2024-09-17T01:19:49.699 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T01:19:49.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T01:19:49.828 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908333 branch: wip-pdonnell-testing-20240916.200549-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/scrub} email: pdonnell@redhat.com first_in_suite: false job_id: '7908333' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240916.200549-debug ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mds: mds cache max size: 1000 mds log max segments: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - Replacing daemon mds - Scrub error on inode - Behind on trimming - Metadata damage detected - bad backtrace on inode - overall HEALTH_ - \(MDS_TRIM\) sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240916.200549-debug sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 993 sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf sleep_before_teardown: 0 subset: 165/512 suite: fs suite_branch: wip-pdonnell-testing-20240916.200549-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi042.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBECzAy1oOeK5YOmJMysghx591/ras3x1ONoKAWEeQPiwSlGcIQsIQLwEN9Y19qJ976LDXuk6bgGi77Ccor+cwv4= smithi043.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBn6JJdtmQ2ohc3kjfEgJtIRxdikKl9Qd/BOxPRk52gsFyxS3iaHaBiJVgo+PE6CEM7uOV82ErDvd9C3DKVrKUA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_scrub_checks - tasks.cephfs.test_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_01:09:11 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T01:19:49.829 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa; will attempt to use it 2024-09-17T01:19:49.829 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks 2024-09-17T01:19:49.829 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T01:19:49.831 INFO:teuthology.task.internal:Checking packages... 2024-09-17T01:19:49.851 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf' 2024-09-17T01:19:49.851 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T01:19:49.851 INFO:teuthology.packaging:ref: None 2024-09-17T01:19:49.851 INFO:teuthology.packaging:tag: None 2024-09-17T01:19:49.851 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240916.200549-debug 2024-09-17T01:19:49.851 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T01:19:49.852 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240916.200549-debug 2024-09-17T01:19:49.990 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4989.gce1b342b 2024-09-17T01:19:49.991 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T01:19:49.997 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T01:19:49.997 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T01:19:50.007 INFO:teuthology.task.internal:Saving configuration 2024-09-17T01:19:50.025 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T01:19:50.034 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T01:19:50.057 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi042.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908333', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 01:15:09.884850', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBECzAy1oOeK5YOmJMysghx591/ras3x1ONoKAWEeQPiwSlGcIQsIQLwEN9Y19qJ976LDXuk6bgGi77Ccor+cwv4='} 2024-09-17T01:19:50.077 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908333', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 01:15:09.883114', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBn6JJdtmQ2ohc3kjfEgJtIRxdikKl9Qd/BOxPRk52gsFyxS3iaHaBiJVgo+PE6CEM7uOV82ErDvd9C3DKVrKUA='} 2024-09-17T01:19:50.077 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T01:19:50.083 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-17T01:19:50.084 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-17T01:19:50.084 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T01:19:50.141 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f250ed03ac0>, signals=[15]) 2024-09-17T01:19:50.141 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T01:19:50.147 INFO:teuthology.task.internal:Opening connections... 2024-09-17T01:19:50.147 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:19:50.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:19:50.225 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T01:19:50.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:19:50.299 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T01:19:50.305 DEBUG:teuthology.orchestra.run.smithi042:> uname -m 2024-09-17T01:19:50.323 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2024-09-17T01:19:50.324 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2024-09-17T01:19:50.382 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream" 2024-09-17T01:19:50.382 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="9" 2024-09-17T01:19:50.382 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos" 2024-09-17T01:19:50.382 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora" 2024-09-17T01:19:50.382 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="9" 2024-09-17T01:19:50.382 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el9" 2024-09-17T01:19:50.383 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T01:19:50.383 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2024-09-17T01:19:50.383 INFO:teuthology.orchestra.run.smithi042.stdout:LOGO="fedora-logo-icon" 2024-09-17T01:19:50.383 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T01:19:50.383 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/" 2024-09-17T01:19:50.383 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T01:19:50.383 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T01:19:50.383 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T01:19:50.384 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2024-09-17T01:19:50.407 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2024-09-17T01:19:50.424 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2024-09-17T01:19:50.425 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2024-09-17T01:19:50.482 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2024-09-17T01:19:50.482 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9" 2024-09-17T01:19:50.482 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2024-09-17T01:19:50.482 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2024-09-17T01:19:50.482 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9" 2024-09-17T01:19:50.482 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9" 2024-09-17T01:19:50.482 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T01:19:50.483 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2024-09-17T01:19:50.483 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon" 2024-09-17T01:19:50.483 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T01:19:50.483 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2024-09-17T01:19:50.483 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T01:19:50.483 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T01:19:50.483 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T01:19:50.483 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2024-09-17T01:19:50.498 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T01:19:50.507 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T01:19:50.513 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T01:19:50.513 DEBUG:teuthology.orchestra.run.smithi042:> test '!' -e /home/ubuntu/cephtest 2024-09-17T01:19:50.516 DEBUG:teuthology.orchestra.run.smithi043:> test '!' -e /home/ubuntu/cephtest 2024-09-17T01:19:50.539 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T01:19:50.545 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T01:19:50.546 DEBUG:teuthology.orchestra.run.smithi042:> test -z $(ls -A /var/lib/ceph) 2024-09-17T01:19:50.574 DEBUG:teuthology.orchestra.run.smithi043:> test -z $(ls -A /var/lib/ceph) 2024-09-17T01:19:50.605 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T01:19:50.661 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T01:19:50.675 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-17T01:19:50.675 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-09-17T01:19:50.675 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-09-17T01:19:50.675 DEBUG:teuthology.orchestra.run.smithi042:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T01:19:50.676 DEBUG:teuthology.orchestra.run.smithi043:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T01:19:50.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:19:50.693 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-17T01:19:50.697 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:19:50.697 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-17T01:19:50.871 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T01:19:50.871 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-17T01:19:50.871 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-09-17T01:19:50.877 DEBUG:teuthology.task.kernel:sha1 for client.1 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T01:19:50.877 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-17T01:19:50.877 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-09-17T01:19:50.889 INFO:teuthology.orchestra.run.smithi042.stdout:5.14.0-503.el9.x86_64 2024-09-17T01:19:50.889 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T01:19:50.890 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-17T01:19:50.890 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum upgrade -y linux-firmware 2024-09-17T01:19:50.894 INFO:teuthology.orchestra.run.smithi043.stdout:5.14.0-503.el9.x86_64 2024-09-17T01:19:50.895 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T01:19:50.895 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-17T01:19:50.895 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum upgrade -y linux-firmware 2024-09-17T01:19:53.486 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-17T01:19:56.044 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - BaseOS 2.5 MB/s | 8.3 MB 00:03 2024-09-17T01:20:00.032 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 3.8 MB/s | 20 MB 00:05 2024-09-17T01:20:00.447 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 20 MB 00:03 2024-09-17T01:20:05.113 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - CRB 8.5 MB/s | 6.5 MB 00:00 2024-09-17T01:20:05.147 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 5.5 MB/s | 6.5 MB 00:01 2024-09-17T01:20:06.697 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 19 kB 00:00 2024-09-17T01:20:06.746 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 19 kB 00:00 2024-09-17T01:20:08.937 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 11 MB/s | 23 MB 00:02 2024-09-17T01:20:08.995 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 11 MB/s | 23 MB 00:02 2024-09-17T01:20:14.483 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-17T01:20:14.690 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-17T01:20:16.568 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-17T01:20:16.579 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-17T01:20:16.579 INFO:teuthology.orchestra.run.smithi042.stdout: Package Architecture Version Repository Size 2024-09-17T01:20:16.579 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-17T01:20:16.579 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrading: 2024-09-17T01:20:16.579 INFO:teuthology.orchestra.run.smithi042.stdout: linux-firmware noarch 20240905-146.el9 baseos 388 M 2024-09-17T01:20:16.579 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:20:16.579 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-17T01:20:16.579 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-17T01:20:16.579 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrade 1 Package 2024-09-17T01:20:16.579 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:20:16.579 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 388 M 2024-09-17T01:20:16.580 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-17T01:20:16.908 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-17T01:20:16.915 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-17T01:20:16.915 INFO:teuthology.orchestra.run.smithi043.stdout: Package Architecture Version Repository Size 2024-09-17T01:20:16.915 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-17T01:20:16.915 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrading: 2024-09-17T01:20:16.915 INFO:teuthology.orchestra.run.smithi043.stdout: linux-firmware noarch 20240905-146.el9 baseos 388 M 2024-09-17T01:20:16.915 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:20:16.915 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-17T01:20:16.915 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-17T01:20:16.915 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrade 1 Package 2024-09-17T01:20:16.915 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:20:16.916 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 388 M 2024-09-17T01:20:16.916 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-17T01:20:21.876 INFO:teuthology.orchestra.run.smithi042.stdout:linux-firmware-20240905-146.el9.noarch.rpm 75 MB/s | 388 MB 00:05 2024-09-17T01:20:21.877 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:20:21.877 INFO:teuthology.orchestra.run.smithi042.stdout:Total 73 MB/s | 388 MB 00:05 2024-09-17T01:20:24.933 INFO:teuthology.orchestra.run.smithi043.stdout:linux-firmware-20240905-146.el9.noarch.rpm 49 MB/s | 388 MB 00:07 2024-09-17T01:20:24.933 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:20:24.933 INFO:teuthology.orchestra.run.smithi043.stdout:Total 48 MB/s | 388 MB 00:08 2024-09-17T01:20:25.151 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-17T01:20:25.257 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-17T01:20:25.257 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-17T01:20:28.208 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-17T01:20:28.292 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-17T01:20:28.292 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-17T01:20:28.708 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-17T01:20:28.708 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-17T01:20:31.704 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-17T01:20:31.704 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-17T01:20:38.638 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-17T01:20:38.953 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-17T01:20:39.045 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-17T01:20:39.797 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: linux-firmware-20240716-145.el9.noarch 2/2 2024-09-17T01:20:39.797 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-17T01:20:40.484 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-17T01:20:40.484 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:20:40.485 INFO:teuthology.orchestra.run.smithi042.stdout:Upgraded: 2024-09-17T01:20:40.485 INFO:teuthology.orchestra.run.smithi042.stdout: linux-firmware-20240905-146.el9.noarch 2024-09-17T01:20:40.485 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:20:40.485 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-17T01:20:40.806 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-17T01:20:40.806 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T01:20:40.954 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-17T01:20:40.954 DEBUG:teuthology.orchestra.run.smithi042:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-17T01:20:40.957 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi042.front.sepia.ceph.com to complete... 2024-09-17T01:20:41.186 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-17T01:20:41.885 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-17T01:20:41.977 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-17T01:20:42.729 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: linux-firmware-20240716-145.el9.noarch 2/2 2024-09-17T01:20:42.729 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-17T01:20:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-17T01:20:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:20:43.591 INFO:teuthology.orchestra.run.smithi043.stdout:Upgraded: 2024-09-17T01:20:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: linux-firmware-20240905-146.el9.noarch 2024-09-17T01:20:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:20:43.591 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-17T01:20:43.974 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-17T01:20:43.974 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T01:20:44.118 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-17T01:20:44.118 DEBUG:teuthology.orchestra.run.smithi043:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-17T01:20:44.121 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi043.front.sepia.ceph.com to complete... 2024-09-17T01:20:49.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17 01:20:49 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-17T01:20:49.069 INFO:teuthology.orchestra.run.smithi042.stderr:FINISHED --2024-09-17 01:20:49-- 2024-09-17T01:20:49.069 INFO:teuthology.orchestra.run.smithi042.stderr:Total wall clock time: 8.1s 2024-09-17T01:20:49.069 INFO:teuthology.orchestra.run.smithi042.stderr:Downloaded: 1 files, 343M in 7.8s (44.0 MB/s) 2024-09-17T01:20:49.072 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-17T01:20:49.072 DEBUG:teuthology.orchestra.run.smithi042:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-17T01:20:51.234 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying... ######################################## 2024-09-17T01:20:51.292 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing... ######################################## 2024-09-17T01:20:51.355 INFO:teuthology.orchestra.run.smithi042.stdout:Updating / installing... 2024-09-17T01:20:53.161 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17 01:20:53 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-17T01:20:53.161 INFO:teuthology.orchestra.run.smithi043.stderr:FINISHED --2024-09-17 01:20:53-- 2024-09-17T01:20:53.161 INFO:teuthology.orchestra.run.smithi043.stderr:Total wall clock time: 9.0s 2024-09-17T01:20:53.161 INFO:teuthology.orchestra.run.smithi043.stderr:Downloaded: 1 files, 343M in 8.6s (39.9 MB/s) 2024-09-17T01:20:53.164 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-17T01:20:53.164 DEBUG:teuthology.orchestra.run.smithi043:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-17T01:20:55.326 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying... ######################################## 2024-09-17T01:20:55.387 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing... ######################################## 2024-09-17T01:20:55.450 INFO:teuthology.orchestra.run.smithi043.stdout:Updating / installing... 2024-09-17T01:20:59.657 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-17T01:21:03.776 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-17T01:21:40.337 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi042.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-17T01:21:40.338 DEBUG:teuthology.orchestra.run.smithi042:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-17T01:21:40.429 INFO:teuthology.orchestra.run.smithi042.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T01:21:40.429 INFO:teuthology.orchestra.run.smithi042.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T01:21:40.429 INFO:teuthology.orchestra.run.smithi042.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T01:21:40.430 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-17T01:21:40.430 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-17T01:21:40.430 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-17T01:21:40.430 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-17T01:21:40.430 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-17T01:21:40.430 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-17T01:21:40.430 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-17T01:21:40.430 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-17T01:21:40.430 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-17T01:21:40.430 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-17T01:21:40.430 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-17T01:21:40.430 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-17T01:21:40.431 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-17T01:21:40.431 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-17T01:21:40.431 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-17T01:21:40.431 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-17T01:21:40.431 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-17T01:21:40.431 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-17T01:21:40.431 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-17T01:21:40.431 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-17T01:21:40.431 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-17T01:21:40.431 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-17T01:21:40.431 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-17T01:21:40.431 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-17T01:21:40.432 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-17T01:21:40.432 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-17T01:21:40.432 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-17T01:21:40.432 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-17T01:21:40.432 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-17T01:21:40.432 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-17T01:21:40.432 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-17T01:21:40.432 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-17T01:21:40.432 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-17T01:21:40.432 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-17T01:21:40.432 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-17T01:21:40.432 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-17T01:21:40.433 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-17T01:21:40.433 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-17T01:21:40.433 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-17T01:21:40.433 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-17T01:21:40.433 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-17T01:21:40.433 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-17T01:21:40.433 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-17T01:21:40.433 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-17T01:21:40.433 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-17T01:21:40.433 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-17T01:21:40.433 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-17T01:21:40.434 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-17T01:21:40.434 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-17T01:21:40.434 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-17T01:21:40.434 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-17T01:21:40.434 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-17T01:21:40.434 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-17T01:21:40.434 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-17T01:21:40.434 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-17T01:21:40.434 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-17T01:21:40.434 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-17T01:21:40.434 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-17T01:21:40.435 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-17T01:21:40.435 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-17T01:21:40.435 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-17T01:21:40.435 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-17T01:21:40.435 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-17T01:21:40.435 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-17T01:21:40.435 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-17T01:21:40.435 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-17T01:21:40.435 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-17T01:21:40.435 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-17T01:21:40.435 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-17T01:21:40.435 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-17T01:21:40.435 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-17T01:21:40.436 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-17T01:21:40.436 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-17T01:21:40.436 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-17T01:21:40.436 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-17T01:21:40.436 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-17T01:21:40.436 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-17T01:21:40.436 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-17T01:21:40.436 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-17T01:21:40.436 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-17T01:21:40.436 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-17T01:21:40.436 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-17T01:21:40.436 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-17T01:21:40.437 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-17T01:21:40.437 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-17T01:21:40.437 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-17T01:21:40.437 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-17T01:21:40.437 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-17T01:21:40.437 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-17T01:21:40.437 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-17T01:21:40.437 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-17T01:21:40.437 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-17T01:21:40.437 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-17T01:21:40.437 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-17T01:21:40.437 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-17T01:21:40.437 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-17T01:21:40.438 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-17T01:21:40.438 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-17T01:21:40.438 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-17T01:21:40.438 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-17T01:21:40.439 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-17T01:21:40.440 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-17T01:21:40.440 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-17T01:21:40.440 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-17T01:21:40.440 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-17T01:21:40.440 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-17T01:21:40.440 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-17T01:21:40.440 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-17T01:21:40.440 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-17T01:21:40.440 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-17T01:21:40.440 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-17T01:21:40.440 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-17T01:21:40.441 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-17T01:21:40.441 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-17T01:21:40.441 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-17T01:21:40.441 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-17T01:21:40.441 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-17T01:21:40.441 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-17T01:21:40.441 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-17T01:21:40.441 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-17T01:21:40.441 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-17T01:21:40.441 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-17T01:21:40.441 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-17T01:21:40.442 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-17T01:21:40.442 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-17T01:21:40.442 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-17T01:21:40.442 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-17T01:21:40.442 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-17T01:21:40.442 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-17T01:21:40.442 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-17T01:21:40.442 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-17T01:21:40.442 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-17T01:21:40.443 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-17T01:21:40.443 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-17T01:21:40.443 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-17T01:21:40.443 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-17T01:21:40.443 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-17T01:21:40.443 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-17T01:21:40.443 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-17T01:21:40.443 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-17T01:21:40.443 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-17T01:21:40.444 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-17T01:21:40.444 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-17T01:21:40.444 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-17T01:21:40.444 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-17T01:21:40.444 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-17T01:21:40.444 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-17T01:21:40.444 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-17T01:21:40.444 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-17T01:21:40.444 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-17T01:21:40.444 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-17T01:21:40.444 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-17T01:21:40.444 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-17T01:21:40.445 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-17T01:21:40.445 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-17T01:21:40.445 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-17T01:21:40.445 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-17T01:21:40.445 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-17T01:21:40.445 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-17T01:21:40.446 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-17T01:21:40.446 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-17T01:21:40.446 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-17T01:21:40.446 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-17T01:21:40.446 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-17T01:21:40.446 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-17T01:21:40.447 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-17T01:21:40.447 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-17T01:21:40.447 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-17T01:21:40.447 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-17T01:21:40.447 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-17T01:21:40.447 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-17T01:21:40.447 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-17T01:21:40.447 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-17T01:21:40.447 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-17T01:21:40.447 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-17T01:21:40.448 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-17T01:21:40.448 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-17T01:21:40.448 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-17T01:21:40.448 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-17T01:21:40.448 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-17T01:21:40.448 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-17T01:21:40.448 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-17T01:21:40.448 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-17T01:21:40.448 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-17T01:21:40.448 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-17T01:21:40.449 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-17T01:21:40.449 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-17T01:21:40.449 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-17T01:21:40.449 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-17T01:21:40.449 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-17T01:21:40.449 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-17T01:21:40.449 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-17T01:21:40.449 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-17T01:21:40.449 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-17T01:21:40.449 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-17T01:21:40.449 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-17T01:21:40.449 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-17T01:21:40.450 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-17T01:21:40.450 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-17T01:21:40.450 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-17T01:21:40.450 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-17T01:21:40.450 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-17T01:21:40.450 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-17T01:21:40.450 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-17T01:21:40.450 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-17T01:21:40.450 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-17T01:21:40.450 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-17T01:21:40.450 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-17T01:21:40.450 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-17T01:21:40.450 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-17T01:21:40.451 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-17T01:21:40.451 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-17T01:21:40.451 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-17T01:21:40.451 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-17T01:21:40.451 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-17T01:21:40.451 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-17T01:21:40.451 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-17T01:21:40.451 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-17T01:21:40.451 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-17T01:21:40.451 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-17T01:21:40.451 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-17T01:21:40.451 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-17T01:21:40.452 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-17T01:21:40.452 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-17T01:21:40.452 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-17T01:21:40.452 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-17T01:21:40.452 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-17T01:21:40.452 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-17T01:21:40.452 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-17T01:21:40.452 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-17T01:21:40.452 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-17T01:21:40.453 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-17T01:21:40.453 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-17T01:21:40.453 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-17T01:21:40.453 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-17T01:21:40.453 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-17T01:21:40.453 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-17T01:21:40.454 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-17T01:21:40.454 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-17T01:21:40.454 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-17T01:21:40.454 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-17T01:21:40.454 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-17T01:21:40.454 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-17T01:21:40.455 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-17T01:21:40.455 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-17T01:21:40.455 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-17T01:21:40.455 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-17T01:21:40.455 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-17T01:21:40.455 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-17T01:21:40.456 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-17T01:21:40.456 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-17T01:21:40.456 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-17T01:21:40.456 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-17T01:21:40.456 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-17T01:21:40.456 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-17T01:21:40.457 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-17T01:21:40.457 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-17T01:21:40.457 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-17T01:21:40.457 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-17T01:21:40.457 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-17T01:21:40.457 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-17T01:21:40.457 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-17T01:21:40.457 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-17T01:21:40.458 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-17T01:21:40.458 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-17T01:21:40.458 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-17T01:21:40.458 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-17T01:21:40.458 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-17T01:21:40.458 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-17T01:21:40.459 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-17T01:21:40.459 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-17T01:21:40.459 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-17T01:21:40.459 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-17T01:21:40.459 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-17T01:21:40.459 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-17T01:21:40.459 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-17T01:21:40.459 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-17T01:21:40.459 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-17T01:21:40.459 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-17T01:21:40.459 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-17T01:21:40.459 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-17T01:21:40.460 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-17T01:21:40.460 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-17T01:21:40.460 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-17T01:21:40.460 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-17T01:21:40.460 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-17T01:21:40.460 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-17T01:21:40.460 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-17T01:21:40.460 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-17T01:21:40.460 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-17T01:21:40.460 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-17T01:21:40.460 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-17T01:21:40.461 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-17T01:21:40.461 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-17T01:21:40.461 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-17T01:21:40.461 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-17T01:21:40.461 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-17T01:21:40.461 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-17T01:21:40.461 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-17T01:21:40.461 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-17T01:21:40.462 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-17T01:21:40.462 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-17T01:21:40.462 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-17T01:21:40.462 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-17T01:21:40.462 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-17T01:21:40.462 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-17T01:21:40.462 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-17T01:21:40.462 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-17T01:21:40.462 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-17T01:21:40.462 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-17T01:21:40.462 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-17T01:21:40.462 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-17T01:21:40.463 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-17T01:21:40.463 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-17T01:21:40.463 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-17T01:21:40.463 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-17T01:21:40.463 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-17T01:21:40.463 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-17T01:21:40.463 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-17T01:21:40.464 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-17T01:21:40.464 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-17T01:21:40.464 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-17T01:21:40.464 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-17T01:21:40.464 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-17T01:21:40.464 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-17T01:21:40.465 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-17T01:21:40.465 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-17T01:21:40.465 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-17T01:21:40.465 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-17T01:21:40.465 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-17T01:21:40.465 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-17T01:21:40.465 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-17T01:21:40.465 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-17T01:21:40.465 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-17T01:21:40.465 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-17T01:21:40.465 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-17T01:21:40.465 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-17T01:21:40.466 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-17T01:21:40.466 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-17T01:21:40.466 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-17T01:21:40.466 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-17T01:21:40.466 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-17T01:21:40.466 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-17T01:21:40.466 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-17T01:21:40.466 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-17T01:21:40.466 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-17T01:21:40.466 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-17T01:21:40.466 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-17T01:21:40.466 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-17T01:21:40.467 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-17T01:21:40.467 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-17T01:21:40.467 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-17T01:21:40.467 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-17T01:21:40.467 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-17T01:21:40.467 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-17T01:21:40.467 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-17T01:21:40.467 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-17T01:21:40.467 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-17T01:21:40.467 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-17T01:21:40.467 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-17T01:21:40.467 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-17T01:21:40.467 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-17T01:21:40.468 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-17T01:21:40.468 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-17T01:21:40.468 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-17T01:21:40.468 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-17T01:21:40.468 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-17T01:21:40.468 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-17T01:21:40.468 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-17T01:21:40.468 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-17T01:21:40.468 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-17T01:21:40.468 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-17T01:21:40.468 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-17T01:21:40.468 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-17T01:21:40.469 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-17T01:21:40.469 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-17T01:21:40.469 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-17T01:21:40.469 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-17T01:21:40.469 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-17T01:21:40.469 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-17T01:21:40.469 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-17T01:21:40.469 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-17T01:21:40.469 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-17T01:21:40.469 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-17T01:21:40.469 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-17T01:21:40.470 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-17T01:21:40.470 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-17T01:21:40.470 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-17T01:21:40.470 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-17T01:21:40.470 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-17T01:21:40.470 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-17T01:21:40.470 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-17T01:21:40.470 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-17T01:21:40.470 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-17T01:21:40.470 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-17T01:21:40.470 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-17T01:21:40.471 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-17T01:21:40.471 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-17T01:21:40.471 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-17T01:21:40.471 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-17T01:21:40.471 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-17T01:21:40.471 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-17T01:21:40.471 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-17T01:21:40.471 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-17T01:21:40.471 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-17T01:21:40.471 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-17T01:21:40.471 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-17T01:21:40.471 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-17T01:21:40.472 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-17T01:21:40.472 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-17T01:21:40.472 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-17T01:21:40.472 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-17T01:21:40.472 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-17T01:21:40.472 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-17T01:21:40.472 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-17T01:21:40.472 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-17T01:21:40.472 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-17T01:21:40.473 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-17T01:21:40.473 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-17T01:21:40.473 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-17T01:21:40.473 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-17T01:21:40.473 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-17T01:21:40.473 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-17T01:21:40.473 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-17T01:21:40.473 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-17T01:21:40.473 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-17T01:21:40.473 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-17T01:21:40.474 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-17T01:21:40.474 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-17T01:21:40.474 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-17T01:21:40.474 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-17T01:21:40.474 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-17T01:21:40.474 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-17T01:21:40.474 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-17T01:21:40.474 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-17T01:21:40.474 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-17T01:21:40.474 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-17T01:21:40.474 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-17T01:21:40.475 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-17T01:21:40.475 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-17T01:21:40.475 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-17T01:21:40.475 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-17T01:21:40.475 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-17T01:21:40.475 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-17T01:21:40.475 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-17T01:21:40.475 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-17T01:21:40.475 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-17T01:21:40.475 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-17T01:21:40.475 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-17T01:21:40.476 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-17T01:21:40.476 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-17T01:21:40.476 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-17T01:21:40.476 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-17T01:21:40.476 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-17T01:21:40.476 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-17T01:21:40.476 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-17T01:21:40.476 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-17T01:21:40.476 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-17T01:21:40.476 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-17T01:21:40.476 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-17T01:21:40.476 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-17T01:21:40.477 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-17T01:21:40.477 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-17T01:21:40.477 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-17T01:21:40.477 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-17T01:21:40.477 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-17T01:21:40.477 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-17T01:21:40.477 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-17T01:21:40.477 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-17T01:21:40.477 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-17T01:21:40.478 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-17T01:21:40.478 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-17T01:21:40.478 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-17T01:21:40.478 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-17T01:21:40.478 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-17T01:21:40.478 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-17T01:21:40.479 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-17T01:21:40.479 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-17T01:21:40.479 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-17T01:21:40.479 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-17T01:21:40.479 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-17T01:21:40.479 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-17T01:21:40.479 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-17T01:21:40.479 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-17T01:21:40.479 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-17T01:21:40.479 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-17T01:21:40.480 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-17T01:21:40.480 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-17T01:21:40.480 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-17T01:21:40.480 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-17T01:21:40.480 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-17T01:21:40.480 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-17T01:21:40.480 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-17T01:21:40.480 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-17T01:21:40.480 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-17T01:21:40.480 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-17T01:21:40.480 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-17T01:21:40.480 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-17T01:21:40.481 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-17T01:21:40.481 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-17T01:21:40.481 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-17T01:21:40.481 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-17T01:21:40.481 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-17T01:21:40.481 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-17T01:21:40.481 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-17T01:21:40.481 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-17T01:21:40.481 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-17T01:21:40.481 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-17T01:21:40.481 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-17T01:21:40.481 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-17T01:21:40.482 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-17T01:21:40.482 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-17T01:21:40.482 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-17T01:21:40.482 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-17T01:21:40.482 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-17T01:21:40.482 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-17T01:21:40.482 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-17T01:21:40.482 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-17T01:21:40.482 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-17T01:21:40.482 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-17T01:21:40.482 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-17T01:21:40.482 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-17T01:21:40.483 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-17T01:21:40.483 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-17T01:21:40.483 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-17T01:21:40.483 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-17T01:21:40.483 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-17T01:21:40.483 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-17T01:21:40.483 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-17T01:21:40.483 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-17T01:21:40.483 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-17T01:21:40.483 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-17T01:21:40.483 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-17T01:21:40.483 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-17T01:21:40.484 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-17T01:21:40.484 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-17T01:21:40.484 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-17T01:21:40.484 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-17T01:21:40.484 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-17T01:21:40.484 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-17T01:21:40.484 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-17T01:21:40.484 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-17T01:21:40.484 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-17T01:21:40.484 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-17T01:21:40.484 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-17T01:21:40.484 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-17T01:21:40.485 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-17T01:21:40.485 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-17T01:21:40.485 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-17T01:21:40.485 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-17T01:21:40.485 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-17T01:21:40.485 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-17T01:21:40.485 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-17T01:21:40.485 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-17T01:21:40.485 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-17T01:21:40.485 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-17T01:21:40.485 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-17T01:21:40.485 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-17T01:21:40.485 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-17T01:21:40.486 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-17T01:21:40.486 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-17T01:21:40.486 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-17T01:21:40.486 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-17T01:21:40.486 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-17T01:21:40.486 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-17T01:21:40.486 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-17T01:21:40.486 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-17T01:21:40.486 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-17T01:21:40.486 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-17T01:21:40.487 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-17T01:21:40.487 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-17T01:21:40.487 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-17T01:21:40.487 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-17T01:21:40.487 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-17T01:21:40.487 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-17T01:21:40.487 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-17T01:21:40.487 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-17T01:21:40.487 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-17T01:21:40.487 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-17T01:21:40.487 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-17T01:21:40.487 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-17T01:21:40.488 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-17T01:21:40.488 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-17T01:21:40.488 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-17T01:21:40.488 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-17T01:21:40.488 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-17T01:21:40.488 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-17T01:21:40.488 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-17T01:21:40.488 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-17T01:21:40.488 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-17T01:21:40.488 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-17T01:21:40.488 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-17T01:21:40.488 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-17T01:21:40.489 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-17T01:21:40.489 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-17T01:21:40.489 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-17T01:21:40.489 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-17T01:21:40.489 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-17T01:21:40.489 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-17T01:21:40.489 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-17T01:21:40.489 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-17T01:21:40.489 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-17T01:21:40.489 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-17T01:21:40.489 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-17T01:21:40.489 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-17T01:21:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-17T01:21:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-17T01:21:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-17T01:21:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-17T01:21:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-17T01:21:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-17T01:21:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-17T01:21:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-17T01:21:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-17T01:21:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-17T01:21:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-17T01:21:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-17T01:21:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-17T01:21:40.491 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-17T01:21:40.491 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-17T01:21:40.491 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-17T01:21:40.491 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-17T01:21:40.491 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-17T01:21:40.491 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-17T01:21:40.491 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-17T01:21:40.491 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-17T01:21:40.491 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-17T01:21:40.491 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-17T01:21:40.491 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-17T01:21:40.491 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-17T01:21:40.491 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-17T01:21:40.492 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-17T01:21:40.492 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-17T01:21:40.492 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-17T01:21:40.492 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-17T01:21:40.492 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-17T01:21:40.492 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-17T01:21:40.492 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-17T01:21:40.492 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-17T01:21:40.492 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-17T01:21:40.492 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-17T01:21:40.492 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-17T01:21:40.492 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-17T01:21:40.493 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-17T01:21:40.493 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-17T01:21:40.493 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-17T01:21:40.493 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-17T01:21:40.493 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-17T01:21:40.493 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-17T01:21:40.493 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-17T01:21:40.493 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-17T01:21:40.493 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-17T01:21:40.493 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-17T01:21:40.493 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-17T01:21:40.493 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-17T01:21:40.494 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-17T01:21:40.494 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-17T01:21:40.494 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-17T01:21:40.494 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-17T01:21:40.494 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-17T01:21:40.494 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-17T01:21:40.494 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-17T01:21:40.494 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-17T01:21:40.494 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-17T01:21:40.494 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-17T01:21:40.494 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-17T01:21:40.494 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-17T01:21:40.494 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-17T01:21:40.495 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-17T01:21:40.495 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-17T01:21:40.495 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-17T01:21:40.495 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-17T01:21:40.495 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-17T01:21:40.495 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-17T01:21:40.495 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-17T01:21:40.495 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-17T01:21:40.495 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-17T01:21:40.495 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-17T01:21:40.495 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-17T01:21:40.495 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-17T01:21:40.496 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-17T01:21:40.496 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-17T01:21:40.496 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-17T01:21:40.496 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-17T01:21:40.496 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-17T01:21:40.496 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-17T01:21:40.496 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-17T01:21:40.496 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-17T01:21:40.496 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-17T01:21:40.496 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-17T01:21:40.496 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-17T01:21:40.496 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-17T01:21:40.497 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-17T01:21:40.497 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-17T01:21:40.497 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-17T01:21:40.497 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-17T01:21:40.497 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-17T01:21:40.497 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-17T01:21:40.497 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-17T01:21:40.497 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-17T01:21:40.497 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-17T01:21:40.497 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-17T01:21:40.497 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-17T01:21:40.498 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-17T01:21:40.498 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-17T01:21:40.498 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-17T01:21:40.498 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-17T01:21:40.498 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-17T01:21:40.498 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-17T01:21:40.498 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-17T01:21:40.498 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-17T01:21:40.498 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-17T01:21:40.498 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-17T01:21:40.498 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-17T01:21:40.498 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-17T01:21:40.499 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-17T01:21:40.499 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-17T01:21:40.499 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-17T01:21:40.499 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-17T01:21:40.499 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-17T01:21:40.499 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-17T01:21:40.499 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-17T01:21:40.499 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-17T01:21:40.499 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-17T01:21:40.499 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-17T01:21:40.499 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-17T01:21:40.499 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-17T01:21:40.500 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-17T01:21:40.500 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-17T01:21:40.500 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-17T01:21:40.500 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-17T01:21:40.500 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-17T01:21:40.500 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-17T01:21:40.500 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-17T01:21:40.500 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-17T01:21:40.500 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-17T01:21:40.500 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-17T01:21:40.500 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-17T01:21:40.500 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-17T01:21:40.501 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-17T01:21:40.501 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-17T01:21:40.501 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-17T01:21:40.501 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-17T01:21:40.501 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-17T01:21:40.501 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-17T01:21:40.501 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-17T01:21:40.501 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-17T01:21:40.501 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-17T01:21:40.501 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-17T01:21:40.501 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-17T01:21:40.501 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-17T01:21:40.502 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-17T01:21:40.502 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-17T01:21:40.502 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-17T01:21:40.502 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-17T01:21:40.502 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-17T01:21:40.502 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-17T01:21:40.502 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-17T01:21:40.502 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-17T01:21:40.502 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-17T01:21:40.502 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-17T01:21:40.502 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-17T01:21:40.502 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-17T01:21:40.503 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-17T01:21:40.503 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-17T01:21:40.503 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-17T01:21:40.503 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-17T01:21:40.503 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-17T01:21:40.503 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-17T01:21:40.503 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-17T01:21:40.503 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-17T01:21:40.503 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-17T01:21:40.503 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-17T01:21:40.503 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-17T01:21:40.503 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-17T01:21:40.503 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-17T01:21:40.504 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-17T01:21:40.504 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-17T01:21:40.504 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-17T01:21:40.504 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-17T01:21:40.504 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-17T01:21:40.504 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-17T01:21:40.504 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-17T01:21:40.504 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-17T01:21:40.504 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-17T01:21:40.504 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-17T01:21:40.504 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-17T01:21:40.505 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-17T01:21:40.505 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-17T01:21:40.505 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-17T01:21:40.505 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-17T01:21:40.505 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-17T01:21:40.505 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-17T01:21:40.505 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-17T01:21:40.505 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-17T01:21:40.505 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-17T01:21:40.505 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-17T01:21:40.505 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-17T01:21:40.505 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-17T01:21:40.505 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-17T01:21:40.506 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-17T01:21:40.506 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-17T01:21:40.506 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-17T01:21:40.506 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-17T01:21:40.506 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-17T01:21:40.506 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-17T01:21:40.506 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-17T01:21:40.506 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-17T01:21:40.506 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-17T01:21:40.506 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-17T01:21:40.506 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-17T01:21:40.506 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-17T01:21:40.507 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-17T01:21:40.507 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-17T01:21:40.507 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-17T01:21:40.507 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-17T01:21:40.507 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-17T01:21:40.507 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-17T01:21:40.507 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-17T01:21:40.507 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-17T01:21:40.507 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-17T01:21:40.507 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-17T01:21:40.507 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-17T01:21:40.507 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-17T01:21:40.507 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-17T01:21:40.508 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-17T01:21:40.508 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-17T01:21:40.508 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-17T01:21:40.508 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-17T01:21:40.508 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-17T01:21:40.508 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-17T01:21:40.508 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-17T01:21:40.508 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-17T01:21:40.508 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-17T01:21:40.508 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-17T01:21:40.508 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-17T01:21:40.508 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-17T01:21:40.509 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-17T01:21:40.509 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-17T01:21:40.509 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-17T01:21:40.509 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-17T01:21:40.509 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-17T01:21:40.509 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-17T01:21:40.510 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-17T01:21:40.510 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-17T01:21:40.510 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-17T01:21:40.510 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-17T01:21:40.510 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-17T01:21:40.510 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-17T01:21:40.510 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-17T01:21:40.510 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-17T01:21:40.510 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-17T01:21:40.510 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-17T01:21:40.510 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-17T01:21:40.510 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-17T01:21:40.510 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-17T01:21:40.511 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-17T01:21:40.511 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-17T01:21:40.511 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-17T01:21:40.511 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-17T01:21:40.511 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-17T01:21:40.511 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-17T01:21:40.511 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-17T01:21:40.511 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-17T01:21:40.511 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-17T01:21:40.511 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-17T01:21:40.511 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-17T01:21:40.511 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-17T01:21:40.512 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-17T01:21:40.512 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-17T01:21:40.512 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-17T01:21:40.512 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-17T01:21:40.512 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-17T01:21:40.512 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-17T01:21:40.512 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-17T01:21:40.512 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-17T01:21:40.512 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-17T01:21:40.512 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-17T01:21:40.512 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-17T01:21:40.512 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-17T01:21:40.512 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-17T01:21:40.513 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-17T01:21:40.513 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-17T01:21:40.513 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-17T01:21:40.513 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-17T01:21:40.513 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-17T01:21:40.513 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-17T01:21:40.513 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-17T01:21:40.513 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-17T01:21:40.513 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-17T01:21:40.513 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-17T01:21:40.513 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-17T01:21:40.513 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-17T01:21:40.514 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-17T01:21:40.514 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-17T01:21:40.514 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-17T01:21:40.514 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-17T01:21:40.514 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-17T01:21:40.514 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-17T01:21:40.514 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-17T01:21:40.514 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-17T01:21:40.514 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-17T01:21:40.514 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-17T01:21:40.514 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-17T01:21:40.514 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-17T01:21:40.514 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-17T01:21:40.515 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-17T01:21:40.515 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-17T01:21:40.515 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-17T01:21:40.515 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-17T01:21:40.515 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-17T01:21:40.515 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-17T01:21:40.515 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-17T01:21:40.515 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-17T01:21:40.515 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-17T01:21:40.515 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-17T01:21:40.515 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-17T01:21:40.516 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-17T01:21:40.516 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-17T01:21:40.516 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-17T01:21:40.516 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-17T01:21:40.516 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-17T01:21:40.516 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-17T01:21:40.516 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-17T01:21:40.516 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-17T01:21:40.516 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-17T01:21:40.516 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-17T01:21:40.516 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-17T01:21:40.516 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-17T01:21:40.517 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-17T01:21:40.517 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-17T01:21:40.517 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-17T01:21:40.517 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-17T01:21:40.517 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-17T01:21:40.517 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-17T01:21:40.517 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-17T01:21:40.517 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-17T01:21:40.517 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-17T01:21:40.517 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-17T01:21:40.517 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-17T01:21:40.517 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-17T01:21:40.517 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-17T01:21:40.518 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-17T01:21:40.518 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-17T01:21:40.518 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-17T01:21:40.518 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-17T01:21:40.518 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-17T01:21:40.518 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-17T01:21:40.518 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-17T01:21:40.518 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-17T01:21:40.518 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-17T01:21:40.518 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-17T01:21:40.518 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-17T01:21:40.518 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-17T01:21:40.519 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-17T01:21:40.519 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-17T01:21:40.519 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-17T01:21:40.519 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-17T01:21:40.519 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-17T01:21:40.519 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-17T01:21:40.519 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-17T01:21:40.519 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-17T01:21:40.519 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-17T01:21:40.519 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-17T01:21:40.519 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-17T01:21:40.519 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-17T01:21:40.519 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-17T01:21:40.520 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-17T01:21:40.520 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-17T01:21:40.520 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-17T01:21:40.520 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-17T01:21:40.520 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-17T01:21:40.520 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-17T01:21:40.520 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-17T01:21:40.520 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-17T01:21:40.520 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-17T01:21:40.520 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-17T01:21:40.520 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-17T01:21:40.520 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-17T01:21:40.520 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-17T01:21:40.521 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-17T01:21:40.521 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-17T01:21:40.521 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-17T01:21:40.521 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-17T01:21:40.521 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-17T01:21:40.521 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-17T01:21:40.521 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-17T01:21:40.521 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-17T01:21:40.521 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-17T01:21:40.521 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-17T01:21:40.521 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-17T01:21:40.521 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-17T01:21:40.521 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-17T01:21:40.521 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-17T01:21:40.522 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-17T01:21:40.522 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-17T01:21:40.522 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-17T01:21:40.522 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-17T01:21:40.522 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-17T01:21:40.522 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-17T01:21:40.522 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-17T01:21:40.522 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-17T01:21:40.522 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-17T01:21:40.522 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-17T01:21:40.522 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-17T01:21:40.522 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-17T01:21:40.522 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-17T01:21:40.523 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-17T01:21:40.523 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-17T01:21:40.523 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-17T01:21:40.523 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-17T01:21:40.523 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-17T01:21:40.523 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-17T01:21:40.523 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-17T01:21:40.523 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-17T01:21:40.523 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-17T01:21:40.523 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-17T01:21:40.524 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-17T01:21:40.524 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-17T01:21:40.524 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-17T01:21:40.524 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-17T01:21:40.524 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-17T01:21:40.524 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-17T01:21:40.524 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-17T01:21:40.524 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-17T01:21:40.524 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-17T01:21:40.525 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-17T01:21:40.525 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-17T01:21:40.525 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-17T01:21:40.525 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-17T01:21:40.525 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-17T01:21:40.525 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-17T01:21:40.525 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-17T01:21:40.525 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-17T01:21:40.526 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-17T01:21:40.526 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-17T01:21:40.526 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-17T01:21:40.526 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-17T01:21:40.526 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-17T01:21:40.526 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-17T01:21:40.526 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-17T01:21:40.526 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-17T01:21:40.527 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-17T01:21:40.527 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-17T01:21:40.527 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-17T01:21:40.527 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-17T01:21:40.527 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-17T01:21:40.527 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-17T01:21:40.527 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-17T01:21:40.527 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-17T01:21:40.528 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-17T01:21:40.528 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-17T01:21:40.528 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-17T01:21:40.528 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-17T01:21:40.528 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-17T01:21:40.528 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-17T01:21:40.528 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-17T01:21:40.528 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-17T01:21:40.528 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-17T01:21:40.529 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-17T01:21:40.529 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-17T01:21:40.529 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-17T01:21:40.529 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-17T01:21:40.529 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-17T01:21:40.529 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-17T01:21:40.529 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-17T01:21:40.530 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-17T01:21:40.530 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-17T01:21:40.530 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-17T01:21:40.530 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-17T01:21:40.530 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-17T01:21:40.530 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-17T01:21:40.530 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-17T01:21:40.530 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-17T01:21:40.531 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-17T01:21:40.531 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-17T01:21:40.531 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-17T01:21:40.531 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-17T01:21:40.531 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-17T01:21:40.531 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-17T01:21:40.531 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-17T01:21:40.531 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-17T01:21:40.531 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-17T01:21:40.532 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-17T01:21:40.532 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-17T01:21:40.532 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-17T01:21:40.532 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-17T01:21:40.532 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-17T01:21:40.532 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-17T01:21:40.532 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-17T01:21:40.532 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-17T01:21:40.533 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-17T01:21:40.533 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-17T01:21:40.533 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-17T01:21:40.533 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-17T01:21:40.533 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-17T01:21:40.533 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-17T01:21:40.533 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-17T01:21:40.533 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-17T01:21:40.534 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-17T01:21:40.534 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-17T01:21:40.534 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-17T01:21:40.534 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-17T01:21:40.534 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-17T01:21:40.534 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-17T01:21:40.534 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-17T01:21:40.534 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-17T01:21:40.534 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-17T01:21:40.535 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-17T01:21:40.535 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-17T01:21:40.535 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-17T01:21:40.535 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-17T01:21:40.535 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-17T01:21:40.535 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-17T01:21:40.535 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-17T01:21:40.535 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-17T01:21:40.536 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-17T01:21:40.536 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-17T01:21:40.536 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-17T01:21:40.536 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-17T01:21:40.536 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-17T01:21:40.536 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-17T01:21:40.536 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-17T01:21:40.536 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-17T01:21:40.537 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-17T01:21:40.537 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-17T01:21:40.537 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-17T01:21:40.537 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-17T01:21:40.537 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-17T01:21:40.537 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-17T01:21:40.537 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-17T01:21:40.537 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-17T01:21:40.538 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-17T01:21:40.538 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-17T01:21:40.538 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-17T01:21:40.538 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-17T01:21:40.538 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-17T01:21:40.538 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-17T01:21:40.538 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-17T01:21:40.538 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-17T01:21:40.538 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-17T01:21:40.538 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-17T01:21:40.538 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-17T01:21:40.539 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-17T01:21:40.539 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-17T01:21:40.539 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-17T01:21:40.539 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-17T01:21:40.539 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-17T01:21:40.539 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-17T01:21:40.539 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-17T01:21:40.539 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-17T01:21:40.539 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-17T01:21:40.539 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-17T01:21:40.539 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-17T01:21:40.539 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-17T01:21:40.539 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-17T01:21:40.539 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-17T01:21:40.540 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-17T01:21:40.540 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-17T01:21:40.540 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-17T01:21:40.540 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-17T01:21:40.540 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-17T01:21:40.540 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-17T01:21:40.540 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-17T01:21:40.540 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-17T01:21:40.540 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-17T01:21:40.540 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-17T01:21:40.540 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-17T01:21:40.540 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-17T01:21:40.540 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-17T01:21:40.541 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-17T01:21:40.541 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-17T01:21:40.541 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-17T01:21:40.541 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-17T01:21:40.541 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-17T01:21:40.541 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-17T01:21:40.541 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-17T01:21:40.541 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-17T01:21:40.541 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-17T01:21:40.541 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-17T01:21:40.541 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-17T01:21:40.541 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-17T01:21:40.542 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-17T01:21:40.542 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-17T01:21:40.542 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-17T01:21:40.542 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-17T01:21:40.542 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-17T01:21:40.542 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-17T01:21:40.542 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-17T01:21:40.542 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-17T01:21:40.542 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-17T01:21:40.542 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-17T01:21:40.542 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-17T01:21:40.543 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-17T01:21:40.543 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-17T01:21:40.543 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-17T01:21:40.543 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-17T01:21:40.543 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-17T01:21:40.543 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-17T01:21:40.543 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-17T01:21:40.543 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-17T01:21:40.543 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-17T01:21:40.543 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-17T01:21:40.544 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-17T01:21:40.544 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-17T01:21:40.544 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-17T01:21:40.544 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-17T01:21:40.544 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-17T01:21:40.544 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-17T01:21:40.544 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-17T01:21:40.544 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-17T01:21:40.544 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-17T01:21:40.544 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-17T01:21:40.544 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-17T01:21:40.544 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-17T01:21:40.545 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-17T01:21:40.545 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-17T01:21:40.545 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-17T01:21:40.545 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-17T01:21:40.545 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-17T01:21:40.545 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-17T01:21:40.545 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-17T01:21:40.545 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-17T01:21:40.545 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-17T01:21:40.545 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-17T01:21:40.545 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-17T01:21:40.545 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-17T01:21:40.546 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-17T01:21:40.546 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-17T01:21:40.546 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-17T01:21:40.546 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-17T01:21:40.546 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-17T01:21:40.546 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-17T01:21:40.546 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-17T01:21:40.546 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-17T01:21:40.546 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-17T01:21:40.546 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-17T01:21:40.547 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-17T01:21:40.547 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-17T01:21:40.547 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-17T01:21:40.547 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-17T01:21:40.547 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-17T01:21:40.547 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-17T01:21:40.547 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-17T01:21:40.547 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-17T01:21:40.547 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-17T01:21:40.547 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-17T01:21:40.547 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-17T01:21:40.548 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-17T01:21:40.548 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-17T01:21:40.548 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-17T01:21:40.548 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-17T01:21:40.548 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-17T01:21:40.548 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-17T01:21:40.548 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-17T01:21:40.548 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-17T01:21:40.548 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-17T01:21:40.548 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-17T01:21:40.548 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-17T01:21:40.549 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-17T01:21:40.549 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-17T01:21:40.549 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-17T01:21:40.549 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-17T01:21:40.549 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-17T01:21:40.549 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-17T01:21:40.549 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-17T01:21:40.549 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-17T01:21:40.549 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-17T01:21:40.549 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-17T01:21:40.549 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-17T01:21:40.549 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-17T01:21:40.549 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-17T01:21:40.550 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-17T01:21:40.550 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-17T01:21:40.550 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-17T01:21:40.550 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-17T01:21:40.550 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-17T01:21:40.550 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-17T01:21:40.550 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-17T01:21:40.550 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-17T01:21:40.550 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-17T01:21:40.550 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-17T01:21:40.550 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-17T01:21:40.550 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-17T01:21:40.550 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-17T01:21:40.550 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-17T01:21:40.551 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-17T01:21:40.551 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-17T01:21:40.551 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-17T01:21:40.551 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-17T01:21:40.551 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-17T01:21:40.551 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-17T01:21:40.551 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-17T01:21:40.551 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-17T01:21:40.551 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-17T01:21:40.551 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-17T01:21:40.551 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-17T01:21:40.551 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-17T01:21:40.552 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-17T01:21:40.552 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-17T01:21:40.552 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-17T01:21:40.552 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-17T01:21:40.552 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-17T01:21:40.552 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-17T01:21:40.552 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-17T01:21:40.552 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-17T01:21:40.552 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-17T01:21:40.552 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-17T01:21:40.552 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-17T01:21:40.552 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-17T01:21:40.553 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-17T01:21:40.553 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-17T01:21:40.553 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-17T01:21:40.553 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-17T01:21:40.553 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-17T01:21:40.553 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-17T01:21:40.553 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-17T01:21:40.553 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-17T01:21:40.553 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-17T01:21:40.553 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-17T01:21:40.553 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-17T01:21:40.553 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-17T01:21:40.553 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-17T01:21:40.553 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-17T01:21:40.554 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-17T01:21:40.554 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-17T01:21:40.554 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-17T01:21:40.554 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-17T01:21:40.554 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-17T01:21:40.554 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-17T01:21:40.554 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-17T01:21:40.554 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-17T01:21:40.554 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-17T01:21:40.554 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-17T01:21:40.554 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-17T01:21:40.555 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-17T01:21:40.555 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-17T01:21:40.555 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-17T01:21:40.555 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-17T01:21:40.555 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-17T01:21:40.555 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-17T01:21:40.555 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-17T01:21:40.555 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-17T01:21:40.555 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-17T01:21:40.555 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-17T01:21:40.555 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-17T01:21:40.555 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-17T01:21:40.555 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-17T01:21:40.556 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-17T01:21:40.556 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-17T01:21:40.556 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-17T01:21:40.556 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-17T01:21:40.556 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-17T01:21:40.556 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-17T01:21:40.556 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-17T01:21:40.556 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-17T01:21:40.556 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-17T01:21:40.556 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-17T01:21:40.556 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-17T01:21:40.557 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-17T01:21:40.557 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-17T01:21:40.557 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-17T01:21:40.557 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-17T01:21:40.557 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-17T01:21:40.557 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-17T01:21:40.557 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-17T01:21:40.557 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-17T01:21:40.557 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-17T01:21:40.557 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-17T01:21:40.557 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-17T01:21:40.557 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-17T01:21:40.558 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-17T01:21:40.558 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-17T01:21:40.558 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-17T01:21:40.558 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-17T01:21:40.558 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-17T01:21:40.558 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-17T01:21:40.558 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-17T01:21:40.558 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-17T01:21:40.558 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-17T01:21:40.558 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-17T01:21:40.558 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-17T01:21:40.559 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-17T01:21:40.559 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-17T01:21:40.559 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-17T01:21:40.559 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-17T01:21:40.559 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-17T01:21:40.559 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-17T01:21:40.559 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-17T01:21:40.559 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-17T01:21:40.559 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-17T01:21:40.559 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-17T01:21:40.559 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-17T01:21:40.559 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-17T01:21:40.559 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-17T01:21:40.560 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-17T01:21:40.560 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-17T01:21:40.560 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-17T01:21:40.560 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-17T01:21:40.560 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-17T01:21:40.560 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-17T01:21:40.560 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-17T01:21:40.560 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-17T01:21:40.560 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-17T01:21:40.560 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-17T01:21:40.560 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-17T01:21:40.560 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-17T01:21:40.560 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-17T01:21:40.561 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-17T01:21:40.561 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-17T01:21:40.561 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-17T01:21:40.561 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-17T01:21:40.561 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-17T01:21:40.561 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-17T01:21:40.561 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-17T01:21:40.561 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-17T01:21:40.561 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-17T01:21:40.561 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-17T01:21:40.561 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-17T01:21:40.562 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-17T01:21:40.562 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-17T01:21:40.562 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-17T01:21:40.562 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-17T01:21:40.562 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-17T01:21:40.562 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-17T01:21:40.562 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-17T01:21:40.562 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-17T01:21:40.562 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-17T01:21:40.562 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-17T01:21:40.562 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-17T01:21:40.562 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-17T01:21:40.562 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-17T01:21:40.563 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-17T01:21:40.563 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-17T01:21:40.563 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-17T01:21:40.563 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-17T01:21:40.563 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-17T01:21:40.563 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-17T01:21:40.563 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-17T01:21:40.563 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-17T01:21:40.563 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-17T01:21:40.563 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-17T01:21:40.563 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-17T01:21:40.563 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-17T01:21:40.563 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-17T01:21:40.564 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-17T01:21:40.564 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-17T01:21:40.564 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-17T01:21:40.564 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-17T01:21:40.564 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-17T01:21:40.564 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-17T01:21:40.564 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-17T01:21:40.564 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-17T01:21:40.564 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-17T01:21:40.564 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-17T01:21:40.564 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-17T01:21:40.564 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-17T01:21:40.564 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-17T01:21:40.565 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-17T01:21:40.565 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-17T01:21:40.565 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-17T01:21:40.565 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-17T01:21:40.565 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-17T01:21:40.565 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-17T01:21:40.565 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-17T01:21:40.565 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-17T01:21:40.565 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-17T01:21:40.565 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-17T01:21:40.565 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-17T01:21:40.565 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-17T01:21:40.565 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-17T01:21:40.566 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-17T01:21:40.566 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-17T01:21:40.566 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-17T01:21:40.566 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-17T01:21:40.566 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-17T01:21:40.566 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-17T01:21:40.566 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-17T01:21:40.566 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-17T01:21:40.566 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-17T01:21:40.566 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-17T01:21:40.567 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-17T01:21:40.567 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-17T01:21:40.567 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-17T01:21:40.567 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-17T01:21:40.567 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-17T01:21:40.567 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-17T01:21:40.567 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-17T01:21:40.567 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-17T01:21:40.567 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-17T01:21:40.567 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-17T01:21:40.567 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-17T01:21:40.567 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-17T01:21:40.567 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-17T01:21:40.568 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-17T01:21:40.568 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-17T01:21:40.568 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-17T01:21:40.568 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-17T01:21:40.568 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-17T01:21:40.568 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-17T01:21:40.568 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-17T01:21:40.568 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-17T01:21:40.568 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-17T01:21:40.568 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-17T01:21:40.568 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-17T01:21:40.568 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-17T01:21:40.568 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-17T01:21:40.569 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-17T01:21:40.569 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-17T01:21:40.569 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-17T01:21:40.569 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-17T01:21:40.569 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-17T01:21:40.569 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-17T01:21:40.569 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-17T01:21:40.569 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-17T01:21:40.569 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-17T01:21:40.569 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-17T01:21:40.569 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-17T01:21:40.569 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-17T01:21:40.570 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-17T01:21:40.570 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-17T01:21:40.570 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-17T01:21:40.570 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-17T01:21:40.570 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-17T01:21:40.570 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-17T01:21:40.570 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-17T01:21:40.570 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-17T01:21:40.570 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-17T01:21:40.570 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-17T01:21:40.570 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-17T01:21:40.570 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-17T01:21:40.571 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-17T01:21:40.571 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-17T01:21:40.571 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-17T01:21:40.571 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-17T01:21:40.571 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-17T01:21:40.571 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-17T01:21:40.571 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-17T01:21:40.571 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-17T01:21:40.571 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-17T01:21:40.571 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-17T01:21:40.571 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-17T01:21:40.572 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-17T01:21:40.572 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-17T01:21:40.572 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-17T01:21:40.572 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-17T01:21:40.572 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-17T01:21:40.572 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-17T01:21:40.572 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-17T01:21:40.572 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-17T01:21:40.572 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-17T01:21:40.572 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-17T01:21:40.572 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-17T01:21:40.572 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-17T01:21:40.572 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-17T01:21:40.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-17T01:21:40.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-17T01:21:40.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-17T01:21:40.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-17T01:21:40.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-17T01:21:40.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-17T01:21:40.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-17T01:21:40.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-17T01:21:40.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-17T01:21:40.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-17T01:21:40.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-17T01:21:40.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-17T01:21:40.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-17T01:21:40.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-17T01:21:40.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-17T01:21:40.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-17T01:21:40.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-17T01:21:40.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-17T01:21:40.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-17T01:21:40.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-17T01:21:40.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-17T01:21:40.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-17T01:21:40.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-17T01:21:40.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-17T01:21:40.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-17T01:21:40.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-17T01:21:40.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-17T01:21:40.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-17T01:21:40.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-17T01:21:40.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-17T01:21:40.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-17T01:21:40.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-17T01:21:40.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-17T01:21:40.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-17T01:21:40.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-17T01:21:40.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-17T01:21:40.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-17T01:21:40.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-17T01:21:40.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-17T01:21:40.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-17T01:21:40.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-17T01:21:40.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-17T01:21:40.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-17T01:21:40.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-17T01:21:40.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-17T01:21:40.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-17T01:21:40.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-17T01:21:40.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-17T01:21:40.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-17T01:21:40.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-17T01:21:40.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-17T01:21:40.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-17T01:21:40.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-17T01:21:40.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-17T01:21:40.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-17T01:21:40.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-17T01:21:40.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-17T01:21:40.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-17T01:21:40.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-17T01:21:40.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-17T01:21:40.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-17T01:21:40.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-17T01:21:40.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-17T01:21:40.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-17T01:21:40.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-17T01:21:40.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-17T01:21:40.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-17T01:21:40.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-17T01:21:40.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-17T01:21:40.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-17T01:21:40.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-17T01:21:40.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-17T01:21:40.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-17T01:21:40.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-17T01:21:40.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-17T01:21:40.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-17T01:21:40.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-17T01:21:40.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-17T01:21:40.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-17T01:21:40.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-17T01:21:40.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-17T01:21:40.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-17T01:21:40.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-17T01:21:40.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-17T01:21:40.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-17T01:21:40.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-17T01:21:40.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-17T01:21:40.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-17T01:21:40.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-17T01:21:40.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-17T01:21:40.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-17T01:21:40.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-17T01:21:40.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-17T01:21:40.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-17T01:21:40.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-17T01:21:40.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-17T01:21:40.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-17T01:21:40.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-17T01:21:40.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-17T01:21:40.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-17T01:21:40.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-17T01:21:40.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-17T01:21:40.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-17T01:21:40.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-17T01:21:40.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-17T01:21:40.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-17T01:21:40.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-17T01:21:40.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-17T01:21:40.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-17T01:21:40.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-17T01:21:40.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-17T01:21:40.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-17T01:21:40.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-17T01:21:40.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-17T01:21:40.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-17T01:21:40.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-17T01:21:40.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-17T01:21:40.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-17T01:21:40.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-17T01:21:40.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-17T01:21:40.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-17T01:21:40.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-17T01:21:40.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-17T01:21:40.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-17T01:21:40.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-17T01:21:40.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-17T01:21:40.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-17T01:21:40.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-17T01:21:40.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-17T01:21:40.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-17T01:21:40.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-17T01:21:40.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-17T01:21:40.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-17T01:21:40.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-17T01:21:40.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-17T01:21:40.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-17T01:21:40.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-17T01:21:40.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-17T01:21:40.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-17T01:21:40.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-17T01:21:40.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-17T01:21:40.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-17T01:21:40.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-17T01:21:40.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-17T01:21:40.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-17T01:21:40.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-17T01:21:40.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-17T01:21:40.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-17T01:21:40.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-17T01:21:40.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-17T01:21:40.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-17T01:21:40.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-17T01:21:40.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-17T01:21:40.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-17T01:21:40.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-17T01:21:40.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-17T01:21:40.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-17T01:21:40.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-17T01:21:40.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-17T01:21:40.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-17T01:21:40.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-17T01:21:40.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-17T01:21:40.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-17T01:21:40.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-17T01:21:40.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-17T01:21:40.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-17T01:21:40.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-17T01:21:40.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-17T01:21:40.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-17T01:21:40.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-17T01:21:40.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-17T01:21:40.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-17T01:21:40.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-17T01:21:40.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-17T01:21:40.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-17T01:21:40.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-17T01:21:40.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-17T01:21:40.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-17T01:21:40.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-17T01:21:40.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-17T01:21:40.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-17T01:21:40.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-17T01:21:40.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-17T01:21:40.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-17T01:21:40.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-17T01:21:40.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-17T01:21:40.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-17T01:21:40.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-17T01:21:40.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-17T01:21:40.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-17T01:21:40.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-17T01:21:40.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-17T01:21:40.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-17T01:21:40.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-17T01:21:40.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-17T01:21:40.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-17T01:21:40.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-17T01:21:40.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-17T01:21:40.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-17T01:21:40.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-17T01:21:40.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-17T01:21:40.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-17T01:21:40.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-17T01:21:40.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-17T01:21:40.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-17T01:21:40.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-17T01:21:40.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-17T01:21:40.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-17T01:21:40.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-17T01:21:40.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-17T01:21:40.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-17T01:21:40.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-17T01:21:40.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-17T01:21:40.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-17T01:21:40.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-17T01:21:40.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-17T01:21:40.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-17T01:21:40.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-17T01:21:40.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-17T01:21:40.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-17T01:21:40.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-17T01:21:40.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-17T01:21:40.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-17T01:21:40.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-17T01:21:40.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-17T01:21:40.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-17T01:21:40.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-17T01:21:40.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-17T01:21:40.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-17T01:21:40.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-17T01:21:40.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-17T01:21:40.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-17T01:21:40.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-17T01:21:40.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-17T01:21:40.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-17T01:21:40.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-17T01:21:40.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-17T01:21:40.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-17T01:21:40.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-17T01:21:40.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-17T01:21:40.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-17T01:21:40.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-17T01:21:40.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-17T01:21:40.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-17T01:21:40.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-17T01:21:40.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-17T01:21:40.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-17T01:21:40.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-17T01:21:40.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-17T01:21:40.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-17T01:21:40.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-17T01:21:40.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-17T01:21:40.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-17T01:21:40.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-17T01:21:40.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-17T01:21:40.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-17T01:21:40.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-17T01:21:40.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-17T01:21:40.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-17T01:21:40.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-17T01:21:40.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-17T01:21:40.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-17T01:21:40.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-17T01:21:40.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-17T01:21:40.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-17T01:21:40.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-17T01:21:40.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-17T01:21:40.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-17T01:21:40.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-17T01:21:40.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-17T01:21:40.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-17T01:21:40.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-17T01:21:40.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-17T01:21:40.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-17T01:21:40.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-17T01:21:40.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-17T01:21:40.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-17T01:21:40.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-17T01:21:40.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-17T01:21:40.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-17T01:21:40.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-17T01:21:40.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-17T01:21:40.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-17T01:21:40.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-17T01:21:40.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-17T01:21:40.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-17T01:21:40.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-17T01:21:40.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-17T01:21:40.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-17T01:21:40.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-17T01:21:40.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-17T01:21:40.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-17T01:21:40.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-17T01:21:40.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-17T01:21:40.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-17T01:21:40.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-17T01:21:40.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-17T01:21:40.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-17T01:21:40.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-17T01:21:40.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-17T01:21:40.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-17T01:21:40.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-17T01:21:40.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-17T01:21:40.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-17T01:21:40.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-17T01:21:40.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-17T01:21:40.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-17T01:21:40.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-17T01:21:40.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-17T01:21:40.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-17T01:21:40.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-17T01:21:40.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-17T01:21:40.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-17T01:21:40.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-17T01:21:40.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-17T01:21:40.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-17T01:21:40.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-17T01:21:40.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-17T01:21:40.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-17T01:21:40.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-17T01:21:40.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-17T01:21:40.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-17T01:21:40.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-17T01:21:40.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-17T01:21:40.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-17T01:21:40.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-17T01:21:40.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-17T01:21:40.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-17T01:21:40.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-17T01:21:40.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-17T01:21:40.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-17T01:21:40.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-17T01:21:40.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-17T01:21:40.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-17T01:21:40.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-17T01:21:40.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-17T01:21:40.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-17T01:21:40.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-17T01:21:40.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-17T01:21:40.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-17T01:21:40.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-17T01:21:40.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-17T01:21:40.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-17T01:21:40.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-17T01:21:40.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-17T01:21:40.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-17T01:21:40.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-17T01:21:40.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-17T01:21:40.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-17T01:21:40.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-17T01:21:40.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-17T01:21:40.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-17T01:21:40.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-17T01:21:40.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-17T01:21:40.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-17T01:21:40.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-17T01:21:40.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-17T01:21:40.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-17T01:21:40.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-17T01:21:40.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-17T01:21:40.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-17T01:21:40.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-17T01:21:40.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-17T01:21:40.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-17T01:21:40.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-17T01:21:40.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-17T01:21:40.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-17T01:21:40.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-17T01:21:40.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-17T01:21:40.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-17T01:21:40.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-17T01:21:40.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-17T01:21:40.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-17T01:21:40.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-17T01:21:40.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-17T01:21:40.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-17T01:21:40.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-17T01:21:40.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-17T01:21:40.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-17T01:21:40.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-17T01:21:40.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-17T01:21:40.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-17T01:21:40.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-17T01:21:40.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-17T01:21:40.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-17T01:21:40.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-17T01:21:40.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-17T01:21:40.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-17T01:21:40.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-17T01:21:40.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-17T01:21:40.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-17T01:21:40.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-17T01:21:40.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-17T01:21:40.604 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-17T01:21:40.604 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-17T01:21:40.604 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-17T01:21:40.604 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-17T01:21:40.611 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T01:21:40.611 DEBUG:teuthology.orchestra.run.smithi042:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-17T01:21:40.636 INFO:teuthology.orchestra.run.smithi042.stdout:postinstall scriptlet (using /bin/sh): 2024-09-17T01:21:40.636 INFO:teuthology.orchestra.run.smithi042.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-17T01:21:40.636 INFO:teuthology.orchestra.run.smithi042.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-17T01:21:40.636 INFO:teuthology.orchestra.run.smithi042.stdout:fi 2024-09-17T01:21:40.636 INFO:teuthology.orchestra.run.smithi042.stdout:for file in vmlinuz System.map config; do 2024-09-17T01:21:40.636 INFO:teuthology.orchestra.run.smithi042.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-17T01:21:40.637 INFO:teuthology.orchestra.run.smithi042.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-17T01:21:40.637 INFO:teuthology.orchestra.run.smithi042.stdout: fi 2024-09-17T01:21:40.637 INFO:teuthology.orchestra.run.smithi042.stdout:done 2024-09-17T01:21:40.637 INFO:teuthology.orchestra.run.smithi042.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-17T01:21:40.637 INFO:teuthology.orchestra.run.smithi042.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-17T01:21:40.637 INFO:teuthology.orchestra.run.smithi042.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-17T01:21:40.637 INFO:teuthology.orchestra.run.smithi042.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-17T01:21:40.637 INFO:teuthology.orchestra.run.smithi042.stdout:fi 2024-09-17T01:21:40.637 INFO:teuthology.orchestra.run.smithi042.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-17T01:21:40.637 INFO:teuthology.orchestra.run.smithi042.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T01:21:40.637 INFO:teuthology.orchestra.run.smithi042.stdout:fi 2024-09-17T01:21:40.637 INFO:teuthology.orchestra.run.smithi042.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-17T01:21:40.637 INFO:teuthology.orchestra.run.smithi042.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-17T01:21:40.638 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T01:21:40.638 INFO:teuthology.orchestra.run.smithi042.stdout:fi 2024-09-17T01:21:40.639 DEBUG:teuthology.orchestra.run.smithi042:> sudo rpm -qi grub2-tools 2024-09-17T01:21:40.718 INFO:teuthology.orchestra.run.smithi042.stdout:Name : grub2-tools 2024-09-17T01:21:40.718 INFO:teuthology.orchestra.run.smithi042.stdout:Epoch : 1 2024-09-17T01:21:40.718 INFO:teuthology.orchestra.run.smithi042.stdout:Version : 2.06 2024-09-17T01:21:40.718 INFO:teuthology.orchestra.run.smithi042.stdout:Release : 82.el9 2024-09-17T01:21:40.718 INFO:teuthology.orchestra.run.smithi042.stdout:Architecture: x86_64 2024-09-17T01:21:40.718 INFO:teuthology.orchestra.run.smithi042.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T01:21:40.718 INFO:teuthology.orchestra.run.smithi042.stdout:Group : Unspecified 2024-09-17T01:21:40.718 INFO:teuthology.orchestra.run.smithi042.stdout:Size : 8274670 2024-09-17T01:21:40.718 INFO:teuthology.orchestra.run.smithi042.stdout:License : GPLv3+ 2024-09-17T01:21:40.719 INFO:teuthology.orchestra.run.smithi042.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T01:21:40.719 INFO:teuthology.orchestra.run.smithi042.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T01:21:40.719 INFO:teuthology.orchestra.run.smithi042.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T01:21:40.719 INFO:teuthology.orchestra.run.smithi042.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T01:21:40.719 INFO:teuthology.orchestra.run.smithi042.stdout:Packager : builder@centos.org 2024-09-17T01:21:40.719 INFO:teuthology.orchestra.run.smithi042.stdout:Vendor : CentOS 2024-09-17T01:21:40.719 INFO:teuthology.orchestra.run.smithi042.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T01:21:40.719 INFO:teuthology.orchestra.run.smithi042.stdout:Summary : Support tools for GRUB. 2024-09-17T01:21:40.719 INFO:teuthology.orchestra.run.smithi042.stdout:Description : 2024-09-17T01:21:40.719 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:21:40.719 INFO:teuthology.orchestra.run.smithi042.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T01:21:40.719 INFO:teuthology.orchestra.run.smithi042.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T01:21:40.719 INFO:teuthology.orchestra.run.smithi042.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T01:21:40.720 INFO:teuthology.orchestra.run.smithi042.stdout:hardware devices. 2024-09-17T01:21:40.720 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:21:40.720 INFO:teuthology.orchestra.run.smithi042.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T01:21:40.721 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T01:21:40.721 INFO:teuthology.task.kernel:Updating grub on smithi042 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T01:21:40.721 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T01:21:41.490 INFO:teuthology.orchestra.run.smithi042.stderr:Generating grub configuration file ... 2024-09-17T01:21:42.854 INFO:teuthology.orchestra.run.smithi042.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T01:21:42.882 INFO:teuthology.orchestra.run.smithi042.stderr:done 2024-09-17T01:21:42.884 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-09-17T01:21:42.900 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.oXTTHtBjZB 2024-09-17T01:21:42.900 DEBUG:teuthology.orchestra.run.smithi042:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.oXTTHtBjZB 2024-09-17T01:21:42.966 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.oXTTHtBjZB 2024-09-17T01:21:43.108 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.oXTTHtBjZB is 6KB 2024-09-17T01:21:43.128 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.oXTTHtBjZB 2024-09-17T01:21:43.142 DEBUG:teuthology.orchestra.run.smithi042:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T01:21:43.208 INFO:teuthology.orchestra.run.smithi042.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T01:21:43.208 INFO:teuthology.orchestra.run.smithi042.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T01:21:43.208 INFO:teuthology.orchestra.run.smithi042.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T01:21:43.208 INFO:teuthology.orchestra.run.smithi042.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-17T01:21:43.209 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T01:21:43.362 DEBUG:teuthology.orchestra.run.smithi042:> sudo shutdown -r now 2024-09-17T01:21:44.092 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi043.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-17T01:21:44.092 DEBUG:teuthology.orchestra.run.smithi043:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-17T01:21:44.180 INFO:teuthology.orchestra.run.smithi043.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T01:21:44.180 INFO:teuthology.orchestra.run.smithi043.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T01:21:44.180 INFO:teuthology.orchestra.run.smithi043.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T01:21:44.180 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-17T01:21:44.180 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-17T01:21:44.180 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-17T01:21:44.180 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-17T01:21:44.180 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-17T01:21:44.181 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-17T01:21:44.181 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-17T01:21:44.181 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-17T01:21:44.181 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-17T01:21:44.181 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-17T01:21:44.181 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-17T01:21:44.181 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-17T01:21:44.181 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-17T01:21:44.181 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-17T01:21:44.181 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-17T01:21:44.181 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-17T01:21:44.181 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-17T01:21:44.181 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-17T01:21:44.182 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-17T01:21:44.182 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-17T01:21:44.182 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-17T01:21:44.182 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-17T01:21:44.182 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-17T01:21:44.182 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-17T01:21:44.182 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-17T01:21:44.182 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-17T01:21:44.182 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-17T01:21:44.182 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-17T01:21:44.182 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-17T01:21:44.182 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-17T01:21:44.182 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-17T01:21:44.183 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-17T01:21:44.183 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-17T01:21:44.183 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-17T01:21:44.183 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-17T01:21:44.183 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-17T01:21:44.183 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-17T01:21:44.183 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-17T01:21:44.183 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-17T01:21:44.183 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-17T01:21:44.183 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-17T01:21:44.183 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-17T01:21:44.183 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-17T01:21:44.183 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-17T01:21:44.184 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-17T01:21:44.184 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-17T01:21:44.184 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-17T01:21:44.184 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-17T01:21:44.184 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-17T01:21:44.184 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-17T01:21:44.184 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-17T01:21:44.184 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-17T01:21:44.184 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-17T01:21:44.184 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-17T01:21:44.184 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-17T01:21:44.184 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-17T01:21:44.184 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-17T01:21:44.185 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-17T01:21:44.185 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-17T01:21:44.185 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-17T01:21:44.185 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-17T01:21:44.185 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-17T01:21:44.185 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-17T01:21:44.185 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-17T01:21:44.185 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-17T01:21:44.185 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-17T01:21:44.185 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-17T01:21:44.185 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-17T01:21:44.185 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-17T01:21:44.185 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-17T01:21:44.186 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-17T01:21:44.186 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-17T01:21:44.186 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-17T01:21:44.186 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-17T01:21:44.186 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-17T01:21:44.186 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-17T01:21:44.186 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-17T01:21:44.186 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-17T01:21:44.186 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-17T01:21:44.186 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-17T01:21:44.186 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-17T01:21:44.186 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-17T01:21:44.186 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-17T01:21:44.186 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-17T01:21:44.187 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-17T01:21:44.187 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-17T01:21:44.187 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-17T01:21:44.187 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-17T01:21:44.187 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-17T01:21:44.187 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-17T01:21:44.187 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-17T01:21:44.187 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-17T01:21:44.187 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-17T01:21:44.187 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-17T01:21:44.187 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-17T01:21:44.187 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-17T01:21:44.187 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-17T01:21:44.187 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-17T01:21:44.188 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-17T01:21:44.188 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-17T01:21:44.188 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-17T01:21:44.188 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-17T01:21:44.188 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-17T01:21:44.188 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-17T01:21:44.188 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-17T01:21:44.188 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-17T01:21:44.188 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-17T01:21:44.188 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-17T01:21:44.188 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-17T01:21:44.188 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-17T01:21:44.188 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-17T01:21:44.189 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-17T01:21:44.189 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-17T01:21:44.189 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-17T01:21:44.189 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-17T01:21:44.189 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-17T01:21:44.189 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-17T01:21:44.189 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-17T01:21:44.189 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-17T01:21:44.189 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-17T01:21:44.189 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-17T01:21:44.189 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-17T01:21:44.189 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-17T01:21:44.189 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-17T01:21:44.190 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-17T01:21:44.190 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-17T01:21:44.190 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-17T01:21:44.190 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-17T01:21:44.190 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-17T01:21:44.190 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-17T01:21:44.190 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-17T01:21:44.190 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-17T01:21:44.190 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-17T01:21:44.190 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-17T01:21:44.190 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-17T01:21:44.190 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-17T01:21:44.190 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-17T01:21:44.190 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-17T01:21:44.191 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-17T01:21:44.191 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-17T01:21:44.191 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-17T01:21:44.191 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-17T01:21:44.191 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-17T01:21:44.191 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-17T01:21:44.191 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-17T01:21:44.191 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-17T01:21:44.191 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-17T01:21:44.191 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-17T01:21:44.191 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-17T01:21:44.191 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-17T01:21:44.191 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-17T01:21:44.191 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-17T01:21:44.192 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-17T01:21:44.192 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-17T01:21:44.192 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-17T01:21:44.192 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-17T01:21:44.192 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-17T01:21:44.192 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-17T01:21:44.192 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-17T01:21:44.192 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-17T01:21:44.192 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-17T01:21:44.192 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-17T01:21:44.192 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-17T01:21:44.192 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-17T01:21:44.192 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-17T01:21:44.192 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-17T01:21:44.193 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-17T01:21:44.193 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-17T01:21:44.193 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-17T01:21:44.193 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-17T01:21:44.193 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-17T01:21:44.193 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-17T01:21:44.193 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-17T01:21:44.193 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-17T01:21:44.193 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-17T01:21:44.193 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-17T01:21:44.193 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-17T01:21:44.193 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-17T01:21:44.193 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-17T01:21:44.193 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-17T01:21:44.194 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-17T01:21:44.194 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-17T01:21:44.194 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-17T01:21:44.194 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-17T01:21:44.194 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-17T01:21:44.194 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-17T01:21:44.194 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-17T01:21:44.194 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-17T01:21:44.194 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-17T01:21:44.194 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-17T01:21:44.194 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-17T01:21:44.194 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-17T01:21:44.195 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-17T01:21:44.195 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-17T01:21:44.195 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-17T01:21:44.195 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-17T01:21:44.195 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-17T01:21:44.195 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-17T01:21:44.195 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-17T01:21:44.195 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-17T01:21:44.195 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-17T01:21:44.195 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-17T01:21:44.195 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-17T01:21:44.195 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-17T01:21:44.195 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-17T01:21:44.196 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-17T01:21:44.196 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-17T01:21:44.196 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-17T01:21:44.196 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-17T01:21:44.196 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-17T01:21:44.196 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-17T01:21:44.196 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-17T01:21:44.196 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-17T01:21:44.196 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-17T01:21:44.196 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-17T01:21:44.196 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-17T01:21:44.196 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-17T01:21:44.196 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-17T01:21:44.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-17T01:21:44.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-17T01:21:44.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-17T01:21:44.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-17T01:21:44.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-17T01:21:44.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-17T01:21:44.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-17T01:21:44.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-17T01:21:44.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-17T01:21:44.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-17T01:21:44.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-17T01:21:44.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-17T01:21:44.197 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-17T01:21:44.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-17T01:21:44.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-17T01:21:44.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-17T01:21:44.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-17T01:21:44.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-17T01:21:44.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-17T01:21:44.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-17T01:21:44.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-17T01:21:44.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-17T01:21:44.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-17T01:21:44.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-17T01:21:44.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-17T01:21:44.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-17T01:21:44.198 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-17T01:21:44.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-17T01:21:44.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-17T01:21:44.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-17T01:21:44.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-17T01:21:44.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-17T01:21:44.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-17T01:21:44.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-17T01:21:44.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-17T01:21:44.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-17T01:21:44.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-17T01:21:44.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-17T01:21:44.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-17T01:21:44.199 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-17T01:21:44.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-17T01:21:44.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-17T01:21:44.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-17T01:21:44.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-17T01:21:44.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-17T01:21:44.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-17T01:21:44.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-17T01:21:44.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-17T01:21:44.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-17T01:21:44.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-17T01:21:44.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-17T01:21:44.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-17T01:21:44.200 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-17T01:21:44.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-17T01:21:44.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-17T01:21:44.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-17T01:21:44.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-17T01:21:44.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-17T01:21:44.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-17T01:21:44.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-17T01:21:44.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-17T01:21:44.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-17T01:21:44.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-17T01:21:44.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-17T01:21:44.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-17T01:21:44.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-17T01:21:44.201 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-17T01:21:44.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-17T01:21:44.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-17T01:21:44.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-17T01:21:44.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-17T01:21:44.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-17T01:21:44.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-17T01:21:44.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-17T01:21:44.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-17T01:21:44.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-17T01:21:44.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-17T01:21:44.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-17T01:21:44.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-17T01:21:44.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-17T01:21:44.202 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-17T01:21:44.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-17T01:21:44.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-17T01:21:44.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-17T01:21:44.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-17T01:21:44.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-17T01:21:44.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-17T01:21:44.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-17T01:21:44.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-17T01:21:44.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-17T01:21:44.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-17T01:21:44.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-17T01:21:44.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-17T01:21:44.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-17T01:21:44.203 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-17T01:21:44.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-17T01:21:44.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-17T01:21:44.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-17T01:21:44.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-17T01:21:44.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-17T01:21:44.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-17T01:21:44.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-17T01:21:44.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-17T01:21:44.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-17T01:21:44.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-17T01:21:44.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-17T01:21:44.204 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-17T01:21:44.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-17T01:21:44.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-17T01:21:44.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-17T01:21:44.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-17T01:21:44.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-17T01:21:44.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-17T01:21:44.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-17T01:21:44.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-17T01:21:44.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-17T01:21:44.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-17T01:21:44.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-17T01:21:44.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-17T01:21:44.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-17T01:21:44.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-17T01:21:44.205 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-17T01:21:44.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-17T01:21:44.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-17T01:21:44.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-17T01:21:44.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-17T01:21:44.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-17T01:21:44.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-17T01:21:44.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-17T01:21:44.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-17T01:21:44.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-17T01:21:44.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-17T01:21:44.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-17T01:21:44.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-17T01:21:44.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-17T01:21:44.206 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-17T01:21:44.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-17T01:21:44.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-17T01:21:44.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-17T01:21:44.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-17T01:21:44.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-17T01:21:44.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-17T01:21:44.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-17T01:21:44.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-17T01:21:44.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-17T01:21:44.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-17T01:21:44.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-17T01:21:44.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-17T01:21:44.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-17T01:21:44.207 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-17T01:21:44.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-17T01:21:44.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-17T01:21:44.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-17T01:21:44.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-17T01:21:44.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-17T01:21:44.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-17T01:21:44.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-17T01:21:44.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-17T01:21:44.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-17T01:21:44.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-17T01:21:44.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-17T01:21:44.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-17T01:21:44.208 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-17T01:21:44.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-17T01:21:44.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-17T01:21:44.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-17T01:21:44.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-17T01:21:44.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-17T01:21:44.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-17T01:21:44.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-17T01:21:44.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-17T01:21:44.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-17T01:21:44.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-17T01:21:44.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-17T01:21:44.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-17T01:21:44.209 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-17T01:21:44.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-17T01:21:44.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-17T01:21:44.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-17T01:21:44.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-17T01:21:44.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-17T01:21:44.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-17T01:21:44.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-17T01:21:44.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-17T01:21:44.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-17T01:21:44.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-17T01:21:44.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-17T01:21:44.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-17T01:21:44.210 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-17T01:21:44.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-17T01:21:44.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-17T01:21:44.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-17T01:21:44.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-17T01:21:44.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-17T01:21:44.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-17T01:21:44.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-17T01:21:44.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-17T01:21:44.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-17T01:21:44.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-17T01:21:44.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-17T01:21:44.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-17T01:21:44.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-17T01:21:44.211 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-17T01:21:44.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-17T01:21:44.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-17T01:21:44.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-17T01:21:44.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-17T01:21:44.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-17T01:21:44.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-17T01:21:44.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-17T01:21:44.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-17T01:21:44.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-17T01:21:44.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-17T01:21:44.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-17T01:21:44.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-17T01:21:44.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-17T01:21:44.212 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-17T01:21:44.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-17T01:21:44.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-17T01:21:44.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-17T01:21:44.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-17T01:21:44.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-17T01:21:44.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-17T01:21:44.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-17T01:21:44.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-17T01:21:44.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-17T01:21:44.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-17T01:21:44.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-17T01:21:44.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-17T01:21:44.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-17T01:21:44.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-17T01:21:44.213 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-17T01:21:44.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-17T01:21:44.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-17T01:21:44.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-17T01:21:44.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-17T01:21:44.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-17T01:21:44.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-17T01:21:44.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-17T01:21:44.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-17T01:21:44.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-17T01:21:44.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-17T01:21:44.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-17T01:21:44.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-17T01:21:44.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-17T01:21:44.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-17T01:21:44.214 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-17T01:21:44.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-17T01:21:44.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-17T01:21:44.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-17T01:21:44.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-17T01:21:44.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-17T01:21:44.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-17T01:21:44.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-17T01:21:44.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-17T01:21:44.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-17T01:21:44.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-17T01:21:44.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-17T01:21:44.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-17T01:21:44.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-17T01:21:44.215 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-17T01:21:44.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-17T01:21:44.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-17T01:21:44.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-17T01:21:44.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-17T01:21:44.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-17T01:21:44.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-17T01:21:44.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-17T01:21:44.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-17T01:21:44.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-17T01:21:44.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-17T01:21:44.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-17T01:21:44.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-17T01:21:44.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-17T01:21:44.216 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-17T01:21:44.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-17T01:21:44.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-17T01:21:44.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-17T01:21:44.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-17T01:21:44.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-17T01:21:44.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-17T01:21:44.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-17T01:21:44.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-17T01:21:44.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-17T01:21:44.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-17T01:21:44.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-17T01:21:44.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-17T01:21:44.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-17T01:21:44.217 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-17T01:21:44.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-17T01:21:44.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-17T01:21:44.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-17T01:21:44.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-17T01:21:44.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-17T01:21:44.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-17T01:21:44.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-17T01:21:44.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-17T01:21:44.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-17T01:21:44.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-17T01:21:44.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-17T01:21:44.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-17T01:21:44.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-17T01:21:44.218 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-17T01:21:44.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-17T01:21:44.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-17T01:21:44.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-17T01:21:44.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-17T01:21:44.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-17T01:21:44.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-17T01:21:44.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-17T01:21:44.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-17T01:21:44.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-17T01:21:44.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-17T01:21:44.219 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-17T01:21:44.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-17T01:21:44.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-17T01:21:44.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-17T01:21:44.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-17T01:21:44.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-17T01:21:44.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-17T01:21:44.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-17T01:21:44.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-17T01:21:44.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-17T01:21:44.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-17T01:21:44.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-17T01:21:44.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-17T01:21:44.220 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-17T01:21:44.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-17T01:21:44.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-17T01:21:44.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-17T01:21:44.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-17T01:21:44.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-17T01:21:44.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-17T01:21:44.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-17T01:21:44.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-17T01:21:44.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-17T01:21:44.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-17T01:21:44.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-17T01:21:44.221 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-17T01:21:44.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-17T01:21:44.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-17T01:21:44.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-17T01:21:44.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-17T01:21:44.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-17T01:21:44.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-17T01:21:44.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-17T01:21:44.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-17T01:21:44.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-17T01:21:44.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-17T01:21:44.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-17T01:21:44.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-17T01:21:44.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-17T01:21:44.222 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-17T01:21:44.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-17T01:21:44.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-17T01:21:44.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-17T01:21:44.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-17T01:21:44.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-17T01:21:44.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-17T01:21:44.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-17T01:21:44.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-17T01:21:44.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-17T01:21:44.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-17T01:21:44.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-17T01:21:44.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-17T01:21:44.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-17T01:21:44.223 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-17T01:21:44.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-17T01:21:44.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-17T01:21:44.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-17T01:21:44.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-17T01:21:44.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-17T01:21:44.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-17T01:21:44.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-17T01:21:44.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-17T01:21:44.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-17T01:21:44.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-17T01:21:44.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-17T01:21:44.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-17T01:21:44.224 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-17T01:21:44.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-17T01:21:44.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-17T01:21:44.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-17T01:21:44.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-17T01:21:44.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-17T01:21:44.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-17T01:21:44.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-17T01:21:44.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-17T01:21:44.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-17T01:21:44.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-17T01:21:44.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-17T01:21:44.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-17T01:21:44.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-17T01:21:44.225 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-17T01:21:44.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-17T01:21:44.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-17T01:21:44.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-17T01:21:44.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-17T01:21:44.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-17T01:21:44.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-17T01:21:44.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-17T01:21:44.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-17T01:21:44.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-17T01:21:44.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-17T01:21:44.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-17T01:21:44.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-17T01:21:44.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-17T01:21:44.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-17T01:21:44.226 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-17T01:21:44.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-17T01:21:44.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-17T01:21:44.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-17T01:21:44.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-17T01:21:44.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-17T01:21:44.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-17T01:21:44.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-17T01:21:44.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-17T01:21:44.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-17T01:21:44.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-17T01:21:44.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-17T01:21:44.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-17T01:21:44.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-17T01:21:44.227 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-17T01:21:44.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-17T01:21:44.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-17T01:21:44.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-17T01:21:44.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-17T01:21:44.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-17T01:21:44.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-17T01:21:44.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-17T01:21:44.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-17T01:21:44.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-17T01:21:44.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-17T01:21:44.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-17T01:21:44.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-17T01:21:44.228 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-17T01:21:44.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-17T01:21:44.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-17T01:21:44.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-17T01:21:44.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-17T01:21:44.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-17T01:21:44.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-17T01:21:44.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-17T01:21:44.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-17T01:21:44.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-17T01:21:44.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-17T01:21:44.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-17T01:21:44.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-17T01:21:44.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-17T01:21:44.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-17T01:21:44.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-17T01:21:44.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-17T01:21:44.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-17T01:21:44.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-17T01:21:44.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-17T01:21:44.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-17T01:21:44.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-17T01:21:44.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-17T01:21:44.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-17T01:21:44.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-17T01:21:44.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-17T01:21:44.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-17T01:21:44.231 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-17T01:21:44.231 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-17T01:21:44.231 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-17T01:21:44.231 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-17T01:21:44.231 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-17T01:21:44.231 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-17T01:21:44.231 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-17T01:21:44.231 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-17T01:21:44.231 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-17T01:21:44.231 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-17T01:21:44.231 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-17T01:21:44.231 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-17T01:21:44.231 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-17T01:21:44.231 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-17T01:21:44.232 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-17T01:21:44.232 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-17T01:21:44.232 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-17T01:21:44.232 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-17T01:21:44.232 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-17T01:21:44.232 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-17T01:21:44.232 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-17T01:21:44.232 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-17T01:21:44.232 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-17T01:21:44.232 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-17T01:21:44.232 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-17T01:21:44.232 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-17T01:21:44.232 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-17T01:21:44.232 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-17T01:21:44.233 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-17T01:21:44.233 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-17T01:21:44.233 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-17T01:21:44.233 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-17T01:21:44.233 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-17T01:21:44.233 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-17T01:21:44.233 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-17T01:21:44.233 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-17T01:21:44.233 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-17T01:21:44.233 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-17T01:21:44.233 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-17T01:21:44.233 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-17T01:21:44.233 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-17T01:21:44.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-17T01:21:44.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-17T01:21:44.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-17T01:21:44.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-17T01:21:44.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-17T01:21:44.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-17T01:21:44.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-17T01:21:44.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-17T01:21:44.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-17T01:21:44.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-17T01:21:44.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-17T01:21:44.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-17T01:21:44.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-17T01:21:44.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-17T01:21:44.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-17T01:21:44.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-17T01:21:44.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-17T01:21:44.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-17T01:21:44.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-17T01:21:44.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-17T01:21:44.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-17T01:21:44.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-17T01:21:44.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-17T01:21:44.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-17T01:21:44.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-17T01:21:44.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-17T01:21:44.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-17T01:21:44.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-17T01:21:44.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-17T01:21:44.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-17T01:21:44.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-17T01:21:44.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-17T01:21:44.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-17T01:21:44.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-17T01:21:44.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-17T01:21:44.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-17T01:21:44.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-17T01:21:44.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-17T01:21:44.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-17T01:21:44.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-17T01:21:44.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-17T01:21:44.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-17T01:21:44.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-17T01:21:44.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-17T01:21:44.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-17T01:21:44.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-17T01:21:44.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-17T01:21:44.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-17T01:21:44.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-17T01:21:44.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-17T01:21:44.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-17T01:21:44.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-17T01:21:44.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-17T01:21:44.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-17T01:21:44.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-17T01:21:44.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-17T01:21:44.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-17T01:21:44.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-17T01:21:44.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-17T01:21:44.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-17T01:21:44.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-17T01:21:44.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-17T01:21:44.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-17T01:21:44.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-17T01:21:44.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-17T01:21:44.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-17T01:21:44.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-17T01:21:44.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-17T01:21:44.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-17T01:21:44.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-17T01:21:44.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-17T01:21:44.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-17T01:21:44.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-17T01:21:44.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-17T01:21:44.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-17T01:21:44.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-17T01:21:44.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-17T01:21:44.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-17T01:21:44.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-17T01:21:44.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-17T01:21:44.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-17T01:21:44.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-17T01:21:44.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-17T01:21:44.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-17T01:21:44.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-17T01:21:44.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-17T01:21:44.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-17T01:21:44.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-17T01:21:44.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-17T01:21:44.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-17T01:21:44.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-17T01:21:44.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-17T01:21:44.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-17T01:21:44.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-17T01:21:44.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-17T01:21:44.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-17T01:21:44.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-17T01:21:44.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-17T01:21:44.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-17T01:21:44.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-17T01:21:44.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-17T01:21:44.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-17T01:21:44.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-17T01:21:44.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-17T01:21:44.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-17T01:21:44.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-17T01:21:44.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-17T01:21:44.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-17T01:21:44.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-17T01:21:44.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-17T01:21:44.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-17T01:21:44.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-17T01:21:44.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-17T01:21:44.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-17T01:21:44.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-17T01:21:44.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-17T01:21:44.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-17T01:21:44.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-17T01:21:44.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-17T01:21:44.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-17T01:21:44.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-17T01:21:44.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-17T01:21:44.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-17T01:21:44.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-17T01:21:44.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-17T01:21:44.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-17T01:21:44.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-17T01:21:44.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-17T01:21:44.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-17T01:21:44.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-17T01:21:44.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-17T01:21:44.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-17T01:21:44.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-17T01:21:44.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-17T01:21:44.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-17T01:21:44.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-17T01:21:44.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-17T01:21:44.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-17T01:21:44.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-17T01:21:44.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-17T01:21:44.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-17T01:21:44.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-17T01:21:44.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-17T01:21:44.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-17T01:21:44.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-17T01:21:44.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-17T01:21:44.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-17T01:21:44.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-17T01:21:44.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-17T01:21:44.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-17T01:21:44.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-17T01:21:44.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-17T01:21:44.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-17T01:21:44.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-17T01:21:44.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-17T01:21:44.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-17T01:21:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-17T01:21:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-17T01:21:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-17T01:21:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-17T01:21:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-17T01:21:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-17T01:21:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-17T01:21:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-17T01:21:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-17T01:21:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-17T01:21:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-17T01:21:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-17T01:21:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-17T01:21:44.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-17T01:21:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-17T01:21:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-17T01:21:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-17T01:21:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-17T01:21:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-17T01:21:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-17T01:21:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-17T01:21:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-17T01:21:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-17T01:21:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-17T01:21:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-17T01:21:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-17T01:21:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-17T01:21:44.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-17T01:21:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-17T01:21:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-17T01:21:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-17T01:21:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-17T01:21:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-17T01:21:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-17T01:21:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-17T01:21:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-17T01:21:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-17T01:21:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-17T01:21:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-17T01:21:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-17T01:21:44.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-17T01:21:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-17T01:21:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-17T01:21:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-17T01:21:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-17T01:21:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-17T01:21:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-17T01:21:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-17T01:21:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-17T01:21:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-17T01:21:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-17T01:21:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-17T01:21:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-17T01:21:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-17T01:21:44.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-17T01:21:44.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-17T01:21:44.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-17T01:21:44.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-17T01:21:44.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-17T01:21:44.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-17T01:21:44.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-17T01:21:44.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-17T01:21:44.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-17T01:21:44.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-17T01:21:44.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-17T01:21:44.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-17T01:21:44.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-17T01:21:44.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-17T01:21:44.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-17T01:21:44.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-17T01:21:44.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-17T01:21:44.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-17T01:21:44.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-17T01:21:44.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-17T01:21:44.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-17T01:21:44.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-17T01:21:44.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-17T01:21:44.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-17T01:21:44.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-17T01:21:44.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-17T01:21:44.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-17T01:21:44.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-17T01:21:44.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-17T01:21:44.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-17T01:21:44.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-17T01:21:44.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-17T01:21:44.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-17T01:21:44.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-17T01:21:44.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-17T01:21:44.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-17T01:21:44.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-17T01:21:44.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-17T01:21:44.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-17T01:21:44.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-17T01:21:44.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-17T01:21:44.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-17T01:21:44.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-17T01:21:44.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-17T01:21:44.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-17T01:21:44.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-17T01:21:44.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-17T01:21:44.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-17T01:21:44.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-17T01:21:44.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-17T01:21:44.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-17T01:21:44.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-17T01:21:44.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-17T01:21:44.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-17T01:21:44.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-17T01:21:44.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-17T01:21:44.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-17T01:21:44.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-17T01:21:44.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-17T01:21:44.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-17T01:21:44.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-17T01:21:44.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-17T01:21:44.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-17T01:21:44.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-17T01:21:44.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-17T01:21:44.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-17T01:21:44.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-17T01:21:44.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-17T01:21:44.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-17T01:21:44.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-17T01:21:44.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-17T01:21:44.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-17T01:21:44.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-17T01:21:44.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-17T01:21:44.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-17T01:21:44.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-17T01:21:44.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-17T01:21:44.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-17T01:21:44.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-17T01:21:44.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-17T01:21:44.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-17T01:21:44.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-17T01:21:44.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-17T01:21:44.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-17T01:21:44.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-17T01:21:44.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-17T01:21:44.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-17T01:21:44.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-17T01:21:44.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-17T01:21:44.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-17T01:21:44.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-17T01:21:44.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-17T01:21:44.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-17T01:21:44.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-17T01:21:44.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-17T01:21:44.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-17T01:21:44.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-17T01:21:44.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-17T01:21:44.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-17T01:21:44.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-17T01:21:44.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-17T01:21:44.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-17T01:21:44.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-17T01:21:44.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-17T01:21:44.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-17T01:21:44.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-17T01:21:44.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-17T01:21:44.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-17T01:21:44.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-17T01:21:44.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-17T01:21:44.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-17T01:21:44.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-17T01:21:44.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-17T01:21:44.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-17T01:21:44.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-17T01:21:44.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-17T01:21:44.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-17T01:21:44.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-17T01:21:44.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-17T01:21:44.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-17T01:21:44.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-17T01:21:44.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-17T01:21:44.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-17T01:21:44.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-17T01:21:44.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-17T01:21:44.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-17T01:21:44.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-17T01:21:44.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-17T01:21:44.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-17T01:21:44.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-17T01:21:44.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-17T01:21:44.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-17T01:21:44.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-17T01:21:44.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-17T01:21:44.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-17T01:21:44.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-17T01:21:44.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-17T01:21:44.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-17T01:21:44.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-17T01:21:44.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-17T01:21:44.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-17T01:21:44.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-17T01:21:44.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-17T01:21:44.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-17T01:21:44.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-17T01:21:44.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-17T01:21:44.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-17T01:21:44.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-17T01:21:44.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-17T01:21:44.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-17T01:21:44.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-17T01:21:44.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-17T01:21:44.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-17T01:21:44.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-17T01:21:44.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-17T01:21:44.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-17T01:21:44.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-17T01:21:44.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-17T01:21:44.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-17T01:21:44.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-17T01:21:44.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-17T01:21:44.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-17T01:21:44.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-17T01:21:44.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-17T01:21:44.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-17T01:21:44.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-17T01:21:44.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-17T01:21:44.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-17T01:21:44.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-17T01:21:44.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-17T01:21:44.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-17T01:21:44.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-17T01:21:44.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-17T01:21:44.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-17T01:21:44.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-17T01:21:44.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-17T01:21:44.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-17T01:21:44.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-17T01:21:44.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-17T01:21:44.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-17T01:21:44.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-17T01:21:44.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-17T01:21:44.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-17T01:21:44.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-17T01:21:44.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-17T01:21:44.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-17T01:21:44.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-17T01:21:44.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-17T01:21:44.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-17T01:21:44.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-17T01:21:44.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-17T01:21:44.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-17T01:21:44.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-17T01:21:44.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-17T01:21:44.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-17T01:21:44.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-17T01:21:44.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-17T01:21:44.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-17T01:21:44.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-17T01:21:44.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-17T01:21:44.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-17T01:21:44.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-17T01:21:44.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-17T01:21:44.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-17T01:21:44.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-17T01:21:44.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-17T01:21:44.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-17T01:21:44.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-17T01:21:44.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-17T01:21:44.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-17T01:21:44.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-17T01:21:44.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-17T01:21:44.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-17T01:21:44.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-17T01:21:44.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-17T01:21:44.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-17T01:21:44.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-17T01:21:44.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-17T01:21:44.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-17T01:21:44.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-17T01:21:44.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-17T01:21:44.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-17T01:21:44.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-17T01:21:44.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-17T01:21:44.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-17T01:21:44.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-17T01:21:44.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-17T01:21:44.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-17T01:21:44.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-17T01:21:44.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-17T01:21:44.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-17T01:21:44.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-17T01:21:44.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-17T01:21:44.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-17T01:21:44.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-17T01:21:44.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-17T01:21:44.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-17T01:21:44.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-17T01:21:44.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-17T01:21:44.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-17T01:21:44.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-17T01:21:44.266 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-17T01:21:44.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-17T01:21:44.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-17T01:21:44.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-17T01:21:44.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-17T01:21:44.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-17T01:21:44.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-17T01:21:44.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-17T01:21:44.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-17T01:21:44.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-17T01:21:44.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-17T01:21:44.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-17T01:21:44.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-17T01:21:44.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-17T01:21:44.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-17T01:21:44.267 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-17T01:21:44.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-17T01:21:44.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-17T01:21:44.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-17T01:21:44.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-17T01:21:44.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-17T01:21:44.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-17T01:21:44.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-17T01:21:44.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-17T01:21:44.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-17T01:21:44.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-17T01:21:44.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-17T01:21:44.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-17T01:21:44.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-17T01:21:44.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-17T01:21:44.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-17T01:21:44.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-17T01:21:44.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-17T01:21:44.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-17T01:21:44.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-17T01:21:44.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-17T01:21:44.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-17T01:21:44.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-17T01:21:44.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-17T01:21:44.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-17T01:21:44.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-17T01:21:44.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-17T01:21:44.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-17T01:21:44.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-17T01:21:44.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-17T01:21:44.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-17T01:21:44.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-17T01:21:44.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-17T01:21:44.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-17T01:21:44.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-17T01:21:44.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-17T01:21:44.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-17T01:21:44.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-17T01:21:44.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-17T01:21:44.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-17T01:21:44.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-17T01:21:44.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-17T01:21:44.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-17T01:21:44.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-17T01:21:44.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-17T01:21:44.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-17T01:21:44.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-17T01:21:44.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-17T01:21:44.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-17T01:21:44.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-17T01:21:44.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-17T01:21:44.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-17T01:21:44.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-17T01:21:44.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-17T01:21:44.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-17T01:21:44.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-17T01:21:44.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-17T01:21:44.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-17T01:21:44.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-17T01:21:44.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-17T01:21:44.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-17T01:21:44.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-17T01:21:44.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-17T01:21:44.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-17T01:21:44.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-17T01:21:44.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-17T01:21:44.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-17T01:21:44.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-17T01:21:44.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-17T01:21:44.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-17T01:21:44.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-17T01:21:44.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-17T01:21:44.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-17T01:21:44.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-17T01:21:44.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-17T01:21:44.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-17T01:21:44.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-17T01:21:44.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-17T01:21:44.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-17T01:21:44.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-17T01:21:44.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-17T01:21:44.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-17T01:21:44.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-17T01:21:44.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-17T01:21:44.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-17T01:21:44.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-17T01:21:44.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-17T01:21:44.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-17T01:21:44.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-17T01:21:44.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-17T01:21:44.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-17T01:21:44.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-17T01:21:44.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-17T01:21:44.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-17T01:21:44.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-17T01:21:44.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-17T01:21:44.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-17T01:21:44.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-17T01:21:44.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-17T01:21:44.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-17T01:21:44.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-17T01:21:44.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-17T01:21:44.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-17T01:21:44.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-17T01:21:44.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-17T01:21:44.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-17T01:21:44.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-17T01:21:44.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-17T01:21:44.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-17T01:21:44.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-17T01:21:44.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-17T01:21:44.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-17T01:21:44.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-17T01:21:44.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-17T01:21:44.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-17T01:21:44.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-17T01:21:44.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-17T01:21:44.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-17T01:21:44.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-17T01:21:44.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-17T01:21:44.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-17T01:21:44.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-17T01:21:44.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-17T01:21:44.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-17T01:21:44.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-17T01:21:44.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-17T01:21:44.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-17T01:21:44.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-17T01:21:44.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-17T01:21:44.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-17T01:21:44.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-17T01:21:44.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-17T01:21:44.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-17T01:21:44.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-17T01:21:44.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-17T01:21:44.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-17T01:21:44.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-17T01:21:44.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-17T01:21:44.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-17T01:21:44.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-17T01:21:44.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-17T01:21:44.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-17T01:21:44.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-17T01:21:44.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-17T01:21:44.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-17T01:21:44.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-17T01:21:44.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-17T01:21:44.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-17T01:21:44.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-17T01:21:44.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-17T01:21:44.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-17T01:21:44.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-17T01:21:44.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-17T01:21:44.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-17T01:21:44.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-17T01:21:44.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-17T01:21:44.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-17T01:21:44.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-17T01:21:44.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-17T01:21:44.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-17T01:21:44.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-17T01:21:44.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-17T01:21:44.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-17T01:21:44.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-17T01:21:44.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-17T01:21:44.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-17T01:21:44.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-17T01:21:44.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-17T01:21:44.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-17T01:21:44.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-17T01:21:44.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-17T01:21:44.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-17T01:21:44.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-17T01:21:44.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-17T01:21:44.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-17T01:21:44.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-17T01:21:44.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-17T01:21:44.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-17T01:21:44.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-17T01:21:44.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-17T01:21:44.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-17T01:21:44.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-17T01:21:44.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-17T01:21:44.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-17T01:21:44.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-17T01:21:44.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-17T01:21:44.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-17T01:21:44.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-17T01:21:44.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-17T01:21:44.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-17T01:21:44.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-17T01:21:44.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-17T01:21:44.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-17T01:21:44.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-17T01:21:44.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-17T01:21:44.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-17T01:21:44.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-17T01:21:44.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-17T01:21:44.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-17T01:21:44.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-17T01:21:44.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-17T01:21:44.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-17T01:21:44.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-17T01:21:44.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-17T01:21:44.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-17T01:21:44.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-17T01:21:44.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-17T01:21:44.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-17T01:21:44.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-17T01:21:44.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-17T01:21:44.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-17T01:21:44.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-17T01:21:44.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-17T01:21:44.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-17T01:21:44.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-17T01:21:44.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-17T01:21:44.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-17T01:21:44.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-17T01:21:44.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-17T01:21:44.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-17T01:21:44.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-17T01:21:44.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-17T01:21:44.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-17T01:21:44.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-17T01:21:44.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-17T01:21:44.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-17T01:21:44.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-17T01:21:44.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-17T01:21:44.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-17T01:21:44.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-17T01:21:44.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-17T01:21:44.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-17T01:21:44.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-17T01:21:44.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-17T01:21:44.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-17T01:21:44.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-17T01:21:44.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-17T01:21:44.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-17T01:21:44.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-17T01:21:44.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-17T01:21:44.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-17T01:21:44.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-17T01:21:44.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-17T01:21:44.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-17T01:21:44.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-17T01:21:44.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-17T01:21:44.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-17T01:21:44.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-17T01:21:44.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-17T01:21:44.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-17T01:21:44.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-17T01:21:44.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-17T01:21:44.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-17T01:21:44.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-17T01:21:44.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-17T01:21:44.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-17T01:21:44.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-17T01:21:44.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-17T01:21:44.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-17T01:21:44.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-17T01:21:44.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-17T01:21:44.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-17T01:21:44.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-17T01:21:44.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-17T01:21:44.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-17T01:21:44.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-17T01:21:44.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-17T01:21:44.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-17T01:21:44.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-17T01:21:44.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-17T01:21:44.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-17T01:21:44.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-17T01:21:44.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-17T01:21:44.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-17T01:21:44.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-17T01:21:44.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-17T01:21:44.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-17T01:21:44.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-17T01:21:44.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-17T01:21:44.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-17T01:21:44.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-17T01:21:44.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-17T01:21:44.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-17T01:21:44.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-17T01:21:44.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-17T01:21:44.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-17T01:21:44.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-17T01:21:44.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-17T01:21:44.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-17T01:21:44.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-17T01:21:44.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-17T01:21:44.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-17T01:21:44.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-17T01:21:44.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-17T01:21:44.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-17T01:21:44.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-17T01:21:44.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-17T01:21:44.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-17T01:21:44.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-17T01:21:44.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-17T01:21:44.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-17T01:21:44.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-17T01:21:44.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-17T01:21:44.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-17T01:21:44.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-17T01:21:44.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-17T01:21:44.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-17T01:21:44.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-17T01:21:44.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-17T01:21:44.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-17T01:21:44.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-17T01:21:44.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-17T01:21:44.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-17T01:21:44.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-17T01:21:44.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-17T01:21:44.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-17T01:21:44.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-17T01:21:44.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-17T01:21:44.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-17T01:21:44.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-17T01:21:44.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-17T01:21:44.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-17T01:21:44.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-17T01:21:44.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-17T01:21:44.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-17T01:21:44.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-17T01:21:44.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-17T01:21:44.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-17T01:21:44.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-17T01:21:44.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-17T01:21:44.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-17T01:21:44.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-17T01:21:44.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-17T01:21:44.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-17T01:21:44.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-17T01:21:44.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-17T01:21:44.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-17T01:21:44.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-17T01:21:44.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-17T01:21:44.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-17T01:21:44.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-17T01:21:44.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-17T01:21:44.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-17T01:21:44.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-17T01:21:44.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-17T01:21:44.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-17T01:21:44.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-17T01:21:44.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-17T01:21:44.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-17T01:21:44.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-17T01:21:44.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-17T01:21:44.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-17T01:21:44.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-17T01:21:44.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-17T01:21:44.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-17T01:21:44.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-17T01:21:44.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-17T01:21:44.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-17T01:21:44.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-17T01:21:44.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-17T01:21:44.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-17T01:21:44.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-17T01:21:44.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-17T01:21:44.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-17T01:21:44.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-17T01:21:44.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-17T01:21:44.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-17T01:21:44.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-17T01:21:44.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-17T01:21:44.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-17T01:21:44.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-17T01:21:44.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-17T01:21:44.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-17T01:21:44.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-17T01:21:44.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-17T01:21:44.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-17T01:21:44.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-17T01:21:44.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-17T01:21:44.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-17T01:21:44.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-17T01:21:44.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-17T01:21:44.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-17T01:21:44.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-17T01:21:44.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-17T01:21:44.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-17T01:21:44.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-17T01:21:44.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-17T01:21:44.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-17T01:21:44.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-17T01:21:44.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-17T01:21:44.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-17T01:21:44.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-17T01:21:44.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-17T01:21:44.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-17T01:21:44.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-17T01:21:44.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-17T01:21:44.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-17T01:21:44.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-17T01:21:44.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-17T01:21:44.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-17T01:21:44.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-17T01:21:44.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-17T01:21:44.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-17T01:21:44.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-17T01:21:44.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-17T01:21:44.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-17T01:21:44.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-17T01:21:44.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-17T01:21:44.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-17T01:21:44.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-17T01:21:44.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-17T01:21:44.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-17T01:21:44.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-17T01:21:44.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-17T01:21:44.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-17T01:21:44.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-17T01:21:44.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-17T01:21:44.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-17T01:21:44.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-17T01:21:44.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-17T01:21:44.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-17T01:21:44.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-17T01:21:44.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-17T01:21:44.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-17T01:21:44.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-17T01:21:44.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-17T01:21:44.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-17T01:21:44.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-17T01:21:44.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-17T01:21:44.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-17T01:21:44.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-17T01:21:44.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-17T01:21:44.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-17T01:21:44.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-17T01:21:44.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-17T01:21:44.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-17T01:21:44.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-17T01:21:44.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-17T01:21:44.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-17T01:21:44.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-17T01:21:44.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-17T01:21:44.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-17T01:21:44.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-17T01:21:44.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-17T01:21:44.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-17T01:21:44.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-17T01:21:44.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-17T01:21:44.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-17T01:21:44.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-17T01:21:44.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-17T01:21:44.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-17T01:21:44.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-17T01:21:44.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-17T01:21:44.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-17T01:21:44.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-17T01:21:44.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-17T01:21:44.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-17T01:21:44.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-17T01:21:44.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-17T01:21:44.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-17T01:21:44.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-17T01:21:44.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-17T01:21:44.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-17T01:21:44.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-17T01:21:44.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-17T01:21:44.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-17T01:21:44.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-17T01:21:44.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-17T01:21:44.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-17T01:21:44.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-17T01:21:44.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-17T01:21:44.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-17T01:21:44.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-17T01:21:44.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-17T01:21:44.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-17T01:21:44.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-17T01:21:44.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-17T01:21:44.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-17T01:21:44.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-17T01:21:44.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-17T01:21:44.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-17T01:21:44.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-17T01:21:44.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-17T01:21:44.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-17T01:21:44.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-17T01:21:44.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-17T01:21:44.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-17T01:21:44.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-17T01:21:44.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-17T01:21:44.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-17T01:21:44.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-17T01:21:44.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-17T01:21:44.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-17T01:21:44.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-17T01:21:44.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-17T01:21:44.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-17T01:21:44.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-17T01:21:44.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-17T01:21:44.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-17T01:21:44.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-17T01:21:44.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-17T01:21:44.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-17T01:21:44.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-17T01:21:44.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-17T01:21:44.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-17T01:21:44.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-17T01:21:44.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-17T01:21:44.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-17T01:21:44.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-17T01:21:44.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-17T01:21:44.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-17T01:21:44.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-17T01:21:44.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-17T01:21:44.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-17T01:21:44.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-17T01:21:44.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-17T01:21:44.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-17T01:21:44.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-17T01:21:44.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-17T01:21:44.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-17T01:21:44.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-17T01:21:44.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-17T01:21:44.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-17T01:21:44.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-17T01:21:44.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-17T01:21:44.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-17T01:21:44.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-17T01:21:44.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-17T01:21:44.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-17T01:21:44.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-17T01:21:44.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-17T01:21:44.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-17T01:21:44.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-17T01:21:44.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-17T01:21:44.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-17T01:21:44.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-17T01:21:44.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-17T01:21:44.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-17T01:21:44.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-17T01:21:44.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-17T01:21:44.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-17T01:21:44.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-17T01:21:44.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-17T01:21:44.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-17T01:21:44.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-17T01:21:44.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-17T01:21:44.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-17T01:21:44.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-17T01:21:44.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-17T01:21:44.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-17T01:21:44.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-17T01:21:44.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-17T01:21:44.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-17T01:21:44.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-17T01:21:44.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-17T01:21:44.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-17T01:21:44.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-17T01:21:44.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-17T01:21:44.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-17T01:21:44.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-17T01:21:44.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-17T01:21:44.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-17T01:21:44.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-17T01:21:44.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-17T01:21:44.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-17T01:21:44.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-17T01:21:44.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-17T01:21:44.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-17T01:21:44.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-17T01:21:44.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-17T01:21:44.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-17T01:21:44.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-17T01:21:44.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-17T01:21:44.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-17T01:21:44.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-17T01:21:44.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-17T01:21:44.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-17T01:21:44.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-17T01:21:44.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-17T01:21:44.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-17T01:21:44.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-17T01:21:44.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-17T01:21:44.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-17T01:21:44.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-17T01:21:44.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-17T01:21:44.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-17T01:21:44.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-17T01:21:44.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-17T01:21:44.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-17T01:21:44.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-17T01:21:44.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-17T01:21:44.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-17T01:21:44.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-17T01:21:44.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-17T01:21:44.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-17T01:21:44.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-17T01:21:44.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-17T01:21:44.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-17T01:21:44.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-17T01:21:44.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-17T01:21:44.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-17T01:21:44.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-17T01:21:44.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-17T01:21:44.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-17T01:21:44.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-17T01:21:44.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-17T01:21:44.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-17T01:21:44.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-17T01:21:44.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-17T01:21:44.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-17T01:21:44.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-17T01:21:44.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-17T01:21:44.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-17T01:21:44.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-17T01:21:44.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-17T01:21:44.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-17T01:21:44.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-17T01:21:44.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-17T01:21:44.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-17T01:21:44.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-17T01:21:44.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-17T01:21:44.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-17T01:21:44.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-17T01:21:44.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-17T01:21:44.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-17T01:21:44.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-17T01:21:44.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-17T01:21:44.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-17T01:21:44.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-17T01:21:44.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-17T01:21:44.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-17T01:21:44.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-17T01:21:44.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-17T01:21:44.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-17T01:21:44.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-17T01:21:44.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-17T01:21:44.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-17T01:21:44.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-17T01:21:44.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-17T01:21:44.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-17T01:21:44.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-17T01:21:44.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-17T01:21:44.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-17T01:21:44.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-17T01:21:44.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-17T01:21:44.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-17T01:21:44.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-17T01:21:44.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-17T01:21:44.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-17T01:21:44.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-17T01:21:44.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-17T01:21:44.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-17T01:21:44.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-17T01:21:44.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-17T01:21:44.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-17T01:21:44.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-17T01:21:44.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-17T01:21:44.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-17T01:21:44.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-17T01:21:44.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-17T01:21:44.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-17T01:21:44.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-17T01:21:44.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-17T01:21:44.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-17T01:21:44.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-17T01:21:44.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-17T01:21:44.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-17T01:21:44.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-17T01:21:44.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-17T01:21:44.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-17T01:21:44.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-17T01:21:44.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-17T01:21:44.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-17T01:21:44.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-17T01:21:44.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-17T01:21:44.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-17T01:21:44.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-17T01:21:44.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-17T01:21:44.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-17T01:21:44.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-17T01:21:44.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-17T01:21:44.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-17T01:21:44.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-17T01:21:44.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-17T01:21:44.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-17T01:21:44.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-17T01:21:44.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-17T01:21:44.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-17T01:21:44.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-17T01:21:44.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-17T01:21:44.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-17T01:21:44.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-17T01:21:44.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-17T01:21:44.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-17T01:21:44.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-17T01:21:44.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-17T01:21:44.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-17T01:21:44.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-17T01:21:44.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-17T01:21:44.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-17T01:21:44.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-17T01:21:44.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-17T01:21:44.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-17T01:21:44.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-17T01:21:44.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-17T01:21:44.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-17T01:21:44.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-17T01:21:44.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-17T01:21:44.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-17T01:21:44.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-17T01:21:44.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-17T01:21:44.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-17T01:21:44.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-17T01:21:44.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-17T01:21:44.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-17T01:21:44.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-17T01:21:44.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-17T01:21:44.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-17T01:21:44.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-17T01:21:44.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-17T01:21:44.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-17T01:21:44.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-17T01:21:44.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-17T01:21:44.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-17T01:21:44.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-17T01:21:44.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-17T01:21:44.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-17T01:21:44.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-17T01:21:44.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-17T01:21:44.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-17T01:21:44.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-17T01:21:44.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-17T01:21:44.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-17T01:21:44.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-17T01:21:44.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-17T01:21:44.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-17T01:21:44.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-17T01:21:44.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-17T01:21:44.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-17T01:21:44.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-17T01:21:44.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-17T01:21:44.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-17T01:21:44.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-17T01:21:44.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-17T01:21:44.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-17T01:21:44.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-17T01:21:44.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-17T01:21:44.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-17T01:21:44.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-17T01:21:44.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-17T01:21:44.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-17T01:21:44.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-17T01:21:44.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-17T01:21:44.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-17T01:21:44.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-17T01:21:44.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-17T01:21:44.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-17T01:21:44.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-17T01:21:44.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-17T01:21:44.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-17T01:21:44.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-17T01:21:44.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-17T01:21:44.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-17T01:21:44.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-17T01:21:44.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-17T01:21:44.328 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T01:21:44.329 DEBUG:teuthology.orchestra.run.smithi043:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-17T01:21:44.361 INFO:teuthology.orchestra.run.smithi043.stdout:postinstall scriptlet (using /bin/sh): 2024-09-17T01:21:44.361 INFO:teuthology.orchestra.run.smithi043.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-17T01:21:44.361 INFO:teuthology.orchestra.run.smithi043.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-17T01:21:44.361 INFO:teuthology.orchestra.run.smithi043.stdout:fi 2024-09-17T01:21:44.361 INFO:teuthology.orchestra.run.smithi043.stdout:for file in vmlinuz System.map config; do 2024-09-17T01:21:44.361 INFO:teuthology.orchestra.run.smithi043.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-17T01:21:44.361 INFO:teuthology.orchestra.run.smithi043.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-17T01:21:44.362 INFO:teuthology.orchestra.run.smithi043.stdout: fi 2024-09-17T01:21:44.362 INFO:teuthology.orchestra.run.smithi043.stdout:done 2024-09-17T01:21:44.362 INFO:teuthology.orchestra.run.smithi043.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-17T01:21:44.362 INFO:teuthology.orchestra.run.smithi043.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-17T01:21:44.362 INFO:teuthology.orchestra.run.smithi043.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-17T01:21:44.362 INFO:teuthology.orchestra.run.smithi043.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-17T01:21:44.362 INFO:teuthology.orchestra.run.smithi043.stdout:fi 2024-09-17T01:21:44.362 INFO:teuthology.orchestra.run.smithi043.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-17T01:21:44.362 INFO:teuthology.orchestra.run.smithi043.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T01:21:44.362 INFO:teuthology.orchestra.run.smithi043.stdout:fi 2024-09-17T01:21:44.362 INFO:teuthology.orchestra.run.smithi043.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-17T01:21:44.362 INFO:teuthology.orchestra.run.smithi043.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-17T01:21:44.363 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T01:21:44.363 INFO:teuthology.orchestra.run.smithi043.stdout:fi 2024-09-17T01:21:44.363 DEBUG:teuthology.orchestra.run.smithi043:> sudo rpm -qi grub2-tools 2024-09-17T01:21:44.444 INFO:teuthology.orchestra.run.smithi043.stdout:Name : grub2-tools 2024-09-17T01:21:44.445 INFO:teuthology.orchestra.run.smithi043.stdout:Epoch : 1 2024-09-17T01:21:44.445 INFO:teuthology.orchestra.run.smithi043.stdout:Version : 2.06 2024-09-17T01:21:44.445 INFO:teuthology.orchestra.run.smithi043.stdout:Release : 82.el9 2024-09-17T01:21:44.445 INFO:teuthology.orchestra.run.smithi043.stdout:Architecture: x86_64 2024-09-17T01:21:44.445 INFO:teuthology.orchestra.run.smithi043.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T01:21:44.445 INFO:teuthology.orchestra.run.smithi043.stdout:Group : Unspecified 2024-09-17T01:21:44.445 INFO:teuthology.orchestra.run.smithi043.stdout:Size : 8274670 2024-09-17T01:21:44.445 INFO:teuthology.orchestra.run.smithi043.stdout:License : GPLv3+ 2024-09-17T01:21:44.445 INFO:teuthology.orchestra.run.smithi043.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T01:21:44.445 INFO:teuthology.orchestra.run.smithi043.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T01:21:44.445 INFO:teuthology.orchestra.run.smithi043.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T01:21:44.445 INFO:teuthology.orchestra.run.smithi043.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T01:21:44.446 INFO:teuthology.orchestra.run.smithi043.stdout:Packager : builder@centos.org 2024-09-17T01:21:44.446 INFO:teuthology.orchestra.run.smithi043.stdout:Vendor : CentOS 2024-09-17T01:21:44.446 INFO:teuthology.orchestra.run.smithi043.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T01:21:44.446 INFO:teuthology.orchestra.run.smithi043.stdout:Summary : Support tools for GRUB. 2024-09-17T01:21:44.446 INFO:teuthology.orchestra.run.smithi043.stdout:Description : 2024-09-17T01:21:44.446 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:21:44.446 INFO:teuthology.orchestra.run.smithi043.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T01:21:44.446 INFO:teuthology.orchestra.run.smithi043.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T01:21:44.446 INFO:teuthology.orchestra.run.smithi043.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T01:21:44.446 INFO:teuthology.orchestra.run.smithi043.stdout:hardware devices. 2024-09-17T01:21:44.446 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:21:44.446 INFO:teuthology.orchestra.run.smithi043.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T01:21:44.447 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T01:21:44.448 INFO:teuthology.task.kernel:Updating grub on smithi043 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T01:21:44.448 DEBUG:teuthology.orchestra.run.smithi043:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T01:21:45.179 INFO:teuthology.orchestra.run.smithi043.stderr:Generating grub configuration file ... 2024-09-17T01:21:46.474 INFO:teuthology.orchestra.run.smithi043.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T01:21:46.489 INFO:teuthology.orchestra.run.smithi043.stderr:done 2024-09-17T01:21:46.497 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-09-17T01:21:46.527 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.HWarV1XhCZ 2024-09-17T01:21:46.527 DEBUG:teuthology.orchestra.run.smithi043:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.HWarV1XhCZ 2024-09-17T01:21:46.593 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.HWarV1XhCZ 2024-09-17T01:21:46.745 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.HWarV1XhCZ is 6KB 2024-09-17T01:21:46.792 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.HWarV1XhCZ 2024-09-17T01:21:46.809 DEBUG:teuthology.orchestra.run.smithi043:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T01:21:46.873 INFO:teuthology.orchestra.run.smithi043.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T01:21:46.874 INFO:teuthology.orchestra.run.smithi043.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T01:21:46.874 INFO:teuthology.orchestra.run.smithi043.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T01:21:46.874 INFO:teuthology.orchestra.run.smithi043.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-17T01:21:46.875 DEBUG:teuthology.orchestra.run.smithi043:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T01:21:47.023 DEBUG:teuthology.orchestra.run.smithi043:> sudo shutdown -r now 2024-09-17T01:22:13.390 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-17T01:22:13.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-17T01:22:13.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:22:17.029 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-17T01:22:17.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-17T01:22:17.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:22:31.873 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-09-17T01:22:35.453 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-09-17T01:22:40.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-17T01:22:40.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:22:44.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-17T01:22:44.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:23:40.937 DEBUG:teuthology.orchestra.remote:timed out 2024-09-17T01:23:44.461 DEBUG:teuthology.orchestra.remote:timed out 2024-09-17T01:23:52.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-17T01:23:52.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:23:53.381 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-09-17T01:23:53.864 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-17T01:23:53.864 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-17T01:23:53.865 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-09-17T01:23:53.899 INFO:teuthology.orchestra.run.smithi042.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-17T01:23:53.899 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T01:23:53.899 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T01:23:53.899 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T01:23:54.900 DEBUG:teuthology.parallel:result is None 2024-09-17T01:23:56.462 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-17T01:23:56.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:23:56.783 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-09-17T01:23:57.265 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-17T01:23:57.265 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-17T01:23:57.266 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-09-17T01:23:57.300 INFO:teuthology.orchestra.run.smithi043.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-17T01:23:57.300 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T01:23:57.300 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T01:23:57.300 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T01:23:58.303 DEBUG:teuthology.parallel:result is None 2024-09-17T01:23:58.303 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T01:23:58.310 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T01:23:58.310 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T01:23:58.314 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T01:23:58.352 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T01:23:58.359 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T01:23:58.372 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T01:23:58.373 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T01:23:58.393 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T01:23:58.445 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T01:23:58.451 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T01:23:58.451 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T01:23:58.474 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T01:23:58.575 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T01:23:58.583 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T01:23:58.604 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T01:23:58.612 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T01:23:58.615 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T01:23:58.622 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T01:23:58.622 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T01:23:58.626 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T01:23:58.683 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T01:23:58.693 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T01:23:58.693 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T01:23:58.697 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T01:23:58.732 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T01:23:58.833 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T01:23:58.905 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T01:23:58.965 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T01:23:59.038 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:23:59.038 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T01:23:59.093 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T01:23:59.158 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T01:23:59.240 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T01:23:59.300 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T01:23:59.374 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:23:59.374 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T01:23:59.429 DEBUG:teuthology.orchestra.run.smithi042:> sudo service rsyslog restart 2024-09-17T01:23:59.433 DEBUG:teuthology.orchestra.run.smithi043:> sudo service rsyslog restart 2024-09-17T01:23:59.508 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T01:23:59.550 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T01:23:59.936 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T01:23:59.944 INFO:teuthology.task.internal:Starting timer... 2024-09-17T01:23:59.945 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T01:23:59.968 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T01:23:59.976 DEBUG:teuthology.orchestra.run.smithi042:> sudo service auditd rotate 2024-09-17T01:24:00.115 INFO:teuthology.orchestra.run.smithi042.stdout:Rotating logs: 2024-09-17T01:24:00.119 DEBUG:teuthology.orchestra.run.smithi043:> sudo service auditd rotate 2024-09-17T01:24:00.198 INFO:teuthology.orchestra.run.smithi043.stdout:Rotating logs: 2024-09-17T01:24:00.201 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T01:24:00.201 DEBUG:teuthology.orchestra.run.smithi042:> /usr/sbin/getenforce 2024-09-17T01:24:00.246 INFO:teuthology.orchestra.run.smithi042.stdout:Permissive 2024-09-17T01:24:00.246 DEBUG:teuthology.orchestra.run.smithi043:> /usr/sbin/getenforce 2024-09-17T01:24:00.289 INFO:teuthology.orchestra.run.smithi043.stdout:Permissive 2024-09-17T01:24:00.289 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi042.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi043.front.sepia.ceph.com': 'permissive'} 2024-09-17T01:24:00.290 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T01:24:00.346 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:24:00.347 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T01:24:00.406 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:24:00.406 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T01:24:00.407 DEBUG:teuthology.orchestra.run.smithi042:> sudo /usr/sbin/setenforce permissive 2024-09-17T01:24:00.489 DEBUG:teuthology.orchestra.run.smithi043:> sudo /usr/sbin/setenforce permissive 2024-09-17T01:24:00.556 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T01:24:00.565 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T01:24:00.577 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T01:24:00.578 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi042.front.sepia.ceph.com,smithi043.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T01:28:49.298 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi042.front.sepia.ceph.com'), Remote(name='ubuntu@smithi043.front.sepia.ceph.com')] 2024-09-17T01:28:49.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-17T01:28:49.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:28:49.396 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-09-17T01:28:49.504 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-17T01:28:49.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-17T01:28:49.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:28:49.599 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-09-17T01:28:49.704 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-17T01:28:49.704 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T01:28:49.714 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T01:28:49.715 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T01:28:49.715 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T01:28:49.719 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T01:28:49.719 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T01:28:49.777 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T01:28:49.807 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T01:28:49.807 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T01:28:49.837 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T01:28:49.857 INFO:teuthology.orchestra.run.smithi042.stderr:sudo: ntpd: command not found 2024-09-17T01:28:49.882 INFO:teuthology.orchestra.run.smithi042.stdout:506 Cannot talk to daemon 2024-09-17T01:28:49.888 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: ntpd: command not found 2024-09-17T01:28:49.911 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T01:28:49.912 INFO:teuthology.orchestra.run.smithi043.stdout:506 Cannot talk to daemon 2024-09-17T01:28:49.941 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T01:28:49.942 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T01:28:49.971 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T01:28:50.035 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-09-17T01:28:50.041 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T01:28:50.041 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-09-17T01:28:50.041 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:28:50.041 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:28:50.041 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:28:50.041 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:28:50.064 INFO:teuthology.orchestra.run.smithi043.stderr:bash: line 1: ntpq: command not found 2024-09-17T01:28:50.071 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T01:28:50.071 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2024-09-17T01:28:50.071 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:28:50.071 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:28:50.071 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:28:50.071 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:28:50.072 INFO:teuthology.run_tasks:Running task install... 2024-09-17T01:28:50.079 DEBUG:teuthology.task.install:project ceph 2024-09-17T01:28:50.080 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}} 2024-09-17T01:28:50.080 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'} 2024-09-17T01:28:50.080 INFO:teuthology.task.install:Using flavor: default 2024-09-17T01:28:50.085 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T01:28:50.086 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-17T01:28:50.086 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'tag': None, 'wait_for_package': False} 2024-09-17T01:28:50.087 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T01:28:50.089 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'tag': None, 'wait_for_package': False} 2024-09-17T01:28:50.089 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T01:28:50.240 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/ 2024-09-17T01:28:50.240 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4989.gce1b342b 2024-09-17T01:28:50.243 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/ 2024-09-17T01:28:50.244 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4989.gce1b342b 2024-09-17T01:28:50.358 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T01:28:50.358 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:28:50.359 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T01:28:50.364 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T01:28:50.364 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:28:50.364 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T01:28:50.415 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-17T01:28:50.415 DEBUG:teuthology.orchestra.run.smithi043:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T01:28:50.420 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-17T01:28:50.421 DEBUG:teuthology.orchestra.run.smithi042:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T01:28:50.513 DEBUG:teuthology.orchestra.run.smithi043:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T01:28:50.518 DEBUG:teuthology.orchestra.run.smithi042:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T01:28:50.592 DEBUG:teuthology.orchestra.run.smithi043:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T01:28:50.596 DEBUG:teuthology.orchestra.run.smithi042:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T01:28:50.648 INFO:teuthology.orchestra.run.smithi043.stdout:check_obsoletes = 1 2024-09-17T01:28:50.652 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum clean all 2024-09-17T01:28:50.652 INFO:teuthology.orchestra.run.smithi042.stdout:check_obsoletes = 1 2024-09-17T01:28:50.655 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum clean all 2024-09-17T01:28:50.930 INFO:teuthology.orchestra.run.smithi042.stdout:45 files removed 2024-09-17T01:28:50.931 INFO:teuthology.orchestra.run.smithi043.stdout:45 files removed 2024-09-17T01:28:50.964 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-17T01:28:50.965 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-17T01:28:51.649 INFO:teuthology.orchestra.run.smithi042.stdout:ceph packages for x86_64 311 kB/s | 84 kB 00:00 2024-09-17T01:28:51.667 INFO:teuthology.orchestra.run.smithi043.stdout:ceph packages for x86_64 287 kB/s | 84 kB 00:00 2024-09-17T01:28:51.949 INFO:teuthology.orchestra.run.smithi042.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-17T01:28:51.958 INFO:teuthology.orchestra.run.smithi043.stdout:ceph noarch packages 99 kB/s | 24 kB 00:00 2024-09-17T01:28:52.225 INFO:teuthology.orchestra.run.smithi042.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-17T01:28:52.242 INFO:teuthology.orchestra.run.smithi043.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-17T01:28:52.834 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-17T01:28:53.150 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 9.3 MB/s | 8.3 MB 00:00 2024-09-17T01:28:56.185 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-09-17T01:28:59.788 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - AppStream 3.5 MB/s | 20 MB 00:05 2024-09-17T01:29:05.108 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 1.4 MB/s | 6.5 MB 00:04 2024-09-17T01:29:05.777 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-17T01:29:06.645 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 102 kB/s | 19 kB 00:00 2024-09-17T01:29:07.562 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 19 kB 00:00 2024-09-17T01:29:07.749 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-17T01:29:08.874 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-17T01:29:14.372 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-09-17T01:29:15.463 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-17T01:29:16.777 INFO:teuthology.orchestra.run.smithi042.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T01:29:16.777 INFO:teuthology.orchestra.run.smithi042.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T01:29:16.789 INFO:teuthology.orchestra.run.smithi042.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-17T01:29:16.790 INFO:teuthology.orchestra.run.smithi042.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-17T01:29:16.791 INFO:teuthology.orchestra.run.smithi042.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T01:29:16.792 INFO:teuthology.orchestra.run.smithi042.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T01:29:16.793 INFO:teuthology.orchestra.run.smithi042.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T01:29:16.796 INFO:teuthology.orchestra.run.smithi042.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-17T01:29:16.797 INFO:teuthology.orchestra.run.smithi042.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T01:29:16.867 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-17T01:29:16.881 INFO:teuthology.orchestra.run.smithi042.stdout:======================================================================================= 2024-09-17T01:29:16.881 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-09-17T01:29:16.881 INFO:teuthology.orchestra.run.smithi042.stdout:======================================================================================= 2024-09-17T01:29:16.881 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-17T01:29:16.881 INFO:teuthology.orchestra.run.smithi042.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-17T01:29:16.881 INFO:teuthology.orchestra.run.smithi042.stdout: ceph x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 6.6 k 2024-09-17T01:29:16.881 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.5 M 2024-09-17T01:29:16.881 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 873 k 2024-09-17T01:29:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 148 k 2024-09-17T01:29:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 1.5 M 2024-09-17T01:29:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 154 k 2024-09-17T01:29:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 14 M 2024-09-17T01:29:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 7.4 M 2024-09-17T01:29:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 49 k 2024-09-17T01:29:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 10 M 2024-09-17T01:29:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 40 M 2024-09-17T01:29:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 285 k 2024-09-17T01:29:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 784 k 2024-09-17T01:29:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 225 k 2024-09-17T01:29:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-shell x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 27 k 2024-09-17T01:29:16.883 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-top noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 18 k 2024-09-17T01:29:16.883 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-17T01:29:16.883 INFO:teuthology.orchestra.run.smithi042.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-17T01:29:16.883 INFO:teuthology.orchestra.run.smithi042.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-17T01:29:16.883 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 32 k 2024-09-17T01:29:16.883 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 766 k 2024-09-17T01:29:16.883 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 127 k 2024-09-17T01:29:16.883 INFO:teuthology.orchestra.run.smithi042.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-17T01:29:16.883 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-17T01:29:16.883 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-17T01:29:16.883 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-17T01:29:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-17T01:29:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-17T01:29:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 161 k 2024-09-17T01:29:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 321 k 2024-09-17T01:29:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 305 k 2024-09-17T01:29:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 99 k 2024-09-17T01:29:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 86 k 2024-09-17T01:29:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.1 M 2024-09-17T01:29:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 170 k 2024-09-17T01:29:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-17T01:29:16.884 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrading: 2024-09-17T01:29:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-17T01:29:16.885 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-17T01:29:16.885 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-17T01:29:16.885 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-17T01:29:16.885 INFO:teuthology.orchestra.run.smithi042.stdout: librados2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.4 M 2024-09-17T01:29:16.885 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.2 M 2024-09-17T01:29:16.885 INFO:teuthology.orchestra.run.smithi042.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-17T01:29:16.885 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-17T01:29:16.885 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-09-17T01:29:16.885 INFO:teuthology.orchestra.run.smithi042.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T01:29:16.885 INFO:teuthology.orchestra.run.smithi042.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-17T01:29:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T01:29:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 20 M 2024-09-17T01:29:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 34 k 2024-09-17T01:29:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 2.3 M 2024-09-17T01:29:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 291 k 2024-09-17T01:29:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.0 M 2024-09-17T01:29:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 18 M 2024-09-17T01:29:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 16 k 2024-09-17T01:29:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 25 k 2024-09-17T01:29:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T01:29:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T01:29:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T01:29:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T01:29:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T01:29:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T01:29:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T01:29:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T01:29:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 158 k 2024-09-17T01:29:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T01:29:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T01:29:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T01:29:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T01:29:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T01:29:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T01:29:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 507 k 2024-09-17T01:29:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T01:29:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.3 M 2024-09-17T01:29:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T01:29:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-17T01:29:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T01:29:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T01:29:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T01:29:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T01:29:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T01:29:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T01:29:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T01:29:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-17T01:29:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T01:29:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T01:29:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T01:29:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-17T01:29:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T01:29:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T01:29:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T01:29:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 45 k 2024-09-17T01:29:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 143 k 2024-09-17T01:29:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T01:29:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T01:29:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T01:29:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T01:29:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-17T01:29:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-17T01:29:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T01:29:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T01:29:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T01:29:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T01:29:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T01:29:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T01:29:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T01:29:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T01:29:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T01:29:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T01:29:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T01:29:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T01:29:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T01:29:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T01:29:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T01:29:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T01:29:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T01:29:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T01:29:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T01:29:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T01:29:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T01:29:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T01:29:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T01:29:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T01:29:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T01:29:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T01:29:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T01:29:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T01:29:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T01:29:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T01:29:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T01:29:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T01:29:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-17T01:29:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T01:29:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T01:29:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T01:29:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T01:29:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T01:29:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T01:29:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T01:29:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T01:29:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T01:29:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T01:29:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T01:29:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-17T01:29:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T01:29:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T01:29:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T01:29:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T01:29:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T01:29:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T01:29:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T01:29:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T01:29:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T01:29:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-17T01:29:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T01:29:16.895 INFO:teuthology.orchestra.run.smithi042.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-17T01:29:16.895 INFO:teuthology.orchestra.run.smithi042.stdout:Installing weak dependencies: 2024-09-17T01:29:16.895 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T01:29:16.895 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:29:16.895 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-17T01:29:16.895 INFO:teuthology.orchestra.run.smithi042.stdout:======================================================================================= 2024-09-17T01:29:16.895 INFO:teuthology.orchestra.run.smithi042.stdout:Install 149 Packages 2024-09-17T01:29:16.895 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrade 8 Packages 2024-09-17T01:29:16.895 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:29:16.896 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 228 M 2024-09-17T01:29:16.896 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-17T01:29:17.724 INFO:teuthology.orchestra.run.smithi042.stdout:(1/157): ceph-19.3.0-4989.gce1b342b.el9.x86_64. 45 kB/s | 6.6 kB 00:00 2024-09-17T01:29:17.887 INFO:teuthology.orchestra.run.smithi043.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T01:29:17.888 INFO:teuthology.orchestra.run.smithi043.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T01:29:17.898 INFO:teuthology.orchestra.run.smithi042.stdout:(2/157): ceph-fuse-19.3.0-4989.gce1b342b.el9.x8 4.9 MB/s | 873 kB 00:00 2024-09-17T01:29:17.902 INFO:teuthology.orchestra.run.smithi043.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-17T01:29:17.904 INFO:teuthology.orchestra.run.smithi043.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-17T01:29:17.905 INFO:teuthology.orchestra.run.smithi043.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T01:29:17.906 INFO:teuthology.orchestra.run.smithi043.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T01:29:17.908 INFO:teuthology.orchestra.run.smithi043.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T01:29:17.911 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-17T01:29:17.912 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T01:29:17.983 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-17T01:29:18.003 INFO:teuthology.orchestra.run.smithi042.stdout:(3/157): ceph-immutable-object-cache-19.3.0-498 1.4 MB/s | 148 kB 00:00 2024-09-17T01:29:18.007 INFO:teuthology.orchestra.run.smithi043.stdout:======================================================================================= 2024-09-17T01:29:18.007 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2024-09-17T01:29:18.007 INFO:teuthology.orchestra.run.smithi043.stdout:======================================================================================= 2024-09-17T01:29:18.007 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-09-17T01:29:18.007 INFO:teuthology.orchestra.run.smithi043.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-17T01:29:18.007 INFO:teuthology.orchestra.run.smithi043.stdout: ceph x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 6.6 k 2024-09-17T01:29:18.007 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.5 M 2024-09-17T01:29:18.008 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 873 k 2024-09-17T01:29:18.008 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 148 k 2024-09-17T01:29:18.008 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 1.5 M 2024-09-17T01:29:18.008 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 154 k 2024-09-17T01:29:18.008 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 14 M 2024-09-17T01:29:18.008 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 7.4 M 2024-09-17T01:29:18.008 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 49 k 2024-09-17T01:29:18.008 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 10 M 2024-09-17T01:29:18.008 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 40 M 2024-09-17T01:29:18.008 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 285 k 2024-09-17T01:29:18.008 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 784 k 2024-09-17T01:29:18.008 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 225 k 2024-09-17T01:29:18.008 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-shell x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 27 k 2024-09-17T01:29:18.009 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-top noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 18 k 2024-09-17T01:29:18.009 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-17T01:29:18.009 INFO:teuthology.orchestra.run.smithi043.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-17T01:29:18.009 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-17T01:29:18.009 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 32 k 2024-09-17T01:29:18.009 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 766 k 2024-09-17T01:29:18.009 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 127 k 2024-09-17T01:29:18.009 INFO:teuthology.orchestra.run.smithi043.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-17T01:29:18.009 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-17T01:29:18.009 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-17T01:29:18.009 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-17T01:29:18.009 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-17T01:29:18.010 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-17T01:29:18.010 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 161 k 2024-09-17T01:29:18.010 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 321 k 2024-09-17T01:29:18.010 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 305 k 2024-09-17T01:29:18.010 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 99 k 2024-09-17T01:29:18.010 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 86 k 2024-09-17T01:29:18.010 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.1 M 2024-09-17T01:29:18.010 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 170 k 2024-09-17T01:29:18.010 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-17T01:29:18.010 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrading: 2024-09-17T01:29:18.010 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-17T01:29:18.010 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-17T01:29:18.010 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-17T01:29:18.011 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-17T01:29:18.011 INFO:teuthology.orchestra.run.smithi043.stdout: librados2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.4 M 2024-09-17T01:29:18.011 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.2 M 2024-09-17T01:29:18.011 INFO:teuthology.orchestra.run.smithi043.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-17T01:29:18.011 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-17T01:29:18.011 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-09-17T01:29:18.011 INFO:teuthology.orchestra.run.smithi043.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T01:29:18.011 INFO:teuthology.orchestra.run.smithi043.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-17T01:29:18.011 INFO:teuthology.orchestra.run.smithi043.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T01:29:18.011 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 20 M 2024-09-17T01:29:18.011 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 34 k 2024-09-17T01:29:18.011 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 2.3 M 2024-09-17T01:29:18.012 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 291 k 2024-09-17T01:29:18.012 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.0 M 2024-09-17T01:29:18.012 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 18 M 2024-09-17T01:29:18.012 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 16 k 2024-09-17T01:29:18.012 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 25 k 2024-09-17T01:29:18.012 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T01:29:18.012 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T01:29:18.012 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T01:29:18.012 INFO:teuthology.orchestra.run.smithi043.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T01:29:18.012 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T01:29:18.012 INFO:teuthology.orchestra.run.smithi043.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T01:29:18.012 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T01:29:18.012 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T01:29:18.012 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 158 k 2024-09-17T01:29:18.013 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T01:29:18.013 INFO:teuthology.orchestra.run.smithi043.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T01:29:18.013 INFO:teuthology.orchestra.run.smithi043.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T01:29:18.013 INFO:teuthology.orchestra.run.smithi043.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T01:29:18.013 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T01:29:18.013 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T01:29:18.013 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 507 k 2024-09-17T01:29:18.013 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T01:29:18.013 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.3 M 2024-09-17T01:29:18.013 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T01:29:18.013 INFO:teuthology.orchestra.run.smithi043.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-17T01:29:18.013 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T01:29:18.013 INFO:teuthology.orchestra.run.smithi043.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T01:29:18.014 INFO:teuthology.orchestra.run.smithi043.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T01:29:18.014 INFO:teuthology.orchestra.run.smithi043.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T01:29:18.014 INFO:teuthology.orchestra.run.smithi043.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T01:29:18.014 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T01:29:18.014 INFO:teuthology.orchestra.run.smithi043.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T01:29:18.014 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-17T01:29:18.014 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T01:29:18.014 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T01:29:18.014 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T01:29:18.014 INFO:teuthology.orchestra.run.smithi043.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-17T01:29:18.014 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T01:29:18.014 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T01:29:18.014 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T01:29:18.015 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 45 k 2024-09-17T01:29:18.015 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 143 k 2024-09-17T01:29:18.015 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T01:29:18.015 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T01:29:18.015 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T01:29:18.015 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T01:29:18.015 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-17T01:29:18.015 INFO:teuthology.orchestra.run.smithi043.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-17T01:29:18.015 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T01:29:18.015 INFO:teuthology.orchestra.run.smithi043.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T01:29:18.015 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T01:29:18.015 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T01:29:18.015 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T01:29:18.016 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T01:29:18.016 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T01:29:18.016 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T01:29:18.016 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T01:29:18.016 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T01:29:18.016 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T01:29:18.016 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T01:29:18.016 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T01:29:18.016 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T01:29:18.016 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T01:29:18.016 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T01:29:18.016 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T01:29:18.016 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T01:29:18.017 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T01:29:18.017 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T01:29:18.017 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T01:29:18.017 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T01:29:18.017 INFO:teuthology.orchestra.run.smithi043.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T01:29:18.017 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T01:29:18.017 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T01:29:18.017 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T01:29:18.017 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T01:29:18.017 INFO:teuthology.orchestra.run.smithi043.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T01:29:18.017 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T01:29:18.017 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T01:29:18.017 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T01:29:18.018 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T01:29:18.018 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-17T01:29:18.018 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T01:29:18.018 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T01:29:18.018 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T01:29:18.018 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T01:29:18.018 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T01:29:18.018 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T01:29:18.018 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T01:29:18.018 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T01:29:18.018 INFO:teuthology.orchestra.run.smithi043.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T01:29:18.018 INFO:teuthology.orchestra.run.smithi043.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T01:29:18.018 INFO:teuthology.orchestra.run.smithi043.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T01:29:18.018 INFO:teuthology.orchestra.run.smithi043.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-17T01:29:18.019 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T01:29:18.019 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T01:29:18.019 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T01:29:18.019 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T01:29:18.019 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T01:29:18.019 INFO:teuthology.orchestra.run.smithi043.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T01:29:18.019 INFO:teuthology.orchestra.run.smithi043.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T01:29:18.019 INFO:teuthology.orchestra.run.smithi043.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T01:29:18.019 INFO:teuthology.orchestra.run.smithi043.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T01:29:18.019 INFO:teuthology.orchestra.run.smithi043.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-17T01:29:18.019 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T01:29:18.019 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-17T01:29:18.019 INFO:teuthology.orchestra.run.smithi043.stdout:Installing weak dependencies: 2024-09-17T01:29:18.020 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T01:29:18.020 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:29:18.020 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-17T01:29:18.020 INFO:teuthology.orchestra.run.smithi043.stdout:======================================================================================= 2024-09-17T01:29:18.020 INFO:teuthology.orchestra.run.smithi043.stdout:Install 149 Packages 2024-09-17T01:29:18.020 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrade 8 Packages 2024-09-17T01:29:18.020 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:29:18.020 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 228 M 2024-09-17T01:29:18.020 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-17T01:29:18.091 INFO:teuthology.orchestra.run.smithi042.stdout:(4/157): ceph-base-19.3.0-4989.gce1b342b.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-17T01:29:18.175 INFO:teuthology.orchestra.run.smithi042.stdout:(5/157): ceph-mgr-19.3.0-4989.gce1b342b.el9.x86 18 MB/s | 1.5 MB 00:00 2024-09-17T01:29:18.233 INFO:teuthology.orchestra.run.smithi042.stdout:(6/157): ceph-mds-19.3.0-4989.gce1b342b.el9.x86 10 MB/s | 2.3 MB 00:00 2024-09-17T01:29:18.417 INFO:teuthology.orchestra.run.smithi042.stdout:(7/157): ceph-mon-19.3.0-4989.gce1b342b.el9.x86 21 MB/s | 5.0 MB 00:00 2024-09-17T01:29:18.598 INFO:teuthology.orchestra.run.smithi043.stdout:(1/157): ceph-19.3.0-4989.gce1b342b.el9.x86_64. 23 kB/s | 6.6 kB 00:00 2024-09-17T01:29:18.859 INFO:teuthology.orchestra.run.smithi042.stdout:(8/157): ceph-radosgw-19.3.0-4989.gce1b342b.el9 24 MB/s | 10 MB 00:00 2024-09-17T01:29:18.927 INFO:teuthology.orchestra.run.smithi042.stdout:(9/157): ceph-selinux-19.3.0-4989.gce1b342b.el9 371 kB/s | 25 kB 00:00 2024-09-17T01:29:18.973 INFO:teuthology.orchestra.run.smithi043.stdout:(2/157): ceph-fuse-19.3.0-4989.gce1b342b.el9.x8 2.3 MB/s | 873 kB 00:00 2024-09-17T01:29:19.115 INFO:teuthology.orchestra.run.smithi043.stdout:(3/157): ceph-immutable-object-cache-19.3.0-498 1.0 MB/s | 148 kB 00:00 2024-09-17T01:29:19.218 INFO:teuthology.orchestra.run.smithi042.stdout:(10/157): ceph-common-19.3.0-4989.gce1b342b.el9 12 MB/s | 20 MB 00:01 2024-09-17T01:29:19.268 INFO:teuthology.orchestra.run.smithi042.stdout:(11/157): cephfs-mirror-19.3.0-4989.gce1b342b.e 4.4 MB/s | 225 kB 00:00 2024-09-17T01:29:19.490 INFO:teuthology.orchestra.run.smithi043.stdout:(4/157): ceph-mds-19.3.0-4989.gce1b342b.el9.x86 6.1 MB/s | 2.3 MB 00:00 2024-09-17T01:29:19.493 INFO:teuthology.orchestra.run.smithi042.stdout:(12/157): ceph-osd-19.3.0-4989.gce1b342b.el9.x8 14 MB/s | 18 MB 00:01 2024-09-17T01:29:19.520 INFO:teuthology.orchestra.run.smithi042.stdout:(13/157): cephfs-shell-19.3.0-4989.gce1b342b.el 108 kB/s | 27 kB 00:00 2024-09-17T01:29:19.544 INFO:teuthology.orchestra.run.smithi042.stdout:(14/157): libcephfs-devel-19.3.0-4989.gce1b342b 634 kB/s | 32 kB 00:00 2024-09-17T01:29:19.602 INFO:teuthology.orchestra.run.smithi042.stdout:(15/157): libcephfs2-19.3.0-4989.gce1b342b.el9. 9.0 MB/s | 766 kB 00:00 2024-09-17T01:29:19.627 INFO:teuthology.orchestra.run.smithi042.stdout:(16/157): libcephsqlite-19.3.0-4989.gce1b342b.e 1.9 MB/s | 158 kB 00:00 2024-09-17T01:29:19.649 INFO:teuthology.orchestra.run.smithi043.stdout:(5/157): ceph-base-19.3.0-4989.gce1b342b.el9.x8 4.1 MB/s | 5.5 MB 00:01 2024-09-17T01:29:19.653 INFO:teuthology.orchestra.run.smithi042.stdout:(17/157): librados-devel-19.3.0-4989.gce1b342b. 2.5 MB/s | 127 kB 00:00 2024-09-17T01:29:19.686 INFO:teuthology.orchestra.run.smithi042.stdout:(18/157): libradosstriper1-19.3.0-4989.gce1b342 8.5 MB/s | 507 kB 00:00 2024-09-17T01:29:19.716 INFO:teuthology.orchestra.run.smithi043.stdout:(6/157): ceph-mgr-19.3.0-4989.gce1b342b.el9.x86 6.7 MB/s | 1.5 MB 00:00 2024-09-17T01:29:19.762 INFO:teuthology.orchestra.run.smithi042.stdout:(19/157): python3-ceph-argparse-19.3.0-4989.gce 603 kB/s | 45 kB 00:00 2024-09-17T01:29:19.862 INFO:teuthology.orchestra.run.smithi042.stdout:(20/157): python3-ceph-common-19.3.0-4989.gce1b 1.4 MB/s | 143 kB 00:00 2024-09-17T01:29:19.962 INFO:teuthology.orchestra.run.smithi042.stdout:(21/157): python3-cephfs-19.3.0-4989.gce1b342b. 1.6 MB/s | 161 kB 00:00 2024-09-17T01:29:20.037 INFO:teuthology.orchestra.run.smithi042.stdout:(22/157): librgw2-19.3.0-4989.gce1b342b.el9.x86 14 MB/s | 5.3 MB 00:00 2024-09-17T01:29:20.063 INFO:teuthology.orchestra.run.smithi042.stdout:(23/157): python3-rados-19.3.0-4989.gce1b342b.e 3.1 MB/s | 321 kB 00:00 2024-09-17T01:29:20.088 INFO:teuthology.orchestra.run.smithi042.stdout:(24/157): python3-rbd-19.3.0-4989.gce1b342b.el9 5.9 MB/s | 305 kB 00:00 2024-09-17T01:29:20.114 INFO:teuthology.orchestra.run.smithi042.stdout:(25/157): python3-rgw-19.3.0-4989.gce1b342b.el9 1.9 MB/s | 99 kB 00:00 2024-09-17T01:29:20.147 INFO:teuthology.orchestra.run.smithi042.stdout:(26/157): rbd-fuse-19.3.0-4989.gce1b342b.el9.x8 1.4 MB/s | 86 kB 00:00 2024-09-17T01:29:20.239 INFO:teuthology.orchestra.run.smithi042.stdout:(27/157): rbd-nbd-19.3.0-4989.gce1b342b.el9.x86 1.8 MB/s | 170 kB 00:00 2024-09-17T01:29:20.356 INFO:teuthology.orchestra.run.smithi042.stdout:(28/157): rbd-mirror-19.3.0-4989.gce1b342b.el9. 13 MB/s | 3.1 MB 00:00 2024-09-17T01:29:20.404 INFO:teuthology.orchestra.run.smithi042.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4989.g 208 kB/s | 34 kB 00:00 2024-09-17T01:29:20.440 INFO:teuthology.orchestra.run.smithi042.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4989.gce1b342 1.8 MB/s | 154 kB 00:00 2024-09-17T01:29:20.991 INFO:teuthology.orchestra.run.smithi043.stdout:(7/157): ceph-mon-19.3.0-4989.gce1b342b.el9.x86 3.7 MB/s | 5.0 MB 00:01 2024-09-17T01:29:21.249 INFO:teuthology.orchestra.run.smithi043.stdout:(8/157): ceph-common-19.3.0-4989.gce1b342b.el9. 6.8 MB/s | 20 MB 00:02 2024-09-17T01:29:21.291 INFO:teuthology.orchestra.run.smithi043.stdout:(9/157): ceph-selinux-19.3.0-4989.gce1b342b.el9 608 kB/s | 25 kB 00:00 2024-09-17T01:29:21.432 INFO:teuthology.orchestra.run.smithi042.stdout:(31/157): ceph-test-19.3.0-4989.gce1b342b.el9.x 16 MB/s | 40 MB 00:02 2024-09-17T01:29:21.541 INFO:teuthology.orchestra.run.smithi042.stdout:(32/157): ceph-mgr-diskprediction-local-19.3.0- 6.7 MB/s | 7.4 MB 00:01 2024-09-17T01:29:21.574 INFO:teuthology.orchestra.run.smithi042.stdout:(33/157): ceph-mgr-modules-core-19.3.0-4989.gce 2.0 MB/s | 291 kB 00:00 2024-09-17T01:29:21.591 INFO:teuthology.orchestra.run.smithi042.stdout:(34/157): ceph-mgr-rook-19.3.0-4989.gce1b342b.e 988 kB/s | 49 kB 00:00 2024-09-17T01:29:21.625 INFO:teuthology.orchestra.run.smithi042.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4989.gc 330 kB/s | 16 kB 00:00 2024-09-17T01:29:21.659 INFO:teuthology.orchestra.run.smithi042.stdout:(36/157): ceph-volume-19.3.0-4989.gce1b342b.el9 4.2 MB/s | 285 kB 00:00 2024-09-17T01:29:21.734 INFO:teuthology.orchestra.run.smithi042.stdout:(37/157): cephfs-top-19.3.0-4989.gce1b342b.el9. 243 kB/s | 18 kB 00:00 2024-09-17T01:29:21.767 INFO:teuthology.orchestra.run.smithi042.stdout:(38/157): cephadm-19.3.0-4989.gce1b342b.el9.noa 5.4 MB/s | 784 kB 00:00 2024-09-17T01:29:21.918 INFO:teuthology.orchestra.run.smithi042.stdout:(39/157): ceph-mgr-dashboard-19.3.0-4989.gce1b3 9.4 MB/s | 14 MB 00:01 2024-09-17T01:29:22.293 INFO:teuthology.orchestra.run.smithi042.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 143 kB/s | 80 kB 00:00 2024-09-17T01:29:22.468 INFO:teuthology.orchestra.run.smithi042.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 347 kB/s | 191 kB 00:00 2024-09-17T01:29:22.577 INFO:teuthology.orchestra.run.smithi042.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 893 kB/s | 253 kB 00:00 2024-09-17T01:29:22.644 INFO:teuthology.orchestra.run.smithi042.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 914 kB/s | 801 kB 00:00 2024-09-17T01:29:22.644 INFO:teuthology.orchestra.run.smithi043.stdout:(10/157): ceph-radosgw-19.3.0-4989.gce1b342b.el 6.3 MB/s | 10 MB 00:01 2024-09-17T01:29:22.694 INFO:teuthology.orchestra.run.smithi042.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 912 kB/s | 106 kB 00:00 2024-09-17T01:29:22.717 INFO:teuthology.orchestra.run.smithi043.stdout:(11/157): cephfs-mirror-19.3.0-4989.gce1b342b.e 3.0 MB/s | 225 kB 00:00 2024-09-17T01:29:22.770 INFO:teuthology.orchestra.run.smithi042.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-17T01:29:22.784 INFO:teuthology.orchestra.run.smithi043.stdout:(12/157): cephfs-shell-19.3.0-4989.gce1b342b.el 406 kB/s | 27 kB 00:00 2024-09-17T01:29:22.820 INFO:teuthology.orchestra.run.smithi042.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 998 kB/s | 125 kB 00:00 2024-09-17T01:29:22.851 INFO:teuthology.orchestra.run.smithi043.stdout:(13/157): libcephfs-devel-19.3.0-4989.gce1b342b 476 kB/s | 32 kB 00:00 2024-09-17T01:29:22.887 INFO:teuthology.orchestra.run.smithi042.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-17T01:29:22.976 INFO:teuthology.orchestra.run.smithi043.stdout:(14/157): libcephfs2-19.3.0-4989.gce1b342b.el9. 6.0 MB/s | 766 kB 00:00 2024-09-17T01:29:22.979 INFO:teuthology.orchestra.run.smithi042.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 4.2 MB/s | 689 kB 00:00 2024-09-17T01:29:23.029 INFO:teuthology.orchestra.run.smithi042.stdout:(49/157): python3-cryptography-36.0.1-4.el9.x86 2.2 MB/s | 1.2 MB 00:00 2024-09-17T01:29:23.035 INFO:teuthology.orchestra.run.smithi043.stdout:(15/157): libcephsqlite-19.3.0-4989.gce1b342b.e 2.7 MB/s | 158 kB 00:00 2024-09-17T01:29:23.054 INFO:teuthology.orchestra.run.smithi042.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-17T01:29:23.085 INFO:teuthology.orchestra.run.smithi043.stdout:(16/157): librados-devel-19.3.0-4989.gce1b342b. 2.5 MB/s | 127 kB 00:00 2024-09-17T01:29:23.105 INFO:teuthology.orchestra.run.smithi042.stdout:(51/157): bison-3.7.4-5.el9.x86_64.rpm 4.2 MB/s | 943 kB 00:00 2024-09-17T01:29:23.130 INFO:teuthology.orchestra.run.smithi042.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-09-17T01:29:23.147 INFO:teuthology.orchestra.run.smithi042.stdout:(53/157): elfutils-libelf-devel-0.191-4.el9.x86 185 kB/s | 22 kB 00:00 2024-09-17T01:29:23.214 INFO:teuthology.orchestra.run.smithi042.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-17T01:29:23.231 INFO:teuthology.orchestra.run.smithi042.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 218 kB/s | 18 kB 00:00 2024-09-17T01:29:23.306 INFO:teuthology.orchestra.run.smithi042.stdout:(56/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 17 MB/s | 3.0 MB 00:00 2024-09-17T01:29:23.323 INFO:teuthology.orchestra.run.smithi042.stdout:(57/157): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-09-17T01:29:23.357 INFO:teuthology.orchestra.run.smithi042.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.3 MB/s | 171 kB 00:00 2024-09-17T01:29:23.399 INFO:teuthology.orchestra.run.smithi042.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-17T01:29:23.424 INFO:teuthology.orchestra.run.smithi042.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 449 kB/s | 45 kB 00:00 2024-09-17T01:29:23.474 INFO:teuthology.orchestra.run.smithi042.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-17T01:29:23.516 INFO:teuthology.orchestra.run.smithi042.stdout:(62/157): libtool-2.4.6-46.el9.x86_64.rpm 4.8 MB/s | 581 kB 00:00 2024-09-17T01:29:23.533 INFO:teuthology.orchestra.run.smithi042.stdout:(63/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 225 kB/s | 24 kB 00:00 2024-09-17T01:29:23.550 INFO:teuthology.orchestra.run.smithi042.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-09-17T01:29:23.592 INFO:teuthology.orchestra.run.smithi042.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-17T01:29:23.611 INFO:teuthology.orchestra.run.smithi043.stdout:(17/157): ceph-test-19.3.0-4989.gce1b342b.el9.x 17 MB/s | 40 MB 00:02 2024-09-17T01:29:23.636 INFO:teuthology.orchestra.run.smithi043.stdout:(18/157): libradosstriper1-19.3.0-4989.gce1b342 921 kB/s | 507 kB 00:00 2024-09-17T01:29:23.648 INFO:teuthology.orchestra.run.smithi042.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-17T01:29:23.668 INFO:teuthology.orchestra.run.smithi042.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 328 kB/s | 38 kB 00:00 2024-09-17T01:29:23.785 INFO:teuthology.orchestra.run.smithi042.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 26 MB/s | 4.9 MB 00:00 2024-09-17T01:29:23.835 INFO:teuthology.orchestra.run.smithi042.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-09-17T01:29:23.836 INFO:teuthology.orchestra.run.smithi043.stdout:(19/157): ceph-osd-19.3.0-4989.gce1b342b.el9.x8 4.3 MB/s | 18 MB 00:04 2024-09-17T01:29:23.861 INFO:teuthology.orchestra.run.smithi043.stdout:(20/157): python3-ceph-argparse-19.3.0-4989.gce 200 kB/s | 45 kB 00:00 2024-09-17T01:29:23.919 INFO:teuthology.orchestra.run.smithi042.stdout:(70/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-17T01:29:23.952 INFO:teuthology.orchestra.run.smithi042.stdout:(71/157): postgresql-contrib-13.16-1.el9.x86_64 5.3 MB/s | 910 kB 00:00 2024-09-17T01:29:23.977 INFO:teuthology.orchestra.run.smithi042.stdout:(72/157): postgresql-private-libs-13.16-1.el9.x 968 kB/s | 137 kB 00:00 2024-09-17T01:29:23.995 INFO:teuthology.orchestra.run.smithi043.stdout:(21/157): python3-ceph-common-19.3.0-4989.gce1b 906 kB/s | 143 kB 00:00 2024-09-17T01:29:24.020 INFO:teuthology.orchestra.run.smithi043.stdout:(22/157): python3-cephfs-19.3.0-4989.gce1b342b. 1.0 MB/s | 161 kB 00:00 2024-09-17T01:29:24.053 INFO:teuthology.orchestra.run.smithi042.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-17T01:29:24.078 INFO:teuthology.orchestra.run.smithi042.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 873 kB/s | 87 kB 00:00 2024-09-17T01:29:24.161 INFO:teuthology.orchestra.run.smithi042.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 24 MB/s | 5.8 MB 00:00 2024-09-17T01:29:24.162 INFO:teuthology.orchestra.run.smithi043.stdout:(23/157): librgw2-19.3.0-4989.gce1b342b.el9.x86 9.6 MB/s | 5.3 MB 00:00 2024-09-17T01:29:24.178 INFO:teuthology.orchestra.run.smithi042.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 610 kB/s | 61 kB 00:00 2024-09-17T01:29:24.187 INFO:teuthology.orchestra.run.smithi043.stdout:(24/157): python3-rados-19.3.0-4989.gce1b342b.e 1.6 MB/s | 321 kB 00:00 2024-09-17T01:29:24.213 INFO:teuthology.orchestra.run.smithi043.stdout:(25/157): python3-rbd-19.3.0-4989.gce1b342b.el9 1.5 MB/s | 305 kB 00:00 2024-09-17T01:29:24.238 INFO:teuthology.orchestra.run.smithi043.stdout:(26/157): rbd-fuse-19.3.0-4989.gce1b342b.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-17T01:29:24.263 INFO:teuthology.orchestra.run.smithi043.stdout:(27/157): python3-rgw-19.3.0-4989.gce1b342b.el9 990 kB/s | 99 kB 00:00 2024-09-17T01:29:24.287 INFO:teuthology.orchestra.run.smithi042.stdout:(77/157): python3-babel-2.9.1-2.el9.noarch.rpm 25 MB/s | 6.0 MB 00:00 2024-09-17T01:29:24.288 INFO:teuthology.orchestra.run.smithi043.stdout:(28/157): rbd-nbd-19.3.0-4989.gce1b342b.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-17T01:29:24.305 INFO:teuthology.orchestra.run.smithi043.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4989.g 820 kB/s | 34 kB 00:00 2024-09-17T01:29:24.312 INFO:teuthology.orchestra.run.smithi042.stdout:(78/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-09-17T01:29:24.338 INFO:teuthology.orchestra.run.smithi042.stdout:(79/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-09-17T01:29:24.339 INFO:teuthology.orchestra.run.smithi043.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4989.gce1b342 3.0 MB/s | 154 kB 00:00 2024-09-17T01:29:24.363 INFO:teuthology.orchestra.run.smithi042.stdout:(80/157): python3-jsonpatch-1.21-16.el9.noarch. 341 kB/s | 26 kB 00:00 2024-09-17T01:29:24.413 INFO:teuthology.orchestra.run.smithi042.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 256 kB/s | 19 kB 00:00 2024-09-17T01:29:24.441 INFO:teuthology.orchestra.run.smithi042.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-17T01:29:24.463 INFO:teuthology.orchestra.run.smithi042.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 345 kB/s | 35 kB 00:00 2024-09-17T01:29:24.506 INFO:teuthology.orchestra.run.smithi042.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.6 MB/s | 250 kB 00:00 2024-09-17T01:29:24.573 INFO:teuthology.orchestra.run.smithi043.stdout:(31/157): rbd-mirror-19.3.0-4989.gce1b342b.el9. 8.6 MB/s | 3.1 MB 00:00 2024-09-17T01:29:24.622 INFO:teuthology.orchestra.run.smithi042.stdout:(85/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 5.1 MB 00:00 2024-09-17T01:29:24.641 INFO:teuthology.orchestra.run.smithi043.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4989.gce 4.3 MB/s | 291 kB 00:00 2024-09-17T01:29:24.648 INFO:teuthology.orchestra.run.smithi042.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 544 kB/s | 77 kB 00:00 2024-09-17T01:29:24.673 INFO:teuthology.orchestra.run.smithi042.stdout:(87/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.0 MB/s | 222 kB 00:00 2024-09-17T01:29:24.681 INFO:teuthology.orchestra.run.smithi043.stdout:(33/157): ceph-mgr-rook-19.3.0-4989.gce1b342b.e 1.2 MB/s | 49 kB 00:00 2024-09-17T01:29:24.698 INFO:teuthology.orchestra.run.smithi042.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 560 kB/s | 42 kB 00:00 2024-09-17T01:29:24.715 INFO:teuthology.orchestra.run.smithi043.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4989.gc 499 kB/s | 16 kB 00:00 2024-09-17T01:29:24.724 INFO:teuthology.orchestra.run.smithi042.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-17T01:29:24.766 INFO:teuthology.orchestra.run.smithi042.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-09-17T01:29:24.791 INFO:teuthology.orchestra.run.smithi042.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.9 MB/s | 279 kB 00:00 2024-09-17T01:29:24.808 INFO:teuthology.orchestra.run.smithi042.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 607 kB/s | 51 kB 00:00 2024-09-17T01:29:24.824 INFO:teuthology.orchestra.run.smithi043.stdout:(35/157): ceph-volume-19.3.0-4989.gce1b342b.el9 2.6 MB/s | 285 kB 00:00 2024-09-17T01:29:24.825 INFO:teuthology.orchestra.run.smithi042.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 912 kB/s | 54 kB 00:00 2024-09-17T01:29:24.875 INFO:teuthology.orchestra.run.smithi042.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 625 kB/s | 42 kB 00:00 2024-09-17T01:29:24.892 INFO:teuthology.orchestra.run.smithi042.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 660 kB/s | 44 kB 00:00 2024-09-17T01:29:24.959 INFO:teuthology.orchestra.run.smithi042.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-17T01:29:24.976 INFO:teuthology.orchestra.run.smithi042.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 430 kB/s | 36 kB 00:00 2024-09-17T01:29:25.041 INFO:teuthology.orchestra.run.smithi043.stdout:(36/157): ceph-mgr-dashboard-19.3.0-4989.gce1b3 19 MB/s | 14 MB 00:00 2024-09-17T01:29:25.051 INFO:teuthology.orchestra.run.smithi042.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 516 kB/s | 47 kB 00:00 2024-09-17T01:29:25.074 INFO:teuthology.orchestra.run.smithi043.stdout:(37/157): cephadm-19.3.0-4989.gce1b342b.el9.noa 3.1 MB/s | 784 kB 00:00 2024-09-17T01:29:25.076 INFO:teuthology.orchestra.run.smithi042.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 3.0 MB/s | 304 kB 00:00 2024-09-17T01:29:25.100 INFO:teuthology.orchestra.run.smithi043.stdout:(38/157): cephfs-top-19.3.0-4989.gce1b342b.el9. 313 kB/s | 18 kB 00:00 2024-09-17T01:29:25.260 INFO:teuthology.orchestra.run.smithi042.stdout:(100/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-09-17T01:29:25.285 INFO:teuthology.orchestra.run.smithi042.stdout:(101/157): uuid-1.6.2-55.el9.x86_64.rpm 248 kB/s | 58 kB 00:00 2024-09-17T01:29:25.311 INFO:teuthology.orchestra.run.smithi042.stdout:(102/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 409 kB/s | 96 kB 00:00 2024-09-17T01:29:25.336 INFO:teuthology.orchestra.run.smithi042.stdout:(103/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 846 kB/s | 64 kB 00:00 2024-09-17T01:29:25.361 INFO:teuthology.orchestra.run.smithi042.stdout:(104/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 592 kB/s | 45 kB 00:00 2024-09-17T01:29:25.416 INFO:teuthology.orchestra.run.smithi043.stdout:(39/157): ceph-mgr-diskprediction-local-19.3.0- 6.9 MB/s | 7.4 MB 00:01 2024-09-17T01:29:25.420 INFO:teuthology.orchestra.run.smithi042.stdout:(105/157): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-17T01:29:25.475 INFO:teuthology.orchestra.run.smithi043.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 199 kB/s | 80 kB 00:00 2024-09-17T01:29:25.495 INFO:teuthology.orchestra.run.smithi042.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 4.0 MB/s | 548 kB 00:00 2024-09-17T01:29:25.530 INFO:teuthology.orchestra.run.smithi042.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 610 kB/s | 19 kB 00:00 2024-09-17T01:29:25.571 INFO:teuthology.orchestra.run.smithi042.stdout:(108/157): gperftools-libs-2.9.1-3.el9.x86_64.r 2.0 MB/s | 308 kB 00:00 2024-09-17T01:29:25.605 INFO:teuthology.orchestra.run.smithi042.stdout:(109/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.1 MB/s | 863 kB 00:00 2024-09-17T01:29:25.622 INFO:teuthology.orchestra.run.smithi042.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 518 kB/s | 26 kB 00:00 2024-09-17T01:29:25.665 INFO:teuthology.orchestra.run.smithi042.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.2 MB/s | 67 kB 00:00 2024-09-17T01:29:25.689 INFO:teuthology.orchestra.run.smithi042.stdout:(112/157): liboath-2.6.7-2.el9.x86_64.rpm 582 kB/s | 49 kB 00:00 2024-09-17T01:29:25.714 INFO:teuthology.orchestra.run.smithi042.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 3.1 MB/s | 151 kB 00:00 2024-09-17T01:29:25.773 INFO:teuthology.orchestra.run.smithi042.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-09-17T01:29:25.807 INFO:teuthology.orchestra.run.smithi042.stdout:(115/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-17T01:29:25.817 INFO:teuthology.orchestra.run.smithi043.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-17T01:29:25.832 INFO:teuthology.orchestra.run.smithi042.stdout:(116/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 741 kB/s | 43 kB 00:00 2024-09-17T01:29:25.857 INFO:teuthology.orchestra.run.smithi042.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-09-17T01:29:25.859 INFO:teuthology.orchestra.run.smithi043.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 432 kB/s | 191 kB 00:00 2024-09-17T01:29:25.882 INFO:teuthology.orchestra.run.smithi042.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-17T01:29:25.908 INFO:teuthology.orchestra.run.smithi042.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-17T01:29:25.965 INFO:teuthology.orchestra.run.smithi042.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 4.3 MB/s | 358 kB 00:00 2024-09-17T01:29:26.008 INFO:teuthology.orchestra.run.smithi042.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-09-17T01:29:26.042 INFO:teuthology.orchestra.run.smithi042.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 2.8 MB/s | 220 kB 00:00 2024-09-17T01:29:26.068 INFO:teuthology.orchestra.run.smithi043.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 428 kB/s | 253 kB 00:00 2024-09-17T01:29:26.076 INFO:teuthology.orchestra.run.smithi042.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-17T01:29:26.101 INFO:teuthology.orchestra.run.smithi042.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-17T01:29:26.168 INFO:teuthology.orchestra.run.smithi042.stdout:(125/157): libarrow-9.0.0-11.el9.x86_64.rpm 6.9 MB/s | 4.4 MB 00:00 2024-09-17T01:29:26.193 INFO:teuthology.orchestra.run.smithi042.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2024-09-17T01:29:26.218 INFO:teuthology.orchestra.run.smithi042.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-17T01:29:26.244 INFO:teuthology.orchestra.run.smithi042.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-17T01:29:26.269 INFO:teuthology.orchestra.run.smithi042.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-17T01:29:26.284 INFO:teuthology.orchestra.run.smithi043.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 250 kB/s | 106 kB 00:00 2024-09-17T01:29:26.303 INFO:teuthology.orchestra.run.smithi042.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-17T01:29:26.328 INFO:teuthology.orchestra.run.smithi042.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-17T01:29:26.353 INFO:teuthology.orchestra.run.smithi042.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-17T01:29:26.387 INFO:teuthology.orchestra.run.smithi042.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-17T01:29:26.454 INFO:teuthology.orchestra.run.smithi042.stdout:(134/157): python3-kubernetes-26.1.0-2.el9.noar 4.9 MB/s | 1.0 MB 00:00 2024-09-17T01:29:26.482 INFO:teuthology.orchestra.run.smithi042.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 179 kB/s | 16 kB 00:00 2024-09-17T01:29:26.493 INFO:teuthology.orchestra.run.smithi043.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 318 kB/s | 135 kB 00:00 2024-09-17T01:29:26.504 INFO:teuthology.orchestra.run.smithi042.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-17T01:29:26.530 INFO:teuthology.orchestra.run.smithi042.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-17T01:29:26.555 INFO:teuthology.orchestra.run.smithi042.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 609 kB/s | 31 kB 00:00 2024-09-17T01:29:26.673 INFO:teuthology.orchestra.run.smithi042.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 501 kB/s | 59 kB 00:00 2024-09-17T01:29:26.714 INFO:teuthology.orchestra.run.smithi042.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2024-09-17T01:29:26.718 INFO:teuthology.orchestra.run.smithi043.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 288 kB/s | 125 kB 00:00 2024-09-17T01:29:26.756 INFO:teuthology.orchestra.run.smithi042.stdout:(141/157): python3-grpcio-1.46.7-10.el9.x86_64. 2.7 MB/s | 2.0 MB 00:00 2024-09-17T01:29:26.781 INFO:teuthology.orchestra.run.smithi042.stdout:(142/157): python3-tempora-5.0.0-2.el9.noarch.r 333 kB/s | 36 kB 00:00 2024-09-17T01:29:26.807 INFO:teuthology.orchestra.run.smithi042.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 810 kB/s | 74 kB 00:00 2024-09-17T01:29:26.832 INFO:teuthology.orchestra.run.smithi042.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-17T01:29:26.835 INFO:teuthology.orchestra.run.smithi043.stdout:(47/157): python3-cryptography-36.0.1-4.el9.x86 1.2 MB/s | 1.2 MB 00:01 2024-09-17T01:29:26.889 INFO:teuthology.orchestra.run.smithi042.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-17T01:29:26.902 INFO:teuthology.orchestra.run.smithi043.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2024-09-17T01:29:26.916 INFO:teuthology.orchestra.run.smithi042.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 239 kB/s | 20 kB 00:00 2024-09-17T01:29:26.944 INFO:teuthology.orchestra.run.smithi043.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-17T01:29:26.949 INFO:teuthology.orchestra.run.smithi042.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.1 MB/s | 191 kB 00:00 2024-09-17T01:29:26.983 INFO:teuthology.orchestra.run.smithi042.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.4 MB/s | 427 kB 00:00 2024-09-17T01:29:26.986 INFO:teuthology.orchestra.run.smithi043.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 524 kB/s | 22 kB 00:00 2024-09-17T01:29:27.011 INFO:teuthology.orchestra.run.smithi043.stdout:(51/157): python3-urllib3-1.26.5-6.el9.noarch.r 414 kB/s | 215 kB 00:00 2024-09-17T01:29:27.042 INFO:teuthology.orchestra.run.smithi042.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-17T01:29:27.045 INFO:teuthology.orchestra.run.smithi043.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 4.4 MB/s | 943 kB 00:00 2024-09-17T01:29:27.070 INFO:teuthology.orchestra.run.smithi043.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-09-17T01:29:27.113 INFO:teuthology.orchestra.run.smithi043.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 325 kB/s | 33 kB 00:00 2024-09-17T01:29:27.138 INFO:teuthology.orchestra.run.smithi043.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-09-17T01:29:27.163 INFO:teuthology.orchestra.run.smithi043.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-17T01:29:27.188 INFO:teuthology.orchestra.run.smithi043.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-17T01:29:27.217 INFO:teuthology.orchestra.run.smithi042.stdout:(150/157): librados2-19.3.0-4989.gce1b342b.el9. 13 MB/s | 3.4 MB 00:00 2024-09-17T01:29:27.272 INFO:teuthology.orchestra.run.smithi043.stdout:(58/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-09-17T01:29:27.305 INFO:teuthology.orchestra.run.smithi043.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 387 kB/s | 45 kB 00:00 2024-09-17T01:29:27.330 INFO:teuthology.orchestra.run.smithi043.stdout:(60/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 959 kB/s | 160 kB 00:00 2024-09-17T01:29:27.372 INFO:teuthology.orchestra.run.smithi043.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 662 kB 00:00 2024-09-17T01:29:27.384 INFO:teuthology.orchestra.run.smithi042.stdout:(151/157): librbd1-19.3.0-4989.gce1b342b.el9.x8 7.9 MB/s | 3.2 MB 00:00 2024-09-17T01:29:27.398 INFO:teuthology.orchestra.run.smithi043.stdout:(62/157): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-09-17T01:29:27.414 INFO:teuthology.orchestra.run.smithi043.stdout:(63/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 292 kB/s | 24 kB 00:00 2024-09-17T01:29:27.432 INFO:teuthology.orchestra.run.smithi043.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-17T01:29:27.457 INFO:teuthology.orchestra.run.smithi043.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-17T01:29:27.474 INFO:teuthology.orchestra.run.smithi043.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 926 kB/s | 38 kB 00:00 2024-09-17T01:29:27.499 INFO:teuthology.orchestra.run.smithi043.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-17T01:29:27.599 INFO:teuthology.orchestra.run.smithi043.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-17T01:29:27.674 INFO:teuthology.orchestra.run.smithi043.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 23 MB/s | 4.9 MB 00:00 2024-09-17T01:29:27.725 INFO:teuthology.orchestra.run.smithi043.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 7.0 MB/s | 1.6 MB 00:00 2024-09-17T01:29:27.750 INFO:teuthology.orchestra.run.smithi043.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-17T01:29:27.768 INFO:teuthology.orchestra.run.smithi042.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 107 kB/s | 41 kB 00:00 2024-09-17T01:29:27.784 INFO:teuthology.orchestra.run.smithi043.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 4.8 MB/s | 910 kB 00:00 2024-09-17T01:29:27.826 INFO:teuthology.orchestra.run.smithi043.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-17T01:29:27.851 INFO:teuthology.orchestra.run.smithi043.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-17T01:29:27.885 INFO:teuthology.orchestra.run.smithi043.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.8 MB/s | 61 kB 00:00 2024-09-17T01:29:27.926 INFO:teuthology.orchestra.run.smithi043.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 5.8 MB/s | 245 kB 00:00 2024-09-17T01:29:28.018 INFO:teuthology.orchestra.run.smithi043.stdout:(77/157): postgresql-server-13.16-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-09-17T01:29:28.044 INFO:teuthology.orchestra.run.smithi043.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-09-17T01:29:28.061 INFO:teuthology.orchestra.run.smithi043.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 611 kB/s | 26 kB 00:00 2024-09-17T01:29:28.077 INFO:teuthology.orchestra.run.smithi043.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 574 kB/s | 19 kB 00:00 2024-09-17T01:29:28.103 INFO:teuthology.orchestra.run.smithi043.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-09-17T01:29:28.119 INFO:teuthology.orchestra.run.smithi043.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 834 kB/s | 35 kB 00:00 2024-09-17T01:29:28.135 INFO:teuthology.orchestra.run.smithi042.stdout:(153/157): NetworkManager-libnm-1.51.0-1.el9.x8 2.0 MB/s | 1.8 MB 00:00 2024-09-17T01:29:28.160 INFO:teuthology.orchestra.run.smithi042.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 635 kB/s | 249 kB 00:00 2024-09-17T01:29:28.225 INFO:teuthology.orchestra.run.smithi043.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-17T01:29:28.253 INFO:teuthology.orchestra.run.smithi043.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.8 MB/s | 250 kB 00:00 2024-09-17T01:29:28.278 INFO:teuthology.orchestra.run.smithi043.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.1 MB/s | 222 kB 00:00 2024-09-17T01:29:28.294 INFO:teuthology.orchestra.run.smithi042.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 8.5 MB/s | 1.4 MB 00:00 2024-09-17T01:29:28.295 INFO:teuthology.orchestra.run.smithi043.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-09-17T01:29:28.321 INFO:teuthology.orchestra.run.smithi043.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-17T01:29:28.346 INFO:teuthology.orchestra.run.smithi043.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-17T01:29:28.371 INFO:teuthology.orchestra.run.smithi043.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-17T01:29:28.397 INFO:teuthology.orchestra.run.smithi043.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-17T01:29:28.422 INFO:teuthology.orchestra.run.smithi043.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-17T01:29:28.447 INFO:teuthology.orchestra.run.smithi043.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-17T01:29:28.489 INFO:teuthology.orchestra.run.smithi043.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-17T01:29:28.544 INFO:teuthology.orchestra.run.smithi042.stdout:(156/157): NetworkManager-1.51.0-1.el9.x86_64.r 1.6 MB/s | 2.3 MB 00:01 2024-09-17T01:29:28.564 INFO:teuthology.orchestra.run.smithi043.stdout:(94/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-09-17T01:29:28.590 INFO:teuthology.orchestra.run.smithi043.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 442 kB/s | 44 kB 00:00 2024-09-17T01:29:28.623 INFO:teuthology.orchestra.run.smithi043.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-17T01:29:28.648 INFO:teuthology.orchestra.run.smithi043.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 615 kB/s | 36 kB 00:00 2024-09-17T01:29:28.674 INFO:teuthology.orchestra.run.smithi043.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-17T01:29:28.699 INFO:teuthology.orchestra.run.smithi043.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-17T01:29:28.724 INFO:teuthology.orchestra.run.smithi043.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-17T01:29:28.741 INFO:teuthology.orchestra.run.smithi043.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.2 MB/s | 96 kB 00:00 2024-09-17T01:29:28.766 INFO:teuthology.orchestra.run.smithi043.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-17T01:29:28.792 INFO:teuthology.orchestra.run.smithi043.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 897 kB/s | 45 kB 00:00 2024-09-17T01:29:28.884 INFO:teuthology.orchestra.run.smithi043.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 190 kB/s | 22 kB 00:00 2024-09-17T01:29:29.027 INFO:teuthology.orchestra.run.smithi042.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.8 MB/s | 2.4 MB 00:00 2024-09-17T01:29:29.034 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:29:29.034 INFO:teuthology.orchestra.run.smithi042.stdout:Total 19 MB/s | 228 MB 00:12 2024-09-17T01:29:29.059 INFO:teuthology.orchestra.run.smithi043.stdout:(105/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-17T01:29:29.135 INFO:teuthology.orchestra.run.smithi043.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 2.1 MB/s | 548 kB 00:00 2024-09-17T01:29:29.169 INFO:teuthology.orchestra.run.smithi043.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 578 kB/s | 19 kB 00:00 2024-09-17T01:29:29.202 INFO:teuthology.orchestra.run.smithi043.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-09-17T01:29:29.227 INFO:teuthology.orchestra.run.smithi043.stdout:(109/157): gperftools-libs-2.9.1-3.el9.x86_64.r 1.9 MB/s | 308 kB 00:00 2024-09-17T01:29:29.269 INFO:teuthology.orchestra.run.smithi043.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2024-09-17T01:29:29.286 INFO:teuthology.orchestra.run.smithi043.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 4.5 MB/s | 67 kB 00:00 2024-09-17T01:29:29.302 INFO:teuthology.orchestra.run.smithi043.stdout:(112/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 259 kB/s | 26 kB 00:00 2024-09-17T01:29:29.336 INFO:teuthology.orchestra.run.smithi043.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-17T01:29:29.387 INFO:teuthology.orchestra.run.smithi043.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-17T01:29:29.412 INFO:teuthology.orchestra.run.smithi043.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-17T01:29:29.429 INFO:teuthology.orchestra.run.smithi043.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-17T01:29:29.462 INFO:teuthology.orchestra.run.smithi043.stdout:(117/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.1 MB/s | 839 kB 00:00 2024-09-17T01:29:29.488 INFO:teuthology.orchestra.run.smithi043.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 242 kB/s | 14 kB 00:00 2024-09-17T01:29:29.513 INFO:teuthology.orchestra.run.smithi043.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-17T01:29:29.546 INFO:teuthology.orchestra.run.smithi043.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-17T01:29:29.580 INFO:teuthology.orchestra.run.smithi043.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-17T01:29:29.597 INFO:teuthology.orchestra.run.smithi043.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-17T01:29:29.639 INFO:teuthology.orchestra.run.smithi043.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-09-17T01:29:29.664 INFO:teuthology.orchestra.run.smithi043.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-17T01:29:29.690 INFO:teuthology.orchestra.run.smithi043.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-09-17T01:29:29.715 INFO:teuthology.orchestra.run.smithi043.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 938 kB/s | 23 kB 00:00 2024-09-17T01:29:29.740 INFO:teuthology.orchestra.run.smithi043.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-17T01:29:29.766 INFO:teuthology.orchestra.run.smithi043.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 784 kB/s | 20 kB 00:00 2024-09-17T01:29:29.833 INFO:teuthology.orchestra.run.smithi043.stdout:(129/157): libarrow-9.0.0-11.el9.x86_64.rpm 6.7 MB/s | 4.4 MB 00:00 2024-09-17T01:29:29.858 INFO:teuthology.orchestra.run.smithi043.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-17T01:29:29.883 INFO:teuthology.orchestra.run.smithi043.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-17T01:29:29.909 INFO:teuthology.orchestra.run.smithi043.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-17T01:29:29.950 INFO:teuthology.orchestra.run.smithi043.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 5.5 MB/s | 1.0 MB 00:00 2024-09-17T01:29:29.984 INFO:teuthology.orchestra.run.smithi043.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-17T01:29:30.009 INFO:teuthology.orchestra.run.smithi043.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-09-17T01:29:30.075 INFO:teuthology.orchestra.run.smithi043.stdout:(136/157): python3-grpcio-1.46.7-10.el9.x86_64. 4.1 MB/s | 2.0 MB 00:00 2024-09-17T01:29:30.102 INFO:teuthology.orchestra.run.smithi043.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 767 kB/s | 90 kB 00:00 2024-09-17T01:29:30.127 INFO:teuthology.orchestra.run.smithi043.stdout:(138/157): python3-pyperclip-1.8.2-2.el9.noarch 241 kB/s | 28 kB 00:00 2024-09-17T01:29:30.152 INFO:teuthology.orchestra.run.smithi043.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 401 kB/s | 31 kB 00:00 2024-09-17T01:29:30.186 INFO:teuthology.orchestra.run.smithi043.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-17T01:29:30.220 INFO:teuthology.orchestra.run.smithi043.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 532 kB/s | 36 kB 00:00 2024-09-17T01:29:30.245 INFO:teuthology.orchestra.run.smithi043.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-09-17T01:29:30.270 INFO:teuthology.orchestra.run.smithi043.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-09-17T01:29:30.312 INFO:teuthology.orchestra.run.smithi043.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-17T01:29:30.337 INFO:teuthology.orchestra.run.smithi043.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 802 kB/s | 20 kB 00:00 2024-09-17T01:29:30.362 INFO:teuthology.orchestra.run.smithi043.stdout:(146/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-09-17T01:29:30.396 INFO:teuthology.orchestra.run.smithi043.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-17T01:29:30.421 INFO:teuthology.orchestra.run.smithi043.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-17T01:29:30.505 INFO:teuthology.orchestra.run.smithi043.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-17T01:29:30.805 INFO:teuthology.orchestra.run.smithi043.stdout:(150/157): librbd1-19.3.0-4989.gce1b342b.el9.x8 8.2 MB/s | 3.2 MB 00:00 2024-09-17T01:29:30.864 INFO:teuthology.orchestra.run.smithi043.stdout:(151/157): librados2-19.3.0-4989.gce1b342b.el9. 7.2 MB/s | 3.4 MB 00:00 2024-09-17T01:29:31.143 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-17T01:29:31.147 INFO:teuthology.orchestra.run.smithi043.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 144 kB/s | 41 kB 00:00 2024-09-17T01:29:31.343 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-17T01:29:31.344 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-17T01:29:31.364 INFO:teuthology.orchestra.run.smithi043.stdout:(153/157): NetworkManager-1.51.0-1.el9.x86_64.r 2.7 MB/s | 2.3 MB 00:00 2024-09-17T01:29:31.573 INFO:teuthology.orchestra.run.smithi043.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 2.4 MB/s | 1.8 MB 00:00 2024-09-17T01:29:31.707 INFO:teuthology.orchestra.run.smithi043.stdout:(155/157): NetworkManager-tui-1.51.0-1.el9.x86_ 445 kB/s | 249 kB 00:00 2024-09-17T01:29:32.407 INFO:teuthology.orchestra.run.smithi043.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.9 MB/s | 2.4 MB 00:00 2024-09-17T01:29:32.532 INFO:teuthology.orchestra.run.smithi043.stdout:(157/157): openssl-3.2.2-6.el9.x86_64.rpm 1.2 MB/s | 1.4 MB 00:01 2024-09-17T01:29:32.539 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:29:32.539 INFO:teuthology.orchestra.run.smithi043.stdout:Total 16 MB/s | 228 MB 00:14 2024-09-17T01:29:33.794 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-17T01:29:33.795 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-17T01:29:34.656 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-17T01:29:34.857 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-17T01:29:34.857 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-17T01:29:37.341 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-17T01:29:37.342 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-17T01:29:40.631 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-17T01:29:40.808 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-17T01:29:40.859 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-17T01:29:40.925 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-17T01:29:40.969 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-17T01:29:41.000 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-17T01:29:41.055 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-17T01:29:41.452 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-17T01:29:41.584 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T01:29:41.731 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T01:29:41.768 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T01:29:41.866 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T01:29:41.906 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T01:29:41.948 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-17T01:29:42.164 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-17T01:29:42.222 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-17T01:29:42.256 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T01:29:42.412 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T01:29:42.441 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T01:29:42.523 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T01:29:42.550 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T01:29:42.592 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T01:29:42.808 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T01:29:42.975 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T01:29:43.199 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-17T01:29:43.315 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T01:29:43.425 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T01:29:43.711 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T01:29:43.861 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-17T01:29:43.898 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-17T01:29:43.943 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-17T01:29:44.031 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-17T01:29:44.107 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-17T01:29:44.125 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-17T01:29:44.159 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-17T01:29:44.213 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-17T01:29:44.262 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-17T01:29:44.262 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-17T01:29:44.302 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-17T01:29:44.394 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-17T01:29:44.395 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-17T01:29:44.456 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-17T01:29:44.493 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-17T01:29:44.539 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-17T01:29:44.553 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-17T01:29:44.582 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-17T01:29:44.612 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-17T01:29:44.654 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-17T01:29:44.680 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-17T01:29:44.693 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 34/165 2024-09-17T01:29:44.737 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 35/165 2024-09-17T01:29:44.764 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 36/165 2024-09-17T01:29:44.862 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-17T01:29:44.918 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-17T01:29:45.013 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-17T01:29:45.075 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-17T01:29:45.185 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-17T01:29:45.196 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T01:29:45.255 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-17T01:29:45.349 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T01:29:45.380 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T01:29:45.486 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T01:29:45.523 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T01:29:45.560 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-17T01:29:45.775 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-17T01:29:45.843 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-17T01:29:45.886 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T01:29:45.937 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-17T01:29:46.008 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T01:29:46.036 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T01:29:46.056 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-17T01:29:46.119 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T01:29:46.146 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T01:29:46.188 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T01:29:46.365 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-17T01:29:46.433 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T01:29:46.434 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-17T01:29:46.474 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 46/165 2024-09-17T01:29:46.527 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-17T01:29:46.635 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T01:29:46.711 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-17T01:29:46.771 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-17T01:29:46.794 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-17T01:29:46.889 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-17T01:29:46.920 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T01:29:46.974 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-17T01:29:47.012 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T01:29:47.061 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-17T01:29:47.097 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-17T01:29:47.141 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-17T01:29:47.201 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-17T01:29:47.241 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-17T01:29:47.286 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-17T01:29:47.289 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T01:29:47.353 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-17T01:29:47.434 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-17T01:29:47.468 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-17T01:29:47.513 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-17T01:29:47.533 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-17T01:29:47.578 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-17T01:29:47.598 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-17T01:29:47.621 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-17T01:29:47.657 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-17T01:29:47.695 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-17T01:29:47.753 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-17T01:29:47.767 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-17T01:29:47.794 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-17T01:29:47.813 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-17T01:29:47.843 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-17T01:29:47.847 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-17T01:29:47.875 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-17T01:29:47.891 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-17T01:29:47.940 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-17T01:29:48.001 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-17T01:29:48.006 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-17T01:29:48.033 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-17T01:29:48.081 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-17T01:29:48.174 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-17T01:29:48.175 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-17T01:29:48.213 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 34/165 2024-09-17T01:29:48.240 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-17T01:29:48.257 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 35/165 2024-09-17T01:29:48.284 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 36/165 2024-09-17T01:29:48.285 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-17T01:29:48.329 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-17T01:29:48.368 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-17T01:29:48.370 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-17T01:29:48.409 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-17T01:29:48.420 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-17T01:29:48.446 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-17T01:29:48.472 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-17T01:29:48.505 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-17T01:29:48.516 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-17T01:29:48.549 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-17T01:29:48.581 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-17T01:29:48.686 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-17T01:29:48.709 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-17T01:29:48.758 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-17T01:29:48.765 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-17T01:29:48.802 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-17T01:29:48.931 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-17T01:29:48.999 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-17T01:29:49.430 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-17T01:29:49.525 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-17T01:29:49.568 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-17T01:29:49.754 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-17T01:29:49.801 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 46/165 2024-09-17T01:29:49.854 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-17T01:29:49.946 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-17T01:29:50.008 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-17T01:29:50.044 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-17T01:29:50.075 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-17T01:29:50.095 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-17T01:29:50.195 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-17T01:29:50.204 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-17T01:29:50.259 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-17T01:29:50.273 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-17T01:29:50.321 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-17T01:29:50.360 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-17T01:29:50.396 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-17T01:29:50.428 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-17T01:29:50.433 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-17T01:29:50.478 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-17T01:29:50.492 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-17T01:29:50.532 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-17T01:29:50.595 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-17T01:29:50.644 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-17T01:29:50.749 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-17T01:29:50.782 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-17T01:29:50.823 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-17T01:29:50.877 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-17T01:29:50.879 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-17T01:29:50.921 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-17T01:29:51.049 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-17T01:29:51.097 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-17T01:29:51.140 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-17T01:29:51.169 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-17T01:29:51.193 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-17T01:29:51.310 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-17T01:29:51.469 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-17T01:29:51.552 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-17T01:29:51.580 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-17T01:29:51.615 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-17T01:29:51.664 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-17T01:29:51.703 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-17T01:29:51.740 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-17T01:29:51.744 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-17T01:29:51.774 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-17T01:29:51.807 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-17T01:29:51.851 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-17T01:29:51.884 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-17T01:29:51.889 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-17T01:29:51.988 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-17T01:29:52.051 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-17T01:29:52.087 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-17T01:29:52.216 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-17T01:29:52.275 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-17T01:29:53.212 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-17T01:29:53.269 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-17T01:29:53.327 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-17T01:29:53.437 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-17T01:29:53.503 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-17T01:29:53.543 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-17T01:29:53.556 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-17T01:29:53.655 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-17T01:29:53.665 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-17T01:29:53.691 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-17T01:29:53.713 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-17T01:29:53.767 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-17T01:29:53.961 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-17T01:29:53.992 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-17T01:29:54.081 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-17T01:29:54.144 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-17T01:29:54.236 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T01:29:54.349 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T01:29:54.384 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 103/165 2024-09-17T01:29:54.438 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-17T01:29:54.950 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-17T01:29:55.017 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-17T01:29:55.055 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T01:29:55.093 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-17T01:29:55.163 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T01:29:55.190 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 107/165 2024-09-17T01:29:56.754 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-17T01:29:57.214 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-17T01:29:57.250 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-17T01:29:57.283 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-17T01:29:57.659 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-17T01:29:57.704 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T01:29:57.817 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T01:29:57.851 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T01:29:57.852 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 103/165 2024-09-17T01:29:57.901 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-17T01:29:57.903 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T01:29:58.467 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-17T01:29:58.498 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T01:29:58.590 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T01:29:58.594 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T01:29:58.617 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 107/165 2024-09-17T01:29:58.640 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T01:29:58.778 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T01:29:58.778 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T01:29:58.779 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T01:29:58.779 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:29:58.825 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T01:30:01.284 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T01:30:01.329 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T01:30:02.020 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T01:30:02.066 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T01:30:02.225 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T01:30:02.225 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T01:30:02.225 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T01:30:02.225 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:02.275 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T01:30:12.405 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T01:30:12.405 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /sys 2024-09-17T01:30:12.406 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /proc 2024-09-17T01:30:12.406 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /mnt 2024-09-17T01:30:12.406 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /var/tmp 2024-09-17T01:30:12.406 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /home 2024-09-17T01:30:12.406 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /root 2024-09-17T01:30:12.406 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /tmp 2024-09-17T01:30:12.406 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:12.628 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T01:30:12.664 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T01:30:12.665 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:30:12.665 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T01:30:12.665 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:14.456 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T01:30:14.515 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T01:30:14.515 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:30:14.515 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T01:30:14.515 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T01:30:14.515 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T01:30:14.515 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:14.773 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T01:30:14.824 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T01:30:14.825 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:30:14.825 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T01:30:14.825 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T01:30:14.825 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T01:30:14.825 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:15.373 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T01:30:15.425 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T01:30:15.425 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:30:15.425 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T01:30:15.426 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T01:30:15.426 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T01:30:15.426 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:15.558 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-17T01:30:15.619 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-17T01:30:15.676 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T01:30:15.676 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /sys 2024-09-17T01:30:15.676 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /proc 2024-09-17T01:30:15.676 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /mnt 2024-09-17T01:30:15.676 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /var/tmp 2024-09-17T01:30:15.676 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /home 2024-09-17T01:30:15.677 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /root 2024-09-17T01:30:15.677 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /tmp 2024-09-17T01:30:15.677 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:15.692 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-17T01:30:15.904 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T01:30:15.929 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-17T01:30:15.941 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T01:30:15.942 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:30:15.942 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T01:30:15.942 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:16.019 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-17T01:30:16.109 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-17T01:30:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-17T01:30:16.624 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-17T01:30:16.669 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-17T01:30:16.709 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-17T01:30:16.775 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-17T01:30:17.335 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T01:30:17.367 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T01:30:17.432 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 127/165 2024-09-17T01:30:17.518 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 128/165 2024-09-17T01:30:17.547 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T01:30:17.723 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T01:30:17.782 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T01:30:17.782 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:30:17.782 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T01:30:17.782 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T01:30:17.782 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T01:30:17.782 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:18.049 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T01:30:18.101 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T01:30:18.101 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:30:18.101 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T01:30:18.101 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T01:30:18.101 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T01:30:18.102 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:18.641 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T01:30:18.692 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T01:30:18.693 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:30:18.693 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T01:30:18.693 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T01:30:18.693 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T01:30:18.693 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:18.825 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-17T01:30:18.896 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-17T01:30:18.968 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-17T01:30:19.214 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-17T01:30:19.279 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-17T01:30:19.368 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-17T01:30:19.477 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-17T01:30:19.667 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-17T01:30:19.717 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-17T01:30:19.776 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-17T01:30:19.826 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-17T01:30:20.361 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T01:30:20.392 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T01:30:20.427 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 127/165 2024-09-17T01:30:20.511 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 128/165 2024-09-17T01:30:20.540 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T01:30:21.436 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T01:30:21.520 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T01:30:22.675 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T01:30:22.703 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T01:30:22.863 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T01:30:23.071 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 132/165 2024-09-17T01:30:23.097 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T01:30:23.149 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T01:30:23.149 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:30:23.149 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T01:30:23.149 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T01:30:23.149 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T01:30:23.150 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:23.206 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T01:30:23.233 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T01:30:23.346 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 135/165 2024-09-17T01:30:23.445 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 136/165 2024-09-17T01:30:24.419 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T01:30:24.479 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T01:30:24.549 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-17T01:30:24.584 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T01:30:24.636 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T01:30:24.636 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:30:24.636 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T01:30:24.636 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T01:30:24.636 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T01:30:24.636 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:24.684 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T01:30:24.734 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T01:30:24.734 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:30:24.734 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T01:30:24.734 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:24.810 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T01:30:24.862 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T01:30:24.862 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:30:24.862 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-17T01:30:24.862 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T01:30:24.862 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T01:30:24.862 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:25.261 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T01:30:25.312 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T01:30:25.312 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:30:25.313 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T01:30:25.313 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T01:30:25.313 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T01:30:25.313 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:25.629 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T01:30:25.662 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T01:30:25.824 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T01:30:26.008 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 132/165 2024-09-17T01:30:26.039 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T01:30:26.092 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T01:30:26.092 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:30:26.092 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T01:30:26.092 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T01:30:26.092 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T01:30:26.092 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:26.149 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T01:30:26.175 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T01:30:26.288 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 135/165 2024-09-17T01:30:26.353 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 136/165 2024-09-17T01:30:27.461 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-17T01:30:27.501 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T01:30:27.553 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T01:30:27.553 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:30:27.553 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T01:30:27.553 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T01:30:27.553 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T01:30:27.553 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:27.601 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T01:30:27.652 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T01:30:27.652 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:30:27.652 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T01:30:27.652 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:27.710 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T01:30:27.762 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T01:30:27.762 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:30:27.762 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-17T01:30:27.762 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T01:30:27.763 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T01:30:27.763 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:28.144 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T01:30:28.196 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T01:30:28.196 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:30:28.196 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T01:30:28.196 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T01:30:28.196 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T01:30:28.196 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:29.933 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 142/165 2024-09-17T01:30:29.975 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 143/165 2024-09-17T01:30:30.027 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 144/165 2024-09-17T01:30:30.063 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-17T01:30:30.099 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-17T01:30:30.369 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 147/165 2024-09-17T01:30:30.428 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-17T01:30:30.457 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 149/165 2024-09-17T01:30:30.489 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-17T01:30:30.533 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-17T01:30:31.331 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T01:30:31.380 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T01:30:31.422 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T01:30:32.800 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 142/165 2024-09-17T01:30:32.818 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 153/165 2024-09-17T01:30:32.850 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 143/165 2024-09-17T01:30:32.902 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 144/165 2024-09-17T01:30:32.921 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-17T01:30:32.955 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-17T01:30:32.979 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-17T01:30:32.982 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-17T01:30:33.232 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-17T01:30:33.245 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 147/165 2024-09-17T01:30:33.265 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-17T01:30:33.290 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-17T01:30:33.295 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-17T01:30:33.324 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 149/165 2024-09-17T01:30:33.327 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-17T01:30:33.327 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T01:30:33.356 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-17T01:30:33.400 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-17T01:30:33.434 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T01:30:33.434 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T01:30:33.543 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T01:30:33.567 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-17T01:30:33.584 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T01:30:33.584 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T01:30:33.829 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T01:30:33.829 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T01:30:33.950 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T01:30:34.032 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T01:30:34.167 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T01:30:34.205 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T01:30:34.247 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T01:30:34.258 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T01:30:34.258 INFO:teuthology.orchestra.run.smithi042.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-17T01:30:34.258 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:35.652 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 153/165 2024-09-17T01:30:35.754 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-17T01:30:35.810 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-17T01:30:35.923 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-17T01:30:35.965 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-17T01:30:35.990 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-17T01:30:36.035 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-17T01:30:36.035 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T01:30:36.142 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T01:30:36.142 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T01:30:36.251 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T01:30:36.275 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-17T01:30:36.292 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T01:30:36.292 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T01:30:36.545 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T01:30:36.545 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T01:30:36.654 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T01:30:36.739 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T01:30:36.975 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T01:30:36.975 INFO:teuthology.orchestra.run.smithi043.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-17T01:30:36.975 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:40.957 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 1/165 2024-09-17T01:30:40.957 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2/165 2024-09-17T01:30:40.957 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 3/165 2024-09-17T01:30:40.957 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 4/165 2024-09-17T01:30:40.957 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 5/165 2024-09-17T01:30:40.957 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 6/165 2024-09-17T01:30:40.957 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 7/165 2024-09-17T01:30:40.957 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T01:30:40.958 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T01:30:40.958 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T01:30:40.958 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 11/165 2024-09-17T01:30:40.958 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 12/165 2024-09-17T01:30:40.958 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 13/165 2024-09-17T01:30:40.958 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T01:30:40.958 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 15/165 2024-09-17T01:30:40.958 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 16/165 2024-09-17T01:30:40.958 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 17/165 2024-09-17T01:30:40.958 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 18/165 2024-09-17T01:30:40.958 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 19/165 2024-09-17T01:30:40.958 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 20/165 2024-09-17T01:30:40.959 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 21/165 2024-09-17T01:30:40.959 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 22/165 2024-09-17T01:30:40.959 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 23/165 2024-09-17T01:30:40.959 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 24/165 2024-09-17T01:30:40.959 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 25/165 2024-09-17T01:30:40.959 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 26/165 2024-09-17T01:30:40.959 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 27/165 2024-09-17T01:30:40.959 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 28/165 2024-09-17T01:30:40.959 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 29/165 2024-09-17T01:30:40.959 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 30/165 2024-09-17T01:30:40.959 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 31/165 2024-09-17T01:30:40.960 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 32/165 2024-09-17T01:30:40.960 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 33/165 2024-09-17T01:30:40.960 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 34/165 2024-09-17T01:30:40.960 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 35/165 2024-09-17T01:30:40.960 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 36/165 2024-09-17T01:30:40.960 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 37/165 2024-09-17T01:30:40.960 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 38/165 2024-09-17T01:30:40.960 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 39/165 2024-09-17T01:30:40.960 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-17T01:30:40.960 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-17T01:30:40.960 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-17T01:30:40.960 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-17T01:30:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-17T01:30:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-17T01:30:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-17T01:30:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-17T01:30:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-17T01:30:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-17T01:30:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-17T01:30:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-17T01:30:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-17T01:30:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-17T01:30:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-17T01:30:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-17T01:30:40.962 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-17T01:30:40.962 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-17T01:30:40.962 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-17T01:30:40.962 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-17T01:30:40.962 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-17T01:30:40.962 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-17T01:30:40.962 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-17T01:30:40.962 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-17T01:30:40.962 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-17T01:30:40.962 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-17T01:30:40.962 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-17T01:30:40.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-17T01:30:40.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-17T01:30:40.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-17T01:30:40.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-17T01:30:40.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-17T01:30:40.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-17T01:30:40.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-17T01:30:40.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-17T01:30:40.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-17T01:30:40.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-17T01:30:40.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-17T01:30:40.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-17T01:30:40.963 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-17T01:30:40.964 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-17T01:30:40.964 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-17T01:30:40.964 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-17T01:30:40.964 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-17T01:30:40.964 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-17T01:30:40.964 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-17T01:30:40.964 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-17T01:30:40.964 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-17T01:30:40.964 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-17T01:30:40.964 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-17T01:30:40.964 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-17T01:30:40.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-17T01:30:40.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-17T01:30:40.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-17T01:30:40.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-17T01:30:40.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-17T01:30:40.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-17T01:30:40.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-17T01:30:40.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-17T01:30:40.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-17T01:30:40.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-17T01:30:40.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-17T01:30:40.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-17T01:30:40.965 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-17T01:30:40.966 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-17T01:30:40.966 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-17T01:30:40.966 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-17T01:30:40.966 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-17T01:30:40.966 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-17T01:30:40.966 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-17T01:30:40.966 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-17T01:30:40.966 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-17T01:30:40.966 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-17T01:30:40.966 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-17T01:30:40.966 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-17T01:30:40.966 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-17T01:30:40.967 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-17T01:30:40.967 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-17T01:30:40.967 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-17T01:30:40.967 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-17T01:30:40.967 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-17T01:30:40.967 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-17T01:30:40.967 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-17T01:30:40.967 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-17T01:30:40.967 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-17T01:30:40.967 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-17T01:30:40.967 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-17T01:30:40.967 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-17T01:30:40.967 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-17T01:30:40.967 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-17T01:30:40.968 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-17T01:30:40.968 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-17T01:30:40.968 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-17T01:30:40.968 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-17T01:30:40.968 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-17T01:30:40.968 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-17T01:30:40.968 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-17T01:30:40.968 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-17T01:30:40.968 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-17T01:30:40.968 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-17T01:30:40.968 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-17T01:30:40.968 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-17T01:30:40.968 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-17T01:30:40.969 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-17T01:30:40.969 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-17T01:30:40.969 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-17T01:30:40.969 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-17T01:30:40.969 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-17T01:30:40.969 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-17T01:30:40.969 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-17T01:30:40.969 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 150/165 2024-09-17T01:30:40.969 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-17T01:30:40.969 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 152/165 2024-09-17T01:30:40.969 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-17T01:30:40.969 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-17T01:30:40.970 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-17T01:30:40.970 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-17T01:30:40.970 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-17T01:30:40.970 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-17T01:30:40.970 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-17T01:30:40.970 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-17T01:30:40.970 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-17T01:30:40.970 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-17T01:30:40.970 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-17T01:30:40.970 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-17T01:30:43.359 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T01:30:43.359 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:43.359 INFO:teuthology.orchestra.run.smithi042.stdout:Upgraded: 2024-09-17T01:30:43.359 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-17T01:30:43.359 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-17T01:30:43.360 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-17T01:30:43.360 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-17T01:30:43.360 INFO:teuthology.orchestra.run.smithi042.stdout: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.360 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.360 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-17T01:30:43.360 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-17T01:30:43.360 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-17T01:30:43.360 INFO:teuthology.orchestra.run.smithi042.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T01:30:43.360 INFO:teuthology.orchestra.run.smithi042.stdout: automake-1.16.2-8.el9.noarch 2024-09-17T01:30:43.360 INFO:teuthology.orchestra.run.smithi042.stdout: bison-3.7.4-5.el9.x86_64 2024-09-17T01:30:43.360 INFO:teuthology.orchestra.run.smithi042.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T01:30:43.360 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.361 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.361 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.361 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.361 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T01:30:43.361 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.361 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.361 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.361 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T01:30:43.361 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T01:30:43.361 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T01:30:43.361 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T01:30:43.361 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T01:30:43.361 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.362 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.362 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T01:30:43.362 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.362 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.362 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.362 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T01:30:43.362 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T01:30:43.362 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.362 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.362 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T01:30:43.362 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-17T01:30:43.362 INFO:teuthology.orchestra.run.smithi042.stdout: flex-2.6.4-9.el9.x86_64 2024-09-17T01:30:43.362 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T01:30:43.363 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T01:30:43.363 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T01:30:43.363 INFO:teuthology.orchestra.run.smithi042.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-17T01:30:43.363 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T01:30:43.363 INFO:teuthology.orchestra.run.smithi042.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T01:30:43.363 INFO:teuthology.orchestra.run.smithi042.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-17T01:30:43.363 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T01:30:43.363 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T01:30:43.363 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.363 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.363 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.363 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T01:30:43.363 INFO:teuthology.orchestra.run.smithi042.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T01:30:43.364 INFO:teuthology.orchestra.run.smithi042.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T01:30:43.364 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T01:30:43.364 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T01:30:43.364 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T01:30:43.364 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.364 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.364 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T01:30:43.364 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.364 INFO:teuthology.orchestra.run.smithi042.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-17T01:30:43.364 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T01:30:43.364 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-17T01:30:43.364 INFO:teuthology.orchestra.run.smithi042.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-17T01:30:43.365 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T01:30:43.365 INFO:teuthology.orchestra.run.smithi042.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T01:30:43.365 INFO:teuthology.orchestra.run.smithi042.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T01:30:43.365 INFO:teuthology.orchestra.run.smithi042.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T01:30:43.365 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T01:30:43.365 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T01:30:43.365 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-17T01:30:43.365 INFO:teuthology.orchestra.run.smithi042.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T01:30:43.365 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-13.16-1.el9.x86_64 2024-09-17T01:30:43.365 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-17T01:30:43.365 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-17T01:30:43.365 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-17T01:30:43.365 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T01:30:43.366 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T01:30:43.366 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T01:30:43.366 INFO:teuthology.orchestra.run.smithi042.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-17T01:30:43.366 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T01:30:43.366 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T01:30:43.366 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T01:30:43.366 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.366 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.366 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.366 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T01:30:43.367 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T01:30:43.367 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T01:30:43.367 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T01:30:43.367 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-17T01:30:43.367 INFO:teuthology.orchestra.run.smithi042.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-17T01:30:43.367 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T01:30:43.367 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T01:30:43.367 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T01:30:43.367 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T01:30:43.367 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T01:30:43.367 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T01:30:43.367 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T01:30:43.368 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T01:30:43.368 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T01:30:43.368 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T01:30:43.368 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T01:30:43.368 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T01:30:43.368 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T01:30:43.368 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T01:30:43.368 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T01:30:43.368 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T01:30:43.368 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T01:30:43.368 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T01:30:43.368 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T01:30:43.369 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T01:30:43.369 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T01:30:43.369 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T01:30:43.369 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T01:30:43.369 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T01:30:43.369 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T01:30:43.369 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T01:30:43.369 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T01:30:43.369 INFO:teuthology.orchestra.run.smithi042.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T01:30:43.369 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T01:30:43.369 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T01:30:43.369 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T01:30:43.369 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T01:30:43.370 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-17T01:30:43.370 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T01:30:43.370 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.370 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.370 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T01:30:43.370 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T01:30:43.370 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T01:30:43.370 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.370 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T01:30:43.370 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T01:30:43.370 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T01:30:43.370 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T01:30:43.370 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T01:30:43.371 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T01:30:43.371 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T01:30:43.371 INFO:teuthology.orchestra.run.smithi042.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-17T01:30:43.371 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T01:30:43.371 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T01:30:43.371 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T01:30:43.371 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T01:30:43.371 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T01:30:43.371 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T01:30:43.371 INFO:teuthology.orchestra.run.smithi042.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T01:30:43.371 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.371 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.371 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:43.371 INFO:teuthology.orchestra.run.smithi042.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T01:30:43.372 INFO:teuthology.orchestra.run.smithi042.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T01:30:43.372 INFO:teuthology.orchestra.run.smithi042.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T01:30:43.372 INFO:teuthology.orchestra.run.smithi042.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-17T01:30:43.372 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-17T01:30:43.372 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T01:30:43.372 INFO:teuthology.orchestra.run.smithi042.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-17T01:30:43.372 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:43.373 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-17T01:30:43.565 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 1/165 2024-09-17T01:30:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2/165 2024-09-17T01:30:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 3/165 2024-09-17T01:30:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 4/165 2024-09-17T01:30:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 5/165 2024-09-17T01:30:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 6/165 2024-09-17T01:30:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 7/165 2024-09-17T01:30:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T01:30:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T01:30:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T01:30:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 11/165 2024-09-17T01:30:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 12/165 2024-09-17T01:30:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 13/165 2024-09-17T01:30:43.566 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T01:30:43.567 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 15/165 2024-09-17T01:30:43.567 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 16/165 2024-09-17T01:30:43.567 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 17/165 2024-09-17T01:30:43.567 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 18/165 2024-09-17T01:30:43.567 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 19/165 2024-09-17T01:30:43.567 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 20/165 2024-09-17T01:30:43.567 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 21/165 2024-09-17T01:30:43.567 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 22/165 2024-09-17T01:30:43.567 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 23/165 2024-09-17T01:30:43.567 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 24/165 2024-09-17T01:30:43.568 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 25/165 2024-09-17T01:30:43.568 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 26/165 2024-09-17T01:30:43.568 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 27/165 2024-09-17T01:30:43.568 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 28/165 2024-09-17T01:30:43.568 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 29/165 2024-09-17T01:30:43.582 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 30/165 2024-09-17T01:30:43.582 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 31/165 2024-09-17T01:30:43.582 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 32/165 2024-09-17T01:30:43.582 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 33/165 2024-09-17T01:30:43.582 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 34/165 2024-09-17T01:30:43.582 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 35/165 2024-09-17T01:30:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 36/165 2024-09-17T01:30:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 37/165 2024-09-17T01:30:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 38/165 2024-09-17T01:30:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 39/165 2024-09-17T01:30:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-17T01:30:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-17T01:30:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-17T01:30:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-17T01:30:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-17T01:30:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-17T01:30:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-17T01:30:43.583 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-17T01:30:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-17T01:30:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-17T01:30:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-17T01:30:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-17T01:30:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-17T01:30:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-17T01:30:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-17T01:30:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-17T01:30:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-17T01:30:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-17T01:30:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-17T01:30:43.584 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-17T01:30:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-17T01:30:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-17T01:30:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-17T01:30:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-17T01:30:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-17T01:30:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-17T01:30:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-17T01:30:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-17T01:30:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-17T01:30:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-17T01:30:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-17T01:30:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-17T01:30:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-17T01:30:43.585 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-17T01:30:43.586 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-17T01:30:43.586 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-17T01:30:43.586 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-17T01:30:43.586 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-17T01:30:43.586 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-17T01:30:43.586 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-17T01:30:43.586 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-17T01:30:43.586 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-17T01:30:43.586 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-17T01:30:43.586 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-17T01:30:43.586 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-17T01:30:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-17T01:30:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-17T01:30:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-17T01:30:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-17T01:30:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-17T01:30:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-17T01:30:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-17T01:30:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-17T01:30:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-17T01:30:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-17T01:30:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-17T01:30:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-17T01:30:43.587 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-17T01:30:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-17T01:30:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-17T01:30:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-17T01:30:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-17T01:30:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-17T01:30:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-17T01:30:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-17T01:30:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-17T01:30:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-17T01:30:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-17T01:30:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-17T01:30:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-17T01:30:43.588 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-17T01:30:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-17T01:30:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-17T01:30:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-17T01:30:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-17T01:30:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-17T01:30:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-17T01:30:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-17T01:30:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-17T01:30:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-17T01:30:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-17T01:30:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-17T01:30:43.589 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-17T01:30:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-17T01:30:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-17T01:30:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-17T01:30:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-17T01:30:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-17T01:30:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-17T01:30:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-17T01:30:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-17T01:30:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-17T01:30:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-17T01:30:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-17T01:30:43.590 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-17T01:30:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-17T01:30:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-17T01:30:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-17T01:30:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-17T01:30:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-17T01:30:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-17T01:30:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-17T01:30:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-17T01:30:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-17T01:30:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-17T01:30:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-17T01:30:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-17T01:30:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-17T01:30:43.591 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-17T01:30:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-17T01:30:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 150/165 2024-09-17T01:30:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-17T01:30:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 152/165 2024-09-17T01:30:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-17T01:30:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-17T01:30:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-17T01:30:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-17T01:30:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-17T01:30:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-17T01:30:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-17T01:30:43.592 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-17T01:30:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-17T01:30:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-17T01:30:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-17T01:30:43.593 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-17T01:30:43.940 DEBUG:teuthology.parallel:result is None 2024-09-17T01:30:45.725 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T01:30:45.725 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:45.725 INFO:teuthology.orchestra.run.smithi043.stdout:Upgraded: 2024-09-17T01:30:45.725 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-17T01:30:45.725 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-17T01:30:45.725 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-17T01:30:45.725 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-17T01:30:45.725 INFO:teuthology.orchestra.run.smithi043.stdout: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.726 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.726 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-17T01:30:45.726 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-17T01:30:45.726 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-09-17T01:30:45.726 INFO:teuthology.orchestra.run.smithi043.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T01:30:45.726 INFO:teuthology.orchestra.run.smithi043.stdout: automake-1.16.2-8.el9.noarch 2024-09-17T01:30:45.726 INFO:teuthology.orchestra.run.smithi043.stdout: bison-3.7.4-5.el9.x86_64 2024-09-17T01:30:45.726 INFO:teuthology.orchestra.run.smithi043.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T01:30:45.726 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.726 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.726 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.726 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.727 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T01:30:45.727 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.727 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.727 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.727 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T01:30:45.727 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T01:30:45.727 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T01:30:45.727 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T01:30:45.727 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T01:30:45.727 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.727 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.727 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T01:30:45.728 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.728 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.728 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.728 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T01:30:45.728 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T01:30:45.728 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.728 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.728 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T01:30:45.728 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-17T01:30:45.728 INFO:teuthology.orchestra.run.smithi043.stdout: flex-2.6.4-9.el9.x86_64 2024-09-17T01:30:45.729 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T01:30:45.729 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T01:30:45.729 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T01:30:45.729 INFO:teuthology.orchestra.run.smithi043.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-17T01:30:45.729 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T01:30:45.729 INFO:teuthology.orchestra.run.smithi043.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T01:30:45.729 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-17T01:30:45.729 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T01:30:45.729 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T01:30:45.729 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.730 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.730 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.730 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T01:30:45.730 INFO:teuthology.orchestra.run.smithi043.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T01:30:45.730 INFO:teuthology.orchestra.run.smithi043.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T01:30:45.730 INFO:teuthology.orchestra.run.smithi043.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T01:30:45.730 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T01:30:45.730 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T01:30:45.730 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.730 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.730 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T01:30:45.731 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.731 INFO:teuthology.orchestra.run.smithi043.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-17T01:30:45.731 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T01:30:45.731 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-17T01:30:45.731 INFO:teuthology.orchestra.run.smithi043.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-17T01:30:45.731 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T01:30:45.731 INFO:teuthology.orchestra.run.smithi043.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T01:30:45.731 INFO:teuthology.orchestra.run.smithi043.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T01:30:45.731 INFO:teuthology.orchestra.run.smithi043.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T01:30:45.731 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T01:30:45.731 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T01:30:45.731 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-17T01:30:45.732 INFO:teuthology.orchestra.run.smithi043.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T01:30:45.732 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-13.16-1.el9.x86_64 2024-09-17T01:30:45.732 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-17T01:30:45.732 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-17T01:30:45.732 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-17T01:30:45.732 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T01:30:45.732 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T01:30:45.732 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T01:30:45.732 INFO:teuthology.orchestra.run.smithi043.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-17T01:30:45.732 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T01:30:45.732 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T01:30:45.732 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T01:30:45.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T01:30:45.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T01:30:45.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T01:30:45.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T01:30:45.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-17T01:30:45.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-17T01:30:45.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T01:30:45.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T01:30:45.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T01:30:45.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T01:30:45.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T01:30:45.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T01:30:45.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T01:30:45.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T01:30:45.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T01:30:45.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T01:30:45.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T01:30:45.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T01:30:45.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T01:30:45.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T01:30:45.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T01:30:45.735 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T01:30:45.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T01:30:45.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T01:30:45.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T01:30:45.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T01:30:45.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T01:30:45.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T01:30:45.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T01:30:45.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T01:30:45.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T01:30:45.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T01:30:45.737 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T01:30:45.737 INFO:teuthology.orchestra.run.smithi043.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T01:30:45.737 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T01:30:45.737 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T01:30:45.737 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T01:30:45.737 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T01:30:45.737 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-17T01:30:45.737 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T01:30:45.737 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.737 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.737 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T01:30:45.737 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T01:30:45.738 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T01:30:45.738 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.738 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T01:30:45.738 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T01:30:45.738 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T01:30:45.738 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T01:30:45.738 INFO:teuthology.orchestra.run.smithi043.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T01:30:45.738 INFO:teuthology.orchestra.run.smithi043.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T01:30:45.738 INFO:teuthology.orchestra.run.smithi043.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T01:30:45.738 INFO:teuthology.orchestra.run.smithi043.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-17T01:30:45.738 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T01:30:45.738 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T01:30:45.738 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T01:30:45.739 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T01:30:45.739 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T01:30:45.739 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T01:30:45.739 INFO:teuthology.orchestra.run.smithi043.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T01:30:45.739 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.739 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.739 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T01:30:45.739 INFO:teuthology.orchestra.run.smithi043.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T01:30:45.739 INFO:teuthology.orchestra.run.smithi043.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T01:30:45.739 INFO:teuthology.orchestra.run.smithi043.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T01:30:45.739 INFO:teuthology.orchestra.run.smithi043.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-17T01:30:45.739 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-17T01:30:45.740 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T01:30:45.740 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-17T01:30:45.740 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:45.740 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-17T01:30:46.348 DEBUG:teuthology.parallel:result is None 2024-09-17T01:30:46.349 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T01:30:46.491 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T01:30:46.545 INFO:teuthology.orchestra.run.smithi042.stdout:19.3.0-4989.gce1b342b.el9 2024-09-17T01:30:46.546 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4989.gce1b342b.el9 2024-09-17T01:30:46.546 INFO:teuthology.task.install:The correct ceph version 19.3.0-4989.gce1b342b is installed. 2024-09-17T01:30:46.548 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T01:30:46.683 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T01:30:46.732 INFO:teuthology.orchestra.run.smithi043.stdout:19.3.0-4989.gce1b342b.el9 2024-09-17T01:30:46.733 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4989.gce1b342b.el9 2024-09-17T01:30:46.733 INFO:teuthology.task.install:The correct ceph version 19.3.0-4989.gce1b342b is installed. 2024-09-17T01:30:46.735 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T01:30:46.735 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:30:46.735 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T01:30:46.798 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:30:46.798 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T01:30:46.858 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T01:30:46.858 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:30:46.858 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T01:30:46.916 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T01:30:47.013 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:30:47.013 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T01:30:47.073 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T01:30:47.175 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T01:30:47.175 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:30:47.175 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T01:30:47.231 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T01:30:47.327 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:30:47.327 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T01:30:47.389 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T01:30:47.489 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T01:30:47.489 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:30:47.489 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T01:30:47.544 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T01:30:47.639 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:30:47.640 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T01:30:47.699 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T01:30:47.795 INFO:teuthology.run_tasks:Running task ceph... 2024-09-17T01:30:47.883 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-17T01:30:47.884 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 777 /var/log/ceph 2024-09-17T01:30:47.888 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 777 /var/log/ceph 2024-09-17T01:30:47.947 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-17T01:30:47.947 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T01:30:47.951 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T01:30:48.008 INFO:tasks.ceph:Creating extra log directories... 2024-09-17T01:30:48.008 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T01:30:48.012 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T01:30:48.075 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-17T01:30:48.075 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-17T01:30:48.075 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-17T01:30:48.075 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:30:48.075 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T01:30:48.110 DEBUG:teuthology.orchestra.run.smithi042:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T01:30:48.279 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-17T01:30:48.335 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:30:48.335 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T01:30:48.370 DEBUG:teuthology.orchestra.run.smithi043:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T01:30:48.541 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-17T01:30:48.606 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-17T01:30:48.606 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mds': {'mds cache max size': 1000, 'mds log max segments': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-17T01:30:48.606 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908333', 'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/scrub}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7908333', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240916.200549-debug'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mds': {'mds cache max size': 1000, 'mds log max segments': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 993, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'sleep_before_teardown': 0, 'subset': '165/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240916.200549-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi042.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBECzAy1oOeK5YOmJMysghx591/ras3x1ONoKAWEeQPiwSlGcIQsIQLwEN9Y19qJ976LDXuk6bgGi77Ccor+cwv4=', 'smithi043.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBn6JJdtmQ2ohc3kjfEgJtIRxdikKl9Qd/BOxPRk52gsFyxS3iaHaBiJVgo+PE6CEM7uOV82ErDvd9C3DKVrKUA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mds': {'mds cache max size': 1000, 'mds log max segments': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_scrub_checks', 'tasks.cephfs.test_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_01:09:11', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-17T01:30:48.607 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T01:30:48.612 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T01:30:48.647 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T01:30:48.689 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T01:30:48.745 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:30:48.745 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T01:30:48.781 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T01:30:48.781 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_1 2024-09-17T01:30:48.855 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T01:30:48.855 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:30:48.856 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 6h/6d Inode: 637 Links: 1 2024-09-17T01:30:48.856 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:30:48.856 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:30:48.856 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-17 01:30:34.607393340 +0000 2024-09-17T01:30:48.856 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-17 01:28:25.137301040 +0000 2024-09-17T01:30:48.856 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-17 01:28:25.137301040 +0000 2024-09-17T01:30:48.856 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-17 01:28:25.137301040 +0000 2024-09-17T01:30:48.856 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T01:30:48.947 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:30:48.947 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:30:48.947 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000157774 s, 3.2 MB/s 2024-09-17T01:30:48.950 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T01:30:48.988 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_2 2024-09-17T01:30:49.064 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T01:30:49.065 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:30:49.065 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 6h/6d Inode: 656 Links: 1 2024-09-17T01:30:49.065 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:30:49.065 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:30:49.065 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-17 01:30:34.608393329 +0000 2024-09-17T01:30:49.065 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-17 01:28:25.586297451 +0000 2024-09-17T01:30:49.065 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-17 01:28:25.586297451 +0000 2024-09-17T01:30:49.065 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-17 01:28:25.586297451 +0000 2024-09-17T01:30:49.065 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T01:30:49.158 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:30:49.158 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:30:49.158 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000203015 s, 2.5 MB/s 2024-09-17T01:30:49.161 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T01:30:49.201 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_3 2024-09-17T01:30:49.277 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T01:30:49.278 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:30:49.278 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 6h/6d Inode: 676 Links: 1 2024-09-17T01:30:49.278 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:30:49.278 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:30:49.278 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-17 01:30:34.609393318 +0000 2024-09-17T01:30:49.278 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-17 01:28:26.045293782 +0000 2024-09-17T01:30:49.278 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-17 01:28:26.045293782 +0000 2024-09-17T01:30:49.278 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-17 01:28:26.045293782 +0000 2024-09-17T01:30:49.279 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T01:30:49.370 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:30:49.370 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:30:49.370 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.00016952 s, 3.0 MB/s 2024-09-17T01:30:49.372 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T01:30:49.409 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_4 2024-09-17T01:30:49.485 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T01:30:49.485 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:30:49.485 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 6h/6d Inode: 692 Links: 1 2024-09-17T01:30:49.485 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:30:49.485 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:30:49.485 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-17 01:30:34.610393307 +0000 2024-09-17T01:30:49.485 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-17 01:28:26.528289921 +0000 2024-09-17T01:30:49.486 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-17 01:28:26.528289921 +0000 2024-09-17T01:30:49.486 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-17 01:28:26.528289921 +0000 2024-09-17T01:30:49.486 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T01:30:49.578 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:30:49.578 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:30:49.578 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000172949 s, 3.0 MB/s 2024-09-17T01:30:49.580 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T01:30:49.617 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T01:30:49.618 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:30:49.618 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T01:30:49.658 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T01:30:49.658 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_1 2024-09-17T01:30:49.735 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T01:30:49.735 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:30:49.735 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 6h/6d Inode: 639 Links: 1 2024-09-17T01:30:49.736 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:30:49.736 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:30:49.736 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-09-17 01:30:37.334404443 +0000 2024-09-17T01:30:49.736 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-09-17 01:28:25.138009867 +0000 2024-09-17T01:30:49.736 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-09-17 01:28:25.138009867 +0000 2024-09-17T01:30:49.736 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-09-17 01:28:25.138009867 +0000 2024-09-17T01:30:49.736 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T01:30:49.831 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-09-17T01:30:49.831 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-09-17T01:30:49.831 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000181025 s, 2.8 MB/s 2024-09-17T01:30:49.834 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T01:30:49.871 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_2 2024-09-17T01:30:49.947 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T01:30:49.947 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:30:49.947 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 6h/6d Inode: 659 Links: 1 2024-09-17T01:30:49.947 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:30:49.947 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:30:49.947 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-09-17 01:30:37.335404428 +0000 2024-09-17T01:30:49.947 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-09-17 01:28:25.595004558 +0000 2024-09-17T01:30:49.948 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-09-17 01:28:25.595004558 +0000 2024-09-17T01:30:49.948 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-09-17 01:28:25.595004558 +0000 2024-09-17T01:30:49.948 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T01:30:50.041 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-09-17T01:30:50.041 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-09-17T01:30:50.041 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000173768 s, 2.9 MB/s 2024-09-17T01:30:50.044 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T01:30:50.080 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_3 2024-09-17T01:30:50.155 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T01:30:50.156 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:30:50.156 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 6h/6d Inode: 678 Links: 1 2024-09-17T01:30:50.156 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:30:50.156 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:30:50.156 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-09-17 01:30:37.336404413 +0000 2024-09-17T01:30:50.156 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-09-17 01:28:26.079998923 +0000 2024-09-17T01:30:50.156 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-09-17 01:28:26.079998923 +0000 2024-09-17T01:30:50.156 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-09-17 01:28:26.079998923 +0000 2024-09-17T01:30:50.156 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T01:30:50.248 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-09-17T01:30:50.248 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-09-17T01:30:50.248 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.00017518 s, 2.9 MB/s 2024-09-17T01:30:50.251 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T01:30:50.287 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_4 2024-09-17T01:30:50.362 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T01:30:50.362 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:30:50.362 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 6h/6d Inode: 697 Links: 1 2024-09-17T01:30:50.363 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:30:50.363 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:30:50.363 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-09-17 01:30:37.336404413 +0000 2024-09-17T01:30:50.363 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-09-17 01:28:26.506993962 +0000 2024-09-17T01:30:50.363 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-09-17 01:28:26.506993962 +0000 2024-09-17T01:30:50.363 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-09-17 01:28:26.506993962 +0000 2024-09-17T01:30:50.363 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T01:30:50.455 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-09-17T01:30:50.455 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-09-17T01:30:50.455 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.00017138 s, 3.0 MB/s 2024-09-17T01:30:50.457 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T01:30:50.494 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T01:30:50.494 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi042.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi043.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T01:30:50.494 INFO:tasks.ceph:Generating config... 2024-09-17T01:30:50.495 INFO:tasks.ceph:[client] pid file = 2024-09-17T01:30:50.495 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-17T01:30:50.496 INFO:tasks.ceph:[mds] mds cache max size = 1000 2024-09-17T01:30:50.496 INFO:tasks.ceph:[mds] mds log max segments = 1 2024-09-17T01:30:50.496 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-17T01:30:50.496 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-17T01:30:50.496 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-17T01:30:50.496 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-17T01:30:50.496 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-17T01:30:50.496 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-17T01:30:50.496 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-17T01:30:50.496 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-17T01:30:50.496 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-17T01:30:50.496 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-17T01:30:50.496 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-17T01:30:50.497 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-17T01:30:50.497 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-17T01:30:50.497 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-17T01:30:50.497 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-17T01:30:50.497 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-17T01:30:50.497 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-17T01:30:50.497 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-17T01:30:50.497 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-17T01:30:50.497 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-17T01:30:50.497 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-17T01:30:50.497 INFO:tasks.ceph:Setting up mon.a... 2024-09-17T01:30:50.498 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-17T01:30:50.660 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.keyring 2024-09-17T01:30:50.672 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-17T01:30:50.830 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T01:30:50.885 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.42'), ('mon.b', '172.21.15.43'), ('mon.c', '[v2:172.21.15.43:3301,v1:172.21.15.43:6790]')] 2024-09-17T01:30:50.886 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.42,172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'mds cache max size': 1000, 'mds log max segments': 1}} 2024-09-17T01:30:50.887 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:30:50.887 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T01:30:50.921 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.42 --add b 172.21.15.43 --addv c '[v2:172.21.15.43:3301,v1:172.21.15.43:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-17T01:30:51.104 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-17T01:30:51.104 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: generated fsid fea1c88c-cb05-432f-a745-f9dcbb5f2503 2024-09-17T01:30:51.104 INFO:teuthology.orchestra.run.smithi042.stdout:setting min_mon_release = quincy 2024-09-17T01:30:51.104 INFO:teuthology.orchestra.run.smithi042.stdout:epoch 0 2024-09-17T01:30:51.104 INFO:teuthology.orchestra.run.smithi042.stdout:fsid fea1c88c-cb05-432f-a745-f9dcbb5f2503 2024-09-17T01:30:51.104 INFO:teuthology.orchestra.run.smithi042.stdout:last_changed 2024-09-17T01:30:51.107323+0000 2024-09-17T01:30:51.104 INFO:teuthology.orchestra.run.smithi042.stdout:created 2024-09-17T01:30:51.107323+0000 2024-09-17T01:30:51.104 INFO:teuthology.orchestra.run.smithi042.stdout:min_mon_release 17 (quincy) 2024-09-17T01:30:51.105 INFO:teuthology.orchestra.run.smithi042.stdout:election_strategy: 1 2024-09-17T01:30:51.105 INFO:teuthology.orchestra.run.smithi042.stdout:0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-09-17T01:30:51.105 INFO:teuthology.orchestra.run.smithi042.stdout:1: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.b 2024-09-17T01:30:51.105 INFO:teuthology.orchestra.run.smithi042.stdout:2: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.c 2024-09-17T01:30:51.105 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-17T01:30:51.113 DEBUG:teuthology.orchestra.run.smithi042:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T01:30:51.147 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID fea1c88c-cb05-432f-a745-f9dcbb5f2503... 2024-09-17T01:30:51.148 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T01:30:51.192 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T01:30:51.284 INFO:teuthology.orchestra.run.smithi042.stdout:[global] 2024-09-17T01:30:51.284 INFO:teuthology.orchestra.run.smithi042.stdout: chdir = "" 2024-09-17T01:30:51.284 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T01:30:51.284 INFO:teuthology.orchestra.run.smithi042.stdout: auth supported = cephx 2024-09-17T01:30:51.285 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.285 INFO:teuthology.orchestra.run.smithi042.stdout: filestore xattr use omap = true 2024-09-17T01:30:51.285 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.285 INFO:teuthology.orchestra.run.smithi042.stdout: mon clock drift allowed = 1.000 2024-09-17T01:30:51.285 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.285 INFO:teuthology.orchestra.run.smithi042.stdout: osd crush chooseleaf type = 0 2024-09-17T01:30:51.285 INFO:teuthology.orchestra.run.smithi042.stdout: auth debug = true 2024-09-17T01:30:51.285 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.285 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on old message = true 2024-09-17T01:30:51.285 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on bug = true 2024-09-17T01:30:51.285 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.285 INFO:teuthology.orchestra.run.smithi042.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T01:30:51.285 INFO:teuthology.orchestra.run.smithi042.stdout: mon pg warn max object skew = 0 2024-09-17T01:30:51.286 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.286 INFO:teuthology.orchestra.run.smithi042.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T01:30:51.286 INFO:teuthology.orchestra.run.smithi042.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T01:30:51.286 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.286 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default size = 2 2024-09-17T01:30:51.286 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.286 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow primary affinity = true 2024-09-17T01:30:51.286 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow pg remap = true 2024-09-17T01:30:51.286 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on legacy crush tunables = false 2024-09-17T01:30:51.286 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on crush straw calc version zero = false 2024-09-17T01:30:51.286 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on no sortbitwise = false 2024-09-17T01:30:51.286 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on osd down out interval zero = false 2024-09-17T01:30:51.286 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on too few osds = false 2024-09-17T01:30:51.287 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T01:30:51.287 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T01:30:51.287 INFO:teuthology.orchestra.run.smithi042.stdout: mon_allow_pool_size_one = true 2024-09-17T01:30:51.287 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.287 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T01:30:51.287 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.287 INFO:teuthology.orchestra.run.smithi042.stdout: osd default data pool replay window = 5 2024-09-17T01:30:51.287 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.287 INFO:teuthology.orchestra.run.smithi042.stdout: mon allow pool delete = true 2024-09-17T01:30:51.287 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.287 INFO:teuthology.orchestra.run.smithi042.stdout: mon cluster log file level = debug 2024-09-17T01:30:51.287 INFO:teuthology.orchestra.run.smithi042.stdout: debug asserts on shutdown = true 2024-09-17T01:30:51.287 INFO:teuthology.orchestra.run.smithi042.stdout: mon health detail to clog = false 2024-09-17T01:30:51.288 INFO:teuthology.orchestra.run.smithi042.stdout: mon host = "172.21.15.42,172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790]" 2024-09-17T01:30:51.288 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on skipped message = False 2024-09-17T01:30:51.288 INFO:teuthology.orchestra.run.smithi042.stdout: fsid = fea1c88c-cb05-432f-a745-f9dcbb5f2503 2024-09-17T01:30:51.288 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.288 INFO:teuthology.orchestra.run.smithi042.stdout:[osd] 2024-09-17T01:30:51.288 INFO:teuthology.orchestra.run.smithi042.stdout: osd journal size = 100 2024-09-17T01:30:51.288 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.288 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub load threshold = 5.0 2024-09-17T01:30:51.288 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub max interval = 600 2024-09-17T01:30:51.288 INFO:teuthology.orchestra.run.smithi042.stdout: osd mclock profile = high_recovery_ops 2024-09-17T01:30:51.289 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.289 INFO:teuthology.orchestra.run.smithi042.stdout: osd recover clone overlap = true 2024-09-17T01:30:51.289 INFO:teuthology.orchestra.run.smithi042.stdout: osd recovery max chunk = 1048576 2024-09-17T01:30:51.289 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.289 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug shutdown = true 2024-09-17T01:30:51.289 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug op order = true 2024-09-17T01:30:51.289 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug verify stray on activate = true 2024-09-17T01:30:51.289 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug trim objects = true 2024-09-17T01:30:51.289 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.289 INFO:teuthology.orchestra.run.smithi042.stdout: osd open classes on start = true 2024-09-17T01:30:51.289 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug pg log writeout = true 2024-09-17T01:30:51.289 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.289 INFO:teuthology.orchestra.run.smithi042.stdout: osd deep scrub update digest min age = 30 2024-09-17T01:30:51.289 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.290 INFO:teuthology.orchestra.run.smithi042.stdout: osd map max advance = 10 2024-09-17T01:30:51.290 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.290 INFO:teuthology.orchestra.run.smithi042.stdout: journal zero on create = true 2024-09-17T01:30:51.290 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.290 INFO:teuthology.orchestra.run.smithi042.stdout: filestore ondisk finisher threads = 3 2024-09-17T01:30:51.290 INFO:teuthology.orchestra.run.smithi042.stdout: filestore apply finisher threads = 3 2024-09-17T01:30:51.290 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.290 INFO:teuthology.orchestra.run.smithi042.stdout: bdev debug aio = true 2024-09-17T01:30:51.290 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug misdirected ops = true 2024-09-17T01:30:51.290 INFO:teuthology.orchestra.run.smithi042.stdout: bdev async discard = True 2024-09-17T01:30:51.290 INFO:teuthology.orchestra.run.smithi042.stdout: bdev enable discard = True 2024-09-17T01:30:51.290 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore allocator = bitmap 2024-09-17T01:30:51.290 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore block size = 96636764160 2024-09-17T01:30:51.290 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore fsck on mount = True 2024-09-17T01:30:51.291 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluefs = 1/20 2024-09-17T01:30:51.291 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluestore = 1/20 2024-09-17T01:30:51.291 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-17T01:30:51.291 INFO:teuthology.orchestra.run.smithi042.stdout: debug osd = 20 2024-09-17T01:30:51.291 INFO:teuthology.orchestra.run.smithi042.stdout: debug rocksdb = 4/10 2024-09-17T01:30:51.291 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T01:30:51.291 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd full ratio = 0.9 2024-09-17T01:30:51.291 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd nearfull ratio = 0.8 2024-09-17T01:30:51.291 INFO:teuthology.orchestra.run.smithi042.stdout: osd failsafe full ratio = 0.95 2024-09-17T01:30:51.291 INFO:teuthology.orchestra.run.smithi042.stdout: osd objectstore = bluestore 2024-09-17T01:30:51.292 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.292 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr] 2024-09-17T01:30:51.292 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-17T01:30:51.292 INFO:teuthology.orchestra.run.smithi042.stdout: debug mgr = 20 2024-09-17T01:30:51.292 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-09-17T01:30:51.292 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-09-17T01:30:51.293 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:30:51.293 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:30:51.293 INFO:teuthology.orchestra.run.smithi042.stdout: mgr/telemetry/nag = false 2024-09-17T01:30:51.293 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.293 INFO:teuthology.orchestra.run.smithi042.stdout:[mon] 2024-09-17T01:30:51.293 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-17T01:30:51.293 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-09-17T01:30:51.293 INFO:teuthology.orchestra.run.smithi042.stdout: debug paxos = 20 2024-09-17T01:30:51.293 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-09-17T01:30:51.293 INFO:teuthology.orchestra.run.smithi042.stdout: mon data avail warn = 5 2024-09-17T01:30:51.293 INFO:teuthology.orchestra.run.smithi042.stdout: mon mgr mkfs grace = 240 2024-09-17T01:30:51.293 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:30:51.293 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd reporter subtree level = osd 2024-09-17T01:30:51.294 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd prime pg temp = true 2024-09-17T01:30:51.294 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:30:51.294 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.294 INFO:teuthology.orchestra.run.smithi042.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T01:30:51.294 INFO:teuthology.orchestra.run.smithi042.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T01:30:51.294 INFO:teuthology.orchestra.run.smithi042.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T01:30:51.294 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.294 INFO:teuthology.orchestra.run.smithi042.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T01:30:51.294 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T01:30:51.294 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T01:30:51.294 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.294 INFO:teuthology.orchestra.run.smithi042.stdout: # 1m isn't quite enough 2024-09-17T01:30:51.294 INFO:teuthology.orchestra.run.smithi042.stdout: mon_down_mkfs_grace = 2m 2024-09-17T01:30:51.295 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.295 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_filestore_osds = false 2024-09-17T01:30:51.295 INFO:teuthology.orchestra.run.smithi042.stdout: mon down mkfs grace = 300 2024-09-17T01:30:51.295 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:30:51.295 INFO:teuthology.orchestra.run.smithi042.stdout:[client] 2024-09-17T01:30:51.295 INFO:teuthology.orchestra.run.smithi042.stdout: rgw cache enabled = true 2024-09-17T01:30:51.295 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable ops log = true 2024-09-17T01:30:51.295 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable usage log = true 2024-09-17T01:30:51.295 INFO:teuthology.orchestra.run.smithi042.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T01:30:51.295 INFO:teuthology.orchestra.run.smithi042.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T01:30:51.295 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = "" 2024-09-17T01:30:51.295 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.a] 2024-09-17T01:30:51.295 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.b] 2024-09-17T01:30:51.295 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.c] 2024-09-17T01:30:51.296 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.a] 2024-09-17T01:30:51.296 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.c] 2024-09-17T01:30:51.296 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.b] 2024-09-17T01:30:51.296 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.d] 2024-09-17T01:30:51.296 INFO:teuthology.orchestra.run.smithi042.stdout:[mds] 2024-09-17T01:30:51.296 INFO:teuthology.orchestra.run.smithi042.stdout: mds cache max size = 1000 2024-09-17T01:30:51.296 INFO:teuthology.orchestra.run.smithi042.stdout: mds log max segments = 1 2024-09-17T01:30:51.296 INFO:teuthology.orchestra.run.smithi043.stdout:[global] 2024-09-17T01:30:51.297 INFO:teuthology.orchestra.run.smithi043.stdout: chdir = "" 2024-09-17T01:30:51.297 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T01:30:51.300 INFO:teuthology.orchestra.run.smithi043.stdout: auth supported = cephx 2024-09-17T01:30:51.300 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.300 INFO:teuthology.orchestra.run.smithi043.stdout: filestore xattr use omap = true 2024-09-17T01:30:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: mon clock drift allowed = 1.000 2024-09-17T01:30:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: osd crush chooseleaf type = 0 2024-09-17T01:30:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: auth debug = true 2024-09-17T01:30:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on old message = true 2024-09-17T01:30:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on bug = true 2024-09-17T01:30:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T01:30:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: mon pg warn max object skew = 0 2024-09-17T01:30:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.301 INFO:teuthology.orchestra.run.smithi043.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T01:30:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T01:30:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default size = 2 2024-09-17T01:30:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow primary affinity = true 2024-09-17T01:30:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow pg remap = true 2024-09-17T01:30:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on legacy crush tunables = false 2024-09-17T01:30:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on crush straw calc version zero = false 2024-09-17T01:30:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on no sortbitwise = false 2024-09-17T01:30:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on osd down out interval zero = false 2024-09-17T01:30:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on too few osds = false 2024-09-17T01:30:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T01:30:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T01:30:51.302 INFO:teuthology.orchestra.run.smithi043.stdout: mon_allow_pool_size_one = true 2024-09-17T01:30:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T01:30:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: osd default data pool replay window = 5 2024-09-17T01:30:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: mon allow pool delete = true 2024-09-17T01:30:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: mon cluster log file level = debug 2024-09-17T01:30:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: debug asserts on shutdown = true 2024-09-17T01:30:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: mon health detail to clog = false 2024-09-17T01:30:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: mon host = "172.21.15.42,172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790]" 2024-09-17T01:30:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on skipped message = False 2024-09-17T01:30:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: fsid = fea1c88c-cb05-432f-a745-f9dcbb5f2503 2024-09-17T01:30:51.303 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.304 INFO:teuthology.orchestra.run.smithi043.stdout:[osd] 2024-09-17T01:30:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: osd journal size = 100 2024-09-17T01:30:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub load threshold = 5.0 2024-09-17T01:30:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub max interval = 600 2024-09-17T01:30:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: osd mclock profile = high_recovery_ops 2024-09-17T01:30:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: osd recover clone overlap = true 2024-09-17T01:30:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: osd recovery max chunk = 1048576 2024-09-17T01:30:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug shutdown = true 2024-09-17T01:30:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug op order = true 2024-09-17T01:30:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug verify stray on activate = true 2024-09-17T01:30:51.304 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug trim objects = true 2024-09-17T01:30:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: osd open classes on start = true 2024-09-17T01:30:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug pg log writeout = true 2024-09-17T01:30:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: osd deep scrub update digest min age = 30 2024-09-17T01:30:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: osd map max advance = 10 2024-09-17T01:30:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: journal zero on create = true 2024-09-17T01:30:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: filestore ondisk finisher threads = 3 2024-09-17T01:30:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: filestore apply finisher threads = 3 2024-09-17T01:30:51.305 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: bdev debug aio = true 2024-09-17T01:30:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug misdirected ops = true 2024-09-17T01:30:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: bdev async discard = True 2024-09-17T01:30:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: bdev enable discard = True 2024-09-17T01:30:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore allocator = bitmap 2024-09-17T01:30:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore block size = 96636764160 2024-09-17T01:30:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore fsck on mount = True 2024-09-17T01:30:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluefs = 1/20 2024-09-17T01:30:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluestore = 1/20 2024-09-17T01:30:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-17T01:30:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: debug osd = 20 2024-09-17T01:30:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: debug rocksdb = 4/10 2024-09-17T01:30:51.306 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T01:30:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd full ratio = 0.9 2024-09-17T01:30:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd nearfull ratio = 0.8 2024-09-17T01:30:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: osd failsafe full ratio = 0.95 2024-09-17T01:30:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: osd objectstore = bluestore 2024-09-17T01:30:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.307 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr] 2024-09-17T01:30:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-17T01:30:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: debug mgr = 20 2024-09-17T01:30:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-09-17T01:30:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-09-17T01:30:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:30:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:30:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: mgr/telemetry/nag = false 2024-09-17T01:30:51.307 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.308 INFO:teuthology.orchestra.run.smithi043.stdout:[mon] 2024-09-17T01:30:51.308 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-17T01:30:51.308 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-09-17T01:30:51.308 INFO:teuthology.orchestra.run.smithi043.stdout: debug paxos = 20 2024-09-17T01:30:51.308 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-09-17T01:30:51.308 INFO:teuthology.orchestra.run.smithi043.stdout: mon data avail warn = 5 2024-09-17T01:30:51.308 INFO:teuthology.orchestra.run.smithi043.stdout: mon mgr mkfs grace = 240 2024-09-17T01:30:51.308 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:30:51.308 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd reporter subtree level = osd 2024-09-17T01:30:51.308 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd prime pg temp = true 2024-09-17T01:30:51.308 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:30:51.308 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.308 INFO:teuthology.orchestra.run.smithi043.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T01:30:51.308 INFO:teuthology.orchestra.run.smithi043.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T01:30:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T01:30:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T01:30:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T01:30:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T01:30:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: # 1m isn't quite enough 2024-09-17T01:30:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: mon_down_mkfs_grace = 2m 2024-09-17T01:30:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_filestore_osds = false 2024-09-17T01:30:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: mon down mkfs grace = 300 2024-09-17T01:30:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:30:51.309 INFO:teuthology.orchestra.run.smithi043.stdout:[client] 2024-09-17T01:30:51.309 INFO:teuthology.orchestra.run.smithi043.stdout: rgw cache enabled = true 2024-09-17T01:30:51.310 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable ops log = true 2024-09-17T01:30:51.310 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable usage log = true 2024-09-17T01:30:51.310 INFO:teuthology.orchestra.run.smithi043.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T01:30:51.310 INFO:teuthology.orchestra.run.smithi043.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T01:30:51.310 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = "" 2024-09-17T01:30:51.310 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.a] 2024-09-17T01:30:51.310 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.b] 2024-09-17T01:30:51.310 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.c] 2024-09-17T01:30:51.310 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a] 2024-09-17T01:30:51.310 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.c] 2024-09-17T01:30:51.310 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.b] 2024-09-17T01:30:51.310 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.d] 2024-09-17T01:30:51.310 INFO:teuthology.orchestra.run.smithi043.stdout:[mds] 2024-09-17T01:30:51.310 INFO:teuthology.orchestra.run.smithi043.stdout: mds cache max size = 1000 2024-09-17T01:30:51.310 INFO:teuthology.orchestra.run.smithi043.stdout: mds log max segments = 1 2024-09-17T01:30:51.322 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-17T01:30:51.322 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-17T01:30:51.492 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-17T01:30:51.492 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:30:51.492 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-17T01:30:51.526 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:30:51.527 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-17T01:30:51.601 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:30:51.601 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:30:51.601 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T01:30:51.601 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T01:30:51.719 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:30:51.719 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T01:30:51.793 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T01:30:51.794 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:30:51.794 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T01:30:51.794 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T01:30:51.876 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:30:51.876 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T01:30:51.952 INFO:tasks.ceph:Setting up mon nodes... 2024-09-17T01:30:51.953 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-17T01:30:51.953 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T01:30:52.121 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T01:30:52.133 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T01:30:52.313 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T01:30:52.327 INFO:tasks.ceph:Setting up mds nodes... 2024-09-17T01:30:52.328 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T01:30:52.495 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T01:30:52.507 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-17T01:30:52.563 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T01:30:52.731 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T01:30:52.742 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-17T01:30:52.798 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T01:30:52.968 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T01:30:52.979 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-17T01:30:53.036 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T01:30:53.203 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T01:30:53.215 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-17T01:30:53.270 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-17T01:30:53.270 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T01:30:53.417 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-17T01:30:53.451 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-17T01:30:53.598 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-17T01:30:53.632 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-17T01:30:53.779 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-17T01:30:53.812 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-17T01:30:53.957 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-17T01:30:53.991 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-17T01:30:53.991 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi042.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi043.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T01:30:53.991 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-17T01:30:54.048 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T01:30:54.048 INFO:tasks.ceph:role: osd.0 2024-09-17T01:30:54.048 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:30:54.049 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T01:30:54.103 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T01:30:54.103 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T01:30:54.103 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T01:30:54.103 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T01:30:54.104 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T01:30:54.104 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-09-17T01:30:54.104 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T01:30:54.104 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T01:30:54.104 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T01:30:54.104 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T01:30:54.137 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-09-17T01:30:54.141 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-09-17T01:30:54.141 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-17T01:30:54.220 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-17T01:30:54.282 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-17T01:30:54.338 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T01:30:54.338 INFO:tasks.ceph:role: osd.1 2024-09-17T01:30:54.338 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:30:54.338 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T01:30:54.393 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T01:30:54.393 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T01:30:54.393 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T01:30:54.393 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T01:30:54.393 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T01:30:54.393 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-09-17T01:30:54.393 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T01:30:54.394 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T01:30:54.394 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T01:30:54.394 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T01:30:54.426 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-09-17T01:30:54.430 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-09-17T01:30:54.430 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-17T01:30:54.509 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-17T01:30:54.571 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-17T01:30:54.627 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T01:30:54.627 INFO:tasks.ceph:role: osd.2 2024-09-17T01:30:54.627 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:30:54.628 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T01:30:54.682 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T01:30:54.683 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T01:30:54.683 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T01:30:54.683 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T01:30:54.683 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T01:30:54.683 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-09-17T01:30:54.683 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T01:30:54.683 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T01:30:54.683 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T01:30:54.683 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T01:30:54.716 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-09-17T01:30:54.719 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-09-17T01:30:54.720 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-17T01:30:54.799 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-17T01:30:54.861 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-17T01:30:54.916 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T01:30:54.916 INFO:tasks.ceph:role: osd.3 2024-09-17T01:30:54.917 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:30:54.917 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T01:30:54.971 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T01:30:54.971 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T01:30:54.971 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T01:30:54.971 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T01:30:54.971 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T01:30:54.971 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-09-17T01:30:54.972 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T01:30:54.972 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T01:30:54.972 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T01:30:54.972 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T01:30:55.006 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-09-17T01:30:55.010 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-09-17T01:30:55.010 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-17T01:30:55.089 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-17T01:30:55.153 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T01:30:55.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:30:55.328+0000 7fceed211640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-17T01:30:55.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:30:55.328+0000 7fceed211640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-17T01:30:55.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:30:55.328+0000 7fceed211640 -1 bdev(0x56533f859900 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-17T01:30:55.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:30:55.328+0000 7fceed211640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-17T01:30:58.594 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:30:58.655 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T01:30:58.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:30:58.815+0000 7f324d044640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-17T01:30:58.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:30:58.815+0000 7f324d044640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-17T01:30:58.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:30:58.815+0000 7f324d044640 -1 bdev(0x56119deb9900 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-17T01:30:58.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:30:58.816+0000 7f324d044640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-17T01:31:01.851 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:31:01.912 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T01:31:02.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:02.075+0000 7f989e958640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-17T01:31:02.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:02.076+0000 7f989e958640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-17T01:31:02.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:02.076+0000 7f989e958640 -1 bdev(0x55a7ab453900 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-17T01:31:02.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:02.076+0000 7f989e958640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-17T01:31:05.139 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T01:31:05.197 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T01:31:05.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:05.357+0000 7f19d2e1f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-17T01:31:05.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:05.357+0000 7f19d2e1f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-17T01:31:05.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:05.357+0000 7f19d2e1f640 -1 bdev(0x5570b07ff900 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-17T01:31:05.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:05.357+0000 7f19d2e1f640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-17T01:31:08.433 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:31:08.492 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-17T01:31:08.554 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T01:31:08.554 INFO:tasks.ceph:role: osd.4 2024-09-17T01:31:08.554 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T01:31:08.554 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T01:31:08.612 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T01:31:08.612 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T01:31:08.613 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T01:31:08.613 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T01:31:08.613 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T01:31:08.613 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-09-17T01:31:08.613 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T01:31:08.613 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T01:31:08.613 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T01:31:08.613 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T01:31:08.645 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-09-17T01:31:08.649 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-09-17T01:31:08.649 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-17T01:31:08.731 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-17T01:31:08.793 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-17T01:31:08.850 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T01:31:08.850 INFO:tasks.ceph:role: osd.5 2024-09-17T01:31:08.850 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T01:31:08.850 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T01:31:08.906 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T01:31:08.906 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T01:31:08.907 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T01:31:08.907 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T01:31:08.907 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T01:31:08.907 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-09-17T01:31:08.907 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T01:31:08.907 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T01:31:08.907 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T01:31:08.907 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T01:31:08.940 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-09-17T01:31:08.944 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-09-17T01:31:08.944 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-17T01:31:09.025 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-17T01:31:09.087 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-17T01:31:09.144 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T01:31:09.144 INFO:tasks.ceph:role: osd.6 2024-09-17T01:31:09.144 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T01:31:09.144 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T01:31:09.200 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T01:31:09.200 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T01:31:09.200 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T01:31:09.200 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T01:31:09.200 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T01:31:09.200 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-09-17T01:31:09.200 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T01:31:09.200 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T01:31:09.200 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T01:31:09.200 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T01:31:09.233 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-09-17T01:31:09.237 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-09-17T01:31:09.237 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-17T01:31:09.321 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-17T01:31:09.383 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-17T01:31:09.439 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T01:31:09.440 INFO:tasks.ceph:role: osd.7 2024-09-17T01:31:09.440 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T01:31:09.440 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T01:31:09.511 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T01:31:09.512 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T01:31:09.512 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T01:31:09.512 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T01:31:09.512 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T01:31:09.512 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-09-17T01:31:09.512 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T01:31:09.512 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T01:31:09.512 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T01:31:09.512 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T01:31:09.545 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-09-17T01:31:09.549 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-09-17T01:31:09.549 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-17T01:31:09.634 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-17T01:31:09.697 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T01:31:09.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:09.871+0000 7fd850d02640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-17T01:31:09.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:09.871+0000 7fd850d02640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-17T01:31:09.870 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:09.872+0000 7fd850d02640 -1 bdev(0x55857673d900 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-17T01:31:09.871 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:09.872+0000 7fd850d02640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-17T01:31:13.424 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T01:31:13.481 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T01:31:13.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:13.640+0000 7f4fe4b45640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-17T01:31:13.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:13.641+0000 7f4fe4b45640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-17T01:31:13.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:13.641+0000 7f4fe4b45640 -1 bdev(0x560279211900 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-17T01:31:13.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:13.641+0000 7f4fe4b45640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-17T01:31:16.675 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T01:31:16.736 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T01:31:16.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:16.896+0000 7fc6a6d51640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-17T01:31:16.895 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:16.896+0000 7fc6a6d51640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-17T01:31:16.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:16.897+0000 7fc6a6d51640 -1 bdev(0x55b061bbb900 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-17T01:31:16.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:16.897+0000 7fc6a6d51640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-17T01:31:18.609 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:31:18.613 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:31:20.159 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T01:31:20.216 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T01:31:20.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:20.376+0000 7f5459e22640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-17T01:31:20.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:20.376+0000 7f5459e22640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-17T01:31:20.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:20.376+0000 7f5459e22640 -1 bdev(0x5594ef7a5900 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-17T01:31:20.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:20.377+0000 7f5459e22640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-17T01:31:23.411 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T01:31:23.471 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-17T01:31:23.472 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:31:23.472 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-17T01:31:23.534 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:31:23.534 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-17T01:31:23.633 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:31:23.633 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-17T01:31:23.730 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:31:23.730 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-17T01:31:23.825 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:31:23.825 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-17T01:31:23.922 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:31:23.923 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-17T01:31:24.018 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:31:24.018 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-17T01:31:24.114 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:31:24.114 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-17T01:31:24.176 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:31:24.176 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-17T01:31:24.274 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:31:24.274 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-17T01:31:24.370 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:31:24.371 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-17T01:31:24.466 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:31:24.466 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-17T01:31:24.561 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:31:24.561 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-17T01:31:24.657 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:31:24.657 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-17T01:31:24.753 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:31:24.753 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-17T01:31:24.791 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:31:24.791 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-17T01:31:24.873 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:31:24.873 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-17T01:31:24.908 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:31:24.908 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-17T01:31:24.984 INFO:tasks.ceph:Adding keys to all mons... 2024-09-17T01:31:24.984 DEBUG:teuthology.orchestra.run.smithi042:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T01:31:24.988 DEBUG:teuthology.orchestra.run.smithi043:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T01:31:25.040 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr.y] 2024-09-17T01:31:25.041 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDM2+hmpCZtBxAAp5tXMc6aEq1aOny2LJZAiA== 2024-09-17T01:31:25.041 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.a] 2024-09-17T01:31:25.041 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDM2+hmyJK4HRAAIC4E4V7p1fqIEfPIICMxZg== 2024-09-17T01:31:25.041 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.c] 2024-09-17T01:31:25.041 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDM2+hmPE7MKxAA9mGG+EO9C3VGVMerOm92+Q== 2024-09-17T01:31:25.041 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.0] 2024-09-17T01:31:25.041 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDP2+hmEJebExAAAdGEoSzM96ybGT9h7t7OkA== 2024-09-17T01:31:25.041 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.1] 2024-09-17T01:31:25.041 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDS2+hm7dWoMBAAagktrUl0O2/mgKCEfpAstA== 2024-09-17T01:31:25.042 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.2] 2024-09-17T01:31:25.042 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDW2+hmEfSPBBAAPAa6EZt27yUcJSfZyCKheg== 2024-09-17T01:31:25.042 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.3] 2024-09-17T01:31:25.042 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDZ2+hmHQhXFRAAj84g+IKqH6KMP7LjRtFvLw== 2024-09-17T01:31:25.042 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr.x] 2024-09-17T01:31:25.042 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDM2+hmYPnlEhAAIcQ11ktWZyMXYdbAONiLog== 2024-09-17T01:31:25.042 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.b] 2024-09-17T01:31:25.042 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDM2+hmXv3vORAALPrYIM6Vtz0g1pOxVhrUig== 2024-09-17T01:31:25.042 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.d] 2024-09-17T01:31:25.042 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDN2+hmaOBSDBAATU4tpjM5IMcuvzZFE7N5bQ== 2024-09-17T01:31:25.042 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.4] 2024-09-17T01:31:25.042 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDd2+hmaNcMNBAAx1GV/oFdfssMjFWFN5M0VQ== 2024-09-17T01:31:25.042 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.5] 2024-09-17T01:31:25.042 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDh2+hm301NJhAAnSUH5AAvqhPwM7loH6frww== 2024-09-17T01:31:25.043 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.6] 2024-09-17T01:31:25.043 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDk2+hm61WNNRAAbCvVvsUpB4fgt4ja60DRZA== 2024-09-17T01:31:25.043 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.7] 2024-09-17T01:31:25.043 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDo2+hmesiLFhAA29n1eageNvP+lkRyh6gGMw== 2024-09-17T01:31:25.043 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-09-17T01:31:25.043 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA== 2024-09-17T01:31:25.043 INFO:teuthology.orchestra.run.smithi042.stdout:[client.2] 2024-09-17T01:31:25.043 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDN2+hm8lnZIxAAN0a2CVMMtu/Nz50OG4a02A== 2024-09-17T01:31:25.043 INFO:teuthology.orchestra.run.smithi042.stdout:[client.1] 2024-09-17T01:31:25.043 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDN2+hmZLygLhAABlauZgnidFWvfCCPuBLObg== 2024-09-17T01:31:25.043 INFO:teuthology.orchestra.run.smithi042.stdout:[client.3] 2024-09-17T01:31:25.043 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDN2+hmgXdAORAAM5Uy66I4nnTJ9Vhkn9JoBw== 2024-09-17T01:31:25.077 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr.y] 2024-09-17T01:31:25.078 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDM2+hmpCZtBxAAp5tXMc6aEq1aOny2LJZAiA== 2024-09-17T01:31:25.078 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a] 2024-09-17T01:31:25.078 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDM2+hmyJK4HRAAIC4E4V7p1fqIEfPIICMxZg== 2024-09-17T01:31:25.078 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.c] 2024-09-17T01:31:25.078 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDM2+hmPE7MKxAA9mGG+EO9C3VGVMerOm92+Q== 2024-09-17T01:31:25.078 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.0] 2024-09-17T01:31:25.078 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDP2+hmEJebExAAAdGEoSzM96ybGT9h7t7OkA== 2024-09-17T01:31:25.078 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.1] 2024-09-17T01:31:25.078 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDS2+hm7dWoMBAAagktrUl0O2/mgKCEfpAstA== 2024-09-17T01:31:25.078 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.2] 2024-09-17T01:31:25.078 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDW2+hmEfSPBBAAPAa6EZt27yUcJSfZyCKheg== 2024-09-17T01:31:25.078 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.3] 2024-09-17T01:31:25.078 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDZ2+hmHQhXFRAAj84g+IKqH6KMP7LjRtFvLw== 2024-09-17T01:31:25.079 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr.x] 2024-09-17T01:31:25.079 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDM2+hmYPnlEhAAIcQ11ktWZyMXYdbAONiLog== 2024-09-17T01:31:25.079 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.b] 2024-09-17T01:31:25.079 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDM2+hmXv3vORAALPrYIM6Vtz0g1pOxVhrUig== 2024-09-17T01:31:25.079 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.d] 2024-09-17T01:31:25.079 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDN2+hmaOBSDBAATU4tpjM5IMcuvzZFE7N5bQ== 2024-09-17T01:31:25.079 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.4] 2024-09-17T01:31:25.079 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDd2+hmaNcMNBAAx1GV/oFdfssMjFWFN5M0VQ== 2024-09-17T01:31:25.079 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.5] 2024-09-17T01:31:25.079 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDh2+hm301NJhAAnSUH5AAvqhPwM7loH6frww== 2024-09-17T01:31:25.079 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.6] 2024-09-17T01:31:25.079 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDk2+hm61WNNRAAbCvVvsUpB4fgt4ja60DRZA== 2024-09-17T01:31:25.079 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.7] 2024-09-17T01:31:25.080 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDo2+hmesiLFhAA29n1eageNvP+lkRyh6gGMw== 2024-09-17T01:31:25.080 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2024-09-17T01:31:25.080 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA== 2024-09-17T01:31:25.080 INFO:teuthology.orchestra.run.smithi043.stdout:[client.2] 2024-09-17T01:31:25.080 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDN2+hm8lnZIxAAN0a2CVMMtu/Nz50OG4a02A== 2024-09-17T01:31:25.080 INFO:teuthology.orchestra.run.smithi043.stdout:[client.1] 2024-09-17T01:31:25.080 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDN2+hmZLygLhAABlauZgnidFWvfCCPuBLObg== 2024-09-17T01:31:25.080 INFO:teuthology.orchestra.run.smithi043.stdout:[client.3] 2024-09-17T01:31:25.080 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDN2+hmgXdAORAAM5Uy66I4nnTJ9Vhkn9JoBw== 2024-09-17T01:31:25.081 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T01:31:25.089 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T01:31:25.286 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T01:31:25.290 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T01:31:25.459 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T01:31:25.463 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T01:31:25.631 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T01:31:25.635 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T01:31:25.800 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T01:31:25.804 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T01:31:25.970 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T01:31:25.973 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T01:31:26.138 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T01:31:26.142 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T01:31:26.307 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T01:31:26.311 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T01:31:26.477 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T01:31:26.481 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T01:31:26.649 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T01:31:26.653 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T01:31:26.822 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T01:31:26.826 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T01:31:26.993 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T01:31:26.997 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T01:31:27.163 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T01:31:27.167 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T01:31:27.334 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T01:31:27.337 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T01:31:27.504 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T01:31:27.509 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T01:31:27.677 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T01:31:27.681 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T01:31:27.850 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T01:31:27.854 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T01:31:28.024 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T01:31:28.028 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T01:31:28.195 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-17T01:31:28.196 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-17T01:31:28.251 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T01:31:28.430 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-17T01:31:28.487 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-17T01:31:28.545 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T01:31:28.729 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-17T01:31:28.785 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-17T01:31:28.840 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T01:31:29.020 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-17T01:31:29.076 DEBUG:teuthology.orchestra.run.smithi042:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T01:31:29.080 DEBUG:teuthology.orchestra.run.smithi043:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T01:31:29.114 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-17T01:31:29.114 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-17T01:31:29.115 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-17T01:31:29.156 INFO:tasks.ceph.mon.a:Started 2024-09-17T01:31:29.157 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-17T01:31:29.157 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-17T01:31:29.161 INFO:tasks.ceph.mon.b:Started 2024-09-17T01:31:29.161 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-17T01:31:29.161 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-17T01:31:29.164 INFO:tasks.ceph.mon.c:Started 2024-09-17T01:31:29.165 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-17T01:31:29.165 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-17T01:31:29.165 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-17T01:31:29.168 INFO:tasks.ceph.mgr.y:Started 2024-09-17T01:31:29.169 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-17T01:31:29.169 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-17T01:31:29.173 INFO:tasks.ceph.mgr.x:Started 2024-09-17T01:31:29.173 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-17T01:31:29.174 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-17T01:31:29.177 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-17T01:31:29.177 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-17T01:31:29.223 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-17T01:31:29.223 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-17T01:31:29.269 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-17T01:31:29.269 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-17T01:31:29.317 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-17T01:31:29.317 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-17T01:31:29.366 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-17T01:31:29.366 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-17T01:31:29.411 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-17T01:31:29.411 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-17T01:31:29.459 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-17T01:31:29.459 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-17T01:31:29.506 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-17T01:31:29.506 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-17T01:31:29.557 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-17T01:31:29.557 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-17T01:31:29.610 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-17T01:31:29.611 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-17T01:31:29.658 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-17T01:31:29.658 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-17T01:31:29.707 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-17T01:31:29.708 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-17T01:31:29.754 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-17T01:31:29.755 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-17T01:31:29.806 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-17T01:31:29.806 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-17T01:31:29.855 INFO:tasks.ceph:setting config [mgr] client_mount_timeout = 30 2024-09-17T01:31:29.856 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set mgr client_mount_timeout 30 2024-09-17T01:31:29.902 INFO:tasks.ceph:setting config [mgr] debug_client = 20 2024-09-17T01:31:29.903 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set mgr debug_client 20 2024-09-17T01:31:29.952 INFO:tasks.ceph:setting config [mgr] debug_mgr = 20 2024-09-17T01:31:29.952 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set mgr debug_mgr 20 2024-09-17T01:31:30.006 INFO:tasks.ceph:setting config [mgr] debug_ms = 1 2024-09-17T01:31:30.006 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set mgr debug_ms 1 2024-09-17T01:31:30.056 INFO:tasks.ceph:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-17T01:31:30.057 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set mgr mon_warn_on_pool_no_app False 2024-09-17T01:31:30.105 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-17T01:31:30.106 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-17T01:31:30.156 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-17T01:31:30.157 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-17T01:31:30.206 DEBUG:tasks.ceph:set 22 configs 2024-09-17T01:31:30.207 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi042') 2024-09-17T01:31:39.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.901+0000 7f8d33400640 1 -- 172.21.15.42:0/2009103248 <== mon.2 v2:172.21.15.43:3301/0 9 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v7)=0 v7) ==== 109+0+0 (secure 0 0 0) 0x7f8d2401fd20 con 0x7f8d1c0039e0 2024-09-17T01:31:39.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.919+0000 7f8d41a00640 1 -- 172.21.15.42:0/2009103248 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d1c0039e0 msgr2=0x7f8d3c0b5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:39.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.919+0000 7f8d41a00640 1 --2- 172.21.15.42:0/2009103248 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d1c0039e0 0x7f8d3c0b5510 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8d24011930 tx=0x7f8d240107a0 comp rx=0 tx=0).stop 2024-09-17T01:31:39.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.919+0000 7f8d41a00640 1 -- 172.21.15.42:0/2009103248 shutdown_connections 2024-09-17T01:31:39.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.919+0000 7f8d41a00640 1 --2- 172.21.15.42:0/2009103248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d1c004db0 0x7f8d3c0b5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:39.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.919+0000 7f8d41a00640 1 --2- 172.21.15.42:0/2009103248 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d1c0039e0 0x7f8d3c0b5510 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:39.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.919+0000 7f8d41a00640 1 --2- 172.21.15.42:0/2009103248 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d1800a150 0x7f8d3c14bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:39.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.919+0000 7f8d41a00640 1 -- 172.21.15.42:0/2009103248 >> 172.21.15.42:0/2009103248 conn(0x7f8d3c06d140 msgr2=0x7f8d3c1564c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:39.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.910+0000 7fc7ebe00640 1 -- 172.21.15.42:0/3456518734 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fc7b8005100 con 0x7fc7cc004800 2024-09-17T01:31:39.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.915+0000 7fa63be00640 1 -- 172.21.15.42:0/70813483 <== mon.1 v2:172.21.15.43:3300/0 9 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v8)=0 v8) ==== 119+0+0 (secure 0 0 0) 0x7fa63c026ac0 con 0x7fa628003a00 2024-09-17T01:31:39.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.927+0000 7f8d41a00640 1 -- 172.21.15.42:0/2009103248 shutdown_connections 2024-09-17T01:31:39.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.924+0000 7f28eea00640 1 -- 172.21.15.42:0/4118748231 <== mon.0 v2:172.21.15.42:3300/0 9 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v9)=0 v9) ==== 121+0+0 (secure 0 0 0) 0x7f28e0003b30 con 0x7f28f80d1a10 2024-09-17T01:31:39.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.928+0000 7fa64b000640 1 -- 172.21.15.42:0/70813483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa628003a00 msgr2=0x7fa6441f0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:39.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.928+0000 7fa64b000640 1 --2- 172.21.15.42:0/70813483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa628003a00 0x7fa6441f0540 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa63c01c760 tx=0x7fa63c01c850 comp rx=0 tx=0).stop 2024-09-17T01:31:39.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.928+0000 7fa64b000640 1 -- 172.21.15.42:0/70813483 shutdown_connections 2024-09-17T01:31:39.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.928+0000 7fa64b000640 1 --2- 172.21.15.42:0/70813483 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa644151c50 0x7fa64406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:39.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.928+0000 7fa64b000640 1 --2- 172.21.15.42:0/70813483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa628004800 0x7fa64413c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:39.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.928+0000 7fa64b000640 1 --2- 172.21.15.42:0/70813483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa628003a00 0x7fa6441f0540 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa63c01c760 tx=0x7fa63c01c850 comp rx=0 tx=0).stop 2024-09-17T01:31:39.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.928+0000 7fa64b000640 1 -- 172.21.15.42:0/70813483 >> 172.21.15.42:0/70813483 conn(0x7fa6440b25b0 msgr2=0x7fa64415d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:39.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.934+0000 7ff757e00640 1 -- 172.21.15.42:0/1043372693 <== mon.1 v2:172.21.15.43:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v10)=0 v10) ==== 106+0+0 (secure 0 0 0) 0x7ff750019040 con 0x7ff740003670 2024-09-17T01:31:39.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.931+0000 7f28e7e00640 1 -- 172.21.15.42:0/4118748231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28f80d1a10 msgr2=0x7f28f80726c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:39.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.931+0000 7f28e7e00640 1 --2- 172.21.15.42:0/4118748231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28f80d1a10 0x7f28f80726c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f28f80b78b0 tx=0x7f28e0011a70 comp rx=0 tx=0).stop 2024-09-17T01:31:39.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.932+0000 7f28e7e00640 1 -- 172.21.15.42:0/4118748231 shutdown_connections 2024-09-17T01:31:39.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.932+0000 7f28e7e00640 1 --2- 172.21.15.42:0/4118748231 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28dc004e60 0x7f28f8072180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:39.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.932+0000 7f28e7e00640 1 --2- 172.21.15.42:0/4118748231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28f80d1a10 0x7f28f80726c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:39.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.932+0000 7f28e7e00640 1 --2- 172.21.15.42:0/4118748231 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28dc0039b0 0x7f28f8157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:39.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.932+0000 7f28e7e00640 1 -- 172.21.15.42:0/4118748231 >> 172.21.15.42:0/4118748231 conn(0x7f28f806cf00 msgr2=0x7f28f80d4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:39.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.935+0000 7f8d41a00640 1 -- 172.21.15.42:0/2009103248 wait complete. 2024-09-17T01:31:39.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.936+0000 7f28e7e00640 1 -- 172.21.15.42:0/4118748231 shutdown_connections 2024-09-17T01:31:39.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.936+0000 7f28e7e00640 1 -- 172.21.15.42:0/4118748231 wait complete. 2024-09-17T01:31:39.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.936+0000 7fa64b000640 1 -- 172.21.15.42:0/70813483 shutdown_connections 2024-09-17T01:31:39.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.937+0000 7fa64b000640 1 -- 172.21.15.42:0/70813483 wait complete. 2024-09-17T01:31:39.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.939+0000 7ff766e00640 1 -- 172.21.15.42:0/1043372693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff740003670 msgr2=0x7ff7600b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:39.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.939+0000 7ff766e00640 1 --2- 172.21.15.42:0/1043372693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff740003670 0x7ff7600b1750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff750012b40 tx=0x7ff75000f800 comp rx=0 tx=0).stop 2024-09-17T01:31:39.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.935+0000 7f5773200640 1 -- 172.21.15.42:0/1693198626 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f576c070df0 con 0x7f5750003be0 2024-09-17T01:31:39.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.950+0000 7ff766e00640 1 -- 172.21.15.42:0/1043372693 shutdown_connections 2024-09-17T01:31:39.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.950+0000 7ff766e00640 1 --2- 172.21.15.42:0/1043372693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff744004800 0x7ff760152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:39.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.950+0000 7ff766e00640 1 --2- 172.21.15.42:0/1043372693 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff7440039b0 0x7ff7601572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:39.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.950+0000 7ff766e00640 1 --2- 172.21.15.42:0/1043372693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff740003670 0x7ff7600b1750 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:39.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.950+0000 7ff766e00640 1 -- 172.21.15.42:0/1043372693 >> 172.21.15.42:0/1043372693 conn(0x7ff7600b2930 msgr2=0x7ff760073230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:39.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.950+0000 7ff766e00640 1 -- 172.21.15.42:0/1043372693 shutdown_connections 2024-09-17T01:31:39.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.951+0000 7ff766e00640 1 -- 172.21.15.42:0/1043372693 wait complete. 2024-09-17T01:31:39.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.948+0000 7f2f16000640 1 -- 172.21.15.42:0/2806813891 <== mon.1 v2:172.21.15.43:3300/0 9 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v11)=0 v11) ==== 120+0+0 (secure 0 0 0) 0x7f2f0c019040 con 0x7f2f040039b0 2024-09-17T01:31:39.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.953+0000 7f2f25000640 1 -- 172.21.15.42:0/2806813891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f040039b0 msgr2=0x7f2f200b0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:39.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.953+0000 7f2f25000640 1 --2- 172.21.15.42:0/2806813891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f040039b0 0x7f2f200b0110 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2f04010870 tx=0x7f2f0c0046c0 comp rx=0 tx=0).stop 2024-09-17T01:31:39.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.953+0000 7f2f25000640 1 -- 172.21.15.42:0/2806813891 shutdown_connections 2024-09-17T01:31:39.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.953+0000 7f2f25000640 1 --2- 172.21.15.42:0/2806813891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f040050e0 0x7f2f20201040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:39.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.953+0000 7f2f25000640 1 --2- 172.21.15.42:0/2806813891 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f04004340 0x7f2f200b0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:39.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.953+0000 7f2f25000640 1 --2- 172.21.15.42:0/2806813891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f040039b0 0x7f2f200b0110 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:39.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.953+0000 7f2f25000640 1 -- 172.21.15.42:0/2806813891 >> 172.21.15.42:0/2806813891 conn(0x7f2f200b2930 msgr2=0x7f2f201536d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:39.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.954+0000 7f2f25000640 1 -- 172.21.15.42:0/2806813891 shutdown_connections 2024-09-17T01:31:39.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.954+0000 7f2f25000640 1 -- 172.21.15.42:0/2806813891 wait complete. 2024-09-17T01:31:39.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.975+0000 7f9e96000640 1 -- 172.21.15.42:0/3092257006 <== mon.0 v2:172.21.15.42:3300/0 9 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v12)=0 v12) ==== 115+0+0 (secure 0 0 0) 0x7f9e8c003a90 con 0x7f9e84004800 2024-09-17T01:31:39.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.980+0000 7f1bf1600640 1 -- 172.21.15.42:0/4088198823 <== mon.2 v2:172.21.15.43:3301/0 9 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v13)=0 v13) ==== 120+0+0 (secure 0 0 0) 0x7f1be8018070 con 0x7f1bd4011e90 2024-09-17T01:31:39.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.983+0000 7f805fe00640 1 -- 172.21.15.42:0/160220528 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f80340050e0 con 0x7f8044005270 2024-09-17T01:31:39.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.984+0000 7f1be6a00640 1 -- 172.21.15.42:0/4088198823 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bd4011e90 msgr2=0x7f1bf414b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:39.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.984+0000 7f1be6a00640 1 --2- 172.21.15.42:0/4088198823 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bd4011e90 0x7f1bf414b5d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4003ab0 tx=0x7f1be8013f10 comp rx=0 tx=0).stop 2024-09-17T01:31:39.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.985+0000 7f37f6600640 1 -- 172.21.15.42:0/3697788500 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f37c40050e0 con 0x7f37f0071c20 2024-09-17T01:31:39.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.988+0000 7f1be6a00640 1 -- 172.21.15.42:0/4088198823 shutdown_connections 2024-09-17T01:31:39.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.988+0000 7f1be6a00640 1 --2- 172.21.15.42:0/4088198823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bdc0039b0 0x7f1bf415aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:39.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.988+0000 7f1be6a00640 1 --2- 172.21.15.42:0/4088198823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bdc004800 0x7f1bf40ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:39.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.988+0000 7f1be6a00640 1 --2- 172.21.15.42:0/4088198823 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bd4011e90 0x7f1bf414b5d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:39.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.988+0000 7f1be6a00640 1 -- 172.21.15.42:0/4088198823 >> 172.21.15.42:0/4088198823 conn(0x7f1bf40d0110 msgr2=0x7f1bf4074840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:39.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.989+0000 7f1be6a00640 1 -- 172.21.15.42:0/4088198823 shutdown_connections 2024-09-17T01:31:39.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.989+0000 7f1be6a00640 1 -- 172.21.15.42:0/4088198823 wait complete. 2024-09-17T01:31:39.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.989+0000 7f9ea4c00640 1 -- 172.21.15.42:0/3092257006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e84004800 msgr2=0x7f9ea01f5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:39.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.989+0000 7f9ea4c00640 1 --2- 172.21.15.42:0/3092257006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e84004800 0x7f9ea01f5f10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c005d00 tx=0x7f9e8c0046c0 comp rx=0 tx=0).stop 2024-09-17T01:31:39.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.989+0000 7f9ea4c00640 1 -- 172.21.15.42:0/3092257006 shutdown_connections 2024-09-17T01:31:39.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.989+0000 7f9ea4c00640 1 --2- 172.21.15.42:0/3092257006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e84005330 0x7f9ea0159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:39.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.989+0000 7f9ea4c00640 1 --2- 172.21.15.42:0/3092257006 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ea014c4d0 0x7f9ea0150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:39.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.989+0000 7f9ea4c00640 1 --2- 172.21.15.42:0/3092257006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e84004800 0x7f9ea01f5f10 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c005d00 tx=0x7f9e8c0046c0 comp rx=0 tx=0).stop 2024-09-17T01:31:39.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.989+0000 7f9ea4c00640 1 -- 172.21.15.42:0/3092257006 >> 172.21.15.42:0/3092257006 conn(0x7f9ea00b25b0 msgr2=0x7f9ea00b4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:39.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.990+0000 7f9ea4c00640 1 -- 172.21.15.42:0/3092257006 shutdown_connections 2024-09-17T01:31:39.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:39.990+0000 7f9ea4c00640 1 -- 172.21.15.42:0/3092257006 wait complete. 2024-09-17T01:31:40.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.010+0000 7fd1cb800640 1 -- 172.21.15.42:0/4114045234 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7fd198005100 con 0x7fd1a40078c0 2024-09-17T01:31:40.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.006+0000 7f6016a00640 1 -- 172.21.15.42:0/665461685 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f5fe80050e0 con 0x7f5ff80039b0 2024-09-17T01:31:40.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.011+0000 7fd8cb400640 1 -- 172.21.15.42:0/1749750536 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fd8e00d0c30 con 0x7fd8c00057b0 2024-09-17T01:31:40.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.013+0000 7fa946200640 1 -- 172.21.15.42:0/2514935498 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fa914005100 con 0x7fa920008f00 2024-09-17T01:31:40.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.021+0000 7f6936a00640 1 -- 172.21.15.42:0/1457372736 <== mon.2 v2:172.21.15.43:3301/0 9 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v14)=0 v14) ==== 121+0+0 (secure 0 0 0) 0x7f69400cabb0 con 0x7f69400ca7a0 2024-09-17T01:31:40.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.023+0000 7fd8d6000640 1 -- 172.21.15.42:0/1749750536 <== mon.2 v2:172.21.15.43:3301/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7fd8d0024670 con 0x7fd8c00057b0 2024-09-17T01:31:40.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.023+0000 7f692f400640 1 -- 172.21.15.42:0/1457372736 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69400ca7a0 msgr2=0x7f69400c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:40.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.023+0000 7f692f400640 1 --2- 172.21.15.42:0/1457372736 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69400ca7a0 0x7f69400c80e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6938005fd0 tx=0x7f6938012e80 comp rx=0 tx=0).stop 2024-09-17T01:31:40.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.023+0000 7fc7e1600640 1 -- 172.21.15.42:0/3456518734 <== mon.2 v2:172.21.15.43:3301/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7fc7dc058020 con 0x7fc7cc004800 2024-09-17T01:31:40.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.024+0000 7fd1c0c00640 1 -- 172.21.15.42:0/4114045234 <== mon.0 v2:172.21.15.42:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7fd1b8003a90 con 0x7fd1a40078c0 2024-09-17T01:31:40.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.024+0000 7f600d600640 1 -- 172.21.15.42:0/665461685 <== mon.2 v2:172.21.15.43:3301/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f600002a440 con 0x7f5ff80039b0 2024-09-17T01:31:40.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.024+0000 7f37e7400640 1 -- 172.21.15.42:0/3697788500 <== mon.0 v2:172.21.15.42:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f37dc049d20 con 0x7f37f0071c20 2024-09-17T01:31:40.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.026+0000 7fa93cc00640 1 -- 172.21.15.42:0/2514935498 <== mon.2 v2:172.21.15.43:3301/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7fa92c0047a0 con 0x7fa920008f00 2024-09-17T01:31:40.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.026+0000 7faf88c00640 1 -- 172.21.15.42:0/4100916808 <== mon.0 v2:172.21.15.42:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7faf80020a80 con 0x7faf8c15d440 2024-09-17T01:31:40.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.026+0000 7f8056a00640 1 -- 172.21.15.42:0/160220528 <== mon.1 v2:172.21.15.43:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f805804a460 con 0x7f8044005270 2024-09-17T01:31:40.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.026+0000 7f5763e00640 1 -- 172.21.15.42:0/1693198626 <== mon.1 v2:172.21.15.43:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f575c025780 con 0x7f5750003be0 2024-09-17T01:31:40.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.030+0000 7fc7e1600640 1 -- 172.21.15.42:0/3456518734 <== mon.2 v2:172.21.15.43:3301/0 10 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v15)=0 v15) ==== 123+0+0 (secure 0 0 0) 0x7fc7dc050020 con 0x7fc7cc004800 2024-09-17T01:31:40.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.032+0000 7f5763e00640 1 -- 172.21.15.42:0/1693198626 <== mon.1 v2:172.21.15.43:3300/0 10 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v16)=0 v16) ==== 125+0+0 (secure 0 0 0) 0x7f575c001790 con 0x7f5750003be0 2024-09-17T01:31:40.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.031+0000 7f692f400640 1 -- 172.21.15.42:0/1457372736 shutdown_connections 2024-09-17T01:31:40.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.034+0000 7f5773200640 1 -- 172.21.15.42:0/1693198626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5750003be0 msgr2=0x7f576c1521e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:40.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.034+0000 7f5773200640 1 --2- 172.21.15.42:0/1693198626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5750003be0 0x7f576c1521e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f575c000f60 tx=0x7f575c013820 comp rx=0 tx=0).stop 2024-09-17T01:31:40.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.034+0000 7f692f400640 1 --2- 172.21.15.42:0/1457372736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f694015b8a0 0x7f69400ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.034+0000 7f692f400640 1 --2- 172.21.15.42:0/1457372736 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69400ca7a0 0x7f69400c80e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.034+0000 7f692f400640 1 --2- 172.21.15.42:0/1457372736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f691c004800 0x7f694015b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.035+0000 7f5773200640 1 -- 172.21.15.42:0/1693198626 shutdown_connections 2024-09-17T01:31:40.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.035+0000 7f5773200640 1 --2- 172.21.15.42:0/1693198626 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57500099b0 0x7f576c0b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.035+0000 7f5773200640 1 --2- 172.21.15.42:0/1693198626 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5750004800 0x7f576c0b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.035+0000 7f5773200640 1 --2- 172.21.15.42:0/1693198626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5750003be0 0x7f576c1521e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.035+0000 7f5773200640 1 -- 172.21.15.42:0/1693198626 >> 172.21.15.42:0/1693198626 conn(0x7f576c0b42a0 msgr2=0x7f576c0b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:40.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.035+0000 7f692f400640 1 -- 172.21.15.42:0/1457372736 >> 172.21.15.42:0/1457372736 conn(0x7f69400d1210 msgr2=0x7f69401624f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:40.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.035+0000 7f5773200640 1 -- 172.21.15.42:0/1693198626 shutdown_connections 2024-09-17T01:31:40.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.035+0000 7f5773200640 1 -- 172.21.15.42:0/1693198626 wait complete. 2024-09-17T01:31:40.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.034+0000 7fc7ebe00640 1 -- 172.21.15.42:0/3456518734 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc7cc004800 msgr2=0x7fc7e414edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:40.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.034+0000 7fc7ebe00640 1 --2- 172.21.15.42:0/3456518734 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc7cc004800 0x7fc7e414edc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc02c420 tx=0x7fc7dc004a40 comp rx=0 tx=0).stop 2024-09-17T01:31:40.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.035+0000 7fc7ebe00640 1 -- 172.21.15.42:0/3456518734 shutdown_connections 2024-09-17T01:31:40.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.035+0000 7fc7ebe00640 1 --2- 172.21.15.42:0/3456518734 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc7cc004800 0x7fc7e414edc0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.035+0000 7fc7ebe00640 1 --2- 172.21.15.42:0/3456518734 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc7cc0039b0 0x7fc7e41561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.035+0000 7fc7ebe00640 1 --2- 172.21.15.42:0/3456518734 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7c4005b70 0x7fc7e4149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.035+0000 7fc7ebe00640 1 -- 172.21.15.42:0/3456518734 >> 172.21.15.42:0/3456518734 conn(0x7fc7e406d140 msgr2=0x7fc7e4159c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:40.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.036+0000 7fc7ebe00640 1 -- 172.21.15.42:0/3456518734 shutdown_connections 2024-09-17T01:31:40.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.036+0000 7fc7ebe00640 1 -- 172.21.15.42:0/3456518734 wait complete. 2024-09-17T01:31:40.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.036+0000 7f692f400640 1 -- 172.21.15.42:0/1457372736 shutdown_connections 2024-09-17T01:31:40.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.036+0000 7f692f400640 1 -- 172.21.15.42:0/1457372736 wait complete. 2024-09-17T01:31:40.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.036+0000 7f37e7400640 1 -- 172.21.15.42:0/3697788500 <== mon.0 v2:172.21.15.42:3300/0 10 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v17)=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7f37dc0408b0 con 0x7f37f0071c20 2024-09-17T01:31:40.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.039+0000 7f37f6600640 1 -- 172.21.15.42:0/3697788500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37f0071c20 msgr2=0x7f37f0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:40.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.040+0000 7f37f6600640 1 --2- 172.21.15.42:0/3697788500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37f0071c20 0x7f37f0070630 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f37dc02c410 tx=0x7f37dc001120 comp rx=0 tx=0).stop 2024-09-17T01:31:40.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.040+0000 7f37f6600640 1 -- 172.21.15.42:0/3697788500 shutdown_connections 2024-09-17T01:31:40.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.040+0000 7f37f6600640 1 --2- 172.21.15.42:0/3697788500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37f0072030 0x7f37f0158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.040+0000 7f37f6600640 1 --2- 172.21.15.42:0/3697788500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37f0071c20 0x7f37f0070630 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.040+0000 7f37f6600640 1 --2- 172.21.15.42:0/3697788500 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f37f0155e70 0x7f37f01558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.040+0000 7f37f6600640 1 -- 172.21.15.42:0/3697788500 >> 172.21.15.42:0/3697788500 conn(0x7f37f006cd20 msgr2=0x7f37f0157980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:40.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.042+0000 7fa93cc00640 1 -- 172.21.15.42:0/2514935498 <== mon.2 v2:172.21.15.43:3301/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fa92c0047a0 con 0x7fa920008f00 2024-09-17T01:31:40.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.042+0000 7f37f6600640 1 -- 172.21.15.42:0/3697788500 shutdown_connections 2024-09-17T01:31:40.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.043+0000 7f37f6600640 1 -- 172.21.15.42:0/3697788500 wait complete. 2024-09-17T01:31:40.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.043+0000 7fd8d6000640 1 -- 172.21.15.42:0/1749750536 <== mon.2 v2:172.21.15.43:3301/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fd8d0024670 con 0x7fd8c00057b0 2024-09-17T01:31:40.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.043+0000 7fd1c0c00640 1 -- 172.21.15.42:0/4114045234 <== mon.0 v2:172.21.15.42:3300/0 10 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v18)=0 v18) ==== 123+0+0 (secure 0 0 0) 0x7fd1b8003cc0 con 0x7fd1a40078c0 2024-09-17T01:31:40.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.044+0000 7faf88c00640 1 -- 172.21.15.42:0/4100916808 <== mon.0 v2:172.21.15.42:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7faf80020d20 con 0x7faf8c15d440 2024-09-17T01:31:40.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.044+0000 7f8056a00640 1 -- 172.21.15.42:0/160220528 <== mon.1 v2:172.21.15.43:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f805803ead0 con 0x7f8044005270 2024-09-17T01:31:40.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.044+0000 7fd1c0c00640 1 -- 172.21.15.42:0/4114045234 <== mon.0 v2:172.21.15.42:3300/0 11 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fd1b8003a90 con 0x7fd1a40078c0 2024-09-17T01:31:40.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.046+0000 7fd1cb800640 1 -- 172.21.15.42:0/4114045234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1a40078c0 msgr2=0x7fd1c4151dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:40.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.046+0000 7fd1cb800640 1 --2- 172.21.15.42:0/4114045234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1a40078c0 0x7fd1c4151dc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8005f10 tx=0x7fd1b80107a0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.046+0000 7fd1cb800640 1 -- 172.21.15.42:0/4114045234 shutdown_connections 2024-09-17T01:31:40.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.046+0000 7fd1cb800640 1 --2- 172.21.15.42:0/4114045234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1ac004800 0x7fd1c41f40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.046+0000 7fd1cb800640 1 --2- 172.21.15.42:0/4114045234 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd1ac0039b0 0x7fd1c4160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.046+0000 7fd1cb800640 1 --2- 172.21.15.42:0/4114045234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1a40078c0 0x7fd1c4151dc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.046+0000 7fd1cb800640 1 -- 172.21.15.42:0/4114045234 >> 172.21.15.42:0/4114045234 conn(0x7fd1c406d140 msgr2=0x7fd1c40b9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:40.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.047+0000 7fd1cb800640 1 -- 172.21.15.42:0/4114045234 shutdown_connections 2024-09-17T01:31:40.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.047+0000 7fd1cb800640 1 -- 172.21.15.42:0/4114045234 wait complete. 2024-09-17T01:31:40.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.044+0000 7f600d600640 1 -- 172.21.15.42:0/665461685 <== mon.2 v2:172.21.15.43:3301/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f600002a5f0 con 0x7f5ff80039b0 2024-09-17T01:31:40.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.055+0000 7f8056a00640 1 -- 172.21.15.42:0/160220528 <== mon.1 v2:172.21.15.43:3300/0 11 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v19)=0 v19) ==== 108+0+0 (secure 0 0 0) 0x7f805803ed70 con 0x7f8044005270 2024-09-17T01:31:40.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.057+0000 7f805fe00640 1 -- 172.21.15.42:0/160220528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8044005270 msgr2=0x7f80600ca6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:40.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.057+0000 7f805fe00640 1 --2- 172.21.15.42:0/160220528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8044005270 0x7f80600ca6e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8058035040 tx=0x7f80580014a0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.060+0000 7f805fe00640 1 -- 172.21.15.42:0/160220528 shutdown_connections 2024-09-17T01:31:40.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.060+0000 7f805fe00640 1 --2- 172.21.15.42:0/160220528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8044005270 0x7f80600ca6e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.060+0000 7f805fe00640 1 --2- 172.21.15.42:0/160220528 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8044004800 0x7f80601616d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.061+0000 7f805fe00640 1 --2- 172.21.15.42:0/160220528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f80440039b0 0x7f80601f6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.061+0000 7f805fe00640 1 -- 172.21.15.42:0/160220528 >> 172.21.15.42:0/160220528 conn(0x7f80600d1210 msgr2=0x7f80600d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:40.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.061+0000 7f805fe00640 1 -- 172.21.15.42:0/160220528 shutdown_connections 2024-09-17T01:31:40.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.061+0000 7f805fe00640 1 -- 172.21.15.42:0/160220528 wait complete. 2024-09-17T01:31:40.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.069+0000 7f600d600640 1 -- 172.21.15.42:0/665461685 <== mon.2 v2:172.21.15.43:3301/0 11 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v20)=0 v20) ==== 119+0+0 (secure 0 0 0) 0x7f600001a040 con 0x7f5ff80039b0 2024-09-17T01:31:40.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.070+0000 7faf93c00640 1 -- 172.21.15.42:0/4100916808 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7faf600050e0 con 0x7faf8c15d440 2024-09-17T01:31:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.074+0000 7fd8d6000640 1 -- 172.21.15.42:0/1749750536 <== mon.2 v2:172.21.15.43:3301/0 11 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v21)=0 v21) ==== 122+0+0 (secure 0 0 0) 0x7fd8d0029020 con 0x7fd8c00057b0 2024-09-17T01:31:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.078+0000 7f5ffea00640 1 -- 172.21.15.42:0/665461685 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ff80039b0 msgr2=0x7f601014f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:40.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.078+0000 7f5ffea00640 1 --2- 172.21.15.42:0/665461685 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ff80039b0 0x7f601014f230 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4006620 tx=0x7f6000013820 comp rx=0 tx=0).stop 2024-09-17T01:31:40.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.079+0000 7f5ffea00640 1 -- 172.21.15.42:0/665461685 shutdown_connections 2024-09-17T01:31:40.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.079+0000 7f5ffea00640 1 --2- 172.21.15.42:0/665461685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ff8005350 0x7f60100c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.079+0000 7f5ffea00640 1 --2- 172.21.15.42:0/665461685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ff8004800 0x7f60100cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.079+0000 7f5ffea00640 1 --2- 172.21.15.42:0/665461685 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ff80039b0 0x7f601014f230 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.079+0000 7f5ffea00640 1 -- 172.21.15.42:0/665461685 >> 172.21.15.42:0/665461685 conn(0x7f60100d1210 msgr2=0x7f60100b54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:40.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.078+0000 7fd8d6000640 1 -- 172.21.15.42:0/1749750536 <== mon.2 v2:172.21.15.43:3301/0 12 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8d001abd0 con 0x7fd8c00057b0 2024-09-17T01:31:40.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.079+0000 7faf88c00640 1 -- 172.21.15.42:0/4100916808 <== mon.0 v2:172.21.15.42:3300/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf800124b0 con 0x7faf8c15d440 2024-09-17T01:31:40.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.080+0000 7f5ffea00640 1 -- 172.21.15.42:0/665461685 shutdown_connections 2024-09-17T01:31:40.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.081+0000 7f5ffea00640 1 -- 172.21.15.42:0/665461685 wait complete. 2024-09-17T01:31:40.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.083+0000 7fa93cc00640 1 -- 172.21.15.42:0/2514935498 <== mon.2 v2:172.21.15.43:3301/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa92c004950 con 0x7fa920008f00 2024-09-17T01:31:40.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.083+0000 7fa93cc00640 1 -- 172.21.15.42:0/2514935498 <== mon.2 v2:172.21.15.43:3301/0 12 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v22)=0 v22) ==== 123+0+0 (secure 0 0 0) 0x7fa92c02e020 con 0x7fa920008f00 2024-09-17T01:31:40.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.083+0000 7fd8cb400640 1 -- 172.21.15.42:0/1749750536 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd8c00057b0 msgr2=0x7fd8e0091d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:40.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.083+0000 7fd8cb400640 1 --2- 172.21.15.42:0/1749750536 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd8c00057b0 0x7fd8e0091d90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00072e0 tx=0x7fd8d000c3d0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.084+0000 7fd8cb400640 1 -- 172.21.15.42:0/1749750536 shutdown_connections 2024-09-17T01:31:40.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.084+0000 7fd8cb400640 1 --2- 172.21.15.42:0/1749750536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8e0206110 0x7fd8e016bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.084+0000 7fd8cb400640 1 --2- 172.21.15.42:0/1749750536 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8e0209a50 0x7fd8e0205bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.084+0000 7fd8cb400640 1 --2- 172.21.15.42:0/1749750536 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd8c00057b0 0x7fd8e0091d90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.084+0000 7fd8cb400640 1 -- 172.21.15.42:0/1749750536 >> 172.21.15.42:0/1749750536 conn(0x7fd8e00d0110 msgr2=0x7fd8e00b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:40.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.085+0000 7fd8cb400640 1 -- 172.21.15.42:0/1749750536 shutdown_connections 2024-09-17T01:31:40.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.085+0000 7fd8cb400640 1 -- 172.21.15.42:0/1749750536 wait complete. 2024-09-17T01:31:40.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.089+0000 7fa946200640 1 -- 172.21.15.42:0/2514935498 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa920008f00 msgr2=0x7fa940153ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:40.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.089+0000 7fa946200640 1 --2- 172.21.15.42:0/2514935498 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa920008f00 0x7fa940153ef0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa92c011880 tx=0x7fa92c011d40 comp rx=0 tx=0).stop 2024-09-17T01:31:40.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.089+0000 7fa946200640 1 -- 172.21.15.42:0/2514935498 shutdown_connections 2024-09-17T01:31:40.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.089+0000 7fa946200640 1 --2- 172.21.15.42:0/2514935498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa924004d90 0x7fa94015d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.089+0000 7fa946200640 1 --2- 172.21.15.42:0/2514935498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa924003fc0 0x7fa94015cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.089+0000 7faf88c00640 1 -- 172.21.15.42:0/4100916808 <== mon.0 v2:172.21.15.42:3300/0 12 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v23)=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7faf800128a0 con 0x7faf8c15d440 2024-09-17T01:31:40.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.089+0000 7fa946200640 1 --2- 172.21.15.42:0/2514935498 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa920008f00 0x7fa940153ef0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.089+0000 7fa946200640 1 -- 172.21.15.42:0/2514935498 >> 172.21.15.42:0/2514935498 conn(0x7fa9400d1100 msgr2=0x7fa9400b8280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:40.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.089+0000 7fa946200640 1 -- 172.21.15.42:0/2514935498 shutdown_connections 2024-09-17T01:31:40.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.089+0000 7fa946200640 1 -- 172.21.15.42:0/2514935498 wait complete. 2024-09-17T01:31:40.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.096+0000 7faf93c00640 1 -- 172.21.15.42:0/4100916808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf8c15d440 msgr2=0x7faf8c15d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:40.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.096+0000 7faf93c00640 1 --2- 172.21.15.42:0/4100916808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf8c15d440 0x7faf8c15d850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faf8c06e840 tx=0x7faf80014b30 comp rx=0 tx=0).stop 2024-09-17T01:31:40.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.096+0000 7faf93c00640 1 -- 172.21.15.42:0/4100916808 shutdown_connections 2024-09-17T01:31:40.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.096+0000 7faf93c00640 1 --2- 172.21.15.42:0/4100916808 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faf8c1536a0 0x7faf8c153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.096+0000 7faf93c00640 1 --2- 172.21.15.42:0/4100916808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf8c15d440 0x7faf8c15d850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.096+0000 7faf93c00640 1 --2- 172.21.15.42:0/4100916808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf8c1498b0 0x7faf8c1fcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.096+0000 7faf93c00640 1 -- 172.21.15.42:0/4100916808 >> 172.21.15.42:0/4100916808 conn(0x7faf8c0b2930 msgr2=0x7faf8c15e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:40.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.099+0000 7faf93c00640 1 -- 172.21.15.42:0/4100916808 shutdown_connections 2024-09-17T01:31:40.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.099+0000 7faf93c00640 1 -- 172.21.15.42:0/4100916808 wait complete. 2024-09-17T01:31:40.106 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi042') 2024-09-17T01:31:40.106 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi042') 2024-09-17T01:31:40.106 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi042') 2024-09-17T01:31:40.137 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi042') 2024-09-17T01:31:40.137 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi042') 2024-09-17T01:31:40.137 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi042') 2024-09-17T01:31:40.137 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi042') 2024-09-17T01:31:40.138 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi042') 2024-09-17T01:31:40.138 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi042') 2024-09-17T01:31:40.138 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi042') 2024-09-17T01:31:40.146 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi042') 2024-09-17T01:31:40.146 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi042') 2024-09-17T01:31:40.146 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi042') 2024-09-17T01:31:40.146 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi042') 2024-09-17T01:31:40.146 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi042') 2024-09-17T01:31:40.146 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi042') 2024-09-17T01:31:40.146 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi042') 2024-09-17T01:31:40.147 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi042') 2024-09-17T01:31:40.147 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi042') 2024-09-17T01:31:40.147 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi042') 2024-09-17T01:31:40.147 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi042') 2024-09-17T01:31:40.147 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config dump 2024-09-17T01:31:40.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.411+0000 7f158e000640 1 -- 172.21.15.42:0/2213797841 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15880b3550 msgr2=0x7f158815cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:40.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.411+0000 7f158e000640 1 --2- 172.21.15.42:0/2213797841 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15880b3550 0x7f158815cec0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1578005fd0 tx=0x7f157802a540 comp rx=0 tx=0).stop 2024-09-17T01:31:40.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.411+0000 7f158e000640 1 -- 172.21.15.42:0/2213797841 shutdown_connections 2024-09-17T01:31:40.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.411+0000 7f158e000640 1 --2- 172.21.15.42:0/2213797841 >> v2:172.21.15.43:3300/0 conn(0x7f1588142f40 0x7f1588072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.411+0000 7f158e000640 1 --2- 172.21.15.42:0/2213797841 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15880b3550 0x7f158815cec0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.411+0000 7f158e000640 1 -- 172.21.15.42:0/2213797841 >> 172.21.15.42:0/2213797841 conn(0x7f15880b2930 msgr2=0x7f158806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:40.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.411+0000 7f158e000640 1 -- 172.21.15.42:0/2213797841 shutdown_connections 2024-09-17T01:31:40.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.411+0000 7f158e000640 1 -- 172.21.15.42:0/2213797841 wait complete. 2024-09-17T01:31:40.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.414+0000 7f158e000640 1 Processor -- start 2024-09-17T01:31:40.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.414+0000 7f158e000640 1 -- start start 2024-09-17T01:31:40.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.415+0000 7f158e000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1588072e90 0x7f1588156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:40.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.415+0000 7f158e000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15880b3550 0x7f158813e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:40.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.415+0000 7f158e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1588142f40 0x7f15880aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:40.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.415+0000 7f158e000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f158806d640 con 0x7f1588142f40 2024-09-17T01:31:40.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.415+0000 7f158e000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f158815d680 con 0x7f1588072e90 2024-09-17T01:31:40.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.415+0000 7f158e000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f158806d7c0 con 0x7f15880b3550 2024-09-17T01:31:40.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.416+0000 7f1587400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1588072e90 0x7f1588156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:40.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.416+0000 7f157fe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15880b3550 0x7f158813e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:40.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.416+0000 7f157fe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15880b3550 0x7f158813e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:47092/0 (socket says 172.21.15.42:47092) 2024-09-17T01:31:40.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.416+0000 7f1587400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1588072e90 0x7f1588156cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:49060/0 (socket says 172.21.15.42:49060) 2024-09-17T01:31:40.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.416+0000 7f157fe00640 1 -- 172.21.15.42:0/3557645908 learned_addr learned my addr 172.21.15.42:0/3557645908 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:31:40.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.416+0000 7f1587e00640 1 --2- 172.21.15.42:0/3557645908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1588142f40 0x7f15880aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:40.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.416+0000 7f157fe00640 1 -- 172.21.15.42:0/3557645908 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1588072e90 msgr2=0x7f1588156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:40.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.416+0000 7f157fe00640 1 --2- 172.21.15.42:0/3557645908 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1588072e90 0x7f1588156cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.416+0000 7f157fe00640 1 -- 172.21.15.42:0/3557645908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1588142f40 msgr2=0x7f15880aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:40.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.416+0000 7f157fe00640 1 --2- 172.21.15.42:0/3557645908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1588142f40 0x7f15880aa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.416+0000 7f157fe00640 1 -- 172.21.15.42:0/3557645908 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1588157c20 con 0x7f15880b3550 2024-09-17T01:31:40.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.416+0000 7f157fe00640 1 --2- 172.21.15.42:0/3557645908 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15880b3550 0x7f158813e4b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f157000e790 tx=0x7f157000ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:31:40.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.417+0000 7f157f400640 1 -- 172.21.15.42:0/3557645908 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157000eea0 con 0x7f15880b3550 2024-09-17T01:31:40.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.417+0000 7f157f400640 1 -- 172.21.15.42:0/3557645908 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f157000cdb0 con 0x7f15880b3550 2024-09-17T01:31:40.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.417+0000 7f157f400640 1 -- 172.21.15.42:0/3557645908 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1570010690 con 0x7f15880b3550 2024-09-17T01:31:40.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.417+0000 7f158e000640 1 -- 172.21.15.42:0/3557645908 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1588156210 con 0x7f15880b3550 2024-09-17T01:31:40.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.417+0000 7f158e000640 1 -- 172.21.15.42:0/3557645908 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f15881567d0 con 0x7f15880b3550 2024-09-17T01:31:40.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.417+0000 7f157f400640 1 -- 172.21.15.42:0/3557645908 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1570010830 con 0x7f15880b3550 2024-09-17T01:31:40.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.417+0000 7f157f400640 1 -- 172.21.15.42:0/3557645908 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1570018d00 con 0x7f15880b3550 2024-09-17T01:31:40.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.418+0000 7f158e000640 1 -- 172.21.15.42:0/3557645908 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1588157990 con 0x7f15880b3550 2024-09-17T01:31:40.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.421+0000 7f157f400640 1 -- 172.21.15.42:0/3557645908 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1570010cb0 con 0x7f15880b3550 2024-09-17T01:31:40.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.489+0000 7f158e000640 1 -- 172.21.15.42:0/3557645908 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f158806dce0 con 0x7f15880b3550 2024-09-17T01:31:40.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.490+0000 7f157f400640 1 -- 172.21.15.42:0/3557645908 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v23) ==== 59+0+1472 (secure 0 0 0) 0x7f1570018420 con 0x7f15880b3550 2024-09-17T01:31:40.489 INFO:teuthology.orchestra.run.smithi042.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T01:31:40.489 INFO:teuthology.orchestra.run.smithi042.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T01:31:40.489 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced client_mount_timeout 30 2024-09-17T01:31:40.489 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_client 20/20 2024-09-17T01:31:40.489 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_mgr 20/20 2024-09-17T01:31:40.489 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_ms 1/1 2024-09-17T01:31:40.489 INFO:teuthology.orchestra.run.smithi042.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T01:31:40.489 INFO:teuthology.orchestra.run.smithi042.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T01:31:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds 20/20 2024-09-17T01:31:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T01:31:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_ms 2/2 2024-09-17T01:31:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_frag true 2024-09-17T01:31:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_scatterstat true 2024-09-17T01:31:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T01:31:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_verify_scatter true 2024-09-17T01:31:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T01:31:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T01:31:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T01:31:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced client_mount_timeout 600 2024-09-17T01:31:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_client 20/20 2024-09-17T01:31:40.490 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_ms 1/1 2024-09-17T01:31:40.491 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T01:31:40.491 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T01:31:40.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.491+0000 7f158e000640 1 -- 172.21.15.42:0/3557645908 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15880b3550 msgr2=0x7f158813e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.491+0000 7f158e000640 1 --2- 172.21.15.42:0/3557645908 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15880b3550 0x7f158813e4b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f157000e790 tx=0x7f157000ec50 comp rx=0 tx=0).stop 2024-09-17T01:31:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.491+0000 7f158e000640 1 -- 172.21.15.42:0/3557645908 shutdown_connections 2024-09-17T01:31:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.491+0000 7f158e000640 1 --2- 172.21.15.42:0/3557645908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1588142f40 0x7f15880aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.491+0000 7f158e000640 1 --2- 172.21.15.42:0/3557645908 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15880b3550 0x7f158813e4b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.491+0000 7f158e000640 1 --2- 172.21.15.42:0/3557645908 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1588072e90 0x7f1588156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.491+0000 7f158e000640 1 -- 172.21.15.42:0/3557645908 >> 172.21.15.42:0/3557645908 conn(0x7f15880b2930 msgr2=0x7f1588073f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.492+0000 7f158e000640 1 -- 172.21.15.42:0/3557645908 shutdown_connections 2024-09-17T01:31:40.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.492+0000 7f158e000640 1 -- 172.21.15.42:0/3557645908 wait complete. 2024-09-17T01:31:40.514 INFO:tasks.ceph:Setting crush tunables to default 2024-09-17T01:31:40.515 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd crush tunables default 2024-09-17T01:31:40.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.737+0000 7f1b5ce00640 1 -- 172.21.15.42:0/2143948724 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b5815ede0 msgr2=0x7f1b5815f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:40.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.737+0000 7f1b5ce00640 1 --2- 172.21.15.42:0/2143948724 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b5815ede0 0x7f1b5815f1f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009be0 tx=0x7f1b5002a890 comp rx=0 tx=0).stop 2024-09-17T01:31:40.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.737+0000 7f1b5ce00640 1 -- 172.21.15.42:0/2143948724 shutdown_connections 2024-09-17T01:31:40.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.737+0000 7f1b5ce00640 1 --2- 172.21.15.42:0/2143948724 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b5815ede0 0x7f1b5815f1f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.737+0000 7f1b5ce00640 1 -- 172.21.15.42:0/2143948724 >> 172.21.15.42:0/2143948724 conn(0x7f1b5806cd20 msgr2=0x7f1b5806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:40.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.737+0000 7f1b5ce00640 1 -- 172.21.15.42:0/2143948724 shutdown_connections 2024-09-17T01:31:40.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.737+0000 7f1b5ce00640 1 -- 172.21.15.42:0/2143948724 wait complete. 2024-09-17T01:31:40.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.740+0000 7f1b5ce00640 1 Processor -- start 2024-09-17T01:31:40.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.740+0000 7f1b5ce00640 1 -- start start 2024-09-17T01:31:40.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.741+0000 7f1b5ce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b580d0d20 0x7f1b581575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:40.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.741+0000 7f1b5ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b580d3e40 0x7f1b580c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:40.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.741+0000 7f1b5ce00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b5815ede0 0x7f1b580ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:40.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.741+0000 7f1b5ce00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1b580d2e50 con 0x7f1b580d3e40 2024-09-17T01:31:40.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.741+0000 7f1b5ce00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1b580d2cd0 con 0x7f1b580d0d20 2024-09-17T01:31:40.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.741+0000 7f1b5ce00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1b580d2fd0 con 0x7f1b5815ede0 2024-09-17T01:31:40.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.742+0000 7f1b4fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b580d3e40 0x7f1b580c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:40.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.742+0000 7f1b57e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b5815ede0 0x7f1b580ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:40.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.742+0000 7f1b4fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b580d3e40 0x7f1b580c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59346/0 (socket says 172.21.15.42:59346) 2024-09-17T01:31:40.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.742+0000 7f1b4fe00640 1 -- 172.21.15.42:0/1791040962 learned_addr learned my addr 172.21.15.42:0/1791040962 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:31:40.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.742+0000 7f1b57400640 1 --2- 172.21.15.42:0/1791040962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b580d0d20 0x7f1b581575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:40.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.742+0000 7f1b4fe00640 1 -- 172.21.15.42:0/1791040962 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b5815ede0 msgr2=0x7f1b580ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:40.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.742+0000 7f1b4fe00640 1 --2- 172.21.15.42:0/1791040962 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b5815ede0 0x7f1b580ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.742+0000 7f1b4fe00640 1 -- 172.21.15.42:0/1791040962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b580d0d20 msgr2=0x7f1b581575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:40.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.742+0000 7f1b4fe00640 1 --2- 172.21.15.42:0/1791040962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b580d0d20 0x7f1b581575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.742+0000 7f1b4fe00640 1 -- 172.21.15.42:0/1791040962 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b580c8cb0 con 0x7f1b580d3e40 2024-09-17T01:31:40.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.742+0000 7f1b4fe00640 1 --2- 172.21.15.42:0/1791040962 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b580d3e40 0x7f1b580c9c80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1b4000c430 tx=0x7f1b4000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:31:40.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.743+0000 7f1b4f400640 1 -- 172.21.15.42:0/1791040962 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b40017070 con 0x7f1b580d3e40 2024-09-17T01:31:40.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.743+0000 7f1b4f400640 1 -- 172.21.15.42:0/1791040962 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b400053e0 con 0x7f1b580d3e40 2024-09-17T01:31:40.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.743+0000 7f1b4f400640 1 -- 172.21.15.42:0/1791040962 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b40003850 con 0x7f1b580d3e40 2024-09-17T01:31:40.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.743+0000 7f1b5ce00640 1 -- 172.21.15.42:0/1791040962 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b580c8f90 con 0x7f1b580d3e40 2024-09-17T01:31:40.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.743+0000 7f1b5ce00640 1 -- 172.21.15.42:0/1791040962 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b5815e4f0 con 0x7f1b580d3e40 2024-09-17T01:31:40.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.743+0000 7f1b4f400640 1 -- 172.21.15.42:0/1791040962 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1b4001a070 con 0x7f1b580d3e40 2024-09-17T01:31:40.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.743+0000 7f1b4f400640 1 -- 172.21.15.42:0/1791040962 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1b4001c780 con 0x7f1b580d3e40 2024-09-17T01:31:40.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.744+0000 7f1b5ce00640 1 -- 172.21.15.42:0/1791040962 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b5815e720 con 0x7f1b580d3e40 2024-09-17T01:31:40.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.746+0000 7f1b4f400640 1 -- 172.21.15.42:0/1791040962 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1b40021020 con 0x7f1b580d3e40 2024-09-17T01:31:40.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.815+0000 7f1b5ce00640 1 -- 172.21.15.42:0/1791040962 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f1b580c98c0 con 0x7f1b580d3e40 2024-09-17T01:31:40.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.817+0000 7f1b4f400640 1 -- 172.21.15.42:0/1791040962 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f1b40011d40 con 0x7f1b580d3e40 2024-09-17T01:31:40.816 INFO:teuthology.orchestra.run.smithi042.stderr:adjusted tunables profile to default 2024-09-17T01:31:40.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.818+0000 7f1b5ce00640 1 -- 172.21.15.42:0/1791040962 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b580d3e40 msgr2=0x7f1b580c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:40.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.818+0000 7f1b5ce00640 1 --2- 172.21.15.42:0/1791040962 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b580d3e40 0x7f1b580c9c80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1b4000c430 tx=0x7f1b4000c8f0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.818+0000 7f1b5ce00640 1 -- 172.21.15.42:0/1791040962 shutdown_connections 2024-09-17T01:31:40.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.818+0000 7f1b5ce00640 1 --2- 172.21.15.42:0/1791040962 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b5815ede0 0x7f1b580ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.818+0000 7f1b5ce00640 1 --2- 172.21.15.42:0/1791040962 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b580d3e40 0x7f1b580c9c80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.818+0000 7f1b5ce00640 1 --2- 172.21.15.42:0/1791040962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b580d0d20 0x7f1b581575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:40.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.818+0000 7f1b5ce00640 1 -- 172.21.15.42:0/1791040962 >> 172.21.15.42:0/1791040962 conn(0x7f1b5806cd20 msgr2=0x7f1b580b68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:40.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.818+0000 7f1b5ce00640 1 -- 172.21.15.42:0/1791040962 shutdown_connections 2024-09-17T01:31:40.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:40.818+0000 7f1b5ce00640 1 -- 172.21.15.42:0/1791040962 wait complete. 2024-09-17T01:31:40.840 INFO:tasks.ceph:check_enable_crimson: False 2024-09-17T01:31:40.840 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-17T01:31:40.841 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:31:40.841 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-17T01:31:40.896 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:31:40.897 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-17T01:31:40.992 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:31:40.992 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-17T01:31:41.088 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:31:41.088 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-17T01:31:41.184 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:31:41.184 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-17T01:31:41.241 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:31:41.241 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-17T01:31:41.337 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:31:41.337 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-17T01:31:41.434 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:31:41.434 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-17T01:31:41.530 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd new bbbed357-73f1-4c49-a687-10f8d1bbc605 0 2024-09-17T01:31:41.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.798+0000 7f7799600640 1 -- 172.21.15.43:0/4104428544 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77940b3550 msgr2=0x7f779415cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:41.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.798+0000 7f7799600640 1 --2- 172.21.15.43:0/4104428544 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77940b3550 0x7f779415cec0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7794071ef0 tx=0x7f778402a560 comp rx=0 tx=0).stop 2024-09-17T01:31:41.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.798+0000 7f7799600640 1 -- 172.21.15.43:0/4104428544 shutdown_connections 2024-09-17T01:31:41.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.798+0000 7f7799600640 1 --2- 172.21.15.43:0/4104428544 >> v2:172.21.15.42:3300/0 conn(0x7f77940cec40 0x7f77940cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:41.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.798+0000 7f7799600640 1 --2- 172.21.15.43:0/4104428544 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77940b3550 0x7f779415cec0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:41.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.798+0000 7f7799600640 1 -- 172.21.15.43:0/4104428544 >> 172.21.15.43:0/4104428544 conn(0x7f77940b2930 msgr2=0x7f779406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:41.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.798+0000 7f7799600640 1 -- 172.21.15.43:0/4104428544 shutdown_connections 2024-09-17T01:31:41.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.798+0000 7f7799600640 1 -- 172.21.15.43:0/4104428544 wait complete. 2024-09-17T01:31:41.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.800+0000 7f7799600640 1 Processor -- start 2024-09-17T01:31:41.798 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.800+0000 7f7799600640 1 -- start start 2024-09-17T01:31:41.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.802+0000 7f7799600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77940b3550 0x7f77940b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:41.800 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.802+0000 7f7799600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77940cec40 0x7f77940b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:41.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.802+0000 7f7799600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7794142f40 0x7f77941f5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:41.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.802+0000 7f7799600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f779406d7c0 con 0x7f77940b3550 2024-09-17T01:31:41.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.802+0000 7f7799600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f779406d640 con 0x7f7794142f40 2024-09-17T01:31:41.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.802+0000 7f7799600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f779406d940 con 0x7f77940cec40 2024-09-17T01:31:41.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.802+0000 7f778be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77940cec40 0x7f77940b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:41.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.802+0000 7f7793400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7794142f40 0x7f77941f5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:41.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.802+0000 7f7792a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77940b3550 0x7f77940b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:41.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.802+0000 7f7792a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77940b3550 0x7f77940b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.43:55274/0 (socket says 172.21.15.43:55274) 2024-09-17T01:31:41.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.802+0000 7f7792a00640 1 -- 172.21.15.43:0/844368720 learned_addr learned my addr 172.21.15.43:0/844368720 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T01:31:41.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.802+0000 7f7793400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7794142f40 0x7f77941f5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55064/0 (socket says 172.21.15.43:55064) 2024-09-17T01:31:41.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.803+0000 7f7792a00640 1 -- 172.21.15.43:0/844368720 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77940cec40 msgr2=0x7f77940b0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:41.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.803+0000 7f7792a00640 1 --2- 172.21.15.43:0/844368720 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77940cec40 0x7f77940b0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:41.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.803+0000 7f7792a00640 1 -- 172.21.15.43:0/844368720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7794142f40 msgr2=0x7f77941f5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:41.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.803+0000 7f7792a00640 1 --2- 172.21.15.43:0/844368720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7794142f40 0x7f77941f5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:41.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.803+0000 7f7792a00640 1 -- 172.21.15.43:0/844368720 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77940aedf0 con 0x7f77940b3550 2024-09-17T01:31:41.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.803+0000 7f7793400640 1 --2- 172.21.15.43:0/844368720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7794142f40 0x7f77941f5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:31:41.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.803+0000 7f7792a00640 1 --2- 172.21.15.43:0/844368720 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77940b3550 0x7f77940b08c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7784034040 tx=0x7f77840038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:31:41.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.803+0000 7f778aa00640 1 -- 172.21.15.43:0/844368720 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778403e030 con 0x7f77940b3550 2024-09-17T01:31:41.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.803+0000 7f778aa00640 1 -- 172.21.15.43:0/844368720 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7784003db0 con 0x7f77940b3550 2024-09-17T01:31:41.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.803+0000 7f778aa00640 1 -- 172.21.15.43:0/844368720 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7784035040 con 0x7f77940b3550 2024-09-17T01:31:41.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.803+0000 7f7799600640 1 -- 172.21.15.43:0/844368720 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77940af0d0 con 0x7f77940b3550 2024-09-17T01:31:41.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.803+0000 7f7799600640 1 -- 172.21.15.43:0/844368720 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77940af690 con 0x7f77940b3550 2024-09-17T01:31:41.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.804+0000 7f778aa00640 1 -- 172.21.15.43:0/844368720 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7784041030 con 0x7f77940b3550 2024-09-17T01:31:41.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.804+0000 7f778aa00640 1 -- 172.21.15.43:0/844368720 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f7784043ba0 con 0x7f77940b3550 2024-09-17T01:31:41.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.804+0000 7f7799600640 1 -- 172.21.15.43:0/844368720 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f779415cec0 con 0x7f77940b3550 2024-09-17T01:31:41.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.807+0000 7f778aa00640 1 -- 172.21.15.43:0/844368720 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7784004f20 con 0x7f77940b3550 2024-09-17T01:31:41.879 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.881+0000 7f7799600640 1 -- 172.21.15.43:0/844368720 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bbbed357-73f1-4c49-a687-10f8d1bbc605", "id": 0} v 0) -- 0x7f779406a170 con 0x7f77940b3550 2024-09-17T01:31:41.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.884+0000 7f778aa00640 1 -- 172.21.15.43:0/844368720 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bbbed357-73f1-4c49-a687-10f8d1bbc605", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f778404d430 con 0x7f77940b3550 2024-09-17T01:31:41.882 INFO:teuthology.orchestra.run.smithi043.stdout:0 2024-09-17T01:31:41.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.885+0000 7f7799600640 1 -- 172.21.15.43:0/844368720 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77940b3550 msgr2=0x7f77940b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:41.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.885+0000 7f7799600640 1 --2- 172.21.15.43:0/844368720 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77940b3550 0x7f77940b08c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7784034040 tx=0x7f77840038a0 comp rx=0 tx=0).stop 2024-09-17T01:31:41.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.885+0000 7f7799600640 1 -- 172.21.15.43:0/844368720 shutdown_connections 2024-09-17T01:31:41.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.885+0000 7f7799600640 1 --2- 172.21.15.43:0/844368720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7794142f40 0x7f77941f5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:41.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.885+0000 7f7799600640 1 --2- 172.21.15.43:0/844368720 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77940cec40 0x7f77940b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:41.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.885+0000 7f7799600640 1 --2- 172.21.15.43:0/844368720 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77940b3550 0x7f77940b08c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:41.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.886+0000 7f7799600640 1 -- 172.21.15.43:0/844368720 >> 172.21.15.43:0/844368720 conn(0x7f77940b2930 msgr2=0x7f7794160440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:41.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.886+0000 7f7799600640 1 -- 172.21.15.43:0/844368720 shutdown_connections 2024-09-17T01:31:41.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:41.886+0000 7f7799600640 1 -- 172.21.15.43:0/844368720 wait complete. 2024-09-17T01:31:41.906 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd new adfdb56d-ca7d-475c-9c67-92b67d1ec8d4 1 2024-09-17T01:31:42.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.130+0000 7fb99c000640 1 -- 172.21.15.43:0/2673625471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9940d14a0 msgr2=0x7fb994162bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:42.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.130+0000 7fb99c000640 1 --2- 172.21.15.43:0/2673625471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9940d14a0 0x7fb994162bb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb9940d4540 tx=0x7fb98002a560 comp rx=0 tx=0).stop 2024-09-17T01:31:42.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.130+0000 7fb99c000640 1 -- 172.21.15.43:0/2673625471 shutdown_connections 2024-09-17T01:31:42.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.130+0000 7fb99c000640 1 --2- 172.21.15.43:0/2673625471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9940d14a0 0x7fb994162bb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.130+0000 7fb99c000640 1 --2- 172.21.15.43:0/2673625471 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb9941630f0 0x7fb9940b6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.130+0000 7fb99c000640 1 --2- 172.21.15.43:0/2673625471 >> v2:172.21.15.42:3300/0 conn(0x7fb994155dc0 0x7fb9940d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.130+0000 7fb99c000640 1 -- 172.21.15.43:0/2673625471 >> 172.21.15.43:0/2673625471 conn(0x7fb99406cd20 msgr2=0x7fb99406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:42.128 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.130+0000 7fb99c000640 1 -- 172.21.15.43:0/2673625471 shutdown_connections 2024-09-17T01:31:42.129 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.130+0000 7fb99c000640 1 -- 172.21.15.43:0/2673625471 wait complete. 2024-09-17T01:31:42.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.132+0000 7fb99c000640 1 Processor -- start 2024-09-17T01:31:42.130 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.132+0000 7fb99c000640 1 -- start start 2024-09-17T01:31:42.131 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.134+0000 7fb99c000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb9940d14a0 0x7fb9941fa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:42.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.134+0000 7fb99c000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb994155dc0 0x7fb9940cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:42.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.134+0000 7fb99c000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9941630f0 0x7fb9940b9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:42.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.134+0000 7fb99c000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb9940b69e0 con 0x7fb994155dc0 2024-09-17T01:31:42.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.134+0000 7fb99c000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb9940b6860 con 0x7fb9941630f0 2024-09-17T01:31:42.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.134+0000 7fb99c000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb9940b6b60 con 0x7fb9940d14a0 2024-09-17T01:31:42.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.134+0000 7fb999600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb9940d14a0 0x7fb9941fa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:42.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.134+0000 7fb998c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb994155dc0 0x7fb9940cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:42.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.134+0000 7fb99a000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9941630f0 0x7fb9940b9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:42.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.134+0000 7fb998c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb994155dc0 0x7fb9940cdf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.43:55286/0 (socket says 172.21.15.43:55286) 2024-09-17T01:31:42.132 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.134+0000 7fb998c00640 1 -- 172.21.15.43:0/4000496468 learned_addr learned my addr 172.21.15.43:0/4000496468 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T01:31:42.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.135+0000 7fb998c00640 1 -- 172.21.15.43:0/4000496468 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb9940d14a0 msgr2=0x7fb9941fa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:42.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.135+0000 7fb998c00640 1 --2- 172.21.15.43:0/4000496468 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb9940d14a0 0x7fb9941fa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.135+0000 7fb998c00640 1 -- 172.21.15.43:0/4000496468 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9941630f0 msgr2=0x7fb9940b9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:42.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.135+0000 7fb998c00640 1 --2- 172.21.15.43:0/4000496468 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9941630f0 0x7fb9940b9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.135+0000 7fb998c00640 1 -- 172.21.15.43:0/4000496468 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9940ca470 con 0x7fb994155dc0 2024-09-17T01:31:42.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.135+0000 7fb99a000640 1 --2- 172.21.15.43:0/4000496468 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9941630f0 0x7fb9940b9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:31:42.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.135+0000 7fb998c00640 1 --2- 172.21.15.43:0/4000496468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb994155dc0 0x7fb9940cdf30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb980034040 tx=0x7fb980003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:31:42.134 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.135+0000 7fb991600640 1 -- 172.21.15.43:0/4000496468 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98003e030 con 0x7fb994155dc0 2024-09-17T01:31:42.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.135+0000 7fb991600640 1 -- 172.21.15.43:0/4000496468 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb980003c20 con 0x7fb994155dc0 2024-09-17T01:31:42.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.135+0000 7fb99c000640 1 -- 172.21.15.43:0/4000496468 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9940ca750 con 0x7fb994155dc0 2024-09-17T01:31:42.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.135+0000 7fb991600640 1 -- 172.21.15.43:0/4000496468 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb980035040 con 0x7fb994155dc0 2024-09-17T01:31:42.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.135+0000 7fb99c000640 1 -- 172.21.15.43:0/4000496468 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9940cad10 con 0x7fb994155dc0 2024-09-17T01:31:42.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.136+0000 7fb991600640 1 -- 172.21.15.43:0/4000496468 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb980041030 con 0x7fb994155dc0 2024-09-17T01:31:42.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.136+0000 7fb991600640 1 -- 172.21.15.43:0/4000496468 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fb980043ba0 con 0x7fb994155dc0 2024-09-17T01:31:42.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.136+0000 7fb99c000640 1 -- 172.21.15.43:0/4000496468 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9940ca1e0 con 0x7fb994155dc0 2024-09-17T01:31:42.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.139+0000 7fb991600640 1 -- 172.21.15.43:0/4000496468 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb980004cc0 con 0x7fb994155dc0 2024-09-17T01:31:42.211 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.214+0000 7fb99c000640 1 -- 172.21.15.43:0/4000496468 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd new", "uuid": "adfdb56d-ca7d-475c-9c67-92b67d1ec8d4", "id": 1} v 0) -- 0x7fb9940b7010 con 0x7fb994155dc0 2024-09-17T01:31:42.214 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.216+0000 7fb991600640 1 -- 172.21.15.43:0/4000496468 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "adfdb56d-ca7d-475c-9c67-92b67d1ec8d4", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fb980004ea0 con 0x7fb994155dc0 2024-09-17T01:31:42.214 INFO:teuthology.orchestra.run.smithi043.stdout:1 2024-09-17T01:31:42.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.217+0000 7fb99c000640 1 -- 172.21.15.43:0/4000496468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb994155dc0 msgr2=0x7fb9940cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:42.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.217+0000 7fb99c000640 1 --2- 172.21.15.43:0/4000496468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb994155dc0 0x7fb9940cdf30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb980034040 tx=0x7fb980003820 comp rx=0 tx=0).stop 2024-09-17T01:31:42.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.217+0000 7fb99c000640 1 -- 172.21.15.43:0/4000496468 shutdown_connections 2024-09-17T01:31:42.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.217+0000 7fb99c000640 1 --2- 172.21.15.43:0/4000496468 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9941630f0 0x7fb9940b9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.217+0000 7fb99c000640 1 --2- 172.21.15.43:0/4000496468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb994155dc0 0x7fb9940cdf30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.217+0000 7fb99c000640 1 --2- 172.21.15.43:0/4000496468 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb9940d14a0 0x7fb9941fa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.217 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.217+0000 7fb99c000640 1 -- 172.21.15.43:0/4000496468 >> 172.21.15.43:0/4000496468 conn(0x7fb99406cd20 msgr2=0x7fb994154c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:42.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.218+0000 7fb99c000640 1 -- 172.21.15.43:0/4000496468 shutdown_connections 2024-09-17T01:31:42.218 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.218+0000 7fb99c000640 1 -- 172.21.15.43:0/4000496468 wait complete. 2024-09-17T01:31:42.236 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd new 91f1a863-ad20-41a1-922c-87c20ee12f4f 2 2024-09-17T01:31:42.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.459+0000 7f8bea000640 1 -- 172.21.15.43:0/1949416369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8be40d14a0 msgr2=0x7f8be4162bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:42.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.459+0000 7f8bea000640 1 --2- 172.21.15.43:0/1949416369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8be40d14a0 0x7f8be4162bb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8be40d4540 tx=0x7f8bd002a5f0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.459+0000 7f8bea000640 1 -- 172.21.15.43:0/1949416369 shutdown_connections 2024-09-17T01:31:42.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.459+0000 7f8bea000640 1 --2- 172.21.15.43:0/1949416369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8be40d14a0 0x7f8be4162bb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.459+0000 7f8bea000640 1 --2- 172.21.15.43:0/1949416369 >> v2:172.21.15.42:3300/0 conn(0x7f8be4155dc0 0x7f8be40d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.459+0000 7f8bea000640 1 -- 172.21.15.43:0/1949416369 >> 172.21.15.43:0/1949416369 conn(0x7f8be406cd20 msgr2=0x7f8be406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:42.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.459+0000 7f8bea000640 1 -- 172.21.15.43:0/1949416369 shutdown_connections 2024-09-17T01:31:42.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.459+0000 7f8bea000640 1 -- 172.21.15.43:0/1949416369 wait complete. 2024-09-17T01:31:42.461 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.463+0000 7f8bea000640 1 Processor -- start 2024-09-17T01:31:42.462 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.463+0000 7f8bea000640 1 -- start start 2024-09-17T01:31:42.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.466+0000 7f8bea000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8be40d14a0 0x7f8be40c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:42.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.466+0000 7f8bea000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be4155dc0 0x7f8be4153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:42.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.466+0000 7f8bea000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8be41630f0 0x7f8be415be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:42.465 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.466+0000 7f8bea000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8be4163680 con 0x7f8be4155dc0 2024-09-17T01:31:42.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.466+0000 7f8bea000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8be4163500 con 0x7f8be40d14a0 2024-09-17T01:31:42.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.466+0000 7f8bea000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8be40b6a30 con 0x7f8be41630f0 2024-09-17T01:31:42.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.466+0000 7f8be3400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8be40d14a0 0x7f8be40c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:42.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.466+0000 7f8be3400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8be40d14a0 0x7f8be40c9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55114/0 (socket says 172.21.15.43:55114) 2024-09-17T01:31:42.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.466+0000 7f8be3400640 1 -- 172.21.15.43:0/2269642936 learned_addr learned my addr 172.21.15.43:0/2269642936 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T01:31:42.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.466+0000 7f8be2a00640 1 --2- 172.21.15.43:0/2269642936 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be4155dc0 0x7f8be4153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:42.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.466+0000 7f8be3e00640 1 --2- 172.21.15.43:0/2269642936 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8be41630f0 0x7f8be415be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:42.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.467+0000 7f8be3400640 1 -- 172.21.15.43:0/2269642936 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8be41630f0 msgr2=0x7f8be415be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:42.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.467+0000 7f8be3400640 1 --2- 172.21.15.43:0/2269642936 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8be41630f0 0x7f8be415be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.467+0000 7f8be3400640 1 -- 172.21.15.43:0/2269642936 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be4155dc0 msgr2=0x7f8be4153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:42.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.467+0000 7f8be3400640 1 --2- 172.21.15.43:0/2269642936 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be4155dc0 0x7f8be4153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.467+0000 7f8be3400640 1 -- 172.21.15.43:0/2269642936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be415b680 con 0x7f8be40d14a0 2024-09-17T01:31:42.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.467+0000 7f8be3e00640 1 --2- 172.21.15.43:0/2269642936 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8be41630f0 0x7f8be415be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:31:42.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.467+0000 7f8be2a00640 1 --2- 172.21.15.43:0/2269642936 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be4155dc0 0x7f8be4153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:31:42.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.467+0000 7f8be3400640 1 --2- 172.21.15.43:0/2269642936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8be40d14a0 0x7f8be40c9210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400e7f0 tx=0x7f8bd400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:31:42.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.467+0000 7f8bdb400640 1 -- 172.21.15.43:0/2269642936 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd400ccc0 con 0x7f8be40d14a0 2024-09-17T01:31:42.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.467+0000 7f8bdb400640 1 -- 172.21.15.43:0/2269642936 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bd400ce80 con 0x7f8be40d14a0 2024-09-17T01:31:42.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.467+0000 7f8bea000640 1 -- 172.21.15.43:0/2269642936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be40cc400 con 0x7f8be40d14a0 2024-09-17T01:31:42.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.467+0000 7f8bdb400640 1 -- 172.21.15.43:0/2269642936 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4005280 con 0x7f8be40d14a0 2024-09-17T01:31:42.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.467+0000 7f8bea000640 1 -- 172.21.15.43:0/2269642936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be415b8f0 con 0x7f8be40d14a0 2024-09-17T01:31:42.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.468+0000 7f8bdb400640 1 -- 172.21.15.43:0/2269642936 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8bd40047a0 con 0x7f8be40d14a0 2024-09-17T01:31:42.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.468+0000 7f8bdb400640 1 -- 172.21.15.43:0/2269642936 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f8bd4004a90 con 0x7f8be40d14a0 2024-09-17T01:31:42.467 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.469+0000 7f8bea000640 1 -- 172.21.15.43:0/2269642936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8be40cc920 con 0x7f8be40d14a0 2024-09-17T01:31:42.468 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.471+0000 7f8bdb400640 1 -- 172.21.15.43:0/2269642936 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8bd4004db0 con 0x7f8be40d14a0 2024-09-17T01:31:42.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.546+0000 7f8bea000640 1 -- 172.21.15.43:0/2269642936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd new", "uuid": "91f1a863-ad20-41a1-922c-87c20ee12f4f", "id": 2} v 0) -- 0x7f8be40b6ef0 con 0x7f8be40d14a0 2024-09-17T01:31:42.548 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.550+0000 7f8bdb400640 1 -- 172.21.15.43:0/2269642936 <== mon.1 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "91f1a863-ad20-41a1-922c-87c20ee12f4f", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f8bd4021440 con 0x7f8be40d14a0 2024-09-17T01:31:42.548 INFO:teuthology.orchestra.run.smithi043.stdout:2 2024-09-17T01:31:42.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.551+0000 7f8bea000640 1 -- 172.21.15.43:0/2269642936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8be40d14a0 msgr2=0x7f8be40c9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:42.549 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.551+0000 7f8bea000640 1 --2- 172.21.15.43:0/2269642936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8be40d14a0 0x7f8be40c9210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400e7f0 tx=0x7f8bd400ecb0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.552+0000 7f8bea000640 1 -- 172.21.15.43:0/2269642936 shutdown_connections 2024-09-17T01:31:42.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.552+0000 7f8bea000640 1 --2- 172.21.15.43:0/2269642936 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8be41630f0 0x7f8be415be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.552+0000 7f8bea000640 1 --2- 172.21.15.43:0/2269642936 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be4155dc0 0x7f8be4153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.552+0000 7f8bea000640 1 --2- 172.21.15.43:0/2269642936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8be40d14a0 0x7f8be40c9210 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.552+0000 7f8bea000640 1 -- 172.21.15.43:0/2269642936 >> 172.21.15.43:0/2269642936 conn(0x7f8be406cd20 msgr2=0x7f8be415d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:42.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.552+0000 7f8bea000640 1 -- 172.21.15.43:0/2269642936 shutdown_connections 2024-09-17T01:31:42.550 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.552+0000 7f8bea000640 1 -- 172.21.15.43:0/2269642936 wait complete. 2024-09-17T01:31:42.569 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd new bf989245-f530-4e54-9bac-348e51303f29 3 2024-09-17T01:31:42.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.792+0000 7ffbe0200640 1 -- 172.21.15.43:0/1070291047 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbd80d1670 msgr2=0x7ffbd8162bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:42.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.792+0000 7ffbe0200640 1 --2- 172.21.15.43:0/1070291047 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbd80d1670 0x7ffbd8162bb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4009830 tx=0x7ffbc402a520 comp rx=0 tx=0).stop 2024-09-17T01:31:42.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.792+0000 7ffbe0200640 1 -- 172.21.15.43:0/1070291047 shutdown_connections 2024-09-17T01:31:42.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.792+0000 7ffbe0200640 1 --2- 172.21.15.43:0/1070291047 >> v2:172.21.15.42:3300/0 conn(0x7ffbd81630f0 0x7ffbd80d2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.792+0000 7ffbe0200640 1 --2- 172.21.15.43:0/1070291047 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbd80d1670 0x7ffbd8162bb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.792+0000 7ffbe0200640 1 -- 172.21.15.43:0/1070291047 >> 172.21.15.43:0/1070291047 conn(0x7ffbd806cd20 msgr2=0x7ffbd806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:42.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.792+0000 7ffbe0200640 1 -- 172.21.15.43:0/1070291047 shutdown_connections 2024-09-17T01:31:42.790 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.792+0000 7ffbe0200640 1 -- 172.21.15.43:0/1070291047 wait complete. 2024-09-17T01:31:42.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.794+0000 7ffbe0200640 1 Processor -- start 2024-09-17T01:31:42.792 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.794+0000 7ffbe0200640 1 -- start start 2024-09-17T01:31:42.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.796+0000 7ffbe0200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbd80d1670 0x7ffbd80b8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:42.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.796+0000 7ffbe0200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbd8155dc0 0x7ffbd80b9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:42.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.796+0000 7ffbe0200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbd81630f0 0x7ffbd80ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:42.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.796+0000 7ffbe0200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd80d34d0 con 0x7ffbd80d1670 2024-09-17T01:31:42.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.796+0000 7ffbe0200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd80d3350 con 0x7ffbd8155dc0 2024-09-17T01:31:42.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.796+0000 7ffbe0200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ffbd80d3650 con 0x7ffbd81630f0 2024-09-17T01:31:42.794 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.796+0000 7ffbdce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbd8155dc0 0x7ffbd80b9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:42.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.796+0000 7ffbdd800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbd80d1670 0x7ffbd80b8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:42.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.796+0000 7ffbde200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbd81630f0 0x7ffbd80ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:42.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.796+0000 7ffbdce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbd8155dc0 0x7ffbd80b9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55122/0 (socket says 172.21.15.43:55122) 2024-09-17T01:31:42.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.796+0000 7ffbdce00640 1 -- 172.21.15.43:0/4079539921 learned_addr learned my addr 172.21.15.43:0/4079539921 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T01:31:42.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.796+0000 7ffbdd800640 1 -- 172.21.15.43:0/4079539921 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbd81630f0 msgr2=0x7ffbd80ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:42.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.796+0000 7ffbdd800640 1 --2- 172.21.15.43:0/4079539921 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbd81630f0 0x7ffbd80ca070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.796+0000 7ffbdd800640 1 -- 172.21.15.43:0/4079539921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbd8155dc0 msgr2=0x7ffbd80b9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:42.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.796+0000 7ffbdd800640 1 --2- 172.21.15.43:0/4079539921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbd8155dc0 0x7ffbd80b9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.795 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.796+0000 7ffbdd800640 1 -- 172.21.15.43:0/4079539921 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd80b89c0 con 0x7ffbd80d1670 2024-09-17T01:31:42.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.797+0000 7ffbdd800640 1 --2- 172.21.15.43:0/4079539921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbd80d1670 0x7ffbd80b8ec0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00c3f0 tx=0x7ffbcc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:31:42.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.797+0000 7ffbd5600640 1 -- 172.21.15.43:0/4079539921 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc011790 con 0x7ffbd80d1670 2024-09-17T01:31:42.796 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.797+0000 7ffbd5600640 1 -- 172.21.15.43:0/4079539921 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffbcc017070 con 0x7ffbd80d1670 2024-09-17T01:31:42.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.797+0000 7ffbd5600640 1 -- 172.21.15.43:0/4079539921 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc011ce0 con 0x7ffbd80d1670 2024-09-17T01:31:42.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.797+0000 7ffbe0200640 1 -- 172.21.15.43:0/4079539921 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbd8156cc0 con 0x7ffbd80d1670 2024-09-17T01:31:42.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.797+0000 7ffbe0200640 1 -- 172.21.15.43:0/4079539921 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbd80c8600 con 0x7ffbd80d1670 2024-09-17T01:31:42.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.797+0000 7ffbd5600640 1 -- 172.21.15.43:0/4079539921 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffbcc01c460 con 0x7ffbd80d1670 2024-09-17T01:31:42.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.798+0000 7ffbd5600640 1 -- 172.21.15.43:0/4079539921 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7ffbcc012b80 con 0x7ffbd80d1670 2024-09-17T01:31:42.797 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.799+0000 7ffbe0200640 1 -- 172.21.15.43:0/4079539921 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbd80d3b70 con 0x7ffbd80d1670 2024-09-17T01:31:42.799 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.801+0000 7ffbd5600640 1 -- 172.21.15.43:0/4079539921 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ffbcc0126f0 con 0x7ffbd80d1670 2024-09-17T01:31:42.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.894+0000 7ffbe0200640 1 -- 172.21.15.43:0/4079539921 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bf989245-f530-4e54-9bac-348e51303f29", "id": 3} v 0) -- 0x7ffbd8156fa0 con 0x7ffbd80d1670 2024-09-17T01:31:42.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.897+0000 7ffbd5600640 1 -- 172.21.15.43:0/4079539921 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bf989245-f530-4e54-9bac-348e51303f29", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7ffbcc012990 con 0x7ffbd80d1670 2024-09-17T01:31:42.894 INFO:teuthology.orchestra.run.smithi043.stdout:3 2024-09-17T01:31:42.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.898+0000 7ffbe0200640 1 -- 172.21.15.43:0/4079539921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbd80d1670 msgr2=0x7ffbd80b8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:42.896 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.898+0000 7ffbe0200640 1 --2- 172.21.15.43:0/4079539921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbd80d1670 0x7ffbd80b8ec0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00c3f0 tx=0x7ffbcc00c8b0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.898+0000 7ffbe0200640 1 -- 172.21.15.43:0/4079539921 shutdown_connections 2024-09-17T01:31:42.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.898+0000 7ffbe0200640 1 --2- 172.21.15.43:0/4079539921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbd8155dc0 0x7ffbd80b9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.898+0000 7ffbe0200640 1 --2- 172.21.15.43:0/4079539921 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbd81630f0 0x7ffbd80ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.898+0000 7ffbe0200640 1 --2- 172.21.15.43:0/4079539921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbd80d1670 0x7ffbd80b8ec0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:42.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.898+0000 7ffbe0200640 1 -- 172.21.15.43:0/4079539921 >> 172.21.15.43:0/4079539921 conn(0x7ffbd806cd20 msgr2=0x7ffbd8075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:42.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.899+0000 7ffbe0200640 1 -- 172.21.15.43:0/4079539921 shutdown_connections 2024-09-17T01:31:42.897 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:42.899+0000 7ffbe0200640 1 -- 172.21.15.43:0/4079539921 wait complete. 2024-09-17T01:31:42.917 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd new a989b7cb-a52d-4ee9-8557-469825e4ca19 4 2024-09-17T01:31:43.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.140+0000 7f6903200640 1 -- 172.21.15.43:0/1414867078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69040d3e40 msgr2=0x7f69040cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:43.138 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.140+0000 7f6903200640 1 --2- 172.21.15.43:0/1414867078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69040d3e40 0x7f69040cfb20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f69040d42e0 tx=0x7f68f402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.140+0000 7f6903200640 1 -- 172.21.15.43:0/1414867078 shutdown_connections 2024-09-17T01:31:43.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.140+0000 7f6903200640 1 --2- 172.21.15.43:0/1414867078 >> v2:172.21.15.43:3300/0 conn(0x7f69040d0d20 0x7f69040d1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.140+0000 7f6903200640 1 --2- 172.21.15.43:0/1414867078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69040d3e40 0x7f69040cfb20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.140+0000 7f6903200640 1 -- 172.21.15.43:0/1414867078 >> 172.21.15.43:0/1414867078 conn(0x7f690406cd20 msgr2=0x7f690406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:43.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.141+0000 7f6903200640 1 -- 172.21.15.43:0/1414867078 shutdown_connections 2024-09-17T01:31:43.139 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.141+0000 7f6903200640 1 -- 172.21.15.43:0/1414867078 wait complete. 2024-09-17T01:31:43.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.143+0000 7f6903200640 1 Processor -- start 2024-09-17T01:31:43.140 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.143+0000 7f6903200640 1 -- start start 2024-09-17T01:31:43.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.144+0000 7f6903200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69040d0d20 0x7f69040c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:43.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.144+0000 7f6903200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69040d3e40 0x7f690415dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:43.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.144+0000 7f6903200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f690415ede0 0x7f69041f8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:43.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.144+0000 7f6903200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f69040d2b70 con 0x7f69040d3e40 2024-09-17T01:31:43.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.145+0000 7f6903200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f69040d29f0 con 0x7f690415ede0 2024-09-17T01:31:43.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.145+0000 7f6903200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f69040d2cf0 con 0x7f69040d0d20 2024-09-17T01:31:43.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.145+0000 7f6901e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69040d0d20 0x7f69040c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:43.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.145+0000 7f6902800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f690415ede0 0x7f69041f8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:43.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.145+0000 7f68fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69040d3e40 0x7f690415dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:43.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.145+0000 7f6901e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69040d0d20 0x7f69040c8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.43:53068/0 (socket says 172.21.15.43:53068) 2024-09-17T01:31:43.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.145+0000 7f6901e00640 1 -- 172.21.15.43:0/1673495333 learned_addr learned my addr 172.21.15.43:0/1673495333 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T01:31:43.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.145+0000 7f6902800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f690415ede0 0x7f69041f8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55154/0 (socket says 172.21.15.43:55154) 2024-09-17T01:31:43.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.145+0000 7f6902800640 1 -- 172.21.15.43:0/1673495333 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69040d0d20 msgr2=0x7f69040c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:43.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.145+0000 7f6902800640 1 --2- 172.21.15.43:0/1673495333 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69040d0d20 0x7f69040c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.145+0000 7f6902800640 1 -- 172.21.15.43:0/1673495333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69040d3e40 msgr2=0x7f690415dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:43.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.145+0000 7f6902800640 1 --2- 172.21.15.43:0/1673495333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69040d3e40 0x7f690415dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.145+0000 7f6902800640 1 -- 172.21.15.43:0/1673495333 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f690414ce80 con 0x7f690415ede0 2024-09-17T01:31:43.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.145+0000 7f6901e00640 1 --2- 172.21.15.43:0/1673495333 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69040d0d20 0x7f69040c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:31:43.145 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.146+0000 7f6902800640 1 --2- 172.21.15.43:0/1673495333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f690415ede0 0x7f69041f8a60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f68fc00c760 tx=0x7f68fc00cb60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:31:43.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.146+0000 7f68fa000640 1 -- 172.21.15.43:0/1673495333 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68fc003b70 con 0x7f690415ede0 2024-09-17T01:31:43.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.146+0000 7f68fa000640 1 -- 172.21.15.43:0/1673495333 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68fc003d10 con 0x7f690415ede0 2024-09-17T01:31:43.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.146+0000 7f68fa000640 1 -- 172.21.15.43:0/1673495333 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68fc005330 con 0x7f690415ede0 2024-09-17T01:31:43.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.146+0000 7f6903200640 1 -- 172.21.15.43:0/1673495333 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f690414d160 con 0x7f690415ede0 2024-09-17T01:31:43.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.146+0000 7f6903200640 1 -- 172.21.15.43:0/1673495333 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69040cd1a0 con 0x7f690415ede0 2024-09-17T01:31:43.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.146+0000 7f68fa000640 1 -- 172.21.15.43:0/1673495333 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f68fc0054d0 con 0x7f690415ede0 2024-09-17T01:31:43.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.146+0000 7f68fa000640 1 -- 172.21.15.43:0/1673495333 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f68fc0057c0 con 0x7f690415ede0 2024-09-17T01:31:43.146 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.147+0000 7f6903200640 1 -- 172.21.15.43:0/1673495333 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f690414cbd0 con 0x7f690415ede0 2024-09-17T01:31:43.147 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.150+0000 7f68fa000640 1 -- 172.21.15.43:0/1673495333 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f69040d0060 con 0x7f690415ede0 2024-09-17T01:31:43.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.225+0000 7f6903200640 1 -- 172.21.15.43:0/1673495333 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a989b7cb-a52d-4ee9-8557-469825e4ca19", "id": 4} v 0) -- 0x7f69040d31a0 con 0x7f690415ede0 2024-09-17T01:31:43.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.229+0000 7f68fa000640 1 -- 172.21.15.43:0/1673495333 <== mon.1 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a989b7cb-a52d-4ee9-8557-469825e4ca19", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f68fc00a640 con 0x7f690415ede0 2024-09-17T01:31:43.227 INFO:teuthology.orchestra.run.smithi043.stdout:4 2024-09-17T01:31:43.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.230+0000 7f6903200640 1 -- 172.21.15.43:0/1673495333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f690415ede0 msgr2=0x7f69041f8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:43.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.230+0000 7f6903200640 1 --2- 172.21.15.43:0/1673495333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f690415ede0 0x7f69041f8a60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f68fc00c760 tx=0x7f68fc00cb60 comp rx=0 tx=0).stop 2024-09-17T01:31:43.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.230+0000 7f6903200640 1 -- 172.21.15.43:0/1673495333 shutdown_connections 2024-09-17T01:31:43.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.230+0000 7f6903200640 1 --2- 172.21.15.43:0/1673495333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f690415ede0 0x7f69041f8a60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.230+0000 7f6903200640 1 --2- 172.21.15.43:0/1673495333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69040d3e40 0x7f690415dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.230+0000 7f6903200640 1 --2- 172.21.15.43:0/1673495333 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69040d0d20 0x7f69040c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.230+0000 7f6903200640 1 -- 172.21.15.43:0/1673495333 >> 172.21.15.43:0/1673495333 conn(0x7f690406cd20 msgr2=0x7f6904161150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:43.228 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.230+0000 7f6903200640 1 -- 172.21.15.43:0/1673495333 shutdown_connections 2024-09-17T01:31:43.229 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.230+0000 7f6903200640 1 -- 172.21.15.43:0/1673495333 wait complete. 2024-09-17T01:31:43.249 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd new 47a091d7-5988-4bf8-a126-e0d61efbcdba 5 2024-09-17T01:31:43.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.474+0000 7f74b9800640 1 -- 172.21.15.43:0/681956066 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74b4155dc0 msgr2=0x7f74b40d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:43.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.474+0000 7f74b9800640 1 --2- 172.21.15.43:0/681956066 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74b4155dc0 0x7f74b40d0f60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f74a4005fd0 tx=0x7f74a402a5d0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.474+0000 7f74b9800640 1 -- 172.21.15.43:0/681956066 shutdown_connections 2024-09-17T01:31:43.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.474+0000 7f74b9800640 1 --2- 172.21.15.43:0/681956066 >> v2:172.21.15.43:3300/0 conn(0x7f74b40d14a0 0x7f74b4162bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.474+0000 7f74b9800640 1 --2- 172.21.15.43:0/681956066 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74b4155dc0 0x7f74b40d0f60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.474+0000 7f74b9800640 1 -- 172.21.15.43:0/681956066 >> 172.21.15.43:0/681956066 conn(0x7f74b406cd20 msgr2=0x7f74b406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:43.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.474+0000 7f74b9800640 1 -- 172.21.15.43:0/681956066 shutdown_connections 2024-09-17T01:31:43.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.474+0000 7f74b9800640 1 -- 172.21.15.43:0/681956066 wait complete. 2024-09-17T01:31:43.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.476+0000 7f74b9800640 1 Processor -- start 2024-09-17T01:31:43.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.476+0000 7f74b9800640 1 -- start start 2024-09-17T01:31:43.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.478+0000 7f74b9800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b40d14a0 0x7f74b414ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:43.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.478+0000 7f74b9800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74b4155dc0 0x7f74b415bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:43.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.478+0000 7f74b9800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74b41630f0 0x7f74b415c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:43.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.478+0000 7f74b9800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f74b4163680 con 0x7f74b41630f0 2024-09-17T01:31:43.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.478+0000 7f74b9800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f74b4163500 con 0x7f74b40d14a0 2024-09-17T01:31:43.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.478+0000 7f74b9800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f74b40b6a30 con 0x7f74b4155dc0 2024-09-17T01:31:43.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.478+0000 7f74b2a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b40d14a0 0x7f74b414ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:43.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.478+0000 7f74abe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74b4155dc0 0x7f74b415bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:43.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.478+0000 7f74abe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74b4155dc0 0x7f74b415bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.43:53088/0 (socket says 172.21.15.43:53088) 2024-09-17T01:31:43.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.478+0000 7f74b2a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b40d14a0 0x7f74b414ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55170/0 (socket says 172.21.15.43:55170) 2024-09-17T01:31:43.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.478+0000 7f74abe00640 1 -- 172.21.15.43:0/3138712073 learned_addr learned my addr 172.21.15.43:0/3138712073 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T01:31:43.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.478+0000 7f74b3400640 1 --2- 172.21.15.43:0/3138712073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74b41630f0 0x7f74b415c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:43.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.478+0000 7f74abe00640 1 -- 172.21.15.43:0/3138712073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b40d14a0 msgr2=0x7f74b414ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:43.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.478+0000 7f74abe00640 1 --2- 172.21.15.43:0/3138712073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b40d14a0 0x7f74b414ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.478+0000 7f74abe00640 1 -- 172.21.15.43:0/3138712073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74b41630f0 msgr2=0x7f74b415c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:43.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.478+0000 7f74abe00640 1 --2- 172.21.15.43:0/3138712073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74b41630f0 0x7f74b415c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.478+0000 7f74abe00640 1 -- 172.21.15.43:0/3138712073 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b4160bc0 con 0x7f74b4155dc0 2024-09-17T01:31:43.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.478+0000 7f74b2a00640 1 --2- 172.21.15.43:0/3138712073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b40d14a0 0x7f74b414ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:31:43.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.479+0000 7f74abe00640 1 --2- 172.21.15.43:0/3138712073 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74b4155dc0 0x7f74b415bbb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f749c00e9f0 tx=0x7f749c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:31:43.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.479+0000 7f74aaa00640 1 -- 172.21.15.43:0/3138712073 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c00cd80 con 0x7f74b4155dc0 2024-09-17T01:31:43.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.479+0000 7f74aaa00640 1 -- 172.21.15.43:0/3138712073 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f749c004020 con 0x7f74b4155dc0 2024-09-17T01:31:43.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.479+0000 7f74aaa00640 1 -- 172.21.15.43:0/3138712073 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c004450 con 0x7f74b4155dc0 2024-09-17T01:31:43.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.479+0000 7f74b9800640 1 -- 172.21.15.43:0/3138712073 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b41f9500 con 0x7f74b4155dc0 2024-09-17T01:31:43.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.479+0000 7f74b9800640 1 -- 172.21.15.43:0/3138712073 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b41f9a80 con 0x7f74b4155dc0 2024-09-17T01:31:43.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.479+0000 7f74aaa00640 1 -- 172.21.15.43:0/3138712073 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f749c0053b0 con 0x7f74b4155dc0 2024-09-17T01:31:43.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.480+0000 7f74aaa00640 1 -- 172.21.15.43:0/3138712073 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f749c0093f0 con 0x7f74b4155dc0 2024-09-17T01:31:43.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.480+0000 7f74b9800640 1 -- 172.21.15.43:0/3138712073 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74b40b6e80 con 0x7f74b4155dc0 2024-09-17T01:31:43.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.483+0000 7f74aaa00640 1 -- 172.21.15.43:0/3138712073 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f749c0047a0 con 0x7f74b4155dc0 2024-09-17T01:31:43.556 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.558+0000 7f74b9800640 1 -- 172.21.15.43:0/3138712073 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "osd new", "uuid": "47a091d7-5988-4bf8-a126-e0d61efbcdba", "id": 5} v 0) -- 0x7f74b40cf670 con 0x7f74b4155dc0 2024-09-17T01:31:43.560 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.562+0000 7f74aaa00640 1 -- 172.21.15.43:0/3138712073 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "47a091d7-5988-4bf8-a126-e0d61efbcdba", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f749c004980 con 0x7f74b4155dc0 2024-09-17T01:31:43.560 INFO:teuthology.orchestra.run.smithi043.stdout:5 2024-09-17T01:31:43.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.563+0000 7f74b9800640 1 -- 172.21.15.43:0/3138712073 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74b4155dc0 msgr2=0x7f74b415bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:43.561 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.563+0000 7f74b9800640 1 --2- 172.21.15.43:0/3138712073 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74b4155dc0 0x7f74b415bbb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f749c00e9f0 tx=0x7f749c00eeb0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.564+0000 7f74b9800640 1 -- 172.21.15.43:0/3138712073 shutdown_connections 2024-09-17T01:31:43.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.564+0000 7f74b9800640 1 --2- 172.21.15.43:0/3138712073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74b41630f0 0x7f74b415c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.564+0000 7f74b9800640 1 --2- 172.21.15.43:0/3138712073 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74b4155dc0 0x7f74b415bbb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.564+0000 7f74b9800640 1 --2- 172.21.15.43:0/3138712073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74b40d14a0 0x7f74b414ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.564+0000 7f74b9800640 1 -- 172.21.15.43:0/3138712073 >> 172.21.15.43:0/3138712073 conn(0x7f74b406cd20 msgr2=0x7f74b40ba030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:43.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.564+0000 7f74b9800640 1 -- 172.21.15.43:0/3138712073 shutdown_connections 2024-09-17T01:31:43.562 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.564+0000 7f74b9800640 1 -- 172.21.15.43:0/3138712073 wait complete. 2024-09-17T01:31:43.581 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd new dbdd536c-6ecc-4533-82d8-ef46e1e1cb97 6 2024-09-17T01:31:43.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.803+0000 7f6b48e00640 1 -- 172.21.15.43:0/3877537282 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b440d0d20 msgr2=0x7f6b440d1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:43.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.803+0000 7f6b48e00640 1 --2- 172.21.15.43:0/3877537282 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b440d0d20 0x7f6b440d1130 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c005fd0 tx=0x7f6b2c02a540 comp rx=0 tx=0).stop 2024-09-17T01:31:43.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.803+0000 7f6b48e00640 1 -- 172.21.15.43:0/3877537282 shutdown_connections 2024-09-17T01:31:43.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.803+0000 7f6b48e00640 1 --2- 172.21.15.43:0/3877537282 >> v2:172.21.15.42:3300/0 conn(0x7f6b4415ede0 0x7f6b4415f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.803+0000 7f6b48e00640 1 --2- 172.21.15.43:0/3877537282 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b440d0d20 0x7f6b440d1130 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.803+0000 7f6b48e00640 1 -- 172.21.15.43:0/3877537282 >> 172.21.15.43:0/3877537282 conn(0x7f6b4406cd20 msgr2=0x7f6b4406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:43.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.803+0000 7f6b48e00640 1 -- 172.21.15.43:0/3877537282 shutdown_connections 2024-09-17T01:31:43.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.803+0000 7f6b48e00640 1 -- 172.21.15.43:0/3877537282 wait complete. 2024-09-17T01:31:43.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.805+0000 7f6b48e00640 1 Processor -- start 2024-09-17T01:31:43.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.805+0000 7f6b48e00640 1 -- start start 2024-09-17T01:31:43.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.807+0000 7f6b48e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b440d0d20 0x7f6b4415d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:43.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.807+0000 7f6b48e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b440d3e40 0x7f6b440cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:43.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.807+0000 7f6b48e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b4415ede0 0x7f6b441f8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:43.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.807+0000 7f6b48e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6b440d2bd0 con 0x7f6b4415ede0 2024-09-17T01:31:43.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.807+0000 7f6b48e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6b440d2a50 con 0x7f6b440d0d20 2024-09-17T01:31:43.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.807+0000 7f6b48e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6b440d2d50 con 0x7f6b440d3e40 2024-09-17T01:31:43.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.807+0000 7f6b3be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b440d3e40 0x7f6b440cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:43.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.807+0000 7f6b43400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b440d0d20 0x7f6b4415d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:43.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.807+0000 7f6b3be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b440d3e40 0x7f6b440cdc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.43:53100/0 (socket says 172.21.15.43:53100) 2024-09-17T01:31:43.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.807+0000 7f6b3be00640 1 -- 172.21.15.43:0/317651099 learned_addr learned my addr 172.21.15.43:0/317651099 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T01:31:43.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.807+0000 7f6b43e00640 1 --2- 172.21.15.43:0/317651099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b4415ede0 0x7f6b441f8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:43.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.808+0000 7f6b3be00640 1 -- 172.21.15.43:0/317651099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b440d0d20 msgr2=0x7f6b4415d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:43.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.808+0000 7f6b3be00640 1 --2- 172.21.15.43:0/317651099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b440d0d20 0x7f6b4415d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.808+0000 7f6b3be00640 1 -- 172.21.15.43:0/317651099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b4415ede0 msgr2=0x7f6b441f8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:43.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.808+0000 7f6b3be00640 1 --2- 172.21.15.43:0/317651099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b4415ede0 0x7f6b441f8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.808+0000 7f6b3be00640 1 -- 172.21.15.43:0/317651099 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4415c6c0 con 0x7f6b440d3e40 2024-09-17T01:31:43.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.808+0000 7f6b43e00640 1 --2- 172.21.15.43:0/317651099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b4415ede0 0x7f6b441f8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:31:43.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.808+0000 7f6b3be00640 1 --2- 172.21.15.43:0/317651099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b440d3e40 0x7f6b440cdc30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c000c00 tx=0x7f6b2c0038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:31:43.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.808+0000 7f6b3b400640 1 -- 172.21.15.43:0/317651099 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c03e030 con 0x7f6b440d3e40 2024-09-17T01:31:43.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.808+0000 7f6b3b400640 1 -- 172.21.15.43:0/317651099 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b2c003db0 con 0x7f6b440d3e40 2024-09-17T01:31:43.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.808+0000 7f6b3b400640 1 -- 172.21.15.43:0/317651099 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c035040 con 0x7f6b440d3e40 2024-09-17T01:31:43.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.808+0000 7f6b48e00640 1 -- 172.21.15.43:0/317651099 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4415bab0 con 0x7f6b440d3e40 2024-09-17T01:31:43.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.808+0000 7f6b48e00640 1 -- 172.21.15.43:0/317651099 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b4415c070 con 0x7f6b440d3e40 2024-09-17T01:31:43.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.809+0000 7f6b3b400640 1 -- 172.21.15.43:0/317651099 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6b2c041030 con 0x7f6b440d3e40 2024-09-17T01:31:43.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.809+0000 7f6b3b400640 1 -- 172.21.15.43:0/317651099 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f6b2c043dc0 con 0x7f6b440d3e40 2024-09-17T01:31:43.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.810+0000 7f6b48e00640 1 -- 172.21.15.43:0/317651099 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b440d3200 con 0x7f6b440d3e40 2024-09-17T01:31:43.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.812+0000 7f6b3b400640 1 -- 172.21.15.43:0/317651099 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6b2c004d90 con 0x7f6b440d3e40 2024-09-17T01:31:43.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.887+0000 7f6b48e00640 1 -- 172.21.15.43:0/317651099 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "osd new", "uuid": "dbdd536c-6ecc-4533-82d8-ef46e1e1cb97", "id": 6} v 0) -- 0x7f6b440ce750 con 0x7f6b440d3e40 2024-09-17T01:31:43.892 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.892+0000 7f6b3b400640 1 -- 172.21.15.43:0/317651099 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dbdd536c-6ecc-4533-82d8-ef46e1e1cb97", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f6b2c004f70 con 0x7f6b440d3e40 2024-09-17T01:31:43.893 INFO:teuthology.orchestra.run.smithi043.stdout:6 2024-09-17T01:31:43.893 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.893+0000 7f6b48e00640 1 -- 172.21.15.43:0/317651099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b440d3e40 msgr2=0x7f6b440cdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:43.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.893+0000 7f6b48e00640 1 --2- 172.21.15.43:0/317651099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b440d3e40 0x7f6b440cdc30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c000c00 tx=0x7f6b2c0038a0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.893+0000 7f6b48e00640 1 -- 172.21.15.43:0/317651099 shutdown_connections 2024-09-17T01:31:43.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.893+0000 7f6b48e00640 1 --2- 172.21.15.43:0/317651099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b4415ede0 0x7f6b441f8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.893+0000 7f6b48e00640 1 --2- 172.21.15.43:0/317651099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b440d3e40 0x7f6b440cdc30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.893+0000 7f6b48e00640 1 --2- 172.21.15.43:0/317651099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b440d0d20 0x7f6b4415d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:43.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.893+0000 7f6b48e00640 1 -- 172.21.15.43:0/317651099 >> 172.21.15.43:0/317651099 conn(0x7f6b4406cd20 msgr2=0x7f6b4415ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:43.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.893+0000 7f6b48e00640 1 -- 172.21.15.43:0/317651099 shutdown_connections 2024-09-17T01:31:43.894 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:43.893+0000 7f6b48e00640 1 -- 172.21.15.43:0/317651099 wait complete. 2024-09-17T01:31:43.913 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd new 603d3787-a3cb-4384-a201-f928d2f083e3 7 2024-09-17T01:31:44.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.137+0000 7f2a19c00640 1 -- 172.21.15.43:0/3871568632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a1415e960 msgr2=0x7f2a140d0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:44.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.137+0000 7f2a19c00640 1 --2- 172.21.15.43:0/3871568632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a1415e960 0x7f2a140d0e40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f29fc009830 tx=0x7f29fc02a5c0 comp rx=0 tx=0).stop 2024-09-17T01:31:44.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.137+0000 7f2a19c00640 1 -- 172.21.15.43:0/3871568632 shutdown_connections 2024-09-17T01:31:44.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.137+0000 7f2a19c00640 1 --2- 172.21.15.43:0/3871568632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a1415e960 0x7f2a140d0e40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:44.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.137+0000 7f2a19c00640 1 -- 172.21.15.43:0/3871568632 >> 172.21.15.43:0/3871568632 conn(0x7f2a140b6140 msgr2=0x7f2a140b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:44.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.137+0000 7f2a19c00640 1 -- 172.21.15.43:0/3871568632 shutdown_connections 2024-09-17T01:31:44.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.138+0000 7f2a19c00640 1 -- 172.21.15.43:0/3871568632 wait complete. 2024-09-17T01:31:44.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.140+0000 7f2a19c00640 1 Processor -- start 2024-09-17T01:31:44.137 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.140+0000 7f2a19c00640 1 -- start start 2024-09-17T01:31:44.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.141+0000 7f2a19c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a140cf040 0x7f2a141531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:44.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.141+0000 7f2a19c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a140d1380 0x7f2a14153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:44.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.141+0000 7f2a19c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a1415e960 0x7f2a14157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:44.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.141+0000 7f2a19c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2a140d3730 con 0x7f2a140cf040 2024-09-17T01:31:44.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.141+0000 7f2a19c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2a140d35b0 con 0x7f2a1415e960 2024-09-17T01:31:44.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.141+0000 7f2a19c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2a140d38b0 con 0x7f2a140d1380 2024-09-17T01:31:44.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.142+0000 7f2a19200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a1415e960 0x7f2a14157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:44.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.142+0000 7f2a0be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a140d1380 0x7f2a14153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:44.141 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.142+0000 7f2a19200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a1415e960 0x7f2a14157440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55180/0 (socket says 172.21.15.43:55180) 2024-09-17T01:31:44.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.142+0000 7f2a19200640 1 -- 172.21.15.43:0/2729205797 learned_addr learned my addr 172.21.15.43:0/2729205797 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-17T01:31:44.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.142+0000 7f2a0be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a140d1380 0x7f2a14153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.43:53102/0 (socket says 172.21.15.43:53102) 2024-09-17T01:31:44.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.142+0000 7f2a13e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a140cf040 0x7f2a141531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:44.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.142+0000 7f2a0be00640 1 -- 172.21.15.43:0/2729205797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a1415e960 msgr2=0x7f2a14157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:44.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.142+0000 7f2a0be00640 1 --2- 172.21.15.43:0/2729205797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a1415e960 0x7f2a14157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:44.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.142+0000 7f2a0be00640 1 -- 172.21.15.43:0/2729205797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a140cf040 msgr2=0x7f2a141531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:44.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.142+0000 7f2a0be00640 1 --2- 172.21.15.43:0/2729205797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a140cf040 0x7f2a141531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:44.142 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.142+0000 7f2a0be00640 1 -- 172.21.15.43:0/2729205797 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a14160380 con 0x7f2a140d1380 2024-09-17T01:31:44.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.142+0000 7f2a13e00640 1 --2- 172.21.15.43:0/2729205797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a140cf040 0x7f2a141531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:31:44.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.142+0000 7f2a0be00640 1 --2- 172.21.15.43:0/2729205797 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a140d1380 0x7f2a14153730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2a140cf7c0 tx=0x7f29fc033ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:31:44.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.143+0000 7f2a10c00640 1 -- 172.21.15.43:0/2729205797 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29fc031b50 con 0x7f2a140d1380 2024-09-17T01:31:44.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.143+0000 7f2a10c00640 1 -- 172.21.15.43:0/2729205797 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29fc031e00 con 0x7f2a140d1380 2024-09-17T01:31:44.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.143+0000 7f2a10c00640 1 -- 172.21.15.43:0/2729205797 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29fc033330 con 0x7f2a140d1380 2024-09-17T01:31:44.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.143+0000 7f2a19c00640 1 -- 172.21.15.43:0/2729205797 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a14160660 con 0x7f2a140d1380 2024-09-17T01:31:44.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.143+0000 7f2a19c00640 1 -- 172.21.15.43:0/2729205797 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a14160c20 con 0x7f2a140d1380 2024-09-17T01:31:44.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.143+0000 7f2a10c00640 1 -- 172.21.15.43:0/2729205797 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f29fc0334d0 con 0x7f2a140d1380 2024-09-17T01:31:44.143 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.143+0000 7f2a10c00640 1 -- 172.21.15.43:0/2729205797 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f29fc003cd0 con 0x7f2a140d1380 2024-09-17T01:31:44.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.144+0000 7f2a19c00640 1 -- 172.21.15.43:0/2729205797 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a140d3d60 con 0x7f2a140d1380 2024-09-17T01:31:44.144 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.146+0000 7f2a10c00640 1 -- 172.21.15.43:0/2729205797 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f29fc04a030 con 0x7f2a140d1380 2024-09-17T01:31:44.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.221+0000 7f2a19c00640 1 -- 172.21.15.43:0/2729205797 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "osd new", "uuid": "603d3787-a3cb-4384-a201-f928d2f083e3", "id": 7} v 0) -- 0x7f2a14162970 con 0x7f2a140d1380 2024-09-17T01:31:44.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.226+0000 7f2a10c00640 1 -- 172.21.15.43:0/2729205797 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "603d3787-a3cb-4384-a201-f928d2f083e3", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f29fc03f030 con 0x7f2a140d1380 2024-09-17T01:31:44.224 INFO:teuthology.orchestra.run.smithi043.stdout:7 2024-09-17T01:31:44.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.227+0000 7f2a19c00640 1 -- 172.21.15.43:0/2729205797 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a140d1380 msgr2=0x7f2a14153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:44.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.227+0000 7f2a19c00640 1 --2- 172.21.15.43:0/2729205797 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a140d1380 0x7f2a14153730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2a140cf7c0 tx=0x7f29fc033ba0 comp rx=0 tx=0).stop 2024-09-17T01:31:44.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.227+0000 7f2a19c00640 1 -- 172.21.15.43:0/2729205797 shutdown_connections 2024-09-17T01:31:44.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.227+0000 7f2a19c00640 1 --2- 172.21.15.43:0/2729205797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a1415e960 0x7f2a14157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:44.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.227+0000 7f2a19c00640 1 --2- 172.21.15.43:0/2729205797 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a140d1380 0x7f2a14153730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:44.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.227+0000 7f2a19c00640 1 --2- 172.21.15.43:0/2729205797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a140cf040 0x7f2a141531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:44.225 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.227+0000 7f2a19c00640 1 -- 172.21.15.43:0/2729205797 >> 172.21.15.43:0/2729205797 conn(0x7f2a140b6140 msgr2=0x7f2a14075fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:44.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.227+0000 7f2a19c00640 1 -- 172.21.15.43:0/2729205797 shutdown_connections 2024-09-17T01:31:44.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:31:44.227+0000 7f2a19c00640 1 -- 172.21.15.43:0/2729205797 wait complete. 2024-09-17T01:31:44.246 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-17T01:31:44.247 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-17T01:31:44.251 INFO:tasks.ceph.osd.0:Started 2024-09-17T01:31:44.251 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-17T01:31:44.251 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-17T01:31:44.255 INFO:tasks.ceph.osd.1:Started 2024-09-17T01:31:44.256 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T01:31:44.256 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T01:31:44.261 INFO:tasks.ceph.osd.2:Started 2024-09-17T01:31:44.261 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-17T01:31:44.261 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-17T01:31:44.266 INFO:tasks.ceph.osd.3:Started 2024-09-17T01:31:44.266 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-17T01:31:44.266 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-17T01:31:44.270 INFO:tasks.ceph.osd.4:Started 2024-09-17T01:31:44.270 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-17T01:31:44.270 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-17T01:31:44.274 INFO:tasks.ceph.osd.5:Started 2024-09-17T01:31:44.275 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-17T01:31:44.275 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-17T01:31:44.280 INFO:tasks.ceph.osd.6:Started 2024-09-17T01:31:44.280 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-17T01:31:44.280 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-17T01:31:44.285 INFO:tasks.ceph.osd.7:Started 2024-09-17T01:31:44.285 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:31:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.548+0000 7fb77ce00640 1 -- 172.21.15.42:0/1633935179 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7780d2810 msgr2=0x7fb77815e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.548+0000 7fb77ce00640 1 --2- 172.21.15.42:0/1633935179 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7780d2810 0x7fb77815e910 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb764009860 tx=0x7fb76402a510 comp rx=0 tx=0).stop 2024-09-17T01:31:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.548+0000 7fb77ce00640 1 -- 172.21.15.42:0/1633935179 shutdown_connections 2024-09-17T01:31:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.548+0000 7fb77ce00640 1 --2- 172.21.15.42:0/1633935179 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7780d2810 0x7fb77815e910 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.548+0000 7fb77ce00640 1 -- 172.21.15.42:0/1633935179 >> 172.21.15.42:0/1633935179 conn(0x7fb7780d1210 msgr2=0x7fb7780d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.549+0000 7fb77ce00640 1 -- 172.21.15.42:0/1633935179 shutdown_connections 2024-09-17T01:31:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.549+0000 7fb77ce00640 1 -- 172.21.15.42:0/1633935179 wait complete. 2024-09-17T01:31:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.551+0000 7fb77ce00640 1 Processor -- start 2024-09-17T01:31:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.551+0000 7fb77ce00640 1 -- start start 2024-09-17T01:31:44.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.553+0000 7fb77ce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb778073340 0x7fb7780c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:44.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.553+0000 7fb77ce00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7780b6030 0x7fb778151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:44.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.553+0000 7fb77ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7780d2810 0x7fb7780c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:44.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.553+0000 7fb77ce00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb77815fac0 con 0x7fb7780d2810 2024-09-17T01:31:44.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.553+0000 7fb77ce00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb77815f940 con 0x7fb778073340 2024-09-17T01:31:44.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.553+0000 7fb77ce00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb77815fc40 con 0x7fb7780b6030 2024-09-17T01:31:44.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.553+0000 7fb777e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7780d2810 0x7fb7780c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:44.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.554+0000 7fb777e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7780d2810 0x7fb7780c7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59364/0 (socket says 172.21.15.42:59364) 2024-09-17T01:31:44.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.554+0000 7fb777e00640 1 -- 172.21.15.42:0/3904213464 learned_addr learned my addr 172.21.15.42:0/3904213464 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:31:44.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.554+0000 7fb776a00640 1 --2- 172.21.15.42:0/3904213464 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7780b6030 0x7fb778151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:44.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.554+0000 7fb777400640 1 --2- 172.21.15.42:0/3904213464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb778073340 0x7fb7780c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:44.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.554+0000 7fb776a00640 1 -- 172.21.15.42:0/3904213464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb778073340 msgr2=0x7fb7780c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:44.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.554+0000 7fb776a00640 1 --2- 172.21.15.42:0/3904213464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb778073340 0x7fb7780c9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:44.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.554+0000 7fb776a00640 1 -- 172.21.15.42:0/3904213464 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7780d2810 msgr2=0x7fb7780c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:44.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.554+0000 7fb776a00640 1 --2- 172.21.15.42:0/3904213464 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7780d2810 0x7fb7780c7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:44.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.554+0000 7fb776a00640 1 -- 172.21.15.42:0/3904213464 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7780c8b00 con 0x7fb7780b6030 2024-09-17T01:31:44.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.555+0000 7fb776a00640 1 --2- 172.21.15.42:0/3904213464 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7780b6030 0x7fb778151230 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb764031000 tx=0x7fb764033ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:31:44.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.555+0000 7fb76f400640 1 -- 172.21.15.42:0/3904213464 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764031b50 con 0x7fb7780b6030 2024-09-17T01:31:44.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.555+0000 7fb76f400640 1 -- 172.21.15.42:0/3904213464 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb764031de0 con 0x7fb7780b6030 2024-09-17T01:31:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.555+0000 7fb76f400640 1 -- 172.21.15.42:0/3904213464 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764005280 con 0x7fb7780b6030 2024-09-17T01:31:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.555+0000 7fb77ce00640 1 -- 172.21.15.42:0/3904213464 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7780c8de0 con 0x7fb7780b6030 2024-09-17T01:31:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.556+0000 7fb77ce00640 1 -- 172.21.15.42:0/3904213464 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7780c93a0 con 0x7fb7780b6030 2024-09-17T01:31:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.556+0000 7fb76f400640 1 -- 172.21.15.42:0/3904213464 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb7640047a0 con 0x7fb7780b6030 2024-09-17T01:31:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.556+0000 7fb76f400640 1 -- 172.21.15.42:0/3904213464 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fb764003cc0 con 0x7fb7780b6030 2024-09-17T01:31:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.557+0000 7fb77ce00640 1 -- 172.21.15.42:0/3904213464 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7780d1a70 con 0x7fb7780b6030 2024-09-17T01:31:44.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.560+0000 7fb76f400640 1 -- 172.21.15.42:0/3904213464 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb7780d1a70 con 0x7fb7780b6030 2024-09-17T01:31:44.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.627+0000 7fb77ce00640 1 -- 172.21.15.42:0/3904213464 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb778160160 con 0x7fb7780b6030 2024-09-17T01:31:44.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.628+0000 7fb76f400640 1 -- 172.21.15.42:0/3904213464 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fb76403f030 con 0x7fb7780b6030 2024-09-17T01:31:44.625 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:31:44.625 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":10,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:31:44.223667+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:31:44.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.628+0000 7fb77ce00640 1 -- 172.21.15.42:0/3904213464 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7780b6030 msgr2=0x7fb778151230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:44.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.628+0000 7fb77ce00640 1 --2- 172.21.15.42:0/3904213464 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7780b6030 0x7fb778151230 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb764031000 tx=0x7fb764033ba0 comp rx=0 tx=0).stop 2024-09-17T01:31:44.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.629+0000 7fb77ce00640 1 -- 172.21.15.42:0/3904213464 shutdown_connections 2024-09-17T01:31:44.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.629+0000 7fb77ce00640 1 --2- 172.21.15.42:0/3904213464 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7780d2810 0x7fb7780c7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:44.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.629+0000 7fb77ce00640 1 --2- 172.21.15.42:0/3904213464 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7780b6030 0x7fb778151230 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:44.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.629+0000 7fb77ce00640 1 --2- 172.21.15.42:0/3904213464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb778073340 0x7fb7780c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:44.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.629+0000 7fb77ce00640 1 -- 172.21.15.42:0/3904213464 >> 172.21.15.42:0/3904213464 conn(0x7fb7780d1210 msgr2=0x7fb778162590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:44.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.629+0000 7fb77ce00640 1 -- 172.21.15.42:0/3904213464 shutdown_connections 2024-09-17T01:31:44.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:31:44.629+0000 7fb77ce00640 1 -- 172.21.15.42:0/3904213464 wait complete. 2024-09-17T01:31:44.646 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-17T01:31:44.647 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-17T01:31:45.453 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T01:31:45.662 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.664+0000 7fd136000640 1 -- 172.21.15.42:0/3476343376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd130162970 msgr2=0x7fd130068d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:45.662 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.664+0000 7fd136000640 1 --2- 172.21.15.42:0/3476343376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd130162970 0x7fd130068d40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd130071790 tx=0x7fd12802aa30 comp rx=0 tx=0).stop 2024-09-17T01:31:45.662 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.664+0000 7fd136000640 1 -- 172.21.15.42:0/3476343376 shutdown_connections 2024-09-17T01:31:45.662 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.664+0000 7fd136000640 1 --2- 172.21.15.42:0/3476343376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd130162970 0x7fd130068d40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:45.662 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.664+0000 7fd136000640 1 --2- 172.21.15.42:0/3476343376 >> v2:172.21.15.43:3300/0 conn(0x7fd13006dc20 0x7fd130162430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:45.662 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.664+0000 7fd136000640 1 -- 172.21.15.42:0/3476343376 >> 172.21.15.42:0/3476343376 conn(0x7fd130073510 msgr2=0x7fd1300b6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:45.662 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.664+0000 7fd136000640 1 -- 172.21.15.42:0/3476343376 shutdown_connections 2024-09-17T01:31:45.662 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.664+0000 7fd136000640 1 -- 172.21.15.42:0/3476343376 wait complete. 2024-09-17T01:31:45.663 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.666+0000 7fd136000640 1 Processor -- start 2024-09-17T01:31:45.664 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.666+0000 7fd136000640 1 -- start start 2024-09-17T01:31:45.665 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.668+0000 7fd136000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd130155aa0 0x7fd1301f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:45.665 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.668+0000 7fd136000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd130162970 0x7fd13009b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:45.666 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.668+0000 7fd136000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd130154d50 0x7fd130150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:45.666 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.668+0000 7fd136000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd130069610 con 0x7fd130162970 2024-09-17T01:31:45.666 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.668+0000 7fd136000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd130069490 con 0x7fd130154d50 2024-09-17T01:31:45.666 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.668+0000 7fd136000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd130069790 con 0x7fd130155aa0 2024-09-17T01:31:45.666 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.668+0000 7fd12fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd130162970 0x7fd13009b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:45.666 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.668+0000 7fd12fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd130162970 0x7fd13009b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59404/0 (socket says 172.21.15.42:59404) 2024-09-17T01:31:45.666 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.668+0000 7fd12fe00640 1 -- 172.21.15.42:0/2945039748 learned_addr learned my addr 172.21.15.42:0/2945039748 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:31:45.666 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.668+0000 7fd134c00640 1 --2- 172.21.15.42:0/2945039748 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd130155aa0 0x7fd1301f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:45.666 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.668+0000 7fd135600640 1 --2- 172.21.15.42:0/2945039748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd130154d50 0x7fd130150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:45.667 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.668+0000 7fd12fe00640 1 -- 172.21.15.42:0/2945039748 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd130155aa0 msgr2=0x7fd1301f52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:45.667 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.668+0000 7fd12fe00640 1 --2- 172.21.15.42:0/2945039748 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd130155aa0 0x7fd1301f52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:45.668 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.668+0000 7fd12fe00640 1 -- 172.21.15.42:0/2945039748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd130154d50 msgr2=0x7fd130150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:45.668 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.668+0000 7fd12fe00640 1 --2- 172.21.15.42:0/2945039748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd130154d50 0x7fd130150950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:45.668 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.668+0000 7fd12fe00640 1 -- 172.21.15.42:0/2945039748 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13009b7f0 con 0x7fd130162970 2024-09-17T01:31:45.668 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.668+0000 7fd12fe00640 1 --2- 172.21.15.42:0/2945039748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd130162970 0x7fd13009b2b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd11c00e7c0 tx=0x7fd11c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:31:45.668 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.669+0000 7fd12cc00640 1 -- 172.21.15.42:0/2945039748 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11c00ccc0 con 0x7fd130162970 2024-09-17T01:31:45.668 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.669+0000 7fd12cc00640 1 -- 172.21.15.42:0/2945039748 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd11c010430 con 0x7fd130162970 2024-09-17T01:31:45.668 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.669+0000 7fd12cc00640 1 -- 172.21.15.42:0/2945039748 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11c010860 con 0x7fd130162970 2024-09-17T01:31:45.668 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.669+0000 7fd136000640 1 -- 172.21.15.42:0/2945039748 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1301f5b90 con 0x7fd130162970 2024-09-17T01:31:45.668 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.669+0000 7fd136000640 1 -- 172.21.15.42:0/2945039748 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1301f6150 con 0x7fd130162970 2024-09-17T01:31:45.668 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.670+0000 7fd136000640 1 -- 172.21.15.42:0/2945039748 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd130162430 con 0x7fd130162970 2024-09-17T01:31:45.669 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.670+0000 7fd12cc00640 1 -- 172.21.15.42:0/2945039748 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7fd11c010a00 con 0x7fd130162970 2024-09-17T01:31:45.669 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.671+0000 7fd12cc00640 1 -- 172.21.15.42:0/2945039748 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fd11c052df0 con 0x7fd130162970 2024-09-17T01:31:45.670 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.673+0000 7fd12cc00640 1 -- 172.21.15.42:0/2945039748 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd11c01fd80 con 0x7fd130162970 2024-09-17T01:31:45.737 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.737+0000 7fd136000640 1 -- 172.21.15.42:0/2945039748 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd1300d1010 con 0x7fd130162970 2024-09-17T01:31:45.737 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.737+0000 7fd12cc00640 1 -- 172.21.15.42:0/2945039748 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fd11c010cf0 con 0x7fd130162970 2024-09-17T01:31:45.737 INFO:teuthology.misc.health.smithi042.stdout: 2024-09-17T01:31:45.737 INFO:teuthology.misc.health.smithi042.stdout:{"epoch":10,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:31:44.223667+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:31:45.738 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.738+0000 7fd136000640 1 -- 172.21.15.42:0/2945039748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd130162970 msgr2=0x7fd13009b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:45.738 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.738+0000 7fd136000640 1 --2- 172.21.15.42:0/2945039748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd130162970 0x7fd13009b2b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd11c00e7c0 tx=0x7fd11c00ec80 comp rx=0 tx=0).stop 2024-09-17T01:31:45.738 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.738+0000 7fd136000640 1 -- 172.21.15.42:0/2945039748 shutdown_connections 2024-09-17T01:31:45.739 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.738+0000 7fd136000640 1 --2- 172.21.15.42:0/2945039748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd130154d50 0x7fd130150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:45.739 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.738+0000 7fd136000640 1 --2- 172.21.15.42:0/2945039748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd130162970 0x7fd13009b2b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:45.739 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.738+0000 7fd136000640 1 --2- 172.21.15.42:0/2945039748 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd130155aa0 0x7fd1301f52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:45.739 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.738+0000 7fd136000640 1 -- 172.21.15.42:0/2945039748 >> 172.21.15.42:0/2945039748 conn(0x7fd130073510 msgr2=0x7fd1301517f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:45.739 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.739+0000 7fd136000640 1 -- 172.21.15.42:0/2945039748 shutdown_connections 2024-09-17T01:31:45.739 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:45.739+0000 7fd136000640 1 -- 172.21.15.42:0/2945039748 wait complete. 2024-09-17T01:31:45.753 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-17T01:31:45.885 INFO:tasks.ceph.osd.5.smithi043.stderr:2024-09-17T01:31:45.887+0000 7fc759327640 -1 Falling back to public interface 2024-09-17T01:31:45.930 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-09-17T01:31:45.932+0000 7f876961e640 -1 Falling back to public interface 2024-09-17T01:31:45.939 INFO:tasks.ceph.osd.7.smithi043.stderr:2024-09-17T01:31:45.942+0000 7fae2c410640 -1 Falling back to public interface 2024-09-17T01:31:45.950 INFO:tasks.ceph.osd.4.smithi043.stderr:2024-09-17T01:31:45.953+0000 7f1355bdd640 -1 Falling back to public interface 2024-09-17T01:31:45.979 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-17T01:31:45.982+0000 7f3dcde00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-17T01:31:45.979 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-09-17T01:31:45.982+0000 7f3dcde00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-17T01:31:45.991 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-09-17T01:31:45.994+0000 7f757060e640 -1 Falling back to public interface 2024-09-17T01:31:45.999 INFO:tasks.ceph.osd.6.smithi043.stderr:2024-09-17T01:31:46.001+0000 7f491d2ef640 -1 Falling back to public interface 2024-09-17T01:31:46.004 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-09-17T01:31:46.007+0000 7ff9b261d640 -1 Falling back to public interface 2024-09-17T01:31:46.221 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-09-17T01:31:46.223+0000 7f01543db640 -1 Falling back to public interface 2024-09-17T01:31:48.721 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:31:48.726 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:31:49.524 INFO:tasks.ceph.osd.5.smithi043.stderr:2024-09-17T01:31:49.526+0000 7fc759327640 -1 osd.5 0 log_to_monitors true 2024-09-17T01:31:49.642 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-09-17T01:31:49.644+0000 7f876961e640 -1 osd.0 0 log_to_monitors true 2024-09-17T01:31:49.934 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-09-17T01:31:49.937+0000 7f757060e640 -1 osd.3 0 log_to_monitors true 2024-09-17T01:31:50.158 INFO:tasks.ceph.osd.4.smithi043.stderr:2024-09-17T01:31:50.161+0000 7f1355bdd640 -1 osd.4 0 log_to_monitors true 2024-09-17T01:31:50.236 INFO:tasks.ceph.osd.6.smithi043.stderr:2024-09-17T01:31:50.238+0000 7f491d2ef640 -1 osd.6 0 log_to_monitors true 2024-09-17T01:31:50.369 INFO:tasks.ceph.osd.7.smithi043.stderr:2024-09-17T01:31:50.371+0000 7fae2c410640 -1 osd.7 0 log_to_monitors true 2024-09-17T01:31:50.664 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-09-17T01:31:50.665+0000 7f01543db640 -1 osd.1 0 log_to_monitors true 2024-09-17T01:31:50.959 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-09-17T01:31:50.961+0000 7ff9b261d640 -1 osd.2 0 log_to_monitors true 2024-09-17T01:31:51.743 INFO:tasks.ceph.osd.5.smithi043.stderr:2024-09-17T01:31:51.745+0000 7fc754200640 -1 osd.5 0 waiting for initial osdmap 2024-09-17T01:31:51.764 INFO:tasks.ceph.osd.5.smithi043.stderr:2024-09-17T01:31:51.766+0000 7fc74a200640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:31:52.559 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T01:31:52.903 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.904+0000 7ff1c9800640 1 -- 172.21.15.42:0/110746255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1c40b9290 msgr2=0x7ff1c40d2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:52.903 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.904+0000 7ff1c9800640 1 --2- 172.21.15.42:0/110746255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1c40b9290 0x7ff1c40d2f50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4005fd0 tx=0x7ff1b402a960 comp rx=0 tx=0).stop 2024-09-17T01:31:52.903 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.904+0000 7ff1c9800640 1 -- 172.21.15.42:0/110746255 shutdown_connections 2024-09-17T01:31:52.903 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.904+0000 7ff1c9800640 1 --2- 172.21.15.42:0/110746255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1c40b9290 0x7ff1c40d2f50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:52.904 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.904+0000 7ff1c9800640 1 -- 172.21.15.42:0/110746255 >> 172.21.15.42:0/110746255 conn(0x7ff1c406cf00 msgr2=0x7ff1c406d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:52.904 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.905+0000 7ff1c9800640 1 -- 172.21.15.42:0/110746255 shutdown_connections 2024-09-17T01:31:52.904 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.905+0000 7ff1c9800640 1 -- 172.21.15.42:0/110746255 wait complete. 2024-09-17T01:31:52.905 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.907+0000 7ff1c9800640 1 Processor -- start 2024-09-17T01:31:52.905 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.908+0000 7ff1c9800640 1 -- start start 2024-09-17T01:31:52.907 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.909+0000 7ff1c9800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1c40b9290 0x7ff1c40cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:52.907 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.910+0000 7ff1c9800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1c415ea80 0x7ff1c415e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:52.907 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.910+0000 7ff1c9800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1c4153560 0x7ff1c414a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:52.909 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.910+0000 7ff1c3e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1c40b9290 0x7ff1c40cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:52.909 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.910+0000 7ff1c3e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1c40b9290 0x7ff1c40cdfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:34674/0 (socket says 172.21.15.42:34674) 2024-09-17T01:31:52.909 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.910+0000 7ff1c8e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1c4153560 0x7ff1c414a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:52.909 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.910+0000 7ff1c8e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1c4153560 0x7ff1c414a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:49344/0 (socket says 172.21.15.42:49344) 2024-09-17T01:31:52.909 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.910+0000 7ff1c3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1c415ea80 0x7ff1c415e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:52.909 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.911+0000 7ff1c3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1c415ea80 0x7ff1c415e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51526/0 (socket says 172.21.15.42:51526) 2024-09-17T01:31:52.909 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.911+0000 7ff1c3e00640 1 -- 172.21.15.42:0/338306806 learned_addr learned my addr 172.21.15.42:0/338306806 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:31:52.909 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.911+0000 7ff1c9800640 1 -- 172.21.15.42:0/338306806 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c4169db0 con 0x7ff1c415ea80 2024-09-17T01:31:52.909 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.911+0000 7ff1c9800640 1 -- 172.21.15.42:0/338306806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c4169c30 con 0x7ff1c4153560 2024-09-17T01:31:52.909 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.911+0000 7ff1c9800640 1 -- 172.21.15.42:0/338306806 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c4169f30 con 0x7ff1c40b9290 2024-09-17T01:31:52.913 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.912+0000 7ff1c3400640 1 -- 172.21.15.42:0/338306806 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1c40b9290 msgr2=0x7ff1c40cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:52.913 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.912+0000 7ff1c3400640 1 --2- 172.21.15.42:0/338306806 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1c40b9290 0x7ff1c40cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:52.913 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.912+0000 7ff1c3400640 1 -- 172.21.15.42:0/338306806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1c4153560 msgr2=0x7ff1c414a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:52.913 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.912+0000 7ff1c3400640 1 --2- 172.21.15.42:0/338306806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1c4153560 0x7ff1c414a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:52.913 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.912+0000 7ff1c3400640 1 -- 172.21.15.42:0/338306806 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c40ccf40 con 0x7ff1c415ea80 2024-09-17T01:31:52.913 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.913+0000 7ff1c8e00640 1 --2- 172.21.15.42:0/338306806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1c4153560 0x7ff1c414a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:31:52.913 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.913+0000 7ff1c3400640 1 --2- 172.21.15.42:0/338306806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1c415ea80 0x7ff1c415e1f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00c370 tx=0x7ff1bc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:31:52.913 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.913+0000 7ff1bbe00640 1 -- 172.21.15.42:0/338306806 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc011790 con 0x7ff1c415ea80 2024-09-17T01:31:52.913 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.914+0000 7ff1bbe00640 1 -- 172.21.15.42:0/338306806 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1bc017070 con 0x7ff1c415ea80 2024-09-17T01:31:52.914 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.914+0000 7ff1c9800640 1 -- 172.21.15.42:0/338306806 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c40cd220 con 0x7ff1c415ea80 2024-09-17T01:31:52.914 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.914+0000 7ff1c9800640 1 -- 172.21.15.42:0/338306806 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c40cd7e0 con 0x7ff1c415ea80 2024-09-17T01:31:52.914 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.916+0000 7ff1bbe00640 1 -- 172.21.15.42:0/338306806 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc011cc0 con 0x7ff1c415ea80 2024-09-17T01:31:52.915 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.918+0000 7ff1c9800640 1 -- 172.21.15.42:0/338306806 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff19c005290 con 0x7ff1c415ea80 2024-09-17T01:31:52.919 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.920+0000 7ff1bbe00640 1 -- 172.21.15.42:0/338306806 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7ff1bc01c460 con 0x7ff1c415ea80 2024-09-17T01:31:52.919 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.920+0000 7ff1bbe00640 1 --2- 172.21.15.42:0/338306806 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff1a0078bd0 0x7ff1a007b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:31:52.919 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.921+0000 7ff1bbe00640 1 -- 172.21.15.42:0/338306806 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2511+0+0 (secure 0 0 0) 0x7ff1bc099b80 con 0x7ff1c415ea80 2024-09-17T01:31:52.919 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.921+0000 7ff1c3e00640 1 --2- 172.21.15.42:0/338306806 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff1a0078bd0 0x7ff1a007b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:31:52.920 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.922+0000 7ff1c3e00640 1 --2- 172.21.15.42:0/338306806 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff1a0078bd0 0x7ff1a007b0e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac000f60 tx=0x7ff1ac009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:31:52.925 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:52.928+0000 7ff1bbe00640 1 -- 172.21.15.42:0/338306806 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff1bc0626b0 con 0x7ff1c415ea80 2024-09-17T01:31:53.032 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-09-17T01:31:53.034+0000 7f756ae00640 -1 osd.3 0 waiting for initial osdmap 2024-09-17T01:31:53.042 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-09-17T01:31:53.045+0000 7f7560e00640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:31:53.096 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-09-17T01:31:53.099+0000 7f8764000640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T01:31:53.113 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-09-17T01:31:53.115+0000 7f875a000640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:31:53.146 INFO:tasks.ceph.osd.6.smithi043.stderr:2024-09-17T01:31:53.148+0000 7f4918200640 -1 osd.6 0 waiting for initial osdmap 2024-09-17T01:31:53.153 INFO:tasks.ceph.osd.6.smithi043.stderr:2024-09-17T01:31:53.155+0000 7f490e200640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:31:53.167 INFO:tasks.ceph.osd.7.smithi043.stderr:2024-09-17T01:31:53.170+0000 7fae26c00640 -1 osd.7 0 waiting for initial osdmap 2024-09-17T01:31:53.176 INFO:tasks.ceph.osd.7.smithi043.stderr:2024-09-17T01:31:53.178+0000 7fae1cc00640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:31:53.185 INFO:tasks.ceph.osd.4.smithi043.stderr:2024-09-17T01:31:53.188+0000 7f1350a00640 -1 osd.4 0 waiting for initial osdmap 2024-09-17T01:31:53.199 INFO:tasks.ceph.osd.4.smithi043.stderr:2024-09-17T01:31:53.201+0000 7f1346a00640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:31:53.250 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:53.252+0000 7ff1c9800640 1 -- 172.21.15.42:0/338306806 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff19c005580 con 0x7ff1c415ea80 2024-09-17T01:31:53.250 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:53.253+0000 7ff1bbe00640 1 -- 172.21.15.42:0/338306806 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7555 (secure 0 0 0) 0x7ff1bc0670e0 con 0x7ff1c415ea80 2024-09-17T01:31:53.251 INFO:teuthology.misc.health.smithi042.stdout: 2024-09-17T01:31:53.251 INFO:teuthology.misc.health.smithi042.stdout:{"epoch":14,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:31:52.593641+0000","last_up_change":"2024-09-17T01:31:52.593641+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:31:53.253 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:53.255+0000 7ff1c9800640 1 -- 172.21.15.42:0/338306806 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff1a0078bd0 msgr2=0x7ff1a007b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:53.254 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:53.255+0000 7ff1c9800640 1 --2- 172.21.15.42:0/338306806 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff1a0078bd0 0x7ff1a007b0e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac000f60 tx=0x7ff1ac009040 comp rx=0 tx=0).stop 2024-09-17T01:31:53.254 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:53.255+0000 7ff1c9800640 1 -- 172.21.15.42:0/338306806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1c415ea80 msgr2=0x7ff1c415e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:31:53.254 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:53.255+0000 7ff1c9800640 1 --2- 172.21.15.42:0/338306806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1c415ea80 0x7ff1c415e1f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00c370 tx=0x7ff1bc00c830 comp rx=0 tx=0).stop 2024-09-17T01:31:53.254 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:53.256+0000 7ff1c9800640 1 -- 172.21.15.42:0/338306806 shutdown_connections 2024-09-17T01:31:53.254 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:53.256+0000 7ff1c9800640 1 --2- 172.21.15.42:0/338306806 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff1a0078bd0 0x7ff1a007b0e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:53.254 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:53.256+0000 7ff1c9800640 1 --2- 172.21.15.42:0/338306806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1c4153560 0x7ff1c414a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:53.254 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:53.256+0000 7ff1c9800640 1 --2- 172.21.15.42:0/338306806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1c415ea80 0x7ff1c415e1f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:53.254 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:53.256+0000 7ff1c9800640 1 --2- 172.21.15.42:0/338306806 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1c40b9290 0x7ff1c40cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:31:53.254 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:53.256+0000 7ff1c9800640 1 -- 172.21.15.42:0/338306806 >> 172.21.15.42:0/338306806 conn(0x7ff1c406cf00 msgr2=0x7ff1c406d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:31:53.254 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:53.256+0000 7ff1c9800640 1 -- 172.21.15.42:0/338306806 shutdown_connections 2024-09-17T01:31:53.255 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:31:53.256+0000 7ff1c9800640 1 -- 172.21.15.42:0/338306806 wait complete. 2024-09-17T01:31:53.280 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-17T01:31:54.022 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-09-17T01:31:54.025+0000 7f014f200640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T01:31:54.037 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-09-17T01:31:54.040+0000 7f0145200640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:31:54.062 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-09-17T01:31:54.064+0000 7ff9ad000640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T01:31:54.069 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-09-17T01:31:54.072+0000 7ff9a3000640 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:32:00.090 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T01:32:00.314 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.314+0000 7f0714000640 1 -- 172.21.15.42:0/2016768591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f070c06d430 msgr2=0x7f070c06d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:00.314 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.314+0000 7f0714000640 1 --2- 172.21.15.42:0/2016768591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f070c06d430 0x7f070c06d840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009830 tx=0x7f06f802a500 comp rx=0 tx=0).stop 2024-09-17T01:32:00.315 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.314+0000 7f0714000640 1 -- 172.21.15.42:0/2016768591 shutdown_connections 2024-09-17T01:32:00.315 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.314+0000 7f0714000640 1 --2- 172.21.15.42:0/2016768591 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f070c15f480 0x7f070c15f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:00.315 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.314+0000 7f0714000640 1 --2- 172.21.15.42:0/2016768591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f070c06d430 0x7f070c06d840 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:00.315 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.314+0000 7f0714000640 1 -- 172.21.15.42:0/2016768591 >> 172.21.15.42:0/2016768591 conn(0x7f070c0b2930 msgr2=0x7f070c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:00.315 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.314+0000 7f0714000640 1 -- 172.21.15.42:0/2016768591 shutdown_connections 2024-09-17T01:32:00.315 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.314+0000 7f0714000640 1 -- 172.21.15.42:0/2016768591 wait complete. 2024-09-17T01:32:00.315 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.316+0000 7f0714000640 1 Processor -- start 2024-09-17T01:32:00.315 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.316+0000 7f0714000640 1 -- start start 2024-09-17T01:32:00.317 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.318+0000 7f0714000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f070c06d430 0x7f070c147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:00.318 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.318+0000 7f0714000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f070c15cb80 0x7f070c153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:00.318 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.318+0000 7f0714000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f070c15f480 0x7f070c1578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:00.318 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.318+0000 7f0714000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f070c073820 con 0x7f070c15cb80 2024-09-17T01:32:00.318 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.318+0000 7f0714000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f070c0736a0 con 0x7f070c06d430 2024-09-17T01:32:00.318 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.318+0000 7f0714000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f070c0739a0 con 0x7f070c15f480 2024-09-17T01:32:00.318 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.318+0000 7f0710c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f070c15cb80 0x7f070c153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:00.318 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.318+0000 7f0710c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f070c15cb80 0x7f070c153f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43282/0 (socket says 172.21.15.42:43282) 2024-09-17T01:32:00.318 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.318+0000 7f0710c00640 1 -- 172.21.15.42:0/991592539 learned_addr learned my addr 172.21.15.42:0/991592539 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:00.318 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.318+0000 7f0712000640 1 --2- 172.21.15.42:0/991592539 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f070c15f480 0x7f070c1578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:00.318 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.318+0000 7f0711600640 1 --2- 172.21.15.42:0/991592539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f070c06d430 0x7f070c147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:00.319 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.318+0000 7f0710c00640 1 -- 172.21.15.42:0/991592539 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f070c15f480 msgr2=0x7f070c1578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:00.319 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.318+0000 7f0710c00640 1 --2- 172.21.15.42:0/991592539 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f070c15f480 0x7f070c1578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:00.319 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.318+0000 7f0710c00640 1 -- 172.21.15.42:0/991592539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f070c06d430 msgr2=0x7f070c147e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:00.319 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.318+0000 7f0710c00640 1 --2- 172.21.15.42:0/991592539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f070c06d430 0x7f070c147e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:00.319 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.319+0000 7f0710c00640 1 -- 172.21.15.42:0/991592539 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070c156b10 con 0x7f070c15cb80 2024-09-17T01:32:00.319 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.319+0000 7f0710c00640 1 --2- 172.21.15.42:0/991592539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f070c15cb80 0x7f070c153f90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f06f802aaf0 tx=0x7f06f8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:00.319 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.319+0000 7f0709600640 1 -- 172.21.15.42:0/991592539 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8005c90 con 0x7f070c15cb80 2024-09-17T01:32:00.319 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.319+0000 7f0714000640 1 -- 172.21.15.42:0/991592539 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f070c156df0 con 0x7f070c15cb80 2024-09-17T01:32:00.319 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.319+0000 7f0709600640 1 -- 172.21.15.42:0/991592539 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06f8031e50 con 0x7f070c15cb80 2024-09-17T01:32:00.319 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.319+0000 7f0709600640 1 -- 172.21.15.42:0/991592539 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8005260 con 0x7f070c15cb80 2024-09-17T01:32:00.319 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.319+0000 7f0714000640 1 -- 172.21.15.42:0/991592539 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f070c1544d0 con 0x7f070c15cb80 2024-09-17T01:32:00.321 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.321+0000 7f0714000640 1 -- 172.21.15.42:0/991592539 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f070c073ec0 con 0x7f070c15cb80 2024-09-17T01:32:00.321 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.322+0000 7f0709600640 1 -- 172.21.15.42:0/991592539 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f06f8005400 con 0x7f070c15cb80 2024-09-17T01:32:00.321 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.323+0000 7f0709600640 1 --2- 172.21.15.42:0/991592539 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f06ec078bc0 0x7f06ec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:00.321 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.323+0000 7f0709600640 1 -- 172.21.15.42:0/991592539 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f06f80bb9d0 con 0x7f070c15cb80 2024-09-17T01:32:00.321 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.323+0000 7f0711600640 1 --2- 172.21.15.42:0/991592539 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f06ec078bc0 0x7f06ec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:00.321 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.324+0000 7f0711600640 1 --2- 172.21.15.42:0/991592539 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f06ec078bc0 0x7f06ec07b0d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0700007d60 tx=0x7f0700007cf0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:00.326 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.328+0000 7f0709600640 1 -- 172.21.15.42:0/991592539 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f06f803f030 con 0x7f070c15cb80 2024-09-17T01:32:00.521 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.523+0000 7f0714000640 1 -- 172.21.15.42:0/991592539 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f070c0af540 con 0x7f070c15cb80 2024-09-17T01:32:00.522 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.524+0000 7f0709600640 1 -- 172.21.15.42:0/991592539 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12848 (secure 0 0 0) 0x7f06f8083a80 con 0x7f070c15cb80 2024-09-17T01:32:00.522 INFO:teuthology.misc.health.smithi042.stdout: 2024-09-17T01:32:00.522 INFO:teuthology.misc.health.smithi042.stdout:{"epoch":18,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:31:57.071587+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:32:00.525 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.527+0000 7f0714000640 1 -- 172.21.15.42:0/991592539 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f06ec078bc0 msgr2=0x7f06ec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:00.525 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.527+0000 7f0714000640 1 --2- 172.21.15.42:0/991592539 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f06ec078bc0 0x7f06ec07b0d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0700007d60 tx=0x7f0700007cf0 comp rx=0 tx=0).stop 2024-09-17T01:32:00.525 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.527+0000 7f0714000640 1 -- 172.21.15.42:0/991592539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f070c15cb80 msgr2=0x7f070c153f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:00.525 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.527+0000 7f0714000640 1 --2- 172.21.15.42:0/991592539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f070c15cb80 0x7f070c153f90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f06f802aaf0 tx=0x7f06f8033c20 comp rx=0 tx=0).stop 2024-09-17T01:32:00.525 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.527+0000 7f0714000640 1 -- 172.21.15.42:0/991592539 shutdown_connections 2024-09-17T01:32:00.525 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.527+0000 7f0714000640 1 --2- 172.21.15.42:0/991592539 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f06ec078bc0 0x7f06ec07b0d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:00.525 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.527+0000 7f0714000640 1 --2- 172.21.15.42:0/991592539 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f070c15f480 0x7f070c1578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:00.525 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.527+0000 7f0714000640 1 --2- 172.21.15.42:0/991592539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f070c15cb80 0x7f070c153f90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:00.525 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.527+0000 7f0714000640 1 --2- 172.21.15.42:0/991592539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f070c06d430 0x7f070c147e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:00.525 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.527+0000 7f0714000640 1 -- 172.21.15.42:0/991592539 >> 172.21.15.42:0/991592539 conn(0x7f070c0b2930 msgr2=0x7f070c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:00.525 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.527+0000 7f0714000640 1 -- 172.21.15.42:0/991592539 shutdown_connections 2024-09-17T01:32:00.525 INFO:teuthology.misc.health.smithi042.stderr:2024-09-17T01:32:00.527+0000 7f0714000640 1 -- 172.21.15.42:0/991592539 wait complete. 2024-09-17T01:32:00.544 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-17T01:32:00.544 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-17T01:32:00.544 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T01:32:00.545 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T01:32:00.548 INFO:tasks.ceph.mds.a:Started 2024-09-17T01:32:00.549 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T01:32:00.549 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T01:32:00.554 INFO:tasks.ceph.mds.c:Started 2024-09-17T01:32:00.555 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T01:32:00.555 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T01:32:00.560 INFO:tasks.ceph.mds.b:Started 2024-09-17T01:32:00.560 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T01:32:00.560 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T01:32:00.564 INFO:tasks.ceph.mds.d:Started 2024-09-17T01:32:00.564 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-17T01:32:00.565 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:32:00.746 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:32:00.758 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:32:00.768 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-09-17T01:32:00.768 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-09-17T01:32:00.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.835+0000 7f8b6e600640 1 -- 172.21.15.42:0/147186034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b680cec40 msgr2=0x7f8b680cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:00.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.835+0000 7f8b6e600640 1 --2- 172.21.15.42:0/147186034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b680cec40 0x7f8b680cf050 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8b60005fd0 tx=0x7f8b6002aa10 comp rx=0 tx=0).stop 2024-09-17T01:32:00.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.835+0000 7f8b6e600640 1 -- 172.21.15.42:0/147186034 shutdown_connections 2024-09-17T01:32:00.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.835+0000 7f8b6e600640 1 --2- 172.21.15.42:0/147186034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b680cec40 0x7f8b680cf050 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:00.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.835+0000 7f8b6e600640 1 --2- 172.21.15.42:0/147186034 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8b680b3550 0x7f8b6815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:00.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.835+0000 7f8b6e600640 1 -- 172.21.15.42:0/147186034 >> 172.21.15.42:0/147186034 conn(0x7f8b680b2930 msgr2=0x7f8b6806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:00.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.835+0000 7f8b6e600640 1 -- 172.21.15.42:0/147186034 shutdown_connections 2024-09-17T01:32:00.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.835+0000 7f8b6e600640 1 -- 172.21.15.42:0/147186034 wait complete. 2024-09-17T01:32:00.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.837+0000 7f8b6e600640 1 Processor -- start 2024-09-17T01:32:00.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.837+0000 7f8b6e600640 1 -- start start 2024-09-17T01:32:00.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.839+0000 7f8b6e600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b680b3550 0x7f8b6806f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:00.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.839+0000 7f8b6e600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8b680cec40 0x7f8b680ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:00.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.839+0000 7f8b6e600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b68142f40 0x7f8b68152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:00.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.839+0000 7f8b6e600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6806d7c0 con 0x7f8b68142f40 2024-09-17T01:32:00.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.839+0000 7f8b6e600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6806d640 con 0x7f8b680b3550 2024-09-17T01:32:00.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.839+0000 7f8b6e600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8b6806d940 con 0x7f8b680cec40 2024-09-17T01:32:00.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.839+0000 7f8b67400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b680b3550 0x7f8b6806f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:00.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.839+0000 7f8b67400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b680b3550 0x7f8b6806f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:50014/0 (socket says 172.21.15.42:50014) 2024-09-17T01:32:00.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.839+0000 7f8b67400640 1 -- 172.21.15.42:0/235250791 learned_addr learned my addr 172.21.15.42:0/235250791 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:00.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.839+0000 7f8b5fe00640 1 --2- 172.21.15.42:0/235250791 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8b680cec40 0x7f8b680ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:00.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.839+0000 7f8b67e00640 1 --2- 172.21.15.42:0/235250791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b68142f40 0x7f8b68152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:00.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.840+0000 7f8b67400640 1 -- 172.21.15.42:0/235250791 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8b680cec40 msgr2=0x7f8b680ad6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:00.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.840+0000 7f8b67400640 1 --2- 172.21.15.42:0/235250791 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8b680cec40 0x7f8b680ad6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:00.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.840+0000 7f8b67400640 1 -- 172.21.15.42:0/235250791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b68142f40 msgr2=0x7f8b68152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:00.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.840+0000 7f8b67400640 1 --2- 172.21.15.42:0/235250791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b68142f40 0x7f8b68152630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:00.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.840+0000 7f8b67400640 1 -- 172.21.15.42:0/235250791 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6806e1c0 con 0x7f8b680b3550 2024-09-17T01:32:00.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.840+0000 7f8b67400640 1 --2- 172.21.15.42:0/235250791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b680b3550 0x7f8b6806f6d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800e790 tx=0x7f8b5800ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:00.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.840+0000 7f8b5f400640 1 -- 172.21.15.42:0/235250791 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5800eea0 con 0x7f8b680b3550 2024-09-17T01:32:00.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.840+0000 7f8b5f400640 1 -- 172.21.15.42:0/235250791 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b5800cdb0 con 0x7f8b680b3550 2024-09-17T01:32:00.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.840+0000 7f8b5f400640 1 -- 172.21.15.42:0/235250791 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b58010690 con 0x7f8b680b3550 2024-09-17T01:32:00.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.840+0000 7f8b6e600640 1 -- 172.21.15.42:0/235250791 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b6806e630 con 0x7f8b680b3550 2024-09-17T01:32:00.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.840+0000 7f8b6e600640 1 -- 172.21.15.42:0/235250791 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b6806ebf0 con 0x7f8b680b3550 2024-09-17T01:32:00.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.841+0000 7f8b6e600640 1 -- 172.21.15.42:0/235250791 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b6815cec0 con 0x7f8b680b3550 2024-09-17T01:32:00.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.842+0000 7f8b5f400640 1 -- 172.21.15.42:0/235250791 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b58010830 con 0x7f8b680b3550 2024-09-17T01:32:00.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.843+0000 7f8b5f400640 1 --2- 172.21.15.42:0/235250791 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b44078b90 0x7f8b4407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:00.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.843+0000 7f8b5f400640 1 -- 172.21.15.42:0/235250791 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f8b5809b430 con 0x7f8b680b3550 2024-09-17T01:32:00.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.844+0000 7f8b5fe00640 1 --2- 172.21.15.42:0/235250791 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b44078b90 0x7f8b4407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:00.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.844+0000 7f8b5fe00640 1 --2- 172.21.15.42:0/235250791 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b44078b90 0x7f8b4407b0a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8b6813f3d0 tx=0x7f8b50009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:00.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:00.849+0000 7f8b5f400640 1 -- 172.21.15.42:0/235250791 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8b580634d0 con 0x7f8b680b3550 2024-09-17T01:32:01.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:01.082+0000 7f8b6e600640 1 -- 172.21.15.42:0/235250791 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b6806a170 con 0x7f8b680b3550 2024-09-17T01:32:01.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:01.082+0000 7f8b5f400640 1 -- 172.21.15.42:0/235250791 <== mon.1 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f8b58067f00 con 0x7f8b680b3550 2024-09-17T01:32:01.080 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:01.080 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":2,"btime":"2024-09-17T01:32:00:758085+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4363,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1971042705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1971042705},{"type":"v1","addr":"172.21.15.42:6833","nonce":1971042705}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-17T01:32:01.081 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 2 2024-09-17T01:32:01.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:01.084+0000 7f8b6e600640 1 -- 172.21.15.42:0/235250791 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b44078b90 msgr2=0x7f8b4407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:01.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:01.084+0000 7f8b6e600640 1 --2- 172.21.15.42:0/235250791 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b44078b90 0x7f8b4407b0a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8b6813f3d0 tx=0x7f8b50009040 comp rx=0 tx=0).stop 2024-09-17T01:32:01.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:01.084+0000 7f8b6e600640 1 -- 172.21.15.42:0/235250791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b680b3550 msgr2=0x7f8b6806f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:01.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:01.084+0000 7f8b6e600640 1 --2- 172.21.15.42:0/235250791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b680b3550 0x7f8b6806f6d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800e790 tx=0x7f8b5800ec50 comp rx=0 tx=0).stop 2024-09-17T01:32:01.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:01.084+0000 7f8b6e600640 1 -- 172.21.15.42:0/235250791 shutdown_connections 2024-09-17T01:32:01.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:01.084+0000 7f8b6e600640 1 --2- 172.21.15.42:0/235250791 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b44078b90 0x7f8b4407b0a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:01.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:01.084+0000 7f8b6e600640 1 --2- 172.21.15.42:0/235250791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b68142f40 0x7f8b68152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:01.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:01.084+0000 7f8b6e600640 1 --2- 172.21.15.42:0/235250791 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8b680cec40 0x7f8b680ad6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:01.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:01.084+0000 7f8b6e600640 1 --2- 172.21.15.42:0/235250791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b680b3550 0x7f8b6806f6d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:01.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:01.084+0000 7f8b6e600640 1 -- 172.21.15.42:0/235250791 >> 172.21.15.42:0/235250791 conn(0x7f8b680b2930 msgr2=0x7f8b68073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:01.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:01.085+0000 7f8b6e600640 1 -- 172.21.15.42:0/235250791 shutdown_connections 2024-09-17T01:32:01.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:01.085+0000 7f8b6e600640 1 -- 172.21.15.42:0/235250791 wait complete. 2024-09-17T01:32:03.105 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:32:03.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.345+0000 7fcb65a00640 1 -- 172.21.15.42:0/155742818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb600b3550 msgr2=0x7fcb6015cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:03.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.345+0000 7fcb65a00640 1 --2- 172.21.15.42:0/155742818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb600b3550 0x7fcb6015cec0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcb600704d0 tx=0x7fcb5002a4d0 comp rx=0 tx=0).stop 2024-09-17T01:32:03.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.345+0000 7fcb65a00640 1 -- 172.21.15.42:0/155742818 shutdown_connections 2024-09-17T01:32:03.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.345+0000 7fcb65a00640 1 --2- 172.21.15.42:0/155742818 >> v2:172.21.15.43:3300/0 conn(0x7fcb60142f40 0x7fcb60072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:03.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.345+0000 7fcb65a00640 1 --2- 172.21.15.42:0/155742818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb600b3550 0x7fcb6015cec0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:03.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.345+0000 7fcb65a00640 1 -- 172.21.15.42:0/155742818 >> 172.21.15.42:0/155742818 conn(0x7fcb600b2930 msgr2=0x7fcb6006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:03.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.345+0000 7fcb65a00640 1 -- 172.21.15.42:0/155742818 shutdown_connections 2024-09-17T01:32:03.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.345+0000 7fcb65a00640 1 -- 172.21.15.42:0/155742818 wait complete. 2024-09-17T01:32:03.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.347+0000 7fcb65a00640 1 Processor -- start 2024-09-17T01:32:03.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.347+0000 7fcb65a00640 1 -- start start 2024-09-17T01:32:03.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.349+0000 7fcb65a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb60072e90 0x7fcb60135460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:03.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.349+0000 7fcb65a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcb600b3550 0x7fcb60137850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:03.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.349+0000 7fcb65a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb60142f40 0x7fcb6006f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:03.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.349+0000 7fcb65a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6006d5b0 con 0x7fcb60142f40 2024-09-17T01:32:03.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.349+0000 7fcb65a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6006d430 con 0x7fcb60072e90 2024-09-17T01:32:03.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.349+0000 7fcb65a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fcb6006d730 con 0x7fcb600b3550 2024-09-17T01:32:03.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.349+0000 7fcb5f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb60142f40 0x7fcb6006f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:03.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.349+0000 7fcb5f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb60142f40 0x7fcb6006f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43350/0 (socket says 172.21.15.42:43350) 2024-09-17T01:32:03.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.349+0000 7fcb5f400640 1 -- 172.21.15.42:0/1424300878 learned_addr learned my addr 172.21.15.42:0/1424300878 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:03.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.349+0000 7fcb5ea00640 1 --2- 172.21.15.42:0/1424300878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb60072e90 0x7fcb60135460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:03.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.349+0000 7fcb56000640 1 --2- 172.21.15.42:0/1424300878 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcb600b3550 0x7fcb60137850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:03.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.350+0000 7fcb5f400640 1 -- 172.21.15.42:0/1424300878 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcb600b3550 msgr2=0x7fcb60137850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:03.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.350+0000 7fcb5f400640 1 --2- 172.21.15.42:0/1424300878 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcb600b3550 0x7fcb60137850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:03.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.350+0000 7fcb5f400640 1 -- 172.21.15.42:0/1424300878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb60072e90 msgr2=0x7fcb60135460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:03.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.350+0000 7fcb5f400640 1 --2- 172.21.15.42:0/1424300878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb60072e90 0x7fcb60135460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:03.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.350+0000 7fcb5f400640 1 -- 172.21.15.42:0/1424300878 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6006ffe0 con 0x7fcb60142f40 2024-09-17T01:32:03.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.350+0000 7fcb5ea00640 1 --2- 172.21.15.42:0/1424300878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb60072e90 0x7fcb60135460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:03.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.350+0000 7fcb56000640 1 --2- 172.21.15.42:0/1424300878 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcb600b3550 0x7fcb60137850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:03.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.350+0000 7fcb5f400640 1 --2- 172.21.15.42:0/1424300878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb60142f40 0x7fcb6006f4e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcb5800b9a0 tx=0x7fcb5800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:03.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.350+0000 7fcb57400640 1 -- 172.21.15.42:0/1424300878 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb58019070 con 0x7fcb60142f40 2024-09-17T01:32:03.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.350+0000 7fcb57400640 1 -- 172.21.15.42:0/1424300878 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb5800cc90 con 0x7fcb60142f40 2024-09-17T01:32:03.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.350+0000 7fcb57400640 1 -- 172.21.15.42:0/1424300878 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb580146a0 con 0x7fcb60142f40 2024-09-17T01:32:03.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.350+0000 7fcb65a00640 1 -- 172.21.15.42:0/1424300878 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb6013f650 con 0x7fcb60142f40 2024-09-17T01:32:03.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.350+0000 7fcb65a00640 1 -- 172.21.15.42:0/1424300878 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb601359a0 con 0x7fcb60142f40 2024-09-17T01:32:03.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.351+0000 7fcb65a00640 1 -- 172.21.15.42:0/1424300878 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb6006fd50 con 0x7fcb60142f40 2024-09-17T01:32:03.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.352+0000 7fcb57400640 1 -- 172.21.15.42:0/1424300878 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcb5801c070 con 0x7fcb60142f40 2024-09-17T01:32:03.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.353+0000 7fcb57400640 1 --2- 172.21.15.42:0/1424300878 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcb3c078bc0 0x7fcb3c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:03.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.354+0000 7fcb57400640 1 -- 172.21.15.42:0/1424300878 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fcb5809a670 con 0x7fcb60142f40 2024-09-17T01:32:03.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.354+0000 7fcb5ea00640 1 --2- 172.21.15.42:0/1424300878 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcb3c078bc0 0x7fcb3c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:03.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.355+0000 7fcb5ea00640 1 --2- 172.21.15.42:0/1424300878 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcb3c078bc0 0x7fcb3c07b0d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcb50033000 tx=0x7fcb50004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:03.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.358+0000 7fcb57400640 1 -- 172.21.15.42:0/1424300878 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcb58062df0 con 0x7fcb60142f40 2024-09-17T01:32:03.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.588+0000 7fcb65a00640 1 -- 172.21.15.42:0/1424300878 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb6013f470 con 0x7fcb60142f40 2024-09-17T01:32:03.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.588+0000 7fcb57400640 1 -- 172.21.15.42:0/1424300878 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3906 (secure 0 0 0) 0x7fcb6013f470 con 0x7fcb60142f40 2024-09-17T01:32:03.586 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:03.586 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":3,"btime":"2024-09-17T01:32:01:759459+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4301,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1899287597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1899287597},{"type":"v1","addr":"172.21.15.43:6836","nonce":1899287597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4359,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3422946855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3422946855},{"type":"v1","addr":"172.21.15.42:6835","nonce":3422946855}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4363,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1971042705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1971042705},{"type":"v1","addr":"172.21.15.42:6833","nonce":1971042705}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4365,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3707512090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3707512090},{"type":"v1","addr":"172.21.15.43:6837","nonce":3707512090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-17T01:32:03.587 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 3 2024-09-17T01:32:03.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.590+0000 7fcb65a00640 1 -- 172.21.15.42:0/1424300878 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcb3c078bc0 msgr2=0x7fcb3c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:03.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.590+0000 7fcb65a00640 1 --2- 172.21.15.42:0/1424300878 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcb3c078bc0 0x7fcb3c07b0d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcb50033000 tx=0x7fcb50004730 comp rx=0 tx=0).stop 2024-09-17T01:32:03.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.590+0000 7fcb65a00640 1 -- 172.21.15.42:0/1424300878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb60142f40 msgr2=0x7fcb6006f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:03.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.590+0000 7fcb65a00640 1 --2- 172.21.15.42:0/1424300878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb60142f40 0x7fcb6006f4e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcb5800b9a0 tx=0x7fcb5800be60 comp rx=0 tx=0).stop 2024-09-17T01:32:03.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.590+0000 7fcb65a00640 1 -- 172.21.15.42:0/1424300878 shutdown_connections 2024-09-17T01:32:03.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.590+0000 7fcb65a00640 1 --2- 172.21.15.42:0/1424300878 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcb3c078bc0 0x7fcb3c07b0d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:03.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.590+0000 7fcb65a00640 1 --2- 172.21.15.42:0/1424300878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb60142f40 0x7fcb6006f4e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:03.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.590+0000 7fcb65a00640 1 --2- 172.21.15.42:0/1424300878 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcb600b3550 0x7fcb60137850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:03.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.590+0000 7fcb65a00640 1 --2- 172.21.15.42:0/1424300878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb60072e90 0x7fcb60135460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:03.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.590+0000 7fcb65a00640 1 -- 172.21.15.42:0/1424300878 >> 172.21.15.42:0/1424300878 conn(0x7fcb600b2930 msgr2=0x7fcb6015e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:03.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.591+0000 7fcb65a00640 1 -- 172.21.15.42:0/1424300878 shutdown_connections 2024-09-17T01:32:03.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.591+0000 7fcb65a00640 1 -- 172.21.15.42:0/1424300878 wait complete. 2024-09-17T01:32:03.609 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T01:32:03.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.838+0000 7f7541a00640 1 -- 172.21.15.42:0/3280218769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7520003f90 msgr2=0x7f7520004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:03.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.838+0000 7f7541a00640 1 --2- 172.21.15.42:0/3280218769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7520003f90 0x7f7520004800 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f752400c290 tx=0x7f7520005830 comp rx=0 tx=0).stop 2024-09-17T01:32:03.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.838+0000 7f7541000640 1 -- 172.21.15.42:0/3280218769 reap_dead start 2024-09-17T01:32:03.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.839+0000 7f7541a00640 1 -- 172.21.15.42:0/3280218769 shutdown_connections 2024-09-17T01:32:03.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.839+0000 7f7541a00640 1 -- 172.21.15.42:0/3280218769 >> 172.21.15.42:0/3280218769 conn(0x7f753c0d1210 msgr2=0x7f753c0d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:03.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.839+0000 7f7541a00640 1 -- 172.21.15.42:0/3280218769 shutdown_connections 2024-09-17T01:32:03.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.839+0000 7f7541a00640 1 -- 172.21.15.42:0/3280218769 wait complete. 2024-09-17T01:32:03.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.841+0000 7f7541a00640 1 Processor -- start 2024-09-17T01:32:03.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.841+0000 7f7541a00640 1 -- start start 2024-09-17T01:32:03.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.842+0000 7f7541a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7520003f90 0x7f753c158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:03.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.842+0000 7f7541a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f753c0caa60 0x7f753c0cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:03.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.842+0000 7f7541a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f753c0ccfb0 0x7f753c0cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:03.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.842+0000 7f7541a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f753c15f640 con 0x7f7520003f90 2024-09-17T01:32:03.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.842+0000 7f7541a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f753c15f4c0 con 0x7f753c0ccfb0 2024-09-17T01:32:03.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.842+0000 7f7541a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f753c15f7c0 con 0x7f753c0caa60 2024-09-17T01:32:03.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.843+0000 7f753be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7520003f90 0x7f753c158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:03.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.843+0000 7f753be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7520003f90 0x7f753c158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43372/0 (socket says 172.21.15.42:43372) 2024-09-17T01:32:03.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.843+0000 7f753be00640 1 -- 172.21.15.42:0/1140749790 learned_addr learned my addr 172.21.15.42:0/1140749790 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:03.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.843+0000 7f7533400640 1 --2- 172.21.15.42:0/1140749790 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f753c0caa60 0x7f753c0cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:03.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.843+0000 7f7541000640 1 --2- 172.21.15.42:0/1140749790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f753c0ccfb0 0x7f753c0cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:03.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.843+0000 7f753be00640 1 -- 172.21.15.42:0/1140749790 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f753c0caa60 msgr2=0x7f753c0cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:03.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.843+0000 7f753be00640 1 --2- 172.21.15.42:0/1140749790 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f753c0caa60 0x7f753c0cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:03.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.843+0000 7f753be00640 1 -- 172.21.15.42:0/1140749790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f753c0ccfb0 msgr2=0x7f753c0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:03.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.843+0000 7f753be00640 1 --2- 172.21.15.42:0/1140749790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f753c0ccfb0 0x7f753c0cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:03.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.843+0000 7f753be00640 1 -- 172.21.15.42:0/1140749790 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753c0cc4e0 con 0x7f7520003f90 2024-09-17T01:32:03.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.843+0000 7f753be00640 1 --2- 172.21.15.42:0/1140749790 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7520003f90 0x7f753c158db0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f752c011ae0 tx=0x7f752c009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:03.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.844+0000 7f7538c00640 1 -- 172.21.15.42:0/1140749790 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c01e070 con 0x7f7520003f90 2024-09-17T01:32:03.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.844+0000 7f7538c00640 1 -- 172.21.15.42:0/1140749790 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f752c00fe70 con 0x7f7520003f90 2024-09-17T01:32:03.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.844+0000 7f7541a00640 1 -- 172.21.15.42:0/1140749790 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f753c159590 con 0x7f7520003f90 2024-09-17T01:32:03.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.844+0000 7f7538c00640 1 -- 172.21.15.42:0/1140749790 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c004290 con 0x7f7520003f90 2024-09-17T01:32:03.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.844+0000 7f7541a00640 1 -- 172.21.15.42:0/1140749790 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f753c0cc760 con 0x7f7520003f90 2024-09-17T01:32:03.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.845+0000 7f7541a00640 1 -- 172.21.15.42:0/1140749790 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f753c159760 con 0x7f7520003f90 2024-09-17T01:32:03.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.846+0000 7f7538c00640 1 -- 172.21.15.42:0/1140749790 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f752c021070 con 0x7f7520003f90 2024-09-17T01:32:03.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.847+0000 7f7538c00640 1 --2- 172.21.15.42:0/1140749790 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7518078b90 0x7f751807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:03.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.847+0000 7f7538c00640 1 -- 172.21.15.42:0/1140749790 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f752c09b450 con 0x7f7520003f90 2024-09-17T01:32:03.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.848+0000 7f7533400640 1 --2- 172.21.15.42:0/1140749790 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7518078b90 0x7f751807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:03.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.848+0000 7f7533400640 1 --2- 172.21.15.42:0/1140749790 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7518078b90 0x7f751807b0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7524033000 tx=0x7f752402d000 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:03.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:03.852+0000 7f7538c00640 1 -- 172.21.15.42:0/1140749790 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f753c0cc4e0 con 0x7f7520003f90 2024-09-17T01:32:04.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.047+0000 7f7541a00640 1 -- 172.21.15.42:0/1140749790 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f753c0b73e0 con 0x7f7520003f90 2024-09-17T01:32:04.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.048+0000 7f7538c00640 1 -- 172.21.15.42:0/1140749790 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f753c0b73e0 con 0x7f7520003f90 2024-09-17T01:32:04.046 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:04.046 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-09-17T01:32:04.046 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:04.046 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-09-17T01:32:04.046 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-09-17T01:32:04.046 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:04.046 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-09-17T01:32:04.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.051+0000 7f7541a00640 1 -- 172.21.15.42:0/1140749790 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7518078b90 msgr2=0x7f751807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:04.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.051+0000 7f7541a00640 1 --2- 172.21.15.42:0/1140749790 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7518078b90 0x7f751807b0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7524033000 tx=0x7f752402d000 comp rx=0 tx=0).stop 2024-09-17T01:32:04.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.051+0000 7f7541a00640 1 -- 172.21.15.42:0/1140749790 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7520003f90 msgr2=0x7f753c158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:04.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.051+0000 7f7541a00640 1 --2- 172.21.15.42:0/1140749790 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7520003f90 0x7f753c158db0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f752c011ae0 tx=0x7f752c009e90 comp rx=0 tx=0).stop 2024-09-17T01:32:04.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.051+0000 7f7541a00640 1 -- 172.21.15.42:0/1140749790 shutdown_connections 2024-09-17T01:32:04.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.051+0000 7f7541a00640 1 --2- 172.21.15.42:0/1140749790 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7518078b90 0x7f751807b0a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:04.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.051+0000 7f7541a00640 1 --2- 172.21.15.42:0/1140749790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f753c0ccfb0 0x7f753c0cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:04.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.051+0000 7f7541a00640 1 --2- 172.21.15.42:0/1140749790 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f753c0caa60 0x7f753c0cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:04.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.051+0000 7f7541a00640 1 --2- 172.21.15.42:0/1140749790 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7520003f90 0x7f753c158db0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:04.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.051+0000 7f7541a00640 1 -- 172.21.15.42:0/1140749790 >> 172.21.15.42:0/1140749790 conn(0x7f753c0d1210 msgr2=0x7f753c0b4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:04.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.051+0000 7f7541a00640 1 -- 172.21.15.42:0/1140749790 shutdown_connections 2024-09-17T01:32:04.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.051+0000 7f7541a00640 1 -- 172.21.15.42:0/1140749790 wait complete. 2024-09-17T01:32:04.072 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T01:32:04.072 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T01:32:04.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.307+0000 7fe2a2600640 1 -- 172.21.15.42:0/2776274383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe29c0d3e70 msgr2=0x7fe29c0cf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:04.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.307+0000 7fe2a2600640 1 --2- 172.21.15.42:0/2776274383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe29c0d3e70 0x7fe29c0cf390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe294005fd0 tx=0x7fe29402a940 comp rx=0 tx=0).stop 2024-09-17T01:32:04.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.307+0000 7fe2a2600640 1 -- 172.21.15.42:0/2776274383 shutdown_connections 2024-09-17T01:32:04.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.307+0000 7fe2a2600640 1 --2- 172.21.15.42:0/2776274383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe29c0d3e70 0x7fe29c0cf390 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:04.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.307+0000 7fe2a2600640 1 -- 172.21.15.42:0/2776274383 >> 172.21.15.42:0/2776274383 conn(0x7fe29c06cf00 msgr2=0x7fe29c06d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:04.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.307+0000 7fe2a2600640 1 -- 172.21.15.42:0/2776274383 shutdown_connections 2024-09-17T01:32:04.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.307+0000 7fe2a2600640 1 -- 172.21.15.42:0/2776274383 wait complete. 2024-09-17T01:32:04.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.309+0000 7fe2a2600640 1 Processor -- start 2024-09-17T01:32:04.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.309+0000 7fe2a2600640 1 -- start start 2024-09-17T01:32:04.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.311+0000 7fe2a2600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe29c0d13c0 0x7fe29c1f99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:04.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.311+0000 7fe2a2600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe29c0d3e70 0x7fe29c15d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:04.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.311+0000 7fe2a2600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe29c162490 0x7fe29c0b8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:04.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.311+0000 7fe2a2600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c0cf8d0 con 0x7fe29c0d3e70 2024-09-17T01:32:04.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.311+0000 7fe2a2600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c162ab0 con 0x7fe29c0d13c0 2024-09-17T01:32:04.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.311+0000 7fe2a2600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe29c0cfa50 con 0x7fe29c162490 2024-09-17T01:32:04.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.311+0000 7fe293e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe29c0d3e70 0x7fe29c15d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:04.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.311+0000 7fe2a1200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe29c0d13c0 0x7fe29c1f99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:04.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.311+0000 7fe293e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe29c0d3e70 0x7fe29c15d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43380/0 (socket says 172.21.15.42:43380) 2024-09-17T01:32:04.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.311+0000 7fe2a1200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe29c0d13c0 0x7fe29c1f99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:50062/0 (socket says 172.21.15.42:50062) 2024-09-17T01:32:04.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.311+0000 7fe293e00640 1 -- 172.21.15.42:0/3438697310 learned_addr learned my addr 172.21.15.42:0/3438697310 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:04.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.311+0000 7fe2a1c00640 1 --2- 172.21.15.42:0/3438697310 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe29c162490 0x7fe29c0b8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:04.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.312+0000 7fe293e00640 1 -- 172.21.15.42:0/3438697310 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe29c162490 msgr2=0x7fe29c0b8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:04.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.312+0000 7fe293e00640 1 --2- 172.21.15.42:0/3438697310 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe29c162490 0x7fe29c0b8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:04.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.312+0000 7fe293e00640 1 -- 172.21.15.42:0/3438697310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe29c0d13c0 msgr2=0x7fe29c1f99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:04.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.312+0000 7fe293e00640 1 --2- 172.21.15.42:0/3438697310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe29c0d13c0 0x7fe29c1f99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:04.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.312+0000 7fe293e00640 1 -- 172.21.15.42:0/3438697310 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe29c15dc20 con 0x7fe29c0d3e70 2024-09-17T01:32:04.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.312+0000 7fe2a1200640 1 --2- 172.21.15.42:0/3438697310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe29c0d13c0 0x7fe29c1f99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:32:04.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.312+0000 7fe293e00640 1 --2- 172.21.15.42:0/3438697310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe29c0d3e70 0x7fe29c15d6e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe28400c430 tx=0x7fe28400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:04.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.312+0000 7fe299600640 1 -- 172.21.15.42:0/3438697310 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe284017070 con 0x7fe29c0d3e70 2024-09-17T01:32:04.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.312+0000 7fe299600640 1 -- 172.21.15.42:0/3438697310 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2840053c0 con 0x7fe29c0d3e70 2024-09-17T01:32:04.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.312+0000 7fe2a2600640 1 -- 172.21.15.42:0/3438697310 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe29c0c8630 con 0x7fe29c0d3e70 2024-09-17T01:32:04.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.312+0000 7fe299600640 1 -- 172.21.15.42:0/3438697310 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe284003850 con 0x7fe29c0d3e70 2024-09-17T01:32:04.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.312+0000 7fe2a2600640 1 -- 172.21.15.42:0/3438697310 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe29c0c8bf0 con 0x7fe29c0d3e70 2024-09-17T01:32:04.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.313+0000 7fe2a2600640 1 -- 172.21.15.42:0/3438697310 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe29c0d2580 con 0x7fe29c0d3e70 2024-09-17T01:32:04.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.315+0000 7fe299600640 1 -- 172.21.15.42:0/3438697310 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe28401a070 con 0x7fe29c0d3e70 2024-09-17T01:32:04.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.316+0000 7fe299600640 1 --2- 172.21.15.42:0/3438697310 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe278078b90 0x7fe27807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:04.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.316+0000 7fe299600640 1 -- 172.21.15.42:0/3438697310 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fe284099d50 con 0x7fe29c0d3e70 2024-09-17T01:32:04.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.316+0000 7fe2a1200640 1 --2- 172.21.15.42:0/3438697310 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe278078b90 0x7fe27807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:04.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.317+0000 7fe2a1200640 1 --2- 172.21.15.42:0/3438697310 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe278078b90 0x7fe27807b0a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe28c007fd0 tx=0x7fe28c007cc0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:04.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.320+0000 7fe299600640 1 -- 172.21.15.42:0/3438697310 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe29c0d2580 con 0x7fe29c0d3e70 2024-09-17T01:32:04.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:04.514+0000 7fe2a2600640 1 -- 172.21.15.42:0/3438697310 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe29c0b7b60 con 0x7fe29c0d3e70 2024-09-17T01:32:05.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.034+0000 7fe299600640 1 -- 172.21.15.42:0/3438697310 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7fe284061df0 con 0x7fe29c0d3e70 2024-09-17T01:32:05.032 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-09-17T01:32:05.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.037+0000 7fe2a2600640 1 -- 172.21.15.42:0/3438697310 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe278078b90 msgr2=0x7fe27807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:05.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.037+0000 7fe2a2600640 1 --2- 172.21.15.42:0/3438697310 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe278078b90 0x7fe27807b0a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe28c007fd0 tx=0x7fe28c007cc0 comp rx=0 tx=0).stop 2024-09-17T01:32:05.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.037+0000 7fe2a2600640 1 -- 172.21.15.42:0/3438697310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe29c0d3e70 msgr2=0x7fe29c15d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:05.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.037+0000 7fe2a2600640 1 --2- 172.21.15.42:0/3438697310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe29c0d3e70 0x7fe29c15d6e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe28400c430 tx=0x7fe28400c8f0 comp rx=0 tx=0).stop 2024-09-17T01:32:05.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.037+0000 7fe2a2600640 1 -- 172.21.15.42:0/3438697310 shutdown_connections 2024-09-17T01:32:05.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.037+0000 7fe2a2600640 1 --2- 172.21.15.42:0/3438697310 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe278078b90 0x7fe27807b0a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:05.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.037+0000 7fe2a2600640 1 --2- 172.21.15.42:0/3438697310 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe29c162490 0x7fe29c0b8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:05.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.037+0000 7fe2a2600640 1 --2- 172.21.15.42:0/3438697310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe29c0d3e70 0x7fe29c15d6e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:05.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.037+0000 7fe2a2600640 1 --2- 172.21.15.42:0/3438697310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe29c0d13c0 0x7fe29c1f99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:05.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.037+0000 7fe2a2600640 1 -- 172.21.15.42:0/3438697310 >> 172.21.15.42:0/3438697310 conn(0x7fe29c06cf00 msgr2=0x7fe29c161410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:05.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.037+0000 7fe2a2600640 1 -- 172.21.15.42:0/3438697310 shutdown_connections 2024-09-17T01:32:05.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.037+0000 7fe2a2600640 1 -- 172.21.15.42:0/3438697310 wait complete. 2024-09-17T01:32:05.062 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T01:32:05.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.300+0000 7f1022e00640 1 -- 172.21.15.42:0/3497378216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1000003a30 msgr2=0x7f1000003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:05.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.300+0000 7f1022e00640 1 --2- 172.21.15.42:0/3497378216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1000003a30 0x7f1000003ea0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f100c006fd0 tx=0x7f1000005830 comp rx=0 tx=0).stop 2024-09-17T01:32:05.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.300+0000 7f1020e00640 1 -- 172.21.15.42:0/3497378216 reap_dead start 2024-09-17T01:32:05.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.300+0000 7f1022e00640 1 -- 172.21.15.42:0/3497378216 shutdown_connections 2024-09-17T01:32:05.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.300+0000 7f1022e00640 1 -- 172.21.15.42:0/3497378216 >> 172.21.15.42:0/3497378216 conn(0x7f101c06cd20 msgr2=0x7f101c06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:05.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.300+0000 7f1022e00640 1 -- 172.21.15.42:0/3497378216 shutdown_connections 2024-09-17T01:32:05.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.300+0000 7f1022e00640 1 -- 172.21.15.42:0/3497378216 wait complete. 2024-09-17T01:32:05.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.302+0000 7f1022e00640 1 Processor -- start 2024-09-17T01:32:05.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.302+0000 7f1022e00640 1 -- start start 2024-09-17T01:32:05.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.304+0000 7f1022e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1000003a30 0x7f101c1f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:05.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.304+0000 7f1022e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f101c149e00 0x7f101c0cf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:05.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.304+0000 7f1022e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f101c0cfad0 0x7f101c14dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:05.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.304+0000 7f1022e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f101c167c00 con 0x7f1000003a30 2024-09-17T01:32:05.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.304+0000 7f1022e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f101c167a80 con 0x7f101c149e00 2024-09-17T01:32:05.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.304+0000 7f1022e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f101c167d80 con 0x7f101c0cfad0 2024-09-17T01:32:05.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.304+0000 7f101be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1000003a30 0x7f101c1f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:05.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.304+0000 7f101be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1000003a30 0x7f101c1f6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43398/0 (socket says 172.21.15.42:43398) 2024-09-17T01:32:05.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.304+0000 7f101be00640 1 -- 172.21.15.42:0/3434496045 learned_addr learned my addr 172.21.15.42:0/3434496045 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:05.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.304+0000 7f1013400640 1 --2- 172.21.15.42:0/3434496045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f101c149e00 0x7f101c0cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:05.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.304+0000 7f1020e00640 1 --2- 172.21.15.42:0/3434496045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f101c0cfad0 0x7f101c14dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:05.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.304+0000 7f101be00640 1 -- 172.21.15.42:0/3434496045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f101c0cfad0 msgr2=0x7f101c14dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:05.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.304+0000 7f101be00640 1 --2- 172.21.15.42:0/3434496045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f101c0cfad0 0x7f101c14dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:05.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.304+0000 7f101be00640 1 -- 172.21.15.42:0/3434496045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f101c149e00 msgr2=0x7f101c0cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:05.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.304+0000 7f101be00640 1 --2- 172.21.15.42:0/3434496045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f101c149e00 0x7f101c0cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:05.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.304+0000 7f101be00640 1 -- 172.21.15.42:0/3434496045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101c0cfee0 con 0x7f1000003a30 2024-09-17T01:32:05.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.304+0000 7f1020e00640 1 --2- 172.21.15.42:0/3434496045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f101c0cfad0 0x7f101c14dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:32:05.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.305+0000 7f101be00640 1 --2- 172.21.15.42:0/3434496045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1000003a30 0x7f101c1f6650 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f100c00c3d0 tx=0x7f100c001db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:05.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.305+0000 7f1018c00640 1 -- 172.21.15.42:0/3434496045 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c031040 con 0x7f1000003a30 2024-09-17T01:32:05.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.305+0000 7f1018c00640 1 -- 172.21.15.42:0/3434496045 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f100c006520 con 0x7f1000003a30 2024-09-17T01:32:05.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.305+0000 7f1022e00640 1 -- 172.21.15.42:0/3434496045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f101c14fa40 con 0x7f1000003a30 2024-09-17T01:32:05.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.305+0000 7f1018c00640 1 -- 172.21.15.42:0/3434496045 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c003a60 con 0x7f1000003a30 2024-09-17T01:32:05.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.305+0000 7f1022e00640 1 -- 172.21.15.42:0/3434496045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f101c1f5e50 con 0x7f1000003a30 2024-09-17T01:32:05.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.306+0000 7f1022e00640 1 -- 172.21.15.42:0/3434496045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f101c162bb0 con 0x7f1000003a30 2024-09-17T01:32:05.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.307+0000 7f1018c00640 1 -- 172.21.15.42:0/3434496045 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f100c03e030 con 0x7f1000003a30 2024-09-17T01:32:05.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.309+0000 7f1018c00640 1 --2- 172.21.15.42:0/3434496045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0ff8078b90 0x7f0ff807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:05.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.309+0000 7f1018c00640 1 -- 172.21.15.42:0/3434496045 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7f100c0ba990 con 0x7f1000003a30 2024-09-17T01:32:05.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.309+0000 7f1013400640 1 --2- 172.21.15.42:0/3434496045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0ff8078b90 0x7f0ff807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:05.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.310+0000 7f1013400640 1 --2- 172.21.15.42:0/3434496045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0ff8078b90 0x7f0ff807b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f101c0cad50 tx=0x7f1004006b70 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:05.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.314+0000 7f1018c00640 1 -- 172.21.15.42:0/3434496045 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f101c0cfee0 con 0x7f1000003a30 2024-09-17T01:32:05.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:05.511+0000 7f1022e00640 1 -- 172.21.15.42:0/3434496045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f101c0ceef0 con 0x7f1000003a30 2024-09-17T01:32:06.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.037+0000 7f1018c00640 1 -- 172.21.15.42:0/3434496045 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) ==== 170+0+0 (secure 0 0 0) 0x7f100c082fa0 con 0x7f1000003a30 2024-09-17T01:32:06.035 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-09-17T01:32:06.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.041+0000 7f1022e00640 1 -- 172.21.15.42:0/3434496045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0ff8078b90 msgr2=0x7f0ff807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:06.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.041+0000 7f1022e00640 1 --2- 172.21.15.42:0/3434496045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0ff8078b90 0x7f0ff807b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f101c0cad50 tx=0x7f1004006b70 comp rx=0 tx=0).stop 2024-09-17T01:32:06.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.041+0000 7f1022e00640 1 -- 172.21.15.42:0/3434496045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1000003a30 msgr2=0x7f101c1f6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:06.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.041+0000 7f1022e00640 1 --2- 172.21.15.42:0/3434496045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1000003a30 0x7f101c1f6650 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f100c00c3d0 tx=0x7f100c001db0 comp rx=0 tx=0).stop 2024-09-17T01:32:06.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.041+0000 7f1022e00640 1 -- 172.21.15.42:0/3434496045 shutdown_connections 2024-09-17T01:32:06.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.041+0000 7f1022e00640 1 --2- 172.21.15.42:0/3434496045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0ff8078b90 0x7f0ff807b0a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:06.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.041+0000 7f1022e00640 1 --2- 172.21.15.42:0/3434496045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f101c149e00 0x7f101c0cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:06.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.041+0000 7f1022e00640 1 --2- 172.21.15.42:0/3434496045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f101c0cfad0 0x7f101c14dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:06.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.041+0000 7f1022e00640 1 --2- 172.21.15.42:0/3434496045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1000003a30 0x7f101c1f6650 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:06.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.041+0000 7f1022e00640 1 -- 172.21.15.42:0/3434496045 >> 172.21.15.42:0/3434496045 conn(0x7f101c06cd20 msgr2=0x7f101c154060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:06.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.041+0000 7f1022e00640 1 -- 172.21.15.42:0/3434496045 shutdown_connections 2024-09-17T01:32:06.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.041+0000 7f1022e00640 1 -- 172.21.15.42:0/3434496045 wait complete. 2024-09-17T01:32:06.082 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T01:32:06.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.318+0000 7f298f600640 1 -- 172.21.15.42:0/1929539472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f296c005320 msgr2=0x7f296c00b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:06.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.318+0000 7f298f600640 1 --2- 172.21.15.42:0/1929539472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f296c005320 0x7f296c00b9e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2980009ed0 tx=0x7f296c005830 comp rx=0 tx=0).stop 2024-09-17T01:32:06.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.318+0000 7f298f600640 1 -- 172.21.15.42:0/1929539472 shutdown_connections 2024-09-17T01:32:06.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.318+0000 7f298f600640 1 --2- 172.21.15.42:0/1929539472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f296c005320 0x7f296c00b9e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:06.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.318+0000 7f298f600640 1 -- 172.21.15.42:0/1929539472 >> 172.21.15.42:0/1929539472 conn(0x7f29880b2930 msgr2=0x7f298806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:06.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.318+0000 7f298f600640 1 -- 172.21.15.42:0/1929539472 shutdown_connections 2024-09-17T01:32:06.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.318+0000 7f298f600640 1 -- 172.21.15.42:0/1929539472 wait complete. 2024-09-17T01:32:06.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.321+0000 7f298f600640 1 Processor -- start 2024-09-17T01:32:06.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.321+0000 7f298f600640 1 -- start start 2024-09-17T01:32:06.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.322+0000 7f298f600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f296c005320 0x7f2988141600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:06.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.322+0000 7f298f600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29881f6f20 0x7f29881f7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:06.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.322+0000 7f298f600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f29880b03f0 0x7f29880b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:06.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.322+0000 7f298f600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f298815fc20 con 0x7f296c005320 2024-09-17T01:32:06.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.322+0000 7f298f600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f298815faa0 con 0x7f29881f6f20 2024-09-17T01:32:06.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.322+0000 7f298f600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f298815fda0 con 0x7f29880b03f0 2024-09-17T01:32:06.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.322+0000 7f298cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f296c005320 0x7f2988141600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:06.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.322+0000 7f298cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f296c005320 0x7f2988141600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50196/0 (socket says 172.21.15.42:50196) 2024-09-17T01:32:06.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.322+0000 7f298cc00640 1 -- 172.21.15.42:0/1390502695 learned_addr learned my addr 172.21.15.42:0/1390502695 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:06.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.323+0000 7f297fe00640 1 --2- 172.21.15.42:0/1390502695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29881f6f20 0x7f29881f7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:06.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.323+0000 7f298d600640 1 --2- 172.21.15.42:0/1390502695 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f29880b03f0 0x7f29880b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:06.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.323+0000 7f298cc00640 1 -- 172.21.15.42:0/1390502695 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f29880b03f0 msgr2=0x7f29880b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:06.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.323+0000 7f298cc00640 1 --2- 172.21.15.42:0/1390502695 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f29880b03f0 0x7f29880b0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:06.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.323+0000 7f298cc00640 1 -- 172.21.15.42:0/1390502695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29881f6f20 msgr2=0x7f29881f7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:06.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.323+0000 7f298cc00640 1 --2- 172.21.15.42:0/1390502695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29881f6f20 0x7f29881f7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:06.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.323+0000 7f298cc00640 1 -- 172.21.15.42:0/1390502695 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29880b0d40 con 0x7f296c005320 2024-09-17T01:32:06.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.323+0000 7f298cc00640 1 --2- 172.21.15.42:0/1390502695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f296c005320 0x7f2988141600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f297800f600 tx=0x7f297800fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:06.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.323+0000 7f2985600640 1 -- 172.21.15.42:0/1390502695 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2978016030 con 0x7f296c005320 2024-09-17T01:32:06.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.323+0000 7f2985600640 1 -- 172.21.15.42:0/1390502695 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f297800d810 con 0x7f296c005320 2024-09-17T01:32:06.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.323+0000 7f2985600640 1 -- 172.21.15.42:0/1390502695 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297800dc60 con 0x7f296c005320 2024-09-17T01:32:06.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.323+0000 7f298f600640 1 -- 172.21.15.42:0/1390502695 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29881f3920 con 0x7f296c005320 2024-09-17T01:32:06.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.324+0000 7f298f600640 1 -- 172.21.15.42:0/1390502695 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29881f3ee0 con 0x7f296c005320 2024-09-17T01:32:06.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.325+0000 7f298f600640 1 -- 172.21.15.42:0/1390502695 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2988152610 con 0x7f296c005320 2024-09-17T01:32:06.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.326+0000 7f2985600640 1 -- 172.21.15.42:0/1390502695 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2978019070 con 0x7f296c005320 2024-09-17T01:32:06.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.327+0000 7f2985600640 1 --2- 172.21.15.42:0/1390502695 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2964078b90 0x7f296407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:06.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.327+0000 7f2985600640 1 -- 172.21.15.42:0/1390502695 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7f297809b8d0 con 0x7f296c005320 2024-09-17T01:32:06.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.328+0000 7f297fe00640 1 --2- 172.21.15.42:0/1390502695 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2964078b90 0x7f296407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:06.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.328+0000 7f297fe00640 1 --2- 172.21.15.42:0/1390502695 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2964078b90 0x7f296407b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f29880763b0 tx=0x7f29700015c0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:06.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.331+0000 7f2985600640 1 -- 172.21.15.42:0/1390502695 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f29880b0d40 con 0x7f296c005320 2024-09-17T01:32:06.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:06.565+0000 7f298f600640 1 -- 172.21.15.42:0/1390502695 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f298806a170 con 0x7f296c005320 2024-09-17T01:32:07.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.067+0000 7f2985600640 1 -- 172.21.15.42:0/1390502695 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f298815be20 con 0x7f296c005320 2024-09-17T01:32:07.065 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 2 and data pool 3 2024-09-17T01:32:07.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.073+0000 7f298f600640 1 -- 172.21.15.42:0/1390502695 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2964078b90 msgr2=0x7f296407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:07.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.073+0000 7f298f600640 1 --2- 172.21.15.42:0/1390502695 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2964078b90 0x7f296407b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f29880763b0 tx=0x7f29700015c0 comp rx=0 tx=0).stop 2024-09-17T01:32:07.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.073+0000 7f298f600640 1 -- 172.21.15.42:0/1390502695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f296c005320 msgr2=0x7f2988141600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:07.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.073+0000 7f298f600640 1 --2- 172.21.15.42:0/1390502695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f296c005320 0x7f2988141600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f297800f600 tx=0x7f297800fac0 comp rx=0 tx=0).stop 2024-09-17T01:32:07.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.074+0000 7f298f600640 1 -- 172.21.15.42:0/1390502695 shutdown_connections 2024-09-17T01:32:07.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.074+0000 7f298f600640 1 --2- 172.21.15.42:0/1390502695 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2964078b90 0x7f296407b0a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:07.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.074+0000 7f298f600640 1 --2- 172.21.15.42:0/1390502695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29881f6f20 0x7f29881f7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:07.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.074+0000 7f298f600640 1 --2- 172.21.15.42:0/1390502695 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f29880b03f0 0x7f29880b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:07.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.074+0000 7f298f600640 1 --2- 172.21.15.42:0/1390502695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f296c005320 0x7f2988141600 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:07.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.074+0000 7f298f600640 1 -- 172.21.15.42:0/1390502695 >> 172.21.15.42:0/1390502695 conn(0x7f29880b2930 msgr2=0x7f2988073260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:07.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.074+0000 7f298f600640 1 -- 172.21.15.42:0/1390502695 shutdown_connections 2024-09-17T01:32:07.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.074+0000 7f298f600640 1 -- 172.21.15.42:0/1390502695 wait complete. 2024-09-17T01:32:07.113 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:32:07.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.344+0000 7f946da00640 1 -- 172.21.15.42:0/1535070745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f944c004b60 msgr2=0x7f944c004fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:07.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.344+0000 7f946da00640 1 --2- 172.21.15.42:0/1535070745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f944c004b60 0x7f944c004fd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f945800c610 tx=0x7f944c006940 comp rx=0 tx=0).stop 2024-09-17T01:32:07.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.344+0000 7f946da00640 1 -- 172.21.15.42:0/1535070745 shutdown_connections 2024-09-17T01:32:07.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.344+0000 7f946da00640 1 --2- 172.21.15.42:0/1535070745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f944c004b60 0x7f944c004fd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:07.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.344+0000 7f946da00640 1 -- 172.21.15.42:0/1535070745 >> 172.21.15.42:0/1535070745 conn(0x7f94680b2930 msgr2=0x7f946806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:07.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.344+0000 7f946da00640 1 -- 172.21.15.42:0/1535070745 shutdown_connections 2024-09-17T01:32:07.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.344+0000 7f946da00640 1 -- 172.21.15.42:0/1535070745 wait complete. 2024-09-17T01:32:07.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.346+0000 7f946da00640 1 Processor -- start 2024-09-17T01:32:07.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.346+0000 7f946da00640 1 -- start start 2024-09-17T01:32:07.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.348+0000 7f946da00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f944c004b60 0x7f946814baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:07.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.348+0000 7f946da00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9468150be0 0x7f946815d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:07.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.348+0000 7f946da00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f946815d980 0x7f9468153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:07.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.348+0000 7f946da00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f946815bdd0 con 0x7f9468150be0 2024-09-17T01:32:07.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.348+0000 7f946da00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f946815bc50 con 0x7f944c004b60 2024-09-17T01:32:07.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.348+0000 7f946da00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f946815bf50 con 0x7f946815d980 2024-09-17T01:32:07.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.348+0000 7f9466000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9468150be0 0x7f946815d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:07.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.348+0000 7f9466000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9468150be0 0x7f946815d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50218/0 (socket says 172.21.15.42:50218) 2024-09-17T01:32:07.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.348+0000 7f9466000640 1 -- 172.21.15.42:0/3390141031 learned_addr learned my addr 172.21.15.42:0/3390141031 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:07.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.348+0000 7f9466a00640 1 --2- 172.21.15.42:0/3390141031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f944c004b60 0x7f946814baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:07.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.348+0000 7f9467400640 1 --2- 172.21.15.42:0/3390141031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f946815d980 0x7f9468153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:07.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.348+0000 7f9466000640 1 -- 172.21.15.42:0/3390141031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f946815d980 msgr2=0x7f9468153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:07.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.348+0000 7f9466000640 1 --2- 172.21.15.42:0/3390141031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f946815d980 0x7f9468153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:07.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.348+0000 7f9466000640 1 -- 172.21.15.42:0/3390141031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f944c004b60 msgr2=0x7f946814baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:07.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.348+0000 7f9466000640 1 --2- 172.21.15.42:0/3390141031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f944c004b60 0x7f946814baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:07.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.349+0000 7f9466000640 1 -- 172.21.15.42:0/3390141031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f946815dd90 con 0x7f9468150be0 2024-09-17T01:32:07.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.349+0000 7f9466a00640 1 --2- 172.21.15.42:0/3390141031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f944c004b60 0x7f946814baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:07.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.349+0000 7f9466000640 1 --2- 172.21.15.42:0/3390141031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9468150be0 0x7f946815d440 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9454003ea0 tx=0x7f9454003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:07.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.349+0000 7f945ea00640 1 -- 172.21.15.42:0/3390141031 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9454015070 con 0x7f9468150be0 2024-09-17T01:32:07.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.349+0000 7f945ea00640 1 -- 172.21.15.42:0/3390141031 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9454011840 con 0x7f9468150be0 2024-09-17T01:32:07.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.349+0000 7f946da00640 1 -- 172.21.15.42:0/3390141031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9468158a70 con 0x7f9468150be0 2024-09-17T01:32:07.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.349+0000 7f945ea00640 1 -- 172.21.15.42:0/3390141031 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9454011c70 con 0x7f9468150be0 2024-09-17T01:32:07.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.349+0000 7f946da00640 1 -- 172.21.15.42:0/3390141031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94681f8f80 con 0x7f9468150be0 2024-09-17T01:32:07.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.350+0000 7f946da00640 1 -- 172.21.15.42:0/3390141031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9468073970 con 0x7f9468150be0 2024-09-17T01:32:07.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.352+0000 7f945ea00640 1 -- 172.21.15.42:0/3390141031 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9454018070 con 0x7f9468150be0 2024-09-17T01:32:07.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.352+0000 7f945ea00640 1 --2- 172.21.15.42:0/3390141031 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9448078b90 0x7f944807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:07.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.353+0000 7f945ea00640 1 -- 172.21.15.42:0/3390141031 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f945409b9e0 con 0x7f9468150be0 2024-09-17T01:32:07.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.353+0000 7f9466a00640 1 --2- 172.21.15.42:0/3390141031 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9448078b90 0x7f944807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:07.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.354+0000 7f9466a00640 1 --2- 172.21.15.42:0/3390141031 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9448078b90 0x7f944807b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9458033000 tx=0x7f9458001bc0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:07.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.357+0000 7f945ea00640 1 -- 172.21.15.42:0/3390141031 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9468073970 con 0x7f9468150be0 2024-09-17T01:32:07.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.551+0000 7f946da00640 1 -- 172.21.15.42:0/3390141031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94681587d0 con 0x7f9468150be0 2024-09-17T01:32:07.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.552+0000 7f945ea00640 1 -- 172.21.15.42:0/3390141031 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16634 (secure 0 0 0) 0x7f946815dd90 con 0x7f9468150be0 2024-09-17T01:32:07.550 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:07.550 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:32:06.566572+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:32:04.526150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T01:32:05.523607+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:32:07.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.554+0000 7f946da00640 1 -- 172.21.15.42:0/3390141031 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9448078b90 msgr2=0x7f944807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:07.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.554+0000 7f946da00640 1 --2- 172.21.15.42:0/3390141031 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9448078b90 0x7f944807b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9458033000 tx=0x7f9458001bc0 comp rx=0 tx=0).stop 2024-09-17T01:32:07.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.554+0000 7f946da00640 1 -- 172.21.15.42:0/3390141031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9468150be0 msgr2=0x7f946815d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:07.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.554+0000 7f946da00640 1 --2- 172.21.15.42:0/3390141031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9468150be0 0x7f946815d440 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9454003ea0 tx=0x7f9454003f90 comp rx=0 tx=0).stop 2024-09-17T01:32:07.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.554+0000 7f946da00640 1 -- 172.21.15.42:0/3390141031 shutdown_connections 2024-09-17T01:32:07.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.554+0000 7f946da00640 1 --2- 172.21.15.42:0/3390141031 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9448078b90 0x7f944807b0a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:07.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.554+0000 7f946da00640 1 --2- 172.21.15.42:0/3390141031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f946815d980 0x7f9468153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:07.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.554+0000 7f946da00640 1 --2- 172.21.15.42:0/3390141031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9468150be0 0x7f946815d440 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:07.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.554+0000 7f946da00640 1 --2- 172.21.15.42:0/3390141031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f944c004b60 0x7f946814baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:07.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.554+0000 7f946da00640 1 -- 172.21.15.42:0/3390141031 >> 172.21.15.42:0/3390141031 conn(0x7f94680b2930 msgr2=0x7f946806f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:07.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.555+0000 7f946da00640 1 -- 172.21.15.42:0/3390141031 shutdown_connections 2024-09-17T01:32:07.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.555+0000 7f946da00640 1 -- 172.21.15.42:0/3390141031 wait complete. 2024-09-17T01:32:07.574 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:32:07.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.803+0000 7f4c50a00640 1 -- 172.21.15.42:0/2509391934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c4c073340 msgr2=0x7f4c4c0d2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:07.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.803+0000 7f4c50a00640 1 --2- 172.21.15.42:0/2509391934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c4c073340 0x7f4c4c0d2810 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c009860 tx=0x7f4c3c02a560 comp rx=0 tx=0).stop 2024-09-17T01:32:07.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.804+0000 7f4c50a00640 1 -- 172.21.15.42:0/2509391934 shutdown_connections 2024-09-17T01:32:07.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.804+0000 7f4c50a00640 1 --2- 172.21.15.42:0/2509391934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c4c073340 0x7f4c4c0d2810 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:07.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.804+0000 7f4c50a00640 1 -- 172.21.15.42:0/2509391934 >> 172.21.15.42:0/2509391934 conn(0x7f4c4c0d1210 msgr2=0x7f4c4c0d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:07.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.804+0000 7f4c50a00640 1 -- 172.21.15.42:0/2509391934 shutdown_connections 2024-09-17T01:32:07.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.804+0000 7f4c50a00640 1 -- 172.21.15.42:0/2509391934 wait complete. 2024-09-17T01:32:07.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.806+0000 7f4c50a00640 1 Processor -- start 2024-09-17T01:32:07.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.806+0000 7f4c50a00640 1 -- start start 2024-09-17T01:32:07.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.807+0000 7f4c50a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c4c073340 0x7f4c4c157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:07.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.808+0000 7f4c50a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4c4c0b6030 0x7f4c4c15a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:07.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.808+0000 7f4c50a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c4c162fa0 0x7f4c4c156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:07.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.808+0000 7f4c50a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4c15fa40 con 0x7f4c4c073340 2024-09-17T01:32:07.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.808+0000 7f4c50a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4c15f8c0 con 0x7f4c4c162fa0 2024-09-17T01:32:07.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.808+0000 7f4c50a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4c4c15fbc0 con 0x7f4c4c0b6030 2024-09-17T01:32:07.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.808+0000 7f4c4b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c4c073340 0x7f4c4c157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:07.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.808+0000 7f4c4b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c4c073340 0x7f4c4c157220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50240/0 (socket says 172.21.15.42:50240) 2024-09-17T01:32:07.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.808+0000 7f4c4b400640 1 -- 172.21.15.42:0/4152993076 learned_addr learned my addr 172.21.15.42:0/4152993076 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:07.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.808+0000 7f4c4be00640 1 --2- 172.21.15.42:0/4152993076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c4c162fa0 0x7f4c4c156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:07.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.808+0000 7f4c43e00640 1 --2- 172.21.15.42:0/4152993076 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4c4c0b6030 0x7f4c4c15a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:07.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.808+0000 7f4c4b400640 1 -- 172.21.15.42:0/4152993076 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4c4c0b6030 msgr2=0x7f4c4c15a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:07.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.808+0000 7f4c4b400640 1 --2- 172.21.15.42:0/4152993076 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4c4c0b6030 0x7f4c4c15a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:07.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.808+0000 7f4c4b400640 1 -- 172.21.15.42:0/4152993076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c4c162fa0 msgr2=0x7f4c4c156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:07.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.808+0000 7f4c4b400640 1 --2- 172.21.15.42:0/4152993076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c4c162fa0 0x7f4c4c156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:07.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.808+0000 7f4c4b400640 1 -- 172.21.15.42:0/4152993076 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c4c0c8180 con 0x7f4c4c073340 2024-09-17T01:32:07.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.808+0000 7f4c43e00640 1 --2- 172.21.15.42:0/4152993076 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4c4c0b6030 0x7f4c4c15a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:07.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.809+0000 7f4c4b400640 1 --2- 172.21.15.42:0/4152993076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c4c073340 0x7f4c4c157220 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c009980 tx=0x7f4c3c033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:07.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.809+0000 7f4c43400640 1 -- 172.21.15.42:0/4152993076 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c031d60 con 0x7f4c4c073340 2024-09-17T01:32:07.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.809+0000 7f4c43400640 1 -- 172.21.15.42:0/4152993076 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c3c005020 con 0x7f4c4c073340 2024-09-17T01:32:07.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.809+0000 7f4c43400640 1 -- 172.21.15.42:0/4152993076 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c005450 con 0x7f4c4c073340 2024-09-17T01:32:07.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.809+0000 7f4c50a00640 1 -- 172.21.15.42:0/4152993076 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c4c0c9d10 con 0x7f4c4c073340 2024-09-17T01:32:07.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.809+0000 7f4c50a00640 1 -- 172.21.15.42:0/4152993076 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c4c0ca5a0 con 0x7f4c4c073340 2024-09-17T01:32:07.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.810+0000 7f4c50a00640 1 -- 172.21.15.42:0/4152993076 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c4c0d34a0 con 0x7f4c4c073340 2024-09-17T01:32:07.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.811+0000 7f4c43400640 1 -- 172.21.15.42:0/4152993076 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4c3c0047a0 con 0x7f4c4c073340 2024-09-17T01:32:07.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.813+0000 7f4c43400640 1 --2- 172.21.15.42:0/4152993076 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4c28078b90 0x7f4c2807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:07.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.813+0000 7f4c43400640 1 -- 172.21.15.42:0/4152993076 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4c3c0bbff0 con 0x7f4c4c073340 2024-09-17T01:32:07.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.813+0000 7f4c43e00640 1 --2- 172.21.15.42:0/4152993076 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4c28078b90 0x7f4c2807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:07.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.814+0000 7f4c43e00640 1 --2- 172.21.15.42:0/4152993076 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4c28078b90 0x7f4c2807b0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0caa30 tx=0x7f4c34009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:07.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:07.817+0000 7f4c43400640 1 -- 172.21.15.42:0/4152993076 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4c4c0d34a0 con 0x7f4c4c073340 2024-09-17T01:32:08.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.011+0000 7f4c50a00640 1 -- 172.21.15.42:0/4152993076 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c4c160070 con 0x7f4c4c073340 2024-09-17T01:32:08.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.012+0000 7f4c43400640 1 -- 172.21.15.42:0/4152993076 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16634 (secure 0 0 0) 0x7f4c3c03f030 con 0x7f4c4c073340 2024-09-17T01:32:08.010 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:08.010 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:32:06.566572+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:32:04.526150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T01:32:05.523607+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:32:08.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.015+0000 7f4c50a00640 1 -- 172.21.15.42:0/4152993076 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4c28078b90 msgr2=0x7f4c2807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:08.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.015+0000 7f4c50a00640 1 --2- 172.21.15.42:0/4152993076 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4c28078b90 0x7f4c2807b0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0caa30 tx=0x7f4c34009040 comp rx=0 tx=0).stop 2024-09-17T01:32:08.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.015+0000 7f4c50a00640 1 -- 172.21.15.42:0/4152993076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c4c073340 msgr2=0x7f4c4c157220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:08.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.015+0000 7f4c50a00640 1 --2- 172.21.15.42:0/4152993076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c4c073340 0x7f4c4c157220 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c009980 tx=0x7f4c3c033c90 comp rx=0 tx=0).stop 2024-09-17T01:32:08.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.015+0000 7f4c50a00640 1 -- 172.21.15.42:0/4152993076 shutdown_connections 2024-09-17T01:32:08.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.015+0000 7f4c50a00640 1 --2- 172.21.15.42:0/4152993076 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4c28078b90 0x7f4c2807b0a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:08.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.015+0000 7f4c50a00640 1 --2- 172.21.15.42:0/4152993076 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c4c162fa0 0x7f4c4c156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:08.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.015+0000 7f4c50a00640 1 --2- 172.21.15.42:0/4152993076 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4c4c0b6030 0x7f4c4c15a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:08.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.015+0000 7f4c50a00640 1 --2- 172.21.15.42:0/4152993076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c4c073340 0x7f4c4c157220 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:08.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.015+0000 7f4c50a00640 1 -- 172.21.15.42:0/4152993076 >> 172.21.15.42:0/4152993076 conn(0x7f4c4c0d1210 msgr2=0x7f4c4c0d2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:08.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.015+0000 7f4c50a00640 1 -- 172.21.15.42:0/4152993076 shutdown_connections 2024-09-17T01:32:08.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.015+0000 7f4c50a00640 1 -- 172.21.15.42:0/4152993076 wait complete. 2024-09-17T01:32:08.037 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T01:32:08.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.272+0000 7f113d000640 1 -- 172.21.15.42:0/2374010669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1138142f40 msgr2=0x7f1138072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:08.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.272+0000 7f113d000640 1 --2- 172.21.15.42:0/2374010669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1138142f40 0x7f1138072950 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1124009830 tx=0x7f112402a480 comp rx=0 tx=0).stop 2024-09-17T01:32:08.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.273+0000 7f113d000640 1 -- 172.21.15.42:0/2374010669 shutdown_connections 2024-09-17T01:32:08.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.273+0000 7f113d000640 1 --2- 172.21.15.42:0/2374010669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1138142f40 0x7f1138072950 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:08.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.273+0000 7f113d000640 1 --2- 172.21.15.42:0/2374010669 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f11380b3550 0x7f113815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:08.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.273+0000 7f113d000640 1 -- 172.21.15.42:0/2374010669 >> 172.21.15.42:0/2374010669 conn(0x7f11380b2930 msgr2=0x7f113806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:08.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.273+0000 7f113d000640 1 -- 172.21.15.42:0/2374010669 shutdown_connections 2024-09-17T01:32:08.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.273+0000 7f113d000640 1 -- 172.21.15.42:0/2374010669 wait complete. 2024-09-17T01:32:08.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.275+0000 7f113d000640 1 Processor -- start 2024-09-17T01:32:08.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.275+0000 7f113d000640 1 -- start start 2024-09-17T01:32:08.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.276+0000 7f113d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1138072e90 0x7f11380cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:08.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.276+0000 7f113d000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11380b3550 0x7f113806e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:08.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.276+0000 7f113d000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1138142f40 0x7f113806e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:08.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.276+0000 7f113d000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f113806d7c0 con 0x7f1138072e90 2024-09-17T01:32:08.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.276+0000 7f113d000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f113806d640 con 0x7f11380b3550 2024-09-17T01:32:08.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.276+0000 7f113d000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f113806d940 con 0x7f1138142f40 2024-09-17T01:32:08.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.277+0000 7f1135e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1138072e90 0x7f11380cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:08.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.277+0000 7f1135e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1138072e90 0x7f11380cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50266/0 (socket says 172.21.15.42:50266) 2024-09-17T01:32:08.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.277+0000 7f1135e00640 1 -- 172.21.15.42:0/1543261467 learned_addr learned my addr 172.21.15.42:0/1543261467 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:08.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.277+0000 7f1135400640 1 --2- 172.21.15.42:0/1543261467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11380b3550 0x7f113806e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:08.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.277+0000 7f1136800640 1 --2- 172.21.15.42:0/1543261467 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1138142f40 0x7f113806e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:08.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.277+0000 7f1135e00640 1 -- 172.21.15.42:0/1543261467 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1138142f40 msgr2=0x7f113806e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:08.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.277+0000 7f1135e00640 1 --2- 172.21.15.42:0/1543261467 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1138142f40 0x7f113806e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:08.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.277+0000 7f1135e00640 1 -- 172.21.15.42:0/1543261467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11380b3550 msgr2=0x7f113806e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:08.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.277+0000 7f1135e00640 1 --2- 172.21.15.42:0/1543261467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11380b3550 0x7f113806e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:08.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.277+0000 7f1135e00640 1 -- 172.21.15.42:0/1543261467 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f113813f950 con 0x7f1138072e90 2024-09-17T01:32:08.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.277+0000 7f1135e00640 1 --2- 172.21.15.42:0/1543261467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1138072e90 0x7f11380cc340 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f112800e9f0 tx=0x7f112800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:08.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.278+0000 7f112e000640 1 -- 172.21.15.42:0/1543261467 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112800cd80 con 0x7f1138072e90 2024-09-17T01:32:08.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.278+0000 7f112e000640 1 -- 172.21.15.42:0/1543261467 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1128004020 con 0x7f1138072e90 2024-09-17T01:32:08.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.278+0000 7f112e000640 1 -- 172.21.15.42:0/1543261467 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1128004470 con 0x7f1138072e90 2024-09-17T01:32:08.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.278+0000 7f113d000640 1 -- 172.21.15.42:0/1543261467 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f113813fc30 con 0x7f1138072e90 2024-09-17T01:32:08.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.278+0000 7f113d000640 1 -- 172.21.15.42:0/1543261467 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11381401f0 con 0x7f1138072e90 2024-09-17T01:32:08.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.279+0000 7f113d000640 1 -- 172.21.15.42:0/1543261467 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f113815cec0 con 0x7f1138072e90 2024-09-17T01:32:08.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.280+0000 7f112e000640 1 -- 172.21.15.42:0/1543261467 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f11280035f0 con 0x7f1138072e90 2024-09-17T01:32:08.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.281+0000 7f112e000640 1 --2- 172.21.15.42:0/1543261467 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1118078bc0 0x7f111807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:08.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.281+0000 7f112e000640 1 -- 172.21.15.42:0/1543261467 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f112809b7d0 con 0x7f1138072e90 2024-09-17T01:32:08.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.282+0000 7f1135400640 1 --2- 172.21.15.42:0/1543261467 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1118078bc0 0x7f111807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:08.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.282+0000 7f1135400640 1 --2- 172.21.15.42:0/1543261467 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1118078bc0 0x7f111807b0d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1124034000 tx=0x7f1124004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:08.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.286+0000 7f112e000640 1 -- 172.21.15.42:0/1543261467 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1128063ca0 con 0x7f1138072e90 2024-09-17T01:32:08.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:08.518+0000 7f113d000640 1 -- 172.21.15.42:0/1543261467 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f113806a170 con 0x7f1138072e90 2024-09-17T01:32:09.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.080+0000 7f112e000640 1 -- 172.21.15.42:0/1543261467 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f11280635a0 con 0x7f1138072e90 2024-09-17T01:32:09.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.084+0000 7f113d000640 1 -- 172.21.15.42:0/1543261467 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1118078bc0 msgr2=0x7f111807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:09.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.084+0000 7f113d000640 1 --2- 172.21.15.42:0/1543261467 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1118078bc0 0x7f111807b0d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1124034000 tx=0x7f1124004730 comp rx=0 tx=0).stop 2024-09-17T01:32:09.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.084+0000 7f113d000640 1 -- 172.21.15.42:0/1543261467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1138072e90 msgr2=0x7f11380cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:09.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.084+0000 7f113d000640 1 --2- 172.21.15.42:0/1543261467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1138072e90 0x7f11380cc340 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f112800e9f0 tx=0x7f112800eeb0 comp rx=0 tx=0).stop 2024-09-17T01:32:09.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.084+0000 7f113d000640 1 -- 172.21.15.42:0/1543261467 shutdown_connections 2024-09-17T01:32:09.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.084+0000 7f113d000640 1 --2- 172.21.15.42:0/1543261467 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1118078bc0 0x7f111807b0d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:09.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.084+0000 7f113d000640 1 --2- 172.21.15.42:0/1543261467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f11380b3550 0x7f113806e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:09.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.084+0000 7f113d000640 1 --2- 172.21.15.42:0/1543261467 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1138142f40 0x7f113806e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:09.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.084+0000 7f113d000640 1 --2- 172.21.15.42:0/1543261467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1138072e90 0x7f11380cc340 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:09.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.084+0000 7f113d000640 1 -- 172.21.15.42:0/1543261467 >> 172.21.15.42:0/1543261467 conn(0x7f11380b2930 msgr2=0x7f11380af810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:09.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.084+0000 7f113d000640 1 -- 172.21.15.42:0/1543261467 shutdown_connections 2024-09-17T01:32:09.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.084+0000 7f113d000640 1 -- 172.21.15.42:0/1543261467 wait complete. 2024-09-17T01:32:09.107 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T01:32:09.107 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T01:32:09.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.342+0000 7fa0e7000640 1 -- 172.21.15.42:0/4047377401 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0e00b3880 msgr2=0x7fa0e00af980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:09.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.342+0000 7fa0e7000640 1 --2- 172.21.15.42:0/4047377401 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0e00b3880 0x7fa0e00af980 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0005fd0 tx=0x7fa0d002a5d0 comp rx=0 tx=0).stop 2024-09-17T01:32:09.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.342+0000 7fa0e7000640 1 -- 172.21.15.42:0/4047377401 shutdown_connections 2024-09-17T01:32:09.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.342+0000 7fa0e7000640 1 --2- 172.21.15.42:0/4047377401 >> v2:172.21.15.43:3300/0 conn(0x7fa0e015cfc0 0x7fa0e00ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:09.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.342+0000 7fa0e7000640 1 --2- 172.21.15.42:0/4047377401 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0e00b3880 0x7fa0e00af980 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:09.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.342+0000 7fa0e7000640 1 -- 172.21.15.42:0/4047377401 >> 172.21.15.42:0/4047377401 conn(0x7fa0e00b2930 msgr2=0x7fa0e006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:09.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.342+0000 7fa0e7000640 1 -- 172.21.15.42:0/4047377401 shutdown_connections 2024-09-17T01:32:09.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.342+0000 7fa0e7000640 1 -- 172.21.15.42:0/4047377401 wait complete. 2024-09-17T01:32:09.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.344+0000 7fa0e7000640 1 Processor -- start 2024-09-17T01:32:09.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.344+0000 7fa0e7000640 1 -- start start 2024-09-17T01:32:09.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.346+0000 7fa0e7000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0e006d430 0x7fa0e0158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:09.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.346+0000 7fa0e7000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0e00b3880 0x7fa0e0159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:09.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.346+0000 7fa0e7000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0e015cfc0 0x7fa0e0146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:09.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.346+0000 7fa0e7000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e0072ad0 con 0x7fa0e00b3880 2024-09-17T01:32:09.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.346+0000 7fa0e7000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e0072950 con 0x7fa0e006d430 2024-09-17T01:32:09.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.346+0000 7fa0e7000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa0e0072c50 con 0x7fa0e015cfc0 2024-09-17T01:32:09.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.346+0000 7fa0df400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0e00b3880 0x7fa0e0159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:09.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.346+0000 7fa0df400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0e00b3880 0x7fa0e0159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50282/0 (socket says 172.21.15.42:50282) 2024-09-17T01:32:09.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.346+0000 7fa0df400640 1 -- 172.21.15.42:0/129358690 learned_addr learned my addr 172.21.15.42:0/129358690 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:09.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.346+0000 7fa0dfe00640 1 --2- 172.21.15.42:0/129358690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0e006d430 0x7fa0e0158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:09.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.346+0000 7fa0e5000640 1 --2- 172.21.15.42:0/129358690 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0e015cfc0 0x7fa0e0146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:09.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.346+0000 7fa0df400640 1 -- 172.21.15.42:0/129358690 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0e015cfc0 msgr2=0x7fa0e0146d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:09.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.346+0000 7fa0df400640 1 --2- 172.21.15.42:0/129358690 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0e015cfc0 0x7fa0e0146d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:09.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.346+0000 7fa0df400640 1 -- 172.21.15.42:0/129358690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0e006d430 msgr2=0x7fa0e0158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:09.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.346+0000 7fa0df400640 1 --2- 172.21.15.42:0/129358690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0e006d430 0x7fa0e0158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:09.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.346+0000 7fa0df400640 1 -- 172.21.15.42:0/129358690 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e0158540 con 0x7fa0e00b3880 2024-09-17T01:32:09.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.346+0000 7fa0e5000640 1 --2- 172.21.15.42:0/129358690 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0e015cfc0 0x7fa0e0146d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:32:09.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.347+0000 7fa0df400640 1 --2- 172.21.15.42:0/129358690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0e00b3880 0x7fa0e0159f70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00e9f0 tx=0x7fa0cc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:09.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.347+0000 7fa0d7e00640 1 -- 172.21.15.42:0/129358690 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc00cd80 con 0x7fa0e00b3880 2024-09-17T01:32:09.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.347+0000 7fa0d7e00640 1 -- 172.21.15.42:0/129358690 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0cc004020 con 0x7fa0e00b3880 2024-09-17T01:32:09.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.347+0000 7fa0e7000640 1 -- 172.21.15.42:0/129358690 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e0147840 con 0x7fa0e00b3880 2024-09-17T01:32:09.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.347+0000 7fa0d7e00640 1 -- 172.21.15.42:0/129358690 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc004450 con 0x7fa0e00b3880 2024-09-17T01:32:09.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.347+0000 7fa0e7000640 1 -- 172.21.15.42:0/129358690 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e0157800 con 0x7fa0e00b3880 2024-09-17T01:32:09.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.348+0000 7fa0e7000640 1 -- 172.21.15.42:0/129358690 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0e0159900 con 0x7fa0e00b3880 2024-09-17T01:32:09.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.349+0000 7fa0d7e00640 1 -- 172.21.15.42:0/129358690 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa0cc0035f0 con 0x7fa0e00b3880 2024-09-17T01:32:09.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.350+0000 7fa0d7e00640 1 --2- 172.21.15.42:0/129358690 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa0c0078b90 0x7fa0c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:09.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.350+0000 7fa0d7e00640 1 -- 172.21.15.42:0/129358690 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa0cc09b730 con 0x7fa0e00b3880 2024-09-17T01:32:09.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.351+0000 7fa0dfe00640 1 --2- 172.21.15.42:0/129358690 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa0c0078b90 0x7fa0c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:09.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.351+0000 7fa0dfe00640 1 --2- 172.21.15.42:0/129358690 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa0c0078b90 0x7fa0c007b0a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0033000 tx=0x7fa0d0004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:09.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.354+0000 7fa0d7e00640 1 -- 172.21.15.42:0/129358690 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa0cc063b10 con 0x7fa0e00b3880 2024-09-17T01:32:09.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:09.588+0000 7fa0e7000640 1 -- 172.21.15.42:0/129358690 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa0e01475d0 con 0x7fa0e00b3880 2024-09-17T01:32:10.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.081+0000 7fa0d7e00640 1 -- 172.21.15.42:0/129358690 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fa0cc063410 con 0x7fa0e00b3880 2024-09-17T01:32:10.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.084+0000 7fa0e7000640 1 -- 172.21.15.42:0/129358690 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa0c0078b90 msgr2=0x7fa0c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:10.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.084+0000 7fa0e7000640 1 --2- 172.21.15.42:0/129358690 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa0c0078b90 0x7fa0c007b0a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0033000 tx=0x7fa0d0004730 comp rx=0 tx=0).stop 2024-09-17T01:32:10.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.084+0000 7fa0e7000640 1 -- 172.21.15.42:0/129358690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0e00b3880 msgr2=0x7fa0e0159f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:10.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.084+0000 7fa0e7000640 1 --2- 172.21.15.42:0/129358690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0e00b3880 0x7fa0e0159f70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00e9f0 tx=0x7fa0cc00eeb0 comp rx=0 tx=0).stop 2024-09-17T01:32:10.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.084+0000 7fa0e7000640 1 -- 172.21.15.42:0/129358690 shutdown_connections 2024-09-17T01:32:10.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.084+0000 7fa0e7000640 1 --2- 172.21.15.42:0/129358690 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa0c0078b90 0x7fa0c007b0a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:10.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.084+0000 7fa0e7000640 1 --2- 172.21.15.42:0/129358690 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0e015cfc0 0x7fa0e0146d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:10.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.084+0000 7fa0e7000640 1 --2- 172.21.15.42:0/129358690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0e00b3880 0x7fa0e0159f70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:10.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.084+0000 7fa0e7000640 1 --2- 172.21.15.42:0/129358690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0e006d430 0x7fa0e0158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:10.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.084+0000 7fa0e7000640 1 -- 172.21.15.42:0/129358690 >> 172.21.15.42:0/129358690 conn(0x7fa0e00b2930 msgr2=0x7fa0e0073d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:10.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.084+0000 7fa0e7000640 1 -- 172.21.15.42:0/129358690 shutdown_connections 2024-09-17T01:32:10.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.085+0000 7fa0e7000640 1 -- 172.21.15.42:0/129358690 wait complete. 2024-09-17T01:32:10.112 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T01:32:10.113 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:32:10.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.343+0000 7f46f4a00640 1 -- 172.21.15.42:0/1667320481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46f015f480 msgr2=0x7f46f015f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:10.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.343+0000 7f46f4a00640 1 --2- 172.21.15.42:0/1667320481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46f015f480 0x7f46f015f890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f46f00b3280 tx=0x7f46e802aa30 comp rx=0 tx=0).stop 2024-09-17T01:32:10.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.344+0000 7f46f4a00640 1 -- 172.21.15.42:0/1667320481 shutdown_connections 2024-09-17T01:32:10.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.344+0000 7f46f4a00640 1 --2- 172.21.15.42:0/1667320481 >> v2:172.21.15.43:3300/0 conn(0x7f46f006d430 0x7f46f006d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:10.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.344+0000 7f46f4a00640 1 --2- 172.21.15.42:0/1667320481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46f015f480 0x7f46f015f890 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:10.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.344+0000 7f46f4a00640 1 --2- 172.21.15.42:0/1667320481 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46f015cb80 0x7f46f0152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:10.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.344+0000 7f46f4a00640 1 -- 172.21.15.42:0/1667320481 >> 172.21.15.42:0/1667320481 conn(0x7f46f00b2930 msgr2=0x7f46f006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:10.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.344+0000 7f46f4a00640 1 -- 172.21.15.42:0/1667320481 shutdown_connections 2024-09-17T01:32:10.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.344+0000 7f46f4a00640 1 -- 172.21.15.42:0/1667320481 wait complete. 2024-09-17T01:32:10.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.346+0000 7f46f4a00640 1 Processor -- start 2024-09-17T01:32:10.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.346+0000 7f46f4a00640 1 -- start start 2024-09-17T01:32:10.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.347+0000 7f46f4a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46f006d430 0x7f46f015d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:10.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.347+0000 7f46f4a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46f015cb80 0x7f46f014c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:10.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.347+0000 7f46f4a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46f015f480 0x7f46f00ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:10.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.347+0000 7f46f4a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f46f0073820 con 0x7f46f015cb80 2024-09-17T01:32:10.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.347+0000 7f46f4a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f46f00736a0 con 0x7f46f015f480 2024-09-17T01:32:10.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.347+0000 7f46f4a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f46f00739a0 con 0x7f46f006d430 2024-09-17T01:32:10.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.348+0000 7f46ed400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46f015cb80 0x7f46f014c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:10.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.348+0000 7f46ed400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46f015cb80 0x7f46f014c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50298/0 (socket says 172.21.15.42:50298) 2024-09-17T01:32:10.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.348+0000 7f46ed400640 1 -- 172.21.15.42:0/913783486 learned_addr learned my addr 172.21.15.42:0/913783486 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:10.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.348+0000 7f46ede00640 1 --2- 172.21.15.42:0/913783486 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46f006d430 0x7f46f015d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:10.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.348+0000 7f46ee800640 1 --2- 172.21.15.42:0/913783486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46f015f480 0x7f46f00ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:10.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.348+0000 7f46ed400640 1 -- 172.21.15.42:0/913783486 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46f006d430 msgr2=0x7f46f015d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:10.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.348+0000 7f46ed400640 1 --2- 172.21.15.42:0/913783486 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46f006d430 0x7f46f015d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:10.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.348+0000 7f46ed400640 1 -- 172.21.15.42:0/913783486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46f015f480 msgr2=0x7f46f00ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:10.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.348+0000 7f46ed400640 1 --2- 172.21.15.42:0/913783486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46f015f480 0x7f46f00ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:10.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.348+0000 7f46ed400640 1 -- 172.21.15.42:0/913783486 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f014cbf0 con 0x7f46f015cb80 2024-09-17T01:32:10.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.348+0000 7f46ede00640 1 --2- 172.21.15.42:0/913783486 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46f006d430 0x7f46f015d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:10.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.348+0000 7f46ed400640 1 --2- 172.21.15.42:0/913783486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46f015cb80 0x7f46f014c6b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00e6c0 tx=0x7f46dc00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:10.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.349+0000 7f46e6000640 1 -- 172.21.15.42:0/913783486 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46dc00cab0 con 0x7f46f015cb80 2024-09-17T01:32:10.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.349+0000 7f46e6000640 1 -- 172.21.15.42:0/913783486 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46dc00cc50 con 0x7f46f015cb80 2024-09-17T01:32:10.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.349+0000 7f46f4a00640 1 -- 172.21.15.42:0/913783486 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46f0151dc0 con 0x7f46f015cb80 2024-09-17T01:32:10.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.349+0000 7f46e6000640 1 -- 172.21.15.42:0/913783486 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46dc005280 con 0x7f46f015cb80 2024-09-17T01:32:10.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.349+0000 7f46f4a00640 1 -- 172.21.15.42:0/913783486 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46f0151800 con 0x7f46f015cb80 2024-09-17T01:32:10.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.350+0000 7f46f4a00640 1 -- 172.21.15.42:0/913783486 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46f0151290 con 0x7f46f015cb80 2024-09-17T01:32:10.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.351+0000 7f46e6000640 1 -- 172.21.15.42:0/913783486 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f46dc005420 con 0x7f46f015cb80 2024-09-17T01:32:10.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.352+0000 7f46e6000640 1 --2- 172.21.15.42:0/913783486 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f46d0078b90 0x7f46d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:10.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.352+0000 7f46e6000640 1 -- 172.21.15.42:0/913783486 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f46dc09b720 con 0x7f46f015cb80 2024-09-17T01:32:10.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.352+0000 7f46ede00640 1 --2- 172.21.15.42:0/913783486 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f46d0078b90 0x7f46d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:10.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.353+0000 7f46ede00640 1 --2- 172.21.15.42:0/913783486 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f46d0078b90 0x7f46d007b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f46e0009b80 tx=0x7f46e0005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:10.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.357+0000 7f46e6000640 1 -- 172.21.15.42:0/913783486 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f46dc005710 con 0x7f46f015cb80 2024-09-17T01:32:10.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.586+0000 7f46f4a00640 1 -- 172.21.15.42:0/913783486 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46f0073ec0 con 0x7f46f015cb80 2024-09-17T01:32:10.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.587+0000 7f46e6000640 1 -- 172.21.15.42:0/913783486 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5217 (secure 0 0 0) 0x7f46dc063ac0 con 0x7f46f015cb80 2024-09-17T01:32:10.585 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:10.585 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":8,"btime":"2024-09-17T01:32:10:080773+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4301,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1899287597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1899287597},{"type":"v1","addr":"172.21.15.43:6836","nonce":1899287597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4359,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3422946855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3422946855},{"type":"v1","addr":"172.21.15.42:6835","nonce":3422946855}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4363,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1971042705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1971042705},{"type":"v1","addr":"172.21.15.42:6833","nonce":1971042705}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:32:06.566519+0000","modified":"2024-09-17T01:32:09.589828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/3707512090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3707512090},{"type":"v1","addr":"172.21.15.43:6837","nonce":3707512090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4365,"qdb_cluster":[4365]},"id":1}]} 2024-09-17T01:32:10.585 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 8 2024-09-17T01:32:10.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.589+0000 7f46f4a00640 1 -- 172.21.15.42:0/913783486 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f46d0078b90 msgr2=0x7f46d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:10.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.589+0000 7f46f4a00640 1 --2- 172.21.15.42:0/913783486 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f46d0078b90 0x7f46d007b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f46e0009b80 tx=0x7f46e0005f90 comp rx=0 tx=0).stop 2024-09-17T01:32:10.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.589+0000 7f46f4a00640 1 -- 172.21.15.42:0/913783486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46f015cb80 msgr2=0x7f46f014c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:10.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.589+0000 7f46f4a00640 1 --2- 172.21.15.42:0/913783486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46f015cb80 0x7f46f014c6b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00e6c0 tx=0x7f46dc00eb80 comp rx=0 tx=0).stop 2024-09-17T01:32:10.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.589+0000 7f46f4a00640 1 -- 172.21.15.42:0/913783486 shutdown_connections 2024-09-17T01:32:10.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.589+0000 7f46f4a00640 1 --2- 172.21.15.42:0/913783486 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f46d0078b90 0x7f46d007b0a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:10.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.589+0000 7f46f4a00640 1 --2- 172.21.15.42:0/913783486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46f015f480 0x7f46f00ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:10.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.589+0000 7f46f4a00640 1 --2- 172.21.15.42:0/913783486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46f015cb80 0x7f46f014c6b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:10.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.589+0000 7f46f4a00640 1 --2- 172.21.15.42:0/913783486 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46f006d430 0x7f46f015d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:10.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.589+0000 7f46f4a00640 1 -- 172.21.15.42:0/913783486 >> 172.21.15.42:0/913783486 conn(0x7f46f00b2930 msgr2=0x7f46f006fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:10.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.589+0000 7f46f4a00640 1 -- 172.21.15.42:0/913783486 shutdown_connections 2024-09-17T01:32:10.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.589+0000 7f46f4a00640 1 -- 172.21.15.42:0/913783486 wait complete. 2024-09-17T01:32:10.610 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:32:10.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.837+0000 7f2306200640 1 -- 172.21.15.42:0/985687636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23000cef70 msgr2=0x7f2300156e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:10.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.837+0000 7f2306200640 1 --2- 172.21.15.42:0/985687636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23000cef70 0x7f2300156e50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009860 tx=0x7f22e802a560 comp rx=0 tx=0).stop 2024-09-17T01:32:10.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.837+0000 7f2306200640 1 -- 172.21.15.42:0/985687636 shutdown_connections 2024-09-17T01:32:10.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.837+0000 7f2306200640 1 --2- 172.21.15.42:0/985687636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23000cef70 0x7f2300156e50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:10.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.837+0000 7f2306200640 1 -- 172.21.15.42:0/985687636 >> 172.21.15.42:0/985687636 conn(0x7f23000b2930 msgr2=0x7f230006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:10.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.837+0000 7f2306200640 1 -- 172.21.15.42:0/985687636 shutdown_connections 2024-09-17T01:32:10.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.837+0000 7f2306200640 1 -- 172.21.15.42:0/985687636 wait complete. 2024-09-17T01:32:10.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.840+0000 7f2306200640 1 Processor -- start 2024-09-17T01:32:10.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.840+0000 7f2306200640 1 -- start start 2024-09-17T01:32:10.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.841+0000 7f2306200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f230006d430 0x7f2300157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:10.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.841+0000 7f2306200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23000b5100 0x7f230015a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:10.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.841+0000 7f2306200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23000cef70 0x7f23000ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:10.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.841+0000 7f2306200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2300073bd0 con 0x7f23000b5100 2024-09-17T01:32:10.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.841+0000 7f2306200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2300073a50 con 0x7f230006d430 2024-09-17T01:32:10.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.841+0000 7f2306200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2300073d50 con 0x7f23000cef70 2024-09-17T01:32:10.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.841+0000 7f22f6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23000b5100 0x7f230015a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:10.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.841+0000 7f22f6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23000b5100 0x7f230015a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50308/0 (socket says 172.21.15.42:50308) 2024-09-17T01:32:10.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.841+0000 7f22f6a00640 1 -- 172.21.15.42:0/11626533 learned_addr learned my addr 172.21.15.42:0/11626533 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:10.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.842+0000 7f22ff400640 1 --2- 172.21.15.42:0/11626533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f230006d430 0x7f2300157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:10.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.842+0000 7f22ffe00640 1 --2- 172.21.15.42:0/11626533 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23000cef70 0x7f23000ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:10.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.842+0000 7f22f6a00640 1 -- 172.21.15.42:0/11626533 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23000cef70 msgr2=0x7f23000ae900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:10.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.842+0000 7f22f6a00640 1 --2- 172.21.15.42:0/11626533 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23000cef70 0x7f23000ae900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:10.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.842+0000 7f22f6a00640 1 -- 172.21.15.42:0/11626533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f230006d430 msgr2=0x7f2300157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:10.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.842+0000 7f22f6a00640 1 --2- 172.21.15.42:0/11626533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f230006d430 0x7f2300157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:10.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.842+0000 7f22f6a00640 1 -- 172.21.15.42:0/11626533 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23001f8ff0 con 0x7f23000b5100 2024-09-17T01:32:10.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.842+0000 7f22ff400640 1 --2- 172.21.15.42:0/11626533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f230006d430 0x7f2300157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:10.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.842+0000 7f22f6a00640 1 --2- 172.21.15.42:0/11626533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23000b5100 0x7f230015a240 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009980 tx=0x7f22e8033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:10.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.843+0000 7f22f7e00640 1 -- 172.21.15.42:0/11626533 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e8031b50 con 0x7f23000b5100 2024-09-17T01:32:10.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.843+0000 7f22f7e00640 1 -- 172.21.15.42:0/11626533 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22e8031de0 con 0x7f23000b5100 2024-09-17T01:32:10.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.843+0000 7f22f7e00640 1 -- 172.21.15.42:0/11626533 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e8005280 con 0x7f23000b5100 2024-09-17T01:32:10.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.843+0000 7f2306200640 1 -- 172.21.15.42:0/11626533 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23001f92d0 con 0x7f23000b5100 2024-09-17T01:32:10.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.843+0000 7f2306200640 1 -- 172.21.15.42:0/11626533 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23001f9890 con 0x7f23000b5100 2024-09-17T01:32:10.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.844+0000 7f2306200640 1 -- 172.21.15.42:0/11626533 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2300156e50 con 0x7f23000b5100 2024-09-17T01:32:10.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.845+0000 7f22f7e00640 1 -- 172.21.15.42:0/11626533 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f22e8005420 con 0x7f23000b5100 2024-09-17T01:32:10.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.846+0000 7f22f7e00640 1 --2- 172.21.15.42:0/11626533 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f22dc078bc0 0x7f22dc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:10.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.846+0000 7f22f7e00640 1 -- 172.21.15.42:0/11626533 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f22e80bbec0 con 0x7f23000b5100 2024-09-17T01:32:10.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.847+0000 7f22ff400640 1 --2- 172.21.15.42:0/11626533 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f22dc078bc0 0x7f22dc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:10.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.847+0000 7f22ff400640 1 --2- 172.21.15.42:0/11626533 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f22dc078bc0 0x7f22dc07b0d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f22f0007fd0 tx=0x7f22f0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:10.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:10.851+0000 7f22f7e00640 1 -- 172.21.15.42:0/11626533 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f22e803f030 con 0x7f23000b5100 2024-09-17T01:32:11.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.045+0000 7f2306200640 1 -- 172.21.15.42:0/11626533 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f230006a170 con 0x7f23000b5100 2024-09-17T01:32:11.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.046+0000 7f22f7e00640 1 -- 172.21.15.42:0/11626533 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16621 (secure 0 0 0) 0x7f22e8031770 con 0x7f23000b5100 2024-09-17T01:32:11.044 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:11.044 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":22,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:32:08.067689+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:32:04.526150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T01:32:05.523607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:32:11.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.048+0000 7f2306200640 1 -- 172.21.15.42:0/11626533 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f22dc078bc0 msgr2=0x7f22dc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:11.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.048+0000 7f2306200640 1 --2- 172.21.15.42:0/11626533 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f22dc078bc0 0x7f22dc07b0d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f22f0007fd0 tx=0x7f22f0009040 comp rx=0 tx=0).stop 2024-09-17T01:32:11.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.048+0000 7f2306200640 1 -- 172.21.15.42:0/11626533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23000b5100 msgr2=0x7f230015a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:11.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.048+0000 7f2306200640 1 --2- 172.21.15.42:0/11626533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23000b5100 0x7f230015a240 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009980 tx=0x7f22e8033ba0 comp rx=0 tx=0).stop 2024-09-17T01:32:11.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.048+0000 7f2306200640 1 -- 172.21.15.42:0/11626533 shutdown_connections 2024-09-17T01:32:11.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.048+0000 7f2306200640 1 --2- 172.21.15.42:0/11626533 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f22dc078bc0 0x7f22dc07b0d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:11.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.048+0000 7f2306200640 1 --2- 172.21.15.42:0/11626533 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23000cef70 0x7f23000ae900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:11.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.048+0000 7f2306200640 1 --2- 172.21.15.42:0/11626533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23000b5100 0x7f230015a240 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:11.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.048+0000 7f2306200640 1 --2- 172.21.15.42:0/11626533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f230006d430 0x7f2300157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:11.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.048+0000 7f2306200640 1 -- 172.21.15.42:0/11626533 >> 172.21.15.42:0/11626533 conn(0x7f23000b2930 msgr2=0x7f2300072340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:11.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.048+0000 7f2306200640 1 -- 172.21.15.42:0/11626533 shutdown_connections 2024-09-17T01:32:11.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.048+0000 7f2306200640 1 -- 172.21.15.42:0/11626533 wait complete. 2024-09-17T01:32:11.069 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T01:32:11.069 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:32:11.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.298+0000 7fde55a00640 1 -- 172.21.15.42:0/3816692454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde500b6030 msgr2=0x7fde500b6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:11.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.298+0000 7fde55a00640 1 --2- 172.21.15.42:0/3816692454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde500b6030 0x7fde500b6440 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fde48005fd0 tx=0x7fde4802a870 comp rx=0 tx=0).stop 2024-09-17T01:32:11.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.298+0000 7fde55a00640 1 -- 172.21.15.42:0/3816692454 shutdown_connections 2024-09-17T01:32:11.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.298+0000 7fde55a00640 1 --2- 172.21.15.42:0/3816692454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde500b6030 0x7fde500b6440 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:11.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.298+0000 7fde55a00640 1 --2- 172.21.15.42:0/3816692454 >> v2:172.21.15.43:3300/0 conn(0x7fde50073340 0x7fde500d2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:11.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.298+0000 7fde55a00640 1 -- 172.21.15.42:0/3816692454 >> 172.21.15.42:0/3816692454 conn(0x7fde500d1210 msgr2=0x7fde500d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:11.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.298+0000 7fde55a00640 1 -- 172.21.15.42:0/3816692454 shutdown_connections 2024-09-17T01:32:11.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.298+0000 7fde55a00640 1 -- 172.21.15.42:0/3816692454 wait complete. 2024-09-17T01:32:11.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.300+0000 7fde55a00640 1 Processor -- start 2024-09-17T01:32:11.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.300+0000 7fde55a00640 1 -- start start 2024-09-17T01:32:11.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.302+0000 7fde55a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde50073340 0x7fde50153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:11.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.302+0000 7fde55a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde500b6030 0x7fde5015a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:11.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.302+0000 7fde55a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde50162fa0 0x7fde50161530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:11.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.302+0000 7fde55a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fde5015f850 con 0x7fde50162fa0 2024-09-17T01:32:11.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.302+0000 7fde55a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fde5015f6d0 con 0x7fde500b6030 2024-09-17T01:32:11.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.302+0000 7fde55a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fde5015f9d0 con 0x7fde50073340 2024-09-17T01:32:11.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.302+0000 7fde55000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde50162fa0 0x7fde50161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:11.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.302+0000 7fde55000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde50162fa0 0x7fde50161530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50312/0 (socket says 172.21.15.42:50312) 2024-09-17T01:32:11.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.302+0000 7fde55000640 1 -- 172.21.15.42:0/337597469 learned_addr learned my addr 172.21.15.42:0/337597469 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:11.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.302+0000 7fde4fe00640 1 --2- 172.21.15.42:0/337597469 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde50073340 0x7fde50153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:11.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.302+0000 7fde47400640 1 --2- 172.21.15.42:0/337597469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde500b6030 0x7fde5015a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:11.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.302+0000 7fde55000640 1 -- 172.21.15.42:0/337597469 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde50073340 msgr2=0x7fde50153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:11.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.302+0000 7fde55000640 1 --2- 172.21.15.42:0/337597469 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde50073340 0x7fde50153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:11.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.302+0000 7fde55000640 1 -- 172.21.15.42:0/337597469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde500b6030 msgr2=0x7fde5015a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:11.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.302+0000 7fde55000640 1 --2- 172.21.15.42:0/337597469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde500b6030 0x7fde5015a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:11.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.302+0000 7fde55000640 1 -- 172.21.15.42:0/337597469 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde501f5f50 con 0x7fde50162fa0 2024-09-17T01:32:11.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.303+0000 7fde55000640 1 --2- 172.21.15.42:0/337597469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde50162fa0 0x7fde50161530 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fde48005fd0 tx=0x7fde48033ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:11.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.303+0000 7fde4cc00640 1 -- 172.21.15.42:0/337597469 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48042020 con 0x7fde50162fa0 2024-09-17T01:32:11.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.303+0000 7fde4cc00640 1 -- 172.21.15.42:0/337597469 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde48033cc0 con 0x7fde50162fa0 2024-09-17T01:32:11.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.303+0000 7fde4cc00640 1 -- 172.21.15.42:0/337597469 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48037040 con 0x7fde50162fa0 2024-09-17T01:32:11.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.303+0000 7fde55a00640 1 -- 172.21.15.42:0/337597469 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde501f6230 con 0x7fde50162fa0 2024-09-17T01:32:11.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.303+0000 7fde55a00640 1 -- 172.21.15.42:0/337597469 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde501f67f0 con 0x7fde50162fa0 2024-09-17T01:32:11.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.304+0000 7fde55a00640 1 -- 172.21.15.42:0/337597469 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde501f5cc0 con 0x7fde50162fa0 2024-09-17T01:32:11.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.305+0000 7fde4cc00640 1 -- 172.21.15.42:0/337597469 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fde48045020 con 0x7fde50162fa0 2024-09-17T01:32:11.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.306+0000 7fde4cc00640 1 --2- 172.21.15.42:0/337597469 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde2c078bc0 0x7fde2c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:11.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.307+0000 7fde4cc00640 1 -- 172.21.15.42:0/337597469 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fde480bb840 con 0x7fde50162fa0 2024-09-17T01:32:11.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.307+0000 7fde4fe00640 1 --2- 172.21.15.42:0/337597469 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde2c078bc0 0x7fde2c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:11.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.308+0000 7fde4fe00640 1 --2- 172.21.15.42:0/337597469 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde2c078bc0 0x7fde2c07b0d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fde40009b30 tx=0x7fde40005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:11.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.311+0000 7fde4cc00640 1 -- 172.21.15.42:0/337597469 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fde4804c070 con 0x7fde50162fa0 2024-09-17T01:32:11.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.503+0000 7fde55a00640 1 -- 172.21.15.42:0/337597469 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fde500d2810 con 0x7fde2c078bc0 2024-09-17T01:32:11.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.510+0000 7fde4cc00640 1 -- 172.21.15.42:0/337597469 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251932 (secure 0 0 0) 0x7fde500d2810 con 0x7fde2c078bc0 2024-09-17T01:32:11.511 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:11.512 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:32:11.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.514+0000 7fde55a00640 1 -- 172.21.15.42:0/337597469 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde2c078bc0 msgr2=0x7fde2c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:11.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.514+0000 7fde55a00640 1 --2- 172.21.15.42:0/337597469 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde2c078bc0 0x7fde2c07b0d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fde40009b30 tx=0x7fde40005f90 comp rx=0 tx=0).stop 2024-09-17T01:32:11.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.514+0000 7fde55a00640 1 -- 172.21.15.42:0/337597469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde50162fa0 msgr2=0x7fde50161530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:11.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.514+0000 7fde55a00640 1 --2- 172.21.15.42:0/337597469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde50162fa0 0x7fde50161530 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fde48005fd0 tx=0x7fde48033ad0 comp rx=0 tx=0).stop 2024-09-17T01:32:11.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.514+0000 7fde55a00640 1 -- 172.21.15.42:0/337597469 shutdown_connections 2024-09-17T01:32:11.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.514+0000 7fde55a00640 1 --2- 172.21.15.42:0/337597469 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde2c078bc0 0x7fde2c07b0d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:11.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.514+0000 7fde55a00640 1 --2- 172.21.15.42:0/337597469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde500b6030 0x7fde5015a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:11.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.514+0000 7fde55a00640 1 --2- 172.21.15.42:0/337597469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde50162fa0 0x7fde50161530 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:11.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.514+0000 7fde55a00640 1 --2- 172.21.15.42:0/337597469 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde50073340 0x7fde50153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:11.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.514+0000 7fde55a00640 1 -- 172.21.15.42:0/337597469 >> 172.21.15.42:0/337597469 conn(0x7fde500d1210 msgr2=0x7fde500b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:11.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.514+0000 7fde55a00640 1 -- 172.21.15.42:0/337597469 shutdown_connections 2024-09-17T01:32:11.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.514+0000 7fde55a00640 1 -- 172.21.15.42:0/337597469 wait complete. 2024-09-17T01:32:11.536 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-17T01:32:10.975592+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252456,"kb_used_data":2940,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722264,"statfs":{"total":773094113280,"available":772835598336,"internally_reserved":0,"allocated":3010560,"data_stored":1793672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.938809"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084683+0000","last_change":"2024-09-17T01:32:07.103456+0000","last_active":"2024-09-17T01:32:08.084683+0000","last_peered":"2024-09-17T01:32:08.084683+0000","last_clean":"2024-09-17T01:32:08.084683+0000","last_became_active":"2024-09-17T01:32:07.103109+0000","last_became_peered":"2024-09-17T01:32:07.103109+0000","last_unstale":"2024-09-17T01:32:08.084683+0000","last_undegraded":"2024-09-17T01:32:08.084683+0000","last_fullsized":"2024-09-17T01:32:08.084683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:38.558917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255495+0000","last_change":"2024-09-17T01:32:07.099455+0000","last_active":"2024-09-17T01:32:08.255495+0000","last_peered":"2024-09-17T01:32:08.255495+0000","last_clean":"2024-09-17T01:32:08.255495+0000","last_became_active":"2024-09-17T01:32:07.099052+0000","last_became_peered":"2024-09-17T01:32:07.099052+0000","last_unstale":"2024-09-17T01:32:08.255495+0000","last_undegraded":"2024-09-17T01:32:08.255495+0000","last_fullsized":"2024-09-17T01:32:08.255495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:14.731320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254735+0000","last_change":"2024-09-17T01:32:07.085703+0000","last_active":"2024-09-17T01:32:08.254735+0000","last_peered":"2024-09-17T01:32:08.254735+0000","last_clean":"2024-09-17T01:32:08.254735+0000","last_became_active":"2024-09-17T01:32:07.085380+0000","last_became_peered":"2024-09-17T01:32:07.085380+0000","last_unstale":"2024-09-17T01:32:08.254735+0000","last_undegraded":"2024-09-17T01:32:08.254735+0000","last_fullsized":"2024-09-17T01:32:08.254735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:01.084404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254328+0000","last_change":"2024-09-17T01:32:07.073236+0000","last_active":"2024-09-17T01:32:08.254328+0000","last_peered":"2024-09-17T01:32:08.254328+0000","last_clean":"2024-09-17T01:32:08.254328+0000","last_became_active":"2024-09-17T01:32:07.072918+0000","last_became_peered":"2024-09-17T01:32:07.072918+0000","last_unstale":"2024-09-17T01:32:08.254328+0000","last_undegraded":"2024-09-17T01:32:08.254328+0000","last_fullsized":"2024-09-17T01:32:08.254328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:57.510381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084044+0000","last_change":"2024-09-17T01:32:07.082349+0000","last_active":"2024-09-17T01:32:08.084044+0000","last_peered":"2024-09-17T01:32:08.084044+0000","last_clean":"2024-09-17T01:32:08.084044+0000","last_became_active":"2024-09-17T01:32:07.081897+0000","last_became_peered":"2024-09-17T01:32:07.081897+0000","last_unstale":"2024-09-17T01:32:08.084044+0000","last_undegraded":"2024-09-17T01:32:08.084044+0000","last_fullsized":"2024-09-17T01:32:08.084044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:32.623242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254134+0000","last_change":"2024-09-17T01:32:07.074398+0000","last_active":"2024-09-17T01:32:08.254134+0000","last_peered":"2024-09-17T01:32:08.254134+0000","last_clean":"2024-09-17T01:32:08.254134+0000","last_became_active":"2024-09-17T01:32:07.074076+0000","last_became_peered":"2024-09-17T01:32:07.074076+0000","last_unstale":"2024-09-17T01:32:08.254134+0000","last_undegraded":"2024-09-17T01:32:08.254134+0000","last_fullsized":"2024-09-17T01:32:08.254134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:14.053004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.083789+0000","last_change":"2024-09-17T01:32:07.076442+0000","last_active":"2024-09-17T01:32:08.083789+0000","last_peered":"2024-09-17T01:32:08.083789+0000","last_clean":"2024-09-17T01:32:08.083789+0000","last_became_active":"2024-09-17T01:32:07.076156+0000","last_became_peered":"2024-09-17T01:32:07.076156+0000","last_unstale":"2024-09-17T01:32:08.083789+0000","last_undegraded":"2024-09-17T01:32:08.083789+0000","last_fullsized":"2024-09-17T01:32:08.083789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:13:53.149286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255624+0000","last_change":"2024-09-17T01:32:07.085589+0000","last_active":"2024-09-17T01:32:08.255624+0000","last_peered":"2024-09-17T01:32:08.255624+0000","last_clean":"2024-09-17T01:32:08.255624+0000","last_became_active":"2024-09-17T01:32:07.085259+0000","last_became_peered":"2024-09-17T01:32:07.085259+0000","last_unstale":"2024-09-17T01:32:08.255624+0000","last_undegraded":"2024-09-17T01:32:08.255624+0000","last_fullsized":"2024-09-17T01:32:08.255624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:41.271843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.078098+0000","last_change":"2024-09-17T01:32:07.092123+0000","last_active":"2024-09-17T01:32:08.078098+0000","last_peered":"2024-09-17T01:32:08.078098+0000","last_clean":"2024-09-17T01:32:08.078098+0000","last_became_active":"2024-09-17T01:32:07.091713+0000","last_became_peered":"2024-09-17T01:32:07.091713+0000","last_unstale":"2024-09-17T01:32:08.078098+0000","last_undegraded":"2024-09-17T01:32:08.078098+0000","last_fullsized":"2024-09-17T01:32:08.078098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:05.017902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084219+0000","last_change":"2024-09-17T01:32:07.085067+0000","last_active":"2024-09-17T01:32:08.084219+0000","last_peered":"2024-09-17T01:32:08.084219+0000","last_clean":"2024-09-17T01:32:08.084219+0000","last_became_active":"2024-09-17T01:32:07.084837+0000","last_became_peered":"2024-09-17T01:32:07.084837+0000","last_unstale":"2024-09-17T01:32:08.084219+0000","last_undegraded":"2024-09-17T01:32:08.084219+0000","last_fullsized":"2024-09-17T01:32:08.084219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:02.511769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084409+0000","last_change":"2024-09-17T01:32:07.099691+0000","last_active":"2024-09-17T01:32:08.084409+0000","last_peered":"2024-09-17T01:32:08.084409+0000","last_clean":"2024-09-17T01:32:08.084409+0000","last_became_active":"2024-09-17T01:32:07.094018+0000","last_became_peered":"2024-09-17T01:32:07.094018+0000","last_unstale":"2024-09-17T01:32:08.084409+0000","last_undegraded":"2024-09-17T01:32:08.084409+0000","last_fullsized":"2024-09-17T01:32:08.084409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:58.314338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084110+0000","last_change":"2024-09-17T01:32:07.073776+0000","last_active":"2024-09-17T01:32:08.084110+0000","last_peered":"2024-09-17T01:32:08.084110+0000","last_clean":"2024-09-17T01:32:08.084110+0000","last_became_active":"2024-09-17T01:32:07.073442+0000","last_became_peered":"2024-09-17T01:32:07.073442+0000","last_unstale":"2024-09-17T01:32:08.084110+0000","last_undegraded":"2024-09-17T01:32:08.084110+0000","last_fullsized":"2024-09-17T01:32:08.084110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:37.765577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.081135+0000","last_change":"2024-09-17T01:32:07.078885+0000","last_active":"2024-09-17T01:32:08.081135+0000","last_peered":"2024-09-17T01:32:08.081135+0000","last_clean":"2024-09-17T01:32:08.081135+0000","last_became_active":"2024-09-17T01:32:07.078435+0000","last_became_peered":"2024-09-17T01:32:07.078435+0000","last_unstale":"2024-09-17T01:32:08.081135+0000","last_undegraded":"2024-09-17T01:32:08.081135+0000","last_fullsized":"2024-09-17T01:32:08.081135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:22:26.061474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.081581+0000","last_change":"2024-09-17T01:32:07.088794+0000","last_active":"2024-09-17T01:32:08.081581+0000","last_peered":"2024-09-17T01:32:08.081581+0000","last_clean":"2024-09-17T01:32:08.081581+0000","last_became_active":"2024-09-17T01:32:07.088354+0000","last_became_peered":"2024-09-17T01:32:07.088354+0000","last_unstale":"2024-09-17T01:32:08.081581+0000","last_undegraded":"2024-09-17T01:32:08.081581+0000","last_fullsized":"2024-09-17T01:32:08.081581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:04.151746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255400+0000","last_change":"2024-09-17T01:32:07.080283+0000","last_active":"2024-09-17T01:32:08.255400+0000","last_peered":"2024-09-17T01:32:08.255400+0000","last_clean":"2024-09-17T01:32:08.255400+0000","last_became_active":"2024-09-17T01:32:07.079956+0000","last_became_peered":"2024-09-17T01:32:07.079956+0000","last_unstale":"2024-09-17T01:32:08.255400+0000","last_undegraded":"2024-09-17T01:32:08.255400+0000","last_fullsized":"2024-09-17T01:32:08.255400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:35:07.968881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.253904+0000","last_change":"2024-09-17T01:32:07.085014+0000","last_active":"2024-09-17T01:32:08.253904+0000","last_peered":"2024-09-17T01:32:08.253904+0000","last_clean":"2024-09-17T01:32:08.253904+0000","last_became_active":"2024-09-17T01:32:07.084701+0000","last_became_peered":"2024-09-17T01:32:07.084701+0000","last_unstale":"2024-09-17T01:32:08.253904+0000","last_undegraded":"2024-09-17T01:32:08.253904+0000","last_fullsized":"2024-09-17T01:32:08.253904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:45.382776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255636+0000","last_change":"2024-09-17T01:32:07.095513+0000","last_active":"2024-09-17T01:32:08.255636+0000","last_peered":"2024-09-17T01:32:08.255636+0000","last_clean":"2024-09-17T01:32:08.255636+0000","last_became_active":"2024-09-17T01:32:07.090989+0000","last_became_peered":"2024-09-17T01:32:07.090989+0000","last_unstale":"2024-09-17T01:32:08.255636+0000","last_undegraded":"2024-09-17T01:32:08.255636+0000","last_fullsized":"2024-09-17T01:32:08.255636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:46.947860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254682+0000","last_change":"2024-09-17T01:32:07.097564+0000","last_active":"2024-09-17T01:32:08.254682+0000","last_peered":"2024-09-17T01:32:08.254682+0000","last_clean":"2024-09-17T01:32:08.254682+0000","last_became_active":"2024-09-17T01:32:07.096842+0000","last_became_peered":"2024-09-17T01:32:07.096842+0000","last_unstale":"2024-09-17T01:32:08.254682+0000","last_undegraded":"2024-09-17T01:32:08.254682+0000","last_fullsized":"2024-09-17T01:32:08.254682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:20.757148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255495+0000","last_change":"2024-09-17T01:32:07.076493+0000","last_active":"2024-09-17T01:32:08.255495+0000","last_peered":"2024-09-17T01:32:08.255495+0000","last_clean":"2024-09-17T01:32:08.255495+0000","last_became_active":"2024-09-17T01:32:07.076153+0000","last_became_peered":"2024-09-17T01:32:07.076153+0000","last_unstale":"2024-09-17T01:32:08.255495+0000","last_undegraded":"2024-09-17T01:32:08.255495+0000","last_fullsized":"2024-09-17T01:32:08.255495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:25.265447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084142+0000","last_change":"2024-09-17T01:32:07.074913+0000","last_active":"2024-09-17T01:32:08.084142+0000","last_peered":"2024-09-17T01:32:08.084142+0000","last_clean":"2024-09-17T01:32:08.084142+0000","last_became_active":"2024-09-17T01:32:07.074573+0000","last_became_peered":"2024-09-17T01:32:07.074573+0000","last_unstale":"2024-09-17T01:32:08.084142+0000","last_undegraded":"2024-09-17T01:32:08.084142+0000","last_fullsized":"2024-09-17T01:32:08.084142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:46.307074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079705+0000","last_change":"2024-09-17T01:32:07.072132+0000","last_active":"2024-09-17T01:32:08.079705+0000","last_peered":"2024-09-17T01:32:08.079705+0000","last_clean":"2024-09-17T01:32:08.079705+0000","last_became_active":"2024-09-17T01:32:07.071687+0000","last_became_peered":"2024-09-17T01:32:07.071687+0000","last_unstale":"2024-09-17T01:32:08.079705+0000","last_undegraded":"2024-09-17T01:32:08.079705+0000","last_fullsized":"2024-09-17T01:32:08.079705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:05:00.465504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.077563+0000","last_change":"2024-09-17T01:32:07.083167+0000","last_active":"2024-09-17T01:32:08.077563+0000","last_peered":"2024-09-17T01:32:08.077563+0000","last_clean":"2024-09-17T01:32:08.077563+0000","last_became_active":"2024-09-17T01:32:07.082843+0000","last_became_peered":"2024-09-17T01:32:07.082843+0000","last_unstale":"2024-09-17T01:32:08.077563+0000","last_undegraded":"2024-09-17T01:32:08.077563+0000","last_fullsized":"2024-09-17T01:32:08.077563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:33.769443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255226+0000","last_change":"2024-09-17T01:32:07.075509+0000","last_active":"2024-09-17T01:32:08.255226+0000","last_peered":"2024-09-17T01:32:08.255226+0000","last_clean":"2024-09-17T01:32:08.255226+0000","last_became_active":"2024-09-17T01:32:07.075146+0000","last_became_peered":"2024-09-17T01:32:07.075146+0000","last_unstale":"2024-09-17T01:32:08.255226+0000","last_undegraded":"2024-09-17T01:32:08.255226+0000","last_fullsized":"2024-09-17T01:32:08.255226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:47.850069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.253907+0000","last_change":"2024-09-17T01:32:07.092134+0000","last_active":"2024-09-17T01:32:08.253907+0000","last_peered":"2024-09-17T01:32:08.253907+0000","last_clean":"2024-09-17T01:32:08.253907+0000","last_became_active":"2024-09-17T01:32:07.091782+0000","last_became_peered":"2024-09-17T01:32:07.091782+0000","last_unstale":"2024-09-17T01:32:08.253907+0000","last_undegraded":"2024-09-17T01:32:08.253907+0000","last_fullsized":"2024-09-17T01:32:08.253907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:50.828833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255041+0000","last_change":"2024-09-17T01:32:07.091641+0000","last_active":"2024-09-17T01:32:08.255041+0000","last_peered":"2024-09-17T01:32:08.255041+0000","last_clean":"2024-09-17T01:32:08.255041+0000","last_became_active":"2024-09-17T01:32:07.091316+0000","last_became_peered":"2024-09-17T01:32:07.091316+0000","last_unstale":"2024-09-17T01:32:08.255041+0000","last_undegraded":"2024-09-17T01:32:08.255041+0000","last_fullsized":"2024-09-17T01:32:08.255041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:30.669754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254763+0000","last_change":"2024-09-17T01:32:07.097633+0000","last_active":"2024-09-17T01:32:08.254763+0000","last_peered":"2024-09-17T01:32:08.254763+0000","last_clean":"2024-09-17T01:32:08.254763+0000","last_became_active":"2024-09-17T01:32:07.092029+0000","last_became_peered":"2024-09-17T01:32:07.092029+0000","last_unstale":"2024-09-17T01:32:08.254763+0000","last_undegraded":"2024-09-17T01:32:08.254763+0000","last_fullsized":"2024-09-17T01:32:08.254763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:56.387025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080174+0000","last_change":"2024-09-17T01:32:07.070606+0000","last_active":"2024-09-17T01:32:08.080174+0000","last_peered":"2024-09-17T01:32:08.080174+0000","last_clean":"2024-09-17T01:32:08.080174+0000","last_became_active":"2024-09-17T01:32:07.070312+0000","last_became_peered":"2024-09-17T01:32:07.070312+0000","last_unstale":"2024-09-17T01:32:08.080174+0000","last_undegraded":"2024-09-17T01:32:08.080174+0000","last_fullsized":"2024-09-17T01:32:08.080174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:58.298740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079492+0000","last_change":"2024-09-17T01:32:07.086253+0000","last_active":"2024-09-17T01:32:08.079492+0000","last_peered":"2024-09-17T01:32:08.079492+0000","last_clean":"2024-09-17T01:32:08.079492+0000","last_became_active":"2024-09-17T01:32:07.085897+0000","last_became_peered":"2024-09-17T01:32:07.085897+0000","last_unstale":"2024-09-17T01:32:08.079492+0000","last_undegraded":"2024-09-17T01:32:08.079492+0000","last_fullsized":"2024-09-17T01:32:08.079492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:54.160964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254923+0000","last_change":"2024-09-17T01:32:07.080316+0000","last_active":"2024-09-17T01:32:08.254923+0000","last_peered":"2024-09-17T01:32:08.254923+0000","last_clean":"2024-09-17T01:32:08.254923+0000","last_became_active":"2024-09-17T01:32:07.079896+0000","last_became_peered":"2024-09-17T01:32:07.079896+0000","last_unstale":"2024-09-17T01:32:08.254923+0000","last_undegraded":"2024-09-17T01:32:08.254923+0000","last_fullsized":"2024-09-17T01:32:08.254923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:19.850165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254673+0000","last_change":"2024-09-17T01:32:07.092975+0000","last_active":"2024-09-17T01:32:08.254673+0000","last_peered":"2024-09-17T01:32:08.254673+0000","last_clean":"2024-09-17T01:32:08.254673+0000","last_became_active":"2024-09-17T01:32:07.090003+0000","last_became_peered":"2024-09-17T01:32:07.090003+0000","last_unstale":"2024-09-17T01:32:08.254673+0000","last_undegraded":"2024-09-17T01:32:08.254673+0000","last_fullsized":"2024-09-17T01:32:08.254673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:12.771004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254825+0000","last_change":"2024-09-17T01:32:07.079839+0000","last_active":"2024-09-17T01:32:08.254825+0000","last_peered":"2024-09-17T01:32:08.254825+0000","last_clean":"2024-09-17T01:32:08.254825+0000","last_became_active":"2024-09-17T01:32:07.079012+0000","last_became_peered":"2024-09-17T01:32:07.079012+0000","last_unstale":"2024-09-17T01:32:08.254825+0000","last_undegraded":"2024-09-17T01:32:08.254825+0000","last_fullsized":"2024-09-17T01:32:08.254825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:23.124830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254237+0000","last_change":"2024-09-17T01:32:07.076970+0000","last_active":"2024-09-17T01:32:08.254237+0000","last_peered":"2024-09-17T01:32:08.254237+0000","last_clean":"2024-09-17T01:32:08.254237+0000","last_became_active":"2024-09-17T01:32:07.072256+0000","last_became_peered":"2024-09-17T01:32:07.072256+0000","last_unstale":"2024-09-17T01:32:08.254237+0000","last_undegraded":"2024-09-17T01:32:08.254237+0000","last_fullsized":"2024-09-17T01:32:08.254237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:17.000817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.077708+0000","last_change":"2024-09-17T01:32:07.086593+0000","last_active":"2024-09-17T01:32:08.077708+0000","last_peered":"2024-09-17T01:32:08.077708+0000","last_clean":"2024-09-17T01:32:08.077708+0000","last_became_active":"2024-09-17T01:32:07.086265+0000","last_became_peered":"2024-09-17T01:32:07.086265+0000","last_unstale":"2024-09-17T01:32:08.077708+0000","last_undegraded":"2024-09-17T01:32:08.077708+0000","last_fullsized":"2024-09-17T01:32:08.077708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:59.076106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255106+0000","last_change":"2024-09-17T01:32:06.072600+0000","last_active":"2024-09-17T01:32:08.255106+0000","last_peered":"2024-09-17T01:32:08.255106+0000","last_clean":"2024-09-17T01:32:08.255106+0000","last_became_active":"2024-09-17T01:32:06.072280+0000","last_became_peered":"2024-09-17T01:32:06.072280+0000","last_unstale":"2024-09-17T01:32:08.255106+0000","last_undegraded":"2024-09-17T01:32:08.255106+0000","last_fullsized":"2024-09-17T01:32:08.255106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:24.693140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079998+0000","last_change":"2024-09-17T01:32:07.082615+0000","last_active":"2024-09-17T01:32:08.079998+0000","last_peered":"2024-09-17T01:32:08.079998+0000","last_clean":"2024-09-17T01:32:08.079998+0000","last_became_active":"2024-09-17T01:32:07.082266+0000","last_became_peered":"2024-09-17T01:32:07.082266+0000","last_unstale":"2024-09-17T01:32:08.079998+0000","last_undegraded":"2024-09-17T01:32:08.079998+0000","last_fullsized":"2024-09-17T01:32:08.079998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:34.677913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254763+0000","last_change":"2024-09-17T01:32:06.081486+0000","last_active":"2024-09-17T01:32:08.254763+0000","last_peered":"2024-09-17T01:32:08.254763+0000","last_clean":"2024-09-17T01:32:08.254763+0000","last_became_active":"2024-09-17T01:32:06.081193+0000","last_became_peered":"2024-09-17T01:32:06.081193+0000","last_unstale":"2024-09-17T01:32:08.254763+0000","last_undegraded":"2024-09-17T01:32:08.254763+0000","last_fullsized":"2024-09-17T01:32:08.254763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:53.154130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079445+0000","last_change":"2024-09-17T01:32:06.069305+0000","last_active":"2024-09-17T01:32:08.079445+0000","last_peered":"2024-09-17T01:32:08.079445+0000","last_clean":"2024-09-17T01:32:08.079445+0000","last_became_active":"2024-09-17T01:32:06.068652+0000","last_became_peered":"2024-09-17T01:32:06.068652+0000","last_unstale":"2024-09-17T01:32:08.079445+0000","last_undegraded":"2024-09-17T01:32:08.079445+0000","last_fullsized":"2024-09-17T01:32:08.079445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:48.494445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255548+0000","last_change":"2024-09-17T01:32:07.087945+0000","last_active":"2024-09-17T01:32:08.255548+0000","last_peered":"2024-09-17T01:32:08.255548+0000","last_clean":"2024-09-17T01:32:08.255548+0000","last_became_active":"2024-09-17T01:32:07.081997+0000","last_became_peered":"2024-09-17T01:32:07.081997+0000","last_unstale":"2024-09-17T01:32:08.255548+0000","last_undegraded":"2024-09-17T01:32:08.255548+0000","last_fullsized":"2024-09-17T01:32:08.255548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:25.453779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254032+0000","last_change":"2024-09-17T01:32:06.064957+0000","last_active":"2024-09-17T01:32:08.254032+0000","last_peered":"2024-09-17T01:32:08.254032+0000","last_clean":"2024-09-17T01:32:08.254032+0000","last_became_active":"2024-09-17T01:32:06.064565+0000","last_became_peered":"2024-09-17T01:32:06.064565+0000","last_unstale":"2024-09-17T01:32:08.254032+0000","last_undegraded":"2024-09-17T01:32:08.254032+0000","last_fullsized":"2024-09-17T01:32:08.254032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:41.844576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079397+0000","last_change":"2024-09-17T01:32:07.068057+0000","last_active":"2024-09-17T01:32:08.079397+0000","last_peered":"2024-09-17T01:32:08.079397+0000","last_clean":"2024-09-17T01:32:08.079397+0000","last_became_active":"2024-09-17T01:32:07.067735+0000","last_became_peered":"2024-09-17T01:32:07.067735+0000","last_unstale":"2024-09-17T01:32:08.079397+0000","last_undegraded":"2024-09-17T01:32:08.079397+0000","last_fullsized":"2024-09-17T01:32:08.079397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:42.854196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.078116+0000","last_change":"2024-09-17T01:32:06.061484+0000","last_active":"2024-09-17T01:32:08.078116+0000","last_peered":"2024-09-17T01:32:08.078116+0000","last_clean":"2024-09-17T01:32:08.078116+0000","last_became_active":"2024-09-17T01:32:06.061082+0000","last_became_peered":"2024-09-17T01:32:06.061082+0000","last_unstale":"2024-09-17T01:32:08.078116+0000","last_undegraded":"2024-09-17T01:32:08.078116+0000","last_fullsized":"2024-09-17T01:32:08.078116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:57.830631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254780+0000","last_change":"2024-09-17T01:32:07.098046+0000","last_active":"2024-09-17T01:32:08.254780+0000","last_peered":"2024-09-17T01:32:08.254780+0000","last_clean":"2024-09-17T01:32:08.254780+0000","last_became_active":"2024-09-17T01:32:07.094416+0000","last_became_peered":"2024-09-17T01:32:07.094416+0000","last_unstale":"2024-09-17T01:32:08.254780+0000","last_undegraded":"2024-09-17T01:32:08.254780+0000","last_fullsized":"2024-09-17T01:32:08.254780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:28.815131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084431+0000","last_change":"2024-09-17T01:32:06.072252+0000","last_active":"2024-09-17T01:32:08.084431+0000","last_peered":"2024-09-17T01:32:08.084431+0000","last_clean":"2024-09-17T01:32:08.084431+0000","last_became_active":"2024-09-17T01:32:06.071868+0000","last_became_peered":"2024-09-17T01:32:06.071868+0000","last_unstale":"2024-09-17T01:32:08.084431+0000","last_undegraded":"2024-09-17T01:32:08.084431+0000","last_fullsized":"2024-09-17T01:32:08.084431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:32.739722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255545+0000","last_change":"2024-09-17T01:32:07.101387+0000","last_active":"2024-09-17T01:32:08.255545+0000","last_peered":"2024-09-17T01:32:08.255545+0000","last_clean":"2024-09-17T01:32:08.255545+0000","last_became_active":"2024-09-17T01:32:07.101077+0000","last_became_peered":"2024-09-17T01:32:07.101077+0000","last_unstale":"2024-09-17T01:32:08.255545+0000","last_undegraded":"2024-09-17T01:32:08.255545+0000","last_fullsized":"2024-09-17T01:32:08.255545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:36:23.728414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254880+0000","last_change":"2024-09-17T01:32:06.061334+0000","last_active":"2024-09-17T01:32:08.254880+0000","last_peered":"2024-09-17T01:32:08.254880+0000","last_clean":"2024-09-17T01:32:08.254880+0000","last_became_active":"2024-09-17T01:32:06.061062+0000","last_became_peered":"2024-09-17T01:32:06.061062+0000","last_unstale":"2024-09-17T01:32:08.254880+0000","last_undegraded":"2024-09-17T01:32:08.254880+0000","last_fullsized":"2024-09-17T01:32:08.254880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:26.325842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255304+0000","last_change":"2024-09-17T01:32:07.089550+0000","last_active":"2024-09-17T01:32:08.255304+0000","last_peered":"2024-09-17T01:32:08.255304+0000","last_clean":"2024-09-17T01:32:08.255304+0000","last_became_active":"2024-09-17T01:32:07.089255+0000","last_became_peered":"2024-09-17T01:32:07.089255+0000","last_unstale":"2024-09-17T01:32:08.255304+0000","last_undegraded":"2024-09-17T01:32:08.255304+0000","last_fullsized":"2024-09-17T01:32:08.255304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:40.540113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254393+0000","last_change":"2024-09-17T01:32:06.062145+0000","last_active":"2024-09-17T01:32:08.254393+0000","last_peered":"2024-09-17T01:32:08.254393+0000","last_clean":"2024-09-17T01:32:08.254393+0000","last_became_active":"2024-09-17T01:32:06.061691+0000","last_became_peered":"2024-09-17T01:32:06.061691+0000","last_unstale":"2024-09-17T01:32:08.254393+0000","last_undegraded":"2024-09-17T01:32:08.254393+0000","last_fullsized":"2024-09-17T01:32:08.254393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:52.657492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084154+0000","last_change":"2024-09-17T01:32:07.078612+0000","last_active":"2024-09-17T01:32:08.084154+0000","last_peered":"2024-09-17T01:32:08.084154+0000","last_clean":"2024-09-17T01:32:08.084154+0000","last_became_active":"2024-09-17T01:32:07.078227+0000","last_became_peered":"2024-09-17T01:32:07.078227+0000","last_unstale":"2024-09-17T01:32:08.084154+0000","last_undegraded":"2024-09-17T01:32:08.084154+0000","last_fullsized":"2024-09-17T01:32:08.084154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:54.702390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254498+0000","last_change":"2024-09-17T01:32:06.083372+0000","last_active":"2024-09-17T01:32:08.254498+0000","last_peered":"2024-09-17T01:32:08.254498+0000","last_clean":"2024-09-17T01:32:08.254498+0000","last_became_active":"2024-09-17T01:32:06.082955+0000","last_became_peered":"2024-09-17T01:32:06.082955+0000","last_unstale":"2024-09-17T01:32:08.254498+0000","last_undegraded":"2024-09-17T01:32:08.254498+0000","last_fullsized":"2024-09-17T01:32:08.254498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:48.494445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.081245+0000","last_change":"2024-09-17T01:32:07.090664+0000","last_active":"2024-09-17T01:32:08.081245+0000","last_peered":"2024-09-17T01:32:08.081245+0000","last_clean":"2024-09-17T01:32:08.081245+0000","last_became_active":"2024-09-17T01:32:07.090142+0000","last_became_peered":"2024-09-17T01:32:07.090142+0000","last_unstale":"2024-09-17T01:32:08.081245+0000","last_undegraded":"2024-09-17T01:32:08.081245+0000","last_fullsized":"2024-09-17T01:32:08.081245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:37.231363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254829+0000","last_change":"2024-09-17T01:32:06.059219+0000","last_active":"2024-09-17T01:32:08.254829+0000","last_peered":"2024-09-17T01:32:08.254829+0000","last_clean":"2024-09-17T01:32:08.254829+0000","last_became_active":"2024-09-17T01:32:06.058230+0000","last_became_peered":"2024-09-17T01:32:06.058230+0000","last_unstale":"2024-09-17T01:32:08.254829+0000","last_undegraded":"2024-09-17T01:32:08.254829+0000","last_fullsized":"2024-09-17T01:32:08.254829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:53.345377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254873+0000","last_change":"2024-09-17T01:32:07.089933+0000","last_active":"2024-09-17T01:32:08.254873+0000","last_peered":"2024-09-17T01:32:08.254873+0000","last_clean":"2024-09-17T01:32:08.254873+0000","last_became_active":"2024-09-17T01:32:07.080900+0000","last_became_peered":"2024-09-17T01:32:07.080900+0000","last_unstale":"2024-09-17T01:32:08.254873+0000","last_undegraded":"2024-09-17T01:32:08.254873+0000","last_fullsized":"2024-09-17T01:32:08.254873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:07:38.397880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.083659+0000","last_change":"2024-09-17T01:32:06.079871+0000","last_active":"2024-09-17T01:32:08.083659+0000","last_peered":"2024-09-17T01:32:08.083659+0000","last_clean":"2024-09-17T01:32:08.083659+0000","last_became_active":"2024-09-17T01:32:06.079581+0000","last_became_peered":"2024-09-17T01:32:06.079581+0000","last_unstale":"2024-09-17T01:32:08.083659+0000","last_undegraded":"2024-09-17T01:32:08.083659+0000","last_fullsized":"2024-09-17T01:32:08.083659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:37.449372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.077508+0000","last_change":"2024-09-17T01:32:07.089282+0000","last_active":"2024-09-17T01:32:08.077508+0000","last_peered":"2024-09-17T01:32:08.077508+0000","last_clean":"2024-09-17T01:32:08.077508+0000","last_became_active":"2024-09-17T01:32:07.088928+0000","last_became_peered":"2024-09-17T01:32:07.088928+0000","last_unstale":"2024-09-17T01:32:08.077508+0000","last_undegraded":"2024-09-17T01:32:08.077508+0000","last_fullsized":"2024-09-17T01:32:08.077508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:58.786102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080466+0000","last_change":"2024-09-17T01:32:06.053867+0000","last_active":"2024-09-17T01:32:08.080466+0000","last_peered":"2024-09-17T01:32:08.080466+0000","last_clean":"2024-09-17T01:32:08.080466+0000","last_became_active":"2024-09-17T01:32:06.053466+0000","last_became_peered":"2024-09-17T01:32:06.053466+0000","last_unstale":"2024-09-17T01:32:08.080466+0000","last_undegraded":"2024-09-17T01:32:08.080466+0000","last_fullsized":"2024-09-17T01:32:08.080466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:33.901561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254246+0000","last_change":"2024-09-17T01:32:07.095265+0000","last_active":"2024-09-17T01:32:08.254246+0000","last_peered":"2024-09-17T01:32:08.254246+0000","last_clean":"2024-09-17T01:32:08.254246+0000","last_became_active":"2024-09-17T01:32:07.094979+0000","last_became_peered":"2024-09-17T01:32:07.094979+0000","last_unstale":"2024-09-17T01:32:08.254246+0000","last_undegraded":"2024-09-17T01:32:08.254246+0000","last_fullsized":"2024-09-17T01:32:08.254246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:38.558917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084880+0000","last_change":"2024-09-17T01:32:06.083417+0000","last_active":"2024-09-17T01:32:08.084880+0000","last_peered":"2024-09-17T01:32:08.084880+0000","last_clean":"2024-09-17T01:32:08.084880+0000","last_became_active":"2024-09-17T01:32:06.082378+0000","last_became_peered":"2024-09-17T01:32:06.082378+0000","last_unstale":"2024-09-17T01:32:08.084880+0000","last_undegraded":"2024-09-17T01:32:08.084880+0000","last_fullsized":"2024-09-17T01:32:08.084880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:37:12.138471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254924+0000","last_change":"2024-09-17T01:32:07.087871+0000","last_active":"2024-09-17T01:32:08.254924+0000","last_peered":"2024-09-17T01:32:08.254924+0000","last_clean":"2024-09-17T01:32:08.254924+0000","last_became_active":"2024-09-17T01:32:07.086811+0000","last_became_peered":"2024-09-17T01:32:07.086811+0000","last_unstale":"2024-09-17T01:32:08.254924+0000","last_undegraded":"2024-09-17T01:32:08.254924+0000","last_fullsized":"2024-09-17T01:32:08.254924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:47.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080419+0000","last_change":"2024-09-17T01:32:06.067533+0000","last_active":"2024-09-17T01:32:08.080419+0000","last_peered":"2024-09-17T01:32:08.080419+0000","last_clean":"2024-09-17T01:32:08.080419+0000","last_became_active":"2024-09-17T01:32:06.066265+0000","last_became_peered":"2024-09-17T01:32:06.066265+0000","last_unstale":"2024-09-17T01:32:08.080419+0000","last_undegraded":"2024-09-17T01:32:08.080419+0000","last_fullsized":"2024-09-17T01:32:08.080419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:05.206992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084686+0000","last_change":"2024-09-17T01:32:07.075279+0000","last_active":"2024-09-17T01:32:08.084686+0000","last_peered":"2024-09-17T01:32:08.084686+0000","last_clean":"2024-09-17T01:32:08.084686+0000","last_became_active":"2024-09-17T01:32:07.073899+0000","last_became_peered":"2024-09-17T01:32:07.073899+0000","last_unstale":"2024-09-17T01:32:08.084686+0000","last_undegraded":"2024-09-17T01:32:08.084686+0000","last_fullsized":"2024-09-17T01:32:08.084686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:19:18.340646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254712+0000","last_change":"2024-09-17T01:32:06.071046+0000","last_active":"2024-09-17T01:32:08.254712+0000","last_peered":"2024-09-17T01:32:08.254712+0000","last_clean":"2024-09-17T01:32:08.254712+0000","last_became_active":"2024-09-17T01:32:06.070668+0000","last_became_peered":"2024-09-17T01:32:06.070668+0000","last_unstale":"2024-09-17T01:32:08.254712+0000","last_undegraded":"2024-09-17T01:32:08.254712+0000","last_fullsized":"2024-09-17T01:32:08.254712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:51.537157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084349+0000","last_change":"2024-09-17T01:32:07.081930+0000","last_active":"2024-09-17T01:32:08.084349+0000","last_peered":"2024-09-17T01:32:08.084349+0000","last_clean":"2024-09-17T01:32:08.084349+0000","last_became_active":"2024-09-17T01:32:07.081525+0000","last_became_peered":"2024-09-17T01:32:07.081525+0000","last_unstale":"2024-09-17T01:32:08.084349+0000","last_undegraded":"2024-09-17T01:32:08.084349+0000","last_fullsized":"2024-09-17T01:32:08.084349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:45.382776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079908+0000","last_change":"2024-09-17T01:32:06.071392+0000","last_active":"2024-09-17T01:32:08.079908+0000","last_peered":"2024-09-17T01:32:08.079908+0000","last_clean":"2024-09-17T01:32:08.079908+0000","last_became_active":"2024-09-17T01:32:06.070869+0000","last_became_peered":"2024-09-17T01:32:06.070869+0000","last_unstale":"2024-09-17T01:32:08.079908+0000","last_undegraded":"2024-09-17T01:32:08.079908+0000","last_fullsized":"2024-09-17T01:32:08.079908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:26.325842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255344+0000","last_change":"2024-09-17T01:32:07.076689+0000","last_active":"2024-09-17T01:32:08.255344+0000","last_peered":"2024-09-17T01:32:08.255344+0000","last_clean":"2024-09-17T01:32:08.255344+0000","last_became_active":"2024-09-17T01:32:07.076399+0000","last_became_peered":"2024-09-17T01:32:07.076399+0000","last_unstale":"2024-09-17T01:32:08.255344+0000","last_undegraded":"2024-09-17T01:32:08.255344+0000","last_fullsized":"2024-09-17T01:32:08.255344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:20.255648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.077377+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:32:08.077377+0000","last_peered":"2024-09-17T01:32:08.077377+0000","last_clean":"2024-09-17T01:32:08.077377+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:32:08.077377+0000","last_undegraded":"2024-09-17T01:32:08.077377+0000","last_fullsized":"2024-09-17T01:32:08.077377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255076+0000","last_change":"2024-09-17T01:32:06.064934+0000","last_active":"2024-09-17T01:32:08.255076+0000","last_peered":"2024-09-17T01:32:08.255076+0000","last_clean":"2024-09-17T01:32:08.255076+0000","last_became_active":"2024-09-17T01:32:06.064552+0000","last_became_peered":"2024-09-17T01:32:06.064552+0000","last_unstale":"2024-09-17T01:32:08.255076+0000","last_undegraded":"2024-09-17T01:32:08.255076+0000","last_fullsized":"2024-09-17T01:32:08.255076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:46:21.965124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080286+0000","last_change":"2024-09-17T01:32:07.071839+0000","last_active":"2024-09-17T01:32:08.080286+0000","last_peered":"2024-09-17T01:32:08.080286+0000","last_clean":"2024-09-17T01:32:08.080286+0000","last_became_active":"2024-09-17T01:32:07.071512+0000","last_became_peered":"2024-09-17T01:32:07.071512+0000","last_unstale":"2024-09-17T01:32:08.080286+0000","last_undegraded":"2024-09-17T01:32:08.080286+0000","last_fullsized":"2024-09-17T01:32:08.080286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:10.661342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254134+0000","last_change":"2024-09-17T01:32:06.070832+0000","last_active":"2024-09-17T01:32:08.254134+0000","last_peered":"2024-09-17T01:32:08.254134+0000","last_clean":"2024-09-17T01:32:08.254134+0000","last_became_active":"2024-09-17T01:32:06.070149+0000","last_became_peered":"2024-09-17T01:32:06.070149+0000","last_unstale":"2024-09-17T01:32:08.254134+0000","last_undegraded":"2024-09-17T01:32:08.254134+0000","last_fullsized":"2024-09-17T01:32:08.254134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:32.739722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079316+0000","last_change":"2024-09-17T01:32:07.075984+0000","last_active":"2024-09-17T01:32:08.079316+0000","last_peered":"2024-09-17T01:32:08.079316+0000","last_clean":"2024-09-17T01:32:08.079316+0000","last_became_active":"2024-09-17T01:32:07.074619+0000","last_became_peered":"2024-09-17T01:32:07.074619+0000","last_unstale":"2024-09-17T01:32:08.079316+0000","last_undegraded":"2024-09-17T01:32:08.079316+0000","last_fullsized":"2024-09-17T01:32:08.079316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:34.608401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254201+0000","last_change":"2024-09-17T01:32:06.071910+0000","last_active":"2024-09-17T01:32:08.254201+0000","last_peered":"2024-09-17T01:32:08.254201+0000","last_clean":"2024-09-17T01:32:08.254201+0000","last_became_active":"2024-09-17T01:32:06.071001+0000","last_became_peered":"2024-09-17T01:32:06.071001+0000","last_unstale":"2024-09-17T01:32:08.254201+0000","last_undegraded":"2024-09-17T01:32:08.254201+0000","last_fullsized":"2024-09-17T01:32:08.254201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:02.474882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255127+0000","last_change":"2024-09-17T01:32:07.081167+0000","last_active":"2024-09-17T01:32:08.255127+0000","last_peered":"2024-09-17T01:32:08.255127+0000","last_clean":"2024-09-17T01:32:08.255127+0000","last_became_active":"2024-09-17T01:32:07.080055+0000","last_became_peered":"2024-09-17T01:32:07.080055+0000","last_unstale":"2024-09-17T01:32:08.255127+0000","last_undegraded":"2024-09-17T01:32:08.255127+0000","last_fullsized":"2024-09-17T01:32:08.255127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:39:36.609246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254883+0000","last_change":"2024-09-17T01:32:06.069316+0000","last_active":"2024-09-17T01:32:08.254883+0000","last_peered":"2024-09-17T01:32:08.254883+0000","last_clean":"2024-09-17T01:32:08.254883+0000","last_became_active":"2024-09-17T01:32:06.069002+0000","last_became_peered":"2024-09-17T01:32:06.069002+0000","last_unstale":"2024-09-17T01:32:08.254883+0000","last_undegraded":"2024-09-17T01:32:08.254883+0000","last_fullsized":"2024-09-17T01:32:08.254883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:57.291905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.083961+0000","last_change":"2024-09-17T01:32:07.095194+0000","last_active":"2024-09-17T01:32:08.083961+0000","last_peered":"2024-09-17T01:32:08.083961+0000","last_clean":"2024-09-17T01:32:08.083961+0000","last_became_active":"2024-09-17T01:32:07.090236+0000","last_became_peered":"2024-09-17T01:32:07.090236+0000","last_unstale":"2024-09-17T01:32:08.083961+0000","last_undegraded":"2024-09-17T01:32:08.083961+0000","last_fullsized":"2024-09-17T01:32:08.083961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:25.383324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254579+0000","last_change":"2024-09-17T01:32:06.073180+0000","last_active":"2024-09-17T01:32:08.254579+0000","last_peered":"2024-09-17T01:32:08.254579+0000","last_clean":"2024-09-17T01:32:08.254579+0000","last_became_active":"2024-09-17T01:32:06.072812+0000","last_became_peered":"2024-09-17T01:32:06.072812+0000","last_unstale":"2024-09-17T01:32:08.254579+0000","last_undegraded":"2024-09-17T01:32:08.254579+0000","last_fullsized":"2024-09-17T01:32:08.254579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:24.568357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254543+0000","last_change":"2024-09-17T01:32:07.068573+0000","last_active":"2024-09-17T01:32:08.254543+0000","last_peered":"2024-09-17T01:32:08.254543+0000","last_clean":"2024-09-17T01:32:08.254543+0000","last_became_active":"2024-09-17T01:32:07.068144+0000","last_became_peered":"2024-09-17T01:32:07.068144+0000","last_unstale":"2024-09-17T01:32:08.254543+0000","last_undegraded":"2024-09-17T01:32:08.254543+0000","last_fullsized":"2024-09-17T01:32:08.254543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:54.256529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255437+0000","last_change":"2024-09-17T01:32:06.067526+0000","last_active":"2024-09-17T01:32:08.255437+0000","last_peered":"2024-09-17T01:32:08.255437+0000","last_clean":"2024-09-17T01:32:08.255437+0000","last_became_active":"2024-09-17T01:32:06.062575+0000","last_became_peered":"2024-09-17T01:32:06.062575+0000","last_unstale":"2024-09-17T01:32:08.255437+0000","last_undegraded":"2024-09-17T01:32:08.255437+0000","last_fullsized":"2024-09-17T01:32:08.255437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:33.601567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079730+0000","last_change":"2024-09-17T01:32:07.092156+0000","last_active":"2024-09-17T01:32:08.079730+0000","last_peered":"2024-09-17T01:32:08.079730+0000","last_clean":"2024-09-17T01:32:08.079730+0000","last_became_active":"2024-09-17T01:32:07.091367+0000","last_became_peered":"2024-09-17T01:32:07.091367+0000","last_unstale":"2024-09-17T01:32:08.079730+0000","last_undegraded":"2024-09-17T01:32:08.079730+0000","last_fullsized":"2024-09-17T01:32:08.079730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:54.352211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.082733+0000","last_change":"2024-09-17T01:32:06.077965+0000","last_active":"2024-09-17T01:32:08.082733+0000","last_peered":"2024-09-17T01:32:08.082733+0000","last_clean":"2024-09-17T01:32:08.082733+0000","last_became_active":"2024-09-17T01:32:06.077187+0000","last_became_peered":"2024-09-17T01:32:06.077187+0000","last_unstale":"2024-09-17T01:32:08.082733+0000","last_undegraded":"2024-09-17T01:32:08.082733+0000","last_fullsized":"2024-09-17T01:32:08.082733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:19.750313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080529+0000","last_change":"2024-09-17T01:32:07.066284+0000","last_active":"2024-09-17T01:32:08.080529+0000","last_peered":"2024-09-17T01:32:08.080529+0000","last_clean":"2024-09-17T01:32:08.080529+0000","last_became_active":"2024-09-17T01:32:07.065959+0000","last_became_peered":"2024-09-17T01:32:07.065959+0000","last_unstale":"2024-09-17T01:32:08.080529+0000","last_undegraded":"2024-09-17T01:32:08.080529+0000","last_fullsized":"2024-09-17T01:32:08.080529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:48:15.533537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255574+0000","last_change":"2024-09-17T01:32:06.081435+0000","last_active":"2024-09-17T01:32:08.255574+0000","last_peered":"2024-09-17T01:32:08.255574+0000","last_clean":"2024-09-17T01:32:08.255574+0000","last_became_active":"2024-09-17T01:32:06.081122+0000","last_became_peered":"2024-09-17T01:32:06.081122+0000","last_unstale":"2024-09-17T01:32:08.255574+0000","last_undegraded":"2024-09-17T01:32:08.255574+0000","last_fullsized":"2024-09-17T01:32:08.255574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:22:25.054640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080231+0000","last_change":"2024-09-17T01:32:07.082941+0000","last_active":"2024-09-17T01:32:08.080231+0000","last_peered":"2024-09-17T01:32:08.080231+0000","last_clean":"2024-09-17T01:32:08.080231+0000","last_became_active":"2024-09-17T01:32:07.082576+0000","last_became_peered":"2024-09-17T01:32:07.082576+0000","last_unstale":"2024-09-17T01:32:08.080231+0000","last_undegraded":"2024-09-17T01:32:08.080231+0000","last_fullsized":"2024-09-17T01:32:08.080231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:52.970626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.083470+0000","last_change":"2024-09-17T01:32:06.078725+0000","last_active":"2024-09-17T01:32:08.083470+0000","last_peered":"2024-09-17T01:32:08.083470+0000","last_clean":"2024-09-17T01:32:08.083470+0000","last_became_active":"2024-09-17T01:32:06.074072+0000","last_became_peered":"2024-09-17T01:32:06.074072+0000","last_unstale":"2024-09-17T01:32:08.083470+0000","last_undegraded":"2024-09-17T01:32:08.083470+0000","last_fullsized":"2024-09-17T01:32:08.083470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:41.844576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254467+0000","last_change":"2024-09-17T01:32:07.092928+0000","last_active":"2024-09-17T01:32:08.254467+0000","last_peered":"2024-09-17T01:32:08.254467+0000","last_clean":"2024-09-17T01:32:08.254467+0000","last_became_active":"2024-09-17T01:32:07.079859+0000","last_became_peered":"2024-09-17T01:32:07.079859+0000","last_unstale":"2024-09-17T01:32:08.254467+0000","last_undegraded":"2024-09-17T01:32:08.254467+0000","last_fullsized":"2024-09-17T01:32:08.254467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:14.465400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.081017+0000","last_change":"2024-09-17T01:32:06.076537+0000","last_active":"2024-09-17T01:32:08.081017+0000","last_peered":"2024-09-17T01:32:08.081017+0000","last_clean":"2024-09-17T01:32:08.081017+0000","last_became_active":"2024-09-17T01:32:06.076002+0000","last_became_peered":"2024-09-17T01:32:06.076002+0000","last_unstale":"2024-09-17T01:32:08.081017+0000","last_undegraded":"2024-09-17T01:32:08.081017+0000","last_fullsized":"2024-09-17T01:32:08.081017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:22.117996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080195+0000","last_change":"2024-09-17T01:32:07.069777+0000","last_active":"2024-09-17T01:32:08.080195+0000","last_peered":"2024-09-17T01:32:08.080195+0000","last_clean":"2024-09-17T01:32:08.080195+0000","last_became_active":"2024-09-17T01:32:07.069387+0000","last_became_peered":"2024-09-17T01:32:07.069387+0000","last_unstale":"2024-09-17T01:32:08.080195+0000","last_undegraded":"2024-09-17T01:32:08.080195+0000","last_fullsized":"2024-09-17T01:32:08.080195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:54.341372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.081349+0000","last_change":"2024-09-17T01:32:06.067797+0000","last_active":"2024-09-17T01:32:08.081349+0000","last_peered":"2024-09-17T01:32:08.081349+0000","last_clean":"2024-09-17T01:32:08.081349+0000","last_became_active":"2024-09-17T01:32:06.067441+0000","last_became_peered":"2024-09-17T01:32:06.067441+0000","last_unstale":"2024-09-17T01:32:08.081349+0000","last_undegraded":"2024-09-17T01:32:08.081349+0000","last_fullsized":"2024-09-17T01:32:08.081349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:25.112393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255127+0000","last_change":"2024-09-17T01:32:07.099514+0000","last_active":"2024-09-17T01:32:08.255127+0000","last_peered":"2024-09-17T01:32:08.255127+0000","last_clean":"2024-09-17T01:32:08.255127+0000","last_became_active":"2024-09-17T01:32:07.099001+0000","last_became_peered":"2024-09-17T01:32:07.099001+0000","last_unstale":"2024-09-17T01:32:08.255127+0000","last_undegraded":"2024-09-17T01:32:08.255127+0000","last_fullsized":"2024-09-17T01:32:08.255127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:22:13.835193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255013+0000","last_change":"2024-09-17T01:32:06.066117+0000","last_active":"2024-09-17T01:32:08.255013+0000","last_peered":"2024-09-17T01:32:08.255013+0000","last_clean":"2024-09-17T01:32:08.255013+0000","last_became_active":"2024-09-17T01:32:06.065785+0000","last_became_peered":"2024-09-17T01:32:06.065785+0000","last_unstale":"2024-09-17T01:32:08.255013+0000","last_undegraded":"2024-09-17T01:32:08.255013+0000","last_fullsized":"2024-09-17T01:32:08.255013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:30.380597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254888+0000","last_change":"2024-09-17T01:32:07.090458+0000","last_active":"2024-09-17T01:32:08.254888+0000","last_peered":"2024-09-17T01:32:08.254888+0000","last_clean":"2024-09-17T01:32:08.254888+0000","last_became_active":"2024-09-17T01:32:07.078369+0000","last_became_peered":"2024-09-17T01:32:07.078369+0000","last_unstale":"2024-09-17T01:32:08.254888+0000","last_undegraded":"2024-09-17T01:32:08.254888+0000","last_fullsized":"2024-09-17T01:32:08.254888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:00.888206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255221+0000","last_change":"2024-09-17T01:32:07.092688+0000","last_active":"2024-09-17T01:32:08.255221+0000","last_peered":"2024-09-17T01:32:08.255221+0000","last_clean":"2024-09-17T01:32:08.255221+0000","last_became_active":"2024-09-17T01:32:07.085320+0000","last_became_peered":"2024-09-17T01:32:07.085320+0000","last_unstale":"2024-09-17T01:32:08.255221+0000","last_undegraded":"2024-09-17T01:32:08.255221+0000","last_fullsized":"2024-09-17T01:32:08.255221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:14.220903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084367+0000","last_change":"2024-09-17T01:32:06.070361+0000","last_active":"2024-09-17T01:32:08.084367+0000","last_peered":"2024-09-17T01:32:08.084367+0000","last_clean":"2024-09-17T01:32:08.084367+0000","last_became_active":"2024-09-17T01:32:06.069832+0000","last_became_peered":"2024-09-17T01:32:06.069832+0000","last_unstale":"2024-09-17T01:32:08.084367+0000","last_undegraded":"2024-09-17T01:32:08.084367+0000","last_fullsized":"2024-09-17T01:32:08.084367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:30.380597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.077817+0000","last_change":"2024-09-17T01:32:07.084781+0000","last_active":"2024-09-17T01:32:08.077817+0000","last_peered":"2024-09-17T01:32:08.077817+0000","last_clean":"2024-09-17T01:32:08.077817+0000","last_became_active":"2024-09-17T01:32:07.084442+0000","last_became_peered":"2024-09-17T01:32:07.084442+0000","last_unstale":"2024-09-17T01:32:08.077817+0000","last_undegraded":"2024-09-17T01:32:08.077817+0000","last_fullsized":"2024-09-17T01:32:08.077817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:01:03.298687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084291+0000","last_change":"2024-09-17T01:32:06.075745+0000","last_active":"2024-09-17T01:32:08.084291+0000","last_peered":"2024-09-17T01:32:08.084291+0000","last_clean":"2024-09-17T01:32:08.084291+0000","last_became_active":"2024-09-17T01:32:06.074453+0000","last_became_peered":"2024-09-17T01:32:06.074453+0000","last_unstale":"2024-09-17T01:32:08.084291+0000","last_undegraded":"2024-09-17T01:32:08.084291+0000","last_fullsized":"2024-09-17T01:32:08.084291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:04.657692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255266+0000","last_change":"2024-09-17T01:32:07.091674+0000","last_active":"2024-09-17T01:32:08.255266+0000","last_peered":"2024-09-17T01:32:08.255266+0000","last_clean":"2024-09-17T01:32:08.255266+0000","last_became_active":"2024-09-17T01:32:07.091348+0000","last_became_peered":"2024-09-17T01:32:07.091348+0000","last_unstale":"2024-09-17T01:32:08.255266+0000","last_undegraded":"2024-09-17T01:32:08.255266+0000","last_fullsized":"2024-09-17T01:32:08.255266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:31.725598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255418+0000","last_change":"2024-09-17T01:32:06.074404+0000","last_active":"2024-09-17T01:32:08.255418+0000","last_peered":"2024-09-17T01:32:08.255418+0000","last_clean":"2024-09-17T01:32:08.255418+0000","last_became_active":"2024-09-17T01:32:06.074047+0000","last_became_peered":"2024-09-17T01:32:06.074047+0000","last_unstale":"2024-09-17T01:32:08.255418+0000","last_undegraded":"2024-09-17T01:32:08.255418+0000","last_fullsized":"2024-09-17T01:32:08.255418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:26.446474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255142+0000","last_change":"2024-09-17T01:32:07.084694+0000","last_active":"2024-09-17T01:32:08.255142+0000","last_peered":"2024-09-17T01:32:08.255142+0000","last_clean":"2024-09-17T01:32:08.255142+0000","last_became_active":"2024-09-17T01:32:07.084387+0000","last_became_peered":"2024-09-17T01:32:07.084387+0000","last_unstale":"2024-09-17T01:32:08.255142+0000","last_undegraded":"2024-09-17T01:32:08.255142+0000","last_fullsized":"2024-09-17T01:32:08.255142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:01.007924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080774+0000","last_change":"2024-09-17T01:32:06.063395+0000","last_active":"2024-09-17T01:32:08.080774+0000","last_peered":"2024-09-17T01:32:08.080774+0000","last_clean":"2024-09-17T01:32:08.080774+0000","last_became_active":"2024-09-17T01:32:06.062964+0000","last_became_peered":"2024-09-17T01:32:06.062964+0000","last_unstale":"2024-09-17T01:32:08.080774+0000","last_undegraded":"2024-09-17T01:32:08.080774+0000","last_fullsized":"2024-09-17T01:32:08.080774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:26.591137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476742,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":233472,"data_stored":78414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":76926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":76802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":241664,"data_stored":79086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":225280,"data_stored":77384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":819200,"data_stored":667240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":76858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":811008,"data_stored":660962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:32:11.542 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:32:11.769 INFO:tasks.ceph.mds.b.smithi043.stderr:2024-09-17T01:32:11.772+0000 7f239de00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:32:11.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.807+0000 7f8bea200640 1 -- 172.21.15.42:0/1398776712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bcc004800 msgr2=0x7f8bcc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:11.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.807+0000 7f8bea200640 1 --2- 172.21.15.42:0/1398776712 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bcc004800 0x7f8bcc004c10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0009b50 tx=0x7f8bcc005830 comp rx=0 tx=0).stop 2024-09-17T01:32:11.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.807+0000 7f8be9800640 1 -- 172.21.15.42:0/1398776712 reap_dead start 2024-09-17T01:32:11.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.807+0000 7f8bea200640 1 -- 172.21.15.42:0/1398776712 shutdown_connections 2024-09-17T01:32:11.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.807+0000 7f8bea200640 1 -- 172.21.15.42:0/1398776712 >> 172.21.15.42:0/1398776712 conn(0x7f8be40b25f0 msgr2=0x7f8be40d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:11.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.807+0000 7f8bea200640 1 -- 172.21.15.42:0/1398776712 shutdown_connections 2024-09-17T01:32:11.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.807+0000 7f8bea200640 1 -- 172.21.15.42:0/1398776712 wait complete. 2024-09-17T01:32:11.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.809+0000 7f8bea200640 1 Processor -- start 2024-09-17T01:32:11.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.809+0000 7f8bea200640 1 -- start start 2024-09-17T01:32:11.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.811+0000 7f8bea200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bcc004800 0x7f8be4074bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:11.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.811+0000 7f8bea200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be40721e0 0x7f8be41437e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:11.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.811+0000 7f8bea200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8be4143d20 0x7f8be414de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:11.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.811+0000 7f8bea200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8be4070470 con 0x7f8be40721e0 2024-09-17T01:32:11.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.811+0000 7f8bea200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8be40702f0 con 0x7f8bcc004800 2024-09-17T01:32:11.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.811+0000 7f8bea200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8be40b34b0 con 0x7f8be4143d20 2024-09-17T01:32:11.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.811+0000 7f8be3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be40721e0 0x7f8be41437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:11.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.811+0000 7f8be3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be40721e0 0x7f8be41437e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50328/0 (socket says 172.21.15.42:50328) 2024-09-17T01:32:11.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.811+0000 7f8be3e00640 1 -- 172.21.15.42:0/1274780616 learned_addr learned my addr 172.21.15.42:0/1274780616 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:11.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.811+0000 7f8be8e00640 1 --2- 172.21.15.42:0/1274780616 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bcc004800 0x7f8be4074bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:11.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.811+0000 7f8be9800640 1 --2- 172.21.15.42:0/1274780616 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8be4143d20 0x7f8be414de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:11.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.812+0000 7f8be3e00640 1 -- 172.21.15.42:0/1274780616 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8be4143d20 msgr2=0x7f8be414de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:11.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.812+0000 7f8be3e00640 1 --2- 172.21.15.42:0/1274780616 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8be4143d20 0x7f8be414de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:11.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.812+0000 7f8be3e00640 1 -- 172.21.15.42:0/1274780616 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bcc004800 msgr2=0x7f8be4074bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:11.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.812+0000 7f8be3e00640 1 --2- 172.21.15.42:0/1274780616 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bcc004800 0x7f8be4074bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:11.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.812+0000 7f8be3e00640 1 -- 172.21.15.42:0/1274780616 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be4144130 con 0x7f8be40721e0 2024-09-17T01:32:11.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.812+0000 7f8be3e00640 1 --2- 172.21.15.42:0/1274780616 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be40721e0 0x7f8be41437e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0036040 tx=0x7f8bd0033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:11.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.812+0000 7f8be0c00640 1 -- 172.21.15.42:0/1274780616 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0038040 con 0x7f8be40721e0 2024-09-17T01:32:11.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.812+0000 7f8be0c00640 1 -- 172.21.15.42:0/1274780616 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bd0004110 con 0x7f8be40721e0 2024-09-17T01:32:11.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.812+0000 7f8be0c00640 1 -- 172.21.15.42:0/1274780616 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd00337e0 con 0x7f8be40721e0 2024-09-17T01:32:11.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.812+0000 7f8bea200640 1 -- 172.21.15.42:0/1274780616 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be414d0f0 con 0x7f8be40721e0 2024-09-17T01:32:11.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.812+0000 7f8bea200640 1 -- 172.21.15.42:0/1274780616 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be414d390 con 0x7f8be40721e0 2024-09-17T01:32:11.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.814+0000 7f8bea200640 1 -- 172.21.15.42:0/1274780616 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8be40cf640 con 0x7f8be40721e0 2024-09-17T01:32:11.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.815+0000 7f8be0c00640 1 -- 172.21.15.42:0/1274780616 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8bd0045020 con 0x7f8be40721e0 2024-09-17T01:32:11.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.816+0000 7f8be0c00640 1 --2- 172.21.15.42:0/1274780616 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8bc4078b90 0x7f8bc407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:11.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.816+0000 7f8be0c00640 1 -- 172.21.15.42:0/1274780616 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8bd00bb9f0 con 0x7f8be40721e0 2024-09-17T01:32:11.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.816+0000 7f8be8e00640 1 --2- 172.21.15.42:0/1274780616 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8bc4078b90 0x7f8bc407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:11.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.817+0000 7f8be8e00640 1 --2- 172.21.15.42:0/1274780616 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8bc4078b90 0x7f8bc407b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80016b0 tx=0x7f8bd8001170 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:11.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:11.821+0000 7f8be0c00640 1 -- 172.21.15.42:0/1274780616 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8be4144130 con 0x7f8be40721e0 2024-09-17T01:32:12.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.010+0000 7f8bea200640 1 -- 172.21.15.42:0/1274780616 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8be40b0330 con 0x7f8bc4078b90 2024-09-17T01:32:12.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.016+0000 7f8be0c00640 1 -- 172.21.15.42:0/1274780616 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251932 (secure 0 0 0) 0x7f8be40b0330 con 0x7f8bc4078b90 2024-09-17T01:32:12.016 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:12.018 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:32:12.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.020+0000 7f8bea200640 1 -- 172.21.15.42:0/1274780616 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8bc4078b90 msgr2=0x7f8bc407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:12.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.020+0000 7f8bea200640 1 --2- 172.21.15.42:0/1274780616 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8bc4078b90 0x7f8bc407b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80016b0 tx=0x7f8bd8001170 comp rx=0 tx=0).stop 2024-09-17T01:32:12.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.020+0000 7f8bea200640 1 -- 172.21.15.42:0/1274780616 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be40721e0 msgr2=0x7f8be41437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:12.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.020+0000 7f8bea200640 1 --2- 172.21.15.42:0/1274780616 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be40721e0 0x7f8be41437e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0036040 tx=0x7f8bd0033670 comp rx=0 tx=0).stop 2024-09-17T01:32:12.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.020+0000 7f8bea200640 1 -- 172.21.15.42:0/1274780616 shutdown_connections 2024-09-17T01:32:12.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.020+0000 7f8bea200640 1 --2- 172.21.15.42:0/1274780616 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8bc4078b90 0x7f8bc407b0a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:12.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.020+0000 7f8bea200640 1 --2- 172.21.15.42:0/1274780616 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8be4143d20 0x7f8be414de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:12.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.020+0000 7f8bea200640 1 --2- 172.21.15.42:0/1274780616 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be40721e0 0x7f8be41437e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:12.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.020+0000 7f8bea200640 1 --2- 172.21.15.42:0/1274780616 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bcc004800 0x7f8be4074bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:12.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.020+0000 7f8bea200640 1 -- 172.21.15.42:0/1274780616 >> 172.21.15.42:0/1274780616 conn(0x7f8be40b25f0 msgr2=0x7f8be415a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:12.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.020+0000 7f8bea200640 1 -- 172.21.15.42:0/1274780616 shutdown_connections 2024-09-17T01:32:12.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.020+0000 7f8bea200640 1 -- 172.21.15.42:0/1274780616 wait complete. 2024-09-17T01:32:12.039 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-17T01:32:10.975592+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252456,"kb_used_data":2940,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722264,"statfs":{"total":773094113280,"available":772835598336,"internally_reserved":0,"allocated":3010560,"data_stored":1793672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.938809"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084683+0000","last_change":"2024-09-17T01:32:07.103456+0000","last_active":"2024-09-17T01:32:08.084683+0000","last_peered":"2024-09-17T01:32:08.084683+0000","last_clean":"2024-09-17T01:32:08.084683+0000","last_became_active":"2024-09-17T01:32:07.103109+0000","last_became_peered":"2024-09-17T01:32:07.103109+0000","last_unstale":"2024-09-17T01:32:08.084683+0000","last_undegraded":"2024-09-17T01:32:08.084683+0000","last_fullsized":"2024-09-17T01:32:08.084683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:38.558917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255495+0000","last_change":"2024-09-17T01:32:07.099455+0000","last_active":"2024-09-17T01:32:08.255495+0000","last_peered":"2024-09-17T01:32:08.255495+0000","last_clean":"2024-09-17T01:32:08.255495+0000","last_became_active":"2024-09-17T01:32:07.099052+0000","last_became_peered":"2024-09-17T01:32:07.099052+0000","last_unstale":"2024-09-17T01:32:08.255495+0000","last_undegraded":"2024-09-17T01:32:08.255495+0000","last_fullsized":"2024-09-17T01:32:08.255495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:14.731320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254735+0000","last_change":"2024-09-17T01:32:07.085703+0000","last_active":"2024-09-17T01:32:08.254735+0000","last_peered":"2024-09-17T01:32:08.254735+0000","last_clean":"2024-09-17T01:32:08.254735+0000","last_became_active":"2024-09-17T01:32:07.085380+0000","last_became_peered":"2024-09-17T01:32:07.085380+0000","last_unstale":"2024-09-17T01:32:08.254735+0000","last_undegraded":"2024-09-17T01:32:08.254735+0000","last_fullsized":"2024-09-17T01:32:08.254735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:01.084404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254328+0000","last_change":"2024-09-17T01:32:07.073236+0000","last_active":"2024-09-17T01:32:08.254328+0000","last_peered":"2024-09-17T01:32:08.254328+0000","last_clean":"2024-09-17T01:32:08.254328+0000","last_became_active":"2024-09-17T01:32:07.072918+0000","last_became_peered":"2024-09-17T01:32:07.072918+0000","last_unstale":"2024-09-17T01:32:08.254328+0000","last_undegraded":"2024-09-17T01:32:08.254328+0000","last_fullsized":"2024-09-17T01:32:08.254328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:57.510381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084044+0000","last_change":"2024-09-17T01:32:07.082349+0000","last_active":"2024-09-17T01:32:08.084044+0000","last_peered":"2024-09-17T01:32:08.084044+0000","last_clean":"2024-09-17T01:32:08.084044+0000","last_became_active":"2024-09-17T01:32:07.081897+0000","last_became_peered":"2024-09-17T01:32:07.081897+0000","last_unstale":"2024-09-17T01:32:08.084044+0000","last_undegraded":"2024-09-17T01:32:08.084044+0000","last_fullsized":"2024-09-17T01:32:08.084044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:32.623242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254134+0000","last_change":"2024-09-17T01:32:07.074398+0000","last_active":"2024-09-17T01:32:08.254134+0000","last_peered":"2024-09-17T01:32:08.254134+0000","last_clean":"2024-09-17T01:32:08.254134+0000","last_became_active":"2024-09-17T01:32:07.074076+0000","last_became_peered":"2024-09-17T01:32:07.074076+0000","last_unstale":"2024-09-17T01:32:08.254134+0000","last_undegraded":"2024-09-17T01:32:08.254134+0000","last_fullsized":"2024-09-17T01:32:08.254134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:14.053004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.083789+0000","last_change":"2024-09-17T01:32:07.076442+0000","last_active":"2024-09-17T01:32:08.083789+0000","last_peered":"2024-09-17T01:32:08.083789+0000","last_clean":"2024-09-17T01:32:08.083789+0000","last_became_active":"2024-09-17T01:32:07.076156+0000","last_became_peered":"2024-09-17T01:32:07.076156+0000","last_unstale":"2024-09-17T01:32:08.083789+0000","last_undegraded":"2024-09-17T01:32:08.083789+0000","last_fullsized":"2024-09-17T01:32:08.083789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:13:53.149286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255624+0000","last_change":"2024-09-17T01:32:07.085589+0000","last_active":"2024-09-17T01:32:08.255624+0000","last_peered":"2024-09-17T01:32:08.255624+0000","last_clean":"2024-09-17T01:32:08.255624+0000","last_became_active":"2024-09-17T01:32:07.085259+0000","last_became_peered":"2024-09-17T01:32:07.085259+0000","last_unstale":"2024-09-17T01:32:08.255624+0000","last_undegraded":"2024-09-17T01:32:08.255624+0000","last_fullsized":"2024-09-17T01:32:08.255624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:41.271843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.078098+0000","last_change":"2024-09-17T01:32:07.092123+0000","last_active":"2024-09-17T01:32:08.078098+0000","last_peered":"2024-09-17T01:32:08.078098+0000","last_clean":"2024-09-17T01:32:08.078098+0000","last_became_active":"2024-09-17T01:32:07.091713+0000","last_became_peered":"2024-09-17T01:32:07.091713+0000","last_unstale":"2024-09-17T01:32:08.078098+0000","last_undegraded":"2024-09-17T01:32:08.078098+0000","last_fullsized":"2024-09-17T01:32:08.078098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:05.017902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084219+0000","last_change":"2024-09-17T01:32:07.085067+0000","last_active":"2024-09-17T01:32:08.084219+0000","last_peered":"2024-09-17T01:32:08.084219+0000","last_clean":"2024-09-17T01:32:08.084219+0000","last_became_active":"2024-09-17T01:32:07.084837+0000","last_became_peered":"2024-09-17T01:32:07.084837+0000","last_unstale":"2024-09-17T01:32:08.084219+0000","last_undegraded":"2024-09-17T01:32:08.084219+0000","last_fullsized":"2024-09-17T01:32:08.084219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:02.511769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084409+0000","last_change":"2024-09-17T01:32:07.099691+0000","last_active":"2024-09-17T01:32:08.084409+0000","last_peered":"2024-09-17T01:32:08.084409+0000","last_clean":"2024-09-17T01:32:08.084409+0000","last_became_active":"2024-09-17T01:32:07.094018+0000","last_became_peered":"2024-09-17T01:32:07.094018+0000","last_unstale":"2024-09-17T01:32:08.084409+0000","last_undegraded":"2024-09-17T01:32:08.084409+0000","last_fullsized":"2024-09-17T01:32:08.084409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:58.314338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084110+0000","last_change":"2024-09-17T01:32:07.073776+0000","last_active":"2024-09-17T01:32:08.084110+0000","last_peered":"2024-09-17T01:32:08.084110+0000","last_clean":"2024-09-17T01:32:08.084110+0000","last_became_active":"2024-09-17T01:32:07.073442+0000","last_became_peered":"2024-09-17T01:32:07.073442+0000","last_unstale":"2024-09-17T01:32:08.084110+0000","last_undegraded":"2024-09-17T01:32:08.084110+0000","last_fullsized":"2024-09-17T01:32:08.084110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:37.765577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.081135+0000","last_change":"2024-09-17T01:32:07.078885+0000","last_active":"2024-09-17T01:32:08.081135+0000","last_peered":"2024-09-17T01:32:08.081135+0000","last_clean":"2024-09-17T01:32:08.081135+0000","last_became_active":"2024-09-17T01:32:07.078435+0000","last_became_peered":"2024-09-17T01:32:07.078435+0000","last_unstale":"2024-09-17T01:32:08.081135+0000","last_undegraded":"2024-09-17T01:32:08.081135+0000","last_fullsized":"2024-09-17T01:32:08.081135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:22:26.061474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.081581+0000","last_change":"2024-09-17T01:32:07.088794+0000","last_active":"2024-09-17T01:32:08.081581+0000","last_peered":"2024-09-17T01:32:08.081581+0000","last_clean":"2024-09-17T01:32:08.081581+0000","last_became_active":"2024-09-17T01:32:07.088354+0000","last_became_peered":"2024-09-17T01:32:07.088354+0000","last_unstale":"2024-09-17T01:32:08.081581+0000","last_undegraded":"2024-09-17T01:32:08.081581+0000","last_fullsized":"2024-09-17T01:32:08.081581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:04.151746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255400+0000","last_change":"2024-09-17T01:32:07.080283+0000","last_active":"2024-09-17T01:32:08.255400+0000","last_peered":"2024-09-17T01:32:08.255400+0000","last_clean":"2024-09-17T01:32:08.255400+0000","last_became_active":"2024-09-17T01:32:07.079956+0000","last_became_peered":"2024-09-17T01:32:07.079956+0000","last_unstale":"2024-09-17T01:32:08.255400+0000","last_undegraded":"2024-09-17T01:32:08.255400+0000","last_fullsized":"2024-09-17T01:32:08.255400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:35:07.968881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.253904+0000","last_change":"2024-09-17T01:32:07.085014+0000","last_active":"2024-09-17T01:32:08.253904+0000","last_peered":"2024-09-17T01:32:08.253904+0000","last_clean":"2024-09-17T01:32:08.253904+0000","last_became_active":"2024-09-17T01:32:07.084701+0000","last_became_peered":"2024-09-17T01:32:07.084701+0000","last_unstale":"2024-09-17T01:32:08.253904+0000","last_undegraded":"2024-09-17T01:32:08.253904+0000","last_fullsized":"2024-09-17T01:32:08.253904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:45.382776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255636+0000","last_change":"2024-09-17T01:32:07.095513+0000","last_active":"2024-09-17T01:32:08.255636+0000","last_peered":"2024-09-17T01:32:08.255636+0000","last_clean":"2024-09-17T01:32:08.255636+0000","last_became_active":"2024-09-17T01:32:07.090989+0000","last_became_peered":"2024-09-17T01:32:07.090989+0000","last_unstale":"2024-09-17T01:32:08.255636+0000","last_undegraded":"2024-09-17T01:32:08.255636+0000","last_fullsized":"2024-09-17T01:32:08.255636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:46.947860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254682+0000","last_change":"2024-09-17T01:32:07.097564+0000","last_active":"2024-09-17T01:32:08.254682+0000","last_peered":"2024-09-17T01:32:08.254682+0000","last_clean":"2024-09-17T01:32:08.254682+0000","last_became_active":"2024-09-17T01:32:07.096842+0000","last_became_peered":"2024-09-17T01:32:07.096842+0000","last_unstale":"2024-09-17T01:32:08.254682+0000","last_undegraded":"2024-09-17T01:32:08.254682+0000","last_fullsized":"2024-09-17T01:32:08.254682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:20.757148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255495+0000","last_change":"2024-09-17T01:32:07.076493+0000","last_active":"2024-09-17T01:32:08.255495+0000","last_peered":"2024-09-17T01:32:08.255495+0000","last_clean":"2024-09-17T01:32:08.255495+0000","last_became_active":"2024-09-17T01:32:07.076153+0000","last_became_peered":"2024-09-17T01:32:07.076153+0000","last_unstale":"2024-09-17T01:32:08.255495+0000","last_undegraded":"2024-09-17T01:32:08.255495+0000","last_fullsized":"2024-09-17T01:32:08.255495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:25.265447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084142+0000","last_change":"2024-09-17T01:32:07.074913+0000","last_active":"2024-09-17T01:32:08.084142+0000","last_peered":"2024-09-17T01:32:08.084142+0000","last_clean":"2024-09-17T01:32:08.084142+0000","last_became_active":"2024-09-17T01:32:07.074573+0000","last_became_peered":"2024-09-17T01:32:07.074573+0000","last_unstale":"2024-09-17T01:32:08.084142+0000","last_undegraded":"2024-09-17T01:32:08.084142+0000","last_fullsized":"2024-09-17T01:32:08.084142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:46.307074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079705+0000","last_change":"2024-09-17T01:32:07.072132+0000","last_active":"2024-09-17T01:32:08.079705+0000","last_peered":"2024-09-17T01:32:08.079705+0000","last_clean":"2024-09-17T01:32:08.079705+0000","last_became_active":"2024-09-17T01:32:07.071687+0000","last_became_peered":"2024-09-17T01:32:07.071687+0000","last_unstale":"2024-09-17T01:32:08.079705+0000","last_undegraded":"2024-09-17T01:32:08.079705+0000","last_fullsized":"2024-09-17T01:32:08.079705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:05:00.465504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.077563+0000","last_change":"2024-09-17T01:32:07.083167+0000","last_active":"2024-09-17T01:32:08.077563+0000","last_peered":"2024-09-17T01:32:08.077563+0000","last_clean":"2024-09-17T01:32:08.077563+0000","last_became_active":"2024-09-17T01:32:07.082843+0000","last_became_peered":"2024-09-17T01:32:07.082843+0000","last_unstale":"2024-09-17T01:32:08.077563+0000","last_undegraded":"2024-09-17T01:32:08.077563+0000","last_fullsized":"2024-09-17T01:32:08.077563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:33.769443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255226+0000","last_change":"2024-09-17T01:32:07.075509+0000","last_active":"2024-09-17T01:32:08.255226+0000","last_peered":"2024-09-17T01:32:08.255226+0000","last_clean":"2024-09-17T01:32:08.255226+0000","last_became_active":"2024-09-17T01:32:07.075146+0000","last_became_peered":"2024-09-17T01:32:07.075146+0000","last_unstale":"2024-09-17T01:32:08.255226+0000","last_undegraded":"2024-09-17T01:32:08.255226+0000","last_fullsized":"2024-09-17T01:32:08.255226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:47.850069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.253907+0000","last_change":"2024-09-17T01:32:07.092134+0000","last_active":"2024-09-17T01:32:08.253907+0000","last_peered":"2024-09-17T01:32:08.253907+0000","last_clean":"2024-09-17T01:32:08.253907+0000","last_became_active":"2024-09-17T01:32:07.091782+0000","last_became_peered":"2024-09-17T01:32:07.091782+0000","last_unstale":"2024-09-17T01:32:08.253907+0000","last_undegraded":"2024-09-17T01:32:08.253907+0000","last_fullsized":"2024-09-17T01:32:08.253907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:50.828833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255041+0000","last_change":"2024-09-17T01:32:07.091641+0000","last_active":"2024-09-17T01:32:08.255041+0000","last_peered":"2024-09-17T01:32:08.255041+0000","last_clean":"2024-09-17T01:32:08.255041+0000","last_became_active":"2024-09-17T01:32:07.091316+0000","last_became_peered":"2024-09-17T01:32:07.091316+0000","last_unstale":"2024-09-17T01:32:08.255041+0000","last_undegraded":"2024-09-17T01:32:08.255041+0000","last_fullsized":"2024-09-17T01:32:08.255041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:30.669754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254763+0000","last_change":"2024-09-17T01:32:07.097633+0000","last_active":"2024-09-17T01:32:08.254763+0000","last_peered":"2024-09-17T01:32:08.254763+0000","last_clean":"2024-09-17T01:32:08.254763+0000","last_became_active":"2024-09-17T01:32:07.092029+0000","last_became_peered":"2024-09-17T01:32:07.092029+0000","last_unstale":"2024-09-17T01:32:08.254763+0000","last_undegraded":"2024-09-17T01:32:08.254763+0000","last_fullsized":"2024-09-17T01:32:08.254763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:56.387025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080174+0000","last_change":"2024-09-17T01:32:07.070606+0000","last_active":"2024-09-17T01:32:08.080174+0000","last_peered":"2024-09-17T01:32:08.080174+0000","last_clean":"2024-09-17T01:32:08.080174+0000","last_became_active":"2024-09-17T01:32:07.070312+0000","last_became_peered":"2024-09-17T01:32:07.070312+0000","last_unstale":"2024-09-17T01:32:08.080174+0000","last_undegraded":"2024-09-17T01:32:08.080174+0000","last_fullsized":"2024-09-17T01:32:08.080174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:58.298740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079492+0000","last_change":"2024-09-17T01:32:07.086253+0000","last_active":"2024-09-17T01:32:08.079492+0000","last_peered":"2024-09-17T01:32:08.079492+0000","last_clean":"2024-09-17T01:32:08.079492+0000","last_became_active":"2024-09-17T01:32:07.085897+0000","last_became_peered":"2024-09-17T01:32:07.085897+0000","last_unstale":"2024-09-17T01:32:08.079492+0000","last_undegraded":"2024-09-17T01:32:08.079492+0000","last_fullsized":"2024-09-17T01:32:08.079492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:54.160964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254923+0000","last_change":"2024-09-17T01:32:07.080316+0000","last_active":"2024-09-17T01:32:08.254923+0000","last_peered":"2024-09-17T01:32:08.254923+0000","last_clean":"2024-09-17T01:32:08.254923+0000","last_became_active":"2024-09-17T01:32:07.079896+0000","last_became_peered":"2024-09-17T01:32:07.079896+0000","last_unstale":"2024-09-17T01:32:08.254923+0000","last_undegraded":"2024-09-17T01:32:08.254923+0000","last_fullsized":"2024-09-17T01:32:08.254923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:19.850165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254673+0000","last_change":"2024-09-17T01:32:07.092975+0000","last_active":"2024-09-17T01:32:08.254673+0000","last_peered":"2024-09-17T01:32:08.254673+0000","last_clean":"2024-09-17T01:32:08.254673+0000","last_became_active":"2024-09-17T01:32:07.090003+0000","last_became_peered":"2024-09-17T01:32:07.090003+0000","last_unstale":"2024-09-17T01:32:08.254673+0000","last_undegraded":"2024-09-17T01:32:08.254673+0000","last_fullsized":"2024-09-17T01:32:08.254673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:12.771004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254825+0000","last_change":"2024-09-17T01:32:07.079839+0000","last_active":"2024-09-17T01:32:08.254825+0000","last_peered":"2024-09-17T01:32:08.254825+0000","last_clean":"2024-09-17T01:32:08.254825+0000","last_became_active":"2024-09-17T01:32:07.079012+0000","last_became_peered":"2024-09-17T01:32:07.079012+0000","last_unstale":"2024-09-17T01:32:08.254825+0000","last_undegraded":"2024-09-17T01:32:08.254825+0000","last_fullsized":"2024-09-17T01:32:08.254825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:23.124830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254237+0000","last_change":"2024-09-17T01:32:07.076970+0000","last_active":"2024-09-17T01:32:08.254237+0000","last_peered":"2024-09-17T01:32:08.254237+0000","last_clean":"2024-09-17T01:32:08.254237+0000","last_became_active":"2024-09-17T01:32:07.072256+0000","last_became_peered":"2024-09-17T01:32:07.072256+0000","last_unstale":"2024-09-17T01:32:08.254237+0000","last_undegraded":"2024-09-17T01:32:08.254237+0000","last_fullsized":"2024-09-17T01:32:08.254237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:17.000817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.077708+0000","last_change":"2024-09-17T01:32:07.086593+0000","last_active":"2024-09-17T01:32:08.077708+0000","last_peered":"2024-09-17T01:32:08.077708+0000","last_clean":"2024-09-17T01:32:08.077708+0000","last_became_active":"2024-09-17T01:32:07.086265+0000","last_became_peered":"2024-09-17T01:32:07.086265+0000","last_unstale":"2024-09-17T01:32:08.077708+0000","last_undegraded":"2024-09-17T01:32:08.077708+0000","last_fullsized":"2024-09-17T01:32:08.077708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:59.076106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255106+0000","last_change":"2024-09-17T01:32:06.072600+0000","last_active":"2024-09-17T01:32:08.255106+0000","last_peered":"2024-09-17T01:32:08.255106+0000","last_clean":"2024-09-17T01:32:08.255106+0000","last_became_active":"2024-09-17T01:32:06.072280+0000","last_became_peered":"2024-09-17T01:32:06.072280+0000","last_unstale":"2024-09-17T01:32:08.255106+0000","last_undegraded":"2024-09-17T01:32:08.255106+0000","last_fullsized":"2024-09-17T01:32:08.255106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:24.693140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079998+0000","last_change":"2024-09-17T01:32:07.082615+0000","last_active":"2024-09-17T01:32:08.079998+0000","last_peered":"2024-09-17T01:32:08.079998+0000","last_clean":"2024-09-17T01:32:08.079998+0000","last_became_active":"2024-09-17T01:32:07.082266+0000","last_became_peered":"2024-09-17T01:32:07.082266+0000","last_unstale":"2024-09-17T01:32:08.079998+0000","last_undegraded":"2024-09-17T01:32:08.079998+0000","last_fullsized":"2024-09-17T01:32:08.079998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:34.677913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254763+0000","last_change":"2024-09-17T01:32:06.081486+0000","last_active":"2024-09-17T01:32:08.254763+0000","last_peered":"2024-09-17T01:32:08.254763+0000","last_clean":"2024-09-17T01:32:08.254763+0000","last_became_active":"2024-09-17T01:32:06.081193+0000","last_became_peered":"2024-09-17T01:32:06.081193+0000","last_unstale":"2024-09-17T01:32:08.254763+0000","last_undegraded":"2024-09-17T01:32:08.254763+0000","last_fullsized":"2024-09-17T01:32:08.254763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:53.154130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079445+0000","last_change":"2024-09-17T01:32:06.069305+0000","last_active":"2024-09-17T01:32:08.079445+0000","last_peered":"2024-09-17T01:32:08.079445+0000","last_clean":"2024-09-17T01:32:08.079445+0000","last_became_active":"2024-09-17T01:32:06.068652+0000","last_became_peered":"2024-09-17T01:32:06.068652+0000","last_unstale":"2024-09-17T01:32:08.079445+0000","last_undegraded":"2024-09-17T01:32:08.079445+0000","last_fullsized":"2024-09-17T01:32:08.079445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:48.494445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255548+0000","last_change":"2024-09-17T01:32:07.087945+0000","last_active":"2024-09-17T01:32:08.255548+0000","last_peered":"2024-09-17T01:32:08.255548+0000","last_clean":"2024-09-17T01:32:08.255548+0000","last_became_active":"2024-09-17T01:32:07.081997+0000","last_became_peered":"2024-09-17T01:32:07.081997+0000","last_unstale":"2024-09-17T01:32:08.255548+0000","last_undegraded":"2024-09-17T01:32:08.255548+0000","last_fullsized":"2024-09-17T01:32:08.255548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:25.453779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254032+0000","last_change":"2024-09-17T01:32:06.064957+0000","last_active":"2024-09-17T01:32:08.254032+0000","last_peered":"2024-09-17T01:32:08.254032+0000","last_clean":"2024-09-17T01:32:08.254032+0000","last_became_active":"2024-09-17T01:32:06.064565+0000","last_became_peered":"2024-09-17T01:32:06.064565+0000","last_unstale":"2024-09-17T01:32:08.254032+0000","last_undegraded":"2024-09-17T01:32:08.254032+0000","last_fullsized":"2024-09-17T01:32:08.254032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:41.844576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079397+0000","last_change":"2024-09-17T01:32:07.068057+0000","last_active":"2024-09-17T01:32:08.079397+0000","last_peered":"2024-09-17T01:32:08.079397+0000","last_clean":"2024-09-17T01:32:08.079397+0000","last_became_active":"2024-09-17T01:32:07.067735+0000","last_became_peered":"2024-09-17T01:32:07.067735+0000","last_unstale":"2024-09-17T01:32:08.079397+0000","last_undegraded":"2024-09-17T01:32:08.079397+0000","last_fullsized":"2024-09-17T01:32:08.079397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:42.854196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.078116+0000","last_change":"2024-09-17T01:32:06.061484+0000","last_active":"2024-09-17T01:32:08.078116+0000","last_peered":"2024-09-17T01:32:08.078116+0000","last_clean":"2024-09-17T01:32:08.078116+0000","last_became_active":"2024-09-17T01:32:06.061082+0000","last_became_peered":"2024-09-17T01:32:06.061082+0000","last_unstale":"2024-09-17T01:32:08.078116+0000","last_undegraded":"2024-09-17T01:32:08.078116+0000","last_fullsized":"2024-09-17T01:32:08.078116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:57.830631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254780+0000","last_change":"2024-09-17T01:32:07.098046+0000","last_active":"2024-09-17T01:32:08.254780+0000","last_peered":"2024-09-17T01:32:08.254780+0000","last_clean":"2024-09-17T01:32:08.254780+0000","last_became_active":"2024-09-17T01:32:07.094416+0000","last_became_peered":"2024-09-17T01:32:07.094416+0000","last_unstale":"2024-09-17T01:32:08.254780+0000","last_undegraded":"2024-09-17T01:32:08.254780+0000","last_fullsized":"2024-09-17T01:32:08.254780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:28.815131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084431+0000","last_change":"2024-09-17T01:32:06.072252+0000","last_active":"2024-09-17T01:32:08.084431+0000","last_peered":"2024-09-17T01:32:08.084431+0000","last_clean":"2024-09-17T01:32:08.084431+0000","last_became_active":"2024-09-17T01:32:06.071868+0000","last_became_peered":"2024-09-17T01:32:06.071868+0000","last_unstale":"2024-09-17T01:32:08.084431+0000","last_undegraded":"2024-09-17T01:32:08.084431+0000","last_fullsized":"2024-09-17T01:32:08.084431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:32.739722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255545+0000","last_change":"2024-09-17T01:32:07.101387+0000","last_active":"2024-09-17T01:32:08.255545+0000","last_peered":"2024-09-17T01:32:08.255545+0000","last_clean":"2024-09-17T01:32:08.255545+0000","last_became_active":"2024-09-17T01:32:07.101077+0000","last_became_peered":"2024-09-17T01:32:07.101077+0000","last_unstale":"2024-09-17T01:32:08.255545+0000","last_undegraded":"2024-09-17T01:32:08.255545+0000","last_fullsized":"2024-09-17T01:32:08.255545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:36:23.728414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254880+0000","last_change":"2024-09-17T01:32:06.061334+0000","last_active":"2024-09-17T01:32:08.254880+0000","last_peered":"2024-09-17T01:32:08.254880+0000","last_clean":"2024-09-17T01:32:08.254880+0000","last_became_active":"2024-09-17T01:32:06.061062+0000","last_became_peered":"2024-09-17T01:32:06.061062+0000","last_unstale":"2024-09-17T01:32:08.254880+0000","last_undegraded":"2024-09-17T01:32:08.254880+0000","last_fullsized":"2024-09-17T01:32:08.254880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:26.325842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255304+0000","last_change":"2024-09-17T01:32:07.089550+0000","last_active":"2024-09-17T01:32:08.255304+0000","last_peered":"2024-09-17T01:32:08.255304+0000","last_clean":"2024-09-17T01:32:08.255304+0000","last_became_active":"2024-09-17T01:32:07.089255+0000","last_became_peered":"2024-09-17T01:32:07.089255+0000","last_unstale":"2024-09-17T01:32:08.255304+0000","last_undegraded":"2024-09-17T01:32:08.255304+0000","last_fullsized":"2024-09-17T01:32:08.255304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:40.540113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254393+0000","last_change":"2024-09-17T01:32:06.062145+0000","last_active":"2024-09-17T01:32:08.254393+0000","last_peered":"2024-09-17T01:32:08.254393+0000","last_clean":"2024-09-17T01:32:08.254393+0000","last_became_active":"2024-09-17T01:32:06.061691+0000","last_became_peered":"2024-09-17T01:32:06.061691+0000","last_unstale":"2024-09-17T01:32:08.254393+0000","last_undegraded":"2024-09-17T01:32:08.254393+0000","last_fullsized":"2024-09-17T01:32:08.254393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:52.657492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084154+0000","last_change":"2024-09-17T01:32:07.078612+0000","last_active":"2024-09-17T01:32:08.084154+0000","last_peered":"2024-09-17T01:32:08.084154+0000","last_clean":"2024-09-17T01:32:08.084154+0000","last_became_active":"2024-09-17T01:32:07.078227+0000","last_became_peered":"2024-09-17T01:32:07.078227+0000","last_unstale":"2024-09-17T01:32:08.084154+0000","last_undegraded":"2024-09-17T01:32:08.084154+0000","last_fullsized":"2024-09-17T01:32:08.084154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:54.702390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254498+0000","last_change":"2024-09-17T01:32:06.083372+0000","last_active":"2024-09-17T01:32:08.254498+0000","last_peered":"2024-09-17T01:32:08.254498+0000","last_clean":"2024-09-17T01:32:08.254498+0000","last_became_active":"2024-09-17T01:32:06.082955+0000","last_became_peered":"2024-09-17T01:32:06.082955+0000","last_unstale":"2024-09-17T01:32:08.254498+0000","last_undegraded":"2024-09-17T01:32:08.254498+0000","last_fullsized":"2024-09-17T01:32:08.254498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:48.494445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.081245+0000","last_change":"2024-09-17T01:32:07.090664+0000","last_active":"2024-09-17T01:32:08.081245+0000","last_peered":"2024-09-17T01:32:08.081245+0000","last_clean":"2024-09-17T01:32:08.081245+0000","last_became_active":"2024-09-17T01:32:07.090142+0000","last_became_peered":"2024-09-17T01:32:07.090142+0000","last_unstale":"2024-09-17T01:32:08.081245+0000","last_undegraded":"2024-09-17T01:32:08.081245+0000","last_fullsized":"2024-09-17T01:32:08.081245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:37.231363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254829+0000","last_change":"2024-09-17T01:32:06.059219+0000","last_active":"2024-09-17T01:32:08.254829+0000","last_peered":"2024-09-17T01:32:08.254829+0000","last_clean":"2024-09-17T01:32:08.254829+0000","last_became_active":"2024-09-17T01:32:06.058230+0000","last_became_peered":"2024-09-17T01:32:06.058230+0000","last_unstale":"2024-09-17T01:32:08.254829+0000","last_undegraded":"2024-09-17T01:32:08.254829+0000","last_fullsized":"2024-09-17T01:32:08.254829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:53.345377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254873+0000","last_change":"2024-09-17T01:32:07.089933+0000","last_active":"2024-09-17T01:32:08.254873+0000","last_peered":"2024-09-17T01:32:08.254873+0000","last_clean":"2024-09-17T01:32:08.254873+0000","last_became_active":"2024-09-17T01:32:07.080900+0000","last_became_peered":"2024-09-17T01:32:07.080900+0000","last_unstale":"2024-09-17T01:32:08.254873+0000","last_undegraded":"2024-09-17T01:32:08.254873+0000","last_fullsized":"2024-09-17T01:32:08.254873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:07:38.397880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.083659+0000","last_change":"2024-09-17T01:32:06.079871+0000","last_active":"2024-09-17T01:32:08.083659+0000","last_peered":"2024-09-17T01:32:08.083659+0000","last_clean":"2024-09-17T01:32:08.083659+0000","last_became_active":"2024-09-17T01:32:06.079581+0000","last_became_peered":"2024-09-17T01:32:06.079581+0000","last_unstale":"2024-09-17T01:32:08.083659+0000","last_undegraded":"2024-09-17T01:32:08.083659+0000","last_fullsized":"2024-09-17T01:32:08.083659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:37.449372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.077508+0000","last_change":"2024-09-17T01:32:07.089282+0000","last_active":"2024-09-17T01:32:08.077508+0000","last_peered":"2024-09-17T01:32:08.077508+0000","last_clean":"2024-09-17T01:32:08.077508+0000","last_became_active":"2024-09-17T01:32:07.088928+0000","last_became_peered":"2024-09-17T01:32:07.088928+0000","last_unstale":"2024-09-17T01:32:08.077508+0000","last_undegraded":"2024-09-17T01:32:08.077508+0000","last_fullsized":"2024-09-17T01:32:08.077508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:58.786102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080466+0000","last_change":"2024-09-17T01:32:06.053867+0000","last_active":"2024-09-17T01:32:08.080466+0000","last_peered":"2024-09-17T01:32:08.080466+0000","last_clean":"2024-09-17T01:32:08.080466+0000","last_became_active":"2024-09-17T01:32:06.053466+0000","last_became_peered":"2024-09-17T01:32:06.053466+0000","last_unstale":"2024-09-17T01:32:08.080466+0000","last_undegraded":"2024-09-17T01:32:08.080466+0000","last_fullsized":"2024-09-17T01:32:08.080466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:33.901561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254246+0000","last_change":"2024-09-17T01:32:07.095265+0000","last_active":"2024-09-17T01:32:08.254246+0000","last_peered":"2024-09-17T01:32:08.254246+0000","last_clean":"2024-09-17T01:32:08.254246+0000","last_became_active":"2024-09-17T01:32:07.094979+0000","last_became_peered":"2024-09-17T01:32:07.094979+0000","last_unstale":"2024-09-17T01:32:08.254246+0000","last_undegraded":"2024-09-17T01:32:08.254246+0000","last_fullsized":"2024-09-17T01:32:08.254246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:38.558917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084880+0000","last_change":"2024-09-17T01:32:06.083417+0000","last_active":"2024-09-17T01:32:08.084880+0000","last_peered":"2024-09-17T01:32:08.084880+0000","last_clean":"2024-09-17T01:32:08.084880+0000","last_became_active":"2024-09-17T01:32:06.082378+0000","last_became_peered":"2024-09-17T01:32:06.082378+0000","last_unstale":"2024-09-17T01:32:08.084880+0000","last_undegraded":"2024-09-17T01:32:08.084880+0000","last_fullsized":"2024-09-17T01:32:08.084880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:37:12.138471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254924+0000","last_change":"2024-09-17T01:32:07.087871+0000","last_active":"2024-09-17T01:32:08.254924+0000","last_peered":"2024-09-17T01:32:08.254924+0000","last_clean":"2024-09-17T01:32:08.254924+0000","last_became_active":"2024-09-17T01:32:07.086811+0000","last_became_peered":"2024-09-17T01:32:07.086811+0000","last_unstale":"2024-09-17T01:32:08.254924+0000","last_undegraded":"2024-09-17T01:32:08.254924+0000","last_fullsized":"2024-09-17T01:32:08.254924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:47.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080419+0000","last_change":"2024-09-17T01:32:06.067533+0000","last_active":"2024-09-17T01:32:08.080419+0000","last_peered":"2024-09-17T01:32:08.080419+0000","last_clean":"2024-09-17T01:32:08.080419+0000","last_became_active":"2024-09-17T01:32:06.066265+0000","last_became_peered":"2024-09-17T01:32:06.066265+0000","last_unstale":"2024-09-17T01:32:08.080419+0000","last_undegraded":"2024-09-17T01:32:08.080419+0000","last_fullsized":"2024-09-17T01:32:08.080419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:05.206992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084686+0000","last_change":"2024-09-17T01:32:07.075279+0000","last_active":"2024-09-17T01:32:08.084686+0000","last_peered":"2024-09-17T01:32:08.084686+0000","last_clean":"2024-09-17T01:32:08.084686+0000","last_became_active":"2024-09-17T01:32:07.073899+0000","last_became_peered":"2024-09-17T01:32:07.073899+0000","last_unstale":"2024-09-17T01:32:08.084686+0000","last_undegraded":"2024-09-17T01:32:08.084686+0000","last_fullsized":"2024-09-17T01:32:08.084686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:19:18.340646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254712+0000","last_change":"2024-09-17T01:32:06.071046+0000","last_active":"2024-09-17T01:32:08.254712+0000","last_peered":"2024-09-17T01:32:08.254712+0000","last_clean":"2024-09-17T01:32:08.254712+0000","last_became_active":"2024-09-17T01:32:06.070668+0000","last_became_peered":"2024-09-17T01:32:06.070668+0000","last_unstale":"2024-09-17T01:32:08.254712+0000","last_undegraded":"2024-09-17T01:32:08.254712+0000","last_fullsized":"2024-09-17T01:32:08.254712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:51.537157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084349+0000","last_change":"2024-09-17T01:32:07.081930+0000","last_active":"2024-09-17T01:32:08.084349+0000","last_peered":"2024-09-17T01:32:08.084349+0000","last_clean":"2024-09-17T01:32:08.084349+0000","last_became_active":"2024-09-17T01:32:07.081525+0000","last_became_peered":"2024-09-17T01:32:07.081525+0000","last_unstale":"2024-09-17T01:32:08.084349+0000","last_undegraded":"2024-09-17T01:32:08.084349+0000","last_fullsized":"2024-09-17T01:32:08.084349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:45.382776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079908+0000","last_change":"2024-09-17T01:32:06.071392+0000","last_active":"2024-09-17T01:32:08.079908+0000","last_peered":"2024-09-17T01:32:08.079908+0000","last_clean":"2024-09-17T01:32:08.079908+0000","last_became_active":"2024-09-17T01:32:06.070869+0000","last_became_peered":"2024-09-17T01:32:06.070869+0000","last_unstale":"2024-09-17T01:32:08.079908+0000","last_undegraded":"2024-09-17T01:32:08.079908+0000","last_fullsized":"2024-09-17T01:32:08.079908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:26.325842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255344+0000","last_change":"2024-09-17T01:32:07.076689+0000","last_active":"2024-09-17T01:32:08.255344+0000","last_peered":"2024-09-17T01:32:08.255344+0000","last_clean":"2024-09-17T01:32:08.255344+0000","last_became_active":"2024-09-17T01:32:07.076399+0000","last_became_peered":"2024-09-17T01:32:07.076399+0000","last_unstale":"2024-09-17T01:32:08.255344+0000","last_undegraded":"2024-09-17T01:32:08.255344+0000","last_fullsized":"2024-09-17T01:32:08.255344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:20.255648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.077377+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:32:08.077377+0000","last_peered":"2024-09-17T01:32:08.077377+0000","last_clean":"2024-09-17T01:32:08.077377+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:32:08.077377+0000","last_undegraded":"2024-09-17T01:32:08.077377+0000","last_fullsized":"2024-09-17T01:32:08.077377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255076+0000","last_change":"2024-09-17T01:32:06.064934+0000","last_active":"2024-09-17T01:32:08.255076+0000","last_peered":"2024-09-17T01:32:08.255076+0000","last_clean":"2024-09-17T01:32:08.255076+0000","last_became_active":"2024-09-17T01:32:06.064552+0000","last_became_peered":"2024-09-17T01:32:06.064552+0000","last_unstale":"2024-09-17T01:32:08.255076+0000","last_undegraded":"2024-09-17T01:32:08.255076+0000","last_fullsized":"2024-09-17T01:32:08.255076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:46:21.965124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080286+0000","last_change":"2024-09-17T01:32:07.071839+0000","last_active":"2024-09-17T01:32:08.080286+0000","last_peered":"2024-09-17T01:32:08.080286+0000","last_clean":"2024-09-17T01:32:08.080286+0000","last_became_active":"2024-09-17T01:32:07.071512+0000","last_became_peered":"2024-09-17T01:32:07.071512+0000","last_unstale":"2024-09-17T01:32:08.080286+0000","last_undegraded":"2024-09-17T01:32:08.080286+0000","last_fullsized":"2024-09-17T01:32:08.080286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:10.661342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254134+0000","last_change":"2024-09-17T01:32:06.070832+0000","last_active":"2024-09-17T01:32:08.254134+0000","last_peered":"2024-09-17T01:32:08.254134+0000","last_clean":"2024-09-17T01:32:08.254134+0000","last_became_active":"2024-09-17T01:32:06.070149+0000","last_became_peered":"2024-09-17T01:32:06.070149+0000","last_unstale":"2024-09-17T01:32:08.254134+0000","last_undegraded":"2024-09-17T01:32:08.254134+0000","last_fullsized":"2024-09-17T01:32:08.254134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:32.739722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079316+0000","last_change":"2024-09-17T01:32:07.075984+0000","last_active":"2024-09-17T01:32:08.079316+0000","last_peered":"2024-09-17T01:32:08.079316+0000","last_clean":"2024-09-17T01:32:08.079316+0000","last_became_active":"2024-09-17T01:32:07.074619+0000","last_became_peered":"2024-09-17T01:32:07.074619+0000","last_unstale":"2024-09-17T01:32:08.079316+0000","last_undegraded":"2024-09-17T01:32:08.079316+0000","last_fullsized":"2024-09-17T01:32:08.079316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:34.608401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254201+0000","last_change":"2024-09-17T01:32:06.071910+0000","last_active":"2024-09-17T01:32:08.254201+0000","last_peered":"2024-09-17T01:32:08.254201+0000","last_clean":"2024-09-17T01:32:08.254201+0000","last_became_active":"2024-09-17T01:32:06.071001+0000","last_became_peered":"2024-09-17T01:32:06.071001+0000","last_unstale":"2024-09-17T01:32:08.254201+0000","last_undegraded":"2024-09-17T01:32:08.254201+0000","last_fullsized":"2024-09-17T01:32:08.254201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:02.474882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255127+0000","last_change":"2024-09-17T01:32:07.081167+0000","last_active":"2024-09-17T01:32:08.255127+0000","last_peered":"2024-09-17T01:32:08.255127+0000","last_clean":"2024-09-17T01:32:08.255127+0000","last_became_active":"2024-09-17T01:32:07.080055+0000","last_became_peered":"2024-09-17T01:32:07.080055+0000","last_unstale":"2024-09-17T01:32:08.255127+0000","last_undegraded":"2024-09-17T01:32:08.255127+0000","last_fullsized":"2024-09-17T01:32:08.255127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:39:36.609246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254883+0000","last_change":"2024-09-17T01:32:06.069316+0000","last_active":"2024-09-17T01:32:08.254883+0000","last_peered":"2024-09-17T01:32:08.254883+0000","last_clean":"2024-09-17T01:32:08.254883+0000","last_became_active":"2024-09-17T01:32:06.069002+0000","last_became_peered":"2024-09-17T01:32:06.069002+0000","last_unstale":"2024-09-17T01:32:08.254883+0000","last_undegraded":"2024-09-17T01:32:08.254883+0000","last_fullsized":"2024-09-17T01:32:08.254883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:57.291905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.083961+0000","last_change":"2024-09-17T01:32:07.095194+0000","last_active":"2024-09-17T01:32:08.083961+0000","last_peered":"2024-09-17T01:32:08.083961+0000","last_clean":"2024-09-17T01:32:08.083961+0000","last_became_active":"2024-09-17T01:32:07.090236+0000","last_became_peered":"2024-09-17T01:32:07.090236+0000","last_unstale":"2024-09-17T01:32:08.083961+0000","last_undegraded":"2024-09-17T01:32:08.083961+0000","last_fullsized":"2024-09-17T01:32:08.083961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:25.383324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254579+0000","last_change":"2024-09-17T01:32:06.073180+0000","last_active":"2024-09-17T01:32:08.254579+0000","last_peered":"2024-09-17T01:32:08.254579+0000","last_clean":"2024-09-17T01:32:08.254579+0000","last_became_active":"2024-09-17T01:32:06.072812+0000","last_became_peered":"2024-09-17T01:32:06.072812+0000","last_unstale":"2024-09-17T01:32:08.254579+0000","last_undegraded":"2024-09-17T01:32:08.254579+0000","last_fullsized":"2024-09-17T01:32:08.254579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:24.568357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254543+0000","last_change":"2024-09-17T01:32:07.068573+0000","last_active":"2024-09-17T01:32:08.254543+0000","last_peered":"2024-09-17T01:32:08.254543+0000","last_clean":"2024-09-17T01:32:08.254543+0000","last_became_active":"2024-09-17T01:32:07.068144+0000","last_became_peered":"2024-09-17T01:32:07.068144+0000","last_unstale":"2024-09-17T01:32:08.254543+0000","last_undegraded":"2024-09-17T01:32:08.254543+0000","last_fullsized":"2024-09-17T01:32:08.254543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:54.256529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255437+0000","last_change":"2024-09-17T01:32:06.067526+0000","last_active":"2024-09-17T01:32:08.255437+0000","last_peered":"2024-09-17T01:32:08.255437+0000","last_clean":"2024-09-17T01:32:08.255437+0000","last_became_active":"2024-09-17T01:32:06.062575+0000","last_became_peered":"2024-09-17T01:32:06.062575+0000","last_unstale":"2024-09-17T01:32:08.255437+0000","last_undegraded":"2024-09-17T01:32:08.255437+0000","last_fullsized":"2024-09-17T01:32:08.255437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:33.601567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079730+0000","last_change":"2024-09-17T01:32:07.092156+0000","last_active":"2024-09-17T01:32:08.079730+0000","last_peered":"2024-09-17T01:32:08.079730+0000","last_clean":"2024-09-17T01:32:08.079730+0000","last_became_active":"2024-09-17T01:32:07.091367+0000","last_became_peered":"2024-09-17T01:32:07.091367+0000","last_unstale":"2024-09-17T01:32:08.079730+0000","last_undegraded":"2024-09-17T01:32:08.079730+0000","last_fullsized":"2024-09-17T01:32:08.079730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:54.352211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.082733+0000","last_change":"2024-09-17T01:32:06.077965+0000","last_active":"2024-09-17T01:32:08.082733+0000","last_peered":"2024-09-17T01:32:08.082733+0000","last_clean":"2024-09-17T01:32:08.082733+0000","last_became_active":"2024-09-17T01:32:06.077187+0000","last_became_peered":"2024-09-17T01:32:06.077187+0000","last_unstale":"2024-09-17T01:32:08.082733+0000","last_undegraded":"2024-09-17T01:32:08.082733+0000","last_fullsized":"2024-09-17T01:32:08.082733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:19.750313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080529+0000","last_change":"2024-09-17T01:32:07.066284+0000","last_active":"2024-09-17T01:32:08.080529+0000","last_peered":"2024-09-17T01:32:08.080529+0000","last_clean":"2024-09-17T01:32:08.080529+0000","last_became_active":"2024-09-17T01:32:07.065959+0000","last_became_peered":"2024-09-17T01:32:07.065959+0000","last_unstale":"2024-09-17T01:32:08.080529+0000","last_undegraded":"2024-09-17T01:32:08.080529+0000","last_fullsized":"2024-09-17T01:32:08.080529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:48:15.533537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255574+0000","last_change":"2024-09-17T01:32:06.081435+0000","last_active":"2024-09-17T01:32:08.255574+0000","last_peered":"2024-09-17T01:32:08.255574+0000","last_clean":"2024-09-17T01:32:08.255574+0000","last_became_active":"2024-09-17T01:32:06.081122+0000","last_became_peered":"2024-09-17T01:32:06.081122+0000","last_unstale":"2024-09-17T01:32:08.255574+0000","last_undegraded":"2024-09-17T01:32:08.255574+0000","last_fullsized":"2024-09-17T01:32:08.255574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:22:25.054640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080231+0000","last_change":"2024-09-17T01:32:07.082941+0000","last_active":"2024-09-17T01:32:08.080231+0000","last_peered":"2024-09-17T01:32:08.080231+0000","last_clean":"2024-09-17T01:32:08.080231+0000","last_became_active":"2024-09-17T01:32:07.082576+0000","last_became_peered":"2024-09-17T01:32:07.082576+0000","last_unstale":"2024-09-17T01:32:08.080231+0000","last_undegraded":"2024-09-17T01:32:08.080231+0000","last_fullsized":"2024-09-17T01:32:08.080231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:52.970626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.083470+0000","last_change":"2024-09-17T01:32:06.078725+0000","last_active":"2024-09-17T01:32:08.083470+0000","last_peered":"2024-09-17T01:32:08.083470+0000","last_clean":"2024-09-17T01:32:08.083470+0000","last_became_active":"2024-09-17T01:32:06.074072+0000","last_became_peered":"2024-09-17T01:32:06.074072+0000","last_unstale":"2024-09-17T01:32:08.083470+0000","last_undegraded":"2024-09-17T01:32:08.083470+0000","last_fullsized":"2024-09-17T01:32:08.083470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:41.844576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254467+0000","last_change":"2024-09-17T01:32:07.092928+0000","last_active":"2024-09-17T01:32:08.254467+0000","last_peered":"2024-09-17T01:32:08.254467+0000","last_clean":"2024-09-17T01:32:08.254467+0000","last_became_active":"2024-09-17T01:32:07.079859+0000","last_became_peered":"2024-09-17T01:32:07.079859+0000","last_unstale":"2024-09-17T01:32:08.254467+0000","last_undegraded":"2024-09-17T01:32:08.254467+0000","last_fullsized":"2024-09-17T01:32:08.254467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:14.465400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.081017+0000","last_change":"2024-09-17T01:32:06.076537+0000","last_active":"2024-09-17T01:32:08.081017+0000","last_peered":"2024-09-17T01:32:08.081017+0000","last_clean":"2024-09-17T01:32:08.081017+0000","last_became_active":"2024-09-17T01:32:06.076002+0000","last_became_peered":"2024-09-17T01:32:06.076002+0000","last_unstale":"2024-09-17T01:32:08.081017+0000","last_undegraded":"2024-09-17T01:32:08.081017+0000","last_fullsized":"2024-09-17T01:32:08.081017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:22.117996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080195+0000","last_change":"2024-09-17T01:32:07.069777+0000","last_active":"2024-09-17T01:32:08.080195+0000","last_peered":"2024-09-17T01:32:08.080195+0000","last_clean":"2024-09-17T01:32:08.080195+0000","last_became_active":"2024-09-17T01:32:07.069387+0000","last_became_peered":"2024-09-17T01:32:07.069387+0000","last_unstale":"2024-09-17T01:32:08.080195+0000","last_undegraded":"2024-09-17T01:32:08.080195+0000","last_fullsized":"2024-09-17T01:32:08.080195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:54.341372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.081349+0000","last_change":"2024-09-17T01:32:06.067797+0000","last_active":"2024-09-17T01:32:08.081349+0000","last_peered":"2024-09-17T01:32:08.081349+0000","last_clean":"2024-09-17T01:32:08.081349+0000","last_became_active":"2024-09-17T01:32:06.067441+0000","last_became_peered":"2024-09-17T01:32:06.067441+0000","last_unstale":"2024-09-17T01:32:08.081349+0000","last_undegraded":"2024-09-17T01:32:08.081349+0000","last_fullsized":"2024-09-17T01:32:08.081349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:25.112393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255127+0000","last_change":"2024-09-17T01:32:07.099514+0000","last_active":"2024-09-17T01:32:08.255127+0000","last_peered":"2024-09-17T01:32:08.255127+0000","last_clean":"2024-09-17T01:32:08.255127+0000","last_became_active":"2024-09-17T01:32:07.099001+0000","last_became_peered":"2024-09-17T01:32:07.099001+0000","last_unstale":"2024-09-17T01:32:08.255127+0000","last_undegraded":"2024-09-17T01:32:08.255127+0000","last_fullsized":"2024-09-17T01:32:08.255127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:22:13.835193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255013+0000","last_change":"2024-09-17T01:32:06.066117+0000","last_active":"2024-09-17T01:32:08.255013+0000","last_peered":"2024-09-17T01:32:08.255013+0000","last_clean":"2024-09-17T01:32:08.255013+0000","last_became_active":"2024-09-17T01:32:06.065785+0000","last_became_peered":"2024-09-17T01:32:06.065785+0000","last_unstale":"2024-09-17T01:32:08.255013+0000","last_undegraded":"2024-09-17T01:32:08.255013+0000","last_fullsized":"2024-09-17T01:32:08.255013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:30.380597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254888+0000","last_change":"2024-09-17T01:32:07.090458+0000","last_active":"2024-09-17T01:32:08.254888+0000","last_peered":"2024-09-17T01:32:08.254888+0000","last_clean":"2024-09-17T01:32:08.254888+0000","last_became_active":"2024-09-17T01:32:07.078369+0000","last_became_peered":"2024-09-17T01:32:07.078369+0000","last_unstale":"2024-09-17T01:32:08.254888+0000","last_undegraded":"2024-09-17T01:32:08.254888+0000","last_fullsized":"2024-09-17T01:32:08.254888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:00.888206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255221+0000","last_change":"2024-09-17T01:32:07.092688+0000","last_active":"2024-09-17T01:32:08.255221+0000","last_peered":"2024-09-17T01:32:08.255221+0000","last_clean":"2024-09-17T01:32:08.255221+0000","last_became_active":"2024-09-17T01:32:07.085320+0000","last_became_peered":"2024-09-17T01:32:07.085320+0000","last_unstale":"2024-09-17T01:32:08.255221+0000","last_undegraded":"2024-09-17T01:32:08.255221+0000","last_fullsized":"2024-09-17T01:32:08.255221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:14.220903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084367+0000","last_change":"2024-09-17T01:32:06.070361+0000","last_active":"2024-09-17T01:32:08.084367+0000","last_peered":"2024-09-17T01:32:08.084367+0000","last_clean":"2024-09-17T01:32:08.084367+0000","last_became_active":"2024-09-17T01:32:06.069832+0000","last_became_peered":"2024-09-17T01:32:06.069832+0000","last_unstale":"2024-09-17T01:32:08.084367+0000","last_undegraded":"2024-09-17T01:32:08.084367+0000","last_fullsized":"2024-09-17T01:32:08.084367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:30.380597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.077817+0000","last_change":"2024-09-17T01:32:07.084781+0000","last_active":"2024-09-17T01:32:08.077817+0000","last_peered":"2024-09-17T01:32:08.077817+0000","last_clean":"2024-09-17T01:32:08.077817+0000","last_became_active":"2024-09-17T01:32:07.084442+0000","last_became_peered":"2024-09-17T01:32:07.084442+0000","last_unstale":"2024-09-17T01:32:08.077817+0000","last_undegraded":"2024-09-17T01:32:08.077817+0000","last_fullsized":"2024-09-17T01:32:08.077817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:01:03.298687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084291+0000","last_change":"2024-09-17T01:32:06.075745+0000","last_active":"2024-09-17T01:32:08.084291+0000","last_peered":"2024-09-17T01:32:08.084291+0000","last_clean":"2024-09-17T01:32:08.084291+0000","last_became_active":"2024-09-17T01:32:06.074453+0000","last_became_peered":"2024-09-17T01:32:06.074453+0000","last_unstale":"2024-09-17T01:32:08.084291+0000","last_undegraded":"2024-09-17T01:32:08.084291+0000","last_fullsized":"2024-09-17T01:32:08.084291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:04.657692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255266+0000","last_change":"2024-09-17T01:32:07.091674+0000","last_active":"2024-09-17T01:32:08.255266+0000","last_peered":"2024-09-17T01:32:08.255266+0000","last_clean":"2024-09-17T01:32:08.255266+0000","last_became_active":"2024-09-17T01:32:07.091348+0000","last_became_peered":"2024-09-17T01:32:07.091348+0000","last_unstale":"2024-09-17T01:32:08.255266+0000","last_undegraded":"2024-09-17T01:32:08.255266+0000","last_fullsized":"2024-09-17T01:32:08.255266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:31.725598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255418+0000","last_change":"2024-09-17T01:32:06.074404+0000","last_active":"2024-09-17T01:32:08.255418+0000","last_peered":"2024-09-17T01:32:08.255418+0000","last_clean":"2024-09-17T01:32:08.255418+0000","last_became_active":"2024-09-17T01:32:06.074047+0000","last_became_peered":"2024-09-17T01:32:06.074047+0000","last_unstale":"2024-09-17T01:32:08.255418+0000","last_undegraded":"2024-09-17T01:32:08.255418+0000","last_fullsized":"2024-09-17T01:32:08.255418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:26.446474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255142+0000","last_change":"2024-09-17T01:32:07.084694+0000","last_active":"2024-09-17T01:32:08.255142+0000","last_peered":"2024-09-17T01:32:08.255142+0000","last_clean":"2024-09-17T01:32:08.255142+0000","last_became_active":"2024-09-17T01:32:07.084387+0000","last_became_peered":"2024-09-17T01:32:07.084387+0000","last_unstale":"2024-09-17T01:32:08.255142+0000","last_undegraded":"2024-09-17T01:32:08.255142+0000","last_fullsized":"2024-09-17T01:32:08.255142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:01.007924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080774+0000","last_change":"2024-09-17T01:32:06.063395+0000","last_active":"2024-09-17T01:32:08.080774+0000","last_peered":"2024-09-17T01:32:08.080774+0000","last_clean":"2024-09-17T01:32:08.080774+0000","last_became_active":"2024-09-17T01:32:06.062964+0000","last_became_peered":"2024-09-17T01:32:06.062964+0000","last_unstale":"2024-09-17T01:32:08.080774+0000","last_undegraded":"2024-09-17T01:32:08.080774+0000","last_fullsized":"2024-09-17T01:32:08.080774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:26.591137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476742,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":233472,"data_stored":78414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":76926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":76802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":241664,"data_stored":79086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":225280,"data_stored":77384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":819200,"data_stored":667240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":76858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":811008,"data_stored":660962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:32:12.043 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T01:32:12.044 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-17T01:32:12.044 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-17T01:32:12.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.310+0000 7f1ff4e00640 1 -- 172.21.15.42:0/2365716895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff00cf7c0 msgr2=0x7f1ff006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:12.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.310+0000 7f1ff4e00640 1 --2- 172.21.15.42:0/2365716895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff00cf7c0 0x7f1ff006cd20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8005fd0 tx=0x7f1fd802a5d0 comp rx=0 tx=0).stop 2024-09-17T01:32:12.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.310+0000 7f1ff4e00640 1 -- 172.21.15.42:0/2365716895 shutdown_connections 2024-09-17T01:32:12.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.310+0000 7f1ff4e00640 1 --2- 172.21.15.42:0/2365716895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff00cf7c0 0x7f1ff006cd20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:12.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.310+0000 7f1ff4e00640 1 --2- 172.21.15.42:0/2365716895 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ff00b4be0 0x7f1ff015d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:12.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.310+0000 7f1ff4e00640 1 -- 172.21.15.42:0/2365716895 >> 172.21.15.42:0/2365716895 conn(0x7f1ff00b25f0 msgr2=0x7f1ff00d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:12.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.310+0000 7f1ff4e00640 1 -- 172.21.15.42:0/2365716895 shutdown_connections 2024-09-17T01:32:12.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.310+0000 7f1ff4e00640 1 -- 172.21.15.42:0/2365716895 wait complete. 2024-09-17T01:32:12.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.313+0000 7f1ff4e00640 1 Processor -- start 2024-09-17T01:32:12.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.313+0000 7f1ff4e00640 1 -- start start 2024-09-17T01:32:12.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.314+0000 7f1ff4e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ff006d260 0x7f1ff014c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:12.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.314+0000 7f1ff4e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff00b4be0 0x7f1ff01543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:12.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.314+0000 7f1ff4e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ff00cf7c0 0x7f1ff00ae670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:12.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.314+0000 7f1ff4e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff0153970 con 0x7f1ff006d260 2024-09-17T01:32:12.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.314+0000 7f1ff4e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff01537f0 con 0x7f1ff00b4be0 2024-09-17T01:32:12.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.314+0000 7f1ff4e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1ff0153af0 con 0x7f1ff00cf7c0 2024-09-17T01:32:12.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.314+0000 7f1fef400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ff006d260 0x7f1ff014c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:12.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.314+0000 7f1fef400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ff006d260 0x7f1ff014c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50334/0 (socket says 172.21.15.42:50334) 2024-09-17T01:32:12.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.314+0000 7f1fef400640 1 -- 172.21.15.42:0/290074922 learned_addr learned my addr 172.21.15.42:0/290074922 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:12.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.315+0000 7f1fefe00640 1 --2- 172.21.15.42:0/290074922 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ff00cf7c0 0x7f1ff00ae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:12.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.315+0000 7f1fe7e00640 1 --2- 172.21.15.42:0/290074922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff00b4be0 0x7f1ff01543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:12.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.315+0000 7f1fef400640 1 -- 172.21.15.42:0/290074922 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ff00cf7c0 msgr2=0x7f1ff00ae670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:12.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.315+0000 7f1fef400640 1 --2- 172.21.15.42:0/290074922 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ff00cf7c0 0x7f1ff00ae670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:12.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.315+0000 7f1fef400640 1 -- 172.21.15.42:0/290074922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff00b4be0 msgr2=0x7f1ff01543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:12.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.315+0000 7f1fef400640 1 --2- 172.21.15.42:0/290074922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff00b4be0 0x7f1ff01543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:12.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.315+0000 7f1fef400640 1 -- 172.21.15.42:0/290074922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff00735e0 con 0x7f1ff006d260 2024-09-17T01:32:12.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.315+0000 7f1fefe00640 1 --2- 172.21.15.42:0/290074922 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ff00cf7c0 0x7f1ff00ae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:32:12.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.315+0000 7f1fef400640 1 --2- 172.21.15.42:0/290074922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ff006d260 0x7f1ff014c730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000e7c0 tx=0x7f1fe000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:12.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.315+0000 7f1fe7400640 1 -- 172.21.15.42:0/290074922 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe000ccc0 con 0x7f1ff006d260 2024-09-17T01:32:12.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.315+0000 7f1fe7400640 1 -- 172.21.15.42:0/290074922 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fe0010430 con 0x7f1ff006d260 2024-09-17T01:32:12.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.315+0000 7f1fe7400640 1 -- 172.21.15.42:0/290074922 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0010860 con 0x7f1ff006d260 2024-09-17T01:32:12.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.315+0000 7f1ff4e00640 1 -- 172.21.15.42:0/290074922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ff0073920 con 0x7f1ff006d260 2024-09-17T01:32:12.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.316+0000 7f1ff4e00640 1 -- 172.21.15.42:0/290074922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ff0072d40 con 0x7f1ff006d260 2024-09-17T01:32:12.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.317+0000 7f1ff4e00640 1 -- 172.21.15.42:0/290074922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ff015d6b0 con 0x7f1ff006d260 2024-09-17T01:32:12.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.318+0000 7f1fe7400640 1 -- 172.21.15.42:0/290074922 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1fe0010a00 con 0x7f1ff006d260 2024-09-17T01:32:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.319+0000 7f1fe7400640 1 --2- 172.21.15.42:0/290074922 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1fcc078bc0 0x7f1fcc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.319+0000 7f1fe7400640 1 -- 172.21.15.42:0/290074922 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1fe009b7b0 con 0x7f1ff006d260 2024-09-17T01:32:12.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.319+0000 7f1fe7e00640 1 --2- 172.21.15.42:0/290074922 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1fcc078bc0 0x7f1fcc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:12.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.320+0000 7f1fe7e00640 1 --2- 172.21.15.42:0/290074922 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1fcc078bc0 0x7f1fcc07b0d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8033000 tx=0x7f1fd8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:12.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.323+0000 7f1fe7400640 1 -- 172.21.15.42:0/290074922 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1fe0063be0 con 0x7f1ff006d260 2024-09-17T01:32:12.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.522+0000 7f1ff4e00640 1 -- 172.21.15.42:0/290074922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f1ff0074f80 con 0x7f1ff006d260 2024-09-17T01:32:12.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.522+0000 7f1fe7400640 1 -- 172.21.15.42:0/290074922 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v31) ==== 86+0+160 (secure 0 0 0) 0x7f1fe00634e0 con 0x7f1ff006d260 2024-09-17T01:32:12.520 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:12.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.525+0000 7f1ff4e00640 1 -- 172.21.15.42:0/290074922 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1fcc078bc0 msgr2=0x7f1fcc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:12.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.525+0000 7f1ff4e00640 1 --2- 172.21.15.42:0/290074922 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1fcc078bc0 0x7f1fcc07b0d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8033000 tx=0x7f1fd8004730 comp rx=0 tx=0).stop 2024-09-17T01:32:12.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.525+0000 7f1ff4e00640 1 -- 172.21.15.42:0/290074922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ff006d260 msgr2=0x7f1ff014c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:12.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.525+0000 7f1ff4e00640 1 --2- 172.21.15.42:0/290074922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ff006d260 0x7f1ff014c730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000e7c0 tx=0x7f1fe000ec80 comp rx=0 tx=0).stop 2024-09-17T01:32:12.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.525+0000 7f1ff4e00640 1 -- 172.21.15.42:0/290074922 shutdown_connections 2024-09-17T01:32:12.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.525+0000 7f1ff4e00640 1 --2- 172.21.15.42:0/290074922 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1fcc078bc0 0x7f1fcc07b0d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:12.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.525+0000 7f1ff4e00640 1 --2- 172.21.15.42:0/290074922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff00b4be0 0x7f1ff01543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:12.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.525+0000 7f1ff4e00640 1 --2- 172.21.15.42:0/290074922 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ff00cf7c0 0x7f1ff00ae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:12.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.525+0000 7f1ff4e00640 1 --2- 172.21.15.42:0/290074922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ff006d260 0x7f1ff014c730 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:12.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.525+0000 7f1ff4e00640 1 -- 172.21.15.42:0/290074922 >> 172.21.15.42:0/290074922 conn(0x7f1ff00b25f0 msgr2=0x7f1ff00afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:12.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.525+0000 7f1ff4e00640 1 -- 172.21.15.42:0/290074922 shutdown_connections 2024-09-17T01:32:12.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.525+0000 7f1ff4e00640 1 -- 172.21.15.42:0/290074922 wait complete. 2024-09-17T01:32:12.545 INFO:teuthology.orchestra.run.smithi042.stdout:[{"version":31,"timestamp":"2024-09-17T01:31:54.065590+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"4316.776055"}]}] 2024-09-17T01:32:12.546 INFO:tasks.ceph_manager:config epoch is 31 2024-09-17T01:32:12.546 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T01:32:12.546 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-17T01:32:12.546 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-17T01:32:12.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.776+0000 7ff041800640 1 -- 172.21.15.42:0/3246522310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff03c0b6030 msgr2=0x7ff03c0b6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:12.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.776+0000 7ff041800640 1 --2- 172.21.15.42:0/3246522310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff03c0b6030 0x7ff03c0b6440 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff034005fd0 tx=0x7ff03402a970 comp rx=0 tx=0).stop 2024-09-17T01:32:12.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.777+0000 7ff041800640 1 -- 172.21.15.42:0/3246522310 shutdown_connections 2024-09-17T01:32:12.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.777+0000 7ff041800640 1 --2- 172.21.15.42:0/3246522310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff03c0b6030 0x7ff03c0b6440 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:12.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.777+0000 7ff041800640 1 --2- 172.21.15.42:0/3246522310 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff03c073340 0x7ff03c0d2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:12.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.777+0000 7ff041800640 1 -- 172.21.15.42:0/3246522310 >> 172.21.15.42:0/3246522310 conn(0x7ff03c0d1210 msgr2=0x7ff03c0d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:12.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.777+0000 7ff041800640 1 -- 172.21.15.42:0/3246522310 shutdown_connections 2024-09-17T01:32:12.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.777+0000 7ff041800640 1 -- 172.21.15.42:0/3246522310 wait complete. 2024-09-17T01:32:12.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.779+0000 7ff041800640 1 Processor -- start 2024-09-17T01:32:12.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.779+0000 7ff041800640 1 -- start start 2024-09-17T01:32:12.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.780+0000 7ff041800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff03c073340 0x7ff03c1f89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:12.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.780+0000 7ff041800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff03c0b6030 0x7ff03c147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:12.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.780+0000 7ff041800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff03c162fa0 0x7ff03c144970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:12.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.780+0000 7ff041800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff03c15f850 con 0x7ff03c162fa0 2024-09-17T01:32:12.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.780+0000 7ff041800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff03c15f6d0 con 0x7ff03c073340 2024-09-17T01:32:12.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.780+0000 7ff041800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff03c15f9d0 con 0x7ff03c0b6030 2024-09-17T01:32:12.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.781+0000 7ff040e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff03c162fa0 0x7ff03c144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:12.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.781+0000 7ff040e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff03c162fa0 0x7ff03c144970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50366/0 (socket says 172.21.15.42:50366) 2024-09-17T01:32:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.781+0000 7ff040e00640 1 -- 172.21.15.42:0/2230145144 learned_addr learned my addr 172.21.15.42:0/2230145144 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.781+0000 7ff03be00640 1 --2- 172.21.15.42:0/2230145144 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff03c073340 0x7ff03c1f89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.781+0000 7ff033e00640 1 --2- 172.21.15.42:0/2230145144 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff03c0b6030 0x7ff03c147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.781+0000 7ff040e00640 1 -- 172.21.15.42:0/2230145144 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff03c0b6030 msgr2=0x7ff03c147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.781+0000 7ff040e00640 1 --2- 172.21.15.42:0/2230145144 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff03c0b6030 0x7ff03c147410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.781+0000 7ff040e00640 1 -- 172.21.15.42:0/2230145144 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff03c073340 msgr2=0x7ff03c1f89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.781+0000 7ff040e00640 1 --2- 172.21.15.42:0/2230145144 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff03c073340 0x7ff03c1f89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.781+0000 7ff040e00640 1 -- 172.21.15.42:0/2230145144 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff03c147950 con 0x7ff03c162fa0 2024-09-17T01:32:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.781+0000 7ff03be00640 1 --2- 172.21.15.42:0/2230145144 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff03c073340 0x7ff03c1f89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.782+0000 7ff040e00640 1 --2- 172.21.15.42:0/2230145144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff03c162fa0 0x7ff03c144970 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff034006010 tx=0x7ff034003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.782+0000 7ff038c00640 1 -- 172.21.15.42:0/2230145144 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff034034040 con 0x7ff03c162fa0 2024-09-17T01:32:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.782+0000 7ff038c00640 1 -- 172.21.15.42:0/2230145144 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff034004640 con 0x7ff03c162fa0 2024-09-17T01:32:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.782+0000 7ff038c00640 1 -- 172.21.15.42:0/2230145144 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff034045480 con 0x7ff03c162fa0 2024-09-17T01:32:12.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.782+0000 7ff041800640 1 -- 172.21.15.42:0/2230145144 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff03c0c85a0 con 0x7ff03c162fa0 2024-09-17T01:32:12.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.782+0000 7ff041800640 1 -- 172.21.15.42:0/2230145144 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff03c0c8b60 con 0x7ff03c162fa0 2024-09-17T01:32:12.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.783+0000 7ff041800640 1 -- 172.21.15.42:0/2230145144 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff03c15ff40 con 0x7ff03c162fa0 2024-09-17T01:32:12.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.784+0000 7ff038c00640 1 -- 172.21.15.42:0/2230145144 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff034037020 con 0x7ff03c162fa0 2024-09-17T01:32:12.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.785+0000 7ff038c00640 1 --2- 172.21.15.42:0/2230145144 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff018078b90 0x7ff01807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:12.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.785+0000 7ff038c00640 1 -- 172.21.15.42:0/2230145144 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff0340bc5d0 con 0x7ff03c162fa0 2024-09-17T01:32:12.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.785+0000 7ff03be00640 1 --2- 172.21.15.42:0/2230145144 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff018078b90 0x7ff01807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:12.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.786+0000 7ff03be00640 1 --2- 172.21.15.42:0/2230145144 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff018078b90 0x7ff01807b0a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff02c00ab40 tx=0x7ff02c00a520 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:12.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:12.789+0000 7ff038c00640 1 -- 172.21.15.42:0/2230145144 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff03c147950 con 0x7ff03c162fa0 2024-09-17T01:32:13.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.034+0000 7ff041800640 1 -- 172.21.15.42:0/2230145144 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7ff03c0d0dc0 con 0x7ff03c162fa0 2024-09-17T01:32:13.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.037+0000 7ff038c00640 1 -- 172.21.15.42:0/2230145144 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+194715 (secure 0 0 0) 0x7ff03c0b6980 con 0x7ff03c162fa0 2024-09-17T01:32:13.037 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:13.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.041+0000 7ff041800640 1 -- 172.21.15.42:0/2230145144 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff018078b90 msgr2=0x7ff01807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:13.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.041+0000 7ff041800640 1 --2- 172.21.15.42:0/2230145144 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff018078b90 0x7ff01807b0a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff02c00ab40 tx=0x7ff02c00a520 comp rx=0 tx=0).stop 2024-09-17T01:32:13.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.041+0000 7ff041800640 1 -- 172.21.15.42:0/2230145144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff03c162fa0 msgr2=0x7ff03c144970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:13.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.041+0000 7ff041800640 1 --2- 172.21.15.42:0/2230145144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff03c162fa0 0x7ff03c144970 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff034006010 tx=0x7ff034003f10 comp rx=0 tx=0).stop 2024-09-17T01:32:13.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.041+0000 7ff041800640 1 -- 172.21.15.42:0/2230145144 shutdown_connections 2024-09-17T01:32:13.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.041+0000 7ff041800640 1 --2- 172.21.15.42:0/2230145144 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff018078b90 0x7ff01807b0a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:13.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.041+0000 7ff041800640 1 --2- 172.21.15.42:0/2230145144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff03c162fa0 0x7ff03c144970 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:13.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.041+0000 7ff041800640 1 --2- 172.21.15.42:0/2230145144 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff03c0b6030 0x7ff03c147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:13.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.041+0000 7ff041800640 1 --2- 172.21.15.42:0/2230145144 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff03c073340 0x7ff03c1f89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:13.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.041+0000 7ff041800640 1 -- 172.21.15.42:0/2230145144 >> 172.21.15.42:0/2230145144 conn(0x7ff03c0d1210 msgr2=0x7ff03c0d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:13.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.041+0000 7ff041800640 1 -- 172.21.15.42:0/2230145144 shutdown_connections 2024-09-17T01:32:13.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.041+0000 7ff041800640 1 -- 172.21.15.42:0/2230145144 wait complete. 2024-09-17T01:32:13.062 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":5,"flags":0,"active_gid":4160,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1082699944},{"type":"v1","addr":"172.21.15.43:6801","nonce":1082699944}]},"active_addr":"172.21.15.43:6801/1082699944","active_change":"2024-09-17T01:31:44.961331+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4118,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":2653529778}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":2935949326}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":3761856853}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":1415057144}]}]} 2024-09-17T01:32:13.070 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-17T01:32:13.071 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T01:32:13.071 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:32:13.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.301+0000 7f2045c00640 1 -- 172.21.15.42:0/1695414148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2040151e60 msgr2=0x7f2040152270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:13.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.301+0000 7f2045c00640 1 --2- 172.21.15.42:0/1695414148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2040151e60 0x7f2040152270 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2038005fd0 tx=0x7f203802a810 comp rx=0 tx=0).stop 2024-09-17T01:32:13.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.301+0000 7f2045c00640 1 -- 172.21.15.42:0/1695414148 shutdown_connections 2024-09-17T01:32:13.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.301+0000 7f2045c00640 1 --2- 172.21.15.42:0/1695414148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2040151e60 0x7f2040152270 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:13.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.301+0000 7f2045c00640 1 --2- 172.21.15.42:0/1695414148 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f20400746d0 0x7f2040074ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:13.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.301+0000 7f2045c00640 1 -- 172.21.15.42:0/1695414148 >> 172.21.15.42:0/1695414148 conn(0x7f2040073510 msgr2=0x7f20400b6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:13.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.301+0000 7f2045c00640 1 -- 172.21.15.42:0/1695414148 shutdown_connections 2024-09-17T01:32:13.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.301+0000 7f2045c00640 1 -- 172.21.15.42:0/1695414148 wait complete. 2024-09-17T01:32:13.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.303+0000 7f2045c00640 1 Processor -- start 2024-09-17T01:32:13.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.304+0000 7f2045c00640 1 -- start start 2024-09-17T01:32:13.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.305+0000 7f2045c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20400746d0 0x7f2040150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.305+0000 7f2045c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2040151e60 0x7f20401e3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.305+0000 7f2045c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f204015ca60 0x7f20401e4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.305+0000 7f2045c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2040152b40 con 0x7f20400746d0 2024-09-17T01:32:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.305+0000 7f2045c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f20401529c0 con 0x7f204015ca60 2024-09-17T01:32:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.305+0000 7f2045c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2040152cc0 con 0x7f2040151e60 2024-09-17T01:32:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.305+0000 7f203fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20400746d0 0x7f2040150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.305+0000 7f203fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20400746d0 0x7f2040150a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50382/0 (socket says 172.21.15.42:50382) 2024-09-17T01:32:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.305+0000 7f203fe00640 1 -- 172.21.15.42:0/2093975318 learned_addr learned my addr 172.21.15.42:0/2093975318 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.306+0000 7f2037e00640 1 --2- 172.21.15.42:0/2093975318 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2040151e60 0x7f20401e3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.306+0000 7f203fe00640 1 -- 172.21.15.42:0/2093975318 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2040151e60 msgr2=0x7f20401e3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:13.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.306+0000 7f2045200640 1 --2- 172.21.15.42:0/2093975318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f204015ca60 0x7f20401e4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:13.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.306+0000 7f203fe00640 1 --2- 172.21.15.42:0/2093975318 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2040151e60 0x7f20401e3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:13.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.306+0000 7f203fe00640 1 -- 172.21.15.42:0/2093975318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f204015ca60 msgr2=0x7f20401e4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:13.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.306+0000 7f203fe00640 1 --2- 172.21.15.42:0/2093975318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f204015ca60 0x7f20401e4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:13.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.306+0000 7f203fe00640 1 -- 172.21.15.42:0/2093975318 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f204009eee0 con 0x7f20400746d0 2024-09-17T01:32:13.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.306+0000 7f2037e00640 1 --2- 172.21.15.42:0/2093975318 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2040151e60 0x7f20401e3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:32:13.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.306+0000 7f2045200640 1 --2- 172.21.15.42:0/2093975318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f204015ca60 0x7f20401e4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:32:13.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.306+0000 7f203fe00640 1 --2- 172.21.15.42:0/2093975318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20400746d0 0x7f2040150a30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f203000c3c0 tx=0x7f203000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:13.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.306+0000 7f203cc00640 1 -- 172.21.15.42:0/2093975318 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2030017070 con 0x7f20400746d0 2024-09-17T01:32:13.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.306+0000 7f203cc00640 1 -- 172.21.15.42:0/2093975318 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20300035f0 con 0x7f20400746d0 2024-09-17T01:32:13.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.306+0000 7f2045c00640 1 -- 172.21.15.42:0/2093975318 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f204009f150 con 0x7f20400746d0 2024-09-17T01:32:13.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.306+0000 7f203cc00640 1 -- 172.21.15.42:0/2093975318 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2030003a40 con 0x7f20400746d0 2024-09-17T01:32:13.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.306+0000 7f2045c00640 1 -- 172.21.15.42:0/2093975318 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2040152ee0 con 0x7f20400746d0 2024-09-17T01:32:13.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.307+0000 7f2045c00640 1 -- 172.21.15.42:0/2093975318 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2040074ae0 con 0x7f20400746d0 2024-09-17T01:32:13.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.309+0000 7f203cc00640 1 -- 172.21.15.42:0/2093975318 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f203001a070 con 0x7f20400746d0 2024-09-17T01:32:13.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.309+0000 7f203cc00640 1 --2- 172.21.15.42:0/2093975318 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f201c078b90 0x7f201c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:13.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.310+0000 7f203cc00640 1 -- 172.21.15.42:0/2093975318 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f2030099fe0 con 0x7f20400746d0 2024-09-17T01:32:13.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.310+0000 7f2037e00640 1 --2- 172.21.15.42:0/2093975318 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f201c078b90 0x7f201c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:13.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.311+0000 7f2037e00640 1 --2- 172.21.15.42:0/2093975318 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f201c078b90 0x7f201c07b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f204006d1e0 tx=0x7f2028005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:13.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.314+0000 7f203cc00640 1 -- 172.21.15.42:0/2093975318 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2040075020 con 0x7f20400746d0 2024-09-17T01:32:13.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.509+0000 7f2045c00640 1 -- 172.21.15.42:0/2093975318 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20400b3c70 con 0x7f20400746d0 2024-09-17T01:32:13.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.510+0000 7f203cc00640 1 -- 172.21.15.42:0/2093975318 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16621 (secure 0 0 0) 0x7f2030062450 con 0x7f20400746d0 2024-09-17T01:32:13.508 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:13.508 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":22,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:32:08.067689+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:32:04.526150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T01:32:05.523607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:32:13.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.513+0000 7f2045c00640 1 -- 172.21.15.42:0/2093975318 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f201c078b90 msgr2=0x7f201c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:13.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.513+0000 7f2045c00640 1 --2- 172.21.15.42:0/2093975318 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f201c078b90 0x7f201c07b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f204006d1e0 tx=0x7f2028005f90 comp rx=0 tx=0).stop 2024-09-17T01:32:13.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.513+0000 7f2045c00640 1 -- 172.21.15.42:0/2093975318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20400746d0 msgr2=0x7f2040150a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:13.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.513+0000 7f2045c00640 1 --2- 172.21.15.42:0/2093975318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20400746d0 0x7f2040150a30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f203000c3c0 tx=0x7f203000c880 comp rx=0 tx=0).stop 2024-09-17T01:32:13.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.513+0000 7f2045c00640 1 -- 172.21.15.42:0/2093975318 shutdown_connections 2024-09-17T01:32:13.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.513+0000 7f2045c00640 1 --2- 172.21.15.42:0/2093975318 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f201c078b90 0x7f201c07b0a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:13.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.513+0000 7f2045c00640 1 --2- 172.21.15.42:0/2093975318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f204015ca60 0x7f20401e4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:13.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.513+0000 7f2045c00640 1 --2- 172.21.15.42:0/2093975318 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2040151e60 0x7f20401e3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:13.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.513+0000 7f2045c00640 1 --2- 172.21.15.42:0/2093975318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20400746d0 0x7f2040150a30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:13.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.513+0000 7f2045c00640 1 -- 172.21.15.42:0/2093975318 >> 172.21.15.42:0/2093975318 conn(0x7f2040073510 msgr2=0x7f204006f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:13.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.513+0000 7f2045c00640 1 -- 172.21.15.42:0/2093975318 shutdown_connections 2024-09-17T01:32:13.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.513+0000 7f2045c00640 1 -- 172.21.15.42:0/2093975318 wait complete. 2024-09-17T01:32:13.531 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T01:32:13.532 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:32:13.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.761+0000 7f4c28600640 1 -- 172.21.15.42:0/1931451491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c2006f2a0 msgr2=0x7f4c2006d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:13.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.761+0000 7f4c28600640 1 --2- 172.21.15.42:0/1931451491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c2006f2a0 0x7f4c2006d610 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009830 tx=0x7f4c0c02a530 comp rx=0 tx=0).stop 2024-09-17T01:32:13.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.761+0000 7f4c28600640 1 -- 172.21.15.42:0/1931451491 shutdown_connections 2024-09-17T01:32:13.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.761+0000 7f4c28600640 1 --2- 172.21.15.42:0/1931451491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c2006f2a0 0x7f4c2006d610 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:13.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.761+0000 7f4c28600640 1 -- 172.21.15.42:0/1931451491 >> 172.21.15.42:0/1931451491 conn(0x7f4c200b2930 msgr2=0x7f4c2006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:13.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.761+0000 7f4c28600640 1 -- 172.21.15.42:0/1931451491 shutdown_connections 2024-09-17T01:32:13.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.761+0000 7f4c28600640 1 -- 172.21.15.42:0/1931451491 wait complete. 2024-09-17T01:32:13.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.763+0000 7f4c28600640 1 Processor -- start 2024-09-17T01:32:13.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.763+0000 7f4c28600640 1 -- start start 2024-09-17T01:32:13.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.764+0000 7f4c28600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4c2006db50 0x7f4c201fa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:13.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.764+0000 7f4c28600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c2006ee90 0x7f4c201f5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:13.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.765+0000 7f4c28600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c2006f2a0 0x7f4c20143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:13.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.765+0000 7f4c28600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4c200cf0c0 con 0x7f4c2006f2a0 2024-09-17T01:32:13.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.765+0000 7f4c28600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4c200cef40 con 0x7f4c2006ee90 2024-09-17T01:32:13.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.765+0000 7f4c28600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4c200cf240 con 0x7f4c2006db50 2024-09-17T01:32:13.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.765+0000 7f4c26600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c2006f2a0 0x7f4c20143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:13.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.765+0000 7f4c26600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c2006f2a0 0x7f4c20143850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50406/0 (socket says 172.21.15.42:50406) 2024-09-17T01:32:13.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.765+0000 7f4c25200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c2006ee90 0x7f4c201f5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:13.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.765+0000 7f4c25c00640 1 --2- 172.21.15.42:0/1721594039 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4c2006db50 0x7f4c201fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:13.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.765+0000 7f4c26600640 1 -- 172.21.15.42:0/1721594039 learned_addr learned my addr 172.21.15.42:0/1721594039 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:13.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.765+0000 7f4c26600640 1 -- 172.21.15.42:0/1721594039 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4c2006db50 msgr2=0x7f4c201fa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:13.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.765+0000 7f4c26600640 1 --2- 172.21.15.42:0/1721594039 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4c2006db50 0x7f4c201fa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:13.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.765+0000 7f4c26600640 1 -- 172.21.15.42:0/1721594039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c2006ee90 msgr2=0x7f4c201f5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:13.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.765+0000 7f4c26600640 1 --2- 172.21.15.42:0/1721594039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c2006ee90 0x7f4c201f5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:13.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.765+0000 7f4c26600640 1 -- 172.21.15.42:0/1721594039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c201f6780 con 0x7f4c2006f2a0 2024-09-17T01:32:13.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.766+0000 7f4c26600640 1 --2- 172.21.15.42:0/1721594039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c2006f2a0 0x7f4c20143850 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4c18002230 tx=0x7f4c1800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:13.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.766+0000 7f4c1d600640 1 -- 172.21.15.42:0/1721594039 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c18003b70 con 0x7f4c2006f2a0 2024-09-17T01:32:13.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.766+0000 7f4c1d600640 1 -- 172.21.15.42:0/1721594039 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c18003d10 con 0x7f4c2006f2a0 2024-09-17T01:32:13.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.766+0000 7f4c1d600640 1 -- 172.21.15.42:0/1721594039 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c18005330 con 0x7f4c2006f2a0 2024-09-17T01:32:13.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.766+0000 7f4c28600640 1 -- 172.21.15.42:0/1721594039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c201f6a60 con 0x7f4c2006f2a0 2024-09-17T01:32:13.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.766+0000 7f4c28600640 1 -- 172.21.15.42:0/1721594039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c201f6440 con 0x7f4c2006f2a0 2024-09-17T01:32:13.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.767+0000 7f4c28600640 1 -- 172.21.15.42:0/1721594039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c200cf660 con 0x7f4c2006f2a0 2024-09-17T01:32:13.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.768+0000 7f4c1d600640 1 -- 172.21.15.42:0/1721594039 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4c180056e0 con 0x7f4c2006f2a0 2024-09-17T01:32:13.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.769+0000 7f4c1d600640 1 --2- 172.21.15.42:0/1721594039 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4c00078b90 0x7f4c0007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:13.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.769+0000 7f4c1d600640 1 -- 172.21.15.42:0/1721594039 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4c1809ac30 con 0x7f4c2006f2a0 2024-09-17T01:32:13.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.770+0000 7f4c25c00640 1 --2- 172.21.15.42:0/1721594039 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4c00078b90 0x7f4c0007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:13.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.770+0000 7f4c25c00640 1 --2- 172.21.15.42:0/1721594039 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4c00078b90 0x7f4c0007b0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4c14000f60 tx=0x7f4c14009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:13.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.773+0000 7f4c1d600640 1 -- 172.21.15.42:0/1721594039 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4c18062a10 con 0x7f4c2006f2a0 2024-09-17T01:32:13.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.967+0000 7f4c28600640 1 -- 172.21.15.42:0/1721594039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c2006a170 con 0x7f4c2006f2a0 2024-09-17T01:32:13.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.968+0000 7f4c1d600640 1 -- 172.21.15.42:0/1721594039 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16621 (secure 0 0 0) 0x7f4c1807ce20 con 0x7f4c2006f2a0 2024-09-17T01:32:13.966 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:13.966 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":22,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:32:08.067689+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:32:04.526150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T01:32:05.523607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:32:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.971+0000 7f4c28600640 1 -- 172.21.15.42:0/1721594039 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4c00078b90 msgr2=0x7f4c0007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.971+0000 7f4c28600640 1 --2- 172.21.15.42:0/1721594039 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4c00078b90 0x7f4c0007b0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4c14000f60 tx=0x7f4c14009040 comp rx=0 tx=0).stop 2024-09-17T01:32:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.971+0000 7f4c28600640 1 -- 172.21.15.42:0/1721594039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c2006f2a0 msgr2=0x7f4c20143850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.971+0000 7f4c28600640 1 --2- 172.21.15.42:0/1721594039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c2006f2a0 0x7f4c20143850 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4c18002230 tx=0x7f4c1800cb90 comp rx=0 tx=0).stop 2024-09-17T01:32:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.971+0000 7f4c28600640 1 -- 172.21.15.42:0/1721594039 shutdown_connections 2024-09-17T01:32:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.971+0000 7f4c28600640 1 --2- 172.21.15.42:0/1721594039 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4c00078b90 0x7f4c0007b0a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.971+0000 7f4c28600640 1 --2- 172.21.15.42:0/1721594039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c2006ee90 0x7f4c201f5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.971+0000 7f4c28600640 1 --2- 172.21.15.42:0/1721594039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c2006f2a0 0x7f4c20143850 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.971+0000 7f4c28600640 1 --2- 172.21.15.42:0/1721594039 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4c2006db50 0x7f4c201fa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.971+0000 7f4c28600640 1 -- 172.21.15.42:0/1721594039 >> 172.21.15.42:0/1721594039 conn(0x7f4c200b2930 msgr2=0x7f4c200ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.971+0000 7f4c28600640 1 -- 172.21.15.42:0/1721594039 shutdown_connections 2024-09-17T01:32:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:13.971+0000 7f4c28600640 1 -- 172.21.15.42:0/1721594039 wait complete. 2024-09-17T01:32:13.991 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T01:32:13.992 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T01:32:13.992 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T01:32:13.993 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-17T01:32:13.993 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-17T01:32:13.993 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-17T01:32:13.994 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-17T01:32:13.994 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-17T01:32:14.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.407+0000 7f039cc00640 1 -- 172.21.15.42:0/928309997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0390036b40 msgr2=0x7f03900066b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.407+0000 7f039cc00640 1 --2- 172.21.15.42:0/928309997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0390036b40 0x7f03900066b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0384007350 tx=0x7f038402b060 comp rx=0 tx=0).stop 2024-09-17T01:32:14.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.407+0000 7fabc2200640 1 -- 172.21.15.42:0/547971166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fabb4036b10 msgr2=0x7fabb40df180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.407+0000 7fabc2200640 1 --2- 172.21.15.42:0/547971166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fabb4036b10 0x7fabb40df180 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fabb400dad0 tx=0x7fabb002a480 comp rx=0 tx=0).stop 2024-09-17T01:32:14.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.407+0000 7f039cc00640 1 -- 172.21.15.42:0/928309997 shutdown_connections 2024-09-17T01:32:14.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.407+0000 7f039cc00640 1 --2- 172.21.15.42:0/928309997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0390036b40 0x7f03900066b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.407+0000 7f039cc00640 1 --2- 172.21.15.42:0/928309997 >> v2:172.21.15.42:3300/0 conn(0x7f0390009ba0 0x7f03900df180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.407+0000 7f039cc00640 1 -- 172.21.15.42:0/928309997 >> 172.21.15.42:0/928309997 conn(0x7f0390051420 msgr2=0x7f0390051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:14.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.407+0000 7f039cc00640 1 -- 172.21.15.42:0/928309997 shutdown_connections 2024-09-17T01:32:14.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.407+0000 7f039cc00640 1 -- 172.21.15.42:0/928309997 wait complete. 2024-09-17T01:32:14.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.408+0000 7fabc2200640 1 -- 172.21.15.42:0/547971166 shutdown_connections 2024-09-17T01:32:14.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.408+0000 7fabc2200640 1 --2- 172.21.15.42:0/547971166 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fabb4009ba0 0x7fabb4005cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.408+0000 7fabc2200640 1 --2- 172.21.15.42:0/547971166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fabb4036b10 0x7fabb40df180 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.408+0000 7fabc2200640 1 -- 172.21.15.42:0/547971166 >> 172.21.15.42:0/547971166 conn(0x7fabb4051420 msgr2=0x7fabb4051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:14.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.409+0000 7fabc2200640 1 -- 172.21.15.42:0/547971166 shutdown_connections 2024-09-17T01:32:14.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.409+0000 7fabc2200640 1 -- 172.21.15.42:0/547971166 wait complete. 2024-09-17T01:32:14.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.409+0000 7fc606e00640 1 -- 172.21.15.42:0/3807160941 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6000b4be0 msgr2=0x7fc60015d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.409+0000 7fc606e00640 1 --2- 172.21.15.42:0/3807160941 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6000b4be0 0x7fc60015d6b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc6000b4870 tx=0x7fc5f802aa50 comp rx=0 tx=0).stop 2024-09-17T01:32:14.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.409+0000 7fc606e00640 1 -- 172.21.15.42:0/3807160941 shutdown_connections 2024-09-17T01:32:14.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.409+0000 7fc606e00640 1 --2- 172.21.15.42:0/3807160941 >> v2:172.21.15.43:3300/0 conn(0x7fc6000cf7c0 0x7fc60006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.409+0000 7fc606e00640 1 --2- 172.21.15.42:0/3807160941 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc60006d260 0x7fc600152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.409+0000 7fc606e00640 1 --2- 172.21.15.42:0/3807160941 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6000b4be0 0x7fc60015d6b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.409+0000 7fc606e00640 1 -- 172.21.15.42:0/3807160941 >> 172.21.15.42:0/3807160941 conn(0x7fc6000b25f0 msgr2=0x7fc6000d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:14.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.410+0000 7fc606e00640 1 -- 172.21.15.42:0/3807160941 shutdown_connections 2024-09-17T01:32:14.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.410+0000 7fc606e00640 1 -- 172.21.15.42:0/3807160941 wait complete. 2024-09-17T01:32:14.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.411+0000 7f039cc00640 1 Processor -- start 2024-09-17T01:32:14.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.411+0000 7f039cc00640 1 -- start start 2024-09-17T01:32:14.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.413+0000 7fabc2200640 1 Processor -- start 2024-09-17T01:32:14.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.413+0000 7fabc2200640 1 -- start start 2024-09-17T01:32:14.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.414+0000 7f039cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0390005cb0 0x7f03900d1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.414+0000 7f039cc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0390009ba0 0x7f03900d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.414+0000 7f039cc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03900ce0e0 0x7f03900ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.414+0000 7fc606e00640 1 Processor -- start 2024-09-17T01:32:14.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.415+0000 7fc606e00640 1 -- start start 2024-09-17T01:32:14.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.415+0000 7f039cc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0390006bf0 con 0x7f0390005cb0 2024-09-17T01:32:14.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.415+0000 7f039cc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f039000be40 con 0x7f03900ce0e0 2024-09-17T01:32:14.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.415+0000 7f039cc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0390006d70 con 0x7f0390009ba0 2024-09-17T01:32:14.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.415+0000 7f0396a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0390009ba0 0x7f03900d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.415+0000 7f0396a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0390009ba0 0x7f03900d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:33340/0 (socket says 172.21.15.42:33340) 2024-09-17T01:32:14.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.415+0000 7f0396a00640 1 -- 172.21.15.42:0/2294364638 learned_addr learned my addr 172.21.15.42:0/2294364638 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:14.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.415+0000 7f0397e00640 1 --2- 172.21.15.42:0/2294364638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03900ce0e0 0x7f03900ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.416+0000 7f0397400640 1 --2- 172.21.15.42:0/2294364638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0390005cb0 0x7f03900d1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.416+0000 7f0396a00640 1 -- 172.21.15.42:0/2294364638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03900ce0e0 msgr2=0x7f03900ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.416+0000 7f0396a00640 1 --2- 172.21.15.42:0/2294364638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03900ce0e0 0x7f03900ce4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.416+0000 7f0396a00640 1 -- 172.21.15.42:0/2294364638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0390005cb0 msgr2=0x7f03900d1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.416+0000 7f0396a00640 1 --2- 172.21.15.42:0/2294364638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0390005cb0 0x7f03900d1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.416+0000 7f0396a00640 1 -- 172.21.15.42:0/2294364638 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0390031990 con 0x7f0390009ba0 2024-09-17T01:32:14.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.416+0000 7f0397400640 1 --2- 172.21.15.42:0/2294364638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0390005cb0 0x7f03900d1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:14.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.417+0000 7f0397e00640 1 --2- 172.21.15.42:0/2294364638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03900ce0e0 0x7f03900ce4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:32:14.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.417+0000 7f0396a00640 1 --2- 172.21.15.42:0/2294364638 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0390009ba0 0x7f03900d18c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f038c00c4d0 tx=0x7f038c00c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.418+0000 7f038b400640 1 -- 172.21.15.42:0/2294364638 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038c0035f0 con 0x7f0390009ba0 2024-09-17T01:32:14.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.418+0000 7f039cc00640 1 -- 172.21.15.42:0/2294364638 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0390031c70 con 0x7f0390009ba0 2024-09-17T01:32:14.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.418+0000 7f039cc00640 1 -- 172.21.15.42:0/2294364638 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f03900212b0 con 0x7f0390009ba0 2024-09-17T01:32:14.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.418+0000 7f038b400640 1 -- 172.21.15.42:0/2294364638 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f038c003790 con 0x7f0390009ba0 2024-09-17T01:32:14.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.418+0000 7f038b400640 1 -- 172.21.15.42:0/2294364638 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038c003be0 con 0x7f0390009ba0 2024-09-17T01:32:14.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.418+0000 7fc606e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc60006d260 0x7fc6000cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.419+0000 7f9be2200640 1 -- 172.21.15.42:0/1333145596 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9bdc0b32b0 msgr2=0x7f9bdc0b4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.419+0000 7f9be2200640 1 --2- 172.21.15.42:0/1333145596 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9bdc0b32b0 0x7f9bdc0b4960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4005fd0 tx=0x7f9bd402a8a0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.419+0000 7f9be2200640 1 -- 172.21.15.42:0/1333145596 shutdown_connections 2024-09-17T01:32:14.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.419+0000 7f9be2200640 1 --2- 172.21.15.42:0/1333145596 >> v2:172.21.15.43:3300/0 conn(0x7f9bdc0b1ac0 0x7f9bdc0b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.419+0000 7f9be2200640 1 --2- 172.21.15.42:0/1333145596 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9bdc0b32b0 0x7f9bdc0b4960 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.419+0000 7f9be2200640 1 -- 172.21.15.42:0/1333145596 >> 172.21.15.42:0/1333145596 conn(0x7f9bdc0b1f40 msgr2=0x7f9bdc0b2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:14.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.420+0000 7f9be2200640 1 -- 172.21.15.42:0/1333145596 shutdown_connections 2024-09-17T01:32:14.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.420+0000 7f9be2200640 1 -- 172.21.15.42:0/1333145596 wait complete. 2024-09-17T01:32:14.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.420+0000 7fc606e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6000b4be0 0x7fc600072050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.420+0000 7fabc2200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fabb4009ba0 0x7fabb401e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.420+0000 7fc606e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6000cf7c0 0x7fc600072590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.420+0000 7fabc2200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fabb400bc30 0x7fabb40ddca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.420+0000 7fc606e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc6001537a0 con 0x7fc6000cf7c0 2024-09-17T01:32:14.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.420+0000 7fc606e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc600153620 con 0x7fc60006d260 2024-09-17T01:32:14.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.420+0000 7fc605a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc60006d260 0x7fc6000cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.420+0000 7fabc2200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fabb4036b10 0x7fabb40dff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.420+0000 7fc605a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc60006d260 0x7fc6000cbfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:35756/0 (socket says 172.21.15.42:35756) 2024-09-17T01:32:14.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.420+0000 7fc605a00640 1 -- 172.21.15.42:0/870561998 learned_addr learned my addr 172.21.15.42:0/870561998 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:14.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.420+0000 7fc606e00640 1 -- 172.21.15.42:0/870561998 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc600153920 con 0x7fc6000b4be0 2024-09-17T01:32:14.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.420+0000 7fabc2200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fabb40ea170 con 0x7fabb400bc30 2024-09-17T01:32:14.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.420+0000 7fabc2200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fabb40e9ff0 con 0x7fabb4009ba0 2024-09-17T01:32:14.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.419+0000 7f039cc00640 1 -- 172.21.15.42:0/2294364638 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0374001030 con 0x7f0390009ba0 2024-09-17T01:32:14.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.420+0000 7fabc2200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fabb40ea2f0 con 0x7fabb4036b10 2024-09-17T01:32:14.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.421+0000 7fc605a00640 1 -- 172.21.15.42:0/870561998 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6000b4be0 msgr2=0x7fc600072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.420+0000 7fabc1800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fabb4036b10 0x7fabb40dff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.421+0000 7fabc1800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fabb4036b10 0x7fabb40dff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:33364/0 (socket says 172.21.15.42:33364) 2024-09-17T01:32:14.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.421+0000 7fabc1800640 1 -- 172.21.15.42:0/1323169578 learned_addr learned my addr 172.21.15.42:0/1323169578 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:14.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.420+0000 7fabc0e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fabb4009ba0 0x7fabb401e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.421+0000 7fc606400640 1 --2- 172.21.15.42:0/870561998 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6000cf7c0 0x7fc600072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.420+0000 7fc605000640 1 --2- 172.21.15.42:0/870561998 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6000b4be0 0x7fc600072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.421+0000 7fc605a00640 1 --2- 172.21.15.42:0/870561998 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6000b4be0 0x7fc600072050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.421+0000 7fc605a00640 1 -- 172.21.15.42:0/870561998 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6000cf7c0 msgr2=0x7fc600072590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.421+0000 7fabbbe00640 1 --2- 172.21.15.42:0/1323169578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fabb400bc30 0x7fabb40ddca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.421+0000 7fc605a00640 1 --2- 172.21.15.42:0/870561998 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6000cf7c0 0x7fc600072590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.421+0000 7fc605a00640 1 -- 172.21.15.42:0/870561998 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60014da00 con 0x7fc60006d260 2024-09-17T01:32:14.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.421+0000 7fc605000640 1 --2- 172.21.15.42:0/870561998 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6000b4be0 0x7fc600072050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:32:14.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.421+0000 7fc605a00640 1 --2- 172.21.15.42:0/870561998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc60006d260 0x7fc6000cbfe0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc5f802b040 tx=0x7fc5f8003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.422+0000 7fabc0e00640 1 -- 172.21.15.42:0/1323169578 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fabb4036b10 msgr2=0x7fabb40dff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.422+0000 7fabc0e00640 1 --2- 172.21.15.42:0/1323169578 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fabb4036b10 0x7fabb40dff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.422+0000 7fabc0e00640 1 -- 172.21.15.42:0/1323169578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fabb400bc30 msgr2=0x7fabb40ddca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.423+0000 7f4521c00640 1 -- 172.21.15.42:0/2198038856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f451c15ede0 msgr2=0x7f451c15f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.423+0000 7f4521c00640 1 --2- 172.21.15.42:0/2198038856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f451c15ede0 0x7f451c15f1f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f45080097b0 tx=0x7f450802a3d0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.423+0000 7fbd3da00640 1 -- 172.21.15.42:0/221839744 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd3000bc30 msgr2=0x7fbd300df180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.423+0000 7fbd3da00640 1 --2- 172.21.15.42:0/221839744 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd3000bc30 0x7fbd300df180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbd24009910 tx=0x7fbd2402a590 comp rx=0 tx=0).stop 2024-09-17T01:32:14.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.423+0000 7fabc0e00640 1 --2- 172.21.15.42:0/1323169578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fabb400bc30 0x7fabb40ddca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.423+0000 7fabc0e00640 1 -- 172.21.15.42:0/1323169578 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb40df7b0 con 0x7fabb4009ba0 2024-09-17T01:32:14.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.424+0000 7f9be2200640 1 Processor -- start 2024-09-17T01:32:14.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.424+0000 7fabc1800640 1 --2- 172.21.15.42:0/1323169578 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fabb4036b10 0x7fabb40dff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:32:14.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.424+0000 7fabbbe00640 1 --2- 172.21.15.42:0/1323169578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fabb400bc30 0x7fabb40ddca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:14.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.424+0000 7fabc0e00640 1 --2- 172.21.15.42:0/1323169578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fabb4009ba0 0x7fabb401e410 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7faba800c410 tx=0x7faba800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.424+0000 7fabb8c00640 1 -- 172.21.15.42:0/1323169578 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba8017070 con 0x7fabb4009ba0 2024-09-17T01:32:14.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.424+0000 7fabb8c00640 1 -- 172.21.15.42:0/1323169578 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faba8005250 con 0x7fabb4009ba0 2024-09-17T01:32:14.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.424+0000 7fabb8c00640 1 -- 172.21.15.42:0/1323169578 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba80045f0 con 0x7fabb4009ba0 2024-09-17T01:32:14.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.424+0000 7f4521c00640 1 -- 172.21.15.42:0/2198038856 shutdown_connections 2024-09-17T01:32:14.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.424+0000 7f4521c00640 1 --2- 172.21.15.42:0/2198038856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f451c15ede0 0x7f451c15f1f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.424+0000 7f4521c00640 1 -- 172.21.15.42:0/2198038856 >> 172.21.15.42:0/2198038856 conn(0x7f451c06cd20 msgr2=0x7f451c06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:14.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.425+0000 7fbd3da00640 1 -- 172.21.15.42:0/221839744 shutdown_connections 2024-09-17T01:32:14.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.425+0000 7fbd3da00640 1 --2- 172.21.15.42:0/221839744 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd3000bc30 0x7fbd300df180 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.425+0000 7fbd3da00640 1 -- 172.21.15.42:0/221839744 >> 172.21.15.42:0/221839744 conn(0x7fbd30051420 msgr2=0x7fbd30051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:14.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.425+0000 7fabc2200640 1 -- 172.21.15.42:0/1323169578 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb40de1e0 con 0x7fabb4009ba0 2024-09-17T01:32:14.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.425+0000 7f4521c00640 1 -- 172.21.15.42:0/2198038856 shutdown_connections 2024-09-17T01:32:14.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.425+0000 7f038b400640 1 -- 172.21.15.42:0/2294364638 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f038c012400 con 0x7f0390009ba0 2024-09-17T01:32:14.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.426+0000 7fabc2200640 1 -- 172.21.15.42:0/1323169578 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb40e1b60 con 0x7fabb4009ba0 2024-09-17T01:32:14.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.426+0000 7fc5fd600640 1 -- 172.21.15.42:0/870561998 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8004410 con 0x7fc60006d260 2024-09-17T01:32:14.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.426+0000 7fc5fd600640 1 -- 172.21.15.42:0/870561998 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5f80045b0 con 0x7fc60006d260 2024-09-17T01:32:14.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.426+0000 7fc5fd600640 1 -- 172.21.15.42:0/870561998 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8036400 con 0x7fc60006d260 2024-09-17T01:32:14.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.426+0000 7fc606e00640 1 -- 172.21.15.42:0/870561998 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc60014caa0 con 0x7fc60006d260 2024-09-17T01:32:14.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.425+0000 7f4521c00640 1 -- 172.21.15.42:0/2198038856 wait complete. 2024-09-17T01:32:14.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.424+0000 7f9be2200640 1 -- start start 2024-09-17T01:32:14.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.426+0000 7f9be2200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bdc0b1ac0 0x7f9bdc0b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.426+0000 7f9be2200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9bdc0b2a60 0x7f9bdc0d0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.426+0000 7f9be2200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9bdc0b32b0 0x7f9bdc0d0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.426+0000 7f9be2200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc073e00 con 0x7f9bdc0b1ac0 2024-09-17T01:32:14.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.426+0000 7f9be2200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc161ae0 con 0x7f9bdc0b2a60 2024-09-17T01:32:14.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.426+0000 7f9be2200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9bdc073f80 con 0x7f9bdc0b32b0 2024-09-17T01:32:14.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.427+0000 7f9bdb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bdc0b1ac0 0x7f9bdc0b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.427+0000 7f9bdb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bdc0b1ac0 0x7f9bdc0b0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50456/0 (socket says 172.21.15.42:50456) 2024-09-17T01:32:14.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.427+0000 7f9bdb400640 1 -- 172.21.15.42:0/2190422788 learned_addr learned my addr 172.21.15.42:0/2190422788 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:14.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.427+0000 7f9bdbe00640 1 --2- 172.21.15.42:0/2190422788 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9bdc0b32b0 0x7f9bdc0d0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.427+0000 7fbd3da00640 1 -- 172.21.15.42:0/221839744 shutdown_connections 2024-09-17T01:32:14.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.427+0000 7f038b400640 1 --2- 172.21.15.42:0/2294364638 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0378078b90 0x7f037807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.427+0000 7f038b400640 1 -- 172.21.15.42:0/2294364638 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f038c09a9e0 con 0x7f0390009ba0 2024-09-17T01:32:14.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.427+0000 7f038b400640 1 --2- 172.21.15.42:0/2294364638 >> [v2:172.21.15.42:6800/1232300261,v1:172.21.15.42:6801/1232300261] conn(0x7f0378080d80 0x7f03780831d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.427+0000 7f038b400640 1 -- 172.21.15.42:0/2294364638 --> [v2:172.21.15.42:6800/1232300261,v1:172.21.15.42:6801/1232300261] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f03780838a0 con 0x7f0378080d80 2024-09-17T01:32:14.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.427+0000 7f038b400640 1 -- 172.21.15.42:0/2294364638 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f038c09ad90 con 0x7f0390009ba0 2024-09-17T01:32:14.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.428+0000 7fbd3da00640 1 -- 172.21.15.42:0/221839744 wait complete. 2024-09-17T01:32:14.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.428+0000 7f9bdb400640 1 -- 172.21.15.42:0/2190422788 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9bdc0b32b0 msgr2=0x7f9bdc0d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.428+0000 7f9bdb400640 1 --2- 172.21.15.42:0/2190422788 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9bdc0b32b0 0x7f9bdc0d0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.428+0000 7f9bdaa00640 1 --2- 172.21.15.42:0/2190422788 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9bdc0b2a60 0x7f9bdc0d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.428+0000 7f9bdb400640 1 -- 172.21.15.42:0/2190422788 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9bdc0b2a60 msgr2=0x7f9bdc0d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.428+0000 7f9bdb400640 1 --2- 172.21.15.42:0/2190422788 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9bdc0b2a60 0x7f9bdc0d0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.428+0000 7f0397400640 1 --2- 172.21.15.42:0/2294364638 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0378078b90 0x7f037807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.428+0000 7f9bdb400640 1 -- 172.21.15.42:0/2190422788 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bdc1e8380 con 0x7f9bdc0b1ac0 2024-09-17T01:32:14.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.429+0000 7f0397e00640 1 --2- 172.21.15.42:0/2294364638 >> [v2:172.21.15.42:6800/1232300261,v1:172.21.15.42:6801/1232300261] conn(0x7f0378080d80 0x7f03780831d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.426+0000 7fc606e00640 1 -- 172.21.15.42:0/870561998 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc60014cd80 con 0x7fc60006d260 2024-09-17T01:32:14.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.429+0000 7f9bdb400640 1 --2- 172.21.15.42:0/2190422788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bdc0b1ac0 0x7f9bdc0b0880 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4000f80 tx=0x7f9bd4032db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.428+0000 7fc606e00640 1 -- 172.21.15.42:0/870561998 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc60015d6b0 con 0x7fc60006d260 2024-09-17T01:32:14.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.430+0000 7f9bd3400640 1 -- 172.21.15.42:0/2190422788 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4041070 con 0x7f9bdc0b1ac0 2024-09-17T01:32:14.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.430+0000 7f046e000640 1 -- 172.21.15.42:0/337935245 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f046815f190 msgr2=0x7f046806fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.430+0000 7f046e000640 1 --2- 172.21.15.42:0/337935245 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f046815f190 0x7f046806fe40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0450005fd0 tx=0x7f045002a5f0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.430+0000 7f9bd3400640 1 -- 172.21.15.42:0/2190422788 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9bd4004450 con 0x7f9bdc0b1ac0 2024-09-17T01:32:14.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.430+0000 7f9bd3400640 1 -- 172.21.15.42:0/2190422788 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4031430 con 0x7f9bdc0b1ac0 2024-09-17T01:32:14.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.430+0000 7f0397400640 1 --2- 172.21.15.42:0/2294364638 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0378078b90 0x7f037807b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f039802ebd0 tx=0x7f039806c0c0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.428+0000 7fabc2200640 1 -- 172.21.15.42:0/1323169578 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fabb401e950 con 0x7fabb4009ba0 2024-09-17T01:32:14.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.430+0000 7fabb8c00640 1 -- 172.21.15.42:0/1323169578 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faba801a070 con 0x7fabb4009ba0 2024-09-17T01:32:14.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.430+0000 7f23cc000640 1 -- 172.21.15.42:0/1267285091 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23c4148400 msgr2=0x7f23c4072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.430+0000 7f23cc000640 1 --2- 172.21.15.42:0/1267285091 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23c4148400 0x7f23c4072900 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f23b8009860 tx=0x7f23b802a4b0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.430+0000 7f046e000640 1 -- 172.21.15.42:0/337935245 shutdown_connections 2024-09-17T01:32:14.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.430+0000 7f046e000640 1 --2- 172.21.15.42:0/337935245 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f046815f190 0x7f046806fe40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.430+0000 7f046e000640 1 --2- 172.21.15.42:0/337935245 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0468072e00 0x7f046815bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.430+0000 7f046e000640 1 -- 172.21.15.42:0/337935245 >> 172.21.15.42:0/337935245 conn(0x7f04680b2930 msgr2=0x7f046806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:14.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.431+0000 7f046e000640 1 -- 172.21.15.42:0/337935245 shutdown_connections 2024-09-17T01:32:14.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.431+0000 7f4521c00640 1 Processor -- start 2024-09-17T01:32:14.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.431+0000 7fbd3da00640 1 Processor -- start 2024-09-17T01:32:14.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.431+0000 7f4521c00640 1 -- start start 2024-09-17T01:32:14.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.431+0000 7f9be2200640 1 -- 172.21.15.42:0/2190422788 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bdc1f5cc0 con 0x7f9bdc0b1ac0 2024-09-17T01:32:14.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.431+0000 7fbd3da00640 1 -- start start 2024-09-17T01:32:14.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.431+0000 7f9bdaa00640 1 --2- 172.21.15.42:0/2190422788 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9bdc0b2a60 0x7f9bdc0d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:32:14.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.431+0000 7f23cc000640 1 -- 172.21.15.42:0/1267285091 shutdown_connections 2024-09-17T01:32:14.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.432+0000 7f23cc000640 1 --2- 172.21.15.42:0/1267285091 >> v2:172.21.15.43:3300/0 conn(0x7f23c40afd80 0x7f23c406f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.432+0000 7f23cc000640 1 --2- 172.21.15.42:0/1267285091 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23c4148400 0x7f23c4072900 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.432+0000 7f23cc000640 1 -- 172.21.15.42:0/1267285091 >> 172.21.15.42:0/1267285091 conn(0x7f23c406d350 msgr2=0x7f23c40b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:14.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.431+0000 7fc5fd600640 1 -- 172.21.15.42:0/870561998 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc5f802eaa0 con 0x7fc60006d260 2024-09-17T01:32:14.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.432+0000 7f9be2200640 1 -- 172.21.15.42:0/2190422788 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bdc1f6280 con 0x7f9bdc0b1ac0 2024-09-17T01:32:14.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.431+0000 7f0397e00640 1 --2- 172.21.15.42:0/2294364638 >> [v2:172.21.15.42:6800/1232300261,v1:172.21.15.42:6801/1232300261] conn(0x7f0378080d80 0x7f03780831d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.431+0000 7f9bdbe00640 1 --2- 172.21.15.42:0/2190422788 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9bdc0b32b0 0x7f9bdc0d0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:14.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.432+0000 7fabb8c00640 1 --2- 172.21.15.42:0/1323169578 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fab9c078b90 0x7fab9c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.433+0000 7fabb8c00640 1 -- 172.21.15.42:0/1323169578 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7faba8099e20 con 0x7fabb4009ba0 2024-09-17T01:32:14.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.433+0000 7fc5fd600640 1 --2- 172.21.15.42:0/870561998 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc5e0078c60 0x7fc5e007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.433+0000 7fc5fd600640 1 -- 172.21.15.42:0/870561998 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc5f80bc320 con 0x7fc60006d260 2024-09-17T01:32:14.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.433+0000 7fabb8c00640 1 --2- 172.21.15.42:0/1323169578 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x7fab9c080de0 0x7fab9c083230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.433+0000 7fabb8c00640 1 -- 172.21.15.42:0/1323169578 --> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faba8016ec0 con 0x7fab9c080de0 2024-09-17T01:32:14.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.433+0000 7fabb8c00640 1 -- 172.21.15.42:0/1323169578 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7faba809c500 con 0x7fabb4009ba0 2024-09-17T01:32:14.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.433+0000 7fc605000640 1 --2- 172.21.15.42:0/870561998 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc5e0078c60 0x7fc5e007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.434+0000 7f23cc000640 1 -- 172.21.15.42:0/1267285091 shutdown_connections 2024-09-17T01:32:14.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.434+0000 7f9be2200640 1 -- 172.21.15.42:0/2190422788 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9bdc0736f0 con 0x7f9bdc0b1ac0 2024-09-17T01:32:14.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.434+0000 7fbd3da00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd30009ba0 0x7fbd30020840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.434+0000 7fbd3da00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd3000bc30 0x7fbd300535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.434+0000 7fbd3da00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd30036b10 0x7fbd30035220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.433+0000 7f038b400640 1 -- 172.21.15.42:0/2294364638 <== osd.0 v2:172.21.15.42:6800/1232300261 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f03780838a0 con 0x7f0378080d80 2024-09-17T01:32:14.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.434+0000 7fbd3da00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbd300eb4d0 con 0x7fbd3000bc30 2024-09-17T01:32:14.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.434+0000 7fbd3da00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbd30006000 con 0x7fbd30009ba0 2024-09-17T01:32:14.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.434+0000 7fbd3da00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbd300eb650 con 0x7fbd30036b10 2024-09-17T01:32:14.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.434+0000 7fabbbe00640 1 --2- 172.21.15.42:0/1323169578 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fab9c078b90 0x7fab9c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.431+0000 7f046e000640 1 -- 172.21.15.42:0/337935245 wait complete. 2024-09-17T01:32:14.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.434+0000 7fc5fd600640 1 --2- 172.21.15.42:0/870561998 >> [v2:172.21.15.42:6816/2631717588,v1:172.21.15.42:6817/2631717588] conn(0x7fc5e0080ed0 0x7fc5e0083320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.434+0000 7fc5fd600640 1 -- 172.21.15.42:0/870561998 --> [v2:172.21.15.42:6816/2631717588,v1:172.21.15.42:6817/2631717588] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc5e00839f0 con 0x7fc5e0080ed0 2024-09-17T01:32:14.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.434+0000 7fc5fd600640 1 -- 172.21.15.42:0/870561998 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc5f80bc710 con 0x7fc60006d260 2024-09-17T01:32:14.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.434+0000 7fbd37e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd30009ba0 0x7fbd30020840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.434+0000 7fabc1800640 1 --2- 172.21.15.42:0/1323169578 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x7fab9c080de0 0x7fab9c083230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.434+0000 7fbd3d000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd30036b10 0x7fbd30035220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.434+0000 7fbd37e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd30009ba0 0x7fbd30020840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:35780/0 (socket says 172.21.15.42:35780) 2024-09-17T01:32:14.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.434+0000 7fbd37e00640 1 -- 172.21.15.42:0/2043430413 learned_addr learned my addr 172.21.15.42:0/2043430413 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:14.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.434+0000 7f23cc000640 1 -- 172.21.15.42:0/1267285091 wait complete. 2024-09-17T01:32:14.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.435+0000 7fc605000640 1 --2- 172.21.15.42:0/870561998 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc5e0078c60 0x7fc5e007b170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc600075150 tx=0x7fc5f4008040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.435+0000 7f4521c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f451c0d0d20 0x7f451c15e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.435+0000 7f046e000640 1 Processor -- start 2024-09-17T01:32:14.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.435+0000 7f4521c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f451c0d3e40 0x7f451c1583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.435+0000 7f046e000640 1 -- start start 2024-09-17T01:32:14.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.435+0000 7fc606400640 1 --2- 172.21.15.42:0/870561998 >> [v2:172.21.15.42:6816/2631717588,v1:172.21.15.42:6817/2631717588] conn(0x7fc5e0080ed0 0x7fc5e0083320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.435+0000 7f4521c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f451c15ede0 0x7f451c1f8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.436+0000 7f4521c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f451c0d2e20 con 0x7f451c0d3e40 2024-09-17T01:32:14.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.436+0000 7f4521c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f451c0d2ca0 con 0x7f451c15ede0 2024-09-17T01:32:14.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.436+0000 7f4521200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f451c15ede0 0x7f451c1f8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.436+0000 7f4521200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f451c15ede0 0x7f451c1f8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:35786/0 (socket says 172.21.15.42:35786) 2024-09-17T01:32:14.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.436+0000 7f4521200640 1 -- 172.21.15.42:0/3020667107 learned_addr learned my addr 172.21.15.42:0/3020667107 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:14.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.436+0000 7f4521c00640 1 -- 172.21.15.42:0/3020667107 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f451c0d2fa0 con 0x7f451c0d0d20 2024-09-17T01:32:14.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.436+0000 7f451be00640 1 --2- 172.21.15.42:0/3020667107 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f451c0d0d20 0x7f451c15e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.436+0000 7fabbbe00640 1 --2- 172.21.15.42:0/1323169578 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fab9c078b90 0x7fab9c07b0a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fabb0032000 tx=0x7fabb0004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.436+0000 7fbd3d000640 1 -- 172.21.15.42:0/2043430413 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd30009ba0 msgr2=0x7fbd30020840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.436+0000 7fabc1800640 1 --2- 172.21.15.42:0/1323169578 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x7fab9c080de0 0x7fab9c083230 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.436+0000 7fbd3d000640 1 --2- 172.21.15.42:0/2043430413 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd30009ba0 0x7fbd30020840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.436+0000 7fbd3d000640 1 -- 172.21.15.42:0/2043430413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd3000bc30 msgr2=0x7fbd300535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.436+0000 7fbd3d000640 1 --2- 172.21.15.42:0/2043430413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd3000bc30 0x7fbd300535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.436+0000 7fbd3d000640 1 -- 172.21.15.42:0/2043430413 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3017e760 con 0x7fbd30036b10 2024-09-17T01:32:14.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.437+0000 7f23cc000640 1 Processor -- start 2024-09-17T01:32:14.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.437+0000 7f451be00640 1 -- 172.21.15.42:0/3020667107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f451c15ede0 msgr2=0x7f451c1f8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.437+0000 7fbd3d000640 1 --2- 172.21.15.42:0/2043430413 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd30036b10 0x7fbd30035220 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c00b3e0 tx=0x7fbd2c00b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.437+0000 7fc606400640 1 --2- 172.21.15.42:0/870561998 >> [v2:172.21.15.42:6816/2631717588,v1:172.21.15.42:6817/2631717588] conn(0x7fc5e0080ed0 0x7fc5e0083320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.437+0000 7f451be00640 1 --2- 172.21.15.42:0/3020667107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f451c15ede0 0x7f451c1f8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.437+0000 7f451be00640 1 -- 172.21.15.42:0/3020667107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f451c0d3e40 msgr2=0x7f451c1583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.437+0000 7f451be00640 1 --2- 172.21.15.42:0/3020667107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f451c0d3e40 0x7f451c1583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.437+0000 7f451be00640 1 -- 172.21.15.42:0/3020667107 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f451c0cc6f0 con 0x7f451c0d0d20 2024-09-17T01:32:14.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.438+0000 7f4521200640 1 --2- 172.21.15.42:0/3020667107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f451c15ede0 0x7f451c1f8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:32:14.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.438+0000 7f046e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f046806d430 0x7f0468203460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.436+0000 7f9bd3400640 1 -- 172.21.15.42:0/2190422788 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9bd4044070 con 0x7f9bdc0b1ac0 2024-09-17T01:32:14.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.438+0000 7f9bd3400640 1 --2- 172.21.15.42:0/2190422788 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9bbc078c10 0x7f9bbc07b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.438+0000 7fbd2be00640 1 -- 172.21.15.42:0/2043430413 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c015020 con 0x7fbd30036b10 2024-09-17T01:32:14.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.438+0000 7fbd2be00640 1 -- 172.21.15.42:0/2043430413 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd2c011940 con 0x7fbd30036b10 2024-09-17T01:32:14.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.438+0000 7fbd2be00640 1 -- 172.21.15.42:0/2043430413 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c011d90 con 0x7fbd30036b10 2024-09-17T01:32:14.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.438+0000 7f046e000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0468072e00 0x7f04681544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.438+0000 7f046e000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f046815f190 0x7f0468205ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.438+0000 7f046e000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0468151520 con 0x7f046806d430 2024-09-17T01:32:14.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.438+0000 7f046e000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0468070740 con 0x7f0468072e00 2024-09-17T01:32:14.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.438+0000 7f046e000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f04681516a0 con 0x7f046815f190 2024-09-17T01:32:14.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.438+0000 7f451be00640 1 --2- 172.21.15.42:0/3020667107 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f451c0d0d20 0x7f451c15e0b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f451400c7c0 tx=0x7f451400cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.438+0000 7fbd3da00640 1 -- 172.21.15.42:0/2043430413 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd3017ea40 con 0x7fbd30036b10 2024-09-17T01:32:14.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f9bdaa00640 1 --2- 172.21.15.42:0/2190422788 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9bbc078c10 0x7f9bbc07b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f9bd3400640 1 -- 172.21.15.42:0/2190422788 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9bd402e020 con 0x7f9bdc0b1ac0 2024-09-17T01:32:14.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.438+0000 7f045ea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0468072e00 0x7f04681544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.438+0000 7f0467e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f046815f190 0x7f0468205ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f045ea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0468072e00 0x7f04681544a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:35798/0 (socket says 172.21.15.42:35798) 2024-09-17T01:32:14.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f045ea00640 1 -- 172.21.15.42:0/1887282924 learned_addr learned my addr 172.21.15.42:0/1887282924 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:14.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f0467400640 1 --2- 172.21.15.42:0/1887282924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f046806d430 0x7f0468203460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7fabb8c00640 1 -- 172.21.15.42:0/1323169578 <== osd.1 v2:172.21.15.42:6824/4073532812 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faba8016ec0 con 0x7fab9c080de0 2024-09-17T01:32:14.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.437+0000 7f23cc000640 1 -- start start 2024-09-17T01:32:14.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7fbd3da00640 1 -- 172.21.15.42:0/2043430413 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd3017f000 con 0x7fbd30036b10 2024-09-17T01:32:14.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f23cc000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23c40afd80 0x7f23c413a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f23cc000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23c4147910 0x7f23c413a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f23cc000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23c4148400 0x7f23c415c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f23cc000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f23c40b57b0 con 0x7f23c4148400 2024-09-17T01:32:14.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f23cc000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f23c40b5930 con 0x7f23c4147910 2024-09-17T01:32:14.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f23cc000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f23c40b5ab0 con 0x7f23c40afd80 2024-09-17T01:32:14.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f23c8c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23c4147910 0x7f23c413a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f045ea00640 1 -- 172.21.15.42:0/1887282924 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f046815f190 msgr2=0x7f0468205ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f045ea00640 1 --2- 172.21.15.42:0/1887282924 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f046815f190 0x7f0468205ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f045ea00640 1 -- 172.21.15.42:0/1887282924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f046806d430 msgr2=0x7f0468203460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f045ea00640 1 --2- 172.21.15.42:0/1887282924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f046806d430 0x7f0468203460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f045ea00640 1 -- 172.21.15.42:0/1887282924 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0468202d60 con 0x7f0468072e00 2024-09-17T01:32:14.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f23c8c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23c4147910 0x7f23c413a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:35812/0 (socket says 172.21.15.42:35812) 2024-09-17T01:32:14.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f0467400640 1 --2- 172.21.15.42:0/1887282924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f046806d430 0x7f0468203460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:14.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f23c8c00640 1 -- 172.21.15.42:0/2022851819 learned_addr learned my addr 172.21.15.42:0/2022851819 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:14.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.440+0000 7fc5fd600640 1 -- 172.21.15.42:0/870561998 <== osd.2 v2:172.21.15.42:6816/2631717588 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc5e00839f0 con 0x7fc5e0080ed0 2024-09-17T01:32:14.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f9bd3400640 1 --2- 172.21.15.42:0/2190422788 >> [v2:172.21.15.43:6818/3453529013,v1:172.21.15.43:6819/3453529013] conn(0x7f9bbc081a90 0x7f9bbc083f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f9bd3400640 1 -- 172.21.15.42:0/2190422788 --> [v2:172.21.15.43:6818/3453529013,v1:172.21.15.43:6819/3453529013] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9bbc084650 con 0x7f9bbc081a90 2024-09-17T01:32:14.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f4513e00640 1 -- 172.21.15.42:0/3020667107 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4514003da0 con 0x7f451c0d0d20 2024-09-17T01:32:14.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f4513e00640 1 -- 172.21.15.42:0/3020667107 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4514005070 con 0x7f451c0d0d20 2024-09-17T01:32:14.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.439+0000 7f4513e00640 1 -- 172.21.15.42:0/3020667107 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45140054c0 con 0x7f451c0d0d20 2024-09-17T01:32:14.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.440+0000 7f9bdbe00640 1 --2- 172.21.15.42:0/2190422788 >> [v2:172.21.15.43:6818/3453529013,v1:172.21.15.43:6819/3453529013] conn(0x7f9bbc081a90 0x7f9bbc083f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.440+0000 7f9bd3400640 1 -- 172.21.15.42:0/2190422788 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f9bd4080190 con 0x7f9bdc0b1ac0 2024-09-17T01:32:14.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.440+0000 7fbd29600640 1 -- 172.21.15.42:0/2043430413 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbd0c001030 con 0x7fbd30036b10 2024-09-17T01:32:14.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.440+0000 7f045ea00640 1 --2- 172.21.15.42:0/1887282924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0468072e00 0x7f04681544a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0450034040 tx=0x7f04500317d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.440+0000 7f23ca000640 1 --2- 172.21.15.42:0/2022851819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23c4148400 0x7f23c415c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.440+0000 7f23c8c00640 1 -- 172.21.15.42:0/2022851819 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23c40afd80 msgr2=0x7f23c413a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.440+0000 7f23c9600640 1 --2- 172.21.15.42:0/2022851819 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23c40afd80 0x7f23c413a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.441+0000 7f9bdbe00640 1 --2- 172.21.15.42:0/2190422788 >> [v2:172.21.15.43:6818/3453529013,v1:172.21.15.43:6819/3453529013] conn(0x7f9bbc081a90 0x7f9bbc083f80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.441+0000 7f23c8c00640 1 --2- 172.21.15.42:0/2022851819 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23c40afd80 0x7f23c413a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.440+0000 7f4521c00640 1 -- 172.21.15.42:0/3020667107 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f451c0cc9d0 con 0x7f451c0d0d20 2024-09-17T01:32:14.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.441+0000 7f4521c00640 1 -- 172.21.15.42:0/3020667107 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f451c0ccf90 con 0x7f451c0d0d20 2024-09-17T01:32:14.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.442+0000 7f23c8c00640 1 -- 172.21.15.42:0/2022851819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23c4148400 msgr2=0x7f23c415c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.442+0000 7f4521c00640 1 -- 172.21.15.42:0/3020667107 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f451c0cd370 con 0x7f451c0d0d20 2024-09-17T01:32:14.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.442+0000 7f23c8c00640 1 --2- 172.21.15.42:0/2022851819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23c4148400 0x7f23c415c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.442+0000 7f23c8c00640 1 -- 172.21.15.42:0/2022851819 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c415f880 con 0x7f23c4147910 2024-09-17T01:32:14.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.442+0000 7f045fe00640 1 -- 172.21.15.42:0/1887282924 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0450040070 con 0x7f0468072e00 2024-09-17T01:32:14.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.442+0000 7f045fe00640 1 -- 172.21.15.42:0/1887282924 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f045003a3f0 con 0x7f0468072e00 2024-09-17T01:32:14.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.442+0000 7f045fe00640 1 -- 172.21.15.42:0/1887282924 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0450035040 con 0x7f0468072e00 2024-09-17T01:32:14.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.442+0000 7f23ca000640 1 --2- 172.21.15.42:0/2022851819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23c4148400 0x7f23c415c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:14.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.442+0000 7f23c9600640 1 --2- 172.21.15.42:0/2022851819 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23c40afd80 0x7f23c413a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:32:14.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.442+0000 7f23c8c00640 1 --2- 172.21.15.42:0/2022851819 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23c4147910 0x7f23c413a670 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f23b000e790 tx=0x7f23b000ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.443+0000 7f23c1600640 1 -- 172.21.15.42:0/2022851819 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b000cac0 con 0x7f23c4147910 2024-09-17T01:32:14.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.443+0000 7f23c1600640 1 -- 172.21.15.42:0/2022851819 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23b000cc60 con 0x7f23c4147910 2024-09-17T01:32:14.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.443+0000 7f23cc000640 1 -- 172.21.15.42:0/2022851819 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c415fb60 con 0x7f23c4147910 2024-09-17T01:32:14.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.443+0000 7fbd2be00640 1 -- 172.21.15.42:0/2043430413 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbd2c018020 con 0x7fbd30036b10 2024-09-17T01:32:14.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.443+0000 7f23c1600640 1 -- 172.21.15.42:0/2022851819 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b0005280 con 0x7f23c4147910 2024-09-17T01:32:14.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.444+0000 7f9bd3400640 1 -- 172.21.15.42:0/2190422788 <== osd.4 v2:172.21.15.43:6818/3453529013 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9bbc084650 con 0x7f9bbc081a90 2024-09-17T01:32:14.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.444+0000 7f9bdaa00640 1 --2- 172.21.15.42:0/2190422788 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9bbc078c10 0x7f9bbc07b120 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc0d0fc0 tx=0x7f9bcc005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.444+0000 7f23cc000640 1 -- 172.21.15.42:0/2022851819 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c415d5d0 con 0x7f23c4147910 2024-09-17T01:32:14.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.443+0000 7f046e000640 1 -- 172.21.15.42:0/1887282924 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0468155f80 con 0x7f0468072e00 2024-09-17T01:32:14.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.443+0000 7f046e000640 1 -- 172.21.15.42:0/1887282924 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0468203a30 con 0x7f0468072e00 2024-09-17T01:32:14.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.444+0000 7f046e000640 1 -- 172.21.15.42:0/1887282924 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0468203260 con 0x7f0468072e00 2024-09-17T01:32:14.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.445+0000 7fbd2be00640 1 --2- 172.21.15.42:0/2043430413 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd18078c60 0x7fbd1807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.445+0000 7fbd2be00640 1 -- 172.21.15.42:0/2043430413 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fbd2c09af60 con 0x7fbd30036b10 2024-09-17T01:32:14.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.446+0000 7fbd37e00640 1 --2- 172.21.15.42:0/2043430413 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd18078c60 0x7fbd1807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.446+0000 7fbd2be00640 1 --2- 172.21.15.42:0/2043430413 >> [v2:172.21.15.43:6802/3469876255,v1:172.21.15.43:6803/3469876255] conn(0x7fbd18080f30 0x7fbd18083380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.446+0000 7fbd2be00640 1 -- 172.21.15.42:0/2043430413 --> [v2:172.21.15.43:6802/3469876255,v1:172.21.15.43:6803/3469876255] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd2c004450 con 0x7fbd18080f30 2024-09-17T01:32:14.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.446+0000 7fbd2be00640 1 -- 172.21.15.42:0/2043430413 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fbd2c09b350 con 0x7fbd30036b10 2024-09-17T01:32:14.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.446+0000 7f23cc000640 1 -- 172.21.15.42:0/2022851819 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f23c406f690 con 0x7f23c4147910 2024-09-17T01:32:14.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.446+0000 7fbd37400640 1 --2- 172.21.15.42:0/2043430413 >> [v2:172.21.15.43:6802/3469876255,v1:172.21.15.43:6803/3469876255] conn(0x7fbd18080f30 0x7fbd18083380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.447+0000 7fbd37e00640 1 --2- 172.21.15.42:0/2043430413 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd18078c60 0x7fbd1807b170 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbd24009910 tx=0x7fbd24004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.447+0000 7fbd37400640 1 --2- 172.21.15.42:0/2043430413 >> [v2:172.21.15.43:6802/3469876255,v1:172.21.15.43:6803/3469876255] conn(0x7fbd18080f30 0x7fbd18083380 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.447+0000 7f4513e00640 1 -- 172.21.15.42:0/3020667107 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4514005660 con 0x7f451c0d0d20 2024-09-17T01:32:14.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.448+0000 7fbd2be00640 1 -- 172.21.15.42:0/2043430413 <== osd.5 v2:172.21.15.43:6802/3469876255 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbd2c004450 con 0x7fbd18080f30 2024-09-17T01:32:14.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.449+0000 7f23c1600640 1 -- 172.21.15.42:0/2022851819 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f23b0005420 con 0x7f23c4147910 2024-09-17T01:32:14.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.449+0000 7f4513e00640 1 --2- 172.21.15.42:0/3020667107 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f44fc078c60 0x7f44fc07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.449+0000 7f4513e00640 1 -- 172.21.15.42:0/3020667107 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f451409b640 con 0x7f451c0d0d20 2024-09-17T01:32:14.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.449+0000 7f4513e00640 1 --2- 172.21.15.42:0/3020667107 >> [v2:172.21.15.42:6808/940657160,v1:172.21.15.42:6809/940657160] conn(0x7f44fc080f30 0x7f44fc083380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.449+0000 7f4513e00640 1 -- 172.21.15.42:0/3020667107 --> [v2:172.21.15.42:6808/940657160,v1:172.21.15.42:6809/940657160] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4514004e50 con 0x7f44fc080f30 2024-09-17T01:32:14.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.449+0000 7f4513e00640 1 -- 172.21.15.42:0/3020667107 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f451409ba30 con 0x7f451c0d0d20 2024-09-17T01:32:14.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.449+0000 7f451b400640 1 --2- 172.21.15.42:0/3020667107 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f44fc078c60 0x7f44fc07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.450+0000 7f4521200640 1 --2- 172.21.15.42:0/3020667107 >> [v2:172.21.15.42:6808/940657160,v1:172.21.15.42:6809/940657160] conn(0x7f44fc080f30 0x7f44fc083380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.450+0000 7f451b400640 1 --2- 172.21.15.42:0/3020667107 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f44fc078c60 0x7f44fc07b170 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f451c15e040 tx=0x7f450c007970 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.451+0000 7f23c1600640 1 --2- 172.21.15.42:0/2022851819 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f23a4078b90 0x7f23a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.451+0000 7f23c1600640 1 -- 172.21.15.42:0/2022851819 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f23b009b860 con 0x7f23c4147910 2024-09-17T01:32:14.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.451+0000 7f23c9600640 1 --2- 172.21.15.42:0/2022851819 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f23a4078b90 0x7f23a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.452+0000 7f4521200640 1 --2- 172.21.15.42:0/3020667107 >> [v2:172.21.15.42:6808/940657160,v1:172.21.15.42:6809/940657160] conn(0x7f44fc080f30 0x7f44fc083380 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.452+0000 7f23c1600640 1 --2- 172.21.15.42:0/2022851819 >> [v2:172.21.15.43:6826/3742263700,v1:172.21.15.43:6827/3742263700] conn(0x7f23a4080e00 0x7f23a4083250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.452+0000 7f045fe00640 1 -- 172.21.15.42:0/1887282924 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0450043070 con 0x7f0468072e00 2024-09-17T01:32:14.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.452+0000 7f23c1600640 1 -- 172.21.15.42:0/2022851819 --> [v2:172.21.15.43:6826/3742263700,v1:172.21.15.43:6827/3742263700] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f23b0009030 con 0x7f23a4080e00 2024-09-17T01:32:14.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.452+0000 7f23c1600640 1 -- 172.21.15.42:0/2022851819 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f23b00a02a0 con 0x7f23c4147910 2024-09-17T01:32:14.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.453+0000 7f23ca000640 1 --2- 172.21.15.42:0/2022851819 >> [v2:172.21.15.43:6826/3742263700,v1:172.21.15.43:6827/3742263700] conn(0x7f23a4080e00 0x7f23a4083250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.454+0000 7f23c9600640 1 --2- 172.21.15.42:0/2022851819 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f23a4078b90 0x7f23a407b0a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f23b8034000 tx=0x7f23b8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.454+0000 7f4513e00640 1 -- 172.21.15.42:0/3020667107 <== osd.3 v2:172.21.15.42:6808/940657160 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4514004e50 con 0x7f44fc080f30 2024-09-17T01:32:14.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.454+0000 7f045fe00640 1 --2- 172.21.15.42:0/1887282924 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0444078c10 0x7f044407b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.454+0000 7f045fe00640 1 -- 172.21.15.42:0/1887282924 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f04500bbf80 con 0x7f0468072e00 2024-09-17T01:32:14.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.455+0000 7f045fe00640 1 --2- 172.21.15.42:0/1887282924 >> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] conn(0x7f0444080e80 0x7f04440832d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.455+0000 7f045fe00640 1 -- 172.21.15.42:0/1887282924 --> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0450005550 con 0x7f0444080e80 2024-09-17T01:32:14.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.455+0000 7f045fe00640 1 -- 172.21.15.42:0/1887282924 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f04500bc330 con 0x7f0468072e00 2024-09-17T01:32:14.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.455+0000 7f0467400640 1 --2- 172.21.15.42:0/1887282924 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0444078c10 0x7f044407b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.455+0000 7f23ca000640 1 --2- 172.21.15.42:0/2022851819 >> [v2:172.21.15.43:6826/3742263700,v1:172.21.15.43:6827/3742263700] conn(0x7f23a4080e00 0x7f23a4083250 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.456+0000 7f0467e00640 1 --2- 172.21.15.42:0/1887282924 >> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] conn(0x7f0444080e80 0x7f04440832d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.456+0000 7f0467400640 1 --2- 172.21.15.42:0/1887282924 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0444078c10 0x7f044407b120 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0458009fa0 tx=0x7f0458009570 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.457+0000 7f23c1600640 1 -- 172.21.15.42:0/2022851819 <== osd.6 v2:172.21.15.43:6826/3742263700 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f23b0009030 con 0x7f23a4080e00 2024-09-17T01:32:14.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.457+0000 7f0467e00640 1 --2- 172.21.15.42:0/1887282924 >> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] conn(0x7f0444080e80 0x7f04440832d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.458+0000 7f045fe00640 1 -- 172.21.15.42:0/1887282924 <== osd.7 v2:172.21.15.43:6810/859332009 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0450005550 con 0x7f0444080e80 2024-09-17T01:32:14.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.462+0000 7fabc2200640 1 -- 172.21.15.42:0/1323169578 --> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fabb40dfd30 con 0x7fab9c080de0 2024-09-17T01:32:14.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.463+0000 7fabb8c00640 1 -- 172.21.15.42:0/1323169578 <== osd.1 v2:172.21.15.42:6824/4073532812 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fabb40dfd30 con 0x7fab9c080de0 2024-09-17T01:32:14.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.463+0000 7fabc2200640 1 -- 172.21.15.42:0/1323169578 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x7fab9c080de0 msgr2=0x7fab9c083230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.463+0000 7fabc2200640 1 --2- 172.21.15.42:0/1323169578 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x7fab9c080de0 0x7fab9c083230 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.466+0000 7fabc2200640 1 -- 172.21.15.42:0/1323169578 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fab9c078b90 msgr2=0x7fab9c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.466+0000 7fabc2200640 1 --2- 172.21.15.42:0/1323169578 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fab9c078b90 0x7fab9c07b0a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fabb0032000 tx=0x7fabb0004730 comp rx=0 tx=0).stop 2024-09-17T01:32:14.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.466+0000 7fabc2200640 1 -- 172.21.15.42:0/1323169578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fabb4009ba0 msgr2=0x7fabb401e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.466+0000 7fabc2200640 1 --2- 172.21.15.42:0/1323169578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fabb4009ba0 0x7fabb401e410 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7faba800c410 tx=0x7faba800c8d0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.466+0000 7fabc1800640 1 -- 172.21.15.42:0/1323169578 reap_dead start 2024-09-17T01:32:14.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.466+0000 7fc606e00640 1 -- 172.21.15.42:0/870561998 --> [v2:172.21.15.42:6816/2631717588,v1:172.21.15.42:6817/2631717588] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc6000cd8c0 con 0x7fc5e0080ed0 2024-09-17T01:32:14.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.467+0000 7fabc2200640 1 -- 172.21.15.42:0/1323169578 shutdown_connections 2024-09-17T01:32:14.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.467+0000 7fabc2200640 1 -- 172.21.15.42:0/1323169578 >> 172.21.15.42:0/1323169578 conn(0x7fabb4051420 msgr2=0x7fabb40546b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:14.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.467+0000 7fabc2200640 1 -- 172.21.15.42:0/1323169578 shutdown_connections 2024-09-17T01:32:14.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.467+0000 7fabc2200640 1 -- 172.21.15.42:0/1323169578 wait complete. 2024-09-17T01:32:14.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.467+0000 7fc5fd600640 1 -- 172.21.15.42:0/870561998 <== osd.2 v2:172.21.15.42:6816/2631717588 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc6000cd8c0 con 0x7fc5e0080ed0 2024-09-17T01:32:14.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.468+0000 7f039cc00640 1 -- 172.21.15.42:0/2294364638 --> [v2:172.21.15.42:6800/1232300261,v1:172.21.15.42:6801/1232300261] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0374002dd0 con 0x7f0378080d80 2024-09-17T01:32:14.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.468+0000 7fc606e00640 1 -- 172.21.15.42:0/870561998 >> [v2:172.21.15.42:6816/2631717588,v1:172.21.15.42:6817/2631717588] conn(0x7fc5e0080ed0 msgr2=0x7fc5e0083320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.468+0000 7fc606e00640 1 --2- 172.21.15.42:0/870561998 >> [v2:172.21.15.42:6816/2631717588,v1:172.21.15.42:6817/2631717588] conn(0x7fc5e0080ed0 0x7fc5e0083320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.468+0000 7fc606e00640 1 -- 172.21.15.42:0/870561998 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc5e0078c60 msgr2=0x7fc5e007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.468+0000 7fc606e00640 1 --2- 172.21.15.42:0/870561998 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc5e0078c60 0x7fc5e007b170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc600075150 tx=0x7fc5f4008040 comp rx=0 tx=0).stop 2024-09-17T01:32:14.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.468+0000 7fc606e00640 1 -- 172.21.15.42:0/870561998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc60006d260 msgr2=0x7fc6000cbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.468+0000 7fc606e00640 1 --2- 172.21.15.42:0/870561998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc60006d260 0x7fc6000cbfe0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc5f802b040 tx=0x7fc5f8003f10 comp rx=0 tx=0).stop 2024-09-17T01:32:14.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.468+0000 7fc606400640 1 -- 172.21.15.42:0/870561998 reap_dead start 2024-09-17T01:32:14.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.469+0000 7fc606e00640 1 -- 172.21.15.42:0/870561998 shutdown_connections 2024-09-17T01:32:14.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.469+0000 7fc606e00640 1 -- 172.21.15.42:0/870561998 >> 172.21.15.42:0/870561998 conn(0x7fc6000b25f0 msgr2=0x7fc6000ca640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:14.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.469+0000 7fc606e00640 1 -- 172.21.15.42:0/870561998 shutdown_connections 2024-09-17T01:32:14.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.469+0000 7fc606e00640 1 -- 172.21.15.42:0/870561998 wait complete. 2024-09-17T01:32:14.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.469+0000 7f038b400640 1 -- 172.21.15.42:0/2294364638 <== osd.0 v2:172.21.15.42:6800/1232300261 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0374002dd0 con 0x7f0378080d80 2024-09-17T01:32:14.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.470+0000 7f039cc00640 1 -- 172.21.15.42:0/2294364638 >> [v2:172.21.15.42:6800/1232300261,v1:172.21.15.42:6801/1232300261] conn(0x7f0378080d80 msgr2=0x7f03780831d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.470+0000 7f039cc00640 1 --2- 172.21.15.42:0/2294364638 >> [v2:172.21.15.42:6800/1232300261,v1:172.21.15.42:6801/1232300261] conn(0x7f0378080d80 0x7f03780831d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.470+0000 7f039cc00640 1 -- 172.21.15.42:0/2294364638 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0378078b90 msgr2=0x7f037807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.470+0000 7f039cc00640 1 --2- 172.21.15.42:0/2294364638 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0378078b90 0x7f037807b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f039802ebd0 tx=0x7f039806c0c0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.470+0000 7f039cc00640 1 -- 172.21.15.42:0/2294364638 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0390009ba0 msgr2=0x7f03900d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.470+0000 7f039cc00640 1 --2- 172.21.15.42:0/2294364638 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0390009ba0 0x7f03900d18c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f038c00c4d0 tx=0x7f038c00c990 comp rx=0 tx=0).stop 2024-09-17T01:32:14.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.471+0000 7f0397e00640 1 -- 172.21.15.42:0/2294364638 reap_dead start 2024-09-17T01:32:14.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.472+0000 7f039cc00640 1 -- 172.21.15.42:0/2294364638 shutdown_connections 2024-09-17T01:32:14.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.472+0000 7f039cc00640 1 -- 172.21.15.42:0/2294364638 >> 172.21.15.42:0/2294364638 conn(0x7f0390051420 msgr2=0x7f039001cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:14.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.472+0000 7f039cc00640 1 -- 172.21.15.42:0/2294364638 shutdown_connections 2024-09-17T01:32:14.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.472+0000 7f039cc00640 1 -- 172.21.15.42:0/2294364638 wait complete. 2024-09-17T01:32:14.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.477+0000 7f9be2200640 1 -- 172.21.15.42:0/2190422788 --> [v2:172.21.15.43:6818/3453529013,v1:172.21.15.43:6819/3453529013] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9bdc15e360 con 0x7f9bbc081a90 2024-09-17T01:32:14.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.477+0000 7f9bd3400640 1 -- 172.21.15.42:0/2190422788 <== osd.4 v2:172.21.15.43:6818/3453529013 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9bdc15e360 con 0x7f9bbc081a90 2024-09-17T01:32:14.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.478+0000 7f9be2200640 1 -- 172.21.15.42:0/2190422788 >> [v2:172.21.15.43:6818/3453529013,v1:172.21.15.43:6819/3453529013] conn(0x7f9bbc081a90 msgr2=0x7f9bbc083f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.478+0000 7f9be2200640 1 --2- 172.21.15.42:0/2190422788 >> [v2:172.21.15.43:6818/3453529013,v1:172.21.15.43:6819/3453529013] conn(0x7f9bbc081a90 0x7f9bbc083f80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.479+0000 7f9be2200640 1 -- 172.21.15.42:0/2190422788 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9bbc078c10 msgr2=0x7f9bbc07b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.479+0000 7f9be2200640 1 --2- 172.21.15.42:0/2190422788 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9bbc078c10 0x7f9bbc07b120 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc0d0fc0 tx=0x7f9bcc005f90 comp rx=0 tx=0).stop 2024-09-17T01:32:14.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.479+0000 7f9be2200640 1 -- 172.21.15.42:0/2190422788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bdc0b1ac0 msgr2=0x7f9bdc0b0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.479+0000 7f9be2200640 1 --2- 172.21.15.42:0/2190422788 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bdc0b1ac0 0x7f9bdc0b0880 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4000f80 tx=0x7f9bd4032db0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.479+0000 7f9bdbe00640 1 -- 172.21.15.42:0/2190422788 reap_dead start 2024-09-17T01:32:14.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.483+0000 7f9be2200640 1 -- 172.21.15.42:0/2190422788 shutdown_connections 2024-09-17T01:32:14.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.483+0000 7f9be2200640 1 -- 172.21.15.42:0/2190422788 >> 172.21.15.42:0/2190422788 conn(0x7f9bdc0b1f40 msgr2=0x7f9bdc155500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:14.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.483+0000 7f9be2200640 1 -- 172.21.15.42:0/2190422788 shutdown_connections 2024-09-17T01:32:14.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.483+0000 7f9be2200640 1 -- 172.21.15.42:0/2190422788 wait complete. 2024-09-17T01:32:14.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.482+0000 7fbd29600640 1 -- 172.21.15.42:0/2043430413 --> [v2:172.21.15.43:6802/3469876255,v1:172.21.15.43:6803/3469876255] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbd0c002dd0 con 0x7fbd18080f30 2024-09-17T01:32:14.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.483+0000 7fbd2be00640 1 -- 172.21.15.42:0/2043430413 <== osd.5 v2:172.21.15.43:6802/3469876255 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbd0c002dd0 con 0x7fbd18080f30 2024-09-17T01:32:14.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.486+0000 7fbd29600640 1 -- 172.21.15.42:0/2043430413 >> [v2:172.21.15.43:6802/3469876255,v1:172.21.15.43:6803/3469876255] conn(0x7fbd18080f30 msgr2=0x7fbd18083380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.486+0000 7fbd29600640 1 --2- 172.21.15.42:0/2043430413 >> [v2:172.21.15.43:6802/3469876255,v1:172.21.15.43:6803/3469876255] conn(0x7fbd18080f30 0x7fbd18083380 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.486+0000 7f046e000640 1 -- 172.21.15.42:0/1887282924 --> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f04681f56f0 con 0x7f0444080e80 2024-09-17T01:32:14.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.486+0000 7fbd29600640 1 -- 172.21.15.42:0/2043430413 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd18078c60 msgr2=0x7fbd1807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.486+0000 7fbd29600640 1 --2- 172.21.15.42:0/2043430413 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd18078c60 0x7fbd1807b170 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbd24009910 tx=0x7fbd24004730 comp rx=0 tx=0).stop 2024-09-17T01:32:14.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.486+0000 7fbd29600640 1 -- 172.21.15.42:0/2043430413 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd30036b10 msgr2=0x7fbd30035220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.486+0000 7fbd29600640 1 --2- 172.21.15.42:0/2043430413 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd30036b10 0x7fbd30035220 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c00b3e0 tx=0x7fbd2c00b8a0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.486+0000 7fbd3d000640 1 -- 172.21.15.42:0/2043430413 reap_dead start 2024-09-17T01:32:14.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.486+0000 7fbd29600640 1 -- 172.21.15.42:0/2043430413 shutdown_connections 2024-09-17T01:32:14.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.486+0000 7fbd29600640 1 -- 172.21.15.42:0/2043430413 >> 172.21.15.42:0/2043430413 conn(0x7fbd30051420 msgr2=0x7fbd30052360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:14.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.486+0000 7f045fe00640 1 -- 172.21.15.42:0/1887282924 <== osd.7 v2:172.21.15.43:6810/859332009 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0450005550 con 0x7f0444080e80 2024-09-17T01:32:14.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.486+0000 7fbd29600640 1 -- 172.21.15.42:0/2043430413 shutdown_connections 2024-09-17T01:32:14.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.486+0000 7fbd29600640 1 -- 172.21.15.42:0/2043430413 wait complete. 2024-09-17T01:32:14.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.487+0000 7f046e000640 1 -- 172.21.15.42:0/1887282924 >> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] conn(0x7f0444080e80 msgr2=0x7f04440832d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.487+0000 7f046e000640 1 --2- 172.21.15.42:0/1887282924 >> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] conn(0x7f0444080e80 0x7f04440832d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.487+0000 7f046e000640 1 -- 172.21.15.42:0/1887282924 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0444078c10 msgr2=0x7f044407b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.487+0000 7f046e000640 1 --2- 172.21.15.42:0/1887282924 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0444078c10 0x7f044407b120 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0458009fa0 tx=0x7f0458009570 comp rx=0 tx=0).stop 2024-09-17T01:32:14.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.487+0000 7f046e000640 1 -- 172.21.15.42:0/1887282924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0468072e00 msgr2=0x7f04681544a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.487+0000 7f046e000640 1 --2- 172.21.15.42:0/1887282924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0468072e00 0x7f04681544a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0450034040 tx=0x7f04500317d0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.488+0000 7f23cc000640 1 -- 172.21.15.42:0/2022851819 --> [v2:172.21.15.43:6826/3742263700,v1:172.21.15.43:6827/3742263700] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f23c415f630 con 0x7f23a4080e00 2024-09-17T01:32:14.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.488+0000 7f0467e00640 1 -- 172.21.15.42:0/1887282924 reap_dead start 2024-09-17T01:32:14.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.488+0000 7f4521c00640 1 -- 172.21.15.42:0/3020667107 --> [v2:172.21.15.42:6808/940657160,v1:172.21.15.42:6809/940657160] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f451c15f1f0 con 0x7f44fc080f30 2024-09-17T01:32:14.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.488+0000 7f046e000640 1 -- 172.21.15.42:0/1887282924 shutdown_connections 2024-09-17T01:32:14.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.488+0000 7f046e000640 1 -- 172.21.15.42:0/1887282924 >> 172.21.15.42:0/1887282924 conn(0x7f04680b2930 msgr2=0x7f04680cd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:14.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.488+0000 7f046e000640 1 -- 172.21.15.42:0/1887282924 shutdown_connections 2024-09-17T01:32:14.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.489+0000 7f23c1600640 1 -- 172.21.15.42:0/2022851819 <== osd.6 v2:172.21.15.43:6826/3742263700 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f23c415f630 con 0x7f23a4080e00 2024-09-17T01:32:14.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.489+0000 7f046e000640 1 -- 172.21.15.42:0/1887282924 wait complete. 2024-09-17T01:32:14.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.489+0000 7f23cc000640 1 -- 172.21.15.42:0/2022851819 >> [v2:172.21.15.43:6826/3742263700,v1:172.21.15.43:6827/3742263700] conn(0x7f23a4080e00 msgr2=0x7f23a4083250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.489+0000 7f23cc000640 1 --2- 172.21.15.42:0/2022851819 >> [v2:172.21.15.43:6826/3742263700,v1:172.21.15.43:6827/3742263700] conn(0x7f23a4080e00 0x7f23a4083250 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.489+0000 7f4513e00640 1 -- 172.21.15.42:0/3020667107 <== osd.3 v2:172.21.15.42:6808/940657160 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f451c15f1f0 con 0x7f44fc080f30 2024-09-17T01:32:14.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.490+0000 7f23cc000640 1 -- 172.21.15.42:0/2022851819 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f23a4078b90 msgr2=0x7f23a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.490+0000 7f23cc000640 1 --2- 172.21.15.42:0/2022851819 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f23a4078b90 0x7f23a407b0a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f23b8034000 tx=0x7f23b8004730 comp rx=0 tx=0).stop 2024-09-17T01:32:14.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.490+0000 7f23cc000640 1 -- 172.21.15.42:0/2022851819 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23c4147910 msgr2=0x7f23c413a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.490+0000 7f23cc000640 1 --2- 172.21.15.42:0/2022851819 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23c4147910 0x7f23c413a670 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f23b000e790 tx=0x7f23b000ec50 comp rx=0 tx=0).stop 2024-09-17T01:32:14.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.490+0000 7f23ca000640 1 -- 172.21.15.42:0/2022851819 reap_dead start 2024-09-17T01:32:14.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.490+0000 7f23cc000640 1 -- 172.21.15.42:0/2022851819 shutdown_connections 2024-09-17T01:32:14.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.490+0000 7f23cc000640 1 -- 172.21.15.42:0/2022851819 >> 172.21.15.42:0/2022851819 conn(0x7f23c406d350 msgr2=0x7f23c413dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:14.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.492+0000 7f23cc000640 1 -- 172.21.15.42:0/2022851819 shutdown_connections 2024-09-17T01:32:14.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.492+0000 7f23cc000640 1 -- 172.21.15.42:0/2022851819 wait complete. 2024-09-17T01:32:14.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.492+0000 7f4521c00640 1 -- 172.21.15.42:0/3020667107 >> [v2:172.21.15.42:6808/940657160,v1:172.21.15.42:6809/940657160] conn(0x7f44fc080f30 msgr2=0x7f44fc083380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.493+0000 7f4521c00640 1 --2- 172.21.15.42:0/3020667107 >> [v2:172.21.15.42:6808/940657160,v1:172.21.15.42:6809/940657160] conn(0x7f44fc080f30 0x7f44fc083380 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.493+0000 7f4521c00640 1 -- 172.21.15.42:0/3020667107 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f44fc078c60 msgr2=0x7f44fc07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.493+0000 7f4521c00640 1 --2- 172.21.15.42:0/3020667107 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f44fc078c60 0x7f44fc07b170 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f451c15e040 tx=0x7f450c007970 comp rx=0 tx=0).stop 2024-09-17T01:32:14.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.493+0000 7f4521c00640 1 -- 172.21.15.42:0/3020667107 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f451c0d0d20 msgr2=0x7f451c15e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.493+0000 7f4521c00640 1 --2- 172.21.15.42:0/3020667107 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f451c0d0d20 0x7f451c15e0b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f451400c7c0 tx=0x7f451400cc80 comp rx=0 tx=0).stop 2024-09-17T01:32:14.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.493+0000 7f4521200640 1 -- 172.21.15.42:0/3020667107 reap_dead start 2024-09-17T01:32:14.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.494+0000 7f4521c00640 1 -- 172.21.15.42:0/3020667107 shutdown_connections 2024-09-17T01:32:14.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.494+0000 7f4521c00640 1 -- 172.21.15.42:0/3020667107 >> 172.21.15.42:0/3020667107 conn(0x7f451c06cd20 msgr2=0x7f451c161630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:14.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.495+0000 7f4521c00640 1 -- 172.21.15.42:0/3020667107 shutdown_connections 2024-09-17T01:32:14.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.495+0000 7f4521c00640 1 -- 172.21.15.42:0/3020667107 wait complete. 2024-09-17T01:32:14.508 INFO:teuthology.orchestra.run.smithi042.stdout:64424509445 2024-09-17T01:32:14.508 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T01:32:14.509 INFO:teuthology.orchestra.run.smithi042.stdout:68719476743 2024-09-17T01:32:14.510 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T01:32:14.511 INFO:teuthology.orchestra.run.smithi042.stdout:64424509447 2024-09-17T01:32:14.511 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T01:32:14.515 INFO:teuthology.orchestra.run.smithi042.stdout:64424509446 2024-09-17T01:32:14.516 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T01:32:14.524 INFO:teuthology.orchestra.run.smithi042.stdout:64424509445 2024-09-17T01:32:14.524 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T01:32:14.530 INFO:teuthology.orchestra.run.smithi042.stdout:64424509446 2024-09-17T01:32:14.531 INFO:teuthology.orchestra.run.smithi042.stdout:60129542152 2024-09-17T01:32:14.531 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T01:32:14.532 INFO:teuthology.orchestra.run.smithi042.stdout:64424509446 2024-09-17T01:32:14.532 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T01:32:14.533 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T01:32:14.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.889+0000 7f7f8c600640 1 -- 172.21.15.42:0/1557608299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f6c004800 msgr2=0x7f7f6c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.889+0000 7f7f8c600640 1 --2- 172.21.15.42:0/1557608299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f6c004800 0x7f7f6c004c10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7f7800c6e0 tx=0x7f7f6c005830 comp rx=0 tx=0).stop 2024-09-17T01:32:14.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.889+0000 7f7f8a600640 1 -- 172.21.15.42:0/1557608299 reap_dead start 2024-09-17T01:32:14.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.889+0000 7f7f8c600640 1 -- 172.21.15.42:0/1557608299 shutdown_connections 2024-09-17T01:32:14.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.890+0000 7f7f8c600640 1 -- 172.21.15.42:0/1557608299 >> 172.21.15.42:0/1557608299 conn(0x7f7f7c00e400 msgr2=0x7f7f7c00e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:14.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.890+0000 7f7f8c600640 1 -- 172.21.15.42:0/1557608299 shutdown_connections 2024-09-17T01:32:14.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.890+0000 7f7f8c600640 1 -- 172.21.15.42:0/1557608299 wait complete. 2024-09-17T01:32:14.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.892+0000 7f7b3ee00640 1 -- 172.21.15.42:0/4109940054 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7b30009ba0 msgr2=0x7f7b30005cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.892+0000 7f7b3ee00640 1 --2- 172.21.15.42:0/4109940054 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7b30009ba0 0x7f7b30005cb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7b24005fd0 tx=0x7f7b2402b7f0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.892+0000 7f7b3ee00640 1 -- 172.21.15.42:0/4109940054 shutdown_connections 2024-09-17T01:32:14.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.892+0000 7f7b3ee00640 1 --2- 172.21.15.42:0/4109940054 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7b30009ba0 0x7f7b30005cb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.892+0000 7f7b3ee00640 1 --2- 172.21.15.42:0/4109940054 >> v2:172.21.15.43:3300/0 conn(0x7f7b3000bc30 0x7f7b300df180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.892+0000 7f7b3ee00640 1 -- 172.21.15.42:0/4109940054 >> 172.21.15.42:0/4109940054 conn(0x7f7b30051420 msgr2=0x7f7b30051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:14.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.893+0000 7f7b3ee00640 1 -- 172.21.15.42:0/4109940054 shutdown_connections 2024-09-17T01:32:14.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.893+0000 7f7b3ee00640 1 -- 172.21.15.42:0/4109940054 wait complete. 2024-09-17T01:32:14.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.894+0000 7f4e81000640 1 -- 172.21.15.42:0/2360428746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e7c162fc0 msgr2=0x7f4e7c0d1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.894+0000 7f4e81000640 1 --2- 172.21.15.42:0/2360428746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e7c162fc0 0x7f4e7c0d1470 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4e64005fd0 tx=0x7f4e6402a5f0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.895+0000 7f4e81000640 1 -- 172.21.15.42:0/2360428746 shutdown_connections 2024-09-17T01:32:14.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.895+0000 7f4e81000640 1 --2- 172.21.15.42:0/2360428746 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4e7c0d19b0 0x7f4e7c0d3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.895+0000 7f4e81000640 1 --2- 172.21.15.42:0/2360428746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e7c162fc0 0x7f4e7c0d1470 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.895+0000 7f4e81000640 1 -- 172.21.15.42:0/2360428746 >> 172.21.15.42:0/2360428746 conn(0x7f4e7c06cf00 msgr2=0x7f4e7c06d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:14.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.895+0000 7f7f8c600640 1 Processor -- start 2024-09-17T01:32:14.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.896+0000 7f7f8c600640 1 -- start start 2024-09-17T01:32:14.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.896+0000 7f4e81000640 1 -- 172.21.15.42:0/2360428746 shutdown_connections 2024-09-17T01:32:14.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.897+0000 7f7b3ee00640 1 Processor -- start 2024-09-17T01:32:14.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.897+0000 7f4e81000640 1 -- 172.21.15.42:0/2360428746 wait complete. 2024-09-17T01:32:14.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.899+0000 7f7f8c600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f6c004800 0x7f7f7c0e0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.899+0000 7f7f8c600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f7c17a050 0x7f7f7c17a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.900+0000 7f7f8c600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7f7c0e3010 0x7f7f7c0e3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.897+0000 7f7b3ee00640 1 -- start start 2024-09-17T01:32:14.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.900+0000 7f7b3ee00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b30009ba0 0x7f7b301814e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.900+0000 7f7b3ee00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7b3000bc30 0x7f7b300479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.900+0000 7f7b3ee00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b3001c5b0 0x7f7b30181bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.900+0000 7f7b3ee00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7b30036400 con 0x7f7b30009ba0 2024-09-17T01:32:14.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.900+0000 7f7b3ee00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3001d2e0 con 0x7f7b3001c5b0 2024-09-17T01:32:14.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.900+0000 7f7b3ee00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7b30036580 con 0x7f7b3000bc30 2024-09-17T01:32:14.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.901+0000 7f4e81000640 1 Processor -- start 2024-09-17T01:32:14.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.901+0000 7f7b3d000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7b3000bc30 0x7f7b300479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.901+0000 7f7b3e400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b3001c5b0 0x7f7b30181bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.901+0000 7f7b3da00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b30009ba0 0x7f7b301814e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.901+0000 7f7b3d000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7b3000bc30 0x7f7b300479e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:33458/0 (socket says 172.21.15.42:33458) 2024-09-17T01:32:14.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.901+0000 7f7b3d000640 1 -- 172.21.15.42:0/3468738221 learned_addr learned my addr 172.21.15.42:0/3468738221 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:14.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.901+0000 7f7f8c600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c03c0b0 con 0x7f7f6c004800 2024-09-17T01:32:14.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.901+0000 7f4e81000640 1 -- start start 2024-09-17T01:32:14.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.901+0000 7f7f89200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f7c17a050 0x7f7f7c17a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.902+0000 7f7f89200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f7c17a050 0x7f7f7c17a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:35824/0 (socket says 172.21.15.42:35824) 2024-09-17T01:32:14.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.902+0000 7f7f89200640 1 -- 172.21.15.42:0/136363992 learned_addr learned my addr 172.21.15.42:0/136363992 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:14.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.902+0000 7f7f89c00640 1 --2- 172.21.15.42:0/136363992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f6c004800 0x7f7f7c0e0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.902+0000 7f7b3d000640 1 -- 172.21.15.42:0/3468738221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b3001c5b0 msgr2=0x7f7b30181bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.902+0000 7f7b3d000640 1 --2- 172.21.15.42:0/3468738221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b3001c5b0 0x7f7b30181bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.902+0000 7f7b3d000640 1 -- 172.21.15.42:0/3468738221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b30009ba0 msgr2=0x7f7b301814e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.902+0000 7f7b3d000640 1 --2- 172.21.15.42:0/3468738221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b30009ba0 0x7f7b301814e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.902+0000 7f7b3d000640 1 -- 172.21.15.42:0/3468738221 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b3017f7a0 con 0x7f7b3000bc30 2024-09-17T01:32:14.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.903+0000 7f7f8c600640 1 -- 172.21.15.42:0/136363992 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c037f40 con 0x7f7f7c17a050 2024-09-17T01:32:14.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.903+0000 7f7f8c600640 1 -- 172.21.15.42:0/136363992 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7f7c03c230 con 0x7f7f7c0e3010 2024-09-17T01:32:14.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.903+0000 7f7f8a600640 1 --2- 172.21.15.42:0/136363992 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7f7c0e3010 0x7f7f7c0e3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.903+0000 7f7f8a600640 1 -- 172.21.15.42:0/136363992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f7c17a050 msgr2=0x7f7f7c17a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.904+0000 7f7f8a600640 1 --2- 172.21.15.42:0/136363992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f7c17a050 0x7f7f7c17a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.904+0000 7f7f8a600640 1 -- 172.21.15.42:0/136363992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f6c004800 msgr2=0x7f7f7c0e0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.904+0000 7f7f8a600640 1 --2- 172.21.15.42:0/136363992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f6c004800 0x7f7f7c0e0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.904+0000 7f7f8a600640 1 -- 172.21.15.42:0/136363992 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f7c0e3960 con 0x7f7f7c0e3010 2024-09-17T01:32:14.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.904+0000 7f7b3d000640 1 --2- 172.21.15.42:0/3468738221 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7b3000bc30 0x7f7b300479e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7b24036040 tx=0x7f7b240035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.904+0000 7f7f89c00640 1 --2- 172.21.15.42:0/136363992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f6c004800 0x7f7f7c0e0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:14.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.904+0000 7f7f8a600640 1 --2- 172.21.15.42:0/136363992 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7f7c0e3010 0x7f7f7c0e3420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7f8406c1a0 tx=0x7f7f8406b2f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.904+0000 7f7f81600640 1 -- 172.21.15.42:0/136363992 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84094070 con 0x7f7f7c0e3010 2024-09-17T01:32:14.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.904+0000 7f7b35600640 1 -- 172.21.15.42:0/3468738221 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b24042020 con 0x7f7b3000bc30 2024-09-17T01:32:14.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.904+0000 7f7f81600640 1 -- 172.21.15.42:0/136363992 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f840755c0 con 0x7f7f7c0e3010 2024-09-17T01:32:14.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.904+0000 7f7f8c600640 1 -- 172.21.15.42:0/136363992 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f7c0e15c0 con 0x7f7f7c0e3010 2024-09-17T01:32:14.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.905+0000 7f7b35600640 1 -- 172.21.15.42:0/3468738221 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b24003ab0 con 0x7f7b3000bc30 2024-09-17T01:32:14.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.905+0000 7f7b35600640 1 -- 172.21.15.42:0/3468738221 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b24042020 con 0x7f7b3000bc30 2024-09-17T01:32:14.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.905+0000 7f7b3ee00640 1 -- 172.21.15.42:0/3468738221 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b300de550 con 0x7f7b3000bc30 2024-09-17T01:32:14.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.905+0000 7f4e81000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4e7c0b34d0 0x7f4e7c157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.905+0000 7f7f81600640 1 -- 172.21.15.42:0/136363992 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84073ae0 con 0x7f7f7c0e3010 2024-09-17T01:32:14.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.905+0000 7f4e81000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e7c0d19b0 0x7f4e7c1613e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.906+0000 7f7b3ee00640 1 -- 172.21.15.42:0/3468738221 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b30020780 con 0x7f7b3000bc30 2024-09-17T01:32:14.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.906+0000 7f4e81000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e7c162fc0 0x7f4e7c201d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.906+0000 7f4e79e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4e7c0b34d0 0x7f4e7c157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.906+0000 7f4e79e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4e7c0b34d0 0x7f4e7c157d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:33486/0 (socket says 172.21.15.42:33486) 2024-09-17T01:32:14.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.906+0000 7f4e79e00640 1 -- 172.21.15.42:0/1730159749 learned_addr learned my addr 172.21.15.42:0/1730159749 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:14.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.907+0000 7fa975400640 1 -- 172.21.15.42:0/896802500 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa970073340 msgr2=0x7fa9700d2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.907+0000 7fa975400640 1 --2- 172.21.15.42:0/896802500 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa970073340 0x7fa9700d2810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa968009860 tx=0x7fa96802a3d0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.907+0000 7f4e81000640 1 -- 172.21.15.42:0/1730159749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7c0d3a60 con 0x7f4e7c162fc0 2024-09-17T01:32:14.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.907+0000 7f4e81000640 1 -- 172.21.15.42:0/1730159749 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7c0d38e0 con 0x7f4e7c0d19b0 2024-09-17T01:32:14.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.907+0000 7f4e81000640 1 -- 172.21.15.42:0/1730159749 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4e7c0d3be0 con 0x7f4e7c0b34d0 2024-09-17T01:32:14.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.907+0000 7f4e79400640 1 --2- 172.21.15.42:0/1730159749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e7c0d19b0 0x7f4e7c1613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.908+0000 7f4e7a800640 1 --2- 172.21.15.42:0/1730159749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e7c162fc0 0x7f4e7c201d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.908+0000 7f7f81600640 1 -- 172.21.15.42:0/136363992 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7f84097070 con 0x7f7f7c0e3010 2024-09-17T01:32:14.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.909+0000 7f4e7a800640 1 -- 172.21.15.42:0/1730159749 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4e7c0b34d0 msgr2=0x7f4e7c157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.909+0000 7f4e7a800640 1 --2- 172.21.15.42:0/1730159749 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4e7c0b34d0 0x7f4e7c157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.909+0000 7f4e7a800640 1 -- 172.21.15.42:0/1730159749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e7c0d19b0 msgr2=0x7f4e7c1613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.909+0000 7f4e7a800640 1 --2- 172.21.15.42:0/1730159749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e7c0d19b0 0x7f4e7c1613e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.909+0000 7f7b35600640 1 -- 172.21.15.42:0/3468738221 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7b24045020 con 0x7f7b3000bc30 2024-09-17T01:32:14.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.910+0000 7f4e7a800640 1 -- 172.21.15.42:0/1730159749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7c15b000 con 0x7f4e7c162fc0 2024-09-17T01:32:14.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.910+0000 7f4e7a800640 1 --2- 172.21.15.42:0/1730159749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e7c162fc0 0x7f4e7c201d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00b500 tx=0x7f4e6c00b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.911+0000 7f7b35600640 1 --2- 172.21.15.42:0/3468738221 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7b18078d90 0x7f7b1807b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.911+0000 7f7b35600640 1 -- 172.21.15.42:0/3468738221 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7b240b9b50 con 0x7f7b3000bc30 2024-09-17T01:32:14.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.911+0000 7f4e72000640 1 -- 172.21.15.42:0/1730159749 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c014070 con 0x7f4e7c162fc0 2024-09-17T01:32:14.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.911+0000 7f7b3ee00640 1 -- 172.21.15.42:0/3468738221 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b30000c50 con 0x7f7b3000bc30 2024-09-17T01:32:14.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.911+0000 7fa975400640 1 -- 172.21.15.42:0/896802500 shutdown_connections 2024-09-17T01:32:14.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.911+0000 7fa975400640 1 --2- 172.21.15.42:0/896802500 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa970073340 0x7fa9700d2810 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.911+0000 7f7f8c600640 1 -- 172.21.15.42:0/136363992 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f7c0e1b80 con 0x7f7f7c0e3010 2024-09-17T01:32:14.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.912+0000 7fa975400640 1 -- 172.21.15.42:0/896802500 >> 172.21.15.42:0/896802500 conn(0x7fa9700d1210 msgr2=0x7fa9700d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:14.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.912+0000 7fa975400640 1 -- 172.21.15.42:0/896802500 shutdown_connections 2024-09-17T01:32:14.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.912+0000 7fa975400640 1 -- 172.21.15.42:0/896802500 wait complete. 2024-09-17T01:32:14.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.912+0000 7f4e81000640 1 -- 172.21.15.42:0/1730159749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e7c1548b0 con 0x7f4e7c162fc0 2024-09-17T01:32:14.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.912+0000 7f4e81000640 1 -- 172.21.15.42:0/1730159749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e7c154e70 con 0x7f4e7c162fc0 2024-09-17T01:32:14.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.913+0000 7f4e72000640 1 -- 172.21.15.42:0/1730159749 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e6c010750 con 0x7f4e7c162fc0 2024-09-17T01:32:14.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.913+0000 7f4e72000640 1 -- 172.21.15.42:0/1730159749 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c010ba0 con 0x7f4e7c162fc0 2024-09-17T01:32:14.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.915+0000 7f7b3da00640 1 --2- 172.21.15.42:0/3468738221 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7b18078d90 0x7f7b1807b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.915+0000 7f7f81600640 1 --2- 172.21.15.42:0/136363992 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7f64078be0 0x7f7f6407b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.915+0000 7f7f76a00640 1 -- 172.21.15.42:0/136363992 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f7c0e0ff0 con 0x7f7f7c0e3010 2024-09-17T01:32:14.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.916+0000 7f7f89c00640 1 --2- 172.21.15.42:0/136363992 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7f64078be0 0x7f7f6407b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.916+0000 7fa975400640 1 Processor -- start 2024-09-17T01:32:14.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.916+0000 7f7f89c00640 1 --2- 172.21.15.42:0/136363992 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7f64078be0 0x7f7f6407b0f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c0119f0 tx=0x7f7f70008040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.917+0000 7fa975400640 1 -- start start 2024-09-17T01:32:14.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.917+0000 7f7b3da00640 1 --2- 172.21.15.42:0/3468738221 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7b18078d90 0x7f7b1807b2a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7b380521d0 tx=0x7f7b3806f040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.917+0000 7f4e81000640 1 -- 172.21.15.42:0/1730159749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e54005290 con 0x7f4e7c162fc0 2024-09-17T01:32:14.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.918+0000 7f7f81600640 1 -- 172.21.15.42:0/136363992 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7f840da480 con 0x7f7f7c0e3010 2024-09-17T01:32:14.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.918+0000 7f4e72000640 1 -- 172.21.15.42:0/1730159749 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4e6c017070 con 0x7f4e7c162fc0 2024-09-17T01:32:14.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.919+0000 7f7b35600640 1 -- 172.21.15.42:0/3468738221 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7b30000c50 con 0x7f7b3000bc30 2024-09-17T01:32:14.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.920+0000 7f4e72000640 1 --2- 172.21.15.42:0/1730159749 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4e58078be0 0x7f4e5807b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.920+0000 7f4e72000640 1 -- 172.21.15.42:0/1730159749 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4e6c09a830 con 0x7f4e7c162fc0 2024-09-17T01:32:14.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.921+0000 7fa975400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa970073340 0x7fa9700ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.921+0000 7f4e79e00640 1 --2- 172.21.15.42:0/1730159749 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4e58078be0 0x7f4e5807b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.921+0000 7fa975400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9700b6030 0x7fa9701568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.921+0000 7fa975400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa970162fa0 0x7fa9700b8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.921+0000 7fa975400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa97015fae0 con 0x7fa970073340 2024-09-17T01:32:14.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.922+0000 7fa975400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa97015f960 con 0x7fa9700b6030 2024-09-17T01:32:14.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.922+0000 7fa975400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa97015fc60 con 0x7fa970162fa0 2024-09-17T01:32:14.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.922+0000 7fa96fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa970073340 0x7fa9700ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.922+0000 7fa974a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa970162fa0 0x7fa9700b8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.922+0000 7fa974a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa970162fa0 0x7fa9700b8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:33494/0 (socket says 172.21.15.42:33494) 2024-09-17T01:32:14.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.922+0000 7fa974a00640 1 -- 172.21.15.42:0/2437269605 learned_addr learned my addr 172.21.15.42:0/2437269605 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:14.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.923+0000 7f4e79e00640 1 --2- 172.21.15.42:0/1730159749 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4e58078be0 0x7f4e5807b0f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4e74007fd0 tx=0x7f4e74009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.922+0000 7fa96f400640 1 --2- 172.21.15.42:0/2437269605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9700b6030 0x7fa9701568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.923+0000 7fa974a00640 1 -- 172.21.15.42:0/2437269605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9700b6030 msgr2=0x7fa9701568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.923+0000 7fa974a00640 1 --2- 172.21.15.42:0/2437269605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9700b6030 0x7fa9701568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.923+0000 7fa974a00640 1 -- 172.21.15.42:0/2437269605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa970073340 msgr2=0x7fa9700ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.923+0000 7fa974a00640 1 --2- 172.21.15.42:0/2437269605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa970073340 0x7fa9700ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.923+0000 7fa974a00640 1 -- 172.21.15.42:0/2437269605 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9701fa410 con 0x7fa970162fa0 2024-09-17T01:32:14.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.923+0000 7fa96fe00640 1 --2- 172.21.15.42:0/2437269605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa970073340 0x7fa9700ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:14.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.924+0000 7fa974a00640 1 --2- 172.21.15.42:0/2437269605 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa970162fa0 0x7fa9700b8d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa96000b9a0 tx=0x7fa96000be60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.925+0000 7f7f81600640 1 -- 172.21.15.42:0/136363992 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7f7c0e3960 con 0x7f7f7c0e3010 2024-09-17T01:32:14.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.925+0000 7fa967e00640 1 -- 172.21.15.42:0/2437269605 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa960019070 con 0x7fa970162fa0 2024-09-17T01:32:14.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.925+0000 7fa967e00640 1 -- 172.21.15.42:0/2437269605 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa96000cc90 con 0x7fa970162fa0 2024-09-17T01:32:14.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.925+0000 7fa967e00640 1 -- 172.21.15.42:0/2437269605 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9600146a0 con 0x7fa970162fa0 2024-09-17T01:32:14.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.926+0000 7fa975400640 1 -- 172.21.15.42:0/2437269605 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa970157440 con 0x7fa970162fa0 2024-09-17T01:32:14.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.926+0000 7fa975400640 1 -- 172.21.15.42:0/2437269605 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9701f6e80 con 0x7fa970162fa0 2024-09-17T01:32:14.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.929+0000 7fa975400640 1 -- 172.21.15.42:0/2437269605 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa97015e910 con 0x7fa970162fa0 2024-09-17T01:32:14.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.930+0000 7fa967e00640 1 -- 172.21.15.42:0/2437269605 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa96001c070 con 0x7fa970162fa0 2024-09-17T01:32:14.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.932+0000 7fa967e00640 1 --2- 172.21.15.42:0/2437269605 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa94c078c90 0x7fa94c07b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.932+0000 7fa967e00640 1 -- 172.21.15.42:0/2437269605 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa96009a9f0 con 0x7fa970162fa0 2024-09-17T01:32:14.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.933+0000 7fa96fe00640 1 --2- 172.21.15.42:0/2437269605 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa94c078c90 0x7fa94c07b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.933+0000 7f4e72000640 1 -- 172.21.15.42:0/1730159749 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4e6c062d70 con 0x7f4e7c162fc0 2024-09-17T01:32:14.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.934+0000 7fa96fe00640 1 --2- 172.21.15.42:0/2437269605 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa94c078c90 0x7fa94c07b1a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa968034000 tx=0x7fa968004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.936+0000 7fa967e00640 1 -- 172.21.15.42:0/2437269605 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa97015e910 con 0x7fa970162fa0 2024-09-17T01:32:14.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.981+0000 7efe84800640 1 -- 172.21.15.42:0/3831887318 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe7c0cf360 msgr2=0x7efe7c0b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.981+0000 7efe84800640 1 --2- 172.21.15.42:0/3831887318 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe7c0cf360 0x7efe7c0b3c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efe78005fd0 tx=0x7efe7802a840 comp rx=0 tx=0).stop 2024-09-17T01:32:14.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.983+0000 7efe84800640 1 -- 172.21.15.42:0/3831887318 shutdown_connections 2024-09-17T01:32:14.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.983+0000 7efe84800640 1 --2- 172.21.15.42:0/3831887318 >> v2:172.21.15.42:3300/0 conn(0x7efe7c15eb60 0x7efe7c0d11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.983+0000 7efe84800640 1 --2- 172.21.15.42:0/3831887318 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe7c0cf360 0x7efe7c0b3c80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.983+0000 7efe84800640 1 -- 172.21.15.42:0/3831887318 >> 172.21.15.42:0/3831887318 conn(0x7efe7c06cd20 msgr2=0x7efe7c06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:14.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.983+0000 7efe84800640 1 -- 172.21.15.42:0/3831887318 shutdown_connections 2024-09-17T01:32:14.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.983+0000 7efe84800640 1 -- 172.21.15.42:0/3831887318 wait complete. 2024-09-17T01:32:14.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.984+0000 7f99fbe00640 1 -- 172.21.15.42:0/2804206881 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f99f40d1670 msgr2=0x7f99f4162bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.984+0000 7f99fbe00640 1 --2- 172.21.15.42:0/2804206881 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f99f40d1670 0x7f99f4162bb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f99e8009880 tx=0x7f99e802a440 comp rx=0 tx=0).stop 2024-09-17T01:32:14.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.985+0000 7fb02f200640 1 -- 172.21.15.42:0/4111016315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb03006ff00 msgr2=0x7fb03015efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.985+0000 7fb02f200640 1 --2- 172.21.15.42:0/4111016315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb03006ff00 0x7fb03015efc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb01c009830 tx=0x7fb01c02a540 comp rx=0 tx=0).stop 2024-09-17T01:32:14.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.985+0000 7f66d1e00640 1 -- 172.21.15.42:0/2924915686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66cc0b6950 msgr2=0x7f66cc0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.985+0000 7f66d1e00640 1 --2- 172.21.15.42:0/2924915686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66cc0b6950 0x7f66cc0b32e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f66cc0d3570 tx=0x7f66b802a420 comp rx=0 tx=0).stop 2024-09-17T01:32:14.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.985+0000 7f66d1e00640 1 -- 172.21.15.42:0/2924915686 shutdown_connections 2024-09-17T01:32:14.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.985+0000 7f66d1e00640 1 --2- 172.21.15.42:0/2924915686 >> v2:172.21.15.43:3300/0 conn(0x7f66cc0d4110 0x7f66cc0cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.985+0000 7f66d1e00640 1 --2- 172.21.15.42:0/2924915686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66cc0b6950 0x7f66cc0b32e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.985+0000 7f66d1e00640 1 -- 172.21.15.42:0/2924915686 >> 172.21.15.42:0/2924915686 conn(0x7f66cc06d140 msgr2=0x7f66cc06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:14.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.985+0000 7f66d1e00640 1 -- 172.21.15.42:0/2924915686 shutdown_connections 2024-09-17T01:32:14.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.986+0000 7f66d1e00640 1 -- 172.21.15.42:0/2924915686 wait complete. 2024-09-17T01:32:14.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.985+0000 7f99fbe00640 1 -- 172.21.15.42:0/2804206881 shutdown_connections 2024-09-17T01:32:14.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.985+0000 7f99fbe00640 1 --2- 172.21.15.42:0/2804206881 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f99f40d1670 0x7f99f4162bb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.985+0000 7f99fbe00640 1 -- 172.21.15.42:0/2804206881 >> 172.21.15.42:0/2804206881 conn(0x7f99f406cd20 msgr2=0x7f99f406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:14.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.985+0000 7f99fbe00640 1 -- 172.21.15.42:0/2804206881 shutdown_connections 2024-09-17T01:32:14.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.985+0000 7f99fbe00640 1 -- 172.21.15.42:0/2804206881 wait complete. 2024-09-17T01:32:14.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.986+0000 7fb02f200640 1 -- 172.21.15.42:0/4111016315 shutdown_connections 2024-09-17T01:32:14.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.986+0000 7fb02f200640 1 --2- 172.21.15.42:0/4111016315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb03006ff00 0x7fb03015efc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.986+0000 7fb02f200640 1 -- 172.21.15.42:0/4111016315 >> 172.21.15.42:0/4111016315 conn(0x7fb0300d0110 msgr2=0x7fb0300d0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:14.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.987+0000 7fb02f200640 1 -- 172.21.15.42:0/4111016315 shutdown_connections 2024-09-17T01:32:14.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.987+0000 7fb02f200640 1 -- 172.21.15.42:0/4111016315 wait complete. 2024-09-17T01:32:14.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.987+0000 7efe84800640 1 Processor -- start 2024-09-17T01:32:14.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.988+0000 7efe84800640 1 -- start start 2024-09-17T01:32:14.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.989+0000 7f99fbe00640 1 Processor -- start 2024-09-17T01:32:14.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.989+0000 7f99fbe00640 1 -- start start 2024-09-17T01:32:14.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.990+0000 7f66d1e00640 1 Processor -- start 2024-09-17T01:32:14.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.990+0000 7f66d1e00640 1 -- start start 2024-09-17T01:32:14.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.991+0000 7efe84800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe7c0cf360 0x7efe7c15aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.991+0000 7efe84800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe7c0d1730 0x7efe7c1614e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.992+0000 7efe81e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe7c0cf360 0x7efe7c15aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.992+0000 7fb02f200640 1 Processor -- start 2024-09-17T01:32:14.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.992+0000 7efe81e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe7c0cf360 0x7efe7c15aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:33524/0 (socket says 172.21.15.42:33524) 2024-09-17T01:32:14.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.992+0000 7fb02f200640 1 -- start start 2024-09-17T01:32:14.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.992+0000 7f99fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99f40d1670 0x7f99f415b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.992+0000 7efe81e00640 1 -- 172.21.15.42:0/570448493 learned_addr learned my addr 172.21.15.42:0/570448493 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:14.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.993+0000 7efe84800640 1 --2- 172.21.15.42:0/570448493 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe7c15eb60 0x7efe7c161a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.993+0000 7f99fbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99f4155dc0 0x7f99f415b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.993+0000 7f99fbe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f99f41630f0 0x7f99f40b8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.993+0000 7f99fbe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f99f40d36a0 con 0x7f99f40d1670 2024-09-17T01:32:14.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.993+0000 7f99fbe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f99f40d3520 con 0x7f99f4155dc0 2024-09-17T01:32:14.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.993+0000 7f99fbe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f99f40d3820 con 0x7f99f41630f0 2024-09-17T01:32:14.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.993+0000 7efe84800640 1 -- 172.21.15.42:0/570448493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efe7c15f130 con 0x7efe7c0d1730 2024-09-17T01:32:14.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.993+0000 7efe84800640 1 -- 172.21.15.42:0/570448493 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efe7c15efb0 con 0x7efe7c15eb60 2024-09-17T01:32:14.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.993+0000 7efe84800640 1 -- 172.21.15.42:0/570448493 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7efe7c0b6970 con 0x7efe7c0cf360 2024-09-17T01:32:14.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.993+0000 7efe82800640 1 --2- 172.21.15.42:0/570448493 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe7c15eb60 0x7efe7c161a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.993+0000 7f66d1e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66cc0d4110 0x7f66cc157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.993+0000 7f99f8a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99f4155dc0 0x7f99f415b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.994+0000 7f99f9e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f99f41630f0 0x7f99f40b8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.994+0000 7f66d1e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66cc15f000 0x7f66cc1eab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.994+0000 7f99f9e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f99f41630f0 0x7f99f40b8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:33528/0 (socket says 172.21.15.42:33528) 2024-09-17T01:32:14.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.994+0000 7f99f9e00640 1 -- 172.21.15.42:0/2761454103 learned_addr learned my addr 172.21.15.42:0/2761454103 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:14.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.994+0000 7f99f8a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99f4155dc0 0x7f99f415b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:35862/0 (socket says 172.21.15.42:35862) 2024-09-17T01:32:14.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.994+0000 7f66d1e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f66cc1f65a0 0x7f66cc158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:14.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.994+0000 7efe82800640 1 -- 172.21.15.42:0/570448493 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe7c0cf360 msgr2=0x7efe7c15aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.994+0000 7f66caa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66cc0d4110 0x7f66cc157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.994+0000 7f66d1e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc0d27a0 con 0x7f66cc0d4110 2024-09-17T01:32:14.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.994+0000 7f66caa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66cc0d4110 0x7f66cc157f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50570/0 (socket says 172.21.15.42:50570) 2024-09-17T01:32:14.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.994+0000 7f66ca000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66cc15f000 0x7f66cc1eab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.994+0000 7f66d1e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc0d2620 con 0x7f66cc15f000 2024-09-17T01:32:14.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.995+0000 7f66d1e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f66cc0d2920 con 0x7f66cc1f65a0 2024-09-17T01:32:14.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.995+0000 7f66cb400640 1 --2- 172.21.15.42:0/3074341678 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f66cc1f65a0 0x7f66cc158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.994+0000 7efe82800640 1 --2- 172.21.15.42:0/570448493 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe7c0cf360 0x7efe7c15aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.995+0000 7f66caa00640 1 -- 172.21.15.42:0/3074341678 learned_addr learned my addr 172.21.15.42:0/3074341678 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:14.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.995+0000 7f99f9400640 1 --2- 172.21.15.42:0/2761454103 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99f40d1670 0x7f99f415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:14.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.994+0000 7efe82800640 1 -- 172.21.15.42:0/570448493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe7c0d1730 msgr2=0x7efe7c1614e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.994+0000 7efe82800640 1 --2- 172.21.15.42:0/570448493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe7c0d1730 0x7efe7c1614e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.995+0000 7f99f9e00640 1 -- 172.21.15.42:0/2761454103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99f4155dc0 msgr2=0x7f99f415b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.995+0000 7f99f9e00640 1 --2- 172.21.15.42:0/2761454103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99f4155dc0 0x7f99f415b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.995+0000 7f99f9e00640 1 -- 172.21.15.42:0/2761454103 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99f40d1670 msgr2=0x7f99f415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:14.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.994+0000 7efe82800640 1 -- 172.21.15.42:0/570448493 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe7c15afe0 con 0x7efe7c15eb60 2024-09-17T01:32:14.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.995+0000 7f99f9e00640 1 --2- 172.21.15.42:0/2761454103 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99f40d1670 0x7f99f415b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:14.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.995+0000 7f99f9e00640 1 -- 172.21.15.42:0/2761454103 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f40ce180 con 0x7f99f41630f0 2024-09-17T01:32:14.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.996+0000 7efe82800640 1 --2- 172.21.15.42:0/570448493 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe7c15eb60 0x7efe7c161a20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00c390 tx=0x7efe6c00c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:14.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.996+0000 7f99f9400640 1 --2- 172.21.15.42:0/2761454103 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99f40d1670 0x7f99f415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:32:14.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.996+0000 7efe76000640 1 -- 172.21.15.42:0/570448493 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe6c011790 con 0x7efe7c15eb60 2024-09-17T01:32:15.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.996+0000 7fb02f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb03006ff00 0x7fb03015ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:15.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.996+0000 7fb02f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb03015f500 0x7fb0300cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:15.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.996+0000 7f66caa00640 1 -- 172.21.15.42:0/3074341678 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f66cc1f65a0 msgr2=0x7f66cc158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.996+0000 7f66caa00640 1 --2- 172.21.15.42:0/3074341678 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f66cc1f65a0 0x7f66cc158960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.996+0000 7f66caa00640 1 -- 172.21.15.42:0/3074341678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66cc15f000 msgr2=0x7f66cc1eab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.996+0000 7f66caa00640 1 --2- 172.21.15.42:0/3074341678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66cc15f000 0x7f66cc1eab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.996+0000 7f66caa00640 1 -- 172.21.15.42:0/3074341678 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66cc1eb480 con 0x7f66cc0d4110 2024-09-17T01:32:15.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.996+0000 7f99f9e00640 1 --2- 172.21.15.42:0/2761454103 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f99f41630f0 0x7f99f40b8020 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f99ec00b9e0 tx=0x7f99ec00bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:15.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.996+0000 7efe76000640 1 -- 172.21.15.42:0/570448493 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe6c017070 con 0x7efe7c15eb60 2024-09-17T01:32:15.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.996+0000 7efe84800640 1 -- 172.21.15.42:0/570448493 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe7c1549f0 con 0x7efe7c15eb60 2024-09-17T01:32:15.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.996+0000 7efe84800640 1 -- 172.21.15.42:0/570448493 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe7c155450 con 0x7efe7c15eb60 2024-09-17T01:32:15.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.996+0000 7efe76000640 1 -- 172.21.15.42:0/570448493 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe6c011ca0 con 0x7efe7c15eb60 2024-09-17T01:32:15.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.997+0000 7f66cb400640 1 --2- 172.21.15.42:0/3074341678 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f66cc1f65a0 0x7f66cc158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:32:15.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.997+0000 7f66ca000640 1 --2- 172.21.15.42:0/3074341678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66cc15f000 0x7f66cc1eab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:32:15.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.997+0000 7fb02f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb030159cd0 0x7fb0300cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:15.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.997+0000 7fb02f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb0300d0db0 con 0x7fb03015f500 2024-09-17T01:32:15.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.997+0000 7fb02f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb0300d0c30 con 0x7fb03006ff00 2024-09-17T01:32:15.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.997+0000 7fb02f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb03015af90 con 0x7fb030159cd0 2024-09-17T01:32:15.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.997+0000 7fb02de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb03006ff00 0x7fb03015ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:15.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.997+0000 7fb02de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb03006ff00 0x7fb03015ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:35880/0 (socket says 172.21.15.42:35880) 2024-09-17T01:32:15.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.997+0000 7fb02de00640 1 -- 172.21.15.42:0/2624637165 learned_addr learned my addr 172.21.15.42:0/2624637165 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:15.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.997+0000 7f66caa00640 1 --2- 172.21.15.42:0/3074341678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66cc0d4110 0x7f66cc157f20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f66bc00c3a0 tx=0x7f66bc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:15.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.997+0000 7fb02de00640 1 -- 172.21.15.42:0/2624637165 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb030159cd0 msgr2=0x7fb0300cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.997+0000 7fb02de00640 1 --2- 172.21.15.42:0/2624637165 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb030159cd0 0x7fb0300cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.997+0000 7fb02de00640 1 -- 172.21.15.42:0/2624637165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb03015f500 msgr2=0x7fb0300cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.997+0000 7fb02d400640 1 --2- 172.21.15.42:0/2624637165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb03015f500 0x7fb0300cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:15.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.997+0000 7f99f1600640 1 -- 172.21.15.42:0/2761454103 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec019070 con 0x7f99f41630f0 2024-09-17T01:32:15.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.997+0000 7fb02de00640 1 --2- 172.21.15.42:0/2624637165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb03015f500 0x7fb0300cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.997+0000 7fb02de00640 1 -- 172.21.15.42:0/2624637165 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0301f9d10 con 0x7fb03006ff00 2024-09-17T01:32:15.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.997+0000 7fb02d400640 1 --2- 172.21.15.42:0/2624637165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb03015f500 0x7fb0300cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:32:15.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.998+0000 7f66c3400640 1 -- 172.21.15.42:0/3074341678 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66bc017070 con 0x7f66cc0d4110 2024-09-17T01:32:15.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.998+0000 7f66d1e00640 1 -- 172.21.15.42:0/3074341678 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66cc1f5ac0 con 0x7f66cc0d4110 2024-09-17T01:32:15.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.998+0000 7f66d1e00640 1 -- 172.21.15.42:0/3074341678 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66cc15dea0 con 0x7f66cc0d4110 2024-09-17T01:32:15.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.998+0000 7f66c3400640 1 -- 172.21.15.42:0/3074341678 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66bc0035f0 con 0x7f66cc0d4110 2024-09-17T01:32:15.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.998+0000 7f66c3400640 1 -- 172.21.15.42:0/3074341678 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66bc003a40 con 0x7f66cc0d4110 2024-09-17T01:32:15.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.999+0000 7f99f1600640 1 -- 172.21.15.42:0/2761454103 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99ec00cbb0 con 0x7f99f41630f0 2024-09-17T01:32:15.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.999+0000 7f99fbe00640 1 -- 172.21.15.42:0/2761454103 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99f40ce430 con 0x7f99f41630f0 2024-09-17T01:32:15.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.999+0000 7f99fbe00640 1 -- 172.21.15.42:0/2761454103 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f99f415bc60 con 0x7f99f41630f0 2024-09-17T01:32:15.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.000+0000 7fb02de00640 1 --2- 172.21.15.42:0/2624637165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb03006ff00 0x7fb03015ecc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb02000c430 tx=0x7fb02000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:15.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.000+0000 7fb026000640 1 -- 172.21.15.42:0/2624637165 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb020011790 con 0x7fb03006ff00 2024-09-17T01:32:15.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.000+0000 7fb026000640 1 -- 172.21.15.42:0/2624637165 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb020017070 con 0x7fb03006ff00 2024-09-17T01:32:15.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.000+0000 7fb026000640 1 -- 172.21.15.42:0/2624637165 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb020011cc0 con 0x7fb03006ff00 2024-09-17T01:32:15.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.000+0000 7fb02f200640 1 -- 172.21.15.42:0/2624637165 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0301f9ff0 con 0x7fb03006ff00 2024-09-17T01:32:15.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.003+0000 7fb02f200640 1 -- 172.21.15.42:0/2624637165 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0301fa5b0 con 0x7fb03006ff00 2024-09-17T01:32:15.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.001+0000 7f66d1e00640 1 -- 172.21.15.42:0/3074341678 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66cc1f58b0 con 0x7f66cc0d4110 2024-09-17T01:32:15.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.999+0000 7f99f1600640 1 -- 172.21.15.42:0/2761454103 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec014440 con 0x7f99f41630f0 2024-09-17T01:32:15.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:14.999+0000 7efe84800640 1 -- 172.21.15.42:0/570448493 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe58005290 con 0x7efe7c15eb60 2024-09-17T01:32:15.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.000+0000 7efe76000640 1 -- 172.21.15.42:0/570448493 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efe6c01c460 con 0x7efe7c15eb60 2024-09-17T01:32:15.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.002+0000 7efe76000640 1 --2- 172.21.15.42:0/570448493 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efe60078bc0 0x7efe6007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:15.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.003+0000 7efe76000640 1 -- 172.21.15.42:0/570448493 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7efe6c09a800 con 0x7efe7c15eb60 2024-09-17T01:32:15.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.003+0000 7efe81e00640 1 --2- 172.21.15.42:0/570448493 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efe60078bc0 0x7efe6007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:15.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.004+0000 7efe81e00640 1 --2- 172.21.15.42:0/570448493 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efe60078bc0 0x7efe6007b0d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efe78006010 tx=0x7efe78004ab0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:15.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.004+0000 7f99fbe00640 1 -- 172.21.15.42:0/2761454103 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99d0005290 con 0x7f99f41630f0 2024-09-17T01:32:15.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.003+0000 7f66c3400640 1 -- 172.21.15.42:0/3074341678 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f66bc01a070 con 0x7f66cc0d4110 2024-09-17T01:32:15.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.004+0000 7f66c3400640 1 --2- 172.21.15.42:0/3074341678 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f66ac078bc0 0x7f66ac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:15.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.005+0000 7fb02f200640 1 -- 172.21.15.42:0/2624637165 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0300b51c0 con 0x7fb03006ff00 2024-09-17T01:32:15.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.005+0000 7f66ca000640 1 --2- 172.21.15.42:0/3074341678 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f66ac078bc0 0x7f66ac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:15.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.006+0000 7f99f1600640 1 -- 172.21.15.42:0/2761454103 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f99ec01c070 con 0x7f99f41630f0 2024-09-17T01:32:15.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.007+0000 7f66c3400640 1 -- 172.21.15.42:0/3074341678 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f66bc0985e0 con 0x7f66cc0d4110 2024-09-17T01:32:15.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.007+0000 7f66ca000640 1 --2- 172.21.15.42:0/3074341678 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f66ac078bc0 0x7f66ac07b0d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f66b8034000 tx=0x7f66b8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:15.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.007+0000 7efe76000640 1 -- 172.21.15.42:0/570448493 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efe7c0d1b40 con 0x7efe7c15eb60 2024-09-17T01:32:15.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.008+0000 7f99f1600640 1 --2- 172.21.15.42:0/2761454103 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f99d4078b90 0x7f99d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:15.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.009+0000 7f99f1600640 1 -- 172.21.15.42:0/2761454103 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f99ec09a8f0 con 0x7f99f41630f0 2024-09-17T01:32:15.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.010+0000 7f99f9400640 1 --2- 172.21.15.42:0/2761454103 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f99d4078b90 0x7f99d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:15.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.010+0000 7f99f9400640 1 --2- 172.21.15.42:0/2761454103 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f99d4078b90 0x7f99d407b0a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f99e0007fd0 tx=0x7f99e0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:15.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.011+0000 7fb026000640 1 -- 172.21.15.42:0/2624637165 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb020005020 con 0x7fb03006ff00 2024-09-17T01:32:15.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.012+0000 7fb026000640 1 --2- 172.21.15.42:0/2624637165 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb010078b90 0x7fb01007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:15.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.013+0000 7fb026000640 1 -- 172.21.15.42:0/2624637165 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb02009b290 con 0x7fb03006ff00 2024-09-17T01:32:15.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.014+0000 7fb02d400640 1 --2- 172.21.15.42:0/2624637165 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb010078b90 0x7fb01007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:15.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.014+0000 7f66c3400640 1 -- 172.21.15.42:0/3074341678 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f66bc061e20 con 0x7f66cc0d4110 2024-09-17T01:32:15.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.014+0000 7fb026000640 1 -- 172.21.15.42:0/2624637165 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb0300b51c0 con 0x7fb03006ff00 2024-09-17T01:32:15.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.014+0000 7f99f1600640 1 -- 172.21.15.42:0/2761454103 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f99ec062880 con 0x7f99f41630f0 2024-09-17T01:32:15.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.016+0000 7fb02d400640 1 --2- 172.21.15.42:0/2624637165 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb010078b90 0x7fb01007b0a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb01c034000 tx=0x7fb01c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:15.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.357+0000 7f7b3ee00640 1 -- 172.21.15.42:0/3468738221 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7b30005cb0 con 0x7f7b3000bc30 2024-09-17T01:32:15.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.358+0000 7f7b35600640 1 -- 172.21.15.42:0/3468738221 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7b2404c070 con 0x7f7b3000bc30 2024-09-17T01:32:15.358 INFO:teuthology.orchestra.run.smithi042.stdout:68719476743 2024-09-17T01:32:15.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.362+0000 7f7b3ee00640 1 -- 172.21.15.42:0/3468738221 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7b18078d90 msgr2=0x7f7b1807b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.362+0000 7f7b3ee00640 1 --2- 172.21.15.42:0/3468738221 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7b18078d90 0x7f7b1807b2a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7b380521d0 tx=0x7f7b3806f040 comp rx=0 tx=0).stop 2024-09-17T01:32:15.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.362+0000 7f7b3ee00640 1 -- 172.21.15.42:0/3468738221 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7b3000bc30 msgr2=0x7f7b300479e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.362+0000 7f7b3ee00640 1 --2- 172.21.15.42:0/3468738221 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7b3000bc30 0x7f7b300479e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7b24036040 tx=0x7f7b240035f0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.363+0000 7f7b3ee00640 1 -- 172.21.15.42:0/3468738221 shutdown_connections 2024-09-17T01:32:15.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.363+0000 7f7b3ee00640 1 --2- 172.21.15.42:0/3468738221 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7b18078d90 0x7f7b1807b2a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.363+0000 7f7b3ee00640 1 --2- 172.21.15.42:0/3468738221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b3001c5b0 0x7f7b30181bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.363+0000 7f7b3ee00640 1 --2- 172.21.15.42:0/3468738221 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7b3000bc30 0x7f7b300479e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.363+0000 7f7b3ee00640 1 --2- 172.21.15.42:0/3468738221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b30009ba0 0x7f7b301814e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.363+0000 7f7b3ee00640 1 -- 172.21.15.42:0/3468738221 >> 172.21.15.42:0/3468738221 conn(0x7f7b30051420 msgr2=0x7f7b30004940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:15.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.364+0000 7f7b3ee00640 1 -- 172.21.15.42:0/3468738221 shutdown_connections 2024-09-17T01:32:15.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.364+0000 7f7b3ee00640 1 -- 172.21.15.42:0/3468738221 wait complete. 2024-09-17T01:32:15.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.370+0000 7f7f76a00640 1 -- 172.21.15.42:0/136363992 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7f7c03c790 con 0x7f7f7c0e3010 2024-09-17T01:32:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.371+0000 7f7f81600640 1 -- 172.21.15.42:0/136363992 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7f7c038220 con 0x7f7f7c0e3010 2024-09-17T01:32:15.368 INFO:teuthology.orchestra.run.smithi042.stdout:64424509446 2024-09-17T01:32:15.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.375+0000 7f7f76a00640 1 -- 172.21.15.42:0/136363992 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7f64078be0 msgr2=0x7f7f6407b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.375+0000 7f7f76a00640 1 --2- 172.21.15.42:0/136363992 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7f64078be0 0x7f7f6407b0f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c0119f0 tx=0x7f7f70008040 comp rx=0 tx=0).stop 2024-09-17T01:32:15.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.375+0000 7f7f76a00640 1 -- 172.21.15.42:0/136363992 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7f7c0e3010 msgr2=0x7f7f7c0e3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.375+0000 7f7f76a00640 1 --2- 172.21.15.42:0/136363992 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7f7c0e3010 0x7f7f7c0e3420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7f8406c1a0 tx=0x7f7f8406b2f0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.375+0000 7f7f76a00640 1 -- 172.21.15.42:0/136363992 shutdown_connections 2024-09-17T01:32:15.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.375+0000 7f7f76a00640 1 --2- 172.21.15.42:0/136363992 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7f64078be0 0x7f7f6407b0f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.375+0000 7f7f76a00640 1 --2- 172.21.15.42:0/136363992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f7c17a050 0x7f7f7c17a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.375+0000 7f7f76a00640 1 --2- 172.21.15.42:0/136363992 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7f7c0e3010 0x7f7f7c0e3420 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.376+0000 7f7f76a00640 1 --2- 172.21.15.42:0/136363992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f6c004800 0x7f7f7c0e0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.376+0000 7f7f76a00640 1 -- 172.21.15.42:0/136363992 >> 172.21.15.42:0/136363992 conn(0x7f7f7c00e400 msgr2=0x7f7f7c051cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:15.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.376+0000 7f7f76a00640 1 -- 172.21.15.42:0/136363992 shutdown_connections 2024-09-17T01:32:15.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.376+0000 7f7f76a00640 1 -- 172.21.15.42:0/136363992 wait complete. 2024-09-17T01:32:15.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.380+0000 7f4e81000640 1 -- 172.21.15.42:0/1730159749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4e54005580 con 0x7f4e7c162fc0 2024-09-17T01:32:15.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.382+0000 7f4e72000640 1 -- 172.21.15.42:0/1730159749 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4e6c062d70 con 0x7f4e7c162fc0 2024-09-17T01:32:15.383 INFO:teuthology.orchestra.run.smithi042.stdout:64424509448 2024-09-17T01:32:15.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.386+0000 7f4e81000640 1 -- 172.21.15.42:0/1730159749 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4e58078be0 msgr2=0x7f4e5807b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.386+0000 7f4e81000640 1 --2- 172.21.15.42:0/1730159749 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4e58078be0 0x7f4e5807b0f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4e74007fd0 tx=0x7f4e74009040 comp rx=0 tx=0).stop 2024-09-17T01:32:15.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.386+0000 7f4e81000640 1 -- 172.21.15.42:0/1730159749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e7c162fc0 msgr2=0x7f4e7c201d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.386+0000 7f4e81000640 1 --2- 172.21.15.42:0/1730159749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e7c162fc0 0x7f4e7c201d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00b500 tx=0x7f4e6c00b9c0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.386+0000 7f4e81000640 1 -- 172.21.15.42:0/1730159749 shutdown_connections 2024-09-17T01:32:15.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.386+0000 7f4e81000640 1 --2- 172.21.15.42:0/1730159749 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4e58078be0 0x7f4e5807b0f0 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4e74007fd0 tx=0x7f4e74009040 comp rx=0 tx=0).stop 2024-09-17T01:32:15.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.386+0000 7f4e81000640 1 --2- 172.21.15.42:0/1730159749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e7c0d19b0 0x7f4e7c1613e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.386+0000 7f4e81000640 1 --2- 172.21.15.42:0/1730159749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e7c162fc0 0x7f4e7c201d90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.386+0000 7f4e81000640 1 --2- 172.21.15.42:0/1730159749 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4e7c0b34d0 0x7f4e7c157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.386+0000 7f4e81000640 1 -- 172.21.15.42:0/1730159749 >> 172.21.15.42:0/1730159749 conn(0x7f4e7c06cf00 msgr2=0x7f4e7c06d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.388+0000 7f4e81000640 1 -- 172.21.15.42:0/1730159749 shutdown_connections 2024-09-17T01:32:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.388+0000 7f4e81000640 1 -- 172.21.15.42:0/1730159749 wait complete. 2024-09-17T01:32:15.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.399+0000 7fa975400640 1 -- 172.21.15.42:0/2437269605 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fa9700d2810 con 0x7fa970162fa0 2024-09-17T01:32:15.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.400+0000 7fa967e00640 1 -- 172.21.15.42:0/2437269605 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa960062ea0 con 0x7fa970162fa0 2024-09-17T01:32:15.400 INFO:teuthology.orchestra.run.smithi042.stdout:64424509447 2024-09-17T01:32:15.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476743 for osd.2 2024-09-17T01:32:15.405 DEBUG:teuthology.parallel:result is None 2024-09-17T01:32:15.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.407+0000 7fa975400640 1 -- 172.21.15.42:0/2437269605 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa94c078c90 msgr2=0x7fa94c07b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.407+0000 7fa975400640 1 --2- 172.21.15.42:0/2437269605 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa94c078c90 0x7fa94c07b1a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa968034000 tx=0x7fa968004730 comp rx=0 tx=0).stop 2024-09-17T01:32:15.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.407+0000 7fa975400640 1 -- 172.21.15.42:0/2437269605 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa970162fa0 msgr2=0x7fa9700b8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.407+0000 7fa975400640 1 --2- 172.21.15.42:0/2437269605 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa970162fa0 0x7fa9700b8d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa96000b9a0 tx=0x7fa96000be60 comp rx=0 tx=0).stop 2024-09-17T01:32:15.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.407+0000 7fa975400640 1 -- 172.21.15.42:0/2437269605 shutdown_connections 2024-09-17T01:32:15.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.407+0000 7fa975400640 1 --2- 172.21.15.42:0/2437269605 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa94c078c90 0x7fa94c07b1a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.407+0000 7fa975400640 1 --2- 172.21.15.42:0/2437269605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9700b6030 0x7fa9701568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.407+0000 7fa975400640 1 --2- 172.21.15.42:0/2437269605 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa970162fa0 0x7fa9700b8d80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.407+0000 7fa975400640 1 --2- 172.21.15.42:0/2437269605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa970073340 0x7fa9700ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.407+0000 7fa975400640 1 -- 172.21.15.42:0/2437269605 >> 172.21.15.42:0/2437269605 conn(0x7fa9700d1210 msgr2=0x7fa970162590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:15.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.407+0000 7fa975400640 1 -- 172.21.15.42:0/2437269605 shutdown_connections 2024-09-17T01:32:15.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.407+0000 7fa975400640 1 -- 172.21.15.42:0/2437269605 wait complete. 2024-09-17T01:32:15.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.1 2024-09-17T01:32:15.416 DEBUG:teuthology.parallel:result is None 2024-09-17T01:32:15.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.0 2024-09-17T01:32:15.426 DEBUG:teuthology.parallel:result is None 2024-09-17T01:32:15.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.430+0000 7efe84800640 1 -- 172.21.15.42:0/570448493 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7efe58005580 con 0x7efe7c15eb60 2024-09-17T01:32:15.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.431+0000 7efe76000640 1 -- 172.21.15.42:0/570448493 <== mon.1 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efe6c062d80 con 0x7efe7c15eb60 2024-09-17T01:32:15.428 INFO:teuthology.orchestra.run.smithi042.stdout:64424509447 2024-09-17T01:32:15.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.433+0000 7efe84800640 1 -- 172.21.15.42:0/570448493 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efe60078bc0 msgr2=0x7efe6007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.433+0000 7efe84800640 1 --2- 172.21.15.42:0/570448493 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efe60078bc0 0x7efe6007b0d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efe78006010 tx=0x7efe78004ab0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.434+0000 7efe84800640 1 -- 172.21.15.42:0/570448493 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe7c15eb60 msgr2=0x7efe7c161a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.434+0000 7efe84800640 1 --2- 172.21.15.42:0/570448493 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe7c15eb60 0x7efe7c161a20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00c390 tx=0x7efe6c00c850 comp rx=0 tx=0).stop 2024-09-17T01:32:15.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.434+0000 7efe84800640 1 -- 172.21.15.42:0/570448493 shutdown_connections 2024-09-17T01:32:15.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.434+0000 7efe84800640 1 --2- 172.21.15.42:0/570448493 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efe60078bc0 0x7efe6007b0d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.434+0000 7efe84800640 1 --2- 172.21.15.42:0/570448493 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe7c15eb60 0x7efe7c161a20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.434+0000 7efe84800640 1 --2- 172.21.15.42:0/570448493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe7c0d1730 0x7efe7c1614e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.434+0000 7efe84800640 1 --2- 172.21.15.42:0/570448493 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe7c0cf360 0x7efe7c15aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.434+0000 7efe84800640 1 -- 172.21.15.42:0/570448493 >> 172.21.15.42:0/570448493 conn(0x7efe7c06cd20 msgr2=0x7efe7c0b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:15.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.434+0000 7efe84800640 1 -- 172.21.15.42:0/570448493 shutdown_connections 2024-09-17T01:32:15.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.434+0000 7efe84800640 1 -- 172.21.15.42:0/570448493 wait complete. 2024-09-17T01:32:15.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.439+0000 7fb02f200640 1 -- 172.21.15.42:0/2624637165 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb0300cd970 con 0x7fb03006ff00 2024-09-17T01:32:15.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.439+0000 7fb026000640 1 -- 172.21.15.42:0/2624637165 <== mon.1 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb0300cd970 con 0x7fb03006ff00 2024-09-17T01:32:15.437 INFO:teuthology.orchestra.run.smithi042.stdout:64424509446 2024-09-17T01:32:15.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.442+0000 7f66d1e00640 1 -- 172.21.15.42:0/3074341678 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f66cc0d2e40 con 0x7f66cc0d4110 2024-09-17T01:32:15.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.442+0000 7f66c3400640 1 -- 172.21.15.42:0/3074341678 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f66bc066850 con 0x7f66cc0d4110 2024-09-17T01:32:15.440 INFO:teuthology.orchestra.run.smithi042.stdout:64424509447 2024-09-17T01:32:15.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.444+0000 7fb02f200640 1 -- 172.21.15.42:0/2624637165 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb010078b90 msgr2=0x7fb01007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.444+0000 7fb02f200640 1 --2- 172.21.15.42:0/2624637165 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb010078b90 0x7fb01007b0a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb01c034000 tx=0x7fb01c004730 comp rx=0 tx=0).stop 2024-09-17T01:32:15.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.444+0000 7fb02f200640 1 -- 172.21.15.42:0/2624637165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb03006ff00 msgr2=0x7fb03015ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.444+0000 7fb02f200640 1 --2- 172.21.15.42:0/2624637165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb03006ff00 0x7fb03015ecc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb02000c430 tx=0x7fb02000c8f0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.444+0000 7fb02f200640 1 -- 172.21.15.42:0/2624637165 shutdown_connections 2024-09-17T01:32:15.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.444+0000 7fb02f200640 1 --2- 172.21.15.42:0/2624637165 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb010078b90 0x7fb01007b0a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.444+0000 7fb02f200640 1 --2- 172.21.15.42:0/2624637165 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb030159cd0 0x7fb0300cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.444+0000 7fb02f200640 1 --2- 172.21.15.42:0/2624637165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb03015f500 0x7fb0300cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.444+0000 7fb02f200640 1 --2- 172.21.15.42:0/2624637165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb03006ff00 0x7fb03015ecc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.444+0000 7fb02f200640 1 -- 172.21.15.42:0/2624637165 >> 172.21.15.42:0/2624637165 conn(0x7fb0300d0110 msgr2=0x7fb0300d0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:15.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.444+0000 7fb02f200640 1 -- 172.21.15.42:0/2624637165 shutdown_connections 2024-09-17T01:32:15.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.444+0000 7fb02f200640 1 -- 172.21.15.42:0/2624637165 wait complete. 2024-09-17T01:32:15.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.445+0000 7f66d1e00640 1 -- 172.21.15.42:0/3074341678 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f66ac078bc0 msgr2=0x7f66ac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.445+0000 7f66d1e00640 1 --2- 172.21.15.42:0/3074341678 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f66ac078bc0 0x7f66ac07b0d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f66b8034000 tx=0x7f66b8004730 comp rx=0 tx=0).stop 2024-09-17T01:32:15.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.445+0000 7f66d1e00640 1 -- 172.21.15.42:0/3074341678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66cc0d4110 msgr2=0x7f66cc157f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.445+0000 7f66d1e00640 1 --2- 172.21.15.42:0/3074341678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66cc0d4110 0x7f66cc157f20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f66bc00c3a0 tx=0x7f66bc00c860 comp rx=0 tx=0).stop 2024-09-17T01:32:15.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.445+0000 7f66d1e00640 1 -- 172.21.15.42:0/3074341678 shutdown_connections 2024-09-17T01:32:15.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.445+0000 7f66d1e00640 1 --2- 172.21.15.42:0/3074341678 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f66ac078bc0 0x7f66ac07b0d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.445+0000 7f66d1e00640 1 --2- 172.21.15.42:0/3074341678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f66cc15f000 0x7f66cc1eab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.445+0000 7f66d1e00640 1 --2- 172.21.15.42:0/3074341678 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f66cc1f65a0 0x7f66cc158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.445+0000 7f66d1e00640 1 --2- 172.21.15.42:0/3074341678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66cc0d4110 0x7f66cc157f20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.445+0000 7f66d1e00640 1 -- 172.21.15.42:0/3074341678 >> 172.21.15.42:0/3074341678 conn(0x7f66cc06d140 msgr2=0x7f66cc0b7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:15.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.445+0000 7f66d1e00640 1 -- 172.21.15.42:0/3074341678 shutdown_connections 2024-09-17T01:32:15.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.445+0000 7f66d1e00640 1 -- 172.21.15.42:0/3074341678 wait complete. 2024-09-17T01:32:15.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.449+0000 7f99fbe00640 1 -- 172.21.15.42:0/2761454103 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f99d0005850 con 0x7f99f41630f0 2024-09-17T01:32:15.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.449+0000 7f99f1600640 1 -- 172.21.15.42:0/2761454103 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f99ec0672b0 con 0x7f99f41630f0 2024-09-17T01:32:15.447 INFO:teuthology.orchestra.run.smithi042.stdout:60129542152 2024-09-17T01:32:15.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.452+0000 7f99fbe00640 1 -- 172.21.15.42:0/2761454103 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f99d4078b90 msgr2=0x7f99d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.452+0000 7f99fbe00640 1 --2- 172.21.15.42:0/2761454103 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f99d4078b90 0x7f99d407b0a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f99e0007fd0 tx=0x7f99e0009040 comp rx=0 tx=0).stop 2024-09-17T01:32:15.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.452+0000 7f99fbe00640 1 -- 172.21.15.42:0/2761454103 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f99f41630f0 msgr2=0x7f99f40b8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.452+0000 7f99fbe00640 1 --2- 172.21.15.42:0/2761454103 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f99f41630f0 0x7f99f40b8020 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f99ec00b9e0 tx=0x7f99ec00bea0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.452+0000 7f99fbe00640 1 -- 172.21.15.42:0/2761454103 shutdown_connections 2024-09-17T01:32:15.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.452+0000 7f99fbe00640 1 --2- 172.21.15.42:0/2761454103 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f99d4078b90 0x7f99d407b0a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.453+0000 7f99fbe00640 1 --2- 172.21.15.42:0/2761454103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99f4155dc0 0x7f99f415b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.453+0000 7f99fbe00640 1 --2- 172.21.15.42:0/2761454103 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f99f41630f0 0x7f99f40b8020 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.453+0000 7f99fbe00640 1 --2- 172.21.15.42:0/2761454103 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99f40d1670 0x7f99f415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.453+0000 7f99fbe00640 1 -- 172.21.15.42:0/2761454103 >> 172.21.15.42:0/2761454103 conn(0x7f99f406cd20 msgr2=0x7f99f41612d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:15.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.453+0000 7f99fbe00640 1 -- 172.21.15.42:0/2761454103 shutdown_connections 2024-09-17T01:32:15.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.453+0000 7f99fbe00640 1 -- 172.21.15.42:0/2761454103 wait complete. 2024-09-17T01:32:15.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.4 2024-09-17T01:32:15.452 DEBUG:teuthology.parallel:result is None 2024-09-17T01:32:15.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.7 2024-09-17T01:32:15.458 DEBUG:teuthology.parallel:result is None 2024-09-17T01:32:15.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.6 2024-09-17T01:32:15.467 DEBUG:teuthology.parallel:result is None 2024-09-17T01:32:15.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.5 2024-09-17T01:32:15.473 DEBUG:teuthology.parallel:result is None 2024-09-17T01:32:15.474 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.3 2024-09-17T01:32:15.474 DEBUG:teuthology.parallel:result is None 2024-09-17T01:32:15.474 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T01:32:15.474 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:32:15.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.741+0000 7fb3bfc00640 1 -- 172.21.15.42:0/1122703734 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb3b8142f40 msgr2=0x7fb3b8072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.741+0000 7fb3bfc00640 1 --2- 172.21.15.42:0/1122703734 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb3b8142f40 0x7fb3b8072950 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4009860 tx=0x7fb3a402a510 comp rx=0 tx=0).stop 2024-09-17T01:32:15.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.741+0000 7fb3bfc00640 1 -- 172.21.15.42:0/1122703734 shutdown_connections 2024-09-17T01:32:15.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.741+0000 7fb3bfc00640 1 --2- 172.21.15.42:0/1122703734 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb3b8142f40 0x7fb3b8072950 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.741+0000 7fb3bfc00640 1 -- 172.21.15.42:0/1122703734 >> 172.21.15.42:0/1122703734 conn(0x7fb3b80b2930 msgr2=0x7fb3b806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:15.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.742+0000 7fb3bfc00640 1 -- 172.21.15.42:0/1122703734 shutdown_connections 2024-09-17T01:32:15.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.742+0000 7fb3bfc00640 1 -- 172.21.15.42:0/1122703734 wait complete. 2024-09-17T01:32:15.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.744+0000 7fb3bfc00640 1 Processor -- start 2024-09-17T01:32:15.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.744+0000 7fb3bfc00640 1 -- start start 2024-09-17T01:32:15.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.745+0000 7fb3bfc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3b8072e90 0x7fb3b8142440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:15.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.745+0000 7fb3bfc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3b80b3550 0x7fb3b81f2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:15.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.745+0000 7fb3bfc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb3b8142f40 0x7fb3b806f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:15.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.745+0000 7fb3bfc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b806d8d0 con 0x7fb3b80b3550 2024-09-17T01:32:15.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.745+0000 7fb3bfc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b806d750 con 0x7fb3b8072e90 2024-09-17T01:32:15.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.745+0000 7fb3bfc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb3b806da50 con 0x7fb3b8142f40 2024-09-17T01:32:15.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.745+0000 7fb3b7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3b80b3550 0x7fb3b81f2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:15.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.746+0000 7fb3b7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3b80b3550 0x7fb3b81f2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50586/0 (socket says 172.21.15.42:50586) 2024-09-17T01:32:15.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.746+0000 7fb3b7e00640 1 -- 172.21.15.42:0/2319631040 learned_addr learned my addr 172.21.15.42:0/2319631040 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:15.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.746+0000 7fb3bd200640 1 --2- 172.21.15.42:0/2319631040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3b8072e90 0x7fb3b8142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:15.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.746+0000 7fb3bdc00640 1 --2- 172.21.15.42:0/2319631040 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb3b8142f40 0x7fb3b806f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:15.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.746+0000 7fb3b7e00640 1 -- 172.21.15.42:0/2319631040 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb3b8142f40 msgr2=0x7fb3b806f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.746+0000 7fb3b7e00640 1 --2- 172.21.15.42:0/2319631040 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb3b8142f40 0x7fb3b806f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.746+0000 7fb3b7e00640 1 -- 172.21.15.42:0/2319631040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3b8072e90 msgr2=0x7fb3b8142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.746+0000 7fb3b7e00640 1 --2- 172.21.15.42:0/2319631040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3b8072e90 0x7fb3b8142440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.746+0000 7fb3b7e00640 1 -- 172.21.15.42:0/2319631040 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b81f3460 con 0x7fb3b80b3550 2024-09-17T01:32:15.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.746+0000 7fb3b7e00640 1 --2- 172.21.15.42:0/2319631040 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3b80b3550 0x7fb3b81f2f20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4009980 tx=0x7fb3a4033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:15.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.747+0000 7fb3b4c00640 1 -- 172.21.15.42:0/2319631040 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a4005c90 con 0x7fb3b80b3550 2024-09-17T01:32:15.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.747+0000 7fb3b4c00640 1 -- 172.21.15.42:0/2319631040 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3a4031e50 con 0x7fb3b80b3550 2024-09-17T01:32:15.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.747+0000 7fb3bfc00640 1 -- 172.21.15.42:0/2319631040 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b8159d30 con 0x7fb3b80b3550 2024-09-17T01:32:15.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.747+0000 7fb3b4c00640 1 -- 172.21.15.42:0/2319631040 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a4005260 con 0x7fb3b80b3550 2024-09-17T01:32:15.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.747+0000 7fb3bfc00640 1 -- 172.21.15.42:0/2319631040 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b81f6950 con 0x7fb3b80b3550 2024-09-17T01:32:15.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.748+0000 7fb3bfc00640 1 -- 172.21.15.42:0/2319631040 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3b81f64a0 con 0x7fb3b80b3550 2024-09-17T01:32:15.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.749+0000 7fb3b4c00640 1 -- 172.21.15.42:0/2319631040 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb3a4005400 con 0x7fb3b80b3550 2024-09-17T01:32:15.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.750+0000 7fb3b4c00640 1 --2- 172.21.15.42:0/2319631040 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb398078b90 0x7fb39807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:15.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.750+0000 7fb3b4c00640 1 -- 172.21.15.42:0/2319631040 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb3a40bbdd0 con 0x7fb3b80b3550 2024-09-17T01:32:15.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.750+0000 7fb3bd200640 1 --2- 172.21.15.42:0/2319631040 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb398078b90 0x7fb39807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:15.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.751+0000 7fb3bd200640 1 --2- 172.21.15.42:0/2319631040 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb398078b90 0x7fb39807b0a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac001120 tx=0x7fb3ac009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:15.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.754+0000 7fb3b4c00640 1 -- 172.21.15.42:0/2319631040 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb3a403f030 con 0x7fb3b80b3550 2024-09-17T01:32:15.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.944+0000 7fb3bfc00640 1 -- 172.21.15.42:0/2319631040 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb3b806a170 con 0x7fb398078b90 2024-09-17T01:32:15.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.949+0000 7fb3b4c00640 1 -- 172.21.15.42:0/2319631040 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251821 (secure 0 0 0) 0x7fb3b806a170 con 0x7fb398078b90 2024-09-17T01:32:15.950 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:15.952 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:32:15.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.954+0000 7fb3bfc00640 1 -- 172.21.15.42:0/2319631040 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb398078b90 msgr2=0x7fb39807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.954+0000 7fb3bfc00640 1 --2- 172.21.15.42:0/2319631040 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb398078b90 0x7fb39807b0a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac001120 tx=0x7fb3ac009040 comp rx=0 tx=0).stop 2024-09-17T01:32:15.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.954+0000 7fb3bfc00640 1 -- 172.21.15.42:0/2319631040 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3b80b3550 msgr2=0x7fb3b81f2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:15.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.954+0000 7fb3bfc00640 1 --2- 172.21.15.42:0/2319631040 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3b80b3550 0x7fb3b81f2f20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4009980 tx=0x7fb3a4033c20 comp rx=0 tx=0).stop 2024-09-17T01:32:15.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.954+0000 7fb3bfc00640 1 -- 172.21.15.42:0/2319631040 shutdown_connections 2024-09-17T01:32:15.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.954+0000 7fb3bfc00640 1 --2- 172.21.15.42:0/2319631040 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb398078b90 0x7fb39807b0a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.954+0000 7fb3bfc00640 1 --2- 172.21.15.42:0/2319631040 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb3b8142f40 0x7fb3b806f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.954+0000 7fb3bfc00640 1 --2- 172.21.15.42:0/2319631040 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3b80b3550 0x7fb3b81f2f20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.954+0000 7fb3bfc00640 1 --2- 172.21.15.42:0/2319631040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3b8072e90 0x7fb3b8142440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:15.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.954+0000 7fb3bfc00640 1 -- 172.21.15.42:0/2319631040 >> 172.21.15.42:0/2319631040 conn(0x7fb3b80b2930 msgr2=0x7fb3b8073500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:15.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.954+0000 7fb3bfc00640 1 -- 172.21.15.42:0/2319631040 shutdown_connections 2024-09-17T01:32:15.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:15.954+0000 7fb3bfc00640 1 -- 172.21.15.42:0/2319631040 wait complete. 2024-09-17T01:32:15.977 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-17T01:32:14.976739+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252460,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722260,"statfs":{"total":773094113280,"available":772835594240,"internally_reserved":0,"allocated":3022848,"data_stored":1799972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002592"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084683+0000","last_change":"2024-09-17T01:32:07.103456+0000","last_active":"2024-09-17T01:32:08.084683+0000","last_peered":"2024-09-17T01:32:08.084683+0000","last_clean":"2024-09-17T01:32:08.084683+0000","last_became_active":"2024-09-17T01:32:07.103109+0000","last_became_peered":"2024-09-17T01:32:07.103109+0000","last_unstale":"2024-09-17T01:32:08.084683+0000","last_undegraded":"2024-09-17T01:32:08.084683+0000","last_fullsized":"2024-09-17T01:32:08.084683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:38.558917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255495+0000","last_change":"2024-09-17T01:32:07.099455+0000","last_active":"2024-09-17T01:32:08.255495+0000","last_peered":"2024-09-17T01:32:08.255495+0000","last_clean":"2024-09-17T01:32:08.255495+0000","last_became_active":"2024-09-17T01:32:07.099052+0000","last_became_peered":"2024-09-17T01:32:07.099052+0000","last_unstale":"2024-09-17T01:32:08.255495+0000","last_undegraded":"2024-09-17T01:32:08.255495+0000","last_fullsized":"2024-09-17T01:32:08.255495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:14.731320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254735+0000","last_change":"2024-09-17T01:32:07.085703+0000","last_active":"2024-09-17T01:32:08.254735+0000","last_peered":"2024-09-17T01:32:08.254735+0000","last_clean":"2024-09-17T01:32:08.254735+0000","last_became_active":"2024-09-17T01:32:07.085380+0000","last_became_peered":"2024-09-17T01:32:07.085380+0000","last_unstale":"2024-09-17T01:32:08.254735+0000","last_undegraded":"2024-09-17T01:32:08.254735+0000","last_fullsized":"2024-09-17T01:32:08.254735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:01.084404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254328+0000","last_change":"2024-09-17T01:32:07.073236+0000","last_active":"2024-09-17T01:32:08.254328+0000","last_peered":"2024-09-17T01:32:08.254328+0000","last_clean":"2024-09-17T01:32:08.254328+0000","last_became_active":"2024-09-17T01:32:07.072918+0000","last_became_peered":"2024-09-17T01:32:07.072918+0000","last_unstale":"2024-09-17T01:32:08.254328+0000","last_undegraded":"2024-09-17T01:32:08.254328+0000","last_fullsized":"2024-09-17T01:32:08.254328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:57.510381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084044+0000","last_change":"2024-09-17T01:32:07.082349+0000","last_active":"2024-09-17T01:32:08.084044+0000","last_peered":"2024-09-17T01:32:08.084044+0000","last_clean":"2024-09-17T01:32:08.084044+0000","last_became_active":"2024-09-17T01:32:07.081897+0000","last_became_peered":"2024-09-17T01:32:07.081897+0000","last_unstale":"2024-09-17T01:32:08.084044+0000","last_undegraded":"2024-09-17T01:32:08.084044+0000","last_fullsized":"2024-09-17T01:32:08.084044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:32.623242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254134+0000","last_change":"2024-09-17T01:32:07.074398+0000","last_active":"2024-09-17T01:32:08.254134+0000","last_peered":"2024-09-17T01:32:08.254134+0000","last_clean":"2024-09-17T01:32:08.254134+0000","last_became_active":"2024-09-17T01:32:07.074076+0000","last_became_peered":"2024-09-17T01:32:07.074076+0000","last_unstale":"2024-09-17T01:32:08.254134+0000","last_undegraded":"2024-09-17T01:32:08.254134+0000","last_fullsized":"2024-09-17T01:32:08.254134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:14.053004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.083789+0000","last_change":"2024-09-17T01:32:07.076442+0000","last_active":"2024-09-17T01:32:08.083789+0000","last_peered":"2024-09-17T01:32:08.083789+0000","last_clean":"2024-09-17T01:32:08.083789+0000","last_became_active":"2024-09-17T01:32:07.076156+0000","last_became_peered":"2024-09-17T01:32:07.076156+0000","last_unstale":"2024-09-17T01:32:08.083789+0000","last_undegraded":"2024-09-17T01:32:08.083789+0000","last_fullsized":"2024-09-17T01:32:08.083789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:13:53.149286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255624+0000","last_change":"2024-09-17T01:32:07.085589+0000","last_active":"2024-09-17T01:32:08.255624+0000","last_peered":"2024-09-17T01:32:08.255624+0000","last_clean":"2024-09-17T01:32:08.255624+0000","last_became_active":"2024-09-17T01:32:07.085259+0000","last_became_peered":"2024-09-17T01:32:07.085259+0000","last_unstale":"2024-09-17T01:32:08.255624+0000","last_undegraded":"2024-09-17T01:32:08.255624+0000","last_fullsized":"2024-09-17T01:32:08.255624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:41.271843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.078098+0000","last_change":"2024-09-17T01:32:07.092123+0000","last_active":"2024-09-17T01:32:08.078098+0000","last_peered":"2024-09-17T01:32:08.078098+0000","last_clean":"2024-09-17T01:32:08.078098+0000","last_became_active":"2024-09-17T01:32:07.091713+0000","last_became_peered":"2024-09-17T01:32:07.091713+0000","last_unstale":"2024-09-17T01:32:08.078098+0000","last_undegraded":"2024-09-17T01:32:08.078098+0000","last_fullsized":"2024-09-17T01:32:08.078098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:05.017902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084219+0000","last_change":"2024-09-17T01:32:07.085067+0000","last_active":"2024-09-17T01:32:08.084219+0000","last_peered":"2024-09-17T01:32:08.084219+0000","last_clean":"2024-09-17T01:32:08.084219+0000","last_became_active":"2024-09-17T01:32:07.084837+0000","last_became_peered":"2024-09-17T01:32:07.084837+0000","last_unstale":"2024-09-17T01:32:08.084219+0000","last_undegraded":"2024-09-17T01:32:08.084219+0000","last_fullsized":"2024-09-17T01:32:08.084219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:02.511769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084409+0000","last_change":"2024-09-17T01:32:07.099691+0000","last_active":"2024-09-17T01:32:08.084409+0000","last_peered":"2024-09-17T01:32:08.084409+0000","last_clean":"2024-09-17T01:32:08.084409+0000","last_became_active":"2024-09-17T01:32:07.094018+0000","last_became_peered":"2024-09-17T01:32:07.094018+0000","last_unstale":"2024-09-17T01:32:08.084409+0000","last_undegraded":"2024-09-17T01:32:08.084409+0000","last_fullsized":"2024-09-17T01:32:08.084409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:58.314338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084110+0000","last_change":"2024-09-17T01:32:07.073776+0000","last_active":"2024-09-17T01:32:08.084110+0000","last_peered":"2024-09-17T01:32:08.084110+0000","last_clean":"2024-09-17T01:32:08.084110+0000","last_became_active":"2024-09-17T01:32:07.073442+0000","last_became_peered":"2024-09-17T01:32:07.073442+0000","last_unstale":"2024-09-17T01:32:08.084110+0000","last_undegraded":"2024-09-17T01:32:08.084110+0000","last_fullsized":"2024-09-17T01:32:08.084110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:37.765577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.081135+0000","last_change":"2024-09-17T01:32:07.078885+0000","last_active":"2024-09-17T01:32:08.081135+0000","last_peered":"2024-09-17T01:32:08.081135+0000","last_clean":"2024-09-17T01:32:08.081135+0000","last_became_active":"2024-09-17T01:32:07.078435+0000","last_became_peered":"2024-09-17T01:32:07.078435+0000","last_unstale":"2024-09-17T01:32:08.081135+0000","last_undegraded":"2024-09-17T01:32:08.081135+0000","last_fullsized":"2024-09-17T01:32:08.081135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:22:26.061474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.081581+0000","last_change":"2024-09-17T01:32:07.088794+0000","last_active":"2024-09-17T01:32:08.081581+0000","last_peered":"2024-09-17T01:32:08.081581+0000","last_clean":"2024-09-17T01:32:08.081581+0000","last_became_active":"2024-09-17T01:32:07.088354+0000","last_became_peered":"2024-09-17T01:32:07.088354+0000","last_unstale":"2024-09-17T01:32:08.081581+0000","last_undegraded":"2024-09-17T01:32:08.081581+0000","last_fullsized":"2024-09-17T01:32:08.081581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:04.151746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255400+0000","last_change":"2024-09-17T01:32:07.080283+0000","last_active":"2024-09-17T01:32:08.255400+0000","last_peered":"2024-09-17T01:32:08.255400+0000","last_clean":"2024-09-17T01:32:08.255400+0000","last_became_active":"2024-09-17T01:32:07.079956+0000","last_became_peered":"2024-09-17T01:32:07.079956+0000","last_unstale":"2024-09-17T01:32:08.255400+0000","last_undegraded":"2024-09-17T01:32:08.255400+0000","last_fullsized":"2024-09-17T01:32:08.255400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:35:07.968881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.253904+0000","last_change":"2024-09-17T01:32:07.085014+0000","last_active":"2024-09-17T01:32:08.253904+0000","last_peered":"2024-09-17T01:32:08.253904+0000","last_clean":"2024-09-17T01:32:08.253904+0000","last_became_active":"2024-09-17T01:32:07.084701+0000","last_became_peered":"2024-09-17T01:32:07.084701+0000","last_unstale":"2024-09-17T01:32:08.253904+0000","last_undegraded":"2024-09-17T01:32:08.253904+0000","last_fullsized":"2024-09-17T01:32:08.253904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:45.382776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255636+0000","last_change":"2024-09-17T01:32:07.095513+0000","last_active":"2024-09-17T01:32:08.255636+0000","last_peered":"2024-09-17T01:32:08.255636+0000","last_clean":"2024-09-17T01:32:08.255636+0000","last_became_active":"2024-09-17T01:32:07.090989+0000","last_became_peered":"2024-09-17T01:32:07.090989+0000","last_unstale":"2024-09-17T01:32:08.255636+0000","last_undegraded":"2024-09-17T01:32:08.255636+0000","last_fullsized":"2024-09-17T01:32:08.255636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:46.947860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254682+0000","last_change":"2024-09-17T01:32:07.097564+0000","last_active":"2024-09-17T01:32:08.254682+0000","last_peered":"2024-09-17T01:32:08.254682+0000","last_clean":"2024-09-17T01:32:08.254682+0000","last_became_active":"2024-09-17T01:32:07.096842+0000","last_became_peered":"2024-09-17T01:32:07.096842+0000","last_unstale":"2024-09-17T01:32:08.254682+0000","last_undegraded":"2024-09-17T01:32:08.254682+0000","last_fullsized":"2024-09-17T01:32:08.254682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:20.757148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255495+0000","last_change":"2024-09-17T01:32:07.076493+0000","last_active":"2024-09-17T01:32:08.255495+0000","last_peered":"2024-09-17T01:32:08.255495+0000","last_clean":"2024-09-17T01:32:08.255495+0000","last_became_active":"2024-09-17T01:32:07.076153+0000","last_became_peered":"2024-09-17T01:32:07.076153+0000","last_unstale":"2024-09-17T01:32:08.255495+0000","last_undegraded":"2024-09-17T01:32:08.255495+0000","last_fullsized":"2024-09-17T01:32:08.255495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:25.265447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084142+0000","last_change":"2024-09-17T01:32:07.074913+0000","last_active":"2024-09-17T01:32:08.084142+0000","last_peered":"2024-09-17T01:32:08.084142+0000","last_clean":"2024-09-17T01:32:08.084142+0000","last_became_active":"2024-09-17T01:32:07.074573+0000","last_became_peered":"2024-09-17T01:32:07.074573+0000","last_unstale":"2024-09-17T01:32:08.084142+0000","last_undegraded":"2024-09-17T01:32:08.084142+0000","last_fullsized":"2024-09-17T01:32:08.084142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:46.307074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079705+0000","last_change":"2024-09-17T01:32:07.072132+0000","last_active":"2024-09-17T01:32:08.079705+0000","last_peered":"2024-09-17T01:32:08.079705+0000","last_clean":"2024-09-17T01:32:08.079705+0000","last_became_active":"2024-09-17T01:32:07.071687+0000","last_became_peered":"2024-09-17T01:32:07.071687+0000","last_unstale":"2024-09-17T01:32:08.079705+0000","last_undegraded":"2024-09-17T01:32:08.079705+0000","last_fullsized":"2024-09-17T01:32:08.079705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:05:00.465504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.077563+0000","last_change":"2024-09-17T01:32:07.083167+0000","last_active":"2024-09-17T01:32:08.077563+0000","last_peered":"2024-09-17T01:32:08.077563+0000","last_clean":"2024-09-17T01:32:08.077563+0000","last_became_active":"2024-09-17T01:32:07.082843+0000","last_became_peered":"2024-09-17T01:32:07.082843+0000","last_unstale":"2024-09-17T01:32:08.077563+0000","last_undegraded":"2024-09-17T01:32:08.077563+0000","last_fullsized":"2024-09-17T01:32:08.077563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:33.769443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255226+0000","last_change":"2024-09-17T01:32:07.075509+0000","last_active":"2024-09-17T01:32:08.255226+0000","last_peered":"2024-09-17T01:32:08.255226+0000","last_clean":"2024-09-17T01:32:08.255226+0000","last_became_active":"2024-09-17T01:32:07.075146+0000","last_became_peered":"2024-09-17T01:32:07.075146+0000","last_unstale":"2024-09-17T01:32:08.255226+0000","last_undegraded":"2024-09-17T01:32:08.255226+0000","last_fullsized":"2024-09-17T01:32:08.255226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:47.850069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.253907+0000","last_change":"2024-09-17T01:32:07.092134+0000","last_active":"2024-09-17T01:32:08.253907+0000","last_peered":"2024-09-17T01:32:08.253907+0000","last_clean":"2024-09-17T01:32:08.253907+0000","last_became_active":"2024-09-17T01:32:07.091782+0000","last_became_peered":"2024-09-17T01:32:07.091782+0000","last_unstale":"2024-09-17T01:32:08.253907+0000","last_undegraded":"2024-09-17T01:32:08.253907+0000","last_fullsized":"2024-09-17T01:32:08.253907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:50.828833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255041+0000","last_change":"2024-09-17T01:32:07.091641+0000","last_active":"2024-09-17T01:32:08.255041+0000","last_peered":"2024-09-17T01:32:08.255041+0000","last_clean":"2024-09-17T01:32:08.255041+0000","last_became_active":"2024-09-17T01:32:07.091316+0000","last_became_peered":"2024-09-17T01:32:07.091316+0000","last_unstale":"2024-09-17T01:32:08.255041+0000","last_undegraded":"2024-09-17T01:32:08.255041+0000","last_fullsized":"2024-09-17T01:32:08.255041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:30.669754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254763+0000","last_change":"2024-09-17T01:32:07.097633+0000","last_active":"2024-09-17T01:32:08.254763+0000","last_peered":"2024-09-17T01:32:08.254763+0000","last_clean":"2024-09-17T01:32:08.254763+0000","last_became_active":"2024-09-17T01:32:07.092029+0000","last_became_peered":"2024-09-17T01:32:07.092029+0000","last_unstale":"2024-09-17T01:32:08.254763+0000","last_undegraded":"2024-09-17T01:32:08.254763+0000","last_fullsized":"2024-09-17T01:32:08.254763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:56.387025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080174+0000","last_change":"2024-09-17T01:32:07.070606+0000","last_active":"2024-09-17T01:32:08.080174+0000","last_peered":"2024-09-17T01:32:08.080174+0000","last_clean":"2024-09-17T01:32:08.080174+0000","last_became_active":"2024-09-17T01:32:07.070312+0000","last_became_peered":"2024-09-17T01:32:07.070312+0000","last_unstale":"2024-09-17T01:32:08.080174+0000","last_undegraded":"2024-09-17T01:32:08.080174+0000","last_fullsized":"2024-09-17T01:32:08.080174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:58.298740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079492+0000","last_change":"2024-09-17T01:32:07.086253+0000","last_active":"2024-09-17T01:32:08.079492+0000","last_peered":"2024-09-17T01:32:08.079492+0000","last_clean":"2024-09-17T01:32:08.079492+0000","last_became_active":"2024-09-17T01:32:07.085897+0000","last_became_peered":"2024-09-17T01:32:07.085897+0000","last_unstale":"2024-09-17T01:32:08.079492+0000","last_undegraded":"2024-09-17T01:32:08.079492+0000","last_fullsized":"2024-09-17T01:32:08.079492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:54.160964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254923+0000","last_change":"2024-09-17T01:32:07.080316+0000","last_active":"2024-09-17T01:32:08.254923+0000","last_peered":"2024-09-17T01:32:08.254923+0000","last_clean":"2024-09-17T01:32:08.254923+0000","last_became_active":"2024-09-17T01:32:07.079896+0000","last_became_peered":"2024-09-17T01:32:07.079896+0000","last_unstale":"2024-09-17T01:32:08.254923+0000","last_undegraded":"2024-09-17T01:32:08.254923+0000","last_fullsized":"2024-09-17T01:32:08.254923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:19.850165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254673+0000","last_change":"2024-09-17T01:32:07.092975+0000","last_active":"2024-09-17T01:32:08.254673+0000","last_peered":"2024-09-17T01:32:08.254673+0000","last_clean":"2024-09-17T01:32:08.254673+0000","last_became_active":"2024-09-17T01:32:07.090003+0000","last_became_peered":"2024-09-17T01:32:07.090003+0000","last_unstale":"2024-09-17T01:32:08.254673+0000","last_undegraded":"2024-09-17T01:32:08.254673+0000","last_fullsized":"2024-09-17T01:32:08.254673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:12.771004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254825+0000","last_change":"2024-09-17T01:32:07.079839+0000","last_active":"2024-09-17T01:32:08.254825+0000","last_peered":"2024-09-17T01:32:08.254825+0000","last_clean":"2024-09-17T01:32:08.254825+0000","last_became_active":"2024-09-17T01:32:07.079012+0000","last_became_peered":"2024-09-17T01:32:07.079012+0000","last_unstale":"2024-09-17T01:32:08.254825+0000","last_undegraded":"2024-09-17T01:32:08.254825+0000","last_fullsized":"2024-09-17T01:32:08.254825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:23.124830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254237+0000","last_change":"2024-09-17T01:32:07.076970+0000","last_active":"2024-09-17T01:32:08.254237+0000","last_peered":"2024-09-17T01:32:08.254237+0000","last_clean":"2024-09-17T01:32:08.254237+0000","last_became_active":"2024-09-17T01:32:07.072256+0000","last_became_peered":"2024-09-17T01:32:07.072256+0000","last_unstale":"2024-09-17T01:32:08.254237+0000","last_undegraded":"2024-09-17T01:32:08.254237+0000","last_fullsized":"2024-09-17T01:32:08.254237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:17.000817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.077708+0000","last_change":"2024-09-17T01:32:07.086593+0000","last_active":"2024-09-17T01:32:08.077708+0000","last_peered":"2024-09-17T01:32:08.077708+0000","last_clean":"2024-09-17T01:32:08.077708+0000","last_became_active":"2024-09-17T01:32:07.086265+0000","last_became_peered":"2024-09-17T01:32:07.086265+0000","last_unstale":"2024-09-17T01:32:08.077708+0000","last_undegraded":"2024-09-17T01:32:08.077708+0000","last_fullsized":"2024-09-17T01:32:08.077708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:59.076106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255106+0000","last_change":"2024-09-17T01:32:06.072600+0000","last_active":"2024-09-17T01:32:08.255106+0000","last_peered":"2024-09-17T01:32:08.255106+0000","last_clean":"2024-09-17T01:32:08.255106+0000","last_became_active":"2024-09-17T01:32:06.072280+0000","last_became_peered":"2024-09-17T01:32:06.072280+0000","last_unstale":"2024-09-17T01:32:08.255106+0000","last_undegraded":"2024-09-17T01:32:08.255106+0000","last_fullsized":"2024-09-17T01:32:08.255106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:24.693140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079998+0000","last_change":"2024-09-17T01:32:07.082615+0000","last_active":"2024-09-17T01:32:08.079998+0000","last_peered":"2024-09-17T01:32:08.079998+0000","last_clean":"2024-09-17T01:32:08.079998+0000","last_became_active":"2024-09-17T01:32:07.082266+0000","last_became_peered":"2024-09-17T01:32:07.082266+0000","last_unstale":"2024-09-17T01:32:08.079998+0000","last_undegraded":"2024-09-17T01:32:08.079998+0000","last_fullsized":"2024-09-17T01:32:08.079998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:34.677913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254763+0000","last_change":"2024-09-17T01:32:06.081486+0000","last_active":"2024-09-17T01:32:08.254763+0000","last_peered":"2024-09-17T01:32:08.254763+0000","last_clean":"2024-09-17T01:32:08.254763+0000","last_became_active":"2024-09-17T01:32:06.081193+0000","last_became_peered":"2024-09-17T01:32:06.081193+0000","last_unstale":"2024-09-17T01:32:08.254763+0000","last_undegraded":"2024-09-17T01:32:08.254763+0000","last_fullsized":"2024-09-17T01:32:08.254763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:53.154130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079445+0000","last_change":"2024-09-17T01:32:06.069305+0000","last_active":"2024-09-17T01:32:08.079445+0000","last_peered":"2024-09-17T01:32:08.079445+0000","last_clean":"2024-09-17T01:32:08.079445+0000","last_became_active":"2024-09-17T01:32:06.068652+0000","last_became_peered":"2024-09-17T01:32:06.068652+0000","last_unstale":"2024-09-17T01:32:08.079445+0000","last_undegraded":"2024-09-17T01:32:08.079445+0000","last_fullsized":"2024-09-17T01:32:08.079445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:48.494445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255548+0000","last_change":"2024-09-17T01:32:07.087945+0000","last_active":"2024-09-17T01:32:08.255548+0000","last_peered":"2024-09-17T01:32:08.255548+0000","last_clean":"2024-09-17T01:32:08.255548+0000","last_became_active":"2024-09-17T01:32:07.081997+0000","last_became_peered":"2024-09-17T01:32:07.081997+0000","last_unstale":"2024-09-17T01:32:08.255548+0000","last_undegraded":"2024-09-17T01:32:08.255548+0000","last_fullsized":"2024-09-17T01:32:08.255548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:25.453779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254032+0000","last_change":"2024-09-17T01:32:06.064957+0000","last_active":"2024-09-17T01:32:08.254032+0000","last_peered":"2024-09-17T01:32:08.254032+0000","last_clean":"2024-09-17T01:32:08.254032+0000","last_became_active":"2024-09-17T01:32:06.064565+0000","last_became_peered":"2024-09-17T01:32:06.064565+0000","last_unstale":"2024-09-17T01:32:08.254032+0000","last_undegraded":"2024-09-17T01:32:08.254032+0000","last_fullsized":"2024-09-17T01:32:08.254032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:41.844576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079397+0000","last_change":"2024-09-17T01:32:07.068057+0000","last_active":"2024-09-17T01:32:08.079397+0000","last_peered":"2024-09-17T01:32:08.079397+0000","last_clean":"2024-09-17T01:32:08.079397+0000","last_became_active":"2024-09-17T01:32:07.067735+0000","last_became_peered":"2024-09-17T01:32:07.067735+0000","last_unstale":"2024-09-17T01:32:08.079397+0000","last_undegraded":"2024-09-17T01:32:08.079397+0000","last_fullsized":"2024-09-17T01:32:08.079397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:42.854196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.078116+0000","last_change":"2024-09-17T01:32:06.061484+0000","last_active":"2024-09-17T01:32:08.078116+0000","last_peered":"2024-09-17T01:32:08.078116+0000","last_clean":"2024-09-17T01:32:08.078116+0000","last_became_active":"2024-09-17T01:32:06.061082+0000","last_became_peered":"2024-09-17T01:32:06.061082+0000","last_unstale":"2024-09-17T01:32:08.078116+0000","last_undegraded":"2024-09-17T01:32:08.078116+0000","last_fullsized":"2024-09-17T01:32:08.078116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:57.830631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254780+0000","last_change":"2024-09-17T01:32:07.098046+0000","last_active":"2024-09-17T01:32:08.254780+0000","last_peered":"2024-09-17T01:32:08.254780+0000","last_clean":"2024-09-17T01:32:08.254780+0000","last_became_active":"2024-09-17T01:32:07.094416+0000","last_became_peered":"2024-09-17T01:32:07.094416+0000","last_unstale":"2024-09-17T01:32:08.254780+0000","last_undegraded":"2024-09-17T01:32:08.254780+0000","last_fullsized":"2024-09-17T01:32:08.254780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:28.815131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084431+0000","last_change":"2024-09-17T01:32:06.072252+0000","last_active":"2024-09-17T01:32:08.084431+0000","last_peered":"2024-09-17T01:32:08.084431+0000","last_clean":"2024-09-17T01:32:08.084431+0000","last_became_active":"2024-09-17T01:32:06.071868+0000","last_became_peered":"2024-09-17T01:32:06.071868+0000","last_unstale":"2024-09-17T01:32:08.084431+0000","last_undegraded":"2024-09-17T01:32:08.084431+0000","last_fullsized":"2024-09-17T01:32:08.084431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:32.739722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255545+0000","last_change":"2024-09-17T01:32:07.101387+0000","last_active":"2024-09-17T01:32:08.255545+0000","last_peered":"2024-09-17T01:32:08.255545+0000","last_clean":"2024-09-17T01:32:08.255545+0000","last_became_active":"2024-09-17T01:32:07.101077+0000","last_became_peered":"2024-09-17T01:32:07.101077+0000","last_unstale":"2024-09-17T01:32:08.255545+0000","last_undegraded":"2024-09-17T01:32:08.255545+0000","last_fullsized":"2024-09-17T01:32:08.255545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:36:23.728414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254880+0000","last_change":"2024-09-17T01:32:06.061334+0000","last_active":"2024-09-17T01:32:08.254880+0000","last_peered":"2024-09-17T01:32:08.254880+0000","last_clean":"2024-09-17T01:32:08.254880+0000","last_became_active":"2024-09-17T01:32:06.061062+0000","last_became_peered":"2024-09-17T01:32:06.061062+0000","last_unstale":"2024-09-17T01:32:08.254880+0000","last_undegraded":"2024-09-17T01:32:08.254880+0000","last_fullsized":"2024-09-17T01:32:08.254880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:26.325842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255304+0000","last_change":"2024-09-17T01:32:07.089550+0000","last_active":"2024-09-17T01:32:08.255304+0000","last_peered":"2024-09-17T01:32:08.255304+0000","last_clean":"2024-09-17T01:32:08.255304+0000","last_became_active":"2024-09-17T01:32:07.089255+0000","last_became_peered":"2024-09-17T01:32:07.089255+0000","last_unstale":"2024-09-17T01:32:08.255304+0000","last_undegraded":"2024-09-17T01:32:08.255304+0000","last_fullsized":"2024-09-17T01:32:08.255304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:40.540113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254393+0000","last_change":"2024-09-17T01:32:06.062145+0000","last_active":"2024-09-17T01:32:08.254393+0000","last_peered":"2024-09-17T01:32:08.254393+0000","last_clean":"2024-09-17T01:32:08.254393+0000","last_became_active":"2024-09-17T01:32:06.061691+0000","last_became_peered":"2024-09-17T01:32:06.061691+0000","last_unstale":"2024-09-17T01:32:08.254393+0000","last_undegraded":"2024-09-17T01:32:08.254393+0000","last_fullsized":"2024-09-17T01:32:08.254393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:52.657492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084154+0000","last_change":"2024-09-17T01:32:07.078612+0000","last_active":"2024-09-17T01:32:08.084154+0000","last_peered":"2024-09-17T01:32:08.084154+0000","last_clean":"2024-09-17T01:32:08.084154+0000","last_became_active":"2024-09-17T01:32:07.078227+0000","last_became_peered":"2024-09-17T01:32:07.078227+0000","last_unstale":"2024-09-17T01:32:08.084154+0000","last_undegraded":"2024-09-17T01:32:08.084154+0000","last_fullsized":"2024-09-17T01:32:08.084154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:54.702390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254498+0000","last_change":"2024-09-17T01:32:06.083372+0000","last_active":"2024-09-17T01:32:08.254498+0000","last_peered":"2024-09-17T01:32:08.254498+0000","last_clean":"2024-09-17T01:32:08.254498+0000","last_became_active":"2024-09-17T01:32:06.082955+0000","last_became_peered":"2024-09-17T01:32:06.082955+0000","last_unstale":"2024-09-17T01:32:08.254498+0000","last_undegraded":"2024-09-17T01:32:08.254498+0000","last_fullsized":"2024-09-17T01:32:08.254498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:48.494445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.081245+0000","last_change":"2024-09-17T01:32:07.090664+0000","last_active":"2024-09-17T01:32:08.081245+0000","last_peered":"2024-09-17T01:32:08.081245+0000","last_clean":"2024-09-17T01:32:08.081245+0000","last_became_active":"2024-09-17T01:32:07.090142+0000","last_became_peered":"2024-09-17T01:32:07.090142+0000","last_unstale":"2024-09-17T01:32:08.081245+0000","last_undegraded":"2024-09-17T01:32:08.081245+0000","last_fullsized":"2024-09-17T01:32:08.081245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:37.231363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254829+0000","last_change":"2024-09-17T01:32:06.059219+0000","last_active":"2024-09-17T01:32:08.254829+0000","last_peered":"2024-09-17T01:32:08.254829+0000","last_clean":"2024-09-17T01:32:08.254829+0000","last_became_active":"2024-09-17T01:32:06.058230+0000","last_became_peered":"2024-09-17T01:32:06.058230+0000","last_unstale":"2024-09-17T01:32:08.254829+0000","last_undegraded":"2024-09-17T01:32:08.254829+0000","last_fullsized":"2024-09-17T01:32:08.254829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:53.345377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254873+0000","last_change":"2024-09-17T01:32:07.089933+0000","last_active":"2024-09-17T01:32:08.254873+0000","last_peered":"2024-09-17T01:32:08.254873+0000","last_clean":"2024-09-17T01:32:08.254873+0000","last_became_active":"2024-09-17T01:32:07.080900+0000","last_became_peered":"2024-09-17T01:32:07.080900+0000","last_unstale":"2024-09-17T01:32:08.254873+0000","last_undegraded":"2024-09-17T01:32:08.254873+0000","last_fullsized":"2024-09-17T01:32:08.254873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:07:38.397880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.083659+0000","last_change":"2024-09-17T01:32:06.079871+0000","last_active":"2024-09-17T01:32:08.083659+0000","last_peered":"2024-09-17T01:32:08.083659+0000","last_clean":"2024-09-17T01:32:08.083659+0000","last_became_active":"2024-09-17T01:32:06.079581+0000","last_became_peered":"2024-09-17T01:32:06.079581+0000","last_unstale":"2024-09-17T01:32:08.083659+0000","last_undegraded":"2024-09-17T01:32:08.083659+0000","last_fullsized":"2024-09-17T01:32:08.083659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:37.449372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.077508+0000","last_change":"2024-09-17T01:32:07.089282+0000","last_active":"2024-09-17T01:32:08.077508+0000","last_peered":"2024-09-17T01:32:08.077508+0000","last_clean":"2024-09-17T01:32:08.077508+0000","last_became_active":"2024-09-17T01:32:07.088928+0000","last_became_peered":"2024-09-17T01:32:07.088928+0000","last_unstale":"2024-09-17T01:32:08.077508+0000","last_undegraded":"2024-09-17T01:32:08.077508+0000","last_fullsized":"2024-09-17T01:32:08.077508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:58.786102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080466+0000","last_change":"2024-09-17T01:32:06.053867+0000","last_active":"2024-09-17T01:32:08.080466+0000","last_peered":"2024-09-17T01:32:08.080466+0000","last_clean":"2024-09-17T01:32:08.080466+0000","last_became_active":"2024-09-17T01:32:06.053466+0000","last_became_peered":"2024-09-17T01:32:06.053466+0000","last_unstale":"2024-09-17T01:32:08.080466+0000","last_undegraded":"2024-09-17T01:32:08.080466+0000","last_fullsized":"2024-09-17T01:32:08.080466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:33.901561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254246+0000","last_change":"2024-09-17T01:32:07.095265+0000","last_active":"2024-09-17T01:32:08.254246+0000","last_peered":"2024-09-17T01:32:08.254246+0000","last_clean":"2024-09-17T01:32:08.254246+0000","last_became_active":"2024-09-17T01:32:07.094979+0000","last_became_peered":"2024-09-17T01:32:07.094979+0000","last_unstale":"2024-09-17T01:32:08.254246+0000","last_undegraded":"2024-09-17T01:32:08.254246+0000","last_fullsized":"2024-09-17T01:32:08.254246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:38.558917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084880+0000","last_change":"2024-09-17T01:32:06.083417+0000","last_active":"2024-09-17T01:32:08.084880+0000","last_peered":"2024-09-17T01:32:08.084880+0000","last_clean":"2024-09-17T01:32:08.084880+0000","last_became_active":"2024-09-17T01:32:06.082378+0000","last_became_peered":"2024-09-17T01:32:06.082378+0000","last_unstale":"2024-09-17T01:32:08.084880+0000","last_undegraded":"2024-09-17T01:32:08.084880+0000","last_fullsized":"2024-09-17T01:32:08.084880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:37:12.138471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254924+0000","last_change":"2024-09-17T01:32:07.087871+0000","last_active":"2024-09-17T01:32:08.254924+0000","last_peered":"2024-09-17T01:32:08.254924+0000","last_clean":"2024-09-17T01:32:08.254924+0000","last_became_active":"2024-09-17T01:32:07.086811+0000","last_became_peered":"2024-09-17T01:32:07.086811+0000","last_unstale":"2024-09-17T01:32:08.254924+0000","last_undegraded":"2024-09-17T01:32:08.254924+0000","last_fullsized":"2024-09-17T01:32:08.254924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:47.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080419+0000","last_change":"2024-09-17T01:32:06.067533+0000","last_active":"2024-09-17T01:32:08.080419+0000","last_peered":"2024-09-17T01:32:08.080419+0000","last_clean":"2024-09-17T01:32:08.080419+0000","last_became_active":"2024-09-17T01:32:06.066265+0000","last_became_peered":"2024-09-17T01:32:06.066265+0000","last_unstale":"2024-09-17T01:32:08.080419+0000","last_undegraded":"2024-09-17T01:32:08.080419+0000","last_fullsized":"2024-09-17T01:32:08.080419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:05.206992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084686+0000","last_change":"2024-09-17T01:32:07.075279+0000","last_active":"2024-09-17T01:32:08.084686+0000","last_peered":"2024-09-17T01:32:08.084686+0000","last_clean":"2024-09-17T01:32:08.084686+0000","last_became_active":"2024-09-17T01:32:07.073899+0000","last_became_peered":"2024-09-17T01:32:07.073899+0000","last_unstale":"2024-09-17T01:32:08.084686+0000","last_undegraded":"2024-09-17T01:32:08.084686+0000","last_fullsized":"2024-09-17T01:32:08.084686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:19:18.340646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254712+0000","last_change":"2024-09-17T01:32:06.071046+0000","last_active":"2024-09-17T01:32:08.254712+0000","last_peered":"2024-09-17T01:32:08.254712+0000","last_clean":"2024-09-17T01:32:08.254712+0000","last_became_active":"2024-09-17T01:32:06.070668+0000","last_became_peered":"2024-09-17T01:32:06.070668+0000","last_unstale":"2024-09-17T01:32:08.254712+0000","last_undegraded":"2024-09-17T01:32:08.254712+0000","last_fullsized":"2024-09-17T01:32:08.254712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:51.537157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084349+0000","last_change":"2024-09-17T01:32:07.081930+0000","last_active":"2024-09-17T01:32:08.084349+0000","last_peered":"2024-09-17T01:32:08.084349+0000","last_clean":"2024-09-17T01:32:08.084349+0000","last_became_active":"2024-09-17T01:32:07.081525+0000","last_became_peered":"2024-09-17T01:32:07.081525+0000","last_unstale":"2024-09-17T01:32:08.084349+0000","last_undegraded":"2024-09-17T01:32:08.084349+0000","last_fullsized":"2024-09-17T01:32:08.084349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:45.382776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079908+0000","last_change":"2024-09-17T01:32:06.071392+0000","last_active":"2024-09-17T01:32:08.079908+0000","last_peered":"2024-09-17T01:32:08.079908+0000","last_clean":"2024-09-17T01:32:08.079908+0000","last_became_active":"2024-09-17T01:32:06.070869+0000","last_became_peered":"2024-09-17T01:32:06.070869+0000","last_unstale":"2024-09-17T01:32:08.079908+0000","last_undegraded":"2024-09-17T01:32:08.079908+0000","last_fullsized":"2024-09-17T01:32:08.079908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:26.325842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255344+0000","last_change":"2024-09-17T01:32:07.076689+0000","last_active":"2024-09-17T01:32:08.255344+0000","last_peered":"2024-09-17T01:32:08.255344+0000","last_clean":"2024-09-17T01:32:08.255344+0000","last_became_active":"2024-09-17T01:32:07.076399+0000","last_became_peered":"2024-09-17T01:32:07.076399+0000","last_unstale":"2024-09-17T01:32:08.255344+0000","last_undegraded":"2024-09-17T01:32:08.255344+0000","last_fullsized":"2024-09-17T01:32:08.255344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:20.255648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.077377+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:32:08.077377+0000","last_peered":"2024-09-17T01:32:08.077377+0000","last_clean":"2024-09-17T01:32:08.077377+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:32:08.077377+0000","last_undegraded":"2024-09-17T01:32:08.077377+0000","last_fullsized":"2024-09-17T01:32:08.077377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255076+0000","last_change":"2024-09-17T01:32:06.064934+0000","last_active":"2024-09-17T01:32:08.255076+0000","last_peered":"2024-09-17T01:32:08.255076+0000","last_clean":"2024-09-17T01:32:08.255076+0000","last_became_active":"2024-09-17T01:32:06.064552+0000","last_became_peered":"2024-09-17T01:32:06.064552+0000","last_unstale":"2024-09-17T01:32:08.255076+0000","last_undegraded":"2024-09-17T01:32:08.255076+0000","last_fullsized":"2024-09-17T01:32:08.255076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:46:21.965124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080286+0000","last_change":"2024-09-17T01:32:07.071839+0000","last_active":"2024-09-17T01:32:08.080286+0000","last_peered":"2024-09-17T01:32:08.080286+0000","last_clean":"2024-09-17T01:32:08.080286+0000","last_became_active":"2024-09-17T01:32:07.071512+0000","last_became_peered":"2024-09-17T01:32:07.071512+0000","last_unstale":"2024-09-17T01:32:08.080286+0000","last_undegraded":"2024-09-17T01:32:08.080286+0000","last_fullsized":"2024-09-17T01:32:08.080286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:10.661342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254134+0000","last_change":"2024-09-17T01:32:06.070832+0000","last_active":"2024-09-17T01:32:08.254134+0000","last_peered":"2024-09-17T01:32:08.254134+0000","last_clean":"2024-09-17T01:32:08.254134+0000","last_became_active":"2024-09-17T01:32:06.070149+0000","last_became_peered":"2024-09-17T01:32:06.070149+0000","last_unstale":"2024-09-17T01:32:08.254134+0000","last_undegraded":"2024-09-17T01:32:08.254134+0000","last_fullsized":"2024-09-17T01:32:08.254134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:32.739722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079316+0000","last_change":"2024-09-17T01:32:07.075984+0000","last_active":"2024-09-17T01:32:08.079316+0000","last_peered":"2024-09-17T01:32:08.079316+0000","last_clean":"2024-09-17T01:32:08.079316+0000","last_became_active":"2024-09-17T01:32:07.074619+0000","last_became_peered":"2024-09-17T01:32:07.074619+0000","last_unstale":"2024-09-17T01:32:08.079316+0000","last_undegraded":"2024-09-17T01:32:08.079316+0000","last_fullsized":"2024-09-17T01:32:08.079316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:34.608401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254201+0000","last_change":"2024-09-17T01:32:06.071910+0000","last_active":"2024-09-17T01:32:08.254201+0000","last_peered":"2024-09-17T01:32:08.254201+0000","last_clean":"2024-09-17T01:32:08.254201+0000","last_became_active":"2024-09-17T01:32:06.071001+0000","last_became_peered":"2024-09-17T01:32:06.071001+0000","last_unstale":"2024-09-17T01:32:08.254201+0000","last_undegraded":"2024-09-17T01:32:08.254201+0000","last_fullsized":"2024-09-17T01:32:08.254201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:02.474882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255127+0000","last_change":"2024-09-17T01:32:07.081167+0000","last_active":"2024-09-17T01:32:08.255127+0000","last_peered":"2024-09-17T01:32:08.255127+0000","last_clean":"2024-09-17T01:32:08.255127+0000","last_became_active":"2024-09-17T01:32:07.080055+0000","last_became_peered":"2024-09-17T01:32:07.080055+0000","last_unstale":"2024-09-17T01:32:08.255127+0000","last_undegraded":"2024-09-17T01:32:08.255127+0000","last_fullsized":"2024-09-17T01:32:08.255127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:39:36.609246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254883+0000","last_change":"2024-09-17T01:32:06.069316+0000","last_active":"2024-09-17T01:32:08.254883+0000","last_peered":"2024-09-17T01:32:08.254883+0000","last_clean":"2024-09-17T01:32:08.254883+0000","last_became_active":"2024-09-17T01:32:06.069002+0000","last_became_peered":"2024-09-17T01:32:06.069002+0000","last_unstale":"2024-09-17T01:32:08.254883+0000","last_undegraded":"2024-09-17T01:32:08.254883+0000","last_fullsized":"2024-09-17T01:32:08.254883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:57.291905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.083961+0000","last_change":"2024-09-17T01:32:07.095194+0000","last_active":"2024-09-17T01:32:08.083961+0000","last_peered":"2024-09-17T01:32:08.083961+0000","last_clean":"2024-09-17T01:32:08.083961+0000","last_became_active":"2024-09-17T01:32:07.090236+0000","last_became_peered":"2024-09-17T01:32:07.090236+0000","last_unstale":"2024-09-17T01:32:08.083961+0000","last_undegraded":"2024-09-17T01:32:08.083961+0000","last_fullsized":"2024-09-17T01:32:08.083961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:25.383324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254579+0000","last_change":"2024-09-17T01:32:06.073180+0000","last_active":"2024-09-17T01:32:08.254579+0000","last_peered":"2024-09-17T01:32:08.254579+0000","last_clean":"2024-09-17T01:32:08.254579+0000","last_became_active":"2024-09-17T01:32:06.072812+0000","last_became_peered":"2024-09-17T01:32:06.072812+0000","last_unstale":"2024-09-17T01:32:08.254579+0000","last_undegraded":"2024-09-17T01:32:08.254579+0000","last_fullsized":"2024-09-17T01:32:08.254579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:24.568357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254543+0000","last_change":"2024-09-17T01:32:07.068573+0000","last_active":"2024-09-17T01:32:08.254543+0000","last_peered":"2024-09-17T01:32:08.254543+0000","last_clean":"2024-09-17T01:32:08.254543+0000","last_became_active":"2024-09-17T01:32:07.068144+0000","last_became_peered":"2024-09-17T01:32:07.068144+0000","last_unstale":"2024-09-17T01:32:08.254543+0000","last_undegraded":"2024-09-17T01:32:08.254543+0000","last_fullsized":"2024-09-17T01:32:08.254543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:54.256529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255437+0000","last_change":"2024-09-17T01:32:06.067526+0000","last_active":"2024-09-17T01:32:08.255437+0000","last_peered":"2024-09-17T01:32:08.255437+0000","last_clean":"2024-09-17T01:32:08.255437+0000","last_became_active":"2024-09-17T01:32:06.062575+0000","last_became_peered":"2024-09-17T01:32:06.062575+0000","last_unstale":"2024-09-17T01:32:08.255437+0000","last_undegraded":"2024-09-17T01:32:08.255437+0000","last_fullsized":"2024-09-17T01:32:08.255437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:33.601567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079730+0000","last_change":"2024-09-17T01:32:07.092156+0000","last_active":"2024-09-17T01:32:08.079730+0000","last_peered":"2024-09-17T01:32:08.079730+0000","last_clean":"2024-09-17T01:32:08.079730+0000","last_became_active":"2024-09-17T01:32:07.091367+0000","last_became_peered":"2024-09-17T01:32:07.091367+0000","last_unstale":"2024-09-17T01:32:08.079730+0000","last_undegraded":"2024-09-17T01:32:08.079730+0000","last_fullsized":"2024-09-17T01:32:08.079730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:54.352211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.082733+0000","last_change":"2024-09-17T01:32:06.077965+0000","last_active":"2024-09-17T01:32:08.082733+0000","last_peered":"2024-09-17T01:32:08.082733+0000","last_clean":"2024-09-17T01:32:08.082733+0000","last_became_active":"2024-09-17T01:32:06.077187+0000","last_became_peered":"2024-09-17T01:32:06.077187+0000","last_unstale":"2024-09-17T01:32:08.082733+0000","last_undegraded":"2024-09-17T01:32:08.082733+0000","last_fullsized":"2024-09-17T01:32:08.082733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:19.750313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080529+0000","last_change":"2024-09-17T01:32:07.066284+0000","last_active":"2024-09-17T01:32:08.080529+0000","last_peered":"2024-09-17T01:32:08.080529+0000","last_clean":"2024-09-17T01:32:08.080529+0000","last_became_active":"2024-09-17T01:32:07.065959+0000","last_became_peered":"2024-09-17T01:32:07.065959+0000","last_unstale":"2024-09-17T01:32:08.080529+0000","last_undegraded":"2024-09-17T01:32:08.080529+0000","last_fullsized":"2024-09-17T01:32:08.080529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:48:15.533537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255574+0000","last_change":"2024-09-17T01:32:06.081435+0000","last_active":"2024-09-17T01:32:08.255574+0000","last_peered":"2024-09-17T01:32:08.255574+0000","last_clean":"2024-09-17T01:32:08.255574+0000","last_became_active":"2024-09-17T01:32:06.081122+0000","last_became_peered":"2024-09-17T01:32:06.081122+0000","last_unstale":"2024-09-17T01:32:08.255574+0000","last_undegraded":"2024-09-17T01:32:08.255574+0000","last_fullsized":"2024-09-17T01:32:08.255574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:22:25.054640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080231+0000","last_change":"2024-09-17T01:32:07.082941+0000","last_active":"2024-09-17T01:32:08.080231+0000","last_peered":"2024-09-17T01:32:08.080231+0000","last_clean":"2024-09-17T01:32:08.080231+0000","last_became_active":"2024-09-17T01:32:07.082576+0000","last_became_peered":"2024-09-17T01:32:07.082576+0000","last_unstale":"2024-09-17T01:32:08.080231+0000","last_undegraded":"2024-09-17T01:32:08.080231+0000","last_fullsized":"2024-09-17T01:32:08.080231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:52.970626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.083470+0000","last_change":"2024-09-17T01:32:06.078725+0000","last_active":"2024-09-17T01:32:08.083470+0000","last_peered":"2024-09-17T01:32:08.083470+0000","last_clean":"2024-09-17T01:32:08.083470+0000","last_became_active":"2024-09-17T01:32:06.074072+0000","last_became_peered":"2024-09-17T01:32:06.074072+0000","last_unstale":"2024-09-17T01:32:08.083470+0000","last_undegraded":"2024-09-17T01:32:08.083470+0000","last_fullsized":"2024-09-17T01:32:08.083470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:41.844576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254467+0000","last_change":"2024-09-17T01:32:07.092928+0000","last_active":"2024-09-17T01:32:08.254467+0000","last_peered":"2024-09-17T01:32:08.254467+0000","last_clean":"2024-09-17T01:32:08.254467+0000","last_became_active":"2024-09-17T01:32:07.079859+0000","last_became_peered":"2024-09-17T01:32:07.079859+0000","last_unstale":"2024-09-17T01:32:08.254467+0000","last_undegraded":"2024-09-17T01:32:08.254467+0000","last_fullsized":"2024-09-17T01:32:08.254467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:14.465400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.081017+0000","last_change":"2024-09-17T01:32:06.076537+0000","last_active":"2024-09-17T01:32:08.081017+0000","last_peered":"2024-09-17T01:32:08.081017+0000","last_clean":"2024-09-17T01:32:08.081017+0000","last_became_active":"2024-09-17T01:32:06.076002+0000","last_became_peered":"2024-09-17T01:32:06.076002+0000","last_unstale":"2024-09-17T01:32:08.081017+0000","last_undegraded":"2024-09-17T01:32:08.081017+0000","last_fullsized":"2024-09-17T01:32:08.081017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:22.117996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080195+0000","last_change":"2024-09-17T01:32:07.069777+0000","last_active":"2024-09-17T01:32:08.080195+0000","last_peered":"2024-09-17T01:32:08.080195+0000","last_clean":"2024-09-17T01:32:08.080195+0000","last_became_active":"2024-09-17T01:32:07.069387+0000","last_became_peered":"2024-09-17T01:32:07.069387+0000","last_unstale":"2024-09-17T01:32:08.080195+0000","last_undegraded":"2024-09-17T01:32:08.080195+0000","last_fullsized":"2024-09-17T01:32:08.080195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:54.341372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.081349+0000","last_change":"2024-09-17T01:32:06.067797+0000","last_active":"2024-09-17T01:32:08.081349+0000","last_peered":"2024-09-17T01:32:08.081349+0000","last_clean":"2024-09-17T01:32:08.081349+0000","last_became_active":"2024-09-17T01:32:06.067441+0000","last_became_peered":"2024-09-17T01:32:06.067441+0000","last_unstale":"2024-09-17T01:32:08.081349+0000","last_undegraded":"2024-09-17T01:32:08.081349+0000","last_fullsized":"2024-09-17T01:32:08.081349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:25.112393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255127+0000","last_change":"2024-09-17T01:32:07.099514+0000","last_active":"2024-09-17T01:32:08.255127+0000","last_peered":"2024-09-17T01:32:08.255127+0000","last_clean":"2024-09-17T01:32:08.255127+0000","last_became_active":"2024-09-17T01:32:07.099001+0000","last_became_peered":"2024-09-17T01:32:07.099001+0000","last_unstale":"2024-09-17T01:32:08.255127+0000","last_undegraded":"2024-09-17T01:32:08.255127+0000","last_fullsized":"2024-09-17T01:32:08.255127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:22:13.835193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255013+0000","last_change":"2024-09-17T01:32:06.066117+0000","last_active":"2024-09-17T01:32:08.255013+0000","last_peered":"2024-09-17T01:32:08.255013+0000","last_clean":"2024-09-17T01:32:08.255013+0000","last_became_active":"2024-09-17T01:32:06.065785+0000","last_became_peered":"2024-09-17T01:32:06.065785+0000","last_unstale":"2024-09-17T01:32:08.255013+0000","last_undegraded":"2024-09-17T01:32:08.255013+0000","last_fullsized":"2024-09-17T01:32:08.255013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:30.380597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254888+0000","last_change":"2024-09-17T01:32:07.090458+0000","last_active":"2024-09-17T01:32:08.254888+0000","last_peered":"2024-09-17T01:32:08.254888+0000","last_clean":"2024-09-17T01:32:08.254888+0000","last_became_active":"2024-09-17T01:32:07.078369+0000","last_became_peered":"2024-09-17T01:32:07.078369+0000","last_unstale":"2024-09-17T01:32:08.254888+0000","last_undegraded":"2024-09-17T01:32:08.254888+0000","last_fullsized":"2024-09-17T01:32:08.254888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:00.888206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255221+0000","last_change":"2024-09-17T01:32:07.092688+0000","last_active":"2024-09-17T01:32:08.255221+0000","last_peered":"2024-09-17T01:32:08.255221+0000","last_clean":"2024-09-17T01:32:08.255221+0000","last_became_active":"2024-09-17T01:32:07.085320+0000","last_became_peered":"2024-09-17T01:32:07.085320+0000","last_unstale":"2024-09-17T01:32:08.255221+0000","last_undegraded":"2024-09-17T01:32:08.255221+0000","last_fullsized":"2024-09-17T01:32:08.255221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:14.220903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084367+0000","last_change":"2024-09-17T01:32:06.070361+0000","last_active":"2024-09-17T01:32:08.084367+0000","last_peered":"2024-09-17T01:32:08.084367+0000","last_clean":"2024-09-17T01:32:08.084367+0000","last_became_active":"2024-09-17T01:32:06.069832+0000","last_became_peered":"2024-09-17T01:32:06.069832+0000","last_unstale":"2024-09-17T01:32:08.084367+0000","last_undegraded":"2024-09-17T01:32:08.084367+0000","last_fullsized":"2024-09-17T01:32:08.084367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:30.380597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.077817+0000","last_change":"2024-09-17T01:32:07.084781+0000","last_active":"2024-09-17T01:32:08.077817+0000","last_peered":"2024-09-17T01:32:08.077817+0000","last_clean":"2024-09-17T01:32:08.077817+0000","last_became_active":"2024-09-17T01:32:07.084442+0000","last_became_peered":"2024-09-17T01:32:07.084442+0000","last_unstale":"2024-09-17T01:32:08.077817+0000","last_undegraded":"2024-09-17T01:32:08.077817+0000","last_fullsized":"2024-09-17T01:32:08.077817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:01:03.298687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084291+0000","last_change":"2024-09-17T01:32:06.075745+0000","last_active":"2024-09-17T01:32:08.084291+0000","last_peered":"2024-09-17T01:32:08.084291+0000","last_clean":"2024-09-17T01:32:08.084291+0000","last_became_active":"2024-09-17T01:32:06.074453+0000","last_became_peered":"2024-09-17T01:32:06.074453+0000","last_unstale":"2024-09-17T01:32:08.084291+0000","last_undegraded":"2024-09-17T01:32:08.084291+0000","last_fullsized":"2024-09-17T01:32:08.084291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:04.657692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255266+0000","last_change":"2024-09-17T01:32:07.091674+0000","last_active":"2024-09-17T01:32:08.255266+0000","last_peered":"2024-09-17T01:32:08.255266+0000","last_clean":"2024-09-17T01:32:08.255266+0000","last_became_active":"2024-09-17T01:32:07.091348+0000","last_became_peered":"2024-09-17T01:32:07.091348+0000","last_unstale":"2024-09-17T01:32:08.255266+0000","last_undegraded":"2024-09-17T01:32:08.255266+0000","last_fullsized":"2024-09-17T01:32:08.255266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:31.725598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255418+0000","last_change":"2024-09-17T01:32:06.074404+0000","last_active":"2024-09-17T01:32:08.255418+0000","last_peered":"2024-09-17T01:32:08.255418+0000","last_clean":"2024-09-17T01:32:08.255418+0000","last_became_active":"2024-09-17T01:32:06.074047+0000","last_became_peered":"2024-09-17T01:32:06.074047+0000","last_unstale":"2024-09-17T01:32:08.255418+0000","last_undegraded":"2024-09-17T01:32:08.255418+0000","last_fullsized":"2024-09-17T01:32:08.255418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:26.446474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255142+0000","last_change":"2024-09-17T01:32:07.084694+0000","last_active":"2024-09-17T01:32:08.255142+0000","last_peered":"2024-09-17T01:32:08.255142+0000","last_clean":"2024-09-17T01:32:08.255142+0000","last_became_active":"2024-09-17T01:32:07.084387+0000","last_became_peered":"2024-09-17T01:32:07.084387+0000","last_unstale":"2024-09-17T01:32:08.255142+0000","last_undegraded":"2024-09-17T01:32:08.255142+0000","last_fullsized":"2024-09-17T01:32:08.255142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:01.007924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080774+0000","last_change":"2024-09-17T01:32:06.063395+0000","last_active":"2024-09-17T01:32:08.080774+0000","last_peered":"2024-09-17T01:32:08.080774+0000","last_clean":"2024-09-17T01:32:08.080774+0000","last_became_active":"2024-09-17T01:32:06.062964+0000","last_became_peered":"2024-09-17T01:32:06.062964+0000","last_unstale":"2024-09-17T01:32:08.080774+0000","last_undegraded":"2024-09-17T01:32:08.080774+0000","last_fullsized":"2024-09-17T01:32:08.080774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:26.591137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476743,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":233472,"data_stored":78414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":76926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":76802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":241664,"data_stored":79086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":225280,"data_stored":77384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":819200,"data_stored":667240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":76858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":823296,"data_stored":667262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:32:15.982 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:32:16.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.247+0000 7fcc76e00640 1 -- 172.21.15.42:0/2360939683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc7015f480 msgr2=0x7fcc7015f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:16.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.247+0000 7fcc76e00640 1 --2- 172.21.15.42:0/2360939683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc7015f480 0x7fcc7015f890 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcc700b3280 tx=0x7fcc6802aa10 comp rx=0 tx=0).stop 2024-09-17T01:32:16.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.247+0000 7fcc76e00640 1 -- 172.21.15.42:0/2360939683 shutdown_connections 2024-09-17T01:32:16.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.247+0000 7fcc76e00640 1 --2- 172.21.15.42:0/2360939683 >> v2:172.21.15.43:3300/0 conn(0x7fcc7006d430 0x7fcc7006d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:16.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.247+0000 7fcc76e00640 1 --2- 172.21.15.42:0/2360939683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc7015f480 0x7fcc7015f890 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:16.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.247+0000 7fcc76e00640 1 --2- 172.21.15.42:0/2360939683 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcc7015cb80 0x7fcc70152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:16.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.247+0000 7fcc76e00640 1 -- 172.21.15.42:0/2360939683 >> 172.21.15.42:0/2360939683 conn(0x7fcc700b2930 msgr2=0x7fcc7006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:16.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.247+0000 7fcc76e00640 1 -- 172.21.15.42:0/2360939683 shutdown_connections 2024-09-17T01:32:16.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.248+0000 7fcc76e00640 1 -- 172.21.15.42:0/2360939683 wait complete. 2024-09-17T01:32:16.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.250+0000 7fcc76e00640 1 Processor -- start 2024-09-17T01:32:16.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.250+0000 7fcc76e00640 1 -- start start 2024-09-17T01:32:16.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.251+0000 7fcc76e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc7006d430 0x7fcc70139c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:16.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.251+0000 7fcc76e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcc7015cb80 0x7fcc70151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:16.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.251+0000 7fcc76e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc7015f480 0x7fcc7014a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:16.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.251+0000 7fcc76e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcc70073820 con 0x7fcc7015f480 2024-09-17T01:32:16.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.251+0000 7fcc76e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcc700736a0 con 0x7fcc7006d430 2024-09-17T01:32:16.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.251+0000 7fcc76e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fcc700739a0 con 0x7fcc7015cb80 2024-09-17T01:32:16.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.252+0000 7fcc74e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc7015f480 0x7fcc7014a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:16.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.252+0000 7fcc74e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc7015f480 0x7fcc7014a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59262/0 (socket says 172.21.15.42:59262) 2024-09-17T01:32:16.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.252+0000 7fcc74e00640 1 -- 172.21.15.42:0/2840310585 learned_addr learned my addr 172.21.15.42:0/2840310585 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:16.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.252+0000 7fcc6fe00640 1 --2- 172.21.15.42:0/2840310585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc7006d430 0x7fcc70139c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:16.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.252+0000 7fcc6f400640 1 --2- 172.21.15.42:0/2840310585 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcc7015cb80 0x7fcc70151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:16.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.252+0000 7fcc74e00640 1 -- 172.21.15.42:0/2840310585 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcc7015cb80 msgr2=0x7fcc70151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:16.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.252+0000 7fcc74e00640 1 --2- 172.21.15.42:0/2840310585 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcc7015cb80 0x7fcc70151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:16.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.252+0000 7fcc74e00640 1 -- 172.21.15.42:0/2840310585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc7006d430 msgr2=0x7fcc70139c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:16.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.252+0000 7fcc74e00640 1 --2- 172.21.15.42:0/2840310585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc7006d430 0x7fcc70139c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:16.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.252+0000 7fcc74e00640 1 -- 172.21.15.42:0/2840310585 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc701513b0 con 0x7fcc7015f480 2024-09-17T01:32:16.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.252+0000 7fcc6f400640 1 --2- 172.21.15.42:0/2840310585 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcc7015cb80 0x7fcc70151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:16.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.252+0000 7fcc74e00640 1 --2- 172.21.15.42:0/2840310585 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc7015f480 0x7fcc7014a610 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcc68009d60 tx=0x7fcc68003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:16.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.253+0000 7fcc67e00640 1 -- 172.21.15.42:0/2840310585 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc68033050 con 0x7fcc7015f480 2024-09-17T01:32:16.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.253+0000 7fcc67e00640 1 -- 172.21.15.42:0/2840310585 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc68004550 con 0x7fcc7015f480 2024-09-17T01:32:16.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.253+0000 7fcc76e00640 1 -- 172.21.15.42:0/2840310585 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc7013a1b0 con 0x7fcc7015f480 2024-09-17T01:32:16.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.253+0000 7fcc67e00640 1 -- 172.21.15.42:0/2840310585 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc68038450 con 0x7fcc7015f480 2024-09-17T01:32:16.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.253+0000 7fcc76e00640 1 -- 172.21.15.42:0/2840310585 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc701505f0 con 0x7fcc7015f480 2024-09-17T01:32:16.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.254+0000 7fcc76e00640 1 -- 172.21.15.42:0/2840310585 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc70073ec0 con 0x7fcc7015f480 2024-09-17T01:32:16.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.255+0000 7fcc67e00640 1 -- 172.21.15.42:0/2840310585 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcc68036070 con 0x7fcc7015f480 2024-09-17T01:32:16.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.256+0000 7fcc67e00640 1 --2- 172.21.15.42:0/2840310585 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcc50078bc0 0x7fcc5007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:16.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.256+0000 7fcc67e00640 1 -- 172.21.15.42:0/2840310585 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fcc680bc270 con 0x7fcc7015f480 2024-09-17T01:32:16.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.257+0000 7fcc6fe00640 1 --2- 172.21.15.42:0/2840310585 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcc50078bc0 0x7fcc5007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:16.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.257+0000 7fcc6fe00640 1 --2- 172.21.15.42:0/2840310585 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcc50078bc0 0x7fcc5007b0d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcc60005fd0 tx=0x7fcc6000a250 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:16.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.260+0000 7fcc67e00640 1 -- 172.21.15.42:0/2840310585 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcc680846a0 con 0x7fcc7015f480 2024-09-17T01:32:16.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.450+0000 7fcc76e00640 1 -- 172.21.15.42:0/2840310585 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcc701500c0 con 0x7fcc50078bc0 2024-09-17T01:32:16.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.455+0000 7fcc67e00640 1 -- 172.21.15.42:0/2840310585 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251821 (secure 0 0 0) 0x7fcc701500c0 con 0x7fcc50078bc0 2024-09-17T01:32:16.454 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:16.457 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:32:16.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.460+0000 7fcc76e00640 1 -- 172.21.15.42:0/2840310585 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcc50078bc0 msgr2=0x7fcc5007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:16.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.460+0000 7fcc76e00640 1 --2- 172.21.15.42:0/2840310585 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcc50078bc0 0x7fcc5007b0d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcc60005fd0 tx=0x7fcc6000a250 comp rx=0 tx=0).stop 2024-09-17T01:32:16.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.460+0000 7fcc76e00640 1 -- 172.21.15.42:0/2840310585 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc7015f480 msgr2=0x7fcc7014a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:16.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.460+0000 7fcc76e00640 1 --2- 172.21.15.42:0/2840310585 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc7015f480 0x7fcc7014a610 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcc68009d60 tx=0x7fcc68003f10 comp rx=0 tx=0).stop 2024-09-17T01:32:16.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.460+0000 7fcc76e00640 1 -- 172.21.15.42:0/2840310585 shutdown_connections 2024-09-17T01:32:16.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.460+0000 7fcc76e00640 1 --2- 172.21.15.42:0/2840310585 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcc50078bc0 0x7fcc5007b0d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:16.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.460+0000 7fcc76e00640 1 --2- 172.21.15.42:0/2840310585 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc7015f480 0x7fcc7014a610 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:16.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.460+0000 7fcc76e00640 1 --2- 172.21.15.42:0/2840310585 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcc7015cb80 0x7fcc70151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:16.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.460+0000 7fcc76e00640 1 --2- 172.21.15.42:0/2840310585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc7006d430 0x7fcc70139c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:16.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.460+0000 7fcc76e00640 1 -- 172.21.15.42:0/2840310585 >> 172.21.15.42:0/2840310585 conn(0x7fcc700b2930 msgr2=0x7fcc700ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:16.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.460+0000 7fcc76e00640 1 -- 172.21.15.42:0/2840310585 shutdown_connections 2024-09-17T01:32:16.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.460+0000 7fcc76e00640 1 -- 172.21.15.42:0/2840310585 wait complete. 2024-09-17T01:32:16.480 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-17T01:32:14.976739+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252460,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722260,"statfs":{"total":773094113280,"available":772835594240,"internally_reserved":0,"allocated":3022848,"data_stored":1799972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002592"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084683+0000","last_change":"2024-09-17T01:32:07.103456+0000","last_active":"2024-09-17T01:32:08.084683+0000","last_peered":"2024-09-17T01:32:08.084683+0000","last_clean":"2024-09-17T01:32:08.084683+0000","last_became_active":"2024-09-17T01:32:07.103109+0000","last_became_peered":"2024-09-17T01:32:07.103109+0000","last_unstale":"2024-09-17T01:32:08.084683+0000","last_undegraded":"2024-09-17T01:32:08.084683+0000","last_fullsized":"2024-09-17T01:32:08.084683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:38.558917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255495+0000","last_change":"2024-09-17T01:32:07.099455+0000","last_active":"2024-09-17T01:32:08.255495+0000","last_peered":"2024-09-17T01:32:08.255495+0000","last_clean":"2024-09-17T01:32:08.255495+0000","last_became_active":"2024-09-17T01:32:07.099052+0000","last_became_peered":"2024-09-17T01:32:07.099052+0000","last_unstale":"2024-09-17T01:32:08.255495+0000","last_undegraded":"2024-09-17T01:32:08.255495+0000","last_fullsized":"2024-09-17T01:32:08.255495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:14.731320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254735+0000","last_change":"2024-09-17T01:32:07.085703+0000","last_active":"2024-09-17T01:32:08.254735+0000","last_peered":"2024-09-17T01:32:08.254735+0000","last_clean":"2024-09-17T01:32:08.254735+0000","last_became_active":"2024-09-17T01:32:07.085380+0000","last_became_peered":"2024-09-17T01:32:07.085380+0000","last_unstale":"2024-09-17T01:32:08.254735+0000","last_undegraded":"2024-09-17T01:32:08.254735+0000","last_fullsized":"2024-09-17T01:32:08.254735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:01.084404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254328+0000","last_change":"2024-09-17T01:32:07.073236+0000","last_active":"2024-09-17T01:32:08.254328+0000","last_peered":"2024-09-17T01:32:08.254328+0000","last_clean":"2024-09-17T01:32:08.254328+0000","last_became_active":"2024-09-17T01:32:07.072918+0000","last_became_peered":"2024-09-17T01:32:07.072918+0000","last_unstale":"2024-09-17T01:32:08.254328+0000","last_undegraded":"2024-09-17T01:32:08.254328+0000","last_fullsized":"2024-09-17T01:32:08.254328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:57.510381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084044+0000","last_change":"2024-09-17T01:32:07.082349+0000","last_active":"2024-09-17T01:32:08.084044+0000","last_peered":"2024-09-17T01:32:08.084044+0000","last_clean":"2024-09-17T01:32:08.084044+0000","last_became_active":"2024-09-17T01:32:07.081897+0000","last_became_peered":"2024-09-17T01:32:07.081897+0000","last_unstale":"2024-09-17T01:32:08.084044+0000","last_undegraded":"2024-09-17T01:32:08.084044+0000","last_fullsized":"2024-09-17T01:32:08.084044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:32.623242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254134+0000","last_change":"2024-09-17T01:32:07.074398+0000","last_active":"2024-09-17T01:32:08.254134+0000","last_peered":"2024-09-17T01:32:08.254134+0000","last_clean":"2024-09-17T01:32:08.254134+0000","last_became_active":"2024-09-17T01:32:07.074076+0000","last_became_peered":"2024-09-17T01:32:07.074076+0000","last_unstale":"2024-09-17T01:32:08.254134+0000","last_undegraded":"2024-09-17T01:32:08.254134+0000","last_fullsized":"2024-09-17T01:32:08.254134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:14.053004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.083789+0000","last_change":"2024-09-17T01:32:07.076442+0000","last_active":"2024-09-17T01:32:08.083789+0000","last_peered":"2024-09-17T01:32:08.083789+0000","last_clean":"2024-09-17T01:32:08.083789+0000","last_became_active":"2024-09-17T01:32:07.076156+0000","last_became_peered":"2024-09-17T01:32:07.076156+0000","last_unstale":"2024-09-17T01:32:08.083789+0000","last_undegraded":"2024-09-17T01:32:08.083789+0000","last_fullsized":"2024-09-17T01:32:08.083789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:13:53.149286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255624+0000","last_change":"2024-09-17T01:32:07.085589+0000","last_active":"2024-09-17T01:32:08.255624+0000","last_peered":"2024-09-17T01:32:08.255624+0000","last_clean":"2024-09-17T01:32:08.255624+0000","last_became_active":"2024-09-17T01:32:07.085259+0000","last_became_peered":"2024-09-17T01:32:07.085259+0000","last_unstale":"2024-09-17T01:32:08.255624+0000","last_undegraded":"2024-09-17T01:32:08.255624+0000","last_fullsized":"2024-09-17T01:32:08.255624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:41.271843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.078098+0000","last_change":"2024-09-17T01:32:07.092123+0000","last_active":"2024-09-17T01:32:08.078098+0000","last_peered":"2024-09-17T01:32:08.078098+0000","last_clean":"2024-09-17T01:32:08.078098+0000","last_became_active":"2024-09-17T01:32:07.091713+0000","last_became_peered":"2024-09-17T01:32:07.091713+0000","last_unstale":"2024-09-17T01:32:08.078098+0000","last_undegraded":"2024-09-17T01:32:08.078098+0000","last_fullsized":"2024-09-17T01:32:08.078098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:05.017902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084219+0000","last_change":"2024-09-17T01:32:07.085067+0000","last_active":"2024-09-17T01:32:08.084219+0000","last_peered":"2024-09-17T01:32:08.084219+0000","last_clean":"2024-09-17T01:32:08.084219+0000","last_became_active":"2024-09-17T01:32:07.084837+0000","last_became_peered":"2024-09-17T01:32:07.084837+0000","last_unstale":"2024-09-17T01:32:08.084219+0000","last_undegraded":"2024-09-17T01:32:08.084219+0000","last_fullsized":"2024-09-17T01:32:08.084219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:02.511769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084409+0000","last_change":"2024-09-17T01:32:07.099691+0000","last_active":"2024-09-17T01:32:08.084409+0000","last_peered":"2024-09-17T01:32:08.084409+0000","last_clean":"2024-09-17T01:32:08.084409+0000","last_became_active":"2024-09-17T01:32:07.094018+0000","last_became_peered":"2024-09-17T01:32:07.094018+0000","last_unstale":"2024-09-17T01:32:08.084409+0000","last_undegraded":"2024-09-17T01:32:08.084409+0000","last_fullsized":"2024-09-17T01:32:08.084409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:58.314338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084110+0000","last_change":"2024-09-17T01:32:07.073776+0000","last_active":"2024-09-17T01:32:08.084110+0000","last_peered":"2024-09-17T01:32:08.084110+0000","last_clean":"2024-09-17T01:32:08.084110+0000","last_became_active":"2024-09-17T01:32:07.073442+0000","last_became_peered":"2024-09-17T01:32:07.073442+0000","last_unstale":"2024-09-17T01:32:08.084110+0000","last_undegraded":"2024-09-17T01:32:08.084110+0000","last_fullsized":"2024-09-17T01:32:08.084110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:37.765577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.081135+0000","last_change":"2024-09-17T01:32:07.078885+0000","last_active":"2024-09-17T01:32:08.081135+0000","last_peered":"2024-09-17T01:32:08.081135+0000","last_clean":"2024-09-17T01:32:08.081135+0000","last_became_active":"2024-09-17T01:32:07.078435+0000","last_became_peered":"2024-09-17T01:32:07.078435+0000","last_unstale":"2024-09-17T01:32:08.081135+0000","last_undegraded":"2024-09-17T01:32:08.081135+0000","last_fullsized":"2024-09-17T01:32:08.081135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:22:26.061474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.081581+0000","last_change":"2024-09-17T01:32:07.088794+0000","last_active":"2024-09-17T01:32:08.081581+0000","last_peered":"2024-09-17T01:32:08.081581+0000","last_clean":"2024-09-17T01:32:08.081581+0000","last_became_active":"2024-09-17T01:32:07.088354+0000","last_became_peered":"2024-09-17T01:32:07.088354+0000","last_unstale":"2024-09-17T01:32:08.081581+0000","last_undegraded":"2024-09-17T01:32:08.081581+0000","last_fullsized":"2024-09-17T01:32:08.081581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:04.151746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255400+0000","last_change":"2024-09-17T01:32:07.080283+0000","last_active":"2024-09-17T01:32:08.255400+0000","last_peered":"2024-09-17T01:32:08.255400+0000","last_clean":"2024-09-17T01:32:08.255400+0000","last_became_active":"2024-09-17T01:32:07.079956+0000","last_became_peered":"2024-09-17T01:32:07.079956+0000","last_unstale":"2024-09-17T01:32:08.255400+0000","last_undegraded":"2024-09-17T01:32:08.255400+0000","last_fullsized":"2024-09-17T01:32:08.255400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:35:07.968881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.253904+0000","last_change":"2024-09-17T01:32:07.085014+0000","last_active":"2024-09-17T01:32:08.253904+0000","last_peered":"2024-09-17T01:32:08.253904+0000","last_clean":"2024-09-17T01:32:08.253904+0000","last_became_active":"2024-09-17T01:32:07.084701+0000","last_became_peered":"2024-09-17T01:32:07.084701+0000","last_unstale":"2024-09-17T01:32:08.253904+0000","last_undegraded":"2024-09-17T01:32:08.253904+0000","last_fullsized":"2024-09-17T01:32:08.253904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:45.382776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255636+0000","last_change":"2024-09-17T01:32:07.095513+0000","last_active":"2024-09-17T01:32:08.255636+0000","last_peered":"2024-09-17T01:32:08.255636+0000","last_clean":"2024-09-17T01:32:08.255636+0000","last_became_active":"2024-09-17T01:32:07.090989+0000","last_became_peered":"2024-09-17T01:32:07.090989+0000","last_unstale":"2024-09-17T01:32:08.255636+0000","last_undegraded":"2024-09-17T01:32:08.255636+0000","last_fullsized":"2024-09-17T01:32:08.255636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:46.947860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254682+0000","last_change":"2024-09-17T01:32:07.097564+0000","last_active":"2024-09-17T01:32:08.254682+0000","last_peered":"2024-09-17T01:32:08.254682+0000","last_clean":"2024-09-17T01:32:08.254682+0000","last_became_active":"2024-09-17T01:32:07.096842+0000","last_became_peered":"2024-09-17T01:32:07.096842+0000","last_unstale":"2024-09-17T01:32:08.254682+0000","last_undegraded":"2024-09-17T01:32:08.254682+0000","last_fullsized":"2024-09-17T01:32:08.254682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:20.757148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255495+0000","last_change":"2024-09-17T01:32:07.076493+0000","last_active":"2024-09-17T01:32:08.255495+0000","last_peered":"2024-09-17T01:32:08.255495+0000","last_clean":"2024-09-17T01:32:08.255495+0000","last_became_active":"2024-09-17T01:32:07.076153+0000","last_became_peered":"2024-09-17T01:32:07.076153+0000","last_unstale":"2024-09-17T01:32:08.255495+0000","last_undegraded":"2024-09-17T01:32:08.255495+0000","last_fullsized":"2024-09-17T01:32:08.255495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:25.265447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084142+0000","last_change":"2024-09-17T01:32:07.074913+0000","last_active":"2024-09-17T01:32:08.084142+0000","last_peered":"2024-09-17T01:32:08.084142+0000","last_clean":"2024-09-17T01:32:08.084142+0000","last_became_active":"2024-09-17T01:32:07.074573+0000","last_became_peered":"2024-09-17T01:32:07.074573+0000","last_unstale":"2024-09-17T01:32:08.084142+0000","last_undegraded":"2024-09-17T01:32:08.084142+0000","last_fullsized":"2024-09-17T01:32:08.084142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:46.307074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079705+0000","last_change":"2024-09-17T01:32:07.072132+0000","last_active":"2024-09-17T01:32:08.079705+0000","last_peered":"2024-09-17T01:32:08.079705+0000","last_clean":"2024-09-17T01:32:08.079705+0000","last_became_active":"2024-09-17T01:32:07.071687+0000","last_became_peered":"2024-09-17T01:32:07.071687+0000","last_unstale":"2024-09-17T01:32:08.079705+0000","last_undegraded":"2024-09-17T01:32:08.079705+0000","last_fullsized":"2024-09-17T01:32:08.079705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:05:00.465504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.077563+0000","last_change":"2024-09-17T01:32:07.083167+0000","last_active":"2024-09-17T01:32:08.077563+0000","last_peered":"2024-09-17T01:32:08.077563+0000","last_clean":"2024-09-17T01:32:08.077563+0000","last_became_active":"2024-09-17T01:32:07.082843+0000","last_became_peered":"2024-09-17T01:32:07.082843+0000","last_unstale":"2024-09-17T01:32:08.077563+0000","last_undegraded":"2024-09-17T01:32:08.077563+0000","last_fullsized":"2024-09-17T01:32:08.077563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:33.769443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255226+0000","last_change":"2024-09-17T01:32:07.075509+0000","last_active":"2024-09-17T01:32:08.255226+0000","last_peered":"2024-09-17T01:32:08.255226+0000","last_clean":"2024-09-17T01:32:08.255226+0000","last_became_active":"2024-09-17T01:32:07.075146+0000","last_became_peered":"2024-09-17T01:32:07.075146+0000","last_unstale":"2024-09-17T01:32:08.255226+0000","last_undegraded":"2024-09-17T01:32:08.255226+0000","last_fullsized":"2024-09-17T01:32:08.255226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:47.850069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.253907+0000","last_change":"2024-09-17T01:32:07.092134+0000","last_active":"2024-09-17T01:32:08.253907+0000","last_peered":"2024-09-17T01:32:08.253907+0000","last_clean":"2024-09-17T01:32:08.253907+0000","last_became_active":"2024-09-17T01:32:07.091782+0000","last_became_peered":"2024-09-17T01:32:07.091782+0000","last_unstale":"2024-09-17T01:32:08.253907+0000","last_undegraded":"2024-09-17T01:32:08.253907+0000","last_fullsized":"2024-09-17T01:32:08.253907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:50.828833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255041+0000","last_change":"2024-09-17T01:32:07.091641+0000","last_active":"2024-09-17T01:32:08.255041+0000","last_peered":"2024-09-17T01:32:08.255041+0000","last_clean":"2024-09-17T01:32:08.255041+0000","last_became_active":"2024-09-17T01:32:07.091316+0000","last_became_peered":"2024-09-17T01:32:07.091316+0000","last_unstale":"2024-09-17T01:32:08.255041+0000","last_undegraded":"2024-09-17T01:32:08.255041+0000","last_fullsized":"2024-09-17T01:32:08.255041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:30.669754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254763+0000","last_change":"2024-09-17T01:32:07.097633+0000","last_active":"2024-09-17T01:32:08.254763+0000","last_peered":"2024-09-17T01:32:08.254763+0000","last_clean":"2024-09-17T01:32:08.254763+0000","last_became_active":"2024-09-17T01:32:07.092029+0000","last_became_peered":"2024-09-17T01:32:07.092029+0000","last_unstale":"2024-09-17T01:32:08.254763+0000","last_undegraded":"2024-09-17T01:32:08.254763+0000","last_fullsized":"2024-09-17T01:32:08.254763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:56.387025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080174+0000","last_change":"2024-09-17T01:32:07.070606+0000","last_active":"2024-09-17T01:32:08.080174+0000","last_peered":"2024-09-17T01:32:08.080174+0000","last_clean":"2024-09-17T01:32:08.080174+0000","last_became_active":"2024-09-17T01:32:07.070312+0000","last_became_peered":"2024-09-17T01:32:07.070312+0000","last_unstale":"2024-09-17T01:32:08.080174+0000","last_undegraded":"2024-09-17T01:32:08.080174+0000","last_fullsized":"2024-09-17T01:32:08.080174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:58.298740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079492+0000","last_change":"2024-09-17T01:32:07.086253+0000","last_active":"2024-09-17T01:32:08.079492+0000","last_peered":"2024-09-17T01:32:08.079492+0000","last_clean":"2024-09-17T01:32:08.079492+0000","last_became_active":"2024-09-17T01:32:07.085897+0000","last_became_peered":"2024-09-17T01:32:07.085897+0000","last_unstale":"2024-09-17T01:32:08.079492+0000","last_undegraded":"2024-09-17T01:32:08.079492+0000","last_fullsized":"2024-09-17T01:32:08.079492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:54.160964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254923+0000","last_change":"2024-09-17T01:32:07.080316+0000","last_active":"2024-09-17T01:32:08.254923+0000","last_peered":"2024-09-17T01:32:08.254923+0000","last_clean":"2024-09-17T01:32:08.254923+0000","last_became_active":"2024-09-17T01:32:07.079896+0000","last_became_peered":"2024-09-17T01:32:07.079896+0000","last_unstale":"2024-09-17T01:32:08.254923+0000","last_undegraded":"2024-09-17T01:32:08.254923+0000","last_fullsized":"2024-09-17T01:32:08.254923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:19.850165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254673+0000","last_change":"2024-09-17T01:32:07.092975+0000","last_active":"2024-09-17T01:32:08.254673+0000","last_peered":"2024-09-17T01:32:08.254673+0000","last_clean":"2024-09-17T01:32:08.254673+0000","last_became_active":"2024-09-17T01:32:07.090003+0000","last_became_peered":"2024-09-17T01:32:07.090003+0000","last_unstale":"2024-09-17T01:32:08.254673+0000","last_undegraded":"2024-09-17T01:32:08.254673+0000","last_fullsized":"2024-09-17T01:32:08.254673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:12.771004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254825+0000","last_change":"2024-09-17T01:32:07.079839+0000","last_active":"2024-09-17T01:32:08.254825+0000","last_peered":"2024-09-17T01:32:08.254825+0000","last_clean":"2024-09-17T01:32:08.254825+0000","last_became_active":"2024-09-17T01:32:07.079012+0000","last_became_peered":"2024-09-17T01:32:07.079012+0000","last_unstale":"2024-09-17T01:32:08.254825+0000","last_undegraded":"2024-09-17T01:32:08.254825+0000","last_fullsized":"2024-09-17T01:32:08.254825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:23.124830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254237+0000","last_change":"2024-09-17T01:32:07.076970+0000","last_active":"2024-09-17T01:32:08.254237+0000","last_peered":"2024-09-17T01:32:08.254237+0000","last_clean":"2024-09-17T01:32:08.254237+0000","last_became_active":"2024-09-17T01:32:07.072256+0000","last_became_peered":"2024-09-17T01:32:07.072256+0000","last_unstale":"2024-09-17T01:32:08.254237+0000","last_undegraded":"2024-09-17T01:32:08.254237+0000","last_fullsized":"2024-09-17T01:32:08.254237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:17.000817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.077708+0000","last_change":"2024-09-17T01:32:07.086593+0000","last_active":"2024-09-17T01:32:08.077708+0000","last_peered":"2024-09-17T01:32:08.077708+0000","last_clean":"2024-09-17T01:32:08.077708+0000","last_became_active":"2024-09-17T01:32:07.086265+0000","last_became_peered":"2024-09-17T01:32:07.086265+0000","last_unstale":"2024-09-17T01:32:08.077708+0000","last_undegraded":"2024-09-17T01:32:08.077708+0000","last_fullsized":"2024-09-17T01:32:08.077708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:59.076106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255106+0000","last_change":"2024-09-17T01:32:06.072600+0000","last_active":"2024-09-17T01:32:08.255106+0000","last_peered":"2024-09-17T01:32:08.255106+0000","last_clean":"2024-09-17T01:32:08.255106+0000","last_became_active":"2024-09-17T01:32:06.072280+0000","last_became_peered":"2024-09-17T01:32:06.072280+0000","last_unstale":"2024-09-17T01:32:08.255106+0000","last_undegraded":"2024-09-17T01:32:08.255106+0000","last_fullsized":"2024-09-17T01:32:08.255106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:24.693140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079998+0000","last_change":"2024-09-17T01:32:07.082615+0000","last_active":"2024-09-17T01:32:08.079998+0000","last_peered":"2024-09-17T01:32:08.079998+0000","last_clean":"2024-09-17T01:32:08.079998+0000","last_became_active":"2024-09-17T01:32:07.082266+0000","last_became_peered":"2024-09-17T01:32:07.082266+0000","last_unstale":"2024-09-17T01:32:08.079998+0000","last_undegraded":"2024-09-17T01:32:08.079998+0000","last_fullsized":"2024-09-17T01:32:08.079998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:34.677913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254763+0000","last_change":"2024-09-17T01:32:06.081486+0000","last_active":"2024-09-17T01:32:08.254763+0000","last_peered":"2024-09-17T01:32:08.254763+0000","last_clean":"2024-09-17T01:32:08.254763+0000","last_became_active":"2024-09-17T01:32:06.081193+0000","last_became_peered":"2024-09-17T01:32:06.081193+0000","last_unstale":"2024-09-17T01:32:08.254763+0000","last_undegraded":"2024-09-17T01:32:08.254763+0000","last_fullsized":"2024-09-17T01:32:08.254763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:53.154130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079445+0000","last_change":"2024-09-17T01:32:06.069305+0000","last_active":"2024-09-17T01:32:08.079445+0000","last_peered":"2024-09-17T01:32:08.079445+0000","last_clean":"2024-09-17T01:32:08.079445+0000","last_became_active":"2024-09-17T01:32:06.068652+0000","last_became_peered":"2024-09-17T01:32:06.068652+0000","last_unstale":"2024-09-17T01:32:08.079445+0000","last_undegraded":"2024-09-17T01:32:08.079445+0000","last_fullsized":"2024-09-17T01:32:08.079445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:48.494445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255548+0000","last_change":"2024-09-17T01:32:07.087945+0000","last_active":"2024-09-17T01:32:08.255548+0000","last_peered":"2024-09-17T01:32:08.255548+0000","last_clean":"2024-09-17T01:32:08.255548+0000","last_became_active":"2024-09-17T01:32:07.081997+0000","last_became_peered":"2024-09-17T01:32:07.081997+0000","last_unstale":"2024-09-17T01:32:08.255548+0000","last_undegraded":"2024-09-17T01:32:08.255548+0000","last_fullsized":"2024-09-17T01:32:08.255548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:25.453779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254032+0000","last_change":"2024-09-17T01:32:06.064957+0000","last_active":"2024-09-17T01:32:08.254032+0000","last_peered":"2024-09-17T01:32:08.254032+0000","last_clean":"2024-09-17T01:32:08.254032+0000","last_became_active":"2024-09-17T01:32:06.064565+0000","last_became_peered":"2024-09-17T01:32:06.064565+0000","last_unstale":"2024-09-17T01:32:08.254032+0000","last_undegraded":"2024-09-17T01:32:08.254032+0000","last_fullsized":"2024-09-17T01:32:08.254032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:41.844576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079397+0000","last_change":"2024-09-17T01:32:07.068057+0000","last_active":"2024-09-17T01:32:08.079397+0000","last_peered":"2024-09-17T01:32:08.079397+0000","last_clean":"2024-09-17T01:32:08.079397+0000","last_became_active":"2024-09-17T01:32:07.067735+0000","last_became_peered":"2024-09-17T01:32:07.067735+0000","last_unstale":"2024-09-17T01:32:08.079397+0000","last_undegraded":"2024-09-17T01:32:08.079397+0000","last_fullsized":"2024-09-17T01:32:08.079397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:42.854196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.078116+0000","last_change":"2024-09-17T01:32:06.061484+0000","last_active":"2024-09-17T01:32:08.078116+0000","last_peered":"2024-09-17T01:32:08.078116+0000","last_clean":"2024-09-17T01:32:08.078116+0000","last_became_active":"2024-09-17T01:32:06.061082+0000","last_became_peered":"2024-09-17T01:32:06.061082+0000","last_unstale":"2024-09-17T01:32:08.078116+0000","last_undegraded":"2024-09-17T01:32:08.078116+0000","last_fullsized":"2024-09-17T01:32:08.078116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:57.830631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254780+0000","last_change":"2024-09-17T01:32:07.098046+0000","last_active":"2024-09-17T01:32:08.254780+0000","last_peered":"2024-09-17T01:32:08.254780+0000","last_clean":"2024-09-17T01:32:08.254780+0000","last_became_active":"2024-09-17T01:32:07.094416+0000","last_became_peered":"2024-09-17T01:32:07.094416+0000","last_unstale":"2024-09-17T01:32:08.254780+0000","last_undegraded":"2024-09-17T01:32:08.254780+0000","last_fullsized":"2024-09-17T01:32:08.254780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:28.815131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084431+0000","last_change":"2024-09-17T01:32:06.072252+0000","last_active":"2024-09-17T01:32:08.084431+0000","last_peered":"2024-09-17T01:32:08.084431+0000","last_clean":"2024-09-17T01:32:08.084431+0000","last_became_active":"2024-09-17T01:32:06.071868+0000","last_became_peered":"2024-09-17T01:32:06.071868+0000","last_unstale":"2024-09-17T01:32:08.084431+0000","last_undegraded":"2024-09-17T01:32:08.084431+0000","last_fullsized":"2024-09-17T01:32:08.084431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:32.739722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255545+0000","last_change":"2024-09-17T01:32:07.101387+0000","last_active":"2024-09-17T01:32:08.255545+0000","last_peered":"2024-09-17T01:32:08.255545+0000","last_clean":"2024-09-17T01:32:08.255545+0000","last_became_active":"2024-09-17T01:32:07.101077+0000","last_became_peered":"2024-09-17T01:32:07.101077+0000","last_unstale":"2024-09-17T01:32:08.255545+0000","last_undegraded":"2024-09-17T01:32:08.255545+0000","last_fullsized":"2024-09-17T01:32:08.255545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:36:23.728414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254880+0000","last_change":"2024-09-17T01:32:06.061334+0000","last_active":"2024-09-17T01:32:08.254880+0000","last_peered":"2024-09-17T01:32:08.254880+0000","last_clean":"2024-09-17T01:32:08.254880+0000","last_became_active":"2024-09-17T01:32:06.061062+0000","last_became_peered":"2024-09-17T01:32:06.061062+0000","last_unstale":"2024-09-17T01:32:08.254880+0000","last_undegraded":"2024-09-17T01:32:08.254880+0000","last_fullsized":"2024-09-17T01:32:08.254880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:26.325842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255304+0000","last_change":"2024-09-17T01:32:07.089550+0000","last_active":"2024-09-17T01:32:08.255304+0000","last_peered":"2024-09-17T01:32:08.255304+0000","last_clean":"2024-09-17T01:32:08.255304+0000","last_became_active":"2024-09-17T01:32:07.089255+0000","last_became_peered":"2024-09-17T01:32:07.089255+0000","last_unstale":"2024-09-17T01:32:08.255304+0000","last_undegraded":"2024-09-17T01:32:08.255304+0000","last_fullsized":"2024-09-17T01:32:08.255304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:40.540113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254393+0000","last_change":"2024-09-17T01:32:06.062145+0000","last_active":"2024-09-17T01:32:08.254393+0000","last_peered":"2024-09-17T01:32:08.254393+0000","last_clean":"2024-09-17T01:32:08.254393+0000","last_became_active":"2024-09-17T01:32:06.061691+0000","last_became_peered":"2024-09-17T01:32:06.061691+0000","last_unstale":"2024-09-17T01:32:08.254393+0000","last_undegraded":"2024-09-17T01:32:08.254393+0000","last_fullsized":"2024-09-17T01:32:08.254393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:52.657492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084154+0000","last_change":"2024-09-17T01:32:07.078612+0000","last_active":"2024-09-17T01:32:08.084154+0000","last_peered":"2024-09-17T01:32:08.084154+0000","last_clean":"2024-09-17T01:32:08.084154+0000","last_became_active":"2024-09-17T01:32:07.078227+0000","last_became_peered":"2024-09-17T01:32:07.078227+0000","last_unstale":"2024-09-17T01:32:08.084154+0000","last_undegraded":"2024-09-17T01:32:08.084154+0000","last_fullsized":"2024-09-17T01:32:08.084154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:54.702390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254498+0000","last_change":"2024-09-17T01:32:06.083372+0000","last_active":"2024-09-17T01:32:08.254498+0000","last_peered":"2024-09-17T01:32:08.254498+0000","last_clean":"2024-09-17T01:32:08.254498+0000","last_became_active":"2024-09-17T01:32:06.082955+0000","last_became_peered":"2024-09-17T01:32:06.082955+0000","last_unstale":"2024-09-17T01:32:08.254498+0000","last_undegraded":"2024-09-17T01:32:08.254498+0000","last_fullsized":"2024-09-17T01:32:08.254498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:48.494445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.081245+0000","last_change":"2024-09-17T01:32:07.090664+0000","last_active":"2024-09-17T01:32:08.081245+0000","last_peered":"2024-09-17T01:32:08.081245+0000","last_clean":"2024-09-17T01:32:08.081245+0000","last_became_active":"2024-09-17T01:32:07.090142+0000","last_became_peered":"2024-09-17T01:32:07.090142+0000","last_unstale":"2024-09-17T01:32:08.081245+0000","last_undegraded":"2024-09-17T01:32:08.081245+0000","last_fullsized":"2024-09-17T01:32:08.081245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:37.231363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254829+0000","last_change":"2024-09-17T01:32:06.059219+0000","last_active":"2024-09-17T01:32:08.254829+0000","last_peered":"2024-09-17T01:32:08.254829+0000","last_clean":"2024-09-17T01:32:08.254829+0000","last_became_active":"2024-09-17T01:32:06.058230+0000","last_became_peered":"2024-09-17T01:32:06.058230+0000","last_unstale":"2024-09-17T01:32:08.254829+0000","last_undegraded":"2024-09-17T01:32:08.254829+0000","last_fullsized":"2024-09-17T01:32:08.254829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:53.345377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254873+0000","last_change":"2024-09-17T01:32:07.089933+0000","last_active":"2024-09-17T01:32:08.254873+0000","last_peered":"2024-09-17T01:32:08.254873+0000","last_clean":"2024-09-17T01:32:08.254873+0000","last_became_active":"2024-09-17T01:32:07.080900+0000","last_became_peered":"2024-09-17T01:32:07.080900+0000","last_unstale":"2024-09-17T01:32:08.254873+0000","last_undegraded":"2024-09-17T01:32:08.254873+0000","last_fullsized":"2024-09-17T01:32:08.254873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:07:38.397880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.083659+0000","last_change":"2024-09-17T01:32:06.079871+0000","last_active":"2024-09-17T01:32:08.083659+0000","last_peered":"2024-09-17T01:32:08.083659+0000","last_clean":"2024-09-17T01:32:08.083659+0000","last_became_active":"2024-09-17T01:32:06.079581+0000","last_became_peered":"2024-09-17T01:32:06.079581+0000","last_unstale":"2024-09-17T01:32:08.083659+0000","last_undegraded":"2024-09-17T01:32:08.083659+0000","last_fullsized":"2024-09-17T01:32:08.083659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:37.449372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.077508+0000","last_change":"2024-09-17T01:32:07.089282+0000","last_active":"2024-09-17T01:32:08.077508+0000","last_peered":"2024-09-17T01:32:08.077508+0000","last_clean":"2024-09-17T01:32:08.077508+0000","last_became_active":"2024-09-17T01:32:07.088928+0000","last_became_peered":"2024-09-17T01:32:07.088928+0000","last_unstale":"2024-09-17T01:32:08.077508+0000","last_undegraded":"2024-09-17T01:32:08.077508+0000","last_fullsized":"2024-09-17T01:32:08.077508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:58.786102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080466+0000","last_change":"2024-09-17T01:32:06.053867+0000","last_active":"2024-09-17T01:32:08.080466+0000","last_peered":"2024-09-17T01:32:08.080466+0000","last_clean":"2024-09-17T01:32:08.080466+0000","last_became_active":"2024-09-17T01:32:06.053466+0000","last_became_peered":"2024-09-17T01:32:06.053466+0000","last_unstale":"2024-09-17T01:32:08.080466+0000","last_undegraded":"2024-09-17T01:32:08.080466+0000","last_fullsized":"2024-09-17T01:32:08.080466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:33.901561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254246+0000","last_change":"2024-09-17T01:32:07.095265+0000","last_active":"2024-09-17T01:32:08.254246+0000","last_peered":"2024-09-17T01:32:08.254246+0000","last_clean":"2024-09-17T01:32:08.254246+0000","last_became_active":"2024-09-17T01:32:07.094979+0000","last_became_peered":"2024-09-17T01:32:07.094979+0000","last_unstale":"2024-09-17T01:32:08.254246+0000","last_undegraded":"2024-09-17T01:32:08.254246+0000","last_fullsized":"2024-09-17T01:32:08.254246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:38.558917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084880+0000","last_change":"2024-09-17T01:32:06.083417+0000","last_active":"2024-09-17T01:32:08.084880+0000","last_peered":"2024-09-17T01:32:08.084880+0000","last_clean":"2024-09-17T01:32:08.084880+0000","last_became_active":"2024-09-17T01:32:06.082378+0000","last_became_peered":"2024-09-17T01:32:06.082378+0000","last_unstale":"2024-09-17T01:32:08.084880+0000","last_undegraded":"2024-09-17T01:32:08.084880+0000","last_fullsized":"2024-09-17T01:32:08.084880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:37:12.138471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254924+0000","last_change":"2024-09-17T01:32:07.087871+0000","last_active":"2024-09-17T01:32:08.254924+0000","last_peered":"2024-09-17T01:32:08.254924+0000","last_clean":"2024-09-17T01:32:08.254924+0000","last_became_active":"2024-09-17T01:32:07.086811+0000","last_became_peered":"2024-09-17T01:32:07.086811+0000","last_unstale":"2024-09-17T01:32:08.254924+0000","last_undegraded":"2024-09-17T01:32:08.254924+0000","last_fullsized":"2024-09-17T01:32:08.254924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:47.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080419+0000","last_change":"2024-09-17T01:32:06.067533+0000","last_active":"2024-09-17T01:32:08.080419+0000","last_peered":"2024-09-17T01:32:08.080419+0000","last_clean":"2024-09-17T01:32:08.080419+0000","last_became_active":"2024-09-17T01:32:06.066265+0000","last_became_peered":"2024-09-17T01:32:06.066265+0000","last_unstale":"2024-09-17T01:32:08.080419+0000","last_undegraded":"2024-09-17T01:32:08.080419+0000","last_fullsized":"2024-09-17T01:32:08.080419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:05.206992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084686+0000","last_change":"2024-09-17T01:32:07.075279+0000","last_active":"2024-09-17T01:32:08.084686+0000","last_peered":"2024-09-17T01:32:08.084686+0000","last_clean":"2024-09-17T01:32:08.084686+0000","last_became_active":"2024-09-17T01:32:07.073899+0000","last_became_peered":"2024-09-17T01:32:07.073899+0000","last_unstale":"2024-09-17T01:32:08.084686+0000","last_undegraded":"2024-09-17T01:32:08.084686+0000","last_fullsized":"2024-09-17T01:32:08.084686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:19:18.340646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254712+0000","last_change":"2024-09-17T01:32:06.071046+0000","last_active":"2024-09-17T01:32:08.254712+0000","last_peered":"2024-09-17T01:32:08.254712+0000","last_clean":"2024-09-17T01:32:08.254712+0000","last_became_active":"2024-09-17T01:32:06.070668+0000","last_became_peered":"2024-09-17T01:32:06.070668+0000","last_unstale":"2024-09-17T01:32:08.254712+0000","last_undegraded":"2024-09-17T01:32:08.254712+0000","last_fullsized":"2024-09-17T01:32:08.254712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:51.537157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084349+0000","last_change":"2024-09-17T01:32:07.081930+0000","last_active":"2024-09-17T01:32:08.084349+0000","last_peered":"2024-09-17T01:32:08.084349+0000","last_clean":"2024-09-17T01:32:08.084349+0000","last_became_active":"2024-09-17T01:32:07.081525+0000","last_became_peered":"2024-09-17T01:32:07.081525+0000","last_unstale":"2024-09-17T01:32:08.084349+0000","last_undegraded":"2024-09-17T01:32:08.084349+0000","last_fullsized":"2024-09-17T01:32:08.084349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:45.382776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079908+0000","last_change":"2024-09-17T01:32:06.071392+0000","last_active":"2024-09-17T01:32:08.079908+0000","last_peered":"2024-09-17T01:32:08.079908+0000","last_clean":"2024-09-17T01:32:08.079908+0000","last_became_active":"2024-09-17T01:32:06.070869+0000","last_became_peered":"2024-09-17T01:32:06.070869+0000","last_unstale":"2024-09-17T01:32:08.079908+0000","last_undegraded":"2024-09-17T01:32:08.079908+0000","last_fullsized":"2024-09-17T01:32:08.079908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:26.325842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255344+0000","last_change":"2024-09-17T01:32:07.076689+0000","last_active":"2024-09-17T01:32:08.255344+0000","last_peered":"2024-09-17T01:32:08.255344+0000","last_clean":"2024-09-17T01:32:08.255344+0000","last_became_active":"2024-09-17T01:32:07.076399+0000","last_became_peered":"2024-09-17T01:32:07.076399+0000","last_unstale":"2024-09-17T01:32:08.255344+0000","last_undegraded":"2024-09-17T01:32:08.255344+0000","last_fullsized":"2024-09-17T01:32:08.255344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:20.255648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.077377+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:32:08.077377+0000","last_peered":"2024-09-17T01:32:08.077377+0000","last_clean":"2024-09-17T01:32:08.077377+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:32:08.077377+0000","last_undegraded":"2024-09-17T01:32:08.077377+0000","last_fullsized":"2024-09-17T01:32:08.077377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255076+0000","last_change":"2024-09-17T01:32:06.064934+0000","last_active":"2024-09-17T01:32:08.255076+0000","last_peered":"2024-09-17T01:32:08.255076+0000","last_clean":"2024-09-17T01:32:08.255076+0000","last_became_active":"2024-09-17T01:32:06.064552+0000","last_became_peered":"2024-09-17T01:32:06.064552+0000","last_unstale":"2024-09-17T01:32:08.255076+0000","last_undegraded":"2024-09-17T01:32:08.255076+0000","last_fullsized":"2024-09-17T01:32:08.255076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:46:21.965124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080286+0000","last_change":"2024-09-17T01:32:07.071839+0000","last_active":"2024-09-17T01:32:08.080286+0000","last_peered":"2024-09-17T01:32:08.080286+0000","last_clean":"2024-09-17T01:32:08.080286+0000","last_became_active":"2024-09-17T01:32:07.071512+0000","last_became_peered":"2024-09-17T01:32:07.071512+0000","last_unstale":"2024-09-17T01:32:08.080286+0000","last_undegraded":"2024-09-17T01:32:08.080286+0000","last_fullsized":"2024-09-17T01:32:08.080286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:10.661342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254134+0000","last_change":"2024-09-17T01:32:06.070832+0000","last_active":"2024-09-17T01:32:08.254134+0000","last_peered":"2024-09-17T01:32:08.254134+0000","last_clean":"2024-09-17T01:32:08.254134+0000","last_became_active":"2024-09-17T01:32:06.070149+0000","last_became_peered":"2024-09-17T01:32:06.070149+0000","last_unstale":"2024-09-17T01:32:08.254134+0000","last_undegraded":"2024-09-17T01:32:08.254134+0000","last_fullsized":"2024-09-17T01:32:08.254134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:32.739722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079316+0000","last_change":"2024-09-17T01:32:07.075984+0000","last_active":"2024-09-17T01:32:08.079316+0000","last_peered":"2024-09-17T01:32:08.079316+0000","last_clean":"2024-09-17T01:32:08.079316+0000","last_became_active":"2024-09-17T01:32:07.074619+0000","last_became_peered":"2024-09-17T01:32:07.074619+0000","last_unstale":"2024-09-17T01:32:08.079316+0000","last_undegraded":"2024-09-17T01:32:08.079316+0000","last_fullsized":"2024-09-17T01:32:08.079316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:34.608401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254201+0000","last_change":"2024-09-17T01:32:06.071910+0000","last_active":"2024-09-17T01:32:08.254201+0000","last_peered":"2024-09-17T01:32:08.254201+0000","last_clean":"2024-09-17T01:32:08.254201+0000","last_became_active":"2024-09-17T01:32:06.071001+0000","last_became_peered":"2024-09-17T01:32:06.071001+0000","last_unstale":"2024-09-17T01:32:08.254201+0000","last_undegraded":"2024-09-17T01:32:08.254201+0000","last_fullsized":"2024-09-17T01:32:08.254201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:02.474882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255127+0000","last_change":"2024-09-17T01:32:07.081167+0000","last_active":"2024-09-17T01:32:08.255127+0000","last_peered":"2024-09-17T01:32:08.255127+0000","last_clean":"2024-09-17T01:32:08.255127+0000","last_became_active":"2024-09-17T01:32:07.080055+0000","last_became_peered":"2024-09-17T01:32:07.080055+0000","last_unstale":"2024-09-17T01:32:08.255127+0000","last_undegraded":"2024-09-17T01:32:08.255127+0000","last_fullsized":"2024-09-17T01:32:08.255127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:39:36.609246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254883+0000","last_change":"2024-09-17T01:32:06.069316+0000","last_active":"2024-09-17T01:32:08.254883+0000","last_peered":"2024-09-17T01:32:08.254883+0000","last_clean":"2024-09-17T01:32:08.254883+0000","last_became_active":"2024-09-17T01:32:06.069002+0000","last_became_peered":"2024-09-17T01:32:06.069002+0000","last_unstale":"2024-09-17T01:32:08.254883+0000","last_undegraded":"2024-09-17T01:32:08.254883+0000","last_fullsized":"2024-09-17T01:32:08.254883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:57.291905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.083961+0000","last_change":"2024-09-17T01:32:07.095194+0000","last_active":"2024-09-17T01:32:08.083961+0000","last_peered":"2024-09-17T01:32:08.083961+0000","last_clean":"2024-09-17T01:32:08.083961+0000","last_became_active":"2024-09-17T01:32:07.090236+0000","last_became_peered":"2024-09-17T01:32:07.090236+0000","last_unstale":"2024-09-17T01:32:08.083961+0000","last_undegraded":"2024-09-17T01:32:08.083961+0000","last_fullsized":"2024-09-17T01:32:08.083961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:25.383324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254579+0000","last_change":"2024-09-17T01:32:06.073180+0000","last_active":"2024-09-17T01:32:08.254579+0000","last_peered":"2024-09-17T01:32:08.254579+0000","last_clean":"2024-09-17T01:32:08.254579+0000","last_became_active":"2024-09-17T01:32:06.072812+0000","last_became_peered":"2024-09-17T01:32:06.072812+0000","last_unstale":"2024-09-17T01:32:08.254579+0000","last_undegraded":"2024-09-17T01:32:08.254579+0000","last_fullsized":"2024-09-17T01:32:08.254579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:24.568357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254543+0000","last_change":"2024-09-17T01:32:07.068573+0000","last_active":"2024-09-17T01:32:08.254543+0000","last_peered":"2024-09-17T01:32:08.254543+0000","last_clean":"2024-09-17T01:32:08.254543+0000","last_became_active":"2024-09-17T01:32:07.068144+0000","last_became_peered":"2024-09-17T01:32:07.068144+0000","last_unstale":"2024-09-17T01:32:08.254543+0000","last_undegraded":"2024-09-17T01:32:08.254543+0000","last_fullsized":"2024-09-17T01:32:08.254543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:54.256529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255437+0000","last_change":"2024-09-17T01:32:06.067526+0000","last_active":"2024-09-17T01:32:08.255437+0000","last_peered":"2024-09-17T01:32:08.255437+0000","last_clean":"2024-09-17T01:32:08.255437+0000","last_became_active":"2024-09-17T01:32:06.062575+0000","last_became_peered":"2024-09-17T01:32:06.062575+0000","last_unstale":"2024-09-17T01:32:08.255437+0000","last_undegraded":"2024-09-17T01:32:08.255437+0000","last_fullsized":"2024-09-17T01:32:08.255437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:33.601567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.079730+0000","last_change":"2024-09-17T01:32:07.092156+0000","last_active":"2024-09-17T01:32:08.079730+0000","last_peered":"2024-09-17T01:32:08.079730+0000","last_clean":"2024-09-17T01:32:08.079730+0000","last_became_active":"2024-09-17T01:32:07.091367+0000","last_became_peered":"2024-09-17T01:32:07.091367+0000","last_unstale":"2024-09-17T01:32:08.079730+0000","last_undegraded":"2024-09-17T01:32:08.079730+0000","last_fullsized":"2024-09-17T01:32:08.079730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:54.352211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.082733+0000","last_change":"2024-09-17T01:32:06.077965+0000","last_active":"2024-09-17T01:32:08.082733+0000","last_peered":"2024-09-17T01:32:08.082733+0000","last_clean":"2024-09-17T01:32:08.082733+0000","last_became_active":"2024-09-17T01:32:06.077187+0000","last_became_peered":"2024-09-17T01:32:06.077187+0000","last_unstale":"2024-09-17T01:32:08.082733+0000","last_undegraded":"2024-09-17T01:32:08.082733+0000","last_fullsized":"2024-09-17T01:32:08.082733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:19.750313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080529+0000","last_change":"2024-09-17T01:32:07.066284+0000","last_active":"2024-09-17T01:32:08.080529+0000","last_peered":"2024-09-17T01:32:08.080529+0000","last_clean":"2024-09-17T01:32:08.080529+0000","last_became_active":"2024-09-17T01:32:07.065959+0000","last_became_peered":"2024-09-17T01:32:07.065959+0000","last_unstale":"2024-09-17T01:32:08.080529+0000","last_undegraded":"2024-09-17T01:32:08.080529+0000","last_fullsized":"2024-09-17T01:32:08.080529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:48:15.533537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255574+0000","last_change":"2024-09-17T01:32:06.081435+0000","last_active":"2024-09-17T01:32:08.255574+0000","last_peered":"2024-09-17T01:32:08.255574+0000","last_clean":"2024-09-17T01:32:08.255574+0000","last_became_active":"2024-09-17T01:32:06.081122+0000","last_became_peered":"2024-09-17T01:32:06.081122+0000","last_unstale":"2024-09-17T01:32:08.255574+0000","last_undegraded":"2024-09-17T01:32:08.255574+0000","last_fullsized":"2024-09-17T01:32:08.255574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:22:25.054640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080231+0000","last_change":"2024-09-17T01:32:07.082941+0000","last_active":"2024-09-17T01:32:08.080231+0000","last_peered":"2024-09-17T01:32:08.080231+0000","last_clean":"2024-09-17T01:32:08.080231+0000","last_became_active":"2024-09-17T01:32:07.082576+0000","last_became_peered":"2024-09-17T01:32:07.082576+0000","last_unstale":"2024-09-17T01:32:08.080231+0000","last_undegraded":"2024-09-17T01:32:08.080231+0000","last_fullsized":"2024-09-17T01:32:08.080231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:52.970626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.083470+0000","last_change":"2024-09-17T01:32:06.078725+0000","last_active":"2024-09-17T01:32:08.083470+0000","last_peered":"2024-09-17T01:32:08.083470+0000","last_clean":"2024-09-17T01:32:08.083470+0000","last_became_active":"2024-09-17T01:32:06.074072+0000","last_became_peered":"2024-09-17T01:32:06.074072+0000","last_unstale":"2024-09-17T01:32:08.083470+0000","last_undegraded":"2024-09-17T01:32:08.083470+0000","last_fullsized":"2024-09-17T01:32:08.083470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:41.844576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254467+0000","last_change":"2024-09-17T01:32:07.092928+0000","last_active":"2024-09-17T01:32:08.254467+0000","last_peered":"2024-09-17T01:32:08.254467+0000","last_clean":"2024-09-17T01:32:08.254467+0000","last_became_active":"2024-09-17T01:32:07.079859+0000","last_became_peered":"2024-09-17T01:32:07.079859+0000","last_unstale":"2024-09-17T01:32:08.254467+0000","last_undegraded":"2024-09-17T01:32:08.254467+0000","last_fullsized":"2024-09-17T01:32:08.254467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:14.465400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.081017+0000","last_change":"2024-09-17T01:32:06.076537+0000","last_active":"2024-09-17T01:32:08.081017+0000","last_peered":"2024-09-17T01:32:08.081017+0000","last_clean":"2024-09-17T01:32:08.081017+0000","last_became_active":"2024-09-17T01:32:06.076002+0000","last_became_peered":"2024-09-17T01:32:06.076002+0000","last_unstale":"2024-09-17T01:32:08.081017+0000","last_undegraded":"2024-09-17T01:32:08.081017+0000","last_fullsized":"2024-09-17T01:32:08.081017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:22.117996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080195+0000","last_change":"2024-09-17T01:32:07.069777+0000","last_active":"2024-09-17T01:32:08.080195+0000","last_peered":"2024-09-17T01:32:08.080195+0000","last_clean":"2024-09-17T01:32:08.080195+0000","last_became_active":"2024-09-17T01:32:07.069387+0000","last_became_peered":"2024-09-17T01:32:07.069387+0000","last_unstale":"2024-09-17T01:32:08.080195+0000","last_undegraded":"2024-09-17T01:32:08.080195+0000","last_fullsized":"2024-09-17T01:32:08.080195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:54.341372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.081349+0000","last_change":"2024-09-17T01:32:06.067797+0000","last_active":"2024-09-17T01:32:08.081349+0000","last_peered":"2024-09-17T01:32:08.081349+0000","last_clean":"2024-09-17T01:32:08.081349+0000","last_became_active":"2024-09-17T01:32:06.067441+0000","last_became_peered":"2024-09-17T01:32:06.067441+0000","last_unstale":"2024-09-17T01:32:08.081349+0000","last_undegraded":"2024-09-17T01:32:08.081349+0000","last_fullsized":"2024-09-17T01:32:08.081349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:25.112393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255127+0000","last_change":"2024-09-17T01:32:07.099514+0000","last_active":"2024-09-17T01:32:08.255127+0000","last_peered":"2024-09-17T01:32:08.255127+0000","last_clean":"2024-09-17T01:32:08.255127+0000","last_became_active":"2024-09-17T01:32:07.099001+0000","last_became_peered":"2024-09-17T01:32:07.099001+0000","last_unstale":"2024-09-17T01:32:08.255127+0000","last_undegraded":"2024-09-17T01:32:08.255127+0000","last_fullsized":"2024-09-17T01:32:08.255127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:22:13.835193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255013+0000","last_change":"2024-09-17T01:32:06.066117+0000","last_active":"2024-09-17T01:32:08.255013+0000","last_peered":"2024-09-17T01:32:08.255013+0000","last_clean":"2024-09-17T01:32:08.255013+0000","last_became_active":"2024-09-17T01:32:06.065785+0000","last_became_peered":"2024-09-17T01:32:06.065785+0000","last_unstale":"2024-09-17T01:32:08.255013+0000","last_undegraded":"2024-09-17T01:32:08.255013+0000","last_fullsized":"2024-09-17T01:32:08.255013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:30.380597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.254888+0000","last_change":"2024-09-17T01:32:07.090458+0000","last_active":"2024-09-17T01:32:08.254888+0000","last_peered":"2024-09-17T01:32:08.254888+0000","last_clean":"2024-09-17T01:32:08.254888+0000","last_became_active":"2024-09-17T01:32:07.078369+0000","last_became_peered":"2024-09-17T01:32:07.078369+0000","last_unstale":"2024-09-17T01:32:08.254888+0000","last_undegraded":"2024-09-17T01:32:08.254888+0000","last_fullsized":"2024-09-17T01:32:08.254888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:00.888206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255221+0000","last_change":"2024-09-17T01:32:07.092688+0000","last_active":"2024-09-17T01:32:08.255221+0000","last_peered":"2024-09-17T01:32:08.255221+0000","last_clean":"2024-09-17T01:32:08.255221+0000","last_became_active":"2024-09-17T01:32:07.085320+0000","last_became_peered":"2024-09-17T01:32:07.085320+0000","last_unstale":"2024-09-17T01:32:08.255221+0000","last_undegraded":"2024-09-17T01:32:08.255221+0000","last_fullsized":"2024-09-17T01:32:08.255221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:14.220903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084367+0000","last_change":"2024-09-17T01:32:06.070361+0000","last_active":"2024-09-17T01:32:08.084367+0000","last_peered":"2024-09-17T01:32:08.084367+0000","last_clean":"2024-09-17T01:32:08.084367+0000","last_became_active":"2024-09-17T01:32:06.069832+0000","last_became_peered":"2024-09-17T01:32:06.069832+0000","last_unstale":"2024-09-17T01:32:08.084367+0000","last_undegraded":"2024-09-17T01:32:08.084367+0000","last_fullsized":"2024-09-17T01:32:08.084367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:30.380597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.077817+0000","last_change":"2024-09-17T01:32:07.084781+0000","last_active":"2024-09-17T01:32:08.077817+0000","last_peered":"2024-09-17T01:32:08.077817+0000","last_clean":"2024-09-17T01:32:08.077817+0000","last_became_active":"2024-09-17T01:32:07.084442+0000","last_became_peered":"2024-09-17T01:32:07.084442+0000","last_unstale":"2024-09-17T01:32:08.077817+0000","last_undegraded":"2024-09-17T01:32:08.077817+0000","last_fullsized":"2024-09-17T01:32:08.077817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:01:03.298687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.084291+0000","last_change":"2024-09-17T01:32:06.075745+0000","last_active":"2024-09-17T01:32:08.084291+0000","last_peered":"2024-09-17T01:32:08.084291+0000","last_clean":"2024-09-17T01:32:08.084291+0000","last_became_active":"2024-09-17T01:32:06.074453+0000","last_became_peered":"2024-09-17T01:32:06.074453+0000","last_unstale":"2024-09-17T01:32:08.084291+0000","last_undegraded":"2024-09-17T01:32:08.084291+0000","last_fullsized":"2024-09-17T01:32:08.084291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:04.657692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255266+0000","last_change":"2024-09-17T01:32:07.091674+0000","last_active":"2024-09-17T01:32:08.255266+0000","last_peered":"2024-09-17T01:32:08.255266+0000","last_clean":"2024-09-17T01:32:08.255266+0000","last_became_active":"2024-09-17T01:32:07.091348+0000","last_became_peered":"2024-09-17T01:32:07.091348+0000","last_unstale":"2024-09-17T01:32:08.255266+0000","last_undegraded":"2024-09-17T01:32:08.255266+0000","last_fullsized":"2024-09-17T01:32:08.255266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:31.725598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255418+0000","last_change":"2024-09-17T01:32:06.074404+0000","last_active":"2024-09-17T01:32:08.255418+0000","last_peered":"2024-09-17T01:32:08.255418+0000","last_clean":"2024-09-17T01:32:08.255418+0000","last_became_active":"2024-09-17T01:32:06.074047+0000","last_became_peered":"2024-09-17T01:32:06.074047+0000","last_unstale":"2024-09-17T01:32:08.255418+0000","last_undegraded":"2024-09-17T01:32:08.255418+0000","last_fullsized":"2024-09-17T01:32:08.255418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:26.446474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.255142+0000","last_change":"2024-09-17T01:32:07.084694+0000","last_active":"2024-09-17T01:32:08.255142+0000","last_peered":"2024-09-17T01:32:08.255142+0000","last_clean":"2024-09-17T01:32:08.255142+0000","last_became_active":"2024-09-17T01:32:07.084387+0000","last_became_peered":"2024-09-17T01:32:07.084387+0000","last_unstale":"2024-09-17T01:32:08.255142+0000","last_undegraded":"2024-09-17T01:32:08.255142+0000","last_fullsized":"2024-09-17T01:32:08.255142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:06.035146+0000","last_clean_scrub_stamp":"2024-09-17T01:32:06.035146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:01.007924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T01:32:08.080774+0000","last_change":"2024-09-17T01:32:06.063395+0000","last_active":"2024-09-17T01:32:08.080774+0000","last_peered":"2024-09-17T01:32:08.080774+0000","last_clean":"2024-09-17T01:32:08.080774+0000","last_became_active":"2024-09-17T01:32:06.062964+0000","last_became_peered":"2024-09-17T01:32:06.062964+0000","last_unstale":"2024-09-17T01:32:08.080774+0000","last_undegraded":"2024-09-17T01:32:08.080774+0000","last_fullsized":"2024-09-17T01:32:08.080774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:05.028312+0000","last_clean_scrub_stamp":"2024-09-17T01:32:05.028312+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:26.591137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476743,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":233472,"data_stored":78414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":76926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":76802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":241664,"data_stored":79086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":225280,"data_stored":77384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":819200,"data_stored":667240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":76858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":823296,"data_stored":667262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:32:16.485 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T01:32:16.485 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T01:32:16.485 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-17T01:32:16.485 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T01:32:16.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.747+0000 7f3749400640 1 -- 172.21.15.42:0/621691778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f374406db40 msgr2=0x7f374406fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:16.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.747+0000 7f3749400640 1 --2- 172.21.15.42:0/621691778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f374406db40 0x7f374406fe40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f373c005fd0 tx=0x7f373c02aa90 comp rx=0 tx=0).stop 2024-09-17T01:32:16.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.747+0000 7f3749400640 1 -- 172.21.15.42:0/621691778 shutdown_connections 2024-09-17T01:32:16.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.747+0000 7f3749400640 1 --2- 172.21.15.42:0/621691778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f374406db40 0x7f374406fe40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:16.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.747+0000 7f3749400640 1 --2- 172.21.15.42:0/621691778 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3744072e00 0x7f374415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:16.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.747+0000 7f3749400640 1 -- 172.21.15.42:0/621691778 >> 172.21.15.42:0/621691778 conn(0x7f37440b2930 msgr2=0x7f374406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:16.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.747+0000 7f3749400640 1 -- 172.21.15.42:0/621691778 shutdown_connections 2024-09-17T01:32:16.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.747+0000 7f3749400640 1 -- 172.21.15.42:0/621691778 wait complete. 2024-09-17T01:32:16.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.750+0000 7f3749400640 1 Processor -- start 2024-09-17T01:32:16.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.750+0000 7f3749400640 1 -- start start 2024-09-17T01:32:16.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.751+0000 7f3749400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3744072e00 0x7f37440b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:16.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.751+0000 7f3749400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f374415f190 0x7f3744155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:16.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.751+0000 7f3749400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f374414d6e0 0x7f37441547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:16.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.751+0000 7f3749400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3744151520 con 0x7f3744072e00 2024-09-17T01:32:16.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.751+0000 7f3749400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3744070740 con 0x7f374414d6e0 2024-09-17T01:32:16.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.751+0000 7f3749400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f37441516a0 con 0x7f374415f190 2024-09-17T01:32:16.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.751+0000 7f3742800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3744072e00 0x7f37440b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:16.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.751+0000 7f3742800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3744072e00 0x7f37440b5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59288/0 (socket says 172.21.15.42:59288) 2024-09-17T01:32:16.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.751+0000 7f3742800640 1 -- 172.21.15.42:0/4149917276 learned_addr learned my addr 172.21.15.42:0/4149917276 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:16.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.752+0000 7f3743200640 1 --2- 172.21.15.42:0/4149917276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f374414d6e0 0x7f37441547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:16.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.752+0000 7f3741e00640 1 --2- 172.21.15.42:0/4149917276 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f374415f190 0x7f3744155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:16.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.752+0000 7f3742800640 1 -- 172.21.15.42:0/4149917276 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f374415f190 msgr2=0x7f3744155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:16.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.752+0000 7f3742800640 1 --2- 172.21.15.42:0/4149917276 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f374415f190 0x7f3744155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:16.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.752+0000 7f3742800640 1 -- 172.21.15.42:0/4149917276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f374414d6e0 msgr2=0x7f37441547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:16.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.752+0000 7f3742800640 1 --2- 172.21.15.42:0/4149917276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f374414d6e0 0x7f37441547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:16.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.752+0000 7f3742800640 1 -- 172.21.15.42:0/4149917276 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37441f9740 con 0x7f3744072e00 2024-09-17T01:32:16.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.752+0000 7f3742800640 1 --2- 172.21.15.42:0/4149917276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3744072e00 0x7f37440b5150 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f373400e790 tx=0x7f373400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:16.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.752+0000 7f373aa00640 1 -- 172.21.15.42:0/4149917276 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373400eea0 con 0x7f3744072e00 2024-09-17T01:32:16.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.752+0000 7f373aa00640 1 -- 172.21.15.42:0/4149917276 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f373400cdb0 con 0x7f3744072e00 2024-09-17T01:32:16.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.752+0000 7f373aa00640 1 -- 172.21.15.42:0/4149917276 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3734010690 con 0x7f3744072e00 2024-09-17T01:32:16.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.752+0000 7f3749400640 1 -- 172.21.15.42:0/4149917276 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37440b46b0 con 0x7f3744072e00 2024-09-17T01:32:16.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.752+0000 7f3749400640 1 -- 172.21.15.42:0/4149917276 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37440b4950 con 0x7f3744072e00 2024-09-17T01:32:16.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.753+0000 7f3749400640 1 -- 172.21.15.42:0/4149917276 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f374406fe40 con 0x7f3744072e00 2024-09-17T01:32:16.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.755+0000 7f373aa00640 1 -- 172.21.15.42:0/4149917276 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3734010830 con 0x7f3744072e00 2024-09-17T01:32:16.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.756+0000 7f373aa00640 1 --2- 172.21.15.42:0/4149917276 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3724078b90 0x7f372407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:16.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.756+0000 7f373aa00640 1 -- 172.21.15.42:0/4149917276 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f373409b780 con 0x7f3744072e00 2024-09-17T01:32:16.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.756+0000 7f3741e00640 1 --2- 172.21.15.42:0/4149917276 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3724078b90 0x7f372407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:16.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.757+0000 7f3741e00640 1 --2- 172.21.15.42:0/4149917276 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3724078b90 0x7f372407b0a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f374415bf60 tx=0x7f3730009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:16.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.760+0000 7f373aa00640 1 -- 172.21.15.42:0/4149917276 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3734063bc0 con 0x7f3744072e00 2024-09-17T01:32:16.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.996+0000 7f3749400640 1 -- 172.21.15.42:0/4149917276 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f374406a170 con 0x7f3744072e00 2024-09-17T01:32:16.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.996+0000 7f373aa00640 1 -- 172.21.15.42:0/4149917276 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f37340634c0 con 0x7f3744072e00 2024-09-17T01:32:16.994 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:16.994 INFO:teuthology.orchestra.run.smithi042.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T01:32:16.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.999+0000 7f3749400640 1 -- 172.21.15.42:0/4149917276 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3724078b90 msgr2=0x7f372407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:16.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.999+0000 7f3749400640 1 --2- 172.21.15.42:0/4149917276 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3724078b90 0x7f372407b0a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f374415bf60 tx=0x7f3730009040 comp rx=0 tx=0).stop 2024-09-17T01:32:16.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.999+0000 7f3749400640 1 -- 172.21.15.42:0/4149917276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3744072e00 msgr2=0x7f37440b5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:16.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.999+0000 7f3749400640 1 --2- 172.21.15.42:0/4149917276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3744072e00 0x7f37440b5150 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f373400e790 tx=0x7f373400ec50 comp rx=0 tx=0).stop 2024-09-17T01:32:16.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.999+0000 7f3749400640 1 -- 172.21.15.42:0/4149917276 shutdown_connections 2024-09-17T01:32:16.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.999+0000 7f3749400640 1 --2- 172.21.15.42:0/4149917276 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3724078b90 0x7f372407b0a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:16.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.999+0000 7f3749400640 1 --2- 172.21.15.42:0/4149917276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f374414d6e0 0x7f37441547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:16.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.999+0000 7f3749400640 1 --2- 172.21.15.42:0/4149917276 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f374415f190 0x7f3744155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:16.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.999+0000 7f3749400640 1 --2- 172.21.15.42:0/4149917276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3744072e00 0x7f37440b5150 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:16.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.999+0000 7f3749400640 1 -- 172.21.15.42:0/4149917276 >> 172.21.15.42:0/4149917276 conn(0x7f37440b2930 msgr2=0x7f374414e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:16.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.999+0000 7f3749400640 1 -- 172.21.15.42:0/4149917276 shutdown_connections 2024-09-17T01:32:16.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:16.999+0000 7f3749400640 1 -- 172.21.15.42:0/4149917276 wait complete. 2024-09-17T01:32:17.019 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-17T01:32:17.019 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:32:17.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.250+0000 7f45f2800640 1 -- 172.21.15.42:0/2617239973 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f45ec0b30a0 msgr2=0x7f45ec0b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:17.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.250+0000 7f45f2800640 1 --2- 172.21.15.42:0/2617239973 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f45ec0b30a0 0x7f45ec0b34b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f45e4005fd0 tx=0x7f45e402aa90 comp rx=0 tx=0).stop 2024-09-17T01:32:17.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.250+0000 7f45f2800640 1 -- 172.21.15.42:0/2617239973 shutdown_connections 2024-09-17T01:32:17.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.250+0000 7f45f2800640 1 --2- 172.21.15.42:0/2617239973 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f45ec0b30a0 0x7f45ec0b34b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:17.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.250+0000 7f45f2800640 1 --2- 172.21.15.42:0/2617239973 >> v2:172.21.15.43:3300/0 conn(0x7f45ec06cd20 0x7f45ec06d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:17.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.250+0000 7f45f2800640 1 -- 172.21.15.42:0/2617239973 >> 172.21.15.42:0/2617239973 conn(0x7f45ec0b25f0 msgr2=0x7f45ec0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:17.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.251+0000 7f45f2800640 1 -- 172.21.15.42:0/2617239973 shutdown_connections 2024-09-17T01:32:17.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.251+0000 7f45f2800640 1 -- 172.21.15.42:0/2617239973 wait complete. 2024-09-17T01:32:17.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.253+0000 7f45f2800640 1 Processor -- start 2024-09-17T01:32:17.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.253+0000 7f45f2800640 1 -- start start 2024-09-17T01:32:17.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.254+0000 7f45f2800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45ec06cd20 0x7f45ec14fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:17.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.254+0000 7f45f2800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f45ec0b30a0 0x7f45ec152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:17.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.254+0000 7f45f2800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45ec0cf230 0x7f45ec152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:17.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.254+0000 7f45f2800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f45ec070470 con 0x7f45ec0cf230 2024-09-17T01:32:17.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.254+0000 7f45f2800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f45ec0702f0 con 0x7f45ec06cd20 2024-09-17T01:32:17.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.254+0000 7f45f2800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f45ec0b39f0 con 0x7f45ec0b30a0 2024-09-17T01:32:17.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.255+0000 7f45f1e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45ec0cf230 0x7f45ec152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:17.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.255+0000 7f45f1e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45ec0cf230 0x7f45ec152a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59290/0 (socket says 172.21.15.42:59290) 2024-09-17T01:32:17.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.255+0000 7f45f1e00640 1 -- 172.21.15.42:0/1704176671 learned_addr learned my addr 172.21.15.42:0/1704176671 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:17.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.255+0000 7f45f0a00640 1 --2- 172.21.15.42:0/1704176671 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f45ec0b30a0 0x7f45ec152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:17.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.255+0000 7f45f1400640 1 --2- 172.21.15.42:0/1704176671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45ec06cd20 0x7f45ec14fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:17.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.255+0000 7f45f1e00640 1 -- 172.21.15.42:0/1704176671 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f45ec0b30a0 msgr2=0x7f45ec152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:17.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.255+0000 7f45f1e00640 1 --2- 172.21.15.42:0/1704176671 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f45ec0b30a0 0x7f45ec152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:17.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.255+0000 7f45f1e00640 1 -- 172.21.15.42:0/1704176671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45ec06cd20 msgr2=0x7f45ec14fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:17.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.255+0000 7f45f1e00640 1 --2- 172.21.15.42:0/1704176671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45ec06cd20 0x7f45ec14fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:17.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.255+0000 7f45f1e00640 1 -- 172.21.15.42:0/1704176671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45ec09ba70 con 0x7f45ec0cf230 2024-09-17T01:32:17.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.256+0000 7f45f1e00640 1 --2- 172.21.15.42:0/1704176671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45ec0cf230 0x7f45ec152a70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f45e4006010 tx=0x7f45e4003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:17.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.256+0000 7f45e9600640 1 -- 172.21.15.42:0/1704176671 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e4044070 con 0x7f45ec0cf230 2024-09-17T01:32:17.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.256+0000 7f45e9600640 1 -- 172.21.15.42:0/1704176671 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f45e4004040 con 0x7f45ec0cf230 2024-09-17T01:32:17.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.256+0000 7f45f2800640 1 -- 172.21.15.42:0/1704176671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45ec09bd50 con 0x7f45ec0cf230 2024-09-17T01:32:17.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.256+0000 7f45e9600640 1 -- 172.21.15.42:0/1704176671 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e4004430 con 0x7f45ec0cf230 2024-09-17T01:32:17.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.256+0000 7f45f2800640 1 -- 172.21.15.42:0/1704176671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45ec09c310 con 0x7f45ec0cf230 2024-09-17T01:32:17.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.257+0000 7f45f2800640 1 -- 172.21.15.42:0/1704176671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45ec09de30 con 0x7f45ec0cf230 2024-09-17T01:32:17.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.258+0000 7f45e9600640 1 -- 172.21.15.42:0/1704176671 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f45e4047070 con 0x7f45ec0cf230 2024-09-17T01:32:17.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.259+0000 7f45e9600640 1 --2- 172.21.15.42:0/1704176671 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f45cc078bc0 0x7f45cc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:17.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.259+0000 7f45e9600640 1 -- 172.21.15.42:0/1704176671 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f45e40bbc60 con 0x7f45ec0cf230 2024-09-17T01:32:17.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.260+0000 7f45f1400640 1 --2- 172.21.15.42:0/1704176671 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f45cc078bc0 0x7f45cc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:17.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.260+0000 7f45f1400640 1 --2- 172.21.15.42:0/1704176671 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f45cc078bc0 0x7f45cc07b0d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f45e00095f0 tx=0x7f45e0005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:17.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.264+0000 7f45e9600640 1 -- 172.21.15.42:0/1704176671 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f45e4032030 con 0x7f45ec0cf230 2024-09-17T01:32:17.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.497+0000 7f45f2800640 1 -- 172.21.15.42:0/1704176671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45ec0b3f40 con 0x7f45ec0cf230 2024-09-17T01:32:17.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.498+0000 7f45e9600640 1 -- 172.21.15.42:0/1704176671 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5217 (secure 0 0 0) 0x7f45e40839c0 con 0x7f45ec0cf230 2024-09-17T01:32:17.496 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:17.496 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":8,"btime":"2024-09-17T01:32:10:080773+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4301,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1899287597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1899287597},{"type":"v1","addr":"172.21.15.43:6836","nonce":1899287597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4359,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3422946855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3422946855},{"type":"v1","addr":"172.21.15.42:6835","nonce":3422946855}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4363,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1971042705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1971042705},{"type":"v1","addr":"172.21.15.42:6833","nonce":1971042705}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:32:06.566519+0000","modified":"2024-09-17T01:32:09.589828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/3707512090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3707512090},{"type":"v1","addr":"172.21.15.43:6837","nonce":3707512090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4365,"qdb_cluster":[4365]},"id":1}]} 2024-09-17T01:32:17.496 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 8 2024-09-17T01:32:17.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.500+0000 7f45f2800640 1 -- 172.21.15.42:0/1704176671 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f45cc078bc0 msgr2=0x7f45cc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:17.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.500+0000 7f45f2800640 1 --2- 172.21.15.42:0/1704176671 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f45cc078bc0 0x7f45cc07b0d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f45e00095f0 tx=0x7f45e0005f90 comp rx=0 tx=0).stop 2024-09-17T01:32:17.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.500+0000 7f45f2800640 1 -- 172.21.15.42:0/1704176671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45ec0cf230 msgr2=0x7f45ec152a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:17.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.500+0000 7f45f2800640 1 --2- 172.21.15.42:0/1704176671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45ec0cf230 0x7f45ec152a70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f45e4006010 tx=0x7f45e4003ce0 comp rx=0 tx=0).stop 2024-09-17T01:32:17.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.500+0000 7f45f2800640 1 -- 172.21.15.42:0/1704176671 shutdown_connections 2024-09-17T01:32:17.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.500+0000 7f45f2800640 1 --2- 172.21.15.42:0/1704176671 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f45cc078bc0 0x7f45cc07b0d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:17.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.500+0000 7f45f2800640 1 --2- 172.21.15.42:0/1704176671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45ec0cf230 0x7f45ec152a70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:17.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.500+0000 7f45f2800640 1 --2- 172.21.15.42:0/1704176671 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f45ec0b30a0 0x7f45ec152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:17.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.500+0000 7f45f2800640 1 --2- 172.21.15.42:0/1704176671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45ec06cd20 0x7f45ec14fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:17.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.500+0000 7f45f2800640 1 -- 172.21.15.42:0/1704176671 >> 172.21.15.42:0/1704176671 conn(0x7f45ec0b25f0 msgr2=0x7f45ec0cbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:17.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.501+0000 7f45f2800640 1 -- 172.21.15.42:0/1704176671 shutdown_connections 2024-09-17T01:32:17.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.501+0000 7f45f2800640 1 -- 172.21.15.42:0/1704176671 wait complete. 2024-09-17T01:32:17.523 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:32:17.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.751+0000 7fa6ed600640 1 -- 172.21.15.42:0/1972060107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6e815f480 msgr2=0x7fa6e815f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:17.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.751+0000 7fa6ed600640 1 --2- 172.21.15.42:0/1972060107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6e815f480 0x7fa6e815f890 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0005fd0 tx=0x7fa6e002a8b0 comp rx=0 tx=0).stop 2024-09-17T01:32:17.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.751+0000 7fa6ed600640 1 -- 172.21.15.42:0/1972060107 shutdown_connections 2024-09-17T01:32:17.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.751+0000 7fa6ed600640 1 --2- 172.21.15.42:0/1972060107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6e815f480 0x7fa6e815f890 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:17.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.751+0000 7fa6ed600640 1 -- 172.21.15.42:0/1972060107 >> 172.21.15.42:0/1972060107 conn(0x7fa6e80b2930 msgr2=0x7fa6e806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:17.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.751+0000 7fa6ed600640 1 -- 172.21.15.42:0/1972060107 shutdown_connections 2024-09-17T01:32:17.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.751+0000 7fa6ed600640 1 -- 172.21.15.42:0/1972060107 wait complete. 2024-09-17T01:32:17.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.753+0000 7fa6ed600640 1 Processor -- start 2024-09-17T01:32:17.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.753+0000 7fa6ed600640 1 -- start start 2024-09-17T01:32:17.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.755+0000 7fa6ed600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6e806d430 0x7fa6e815a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:17.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.755+0000 7fa6ed600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa6e815cb80 0x7fa6e815b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:17.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.755+0000 7fa6ed600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6e815f480 0x7fa6e815cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:17.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.755+0000 7fa6ed600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e80738d0 con 0x7fa6e806d430 2024-09-17T01:32:17.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.755+0000 7fa6ed600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e8073750 con 0x7fa6e815f480 2024-09-17T01:32:17.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.755+0000 7fa6ed600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa6e8073a50 con 0x7fa6e815cb80 2024-09-17T01:32:17.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.755+0000 7fa6e6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6e806d430 0x7fa6e815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:17.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.755+0000 7fa6e6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6e806d430 0x7fa6e815a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59312/0 (socket says 172.21.15.42:59312) 2024-09-17T01:32:17.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.755+0000 7fa6e6a00640 1 -- 172.21.15.42:0/2204383505 learned_addr learned my addr 172.21.15.42:0/2204383505 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:17.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.755+0000 7fa6dfe00640 1 --2- 172.21.15.42:0/2204383505 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa6e815cb80 0x7fa6e815b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:17.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.755+0000 7fa6e7400640 1 --2- 172.21.15.42:0/2204383505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6e815f480 0x7fa6e815cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:17.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.756+0000 7fa6e6a00640 1 -- 172.21.15.42:0/2204383505 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa6e815cb80 msgr2=0x7fa6e815b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:17.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.756+0000 7fa6e6a00640 1 --2- 172.21.15.42:0/2204383505 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa6e815cb80 0x7fa6e815b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:17.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.756+0000 7fa6e6a00640 1 -- 172.21.15.42:0/2204383505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6e815f480 msgr2=0x7fa6e815cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:17.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.756+0000 7fa6e6a00640 1 --2- 172.21.15.42:0/2204383505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6e815f480 0x7fa6e815cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:17.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.756+0000 7fa6e6a00640 1 -- 172.21.15.42:0/2204383505 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e815b9b0 con 0x7fa6e806d430 2024-09-17T01:32:17.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.756+0000 7fa6dfe00640 1 --2- 172.21.15.42:0/2204383505 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa6e815cb80 0x7fa6e815b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:17.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.756+0000 7fa6e7400640 1 --2- 172.21.15.42:0/2204383505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6e815f480 0x7fa6e815cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:17.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.756+0000 7fa6e6a00640 1 --2- 172.21.15.42:0/2204383505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6e806d430 0x7fa6e815a930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa6d800c430 tx=0x7fa6d800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:17.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.756+0000 7fa6dea00640 1 -- 172.21.15.42:0/2204383505 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d8017070 con 0x7fa6e806d430 2024-09-17T01:32:17.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.756+0000 7fa6dea00640 1 -- 172.21.15.42:0/2204383505 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6d80053c0 con 0x7fa6e806d430 2024-09-17T01:32:17.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.756+0000 7fa6ed600640 1 -- 172.21.15.42:0/2204383505 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6e8159b70 con 0x7fa6e806d430 2024-09-17T01:32:17.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.756+0000 7fa6dea00640 1 -- 172.21.15.42:0/2204383505 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d8003850 con 0x7fa6e806d430 2024-09-17T01:32:17.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.756+0000 7fa6ed600640 1 -- 172.21.15.42:0/2204383505 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6e815a130 con 0x7fa6e806d430 2024-09-17T01:32:17.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.758+0000 7fa6ed600640 1 -- 172.21.15.42:0/2204383505 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6e815f890 con 0x7fa6e806d430 2024-09-17T01:32:17.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.759+0000 7fa6dea00640 1 -- 172.21.15.42:0/2204383505 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa6d801a070 con 0x7fa6e806d430 2024-09-17T01:32:17.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.760+0000 7fa6dea00640 1 --2- 172.21.15.42:0/2204383505 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa6c4078b90 0x7fa6c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:17.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.760+0000 7fa6dea00640 1 -- 172.21.15.42:0/2204383505 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa6d809a000 con 0x7fa6e806d430 2024-09-17T01:32:17.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.760+0000 7fa6dfe00640 1 --2- 172.21.15.42:0/2204383505 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa6c4078b90 0x7fa6c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:17.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.761+0000 7fa6dfe00640 1 --2- 172.21.15.42:0/2204383505 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa6c4078b90 0x7fa6c407b0a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa6e81ec910 tx=0x7fa6d0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:17.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.764+0000 7fa6dea00640 1 -- 172.21.15.42:0/2204383505 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa6e815be20 con 0x7fa6e806d430 2024-09-17T01:32:17.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.995+0000 7fa6ed600640 1 -- 172.21.15.42:0/2204383505 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6e806a170 con 0x7fa6e806d430 2024-09-17T01:32:17.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.996+0000 7fa6dea00640 1 -- 172.21.15.42:0/2204383505 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5217 (secure 0 0 0) 0x7fa6d80624d0 con 0x7fa6e806d430 2024-09-17T01:32:17.994 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:17.994 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":8,"btime":"2024-09-17T01:32:10:080773+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4301,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1899287597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1899287597},{"type":"v1","addr":"172.21.15.43:6836","nonce":1899287597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4359,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3422946855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3422946855},{"type":"v1","addr":"172.21.15.42:6835","nonce":3422946855}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4363,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1971042705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1971042705},{"type":"v1","addr":"172.21.15.42:6833","nonce":1971042705}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:32:06.566519+0000","modified":"2024-09-17T01:32:09.589828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/3707512090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3707512090},{"type":"v1","addr":"172.21.15.43:6837","nonce":3707512090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4365,"qdb_cluster":[4365]},"id":1}]} 2024-09-17T01:32:17.994 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 8 2024-09-17T01:32:17.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.998+0000 7fa6ed600640 1 -- 172.21.15.42:0/2204383505 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa6c4078b90 msgr2=0x7fa6c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:17.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.998+0000 7fa6ed600640 1 --2- 172.21.15.42:0/2204383505 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa6c4078b90 0x7fa6c407b0a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa6e81ec910 tx=0x7fa6d0009040 comp rx=0 tx=0).stop 2024-09-17T01:32:17.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.998+0000 7fa6ed600640 1 -- 172.21.15.42:0/2204383505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6e806d430 msgr2=0x7fa6e815a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:17.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.998+0000 7fa6ed600640 1 --2- 172.21.15.42:0/2204383505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6e806d430 0x7fa6e815a930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa6d800c430 tx=0x7fa6d800c8f0 comp rx=0 tx=0).stop 2024-09-17T01:32:17.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.998+0000 7fa6ed600640 1 -- 172.21.15.42:0/2204383505 shutdown_connections 2024-09-17T01:32:17.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.998+0000 7fa6ed600640 1 --2- 172.21.15.42:0/2204383505 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa6c4078b90 0x7fa6c407b0a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:17.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.998+0000 7fa6ed600640 1 --2- 172.21.15.42:0/2204383505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6e815f480 0x7fa6e815cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:17.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.998+0000 7fa6ed600640 1 --2- 172.21.15.42:0/2204383505 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa6e815cb80 0x7fa6e815b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:17.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.998+0000 7fa6ed600640 1 --2- 172.21.15.42:0/2204383505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6e806d430 0x7fa6e815a930 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:17.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.998+0000 7fa6ed600640 1 -- 172.21.15.42:0/2204383505 >> 172.21.15.42:0/2204383505 conn(0x7fa6e80b2930 msgr2=0x7fa6e8072480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:17.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.998+0000 7fa6ed600640 1 -- 172.21.15.42:0/2204383505 shutdown_connections 2024-09-17T01:32:17.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:17.998+0000 7fa6ed600640 1 -- 172.21.15.42:0/2204383505 wait complete. 2024-09-17T01:32:18.017 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:32:18.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.245+0000 7f2635000640 1 -- 172.21.15.42:0/2888334331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f263015f190 msgr2=0x7f263006fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:18.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.245+0000 7f2635000640 1 --2- 172.21.15.42:0/2888334331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f263015f190 0x7f263006fe40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f26300b3110 tx=0x7f261802a560 comp rx=0 tx=0).stop 2024-09-17T01:32:18.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.245+0000 7f2635000640 1 -- 172.21.15.42:0/2888334331 shutdown_connections 2024-09-17T01:32:18.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.245+0000 7f2635000640 1 --2- 172.21.15.42:0/2888334331 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f263006d430 0x7f263006d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:18.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.245+0000 7f2635000640 1 --2- 172.21.15.42:0/2888334331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f263015f190 0x7f263006fe40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:18.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.245+0000 7f2635000640 1 --2- 172.21.15.42:0/2888334331 >> v2:172.21.15.43:3300/0 conn(0x7f2630072e00 0x7f263015bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:18.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.245+0000 7f2635000640 1 -- 172.21.15.42:0/2888334331 >> 172.21.15.42:0/2888334331 conn(0x7f26300b2930 msgr2=0x7f263006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:18.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.245+0000 7f2635000640 1 -- 172.21.15.42:0/2888334331 shutdown_connections 2024-09-17T01:32:18.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.245+0000 7f2635000640 1 -- 172.21.15.42:0/2888334331 wait complete. 2024-09-17T01:32:18.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.247+0000 7f2635000640 1 Processor -- start 2024-09-17T01:32:18.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.247+0000 7f2635000640 1 -- start start 2024-09-17T01:32:18.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.249+0000 7f2635000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f263006d430 0x7f263014f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:18.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.249+0000 7f2635000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2630072e00 0x7f2630143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:18.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.249+0000 7f2635000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f263015f190 0x7f2630149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:18.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.249+0000 7f2635000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f26300706b0 con 0x7f263006d430 2024-09-17T01:32:18.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.249+0000 7f2635000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2630070530 con 0x7f263015f190 2024-09-17T01:32:18.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.249+0000 7f2635000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2630151520 con 0x7f2630072e00 2024-09-17T01:32:18.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.249+0000 7f262de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f263006d430 0x7f263014f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:18.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.249+0000 7f262de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f263006d430 0x7f263014f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59326/0 (socket says 172.21.15.42:59326) 2024-09-17T01:32:18.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.249+0000 7f262de00640 1 -- 172.21.15.42:0/3109880411 learned_addr learned my addr 172.21.15.42:0/3109880411 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:18.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.249+0000 7f2627e00640 1 --2- 172.21.15.42:0/3109880411 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2630072e00 0x7f2630143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:18.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.249+0000 7f262e800640 1 --2- 172.21.15.42:0/3109880411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f263015f190 0x7f2630149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:18.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.249+0000 7f262de00640 1 -- 172.21.15.42:0/3109880411 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2630072e00 msgr2=0x7f2630143850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:18.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.249+0000 7f262de00640 1 --2- 172.21.15.42:0/3109880411 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2630072e00 0x7f2630143850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:18.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.249+0000 7f262de00640 1 -- 172.21.15.42:0/3109880411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f263015f190 msgr2=0x7f2630149a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:18.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.249+0000 7f262de00640 1 --2- 172.21.15.42:0/3109880411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f263015f190 0x7f2630149a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:18.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.249+0000 7f262de00640 1 -- 172.21.15.42:0/3109880411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26300ab580 con 0x7f263006d430 2024-09-17T01:32:18.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.250+0000 7f262de00640 1 --2- 172.21.15.42:0/3109880411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f263006d430 0x7f263014f2a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f262000d740 tx=0x7f262000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:18.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.250+0000 7f2626000640 1 -- 172.21.15.42:0/3109880411 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2620017070 con 0x7f263006d430 2024-09-17T01:32:18.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.250+0000 7f2626000640 1 -- 172.21.15.42:0/3109880411 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2620009d20 con 0x7f263006d430 2024-09-17T01:32:18.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.250+0000 7f2626000640 1 -- 172.21.15.42:0/3109880411 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26200106c0 con 0x7f263006d430 2024-09-17T01:32:18.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.250+0000 7f2635000640 1 -- 172.21.15.42:0/3109880411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26300ab860 con 0x7f263006d430 2024-09-17T01:32:18.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.250+0000 7f2635000640 1 -- 172.21.15.42:0/3109880411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26300b3940 con 0x7f263006d430 2024-09-17T01:32:18.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.251+0000 7f2635000640 1 -- 172.21.15.42:0/3109880411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f263015bc50 con 0x7f263006d430 2024-09-17T01:32:18.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.253+0000 7f2626000640 1 -- 172.21.15.42:0/3109880411 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f262001a070 con 0x7f263006d430 2024-09-17T01:32:18.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.254+0000 7f2626000640 1 --2- 172.21.15.42:0/3109880411 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f260c078b90 0x7f260c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:18.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.254+0000 7f2626000640 1 -- 172.21.15.42:0/3109880411 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f262009af30 con 0x7f263006d430 2024-09-17T01:32:18.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.254+0000 7f2627e00640 1 --2- 172.21.15.42:0/3109880411 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f260c078b90 0x7f260c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:18.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.255+0000 7f2627e00640 1 --2- 172.21.15.42:0/3109880411 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f260c078b90 0x7f260c07b0a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2618033000 tx=0x7f2618004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:18.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.258+0000 7f2626000640 1 -- 172.21.15.42:0/3109880411 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2620063360 con 0x7f263006d430 2024-09-17T01:32:18.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.451+0000 7f2635000640 1 -- 172.21.15.42:0/3109880411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f263006a170 con 0x7f263006d430 2024-09-17T01:32:18.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.453+0000 7f2626000640 1 -- 172.21.15.42:0/3109880411 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16621 (secure 0 0 0) 0x7f2620062c60 con 0x7f263006d430 2024-09-17T01:32:18.451 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:18.451 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":22,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:32:08.067689+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:32:04.526150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T01:32:05.523607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:32:18.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.455+0000 7f2635000640 1 -- 172.21.15.42:0/3109880411 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f260c078b90 msgr2=0x7f260c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:18.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.455+0000 7f2635000640 1 --2- 172.21.15.42:0/3109880411 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f260c078b90 0x7f260c07b0a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2618033000 tx=0x7f2618004730 comp rx=0 tx=0).stop 2024-09-17T01:32:18.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.455+0000 7f2635000640 1 -- 172.21.15.42:0/3109880411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f263006d430 msgr2=0x7f263014f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:18.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.455+0000 7f2635000640 1 --2- 172.21.15.42:0/3109880411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f263006d430 0x7f263014f2a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f262000d740 tx=0x7f262000dc00 comp rx=0 tx=0).stop 2024-09-17T01:32:18.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.455+0000 7f2635000640 1 -- 172.21.15.42:0/3109880411 shutdown_connections 2024-09-17T01:32:18.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.455+0000 7f2635000640 1 --2- 172.21.15.42:0/3109880411 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f260c078b90 0x7f260c07b0a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:18.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.455+0000 7f2635000640 1 --2- 172.21.15.42:0/3109880411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f263015f190 0x7f2630149a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:18.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.455+0000 7f2635000640 1 --2- 172.21.15.42:0/3109880411 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2630072e00 0x7f2630143850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:18.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.455+0000 7f2635000640 1 --2- 172.21.15.42:0/3109880411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f263006d430 0x7f263014f2a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:18.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.455+0000 7f2635000640 1 -- 172.21.15.42:0/3109880411 >> 172.21.15.42:0/3109880411 conn(0x7f26300b2930 msgr2=0x7f263006f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:18.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.456+0000 7f2635000640 1 -- 172.21.15.42:0/3109880411 shutdown_connections 2024-09-17T01:32:18.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.456+0000 7f2635000640 1 -- 172.21.15.42:0/3109880411 wait complete. 2024-09-17T01:32:18.475 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:32:18.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.704+0000 7f0f2b200640 1 -- 172.21.15.42:0/507813258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f2c0d2810 msgr2=0x7f0f2c15e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:18.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.704+0000 7f0f2b200640 1 --2- 172.21.15.42:0/507813258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f2c0d2810 0x7f0f2c15e910 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0f18005fd0 tx=0x7f0f1802a540 comp rx=0 tx=0).stop 2024-09-17T01:32:18.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.704+0000 7f0f2b200640 1 -- 172.21.15.42:0/507813258 shutdown_connections 2024-09-17T01:32:18.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.704+0000 7f0f2b200640 1 --2- 172.21.15.42:0/507813258 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f2c0b6030 0x7f0f2c0b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:18.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.704+0000 7f0f2b200640 1 --2- 172.21.15.42:0/507813258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f2c0d2810 0x7f0f2c15e910 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:18.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.704+0000 7f0f2b200640 1 -- 172.21.15.42:0/507813258 >> 172.21.15.42:0/507813258 conn(0x7f0f2c0d1210 msgr2=0x7f0f2c0d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:18.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.704+0000 7f0f2b200640 1 -- 172.21.15.42:0/507813258 shutdown_connections 2024-09-17T01:32:18.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.704+0000 7f0f2b200640 1 -- 172.21.15.42:0/507813258 wait complete. 2024-09-17T01:32:18.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.706+0000 7f0f2b200640 1 Processor -- start 2024-09-17T01:32:18.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.706+0000 7f0f2b200640 1 -- start start 2024-09-17T01:32:18.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.708+0000 7f0f2b200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f2c073340 0x7f0f2c1f6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:18.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.708+0000 7f0f2b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f2c0b6030 0x7f0f2c156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:18.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.708+0000 7f0f2b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f2c0d2810 0x7f0f2c1580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:18.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.708+0000 7f0f2b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2c15f880 con 0x7f0f2c0b6030 2024-09-17T01:32:18.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.708+0000 7f0f2b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2c15f700 con 0x7f0f2c0d2810 2024-09-17T01:32:18.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.708+0000 7f0f2b200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0f2c15fa00 con 0x7f0f2c073340 2024-09-17T01:32:18.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.708+0000 7f0f29400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f2c0b6030 0x7f0f2c156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:18.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.708+0000 7f0f29400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f2c0b6030 0x7f0f2c156ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59344/0 (socket says 172.21.15.42:59344) 2024-09-17T01:32:18.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.708+0000 7f0f29400640 1 -- 172.21.15.42:0/2441178416 learned_addr learned my addr 172.21.15.42:0/2441178416 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:18.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.708+0000 7f0f29e00640 1 --2- 172.21.15.42:0/2441178416 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f2c073340 0x7f0f2c1f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:18.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.708+0000 7f0f2a800640 1 --2- 172.21.15.42:0/2441178416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f2c0d2810 0x7f0f2c1580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:18.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.708+0000 7f0f29400640 1 -- 172.21.15.42:0/2441178416 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f2c073340 msgr2=0x7f0f2c1f6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:18.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.708+0000 7f0f29400640 1 --2- 172.21.15.42:0/2441178416 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f2c073340 0x7f0f2c1f6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:18.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.708+0000 7f0f29400640 1 -- 172.21.15.42:0/2441178416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f2c0d2810 msgr2=0x7f0f2c1580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:18.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.708+0000 7f0f29400640 1 --2- 172.21.15.42:0/2441178416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f2c0d2810 0x7f0f2c1580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:18.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.708+0000 7f0f29400640 1 -- 172.21.15.42:0/2441178416 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f2c15a3a0 con 0x7f0f2c0b6030 2024-09-17T01:32:18.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.709+0000 7f0f29400640 1 --2- 172.21.15.42:0/2441178416 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f2c0b6030 0x7f0f2c156ae0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0f18034040 tx=0x7f0f180038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:18.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.709+0000 7f0f22000640 1 -- 172.21.15.42:0/2441178416 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1803e030 con 0x7f0f2c0b6030 2024-09-17T01:32:18.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.709+0000 7f0f22000640 1 -- 172.21.15.42:0/2441178416 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f18003d90 con 0x7f0f2c0b6030 2024-09-17T01:32:18.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.709+0000 7f0f22000640 1 -- 172.21.15.42:0/2441178416 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f18035040 con 0x7f0f2c0b6030 2024-09-17T01:32:18.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.709+0000 7f0f2b200640 1 -- 172.21.15.42:0/2441178416 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f2c1f6a50 con 0x7f0f2c0b6030 2024-09-17T01:32:18.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.709+0000 7f0f2b200640 1 -- 172.21.15.42:0/2441178416 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f2c157020 con 0x7f0f2c0b6030 2024-09-17T01:32:18.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.710+0000 7f0f2b200640 1 -- 172.21.15.42:0/2441178416 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f2c1f8870 con 0x7f0f2c0b6030 2024-09-17T01:32:18.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.711+0000 7f0f22000640 1 -- 172.21.15.42:0/2441178416 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0f18041030 con 0x7f0f2c0b6030 2024-09-17T01:32:18.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.712+0000 7f0f22000640 1 --2- 172.21.15.42:0/2441178416 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0f0c078b90 0x7f0f0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:18.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.713+0000 7f0f22000640 1 -- 172.21.15.42:0/2441178416 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0f180bb420 con 0x7f0f2c0b6030 2024-09-17T01:32:18.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.713+0000 7f0f29e00640 1 --2- 172.21.15.42:0/2441178416 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0f0c078b90 0x7f0f0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:18.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.713+0000 7f0f29e00640 1 --2- 172.21.15.42:0/2441178416 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0f0c078b90 0x7f0f0c07b0a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c001720 tx=0x7f0f1c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:18.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.717+0000 7f0f22000640 1 -- 172.21.15.42:0/2441178416 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0f18083170 con 0x7f0f2c0b6030 2024-09-17T01:32:18.833 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:32:18.838 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:32:18.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.949+0000 7f0f2b200640 1 -- 172.21.15.42:0/2441178416 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f2c15ff20 con 0x7f0f2c0b6030 2024-09-17T01:32:18.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.949+0000 7f0f22000640 1 -- 172.21.15.42:0/2441178416 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5217 (secure 0 0 0) 0x7f0f18087ba0 con 0x7f0f2c0b6030 2024-09-17T01:32:18.947 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:18.947 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":8,"btime":"2024-09-17T01:32:10:080773+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4301,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1899287597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1899287597},{"type":"v1","addr":"172.21.15.43:6836","nonce":1899287597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4359,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3422946855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3422946855},{"type":"v1","addr":"172.21.15.42:6835","nonce":3422946855}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4363,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1971042705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1971042705},{"type":"v1","addr":"172.21.15.42:6833","nonce":1971042705}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:32:06.566519+0000","modified":"2024-09-17T01:32:09.589828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/3707512090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3707512090},{"type":"v1","addr":"172.21.15.43:6837","nonce":3707512090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4365,"qdb_cluster":[4365]},"id":1}]} 2024-09-17T01:32:18.948 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 8 2024-09-17T01:32:18.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.952+0000 7f0f2b200640 1 -- 172.21.15.42:0/2441178416 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0f0c078b90 msgr2=0x7f0f0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:18.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.952+0000 7f0f2b200640 1 --2- 172.21.15.42:0/2441178416 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0f0c078b90 0x7f0f0c07b0a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c001720 tx=0x7f0f1c009040 comp rx=0 tx=0).stop 2024-09-17T01:32:18.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.952+0000 7f0f2b200640 1 -- 172.21.15.42:0/2441178416 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f2c0b6030 msgr2=0x7f0f2c156ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:18.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.952+0000 7f0f2b200640 1 --2- 172.21.15.42:0/2441178416 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f2c0b6030 0x7f0f2c156ae0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0f18034040 tx=0x7f0f180038a0 comp rx=0 tx=0).stop 2024-09-17T01:32:18.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.952+0000 7f0f2b200640 1 -- 172.21.15.42:0/2441178416 shutdown_connections 2024-09-17T01:32:18.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.952+0000 7f0f2b200640 1 --2- 172.21.15.42:0/2441178416 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0f0c078b90 0x7f0f0c07b0a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:18.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.952+0000 7f0f2b200640 1 --2- 172.21.15.42:0/2441178416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f2c0d2810 0x7f0f2c1580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:18.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.952+0000 7f0f2b200640 1 --2- 172.21.15.42:0/2441178416 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f2c0b6030 0x7f0f2c156ae0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:18.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.952+0000 7f0f2b200640 1 --2- 172.21.15.42:0/2441178416 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f2c073340 0x7f0f2c1f6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:18.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.952+0000 7f0f2b200640 1 -- 172.21.15.42:0/2441178416 >> 172.21.15.42:0/2441178416 conn(0x7f0f2c0d1210 msgr2=0x7f0f2c0d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:18.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.952+0000 7f0f2b200640 1 -- 172.21.15.42:0/2441178416 shutdown_connections 2024-09-17T01:32:18.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:18.952+0000 7f0f2b200640 1 -- 172.21.15.42:0/2441178416 wait complete. 2024-09-17T01:32:19.376 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:32:06.566519+0000', 'modified': '2024-09-17T01:32:09.589828+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4365}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4365': {'gid': 4365, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.43:6837/3707512090', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 3707512090}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 3707512090}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4365, 'qdb_cluster': [4365]} 2024-09-17T01:32:19.376 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T01:32:19.376 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-17T01:32:19.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.608+0000 7ff501200640 1 -- 172.21.15.42:0/3215608676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e00051a0 msgr2=0x7ff4e000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:19.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.608+0000 7ff501200640 1 --2- 172.21.15.42:0/3215608676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e00051a0 0x7ff4e000b9c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4009ed0 tx=0x7ff4e0005830 comp rx=0 tx=0).stop 2024-09-17T01:32:19.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.608+0000 7ff4fbe00640 1 -- 172.21.15.42:0/3215608676 reap_dead start 2024-09-17T01:32:19.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.609+0000 7ff501200640 1 -- 172.21.15.42:0/3215608676 shutdown_connections 2024-09-17T01:32:19.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.609+0000 7ff501200640 1 -- 172.21.15.42:0/3215608676 >> 172.21.15.42:0/3215608676 conn(0x7ff4fc0734a0 msgr2=0x7ff4fc0b61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:19.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.609+0000 7ff501200640 1 -- 172.21.15.42:0/3215608676 shutdown_connections 2024-09-17T01:32:19.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.609+0000 7ff501200640 1 -- 172.21.15.42:0/3215608676 wait complete. 2024-09-17T01:32:19.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.611+0000 7ff501200640 1 Processor -- start 2024-09-17T01:32:19.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.611+0000 7ff501200640 1 -- start start 2024-09-17T01:32:19.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.612+0000 7ff501200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e00051a0 0x7ff4fc150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:19.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.612+0000 7ff501200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4fc1f4dd0 0x7ff4fc155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:19.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.613+0000 7ff501200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff4fc155dd0 0x7ff4fc1f8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:19.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.613+0000 7ff501200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc0695d0 con 0x7ff4e00051a0 2024-09-17T01:32:19.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.613+0000 7ff501200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc069450 con 0x7ff4fc1f4dd0 2024-09-17T01:32:19.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.613+0000 7ff501200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff4fc074a00 con 0x7ff4fc155dd0 2024-09-17T01:32:19.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.613+0000 7ff4fb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e00051a0 0x7ff4fc150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:19.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.613+0000 7ff4fb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e00051a0 0x7ff4fc150970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59364/0 (socket says 172.21.15.42:59364) 2024-09-17T01:32:19.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.613+0000 7ff4fb400640 1 -- 172.21.15.42:0/2466368384 learned_addr learned my addr 172.21.15.42:0/2466368384 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:19.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.613+0000 7ff4f3e00640 1 --2- 172.21.15.42:0/2466368384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4fc1f4dd0 0x7ff4fc155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:19.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.613+0000 7ff4fbe00640 1 --2- 172.21.15.42:0/2466368384 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff4fc155dd0 0x7ff4fc1f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:19.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.613+0000 7ff4fb400640 1 -- 172.21.15.42:0/2466368384 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff4fc155dd0 msgr2=0x7ff4fc1f8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:19.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.613+0000 7ff4fb400640 1 --2- 172.21.15.42:0/2466368384 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff4fc155dd0 0x7ff4fc1f8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.613+0000 7ff4fb400640 1 -- 172.21.15.42:0/2466368384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4fc1f4dd0 msgr2=0x7ff4fc155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:19.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.613+0000 7ff4fb400640 1 --2- 172.21.15.42:0/2466368384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4fc1f4dd0 0x7ff4fc155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.613+0000 7ff4fb400640 1 -- 172.21.15.42:0/2466368384 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4fc1561e0 con 0x7ff4e00051a0 2024-09-17T01:32:19.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.614+0000 7ff4fb400640 1 --2- 172.21.15.42:0/2466368384 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e00051a0 0x7ff4fc150970 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec003e70 tx=0x7ff4ec001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:19.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.614+0000 7ff4f3400640 1 -- 172.21.15.42:0/2466368384 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec011700 con 0x7ff4e00051a0 2024-09-17T01:32:19.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.614+0000 7ff4f3400640 1 -- 172.21.15.42:0/2466368384 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4ec016020 con 0x7ff4e00051a0 2024-09-17T01:32:19.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.614+0000 7ff4f3400640 1 -- 172.21.15.42:0/2466368384 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec011b60 con 0x7ff4e00051a0 2024-09-17T01:32:19.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.614+0000 7ff501200640 1 -- 172.21.15.42:0/2466368384 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4fc0af3e0 con 0x7ff4e00051a0 2024-09-17T01:32:19.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.614+0000 7ff501200640 1 -- 172.21.15.42:0/2466368384 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4fc0ae340 con 0x7ff4e00051a0 2024-09-17T01:32:19.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.616+0000 7ff4f3400640 1 -- 172.21.15.42:0/2466368384 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff4ec011d00 con 0x7ff4e00051a0 2024-09-17T01:32:19.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.617+0000 7ff4f3400640 1 --2- 172.21.15.42:0/2466368384 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff4d8078bc0 0x7ff4d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:19.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.617+0000 7ff4f3400640 1 -- 172.21.15.42:0/2466368384 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff4ec09b9b0 con 0x7ff4e00051a0 2024-09-17T01:32:19.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.618+0000 7ff4f3e00640 1 --2- 172.21.15.42:0/2466368384 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff4d8078bc0 0x7ff4d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:19.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.618+0000 7ff509a21740 1 Processor -- start 2024-09-17T01:32:19.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.618+0000 7ff509a21740 1 -- start start 2024-09-17T01:32:19.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.618+0000 7ff4f3e00640 1 --2- 172.21.15.42:0/2466368384 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff4d8078bc0 0x7ff4d807b0d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4000c00 tx=0x7ff4e4006040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:19.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.619+0000 7ff509a21740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5651332e9270 0x5651336b9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.619+0000 7ff509a21740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332c03b0 0x5651336ba0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.619+0000 7ff509a21740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651332c8590 0x56513368a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.619+0000 7ff509a21740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x565133613430 con 0x5651332c03b0 2024-09-17T01:32:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.619+0000 7ff509a21740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5651336035d0 con 0x5651332c8590 2024-09-17T01:32:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.619+0000 7ff509a21740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5651335f2a00 con 0x5651332e9270 2024-09-17T01:32:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.620+0000 7ff4f3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332c03b0 0x5651336ba0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.620+0000 7ff4fb400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5651332e9270 0x5651336b9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.620+0000 7ff4f3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332c03b0 0x5651336ba0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59374/0 (socket says 172.21.15.42:59374) 2024-09-17T01:32:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.620+0000 7ff4f3e00640 1 -- 172.21.15.42:0/741904983 learned_addr learned my addr 172.21.15.42:0/741904983 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.620+0000 7ff4fbe00640 1 --2- 172.21.15.42:0/741904983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651332c8590 0x56513368a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.620+0000 7ff4f3e00640 1 -- 172.21.15.42:0/741904983 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5651332e9270 msgr2=0x5651336b9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:32:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.620+0000 7ff4f3e00640 1 --2- 172.21.15.42:0/741904983 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5651332e9270 0x5651336b9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.620+0000 7ff4f3e00640 1 -- 172.21.15.42:0/741904983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651332c8590 msgr2=0x56513368a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:32:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.620+0000 7ff4f3e00640 1 --2- 172.21.15.42:0/741904983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651332c8590 0x56513368a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.620+0000 7ff4f3e00640 1 -- 172.21.15.42:0/741904983 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651335bb520 con 0x5651332c03b0 2024-09-17T01:32:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.620+0000 7ff4f3e00640 1 --2- 172.21.15.42:0/741904983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332c03b0 0x5651336ba0a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4000fd0 tx=0x7ff4e4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a9a085462e1488 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.621+0000 7ff4ebe00640 1 -- 172.21.15.42:0/741904983 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4023020 con 0x5651332c03b0 2024-09-17T01:32:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.621+0000 7ff4ebe00640 1 -- 172.21.15.42:0/741904983 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4e4016070 con 0x5651332c03b0 2024-09-17T01:32:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.621+0000 7ff4ebe00640 1 -- 172.21.15.42:0/741904983 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e401f430 con 0x5651332c03b0 2024-09-17T01:32:19.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.621+0000 7ff509a21740 1 -- 172.21.15.42:0/741904983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332c03b0 msgr2=0x5651336ba0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:19.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.621+0000 7ff509a21740 1 --2- 172.21.15.42:0/741904983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332c03b0 0x5651336ba0a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4000fd0 tx=0x7ff4e4014000 comp rx=0 tx=0).stop 2024-09-17T01:32:19.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.622+0000 7ff509a21740 1 -- 172.21.15.42:0/741904983 shutdown_connections 2024-09-17T01:32:19.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.622+0000 7ff509a21740 1 --2- 172.21.15.42:0/741904983 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651332c8590 0x56513368a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.622+0000 7ff509a21740 1 --2- 172.21.15.42:0/741904983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332c03b0 0x5651336ba0a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.622+0000 7ff509a21740 1 --2- 172.21.15.42:0/741904983 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5651332e9270 0x5651336b9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.622+0000 7ff509a21740 1 -- 172.21.15.42:0/741904983 >> 172.21.15.42:0/741904983 conn(0x5651332dd3c0 msgr2=0x56513368fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:19.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.622+0000 7ff509a21740 1 -- 172.21.15.42:0/741904983 shutdown_connections 2024-09-17T01:32:19.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.622+0000 7ff509a21740 1 -- 172.21.15.42:0/741904983 wait complete. 2024-09-17T01:32:19.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.623+0000 7ff509a21740 1 -- start start 2024-09-17T01:32:19.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.623+0000 7ff509a21740 1 Processor -- start 2024-09-17T01:32:19.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.624+0000 7ff509a21740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651332c03b0 0x5651336ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:19.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.624+0000 7ff509a21740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5651332c8590 0x5651336e4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:19.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.624+0000 7ff509a21740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332e9270 0x5651336ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:19.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.624+0000 7ff509a21740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x565133599330 con 0x5651332e9270 2024-09-17T01:32:19.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.624+0000 7ff509a21740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5651335f6810 con 0x5651332c03b0 2024-09-17T01:32:19.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.624+0000 7ff509a21740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x565133363620 con 0x5651332c8590 2024-09-17T01:32:19.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.624+0000 7ff509a21740 10 client.0 _ll_register_callbacks cb 0x56513359e420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:32:19.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.625+0000 7ff4fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332e9270 0x5651336ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:19.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.625+0000 7ff4fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332e9270 0x5651336ccd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59386/0 (socket says 172.21.15.42:59386) 2024-09-17T01:32:19.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.625+0000 7ff4fbe00640 1 -- 172.21.15.42:0/395531533 learned_addr learned my addr 172.21.15.42:0/395531533 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:19.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.625+0000 7ff4fb400640 1 --2- 172.21.15.42:0/395531533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651332c03b0 0x5651336ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:19.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.625+0000 7ff4f3e00640 1 --2- 172.21.15.42:0/395531533 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5651332c8590 0x5651336e4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:19.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.625+0000 7ff4fbe00640 1 -- 172.21.15.42:0/395531533 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5651332c8590 msgr2=0x5651336e4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:32:19.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.625+0000 7ff4fbe00640 1 --2- 172.21.15.42:0/395531533 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5651332c8590 0x5651336e4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.625+0000 7ff4fbe00640 1 -- 172.21.15.42:0/395531533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651332c03b0 msgr2=0x5651336ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:32:19.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.625+0000 7ff4fbe00640 1 --2- 172.21.15.42:0/395531533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651332c03b0 0x5651336ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.625+0000 7ff4fbe00640 1 -- 172.21.15.42:0/395531533 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565133354850 con 0x5651332e9270 2024-09-17T01:32:19.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.625+0000 7ff4fb400640 1 --2- 172.21.15.42:0/395531533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651332c03b0 0x5651336ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:19.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.625+0000 7ff4fbe00640 1 --2- 172.21.15.42:0/395531533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332e9270 0x5651336ccd80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4009ed0 tx=0x7ff4f4003dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857003e9e463f269 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:19.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.625+0000 7ff4e8c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:32:19.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.625+0000 7ff4e8c00640 1 -- 172.21.15.42:0/395531533 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f4038040 con 0x5651332e9270 2024-09-17T01:32:19.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.626+0000 7ff509a21740 1 -- 172.21.15.42:0/395531533 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4e4016070 con 0x5651332e9270 2024-09-17T01:32:19.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.626+0000 7ff4e8c00640 1 -- 172.21.15.42:0/395531533 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff4f40040b0 con 0x5651332e9270 2024-09-17T01:32:19.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.626+0000 7ff4e8c00640 1 -- 172.21.15.42:0/395531533 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7ff4f404d050 con 0x5651332e9270 2024-09-17T01:32:19.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.626+0000 7ff509a21740 10 client.4611 fetch_fsmap learned FSMap version 8 2024-09-17T01:32:19.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.626+0000 7ff509a21740 1 -- 172.21.15.42:0/395531533 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5651333cb6b0 con 0x5651332e9270 2024-09-17T01:32:19.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.626+0000 7ff4e8c00640 1 -- 172.21.15.42:0/395531533 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4e4016070 con 0x5651332e9270 2024-09-17T01:32:19.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.626+0000 7ff4e8c00640 1 -- 172.21.15.42:0/395531533 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7ff4f4050020 con 0x5651332e9270 2024-09-17T01:32:19.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.626+0000 7ff509a21740 10 client.4611 fetch_fsmap finished waiting for FSMap version 8 2024-09-17T01:32:19.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.626+0000 7ff509a21740 10 client.4611 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T01:32:19.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.626+0000 7ff509a21740 20 client.4611 populate_metadata read hostname 'smithi042' 2024-09-17T01:32:19.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.626+0000 7ff509a21740 1 --2- 172.21.15.42:0/395531533 >> [v2:172.21.15.43:6835/3707512090,v1:172.21.15.43:6837/3707512090] conn(0x5651332a7e40 0x5651336b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:19.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.626+0000 7ff509a21740 4 client.4611 mds_command: new command op to 4365 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:32:19.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.626+0000 7ff509a21740 1 -- 172.21.15.42:0/395531533 --> [v2:172.21.15.43:6835/3707512090,v1:172.21.15.43:6837/3707512090] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565133605520 con 0x5651332a7e40 2024-09-17T01:32:19.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.627+0000 7ff4fb400640 1 --2- 172.21.15.42:0/395531533 >> [v2:172.21.15.43:6835/3707512090,v1:172.21.15.43:6837/3707512090] conn(0x5651332a7e40 0x5651336b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:19.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.627+0000 7ff4fb400640 1 --2- 172.21.15.42:0/395531533 >> [v2:172.21.15.43:6835/3707512090,v1:172.21.15.43:6837/3707512090] conn(0x5651332a7e40 0x5651336b39f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c08aa01898022692 server_cookie=c8549853b26a209d in_seq=0 out_seq=0 2024-09-17T01:32:19.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.627+0000 7ff4e8c00640 10 client.4611 ms_handle_connect on v2:172.21.15.43:6835/3707512090 2024-09-17T01:32:19.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.628+0000 7ff4e8c00640 1 -- 172.21.15.42:0/395531533 <== mds.0 v2:172.21.15.43:6835/3707512090 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x565133605520 con 0x5651332a7e40 2024-09-17T01:32:19.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.628+0000 7ff4e8c00640 10 client.4611 handle_command_reply: tid=0 2024-09-17T01:32:19.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.628+0000 7ff509a21740 1 client.4611 shutdown 2024-09-17T01:32:19.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.629+0000 7ff509a21740 1 -- 172.21.15.42:0/395531533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332e9270 msgr2=0x5651336ccd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:19.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.629+0000 7ff509a21740 1 --2- 172.21.15.42:0/395531533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332e9270 0x5651336ccd80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4009ed0 tx=0x7ff4f4003dc0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.629+0000 7ff509a21740 1 -- 172.21.15.42:0/395531533 shutdown_connections 2024-09-17T01:32:19.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.629+0000 7ff509a21740 1 --2- 172.21.15.42:0/395531533 >> [v2:172.21.15.43:6835/3707512090,v1:172.21.15.43:6837/3707512090] conn(0x5651332a7e40 0x5651336b39f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.629+0000 7ff509a21740 1 --2- 172.21.15.42:0/395531533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332e9270 0x5651336ccd80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.629+0000 7ff509a21740 1 --2- 172.21.15.42:0/395531533 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5651332c8590 0x5651336e4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.629+0000 7ff509a21740 1 --2- 172.21.15.42:0/395531533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651332c03b0 0x5651336ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.629+0000 7ff509a21740 1 -- 172.21.15.42:0/395531533 >> 172.21.15.42:0/395531533 conn(0x5651332dd3c0 msgr2=0x5651336b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:19.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.629+0000 7ff4e8c00640 0 client.4611 ms_handle_reset on v2:172.21.15.43:6835/3707512090 2024-09-17T01:32:19.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.629+0000 7ff509a21740 1 -- 172.21.15.42:0/395531533 shutdown_connections 2024-09-17T01:32:19.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.629+0000 7ff509a21740 1 -- 172.21.15.42:0/395531533 wait complete. 2024-09-17T01:32:19.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.629+0000 7ff509a21740 20 client.4611 trim_cache size 0 max 16384 2024-09-17T01:32:19.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.648+0000 7ff509a21740 1 Processor -- start 2024-09-17T01:32:19.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.648+0000 7ff509a21740 1 -- start start 2024-09-17T01:32:19.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.649+0000 7ff509a21740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332dd3c0 0x5651336b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:19.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.649+0000 7ff509a21740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5651332c03b0 0x5651336e70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:19.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.649+0000 7ff509a21740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651332c8590 0x5651336e7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:19.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.650+0000 7ff509a21740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc201260 con 0x5651332dd3c0 2024-09-17T01:32:19.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.650+0000 7ff509a21740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc152330 con 0x5651332c8590 2024-09-17T01:32:19.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.650+0000 7ff509a21740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff4fc200bf0 con 0x5651332c03b0 2024-09-17T01:32:19.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.650+0000 7ff4f3e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5651332c03b0 0x5651336e70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:19.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.650+0000 7ff4fbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651332c8590 0x5651336e7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:19.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.650+0000 7ff4f3e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5651332c03b0 0x5651336e70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:59824/0 (socket says 172.21.15.42:59824) 2024-09-17T01:32:19.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.650+0000 7ff4f3e00640 1 -- 172.21.15.42:0/331360356 learned_addr learned my addr 172.21.15.42:0/331360356 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:19.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.650+0000 7ff4fb400640 1 --2- 172.21.15.42:0/331360356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332dd3c0 0x5651336b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:19.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.650+0000 7ff4fb400640 1 -- 172.21.15.42:0/331360356 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5651332c03b0 msgr2=0x5651336e70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:32:19.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.650+0000 7ff4fb400640 1 --2- 172.21.15.42:0/331360356 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5651332c03b0 0x5651336e70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.650+0000 7ff4fb400640 1 -- 172.21.15.42:0/331360356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651332c8590 msgr2=0x5651336e7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:32:19.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.650+0000 7ff4fb400640 1 --2- 172.21.15.42:0/331360356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651332c8590 0x5651336e7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.650+0000 7ff4fb400640 1 -- 172.21.15.42:0/331360356 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56513368f350 con 0x5651332dd3c0 2024-09-17T01:32:19.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.651+0000 7ff4fb400640 1 --2- 172.21.15.42:0/331360356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332dd3c0 0x5651336b4e70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec099e10 tx=0x7ff4ec099d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78da6f63b626231e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:19.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.651+0000 7ff4eb400640 1 -- 172.21.15.42:0/331360356 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec015040 con 0x5651332dd3c0 2024-09-17T01:32:19.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.651+0000 7ff4eb400640 1 -- 172.21.15.42:0/331360356 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4ec085e50 con 0x5651332dd3c0 2024-09-17T01:32:19.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.651+0000 7ff4eb400640 1 -- 172.21.15.42:0/331360356 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec07dba0 con 0x5651332dd3c0 2024-09-17T01:32:19.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.652+0000 7ff509a21740 1 -- 172.21.15.42:0/331360356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332dd3c0 msgr2=0x5651336b4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:19.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.652+0000 7ff509a21740 1 --2- 172.21.15.42:0/331360356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332dd3c0 0x5651336b4e70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec099e10 tx=0x7ff4ec099d10 comp rx=0 tx=0).stop 2024-09-17T01:32:19.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.652+0000 7ff509a21740 1 -- 172.21.15.42:0/331360356 shutdown_connections 2024-09-17T01:32:19.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.652+0000 7ff509a21740 1 --2- 172.21.15.42:0/331360356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651332c8590 0x5651336e7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.652+0000 7ff509a21740 1 --2- 172.21.15.42:0/331360356 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5651332c03b0 0x5651336e70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.652+0000 7ff509a21740 1 --2- 172.21.15.42:0/331360356 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332dd3c0 0x5651336b4e70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.652+0000 7ff509a21740 1 -- 172.21.15.42:0/331360356 >> 172.21.15.42:0/331360356 conn(0x5651336e8120 msgr2=0x5651336b9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:19.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.652+0000 7ff509a21740 1 -- 172.21.15.42:0/331360356 shutdown_connections 2024-09-17T01:32:19.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.652+0000 7ff509a21740 1 -- 172.21.15.42:0/331360356 wait complete. 2024-09-17T01:32:19.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.653+0000 7ff509a21740 1 -- start start 2024-09-17T01:32:19.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.653+0000 7ff509a21740 1 Processor -- start 2024-09-17T01:32:19.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.654+0000 7ff509a21740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651332c03b0 0x5651337524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:19.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.654+0000 7ff509a21740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5651332c8590 0x5651336b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:19.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.655+0000 7ff509a21740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332dd3c0 0x5651336b1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:19.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.655+0000 7ff509a21740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5651336cd710 con 0x5651332dd3c0 2024-09-17T01:32:19.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.655+0000 7ff509a21740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5651336cd2c0 con 0x5651332c03b0 2024-09-17T01:32:19.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.655+0000 7ff509a21740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5651336b5f30 con 0x5651332c8590 2024-09-17T01:32:19.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.655+0000 7ff509a21740 10 client.0 _ll_register_callbacks cb 0x7ff4f4009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:32:19.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.655+0000 7ff4fb400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651332c03b0 0x5651337524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:19.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.655+0000 7ff4fb400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651332c03b0 0x5651337524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:37894/0 (socket says 172.21.15.42:37894) 2024-09-17T01:32:19.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.655+0000 7ff4fb400640 1 -- 172.21.15.42:0/2103602842 learned_addr learned my addr 172.21.15.42:0/2103602842 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:19.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.655+0000 7ff4f3e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5651332c8590 0x5651336b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:19.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.655+0000 7ff4fbe00640 1 --2- 172.21.15.42:0/2103602842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332dd3c0 0x5651336b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:19.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.655+0000 7ff4fb400640 1 -- 172.21.15.42:0/2103602842 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5651332c8590 msgr2=0x5651336b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:32:19.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.655+0000 7ff4fb400640 1 --2- 172.21.15.42:0/2103602842 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5651332c8590 0x5651336b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.655+0000 7ff4fb400640 1 -- 172.21.15.42:0/2103602842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332dd3c0 msgr2=0x5651336b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:32:19.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.655+0000 7ff4fb400640 1 --2- 172.21.15.42:0/2103602842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332dd3c0 0x5651336b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.655+0000 7ff4fb400640 1 -- 172.21.15.42:0/2103602842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56513368b980 con 0x5651332c03b0 2024-09-17T01:32:19.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.655+0000 7ff4fbe00640 1 --2- 172.21.15.42:0/2103602842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332dd3c0 0x5651336b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:32:19.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.656+0000 7ff4fb400640 1 --2- 172.21.15.42:0/2103602842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651332c03b0 0x5651337524e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec063690 tx=0x7ff4ec06d1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a61923e0e0b633a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:19.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.656+0000 7ff4e8c00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-17T01:32:19.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.656+0000 7ff4e8c00640 1 -- 172.21.15.42:0/2103602842 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec07dda0 con 0x5651332c03b0 2024-09-17T01:32:19.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.656+0000 7ff4e8c00640 1 -- 172.21.15.42:0/2103602842 <== mon.1 v2:172.21.15.43:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff4ec062960 con 0x5651332c03b0 2024-09-17T01:32:19.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.656+0000 7ff509a21740 1 -- 172.21.15.42:0/2103602842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4ec085e50 con 0x5651332c03b0 2024-09-17T01:32:19.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.656+0000 7ff4e8c00640 1 -- 172.21.15.42:0/2103602842 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7ff4ec062ba0 con 0x5651332c03b0 2024-09-17T01:32:19.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.656+0000 7ff509a21740 10 client.4630 fetch_fsmap learned FSMap version 8 2024-09-17T01:32:19.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.656+0000 7ff509a21740 1 -- 172.21.15.42:0/2103602842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x565133752a20 con 0x5651332c03b0 2024-09-17T01:32:19.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.656+0000 7ff4e8c00640 1 -- 172.21.15.42:0/2103602842 <== mon.1 v2:172.21.15.43:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4ec085e50 con 0x5651332c03b0 2024-09-17T01:32:19.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.656+0000 7ff4e8c00640 1 -- 172.21.15.42:0/2103602842 <== mon.1 v2:172.21.15.43:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7ff4ec06c020 con 0x5651332c03b0 2024-09-17T01:32:19.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.656+0000 7ff509a21740 10 client.4630 fetch_fsmap finished waiting for FSMap version 8 2024-09-17T01:32:19.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.656+0000 7ff509a21740 10 client.4630 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T01:32:19.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.656+0000 7ff509a21740 20 client.4630 populate_metadata read hostname 'smithi042' 2024-09-17T01:32:19.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.656+0000 7ff509a21740 1 --2- 172.21.15.42:0/2103602842 >> [v2:172.21.15.43:6835/3707512090,v1:172.21.15.43:6837/3707512090] conn(0x56513327d280 0x565133758b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:19.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.656+0000 7ff509a21740 4 client.4630 mds_command: new command op to 4365 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T01:32:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.656+0000 7ff509a21740 1 -- 172.21.15.42:0/2103602842 --> [v2:172.21.15.43:6835/3707512090,v1:172.21.15.43:6837/3707512090] -- command(tid 0: {"prefix": "status"}) -- 0x5651336b5d80 con 0x56513327d280 2024-09-17T01:32:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.657+0000 7ff4f3e00640 1 --2- 172.21.15.42:0/2103602842 >> [v2:172.21.15.43:6835/3707512090,v1:172.21.15.43:6837/3707512090] conn(0x56513327d280 0x565133758b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.657+0000 7ff4f3e00640 1 --2- 172.21.15.42:0/2103602842 >> [v2:172.21.15.43:6835/3707512090,v1:172.21.15.43:6837/3707512090] conn(0x56513327d280 0x565133758b10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bff35184ff257f5 server_cookie=15330f9641bcdc67 in_seq=0 out_seq=0 2024-09-17T01:32:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.657+0000 7ff4e8c00640 10 client.4630 ms_handle_connect on v2:172.21.15.43:6835/3707512090 2024-09-17T01:32:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.658+0000 7ff4e8c00640 1 -- 172.21.15.42:0/2103602842 <== mds.0 v2:172.21.15.43:6835/3707512090 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5651336b5d80 con 0x56513327d280 2024-09-17T01:32:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.658+0000 7ff4e8c00640 10 client.4630 handle_command_reply: tid=0 2024-09-17T01:32:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.658+0000 7ff509a21740 1 client.4630 shutdown 2024-09-17T01:32:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.658+0000 7ff509a21740 1 -- 172.21.15.42:0/2103602842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651332c03b0 msgr2=0x5651337524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.658+0000 7ff509a21740 1 --2- 172.21.15.42:0/2103602842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651332c03b0 0x5651337524e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec063690 tx=0x7ff4ec06d1f0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.658+0000 7ff509a21740 1 -- 172.21.15.42:0/2103602842 shutdown_connections 2024-09-17T01:32:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.658+0000 7ff509a21740 1 --2- 172.21.15.42:0/2103602842 >> [v2:172.21.15.43:6835/3707512090,v1:172.21.15.43:6837/3707512090] conn(0x56513327d280 0x565133758b10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.658+0000 7ff509a21740 1 --2- 172.21.15.42:0/2103602842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5651332dd3c0 0x5651336b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.658+0000 7ff509a21740 1 --2- 172.21.15.42:0/2103602842 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5651332c8590 0x5651336b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.658+0000 7ff4e8c00640 0 client.4630 ms_handle_reset on v2:172.21.15.43:6835/3707512090 2024-09-17T01:32:19.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.658+0000 7ff509a21740 1 --2- 172.21.15.42:0/2103602842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651332c03b0 0x5651337524e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.658+0000 7ff509a21740 1 -- 172.21.15.42:0/2103602842 >> 172.21.15.42:0/2103602842 conn(0x5651336e8120 msgr2=0x5651336e2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:19.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.658+0000 7ff509a21740 1 -- 172.21.15.42:0/2103602842 shutdown_connections 2024-09-17T01:32:19.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.658+0000 7ff509a21740 1 -- 172.21.15.42:0/2103602842 wait complete. 2024-09-17T01:32:19.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.658+0000 7ff509a21740 20 client.4630 trim_cache size 0 max 16384 2024-09-17T01:32:19.660 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:32:19.660 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "fea1c88c-cb05-432f-a745-f9dcbb5f2503", 2024-09-17T01:32:19.661 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-17T01:32:19.661 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4365, 2024-09-17T01:32:19.661 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-17T01:32:19.661 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-17T01:32:19.661 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-17T01:32:19.661 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 12.587346523000001, 2024-09-17T01:32:19.661 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 8, 2024-09-17T01:32:19.661 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 22, 2024-09-17T01:32:19.661 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 22, 2024-09-17T01:32:19.661 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 18.883094077999999 2024-09-17T01:32:19.661 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:32:19.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.659+0000 7ff501200640 1 -- 172.21.15.42:0/2466368384 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff4d8078bc0 msgr2=0x7ff4d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:19.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.659+0000 7ff501200640 1 --2- 172.21.15.42:0/2466368384 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff4d8078bc0 0x7ff4d807b0d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4000c00 tx=0x7ff4e4006040 comp rx=0 tx=0).stop 2024-09-17T01:32:19.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.659+0000 7ff501200640 1 -- 172.21.15.42:0/2466368384 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e00051a0 msgr2=0x7ff4fc150970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:19.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.659+0000 7ff501200640 1 --2- 172.21.15.42:0/2466368384 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e00051a0 0x7ff4fc150970 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec003e70 tx=0x7ff4ec001800 comp rx=0 tx=0).stop 2024-09-17T01:32:19.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.659+0000 7ff501200640 1 -- 172.21.15.42:0/2466368384 shutdown_connections 2024-09-17T01:32:19.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.659+0000 7ff501200640 1 --2- 172.21.15.42:0/2466368384 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff4d8078bc0 0x7ff4d807b0d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.659+0000 7ff501200640 1 --2- 172.21.15.42:0/2466368384 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4fc1f4dd0 0x7ff4fc155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.659+0000 7ff501200640 1 --2- 172.21.15.42:0/2466368384 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff4fc155dd0 0x7ff4fc1f8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.659+0000 7ff501200640 1 --2- 172.21.15.42:0/2466368384 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e00051a0 0x7ff4fc150970 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:19.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.659+0000 7ff501200640 1 -- 172.21.15.42:0/2466368384 >> 172.21.15.42:0/2466368384 conn(0x7ff4fc0734a0 msgr2=0x7ff4fc158310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:19.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.659+0000 7ff501200640 1 -- 172.21.15.42:0/2466368384 shutdown_connections 2024-09-17T01:32:19.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:19.659+0000 7ff501200640 1 -- 172.21.15.42:0/2466368384 wait complete. 2024-09-17T01:32:19.681 INFO:teuthology.run_tasks:Running task kclient... 2024-09-17T01:32:19.709 INFO:tasks.kclient:Mounting kernel clients... 2024-09-17T01:32:19.709 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-17T01:32:19.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:19.709 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-17T01:32:19.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:19.748 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-09-17T01:32:19.846 INFO:teuthology.orchestra.run.smithi042.stderr:Cannot find device "ceph-brx" 2024-09-17T01:32:19.849 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:32:19.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:19.850 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-17T01:32:19.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:19.885 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-09-17T01:32:19.983 INFO:teuthology.orchestra.run.smithi042.stderr:Cannot find device "ceph-brx" 2024-09-17T01:32:19.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:32:19.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:19.986 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-09-17T01:32:20.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:20.026 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2024-09-17T01:32:20.130 INFO:teuthology.orchestra.run.smithi043.stderr:Cannot find device "ceph-brx" 2024-09-17T01:32:20.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:32:20.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:20.134 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-09-17T01:32:20.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:20.170 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2024-09-17T01:32:20.269 INFO:teuthology.orchestra.run.smithi043.stderr:Cannot find device "ceph-brx" 2024-09-17T01:32:20.271 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:32:20.272 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-17T01:32:20.272 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T01:32:20.272 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:32:20.272 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T01:32:20.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.501+0000 7f3e3ce00640 1 -- 172.21.15.42:0/2558708367 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3e38142f40 msgr2=0x7f3e38072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:20.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.501+0000 7f3e3ce00640 1 --2- 172.21.15.42:0/2558708367 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3e38142f40 0x7f3e38072950 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009830 tx=0x7f3e2002a480 comp rx=0 tx=0).stop 2024-09-17T01:32:20.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.501+0000 7f3e3ce00640 1 -- 172.21.15.42:0/2558708367 shutdown_connections 2024-09-17T01:32:20.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.501+0000 7f3e3ce00640 1 --2- 172.21.15.42:0/2558708367 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3e38142f40 0x7f3e38072950 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:20.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.501+0000 7f3e3ce00640 1 --2- 172.21.15.42:0/2558708367 >> v2:172.21.15.43:3300/0 conn(0x7f3e380b3550 0x7f3e3815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:20.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.501+0000 7f3e3ce00640 1 -- 172.21.15.42:0/2558708367 >> 172.21.15.42:0/2558708367 conn(0x7f3e380b2930 msgr2=0x7f3e3806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:20.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.501+0000 7f3e3ce00640 1 -- 172.21.15.42:0/2558708367 shutdown_connections 2024-09-17T01:32:20.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.502+0000 7f3e3ce00640 1 -- 172.21.15.42:0/2558708367 wait complete. 2024-09-17T01:32:20.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.504+0000 7f3e3ce00640 1 Processor -- start 2024-09-17T01:32:20.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.504+0000 7f3e3ce00640 1 -- start start 2024-09-17T01:32:20.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.505+0000 7f3e3ce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e38072e90 0x7f3e381597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:20.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.505+0000 7f3e3ce00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3e380b3550 0x7f3e380aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:20.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.505+0000 7f3e3ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e38142f40 0x7f3e38134b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:20.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.505+0000 7f3e3ce00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3806d640 con 0x7f3e38142f40 2024-09-17T01:32:20.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.505+0000 7f3e3ce00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3815d680 con 0x7f3e38072e90 2024-09-17T01:32:20.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.505+0000 7f3e3ce00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3e3806d7c0 con 0x7f3e380b3550 2024-09-17T01:32:20.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.506+0000 7f3e36800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e38142f40 0x7f3e38134b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:20.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.506+0000 7f3e36800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e38142f40 0x7f3e38134b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59412/0 (socket says 172.21.15.42:59412) 2024-09-17T01:32:20.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.506+0000 7f3e36800640 1 -- 172.21.15.42:0/3829707151 learned_addr learned my addr 172.21.15.42:0/3829707151 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:20.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.506+0000 7f3e35e00640 1 --2- 172.21.15.42:0/3829707151 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e38072e90 0x7f3e381597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:20.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.506+0000 7f3e2fe00640 1 --2- 172.21.15.42:0/3829707151 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3e380b3550 0x7f3e380aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:20.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.506+0000 7f3e36800640 1 -- 172.21.15.42:0/3829707151 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3e380b3550 msgr2=0x7f3e380aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:20.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.506+0000 7f3e36800640 1 --2- 172.21.15.42:0/3829707151 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3e380b3550 0x7f3e380aa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:20.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.506+0000 7f3e36800640 1 -- 172.21.15.42:0/3829707151 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e38072e90 msgr2=0x7f3e381597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:20.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.506+0000 7f3e36800640 1 --2- 172.21.15.42:0/3829707151 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e38072e90 0x7f3e381597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:20.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.506+0000 7f3e36800640 1 -- 172.21.15.42:0/3829707151 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e38135a00 con 0x7f3e38142f40 2024-09-17T01:32:20.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.506+0000 7f3e36800640 1 --2- 172.21.15.42:0/3829707151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e38142f40 0x7f3e38134b60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000cb40 tx=0x7f3e3000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:20.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.507+0000 7f3e2e000640 1 -- 172.21.15.42:0/3829707151 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e30016020 con 0x7f3e38142f40 2024-09-17T01:32:20.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.507+0000 7f3e2e000640 1 -- 172.21.15.42:0/3829707151 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e3000adb0 con 0x7f3e38142f40 2024-09-17T01:32:20.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.507+0000 7f3e2e000640 1 -- 172.21.15.42:0/3829707151 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e30012680 con 0x7f3e38142f40 2024-09-17T01:32:20.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.507+0000 7f3e3ce00640 1 -- 172.21.15.42:0/3829707151 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e380ab000 con 0x7f3e38142f40 2024-09-17T01:32:20.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.507+0000 7f3e3ce00640 1 -- 172.21.15.42:0/3829707151 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e380ab5c0 con 0x7f3e38142f40 2024-09-17T01:32:20.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.508+0000 7f3e3ce00640 1 -- 172.21.15.42:0/3829707151 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e3806dce0 con 0x7f3e38142f40 2024-09-17T01:32:20.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.509+0000 7f3e2e000640 1 -- 172.21.15.42:0/3829707151 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3e30019020 con 0x7f3e38142f40 2024-09-17T01:32:20.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.511+0000 7f3e2e000640 1 --2- 172.21.15.42:0/3829707151 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3e14078b90 0x7f3e1407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:20.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.511+0000 7f3e2e000640 1 -- 172.21.15.42:0/3829707151 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3e3009b290 con 0x7f3e38142f40 2024-09-17T01:32:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.511+0000 7f3e35e00640 1 --2- 172.21.15.42:0/3829707151 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3e14078b90 0x7f3e1407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.512+0000 7f3e35e00640 1 --2- 172.21.15.42:0/3829707151 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3e14078b90 0x7f3e1407b0a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3e28009b30 tx=0x7f3e28005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:20.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.516+0000 7f3e2e000640 1 -- 172.21.15.42:0/3829707151 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3e30020020 con 0x7f3e38142f40 2024-09-17T01:32:20.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.749+0000 7f3e3ce00640 1 -- 172.21.15.42:0/3829707151 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3e380aad90 con 0x7f3e38142f40 2024-09-17T01:32:20.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.750+0000 7f3e2e000640 1 -- 172.21.15.42:0/3829707151 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f3e30062fe0 con 0x7f3e38142f40 2024-09-17T01:32:20.748 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T01:32:20.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.752+0000 7f3e3ce00640 1 -- 172.21.15.42:0/3829707151 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3e14078b90 msgr2=0x7f3e1407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:20.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.752+0000 7f3e3ce00640 1 --2- 172.21.15.42:0/3829707151 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3e14078b90 0x7f3e1407b0a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3e28009b30 tx=0x7f3e28005f90 comp rx=0 tx=0).stop 2024-09-17T01:32:20.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.752+0000 7f3e3ce00640 1 -- 172.21.15.42:0/3829707151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e38142f40 msgr2=0x7f3e38134b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:20.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.752+0000 7f3e3ce00640 1 --2- 172.21.15.42:0/3829707151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e38142f40 0x7f3e38134b60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000cb40 tx=0x7f3e3000a060 comp rx=0 tx=0).stop 2024-09-17T01:32:20.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.752+0000 7f3e3ce00640 1 -- 172.21.15.42:0/3829707151 shutdown_connections 2024-09-17T01:32:20.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.752+0000 7f3e3ce00640 1 --2- 172.21.15.42:0/3829707151 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3e14078b90 0x7f3e1407b0a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:20.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.752+0000 7f3e3ce00640 1 --2- 172.21.15.42:0/3829707151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e38142f40 0x7f3e38134b60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:20.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.752+0000 7f3e3ce00640 1 --2- 172.21.15.42:0/3829707151 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3e380b3550 0x7f3e380aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:20.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.752+0000 7f3e3ce00640 1 --2- 172.21.15.42:0/3829707151 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e38072e90 0x7f3e381597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:20.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.752+0000 7f3e3ce00640 1 -- 172.21.15.42:0/3829707151 >> 172.21.15.42:0/3829707151 conn(0x7f3e380b2930 msgr2=0x7f3e38073f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:20.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.752+0000 7f3e3ce00640 1 -- 172.21.15.42:0/3829707151 shutdown_connections 2024-09-17T01:32:20.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20.752+0000 7f3e3ce00640 1 -- 172.21.15.42:0/3829707151 wait complete. 2024-09-17T01:32:20.775 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T01:32:20.776 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:32:20.776 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-09-17T01:32:20.776 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T01:32:20.776 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:32:20.776 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T01:32:20.776 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T01:32:20.776 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:32:20.776 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:32:20.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:20.777 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-09-17T01:32:20.812 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:32:20.812 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:32:20.813 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:32:20.813 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:20.813 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-17T01:32:20.813 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:20.813 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:32:20.813 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-09-17T01:32:20.813 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-09-17T01:32:20.813 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:32:20.813 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-09-17T01:32:20.813 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-09-17T01:32:20.813 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:32:20.813 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:32:20.813 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-09-17T01:32:20.814 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-17T01:32:20.814 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42667sec preferred_lft 42667sec 2024-09-17T01:32:20.814 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-17T01:32:20.814 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:20.814 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:32:20.814 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:32:20.814 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-09-17T01:32:20.815 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T01:32:20.815 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:32:20.815 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:32:20.815 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add name ceph-brx type bridge 2024-09-17T01:32:20.815 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip addr flush dev ceph-brx 2024-09-17T01:32:20.815 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set ceph-brx up 2024-09-17T01:32:20.815 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T01:32:20.815 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:32:20.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:32:21.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:21.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:21.236 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:32:21.292 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-17T01:32:21.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:21.296 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-09-17T01:32:21.341 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-09-17T01:32:21.341 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:32:21.341 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-17T01:32:21.341 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-17T01:32:21.342 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:32:21.342 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:32:21.342 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:32:21.342 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T01:32:21.342 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T01:32:21.342 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T01:32:21.342 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:32:21.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:32:21.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:21.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:21.967 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-17T01:32:22.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:22.004 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list-id 2024-09-17T01:32:22.080 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:32:22.080 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:32:22.081 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:32:22.081 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-17T01:32:22.081 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:32:22.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:32:22.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:22.260 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-17T01:32:22.260 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:32:22.260 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:32:22.260 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-17T01:32:22.260 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T01:32:22.260 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-17T01:32:22.260 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-17T01:32:22.261 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-17T01:32:22.261 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:32:22.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:32:22.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:22.511 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:32:22.511 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:32:22.511 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-09-17T01:32:22.511 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T01:32:22.511 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:32:22.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:32:22.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:22.678 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:32:22.678 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T01:32:22.714 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:32:22.714 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:32:22.715 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:32:22.790 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T01:32:22.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:22.791 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:32:22.999 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:32:23.000 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:32:23.000 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:32:23.641 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:32:23.641 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:32:23.641 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:32:23.641 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:32:23.641 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:32:23.677 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:32:23.677 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:32:23.677 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:32:23.677 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:32:23.677 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:32:23.677 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-09-17T01:32:23.677 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-09-17T01:32:23.677 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fea1c88c-cb05-432f-a745-f9dcbb5f2503" will pass to kernel 2024-09-17T01:32:23.679 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T01:32:23.679 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-09-17T01:32:23.679 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T01:32:23.679 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T01:32:23.679 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T01:32:23.682 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T01:32:23.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:23.682 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:32:23.740 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:32:23.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:32:23.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:23.841 INFO:teuthology.orchestra.run.smithi042.stdout:client4505 2024-09-17T01:32:23.842 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:32:23.842 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:32:23.878 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:32:24.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:32:24.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:24.018 INFO:teuthology.orchestra.run.smithi042.stdout:client4505 2024-09-17T01:32:24.019 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:32:24.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:32:24.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:24.120 INFO:teuthology.orchestra.run.smithi042.stdout:client4505 2024-09-17T01:32:24.120 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/fea1c88c-cb05-432f-a745-f9dcbb5f2503.client4505/status') 2024-09-17T01:32:24.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:32:24.227 INFO:teuthology.orchestra.run.smithi042.stdout:instance: client.4505 (3)172.21.15.42:0/2414241535 2024-09-17T01:32:24.227 INFO:teuthology.orchestra.run.smithi042.stdout:blocklisted: false 2024-09-17T01:32:24.228 INFO:teuthology.orchestra.run.smithi042.stderr:0+1 records in 2024-09-17T01:32:24.228 INFO:teuthology.orchestra.run.smithi042.stderr:0+1 records out 2024-09-17T01:32:24.228 INFO:teuthology.orchestra.run.smithi042.stderr:70 bytes copied, 5.8435e-05 s, 1.2 MB/s 2024-09-17T01:32:24.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:24.238 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-17T01:32:24.238 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T01:32:24.238 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T01:32:24.238 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T01:32:24.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.469+0000 7f6783400640 1 -- 172.21.15.42:0/2223725754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6764004d40 msgr2=0x7f6764005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:24.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.469+0000 7f6783400640 1 --2- 172.21.15.42:0/2223725754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6764004d40 0x7f6764005190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f677c158cf0 tx=0x7f6764005830 comp rx=0 tx=0).stop 2024-09-17T01:32:24.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.469+0000 7f6781400640 1 -- 172.21.15.42:0/2223725754 reap_dead start 2024-09-17T01:32:24.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.469+0000 7f6783400640 1 -- 172.21.15.42:0/2223725754 shutdown_connections 2024-09-17T01:32:24.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.469+0000 7f6783400640 1 -- 172.21.15.42:0/2223725754 >> 172.21.15.42:0/2223725754 conn(0x7f677c0b2930 msgr2=0x7f677c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:24.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.469+0000 7f6783400640 1 -- 172.21.15.42:0/2223725754 shutdown_connections 2024-09-17T01:32:24.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.469+0000 7f6783400640 1 -- 172.21.15.42:0/2223725754 wait complete. 2024-09-17T01:32:24.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.471+0000 7f6783400640 1 Processor -- start 2024-09-17T01:32:24.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.472+0000 7f6783400640 1 -- start start 2024-09-17T01:32:24.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.473+0000 7f6783400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6764004d40 0x7f677c144e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:24.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.473+0000 7f6783400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f677c1537f0 0x7f677c153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:24.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.473+0000 7f6783400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f677c154140 0x7f677c1f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:24.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.473+0000 7f6783400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f677c15bdd0 con 0x7f6764004d40 2024-09-17T01:32:24.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.473+0000 7f6783400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f677c15bc50 con 0x7f677c1537f0 2024-09-17T01:32:24.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.473+0000 7f6783400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f677c15bf50 con 0x7f677c154140 2024-09-17T01:32:24.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.473+0000 7f6780a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6764004d40 0x7f677c144e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:24.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.473+0000 7f6780a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6764004d40 0x7f677c144e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59436/0 (socket says 172.21.15.42:59436) 2024-09-17T01:32:24.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.473+0000 7f6780a00640 1 -- 172.21.15.42:0/2410703516 learned_addr learned my addr 172.21.15.42:0/2410703516 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:24.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.474+0000 7f6780a00640 1 -- 172.21.15.42:0/2410703516 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f677c154140 msgr2=0x7f677c1f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:24.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.474+0000 7f6780a00640 1 --2- 172.21.15.42:0/2410703516 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f677c154140 0x7f677c1f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:24.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.474+0000 7f6780a00640 1 -- 172.21.15.42:0/2410703516 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f677c1537f0 msgr2=0x7f677c153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:24.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.474+0000 7f6780a00640 1 --2- 172.21.15.42:0/2410703516 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f677c1537f0 0x7f677c153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:24.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.474+0000 7f6780a00640 1 -- 172.21.15.42:0/2410703516 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f677c153310 con 0x7f6764004d40 2024-09-17T01:32:24.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.474+0000 7f6780a00640 1 --2- 172.21.15.42:0/2410703516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6764004d40 0x7f677c144e40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6770004e10 tx=0x7f6770001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:24.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.474+0000 7f6778c00640 1 -- 172.21.15.42:0/2410703516 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6770015020 con 0x7f6764004d40 2024-09-17T01:32:24.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.474+0000 7f6778c00640 1 -- 172.21.15.42:0/2410703516 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6770011960 con 0x7f6764004d40 2024-09-17T01:32:24.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.474+0000 7f6778c00640 1 -- 172.21.15.42:0/2410703516 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6770011db0 con 0x7f6764004d40 2024-09-17T01:32:24.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.474+0000 7f6783400640 1 -- 172.21.15.42:0/2410703516 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f677c159f70 con 0x7f6764004d40 2024-09-17T01:32:24.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.474+0000 7f6783400640 1 -- 172.21.15.42:0/2410703516 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f677c15a530 con 0x7f6764004d40 2024-09-17T01:32:24.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.475+0000 7f6783400640 1 -- 172.21.15.42:0/2410703516 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f677c15f350 con 0x7f6764004d40 2024-09-17T01:32:24.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.477+0000 7f6778c00640 1 -- 172.21.15.42:0/2410703516 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6770018020 con 0x7f6764004d40 2024-09-17T01:32:24.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.477+0000 7f6778c00640 1 --2- 172.21.15.42:0/2410703516 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f675c078b90 0x7f675c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:24.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.478+0000 7f6778c00640 1 -- 172.21.15.42:0/2410703516 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f677009b870 con 0x7f6764004d40 2024-09-17T01:32:24.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.478+0000 7f677be00640 1 --2- 172.21.15.42:0/2410703516 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f675c078b90 0x7f675c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:24.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.479+0000 7f677be00640 1 --2- 172.21.15.42:0/2410703516 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f675c078b90 0x7f675c07b0a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f677c0cc510 tx=0x7f6768000ef0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:24.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.482+0000 7f6778c00640 1 -- 172.21.15.42:0/2410703516 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f677001f020 con 0x7f6764004d40 2024-09-17T01:32:24.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.715+0000 7f6783400640 1 -- 172.21.15.42:0/2410703516 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f677c06a170 con 0x7f6764004d40 2024-09-17T01:32:24.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.716+0000 7f6778c00640 1 -- 172.21.15.42:0/2410703516 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f6770063ca0 con 0x7f6764004d40 2024-09-17T01:32:24.714 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T01:32:24.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.719+0000 7f6783400640 1 -- 172.21.15.42:0/2410703516 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f675c078b90 msgr2=0x7f675c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:24.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.719+0000 7f6783400640 1 --2- 172.21.15.42:0/2410703516 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f675c078b90 0x7f675c07b0a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f677c0cc510 tx=0x7f6768000ef0 comp rx=0 tx=0).stop 2024-09-17T01:32:24.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.719+0000 7f6783400640 1 -- 172.21.15.42:0/2410703516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6764004d40 msgr2=0x7f677c144e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:24.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.719+0000 7f6783400640 1 --2- 172.21.15.42:0/2410703516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6764004d40 0x7f677c144e40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6770004e10 tx=0x7f6770001710 comp rx=0 tx=0).stop 2024-09-17T01:32:24.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.719+0000 7f6783400640 1 -- 172.21.15.42:0/2410703516 shutdown_connections 2024-09-17T01:32:24.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.719+0000 7f6783400640 1 --2- 172.21.15.42:0/2410703516 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f675c078b90 0x7f675c07b0a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:24.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.719+0000 7f6783400640 1 --2- 172.21.15.42:0/2410703516 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f677c1537f0 0x7f677c153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:24.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.719+0000 7f6783400640 1 --2- 172.21.15.42:0/2410703516 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f677c154140 0x7f677c1f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:24.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.719+0000 7f6783400640 1 --2- 172.21.15.42:0/2410703516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6764004d40 0x7f677c144e40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:24.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.719+0000 7f6783400640 1 -- 172.21.15.42:0/2410703516 >> 172.21.15.42:0/2410703516 conn(0x7f677c0b2930 msgr2=0x7f677c0b0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:24.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.719+0000 7f6783400640 1 -- 172.21.15.42:0/2410703516 shutdown_connections 2024-09-17T01:32:24.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:24.719+0000 7f6783400640 1 -- 172.21.15.42:0/2410703516 wait complete. 2024-09-17T01:32:24.741 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T01:32:24.742 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:32:24.742 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-09-17T01:32:24.742 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-17T01:32:24.742 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T01:32:24.742 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T01:32:24.742 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T01:32:24.742 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:32:24.742 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-17T01:32:24.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:24.742 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-09-17T01:32:24.779 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:32:24.779 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:32:24.779 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:32:24.779 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:24.779 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-17T01:32:24.779 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:24.779 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:32:24.779 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-09-17T01:32:24.780 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-09-17T01:32:24.780 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:32:24.780 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-09-17T01:32:24.780 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-09-17T01:32:24.780 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:32:24.780 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:32:24.780 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-09-17T01:32:24.780 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-17T01:32:24.780 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42663sec preferred_lft 42663sec 2024-09-17T01:32:24.780 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-17T01:32:24.781 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:24.781 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:32:24.781 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:32:24.781 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-09-17T01:32:24.781 INFO:teuthology.orchestra.run.smithi042.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T01:32:24.781 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether e2:73:3e:9b:8a:00 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:32:24.781 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T01:32:24.781 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:24.781 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::68d2:2bff:fe2f:191a/64 scope link 2024-09-17T01:32:24.781 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:24.781 INFO:teuthology.orchestra.run.smithi042.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:32:24.781 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether e2:73:3e:9b:8a:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:32:24.782 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::e073:3eff:fe9b:8a00/64 scope link 2024-09-17T01:32:24.782 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:24.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:24.782 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:32:24.875 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-17T01:32:24.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:24.878 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-09-17T01:32:24.915 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-09-17T01:32:24.915 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:32:24.915 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-17T01:32:24.915 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-17T01:32:24.915 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:32:24.915 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:32:24.916 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:32:24.916 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T01:32:24.916 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T01:32:24.916 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T01:32:24.916 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:32:25.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:32:25.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:25.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:25.115 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-17T01:32:25.151 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T01:32:25.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:25.152 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list-id 2024-09-17T01:32:25.227 INFO:teuthology.orchestra.run.smithi042.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-17T01:32:25.228 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:32:25.228 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:32:25.228 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T01:32:25.228 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-17T01:32:25.228 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:32:25.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:32:25.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:25.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:25.405 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T01:32:25.460 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:32:25.461 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:32:25.461 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:32:25.461 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:25.461 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-17T01:32:25.461 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:25.461 INFO:teuthology.orchestra.run.smithi042.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T01:32:25.461 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 8a:07:37:c5:78:11 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T01:32:25.461 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T01:32:25.461 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:25.461 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::8807:37ff:fec5:7811/64 scope link 2024-09-17T01:32:25.461 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:25.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:25.463 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T01:32:25.519 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:32:25.519 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:32:25.519 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:32:25.519 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:25.520 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-17T01:32:25.520 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:25.520 INFO:teuthology.orchestra.run.smithi042.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T01:32:25.520 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 8a:07:37:c5:78:11 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T01:32:25.520 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T01:32:25.520 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:25.520 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::8807:37ff:fec5:7811/64 scope link 2024-09-17T01:32:25.520 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:25.522 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-17T01:32:25.522 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:32:25.522 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:32:25.522 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-17T01:32:25.522 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T01:32:25.523 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-17T01:32:25.523 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-17T01:32:25.523 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-17T01:32:25.523 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:32:25.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:32:25.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:25.739 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:32:25.739 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:32:25.740 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.1 up 2024-09-17T01:32:25.740 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T01:32:25.740 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:32:25.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:32:25.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:25.908 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:32:25.908 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-17T01:32:25.943 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-17T01:32:25.944 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:32:25.944 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-17T01:32:26.018 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T01:32:26.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:26.018 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T01:32:26.215 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T01:32:26.215 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T01:32:26.215 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:32:26.235 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T01:32:26.235 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T01:32:26.235 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:32:26.235 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:32:26.236 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:32:26.265 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T01:32:26.266 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T01:32:26.266 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:32:26.266 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:32:26.266 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:32:26.266 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-09-17T01:32:26.266 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-09-17T01:32:26.266 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=fea1c88c-cb05-432f-a745-f9dcbb5f2503" will pass to kernel 2024-09-17T01:32:26.267 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-17T01:32:26.267 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-09-17T01:32:26.267 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T01:32:26.267 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T01:32:26.268 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T01:32:26.270 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T01:32:26.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:26.271 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-17T01:32:26.327 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:32:26.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:32:26.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:26.417 INFO:teuthology.orchestra.run.smithi042.stdout:client4642 2024-09-17T01:32:26.418 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:32:26.418 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:32:26.454 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:32:26.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:32:26.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:26.584 INFO:teuthology.orchestra.run.smithi042.stdout:client4642 2024-09-17T01:32:26.584 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:32:26.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:32:26.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:26.675 INFO:teuthology.orchestra.run.smithi042.stdout:client4642 2024-09-17T01:32:26.675 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/fea1c88c-cb05-432f-a745-f9dcbb5f2503.client4642/status') 2024-09-17T01:32:26.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:32:26.776 INFO:teuthology.orchestra.run.smithi042.stdout:instance: client.4642 (3)172.21.15.42:0/716643053 2024-09-17T01:32:26.776 INFO:teuthology.orchestra.run.smithi042.stdout:blocklisted: false 2024-09-17T01:32:26.776 INFO:teuthology.orchestra.run.smithi042.stderr:0+1 records in 2024-09-17T01:32:26.777 INFO:teuthology.orchestra.run.smithi042.stderr:0+1 records out 2024-09-17T01:32:26.777 INFO:teuthology.orchestra.run.smithi042.stderr:69 bytes copied, 5.822e-05 s, 1.2 MB/s 2024-09-17T01:32:26.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:26.786 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-17T01:32:26.787 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T01:32:26.787 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T01:32:26.787 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T01:32:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.018+0000 7f3709c00640 1 -- 172.21.15.42:0/1402898838 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3704156d50 msgr2=0x7f3704073c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.018+0000 7f3709c00640 1 --2- 172.21.15.42:0/1402898838 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3704156d50 0x7f3704073c40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f36f4005fd0 tx=0x7f36f402a540 comp rx=0 tx=0).stop 2024-09-17T01:32:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.018+0000 7f3709c00640 1 -- 172.21.15.42:0/1402898838 shutdown_connections 2024-09-17T01:32:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.018+0000 7f3709c00640 1 --2- 172.21.15.42:0/1402898838 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3704074400 0x7f3704160170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.018+0000 7f3709c00640 1 --2- 172.21.15.42:0/1402898838 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3704156d50 0x7f3704073c40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.018+0000 7f3709c00640 1 -- 172.21.15.42:0/1402898838 >> 172.21.15.42:0/1402898838 conn(0x7f370406d890 msgr2=0x7f37040b2330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.019+0000 7f3709c00640 1 -- 172.21.15.42:0/1402898838 shutdown_connections 2024-09-17T01:32:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.019+0000 7f3709c00640 1 -- 172.21.15.42:0/1402898838 wait complete. 2024-09-17T01:32:27.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.021+0000 7f3709c00640 1 Processor -- start 2024-09-17T01:32:27.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.021+0000 7f3709c00640 1 -- start start 2024-09-17T01:32:27.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.022+0000 7f3709c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3704074400 0x7f3704158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:27.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.022+0000 7f3709c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3704156d50 0x7f37040aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:27.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.022+0000 7f3709c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37041606b0 0x7f37040aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:27.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.022+0000 7f3709c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f370415d430 con 0x7f3704074400 2024-09-17T01:32:27.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.022+0000 7f3709c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f370415d2b0 con 0x7f37041606b0 2024-09-17T01:32:27.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.022+0000 7f3709c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f370415d5b0 con 0x7f3704156d50 2024-09-17T01:32:27.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.023+0000 7f3703e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3704074400 0x7f3704158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:27.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.023+0000 7f3703e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3704074400 0x7f3704158c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54262/0 (socket says 172.21.15.42:54262) 2024-09-17T01:32:27.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.023+0000 7f3703e00640 1 -- 172.21.15.42:0/2490969141 learned_addr learned my addr 172.21.15.42:0/2490969141 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:27.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.023+0000 7f36fbe00640 1 --2- 172.21.15.42:0/2490969141 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3704156d50 0x7f37040aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:27.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.023+0000 7f3709200640 1 --2- 172.21.15.42:0/2490969141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37041606b0 0x7f37040aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:27.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.023+0000 7f3703e00640 1 -- 172.21.15.42:0/2490969141 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3704156d50 msgr2=0x7f37040aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:27.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.023+0000 7f3703e00640 1 --2- 172.21.15.42:0/2490969141 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3704156d50 0x7f37040aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:27.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.023+0000 7f3703e00640 1 -- 172.21.15.42:0/2490969141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37041606b0 msgr2=0x7f37040aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:27.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.023+0000 7f3703e00640 1 --2- 172.21.15.42:0/2490969141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37041606b0 0x7f37040aa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:27.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.023+0000 7f3703e00640 1 -- 172.21.15.42:0/2490969141 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3704159540 con 0x7f3704074400 2024-09-17T01:32:27.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.023+0000 7f3703e00640 1 --2- 172.21.15.42:0/2490969141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3704074400 0x7f3704158c60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f36f4006010 tx=0x7f36f40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:27.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.024+0000 7f3700c00640 1 -- 172.21.15.42:0/2490969141 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f403e030 con 0x7f3704074400 2024-09-17T01:32:27.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.024+0000 7f3700c00640 1 -- 172.21.15.42:0/2490969141 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36f4003d90 con 0x7f3704074400 2024-09-17T01:32:27.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.024+0000 7f3709c00640 1 -- 172.21.15.42:0/2490969141 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3704159820 con 0x7f3704074400 2024-09-17T01:32:27.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.024+0000 7f3700c00640 1 -- 172.21.15.42:0/2490969141 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f4035040 con 0x7f3704074400 2024-09-17T01:32:27.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.024+0000 7f3709c00640 1 -- 172.21.15.42:0/2490969141 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37040cf0b0 con 0x7f3704074400 2024-09-17T01:32:27.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.025+0000 7f3709c00640 1 -- 172.21.15.42:0/2490969141 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3704160170 con 0x7f3704074400 2024-09-17T01:32:27.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.026+0000 7f3700c00640 1 -- 172.21.15.42:0/2490969141 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f36f4041030 con 0x7f3704074400 2024-09-17T01:32:27.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.027+0000 7f3700c00640 1 --2- 172.21.15.42:0/2490969141 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f36e0078bf0 0x7f36e007b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:27.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.027+0000 7f3700c00640 1 -- 172.21.15.42:0/2490969141 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f36f40bb4c0 con 0x7f3704074400 2024-09-17T01:32:27.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.028+0000 7f36fbe00640 1 --2- 172.21.15.42:0/2490969141 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f36e0078bf0 0x7f36e007b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:27.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.028+0000 7f36fbe00640 1 --2- 172.21.15.42:0/2490969141 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f36e0078bf0 0x7f36e007b100 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f37040ab250 tx=0x7f36ec005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:27.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.032+0000 7f3700c00640 1 -- 172.21.15.42:0/2490969141 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f36f4083210 con 0x7f3704074400 2024-09-17T01:32:27.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.264+0000 7f3709c00640 1 -- 172.21.15.42:0/2490969141 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f370415f440 con 0x7f3704074400 2024-09-17T01:32:27.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.264+0000 7f3700c00640 1 -- 172.21.15.42:0/2490969141 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f36f4087c40 con 0x7f3704074400 2024-09-17T01:32:27.262 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T01:32:27.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.267+0000 7f3709c00640 1 -- 172.21.15.42:0/2490969141 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f36e0078bf0 msgr2=0x7f36e007b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:27.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.267+0000 7f3709c00640 1 --2- 172.21.15.42:0/2490969141 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f36e0078bf0 0x7f36e007b100 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f37040ab250 tx=0x7f36ec005f90 comp rx=0 tx=0).stop 2024-09-17T01:32:27.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.267+0000 7f3709c00640 1 -- 172.21.15.42:0/2490969141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3704074400 msgr2=0x7f3704158c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:27.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.267+0000 7f3709c00640 1 --2- 172.21.15.42:0/2490969141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3704074400 0x7f3704158c60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f36f4006010 tx=0x7f36f40038a0 comp rx=0 tx=0).stop 2024-09-17T01:32:27.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.267+0000 7f3709c00640 1 -- 172.21.15.42:0/2490969141 shutdown_connections 2024-09-17T01:32:27.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.267+0000 7f3709c00640 1 --2- 172.21.15.42:0/2490969141 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f36e0078bf0 0x7f36e007b100 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:27.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.267+0000 7f3709c00640 1 --2- 172.21.15.42:0/2490969141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37041606b0 0x7f37040aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:27.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.267+0000 7f3709c00640 1 --2- 172.21.15.42:0/2490969141 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3704156d50 0x7f37040aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:27.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.267+0000 7f3709c00640 1 --2- 172.21.15.42:0/2490969141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3704074400 0x7f3704158c60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:27.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.267+0000 7f3709c00640 1 -- 172.21.15.42:0/2490969141 >> 172.21.15.42:0/2490969141 conn(0x7f370406d890 msgr2=0x7f370415bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:27.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.267+0000 7f3709c00640 1 -- 172.21.15.42:0/2490969141 shutdown_connections 2024-09-17T01:32:27.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:27.267+0000 7f3709c00640 1 -- 172.21.15.42:0/2490969141 wait complete. 2024-09-17T01:32:27.289 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T01:32:27.289 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:32:27.289 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2024-09-17T01:32:27.289 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T01:32:27.289 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T01:32:27.289 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T01:32:27.289 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T01:32:27.289 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:32:27.289 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T01:32:27.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:27.290 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2024-09-17T01:32:27.329 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:32:27.329 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:32:27.329 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:32:27.329 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:27.329 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-09-17T01:32:27.329 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:27.332 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:32:27.332 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2024-09-17T01:32:27.332 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f0 2024-09-17T01:32:27.332 INFO:teuthology.orchestra.run.smithi043.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:32:27.332 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2024-09-17T01:32:27.332 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f1 2024-09-17T01:32:27.332 INFO:teuthology.orchestra.run.smithi043.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:32:27.332 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:32:27.332 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f0 2024-09-17T01:32:27.333 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-17T01:32:27.333 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 42660sec preferred_lft 42660sec 2024-09-17T01:32:27.334 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link 2024-09-17T01:32:27.334 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:27.334 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:32:27.334 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:32:27.334 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f1 2024-09-17T01:32:27.335 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T01:32:27.335 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:32:27.336 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-09-17T01:32:27.336 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add name ceph-brx type bridge 2024-09-17T01:32:27.336 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr flush dev ceph-brx 2024-09-17T01:32:27.336 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set ceph-brx up 2024-09-17T01:32:27.336 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T01:32:27.336 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-09-17T01:32:27.460 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:32:27.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:27.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:27.769 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:32:27.825 INFO:teuthology.orchestra.run.smithi043.stdout:1 2024-09-17T01:32:27.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:27.828 DEBUG:teuthology.orchestra.run.smithi043:> route 2024-09-17T01:32:27.878 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2024-09-17T01:32:27.878 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:32:27.878 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-17T01:32:27.879 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-17T01:32:27.879 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:32:27.879 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:32:27.879 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-09-17T01:32:27.879 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T01:32:27.879 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T01:32:27.879 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T01:32:27.879 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-09-17T01:32:27.958 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:32:28.482 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:28.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:28.490 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-09-17T01:32:28.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:28.525 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list-id 2024-09-17T01:32:28.600 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:32:28.600 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-09-17T01:32:28.601 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T01:32:28.601 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-17T01:32:28.601 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-09-17T01:32:28.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:32:28.772 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:28.779 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-17T01:32:28.779 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:32:28.779 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-09-17T01:32:28.779 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-17T01:32:28.780 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T01:32:28.780 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-17T01:32:28.780 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-17T01:32:28.780 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-17T01:32:28.780 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-09-17T01:32:28.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:32:29.007 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:29.016 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:32:29.016 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-09-17T01:32:29.016 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.0 up 2024-09-17T01:32:29.016 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T01:32:29.016 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-09-17T01:32:29.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:32:29.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:29.185 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:32:29.185 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T01:32:29.220 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T01:32:29.221 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:32:29.221 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T01:32:29.295 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T01:32:29.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:29.295 DEBUG:teuthology.orchestra.run.smithi043:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T01:32:29.509 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T01:32:29.510 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T01:32:29.510 INFO:teuthology.orchestra.run.smithi043.stdout:invalid new device string format 2024-09-17T01:32:30.095 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T01:32:30.096 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T01:32:30.096 INFO:teuthology.orchestra.run.smithi043.stdout:invalid new device string format 2024-09-17T01:32:30.096 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:32:30.096 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:32:30.130 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T01:32:30.130 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T01:32:30.130 INFO:teuthology.orchestra.run.smithi043.stdout:invalid new device string format 2024-09-17T01:32:30.130 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:32:30.130 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:32:30.130 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-09-17T01:32:30.130 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-09-17T01:32:30.130 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=fea1c88c-cb05-432f-a745-f9dcbb5f2503" will pass to kernel 2024-09-17T01:32:30.132 INFO:teuthology.orchestra.run.smithi043.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T01:32:30.132 INFO:teuthology.orchestra.run.smithi043.stdout: You just mounted a file system that supports labels which does not 2024-09-17T01:32:30.132 INFO:teuthology.orchestra.run.smithi043.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T01:32:30.132 INFO:teuthology.orchestra.run.smithi043.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T01:32:30.132 INFO:teuthology.orchestra.run.smithi043.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T01:32:30.135 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T01:32:30.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:30.135 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T01:32:30.192 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:32:30.271 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:32:30.275 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:30.283 INFO:teuthology.orchestra.run.smithi043.stdout:client4635 2024-09-17T01:32:30.283 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:32:30.283 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:32:30.319 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:32:30.437 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:32:30.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:30.447 INFO:teuthology.orchestra.run.smithi043.stdout:client4635 2024-09-17T01:32:30.448 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:32:30.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:32:30.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:30.536 INFO:teuthology.orchestra.run.smithi043.stdout:client4635 2024-09-17T01:32:30.536 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/fea1c88c-cb05-432f-a745-f9dcbb5f2503.client4635/status') 2024-09-17T01:32:30.615 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:32:30.636 INFO:teuthology.orchestra.run.smithi043.stdout:instance: client.4635 (3)172.21.15.43:0/2584045360 2024-09-17T01:32:30.637 INFO:teuthology.orchestra.run.smithi043.stdout:blocklisted: false 2024-09-17T01:32:30.637 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records in 2024-09-17T01:32:30.637 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records out 2024-09-17T01:32:30.637 INFO:teuthology.orchestra.run.smithi043.stderr:70 bytes copied, 7.1099e-05 s, 985 kB/s 2024-09-17T01:32:30.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:30.647 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-17T01:32:30.647 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T01:32:30.648 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T01:32:30.648 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T01:32:30.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.888+0000 7f1f6ce00640 1 -- 172.21.15.42:0/2633484039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f68142f40 msgr2=0x7f1f68072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:30.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.888+0000 7f1f6ce00640 1 --2- 172.21.15.42:0/2633484039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f68142f40 0x7f1f68072950 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009830 tx=0x7f1f5002a480 comp rx=0 tx=0).stop 2024-09-17T01:32:30.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.888+0000 7f1f6ce00640 1 -- 172.21.15.42:0/2633484039 shutdown_connections 2024-09-17T01:32:30.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.888+0000 7f1f6ce00640 1 --2- 172.21.15.42:0/2633484039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f68142f40 0x7f1f68072950 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:30.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.888+0000 7f1f6ce00640 1 --2- 172.21.15.42:0/2633484039 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f680b3550 0x7f1f6815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:30.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.888+0000 7f1f6ce00640 1 -- 172.21.15.42:0/2633484039 >> 172.21.15.42:0/2633484039 conn(0x7f1f680b2930 msgr2=0x7f1f6806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:30.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.889+0000 7f1f6ce00640 1 -- 172.21.15.42:0/2633484039 shutdown_connections 2024-09-17T01:32:30.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.889+0000 7f1f6ce00640 1 -- 172.21.15.42:0/2633484039 wait complete. 2024-09-17T01:32:30.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.891+0000 7f1f6ce00640 1 Processor -- start 2024-09-17T01:32:30.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.891+0000 7f1f6ce00640 1 -- start start 2024-09-17T01:32:30.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.892+0000 7f1f6ce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f68072e90 0x7f1f6814ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:30.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.892+0000 7f1f6ce00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f680b3550 0x7f1f680ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:30.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.892+0000 7f1f6ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f68142f40 0x7f1f680aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:30.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.892+0000 7f1f6ce00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6806d7c0 con 0x7f1f68142f40 2024-09-17T01:32:30.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.892+0000 7f1f6ce00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6806d640 con 0x7f1f68072e90 2024-09-17T01:32:30.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.892+0000 7f1f6ce00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1f6806d940 con 0x7f1f680b3550 2024-09-17T01:32:30.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.893+0000 7f1f66800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f68142f40 0x7f1f680aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:30.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.893+0000 7f1f5fe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f680b3550 0x7f1f680ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:30.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.893+0000 7f1f65e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f68072e90 0x7f1f6814ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:30.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.893+0000 7f1f66800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f68142f40 0x7f1f680aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54266/0 (socket says 172.21.15.42:54266) 2024-09-17T01:32:30.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.893+0000 7f1f66800640 1 -- 172.21.15.42:0/1062650501 learned_addr learned my addr 172.21.15.42:0/1062650501 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:30.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.893+0000 7f1f66800640 1 -- 172.21.15.42:0/1062650501 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f680b3550 msgr2=0x7f1f680ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:30.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.893+0000 7f1f66800640 1 --2- 172.21.15.42:0/1062650501 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f680b3550 0x7f1f680ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:30.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.893+0000 7f1f66800640 1 -- 172.21.15.42:0/1062650501 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f68072e90 msgr2=0x7f1f6814ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:30.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.893+0000 7f1f66800640 1 --2- 172.21.15.42:0/1062650501 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f68072e90 0x7f1f6814ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:30.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.893+0000 7f1f66800640 1 -- 172.21.15.42:0/1062650501 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f680740f0 con 0x7f1f68142f40 2024-09-17T01:32:30.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.893+0000 7f1f5fe00640 1 --2- 172.21.15.42:0/1062650501 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f680b3550 0x7f1f680ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:32:30.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.893+0000 7f1f65e00640 1 --2- 172.21.15.42:0/1062650501 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f68072e90 0x7f1f6814ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:32:30.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.894+0000 7f1f66800640 1 --2- 172.21.15.42:0/1062650501 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f68142f40 0x7f1f680aede0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1f6000cb10 tx=0x7f1f6000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:30.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.894+0000 7f1f5e000640 1 -- 172.21.15.42:0/1062650501 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f60016020 con 0x7f1f68142f40 2024-09-17T01:32:30.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.894+0000 7f1f5e000640 1 -- 172.21.15.42:0/1062650501 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f6000ad80 con 0x7f1f68142f40 2024-09-17T01:32:30.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.894+0000 7f1f6ce00640 1 -- 172.21.15.42:0/1062650501 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f6806e360 con 0x7f1f68142f40 2024-09-17T01:32:30.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.894+0000 7f1f5e000640 1 -- 172.21.15.42:0/1062650501 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f60012680 con 0x7f1f68142f40 2024-09-17T01:32:30.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.894+0000 7f1f6ce00640 1 -- 172.21.15.42:0/1062650501 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f6806e600 con 0x7f1f68142f40 2024-09-17T01:32:30.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.895+0000 7f1f6ce00640 1 -- 172.21.15.42:0/1062650501 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f6815cec0 con 0x7f1f68142f40 2024-09-17T01:32:30.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.896+0000 7f1f5e000640 1 -- 172.21.15.42:0/1062650501 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1f60019020 con 0x7f1f68142f40 2024-09-17T01:32:30.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.897+0000 7f1f5e000640 1 --2- 172.21.15.42:0/1062650501 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1f44078b90 0x7f1f4407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:30.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.897+0000 7f1f5e000640 1 -- 172.21.15.42:0/1062650501 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1f6009b2f0 con 0x7f1f68142f40 2024-09-17T01:32:30.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.898+0000 7f1f65e00640 1 --2- 172.21.15.42:0/1062650501 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1f44078b90 0x7f1f4407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:30.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.898+0000 7f1f65e00640 1 --2- 172.21.15.42:0/1062650501 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1f44078b90 0x7f1f4407b0a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1f58009f20 tx=0x7f1f58005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:30.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:30.902+0000 7f1f5e000640 1 -- 172.21.15.42:0/1062650501 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1f60020020 con 0x7f1f68142f40 2024-09-17T01:32:31.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:31.138+0000 7f1f6ce00640 1 -- 172.21.15.42:0/1062650501 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1f680742f0 con 0x7f1f68142f40 2024-09-17T01:32:31.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:31.139+0000 7f1f5e000640 1 -- 172.21.15.42:0/1062650501 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f1f60063040 con 0x7f1f68142f40 2024-09-17T01:32:31.137 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T01:32:31.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:31.141+0000 7f1f6ce00640 1 -- 172.21.15.42:0/1062650501 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1f44078b90 msgr2=0x7f1f4407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:31.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:31.141+0000 7f1f6ce00640 1 --2- 172.21.15.42:0/1062650501 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1f44078b90 0x7f1f4407b0a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1f58009f20 tx=0x7f1f58005f90 comp rx=0 tx=0).stop 2024-09-17T01:32:31.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:31.141+0000 7f1f6ce00640 1 -- 172.21.15.42:0/1062650501 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f68142f40 msgr2=0x7f1f680aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:31.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:31.141+0000 7f1f6ce00640 1 --2- 172.21.15.42:0/1062650501 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f68142f40 0x7f1f680aede0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1f6000cb10 tx=0x7f1f6000a060 comp rx=0 tx=0).stop 2024-09-17T01:32:31.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:31.141+0000 7f1f6ce00640 1 -- 172.21.15.42:0/1062650501 shutdown_connections 2024-09-17T01:32:31.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:31.141+0000 7f1f6ce00640 1 --2- 172.21.15.42:0/1062650501 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1f44078b90 0x7f1f4407b0a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:31.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:31.141+0000 7f1f6ce00640 1 --2- 172.21.15.42:0/1062650501 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f68142f40 0x7f1f680aede0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:31.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:31.141+0000 7f1f6ce00640 1 --2- 172.21.15.42:0/1062650501 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f680b3550 0x7f1f680ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:31.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:31.141+0000 7f1f6ce00640 1 --2- 172.21.15.42:0/1062650501 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f68072e90 0x7f1f6814ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:31.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:31.141+0000 7f1f6ce00640 1 -- 172.21.15.42:0/1062650501 >> 172.21.15.42:0/1062650501 conn(0x7f1f680b2930 msgr2=0x7f1f6815b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:31.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:31.141+0000 7f1f6ce00640 1 -- 172.21.15.42:0/1062650501 shutdown_connections 2024-09-17T01:32:31.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:31.141+0000 7f1f6ce00640 1 -- 172.21.15.42:0/1062650501 wait complete. 2024-09-17T01:32:31.164 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T01:32:31.164 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:32:31.165 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2024-09-17T01:32:31.165 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-17T01:32:31.165 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T01:32:31.165 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T01:32:31.165 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T01:32:31.165 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:32:31.165 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-17T01:32:31.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:31.165 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2024-09-17T01:32:31.203 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:32:31.203 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:32:31.203 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:32:31.203 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:31.203 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-09-17T01:32:31.203 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:31.203 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:32:31.203 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2024-09-17T01:32:31.203 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f0 2024-09-17T01:32:31.204 INFO:teuthology.orchestra.run.smithi043.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:32:31.204 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2024-09-17T01:32:31.204 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f1 2024-09-17T01:32:31.204 INFO:teuthology.orchestra.run.smithi043.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:32:31.204 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:32:31.204 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f0 2024-09-17T01:32:31.204 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-17T01:32:31.204 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 42656sec preferred_lft 42656sec 2024-09-17T01:32:31.204 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link 2024-09-17T01:32:31.204 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:31.204 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:32:31.204 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:32:31.205 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f1 2024-09-17T01:32:31.205 INFO:teuthology.orchestra.run.smithi043.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T01:32:31.205 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 9e:d9:08:f7:55:98 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:32:31.205 INFO:teuthology.orchestra.run.smithi043.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T01:32:31.205 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:31.205 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::50b6:82ff:fe21:d8b8/64 scope link 2024-09-17T01:32:31.205 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:31.205 INFO:teuthology.orchestra.run.smithi043.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:32:31.205 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 9e:d9:08:f7:55:98 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T01:32:31.205 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::9cd9:8ff:fef7:5598/64 scope link 2024-09-17T01:32:31.205 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:31.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:31.206 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:32:31.298 INFO:teuthology.orchestra.run.smithi043.stdout:1 2024-09-17T01:32:31.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:31.301 DEBUG:teuthology.orchestra.run.smithi043:> route 2024-09-17T01:32:31.338 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2024-09-17T01:32:31.338 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:32:31.338 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-17T01:32:31.338 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-17T01:32:31.339 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:32:31.339 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:32:31.339 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-09-17T01:32:31.339 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T01:32:31.339 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T01:32:31.339 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T01:32:31.339 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-09-17T01:32:31.457 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:32:31.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:31.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:31.536 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-09-17T01:32:31.572 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T01:32:31.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:31.573 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list-id 2024-09-17T01:32:31.647 INFO:teuthology.orchestra.run.smithi043.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-17T01:32:31.648 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:32:31.648 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-09-17T01:32:31.648 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T01:32:31.648 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-17T01:32:31.648 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-09-17T01:32:31.766 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:32:31.817 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:31.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:31.825 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T01:32:31.881 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:32:31.881 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:32:31.881 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:32:31.881 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:31.882 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-09-17T01:32:31.882 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:31.882 INFO:teuthology.orchestra.run.smithi043.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T01:32:31.882 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 2e:20:aa:0e:ca:5e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T01:32:31.882 INFO:teuthology.orchestra.run.smithi043.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T01:32:31.882 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:31.882 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::2c20:aaff:fe0e:ca5e/64 scope link 2024-09-17T01:32:31.882 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:31.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:31.883 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T01:32:31.939 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:32:31.939 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:32:31.939 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:32:31.939 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:31.939 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2024-09-17T01:32:31.939 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:31.939 INFO:teuthology.orchestra.run.smithi043.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T01:32:31.939 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 2e:20:aa:0e:ca:5e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T01:32:31.939 INFO:teuthology.orchestra.run.smithi043.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T01:32:31.939 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:31.940 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::2c20:aaff:fe0e:ca5e/64 scope link 2024-09-17T01:32:31.940 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:32:31.941 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-17T01:32:31.942 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:32:31.942 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-09-17T01:32:31.942 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-17T01:32:31.942 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T01:32:31.942 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-17T01:32:31.942 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-17T01:32:31.942 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-17T01:32:31.942 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-09-17T01:32:32.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:32:32.151 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:32.160 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:32:32.160 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2024-09-17T01:32:32.160 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.1 up 2024-09-17T01:32:32.160 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T01:32:32.160 DEBUG:teuthology.orchestra.run.smithi043:> ') 2024-09-17T01:32:32.238 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:32:32.318 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:32.326 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:32:32.326 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-17T01:32:32.362 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-17T01:32:32.362 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:32:32.362 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-17T01:32:32.437 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T01:32:32.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:32.438 DEBUG:teuthology.orchestra.run.smithi043:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T01:32:32.634 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T01:32:32.634 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T01:32:32.634 INFO:teuthology.orchestra.run.smithi043.stdout:invalid new device string format 2024-09-17T01:32:32.654 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T01:32:32.654 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T01:32:32.654 INFO:teuthology.orchestra.run.smithi043.stdout:invalid new device string format 2024-09-17T01:32:32.654 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:32:32.655 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:32:32.682 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T01:32:32.683 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T01:32:32.683 INFO:teuthology.orchestra.run.smithi043.stdout:invalid new device string format 2024-09-17T01:32:32.683 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:32:32.683 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:32:32.683 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-09-17T01:32:32.683 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-09-17T01:32:32.683 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=fea1c88c-cb05-432f-a745-f9dcbb5f2503" will pass to kernel 2024-09-17T01:32:32.684 INFO:teuthology.orchestra.run.smithi043.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-17T01:32:32.684 INFO:teuthology.orchestra.run.smithi043.stdout: You just mounted a file system that supports labels which does not 2024-09-17T01:32:32.684 INFO:teuthology.orchestra.run.smithi043.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T01:32:32.684 INFO:teuthology.orchestra.run.smithi043.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T01:32:32.684 INFO:teuthology.orchestra.run.smithi043.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T01:32:32.687 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T01:32:32.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:32.687 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-17T01:32:32.743 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:32:32.823 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:32:32.825 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:32.833 INFO:teuthology.orchestra.run.smithi043.stdout:client4644 2024-09-17T01:32:32.833 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:32:32.834 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:32:32.869 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:32:32.989 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:32:32.992 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:33.000 INFO:teuthology.orchestra.run.smithi043.stdout:client4644 2024-09-17T01:32:33.000 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:32:33.080 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:32:33.083 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:33.091 INFO:teuthology.orchestra.run.smithi043.stdout:client4644 2024-09-17T01:32:33.091 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/fea1c88c-cb05-432f-a745-f9dcbb5f2503.client4644/status') 2024-09-17T01:32:33.170 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:32:33.191 INFO:teuthology.orchestra.run.smithi043.stdout:instance: client.4644 (3)172.21.15.43:0/736845163 2024-09-17T01:32:33.191 INFO:teuthology.orchestra.run.smithi043.stdout:blocklisted: false 2024-09-17T01:32:33.191 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records in 2024-09-17T01:32:33.191 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records out 2024-09-17T01:32:33.192 INFO:teuthology.orchestra.run.smithi043.stderr:69 bytes copied, 5.8119e-05 s, 1.2 MB/s 2024-09-17T01:32:33.193 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-17T01:32:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:32:33.202 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-17T01:32:33.239 INFO:tasks.cephfs_test_runner:Starting test: test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) test flag scrub_mdsdir 2024-09-17T01:32:33.239 INFO:tasks.cephfs_test_runner:test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-17T01:32:33.239 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:32:33.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.480+0000 7fa062a00640 1 -- 172.21.15.42:0/3966806351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa05c142f40 msgr2=0x7fa05c072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:33.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.480+0000 7fa062a00640 1 --2- 172.21.15.42:0/3966806351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa05c142f40 0x7fa05c072950 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa044009830 tx=0x7fa04402a480 comp rx=0 tx=0).stop 2024-09-17T01:32:33.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.480+0000 7fa062a00640 1 -- 172.21.15.42:0/3966806351 shutdown_connections 2024-09-17T01:32:33.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.480+0000 7fa062a00640 1 --2- 172.21.15.42:0/3966806351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa05c142f40 0x7fa05c072950 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:33.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.480+0000 7fa062a00640 1 --2- 172.21.15.42:0/3966806351 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa05c0b3550 0x7fa05c15cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:33.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.480+0000 7fa062a00640 1 -- 172.21.15.42:0/3966806351 >> 172.21.15.42:0/3966806351 conn(0x7fa05c0b2930 msgr2=0x7fa05c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:33.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.480+0000 7fa062a00640 1 -- 172.21.15.42:0/3966806351 shutdown_connections 2024-09-17T01:32:33.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.480+0000 7fa062a00640 1 -- 172.21.15.42:0/3966806351 wait complete. 2024-09-17T01:32:33.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.483+0000 7fa062a00640 1 Processor -- start 2024-09-17T01:32:33.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.483+0000 7fa062a00640 1 -- start start 2024-09-17T01:32:33.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.484+0000 7fa062a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa05c072e90 0x7fa05c137b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:33.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.484+0000 7fa062a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa05c0b3550 0x7fa05c0ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:33.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.484+0000 7fa062a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa05c142f40 0x7fa05c0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:33.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.484+0000 7fa062a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c06d7c0 con 0x7fa05c142f40 2024-09-17T01:32:33.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.484+0000 7fa062a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c06d640 con 0x7fa05c072e90 2024-09-17T01:32:33.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.484+0000 7fa062a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa05c06d940 con 0x7fa05c0b3550 2024-09-17T01:32:33.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.485+0000 7fa060a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa05c142f40 0x7fa05c0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:33.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.485+0000 7fa05be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa05c072e90 0x7fa05c137b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:33.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.485+0000 7fa05be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa05c072e90 0x7fa05c137b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:43544/0 (socket says 172.21.15.42:43544) 2024-09-17T01:32:33.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.485+0000 7fa05be00640 1 -- 172.21.15.42:0/3577370822 learned_addr learned my addr 172.21.15.42:0/3577370822 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:33.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.485+0000 7fa053e00640 1 --2- 172.21.15.42:0/3577370822 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa05c0b3550 0x7fa05c0ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:33.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.485+0000 7fa05be00640 1 -- 172.21.15.42:0/3577370822 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa05c0b3550 msgr2=0x7fa05c0ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:33.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.485+0000 7fa05be00640 1 --2- 172.21.15.42:0/3577370822 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa05c0b3550 0x7fa05c0ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:33.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.485+0000 7fa05be00640 1 -- 172.21.15.42:0/3577370822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa05c142f40 msgr2=0x7fa05c0aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:33.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.485+0000 7fa05be00640 1 --2- 172.21.15.42:0/3577370822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa05c142f40 0x7fa05c0aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:33.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.485+0000 7fa05be00640 1 -- 172.21.15.42:0/3577370822 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa05c06e260 con 0x7fa05c072e90 2024-09-17T01:32:33.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.485+0000 7fa060a00640 1 --2- 172.21.15.42:0/3577370822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa05c142f40 0x7fa05c0aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:32:33.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.485+0000 7fa05be00640 1 --2- 172.21.15.42:0/3577370822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa05c072e90 0x7fa05c137b50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00e9c0 tx=0x7fa04c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:33.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.486+0000 7fa058c00640 1 -- 172.21.15.42:0/3577370822 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c00cd80 con 0x7fa05c072e90 2024-09-17T01:32:33.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.486+0000 7fa058c00640 1 -- 172.21.15.42:0/3577370822 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa04c004020 con 0x7fa05c072e90 2024-09-17T01:32:33.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.486+0000 7fa058c00640 1 -- 172.21.15.42:0/3577370822 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c004450 con 0x7fa05c072e90 2024-09-17T01:32:33.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.486+0000 7fa062a00640 1 -- 172.21.15.42:0/3577370822 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa05c06fbf0 con 0x7fa05c072e90 2024-09-17T01:32:33.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.486+0000 7fa062a00640 1 -- 172.21.15.42:0/3577370822 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa05c06e7b0 con 0x7fa05c072e90 2024-09-17T01:32:33.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.487+0000 7fa062a00640 1 -- 172.21.15.42:0/3577370822 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa05c0b59d0 con 0x7fa05c072e90 2024-09-17T01:32:33.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.488+0000 7fa058c00640 1 -- 172.21.15.42:0/3577370822 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa04c005030 con 0x7fa05c072e90 2024-09-17T01:32:33.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.489+0000 7fa058c00640 1 --2- 172.21.15.42:0/3577370822 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa038078b90 0x7fa03807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:33.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.489+0000 7fa058c00640 1 -- 172.21.15.42:0/3577370822 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa04c09ba30 con 0x7fa05c072e90 2024-09-17T01:32:33.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.490+0000 7fa053e00640 1 --2- 172.21.15.42:0/3577370822 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa038078b90 0x7fa03807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:33.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.490+0000 7fa053e00640 1 --2- 172.21.15.42:0/3577370822 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa038078b90 0x7fa03807b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa044034000 tx=0x7fa044004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:33.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.493+0000 7fa058c00640 1 -- 172.21.15.42:0/3577370822 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa05c0b59d0 con 0x7fa05c072e90 2024-09-17T01:32:33.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.687+0000 7fa062a00640 1 -- 172.21.15.42:0/3577370822 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa05c15cec0 con 0x7fa05c072e90 2024-09-17T01:32:33.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.688+0000 7fa058c00640 1 -- 172.21.15.42:0/3577370822 <== mon.1 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16621 (secure 0 0 0) 0x7fa04c063800 con 0x7fa05c072e90 2024-09-17T01:32:33.686 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:33.686 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":22,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:32:08.067689+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:32:04.526150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T01:32:05.523607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:32:33.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.691+0000 7fa062a00640 1 -- 172.21.15.42:0/3577370822 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa038078b90 msgr2=0x7fa03807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:33.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.691+0000 7fa062a00640 1 --2- 172.21.15.42:0/3577370822 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa038078b90 0x7fa03807b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa044034000 tx=0x7fa044004730 comp rx=0 tx=0).stop 2024-09-17T01:32:33.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.691+0000 7fa062a00640 1 -- 172.21.15.42:0/3577370822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa05c072e90 msgr2=0x7fa05c137b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:33.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.691+0000 7fa062a00640 1 --2- 172.21.15.42:0/3577370822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa05c072e90 0x7fa05c137b50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00e9c0 tx=0x7fa04c00ee80 comp rx=0 tx=0).stop 2024-09-17T01:32:33.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.691+0000 7fa062a00640 1 -- 172.21.15.42:0/3577370822 shutdown_connections 2024-09-17T01:32:33.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.691+0000 7fa062a00640 1 --2- 172.21.15.42:0/3577370822 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa038078b90 0x7fa03807b0a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:33.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.691+0000 7fa062a00640 1 --2- 172.21.15.42:0/3577370822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa05c142f40 0x7fa05c0aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:33.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.691+0000 7fa062a00640 1 --2- 172.21.15.42:0/3577370822 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa05c0b3550 0x7fa05c0ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:33.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.691+0000 7fa062a00640 1 --2- 172.21.15.42:0/3577370822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa05c072e90 0x7fa05c137b50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:33.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.691+0000 7fa062a00640 1 -- 172.21.15.42:0/3577370822 >> 172.21.15.42:0/3577370822 conn(0x7fa05c0b2930 msgr2=0x7fa05c15f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:33.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.691+0000 7fa062a00640 1 -- 172.21.15.42:0/3577370822 shutdown_connections 2024-09-17T01:32:33.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.691+0000 7fa062a00640 1 -- 172.21.15.42:0/3577370822 wait complete. 2024-09-17T01:32:33.711 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T01:31:55.004951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T01:32:04.526150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T01:32:05.523607+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T01:32:33.712 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T01:32:33.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.946+0000 7f9354c00640 1 -- 172.21.15.42:0/2270850568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9334004800 msgr2=0x7f9334004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:33.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.946+0000 7f9354c00640 1 --2- 172.21.15.42:0/2270850568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9334004800 0x7f9334004c10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f93380016c0 tx=0x7f9334005830 comp rx=0 tx=0).stop 2024-09-17T01:32:33.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.946+0000 7f9354c00640 1 -- 172.21.15.42:0/2270850568 shutdown_connections 2024-09-17T01:32:33.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.946+0000 7f9354c00640 1 --2- 172.21.15.42:0/2270850568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9334004800 0x7f9334004c10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:33.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.946+0000 7f9354c00640 1 -- 172.21.15.42:0/2270850568 >> 172.21.15.42:0/2270850568 conn(0x7f93500b27a0 msgr2=0x7f93500d0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:33.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.946+0000 7f9354c00640 1 -- 172.21.15.42:0/2270850568 shutdown_connections 2024-09-17T01:32:33.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.946+0000 7f9354c00640 1 -- 172.21.15.42:0/2270850568 wait complete. 2024-09-17T01:32:33.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.949+0000 7f9354c00640 1 Processor -- start 2024-09-17T01:32:33.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.949+0000 7f9354c00640 1 -- start start 2024-09-17T01:32:33.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.950+0000 7f9354c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9334004800 0x7f935014b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:33.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.950+0000 7f9354c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9350152540 0x7f93500c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:33.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.950+0000 7f9354c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93500ca510 0x7f935006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:33.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.950+0000 7f9354c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9350074970 con 0x7f9350152540 2024-09-17T01:32:33.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.950+0000 7f9354c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f93500747f0 con 0x7f93500ca510 2024-09-17T01:32:33.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.950+0000 7f9354c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f935015de20 con 0x7f9334004800 2024-09-17T01:32:33.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.951+0000 7f9347e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9350152540 0x7f93500c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:33.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.951+0000 7f9347e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9350152540 0x7f93500c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54290/0 (socket says 172.21.15.42:54290) 2024-09-17T01:32:33.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.951+0000 7f9347e00640 1 -- 172.21.15.42:0/3391313845 learned_addr learned my addr 172.21.15.42:0/3391313845 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:33.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.951+0000 7f934f400640 1 --2- 172.21.15.42:0/3391313845 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9334004800 0x7f935014b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:33.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.951+0000 7f934fe00640 1 --2- 172.21.15.42:0/3391313845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93500ca510 0x7f935006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:33.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.951+0000 7f9347e00640 1 -- 172.21.15.42:0/3391313845 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9334004800 msgr2=0x7f935014b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:33.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.951+0000 7f9347e00640 1 --2- 172.21.15.42:0/3391313845 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9334004800 0x7f935014b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:33.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.951+0000 7f9347e00640 1 -- 172.21.15.42:0/3391313845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93500ca510 msgr2=0x7f935006e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:33.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.951+0000 7f9347e00640 1 --2- 172.21.15.42:0/3391313845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93500ca510 0x7f935006e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:33.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.951+0000 7f9347e00640 1 -- 172.21.15.42:0/3391313845 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93500cc410 con 0x7f9350152540 2024-09-17T01:32:33.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.951+0000 7f9347e00640 1 --2- 172.21.15.42:0/3391313845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9350152540 0x7f93500c9fd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f93380017e0 tx=0x7f93380063a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:33.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.952+0000 7f9347400640 1 -- 172.21.15.42:0/3391313845 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9338042070 con 0x7f9350152540 2024-09-17T01:32:33.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.952+0000 7f9347400640 1 -- 172.21.15.42:0/3391313845 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9338039070 con 0x7f9350152540 2024-09-17T01:32:33.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.952+0000 7f9347400640 1 -- 172.21.15.42:0/3391313845 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9338003d70 con 0x7f9350152540 2024-09-17T01:32:33.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.952+0000 7f9354c00640 1 -- 172.21.15.42:0/3391313845 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93501f8a00 con 0x7f9350152540 2024-09-17T01:32:33.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.952+0000 7f9354c00640 1 -- 172.21.15.42:0/3391313845 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93501f8fc0 con 0x7f9350152540 2024-09-17T01:32:33.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.953+0000 7f9354c00640 1 -- 172.21.15.42:0/3391313845 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93501604d0 con 0x7f9350152540 2024-09-17T01:32:33.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.954+0000 7f9347400640 1 -- 172.21.15.42:0/3391313845 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f933803b070 con 0x7f9350152540 2024-09-17T01:32:33.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.955+0000 7f9347400640 1 --2- 172.21.15.42:0/3391313845 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f932c078b90 0x7f932c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:33.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.955+0000 7f9347400640 1 -- 172.21.15.42:0/3391313845 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f93380ba400 con 0x7f9350152540 2024-09-17T01:32:33.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.955+0000 7f934f400640 1 --2- 172.21.15.42:0/3391313845 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f932c078b90 0x7f932c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:33.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.956+0000 7f934f400640 1 --2- 172.21.15.42:0/3391313845 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f932c078b90 0x7f932c07b0a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9350077840 tx=0x7f9340005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:33.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:33.959+0000 7f9347400640 1 -- 172.21.15.42:0/3391313845 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f93380827a0 con 0x7f9350152540 2024-09-17T01:32:34.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.153+0000 7f9354c00640 1 -- 172.21.15.42:0/3391313845 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f935015e0d0 con 0x7f9350152540 2024-09-17T01:32:34.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.153+0000 7f9347400640 1 -- 172.21.15.42:0/3391313845 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f93380820a0 con 0x7f9350152540 2024-09-17T01:32:34.152 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-09-17T01:32:34.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.156+0000 7f9354c00640 1 -- 172.21.15.42:0/3391313845 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f932c078b90 msgr2=0x7f932c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:34.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.156+0000 7f9354c00640 1 --2- 172.21.15.42:0/3391313845 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f932c078b90 0x7f932c07b0a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9350077840 tx=0x7f9340005f90 comp rx=0 tx=0).stop 2024-09-17T01:32:34.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.156+0000 7f9354c00640 1 -- 172.21.15.42:0/3391313845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9350152540 msgr2=0x7f93500c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:34.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.156+0000 7f9354c00640 1 --2- 172.21.15.42:0/3391313845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9350152540 0x7f93500c9fd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f93380017e0 tx=0x7f93380063a0 comp rx=0 tx=0).stop 2024-09-17T01:32:34.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.156+0000 7f9354c00640 1 -- 172.21.15.42:0/3391313845 shutdown_connections 2024-09-17T01:32:34.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.156+0000 7f9354c00640 1 --2- 172.21.15.42:0/3391313845 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f932c078b90 0x7f932c07b0a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:34.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.156+0000 7f9354c00640 1 --2- 172.21.15.42:0/3391313845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93500ca510 0x7f935006e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:34.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.156+0000 7f9354c00640 1 --2- 172.21.15.42:0/3391313845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9350152540 0x7f93500c9fd0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:34.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.156+0000 7f9354c00640 1 --2- 172.21.15.42:0/3391313845 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9334004800 0x7f935014b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:34.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.156+0000 7f9354c00640 1 -- 172.21.15.42:0/3391313845 >> 172.21.15.42:0/3391313845 conn(0x7f93500b27a0 msgr2=0x7f935015bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:34.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.156+0000 7f9354c00640 1 -- 172.21.15.42:0/3391313845 shutdown_connections 2024-09-17T01:32:34.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.156+0000 7f9354c00640 1 -- 172.21.15.42:0/3391313845 wait complete. 2024-09-17T01:32:34.180 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-17T01:32:34.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.415+0000 7f9ea0e00640 1 -- 172.21.15.42:0/767206629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e80003f90 msgr2=0x7f9e80004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:34.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.415+0000 7f9ea0e00640 1 --2- 172.21.15.42:0/767206629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e80003f90 0x7f9e80004800 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800c290 tx=0x7f9e80005830 comp rx=0 tx=0).stop 2024-09-17T01:32:34.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.415+0000 7f9e9a800640 1 -- 172.21.15.42:0/767206629 reap_dead start 2024-09-17T01:32:34.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.415+0000 7f9ea0e00640 1 -- 172.21.15.42:0/767206629 shutdown_connections 2024-09-17T01:32:34.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.415+0000 7f9ea0e00640 1 -- 172.21.15.42:0/767206629 >> 172.21.15.42:0/767206629 conn(0x7f9e9c0b2930 msgr2=0x7f9e9c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:34.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.415+0000 7f9ea0e00640 1 -- 172.21.15.42:0/767206629 shutdown_connections 2024-09-17T01:32:34.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.415+0000 7f9ea0e00640 1 -- 172.21.15.42:0/767206629 wait complete. 2024-09-17T01:32:34.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.417+0000 7f9ea0e00640 1 Processor -- start 2024-09-17T01:32:34.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.417+0000 7f9ea0e00640 1 -- start start 2024-09-17T01:32:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.419+0000 7f9ea0e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e80003f90 0x7f9e9c149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.419+0000 7f9ea0e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e9c0cba90 0x7f9e9c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.419+0000 7f9ea0e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e9c147fc0 0x7f9e9c1483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.419+0000 7f9ea0e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c15f6d0 con 0x7f9e9c0cba90 2024-09-17T01:32:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.419+0000 7f9ea0e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c15f550 con 0x7f9e80003f90 2024-09-17T01:32:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.419+0000 7f9ea0e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9e9c15f850 con 0x7f9e9c147fc0 2024-09-17T01:32:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.419+0000 7f9e99400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e9c0cba90 0x7f9e9c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.419+0000 7f9e99400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e9c0cba90 0x7f9e9c0cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54300/0 (socket says 172.21.15.42:54300) 2024-09-17T01:32:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.419+0000 7f9e99400640 1 -- 172.21.15.42:0/2733405524 learned_addr learned my addr 172.21.15.42:0/2733405524 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.419+0000 7f9e99e00640 1 --2- 172.21.15.42:0/2733405524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e80003f90 0x7f9e9c149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:34.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.419+0000 7f9e9a800640 1 --2- 172.21.15.42:0/2733405524 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e9c147fc0 0x7f9e9c1483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.419+0000 7f9e99400640 1 -- 172.21.15.42:0/2733405524 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e9c147fc0 msgr2=0x7f9e9c1483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.419+0000 7f9e99400640 1 --2- 172.21.15.42:0/2733405524 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e9c147fc0 0x7f9e9c1483d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.419+0000 7f9e99400640 1 -- 172.21.15.42:0/2733405524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e80003f90 msgr2=0x7f9e9c149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.419+0000 7f9e99400640 1 --2- 172.21.15.42:0/2733405524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e80003f90 0x7f9e9c149770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.419+0000 7f9e99400640 1 -- 172.21.15.42:0/2733405524 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9c146f20 con 0x7f9e9c0cba90 2024-09-17T01:32:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.419+0000 7f9e9a800640 1 --2- 172.21.15.42:0/2733405524 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e9c147fc0 0x7f9e9c1483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.420+0000 7f9e99400640 1 --2- 172.21.15.42:0/2733405524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e9c0cba90 0x7f9e9c0cbea0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800c3b0 tx=0x7f9e88001000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.420+0000 7f9e92000640 1 -- 172.21.15.42:0/2733405524 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e88031040 con 0x7f9e9c0cba90 2024-09-17T01:32:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.420+0000 7f9e92000640 1 -- 172.21.15.42:0/2733405524 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e880035f0 con 0x7f9e9c0cba90 2024-09-17T01:32:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.420+0000 7f9e92000640 1 -- 172.21.15.42:0/2733405524 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e88003a20 con 0x7f9e9c0cba90 2024-09-17T01:32:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.420+0000 7f9ea0e00640 1 -- 172.21.15.42:0/2733405524 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e9c147200 con 0x7f9e9c0cba90 2024-09-17T01:32:34.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.420+0000 7f9ea0e00640 1 -- 172.21.15.42:0/2733405524 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e9c1477c0 con 0x7f9e9c0cba90 2024-09-17T01:32:34.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.421+0000 7f9ea0e00640 1 -- 172.21.15.42:0/2733405524 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e9c0cd660 con 0x7f9e9c0cba90 2024-09-17T01:32:34.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.423+0000 7f9e92000640 1 -- 172.21.15.42:0/2733405524 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9e88034070 con 0x7f9e9c0cba90 2024-09-17T01:32:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.424+0000 7f9e92000640 1 --2- 172.21.15.42:0/2733405524 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e7c078b90 0x7f9e7c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.424+0000 7f9e92000640 1 -- 172.21.15.42:0/2733405524 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9e880ba650 con 0x7f9e9c0cba90 2024-09-17T01:32:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.424+0000 7f9e99e00640 1 --2- 172.21.15.42:0/2733405524 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e7c078b90 0x7f9e7c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:34.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.425+0000 7f9e99e00640 1 --2- 172.21.15.42:0/2733405524 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e7c078b90 0x7f9e7c07b0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c009c50 tx=0x7f9e8c005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:34.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.428+0000 7f9e92000640 1 -- 172.21.15.42:0/2733405524 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9e9c0cd660 con 0x7f9e9c0cba90 2024-09-17T01:32:34.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.620+0000 7f9ea0e00640 1 -- 172.21.15.42:0/2733405524 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9e9c06d610 con 0x7f9e9c0cba90 2024-09-17T01:32:34.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.621+0000 7f9e92000640 1 -- 172.21.15.42:0/2733405524 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f9e88047070 con 0x7f9e9c0cba90 2024-09-17T01:32:34.619 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2024-09-17T01:32:34.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.623+0000 7f9ea0e00640 1 -- 172.21.15.42:0/2733405524 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e7c078b90 msgr2=0x7f9e7c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:34.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.623+0000 7f9ea0e00640 1 --2- 172.21.15.42:0/2733405524 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e7c078b90 0x7f9e7c07b0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c009c50 tx=0x7f9e8c005f90 comp rx=0 tx=0).stop 2024-09-17T01:32:34.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.623+0000 7f9ea0e00640 1 -- 172.21.15.42:0/2733405524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e9c0cba90 msgr2=0x7f9e9c0cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:34.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.623+0000 7f9ea0e00640 1 --2- 172.21.15.42:0/2733405524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e9c0cba90 0x7f9e9c0cbea0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800c3b0 tx=0x7f9e88001000 comp rx=0 tx=0).stop 2024-09-17T01:32:34.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.623+0000 7f9ea0e00640 1 -- 172.21.15.42:0/2733405524 shutdown_connections 2024-09-17T01:32:34.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.623+0000 7f9ea0e00640 1 --2- 172.21.15.42:0/2733405524 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e7c078b90 0x7f9e7c07b0a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:34.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.623+0000 7f9ea0e00640 1 --2- 172.21.15.42:0/2733405524 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e9c147fc0 0x7f9e9c1483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:34.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.623+0000 7f9ea0e00640 1 --2- 172.21.15.42:0/2733405524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e9c0cba90 0x7f9e9c0cbea0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:34.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.623+0000 7f9ea0e00640 1 --2- 172.21.15.42:0/2733405524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e80003f90 0x7f9e9c149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:34.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.623+0000 7f9ea0e00640 1 -- 172.21.15.42:0/2733405524 >> 172.21.15.42:0/2733405524 conn(0x7f9e9c0b2930 msgr2=0x7f9e9c159030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:34.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.623+0000 7f9ea0e00640 1 -- 172.21.15.42:0/2733405524 shutdown_connections 2024-09-17T01:32:34.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.623+0000 7f9ea0e00640 1 -- 172.21.15.42:0/2733405524 wait complete. 2024-09-17T01:32:34.643 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-17T01:32:34.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.877+0000 7f284e600640 1 -- 172.21.15.42:0/2369878625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28480b06d0 msgr2=0x7f284815bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:34.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.877+0000 7f284e600640 1 --2- 172.21.15.42:0/2369878625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28480b06d0 0x7f284815bba0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2848075780 tx=0x7f283402a5d0 comp rx=0 tx=0).stop 2024-09-17T01:32:34.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.877+0000 7f284e600640 1 -- 172.21.15.42:0/2369878625 shutdown_connections 2024-09-17T01:32:34.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.877+0000 7f284e600640 1 --2- 172.21.15.42:0/2369878625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28480b06d0 0x7f284815bba0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:34.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.877+0000 7f284e600640 1 --2- 172.21.15.42:0/2369878625 >> v2:172.21.15.43:3300/0 conn(0x7f284806e240 0x7f284815fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:34.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.877+0000 7f284e600640 1 -- 172.21.15.42:0/2369878625 >> 172.21.15.42:0/2369878625 conn(0x7f28480734a0 msgr2=0x7f28480b61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:34.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.877+0000 7f284e600640 1 -- 172.21.15.42:0/2369878625 shutdown_connections 2024-09-17T01:32:34.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.877+0000 7f284e600640 1 -- 172.21.15.42:0/2369878625 wait complete. 2024-09-17T01:32:34.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.879+0000 7f284e600640 1 Processor -- start 2024-09-17T01:32:34.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.880+0000 7f284e600640 1 -- start start 2024-09-17T01:32:34.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.881+0000 7f284e600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f284806cd20 0x7f28480af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:34.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.881+0000 7f284e600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f284806e240 0x7f28480cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:34.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.881+0000 7f284e600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28480b06d0 0x7f28480cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:34.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.881+0000 7f284e600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f284815d080 con 0x7f284806e240 2024-09-17T01:32:34.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.881+0000 7f284e600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f284815cf00 con 0x7f28480b06d0 2024-09-17T01:32:34.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.881+0000 7f284e600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f284815d200 con 0x7f284806cd20 2024-09-17T01:32:34.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.881+0000 7f2847e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f284806e240 0x7f28480cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:34.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.881+0000 7f2847e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f284806e240 0x7f28480cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54316/0 (socket says 172.21.15.42:54316) 2024-09-17T01:32:34.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.881+0000 7f2847e00640 1 -- 172.21.15.42:0/3590952361 learned_addr learned my addr 172.21.15.42:0/3590952361 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:34.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.882+0000 7f284d200640 1 --2- 172.21.15.42:0/3590952361 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f284806cd20 0x7f28480af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:34.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.882+0000 7f284dc00640 1 --2- 172.21.15.42:0/3590952361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28480b06d0 0x7f28480cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:34.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.882+0000 7f2847e00640 1 -- 172.21.15.42:0/3590952361 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f284806cd20 msgr2=0x7f28480af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:34.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.882+0000 7f2847e00640 1 --2- 172.21.15.42:0/3590952361 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f284806cd20 0x7f28480af3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:34.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.882+0000 7f2847e00640 1 -- 172.21.15.42:0/3590952361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28480b06d0 msgr2=0x7f28480cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:34.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.882+0000 7f2847e00640 1 --2- 172.21.15.42:0/3590952361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28480b06d0 0x7f28480cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:34.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.882+0000 7f2847e00640 1 -- 172.21.15.42:0/3590952361 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28481f5780 con 0x7f284806e240 2024-09-17T01:32:34.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.882+0000 7f284dc00640 1 --2- 172.21.15.42:0/3590952361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28480b06d0 0x7f28480cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:34.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.882+0000 7f2847e00640 1 --2- 172.21.15.42:0/3590952361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f284806e240 0x7f28480cbe70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f283402abc0 tx=0x7f2834031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:34.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.883+0000 7f2844c00640 1 -- 172.21.15.42:0/3590952361 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2834033e00 con 0x7f284806e240 2024-09-17T01:32:34.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.883+0000 7f2844c00640 1 -- 172.21.15.42:0/3590952361 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2834031a40 con 0x7f284806e240 2024-09-17T01:32:34.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.883+0000 7f2844c00640 1 -- 172.21.15.42:0/3590952361 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2834005020 con 0x7f284806e240 2024-09-17T01:32:34.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.883+0000 7f284e600640 1 -- 172.21.15.42:0/3590952361 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28481f5a60 con 0x7f284806e240 2024-09-17T01:32:34.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.883+0000 7f284e600640 1 -- 172.21.15.42:0/3590952361 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28481f6020 con 0x7f284806e240 2024-09-17T01:32:34.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.884+0000 7f284e600640 1 -- 172.21.15.42:0/3590952361 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f284815d6b0 con 0x7f284806e240 2024-09-17T01:32:34.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.885+0000 7f2844c00640 1 -- 172.21.15.42:0/3590952361 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f28340051c0 con 0x7f284806e240 2024-09-17T01:32:34.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.886+0000 7f2844c00640 1 --2- 172.21.15.42:0/3590952361 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2828078b90 0x7f282807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:34.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.886+0000 7f2844c00640 1 -- 172.21.15.42:0/3590952361 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f28340bbc00 con 0x7f284806e240 2024-09-17T01:32:34.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.887+0000 7f284d200640 1 --2- 172.21.15.42:0/3590952361 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2828078b90 0x7f282807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:34.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.887+0000 7f284d200640 1 --2- 172.21.15.42:0/3590952361 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2828078b90 0x7f282807b0a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f283c009b30 tx=0x7f283c005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:34.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:34.891+0000 7f2844c00640 1 -- 172.21.15.42:0/3590952361 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f283403f030 con 0x7f284806e240 2024-09-17T01:32:35.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.083+0000 7f284e600640 1 -- 172.21.15.42:0/3590952361 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2848076430 con 0x7f284806e240 2024-09-17T01:32:35.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.084+0000 7f2844c00640 1 -- 172.21.15.42:0/3590952361 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f28340839e0 con 0x7f284806e240 2024-09-17T01:32:35.082 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2024-09-17T01:32:35.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.086+0000 7f284e600640 1 -- 172.21.15.42:0/3590952361 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2828078b90 msgr2=0x7f282807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:35.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.086+0000 7f284e600640 1 --2- 172.21.15.42:0/3590952361 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2828078b90 0x7f282807b0a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f283c009b30 tx=0x7f283c005f90 comp rx=0 tx=0).stop 2024-09-17T01:32:35.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.086+0000 7f284e600640 1 -- 172.21.15.42:0/3590952361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f284806e240 msgr2=0x7f28480cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:35.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.086+0000 7f284e600640 1 --2- 172.21.15.42:0/3590952361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f284806e240 0x7f28480cbe70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f283402abc0 tx=0x7f2834031630 comp rx=0 tx=0).stop 2024-09-17T01:32:35.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.086+0000 7f284e600640 1 -- 172.21.15.42:0/3590952361 shutdown_connections 2024-09-17T01:32:35.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.086+0000 7f284e600640 1 --2- 172.21.15.42:0/3590952361 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2828078b90 0x7f282807b0a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:35.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.086+0000 7f284e600640 1 --2- 172.21.15.42:0/3590952361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28480b06d0 0x7f28480cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:35.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.086+0000 7f284e600640 1 --2- 172.21.15.42:0/3590952361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f284806e240 0x7f28480cbe70 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:35.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.086+0000 7f284e600640 1 --2- 172.21.15.42:0/3590952361 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f284806cd20 0x7f28480af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:35.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.086+0000 7f284e600640 1 -- 172.21.15.42:0/3590952361 >> 172.21.15.42:0/3590952361 conn(0x7f28480734a0 msgr2=0x7f28480b61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:35.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.087+0000 7f284e600640 1 -- 172.21.15.42:0/3590952361 shutdown_connections 2024-09-17T01:32:35.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.087+0000 7f284e600640 1 -- 172.21.15.42:0/3590952361 wait complete. 2024-09-17T01:32:35.106 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-09-17T01:32:35.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.334+0000 7f5853e00640 1 -- 172.21.15.42:0/325251703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f585406d430 msgr2=0x7f5854152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:35.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.334+0000 7f5853e00640 1 --2- 172.21.15.42:0/325251703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f585406d430 0x7f5854152ed0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f584c005fd0 tx=0x7f584c02a8b0 comp rx=0 tx=0).stop 2024-09-17T01:32:35.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.334+0000 7f5853e00640 1 -- 172.21.15.42:0/325251703 shutdown_connections 2024-09-17T01:32:35.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.334+0000 7f5853e00640 1 --2- 172.21.15.42:0/325251703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f585406d430 0x7f5854152ed0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:35.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.334+0000 7f5853e00640 1 -- 172.21.15.42:0/325251703 >> 172.21.15.42:0/325251703 conn(0x7f58540b25f0 msgr2=0x7f58540d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:35.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.334+0000 7f5853e00640 1 -- 172.21.15.42:0/325251703 shutdown_connections 2024-09-17T01:32:35.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.334+0000 7f5853e00640 1 -- 172.21.15.42:0/325251703 wait complete. 2024-09-17T01:32:35.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.336+0000 7f5853e00640 1 Processor -- start 2024-09-17T01:32:35.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.336+0000 7f5853e00640 1 -- start start 2024-09-17T01:32:35.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.338+0000 7f5853e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f58540b4be0 0x7f58541f2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:35.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.338+0000 7f5853e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58540cf7c0 0x7f5854151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:35.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.338+0000 7f5853e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58540c7320 0x7f58540c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:35.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.338+0000 7f5853e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5854153590 con 0x7f58540cf7c0 2024-09-17T01:32:35.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.338+0000 7f5853e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5854153410 con 0x7f58540c7320 2024-09-17T01:32:35.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.338+0000 7f5853e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5854153710 con 0x7f58540b4be0 2024-09-17T01:32:35.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.338+0000 7f584be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58540cf7c0 0x7f5854151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:35.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.338+0000 7f584be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58540cf7c0 0x7f5854151bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54344/0 (socket says 172.21.15.42:54344) 2024-09-17T01:32:35.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.338+0000 7f584be00640 1 -- 172.21.15.42:0/2804970819 learned_addr learned my addr 172.21.15.42:0/2804970819 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:35.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.338+0000 7f5852a00640 1 --2- 172.21.15.42:0/2804970819 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f58540b4be0 0x7f58541f2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:35.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.338+0000 7f5853400640 1 --2- 172.21.15.42:0/2804970819 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58540c7320 0x7f58540c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:35.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.339+0000 7f584be00640 1 -- 172.21.15.42:0/2804970819 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f58540b4be0 msgr2=0x7f58541f2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:35.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.339+0000 7f584be00640 1 --2- 172.21.15.42:0/2804970819 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f58540b4be0 0x7f58541f2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:35.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.339+0000 7f584be00640 1 -- 172.21.15.42:0/2804970819 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58540c7320 msgr2=0x7f58540c7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:35.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.339+0000 7f584be00640 1 --2- 172.21.15.42:0/2804970819 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58540c7320 0x7f58540c7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:35.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.339+0000 7f584be00640 1 -- 172.21.15.42:0/2804970819 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58540c7c70 con 0x7f58540cf7c0 2024-09-17T01:32:35.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.339+0000 7f5853400640 1 --2- 172.21.15.42:0/2804970819 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58540c7320 0x7f58540c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:35.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.339+0000 7f584be00640 1 --2- 172.21.15.42:0/2804970819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58540cf7c0 0x7f5854151bd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f583c00c3c0 tx=0x7f583c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:35.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.339+0000 7f584aa00640 1 -- 172.21.15.42:0/2804970819 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c017070 con 0x7f58540cf7c0 2024-09-17T01:32:35.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.339+0000 7f584aa00640 1 -- 172.21.15.42:0/2804970819 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f583c0035f0 con 0x7f58540cf7c0 2024-09-17T01:32:35.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.339+0000 7f5853e00640 1 -- 172.21.15.42:0/2804970819 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58541f3370 con 0x7f58540cf7c0 2024-09-17T01:32:35.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.339+0000 7f584aa00640 1 -- 172.21.15.42:0/2804970819 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c003a80 con 0x7f58540cf7c0 2024-09-17T01:32:35.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.339+0000 7f5853e00640 1 -- 172.21.15.42:0/2804970819 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58541f3b40 con 0x7f58540cf7c0 2024-09-17T01:32:35.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.341+0000 7f5853e00640 1 -- 172.21.15.42:0/2804970819 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58541f35d0 con 0x7f58540cf7c0 2024-09-17T01:32:35.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.342+0000 7f584aa00640 1 -- 172.21.15.42:0/2804970819 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f583c01a070 con 0x7f58540cf7c0 2024-09-17T01:32:35.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.343+0000 7f584aa00640 1 --2- 172.21.15.42:0/2804970819 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5830078b90 0x7f583007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:35.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.343+0000 7f584aa00640 1 -- 172.21.15.42:0/2804970819 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f583c099fe0 con 0x7f58540cf7c0 2024-09-17T01:32:35.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.344+0000 7f5852a00640 1 --2- 172.21.15.42:0/2804970819 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5830078b90 0x7f583007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:35.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.344+0000 7f5852a00640 1 --2- 172.21.15.42:0/2804970819 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5830078b90 0x7f583007b0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5844006fd0 tx=0x7f5844009060 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:35.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.348+0000 7f584aa00640 1 -- 172.21.15.42:0/2804970819 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f58540c7c70 con 0x7f58540cf7c0 2024-09-17T01:32:35.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:35.615+0000 7f5853e00640 1 -- 172.21.15.42:0/2804970819 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) -- 0x7f58541f3d80 con 0x7f58540cf7c0 2024-09-17T01:32:36.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.167+0000 7f584aa00640 1 -- 172.21.15.42:0/2804970819 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v51) ==== 151+0+0 (secure 0 0 0) 0x7f58541f3d80 con 0x7f58540cf7c0 2024-09-17T01:32:36.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.170+0000 7f5853e00640 1 -- 172.21.15.42:0/2804970819 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5830078b90 msgr2=0x7f583007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:36.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.170+0000 7f5853e00640 1 --2- 172.21.15.42:0/2804970819 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5830078b90 0x7f583007b0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5844006fd0 tx=0x7f5844009060 comp rx=0 tx=0).stop 2024-09-17T01:32:36.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.170+0000 7f5853e00640 1 -- 172.21.15.42:0/2804970819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58540cf7c0 msgr2=0x7f5854151bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:36.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.170+0000 7f5853e00640 1 --2- 172.21.15.42:0/2804970819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58540cf7c0 0x7f5854151bd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f583c00c3c0 tx=0x7f583c00c880 comp rx=0 tx=0).stop 2024-09-17T01:32:36.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.170+0000 7f5853e00640 1 -- 172.21.15.42:0/2804970819 shutdown_connections 2024-09-17T01:32:36.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.170+0000 7f5853e00640 1 --2- 172.21.15.42:0/2804970819 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5830078b90 0x7f583007b0a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:36.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.170+0000 7f5853e00640 1 --2- 172.21.15.42:0/2804970819 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58540c7320 0x7f58540c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:36.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.170+0000 7f5853e00640 1 --2- 172.21.15.42:0/2804970819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58540cf7c0 0x7f5854151bd0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:36.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.170+0000 7f5853e00640 1 --2- 172.21.15.42:0/2804970819 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f58540b4be0 0x7f58541f2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:36.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.170+0000 7f5853e00640 1 -- 172.21.15.42:0/2804970819 >> 172.21.15.42:0/2804970819 conn(0x7f58540b25f0 msgr2=0x7f585415c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:36.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.170+0000 7f5853e00640 1 -- 172.21.15.42:0/2804970819 shutdown_connections 2024-09-17T01:32:36.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.170+0000 7f5853e00640 1 -- 172.21.15.42:0/2804970819 wait complete. 2024-09-17T01:32:36.195 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T01:32:36.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.427+0000 7ff90ec00640 1 -- 172.21.15.42:0/3528291165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff90806db40 msgr2=0x7ff90815bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.427+0000 7ff90ec00640 1 --2- 172.21.15.42:0/3528291165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff90806db40 0x7ff90815bc50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff9080b5b30 tx=0x7ff8f402a510 comp rx=0 tx=0).stop 2024-09-17T01:32:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.427+0000 7ff90ec00640 1 -- 172.21.15.42:0/3528291165 shutdown_connections 2024-09-17T01:32:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.427+0000 7ff90ec00640 1 --2- 172.21.15.42:0/3528291165 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff90815f190 0x7ff90806fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.427+0000 7ff90ec00640 1 --2- 172.21.15.42:0/3528291165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff90806db40 0x7ff90815bc50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.427+0000 7ff90ec00640 1 -- 172.21.15.42:0/3528291165 >> 172.21.15.42:0/3528291165 conn(0x7ff9080b2930 msgr2=0x7ff90806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.428+0000 7ff90ec00640 1 -- 172.21.15.42:0/3528291165 shutdown_connections 2024-09-17T01:32:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.428+0000 7ff90ec00640 1 -- 172.21.15.42:0/3528291165 wait complete. 2024-09-17T01:32:36.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.430+0000 7ff90ec00640 1 Processor -- start 2024-09-17T01:32:36.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.430+0000 7ff90ec00640 1 -- start start 2024-09-17T01:32:36.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.431+0000 7ff90ec00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff908072e00 0x7ff9080b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:36.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.431+0000 7ff90ec00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff90815f190 0x7ff90813dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:36.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.431+0000 7ff90ec00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff90814bec0 0x7ff9081f9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:36.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.431+0000 7ff90ec00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff908151520 con 0x7ff90815f190 2024-09-17T01:32:36.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.431+0000 7ff90ec00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff908070740 con 0x7ff908072e00 2024-09-17T01:32:36.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.431+0000 7ff90ec00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff9081516a0 con 0x7ff90814bec0 2024-09-17T01:32:36.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.432+0000 7ff907400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff90815f190 0x7ff90813dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:36.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.432+0000 7ff907400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff90815f190 0x7ff90813dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46302/0 (socket says 172.21.15.42:46302) 2024-09-17T01:32:36.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.432+0000 7ff907400640 1 -- 172.21.15.42:0/353287720 learned_addr learned my addr 172.21.15.42:0/353287720 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:36.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.432+0000 7ff90cc00640 1 --2- 172.21.15.42:0/353287720 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff90814bec0 0x7ff9081f9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:36.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.432+0000 7ff907e00640 1 --2- 172.21.15.42:0/353287720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff908072e00 0x7ff9080b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:36.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.432+0000 7ff907400640 1 -- 172.21.15.42:0/353287720 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff90814bec0 msgr2=0x7ff9081f9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:36.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.432+0000 7ff907400640 1 --2- 172.21.15.42:0/353287720 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff90814bec0 0x7ff9081f9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:36.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.432+0000 7ff907400640 1 -- 172.21.15.42:0/353287720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff908072e00 msgr2=0x7ff9080b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.432+0000 7ff907400640 1 --2- 172.21.15.42:0/353287720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff908072e00 0x7ff9080b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.432+0000 7ff907400640 1 -- 172.21.15.42:0/353287720 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9080b4380 con 0x7ff90815f190 2024-09-17T01:32:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.433+0000 7ff907400640 1 --2- 172.21.15.42:0/353287720 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff90815f190 0x7ff90813dcd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4000c00 tx=0x7ff8f4003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.433+0000 7ff8ffe00640 1 -- 172.21.15.42:0/353287720 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f403e030 con 0x7ff90815f190 2024-09-17T01:32:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.433+0000 7ff8ffe00640 1 -- 172.21.15.42:0/353287720 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8f4003e00 con 0x7ff90815f190 2024-09-17T01:32:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.433+0000 7ff8ffe00640 1 -- 172.21.15.42:0/353287720 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4035040 con 0x7ff90815f190 2024-09-17T01:32:36.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.433+0000 7ff90ec00640 1 -- 172.21.15.42:0/353287720 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9080b3dc0 con 0x7ff90815f190 2024-09-17T01:32:36.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.433+0000 7ff90ec00640 1 -- 172.21.15.42:0/353287720 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9081f92c0 con 0x7ff90815f190 2024-09-17T01:32:36.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.434+0000 7ff90ec00640 1 -- 172.21.15.42:0/353287720 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9080b3b30 con 0x7ff90815f190 2024-09-17T01:32:36.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.435+0000 7ff8ffe00640 1 -- 172.21.15.42:0/353287720 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff8f4041030 con 0x7ff90815f190 2024-09-17T01:32:36.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.436+0000 7ff8ffe00640 1 --2- 172.21.15.42:0/353287720 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff8e8078bc0 0x7ff8e807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:36.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.437+0000 7ff8ffe00640 1 -- 172.21.15.42:0/353287720 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff8f40bb4e0 con 0x7ff90815f190 2024-09-17T01:32:36.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.437+0000 7ff907e00640 1 --2- 172.21.15.42:0/353287720 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff8e8078bc0 0x7ff8e807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:36.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.438+0000 7ff907e00640 1 --2- 172.21.15.42:0/353287720 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff8e8078bc0 0x7ff8e807b0d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8006fd0 tx=0x7ff8f8009060 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:36.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.441+0000 7ff8ffe00640 1 -- 172.21.15.42:0/353287720 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff8f4083230 con 0x7ff90815f190 2024-09-17T01:32:36.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.638+0000 7ff90ec00640 1 -- 172.21.15.42:0/353287720 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7ff9080b01f0 con 0x7ff90815f190 2024-09-17T01:32:36.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.639+0000 7ff8ffe00640 1 -- 172.21.15.42:0/353287720 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v31) ==== 59+0+2294 (secure 0 0 0) 0x7ff9080b01f0 con 0x7ff90815f190 2024-09-17T01:32:36.636 INFO:teuthology.orchestra.run.smithi042.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T01:32:36.637 INFO:teuthology.orchestra.run.smithi042.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T01:32:36.637 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced client_mount_timeout 30 2024-09-17T01:32:36.637 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_client 20/20 2024-09-17T01:32:36.637 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_mgr 20/20 2024-09-17T01:32:36.637 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_ms 1/1 2024-09-17T01:32:36.637 INFO:teuthology.orchestra.run.smithi042.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T01:32:36.637 INFO:teuthology.orchestra.run.smithi042.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T01:32:36.637 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3683.959260 2024-09-17T01:32:36.637 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4350.010833 2024-09-17T01:32:36.637 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4316.776055 2024-09-17T01:32:36.637 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3885.595082 2024-09-17T01:32:36.637 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3602.000737 2024-09-17T01:32:36.637 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4883.364748 2024-09-17T01:32:36.638 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3752.484811 2024-09-17T01:32:36.638 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3775.035963 2024-09-17T01:32:36.638 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds 20/20 2024-09-17T01:32:36.638 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T01:32:36.638 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_ms 2/2 2024-09-17T01:32:36.638 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_frag true 2024-09-17T01:32:36.638 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_scatterstat true 2024-09-17T01:32:36.638 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T01:32:36.638 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_verify_scatter true 2024-09-17T01:32:36.638 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T01:32:36.638 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T01:32:36.638 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T01:32:36.639 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced client_mount_timeout 600 2024-09-17T01:32:36.639 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_client 20/20 2024-09-17T01:32:36.639 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_ms 1/1 2024-09-17T01:32:36.639 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T01:32:36.639 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T01:32:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.641+0000 7ff90ec00640 1 -- 172.21.15.42:0/353287720 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff8e8078bc0 msgr2=0x7ff8e807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.641+0000 7ff90ec00640 1 --2- 172.21.15.42:0/353287720 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff8e8078bc0 0x7ff8e807b0d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8006fd0 tx=0x7ff8f8009060 comp rx=0 tx=0).stop 2024-09-17T01:32:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.641+0000 7ff90ec00640 1 -- 172.21.15.42:0/353287720 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff90815f190 msgr2=0x7ff90813dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.641+0000 7ff90ec00640 1 --2- 172.21.15.42:0/353287720 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff90815f190 0x7ff90813dcd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4000c00 tx=0x7ff8f4003910 comp rx=0 tx=0).stop 2024-09-17T01:32:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.641+0000 7ff90ec00640 1 -- 172.21.15.42:0/353287720 shutdown_connections 2024-09-17T01:32:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.641+0000 7ff90ec00640 1 --2- 172.21.15.42:0/353287720 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff8e8078bc0 0x7ff8e807b0d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.641+0000 7ff90ec00640 1 --2- 172.21.15.42:0/353287720 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff90814bec0 0x7ff9081f9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.641+0000 7ff90ec00640 1 --2- 172.21.15.42:0/353287720 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff90815f190 0x7ff90813dcd0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.641+0000 7ff90ec00640 1 --2- 172.21.15.42:0/353287720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff908072e00 0x7ff9080b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:36.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.641+0000 7ff90ec00640 1 -- 172.21.15.42:0/353287720 >> 172.21.15.42:0/353287720 conn(0x7ff9080b2930 msgr2=0x7ff9080725b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:36.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.641+0000 7ff90ec00640 1 -- 172.21.15.42:0/353287720 shutdown_connections 2024-09-17T01:32:36.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.641+0000 7ff90ec00640 1 -- 172.21.15.42:0/353287720 wait complete. 2024-09-17T01:32:36.661 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T01:32:36.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.895+0000 7f54cb200640 1 -- 172.21.15.42:0/131073559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54cc0cd310 msgr2=0x7f54cc0cd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:36.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.895+0000 7f54cb200640 1 --2- 172.21.15.42:0/131073559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54cc0cd310 0x7f54cc0cd720 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f54c4005fd0 tx=0x7f54c402a8b0 comp rx=0 tx=0).stop 2024-09-17T01:32:36.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.895+0000 7f54cb200640 1 -- 172.21.15.42:0/131073559 shutdown_connections 2024-09-17T01:32:36.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.895+0000 7f54cb200640 1 --2- 172.21.15.42:0/131073559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54cc0cd310 0x7f54cc0cd720 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:36.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.895+0000 7f54cb200640 1 --2- 172.21.15.42:0/131073559 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f54cc0b78f0 0x7f54cc0d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:36.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.895+0000 7f54cb200640 1 -- 172.21.15.42:0/131073559 >> 172.21.15.42:0/131073559 conn(0x7f54cc0b3ed0 msgr2=0x7f54cc0b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:36.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.895+0000 7f54cb200640 1 -- 172.21.15.42:0/131073559 shutdown_connections 2024-09-17T01:32:36.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.895+0000 7f54cb200640 1 -- 172.21.15.42:0/131073559 wait complete. 2024-09-17T01:32:36.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.897+0000 7f54cb200640 1 Processor -- start 2024-09-17T01:32:36.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.898+0000 7f54cb200640 1 -- start start 2024-09-17T01:32:36.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.899+0000 7f54cb200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f54cc0b78f0 0x7f54cc09fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:36.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.899+0000 7f54cb200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54cc0cd310 0x7f54cc153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:36.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.899+0000 7f54cb200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54cc0d0830 0x7f54cc15f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:36.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.899+0000 7f54cb200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc0cdc60 con 0x7f54cc0d0830 2024-09-17T01:32:36.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.899+0000 7f54cb200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc0b7f10 con 0x7f54cc0cd310 2024-09-17T01:32:36.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.899+0000 7f54cb200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f54cc0cdde0 con 0x7f54cc0b78f0 2024-09-17T01:32:36.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.899+0000 7f54ca800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54cc0d0830 0x7f54cc15f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:36.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.899+0000 7f54ca800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54cc0d0830 0x7f54cc15f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46308/0 (socket says 172.21.15.42:46308) 2024-09-17T01:32:36.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.899+0000 7f54ca800640 1 -- 172.21.15.42:0/2992397635 learned_addr learned my addr 172.21.15.42:0/2992397635 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:36.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.900+0000 7f54c9e00640 1 --2- 172.21.15.42:0/2992397635 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f54cc0b78f0 0x7f54cc09fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:36.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.900+0000 7f54c3e00640 1 --2- 172.21.15.42:0/2992397635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54cc0cd310 0x7f54cc153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:36.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.900+0000 7f54ca800640 1 -- 172.21.15.42:0/2992397635 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f54cc0b78f0 msgr2=0x7f54cc09fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:36.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.900+0000 7f54ca800640 1 --2- 172.21.15.42:0/2992397635 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f54cc0b78f0 0x7f54cc09fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:36.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.900+0000 7f54ca800640 1 -- 172.21.15.42:0/2992397635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54cc0cd310 msgr2=0x7f54cc153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:36.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.900+0000 7f54ca800640 1 --2- 172.21.15.42:0/2992397635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54cc0cd310 0x7f54cc153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:36.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.900+0000 7f54ca800640 1 -- 172.21.15.42:0/2992397635 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54cc09ed40 con 0x7f54cc0d0830 2024-09-17T01:32:36.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.900+0000 7f54c3e00640 1 --2- 172.21.15.42:0/2992397635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54cc0cd310 0x7f54cc153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:36.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.900+0000 7f54ca800640 1 --2- 172.21.15.42:0/2992397635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54cc0d0830 0x7f54cc15f210 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009cd0 tx=0x7f54c40316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:36.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.901+0000 7f54c2000640 1 -- 172.21.15.42:0/2992397635 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c4031990 con 0x7f54cc0d0830 2024-09-17T01:32:36.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.901+0000 7f54c2000640 1 -- 172.21.15.42:0/2992397635 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54c4031c20 con 0x7f54cc0d0830 2024-09-17T01:32:36.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.901+0000 7f54c2000640 1 -- 172.21.15.42:0/2992397635 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c40330d0 con 0x7f54cc0d0830 2024-09-17T01:32:36.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.901+0000 7f54cb200640 1 -- 172.21.15.42:0/2992397635 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54cc09f020 con 0x7f54cc0d0830 2024-09-17T01:32:36.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.901+0000 7f54cb200640 1 -- 172.21.15.42:0/2992397635 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54cc09f5e0 con 0x7f54cc0d0830 2024-09-17T01:32:36.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.902+0000 7f54cb200640 1 -- 172.21.15.42:0/2992397635 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54cc0ce330 con 0x7f54cc0d0830 2024-09-17T01:32:36.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.903+0000 7f54c2000640 1 -- 172.21.15.42:0/2992397635 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f54c4033270 con 0x7f54cc0d0830 2024-09-17T01:32:36.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.904+0000 7f54c2000640 1 --2- 172.21.15.42:0/2992397635 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f54a8078bb0 0x7f54a807b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:36.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.904+0000 7f54c2000640 1 -- 172.21.15.42:0/2992397635 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f54c40bc180 con 0x7f54cc0d0830 2024-09-17T01:32:36.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.905+0000 7f54c9e00640 1 --2- 172.21.15.42:0/2992397635 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f54a8078bb0 0x7f54a807b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:36.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.906+0000 7f54c9e00640 1 --2- 172.21.15.42:0/2992397635 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f54a8078bb0 0x7f54a807b0c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009b30 tx=0x7f54bc005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:36.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:36.909+0000 7f54c2000640 1 -- 172.21.15.42:0/2992397635 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f54c403f030 con 0x7f54cc0d0830 2024-09-17T01:32:37.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.105+0000 7f54cb200640 1 -- 172.21.15.42:0/2992397635 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f54cc09ead0 con 0x7f54cc0d0830 2024-09-17T01:32:37.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.109+0000 7f54c2000640 1 -- 172.21.15.42:0/2992397635 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7f54c4084520 con 0x7f54cc0d0830 2024-09-17T01:32:37.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.112+0000 7f54cb200640 1 -- 172.21.15.42:0/2992397635 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f54a8078bb0 msgr2=0x7f54a807b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:37.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.112+0000 7f54cb200640 1 --2- 172.21.15.42:0/2992397635 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f54a8078bb0 0x7f54a807b0c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009b30 tx=0x7f54bc005f90 comp rx=0 tx=0).stop 2024-09-17T01:32:37.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.112+0000 7f54cb200640 1 -- 172.21.15.42:0/2992397635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54cc0d0830 msgr2=0x7f54cc15f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:37.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.112+0000 7f54cb200640 1 --2- 172.21.15.42:0/2992397635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54cc0d0830 0x7f54cc15f210 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009cd0 tx=0x7f54c40316d0 comp rx=0 tx=0).stop 2024-09-17T01:32:37.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.112+0000 7f54cb200640 1 -- 172.21.15.42:0/2992397635 shutdown_connections 2024-09-17T01:32:37.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.112+0000 7f54cb200640 1 --2- 172.21.15.42:0/2992397635 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f54a8078bb0 0x7f54a807b0c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:37.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.112+0000 7f54cb200640 1 --2- 172.21.15.42:0/2992397635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54cc0cd310 0x7f54cc153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:37.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.112+0000 7f54cb200640 1 --2- 172.21.15.42:0/2992397635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54cc0d0830 0x7f54cc15f210 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:37.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.112+0000 7f54cb200640 1 --2- 172.21.15.42:0/2992397635 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f54cc0b78f0 0x7f54cc09fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:37.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.112+0000 7f54cb200640 1 -- 172.21.15.42:0/2992397635 >> 172.21.15.42:0/2992397635 conn(0x7f54cc0b3ed0 msgr2=0x7f54cc15e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:37.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.112+0000 7f54cb200640 1 -- 172.21.15.42:0/2992397635 shutdown_connections 2024-09-17T01:32:37.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.112+0000 7f54cb200640 1 -- 172.21.15.42:0/2992397635 wait complete. 2024-09-17T01:32:37.131 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:32:37.131 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:32:37.237 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:32:37.329 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:32:37.329 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:32:37.329 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:32:37.365 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:32:37.365 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:32:37.442 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:32:37.442 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:32:37.517 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T01:32:37.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.787+0000 7fd9d7800640 1 -- 172.21.15.42:0/453353867 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9d00b3550 msgr2=0x7fd9d015cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:37.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.787+0000 7fd9d7800640 1 --2- 172.21.15.42:0/453353867 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9d00b3550 0x7fd9d015cec0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00704d0 tx=0x7fd9c402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:32:37.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.787+0000 7fd9d7800640 1 -- 172.21.15.42:0/453353867 shutdown_connections 2024-09-17T01:32:37.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.787+0000 7fd9d7800640 1 --2- 172.21.15.42:0/453353867 >> v2:172.21.15.43:3300/0 conn(0x7fd9d0142f40 0x7fd9d0072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:37.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.787+0000 7fd9d7800640 1 --2- 172.21.15.42:0/453353867 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9d00b3550 0x7fd9d015cec0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:37.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.787+0000 7fd9d7800640 1 -- 172.21.15.42:0/453353867 >> 172.21.15.42:0/453353867 conn(0x7fd9d00b2930 msgr2=0x7fd9d006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:37.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.787+0000 7fd9d7800640 1 -- 172.21.15.42:0/453353867 shutdown_connections 2024-09-17T01:32:37.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.787+0000 7fd9d7800640 1 -- 172.21.15.42:0/453353867 wait complete. 2024-09-17T01:32:37.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.789+0000 7fd9d7800640 1 Processor -- start 2024-09-17T01:32:37.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.789+0000 7fd9d7800640 1 -- start start 2024-09-17T01:32:37.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.791+0000 7fd9d7800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9d0072e90 0x7fd9d01f6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:37.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.791+0000 7fd9d7800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9d00b3550 0x7fd9d0156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:37.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.791+0000 7fd9d7800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9d0142f40 0x7fd9d00b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:37.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.791+0000 7fd9d7800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d006d5b0 con 0x7fd9d0142f40 2024-09-17T01:32:37.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.791+0000 7fd9d7800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d006d430 con 0x7fd9d00b3550 2024-09-17T01:32:37.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.791+0000 7fd9d7800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd9d006d730 con 0x7fd9d0072e90 2024-09-17T01:32:37.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.791+0000 7fd9d5800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9d0142f40 0x7fd9d00b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:37.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.791+0000 7fd9d5800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9d0142f40 0x7fd9d00b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46340/0 (socket says 172.21.15.42:46340) 2024-09-17T01:32:37.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.791+0000 7fd9d5800640 1 -- 172.21.15.42:0/2548732430 learned_addr learned my addr 172.21.15.42:0/2548732430 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:37.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.791+0000 7fd9cfe00640 1 --2- 172.21.15.42:0/2548732430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9d00b3550 0x7fd9d0156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:37.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.791+0000 7fd9d4e00640 1 --2- 172.21.15.42:0/2548732430 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9d0072e90 0x7fd9d01f6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:37.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.792+0000 7fd9d5800640 1 -- 172.21.15.42:0/2548732430 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9d0072e90 msgr2=0x7fd9d01f6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:37.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.792+0000 7fd9d5800640 1 --2- 172.21.15.42:0/2548732430 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9d0072e90 0x7fd9d01f6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:37.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.792+0000 7fd9d5800640 1 -- 172.21.15.42:0/2548732430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9d00b3550 msgr2=0x7fd9d0156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:37.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.792+0000 7fd9d5800640 1 --2- 172.21.15.42:0/2548732430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9d00b3550 0x7fd9d0156dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:37.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.792+0000 7fd9d5800640 1 -- 172.21.15.42:0/2548732430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d01f77c0 con 0x7fd9d0142f40 2024-09-17T01:32:37.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.792+0000 7fd9d5800640 1 --2- 172.21.15.42:0/2548732430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9d0142f40 0x7fd9d00b1080 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800c6f0 tx=0x7fd9c800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:37.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.792+0000 7fd9ccc00640 1 -- 172.21.15.42:0/2548732430 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8017070 con 0x7fd9d0142f40 2024-09-17T01:32:37.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.792+0000 7fd9ccc00640 1 -- 172.21.15.42:0/2548732430 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9c8003c90 con 0x7fd9d0142f40 2024-09-17T01:32:37.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.792+0000 7fd9ccc00640 1 -- 172.21.15.42:0/2548732430 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8003e60 con 0x7fd9d0142f40 2024-09-17T01:32:37.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.792+0000 7fd9d7800640 1 -- 172.21.15.42:0/2548732430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9d01f7aa0 con 0x7fd9d0142f40 2024-09-17T01:32:37.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.792+0000 7fd9d7800640 1 -- 172.21.15.42:0/2548732430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9d0140f30 con 0x7fd9d0142f40 2024-09-17T01:32:37.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.793+0000 7fd9d7800640 1 -- 172.21.15.42:0/2548732430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9d006dbe0 con 0x7fd9d0142f40 2024-09-17T01:32:37.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.795+0000 7fd9ccc00640 1 -- 172.21.15.42:0/2548732430 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd9c801a070 con 0x7fd9d0142f40 2024-09-17T01:32:37.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.796+0000 7fd9ccc00640 1 --2- 172.21.15.42:0/2548732430 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd9b0078bc0 0x7fd9b007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:37.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.796+0000 7fd9ccc00640 1 -- 172.21.15.42:0/2548732430 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd9c809a2f0 con 0x7fd9d0142f40 2024-09-17T01:32:37.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.796+0000 7fd9d4e00640 1 --2- 172.21.15.42:0/2548732430 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd9b0078bc0 0x7fd9b007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:37.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.797+0000 7fd9d4e00640 1 --2- 172.21.15.42:0/2548732430 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd9b0078bc0 0x7fd9b007b0d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4034000 tx=0x7fd9c4004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:37.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:37.800+0000 7fd9ccc00640 1 -- 172.21.15.42:0/2548732430 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd9c8062040 con 0x7fd9d0142f40 2024-09-17T01:32:38.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.007+0000 7fd9d7800640 1 -- 172.21.15.42:0/2548732430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd9d006a170 con 0x7fd9d0142f40 2024-09-17T01:32:38.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.007+0000 7fd9ccc00640 1 -- 172.21.15.42:0/2548732430 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7fd9c809a0d0 con 0x7fd9d0142f40 2024-09-17T01:32:38.005 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-17T01:32:38.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.010+0000 7fd9d7800640 1 -- 172.21.15.42:0/2548732430 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd9b0078bc0 msgr2=0x7fd9b007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:38.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.010+0000 7fd9d7800640 1 --2- 172.21.15.42:0/2548732430 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd9b0078bc0 0x7fd9b007b0d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4034000 tx=0x7fd9c4004730 comp rx=0 tx=0).stop 2024-09-17T01:32:38.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.010+0000 7fd9d7800640 1 -- 172.21.15.42:0/2548732430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9d0142f40 msgr2=0x7fd9d00b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:38.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.010+0000 7fd9d7800640 1 --2- 172.21.15.42:0/2548732430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9d0142f40 0x7fd9d00b1080 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800c6f0 tx=0x7fd9c800cbb0 comp rx=0 tx=0).stop 2024-09-17T01:32:38.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.010+0000 7fd9d7800640 1 -- 172.21.15.42:0/2548732430 shutdown_connections 2024-09-17T01:32:38.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.010+0000 7fd9d7800640 1 --2- 172.21.15.42:0/2548732430 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd9b0078bc0 0x7fd9b007b0d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:38.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.010+0000 7fd9d7800640 1 --2- 172.21.15.42:0/2548732430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9d00b3550 0x7fd9d0156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:38.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.010+0000 7fd9d7800640 1 --2- 172.21.15.42:0/2548732430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9d0142f40 0x7fd9d00b1080 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:38.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.010+0000 7fd9d7800640 1 --2- 172.21.15.42:0/2548732430 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9d0072e90 0x7fd9d01f6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:38.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.010+0000 7fd9d7800640 1 -- 172.21.15.42:0/2548732430 >> 172.21.15.42:0/2548732430 conn(0x7fd9d00b2930 msgr2=0x7fd9d015f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:38.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.010+0000 7fd9d7800640 1 -- 172.21.15.42:0/2548732430 shutdown_connections 2024-09-17T01:32:38.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.010+0000 7fd9d7800640 1 -- 172.21.15.42:0/2548732430 wait complete. 2024-09-17T01:32:38.029 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T01:32:38.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:38.029 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-17T01:32:38.093 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:32:38.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:38.093 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T01:32:38.141 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:32:38.141 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:32:38.182 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:32:38.182 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:32:38.261 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:32:38.261 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:32:38.341 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T01:32:38.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.572+0000 7f8397200640 1 -- 172.21.15.42:0/1390014948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8398073340 msgr2=0x7f83980d2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:38.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.572+0000 7f8397200640 1 --2- 172.21.15.42:0/1390014948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8398073340 0x7f83980d2810 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8388009900 tx=0x7f838802a610 comp rx=0 tx=0).stop 2024-09-17T01:32:38.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.572+0000 7f8397200640 1 -- 172.21.15.42:0/1390014948 shutdown_connections 2024-09-17T01:32:38.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.572+0000 7f8397200640 1 --2- 172.21.15.42:0/1390014948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8398073340 0x7f83980d2810 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:38.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.572+0000 7f8397200640 1 -- 172.21.15.42:0/1390014948 >> 172.21.15.42:0/1390014948 conn(0x7f83980d1210 msgr2=0x7f83980d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:38.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.572+0000 7f8397200640 1 -- 172.21.15.42:0/1390014948 shutdown_connections 2024-09-17T01:32:38.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.572+0000 7f8397200640 1 -- 172.21.15.42:0/1390014948 wait complete. 2024-09-17T01:32:38.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.574+0000 7f8397200640 1 Processor -- start 2024-09-17T01:32:38.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.574+0000 7f8397200640 1 -- start start 2024-09-17T01:32:38.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.576+0000 7f8397200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8398073340 0x7f839814dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:38.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.576+0000 7f8397200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f83980b6030 0x7f83981ea230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:38.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.576+0000 7f8397200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8398162fa0 0x7f83981ea770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:38.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.576+0000 7f8397200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f839815fa40 con 0x7f8398073340 2024-09-17T01:32:38.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.576+0000 7f8397200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f839815f8c0 con 0x7f8398162fa0 2024-09-17T01:32:38.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.576+0000 7f8397200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f839815fbc0 con 0x7f83980b6030 2024-09-17T01:32:38.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.576+0000 7f8395e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8398073340 0x7f839814dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:38.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.576+0000 7f8395e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8398073340 0x7f839814dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46348/0 (socket says 172.21.15.42:46348) 2024-09-17T01:32:38.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.576+0000 7f8395e00640 1 -- 172.21.15.42:0/2422880631 learned_addr learned my addr 172.21.15.42:0/2422880631 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:38.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.576+0000 7f838fe00640 1 --2- 172.21.15.42:0/2422880631 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f83980b6030 0x7f83981ea230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:38.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.576+0000 7f8396800640 1 --2- 172.21.15.42:0/2422880631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8398162fa0 0x7f83981ea770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:38.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.576+0000 7f8395e00640 1 -- 172.21.15.42:0/2422880631 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f83980b6030 msgr2=0x7f83981ea230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:38.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.576+0000 7f8395e00640 1 --2- 172.21.15.42:0/2422880631 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f83980b6030 0x7f83981ea230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:38.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.576+0000 7f8395e00640 1 -- 172.21.15.42:0/2422880631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8398162fa0 msgr2=0x7f83981ea770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:38.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.576+0000 7f8395e00640 1 --2- 172.21.15.42:0/2422880631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8398162fa0 0x7f83981ea770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:38.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.576+0000 7f8395e00640 1 -- 172.21.15.42:0/2422880631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83981e85a0 con 0x7f8398073340 2024-09-17T01:32:38.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.576+0000 7f8396800640 1 --2- 172.21.15.42:0/2422880631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8398162fa0 0x7f83981ea770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:38.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.576+0000 7f838fe00640 1 --2- 172.21.15.42:0/2422880631 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f83980b6030 0x7f83981ea230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:38.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.577+0000 7f8395e00640 1 --2- 172.21.15.42:0/2422880631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8398073340 0x7f839814dae0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8388034040 tx=0x7f83880038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:38.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.577+0000 7f838e000640 1 -- 172.21.15.42:0/2422880631 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838803e030 con 0x7f8398073340 2024-09-17T01:32:38.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.577+0000 7f838e000640 1 -- 172.21.15.42:0/2422880631 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8388003ca0 con 0x7f8398073340 2024-09-17T01:32:38.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.577+0000 7f838e000640 1 -- 172.21.15.42:0/2422880631 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388035040 con 0x7f8398073340 2024-09-17T01:32:38.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.577+0000 7f8397200640 1 -- 172.21.15.42:0/2422880631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83981e8880 con 0x7f8398073340 2024-09-17T01:32:38.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.577+0000 7f8397200640 1 -- 172.21.15.42:0/2422880631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83981e8e40 con 0x7f8398073340 2024-09-17T01:32:38.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.578+0000 7f8397200640 1 -- 172.21.15.42:0/2422880631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83981600b0 con 0x7f8398073340 2024-09-17T01:32:38.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.580+0000 7f838e000640 1 -- 172.21.15.42:0/2422880631 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8388041030 con 0x7f8398073340 2024-09-17T01:32:38.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.580+0000 7f838e000640 1 --2- 172.21.15.42:0/2422880631 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8374078b90 0x7f837407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:38.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.581+0000 7f838e000640 1 -- 172.21.15.42:0/2422880631 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f83880bb2f0 con 0x7f8398073340 2024-09-17T01:32:38.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.581+0000 7f838fe00640 1 --2- 172.21.15.42:0/2422880631 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8374078b90 0x7f837407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:38.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.582+0000 7f838fe00640 1 --2- 172.21.15.42:0/2422880631 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8374078b90 0x7f837407b0a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f839815af10 tx=0x7f8380009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:38.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.585+0000 7f838e000640 1 -- 172.21.15.42:0/2422880631 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8388083850 con 0x7f8398073340 2024-09-17T01:32:38.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.787+0000 7f8397200640 1 -- 172.21.15.42:0/2422880631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f83980ba150 con 0x7f8398073340 2024-09-17T01:32:38.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.788+0000 7f838e000640 1 -- 172.21.15.42:0/2422880631 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f8388083150 con 0x7f8398073340 2024-09-17T01:32:38.786 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-17T01:32:38.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.790+0000 7f8397200640 1 -- 172.21.15.42:0/2422880631 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8374078b90 msgr2=0x7f837407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:38.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.790+0000 7f8397200640 1 --2- 172.21.15.42:0/2422880631 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8374078b90 0x7f837407b0a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f839815af10 tx=0x7f8380009040 comp rx=0 tx=0).stop 2024-09-17T01:32:38.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.790+0000 7f8397200640 1 -- 172.21.15.42:0/2422880631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8398073340 msgr2=0x7f839814dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:38.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.790+0000 7f8397200640 1 --2- 172.21.15.42:0/2422880631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8398073340 0x7f839814dae0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8388034040 tx=0x7f83880038a0 comp rx=0 tx=0).stop 2024-09-17T01:32:38.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.790+0000 7f8397200640 1 -- 172.21.15.42:0/2422880631 shutdown_connections 2024-09-17T01:32:38.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.790+0000 7f8397200640 1 --2- 172.21.15.42:0/2422880631 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8374078b90 0x7f837407b0a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:38.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.790+0000 7f8397200640 1 --2- 172.21.15.42:0/2422880631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8398162fa0 0x7f83981ea770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:38.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.790+0000 7f8397200640 1 --2- 172.21.15.42:0/2422880631 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f83980b6030 0x7f83981ea230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:38.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.790+0000 7f8397200640 1 --2- 172.21.15.42:0/2422880631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8398073340 0x7f839814dae0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:38.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.790+0000 7f8397200640 1 -- 172.21.15.42:0/2422880631 >> 172.21.15.42:0/2422880631 conn(0x7f83980d1210 msgr2=0x7f83980b4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:38.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.790+0000 7f8397200640 1 -- 172.21.15.42:0/2422880631 shutdown_connections 2024-09-17T01:32:38.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:38.790+0000 7f8397200640 1 -- 172.21.15.42:0/2422880631 wait complete. 2024-09-17T01:32:38.812 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T01:32:38.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:38.812 DEBUG:teuthology.orchestra.run.smithi043:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-17T01:32:38.881 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T01:32:38.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:38.881 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T01:32:38.949 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:32:38.949 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:32:38.985 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:32:38.985 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:32:39.060 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:32:39.060 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:32:39.136 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T01:32:39.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.407+0000 7f19d5200640 1 -- 172.21.15.42:0/1826207732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19d00b3550 msgr2=0x7f19d015cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:39.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.407+0000 7f19d5200640 1 --2- 172.21.15.42:0/1826207732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19d00b3550 0x7f19d015cec0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009830 tx=0x7f19c002a4b0 comp rx=0 tx=0).stop 2024-09-17T01:32:39.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.408+0000 7f19d5200640 1 -- 172.21.15.42:0/1826207732 shutdown_connections 2024-09-17T01:32:39.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.408+0000 7f19d5200640 1 --2- 172.21.15.42:0/1826207732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19d00b3550 0x7f19d015cec0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:39.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.408+0000 7f19d5200640 1 -- 172.21.15.42:0/1826207732 >> 172.21.15.42:0/1826207732 conn(0x7f19d00b2930 msgr2=0x7f19d006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:39.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.408+0000 7f19d5200640 1 -- 172.21.15.42:0/1826207732 shutdown_connections 2024-09-17T01:32:39.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.408+0000 7f19d5200640 1 -- 172.21.15.42:0/1826207732 wait complete. 2024-09-17T01:32:39.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.410+0000 7f19d5200640 1 Processor -- start 2024-09-17T01:32:39.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.410+0000 7f19d5200640 1 -- start start 2024-09-17T01:32:39.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.412+0000 7f19d5200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19d00b3550 0x7f19d0141a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:39.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.412+0000 7f19d5200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f19d00cec40 0x7f19d013f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:39.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.412+0000 7f19d5200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19d0142f40 0x7f19d006f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:39.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.412+0000 7f19d5200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f19d00cf050 con 0x7f19d00b3550 2024-09-17T01:32:39.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.412+0000 7f19d5200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f19d006dd50 con 0x7f19d0142f40 2024-09-17T01:32:39.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.412+0000 7f19d5200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f19d00cf1d0 con 0x7f19d00cec40 2024-09-17T01:32:39.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.412+0000 7f19cde00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19d00b3550 0x7f19d0141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:39.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.412+0000 7f19cde00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19d00b3550 0x7f19d0141a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46360/0 (socket says 172.21.15.42:46360) 2024-09-17T01:32:39.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.412+0000 7f19cde00640 1 -- 172.21.15.42:0/4275018744 learned_addr learned my addr 172.21.15.42:0/4275018744 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:39.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.412+0000 7f19ce800640 1 --2- 172.21.15.42:0/4275018744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19d0142f40 0x7f19d006f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:39.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.412+0000 7f19c7e00640 1 --2- 172.21.15.42:0/4275018744 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f19d00cec40 0x7f19d013f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:39.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.412+0000 7f19cde00640 1 -- 172.21.15.42:0/4275018744 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f19d00cec40 msgr2=0x7f19d013f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:39.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.412+0000 7f19cde00640 1 --2- 172.21.15.42:0/4275018744 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f19d00cec40 0x7f19d013f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:39.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.412+0000 7f19cde00640 1 -- 172.21.15.42:0/4275018744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19d0142f40 msgr2=0x7f19d006f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:39.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.412+0000 7f19cde00640 1 --2- 172.21.15.42:0/4275018744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19d0142f40 0x7f19d006f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:39.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.412+0000 7f19cde00640 1 -- 172.21.15.42:0/4275018744 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d0140160 con 0x7f19d00b3550 2024-09-17T01:32:39.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.412+0000 7f19ce800640 1 --2- 172.21.15.42:0/4275018744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19d0142f40 0x7f19d006f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:32:39.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.412+0000 7f19c7e00640 1 --2- 172.21.15.42:0/4275018744 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f19d00cec40 0x7f19d013f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:32:39.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.413+0000 7f19cde00640 1 --2- 172.21.15.42:0/4275018744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19d00b3550 0x7f19d0141a60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009950 tx=0x7f19c0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:39.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.413+0000 7f19c6000640 1 -- 172.21.15.42:0/4275018744 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c0005c90 con 0x7f19d00b3550 2024-09-17T01:32:39.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.413+0000 7f19c6000640 1 -- 172.21.15.42:0/4275018744 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19c0005020 con 0x7f19d00b3550 2024-09-17T01:32:39.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.413+0000 7f19c6000640 1 -- 172.21.15.42:0/4275018744 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c0005450 con 0x7f19d00b3550 2024-09-17T01:32:39.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.413+0000 7f19d5200640 1 -- 172.21.15.42:0/4275018744 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19d01f5ee0 con 0x7f19d00b3550 2024-09-17T01:32:39.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.413+0000 7f19d5200640 1 -- 172.21.15.42:0/4275018744 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19d01f64a0 con 0x7f19d00b3550 2024-09-17T01:32:39.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.414+0000 7f19d5200640 1 -- 172.21.15.42:0/4275018744 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19d015cec0 con 0x7f19d00b3550 2024-09-17T01:32:39.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.415+0000 7f19c6000640 1 -- 172.21.15.42:0/4275018744 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f19c00317c0 con 0x7f19d00b3550 2024-09-17T01:32:39.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.416+0000 7f19c6000640 1 --2- 172.21.15.42:0/4275018744 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f19ac078b90 0x7f19ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:39.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.416+0000 7f19c6000640 1 -- 172.21.15.42:0/4275018744 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f19c00bbed0 con 0x7f19d00b3550 2024-09-17T01:32:39.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.417+0000 7f19c7e00640 1 --2- 172.21.15.42:0/4275018744 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f19ac078b90 0x7f19ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:39.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.417+0000 7f19c7e00640 1 --2- 172.21.15.42:0/4275018744 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f19ac078b90 0x7f19ac07b0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f19d0159b30 tx=0x7f19b8009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:39.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.421+0000 7f19c6000640 1 -- 172.21.15.42:0/4275018744 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f19c003f030 con 0x7f19d00b3550 2024-09-17T01:32:39.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.630+0000 7f19d5200640 1 -- 172.21.15.42:0/4275018744 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f19d006a170 con 0x7f19d00b3550 2024-09-17T01:32:39.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.631+0000 7f19c6000640 1 -- 172.21.15.42:0/4275018744 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f19c00841f0 con 0x7f19d00b3550 2024-09-17T01:32:39.691 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-17T01:32:39.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.633+0000 7f19d5200640 1 -- 172.21.15.42:0/4275018744 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f19ac078b90 msgr2=0x7f19ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:39.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.633+0000 7f19d5200640 1 --2- 172.21.15.42:0/4275018744 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f19ac078b90 0x7f19ac07b0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f19d0159b30 tx=0x7f19b8009040 comp rx=0 tx=0).stop 2024-09-17T01:32:39.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.633+0000 7f19d5200640 1 -- 172.21.15.42:0/4275018744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19d00b3550 msgr2=0x7f19d0141a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:39.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.633+0000 7f19d5200640 1 --2- 172.21.15.42:0/4275018744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19d00b3550 0x7f19d0141a60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009950 tx=0x7f19c0003c10 comp rx=0 tx=0).stop 2024-09-17T01:32:39.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.633+0000 7f19d5200640 1 -- 172.21.15.42:0/4275018744 shutdown_connections 2024-09-17T01:32:39.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.633+0000 7f19d5200640 1 --2- 172.21.15.42:0/4275018744 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f19ac078b90 0x7f19ac07b0a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:39.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.633+0000 7f19d5200640 1 --2- 172.21.15.42:0/4275018744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19d0142f40 0x7f19d006f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:39.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.633+0000 7f19d5200640 1 --2- 172.21.15.42:0/4275018744 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f19d00cec40 0x7f19d013f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:39.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.633+0000 7f19d5200640 1 --2- 172.21.15.42:0/4275018744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19d00b3550 0x7f19d0141a60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:39.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.633+0000 7f19d5200640 1 -- 172.21.15.42:0/4275018744 >> 172.21.15.42:0/4275018744 conn(0x7f19d00b2930 msgr2=0x7f19d01425a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:39.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.634+0000 7f19d5200640 1 -- 172.21.15.42:0/4275018744 shutdown_connections 2024-09-17T01:32:39.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:39.634+0000 7f19d5200640 1 -- 172.21.15.42:0/4275018744 wait complete. 2024-09-17T01:32:39.693 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-17T01:32:39.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:39.693 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-17T01:32:39.753 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:32:39.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:39.753 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-17T01:32:39.790 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:32:39.790 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:32:39.830 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:32:39.830 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:32:39.908 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:32:39.908 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:32:39.986 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T01:32:40.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.216+0000 7f718d000640 1 -- 172.21.15.42:0/4122616212 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f718806d260 msgr2=0x7f7188152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:40.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.216+0000 7f718d000640 1 --2- 172.21.15.42:0/4122616212 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f718806d260 0x7f7188152ed0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f71880ccaf0 tx=0x7f718002aa30 comp rx=0 tx=0).stop 2024-09-17T01:32:40.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.216+0000 7f718d000640 1 -- 172.21.15.42:0/4122616212 shutdown_connections 2024-09-17T01:32:40.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.216+0000 7f718d000640 1 --2- 172.21.15.42:0/4122616212 >> v2:172.21.15.43:3300/0 conn(0x7f71880cf7c0 0x7f718806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:40.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.216+0000 7f718d000640 1 --2- 172.21.15.42:0/4122616212 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f718806d260 0x7f7188152ed0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:40.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.216+0000 7f718d000640 1 --2- 172.21.15.42:0/4122616212 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f71880b4be0 0x7f718815d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:40.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.216+0000 7f718d000640 1 -- 172.21.15.42:0/4122616212 >> 172.21.15.42:0/4122616212 conn(0x7f71880b25f0 msgr2=0x7f71880d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:40.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.216+0000 7f718d000640 1 -- 172.21.15.42:0/4122616212 shutdown_connections 2024-09-17T01:32:40.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.216+0000 7f718d000640 1 -- 172.21.15.42:0/4122616212 wait complete. 2024-09-17T01:32:40.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.218+0000 7f718d000640 1 Processor -- start 2024-09-17T01:32:40.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.218+0000 7f718d000640 1 -- start start 2024-09-17T01:32:40.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.220+0000 7f718d000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f718806d260 0x7f7188145e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:40.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.220+0000 7f718d000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71880b4be0 0x7f71881440b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:40.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.220+0000 7f718d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71880cf7c0 0x7f7188148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:40.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.220+0000 7f718d000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f71881537a0 con 0x7f71880cf7c0 2024-09-17T01:32:40.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.220+0000 7f718d000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7188153620 con 0x7f71880b4be0 2024-09-17T01:32:40.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.220+0000 7f718d000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7188153920 con 0x7f718806d260 2024-09-17T01:32:40.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.220+0000 7f7187e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71880cf7c0 0x7f7188148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:40.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.220+0000 7f7187e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71880cf7c0 0x7f7188148050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46366/0 (socket says 172.21.15.42:46366) 2024-09-17T01:32:40.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.220+0000 7f7187e00640 1 -- 172.21.15.42:0/1762327262 learned_addr learned my addr 172.21.15.42:0/1762327262 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:40.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.220+0000 7f7187400640 1 --2- 172.21.15.42:0/1762327262 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f718806d260 0x7f7188145e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:40.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.220+0000 7f717fe00640 1 --2- 172.21.15.42:0/1762327262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71880b4be0 0x7f71881440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:40.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.221+0000 7f7187e00640 1 -- 172.21.15.42:0/1762327262 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f718806d260 msgr2=0x7f7188145e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:40.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.221+0000 7f7187e00640 1 --2- 172.21.15.42:0/1762327262 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f718806d260 0x7f7188145e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:40.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.221+0000 7f7187e00640 1 -- 172.21.15.42:0/1762327262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71880b4be0 msgr2=0x7f71881440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:40.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.221+0000 7f7187e00640 1 --2- 172.21.15.42:0/1762327262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71880b4be0 0x7f71881440b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:40.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.221+0000 7f7187e00640 1 -- 172.21.15.42:0/1762327262 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7188143010 con 0x7f71880cf7c0 2024-09-17T01:32:40.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.221+0000 7f7187e00640 1 --2- 172.21.15.42:0/1762327262 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71880cf7c0 0x7f7188148050 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7180009d60 tx=0x7f7180003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:40.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.221+0000 7f717f400640 1 -- 172.21.15.42:0/1762327262 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7180033050 con 0x7f71880cf7c0 2024-09-17T01:32:40.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.221+0000 7f717f400640 1 -- 172.21.15.42:0/1762327262 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7180004450 con 0x7f71880cf7c0 2024-09-17T01:32:40.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.221+0000 7f717f400640 1 -- 172.21.15.42:0/1762327262 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7180038450 con 0x7f71880cf7c0 2024-09-17T01:32:40.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.221+0000 7f718d000640 1 -- 172.21.15.42:0/1762327262 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71881432f0 con 0x7f71880cf7c0 2024-09-17T01:32:40.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.221+0000 7f718d000640 1 -- 172.21.15.42:0/1762327262 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71881438b0 con 0x7f71880cf7c0 2024-09-17T01:32:40.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.222+0000 7f718d000640 1 -- 172.21.15.42:0/1762327262 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7188142d80 con 0x7f71880cf7c0 2024-09-17T01:32:40.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.224+0000 7f717f400640 1 -- 172.21.15.42:0/1762327262 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7180036070 con 0x7f71880cf7c0 2024-09-17T01:32:40.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.225+0000 7f717f400640 1 --2- 172.21.15.42:0/1762327262 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7164078b90 0x7f716407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:40.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.225+0000 7f717f400640 1 -- 172.21.15.42:0/1762327262 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f71800bc080 con 0x7f71880cf7c0 2024-09-17T01:32:40.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.226+0000 7f7187400640 1 --2- 172.21.15.42:0/1762327262 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7164078b90 0x7f716407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:40.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.226+0000 7f7187400640 1 --2- 172.21.15.42:0/1762327262 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7164078b90 0x7f716407b0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7178009ab0 tx=0x7f7178005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:40.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.230+0000 7f717f400640 1 -- 172.21.15.42:0/1762327262 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7180083e70 con 0x7f71880cf7c0 2024-09-17T01:32:40.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.435+0000 7f718d000640 1 -- 172.21.15.42:0/1762327262 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7188069870 con 0x7f71880cf7c0 2024-09-17T01:32:40.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.436+0000 7f717f400640 1 -- 172.21.15.42:0/1762327262 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f71800888a0 con 0x7f71880cf7c0 2024-09-17T01:32:40.434 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-17T01:32:40.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.438+0000 7f718d000640 1 -- 172.21.15.42:0/1762327262 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7164078b90 msgr2=0x7f716407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:40.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.438+0000 7f718d000640 1 --2- 172.21.15.42:0/1762327262 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7164078b90 0x7f716407b0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7178009ab0 tx=0x7f7178005f90 comp rx=0 tx=0).stop 2024-09-17T01:32:40.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.438+0000 7f718d000640 1 -- 172.21.15.42:0/1762327262 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71880cf7c0 msgr2=0x7f7188148050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:40.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.438+0000 7f718d000640 1 --2- 172.21.15.42:0/1762327262 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71880cf7c0 0x7f7188148050 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7180009d60 tx=0x7f7180003f10 comp rx=0 tx=0).stop 2024-09-17T01:32:40.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.438+0000 7f718d000640 1 -- 172.21.15.42:0/1762327262 shutdown_connections 2024-09-17T01:32:40.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.438+0000 7f718d000640 1 --2- 172.21.15.42:0/1762327262 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7164078b90 0x7f716407b0a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:40.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.438+0000 7f718d000640 1 --2- 172.21.15.42:0/1762327262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71880b4be0 0x7f71881440b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:40.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.438+0000 7f718d000640 1 --2- 172.21.15.42:0/1762327262 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71880cf7c0 0x7f7188148050 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:40.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.438+0000 7f718d000640 1 --2- 172.21.15.42:0/1762327262 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f718806d260 0x7f7188145e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:40.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.438+0000 7f718d000640 1 -- 172.21.15.42:0/1762327262 >> 172.21.15.42:0/1762327262 conn(0x7f71880b25f0 msgr2=0x7f71880b06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:40.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.438+0000 7f718d000640 1 -- 172.21.15.42:0/1762327262 shutdown_connections 2024-09-17T01:32:40.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.438+0000 7f718d000640 1 -- 172.21.15.42:0/1762327262 wait complete. 2024-09-17T01:32:40.458 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-17T01:32:40.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:40.458 DEBUG:teuthology.orchestra.run.smithi043:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-17T01:32:40.525 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T01:32:40.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:32:40.525 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-17T01:32:40.563 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T01:32:40.563 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:32:40.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.791+0000 7f91b9800640 1 -- 172.21.15.42:0/3492281315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91b40b3550 msgr2=0x7f91b415cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:40.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.791+0000 7f91b9800640 1 --2- 172.21.15.42:0/3492281315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91b40b3550 0x7f91b415cec0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f91a4009830 tx=0x7f91a402a480 comp rx=0 tx=0).stop 2024-09-17T01:32:40.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.791+0000 7f91b9800640 1 -- 172.21.15.42:0/3492281315 shutdown_connections 2024-09-17T01:32:40.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.791+0000 7f91b9800640 1 --2- 172.21.15.42:0/3492281315 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91b4142f40 0x7f91b4072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:40.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.791+0000 7f91b9800640 1 --2- 172.21.15.42:0/3492281315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91b40b3550 0x7f91b415cec0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:40.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.791+0000 7f91b9800640 1 -- 172.21.15.42:0/3492281315 >> 172.21.15.42:0/3492281315 conn(0x7f91b40b2930 msgr2=0x7f91b406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:40.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.791+0000 7f91b9800640 1 -- 172.21.15.42:0/3492281315 shutdown_connections 2024-09-17T01:32:40.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.791+0000 7f91b9800640 1 -- 172.21.15.42:0/3492281315 wait complete. 2024-09-17T01:32:40.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.793+0000 7f91b9800640 1 Processor -- start 2024-09-17T01:32:40.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.793+0000 7f91b9800640 1 -- start start 2024-09-17T01:32:40.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.795+0000 7f91b9800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91b4072e90 0x7f91b40ab510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:40.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.795+0000 7f91b9800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91b40b3550 0x7f91b4159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:40.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.795+0000 7f91b9800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91b4142f40 0x7f91b4159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:40.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.795+0000 7f91b9800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f91b406d7c0 con 0x7f91b4072e90 2024-09-17T01:32:40.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.795+0000 7f91b9800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f91b406d640 con 0x7f91b40b3550 2024-09-17T01:32:40.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.795+0000 7f91b9800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f91b406d940 con 0x7f91b4142f40 2024-09-17T01:32:40.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.795+0000 7f91b2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91b4072e90 0x7f91b40ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:40.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.795+0000 7f91b2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91b4072e90 0x7f91b40ab510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46380/0 (socket says 172.21.15.42:46380) 2024-09-17T01:32:40.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.795+0000 7f91b2a00640 1 -- 172.21.15.42:0/4090120510 learned_addr learned my addr 172.21.15.42:0/4090120510 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:40.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.795+0000 7f91abe00640 1 --2- 172.21.15.42:0/4090120510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91b40b3550 0x7f91b4159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:40.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.795+0000 7f91b3400640 1 --2- 172.21.15.42:0/4090120510 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91b4142f40 0x7f91b4159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:40.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.796+0000 7f91b2a00640 1 -- 172.21.15.42:0/4090120510 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91b4142f40 msgr2=0x7f91b4159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:40.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.796+0000 7f91b2a00640 1 --2- 172.21.15.42:0/4090120510 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91b4142f40 0x7f91b4159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:40.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.796+0000 7f91b2a00640 1 -- 172.21.15.42:0/4090120510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91b40b3550 msgr2=0x7f91b4159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:40.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.796+0000 7f91b2a00640 1 --2- 172.21.15.42:0/4090120510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91b40b3550 0x7f91b4159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:40.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.796+0000 7f91b2a00640 1 -- 172.21.15.42:0/4090120510 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b41f3780 con 0x7f91b4072e90 2024-09-17T01:32:40.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.796+0000 7f91abe00640 1 --2- 172.21.15.42:0/4090120510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91b40b3550 0x7f91b4159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:40.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.796+0000 7f91b2a00640 1 --2- 172.21.15.42:0/4090120510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91b4072e90 0x7f91b40ab510 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f91a4009950 tx=0x7f91a4033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:40.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.796+0000 7f91aaa00640 1 -- 172.21.15.42:0/4090120510 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a4005c90 con 0x7f91b4072e90 2024-09-17T01:32:40.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.796+0000 7f91aaa00640 1 -- 172.21.15.42:0/4090120510 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91a4031e50 con 0x7f91b4072e90 2024-09-17T01:32:40.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.796+0000 7f91b9800640 1 -- 172.21.15.42:0/4090120510 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b41f3a20 con 0x7f91b4072e90 2024-09-17T01:32:40.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.796+0000 7f91aaa00640 1 -- 172.21.15.42:0/4090120510 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a40332f0 con 0x7f91b4072e90 2024-09-17T01:32:40.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.796+0000 7f91b9800640 1 -- 172.21.15.42:0/4090120510 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b41586b0 con 0x7f91b4072e90 2024-09-17T01:32:40.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.798+0000 7f91b9800640 1 -- 172.21.15.42:0/4090120510 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91b415cec0 con 0x7f91b4072e90 2024-09-17T01:32:40.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.799+0000 7f91aaa00640 1 -- 172.21.15.42:0/4090120510 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f91a4033490 con 0x7f91b4072e90 2024-09-17T01:32:40.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.800+0000 7f91aaa00640 1 --2- 172.21.15.42:0/4090120510 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9190078b90 0x7f919007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:40.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.800+0000 7f91aaa00640 1 -- 172.21.15.42:0/4090120510 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f91a40bc200 con 0x7f91b4072e90 2024-09-17T01:32:40.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.800+0000 7f91abe00640 1 --2- 172.21.15.42:0/4090120510 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9190078b90 0x7f919007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:40.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.801+0000 7f91abe00640 1 --2- 172.21.15.42:0/4090120510 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9190078b90 0x7f919007b0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f91b41594c0 tx=0x7f919c005f10 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:40.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:40.804+0000 7f91aaa00640 1 -- 172.21.15.42:0/4090120510 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f91a403f030 con 0x7f91b4072e90 2024-09-17T01:32:41.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.037+0000 7f91b9800640 1 -- 172.21.15.42:0/4090120510 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91b406a170 con 0x7f91b4072e90 2024-09-17T01:32:41.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.037+0000 7f91aaa00640 1 -- 172.21.15.42:0/4090120510 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5217 (secure 0 0 0) 0x7f91a4084640 con 0x7f91b4072e90 2024-09-17T01:32:41.035 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:41.036 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":8,"btime":"2024-09-17T01:32:10:080773+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4301,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1899287597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1899287597},{"type":"v1","addr":"172.21.15.43:6836","nonce":1899287597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4359,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3422946855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3422946855},{"type":"v1","addr":"172.21.15.42:6835","nonce":3422946855}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4363,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1971042705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1971042705},{"type":"v1","addr":"172.21.15.42:6833","nonce":1971042705}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:32:06.566519+0000","modified":"2024-09-17T01:32:09.589828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/3707512090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3707512090},{"type":"v1","addr":"172.21.15.43:6837","nonce":3707512090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4365,"qdb_cluster":[4365]},"id":1}]} 2024-09-17T01:32:41.036 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 8 2024-09-17T01:32:41.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.040+0000 7f91b9800640 1 -- 172.21.15.42:0/4090120510 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9190078b90 msgr2=0x7f919007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:41.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.040+0000 7f91b9800640 1 --2- 172.21.15.42:0/4090120510 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9190078b90 0x7f919007b0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f91b41594c0 tx=0x7f919c005f10 comp rx=0 tx=0).stop 2024-09-17T01:32:41.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.040+0000 7f91b9800640 1 -- 172.21.15.42:0/4090120510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91b4072e90 msgr2=0x7f91b40ab510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:41.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.040+0000 7f91b9800640 1 --2- 172.21.15.42:0/4090120510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91b4072e90 0x7f91b40ab510 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f91a4009950 tx=0x7f91a4033c90 comp rx=0 tx=0).stop 2024-09-17T01:32:41.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.040+0000 7f91b9800640 1 -- 172.21.15.42:0/4090120510 shutdown_connections 2024-09-17T01:32:41.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.040+0000 7f91b9800640 1 --2- 172.21.15.42:0/4090120510 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9190078b90 0x7f919007b0a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:41.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.040+0000 7f91b9800640 1 --2- 172.21.15.42:0/4090120510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91b40b3550 0x7f91b4159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:41.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.040+0000 7f91b9800640 1 --2- 172.21.15.42:0/4090120510 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91b4142f40 0x7f91b4159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:41.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.040+0000 7f91b9800640 1 --2- 172.21.15.42:0/4090120510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91b4072e90 0x7f91b40ab510 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:41.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.040+0000 7f91b9800640 1 -- 172.21.15.42:0/4090120510 >> 172.21.15.42:0/4090120510 conn(0x7f91b40b2930 msgr2=0x7f91b4160440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:41.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.040+0000 7f91b9800640 1 -- 172.21.15.42:0/4090120510 shutdown_connections 2024-09-17T01:32:41.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.040+0000 7f91b9800640 1 -- 172.21.15.42:0/4090120510 wait complete. 2024-09-17T01:32:41.059 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:32:41.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.290+0000 7fe3a8000640 1 -- 172.21.15.42:0/2099000817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe388003a30 msgr2=0x7fe388003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:41.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.290+0000 7fe3a8000640 1 --2- 172.21.15.42:0/2099000817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe388003a30 0x7fe388003ea0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe3940016c0 tx=0x7fe388005830 comp rx=0 tx=0).stop 2024-09-17T01:32:41.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.290+0000 7fe3a6000640 1 -- 172.21.15.42:0/2099000817 reap_dead start 2024-09-17T01:32:41.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.290+0000 7fe3a8000640 1 -- 172.21.15.42:0/2099000817 shutdown_connections 2024-09-17T01:32:41.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.290+0000 7fe3a8000640 1 -- 172.21.15.42:0/2099000817 >> 172.21.15.42:0/2099000817 conn(0x7fe3a00b2930 msgr2=0x7fe3a006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:41.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.290+0000 7fe3a8000640 1 -- 172.21.15.42:0/2099000817 shutdown_connections 2024-09-17T01:32:41.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.290+0000 7fe3a8000640 1 -- 172.21.15.42:0/2099000817 wait complete. 2024-09-17T01:32:41.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.293+0000 7fe3a8000640 1 Processor -- start 2024-09-17T01:32:41.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.293+0000 7fe3a8000640 1 -- start start 2024-09-17T01:32:41.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.294+0000 7fe3a8000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe388003a30 0x7fe3a01e7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:41.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.294+0000 7fe3a8000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3a0155c30 0x7fe3a0155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:41.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.294+0000 7fe3a8000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe3a015e360 0x7fe3a015e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:41.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.294+0000 7fe3a8000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a00737e0 con 0x7fe3a0155c30 2024-09-17T01:32:41.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.294+0000 7fe3a8000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a0073660 con 0x7fe388003a30 2024-09-17T01:32:41.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.294+0000 7fe3a8000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe3a0073960 con 0x7fe3a015e360 2024-09-17T01:32:41.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.295+0000 7fe3a4c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3a0155c30 0x7fe3a0155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:41.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.295+0000 7fe3a4c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3a0155c30 0x7fe3a0155420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46402/0 (socket says 172.21.15.42:46402) 2024-09-17T01:32:41.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.295+0000 7fe3a4c00640 1 -- 172.21.15.42:0/3948999886 learned_addr learned my addr 172.21.15.42:0/3948999886 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:41.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.295+0000 7fe3a5600640 1 --2- 172.21.15.42:0/3948999886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe388003a30 0x7fe3a01e7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:41.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.295+0000 7fe3a6000640 1 --2- 172.21.15.42:0/3948999886 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe3a015e360 0x7fe3a015e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:41.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.295+0000 7fe3a4c00640 1 -- 172.21.15.42:0/3948999886 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe3a015e360 msgr2=0x7fe3a015e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:41.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.295+0000 7fe3a4c00640 1 --2- 172.21.15.42:0/3948999886 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe3a015e360 0x7fe3a015e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:41.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.295+0000 7fe3a4c00640 1 -- 172.21.15.42:0/3948999886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe388003a30 msgr2=0x7fe3a01e7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:41.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.295+0000 7fe3a4c00640 1 --2- 172.21.15.42:0/3948999886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe388003a30 0x7fe3a01e7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:41.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.295+0000 7fe3a4c00640 1 -- 172.21.15.42:0/3948999886 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a01564d0 con 0x7fe3a0155c30 2024-09-17T01:32:41.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.295+0000 7fe3a6000640 1 --2- 172.21.15.42:0/3948999886 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe3a015e360 0x7fe3a015e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:41.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.296+0000 7fe3a4c00640 1 --2- 172.21.15.42:0/3948999886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3a0155c30 0x7fe3a0155420 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe38c006680 tx=0x7fe38c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:41.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.296+0000 7fe39d600640 1 -- 172.21.15.42:0/3948999886 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c011700 con 0x7fe3a0155c30 2024-09-17T01:32:41.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.296+0000 7fe39d600640 1 -- 172.21.15.42:0/3948999886 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe38c016020 con 0x7fe3a0155c30 2024-09-17T01:32:41.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.296+0000 7fe3a8000640 1 -- 172.21.15.42:0/3948999886 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a015ecb0 con 0x7fe3a0155c30 2024-09-17T01:32:41.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.296+0000 7fe39d600640 1 -- 172.21.15.42:0/3948999886 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c011b20 con 0x7fe3a0155c30 2024-09-17T01:32:41.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.296+0000 7fe3a8000640 1 -- 172.21.15.42:0/3948999886 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a01e6ce0 con 0x7fe3a0155c30 2024-09-17T01:32:41.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.297+0000 7fe3a8000640 1 -- 172.21.15.42:0/3948999886 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3a0160f10 con 0x7fe3a0155c30 2024-09-17T01:32:41.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.298+0000 7fe39d600640 1 -- 172.21.15.42:0/3948999886 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe38c011cc0 con 0x7fe3a0155c30 2024-09-17T01:32:41.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.300+0000 7fe39d600640 1 --2- 172.21.15.42:0/3948999886 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe380078b90 0x7fe38007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:41.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.300+0000 7fe39d600640 1 -- 172.21.15.42:0/3948999886 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe38c09b760 con 0x7fe3a0155c30 2024-09-17T01:32:41.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.301+0000 7fe3a5600640 1 --2- 172.21.15.42:0/3948999886 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe380078b90 0x7fe38007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:41.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.301+0000 7fe3a5600640 1 --2- 172.21.15.42:0/3948999886 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe380078b90 0x7fe38007b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe394032000 tx=0x7fe39402c040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:41.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.304+0000 7fe39d600640 1 -- 172.21.15.42:0/3948999886 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe3a0160f10 con 0x7fe3a0155c30 2024-09-17T01:32:41.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.538+0000 7fe3a8000640 1 -- 172.21.15.42:0/3948999886 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3a01e6790 con 0x7fe3a0155c30 2024-09-17T01:32:41.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.538+0000 7fe39d600640 1 -- 172.21.15.42:0/3948999886 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5217 (secure 0 0 0) 0x7fe38c020020 con 0x7fe3a0155c30 2024-09-17T01:32:41.536 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:41.536 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":8,"btime":"2024-09-17T01:32:10:080773+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4301,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1899287597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1899287597},{"type":"v1","addr":"172.21.15.43:6836","nonce":1899287597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4359,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3422946855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3422946855},{"type":"v1","addr":"172.21.15.42:6835","nonce":3422946855}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4363,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1971042705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1971042705},{"type":"v1","addr":"172.21.15.42:6833","nonce":1971042705}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:32:06.566519+0000","modified":"2024-09-17T01:32:09.589828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/3707512090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3707512090},{"type":"v1","addr":"172.21.15.43:6837","nonce":3707512090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4365,"qdb_cluster":[4365]},"id":1}]} 2024-09-17T01:32:41.537 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 8 2024-09-17T01:32:41.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.541+0000 7fe3a8000640 1 -- 172.21.15.42:0/3948999886 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe380078b90 msgr2=0x7fe38007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:41.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.541+0000 7fe3a8000640 1 --2- 172.21.15.42:0/3948999886 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe380078b90 0x7fe38007b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe394032000 tx=0x7fe39402c040 comp rx=0 tx=0).stop 2024-09-17T01:32:41.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.541+0000 7fe3a8000640 1 -- 172.21.15.42:0/3948999886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3a0155c30 msgr2=0x7fe3a0155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:41.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.541+0000 7fe3a8000640 1 --2- 172.21.15.42:0/3948999886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3a0155c30 0x7fe3a0155420 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe38c006680 tx=0x7fe38c0039c0 comp rx=0 tx=0).stop 2024-09-17T01:32:41.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.541+0000 7fe3a8000640 1 -- 172.21.15.42:0/3948999886 shutdown_connections 2024-09-17T01:32:41.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.541+0000 7fe3a8000640 1 --2- 172.21.15.42:0/3948999886 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe380078b90 0x7fe38007b0a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:41.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.541+0000 7fe3a8000640 1 --2- 172.21.15.42:0/3948999886 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe3a015e360 0x7fe3a015e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:41.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.541+0000 7fe3a8000640 1 --2- 172.21.15.42:0/3948999886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3a0155c30 0x7fe3a0155420 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:41.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.541+0000 7fe3a8000640 1 --2- 172.21.15.42:0/3948999886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe388003a30 0x7fe3a01e7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:41.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.541+0000 7fe3a8000640 1 -- 172.21.15.42:0/3948999886 >> 172.21.15.42:0/3948999886 conn(0x7fe3a00b2930 msgr2=0x7fe3a015c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:41.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.541+0000 7fe3a8000640 1 -- 172.21.15.42:0/3948999886 shutdown_connections 2024-09-17T01:32:41.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.541+0000 7fe3a8000640 1 -- 172.21.15.42:0/3948999886 wait complete. 2024-09-17T01:32:41.565 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:32:41.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.794+0000 7fba81200640 1 -- 172.21.15.42:0/1067504509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba7c0b2260 msgr2=0x7fba7c1605b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:41.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.794+0000 7fba81200640 1 --2- 172.21.15.42:0/1067504509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba7c0b2260 0x7fba7c1605b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fba74005fd0 tx=0x7fba7402aa90 comp rx=0 tx=0).stop 2024-09-17T01:32:41.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.794+0000 7fba81200640 1 -- 172.21.15.42:0/1067504509 shutdown_connections 2024-09-17T01:32:41.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.794+0000 7fba81200640 1 --2- 172.21.15.42:0/1067504509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba7c0b2260 0x7fba7c1605b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:41.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.794+0000 7fba81200640 1 --2- 172.21.15.42:0/1067504509 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba7c0b0e80 0x7fba7c0b4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:41.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.794+0000 7fba81200640 1 -- 172.21.15.42:0/1067504509 >> 172.21.15.42:0/1067504509 conn(0x7fba7c0b7990 msgr2=0x7fba7c0b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:41.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.794+0000 7fba81200640 1 -- 172.21.15.42:0/1067504509 shutdown_connections 2024-09-17T01:32:41.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.794+0000 7fba81200640 1 -- 172.21.15.42:0/1067504509 wait complete. 2024-09-17T01:32:41.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.797+0000 7fba81200640 1 Processor -- start 2024-09-17T01:32:41.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.797+0000 7fba81200640 1 -- start start 2024-09-17T01:32:41.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.798+0000 7fba81200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba7c0b0e80 0x7fba7c155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:41.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.798+0000 7fba81200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba7c0b2260 0x7fba7c15f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:41.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.798+0000 7fba81200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba7c15cb80 0x7fba7c15f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:41.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.798+0000 7fba81200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fba7c160c70 con 0x7fba7c0b2260 2024-09-17T01:32:41.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.798+0000 7fba81200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fba7c160af0 con 0x7fba7c15cb80 2024-09-17T01:32:41.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.798+0000 7fba81200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fba7c160df0 con 0x7fba7c0b0e80 2024-09-17T01:32:41.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.798+0000 7fba73e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba7c0b2260 0x7fba7c15f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:41.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.798+0000 7fba73e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba7c0b2260 0x7fba7c15f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46406/0 (socket says 172.21.15.42:46406) 2024-09-17T01:32:41.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.798+0000 7fba73e00640 1 -- 172.21.15.42:0/4153155680 learned_addr learned my addr 172.21.15.42:0/4153155680 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:41.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.798+0000 7fba79e00640 1 --2- 172.21.15.42:0/4153155680 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba7c0b0e80 0x7fba7c155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:41.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.799+0000 7fba7a800640 1 --2- 172.21.15.42:0/4153155680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba7c15cb80 0x7fba7c15f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:41.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.799+0000 7fba73e00640 1 -- 172.21.15.42:0/4153155680 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba7c0b0e80 msgr2=0x7fba7c155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:41.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.799+0000 7fba73e00640 1 --2- 172.21.15.42:0/4153155680 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba7c0b0e80 0x7fba7c155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:41.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.799+0000 7fba73e00640 1 -- 172.21.15.42:0/4153155680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba7c15cb80 msgr2=0x7fba7c15f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:41.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.799+0000 7fba73e00640 1 --2- 172.21.15.42:0/4153155680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba7c15cb80 0x7fba7c15f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:41.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.799+0000 7fba73e00640 1 -- 172.21.15.42:0/4153155680 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba7c15d230 con 0x7fba7c0b2260 2024-09-17T01:32:41.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.799+0000 7fba73e00640 1 --2- 172.21.15.42:0/4153155680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba7c0b2260 0x7fba7c15f250 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fba6400e7c0 tx=0x7fba6400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:41.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.799+0000 7fba72000640 1 -- 172.21.15.42:0/4153155680 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6400ccc0 con 0x7fba7c0b2260 2024-09-17T01:32:41.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.800+0000 7fba72000640 1 -- 172.21.15.42:0/4153155680 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba64010430 con 0x7fba7c0b2260 2024-09-17T01:32:41.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.800+0000 7fba81200640 1 -- 172.21.15.42:0/4153155680 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba7c15d510 con 0x7fba7c0b2260 2024-09-17T01:32:41.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.800+0000 7fba72000640 1 -- 172.21.15.42:0/4153155680 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba64010860 con 0x7fba7c0b2260 2024-09-17T01:32:41.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.800+0000 7fba81200640 1 -- 172.21.15.42:0/4153155680 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba7c0d18b0 con 0x7fba7c0b2260 2024-09-17T01:32:41.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.801+0000 7fba81200640 1 -- 172.21.15.42:0/4153155680 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba7c0b1b30 con 0x7fba7c0b2260 2024-09-17T01:32:41.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.802+0000 7fba72000640 1 -- 172.21.15.42:0/4153155680 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fba64010a00 con 0x7fba7c0b2260 2024-09-17T01:32:41.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.803+0000 7fba72000640 1 --2- 172.21.15.42:0/4153155680 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fba58078b90 0x7fba5807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:41.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.803+0000 7fba72000640 1 -- 172.21.15.42:0/4153155680 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fba6409b6b0 con 0x7fba7c0b2260 2024-09-17T01:32:41.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.804+0000 7fba79e00640 1 --2- 172.21.15.42:0/4153155680 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fba58078b90 0x7fba5807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:41.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.804+0000 7fba79e00640 1 --2- 172.21.15.42:0/4153155680 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fba58078b90 0x7fba5807b0a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fba6c000f60 tx=0x7fba6c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:41.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:41.807+0000 7fba72000640 1 -- 172.21.15.42:0/4153155680 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fba7c0b1b30 con 0x7fba7c0b2260 2024-09-17T01:32:41.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.001+0000 7fba81200640 1 -- 172.21.15.42:0/4153155680 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba7c161380 con 0x7fba7c0b2260 2024-09-17T01:32:42.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.003+0000 7fba72000640 1 -- 172.21.15.42:0/4153155680 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16621 (secure 0 0 0) 0x7fba6406c020 con 0x7fba7c0b2260 2024-09-17T01:32:42.001 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:42.001 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":22,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:32:08.067689+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:32:04.526150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T01:32:05.523607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:32:42.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.005+0000 7fba81200640 1 -- 172.21.15.42:0/4153155680 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fba58078b90 msgr2=0x7fba5807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:42.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.005+0000 7fba81200640 1 --2- 172.21.15.42:0/4153155680 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fba58078b90 0x7fba5807b0a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fba6c000f60 tx=0x7fba6c009040 comp rx=0 tx=0).stop 2024-09-17T01:32:42.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.005+0000 7fba81200640 1 -- 172.21.15.42:0/4153155680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba7c0b2260 msgr2=0x7fba7c15f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:42.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.005+0000 7fba81200640 1 --2- 172.21.15.42:0/4153155680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba7c0b2260 0x7fba7c15f250 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fba6400e7c0 tx=0x7fba6400ec80 comp rx=0 tx=0).stop 2024-09-17T01:32:42.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.005+0000 7fba81200640 1 -- 172.21.15.42:0/4153155680 shutdown_connections 2024-09-17T01:32:42.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.005+0000 7fba81200640 1 --2- 172.21.15.42:0/4153155680 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fba58078b90 0x7fba5807b0a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:42.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.005+0000 7fba81200640 1 --2- 172.21.15.42:0/4153155680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba7c15cb80 0x7fba7c15f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:42.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.005+0000 7fba81200640 1 --2- 172.21.15.42:0/4153155680 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba7c0b2260 0x7fba7c15f250 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:42.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.005+0000 7fba81200640 1 --2- 172.21.15.42:0/4153155680 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba7c0b0e80 0x7fba7c155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:42.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.005+0000 7fba81200640 1 -- 172.21.15.42:0/4153155680 >> 172.21.15.42:0/4153155680 conn(0x7fba7c0b7990 msgr2=0x7fba7c0706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:42.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.005+0000 7fba81200640 1 -- 172.21.15.42:0/4153155680 shutdown_connections 2024-09-17T01:32:42.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.006+0000 7fba81200640 1 -- 172.21.15.42:0/4153155680 wait complete. 2024-09-17T01:32:42.029 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T01:32:42.029 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:32:42.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.259+0000 7fe448000640 1 -- 172.21.15.42:0/3513561942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4400b5100 msgr2=0x7fe44015d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:42.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.259+0000 7fe448000640 1 --2- 172.21.15.42:0/3513561942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4400b5100 0x7fe44015d950 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe434009830 tx=0x7fe43402a540 comp rx=0 tx=0).stop 2024-09-17T01:32:42.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.259+0000 7fe448000640 1 -- 172.21.15.42:0/3513561942 shutdown_connections 2024-09-17T01:32:42.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.259+0000 7fe448000640 1 --2- 172.21.15.42:0/3513561942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4400b5100 0x7fe44015d950 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:42.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.259+0000 7fe448000640 1 -- 172.21.15.42:0/3513561942 >> 172.21.15.42:0/3513561942 conn(0x7fe4400b2930 msgr2=0x7fe44006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:42.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.259+0000 7fe448000640 1 -- 172.21.15.42:0/3513561942 shutdown_connections 2024-09-17T01:32:42.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.259+0000 7fe448000640 1 -- 172.21.15.42:0/3513561942 wait complete. 2024-09-17T01:32:42.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.261+0000 7fe448000640 1 Processor -- start 2024-09-17T01:32:42.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.261+0000 7fe448000640 1 -- start start 2024-09-17T01:32:42.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.263+0000 7fe448000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe44006d430 0x7fe44014faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:42.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.263+0000 7fe448000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4400b5100 0x7fe4401553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:42.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.263+0000 7fe448000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe4400cef70 0x7fe440155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:42.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.263+0000 7fe448000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe440073bd0 con 0x7fe4400b5100 2024-09-17T01:32:42.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.263+0000 7fe448000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe440073a50 con 0x7fe44006d430 2024-09-17T01:32:42.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.263+0000 7fe448000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe440073d50 con 0x7fe4400cef70 2024-09-17T01:32:42.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.263+0000 7fe444c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4400b5100 0x7fe4401553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:42.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.263+0000 7fe444c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4400b5100 0x7fe4401553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46424/0 (socket says 172.21.15.42:46424) 2024-09-17T01:32:42.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.263+0000 7fe444c00640 1 -- 172.21.15.42:0/2544354513 learned_addr learned my addr 172.21.15.42:0/2544354513 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:42.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.263+0000 7fe445600640 1 --2- 172.21.15.42:0/2544354513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe44006d430 0x7fe44014faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:42.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.264+0000 7fe446000640 1 --2- 172.21.15.42:0/2544354513 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe4400cef70 0x7fe440155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:42.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.264+0000 7fe444c00640 1 -- 172.21.15.42:0/2544354513 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe4400cef70 msgr2=0x7fe440155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:42.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.264+0000 7fe444c00640 1 --2- 172.21.15.42:0/2544354513 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe4400cef70 0x7fe440155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:42.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.264+0000 7fe444c00640 1 -- 172.21.15.42:0/2544354513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe44006d430 msgr2=0x7fe44014faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:42.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.264+0000 7fe444c00640 1 --2- 172.21.15.42:0/2544354513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe44006d430 0x7fe44014faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:42.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.264+0000 7fe444c00640 1 -- 172.21.15.42:0/2544354513 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe440154cf0 con 0x7fe4400b5100 2024-09-17T01:32:42.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.264+0000 7fe444c00640 1 --2- 172.21.15.42:0/2544354513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4400b5100 0x7fe4401553c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00c3c0 tx=0x7fe42c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:42.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.264+0000 7fe43d600640 1 -- 172.21.15.42:0/2544354513 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42c017070 con 0x7fe4400b5100 2024-09-17T01:32:42.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.264+0000 7fe43d600640 1 -- 172.21.15.42:0/2544354513 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe42c0035f0 con 0x7fe4400b5100 2024-09-17T01:32:42.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.264+0000 7fe43d600640 1 -- 172.21.15.42:0/2544354513 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42c003a40 con 0x7fe4400b5100 2024-09-17T01:32:42.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.264+0000 7fe448000640 1 -- 172.21.15.42:0/2544354513 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe440153c50 con 0x7fe4400b5100 2024-09-17T01:32:42.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.264+0000 7fe448000640 1 -- 172.21.15.42:0/2544354513 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe440154210 con 0x7fe4400b5100 2024-09-17T01:32:42.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.265+0000 7fe448000640 1 -- 172.21.15.42:0/2544354513 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe44015d730 con 0x7fe4400b5100 2024-09-17T01:32:42.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.267+0000 7fe43d600640 1 -- 172.21.15.42:0/2544354513 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe42c01a070 con 0x7fe4400b5100 2024-09-17T01:32:42.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.268+0000 7fe43d600640 1 --2- 172.21.15.42:0/2544354513 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe420078b90 0x7fe42007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:42.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.268+0000 7fe43d600640 1 -- 172.21.15.42:0/2544354513 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe42c099f00 con 0x7fe4400b5100 2024-09-17T01:32:42.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.268+0000 7fe445600640 1 --2- 172.21.15.42:0/2544354513 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe420078b90 0x7fe42007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:42.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.269+0000 7fe445600640 1 --2- 172.21.15.42:0/2544354513 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe420078b90 0x7fe42007b0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe434034000 tx=0x7fe434004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:42.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.272+0000 7fe43d600640 1 -- 172.21.15.42:0/2544354513 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe44015d730 con 0x7fe4400b5100 2024-09-17T01:32:42.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.503+0000 7fe448000640 1 -- 172.21.15.42:0/2544354513 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe44015d950 con 0x7fe4400b5100 2024-09-17T01:32:42.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.504+0000 7fe43d600640 1 -- 172.21.15.42:0/2544354513 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5217 (secure 0 0 0) 0x7fe44015de90 con 0x7fe4400b5100 2024-09-17T01:32:42.502 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:42.502 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":8,"btime":"2024-09-17T01:32:10:080773+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4301,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1899287597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1899287597},{"type":"v1","addr":"172.21.15.43:6836","nonce":1899287597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4359,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3422946855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3422946855},{"type":"v1","addr":"172.21.15.42:6835","nonce":3422946855}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4363,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1971042705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1971042705},{"type":"v1","addr":"172.21.15.42:6833","nonce":1971042705}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:32:06.566519+0000","modified":"2024-09-17T01:32:09.589828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/3707512090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3707512090},{"type":"v1","addr":"172.21.15.43:6837","nonce":3707512090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4365,"qdb_cluster":[4365]},"id":1}]} 2024-09-17T01:32:42.502 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 8 2024-09-17T01:32:42.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.506+0000 7fe448000640 1 -- 172.21.15.42:0/2544354513 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe420078b90 msgr2=0x7fe42007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:42.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.506+0000 7fe448000640 1 --2- 172.21.15.42:0/2544354513 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe420078b90 0x7fe42007b0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe434034000 tx=0x7fe434004730 comp rx=0 tx=0).stop 2024-09-17T01:32:42.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.506+0000 7fe448000640 1 -- 172.21.15.42:0/2544354513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4400b5100 msgr2=0x7fe4401553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:42.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.506+0000 7fe448000640 1 --2- 172.21.15.42:0/2544354513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4400b5100 0x7fe4401553c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00c3c0 tx=0x7fe42c00c880 comp rx=0 tx=0).stop 2024-09-17T01:32:42.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.507+0000 7fe448000640 1 -- 172.21.15.42:0/2544354513 shutdown_connections 2024-09-17T01:32:42.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.507+0000 7fe448000640 1 --2- 172.21.15.42:0/2544354513 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe420078b90 0x7fe42007b0a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:42.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.507+0000 7fe448000640 1 --2- 172.21.15.42:0/2544354513 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe4400cef70 0x7fe440155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:42.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.507+0000 7fe448000640 1 --2- 172.21.15.42:0/2544354513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4400b5100 0x7fe4401553c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:42.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.507+0000 7fe448000640 1 --2- 172.21.15.42:0/2544354513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe44006d430 0x7fe44014faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:42.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.507+0000 7fe448000640 1 -- 172.21.15.42:0/2544354513 >> 172.21.15.42:0/2544354513 conn(0x7fe4400b2930 msgr2=0x7fe440160350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:42.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.507+0000 7fe448000640 1 -- 172.21.15.42:0/2544354513 shutdown_connections 2024-09-17T01:32:42.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.507+0000 7fe448000640 1 -- 172.21.15.42:0/2544354513 wait complete. 2024-09-17T01:32:42.528 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:32:42.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.757+0000 7fe9bf200640 1 -- 172.21.15.42:0/2710922311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9c006dc20 msgr2=0x7fe9c0162430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:42.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.757+0000 7fe9bf200640 1 --2- 172.21.15.42:0/2710922311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9c006dc20 0x7fe9c0162430 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe9c00b0f30 tx=0x7fe9a802a560 comp rx=0 tx=0).stop 2024-09-17T01:32:42.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.757+0000 7fe9bf200640 1 -- 172.21.15.42:0/2710922311 shutdown_connections 2024-09-17T01:32:42.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.757+0000 7fe9bf200640 1 --2- 172.21.15.42:0/2710922311 >> v2:172.21.15.43:3300/0 conn(0x7fe9c0162970 0x7fe9c0068d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:42.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.757+0000 7fe9bf200640 1 --2- 172.21.15.42:0/2710922311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9c006dc20 0x7fe9c0162430 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:42.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.757+0000 7fe9bf200640 1 -- 172.21.15.42:0/2710922311 >> 172.21.15.42:0/2710922311 conn(0x7fe9c0073510 msgr2=0x7fe9c00b6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:42.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.757+0000 7fe9bf200640 1 -- 172.21.15.42:0/2710922311 shutdown_connections 2024-09-17T01:32:42.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.757+0000 7fe9bf200640 1 -- 172.21.15.42:0/2710922311 wait complete. 2024-09-17T01:32:42.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.759+0000 7fe9bf200640 1 Processor -- start 2024-09-17T01:32:42.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.760+0000 7fe9bf200640 1 -- start start 2024-09-17T01:32:42.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.761+0000 7fe9bf200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9c0155aa0 0x7fe9c01475a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:42.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.761+0000 7fe9bf200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe9c0162970 0x7fe9c01539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:42.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.761+0000 7fe9bf200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9c0153f00 0x7fe9c0154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:42.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.761+0000 7fe9bf200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c0069610 con 0x7fe9c0153f00 2024-09-17T01:32:42.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.761+0000 7fe9bf200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c0069490 con 0x7fe9c0155aa0 2024-09-17T01:32:42.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.761+0000 7fe9bf200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c0069790 con 0x7fe9c0162970 2024-09-17T01:32:42.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.761+0000 7fe9be800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9c0153f00 0x7fe9c0154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:42.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.761+0000 7fe9be800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9c0153f00 0x7fe9c0154310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46454/0 (socket says 172.21.15.42:46454) 2024-09-17T01:32:42.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.761+0000 7fe9be800640 1 -- 172.21.15.42:0/25216010 learned_addr learned my addr 172.21.15.42:0/25216010 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:42.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.762+0000 7fe9b5400640 1 --2- 172.21.15.42:0/25216010 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe9c0162970 0x7fe9c01539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:42.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.762+0000 7fe9bde00640 1 --2- 172.21.15.42:0/25216010 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9c0155aa0 0x7fe9c01475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:42.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.762+0000 7fe9be800640 1 -- 172.21.15.42:0/25216010 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe9c0162970 msgr2=0x7fe9c01539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:42.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.762+0000 7fe9be800640 1 --2- 172.21.15.42:0/25216010 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe9c0162970 0x7fe9c01539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:42.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.762+0000 7fe9be800640 1 -- 172.21.15.42:0/25216010 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9c0155aa0 msgr2=0x7fe9c01475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:42.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.762+0000 7fe9be800640 1 --2- 172.21.15.42:0/25216010 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9c0155aa0 0x7fe9c01475a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:42.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.762+0000 7fe9be800640 1 -- 172.21.15.42:0/25216010 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c0154850 con 0x7fe9c0153f00 2024-09-17T01:32:42.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.762+0000 7fe9bde00640 1 --2- 172.21.15.42:0/25216010 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9c0155aa0 0x7fe9c01475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:42.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.762+0000 7fe9be800640 1 --2- 172.21.15.42:0/25216010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9c0153f00 0x7fe9c0154310 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800ea80 tx=0x7fe9b800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:42.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.762+0000 7fe9b6a00640 1 -- 172.21.15.42:0/25216010 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8004b20 con 0x7fe9c0153f00 2024-09-17T01:32:42.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.763+0000 7fe9b6a00640 1 -- 172.21.15.42:0/25216010 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9b8004ce0 con 0x7fe9c0153f00 2024-09-17T01:32:42.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.763+0000 7fe9b6a00640 1 -- 172.21.15.42:0/25216010 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8005280 con 0x7fe9c0153f00 2024-09-17T01:32:42.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.763+0000 7fe9bf200640 1 -- 172.21.15.42:0/25216010 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c0155060 con 0x7fe9c0153f00 2024-09-17T01:32:42.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.763+0000 7fe9bf200640 1 -- 172.21.15.42:0/25216010 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c0155340 con 0x7fe9c0153f00 2024-09-17T01:32:42.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.764+0000 7fe9bf200640 1 -- 172.21.15.42:0/25216010 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c0162430 con 0x7fe9c0153f00 2024-09-17T01:32:42.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.765+0000 7fe9b6a00640 1 -- 172.21.15.42:0/25216010 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe9b8005420 con 0x7fe9c0153f00 2024-09-17T01:32:42.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.766+0000 7fe9b6a00640 1 --2- 172.21.15.42:0/25216010 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe99c078bc0 0x7fe99c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:42.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.766+0000 7fe9b6a00640 1 -- 172.21.15.42:0/25216010 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe9b809b930 con 0x7fe9c0153f00 2024-09-17T01:32:42.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.767+0000 7fe9bde00640 1 --2- 172.21.15.42:0/25216010 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe99c078bc0 0x7fe99c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:42.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.767+0000 7fe9bde00640 1 --2- 172.21.15.42:0/25216010 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe99c078bc0 0x7fe99c07b0d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0007fd0 tx=0x7fe9b0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:42.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:42.770+0000 7fe9b6a00640 1 -- 172.21.15.42:0/25216010 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe9b8063cd0 con 0x7fe9c0153f00 2024-09-17T01:32:42.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.000+0000 7fe9bf200640 1 -- 172.21.15.42:0/25216010 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9c00d1010 con 0x7fe9c0153f00 2024-09-17T01:32:42.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.001+0000 7fe9b6a00640 1 -- 172.21.15.42:0/25216010 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5217 (secure 0 0 0) 0x7fe9b80635d0 con 0x7fe9c0153f00 2024-09-17T01:32:42.999 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:42.999 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":8,"btime":"2024-09-17T01:32:10:080773+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4301,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1899287597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1899287597},{"type":"v1","addr":"172.21.15.43:6836","nonce":1899287597}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4359,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3422946855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3422946855},{"type":"v1","addr":"172.21.15.42:6835","nonce":3422946855}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4363,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1971042705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1971042705},{"type":"v1","addr":"172.21.15.42:6833","nonce":1971042705}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:32:06.566519+0000","modified":"2024-09-17T01:32:09.589828+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4365":{"gid":4365,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/3707512090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3707512090},{"type":"v1","addr":"172.21.15.43:6837","nonce":3707512090}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4365,"qdb_cluster":[4365]},"id":1}]} 2024-09-17T01:32:42.999 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 8 2024-09-17T01:32:43.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.004+0000 7fe9bf200640 1 -- 172.21.15.42:0/25216010 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe99c078bc0 msgr2=0x7fe99c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:43.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.004+0000 7fe9bf200640 1 --2- 172.21.15.42:0/25216010 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe99c078bc0 0x7fe99c07b0d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0007fd0 tx=0x7fe9b0009040 comp rx=0 tx=0).stop 2024-09-17T01:32:43.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.004+0000 7fe9bf200640 1 -- 172.21.15.42:0/25216010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9c0153f00 msgr2=0x7fe9c0154310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:43.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.004+0000 7fe9bf200640 1 --2- 172.21.15.42:0/25216010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9c0153f00 0x7fe9c0154310 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800ea80 tx=0x7fe9b800ef40 comp rx=0 tx=0).stop 2024-09-17T01:32:43.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.004+0000 7fe9bf200640 1 -- 172.21.15.42:0/25216010 shutdown_connections 2024-09-17T01:32:43.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.004+0000 7fe9bf200640 1 --2- 172.21.15.42:0/25216010 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe99c078bc0 0x7fe99c07b0d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:43.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.004+0000 7fe9bf200640 1 --2- 172.21.15.42:0/25216010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9c0153f00 0x7fe9c0154310 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:43.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.004+0000 7fe9bf200640 1 --2- 172.21.15.42:0/25216010 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe9c0162970 0x7fe9c01539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:43.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.004+0000 7fe9bf200640 1 --2- 172.21.15.42:0/25216010 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9c0155aa0 0x7fe9c01475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:43.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.004+0000 7fe9bf200640 1 -- 172.21.15.42:0/25216010 >> 172.21.15.42:0/25216010 conn(0x7fe9c0073510 msgr2=0x7fe9c0151fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:43.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.004+0000 7fe9bf200640 1 -- 172.21.15.42:0/25216010 shutdown_connections 2024-09-17T01:32:43.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.004+0000 7fe9bf200640 1 -- 172.21.15.42:0/25216010 wait complete. 2024-09-17T01:32:43.023 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:32:43.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.255+0000 7f6996400640 1 -- 172.21.15.42:0/486386293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6974003a00 msgr2=0x7f6974003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:43.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.255+0000 7f6996400640 1 --2- 172.21.15.42:0/486386293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6974003a00 0x7f6974003e70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f698000c4a0 tx=0x7f6974005830 comp rx=0 tx=0).stop 2024-09-17T01:32:43.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.255+0000 7f6995a00640 1 -- 172.21.15.42:0/486386293 reap_dead start 2024-09-17T01:32:43.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.255+0000 7f6996400640 1 -- 172.21.15.42:0/486386293 shutdown_connections 2024-09-17T01:32:43.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.255+0000 7f6996400640 1 -- 172.21.15.42:0/486386293 >> 172.21.15.42:0/486386293 conn(0x7f69900d1210 msgr2=0x7f69900d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:43.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.255+0000 7f6996400640 1 -- 172.21.15.42:0/486386293 shutdown_connections 2024-09-17T01:32:43.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.255+0000 7f6996400640 1 -- 172.21.15.42:0/486386293 wait complete. 2024-09-17T01:32:43.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.257+0000 7f6996400640 1 Processor -- start 2024-09-17T01:32:43.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.258+0000 7f6996400640 1 -- start start 2024-09-17T01:32:43.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.259+0000 7f6996400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6974003a00 0x7f699014b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:43.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.259+0000 7f6996400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69901549f0 0x7f69901f8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:43.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.259+0000 7f6996400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69901f9290 0x7f69900c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:43.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.259+0000 7f6996400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f699015efb0 con 0x7f69901549f0 2024-09-17T01:32:43.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.259+0000 7f6996400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f699015ee30 con 0x7f6974003a00 2024-09-17T01:32:43.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.259+0000 7f6996400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f699015f4c0 con 0x7f69901f9290 2024-09-17T01:32:43.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.259+0000 7f6987e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69901549f0 0x7f69901f8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:43.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.259+0000 7f6987e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69901549f0 0x7f69901f8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46462/0 (socket says 172.21.15.42:46462) 2024-09-17T01:32:43.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.259+0000 7f6987e00640 1 -- 172.21.15.42:0/3984626333 learned_addr learned my addr 172.21.15.42:0/3984626333 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:43.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.260+0000 7f6995a00640 1 --2- 172.21.15.42:0/3984626333 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69901f9290 0x7f69900c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:43.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.260+0000 7f6995000640 1 --2- 172.21.15.42:0/3984626333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6974003a00 0x7f699014b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:43.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.260+0000 7f6987e00640 1 -- 172.21.15.42:0/3984626333 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69901f9290 msgr2=0x7f69900c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:43.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.260+0000 7f6987e00640 1 --2- 172.21.15.42:0/3984626333 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69901f9290 0x7f69900c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:43.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.260+0000 7f6987e00640 1 -- 172.21.15.42:0/3984626333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6974003a00 msgr2=0x7f699014b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:43.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.260+0000 7f6987e00640 1 --2- 172.21.15.42:0/3984626333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6974003a00 0x7f699014b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:43.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.260+0000 7f6987e00640 1 -- 172.21.15.42:0/3984626333 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f699014bf00 con 0x7f69901549f0 2024-09-17T01:32:43.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.260+0000 7f6995a00640 1 --2- 172.21.15.42:0/3984626333 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69901f9290 0x7f69900c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:43.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.260+0000 7f6995000640 1 --2- 172.21.15.42:0/3984626333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6974003a00 0x7f699014b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:43.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.260+0000 7f6987e00640 1 --2- 172.21.15.42:0/3984626333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69901549f0 0x7f69901f8d50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6978011820 tx=0x7f6978011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:43.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.260+0000 7f698d600640 1 -- 172.21.15.42:0/3984626333 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697800fd50 con 0x7f69901549f0 2024-09-17T01:32:43.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.261+0000 7f698d600640 1 -- 172.21.15.42:0/3984626333 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6978016070 con 0x7f69901549f0 2024-09-17T01:32:43.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.261+0000 7f698d600640 1 -- 172.21.15.42:0/3984626333 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6978012690 con 0x7f69901549f0 2024-09-17T01:32:43.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.261+0000 7f6996400640 1 -- 172.21.15.42:0/3984626333 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6990155bb0 con 0x7f69901549f0 2024-09-17T01:32:43.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.261+0000 7f6996400640 1 -- 172.21.15.42:0/3984626333 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6990158890 con 0x7f69901549f0 2024-09-17T01:32:43.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.262+0000 7f6996400640 1 -- 172.21.15.42:0/3984626333 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69901f9b60 con 0x7f69901549f0 2024-09-17T01:32:43.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.263+0000 7f698d600640 1 -- 172.21.15.42:0/3984626333 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6978018030 con 0x7f69901549f0 2024-09-17T01:32:43.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.264+0000 7f698d600640 1 --2- 172.21.15.42:0/3984626333 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f696c078b90 0x7f696c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:43.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.264+0000 7f698d600640 1 -- 172.21.15.42:0/3984626333 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f697809b680 con 0x7f69901549f0 2024-09-17T01:32:43.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.265+0000 7f6995000640 1 --2- 172.21.15.42:0/3984626333 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f696c078b90 0x7f696c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:43.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.265+0000 7f6995000640 1 --2- 172.21.15.42:0/3984626333 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f696c078b90 0x7f696c07b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f698000c4a0 tx=0x7f6980038040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:43.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.268+0000 7f698d600640 1 -- 172.21.15.42:0/3984626333 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f699014bf00 con 0x7f69901549f0 2024-09-17T01:32:43.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.464+0000 7f6996400640 1 -- 172.21.15.42:0/3984626333 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f69900b6440 con 0x7f69901549f0 2024-09-17T01:32:43.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.465+0000 7f698d600640 1 -- 172.21.15.42:0/3984626333 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16621 (secure 0 0 0) 0x7f6978063ab0 con 0x7f69901549f0 2024-09-17T01:32:43.463 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:43.463 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":22,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:32:08.067689+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:32:04.526150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T01:32:05.523607+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:32:43.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.467+0000 7f6996400640 1 -- 172.21.15.42:0/3984626333 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f696c078b90 msgr2=0x7f696c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:43.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.467+0000 7f6996400640 1 --2- 172.21.15.42:0/3984626333 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f696c078b90 0x7f696c07b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f698000c4a0 tx=0x7f6980038040 comp rx=0 tx=0).stop 2024-09-17T01:32:43.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.467+0000 7f6996400640 1 -- 172.21.15.42:0/3984626333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69901549f0 msgr2=0x7f69901f8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:43.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.467+0000 7f6996400640 1 --2- 172.21.15.42:0/3984626333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69901549f0 0x7f69901f8d50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6978011820 tx=0x7f6978011ce0 comp rx=0 tx=0).stop 2024-09-17T01:32:43.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.468+0000 7f6996400640 1 -- 172.21.15.42:0/3984626333 shutdown_connections 2024-09-17T01:32:43.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.468+0000 7f6996400640 1 --2- 172.21.15.42:0/3984626333 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f696c078b90 0x7f696c07b0a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:43.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.468+0000 7f6996400640 1 --2- 172.21.15.42:0/3984626333 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69901f9290 0x7f69900c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:43.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.468+0000 7f6996400640 1 --2- 172.21.15.42:0/3984626333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69901549f0 0x7f69901f8d50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:43.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.468+0000 7f6996400640 1 --2- 172.21.15.42:0/3984626333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6974003a00 0x7f699014b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:43.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.468+0000 7f6996400640 1 -- 172.21.15.42:0/3984626333 >> 172.21.15.42:0/3984626333 conn(0x7f69900d1210 msgr2=0x7f69900d3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:43.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.468+0000 7f6996400640 1 -- 172.21.15.42:0/3984626333 shutdown_connections 2024-09-17T01:32:43.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.468+0000 7f6996400640 1 -- 172.21.15.42:0/3984626333 wait complete. 2024-09-17T01:32:43.491 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T01:32:43.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.722+0000 7f5198200640 1 -- 172.21.15.42:0/793186385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51900cec40 msgr2=0x7f51900cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:43.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.722+0000 7f5198200640 1 --2- 172.21.15.42:0/793186385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51900cec40 0x7f51900cf050 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5188005fd0 tx=0x7f518802a8b0 comp rx=0 tx=0).stop 2024-09-17T01:32:43.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.723+0000 7f5198200640 1 -- 172.21.15.42:0/793186385 shutdown_connections 2024-09-17T01:32:43.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.723+0000 7f5198200640 1 --2- 172.21.15.42:0/793186385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51900cec40 0x7f51900cf050 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:43.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.723+0000 7f5198200640 1 -- 172.21.15.42:0/793186385 >> 172.21.15.42:0/793186385 conn(0x7f51900b2930 msgr2=0x7f519006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:43.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.723+0000 7f5198200640 1 -- 172.21.15.42:0/793186385 shutdown_connections 2024-09-17T01:32:43.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.723+0000 7f5198200640 1 -- 172.21.15.42:0/793186385 wait complete. 2024-09-17T01:32:43.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.725+0000 7f5198200640 1 Processor -- start 2024-09-17T01:32:43.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.725+0000 7f5198200640 1 -- start start 2024-09-17T01:32:43.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.726+0000 7f5198200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51900b3550 0x7f519013e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:43.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.726+0000 7f5198200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51900cec40 0x7f51900ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:43.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.727+0000 7f5198200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5190142f40 0x7f51900aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:43.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.727+0000 7f5198200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f519006d900 con 0x7f51900cec40 2024-09-17T01:32:43.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.727+0000 7f5198200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f519006d780 con 0x7f51900b3550 2024-09-17T01:32:43.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.727+0000 7f5198200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f519006da80 con 0x7f5190142f40 2024-09-17T01:32:43.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.727+0000 7f5194e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51900cec40 0x7f51900ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:43.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.727+0000 7f5195800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51900b3550 0x7f519013e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:43.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.727+0000 7f5194e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51900cec40 0x7f51900ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46492/0 (socket says 172.21.15.42:46492) 2024-09-17T01:32:43.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.727+0000 7f5194e00640 1 -- 172.21.15.42:0/950445018 learned_addr learned my addr 172.21.15.42:0/950445018 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:43.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.727+0000 7f5196200640 1 --2- 172.21.15.42:0/950445018 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5190142f40 0x7f51900aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:43.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.727+0000 7f5194e00640 1 -- 172.21.15.42:0/950445018 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5190142f40 msgr2=0x7f51900aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:43.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.727+0000 7f5194e00640 1 --2- 172.21.15.42:0/950445018 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5190142f40 0x7f51900aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.727+0000 7f5194e00640 1 -- 172.21.15.42:0/950445018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51900b3550 msgr2=0x7f519013e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.727+0000 7f5194e00640 1 --2- 172.21.15.42:0/950445018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51900b3550 0x7f519013e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.727+0000 7f5194e00640 1 -- 172.21.15.42:0/950445018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f519015c8f0 con 0x7f51900cec40 2024-09-17T01:32:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.728+0000 7f5194e00640 1 --2- 172.21.15.42:0/950445018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51900cec40 0x7f51900ae8a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f517c00c3a0 tx=0x7f517c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.728+0000 7f518d600640 1 -- 172.21.15.42:0/950445018 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c017070 con 0x7f51900cec40 2024-09-17T01:32:43.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.728+0000 7f518d600640 1 -- 172.21.15.42:0/950445018 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f517c0053c0 con 0x7f51900cec40 2024-09-17T01:32:43.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.728+0000 7f518d600640 1 -- 172.21.15.42:0/950445018 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c003850 con 0x7f51900cec40 2024-09-17T01:32:43.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.728+0000 7f5198200640 1 -- 172.21.15.42:0/950445018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f519015c050 con 0x7f51900cec40 2024-09-17T01:32:43.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.728+0000 7f5198200640 1 -- 172.21.15.42:0/950445018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f519015c610 con 0x7f51900cec40 2024-09-17T01:32:43.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.729+0000 7f5198200640 1 -- 172.21.15.42:0/950445018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51900cf050 con 0x7f51900cec40 2024-09-17T01:32:43.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.731+0000 7f518d600640 1 -- 172.21.15.42:0/950445018 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f517c01a070 con 0x7f51900cec40 2024-09-17T01:32:43.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.731+0000 7f518d600640 1 --2- 172.21.15.42:0/950445018 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5170078b90 0x7f517007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:43.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.732+0000 7f518d600640 1 -- 172.21.15.42:0/950445018 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f517c09a080 con 0x7f51900cec40 2024-09-17T01:32:43.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.732+0000 7f5195800640 1 --2- 172.21.15.42:0/950445018 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5170078b90 0x7f517007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:43.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.733+0000 7f5195800640 1 --2- 172.21.15.42:0/950445018 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5170078b90 0x7f517007b0a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f51840046b0 tx=0x7f5184007e90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:43.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.736+0000 7f518d600640 1 -- 172.21.15.42:0/950445018 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f517c061e60 con 0x7f51900cec40 2024-09-17T01:32:43.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.969+0000 7f5198200640 1 -- 172.21.15.42:0/950445018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f519015aa50 con 0x7f51900cec40 2024-09-17T01:32:43.968 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-17T01:32:43.970+0000 7f9961e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:32:43.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.972+0000 7f518d600640 1 -- 172.21.15.42:0/950445018 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f517c066890 con 0x7f51900cec40 2024-09-17T01:32:43.970 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T01:32:43.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.974+0000 7f5198200640 1 -- 172.21.15.42:0/950445018 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5170078b90 msgr2=0x7f517007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:43.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.974+0000 7f5198200640 1 --2- 172.21.15.42:0/950445018 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5170078b90 0x7f517007b0a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f51840046b0 tx=0x7f5184007e90 comp rx=0 tx=0).stop 2024-09-17T01:32:43.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.974+0000 7f5198200640 1 -- 172.21.15.42:0/950445018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51900cec40 msgr2=0x7f51900ae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:43.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.974+0000 7f5198200640 1 --2- 172.21.15.42:0/950445018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51900cec40 0x7f51900ae8a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f517c00c3a0 tx=0x7f517c00c860 comp rx=0 tx=0).stop 2024-09-17T01:32:43.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.975+0000 7f5198200640 1 -- 172.21.15.42:0/950445018 shutdown_connections 2024-09-17T01:32:43.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.975+0000 7f5198200640 1 --2- 172.21.15.42:0/950445018 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5170078b90 0x7f517007b0a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:43.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.975+0000 7f5198200640 1 --2- 172.21.15.42:0/950445018 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5190142f40 0x7f51900aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:43.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.975+0000 7f5198200640 1 --2- 172.21.15.42:0/950445018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51900cec40 0x7f51900ae8a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:43.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.975+0000 7f5198200640 1 --2- 172.21.15.42:0/950445018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51900b3550 0x7f519013e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:43.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.975+0000 7f5198200640 1 -- 172.21.15.42:0/950445018 >> 172.21.15.42:0/950445018 conn(0x7f51900b2930 msgr2=0x7f519015f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:43.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.975+0000 7f5198200640 1 -- 172.21.15.42:0/950445018 shutdown_connections 2024-09-17T01:32:43.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:43.975+0000 7f5198200640 1 -- 172.21.15.42:0/950445018 wait complete. 2024-09-17T01:32:43.985 INFO:tasks.ceph.mds.b.smithi043.stderr: -7251> 2024-09-17T01:32:11.772+0000 7f239de00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:32:43.994 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T01:32:44.115 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-09-17T01:32:44.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.228+0000 7f9cd6200640 1 -- 172.21.15.42:0/2517817704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cd00b3550 msgr2=0x7f9cd015cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:44.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.228+0000 7f9cd6200640 1 --2- 172.21.15.42:0/2517817704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cd00b3550 0x7f9cd015cec0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0071ef0 tx=0x7f9cc002a4b0 comp rx=0 tx=0).stop 2024-09-17T01:32:44.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.228+0000 7f9cd6200640 1 -- 172.21.15.42:0/2517817704 shutdown_connections 2024-09-17T01:32:44.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.228+0000 7f9cd6200640 1 --2- 172.21.15.42:0/2517817704 >> v2:172.21.15.42:3300/0 conn(0x7f9cd0142f40 0x7f9cd0072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:44.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.228+0000 7f9cd6200640 1 --2- 172.21.15.42:0/2517817704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cd00b3550 0x7f9cd015cec0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:44.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.228+0000 7f9cd6200640 1 -- 172.21.15.42:0/2517817704 >> 172.21.15.42:0/2517817704 conn(0x7f9cd00b2930 msgr2=0x7f9cd006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:44.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.228+0000 7f9cd6200640 1 -- 172.21.15.42:0/2517817704 shutdown_connections 2024-09-17T01:32:44.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.228+0000 7f9cd6200640 1 -- 172.21.15.42:0/2517817704 wait complete. 2024-09-17T01:32:44.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.230+0000 7f9cd6200640 1 Processor -- start 2024-09-17T01:32:44.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.230+0000 7f9cd6200640 1 -- start start 2024-09-17T01:32:44.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.232+0000 7f9cd6200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9cd0072e90 0x7f9cd01404c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:44.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.232+0000 7f9cd6200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cd00b3550 0x7f9cd0132360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:44.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.232+0000 7f9cd6200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9cd0142f40 0x7f9cd00cc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:44.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.232+0000 7f9cd6200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd006d5b0 con 0x7f9cd0072e90 2024-09-17T01:32:44.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.232+0000 7f9cd6200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd006d430 con 0x7f9cd00b3550 2024-09-17T01:32:44.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.232+0000 7f9cd6200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd006d730 con 0x7f9cd0142f40 2024-09-17T01:32:44.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.232+0000 7f9ccf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9cd0072e90 0x7f9cd01404c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:44.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.232+0000 7f9ccf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9cd0072e90 0x7f9cd01404c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46510/0 (socket says 172.21.15.42:46510) 2024-09-17T01:32:44.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.232+0000 7f9ccf400640 1 -- 172.21.15.42:0/2560794437 learned_addr learned my addr 172.21.15.42:0/2560794437 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:44.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.232+0000 7f9ccea00640 1 --2- 172.21.15.42:0/2560794437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cd00b3550 0x7f9cd0132360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:44.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.232+0000 7f9ccfe00640 1 --2- 172.21.15.42:0/2560794437 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9cd0142f40 0x7f9cd00cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:44.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.232+0000 7f9ccf400640 1 -- 172.21.15.42:0/2560794437 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9cd0142f40 msgr2=0x7f9cd00cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:44.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.232+0000 7f9ccf400640 1 --2- 172.21.15.42:0/2560794437 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9cd0142f40 0x7f9cd00cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:44.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.232+0000 7f9ccf400640 1 -- 172.21.15.42:0/2560794437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cd00b3550 msgr2=0x7f9cd0132360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:44.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.232+0000 7f9ccf400640 1 --2- 172.21.15.42:0/2560794437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cd00b3550 0x7f9cd0132360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:44.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.232+0000 7f9ccf400640 1 -- 172.21.15.42:0/2560794437 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd0141db0 con 0x7f9cd0072e90 2024-09-17T01:32:44.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.233+0000 7f9ccf400640 1 --2- 172.21.15.42:0/2560794437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9cd0072e90 0x7f9cd01404c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0009780 tx=0x7f9cc0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:44.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.233+0000 7f9cc7400640 1 -- 172.21.15.42:0/2560794437 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0031d60 con 0x7f9cd0072e90 2024-09-17T01:32:44.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.233+0000 7f9cd6200640 1 -- 172.21.15.42:0/2560794437 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd0140d10 con 0x7f9cd0072e90 2024-09-17T01:32:44.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.233+0000 7f9cc7400640 1 -- 172.21.15.42:0/2560794437 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9cc0033e10 con 0x7f9cd0072e90 2024-09-17T01:32:44.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.233+0000 7f9cc7400640 1 -- 172.21.15.42:0/2560794437 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0005260 con 0x7f9cd0072e90 2024-09-17T01:32:44.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.233+0000 7f9cd6200640 1 -- 172.21.15.42:0/2560794437 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd01412d0 con 0x7f9cd0072e90 2024-09-17T01:32:44.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.234+0000 7f9cd6200640 1 -- 172.21.15.42:0/2560794437 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cd006dbe0 con 0x7f9cd0072e90 2024-09-17T01:32:44.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.236+0000 7f9cc7400640 1 -- 172.21.15.42:0/2560794437 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9cc0005400 con 0x7f9cd0072e90 2024-09-17T01:32:44.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.237+0000 7f9cc7400640 1 --2- 172.21.15.42:0/2560794437 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9cb0078bc0 0x7f9cb007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:44.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.237+0000 7f9cc7400640 1 -- 172.21.15.42:0/2560794437 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5795+0+0 (secure 0 0 0) 0x7f9cc00bbec0 con 0x7f9cd0072e90 2024-09-17T01:32:44.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.237+0000 7f9ccea00640 1 --2- 172.21.15.42:0/2560794437 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9cb0078bc0 0x7f9cb007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:44.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.238+0000 7f9ccea00640 1 --2- 172.21.15.42:0/2560794437 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9cb0078bc0 0x7f9cb007b0d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9cd015bea0 tx=0x7f9cbc009260 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.241+0000 7f9cc7400640 1 -- 172.21.15.42:0/2560794437 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9cc003f030 con 0x7f9cd0072e90 2024-09-17T01:32:44.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.472+0000 7f9cd6200640 1 -- 172.21.15.42:0/2560794437 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9cd006a170 con 0x7f9cd0072e90 2024-09-17T01:32:44.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.974+0000 7f9cc7400640 1 -- 172.21.15.42:0/2560794437 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f9cc0083b30 con 0x7f9cd0072e90 2024-09-17T01:32:44.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.977+0000 7f9cd6200640 1 -- 172.21.15.42:0/2560794437 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9cb0078bc0 msgr2=0x7f9cb007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:44.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.977+0000 7f9cd6200640 1 --2- 172.21.15.42:0/2560794437 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9cb0078bc0 0x7f9cb007b0d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9cd015bea0 tx=0x7f9cbc009260 comp rx=0 tx=0).stop 2024-09-17T01:32:44.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.977+0000 7f9cd6200640 1 -- 172.21.15.42:0/2560794437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9cd0072e90 msgr2=0x7f9cd01404c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:44.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.977+0000 7f9cd6200640 1 --2- 172.21.15.42:0/2560794437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9cd0072e90 0x7f9cd01404c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0009780 tx=0x7f9cc0033c20 comp rx=0 tx=0).stop 2024-09-17T01:32:44.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.977+0000 7f9cd6200640 1 -- 172.21.15.42:0/2560794437 shutdown_connections 2024-09-17T01:32:44.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.977+0000 7f9cd6200640 1 --2- 172.21.15.42:0/2560794437 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9cb0078bc0 0x7f9cb007b0d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:44.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.977+0000 7f9cd6200640 1 --2- 172.21.15.42:0/2560794437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cd00b3550 0x7f9cd0132360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:44.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.977+0000 7f9cd6200640 1 --2- 172.21.15.42:0/2560794437 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9cd0142f40 0x7f9cd00cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:44.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.977+0000 7f9cd6200640 1 --2- 172.21.15.42:0/2560794437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9cd0072e90 0x7f9cd01404c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:44.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.977+0000 7f9cd6200640 1 -- 172.21.15.42:0/2560794437 >> 172.21.15.42:0/2560794437 conn(0x7f9cd00b2930 msgr2=0x7f9cd015f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:44.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.977+0000 7f9cd6200640 1 -- 172.21.15.42:0/2560794437 shutdown_connections 2024-09-17T01:32:44.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:44.977+0000 7f9cd6200640 1 -- 172.21.15.42:0/2560794437 wait complete. 2024-09-17T01:32:44.998 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T01:32:45.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.236+0000 7f258ae00640 1 -- 172.21.15.42:0/22458732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25840cf120 msgr2=0x7f25840ca7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:45.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.236+0000 7f258ae00640 1 --2- 172.21.15.42:0/22458732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25840cf120 0x7f25840ca7c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f257c005fd0 tx=0x7f257c02a940 comp rx=0 tx=0).stop 2024-09-17T01:32:45.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.236+0000 7f258ae00640 1 -- 172.21.15.42:0/22458732 shutdown_connections 2024-09-17T01:32:45.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.236+0000 7f258ae00640 1 --2- 172.21.15.42:0/22458732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25840cf120 0x7f25840ca7c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:45.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.236+0000 7f258ae00640 1 -- 172.21.15.42:0/22458732 >> 172.21.15.42:0/22458732 conn(0x7f25840b25d0 msgr2=0x7f25840d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:45.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.236+0000 7f258ae00640 1 -- 172.21.15.42:0/22458732 shutdown_connections 2024-09-17T01:32:45.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.236+0000 7f258ae00640 1 -- 172.21.15.42:0/22458732 wait complete. 2024-09-17T01:32:45.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.239+0000 7f258ae00640 1 Processor -- start 2024-09-17T01:32:45.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.239+0000 7f258ae00640 1 -- start start 2024-09-17T01:32:45.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.240+0000 7f258ae00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25840b43c0 0x7f258415ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:45.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.240+0000 7f258ae00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25840cf120 0x7f258406f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:45.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.240+0000 7f258ae00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f258415b450 0x7f258406f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:45.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.240+0000 7f258ae00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f25840c6010 con 0x7f25840cf120 2024-09-17T01:32:45.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.240+0000 7f258ae00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f25840c5e90 con 0x7f25840b43c0 2024-09-17T01:32:45.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.240+0000 7f258ae00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f25840c6190 con 0x7f258415b450 2024-09-17T01:32:45.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.241+0000 7f2589000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25840cf120 0x7f258406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:45.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.241+0000 7f2589000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25840cf120 0x7f258406f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46524/0 (socket says 172.21.15.42:46524) 2024-09-17T01:32:45.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.241+0000 7f2589000640 1 -- 172.21.15.42:0/1874535657 learned_addr learned my addr 172.21.15.42:0/1874535657 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:45.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.241+0000 7f2589a00640 1 --2- 172.21.15.42:0/1874535657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25840b43c0 0x7f258415ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:45.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.241+0000 7f258a400640 1 --2- 172.21.15.42:0/1874535657 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f258415b450 0x7f258406f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:45.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.241+0000 7f2589000640 1 -- 172.21.15.42:0/1874535657 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f258415b450 msgr2=0x7f258406f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:45.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.241+0000 7f2589000640 1 --2- 172.21.15.42:0/1874535657 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f258415b450 0x7f258406f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:45.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.241+0000 7f2589000640 1 -- 172.21.15.42:0/1874535657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25840b43c0 msgr2=0x7f258415ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:45.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.241+0000 7f2589000640 1 --2- 172.21.15.42:0/1874535657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25840b43c0 0x7f258415ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:45.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.241+0000 7f2589000640 1 -- 172.21.15.42:0/1874535657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258415f350 con 0x7f25840cf120 2024-09-17T01:32:45.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.241+0000 7f2589000640 1 --2- 172.21.15.42:0/1874535657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25840cf120 0x7f258406f250 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f257000c340 tx=0x7f257000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:45.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.242+0000 7f2581600640 1 -- 172.21.15.42:0/1874535657 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2570017070 con 0x7f25840cf120 2024-09-17T01:32:45.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.242+0000 7f2581600640 1 -- 172.21.15.42:0/1874535657 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f25700053c0 con 0x7f25840cf120 2024-09-17T01:32:45.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.242+0000 7f258ae00640 1 -- 172.21.15.42:0/1874535657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f258415bc60 con 0x7f25840cf120 2024-09-17T01:32:45.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.242+0000 7f2581600640 1 -- 172.21.15.42:0/1874535657 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2570003850 con 0x7f25840cf120 2024-09-17T01:32:45.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.242+0000 7f258ae00640 1 -- 172.21.15.42:0/1874535657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25840739c0 con 0x7f25840cf120 2024-09-17T01:32:45.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.243+0000 7f258ae00640 1 -- 172.21.15.42:0/1874535657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f258415eb00 con 0x7f25840cf120 2024-09-17T01:32:45.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.244+0000 7f2581600640 1 -- 172.21.15.42:0/1874535657 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f257001a070 con 0x7f25840cf120 2024-09-17T01:32:45.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.245+0000 7f2581600640 1 --2- 172.21.15.42:0/1874535657 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2564078bc0 0x7f256407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:45.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.245+0000 7f2581600640 1 -- 172.21.15.42:0/1874535657 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5795+0+0 (secure 0 0 0) 0x7f257009a110 con 0x7f25840cf120 2024-09-17T01:32:45.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.246+0000 7f2589a00640 1 --2- 172.21.15.42:0/1874535657 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2564078bc0 0x7f256407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:45.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.246+0000 7f2589a00640 1 --2- 172.21.15.42:0/1874535657 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2564078bc0 0x7f256407b0d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2578007fd0 tx=0x7f2578001370 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:45.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.250+0000 7f2581600640 1 -- 172.21.15.42:0/1874535657 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2570061e00 con 0x7f25840cf120 2024-09-17T01:32:45.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.446+0000 7f258ae00640 1 -- 172.21.15.42:0/1874535657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f25840cf530 con 0x7f25840cf120 2024-09-17T01:32:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.980+0000 7f2581600640 1 -- 172.21.15.42:0/1874535657 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) ==== 181+0+0 (secure 0 0 0) 0x7f2570066830 con 0x7f25840cf120 2024-09-17T01:32:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-09-17T01:32:45.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.984+0000 7f258ae00640 1 -- 172.21.15.42:0/1874535657 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2564078bc0 msgr2=0x7f256407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.984+0000 7f258ae00640 1 --2- 172.21.15.42:0/1874535657 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2564078bc0 0x7f256407b0d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2578007fd0 tx=0x7f2578001370 comp rx=0 tx=0).stop 2024-09-17T01:32:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.984+0000 7f258ae00640 1 -- 172.21.15.42:0/1874535657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25840cf120 msgr2=0x7f258406f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.984+0000 7f258ae00640 1 --2- 172.21.15.42:0/1874535657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25840cf120 0x7f258406f250 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f257000c340 tx=0x7f257000c800 comp rx=0 tx=0).stop 2024-09-17T01:32:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.985+0000 7f258ae00640 1 -- 172.21.15.42:0/1874535657 shutdown_connections 2024-09-17T01:32:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.985+0000 7f258ae00640 1 --2- 172.21.15.42:0/1874535657 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2564078bc0 0x7f256407b0d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.985+0000 7f258ae00640 1 --2- 172.21.15.42:0/1874535657 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f258415b450 0x7f258406f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.985+0000 7f258ae00640 1 --2- 172.21.15.42:0/1874535657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25840cf120 0x7f258406f250 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.985+0000 7f258ae00640 1 --2- 172.21.15.42:0/1874535657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25840b43c0 0x7f258415ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.985+0000 7f258ae00640 1 -- 172.21.15.42:0/1874535657 >> 172.21.15.42:0/1874535657 conn(0x7f25840b25d0 msgr2=0x7f25840ccb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.985+0000 7f258ae00640 1 -- 172.21.15.42:0/1874535657 shutdown_connections 2024-09-17T01:32:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:45.985+0000 7f258ae00640 1 -- 172.21.15.42:0/1874535657 wait complete. 2024-09-17T01:32:46.006 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T01:32:46.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.242+0000 7f9f2e200640 1 -- 172.21.15.42:0/435476341 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9f280af4f0 msgr2=0x7f9f2815d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:46.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.242+0000 7f9f2e200640 1 --2- 172.21.15.42:0/435476341 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9f280af4f0 0x7f9f2815d6a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c009860 tx=0x7f9f1c02a530 comp rx=0 tx=0).stop 2024-09-17T01:32:46.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.243+0000 7f9f2e200640 1 -- 172.21.15.42:0/435476341 shutdown_connections 2024-09-17T01:32:46.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.243+0000 7f9f2e200640 1 --2- 172.21.15.42:0/435476341 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9f280af4f0 0x7f9f2815d6a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:46.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.243+0000 7f9f2e200640 1 -- 172.21.15.42:0/435476341 >> 172.21.15.42:0/435476341 conn(0x7f9f280b25d0 msgr2=0x7f9f280d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:46.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.243+0000 7f9f2e200640 1 -- 172.21.15.42:0/435476341 shutdown_connections 2024-09-17T01:32:46.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.243+0000 7f9f2e200640 1 -- 172.21.15.42:0/435476341 wait complete. 2024-09-17T01:32:46.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.245+0000 7f9f2e200640 1 Processor -- start 2024-09-17T01:32:46.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.245+0000 7f9f2e200640 1 -- start start 2024-09-17T01:32:46.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.247+0000 7f9f2e200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f280aebf0 0x7f9f2814fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:46.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.247+0000 7f9f2e200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f280af4f0 0x7f9f281f8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:46.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.247+0000 7f9f2e200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9f281f9080 0x7f9f28152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:46.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.247+0000 7f9f2e200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9f280b3b40 con 0x7f9f280af4f0 2024-09-17T01:32:46.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.247+0000 7f9f2e200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9f280b39c0 con 0x7f9f280aebf0 2024-09-17T01:32:46.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.247+0000 7f9f2e200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9f280b3cc0 con 0x7f9f281f9080 2024-09-17T01:32:46.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.248+0000 7f9f27e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f280af4f0 0x7f9f281f8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:46.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.248+0000 7f9f27e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f280af4f0 0x7f9f281f8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51204/0 (socket says 172.21.15.42:51204) 2024-09-17T01:32:46.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.248+0000 7f9f27e00640 1 -- 172.21.15.42:0/941475128 learned_addr learned my addr 172.21.15.42:0/941475128 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:46.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.248+0000 7f9f2ce00640 1 --2- 172.21.15.42:0/941475128 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f280aebf0 0x7f9f2814fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:46.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.248+0000 7f9f2d800640 1 --2- 172.21.15.42:0/941475128 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9f281f9080 0x7f9f28152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:46.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.249+0000 7f9f27e00640 1 -- 172.21.15.42:0/941475128 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9f281f9080 msgr2=0x7f9f28152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:46.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.249+0000 7f9f27e00640 1 --2- 172.21.15.42:0/941475128 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9f281f9080 0x7f9f28152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:46.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.249+0000 7f9f27e00640 1 -- 172.21.15.42:0/941475128 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f280aebf0 msgr2=0x7f9f2814fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:46.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.249+0000 7f9f27e00640 1 --2- 172.21.15.42:0/941475128 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f280aebf0 0x7f9f2814fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:46.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.249+0000 7f9f27e00640 1 -- 172.21.15.42:0/941475128 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f28150400 con 0x7f9f280af4f0 2024-09-17T01:32:46.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.250+0000 7f9f27e00640 1 --2- 172.21.15.42:0/941475128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f280af4f0 0x7f9f281f8b40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400c3f0 tx=0x7f9f1400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:46.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.251+0000 7f9f24c00640 1 -- 172.21.15.42:0/941475128 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f14017070 con 0x7f9f280af4f0 2024-09-17T01:32:46.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.251+0000 7f9f24c00640 1 -- 172.21.15.42:0/941475128 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f140053c0 con 0x7f9f280af4f0 2024-09-17T01:32:46.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.251+0000 7f9f2e200640 1 -- 172.21.15.42:0/941475128 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f28150df0 con 0x7f9f280af4f0 2024-09-17T01:32:46.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.251+0000 7f9f2e200640 1 -- 172.21.15.42:0/941475128 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f281568e0 con 0x7f9f280af4f0 2024-09-17T01:32:46.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.252+0000 7f9f24c00640 1 -- 172.21.15.42:0/941475128 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f14003850 con 0x7f9f280af4f0 2024-09-17T01:32:46.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.253+0000 7f9f2e200640 1 -- 172.21.15.42:0/941475128 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f04005290 con 0x7f9f280af4f0 2024-09-17T01:32:46.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.257+0000 7f9f24c00640 1 -- 172.21.15.42:0/941475128 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9f1401a070 con 0x7f9f280af4f0 2024-09-17T01:32:46.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.258+0000 7f9f24c00640 1 --2- 172.21.15.42:0/941475128 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9f08078c90 0x7f9f0807b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:46.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.259+0000 7f9f24c00640 1 -- 172.21.15.42:0/941475128 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5386+0+0 (secure 0 0 0) 0x7f9f1409a210 con 0x7f9f280af4f0 2024-09-17T01:32:46.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.259+0000 7f9f2ce00640 1 --2- 172.21.15.42:0/941475128 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9f08078c90 0x7f9f0807b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:46.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.260+0000 7f9f2ce00640 1 --2- 172.21.15.42:0/941475128 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9f08078c90 0x7f9f0807b1a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c034000 tx=0x7f9f1c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:46.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.263+0000 7f9f24c00640 1 -- 172.21.15.42:0/941475128 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9f14021080 con 0x7f9f280af4f0 2024-09-17T01:32:46.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:46.457+0000 7f9f2e200640 1 -- 172.21.15.42:0/941475128 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9f04005580 con 0x7f9f280af4f0 2024-09-17T01:32:47.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.207+0000 7f9f24c00640 1 -- 172.21.15.42:0/941475128 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) ==== 169+0+0 (secure 0 0 0) 0x7f9f28150400 con 0x7f9f280af4f0 2024-09-17T01:32:47.205 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-09-17T01:32:47.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.212+0000 7f9f2e200640 1 -- 172.21.15.42:0/941475128 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9f08078c90 msgr2=0x7f9f0807b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:47.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.212+0000 7f9f2e200640 1 --2- 172.21.15.42:0/941475128 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9f08078c90 0x7f9f0807b1a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c034000 tx=0x7f9f1c004730 comp rx=0 tx=0).stop 2024-09-17T01:32:47.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.212+0000 7f9f2e200640 1 -- 172.21.15.42:0/941475128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f280af4f0 msgr2=0x7f9f281f8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:47.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.212+0000 7f9f2e200640 1 --2- 172.21.15.42:0/941475128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f280af4f0 0x7f9f281f8b40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400c3f0 tx=0x7f9f1400c8b0 comp rx=0 tx=0).stop 2024-09-17T01:32:47.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.212+0000 7f9f2e200640 1 -- 172.21.15.42:0/941475128 shutdown_connections 2024-09-17T01:32:47.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.212+0000 7f9f2e200640 1 --2- 172.21.15.42:0/941475128 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9f08078c90 0x7f9f0807b1a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:47.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.212+0000 7f9f2e200640 1 --2- 172.21.15.42:0/941475128 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9f281f9080 0x7f9f28152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:47.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.212+0000 7f9f2e200640 1 --2- 172.21.15.42:0/941475128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f280af4f0 0x7f9f281f8b40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:47.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.212+0000 7f9f2e200640 1 --2- 172.21.15.42:0/941475128 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9f280aebf0 0x7f9f2814fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:47.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.212+0000 7f9f2e200640 1 -- 172.21.15.42:0/941475128 >> 172.21.15.42:0/941475128 conn(0x7f9f280b25d0 msgr2=0x7f9f280b0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:47.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.213+0000 7f9f2e200640 1 -- 172.21.15.42:0/941475128 shutdown_connections 2024-09-17T01:32:47.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.213+0000 7f9f2e200640 1 -- 172.21.15.42:0/941475128 wait complete. 2024-09-17T01:32:47.243 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T01:32:47.243 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T01:32:47.243 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T01:32:47.243 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:32:47.243 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T01:32:47.244 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T01:32:47.244 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T01:32:47.244 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:32:47.244 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T01:32:47.244 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T01:32:47.244 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T01:32:47.245 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:32:47.245 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T01:32:47.245 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T01:32:47.245 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T01:32:47.245 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:32:47.267 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T01:32:47.268 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T01:32:47.269 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T01:32:47.269 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T01:32:47.273 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T01:32:47.274 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T01:32:47.275 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T01:32:47.275 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T01:32:47.314 INFO:tasks.ceph.mds.d:Started 2024-09-17T01:32:47.314 DEBUG:teuthology.parallel:result is None 2024-09-17T01:32:47.317 INFO:tasks.ceph.mds.b:Started 2024-09-17T01:32:47.317 DEBUG:teuthology.parallel:result is None 2024-09-17T01:32:47.319 INFO:tasks.ceph.mds.c:Started 2024-09-17T01:32:47.319 DEBUG:teuthology.parallel:result is None 2024-09-17T01:32:47.322 INFO:tasks.ceph.mds.a:Started 2024-09-17T01:32:47.322 DEBUG:teuthology.parallel:result is None 2024-09-17T01:32:47.322 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T01:32:47.517 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-09-17T01:32:47.518 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-09-17T01:32:47.536 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:32:47.539 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:32:47.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.577+0000 7f36c3000640 1 -- 172.21.15.42:0/3206419420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36bc06ee90 msgr2=0x7f36bc15f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:47.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.577+0000 7f36c3000640 1 --2- 172.21.15.42:0/3206419420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36bc06ee90 0x7f36bc15f200 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f36ac009830 tx=0x7f36ac02a520 comp rx=0 tx=0).stop 2024-09-17T01:32:47.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.577+0000 7f36c3000640 1 -- 172.21.15.42:0/3206419420 shutdown_connections 2024-09-17T01:32:47.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.577+0000 7f36c3000640 1 --2- 172.21.15.42:0/3206419420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36bc06ee90 0x7f36bc15f200 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:47.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.577+0000 7f36c3000640 1 -- 172.21.15.42:0/3206419420 >> 172.21.15.42:0/3206419420 conn(0x7f36bc0b2930 msgr2=0x7f36bc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:47.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.577+0000 7f36c3000640 1 -- 172.21.15.42:0/3206419420 shutdown_connections 2024-09-17T01:32:47.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.577+0000 7f36c3000640 1 -- 172.21.15.42:0/3206419420 wait complete. 2024-09-17T01:32:47.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.580+0000 7f36c3000640 1 Processor -- start 2024-09-17T01:32:47.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.580+0000 7f36c3000640 1 -- start start 2024-09-17T01:32:47.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.581+0000 7f36c3000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36bc06ee90 0x7f36bc0b4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:47.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.581+0000 7f36c3000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36bc06f2a0 0x7f36bc0b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:47.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.581+0000 7f36c3000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36bc073df0 0x7f36bc0b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:47.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.581+0000 7f36c3000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc0cf0c0 con 0x7f36bc06f2a0 2024-09-17T01:32:47.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.581+0000 7f36c3000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc0cef40 con 0x7f36bc073df0 2024-09-17T01:32:47.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.581+0000 7f36c3000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f36bc0cf240 con 0x7f36bc06ee90 2024-09-17T01:32:47.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.581+0000 7f36b3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36bc06f2a0 0x7f36bc0b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:47.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.581+0000 7f36b3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36bc06f2a0 0x7f36bc0b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51262/0 (socket says 172.21.15.42:51262) 2024-09-17T01:32:47.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.581+0000 7f36b3e00640 1 -- 172.21.15.42:0/3451933379 learned_addr learned my addr 172.21.15.42:0/3451933379 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:47.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.582+0000 7f36c1000640 1 --2- 172.21.15.42:0/3451933379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36bc073df0 0x7f36bc0b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:47.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.582+0000 7f36bbe00640 1 --2- 172.21.15.42:0/3451933379 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36bc06ee90 0x7f36bc0b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:47.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.582+0000 7f36b3e00640 1 -- 172.21.15.42:0/3451933379 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36bc06ee90 msgr2=0x7f36bc0b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:47.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.582+0000 7f36b3e00640 1 --2- 172.21.15.42:0/3451933379 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36bc06ee90 0x7f36bc0b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:47.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.582+0000 7f36b3e00640 1 -- 172.21.15.42:0/3451933379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36bc073df0 msgr2=0x7f36bc0b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:47.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.582+0000 7f36b3e00640 1 --2- 172.21.15.42:0/3451933379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36bc073df0 0x7f36bc0b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:47.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.582+0000 7f36b3e00640 1 -- 172.21.15.42:0/3451933379 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36bc0b4dd0 con 0x7f36bc06f2a0 2024-09-17T01:32:47.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.582+0000 7f36bbe00640 1 --2- 172.21.15.42:0/3451933379 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36bc06ee90 0x7f36bc0b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:32:47.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.582+0000 7f36c1000640 1 --2- 172.21.15.42:0/3451933379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36bc073df0 0x7f36bc0b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:32:47.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.582+0000 7f36b3e00640 1 --2- 172.21.15.42:0/3451933379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36bc06f2a0 0x7f36bc0b1080 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f36a400c430 tx=0x7f36a400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:47.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.582+0000 7f36b8c00640 1 -- 172.21.15.42:0/3451933379 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4011790 con 0x7f36bc06f2a0 2024-09-17T01:32:47.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.583+0000 7f36b8c00640 1 -- 172.21.15.42:0/3451933379 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36a4017070 con 0x7f36bc06f2a0 2024-09-17T01:32:47.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.583+0000 7f36b8c00640 1 -- 172.21.15.42:0/3451933379 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4011ce0 con 0x7f36bc06f2a0 2024-09-17T01:32:47.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.583+0000 7f36c3000640 1 -- 172.21.15.42:0/3451933379 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36bc1f5b60 con 0x7f36bc06f2a0 2024-09-17T01:32:47.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.583+0000 7f36c3000640 1 -- 172.21.15.42:0/3451933379 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36bc1f6120 con 0x7f36bc06f2a0 2024-09-17T01:32:47.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.584+0000 7f36c3000640 1 -- 172.21.15.42:0/3451933379 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36bc0cf6f0 con 0x7f36bc06f2a0 2024-09-17T01:32:47.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.585+0000 7f36b8c00640 1 -- 172.21.15.42:0/3451933379 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f36a401c460 con 0x7f36bc06f2a0 2024-09-17T01:32:47.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.586+0000 7f36b8c00640 1 --2- 172.21.15.42:0/3451933379 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3698078b90 0x7f369807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:47.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.587+0000 7f36b8c00640 1 -- 172.21.15.42:0/3451933379 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4943+0+0 (secure 0 0 0) 0x7f36a409a9d0 con 0x7f36bc06f2a0 2024-09-17T01:32:47.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.587+0000 7f36bbe00640 1 --2- 172.21.15.42:0/3451933379 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3698078b90 0x7f369807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:47.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.588+0000 7f36bbe00640 1 --2- 172.21.15.42:0/3451933379 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3698078b90 0x7f369807b0a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f36ac034000 tx=0x7f36ac004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:47.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.591+0000 7f36b8c00640 1 -- 172.21.15.42:0/3451933379 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f36a4062ff0 con 0x7f36bc06f2a0 2024-09-17T01:32:47.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:47.797+0000 7f36c3000640 1 -- 172.21.15.42:0/3451933379 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f36bc0b4fa0 con 0x7f36bc06f2a0 2024-09-17T01:32:48.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.220+0000 7f36b8c00640 1 -- 172.21.15.42:0/3451933379 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) ==== 97+0+0 (secure 0 0 0) 0x7f36a40628f0 con 0x7f36bc06f2a0 2024-09-17T01:32:48.218 INFO:teuthology.orchestra.run.smithi042.stderr: removed all blocklist entries 2024-09-17T01:32:48.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.224+0000 7f36c3000640 1 -- 172.21.15.42:0/3451933379 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3698078b90 msgr2=0x7f369807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:48.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.224+0000 7f36c3000640 1 --2- 172.21.15.42:0/3451933379 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3698078b90 0x7f369807b0a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f36ac034000 tx=0x7f36ac004730 comp rx=0 tx=0).stop 2024-09-17T01:32:48.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.224+0000 7f36c3000640 1 -- 172.21.15.42:0/3451933379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36bc06f2a0 msgr2=0x7f36bc0b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:48.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.224+0000 7f36c3000640 1 --2- 172.21.15.42:0/3451933379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36bc06f2a0 0x7f36bc0b1080 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f36a400c430 tx=0x7f36a400c8f0 comp rx=0 tx=0).stop 2024-09-17T01:32:48.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.224+0000 7f36c3000640 1 -- 172.21.15.42:0/3451933379 shutdown_connections 2024-09-17T01:32:48.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.224+0000 7f36c3000640 1 --2- 172.21.15.42:0/3451933379 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3698078b90 0x7f369807b0a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:48.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.224+0000 7f36c3000640 1 --2- 172.21.15.42:0/3451933379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36bc073df0 0x7f36bc0b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:48.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.224+0000 7f36c3000640 1 --2- 172.21.15.42:0/3451933379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36bc06f2a0 0x7f36bc0b1080 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:48.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.224+0000 7f36c3000640 1 --2- 172.21.15.42:0/3451933379 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36bc06ee90 0x7f36bc0b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:48.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.224+0000 7f36c3000640 1 -- 172.21.15.42:0/3451933379 >> 172.21.15.42:0/3451933379 conn(0x7f36bc0b2930 msgr2=0x7f36bc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:48.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.224+0000 7f36c3000640 1 -- 172.21.15.42:0/3451933379 shutdown_connections 2024-09-17T01:32:48.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.224+0000 7f36c3000640 1 -- 172.21.15.42:0/3451933379 wait complete. 2024-09-17T01:32:48.247 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T01:32:48.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.479+0000 7ff798400640 1 -- 172.21.15.42:0/3384793668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff790072e90 msgr2=0x7ff7900cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:48.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.479+0000 7ff798400640 1 --2- 172.21.15.42:0/3384793668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff790072e90 0x7ff7900cec40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff7900704d0 tx=0x7ff78802aa30 comp rx=0 tx=0).stop 2024-09-17T01:32:48.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.480+0000 7ff798400640 1 -- 172.21.15.42:0/3384793668 shutdown_connections 2024-09-17T01:32:48.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.480+0000 7ff798400640 1 --2- 172.21.15.42:0/3384793668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff790072e90 0x7ff7900cec40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:48.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.480+0000 7ff798400640 1 --2- 172.21.15.42:0/3384793668 >> v2:172.21.15.43:3300/0 conn(0x7ff790142f40 0x7ff790072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:48.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.480+0000 7ff798400640 1 -- 172.21.15.42:0/3384793668 >> 172.21.15.42:0/3384793668 conn(0x7ff7900b2930 msgr2=0x7ff79006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:48.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.480+0000 7ff798400640 1 -- 172.21.15.42:0/3384793668 shutdown_connections 2024-09-17T01:32:48.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.480+0000 7ff798400640 1 -- 172.21.15.42:0/3384793668 wait complete. 2024-09-17T01:32:48.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.482+0000 7ff798400640 1 Processor -- start 2024-09-17T01:32:48.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.482+0000 7ff798400640 1 -- start start 2024-09-17T01:32:48.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.483+0000 7ff798400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff790072e90 0x7ff7901f6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:48.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.483+0000 7ff798400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7900b3550 0x7ff79013ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:48.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.483+0000 7ff798400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff790142f40 0x7ff7900ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:48.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.483+0000 7ff798400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff79006d5b0 con 0x7ff790142f40 2024-09-17T01:32:48.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.483+0000 7ff798400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff79006d430 con 0x7ff7900b3550 2024-09-17T01:32:48.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.483+0000 7ff798400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff79006d730 con 0x7ff790072e90 2024-09-17T01:32:48.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.484+0000 7ff796400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff790142f40 0x7ff7900ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:48.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.484+0000 7ff796400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff790142f40 0x7ff7900ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51282/0 (socket says 172.21.15.42:51282) 2024-09-17T01:32:48.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.484+0000 7ff796400640 1 -- 172.21.15.42:0/108291253 learned_addr learned my addr 172.21.15.42:0/108291253 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:48.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.484+0000 7ff795000640 1 --2- 172.21.15.42:0/108291253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7900b3550 0x7ff79013ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:48.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.484+0000 7ff795a00640 1 --2- 172.21.15.42:0/108291253 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff790072e90 0x7ff7901f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:48.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.484+0000 7ff796400640 1 -- 172.21.15.42:0/108291253 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff790072e90 msgr2=0x7ff7901f6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:48.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.484+0000 7ff796400640 1 --2- 172.21.15.42:0/108291253 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff790072e90 0x7ff7901f6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:48.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.484+0000 7ff796400640 1 -- 172.21.15.42:0/108291253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7900b3550 msgr2=0x7ff79013ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:48.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.484+0000 7ff796400640 1 --2- 172.21.15.42:0/108291253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7900b3550 0x7ff79013ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:48.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.484+0000 7ff796400640 1 -- 172.21.15.42:0/108291253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff79006e2f0 con 0x7ff790142f40 2024-09-17T01:32:48.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.484+0000 7ff795a00640 1 --2- 172.21.15.42:0/108291253 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff790072e90 0x7ff7901f6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:48.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.485+0000 7ff796400640 1 --2- 172.21.15.42:0/108291253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff790142f40 0x7ff7900ae8a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff788009d60 tx=0x7ff788003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:48.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.485+0000 7ff78d600640 1 -- 172.21.15.42:0/108291253 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff788033050 con 0x7ff790142f40 2024-09-17T01:32:48.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.485+0000 7ff78d600640 1 -- 172.21.15.42:0/108291253 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff788004450 con 0x7ff790142f40 2024-09-17T01:32:48.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.485+0000 7ff78d600640 1 -- 172.21.15.42:0/108291253 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff788038450 con 0x7ff790142f40 2024-09-17T01:32:48.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.485+0000 7ff798400640 1 -- 172.21.15.42:0/108291253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff79006e5d0 con 0x7ff790142f40 2024-09-17T01:32:48.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.485+0000 7ff798400640 1 -- 172.21.15.42:0/108291253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff79006eb90 con 0x7ff790142f40 2024-09-17T01:32:48.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.486+0000 7ff798400640 1 -- 172.21.15.42:0/108291253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff79006dc50 con 0x7ff790142f40 2024-09-17T01:32:48.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.487+0000 7ff78d600640 1 -- 172.21.15.42:0/108291253 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff788036070 con 0x7ff790142f40 2024-09-17T01:32:48.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.489+0000 7ff78d600640 1 --2- 172.21.15.42:0/108291253 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff770078b90 0x7ff77007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:48.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.489+0000 7ff78d600640 1 -- 172.21.15.42:0/108291253 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7ff7880bbe80 con 0x7ff790142f40 2024-09-17T01:32:48.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.489+0000 7ff795a00640 1 --2- 172.21.15.42:0/108291253 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff770078b90 0x7ff77007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:48.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.490+0000 7ff795a00640 1 --2- 172.21.15.42:0/108291253 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff770078b90 0x7ff77007b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff784007fd0 tx=0x7ff784009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:48.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.494+0000 7ff78d600640 1 -- 172.21.15.42:0/108291253 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff788084570 con 0x7ff790142f40 2024-09-17T01:32:48.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.758+0000 7ff798400640 1 -- 172.21.15.42:0/108291253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ff79006a170 con 0x7ff790142f40 2024-09-17T01:32:48.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.759+0000 7ff78d600640 1 -- 172.21.15.42:0/108291253 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) ==== 80+0+6645 (secure 0 0 0) 0x7ff788083e70 con 0x7ff790142f40 2024-09-17T01:32:48.757 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:48.757 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:32:48.757 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_dump": [ 2024-09-17T01:32:48.757 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.757 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.a", 2024-09-17T01:32:48.757 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmyJK4HRAAIC4E4V7p1fqIEfPIICMxZg==", 2024-09-17T01:32:48.757 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.757 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:32:48.757 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:32:48.758 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:32:48.758 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:32:48.758 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:32:48.758 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.758 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.b", 2024-09-17T01:32:48.758 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmXv3vORAALPrYIM6Vtz0g1pOxVhrUig==", 2024-09-17T01:32:48.758 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.758 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:32:48.758 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:32:48.758 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:32:48.758 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:32:48.758 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.759 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:32:48.759 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.759 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.c", 2024-09-17T01:32:48.759 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmPE7MKxAA9mGG+EO9C3VGVMerOm92+Q==", 2024-09-17T01:32:48.759 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.759 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:32:48.759 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:32:48.759 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:32:48.759 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:32:48.759 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.759 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:32:48.759 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.759 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.d", 2024-09-17T01:32:48.759 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmaOBSDBAATU4tpjM5IMcuvzZFE7N5bQ==", 2024-09-17T01:32:48.759 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.760 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:32:48.760 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:32:48.760 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:32:48.760 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:32:48.760 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.760 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:32:48.760 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.760 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.0", 2024-09-17T01:32:48.760 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDP2+hmEJebExAAAdGEoSzM96ybGT9h7t7OkA==", 2024-09-17T01:32:48.760 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.761 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:32:48.761 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:32:48.761 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:32:48.761 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.761 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:32:48.761 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.761 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.1", 2024-09-17T01:32:48.761 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDS2+hm7dWoMBAAagktrUl0O2/mgKCEfpAstA==", 2024-09-17T01:32:48.761 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.761 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:32:48.761 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:32:48.762 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:32:48.762 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.762 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:32:48.762 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.762 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.2", 2024-09-17T01:32:48.762 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDW2+hmEfSPBBAAPAa6EZt27yUcJSfZyCKheg==", 2024-09-17T01:32:48.762 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.762 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:32:48.762 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:32:48.762 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:32:48.762 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.763 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:32:48.763 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.763 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.3", 2024-09-17T01:32:48.763 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDZ2+hmHQhXFRAAj84g+IKqH6KMP7LjRtFvLw==", 2024-09-17T01:32:48.763 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.763 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:32:48.763 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:32:48.763 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:32:48.763 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.763 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:32:48.763 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.763 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.4", 2024-09-17T01:32:48.763 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDd2+hmaNcMNBAAx1GV/oFdfssMjFWFN5M0VQ==", 2024-09-17T01:32:48.763 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.764 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:32:48.764 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:32:48.764 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:32:48.764 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:32:48.764 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.764 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.5", 2024-09-17T01:32:48.764 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDh2+hm301NJhAAnSUH5AAvqhPwM7loH6frww==", 2024-09-17T01:32:48.764 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.764 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:32:48.764 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:32:48.764 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:32:48.764 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:32:48.765 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.765 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.6", 2024-09-17T01:32:48.765 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDk2+hm61WNNRAAbCvVvsUpB4fgt4ja60DRZA==", 2024-09-17T01:32:48.765 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.765 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:32:48.765 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:32:48.765 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:32:48.765 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:32:48.765 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.765 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.7", 2024-09-17T01:32:48.765 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDo2+hmesiLFhAA29n1eageNvP+lkRyh6gGMw==", 2024-09-17T01:32:48.765 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.766 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:32:48.766 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:32:48.766 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:32:48.766 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.766 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:32:48.766 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.766 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.0", 2024-09-17T01:32:48.766 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA==", 2024-09-17T01:32:48.766 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.766 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:32:48.766 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:32:48.766 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:32:48.766 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:32:48.767 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:32:48.767 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.767 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.1", 2024-09-17T01:32:48.767 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmZLygLhAABlauZgnidFWvfCCPuBLObg==", 2024-09-17T01:32:48.767 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.767 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:32:48.767 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:32:48.767 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:32:48.767 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:32:48.767 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:32:48.767 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.767 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.2", 2024-09-17T01:32:48.768 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hm8lnZIxAAN0a2CVMMtu/Nz50OG4a02A==", 2024-09-17T01:32:48.768 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.768 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:32:48.768 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:32:48.768 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:32:48.768 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:32:48.768 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.768 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:32:48.768 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.768 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.3", 2024-09-17T01:32:48.768 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmgXdAORAAM5Uy66I4nnTJ9Vhkn9JoBw==", 2024-09-17T01:32:48.768 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.768 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:32:48.769 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:32:48.769 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:32:48.769 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:32:48.769 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.769 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:32:48.769 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.769 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.admin", 2024-09-17T01:32:48.769 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDL2+hmvCreHBAA4CSAhosssViGqD93U+I7Iw==", 2024-09-17T01:32:48.769 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.769 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:32:48.770 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:32:48.770 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:32:48.770 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:32:48.770 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.770 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:32:48.770 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.770 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.bootstrap-mds", 2024-09-17T01:32:48.770 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQD72+hmXLx/GRAALgkv5QTZ7YtRf1BJnhsr+g==", 2024-09-17T01:32:48.770 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.770 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile bootstrap-mds" 2024-09-17T01:32:48.770 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.770 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:32:48.770 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.771 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.bootstrap-mgr", 2024-09-17T01:32:48.771 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQD72+hm6tB/GRAA5OBIsm5PQbhLJVWBt1rH7g==", 2024-09-17T01:32:48.771 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.771 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-17T01:32:48.771 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.771 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:32:48.771 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.771 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.bootstrap-osd", 2024-09-17T01:32:48.771 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQD72+hmsOB/GRAAFNV7zx/ShcjQJ4A0oUpnpA==", 2024-09-17T01:32:48.771 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.771 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile bootstrap-osd" 2024-09-17T01:32:48.771 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.771 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:32:48.771 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.772 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.bootstrap-rbd", 2024-09-17T01:32:48.772 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQD72+hm6+9/GRAA/wIqnh2YYeK0lp2O4uQ41Q==", 2024-09-17T01:32:48.772 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.772 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-17T01:32:48.772 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.772 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:32:48.772 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.772 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-17T01:32:48.772 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQD72+hms/1/GRAAJNiEMSuxhwKG6rAF60p87g==", 2024-09-17T01:32:48.772 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.772 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-17T01:32:48.772 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.772 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:32:48.772 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.773 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.bootstrap-rgw", 2024-09-17T01:32:48.773 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQD72+hmYQeAGRAAwNXtv4Nl9v/SBovbN/Oa5w==", 2024-09-17T01:32:48.773 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.773 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-17T01:32:48.773 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.773 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:32:48.773 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.773 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.x", 2024-09-17T01:32:48.773 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmYPnlEhAAIcQ11ktWZyMXYdbAONiLog==", 2024-09-17T01:32:48.773 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.773 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:32:48.774 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:32:48.774 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:32:48.774 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.774 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:32:48.774 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:48.774 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.y", 2024-09-17T01:32:48.774 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmpCZtBxAAp5tXMc6aEq1aOny2LJZAiA==", 2024-09-17T01:32:48.774 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:32:48.775 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:32:48.775 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:32:48.775 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:32:48.776 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.776 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:48.776 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-17T01:32:48.776 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:32:48.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.761+0000 7ff798400640 1 -- 172.21.15.42:0/108291253 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff770078b90 msgr2=0x7ff77007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:48.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.761+0000 7ff798400640 1 --2- 172.21.15.42:0/108291253 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff770078b90 0x7ff77007b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff784007fd0 tx=0x7ff784009040 comp rx=0 tx=0).stop 2024-09-17T01:32:48.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.761+0000 7ff798400640 1 -- 172.21.15.42:0/108291253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff790142f40 msgr2=0x7ff7900ae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:48.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.761+0000 7ff798400640 1 --2- 172.21.15.42:0/108291253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff790142f40 0x7ff7900ae8a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff788009d60 tx=0x7ff788003f10 comp rx=0 tx=0).stop 2024-09-17T01:32:48.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.761+0000 7ff798400640 1 -- 172.21.15.42:0/108291253 shutdown_connections 2024-09-17T01:32:48.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.761+0000 7ff798400640 1 --2- 172.21.15.42:0/108291253 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff770078b90 0x7ff77007b0a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:48.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.761+0000 7ff798400640 1 --2- 172.21.15.42:0/108291253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7900b3550 0x7ff79013ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:48.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.761+0000 7ff798400640 1 --2- 172.21.15.42:0/108291253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff790142f40 0x7ff7900ae8a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:48.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.761+0000 7ff798400640 1 --2- 172.21.15.42:0/108291253 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff790072e90 0x7ff7901f6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:48.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.761+0000 7ff798400640 1 -- 172.21.15.42:0/108291253 >> 172.21.15.42:0/108291253 conn(0x7ff7900b2930 msgr2=0x7ff79015af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:48.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.761+0000 7ff798400640 1 -- 172.21.15.42:0/108291253 shutdown_connections 2024-09-17T01:32:48.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:48.761+0000 7ff798400640 1 -- 172.21.15.42:0/108291253 wait complete. 2024-09-17T01:32:48.780 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-17T01:32:48.934 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:32:48.938 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:32:49.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.011+0000 7f4740000640 1 -- 172.21.15.42:0/1448678949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4720003a50 msgr2=0x7f4720003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:49.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.011+0000 7f4740000640 1 --2- 172.21.15.42:0/1448678949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4720003a50 0x7f4720003ee0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f472c009d00 tx=0x7f4720005830 comp rx=0 tx=0).stop 2024-09-17T01:32:49.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.011+0000 7f4740000640 1 -- 172.21.15.42:0/1448678949 shutdown_connections 2024-09-17T01:32:49.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.011+0000 7f4740000640 1 --2- 172.21.15.42:0/1448678949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4720003a50 0x7f4720003ee0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:49.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.011+0000 7f4740000640 1 -- 172.21.15.42:0/1448678949 >> 172.21.15.42:0/1448678949 conn(0x7f473806d140 msgr2=0x7f473806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:49.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.011+0000 7f4740000640 1 -- 172.21.15.42:0/1448678949 shutdown_connections 2024-09-17T01:32:49.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.011+0000 7f4740000640 1 -- 172.21.15.42:0/1448678949 wait complete. 2024-09-17T01:32:49.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.013+0000 7f4740000640 1 Processor -- start 2024-09-17T01:32:49.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.013+0000 7f4740000640 1 -- start start 2024-09-17T01:32:49.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.015+0000 7f4740000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4720003a50 0x7f4738160c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:49.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.015+0000 7f4740000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4738151800 0x7f47381511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:49.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.015+0000 7f4740000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4738152610 0x7f4738152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:49.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.015+0000 7f4740000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f47380cf340 con 0x7f4738152610 2024-09-17T01:32:49.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.015+0000 7f4740000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f47380b36b0 con 0x7f4720003a50 2024-09-17T01:32:49.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.015+0000 7f4740000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f47380cf4c0 con 0x7f4738151800 2024-09-17T01:32:49.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.015+0000 7f473e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4738152610 0x7f4738152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:49.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.015+0000 7f473e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4738152610 0x7f4738152a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51300/0 (socket says 172.21.15.42:51300) 2024-09-17T01:32:49.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.015+0000 7f473e000640 1 -- 172.21.15.42:0/1465071929 learned_addr learned my addr 172.21.15.42:0/1465071929 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:49.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.015+0000 7f473d600640 1 --2- 172.21.15.42:0/1465071929 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4720003a50 0x7f4738160c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:49.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.015+0000 7f473cc00640 1 --2- 172.21.15.42:0/1465071929 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4738151800 0x7f47381511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:49.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.015+0000 7f473e000640 1 -- 172.21.15.42:0/1465071929 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4738151800 msgr2=0x7f47381511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:49.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.015+0000 7f473e000640 1 --2- 172.21.15.42:0/1465071929 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4738151800 0x7f47381511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:49.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.015+0000 7f473e000640 1 -- 172.21.15.42:0/1465071929 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4720003a50 msgr2=0x7f4738160c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:49.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.015+0000 7f473e000640 1 --2- 172.21.15.42:0/1465071929 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4720003a50 0x7f4738160c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:49.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.015+0000 7f473e000640 1 -- 172.21.15.42:0/1465071929 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4738152f60 con 0x7f4738152610 2024-09-17T01:32:49.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.016+0000 7f473e000640 1 --2- 172.21.15.42:0/1465071929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4738152610 0x7f4738152a20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f47380cf0e0 tx=0x7f4730006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:49.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.016+0000 7f4735600640 1 -- 172.21.15.42:0/1465071929 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4730011900 con 0x7f4738152610 2024-09-17T01:32:49.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.016+0000 7f4735600640 1 -- 172.21.15.42:0/1465071929 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4730018070 con 0x7f4738152610 2024-09-17T01:32:49.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.016+0000 7f4740000640 1 -- 172.21.15.42:0/1465071929 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47381622c0 con 0x7f4738152610 2024-09-17T01:32:49.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.016+0000 7f4735600640 1 -- 172.21.15.42:0/1465071929 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4730011d60 con 0x7f4738152610 2024-09-17T01:32:49.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.016+0000 7f4740000640 1 -- 172.21.15.42:0/1465071929 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f473815fe70 con 0x7f4738152610 2024-09-17T01:32:49.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.017+0000 7f4740000640 1 -- 172.21.15.42:0/1465071929 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47380d33b0 con 0x7f4738152610 2024-09-17T01:32:49.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.019+0000 7f4735600640 1 -- 172.21.15.42:0/1465071929 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f473001d460 con 0x7f4738152610 2024-09-17T01:32:49.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.019+0000 7f4735600640 1 --2- 172.21.15.42:0/1465071929 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4718078bc0 0x7f471807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:49.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.020+0000 7f4735600640 1 -- 172.21.15.42:0/1465071929 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f473009b270 con 0x7f4738152610 2024-09-17T01:32:49.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.020+0000 7f473d600640 1 --2- 172.21.15.42:0/1465071929 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4718078bc0 0x7f471807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:49.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.021+0000 7f473d600640 1 --2- 172.21.15.42:0/1465071929 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4718078bc0 0x7f471807b0d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f472c035000 tx=0x7f472c0046c0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:49.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.024+0000 7f4735600640 1 -- 172.21.15.42:0/1465071929 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f47300633a0 con 0x7f4738152610 2024-09-17T01:32:49.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.293+0000 7f4740000640 1 -- 172.21.15.42:0/1465071929 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f47380c7e60 con 0x7f4738152610 2024-09-17T01:32:49.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.296+0000 7f4735600640 1 -- 172.21.15.42:0/1465071929 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v23) ==== 90+0+0 (secure 0 0 0) 0x7f4730067dd0 con 0x7f4738152610 2024-09-17T01:32:49.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.298+0000 7f4740000640 1 -- 172.21.15.42:0/1465071929 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4718078bc0 msgr2=0x7f471807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:49.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.298+0000 7f4740000640 1 --2- 172.21.15.42:0/1465071929 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4718078bc0 0x7f471807b0d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f472c035000 tx=0x7f472c0046c0 comp rx=0 tx=0).stop 2024-09-17T01:32:49.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.298+0000 7f4740000640 1 -- 172.21.15.42:0/1465071929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4738152610 msgr2=0x7f4738152a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:49.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.298+0000 7f4740000640 1 --2- 172.21.15.42:0/1465071929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4738152610 0x7f4738152a20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f47380cf0e0 tx=0x7f4730006430 comp rx=0 tx=0).stop 2024-09-17T01:32:49.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.298+0000 7f4740000640 1 -- 172.21.15.42:0/1465071929 shutdown_connections 2024-09-17T01:32:49.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.298+0000 7f4740000640 1 --2- 172.21.15.42:0/1465071929 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4718078bc0 0x7f471807b0d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:49.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.298+0000 7f4740000640 1 --2- 172.21.15.42:0/1465071929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4738152610 0x7f4738152a20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:49.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.298+0000 7f4740000640 1 --2- 172.21.15.42:0/1465071929 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4738151800 0x7f47381511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:49.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.298+0000 7f4740000640 1 --2- 172.21.15.42:0/1465071929 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4720003a50 0x7f4738160c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:49.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.298+0000 7f4740000640 1 -- 172.21.15.42:0/1465071929 >> 172.21.15.42:0/1465071929 conn(0x7f473806d140 msgr2=0x7f47380b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:49.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.298+0000 7f4740000640 1 -- 172.21.15.42:0/1465071929 shutdown_connections 2024-09-17T01:32:49.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.298+0000 7f4740000640 1 -- 172.21.15.42:0/1465071929 wait complete. 2024-09-17T01:32:49.319 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-17T01:32:49.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.550+0000 7f2c36400640 1 -- 172.21.15.42:0/1851729825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c300b3550 msgr2=0x7f2c3015cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:49.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.550+0000 7f2c36400640 1 --2- 172.21.15.42:0/1851729825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c300b3550 0x7f2c3015cec0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2c20009830 tx=0x7f2c2002a490 comp rx=0 tx=0).stop 2024-09-17T01:32:49.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.550+0000 7f2c36400640 1 -- 172.21.15.42:0/1851729825 shutdown_connections 2024-09-17T01:32:49.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.550+0000 7f2c36400640 1 --2- 172.21.15.42:0/1851729825 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c30142f40 0x7f2c30072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:49.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.550+0000 7f2c36400640 1 --2- 172.21.15.42:0/1851729825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c300b3550 0x7f2c3015cec0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:49.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.550+0000 7f2c36400640 1 -- 172.21.15.42:0/1851729825 >> 172.21.15.42:0/1851729825 conn(0x7f2c300b2930 msgr2=0x7f2c3006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:49.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.550+0000 7f2c36400640 1 -- 172.21.15.42:0/1851729825 shutdown_connections 2024-09-17T01:32:49.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.550+0000 7f2c36400640 1 -- 172.21.15.42:0/1851729825 wait complete. 2024-09-17T01:32:49.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.553+0000 7f2c36400640 1 Processor -- start 2024-09-17T01:32:49.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.553+0000 7f2c36400640 1 -- start start 2024-09-17T01:32:49.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.554+0000 7f2c36400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c30072e90 0x7f2c30157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:49.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.554+0000 7f2c36400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c300b3550 0x7f2c3006e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:49.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.554+0000 7f2c36400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c30142f40 0x7f2c300ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:49.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.554+0000 7f2c36400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3006d7c0 con 0x7f2c30072e90 2024-09-17T01:32:49.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.554+0000 7f2c36400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3006d640 con 0x7f2c300b3550 2024-09-17T01:32:49.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.554+0000 7f2c36400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2c3006d940 con 0x7f2c30142f40 2024-09-17T01:32:49.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.554+0000 7f2c2f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c30072e90 0x7f2c30157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:49.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.554+0000 7f2c2f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c30072e90 0x7f2c30157e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51320/0 (socket says 172.21.15.42:51320) 2024-09-17T01:32:49.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.554+0000 7f2c2f400640 1 -- 172.21.15.42:0/501298050 learned_addr learned my addr 172.21.15.42:0/501298050 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:49.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.555+0000 7f2c2ea00640 1 --2- 172.21.15.42:0/501298050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c300b3550 0x7f2c3006e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:49.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.555+0000 7f2c2fe00640 1 --2- 172.21.15.42:0/501298050 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c30142f40 0x7f2c300ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:49.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.555+0000 7f2c2f400640 1 -- 172.21.15.42:0/501298050 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c30142f40 msgr2=0x7f2c300ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:49.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.555+0000 7f2c2f400640 1 --2- 172.21.15.42:0/501298050 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c30142f40 0x7f2c300ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:49.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.555+0000 7f2c2f400640 1 -- 172.21.15.42:0/501298050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c300b3550 msgr2=0x7f2c3006e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:49.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.555+0000 7f2c2f400640 1 --2- 172.21.15.42:0/501298050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c300b3550 0x7f2c3006e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:49.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.555+0000 7f2c2f400640 1 -- 172.21.15.42:0/501298050 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c3013f510 con 0x7f2c30072e90 2024-09-17T01:32:49.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.555+0000 7f2c2ea00640 1 --2- 172.21.15.42:0/501298050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c300b3550 0x7f2c3006e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:32:49.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.555+0000 7f2c2fe00640 1 --2- 172.21.15.42:0/501298050 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c30142f40 0x7f2c300ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:32:49.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.555+0000 7f2c2f400640 1 --2- 172.21.15.42:0/501298050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c30072e90 0x7f2c30157e50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2c20009950 tx=0x7f2c20033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:49.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.556+0000 7f2c27400640 1 -- 172.21.15.42:0/501298050 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c20005c90 con 0x7f2c30072e90 2024-09-17T01:32:49.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.556+0000 7f2c27400640 1 -- 172.21.15.42:0/501298050 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c20031e50 con 0x7f2c30072e90 2024-09-17T01:32:49.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.556+0000 7f2c27400640 1 -- 172.21.15.42:0/501298050 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c20005260 con 0x7f2c30072e90 2024-09-17T01:32:49.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.556+0000 7f2c36400640 1 -- 172.21.15.42:0/501298050 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c3006ebd0 con 0x7f2c30072e90 2024-09-17T01:32:49.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.556+0000 7f2c36400640 1 -- 172.21.15.42:0/501298050 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c3013f780 con 0x7f2c30072e90 2024-09-17T01:32:49.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.557+0000 7f2c36400640 1 -- 172.21.15.42:0/501298050 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c30142640 con 0x7f2c30072e90 2024-09-17T01:32:49.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.558+0000 7f2c27400640 1 -- 172.21.15.42:0/501298050 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2c20005400 con 0x7f2c30072e90 2024-09-17T01:32:49.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.559+0000 7f2c27400640 1 --2- 172.21.15.42:0/501298050 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2c10078b90 0x7f2c1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:49.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.559+0000 7f2c27400640 1 -- 172.21.15.42:0/501298050 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f2c200bbc30 con 0x7f2c30072e90 2024-09-17T01:32:49.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.560+0000 7f2c2ea00640 1 --2- 172.21.15.42:0/501298050 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2c10078b90 0x7f2c1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:49.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.560+0000 7f2c2ea00640 1 --2- 172.21.15.42:0/501298050 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2c10078b90 0x7f2c1007b0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2c300701f0 tx=0x7f2c1c005dd0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:49.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.564+0000 7f2c27400640 1 -- 172.21.15.42:0/501298050 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2c30142640 con 0x7f2c30072e90 2024-09-17T01:32:49.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.833+0000 7f2c36400640 1 -- 172.21.15.42:0/501298050 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f2c3015cec0 con 0x7f2c30072e90 2024-09-17T01:32:49.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.836+0000 7f2c27400640 1 -- 172.21.15.42:0/501298050 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v24) ==== 90+0+0 (secure 0 0 0) 0x7f2c2003f030 con 0x7f2c30072e90 2024-09-17T01:32:49.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.838+0000 7f2c36400640 1 -- 172.21.15.42:0/501298050 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2c10078b90 msgr2=0x7f2c1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:49.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.839+0000 7f2c36400640 1 --2- 172.21.15.42:0/501298050 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2c10078b90 0x7f2c1007b0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2c300701f0 tx=0x7f2c1c005dd0 comp rx=0 tx=0).stop 2024-09-17T01:32:49.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.839+0000 7f2c36400640 1 -- 172.21.15.42:0/501298050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c30072e90 msgr2=0x7f2c30157e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:49.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.839+0000 7f2c36400640 1 --2- 172.21.15.42:0/501298050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c30072e90 0x7f2c30157e50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2c20009950 tx=0x7f2c20033c90 comp rx=0 tx=0).stop 2024-09-17T01:32:49.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.839+0000 7f2c36400640 1 -- 172.21.15.42:0/501298050 shutdown_connections 2024-09-17T01:32:49.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.839+0000 7f2c36400640 1 --2- 172.21.15.42:0/501298050 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2c10078b90 0x7f2c1007b0a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:49.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.839+0000 7f2c36400640 1 --2- 172.21.15.42:0/501298050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c300b3550 0x7f2c3006e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:49.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.839+0000 7f2c36400640 1 --2- 172.21.15.42:0/501298050 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c30142f40 0x7f2c300ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:49.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.839+0000 7f2c36400640 1 --2- 172.21.15.42:0/501298050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c30072e90 0x7f2c30157e50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:49.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.839+0000 7f2c36400640 1 -- 172.21.15.42:0/501298050 >> 172.21.15.42:0/501298050 conn(0x7f2c300b2930 msgr2=0x7f2c3015f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:49.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.839+0000 7f2c36400640 1 -- 172.21.15.42:0/501298050 shutdown_connections 2024-09-17T01:32:49.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:49.839+0000 7f2c36400640 1 -- 172.21.15.42:0/501298050 wait complete. 2024-09-17T01:32:49.858 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-17T01:32:50.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.088+0000 7f4c8f200640 1 -- 172.21.15.42:0/3656081876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c900b7610 msgr2=0x7f4c900cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:50.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.088+0000 7f4c8f200640 1 --2- 172.21.15.42:0/3656081876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c900b7610 0x7f4c900cef90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4c90073bb0 tx=0x7f4c8802a8b0 comp rx=0 tx=0).stop 2024-09-17T01:32:50.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.088+0000 7f4c8f200640 1 -- 172.21.15.42:0/3656081876 shutdown_connections 2024-09-17T01:32:50.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.088+0000 7f4c8f200640 1 --2- 172.21.15.42:0/3656081876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c900b7610 0x7f4c900cef90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:50.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.088+0000 7f4c8f200640 1 --2- 172.21.15.42:0/3656081876 >> v2:172.21.15.43:3300/0 conn(0x7f4c900ccd80 0x7f4c900ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:50.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.088+0000 7f4c8f200640 1 -- 172.21.15.42:0/3656081876 >> 172.21.15.42:0/3656081876 conn(0x7f4c900b3ed0 msgr2=0x7f4c900b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:50.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.088+0000 7f4c8f200640 1 -- 172.21.15.42:0/3656081876 shutdown_connections 2024-09-17T01:32:50.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.088+0000 7f4c8f200640 1 -- 172.21.15.42:0/3656081876 wait complete. 2024-09-17T01:32:50.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.090+0000 7f4c8f200640 1 Processor -- start 2024-09-17T01:32:50.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.090+0000 7f4c8f200640 1 -- start start 2024-09-17T01:32:50.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.092+0000 7f4c8f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4c900b7610 0x7f4c9015a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:50.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.092+0000 7f4c8f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c900b7b80 0x7f4c901f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:50.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.092+0000 7f4c8f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c9015b290 0x7f4c901f6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:50.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.092+0000 7f4c8f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4c900cf4d0 con 0x7f4c900b7b80 2024-09-17T01:32:50.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.092+0000 7f4c8f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4c900ceaf0 con 0x7f4c9015b290 2024-09-17T01:32:50.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.092+0000 7f4c8f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4c900cf650 con 0x7f4c900b7610 2024-09-17T01:32:50.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.092+0000 7f4c85400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c900b7b80 0x7f4c901f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:50.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.092+0000 7f4c85400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c900b7b80 0x7f4c901f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51352/0 (socket says 172.21.15.42:51352) 2024-09-17T01:32:50.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.092+0000 7f4c85400640 1 -- 172.21.15.42:0/3646753831 learned_addr learned my addr 172.21.15.42:0/3646753831 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:50.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.092+0000 7f4c8de00640 1 --2- 172.21.15.42:0/3646753831 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4c900b7610 0x7f4c9015a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:50.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.092+0000 7f4c8e800640 1 --2- 172.21.15.42:0/3646753831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c9015b290 0x7f4c901f6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:50.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.093+0000 7f4c85400640 1 -- 172.21.15.42:0/3646753831 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4c900b7610 msgr2=0x7f4c9015a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:50.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.093+0000 7f4c85400640 1 --2- 172.21.15.42:0/3646753831 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4c900b7610 0x7f4c9015a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:50.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.093+0000 7f4c85400640 1 -- 172.21.15.42:0/3646753831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c9015b290 msgr2=0x7f4c901f6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:50.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.093+0000 7f4c85400640 1 --2- 172.21.15.42:0/3646753831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c9015b290 0x7f4c901f6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:50.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.093+0000 7f4c85400640 1 -- 172.21.15.42:0/3646753831 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c901f72f0 con 0x7f4c900b7b80 2024-09-17T01:32:50.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.093+0000 7f4c8e800640 1 --2- 172.21.15.42:0/3646753831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c9015b290 0x7f4c901f6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:50.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.093+0000 7f4c85400640 1 --2- 172.21.15.42:0/3646753831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c900b7b80 0x7f4c901f64e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4c7800c3c0 tx=0x7f4c7800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:50.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.093+0000 7f4c86a00640 1 -- 172.21.15.42:0/3646753831 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c78011790 con 0x7f4c900b7b80 2024-09-17T01:32:50.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.093+0000 7f4c86a00640 1 -- 172.21.15.42:0/3646753831 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c78017070 con 0x7f4c900b7b80 2024-09-17T01:32:50.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.093+0000 7f4c8f200640 1 -- 172.21.15.42:0/3646753831 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c900b2ee0 con 0x7f4c900b7b80 2024-09-17T01:32:50.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.093+0000 7f4c86a00640 1 -- 172.21.15.42:0/3646753831 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c78011ce0 con 0x7f4c900b7b80 2024-09-17T01:32:50.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.094+0000 7f4c8f200640 1 -- 172.21.15.42:0/3646753831 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c9015af00 con 0x7f4c900b7b80 2024-09-17T01:32:50.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.094+0000 7f4c8f200640 1 -- 172.21.15.42:0/3646753831 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c900cfb00 con 0x7f4c900b7b80 2024-09-17T01:32:50.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.096+0000 7f4c86a00640 1 -- 172.21.15.42:0/3646753831 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4c7801c460 con 0x7f4c900b7b80 2024-09-17T01:32:50.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.097+0000 7f4c86a00640 1 --2- 172.21.15.42:0/3646753831 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4c6c078bc0 0x7f4c6c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:50.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.097+0000 7f4c86a00640 1 -- 172.21.15.42:0/3646753831 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f4c7809a7a0 con 0x7f4c900b7b80 2024-09-17T01:32:50.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.097+0000 7f4c8de00640 1 --2- 172.21.15.42:0/3646753831 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4c6c078bc0 0x7f4c6c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:50.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.098+0000 7f4c8de00640 1 --2- 172.21.15.42:0/3646753831 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4c6c078bc0 0x7f4c6c07b0d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4c900a0500 tx=0x7f4c80005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:50.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.101+0000 7f4c86a00640 1 -- 172.21.15.42:0/3646753831 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4c78062e90 con 0x7f4c900b7b80 2024-09-17T01:32:50.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.367+0000 7f4c8f200640 1 -- 172.21.15.42:0/3646753831 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f4c9009c330 con 0x7f4c900b7b80 2024-09-17T01:32:50.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.371+0000 7f4c86a00640 1 -- 172.21.15.42:0/3646753831 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v25) ==== 90+0+0 (secure 0 0 0) 0x7f4c78062790 con 0x7f4c900b7b80 2024-09-17T01:32:50.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.373+0000 7f4c8f200640 1 -- 172.21.15.42:0/3646753831 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4c6c078bc0 msgr2=0x7f4c6c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:50.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.373+0000 7f4c8f200640 1 --2- 172.21.15.42:0/3646753831 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4c6c078bc0 0x7f4c6c07b0d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4c900a0500 tx=0x7f4c80005f90 comp rx=0 tx=0).stop 2024-09-17T01:32:50.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.373+0000 7f4c8f200640 1 -- 172.21.15.42:0/3646753831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c900b7b80 msgr2=0x7f4c901f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:50.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.373+0000 7f4c8f200640 1 --2- 172.21.15.42:0/3646753831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c900b7b80 0x7f4c901f64e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4c7800c3c0 tx=0x7f4c7800c880 comp rx=0 tx=0).stop 2024-09-17T01:32:50.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.373+0000 7f4c8f200640 1 -- 172.21.15.42:0/3646753831 shutdown_connections 2024-09-17T01:32:50.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.373+0000 7f4c8f200640 1 --2- 172.21.15.42:0/3646753831 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4c6c078bc0 0x7f4c6c07b0d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:50.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.373+0000 7f4c8f200640 1 --2- 172.21.15.42:0/3646753831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c9015b290 0x7f4c901f6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:50.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.373+0000 7f4c8f200640 1 --2- 172.21.15.42:0/3646753831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4c900b7b80 0x7f4c901f64e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:50.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.373+0000 7f4c8f200640 1 --2- 172.21.15.42:0/3646753831 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4c900b7610 0x7f4c9015a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:50.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.373+0000 7f4c8f200640 1 -- 172.21.15.42:0/3646753831 >> 172.21.15.42:0/3646753831 conn(0x7f4c900b3ed0 msgr2=0x7f4c900b5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:50.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.373+0000 7f4c8f200640 1 -- 172.21.15.42:0/3646753831 shutdown_connections 2024-09-17T01:32:50.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.373+0000 7f4c8f200640 1 -- 172.21.15.42:0/3646753831 wait complete. 2024-09-17T01:32:50.396 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-17T01:32:50.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.625+0000 7fd467c00640 1 -- 172.21.15.42:0/1059668712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4480039e0 msgr2=0x7fd448003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:50.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.625+0000 7fd467c00640 1 --2- 172.21.15.42:0/1059668712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4480039e0 0x7fd448003e10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd454009b50 tx=0x7fd448005830 comp rx=0 tx=0).stop 2024-09-17T01:32:50.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.625+0000 7fd465c00640 1 -- 172.21.15.42:0/1059668712 reap_dead start 2024-09-17T01:32:50.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.625+0000 7fd467c00640 1 -- 172.21.15.42:0/1059668712 shutdown_connections 2024-09-17T01:32:50.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.625+0000 7fd467c00640 1 -- 172.21.15.42:0/1059668712 >> 172.21.15.42:0/1059668712 conn(0x7fd4600b2930 msgr2=0x7fd46006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:50.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.625+0000 7fd467c00640 1 -- 172.21.15.42:0/1059668712 shutdown_connections 2024-09-17T01:32:50.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.625+0000 7fd467c00640 1 -- 172.21.15.42:0/1059668712 wait complete. 2024-09-17T01:32:50.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.628+0000 7fd467c00640 1 Processor -- start 2024-09-17T01:32:50.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.628+0000 7fd467c00640 1 -- start start 2024-09-17T01:32:50.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.629+0000 7fd467c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4480039e0 0x7fd460158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:50.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.629+0000 7fd467c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4601f5e20 0x7fd4600ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:50.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.629+0000 7fd467c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd4601f6230 0x7fd4600aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:50.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.629+0000 7fd467c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd460073450 con 0x7fd4601f5e20 2024-09-17T01:32:50.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.629+0000 7fd467c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd460152d70 con 0x7fd4480039e0 2024-09-17T01:32:50.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.629+0000 7fd467c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd4600735d0 con 0x7fd4601f6230 2024-09-17T01:32:50.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.629+0000 7fd45fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4601f5e20 0x7fd4600ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:50.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.630+0000 7fd45fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4601f5e20 0x7fd4600ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51362/0 (socket says 172.21.15.42:51362) 2024-09-17T01:32:50.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.630+0000 7fd45fe00640 1 -- 172.21.15.42:0/3758757760 learned_addr learned my addr 172.21.15.42:0/3758757760 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:50.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.630+0000 7fd465200640 1 --2- 172.21.15.42:0/3758757760 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4480039e0 0x7fd460158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:50.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.630+0000 7fd465c00640 1 --2- 172.21.15.42:0/3758757760 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd4601f6230 0x7fd4600aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:50.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.630+0000 7fd45fe00640 1 -- 172.21.15.42:0/3758757760 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd4601f6230 msgr2=0x7fd4600aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:50.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.630+0000 7fd45fe00640 1 --2- 172.21.15.42:0/3758757760 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd4601f6230 0x7fd4600aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:50.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.630+0000 7fd45fe00640 1 -- 172.21.15.42:0/3758757760 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4480039e0 msgr2=0x7fd460158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:50.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.630+0000 7fd45fe00640 1 --2- 172.21.15.42:0/3758757760 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4480039e0 0x7fd460158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:50.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.630+0000 7fd45fe00640 1 -- 172.21.15.42:0/3758757760 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd460152f40 con 0x7fd4601f5e20 2024-09-17T01:32:50.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.630+0000 7fd45fe00640 1 --2- 172.21.15.42:0/3758757760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4601f5e20 0x7fd4600ae8a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd44c006de0 tx=0x7fd44c0049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:50.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.631+0000 7fd45cc00640 1 -- 172.21.15.42:0/3758757760 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44c015020 con 0x7fd4601f5e20 2024-09-17T01:32:50.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.631+0000 7fd45cc00640 1 -- 172.21.15.42:0/3758757760 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd44c011960 con 0x7fd4601f5e20 2024-09-17T01:32:50.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.631+0000 7fd45cc00640 1 -- 172.21.15.42:0/3758757760 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44c011db0 con 0x7fd4601f5e20 2024-09-17T01:32:50.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.631+0000 7fd467c00640 1 -- 172.21.15.42:0/3758757760 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd460153220 con 0x7fd4601f5e20 2024-09-17T01:32:50.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.631+0000 7fd467c00640 1 -- 172.21.15.42:0/3758757760 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4601537e0 con 0x7fd4601f5e20 2024-09-17T01:32:50.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.632+0000 7fd467c00640 1 -- 172.21.15.42:0/3758757760 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd460158910 con 0x7fd4601f5e20 2024-09-17T01:32:50.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.633+0000 7fd45cc00640 1 -- 172.21.15.42:0/3758757760 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd44c018020 con 0x7fd4601f5e20 2024-09-17T01:32:50.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.634+0000 7fd45cc00640 1 --2- 172.21.15.42:0/3758757760 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd440078bc0 0x7fd44007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:50.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.634+0000 7fd45cc00640 1 -- 172.21.15.42:0/3758757760 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fd44c09b3d0 con 0x7fd4601f5e20 2024-09-17T01:32:50.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.635+0000 7fd465200640 1 --2- 172.21.15.42:0/3758757760 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd440078bc0 0x7fd44007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:50.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.635+0000 7fd465200640 1 --2- 172.21.15.42:0/3758757760 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd440078bc0 0x7fd44007b0d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd454035000 tx=0x7fd45402d040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:50.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.639+0000 7fd45cc00640 1 -- 172.21.15.42:0/3758757760 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd44c01f020 con 0x7fd4601f5e20 2024-09-17T01:32:50.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.903+0000 7fd467c00640 1 -- 172.21.15.42:0/3758757760 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fd460073b10 con 0x7fd4601f5e20 2024-09-17T01:32:50.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.906+0000 7fd45cc00640 1 -- 172.21.15.42:0/3758757760 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v26) ==== 90+0+0 (secure 0 0 0) 0x7fd46015be20 con 0x7fd4601f5e20 2024-09-17T01:32:50.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.908+0000 7fd467c00640 1 -- 172.21.15.42:0/3758757760 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd440078bc0 msgr2=0x7fd44007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:50.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.908+0000 7fd467c00640 1 --2- 172.21.15.42:0/3758757760 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd440078bc0 0x7fd44007b0d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd454035000 tx=0x7fd45402d040 comp rx=0 tx=0).stop 2024-09-17T01:32:50.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.908+0000 7fd467c00640 1 -- 172.21.15.42:0/3758757760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4601f5e20 msgr2=0x7fd4600ae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:50.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.908+0000 7fd467c00640 1 --2- 172.21.15.42:0/3758757760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4601f5e20 0x7fd4600ae8a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd44c006de0 tx=0x7fd44c0049d0 comp rx=0 tx=0).stop 2024-09-17T01:32:50.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.908+0000 7fd467c00640 1 -- 172.21.15.42:0/3758757760 shutdown_connections 2024-09-17T01:32:50.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.908+0000 7fd467c00640 1 --2- 172.21.15.42:0/3758757760 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd440078bc0 0x7fd44007b0d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:50.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.908+0000 7fd467c00640 1 --2- 172.21.15.42:0/3758757760 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd4601f6230 0x7fd4600aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:50.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.908+0000 7fd467c00640 1 --2- 172.21.15.42:0/3758757760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd4601f5e20 0x7fd4600ae8a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:50.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.908+0000 7fd467c00640 1 --2- 172.21.15.42:0/3758757760 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4480039e0 0x7fd460158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:50.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.908+0000 7fd467c00640 1 -- 172.21.15.42:0/3758757760 >> 172.21.15.42:0/3758757760 conn(0x7fd4600b2930 msgr2=0x7fd460072340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:50.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.908+0000 7fd467c00640 1 -- 172.21.15.42:0/3758757760 shutdown_connections 2024-09-17T01:32:50.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:50.909+0000 7fd467c00640 1 -- 172.21.15.42:0/3758757760 wait complete. 2024-09-17T01:32:50.930 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-17T01:32:51.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.162+0000 7f5095200640 1 -- 172.21.15.42:0/1967787139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f509006d430 msgr2=0x7f509006d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:51.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.162+0000 7f5095200640 1 --2- 172.21.15.42:0/1967787139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f509006d430 0x7f509006d840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5088005fd0 tx=0x7f508802aa70 comp rx=0 tx=0).stop 2024-09-17T01:32:51.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.162+0000 7f5095200640 1 -- 172.21.15.42:0/1967787139 shutdown_connections 2024-09-17T01:32:51.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.162+0000 7f5095200640 1 --2- 172.21.15.42:0/1967787139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f509006d430 0x7f509006d840 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:51.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.162+0000 7f5095200640 1 --2- 172.21.15.42:0/1967787139 >> v2:172.21.15.43:3300/0 conn(0x7f50900cef70 0x7f5090156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:51.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.162+0000 7f5095200640 1 -- 172.21.15.42:0/1967787139 >> 172.21.15.42:0/1967787139 conn(0x7f50900b2930 msgr2=0x7f509006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:51.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.162+0000 7f5095200640 1 -- 172.21.15.42:0/1967787139 shutdown_connections 2024-09-17T01:32:51.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.162+0000 7f5095200640 1 -- 172.21.15.42:0/1967787139 wait complete. 2024-09-17T01:32:51.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.164+0000 7f5095200640 1 Processor -- start 2024-09-17T01:32:51.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.164+0000 7f5095200640 1 -- start start 2024-09-17T01:32:51.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.166+0000 7f5095200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f509006d430 0x7f50901478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:51.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.166+0000 7f5095200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50900b5100 0x7f5090144450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:51.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.166+0000 7f5095200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50900cef70 0x7f5090154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:51.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.166+0000 7f5095200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f50900729c0 con 0x7f50900b5100 2024-09-17T01:32:51.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.166+0000 7f5095200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5090072840 con 0x7f509006d430 2024-09-17T01:32:51.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.166+0000 7f5095200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5090072b40 con 0x7f50900cef70 2024-09-17T01:32:51.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.166+0000 7f5085400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50900b5100 0x7f5090144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:51.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.166+0000 7f5085400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50900b5100 0x7f5090144450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51384/0 (socket says 172.21.15.42:51384) 2024-09-17T01:32:51.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.166+0000 7f5085400640 1 -- 172.21.15.42:0/3429237451 learned_addr learned my addr 172.21.15.42:0/3429237451 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:51.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.166+0000 7f508de00640 1 --2- 172.21.15.42:0/3429237451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f509006d430 0x7f50901478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:51.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.166+0000 7f508e800640 1 --2- 172.21.15.42:0/3429237451 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50900cef70 0x7f5090154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:51.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.166+0000 7f5085400640 1 -- 172.21.15.42:0/3429237451 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50900cef70 msgr2=0x7f5090154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:51.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.166+0000 7f5085400640 1 --2- 172.21.15.42:0/3429237451 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50900cef70 0x7f5090154170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:51.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.166+0000 7f5085400640 1 -- 172.21.15.42:0/3429237451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f509006d430 msgr2=0x7f50901478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:51.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.166+0000 7f5085400640 1 --2- 172.21.15.42:0/3429237451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f509006d430 0x7f50901478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:51.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.166+0000 7f5085400640 1 -- 172.21.15.42:0/3429237451 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5090146e20 con 0x7f50900b5100 2024-09-17T01:32:51.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.166+0000 7f508de00640 1 --2- 172.21.15.42:0/3429237451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f509006d430 0x7f50901478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:32:51.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.166+0000 7f508e800640 1 --2- 172.21.15.42:0/3429237451 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50900cef70 0x7f5090154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:32:51.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.167+0000 7f5085400640 1 --2- 172.21.15.42:0/3429237451 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50900b5100 0x7f5090144450 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f507800d750 tx=0x7f507800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:51.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.167+0000 7f5086a00640 1 -- 172.21.15.42:0/3429237451 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5078017070 con 0x7f50900b5100 2024-09-17T01:32:51.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.167+0000 7f5086a00640 1 -- 172.21.15.42:0/3429237451 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5078009d20 con 0x7f50900b5100 2024-09-17T01:32:51.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.167+0000 7f5086a00640 1 -- 172.21.15.42:0/3429237451 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507800de60 con 0x7f50900b5100 2024-09-17T01:32:51.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.167+0000 7f5095200640 1 -- 172.21.15.42:0/3429237451 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50901f99e0 con 0x7f50900b5100 2024-09-17T01:32:51.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.167+0000 7f5095200640 1 -- 172.21.15.42:0/3429237451 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50901473a0 con 0x7f50900b5100 2024-09-17T01:32:51.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.168+0000 7f5095200640 1 -- 172.21.15.42:0/3429237451 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f509006d840 con 0x7f50900b5100 2024-09-17T01:32:51.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.170+0000 7f5086a00640 1 -- 172.21.15.42:0/3429237451 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5078004280 con 0x7f50900b5100 2024-09-17T01:32:51.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.170+0000 7f5086a00640 1 --2- 172.21.15.42:0/3429237451 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f506c078bc0 0x7f506c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:51.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.171+0000 7f5086a00640 1 -- 172.21.15.42:0/3429237451 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f507809ad90 con 0x7f50900b5100 2024-09-17T01:32:51.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.171+0000 7f508de00640 1 --2- 172.21.15.42:0/3429237451 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f506c078bc0 0x7f506c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:51.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.172+0000 7f508de00640 1 --2- 172.21.15.42:0/3429237451 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f506c078bc0 0x7f506c07b0d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f50800016a0 tx=0x7f5080009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:51.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.175+0000 7f5086a00640 1 -- 172.21.15.42:0/3429237451 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5078020020 con 0x7f50900b5100 2024-09-17T01:32:51.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.443+0000 7f5095200640 1 -- 172.21.15.42:0/3429237451 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f509006a170 con 0x7f50900b5100 2024-09-17T01:32:51.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.446+0000 7f5086a00640 1 -- 172.21.15.42:0/3429237451 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v27) ==== 97+0+0 (secure 0 0 0) 0x7f5078063520 con 0x7f50900b5100 2024-09-17T01:32:51.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.449+0000 7f5095200640 1 -- 172.21.15.42:0/3429237451 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f506c078bc0 msgr2=0x7f506c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:51.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.449+0000 7f5095200640 1 --2- 172.21.15.42:0/3429237451 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f506c078bc0 0x7f506c07b0d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f50800016a0 tx=0x7f5080009040 comp rx=0 tx=0).stop 2024-09-17T01:32:51.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.449+0000 7f5095200640 1 -- 172.21.15.42:0/3429237451 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50900b5100 msgr2=0x7f5090144450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:51.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.449+0000 7f5095200640 1 --2- 172.21.15.42:0/3429237451 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50900b5100 0x7f5090144450 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f507800d750 tx=0x7f507800dc10 comp rx=0 tx=0).stop 2024-09-17T01:32:51.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.449+0000 7f5095200640 1 -- 172.21.15.42:0/3429237451 shutdown_connections 2024-09-17T01:32:51.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.449+0000 7f5095200640 1 --2- 172.21.15.42:0/3429237451 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f506c078bc0 0x7f506c07b0d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:51.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.449+0000 7f5095200640 1 --2- 172.21.15.42:0/3429237451 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50900cef70 0x7f5090154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:51.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.449+0000 7f5095200640 1 --2- 172.21.15.42:0/3429237451 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50900b5100 0x7f5090144450 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:51.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.449+0000 7f5095200640 1 --2- 172.21.15.42:0/3429237451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f509006d430 0x7f50901478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:51.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.449+0000 7f5095200640 1 -- 172.21.15.42:0/3429237451 >> 172.21.15.42:0/3429237451 conn(0x7f50900b2930 msgr2=0x7f50900b0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:51.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.449+0000 7f5095200640 1 -- 172.21.15.42:0/3429237451 shutdown_connections 2024-09-17T01:32:51.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.449+0000 7f5095200640 1 -- 172.21.15.42:0/3429237451 wait complete. 2024-09-17T01:32:51.468 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-17T01:32:51.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.697+0000 7f9567c00640 1 -- 172.21.15.42:0/3957399481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9560142f40 msgr2=0x7f9560072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:51.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.697+0000 7f9567c00640 1 --2- 172.21.15.42:0/3957399481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9560142f40 0x7f9560072950 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f95600b3110 tx=0x7f954c02a4d0 comp rx=0 tx=0).stop 2024-09-17T01:32:51.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.697+0000 7f9567c00640 1 -- 172.21.15.42:0/3957399481 shutdown_connections 2024-09-17T01:32:51.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.697+0000 7f9567c00640 1 --2- 172.21.15.42:0/3957399481 >> v2:172.21.15.43:3300/0 conn(0x7f9560072e90 0x7f95600cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:51.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.697+0000 7f9567c00640 1 --2- 172.21.15.42:0/3957399481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9560142f40 0x7f9560072950 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:51.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.697+0000 7f9567c00640 1 --2- 172.21.15.42:0/3957399481 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f95600b3550 0x7f956015cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:51.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.697+0000 7f9567c00640 1 -- 172.21.15.42:0/3957399481 >> 172.21.15.42:0/3957399481 conn(0x7f95600b2930 msgr2=0x7f956006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:51.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.697+0000 7f9567c00640 1 -- 172.21.15.42:0/3957399481 shutdown_connections 2024-09-17T01:32:51.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.697+0000 7f9567c00640 1 -- 172.21.15.42:0/3957399481 wait complete. 2024-09-17T01:32:51.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.699+0000 7f9567c00640 1 Processor -- start 2024-09-17T01:32:51.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.700+0000 7f9567c00640 1 -- start start 2024-09-17T01:32:51.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.701+0000 7f9567c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9560072e90 0x7f95600aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:51.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.701+0000 7f9567c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95600b3550 0x7f956014c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:51.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.701+0000 7f9567c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9560142f40 0x7f9560141480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:51.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.701+0000 7f9567c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f956006d430 con 0x7f95600b3550 2024-09-17T01:32:51.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.701+0000 7f9567c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f95600cf4d0 con 0x7f9560072e90 2024-09-17T01:32:51.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.701+0000 7f9567c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f956006d5b0 con 0x7f9560142f40 2024-09-17T01:32:51.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.701+0000 7f955fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95600b3550 0x7f956014c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:51.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.701+0000 7f955fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95600b3550 0x7f956014c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51398/0 (socket says 172.21.15.42:51398) 2024-09-17T01:32:51.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.701+0000 7f955fe00640 1 -- 172.21.15.42:0/3353043263 learned_addr learned my addr 172.21.15.42:0/3353043263 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:51.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.702+0000 7f9565200640 1 --2- 172.21.15.42:0/3353043263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9560072e90 0x7f95600aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:51.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.702+0000 7f9565c00640 1 --2- 172.21.15.42:0/3353043263 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9560142f40 0x7f9560141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:51.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.702+0000 7f955fe00640 1 -- 172.21.15.42:0/3353043263 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9560142f40 msgr2=0x7f9560141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:51.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.702+0000 7f955fe00640 1 --2- 172.21.15.42:0/3353043263 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9560142f40 0x7f9560141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:51.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.702+0000 7f955fe00640 1 -- 172.21.15.42:0/3353043263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9560072e90 msgr2=0x7f95600aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:51.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.702+0000 7f955fe00640 1 --2- 172.21.15.42:0/3353043263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9560072e90 0x7f95600aa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:51.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.702+0000 7f955fe00640 1 -- 172.21.15.42:0/3353043263 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9560146a40 con 0x7f95600b3550 2024-09-17T01:32:51.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.702+0000 7f955fe00640 1 --2- 172.21.15.42:0/3353043263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95600b3550 0x7f956014c7a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f954c034040 tx=0x7f954c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:51.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.702+0000 7f955cc00640 1 -- 172.21.15.42:0/3353043263 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954c03e030 con 0x7f95600b3550 2024-09-17T01:32:51.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.702+0000 7f955cc00640 1 -- 172.21.15.42:0/3353043263 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f954c003ca0 con 0x7f95600b3550 2024-09-17T01:32:51.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.702+0000 7f9567c00640 1 -- 172.21.15.42:0/3353043263 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9560149db0 con 0x7f95600b3550 2024-09-17T01:32:51.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.702+0000 7f955cc00640 1 -- 172.21.15.42:0/3353043263 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954c035040 con 0x7f95600b3550 2024-09-17T01:32:51.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.703+0000 7f9567c00640 1 -- 172.21.15.42:0/3353043263 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9560146fe0 con 0x7f95600b3550 2024-09-17T01:32:51.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.704+0000 7f9567c00640 1 -- 172.21.15.42:0/3353043263 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f956006da60 con 0x7f95600b3550 2024-09-17T01:32:51.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.705+0000 7f955cc00640 1 -- 172.21.15.42:0/3353043263 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f954c041030 con 0x7f95600b3550 2024-09-17T01:32:51.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.706+0000 7f955cc00640 1 --2- 172.21.15.42:0/3353043263 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9540078b90 0x7f954007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:51.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.706+0000 7f955cc00640 1 -- 172.21.15.42:0/3353043263 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f954c0bb090 con 0x7f95600b3550 2024-09-17T01:32:51.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.706+0000 7f9565200640 1 --2- 172.21.15.42:0/3353043263 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9540078b90 0x7f954007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:51.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.707+0000 7f9565200640 1 --2- 172.21.15.42:0/3353043263 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9540078b90 0x7f954007b0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9554009a40 tx=0x7f9554005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:51.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.710+0000 7f955cc00640 1 -- 172.21.15.42:0/3353043263 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f954c083810 con 0x7f95600b3550 2024-09-17T01:32:51.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.974+0000 7f9567c00640 1 -- 172.21.15.42:0/3353043263 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f956006a170 con 0x7f95600b3550 2024-09-17T01:32:51.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.977+0000 7f955cc00640 1 -- 172.21.15.42:0/3353043263 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v28) ==== 90+0+0 (secure 0 0 0) 0x7f954c083110 con 0x7f95600b3550 2024-09-17T01:32:51.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.979+0000 7f9567c00640 1 -- 172.21.15.42:0/3353043263 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9540078b90 msgr2=0x7f954007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:51.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.979+0000 7f9567c00640 1 --2- 172.21.15.42:0/3353043263 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9540078b90 0x7f954007b0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9554009a40 tx=0x7f9554005f90 comp rx=0 tx=0).stop 2024-09-17T01:32:51.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.979+0000 7f9567c00640 1 -- 172.21.15.42:0/3353043263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95600b3550 msgr2=0x7f956014c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:51.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.979+0000 7f9567c00640 1 --2- 172.21.15.42:0/3353043263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95600b3550 0x7f956014c7a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f954c034040 tx=0x7f954c0038a0 comp rx=0 tx=0).stop 2024-09-17T01:32:51.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.979+0000 7f9567c00640 1 -- 172.21.15.42:0/3353043263 shutdown_connections 2024-09-17T01:32:51.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.979+0000 7f9567c00640 1 --2- 172.21.15.42:0/3353043263 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9540078b90 0x7f954007b0a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:51.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.979+0000 7f9567c00640 1 --2- 172.21.15.42:0/3353043263 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9560142f40 0x7f9560141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:51.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.979+0000 7f9567c00640 1 --2- 172.21.15.42:0/3353043263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95600b3550 0x7f956014c7a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:51.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.979+0000 7f9567c00640 1 --2- 172.21.15.42:0/3353043263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9560072e90 0x7f95600aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:51.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.979+0000 7f9567c00640 1 -- 172.21.15.42:0/3353043263 >> 172.21.15.42:0/3353043263 conn(0x7f95600b2930 msgr2=0x7f956006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:51.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.980+0000 7f9567c00640 1 -- 172.21.15.42:0/3353043263 shutdown_connections 2024-09-17T01:32:51.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:51.980+0000 7f9567c00640 1 -- 172.21.15.42:0/3353043263 wait complete. 2024-09-17T01:32:51.999 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T01:32:52.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.232+0000 7f6692c00640 1 -- 172.21.15.42:0/3391676538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f668c142f40 msgr2=0x7f668c072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:52.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.232+0000 7f6692c00640 1 --2- 172.21.15.42:0/3391676538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f668c142f40 0x7f668c072950 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6674009830 tx=0x7f667402a530 comp rx=0 tx=0).stop 2024-09-17T01:32:52.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.232+0000 7f6692c00640 1 -- 172.21.15.42:0/3391676538 shutdown_connections 2024-09-17T01:32:52.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.232+0000 7f6692c00640 1 --2- 172.21.15.42:0/3391676538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f668c142f40 0x7f668c072950 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:52.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.232+0000 7f6692c00640 1 -- 172.21.15.42:0/3391676538 >> 172.21.15.42:0/3391676538 conn(0x7f668c0b2930 msgr2=0x7f668c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:52.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.233+0000 7f6692c00640 1 -- 172.21.15.42:0/3391676538 shutdown_connections 2024-09-17T01:32:52.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.233+0000 7f6692c00640 1 -- 172.21.15.42:0/3391676538 wait complete. 2024-09-17T01:32:52.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.235+0000 7f6692c00640 1 Processor -- start 2024-09-17T01:32:52.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.235+0000 7f6692c00640 1 -- start start 2024-09-17T01:32:52.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.236+0000 7f6692c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f668c072e90 0x7f668c166f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:52.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.237+0000 7f6692c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f668c0b3550 0x7f668c159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:52.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.237+0000 7f6692c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f668c142f40 0x7f668c0b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:52.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.237+0000 7f6692c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f668c06d900 con 0x7f668c0b3550 2024-09-17T01:32:52.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.237+0000 7f6692c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f668c06d780 con 0x7f668c142f40 2024-09-17T01:32:52.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.237+0000 7f6692c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f668c06da80 con 0x7f668c072e90 2024-09-17T01:32:52.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.237+0000 7f6683e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f668c0b3550 0x7f668c159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:52.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.237+0000 7f6683e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f668c0b3550 0x7f668c159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51404/0 (socket says 172.21.15.42:51404) 2024-09-17T01:32:52.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.237+0000 7f6683e00640 1 -- 172.21.15.42:0/4268311886 learned_addr learned my addr 172.21.15.42:0/4268311886 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:52.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.237+0000 7f668be00640 1 --2- 172.21.15.42:0/4268311886 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f668c072e90 0x7f668c166f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:52.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.237+0000 7f6690c00640 1 --2- 172.21.15.42:0/4268311886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f668c142f40 0x7f668c0b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:52.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.237+0000 7f6683e00640 1 -- 172.21.15.42:0/4268311886 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f668c072e90 msgr2=0x7f668c166f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:52.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.237+0000 7f6683e00640 1 --2- 172.21.15.42:0/4268311886 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f668c072e90 0x7f668c166f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:52.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.237+0000 7f6683e00640 1 -- 172.21.15.42:0/4268311886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f668c142f40 msgr2=0x7f668c0b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:52.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.237+0000 7f6683e00640 1 --2- 172.21.15.42:0/4268311886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f668c142f40 0x7f668c0b0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:52.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.237+0000 7f6683e00640 1 -- 172.21.15.42:0/4268311886 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f668c147a90 con 0x7f668c0b3550 2024-09-17T01:32:52.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.238+0000 7f6683e00640 1 --2- 172.21.15.42:0/4268311886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f668c0b3550 0x7f668c159ce0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6674009950 tx=0x7f6674033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:52.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.238+0000 7f6688c00640 1 -- 172.21.15.42:0/4268311886 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6674031d60 con 0x7f668c0b3550 2024-09-17T01:32:52.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.238+0000 7f6688c00640 1 -- 172.21.15.42:0/4268311886 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66740330d0 con 0x7f668c0b3550 2024-09-17T01:32:52.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.238+0000 7f6688c00640 1 -- 172.21.15.42:0/4268311886 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6674033520 con 0x7f668c0b3550 2024-09-17T01:32:52.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.238+0000 7f6692c00640 1 -- 172.21.15.42:0/4268311886 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f668c147d70 con 0x7f668c0b3550 2024-09-17T01:32:52.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.238+0000 7f6692c00640 1 -- 172.21.15.42:0/4268311886 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f668c1498d0 con 0x7f668c0b3550 2024-09-17T01:32:52.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.239+0000 7f6692c00640 1 -- 172.21.15.42:0/4268311886 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f668c15a640 con 0x7f668c0b3550 2024-09-17T01:32:52.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.240+0000 7f6688c00640 1 -- 172.21.15.42:0/4268311886 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f66740035f0 con 0x7f668c0b3550 2024-09-17T01:32:52.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.241+0000 7f6688c00640 1 --2- 172.21.15.42:0/4268311886 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6668078b90 0x7f666807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:52.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.241+0000 7f6688c00640 1 -- 172.21.15.42:0/4268311886 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f66740bbe70 con 0x7f668c0b3550 2024-09-17T01:32:52.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.242+0000 7f668be00640 1 --2- 172.21.15.42:0/4268311886 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6668078b90 0x7f666807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:52.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.243+0000 7f668be00640 1 --2- 172.21.15.42:0/4268311886 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6668078b90 0x7f666807b0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f667c000f60 tx=0x7f667c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:52.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.246+0000 7f6688c00640 1 -- 172.21.15.42:0/4268311886 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f667403f030 con 0x7f668c0b3550 2024-09-17T01:32:52.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.441+0000 7f6692c00640 1 -- 172.21.15.42:0/4268311886 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f668c06a170 con 0x7f668c0b3550 2024-09-17T01:32:52.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.442+0000 7f6688c00640 1 -- 172.21.15.42:0/4268311886 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) ==== 84+0+65 (secure 0 0 0) 0x7f6674083fa0 con 0x7f668c0b3550 2024-09-17T01:32:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:52.440 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-09-17T01:32:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:32:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-09-17T01:32:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-09-17T01:32:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:32:52.440 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-09-17T01:32:52.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.444+0000 7f6692c00640 1 -- 172.21.15.42:0/4268311886 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6668078b90 msgr2=0x7f666807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:52.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.444+0000 7f6692c00640 1 --2- 172.21.15.42:0/4268311886 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6668078b90 0x7f666807b0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f667c000f60 tx=0x7f667c009040 comp rx=0 tx=0).stop 2024-09-17T01:32:52.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.444+0000 7f6692c00640 1 -- 172.21.15.42:0/4268311886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f668c0b3550 msgr2=0x7f668c159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:52.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.444+0000 7f6692c00640 1 --2- 172.21.15.42:0/4268311886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f668c0b3550 0x7f668c159ce0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6674009950 tx=0x7f6674033d60 comp rx=0 tx=0).stop 2024-09-17T01:32:52.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.444+0000 7f6692c00640 1 -- 172.21.15.42:0/4268311886 shutdown_connections 2024-09-17T01:32:52.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.444+0000 7f6692c00640 1 --2- 172.21.15.42:0/4268311886 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6668078b90 0x7f666807b0a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:52.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.444+0000 7f6692c00640 1 --2- 172.21.15.42:0/4268311886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f668c142f40 0x7f668c0b0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:52.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.444+0000 7f6692c00640 1 --2- 172.21.15.42:0/4268311886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f668c0b3550 0x7f668c159ce0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:52.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.444+0000 7f6692c00640 1 --2- 172.21.15.42:0/4268311886 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f668c072e90 0x7f668c166f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:52.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.444+0000 7f6692c00640 1 -- 172.21.15.42:0/4268311886 >> 172.21.15.42:0/4268311886 conn(0x7f668c0b2930 msgr2=0x7f668c167eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:52.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.444+0000 7f6692c00640 1 -- 172.21.15.42:0/4268311886 shutdown_connections 2024-09-17T01:32:52.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.444+0000 7f6692c00640 1 -- 172.21.15.42:0/4268311886 wait complete. 2024-09-17T01:32:52.466 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T01:32:52.466 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T01:32:52.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.700+0000 7f3fa3200640 1 -- 172.21.15.42:0/4102539562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f9c0cdb20 msgr2=0x7f3f9c0cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:52.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.700+0000 7f3fa3200640 1 --2- 172.21.15.42:0/4102539562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f9c0cdb20 0x7f3f9c0cdf30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3f84009830 tx=0x7f3f8402a500 comp rx=0 tx=0).stop 2024-09-17T01:32:52.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.700+0000 7f3fa3200640 1 -- 172.21.15.42:0/4102539562 shutdown_connections 2024-09-17T01:32:52.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.700+0000 7f3fa3200640 1 --2- 172.21.15.42:0/4102539562 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3f9c06d430 0x7f3f9c06d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:52.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.700+0000 7f3fa3200640 1 --2- 172.21.15.42:0/4102539562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f9c0cdb20 0x7f3f9c0cdf30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:52.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.700+0000 7f3fa3200640 1 -- 172.21.15.42:0/4102539562 >> 172.21.15.42:0/4102539562 conn(0x7f3f9c0b28f0 msgr2=0x7f3f9c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:52.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.700+0000 7f3fa3200640 1 -- 172.21.15.42:0/4102539562 shutdown_connections 2024-09-17T01:32:52.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.700+0000 7f3fa3200640 1 -- 172.21.15.42:0/4102539562 wait complete. 2024-09-17T01:32:52.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.703+0000 7f3fa3200640 1 Processor -- start 2024-09-17T01:32:52.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.703+0000 7f3fa3200640 1 -- start start 2024-09-17T01:32:52.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.704+0000 7f3fa3200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3f9c06d430 0x7f3f9c0cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:52.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.704+0000 7f3fa3200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f9c0b56d0 0x7f3f9c0c5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:52.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.704+0000 7f3fa3200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f9c0cdb20 0x7f3f9c1f8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:52.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.704+0000 7f3fa3200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9c15d560 con 0x7f3f9c0cdb20 2024-09-17T01:32:52.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.704+0000 7f3fa3200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9c15d3e0 con 0x7f3f9c0b56d0 2024-09-17T01:32:52.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.704+0000 7f3fa3200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3f9c15d6e0 con 0x7f3f9c06d430 2024-09-17T01:32:52.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.704+0000 7f3fa1200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f9c0cdb20 0x7f3f9c1f8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:52.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.705+0000 7f3fa1200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f9c0cdb20 0x7f3f9c1f8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51420/0 (socket says 172.21.15.42:51420) 2024-09-17T01:32:52.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.705+0000 7f3fa1200640 1 -- 172.21.15.42:0/2784416409 learned_addr learned my addr 172.21.15.42:0/2784416409 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:52.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.705+0000 7f3f93400640 1 --2- 172.21.15.42:0/2784416409 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f9c0b56d0 0x7f3f9c0c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:52.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.705+0000 7f3f9be00640 1 --2- 172.21.15.42:0/2784416409 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3f9c06d430 0x7f3f9c0cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:52.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.705+0000 7f3fa1200640 1 -- 172.21.15.42:0/2784416409 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3f9c06d430 msgr2=0x7f3f9c0cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:52.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.705+0000 7f3fa1200640 1 --2- 172.21.15.42:0/2784416409 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3f9c06d430 0x7f3f9c0cc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:52.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.705+0000 7f3fa1200640 1 -- 172.21.15.42:0/2784416409 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f9c0b56d0 msgr2=0x7f3f9c0c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:52.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.705+0000 7f3fa1200640 1 --2- 172.21.15.42:0/2784416409 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f9c0b56d0 0x7f3f9c0c5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:52.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.705+0000 7f3fa1200640 1 -- 172.21.15.42:0/2784416409 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f9c131a00 con 0x7f3f9c0cdb20 2024-09-17T01:32:52.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.705+0000 7f3fa1200640 1 --2- 172.21.15.42:0/2784416409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f9c0cdb20 0x7f3f9c1f8d90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400ea10 tx=0x7f3f9400eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:52.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.706+0000 7f3f98c00640 1 -- 172.21.15.42:0/2784416409 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9400cde0 con 0x7f3f9c0cdb20 2024-09-17T01:32:52.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.706+0000 7f3f98c00640 1 -- 172.21.15.42:0/2784416409 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f94004c10 con 0x7f3f9c0cdb20 2024-09-17T01:32:52.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.706+0000 7f3f98c00640 1 -- 172.21.15.42:0/2784416409 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f94005020 con 0x7f3f9c0cdb20 2024-09-17T01:32:52.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.706+0000 7f3fa3200640 1 -- 172.21.15.42:0/2784416409 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f9c0ccd00 con 0x7f3f9c0cdb20 2024-09-17T01:32:52.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.706+0000 7f3fa3200640 1 -- 172.21.15.42:0/2784416409 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f9c1e7330 con 0x7f3f9c0cdb20 2024-09-17T01:32:52.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.707+0000 7f3fa3200640 1 -- 172.21.15.42:0/2784416409 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f9c1345f0 con 0x7f3f9c0cdb20 2024-09-17T01:32:52.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.708+0000 7f3f98c00640 1 -- 172.21.15.42:0/2784416409 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3f940051c0 con 0x7f3f9c0cdb20 2024-09-17T01:32:52.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.709+0000 7f3f98c00640 1 --2- 172.21.15.42:0/2784416409 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3f78078b90 0x7f3f7807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:52.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.709+0000 7f3f98c00640 1 -- 172.21.15.42:0/2784416409 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f3f9409b950 con 0x7f3f9c0cdb20 2024-09-17T01:32:52.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.709+0000 7f3f9be00640 1 --2- 172.21.15.42:0/2784416409 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3f78078b90 0x7f3f7807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:52.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.710+0000 7f3f9be00640 1 --2- 172.21.15.42:0/2784416409 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3f78078b90 0x7f3f7807b0a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0015e0 tx=0x7f3f8c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:52.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.713+0000 7f3f98c00640 1 -- 172.21.15.42:0/2784416409 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3f94064040 con 0x7f3f9c0cdb20 2024-09-17T01:32:52.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:52.908+0000 7f3fa3200640 1 -- 172.21.15.42:0/2784416409 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f3f9c0afa40 con 0x7f3f9c0cdb20 2024-09-17T01:32:53.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.234+0000 7f3f98c00640 1 -- 172.21.15.42:0/2784416409 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) ==== 138+0+0 (secure 0 0 0) 0x7f3f94063940 con 0x7f3f9c0cdb20 2024-09-17T01:32:53.232 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-09-17T01:32:53.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.237+0000 7f3fa3200640 1 -- 172.21.15.42:0/2784416409 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3f78078b90 msgr2=0x7f3f7807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:53.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.237+0000 7f3fa3200640 1 --2- 172.21.15.42:0/2784416409 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3f78078b90 0x7f3f7807b0a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0015e0 tx=0x7f3f8c009040 comp rx=0 tx=0).stop 2024-09-17T01:32:53.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.237+0000 7f3fa3200640 1 -- 172.21.15.42:0/2784416409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f9c0cdb20 msgr2=0x7f3f9c1f8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:53.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.237+0000 7f3fa3200640 1 --2- 172.21.15.42:0/2784416409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f9c0cdb20 0x7f3f9c1f8d90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400ea10 tx=0x7f3f9400eed0 comp rx=0 tx=0).stop 2024-09-17T01:32:53.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.237+0000 7f3fa3200640 1 -- 172.21.15.42:0/2784416409 shutdown_connections 2024-09-17T01:32:53.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.237+0000 7f3fa3200640 1 --2- 172.21.15.42:0/2784416409 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3f78078b90 0x7f3f7807b0a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:53.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.237+0000 7f3fa3200640 1 --2- 172.21.15.42:0/2784416409 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f9c0b56d0 0x7f3f9c0c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:53.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.237+0000 7f3fa3200640 1 --2- 172.21.15.42:0/2784416409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f9c0cdb20 0x7f3f9c1f8d90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:53.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.237+0000 7f3fa3200640 1 --2- 172.21.15.42:0/2784416409 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3f9c06d430 0x7f3f9c0cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:53.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.237+0000 7f3fa3200640 1 -- 172.21.15.42:0/2784416409 >> 172.21.15.42:0/2784416409 conn(0x7f3f9c0b28f0 msgr2=0x7f3f9c0763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:53.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.237+0000 7f3fa3200640 1 -- 172.21.15.42:0/2784416409 shutdown_connections 2024-09-17T01:32:53.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.237+0000 7f3fa3200640 1 -- 172.21.15.42:0/2784416409 wait complete. 2024-09-17T01:32:53.264 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T01:32:53.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.500+0000 7f5deca00640 1 -- 172.21.15.42:0/552407942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de80d0d80 msgr2=0x7f5de806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:53.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.500+0000 7f5deca00640 1 --2- 172.21.15.42:0/552407942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de80d0d80 0x7f5de806cd20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8005fd0 tx=0x7f5dd802a5d0 comp rx=0 tx=0).stop 2024-09-17T01:32:53.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.501+0000 7f5deca00640 1 -- 172.21.15.42:0/552407942 shutdown_connections 2024-09-17T01:32:53.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.501+0000 7f5deca00640 1 --2- 172.21.15.42:0/552407942 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5de806d260 0x7f5de80c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:53.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.501+0000 7f5deca00640 1 --2- 172.21.15.42:0/552407942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de80d0d80 0x7f5de806cd20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:53.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.501+0000 7f5deca00640 1 -- 172.21.15.42:0/552407942 >> 172.21.15.42:0/552407942 conn(0x7f5de80b25f0 msgr2=0x7f5de80d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:53.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.501+0000 7f5deca00640 1 -- 172.21.15.42:0/552407942 shutdown_connections 2024-09-17T01:32:53.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.501+0000 7f5deca00640 1 -- 172.21.15.42:0/552407942 wait complete. 2024-09-17T01:32:53.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.503+0000 7f5deca00640 1 Processor -- start 2024-09-17T01:32:53.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.503+0000 7f5deca00640 1 -- start start 2024-09-17T01:32:53.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.504+0000 7f5deca00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5de806d260 0x7f5de815d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:53.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.504+0000 7f5deca00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5de80af460 0x7f5de806fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:53.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.504+0000 7f5deca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de80d0d80 0x7f5de8161010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:53.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.504+0000 7f5deca00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5de81632b0 con 0x7f5de80d0d80 2024-09-17T01:32:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.504+0000 7f5deca00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5de8163130 con 0x7f5de80af460 2024-09-17T01:32:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.504+0000 7f5deca00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5de80ca070 con 0x7f5de806d260 2024-09-17T01:32:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.505+0000 7f5de7200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de80d0d80 0x7f5de8161010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.505+0000 7f5de7200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de80d0d80 0x7f5de8161010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51442/0 (socket says 172.21.15.42:51442) 2024-09-17T01:32:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.505+0000 7f5de7200640 1 -- 172.21.15.42:0/3986179401 learned_addr learned my addr 172.21.15.42:0/3986179401 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.505+0000 7f5de6800640 1 --2- 172.21.15.42:0/3986179401 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5de806d260 0x7f5de815d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.505+0000 7f5de5e00640 1 --2- 172.21.15.42:0/3986179401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5de80af460 0x7f5de806fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.505+0000 7f5de7200640 1 -- 172.21.15.42:0/3986179401 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5de806d260 msgr2=0x7f5de815d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.505+0000 7f5de7200640 1 --2- 172.21.15.42:0/3986179401 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5de806d260 0x7f5de815d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.505+0000 7f5de7200640 1 -- 172.21.15.42:0/3986179401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5de80af460 msgr2=0x7f5de806fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.505+0000 7f5de7200640 1 --2- 172.21.15.42:0/3986179401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5de80af460 0x7f5de806fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:53.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.505+0000 7f5de7200640 1 -- 172.21.15.42:0/3986179401 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de806ee40 con 0x7f5de80d0d80 2024-09-17T01:32:53.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.505+0000 7f5de5e00640 1 --2- 172.21.15.42:0/3986179401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5de80af460 0x7f5de806fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:53.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.506+0000 7f5de7200640 1 --2- 172.21.15.42:0/3986179401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de80d0d80 0x7f5de8161010 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5de000eab0 tx=0x7f5de000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:53.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.506+0000 7f5ddea00640 1 -- 172.21.15.42:0/3986179401 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de000cea0 con 0x7f5de80d0d80 2024-09-17T01:32:53.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.506+0000 7f5ddea00640 1 -- 172.21.15.42:0/3986179401 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5de0004b20 con 0x7f5de80d0d80 2024-09-17T01:32:53.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.506+0000 7f5deca00640 1 -- 172.21.15.42:0/3986179401 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5de8160250 con 0x7f5de80d0d80 2024-09-17T01:32:53.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.506+0000 7f5ddea00640 1 -- 172.21.15.42:0/3986179401 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de0005020 con 0x7f5de80d0d80 2024-09-17T01:32:53.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.506+0000 7f5deca00640 1 -- 172.21.15.42:0/3986179401 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5de8160810 con 0x7f5de80d0d80 2024-09-17T01:32:53.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.507+0000 7f5deca00640 1 -- 172.21.15.42:0/3986179401 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5de815eb70 con 0x7f5de80d0d80 2024-09-17T01:32:53.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.508+0000 7f5ddea00640 1 -- 172.21.15.42:0/3986179401 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5de00051c0 con 0x7f5de80d0d80 2024-09-17T01:32:53.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.509+0000 7f5ddea00640 1 --2- 172.21.15.42:0/3986179401 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5dc8078b90 0x7f5dc807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:53.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.509+0000 7f5ddea00640 1 -- 172.21.15.42:0/3986179401 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7f5de009b7c0 con 0x7f5de80d0d80 2024-09-17T01:32:53.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.510+0000 7f5de6800640 1 --2- 172.21.15.42:0/3986179401 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5dc8078b90 0x7f5dc807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:53.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.511+0000 7f5de6800640 1 --2- 172.21.15.42:0/3986179401 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5dc8078b90 0x7f5dc807b0a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8033000 tx=0x7f5dd8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:53.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.515+0000 7f5ddea00640 1 -- 172.21.15.42:0/3986179401 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5de0063d40 con 0x7f5de80d0d80 2024-09-17T01:32:53.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:53.710+0000 7f5deca00640 1 -- 172.21.15.42:0/3986179401 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f5de806ebd0 con 0x7f5de80d0d80 2024-09-17T01:32:54.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.243+0000 7f5ddea00640 1 -- 172.21.15.42:0/3986179401 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) ==== 170+0+0 (secure 0 0 0) 0x7f5de0063640 con 0x7f5de80d0d80 2024-09-17T01:32:54.241 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-09-17T01:32:54.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.247+0000 7f5deca00640 1 -- 172.21.15.42:0/3986179401 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5dc8078b90 msgr2=0x7f5dc807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:54.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.247+0000 7f5deca00640 1 --2- 172.21.15.42:0/3986179401 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5dc8078b90 0x7f5dc807b0a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8033000 tx=0x7f5dd8004730 comp rx=0 tx=0).stop 2024-09-17T01:32:54.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.247+0000 7f5deca00640 1 -- 172.21.15.42:0/3986179401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de80d0d80 msgr2=0x7f5de8161010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:54.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.247+0000 7f5deca00640 1 --2- 172.21.15.42:0/3986179401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de80d0d80 0x7f5de8161010 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5de000eab0 tx=0x7f5de000ef70 comp rx=0 tx=0).stop 2024-09-17T01:32:54.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.248+0000 7f5deca00640 1 -- 172.21.15.42:0/3986179401 shutdown_connections 2024-09-17T01:32:54.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.248+0000 7f5deca00640 1 --2- 172.21.15.42:0/3986179401 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5dc8078b90 0x7f5dc807b0a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:54.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.248+0000 7f5deca00640 1 --2- 172.21.15.42:0/3986179401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5de80af460 0x7f5de806fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:54.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.248+0000 7f5deca00640 1 --2- 172.21.15.42:0/3986179401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de80d0d80 0x7f5de8161010 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:54.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.248+0000 7f5deca00640 1 --2- 172.21.15.42:0/3986179401 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5de806d260 0x7f5de815d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:54.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.248+0000 7f5deca00640 1 -- 172.21.15.42:0/3986179401 >> 172.21.15.42:0/3986179401 conn(0x7f5de80b25f0 msgr2=0x7f5de80c9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:54.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.248+0000 7f5deca00640 1 -- 172.21.15.42:0/3986179401 shutdown_connections 2024-09-17T01:32:54.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.249+0000 7f5deca00640 1 -- 172.21.15.42:0/3986179401 wait complete. 2024-09-17T01:32:54.285 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T01:32:54.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.521+0000 7f1bbc800640 1 -- 172.21.15.42:0/1083588761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bb40b5100 msgr2=0x7f1bb415d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:54.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.521+0000 7f1bbc800640 1 --2- 172.21.15.42:0/1083588761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bb40b5100 0x7f1bb415d950 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40cceb0 tx=0x7f1ba802a560 comp rx=0 tx=0).stop 2024-09-17T01:32:54.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.521+0000 7f1bbc800640 1 -- 172.21.15.42:0/1083588761 shutdown_connections 2024-09-17T01:32:54.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.521+0000 7f1bbc800640 1 --2- 172.21.15.42:0/1083588761 >> v2:172.21.15.43:3300/0 conn(0x7f1bb406d430 0x7f1bb406d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:54.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.521+0000 7f1bbc800640 1 --2- 172.21.15.42:0/1083588761 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bb40cef70 0x7f1bb4156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:54.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.521+0000 7f1bbc800640 1 --2- 172.21.15.42:0/1083588761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bb40b5100 0x7f1bb415d950 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:54.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.521+0000 7f1bbc800640 1 -- 172.21.15.42:0/1083588761 >> 172.21.15.42:0/1083588761 conn(0x7f1bb40b2930 msgr2=0x7f1bb406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:54.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.521+0000 7f1bbc800640 1 -- 172.21.15.42:0/1083588761 shutdown_connections 2024-09-17T01:32:54.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.521+0000 7f1bbc800640 1 -- 172.21.15.42:0/1083588761 wait complete. 2024-09-17T01:32:54.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.523+0000 7f1bbc800640 1 Processor -- start 2024-09-17T01:32:54.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.523+0000 7f1bbc800640 1 -- start start 2024-09-17T01:32:54.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.525+0000 7f1bbc800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bb406d430 0x7f1bb4159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:54.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.525+0000 7f1bbc800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bb40b5100 0x7f1bb415b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:54.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.525+0000 7f1bbc800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bb40cef70 0x7f1bb41f7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:54.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.525+0000 7f1bbc800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb4160850 con 0x7f1bb40b5100 2024-09-17T01:32:54.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.525+0000 7f1bbc800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb41606d0 con 0x7f1bb406d430 2024-09-17T01:32:54.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.525+0000 7f1bbc800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb41609d0 con 0x7f1bb40cef70 2024-09-17T01:32:54.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.525+0000 7f1bb9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bb40b5100 0x7f1bb415b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:54.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.525+0000 7f1bb9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bb40b5100 0x7f1bb415b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51462/0 (socket says 172.21.15.42:51462) 2024-09-17T01:32:54.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.525+0000 7f1bb9400640 1 -- 172.21.15.42:0/1582590031 learned_addr learned my addr 172.21.15.42:0/1582590031 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:54.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.525+0000 7f1bb9e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bb406d430 0x7f1bb4159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:54.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.525+0000 7f1bba800640 1 --2- 172.21.15.42:0/1582590031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bb40cef70 0x7f1bb41f7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:54.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.526+0000 7f1bb9400640 1 -- 172.21.15.42:0/1582590031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bb40cef70 msgr2=0x7f1bb41f7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:54.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.526+0000 7f1bb9400640 1 --2- 172.21.15.42:0/1582590031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bb40cef70 0x7f1bb41f7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:54.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.526+0000 7f1bb9400640 1 -- 172.21.15.42:0/1582590031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bb406d430 msgr2=0x7f1bb4159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:54.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.526+0000 7f1bb9400640 1 --2- 172.21.15.42:0/1582590031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bb406d430 0x7f1bb4159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:54.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.526+0000 7f1bb9400640 1 -- 172.21.15.42:0/1582590031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb415bdc0 con 0x7f1bb40b5100 2024-09-17T01:32:54.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.526+0000 7f1bb9400640 1 --2- 172.21.15.42:0/1582590031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bb40b5100 0x7f1bb415b880 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400d750 tx=0x7f1ba400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:54.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.526+0000 7f1bae000640 1 -- 172.21.15.42:0/1582590031 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba4017070 con 0x7f1bb40b5100 2024-09-17T01:32:54.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.526+0000 7f1bae000640 1 -- 172.21.15.42:0/1582590031 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ba4009b10 con 0x7f1bb40b5100 2024-09-17T01:32:54.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.526+0000 7f1bae000640 1 -- 172.21.15.42:0/1582590031 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba4010460 con 0x7f1bb40b5100 2024-09-17T01:32:54.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.526+0000 7f1bbc800640 1 -- 172.21.15.42:0/1582590031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb41f40a0 con 0x7f1bb40b5100 2024-09-17T01:32:54.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.526+0000 7f1bbc800640 1 -- 172.21.15.42:0/1582590031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb41f4660 con 0x7f1bb40b5100 2024-09-17T01:32:54.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.528+0000 7f1bbc800640 1 -- 172.21.15.42:0/1582590031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bb415d950 con 0x7f1bb40b5100 2024-09-17T01:32:54.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.529+0000 7f1bae000640 1 -- 172.21.15.42:0/1582590031 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1ba401a070 con 0x7f1bb40b5100 2024-09-17T01:32:54.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.530+0000 7f1bae000640 1 --2- 172.21.15.42:0/1582590031 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b98078bc0 0x7f1b9807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:54.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.530+0000 7f1bae000640 1 -- 172.21.15.42:0/1582590031 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5609+0+0 (secure 0 0 0) 0x7f1ba409b0b0 con 0x7f1bb40b5100 2024-09-17T01:32:54.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.530+0000 7f1bb9e00640 1 --2- 172.21.15.42:0/1582590031 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b98078bc0 0x7f1b9807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:54.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.531+0000 7f1bb9e00640 1 --2- 172.21.15.42:0/1582590031 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b98078bc0 0x7f1b9807b0d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8033000 tx=0x7f1ba8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:54.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.535+0000 7f1bae000640 1 -- 172.21.15.42:0/1582590031 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1ba4062ef0 con 0x7f1bb40b5100 2024-09-17T01:32:54.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:54.765+0000 7f1bbc800640 1 -- 172.21.15.42:0/1582590031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1bb41f3e30 con 0x7f1bb40b5100 2024-09-17T01:32:55.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.257+0000 7f1bae000640 1 -- 172.21.15.42:0/1582590031 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7f1ba4067920 con 0x7f1bb40b5100 2024-09-17T01:32:55.255 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 4 and data pool 5 2024-09-17T01:32:55.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.263+0000 7f1bbc800640 1 -- 172.21.15.42:0/1582590031 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b98078bc0 msgr2=0x7f1b9807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:55.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.263+0000 7f1bbc800640 1 --2- 172.21.15.42:0/1582590031 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b98078bc0 0x7f1b9807b0d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8033000 tx=0x7f1ba8004730 comp rx=0 tx=0).stop 2024-09-17T01:32:55.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.263+0000 7f1bbc800640 1 -- 172.21.15.42:0/1582590031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bb40b5100 msgr2=0x7f1bb415b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:55.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.263+0000 7f1bbc800640 1 --2- 172.21.15.42:0/1582590031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bb40b5100 0x7f1bb415b880 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400d750 tx=0x7f1ba400dc10 comp rx=0 tx=0).stop 2024-09-17T01:32:55.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.264+0000 7f1bbc800640 1 -- 172.21.15.42:0/1582590031 shutdown_connections 2024-09-17T01:32:55.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.264+0000 7f1bbc800640 1 --2- 172.21.15.42:0/1582590031 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b98078bc0 0x7f1b9807b0d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:55.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.264+0000 7f1bbc800640 1 --2- 172.21.15.42:0/1582590031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bb40cef70 0x7f1bb41f7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:55.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.264+0000 7f1bbc800640 1 --2- 172.21.15.42:0/1582590031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bb40b5100 0x7f1bb415b880 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:55.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.264+0000 7f1bbc800640 1 --2- 172.21.15.42:0/1582590031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bb406d430 0x7f1bb4159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:55.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.264+0000 7f1bbc800640 1 -- 172.21.15.42:0/1582590031 >> 172.21.15.42:0/1582590031 conn(0x7f1bb40b2930 msgr2=0x7f1bb4072ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:55.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.265+0000 7f1bbc800640 1 -- 172.21.15.42:0/1582590031 shutdown_connections 2024-09-17T01:32:55.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.265+0000 7f1bbc800640 1 -- 172.21.15.42:0/1582590031 wait complete. 2024-09-17T01:32:55.302 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:32:55.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.532+0000 7f3d1a800640 1 -- 172.21.15.42:0/4171934064 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3d140b6100 msgr2=0x7f3d140b6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:55.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.532+0000 7f3d1a800640 1 --2- 172.21.15.42:0/4171934064 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3d140b6100 0x7f3d140b6510 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009860 tx=0x7f3d0002a510 comp rx=0 tx=0).stop 2024-09-17T01:32:55.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.532+0000 7f3d1a800640 1 -- 172.21.15.42:0/4171934064 shutdown_connections 2024-09-17T01:32:55.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.532+0000 7f3d1a800640 1 --2- 172.21.15.42:0/4171934064 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3d140b6100 0x7f3d140b6510 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:55.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.532+0000 7f3d1a800640 1 -- 172.21.15.42:0/4171934064 >> 172.21.15.42:0/4171934064 conn(0x7f3d140d1100 msgr2=0x7f3d140d1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:55.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.532+0000 7f3d1a800640 1 -- 172.21.15.42:0/4171934064 shutdown_connections 2024-09-17T01:32:55.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.532+0000 7f3d1a800640 1 -- 172.21.15.42:0/4171934064 wait complete. 2024-09-17T01:32:55.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.534+0000 7f3d1a800640 1 Processor -- start 2024-09-17T01:32:55.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.534+0000 7f3d1a800640 1 -- start start 2024-09-17T01:32:55.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.536+0000 7f3d1a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d140b6100 0x7f3d14152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:55.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.536+0000 7f3d1a800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3d140d2a00 0x7f3d141612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:55.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.536+0000 7f3d1a800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d1415c580 0x7f3d1415dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:55.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.536+0000 7f3d1a800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3d140d36a0 con 0x7f3d140b6100 2024-09-17T01:32:55.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.536+0000 7f3d1a800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3d140d3520 con 0x7f3d1415c580 2024-09-17T01:32:55.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.536+0000 7f3d1a800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3d140d3820 con 0x7f3d140d2a00 2024-09-17T01:32:55.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.536+0000 7f3d19400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d140b6100 0x7f3d14152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:55.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.536+0000 7f3d19400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d140b6100 0x7f3d14152c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51466/0 (socket says 172.21.15.42:51466) 2024-09-17T01:32:55.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.536+0000 7f3d19400640 1 -- 172.21.15.42:0/3302594718 learned_addr learned my addr 172.21.15.42:0/3302594718 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:55.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.536+0000 7f3d18a00640 1 --2- 172.21.15.42:0/3302594718 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3d140d2a00 0x7f3d141612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:55.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.536+0000 7f3d19e00640 1 --2- 172.21.15.42:0/3302594718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d1415c580 0x7f3d1415dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:55.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.536+0000 7f3d19400640 1 -- 172.21.15.42:0/3302594718 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3d140d2a00 msgr2=0x7f3d141612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:55.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.536+0000 7f3d19400640 1 --2- 172.21.15.42:0/3302594718 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3d140d2a00 0x7f3d141612e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:55.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.536+0000 7f3d19400640 1 -- 172.21.15.42:0/3302594718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d1415c580 msgr2=0x7f3d1415dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:55.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.536+0000 7f3d19400640 1 --2- 172.21.15.42:0/3302594718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d1415c580 0x7f3d1415dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:55.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.536+0000 7f3d19400640 1 -- 172.21.15.42:0/3302594718 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d14154740 con 0x7f3d140b6100 2024-09-17T01:32:55.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.536+0000 7f3d19e00640 1 --2- 172.21.15.42:0/3302594718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d1415c580 0x7f3d1415dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:55.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.537+0000 7f3d19400640 1 --2- 172.21.15.42:0/3302594718 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d140b6100 0x7f3d14152c00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800c790 tx=0x7f3d0800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:55.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.537+0000 7f3d11600640 1 -- 172.21.15.42:0/3302594718 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d08016020 con 0x7f3d140b6100 2024-09-17T01:32:55.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.537+0000 7f3d11600640 1 -- 172.21.15.42:0/3302594718 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d0800a950 con 0x7f3d140b6100 2024-09-17T01:32:55.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.537+0000 7f3d1a800640 1 -- 172.21.15.42:0/3302594718 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d14154c70 con 0x7f3d140b6100 2024-09-17T01:32:55.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.537+0000 7f3d11600640 1 -- 172.21.15.42:0/3302594718 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0800ada0 con 0x7f3d140b6100 2024-09-17T01:32:55.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.537+0000 7f3d1a800640 1 -- 172.21.15.42:0/3302594718 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d14155230 con 0x7f3d140b6100 2024-09-17T01:32:55.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.538+0000 7f3d1a800640 1 -- 172.21.15.42:0/3302594718 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d140b6510 con 0x7f3d140b6100 2024-09-17T01:32:55.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.539+0000 7f3d11600640 1 -- 172.21.15.42:0/3302594718 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3d08019020 con 0x7f3d140b6100 2024-09-17T01:32:55.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.540+0000 7f3d11600640 1 --2- 172.21.15.42:0/3302594718 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3cf4078bc0 0x7f3cf407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:55.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.540+0000 7f3d11600640 1 -- 172.21.15.42:0/3302594718 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f3d0809aca0 con 0x7f3d140b6100 2024-09-17T01:32:55.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.541+0000 7f3d18a00640 1 --2- 172.21.15.42:0/3302594718 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3cf4078bc0 0x7f3cf407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:55.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.541+0000 7f3d18a00640 1 --2- 172.21.15.42:0/3302594718 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3cf4078bc0 0x7f3cf407b0d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3d00034000 tx=0x7f3d00004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:55.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.545+0000 7f3d11600640 1 -- 172.21.15.42:0/3302594718 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3d08020020 con 0x7f3d140b6100 2024-09-17T01:32:55.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.739+0000 7f3d1a800640 1 -- 172.21.15.42:0/3302594718 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d14158340 con 0x7f3d140b6100 2024-09-17T01:32:55.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.740+0000 7f3d11600640 1 -- 172.21.15.42:0/3302594718 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16634 (secure 0 0 0) 0x7f3d140b6a50 con 0x7f3d140b6100 2024-09-17T01:32:55.738 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:55.738 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":32,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:32:54.766621+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:32:52.920392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T01:32:53.722123+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:32:55.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.742+0000 7f3d1a800640 1 -- 172.21.15.42:0/3302594718 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3cf4078bc0 msgr2=0x7f3cf407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:55.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.742+0000 7f3d1a800640 1 --2- 172.21.15.42:0/3302594718 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3cf4078bc0 0x7f3cf407b0d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3d00034000 tx=0x7f3d00004730 comp rx=0 tx=0).stop 2024-09-17T01:32:55.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.743+0000 7f3d1a800640 1 -- 172.21.15.42:0/3302594718 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d140b6100 msgr2=0x7f3d14152c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:55.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.743+0000 7f3d1a800640 1 --2- 172.21.15.42:0/3302594718 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d140b6100 0x7f3d14152c00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800c790 tx=0x7f3d0800cc50 comp rx=0 tx=0).stop 2024-09-17T01:32:55.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.743+0000 7f3d1a800640 1 -- 172.21.15.42:0/3302594718 shutdown_connections 2024-09-17T01:32:55.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.743+0000 7f3d1a800640 1 --2- 172.21.15.42:0/3302594718 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3cf4078bc0 0x7f3cf407b0d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:55.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.743+0000 7f3d1a800640 1 --2- 172.21.15.42:0/3302594718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d1415c580 0x7f3d1415dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:55.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.743+0000 7f3d1a800640 1 --2- 172.21.15.42:0/3302594718 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3d140d2a00 0x7f3d141612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:55.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.743+0000 7f3d1a800640 1 --2- 172.21.15.42:0/3302594718 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d140b6100 0x7f3d14152c00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:55.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.743+0000 7f3d1a800640 1 -- 172.21.15.42:0/3302594718 >> 172.21.15.42:0/3302594718 conn(0x7f3d140d1100 msgr2=0x7f3d140d1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:55.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.743+0000 7f3d1a800640 1 -- 172.21.15.42:0/3302594718 shutdown_connections 2024-09-17T01:32:55.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.743+0000 7f3d1a800640 1 -- 172.21.15.42:0/3302594718 wait complete. 2024-09-17T01:32:55.762 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:32:55.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.992+0000 7f0878400640 1 -- 172.21.15.42:0/2366284486 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f08700cecb0 msgr2=0x7f08700cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:55.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.992+0000 7f0878400640 1 --2- 172.21.15.42:0/2366284486 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f08700cecb0 0x7f08700cf0c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f085c005fd0 tx=0x7f085c02a5d0 comp rx=0 tx=0).stop 2024-09-17T01:32:55.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.993+0000 7f0878400640 1 -- 172.21.15.42:0/2366284486 shutdown_connections 2024-09-17T01:32:55.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.993+0000 7f0878400640 1 --2- 172.21.15.42:0/2366284486 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f08700cecb0 0x7f08700cf0c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:55.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.993+0000 7f0878400640 1 --2- 172.21.15.42:0/2366284486 >> v2:172.21.15.43:3300/0 conn(0x7f087015cec0 0x7f087015d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:55.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.993+0000 7f0878400640 1 -- 172.21.15.42:0/2366284486 >> 172.21.15.42:0/2366284486 conn(0x7f08700b2930 msgr2=0x7f087006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:55.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.993+0000 7f0878400640 1 -- 172.21.15.42:0/2366284486 shutdown_connections 2024-09-17T01:32:55.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.993+0000 7f0878400640 1 -- 172.21.15.42:0/2366284486 wait complete. 2024-09-17T01:32:55.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.995+0000 7f0878400640 1 Processor -- start 2024-09-17T01:32:55.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.995+0000 7f0878400640 1 -- start start 2024-09-17T01:32:55.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.996+0000 7f0878400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0870072950 0x7f087014bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:55.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.996+0000 7f0878400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f08700cecb0 0x7f08701e7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:55.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.997+0000 7f0878400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f087015cec0 0x7f08700ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:55.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.997+0000 7f0878400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f087006dd50 con 0x7f0870072950 2024-09-17T01:32:55.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.997+0000 7f0878400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0870072d60 con 0x7f087015cec0 2024-09-17T01:32:55.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.997+0000 7f0878400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f08701e6420 con 0x7f08700cecb0 2024-09-17T01:32:55.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.997+0000 7f0875a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0870072950 0x7f087014bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:55.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.997+0000 7f0875a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0870072950 0x7f087014bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48600/0 (socket says 172.21.15.42:48600) 2024-09-17T01:32:55.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.997+0000 7f0875a00640 1 -- 172.21.15.42:0/2490869158 learned_addr learned my addr 172.21.15.42:0/2490869158 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:55.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.997+0000 7f0875000640 1 --2- 172.21.15.42:0/2490869158 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f08700cecb0 0x7f08701e7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:55.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.997+0000 7f0876400640 1 --2- 172.21.15.42:0/2490869158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f087015cec0 0x7f08700ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:55.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.997+0000 7f0875a00640 1 -- 172.21.15.42:0/2490869158 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f08700cecb0 msgr2=0x7f08701e7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:55.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.997+0000 7f0875a00640 1 --2- 172.21.15.42:0/2490869158 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f08700cecb0 0x7f08701e7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:55.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.997+0000 7f0875a00640 1 -- 172.21.15.42:0/2490869158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f087015cec0 msgr2=0x7f08700ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:55.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.997+0000 7f0875a00640 1 --2- 172.21.15.42:0/2490869158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f087015cec0 0x7f08700ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:55.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.997+0000 7f0875a00640 1 -- 172.21.15.42:0/2490869158 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08701f9270 con 0x7f0870072950 2024-09-17T01:32:55.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.997+0000 7f0875000640 1 --2- 172.21.15.42:0/2490869158 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f08700cecb0 0x7f08701e7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:55.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.998+0000 7f0875a00640 1 --2- 172.21.15.42:0/2490869158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0870072950 0x7f087014bde0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f086400e790 tx=0x7f086400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:55.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.998+0000 7f086d600640 1 -- 172.21.15.42:0/2490869158 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086400eea0 con 0x7f0870072950 2024-09-17T01:32:55.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.998+0000 7f086d600640 1 -- 172.21.15.42:0/2490869158 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f086400cc60 con 0x7f0870072950 2024-09-17T01:32:55.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.998+0000 7f0878400640 1 -- 172.21.15.42:0/2490869158 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08701f9550 con 0x7f0870072950 2024-09-17T01:32:55.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.998+0000 7f086d600640 1 -- 172.21.15.42:0/2490869158 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0864004020 con 0x7f0870072950 2024-09-17T01:32:55.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.998+0000 7f0878400640 1 -- 172.21.15.42:0/2490869158 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08701e8460 con 0x7f0870072950 2024-09-17T01:32:55.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:55.999+0000 7f0878400640 1 -- 172.21.15.42:0/2490869158 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0870073180 con 0x7f0870072950 2024-09-17T01:32:55.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.000+0000 7f086d600640 1 -- 172.21.15.42:0/2490869158 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f08640041c0 con 0x7f0870072950 2024-09-17T01:32:55.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.001+0000 7f086d600640 1 --2- 172.21.15.42:0/2490869158 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0850078bc0 0x7f085007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:55.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.002+0000 7f086d600640 1 -- 172.21.15.42:0/2490869158 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f086409b560 con 0x7f0870072950 2024-09-17T01:32:55.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.002+0000 7f0875000640 1 --2- 172.21.15.42:0/2490869158 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0850078bc0 0x7f085007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:56.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.003+0000 7f0875000640 1 --2- 172.21.15.42:0/2490869158 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0850078bc0 0x7f085007b0d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f085c033000 tx=0x7f085c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:56.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.006+0000 7f086d600640 1 -- 172.21.15.42:0/2490869158 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0864063a30 con 0x7f0870072950 2024-09-17T01:32:56.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.202+0000 7f0878400640 1 -- 172.21.15.42:0/2490869158 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f087006a170 con 0x7f0870072950 2024-09-17T01:32:56.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.203+0000 7f086d600640 1 -- 172.21.15.42:0/2490869158 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16634 (secure 0 0 0) 0x7f0864063330 con 0x7f0870072950 2024-09-17T01:32:56.201 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:56.201 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":32,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:32:54.766621+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:32:52.920392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T01:32:53.722123+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:32:56.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.205+0000 7f0878400640 1 -- 172.21.15.42:0/2490869158 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0850078bc0 msgr2=0x7f085007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:56.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.205+0000 7f0878400640 1 --2- 172.21.15.42:0/2490869158 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0850078bc0 0x7f085007b0d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f085c033000 tx=0x7f085c004730 comp rx=0 tx=0).stop 2024-09-17T01:32:56.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.205+0000 7f0878400640 1 -- 172.21.15.42:0/2490869158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0870072950 msgr2=0x7f087014bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:56.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.205+0000 7f0878400640 1 --2- 172.21.15.42:0/2490869158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0870072950 0x7f087014bde0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f086400e790 tx=0x7f086400ec50 comp rx=0 tx=0).stop 2024-09-17T01:32:56.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.206+0000 7f0878400640 1 -- 172.21.15.42:0/2490869158 shutdown_connections 2024-09-17T01:32:56.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.206+0000 7f0878400640 1 --2- 172.21.15.42:0/2490869158 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0850078bc0 0x7f085007b0d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:56.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.206+0000 7f0878400640 1 --2- 172.21.15.42:0/2490869158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f087015cec0 0x7f08700ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:56.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.206+0000 7f0878400640 1 --2- 172.21.15.42:0/2490869158 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f08700cecb0 0x7f08701e7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:56.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.206+0000 7f0878400640 1 --2- 172.21.15.42:0/2490869158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0870072950 0x7f087014bde0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:56.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.206+0000 7f0878400640 1 -- 172.21.15.42:0/2490869158 >> 172.21.15.42:0/2490869158 conn(0x7f08700b2930 msgr2=0x7f087015be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:56.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.206+0000 7f0878400640 1 -- 172.21.15.42:0/2490869158 shutdown_connections 2024-09-17T01:32:56.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.206+0000 7f0878400640 1 -- 172.21.15.42:0/2490869158 wait complete. 2024-09-17T01:32:56.225 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T01:32:56.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.459+0000 7f195aa00640 1 -- 172.21.15.42:0/1174872077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19540cef70 msgr2=0x7f1954156e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:56.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.459+0000 7f195aa00640 1 --2- 172.21.15.42:0/1174872077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19540cef70 0x7f1954156e50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f193c009830 tx=0x7f193c02a510 comp rx=0 tx=0).stop 2024-09-17T01:32:56.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.459+0000 7f195aa00640 1 -- 172.21.15.42:0/1174872077 shutdown_connections 2024-09-17T01:32:56.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.459+0000 7f195aa00640 1 --2- 172.21.15.42:0/1174872077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19540cef70 0x7f1954156e50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:56.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.459+0000 7f195aa00640 1 --2- 172.21.15.42:0/1174872077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f19540b5100 0x7f195415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:56.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.459+0000 7f195aa00640 1 -- 172.21.15.42:0/1174872077 >> 172.21.15.42:0/1174872077 conn(0x7f19540b2930 msgr2=0x7f195406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:56.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.459+0000 7f195aa00640 1 -- 172.21.15.42:0/1174872077 shutdown_connections 2024-09-17T01:32:56.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.459+0000 7f195aa00640 1 -- 172.21.15.42:0/1174872077 wait complete. 2024-09-17T01:32:56.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.461+0000 7f195aa00640 1 Processor -- start 2024-09-17T01:32:56.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.462+0000 7f195aa00640 1 -- start start 2024-09-17T01:32:56.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.463+0000 7f195aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f195406d430 0x7f19541e8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:56.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.463+0000 7f195aa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f19540b5100 0x7f19541f7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:56.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.463+0000 7f195aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19540cef70 0x7f19540ab790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:56.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.463+0000 7f195aa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1954072970 con 0x7f195406d430 2024-09-17T01:32:56.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.463+0000 7f195aa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f19540727f0 con 0x7f19540cef70 2024-09-17T01:32:56.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.463+0000 7f195aa00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1954072af0 con 0x7f19540b5100 2024-09-17T01:32:56.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.463+0000 7f1953e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f195406d430 0x7f19541e8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:56.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.463+0000 7f1953e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f195406d430 0x7f19541e8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48606/0 (socket says 172.21.15.42:48606) 2024-09-17T01:32:56.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.463+0000 7f1953e00640 1 -- 172.21.15.42:0/3128161482 learned_addr learned my addr 172.21.15.42:0/3128161482 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:56.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.464+0000 7f194b400640 1 --2- 172.21.15.42:0/3128161482 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f19540b5100 0x7f19541f7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:56.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.464+0000 7f1958a00640 1 --2- 172.21.15.42:0/3128161482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19540cef70 0x7f19540ab790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:56.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.464+0000 7f1953e00640 1 -- 172.21.15.42:0/3128161482 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f19540b5100 msgr2=0x7f19541f7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:56.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.464+0000 7f1953e00640 1 --2- 172.21.15.42:0/3128161482 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f19540b5100 0x7f19541f7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:56.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.464+0000 7f1953e00640 1 -- 172.21.15.42:0/3128161482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19540cef70 msgr2=0x7f19540ab790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:56.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.464+0000 7f1953e00640 1 --2- 172.21.15.42:0/3128161482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19540cef70 0x7f19540ab790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:56.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.464+0000 7f1953e00640 1 -- 172.21.15.42:0/3128161482 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19541f7c90 con 0x7f195406d430 2024-09-17T01:32:56.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.464+0000 7f1958a00640 1 --2- 172.21.15.42:0/3128161482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19540cef70 0x7f19540ab790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:56.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.464+0000 7f1953e00640 1 --2- 172.21.15.42:0/3128161482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f195406d430 0x7f19541e8790 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f194400d740 tx=0x7f194400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:56.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.464+0000 7f1950c00640 1 -- 172.21.15.42:0/3128161482 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1944017070 con 0x7f195406d430 2024-09-17T01:32:56.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.464+0000 7f1950c00640 1 -- 172.21.15.42:0/3128161482 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1944009d20 con 0x7f195406d430 2024-09-17T01:32:56.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.465+0000 7f1950c00640 1 -- 172.21.15.42:0/3128161482 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19440106c0 con 0x7f195406d430 2024-09-17T01:32:56.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.465+0000 7f195aa00640 1 -- 172.21.15.42:0/3128161482 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19541e76f0 con 0x7f195406d430 2024-09-17T01:32:56.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.465+0000 7f195aa00640 1 -- 172.21.15.42:0/3128161482 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19541e7cb0 con 0x7f195406d430 2024-09-17T01:32:56.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.466+0000 7f195aa00640 1 -- 172.21.15.42:0/3128161482 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f195415d950 con 0x7f195406d430 2024-09-17T01:32:56.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.467+0000 7f1950c00640 1 -- 172.21.15.42:0/3128161482 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f194401a070 con 0x7f195406d430 2024-09-17T01:32:56.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.468+0000 7f1950c00640 1 --2- 172.21.15.42:0/3128161482 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1930078b90 0x7f193007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:56.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.468+0000 7f1950c00640 1 -- 172.21.15.42:0/3128161482 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f194409af00 con 0x7f195406d430 2024-09-17T01:32:56.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.468+0000 7f194b400640 1 --2- 172.21.15.42:0/3128161482 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1930078b90 0x7f193007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:56.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.469+0000 7f194b400640 1 --2- 172.21.15.42:0/3128161482 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1930078b90 0x7f193007b0a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f193c034000 tx=0x7f193c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:56.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.472+0000 7f1950c00640 1 -- 172.21.15.42:0/3128161482 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f19541f7c90 con 0x7f195406d430 2024-09-17T01:32:56.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:56.701+0000 7f195aa00640 1 -- 172.21.15.42:0/3128161482 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f195406a170 con 0x7f195406d430 2024-09-17T01:32:57.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.268+0000 7f1950c00640 1 -- 172.21.15.42:0/3128161482 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f1944062c50 con 0x7f195406d430 2024-09-17T01:32:57.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.272+0000 7f195aa00640 1 -- 172.21.15.42:0/3128161482 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1930078b90 msgr2=0x7f193007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:57.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.272+0000 7f195aa00640 1 --2- 172.21.15.42:0/3128161482 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1930078b90 0x7f193007b0a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f193c034000 tx=0x7f193c004730 comp rx=0 tx=0).stop 2024-09-17T01:32:57.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.272+0000 7f195aa00640 1 -- 172.21.15.42:0/3128161482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f195406d430 msgr2=0x7f19541e8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:57.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.272+0000 7f195aa00640 1 --2- 172.21.15.42:0/3128161482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f195406d430 0x7f19541e8790 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f194400d740 tx=0x7f194400dc00 comp rx=0 tx=0).stop 2024-09-17T01:32:57.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.272+0000 7f195aa00640 1 -- 172.21.15.42:0/3128161482 shutdown_connections 2024-09-17T01:32:57.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.272+0000 7f195aa00640 1 --2- 172.21.15.42:0/3128161482 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1930078b90 0x7f193007b0a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:57.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.272+0000 7f195aa00640 1 --2- 172.21.15.42:0/3128161482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19540cef70 0x7f19540ab790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:57.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.272+0000 7f195aa00640 1 --2- 172.21.15.42:0/3128161482 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f19540b5100 0x7f19541f7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:57.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.272+0000 7f195aa00640 1 --2- 172.21.15.42:0/3128161482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f195406d430 0x7f19541e8790 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:57.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.272+0000 7f195aa00640 1 -- 172.21.15.42:0/3128161482 >> 172.21.15.42:0/3128161482 conn(0x7f19540b2930 msgr2=0x7f195406d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:57.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.272+0000 7f195aa00640 1 -- 172.21.15.42:0/3128161482 shutdown_connections 2024-09-17T01:32:57.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.272+0000 7f195aa00640 1 -- 172.21.15.42:0/3128161482 wait complete. 2024-09-17T01:32:57.292 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T01:32:57.293 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T01:32:57.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.526+0000 7f8f49800640 1 -- 172.21.15.42:0/2350812819 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f440b3880 msgr2=0x7f8f440af980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:57.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.526+0000 7f8f49800640 1 --2- 172.21.15.42:0/2350812819 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f440b3880 0x7f8f440af980 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8f34005fd0 tx=0x7f8f3402a5d0 comp rx=0 tx=0).stop 2024-09-17T01:32:57.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.527+0000 7f8f49800640 1 -- 172.21.15.42:0/2350812819 shutdown_connections 2024-09-17T01:32:57.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.527+0000 7f8f49800640 1 --2- 172.21.15.42:0/2350812819 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8f4415cfc0 0x7f8f440ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:57.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.527+0000 7f8f49800640 1 --2- 172.21.15.42:0/2350812819 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f440b3880 0x7f8f440af980 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:57.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.527+0000 7f8f49800640 1 -- 172.21.15.42:0/2350812819 >> 172.21.15.42:0/2350812819 conn(0x7f8f440b2930 msgr2=0x7f8f4406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:57.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.527+0000 7f8f49800640 1 -- 172.21.15.42:0/2350812819 shutdown_connections 2024-09-17T01:32:57.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.527+0000 7f8f49800640 1 -- 172.21.15.42:0/2350812819 wait complete. 2024-09-17T01:32:57.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.529+0000 7f8f49800640 1 Processor -- start 2024-09-17T01:32:57.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.529+0000 7f8f49800640 1 -- start start 2024-09-17T01:32:57.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.530+0000 7f8f49800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8f4406d430 0x7f8f441575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:57.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.530+0000 7f8f49800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f440b3880 0x7f8f44152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:57.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.531+0000 7f8f49800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f4415cfc0 0x7f8f44152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:57.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.531+0000 7f8f49800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8f44072ad0 con 0x7f8f4415cfc0 2024-09-17T01:32:57.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.531+0000 7f8f49800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8f44072950 con 0x7f8f440b3880 2024-09-17T01:32:57.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.531+0000 7f8f49800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8f44072c50 con 0x7f8f4406d430 2024-09-17T01:32:57.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.531+0000 7f8f43400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f4415cfc0 0x7f8f44152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:57.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.531+0000 7f8f43400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f4415cfc0 0x7f8f44152a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48612/0 (socket says 172.21.15.42:48612) 2024-09-17T01:32:57.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.531+0000 7f8f43400640 1 -- 172.21.15.42:0/497082502 learned_addr learned my addr 172.21.15.42:0/497082502 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:57.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.531+0000 7f8f42a00640 1 --2- 172.21.15.42:0/497082502 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8f4406d430 0x7f8f441575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:57.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.531+0000 7f8f3be00640 1 --2- 172.21.15.42:0/497082502 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f440b3880 0x7f8f44152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:57.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.531+0000 7f8f43400640 1 -- 172.21.15.42:0/497082502 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8f4406d430 msgr2=0x7f8f441575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:57.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.531+0000 7f8f43400640 1 --2- 172.21.15.42:0/497082502 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8f4406d430 0x7f8f441575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:57.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.531+0000 7f8f43400640 1 -- 172.21.15.42:0/497082502 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f440b3880 msgr2=0x7f8f44152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:57.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.531+0000 7f8f43400640 1 --2- 172.21.15.42:0/497082502 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f440b3880 0x7f8f44152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:57.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.531+0000 7f8f43400640 1 -- 172.21.15.42:0/497082502 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f44156ec0 con 0x7f8f4415cfc0 2024-09-17T01:32:57.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.532+0000 7f8f43400640 1 --2- 172.21.15.42:0/497082502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f4415cfc0 0x7f8f44152a70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00c730 tx=0x7f8f3c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:57.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.532+0000 7f8f3aa00640 1 -- 172.21.15.42:0/497082502 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c003b70 con 0x7f8f4415cfc0 2024-09-17T01:32:57.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.532+0000 7f8f3aa00640 1 -- 172.21.15.42:0/497082502 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f3c003d10 con 0x7f8f4415cfc0 2024-09-17T01:32:57.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.532+0000 7f8f49800640 1 -- 172.21.15.42:0/497082502 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f441587a0 con 0x7f8f4415cfc0 2024-09-17T01:32:57.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.532+0000 7f8f3aa00640 1 -- 172.21.15.42:0/497082502 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c005330 con 0x7f8f4415cfc0 2024-09-17T01:32:57.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.532+0000 7f8f49800640 1 -- 172.21.15.42:0/497082502 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f441580e0 con 0x7f8f4415cfc0 2024-09-17T01:32:57.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.533+0000 7f8f49800640 1 -- 172.21.15.42:0/497082502 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f440af980 con 0x7f8f4415cfc0 2024-09-17T01:32:57.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.534+0000 7f8f3aa00640 1 -- 172.21.15.42:0/497082502 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8f3c0056e0 con 0x7f8f4415cfc0 2024-09-17T01:32:57.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.535+0000 7f8f3aa00640 1 --2- 172.21.15.42:0/497082502 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8f20078b90 0x7f8f2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:57.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.536+0000 7f8f3aa00640 1 -- 172.21.15.42:0/497082502 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f8f3c09ab60 con 0x7f8f4415cfc0 2024-09-17T01:32:57.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.536+0000 7f8f42a00640 1 --2- 172.21.15.42:0/497082502 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8f20078b90 0x7f8f2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:57.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.537+0000 7f8f42a00640 1 --2- 172.21.15.42:0/497082502 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8f20078b90 0x7f8f2007b0a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8f34033000 tx=0x7f8f34004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:57.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.540+0000 7f8f3aa00640 1 -- 172.21.15.42:0/497082502 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8f3c0629d0 con 0x7f8f4415cfc0 2024-09-17T01:32:57.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:57.771+0000 7f8f49800640 1 -- 172.21.15.42:0/497082502 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f8f4406a170 con 0x7f8f4415cfc0 2024-09-17T01:32:58.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.270+0000 7f8f3aa00640 1 -- 172.21.15.42:0/497082502 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f8f3c067400 con 0x7f8f4415cfc0 2024-09-17T01:32:58.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.273+0000 7f8f49800640 1 -- 172.21.15.42:0/497082502 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8f20078b90 msgr2=0x7f8f2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:58.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.273+0000 7f8f49800640 1 --2- 172.21.15.42:0/497082502 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8f20078b90 0x7f8f2007b0a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8f34033000 tx=0x7f8f34004730 comp rx=0 tx=0).stop 2024-09-17T01:32:58.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.273+0000 7f8f49800640 1 -- 172.21.15.42:0/497082502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f4415cfc0 msgr2=0x7f8f44152a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:58.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.273+0000 7f8f49800640 1 --2- 172.21.15.42:0/497082502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f4415cfc0 0x7f8f44152a70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00c730 tx=0x7f8f3c00cbf0 comp rx=0 tx=0).stop 2024-09-17T01:32:58.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.273+0000 7f8f49800640 1 -- 172.21.15.42:0/497082502 shutdown_connections 2024-09-17T01:32:58.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.273+0000 7f8f49800640 1 --2- 172.21.15.42:0/497082502 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8f20078b90 0x7f8f2007b0a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:58.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.273+0000 7f8f49800640 1 --2- 172.21.15.42:0/497082502 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f440b3880 0x7f8f44152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:58.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.273+0000 7f8f49800640 1 --2- 172.21.15.42:0/497082502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f4415cfc0 0x7f8f44152a70 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:58.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.273+0000 7f8f49800640 1 --2- 172.21.15.42:0/497082502 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8f4406d430 0x7f8f441575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:58.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.273+0000 7f8f49800640 1 -- 172.21.15.42:0/497082502 >> 172.21.15.42:0/497082502 conn(0x7f8f440b2930 msgr2=0x7f8f44160110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:58.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.273+0000 7f8f49800640 1 -- 172.21.15.42:0/497082502 shutdown_connections 2024-09-17T01:32:58.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.273+0000 7f8f49800640 1 -- 172.21.15.42:0/497082502 wait complete. 2024-09-17T01:32:58.298 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T01:32:58.298 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:32:58.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.530+0000 7f74dcc00640 1 -- 172.21.15.42:0/3014837221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74d8072e00 msgr2=0x7f74d815bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:58.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.530+0000 7f74dcc00640 1 --2- 172.21.15.42:0/3014837221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74d8072e00 0x7f74d815bc50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f74c800a940 tx=0x7f74c802b8f0 comp rx=0 tx=0).stop 2024-09-17T01:32:58.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.530+0000 7f74dcc00640 1 -- 172.21.15.42:0/3014837221 shutdown_connections 2024-09-17T01:32:58.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.530+0000 7f74dcc00640 1 --2- 172.21.15.42:0/3014837221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74d8072e00 0x7f74d815bc50 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:58.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.530+0000 7f74dcc00640 1 -- 172.21.15.42:0/3014837221 >> 172.21.15.42:0/3014837221 conn(0x7f74d80b2930 msgr2=0x7f74d806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:58.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.530+0000 7f74dcc00640 1 -- 172.21.15.42:0/3014837221 shutdown_connections 2024-09-17T01:32:58.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.530+0000 7f74dcc00640 1 -- 172.21.15.42:0/3014837221 wait complete. 2024-09-17T01:32:58.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.532+0000 7f74dcc00640 1 Processor -- start 2024-09-17T01:32:58.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.532+0000 7f74dcc00640 1 -- start start 2024-09-17T01:32:58.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.534+0000 7f74dcc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74d8072e00 0x7f74d81f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:58.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.534+0000 7f74dcc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74d815f190 0x7f74d80b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:58.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.534+0000 7f74dcc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74d81521b0 0x7f74d81543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:58.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.534+0000 7f74dcc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f74d8151c30 con 0x7f74d815f190 2024-09-17T01:32:58.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.534+0000 7f74dcc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f74d8070790 con 0x7f74d81521b0 2024-09-17T01:32:58.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.534+0000 7f74dcc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f74d8151db0 con 0x7f74d8072e00 2024-09-17T01:32:58.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.534+0000 7f74d5400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74d815f190 0x7f74d80b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:58.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.534+0000 7f74d5400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74d815f190 0x7f74d80b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48632/0 (socket says 172.21.15.42:48632) 2024-09-17T01:32:58.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.534+0000 7f74d5400640 1 -- 172.21.15.42:0/1014616512 learned_addr learned my addr 172.21.15.42:0/1014616512 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:58.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.534+0000 7f74d5e00640 1 --2- 172.21.15.42:0/1014616512 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74d8072e00 0x7f74d81f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:58.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.534+0000 7f74d6800640 1 --2- 172.21.15.42:0/1014616512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74d81521b0 0x7f74d81543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:58.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.534+0000 7f74d5400640 1 -- 172.21.15.42:0/1014616512 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74d8072e00 msgr2=0x7f74d81f5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:58.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.534+0000 7f74d5400640 1 --2- 172.21.15.42:0/1014616512 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74d8072e00 0x7f74d81f5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:58.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.534+0000 7f74d5400640 1 -- 172.21.15.42:0/1014616512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74d81521b0 msgr2=0x7f74d81543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:58.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.534+0000 7f74d5400640 1 --2- 172.21.15.42:0/1014616512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74d81521b0 0x7f74d81543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:58.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.534+0000 7f74d5400640 1 -- 172.21.15.42:0/1014616512 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d80b34c0 con 0x7f74d815f190 2024-09-17T01:32:58.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.535+0000 7f74d5400640 1 --2- 172.21.15.42:0/1014616512 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74d815f190 0x7f74d80b5080 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f74c400c370 tx=0x7f74c400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:58.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.535+0000 7f74ce000640 1 -- 172.21.15.42:0/1014616512 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c4017070 con 0x7f74d815f190 2024-09-17T01:32:58.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.535+0000 7f74ce000640 1 -- 172.21.15.42:0/1014616512 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74c40035f0 con 0x7f74d815f190 2024-09-17T01:32:58.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.535+0000 7f74ce000640 1 -- 172.21.15.42:0/1014616512 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c4003a40 con 0x7f74d815f190 2024-09-17T01:32:58.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.535+0000 7f74dcc00640 1 -- 172.21.15.42:0/1014616512 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74d81f6270 con 0x7f74d815f190 2024-09-17T01:32:58.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.535+0000 7f74dcc00640 1 -- 172.21.15.42:0/1014616512 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74d81f6830 con 0x7f74d815f190 2024-09-17T01:32:58.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.536+0000 7f74dcc00640 1 -- 172.21.15.42:0/1014616512 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74d815bc50 con 0x7f74d815f190 2024-09-17T01:32:58.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.537+0000 7f74ce000640 1 -- 172.21.15.42:0/1014616512 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f74c401a070 con 0x7f74d815f190 2024-09-17T01:32:58.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.538+0000 7f74ce000640 1 --2- 172.21.15.42:0/1014616512 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74b8078bc0 0x7f74b807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:58.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.538+0000 7f74ce000640 1 -- 172.21.15.42:0/1014616512 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f74c4099ec0 con 0x7f74d815f190 2024-09-17T01:32:58.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.539+0000 7f74d5e00640 1 --2- 172.21.15.42:0/1014616512 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74b8078bc0 0x7f74b807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:58.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.540+0000 7f74d5e00640 1 --2- 172.21.15.42:0/1014616512 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74b8078bc0 0x7f74b807b0d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f74c8036000 tx=0x7f74c8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:58.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.543+0000 7f74ce000640 1 -- 172.21.15.42:0/1014616512 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f74c4061d30 con 0x7f74d815f190 2024-09-17T01:32:58.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.771+0000 7f74dcc00640 1 -- 172.21.15.42:0/1014616512 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74d81f6000 con 0x7f74d815f190 2024-09-17T01:32:58.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.772+0000 7f74ce000640 1 -- 172.21.15.42:0/1014616512 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5223 (secure 0 0 0) 0x7f74c4066760 con 0x7f74d815f190 2024-09-17T01:32:58.769 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:58.770 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":17,"btime":"2024-09-17T01:32:58:269267+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4628,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/2560567328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2560567328},{"type":"v1","addr":"172.21.15.42:6833","nonce":2560567328}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1462836032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1462836032},{"type":"v1","addr":"172.21.15.43:6836","nonce":1462836032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4798,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3719448578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3719448578},{"type":"v1","addr":"172.21.15.43:6837","nonce":3719448578}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:32:54.766579+0000","modified":"2024-09-17T01:32:57.772964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4830},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4830":{"gid":4830,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3278817895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3278817895},{"type":"v1","addr":"172.21.15.42:6835","nonce":3278817895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4830,"qdb_cluster":[4830]},"id":2}]} 2024-09-17T01:32:58.770 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 17 2024-09-17T01:32:58.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.774+0000 7f74dcc00640 1 -- 172.21.15.42:0/1014616512 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74b8078bc0 msgr2=0x7f74b807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:58.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.774+0000 7f74dcc00640 1 --2- 172.21.15.42:0/1014616512 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74b8078bc0 0x7f74b807b0d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f74c8036000 tx=0x7f74c8004730 comp rx=0 tx=0).stop 2024-09-17T01:32:58.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.774+0000 7f74dcc00640 1 -- 172.21.15.42:0/1014616512 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74d815f190 msgr2=0x7f74d80b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:58.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.774+0000 7f74dcc00640 1 --2- 172.21.15.42:0/1014616512 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74d815f190 0x7f74d80b5080 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f74c400c370 tx=0x7f74c400c830 comp rx=0 tx=0).stop 2024-09-17T01:32:58.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.774+0000 7f74dcc00640 1 -- 172.21.15.42:0/1014616512 shutdown_connections 2024-09-17T01:32:58.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.774+0000 7f74dcc00640 1 --2- 172.21.15.42:0/1014616512 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74b8078bc0 0x7f74b807b0d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:58.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.774+0000 7f74dcc00640 1 --2- 172.21.15.42:0/1014616512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74d81521b0 0x7f74d81543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:58.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.774+0000 7f74dcc00640 1 --2- 172.21.15.42:0/1014616512 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74d815f190 0x7f74d80b5080 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:58.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.774+0000 7f74dcc00640 1 --2- 172.21.15.42:0/1014616512 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74d8072e00 0x7f74d81f5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:58.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.774+0000 7f74dcc00640 1 -- 172.21.15.42:0/1014616512 >> 172.21.15.42:0/1014616512 conn(0x7f74d80b2930 msgr2=0x7f74d80b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:58.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.774+0000 7f74dcc00640 1 -- 172.21.15.42:0/1014616512 shutdown_connections 2024-09-17T01:32:58.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:58.774+0000 7f74dcc00640 1 -- 172.21.15.42:0/1014616512 wait complete. 2024-09-17T01:32:58.797 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:32:59.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.026+0000 7f8b53e00640 1 -- 172.21.15.42:0/1932341770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b38003c30 msgr2=0x7f8b38004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:59.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.026+0000 7f8b53e00640 1 --2- 172.21.15.42:0/1932341770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b38003c30 0x7f8b38004080 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8b44009b20 tx=0x7f8b38005830 comp rx=0 tx=0).stop 2024-09-17T01:32:59.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.026+0000 7f8b53e00640 1 -- 172.21.15.42:0/1932341770 shutdown_connections 2024-09-17T01:32:59.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.026+0000 7f8b53e00640 1 --2- 172.21.15.42:0/1932341770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b38003c30 0x7f8b38004080 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:59.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.026+0000 7f8b53e00640 1 -- 172.21.15.42:0/1932341770 >> 172.21.15.42:0/1932341770 conn(0x7f8b54070360 msgr2=0x7f8b54070770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:59.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.026+0000 7f8b53e00640 1 -- 172.21.15.42:0/1932341770 shutdown_connections 2024-09-17T01:32:59.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.026+0000 7f8b53e00640 1 -- 172.21.15.42:0/1932341770 wait complete. 2024-09-17T01:32:59.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.028+0000 7f8b53e00640 1 Processor -- start 2024-09-17T01:32:59.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.029+0000 7f8b53e00640 1 -- start start 2024-09-17T01:32:59.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.030+0000 7f8b53e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b38003c30 0x7f8b540d19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:59.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.030+0000 7f8b53e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b5406ddf0 0x7f8b540d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:59.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.030+0000 7f8b53e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8b5406e930 0x7f8b540ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:59.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.030+0000 7f8b53e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8b54071c40 con 0x7f8b38003c30 2024-09-17T01:32:59.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.030+0000 7f8b53e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8b54071ac0 con 0x7f8b5406ddf0 2024-09-17T01:32:59.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.030+0000 7f8b53e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8b54071dc0 con 0x7f8b5406e930 2024-09-17T01:32:59.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.030+0000 7f8b52a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b38003c30 0x7f8b540d19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:59.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.030+0000 7f8b52a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b38003c30 0x7f8b540d19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48648/0 (socket says 172.21.15.42:48648) 2024-09-17T01:32:59.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.030+0000 7f8b52a00640 1 -- 172.21.15.42:0/1175817595 learned_addr learned my addr 172.21.15.42:0/1175817595 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:59.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.031+0000 7f8b53400640 1 --2- 172.21.15.42:0/1175817595 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8b5406e930 0x7f8b540ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:59.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.031+0000 7f8b4be00640 1 --2- 172.21.15.42:0/1175817595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b5406ddf0 0x7f8b540d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:59.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.031+0000 7f8b52a00640 1 -- 172.21.15.42:0/1175817595 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8b5406e930 msgr2=0x7f8b540ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:59.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.031+0000 7f8b52a00640 1 --2- 172.21.15.42:0/1175817595 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8b5406e930 0x7f8b540ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:59.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.031+0000 7f8b52a00640 1 -- 172.21.15.42:0/1175817595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b5406ddf0 msgr2=0x7f8b540d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:59.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.031+0000 7f8b52a00640 1 --2- 172.21.15.42:0/1175817595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b5406ddf0 0x7f8b540d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:59.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.031+0000 7f8b52a00640 1 -- 172.21.15.42:0/1175817595 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b5406cdc0 con 0x7f8b38003c30 2024-09-17T01:32:59.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.031+0000 7f8b53400640 1 --2- 172.21.15.42:0/1175817595 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8b5406e930 0x7f8b540ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:32:59.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.031+0000 7f8b52a00640 1 --2- 172.21.15.42:0/1175817595 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b38003c30 0x7f8b540d19b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8b44000c00 tx=0x7f8b440336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:59.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.031+0000 7f8b4aa00640 1 -- 172.21.15.42:0/1175817595 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b44038040 con 0x7f8b38003c30 2024-09-17T01:32:59.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.031+0000 7f8b4aa00640 1 -- 172.21.15.42:0/1175817595 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b440338e0 con 0x7f8b38003c30 2024-09-17T01:32:59.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.032+0000 7f8b4aa00640 1 -- 172.21.15.42:0/1175817595 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b44033d30 con 0x7f8b38003c30 2024-09-17T01:32:59.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.032+0000 7f8b53e00640 1 -- 172.21.15.42:0/1175817595 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b5406d030 con 0x7f8b38003c30 2024-09-17T01:32:59.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.032+0000 7f8b53e00640 1 -- 172.21.15.42:0/1175817595 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b5406d5f0 con 0x7f8b38003c30 2024-09-17T01:32:59.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.033+0000 7f8b53e00640 1 -- 172.21.15.42:0/1175817595 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b54072320 con 0x7f8b38003c30 2024-09-17T01:32:59.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.034+0000 7f8b4aa00640 1 -- 172.21.15.42:0/1175817595 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b44043020 con 0x7f8b38003c30 2024-09-17T01:32:59.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.035+0000 7f8b4aa00640 1 --2- 172.21.15.42:0/1175817595 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b30078b90 0x7f8b3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:59.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.035+0000 7f8b4aa00640 1 -- 172.21.15.42:0/1175817595 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f8b440baf20 con 0x7f8b38003c30 2024-09-17T01:32:59.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.035+0000 7f8b4be00640 1 --2- 172.21.15.42:0/1175817595 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b30078b90 0x7f8b3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:59.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.036+0000 7f8b4be00640 1 --2- 172.21.15.42:0/1175817595 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b30078b90 0x7f8b3007b0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c003a90 tx=0x7f8b3c0045f0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:59.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.040+0000 7f8b4aa00640 1 -- 172.21.15.42:0/1175817595 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8b4404a020 con 0x7f8b38003c30 2024-09-17T01:32:59.229 INFO:tasks.ceph.mds.a.smithi042.stderr:2024-09-17T01:32:59.231+0000 7fcdc0800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:32:59.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.235+0000 7f8b53e00640 1 -- 172.21.15.42:0/1175817595 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b540b5f80 con 0x7f8b38003c30 2024-09-17T01:32:59.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.236+0000 7f8b4aa00640 1 -- 172.21.15.42:0/1175817595 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16621 (secure 0 0 0) 0x7f8b44083350 con 0x7f8b38003c30 2024-09-17T01:32:59.234 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:59.235 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":33,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:32:56.246323+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:32:52.920392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T01:32:53.722123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:32:59.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.239+0000 7f8b53e00640 1 -- 172.21.15.42:0/1175817595 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b30078b90 msgr2=0x7f8b3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:59.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.239+0000 7f8b53e00640 1 --2- 172.21.15.42:0/1175817595 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b30078b90 0x7f8b3007b0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c003a90 tx=0x7f8b3c0045f0 comp rx=0 tx=0).stop 2024-09-17T01:32:59.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.239+0000 7f8b53e00640 1 -- 172.21.15.42:0/1175817595 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b38003c30 msgr2=0x7f8b540d19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:59.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.239+0000 7f8b53e00640 1 --2- 172.21.15.42:0/1175817595 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b38003c30 0x7f8b540d19b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8b44000c00 tx=0x7f8b440336f0 comp rx=0 tx=0).stop 2024-09-17T01:32:59.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.239+0000 7f8b53e00640 1 -- 172.21.15.42:0/1175817595 shutdown_connections 2024-09-17T01:32:59.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.239+0000 7f8b53e00640 1 --2- 172.21.15.42:0/1175817595 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b30078b90 0x7f8b3007b0a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:59.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.239+0000 7f8b53e00640 1 --2- 172.21.15.42:0/1175817595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b5406ddf0 0x7f8b540d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:59.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.239+0000 7f8b53e00640 1 --2- 172.21.15.42:0/1175817595 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8b5406e930 0x7f8b540ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:59.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.239+0000 7f8b53e00640 1 --2- 172.21.15.42:0/1175817595 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b38003c30 0x7f8b540d19b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:59.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.239+0000 7f8b53e00640 1 -- 172.21.15.42:0/1175817595 >> 172.21.15.42:0/1175817595 conn(0x7f8b54070360 msgr2=0x7f8b540b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:59.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.239+0000 7f8b53e00640 1 -- 172.21.15.42:0/1175817595 shutdown_connections 2024-09-17T01:32:59.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.239+0000 7f8b53e00640 1 -- 172.21.15.42:0/1175817595 wait complete. 2024-09-17T01:32:59.259 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T01:32:59.259 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:32:59.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.489+0000 7f40cbe00640 1 -- 172.21.15.42:0/1048189127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40cc15b680 msgr2=0x7f40cc15fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:59.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.489+0000 7f40cbe00640 1 --2- 172.21.15.42:0/1048189127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40cc15b680 0x7f40cc15fcc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f40cc072190 tx=0x7f40bc02a5f0 comp rx=0 tx=0).stop 2024-09-17T01:32:59.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.489+0000 7f40cbe00640 1 -- 172.21.15.42:0/1048189127 shutdown_connections 2024-09-17T01:32:59.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.489+0000 7f40cbe00640 1 --2- 172.21.15.42:0/1048189127 >> v2:172.21.15.43:3300/0 conn(0x7f40cc0cafe0 0x7f40cc15f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:59.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.489+0000 7f40cbe00640 1 --2- 172.21.15.42:0/1048189127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40cc15b680 0x7f40cc15fcc0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:59.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.489+0000 7f40cbe00640 1 -- 172.21.15.42:0/1048189127 >> 172.21.15.42:0/1048189127 conn(0x7f40cc0b25f0 msgr2=0x7f40cc0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:59.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.489+0000 7f40cbe00640 1 -- 172.21.15.42:0/1048189127 shutdown_connections 2024-09-17T01:32:59.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.489+0000 7f40cbe00640 1 -- 172.21.15.42:0/1048189127 wait complete. 2024-09-17T01:32:59.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.491+0000 7f40cbe00640 1 Processor -- start 2024-09-17T01:32:59.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.491+0000 7f40cbe00640 1 -- start start 2024-09-17T01:32:59.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.493+0000 7f40cbe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f40cc0cafe0 0x7f40cc09dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:59.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.493+0000 7f40cbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40cc15b680 0x7f40cc09bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:59.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.493+0000 7f40cbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40cc15f660 0x7f40cc0721e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:59.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.493+0000 7f40cbe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f40cc0b37b0 con 0x7f40cc15f660 2024-09-17T01:32:59.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.493+0000 7f40cbe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f40cc06fc20 con 0x7f40cc15b680 2024-09-17T01:32:59.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.493+0000 7f40cbe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f40cc0b3930 con 0x7f40cc0cafe0 2024-09-17T01:32:59.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.493+0000 7f40cb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40cc15f660 0x7f40cc0721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:59.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.493+0000 7f40cb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40cc15f660 0x7f40cc0721e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48664/0 (socket says 172.21.15.42:48664) 2024-09-17T01:32:59.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.493+0000 7f40cb400640 1 -- 172.21.15.42:0/2636503691 learned_addr learned my addr 172.21.15.42:0/2636503691 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:32:59.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.493+0000 7f40caa00640 1 --2- 172.21.15.42:0/2636503691 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f40cc0cafe0 0x7f40cc09dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:59.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.493+0000 7f40c3e00640 1 --2- 172.21.15.42:0/2636503691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40cc15b680 0x7f40cc09bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:59.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.493+0000 7f40cb400640 1 -- 172.21.15.42:0/2636503691 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f40cc0cafe0 msgr2=0x7f40cc09dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:59.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.493+0000 7f40cb400640 1 --2- 172.21.15.42:0/2636503691 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f40cc0cafe0 0x7f40cc09dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:59.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.493+0000 7f40cb400640 1 -- 172.21.15.42:0/2636503691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40cc15b680 msgr2=0x7f40cc09bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:59.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.493+0000 7f40cb400640 1 --2- 172.21.15.42:0/2636503691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40cc15b680 0x7f40cc09bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:59.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.493+0000 7f40cb400640 1 -- 172.21.15.42:0/2636503691 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40cc1590a0 con 0x7f40cc15f660 2024-09-17T01:32:59.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.494+0000 7f40caa00640 1 --2- 172.21.15.42:0/2636503691 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f40cc0cafe0 0x7f40cc09dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:59.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.494+0000 7f40c3e00640 1 --2- 172.21.15.42:0/2636503691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40cc15b680 0x7f40cc09bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:32:59.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.494+0000 7f40cb400640 1 --2- 172.21.15.42:0/2636503691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40cc15f660 0x7f40cc0721e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f40c400c6b0 tx=0x7f40c400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:59.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.494+0000 7f40c3400640 1 -- 172.21.15.42:0/2636503691 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c4003b70 con 0x7f40cc15f660 2024-09-17T01:32:59.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.494+0000 7f40c3400640 1 -- 172.21.15.42:0/2636503691 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40c4003d30 con 0x7f40cc15f660 2024-09-17T01:32:59.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.494+0000 7f40cbe00640 1 -- 172.21.15.42:0/2636503691 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40cc09a700 con 0x7f40cc15f660 2024-09-17T01:32:59.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.494+0000 7f40c3400640 1 -- 172.21.15.42:0/2636503691 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c4005330 con 0x7f40cc15f660 2024-09-17T01:32:59.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.494+0000 7f40cbe00640 1 -- 172.21.15.42:0/2636503691 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40cc09acc0 con 0x7f40cc15f660 2024-09-17T01:32:59.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.495+0000 7f40cbe00640 1 -- 172.21.15.42:0/2636503691 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40cc09b400 con 0x7f40cc15f660 2024-09-17T01:32:59.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.497+0000 7f40c3400640 1 -- 172.21.15.42:0/2636503691 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f40c40054d0 con 0x7f40cc15f660 2024-09-17T01:32:59.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.498+0000 7f40c3400640 1 --2- 172.21.15.42:0/2636503691 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f40a8078bc0 0x7f40a807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:32:59.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.498+0000 7f40c3400640 1 -- 172.21.15.42:0/2636503691 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f40c409aa70 con 0x7f40cc15f660 2024-09-17T01:32:59.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.499+0000 7f40caa00640 1 --2- 172.21.15.42:0/2636503691 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f40a8078bc0 0x7f40a807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:32:59.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.500+0000 7f40caa00640 1 --2- 172.21.15.42:0/2636503691 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f40a8078bc0 0x7f40a807b0d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f40bc033000 tx=0x7f40bc004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:32:59.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.503+0000 7f40c3400640 1 -- 172.21.15.42:0/2636503691 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f40cc1590a0 con 0x7f40cc15f660 2024-09-17T01:32:59.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.692+0000 7f40cbe00640 1 -- 172.21.15.42:0/2636503691 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f40cc0cd100 con 0x7f40a8078bc0 2024-09-17T01:32:59.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.699+0000 7f40c3400640 1 -- 172.21.15.42:0/2636503691 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247976 (secure 0 0 0) 0x7f40cc0cd100 con 0x7f40a8078bc0 2024-09-17T01:32:59.700 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:32:59.701 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:32:59.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.703+0000 7f40cbe00640 1 -- 172.21.15.42:0/2636503691 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f40a8078bc0 msgr2=0x7f40a807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:59.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.703+0000 7f40cbe00640 1 --2- 172.21.15.42:0/2636503691 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f40a8078bc0 0x7f40a807b0d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f40bc033000 tx=0x7f40bc004730 comp rx=0 tx=0).stop 2024-09-17T01:32:59.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.703+0000 7f40cbe00640 1 -- 172.21.15.42:0/2636503691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40cc15f660 msgr2=0x7f40cc0721e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:59.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.703+0000 7f40cbe00640 1 --2- 172.21.15.42:0/2636503691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40cc15f660 0x7f40cc0721e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f40c400c6b0 tx=0x7f40c400cb70 comp rx=0 tx=0).stop 2024-09-17T01:32:59.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.703+0000 7f40cbe00640 1 -- 172.21.15.42:0/2636503691 shutdown_connections 2024-09-17T01:32:59.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.703+0000 7f40cbe00640 1 --2- 172.21.15.42:0/2636503691 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f40a8078bc0 0x7f40a807b0d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:59.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.703+0000 7f40cbe00640 1 --2- 172.21.15.42:0/2636503691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40cc15b680 0x7f40cc09bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:59.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.703+0000 7f40cbe00640 1 --2- 172.21.15.42:0/2636503691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40cc15f660 0x7f40cc0721e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:59.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.703+0000 7f40cbe00640 1 --2- 172.21.15.42:0/2636503691 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f40cc0cafe0 0x7f40cc09dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:59.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.703+0000 7f40cbe00640 1 -- 172.21.15.42:0/2636503691 >> 172.21.15.42:0/2636503691 conn(0x7f40cc0b25f0 msgr2=0x7f40cc0d00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:59.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.703+0000 7f40cbe00640 1 -- 172.21.15.42:0/2636503691 shutdown_connections 2024-09-17T01:32:59.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.703+0000 7f40cbe00640 1 -- 172.21.15.42:0/2636503691 wait complete. 2024-09-17T01:32:59.723 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-09-17T01:32:58.988493+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":109,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":62,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253348,"kb_used_data":3824,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721372,"statfs":{"total":773094113280,"available":772834684928,"internally_reserved":0,"allocated":3915776,"data_stored":2198457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.752209"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.284914+0000","last_change":"2024-09-17T01:32:55.281409+0000","last_active":"2024-09-17T01:32:55.284914+0000","last_peered":"2024-09-17T01:32:55.284914+0000","last_clean":"2024-09-17T01:32:55.284914+0000","last_became_active":"2024-09-17T01:32:55.277989+0000","last_became_peered":"2024-09-17T01:32:55.277989+0000","last_unstale":"2024-09-17T01:32:55.284914+0000","last_undegraded":"2024-09-17T01:32:55.284914+0000","last_fullsized":"2024-09-17T01:32:55.284914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:37.868206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269483+0000","last_change":"2024-09-17T01:32:55.286374+0000","last_active":"2024-09-17T01:32:56.269483+0000","last_peered":"2024-09-17T01:32:56.269483+0000","last_clean":"2024-09-17T01:32:56.269483+0000","last_became_active":"2024-09-17T01:32:55.282079+0000","last_became_peered":"2024-09-17T01:32:55.282079+0000","last_unstale":"2024-09-17T01:32:56.269483+0000","last_undegraded":"2024-09-17T01:32:56.269483+0000","last_fullsized":"2024-09-17T01:32:56.269483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:37.917841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.251474+0000","last_change":"2024-09-17T01:32:54.251474+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.251474+0000","last_undegraded":"2024-09-17T01:32:54.251474+0000","last_fullsized":"2024-09-17T01:32:54.251474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.253930+0000","last_change":"2024-09-17T01:32:54.253930+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.253930+0000","last_undegraded":"2024-09-17T01:32:54.253930+0000","last_fullsized":"2024-09-17T01:32:54.253930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269043+0000","last_change":"2024-09-17T01:32:55.282329+0000","last_active":"2024-09-17T01:32:56.269043+0000","last_peered":"2024-09-17T01:32:56.269043+0000","last_clean":"2024-09-17T01:32:56.269043+0000","last_became_active":"2024-09-17T01:32:55.281587+0000","last_became_peered":"2024-09-17T01:32:55.281587+0000","last_unstale":"2024-09-17T01:32:56.269043+0000","last_undegraded":"2024-09-17T01:32:56.269043+0000","last_fullsized":"2024-09-17T01:32:56.269043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:38:26.720551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.253554+0000","last_change":"2024-09-17T01:32:54.253554+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.253554+0000","last_undegraded":"2024-09-17T01:32:54.253554+0000","last_fullsized":"2024-09-17T01:32:54.253554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.280637+0000","last_change":"2024-09-17T01:32:55.278314+0000","last_active":"2024-09-17T01:32:55.280637+0000","last_peered":"2024-09-17T01:32:55.280637+0000","last_clean":"2024-09-17T01:32:55.280637+0000","last_became_active":"2024-09-17T01:32:55.277821+0000","last_became_peered":"2024-09-17T01:32:55.277821+0000","last_unstale":"2024-09-17T01:32:55.280637+0000","last_undegraded":"2024-09-17T01:32:55.280637+0000","last_fullsized":"2024-09-17T01:32:55.280637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:34:51.193448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.290252+0000","last_change":"2024-09-17T01:32:55.284414+0000","last_active":"2024-09-17T01:32:55.290252+0000","last_peered":"2024-09-17T01:32:55.290252+0000","last_clean":"2024-09-17T01:32:55.290252+0000","last_became_active":"2024-09-17T01:32:55.284204+0000","last_became_peered":"2024-09-17T01:32:55.284204+0000","last_unstale":"2024-09-17T01:32:55.290252+0000","last_undegraded":"2024-09-17T01:32:55.290252+0000","last_fullsized":"2024-09-17T01:32:55.290252+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:24.066985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.251163+0000","last_change":"2024-09-17T01:32:54.251163+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.251163+0000","last_undegraded":"2024-09-17T01:32:54.251163+0000","last_fullsized":"2024-09-17T01:32:54.251163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.254676+0000","last_change":"2024-09-17T01:32:54.254676+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.254676+0000","last_undegraded":"2024-09-17T01:32:54.254676+0000","last_fullsized":"2024-09-17T01:32:54.254676+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.262516+0000","last_change":"2024-09-17T01:32:54.262516+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.262516+0000","last_undegraded":"2024-09-17T01:32:54.262516+0000","last_fullsized":"2024-09-17T01:32:54.262516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.249802+0000","last_change":"2024-09-17T01:32:54.249802+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.249802+0000","last_undegraded":"2024-09-17T01:32:54.249802+0000","last_fullsized":"2024-09-17T01:32:54.249802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.249501+0000","last_change":"2024-09-17T01:32:54.249501+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.249501+0000","last_undegraded":"2024-09-17T01:32:54.249501+0000","last_fullsized":"2024-09-17T01:32:54.249501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.251224+0000","last_change":"2024-09-17T01:32:54.251224+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.251224+0000","last_undegraded":"2024-09-17T01:32:54.251224+0000","last_fullsized":"2024-09-17T01:32:54.251224+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.262084+0000","last_change":"2024-09-17T01:32:54.262084+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.262084+0000","last_undegraded":"2024-09-17T01:32:54.262084+0000","last_fullsized":"2024-09-17T01:32:54.262084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.253217+0000","last_change":"2024-09-17T01:32:54.253217+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.253217+0000","last_undegraded":"2024-09-17T01:32:54.253217+0000","last_fullsized":"2024-09-17T01:32:54.253217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.264120+0000","last_change":"2024-09-17T01:32:54.264120+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.264120+0000","last_undegraded":"2024-09-17T01:32:54.264120+0000","last_fullsized":"2024-09-17T01:32:54.264120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.258634+0000","last_change":"2024-09-17T01:32:54.258634+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.258634+0000","last_undegraded":"2024-09-17T01:32:54.258634+0000","last_fullsized":"2024-09-17T01:32:54.258634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.259123+0000","last_change":"2024-09-17T01:32:54.259123+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.259123+0000","last_undegraded":"2024-09-17T01:32:54.259123+0000","last_fullsized":"2024-09-17T01:32:54.259123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.251851+0000","last_change":"2024-09-17T01:32:54.251851+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.251851+0000","last_undegraded":"2024-09-17T01:32:54.251851+0000","last_fullsized":"2024-09-17T01:32:54.251851+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.257412+0000","last_change":"2024-09-17T01:32:54.257412+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.257412+0000","last_undegraded":"2024-09-17T01:32:54.257412+0000","last_fullsized":"2024-09-17T01:32:54.257412+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.289838+0000","last_change":"2024-09-17T01:32:55.283222+0000","last_active":"2024-09-17T01:32:55.289838+0000","last_peered":"2024-09-17T01:32:55.289838+0000","last_clean":"2024-09-17T01:32:55.289838+0000","last_became_active":"2024-09-17T01:32:55.282841+0000","last_became_peered":"2024-09-17T01:32:55.282841+0000","last_unstale":"2024-09-17T01:32:55.289838+0000","last_undegraded":"2024-09-17T01:32:55.289838+0000","last_fullsized":"2024-09-17T01:32:55.289838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:39.561775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.248800+0000","last_change":"2024-09-17T01:32:54.248800+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.248800+0000","last_undegraded":"2024-09-17T01:32:54.248800+0000","last_fullsized":"2024-09-17T01:32:54.248800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.283936+0000","last_change":"2024-09-17T01:32:55.281293+0000","last_active":"2024-09-17T01:32:55.283936+0000","last_peered":"2024-09-17T01:32:55.283936+0000","last_clean":"2024-09-17T01:32:55.283936+0000","last_became_active":"2024-09-17T01:32:55.280932+0000","last_became_peered":"2024-09-17T01:32:55.280932+0000","last_unstale":"2024-09-17T01:32:55.283936+0000","last_undegraded":"2024-09-17T01:32:55.283936+0000","last_fullsized":"2024-09-17T01:32:55.283936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:41.379696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.257796+0000","last_change":"2024-09-17T01:32:54.257796+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.257796+0000","last_undegraded":"2024-09-17T01:32:54.257796+0000","last_fullsized":"2024-09-17T01:32:54.257796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.253346+0000","last_change":"2024-09-17T01:32:54.253346+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.253346+0000","last_undegraded":"2024-09-17T01:32:54.253346+0000","last_fullsized":"2024-09-17T01:32:54.253346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269159+0000","last_change":"2024-09-17T01:32:55.258825+0000","last_active":"2024-09-17T01:32:56.269159+0000","last_peered":"2024-09-17T01:32:56.269159+0000","last_clean":"2024-09-17T01:32:56.269159+0000","last_became_active":"2024-09-17T01:32:55.258420+0000","last_became_peered":"2024-09-17T01:32:55.258420+0000","last_unstale":"2024-09-17T01:32:56.269159+0000","last_undegraded":"2024-09-17T01:32:56.269159+0000","last_fullsized":"2024-09-17T01:32:56.269159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:07.739522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.281933+0000","last_change":"2024-09-17T01:32:55.279814+0000","last_active":"2024-09-17T01:32:55.281933+0000","last_peered":"2024-09-17T01:32:55.281933+0000","last_clean":"2024-09-17T01:32:55.281933+0000","last_became_active":"2024-09-17T01:32:55.278739+0000","last_became_peered":"2024-09-17T01:32:55.278739+0000","last_unstale":"2024-09-17T01:32:55.281933+0000","last_undegraded":"2024-09-17T01:32:55.281933+0000","last_fullsized":"2024-09-17T01:32:55.281933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:47.719271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.257949+0000","last_change":"2024-09-17T01:32:54.257949+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.257949+0000","last_undegraded":"2024-09-17T01:32:54.257949+0000","last_fullsized":"2024-09-17T01:32:54.257949+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.254014+0000","last_change":"2024-09-17T01:32:54.254014+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.254014+0000","last_undegraded":"2024-09-17T01:32:54.254014+0000","last_fullsized":"2024-09-17T01:32:54.254014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.280609+0000","last_change":"2024-09-17T01:32:55.278268+0000","last_active":"2024-09-17T01:32:55.280609+0000","last_peered":"2024-09-17T01:32:55.280609+0000","last_clean":"2024-09-17T01:32:55.280609+0000","last_became_active":"2024-09-17T01:32:55.277398+0000","last_became_peered":"2024-09-17T01:32:55.277398+0000","last_unstale":"2024-09-17T01:32:55.280609+0000","last_undegraded":"2024-09-17T01:32:55.280609+0000","last_fullsized":"2024-09-17T01:32:55.280609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:52.539549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.252588+0000","last_change":"2024-09-17T01:32:54.252588+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.252588+0000","last_undegraded":"2024-09-17T01:32:54.252588+0000","last_fullsized":"2024-09-17T01:32:54.252588+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.249991+0000","last_change":"2024-09-17T01:32:54.249991+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.249991+0000","last_undegraded":"2024-09-17T01:32:54.249991+0000","last_fullsized":"2024-09-17T01:32:54.249991+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.279607+0000","last_change":"2024-09-17T01:32:54.273748+0000","last_active":"2024-09-17T01:32:54.279607+0000","last_peered":"2024-09-17T01:32:54.279607+0000","last_clean":"2024-09-17T01:32:54.279607+0000","last_became_active":"2024-09-17T01:32:54.273437+0000","last_became_peered":"2024-09-17T01:32:54.273437+0000","last_unstale":"2024-09-17T01:32:54.279607+0000","last_undegraded":"2024-09-17T01:32:54.279607+0000","last_fullsized":"2024-09-17T01:32:54.279607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:37.611316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.281643+0000","last_change":"2024-09-17T01:32:55.276719+0000","last_active":"2024-09-17T01:32:55.281643+0000","last_peered":"2024-09-17T01:32:55.281643+0000","last_clean":"2024-09-17T01:32:55.281643+0000","last_became_active":"2024-09-17T01:32:55.276410+0000","last_became_peered":"2024-09-17T01:32:55.276410+0000","last_unstale":"2024-09-17T01:32:55.281643+0000","last_undegraded":"2024-09-17T01:32:55.281643+0000","last_fullsized":"2024-09-17T01:32:55.281643+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:21.702511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.275479+0000","last_change":"2024-09-17T01:32:54.270531+0000","last_active":"2024-09-17T01:32:54.275479+0000","last_peered":"2024-09-17T01:32:54.275479+0000","last_clean":"2024-09-17T01:32:54.275479+0000","last_became_active":"2024-09-17T01:32:54.270161+0000","last_became_peered":"2024-09-17T01:32:54.270161+0000","last_unstale":"2024-09-17T01:32:54.275479+0000","last_undegraded":"2024-09-17T01:32:54.275479+0000","last_fullsized":"2024-09-17T01:32:54.275479+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:20:05.534622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.286029+0000","last_change":"2024-09-17T01:32:55.283488+0000","last_active":"2024-09-17T01:32:55.286029+0000","last_peered":"2024-09-17T01:32:55.286029+0000","last_clean":"2024-09-17T01:32:55.286029+0000","last_became_active":"2024-09-17T01:32:55.283023+0000","last_became_peered":"2024-09-17T01:32:55.283023+0000","last_unstale":"2024-09-17T01:32:55.286029+0000","last_undegraded":"2024-09-17T01:32:55.286029+0000","last_fullsized":"2024-09-17T01:32:55.286029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:21:32.704860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.278383+0000","last_change":"2024-09-17T01:32:54.276942+0000","last_active":"2024-09-17T01:32:54.278383+0000","last_peered":"2024-09-17T01:32:54.278383+0000","last_clean":"2024-09-17T01:32:54.278383+0000","last_became_active":"2024-09-17T01:32:54.275355+0000","last_became_peered":"2024-09-17T01:32:54.275355+0000","last_unstale":"2024-09-17T01:32:54.278383+0000","last_undegraded":"2024-09-17T01:32:54.278383+0000","last_fullsized":"2024-09-17T01:32:54.278383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:07.743562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.251439+0000","last_change":"2024-09-17T01:32:54.251439+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.251439+0000","last_undegraded":"2024-09-17T01:32:54.251439+0000","last_fullsized":"2024-09-17T01:32:54.251439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.265738+0000","last_change":"2024-09-17T01:32:54.262112+0000","last_active":"2024-09-17T01:32:54.265738+0000","last_peered":"2024-09-17T01:32:54.265738+0000","last_clean":"2024-09-17T01:32:54.265738+0000","last_became_active":"2024-09-17T01:32:54.261706+0000","last_became_peered":"2024-09-17T01:32:54.261706+0000","last_unstale":"2024-09-17T01:32:54.265738+0000","last_undegraded":"2024-09-17T01:32:54.265738+0000","last_fullsized":"2024-09-17T01:32:54.265738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:24.840346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.249623+0000","last_change":"2024-09-17T01:32:54.249623+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.249623+0000","last_undegraded":"2024-09-17T01:32:54.249623+0000","last_fullsized":"2024-09-17T01:32:54.249623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.298037+0000","last_change":"2024-09-17T01:32:54.270450+0000","last_active":"2024-09-17T01:32:55.298037+0000","last_peered":"2024-09-17T01:32:55.298037+0000","last_clean":"2024-09-17T01:32:55.298037+0000","last_became_active":"2024-09-17T01:32:54.270127+0000","last_became_peered":"2024-09-17T01:32:54.270127+0000","last_unstale":"2024-09-17T01:32:55.298037+0000","last_undegraded":"2024-09-17T01:32:55.298037+0000","last_fullsized":"2024-09-17T01:32:55.298037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:37:22.998881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.280697+0000","last_change":"2024-09-17T01:32:55.279427+0000","last_active":"2024-09-17T01:32:55.280697+0000","last_peered":"2024-09-17T01:32:55.280697+0000","last_clean":"2024-09-17T01:32:55.280697+0000","last_became_active":"2024-09-17T01:32:55.278575+0000","last_became_peered":"2024-09-17T01:32:55.278575+0000","last_unstale":"2024-09-17T01:32:55.280697+0000","last_undegraded":"2024-09-17T01:32:55.280697+0000","last_fullsized":"2024-09-17T01:32:55.280697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:24.531548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.294322+0000","last_change":"2024-09-17T01:32:54.263865+0000","last_active":"2024-09-17T01:32:55.294322+0000","last_peered":"2024-09-17T01:32:55.294322+0000","last_clean":"2024-09-17T01:32:55.294322+0000","last_became_active":"2024-09-17T01:32:54.263543+0000","last_became_peered":"2024-09-17T01:32:54.263543+0000","last_unstale":"2024-09-17T01:32:55.294322+0000","last_undegraded":"2024-09-17T01:32:55.294322+0000","last_fullsized":"2024-09-17T01:32:55.294322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:08.574044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.250373+0000","last_change":"2024-09-17T01:32:54.250373+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.250373+0000","last_undegraded":"2024-09-17T01:32:54.250373+0000","last_fullsized":"2024-09-17T01:32:54.250373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.279010+0000","last_change":"2024-09-17T01:32:54.277476+0000","last_active":"2024-09-17T01:32:54.279010+0000","last_peered":"2024-09-17T01:32:54.279010+0000","last_clean":"2024-09-17T01:32:54.279010+0000","last_became_active":"2024-09-17T01:32:54.275552+0000","last_became_peered":"2024-09-17T01:32:54.275552+0000","last_unstale":"2024-09-17T01:32:54.279010+0000","last_undegraded":"2024-09-17T01:32:54.279010+0000","last_fullsized":"2024-09-17T01:32:54.279010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:03.098153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.251240+0000","last_change":"2024-09-17T01:32:54.251240+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.251240+0000","last_undegraded":"2024-09-17T01:32:54.251240+0000","last_fullsized":"2024-09-17T01:32:54.251240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.262075+0000","last_change":"2024-09-17T01:32:54.267969+0000","last_active":"2024-09-17T01:32:55.262075+0000","last_peered":"2024-09-17T01:32:55.262075+0000","last_clean":"2024-09-17T01:32:55.262075+0000","last_became_active":"2024-09-17T01:32:54.267655+0000","last_became_peered":"2024-09-17T01:32:54.267655+0000","last_unstale":"2024-09-17T01:32:55.262075+0000","last_undegraded":"2024-09-17T01:32:55.262075+0000","last_fullsized":"2024-09-17T01:32:55.262075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:52:13.804280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.259535+0000","last_change":"2024-09-17T01:32:54.259535+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.259535+0000","last_undegraded":"2024-09-17T01:32:54.259535+0000","last_fullsized":"2024-09-17T01:32:54.259535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269288+0000","last_change":"2024-09-17T01:32:54.265327+0000","last_active":"2024-09-17T01:32:56.269288+0000","last_peered":"2024-09-17T01:32:56.269288+0000","last_clean":"2024-09-17T01:32:56.269288+0000","last_became_active":"2024-09-17T01:32:54.265022+0000","last_became_peered":"2024-09-17T01:32:54.265022+0000","last_unstale":"2024-09-17T01:32:56.269288+0000","last_undegraded":"2024-09-17T01:32:56.269288+0000","last_fullsized":"2024-09-17T01:32:56.269288+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:36.740407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.254809+0000","last_change":"2024-09-17T01:32:54.254809+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.254809+0000","last_undegraded":"2024-09-17T01:32:54.254809+0000","last_fullsized":"2024-09-17T01:32:54.254809+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269099+0000","last_change":"2024-09-17T01:32:54.270692+0000","last_active":"2024-09-17T01:32:56.269099+0000","last_peered":"2024-09-17T01:32:56.269099+0000","last_clean":"2024-09-17T01:32:56.269099+0000","last_became_active":"2024-09-17T01:32:54.269836+0000","last_became_peered":"2024-09-17T01:32:54.269836+0000","last_unstale":"2024-09-17T01:32:56.269099+0000","last_undegraded":"2024-09-17T01:32:56.269099+0000","last_fullsized":"2024-09-17T01:32:56.269099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:01.191442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.253202+0000","last_change":"2024-09-17T01:32:54.253202+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.253202+0000","last_undegraded":"2024-09-17T01:32:54.253202+0000","last_fullsized":"2024-09-17T01:32:54.253202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.280158+0000","last_change":"2024-09-17T01:32:54.278326+0000","last_active":"2024-09-17T01:32:54.280158+0000","last_peered":"2024-09-17T01:32:54.280158+0000","last_clean":"2024-09-17T01:32:54.280158+0000","last_became_active":"2024-09-17T01:32:54.277421+0000","last_became_peered":"2024-09-17T01:32:54.277421+0000","last_unstale":"2024-09-17T01:32:54.280158+0000","last_undegraded":"2024-09-17T01:32:54.280158+0000","last_fullsized":"2024-09-17T01:32:54.280158+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:05.597471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.263361+0000","last_change":"2024-09-17T01:32:54.263361+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.263361+0000","last_undegraded":"2024-09-17T01:32:54.263361+0000","last_fullsized":"2024-09-17T01:32:54.263361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.269179+0000","last_change":"2024-09-17T01:32:54.263719+0000","last_active":"2024-09-17T01:32:54.269179+0000","last_peered":"2024-09-17T01:32:54.269179+0000","last_clean":"2024-09-17T01:32:54.269179+0000","last_became_active":"2024-09-17T01:32:54.263393+0000","last_became_peered":"2024-09-17T01:32:54.263393+0000","last_unstale":"2024-09-17T01:32:54.269179+0000","last_undegraded":"2024-09-17T01:32:54.269179+0000","last_fullsized":"2024-09-17T01:32:54.269179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:45.169483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.250545+0000","last_change":"2024-09-17T01:32:54.250545+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.250545+0000","last_undegraded":"2024-09-17T01:32:54.250545+0000","last_fullsized":"2024-09-17T01:32:54.250545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.298218+0000","last_change":"2024-09-17T01:32:54.281274+0000","last_active":"2024-09-17T01:32:55.298218+0000","last_peered":"2024-09-17T01:32:55.298218+0000","last_clean":"2024-09-17T01:32:55.298218+0000","last_became_active":"2024-09-17T01:32:54.276072+0000","last_became_peered":"2024-09-17T01:32:54.276072+0000","last_unstale":"2024-09-17T01:32:55.298218+0000","last_undegraded":"2024-09-17T01:32:55.298218+0000","last_fullsized":"2024-09-17T01:32:55.298218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:54.540207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.254166+0000","last_change":"2024-09-17T01:32:54.254166+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.254166+0000","last_undegraded":"2024-09-17T01:32:54.254166+0000","last_fullsized":"2024-09-17T01:32:54.254166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.278111+0000","last_change":"2024-09-17T01:32:54.276866+0000","last_active":"2024-09-17T01:32:54.278111+0000","last_peered":"2024-09-17T01:32:54.278111+0000","last_clean":"2024-09-17T01:32:54.278111+0000","last_became_active":"2024-09-17T01:32:54.275207+0000","last_became_peered":"2024-09-17T01:32:54.275207+0000","last_unstale":"2024-09-17T01:32:54.278111+0000","last_undegraded":"2024-09-17T01:32:54.278111+0000","last_fullsized":"2024-09-17T01:32:54.278111+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:41:14.479399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.277528+0000","last_change":"2024-09-17T01:32:55.274043+0000","last_active":"2024-09-17T01:32:55.277528+0000","last_peered":"2024-09-17T01:32:55.277528+0000","last_clean":"2024-09-17T01:32:55.277528+0000","last_became_active":"2024-09-17T01:32:55.273734+0000","last_became_peered":"2024-09-17T01:32:55.273734+0000","last_unstale":"2024-09-17T01:32:55.277528+0000","last_undegraded":"2024-09-17T01:32:55.277528+0000","last_fullsized":"2024-09-17T01:32:55.277528+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:04.553804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.275263+0000","last_change":"2024-09-17T01:32:54.271260+0000","last_active":"2024-09-17T01:32:54.275263+0000","last_peered":"2024-09-17T01:32:54.275263+0000","last_clean":"2024-09-17T01:32:54.275263+0000","last_became_active":"2024-09-17T01:32:54.270930+0000","last_became_peered":"2024-09-17T01:32:54.270930+0000","last_unstale":"2024-09-17T01:32:54.275263+0000","last_undegraded":"2024-09-17T01:32:54.275263+0000","last_fullsized":"2024-09-17T01:32:54.275263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:56.949109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.266778+0000","last_change":"2024-09-17T01:32:54.266778+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.266778+0000","last_undegraded":"2024-09-17T01:32:54.266778+0000","last_fullsized":"2024-09-17T01:32:54.266778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.278518+0000","last_change":"2024-09-17T01:32:54.277270+0000","last_active":"2024-09-17T01:32:54.278518+0000","last_peered":"2024-09-17T01:32:54.278518+0000","last_clean":"2024-09-17T01:32:54.278518+0000","last_became_active":"2024-09-17T01:32:54.276138+0000","last_became_peered":"2024-09-17T01:32:54.276138+0000","last_unstale":"2024-09-17T01:32:54.278518+0000","last_undegraded":"2024-09-17T01:32:54.278518+0000","last_fullsized":"2024-09-17T01:32:54.278518+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:50.745159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.259011+0000","last_change":"2024-09-17T01:32:54.259011+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.259011+0000","last_undegraded":"2024-09-17T01:32:54.259011+0000","last_fullsized":"2024-09-17T01:32:54.259011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.276924+0000","last_change":"2024-09-17T01:32:54.275279+0000","last_active":"2024-09-17T01:32:54.276924+0000","last_peered":"2024-09-17T01:32:54.276924+0000","last_clean":"2024-09-17T01:32:54.276924+0000","last_became_active":"2024-09-17T01:32:54.274814+0000","last_became_peered":"2024-09-17T01:32:54.274814+0000","last_unstale":"2024-09-17T01:32:54.276924+0000","last_undegraded":"2024-09-17T01:32:54.276924+0000","last_fullsized":"2024-09-17T01:32:54.276924+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:51.345722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.249634+0000","last_change":"2024-09-17T01:32:54.249634+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.249634+0000","last_undegraded":"2024-09-17T01:32:54.249634+0000","last_fullsized":"2024-09-17T01:32:54.249634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.296085+0000","last_change":"2024-09-17T01:32:54.277438+0000","last_active":"2024-09-17T01:32:55.296085+0000","last_peered":"2024-09-17T01:32:55.296085+0000","last_clean":"2024-09-17T01:32:55.296085+0000","last_became_active":"2024-09-17T01:32:54.277129+0000","last_became_peered":"2024-09-17T01:32:54.277129+0000","last_unstale":"2024-09-17T01:32:55.296085+0000","last_undegraded":"2024-09-17T01:32:55.296085+0000","last_fullsized":"2024-09-17T01:32:55.296085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:59.228808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269046+0000","last_change":"2024-09-17T01:32:55.259074+0000","last_active":"2024-09-17T01:32:56.269046+0000","last_peered":"2024-09-17T01:32:56.269046+0000","last_clean":"2024-09-17T01:32:56.269046+0000","last_became_active":"2024-09-17T01:32:55.258557+0000","last_became_peered":"2024-09-17T01:32:55.258557+0000","last_unstale":"2024-09-17T01:32:56.269046+0000","last_undegraded":"2024-09-17T01:32:56.269046+0000","last_fullsized":"2024-09-17T01:32:56.269046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:16.828516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.280072+0000","last_change":"2024-09-17T01:32:54.277977+0000","last_active":"2024-09-17T01:32:54.280072+0000","last_peered":"2024-09-17T01:32:54.280072+0000","last_clean":"2024-09-17T01:32:54.280072+0000","last_became_active":"2024-09-17T01:32:54.276470+0000","last_became_peered":"2024-09-17T01:32:54.276470+0000","last_unstale":"2024-09-17T01:32:54.280072+0000","last_undegraded":"2024-09-17T01:32:54.280072+0000","last_fullsized":"2024-09-17T01:32:54.280072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:39:50.371125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.258513+0000","last_change":"2024-09-17T01:32:54.258513+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.258513+0000","last_undegraded":"2024-09-17T01:32:54.258513+0000","last_fullsized":"2024-09-17T01:32:54.258513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.273042+0000","last_change":"2024-09-17T01:32:54.266920+0000","last_active":"2024-09-17T01:32:54.273042+0000","last_peered":"2024-09-17T01:32:54.273042+0000","last_clean":"2024-09-17T01:32:54.273042+0000","last_became_active":"2024-09-17T01:32:54.266582+0000","last_became_peered":"2024-09-17T01:32:54.266582+0000","last_unstale":"2024-09-17T01:32:54.273042+0000","last_undegraded":"2024-09-17T01:32:54.273042+0000","last_fullsized":"2024-09-17T01:32:54.273042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:34.037700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.249933+0000","last_change":"2024-09-17T01:32:54.249933+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.249933+0000","last_undegraded":"2024-09-17T01:32:54.249933+0000","last_fullsized":"2024-09-17T01:32:54.249933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269159+0000","last_change":"2024-09-17T01:32:54.264750+0000","last_active":"2024-09-17T01:32:56.269159+0000","last_peered":"2024-09-17T01:32:56.269159+0000","last_clean":"2024-09-17T01:32:56.269159+0000","last_became_active":"2024-09-17T01:32:54.262686+0000","last_became_peered":"2024-09-17T01:32:54.262686+0000","last_unstale":"2024-09-17T01:32:56.269159+0000","last_undegraded":"2024-09-17T01:32:56.269159+0000","last_fullsized":"2024-09-17T01:32:56.269159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:17:55.846732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269330+0000","last_change":"2024-09-17T01:32:55.266507+0000","last_active":"2024-09-17T01:32:56.269330+0000","last_peered":"2024-09-17T01:32:56.269330+0000","last_clean":"2024-09-17T01:32:56.269330+0000","last_became_active":"2024-09-17T01:32:55.266152+0000","last_became_peered":"2024-09-17T01:32:55.266152+0000","last_unstale":"2024-09-17T01:32:56.269330+0000","last_undegraded":"2024-09-17T01:32:56.269330+0000","last_fullsized":"2024-09-17T01:32:56.269330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:19.375873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.271233+0000","last_change":"2024-09-17T01:32:54.278174+0000","last_active":"2024-09-17T01:32:55.271233+0000","last_peered":"2024-09-17T01:32:55.271233+0000","last_clean":"2024-09-17T01:32:55.271233+0000","last_became_active":"2024-09-17T01:32:54.276004+0000","last_became_peered":"2024-09-17T01:32:54.276004+0000","last_unstale":"2024-09-17T01:32:55.271233+0000","last_undegraded":"2024-09-17T01:32:55.271233+0000","last_fullsized":"2024-09-17T01:32:55.271233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:13.711695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.248802+0000","last_change":"2024-09-17T01:32:54.248802+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.248802+0000","last_undegraded":"2024-09-17T01:32:54.248802+0000","last_fullsized":"2024-09-17T01:32:54.248802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.269078+0000","last_change":"2024-09-17T01:32:54.263007+0000","last_active":"2024-09-17T01:32:54.269078+0000","last_peered":"2024-09-17T01:32:54.269078+0000","last_clean":"2024-09-17T01:32:54.269078+0000","last_became_active":"2024-09-17T01:32:54.262642+0000","last_became_peered":"2024-09-17T01:32:54.262642+0000","last_unstale":"2024-09-17T01:32:54.269078+0000","last_undegraded":"2024-09-17T01:32:54.269078+0000","last_fullsized":"2024-09-17T01:32:54.269078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:58.487523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.250820+0000","last_change":"2024-09-17T01:32:54.250820+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.250820+0000","last_undegraded":"2024-09-17T01:32:54.250820+0000","last_fullsized":"2024-09-17T01:32:54.250820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.271099+0000","last_change":"2024-09-17T01:32:54.265991+0000","last_active":"2024-09-17T01:32:54.271099+0000","last_peered":"2024-09-17T01:32:54.271099+0000","last_clean":"2024-09-17T01:32:54.271099+0000","last_became_active":"2024-09-17T01:32:54.265640+0000","last_became_peered":"2024-09-17T01:32:54.265640+0000","last_unstale":"2024-09-17T01:32:54.271099+0000","last_undegraded":"2024-09-17T01:32:54.271099+0000","last_fullsized":"2024-09-17T01:32:54.271099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:34.217760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.257317+0000","last_change":"2024-09-17T01:32:54.257317+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.257317+0000","last_undegraded":"2024-09-17T01:32:54.257317+0000","last_fullsized":"2024-09-17T01:32:54.257317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.269101+0000","last_change":"2024-09-17T01:32:54.263467+0000","last_active":"2024-09-17T01:32:54.269101+0000","last_peered":"2024-09-17T01:32:54.269101+0000","last_clean":"2024-09-17T01:32:54.269101+0000","last_became_active":"2024-09-17T01:32:54.263098+0000","last_became_peered":"2024-09-17T01:32:54.263098+0000","last_unstale":"2024-09-17T01:32:54.269101+0000","last_undegraded":"2024-09-17T01:32:54.269101+0000","last_fullsized":"2024-09-17T01:32:54.269101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:02.074305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.263624+0000","last_change":"2024-09-17T01:32:54.263624+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.263624+0000","last_undegraded":"2024-09-17T01:32:54.263624+0000","last_fullsized":"2024-09-17T01:32:54.263624+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269306+0000","last_change":"2024-09-17T01:32:54.269945+0000","last_active":"2024-09-17T01:32:56.269306+0000","last_peered":"2024-09-17T01:32:56.269306+0000","last_clean":"2024-09-17T01:32:56.269306+0000","last_became_active":"2024-09-17T01:32:54.269614+0000","last_became_peered":"2024-09-17T01:32:54.269614+0000","last_unstale":"2024-09-17T01:32:56.269306+0000","last_undegraded":"2024-09-17T01:32:56.269306+0000","last_fullsized":"2024-09-17T01:32:56.269306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:39.597893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.253554+0000","last_change":"2024-09-17T01:32:54.253554+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.253554+0000","last_undegraded":"2024-09-17T01:32:54.253554+0000","last_fullsized":"2024-09-17T01:32:54.253554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.274839+0000","last_change":"2024-09-17T01:32:54.271877+0000","last_active":"2024-09-17T01:32:54.274839+0000","last_peered":"2024-09-17T01:32:54.274839+0000","last_clean":"2024-09-17T01:32:54.274839+0000","last_became_active":"2024-09-17T01:32:54.269407+0000","last_became_peered":"2024-09-17T01:32:54.269407+0000","last_unstale":"2024-09-17T01:32:54.274839+0000","last_undegraded":"2024-09-17T01:32:54.274839+0000","last_fullsized":"2024-09-17T01:32:54.274839+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:50.816324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.253424+0000","last_change":"2024-09-17T01:32:54.253424+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.253424+0000","last_undegraded":"2024-09-17T01:32:54.253424+0000","last_fullsized":"2024-09-17T01:32:54.253424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.269096+0000","last_change":"2024-09-17T01:32:54.266052+0000","last_active":"2024-09-17T01:32:54.269096+0000","last_peered":"2024-09-17T01:32:54.269096+0000","last_clean":"2024-09-17T01:32:54.269096+0000","last_became_active":"2024-09-17T01:32:54.265696+0000","last_became_peered":"2024-09-17T01:32:54.265696+0000","last_unstale":"2024-09-17T01:32:54.269096+0000","last_undegraded":"2024-09-17T01:32:54.269096+0000","last_fullsized":"2024-09-17T01:32:54.269096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:41.896366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.250666+0000","last_change":"2024-09-17T01:32:54.250666+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.250666+0000","last_undegraded":"2024-09-17T01:32:54.250666+0000","last_fullsized":"2024-09-17T01:32:54.250666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.275946+0000","last_change":"2024-09-17T01:32:54.274129+0000","last_active":"2024-09-17T01:32:54.275946+0000","last_peered":"2024-09-17T01:32:54.275946+0000","last_clean":"2024-09-17T01:32:54.275946+0000","last_became_active":"2024-09-17T01:32:54.273414+0000","last_became_peered":"2024-09-17T01:32:54.273414+0000","last_unstale":"2024-09-17T01:32:54.275946+0000","last_undegraded":"2024-09-17T01:32:54.275946+0000","last_fullsized":"2024-09-17T01:32:54.275946+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:38.022810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.256041+0000","last_change":"2024-09-17T01:32:54.256041+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.256041+0000","last_undegraded":"2024-09-17T01:32:54.256041+0000","last_fullsized":"2024-09-17T01:32:54.256041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.261748+0000","last_change":"2024-09-17T01:32:54.277748+0000","last_active":"2024-09-17T01:32:55.261748+0000","last_peered":"2024-09-17T01:32:55.261748+0000","last_clean":"2024-09-17T01:32:55.261748+0000","last_became_active":"2024-09-17T01:32:54.277399+0000","last_became_peered":"2024-09-17T01:32:54.277399+0000","last_unstale":"2024-09-17T01:32:55.261748+0000","last_undegraded":"2024-09-17T01:32:55.261748+0000","last_fullsized":"2024-09-17T01:32:55.261748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:24.670099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.265033+0000","last_change":"2024-09-17T01:32:54.265033+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.265033+0000","last_undegraded":"2024-09-17T01:32:54.265033+0000","last_fullsized":"2024-09-17T01:32:54.265033+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.276514+0000","last_change":"2024-09-17T01:32:54.271709+0000","last_active":"2024-09-17T01:32:54.276514+0000","last_peered":"2024-09-17T01:32:54.276514+0000","last_clean":"2024-09-17T01:32:54.276514+0000","last_became_active":"2024-09-17T01:32:54.271408+0000","last_became_peered":"2024-09-17T01:32:54.271408+0000","last_unstale":"2024-09-17T01:32:54.276514+0000","last_undegraded":"2024-09-17T01:32:54.276514+0000","last_fullsized":"2024-09-17T01:32:54.276514+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:44:59.775956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.254823+0000","last_change":"2024-09-17T01:32:54.254823+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.254823+0000","last_undegraded":"2024-09-17T01:32:54.254823+0000","last_fullsized":"2024-09-17T01:32:54.254823+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.280103+0000","last_change":"2024-09-17T01:32:54.278092+0000","last_active":"2024-09-17T01:32:54.280103+0000","last_peered":"2024-09-17T01:32:54.280103+0000","last_clean":"2024-09-17T01:32:54.280103+0000","last_became_active":"2024-09-17T01:32:54.276983+0000","last_became_peered":"2024-09-17T01:32:54.276983+0000","last_unstale":"2024-09-17T01:32:54.280103+0000","last_undegraded":"2024-09-17T01:32:54.280103+0000","last_fullsized":"2024-09-17T01:32:54.280103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:49.194868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.246766+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:32:54.246766+0000","last_peered":"2024-09-17T01:32:54.246766+0000","last_clean":"2024-09-17T01:32:54.246766+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:32:54.246766+0000","last_undegraded":"2024-09-17T01:32:54.246766+0000","last_fullsized":"2024-09-17T01:32:54.246766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476752,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":356352,"data_stored":133819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":339968,"data_stored":127010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":339968,"data_stored":127010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":327680,"data_stored":120735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":339968,"data_stored":127010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":921600,"data_stored":711103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":327680,"data_stored":120735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":962560,"data_stored":731035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:32:59.728 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:32:59.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.995+0000 7fa837800640 1 -- 172.21.15.42:0/3324964889 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa830072e00 msgr2=0x7fa83015bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:32:59.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.995+0000 7fa837800640 1 --2- 172.21.15.42:0/3324964889 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa830072e00 0x7fa83015bc50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa824009830 tx=0x7fa82402a530 comp rx=0 tx=0).stop 2024-09-17T01:32:59.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.995+0000 7fa837800640 1 -- 172.21.15.42:0/3324964889 shutdown_connections 2024-09-17T01:32:59.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.995+0000 7fa837800640 1 --2- 172.21.15.42:0/3324964889 >> v2:172.21.15.43:3300/0 conn(0x7fa83015f190 0x7fa83006fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:59.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.995+0000 7fa837800640 1 --2- 172.21.15.42:0/3324964889 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa830072e00 0x7fa83015bc50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:32:59.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.995+0000 7fa837800640 1 -- 172.21.15.42:0/3324964889 >> 172.21.15.42:0/3324964889 conn(0x7fa8300b2930 msgr2=0x7fa83006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:32:59.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.995+0000 7fa837800640 1 -- 172.21.15.42:0/3324964889 shutdown_connections 2024-09-17T01:32:59.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.995+0000 7fa837800640 1 -- 172.21.15.42:0/3324964889 wait complete. 2024-09-17T01:32:59.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.998+0000 7fa837800640 1 Processor -- start 2024-09-17T01:32:59.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.998+0000 7fa837800640 1 -- start start 2024-09-17T01:33:00.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.999+0000 7fa837800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa83006d430 0x7fa83014a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:00.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.999+0000 7fa837800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa830072e00 0x7fa83015d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:00.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.999+0000 7fa837800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa83015f190 0x7fa83015d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:00.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.999+0000 7fa837800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa830151520 con 0x7fa83006d430 2024-09-17T01:33:00.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.999+0000 7fa837800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa830070740 con 0x7fa830072e00 2024-09-17T01:33:00.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:32:59.999+0000 7fa837800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa8301516a0 con 0x7fa83015f190 2024-09-17T01:33:00.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.000+0000 7fa834e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa83006d430 0x7fa83014a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:00.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.000+0000 7fa834e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa83006d430 0x7fa83014a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48670/0 (socket says 172.21.15.42:48670) 2024-09-17T01:33:00.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.000+0000 7fa834e00640 1 -- 172.21.15.42:0/3568137245 learned_addr learned my addr 172.21.15.42:0/3568137245 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:33:00.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.000+0000 7fa82fe00640 1 --2- 172.21.15.42:0/3568137245 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa830072e00 0x7fa83015d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:00.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.000+0000 7fa835800640 1 --2- 172.21.15.42:0/3568137245 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa83015f190 0x7fa83015d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:00.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.000+0000 7fa834e00640 1 -- 172.21.15.42:0/3568137245 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa83015f190 msgr2=0x7fa83015d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:00.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.000+0000 7fa834e00640 1 --2- 172.21.15.42:0/3568137245 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa83015f190 0x7fa83015d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:00.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.000+0000 7fa834e00640 1 -- 172.21.15.42:0/3568137245 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa830072e00 msgr2=0x7fa83015d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:00.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.000+0000 7fa834e00640 1 --2- 172.21.15.42:0/3568137245 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa830072e00 0x7fa83015d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:00.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.000+0000 7fa834e00640 1 -- 172.21.15.42:0/3568137245 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83014a850 con 0x7fa83006d430 2024-09-17T01:33:00.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.001+0000 7fa834e00640 1 --2- 172.21.15.42:0/3568137245 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa83006d430 0x7fa83014a090 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa824009950 tx=0x7fa824033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:33:00.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.001+0000 7fa82cc00640 1 -- 172.21.15.42:0/3568137245 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa824005c90 con 0x7fa83006d430 2024-09-17T01:33:00.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.001+0000 7fa82cc00640 1 -- 172.21.15.42:0/3568137245 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa824031e50 con 0x7fa83006d430 2024-09-17T01:33:00.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.001+0000 7fa837800640 1 -- 172.21.15.42:0/3568137245 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa83015df50 con 0x7fa83006d430 2024-09-17T01:33:00.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.001+0000 7fa82cc00640 1 -- 172.21.15.42:0/3568137245 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa824033310 con 0x7fa83006d430 2024-09-17T01:33:00.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.001+0000 7fa837800640 1 -- 172.21.15.42:0/3568137245 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa830151cc0 con 0x7fa83006d430 2024-09-17T01:33:00.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.002+0000 7fa837800640 1 -- 172.21.15.42:0/3568137245 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa83015dd70 con 0x7fa83006d430 2024-09-17T01:33:00.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.003+0000 7fa82cc00640 1 -- 172.21.15.42:0/3568137245 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa8240334b0 con 0x7fa83006d430 2024-09-17T01:33:00.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.004+0000 7fa82cc00640 1 --2- 172.21.15.42:0/3568137245 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa810078bc0 0x7fa81007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:00.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.004+0000 7fa82cc00640 1 -- 172.21.15.42:0/3568137245 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fa8240bbe30 con 0x7fa83006d430 2024-09-17T01:33:00.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.005+0000 7fa82fe00640 1 --2- 172.21.15.42:0/3568137245 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa810078bc0 0x7fa81007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:00.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.006+0000 7fa82fe00640 1 --2- 172.21.15.42:0/3568137245 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa810078bc0 0x7fa81007b0d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa8301f8d90 tx=0x7fa81c005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:33:00.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.009+0000 7fa82cc00640 1 -- 172.21.15.42:0/3568137245 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa83015dd70 con 0x7fa83006d430 2024-09-17T01:33:00.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.199+0000 7fa837800640 1 -- 172.21.15.42:0/3568137245 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa83014ab30 con 0x7fa810078bc0 2024-09-17T01:33:00.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.204+0000 7fa82cc00640 1 -- 172.21.15.42:0/3568137245 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247976 (secure 0 0 0) 0x7fa83014ab30 con 0x7fa810078bc0 2024-09-17T01:33:00.205 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:33:00.206 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:33:00.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.208+0000 7fa837800640 1 -- 172.21.15.42:0/3568137245 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa810078bc0 msgr2=0x7fa81007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:00.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.208+0000 7fa837800640 1 --2- 172.21.15.42:0/3568137245 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa810078bc0 0x7fa81007b0d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa8301f8d90 tx=0x7fa81c005f90 comp rx=0 tx=0).stop 2024-09-17T01:33:00.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.208+0000 7fa837800640 1 -- 172.21.15.42:0/3568137245 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa83006d430 msgr2=0x7fa83014a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:00.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.208+0000 7fa837800640 1 --2- 172.21.15.42:0/3568137245 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa83006d430 0x7fa83014a090 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa824009950 tx=0x7fa824033c20 comp rx=0 tx=0).stop 2024-09-17T01:33:00.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.208+0000 7fa837800640 1 -- 172.21.15.42:0/3568137245 shutdown_connections 2024-09-17T01:33:00.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.208+0000 7fa837800640 1 --2- 172.21.15.42:0/3568137245 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa810078bc0 0x7fa81007b0d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:00.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.208+0000 7fa837800640 1 --2- 172.21.15.42:0/3568137245 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa830072e00 0x7fa83015d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:00.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.208+0000 7fa837800640 1 --2- 172.21.15.42:0/3568137245 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa83015f190 0x7fa83015d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:00.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.208+0000 7fa837800640 1 --2- 172.21.15.42:0/3568137245 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa83006d430 0x7fa83014a090 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:00.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.208+0000 7fa837800640 1 -- 172.21.15.42:0/3568137245 >> 172.21.15.42:0/3568137245 conn(0x7fa8300b2930 msgr2=0x7fa8300ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:33:00.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.208+0000 7fa837800640 1 -- 172.21.15.42:0/3568137245 shutdown_connections 2024-09-17T01:33:00.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.208+0000 7fa837800640 1 -- 172.21.15.42:0/3568137245 wait complete. 2024-09-17T01:33:00.231 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-09-17T01:32:58.988493+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":109,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":62,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253348,"kb_used_data":3824,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721372,"statfs":{"total":773094113280,"available":772834684928,"internally_reserved":0,"allocated":3915776,"data_stored":2198457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.752209"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.284914+0000","last_change":"2024-09-17T01:32:55.281409+0000","last_active":"2024-09-17T01:32:55.284914+0000","last_peered":"2024-09-17T01:32:55.284914+0000","last_clean":"2024-09-17T01:32:55.284914+0000","last_became_active":"2024-09-17T01:32:55.277989+0000","last_became_peered":"2024-09-17T01:32:55.277989+0000","last_unstale":"2024-09-17T01:32:55.284914+0000","last_undegraded":"2024-09-17T01:32:55.284914+0000","last_fullsized":"2024-09-17T01:32:55.284914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:37.868206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269483+0000","last_change":"2024-09-17T01:32:55.286374+0000","last_active":"2024-09-17T01:32:56.269483+0000","last_peered":"2024-09-17T01:32:56.269483+0000","last_clean":"2024-09-17T01:32:56.269483+0000","last_became_active":"2024-09-17T01:32:55.282079+0000","last_became_peered":"2024-09-17T01:32:55.282079+0000","last_unstale":"2024-09-17T01:32:56.269483+0000","last_undegraded":"2024-09-17T01:32:56.269483+0000","last_fullsized":"2024-09-17T01:32:56.269483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:37.917841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.251474+0000","last_change":"2024-09-17T01:32:54.251474+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.251474+0000","last_undegraded":"2024-09-17T01:32:54.251474+0000","last_fullsized":"2024-09-17T01:32:54.251474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.253930+0000","last_change":"2024-09-17T01:32:54.253930+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.253930+0000","last_undegraded":"2024-09-17T01:32:54.253930+0000","last_fullsized":"2024-09-17T01:32:54.253930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269043+0000","last_change":"2024-09-17T01:32:55.282329+0000","last_active":"2024-09-17T01:32:56.269043+0000","last_peered":"2024-09-17T01:32:56.269043+0000","last_clean":"2024-09-17T01:32:56.269043+0000","last_became_active":"2024-09-17T01:32:55.281587+0000","last_became_peered":"2024-09-17T01:32:55.281587+0000","last_unstale":"2024-09-17T01:32:56.269043+0000","last_undegraded":"2024-09-17T01:32:56.269043+0000","last_fullsized":"2024-09-17T01:32:56.269043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:38:26.720551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.253554+0000","last_change":"2024-09-17T01:32:54.253554+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.253554+0000","last_undegraded":"2024-09-17T01:32:54.253554+0000","last_fullsized":"2024-09-17T01:32:54.253554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.280637+0000","last_change":"2024-09-17T01:32:55.278314+0000","last_active":"2024-09-17T01:32:55.280637+0000","last_peered":"2024-09-17T01:32:55.280637+0000","last_clean":"2024-09-17T01:32:55.280637+0000","last_became_active":"2024-09-17T01:32:55.277821+0000","last_became_peered":"2024-09-17T01:32:55.277821+0000","last_unstale":"2024-09-17T01:32:55.280637+0000","last_undegraded":"2024-09-17T01:32:55.280637+0000","last_fullsized":"2024-09-17T01:32:55.280637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:34:51.193448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.290252+0000","last_change":"2024-09-17T01:32:55.284414+0000","last_active":"2024-09-17T01:32:55.290252+0000","last_peered":"2024-09-17T01:32:55.290252+0000","last_clean":"2024-09-17T01:32:55.290252+0000","last_became_active":"2024-09-17T01:32:55.284204+0000","last_became_peered":"2024-09-17T01:32:55.284204+0000","last_unstale":"2024-09-17T01:32:55.290252+0000","last_undegraded":"2024-09-17T01:32:55.290252+0000","last_fullsized":"2024-09-17T01:32:55.290252+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:24.066985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.251163+0000","last_change":"2024-09-17T01:32:54.251163+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.251163+0000","last_undegraded":"2024-09-17T01:32:54.251163+0000","last_fullsized":"2024-09-17T01:32:54.251163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.254676+0000","last_change":"2024-09-17T01:32:54.254676+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.254676+0000","last_undegraded":"2024-09-17T01:32:54.254676+0000","last_fullsized":"2024-09-17T01:32:54.254676+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.262516+0000","last_change":"2024-09-17T01:32:54.262516+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.262516+0000","last_undegraded":"2024-09-17T01:32:54.262516+0000","last_fullsized":"2024-09-17T01:32:54.262516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.249802+0000","last_change":"2024-09-17T01:32:54.249802+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.249802+0000","last_undegraded":"2024-09-17T01:32:54.249802+0000","last_fullsized":"2024-09-17T01:32:54.249802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.249501+0000","last_change":"2024-09-17T01:32:54.249501+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.249501+0000","last_undegraded":"2024-09-17T01:32:54.249501+0000","last_fullsized":"2024-09-17T01:32:54.249501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.251224+0000","last_change":"2024-09-17T01:32:54.251224+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.251224+0000","last_undegraded":"2024-09-17T01:32:54.251224+0000","last_fullsized":"2024-09-17T01:32:54.251224+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.262084+0000","last_change":"2024-09-17T01:32:54.262084+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.262084+0000","last_undegraded":"2024-09-17T01:32:54.262084+0000","last_fullsized":"2024-09-17T01:32:54.262084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.253217+0000","last_change":"2024-09-17T01:32:54.253217+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.253217+0000","last_undegraded":"2024-09-17T01:32:54.253217+0000","last_fullsized":"2024-09-17T01:32:54.253217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.264120+0000","last_change":"2024-09-17T01:32:54.264120+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.264120+0000","last_undegraded":"2024-09-17T01:32:54.264120+0000","last_fullsized":"2024-09-17T01:32:54.264120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.258634+0000","last_change":"2024-09-17T01:32:54.258634+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.258634+0000","last_undegraded":"2024-09-17T01:32:54.258634+0000","last_fullsized":"2024-09-17T01:32:54.258634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.259123+0000","last_change":"2024-09-17T01:32:54.259123+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.259123+0000","last_undegraded":"2024-09-17T01:32:54.259123+0000","last_fullsized":"2024-09-17T01:32:54.259123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.251851+0000","last_change":"2024-09-17T01:32:54.251851+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.251851+0000","last_undegraded":"2024-09-17T01:32:54.251851+0000","last_fullsized":"2024-09-17T01:32:54.251851+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.257412+0000","last_change":"2024-09-17T01:32:54.257412+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.257412+0000","last_undegraded":"2024-09-17T01:32:54.257412+0000","last_fullsized":"2024-09-17T01:32:54.257412+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.289838+0000","last_change":"2024-09-17T01:32:55.283222+0000","last_active":"2024-09-17T01:32:55.289838+0000","last_peered":"2024-09-17T01:32:55.289838+0000","last_clean":"2024-09-17T01:32:55.289838+0000","last_became_active":"2024-09-17T01:32:55.282841+0000","last_became_peered":"2024-09-17T01:32:55.282841+0000","last_unstale":"2024-09-17T01:32:55.289838+0000","last_undegraded":"2024-09-17T01:32:55.289838+0000","last_fullsized":"2024-09-17T01:32:55.289838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:39.561775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.248800+0000","last_change":"2024-09-17T01:32:54.248800+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.248800+0000","last_undegraded":"2024-09-17T01:32:54.248800+0000","last_fullsized":"2024-09-17T01:32:54.248800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.283936+0000","last_change":"2024-09-17T01:32:55.281293+0000","last_active":"2024-09-17T01:32:55.283936+0000","last_peered":"2024-09-17T01:32:55.283936+0000","last_clean":"2024-09-17T01:32:55.283936+0000","last_became_active":"2024-09-17T01:32:55.280932+0000","last_became_peered":"2024-09-17T01:32:55.280932+0000","last_unstale":"2024-09-17T01:32:55.283936+0000","last_undegraded":"2024-09-17T01:32:55.283936+0000","last_fullsized":"2024-09-17T01:32:55.283936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:41.379696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.257796+0000","last_change":"2024-09-17T01:32:54.257796+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.257796+0000","last_undegraded":"2024-09-17T01:32:54.257796+0000","last_fullsized":"2024-09-17T01:32:54.257796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.253346+0000","last_change":"2024-09-17T01:32:54.253346+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.253346+0000","last_undegraded":"2024-09-17T01:32:54.253346+0000","last_fullsized":"2024-09-17T01:32:54.253346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269159+0000","last_change":"2024-09-17T01:32:55.258825+0000","last_active":"2024-09-17T01:32:56.269159+0000","last_peered":"2024-09-17T01:32:56.269159+0000","last_clean":"2024-09-17T01:32:56.269159+0000","last_became_active":"2024-09-17T01:32:55.258420+0000","last_became_peered":"2024-09-17T01:32:55.258420+0000","last_unstale":"2024-09-17T01:32:56.269159+0000","last_undegraded":"2024-09-17T01:32:56.269159+0000","last_fullsized":"2024-09-17T01:32:56.269159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:07.739522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.281933+0000","last_change":"2024-09-17T01:32:55.279814+0000","last_active":"2024-09-17T01:32:55.281933+0000","last_peered":"2024-09-17T01:32:55.281933+0000","last_clean":"2024-09-17T01:32:55.281933+0000","last_became_active":"2024-09-17T01:32:55.278739+0000","last_became_peered":"2024-09-17T01:32:55.278739+0000","last_unstale":"2024-09-17T01:32:55.281933+0000","last_undegraded":"2024-09-17T01:32:55.281933+0000","last_fullsized":"2024-09-17T01:32:55.281933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:47.719271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.257949+0000","last_change":"2024-09-17T01:32:54.257949+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.257949+0000","last_undegraded":"2024-09-17T01:32:54.257949+0000","last_fullsized":"2024-09-17T01:32:54.257949+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.254014+0000","last_change":"2024-09-17T01:32:54.254014+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.254014+0000","last_undegraded":"2024-09-17T01:32:54.254014+0000","last_fullsized":"2024-09-17T01:32:54.254014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.280609+0000","last_change":"2024-09-17T01:32:55.278268+0000","last_active":"2024-09-17T01:32:55.280609+0000","last_peered":"2024-09-17T01:32:55.280609+0000","last_clean":"2024-09-17T01:32:55.280609+0000","last_became_active":"2024-09-17T01:32:55.277398+0000","last_became_peered":"2024-09-17T01:32:55.277398+0000","last_unstale":"2024-09-17T01:32:55.280609+0000","last_undegraded":"2024-09-17T01:32:55.280609+0000","last_fullsized":"2024-09-17T01:32:55.280609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:52.539549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.252588+0000","last_change":"2024-09-17T01:32:54.252588+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.252588+0000","last_undegraded":"2024-09-17T01:32:54.252588+0000","last_fullsized":"2024-09-17T01:32:54.252588+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.249991+0000","last_change":"2024-09-17T01:32:54.249991+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.249991+0000","last_undegraded":"2024-09-17T01:32:54.249991+0000","last_fullsized":"2024-09-17T01:32:54.249991+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.279607+0000","last_change":"2024-09-17T01:32:54.273748+0000","last_active":"2024-09-17T01:32:54.279607+0000","last_peered":"2024-09-17T01:32:54.279607+0000","last_clean":"2024-09-17T01:32:54.279607+0000","last_became_active":"2024-09-17T01:32:54.273437+0000","last_became_peered":"2024-09-17T01:32:54.273437+0000","last_unstale":"2024-09-17T01:32:54.279607+0000","last_undegraded":"2024-09-17T01:32:54.279607+0000","last_fullsized":"2024-09-17T01:32:54.279607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:37.611316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.281643+0000","last_change":"2024-09-17T01:32:55.276719+0000","last_active":"2024-09-17T01:32:55.281643+0000","last_peered":"2024-09-17T01:32:55.281643+0000","last_clean":"2024-09-17T01:32:55.281643+0000","last_became_active":"2024-09-17T01:32:55.276410+0000","last_became_peered":"2024-09-17T01:32:55.276410+0000","last_unstale":"2024-09-17T01:32:55.281643+0000","last_undegraded":"2024-09-17T01:32:55.281643+0000","last_fullsized":"2024-09-17T01:32:55.281643+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:21.702511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.275479+0000","last_change":"2024-09-17T01:32:54.270531+0000","last_active":"2024-09-17T01:32:54.275479+0000","last_peered":"2024-09-17T01:32:54.275479+0000","last_clean":"2024-09-17T01:32:54.275479+0000","last_became_active":"2024-09-17T01:32:54.270161+0000","last_became_peered":"2024-09-17T01:32:54.270161+0000","last_unstale":"2024-09-17T01:32:54.275479+0000","last_undegraded":"2024-09-17T01:32:54.275479+0000","last_fullsized":"2024-09-17T01:32:54.275479+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:20:05.534622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.286029+0000","last_change":"2024-09-17T01:32:55.283488+0000","last_active":"2024-09-17T01:32:55.286029+0000","last_peered":"2024-09-17T01:32:55.286029+0000","last_clean":"2024-09-17T01:32:55.286029+0000","last_became_active":"2024-09-17T01:32:55.283023+0000","last_became_peered":"2024-09-17T01:32:55.283023+0000","last_unstale":"2024-09-17T01:32:55.286029+0000","last_undegraded":"2024-09-17T01:32:55.286029+0000","last_fullsized":"2024-09-17T01:32:55.286029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:21:32.704860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.278383+0000","last_change":"2024-09-17T01:32:54.276942+0000","last_active":"2024-09-17T01:32:54.278383+0000","last_peered":"2024-09-17T01:32:54.278383+0000","last_clean":"2024-09-17T01:32:54.278383+0000","last_became_active":"2024-09-17T01:32:54.275355+0000","last_became_peered":"2024-09-17T01:32:54.275355+0000","last_unstale":"2024-09-17T01:32:54.278383+0000","last_undegraded":"2024-09-17T01:32:54.278383+0000","last_fullsized":"2024-09-17T01:32:54.278383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:07.743562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.251439+0000","last_change":"2024-09-17T01:32:54.251439+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.251439+0000","last_undegraded":"2024-09-17T01:32:54.251439+0000","last_fullsized":"2024-09-17T01:32:54.251439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.265738+0000","last_change":"2024-09-17T01:32:54.262112+0000","last_active":"2024-09-17T01:32:54.265738+0000","last_peered":"2024-09-17T01:32:54.265738+0000","last_clean":"2024-09-17T01:32:54.265738+0000","last_became_active":"2024-09-17T01:32:54.261706+0000","last_became_peered":"2024-09-17T01:32:54.261706+0000","last_unstale":"2024-09-17T01:32:54.265738+0000","last_undegraded":"2024-09-17T01:32:54.265738+0000","last_fullsized":"2024-09-17T01:32:54.265738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:24.840346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.249623+0000","last_change":"2024-09-17T01:32:54.249623+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.249623+0000","last_undegraded":"2024-09-17T01:32:54.249623+0000","last_fullsized":"2024-09-17T01:32:54.249623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.298037+0000","last_change":"2024-09-17T01:32:54.270450+0000","last_active":"2024-09-17T01:32:55.298037+0000","last_peered":"2024-09-17T01:32:55.298037+0000","last_clean":"2024-09-17T01:32:55.298037+0000","last_became_active":"2024-09-17T01:32:54.270127+0000","last_became_peered":"2024-09-17T01:32:54.270127+0000","last_unstale":"2024-09-17T01:32:55.298037+0000","last_undegraded":"2024-09-17T01:32:55.298037+0000","last_fullsized":"2024-09-17T01:32:55.298037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:37:22.998881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.280697+0000","last_change":"2024-09-17T01:32:55.279427+0000","last_active":"2024-09-17T01:32:55.280697+0000","last_peered":"2024-09-17T01:32:55.280697+0000","last_clean":"2024-09-17T01:32:55.280697+0000","last_became_active":"2024-09-17T01:32:55.278575+0000","last_became_peered":"2024-09-17T01:32:55.278575+0000","last_unstale":"2024-09-17T01:32:55.280697+0000","last_undegraded":"2024-09-17T01:32:55.280697+0000","last_fullsized":"2024-09-17T01:32:55.280697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:24.531548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.294322+0000","last_change":"2024-09-17T01:32:54.263865+0000","last_active":"2024-09-17T01:32:55.294322+0000","last_peered":"2024-09-17T01:32:55.294322+0000","last_clean":"2024-09-17T01:32:55.294322+0000","last_became_active":"2024-09-17T01:32:54.263543+0000","last_became_peered":"2024-09-17T01:32:54.263543+0000","last_unstale":"2024-09-17T01:32:55.294322+0000","last_undegraded":"2024-09-17T01:32:55.294322+0000","last_fullsized":"2024-09-17T01:32:55.294322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:08.574044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.250373+0000","last_change":"2024-09-17T01:32:54.250373+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.250373+0000","last_undegraded":"2024-09-17T01:32:54.250373+0000","last_fullsized":"2024-09-17T01:32:54.250373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.279010+0000","last_change":"2024-09-17T01:32:54.277476+0000","last_active":"2024-09-17T01:32:54.279010+0000","last_peered":"2024-09-17T01:32:54.279010+0000","last_clean":"2024-09-17T01:32:54.279010+0000","last_became_active":"2024-09-17T01:32:54.275552+0000","last_became_peered":"2024-09-17T01:32:54.275552+0000","last_unstale":"2024-09-17T01:32:54.279010+0000","last_undegraded":"2024-09-17T01:32:54.279010+0000","last_fullsized":"2024-09-17T01:32:54.279010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:03.098153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.251240+0000","last_change":"2024-09-17T01:32:54.251240+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.251240+0000","last_undegraded":"2024-09-17T01:32:54.251240+0000","last_fullsized":"2024-09-17T01:32:54.251240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.262075+0000","last_change":"2024-09-17T01:32:54.267969+0000","last_active":"2024-09-17T01:32:55.262075+0000","last_peered":"2024-09-17T01:32:55.262075+0000","last_clean":"2024-09-17T01:32:55.262075+0000","last_became_active":"2024-09-17T01:32:54.267655+0000","last_became_peered":"2024-09-17T01:32:54.267655+0000","last_unstale":"2024-09-17T01:32:55.262075+0000","last_undegraded":"2024-09-17T01:32:55.262075+0000","last_fullsized":"2024-09-17T01:32:55.262075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:52:13.804280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.259535+0000","last_change":"2024-09-17T01:32:54.259535+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.259535+0000","last_undegraded":"2024-09-17T01:32:54.259535+0000","last_fullsized":"2024-09-17T01:32:54.259535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269288+0000","last_change":"2024-09-17T01:32:54.265327+0000","last_active":"2024-09-17T01:32:56.269288+0000","last_peered":"2024-09-17T01:32:56.269288+0000","last_clean":"2024-09-17T01:32:56.269288+0000","last_became_active":"2024-09-17T01:32:54.265022+0000","last_became_peered":"2024-09-17T01:32:54.265022+0000","last_unstale":"2024-09-17T01:32:56.269288+0000","last_undegraded":"2024-09-17T01:32:56.269288+0000","last_fullsized":"2024-09-17T01:32:56.269288+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:36.740407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.254809+0000","last_change":"2024-09-17T01:32:54.254809+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.254809+0000","last_undegraded":"2024-09-17T01:32:54.254809+0000","last_fullsized":"2024-09-17T01:32:54.254809+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269099+0000","last_change":"2024-09-17T01:32:54.270692+0000","last_active":"2024-09-17T01:32:56.269099+0000","last_peered":"2024-09-17T01:32:56.269099+0000","last_clean":"2024-09-17T01:32:56.269099+0000","last_became_active":"2024-09-17T01:32:54.269836+0000","last_became_peered":"2024-09-17T01:32:54.269836+0000","last_unstale":"2024-09-17T01:32:56.269099+0000","last_undegraded":"2024-09-17T01:32:56.269099+0000","last_fullsized":"2024-09-17T01:32:56.269099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:01.191442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.253202+0000","last_change":"2024-09-17T01:32:54.253202+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.253202+0000","last_undegraded":"2024-09-17T01:32:54.253202+0000","last_fullsized":"2024-09-17T01:32:54.253202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.280158+0000","last_change":"2024-09-17T01:32:54.278326+0000","last_active":"2024-09-17T01:32:54.280158+0000","last_peered":"2024-09-17T01:32:54.280158+0000","last_clean":"2024-09-17T01:32:54.280158+0000","last_became_active":"2024-09-17T01:32:54.277421+0000","last_became_peered":"2024-09-17T01:32:54.277421+0000","last_unstale":"2024-09-17T01:32:54.280158+0000","last_undegraded":"2024-09-17T01:32:54.280158+0000","last_fullsized":"2024-09-17T01:32:54.280158+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:05.597471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.263361+0000","last_change":"2024-09-17T01:32:54.263361+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.263361+0000","last_undegraded":"2024-09-17T01:32:54.263361+0000","last_fullsized":"2024-09-17T01:32:54.263361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.269179+0000","last_change":"2024-09-17T01:32:54.263719+0000","last_active":"2024-09-17T01:32:54.269179+0000","last_peered":"2024-09-17T01:32:54.269179+0000","last_clean":"2024-09-17T01:32:54.269179+0000","last_became_active":"2024-09-17T01:32:54.263393+0000","last_became_peered":"2024-09-17T01:32:54.263393+0000","last_unstale":"2024-09-17T01:32:54.269179+0000","last_undegraded":"2024-09-17T01:32:54.269179+0000","last_fullsized":"2024-09-17T01:32:54.269179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:45.169483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.250545+0000","last_change":"2024-09-17T01:32:54.250545+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.250545+0000","last_undegraded":"2024-09-17T01:32:54.250545+0000","last_fullsized":"2024-09-17T01:32:54.250545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.298218+0000","last_change":"2024-09-17T01:32:54.281274+0000","last_active":"2024-09-17T01:32:55.298218+0000","last_peered":"2024-09-17T01:32:55.298218+0000","last_clean":"2024-09-17T01:32:55.298218+0000","last_became_active":"2024-09-17T01:32:54.276072+0000","last_became_peered":"2024-09-17T01:32:54.276072+0000","last_unstale":"2024-09-17T01:32:55.298218+0000","last_undegraded":"2024-09-17T01:32:55.298218+0000","last_fullsized":"2024-09-17T01:32:55.298218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:54.540207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.254166+0000","last_change":"2024-09-17T01:32:54.254166+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.254166+0000","last_undegraded":"2024-09-17T01:32:54.254166+0000","last_fullsized":"2024-09-17T01:32:54.254166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.278111+0000","last_change":"2024-09-17T01:32:54.276866+0000","last_active":"2024-09-17T01:32:54.278111+0000","last_peered":"2024-09-17T01:32:54.278111+0000","last_clean":"2024-09-17T01:32:54.278111+0000","last_became_active":"2024-09-17T01:32:54.275207+0000","last_became_peered":"2024-09-17T01:32:54.275207+0000","last_unstale":"2024-09-17T01:32:54.278111+0000","last_undegraded":"2024-09-17T01:32:54.278111+0000","last_fullsized":"2024-09-17T01:32:54.278111+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:41:14.479399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.277528+0000","last_change":"2024-09-17T01:32:55.274043+0000","last_active":"2024-09-17T01:32:55.277528+0000","last_peered":"2024-09-17T01:32:55.277528+0000","last_clean":"2024-09-17T01:32:55.277528+0000","last_became_active":"2024-09-17T01:32:55.273734+0000","last_became_peered":"2024-09-17T01:32:55.273734+0000","last_unstale":"2024-09-17T01:32:55.277528+0000","last_undegraded":"2024-09-17T01:32:55.277528+0000","last_fullsized":"2024-09-17T01:32:55.277528+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:04.553804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.275263+0000","last_change":"2024-09-17T01:32:54.271260+0000","last_active":"2024-09-17T01:32:54.275263+0000","last_peered":"2024-09-17T01:32:54.275263+0000","last_clean":"2024-09-17T01:32:54.275263+0000","last_became_active":"2024-09-17T01:32:54.270930+0000","last_became_peered":"2024-09-17T01:32:54.270930+0000","last_unstale":"2024-09-17T01:32:54.275263+0000","last_undegraded":"2024-09-17T01:32:54.275263+0000","last_fullsized":"2024-09-17T01:32:54.275263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:56.949109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.266778+0000","last_change":"2024-09-17T01:32:54.266778+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.266778+0000","last_undegraded":"2024-09-17T01:32:54.266778+0000","last_fullsized":"2024-09-17T01:32:54.266778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.278518+0000","last_change":"2024-09-17T01:32:54.277270+0000","last_active":"2024-09-17T01:32:54.278518+0000","last_peered":"2024-09-17T01:32:54.278518+0000","last_clean":"2024-09-17T01:32:54.278518+0000","last_became_active":"2024-09-17T01:32:54.276138+0000","last_became_peered":"2024-09-17T01:32:54.276138+0000","last_unstale":"2024-09-17T01:32:54.278518+0000","last_undegraded":"2024-09-17T01:32:54.278518+0000","last_fullsized":"2024-09-17T01:32:54.278518+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:50.745159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.259011+0000","last_change":"2024-09-17T01:32:54.259011+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.259011+0000","last_undegraded":"2024-09-17T01:32:54.259011+0000","last_fullsized":"2024-09-17T01:32:54.259011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.276924+0000","last_change":"2024-09-17T01:32:54.275279+0000","last_active":"2024-09-17T01:32:54.276924+0000","last_peered":"2024-09-17T01:32:54.276924+0000","last_clean":"2024-09-17T01:32:54.276924+0000","last_became_active":"2024-09-17T01:32:54.274814+0000","last_became_peered":"2024-09-17T01:32:54.274814+0000","last_unstale":"2024-09-17T01:32:54.276924+0000","last_undegraded":"2024-09-17T01:32:54.276924+0000","last_fullsized":"2024-09-17T01:32:54.276924+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:51.345722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.249634+0000","last_change":"2024-09-17T01:32:54.249634+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.249634+0000","last_undegraded":"2024-09-17T01:32:54.249634+0000","last_fullsized":"2024-09-17T01:32:54.249634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.296085+0000","last_change":"2024-09-17T01:32:54.277438+0000","last_active":"2024-09-17T01:32:55.296085+0000","last_peered":"2024-09-17T01:32:55.296085+0000","last_clean":"2024-09-17T01:32:55.296085+0000","last_became_active":"2024-09-17T01:32:54.277129+0000","last_became_peered":"2024-09-17T01:32:54.277129+0000","last_unstale":"2024-09-17T01:32:55.296085+0000","last_undegraded":"2024-09-17T01:32:55.296085+0000","last_fullsized":"2024-09-17T01:32:55.296085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:59.228808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269046+0000","last_change":"2024-09-17T01:32:55.259074+0000","last_active":"2024-09-17T01:32:56.269046+0000","last_peered":"2024-09-17T01:32:56.269046+0000","last_clean":"2024-09-17T01:32:56.269046+0000","last_became_active":"2024-09-17T01:32:55.258557+0000","last_became_peered":"2024-09-17T01:32:55.258557+0000","last_unstale":"2024-09-17T01:32:56.269046+0000","last_undegraded":"2024-09-17T01:32:56.269046+0000","last_fullsized":"2024-09-17T01:32:56.269046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:16.828516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.280072+0000","last_change":"2024-09-17T01:32:54.277977+0000","last_active":"2024-09-17T01:32:54.280072+0000","last_peered":"2024-09-17T01:32:54.280072+0000","last_clean":"2024-09-17T01:32:54.280072+0000","last_became_active":"2024-09-17T01:32:54.276470+0000","last_became_peered":"2024-09-17T01:32:54.276470+0000","last_unstale":"2024-09-17T01:32:54.280072+0000","last_undegraded":"2024-09-17T01:32:54.280072+0000","last_fullsized":"2024-09-17T01:32:54.280072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:39:50.371125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.258513+0000","last_change":"2024-09-17T01:32:54.258513+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.258513+0000","last_undegraded":"2024-09-17T01:32:54.258513+0000","last_fullsized":"2024-09-17T01:32:54.258513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.273042+0000","last_change":"2024-09-17T01:32:54.266920+0000","last_active":"2024-09-17T01:32:54.273042+0000","last_peered":"2024-09-17T01:32:54.273042+0000","last_clean":"2024-09-17T01:32:54.273042+0000","last_became_active":"2024-09-17T01:32:54.266582+0000","last_became_peered":"2024-09-17T01:32:54.266582+0000","last_unstale":"2024-09-17T01:32:54.273042+0000","last_undegraded":"2024-09-17T01:32:54.273042+0000","last_fullsized":"2024-09-17T01:32:54.273042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:34.037700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.249933+0000","last_change":"2024-09-17T01:32:54.249933+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.249933+0000","last_undegraded":"2024-09-17T01:32:54.249933+0000","last_fullsized":"2024-09-17T01:32:54.249933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269159+0000","last_change":"2024-09-17T01:32:54.264750+0000","last_active":"2024-09-17T01:32:56.269159+0000","last_peered":"2024-09-17T01:32:56.269159+0000","last_clean":"2024-09-17T01:32:56.269159+0000","last_became_active":"2024-09-17T01:32:54.262686+0000","last_became_peered":"2024-09-17T01:32:54.262686+0000","last_unstale":"2024-09-17T01:32:56.269159+0000","last_undegraded":"2024-09-17T01:32:56.269159+0000","last_fullsized":"2024-09-17T01:32:56.269159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:17:55.846732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269330+0000","last_change":"2024-09-17T01:32:55.266507+0000","last_active":"2024-09-17T01:32:56.269330+0000","last_peered":"2024-09-17T01:32:56.269330+0000","last_clean":"2024-09-17T01:32:56.269330+0000","last_became_active":"2024-09-17T01:32:55.266152+0000","last_became_peered":"2024-09-17T01:32:55.266152+0000","last_unstale":"2024-09-17T01:32:56.269330+0000","last_undegraded":"2024-09-17T01:32:56.269330+0000","last_fullsized":"2024-09-17T01:32:56.269330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:19.375873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.271233+0000","last_change":"2024-09-17T01:32:54.278174+0000","last_active":"2024-09-17T01:32:55.271233+0000","last_peered":"2024-09-17T01:32:55.271233+0000","last_clean":"2024-09-17T01:32:55.271233+0000","last_became_active":"2024-09-17T01:32:54.276004+0000","last_became_peered":"2024-09-17T01:32:54.276004+0000","last_unstale":"2024-09-17T01:32:55.271233+0000","last_undegraded":"2024-09-17T01:32:55.271233+0000","last_fullsized":"2024-09-17T01:32:55.271233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:13.711695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.248802+0000","last_change":"2024-09-17T01:32:54.248802+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.248802+0000","last_undegraded":"2024-09-17T01:32:54.248802+0000","last_fullsized":"2024-09-17T01:32:54.248802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.269078+0000","last_change":"2024-09-17T01:32:54.263007+0000","last_active":"2024-09-17T01:32:54.269078+0000","last_peered":"2024-09-17T01:32:54.269078+0000","last_clean":"2024-09-17T01:32:54.269078+0000","last_became_active":"2024-09-17T01:32:54.262642+0000","last_became_peered":"2024-09-17T01:32:54.262642+0000","last_unstale":"2024-09-17T01:32:54.269078+0000","last_undegraded":"2024-09-17T01:32:54.269078+0000","last_fullsized":"2024-09-17T01:32:54.269078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:58.487523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.250820+0000","last_change":"2024-09-17T01:32:54.250820+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.250820+0000","last_undegraded":"2024-09-17T01:32:54.250820+0000","last_fullsized":"2024-09-17T01:32:54.250820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.271099+0000","last_change":"2024-09-17T01:32:54.265991+0000","last_active":"2024-09-17T01:32:54.271099+0000","last_peered":"2024-09-17T01:32:54.271099+0000","last_clean":"2024-09-17T01:32:54.271099+0000","last_became_active":"2024-09-17T01:32:54.265640+0000","last_became_peered":"2024-09-17T01:32:54.265640+0000","last_unstale":"2024-09-17T01:32:54.271099+0000","last_undegraded":"2024-09-17T01:32:54.271099+0000","last_fullsized":"2024-09-17T01:32:54.271099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:34.217760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.257317+0000","last_change":"2024-09-17T01:32:54.257317+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.257317+0000","last_undegraded":"2024-09-17T01:32:54.257317+0000","last_fullsized":"2024-09-17T01:32:54.257317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.269101+0000","last_change":"2024-09-17T01:32:54.263467+0000","last_active":"2024-09-17T01:32:54.269101+0000","last_peered":"2024-09-17T01:32:54.269101+0000","last_clean":"2024-09-17T01:32:54.269101+0000","last_became_active":"2024-09-17T01:32:54.263098+0000","last_became_peered":"2024-09-17T01:32:54.263098+0000","last_unstale":"2024-09-17T01:32:54.269101+0000","last_undegraded":"2024-09-17T01:32:54.269101+0000","last_fullsized":"2024-09-17T01:32:54.269101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:02.074305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.263624+0000","last_change":"2024-09-17T01:32:54.263624+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.263624+0000","last_undegraded":"2024-09-17T01:32:54.263624+0000","last_fullsized":"2024-09-17T01:32:54.263624+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269306+0000","last_change":"2024-09-17T01:32:54.269945+0000","last_active":"2024-09-17T01:32:56.269306+0000","last_peered":"2024-09-17T01:32:56.269306+0000","last_clean":"2024-09-17T01:32:56.269306+0000","last_became_active":"2024-09-17T01:32:54.269614+0000","last_became_peered":"2024-09-17T01:32:54.269614+0000","last_unstale":"2024-09-17T01:32:56.269306+0000","last_undegraded":"2024-09-17T01:32:56.269306+0000","last_fullsized":"2024-09-17T01:32:56.269306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:39.597893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.253554+0000","last_change":"2024-09-17T01:32:54.253554+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.253554+0000","last_undegraded":"2024-09-17T01:32:54.253554+0000","last_fullsized":"2024-09-17T01:32:54.253554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.274839+0000","last_change":"2024-09-17T01:32:54.271877+0000","last_active":"2024-09-17T01:32:54.274839+0000","last_peered":"2024-09-17T01:32:54.274839+0000","last_clean":"2024-09-17T01:32:54.274839+0000","last_became_active":"2024-09-17T01:32:54.269407+0000","last_became_peered":"2024-09-17T01:32:54.269407+0000","last_unstale":"2024-09-17T01:32:54.274839+0000","last_undegraded":"2024-09-17T01:32:54.274839+0000","last_fullsized":"2024-09-17T01:32:54.274839+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:50.816324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.253424+0000","last_change":"2024-09-17T01:32:54.253424+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.253424+0000","last_undegraded":"2024-09-17T01:32:54.253424+0000","last_fullsized":"2024-09-17T01:32:54.253424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.269096+0000","last_change":"2024-09-17T01:32:54.266052+0000","last_active":"2024-09-17T01:32:54.269096+0000","last_peered":"2024-09-17T01:32:54.269096+0000","last_clean":"2024-09-17T01:32:54.269096+0000","last_became_active":"2024-09-17T01:32:54.265696+0000","last_became_peered":"2024-09-17T01:32:54.265696+0000","last_unstale":"2024-09-17T01:32:54.269096+0000","last_undegraded":"2024-09-17T01:32:54.269096+0000","last_fullsized":"2024-09-17T01:32:54.269096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:41.896366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.250666+0000","last_change":"2024-09-17T01:32:54.250666+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.250666+0000","last_undegraded":"2024-09-17T01:32:54.250666+0000","last_fullsized":"2024-09-17T01:32:54.250666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.275946+0000","last_change":"2024-09-17T01:32:54.274129+0000","last_active":"2024-09-17T01:32:54.275946+0000","last_peered":"2024-09-17T01:32:54.275946+0000","last_clean":"2024-09-17T01:32:54.275946+0000","last_became_active":"2024-09-17T01:32:54.273414+0000","last_became_peered":"2024-09-17T01:32:54.273414+0000","last_unstale":"2024-09-17T01:32:54.275946+0000","last_undegraded":"2024-09-17T01:32:54.275946+0000","last_fullsized":"2024-09-17T01:32:54.275946+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:38.022810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.256041+0000","last_change":"2024-09-17T01:32:54.256041+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.256041+0000","last_undegraded":"2024-09-17T01:32:54.256041+0000","last_fullsized":"2024-09-17T01:32:54.256041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.261748+0000","last_change":"2024-09-17T01:32:54.277748+0000","last_active":"2024-09-17T01:32:55.261748+0000","last_peered":"2024-09-17T01:32:55.261748+0000","last_clean":"2024-09-17T01:32:55.261748+0000","last_became_active":"2024-09-17T01:32:54.277399+0000","last_became_peered":"2024-09-17T01:32:54.277399+0000","last_unstale":"2024-09-17T01:32:55.261748+0000","last_undegraded":"2024-09-17T01:32:55.261748+0000","last_fullsized":"2024-09-17T01:32:55.261748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:24.670099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.265033+0000","last_change":"2024-09-17T01:32:54.265033+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.265033+0000","last_undegraded":"2024-09-17T01:32:54.265033+0000","last_fullsized":"2024-09-17T01:32:54.265033+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.276514+0000","last_change":"2024-09-17T01:32:54.271709+0000","last_active":"2024-09-17T01:32:54.276514+0000","last_peered":"2024-09-17T01:32:54.276514+0000","last_clean":"2024-09-17T01:32:54.276514+0000","last_became_active":"2024-09-17T01:32:54.271408+0000","last_became_peered":"2024-09-17T01:32:54.271408+0000","last_unstale":"2024-09-17T01:32:54.276514+0000","last_undegraded":"2024-09-17T01:32:54.276514+0000","last_fullsized":"2024-09-17T01:32:54.276514+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:44:59.775956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.254823+0000","last_change":"2024-09-17T01:32:54.254823+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.254823+0000","last_undegraded":"2024-09-17T01:32:54.254823+0000","last_fullsized":"2024-09-17T01:32:54.254823+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.280103+0000","last_change":"2024-09-17T01:32:54.278092+0000","last_active":"2024-09-17T01:32:54.280103+0000","last_peered":"2024-09-17T01:32:54.280103+0000","last_clean":"2024-09-17T01:32:54.280103+0000","last_became_active":"2024-09-17T01:32:54.276983+0000","last_became_peered":"2024-09-17T01:32:54.276983+0000","last_unstale":"2024-09-17T01:32:54.280103+0000","last_undegraded":"2024-09-17T01:32:54.280103+0000","last_fullsized":"2024-09-17T01:32:54.280103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:49.194868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.246766+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:32:54.246766+0000","last_peered":"2024-09-17T01:32:54.246766+0000","last_clean":"2024-09-17T01:32:54.246766+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:32:54.246766+0000","last_undegraded":"2024-09-17T01:32:54.246766+0000","last_fullsized":"2024-09-17T01:32:54.246766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476752,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":356352,"data_stored":133819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":339968,"data_stored":127010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":339968,"data_stored":127010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":327680,"data_stored":120735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":339968,"data_stored":127010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":921600,"data_stored":711103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":327680,"data_stored":120735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":962560,"data_stored":731035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:33:00.235 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:33:00.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.502+0000 7f1b87e00640 1 -- 172.21.15.42:0/127402458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b6c005150 msgr2=0x7f1b6c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:00.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.502+0000 7f1b87e00640 1 --2- 172.21.15.42:0/127402458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b6c005150 0x7f1b6c00b9c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000c4a0 tx=0x7f1b6c005830 comp rx=0 tx=0).stop 2024-09-17T01:33:00.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.502+0000 7f1b87400640 1 -- 172.21.15.42:0/127402458 reap_dead start 2024-09-17T01:33:00.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.502+0000 7f1b87e00640 1 -- 172.21.15.42:0/127402458 shutdown_connections 2024-09-17T01:33:00.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.502+0000 7f1b87e00640 1 -- 172.21.15.42:0/127402458 >> 172.21.15.42:0/127402458 conn(0x7f1b880cd4c0 msgr2=0x7f1b880cd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:33:00.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.503+0000 7f1b87e00640 1 -- 172.21.15.42:0/127402458 shutdown_connections 2024-09-17T01:33:00.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.503+0000 7f1b87e00640 1 -- 172.21.15.42:0/127402458 wait complete. 2024-09-17T01:33:00.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.505+0000 7f1b87e00640 1 Processor -- start 2024-09-17T01:33:00.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.505+0000 7f1b87e00640 1 -- start start 2024-09-17T01:33:00.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.506+0000 7f1b87e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b8814c410 0x7f1b881f9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:00.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.506+0000 7f1b87e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b8814e210 0x7f1b881e90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:00.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.506+0000 7f1b87e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b8814e620 0x7f1b881e9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:00.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.506+0000 7f1b87e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8815cf10 con 0x7f1b8814e210 2024-09-17T01:33:00.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.506+0000 7f1b87e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8815cd90 con 0x7f1b8814e620 2024-09-17T01:33:00.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.506+0000 7f1b87e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1b88071320 con 0x7f1b8814c410 2024-09-17T01:33:00.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.507+0000 7f1b86000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b8814e210 0x7f1b881e90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:00.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.507+0000 7f1b86000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b8814e210 0x7f1b881e90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48700/0 (socket says 172.21.15.42:48700) 2024-09-17T01:33:00.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.507+0000 7f1b86000640 1 -- 172.21.15.42:0/2706919340 learned_addr learned my addr 172.21.15.42:0/2706919340 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:33:00.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.507+0000 7f1b86a00640 1 --2- 172.21.15.42:0/2706919340 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b8814c410 0x7f1b881f9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:00.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.507+0000 7f1b87400640 1 --2- 172.21.15.42:0/2706919340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b8814e620 0x7f1b881e9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:00.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.507+0000 7f1b86000640 1 -- 172.21.15.42:0/2706919340 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b8814c410 msgr2=0x7f1b881f9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:00.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.507+0000 7f1b86000640 1 --2- 172.21.15.42:0/2706919340 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b8814c410 0x7f1b881f9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:00.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.507+0000 7f1b86000640 1 -- 172.21.15.42:0/2706919340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b8814e620 msgr2=0x7f1b881e9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:00.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.507+0000 7f1b86000640 1 --2- 172.21.15.42:0/2706919340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b8814e620 0x7f1b881e9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:00.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.507+0000 7f1b86000640 1 -- 172.21.15.42:0/2706919340 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b881f5550 con 0x7f1b8814e210 2024-09-17T01:33:00.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.507+0000 7f1b86000640 1 --2- 172.21.15.42:0/2706919340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b8814e210 0x7f1b881e90d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1b74011ae0 tx=0x7f1b74009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:33:00.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.508+0000 7f1b7ea00640 1 -- 172.21.15.42:0/2706919340 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7400fcb0 con 0x7f1b8814e210 2024-09-17T01:33:00.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.508+0000 7f1b7ea00640 1 -- 172.21.15.42:0/2706919340 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b7400fe50 con 0x7f1b8814e210 2024-09-17T01:33:00.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.508+0000 7f1b87e00640 1 -- 172.21.15.42:0/2706919340 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b881f57d0 con 0x7f1b8814e210 2024-09-17T01:33:00.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.508+0000 7f1b7ea00640 1 -- 172.21.15.42:0/2706919340 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b74004280 con 0x7f1b8814e210 2024-09-17T01:33:00.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.508+0000 7f1b87e00640 1 -- 172.21.15.42:0/2706919340 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b881f5d90 con 0x7f1b8814e210 2024-09-17T01:33:00.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.509+0000 7f1b87e00640 1 -- 172.21.15.42:0/2706919340 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b88153790 con 0x7f1b8814e210 2024-09-17T01:33:00.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.510+0000 7f1b7ea00640 1 -- 172.21.15.42:0/2706919340 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1b740035f0 con 0x7f1b8814e210 2024-09-17T01:33:00.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.511+0000 7f1b7ea00640 1 --2- 172.21.15.42:0/2706919340 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b68078b90 0x7f1b6807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:00.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.511+0000 7f1b7ea00640 1 -- 172.21.15.42:0/2706919340 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f1b7409b810 con 0x7f1b8814e210 2024-09-17T01:33:00.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.512+0000 7f1b86a00640 1 --2- 172.21.15.42:0/2706919340 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b68078b90 0x7f1b6807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:00.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.512+0000 7f1b86a00640 1 --2- 172.21.15.42:0/2706919340 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b68078b90 0x7f1b6807b0a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1b88072570 tx=0x7f1b78009500 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:33:00.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.516+0000 7f1b7ea00640 1 -- 172.21.15.42:0/2706919340 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1b881f5550 con 0x7f1b8814e210 2024-09-17T01:33:00.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.706+0000 7f1b87e00640 1 -- 172.21.15.42:0/2706919340 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1b880cea90 con 0x7f1b68078b90 2024-09-17T01:33:00.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.711+0000 7f1b7ea00640 1 -- 172.21.15.42:0/2706919340 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247976 (secure 0 0 0) 0x7f1b880cea90 con 0x7f1b68078b90 2024-09-17T01:33:00.712 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:33:00.713 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:33:00.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.715+0000 7f1b87e00640 1 -- 172.21.15.42:0/2706919340 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b68078b90 msgr2=0x7f1b6807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:00.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.715+0000 7f1b87e00640 1 --2- 172.21.15.42:0/2706919340 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b68078b90 0x7f1b6807b0a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1b88072570 tx=0x7f1b78009500 comp rx=0 tx=0).stop 2024-09-17T01:33:00.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.715+0000 7f1b87e00640 1 -- 172.21.15.42:0/2706919340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b8814e210 msgr2=0x7f1b881e90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:00.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.715+0000 7f1b87e00640 1 --2- 172.21.15.42:0/2706919340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b8814e210 0x7f1b881e90d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1b74011ae0 tx=0x7f1b74009f10 comp rx=0 tx=0).stop 2024-09-17T01:33:00.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.715+0000 7f1b87e00640 1 -- 172.21.15.42:0/2706919340 shutdown_connections 2024-09-17T01:33:00.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.715+0000 7f1b87e00640 1 --2- 172.21.15.42:0/2706919340 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b68078b90 0x7f1b6807b0a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:00.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.715+0000 7f1b87e00640 1 --2- 172.21.15.42:0/2706919340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b8814e620 0x7f1b881e9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:00.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.715+0000 7f1b87e00640 1 --2- 172.21.15.42:0/2706919340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b8814e210 0x7f1b881e90d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:00.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.715+0000 7f1b87e00640 1 --2- 172.21.15.42:0/2706919340 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b8814c410 0x7f1b881f9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:00.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.715+0000 7f1b87e00640 1 -- 172.21.15.42:0/2706919340 >> 172.21.15.42:0/2706919340 conn(0x7f1b880cd4c0 msgr2=0x7f1b880cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:33:00.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.715+0000 7f1b87e00640 1 -- 172.21.15.42:0/2706919340 shutdown_connections 2024-09-17T01:33:00.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:00.715+0000 7f1b87e00640 1 -- 172.21.15.42:0/2706919340 wait complete. 2024-09-17T01:33:00.737 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-09-17T01:32:58.988493+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":109,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":62,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253348,"kb_used_data":3824,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721372,"statfs":{"total":773094113280,"available":772834684928,"internally_reserved":0,"allocated":3915776,"data_stored":2198457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.752209"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.284914+0000","last_change":"2024-09-17T01:32:55.281409+0000","last_active":"2024-09-17T01:32:55.284914+0000","last_peered":"2024-09-17T01:32:55.284914+0000","last_clean":"2024-09-17T01:32:55.284914+0000","last_became_active":"2024-09-17T01:32:55.277989+0000","last_became_peered":"2024-09-17T01:32:55.277989+0000","last_unstale":"2024-09-17T01:32:55.284914+0000","last_undegraded":"2024-09-17T01:32:55.284914+0000","last_fullsized":"2024-09-17T01:32:55.284914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:37.868206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269483+0000","last_change":"2024-09-17T01:32:55.286374+0000","last_active":"2024-09-17T01:32:56.269483+0000","last_peered":"2024-09-17T01:32:56.269483+0000","last_clean":"2024-09-17T01:32:56.269483+0000","last_became_active":"2024-09-17T01:32:55.282079+0000","last_became_peered":"2024-09-17T01:32:55.282079+0000","last_unstale":"2024-09-17T01:32:56.269483+0000","last_undegraded":"2024-09-17T01:32:56.269483+0000","last_fullsized":"2024-09-17T01:32:56.269483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:37.917841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.251474+0000","last_change":"2024-09-17T01:32:54.251474+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.251474+0000","last_undegraded":"2024-09-17T01:32:54.251474+0000","last_fullsized":"2024-09-17T01:32:54.251474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.253930+0000","last_change":"2024-09-17T01:32:54.253930+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.253930+0000","last_undegraded":"2024-09-17T01:32:54.253930+0000","last_fullsized":"2024-09-17T01:32:54.253930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269043+0000","last_change":"2024-09-17T01:32:55.282329+0000","last_active":"2024-09-17T01:32:56.269043+0000","last_peered":"2024-09-17T01:32:56.269043+0000","last_clean":"2024-09-17T01:32:56.269043+0000","last_became_active":"2024-09-17T01:32:55.281587+0000","last_became_peered":"2024-09-17T01:32:55.281587+0000","last_unstale":"2024-09-17T01:32:56.269043+0000","last_undegraded":"2024-09-17T01:32:56.269043+0000","last_fullsized":"2024-09-17T01:32:56.269043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:38:26.720551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.253554+0000","last_change":"2024-09-17T01:32:54.253554+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.253554+0000","last_undegraded":"2024-09-17T01:32:54.253554+0000","last_fullsized":"2024-09-17T01:32:54.253554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.280637+0000","last_change":"2024-09-17T01:32:55.278314+0000","last_active":"2024-09-17T01:32:55.280637+0000","last_peered":"2024-09-17T01:32:55.280637+0000","last_clean":"2024-09-17T01:32:55.280637+0000","last_became_active":"2024-09-17T01:32:55.277821+0000","last_became_peered":"2024-09-17T01:32:55.277821+0000","last_unstale":"2024-09-17T01:32:55.280637+0000","last_undegraded":"2024-09-17T01:32:55.280637+0000","last_fullsized":"2024-09-17T01:32:55.280637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:34:51.193448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.290252+0000","last_change":"2024-09-17T01:32:55.284414+0000","last_active":"2024-09-17T01:32:55.290252+0000","last_peered":"2024-09-17T01:32:55.290252+0000","last_clean":"2024-09-17T01:32:55.290252+0000","last_became_active":"2024-09-17T01:32:55.284204+0000","last_became_peered":"2024-09-17T01:32:55.284204+0000","last_unstale":"2024-09-17T01:32:55.290252+0000","last_undegraded":"2024-09-17T01:32:55.290252+0000","last_fullsized":"2024-09-17T01:32:55.290252+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:24.066985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.251163+0000","last_change":"2024-09-17T01:32:54.251163+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.251163+0000","last_undegraded":"2024-09-17T01:32:54.251163+0000","last_fullsized":"2024-09-17T01:32:54.251163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.254676+0000","last_change":"2024-09-17T01:32:54.254676+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.254676+0000","last_undegraded":"2024-09-17T01:32:54.254676+0000","last_fullsized":"2024-09-17T01:32:54.254676+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.262516+0000","last_change":"2024-09-17T01:32:54.262516+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.262516+0000","last_undegraded":"2024-09-17T01:32:54.262516+0000","last_fullsized":"2024-09-17T01:32:54.262516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.249802+0000","last_change":"2024-09-17T01:32:54.249802+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.249802+0000","last_undegraded":"2024-09-17T01:32:54.249802+0000","last_fullsized":"2024-09-17T01:32:54.249802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.249501+0000","last_change":"2024-09-17T01:32:54.249501+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.249501+0000","last_undegraded":"2024-09-17T01:32:54.249501+0000","last_fullsized":"2024-09-17T01:32:54.249501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.251224+0000","last_change":"2024-09-17T01:32:54.251224+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.251224+0000","last_undegraded":"2024-09-17T01:32:54.251224+0000","last_fullsized":"2024-09-17T01:32:54.251224+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.262084+0000","last_change":"2024-09-17T01:32:54.262084+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.262084+0000","last_undegraded":"2024-09-17T01:32:54.262084+0000","last_fullsized":"2024-09-17T01:32:54.262084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.253217+0000","last_change":"2024-09-17T01:32:54.253217+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.253217+0000","last_undegraded":"2024-09-17T01:32:54.253217+0000","last_fullsized":"2024-09-17T01:32:54.253217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.264120+0000","last_change":"2024-09-17T01:32:54.264120+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.264120+0000","last_undegraded":"2024-09-17T01:32:54.264120+0000","last_fullsized":"2024-09-17T01:32:54.264120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.258634+0000","last_change":"2024-09-17T01:32:54.258634+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.258634+0000","last_undegraded":"2024-09-17T01:32:54.258634+0000","last_fullsized":"2024-09-17T01:32:54.258634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.259123+0000","last_change":"2024-09-17T01:32:54.259123+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.259123+0000","last_undegraded":"2024-09-17T01:32:54.259123+0000","last_fullsized":"2024-09-17T01:32:54.259123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.251851+0000","last_change":"2024-09-17T01:32:54.251851+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.251851+0000","last_undegraded":"2024-09-17T01:32:54.251851+0000","last_fullsized":"2024-09-17T01:32:54.251851+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.257412+0000","last_change":"2024-09-17T01:32:54.257412+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.257412+0000","last_undegraded":"2024-09-17T01:32:54.257412+0000","last_fullsized":"2024-09-17T01:32:54.257412+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.289838+0000","last_change":"2024-09-17T01:32:55.283222+0000","last_active":"2024-09-17T01:32:55.289838+0000","last_peered":"2024-09-17T01:32:55.289838+0000","last_clean":"2024-09-17T01:32:55.289838+0000","last_became_active":"2024-09-17T01:32:55.282841+0000","last_became_peered":"2024-09-17T01:32:55.282841+0000","last_unstale":"2024-09-17T01:32:55.289838+0000","last_undegraded":"2024-09-17T01:32:55.289838+0000","last_fullsized":"2024-09-17T01:32:55.289838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:39.561775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.248800+0000","last_change":"2024-09-17T01:32:54.248800+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.248800+0000","last_undegraded":"2024-09-17T01:32:54.248800+0000","last_fullsized":"2024-09-17T01:32:54.248800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.283936+0000","last_change":"2024-09-17T01:32:55.281293+0000","last_active":"2024-09-17T01:32:55.283936+0000","last_peered":"2024-09-17T01:32:55.283936+0000","last_clean":"2024-09-17T01:32:55.283936+0000","last_became_active":"2024-09-17T01:32:55.280932+0000","last_became_peered":"2024-09-17T01:32:55.280932+0000","last_unstale":"2024-09-17T01:32:55.283936+0000","last_undegraded":"2024-09-17T01:32:55.283936+0000","last_fullsized":"2024-09-17T01:32:55.283936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:41.379696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.257796+0000","last_change":"2024-09-17T01:32:54.257796+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.257796+0000","last_undegraded":"2024-09-17T01:32:54.257796+0000","last_fullsized":"2024-09-17T01:32:54.257796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.253346+0000","last_change":"2024-09-17T01:32:54.253346+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.253346+0000","last_undegraded":"2024-09-17T01:32:54.253346+0000","last_fullsized":"2024-09-17T01:32:54.253346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269159+0000","last_change":"2024-09-17T01:32:55.258825+0000","last_active":"2024-09-17T01:32:56.269159+0000","last_peered":"2024-09-17T01:32:56.269159+0000","last_clean":"2024-09-17T01:32:56.269159+0000","last_became_active":"2024-09-17T01:32:55.258420+0000","last_became_peered":"2024-09-17T01:32:55.258420+0000","last_unstale":"2024-09-17T01:32:56.269159+0000","last_undegraded":"2024-09-17T01:32:56.269159+0000","last_fullsized":"2024-09-17T01:32:56.269159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:07.739522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.281933+0000","last_change":"2024-09-17T01:32:55.279814+0000","last_active":"2024-09-17T01:32:55.281933+0000","last_peered":"2024-09-17T01:32:55.281933+0000","last_clean":"2024-09-17T01:32:55.281933+0000","last_became_active":"2024-09-17T01:32:55.278739+0000","last_became_peered":"2024-09-17T01:32:55.278739+0000","last_unstale":"2024-09-17T01:32:55.281933+0000","last_undegraded":"2024-09-17T01:32:55.281933+0000","last_fullsized":"2024-09-17T01:32:55.281933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:47.719271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.257949+0000","last_change":"2024-09-17T01:32:54.257949+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.257949+0000","last_undegraded":"2024-09-17T01:32:54.257949+0000","last_fullsized":"2024-09-17T01:32:54.257949+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.254014+0000","last_change":"2024-09-17T01:32:54.254014+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.254014+0000","last_undegraded":"2024-09-17T01:32:54.254014+0000","last_fullsized":"2024-09-17T01:32:54.254014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.280609+0000","last_change":"2024-09-17T01:32:55.278268+0000","last_active":"2024-09-17T01:32:55.280609+0000","last_peered":"2024-09-17T01:32:55.280609+0000","last_clean":"2024-09-17T01:32:55.280609+0000","last_became_active":"2024-09-17T01:32:55.277398+0000","last_became_peered":"2024-09-17T01:32:55.277398+0000","last_unstale":"2024-09-17T01:32:55.280609+0000","last_undegraded":"2024-09-17T01:32:55.280609+0000","last_fullsized":"2024-09-17T01:32:55.280609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:52.539549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.252588+0000","last_change":"2024-09-17T01:32:54.252588+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.252588+0000","last_undegraded":"2024-09-17T01:32:54.252588+0000","last_fullsized":"2024-09-17T01:32:54.252588+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.249991+0000","last_change":"2024-09-17T01:32:54.249991+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.249991+0000","last_undegraded":"2024-09-17T01:32:54.249991+0000","last_fullsized":"2024-09-17T01:32:54.249991+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.279607+0000","last_change":"2024-09-17T01:32:54.273748+0000","last_active":"2024-09-17T01:32:54.279607+0000","last_peered":"2024-09-17T01:32:54.279607+0000","last_clean":"2024-09-17T01:32:54.279607+0000","last_became_active":"2024-09-17T01:32:54.273437+0000","last_became_peered":"2024-09-17T01:32:54.273437+0000","last_unstale":"2024-09-17T01:32:54.279607+0000","last_undegraded":"2024-09-17T01:32:54.279607+0000","last_fullsized":"2024-09-17T01:32:54.279607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:37.611316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.281643+0000","last_change":"2024-09-17T01:32:55.276719+0000","last_active":"2024-09-17T01:32:55.281643+0000","last_peered":"2024-09-17T01:32:55.281643+0000","last_clean":"2024-09-17T01:32:55.281643+0000","last_became_active":"2024-09-17T01:32:55.276410+0000","last_became_peered":"2024-09-17T01:32:55.276410+0000","last_unstale":"2024-09-17T01:32:55.281643+0000","last_undegraded":"2024-09-17T01:32:55.281643+0000","last_fullsized":"2024-09-17T01:32:55.281643+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:21.702511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.275479+0000","last_change":"2024-09-17T01:32:54.270531+0000","last_active":"2024-09-17T01:32:54.275479+0000","last_peered":"2024-09-17T01:32:54.275479+0000","last_clean":"2024-09-17T01:32:54.275479+0000","last_became_active":"2024-09-17T01:32:54.270161+0000","last_became_peered":"2024-09-17T01:32:54.270161+0000","last_unstale":"2024-09-17T01:32:54.275479+0000","last_undegraded":"2024-09-17T01:32:54.275479+0000","last_fullsized":"2024-09-17T01:32:54.275479+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:20:05.534622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.286029+0000","last_change":"2024-09-17T01:32:55.283488+0000","last_active":"2024-09-17T01:32:55.286029+0000","last_peered":"2024-09-17T01:32:55.286029+0000","last_clean":"2024-09-17T01:32:55.286029+0000","last_became_active":"2024-09-17T01:32:55.283023+0000","last_became_peered":"2024-09-17T01:32:55.283023+0000","last_unstale":"2024-09-17T01:32:55.286029+0000","last_undegraded":"2024-09-17T01:32:55.286029+0000","last_fullsized":"2024-09-17T01:32:55.286029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:21:32.704860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.278383+0000","last_change":"2024-09-17T01:32:54.276942+0000","last_active":"2024-09-17T01:32:54.278383+0000","last_peered":"2024-09-17T01:32:54.278383+0000","last_clean":"2024-09-17T01:32:54.278383+0000","last_became_active":"2024-09-17T01:32:54.275355+0000","last_became_peered":"2024-09-17T01:32:54.275355+0000","last_unstale":"2024-09-17T01:32:54.278383+0000","last_undegraded":"2024-09-17T01:32:54.278383+0000","last_fullsized":"2024-09-17T01:32:54.278383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:07.743562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.251439+0000","last_change":"2024-09-17T01:32:54.251439+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.251439+0000","last_undegraded":"2024-09-17T01:32:54.251439+0000","last_fullsized":"2024-09-17T01:32:54.251439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.265738+0000","last_change":"2024-09-17T01:32:54.262112+0000","last_active":"2024-09-17T01:32:54.265738+0000","last_peered":"2024-09-17T01:32:54.265738+0000","last_clean":"2024-09-17T01:32:54.265738+0000","last_became_active":"2024-09-17T01:32:54.261706+0000","last_became_peered":"2024-09-17T01:32:54.261706+0000","last_unstale":"2024-09-17T01:32:54.265738+0000","last_undegraded":"2024-09-17T01:32:54.265738+0000","last_fullsized":"2024-09-17T01:32:54.265738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:24.840346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.249623+0000","last_change":"2024-09-17T01:32:54.249623+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.249623+0000","last_undegraded":"2024-09-17T01:32:54.249623+0000","last_fullsized":"2024-09-17T01:32:54.249623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.298037+0000","last_change":"2024-09-17T01:32:54.270450+0000","last_active":"2024-09-17T01:32:55.298037+0000","last_peered":"2024-09-17T01:32:55.298037+0000","last_clean":"2024-09-17T01:32:55.298037+0000","last_became_active":"2024-09-17T01:32:54.270127+0000","last_became_peered":"2024-09-17T01:32:54.270127+0000","last_unstale":"2024-09-17T01:32:55.298037+0000","last_undegraded":"2024-09-17T01:32:55.298037+0000","last_fullsized":"2024-09-17T01:32:55.298037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:37:22.998881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.280697+0000","last_change":"2024-09-17T01:32:55.279427+0000","last_active":"2024-09-17T01:32:55.280697+0000","last_peered":"2024-09-17T01:32:55.280697+0000","last_clean":"2024-09-17T01:32:55.280697+0000","last_became_active":"2024-09-17T01:32:55.278575+0000","last_became_peered":"2024-09-17T01:32:55.278575+0000","last_unstale":"2024-09-17T01:32:55.280697+0000","last_undegraded":"2024-09-17T01:32:55.280697+0000","last_fullsized":"2024-09-17T01:32:55.280697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:24.531548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.294322+0000","last_change":"2024-09-17T01:32:54.263865+0000","last_active":"2024-09-17T01:32:55.294322+0000","last_peered":"2024-09-17T01:32:55.294322+0000","last_clean":"2024-09-17T01:32:55.294322+0000","last_became_active":"2024-09-17T01:32:54.263543+0000","last_became_peered":"2024-09-17T01:32:54.263543+0000","last_unstale":"2024-09-17T01:32:55.294322+0000","last_undegraded":"2024-09-17T01:32:55.294322+0000","last_fullsized":"2024-09-17T01:32:55.294322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:08.574044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.250373+0000","last_change":"2024-09-17T01:32:54.250373+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.250373+0000","last_undegraded":"2024-09-17T01:32:54.250373+0000","last_fullsized":"2024-09-17T01:32:54.250373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.279010+0000","last_change":"2024-09-17T01:32:54.277476+0000","last_active":"2024-09-17T01:32:54.279010+0000","last_peered":"2024-09-17T01:32:54.279010+0000","last_clean":"2024-09-17T01:32:54.279010+0000","last_became_active":"2024-09-17T01:32:54.275552+0000","last_became_peered":"2024-09-17T01:32:54.275552+0000","last_unstale":"2024-09-17T01:32:54.279010+0000","last_undegraded":"2024-09-17T01:32:54.279010+0000","last_fullsized":"2024-09-17T01:32:54.279010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:03.098153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.251240+0000","last_change":"2024-09-17T01:32:54.251240+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.251240+0000","last_undegraded":"2024-09-17T01:32:54.251240+0000","last_fullsized":"2024-09-17T01:32:54.251240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.262075+0000","last_change":"2024-09-17T01:32:54.267969+0000","last_active":"2024-09-17T01:32:55.262075+0000","last_peered":"2024-09-17T01:32:55.262075+0000","last_clean":"2024-09-17T01:32:55.262075+0000","last_became_active":"2024-09-17T01:32:54.267655+0000","last_became_peered":"2024-09-17T01:32:54.267655+0000","last_unstale":"2024-09-17T01:32:55.262075+0000","last_undegraded":"2024-09-17T01:32:55.262075+0000","last_fullsized":"2024-09-17T01:32:55.262075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:52:13.804280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.259535+0000","last_change":"2024-09-17T01:32:54.259535+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.259535+0000","last_undegraded":"2024-09-17T01:32:54.259535+0000","last_fullsized":"2024-09-17T01:32:54.259535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269288+0000","last_change":"2024-09-17T01:32:54.265327+0000","last_active":"2024-09-17T01:32:56.269288+0000","last_peered":"2024-09-17T01:32:56.269288+0000","last_clean":"2024-09-17T01:32:56.269288+0000","last_became_active":"2024-09-17T01:32:54.265022+0000","last_became_peered":"2024-09-17T01:32:54.265022+0000","last_unstale":"2024-09-17T01:32:56.269288+0000","last_undegraded":"2024-09-17T01:32:56.269288+0000","last_fullsized":"2024-09-17T01:32:56.269288+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:36.740407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.254809+0000","last_change":"2024-09-17T01:32:54.254809+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.254809+0000","last_undegraded":"2024-09-17T01:32:54.254809+0000","last_fullsized":"2024-09-17T01:32:54.254809+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269099+0000","last_change":"2024-09-17T01:32:54.270692+0000","last_active":"2024-09-17T01:32:56.269099+0000","last_peered":"2024-09-17T01:32:56.269099+0000","last_clean":"2024-09-17T01:32:56.269099+0000","last_became_active":"2024-09-17T01:32:54.269836+0000","last_became_peered":"2024-09-17T01:32:54.269836+0000","last_unstale":"2024-09-17T01:32:56.269099+0000","last_undegraded":"2024-09-17T01:32:56.269099+0000","last_fullsized":"2024-09-17T01:32:56.269099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:01.191442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.253202+0000","last_change":"2024-09-17T01:32:54.253202+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.253202+0000","last_undegraded":"2024-09-17T01:32:54.253202+0000","last_fullsized":"2024-09-17T01:32:54.253202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.280158+0000","last_change":"2024-09-17T01:32:54.278326+0000","last_active":"2024-09-17T01:32:54.280158+0000","last_peered":"2024-09-17T01:32:54.280158+0000","last_clean":"2024-09-17T01:32:54.280158+0000","last_became_active":"2024-09-17T01:32:54.277421+0000","last_became_peered":"2024-09-17T01:32:54.277421+0000","last_unstale":"2024-09-17T01:32:54.280158+0000","last_undegraded":"2024-09-17T01:32:54.280158+0000","last_fullsized":"2024-09-17T01:32:54.280158+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:05.597471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.263361+0000","last_change":"2024-09-17T01:32:54.263361+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.263361+0000","last_undegraded":"2024-09-17T01:32:54.263361+0000","last_fullsized":"2024-09-17T01:32:54.263361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.269179+0000","last_change":"2024-09-17T01:32:54.263719+0000","last_active":"2024-09-17T01:32:54.269179+0000","last_peered":"2024-09-17T01:32:54.269179+0000","last_clean":"2024-09-17T01:32:54.269179+0000","last_became_active":"2024-09-17T01:32:54.263393+0000","last_became_peered":"2024-09-17T01:32:54.263393+0000","last_unstale":"2024-09-17T01:32:54.269179+0000","last_undegraded":"2024-09-17T01:32:54.269179+0000","last_fullsized":"2024-09-17T01:32:54.269179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:45.169483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.250545+0000","last_change":"2024-09-17T01:32:54.250545+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.250545+0000","last_undegraded":"2024-09-17T01:32:54.250545+0000","last_fullsized":"2024-09-17T01:32:54.250545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.298218+0000","last_change":"2024-09-17T01:32:54.281274+0000","last_active":"2024-09-17T01:32:55.298218+0000","last_peered":"2024-09-17T01:32:55.298218+0000","last_clean":"2024-09-17T01:32:55.298218+0000","last_became_active":"2024-09-17T01:32:54.276072+0000","last_became_peered":"2024-09-17T01:32:54.276072+0000","last_unstale":"2024-09-17T01:32:55.298218+0000","last_undegraded":"2024-09-17T01:32:55.298218+0000","last_fullsized":"2024-09-17T01:32:55.298218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:54.540207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.254166+0000","last_change":"2024-09-17T01:32:54.254166+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.254166+0000","last_undegraded":"2024-09-17T01:32:54.254166+0000","last_fullsized":"2024-09-17T01:32:54.254166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.278111+0000","last_change":"2024-09-17T01:32:54.276866+0000","last_active":"2024-09-17T01:32:54.278111+0000","last_peered":"2024-09-17T01:32:54.278111+0000","last_clean":"2024-09-17T01:32:54.278111+0000","last_became_active":"2024-09-17T01:32:54.275207+0000","last_became_peered":"2024-09-17T01:32:54.275207+0000","last_unstale":"2024-09-17T01:32:54.278111+0000","last_undegraded":"2024-09-17T01:32:54.278111+0000","last_fullsized":"2024-09-17T01:32:54.278111+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:41:14.479399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.277528+0000","last_change":"2024-09-17T01:32:55.274043+0000","last_active":"2024-09-17T01:32:55.277528+0000","last_peered":"2024-09-17T01:32:55.277528+0000","last_clean":"2024-09-17T01:32:55.277528+0000","last_became_active":"2024-09-17T01:32:55.273734+0000","last_became_peered":"2024-09-17T01:32:55.273734+0000","last_unstale":"2024-09-17T01:32:55.277528+0000","last_undegraded":"2024-09-17T01:32:55.277528+0000","last_fullsized":"2024-09-17T01:32:55.277528+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:04.553804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.275263+0000","last_change":"2024-09-17T01:32:54.271260+0000","last_active":"2024-09-17T01:32:54.275263+0000","last_peered":"2024-09-17T01:32:54.275263+0000","last_clean":"2024-09-17T01:32:54.275263+0000","last_became_active":"2024-09-17T01:32:54.270930+0000","last_became_peered":"2024-09-17T01:32:54.270930+0000","last_unstale":"2024-09-17T01:32:54.275263+0000","last_undegraded":"2024-09-17T01:32:54.275263+0000","last_fullsized":"2024-09-17T01:32:54.275263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:56.949109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.266778+0000","last_change":"2024-09-17T01:32:54.266778+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.266778+0000","last_undegraded":"2024-09-17T01:32:54.266778+0000","last_fullsized":"2024-09-17T01:32:54.266778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.278518+0000","last_change":"2024-09-17T01:32:54.277270+0000","last_active":"2024-09-17T01:32:54.278518+0000","last_peered":"2024-09-17T01:32:54.278518+0000","last_clean":"2024-09-17T01:32:54.278518+0000","last_became_active":"2024-09-17T01:32:54.276138+0000","last_became_peered":"2024-09-17T01:32:54.276138+0000","last_unstale":"2024-09-17T01:32:54.278518+0000","last_undegraded":"2024-09-17T01:32:54.278518+0000","last_fullsized":"2024-09-17T01:32:54.278518+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:50.745159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.259011+0000","last_change":"2024-09-17T01:32:54.259011+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.259011+0000","last_undegraded":"2024-09-17T01:32:54.259011+0000","last_fullsized":"2024-09-17T01:32:54.259011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.276924+0000","last_change":"2024-09-17T01:32:54.275279+0000","last_active":"2024-09-17T01:32:54.276924+0000","last_peered":"2024-09-17T01:32:54.276924+0000","last_clean":"2024-09-17T01:32:54.276924+0000","last_became_active":"2024-09-17T01:32:54.274814+0000","last_became_peered":"2024-09-17T01:32:54.274814+0000","last_unstale":"2024-09-17T01:32:54.276924+0000","last_undegraded":"2024-09-17T01:32:54.276924+0000","last_fullsized":"2024-09-17T01:32:54.276924+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:51.345722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.249634+0000","last_change":"2024-09-17T01:32:54.249634+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.249634+0000","last_undegraded":"2024-09-17T01:32:54.249634+0000","last_fullsized":"2024-09-17T01:32:54.249634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.296085+0000","last_change":"2024-09-17T01:32:54.277438+0000","last_active":"2024-09-17T01:32:55.296085+0000","last_peered":"2024-09-17T01:32:55.296085+0000","last_clean":"2024-09-17T01:32:55.296085+0000","last_became_active":"2024-09-17T01:32:54.277129+0000","last_became_peered":"2024-09-17T01:32:54.277129+0000","last_unstale":"2024-09-17T01:32:55.296085+0000","last_undegraded":"2024-09-17T01:32:55.296085+0000","last_fullsized":"2024-09-17T01:32:55.296085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:59.228808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269046+0000","last_change":"2024-09-17T01:32:55.259074+0000","last_active":"2024-09-17T01:32:56.269046+0000","last_peered":"2024-09-17T01:32:56.269046+0000","last_clean":"2024-09-17T01:32:56.269046+0000","last_became_active":"2024-09-17T01:32:55.258557+0000","last_became_peered":"2024-09-17T01:32:55.258557+0000","last_unstale":"2024-09-17T01:32:56.269046+0000","last_undegraded":"2024-09-17T01:32:56.269046+0000","last_fullsized":"2024-09-17T01:32:56.269046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:16.828516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.280072+0000","last_change":"2024-09-17T01:32:54.277977+0000","last_active":"2024-09-17T01:32:54.280072+0000","last_peered":"2024-09-17T01:32:54.280072+0000","last_clean":"2024-09-17T01:32:54.280072+0000","last_became_active":"2024-09-17T01:32:54.276470+0000","last_became_peered":"2024-09-17T01:32:54.276470+0000","last_unstale":"2024-09-17T01:32:54.280072+0000","last_undegraded":"2024-09-17T01:32:54.280072+0000","last_fullsized":"2024-09-17T01:32:54.280072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:39:50.371125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.258513+0000","last_change":"2024-09-17T01:32:54.258513+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.258513+0000","last_undegraded":"2024-09-17T01:32:54.258513+0000","last_fullsized":"2024-09-17T01:32:54.258513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.273042+0000","last_change":"2024-09-17T01:32:54.266920+0000","last_active":"2024-09-17T01:32:54.273042+0000","last_peered":"2024-09-17T01:32:54.273042+0000","last_clean":"2024-09-17T01:32:54.273042+0000","last_became_active":"2024-09-17T01:32:54.266582+0000","last_became_peered":"2024-09-17T01:32:54.266582+0000","last_unstale":"2024-09-17T01:32:54.273042+0000","last_undegraded":"2024-09-17T01:32:54.273042+0000","last_fullsized":"2024-09-17T01:32:54.273042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:34.037700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.249933+0000","last_change":"2024-09-17T01:32:54.249933+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.249933+0000","last_undegraded":"2024-09-17T01:32:54.249933+0000","last_fullsized":"2024-09-17T01:32:54.249933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269159+0000","last_change":"2024-09-17T01:32:54.264750+0000","last_active":"2024-09-17T01:32:56.269159+0000","last_peered":"2024-09-17T01:32:56.269159+0000","last_clean":"2024-09-17T01:32:56.269159+0000","last_became_active":"2024-09-17T01:32:54.262686+0000","last_became_peered":"2024-09-17T01:32:54.262686+0000","last_unstale":"2024-09-17T01:32:56.269159+0000","last_undegraded":"2024-09-17T01:32:56.269159+0000","last_fullsized":"2024-09-17T01:32:56.269159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:17:55.846732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269330+0000","last_change":"2024-09-17T01:32:55.266507+0000","last_active":"2024-09-17T01:32:56.269330+0000","last_peered":"2024-09-17T01:32:56.269330+0000","last_clean":"2024-09-17T01:32:56.269330+0000","last_became_active":"2024-09-17T01:32:55.266152+0000","last_became_peered":"2024-09-17T01:32:55.266152+0000","last_unstale":"2024-09-17T01:32:56.269330+0000","last_undegraded":"2024-09-17T01:32:56.269330+0000","last_fullsized":"2024-09-17T01:32:56.269330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:19.375873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.271233+0000","last_change":"2024-09-17T01:32:54.278174+0000","last_active":"2024-09-17T01:32:55.271233+0000","last_peered":"2024-09-17T01:32:55.271233+0000","last_clean":"2024-09-17T01:32:55.271233+0000","last_became_active":"2024-09-17T01:32:54.276004+0000","last_became_peered":"2024-09-17T01:32:54.276004+0000","last_unstale":"2024-09-17T01:32:55.271233+0000","last_undegraded":"2024-09-17T01:32:55.271233+0000","last_fullsized":"2024-09-17T01:32:55.271233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:13.711695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.248802+0000","last_change":"2024-09-17T01:32:54.248802+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.248802+0000","last_undegraded":"2024-09-17T01:32:54.248802+0000","last_fullsized":"2024-09-17T01:32:54.248802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.269078+0000","last_change":"2024-09-17T01:32:54.263007+0000","last_active":"2024-09-17T01:32:54.269078+0000","last_peered":"2024-09-17T01:32:54.269078+0000","last_clean":"2024-09-17T01:32:54.269078+0000","last_became_active":"2024-09-17T01:32:54.262642+0000","last_became_peered":"2024-09-17T01:32:54.262642+0000","last_unstale":"2024-09-17T01:32:54.269078+0000","last_undegraded":"2024-09-17T01:32:54.269078+0000","last_fullsized":"2024-09-17T01:32:54.269078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:58.487523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.250820+0000","last_change":"2024-09-17T01:32:54.250820+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.250820+0000","last_undegraded":"2024-09-17T01:32:54.250820+0000","last_fullsized":"2024-09-17T01:32:54.250820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.271099+0000","last_change":"2024-09-17T01:32:54.265991+0000","last_active":"2024-09-17T01:32:54.271099+0000","last_peered":"2024-09-17T01:32:54.271099+0000","last_clean":"2024-09-17T01:32:54.271099+0000","last_became_active":"2024-09-17T01:32:54.265640+0000","last_became_peered":"2024-09-17T01:32:54.265640+0000","last_unstale":"2024-09-17T01:32:54.271099+0000","last_undegraded":"2024-09-17T01:32:54.271099+0000","last_fullsized":"2024-09-17T01:32:54.271099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:34.217760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.257317+0000","last_change":"2024-09-17T01:32:54.257317+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.257317+0000","last_undegraded":"2024-09-17T01:32:54.257317+0000","last_fullsized":"2024-09-17T01:32:54.257317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.269101+0000","last_change":"2024-09-17T01:32:54.263467+0000","last_active":"2024-09-17T01:32:54.269101+0000","last_peered":"2024-09-17T01:32:54.269101+0000","last_clean":"2024-09-17T01:32:54.269101+0000","last_became_active":"2024-09-17T01:32:54.263098+0000","last_became_peered":"2024-09-17T01:32:54.263098+0000","last_unstale":"2024-09-17T01:32:54.269101+0000","last_undegraded":"2024-09-17T01:32:54.269101+0000","last_fullsized":"2024-09-17T01:32:54.269101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:02.074305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.263624+0000","last_change":"2024-09-17T01:32:54.263624+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.263624+0000","last_undegraded":"2024-09-17T01:32:54.263624+0000","last_fullsized":"2024-09-17T01:32:54.263624+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269306+0000","last_change":"2024-09-17T01:32:54.269945+0000","last_active":"2024-09-17T01:32:56.269306+0000","last_peered":"2024-09-17T01:32:56.269306+0000","last_clean":"2024-09-17T01:32:56.269306+0000","last_became_active":"2024-09-17T01:32:54.269614+0000","last_became_peered":"2024-09-17T01:32:54.269614+0000","last_unstale":"2024-09-17T01:32:56.269306+0000","last_undegraded":"2024-09-17T01:32:56.269306+0000","last_fullsized":"2024-09-17T01:32:56.269306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:39.597893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.253554+0000","last_change":"2024-09-17T01:32:54.253554+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.253554+0000","last_undegraded":"2024-09-17T01:32:54.253554+0000","last_fullsized":"2024-09-17T01:32:54.253554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.274839+0000","last_change":"2024-09-17T01:32:54.271877+0000","last_active":"2024-09-17T01:32:54.274839+0000","last_peered":"2024-09-17T01:32:54.274839+0000","last_clean":"2024-09-17T01:32:54.274839+0000","last_became_active":"2024-09-17T01:32:54.269407+0000","last_became_peered":"2024-09-17T01:32:54.269407+0000","last_unstale":"2024-09-17T01:32:54.274839+0000","last_undegraded":"2024-09-17T01:32:54.274839+0000","last_fullsized":"2024-09-17T01:32:54.274839+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:50.816324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.253424+0000","last_change":"2024-09-17T01:32:54.253424+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.253424+0000","last_undegraded":"2024-09-17T01:32:54.253424+0000","last_fullsized":"2024-09-17T01:32:54.253424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.269096+0000","last_change":"2024-09-17T01:32:54.266052+0000","last_active":"2024-09-17T01:32:54.269096+0000","last_peered":"2024-09-17T01:32:54.269096+0000","last_clean":"2024-09-17T01:32:54.269096+0000","last_became_active":"2024-09-17T01:32:54.265696+0000","last_became_peered":"2024-09-17T01:32:54.265696+0000","last_unstale":"2024-09-17T01:32:54.269096+0000","last_undegraded":"2024-09-17T01:32:54.269096+0000","last_fullsized":"2024-09-17T01:32:54.269096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:41.896366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.250666+0000","last_change":"2024-09-17T01:32:54.250666+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.250666+0000","last_undegraded":"2024-09-17T01:32:54.250666+0000","last_fullsized":"2024-09-17T01:32:54.250666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.275946+0000","last_change":"2024-09-17T01:32:54.274129+0000","last_active":"2024-09-17T01:32:54.275946+0000","last_peered":"2024-09-17T01:32:54.275946+0000","last_clean":"2024-09-17T01:32:54.275946+0000","last_became_active":"2024-09-17T01:32:54.273414+0000","last_became_peered":"2024-09-17T01:32:54.273414+0000","last_unstale":"2024-09-17T01:32:54.275946+0000","last_undegraded":"2024-09-17T01:32:54.275946+0000","last_fullsized":"2024-09-17T01:32:54.275946+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:38.022810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.256041+0000","last_change":"2024-09-17T01:32:54.256041+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.256041+0000","last_undegraded":"2024-09-17T01:32:54.256041+0000","last_fullsized":"2024-09-17T01:32:54.256041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T01:32:55.261748+0000","last_change":"2024-09-17T01:32:54.277748+0000","last_active":"2024-09-17T01:32:55.261748+0000","last_peered":"2024-09-17T01:32:55.261748+0000","last_clean":"2024-09-17T01:32:55.261748+0000","last_became_active":"2024-09-17T01:32:54.277399+0000","last_became_peered":"2024-09-17T01:32:54.277399+0000","last_unstale":"2024-09-17T01:32:55.261748+0000","last_undegraded":"2024-09-17T01:32:55.261748+0000","last_fullsized":"2024-09-17T01:32:55.261748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:24.670099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.265033+0000","last_change":"2024-09-17T01:32:54.265033+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.265033+0000","last_undegraded":"2024-09-17T01:32:54.265033+0000","last_fullsized":"2024-09-17T01:32:54.265033+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.276514+0000","last_change":"2024-09-17T01:32:54.271709+0000","last_active":"2024-09-17T01:32:54.276514+0000","last_peered":"2024-09-17T01:32:54.276514+0000","last_clean":"2024-09-17T01:32:54.276514+0000","last_became_active":"2024-09-17T01:32:54.271408+0000","last_became_peered":"2024-09-17T01:32:54.271408+0000","last_unstale":"2024-09-17T01:32:54.276514+0000","last_undegraded":"2024-09-17T01:32:54.276514+0000","last_fullsized":"2024-09-17T01:32:54.276514+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:44:59.775956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T01:32:54.254823+0000","last_change":"2024-09-17T01:32:54.254823+0000","last_active":"2024-09-17T01:32:54.235595+0000","last_peered":"2024-09-17T01:32:54.235595+0000","last_clean":"2024-09-17T01:32:54.235595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:32:54.254823+0000","last_undegraded":"2024-09-17T01:32:54.254823+0000","last_fullsized":"2024-09-17T01:32:54.254823+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.280103+0000","last_change":"2024-09-17T01:32:54.278092+0000","last_active":"2024-09-17T01:32:54.280103+0000","last_peered":"2024-09-17T01:32:54.280103+0000","last_clean":"2024-09-17T01:32:54.280103+0000","last_became_active":"2024-09-17T01:32:54.276983+0000","last_became_peered":"2024-09-17T01:32:54.276983+0000","last_unstale":"2024-09-17T01:32:54.280103+0000","last_undegraded":"2024-09-17T01:32:54.280103+0000","last_fullsized":"2024-09-17T01:32:54.280103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:49.194868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":126,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T01:32:54.246766+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:32:54.246766+0000","last_peered":"2024-09-17T01:32:54.246766+0000","last_clean":"2024-09-17T01:32:54.246766+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:32:54.246766+0000","last_undegraded":"2024-09-17T01:32:54.246766+0000","last_fullsized":"2024-09-17T01:32:54.246766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476752,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":356352,"data_stored":133819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":339968,"data_stored":127010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":339968,"data_stored":127010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":327680,"data_stored":120735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":339968,"data_stored":127010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":921600,"data_stored":711103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":327680,"data_stored":120735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":962560,"data_stored":731035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:33:00.742 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3d is not active+clean 2024-09-17T01:33:00.743 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.251474+0000', 'last_change': '2024-09-17T01:32:54.251474+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.251474+0000', 'last_undegraded': '2024-09-17T01:32:54.251474+0000', 'last_fullsized': '2024-09-17T01:32:54.251474+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T01:33:00.743 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3c is not active+clean 2024-09-17T01:33:00.743 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.253930+0000', 'last_change': '2024-09-17T01:32:54.253930+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.253930+0000', 'last_undegraded': '2024-09-17T01:32:54.253930+0000', 'last_fullsized': '2024-09-17T01:32:54.253930+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T01:33:00.743 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3a is not active+clean 2024-09-17T01:33:00.743 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.253554+0000', 'last_change': '2024-09-17T01:32:54.253554+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.253554+0000', 'last_undegraded': '2024-09-17T01:32:54.253554+0000', 'last_fullsized': '2024-09-17T01:32:54.253554+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T01:33:00.743 INFO:tasks.ceph.ceph_manager.ceph:PG 5.37 is not active+clean 2024-09-17T01:33:00.743 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.251163+0000', 'last_change': '2024-09-17T01:32:54.251163+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.251163+0000', 'last_undegraded': '2024-09-17T01:32:54.251163+0000', 'last_fullsized': '2024-09-17T01:32:54.251163+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T01:33:00.743 INFO:tasks.ceph.ceph_manager.ceph:PG 5.36 is not active+clean 2024-09-17T01:33:00.743 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.254676+0000', 'last_change': '2024-09-17T01:32:54.254676+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.254676+0000', 'last_undegraded': '2024-09-17T01:32:54.254676+0000', 'last_fullsized': '2024-09-17T01:32:54.254676+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T01:33:00.744 INFO:tasks.ceph.ceph_manager.ceph:PG 5.35 is not active+clean 2024-09-17T01:33:00.744 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.262516+0000', 'last_change': '2024-09-17T01:32:54.262516+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.262516+0000', 'last_undegraded': '2024-09-17T01:32:54.262516+0000', 'last_fullsized': '2024-09-17T01:32:54.262516+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T01:33:00.744 INFO:tasks.ceph.ceph_manager.ceph:PG 5.34 is not active+clean 2024-09-17T01:33:00.744 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.249802+0000', 'last_change': '2024-09-17T01:32:54.249802+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.249802+0000', 'last_undegraded': '2024-09-17T01:32:54.249802+0000', 'last_fullsized': '2024-09-17T01:32:54.249802+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T01:33:00.744 INFO:tasks.ceph.ceph_manager.ceph:PG 5.33 is not active+clean 2024-09-17T01:33:00.744 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.249501+0000', 'last_change': '2024-09-17T01:32:54.249501+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.249501+0000', 'last_undegraded': '2024-09-17T01:32:54.249501+0000', 'last_fullsized': '2024-09-17T01:32:54.249501+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T01:33:00.744 INFO:tasks.ceph.ceph_manager.ceph:PG 5.32 is not active+clean 2024-09-17T01:33:00.744 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.251224+0000', 'last_change': '2024-09-17T01:32:54.251224+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.251224+0000', 'last_undegraded': '2024-09-17T01:32:54.251224+0000', 'last_fullsized': '2024-09-17T01:32:54.251224+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T01:33:00.744 INFO:tasks.ceph.ceph_manager.ceph:PG 5.31 is not active+clean 2024-09-17T01:33:00.744 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.262084+0000', 'last_change': '2024-09-17T01:32:54.262084+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.262084+0000', 'last_undegraded': '2024-09-17T01:32:54.262084+0000', 'last_fullsized': '2024-09-17T01:32:54.262084+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T01:33:00.745 INFO:tasks.ceph.ceph_manager.ceph:PG 5.30 is not active+clean 2024-09-17T01:33:00.745 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.253217+0000', 'last_change': '2024-09-17T01:32:54.253217+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.253217+0000', 'last_undegraded': '2024-09-17T01:32:54.253217+0000', 'last_fullsized': '2024-09-17T01:32:54.253217+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T01:33:00.745 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2f is not active+clean 2024-09-17T01:33:00.745 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.264120+0000', 'last_change': '2024-09-17T01:32:54.264120+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.264120+0000', 'last_undegraded': '2024-09-17T01:32:54.264120+0000', 'last_fullsized': '2024-09-17T01:32:54.264120+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T01:33:00.745 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2e is not active+clean 2024-09-17T01:33:00.745 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.258634+0000', 'last_change': '2024-09-17T01:32:54.258634+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.258634+0000', 'last_undegraded': '2024-09-17T01:32:54.258634+0000', 'last_fullsized': '2024-09-17T01:32:54.258634+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T01:33:00.745 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2d is not active+clean 2024-09-17T01:33:00.745 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.259123+0000', 'last_change': '2024-09-17T01:32:54.259123+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.259123+0000', 'last_undegraded': '2024-09-17T01:32:54.259123+0000', 'last_fullsized': '2024-09-17T01:32:54.259123+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T01:33:00.745 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2c is not active+clean 2024-09-17T01:33:00.745 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.251851+0000', 'last_change': '2024-09-17T01:32:54.251851+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.251851+0000', 'last_undegraded': '2024-09-17T01:32:54.251851+0000', 'last_fullsized': '2024-09-17T01:32:54.251851+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T01:33:00.746 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2b is not active+clean 2024-09-17T01:33:00.746 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.257412+0000', 'last_change': '2024-09-17T01:32:54.257412+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.257412+0000', 'last_undegraded': '2024-09-17T01:32:54.257412+0000', 'last_fullsized': '2024-09-17T01:32:54.257412+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T01:33:00.746 INFO:tasks.ceph.ceph_manager.ceph:PG 5.29 is not active+clean 2024-09-17T01:33:00.746 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.248800+0000', 'last_change': '2024-09-17T01:32:54.248800+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.248800+0000', 'last_undegraded': '2024-09-17T01:32:54.248800+0000', 'last_fullsized': '2024-09-17T01:32:54.248800+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T01:33:00.746 INFO:tasks.ceph.ceph_manager.ceph:PG 5.27 is not active+clean 2024-09-17T01:33:00.746 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.257796+0000', 'last_change': '2024-09-17T01:32:54.257796+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.257796+0000', 'last_undegraded': '2024-09-17T01:32:54.257796+0000', 'last_fullsized': '2024-09-17T01:32:54.257796+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T01:33:00.746 INFO:tasks.ceph.ceph_manager.ceph:PG 5.26 is not active+clean 2024-09-17T01:33:00.746 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.253346+0000', 'last_change': '2024-09-17T01:32:54.253346+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.253346+0000', 'last_undegraded': '2024-09-17T01:32:54.253346+0000', 'last_fullsized': '2024-09-17T01:32:54.253346+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T01:33:00.747 INFO:tasks.ceph.ceph_manager.ceph:PG 5.23 is not active+clean 2024-09-17T01:33:00.747 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.257949+0000', 'last_change': '2024-09-17T01:32:54.257949+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.257949+0000', 'last_undegraded': '2024-09-17T01:32:54.257949+0000', 'last_fullsized': '2024-09-17T01:32:54.257949+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T01:33:00.747 INFO:tasks.ceph.ceph_manager.ceph:PG 5.22 is not active+clean 2024-09-17T01:33:00.747 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.254014+0000', 'last_change': '2024-09-17T01:32:54.254014+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.254014+0000', 'last_undegraded': '2024-09-17T01:32:54.254014+0000', 'last_fullsized': '2024-09-17T01:32:54.254014+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T01:33:00.747 INFO:tasks.ceph.ceph_manager.ceph:PG 5.20 is not active+clean 2024-09-17T01:33:00.748 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.252588+0000', 'last_change': '2024-09-17T01:32:54.252588+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.252588+0000', 'last_undegraded': '2024-09-17T01:32:54.252588+0000', 'last_fullsized': '2024-09-17T01:32:54.252588+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T01:33:00.748 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1e is not active+clean 2024-09-17T01:33:00.748 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.249991+0000', 'last_change': '2024-09-17T01:32:54.249991+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.249991+0000', 'last_undegraded': '2024-09-17T01:32:54.249991+0000', 'last_fullsized': '2024-09-17T01:32:54.249991+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T01:33:00.748 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-09-17T01:33:00.748 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.251439+0000', 'last_change': '2024-09-17T01:32:54.251439+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.251439+0000', 'last_undegraded': '2024-09-17T01:32:54.251439+0000', 'last_fullsized': '2024-09-17T01:32:54.251439+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T01:33:00.748 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1a is not active+clean 2024-09-17T01:33:00.748 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.249623+0000', 'last_change': '2024-09-17T01:32:54.249623+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.249623+0000', 'last_undegraded': '2024-09-17T01:32:54.249623+0000', 'last_fullsized': '2024-09-17T01:32:54.249623+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T01:33:00.748 INFO:tasks.ceph.ceph_manager.ceph:PG 5.18 is not active+clean 2024-09-17T01:33:00.748 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.250373+0000', 'last_change': '2024-09-17T01:32:54.250373+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.250373+0000', 'last_undegraded': '2024-09-17T01:32:54.250373+0000', 'last_fullsized': '2024-09-17T01:32:54.250373+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T01:33:00.748 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-09-17T01:33:00.749 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.251240+0000', 'last_change': '2024-09-17T01:32:54.251240+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.251240+0000', 'last_undegraded': '2024-09-17T01:32:54.251240+0000', 'last_fullsized': '2024-09-17T01:32:54.251240+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T01:33:00.749 INFO:tasks.ceph.ceph_manager.ceph:PG 5.16 is not active+clean 2024-09-17T01:33:00.749 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.259535+0000', 'last_change': '2024-09-17T01:32:54.259535+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.259535+0000', 'last_undegraded': '2024-09-17T01:32:54.259535+0000', 'last_fullsized': '2024-09-17T01:32:54.259535+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T01:33:00.749 INFO:tasks.ceph.ceph_manager.ceph:PG 5.17 is not active+clean 2024-09-17T01:33:00.749 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.254809+0000', 'last_change': '2024-09-17T01:32:54.254809+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.254809+0000', 'last_undegraded': '2024-09-17T01:32:54.254809+0000', 'last_fullsized': '2024-09-17T01:32:54.254809+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T01:33:00.749 INFO:tasks.ceph.ceph_manager.ceph:PG 5.14 is not active+clean 2024-09-17T01:33:00.749 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.253202+0000', 'last_change': '2024-09-17T01:32:54.253202+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.253202+0000', 'last_undegraded': '2024-09-17T01:32:54.253202+0000', 'last_fullsized': '2024-09-17T01:32:54.253202+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T01:33:00.749 INFO:tasks.ceph.ceph_manager.ceph:PG 5.15 is not active+clean 2024-09-17T01:33:00.749 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.263361+0000', 'last_change': '2024-09-17T01:32:54.263361+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.263361+0000', 'last_undegraded': '2024-09-17T01:32:54.263361+0000', 'last_fullsized': '2024-09-17T01:32:54.263361+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T01:33:00.749 INFO:tasks.ceph.ceph_manager.ceph:PG 5.12 is not active+clean 2024-09-17T01:33:00.749 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.250545+0000', 'last_change': '2024-09-17T01:32:54.250545+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.250545+0000', 'last_undegraded': '2024-09-17T01:32:54.250545+0000', 'last_fullsized': '2024-09-17T01:32:54.250545+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T01:33:00.750 INFO:tasks.ceph.ceph_manager.ceph:PG 5.13 is not active+clean 2024-09-17T01:33:00.750 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.254166+0000', 'last_change': '2024-09-17T01:32:54.254166+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.254166+0000', 'last_undegraded': '2024-09-17T01:32:54.254166+0000', 'last_fullsized': '2024-09-17T01:32:54.254166+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T01:33:00.750 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-09-17T01:33:00.750 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.266778+0000', 'last_change': '2024-09-17T01:32:54.266778+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.266778+0000', 'last_undegraded': '2024-09-17T01:32:54.266778+0000', 'last_fullsized': '2024-09-17T01:32:54.266778+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T01:33:00.750 INFO:tasks.ceph.ceph_manager.ceph:PG 5.e is not active+clean 2024-09-17T01:33:00.750 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.259011+0000', 'last_change': '2024-09-17T01:32:54.259011+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.259011+0000', 'last_undegraded': '2024-09-17T01:32:54.259011+0000', 'last_fullsized': '2024-09-17T01:32:54.259011+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T01:33:00.750 INFO:tasks.ceph.ceph_manager.ceph:PG 5.f is not active+clean 2024-09-17T01:33:00.750 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.249634+0000', 'last_change': '2024-09-17T01:32:54.249634+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.249634+0000', 'last_undegraded': '2024-09-17T01:32:54.249634+0000', 'last_fullsized': '2024-09-17T01:32:54.249634+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T01:33:00.750 INFO:tasks.ceph.ceph_manager.ceph:PG 5.d is not active+clean 2024-09-17T01:33:00.750 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.258513+0000', 'last_change': '2024-09-17T01:32:54.258513+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.258513+0000', 'last_undegraded': '2024-09-17T01:32:54.258513+0000', 'last_fullsized': '2024-09-17T01:32:54.258513+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T01:33:00.750 INFO:tasks.ceph.ceph_manager.ceph:PG 5.a is not active+clean 2024-09-17T01:33:00.751 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.249933+0000', 'last_change': '2024-09-17T01:32:54.249933+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.249933+0000', 'last_undegraded': '2024-09-17T01:32:54.249933+0000', 'last_fullsized': '2024-09-17T01:32:54.249933+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T01:33:00.751 INFO:tasks.ceph.ceph_manager.ceph:PG 5.8 is not active+clean 2024-09-17T01:33:00.751 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.248802+0000', 'last_change': '2024-09-17T01:32:54.248802+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.248802+0000', 'last_undegraded': '2024-09-17T01:32:54.248802+0000', 'last_fullsized': '2024-09-17T01:32:54.248802+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T01:33:00.751 INFO:tasks.ceph.ceph_manager.ceph:PG 5.9 is not active+clean 2024-09-17T01:33:00.751 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.250820+0000', 'last_change': '2024-09-17T01:32:54.250820+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.250820+0000', 'last_undegraded': '2024-09-17T01:32:54.250820+0000', 'last_fullsized': '2024-09-17T01:32:54.250820+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T01:33:00.751 INFO:tasks.ceph.ceph_manager.ceph:PG 5.6 is not active+clean 2024-09-17T01:33:00.751 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.257317+0000', 'last_change': '2024-09-17T01:32:54.257317+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.257317+0000', 'last_undegraded': '2024-09-17T01:32:54.257317+0000', 'last_fullsized': '2024-09-17T01:32:54.257317+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T01:33:00.751 INFO:tasks.ceph.ceph_manager.ceph:PG 5.7 is not active+clean 2024-09-17T01:33:00.751 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.263624+0000', 'last_change': '2024-09-17T01:32:54.263624+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.263624+0000', 'last_undegraded': '2024-09-17T01:32:54.263624+0000', 'last_fullsized': '2024-09-17T01:32:54.263624+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T01:33:00.751 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-09-17T01:33:00.751 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.253554+0000', 'last_change': '2024-09-17T01:32:54.253554+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.253554+0000', 'last_undegraded': '2024-09-17T01:32:54.253554+0000', 'last_fullsized': '2024-09-17T01:32:54.253554+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T01:33:00.752 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-09-17T01:33:00.752 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.253424+0000', 'last_change': '2024-09-17T01:32:54.253424+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.253424+0000', 'last_undegraded': '2024-09-17T01:32:54.253424+0000', 'last_fullsized': '2024-09-17T01:32:54.253424+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T01:33:00.752 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-09-17T01:33:00.752 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.250666+0000', 'last_change': '2024-09-17T01:32:54.250666+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.250666+0000', 'last_undegraded': '2024-09-17T01:32:54.250666+0000', 'last_fullsized': '2024-09-17T01:32:54.250666+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T01:33:00.752 INFO:tasks.ceph.ceph_manager.ceph:PG 5.0 is not active+clean 2024-09-17T01:33:00.752 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.256041+0000', 'last_change': '2024-09-17T01:32:54.256041+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.256041+0000', 'last_undegraded': '2024-09-17T01:32:54.256041+0000', 'last_fullsized': '2024-09-17T01:32:54.256041+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T01:33:00.752 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1 is not active+clean 2024-09-17T01:33:00.752 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.265033+0000', 'last_change': '2024-09-17T01:32:54.265033+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.265033+0000', 'last_undegraded': '2024-09-17T01:32:54.265033+0000', 'last_fullsized': '2024-09-17T01:32:54.265033+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T01:33:00.752 INFO:tasks.ceph.ceph_manager.ceph:PG 5.4 is not active+clean 2024-09-17T01:33:00.752 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:32:54.254823+0000', 'last_change': '2024-09-17T01:32:54.254823+0000', 'last_active': '2024-09-17T01:32:54.235595+0000', 'last_peered': '2024-09-17T01:32:54.235595+0000', 'last_clean': '2024-09-17T01:32:54.235595+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:32:54.254823+0000', 'last_undegraded': '2024-09-17T01:32:54.254823+0000', 'last_fullsized': '2024-09-17T01:32:54.254823+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'last_clean_scrub_stamp': '2024-09-17T01:32:54.235595+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T01:33:00.756 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:33:01.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.005+0000 7f510b800640 1 -- 172.21.15.42:0/3043893603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5104142f40 msgr2=0x7f5104072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:01.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.005+0000 7f510b800640 1 --2- 172.21.15.42:0/3043893603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5104142f40 0x7f5104072950 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f51040b3110 tx=0x7f50ec02a4d0 comp rx=0 tx=0).stop 2024-09-17T01:33:01.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.005+0000 7f510b800640 1 -- 172.21.15.42:0/3043893603 shutdown_connections 2024-09-17T01:33:01.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.005+0000 7f510b800640 1 --2- 172.21.15.42:0/3043893603 >> v2:172.21.15.43:3300/0 conn(0x7f5104072e90 0x7f51040cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:01.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.005+0000 7f510b800640 1 --2- 172.21.15.42:0/3043893603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5104142f40 0x7f5104072950 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:01.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.005+0000 7f510b800640 1 --2- 172.21.15.42:0/3043893603 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51040b3550 0x7f510415cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:01.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.005+0000 7f510b800640 1 -- 172.21.15.42:0/3043893603 >> 172.21.15.42:0/3043893603 conn(0x7f51040b2930 msgr2=0x7f510406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:33:01.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.005+0000 7f510b800640 1 -- 172.21.15.42:0/3043893603 shutdown_connections 2024-09-17T01:33:01.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.005+0000 7f510b800640 1 -- 172.21.15.42:0/3043893603 wait complete. 2024-09-17T01:33:01.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.007+0000 7f510b800640 1 Processor -- start 2024-09-17T01:33:01.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.008+0000 7f510b800640 1 -- start start 2024-09-17T01:33:01.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.009+0000 7f510b800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5104072e90 0x7f510413e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:01.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.009+0000 7f510b800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51040b3550 0x7f510406f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:01.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.009+0000 7f510b800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5104142f40 0x7f51040ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:01.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.009+0000 7f510b800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f510406d430 con 0x7f51040b3550 2024-09-17T01:33:01.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.009+0000 7f510b800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f51040cf4d0 con 0x7f5104142f40 2024-09-17T01:33:01.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.009+0000 7f510b800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f510406d5b0 con 0x7f5104072e90 2024-09-17T01:33:01.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.009+0000 7f50fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51040b3550 0x7f510406f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:01.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.009+0000 7f50fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51040b3550 0x7f510406f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48714/0 (socket says 172.21.15.42:48714) 2024-09-17T01:33:01.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.009+0000 7f50fbe00640 1 -- 172.21.15.42:0/3543950905 learned_addr learned my addr 172.21.15.42:0/3543950905 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:33:01.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.010+0000 7f5109800640 1 --2- 172.21.15.42:0/3543950905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5104142f40 0x7f51040ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:01.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.010+0000 7f5108e00640 1 --2- 172.21.15.42:0/3543950905 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5104072e90 0x7f510413e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:01.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.010+0000 7f50fbe00640 1 -- 172.21.15.42:0/3543950905 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5104072e90 msgr2=0x7f510413e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:01.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.010+0000 7f50fbe00640 1 --2- 172.21.15.42:0/3543950905 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5104072e90 0x7f510413e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:01.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.010+0000 7f50fbe00640 1 -- 172.21.15.42:0/3543950905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5104142f40 msgr2=0x7f51040ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:01.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.010+0000 7f50fbe00640 1 --2- 172.21.15.42:0/3543950905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5104142f40 0x7f51040ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:01.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.010+0000 7f50fbe00640 1 -- 172.21.15.42:0/3543950905 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51041fa1d0 con 0x7f51040b3550 2024-09-17T01:33:01.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.010+0000 7f5108e00640 1 --2- 172.21.15.42:0/3543950905 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5104072e90 0x7f510413e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:33:01.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.010+0000 7f50fbe00640 1 --2- 172.21.15.42:0/3543950905 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51040b3550 0x7f510406f200 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f50ec034040 tx=0x7f50ec003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:33:01.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.010+0000 7f5101600640 1 -- 172.21.15.42:0/3543950905 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ec03e030 con 0x7f51040b3550 2024-09-17T01:33:01.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.011+0000 7f5101600640 1 -- 172.21.15.42:0/3543950905 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50ec003e00 con 0x7f51040b3550 2024-09-17T01:33:01.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.011+0000 7f510b800640 1 -- 172.21.15.42:0/3543950905 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51041f9ef0 con 0x7f51040b3550 2024-09-17T01:33:01.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.011+0000 7f5101600640 1 -- 172.21.15.42:0/3543950905 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ec035040 con 0x7f51040b3550 2024-09-17T01:33:01.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.011+0000 7f510b800640 1 -- 172.21.15.42:0/3543950905 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51041f61d0 con 0x7f51040b3550 2024-09-17T01:33:01.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.012+0000 7f510b800640 1 -- 172.21.15.42:0/3543950905 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f510406da60 con 0x7f51040b3550 2024-09-17T01:33:01.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.013+0000 7f5101600640 1 -- 172.21.15.42:0/3543950905 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f50ec041030 con 0x7f51040b3550 2024-09-17T01:33:01.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.014+0000 7f5101600640 1 --2- 172.21.15.42:0/3543950905 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f50e0078b90 0x7f50e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:01.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.014+0000 7f5101600640 1 -- 172.21.15.42:0/3543950905 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f50ec0bb5a0 con 0x7f51040b3550 2024-09-17T01:33:01.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.014+0000 7f5108e00640 1 --2- 172.21.15.42:0/3543950905 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f50e0078b90 0x7f50e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:01.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.015+0000 7f5108e00640 1 --2- 172.21.15.42:0/3543950905 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f50e0078b90 0x7f50e007b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f50f4005fd0 tx=0x7f50f4005cf0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:33:01.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.018+0000 7f5101600640 1 -- 172.21.15.42:0/3543950905 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f50ec0839d0 con 0x7f51040b3550 2024-09-17T01:33:01.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.283+0000 7f510b800640 1 -- 172.21.15.42:0/3543950905 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f510406a170 con 0x7f51040b3550 2024-09-17T01:33:01.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.283+0000 7f5101600640 1 -- 172.21.15.42:0/3543950905 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1687 (secure 0 0 0) 0x7f50ec0832d0 con 0x7f51040b3550 2024-09-17T01:33:01.281 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:33:01.281 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":81,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":33,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":49},{"state_name":"creating+peering","count":48}],"num_pgs":97,"num_pools":3,"num_objects":7,"data_bytes":590402,"bytes_used":259428352,"bytes_avail":772834684928,"bytes_total":773094113280,"inactive_pgs_ratio":0.49484536051750183,"write_bytes_sec":1246,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":17,"btime":"2024-09-17T01:32:58:269267+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4830}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-17T01:32:56.988078+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:33:01.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.285+0000 7f510b800640 1 -- 172.21.15.42:0/3543950905 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f50e0078b90 msgr2=0x7f50e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:01.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.285+0000 7f510b800640 1 --2- 172.21.15.42:0/3543950905 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f50e0078b90 0x7f50e007b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f50f4005fd0 tx=0x7f50f4005cf0 comp rx=0 tx=0).stop 2024-09-17T01:33:01.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.285+0000 7f510b800640 1 -- 172.21.15.42:0/3543950905 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51040b3550 msgr2=0x7f510406f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:01.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.285+0000 7f510b800640 1 --2- 172.21.15.42:0/3543950905 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51040b3550 0x7f510406f200 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f50ec034040 tx=0x7f50ec003910 comp rx=0 tx=0).stop 2024-09-17T01:33:01.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.286+0000 7f510b800640 1 -- 172.21.15.42:0/3543950905 shutdown_connections 2024-09-17T01:33:01.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.286+0000 7f510b800640 1 --2- 172.21.15.42:0/3543950905 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f50e0078b90 0x7f50e007b0a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:01.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.286+0000 7f510b800640 1 --2- 172.21.15.42:0/3543950905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5104142f40 0x7f51040ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:01.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.286+0000 7f510b800640 1 --2- 172.21.15.42:0/3543950905 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51040b3550 0x7f510406f200 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:01.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.286+0000 7f510b800640 1 --2- 172.21.15.42:0/3543950905 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5104072e90 0x7f510413e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:01.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.286+0000 7f510b800640 1 -- 172.21.15.42:0/3543950905 >> 172.21.15.42:0/3543950905 conn(0x7f51040b2930 msgr2=0x7f510415e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:33:01.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.286+0000 7f510b800640 1 -- 172.21.15.42:0/3543950905 shutdown_connections 2024-09-17T01:33:01.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.286+0000 7f510b800640 1 -- 172.21.15.42:0/3543950905 wait complete. 2024-09-17T01:33:01.306 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T01:33:01.306 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:33:01.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.534+0000 7f679c800640 1 -- 172.21.15.42:0/3098020378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67940b3550 msgr2=0x7f679415cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:01.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.534+0000 7f679c800640 1 --2- 172.21.15.42:0/3098020378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67940b3550 0x7f679415cec0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6788005fd0 tx=0x7f678802a540 comp rx=0 tx=0).stop 2024-09-17T01:33:01.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.535+0000 7f679c800640 1 -- 172.21.15.42:0/3098020378 shutdown_connections 2024-09-17T01:33:01.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.535+0000 7f679c800640 1 --2- 172.21.15.42:0/3098020378 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f67940cec40 0x7f67940cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:01.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.535+0000 7f679c800640 1 --2- 172.21.15.42:0/3098020378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67940b3550 0x7f679415cec0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:01.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.535+0000 7f679c800640 1 -- 172.21.15.42:0/3098020378 >> 172.21.15.42:0/3098020378 conn(0x7f67940b2930 msgr2=0x7f679406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:33:01.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.535+0000 7f679c800640 1 -- 172.21.15.42:0/3098020378 shutdown_connections 2024-09-17T01:33:01.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.535+0000 7f679c800640 1 -- 172.21.15.42:0/3098020378 wait complete. 2024-09-17T01:33:01.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.537+0000 7f679c800640 1 Processor -- start 2024-09-17T01:33:01.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.537+0000 7f679c800640 1 -- start start 2024-09-17T01:33:01.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.538+0000 7f679c800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67940b3550 0x7f679414eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:01.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.538+0000 7f679c800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f67940cec40 0x7f67941e7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:01.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.538+0000 7f679c800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6794142f40 0x7f67941e7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:01.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.538+0000 7f679c800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f679406d7c0 con 0x7f67940b3550 2024-09-17T01:33:01.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.538+0000 7f679c800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f679406d640 con 0x7f6794142f40 2024-09-17T01:33:01.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.538+0000 7f679c800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f679406d940 con 0x7f67940cec40 2024-09-17T01:33:01.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.539+0000 7f6799e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67940b3550 0x7f679414eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:01.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.539+0000 7f6799e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67940b3550 0x7f679414eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48720/0 (socket says 172.21.15.42:48720) 2024-09-17T01:33:01.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.539+0000 7f6799e00640 1 -- 172.21.15.42:0/707414203 learned_addr learned my addr 172.21.15.42:0/707414203 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:33:01.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.539+0000 7f6799400640 1 --2- 172.21.15.42:0/707414203 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f67940cec40 0x7f67941e7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:01.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.539+0000 7f679a800640 1 --2- 172.21.15.42:0/707414203 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6794142f40 0x7f67941e7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:01.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.539+0000 7f6799e00640 1 -- 172.21.15.42:0/707414203 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f67940cec40 msgr2=0x7f67941e7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:01.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.539+0000 7f6799e00640 1 --2- 172.21.15.42:0/707414203 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f67940cec40 0x7f67941e7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:01.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.539+0000 7f6799e00640 1 -- 172.21.15.42:0/707414203 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6794142f40 msgr2=0x7f67941e7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:01.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.539+0000 7f6799e00640 1 --2- 172.21.15.42:0/707414203 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6794142f40 0x7f67941e7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:01.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.539+0000 7f6799e00640 1 -- 172.21.15.42:0/707414203 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679413f510 con 0x7f67940b3550 2024-09-17T01:33:01.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.539+0000 7f6799e00640 1 --2- 172.21.15.42:0/707414203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67940b3550 0x7f679414eb20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6788000c00 tx=0x7f6788003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:33:01.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.540+0000 7f678e000640 1 -- 172.21.15.42:0/707414203 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678803e030 con 0x7f67940b3550 2024-09-17T01:33:01.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.540+0000 7f678e000640 1 -- 172.21.15.42:0/707414203 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6788003e00 con 0x7f67940b3550 2024-09-17T01:33:01.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.540+0000 7f678e000640 1 -- 172.21.15.42:0/707414203 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788035040 con 0x7f67940b3550 2024-09-17T01:33:01.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.540+0000 7f679c800640 1 -- 172.21.15.42:0/707414203 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f679413f780 con 0x7f67940b3550 2024-09-17T01:33:01.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.540+0000 7f679c800640 1 -- 172.21.15.42:0/707414203 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f679413fd40 con 0x7f67940b3550 2024-09-17T01:33:01.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.541+0000 7f679c800640 1 -- 172.21.15.42:0/707414203 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f679415cec0 con 0x7f67940b3550 2024-09-17T01:33:01.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.542+0000 7f678e000640 1 -- 172.21.15.42:0/707414203 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6788041030 con 0x7f67940b3550 2024-09-17T01:33:01.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.543+0000 7f678e000640 1 --2- 172.21.15.42:0/707414203 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6778078bc0 0x7f677807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:01.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.543+0000 7f678e000640 1 -- 172.21.15.42:0/707414203 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f67880bb460 con 0x7f67940b3550 2024-09-17T01:33:01.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.544+0000 7f6799400640 1 --2- 172.21.15.42:0/707414203 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6778078bc0 0x7f677807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:01.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.545+0000 7f6799400640 1 --2- 172.21.15.42:0/707414203 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6778078bc0 0x7f677807b0d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f67940cce40 tx=0x7f6784009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:33:01.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.548+0000 7f678e000640 1 -- 172.21.15.42:0/707414203 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6788083250 con 0x7f67940b3550 2024-09-17T01:33:01.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.737+0000 7f679c800640 1 -- 172.21.15.42:0/707414203 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f679406a170 con 0x7f6778078bc0 2024-09-17T01:33:01.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.743+0000 7f678e000640 1 -- 172.21.15.42:0/707414203 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251944 (secure 0 0 0) 0x7f679406a170 con 0x7f6778078bc0 2024-09-17T01:33:01.744 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:33:01.745 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:33:01.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.747+0000 7f679c800640 1 -- 172.21.15.42:0/707414203 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6778078bc0 msgr2=0x7f677807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:01.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.747+0000 7f679c800640 1 --2- 172.21.15.42:0/707414203 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6778078bc0 0x7f677807b0d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f67940cce40 tx=0x7f6784009040 comp rx=0 tx=0).stop 2024-09-17T01:33:01.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.747+0000 7f679c800640 1 -- 172.21.15.42:0/707414203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67940b3550 msgr2=0x7f679414eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:01.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.747+0000 7f679c800640 1 --2- 172.21.15.42:0/707414203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67940b3550 0x7f679414eb20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6788000c00 tx=0x7f6788003910 comp rx=0 tx=0).stop 2024-09-17T01:33:01.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.747+0000 7f679c800640 1 -- 172.21.15.42:0/707414203 shutdown_connections 2024-09-17T01:33:01.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.747+0000 7f679c800640 1 --2- 172.21.15.42:0/707414203 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6778078bc0 0x7f677807b0d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:01.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.747+0000 7f679c800640 1 --2- 172.21.15.42:0/707414203 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6794142f40 0x7f67941e7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:01.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.747+0000 7f679c800640 1 --2- 172.21.15.42:0/707414203 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f67940cec40 0x7f67941e7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:01.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.747+0000 7f679c800640 1 --2- 172.21.15.42:0/707414203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67940b3550 0x7f679414eb20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:01.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.747+0000 7f679c800640 1 -- 172.21.15.42:0/707414203 >> 172.21.15.42:0/707414203 conn(0x7f67940b2930 msgr2=0x7f679415ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:33:01.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.748+0000 7f679c800640 1 -- 172.21.15.42:0/707414203 shutdown_connections 2024-09-17T01:33:01.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:01.748+0000 7f679c800640 1 -- 172.21.15.42:0/707414203 wait complete. 2024-09-17T01:33:01.766 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-09-17T01:33:00.988921+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253580,"kb_used_data":4072,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721140,"statfs":{"total":773094113280,"available":772834447360,"internally_reserved":0,"allocated":4169728,"data_stored":2306236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.743346"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083235+0000","last_change":"2024-09-17T01:32:55.281409+0000","last_active":"2024-09-17T01:32:57.083235+0000","last_peered":"2024-09-17T01:32:57.083235+0000","last_clean":"2024-09-17T01:32:57.083235+0000","last_became_active":"2024-09-17T01:32:55.277989+0000","last_became_peered":"2024-09-17T01:32:55.277989+0000","last_unstale":"2024-09-17T01:32:57.083235+0000","last_undegraded":"2024-09-17T01:32:57.083235+0000","last_fullsized":"2024-09-17T01:32:57.083235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:41.218963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269483+0000","last_change":"2024-09-17T01:32:55.286374+0000","last_active":"2024-09-17T01:32:56.269483+0000","last_peered":"2024-09-17T01:32:56.269483+0000","last_clean":"2024-09-17T01:32:56.269483+0000","last_became_active":"2024-09-17T01:32:55.282079+0000","last_became_peered":"2024-09-17T01:32:55.282079+0000","last_unstale":"2024-09-17T01:32:56.269483+0000","last_undegraded":"2024-09-17T01:32:56.269483+0000","last_fullsized":"2024-09-17T01:32:56.269483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:37.917841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083909+0000","last_change":"2024-09-17T01:32:55.278863+0000","last_active":"2024-09-17T01:32:57.083909+0000","last_peered":"2024-09-17T01:32:57.083909+0000","last_clean":"2024-09-17T01:32:57.083909+0000","last_became_active":"2024-09-17T01:32:55.278547+0000","last_became_peered":"2024-09-17T01:32:55.278547+0000","last_unstale":"2024-09-17T01:32:57.083909+0000","last_undegraded":"2024-09-17T01:32:57.083909+0000","last_fullsized":"2024-09-17T01:32:57.083909+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:00.235280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.253739+0000","last_change":"2024-09-17T01:32:55.281473+0000","last_active":"2024-09-17T01:32:56.253739+0000","last_peered":"2024-09-17T01:32:56.253739+0000","last_clean":"2024-09-17T01:32:56.253739+0000","last_became_active":"2024-09-17T01:32:55.280737+0000","last_became_peered":"2024-09-17T01:32:55.280737+0000","last_unstale":"2024-09-17T01:32:56.253739+0000","last_undegraded":"2024-09-17T01:32:56.253739+0000","last_fullsized":"2024-09-17T01:32:56.253739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:59.908587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269043+0000","last_change":"2024-09-17T01:32:55.282329+0000","last_active":"2024-09-17T01:32:56.269043+0000","last_peered":"2024-09-17T01:32:56.269043+0000","last_clean":"2024-09-17T01:32:56.269043+0000","last_became_active":"2024-09-17T01:32:55.281587+0000","last_became_peered":"2024-09-17T01:32:55.281587+0000","last_unstale":"2024-09-17T01:32:56.269043+0000","last_undegraded":"2024-09-17T01:32:56.269043+0000","last_fullsized":"2024-09-17T01:32:56.269043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:38:26.720551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.272508+0000","last_change":"2024-09-17T01:32:55.278299+0000","last_active":"2024-09-17T01:32:56.272508+0000","last_peered":"2024-09-17T01:32:56.272508+0000","last_clean":"2024-09-17T01:32:56.272508+0000","last_became_active":"2024-09-17T01:32:55.277972+0000","last_became_peered":"2024-09-17T01:32:55.277972+0000","last_unstale":"2024-09-17T01:32:56.272508+0000","last_undegraded":"2024-09-17T01:32:56.272508+0000","last_fullsized":"2024-09-17T01:32:56.272508+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:28.740562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.081780+0000","last_change":"2024-09-17T01:32:55.278314+0000","last_active":"2024-09-17T01:32:57.081780+0000","last_peered":"2024-09-17T01:32:57.081780+0000","last_clean":"2024-09-17T01:32:57.081780+0000","last_became_active":"2024-09-17T01:32:55.277821+0000","last_became_peered":"2024-09-17T01:32:55.277821+0000","last_unstale":"2024-09-17T01:32:57.081780+0000","last_undegraded":"2024-09-17T01:32:57.081780+0000","last_fullsized":"2024-09-17T01:32:57.081780+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:19.370029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082588+0000","last_change":"2024-09-17T01:32:55.284414+0000","last_active":"2024-09-17T01:32:57.082588+0000","last_peered":"2024-09-17T01:32:57.082588+0000","last_clean":"2024-09-17T01:32:57.082588+0000","last_became_active":"2024-09-17T01:32:55.284204+0000","last_became_peered":"2024-09-17T01:32:55.284204+0000","last_unstale":"2024-09-17T01:32:57.082588+0000","last_undegraded":"2024-09-17T01:32:57.082588+0000","last_fullsized":"2024-09-17T01:32:57.082588+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:58.344490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083734+0000","last_change":"2024-09-17T01:32:55.286855+0000","last_active":"2024-09-17T01:32:57.083734+0000","last_peered":"2024-09-17T01:32:57.083734+0000","last_clean":"2024-09-17T01:32:57.083734+0000","last_became_active":"2024-09-17T01:32:55.286507+0000","last_became_peered":"2024-09-17T01:32:55.286507+0000","last_unstale":"2024-09-17T01:32:57.083734+0000","last_undegraded":"2024-09-17T01:32:57.083734+0000","last_fullsized":"2024-09-17T01:32:57.083734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:20.050967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254349+0000","last_change":"2024-09-17T01:32:55.278573+0000","last_active":"2024-09-17T01:32:56.254349+0000","last_peered":"2024-09-17T01:32:56.254349+0000","last_clean":"2024-09-17T01:32:56.254349+0000","last_became_active":"2024-09-17T01:32:55.277176+0000","last_became_peered":"2024-09-17T01:32:55.277176+0000","last_unstale":"2024-09-17T01:32:56.254349+0000","last_undegraded":"2024-09-17T01:32:56.254349+0000","last_fullsized":"2024-09-17T01:32:56.254349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:56.021140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.251654+0000","last_change":"2024-09-17T01:32:55.272949+0000","last_active":"2024-09-17T01:32:56.251654+0000","last_peered":"2024-09-17T01:32:56.251654+0000","last_clean":"2024-09-17T01:32:56.251654+0000","last_became_active":"2024-09-17T01:32:55.271731+0000","last_became_peered":"2024-09-17T01:32:55.271731+0000","last_unstale":"2024-09-17T01:32:56.251654+0000","last_undegraded":"2024-09-17T01:32:56.251654+0000","last_fullsized":"2024-09-17T01:32:56.251654+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:25.975979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083294+0000","last_change":"2024-09-17T01:32:55.267654+0000","last_active":"2024-09-17T01:32:57.083294+0000","last_peered":"2024-09-17T01:32:57.083294+0000","last_clean":"2024-09-17T01:32:57.083294+0000","last_became_active":"2024-09-17T01:32:55.267347+0000","last_became_peered":"2024-09-17T01:32:55.267347+0000","last_unstale":"2024-09-17T01:32:57.083294+0000","last_undegraded":"2024-09-17T01:32:57.083294+0000","last_fullsized":"2024-09-17T01:32:57.083294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:55.546679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254838+0000","last_change":"2024-09-17T01:32:55.284646+0000","last_active":"2024-09-17T01:32:56.254838+0000","last_peered":"2024-09-17T01:32:56.254838+0000","last_clean":"2024-09-17T01:32:56.254838+0000","last_became_active":"2024-09-17T01:32:55.284369+0000","last_became_peered":"2024-09-17T01:32:55.284369+0000","last_unstale":"2024-09-17T01:32:56.254838+0000","last_undegraded":"2024-09-17T01:32:56.254838+0000","last_fullsized":"2024-09-17T01:32:56.254838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:50.201340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.253300+0000","last_change":"2024-09-17T01:32:55.274253+0000","last_active":"2024-09-17T01:32:56.253300+0000","last_peered":"2024-09-17T01:32:56.253300+0000","last_clean":"2024-09-17T01:32:56.253300+0000","last_became_active":"2024-09-17T01:32:55.273796+0000","last_became_peered":"2024-09-17T01:32:55.273796+0000","last_unstale":"2024-09-17T01:32:56.253300+0000","last_undegraded":"2024-09-17T01:32:56.253300+0000","last_fullsized":"2024-09-17T01:32:56.253300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:36:02.889869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.081711+0000","last_change":"2024-09-17T01:32:55.280963+0000","last_active":"2024-09-17T01:32:57.081711+0000","last_peered":"2024-09-17T01:32:57.081711+0000","last_clean":"2024-09-17T01:32:57.081711+0000","last_became_active":"2024-09-17T01:32:55.280644+0000","last_became_peered":"2024-09-17T01:32:55.280644+0000","last_unstale":"2024-09-17T01:32:57.081711+0000","last_undegraded":"2024-09-17T01:32:57.081711+0000","last_fullsized":"2024-09-17T01:32:57.081711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:50.201340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082576+0000","last_change":"2024-09-17T01:32:55.271372+0000","last_active":"2024-09-17T01:32:57.082576+0000","last_peered":"2024-09-17T01:32:57.082576+0000","last_clean":"2024-09-17T01:32:57.082576+0000","last_became_active":"2024-09-17T01:32:55.271050+0000","last_became_peered":"2024-09-17T01:32:55.271050+0000","last_unstale":"2024-09-17T01:32:57.082576+0000","last_undegraded":"2024-09-17T01:32:57.082576+0000","last_fullsized":"2024-09-17T01:32:57.082576+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:44.805529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.252014+0000","last_change":"2024-09-17T01:32:55.284437+0000","last_active":"2024-09-17T01:32:56.252014+0000","last_peered":"2024-09-17T01:32:56.252014+0000","last_clean":"2024-09-17T01:32:56.252014+0000","last_became_active":"2024-09-17T01:32:55.284104+0000","last_became_peered":"2024-09-17T01:32:55.284104+0000","last_unstale":"2024-09-17T01:32:56.252014+0000","last_undegraded":"2024-09-17T01:32:56.252014+0000","last_fullsized":"2024-09-17T01:32:56.252014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:39.864745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.272375+0000","last_change":"2024-09-17T01:32:55.277229+0000","last_active":"2024-09-17T01:32:56.272375+0000","last_peered":"2024-09-17T01:32:56.272375+0000","last_clean":"2024-09-17T01:32:56.272375+0000","last_became_active":"2024-09-17T01:32:55.276726+0000","last_became_peered":"2024-09-17T01:32:55.276726+0000","last_unstale":"2024-09-17T01:32:56.272375+0000","last_undegraded":"2024-09-17T01:32:56.272375+0000","last_fullsized":"2024-09-17T01:32:56.272375+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:45:00.782429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.272227+0000","last_change":"2024-09-17T01:32:55.271370+0000","last_active":"2024-09-17T01:32:56.272227+0000","last_peered":"2024-09-17T01:32:56.272227+0000","last_clean":"2024-09-17T01:32:56.272227+0000","last_became_active":"2024-09-17T01:32:55.269831+0000","last_became_peered":"2024-09-17T01:32:55.269831+0000","last_unstale":"2024-09-17T01:32:56.272227+0000","last_undegraded":"2024-09-17T01:32:56.272227+0000","last_fullsized":"2024-09-17T01:32:56.272227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:57.955582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254108+0000","last_change":"2024-09-17T01:32:55.271965+0000","last_active":"2024-09-17T01:32:56.254108+0000","last_peered":"2024-09-17T01:32:56.254108+0000","last_clean":"2024-09-17T01:32:56.254108+0000","last_became_active":"2024-09-17T01:32:55.271388+0000","last_became_peered":"2024-09-17T01:32:55.271388+0000","last_unstale":"2024-09-17T01:32:56.254108+0000","last_undegraded":"2024-09-17T01:32:56.254108+0000","last_fullsized":"2024-09-17T01:32:56.254108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:38.617789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082146+0000","last_change":"2024-09-17T01:32:55.267860+0000","last_active":"2024-09-17T01:32:57.082146+0000","last_peered":"2024-09-17T01:32:57.082146+0000","last_clean":"2024-09-17T01:32:57.082146+0000","last_became_active":"2024-09-17T01:32:55.267651+0000","last_became_peered":"2024-09-17T01:32:55.267651+0000","last_unstale":"2024-09-17T01:32:57.082146+0000","last_undegraded":"2024-09-17T01:32:57.082146+0000","last_fullsized":"2024-09-17T01:32:57.082146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:10.089599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082616+0000","last_change":"2024-09-17T01:32:55.283222+0000","last_active":"2024-09-17T01:32:57.082616+0000","last_peered":"2024-09-17T01:32:57.082616+0000","last_clean":"2024-09-17T01:32:57.082616+0000","last_became_active":"2024-09-17T01:32:55.282841+0000","last_became_peered":"2024-09-17T01:32:55.282841+0000","last_unstale":"2024-09-17T01:32:57.082616+0000","last_undegraded":"2024-09-17T01:32:57.082616+0000","last_fullsized":"2024-09-17T01:32:57.082616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:58.411166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.252402+0000","last_change":"2024-09-17T01:32:55.276032+0000","last_active":"2024-09-17T01:32:56.252402+0000","last_peered":"2024-09-17T01:32:56.252402+0000","last_clean":"2024-09-17T01:32:56.252402+0000","last_became_active":"2024-09-17T01:32:55.275595+0000","last_became_peered":"2024-09-17T01:32:55.275595+0000","last_unstale":"2024-09-17T01:32:56.252402+0000","last_undegraded":"2024-09-17T01:32:56.252402+0000","last_fullsized":"2024-09-17T01:32:56.252402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:24.265399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.081625+0000","last_change":"2024-09-17T01:32:55.281293+0000","last_active":"2024-09-17T01:32:57.081625+0000","last_peered":"2024-09-17T01:32:57.081625+0000","last_clean":"2024-09-17T01:32:57.081625+0000","last_became_active":"2024-09-17T01:32:55.280932+0000","last_became_peered":"2024-09-17T01:32:55.280932+0000","last_unstale":"2024-09-17T01:32:57.081625+0000","last_undegraded":"2024-09-17T01:32:57.081625+0000","last_fullsized":"2024-09-17T01:32:57.081625+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:06.688211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254172+0000","last_change":"2024-09-17T01:32:55.270509+0000","last_active":"2024-09-17T01:32:56.254172+0000","last_peered":"2024-09-17T01:32:56.254172+0000","last_clean":"2024-09-17T01:32:56.254172+0000","last_became_active":"2024-09-17T01:32:55.270137+0000","last_became_peered":"2024-09-17T01:32:55.270137+0000","last_unstale":"2024-09-17T01:32:56.254172+0000","last_undegraded":"2024-09-17T01:32:56.254172+0000","last_fullsized":"2024-09-17T01:32:56.254172+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:56.911430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.253986+0000","last_change":"2024-09-17T01:32:55.277658+0000","last_active":"2024-09-17T01:32:56.253986+0000","last_peered":"2024-09-17T01:32:56.253986+0000","last_clean":"2024-09-17T01:32:56.253986+0000","last_became_active":"2024-09-17T01:32:55.277194+0000","last_became_peered":"2024-09-17T01:32:55.277194+0000","last_unstale":"2024-09-17T01:32:56.253986+0000","last_undegraded":"2024-09-17T01:32:56.253986+0000","last_fullsized":"2024-09-17T01:32:56.253986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:54.104314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269159+0000","last_change":"2024-09-17T01:32:55.258825+0000","last_active":"2024-09-17T01:32:56.269159+0000","last_peered":"2024-09-17T01:32:56.269159+0000","last_clean":"2024-09-17T01:32:56.269159+0000","last_became_active":"2024-09-17T01:32:55.258420+0000","last_became_peered":"2024-09-17T01:32:55.258420+0000","last_unstale":"2024-09-17T01:32:56.269159+0000","last_undegraded":"2024-09-17T01:32:56.269159+0000","last_fullsized":"2024-09-17T01:32:56.269159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:07.739522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083210+0000","last_change":"2024-09-17T01:32:55.279814+0000","last_active":"2024-09-17T01:32:57.083210+0000","last_peered":"2024-09-17T01:32:57.083210+0000","last_clean":"2024-09-17T01:32:57.083210+0000","last_became_active":"2024-09-17T01:32:55.278739+0000","last_became_peered":"2024-09-17T01:32:55.278739+0000","last_unstale":"2024-09-17T01:32:57.083210+0000","last_undegraded":"2024-09-17T01:32:57.083210+0000","last_fullsized":"2024-09-17T01:32:57.083210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:59.516912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.081697+0000","last_change":"2024-09-17T01:32:55.275915+0000","last_active":"2024-09-17T01:32:57.081697+0000","last_peered":"2024-09-17T01:32:57.081697+0000","last_clean":"2024-09-17T01:32:57.081697+0000","last_became_active":"2024-09-17T01:32:55.275543+0000","last_became_peered":"2024-09-17T01:32:55.275543+0000","last_unstale":"2024-09-17T01:32:57.081697+0000","last_undegraded":"2024-09-17T01:32:57.081697+0000","last_fullsized":"2024-09-17T01:32:57.081697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:06.603944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082048+0000","last_change":"2024-09-17T01:32:55.263275+0000","last_active":"2024-09-17T01:32:57.082048+0000","last_peered":"2024-09-17T01:32:57.082048+0000","last_clean":"2024-09-17T01:32:57.082048+0000","last_became_active":"2024-09-17T01:32:55.262913+0000","last_became_peered":"2024-09-17T01:32:55.262913+0000","last_unstale":"2024-09-17T01:32:57.082048+0000","last_undegraded":"2024-09-17T01:32:57.082048+0000","last_fullsized":"2024-09-17T01:32:57.082048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:45:49.776470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082034+0000","last_change":"2024-09-17T01:32:55.278268+0000","last_active":"2024-09-17T01:32:57.082034+0000","last_peered":"2024-09-17T01:32:57.082034+0000","last_clean":"2024-09-17T01:32:57.082034+0000","last_became_active":"2024-09-17T01:32:55.277398+0000","last_became_peered":"2024-09-17T01:32:55.277398+0000","last_unstale":"2024-09-17T01:32:57.082034+0000","last_undegraded":"2024-09-17T01:32:57.082034+0000","last_fullsized":"2024-09-17T01:32:57.082034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:16.837875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.250854+0000","last_change":"2024-09-17T01:32:55.279618+0000","last_active":"2024-09-17T01:32:56.250854+0000","last_peered":"2024-09-17T01:32:56.250854+0000","last_clean":"2024-09-17T01:32:56.250854+0000","last_became_active":"2024-09-17T01:32:55.279251+0000","last_became_peered":"2024-09-17T01:32:55.279251+0000","last_unstale":"2024-09-17T01:32:56.250854+0000","last_undegraded":"2024-09-17T01:32:56.250854+0000","last_fullsized":"2024-09-17T01:32:56.250854+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:16.980206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254844+0000","last_change":"2024-09-17T01:32:55.282016+0000","last_active":"2024-09-17T01:32:56.254844+0000","last_peered":"2024-09-17T01:32:56.254844+0000","last_clean":"2024-09-17T01:32:56.254844+0000","last_became_active":"2024-09-17T01:32:55.281337+0000","last_became_peered":"2024-09-17T01:32:55.281337+0000","last_unstale":"2024-09-17T01:32:56.254844+0000","last_undegraded":"2024-09-17T01:32:56.254844+0000","last_fullsized":"2024-09-17T01:32:56.254844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:39:51.377597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.252116+0000","last_change":"2024-09-17T01:32:54.273748+0000","last_active":"2024-09-17T01:32:56.252116+0000","last_peered":"2024-09-17T01:32:56.252116+0000","last_clean":"2024-09-17T01:32:56.252116+0000","last_became_active":"2024-09-17T01:32:54.273437+0000","last_became_peered":"2024-09-17T01:32:54.273437+0000","last_unstale":"2024-09-17T01:32:56.252116+0000","last_undegraded":"2024-09-17T01:32:56.252116+0000","last_fullsized":"2024-09-17T01:32:56.252116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:52.612630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083372+0000","last_change":"2024-09-17T01:32:55.276719+0000","last_active":"2024-09-17T01:32:57.083372+0000","last_peered":"2024-09-17T01:32:57.083372+0000","last_clean":"2024-09-17T01:32:57.083372+0000","last_became_active":"2024-09-17T01:32:55.276410+0000","last_became_peered":"2024-09-17T01:32:55.276410+0000","last_unstale":"2024-09-17T01:32:57.083372+0000","last_undegraded":"2024-09-17T01:32:57.083372+0000","last_fullsized":"2024-09-17T01:32:57.083372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:05.011121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254223+0000","last_change":"2024-09-17T01:32:54.270531+0000","last_active":"2024-09-17T01:32:56.254223+0000","last_peered":"2024-09-17T01:32:56.254223+0000","last_clean":"2024-09-17T01:32:56.254223+0000","last_became_active":"2024-09-17T01:32:54.270161+0000","last_became_peered":"2024-09-17T01:32:54.270161+0000","last_unstale":"2024-09-17T01:32:56.254223+0000","last_undegraded":"2024-09-17T01:32:56.254223+0000","last_fullsized":"2024-09-17T01:32:56.254223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:34.037700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083440+0000","last_change":"2024-09-17T01:32:55.283488+0000","last_active":"2024-09-17T01:32:57.083440+0000","last_peered":"2024-09-17T01:32:57.083440+0000","last_clean":"2024-09-17T01:32:57.083440+0000","last_became_active":"2024-09-17T01:32:55.283023+0000","last_became_peered":"2024-09-17T01:32:55.283023+0000","last_unstale":"2024-09-17T01:32:57.083440+0000","last_undegraded":"2024-09-17T01:32:57.083440+0000","last_fullsized":"2024-09-17T01:32:57.083440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:02.481456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.272566+0000","last_change":"2024-09-17T01:32:54.276942+0000","last_active":"2024-09-17T01:32:56.272566+0000","last_peered":"2024-09-17T01:32:56.272566+0000","last_clean":"2024-09-17T01:32:56.272566+0000","last_became_active":"2024-09-17T01:32:54.275355+0000","last_became_peered":"2024-09-17T01:32:54.275355+0000","last_unstale":"2024-09-17T01:32:56.272566+0000","last_undegraded":"2024-09-17T01:32:56.272566+0000","last_fullsized":"2024-09-17T01:32:56.272566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:40.343262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254319+0000","last_change":"2024-09-17T01:32:55.285200+0000","last_active":"2024-09-17T01:32:56.254319+0000","last_peered":"2024-09-17T01:32:56.254319+0000","last_clean":"2024-09-17T01:32:56.254319+0000","last_became_active":"2024-09-17T01:32:55.284886+0000","last_became_peered":"2024-09-17T01:32:55.284886+0000","last_unstale":"2024-09-17T01:32:56.254319+0000","last_undegraded":"2024-09-17T01:32:56.254319+0000","last_fullsized":"2024-09-17T01:32:56.254319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:44.470345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254156+0000","last_change":"2024-09-17T01:32:54.262112+0000","last_active":"2024-09-17T01:32:56.254156+0000","last_peered":"2024-09-17T01:32:56.254156+0000","last_clean":"2024-09-17T01:32:56.254156+0000","last_became_active":"2024-09-17T01:32:54.261706+0000","last_became_peered":"2024-09-17T01:32:54.261706+0000","last_unstale":"2024-09-17T01:32:56.254156+0000","last_undegraded":"2024-09-17T01:32:56.254156+0000","last_fullsized":"2024-09-17T01:32:56.254156+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:47.082248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082930+0000","last_change":"2024-09-17T01:32:55.270615+0000","last_active":"2024-09-17T01:32:57.082930+0000","last_peered":"2024-09-17T01:32:57.082930+0000","last_clean":"2024-09-17T01:32:57.082930+0000","last_became_active":"2024-09-17T01:32:55.270248+0000","last_became_peered":"2024-09-17T01:32:55.270248+0000","last_unstale":"2024-09-17T01:32:57.082930+0000","last_undegraded":"2024-09-17T01:32:57.082930+0000","last_fullsized":"2024-09-17T01:32:57.082930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:37:24.005353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083227+0000","last_change":"2024-09-17T01:32:54.270450+0000","last_active":"2024-09-17T01:32:57.083227+0000","last_peered":"2024-09-17T01:32:57.083227+0000","last_clean":"2024-09-17T01:32:57.083227+0000","last_became_active":"2024-09-17T01:32:54.270127+0000","last_became_peered":"2024-09-17T01:32:54.270127+0000","last_unstale":"2024-09-17T01:32:57.083227+0000","last_undegraded":"2024-09-17T01:32:57.083227+0000","last_fullsized":"2024-09-17T01:32:57.083227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:37:22.998881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083070+0000","last_change":"2024-09-17T01:32:55.279427+0000","last_active":"2024-09-17T01:32:57.083070+0000","last_peered":"2024-09-17T01:32:57.083070+0000","last_clean":"2024-09-17T01:32:57.083070+0000","last_became_active":"2024-09-17T01:32:55.278575+0000","last_became_peered":"2024-09-17T01:32:55.278575+0000","last_unstale":"2024-09-17T01:32:57.083070+0000","last_undegraded":"2024-09-17T01:32:57.083070+0000","last_fullsized":"2024-09-17T01:32:57.083070+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:36.683405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082840+0000","last_change":"2024-09-17T01:32:54.263865+0000","last_active":"2024-09-17T01:32:57.082840+0000","last_peered":"2024-09-17T01:32:57.082840+0000","last_clean":"2024-09-17T01:32:57.082840+0000","last_became_active":"2024-09-17T01:32:54.263543+0000","last_became_peered":"2024-09-17T01:32:54.263543+0000","last_unstale":"2024-09-17T01:32:57.082840+0000","last_undegraded":"2024-09-17T01:32:57.082840+0000","last_fullsized":"2024-09-17T01:32:57.082840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:08.574044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083709+0000","last_change":"2024-09-17T01:32:55.258824+0000","last_active":"2024-09-17T01:32:57.083709+0000","last_peered":"2024-09-17T01:32:57.083709+0000","last_clean":"2024-09-17T01:32:57.083709+0000","last_became_active":"2024-09-17T01:32:55.256418+0000","last_became_peered":"2024-09-17T01:32:55.256418+0000","last_unstale":"2024-09-17T01:32:57.083709+0000","last_undegraded":"2024-09-17T01:32:57.083709+0000","last_fullsized":"2024-09-17T01:32:57.083709+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:25.676572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.272096+0000","last_change":"2024-09-17T01:32:54.277476+0000","last_active":"2024-09-17T01:32:56.272096+0000","last_peered":"2024-09-17T01:32:56.272096+0000","last_clean":"2024-09-17T01:32:56.272096+0000","last_became_active":"2024-09-17T01:32:54.275552+0000","last_became_peered":"2024-09-17T01:32:54.275552+0000","last_unstale":"2024-09-17T01:32:56.272096+0000","last_undegraded":"2024-09-17T01:32:56.272096+0000","last_fullsized":"2024-09-17T01:32:56.272096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:24.959553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.252336+0000","last_change":"2024-09-17T01:32:55.268898+0000","last_active":"2024-09-17T01:32:56.252336+0000","last_peered":"2024-09-17T01:32:56.252336+0000","last_clean":"2024-09-17T01:32:56.252336+0000","last_became_active":"2024-09-17T01:32:55.268541+0000","last_became_peered":"2024-09-17T01:32:55.268541+0000","last_unstale":"2024-09-17T01:32:56.252336+0000","last_undegraded":"2024-09-17T01:32:56.252336+0000","last_fullsized":"2024-09-17T01:32:56.252336+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:03.996972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082176+0000","last_change":"2024-09-17T01:32:54.267969+0000","last_active":"2024-09-17T01:32:57.082176+0000","last_peered":"2024-09-17T01:32:57.082176+0000","last_clean":"2024-09-17T01:32:57.082176+0000","last_became_active":"2024-09-17T01:32:54.267655+0000","last_became_peered":"2024-09-17T01:32:54.267655+0000","last_unstale":"2024-09-17T01:32:57.082176+0000","last_undegraded":"2024-09-17T01:32:57.082176+0000","last_fullsized":"2024-09-17T01:32:57.082176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:52:13.804280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.251690+0000","last_change":"2024-09-17T01:32:55.288590+0000","last_active":"2024-09-17T01:32:56.251690+0000","last_peered":"2024-09-17T01:32:56.251690+0000","last_clean":"2024-09-17T01:32:56.251690+0000","last_became_active":"2024-09-17T01:32:55.288326+0000","last_became_peered":"2024-09-17T01:32:55.288326+0000","last_unstale":"2024-09-17T01:32:56.251690+0000","last_undegraded":"2024-09-17T01:32:56.251690+0000","last_fullsized":"2024-09-17T01:32:56.251690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:10.999916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269288+0000","last_change":"2024-09-17T01:32:54.265327+0000","last_active":"2024-09-17T01:32:56.269288+0000","last_peered":"2024-09-17T01:32:56.269288+0000","last_clean":"2024-09-17T01:32:56.269288+0000","last_became_active":"2024-09-17T01:32:54.265022+0000","last_became_peered":"2024-09-17T01:32:54.265022+0000","last_unstale":"2024-09-17T01:32:56.269288+0000","last_undegraded":"2024-09-17T01:32:56.269288+0000","last_fullsized":"2024-09-17T01:32:56.269288+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:36.740407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254440+0000","last_change":"2024-09-17T01:32:55.271519+0000","last_active":"2024-09-17T01:32:56.254440+0000","last_peered":"2024-09-17T01:32:56.254440+0000","last_clean":"2024-09-17T01:32:56.254440+0000","last_became_active":"2024-09-17T01:32:55.270178+0000","last_became_peered":"2024-09-17T01:32:55.270178+0000","last_unstale":"2024-09-17T01:32:56.254440+0000","last_undegraded":"2024-09-17T01:32:56.254440+0000","last_fullsized":"2024-09-17T01:32:56.254440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:47.475449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269099+0000","last_change":"2024-09-17T01:32:54.270692+0000","last_active":"2024-09-17T01:32:56.269099+0000","last_peered":"2024-09-17T01:32:56.269099+0000","last_clean":"2024-09-17T01:32:56.269099+0000","last_became_active":"2024-09-17T01:32:54.269836+0000","last_became_peered":"2024-09-17T01:32:54.269836+0000","last_unstale":"2024-09-17T01:32:56.269099+0000","last_undegraded":"2024-09-17T01:32:56.269099+0000","last_fullsized":"2024-09-17T01:32:56.269099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:01.191442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254034+0000","last_change":"2024-09-17T01:32:55.281107+0000","last_active":"2024-09-17T01:32:56.254034+0000","last_peered":"2024-09-17T01:32:56.254034+0000","last_clean":"2024-09-17T01:32:56.254034+0000","last_became_active":"2024-09-17T01:32:55.280497+0000","last_became_peered":"2024-09-17T01:32:55.280497+0000","last_unstale":"2024-09-17T01:32:56.254034+0000","last_undegraded":"2024-09-17T01:32:56.254034+0000","last_fullsized":"2024-09-17T01:32:56.254034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:39.562251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.251357+0000","last_change":"2024-09-17T01:32:54.278326+0000","last_active":"2024-09-17T01:32:56.251357+0000","last_peered":"2024-09-17T01:32:56.251357+0000","last_clean":"2024-09-17T01:32:56.251357+0000","last_became_active":"2024-09-17T01:32:54.277421+0000","last_became_peered":"2024-09-17T01:32:54.277421+0000","last_unstale":"2024-09-17T01:32:56.251357+0000","last_undegraded":"2024-09-17T01:32:56.251357+0000","last_fullsized":"2024-09-17T01:32:56.251357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:09.083126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.251362+0000","last_change":"2024-09-17T01:32:55.272125+0000","last_active":"2024-09-17T01:32:56.251362+0000","last_peered":"2024-09-17T01:32:56.251362+0000","last_clean":"2024-09-17T01:32:56.251362+0000","last_became_active":"2024-09-17T01:32:55.271789+0000","last_became_peered":"2024-09-17T01:32:55.271789+0000","last_unstale":"2024-09-17T01:32:56.251362+0000","last_undegraded":"2024-09-17T01:32:56.251362+0000","last_fullsized":"2024-09-17T01:32:56.251362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:50.252168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254090+0000","last_change":"2024-09-17T01:32:54.263719+0000","last_active":"2024-09-17T01:32:56.254090+0000","last_peered":"2024-09-17T01:32:56.254090+0000","last_clean":"2024-09-17T01:32:56.254090+0000","last_became_active":"2024-09-17T01:32:54.263393+0000","last_became_peered":"2024-09-17T01:32:54.263393+0000","last_unstale":"2024-09-17T01:32:56.254090+0000","last_undegraded":"2024-09-17T01:32:56.254090+0000","last_fullsized":"2024-09-17T01:32:56.254090+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:01.659376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.252932+0000","last_change":"2024-09-17T01:32:55.276017+0000","last_active":"2024-09-17T01:32:56.252932+0000","last_peered":"2024-09-17T01:32:56.252932+0000","last_clean":"2024-09-17T01:32:56.252932+0000","last_became_active":"2024-09-17T01:32:55.275597+0000","last_became_peered":"2024-09-17T01:32:55.275597+0000","last_unstale":"2024-09-17T01:32:56.252932+0000","last_undegraded":"2024-09-17T01:32:56.252932+0000","last_fullsized":"2024-09-17T01:32:56.252932+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:15.133860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083239+0000","last_change":"2024-09-17T01:32:54.281274+0000","last_active":"2024-09-17T01:32:57.083239+0000","last_peered":"2024-09-17T01:32:57.083239+0000","last_clean":"2024-09-17T01:32:57.083239+0000","last_became_active":"2024-09-17T01:32:54.276072+0000","last_became_peered":"2024-09-17T01:32:54.276072+0000","last_unstale":"2024-09-17T01:32:57.083239+0000","last_undegraded":"2024-09-17T01:32:57.083239+0000","last_fullsized":"2024-09-17T01:32:57.083239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:54.540207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.253296+0000","last_change":"2024-09-17T01:32:55.286397+0000","last_active":"2024-09-17T01:32:56.253296+0000","last_peered":"2024-09-17T01:32:56.253296+0000","last_clean":"2024-09-17T01:32:56.253296+0000","last_became_active":"2024-09-17T01:32:55.286050+0000","last_became_peered":"2024-09-17T01:32:55.286050+0000","last_unstale":"2024-09-17T01:32:56.253296+0000","last_undegraded":"2024-09-17T01:32:56.253296+0000","last_fullsized":"2024-09-17T01:32:56.253296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:29.319900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.253554+0000","last_change":"2024-09-17T01:32:54.276866+0000","last_active":"2024-09-17T01:32:56.253554+0000","last_peered":"2024-09-17T01:32:56.253554+0000","last_clean":"2024-09-17T01:32:56.253554+0000","last_became_active":"2024-09-17T01:32:54.275207+0000","last_became_peered":"2024-09-17T01:32:54.275207+0000","last_unstale":"2024-09-17T01:32:56.253554+0000","last_undegraded":"2024-09-17T01:32:56.253554+0000","last_fullsized":"2024-09-17T01:32:56.253554+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:48.529040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.081990+0000","last_change":"2024-09-17T01:32:55.274043+0000","last_active":"2024-09-17T01:32:57.081990+0000","last_peered":"2024-09-17T01:32:57.081990+0000","last_clean":"2024-09-17T01:32:57.081990+0000","last_became_active":"2024-09-17T01:32:55.273734+0000","last_became_peered":"2024-09-17T01:32:55.273734+0000","last_unstale":"2024-09-17T01:32:57.081990+0000","last_undegraded":"2024-09-17T01:32:57.081990+0000","last_fullsized":"2024-09-17T01:32:57.081990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:31.979443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.252784+0000","last_change":"2024-09-17T01:32:54.271260+0000","last_active":"2024-09-17T01:32:56.252784+0000","last_peered":"2024-09-17T01:32:56.252784+0000","last_clean":"2024-09-17T01:32:56.252784+0000","last_became_active":"2024-09-17T01:32:54.270930+0000","last_became_peered":"2024-09-17T01:32:54.270930+0000","last_unstale":"2024-09-17T01:32:56.252784+0000","last_undegraded":"2024-09-17T01:32:56.252784+0000","last_fullsized":"2024-09-17T01:32:56.252784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:57.951213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.251103+0000","last_change":"2024-09-17T01:32:55.291808+0000","last_active":"2024-09-17T01:32:56.251103+0000","last_peered":"2024-09-17T01:32:56.251103+0000","last_clean":"2024-09-17T01:32:56.251103+0000","last_became_active":"2024-09-17T01:32:55.289555+0000","last_became_peered":"2024-09-17T01:32:55.289555+0000","last_unstale":"2024-09-17T01:32:56.251103+0000","last_undegraded":"2024-09-17T01:32:56.251103+0000","last_fullsized":"2024-09-17T01:32:56.251103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:20.673746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.271975+0000","last_change":"2024-09-17T01:32:54.277270+0000","last_active":"2024-09-17T01:32:56.271975+0000","last_peered":"2024-09-17T01:32:56.271975+0000","last_clean":"2024-09-17T01:32:56.271975+0000","last_became_active":"2024-09-17T01:32:54.276138+0000","last_became_peered":"2024-09-17T01:32:54.276138+0000","last_unstale":"2024-09-17T01:32:56.271975+0000","last_undegraded":"2024-09-17T01:32:56.271975+0000","last_fullsized":"2024-09-17T01:32:56.271975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:12.577300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.251701+0000","last_change":"2024-09-17T01:32:55.288408+0000","last_active":"2024-09-17T01:32:56.251701+0000","last_peered":"2024-09-17T01:32:56.251701+0000","last_clean":"2024-09-17T01:32:56.251701+0000","last_became_active":"2024-09-17T01:32:55.287946+0000","last_became_peered":"2024-09-17T01:32:55.287946+0000","last_unstale":"2024-09-17T01:32:56.251701+0000","last_undegraded":"2024-09-17T01:32:56.251701+0000","last_fullsized":"2024-09-17T01:32:56.251701+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:26.648023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.272458+0000","last_change":"2024-09-17T01:32:54.275279+0000","last_active":"2024-09-17T01:32:56.272458+0000","last_peered":"2024-09-17T01:32:56.272458+0000","last_clean":"2024-09-17T01:32:56.272458+0000","last_became_active":"2024-09-17T01:32:54.274814+0000","last_became_peered":"2024-09-17T01:32:54.274814+0000","last_unstale":"2024-09-17T01:32:56.272458+0000","last_undegraded":"2024-09-17T01:32:56.272458+0000","last_fullsized":"2024-09-17T01:32:56.272458+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:19.817218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.084007+0000","last_change":"2024-09-17T01:32:55.257210+0000","last_active":"2024-09-17T01:32:57.084007+0000","last_peered":"2024-09-17T01:32:57.084007+0000","last_clean":"2024-09-17T01:32:57.084007+0000","last_became_active":"2024-09-17T01:32:55.256881+0000","last_became_peered":"2024-09-17T01:32:55.256881+0000","last_unstale":"2024-09-17T01:32:57.084007+0000","last_undegraded":"2024-09-17T01:32:57.084007+0000","last_fullsized":"2024-09-17T01:32:57.084007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:14.718167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083015+0000","last_change":"2024-09-17T01:32:54.277438+0000","last_active":"2024-09-17T01:32:57.083015+0000","last_peered":"2024-09-17T01:32:57.083015+0000","last_clean":"2024-09-17T01:32:57.083015+0000","last_became_active":"2024-09-17T01:32:54.277129+0000","last_became_peered":"2024-09-17T01:32:54.277129+0000","last_unstale":"2024-09-17T01:32:57.083015+0000","last_undegraded":"2024-09-17T01:32:57.083015+0000","last_fullsized":"2024-09-17T01:32:57.083015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:59.228808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269046+0000","last_change":"2024-09-17T01:32:55.259074+0000","last_active":"2024-09-17T01:32:56.269046+0000","last_peered":"2024-09-17T01:32:56.269046+0000","last_clean":"2024-09-17T01:32:56.269046+0000","last_became_active":"2024-09-17T01:32:55.258557+0000","last_became_peered":"2024-09-17T01:32:55.258557+0000","last_unstale":"2024-09-17T01:32:56.269046+0000","last_undegraded":"2024-09-17T01:32:56.269046+0000","last_fullsized":"2024-09-17T01:32:56.269046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:16.828516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.251796+0000","last_change":"2024-09-17T01:32:54.277977+0000","last_active":"2024-09-17T01:32:56.251796+0000","last_peered":"2024-09-17T01:32:56.251796+0000","last_clean":"2024-09-17T01:32:56.251796+0000","last_became_active":"2024-09-17T01:32:54.276470+0000","last_became_peered":"2024-09-17T01:32:54.276470+0000","last_unstale":"2024-09-17T01:32:56.251796+0000","last_undegraded":"2024-09-17T01:32:56.251796+0000","last_fullsized":"2024-09-17T01:32:56.251796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:20.970703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.272326+0000","last_change":"2024-09-17T01:32:55.268454+0000","last_active":"2024-09-17T01:32:56.272326+0000","last_peered":"2024-09-17T01:32:56.272326+0000","last_clean":"2024-09-17T01:32:56.272326+0000","last_became_active":"2024-09-17T01:32:55.268063+0000","last_became_peered":"2024-09-17T01:32:55.268063+0000","last_unstale":"2024-09-17T01:32:56.272326+0000","last_undegraded":"2024-09-17T01:32:56.272326+0000","last_fullsized":"2024-09-17T01:32:56.272326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:26.598329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082316+0000","last_change":"2024-09-17T01:32:54.266920+0000","last_active":"2024-09-17T01:32:57.082316+0000","last_peered":"2024-09-17T01:32:57.082316+0000","last_clean":"2024-09-17T01:32:57.082316+0000","last_became_active":"2024-09-17T01:32:54.266582+0000","last_became_peered":"2024-09-17T01:32:54.266582+0000","last_unstale":"2024-09-17T01:32:57.082316+0000","last_undegraded":"2024-09-17T01:32:57.082316+0000","last_fullsized":"2024-09-17T01:32:57.082316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:25.978040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.253406+0000","last_change":"2024-09-17T01:32:55.275935+0000","last_active":"2024-09-17T01:32:56.253406+0000","last_peered":"2024-09-17T01:32:56.253406+0000","last_clean":"2024-09-17T01:32:56.253406+0000","last_became_active":"2024-09-17T01:32:55.275569+0000","last_became_peered":"2024-09-17T01:32:55.275569+0000","last_unstale":"2024-09-17T01:32:56.253406+0000","last_undegraded":"2024-09-17T01:32:56.253406+0000","last_fullsized":"2024-09-17T01:32:56.253406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:35.224232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269159+0000","last_change":"2024-09-17T01:32:54.264750+0000","last_active":"2024-09-17T01:32:56.269159+0000","last_peered":"2024-09-17T01:32:56.269159+0000","last_clean":"2024-09-17T01:32:56.269159+0000","last_became_active":"2024-09-17T01:32:54.262686+0000","last_became_peered":"2024-09-17T01:32:54.262686+0000","last_unstale":"2024-09-17T01:32:56.269159+0000","last_undegraded":"2024-09-17T01:32:56.269159+0000","last_fullsized":"2024-09-17T01:32:56.269159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:17:55.846732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269330+0000","last_change":"2024-09-17T01:32:55.266507+0000","last_active":"2024-09-17T01:32:56.269330+0000","last_peered":"2024-09-17T01:32:56.269330+0000","last_clean":"2024-09-17T01:32:56.269330+0000","last_became_active":"2024-09-17T01:32:55.266152+0000","last_became_peered":"2024-09-17T01:32:55.266152+0000","last_unstale":"2024-09-17T01:32:56.269330+0000","last_undegraded":"2024-09-17T01:32:56.269330+0000","last_fullsized":"2024-09-17T01:32:56.269330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:19.375873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082966+0000","last_change":"2024-09-17T01:32:54.278174+0000","last_active":"2024-09-17T01:32:57.082966+0000","last_peered":"2024-09-17T01:32:57.082966+0000","last_clean":"2024-09-17T01:32:57.082966+0000","last_became_active":"2024-09-17T01:32:54.276004+0000","last_became_peered":"2024-09-17T01:32:54.276004+0000","last_unstale":"2024-09-17T01:32:57.082966+0000","last_undegraded":"2024-09-17T01:32:57.082966+0000","last_fullsized":"2024-09-17T01:32:57.082966+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:13.711695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.252495+0000","last_change":"2024-09-17T01:32:55.286356+0000","last_active":"2024-09-17T01:32:56.252495+0000","last_peered":"2024-09-17T01:32:56.252495+0000","last_clean":"2024-09-17T01:32:56.252495+0000","last_became_active":"2024-09-17T01:32:55.285612+0000","last_became_peered":"2024-09-17T01:32:55.285612+0000","last_unstale":"2024-09-17T01:32:56.252495+0000","last_undegraded":"2024-09-17T01:32:56.252495+0000","last_fullsized":"2024-09-17T01:32:56.252495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:34.033098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.081928+0000","last_change":"2024-09-17T01:32:54.263007+0000","last_active":"2024-09-17T01:32:57.081928+0000","last_peered":"2024-09-17T01:32:57.081928+0000","last_clean":"2024-09-17T01:32:57.081928+0000","last_became_active":"2024-09-17T01:32:54.262642+0000","last_became_peered":"2024-09-17T01:32:54.262642+0000","last_unstale":"2024-09-17T01:32:57.081928+0000","last_undegraded":"2024-09-17T01:32:57.081928+0000","last_fullsized":"2024-09-17T01:32:57.081928+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:21.236724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.081743+0000","last_change":"2024-09-17T01:32:55.257180+0000","last_active":"2024-09-17T01:32:57.081743+0000","last_peered":"2024-09-17T01:32:57.081743+0000","last_clean":"2024-09-17T01:32:57.081743+0000","last_became_active":"2024-09-17T01:32:55.256839+0000","last_became_peered":"2024-09-17T01:32:55.256839+0000","last_unstale":"2024-09-17T01:32:57.081743+0000","last_undegraded":"2024-09-17T01:32:57.081743+0000","last_fullsized":"2024-09-17T01:32:57.081743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:39.001302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.250847+0000","last_change":"2024-09-17T01:32:54.265991+0000","last_active":"2024-09-17T01:32:56.250847+0000","last_peered":"2024-09-17T01:32:56.250847+0000","last_clean":"2024-09-17T01:32:56.250847+0000","last_became_active":"2024-09-17T01:32:54.265640+0000","last_became_peered":"2024-09-17T01:32:54.265640+0000","last_unstale":"2024-09-17T01:32:56.250847+0000","last_undegraded":"2024-09-17T01:32:56.250847+0000","last_fullsized":"2024-09-17T01:32:56.250847+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:45:48.769998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.272451+0000","last_change":"2024-09-17T01:32:55.271056+0000","last_active":"2024-09-17T01:32:56.272451+0000","last_peered":"2024-09-17T01:32:56.272451+0000","last_clean":"2024-09-17T01:32:56.272451+0000","last_became_active":"2024-09-17T01:32:55.270714+0000","last_became_peered":"2024-09-17T01:32:55.270714+0000","last_unstale":"2024-09-17T01:32:56.272451+0000","last_undegraded":"2024-09-17T01:32:56.272451+0000","last_fullsized":"2024-09-17T01:32:56.272451+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:24.114366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254845+0000","last_change":"2024-09-17T01:32:54.263467+0000","last_active":"2024-09-17T01:32:56.254845+0000","last_peered":"2024-09-17T01:32:56.254845+0000","last_clean":"2024-09-17T01:32:56.254845+0000","last_became_active":"2024-09-17T01:32:54.263098+0000","last_became_peered":"2024-09-17T01:32:54.263098+0000","last_unstale":"2024-09-17T01:32:56.254845+0000","last_undegraded":"2024-09-17T01:32:56.254845+0000","last_fullsized":"2024-09-17T01:32:56.254845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:25.591856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.252100+0000","last_change":"2024-09-17T01:32:55.274792+0000","last_active":"2024-09-17T01:32:56.252100+0000","last_peered":"2024-09-17T01:32:56.252100+0000","last_clean":"2024-09-17T01:32:56.252100+0000","last_became_active":"2024-09-17T01:32:55.272127+0000","last_became_peered":"2024-09-17T01:32:55.272127+0000","last_unstale":"2024-09-17T01:32:56.252100+0000","last_undegraded":"2024-09-17T01:32:56.252100+0000","last_fullsized":"2024-09-17T01:32:56.252100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:42.717926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269306+0000","last_change":"2024-09-17T01:32:54.269945+0000","last_active":"2024-09-17T01:32:56.269306+0000","last_peered":"2024-09-17T01:32:56.269306+0000","last_clean":"2024-09-17T01:32:56.269306+0000","last_became_active":"2024-09-17T01:32:54.269614+0000","last_became_peered":"2024-09-17T01:32:54.269614+0000","last_unstale":"2024-09-17T01:32:56.269306+0000","last_undegraded":"2024-09-17T01:32:56.269306+0000","last_fullsized":"2024-09-17T01:32:56.269306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:39.597893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.272519+0000","last_change":"2024-09-17T01:32:55.272683+0000","last_active":"2024-09-17T01:32:56.272519+0000","last_peered":"2024-09-17T01:32:56.272519+0000","last_clean":"2024-09-17T01:32:56.272519+0000","last_became_active":"2024-09-17T01:32:55.272225+0000","last_became_peered":"2024-09-17T01:32:55.272225+0000","last_unstale":"2024-09-17T01:32:56.272519+0000","last_undegraded":"2024-09-17T01:32:56.272519+0000","last_fullsized":"2024-09-17T01:32:56.272519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:58.957685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254234+0000","last_change":"2024-09-17T01:32:54.271877+0000","last_active":"2024-09-17T01:32:56.254234+0000","last_peered":"2024-09-17T01:32:56.254234+0000","last_clean":"2024-09-17T01:32:56.254234+0000","last_became_active":"2024-09-17T01:32:54.269407+0000","last_became_peered":"2024-09-17T01:32:54.269407+0000","last_unstale":"2024-09-17T01:32:56.254234+0000","last_undegraded":"2024-09-17T01:32:56.254234+0000","last_fullsized":"2024-09-17T01:32:56.254234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:59.964980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082294+0000","last_change":"2024-09-17T01:32:55.271939+0000","last_active":"2024-09-17T01:32:57.082294+0000","last_peered":"2024-09-17T01:32:57.082294+0000","last_clean":"2024-09-17T01:32:57.082294+0000","last_became_active":"2024-09-17T01:32:55.271618+0000","last_became_peered":"2024-09-17T01:32:55.271618+0000","last_unstale":"2024-09-17T01:32:57.082294+0000","last_undegraded":"2024-09-17T01:32:57.082294+0000","last_fullsized":"2024-09-17T01:32:57.082294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:21.977175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254981+0000","last_change":"2024-09-17T01:32:54.266052+0000","last_active":"2024-09-17T01:32:56.254981+0000","last_peered":"2024-09-17T01:32:56.254981+0000","last_clean":"2024-09-17T01:32:56.254981+0000","last_became_active":"2024-09-17T01:32:54.265696+0000","last_became_peered":"2024-09-17T01:32:54.265696+0000","last_unstale":"2024-09-17T01:32:56.254981+0000","last_undegraded":"2024-09-17T01:32:56.254981+0000","last_fullsized":"2024-09-17T01:32:56.254981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:48.082182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.253599+0000","last_change":"2024-09-17T01:32:55.283496+0000","last_active":"2024-09-17T01:32:56.253599+0000","last_peered":"2024-09-17T01:32:56.253599+0000","last_clean":"2024-09-17T01:32:56.253599+0000","last_became_active":"2024-09-17T01:32:55.283189+0000","last_became_peered":"2024-09-17T01:32:55.283189+0000","last_unstale":"2024-09-17T01:32:56.253599+0000","last_undegraded":"2024-09-17T01:32:56.253599+0000","last_fullsized":"2024-09-17T01:32:56.253599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:17.554447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.253615+0000","last_change":"2024-09-17T01:32:54.274129+0000","last_active":"2024-09-17T01:32:56.253615+0000","last_peered":"2024-09-17T01:32:56.253615+0000","last_clean":"2024-09-17T01:32:56.253615+0000","last_became_active":"2024-09-17T01:32:54.273414+0000","last_became_peered":"2024-09-17T01:32:54.273414+0000","last_unstale":"2024-09-17T01:32:56.253615+0000","last_undegraded":"2024-09-17T01:32:56.253615+0000","last_fullsized":"2024-09-17T01:32:56.253615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:25.752893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.252363+0000","last_change":"2024-09-17T01:32:55.282507+0000","last_active":"2024-09-17T01:32:56.252363+0000","last_peered":"2024-09-17T01:32:56.252363+0000","last_clean":"2024-09-17T01:32:56.252363+0000","last_became_active":"2024-09-17T01:32:55.281836+0000","last_became_peered":"2024-09-17T01:32:55.281836+0000","last_unstale":"2024-09-17T01:32:56.252363+0000","last_undegraded":"2024-09-17T01:32:56.252363+0000","last_fullsized":"2024-09-17T01:32:56.252363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:34:28.124050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082566+0000","last_change":"2024-09-17T01:32:54.277748+0000","last_active":"2024-09-17T01:32:57.082566+0000","last_peered":"2024-09-17T01:32:57.082566+0000","last_clean":"2024-09-17T01:32:57.082566+0000","last_became_active":"2024-09-17T01:32:54.277399+0000","last_became_peered":"2024-09-17T01:32:54.277399+0000","last_unstale":"2024-09-17T01:32:57.082566+0000","last_undegraded":"2024-09-17T01:32:57.082566+0000","last_fullsized":"2024-09-17T01:32:57.082566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:24.670099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.251342+0000","last_change":"2024-09-17T01:32:55.275514+0000","last_active":"2024-09-17T01:32:56.251342+0000","last_peered":"2024-09-17T01:32:56.251342+0000","last_clean":"2024-09-17T01:32:56.251342+0000","last_became_active":"2024-09-17T01:32:55.273253+0000","last_became_peered":"2024-09-17T01:32:55.273253+0000","last_unstale":"2024-09-17T01:32:56.251342+0000","last_undegraded":"2024-09-17T01:32:56.251342+0000","last_fullsized":"2024-09-17T01:32:56.251342+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:20.061628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.252334+0000","last_change":"2024-09-17T01:32:54.271709+0000","last_active":"2024-09-17T01:32:56.252334+0000","last_peered":"2024-09-17T01:32:56.252334+0000","last_clean":"2024-09-17T01:32:56.252334+0000","last_became_active":"2024-09-17T01:32:54.271408+0000","last_became_peered":"2024-09-17T01:32:54.271408+0000","last_unstale":"2024-09-17T01:32:56.252334+0000","last_undegraded":"2024-09-17T01:32:56.252334+0000","last_fullsized":"2024-09-17T01:32:56.252334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:23.107893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.081953+0000","last_change":"2024-09-17T01:32:55.273286+0000","last_active":"2024-09-17T01:32:57.081953+0000","last_peered":"2024-09-17T01:32:57.081953+0000","last_clean":"2024-09-17T01:32:57.081953+0000","last_became_active":"2024-09-17T01:32:55.271139+0000","last_became_peered":"2024-09-17T01:32:55.271139+0000","last_unstale":"2024-09-17T01:32:57.081953+0000","last_undegraded":"2024-09-17T01:32:57.081953+0000","last_fullsized":"2024-09-17T01:32:57.081953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:53.619103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.251850+0000","last_change":"2024-09-17T01:32:54.278092+0000","last_active":"2024-09-17T01:32:56.251850+0000","last_peered":"2024-09-17T01:32:56.251850+0000","last_clean":"2024-09-17T01:32:56.251850+0000","last_became_active":"2024-09-17T01:32:54.276983+0000","last_became_peered":"2024-09-17T01:32:54.276983+0000","last_unstale":"2024-09-17T01:32:56.251850+0000","last_undegraded":"2024-09-17T01:32:56.251850+0000","last_fullsized":"2024-09-17T01:32:56.251850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:43.799057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":130,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083616+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:32:57.083616+0000","last_peered":"2024-09-17T01:32:57.083616+0000","last_clean":"2024-09-17T01:32:57.083616+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:32:57.083616+0000","last_undegraded":"2024-09-17T01:32:57.083616+0000","last_fullsized":"2024-09-17T01:32:57.083616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476753,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":368640,"data_stored":140119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":368640,"data_stored":140107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":376832,"data_stored":141697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":380928,"data_stored":141719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":380928,"data_stored":140861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":962560,"data_stored":730523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":368640,"data_stored":140175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":962560,"data_stored":731035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:33:04.771 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:33:05.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.011+0000 7f81e2200640 1 -- 172.21.15.42:0/2464041519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81dc0b3880 msgr2=0x7f81dc0af980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:05.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.011+0000 7f81e2200640 1 --2- 172.21.15.42:0/2464041519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81dc0b3880 0x7f81dc0af980 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f81cc005fd0 tx=0x7f81cc02a5d0 comp rx=0 tx=0).stop 2024-09-17T01:33:05.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.011+0000 7f81e2200640 1 -- 172.21.15.42:0/2464041519 shutdown_connections 2024-09-17T01:33:05.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.011+0000 7f81e2200640 1 --2- 172.21.15.42:0/2464041519 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81dc15cfc0 0x7f81dc0ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:05.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.011+0000 7f81e2200640 1 --2- 172.21.15.42:0/2464041519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81dc0b3880 0x7f81dc0af980 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:05.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.011+0000 7f81e2200640 1 -- 172.21.15.42:0/2464041519 >> 172.21.15.42:0/2464041519 conn(0x7f81dc0b2930 msgr2=0x7f81dc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:33:05.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.011+0000 7f81e2200640 1 -- 172.21.15.42:0/2464041519 shutdown_connections 2024-09-17T01:33:05.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.011+0000 7f81e2200640 1 -- 172.21.15.42:0/2464041519 wait complete. 2024-09-17T01:33:05.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.013+0000 7f81e2200640 1 Processor -- start 2024-09-17T01:33:05.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.013+0000 7f81e2200640 1 -- start start 2024-09-17T01:33:05.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.015+0000 7f81e2200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81dc06d430 0x7f81dc145d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:05.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.015+0000 7f81e2200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81dc0b3880 0x7f81dc1e6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:05.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.015+0000 7f81e2200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81dc15cfc0 0x7f81dc1e73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:05.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.015+0000 7f81e2200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f81dc072ad0 con 0x7f81dc0b3880 2024-09-17T01:33:05.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.015+0000 7f81e2200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f81dc072950 con 0x7f81dc15cfc0 2024-09-17T01:33:05.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.015+0000 7f81e2200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f81dc072c50 con 0x7f81dc06d430 2024-09-17T01:33:05.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.015+0000 7f81d2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81dc0b3880 0x7f81dc1e6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:05.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.015+0000 7f81d2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81dc0b3880 0x7f81dc1e6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48728/0 (socket says 172.21.15.42:48728) 2024-09-17T01:33:05.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.015+0000 7f81d2a00640 1 -- 172.21.15.42:0/1238447018 learned_addr learned my addr 172.21.15.42:0/1238447018 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:33:05.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.015+0000 7f81db400640 1 --2- 172.21.15.42:0/1238447018 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81dc06d430 0x7f81dc145d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:05.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.015+0000 7f81dbe00640 1 --2- 172.21.15.42:0/1238447018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81dc15cfc0 0x7f81dc1e73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:05.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.015+0000 7f81d2a00640 1 -- 172.21.15.42:0/1238447018 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81dc06d430 msgr2=0x7f81dc145d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:05.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.015+0000 7f81d2a00640 1 --2- 172.21.15.42:0/1238447018 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81dc06d430 0x7f81dc145d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:05.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.015+0000 7f81d2a00640 1 -- 172.21.15.42:0/1238447018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81dc15cfc0 msgr2=0x7f81dc1e73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:05.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.015+0000 7f81d2a00640 1 --2- 172.21.15.42:0/1238447018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81dc15cfc0 0x7f81dc1e73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:05.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.015+0000 7f81d2a00640 1 -- 172.21.15.42:0/1238447018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81dc146290 con 0x7f81dc0b3880 2024-09-17T01:33:05.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.015+0000 7f81dbe00640 1 --2- 172.21.15.42:0/1238447018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81dc15cfc0 0x7f81dc1e73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:33:05.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.016+0000 7f81d2a00640 1 --2- 172.21.15.42:0/1238447018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81dc0b3880 0x7f81dc1e6e90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f81c400d6d0 tx=0x7f81c400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:33:05.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.016+0000 7f81d3e00640 1 -- 172.21.15.42:0/1238447018 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c4017070 con 0x7f81dc0b3880 2024-09-17T01:33:05.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.016+0000 7f81d3e00640 1 -- 172.21.15.42:0/1238447018 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81c4009ab0 con 0x7f81dc0b3880 2024-09-17T01:33:05.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.016+0000 7f81d3e00640 1 -- 172.21.15.42:0/1238447018 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c4010460 con 0x7f81dc0b3880 2024-09-17T01:33:05.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.016+0000 7f81e2200640 1 -- 172.21.15.42:0/1238447018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81dc154a60 con 0x7f81dc0b3880 2024-09-17T01:33:05.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.016+0000 7f81e2200640 1 -- 172.21.15.42:0/1238447018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81dc155000 con 0x7f81dc0b3880 2024-09-17T01:33:05.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.017+0000 7f81e2200640 1 -- 172.21.15.42:0/1238447018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81dc0af980 con 0x7f81dc0b3880 2024-09-17T01:33:05.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.018+0000 7f81d3e00640 1 -- 172.21.15.42:0/1238447018 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f81c401a070 con 0x7f81dc0b3880 2024-09-17T01:33:05.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.019+0000 7f81d3e00640 1 --2- 172.21.15.42:0/1238447018 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f81b8078b90 0x7f81b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:05.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.019+0000 7f81d3e00640 1 -- 172.21.15.42:0/1238447018 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f81c409aee0 con 0x7f81dc0b3880 2024-09-17T01:33:05.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.020+0000 7f81db400640 1 --2- 172.21.15.42:0/1238447018 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f81b8078b90 0x7f81b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:05.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.021+0000 7f81db400640 1 --2- 172.21.15.42:0/1238447018 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f81b8078b90 0x7f81b807b0a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f81cc033000 tx=0x7f81cc004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:33:05.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.024+0000 7f81d3e00640 1 -- 172.21.15.42:0/1238447018 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f81dc146290 con 0x7f81dc0b3880 2024-09-17T01:33:05.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.213+0000 7f81e2200640 1 -- 172.21.15.42:0/1238447018 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f81dc06a170 con 0x7f81b8078b90 2024-09-17T01:33:05.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.218+0000 7f81d3e00640 1 -- 172.21.15.42:0/1238447018 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251856 (secure 0 0 0) 0x7f81dc06a170 con 0x7f81b8078b90 2024-09-17T01:33:05.219 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:33:05.220 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:33:05.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.223+0000 7f81e2200640 1 -- 172.21.15.42:0/1238447018 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f81b8078b90 msgr2=0x7f81b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:05.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.223+0000 7f81e2200640 1 --2- 172.21.15.42:0/1238447018 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f81b8078b90 0x7f81b807b0a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f81cc033000 tx=0x7f81cc004730 comp rx=0 tx=0).stop 2024-09-17T01:33:05.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.223+0000 7f81e2200640 1 -- 172.21.15.42:0/1238447018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81dc0b3880 msgr2=0x7f81dc1e6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:05.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.223+0000 7f81e2200640 1 --2- 172.21.15.42:0/1238447018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81dc0b3880 0x7f81dc1e6e90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f81c400d6d0 tx=0x7f81c400db90 comp rx=0 tx=0).stop 2024-09-17T01:33:05.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.223+0000 7f81e2200640 1 -- 172.21.15.42:0/1238447018 shutdown_connections 2024-09-17T01:33:05.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.223+0000 7f81e2200640 1 --2- 172.21.15.42:0/1238447018 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f81b8078b90 0x7f81b807b0a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:05.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.223+0000 7f81e2200640 1 --2- 172.21.15.42:0/1238447018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81dc15cfc0 0x7f81dc1e73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:05.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.223+0000 7f81e2200640 1 --2- 172.21.15.42:0/1238447018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81dc0b3880 0x7f81dc1e6e90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:05.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.223+0000 7f81e2200640 1 --2- 172.21.15.42:0/1238447018 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81dc06d430 0x7f81dc145d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:05.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.223+0000 7f81e2200640 1 -- 172.21.15.42:0/1238447018 >> 172.21.15.42:0/1238447018 conn(0x7f81dc0b2930 msgr2=0x7f81dc15f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:33:05.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.223+0000 7f81e2200640 1 -- 172.21.15.42:0/1238447018 shutdown_connections 2024-09-17T01:33:05.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.223+0000 7f81e2200640 1 -- 172.21.15.42:0/1238447018 wait complete. 2024-09-17T01:33:05.242 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-09-17T01:33:04.990046+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253580,"kb_used_data":4072,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754721140,"statfs":{"total":773094113280,"available":772834447360,"internally_reserved":0,"allocated":4169728,"data_stored":2306236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.742111"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083235+0000","last_change":"2024-09-17T01:32:55.281409+0000","last_active":"2024-09-17T01:32:57.083235+0000","last_peered":"2024-09-17T01:32:57.083235+0000","last_clean":"2024-09-17T01:32:57.083235+0000","last_became_active":"2024-09-17T01:32:55.277989+0000","last_became_peered":"2024-09-17T01:32:55.277989+0000","last_unstale":"2024-09-17T01:32:57.083235+0000","last_undegraded":"2024-09-17T01:32:57.083235+0000","last_fullsized":"2024-09-17T01:32:57.083235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:41.218963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269483+0000","last_change":"2024-09-17T01:32:55.286374+0000","last_active":"2024-09-17T01:32:56.269483+0000","last_peered":"2024-09-17T01:32:56.269483+0000","last_clean":"2024-09-17T01:32:56.269483+0000","last_became_active":"2024-09-17T01:32:55.282079+0000","last_became_peered":"2024-09-17T01:32:55.282079+0000","last_unstale":"2024-09-17T01:32:56.269483+0000","last_undegraded":"2024-09-17T01:32:56.269483+0000","last_fullsized":"2024-09-17T01:32:56.269483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:37.917841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083909+0000","last_change":"2024-09-17T01:32:55.278863+0000","last_active":"2024-09-17T01:32:57.083909+0000","last_peered":"2024-09-17T01:32:57.083909+0000","last_clean":"2024-09-17T01:32:57.083909+0000","last_became_active":"2024-09-17T01:32:55.278547+0000","last_became_peered":"2024-09-17T01:32:55.278547+0000","last_unstale":"2024-09-17T01:32:57.083909+0000","last_undegraded":"2024-09-17T01:32:57.083909+0000","last_fullsized":"2024-09-17T01:32:57.083909+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:00.235280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.253739+0000","last_change":"2024-09-17T01:32:55.281473+0000","last_active":"2024-09-17T01:32:56.253739+0000","last_peered":"2024-09-17T01:32:56.253739+0000","last_clean":"2024-09-17T01:32:56.253739+0000","last_became_active":"2024-09-17T01:32:55.280737+0000","last_became_peered":"2024-09-17T01:32:55.280737+0000","last_unstale":"2024-09-17T01:32:56.253739+0000","last_undegraded":"2024-09-17T01:32:56.253739+0000","last_fullsized":"2024-09-17T01:32:56.253739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:59.908587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269043+0000","last_change":"2024-09-17T01:32:55.282329+0000","last_active":"2024-09-17T01:32:56.269043+0000","last_peered":"2024-09-17T01:32:56.269043+0000","last_clean":"2024-09-17T01:32:56.269043+0000","last_became_active":"2024-09-17T01:32:55.281587+0000","last_became_peered":"2024-09-17T01:32:55.281587+0000","last_unstale":"2024-09-17T01:32:56.269043+0000","last_undegraded":"2024-09-17T01:32:56.269043+0000","last_fullsized":"2024-09-17T01:32:56.269043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:38:26.720551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.272508+0000","last_change":"2024-09-17T01:32:55.278299+0000","last_active":"2024-09-17T01:32:56.272508+0000","last_peered":"2024-09-17T01:32:56.272508+0000","last_clean":"2024-09-17T01:32:56.272508+0000","last_became_active":"2024-09-17T01:32:55.277972+0000","last_became_peered":"2024-09-17T01:32:55.277972+0000","last_unstale":"2024-09-17T01:32:56.272508+0000","last_undegraded":"2024-09-17T01:32:56.272508+0000","last_fullsized":"2024-09-17T01:32:56.272508+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:28.740562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.081780+0000","last_change":"2024-09-17T01:32:55.278314+0000","last_active":"2024-09-17T01:32:57.081780+0000","last_peered":"2024-09-17T01:32:57.081780+0000","last_clean":"2024-09-17T01:32:57.081780+0000","last_became_active":"2024-09-17T01:32:55.277821+0000","last_became_peered":"2024-09-17T01:32:55.277821+0000","last_unstale":"2024-09-17T01:32:57.081780+0000","last_undegraded":"2024-09-17T01:32:57.081780+0000","last_fullsized":"2024-09-17T01:32:57.081780+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:19.370029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082588+0000","last_change":"2024-09-17T01:32:55.284414+0000","last_active":"2024-09-17T01:32:57.082588+0000","last_peered":"2024-09-17T01:32:57.082588+0000","last_clean":"2024-09-17T01:32:57.082588+0000","last_became_active":"2024-09-17T01:32:55.284204+0000","last_became_peered":"2024-09-17T01:32:55.284204+0000","last_unstale":"2024-09-17T01:32:57.082588+0000","last_undegraded":"2024-09-17T01:32:57.082588+0000","last_fullsized":"2024-09-17T01:32:57.082588+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:58.344490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083734+0000","last_change":"2024-09-17T01:32:55.286855+0000","last_active":"2024-09-17T01:32:57.083734+0000","last_peered":"2024-09-17T01:32:57.083734+0000","last_clean":"2024-09-17T01:32:57.083734+0000","last_became_active":"2024-09-17T01:32:55.286507+0000","last_became_peered":"2024-09-17T01:32:55.286507+0000","last_unstale":"2024-09-17T01:32:57.083734+0000","last_undegraded":"2024-09-17T01:32:57.083734+0000","last_fullsized":"2024-09-17T01:32:57.083734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:20.050967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254349+0000","last_change":"2024-09-17T01:32:55.278573+0000","last_active":"2024-09-17T01:32:56.254349+0000","last_peered":"2024-09-17T01:32:56.254349+0000","last_clean":"2024-09-17T01:32:56.254349+0000","last_became_active":"2024-09-17T01:32:55.277176+0000","last_became_peered":"2024-09-17T01:32:55.277176+0000","last_unstale":"2024-09-17T01:32:56.254349+0000","last_undegraded":"2024-09-17T01:32:56.254349+0000","last_fullsized":"2024-09-17T01:32:56.254349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:56.021140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.251654+0000","last_change":"2024-09-17T01:32:55.272949+0000","last_active":"2024-09-17T01:32:56.251654+0000","last_peered":"2024-09-17T01:32:56.251654+0000","last_clean":"2024-09-17T01:32:56.251654+0000","last_became_active":"2024-09-17T01:32:55.271731+0000","last_became_peered":"2024-09-17T01:32:55.271731+0000","last_unstale":"2024-09-17T01:32:56.251654+0000","last_undegraded":"2024-09-17T01:32:56.251654+0000","last_fullsized":"2024-09-17T01:32:56.251654+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:25.975979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083294+0000","last_change":"2024-09-17T01:32:55.267654+0000","last_active":"2024-09-17T01:32:57.083294+0000","last_peered":"2024-09-17T01:32:57.083294+0000","last_clean":"2024-09-17T01:32:57.083294+0000","last_became_active":"2024-09-17T01:32:55.267347+0000","last_became_peered":"2024-09-17T01:32:55.267347+0000","last_unstale":"2024-09-17T01:32:57.083294+0000","last_undegraded":"2024-09-17T01:32:57.083294+0000","last_fullsized":"2024-09-17T01:32:57.083294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:55.546679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254838+0000","last_change":"2024-09-17T01:32:55.284646+0000","last_active":"2024-09-17T01:32:56.254838+0000","last_peered":"2024-09-17T01:32:56.254838+0000","last_clean":"2024-09-17T01:32:56.254838+0000","last_became_active":"2024-09-17T01:32:55.284369+0000","last_became_peered":"2024-09-17T01:32:55.284369+0000","last_unstale":"2024-09-17T01:32:56.254838+0000","last_undegraded":"2024-09-17T01:32:56.254838+0000","last_fullsized":"2024-09-17T01:32:56.254838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:50.201340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.253300+0000","last_change":"2024-09-17T01:32:55.274253+0000","last_active":"2024-09-17T01:32:56.253300+0000","last_peered":"2024-09-17T01:32:56.253300+0000","last_clean":"2024-09-17T01:32:56.253300+0000","last_became_active":"2024-09-17T01:32:55.273796+0000","last_became_peered":"2024-09-17T01:32:55.273796+0000","last_unstale":"2024-09-17T01:32:56.253300+0000","last_undegraded":"2024-09-17T01:32:56.253300+0000","last_fullsized":"2024-09-17T01:32:56.253300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:36:02.889869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.081711+0000","last_change":"2024-09-17T01:32:55.280963+0000","last_active":"2024-09-17T01:32:57.081711+0000","last_peered":"2024-09-17T01:32:57.081711+0000","last_clean":"2024-09-17T01:32:57.081711+0000","last_became_active":"2024-09-17T01:32:55.280644+0000","last_became_peered":"2024-09-17T01:32:55.280644+0000","last_unstale":"2024-09-17T01:32:57.081711+0000","last_undegraded":"2024-09-17T01:32:57.081711+0000","last_fullsized":"2024-09-17T01:32:57.081711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:50.201340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082576+0000","last_change":"2024-09-17T01:32:55.271372+0000","last_active":"2024-09-17T01:32:57.082576+0000","last_peered":"2024-09-17T01:32:57.082576+0000","last_clean":"2024-09-17T01:32:57.082576+0000","last_became_active":"2024-09-17T01:32:55.271050+0000","last_became_peered":"2024-09-17T01:32:55.271050+0000","last_unstale":"2024-09-17T01:32:57.082576+0000","last_undegraded":"2024-09-17T01:32:57.082576+0000","last_fullsized":"2024-09-17T01:32:57.082576+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:44.805529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.252014+0000","last_change":"2024-09-17T01:32:55.284437+0000","last_active":"2024-09-17T01:32:56.252014+0000","last_peered":"2024-09-17T01:32:56.252014+0000","last_clean":"2024-09-17T01:32:56.252014+0000","last_became_active":"2024-09-17T01:32:55.284104+0000","last_became_peered":"2024-09-17T01:32:55.284104+0000","last_unstale":"2024-09-17T01:32:56.252014+0000","last_undegraded":"2024-09-17T01:32:56.252014+0000","last_fullsized":"2024-09-17T01:32:56.252014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:39.864745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.272375+0000","last_change":"2024-09-17T01:32:55.277229+0000","last_active":"2024-09-17T01:32:56.272375+0000","last_peered":"2024-09-17T01:32:56.272375+0000","last_clean":"2024-09-17T01:32:56.272375+0000","last_became_active":"2024-09-17T01:32:55.276726+0000","last_became_peered":"2024-09-17T01:32:55.276726+0000","last_unstale":"2024-09-17T01:32:56.272375+0000","last_undegraded":"2024-09-17T01:32:56.272375+0000","last_fullsized":"2024-09-17T01:32:56.272375+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:45:00.782429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.272227+0000","last_change":"2024-09-17T01:32:55.271370+0000","last_active":"2024-09-17T01:32:56.272227+0000","last_peered":"2024-09-17T01:32:56.272227+0000","last_clean":"2024-09-17T01:32:56.272227+0000","last_became_active":"2024-09-17T01:32:55.269831+0000","last_became_peered":"2024-09-17T01:32:55.269831+0000","last_unstale":"2024-09-17T01:32:56.272227+0000","last_undegraded":"2024-09-17T01:32:56.272227+0000","last_fullsized":"2024-09-17T01:32:56.272227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:57.955582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254108+0000","last_change":"2024-09-17T01:32:55.271965+0000","last_active":"2024-09-17T01:32:56.254108+0000","last_peered":"2024-09-17T01:32:56.254108+0000","last_clean":"2024-09-17T01:32:56.254108+0000","last_became_active":"2024-09-17T01:32:55.271388+0000","last_became_peered":"2024-09-17T01:32:55.271388+0000","last_unstale":"2024-09-17T01:32:56.254108+0000","last_undegraded":"2024-09-17T01:32:56.254108+0000","last_fullsized":"2024-09-17T01:32:56.254108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:38.617789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082146+0000","last_change":"2024-09-17T01:32:55.267860+0000","last_active":"2024-09-17T01:32:57.082146+0000","last_peered":"2024-09-17T01:32:57.082146+0000","last_clean":"2024-09-17T01:32:57.082146+0000","last_became_active":"2024-09-17T01:32:55.267651+0000","last_became_peered":"2024-09-17T01:32:55.267651+0000","last_unstale":"2024-09-17T01:32:57.082146+0000","last_undegraded":"2024-09-17T01:32:57.082146+0000","last_fullsized":"2024-09-17T01:32:57.082146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:10.089599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082616+0000","last_change":"2024-09-17T01:32:55.283222+0000","last_active":"2024-09-17T01:32:57.082616+0000","last_peered":"2024-09-17T01:32:57.082616+0000","last_clean":"2024-09-17T01:32:57.082616+0000","last_became_active":"2024-09-17T01:32:55.282841+0000","last_became_peered":"2024-09-17T01:32:55.282841+0000","last_unstale":"2024-09-17T01:32:57.082616+0000","last_undegraded":"2024-09-17T01:32:57.082616+0000","last_fullsized":"2024-09-17T01:32:57.082616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:58.411166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.252402+0000","last_change":"2024-09-17T01:32:55.276032+0000","last_active":"2024-09-17T01:32:56.252402+0000","last_peered":"2024-09-17T01:32:56.252402+0000","last_clean":"2024-09-17T01:32:56.252402+0000","last_became_active":"2024-09-17T01:32:55.275595+0000","last_became_peered":"2024-09-17T01:32:55.275595+0000","last_unstale":"2024-09-17T01:32:56.252402+0000","last_undegraded":"2024-09-17T01:32:56.252402+0000","last_fullsized":"2024-09-17T01:32:56.252402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:24.265399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.081625+0000","last_change":"2024-09-17T01:32:55.281293+0000","last_active":"2024-09-17T01:32:57.081625+0000","last_peered":"2024-09-17T01:32:57.081625+0000","last_clean":"2024-09-17T01:32:57.081625+0000","last_became_active":"2024-09-17T01:32:55.280932+0000","last_became_peered":"2024-09-17T01:32:55.280932+0000","last_unstale":"2024-09-17T01:32:57.081625+0000","last_undegraded":"2024-09-17T01:32:57.081625+0000","last_fullsized":"2024-09-17T01:32:57.081625+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:06.688211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254172+0000","last_change":"2024-09-17T01:32:55.270509+0000","last_active":"2024-09-17T01:32:56.254172+0000","last_peered":"2024-09-17T01:32:56.254172+0000","last_clean":"2024-09-17T01:32:56.254172+0000","last_became_active":"2024-09-17T01:32:55.270137+0000","last_became_peered":"2024-09-17T01:32:55.270137+0000","last_unstale":"2024-09-17T01:32:56.254172+0000","last_undegraded":"2024-09-17T01:32:56.254172+0000","last_fullsized":"2024-09-17T01:32:56.254172+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:56.911430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.253986+0000","last_change":"2024-09-17T01:32:55.277658+0000","last_active":"2024-09-17T01:32:56.253986+0000","last_peered":"2024-09-17T01:32:56.253986+0000","last_clean":"2024-09-17T01:32:56.253986+0000","last_became_active":"2024-09-17T01:32:55.277194+0000","last_became_peered":"2024-09-17T01:32:55.277194+0000","last_unstale":"2024-09-17T01:32:56.253986+0000","last_undegraded":"2024-09-17T01:32:56.253986+0000","last_fullsized":"2024-09-17T01:32:56.253986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:54.104314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269159+0000","last_change":"2024-09-17T01:32:55.258825+0000","last_active":"2024-09-17T01:32:56.269159+0000","last_peered":"2024-09-17T01:32:56.269159+0000","last_clean":"2024-09-17T01:32:56.269159+0000","last_became_active":"2024-09-17T01:32:55.258420+0000","last_became_peered":"2024-09-17T01:32:55.258420+0000","last_unstale":"2024-09-17T01:32:56.269159+0000","last_undegraded":"2024-09-17T01:32:56.269159+0000","last_fullsized":"2024-09-17T01:32:56.269159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:07.739522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083210+0000","last_change":"2024-09-17T01:32:55.279814+0000","last_active":"2024-09-17T01:32:57.083210+0000","last_peered":"2024-09-17T01:32:57.083210+0000","last_clean":"2024-09-17T01:32:57.083210+0000","last_became_active":"2024-09-17T01:32:55.278739+0000","last_became_peered":"2024-09-17T01:32:55.278739+0000","last_unstale":"2024-09-17T01:32:57.083210+0000","last_undegraded":"2024-09-17T01:32:57.083210+0000","last_fullsized":"2024-09-17T01:32:57.083210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:59.516912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.081697+0000","last_change":"2024-09-17T01:32:55.275915+0000","last_active":"2024-09-17T01:32:57.081697+0000","last_peered":"2024-09-17T01:32:57.081697+0000","last_clean":"2024-09-17T01:32:57.081697+0000","last_became_active":"2024-09-17T01:32:55.275543+0000","last_became_peered":"2024-09-17T01:32:55.275543+0000","last_unstale":"2024-09-17T01:32:57.081697+0000","last_undegraded":"2024-09-17T01:32:57.081697+0000","last_fullsized":"2024-09-17T01:32:57.081697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:06.603944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082048+0000","last_change":"2024-09-17T01:32:55.263275+0000","last_active":"2024-09-17T01:32:57.082048+0000","last_peered":"2024-09-17T01:32:57.082048+0000","last_clean":"2024-09-17T01:32:57.082048+0000","last_became_active":"2024-09-17T01:32:55.262913+0000","last_became_peered":"2024-09-17T01:32:55.262913+0000","last_unstale":"2024-09-17T01:32:57.082048+0000","last_undegraded":"2024-09-17T01:32:57.082048+0000","last_fullsized":"2024-09-17T01:32:57.082048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:45:49.776470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082034+0000","last_change":"2024-09-17T01:32:55.278268+0000","last_active":"2024-09-17T01:32:57.082034+0000","last_peered":"2024-09-17T01:32:57.082034+0000","last_clean":"2024-09-17T01:32:57.082034+0000","last_became_active":"2024-09-17T01:32:55.277398+0000","last_became_peered":"2024-09-17T01:32:55.277398+0000","last_unstale":"2024-09-17T01:32:57.082034+0000","last_undegraded":"2024-09-17T01:32:57.082034+0000","last_fullsized":"2024-09-17T01:32:57.082034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:16.837875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.250854+0000","last_change":"2024-09-17T01:32:55.279618+0000","last_active":"2024-09-17T01:32:56.250854+0000","last_peered":"2024-09-17T01:32:56.250854+0000","last_clean":"2024-09-17T01:32:56.250854+0000","last_became_active":"2024-09-17T01:32:55.279251+0000","last_became_peered":"2024-09-17T01:32:55.279251+0000","last_unstale":"2024-09-17T01:32:56.250854+0000","last_undegraded":"2024-09-17T01:32:56.250854+0000","last_fullsized":"2024-09-17T01:32:56.250854+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:16.980206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254844+0000","last_change":"2024-09-17T01:32:55.282016+0000","last_active":"2024-09-17T01:32:56.254844+0000","last_peered":"2024-09-17T01:32:56.254844+0000","last_clean":"2024-09-17T01:32:56.254844+0000","last_became_active":"2024-09-17T01:32:55.281337+0000","last_became_peered":"2024-09-17T01:32:55.281337+0000","last_unstale":"2024-09-17T01:32:56.254844+0000","last_undegraded":"2024-09-17T01:32:56.254844+0000","last_fullsized":"2024-09-17T01:32:56.254844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:39:51.377597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.252116+0000","last_change":"2024-09-17T01:32:54.273748+0000","last_active":"2024-09-17T01:32:56.252116+0000","last_peered":"2024-09-17T01:32:56.252116+0000","last_clean":"2024-09-17T01:32:56.252116+0000","last_became_active":"2024-09-17T01:32:54.273437+0000","last_became_peered":"2024-09-17T01:32:54.273437+0000","last_unstale":"2024-09-17T01:32:56.252116+0000","last_undegraded":"2024-09-17T01:32:56.252116+0000","last_fullsized":"2024-09-17T01:32:56.252116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:52.612630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083372+0000","last_change":"2024-09-17T01:32:55.276719+0000","last_active":"2024-09-17T01:32:57.083372+0000","last_peered":"2024-09-17T01:32:57.083372+0000","last_clean":"2024-09-17T01:32:57.083372+0000","last_became_active":"2024-09-17T01:32:55.276410+0000","last_became_peered":"2024-09-17T01:32:55.276410+0000","last_unstale":"2024-09-17T01:32:57.083372+0000","last_undegraded":"2024-09-17T01:32:57.083372+0000","last_fullsized":"2024-09-17T01:32:57.083372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:05.011121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254223+0000","last_change":"2024-09-17T01:32:54.270531+0000","last_active":"2024-09-17T01:32:56.254223+0000","last_peered":"2024-09-17T01:32:56.254223+0000","last_clean":"2024-09-17T01:32:56.254223+0000","last_became_active":"2024-09-17T01:32:54.270161+0000","last_became_peered":"2024-09-17T01:32:54.270161+0000","last_unstale":"2024-09-17T01:32:56.254223+0000","last_undegraded":"2024-09-17T01:32:56.254223+0000","last_fullsized":"2024-09-17T01:32:56.254223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:34.037700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083440+0000","last_change":"2024-09-17T01:32:55.283488+0000","last_active":"2024-09-17T01:32:57.083440+0000","last_peered":"2024-09-17T01:32:57.083440+0000","last_clean":"2024-09-17T01:32:57.083440+0000","last_became_active":"2024-09-17T01:32:55.283023+0000","last_became_peered":"2024-09-17T01:32:55.283023+0000","last_unstale":"2024-09-17T01:32:57.083440+0000","last_undegraded":"2024-09-17T01:32:57.083440+0000","last_fullsized":"2024-09-17T01:32:57.083440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:02.481456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.272566+0000","last_change":"2024-09-17T01:32:54.276942+0000","last_active":"2024-09-17T01:32:56.272566+0000","last_peered":"2024-09-17T01:32:56.272566+0000","last_clean":"2024-09-17T01:32:56.272566+0000","last_became_active":"2024-09-17T01:32:54.275355+0000","last_became_peered":"2024-09-17T01:32:54.275355+0000","last_unstale":"2024-09-17T01:32:56.272566+0000","last_undegraded":"2024-09-17T01:32:56.272566+0000","last_fullsized":"2024-09-17T01:32:56.272566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:40.343262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254319+0000","last_change":"2024-09-17T01:32:55.285200+0000","last_active":"2024-09-17T01:32:56.254319+0000","last_peered":"2024-09-17T01:32:56.254319+0000","last_clean":"2024-09-17T01:32:56.254319+0000","last_became_active":"2024-09-17T01:32:55.284886+0000","last_became_peered":"2024-09-17T01:32:55.284886+0000","last_unstale":"2024-09-17T01:32:56.254319+0000","last_undegraded":"2024-09-17T01:32:56.254319+0000","last_fullsized":"2024-09-17T01:32:56.254319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:44.470345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254156+0000","last_change":"2024-09-17T01:32:54.262112+0000","last_active":"2024-09-17T01:32:56.254156+0000","last_peered":"2024-09-17T01:32:56.254156+0000","last_clean":"2024-09-17T01:32:56.254156+0000","last_became_active":"2024-09-17T01:32:54.261706+0000","last_became_peered":"2024-09-17T01:32:54.261706+0000","last_unstale":"2024-09-17T01:32:56.254156+0000","last_undegraded":"2024-09-17T01:32:56.254156+0000","last_fullsized":"2024-09-17T01:32:56.254156+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:47.082248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082930+0000","last_change":"2024-09-17T01:32:55.270615+0000","last_active":"2024-09-17T01:32:57.082930+0000","last_peered":"2024-09-17T01:32:57.082930+0000","last_clean":"2024-09-17T01:32:57.082930+0000","last_became_active":"2024-09-17T01:32:55.270248+0000","last_became_peered":"2024-09-17T01:32:55.270248+0000","last_unstale":"2024-09-17T01:32:57.082930+0000","last_undegraded":"2024-09-17T01:32:57.082930+0000","last_fullsized":"2024-09-17T01:32:57.082930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:37:24.005353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083227+0000","last_change":"2024-09-17T01:32:54.270450+0000","last_active":"2024-09-17T01:32:57.083227+0000","last_peered":"2024-09-17T01:32:57.083227+0000","last_clean":"2024-09-17T01:32:57.083227+0000","last_became_active":"2024-09-17T01:32:54.270127+0000","last_became_peered":"2024-09-17T01:32:54.270127+0000","last_unstale":"2024-09-17T01:32:57.083227+0000","last_undegraded":"2024-09-17T01:32:57.083227+0000","last_fullsized":"2024-09-17T01:32:57.083227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:37:22.998881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083070+0000","last_change":"2024-09-17T01:32:55.279427+0000","last_active":"2024-09-17T01:32:57.083070+0000","last_peered":"2024-09-17T01:32:57.083070+0000","last_clean":"2024-09-17T01:32:57.083070+0000","last_became_active":"2024-09-17T01:32:55.278575+0000","last_became_peered":"2024-09-17T01:32:55.278575+0000","last_unstale":"2024-09-17T01:32:57.083070+0000","last_undegraded":"2024-09-17T01:32:57.083070+0000","last_fullsized":"2024-09-17T01:32:57.083070+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:36.683405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082840+0000","last_change":"2024-09-17T01:32:54.263865+0000","last_active":"2024-09-17T01:32:57.082840+0000","last_peered":"2024-09-17T01:32:57.082840+0000","last_clean":"2024-09-17T01:32:57.082840+0000","last_became_active":"2024-09-17T01:32:54.263543+0000","last_became_peered":"2024-09-17T01:32:54.263543+0000","last_unstale":"2024-09-17T01:32:57.082840+0000","last_undegraded":"2024-09-17T01:32:57.082840+0000","last_fullsized":"2024-09-17T01:32:57.082840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:08.574044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083709+0000","last_change":"2024-09-17T01:32:55.258824+0000","last_active":"2024-09-17T01:32:57.083709+0000","last_peered":"2024-09-17T01:32:57.083709+0000","last_clean":"2024-09-17T01:32:57.083709+0000","last_became_active":"2024-09-17T01:32:55.256418+0000","last_became_peered":"2024-09-17T01:32:55.256418+0000","last_unstale":"2024-09-17T01:32:57.083709+0000","last_undegraded":"2024-09-17T01:32:57.083709+0000","last_fullsized":"2024-09-17T01:32:57.083709+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:25.676572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.272096+0000","last_change":"2024-09-17T01:32:54.277476+0000","last_active":"2024-09-17T01:32:56.272096+0000","last_peered":"2024-09-17T01:32:56.272096+0000","last_clean":"2024-09-17T01:32:56.272096+0000","last_became_active":"2024-09-17T01:32:54.275552+0000","last_became_peered":"2024-09-17T01:32:54.275552+0000","last_unstale":"2024-09-17T01:32:56.272096+0000","last_undegraded":"2024-09-17T01:32:56.272096+0000","last_fullsized":"2024-09-17T01:32:56.272096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:24.959553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.252336+0000","last_change":"2024-09-17T01:32:55.268898+0000","last_active":"2024-09-17T01:32:56.252336+0000","last_peered":"2024-09-17T01:32:56.252336+0000","last_clean":"2024-09-17T01:32:56.252336+0000","last_became_active":"2024-09-17T01:32:55.268541+0000","last_became_peered":"2024-09-17T01:32:55.268541+0000","last_unstale":"2024-09-17T01:32:56.252336+0000","last_undegraded":"2024-09-17T01:32:56.252336+0000","last_fullsized":"2024-09-17T01:32:56.252336+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:03.996972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082176+0000","last_change":"2024-09-17T01:32:54.267969+0000","last_active":"2024-09-17T01:32:57.082176+0000","last_peered":"2024-09-17T01:32:57.082176+0000","last_clean":"2024-09-17T01:32:57.082176+0000","last_became_active":"2024-09-17T01:32:54.267655+0000","last_became_peered":"2024-09-17T01:32:54.267655+0000","last_unstale":"2024-09-17T01:32:57.082176+0000","last_undegraded":"2024-09-17T01:32:57.082176+0000","last_fullsized":"2024-09-17T01:32:57.082176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:52:13.804280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.251690+0000","last_change":"2024-09-17T01:32:55.288590+0000","last_active":"2024-09-17T01:32:56.251690+0000","last_peered":"2024-09-17T01:32:56.251690+0000","last_clean":"2024-09-17T01:32:56.251690+0000","last_became_active":"2024-09-17T01:32:55.288326+0000","last_became_peered":"2024-09-17T01:32:55.288326+0000","last_unstale":"2024-09-17T01:32:56.251690+0000","last_undegraded":"2024-09-17T01:32:56.251690+0000","last_fullsized":"2024-09-17T01:32:56.251690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:10.999916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269288+0000","last_change":"2024-09-17T01:32:54.265327+0000","last_active":"2024-09-17T01:32:56.269288+0000","last_peered":"2024-09-17T01:32:56.269288+0000","last_clean":"2024-09-17T01:32:56.269288+0000","last_became_active":"2024-09-17T01:32:54.265022+0000","last_became_peered":"2024-09-17T01:32:54.265022+0000","last_unstale":"2024-09-17T01:32:56.269288+0000","last_undegraded":"2024-09-17T01:32:56.269288+0000","last_fullsized":"2024-09-17T01:32:56.269288+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:36.740407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254440+0000","last_change":"2024-09-17T01:32:55.271519+0000","last_active":"2024-09-17T01:32:56.254440+0000","last_peered":"2024-09-17T01:32:56.254440+0000","last_clean":"2024-09-17T01:32:56.254440+0000","last_became_active":"2024-09-17T01:32:55.270178+0000","last_became_peered":"2024-09-17T01:32:55.270178+0000","last_unstale":"2024-09-17T01:32:56.254440+0000","last_undegraded":"2024-09-17T01:32:56.254440+0000","last_fullsized":"2024-09-17T01:32:56.254440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:47.475449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269099+0000","last_change":"2024-09-17T01:32:54.270692+0000","last_active":"2024-09-17T01:32:56.269099+0000","last_peered":"2024-09-17T01:32:56.269099+0000","last_clean":"2024-09-17T01:32:56.269099+0000","last_became_active":"2024-09-17T01:32:54.269836+0000","last_became_peered":"2024-09-17T01:32:54.269836+0000","last_unstale":"2024-09-17T01:32:56.269099+0000","last_undegraded":"2024-09-17T01:32:56.269099+0000","last_fullsized":"2024-09-17T01:32:56.269099+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:01.191442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254034+0000","last_change":"2024-09-17T01:32:55.281107+0000","last_active":"2024-09-17T01:32:56.254034+0000","last_peered":"2024-09-17T01:32:56.254034+0000","last_clean":"2024-09-17T01:32:56.254034+0000","last_became_active":"2024-09-17T01:32:55.280497+0000","last_became_peered":"2024-09-17T01:32:55.280497+0000","last_unstale":"2024-09-17T01:32:56.254034+0000","last_undegraded":"2024-09-17T01:32:56.254034+0000","last_fullsized":"2024-09-17T01:32:56.254034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:39.562251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.251357+0000","last_change":"2024-09-17T01:32:54.278326+0000","last_active":"2024-09-17T01:32:56.251357+0000","last_peered":"2024-09-17T01:32:56.251357+0000","last_clean":"2024-09-17T01:32:56.251357+0000","last_became_active":"2024-09-17T01:32:54.277421+0000","last_became_peered":"2024-09-17T01:32:54.277421+0000","last_unstale":"2024-09-17T01:32:56.251357+0000","last_undegraded":"2024-09-17T01:32:56.251357+0000","last_fullsized":"2024-09-17T01:32:56.251357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:09.083126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.251362+0000","last_change":"2024-09-17T01:32:55.272125+0000","last_active":"2024-09-17T01:32:56.251362+0000","last_peered":"2024-09-17T01:32:56.251362+0000","last_clean":"2024-09-17T01:32:56.251362+0000","last_became_active":"2024-09-17T01:32:55.271789+0000","last_became_peered":"2024-09-17T01:32:55.271789+0000","last_unstale":"2024-09-17T01:32:56.251362+0000","last_undegraded":"2024-09-17T01:32:56.251362+0000","last_fullsized":"2024-09-17T01:32:56.251362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:50.252168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254090+0000","last_change":"2024-09-17T01:32:54.263719+0000","last_active":"2024-09-17T01:32:56.254090+0000","last_peered":"2024-09-17T01:32:56.254090+0000","last_clean":"2024-09-17T01:32:56.254090+0000","last_became_active":"2024-09-17T01:32:54.263393+0000","last_became_peered":"2024-09-17T01:32:54.263393+0000","last_unstale":"2024-09-17T01:32:56.254090+0000","last_undegraded":"2024-09-17T01:32:56.254090+0000","last_fullsized":"2024-09-17T01:32:56.254090+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:01.659376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.252932+0000","last_change":"2024-09-17T01:32:55.276017+0000","last_active":"2024-09-17T01:32:56.252932+0000","last_peered":"2024-09-17T01:32:56.252932+0000","last_clean":"2024-09-17T01:32:56.252932+0000","last_became_active":"2024-09-17T01:32:55.275597+0000","last_became_peered":"2024-09-17T01:32:55.275597+0000","last_unstale":"2024-09-17T01:32:56.252932+0000","last_undegraded":"2024-09-17T01:32:56.252932+0000","last_fullsized":"2024-09-17T01:32:56.252932+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:15.133860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083239+0000","last_change":"2024-09-17T01:32:54.281274+0000","last_active":"2024-09-17T01:32:57.083239+0000","last_peered":"2024-09-17T01:32:57.083239+0000","last_clean":"2024-09-17T01:32:57.083239+0000","last_became_active":"2024-09-17T01:32:54.276072+0000","last_became_peered":"2024-09-17T01:32:54.276072+0000","last_unstale":"2024-09-17T01:32:57.083239+0000","last_undegraded":"2024-09-17T01:32:57.083239+0000","last_fullsized":"2024-09-17T01:32:57.083239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:54.540207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.253296+0000","last_change":"2024-09-17T01:32:55.286397+0000","last_active":"2024-09-17T01:32:56.253296+0000","last_peered":"2024-09-17T01:32:56.253296+0000","last_clean":"2024-09-17T01:32:56.253296+0000","last_became_active":"2024-09-17T01:32:55.286050+0000","last_became_peered":"2024-09-17T01:32:55.286050+0000","last_unstale":"2024-09-17T01:32:56.253296+0000","last_undegraded":"2024-09-17T01:32:56.253296+0000","last_fullsized":"2024-09-17T01:32:56.253296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:29.319900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.253554+0000","last_change":"2024-09-17T01:32:54.276866+0000","last_active":"2024-09-17T01:32:56.253554+0000","last_peered":"2024-09-17T01:32:56.253554+0000","last_clean":"2024-09-17T01:32:56.253554+0000","last_became_active":"2024-09-17T01:32:54.275207+0000","last_became_peered":"2024-09-17T01:32:54.275207+0000","last_unstale":"2024-09-17T01:32:56.253554+0000","last_undegraded":"2024-09-17T01:32:56.253554+0000","last_fullsized":"2024-09-17T01:32:56.253554+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:48.529040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.081990+0000","last_change":"2024-09-17T01:32:55.274043+0000","last_active":"2024-09-17T01:32:57.081990+0000","last_peered":"2024-09-17T01:32:57.081990+0000","last_clean":"2024-09-17T01:32:57.081990+0000","last_became_active":"2024-09-17T01:32:55.273734+0000","last_became_peered":"2024-09-17T01:32:55.273734+0000","last_unstale":"2024-09-17T01:32:57.081990+0000","last_undegraded":"2024-09-17T01:32:57.081990+0000","last_fullsized":"2024-09-17T01:32:57.081990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:31.979443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.252784+0000","last_change":"2024-09-17T01:32:54.271260+0000","last_active":"2024-09-17T01:32:56.252784+0000","last_peered":"2024-09-17T01:32:56.252784+0000","last_clean":"2024-09-17T01:32:56.252784+0000","last_became_active":"2024-09-17T01:32:54.270930+0000","last_became_peered":"2024-09-17T01:32:54.270930+0000","last_unstale":"2024-09-17T01:32:56.252784+0000","last_undegraded":"2024-09-17T01:32:56.252784+0000","last_fullsized":"2024-09-17T01:32:56.252784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:57.951213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.251103+0000","last_change":"2024-09-17T01:32:55.291808+0000","last_active":"2024-09-17T01:32:56.251103+0000","last_peered":"2024-09-17T01:32:56.251103+0000","last_clean":"2024-09-17T01:32:56.251103+0000","last_became_active":"2024-09-17T01:32:55.289555+0000","last_became_peered":"2024-09-17T01:32:55.289555+0000","last_unstale":"2024-09-17T01:32:56.251103+0000","last_undegraded":"2024-09-17T01:32:56.251103+0000","last_fullsized":"2024-09-17T01:32:56.251103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:20.673746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.271975+0000","last_change":"2024-09-17T01:32:54.277270+0000","last_active":"2024-09-17T01:32:56.271975+0000","last_peered":"2024-09-17T01:32:56.271975+0000","last_clean":"2024-09-17T01:32:56.271975+0000","last_became_active":"2024-09-17T01:32:54.276138+0000","last_became_peered":"2024-09-17T01:32:54.276138+0000","last_unstale":"2024-09-17T01:32:56.271975+0000","last_undegraded":"2024-09-17T01:32:56.271975+0000","last_fullsized":"2024-09-17T01:32:56.271975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:12.577300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.251701+0000","last_change":"2024-09-17T01:32:55.288408+0000","last_active":"2024-09-17T01:32:56.251701+0000","last_peered":"2024-09-17T01:32:56.251701+0000","last_clean":"2024-09-17T01:32:56.251701+0000","last_became_active":"2024-09-17T01:32:55.287946+0000","last_became_peered":"2024-09-17T01:32:55.287946+0000","last_unstale":"2024-09-17T01:32:56.251701+0000","last_undegraded":"2024-09-17T01:32:56.251701+0000","last_fullsized":"2024-09-17T01:32:56.251701+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:26.648023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.272458+0000","last_change":"2024-09-17T01:32:54.275279+0000","last_active":"2024-09-17T01:32:56.272458+0000","last_peered":"2024-09-17T01:32:56.272458+0000","last_clean":"2024-09-17T01:32:56.272458+0000","last_became_active":"2024-09-17T01:32:54.274814+0000","last_became_peered":"2024-09-17T01:32:54.274814+0000","last_unstale":"2024-09-17T01:32:56.272458+0000","last_undegraded":"2024-09-17T01:32:56.272458+0000","last_fullsized":"2024-09-17T01:32:56.272458+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:19.817218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.084007+0000","last_change":"2024-09-17T01:32:55.257210+0000","last_active":"2024-09-17T01:32:57.084007+0000","last_peered":"2024-09-17T01:32:57.084007+0000","last_clean":"2024-09-17T01:32:57.084007+0000","last_became_active":"2024-09-17T01:32:55.256881+0000","last_became_peered":"2024-09-17T01:32:55.256881+0000","last_unstale":"2024-09-17T01:32:57.084007+0000","last_undegraded":"2024-09-17T01:32:57.084007+0000","last_fullsized":"2024-09-17T01:32:57.084007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:14.718167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083015+0000","last_change":"2024-09-17T01:32:54.277438+0000","last_active":"2024-09-17T01:32:57.083015+0000","last_peered":"2024-09-17T01:32:57.083015+0000","last_clean":"2024-09-17T01:32:57.083015+0000","last_became_active":"2024-09-17T01:32:54.277129+0000","last_became_peered":"2024-09-17T01:32:54.277129+0000","last_unstale":"2024-09-17T01:32:57.083015+0000","last_undegraded":"2024-09-17T01:32:57.083015+0000","last_fullsized":"2024-09-17T01:32:57.083015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:59.228808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269046+0000","last_change":"2024-09-17T01:32:55.259074+0000","last_active":"2024-09-17T01:32:56.269046+0000","last_peered":"2024-09-17T01:32:56.269046+0000","last_clean":"2024-09-17T01:32:56.269046+0000","last_became_active":"2024-09-17T01:32:55.258557+0000","last_became_peered":"2024-09-17T01:32:55.258557+0000","last_unstale":"2024-09-17T01:32:56.269046+0000","last_undegraded":"2024-09-17T01:32:56.269046+0000","last_fullsized":"2024-09-17T01:32:56.269046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:16.828516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.251796+0000","last_change":"2024-09-17T01:32:54.277977+0000","last_active":"2024-09-17T01:32:56.251796+0000","last_peered":"2024-09-17T01:32:56.251796+0000","last_clean":"2024-09-17T01:32:56.251796+0000","last_became_active":"2024-09-17T01:32:54.276470+0000","last_became_peered":"2024-09-17T01:32:54.276470+0000","last_unstale":"2024-09-17T01:32:56.251796+0000","last_undegraded":"2024-09-17T01:32:56.251796+0000","last_fullsized":"2024-09-17T01:32:56.251796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:20.970703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.272326+0000","last_change":"2024-09-17T01:32:55.268454+0000","last_active":"2024-09-17T01:32:56.272326+0000","last_peered":"2024-09-17T01:32:56.272326+0000","last_clean":"2024-09-17T01:32:56.272326+0000","last_became_active":"2024-09-17T01:32:55.268063+0000","last_became_peered":"2024-09-17T01:32:55.268063+0000","last_unstale":"2024-09-17T01:32:56.272326+0000","last_undegraded":"2024-09-17T01:32:56.272326+0000","last_fullsized":"2024-09-17T01:32:56.272326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:26.598329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082316+0000","last_change":"2024-09-17T01:32:54.266920+0000","last_active":"2024-09-17T01:32:57.082316+0000","last_peered":"2024-09-17T01:32:57.082316+0000","last_clean":"2024-09-17T01:32:57.082316+0000","last_became_active":"2024-09-17T01:32:54.266582+0000","last_became_peered":"2024-09-17T01:32:54.266582+0000","last_unstale":"2024-09-17T01:32:57.082316+0000","last_undegraded":"2024-09-17T01:32:57.082316+0000","last_fullsized":"2024-09-17T01:32:57.082316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:25.978040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.253406+0000","last_change":"2024-09-17T01:32:55.275935+0000","last_active":"2024-09-17T01:32:56.253406+0000","last_peered":"2024-09-17T01:32:56.253406+0000","last_clean":"2024-09-17T01:32:56.253406+0000","last_became_active":"2024-09-17T01:32:55.275569+0000","last_became_peered":"2024-09-17T01:32:55.275569+0000","last_unstale":"2024-09-17T01:32:56.253406+0000","last_undegraded":"2024-09-17T01:32:56.253406+0000","last_fullsized":"2024-09-17T01:32:56.253406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:35.224232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269159+0000","last_change":"2024-09-17T01:32:54.264750+0000","last_active":"2024-09-17T01:32:56.269159+0000","last_peered":"2024-09-17T01:32:56.269159+0000","last_clean":"2024-09-17T01:32:56.269159+0000","last_became_active":"2024-09-17T01:32:54.262686+0000","last_became_peered":"2024-09-17T01:32:54.262686+0000","last_unstale":"2024-09-17T01:32:56.269159+0000","last_undegraded":"2024-09-17T01:32:56.269159+0000","last_fullsized":"2024-09-17T01:32:56.269159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:17:55.846732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269330+0000","last_change":"2024-09-17T01:32:55.266507+0000","last_active":"2024-09-17T01:32:56.269330+0000","last_peered":"2024-09-17T01:32:56.269330+0000","last_clean":"2024-09-17T01:32:56.269330+0000","last_became_active":"2024-09-17T01:32:55.266152+0000","last_became_peered":"2024-09-17T01:32:55.266152+0000","last_unstale":"2024-09-17T01:32:56.269330+0000","last_undegraded":"2024-09-17T01:32:56.269330+0000","last_fullsized":"2024-09-17T01:32:56.269330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:19.375873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082966+0000","last_change":"2024-09-17T01:32:54.278174+0000","last_active":"2024-09-17T01:32:57.082966+0000","last_peered":"2024-09-17T01:32:57.082966+0000","last_clean":"2024-09-17T01:32:57.082966+0000","last_became_active":"2024-09-17T01:32:54.276004+0000","last_became_peered":"2024-09-17T01:32:54.276004+0000","last_unstale":"2024-09-17T01:32:57.082966+0000","last_undegraded":"2024-09-17T01:32:57.082966+0000","last_fullsized":"2024-09-17T01:32:57.082966+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:13.711695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.252495+0000","last_change":"2024-09-17T01:32:55.286356+0000","last_active":"2024-09-17T01:32:56.252495+0000","last_peered":"2024-09-17T01:32:56.252495+0000","last_clean":"2024-09-17T01:32:56.252495+0000","last_became_active":"2024-09-17T01:32:55.285612+0000","last_became_peered":"2024-09-17T01:32:55.285612+0000","last_unstale":"2024-09-17T01:32:56.252495+0000","last_undegraded":"2024-09-17T01:32:56.252495+0000","last_fullsized":"2024-09-17T01:32:56.252495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:34.033098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.081928+0000","last_change":"2024-09-17T01:32:54.263007+0000","last_active":"2024-09-17T01:32:57.081928+0000","last_peered":"2024-09-17T01:32:57.081928+0000","last_clean":"2024-09-17T01:32:57.081928+0000","last_became_active":"2024-09-17T01:32:54.262642+0000","last_became_peered":"2024-09-17T01:32:54.262642+0000","last_unstale":"2024-09-17T01:32:57.081928+0000","last_undegraded":"2024-09-17T01:32:57.081928+0000","last_fullsized":"2024-09-17T01:32:57.081928+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:21.236724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.081743+0000","last_change":"2024-09-17T01:32:55.257180+0000","last_active":"2024-09-17T01:32:57.081743+0000","last_peered":"2024-09-17T01:32:57.081743+0000","last_clean":"2024-09-17T01:32:57.081743+0000","last_became_active":"2024-09-17T01:32:55.256839+0000","last_became_peered":"2024-09-17T01:32:55.256839+0000","last_unstale":"2024-09-17T01:32:57.081743+0000","last_undegraded":"2024-09-17T01:32:57.081743+0000","last_fullsized":"2024-09-17T01:32:57.081743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:39.001302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.250847+0000","last_change":"2024-09-17T01:32:54.265991+0000","last_active":"2024-09-17T01:32:56.250847+0000","last_peered":"2024-09-17T01:32:56.250847+0000","last_clean":"2024-09-17T01:32:56.250847+0000","last_became_active":"2024-09-17T01:32:54.265640+0000","last_became_peered":"2024-09-17T01:32:54.265640+0000","last_unstale":"2024-09-17T01:32:56.250847+0000","last_undegraded":"2024-09-17T01:32:56.250847+0000","last_fullsized":"2024-09-17T01:32:56.250847+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:45:48.769998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.272451+0000","last_change":"2024-09-17T01:32:55.271056+0000","last_active":"2024-09-17T01:32:56.272451+0000","last_peered":"2024-09-17T01:32:56.272451+0000","last_clean":"2024-09-17T01:32:56.272451+0000","last_became_active":"2024-09-17T01:32:55.270714+0000","last_became_peered":"2024-09-17T01:32:55.270714+0000","last_unstale":"2024-09-17T01:32:56.272451+0000","last_undegraded":"2024-09-17T01:32:56.272451+0000","last_fullsized":"2024-09-17T01:32:56.272451+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:24.114366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254845+0000","last_change":"2024-09-17T01:32:54.263467+0000","last_active":"2024-09-17T01:32:56.254845+0000","last_peered":"2024-09-17T01:32:56.254845+0000","last_clean":"2024-09-17T01:32:56.254845+0000","last_became_active":"2024-09-17T01:32:54.263098+0000","last_became_peered":"2024-09-17T01:32:54.263098+0000","last_unstale":"2024-09-17T01:32:56.254845+0000","last_undegraded":"2024-09-17T01:32:56.254845+0000","last_fullsized":"2024-09-17T01:32:56.254845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:25.591856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.252100+0000","last_change":"2024-09-17T01:32:55.274792+0000","last_active":"2024-09-17T01:32:56.252100+0000","last_peered":"2024-09-17T01:32:56.252100+0000","last_clean":"2024-09-17T01:32:56.252100+0000","last_became_active":"2024-09-17T01:32:55.272127+0000","last_became_peered":"2024-09-17T01:32:55.272127+0000","last_unstale":"2024-09-17T01:32:56.252100+0000","last_undegraded":"2024-09-17T01:32:56.252100+0000","last_fullsized":"2024-09-17T01:32:56.252100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:42.717926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.269306+0000","last_change":"2024-09-17T01:32:54.269945+0000","last_active":"2024-09-17T01:32:56.269306+0000","last_peered":"2024-09-17T01:32:56.269306+0000","last_clean":"2024-09-17T01:32:56.269306+0000","last_became_active":"2024-09-17T01:32:54.269614+0000","last_became_peered":"2024-09-17T01:32:54.269614+0000","last_unstale":"2024-09-17T01:32:56.269306+0000","last_undegraded":"2024-09-17T01:32:56.269306+0000","last_fullsized":"2024-09-17T01:32:56.269306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:39.597893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.272519+0000","last_change":"2024-09-17T01:32:55.272683+0000","last_active":"2024-09-17T01:32:56.272519+0000","last_peered":"2024-09-17T01:32:56.272519+0000","last_clean":"2024-09-17T01:32:56.272519+0000","last_became_active":"2024-09-17T01:32:55.272225+0000","last_became_peered":"2024-09-17T01:32:55.272225+0000","last_unstale":"2024-09-17T01:32:56.272519+0000","last_undegraded":"2024-09-17T01:32:56.272519+0000","last_fullsized":"2024-09-17T01:32:56.272519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:58.957685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254234+0000","last_change":"2024-09-17T01:32:54.271877+0000","last_active":"2024-09-17T01:32:56.254234+0000","last_peered":"2024-09-17T01:32:56.254234+0000","last_clean":"2024-09-17T01:32:56.254234+0000","last_became_active":"2024-09-17T01:32:54.269407+0000","last_became_peered":"2024-09-17T01:32:54.269407+0000","last_unstale":"2024-09-17T01:32:56.254234+0000","last_undegraded":"2024-09-17T01:32:56.254234+0000","last_fullsized":"2024-09-17T01:32:56.254234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:59.964980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082294+0000","last_change":"2024-09-17T01:32:55.271939+0000","last_active":"2024-09-17T01:32:57.082294+0000","last_peered":"2024-09-17T01:32:57.082294+0000","last_clean":"2024-09-17T01:32:57.082294+0000","last_became_active":"2024-09-17T01:32:55.271618+0000","last_became_peered":"2024-09-17T01:32:55.271618+0000","last_unstale":"2024-09-17T01:32:57.082294+0000","last_undegraded":"2024-09-17T01:32:57.082294+0000","last_fullsized":"2024-09-17T01:32:57.082294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:21.977175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.254981+0000","last_change":"2024-09-17T01:32:54.266052+0000","last_active":"2024-09-17T01:32:56.254981+0000","last_peered":"2024-09-17T01:32:56.254981+0000","last_clean":"2024-09-17T01:32:56.254981+0000","last_became_active":"2024-09-17T01:32:54.265696+0000","last_became_peered":"2024-09-17T01:32:54.265696+0000","last_unstale":"2024-09-17T01:32:56.254981+0000","last_undegraded":"2024-09-17T01:32:56.254981+0000","last_fullsized":"2024-09-17T01:32:56.254981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:48.082182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.253599+0000","last_change":"2024-09-17T01:32:55.283496+0000","last_active":"2024-09-17T01:32:56.253599+0000","last_peered":"2024-09-17T01:32:56.253599+0000","last_clean":"2024-09-17T01:32:56.253599+0000","last_became_active":"2024-09-17T01:32:55.283189+0000","last_became_peered":"2024-09-17T01:32:55.283189+0000","last_unstale":"2024-09-17T01:32:56.253599+0000","last_undegraded":"2024-09-17T01:32:56.253599+0000","last_fullsized":"2024-09-17T01:32:56.253599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:17.554447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.253615+0000","last_change":"2024-09-17T01:32:54.274129+0000","last_active":"2024-09-17T01:32:56.253615+0000","last_peered":"2024-09-17T01:32:56.253615+0000","last_clean":"2024-09-17T01:32:56.253615+0000","last_became_active":"2024-09-17T01:32:54.273414+0000","last_became_peered":"2024-09-17T01:32:54.273414+0000","last_unstale":"2024-09-17T01:32:56.253615+0000","last_undegraded":"2024-09-17T01:32:56.253615+0000","last_fullsized":"2024-09-17T01:32:56.253615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:25.752893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.252363+0000","last_change":"2024-09-17T01:32:55.282507+0000","last_active":"2024-09-17T01:32:56.252363+0000","last_peered":"2024-09-17T01:32:56.252363+0000","last_clean":"2024-09-17T01:32:56.252363+0000","last_became_active":"2024-09-17T01:32:55.281836+0000","last_became_peered":"2024-09-17T01:32:55.281836+0000","last_unstale":"2024-09-17T01:32:56.252363+0000","last_undegraded":"2024-09-17T01:32:56.252363+0000","last_fullsized":"2024-09-17T01:32:56.252363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:34:28.124050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.082566+0000","last_change":"2024-09-17T01:32:54.277748+0000","last_active":"2024-09-17T01:32:57.082566+0000","last_peered":"2024-09-17T01:32:57.082566+0000","last_clean":"2024-09-17T01:32:57.082566+0000","last_became_active":"2024-09-17T01:32:54.277399+0000","last_became_peered":"2024-09-17T01:32:54.277399+0000","last_unstale":"2024-09-17T01:32:57.082566+0000","last_undegraded":"2024-09-17T01:32:57.082566+0000","last_fullsized":"2024-09-17T01:32:57.082566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:24.670099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.251342+0000","last_change":"2024-09-17T01:32:55.275514+0000","last_active":"2024-09-17T01:32:56.251342+0000","last_peered":"2024-09-17T01:32:56.251342+0000","last_clean":"2024-09-17T01:32:56.251342+0000","last_became_active":"2024-09-17T01:32:55.273253+0000","last_became_peered":"2024-09-17T01:32:55.273253+0000","last_unstale":"2024-09-17T01:32:56.251342+0000","last_undegraded":"2024-09-17T01:32:56.251342+0000","last_fullsized":"2024-09-17T01:32:56.251342+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:20.061628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.252334+0000","last_change":"2024-09-17T01:32:54.271709+0000","last_active":"2024-09-17T01:32:56.252334+0000","last_peered":"2024-09-17T01:32:56.252334+0000","last_clean":"2024-09-17T01:32:56.252334+0000","last_became_active":"2024-09-17T01:32:54.271408+0000","last_became_peered":"2024-09-17T01:32:54.271408+0000","last_unstale":"2024-09-17T01:32:56.252334+0000","last_undegraded":"2024-09-17T01:32:56.252334+0000","last_fullsized":"2024-09-17T01:32:56.252334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:23.107893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.081953+0000","last_change":"2024-09-17T01:32:55.273286+0000","last_active":"2024-09-17T01:32:57.081953+0000","last_peered":"2024-09-17T01:32:57.081953+0000","last_clean":"2024-09-17T01:32:57.081953+0000","last_became_active":"2024-09-17T01:32:55.271139+0000","last_became_peered":"2024-09-17T01:32:55.271139+0000","last_unstale":"2024-09-17T01:32:57.081953+0000","last_undegraded":"2024-09-17T01:32:57.081953+0000","last_fullsized":"2024-09-17T01:32:57.081953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:54.235595+0000","last_clean_scrub_stamp":"2024-09-17T01:32:54.235595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:53.619103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:56.251850+0000","last_change":"2024-09-17T01:32:54.278092+0000","last_active":"2024-09-17T01:32:56.251850+0000","last_peered":"2024-09-17T01:32:56.251850+0000","last_clean":"2024-09-17T01:32:56.251850+0000","last_became_active":"2024-09-17T01:32:54.276983+0000","last_became_peered":"2024-09-17T01:32:54.276983+0000","last_unstale":"2024-09-17T01:32:56.251850+0000","last_undegraded":"2024-09-17T01:32:56.251850+0000","last_fullsized":"2024-09-17T01:32:56.251850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:32:53.229122+0000","last_clean_scrub_stamp":"2024-09-17T01:32:53.229122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:43.799057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":130,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T01:32:57.083616+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:32:57.083616+0000","last_peered":"2024-09-17T01:32:57.083616+0000","last_clean":"2024-09-17T01:32:57.083616+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:32:57.083616+0000","last_undegraded":"2024-09-17T01:32:57.083616+0000","last_fullsized":"2024-09-17T01:32:57.083616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476753,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":368640,"data_stored":140119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":368640,"data_stored":140107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":376832,"data_stored":141697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":380928,"data_stored":141719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":380928,"data_stored":140861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":962560,"data_stored":730523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":368640,"data_stored":140175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":962560,"data_stored":731035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:33:05.249 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T01:33:05.250 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T01:33:05.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.520+0000 7f1c43e00640 1 -- 172.21.15.42:0/3914398443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c3c0af980 msgr2=0x7f1c3c0ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:05.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.520+0000 7f1c43e00640 1 --2- 172.21.15.42:0/3914398443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c3c0af980 0x7f1c3c0ceb40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1c28009830 tx=0x7f1c2802a5c0 comp rx=0 tx=0).stop 2024-09-17T01:33:05.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.520+0000 7f1c43e00640 1 -- 172.21.15.42:0/3914398443 shutdown_connections 2024-09-17T01:33:05.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.520+0000 7f1c43e00640 1 --2- 172.21.15.42:0/3914398443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c3c0af980 0x7f1c3c0ceb40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:05.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.520+0000 7f1c43e00640 1 -- 172.21.15.42:0/3914398443 >> 172.21.15.42:0/3914398443 conn(0x7f1c3c0b2930 msgr2=0x7f1c3c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:33:05.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.520+0000 7f1c43e00640 1 -- 172.21.15.42:0/3914398443 shutdown_connections 2024-09-17T01:33:05.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.520+0000 7f1c43e00640 1 -- 172.21.15.42:0/3914398443 wait complete. 2024-09-17T01:33:05.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.522+0000 7f1c43e00640 1 Processor -- start 2024-09-17T01:33:05.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.523+0000 7f1c43e00640 1 -- start start 2024-09-17T01:33:05.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.524+0000 7f1c43e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c3c06d430 0x7f1c3c154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:05.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.524+0000 7f1c43e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c3c0af980 0x7f1c3c159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:05.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.524+0000 7f1c43e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c3c0b3880 0x7f1c3c1f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:05.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.524+0000 7f1c43e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3c073cf0 con 0x7f1c3c06d430 2024-09-17T01:33:05.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.524+0000 7f1c43e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3c073b70 con 0x7f1c3c0b3880 2024-09-17T01:33:05.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.524+0000 7f1c43e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1c3c073e70 con 0x7f1c3c0af980 2024-09-17T01:33:05.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.524+0000 7f1c41400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c3c06d430 0x7f1c3c154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:05.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.524+0000 7f1c41400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c3c06d430 0x7f1c3c154030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48744/0 (socket says 172.21.15.42:48744) 2024-09-17T01:33:05.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.524+0000 7f1c41400640 1 -- 172.21.15.42:0/3555132428 learned_addr learned my addr 172.21.15.42:0/3555132428 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:33:05.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.524+0000 7f1c41e00640 1 --2- 172.21.15.42:0/3555132428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c3c0b3880 0x7f1c3c1f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:05.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.524+0000 7f1c40a00640 1 --2- 172.21.15.42:0/3555132428 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c3c0af980 0x7f1c3c159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:05.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.525+0000 7f1c41400640 1 -- 172.21.15.42:0/3555132428 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c3c0af980 msgr2=0x7f1c3c159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:05.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.525+0000 7f1c41400640 1 --2- 172.21.15.42:0/3555132428 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c3c0af980 0x7f1c3c159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:05.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.525+0000 7f1c41400640 1 -- 172.21.15.42:0/3555132428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c3c0b3880 msgr2=0x7f1c3c1f60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:05.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.525+0000 7f1c41400640 1 --2- 172.21.15.42:0/3555132428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c3c0b3880 0x7f1c3c1f60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:05.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.525+0000 7f1c41400640 1 -- 172.21.15.42:0/3555132428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c3c06e690 con 0x7f1c3c06d430 2024-09-17T01:33:05.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.525+0000 7f1c41400640 1 --2- 172.21.15.42:0/3555132428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c3c06d430 0x7f1c3c154030 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1c3000c400 tx=0x7f1c3000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:33:05.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.525+0000 7f1c39600640 1 -- 172.21.15.42:0/3555132428 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c30017070 con 0x7f1c3c06d430 2024-09-17T01:33:05.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.525+0000 7f1c39600640 1 -- 172.21.15.42:0/3555132428 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c300053c0 con 0x7f1c3c06d430 2024-09-17T01:33:05.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.525+0000 7f1c39600640 1 -- 172.21.15.42:0/3555132428 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c30003850 con 0x7f1c3c06d430 2024-09-17T01:33:05.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.525+0000 7f1c43e00640 1 -- 172.21.15.42:0/3555132428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c3c154b30 con 0x7f1c3c06d430 2024-09-17T01:33:05.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.526+0000 7f1c43e00640 1 -- 172.21.15.42:0/3555132428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c3c151550 con 0x7f1c3c06d430 2024-09-17T01:33:05.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.527+0000 7f1c43e00640 1 -- 172.21.15.42:0/3555132428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c3c0ceb40 con 0x7f1c3c06d430 2024-09-17T01:33:05.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.528+0000 7f1c39600640 1 -- 172.21.15.42:0/3555132428 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1c3001a070 con 0x7f1c3c06d430 2024-09-17T01:33:05.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.529+0000 7f1c39600640 1 --2- 172.21.15.42:0/3555132428 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1c1c078b90 0x7f1c1c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:05.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.529+0000 7f1c39600640 1 -- 172.21.15.42:0/3555132428 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f1c3009a0a0 con 0x7f1c3c06d430 2024-09-17T01:33:05.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.529+0000 7f1c40a00640 1 --2- 172.21.15.42:0/3555132428 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1c1c078b90 0x7f1c1c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:05.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.530+0000 7f1c40a00640 1 --2- 172.21.15.42:0/3555132428 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1c1c078b90 0x7f1c1c07b0a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1c28034000 tx=0x7f1c28004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:33:05.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.533+0000 7f1c39600640 1 -- 172.21.15.42:0/3555132428 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1c30061e80 con 0x7f1c3c06d430 2024-09-17T01:33:05.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.800+0000 7f1c43e00640 1 -- 172.21.15.42:0/3555132428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f1c3c06a170 con 0x7f1c3c06d430 2024-09-17T01:33:05.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.803+0000 7f1c39600640 1 -- 172.21.15.42:0/3555132428 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v29) ==== 190+0+147 (secure 0 0 0) 0x7f1c300668b0 con 0x7f1c3c06d430 2024-09-17T01:33:05.801 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-09-17T01:33:05.801 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA== 2024-09-17T01:33:05.801 INFO:teuthology.orchestra.run.smithi042.stdout: caps mds = "allow" 2024-09-17T01:33:05.801 INFO:teuthology.orchestra.run.smithi042.stdout: caps mon = "allow r" 2024-09-17T01:33:05.802 INFO:teuthology.orchestra.run.smithi042.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T01:33:05.802 INFO:teuthology.orchestra.run.smithi042.stderr:updated caps for client.0 2024-09-17T01:33:05.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.806+0000 7f1c43e00640 1 -- 172.21.15.42:0/3555132428 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1c1c078b90 msgr2=0x7f1c1c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:05.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.806+0000 7f1c43e00640 1 --2- 172.21.15.42:0/3555132428 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1c1c078b90 0x7f1c1c07b0a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1c28034000 tx=0x7f1c28004730 comp rx=0 tx=0).stop 2024-09-17T01:33:05.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.806+0000 7f1c43e00640 1 -- 172.21.15.42:0/3555132428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c3c06d430 msgr2=0x7f1c3c154030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:05.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.806+0000 7f1c43e00640 1 --2- 172.21.15.42:0/3555132428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c3c06d430 0x7f1c3c154030 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1c3000c400 tx=0x7f1c3000c8c0 comp rx=0 tx=0).stop 2024-09-17T01:33:05.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.806+0000 7f1c43e00640 1 -- 172.21.15.42:0/3555132428 shutdown_connections 2024-09-17T01:33:05.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.806+0000 7f1c43e00640 1 --2- 172.21.15.42:0/3555132428 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1c1c078b90 0x7f1c1c07b0a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:05.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.806+0000 7f1c43e00640 1 --2- 172.21.15.42:0/3555132428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c3c0b3880 0x7f1c3c1f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:05.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.806+0000 7f1c43e00640 1 --2- 172.21.15.42:0/3555132428 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c3c0af980 0x7f1c3c159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:05.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.806+0000 7f1c43e00640 1 --2- 172.21.15.42:0/3555132428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c3c06d430 0x7f1c3c154030 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:05.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.806+0000 7f1c43e00640 1 -- 172.21.15.42:0/3555132428 >> 172.21.15.42:0/3555132428 conn(0x7f1c3c0b2930 msgr2=0x7f1c3c15e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:33:05.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.806+0000 7f1c43e00640 1 -- 172.21.15.42:0/3555132428 shutdown_connections 2024-09-17T01:33:05.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:05.806+0000 7f1c43e00640 1 -- 172.21.15.42:0/3555132428 wait complete. 2024-09-17T01:33:05.827 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:33:06.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.057+0000 7fdf88c00640 1 -- 172.21.15.42:0/3369309496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf84142f40 msgr2=0x7fdf84072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:06.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.057+0000 7fdf88c00640 1 --2- 172.21.15.42:0/3369309496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf84142f40 0x7fdf84072950 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdf84071ef0 tx=0x7fdf7002a560 comp rx=0 tx=0).stop 2024-09-17T01:33:06.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.057+0000 7fdf88c00640 1 -- 172.21.15.42:0/3369309496 shutdown_connections 2024-09-17T01:33:06.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.057+0000 7fdf88c00640 1 --2- 172.21.15.42:0/3369309496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf84142f40 0x7fdf84072950 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:06.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.057+0000 7fdf88c00640 1 --2- 172.21.15.42:0/3369309496 >> v2:172.21.15.43:3300/0 conn(0x7fdf840b3550 0x7fdf8415cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:06.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.057+0000 7fdf88c00640 1 -- 172.21.15.42:0/3369309496 >> 172.21.15.42:0/3369309496 conn(0x7fdf840b2930 msgr2=0x7fdf8406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:33:06.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.057+0000 7fdf88c00640 1 -- 172.21.15.42:0/3369309496 shutdown_connections 2024-09-17T01:33:06.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.057+0000 7fdf88c00640 1 -- 172.21.15.42:0/3369309496 wait complete. 2024-09-17T01:33:06.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.059+0000 7fdf88c00640 1 Processor -- start 2024-09-17T01:33:06.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.059+0000 7fdf88c00640 1 -- start start 2024-09-17T01:33:06.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.061+0000 7fdf88c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf84072e90 0x7fdf841590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:06.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.061+0000 7fdf88c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf840b3550 0x7fdf8413c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:06.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.061+0000 7fdf88c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdf84142f40 0x7fdf8415bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:06.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.061+0000 7fdf88c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8406d5b0 con 0x7fdf840b3550 2024-09-17T01:33:06.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.061+0000 7fdf88c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8406d430 con 0x7fdf84072e90 2024-09-17T01:33:06.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.061+0000 7fdf88c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fdf8406d730 con 0x7fdf84142f40 2024-09-17T01:33:06.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.061+0000 7fdf81400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf840b3550 0x7fdf8413c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:06.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.061+0000 7fdf81400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf840b3550 0x7fdf8413c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36410/0 (socket says 172.21.15.42:36410) 2024-09-17T01:33:06.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.061+0000 7fdf81400640 1 -- 172.21.15.42:0/2074007894 learned_addr learned my addr 172.21.15.42:0/2074007894 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:33:06.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.061+0000 7fdf81e00640 1 --2- 172.21.15.42:0/2074007894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf84072e90 0x7fdf841590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:06.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.061+0000 7fdf82800640 1 --2- 172.21.15.42:0/2074007894 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdf84142f40 0x7fdf8415bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:06.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.062+0000 7fdf81400640 1 -- 172.21.15.42:0/2074007894 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdf84142f40 msgr2=0x7fdf8415bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:06.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.062+0000 7fdf81400640 1 --2- 172.21.15.42:0/2074007894 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdf84142f40 0x7fdf8415bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:06.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.062+0000 7fdf81400640 1 -- 172.21.15.42:0/2074007894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf84072e90 msgr2=0x7fdf841590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:06.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.062+0000 7fdf81400640 1 --2- 172.21.15.42:0/2074007894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf84072e90 0x7fdf841590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:06.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.062+0000 7fdf81400640 1 -- 172.21.15.42:0/2074007894 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf840aeba0 con 0x7fdf840b3550 2024-09-17T01:33:06.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.062+0000 7fdf81400640 1 --2- 172.21.15.42:0/2074007894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf840b3550 0x7fdf8413c7e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdf70000c00 tx=0x7fdf70003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:33:06.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.062+0000 7fdf7a000640 1 -- 172.21.15.42:0/2074007894 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7003e030 con 0x7fdf840b3550 2024-09-17T01:33:06.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.062+0000 7fdf7a000640 1 -- 172.21.15.42:0/2074007894 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf70003e00 con 0x7fdf840b3550 2024-09-17T01:33:06.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.062+0000 7fdf88c00640 1 -- 172.21.15.42:0/2074007894 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf840aee80 con 0x7fdf840b3550 2024-09-17T01:33:06.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.062+0000 7fdf7a000640 1 -- 172.21.15.42:0/2074007894 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf70035040 con 0x7fdf840b3550 2024-09-17T01:33:06.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.063+0000 7fdf88c00640 1 -- 172.21.15.42:0/2074007894 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf841f3ce0 con 0x7fdf840b3550 2024-09-17T01:33:06.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.063+0000 7fdf88c00640 1 -- 172.21.15.42:0/2074007894 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf8406dbe0 con 0x7fdf840b3550 2024-09-17T01:33:06.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.065+0000 7fdf7a000640 1 -- 172.21.15.42:0/2074007894 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdf70041030 con 0x7fdf840b3550 2024-09-17T01:33:06.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.066+0000 7fdf7a000640 1 --2- 172.21.15.42:0/2074007894 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdf64078bc0 0x7fdf6407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:06.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.066+0000 7fdf7a000640 1 -- 172.21.15.42:0/2074007894 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fdf700bb520 con 0x7fdf840b3550 2024-09-17T01:33:06.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.066+0000 7fdf81e00640 1 --2- 172.21.15.42:0/2074007894 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdf64078bc0 0x7fdf6407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:06.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.067+0000 7fdf81e00640 1 --2- 172.21.15.42:0/2074007894 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdf64078bc0 0x7fdf6407b0d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdf74004590 tx=0x7fdf7400b390 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:33:06.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.070+0000 7fdf7a000640 1 -- 172.21.15.42:0/2074007894 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdf70083270 con 0x7fdf840b3550 2024-09-17T01:33:06.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.302+0000 7fdf88c00640 1 -- 172.21.15.42:0/2074007894 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf8406a170 con 0x7fdf840b3550 2024-09-17T01:33:06.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.303+0000 7fdf7a000640 1 -- 172.21.15.42:0/2074007894 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5223 (secure 0 0 0) 0x7fdf70087ca0 con 0x7fdf840b3550 2024-09-17T01:33:06.301 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:33:06.301 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":17,"btime":"2024-09-17T01:32:58:269267+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4628,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/2560567328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2560567328},{"type":"v1","addr":"172.21.15.42:6833","nonce":2560567328}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1462836032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1462836032},{"type":"v1","addr":"172.21.15.43:6836","nonce":1462836032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4798,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3719448578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3719448578},{"type":"v1","addr":"172.21.15.43:6837","nonce":3719448578}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:32:54.766579+0000","modified":"2024-09-17T01:32:57.772964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4830},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4830":{"gid":4830,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3278817895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3278817895},{"type":"v1","addr":"172.21.15.42:6835","nonce":3278817895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4830,"qdb_cluster":[4830]},"id":2}]} 2024-09-17T01:33:06.301 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 17 2024-09-17T01:33:06.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.305+0000 7fdf88c00640 1 -- 172.21.15.42:0/2074007894 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdf64078bc0 msgr2=0x7fdf6407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:06.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.305+0000 7fdf88c00640 1 --2- 172.21.15.42:0/2074007894 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdf64078bc0 0x7fdf6407b0d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdf74004590 tx=0x7fdf7400b390 comp rx=0 tx=0).stop 2024-09-17T01:33:06.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.305+0000 7fdf88c00640 1 -- 172.21.15.42:0/2074007894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf840b3550 msgr2=0x7fdf8413c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:06.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.305+0000 7fdf88c00640 1 --2- 172.21.15.42:0/2074007894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf840b3550 0x7fdf8413c7e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdf70000c00 tx=0x7fdf70003910 comp rx=0 tx=0).stop 2024-09-17T01:33:06.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.305+0000 7fdf88c00640 1 -- 172.21.15.42:0/2074007894 shutdown_connections 2024-09-17T01:33:06.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.305+0000 7fdf88c00640 1 --2- 172.21.15.42:0/2074007894 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdf64078bc0 0x7fdf6407b0d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:06.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.305+0000 7fdf88c00640 1 --2- 172.21.15.42:0/2074007894 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdf84142f40 0x7fdf8415bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:06.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.305+0000 7fdf88c00640 1 --2- 172.21.15.42:0/2074007894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf840b3550 0x7fdf8413c7e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:06.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.305+0000 7fdf88c00640 1 --2- 172.21.15.42:0/2074007894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf84072e90 0x7fdf841590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:06.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.305+0000 7fdf88c00640 1 -- 172.21.15.42:0/2074007894 >> 172.21.15.42:0/2074007894 conn(0x7fdf840b2930 msgr2=0x7fdf84073c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:33:06.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.305+0000 7fdf88c00640 1 -- 172.21.15.42:0/2074007894 shutdown_connections 2024-09-17T01:33:06.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.305+0000 7fdf88c00640 1 -- 172.21.15.42:0/2074007894 wait complete. 2024-09-17T01:33:06.727 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:32:54.766579+0000', 'modified': '2024-09-17T01:32:57.772964+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4830}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4830': {'gid': 4830, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.42:6835/3278817895', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6834', 'nonce': 3278817895}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 3278817895}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4830, 'qdb_cluster': [4830]} 2024-09-17T01:33:06.728 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T01:33:06.728 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T01:33:06.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.963+0000 7f5a8d200640 1 -- 172.21.15.42:0/74281301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a8806d430 msgr2=0x7f5a8806d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:06.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.963+0000 7f5a8d200640 1 --2- 172.21.15.42:0/74281301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a8806d430 0x7f5a8806d840 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009830 tx=0x7f5a7402a5b0 comp rx=0 tx=0).stop 2024-09-17T01:33:06.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.964+0000 7f5a8d200640 1 -- 172.21.15.42:0/74281301 shutdown_connections 2024-09-17T01:33:06.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.964+0000 7f5a8d200640 1 --2- 172.21.15.42:0/74281301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a8806d430 0x7f5a8806d840 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:06.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.964+0000 7f5a8d200640 1 -- 172.21.15.42:0/74281301 >> 172.21.15.42:0/74281301 conn(0x7f5a880b2930 msgr2=0x7f5a8806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:33:06.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.964+0000 7f5a8d200640 1 -- 172.21.15.42:0/74281301 shutdown_connections 2024-09-17T01:33:06.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.964+0000 7f5a8d200640 1 -- 172.21.15.42:0/74281301 wait complete. 2024-09-17T01:33:06.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.966+0000 7f5a8d200640 1 Processor -- start 2024-09-17T01:33:06.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.966+0000 7f5a8d200640 1 -- start start 2024-09-17T01:33:06.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.967+0000 7f5a8d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a8806d430 0x7f5a880ad380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:06.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.968+0000 7f5a8d200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a8815cb80 0x7f5a881f4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:06.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.968+0000 7f5a8d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a8815f480 0x7f5a880ae650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:06.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.968+0000 7f5a8d200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5a88073960 con 0x7f5a8806d430 2024-09-17T01:33:06.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.968+0000 7f5a8d200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5a880737e0 con 0x7f5a8815f480 2024-09-17T01:33:06.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.968+0000 7f5a8d200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5a88073ae0 con 0x7f5a8815cb80 2024-09-17T01:33:06.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.968+0000 7f5a85e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a8806d430 0x7f5a880ad380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:06.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.968+0000 7f5a85e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a8806d430 0x7f5a880ad380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36418/0 (socket says 172.21.15.42:36418) 2024-09-17T01:33:06.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.968+0000 7f5a85e00640 1 -- 172.21.15.42:0/1855341270 learned_addr learned my addr 172.21.15.42:0/1855341270 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:33:06.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.968+0000 7f5a85400640 1 --2- 172.21.15.42:0/1855341270 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a8815cb80 0x7f5a881f4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:06.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.968+0000 7f5a86800640 1 --2- 172.21.15.42:0/1855341270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a8815f480 0x7f5a880ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:06.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.968+0000 7f5a85e00640 1 -- 172.21.15.42:0/1855341270 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a8815cb80 msgr2=0x7f5a881f4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:06.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.968+0000 7f5a85e00640 1 --2- 172.21.15.42:0/1855341270 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a8815cb80 0x7f5a881f4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:06.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.968+0000 7f5a85e00640 1 -- 172.21.15.42:0/1855341270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a8815f480 msgr2=0x7f5a880ae650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:06.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.968+0000 7f5a85e00640 1 --2- 172.21.15.42:0/1855341270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a8815f480 0x7f5a880ae650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:06.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.968+0000 7f5a85e00640 1 -- 172.21.15.42:0/1855341270 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a880ad8c0 con 0x7f5a8806d430 2024-09-17T01:33:06.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.968+0000 7f5a85400640 1 --2- 172.21.15.42:0/1855341270 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a8815cb80 0x7f5a881f4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:33:06.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.968+0000 7f5a85e00640 1 --2- 172.21.15.42:0/1855341270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a8806d430 0x7f5a880ad380 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5a7800c3a0 tx=0x7f5a7800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:33:06.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.969+0000 7f5a7e000640 1 -- 172.21.15.42:0/1855341270 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a78017070 con 0x7f5a8806d430 2024-09-17T01:33:06.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.969+0000 7f5a7e000640 1 -- 172.21.15.42:0/1855341270 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a780035f0 con 0x7f5a8806d430 2024-09-17T01:33:06.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.969+0000 7f5a8d200640 1 -- 172.21.15.42:0/1855341270 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a880aa5c0 con 0x7f5a8806d430 2024-09-17T01:33:06.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.969+0000 7f5a7e000640 1 -- 172.21.15.42:0/1855341270 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a78003a40 con 0x7f5a8806d430 2024-09-17T01:33:06.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.969+0000 7f5a8d200640 1 -- 172.21.15.42:0/1855341270 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a880aa860 con 0x7f5a8806d430 2024-09-17T01:33:06.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.971+0000 7f5a7e000640 1 -- 172.21.15.42:0/1855341270 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5a7801a070 con 0x7f5a8806d430 2024-09-17T01:33:06.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.972+0000 7f5a7e000640 1 --2- 172.21.15.42:0/1855341270 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5a68078b90 0x7f5a6807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:06.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.972+0000 7f5a7e000640 1 -- 172.21.15.42:0/1855341270 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f5a7809a0a0 con 0x7f5a8806d430 2024-09-17T01:33:06.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.973+0000 7f5a85400640 1 --2- 172.21.15.42:0/1855341270 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5a68078b90 0x7f5a6807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:06.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.973+0000 7f5a9429b740 1 Processor -- start 2024-09-17T01:33:06.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.973+0000 7f5a9429b740 1 -- start start 2024-09-17T01:33:06.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.973+0000 7f5a85400640 1 --2- 172.21.15.42:0/1855341270 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5a68078b90 0x7f5a6807b0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5a74034000 tx=0x7f5a74004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:33:06.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.974+0000 7f5a9429b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bfb270 0x562c11fe6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:06.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.974+0000 7f5a9429b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c11bd23b0 0x562c11f9bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:06.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.974+0000 7f5a9429b740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562c11bda590 0x562c11f9c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:06.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.974+0000 7f5a9429b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562c11f25430 con 0x562c11bfb270 2024-09-17T01:33:06.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.974+0000 7f5a9429b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562c11f155d0 con 0x562c11bd23b0 2024-09-17T01:33:06.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.974+0000 7f5a9429b740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x562c11f04a00 con 0x562c11bda590 2024-09-17T01:33:06.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.975+0000 7f5a85e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bfb270 0x562c11fe6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:06.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.975+0000 7f5a85e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bfb270 0x562c11fe6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36432/0 (socket says 172.21.15.42:36432) 2024-09-17T01:33:06.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.975+0000 7f5a85e00640 1 -- 172.21.15.42:0/1416183265 learned_addr learned my addr 172.21.15.42:0/1416183265 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:33:06.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.975+0000 7f5a85400640 1 --2- 172.21.15.42:0/1416183265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c11bd23b0 0x562c11f9bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:06.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.975+0000 7f5a86800640 1 --2- 172.21.15.42:0/1416183265 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562c11bda590 0x562c11f9c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:06.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.975+0000 7f5a85e00640 1 -- 172.21.15.42:0/1416183265 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562c11bda590 msgr2=0x562c11f9c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:33:06.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.975+0000 7f5a85e00640 1 --2- 172.21.15.42:0/1416183265 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562c11bda590 0x562c11f9c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:06.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.975+0000 7f5a85e00640 1 -- 172.21.15.42:0/1416183265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c11bd23b0 msgr2=0x562c11f9bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:33:06.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.975+0000 7f5a85e00640 1 --2- 172.21.15.42:0/1416183265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c11bd23b0 0x562c11f9bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:06.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.975+0000 7f5a85e00640 1 -- 172.21.15.42:0/1416183265 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c11ecd520 con 0x562c11bfb270 2024-09-17T01:33:06.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.975+0000 7f5a85e00640 1 --2- 172.21.15.42:0/1416183265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bfb270 0x562c11fe6a20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5a78061d60 tx=0x7f5a78061540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f1dbbb595c8d11 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:33:06.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.976+0000 7f5a72a00640 1 -- 172.21.15.42:0/1416183265 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a78065070 con 0x562c11bfb270 2024-09-17T01:33:06.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.976+0000 7f5a72a00640 1 -- 172.21.15.42:0/1416183265 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a78061dd0 con 0x562c11bfb270 2024-09-17T01:33:06.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.976+0000 7f5a72a00640 1 -- 172.21.15.42:0/1416183265 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7806b530 con 0x562c11bfb270 2024-09-17T01:33:06.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.976+0000 7f5a9429b740 1 -- 172.21.15.42:0/1416183265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bfb270 msgr2=0x562c11fe6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:06.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.976+0000 7f5a9429b740 1 --2- 172.21.15.42:0/1416183265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bfb270 0x562c11fe6a20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5a78061d60 tx=0x7f5a78061540 comp rx=0 tx=0).stop 2024-09-17T01:33:06.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.977+0000 7f5a9429b740 1 -- 172.21.15.42:0/1416183265 shutdown_connections 2024-09-17T01:33:06.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.977+0000 7f5a9429b740 1 --2- 172.21.15.42:0/1416183265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c11bd23b0 0x562c11f9bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:06.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.977+0000 7f5a9429b740 1 --2- 172.21.15.42:0/1416183265 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562c11bda590 0x562c11f9c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:06.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.977+0000 7f5a9429b740 1 --2- 172.21.15.42:0/1416183265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bfb270 0x562c11fe6a20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:06.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.977+0000 7f5a9429b740 1 -- 172.21.15.42:0/1416183265 >> 172.21.15.42:0/1416183265 conn(0x562c11bef3c0 msgr2=0x562c11fa1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:33:06.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.977+0000 7f5a9429b740 1 -- 172.21.15.42:0/1416183265 shutdown_connections 2024-09-17T01:33:06.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.977+0000 7f5a9429b740 1 -- 172.21.15.42:0/1416183265 wait complete. 2024-09-17T01:33:06.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.978+0000 7f5a9429b740 1 -- start start 2024-09-17T01:33:06.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.978+0000 7f5a9429b740 1 Processor -- start 2024-09-17T01:33:06.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.979+0000 7f5a9429b740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562c11bd23b0 0x562c11fbc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:06.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.979+0000 7f5a9429b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c11bda590 0x562c11fcba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:06.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.979+0000 7f5a9429b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bfb270 0x562c11fcbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:06.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.979+0000 7f5a9429b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562c11eab330 con 0x562c11bfb270 2024-09-17T01:33:06.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.979+0000 7f5a9429b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562c11f08810 con 0x562c11bda590 2024-09-17T01:33:06.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.979+0000 7f5a9429b740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x562c11c75620 con 0x562c11bd23b0 2024-09-17T01:33:06.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.979+0000 7f5a9429b740 10 client.0 _ll_register_callbacks cb 0x562c11eb0420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:33:06.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.980+0000 7f5a86800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bfb270 0x562c11fcbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:06.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.980+0000 7f5a86800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bfb270 0x562c11fcbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36448/0 (socket says 172.21.15.42:36448) 2024-09-17T01:33:06.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.980+0000 7f5a86800640 1 -- 172.21.15.42:0/3646129780 learned_addr learned my addr 172.21.15.42:0/3646129780 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:33:06.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.980+0000 7f5a85e00640 1 --2- 172.21.15.42:0/3646129780 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562c11bd23b0 0x562c11fbc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:06.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.980+0000 7f5a85400640 1 --2- 172.21.15.42:0/3646129780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c11bda590 0x562c11fcba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:06.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.980+0000 7f5a86800640 1 -- 172.21.15.42:0/3646129780 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562c11bd23b0 msgr2=0x562c11fbc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:33:06.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.980+0000 7f5a86800640 1 --2- 172.21.15.42:0/3646129780 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562c11bd23b0 0x562c11fbc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:06.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.980+0000 7f5a86800640 1 -- 172.21.15.42:0/3646129780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c11bda590 msgr2=0x562c11fcba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:33:06.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.980+0000 7f5a86800640 1 --2- 172.21.15.42:0/3646129780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c11bda590 0x562c11fcba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:06.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.980+0000 7f5a86800640 1 -- 172.21.15.42:0/3646129780 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c11c66850 con 0x562c11bfb270 2024-09-17T01:33:06.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.980+0000 7f5a86800640 1 --2- 172.21.15.42:0/3646129780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bfb270 0x562c11fcbf70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5a80005980 tx=0x7f5a800018d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738c1ef41a598d4c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:33:06.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.980+0000 7f5a67400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:33:06.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.981+0000 7f5a67400640 1 -- 172.21.15.42:0/3646129780 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8001a060 con 0x562c11bfb270 2024-09-17T01:33:06.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.981+0000 7f5a67400640 1 -- 172.21.15.42:0/3646129780 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f5a800124d0 con 0x562c11bfb270 2024-09-17T01:33:06.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.981+0000 7f5a9429b740 1 -- 172.21.15.42:0/3646129780 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a78061dd0 con 0x562c11bfb270 2024-09-17T01:33:06.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.981+0000 7f5a67400640 1 -- 172.21.15.42:0/3646129780 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f5a80020050 con 0x562c11bfb270 2024-09-17T01:33:06.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.981+0000 7f5a9429b740 10 client.5010 fetch_fsmap learned FSMap version 17 2024-09-17T01:33:06.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.981+0000 7f5a9429b740 1 -- 172.21.15.42:0/3646129780 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x562c11cdd6b0 con 0x562c11bfb270 2024-09-17T01:33:06.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.981+0000 7f5a67400640 1 -- 172.21.15.42:0/3646129780 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a78061dd0 con 0x562c11bfb270 2024-09-17T01:33:06.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.981+0000 7f5a67400640 1 -- 172.21.15.42:0/3646129780 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f5a80023020 con 0x562c11bfb270 2024-09-17T01:33:06.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.981+0000 7f5a9429b740 10 client.5010 fetch_fsmap finished waiting for FSMap version 17 2024-09-17T01:33:06.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.981+0000 7f5a9429b740 10 client.5010 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T01:33:06.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.981+0000 7f5a9429b740 20 client.5010 populate_metadata read hostname 'smithi042' 2024-09-17T01:33:06.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.982+0000 7f5a9429b740 1 --2- 172.21.15.42:0/3646129780 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x562c11bb9e40 0x562c11ffa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:06.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.982+0000 7f5a9429b740 4 client.5010 mds_command: new command op to 4830 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:33:06.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.982+0000 7f5a9429b740 1 -- 172.21.15.42:0/3646129780 --> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c11f17520 con 0x562c11bb9e40 2024-09-17T01:33:06.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.982+0000 7f5a85e00640 1 --2- 172.21.15.42:0/3646129780 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x562c11bb9e40 0x562c11ffa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:06.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.982+0000 7f5a85e00640 1 --2- 172.21.15.42:0/3646129780 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x562c11bb9e40 0x562c11ffa4a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=814ea9fb21bae3bc server_cookie=282b92a2e8a2789f in_seq=0 out_seq=0 2024-09-17T01:33:06.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.982+0000 7f5a67400640 10 client.5010 ms_handle_connect on v2:172.21.15.42:6834/3278817895 2024-09-17T01:33:06.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.983+0000 7f5a67400640 1 -- 172.21.15.42:0/3646129780 <== mds.0 v2:172.21.15.42:6834/3278817895 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562c11f17520 con 0x562c11bb9e40 2024-09-17T01:33:06.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.983+0000 7f5a67400640 10 client.5010 handle_command_reply: tid=0 2024-09-17T01:33:06.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.983+0000 7f5a9429b740 1 client.5010 shutdown 2024-09-17T01:33:06.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.984+0000 7f5a9429b740 1 -- 172.21.15.42:0/3646129780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bfb270 msgr2=0x562c11fcbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:06.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.984+0000 7f5a9429b740 1 --2- 172.21.15.42:0/3646129780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bfb270 0x562c11fcbf70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5a80005980 tx=0x7f5a800018d0 comp rx=0 tx=0).stop 2024-09-17T01:33:06.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.984+0000 7f5a9429b740 1 -- 172.21.15.42:0/3646129780 shutdown_connections 2024-09-17T01:33:06.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.984+0000 7f5a9429b740 1 --2- 172.21.15.42:0/3646129780 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x562c11bb9e40 0x562c11ffa4a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:06.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.984+0000 7f5a9429b740 1 --2- 172.21.15.42:0/3646129780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c11bda590 0x562c11fcba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:06.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.984+0000 7f5a67400640 0 client.5010 ms_handle_reset on v2:172.21.15.42:6834/3278817895 2024-09-17T01:33:06.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.984+0000 7f5a9429b740 1 --2- 172.21.15.42:0/3646129780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bfb270 0x562c11fcbf70 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:06.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.984+0000 7f5a9429b740 1 --2- 172.21.15.42:0/3646129780 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562c11bd23b0 0x562c11fbc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:06.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.984+0000 7f5a9429b740 1 -- 172.21.15.42:0/3646129780 >> 172.21.15.42:0/3646129780 conn(0x562c11bef3c0 msgr2=0x562c11fc84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:33:06.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.984+0000 7f5a9429b740 1 -- 172.21.15.42:0/3646129780 shutdown_connections 2024-09-17T01:33:06.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.984+0000 7f5a9429b740 1 -- 172.21.15.42:0/3646129780 wait complete. 2024-09-17T01:33:06.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:06.984+0000 7f5a9429b740 20 client.5010 trim_cache size 0 max 16384 2024-09-17T01:33:07.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.004+0000 7f5a9429b740 1 Processor -- start 2024-09-17T01:33:07.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.004+0000 7f5a9429b740 1 -- start start 2024-09-17T01:33:07.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.005+0000 7f5a9429b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c11bd23b0 0x562c11fccd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:07.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.005+0000 7f5a9429b740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562c11bda590 0x562c11fe9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:07.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.005+0000 7f5a9429b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bfb270 0x562c11fea1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:07.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.005+0000 7f5a9429b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5a881f6e90 con 0x562c11bfb270 2024-09-17T01:33:07.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.006+0000 7f5a9429b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5a88145210 con 0x562c11bd23b0 2024-09-17T01:33:07.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.006+0000 7f5a9429b740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5a880b19b0 con 0x562c11bda590 2024-09-17T01:33:07.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.006+0000 7f5a86800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bfb270 0x562c11fea1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:07.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.006+0000 7f5a86800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bfb270 0x562c11fea1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36456/0 (socket says 172.21.15.42:36456) 2024-09-17T01:33:07.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.006+0000 7f5a86800640 1 -- 172.21.15.42:0/1397620924 learned_addr learned my addr 172.21.15.42:0/1397620924 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:33:07.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.006+0000 7f5a85400640 1 --2- 172.21.15.42:0/1397620924 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562c11bda590 0x562c11fe9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:07.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.006+0000 7f5a85e00640 1 --2- 172.21.15.42:0/1397620924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c11bd23b0 0x562c11fccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:07.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.006+0000 7f5a86800640 1 -- 172.21.15.42:0/1397620924 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562c11bda590 msgr2=0x562c11fe9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:33:07.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.006+0000 7f5a86800640 1 --2- 172.21.15.42:0/1397620924 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562c11bda590 0x562c11fe9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:07.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.006+0000 7f5a86800640 1 -- 172.21.15.42:0/1397620924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c11bd23b0 msgr2=0x562c11fccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:33:07.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.006+0000 7f5a86800640 1 --2- 172.21.15.42:0/1397620924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c11bd23b0 0x562c11fccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:07.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.006+0000 7f5a86800640 1 -- 172.21.15.42:0/1397620924 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c11f04b80 con 0x562c11bfb270 2024-09-17T01:33:07.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.006+0000 7f5a86800640 1 --2- 172.21.15.42:0/1397620924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bfb270 0x562c11fea1c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5a80001220 tx=0x7f5a800127a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20ec990e96de8b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:33:07.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.007+0000 7f5a72000640 1 -- 172.21.15.42:0/1397620924 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a80029070 con 0x562c11bfb270 2024-09-17T01:33:07.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.007+0000 7f5a72000640 1 -- 172.21.15.42:0/1397620924 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a80012a20 con 0x562c11bfb270 2024-09-17T01:33:07.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.007+0000 7f5a72000640 1 -- 172.21.15.42:0/1397620924 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8001a070 con 0x562c11bfb270 2024-09-17T01:33:07.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.007+0000 7f5a9429b740 1 -- 172.21.15.42:0/1397620924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bfb270 msgr2=0x562c11fea1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:07.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.007+0000 7f5a9429b740 1 --2- 172.21.15.42:0/1397620924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bfb270 0x562c11fea1c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5a80001220 tx=0x7f5a800127a0 comp rx=0 tx=0).stop 2024-09-17T01:33:07.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.008+0000 7f5a9429b740 1 -- 172.21.15.42:0/1397620924 shutdown_connections 2024-09-17T01:33:07.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.008+0000 7f5a9429b740 1 --2- 172.21.15.42:0/1397620924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bfb270 0x562c11fea1c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:07.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.008+0000 7f5a9429b740 1 --2- 172.21.15.42:0/1397620924 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562c11bda590 0x562c11fe9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:07.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.008+0000 7f5a9429b740 1 --2- 172.21.15.42:0/1397620924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c11bd23b0 0x562c11fccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:07.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.008+0000 7f5a9429b740 1 -- 172.21.15.42:0/1397620924 >> 172.21.15.42:0/1397620924 conn(0x562c11bef3c0 msgr2=0x562c11f9bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:33:07.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.008+0000 7f5a9429b740 1 -- 172.21.15.42:0/1397620924 shutdown_connections 2024-09-17T01:33:07.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.008+0000 7f5a9429b740 1 -- 172.21.15.42:0/1397620924 wait complete. 2024-09-17T01:33:07.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.009+0000 7f5a9429b740 1 -- start start 2024-09-17T01:33:07.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.009+0000 7f5a9429b740 1 Processor -- start 2024-09-17T01:33:07.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.010+0000 7f5a9429b740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562c11bd23b0 0x562c12052920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:07.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.010+0000 7f5a9429b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bda590 0x562c1206ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:07.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.010+0000 7f5a9429b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c11bfb270 0x562c1206da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:07.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.010+0000 7f5a9429b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562c11fc9670 con 0x562c11bda590 2024-09-17T01:33:07.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.010+0000 7f5a9429b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562c11feac40 con 0x562c11bfb270 2024-09-17T01:33:07.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.010+0000 7f5a9429b740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x562c11fe8e80 con 0x562c11bd23b0 2024-09-17T01:33:07.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.011+0000 7f5a9429b740 10 client.0 _ll_register_callbacks cb 0x7f5a80005530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:33:07.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.011+0000 7f5a85400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bda590 0x562c1206ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:07.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.011+0000 7f5a85400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bda590 0x562c1206ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36466/0 (socket says 172.21.15.42:36466) 2024-09-17T01:33:07.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.011+0000 7f5a85400640 1 -- 172.21.15.42:0/1509571987 learned_addr learned my addr 172.21.15.42:0/1509571987 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:33:07.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.011+0000 7f5a86800640 1 --2- 172.21.15.42:0/1509571987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c11bfb270 0x562c1206da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:07.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.011+0000 7f5a85e00640 1 --2- 172.21.15.42:0/1509571987 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562c11bd23b0 0x562c12052920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:07.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.011+0000 7f5a85400640 1 -- 172.21.15.42:0/1509571987 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562c11bd23b0 msgr2=0x562c12052920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:33:07.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.011+0000 7f5a85400640 1 --2- 172.21.15.42:0/1509571987 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562c11bd23b0 0x562c12052920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:07.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.011+0000 7f5a85400640 1 -- 172.21.15.42:0/1509571987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c11bfb270 msgr2=0x562c1206da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:33:07.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.011+0000 7f5a85400640 1 --2- 172.21.15.42:0/1509571987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c11bfb270 0x562c1206da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:07.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.011+0000 7f5a85400640 1 -- 172.21.15.42:0/1509571987 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c11f9b6c0 con 0x562c11bda590 2024-09-17T01:33:07.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.011+0000 7f5a85e00640 1 --2- 172.21.15.42:0/1509571987 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562c11bd23b0 0x562c12052920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:33:07.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.011+0000 7f5a85400640 1 --2- 172.21.15.42:0/1509571987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bda590 0x562c1206ae70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5a7402aba0 tx=0x7f5a74005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9664b2d2009f8c83 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:33:07.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.011+0000 7f5a67400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:33:07.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.012+0000 7f5a67400640 1 -- 172.21.15.42:0/1509571987 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7404ac10 con 0x562c11bda590 2024-09-17T01:33:07.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.012+0000 7f5a67400640 1 -- 172.21.15.42:0/1509571987 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f5a7404adb0 con 0x562c11bda590 2024-09-17T01:33:07.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.012+0000 7f5a9429b740 1 -- 172.21.15.42:0/1509571987 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a80012a20 con 0x562c11bda590 2024-09-17T01:33:07.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.012+0000 7f5a67400640 1 -- 172.21.15.42:0/1509571987 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f5a7405d050 con 0x562c11bda590 2024-09-17T01:33:07.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.012+0000 7f5a9429b740 10 client.5016 fetch_fsmap learned FSMap version 17 2024-09-17T01:33:07.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.012+0000 7f5a9429b740 1 -- 172.21.15.42:0/1509571987 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x562c1206a950 con 0x562c11bda590 2024-09-17T01:33:07.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.012+0000 7f5a67400640 1 -- 172.21.15.42:0/1509571987 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a80012a20 con 0x562c11bda590 2024-09-17T01:33:07.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.012+0000 7f5a67400640 1 -- 172.21.15.42:0/1509571987 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f5a74060020 con 0x562c11bda590 2024-09-17T01:33:07.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.012+0000 7f5a9429b740 10 client.5016 fetch_fsmap finished waiting for FSMap version 17 2024-09-17T01:33:07.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.012+0000 7f5a9429b740 10 client.5016 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T01:33:07.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.012+0000 7f5a9429b740 20 client.5016 populate_metadata read hostname 'smithi042' 2024-09-17T01:33:07.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.012+0000 7f5a9429b740 1 --2- 172.21.15.42:0/1509571987 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x562c11fea320 0x562c11fe4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:07.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.012+0000 7f5a9429b740 4 client.5016 mds_command: new command op to 4830 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T01:33:07.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.012+0000 7f5a9429b740 1 -- 172.21.15.42:0/1509571987 --> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] -- command(tid 0: {"prefix": "status"}) -- 0x562c11f12fd0 con 0x562c11fea320 2024-09-17T01:33:07.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.013+0000 7f5a85e00640 1 --2- 172.21.15.42:0/1509571987 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x562c11fea320 0x562c11fe4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:07.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.013+0000 7f5a85e00640 1 --2- 172.21.15.42:0/1509571987 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x562c11fea320 0x562c11fe4d60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=707ea9b455762750 server_cookie=50bcf89009d5f6e in_seq=0 out_seq=0 2024-09-17T01:33:07.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.013+0000 7f5a67400640 10 client.5016 ms_handle_connect on v2:172.21.15.42:6834/3278817895 2024-09-17T01:33:07.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.014+0000 7f5a67400640 1 -- 172.21.15.42:0/1509571987 <== mds.0 v2:172.21.15.42:6834/3278817895 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x562c11f12fd0 con 0x562c11fea320 2024-09-17T01:33:07.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.014+0000 7f5a67400640 10 client.5016 handle_command_reply: tid=0 2024-09-17T01:33:07.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.014+0000 7f5a9429b740 1 client.5016 shutdown 2024-09-17T01:33:07.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.014+0000 7f5a9429b740 1 -- 172.21.15.42:0/1509571987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bda590 msgr2=0x562c1206ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:07.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.014+0000 7f5a9429b740 1 --2- 172.21.15.42:0/1509571987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bda590 0x562c1206ae70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5a7402aba0 tx=0x7f5a74005f90 comp rx=0 tx=0).stop 2024-09-17T01:33:07.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.014+0000 7f5a9429b740 1 -- 172.21.15.42:0/1509571987 shutdown_connections 2024-09-17T01:33:07.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.014+0000 7f5a9429b740 1 --2- 172.21.15.42:0/1509571987 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x562c11fea320 0x562c11fe4d60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:07.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.014+0000 7f5a9429b740 1 --2- 172.21.15.42:0/1509571987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562c11bfb270 0x562c1206da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:07.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.014+0000 7f5a9429b740 1 --2- 172.21.15.42:0/1509571987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562c11bda590 0x562c1206ae70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:07.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.014+0000 7f5a9429b740 1 --2- 172.21.15.42:0/1509571987 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562c11bd23b0 0x562c12052920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:07.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.014+0000 7f5a67400640 0 client.5016 ms_handle_reset on v2:172.21.15.42:6834/3278817895 2024-09-17T01:33:07.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.014+0000 7f5a9429b740 1 -- 172.21.15.42:0/1509571987 >> 172.21.15.42:0/1509571987 conn(0x562c11bef3c0 msgr2=0x562c11fa0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:33:07.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.014+0000 7f5a9429b740 1 -- 172.21.15.42:0/1509571987 shutdown_connections 2024-09-17T01:33:07.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.014+0000 7f5a9429b740 1 -- 172.21.15.42:0/1509571987 wait complete. 2024-09-17T01:33:07.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.014+0000 7f5a9429b740 20 client.5016 trim_cache size 0 max 16384 2024-09-17T01:33:07.015 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:33:07.015 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "fea1c88c-cb05-432f-a745-f9dcbb5f2503", 2024-09-17T01:33:07.016 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-17T01:33:07.016 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4830, 2024-09-17T01:33:07.016 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-17T01:33:07.016 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-17T01:33:07.016 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-17T01:33:07.016 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 11.755267417000001, 2024-09-17T01:33:07.016 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 17, 2024-09-17T01:33:07.016 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 33, 2024-09-17T01:33:07.016 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 33, 2024-09-17T01:33:07.016 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 19.466519163000001 2024-09-17T01:33:07.016 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:33:07.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.015+0000 7f5a8d200640 1 -- 172.21.15.42:0/1855341270 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5a68078b90 msgr2=0x7f5a6807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:07.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.015+0000 7f5a8d200640 1 --2- 172.21.15.42:0/1855341270 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5a68078b90 0x7f5a6807b0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5a74034000 tx=0x7f5a74004730 comp rx=0 tx=0).stop 2024-09-17T01:33:07.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.015+0000 7f5a8d200640 1 -- 172.21.15.42:0/1855341270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a8806d430 msgr2=0x7f5a880ad380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:07.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.015+0000 7f5a8d200640 1 --2- 172.21.15.42:0/1855341270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a8806d430 0x7f5a880ad380 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5a7800c3a0 tx=0x7f5a7800c860 comp rx=0 tx=0).stop 2024-09-17T01:33:07.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.015+0000 7f5a8d200640 1 -- 172.21.15.42:0/1855341270 shutdown_connections 2024-09-17T01:33:07.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.015+0000 7f5a8d200640 1 --2- 172.21.15.42:0/1855341270 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5a68078b90 0x7f5a6807b0a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:07.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.015+0000 7f5a8d200640 1 --2- 172.21.15.42:0/1855341270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a8815f480 0x7f5a880ae650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:07.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.015+0000 7f5a8d200640 1 --2- 172.21.15.42:0/1855341270 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a8815cb80 0x7f5a881f4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:07.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.015+0000 7f5a8d200640 1 --2- 172.21.15.42:0/1855341270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a8806d430 0x7f5a880ad380 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:07.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.015+0000 7f5a8d200640 1 -- 172.21.15.42:0/1855341270 >> 172.21.15.42:0/1855341270 conn(0x7f5a880b2930 msgr2=0x7f5a88152710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:33:07.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.015+0000 7f5a8d200640 1 -- 172.21.15.42:0/1855341270 shutdown_connections 2024-09-17T01:33:07.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.015+0000 7f5a8d200640 1 -- 172.21.15.42:0/1855341270 wait complete. 2024-09-17T01:33:07.037 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T01:33:07.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.267+0000 7f35ab200640 1 -- 172.21.15.42:0/2854748912 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f35ac15a2a0 msgr2=0x7f35ac15d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:07.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.267+0000 7f35ab200640 1 --2- 172.21.15.42:0/2854748912 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f35ac15a2a0 0x7f35ac15d720 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f359c009860 tx=0x7f359c02a5a0 comp rx=0 tx=0).stop 2024-09-17T01:33:07.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.267+0000 7f35ab200640 1 -- 172.21.15.42:0/2854748912 shutdown_connections 2024-09-17T01:33:07.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.267+0000 7f35ab200640 1 --2- 172.21.15.42:0/2854748912 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f35ac15a2a0 0x7f35ac15d720 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:07.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.267+0000 7f35ab200640 1 -- 172.21.15.42:0/2854748912 >> 172.21.15.42:0/2854748912 conn(0x7f35ac0734a0 msgr2=0x7f35ac0b61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:33:07.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.267+0000 7f35ab200640 1 -- 172.21.15.42:0/2854748912 shutdown_connections 2024-09-17T01:33:07.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.267+0000 7f35ab200640 1 -- 172.21.15.42:0/2854748912 wait complete. 2024-09-17T01:33:07.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.269+0000 7f35ab200640 1 Processor -- start 2024-09-17T01:33:07.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.269+0000 7f35ab200640 1 -- start start 2024-09-17T01:33:07.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.270+0000 7f35ab200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35ac0b14a0 0x7f35ac09eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:07.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.271+0000 7f35ab200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35ac15a2a0 0x7f35ac15b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:07.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.271+0000 7f35ab200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f35ac1f53d0 0x7f35ac15bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:07.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.271+0000 7f35ab200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f35ac075110 con 0x7f35ac15a2a0 2024-09-17T01:33:07.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.271+0000 7f35ab200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f35ac0b1ac0 con 0x7f35ac0b14a0 2024-09-17T01:33:07.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.271+0000 7f35ab200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f35ac075290 con 0x7f35ac1f53d0 2024-09-17T01:33:07.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.271+0000 7f35a9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35ac15a2a0 0x7f35ac15b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:07.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.271+0000 7f35a9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35ac15a2a0 0x7f35ac15b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36474/0 (socket says 172.21.15.42:36474) 2024-09-17T01:33:07.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.271+0000 7f35a9400640 1 -- 172.21.15.42:0/1989578997 learned_addr learned my addr 172.21.15.42:0/1989578997 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:33:07.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.271+0000 7f35a9e00640 1 --2- 172.21.15.42:0/1989578997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35ac0b14a0 0x7f35ac09eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:07.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.271+0000 7f35aa800640 1 --2- 172.21.15.42:0/1989578997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f35ac1f53d0 0x7f35ac15bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:07.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.271+0000 7f35a9400640 1 -- 172.21.15.42:0/1989578997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f35ac1f53d0 msgr2=0x7f35ac15bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:07.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.271+0000 7f35a9400640 1 --2- 172.21.15.42:0/1989578997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f35ac1f53d0 0x7f35ac15bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:07.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.271+0000 7f35a9400640 1 -- 172.21.15.42:0/1989578997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35ac0b14a0 msgr2=0x7f35ac09eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:07.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.271+0000 7f35a9400640 1 --2- 172.21.15.42:0/1989578997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35ac0b14a0 0x7f35ac09eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:07.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.271+0000 7f35a9400640 1 -- 172.21.15.42:0/1989578997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ac1473c0 con 0x7f35ac15a2a0 2024-09-17T01:33:07.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.271+0000 7f35aa800640 1 --2- 172.21.15.42:0/1989578997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f35ac1f53d0 0x7f35ac15bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:33:07.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.272+0000 7f35a9400640 1 --2- 172.21.15.42:0/1989578997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35ac15a2a0 0x7f35ac15b8b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f359800c390 tx=0x7f359800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:33:07.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.272+0000 7f35a2000640 1 -- 172.21.15.42:0/1989578997 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3598017070 con 0x7f35ac15a2a0 2024-09-17T01:33:07.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.272+0000 7f35a2000640 1 -- 172.21.15.42:0/1989578997 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f35980053c0 con 0x7f35ac15a2a0 2024-09-17T01:33:07.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.272+0000 7f35a2000640 1 -- 172.21.15.42:0/1989578997 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3598003850 con 0x7f35ac15a2a0 2024-09-17T01:33:07.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.272+0000 7f35ab200640 1 -- 172.21.15.42:0/1989578997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35ac1476a0 con 0x7f35ac15a2a0 2024-09-17T01:33:07.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.272+0000 7f35ab200640 1 -- 172.21.15.42:0/1989578997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35ac147c60 con 0x7f35ac15a2a0 2024-09-17T01:33:07.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.273+0000 7f35ab200640 1 -- 172.21.15.42:0/1989578997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35ac15d720 con 0x7f35ac15a2a0 2024-09-17T01:33:07.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.275+0000 7f35a2000640 1 -- 172.21.15.42:0/1989578997 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f359801a070 con 0x7f35ac15a2a0 2024-09-17T01:33:07.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.275+0000 7f35a2000640 1 --2- 172.21.15.42:0/1989578997 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f358c078b90 0x7f358c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:07.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.276+0000 7f35a2000640 1 -- 172.21.15.42:0/1989578997 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f359809a110 con 0x7f35ac15a2a0 2024-09-17T01:33:07.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.276+0000 7f35a9e00640 1 --2- 172.21.15.42:0/1989578997 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f358c078b90 0x7f358c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:07.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.277+0000 7f35a9e00640 1 --2- 172.21.15.42:0/1989578997 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f358c078b90 0x7f358c07b0a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f359c034000 tx=0x7f359c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:33:07.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.280+0000 7f35a2000640 1 -- 172.21.15.42:0/1989578997 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3598061e60 con 0x7f35ac15a2a0 2024-09-17T01:33:07.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.516+0000 7f35ab200640 1 -- 172.21.15.42:0/1989578997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f35ac0763d0 con 0x7f35ac15a2a0 2024-09-17T01:33:07.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.516+0000 7f35a2000640 1 -- 172.21.15.42:0/1989578997 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f3598066890 con 0x7f35ac15a2a0 2024-09-17T01:33:07.514 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T01:33:07.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.519+0000 7f35ab200640 1 -- 172.21.15.42:0/1989578997 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f358c078b90 msgr2=0x7f358c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:07.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.519+0000 7f35ab200640 1 --2- 172.21.15.42:0/1989578997 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f358c078b90 0x7f358c07b0a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f359c034000 tx=0x7f359c004730 comp rx=0 tx=0).stop 2024-09-17T01:33:07.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.519+0000 7f35ab200640 1 -- 172.21.15.42:0/1989578997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35ac15a2a0 msgr2=0x7f35ac15b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:07.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.519+0000 7f35ab200640 1 --2- 172.21.15.42:0/1989578997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35ac15a2a0 0x7f35ac15b8b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f359800c390 tx=0x7f359800c850 comp rx=0 tx=0).stop 2024-09-17T01:33:07.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.519+0000 7f35ab200640 1 -- 172.21.15.42:0/1989578997 shutdown_connections 2024-09-17T01:33:07.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.519+0000 7f35ab200640 1 --2- 172.21.15.42:0/1989578997 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f358c078b90 0x7f358c07b0a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:07.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.519+0000 7f35ab200640 1 --2- 172.21.15.42:0/1989578997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f35ac1f53d0 0x7f35ac15bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:07.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.519+0000 7f35ab200640 1 --2- 172.21.15.42:0/1989578997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35ac15a2a0 0x7f35ac15b8b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:07.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.519+0000 7f35ab200640 1 --2- 172.21.15.42:0/1989578997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35ac0b14a0 0x7f35ac09eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:07.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.519+0000 7f35ab200640 1 -- 172.21.15.42:0/1989578997 >> 172.21.15.42:0/1989578997 conn(0x7f35ac0734a0 msgr2=0x7f35ac15de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:33:07.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.519+0000 7f35ab200640 1 -- 172.21.15.42:0/1989578997 shutdown_connections 2024-09-17T01:33:07.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07.519+0000 7f35ab200640 1 -- 172.21.15.42:0/1989578997 wait complete. 2024-09-17T01:33:07.540 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T01:33:07.540 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:33:07.540 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-09-17T01:33:07.541 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T01:33:07.541 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:33:07.541 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T01:33:07.541 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T01:33:07.541 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:33:07.541 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:33:07.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:33:07.541 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-09-17T01:33:07.577 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:33:07.577 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:33:07.577 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:33:07.578 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:33:07.578 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-17T01:33:07.578 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:33:07.578 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:33:07.578 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-09-17T01:33:07.578 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-09-17T01:33:07.578 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:33:07.578 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-09-17T01:33:07.578 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-09-17T01:33:07.578 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:33:07.578 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:33:07.578 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-09-17T01:33:07.578 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-17T01:33:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42620sec preferred_lft 42620sec 2024-09-17T01:33:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-17T01:33:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:33:07.579 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:33:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:33:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-09-17T01:33:07.579 INFO:teuthology.orchestra.run.smithi042.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T01:33:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T01:33:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T01:33:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:33:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::68d2:2bff:fe2f:191a/64 scope link 2024-09-17T01:33:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:33:07.579 INFO:teuthology.orchestra.run.smithi042.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:33:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether e2:73:3e:9b:8a:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:33:07.580 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::e073:3eff:fe9b:8a00/64 scope link 2024-09-17T01:33:07.580 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:33:07.580 INFO:teuthology.orchestra.run.smithi042.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:33:07.580 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T01:33:07.580 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::240b:bfff:feb7:6e5b/64 scope link 2024-09-17T01:33:07.580 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:33:07.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:33:07.580 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:33:07.671 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-17T01:33:07.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:33:07.674 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-09-17T01:33:07.712 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-09-17T01:33:07.712 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:33:07.712 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-17T01:33:07.712 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-17T01:33:07.712 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:33:07.713 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:33:07.713 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:33:07.713 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T01:33:07.713 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T01:33:07.713 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T01:33:07.713 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:33:07.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:33:07.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:33:07.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:33:07.912 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-17T01:33:07.948 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T01:33:07.949 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T01:33:07.949 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:33:07.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:33:07.950 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-09-17T01:33:08.046 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:33:08.046 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T01:33:08.081 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:33:08.081 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:33:08.082 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:33:08.156 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T01:33:08.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:33:08.157 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:33:08.355 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:33:08.356 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:33:08.356 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:33:08.376 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:33:08.376 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:33:08.377 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:33:08.377 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:33:08.377 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:33:08.406 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:33:08.406 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:33:08.407 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:33:08.407 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:33:08.407 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:33:08.407 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-09-17T01:33:08.407 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-09-17T01:33:08.407 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fea1c88c-cb05-432f-a745-f9dcbb5f2503" will pass to kernel 2024-09-17T01:33:08.408 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T01:33:08.408 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-09-17T01:33:08.408 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T01:33:08.408 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T01:33:08.408 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T01:33:08.411 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T01:33:08.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:33:08.411 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:33:08.468 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:33:08.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:33:08.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:33:08.565 INFO:teuthology.orchestra.run.smithi042.stdout:client4766 2024-09-17T01:33:08.565 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:33:08.565 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:33:08.601 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-09-17T01:33:08.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.876+0000 7f8e85400640 1 -- 172.21.15.42:0/9868359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e8006d430 msgr2=0x7f8e8015d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:08.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.876+0000 7f8e85400640 1 --2- 172.21.15.42:0/9868359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e8006d430 0x7f8e8015d6a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8e68009830 tx=0x7f8e6802a510 comp rx=0 tx=0).stop 2024-09-17T01:33:08.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.876+0000 7f8e85400640 1 -- 172.21.15.42:0/9868359 shutdown_connections 2024-09-17T01:33:08.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.876+0000 7f8e85400640 1 --2- 172.21.15.42:0/9868359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e8006d430 0x7f8e8015d6a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:08.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.876+0000 7f8e85400640 1 -- 172.21.15.42:0/9868359 >> 172.21.15.42:0/9868359 conn(0x7f8e800b25d0 msgr2=0x7f8e800d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:33:08.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.876+0000 7f8e85400640 1 -- 172.21.15.42:0/9868359 shutdown_connections 2024-09-17T01:33:08.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.876+0000 7f8e85400640 1 -- 172.21.15.42:0/9868359 wait complete. 2024-09-17T01:33:08.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.878+0000 7f8e85400640 1 Processor -- start 2024-09-17T01:33:08.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.879+0000 7f8e85400640 1 -- start start 2024-09-17T01:33:08.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.880+0000 7f8e85400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8e800aebf0 0x7f8e8009b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:08.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.880+0000 7f8e85400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e800af4f0 0x7f8e80155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:08.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.880+0000 7f8e85400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e801f6780 0x7f8e8009cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:08.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.880+0000 7f8e85400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8e800b3b40 con 0x7f8e801f6780 2024-09-17T01:33:08.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.880+0000 7f8e85400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8e800b39c0 con 0x7f8e800af4f0 2024-09-17T01:33:08.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.880+0000 7f8e85400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8e800b3cc0 con 0x7f8e800aebf0 2024-09-17T01:33:08.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.880+0000 7f8e84a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e801f6780 0x7f8e8009cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:08.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.880+0000 7f8e84a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e801f6780 0x7f8e8009cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36496/0 (socket says 172.21.15.42:36496) 2024-09-17T01:33:08.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.880+0000 7f8e84a00640 1 -- 172.21.15.42:0/1725942592 learned_addr learned my addr 172.21.15.42:0/1725942592 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:33:08.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.880+0000 7f8e7fe00640 1 --2- 172.21.15.42:0/1725942592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8e800aebf0 0x7f8e8009b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:08.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.880+0000 7f8e77400640 1 --2- 172.21.15.42:0/1725942592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e800af4f0 0x7f8e80155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:08.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.881+0000 7f8e84a00640 1 -- 172.21.15.42:0/1725942592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8e800aebf0 msgr2=0x7f8e8009b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:08.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.881+0000 7f8e84a00640 1 --2- 172.21.15.42:0/1725942592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8e800aebf0 0x7f8e8009b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:08.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.881+0000 7f8e84a00640 1 -- 172.21.15.42:0/1725942592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e800af4f0 msgr2=0x7f8e80155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:08.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.881+0000 7f8e84a00640 1 --2- 172.21.15.42:0/1725942592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e800af4f0 0x7f8e80155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:08.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.881+0000 7f8e84a00640 1 -- 172.21.15.42:0/1725942592 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e80155f50 con 0x7f8e801f6780 2024-09-17T01:33:08.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.881+0000 7f8e84a00640 1 --2- 172.21.15.42:0/1725942592 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e801f6780 0x7f8e8009cde0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8e7800cb10 tx=0x7f8e7800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:33:08.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.881+0000 7f8e7cc00640 1 -- 172.21.15.42:0/1725942592 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e78016020 con 0x7f8e801f6780 2024-09-17T01:33:08.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.881+0000 7f8e7cc00640 1 -- 172.21.15.42:0/1725942592 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e7800ad60 con 0x7f8e801f6780 2024-09-17T01:33:08.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.881+0000 7f8e85400640 1 -- 172.21.15.42:0/1725942592 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e801f6ef0 con 0x7f8e801f6780 2024-09-17T01:33:08.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.881+0000 7f8e7cc00640 1 -- 172.21.15.42:0/1725942592 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e78012680 con 0x7f8e801f6780 2024-09-17T01:33:08.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.881+0000 7f8e85400640 1 -- 172.21.15.42:0/1725942592 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e801f74b0 con 0x7f8e801f6780 2024-09-17T01:33:08.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.883+0000 7f8e85400640 1 -- 172.21.15.42:0/1725942592 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e8015d6a0 con 0x7f8e801f6780 2024-09-17T01:33:08.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.884+0000 7f8e7cc00640 1 -- 172.21.15.42:0/1725942592 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8e78019020 con 0x7f8e801f6780 2024-09-17T01:33:08.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.885+0000 7f8e7cc00640 1 --2- 172.21.15.42:0/1725942592 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8e5c078b90 0x7f8e5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:33:08.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.885+0000 7f8e7cc00640 1 -- 172.21.15.42:0/1725942592 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f8e7809ae90 con 0x7f8e801f6780 2024-09-17T01:33:08.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.885+0000 7f8e7fe00640 1 --2- 172.21.15.42:0/1725942592 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8e5c078b90 0x7f8e5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:33:08.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.886+0000 7f8e7fe00640 1 --2- 172.21.15.42:0/1725942592 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8e5c078b90 0x7f8e5c07b0a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8e70006fd0 tx=0x7f8e70009060 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:33:08.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:08.889+0000 7f8e7cc00640 1 -- 172.21.15.42:0/1725942592 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8e78020030 con 0x7f8e801f6780 2024-09-17T01:33:09.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:09.124+0000 7f8e85400640 1 -- 172.21.15.42:0/1725942592 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f8e801f6c80 con 0x7f8e801f6780 2024-09-17T01:33:09.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:09.312+0000 7f8e7cc00640 1 -- 172.21.15.42:0/1725942592 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v18) ==== 167+0+0 (secure 0 0 0) 0x7f8e78062d00 con 0x7f8e801f6780 2024-09-17T01:33:09.310 INFO:teuthology.orchestra.run.smithi042.stderr:enabled new snapshots 2024-09-17T01:33:09.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:09.315+0000 7f8e85400640 1 -- 172.21.15.42:0/1725942592 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8e5c078b90 msgr2=0x7f8e5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:09.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:09.315+0000 7f8e85400640 1 --2- 172.21.15.42:0/1725942592 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8e5c078b90 0x7f8e5c07b0a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8e70006fd0 tx=0x7f8e70009060 comp rx=0 tx=0).stop 2024-09-17T01:33:09.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:09.315+0000 7f8e85400640 1 -- 172.21.15.42:0/1725942592 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e801f6780 msgr2=0x7f8e8009cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:33:09.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:09.315+0000 7f8e85400640 1 --2- 172.21.15.42:0/1725942592 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e801f6780 0x7f8e8009cde0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8e7800cb10 tx=0x7f8e7800a060 comp rx=0 tx=0).stop 2024-09-17T01:33:09.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:09.315+0000 7f8e85400640 1 -- 172.21.15.42:0/1725942592 shutdown_connections 2024-09-17T01:33:09.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:09.315+0000 7f8e85400640 1 --2- 172.21.15.42:0/1725942592 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8e5c078b90 0x7f8e5c07b0a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:09.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:09.315+0000 7f8e85400640 1 --2- 172.21.15.42:0/1725942592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e800af4f0 0x7f8e80155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:09.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:09.315+0000 7f8e85400640 1 --2- 172.21.15.42:0/1725942592 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e801f6780 0x7f8e8009cde0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:09.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:09.315+0000 7f8e85400640 1 --2- 172.21.15.42:0/1725942592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8e800aebf0 0x7f8e8009b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:33:09.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:09.315+0000 7f8e85400640 1 -- 172.21.15.42:0/1725942592 >> 172.21.15.42:0/1725942592 conn(0x7f8e800b25d0 msgr2=0x7f8e800b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:33:09.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:09.315+0000 7f8e85400640 1 -- 172.21.15.42:0/1725942592 shutdown_connections 2024-09-17T01:33:09.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:09.315+0000 7f8e85400640 1 -- 172.21.15.42:0/1725942592 wait complete. 2024-09-17T01:33:09.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:33:09.335 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-09-17T01:33:09.379 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:33:09.379 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:33:09.455 DEBUG:teuthology.orchestra.run.smithi042:> stdin-killer -- python3 -c ' 2024-09-17T01:33:09.455 DEBUG:teuthology.orchestra.run.smithi042:> import os 2024-09-17T01:33:09.455 DEBUG:teuthology.orchestra.run.smithi042:> import uuid 2024-09-17T01:33:09.455 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:33:09.456 DEBUG:teuthology.orchestra.run.smithi042:> n = 2000 2024-09-17T01:33:09.456 DEBUG:teuthology.orchestra.run.smithi042:> create_hard_links = False 2024-09-17T01:33:09.456 DEBUG:teuthology.orchestra.run.smithi042:> if 3 > 0: 2024-09-17T01:33:09.456 DEBUG:teuthology.orchestra.run.smithi042:> create_hard_links = True 2024-09-17T01:33:09.456 DEBUG:teuthology.orchestra.run.smithi042:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-09-17T01:33:09.456 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:33:09.456 DEBUG:teuthology.orchestra.run.smithi042:> dpath = os.path.dirname(path) 2024-09-17T01:33:09.456 DEBUG:teuthology.orchestra.run.smithi042:> fnameprefix = os.path.basename(path) 2024-09-17T01:33:09.456 DEBUG:teuthology.orchestra.run.smithi042:> os.makedirs(dpath, exist_ok=True) 2024-09-17T01:33:09.456 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:33:09.456 DEBUG:teuthology.orchestra.run.smithi042:> try: 2024-09-17T01:33:09.456 DEBUG:teuthology.orchestra.run.smithi042:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-17T01:33:09.456 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:33:09.456 DEBUG:teuthology.orchestra.run.smithi042:> for i in range(n): 2024-09-17T01:33:09.456 DEBUG:teuthology.orchestra.run.smithi042:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-17T01:33:09.457 DEBUG:teuthology.orchestra.run.smithi042:> with open(fpath, '"'"'w'"'"') as f: 2024-09-17T01:33:09.457 DEBUG:teuthology.orchestra.run.smithi042:> f.write(f"{i}") 2024-09-17T01:33:09.457 DEBUG:teuthology.orchestra.run.smithi042:> if False: 2024-09-17T01:33:09.457 DEBUG:teuthology.orchestra.run.smithi042:> f.flush() 2024-09-17T01:33:09.457 DEBUG:teuthology.orchestra.run.smithi042:> os.fsync(f.fileno()) 2024-09-17T01:33:09.457 DEBUG:teuthology.orchestra.run.smithi042:> if False: 2024-09-17T01:33:09.457 DEBUG:teuthology.orchestra.run.smithi042:> os.unlink(fpath) 2024-09-17T01:33:09.457 DEBUG:teuthology.orchestra.run.smithi042:> if False: 2024-09-17T01:33:09.457 DEBUG:teuthology.orchestra.run.smithi042:> os.fsync(dirfd) 2024-09-17T01:33:09.457 DEBUG:teuthology.orchestra.run.smithi042:> if create_hard_links: 2024-09-17T01:33:09.457 DEBUG:teuthology.orchestra.run.smithi042:> for j in range(3): 2024-09-17T01:33:09.457 DEBUG:teuthology.orchestra.run.smithi042:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-17T01:33:09.457 DEBUG:teuthology.orchestra.run.smithi042:> if False: 2024-09-17T01:33:09.457 DEBUG:teuthology.orchestra.run.smithi042:> os.fsync(dirfd) 2024-09-17T01:33:09.457 DEBUG:teuthology.orchestra.run.smithi042:> finally: 2024-09-17T01:33:09.458 DEBUG:teuthology.orchestra.run.smithi042:> os.close(dirfd) 2024-09-17T01:33:09.458 DEBUG:teuthology.orchestra.run.smithi042:> ' 2024-09-17T01:33:19.056 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:33:19.061 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:33:42.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:33:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:33:42.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:33:42.781 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-17T01:33:43.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:33:43.119 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-09-17T01:33:49.167 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:33:49.172 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:34:14.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:34:14.332 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-17T01:34:14.377 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-09-17T01:34:14.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.650+0000 7ff9b4200640 1 -- 172.21.15.42:0/3122216276 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9ac0b3550 msgr2=0x7ff9ac15cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:14.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.650+0000 7ff9b4200640 1 --2- 172.21.15.42:0/3122216276 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9ac0b3550 0x7ff9ac15cec0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0009830 tx=0x7ff9a002a410 comp rx=0 tx=0).stop 2024-09-17T01:34:14.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.650+0000 7ff9b4200640 1 -- 172.21.15.42:0/3122216276 shutdown_connections 2024-09-17T01:34:14.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.650+0000 7ff9b4200640 1 --2- 172.21.15.42:0/3122216276 >> v2:172.21.15.43:3300/0 conn(0x7ff9ac0cec40 0x7ff9ac0cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.650+0000 7ff9b4200640 1 --2- 172.21.15.42:0/3122216276 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9ac0b3550 0x7ff9ac15cec0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.650+0000 7ff9b4200640 1 -- 172.21.15.42:0/3122216276 >> 172.21.15.42:0/3122216276 conn(0x7ff9ac0b2930 msgr2=0x7ff9ac06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:14.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.650+0000 7ff9b4200640 1 -- 172.21.15.42:0/3122216276 shutdown_connections 2024-09-17T01:34:14.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.650+0000 7ff9b4200640 1 -- 172.21.15.42:0/3122216276 wait complete. 2024-09-17T01:34:14.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.652+0000 7ff9b4200640 1 Processor -- start 2024-09-17T01:34:14.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.653+0000 7ff9b4200640 1 -- start start 2024-09-17T01:34:14.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.654+0000 7ff9b4200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9ac0b3550 0x7ff9ac160dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:14.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.654+0000 7ff9b4200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9ac0cec40 0x7ff9ac14e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:14.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.654+0000 7ff9b4200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9ac142f40 0x7ff9ac14edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:14.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.654+0000 7ff9b4200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac06d7c0 con 0x7ff9ac0b3550 2024-09-17T01:34:14.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.654+0000 7ff9b4200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac06d640 con 0x7ff9ac0cec40 2024-09-17T01:34:14.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.654+0000 7ff9b4200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ac06d940 con 0x7ff9ac142f40 2024-09-17T01:34:14.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.654+0000 7ff9b1800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9ac0b3550 0x7ff9ac160dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:14.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.654+0000 7ff9b1800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9ac0b3550 0x7ff9ac160dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60004/0 (socket says 172.21.15.42:60004) 2024-09-17T01:34:14.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.654+0000 7ff9b1800640 1 -- 172.21.15.42:0/3604220905 learned_addr learned my addr 172.21.15.42:0/3604220905 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:14.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.655+0000 7ff9b0e00640 1 --2- 172.21.15.42:0/3604220905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9ac0cec40 0x7ff9ac14e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:14.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.655+0000 7ff9b2200640 1 --2- 172.21.15.42:0/3604220905 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9ac142f40 0x7ff9ac14edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:14.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.655+0000 7ff9b1800640 1 -- 172.21.15.42:0/3604220905 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9ac142f40 msgr2=0x7ff9ac14edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:14.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.655+0000 7ff9b1800640 1 --2- 172.21.15.42:0/3604220905 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9ac142f40 0x7ff9ac14edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.655+0000 7ff9b1800640 1 -- 172.21.15.42:0/3604220905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9ac0cec40 msgr2=0x7ff9ac14e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:14.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.655+0000 7ff9b1800640 1 --2- 172.21.15.42:0/3604220905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9ac0cec40 0x7ff9ac14e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.655+0000 7ff9b1800640 1 -- 172.21.15.42:0/3604220905 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ac159f90 con 0x7ff9ac0b3550 2024-09-17T01:34:14.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.655+0000 7ff9b2200640 1 --2- 172.21.15.42:0/3604220905 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9ac142f40 0x7ff9ac14edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:34:14.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.655+0000 7ff9b1800640 1 --2- 172.21.15.42:0/3604220905 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9ac0b3550 0x7ff9ac160dd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0009950 tx=0x7ff9a0003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:14.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.655+0000 7ff9a9600640 1 -- 172.21.15.42:0/3604220905 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a003f030 con 0x7ff9ac0b3550 2024-09-17T01:34:14.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.655+0000 7ff9a9600640 1 -- 172.21.15.42:0/3604220905 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9a0004510 con 0x7ff9ac0b3550 2024-09-17T01:34:14.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.655+0000 7ff9b4200640 1 -- 172.21.15.42:0/3604220905 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9ac1e6ce0 con 0x7ff9ac0b3550 2024-09-17T01:34:14.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.655+0000 7ff9a9600640 1 -- 172.21.15.42:0/3604220905 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0037040 con 0x7ff9ac0b3550 2024-09-17T01:34:14.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.655+0000 7ff9b4200640 1 -- 172.21.15.42:0/3604220905 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9ac1e7260 con 0x7ff9ac0b3550 2024-09-17T01:34:14.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.658+0000 7ff9a9600640 1 -- 172.21.15.42:0/3604220905 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff9a0042070 con 0x7ff9ac0b3550 2024-09-17T01:34:14.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.659+0000 7ff9a9600640 1 --2- 172.21.15.42:0/3604220905 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff98c078bc0 0x7ff98c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:14.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.660+0000 7ff9a9600640 1 -- 172.21.15.42:0/3604220905 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5825+0+0 (secure 0 0 0) 0x7ff9a00bab00 con 0x7ff9ac0b3550 2024-09-17T01:34:14.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.660+0000 7ff9b0e00640 1 --2- 172.21.15.42:0/3604220905 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff98c078bc0 0x7ff98c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:14.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.660+0000 7ff9bb250740 1 Processor -- start 2024-09-17T01:34:14.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.660+0000 7ff9bb250740 1 -- start start 2024-09-17T01:34:14.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.661+0000 7ff9b0e00640 1 --2- 172.21.15.42:0/3604220905 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff98c078bc0 0x7ff98c07b0d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff998001eb0 tx=0x7ff998009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:14.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.662+0000 7ff9bb250740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56059e219390 0x56059e6086a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:14.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.662+0000 7ff9bb250740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56059e1f04d0 0x56059e5eb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:14.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.662+0000 7ff9bb250740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e1f86b0 0x56059e5eb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:14.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.662+0000 7ff9bb250740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56059e4d4c10 con 0x56059e1f86b0 2024-09-17T01:34:14.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.662+0000 7ff9bb250740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56059e5339f0 con 0x56059e219390 2024-09-17T01:34:14.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.662+0000 7ff9bb250740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56059e522e20 con 0x56059e1f04d0 2024-09-17T01:34:14.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.662+0000 7ff9b2200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e1f86b0 0x56059e5eb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:14.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.662+0000 7ff9b2200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e1f86b0 0x56059e5eb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60010/0 (socket says 172.21.15.42:60010) 2024-09-17T01:34:14.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.662+0000 7ff9b2200640 1 -- 172.21.15.42:0/952992095 learned_addr learned my addr 172.21.15.42:0/952992095 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:14.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.662+0000 7ff9b0e00640 1 --2- 172.21.15.42:0/952992095 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56059e1f04d0 0x56059e5eb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:14.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.662+0000 7ff9b1800640 1 --2- 172.21.15.42:0/952992095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56059e219390 0x56059e6086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:14.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.663+0000 7ff9b2200640 1 -- 172.21.15.42:0/952992095 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56059e1f04d0 msgr2=0x56059e5eb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:14.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.663+0000 7ff9b2200640 1 --2- 172.21.15.42:0/952992095 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56059e1f04d0 0x56059e5eb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.663+0000 7ff9b2200640 1 -- 172.21.15.42:0/952992095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56059e219390 msgr2=0x56059e6086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:14.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.663+0000 7ff9b2200640 1 --2- 172.21.15.42:0/952992095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56059e219390 0x56059e6086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.663+0000 7ff9b2200640 1 -- 172.21.15.42:0/952992095 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56059e2fb7d0 con 0x56059e1f86b0 2024-09-17T01:34:14.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.663+0000 7ff9b2200640 1 --2- 172.21.15.42:0/952992095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e1f86b0 0x56059e5eb8b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4009f50 tx=0x7ff9a400f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39badfc350b97fa server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:14.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.663+0000 7ff99e000640 1 -- 172.21.15.42:0/952992095 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4003b70 con 0x56059e1f86b0 2024-09-17T01:34:14.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.663+0000 7ff99e000640 1 -- 172.21.15.42:0/952992095 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9a4003e00 con 0x56059e1f86b0 2024-09-17T01:34:14.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.663+0000 7ff99e000640 1 -- 172.21.15.42:0/952992095 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4004240 con 0x56059e1f86b0 2024-09-17T01:34:14.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.664+0000 7ff9bb250740 1 -- 172.21.15.42:0/952992095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e1f86b0 msgr2=0x56059e5eb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:14.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.664+0000 7ff9bb250740 1 --2- 172.21.15.42:0/952992095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e1f86b0 0x56059e5eb8b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4009f50 tx=0x7ff9a400f7f0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.664+0000 7ff9bb250740 1 -- 172.21.15.42:0/952992095 shutdown_connections 2024-09-17T01:34:14.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.664+0000 7ff9bb250740 1 --2- 172.21.15.42:0/952992095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e1f86b0 0x56059e5eb8b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.664+0000 7ff9bb250740 1 --2- 172.21.15.42:0/952992095 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56059e1f04d0 0x56059e5eb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.664+0000 7ff9bb250740 1 --2- 172.21.15.42:0/952992095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56059e219390 0x56059e6086a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.664+0000 7ff9bb250740 1 -- 172.21.15.42:0/952992095 >> 172.21.15.42:0/952992095 conn(0x56059e20d4e0 msgr2=0x56059e5c1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:14.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.664+0000 7ff9bb250740 1 -- 172.21.15.42:0/952992095 shutdown_connections 2024-09-17T01:34:14.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.664+0000 7ff9bb250740 1 -- 172.21.15.42:0/952992095 wait complete. 2024-09-17T01:34:14.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.665+0000 7ff9bb250740 1 -- start start 2024-09-17T01:34:14.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.666+0000 7ff9bb250740 1 Processor -- start 2024-09-17T01:34:14.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.667+0000 7ff9bb250740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56059e1f04d0 0x56059e6197c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:14.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.667+0000 7ff9bb250740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e1f86b0 0x56059e5d9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:14.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.667+0000 7ff9bb250740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56059e219390 0x56059e60a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:14.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.667+0000 7ff9bb250740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56059e4c8790 con 0x56059e1f86b0 2024-09-17T01:34:14.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.667+0000 7ff9bb250740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56059e526c30 con 0x56059e1f04d0 2024-09-17T01:34:14.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.667+0000 7ff9bb250740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56059e293740 con 0x56059e219390 2024-09-17T01:34:14.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.667+0000 7ff9bb250740 10 client.0 _ll_register_callbacks cb 0x56059e4d8260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:34:14.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.667+0000 7ff9b0e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e1f86b0 0x56059e5d9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:14.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.667+0000 7ff9b0e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e1f86b0 0x56059e5d9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60016/0 (socket says 172.21.15.42:60016) 2024-09-17T01:34:14.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.667+0000 7ff9b0e00640 1 -- 172.21.15.42:0/1724024440 learned_addr learned my addr 172.21.15.42:0/1724024440 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:14.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.667+0000 7ff9b2200640 1 --2- 172.21.15.42:0/1724024440 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56059e219390 0x56059e60a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:14.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.668+0000 7ff9b1800640 1 --2- 172.21.15.42:0/1724024440 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56059e1f04d0 0x56059e6197c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:14.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.668+0000 7ff9b0e00640 1 -- 172.21.15.42:0/1724024440 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56059e219390 msgr2=0x56059e60a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:14.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.668+0000 7ff9b0e00640 1 --2- 172.21.15.42:0/1724024440 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56059e219390 0x56059e60a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.668+0000 7ff9b0e00640 1 -- 172.21.15.42:0/1724024440 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56059e1f04d0 msgr2=0x56059e6197c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:14.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.668+0000 7ff9b0e00640 1 --2- 172.21.15.42:0/1724024440 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56059e1f04d0 0x56059e6197c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.668+0000 7ff9b0e00640 1 -- 172.21.15.42:0/1724024440 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56059e2626a0 con 0x56059e1f86b0 2024-09-17T01:34:14.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.668+0000 7ff9b2200640 1 --2- 172.21.15.42:0/1724024440 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56059e219390 0x56059e60a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:34:14.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.668+0000 7ff9b0e00640 1 --2- 172.21.15.42:0/1724024440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e1f86b0 0x56059e5d9b90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff99800ee00 tx=0x7ff998000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5bbf5ff9753b9b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:14.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.668+0000 7ff992a00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:34:14.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.668+0000 7ff992a00640 1 -- 172.21.15.42:0/1724024440 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff998025020 con 0x56059e1f86b0 2024-09-17T01:34:14.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.668+0000 7ff992a00640 1 -- 172.21.15.42:0/1724024440 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5825+0+0 (secure 0 0 0) 0x7ff998010040 con 0x56059e1f86b0 2024-09-17T01:34:14.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.668+0000 7ff9bb250740 1 -- 172.21.15.42:0/1724024440 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9a4003e00 con 0x56059e1f86b0 2024-09-17T01:34:14.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.669+0000 7ff992a00640 1 -- 172.21.15.42:0/1724024440 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7ff99802f050 con 0x56059e1f86b0 2024-09-17T01:34:14.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.669+0000 7ff9bb250740 10 client.5043 fetch_fsmap learned FSMap version 18 2024-09-17T01:34:14.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.669+0000 7ff9bb250740 1 -- 172.21.15.42:0/1724024440 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x56059e35bf60 con 0x56059e1f86b0 2024-09-17T01:34:14.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.669+0000 7ff992a00640 1 -- 172.21.15.42:0/1724024440 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9a4003e00 con 0x56059e1f86b0 2024-09-17T01:34:14.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.669+0000 7ff992a00640 1 -- 172.21.15.42:0/1724024440 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7ff998032020 con 0x56059e1f86b0 2024-09-17T01:34:14.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.669+0000 7ff9bb250740 10 client.5043 fetch_fsmap finished waiting for FSMap version 18 2024-09-17T01:34:14.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.669+0000 7ff9bb250740 10 client.5043 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-17T01:34:14.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.669+0000 7ff9bb250740 20 client.5043 populate_metadata read hostname 'smithi042' 2024-09-17T01:34:14.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.669+0000 7ff9bb250740 1 --2- 172.21.15.42:0/1724024440 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x56059e1d7f60 0x56059e5c0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:14.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.669+0000 7ff9bb250740 4 client.5043 mds_command: new command op to 4830 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:34:14.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.669+0000 7ff9bb250740 1 -- 172.21.15.42:0/1724024440 --> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56059e535940 con 0x56059e1d7f60 2024-09-17T01:34:14.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.669+0000 7ff9b1800640 1 --2- 172.21.15.42:0/1724024440 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x56059e1d7f60 0x56059e5c0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:14.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.670+0000 7ff9b1800640 1 --2- 172.21.15.42:0/1724024440 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x56059e1d7f60 0x56059e5c0620 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9136db4b8c1566d2 server_cookie=258de6e6782d5bf3 in_seq=0 out_seq=0 2024-09-17T01:34:14.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.670+0000 7ff992a00640 10 client.5043 ms_handle_connect on v2:172.21.15.42:6834/3278817895 2024-09-17T01:34:14.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.671+0000 7ff992a00640 1 -- 172.21.15.42:0/1724024440 <== mds.0 v2:172.21.15.42:6834/3278817895 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56059e535940 con 0x56059e1d7f60 2024-09-17T01:34:14.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.671+0000 7ff992a00640 10 client.5043 handle_command_reply: tid=0 2024-09-17T01:34:14.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.671+0000 7ff9bb250740 1 client.5043 shutdown 2024-09-17T01:34:14.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.671+0000 7ff9bb250740 1 -- 172.21.15.42:0/1724024440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e1f86b0 msgr2=0x56059e5d9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:14.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.671+0000 7ff9bb250740 1 --2- 172.21.15.42:0/1724024440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e1f86b0 0x56059e5d9b90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff99800ee00 tx=0x7ff998000ed0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.671+0000 7ff9bb250740 1 -- 172.21.15.42:0/1724024440 shutdown_connections 2024-09-17T01:34:14.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.671+0000 7ff9bb250740 1 --2- 172.21.15.42:0/1724024440 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56059e219390 0x56059e60a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.671+0000 7ff9bb250740 1 --2- 172.21.15.42:0/1724024440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e1f86b0 0x56059e5d9b90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.671+0000 7ff9bb250740 1 --2- 172.21.15.42:0/1724024440 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x56059e1d7f60 0x56059e5c0620 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.671+0000 7ff9bb250740 1 --2- 172.21.15.42:0/1724024440 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56059e1f04d0 0x56059e6197c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.671+0000 7ff9bb250740 1 -- 172.21.15.42:0/1724024440 >> 172.21.15.42:0/1724024440 conn(0x56059e20d4e0 msgr2=0x56059e5dab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:14.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.671+0000 7ff992a00640 0 client.5043 ms_handle_reset on v2:172.21.15.42:6834/3278817895 2024-09-17T01:34:14.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.671+0000 7ff9bb250740 1 -- 172.21.15.42:0/1724024440 shutdown_connections 2024-09-17T01:34:14.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.671+0000 7ff9bb250740 1 -- 172.21.15.42:0/1724024440 wait complete. 2024-09-17T01:34:14.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.671+0000 7ff9bb250740 20 client.5043 trim_cache size 0 max 16384 2024-09-17T01:34:14.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.691+0000 7ff9bb250740 1 Processor -- start 2024-09-17T01:34:14.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.691+0000 7ff9bb250740 1 -- start start 2024-09-17T01:34:14.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.692+0000 7ff9bb250740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56059e1f04d0 0x56059e5d9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:14.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.692+0000 7ff9bb250740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e1f86b0 0x56059e618b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:14.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.692+0000 7ff9bb250740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56059e219390 0x56059e619080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:14.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.692+0000 7ff9bb250740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac2022d0 con 0x56059e1f86b0 2024-09-17T01:34:14.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.692+0000 7ff9bb250740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac2012d0 con 0x56059e219390 2024-09-17T01:34:14.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.692+0000 7ff9bb250740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ac1f8260 con 0x56059e1f04d0 2024-09-17T01:34:14.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.693+0000 7ff9b0e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e1f86b0 0x56059e618b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:14.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.693+0000 7ff9b0e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e1f86b0 0x56059e618b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60030/0 (socket says 172.21.15.42:60030) 2024-09-17T01:34:14.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.693+0000 7ff9b0e00640 1 -- 172.21.15.42:0/4133218404 learned_addr learned my addr 172.21.15.42:0/4133218404 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:14.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.693+0000 7ff9b1800640 1 --2- 172.21.15.42:0/4133218404 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56059e1f04d0 0x56059e5d9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:14.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.693+0000 7ff9b2200640 1 --2- 172.21.15.42:0/4133218404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56059e219390 0x56059e619080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:14.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.693+0000 7ff9b0e00640 1 -- 172.21.15.42:0/4133218404 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56059e1f04d0 msgr2=0x56059e5d9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:14.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.693+0000 7ff9b0e00640 1 --2- 172.21.15.42:0/4133218404 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56059e1f04d0 0x56059e5d9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.693+0000 7ff9b0e00640 1 -- 172.21.15.42:0/4133218404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56059e219390 msgr2=0x56059e619080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:14.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.693+0000 7ff9b0e00640 1 --2- 172.21.15.42:0/4133218404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56059e219390 0x56059e619080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.693+0000 7ff9b0e00640 1 -- 172.21.15.42:0/4133218404 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56059e2f9ad0 con 0x56059e1f86b0 2024-09-17T01:34:14.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.693+0000 7ff9b0e00640 1 --2- 172.21.15.42:0/4133218404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e1f86b0 0x56059e618b40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff998015c90 tx=0x7ff998015cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a13c14cc5bdf00 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:14.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.694+0000 7ff99d600640 1 -- 172.21.15.42:0/4133218404 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff998025040 con 0x56059e1f86b0 2024-09-17T01:34:14.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.694+0000 7ff99d600640 1 -- 172.21.15.42:0/4133218404 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff99802a5e0 con 0x56059e1f86b0 2024-09-17T01:34:14.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.694+0000 7ff99d600640 1 -- 172.21.15.42:0/4133218404 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99802ab80 con 0x56059e1f86b0 2024-09-17T01:34:14.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.695+0000 7ff9bb250740 1 -- 172.21.15.42:0/4133218404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e1f86b0 msgr2=0x56059e618b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:14.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.695+0000 7ff9bb250740 1 --2- 172.21.15.42:0/4133218404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e1f86b0 0x56059e618b40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff998015c90 tx=0x7ff998015cc0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.695+0000 7ff9bb250740 1 -- 172.21.15.42:0/4133218404 shutdown_connections 2024-09-17T01:34:14.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.695+0000 7ff9bb250740 1 --2- 172.21.15.42:0/4133218404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56059e219390 0x56059e619080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.695+0000 7ff9bb250740 1 --2- 172.21.15.42:0/4133218404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e1f86b0 0x56059e618b40 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.695+0000 7ff9bb250740 1 --2- 172.21.15.42:0/4133218404 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56059e1f04d0 0x56059e5d9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.695+0000 7ff9bb250740 1 -- 172.21.15.42:0/4133218404 >> 172.21.15.42:0/4133218404 conn(0x56059e20d4e0 msgr2=0x56059e5b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:14.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.695+0000 7ff9bb250740 1 -- 172.21.15.42:0/4133218404 shutdown_connections 2024-09-17T01:34:14.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.695+0000 7ff9bb250740 1 -- 172.21.15.42:0/4133218404 wait complete. 2024-09-17T01:34:14.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.696+0000 7ff9bb250740 1 -- start start 2024-09-17T01:34:14.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.696+0000 7ff9bb250740 1 Processor -- start 2024-09-17T01:34:14.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.697+0000 7ff9bb250740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56059e1f04d0 0x56059e668650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:14.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.697+0000 7ff9bb250740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56059e1f86b0 0x56059e61f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:14.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.697+0000 7ff9bb250740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e219390 0x56059e61f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:14.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.697+0000 7ff9bb250740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac200de0 con 0x56059e219390 2024-09-17T01:34:14.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.698+0000 7ff9bb250740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56059e5c26f0 con 0x56059e1f04d0 2024-09-17T01:34:14.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.698+0000 7ff9bb250740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56059e618aa0 con 0x56059e1f86b0 2024-09-17T01:34:14.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.698+0000 7ff9bb250740 10 client.0 _ll_register_callbacks cb 0x7ff998001570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:34:14.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.698+0000 7ff9b2200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e219390 0x56059e61f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:14.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.698+0000 7ff9b2200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e219390 0x56059e61f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60046/0 (socket says 172.21.15.42:60046) 2024-09-17T01:34:14.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.698+0000 7ff9b2200640 1 -- 172.21.15.42:0/561510782 learned_addr learned my addr 172.21.15.42:0/561510782 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:14.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.698+0000 7ff9b0e00640 1 --2- 172.21.15.42:0/561510782 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56059e1f86b0 0x56059e61f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:14.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.698+0000 7ff9b1800640 1 --2- 172.21.15.42:0/561510782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56059e1f04d0 0x56059e668650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:14.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.698+0000 7ff9b2200640 1 -- 172.21.15.42:0/561510782 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56059e1f86b0 msgr2=0x56059e61f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:14.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.698+0000 7ff9b2200640 1 --2- 172.21.15.42:0/561510782 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56059e1f86b0 0x56059e61f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.698+0000 7ff9b2200640 1 -- 172.21.15.42:0/561510782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56059e1f04d0 msgr2=0x56059e668650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:14.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.698+0000 7ff9b2200640 1 --2- 172.21.15.42:0/561510782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56059e1f04d0 0x56059e668650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.698+0000 7ff9b2200640 1 -- 172.21.15.42:0/561510782 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56059e68a100 con 0x56059e219390 2024-09-17T01:34:14.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.699+0000 7ff9b2200640 1 --2- 172.21.15.42:0/561510782 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e219390 0x56059e61f890 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff9a400fcf0 tx=0x7ff9a4009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c83f3f023f9a875 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:14.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.699+0000 7ff992a00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:34:14.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.699+0000 7ff992a00640 1 -- 172.21.15.42:0/561510782 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a402c060 con 0x56059e219390 2024-09-17T01:34:14.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.699+0000 7ff992a00640 1 -- 172.21.15.42:0/561510782 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5825+0+0 (secure 0 0 0) 0x7ff9a4027670 con 0x56059e219390 2024-09-17T01:34:14.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.699+0000 7ff9bb250740 1 -- 172.21.15.42:0/561510782 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff99802a5e0 con 0x56059e219390 2024-09-17T01:34:14.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.700+0000 7ff992a00640 1 -- 172.21.15.42:0/561510782 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7ff9a4032050 con 0x56059e219390 2024-09-17T01:34:14.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.700+0000 7ff9bb250740 10 client.5049 fetch_fsmap learned FSMap version 18 2024-09-17T01:34:14.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.700+0000 7ff9bb250740 1 -- 172.21.15.42:0/561510782 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x56059e5eb9e0 con 0x56059e219390 2024-09-17T01:34:14.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.700+0000 7ff992a00640 1 -- 172.21.15.42:0/561510782 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff99802a5e0 con 0x56059e219390 2024-09-17T01:34:14.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.701+0000 7ff992a00640 1 -- 172.21.15.42:0/561510782 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7ff9a4035020 con 0x56059e219390 2024-09-17T01:34:14.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.701+0000 7ff9bb250740 10 client.5049 fetch_fsmap finished waiting for FSMap version 18 2024-09-17T01:34:14.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.701+0000 7ff9bb250740 10 client.5049 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-17T01:34:14.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.701+0000 7ff9bb250740 20 client.5049 populate_metadata read hostname 'smithi042' 2024-09-17T01:34:14.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.701+0000 7ff9bb250740 1 --2- 172.21.15.42:0/561510782 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x56059e5d9960 0x56059e689200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:14.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.701+0000 7ff9bb250740 4 client.5049 mds_command: new command op to 4830 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-17T01:34:14.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.701+0000 7ff9bb250740 1 -- 172.21.15.42:0/561510782 --> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] -- command(tid 0: {"prefix": "perf dump"}) -- 0x56059e5313f0 con 0x56059e5d9960 2024-09-17T01:34:14.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.701+0000 7ff9b1800640 1 --2- 172.21.15.42:0/561510782 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x56059e5d9960 0x56059e689200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:14.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.702+0000 7ff992a00640 10 client.5049 ms_handle_connect on v2:172.21.15.42:6834/3278817895 2024-09-17T01:34:14.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.702+0000 7ff9b1800640 1 --2- 172.21.15.42:0/561510782 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x56059e5d9960 0x56059e689200 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a43c166838e1a31 server_cookie=284914fe8adef9b0 in_seq=0 out_seq=0 2024-09-17T01:34:14.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.703+0000 7ff992a00640 1 -- 172.21.15.42:0/561510782 <== mds.0 v2:172.21.15.42:6834/3278817895 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18090 (crc 0 0 0) 0x56059e5313f0 con 0x56059e5d9960 2024-09-17T01:34:14.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.703+0000 7ff992a00640 10 client.5049 handle_command_reply: tid=0 2024-09-17T01:34:14.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.703+0000 7ff9bb250740 1 client.5049 shutdown 2024-09-17T01:34:14.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.703+0000 7ff9bb250740 1 -- 172.21.15.42:0/561510782 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e219390 msgr2=0x56059e61f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:14.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.703+0000 7ff9bb250740 1 --2- 172.21.15.42:0/561510782 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e219390 0x56059e61f890 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff9a400fcf0 tx=0x7ff9a4009cb0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.703+0000 7ff9bb250740 1 -- 172.21.15.42:0/561510782 shutdown_connections 2024-09-17T01:34:14.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.703+0000 7ff9bb250740 1 --2- 172.21.15.42:0/561510782 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56059e219390 0x56059e61f890 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.703+0000 7ff9bb250740 1 --2- 172.21.15.42:0/561510782 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56059e1f86b0 0x56059e61f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.703+0000 7ff9bb250740 1 --2- 172.21.15.42:0/561510782 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x56059e5d9960 0x56059e689200 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.703+0000 7ff9bb250740 1 --2- 172.21.15.42:0/561510782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56059e1f04d0 0x56059e668650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.703+0000 7ff9bb250740 1 -- 172.21.15.42:0/561510782 >> 172.21.15.42:0/561510782 conn(0x56059e20d4e0 msgr2=0x56059e5b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:14.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.703+0000 7ff992a00640 0 client.5049 ms_handle_reset on v2:172.21.15.42:6834/3278817895 2024-09-17T01:34:14.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.703+0000 7ff9bb250740 1 -- 172.21.15.42:0/561510782 shutdown_connections 2024-09-17T01:34:14.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.703+0000 7ff9bb250740 1 -- 172.21.15.42:0/561510782 wait complete. 2024-09-17T01:34:14.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.703+0000 7ff9bb250740 20 client.5049 trim_cache size 0 max 16384 2024-09-17T01:34:14.703 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:34:14.703 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-0": { 2024-09-17T01:34:14.704 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 28006, 2024-09-17T01:34:14.704 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 50170, 2024-09-17T01:34:14.704 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 9714272, 2024-09-17T01:34:14.704 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 50872495, 2024-09-17T01:34:14.704 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 11, 2024-09-17T01:34:14.704 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 3, 2024-09-17T01:34:14.704 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 4.469245695, 2024-09-17T01:34:14.704 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 3.384322630, 2024-09-17T01:34:14.704 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 2.367182299, 2024-09-17T01:34:14.704 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.055941818, 2024-09-17T01:34:14.704 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T01:34:14.704 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 50169, 2024-09-17T01:34:14.704 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 1.833906393, 2024-09-17T01:34:14.705 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000036554 2024-09-17T01:34:14.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.705 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-17T01:34:14.705 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 46747, 2024-09-17T01:34:14.705 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.011071628, 2024-09-17T01:34:14.705 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000236 2024-09-17T01:34:14.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.705 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-17T01:34:14.705 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 0 2024-09-17T01:34:14.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.705 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-1": { 2024-09-17T01:34:14.705 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 2076, 2024-09-17T01:34:14.706 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 2068, 2024-09-17T01:34:14.706 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 837453, 2024-09-17T01:34:14.706 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 39350397, 2024-09-17T01:34:14.706 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 5, 2024-09-17T01:34:14.706 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 4, 2024-09-17T01:34:14.706 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.396618836, 2024-09-17T01:34:14.706 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.241668101, 2024-09-17T01:34:14.706 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.067024919, 2024-09-17T01:34:14.706 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.075740152, 2024-09-17T01:34:14.706 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T01:34:14.706 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2068, 2024-09-17T01:34:14.706 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.656325049, 2024-09-17T01:34:14.706 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000317371 2024-09-17T01:34:14.706 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.707 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-17T01:34:14.707 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:14.707 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:14.707 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:14.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.707 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 133440, 2024-09-17T01:34:14.707 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 22768 2024-09-17T01:34:14.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.707 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-2": { 2024-09-17T01:34:14.707 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 1107, 2024-09-17T01:34:14.707 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 1127, 2024-09-17T01:34:14.707 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 280880, 2024-09-17T01:34:14.708 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 14335352, 2024-09-17T01:34:14.708 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 6, 2024-09-17T01:34:14.708 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 4, 2024-09-17T01:34:14.708 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.203270332, 2024-09-17T01:34:14.708 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.116594715, 2024-09-17T01:34:14.708 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.035615693, 2024-09-17T01:34:14.708 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.042175119, 2024-09-17T01:34:14.708 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T01:34:14.708 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1125, 2024-09-17T01:34:14.708 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.381676499, 2024-09-17T01:34:14.708 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000339267 2024-09-17T01:34:14.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.708 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-17T01:34:14.709 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:14.709 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:14.709 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:14.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.709 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-17T01:34:14.709 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 85776 2024-09-17T01:34:14.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.709 INFO:teuthology.orchestra.run.smithi042.stdout: "cct": { 2024-09-17T01:34:14.709 INFO:teuthology.orchestra.run.smithi042.stdout: "total_workers": 1, 2024-09-17T01:34:14.709 INFO:teuthology.orchestra.run.smithi042.stdout: "unhealthy_workers": 0 2024-09-17T01:34:14.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.709 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-MDSRank": { 2024-09-17T01:34:14.709 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2024-09-17T01:34:14.710 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2024-09-17T01:34:14.710 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1328, 2024-09-17T01:34:14.710 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 18.509984415, 2024-09-17T01:34:14.710 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.013938241 2024-09-17T01:34:14.710 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:34:14.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.710 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-PurgeQueue": { 2024-09-17T01:34:14.710 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 302, 2024-09-17T01:34:14.710 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2024-09-17T01:34:14.710 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1615, 2024-09-17T01:34:14.710 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.987981004, 2024-09-17T01:34:14.710 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000611752 2024-09-17T01:34:14.710 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:34:14.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.711 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": { 2024-09-17T01:34:14.711 INFO:teuthology.orchestra.run.smithi042.stdout: "request": 25529, 2024-09-17T01:34:14.711 INFO:teuthology.orchestra.run.smithi042.stdout: "reply": 25529, 2024-09-17T01:34:14.711 INFO:teuthology.orchestra.run.smithi042.stdout: "reply_latency": { 2024-09-17T01:34:14.711 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 25529, 2024-09-17T01:34:14.711 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 466.893702714, 2024-09-17T01:34:14.711 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.018288757 2024-09-17T01:34:14.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.711 INFO:teuthology.orchestra.run.smithi042.stdout: "slow_reply": 0, 2024-09-17T01:34:14.711 INFO:teuthology.orchestra.run.smithi042.stdout: "forward": 0, 2024-09-17T01:34:14.711 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch_complete": 0, 2024-09-17T01:34:14.711 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch_keys": 0, 2024-09-17T01:34:14.711 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_commit": 12, 2024-09-17T01:34:14.712 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_split": 0, 2024-09-17T01:34:14.712 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_merge": 0, 2024-09-17T01:34:14.712 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes": 19894, 2024-09-17T01:34:14.712 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_top": 0, 2024-09-17T01:34:14.712 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_bottom": 19894, 2024-09-17T01:34:14.712 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pin_tail": 0, 2024-09-17T01:34:14.712 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pinned": 19893, 2024-09-17T01:34:14.712 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_expired": 0, 2024-09-17T01:34:14.712 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_with_caps": 72, 2024-09-17T01:34:14.712 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": 72, 2024-09-17T01:34:14.712 INFO:teuthology.orchestra.run.smithi042.stdout: "subtrees": 2, 2024-09-17T01:34:14.712 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse": 46394, 2024-09-17T01:34:14.712 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_hit": 45837, 2024-09-17T01:34:14.713 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_forward": 0, 2024-09-17T01:34:14.713 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_discover": 0, 2024-09-17T01:34:14.713 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_dir_fetch": 0, 2024-09-17T01:34:14.713 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_remote_ino": 0, 2024-09-17T01:34:14.713 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_lock": 112, 2024-09-17T01:34:14.713 INFO:teuthology.orchestra.run.smithi042.stdout: "load_cent": 0, 2024-09-17T01:34:14.717 INFO:teuthology.orchestra.run.smithi042.stdout: "q": 0, 2024-09-17T01:34:14.717 INFO:teuthology.orchestra.run.smithi042.stdout: "exported": 0, 2024-09-17T01:34:14.717 INFO:teuthology.orchestra.run.smithi042.stdout: "exported_inodes": 0, 2024-09-17T01:34:14.717 INFO:teuthology.orchestra.run.smithi042.stdout: "imported": 0, 2024-09-17T01:34:14.717 INFO:teuthology.orchestra.run.smithi042.stdout: "imported_inodes": 0, 2024-09-17T01:34:14.717 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_dir_fetch": 0, 2024-09-17T01:34:14.717 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_backtrace_fetch": 0, 2024-09-17T01:34:14.717 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_peer_discover": 0, 2024-09-17T01:34:14.717 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rfiles": 0, 2024-09-17T01:34:14.718 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rbytes": 0, 2024-09-17T01:34:14.718 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rsnaps": 0, 2024-09-17T01:34:14.718 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_backtrace_fetch": 0, 2024-09-17T01:34:14.718 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_set_tag": 0, 2024-09-17T01:34:14.718 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_backtrace_repaired": 0, 2024-09-17T01:34:14.718 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_inotable_repaired": 0, 2024-09-17T01:34:14.718 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dir_inodes": 0, 2024-09-17T01:34:14.718 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dir_base_inodes": 0, 2024-09-17T01:34:14.718 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dirfrag_rstats": 0, 2024-09-17T01:34:14.718 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_file_inodes": 0, 2024-09-17T01:34:14.718 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_inode_file_caps": 0, 2024-09-17T01:34:14.718 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_revoke": 749, 2024-09-17T01:34:14.718 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_grant": 4023, 2024-09-17T01:34:14.718 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_trunc": 0, 2024-09-17T01:34:14.719 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-17T01:34:14.719 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-17T01:34:14.719 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_caps": 3186, 2024-09-17T01:34:14.719 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_caps_dirty": 2700, 2024-09-17T01:34:14.719 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_cap_release": 62, 2024-09-17T01:34:14.719 INFO:teuthology.orchestra.run.smithi042.stdout: "process_request_cap_release": 14069 2024-09-17T01:34:14.719 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.719 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache": { 2024-09-17T01:34:14.719 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_update": 0, 2024-09-17T01:34:14.719 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_update_receipt": 0, 2024-09-17T01:34:14.719 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_try_discover": 0, 2024-09-17T01:34:14.719 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_send_discover": 0, 2024-09-17T01:34:14.720 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_handle_discover": 0, 2024-09-17T01:34:14.720 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays": 1950, 2024-09-17T01:34:14.720 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_delayed": 0, 2024-09-17T01:34:14.720 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_enqueuing": 284, 2024-09-17T01:34:14.720 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_created": 4157, 2024-09-17T01:34:14.720 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_enqueued": 1646, 2024-09-17T01:34:14.720 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_reintegrated": 2215, 2024-09-17T01:34:14.720 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_migrated": 0, 2024-09-17T01:34:14.720 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_processing": 0, 2024-09-17T01:34:14.720 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_enqueued": 0, 2024-09-17T01:34:14.720 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_prioritized": 0, 2024-09-17T01:34:14.720 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_started": 0, 2024-09-17T01:34:14.720 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_completed": 0, 2024-09-17T01:34:14.721 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_quiesce_path": 0, 2024-09-17T01:34:14.721 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_quiesce_inode": 0, 2024-09-17T01:34:14.721 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_enqueue_scrub": 0, 2024-09-17T01:34:14.721 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_exportdir": 0, 2024-09-17T01:34:14.721 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_flush": 0, 2024-09-17T01:34:14.721 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragmentdir": 0, 2024-09-17T01:34:14.721 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragstats": 0, 2024-09-17T01:34:14.721 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_inodestats": 0, 2024-09-17T01:34:14.721 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:34:14.721 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_succeeded": 0, 2024-09-17T01:34:14.721 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_write_failed": 0 2024-09-17T01:34:14.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.721 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log": { 2024-09-17T01:34:14.722 INFO:teuthology.orchestra.run.smithi042.stdout: "evlrg": 0, 2024-09-17T01:34:14.722 INFO:teuthology.orchestra.run.smithi042.stdout: "evadd": 23780, 2024-09-17T01:34:14.722 INFO:teuthology.orchestra.run.smithi042.stdout: "evex": 0, 2024-09-17T01:34:14.722 INFO:teuthology.orchestra.run.smithi042.stdout: "evtrm": 0, 2024-09-17T01:34:14.722 INFO:teuthology.orchestra.run.smithi042.stdout: "ev": 23780, 2024-09-17T01:34:14.722 INFO:teuthology.orchestra.run.smithi042.stdout: "evexg": 0, 2024-09-17T01:34:14.722 INFO:teuthology.orchestra.run.smithi042.stdout: "evexd": 0, 2024-09-17T01:34:14.722 INFO:teuthology.orchestra.run.smithi042.stdout: "segadd": 32, 2024-09-17T01:34:14.722 INFO:teuthology.orchestra.run.smithi042.stdout: "segex": 0, 2024-09-17T01:34:14.722 INFO:teuthology.orchestra.run.smithi042.stdout: "segtrm": 0, 2024-09-17T01:34:14.722 INFO:teuthology.orchestra.run.smithi042.stdout: "seg": 32, 2024-09-17T01:34:14.722 INFO:teuthology.orchestra.run.smithi042.stdout: "segmjr": 3, 2024-09-17T01:34:14.722 INFO:teuthology.orchestra.run.smithi042.stdout: "segexg": 0, 2024-09-17T01:34:14.722 INFO:teuthology.orchestra.run.smithi042.stdout: "segexd": 0, 2024-09-17T01:34:14.722 INFO:teuthology.orchestra.run.smithi042.stdout: "expos": 4194304, 2024-09-17T01:34:14.723 INFO:teuthology.orchestra.run.smithi042.stdout: "wrpos": 94386647, 2024-09-17T01:34:14.723 INFO:teuthology.orchestra.run.smithi042.stdout: "rdpos": 0, 2024-09-17T01:34:14.723 INFO:teuthology.orchestra.run.smithi042.stdout: "jlat": { 2024-09-17T01:34:14.723 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2591, 2024-09-17T01:34:14.723 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 117.499362030, 2024-09-17T01:34:14.723 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.045349039 2024-09-17T01:34:14.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.723 INFO:teuthology.orchestra.run.smithi042.stdout: "replayed": 0 2024-09-17T01:34:14.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.723 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_mem": { 2024-09-17T01:34:14.723 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 2014, 2024-09-17T01:34:14.723 INFO:teuthology.orchestra.run.smithi042.stdout: "ino+": 2014, 2024-09-17T01:34:14.723 INFO:teuthology.orchestra.run.smithi042.stdout: "ino-": 0, 2024-09-17T01:34:14.724 INFO:teuthology.orchestra.run.smithi042.stdout: "dir": 13, 2024-09-17T01:34:14.724 INFO:teuthology.orchestra.run.smithi042.stdout: "dir+": 13, 2024-09-17T01:34:14.724 INFO:teuthology.orchestra.run.smithi042.stdout: "dir-": 0, 2024-09-17T01:34:14.724 INFO:teuthology.orchestra.run.smithi042.stdout: "dn": 19894, 2024-09-17T01:34:14.724 INFO:teuthology.orchestra.run.smithi042.stdout: "dn+": 19895, 2024-09-17T01:34:14.724 INFO:teuthology.orchestra.run.smithi042.stdout: "dn-": 1, 2024-09-17T01:34:14.724 INFO:teuthology.orchestra.run.smithi042.stdout: "cap": 72, 2024-09-17T01:34:14.724 INFO:teuthology.orchestra.run.smithi042.stdout: "cap+": 8656, 2024-09-17T01:34:14.724 INFO:teuthology.orchestra.run.smithi042.stdout: "cap-": 8584, 2024-09-17T01:34:14.724 INFO:teuthology.orchestra.run.smithi042.stdout: "rss": 177944, 2024-09-17T01:34:14.724 INFO:teuthology.orchestra.run.smithi042.stdout: "heap": 408907776 2024-09-17T01:34:14.724 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.724 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_server": { 2024-09-17T01:34:14.724 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_client_request": 28474, 2024-09-17T01:34:14.724 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_server_request": 0, 2024-09-17T01:34:14.725 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_request": 25529, 2024-09-17T01:34:14.725 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_session": 5, 2024-09-17T01:34:14.725 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_peer_request": 0, 2024-09-17T01:34:14.725 INFO:teuthology.orchestra.run.smithi042.stdout: "req_create_latency": { 2024-09-17T01:34:14.725 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2000, 2024-09-17T01:34:14.725 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 1.735448118, 2024-09-17T01:34:14.725 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000867724 2024-09-17T01:34:14.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.725 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getattr_latency": { 2024-09-17T01:34:14.725 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 30, 2024-09-17T01:34:14.725 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.004667425, 2024-09-17T01:34:14.725 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000155580 2024-09-17T01:34:14.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.726 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getfilelock_latency": { 2024-09-17T01:34:14.726 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:14.726 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:14.726 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:14.726 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.726 INFO:teuthology.orchestra.run.smithi042.stdout: "req_link_latency": { 2024-09-17T01:34:14.726 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 6000, 2024-09-17T01:34:14.726 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 7.961918365, 2024-09-17T01:34:14.726 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.001326986 2024-09-17T01:34:14.726 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.726 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookup_latency": { 2024-09-17T01:34:14.726 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 7270, 2024-09-17T01:34:14.726 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 5.959106005, 2024-09-17T01:34:14.726 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000819684 2024-09-17T01:34:14.727 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.727 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookuphash_latency": { 2024-09-17T01:34:14.727 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:14.727 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:14.727 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:14.727 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.727 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupino_latency": { 2024-09-17T01:34:14.727 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:14.727 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:14.727 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:14.727 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.727 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupname_latency": { 2024-09-17T01:34:14.727 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:14.728 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:14.728 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:14.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.728 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupparent_latency": { 2024-09-17T01:34:14.728 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:14.728 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:14.728 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:14.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.728 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupsnap_latency": { 2024-09-17T01:34:14.728 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-17T01:34:14.728 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000377436, 2024-09-17T01:34:14.728 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000377436 2024-09-17T01:34:14.729 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.729 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lssnap_latency": { 2024-09-17T01:34:14.729 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:14.729 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:14.729 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:14.729 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.729 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mkdir_latency": { 2024-09-17T01:34:14.729 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-17T01:34:14.729 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.003953364, 2024-09-17T01:34:14.729 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.003953364 2024-09-17T01:34:14.729 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.729 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mknod_latency": { 2024-09-17T01:34:14.729 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:14.730 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:14.730 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:14.730 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.730 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mksnap_latency": { 2024-09-17T01:34:14.730 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-17T01:34:14.730 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.268330357, 2024-09-17T01:34:14.730 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.268330357 2024-09-17T01:34:14.730 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.730 INFO:teuthology.orchestra.run.smithi042.stdout: "req_open_latency": { 2024-09-17T01:34:14.730 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-17T01:34:14.730 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000095744, 2024-09-17T01:34:14.730 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000095744 2024-09-17T01:34:14.730 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.731 INFO:teuthology.orchestra.run.smithi042.stdout: "req_readdir_latency": { 2024-09-17T01:34:14.731 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 8, 2024-09-17T01:34:14.731 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.842030721, 2024-09-17T01:34:14.731 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.105253840 2024-09-17T01:34:14.731 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.731 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rename_latency": { 2024-09-17T01:34:14.731 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2215, 2024-09-17T01:34:14.731 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 429.630943931, 2024-09-17T01:34:14.731 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.193964308 2024-09-17T01:34:14.731 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.731 INFO:teuthology.orchestra.run.smithi042.stdout: "req_renamesnap_latency": { 2024-09-17T01:34:14.731 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:14.732 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:14.732 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:14.732 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.732 INFO:teuthology.orchestra.run.smithi042.stdout: "req_snapdiff_latency": { 2024-09-17T01:34:14.732 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:14.732 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:14.732 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:14.732 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.732 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmdir_latency": { 2024-09-17T01:34:14.732 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:14.732 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:14.732 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:14.732 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.733 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmsnap_latency": { 2024-09-17T01:34:14.733 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-17T01:34:14.733 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.005133621, 2024-09-17T01:34:14.733 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.005133621 2024-09-17T01:34:14.733 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.733 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmxattr_latency": { 2024-09-17T01:34:14.733 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:14.733 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:14.733 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:14.733 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.733 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setattr_latency": { 2024-09-17T01:34:14.733 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-17T01:34:14.733 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000349170, 2024-09-17T01:34:14.734 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000349170 2024-09-17T01:34:14.734 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.734 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setdirlayout_latency": { 2024-09-17T01:34:14.734 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:14.734 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:14.734 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:14.734 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.734 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setfilelock_latency": { 2024-09-17T01:34:14.734 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:14.734 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:14.734 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:14.734 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.734 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setlayout_latency": { 2024-09-17T01:34:14.735 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:14.735 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:14.735 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:14.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.735 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setxattr_latency": { 2024-09-17T01:34:14.735 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:14.735 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:14.735 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:14.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.735 INFO:teuthology.orchestra.run.smithi042.stdout: "req_symlink_latency": { 2024-09-17T01:34:14.735 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:14.735 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:14.735 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:14.736 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.736 INFO:teuthology.orchestra.run.smithi042.stdout: "req_unlink_latency": { 2024-09-17T01:34:14.736 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 8000, 2024-09-17T01:34:14.736 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 20.481348457, 2024-09-17T01:34:14.736 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.002560168 2024-09-17T01:34:14.736 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.736 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_revoke_eviction": 0, 2024-09-17T01:34:14.736 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_acquisition_throttle": 0, 2024-09-17T01:34:14.736 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getvxattr_latency": { 2024-09-17T01:34:14.736 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:14.736 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:14.736 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:14.736 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:34:14.736 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.737 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_sessions": { 2024-09-17T01:34:14.737 INFO:teuthology.orchestra.run.smithi042.stdout: "session_count": 1, 2024-09-17T01:34:14.737 INFO:teuthology.orchestra.run.smithi042.stdout: "session_add": 1, 2024-09-17T01:34:14.737 INFO:teuthology.orchestra.run.smithi042.stdout: "session_remove": 0, 2024-09-17T01:34:14.737 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_open": 1, 2024-09-17T01:34:14.737 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_stale": 0, 2024-09-17T01:34:14.737 INFO:teuthology.orchestra.run.smithi042.stdout: "total_load": 17622, 2024-09-17T01:34:14.737 INFO:teuthology.orchestra.run.smithi042.stdout: "average_load": 17622, 2024-09-17T01:34:14.737 INFO:teuthology.orchestra.run.smithi042.stdout: "avg_session_uptime": 64, 2024-09-17T01:34:14.737 INFO:teuthology.orchestra.run.smithi042.stdout: "mdthresh_evicted": 0 2024-09-17T01:34:14.737 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.737 INFO:teuthology.orchestra.run.smithi042.stdout: "mempool": { 2024-09-17T01:34:14.737 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_bytes": 0, 2024-09-17T01:34:14.737 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_items": 0, 2024-09-17T01:34:14.738 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_bytes": 0, 2024-09-17T01:34:14.738 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_items": 0, 2024-09-17T01:34:14.738 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_bytes": 0, 2024-09-17T01:34:14.738 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_items": 0, 2024-09-17T01:34:14.738 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-17T01:34:14.738 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_items": 0, 2024-09-17T01:34:14.738 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-17T01:34:14.738 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_items": 0, 2024-09-17T01:34:14.738 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_bytes": 0, 2024-09-17T01:34:14.738 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_items": 0, 2024-09-17T01:34:14.738 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-17T01:34:14.738 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_items": 0, 2024-09-17T01:34:14.738 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_bytes": 0, 2024-09-17T01:34:14.738 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_items": 0, 2024-09-17T01:34:14.739 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_bytes": 0, 2024-09-17T01:34:14.739 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_items": 0, 2024-09-17T01:34:14.739 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-17T01:34:14.739 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_items": 0, 2024-09-17T01:34:14.739 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-17T01:34:14.739 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_items": 0, 2024-09-17T01:34:14.739 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_bytes": 0, 2024-09-17T01:34:14.739 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_items": 0, 2024-09-17T01:34:14.739 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_bytes": 0, 2024-09-17T01:34:14.739 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_items": 0, 2024-09-17T01:34:14.739 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-17T01:34:14.739 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_items": 0, 2024-09-17T01:34:14.739 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_bytes": 0, 2024-09-17T01:34:14.739 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_items": 0, 2024-09-17T01:34:14.739 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_bytes": 0, 2024-09-17T01:34:14.740 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_items": 0, 2024-09-17T01:34:14.740 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_bytes": 0, 2024-09-17T01:34:14.740 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_items": 0, 2024-09-17T01:34:14.740 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_bytes": 0, 2024-09-17T01:34:14.740 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_items": 0, 2024-09-17T01:34:14.740 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_bytes": 16499466, 2024-09-17T01:34:14.740 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_items": 6140, 2024-09-17T01:34:14.740 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_bytes": 440, 2024-09-17T01:34:14.740 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_items": 5, 2024-09-17T01:34:14.740 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bytes": 0, 2024-09-17T01:34:14.740 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_items": 0, 2024-09-17T01:34:14.740 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_bytes": 0, 2024-09-17T01:34:14.740 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_items": 0, 2024-09-17T01:34:14.741 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_bytes": 0, 2024-09-17T01:34:14.741 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_items": 0, 2024-09-17T01:34:14.741 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_bytes": 5696, 2024-09-17T01:34:14.741 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_items": 83, 2024-09-17T01:34:14.741 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_bytes": 0, 2024-09-17T01:34:14.741 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_items": 0, 2024-09-17T01:34:14.741 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_bytes": 0, 2024-09-17T01:34:14.741 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_items": 0, 2024-09-17T01:34:14.741 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_bytes": 20944658, 2024-09-17T01:34:14.741 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_items": 911695, 2024-09-17T01:34:14.741 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_bytes": 0, 2024-09-17T01:34:14.741 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_items": 0, 2024-09-17T01:34:14.741 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_bytes": 0, 2024-09-17T01:34:14.741 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_items": 0 2024-09-17T01:34:14.742 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.742 INFO:teuthology.orchestra.run.smithi042.stdout: "objecter": { 2024-09-17T01:34:14.742 INFO:teuthology.orchestra.run.smithi042.stdout: "op_active": 0, 2024-09-17T01:34:14.742 INFO:teuthology.orchestra.run.smithi042.stdout: "op_laggy": 0, 2024-09-17T01:34:14.742 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send": 4468, 2024-09-17T01:34:14.742 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send_bytes": 90645382, 2024-09-17T01:34:14.742 INFO:teuthology.orchestra.run.smithi042.stdout: "op_resend": 37, 2024-09-17T01:34:14.742 INFO:teuthology.orchestra.run.smithi042.stdout: "op_reply": 4468, 2024-09-17T01:34:14.742 INFO:teuthology.orchestra.run.smithi042.stdout: "op_latency": { 2024-09-17T01:34:14.742 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 4468, 2024-09-17T01:34:14.742 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 22.176818987, 2024-09-17T01:34:14.742 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.004963477 2024-09-17T01:34:14.742 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.742 INFO:teuthology.orchestra.run.smithi042.stdout: "op_inflight": 0, 2024-09-17T01:34:14.742 INFO:teuthology.orchestra.run.smithi042.stdout: "oplen_avg": { 2024-09-17T01:34:14.743 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 4468, 2024-09-17T01:34:14.743 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 4582 2024-09-17T01:34:14.743 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.743 INFO:teuthology.orchestra.run.smithi042.stdout: "op": 4468, 2024-09-17T01:34:14.743 INFO:teuthology.orchestra.run.smithi042.stdout: "op_r": 60, 2024-09-17T01:34:14.743 INFO:teuthology.orchestra.run.smithi042.stdout: "op_w": 4408, 2024-09-17T01:34:14.743 INFO:teuthology.orchestra.run.smithi042.stdout: "op_rmw": 0, 2024-09-17T01:34:14.743 INFO:teuthology.orchestra.run.smithi042.stdout: "op_pg": 0, 2024-09-17T01:34:14.743 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_stat": 0, 2024-09-17T01:34:14.743 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_create": 11, 2024-09-17T01:34:14.743 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_read": 60, 2024-09-17T01:34:14.743 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_write": 2651, 2024-09-17T01:34:14.743 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writefull": 37, 2024-09-17T01:34:14.743 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writesame": 0, 2024-09-17T01:34:14.743 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_append": 0, 2024-09-17T01:34:14.744 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_zero": 1596, 2024-09-17T01:34:14.744 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_truncate": 0, 2024-09-17T01:34:14.744 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_delete": 34, 2024-09-17T01:34:14.744 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_mapext": 0, 2024-09-17T01:34:14.744 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_sparse_read": 0, 2024-09-17T01:34:14.744 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_clonerange": 0, 2024-09-17T01:34:14.744 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_getxattr": 0, 2024-09-17T01:34:14.744 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_setxattr": 22, 2024-09-17T01:34:14.744 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_cmpxattr": 0, 2024-09-17T01:34:14.744 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_rmxattr": 0, 2024-09-17T01:34:14.744 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_resetxattrs": 0, 2024-09-17T01:34:14.744 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_call": 0, 2024-09-17T01:34:14.744 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_watch": 0, 2024-09-17T01:34:14.745 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_notify": 0, 2024-09-17T01:34:14.745 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_src_cmpxattr": 0, 2024-09-17T01:34:14.745 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls": 0, 2024-09-17T01:34:14.745 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls_filter": 0, 2024-09-17T01:34:14.745 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_other": 0, 2024-09-17T01:34:14.745 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_active": 0, 2024-09-17T01:34:14.745 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_send": 0, 2024-09-17T01:34:14.745 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_resend": 0, 2024-09-17T01:34:14.745 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_ping": 0, 2024-09-17T01:34:14.745 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_active": 0, 2024-09-17T01:34:14.745 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_send": 0, 2024-09-17T01:34:14.745 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_resend": 0, 2024-09-17T01:34:14.745 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_active": 0, 2024-09-17T01:34:14.745 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_send": 0, 2024-09-17T01:34:14.746 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_resend": 0, 2024-09-17T01:34:14.746 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_active": 0, 2024-09-17T01:34:14.746 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_send": 0, 2024-09-17T01:34:14.746 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_resend": 0, 2024-09-17T01:34:14.746 INFO:teuthology.orchestra.run.smithi042.stdout: "command_active": 0, 2024-09-17T01:34:14.746 INFO:teuthology.orchestra.run.smithi042.stdout: "command_send": 0, 2024-09-17T01:34:14.746 INFO:teuthology.orchestra.run.smithi042.stdout: "command_resend": 0, 2024-09-17T01:34:14.746 INFO:teuthology.orchestra.run.smithi042.stdout: "map_epoch": 35, 2024-09-17T01:34:14.746 INFO:teuthology.orchestra.run.smithi042.stdout: "map_full": 0, 2024-09-17T01:34:14.746 INFO:teuthology.orchestra.run.smithi042.stdout: "map_inc": 3, 2024-09-17T01:34:14.746 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_sessions": 8, 2024-09-17T01:34:14.746 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_open": 8, 2024-09-17T01:34:14.746 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_close": 0, 2024-09-17T01:34:14.746 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_laggy": 0, 2024-09-17T01:34:14.746 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_wr": 138, 2024-09-17T01:34:14.747 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_rd": 0, 2024-09-17T01:34:14.747 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_del": 33 2024-09-17T01:34:14.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.747 INFO:teuthology.orchestra.run.smithi042.stdout: "oft": { 2024-09-17T01:34:14.747 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_objs": 1, 2024-09-17T01:34:14.747 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_kv_pairs": 0, 2024-09-17T01:34:14.747 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_updates": 0, 2024-09-17T01:34:14.747 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_removes": 0 2024-09-17T01:34:14.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.747 INFO:teuthology.orchestra.run.smithi042.stdout: "purge_queue": { 2024-09-17T01:34:14.747 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops": 1, 2024-09-17T01:34:14.747 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops_high_water": 32, 2024-09-17T01:34:14.747 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing": 1, 2024-09-17T01:34:14.747 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_high_water": 32, 2024-09-17T01:34:14.747 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed_ops": 1596, 2024-09-17T01:34:14.747 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed": 1596, 2024-09-17T01:34:14.748 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_item_in_journal": 0 2024-09-17T01:34:14.748 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.748 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-17T01:34:14.748 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-17T01:34:14.748 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-09-17T01:34:14.748 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-17T01:34:14.748 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 31185, 2024-09-17T01:34:14.748 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 8446586, 2024-09-17T01:34:14.748 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-17T01:34:14.748 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 31185, 2024-09-17T01:34:14.748 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-17T01:34:14.748 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-17T01:34:14.748 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 31185, 2024-09-17T01:34:14.749 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 8446586, 2024-09-17T01:34:14.749 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-17T01:34:14.749 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:14.749 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:14.749 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:14.749 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:34:14.749 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.749 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_bytes": { 2024-09-17T01:34:14.749 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-17T01:34:14.749 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-09-17T01:34:14.749 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-17T01:34:14.749 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-17T01:34:14.749 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-17T01:34:14.750 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-17T01:34:14.750 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-17T01:34:14.750 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 4468, 2024-09-17T01:34:14.750 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 90853080, 2024-09-17T01:34:14.750 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 4468, 2024-09-17T01:34:14.750 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 90853080, 2024-09-17T01:34:14.750 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-17T01:34:14.750 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:14.750 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:14.750 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:14.750 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:34:14.750 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.750 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_ops": { 2024-09-17T01:34:14.750 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-17T01:34:14.751 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 1024, 2024-09-17T01:34:14.751 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-17T01:34:14.751 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-17T01:34:14.751 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-17T01:34:14.751 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-17T01:34:14.751 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-17T01:34:14.751 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 4468, 2024-09-17T01:34:14.751 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 4468, 2024-09-17T01:34:14.751 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 4468, 2024-09-17T01:34:14.751 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 4468, 2024-09-17T01:34:14.751 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-17T01:34:14.751 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:14.751 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:14.751 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:14.752 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:34:14.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.752 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle": { 2024-09-17T01:34:14.752 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-17T01:34:14.752 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2024-09-17T01:34:14.752 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-17T01:34:14.752 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 1930, 2024-09-17T01:34:14.752 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 207698, 2024-09-17T01:34:14.752 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-17T01:34:14.752 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 1930, 2024-09-17T01:34:14.752 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-17T01:34:14.752 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-17T01:34:14.752 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 60, 2024-09-17T01:34:14.753 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 207698, 2024-09-17T01:34:14.753 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-17T01:34:14.753 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:14.753 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:14.753 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:14.753 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:34:14.753 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.753 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle-0x5654656f9380": { 2024-09-17T01:34:14.753 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 31232, 2024-09-17T01:34:14.753 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2024-09-17T01:34:14.753 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-17T01:34:14.753 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 23783, 2024-09-17T01:34:14.753 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 90194140, 2024-09-17T01:34:14.754 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-17T01:34:14.754 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 23783, 2024-09-17T01:34:14.754 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-17T01:34:14.754 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-17T01:34:14.754 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 2591, 2024-09-17T01:34:14.754 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 90162908, 2024-09-17T01:34:14.754 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-17T01:34:14.754 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:14.754 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:14.754 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:14.754 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:34:14.754 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:14.754 INFO:teuthology.orchestra.run.smithi042.stdout: "trackedop": { 2024-09-17T01:34:14.755 INFO:teuthology.orchestra.run.smithi042.stdout: "slow_ops_count": 0 2024-09-17T01:34:14.755 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:34:14.755 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:34:14.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.704+0000 7ff9b4200640 1 -- 172.21.15.42:0/3604220905 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff98c078bc0 msgr2=0x7ff98c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:14.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.704+0000 7ff9b4200640 1 --2- 172.21.15.42:0/3604220905 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff98c078bc0 0x7ff98c07b0d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff998001eb0 tx=0x7ff998009040 comp rx=0 tx=0).stop 2024-09-17T01:34:14.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.704+0000 7ff9b4200640 1 -- 172.21.15.42:0/3604220905 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9ac0b3550 msgr2=0x7ff9ac160dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:14.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.704+0000 7ff9b4200640 1 --2- 172.21.15.42:0/3604220905 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9ac0b3550 0x7ff9ac160dd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0009950 tx=0x7ff9a0003b60 comp rx=0 tx=0).stop 2024-09-17T01:34:14.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.704+0000 7ff9b4200640 1 -- 172.21.15.42:0/3604220905 shutdown_connections 2024-09-17T01:34:14.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.704+0000 7ff9b4200640 1 --2- 172.21.15.42:0/3604220905 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff98c078bc0 0x7ff98c07b0d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.704+0000 7ff9b4200640 1 --2- 172.21.15.42:0/3604220905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9ac0cec40 0x7ff9ac14e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.704+0000 7ff9b4200640 1 --2- 172.21.15.42:0/3604220905 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9ac142f40 0x7ff9ac14edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.704+0000 7ff9b4200640 1 --2- 172.21.15.42:0/3604220905 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9ac0b3550 0x7ff9ac160dd0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:14.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.704+0000 7ff9b4200640 1 -- 172.21.15.42:0/3604220905 >> 172.21.15.42:0/3604220905 conn(0x7ff9ac0b2930 msgr2=0x7ff9ac15b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:14.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.704+0000 7ff9b4200640 1 -- 172.21.15.42:0/3604220905 shutdown_connections 2024-09-17T01:34:14.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:14.705+0000 7ff9b4200640 1 -- 172.21.15.42:0/3604220905 wait complete. 2024-09-17T01:34:14.758 INFO:tasks.cephfs.test_scrub_checks:num of strays: 1950 2024-09-17T01:34:14.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:34:14.758 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub start / recursive,scrub_mdsdir 2024-09-17T01:34:15.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.006+0000 7fda2e200640 1 -- 172.21.15.42:0/1701161020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda280b56d0 msgr2=0x7fda280b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:15.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.006+0000 7fda2e200640 1 --2- 172.21.15.42:0/1701161020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda280b56d0 0x7fda280b46f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fda18009830 tx=0x7fda1802a510 comp rx=0 tx=0).stop 2024-09-17T01:34:15.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.006+0000 7fda2e200640 1 -- 172.21.15.42:0/1701161020 shutdown_connections 2024-09-17T01:34:15.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.006+0000 7fda2e200640 1 --2- 172.21.15.42:0/1701161020 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fda280cdb20 0x7fda280cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.006+0000 7fda2e200640 1 --2- 172.21.15.42:0/1701161020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda280b56d0 0x7fda280b46f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.006+0000 7fda2e200640 1 -- 172.21.15.42:0/1701161020 >> 172.21.15.42:0/1701161020 conn(0x7fda280b28f0 msgr2=0x7fda2806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:15.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.006+0000 7fda2e200640 1 -- 172.21.15.42:0/1701161020 shutdown_connections 2024-09-17T01:34:15.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.006+0000 7fda2e200640 1 -- 172.21.15.42:0/1701161020 wait complete. 2024-09-17T01:34:15.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.008+0000 7fda2e200640 1 Processor -- start 2024-09-17T01:34:15.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.008+0000 7fda2e200640 1 -- start start 2024-09-17T01:34:15.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.010+0000 7fda2e200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda2806d430 0x7fda281f35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.010+0000 7fda2e200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda280b56d0 0x7fda2813f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.010+0000 7fda2e200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fda280cdb20 0x7fda281f73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.010+0000 7fda2e200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fda2815d560 con 0x7fda280b56d0 2024-09-17T01:34:15.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.010+0000 7fda2e200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fda2815d3e0 con 0x7fda2806d430 2024-09-17T01:34:15.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.010+0000 7fda2e200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fda2815d6e0 con 0x7fda280cdb20 2024-09-17T01:34:15.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.010+0000 7fda26a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda280b56d0 0x7fda2813f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.010+0000 7fda26a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda280b56d0 0x7fda2813f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60058/0 (socket says 172.21.15.42:60058) 2024-09-17T01:34:15.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.010+0000 7fda26a00640 1 -- 172.21.15.42:0/2767358100 learned_addr learned my addr 172.21.15.42:0/2767358100 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:15.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.010+0000 7fda27e00640 1 --2- 172.21.15.42:0/2767358100 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fda280cdb20 0x7fda281f73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.010+0000 7fda27400640 1 --2- 172.21.15.42:0/2767358100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda2806d430 0x7fda281f35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.011+0000 7fda26a00640 1 -- 172.21.15.42:0/2767358100 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fda280cdb20 msgr2=0x7fda281f73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:15.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.011+0000 7fda26a00640 1 --2- 172.21.15.42:0/2767358100 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fda280cdb20 0x7fda281f73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.011+0000 7fda26a00640 1 -- 172.21.15.42:0/2767358100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda2806d430 msgr2=0x7fda281f35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:15.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.011+0000 7fda26a00640 1 --2- 172.21.15.42:0/2767358100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda2806d430 0x7fda281f35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.011+0000 7fda26a00640 1 -- 172.21.15.42:0/2767358100 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda281f6bd0 con 0x7fda280b56d0 2024-09-17T01:34:15.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.011+0000 7fda26a00640 1 --2- 172.21.15.42:0/2767358100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda280b56d0 0x7fda2813f500 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fda1400d740 tx=0x7fda1400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:15.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.011+0000 7fda1f400640 1 -- 172.21.15.42:0/2767358100 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda14017070 con 0x7fda280b56d0 2024-09-17T01:34:15.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.012+0000 7fda1f400640 1 -- 172.21.15.42:0/2767358100 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda14009d20 con 0x7fda280b56d0 2024-09-17T01:34:15.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.012+0000 7fda2e200640 1 -- 172.21.15.42:0/2767358100 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda281f3ec0 con 0x7fda280b56d0 2024-09-17T01:34:15.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.012+0000 7fda1f400640 1 -- 172.21.15.42:0/2767358100 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda140106c0 con 0x7fda280b56d0 2024-09-17T01:34:15.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.012+0000 7fda2e200640 1 -- 172.21.15.42:0/2767358100 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda281f4480 con 0x7fda280b56d0 2024-09-17T01:34:15.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.014+0000 7fda1f400640 1 -- 172.21.15.42:0/2767358100 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fda1401a070 con 0x7fda280b56d0 2024-09-17T01:34:15.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.015+0000 7fda1f400640 1 --2- 172.21.15.42:0/2767358100 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fda08078bc0 0x7fda0807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.015+0000 7fda1f400640 1 -- 172.21.15.42:0/2767358100 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5825+0+0 (secure 0 0 0) 0x7fda1409ad90 con 0x7fda280b56d0 2024-09-17T01:34:15.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.016+0000 7fda35428740 1 Processor -- start 2024-09-17T01:34:15.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.016+0000 7fda27400640 1 --2- 172.21.15.42:0/2767358100 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fda08078bc0 0x7fda0807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.016+0000 7fda35428740 1 -- start start 2024-09-17T01:34:15.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.016+0000 7fda27400640 1 --2- 172.21.15.42:0/2767358100 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fda08078bc0 0x7fda0807b0d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fda18034000 tx=0x7fda18004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:15.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.017+0000 7fda35428740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596435464d0 0x5596439080e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.017+0000 7fda35428740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55964351d610 0x559643933c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.017+0000 7fda35428740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596435257f0 0x559643914cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.017+0000 7fda35428740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5596438607d0 con 0x5596435464d0 2024-09-17T01:34:15.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.017+0000 7fda35428740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55964384fc00 con 0x55964351d610 2024-09-17T01:34:15.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.017+0000 7fda35428740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x559643853a10 con 0x5596435257f0 2024-09-17T01:34:15.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.017+0000 7fda27400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596435464d0 0x5596439080e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.017+0000 7fda27400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596435464d0 0x5596439080e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60068/0 (socket says 172.21.15.42:60068) 2024-09-17T01:34:15.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.017+0000 7fda27400640 1 -- 172.21.15.42:0/3679078344 learned_addr learned my addr 172.21.15.42:0/3679078344 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:15.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.017+0000 7fda26a00640 1 --2- 172.21.15.42:0/3679078344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55964351d610 0x559643933c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.017+0000 7fda27e00640 1 --2- 172.21.15.42:0/3679078344 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596435257f0 0x559643914cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.018+0000 7fda27400640 1 -- 172.21.15.42:0/3679078344 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596435257f0 msgr2=0x559643914cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:15.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.018+0000 7fda27400640 1 --2- 172.21.15.42:0/3679078344 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596435257f0 0x559643914cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.018+0000 7fda27400640 1 -- 172.21.15.42:0/3679078344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55964351d610 msgr2=0x559643933c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:15.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.018+0000 7fda27400640 1 --2- 172.21.15.42:0/3679078344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55964351d610 0x559643933c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.018+0000 7fda27400640 1 -- 172.21.15.42:0/3679078344 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596437ddb50 con 0x5596435464d0 2024-09-17T01:34:15.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.018+0000 7fda26a00640 1 --2- 172.21.15.42:0/3679078344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55964351d610 0x559643933c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:34:15.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.018+0000 7fda27e00640 1 --2- 172.21.15.42:0/3679078344 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596435257f0 0x559643914cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:34:15.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.018+0000 7fda27400640 1 --2- 172.21.15.42:0/3679078344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596435464d0 0x5596439080e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fda18009920 tx=0x7fda1803e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0ced0499072568 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:15.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.018+0000 7fda13400640 1 -- 172.21.15.42:0/3679078344 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda18003b20 con 0x5596435464d0 2024-09-17T01:34:15.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.018+0000 7fda13400640 1 -- 172.21.15.42:0/3679078344 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda18003db0 con 0x5596435464d0 2024-09-17T01:34:15.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.018+0000 7fda13400640 1 -- 172.21.15.42:0/3679078344 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda18005280 con 0x5596435464d0 2024-09-17T01:34:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.019+0000 7fda35428740 1 -- 172.21.15.42:0/3679078344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596435464d0 msgr2=0x5596439080e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.019+0000 7fda35428740 1 --2- 172.21.15.42:0/3679078344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596435464d0 0x5596439080e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fda18009920 tx=0x7fda1803e040 comp rx=0 tx=0).stop 2024-09-17T01:34:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.019+0000 7fda35428740 1 -- 172.21.15.42:0/3679078344 shutdown_connections 2024-09-17T01:34:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.019+0000 7fda35428740 1 --2- 172.21.15.42:0/3679078344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55964351d610 0x559643933c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.019+0000 7fda35428740 1 --2- 172.21.15.42:0/3679078344 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596435257f0 0x559643914cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.019+0000 7fda35428740 1 --2- 172.21.15.42:0/3679078344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596435464d0 0x5596439080e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.019+0000 7fda35428740 1 -- 172.21.15.42:0/3679078344 >> 172.21.15.42:0/3679078344 conn(0x55964353a620 msgr2=0x5596438edfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.019+0000 7fda35428740 1 -- 172.21.15.42:0/3679078344 shutdown_connections 2024-09-17T01:34:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.019+0000 7fda35428740 1 -- 172.21.15.42:0/3679078344 wait complete. 2024-09-17T01:34:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.020+0000 7fda35428740 1 -- start start 2024-09-17T01:34:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.021+0000 7fda35428740 1 Processor -- start 2024-09-17T01:34:15.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.022+0000 7fda35428740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55964351d610 0x559643929bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.022+0000 7fda35428740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596435257f0 0x559643919970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.022+0000 7fda35428740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596435464d0 0x559643904db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.022+0000 7fda35428740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5596435c0880 con 0x55964351d610 2024-09-17T01:34:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.022+0000 7fda35428740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5596437f54b0 con 0x5596435257f0 2024-09-17T01:34:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.022+0000 7fda35428740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5596439061a0 con 0x5596435464d0 2024-09-17T01:34:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.022+0000 7fda35428740 10 client.0 _ll_register_callbacks cb 0x5596437fb680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:34:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.022+0000 7fda27400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55964351d610 0x559643929bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.022+0000 7fda27400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55964351d610 0x559643929bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60080/0 (socket says 172.21.15.42:60080) 2024-09-17T01:34:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.022+0000 7fda27400640 1 -- 172.21.15.42:0/402074980 learned_addr learned my addr 172.21.15.42:0/402074980 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.023+0000 7fda26a00640 1 --2- 172.21.15.42:0/402074980 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596435257f0 0x559643919970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.023+0000 7fda27e00640 1 --2- 172.21.15.42:0/402074980 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596435464d0 0x559643904db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.023+0000 7fda27400640 1 -- 172.21.15.42:0/402074980 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596435464d0 msgr2=0x559643904db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:15.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.023+0000 7fda27400640 1 --2- 172.21.15.42:0/402074980 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596435464d0 0x559643904db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.023+0000 7fda27400640 1 -- 172.21.15.42:0/402074980 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596435257f0 msgr2=0x559643919970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:15.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.023+0000 7fda27400640 1 --2- 172.21.15.42:0/402074980 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596435257f0 0x559643919970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.023+0000 7fda27400640 1 -- 172.21.15.42:0/402074980 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55964362a940 con 0x55964351d610 2024-09-17T01:34:15.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.023+0000 7fda27400640 1 --2- 172.21.15.42:0/402074980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55964351d610 0x559643929bd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fda18048040 tx=0x7fda180052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80be9c8141318fe4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:15.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.023+0000 7fda07e00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:34:15.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.023+0000 7fda07e00640 1 -- 172.21.15.42:0/402074980 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda180049a0 con 0x55964351d610 2024-09-17T01:34:15.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.023+0000 7fda07e00640 1 -- 172.21.15.42:0/402074980 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5825+0+0 (secure 0 0 0) 0x7fda1805bba0 con 0x55964351d610 2024-09-17T01:34:15.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.024+0000 7fda35428740 1 -- 172.21.15.42:0/402074980 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda18003db0 con 0x55964351d610 2024-09-17T01:34:15.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.024+0000 7fda07e00640 1 -- 172.21.15.42:0/402074980 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fda1805bda0 con 0x55964351d610 2024-09-17T01:34:15.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.024+0000 7fda35428740 10 client.5064 fetch_fsmap learned FSMap version 18 2024-09-17T01:34:15.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.024+0000 7fda35428740 1 -- 172.21.15.42:0/402074980 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55964368b0d0 con 0x55964351d610 2024-09-17T01:34:15.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.024+0000 7fda07e00640 1 -- 172.21.15.42:0/402074980 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda18003db0 con 0x55964351d610 2024-09-17T01:34:15.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.024+0000 7fda07e00640 1 -- 172.21.15.42:0/402074980 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7fda1804e030 con 0x55964351d610 2024-09-17T01:34:15.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.024+0000 7fda35428740 10 client.5064 fetch_fsmap finished waiting for FSMap version 18 2024-09-17T01:34:15.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.024+0000 7fda35428740 10 client.5064 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-17T01:34:15.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.024+0000 7fda35428740 20 client.5064 populate_metadata read hostname 'smithi042' 2024-09-17T01:34:15.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.024+0000 7fda35428740 1 --2- 172.21.15.42:0/402074980 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x5596435052b0 0x559643905590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.024+0000 7fda35428740 4 client.5064 mds_command: new command op to 4830 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:34:15.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.024+0000 7fda35428740 1 -- 172.21.15.42:0/402074980 --> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559643862720 con 0x5596435052b0 2024-09-17T01:34:15.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.025+0000 7fda26a00640 1 --2- 172.21.15.42:0/402074980 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x5596435052b0 0x559643905590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.025+0000 7fda26a00640 1 --2- 172.21.15.42:0/402074980 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x5596435052b0 0x559643905590 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=706afa4dbd03be75 server_cookie=3123953469a3b461 in_seq=0 out_seq=0 2024-09-17T01:34:15.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.025+0000 7fda07e00640 10 client.5064 ms_handle_connect on v2:172.21.15.42:6834/3278817895 2024-09-17T01:34:15.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.026+0000 7fda07e00640 1 -- 172.21.15.42:0/402074980 <== mds.0 v2:172.21.15.42:6834/3278817895 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559643862720 con 0x5596435052b0 2024-09-17T01:34:15.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.026+0000 7fda07e00640 10 client.5064 handle_command_reply: tid=0 2024-09-17T01:34:15.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.026+0000 7fda35428740 1 client.5064 shutdown 2024-09-17T01:34:15.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.026+0000 7fda35428740 1 -- 172.21.15.42:0/402074980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55964351d610 msgr2=0x559643929bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:15.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.026+0000 7fda35428740 1 --2- 172.21.15.42:0/402074980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55964351d610 0x559643929bd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fda18048040 tx=0x7fda180052d0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.026+0000 7fda35428740 1 -- 172.21.15.42:0/402074980 shutdown_connections 2024-09-17T01:34:15.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.026+0000 7fda35428740 1 --2- 172.21.15.42:0/402074980 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x5596435052b0 0x559643905590 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.026+0000 7fda35428740 1 --2- 172.21.15.42:0/402074980 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596435257f0 0x559643919970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.026+0000 7fda07e00640 0 client.5064 ms_handle_reset on v2:172.21.15.42:6834/3278817895 2024-09-17T01:34:15.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.026+0000 7fda35428740 1 --2- 172.21.15.42:0/402074980 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596435464d0 0x559643904db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.026+0000 7fda35428740 1 --2- 172.21.15.42:0/402074980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55964351d610 0x559643929bd0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.026+0000 7fda35428740 1 -- 172.21.15.42:0/402074980 >> 172.21.15.42:0/402074980 conn(0x55964353a620 msgr2=0x5596439080e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:15.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.026+0000 7fda35428740 1 -- 172.21.15.42:0/402074980 shutdown_connections 2024-09-17T01:34:15.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.026+0000 7fda35428740 1 -- 172.21.15.42:0/402074980 wait complete. 2024-09-17T01:34:15.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.026+0000 7fda35428740 20 client.5064 trim_cache size 0 max 16384 2024-09-17T01:34:15.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.045+0000 7fda35428740 1 Processor -- start 2024-09-17T01:34:15.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.045+0000 7fda35428740 1 -- start start 2024-09-17T01:34:15.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.046+0000 7fda35428740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55964351d610 0x55964391ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.046+0000 7fda35428740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596435257f0 0x55964392b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.047+0000 7fda35428740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596435464d0 0x559643919fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.047+0000 7fda35428740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55964390ff70 con 0x5596435257f0 2024-09-17T01:34:15.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.047+0000 7fda35428740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fda281fde60 con 0x55964351d610 2024-09-17T01:34:15.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.047+0000 7fda35428740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fda28073840 con 0x5596435464d0 2024-09-17T01:34:15.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.047+0000 7fda26a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596435257f0 0x55964392b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.047+0000 7fda26a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596435257f0 0x55964392b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60084/0 (socket says 172.21.15.42:60084) 2024-09-17T01:34:15.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.047+0000 7fda26a00640 1 -- 172.21.15.42:0/2643524519 learned_addr learned my addr 172.21.15.42:0/2643524519 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:15.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.047+0000 7fda27e00640 1 --2- 172.21.15.42:0/2643524519 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596435464d0 0x559643919fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.047+0000 7fda27400640 1 --2- 172.21.15.42:0/2643524519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55964351d610 0x55964391ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.047+0000 7fda26a00640 1 -- 172.21.15.42:0/2643524519 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596435464d0 msgr2=0x559643919fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:15.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.047+0000 7fda26a00640 1 --2- 172.21.15.42:0/2643524519 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596435464d0 0x559643919fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.047+0000 7fda26a00640 1 -- 172.21.15.42:0/2643524519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55964351d610 msgr2=0x55964391ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:15.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.047+0000 7fda26a00640 1 --2- 172.21.15.42:0/2643524519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55964351d610 0x55964391ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.047+0000 7fda26a00640 1 -- 172.21.15.42:0/2643524519 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55964358f7e0 con 0x5596435257f0 2024-09-17T01:34:15.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.048+0000 7fda26a00640 1 --2- 172.21.15.42:0/2643524519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596435257f0 0x55964392b870 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fda14009610 tx=0x7fda1407cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706a0b9b4299a901 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:15.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.048+0000 7fda12a00640 1 -- 172.21.15.42:0/2643524519 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda14021040 con 0x5596435257f0 2024-09-17T01:34:15.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.048+0000 7fda12a00640 1 -- 172.21.15.42:0/2643524519 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda1406c460 con 0x5596435257f0 2024-09-17T01:34:15.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.048+0000 7fda12a00640 1 -- 172.21.15.42:0/2643524519 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1400de50 con 0x5596435257f0 2024-09-17T01:34:15.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.048+0000 7fda35428740 1 -- 172.21.15.42:0/2643524519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596435257f0 msgr2=0x55964392b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:15.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.048+0000 7fda35428740 1 --2- 172.21.15.42:0/2643524519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596435257f0 0x55964392b870 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fda14009610 tx=0x7fda1407cf90 comp rx=0 tx=0).stop 2024-09-17T01:34:15.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.049+0000 7fda35428740 1 -- 172.21.15.42:0/2643524519 shutdown_connections 2024-09-17T01:34:15.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.049+0000 7fda35428740 1 --2- 172.21.15.42:0/2643524519 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596435464d0 0x559643919fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.049+0000 7fda35428740 1 --2- 172.21.15.42:0/2643524519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596435257f0 0x55964392b870 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.049+0000 7fda35428740 1 --2- 172.21.15.42:0/2643524519 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55964351d610 0x55964391ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.049+0000 7fda35428740 1 -- 172.21.15.42:0/2643524519 >> 172.21.15.42:0/2643524519 conn(0x55964353a620 msgr2=0x559643933a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:15.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.049+0000 7fda35428740 1 -- 172.21.15.42:0/2643524519 shutdown_connections 2024-09-17T01:34:15.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.049+0000 7fda35428740 1 -- 172.21.15.42:0/2643524519 wait complete. 2024-09-17T01:34:15.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.050+0000 7fda35428740 1 -- start start 2024-09-17T01:34:15.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.050+0000 7fda35428740 1 Processor -- start 2024-09-17T01:34:15.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.051+0000 7fda35428740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55964351d610 0x55964395abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.051+0000 7fda35428740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596435257f0 0x5596439b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.051+0000 7fda35428740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596435464d0 0x55964391a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.051+0000 7fda35428740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fda28142e80 con 0x55964351d610 2024-09-17T01:34:15.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.051+0000 7fda35428740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fda281e6da0 con 0x5596435464d0 2024-09-17T01:34:15.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.051+0000 7fda35428740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55964380f690 con 0x5596435257f0 2024-09-17T01:34:15.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.051+0000 7fda35428740 10 client.0 _ll_register_callbacks cb 0x7fda18004510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:34:15.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.052+0000 7fda27400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55964351d610 0x55964395abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.052+0000 7fda27400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55964351d610 0x55964395abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60094/0 (socket says 172.21.15.42:60094) 2024-09-17T01:34:15.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.052+0000 7fda27400640 1 -- 172.21.15.42:0/3002728884 learned_addr learned my addr 172.21.15.42:0/3002728884 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:15.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.052+0000 7fda26a00640 1 --2- 172.21.15.42:0/3002728884 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596435257f0 0x5596439b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.052+0000 7fda27e00640 1 --2- 172.21.15.42:0/3002728884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596435464d0 0x55964391a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.052+0000 7fda27400640 1 -- 172.21.15.42:0/3002728884 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596435257f0 msgr2=0x5596439b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:15.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.052+0000 7fda27400640 1 --2- 172.21.15.42:0/3002728884 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596435257f0 0x5596439b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.052+0000 7fda27400640 1 -- 172.21.15.42:0/3002728884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596435464d0 msgr2=0x55964391a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:15.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.052+0000 7fda27400640 1 --2- 172.21.15.42:0/3002728884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596435464d0 0x55964391a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.052+0000 7fda27400640 1 -- 172.21.15.42:0/3002728884 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55964381c6b0 con 0x55964351d610 2024-09-17T01:34:15.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.052+0000 7fda27400640 1 --2- 172.21.15.42:0/3002728884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55964351d610 0x55964395abb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fda18000c00 tx=0x7fda180037f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cd974ba9d98d4e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:15.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.052+0000 7fda07e00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:34:15.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.052+0000 7fda07e00640 1 -- 172.21.15.42:0/3002728884 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda18004270 con 0x55964351d610 2024-09-17T01:34:15.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.053+0000 7fda07e00640 1 -- 172.21.15.42:0/3002728884 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5825+0+0 (secure 0 0 0) 0x7fda18004bd0 con 0x55964351d610 2024-09-17T01:34:15.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.053+0000 7fda35428740 1 -- 172.21.15.42:0/3002728884 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda1406c460 con 0x55964351d610 2024-09-17T01:34:15.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.053+0000 7fda07e00640 1 -- 172.21.15.42:0/3002728884 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fda1805a680 con 0x55964351d610 2024-09-17T01:34:15.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.053+0000 7fda35428740 10 client.5070 fetch_fsmap learned FSMap version 18 2024-09-17T01:34:15.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.053+0000 7fda35428740 1 -- 172.21.15.42:0/3002728884 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5596439b6eb0 con 0x55964351d610 2024-09-17T01:34:15.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.053+0000 7fda07e00640 1 -- 172.21.15.42:0/3002728884 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda1406c460 con 0x55964351d610 2024-09-17T01:34:15.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.053+0000 7fda07e00640 1 -- 172.21.15.42:0/3002728884 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7fda1804e070 con 0x55964351d610 2024-09-17T01:34:15.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.053+0000 7fda35428740 10 client.5070 fetch_fsmap finished waiting for FSMap version 18 2024-09-17T01:34:15.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.053+0000 7fda35428740 10 client.5070 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-17T01:34:15.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.053+0000 7fda35428740 20 client.5070 populate_metadata read hostname 'smithi042' 2024-09-17T01:34:15.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.053+0000 7fda35428740 1 --2- 172.21.15.42:0/3002728884 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x559643928110 0x559643928520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.053+0000 7fda35428740 4 client.5070 mds_command: new command op to 4830 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}] 2024-09-17T01:34:15.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.053+0000 7fda35428740 1 -- 172.21.15.42:0/3002728884 --> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}) -- 0x55964385e1d0 con 0x559643928110 2024-09-17T01:34:15.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.054+0000 7fda26a00640 1 --2- 172.21.15.42:0/3002728884 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x559643928110 0x559643928520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.054+0000 7fda26a00640 1 --2- 172.21.15.42:0/3002728884 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x559643928110 0x559643928520 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9149d825c8f64d8f server_cookie=edc91f75273fbcdd in_seq=0 out_seq=0 2024-09-17T01:34:15.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.054+0000 7fda07e00640 10 client.5070 ms_handle_connect on v2:172.21.15.42:6834/3278817895 2024-09-17T01:34:15.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.060+0000 7fda07e00640 1 -- 172.21.15.42:0/3002728884 <== mds.0 v2:172.21.15.42:6834/3278817895 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55964385e1d0 con 0x559643928110 2024-09-17T01:34:15.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.060+0000 7fda07e00640 10 client.5070 handle_command_reply: tid=0 2024-09-17T01:34:15.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.060+0000 7fda35428740 1 client.5070 shutdown 2024-09-17T01:34:15.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.061+0000 7fda35428740 1 -- 172.21.15.42:0/3002728884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55964351d610 msgr2=0x55964395abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:15.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.061+0000 7fda35428740 1 --2- 172.21.15.42:0/3002728884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55964351d610 0x55964395abb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fda18000c00 tx=0x7fda180037f0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.061+0000 7fda35428740 1 -- 172.21.15.42:0/3002728884 shutdown_connections 2024-09-17T01:34:15.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.061+0000 7fda35428740 1 --2- 172.21.15.42:0/3002728884 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x559643928110 0x559643928520 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.061+0000 7fda35428740 1 --2- 172.21.15.42:0/3002728884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596435464d0 0x55964391a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.061+0000 7fda35428740 1 --2- 172.21.15.42:0/3002728884 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596435257f0 0x5596439b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.061+0000 7fda35428740 1 --2- 172.21.15.42:0/3002728884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55964351d610 0x55964395abb0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.061+0000 7fda07e00640 0 client.5070 ms_handle_reset on v2:172.21.15.42:6834/3278817895 2024-09-17T01:34:15.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.061+0000 7fda35428740 1 -- 172.21.15.42:0/3002728884 >> 172.21.15.42:0/3002728884 conn(0x55964353a620 msgr2=0x5596438edf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:15.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.061+0000 7fda35428740 1 -- 172.21.15.42:0/3002728884 shutdown_connections 2024-09-17T01:34:15.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.061+0000 7fda35428740 1 -- 172.21.15.42:0/3002728884 wait complete. 2024-09-17T01:34:15.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.061+0000 7fda35428740 20 client.5070 trim_cache size 0 max 16384 2024-09-17T01:34:15.060 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:34:15.060 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-17T01:34:15.060 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "ddae4f68-6c4d-4449-b792-511937baea49", 2024-09-17T01:34:15.060 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-17T01:34:15.061 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:34:15.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.062+0000 7fda2e200640 1 -- 172.21.15.42:0/2767358100 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fda08078bc0 msgr2=0x7fda0807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:15.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.062+0000 7fda2e200640 1 --2- 172.21.15.42:0/2767358100 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fda08078bc0 0x7fda0807b0d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fda18034000 tx=0x7fda18004730 comp rx=0 tx=0).stop 2024-09-17T01:34:15.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.062+0000 7fda2e200640 1 -- 172.21.15.42:0/2767358100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda280b56d0 msgr2=0x7fda2813f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:15.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.062+0000 7fda2e200640 1 --2- 172.21.15.42:0/2767358100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda280b56d0 0x7fda2813f500 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fda1400d740 tx=0x7fda1400dc00 comp rx=0 tx=0).stop 2024-09-17T01:34:15.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.062+0000 7fda2e200640 1 -- 172.21.15.42:0/2767358100 shutdown_connections 2024-09-17T01:34:15.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.062+0000 7fda2e200640 1 --2- 172.21.15.42:0/2767358100 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fda08078bc0 0x7fda0807b0d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.062+0000 7fda2e200640 1 --2- 172.21.15.42:0/2767358100 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fda280cdb20 0x7fda281f73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.062+0000 7fda2e200640 1 --2- 172.21.15.42:0/2767358100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda280b56d0 0x7fda2813f500 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.062+0000 7fda2e200640 1 --2- 172.21.15.42:0/2767358100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda2806d430 0x7fda281f35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.062+0000 7fda2e200640 1 -- 172.21.15.42:0/2767358100 >> 172.21.15.42:0/2767358100 conn(0x7fda280b28f0 msgr2=0x7fda2815e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:15.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.062+0000 7fda2e200640 1 -- 172.21.15.42:0/2767358100 shutdown_connections 2024-09-17T01:34:15.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.062+0000 7fda2e200640 1 -- 172.21.15.42:0/2767358100 wait complete. 2024-09-17T01:34:15.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:34:15.083 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-17T01:34:15.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.344+0000 7f2f87200640 1 -- 172.21.15.42:0/2141466045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f8815ede0 msgr2=0x7f2f8815f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:15.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.344+0000 7f2f87200640 1 --2- 172.21.15.42:0/2141466045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f8815ede0 0x7f2f8815f1f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2f880b71c0 tx=0x7f2f8002a980 comp rx=0 tx=0).stop 2024-09-17T01:34:15.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.344+0000 7f2f87200640 1 -- 172.21.15.42:0/2141466045 shutdown_connections 2024-09-17T01:34:15.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.344+0000 7f2f87200640 1 --2- 172.21.15.42:0/2141466045 >> v2:172.21.15.43:3300/0 conn(0x7f2f880d0d20 0x7f2f880d1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.344+0000 7f2f87200640 1 --2- 172.21.15.42:0/2141466045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f8815ede0 0x7f2f8815f1f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.344+0000 7f2f87200640 1 --2- 172.21.15.42:0/2141466045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f880d3e40 0x7f2f880cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.344+0000 7f2f87200640 1 -- 172.21.15.42:0/2141466045 >> 172.21.15.42:0/2141466045 conn(0x7f2f8806cd20 msgr2=0x7f2f8806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:15.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.344+0000 7f2f87200640 1 -- 172.21.15.42:0/2141466045 shutdown_connections 2024-09-17T01:34:15.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.344+0000 7f2f87200640 1 -- 172.21.15.42:0/2141466045 wait complete. 2024-09-17T01:34:15.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.347+0000 7f2f87200640 1 Processor -- start 2024-09-17T01:34:15.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.347+0000 7f2f87200640 1 -- start start 2024-09-17T01:34:15.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.349+0000 7f2f87200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f880d0d20 0x7f2f88153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.349+0000 7f2f87200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f880d3e40 0x7f2f8814b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.349+0000 7f2f85e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f880d0d20 0x7f2f88153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.349+0000 7f2f85e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f880d0d20 0x7f2f88153d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:51098/0 (socket says 172.21.15.42:51098) 2024-09-17T01:34:15.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.349+0000 7f2f87200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f8815ede0 0x7f2f881f8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.349+0000 7f2f87200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2f880d2a30 con 0x7f2f880d3e40 2024-09-17T01:34:15.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.349+0000 7f2f87200640 1 -- 172.21.15.42:0/694655155 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2f880d28b0 con 0x7f2f880d0d20 2024-09-17T01:34:15.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.349+0000 7f2f85e00640 1 -- 172.21.15.42:0/694655155 learned_addr learned my addr 172.21.15.42:0/694655155 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:15.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.349+0000 7f2f85400640 1 --2- 172.21.15.42:0/694655155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f880d3e40 0x7f2f8814b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.349+0000 7f2f87200640 1 -- 172.21.15.42:0/694655155 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2f880d2bb0 con 0x7f2f8815ede0 2024-09-17T01:34:15.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.350+0000 7f2f86800640 1 --2- 172.21.15.42:0/694655155 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f8815ede0 0x7f2f881f8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.350+0000 7f2f85400640 1 -- 172.21.15.42:0/694655155 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f8815ede0 msgr2=0x7f2f881f8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:15.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.350+0000 7f2f85400640 1 --2- 172.21.15.42:0/694655155 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f8815ede0 0x7f2f881f8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.350+0000 7f2f85400640 1 -- 172.21.15.42:0/694655155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f880d0d20 msgr2=0x7f2f88153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:15.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.350+0000 7f2f85400640 1 --2- 172.21.15.42:0/694655155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f880d0d20 0x7f2f88153d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.350+0000 7f2f85400640 1 -- 172.21.15.42:0/694655155 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f8815e5a0 con 0x7f2f880d3e40 2024-09-17T01:34:15.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.350+0000 7f2f85e00640 1 --2- 172.21.15.42:0/694655155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f880d0d20 0x7f2f88153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:34:15.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.350+0000 7f2f85400640 1 --2- 172.21.15.42:0/694655155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f880d3e40 0x7f2f8814b820 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400e680 tx=0x7f2f7400eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:15.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.351+0000 7f2f7e000640 1 -- 172.21.15.42:0/694655155 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7400cab0 con 0x7f2f880d3e40 2024-09-17T01:34:15.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.351+0000 7f2f7e000640 1 -- 172.21.15.42:0/694655155 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f7400cd40 con 0x7f2f880d3e40 2024-09-17T01:34:15.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.351+0000 7f2f87200640 1 -- 172.21.15.42:0/694655155 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f8815e880 con 0x7f2f880d3e40 2024-09-17T01:34:15.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.351+0000 7f2f7e000640 1 -- 172.21.15.42:0/694655155 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f74010690 con 0x7f2f880d3e40 2024-09-17T01:34:15.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.351+0000 7f2f87200640 1 -- 172.21.15.42:0/694655155 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f8814bd60 con 0x7f2f880d3e40 2024-09-17T01:34:15.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.354+0000 7f2f7e000640 1 -- 172.21.15.42:0/694655155 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2f74010830 con 0x7f2f880d3e40 2024-09-17T01:34:15.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.355+0000 7f2f7e000640 1 --2- 172.21.15.42:0/694655155 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f68078b90 0x7f2f6807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.355+0000 7f2f7e000640 1 -- 172.21.15.42:0/694655155 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5825+0+0 (secure 0 0 0) 0x7f2f7409b610 con 0x7f2f880d3e40 2024-09-17T01:34:15.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.355+0000 7f2f939d2740 1 Processor -- start 2024-09-17T01:34:15.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.356+0000 7f2f939d2740 1 -- start start 2024-09-17T01:34:15.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.356+0000 7f2f85e00640 1 --2- 172.21.15.42:0/694655155 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f68078b90 0x7f2f6807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.357+0000 7f2f85e00640 1 --2- 172.21.15.42:0/694655155 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f68078b90 0x7f2f6807b0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2f78009fd0 tx=0x7f2f78005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:15.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.357+0000 7f2f939d2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fbc0b9390 0x564fbc4a7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.357+0000 7f2f939d2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0904d0 0x564fbc48a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.357+0000 7f2f939d2740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564fbc0986b0 0x564fbc48a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.357+0000 7f2f939d2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564fbc3c01c0 con 0x564fbc0904d0 2024-09-17T01:34:15.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.357+0000 7f2f939d2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564fbc3d3870 con 0x564fbc0b9390 2024-09-17T01:34:15.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.357+0000 7f2f939d2740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x564fbc3c2ca0 con 0x564fbc0986b0 2024-09-17T01:34:15.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.358+0000 7f2f85400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0904d0 0x564fbc48a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.358+0000 7f2f85400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0904d0 0x564fbc48a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60126/0 (socket says 172.21.15.42:60126) 2024-09-17T01:34:15.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.358+0000 7f2f85400640 1 -- 172.21.15.42:0/2765604093 learned_addr learned my addr 172.21.15.42:0/2765604093 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:15.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.358+0000 7f2f85e00640 1 --2- 172.21.15.42:0/2765604093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fbc0b9390 0x564fbc4a7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.358+0000 7f2f86800640 1 --2- 172.21.15.42:0/2765604093 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564fbc0986b0 0x564fbc48a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.358+0000 7f2f85400640 1 -- 172.21.15.42:0/2765604093 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564fbc0986b0 msgr2=0x564fbc48a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:15.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.358+0000 7f2f85400640 1 --2- 172.21.15.42:0/2765604093 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564fbc0986b0 0x564fbc48a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.358+0000 7f2f85400640 1 -- 172.21.15.42:0/2765604093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fbc0b9390 msgr2=0x564fbc4a7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:15.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.358+0000 7f2f85400640 1 --2- 172.21.15.42:0/2765604093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fbc0b9390 0x564fbc4a7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.358+0000 7f2f85400640 1 -- 172.21.15.42:0/2765604093 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fbc19b7d0 con 0x564fbc0904d0 2024-09-17T01:34:15.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.358+0000 7f2f86800640 1 --2- 172.21.15.42:0/2765604093 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564fbc0986b0 0x564fbc48a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:34:15.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.359+0000 7f2f85400640 1 --2- 172.21.15.42:0/2765604093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0904d0 0x564fbc48a400 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2f74063070 tx=0x7f2f74062d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a889d2753e8b6ee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:15.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.359+0000 7f2f72600640 1 -- 172.21.15.42:0/2765604093 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f74063370 con 0x564fbc0904d0 2024-09-17T01:34:15.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.359+0000 7f2f72600640 1 -- 172.21.15.42:0/2765604093 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f74067da0 con 0x564fbc0904d0 2024-09-17T01:34:15.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.359+0000 7f2f72600640 1 -- 172.21.15.42:0/2765604093 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7406a2f0 con 0x564fbc0904d0 2024-09-17T01:34:15.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.360+0000 7f2f939d2740 1 -- 172.21.15.42:0/2765604093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0904d0 msgr2=0x564fbc48a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:15.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.360+0000 7f2f939d2740 1 --2- 172.21.15.42:0/2765604093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0904d0 0x564fbc48a400 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2f74063070 tx=0x7f2f74062d40 comp rx=0 tx=0).stop 2024-09-17T01:34:15.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.360+0000 7f2f939d2740 1 -- 172.21.15.42:0/2765604093 shutdown_connections 2024-09-17T01:34:15.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.360+0000 7f2f939d2740 1 --2- 172.21.15.42:0/2765604093 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564fbc0986b0 0x564fbc48a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.360+0000 7f2f939d2740 1 --2- 172.21.15.42:0/2765604093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0904d0 0x564fbc48a400 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.360+0000 7f2f939d2740 1 --2- 172.21.15.42:0/2765604093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fbc0b9390 0x564fbc4a7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.360+0000 7f2f939d2740 1 -- 172.21.15.42:0/2765604093 >> 172.21.15.42:0/2765604093 conn(0x564fbc0ad4e0 msgr2=0x564fbc460620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:15.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.360+0000 7f2f939d2740 1 -- 172.21.15.42:0/2765604093 shutdown_connections 2024-09-17T01:34:15.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.360+0000 7f2f939d2740 1 -- 172.21.15.42:0/2765604093 wait complete. 2024-09-17T01:34:15.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.361+0000 7f2f939d2740 1 -- start start 2024-09-17T01:34:15.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.362+0000 7f2f939d2740 1 Processor -- start 2024-09-17T01:34:15.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.363+0000 7f2f939d2740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564fbc0904d0 0x564fbc4876e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.363+0000 7f2f939d2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fbc0986b0 0x564fbc4b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.363+0000 7f2f939d2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0b9390 0x564fbc486030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.363+0000 7f2f939d2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564fbc369410 con 0x564fbc0b9390 2024-09-17T01:34:15.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.363+0000 7f2f939d2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564fbc3c6ab0 con 0x564fbc0986b0 2024-09-17T01:34:15.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.363+0000 7f2f939d2740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x564fbc133740 con 0x564fbc0904d0 2024-09-17T01:34:15.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.363+0000 7f2f939d2740 10 client.0 _ll_register_callbacks cb 0x564fbc346360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:34:15.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.364+0000 7f2f86800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0b9390 0x564fbc486030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.364+0000 7f2f86800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0b9390 0x564fbc486030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60140/0 (socket says 172.21.15.42:60140) 2024-09-17T01:34:15.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.364+0000 7f2f86800640 1 -- 172.21.15.42:0/3196210878 learned_addr learned my addr 172.21.15.42:0/3196210878 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:15.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.364+0000 7f2f85400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fbc0986b0 0x564fbc4b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.364+0000 7f2f85e00640 1 --2- 172.21.15.42:0/3196210878 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564fbc0904d0 0x564fbc4876e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.364+0000 7f2f85400640 1 -- 172.21.15.42:0/3196210878 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564fbc0904d0 msgr2=0x564fbc4876e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:15.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.364+0000 7f2f85400640 1 --2- 172.21.15.42:0/3196210878 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564fbc0904d0 0x564fbc4876e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.364+0000 7f2f85400640 1 -- 172.21.15.42:0/3196210878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0b9390 msgr2=0x564fbc486030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:15.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.364+0000 7f2f85400640 1 --2- 172.21.15.42:0/3196210878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0b9390 0x564fbc486030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.364+0000 7f2f85400640 1 -- 172.21.15.42:0/3196210878 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fbc124970 con 0x564fbc0986b0 2024-09-17T01:34:15.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.364+0000 7f2f85e00640 1 --2- 172.21.15.42:0/3196210878 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564fbc0904d0 0x564fbc4876e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:34:15.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.364+0000 7f2f86800640 1 --2- 172.21.15.42:0/3196210878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0b9390 0x564fbc486030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:34:15.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.365+0000 7f2f85400640 1 --2- 172.21.15.42:0/3196210878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fbc0986b0 0x564fbc4b5070 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2f74086000 tx=0x7f2f7406a2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afcc422d56eb2b2b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:15.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.365+0000 7f2f66a00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-17T01:34:15.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.365+0000 7f2f66a00640 1 -- 172.21.15.42:0/3196210878 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f74063370 con 0x564fbc0986b0 2024-09-17T01:34:15.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.365+0000 7f2f66a00640 1 -- 172.21.15.42:0/3196210878 <== mon.1 v2:172.21.15.43:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5825+0+0 (secure 0 0 0) 0x7f2f74010b20 con 0x564fbc0986b0 2024-09-17T01:34:15.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.365+0000 7f2f939d2740 1 -- 172.21.15.42:0/3196210878 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f74067da0 con 0x564fbc0986b0 2024-09-17T01:34:15.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.365+0000 7f2f66a00640 1 -- 172.21.15.42:0/3196210878 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f2f74010d20 con 0x564fbc0986b0 2024-09-17T01:34:15.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.365+0000 7f2f939d2740 10 client.5038 fetch_fsmap learned FSMap version 18 2024-09-17T01:34:15.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.365+0000 7f2f939d2740 1 -- 172.21.15.42:0/3196210878 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x564fbc1026a0 con 0x564fbc0986b0 2024-09-17T01:34:15.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.365+0000 7f2f66a00640 1 -- 172.21.15.42:0/3196210878 <== mon.1 v2:172.21.15.43:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f74067da0 con 0x564fbc0986b0 2024-09-17T01:34:15.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.365+0000 7f2f66a00640 1 -- 172.21.15.42:0/3196210878 <== mon.1 v2:172.21.15.43:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f2f7409b0c0 con 0x564fbc0986b0 2024-09-17T01:34:15.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.366+0000 7f2f939d2740 10 client.5038 fetch_fsmap finished waiting for FSMap version 18 2024-09-17T01:34:15.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.366+0000 7f2f939d2740 10 client.5038 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-17T01:34:15.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.366+0000 7f2f939d2740 20 client.5038 populate_metadata read hostname 'smithi042' 2024-09-17T01:34:15.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.366+0000 7f2f939d2740 1 --2- 172.21.15.42:0/3196210878 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x564fbc077f60 0x564fbc482c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.366+0000 7f2f939d2740 4 client.5038 mds_command: new command op to 4830 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:34:15.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.366+0000 7f2f939d2740 1 -- 172.21.15.42:0/3196210878 --> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fbc3d57c0 con 0x564fbc077f60 2024-09-17T01:34:15.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.366+0000 7f2f85e00640 1 --2- 172.21.15.42:0/3196210878 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x564fbc077f60 0x564fbc482c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.367+0000 7f2f66a00640 10 client.5038 ms_handle_connect on v2:172.21.15.42:6834/3278817895 2024-09-17T01:34:15.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.367+0000 7f2f85e00640 1 --2- 172.21.15.42:0/3196210878 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x564fbc077f60 0x564fbc482c00 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77a82e302641ee81 server_cookie=14df8b176ccb925b in_seq=0 out_seq=0 2024-09-17T01:34:15.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.369+0000 7f2f66a00640 1 -- 172.21.15.42:0/3196210878 <== mds.0 v2:172.21.15.42:6834/3278817895 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564fbc3d57c0 con 0x564fbc077f60 2024-09-17T01:34:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.369+0000 7f2f66a00640 10 client.5038 handle_command_reply: tid=0 2024-09-17T01:34:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.369+0000 7f2f939d2740 1 client.5038 shutdown 2024-09-17T01:34:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.369+0000 7f2f939d2740 1 -- 172.21.15.42:0/3196210878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fbc0986b0 msgr2=0x564fbc4b5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.369+0000 7f2f939d2740 1 --2- 172.21.15.42:0/3196210878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fbc0986b0 0x564fbc4b5070 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2f74086000 tx=0x7f2f7406a2e0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.369+0000 7f2f939d2740 1 -- 172.21.15.42:0/3196210878 shutdown_connections 2024-09-17T01:34:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.369+0000 7f2f939d2740 1 --2- 172.21.15.42:0/3196210878 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x564fbc077f60 0x564fbc482c00 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.369+0000 7f2f939d2740 1 --2- 172.21.15.42:0/3196210878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fbc0986b0 0x564fbc4b5070 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.369+0000 7f2f939d2740 1 --2- 172.21.15.42:0/3196210878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0b9390 0x564fbc486030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.369+0000 7f2f939d2740 1 --2- 172.21.15.42:0/3196210878 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564fbc0904d0 0x564fbc4876e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.369+0000 7f2f66a00640 0 client.5038 ms_handle_reset on v2:172.21.15.42:6834/3278817895 2024-09-17T01:34:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.369+0000 7f2f939d2740 1 -- 172.21.15.42:0/3196210878 >> 172.21.15.42:0/3196210878 conn(0x564fbc0ad4e0 msgr2=0x564fbc4a8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:15.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.369+0000 7f2f939d2740 1 -- 172.21.15.42:0/3196210878 shutdown_connections 2024-09-17T01:34:15.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.370+0000 7f2f939d2740 1 -- 172.21.15.42:0/3196210878 wait complete. 2024-09-17T01:34:15.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.370+0000 7f2f939d2740 20 client.5038 trim_cache size 0 max 16384 2024-09-17T01:34:15.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.393+0000 7f2f939d2740 1 Processor -- start 2024-09-17T01:34:15.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.393+0000 7f2f939d2740 1 -- start start 2024-09-17T01:34:15.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.394+0000 7f2f939d2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fbc0904d0 0x564fbc4a5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.394+0000 7f2f939d2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0986b0 0x564fbc4819c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.394+0000 7f2f939d2740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564fbc0b9390 0x564fbc481f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.394+0000 7f2f939d2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2f882021f0 con 0x564fbc0986b0 2024-09-17T01:34:15.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.394+0000 7f2f939d2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2f882012a0 con 0x564fbc0904d0 2024-09-17T01:34:15.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.394+0000 7f2f939d2740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2f8815a5d0 con 0x564fbc0b9390 2024-09-17T01:34:15.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.395+0000 7f2f85400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0986b0 0x564fbc4819c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.395+0000 7f2f85400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0986b0 0x564fbc4819c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60142/0 (socket says 172.21.15.42:60142) 2024-09-17T01:34:15.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.395+0000 7f2f85400640 1 -- 172.21.15.42:0/2688732747 learned_addr learned my addr 172.21.15.42:0/2688732747 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:15.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.395+0000 7f2f85e00640 1 --2- 172.21.15.42:0/2688732747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fbc0904d0 0x564fbc4a5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.395+0000 7f2f86800640 1 --2- 172.21.15.42:0/2688732747 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564fbc0b9390 0x564fbc481f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.395+0000 7f2f85400640 1 -- 172.21.15.42:0/2688732747 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564fbc0b9390 msgr2=0x564fbc481f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:15.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.395+0000 7f2f85400640 1 --2- 172.21.15.42:0/2688732747 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564fbc0b9390 0x564fbc481f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.395+0000 7f2f85400640 1 -- 172.21.15.42:0/2688732747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fbc0904d0 msgr2=0x564fbc4a5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:15.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.395+0000 7f2f85400640 1 --2- 172.21.15.42:0/2688732747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fbc0904d0 0x564fbc4a5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.395+0000 7f2f85400640 1 -- 172.21.15.42:0/2688732747 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fbc49e940 con 0x564fbc0986b0 2024-09-17T01:34:15.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.395+0000 7f2f85400640 1 --2- 172.21.15.42:0/2688732747 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0986b0 0x564fbc4819c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2f74063020 tx=0x7f2f7400efa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99cb839b995684a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:15.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.396+0000 7f2f71c00640 1 -- 172.21.15.42:0/2688732747 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f74062ae0 con 0x564fbc0986b0 2024-09-17T01:34:15.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.396+0000 7f2f71c00640 1 -- 172.21.15.42:0/2688732747 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f74067da0 con 0x564fbc0986b0 2024-09-17T01:34:15.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.396+0000 7f2f71c00640 1 -- 172.21.15.42:0/2688732747 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7409b0c0 con 0x564fbc0986b0 2024-09-17T01:34:15.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.397+0000 7f2f939d2740 1 -- 172.21.15.42:0/2688732747 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0986b0 msgr2=0x564fbc4819c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:15.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.397+0000 7f2f939d2740 1 --2- 172.21.15.42:0/2688732747 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0986b0 0x564fbc4819c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2f74063020 tx=0x7f2f7400efa0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.397+0000 7f2f939d2740 1 -- 172.21.15.42:0/2688732747 shutdown_connections 2024-09-17T01:34:15.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.397+0000 7f2f939d2740 1 --2- 172.21.15.42:0/2688732747 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564fbc0b9390 0x564fbc481f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.397+0000 7f2f939d2740 1 --2- 172.21.15.42:0/2688732747 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0986b0 0x564fbc4819c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.397+0000 7f2f939d2740 1 --2- 172.21.15.42:0/2688732747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fbc0904d0 0x564fbc4a5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.397+0000 7f2f939d2740 1 -- 172.21.15.42:0/2688732747 >> 172.21.15.42:0/2688732747 conn(0x564fbc0ad4e0 msgr2=0x564fbc4a8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:15.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.397+0000 7f2f939d2740 1 -- 172.21.15.42:0/2688732747 shutdown_connections 2024-09-17T01:34:15.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.397+0000 7f2f939d2740 1 -- 172.21.15.42:0/2688732747 wait complete. 2024-09-17T01:34:15.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.398+0000 7f2f939d2740 1 -- start start 2024-09-17T01:34:15.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.398+0000 7f2f939d2740 1 Processor -- start 2024-09-17T01:34:15.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.400+0000 7f2f939d2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fbc0904d0 0x564fbc523180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.400+0000 7f2f939d2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0986b0 0x564fbc4819c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.400+0000 7f2f939d2740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564fbc0b9390 0x564fbc481f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.400+0000 7f2f939d2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2f88200ea0 con 0x564fbc0986b0 2024-09-17T01:34:15.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.400+0000 7f2f939d2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564fbc45d2b0 con 0x564fbc0904d0 2024-09-17T01:34:15.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.400+0000 7f2f939d2740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x564fbc4c7760 con 0x564fbc0b9390 2024-09-17T01:34:15.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.400+0000 7f2f939d2740 10 client.0 _ll_register_callbacks cb 0x7f2f740631d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:34:15.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.400+0000 7f2f85400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0986b0 0x564fbc4819c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.400+0000 7f2f85400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0986b0 0x564fbc4819c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60152/0 (socket says 172.21.15.42:60152) 2024-09-17T01:34:15.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.400+0000 7f2f85400640 1 -- 172.21.15.42:0/652909137 learned_addr learned my addr 172.21.15.42:0/652909137 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:15.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.400+0000 7f2f86800640 1 --2- 172.21.15.42:0/652909137 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564fbc0b9390 0x564fbc481f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.400+0000 7f2f85e00640 1 --2- 172.21.15.42:0/652909137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fbc0904d0 0x564fbc523180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.401+0000 7f2f85400640 1 -- 172.21.15.42:0/652909137 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564fbc0b9390 msgr2=0x564fbc481f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:15.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.401+0000 7f2f85400640 1 --2- 172.21.15.42:0/652909137 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564fbc0b9390 0x564fbc481f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.401+0000 7f2f85400640 1 -- 172.21.15.42:0/652909137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fbc0904d0 msgr2=0x564fbc523180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:15.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.401+0000 7f2f85400640 1 --2- 172.21.15.42:0/652909137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fbc0904d0 0x564fbc523180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.401+0000 7f2f85400640 1 -- 172.21.15.42:0/652909137 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fbc460e90 con 0x564fbc0986b0 2024-09-17T01:34:15.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.401+0000 7f2f85400640 1 --2- 172.21.15.42:0/652909137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0986b0 0x564fbc4819c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2f74000c00 tx=0x7f2f7401a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e8ac951994db7e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:15.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.401+0000 7f2f66a00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:34:15.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.401+0000 7f2f66a00640 1 -- 172.21.15.42:0/652909137 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f74062ae0 con 0x564fbc0986b0 2024-09-17T01:34:15.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.401+0000 7f2f66a00640 1 -- 172.21.15.42:0/652909137 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5825+0+0 (secure 0 0 0) 0x7f2f7405ef70 con 0x564fbc0986b0 2024-09-17T01:34:15.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.401+0000 7f2f939d2740 1 -- 172.21.15.42:0/652909137 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f74067da0 con 0x564fbc0986b0 2024-09-17T01:34:15.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.401+0000 7f2f66a00640 1 -- 172.21.15.42:0/652909137 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f2f74062040 con 0x564fbc0986b0 2024-09-17T01:34:15.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.402+0000 7f2f939d2740 10 client.5088 fetch_fsmap learned FSMap version 18 2024-09-17T01:34:15.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.402+0000 7f2f939d2740 1 -- 172.21.15.42:0/652909137 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x564fbc460e90 con 0x564fbc0986b0 2024-09-17T01:34:15.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.402+0000 7f2f66a00640 1 -- 172.21.15.42:0/652909137 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f74067da0 con 0x564fbc0986b0 2024-09-17T01:34:15.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.402+0000 7f2f66a00640 1 -- 172.21.15.42:0/652909137 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f2f740621e0 con 0x564fbc0986b0 2024-09-17T01:34:15.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.402+0000 7f2f939d2740 10 client.5088 fetch_fsmap finished waiting for FSMap version 18 2024-09-17T01:34:15.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.402+0000 7f2f939d2740 10 client.5088 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-17T01:34:15.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.402+0000 7f2f939d2740 20 client.5088 populate_metadata read hostname 'smithi042' 2024-09-17T01:34:15.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.402+0000 7f2f939d2740 1 --2- 172.21.15.42:0/652909137 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x564fbc4c8b00 0x564fbc4850b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:15.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.402+0000 7f2f939d2740 4 client.5088 mds_command: new command op to 4830 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:34:15.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.402+0000 7f2f939d2740 1 -- 172.21.15.42:0/652909137 --> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564fbc3d1270 con 0x564fbc4c8b00 2024-09-17T01:34:15.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.402+0000 7f2f85e00640 1 --2- 172.21.15.42:0/652909137 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x564fbc4c8b00 0x564fbc4850b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:15.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.403+0000 7f2f85e00640 1 --2- 172.21.15.42:0/652909137 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x564fbc4c8b00 0x564fbc4850b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff30c8d23ae19c3f server_cookie=60dea36fedfef856 in_seq=0 out_seq=0 2024-09-17T01:34:15.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.403+0000 7f2f66a00640 10 client.5088 ms_handle_connect on v2:172.21.15.42:6834/3278817895 2024-09-17T01:34:15.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.405+0000 7f2f66a00640 1 -- 172.21.15.42:0/652909137 <== mds.0 v2:172.21.15.42:6834/3278817895 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x564fbc3d1270 con 0x564fbc4c8b00 2024-09-17T01:34:15.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.405+0000 7f2f66a00640 10 client.5088 handle_command_reply: tid=0 2024-09-17T01:34:15.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.405+0000 7f2f939d2740 1 client.5088 shutdown 2024-09-17T01:34:15.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.405+0000 7f2f939d2740 1 -- 172.21.15.42:0/652909137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0986b0 msgr2=0x564fbc4819c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:15.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.405+0000 7f2f939d2740 1 --2- 172.21.15.42:0/652909137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0986b0 0x564fbc4819c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2f74000c00 tx=0x7f2f7401a040 comp rx=0 tx=0).stop 2024-09-17T01:34:15.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.405+0000 7f2f939d2740 1 -- 172.21.15.42:0/652909137 shutdown_connections 2024-09-17T01:34:15.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.405+0000 7f2f939d2740 1 --2- 172.21.15.42:0/652909137 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564fbc0b9390 0x564fbc481f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.405+0000 7f2f939d2740 1 --2- 172.21.15.42:0/652909137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564fbc0986b0 0x564fbc4819c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.405+0000 7f2f939d2740 1 --2- 172.21.15.42:0/652909137 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x564fbc4c8b00 0x564fbc4850b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.405+0000 7f2f939d2740 1 --2- 172.21.15.42:0/652909137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564fbc0904d0 0x564fbc523180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.405+0000 7f2f939d2740 1 -- 172.21.15.42:0/652909137 >> 172.21.15.42:0/652909137 conn(0x564fbc0ad4e0 msgr2=0x564fbc487510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:15.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.405+0000 7f2f66a00640 0 client.5088 ms_handle_reset on v2:172.21.15.42:6834/3278817895 2024-09-17T01:34:15.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.405+0000 7f2f939d2740 1 -- 172.21.15.42:0/652909137 shutdown_connections 2024-09-17T01:34:15.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.405+0000 7f2f939d2740 1 -- 172.21.15.42:0/652909137 wait complete. 2024-09-17T01:34:15.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.406+0000 7f2f939d2740 20 client.5088 trim_cache size 0 max 16384 2024-09-17T01:34:15.405 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:34:15.405 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "scrub active (1135 inodes in the stack)", 2024-09-17T01:34:15.405 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-09-17T01:34:15.405 INFO:teuthology.orchestra.run.smithi042.stdout: "ddae4f68-6c4d-4449-b792-511937baea49": { 2024-09-17T01:34:15.405 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-17T01:34:15.405 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "ddae4f68-6c4d-4449-b792-511937baea49", 2024-09-17T01:34:15.405 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive,scrub_mdsdir" 2024-09-17T01:34:15.405 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:34:15.405 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:15.406 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_stats": { 2024-09-17T01:34:15.406 INFO:teuthology.orchestra.run.smithi042.stdout: "ddae4f68-6c4d-4449-b792-511937baea49": { 2024-09-17T01:34:15.406 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:34:15.054517+0000", 2024-09-17T01:34:15.406 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-17T01:34:15.406 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:34:15.406 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:34:15.406 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:34:15.406 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:34:15.406 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:34:15.406 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:34:15.406 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:34:15.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.406+0000 7f2f87200640 1 -- 172.21.15.42:0/694655155 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f68078b90 msgr2=0x7f2f6807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:15.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.406+0000 7f2f87200640 1 --2- 172.21.15.42:0/694655155 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f68078b90 0x7f2f6807b0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2f78009fd0 tx=0x7f2f78005f90 comp rx=0 tx=0).stop 2024-09-17T01:34:15.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.406+0000 7f2f87200640 1 -- 172.21.15.42:0/694655155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f880d3e40 msgr2=0x7f2f8814b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:15.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.406+0000 7f2f87200640 1 --2- 172.21.15.42:0/694655155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f880d3e40 0x7f2f8814b820 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400e680 tx=0x7f2f7400eb40 comp rx=0 tx=0).stop 2024-09-17T01:34:15.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.406+0000 7f2f87200640 1 -- 172.21.15.42:0/694655155 shutdown_connections 2024-09-17T01:34:15.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.406+0000 7f2f87200640 1 --2- 172.21.15.42:0/694655155 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f68078b90 0x7f2f6807b0a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.407+0000 7f2f87200640 1 --2- 172.21.15.42:0/694655155 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f8815ede0 0x7f2f881f8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.407+0000 7f2f87200640 1 --2- 172.21.15.42:0/694655155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f880d3e40 0x7f2f8814b820 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.407+0000 7f2f87200640 1 --2- 172.21.15.42:0/694655155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f880d0d20 0x7f2f88153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:15.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.407+0000 7f2f87200640 1 -- 172.21.15.42:0/694655155 >> 172.21.15.42:0/694655155 conn(0x7f2f8806cd20 msgr2=0x7f2f88158910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:15.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.407+0000 7f2f87200640 1 -- 172.21.15.42:0/694655155 shutdown_connections 2024-09-17T01:34:15.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:15.407+0000 7f2f87200640 1 -- 172.21.15.42:0/694655155 wait complete. 2024-09-17T01:34:15.430 INFO:tasks.cephfs.filesystem:scrub status for tag:ddae4f68-6c4d-4449-b792-511937baea49 - {'path': '/', 'tag': 'ddae4f68-6c4d-4449-b792-511937baea49', 'options': 'recursive,scrub_mdsdir'} 2024-09-17T01:34:19.340 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:34:19.344 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:34:45.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:34:45.431 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-17T01:34:45.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.676+0000 7f830bc00640 1 -- 172.21.15.42:0/470386133 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f830406ee90 msgr2=0x7f830415f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:45.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.676+0000 7f830bc00640 1 --2- 172.21.15.42:0/470386133 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f830406ee90 0x7f830415f200 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f83040b00c0 tx=0x7f82f802a4d0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.676+0000 7f830bc00640 1 -- 172.21.15.42:0/470386133 shutdown_connections 2024-09-17T01:34:45.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.676+0000 7f830bc00640 1 --2- 172.21.15.42:0/470386133 >> v2:172.21.15.43:3300/0 conn(0x7f830406db50 0x7f8304073df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.676+0000 7f830bc00640 1 --2- 172.21.15.42:0/470386133 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f830406f2a0 0x7f830406d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.676+0000 7f830bc00640 1 --2- 172.21.15.42:0/470386133 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f830406ee90 0x7f830415f200 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.676+0000 7f830bc00640 1 -- 172.21.15.42:0/470386133 >> 172.21.15.42:0/470386133 conn(0x7f83040b2930 msgr2=0x7f830406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:45.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.676+0000 7f830bc00640 1 -- 172.21.15.42:0/470386133 shutdown_connections 2024-09-17T01:34:45.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.676+0000 7f830bc00640 1 -- 172.21.15.42:0/470386133 wait complete. 2024-09-17T01:34:45.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.678+0000 7f830bc00640 1 Processor -- start 2024-09-17T01:34:45.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.678+0000 7f830bc00640 1 -- start start 2024-09-17T01:34:45.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.680+0000 7f830bc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f830406db50 0x7f83041580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.680+0000 7f830bc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f830406ee90 0x7f8304141600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.680+0000 7f830bc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f830406f2a0 0x7f83040ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.680+0000 7f830bc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f83040746c0 con 0x7f830406f2a0 2024-09-17T01:34:45.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.680+0000 7f830bc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8304074540 con 0x7f830406ee90 2024-09-17T01:34:45.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.680+0000 7f830bc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f83040cef40 con 0x7f830406db50 2024-09-17T01:34:45.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.680+0000 7f8309c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f830406f2a0 0x7f83040ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.680+0000 7f8303e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f830406ee90 0x7f8304141600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.680+0000 7f8309c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f830406f2a0 0x7f83040ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35114/0 (socket says 172.21.15.42:35114) 2024-09-17T01:34:45.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.680+0000 7f8309c00640 1 -- 172.21.15.42:0/3824867781 learned_addr learned my addr 172.21.15.42:0/3824867781 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:45.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.680+0000 7f8309200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f830406db50 0x7f83041580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.680+0000 7f8309c00640 1 -- 172.21.15.42:0/3824867781 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f830406db50 msgr2=0x7f83041580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:45.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.680+0000 7f8309c00640 1 --2- 172.21.15.42:0/3824867781 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f830406db50 0x7f83041580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.680+0000 7f8309c00640 1 -- 172.21.15.42:0/3824867781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f830406ee90 msgr2=0x7f8304141600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:45.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.680+0000 7f8309c00640 1 --2- 172.21.15.42:0/3824867781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f830406ee90 0x7f8304141600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.680+0000 7f8309c00640 1 -- 172.21.15.42:0/3824867781 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83041568c0 con 0x7f830406f2a0 2024-09-17T01:34:45.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.681+0000 7f8309c00640 1 --2- 172.21.15.42:0/3824867781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f830406f2a0 0x7f83040ae8a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f82fc00d9b0 tx=0x7f82fc00de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:45.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.681+0000 7f8300c00640 1 -- 172.21.15.42:0/3824867781 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82fc016070 con 0x7f830406f2a0 2024-09-17T01:34:45.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.681+0000 7f8300c00640 1 -- 172.21.15.42:0/3824867781 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82fc00bce0 con 0x7f830406f2a0 2024-09-17T01:34:45.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.681+0000 7f8300c00640 1 -- 172.21.15.42:0/3824867781 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82fc003bd0 con 0x7f830406f2a0 2024-09-17T01:34:45.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.681+0000 7f830bc00640 1 -- 172.21.15.42:0/3824867781 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8304156b60 con 0x7f830406f2a0 2024-09-17T01:34:45.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.681+0000 7f830bc00640 1 -- 172.21.15.42:0/3824867781 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8304157120 con 0x7f830406f2a0 2024-09-17T01:34:45.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.685+0000 7f8300c00640 1 -- 172.21.15.42:0/3824867781 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f82fc010460 con 0x7f830406f2a0 2024-09-17T01:34:45.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.686+0000 7f8300c00640 1 --2- 172.21.15.42:0/3824867781 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f82e4078b90 0x7f82e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.686+0000 7f8312e31740 1 Processor -- start 2024-09-17T01:34:45.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.686+0000 7f8300c00640 1 -- 172.21.15.42:0/3824867781 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7f82fc09b340 con 0x7f830406f2a0 2024-09-17T01:34:45.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.686+0000 7f8312e31740 1 -- start start 2024-09-17T01:34:45.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.687+0000 7f8309200640 1 --2- 172.21.15.42:0/3824867781 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f82e4078b90 0x7f82e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.687+0000 7f8312e31740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb94420390 0x55eb9480e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.687+0000 7f8312e31740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb943f74d0 0x55eb947f1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.687+0000 7f8309200640 1 --2- 172.21.15.42:0/3824867781 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f82e4078b90 0x7f82e407b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f82f8033000 tx=0x7f82f8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:45.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.687+0000 7f8312e31740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb943ff6b0 0x55eb947f1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.687+0000 7f8312e31740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55eb947271c0 con 0x55eb943f74d0 2024-09-17T01:34:45.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.687+0000 7f8312e31740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55eb9473a870 con 0x55eb94420390 2024-09-17T01:34:45.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.687+0000 7f8312e31740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55eb94729ca0 con 0x55eb943ff6b0 2024-09-17T01:34:45.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.688+0000 7f8303e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb943f74d0 0x55eb947f1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.688+0000 7f8303e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb943f74d0 0x55eb947f1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35128/0 (socket says 172.21.15.42:35128) 2024-09-17T01:34:45.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.688+0000 7f8303e00640 1 -- 172.21.15.42:0/3745600246 learned_addr learned my addr 172.21.15.42:0/3745600246 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:45.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.688+0000 7f8309c00640 1 --2- 172.21.15.42:0/3745600246 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb943ff6b0 0x55eb947f1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.688+0000 7f8309200640 1 --2- 172.21.15.42:0/3745600246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb94420390 0x55eb9480e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.688+0000 7f8303e00640 1 -- 172.21.15.42:0/3745600246 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb943ff6b0 msgr2=0x55eb947f1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:45.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.688+0000 7f8303e00640 1 --2- 172.21.15.42:0/3745600246 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb943ff6b0 0x55eb947f1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.688+0000 7f8303e00640 1 -- 172.21.15.42:0/3745600246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb94420390 msgr2=0x55eb9480e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:45.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.688+0000 7f8303e00640 1 --2- 172.21.15.42:0/3745600246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb94420390 0x55eb9480e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.688+0000 7f8303e00640 1 -- 172.21.15.42:0/3745600246 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb945027d0 con 0x55eb943f74d0 2024-09-17T01:34:45.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.688+0000 7f8309200640 1 --2- 172.21.15.42:0/3745600246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb94420390 0x55eb9480e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:34:45.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.688+0000 7f8303e00640 1 --2- 172.21.15.42:0/3745600246 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb943f74d0 0x55eb947f1220 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f82f00036d0 tx=0x7f82f0003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a60aa95d73cd08a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:45.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.689+0000 7f82f5600640 1 -- 172.21.15.42:0/3745600246 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f000bb60 con 0x55eb943f74d0 2024-09-17T01:34:45.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.689+0000 7f82f5600640 1 -- 172.21.15.42:0/3745600246 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82f0015030 con 0x55eb943f74d0 2024-09-17T01:34:45.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.689+0000 7f82f5600640 1 -- 172.21.15.42:0/3745600246 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f0005020 con 0x55eb943f74d0 2024-09-17T01:34:45.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.689+0000 7f8312e31740 1 -- 172.21.15.42:0/3745600246 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb943f74d0 msgr2=0x55eb947f1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:45.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.689+0000 7f8312e31740 1 --2- 172.21.15.42:0/3745600246 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb943f74d0 0x55eb947f1220 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f82f00036d0 tx=0x7f82f0003b90 comp rx=0 tx=0).stop 2024-09-17T01:34:45.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.689+0000 7f8312e31740 1 -- 172.21.15.42:0/3745600246 shutdown_connections 2024-09-17T01:34:45.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.689+0000 7f8312e31740 1 --2- 172.21.15.42:0/3745600246 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb943ff6b0 0x55eb947f1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.689+0000 7f8312e31740 1 --2- 172.21.15.42:0/3745600246 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb943f74d0 0x55eb947f1220 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.689+0000 7f8312e31740 1 --2- 172.21.15.42:0/3745600246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb94420390 0x55eb9480e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.689+0000 7f8312e31740 1 -- 172.21.15.42:0/3745600246 >> 172.21.15.42:0/3745600246 conn(0x55eb944144e0 msgr2=0x55eb947c7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:45.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.690+0000 7f8312e31740 1 -- 172.21.15.42:0/3745600246 shutdown_connections 2024-09-17T01:34:45.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.690+0000 7f8312e31740 1 -- 172.21.15.42:0/3745600246 wait complete. 2024-09-17T01:34:45.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.691+0000 7f8312e31740 1 -- start start 2024-09-17T01:34:45.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.691+0000 7f8312e31740 1 Processor -- start 2024-09-17T01:34:45.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.692+0000 7f8312e31740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb943f74d0 0x55eb9481b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.692+0000 7f8312e31740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb943ff6b0 0x55eb94803ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.692+0000 7f8312e31740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb94420390 0x55eb947c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.692+0000 7f8312e31740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55eb946d0410 con 0x55eb94420390 2024-09-17T01:34:45.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.692+0000 7f8312e31740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55eb9472dab0 con 0x55eb943ff6b0 2024-09-17T01:34:45.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.692+0000 7f8312e31740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55eb9449a740 con 0x55eb943f74d0 2024-09-17T01:34:45.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.693+0000 7f8312e31740 10 client.0 _ll_register_callbacks cb 0x55eb946ad360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:34:45.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.693+0000 7f8309c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb94420390 0x55eb947c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.693+0000 7f8309c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb94420390 0x55eb947c66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35138/0 (socket says 172.21.15.42:35138) 2024-09-17T01:34:45.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.693+0000 7f8309c00640 1 -- 172.21.15.42:0/769971422 learned_addr learned my addr 172.21.15.42:0/769971422 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:45.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.693+0000 7f8309200640 1 --2- 172.21.15.42:0/769971422 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb943f74d0 0x55eb9481b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.693+0000 7f8303e00640 1 --2- 172.21.15.42:0/769971422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb943ff6b0 0x55eb94803ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.693+0000 7f8309c00640 1 -- 172.21.15.42:0/769971422 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb943f74d0 msgr2=0x55eb9481b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:45.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.693+0000 7f8309c00640 1 --2- 172.21.15.42:0/769971422 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb943f74d0 0x55eb9481b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.693+0000 7f8309c00640 1 -- 172.21.15.42:0/769971422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb943ff6b0 msgr2=0x55eb94803ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:45.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.693+0000 7f8309c00640 1 --2- 172.21.15.42:0/769971422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb943ff6b0 0x55eb94803ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.693+0000 7f8309c00640 1 -- 172.21.15.42:0/769971422 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb9448b970 con 0x55eb94420390 2024-09-17T01:34:45.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.693+0000 7f8309c00640 1 --2- 172.21.15.42:0/769971422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb94420390 0x55eb947c66f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f82fc062d90 tx=0x7f82fc0628f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=400ef7462cdd948a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:45.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.693+0000 7f82ea000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:34:45.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.694+0000 7f82ea000640 1 -- 172.21.15.42:0/769971422 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82fc089070 con 0x55eb94420390 2024-09-17T01:34:45.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.694+0000 7f82ea000640 1 -- 172.21.15.42:0/769971422 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7f82fc099b60 con 0x55eb94420390 2024-09-17T01:34:45.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.694+0000 7f8312e31740 1 -- 172.21.15.42:0/769971422 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82f0015030 con 0x55eb94420390 2024-09-17T01:34:45.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.694+0000 7f82ea000640 1 -- 172.21.15.42:0/769971422 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f82fc01f040 con 0x55eb94420390 2024-09-17T01:34:45.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.694+0000 7f8312e31740 10 client.5100 fetch_fsmap learned FSMap version 18 2024-09-17T01:34:45.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.694+0000 7f8312e31740 1 -- 172.21.15.42:0/769971422 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55eb944696a0 con 0x55eb94420390 2024-09-17T01:34:45.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.694+0000 7f82ea000640 1 -- 172.21.15.42:0/769971422 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82f0015030 con 0x55eb94420390 2024-09-17T01:34:45.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.694+0000 7f82ea000640 1 -- 172.21.15.42:0/769971422 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f82fc07d080 con 0x55eb94420390 2024-09-17T01:34:45.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.694+0000 7f8312e31740 10 client.5100 fetch_fsmap finished waiting for FSMap version 18 2024-09-17T01:34:45.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.694+0000 7f8312e31740 10 client.5100 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-17T01:34:45.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.694+0000 7f8312e31740 20 client.5100 populate_metadata read hostname 'smithi042' 2024-09-17T01:34:45.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.694+0000 7f8312e31740 1 --2- 172.21.15.42:0/769971422 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x55eb943def60 0x55eb94803500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.694+0000 7f8312e31740 4 client.5100 mds_command: new command op to 4830 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:34:45.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.694+0000 7f8312e31740 1 -- 172.21.15.42:0/769971422 --> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb9473c7c0 con 0x55eb943def60 2024-09-17T01:34:45.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.695+0000 7f8309200640 1 --2- 172.21.15.42:0/769971422 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x55eb943def60 0x55eb94803500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.695+0000 7f8309200640 1 --2- 172.21.15.42:0/769971422 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x55eb943def60 0x55eb94803500 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6eb48534605a187a server_cookie=d2391f4e7f8ba051 in_seq=0 out_seq=0 2024-09-17T01:34:45.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.695+0000 7f82ea000640 10 client.5100 ms_handle_connect on v2:172.21.15.42:6834/3278817895 2024-09-17T01:34:45.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.696+0000 7f82ea000640 1 -- 172.21.15.42:0/769971422 <== mds.0 v2:172.21.15.42:6834/3278817895 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eb9473c7c0 con 0x55eb943def60 2024-09-17T01:34:45.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.696+0000 7f82ea000640 10 client.5100 handle_command_reply: tid=0 2024-09-17T01:34:45.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.696+0000 7f8312e31740 1 client.5100 shutdown 2024-09-17T01:34:45.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.696+0000 7f8312e31740 1 -- 172.21.15.42:0/769971422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb94420390 msgr2=0x55eb947c66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:45.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.696+0000 7f8312e31740 1 --2- 172.21.15.42:0/769971422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb94420390 0x55eb947c66f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f82fc062d90 tx=0x7f82fc0628f0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.696+0000 7f8312e31740 1 -- 172.21.15.42:0/769971422 shutdown_connections 2024-09-17T01:34:45.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.696+0000 7f8312e31740 1 --2- 172.21.15.42:0/769971422 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x55eb943def60 0x55eb94803500 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.696+0000 7f8312e31740 1 --2- 172.21.15.42:0/769971422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb943ff6b0 0x55eb94803ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.696+0000 7f8312e31740 1 --2- 172.21.15.42:0/769971422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb94420390 0x55eb947c66f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.696+0000 7f8312e31740 1 --2- 172.21.15.42:0/769971422 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb943f74d0 0x55eb9481b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.696+0000 7f82ea000640 0 client.5100 ms_handle_reset on v2:172.21.15.42:6834/3278817895 2024-09-17T01:34:45.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.696+0000 7f8312e31740 1 -- 172.21.15.42:0/769971422 >> 172.21.15.42:0/769971422 conn(0x55eb944144e0 msgr2=0x55eb947e09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:45.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.697+0000 7f8312e31740 1 -- 172.21.15.42:0/769971422 shutdown_connections 2024-09-17T01:34:45.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.697+0000 7f8312e31740 1 -- 172.21.15.42:0/769971422 wait complete. 2024-09-17T01:34:45.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.697+0000 7f8312e31740 20 client.5100 trim_cache size 0 max 16384 2024-09-17T01:34:45.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.715+0000 7f8312e31740 1 Processor -- start 2024-09-17T01:34:45.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.716+0000 7f8312e31740 1 -- start start 2024-09-17T01:34:45.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.717+0000 7f8312e31740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb943f74d0 0x55eb94804010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.717+0000 7f8312e31740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb943ff6b0 0x55eb947c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.717+0000 7f8312e31740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb94420390 0x55eb947c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.717+0000 7f8312e31740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8304202530 con 0x55eb943f74d0 2024-09-17T01:34:45.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.717+0000 7f8312e31740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8304201580 con 0x55eb943ff6b0 2024-09-17T01:34:45.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.717+0000 7f8312e31740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8304142640 con 0x55eb94420390 2024-09-17T01:34:45.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.717+0000 7f8309200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb943f74d0 0x55eb94804010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.717+0000 7f8309200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb943f74d0 0x55eb94804010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35154/0 (socket says 172.21.15.42:35154) 2024-09-17T01:34:45.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.717+0000 7f8309200640 1 -- 172.21.15.42:0/4058888529 learned_addr learned my addr 172.21.15.42:0/4058888529 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:45.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.717+0000 7f8309200640 1 -- 172.21.15.42:0/4058888529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb94420390 msgr2=0x55eb947c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:45.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.717+0000 7f8309200640 1 --2- 172.21.15.42:0/4058888529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb94420390 0x55eb947c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.717+0000 7f8309200640 1 -- 172.21.15.42:0/4058888529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb943ff6b0 msgr2=0x55eb947c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:45.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.717+0000 7f8309200640 1 --2- 172.21.15.42:0/4058888529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb943ff6b0 0x55eb947c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.717+0000 7f8309200640 1 -- 172.21.15.42:0/4058888529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb94803870 con 0x55eb943f74d0 2024-09-17T01:34:45.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.718+0000 7f8309200640 1 --2- 172.21.15.42:0/4058888529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb943f74d0 0x55eb94804010 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f82f80099c0 tx=0x7f82f803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e169c6464925bb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:45.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.718+0000 7f82f4c00640 1 -- 172.21.15.42:0/4058888529 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f8035040 con 0x55eb943f74d0 2024-09-17T01:34:45.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.718+0000 7f82f4c00640 1 -- 172.21.15.42:0/4058888529 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82f80044a0 con 0x55eb943f74d0 2024-09-17T01:34:45.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.718+0000 7f82f4c00640 1 -- 172.21.15.42:0/4058888529 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f8003c00 con 0x55eb943f74d0 2024-09-17T01:34:45.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.719+0000 7f8312e31740 1 -- 172.21.15.42:0/4058888529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb943f74d0 msgr2=0x55eb94804010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:45.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.719+0000 7f8312e31740 1 --2- 172.21.15.42:0/4058888529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb943f74d0 0x55eb94804010 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f82f80099c0 tx=0x7f82f803d000 comp rx=0 tx=0).stop 2024-09-17T01:34:45.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.719+0000 7f8312e31740 1 -- 172.21.15.42:0/4058888529 shutdown_connections 2024-09-17T01:34:45.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.719+0000 7f8312e31740 1 --2- 172.21.15.42:0/4058888529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb943ff6b0 0x55eb947c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.719+0000 7f8312e31740 1 --2- 172.21.15.42:0/4058888529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb94420390 0x55eb947c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.719+0000 7f8312e31740 1 --2- 172.21.15.42:0/4058888529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb943f74d0 0x55eb94804010 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.719+0000 7f8312e31740 1 -- 172.21.15.42:0/4058888529 >> 172.21.15.42:0/4058888529 conn(0x55eb944144e0 msgr2=0x55eb9481a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:45.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.719+0000 7f8312e31740 1 -- 172.21.15.42:0/4058888529 shutdown_connections 2024-09-17T01:34:45.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.719+0000 7f8312e31740 1 -- 172.21.15.42:0/4058888529 wait complete. 2024-09-17T01:34:45.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.720+0000 7f8312e31740 1 -- start start 2024-09-17T01:34:45.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.720+0000 7f8312e31740 1 Processor -- start 2024-09-17T01:34:45.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.721+0000 7f8312e31740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb943f74d0 0x55eb948887d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.721+0000 7f8312e31740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb943ff6b0 0x55eb94804960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.722+0000 7f8312e31740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb94420390 0x55eb94804ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.722+0000 7f8312e31740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8304142c90 con 0x55eb943f74d0 2024-09-17T01:34:45.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.722+0000 7f8312e31740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55eb947ee160 con 0x55eb943ff6b0 2024-09-17T01:34:45.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.722+0000 7f8312e31740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55eb9488c2a0 con 0x55eb94420390 2024-09-17T01:34:45.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.722+0000 7f8312e31740 10 client.0 _ll_register_callbacks cb 0x7f82fc004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:34:45.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.722+0000 7f8309200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb943f74d0 0x55eb948887d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.722+0000 7f8309200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb943f74d0 0x55eb948887d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:35170/0 (socket says 172.21.15.42:35170) 2024-09-17T01:34:45.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.722+0000 7f8309200640 1 -- 172.21.15.42:0/1329473437 learned_addr learned my addr 172.21.15.42:0/1329473437 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:45.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.722+0000 7f8303e00640 1 --2- 172.21.15.42:0/1329473437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb943ff6b0 0x55eb94804960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.722+0000 7f8309c00640 1 --2- 172.21.15.42:0/1329473437 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb94420390 0x55eb94804ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.722+0000 7f8309200640 1 -- 172.21.15.42:0/1329473437 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb94420390 msgr2=0x55eb94804ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:45.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.722+0000 7f8309200640 1 --2- 172.21.15.42:0/1329473437 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb94420390 0x55eb94804ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.722+0000 7f8309200640 1 -- 172.21.15.42:0/1329473437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb943ff6b0 msgr2=0x55eb94804960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:45.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.722+0000 7f8309200640 1 --2- 172.21.15.42:0/1329473437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb943ff6b0 0x55eb94804960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.722+0000 7f8309200640 1 -- 172.21.15.42:0/1329473437 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb947eb5d0 con 0x55eb943f74d0 2024-09-17T01:34:45.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.723+0000 7f8309200640 1 --2- 172.21.15.42:0/1329473437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb943f74d0 0x55eb948887d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f82f8005880 tx=0x7f82f8003c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7120bd0b7435441c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:45.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.723+0000 7f82ea000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:34:45.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.723+0000 7f82ea000640 1 -- 172.21.15.42:0/1329473437 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f8035050 con 0x55eb943f74d0 2024-09-17T01:34:45.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.723+0000 7f82ea000640 1 -- 172.21.15.42:0/1329473437 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7f82f80047a0 con 0x55eb943f74d0 2024-09-17T01:34:45.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.723+0000 7f8312e31740 1 -- 172.21.15.42:0/1329473437 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82f80044a0 con 0x55eb943f74d0 2024-09-17T01:34:45.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.723+0000 7f82ea000640 1 -- 172.21.15.42:0/1329473437 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f82f80049a0 con 0x55eb943f74d0 2024-09-17T01:34:45.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.723+0000 7f8312e31740 10 client.5106 fetch_fsmap learned FSMap version 18 2024-09-17T01:34:45.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.723+0000 7f8312e31740 1 -- 172.21.15.42:0/1329473437 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55eb947c8a60 con 0x55eb943f74d0 2024-09-17T01:34:45.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.723+0000 7f82ea000640 1 -- 172.21.15.42:0/1329473437 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82f80044a0 con 0x55eb943f74d0 2024-09-17T01:34:45.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.724+0000 7f82ea000640 1 -- 172.21.15.42:0/1329473437 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f82f8065030 con 0x55eb943f74d0 2024-09-17T01:34:45.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.724+0000 7f8312e31740 10 client.5106 fetch_fsmap finished waiting for FSMap version 18 2024-09-17T01:34:45.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.724+0000 7f8312e31740 10 client.5106 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-17T01:34:45.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.724+0000 7f8312e31740 20 client.5106 populate_metadata read hostname 'smithi042' 2024-09-17T01:34:45.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.724+0000 7f8312e31740 1 --2- 172.21.15.42:0/1329473437 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x55eb9488e890 0x55eb9488eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.724+0000 7f8312e31740 4 client.5106 mds_command: new command op to 4830 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:34:45.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.724+0000 7f8312e31740 1 -- 172.21.15.42:0/1329473437 --> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55eb94738270 con 0x55eb9488e890 2024-09-17T01:34:45.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.724+0000 7f8303e00640 1 --2- 172.21.15.42:0/1329473437 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x55eb9488e890 0x55eb9488eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.724+0000 7f8303e00640 1 --2- 172.21.15.42:0/1329473437 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x55eb9488e890 0x55eb9488eca0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd1c21930f52fe4f server_cookie=a700a8ce1c94ee0a in_seq=0 out_seq=0 2024-09-17T01:34:45.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.724+0000 7f82ea000640 10 client.5106 ms_handle_connect on v2:172.21.15.42:6834/3278817895 2024-09-17T01:34:45.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.725+0000 7f82ea000640 1 -- 172.21.15.42:0/1329473437 <== mds.0 v2:172.21.15.42:6834/3278817895 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x55eb94738270 con 0x55eb9488e890 2024-09-17T01:34:45.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.725+0000 7f82ea000640 10 client.5106 handle_command_reply: tid=0 2024-09-17T01:34:45.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.725+0000 7f8312e31740 1 client.5106 shutdown 2024-09-17T01:34:45.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.725+0000 7f8312e31740 1 -- 172.21.15.42:0/1329473437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb943f74d0 msgr2=0x55eb948887d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:45.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.725+0000 7f8312e31740 1 --2- 172.21.15.42:0/1329473437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb943f74d0 0x55eb948887d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f82f8005880 tx=0x7f82f8003c70 comp rx=0 tx=0).stop 2024-09-17T01:34:45.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.725+0000 7f8312e31740 1 -- 172.21.15.42:0/1329473437 shutdown_connections 2024-09-17T01:34:45.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.725+0000 7f8312e31740 1 --2- 172.21.15.42:0/1329473437 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x55eb9488e890 0x55eb9488eca0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.725+0000 7f8312e31740 1 --2- 172.21.15.42:0/1329473437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb943ff6b0 0x55eb94804960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.725+0000 7f8312e31740 1 --2- 172.21.15.42:0/1329473437 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb94420390 0x55eb94804ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.725+0000 7f8312e31740 1 --2- 172.21.15.42:0/1329473437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb943f74d0 0x55eb948887d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.725+0000 7f82ea000640 0 client.5106 ms_handle_reset on v2:172.21.15.42:6834/3278817895 2024-09-17T01:34:45.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.725+0000 7f8312e31740 1 -- 172.21.15.42:0/1329473437 >> 172.21.15.42:0/1329473437 conn(0x55eb944144e0 msgr2=0x55eb94805e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:45.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.725+0000 7f8312e31740 1 -- 172.21.15.42:0/1329473437 shutdown_connections 2024-09-17T01:34:45.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.725+0000 7f8312e31740 1 -- 172.21.15.42:0/1329473437 wait complete. 2024-09-17T01:34:45.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.725+0000 7f8312e31740 20 client.5106 trim_cache size 0 max 16384 2024-09-17T01:34:45.727 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:34:45.727 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-09-17T01:34:45.727 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {}, 2024-09-17T01:34:45.727 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_stats": { 2024-09-17T01:34:45.727 INFO:teuthology.orchestra.run.smithi042.stdout: "ddae4f68-6c4d-4449-b792-511937baea49": { 2024-09-17T01:34:45.727 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:34:15.054517+0000", 2024-09-17T01:34:45.727 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-17T01:34:45.727 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:34:45.728 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:34:45.728 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:34:45.728 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:34:45.728 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:34:45.728 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:34:45.728 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:34:45.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.726+0000 7f830bc00640 1 -- 172.21.15.42:0/3824867781 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f82e4078b90 msgr2=0x7f82e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:45.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.726+0000 7f830bc00640 1 --2- 172.21.15.42:0/3824867781 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f82e4078b90 0x7f82e407b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f82f8033000 tx=0x7f82f8004730 comp rx=0 tx=0).stop 2024-09-17T01:34:45.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.726+0000 7f830bc00640 1 -- 172.21.15.42:0/3824867781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f830406f2a0 msgr2=0x7f83040ae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:45.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.726+0000 7f830bc00640 1 --2- 172.21.15.42:0/3824867781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f830406f2a0 0x7f83040ae8a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f82fc00d9b0 tx=0x7f82fc00de70 comp rx=0 tx=0).stop 2024-09-17T01:34:45.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.726+0000 7f830bc00640 1 -- 172.21.15.42:0/3824867781 shutdown_connections 2024-09-17T01:34:45.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.726+0000 7f830bc00640 1 --2- 172.21.15.42:0/3824867781 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f82e4078b90 0x7f82e407b0a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.726+0000 7f830bc00640 1 --2- 172.21.15.42:0/3824867781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f830406ee90 0x7f8304141600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.726+0000 7f830bc00640 1 --2- 172.21.15.42:0/3824867781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f830406f2a0 0x7f83040ae8a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.726+0000 7f830bc00640 1 --2- 172.21.15.42:0/3824867781 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f830406db50 0x7f83041580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.726+0000 7f830bc00640 1 -- 172.21.15.42:0/3824867781 >> 172.21.15.42:0/3824867781 conn(0x7f83040b2930 msgr2=0x7f830406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:45.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.726+0000 7f830bc00640 1 -- 172.21.15.42:0/3824867781 shutdown_connections 2024-09-17T01:34:45.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.726+0000 7f830bc00640 1 -- 172.21.15.42:0/3824867781 wait complete. 2024-09-17T01:34:45.747 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T01:34:45.747 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-09-17T01:34:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.980+0000 7f9849000640 1 -- 172.21.15.42:0/4085769101 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f98440b3550 msgr2=0x7f984415cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.980+0000 7f9849000640 1 --2- 172.21.15.42:0/4085769101 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f98440b3550 0x7f984415cec0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9834009860 tx=0x7f983402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.980+0000 7f9849000640 1 -- 172.21.15.42:0/4085769101 shutdown_connections 2024-09-17T01:34:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.980+0000 7f9849000640 1 --2- 172.21.15.42:0/4085769101 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f98440b3550 0x7f984415cec0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.980+0000 7f9849000640 1 -- 172.21.15.42:0/4085769101 >> 172.21.15.42:0/4085769101 conn(0x7f98440b2930 msgr2=0x7f984406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:45.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.980+0000 7f9849000640 1 -- 172.21.15.42:0/4085769101 shutdown_connections 2024-09-17T01:34:45.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.980+0000 7f9849000640 1 -- 172.21.15.42:0/4085769101 wait complete. 2024-09-17T01:34:45.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.982+0000 7f9849000640 1 Processor -- start 2024-09-17T01:34:45.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.982+0000 7f9849000640 1 -- start start 2024-09-17T01:34:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.984+0000 7f9849000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f98440b3550 0x7f98441f8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.984+0000 7f9849000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98440cec40 0x7f98440ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.984+0000 7f9849000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9844142f40 0x7f98440aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.984+0000 7f9849000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f98440cf1d0 con 0x7f98440cec40 2024-09-17T01:34:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.984+0000 7f9849000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f98440cf050 con 0x7f9844142f40 2024-09-17T01:34:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.984+0000 7f9849000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f98440cf350 con 0x7f98440b3550 2024-09-17T01:34:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.984+0000 7f983be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98440cec40 0x7f98440ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.984+0000 7f983be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98440cec40 0x7f98440ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55822/0 (socket says 172.21.15.42:55822) 2024-09-17T01:34:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.984+0000 7f983be00640 1 -- 172.21.15.42:0/4194454254 learned_addr learned my addr 172.21.15.42:0/4194454254 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.984+0000 7f9841e00640 1 --2- 172.21.15.42:0/4194454254 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f98440b3550 0x7f98441f8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.984+0000 7f9842800640 1 --2- 172.21.15.42:0/4194454254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9844142f40 0x7f98440aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.984+0000 7f983be00640 1 -- 172.21.15.42:0/4194454254 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f98440b3550 msgr2=0x7f98441f8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.984+0000 7f983be00640 1 --2- 172.21.15.42:0/4194454254 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f98440b3550 0x7f98441f8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.984+0000 7f983be00640 1 -- 172.21.15.42:0/4194454254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9844142f40 msgr2=0x7f98440aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.984+0000 7f983be00640 1 --2- 172.21.15.42:0/4194454254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9844142f40 0x7f98440aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.984+0000 7f983be00640 1 -- 172.21.15.42:0/4194454254 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98441f71d0 con 0x7f98440cec40 2024-09-17T01:34:45.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.984+0000 7f9842800640 1 --2- 172.21.15.42:0/4194454254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9844142f40 0x7f98440aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:34:45.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.985+0000 7f983be00640 1 --2- 172.21.15.42:0/4194454254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98440cec40 0x7f98440ae8a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f982c00c460 tx=0x7f982c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:45.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.985+0000 7f983a000640 1 -- 172.21.15.42:0/4194454254 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c0052d0 con 0x7f98440cec40 2024-09-17T01:34:45.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.985+0000 7f983a000640 1 -- 172.21.15.42:0/4194454254 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f982c005490 con 0x7f98440cec40 2024-09-17T01:34:45.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.985+0000 7f9849000640 1 -- 172.21.15.42:0/4194454254 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f984406e340 con 0x7f98440cec40 2024-09-17T01:34:45.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.985+0000 7f983a000640 1 -- 172.21.15.42:0/4194454254 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c012870 con 0x7f98440cec40 2024-09-17T01:34:45.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.985+0000 7f9849000640 1 -- 172.21.15.42:0/4194454254 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f984406e900 con 0x7f98440cec40 2024-09-17T01:34:45.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.988+0000 7f983a000640 1 -- 172.21.15.42:0/4194454254 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f982c012a10 con 0x7f98440cec40 2024-09-17T01:34:45.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.989+0000 7f983a000640 1 --2- 172.21.15.42:0/4194454254 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9820078b90 0x7f982007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.989+0000 7f983a000640 1 -- 172.21.15.42:0/4194454254 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7f982c09a910 con 0x7f98440cec40 2024-09-17T01:34:45.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.989+0000 7f98501cd740 1 Processor -- start 2024-09-17T01:34:45.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.989+0000 7f9841e00640 1 --2- 172.21.15.42:0/4194454254 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9820078b90 0x7f982007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.989+0000 7f98501cd740 1 -- start start 2024-09-17T01:34:45.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.990+0000 7f9841e00640 1 --2- 172.21.15.42:0/4194454254 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9820078b90 0x7f982007b0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9834034000 tx=0x7f9834004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:45.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.990+0000 7f98501cd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c720ab5390 0x55c720ea46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.990+0000 7f98501cd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a8c4d0 0x55c720e87370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.990+0000 7f98501cd740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c720a946b0 0x55c720e878b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.990+0000 7f98501cd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c720d70c10 con 0x55c720a8c4d0 2024-09-17T01:34:45.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.990+0000 7f98501cd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c720dcf9f0 con 0x55c720ab5390 2024-09-17T01:34:45.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.990+0000 7f98501cd740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55c720dbee20 con 0x55c720a946b0 2024-09-17T01:34:45.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.991+0000 7f983be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a8c4d0 0x55c720e87370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.991+0000 7f983be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a8c4d0 0x55c720e87370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55838/0 (socket says 172.21.15.42:55838) 2024-09-17T01:34:45.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.991+0000 7f983be00640 1 -- 172.21.15.42:0/4211987276 learned_addr learned my addr 172.21.15.42:0/4211987276 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:45.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.991+0000 7f9841e00640 1 --2- 172.21.15.42:0/4211987276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c720ab5390 0x55c720ea46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.991+0000 7f9842800640 1 --2- 172.21.15.42:0/4211987276 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c720a946b0 0x55c720e878b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.991+0000 7f983be00640 1 -- 172.21.15.42:0/4211987276 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c720a946b0 msgr2=0x55c720e878b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:45.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.991+0000 7f983be00640 1 --2- 172.21.15.42:0/4211987276 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c720a946b0 0x55c720e878b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.991+0000 7f983be00640 1 -- 172.21.15.42:0/4211987276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c720ab5390 msgr2=0x55c720ea46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:45.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.991+0000 7f983be00640 1 --2- 172.21.15.42:0/4211987276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c720ab5390 0x55c720ea46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.991+0000 7f983be00640 1 -- 172.21.15.42:0/4211987276 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c720b977d0 con 0x55c720a8c4d0 2024-09-17T01:34:45.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.991+0000 7f983be00640 1 --2- 172.21.15.42:0/4211987276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a8c4d0 0x55c720e87370 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f982c062030 tx=0x7f982c061de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a379dcaa9d27bda9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:45.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.992+0000 7f9832a00640 1 -- 172.21.15.42:0/4211987276 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c09a050 con 0x55c720a8c4d0 2024-09-17T01:34:45.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.992+0000 7f9832a00640 1 -- 172.21.15.42:0/4211987276 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f982c0625b0 con 0x55c720a8c4d0 2024-09-17T01:34:45.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.992+0000 7f9832a00640 1 -- 172.21.15.42:0/4211987276 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c067090 con 0x55c720a8c4d0 2024-09-17T01:34:45.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.992+0000 7f98501cd740 1 -- 172.21.15.42:0/4211987276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a8c4d0 msgr2=0x55c720e87370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:45.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.992+0000 7f98501cd740 1 --2- 172.21.15.42:0/4211987276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a8c4d0 0x55c720e87370 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f982c062030 tx=0x7f982c061de0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.993+0000 7f98501cd740 1 -- 172.21.15.42:0/4211987276 shutdown_connections 2024-09-17T01:34:45.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.993+0000 7f98501cd740 1 --2- 172.21.15.42:0/4211987276 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c720a946b0 0x55c720e878b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.993+0000 7f98501cd740 1 --2- 172.21.15.42:0/4211987276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a8c4d0 0x55c720e87370 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.993+0000 7f98501cd740 1 --2- 172.21.15.42:0/4211987276 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c720ab5390 0x55c720ea46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.993+0000 7f98501cd740 1 -- 172.21.15.42:0/4211987276 >> 172.21.15.42:0/4211987276 conn(0x55c720aa94e0 msgr2=0x55c720e5d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:45.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.993+0000 7f98501cd740 1 -- 172.21.15.42:0/4211987276 shutdown_connections 2024-09-17T01:34:45.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.993+0000 7f98501cd740 1 -- 172.21.15.42:0/4211987276 wait complete. 2024-09-17T01:34:45.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.994+0000 7f98501cd740 1 -- start start 2024-09-17T01:34:45.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.994+0000 7f98501cd740 1 Processor -- start 2024-09-17T01:34:45.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.995+0000 7f98501cd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a8c4d0 0x55c720ea1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.995+0000 7f98501cd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c720a946b0 0x55c720eb13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.995+0000 7f98501cd740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c720ab5390 0x55c720e9e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:45.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.995+0000 7f98501cd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c720d64790 con 0x55c720a8c4d0 2024-09-17T01:34:45.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.995+0000 7f98501cd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c720dc2c30 con 0x55c720a946b0 2024-09-17T01:34:45.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.995+0000 7f98501cd740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55c720b2f740 con 0x55c720ab5390 2024-09-17T01:34:45.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.996+0000 7f98501cd740 10 client.0 _ll_register_callbacks cb 0x55c720d74260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:34:45.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.996+0000 7f9841e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a8c4d0 0x55c720ea1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.996+0000 7f9841e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a8c4d0 0x55c720ea1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55840/0 (socket says 172.21.15.42:55840) 2024-09-17T01:34:45.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.996+0000 7f9841e00640 1 -- 172.21.15.42:0/1494855816 learned_addr learned my addr 172.21.15.42:0/1494855816 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:45.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.996+0000 7f983be00640 1 --2- 172.21.15.42:0/1494855816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c720a946b0 0x55c720eb13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.996+0000 7f9842800640 1 --2- 172.21.15.42:0/1494855816 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c720ab5390 0x55c720e9e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:45.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.996+0000 7f9841e00640 1 -- 172.21.15.42:0/1494855816 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c720ab5390 msgr2=0x55c720e9e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:45.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.996+0000 7f9841e00640 1 --2- 172.21.15.42:0/1494855816 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c720ab5390 0x55c720e9e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.996+0000 7f9841e00640 1 -- 172.21.15.42:0/1494855816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c720a946b0 msgr2=0x55c720eb13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:45.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.996+0000 7f9841e00640 1 --2- 172.21.15.42:0/1494855816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c720a946b0 0x55c720eb13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:45.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.996+0000 7f9841e00640 1 -- 172.21.15.42:0/1494855816 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c720afe6a0 con 0x55c720a8c4d0 2024-09-17T01:34:45.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.996+0000 7f9841e00640 1 --2- 172.21.15.42:0/1494855816 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a8c4d0 0x55c720ea1800 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9834009950 tx=0x7f9834005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194c0dbd3b044ce1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:45.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.996+0000 7f9827400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:34:45.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.997+0000 7f9827400640 1 -- 172.21.15.42:0/1494855816 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9834005220 con 0x55c720a8c4d0 2024-09-17T01:34:45.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.997+0000 7f9827400640 1 -- 172.21.15.42:0/1494855816 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7f98340053c0 con 0x55c720a8c4d0 2024-09-17T01:34:45.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.997+0000 7f98501cd740 1 -- 172.21.15.42:0/1494855816 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f982c0625b0 con 0x55c720a8c4d0 2024-09-17T01:34:45.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.997+0000 7f9827400640 1 -- 172.21.15.42:0/1494855816 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f9834058050 con 0x55c720a8c4d0 2024-09-17T01:34:45.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.997+0000 7f98501cd740 10 client.5118 fetch_fsmap learned FSMap version 18 2024-09-17T01:34:45.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.997+0000 7f98501cd740 1 -- 172.21.15.42:0/1494855816 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55c720bf7f60 con 0x55c720a8c4d0 2024-09-17T01:34:45.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.997+0000 7f9827400640 1 -- 172.21.15.42:0/1494855816 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f982c0625b0 con 0x55c720a8c4d0 2024-09-17T01:34:45.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.997+0000 7f9827400640 1 -- 172.21.15.42:0/1494855816 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f983405b020 con 0x55c720a8c4d0 2024-09-17T01:34:45.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.997+0000 7f98501cd740 10 client.5118 fetch_fsmap finished waiting for FSMap version 18 2024-09-17T01:34:46.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.997+0000 7f98501cd740 10 client.5118 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-17T01:34:46.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.997+0000 7f98501cd740 20 client.5118 populate_metadata read hostname 'smithi042' 2024-09-17T01:34:46.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.997+0000 7f98501cd740 1 --2- 172.21.15.42:0/1494855816 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x55c720a73f60 0x55c720eb49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:46.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.997+0000 7f98501cd740 4 client.5118 mds_command: new command op to 4830 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:34:46.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.997+0000 7f98501cd740 1 -- 172.21.15.42:0/1494855816 --> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c720dd1940 con 0x55c720a73f60 2024-09-17T01:34:46.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.998+0000 7f983be00640 1 --2- 172.21.15.42:0/1494855816 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x55c720a73f60 0x55c720eb49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:46.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.998+0000 7f983be00640 1 --2- 172.21.15.42:0/1494855816 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x55c720a73f60 0x55c720eb49e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f218a5a8980ac05 server_cookie=f82f0ff9d2cb5cfa in_seq=0 out_seq=0 2024-09-17T01:34:46.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.998+0000 7f9827400640 10 client.5118 ms_handle_connect on v2:172.21.15.42:6834/3278817895 2024-09-17T01:34:46.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.999+0000 7f9827400640 1 -- 172.21.15.42:0/1494855816 <== mds.0 v2:172.21.15.42:6834/3278817895 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c720dd1940 con 0x55c720a73f60 2024-09-17T01:34:46.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.999+0000 7f9827400640 10 client.5118 handle_command_reply: tid=0 2024-09-17T01:34:46.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.999+0000 7f98501cd740 1 client.5118 shutdown 2024-09-17T01:34:46.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.999+0000 7f98501cd740 1 -- 172.21.15.42:0/1494855816 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a8c4d0 msgr2=0x55c720ea1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:46.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.999+0000 7f98501cd740 1 --2- 172.21.15.42:0/1494855816 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a8c4d0 0x55c720ea1800 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9834009950 tx=0x7f9834005f90 comp rx=0 tx=0).stop 2024-09-17T01:34:46.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.999+0000 7f98501cd740 1 -- 172.21.15.42:0/1494855816 shutdown_connections 2024-09-17T01:34:46.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.999+0000 7f98501cd740 1 --2- 172.21.15.42:0/1494855816 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x55c720a73f60 0x55c720eb49e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.999+0000 7f98501cd740 1 --2- 172.21.15.42:0/1494855816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c720a946b0 0x55c720eb13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.999+0000 7f98501cd740 1 --2- 172.21.15.42:0/1494855816 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c720ab5390 0x55c720e9e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.999+0000 7f98501cd740 1 --2- 172.21.15.42:0/1494855816 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a8c4d0 0x55c720ea1800 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.999+0000 7f98501cd740 1 -- 172.21.15.42:0/1494855816 >> 172.21.15.42:0/1494855816 conn(0x55c720aa94e0 msgr2=0x55c720ea5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:46.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:45.999+0000 7f9827400640 0 client.5118 ms_handle_reset on v2:172.21.15.42:6834/3278817895 2024-09-17T01:34:46.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.000+0000 7f98501cd740 1 -- 172.21.15.42:0/1494855816 shutdown_connections 2024-09-17T01:34:46.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.000+0000 7f98501cd740 1 -- 172.21.15.42:0/1494855816 wait complete. 2024-09-17T01:34:46.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.000+0000 7f98501cd740 20 client.5118 trim_cache size 0 max 16384 2024-09-17T01:34:46.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.017+0000 7f98501cd740 1 Processor -- start 2024-09-17T01:34:46.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.017+0000 7f98501cd740 1 -- start start 2024-09-17T01:34:46.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.018+0000 7f98501cd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a8c4d0 0x55c720ea15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:46.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.018+0000 7f98501cd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c720a946b0 0x55c720e77130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:46.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.018+0000 7f98501cd740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c720ab5390 0x55c720e57ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:46.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.018+0000 7f98501cd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f98442025e0 con 0x55c720a8c4d0 2024-09-17T01:34:46.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.018+0000 7f98501cd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f98441424a0 con 0x55c720a946b0 2024-09-17T01:34:46.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.018+0000 7f98501cd740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9844141800 con 0x55c720ab5390 2024-09-17T01:34:46.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.019+0000 7f9841e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a8c4d0 0x55c720ea15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:46.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.019+0000 7f9841e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a8c4d0 0x55c720ea15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55854/0 (socket says 172.21.15.42:55854) 2024-09-17T01:34:46.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.019+0000 7f9841e00640 1 -- 172.21.15.42:0/2469003781 learned_addr learned my addr 172.21.15.42:0/2469003781 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:46.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.019+0000 7f9841e00640 1 -- 172.21.15.42:0/2469003781 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c720ab5390 msgr2=0x55c720e57ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:46.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.019+0000 7f9841e00640 1 --2- 172.21.15.42:0/2469003781 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c720ab5390 0x55c720e57ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.019+0000 7f983be00640 1 --2- 172.21.15.42:0/2469003781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c720a946b0 0x55c720e77130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:46.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.019+0000 7f9841e00640 1 -- 172.21.15.42:0/2469003781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c720a946b0 msgr2=0x55c720e77130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:46.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.019+0000 7f9841e00640 1 --2- 172.21.15.42:0/2469003781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c720a946b0 0x55c720e77130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.019+0000 7f9841e00640 1 -- 172.21.15.42:0/2469003781 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c720b95ad0 con 0x55c720a8c4d0 2024-09-17T01:34:46.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.019+0000 7f983be00640 1 --2- 172.21.15.42:0/2469003781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c720a946b0 0x55c720e77130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:34:46.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.019+0000 7f9841e00640 1 --2- 172.21.15.42:0/2469003781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a8c4d0 0x55c720ea15e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9834005eb0 tx=0x7f98340047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71c8639e6f1335f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:46.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.019+0000 7f9832000640 1 -- 172.21.15.42:0/2469003781 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983404a900 con 0x55c720a8c4d0 2024-09-17T01:34:46.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.019+0000 7f9832000640 1 -- 172.21.15.42:0/2469003781 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9834060030 con 0x55c720a8c4d0 2024-09-17T01:34:46.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.019+0000 7f9832000640 1 -- 172.21.15.42:0/2469003781 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983404add0 con 0x55c720a8c4d0 2024-09-17T01:34:46.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.020+0000 7f98501cd740 1 -- 172.21.15.42:0/2469003781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a8c4d0 msgr2=0x55c720ea15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:46.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.020+0000 7f98501cd740 1 --2- 172.21.15.42:0/2469003781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a8c4d0 0x55c720ea15e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9834005eb0 tx=0x7f98340047a0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.020+0000 7f98501cd740 1 -- 172.21.15.42:0/2469003781 shutdown_connections 2024-09-17T01:34:46.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.020+0000 7f98501cd740 1 --2- 172.21.15.42:0/2469003781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c720a946b0 0x55c720e77130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.020+0000 7f98501cd740 1 --2- 172.21.15.42:0/2469003781 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c720ab5390 0x55c720e57ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.020+0000 7f98501cd740 1 --2- 172.21.15.42:0/2469003781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a8c4d0 0x55c720ea15e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.020+0000 7f98501cd740 1 -- 172.21.15.42:0/2469003781 >> 172.21.15.42:0/2469003781 conn(0x55c720aa94e0 msgr2=0x55c720ea5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:46.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.020+0000 7f98501cd740 1 -- 172.21.15.42:0/2469003781 shutdown_connections 2024-09-17T01:34:46.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.020+0000 7f98501cd740 1 -- 172.21.15.42:0/2469003781 wait complete. 2024-09-17T01:34:46.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.021+0000 7f98501cd740 1 -- start start 2024-09-17T01:34:46.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.021+0000 7f98501cd740 1 Processor -- start 2024-09-17T01:34:46.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.023+0000 7f98501cd740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c720a8c4d0 0x55c720f20e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:46.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.023+0000 7f98501cd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a946b0 0x55c720eba4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:46.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.023+0000 7f98501cd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c720ab5390 0x55c720e56cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:46.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.023+0000 7f98501cd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c720e5e4c0 con 0x55c720a946b0 2024-09-17T01:34:46.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.023+0000 7f98501cd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9844141e50 con 0x55c720ab5390 2024-09-17T01:34:46.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.023+0000 7f98501cd740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55c720ec4e40 con 0x55c720a8c4d0 2024-09-17T01:34:46.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.023+0000 7f98501cd740 10 client.0 _ll_register_callbacks cb 0x7f9828003880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:34:46.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.023+0000 7f983be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a946b0 0x55c720eba4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:46.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.023+0000 7f983be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a946b0 0x55c720eba4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55868/0 (socket says 172.21.15.42:55868) 2024-09-17T01:34:46.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.023+0000 7f983be00640 1 -- 172.21.15.42:0/1857113259 learned_addr learned my addr 172.21.15.42:0/1857113259 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:46.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.023+0000 7f9841e00640 1 --2- 172.21.15.42:0/1857113259 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c720a8c4d0 0x55c720f20e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:46.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.023+0000 7f9842800640 1 --2- 172.21.15.42:0/1857113259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c720ab5390 0x55c720e56cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:46.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.024+0000 7f983be00640 1 -- 172.21.15.42:0/1857113259 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c720a8c4d0 msgr2=0x55c720f20e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:46.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.024+0000 7f983be00640 1 --2- 172.21.15.42:0/1857113259 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c720a8c4d0 0x55c720f20e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.024+0000 7f983be00640 1 -- 172.21.15.42:0/1857113259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c720ab5390 msgr2=0x55c720e56cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:34:46.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.024+0000 7f983be00640 1 --2- 172.21.15.42:0/1857113259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c720ab5390 0x55c720e56cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.024+0000 7f983be00640 1 -- 172.21.15.42:0/1857113259 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c720e592c0 con 0x55c720a946b0 2024-09-17T01:34:46.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.024+0000 7f983be00640 1 --2- 172.21.15.42:0/1857113259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a946b0 0x55c720eba4e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f982c0622b0 tx=0x7f982c098be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c653d66a3b0ea8f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:46.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.024+0000 7f9827400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:34:46.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.024+0000 7f9827400640 1 -- 172.21.15.42:0/1857113259 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c05ec00 con 0x55c720a946b0 2024-09-17T01:34:46.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.024+0000 7f9827400640 1 -- 172.21.15.42:0/1857113259 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7f982c004d30 con 0x55c720a946b0 2024-09-17T01:34:46.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.024+0000 7f98501cd740 1 -- 172.21.15.42:0/1857113259 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9834060030 con 0x55c720a946b0 2024-09-17T01:34:46.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.024+0000 7f9827400640 1 -- 172.21.15.42:0/1857113259 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f982c06bf40 con 0x55c720a946b0 2024-09-17T01:34:46.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.024+0000 7f98501cd740 10 client.5124 fetch_fsmap learned FSMap version 18 2024-09-17T01:34:46.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.024+0000 7f98501cd740 1 -- 172.21.15.42:0/1857113259 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55c720ec4b80 con 0x55c720a946b0 2024-09-17T01:34:46.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.025+0000 7f9827400640 1 -- 172.21.15.42:0/1857113259 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9834060030 con 0x55c720a946b0 2024-09-17T01:34:46.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.025+0000 7f9827400640 1 -- 172.21.15.42:0/1857113259 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f982c061810 con 0x55c720a946b0 2024-09-17T01:34:46.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.025+0000 7f98501cd740 10 client.5124 fetch_fsmap finished waiting for FSMap version 18 2024-09-17T01:34:46.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.025+0000 7f98501cd740 10 client.5124 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-17T01:34:46.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.025+0000 7f98501cd740 20 client.5124 populate_metadata read hostname 'smithi042' 2024-09-17T01:34:46.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.025+0000 7f98501cd740 1 --2- 172.21.15.42:0/1857113259 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x55c720ebadc0 0x55c720e57210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:46.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.025+0000 7f98501cd740 4 client.5124 mds_command: new command op to 4830 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-17T01:34:46.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.025+0000 7f98501cd740 1 -- 172.21.15.42:0/1857113259 --> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] -- command(tid 0: {"prefix": "perf dump"}) -- 0x55c720dcd3f0 con 0x55c720ebadc0 2024-09-17T01:34:46.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.025+0000 7f9841e00640 1 --2- 172.21.15.42:0/1857113259 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x55c720ebadc0 0x55c720e57210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:46.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.026+0000 7f9841e00640 1 --2- 172.21.15.42:0/1857113259 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x55c720ebadc0 0x55c720e57210 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9ed8fc32f401974 server_cookie=39d027ffbaa44e9a in_seq=0 out_seq=0 2024-09-17T01:34:46.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.026+0000 7f9827400640 10 client.5124 ms_handle_connect on v2:172.21.15.42:6834/3278817895 2024-09-17T01:34:46.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.026+0000 7f9827400640 1 -- 172.21.15.42:0/1857113259 <== mds.0 v2:172.21.15.42:6834/3278817895 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18097 (crc 0 0 0) 0x55c720dcd3f0 con 0x55c720ebadc0 2024-09-17T01:34:46.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.026+0000 7f9827400640 10 client.5124 handle_command_reply: tid=0 2024-09-17T01:34:46.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.026+0000 7f98501cd740 1 client.5124 shutdown 2024-09-17T01:34:46.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.026+0000 7f98501cd740 1 -- 172.21.15.42:0/1857113259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a946b0 msgr2=0x55c720eba4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:46.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.026+0000 7f98501cd740 1 --2- 172.21.15.42:0/1857113259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a946b0 0x55c720eba4e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f982c0622b0 tx=0x7f982c098be0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.027+0000 7f98501cd740 1 -- 172.21.15.42:0/1857113259 shutdown_connections 2024-09-17T01:34:46.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.027+0000 7f98501cd740 1 --2- 172.21.15.42:0/1857113259 >> [v2:172.21.15.42:6834/3278817895,v1:172.21.15.42:6835/3278817895] conn(0x55c720ebadc0 0x55c720e57210 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.027+0000 7f98501cd740 1 --2- 172.21.15.42:0/1857113259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c720ab5390 0x55c720e56cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.027+0000 7f98501cd740 1 --2- 172.21.15.42:0/1857113259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c720a946b0 0x55c720eba4e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.027+0000 7f98501cd740 1 --2- 172.21.15.42:0/1857113259 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c720a8c4d0 0x55c720f20e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.027+0000 7f9827400640 0 client.5124 ms_handle_reset on v2:172.21.15.42:6834/3278817895 2024-09-17T01:34:46.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.027+0000 7f98501cd740 1 -- 172.21.15.42:0/1857113259 >> 172.21.15.42:0/1857113259 conn(0x55c720aa94e0 msgr2=0x55c720ea4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:46.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.027+0000 7f98501cd740 1 -- 172.21.15.42:0/1857113259 shutdown_connections 2024-09-17T01:34:46.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.027+0000 7f98501cd740 1 -- 172.21.15.42:0/1857113259 wait complete. 2024-09-17T01:34:46.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.027+0000 7f98501cd740 20 client.5124 trim_cache size 0 max 16384 2024-09-17T01:34:46.029 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:34:46.029 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-0": { 2024-09-17T01:34:46.029 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 29137, 2024-09-17T01:34:46.029 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 51286, 2024-09-17T01:34:46.029 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 10000454, 2024-09-17T01:34:46.029 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 51355236, 2024-09-17T01:34:46.029 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 19, 2024-09-17T01:34:46.030 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 6, 2024-09-17T01:34:46.030 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 4.592199823, 2024-09-17T01:34:46.030 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 3.436397379, 2024-09-17T01:34:46.030 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 2.400762559, 2024-09-17T01:34:46.030 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.087989276, 2024-09-17T01:34:46.030 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T01:34:46.030 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 51285, 2024-09-17T01:34:46.030 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 2.075307315, 2024-09-17T01:34:46.030 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000040466 2024-09-17T01:34:46.030 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.030 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-17T01:34:46.030 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 46757, 2024-09-17T01:34:46.030 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.011089511, 2024-09-17T01:34:46.031 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000237 2024-09-17T01:34:46.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.031 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-17T01:34:46.031 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 0 2024-09-17T01:34:46.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.031 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-1": { 2024-09-17T01:34:46.031 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 3461, 2024-09-17T01:34:46.031 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 3453, 2024-09-17T01:34:46.031 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 1358183, 2024-09-17T01:34:46.031 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 41190134, 2024-09-17T01:34:46.031 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 5, 2024-09-17T01:34:46.031 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 4, 2024-09-17T01:34:46.032 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.575953958, 2024-09-17T01:34:46.032 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.342446020, 2024-09-17T01:34:46.032 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.095773651, 2024-09-17T01:34:46.032 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.113760130, 2024-09-17T01:34:46.032 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T01:34:46.032 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 3453, 2024-09-17T01:34:46.032 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.979984481, 2024-09-17T01:34:46.032 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000283806 2024-09-17T01:34:46.032 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.032 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-17T01:34:46.032 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:46.032 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:46.032 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:46.033 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.033 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 137744, 2024-09-17T01:34:46.033 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 29904 2024-09-17T01:34:46.033 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.033 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-2": { 2024-09-17T01:34:46.033 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 2403, 2024-09-17T01:34:46.033 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 2429, 2024-09-17T01:34:46.033 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 610718, 2024-09-17T01:34:46.033 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 14772727, 2024-09-17T01:34:46.033 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 6, 2024-09-17T01:34:46.033 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 4, 2024-09-17T01:34:46.033 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.358709496, 2024-09-17T01:34:46.033 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.195044703, 2024-09-17T01:34:46.034 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.063719663, 2024-09-17T01:34:46.034 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.080904490, 2024-09-17T01:34:46.034 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T01:34:46.034 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2427, 2024-09-17T01:34:46.034 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.714569737, 2024-09-17T01:34:46.034 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000294425 2024-09-17T01:34:46.034 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.034 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-17T01:34:46.034 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:46.034 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:46.034 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:46.034 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.034 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-17T01:34:46.034 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 96864 2024-09-17T01:34:46.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.035 INFO:teuthology.orchestra.run.smithi042.stdout: "cct": { 2024-09-17T01:34:46.035 INFO:teuthology.orchestra.run.smithi042.stdout: "total_workers": 1, 2024-09-17T01:34:46.035 INFO:teuthology.orchestra.run.smithi042.stdout: "unhealthy_workers": 0 2024-09-17T01:34:46.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.035 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-MDSRank": { 2024-09-17T01:34:46.035 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2024-09-17T01:34:46.035 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2024-09-17T01:34:46.035 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1822, 2024-09-17T01:34:46.035 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 19.511541044, 2024-09-17T01:34:46.035 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.010708858 2024-09-17T01:34:46.035 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:34:46.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.035 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-PurgeQueue": { 2024-09-17T01:34:46.036 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2024-09-17T01:34:46.036 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2024-09-17T01:34:46.036 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 3254, 2024-09-17T01:34:46.036 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 1.411855064, 2024-09-17T01:34:46.036 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000433882 2024-09-17T01:34:46.036 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:34:46.036 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.036 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": { 2024-09-17T01:34:46.036 INFO:teuthology.orchestra.run.smithi042.stdout: "request": 25529, 2024-09-17T01:34:46.036 INFO:teuthology.orchestra.run.smithi042.stdout: "reply": 25529, 2024-09-17T01:34:46.036 INFO:teuthology.orchestra.run.smithi042.stdout: "reply_latency": { 2024-09-17T01:34:46.036 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 25529, 2024-09-17T01:34:46.036 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 466.893702714, 2024-09-17T01:34:46.036 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.018288757 2024-09-17T01:34:46.037 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.037 INFO:teuthology.orchestra.run.smithi042.stdout: "slow_reply": 0, 2024-09-17T01:34:46.037 INFO:teuthology.orchestra.run.smithi042.stdout: "forward": 0, 2024-09-17T01:34:46.037 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch_complete": 0, 2024-09-17T01:34:46.037 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch_keys": 0, 2024-09-17T01:34:46.037 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_commit": 12, 2024-09-17T01:34:46.037 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_split": 0, 2024-09-17T01:34:46.037 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_merge": 0, 2024-09-17T01:34:46.037 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes": 17894, 2024-09-17T01:34:46.037 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_top": 0, 2024-09-17T01:34:46.037 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_bottom": 17894, 2024-09-17T01:34:46.037 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pin_tail": 0, 2024-09-17T01:34:46.037 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pinned": 17893, 2024-09-17T01:34:46.037 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_expired": 0, 2024-09-17T01:34:46.038 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_with_caps": 2, 2024-09-17T01:34:46.038 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": 2, 2024-09-17T01:34:46.038 INFO:teuthology.orchestra.run.smithi042.stdout: "subtrees": 2, 2024-09-17T01:34:46.038 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse": 48061, 2024-09-17T01:34:46.038 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_hit": 47504, 2024-09-17T01:34:46.038 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_forward": 0, 2024-09-17T01:34:46.038 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_discover": 0, 2024-09-17T01:34:46.038 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_dir_fetch": 0, 2024-09-17T01:34:46.038 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_remote_ino": 0, 2024-09-17T01:34:46.038 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_lock": 112, 2024-09-17T01:34:46.038 INFO:teuthology.orchestra.run.smithi042.stdout: "load_cent": 0, 2024-09-17T01:34:46.038 INFO:teuthology.orchestra.run.smithi042.stdout: "q": 0, 2024-09-17T01:34:46.038 INFO:teuthology.orchestra.run.smithi042.stdout: "exported": 0, 2024-09-17T01:34:46.038 INFO:teuthology.orchestra.run.smithi042.stdout: "exported_inodes": 0, 2024-09-17T01:34:46.039 INFO:teuthology.orchestra.run.smithi042.stdout: "imported": 0, 2024-09-17T01:34:46.039 INFO:teuthology.orchestra.run.smithi042.stdout: "imported_inodes": 0, 2024-09-17T01:34:46.039 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_dir_fetch": 0, 2024-09-17T01:34:46.039 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_backtrace_fetch": 1679, 2024-09-17T01:34:46.039 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_peer_discover": 0, 2024-09-17T01:34:46.039 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rfiles": 0, 2024-09-17T01:34:46.039 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rbytes": 0, 2024-09-17T01:34:46.039 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rsnaps": 0, 2024-09-17T01:34:46.039 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_backtrace_fetch": 1679, 2024-09-17T01:34:46.039 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_set_tag": 0, 2024-09-17T01:34:46.039 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_backtrace_repaired": 0, 2024-09-17T01:34:46.039 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_inotable_repaired": 0, 2024-09-17T01:34:46.039 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dir_inodes": 13, 2024-09-17T01:34:46.039 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dir_base_inodes": 2, 2024-09-17T01:34:46.040 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dirfrag_rstats": 11, 2024-09-17T01:34:46.040 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_file_inodes": 1666, 2024-09-17T01:34:46.040 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_inode_file_caps": 0, 2024-09-17T01:34:46.040 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_revoke": 819, 2024-09-17T01:34:46.040 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_grant": 4023, 2024-09-17T01:34:46.040 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_trunc": 0, 2024-09-17T01:34:46.040 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-17T01:34:46.040 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-17T01:34:46.040 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_caps": 3186, 2024-09-17T01:34:46.040 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_caps_dirty": 2700, 2024-09-17T01:34:46.040 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_cap_release": 115, 2024-09-17T01:34:46.040 INFO:teuthology.orchestra.run.smithi042.stdout: "process_request_cap_release": 14069 2024-09-17T01:34:46.040 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.040 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache": { 2024-09-17T01:34:46.041 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_update": 0, 2024-09-17T01:34:46.041 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_update_receipt": 0, 2024-09-17T01:34:46.041 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_try_discover": 0, 2024-09-17T01:34:46.041 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_send_discover": 0, 2024-09-17T01:34:46.041 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_handle_discover": 0, 2024-09-17T01:34:46.041 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays": 0, 2024-09-17T01:34:46.041 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_delayed": 0, 2024-09-17T01:34:46.041 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_enqueuing": 0, 2024-09-17T01:34:46.041 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_created": 4157, 2024-09-17T01:34:46.041 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_enqueued": 3596, 2024-09-17T01:34:46.041 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_reintegrated": 2215, 2024-09-17T01:34:46.041 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_migrated": 0, 2024-09-17T01:34:46.041 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_processing": 0, 2024-09-17T01:34:46.041 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_enqueued": 0, 2024-09-17T01:34:46.042 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_prioritized": 0, 2024-09-17T01:34:46.042 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_started": 0, 2024-09-17T01:34:46.042 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_completed": 0, 2024-09-17T01:34:46.042 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_quiesce_path": 0, 2024-09-17T01:34:46.042 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_quiesce_inode": 0, 2024-09-17T01:34:46.042 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_enqueue_scrub": 1, 2024-09-17T01:34:46.042 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_exportdir": 0, 2024-09-17T01:34:46.042 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_flush": 0, 2024-09-17T01:34:46.042 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragmentdir": 0, 2024-09-17T01:34:46.042 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragstats": 0, 2024-09-17T01:34:46.042 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_inodestats": 0, 2024-09-17T01:34:46.042 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:34:46.042 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_succeeded": 0, 2024-09-17T01:34:46.042 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_write_failed": 0 2024-09-17T01:34:46.043 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.043 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log": { 2024-09-17T01:34:46.043 INFO:teuthology.orchestra.run.smithi042.stdout: "evlrg": 0, 2024-09-17T01:34:46.043 INFO:teuthology.orchestra.run.smithi042.stdout: "evadd": 25739, 2024-09-17T01:34:46.043 INFO:teuthology.orchestra.run.smithi042.stdout: "evex": 0, 2024-09-17T01:34:46.043 INFO:teuthology.orchestra.run.smithi042.stdout: "evtrm": 0, 2024-09-17T01:34:46.043 INFO:teuthology.orchestra.run.smithi042.stdout: "ev": 25739, 2024-09-17T01:34:46.043 INFO:teuthology.orchestra.run.smithi042.stdout: "evexg": 0, 2024-09-17T01:34:46.043 INFO:teuthology.orchestra.run.smithi042.stdout: "evexd": 0, 2024-09-17T01:34:46.043 INFO:teuthology.orchestra.run.smithi042.stdout: "segadd": 35, 2024-09-17T01:34:46.043 INFO:teuthology.orchestra.run.smithi042.stdout: "segex": 0, 2024-09-17T01:34:46.043 INFO:teuthology.orchestra.run.smithi042.stdout: "segtrm": 0, 2024-09-17T01:34:46.043 INFO:teuthology.orchestra.run.smithi042.stdout: "seg": 35, 2024-09-17T01:34:46.043 INFO:teuthology.orchestra.run.smithi042.stdout: "segmjr": 4, 2024-09-17T01:34:46.043 INFO:teuthology.orchestra.run.smithi042.stdout: "segexg": 0, 2024-09-17T01:34:46.044 INFO:teuthology.orchestra.run.smithi042.stdout: "segexd": 0, 2024-09-17T01:34:46.044 INFO:teuthology.orchestra.run.smithi042.stdout: "expos": 4194304, 2024-09-17T01:34:46.044 INFO:teuthology.orchestra.run.smithi042.stdout: "wrpos": 95571352, 2024-09-17T01:34:46.044 INFO:teuthology.orchestra.run.smithi042.stdout: "rdpos": 0, 2024-09-17T01:34:46.044 INFO:teuthology.orchestra.run.smithi042.stdout: "jlat": { 2024-09-17T01:34:46.044 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2595, 2024-09-17T01:34:46.044 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 117.536394248, 2024-09-17T01:34:46.044 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.045293408 2024-09-17T01:34:46.044 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.044 INFO:teuthology.orchestra.run.smithi042.stdout: "replayed": 0 2024-09-17T01:34:46.044 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.044 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_mem": { 2024-09-17T01:34:46.044 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 14, 2024-09-17T01:34:46.044 INFO:teuthology.orchestra.run.smithi042.stdout: "ino+": 2016, 2024-09-17T01:34:46.044 INFO:teuthology.orchestra.run.smithi042.stdout: "ino-": 2002, 2024-09-17T01:34:46.045 INFO:teuthology.orchestra.run.smithi042.stdout: "dir": 13, 2024-09-17T01:34:46.045 INFO:teuthology.orchestra.run.smithi042.stdout: "dir+": 13, 2024-09-17T01:34:46.045 INFO:teuthology.orchestra.run.smithi042.stdout: "dir-": 0, 2024-09-17T01:34:46.045 INFO:teuthology.orchestra.run.smithi042.stdout: "dn": 17894, 2024-09-17T01:34:46.045 INFO:teuthology.orchestra.run.smithi042.stdout: "dn+": 19895, 2024-09-17T01:34:46.045 INFO:teuthology.orchestra.run.smithi042.stdout: "dn-": 2001, 2024-09-17T01:34:46.045 INFO:teuthology.orchestra.run.smithi042.stdout: "cap": 2, 2024-09-17T01:34:46.045 INFO:teuthology.orchestra.run.smithi042.stdout: "cap+": 8656, 2024-09-17T01:34:46.045 INFO:teuthology.orchestra.run.smithi042.stdout: "cap-": 8654, 2024-09-17T01:34:46.045 INFO:teuthology.orchestra.run.smithi042.stdout: "rss": 166368, 2024-09-17T01:34:46.045 INFO:teuthology.orchestra.run.smithi042.stdout: "heap": 408907776 2024-09-17T01:34:46.045 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.045 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_server": { 2024-09-17T01:34:46.045 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_client_request": 28474, 2024-09-17T01:34:46.045 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_server_request": 0, 2024-09-17T01:34:46.046 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_request": 25529, 2024-09-17T01:34:46.046 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_session": 6, 2024-09-17T01:34:46.046 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_peer_request": 0, 2024-09-17T01:34:46.046 INFO:teuthology.orchestra.run.smithi042.stdout: "req_create_latency": { 2024-09-17T01:34:46.046 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2000, 2024-09-17T01:34:46.046 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 1.735448118, 2024-09-17T01:34:46.046 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000867724 2024-09-17T01:34:46.046 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.046 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getattr_latency": { 2024-09-17T01:34:46.046 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 30, 2024-09-17T01:34:46.046 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.004667425, 2024-09-17T01:34:46.046 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000155580 2024-09-17T01:34:46.046 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.046 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getfilelock_latency": { 2024-09-17T01:34:46.046 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:46.047 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:46.047 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:46.047 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.047 INFO:teuthology.orchestra.run.smithi042.stdout: "req_link_latency": { 2024-09-17T01:34:46.047 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 6000, 2024-09-17T01:34:46.047 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 7.961918365, 2024-09-17T01:34:46.047 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.001326986 2024-09-17T01:34:46.047 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.047 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookup_latency": { 2024-09-17T01:34:46.047 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 7270, 2024-09-17T01:34:46.047 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 5.959106005, 2024-09-17T01:34:46.047 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000819684 2024-09-17T01:34:46.047 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.048 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookuphash_latency": { 2024-09-17T01:34:46.048 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:46.048 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:46.048 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:46.048 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.048 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupino_latency": { 2024-09-17T01:34:46.048 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:46.048 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:46.048 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:46.048 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.048 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupname_latency": { 2024-09-17T01:34:46.048 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:46.048 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:46.048 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:46.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.049 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupparent_latency": { 2024-09-17T01:34:46.049 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:46.049 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:46.049 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:46.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.049 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupsnap_latency": { 2024-09-17T01:34:46.049 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-17T01:34:46.049 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000377436, 2024-09-17T01:34:46.049 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000377436 2024-09-17T01:34:46.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.050 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lssnap_latency": { 2024-09-17T01:34:46.050 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:46.050 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:46.050 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:46.050 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.050 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mkdir_latency": { 2024-09-17T01:34:46.050 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-17T01:34:46.050 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.003953364, 2024-09-17T01:34:46.050 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.003953364 2024-09-17T01:34:46.050 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.050 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mknod_latency": { 2024-09-17T01:34:46.050 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:46.050 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:46.050 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mksnap_latency": { 2024-09-17T01:34:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-17T01:34:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.268330357, 2024-09-17T01:34:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.268330357 2024-09-17T01:34:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: "req_open_latency": { 2024-09-17T01:34:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-17T01:34:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000095744, 2024-09-17T01:34:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000095744 2024-09-17T01:34:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: "req_readdir_latency": { 2024-09-17T01:34:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 8, 2024-09-17T01:34:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.842030721, 2024-09-17T01:34:46.051 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.105253840 2024-09-17T01:34:46.052 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.052 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rename_latency": { 2024-09-17T01:34:46.052 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2215, 2024-09-17T01:34:46.052 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 429.630943931, 2024-09-17T01:34:46.052 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.193964308 2024-09-17T01:34:46.052 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.052 INFO:teuthology.orchestra.run.smithi042.stdout: "req_renamesnap_latency": { 2024-09-17T01:34:46.052 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:46.052 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:46.052 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:46.052 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.052 INFO:teuthology.orchestra.run.smithi042.stdout: "req_snapdiff_latency": { 2024-09-17T01:34:46.053 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:46.053 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:46.053 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:46.053 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.053 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmdir_latency": { 2024-09-17T01:34:46.053 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:46.053 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:46.053 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:46.053 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.053 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmsnap_latency": { 2024-09-17T01:34:46.053 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-17T01:34:46.053 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.005133621, 2024-09-17T01:34:46.053 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.005133621 2024-09-17T01:34:46.054 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.054 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmxattr_latency": { 2024-09-17T01:34:46.054 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:46.054 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:46.054 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:46.054 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.054 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setattr_latency": { 2024-09-17T01:34:46.054 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-17T01:34:46.054 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000349170, 2024-09-17T01:34:46.054 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000349170 2024-09-17T01:34:46.054 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.054 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setdirlayout_latency": { 2024-09-17T01:34:46.054 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:46.055 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:46.055 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:46.055 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.055 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setfilelock_latency": { 2024-09-17T01:34:46.055 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:46.055 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:46.055 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:46.055 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.055 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setlayout_latency": { 2024-09-17T01:34:46.055 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:46.055 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:46.055 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:46.055 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.055 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setxattr_latency": { 2024-09-17T01:34:46.056 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:46.056 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:46.056 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:46.056 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.056 INFO:teuthology.orchestra.run.smithi042.stdout: "req_symlink_latency": { 2024-09-17T01:34:46.056 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:46.056 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:46.056 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:46.056 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.056 INFO:teuthology.orchestra.run.smithi042.stdout: "req_unlink_latency": { 2024-09-17T01:34:46.056 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 8000, 2024-09-17T01:34:46.056 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 20.481348457, 2024-09-17T01:34:46.056 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.002560168 2024-09-17T01:34:46.056 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.057 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_revoke_eviction": 0, 2024-09-17T01:34:46.057 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_acquisition_throttle": 0, 2024-09-17T01:34:46.057 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getvxattr_latency": { 2024-09-17T01:34:46.057 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:46.057 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:46.057 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:46.057 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:34:46.060 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.060 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_sessions": { 2024-09-17T01:34:46.060 INFO:teuthology.orchestra.run.smithi042.stdout: "session_count": 1, 2024-09-17T01:34:46.060 INFO:teuthology.orchestra.run.smithi042.stdout: "session_add": 1, 2024-09-17T01:34:46.060 INFO:teuthology.orchestra.run.smithi042.stdout: "session_remove": 0, 2024-09-17T01:34:46.060 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_open": 1, 2024-09-17T01:34:46.060 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_stale": 0, 2024-09-17T01:34:46.060 INFO:teuthology.orchestra.run.smithi042.stdout: "total_load": 17622, 2024-09-17T01:34:46.060 INFO:teuthology.orchestra.run.smithi042.stdout: "average_load": 17622, 2024-09-17T01:34:46.060 INFO:teuthology.orchestra.run.smithi042.stdout: "avg_session_uptime": 94, 2024-09-17T01:34:46.060 INFO:teuthology.orchestra.run.smithi042.stdout: "mdthresh_evicted": 0 2024-09-17T01:34:46.060 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.061 INFO:teuthology.orchestra.run.smithi042.stdout: "mempool": { 2024-09-17T01:34:46.061 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_bytes": 0, 2024-09-17T01:34:46.061 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_items": 0, 2024-09-17T01:34:46.061 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_bytes": 0, 2024-09-17T01:34:46.061 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_items": 0, 2024-09-17T01:34:46.061 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_bytes": 0, 2024-09-17T01:34:46.061 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_items": 0, 2024-09-17T01:34:46.061 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-17T01:34:46.061 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_items": 0, 2024-09-17T01:34:46.061 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-17T01:34:46.061 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_items": 0, 2024-09-17T01:34:46.061 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_bytes": 0, 2024-09-17T01:34:46.062 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_items": 0, 2024-09-17T01:34:46.062 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-17T01:34:46.062 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_items": 0, 2024-09-17T01:34:46.062 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_bytes": 0, 2024-09-17T01:34:46.062 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_items": 0, 2024-09-17T01:34:46.062 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_bytes": 0, 2024-09-17T01:34:46.062 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_items": 0, 2024-09-17T01:34:46.062 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-17T01:34:46.062 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_items": 0, 2024-09-17T01:34:46.062 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-17T01:34:46.062 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_items": 0, 2024-09-17T01:34:46.062 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_bytes": 0, 2024-09-17T01:34:46.062 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_items": 0, 2024-09-17T01:34:46.062 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_bytes": 0, 2024-09-17T01:34:46.063 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_items": 0, 2024-09-17T01:34:46.063 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-17T01:34:46.063 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_items": 0, 2024-09-17T01:34:46.063 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_bytes": 0, 2024-09-17T01:34:46.063 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_items": 0, 2024-09-17T01:34:46.063 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_bytes": 0, 2024-09-17T01:34:46.063 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_items": 0, 2024-09-17T01:34:46.063 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_bytes": 0, 2024-09-17T01:34:46.063 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_items": 0, 2024-09-17T01:34:46.063 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_bytes": 0, 2024-09-17T01:34:46.063 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_items": 0, 2024-09-17T01:34:46.063 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_bytes": 250873, 2024-09-17T01:34:46.064 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_items": 92, 2024-09-17T01:34:46.064 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_bytes": 440, 2024-09-17T01:34:46.064 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_items": 5, 2024-09-17T01:34:46.064 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bytes": 0, 2024-09-17T01:34:46.064 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_items": 0, 2024-09-17T01:34:46.064 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_bytes": 0, 2024-09-17T01:34:46.064 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_items": 0, 2024-09-17T01:34:46.064 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_bytes": 0, 2024-09-17T01:34:46.064 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_items": 0, 2024-09-17T01:34:46.064 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_bytes": 5800, 2024-09-17T01:34:46.064 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_items": 85, 2024-09-17T01:34:46.064 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_bytes": 0, 2024-09-17T01:34:46.064 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_items": 0, 2024-09-17T01:34:46.065 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_bytes": 0, 2024-09-17T01:34:46.065 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_items": 0, 2024-09-17T01:34:46.065 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_bytes": 13049365, 2024-09-17T01:34:46.065 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_items": 661644, 2024-09-17T01:34:46.065 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_bytes": 0, 2024-09-17T01:34:46.065 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_items": 0, 2024-09-17T01:34:46.065 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_bytes": 0, 2024-09-17T01:34:46.065 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_items": 0 2024-09-17T01:34:46.065 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.065 INFO:teuthology.orchestra.run.smithi042.stdout: "objecter": { 2024-09-17T01:34:46.065 INFO:teuthology.orchestra.run.smithi042.stdout: "op_active": 0, 2024-09-17T01:34:46.065 INFO:teuthology.orchestra.run.smithi042.stdout: "op_laggy": 0, 2024-09-17T01:34:46.065 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send": 8171, 2024-09-17T01:34:46.066 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send_bytes": 92038244, 2024-09-17T01:34:46.066 INFO:teuthology.orchestra.run.smithi042.stdout: "op_resend": 37, 2024-09-17T01:34:46.066 INFO:teuthology.orchestra.run.smithi042.stdout: "op_reply": 8171, 2024-09-17T01:34:46.066 INFO:teuthology.orchestra.run.smithi042.stdout: "op_latency": { 2024-09-17T01:34:46.066 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 8171, 2024-09-17T01:34:46.066 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 37.315695386, 2024-09-17T01:34:46.066 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.004566845 2024-09-17T01:34:46.066 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.066 INFO:teuthology.orchestra.run.smithi042.stdout: "op_inflight": 0, 2024-09-17T01:34:46.066 INFO:teuthology.orchestra.run.smithi042.stdout: "oplen_avg": { 2024-09-17T01:34:46.066 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 8171, 2024-09-17T01:34:46.066 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 8286 2024-09-17T01:34:46.066 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.067 INFO:teuthology.orchestra.run.smithi042.stdout: "op": 8171, 2024-09-17T01:34:46.067 INFO:teuthology.orchestra.run.smithi042.stdout: "op_r": 1749, 2024-09-17T01:34:46.067 INFO:teuthology.orchestra.run.smithi042.stdout: "op_w": 6422, 2024-09-17T01:34:46.067 INFO:teuthology.orchestra.run.smithi042.stdout: "op_rmw": 0, 2024-09-17T01:34:46.067 INFO:teuthology.orchestra.run.smithi042.stdout: "op_pg": 0, 2024-09-17T01:34:46.067 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_stat": 0, 2024-09-17T01:34:46.067 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_create": 11, 2024-09-17T01:34:46.067 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_read": 68, 2024-09-17T01:34:46.067 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_write": 2661, 2024-09-17T01:34:46.067 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writefull": 40, 2024-09-17T01:34:46.067 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writesame": 0, 2024-09-17T01:34:46.067 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_append": 0, 2024-09-17T01:34:46.067 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_zero": 1596, 2024-09-17T01:34:46.067 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_truncate": 0, 2024-09-17T01:34:46.068 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_delete": 2033, 2024-09-17T01:34:46.068 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_mapext": 0, 2024-09-17T01:34:46.068 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_sparse_read": 0, 2024-09-17T01:34:46.068 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_clonerange": 0, 2024-09-17T01:34:46.068 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_getxattr": 1681, 2024-09-17T01:34:46.068 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_setxattr": 22, 2024-09-17T01:34:46.068 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_cmpxattr": 0, 2024-09-17T01:34:46.068 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_rmxattr": 0, 2024-09-17T01:34:46.068 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_resetxattrs": 0, 2024-09-17T01:34:46.068 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_call": 0, 2024-09-17T01:34:46.068 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_watch": 0, 2024-09-17T01:34:46.068 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_notify": 0, 2024-09-17T01:34:46.068 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_src_cmpxattr": 0, 2024-09-17T01:34:46.069 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls": 0, 2024-09-17T01:34:46.069 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls_filter": 0, 2024-09-17T01:34:46.069 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_other": 0, 2024-09-17T01:34:46.069 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_active": 0, 2024-09-17T01:34:46.069 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_send": 0, 2024-09-17T01:34:46.069 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_resend": 0, 2024-09-17T01:34:46.069 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_ping": 0, 2024-09-17T01:34:46.069 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_active": 0, 2024-09-17T01:34:46.069 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_send": 0, 2024-09-17T01:34:46.069 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_resend": 0, 2024-09-17T01:34:46.069 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_active": 0, 2024-09-17T01:34:46.069 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_send": 0, 2024-09-17T01:34:46.069 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_resend": 0, 2024-09-17T01:34:46.069 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_active": 0, 2024-09-17T01:34:46.070 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_send": 0, 2024-09-17T01:34:46.070 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_resend": 0, 2024-09-17T01:34:46.070 INFO:teuthology.orchestra.run.smithi042.stdout: "command_active": 0, 2024-09-17T01:34:46.070 INFO:teuthology.orchestra.run.smithi042.stdout: "command_send": 0, 2024-09-17T01:34:46.070 INFO:teuthology.orchestra.run.smithi042.stdout: "command_resend": 0, 2024-09-17T01:34:46.070 INFO:teuthology.orchestra.run.smithi042.stdout: "map_epoch": 37, 2024-09-17T01:34:46.070 INFO:teuthology.orchestra.run.smithi042.stdout: "map_full": 0, 2024-09-17T01:34:46.070 INFO:teuthology.orchestra.run.smithi042.stdout: "map_inc": 5, 2024-09-17T01:34:46.070 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_sessions": 8, 2024-09-17T01:34:46.070 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_open": 8, 2024-09-17T01:34:46.070 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_close": 0, 2024-09-17T01:34:46.070 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_laggy": 0, 2024-09-17T01:34:46.070 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_wr": 140, 2024-09-17T01:34:46.070 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_rd": 0, 2024-09-17T01:34:46.070 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_del": 34 2024-09-17T01:34:46.071 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.071 INFO:teuthology.orchestra.run.smithi042.stdout: "oft": { 2024-09-17T01:34:46.071 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_objs": 1, 2024-09-17T01:34:46.071 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_kv_pairs": 0, 2024-09-17T01:34:46.071 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_updates": 0, 2024-09-17T01:34:46.071 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_removes": 0 2024-09-17T01:34:46.071 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.071 INFO:teuthology.orchestra.run.smithi042.stdout: "purge_queue": { 2024-09-17T01:34:46.071 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops": 0, 2024-09-17T01:34:46.071 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops_high_water": 32, 2024-09-17T01:34:46.071 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing": 0, 2024-09-17T01:34:46.071 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_high_water": 32, 2024-09-17T01:34:46.071 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed_ops": 3596, 2024-09-17T01:34:46.071 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed": 3596, 2024-09-17T01:34:46.071 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_item_in_journal": 0 2024-09-17T01:34:46.072 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.072 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-17T01:34:46.072 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-17T01:34:46.072 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-09-17T01:34:46.072 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-17T01:34:46.072 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 34997, 2024-09-17T01:34:46.072 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 9240917, 2024-09-17T01:34:46.072 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-17T01:34:46.072 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 34997, 2024-09-17T01:34:46.072 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-17T01:34:46.072 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-17T01:34:46.072 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 34997, 2024-09-17T01:34:46.072 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 9240917, 2024-09-17T01:34:46.072 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-17T01:34:46.073 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:46.073 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:46.073 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:46.073 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:34:46.073 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.073 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_bytes": { 2024-09-17T01:34:46.073 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-17T01:34:46.073 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-09-17T01:34:46.073 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-17T01:34:46.073 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-17T01:34:46.073 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-17T01:34:46.073 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-17T01:34:46.073 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-17T01:34:46.074 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 8171, 2024-09-17T01:34:46.074 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 92414208, 2024-09-17T01:34:46.074 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 8171, 2024-09-17T01:34:46.074 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 92414208, 2024-09-17T01:34:46.074 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-17T01:34:46.074 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:46.074 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:46.074 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:46.074 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:34:46.074 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.074 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_ops": { 2024-09-17T01:34:46.074 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-17T01:34:46.074 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 1024, 2024-09-17T01:34:46.074 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-17T01:34:46.074 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-17T01:34:46.075 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-17T01:34:46.075 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-17T01:34:46.075 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-17T01:34:46.075 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 8171, 2024-09-17T01:34:46.075 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 8171, 2024-09-17T01:34:46.075 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 8171, 2024-09-17T01:34:46.075 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 8171, 2024-09-17T01:34:46.075 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-17T01:34:46.075 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:46.075 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:46.075 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:46.075 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:34:46.075 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.075 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle": { 2024-09-17T01:34:46.075 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-17T01:34:46.076 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2024-09-17T01:34:46.076 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-17T01:34:46.076 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 3596, 2024-09-17T01:34:46.076 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 375964, 2024-09-17T01:34:46.076 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-17T01:34:46.076 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 3596, 2024-09-17T01:34:46.076 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-17T01:34:46.076 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-17T01:34:46.076 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 66, 2024-09-17T01:34:46.076 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 375964, 2024-09-17T01:34:46.076 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-17T01:34:46.076 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:46.077 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:46.077 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:46.077 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:34:46.077 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.077 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle-0x5654656f9380": { 2024-09-17T01:34:46.077 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-17T01:34:46.077 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2024-09-17T01:34:46.077 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-17T01:34:46.077 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 25739, 2024-09-17T01:34:46.077 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 91377048, 2024-09-17T01:34:46.077 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-17T01:34:46.077 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 25739, 2024-09-17T01:34:46.077 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-17T01:34:46.078 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-17T01:34:46.078 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 2595, 2024-09-17T01:34:46.078 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 91377048, 2024-09-17T01:34:46.078 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-17T01:34:46.078 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:34:46.078 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:34:46.078 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:34:46.078 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:34:46.078 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:34:46.078 INFO:teuthology.orchestra.run.smithi042.stdout: "trackedop": { 2024-09-17T01:34:46.078 INFO:teuthology.orchestra.run.smithi042.stdout: "slow_ops_count": 0 2024-09-17T01:34:46.078 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:34:46.078 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:34:46.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.027+0000 7f9849000640 1 -- 172.21.15.42:0/4194454254 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9820078b90 msgr2=0x7f982007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:46.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.027+0000 7f9849000640 1 --2- 172.21.15.42:0/4194454254 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9820078b90 0x7f982007b0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9834034000 tx=0x7f9834004730 comp rx=0 tx=0).stop 2024-09-17T01:34:46.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.027+0000 7f9849000640 1 -- 172.21.15.42:0/4194454254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98440cec40 msgr2=0x7f98440ae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:46.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.027+0000 7f9849000640 1 --2- 172.21.15.42:0/4194454254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98440cec40 0x7f98440ae8a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f982c00c460 tx=0x7f982c00c920 comp rx=0 tx=0).stop 2024-09-17T01:34:46.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.028+0000 7f9849000640 1 -- 172.21.15.42:0/4194454254 shutdown_connections 2024-09-17T01:34:46.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.028+0000 7f9849000640 1 --2- 172.21.15.42:0/4194454254 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9820078b90 0x7f982007b0a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.028+0000 7f9849000640 1 --2- 172.21.15.42:0/4194454254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9844142f40 0x7f98440aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.028+0000 7f9849000640 1 --2- 172.21.15.42:0/4194454254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98440cec40 0x7f98440ae8a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.028+0000 7f9849000640 1 --2- 172.21.15.42:0/4194454254 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f98440b3550 0x7f98441f8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.028+0000 7f9849000640 1 -- 172.21.15.42:0/4194454254 >> 172.21.15.42:0/4194454254 conn(0x7f98440b2930 msgr2=0x7f9844167e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:46.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.028+0000 7f9849000640 1 -- 172.21.15.42:0/4194454254 shutdown_connections 2024-09-17T01:34:46.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.028+0000 7f9849000640 1 -- 172.21.15.42:0/4194454254 wait complete. 2024-09-17T01:34:46.081 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:34:46.082 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:34:46.186 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:34:46.282 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:34:46.282 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:34:46.282 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:34:46.283 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:34:46.318 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:34:46.319 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:34:46.394 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T01:34:46.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.665+0000 7fd5afc00640 1 -- 172.21.15.42:0/3161290695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd590003fd0 msgr2=0x7fd590004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:46.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.665+0000 7fd5afc00640 1 --2- 172.21.15.42:0/3161290695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd590003fd0 0x7fd590004800 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd594009b50 tx=0x7fd590005830 comp rx=0 tx=0).stop 2024-09-17T01:34:46.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.665+0000 7fd5adc00640 1 -- 172.21.15.42:0/3161290695 reap_dead start 2024-09-17T01:34:46.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.665+0000 7fd5afc00640 1 -- 172.21.15.42:0/3161290695 shutdown_connections 2024-09-17T01:34:46.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.665+0000 7fd5afc00640 1 -- 172.21.15.42:0/3161290695 >> 172.21.15.42:0/3161290695 conn(0x7fd5a80b2930 msgr2=0x7fd5a806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:46.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.666+0000 7fd5afc00640 1 -- 172.21.15.42:0/3161290695 shutdown_connections 2024-09-17T01:34:46.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.666+0000 7fd5afc00640 1 -- 172.21.15.42:0/3161290695 wait complete. 2024-09-17T01:34:46.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.668+0000 7fd5afc00640 1 Processor -- start 2024-09-17T01:34:46.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.668+0000 7fd5afc00640 1 -- start start 2024-09-17T01:34:46.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.669+0000 7fd5afc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd590003fd0 0x7fd5a8156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:46.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.669+0000 7fd5afc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5a8157210 0x7fd5a81566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:46.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.669+0000 7fd5afc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5a814c900 0x7fd5a8159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:46.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.669+0000 7fd5afc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a815f680 con 0x7fd5a8157210 2024-09-17T01:34:46.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.669+0000 7fd5afc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a8070740 con 0x7fd5a814c900 2024-09-17T01:34:46.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.669+0000 7fd5afc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd5a806fe40 con 0x7fd590003fd0 2024-09-17T01:34:46.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.670+0000 7fd5a7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5a8157210 0x7fd5a81566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:46.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.670+0000 7fd5a7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5a8157210 0x7fd5a81566a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55896/0 (socket says 172.21.15.42:55896) 2024-09-17T01:34:46.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.670+0000 7fd5a7e00640 1 -- 172.21.15.42:0/3942730532 learned_addr learned my addr 172.21.15.42:0/3942730532 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:46.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.670+0000 7fd5ad200640 1 --2- 172.21.15.42:0/3942730532 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd590003fd0 0x7fd5a8156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:46.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.670+0000 7fd5adc00640 1 --2- 172.21.15.42:0/3942730532 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5a814c900 0x7fd5a8159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:46.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.670+0000 7fd5a7e00640 1 -- 172.21.15.42:0/3942730532 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd590003fd0 msgr2=0x7fd5a8156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:46.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.670+0000 7fd5a7e00640 1 --2- 172.21.15.42:0/3942730532 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd590003fd0 0x7fd5a8156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.670+0000 7fd5a7e00640 1 -- 172.21.15.42:0/3942730532 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5a814c900 msgr2=0x7fd5a8159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:46.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.670+0000 7fd5a7e00640 1 --2- 172.21.15.42:0/3942730532 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5a814c900 0x7fd5a8159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.670+0000 7fd5a7e00640 1 -- 172.21.15.42:0/3942730532 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a81543c0 con 0x7fd5a8157210 2024-09-17T01:34:46.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.670+0000 7fd5ad200640 1 --2- 172.21.15.42:0/3942730532 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd590003fd0 0x7fd5a8156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:34:46.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.670+0000 7fd5adc00640 1 --2- 172.21.15.42:0/3942730532 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5a814c900 0x7fd5a8159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:34:46.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.670+0000 7fd5a7e00640 1 --2- 172.21.15.42:0/3942730532 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5a8157210 0x7fd5a81566a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd59402b4f0 tx=0x7fd594033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:46.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.671+0000 7fd5a4c00640 1 -- 172.21.15.42:0/3942730532 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd594038040 con 0x7fd5a8157210 2024-09-17T01:34:46.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.671+0000 7fd5a4c00640 1 -- 172.21.15.42:0/3942730532 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd594004020 con 0x7fd5a8157210 2024-09-17T01:34:46.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.671+0000 7fd5a4c00640 1 -- 172.21.15.42:0/3942730532 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd594004470 con 0x7fd5a8157210 2024-09-17T01:34:46.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.671+0000 7fd5afc00640 1 -- 172.21.15.42:0/3942730532 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5a81546a0 con 0x7fd5a8157210 2024-09-17T01:34:46.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.671+0000 7fd5afc00640 1 -- 172.21.15.42:0/3942730532 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5a814fd20 con 0x7fd5a8157210 2024-09-17T01:34:46.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.672+0000 7fd5afc00640 1 -- 172.21.15.42:0/3942730532 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5a815bc50 con 0x7fd5a8157210 2024-09-17T01:34:46.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.673+0000 7fd5a4c00640 1 -- 172.21.15.42:0/3942730532 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd594045020 con 0x7fd5a8157210 2024-09-17T01:34:46.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.674+0000 7fd5a4c00640 1 --2- 172.21.15.42:0/3942730532 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd588078b90 0x7fd58807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:46.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.674+0000 7fd5a4c00640 1 -- 172.21.15.42:0/3942730532 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7fd5940bb840 con 0x7fd5a8157210 2024-09-17T01:34:46.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.675+0000 7fd5ad200640 1 --2- 172.21.15.42:0/3942730532 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd588078b90 0x7fd58807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:46.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.676+0000 7fd5ad200640 1 --2- 172.21.15.42:0/3942730532 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd588078b90 0x7fd58807b0a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd59c001d40 tx=0x7fd59c001700 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:46.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.679+0000 7fd5a4c00640 1 -- 172.21.15.42:0/3942730532 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd59402b9d0 con 0x7fd5a8157210 2024-09-17T01:34:46.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.886+0000 7fd5afc00640 1 -- 172.21.15.42:0/3942730532 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd5a8154870 con 0x7fd5a8157210 2024-09-17T01:34:46.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.886+0000 7fd5a4c00640 1 -- 172.21.15.42:0/3942730532 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) ==== 80+0+0 (secure 0 0 0) 0x7fd594083b50 con 0x7fd5a8157210 2024-09-17T01:34:46.884 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-17T01:34:46.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.888+0000 7fd5afc00640 1 -- 172.21.15.42:0/3942730532 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd588078b90 msgr2=0x7fd58807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:46.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.888+0000 7fd5afc00640 1 --2- 172.21.15.42:0/3942730532 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd588078b90 0x7fd58807b0a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd59c001d40 tx=0x7fd59c001700 comp rx=0 tx=0).stop 2024-09-17T01:34:46.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.888+0000 7fd5afc00640 1 -- 172.21.15.42:0/3942730532 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5a8157210 msgr2=0x7fd5a81566a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:46.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.888+0000 7fd5afc00640 1 --2- 172.21.15.42:0/3942730532 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5a8157210 0x7fd5a81566a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd59402b4f0 tx=0x7fd594033670 comp rx=0 tx=0).stop 2024-09-17T01:34:46.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.888+0000 7fd5afc00640 1 -- 172.21.15.42:0/3942730532 shutdown_connections 2024-09-17T01:34:46.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.888+0000 7fd5afc00640 1 --2- 172.21.15.42:0/3942730532 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd588078b90 0x7fd58807b0a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.888+0000 7fd5afc00640 1 --2- 172.21.15.42:0/3942730532 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5a814c900 0x7fd5a8159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.888+0000 7fd5afc00640 1 --2- 172.21.15.42:0/3942730532 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5a8157210 0x7fd5a81566a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.888+0000 7fd5afc00640 1 --2- 172.21.15.42:0/3942730532 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd590003fd0 0x7fd5a8156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.888+0000 7fd5afc00640 1 -- 172.21.15.42:0/3942730532 >> 172.21.15.42:0/3942730532 conn(0x7fd5a80b2930 msgr2=0x7fd5a80b1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:46.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.889+0000 7fd5afc00640 1 -- 172.21.15.42:0/3942730532 shutdown_connections 2024-09-17T01:34:46.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:46.889+0000 7fd5afc00640 1 -- 172.21.15.42:0/3942730532 wait complete. 2024-09-17T01:34:46.909 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T01:34:46.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:34:46.910 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T01:34:47.006 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:34:47.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:34:47.006 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T01:34:47.056 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:34:47.056 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:34:47.056 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:34:47.093 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:34:47.094 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:34:47.094 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:34:47.094 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:34:47.132 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:34:47.132 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:34:47.132 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:34:47.132 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:34:47.170 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:34:47.171 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:34:47.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.404+0000 7fab01e00640 1 -- 172.21.15.42:0/1545370427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faafc06d430 msgr2=0x7faafc06d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:47.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.404+0000 7fab01e00640 1 --2- 172.21.15.42:0/1545370427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faafc06d430 0x7faafc06d840 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7faafc0b3110 tx=0x7faaf402a6f0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.405+0000 7fab01e00640 1 -- 172.21.15.42:0/1545370427 shutdown_connections 2024-09-17T01:34:47.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.405+0000 7fab01e00640 1 --2- 172.21.15.42:0/1545370427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faafc06d430 0x7faafc06d840 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.405+0000 7fab01e00640 1 --2- 172.21.15.42:0/1545370427 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faafc15f190 0x7faafc06fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.405+0000 7fab01e00640 1 --2- 172.21.15.42:0/1545370427 >> v2:172.21.15.43:3300/0 conn(0x7faafc072e00 0x7faafc15bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.405+0000 7fab01e00640 1 -- 172.21.15.42:0/1545370427 >> 172.21.15.42:0/1545370427 conn(0x7faafc0b2930 msgr2=0x7faafc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:47.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.405+0000 7fab01e00640 1 -- 172.21.15.42:0/1545370427 shutdown_connections 2024-09-17T01:34:47.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.405+0000 7fab01e00640 1 -- 172.21.15.42:0/1545370427 wait complete. 2024-09-17T01:34:47.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.407+0000 7fab01e00640 1 Processor -- start 2024-09-17T01:34:47.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.407+0000 7fab01e00640 1 -- start start 2024-09-17T01:34:47.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.408+0000 7fab01e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faafc06d430 0x7faafc1451d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:47.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.408+0000 7fab01e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faafc072e00 0x7faafc154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:47.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.408+0000 7fab01e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faafc15f190 0x7faafc1448f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:47.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.408+0000 7fab01e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faafc0706b0 con 0x7faafc15f190 2024-09-17T01:34:47.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.408+0000 7fab01e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faafc070530 con 0x7faafc072e00 2024-09-17T01:34:47.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.408+0000 7fab01e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7faafc151520 con 0x7faafc06d430 2024-09-17T01:34:47.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.409+0000 7faafb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faafc15f190 0x7faafc1448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:47.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.409+0000 7faafb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faafc15f190 0x7faafc1448f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55918/0 (socket says 172.21.15.42:55918) 2024-09-17T01:34:47.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.409+0000 7faafb400640 1 -- 172.21.15.42:0/2533484742 learned_addr learned my addr 172.21.15.42:0/2533484742 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:47.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.409+0000 7faafa000640 1 --2- 172.21.15.42:0/2533484742 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faafc072e00 0x7faafc154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:47.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.409+0000 7faafaa00640 1 --2- 172.21.15.42:0/2533484742 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faafc06d430 0x7faafc1451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:47.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.409+0000 7faafb400640 1 -- 172.21.15.42:0/2533484742 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faafc06d430 msgr2=0x7faafc1451d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:47.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.409+0000 7faafb400640 1 --2- 172.21.15.42:0/2533484742 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faafc06d430 0x7faafc1451d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.409+0000 7faafb400640 1 -- 172.21.15.42:0/2533484742 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faafc072e00 msgr2=0x7faafc154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:47.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.409+0000 7faafb400640 1 --2- 172.21.15.42:0/2533484742 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faafc072e00 0x7faafc154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.409+0000 7faafb400640 1 -- 172.21.15.42:0/2533484742 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faafc1598e0 con 0x7faafc15f190 2024-09-17T01:34:47.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.409+0000 7faafa000640 1 --2- 172.21.15.42:0/2533484742 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faafc072e00 0x7faafc154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:34:47.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.409+0000 7faafaa00640 1 --2- 172.21.15.42:0/2533484742 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faafc06d430 0x7faafc1451d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:34:47.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.409+0000 7faafb400640 1 --2- 172.21.15.42:0/2533484742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faafc15f190 0x7faafc1448f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7faaf40098c0 tx=0x7faaf4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:47.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.410+0000 7faaf3400640 1 -- 172.21.15.42:0/2533484742 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf4004240 con 0x7faafc15f190 2024-09-17T01:34:47.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.410+0000 7faaf3400640 1 -- 172.21.15.42:0/2533484742 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faaf40043e0 con 0x7faafc15f190 2024-09-17T01:34:47.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.410+0000 7faaf3400640 1 -- 172.21.15.42:0/2533484742 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf4004810 con 0x7faafc15f190 2024-09-17T01:34:47.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.410+0000 7fab01e00640 1 -- 172.21.15.42:0/2533484742 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faafc148070 con 0x7faafc15f190 2024-09-17T01:34:47.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.410+0000 7fab01e00640 1 -- 172.21.15.42:0/2533484742 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faafc159e60 con 0x7faafc15f190 2024-09-17T01:34:47.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.411+0000 7fab01e00640 1 -- 172.21.15.42:0/2533484742 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faafc06e1c0 con 0x7faafc15f190 2024-09-17T01:34:47.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.412+0000 7faaf3400640 1 -- 172.21.15.42:0/2533484742 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faaf403b410 con 0x7faafc15f190 2024-09-17T01:34:47.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.413+0000 7faaf3400640 1 --2- 172.21.15.42:0/2533484742 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faadc078b90 0x7faadc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:47.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.413+0000 7faaf3400640 1 -- 172.21.15.42:0/2533484742 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7faaf40bbf50 con 0x7faafc15f190 2024-09-17T01:34:47.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.414+0000 7faafaa00640 1 --2- 172.21.15.42:0/2533484742 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faadc078b90 0x7faadc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:47.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.414+0000 7faafaa00640 1 --2- 172.21.15.42:0/2533484742 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faadc078b90 0x7faadc07b0a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faaec00dbe0 tx=0x7faaec005e70 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:47.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.417+0000 7faaf3400640 1 -- 172.21.15.42:0/2533484742 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faafc06e1c0 con 0x7faafc15f190 2024-09-17T01:34:47.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.649+0000 7fab01e00640 1 -- 172.21.15.42:0/2533484742 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faafc073970 con 0x7faafc15f190 2024-09-17T01:34:47.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.649+0000 7faaf3400640 1 -- 172.21.15.42:0/2533484742 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5223 (secure 0 0 0) 0x7faafc073970 con 0x7faafc15f190 2024-09-17T01:34:47.647 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:34:47.648 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":18,"btime":"2024-09-17T01:33:09:307330+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4628,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/2560567328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2560567328},{"type":"v1","addr":"172.21.15.42:6833","nonce":2560567328}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1462836032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1462836032},{"type":"v1","addr":"172.21.15.43:6836","nonce":1462836032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4798,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3719448578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3719448578},{"type":"v1","addr":"172.21.15.43:6837","nonce":3719448578}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-17T01:32:54.766579+0000","modified":"2024-09-17T01:33:09.126100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4830},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4830":{"gid":4830,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3278817895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3278817895},{"type":"v1","addr":"172.21.15.42:6835","nonce":3278817895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4830,"qdb_cluster":[4830]},"id":2}]} 2024-09-17T01:34:47.648 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 18 2024-09-17T01:34:47.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.652+0000 7fab01e00640 1 -- 172.21.15.42:0/2533484742 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faadc078b90 msgr2=0x7faadc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:47.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.652+0000 7fab01e00640 1 --2- 172.21.15.42:0/2533484742 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faadc078b90 0x7faadc07b0a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faaec00dbe0 tx=0x7faaec005e70 comp rx=0 tx=0).stop 2024-09-17T01:34:47.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.652+0000 7fab01e00640 1 -- 172.21.15.42:0/2533484742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faafc15f190 msgr2=0x7faafc1448f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:47.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.652+0000 7fab01e00640 1 --2- 172.21.15.42:0/2533484742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faafc15f190 0x7faafc1448f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7faaf40098c0 tx=0x7faaf4003ba0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.652+0000 7fab01e00640 1 -- 172.21.15.42:0/2533484742 shutdown_connections 2024-09-17T01:34:47.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.652+0000 7fab01e00640 1 --2- 172.21.15.42:0/2533484742 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faadc078b90 0x7faadc07b0a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.652+0000 7fab01e00640 1 --2- 172.21.15.42:0/2533484742 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faafc072e00 0x7faafc154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.652+0000 7fab01e00640 1 --2- 172.21.15.42:0/2533484742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faafc15f190 0x7faafc1448f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.652+0000 7fab01e00640 1 --2- 172.21.15.42:0/2533484742 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faafc06d430 0x7faafc1451d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.652+0000 7fab01e00640 1 -- 172.21.15.42:0/2533484742 >> 172.21.15.42:0/2533484742 conn(0x7faafc0b2930 msgr2=0x7faafc0b16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:47.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.652+0000 7fab01e00640 1 -- 172.21.15.42:0/2533484742 shutdown_connections 2024-09-17T01:34:47.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.652+0000 7fab01e00640 1 -- 172.21.15.42:0/2533484742 wait complete. 2024-09-17T01:34:47.671 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:34:47.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.901+0000 7f574a600640 1 -- 172.21.15.42:0/2584791425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5728003f90 msgr2=0x7f5728004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:47.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.901+0000 7f574a600640 1 --2- 172.21.15.42:0/2584791425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5728003f90 0x7f5728004800 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f572c0017c0 tx=0x7f5728005830 comp rx=0 tx=0).stop 2024-09-17T01:34:47.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.901+0000 7f5743e00640 1 -- 172.21.15.42:0/2584791425 reap_dead start 2024-09-17T01:34:47.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.901+0000 7f574a600640 1 -- 172.21.15.42:0/2584791425 shutdown_connections 2024-09-17T01:34:47.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.901+0000 7f574a600640 1 -- 172.21.15.42:0/2584791425 >> 172.21.15.42:0/2584791425 conn(0x7f57440b2930 msgr2=0x7f574406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:47.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.901+0000 7f574a600640 1 -- 172.21.15.42:0/2584791425 shutdown_connections 2024-09-17T01:34:47.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.901+0000 7f574a600640 1 -- 172.21.15.42:0/2584791425 wait complete. 2024-09-17T01:34:47.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.904+0000 7f574a600640 1 Processor -- start 2024-09-17T01:34:47.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.904+0000 7f574a600640 1 -- start start 2024-09-17T01:34:47.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.905+0000 7f574a600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5728003f90 0x7f57441f5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:47.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.905+0000 7f574a600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57441f63d0 0x7f57440ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:47.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.905+0000 7f574a600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f574406f1d0 0x7f574406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:47.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.905+0000 7f574a600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f57440cf430 con 0x7f5728003f90 2024-09-17T01:34:47.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.905+0000 7f574a600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f57440cf2b0 con 0x7f57441f63d0 2024-09-17T01:34:47.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.905+0000 7f574a600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f574415cec0 con 0x7f574406f1d0 2024-09-17T01:34:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.905+0000 7f5743400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5728003f90 0x7f57441f5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.905+0000 7f5743400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5728003f90 0x7f57441f5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55938/0 (socket says 172.21.15.42:55938) 2024-09-17T01:34:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.905+0000 7f5743400640 1 -- 172.21.15.42:0/3127255506 learned_addr learned my addr 172.21.15.42:0/3127255506 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.906+0000 7f573be00640 1 --2- 172.21.15.42:0/3127255506 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57441f63d0 0x7f57440ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.906+0000 7f5743e00640 1 --2- 172.21.15.42:0/3127255506 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f574406f1d0 0x7f574406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.906+0000 7f5743400640 1 -- 172.21.15.42:0/3127255506 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f574406f1d0 msgr2=0x7f574406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.906+0000 7f5743400640 1 --2- 172.21.15.42:0/3127255506 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f574406f1d0 0x7f574406f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.906+0000 7f5743400640 1 -- 172.21.15.42:0/3127255506 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57441f63d0 msgr2=0x7f57440ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.906+0000 7f5743400640 1 --2- 172.21.15.42:0/3127255506 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57441f63d0 0x7f57440ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.906+0000 7f5743400640 1 -- 172.21.15.42:0/3127255506 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574406fb20 con 0x7f5728003f90 2024-09-17T01:34:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.906+0000 7f5743e00640 1 --2- 172.21.15.42:0/3127255506 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f574406f1d0 0x7f574406f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:34:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.906+0000 7f573be00640 1 --2- 172.21.15.42:0/3127255506 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57441f63d0 0x7f57440ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:34:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.906+0000 7f5743400640 1 --2- 172.21.15.42:0/3127255506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5728003f90 0x7f57441f5ae0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5734011a80 tx=0x7f5734011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:47.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.906+0000 7f573b400640 1 -- 172.21.15.42:0/3127255506 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573400fd50 con 0x7f5728003f90 2024-09-17T01:34:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.906+0000 7f573b400640 1 -- 172.21.15.42:0/3127255506 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5734016070 con 0x7f5728003f90 2024-09-17T01:34:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.906+0000 7f573b400640 1 -- 172.21.15.42:0/3127255506 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57340126b0 con 0x7f5728003f90 2024-09-17T01:34:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.907+0000 7f574a600640 1 -- 172.21.15.42:0/3127255506 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f574406e410 con 0x7f5728003f90 2024-09-17T01:34:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.907+0000 7f574a600640 1 -- 172.21.15.42:0/3127255506 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f574406e9d0 con 0x7f5728003f90 2024-09-17T01:34:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.908+0000 7f574a600640 1 -- 172.21.15.42:0/3127255506 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f574415d420 con 0x7f5728003f90 2024-09-17T01:34:47.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.909+0000 7f573b400640 1 -- 172.21.15.42:0/3127255506 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5734018030 con 0x7f5728003f90 2024-09-17T01:34:47.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.910+0000 7f573b400640 1 --2- 172.21.15.42:0/3127255506 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5720078b90 0x7f572007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:47.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.910+0000 7f573b400640 1 -- 172.21.15.42:0/3127255506 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7f573409b620 con 0x7f5728003f90 2024-09-17T01:34:47.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.910+0000 7f573be00640 1 --2- 172.21.15.42:0/3127255506 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5720078b90 0x7f572007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:47.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.911+0000 7f573be00640 1 --2- 172.21.15.42:0/3127255506 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5720078b90 0x7f572007b0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f572c032000 tx=0x7f572c02c000 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:47.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:47.914+0000 7f573b400640 1 -- 172.21.15.42:0/3127255506 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f574406fb20 con 0x7f5728003f90 2024-09-17T01:34:48.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.145+0000 7f574a600640 1 -- 172.21.15.42:0/3127255506 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f574406a170 con 0x7f5728003f90 2024-09-17T01:34:48.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.145+0000 7f573b400640 1 -- 172.21.15.42:0/3127255506 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5223 (secure 0 0 0) 0x7f5734063a50 con 0x7f5728003f90 2024-09-17T01:34:48.143 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:34:48.143 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":18,"btime":"2024-09-17T01:33:09:307330+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4628,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/2560567328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2560567328},{"type":"v1","addr":"172.21.15.42:6833","nonce":2560567328}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1462836032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1462836032},{"type":"v1","addr":"172.21.15.43:6836","nonce":1462836032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4798,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3719448578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3719448578},{"type":"v1","addr":"172.21.15.43:6837","nonce":3719448578}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-17T01:32:54.766579+0000","modified":"2024-09-17T01:33:09.126100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4830},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4830":{"gid":4830,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3278817895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3278817895},{"type":"v1","addr":"172.21.15.42:6835","nonce":3278817895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4830,"qdb_cluster":[4830]},"id":2}]} 2024-09-17T01:34:48.144 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 18 2024-09-17T01:34:48.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.148+0000 7f574a600640 1 -- 172.21.15.42:0/3127255506 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5720078b90 msgr2=0x7f572007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:48.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.148+0000 7f574a600640 1 --2- 172.21.15.42:0/3127255506 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5720078b90 0x7f572007b0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f572c032000 tx=0x7f572c02c000 comp rx=0 tx=0).stop 2024-09-17T01:34:48.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.148+0000 7f574a600640 1 -- 172.21.15.42:0/3127255506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5728003f90 msgr2=0x7f57441f5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:48.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.148+0000 7f574a600640 1 --2- 172.21.15.42:0/3127255506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5728003f90 0x7f57441f5ae0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5734011a80 tx=0x7f5734011f40 comp rx=0 tx=0).stop 2024-09-17T01:34:48.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.148+0000 7f574a600640 1 -- 172.21.15.42:0/3127255506 shutdown_connections 2024-09-17T01:34:48.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.148+0000 7f574a600640 1 --2- 172.21.15.42:0/3127255506 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5720078b90 0x7f572007b0a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:48.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.148+0000 7f574a600640 1 --2- 172.21.15.42:0/3127255506 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57441f63d0 0x7f57440ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:48.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.148+0000 7f574a600640 1 --2- 172.21.15.42:0/3127255506 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f574406f1d0 0x7f574406f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:48.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.148+0000 7f574a600640 1 --2- 172.21.15.42:0/3127255506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5728003f90 0x7f57441f5ae0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:48.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.148+0000 7f574a600640 1 -- 172.21.15.42:0/3127255506 >> 172.21.15.42:0/3127255506 conn(0x7f57440b2930 msgr2=0x7f5744073330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:48.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.148+0000 7f574a600640 1 -- 172.21.15.42:0/3127255506 shutdown_connections 2024-09-17T01:34:48.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.148+0000 7f574a600640 1 -- 172.21.15.42:0/3127255506 wait complete. 2024-09-17T01:34:48.168 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:34:48.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.396+0000 7f185a200640 1 -- 172.21.15.42:0/3905138205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f185415fbe0 msgr2=0x7f185415c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:48.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.396+0000 7f185a200640 1 --2- 172.21.15.42:0/3905138205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f185415fbe0 0x7f185415c3c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1848009830 tx=0x7f184802a4b0 comp rx=0 tx=0).stop 2024-09-17T01:34:48.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.396+0000 7f185a200640 1 -- 172.21.15.42:0/3905138205 shutdown_connections 2024-09-17T01:34:48.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.396+0000 7f185a200640 1 --2- 172.21.15.42:0/3905138205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f185415fbe0 0x7f185415c3c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:48.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.396+0000 7f185a200640 1 -- 172.21.15.42:0/3905138205 >> 172.21.15.42:0/3905138205 conn(0x7f1854073f20 msgr2=0x7f185406cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:48.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.397+0000 7f185a200640 1 -- 172.21.15.42:0/3905138205 shutdown_connections 2024-09-17T01:34:48.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.397+0000 7f185a200640 1 -- 172.21.15.42:0/3905138205 wait complete. 2024-09-17T01:34:48.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.399+0000 7f185a200640 1 Processor -- start 2024-09-17T01:34:48.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.399+0000 7f185a200640 1 -- start start 2024-09-17T01:34:48.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.400+0000 7f185a200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f185415fbe0 0x7f18540b6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:48.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.400+0000 7f185a200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1854162520 0x7f18541f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:48.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.400+0000 7f185a200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1854162930 0x7f18540cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:48.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.400+0000 7f185a200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f18540d0e80 con 0x7f1854162930 2024-09-17T01:34:48.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.400+0000 7f185a200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f18540d0d00 con 0x7f185415fbe0 2024-09-17T01:34:48.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.400+0000 7f185a200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f18540d1000 con 0x7f1854162520 2024-09-17T01:34:48.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.401+0000 7f1859800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1854162930 0x7f18540cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:48.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.401+0000 7f1859800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1854162930 0x7f18540cb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55946/0 (socket says 172.21.15.42:55946) 2024-09-17T01:34:48.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.401+0000 7f1859800640 1 -- 172.21.15.42:0/1203269752 learned_addr learned my addr 172.21.15.42:0/1203269752 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:48.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.401+0000 7f1858e00640 1 --2- 172.21.15.42:0/1203269752 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f185415fbe0 0x7f18540b6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:48.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.401+0000 7f1853e00640 1 --2- 172.21.15.42:0/1203269752 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1854162520 0x7f18541f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:48.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.401+0000 7f1859800640 1 -- 172.21.15.42:0/1203269752 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1854162520 msgr2=0x7f18541f5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:48.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.401+0000 7f1859800640 1 --2- 172.21.15.42:0/1203269752 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1854162520 0x7f18541f5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:48.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.401+0000 7f1859800640 1 -- 172.21.15.42:0/1203269752 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f185415fbe0 msgr2=0x7f18540b6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:48.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.401+0000 7f1859800640 1 --2- 172.21.15.42:0/1203269752 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f185415fbe0 0x7f18540b6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:48.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.401+0000 7f1859800640 1 -- 172.21.15.42:0/1203269752 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18540b54b0 con 0x7f1854162930 2024-09-17T01:34:48.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.401+0000 7f1853e00640 1 --2- 172.21.15.42:0/1203269752 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1854162520 0x7f18541f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:34:48.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.402+0000 7f1859800640 1 --2- 172.21.15.42:0/1203269752 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1854162930 0x7f18540cb810 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f184c002230 tx=0x7f184c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:48.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.402+0000 7f1850c00640 1 -- 172.21.15.42:0/1203269752 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c016020 con 0x7f1854162930 2024-09-17T01:34:48.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.402+0000 7f1850c00640 1 -- 172.21.15.42:0/1203269752 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f184c00ae30 con 0x7f1854162930 2024-09-17T01:34:48.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.402+0000 7f185a200640 1 -- 172.21.15.42:0/1203269752 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18540b5790 con 0x7f1854162930 2024-09-17T01:34:48.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.402+0000 7f1850c00640 1 -- 172.21.15.42:0/1203269752 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c012660 con 0x7f1854162930 2024-09-17T01:34:48.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.402+0000 7f185a200640 1 -- 172.21.15.42:0/1203269752 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18540b5d50 con 0x7f1854162930 2024-09-17T01:34:48.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.403+0000 7f185a200640 1 -- 172.21.15.42:0/1203269752 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18540b5220 con 0x7f1854162930 2024-09-17T01:34:48.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.404+0000 7f1850c00640 1 -- 172.21.15.42:0/1203269752 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f184c019020 con 0x7f1854162930 2024-09-17T01:34:48.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.405+0000 7f1850c00640 1 --2- 172.21.15.42:0/1203269752 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1834078bc0 0x7f183407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:48.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.405+0000 7f1850c00640 1 -- 172.21.15.42:0/1203269752 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7f184c09b320 con 0x7f1854162930 2024-09-17T01:34:48.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.406+0000 7f1858e00640 1 --2- 172.21.15.42:0/1203269752 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1834078bc0 0x7f183407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:48.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.406+0000 7f1858e00640 1 --2- 172.21.15.42:0/1203269752 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1834078bc0 0x7f183407b0d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1848034000 tx=0x7f1848004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:48.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.410+0000 7f1850c00640 1 -- 172.21.15.42:0/1203269752 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f184c020030 con 0x7f1854162930 2024-09-17T01:34:48.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.606+0000 7f185a200640 1 -- 172.21.15.42:0/1203269752 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f185406d1e0 con 0x7f1854162930 2024-09-17T01:34:48.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.607+0000 7f1850c00640 1 -- 172.21.15.42:0/1203269752 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16935 (secure 0 0 0) 0x7f184c063630 con 0x7f1854162930 2024-09-17T01:34:48.605 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:34:48.605 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":37,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:34:29.422092+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:32:52.920392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T01:32:53.722123+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.e","mappings":[{"from":4,"to":5}]},{"pgid":"5.19","mappings":[{"from":4,"to":5}]},{"pgid":"5.33","mappings":[{"from":4,"to":5}]},{"pgid":"5.37","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:34:48.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.609+0000 7f185a200640 1 -- 172.21.15.42:0/1203269752 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1834078bc0 msgr2=0x7f183407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:48.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.609+0000 7f185a200640 1 --2- 172.21.15.42:0/1203269752 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1834078bc0 0x7f183407b0d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1848034000 tx=0x7f1848004730 comp rx=0 tx=0).stop 2024-09-17T01:34:48.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.609+0000 7f185a200640 1 -- 172.21.15.42:0/1203269752 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1854162930 msgr2=0x7f18540cb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:48.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.609+0000 7f185a200640 1 --2- 172.21.15.42:0/1203269752 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1854162930 0x7f18540cb810 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f184c002230 tx=0x7f184c00a430 comp rx=0 tx=0).stop 2024-09-17T01:34:48.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.609+0000 7f185a200640 1 -- 172.21.15.42:0/1203269752 shutdown_connections 2024-09-17T01:34:48.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.609+0000 7f185a200640 1 --2- 172.21.15.42:0/1203269752 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1834078bc0 0x7f183407b0d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:48.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.609+0000 7f185a200640 1 --2- 172.21.15.42:0/1203269752 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1854162930 0x7f18540cb810 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:48.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.609+0000 7f185a200640 1 --2- 172.21.15.42:0/1203269752 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1854162520 0x7f18541f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:48.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.609+0000 7f185a200640 1 --2- 172.21.15.42:0/1203269752 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f185415fbe0 0x7f18540b6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:48.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.609+0000 7f185a200640 1 -- 172.21.15.42:0/1203269752 >> 172.21.15.42:0/1203269752 conn(0x7f1854073f20 msgr2=0x7f18540d1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:48.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.609+0000 7f185a200640 1 -- 172.21.15.42:0/1203269752 shutdown_connections 2024-09-17T01:34:48.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.609+0000 7f185a200640 1 -- 172.21.15.42:0/1203269752 wait complete. 2024-09-17T01:34:48.632 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T01:34:48.632 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:34:48.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.864+0000 7ff24f200640 1 -- 172.21.15.42:0/172264260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff234003a30 msgr2=0x7ff234003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:48.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.864+0000 7ff24f200640 1 --2- 172.21.15.42:0/172264260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff234003a30 0x7ff234003ea0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff240009b50 tx=0x7ff234005830 comp rx=0 tx=0).stop 2024-09-17T01:34:48.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.864+0000 7ff24e800640 1 -- 172.21.15.42:0/172264260 reap_dead start 2024-09-17T01:34:48.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.864+0000 7ff24f200640 1 -- 172.21.15.42:0/172264260 shutdown_connections 2024-09-17T01:34:48.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.864+0000 7ff24f200640 1 -- 172.21.15.42:0/172264260 >> 172.21.15.42:0/172264260 conn(0x7ff2500b25f0 msgr2=0x7ff2500d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:48.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.864+0000 7ff24f200640 1 -- 172.21.15.42:0/172264260 shutdown_connections 2024-09-17T01:34:48.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.864+0000 7ff24f200640 1 -- 172.21.15.42:0/172264260 wait complete. 2024-09-17T01:34:48.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.866+0000 7ff24f200640 1 Processor -- start 2024-09-17T01:34:48.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.867+0000 7ff24f200640 1 -- start start 2024-09-17T01:34:48.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.868+0000 7ff24f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff234003a30 0x7ff25014cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:48.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.868+0000 7ff24f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff25006e1e0 0x7ff25006e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:48.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.868+0000 7ff24f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff25006eb30 0x7ff25014ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:48.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.868+0000 7ff24f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff2501632b0 con 0x7ff25006e1e0 2024-09-17T01:34:48.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.868+0000 7ff24f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff250163130 con 0x7ff25006eb30 2024-09-17T01:34:48.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.868+0000 7ff24f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff25015ea00 con 0x7ff234003a30 2024-09-17T01:34:48.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.868+0000 7ff245400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff25006e1e0 0x7ff25006e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:48.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.868+0000 7ff245400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff25006e1e0 0x7ff25006e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55974/0 (socket says 172.21.15.42:55974) 2024-09-17T01:34:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.868+0000 7ff245400640 1 -- 172.21.15.42:0/2461783011 learned_addr learned my addr 172.21.15.42:0/2461783011 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.869+0000 7ff24de00640 1 --2- 172.21.15.42:0/2461783011 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff234003a30 0x7ff25014cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.869+0000 7ff24e800640 1 --2- 172.21.15.42:0/2461783011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff25006eb30 0x7ff25014ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.869+0000 7ff245400640 1 -- 172.21.15.42:0/2461783011 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff234003a30 msgr2=0x7ff25014cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.869+0000 7ff245400640 1 --2- 172.21.15.42:0/2461783011 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff234003a30 0x7ff25014cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.869+0000 7ff245400640 1 -- 172.21.15.42:0/2461783011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff25006eb30 msgr2=0x7ff25014ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.869+0000 7ff245400640 1 --2- 172.21.15.42:0/2461783011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff25006eb30 0x7ff25014ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.869+0000 7ff245400640 1 -- 172.21.15.42:0/2461783011 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff250074950 con 0x7ff25006e1e0 2024-09-17T01:34:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.869+0000 7ff245400640 1 --2- 172.21.15.42:0/2461783011 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff25006e1e0 0x7ff25006e5f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff238001db0 tx=0x7ff2380039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.870+0000 7ff246a00640 1 -- 172.21.15.42:0/2461783011 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff238015070 con 0x7ff25006e1e0 2024-09-17T01:34:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.870+0000 7ff246a00640 1 -- 172.21.15.42:0/2461783011 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff238011900 con 0x7ff25006e1e0 2024-09-17T01:34:48.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.870+0000 7ff246a00640 1 -- 172.21.15.42:0/2461783011 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff238011d50 con 0x7ff25006e1e0 2024-09-17T01:34:48.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.870+0000 7ff24f200640 1 -- 172.21.15.42:0/2461783011 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff25015cc00 con 0x7ff25006e1e0 2024-09-17T01:34:48.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.870+0000 7ff24f200640 1 -- 172.21.15.42:0/2461783011 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff250074eb0 con 0x7ff25006e1e0 2024-09-17T01:34:48.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.871+0000 7ff24f200640 1 -- 172.21.15.42:0/2461783011 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff25006cdb0 con 0x7ff25006e1e0 2024-09-17T01:34:48.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.872+0000 7ff246a00640 1 -- 172.21.15.42:0/2461783011 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff238018070 con 0x7ff25006e1e0 2024-09-17T01:34:48.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.873+0000 7ff246a00640 1 --2- 172.21.15.42:0/2461783011 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff22c078b90 0x7ff22c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:48.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.873+0000 7ff246a00640 1 -- 172.21.15.42:0/2461783011 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7ff23809b9d0 con 0x7ff25006e1e0 2024-09-17T01:34:48.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.874+0000 7ff24de00640 1 --2- 172.21.15.42:0/2461783011 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff22c078b90 0x7ff22c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:48.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.874+0000 7ff24de00640 1 --2- 172.21.15.42:0/2461783011 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff22c078b90 0x7ff22c07b0a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff240035000 tx=0x7ff24002d040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:48.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:48.877+0000 7ff246a00640 1 -- 172.21.15.42:0/2461783011 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff25015cc00 con 0x7ff25006e1e0 2024-09-17T01:34:49.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.108+0000 7ff24f200640 1 -- 172.21.15.42:0/2461783011 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff250072550 con 0x7ff25006e1e0 2024-09-17T01:34:49.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.108+0000 7ff246a00640 1 -- 172.21.15.42:0/2461783011 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5223 (secure 0 0 0) 0x7ff250074950 con 0x7ff25006e1e0 2024-09-17T01:34:49.107 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:34:49.107 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":18,"btime":"2024-09-17T01:33:09:307330+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4628,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/2560567328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2560567328},{"type":"v1","addr":"172.21.15.42:6833","nonce":2560567328}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1462836032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1462836032},{"type":"v1","addr":"172.21.15.43:6836","nonce":1462836032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4798,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3719448578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3719448578},{"type":"v1","addr":"172.21.15.43:6837","nonce":3719448578}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-17T01:32:54.766579+0000","modified":"2024-09-17T01:33:09.126100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4830},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4830":{"gid":4830,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3278817895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3278817895},{"type":"v1","addr":"172.21.15.42:6835","nonce":3278817895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4830,"qdb_cluster":[4830]},"id":2}]} 2024-09-17T01:34:49.109 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 18 2024-09-17T01:34:49.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.111+0000 7ff24f200640 1 -- 172.21.15.42:0/2461783011 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff22c078b90 msgr2=0x7ff22c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:49.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.111+0000 7ff24f200640 1 --2- 172.21.15.42:0/2461783011 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff22c078b90 0x7ff22c07b0a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff240035000 tx=0x7ff24002d040 comp rx=0 tx=0).stop 2024-09-17T01:34:49.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.111+0000 7ff24f200640 1 -- 172.21.15.42:0/2461783011 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff25006e1e0 msgr2=0x7ff25006e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:49.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.111+0000 7ff24f200640 1 --2- 172.21.15.42:0/2461783011 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff25006e1e0 0x7ff25006e5f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff238001db0 tx=0x7ff2380039c0 comp rx=0 tx=0).stop 2024-09-17T01:34:49.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.111+0000 7ff24f200640 1 -- 172.21.15.42:0/2461783011 shutdown_connections 2024-09-17T01:34:49.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.111+0000 7ff24f200640 1 --2- 172.21.15.42:0/2461783011 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff22c078b90 0x7ff22c07b0a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:49.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.111+0000 7ff24f200640 1 --2- 172.21.15.42:0/2461783011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff25006eb30 0x7ff25014ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:49.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.111+0000 7ff24f200640 1 --2- 172.21.15.42:0/2461783011 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff25006e1e0 0x7ff25006e5f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:49.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.111+0000 7ff24f200640 1 --2- 172.21.15.42:0/2461783011 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff234003a30 0x7ff25014cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:49.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.111+0000 7ff24f200640 1 -- 172.21.15.42:0/2461783011 >> 172.21.15.42:0/2461783011 conn(0x7ff2500b25f0 msgr2=0x7ff250075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:49.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.111+0000 7ff24f200640 1 -- 172.21.15.42:0/2461783011 shutdown_connections 2024-09-17T01:34:49.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.111+0000 7ff24f200640 1 -- 172.21.15.42:0/2461783011 wait complete. 2024-09-17T01:34:49.131 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:34:49.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.360+0000 7f59e9400640 1 -- 172.21.15.42:0/2876570007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59e40d2810 msgr2=0x7f59e415e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:49.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.360+0000 7f59e9400640 1 --2- 172.21.15.42:0/2876570007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59e40d2810 0x7f59e415e910 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f59e4073750 tx=0x7f59cc02a420 comp rx=0 tx=0).stop 2024-09-17T01:34:49.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.360+0000 7f59e9400640 1 -- 172.21.15.42:0/2876570007 shutdown_connections 2024-09-17T01:34:49.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.360+0000 7f59e9400640 1 --2- 172.21.15.42:0/2876570007 >> v2:172.21.15.43:3300/0 conn(0x7f59e40b6030 0x7f59e40b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:49.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.360+0000 7f59e9400640 1 --2- 172.21.15.42:0/2876570007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59e40d2810 0x7f59e415e910 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:49.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.360+0000 7f59e9400640 1 -- 172.21.15.42:0/2876570007 >> 172.21.15.42:0/2876570007 conn(0x7f59e40d1210 msgr2=0x7f59e40d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:49.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.360+0000 7f59e9400640 1 -- 172.21.15.42:0/2876570007 shutdown_connections 2024-09-17T01:34:49.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.360+0000 7f59e9400640 1 -- 172.21.15.42:0/2876570007 wait complete. 2024-09-17T01:34:49.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.362+0000 7f59e9400640 1 Processor -- start 2024-09-17T01:34:49.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.362+0000 7f59e9400640 1 -- start start 2024-09-17T01:34:49.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.364+0000 7f59e9400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f59e4073340 0x7f59e41567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:49.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.364+0000 7f59e9400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59e40b6030 0x7f59e40ced70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:49.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.364+0000 7f59e9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59e40d2810 0x7f59e40d3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:49.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.364+0000 7f59e9400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f59e415f850 con 0x7f59e40d2810 2024-09-17T01:34:49.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.364+0000 7f59e9400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f59e415f6d0 con 0x7f59e40b6030 2024-09-17T01:34:49.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.364+0000 7f59e9400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f59e415f9d0 con 0x7f59e4073340 2024-09-17T01:34:49.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.364+0000 7f59e8a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59e40d2810 0x7f59e40d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:49.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.364+0000 7f59e8a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59e40d2810 0x7f59e40d3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55986/0 (socket says 172.21.15.42:55986) 2024-09-17T01:34:49.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.364+0000 7f59e8a00640 1 -- 172.21.15.42:0/3530775453 learned_addr learned my addr 172.21.15.42:0/3530775453 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:49.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.364+0000 7f59dbe00640 1 --2- 172.21.15.42:0/3530775453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59e40b6030 0x7f59e40ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:49.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.364+0000 7f59e3e00640 1 --2- 172.21.15.42:0/3530775453 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f59e4073340 0x7f59e41567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:49.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.364+0000 7f59e8a00640 1 -- 172.21.15.42:0/3530775453 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f59e4073340 msgr2=0x7f59e41567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:49.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.364+0000 7f59e8a00640 1 --2- 172.21.15.42:0/3530775453 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f59e4073340 0x7f59e41567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:49.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.364+0000 7f59e8a00640 1 -- 172.21.15.42:0/3530775453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59e40b6030 msgr2=0x7f59e40ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:49.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.364+0000 7f59e8a00640 1 --2- 172.21.15.42:0/3530775453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59e40b6030 0x7f59e40ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:49.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.364+0000 7f59e8a00640 1 -- 172.21.15.42:0/3530775453 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e4156cf0 con 0x7f59e40d2810 2024-09-17T01:34:49.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.365+0000 7f59e8a00640 1 --2- 172.21.15.42:0/3530775453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59e40d2810 0x7f59e40d3380 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f59dc00e9c0 tx=0x7f59dc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:49.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.365+0000 7f59e0c00640 1 -- 172.21.15.42:0/3530775453 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59dc004d20 con 0x7f59e40d2810 2024-09-17T01:34:49.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.365+0000 7f59e0c00640 1 -- 172.21.15.42:0/3530775453 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59dc00cb20 con 0x7f59e40d2810 2024-09-17T01:34:49.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.365+0000 7f59e0c00640 1 -- 172.21.15.42:0/3530775453 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59dc005020 con 0x7f59e40d2810 2024-09-17T01:34:49.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.365+0000 7f59e9400640 1 -- 172.21.15.42:0/3530775453 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59e41f96d0 con 0x7f59e40d2810 2024-09-17T01:34:49.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.365+0000 7f59e9400640 1 -- 172.21.15.42:0/3530775453 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59e41f9c90 con 0x7f59e40d2810 2024-09-17T01:34:49.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.366+0000 7f59e9400640 1 -- 172.21.15.42:0/3530775453 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59e41fa350 con 0x7f59e40d2810 2024-09-17T01:34:49.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.367+0000 7f59e0c00640 1 -- 172.21.15.42:0/3530775453 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f59dc0051c0 con 0x7f59e40d2810 2024-09-17T01:34:49.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.368+0000 7f59e0c00640 1 --2- 172.21.15.42:0/3530775453 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f59c0078b90 0x7f59c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:49.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.368+0000 7f59e0c00640 1 -- 172.21.15.42:0/3530775453 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7f59dc09b630 con 0x7f59e40d2810 2024-09-17T01:34:49.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.369+0000 7f59e3e00640 1 --2- 172.21.15.42:0/3530775453 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f59c0078b90 0x7f59c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:49.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.369+0000 7f59e3e00640 1 --2- 172.21.15.42:0/3530775453 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f59c0078b90 0x7f59c007b0a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f59d4001720 tx=0x7f59d4007e90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:49.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.373+0000 7f59e0c00640 1 -- 172.21.15.42:0/3530775453 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f59e41fa350 con 0x7f59e40d2810 2024-09-17T01:34:49.434 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:34:49.438 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:34:49.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.610+0000 7f59e9400640 1 -- 172.21.15.42:0/3530775453 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59e415ff20 con 0x7f59e40d2810 2024-09-17T01:34:49.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.610+0000 7f59e0c00640 1 -- 172.21.15.42:0/3530775453 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5223 (secure 0 0 0) 0x7f59dc016030 con 0x7f59e40d2810 2024-09-17T01:34:49.608 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:34:49.609 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":18,"btime":"2024-09-17T01:33:09:307330+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4628,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/2560567328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2560567328},{"type":"v1","addr":"172.21.15.42:6833","nonce":2560567328}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1462836032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1462836032},{"type":"v1","addr":"172.21.15.43:6836","nonce":1462836032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4798,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3719448578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3719448578},{"type":"v1","addr":"172.21.15.43:6837","nonce":3719448578}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-17T01:32:54.766579+0000","modified":"2024-09-17T01:33:09.126100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4830},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4830":{"gid":4830,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3278817895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3278817895},{"type":"v1","addr":"172.21.15.42:6835","nonce":3278817895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4830,"qdb_cluster":[4830]},"id":2}]} 2024-09-17T01:34:49.609 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 18 2024-09-17T01:34:49.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.613+0000 7f59e9400640 1 -- 172.21.15.42:0/3530775453 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f59c0078b90 msgr2=0x7f59c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:49.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.613+0000 7f59e9400640 1 --2- 172.21.15.42:0/3530775453 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f59c0078b90 0x7f59c007b0a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f59d4001720 tx=0x7f59d4007e90 comp rx=0 tx=0).stop 2024-09-17T01:34:49.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.613+0000 7f59e9400640 1 -- 172.21.15.42:0/3530775453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59e40d2810 msgr2=0x7f59e40d3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:49.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.613+0000 7f59e9400640 1 --2- 172.21.15.42:0/3530775453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59e40d2810 0x7f59e40d3380 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f59dc00e9c0 tx=0x7f59dc00ee80 comp rx=0 tx=0).stop 2024-09-17T01:34:49.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.613+0000 7f59e9400640 1 -- 172.21.15.42:0/3530775453 shutdown_connections 2024-09-17T01:34:49.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.613+0000 7f59e9400640 1 --2- 172.21.15.42:0/3530775453 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f59c0078b90 0x7f59c007b0a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:49.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.613+0000 7f59e9400640 1 --2- 172.21.15.42:0/3530775453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59e40b6030 0x7f59e40ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:49.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.613+0000 7f59e9400640 1 --2- 172.21.15.42:0/3530775453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59e40d2810 0x7f59e40d3380 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:49.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.613+0000 7f59e9400640 1 --2- 172.21.15.42:0/3530775453 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f59e4073340 0x7f59e41567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:49.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.613+0000 7f59e9400640 1 -- 172.21.15.42:0/3530775453 >> 172.21.15.42:0/3530775453 conn(0x7f59e40d1210 msgr2=0x7f59e40d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:49.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.613+0000 7f59e9400640 1 -- 172.21.15.42:0/3530775453 shutdown_connections 2024-09-17T01:34:49.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.613+0000 7f59e9400640 1 -- 172.21.15.42:0/3530775453 wait complete. 2024-09-17T01:34:49.632 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:34:49.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.860+0000 7fe908a00640 1 -- 172.21.15.42:0/737090385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9040cafe0 msgr2=0x7fe90406e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:49.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.860+0000 7fe908a00640 1 --2- 172.21.15.42:0/737090385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9040cafe0 0x7fe90406e950 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe904072190 tx=0x7fe8fc02aa10 comp rx=0 tx=0).stop 2024-09-17T01:34:49.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.860+0000 7fe908a00640 1 -- 172.21.15.42:0/737090385 shutdown_connections 2024-09-17T01:34:49.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.860+0000 7fe908a00640 1 --2- 172.21.15.42:0/737090385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9040cafe0 0x7fe90406e950 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:49.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.860+0000 7fe908a00640 1 --2- 172.21.15.42:0/737090385 >> v2:172.21.15.43:3300/0 conn(0x7fe90415f830 0x7fe90415fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:49.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.860+0000 7fe908a00640 1 -- 172.21.15.42:0/737090385 >> 172.21.15.42:0/737090385 conn(0x7fe9040b25f0 msgr2=0x7fe9040d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:49.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.860+0000 7fe908a00640 1 -- 172.21.15.42:0/737090385 shutdown_connections 2024-09-17T01:34:49.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.860+0000 7fe908a00640 1 -- 172.21.15.42:0/737090385 wait complete. 2024-09-17T01:34:49.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.862+0000 7fe908a00640 1 Processor -- start 2024-09-17T01:34:49.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.862+0000 7fe908a00640 1 -- start start 2024-09-17T01:34:49.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.864+0000 7fe908a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9040cafe0 0x7fe9041e8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:49.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.864+0000 7fe908a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe90415b680 0x7fe9041f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:49.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.864+0000 7fe908a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe9041f5970 0x7fe9040c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:49.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.864+0000 7fe908a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe90406f490 con 0x7fe90415b680 2024-09-17T01:34:49.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.864+0000 7fe908a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe90406f310 con 0x7fe9040cafe0 2024-09-17T01:34:49.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.864+0000 7fe908a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe90406f610 con 0x7fe9041f5970 2024-09-17T01:34:49.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.864+0000 7fe8fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe90415b680 0x7fe9041f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:49.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.864+0000 7fe8fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe90415b680 0x7fe9041f5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56010/0 (socket says 172.21.15.42:56010) 2024-09-17T01:34:49.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.864+0000 7fe8fbe00640 1 -- 172.21.15.42:0/716347813 learned_addr learned my addr 172.21.15.42:0/716347813 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:49.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.864+0000 7fe903400640 1 --2- 172.21.15.42:0/716347813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9040cafe0 0x7fe9041e8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:49.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.864+0000 7fe903e00640 1 --2- 172.21.15.42:0/716347813 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe9041f5970 0x7fe9040c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:49.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.865+0000 7fe8fbe00640 1 -- 172.21.15.42:0/716347813 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe9041f5970 msgr2=0x7fe9040c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:49.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.865+0000 7fe8fbe00640 1 --2- 172.21.15.42:0/716347813 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe9041f5970 0x7fe9040c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:49.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.865+0000 7fe8fbe00640 1 -- 172.21.15.42:0/716347813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9040cafe0 msgr2=0x7fe9041e8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:49.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.865+0000 7fe8fbe00640 1 --2- 172.21.15.42:0/716347813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9040cafe0 0x7fe9041e8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:49.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.865+0000 7fe8fbe00640 1 -- 172.21.15.42:0/716347813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9041f8d00 con 0x7fe90415b680 2024-09-17T01:34:49.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.865+0000 7fe8fbe00640 1 --2- 172.21.15.42:0/716347813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe90415b680 0x7fe9041f5430 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00c970 tx=0x7fe8ec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:49.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.865+0000 7fe8fb400640 1 -- 172.21.15.42:0/716347813 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec007bb0 con 0x7fe90415b680 2024-09-17T01:34:49.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.865+0000 7fe8fb400640 1 -- 172.21.15.42:0/716347813 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8ec007e40 con 0x7fe90415b680 2024-09-17T01:34:49.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.865+0000 7fe908a00640 1 -- 172.21.15.42:0/716347813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe90415bbe0 con 0x7fe90415b680 2024-09-17T01:34:49.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.865+0000 7fe8fb400640 1 -- 172.21.15.42:0/716347813 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec00f690 con 0x7fe90415b680 2024-09-17T01:34:49.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.866+0000 7fe908a00640 1 -- 172.21.15.42:0/716347813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9041f62d0 con 0x7fe90415b680 2024-09-17T01:34:49.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.866+0000 7fe908a00640 1 -- 172.21.15.42:0/716347813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe90406fae0 con 0x7fe90415b680 2024-09-17T01:34:49.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.868+0000 7fe8fb400640 1 -- 172.21.15.42:0/716347813 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe8ec00f830 con 0x7fe90415b680 2024-09-17T01:34:49.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.869+0000 7fe8fb400640 1 --2- 172.21.15.42:0/716347813 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe8e0078b90 0x7fe8e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:49.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.869+0000 7fe8fb400640 1 -- 172.21.15.42:0/716347813 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7fe8ec09b600 con 0x7fe90415b680 2024-09-17T01:34:49.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.869+0000 7fe903400640 1 --2- 172.21.15.42:0/716347813 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe8e0078b90 0x7fe8e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:49.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.870+0000 7fe903400640 1 --2- 172.21.15.42:0/716347813 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe8e0078b90 0x7fe8e007b0a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4006fd0 tx=0x7fe8f4009060 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:49.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:49.874+0000 7fe8fb400640 1 -- 172.21.15.42:0/716347813 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe8ec014030 con 0x7fe90415b680 2024-09-17T01:34:50.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.070+0000 7fe908a00640 1 -- 172.21.15.42:0/716347813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9041f5d80 con 0x7fe90415b680 2024-09-17T01:34:50.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.071+0000 7fe8fb400640 1 -- 172.21.15.42:0/716347813 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16935 (secure 0 0 0) 0x7fe8ec099e20 con 0x7fe90415b680 2024-09-17T01:34:50.069 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:34:50.070 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":37,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:34:29.422092+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:32:52.920392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T01:32:53.722123+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":36,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.e","mappings":[{"from":4,"to":5}]},{"pgid":"5.19","mappings":[{"from":4,"to":5}]},{"pgid":"5.33","mappings":[{"from":4,"to":5}]},{"pgid":"5.37","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:34:50.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.074+0000 7fe908a00640 1 -- 172.21.15.42:0/716347813 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe8e0078b90 msgr2=0x7fe8e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:50.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.074+0000 7fe908a00640 1 --2- 172.21.15.42:0/716347813 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe8e0078b90 0x7fe8e007b0a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4006fd0 tx=0x7fe8f4009060 comp rx=0 tx=0).stop 2024-09-17T01:34:50.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.074+0000 7fe908a00640 1 -- 172.21.15.42:0/716347813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe90415b680 msgr2=0x7fe9041f5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:50.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.074+0000 7fe908a00640 1 --2- 172.21.15.42:0/716347813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe90415b680 0x7fe9041f5430 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00c970 tx=0x7fe8ec00ce30 comp rx=0 tx=0).stop 2024-09-17T01:34:50.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.074+0000 7fe908a00640 1 -- 172.21.15.42:0/716347813 shutdown_connections 2024-09-17T01:34:50.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.074+0000 7fe908a00640 1 --2- 172.21.15.42:0/716347813 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe8e0078b90 0x7fe8e007b0a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:50.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.074+0000 7fe908a00640 1 --2- 172.21.15.42:0/716347813 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe9041f5970 0x7fe9040c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:50.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.074+0000 7fe908a00640 1 --2- 172.21.15.42:0/716347813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe90415b680 0x7fe9041f5430 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:50.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.074+0000 7fe908a00640 1 --2- 172.21.15.42:0/716347813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9040cafe0 0x7fe9041e8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:50.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.074+0000 7fe908a00640 1 -- 172.21.15.42:0/716347813 >> 172.21.15.42:0/716347813 conn(0x7fe9040b25f0 msgr2=0x7fe90415a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:50.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.074+0000 7fe908a00640 1 -- 172.21.15.42:0/716347813 shutdown_connections 2024-09-17T01:34:50.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.074+0000 7fe908a00640 1 -- 172.21.15.42:0/716347813 wait complete. 2024-09-17T01:34:50.093 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T01:34:50.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.321+0000 7fd12fc00640 1 -- 172.21.15.42:0/3571595011 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd1280b3550 msgr2=0x7fd12815cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:50.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.321+0000 7fd12fc00640 1 --2- 172.21.15.42:0/3571595011 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd1280b3550 0x7fd12815cec0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd11c009860 tx=0x7fd11c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:34:50.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.321+0000 7fd12fc00640 1 -- 172.21.15.42:0/3571595011 shutdown_connections 2024-09-17T01:34:50.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.321+0000 7fd12fc00640 1 --2- 172.21.15.42:0/3571595011 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd1280b3550 0x7fd12815cec0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:50.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.321+0000 7fd12fc00640 1 -- 172.21.15.42:0/3571595011 >> 172.21.15.42:0/3571595011 conn(0x7fd1280b2930 msgr2=0x7fd12806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:50.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.321+0000 7fd12fc00640 1 -- 172.21.15.42:0/3571595011 shutdown_connections 2024-09-17T01:34:50.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.321+0000 7fd12fc00640 1 -- 172.21.15.42:0/3571595011 wait complete. 2024-09-17T01:34:50.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.323+0000 7fd12fc00640 1 Processor -- start 2024-09-17T01:34:50.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.323+0000 7fd12fc00640 1 -- start start 2024-09-17T01:34:50.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.325+0000 7fd12fc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1280b3550 0x7fd12813ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:50.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.325+0000 7fd12fc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd1280cec40 0x7fd128166e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:50.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.325+0000 7fd12fc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd128142f40 0x7fd128141cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:50.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.325+0000 7fd12fc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd1280cf1d0 con 0x7fd128142f40 2024-09-17T01:34:50.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.325+0000 7fd12fc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd1280cf050 con 0x7fd1280b3550 2024-09-17T01:34:50.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.325+0000 7fd12fc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd1280cf350 con 0x7fd1280cec40 2024-09-17T01:34:50.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.325+0000 7fd12dc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd128142f40 0x7fd128141cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:50.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.325+0000 7fd12dc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd128142f40 0x7fd128141cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56012/0 (socket says 172.21.15.42:56012) 2024-09-17T01:34:50.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.325+0000 7fd12dc00640 1 -- 172.21.15.42:0/1080605856 learned_addr learned my addr 172.21.15.42:0/1080605856 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:50.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.326+0000 7fd12d200640 1 --2- 172.21.15.42:0/1080605856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1280b3550 0x7fd12813ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:50.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.326+0000 7fd127e00640 1 --2- 172.21.15.42:0/1080605856 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd1280cec40 0x7fd128166e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:50.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.326+0000 7fd12dc00640 1 -- 172.21.15.42:0/1080605856 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd1280cec40 msgr2=0x7fd128166e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:50.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.326+0000 7fd12dc00640 1 --2- 172.21.15.42:0/1080605856 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd1280cec40 0x7fd128166e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:50.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.326+0000 7fd12dc00640 1 -- 172.21.15.42:0/1080605856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1280b3550 msgr2=0x7fd12813ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:50.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.326+0000 7fd12dc00640 1 --2- 172.21.15.42:0/1080605856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1280b3550 0x7fd12813ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:50.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.326+0000 7fd12dc00640 1 -- 172.21.15.42:0/1080605856 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd128142a90 con 0x7fd128142f40 2024-09-17T01:34:50.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.326+0000 7fd127e00640 1 --2- 172.21.15.42:0/1080605856 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd1280cec40 0x7fd128166e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:34:50.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.326+0000 7fd12dc00640 1 --2- 172.21.15.42:0/1080605856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd128142f40 0x7fd128141cb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd12000c760 tx=0x7fd12000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:50.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.326+0000 7fd124c00640 1 -- 172.21.15.42:0/1080605856 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd120003b70 con 0x7fd128142f40 2024-09-17T01:34:50.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.326+0000 7fd124c00640 1 -- 172.21.15.42:0/1080605856 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd120003d10 con 0x7fd128142f40 2024-09-17T01:34:50.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.326+0000 7fd12fc00640 1 -- 172.21.15.42:0/1080605856 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1281f9770 con 0x7fd128142f40 2024-09-17T01:34:50.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.326+0000 7fd124c00640 1 -- 172.21.15.42:0/1080605856 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12000aab0 con 0x7fd128142f40 2024-09-17T01:34:50.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.326+0000 7fd12fc00640 1 -- 172.21.15.42:0/1080605856 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1281f9d30 con 0x7fd128142f40 2024-09-17T01:34:50.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.328+0000 7fd12fc00640 1 -- 172.21.15.42:0/1080605856 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd12806a3f0 con 0x7fd128142f40 2024-09-17T01:34:50.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.329+0000 7fd124c00640 1 -- 172.21.15.42:0/1080605856 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd12000ac50 con 0x7fd128142f40 2024-09-17T01:34:50.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.330+0000 7fd124c00640 1 --2- 172.21.15.42:0/1080605856 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd108078bc0 0x7fd10807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:50.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.331+0000 7fd124c00640 1 -- 172.21.15.42:0/1080605856 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5853+0+0 (secure 0 0 0) 0x7fd12009ac70 con 0x7fd128142f40 2024-09-17T01:34:50.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.331+0000 7fd12d200640 1 --2- 172.21.15.42:0/1080605856 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd108078bc0 0x7fd10807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:50.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.332+0000 7fd12d200640 1 --2- 172.21.15.42:0/1080605856 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd108078bc0 0x7fd10807b0d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd11c034000 tx=0x7fd11c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:50.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.335+0000 7fd124c00640 1 -- 172.21.15.42:0/1080605856 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd12806a3f0 con 0x7fd128142f40 2024-09-17T01:34:50.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.568+0000 7fd12fc00640 1 -- 172.21.15.42:0/1080605856 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd12815cec0 con 0x7fd128142f40 2024-09-17T01:34:50.566 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-17T01:34:50.569+0000 7f9961e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:34:50.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.571+0000 7fd124c00640 1 -- 172.21.15.42:0/1080605856 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7fd120062f80 con 0x7fd128142f40 2024-09-17T01:34:50.569 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T01:34:50.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.574+0000 7fd12fc00640 1 -- 172.21.15.42:0/1080605856 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd108078bc0 msgr2=0x7fd10807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:50.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.574+0000 7fd12fc00640 1 --2- 172.21.15.42:0/1080605856 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd108078bc0 0x7fd10807b0d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd11c034000 tx=0x7fd11c004730 comp rx=0 tx=0).stop 2024-09-17T01:34:50.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.574+0000 7fd12fc00640 1 -- 172.21.15.42:0/1080605856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd128142f40 msgr2=0x7fd128141cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:50.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.574+0000 7fd12fc00640 1 --2- 172.21.15.42:0/1080605856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd128142f40 0x7fd128141cb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd12000c760 tx=0x7fd12000cc20 comp rx=0 tx=0).stop 2024-09-17T01:34:50.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.575+0000 7fd12fc00640 1 -- 172.21.15.42:0/1080605856 shutdown_connections 2024-09-17T01:34:50.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.575+0000 7fd12fc00640 1 --2- 172.21.15.42:0/1080605856 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd108078bc0 0x7fd10807b0d0 secure :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd11c034000 tx=0x7fd11c004730 comp rx=0 tx=0).stop 2024-09-17T01:34:50.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.575+0000 7fd12fc00640 1 --2- 172.21.15.42:0/1080605856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd128142f40 0x7fd128141cb0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:50.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.575+0000 7fd12fc00640 1 --2- 172.21.15.42:0/1080605856 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd1280cec40 0x7fd128166e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:50.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.575+0000 7fd12fc00640 1 --2- 172.21.15.42:0/1080605856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1280b3550 0x7fd12813ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:50.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.575+0000 7fd12fc00640 1 -- 172.21.15.42:0/1080605856 >> 172.21.15.42:0/1080605856 conn(0x7fd1280b2930 msgr2=0x7fd128073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:50.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.575+0000 7fd12fc00640 1 -- 172.21.15.42:0/1080605856 shutdown_connections 2024-09-17T01:34:50.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.575+0000 7fd12fc00640 1 -- 172.21.15.42:0/1080605856 wait complete. 2024-09-17T01:34:50.594 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T01:34:50.725 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:34:50.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.834+0000 7f4f1da00640 1 -- 172.21.15.42:0/3312866732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f1815c6c0 msgr2=0x7f4f180cf990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:50.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.834+0000 7f4f1da00640 1 --2- 172.21.15.42:0/3312866732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f1815c6c0 0x7f4f180cf990 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4f180703e0 tx=0x7f4f0002a4d0 comp rx=0 tx=0).stop 2024-09-17T01:34:50.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.834+0000 7f4f1da00640 1 -- 172.21.15.42:0/3312866732 shutdown_connections 2024-09-17T01:34:50.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.834+0000 7f4f1da00640 1 --2- 172.21.15.42:0/3312866732 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f180b32b0 0x7f4f180b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:50.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.834+0000 7f4f1da00640 1 --2- 172.21.15.42:0/3312866732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f1815c6c0 0x7f4f180cf990 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:50.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.834+0000 7f4f1da00640 1 --2- 172.21.15.42:0/3312866732 >> v2:172.21.15.43:3300/0 conn(0x7f4f180af910 0x7f4f180ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:50.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.834+0000 7f4f1da00640 1 -- 172.21.15.42:0/3312866732 >> 172.21.15.42:0/3312866732 conn(0x7f4f1806d440 msgr2=0x7f4f180b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:50.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.834+0000 7f4f1da00640 1 -- 172.21.15.42:0/3312866732 shutdown_connections 2024-09-17T01:34:50.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.834+0000 7f4f1da00640 1 -- 172.21.15.42:0/3312866732 wait complete. 2024-09-17T01:34:50.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.836+0000 7f4f1da00640 1 Processor -- start 2024-09-17T01:34:50.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.836+0000 7f4f1da00640 1 -- start start 2024-09-17T01:34:50.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.838+0000 7f4f1da00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f180af910 0x7f4f181466b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:50.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.838+0000 7f4f1da00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f180b32b0 0x7f4f1815a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:50.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.838+0000 7f4f1da00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f1815c6c0 0x7f4f1815ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:50.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.838+0000 7f4f1da00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1806e470 con 0x7f4f1815c6c0 2024-09-17T01:34:50.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.838+0000 7f4f1da00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1806e2f0 con 0x7f4f180af910 2024-09-17T01:34:50.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.838+0000 7f4f1da00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4f1806e5f0 con 0x7f4f180b32b0 2024-09-17T01:34:50.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.838+0000 7f4f1d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f1815c6c0 0x7f4f1815ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:50.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.838+0000 7f4f1d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f1815c6c0 0x7f4f1815ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56036/0 (socket says 172.21.15.42:56036) 2024-09-17T01:34:50.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.838+0000 7f4f1d000640 1 -- 172.21.15.42:0/2384583560 learned_addr learned my addr 172.21.15.42:0/2384583560 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:50.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.838+0000 7f4f17e00640 1 --2- 172.21.15.42:0/2384583560 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f180af910 0x7f4f181466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:50.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.838+0000 7f4f0f400640 1 --2- 172.21.15.42:0/2384583560 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f180b32b0 0x7f4f1815a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:50.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.838+0000 7f4f1d000640 1 -- 172.21.15.42:0/2384583560 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f180b32b0 msgr2=0x7f4f1815a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:50.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.838+0000 7f4f1d000640 1 --2- 172.21.15.42:0/2384583560 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f180b32b0 0x7f4f1815a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:50.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.838+0000 7f4f1d000640 1 -- 172.21.15.42:0/2384583560 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f180af910 msgr2=0x7f4f181466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:50.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.838+0000 7f4f1d000640 1 --2- 172.21.15.42:0/2384583560 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f180af910 0x7f4f181466b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:50.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.838+0000 7f4f1d000640 1 -- 172.21.15.42:0/2384583560 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f181501a0 con 0x7f4f1815c6c0 2024-09-17T01:34:50.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.839+0000 7f4f1d000640 1 --2- 172.21.15.42:0/2384583560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f1815c6c0 0x7f4f1815ab30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000ea80 tx=0x7f4f1000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:50.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.839+0000 7f4f14c00640 1 -- 172.21.15.42:0/2384583560 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10004b20 con 0x7f4f1815c6c0 2024-09-17T01:34:50.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.839+0000 7f4f14c00640 1 -- 172.21.15.42:0/2384583560 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f10004ce0 con 0x7f4f1815c6c0 2024-09-17T01:34:50.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.839+0000 7f4f14c00640 1 -- 172.21.15.42:0/2384583560 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f10005280 con 0x7f4f1815c6c0 2024-09-17T01:34:50.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.839+0000 7f4f1da00640 1 -- 172.21.15.42:0/2384583560 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f18153180 con 0x7f4f1815c6c0 2024-09-17T01:34:50.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.839+0000 7f4f1da00640 1 -- 172.21.15.42:0/2384583560 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f18073bf0 con 0x7f4f1815c6c0 2024-09-17T01:34:50.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.840+0000 7f4f1da00640 1 -- 172.21.15.42:0/2384583560 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f18150410 con 0x7f4f1815c6c0 2024-09-17T01:34:50.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.842+0000 7f4f14c00640 1 -- 172.21.15.42:0/2384583560 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4f10005420 con 0x7f4f1815c6c0 2024-09-17T01:34:50.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.843+0000 7f4f14c00640 1 --2- 172.21.15.42:0/2384583560 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4ef4078b90 0x7f4ef407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:50.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.843+0000 7f4f14c00640 1 -- 172.21.15.42:0/2384583560 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5911+0+0 (secure 0 0 0) 0x7f4f1009b900 con 0x7f4f1815c6c0 2024-09-17T01:34:50.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.844+0000 7f4f17e00640 1 --2- 172.21.15.42:0/2384583560 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4ef4078b90 0x7f4ef407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:50.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.844+0000 7f4f17e00640 1 --2- 172.21.15.42:0/2384583560 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4ef4078b90 0x7f4ef407b0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009b30 tx=0x7f4f08005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:50.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:50.848+0000 7f4f14c00640 1 -- 172.21.15.42:0/2384583560 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4f10063610 con 0x7f4f1815c6c0 2024-09-17T01:34:51.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.080+0000 7f4f1da00640 1 -- 172.21.15.42:0/2384583560 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4f18075610 con 0x7f4f1815c6c0 2024-09-17T01:34:51.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.577+0000 7f4f14c00640 1 -- 172.21.15.42:0/2384583560 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7f4f10068040 con 0x7f4f1815c6c0 2024-09-17T01:34:51.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.579+0000 7f4f1da00640 1 -- 172.21.15.42:0/2384583560 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4ef4078b90 msgr2=0x7f4ef407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:51.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.579+0000 7f4f1da00640 1 --2- 172.21.15.42:0/2384583560 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4ef4078b90 0x7f4ef407b0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009b30 tx=0x7f4f08005f90 comp rx=0 tx=0).stop 2024-09-17T01:34:51.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.579+0000 7f4f1da00640 1 -- 172.21.15.42:0/2384583560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f1815c6c0 msgr2=0x7f4f1815ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:51.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.579+0000 7f4f1da00640 1 --2- 172.21.15.42:0/2384583560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f1815c6c0 0x7f4f1815ab30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000ea80 tx=0x7f4f1000ef40 comp rx=0 tx=0).stop 2024-09-17T01:34:51.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.579+0000 7f4f1da00640 1 -- 172.21.15.42:0/2384583560 shutdown_connections 2024-09-17T01:34:51.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.579+0000 7f4f1da00640 1 --2- 172.21.15.42:0/2384583560 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4ef4078b90 0x7f4ef407b0a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:51.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.579+0000 7f4f1da00640 1 --2- 172.21.15.42:0/2384583560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f1815c6c0 0x7f4f1815ab30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:51.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.580+0000 7f4f1da00640 1 --2- 172.21.15.42:0/2384583560 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f180b32b0 0x7f4f1815a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:51.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.580+0000 7f4f1da00640 1 --2- 172.21.15.42:0/2384583560 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f180af910 0x7f4f181466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:51.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.580+0000 7f4f1da00640 1 -- 172.21.15.42:0/2384583560 >> 172.21.15.42:0/2384583560 conn(0x7f4f1806d440 msgr2=0x7f4f180b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:51.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.580+0000 7f4f1da00640 1 -- 172.21.15.42:0/2384583560 shutdown_connections 2024-09-17T01:34:51.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.580+0000 7f4f1da00640 1 -- 172.21.15.42:0/2384583560 wait complete. 2024-09-17T01:34:51.601 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T01:34:51.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.838+0000 7f839f200640 1 -- 172.21.15.42:0/52456968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8384003a50 msgr2=0x7f8384003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:51.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.838+0000 7f839f200640 1 --2- 172.21.15.42:0/52456968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8384003a50 0x7f8384003ec0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8390006fc0 tx=0x7f8384005830 comp rx=0 tx=0).stop 2024-09-17T01:34:51.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.838+0000 7f839f200640 1 -- 172.21.15.42:0/52456968 shutdown_connections 2024-09-17T01:34:51.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.838+0000 7f839f200640 1 --2- 172.21.15.42:0/52456968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8384003a50 0x7f8384003ec0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:51.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.838+0000 7f839f200640 1 -- 172.21.15.42:0/52456968 >> 172.21.15.42:0/52456968 conn(0x7f83a00b25d0 msgr2=0x7f83a00d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:51.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.838+0000 7f839f200640 1 -- 172.21.15.42:0/52456968 shutdown_connections 2024-09-17T01:34:51.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.838+0000 7f839f200640 1 -- 172.21.15.42:0/52456968 wait complete. 2024-09-17T01:34:51.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.840+0000 7f839f200640 1 Processor -- start 2024-09-17T01:34:51.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.841+0000 7f839f200640 1 -- start start 2024-09-17T01:34:51.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.842+0000 7f839f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8384003a50 0x7f83a01f9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:51.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.842+0000 7f839f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83a01f8b20 0x7f83a01f9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:51.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.842+0000 7f839f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f83a0073500 0x7f83a0073910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:51.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.842+0000 7f839f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f83a015da30 con 0x7f8384003a50 2024-09-17T01:34:51.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.842+0000 7f839f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f83a015d8b0 con 0x7f83a01f8b20 2024-09-17T01:34:51.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.842+0000 7f839f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f83a015dbb0 con 0x7f83a0073500 2024-09-17T01:34:51.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.842+0000 7f839de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8384003a50 0x7f83a01f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:51.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.842+0000 7f839de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8384003a50 0x7f83a01f9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56044/0 (socket says 172.21.15.42:56044) 2024-09-17T01:34:51.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.842+0000 7f839de00640 1 -- 172.21.15.42:0/873095238 learned_addr learned my addr 172.21.15.42:0/873095238 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:51.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.843+0000 7f8397e00640 1 --2- 172.21.15.42:0/873095238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83a01f8b20 0x7f83a01f9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:51.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.843+0000 7f839e800640 1 --2- 172.21.15.42:0/873095238 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f83a0073500 0x7f83a0073910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:51.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.843+0000 7f839de00640 1 -- 172.21.15.42:0/873095238 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f83a0073500 msgr2=0x7f83a0073910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:51.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.843+0000 7f839de00640 1 --2- 172.21.15.42:0/873095238 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f83a0073500 0x7f83a0073910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:51.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.843+0000 7f839de00640 1 -- 172.21.15.42:0/873095238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83a01f8b20 msgr2=0x7f83a01f9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:51.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.843+0000 7f839de00640 1 --2- 172.21.15.42:0/873095238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83a01f8b20 0x7f83a01f9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:51.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.843+0000 7f839de00640 1 -- 172.21.15.42:0/873095238 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a0073e50 con 0x7f8384003a50 2024-09-17T01:34:51.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.843+0000 7f8397e00640 1 --2- 172.21.15.42:0/873095238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83a01f8b20 0x7f83a01f9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:34:51.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.843+0000 7f839e800640 1 --2- 172.21.15.42:0/873095238 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f83a0073500 0x7f83a0073910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:34:51.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.843+0000 7f839de00640 1 --2- 172.21.15.42:0/873095238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8384003a50 0x7f83a01f9100 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f839000c350 tx=0x7f8390006d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:51.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.843+0000 7f8396000640 1 -- 172.21.15.42:0/873095238 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83900037f0 con 0x7f8384003a50 2024-09-17T01:34:51.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.843+0000 7f8396000640 1 -- 172.21.15.42:0/873095238 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8390003990 con 0x7f8384003a50 2024-09-17T01:34:51.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.843+0000 7f8396000640 1 -- 172.21.15.42:0/873095238 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8390003da0 con 0x7f8384003a50 2024-09-17T01:34:51.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.843+0000 7f839f200640 1 -- 172.21.15.42:0/873095238 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a01f5aa0 con 0x7f8384003a50 2024-09-17T01:34:51.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.844+0000 7f839f200640 1 -- 172.21.15.42:0/873095238 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a01f6060 con 0x7f8384003a50 2024-09-17T01:34:51.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.844+0000 7f839f200640 1 -- 172.21.15.42:0/873095238 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83a006cf50 con 0x7f8384003a50 2024-09-17T01:34:51.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.847+0000 7f8396000640 1 -- 172.21.15.42:0/873095238 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8390035020 con 0x7f8384003a50 2024-09-17T01:34:51.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.848+0000 7f8396000640 1 --2- 172.21.15.42:0/873095238 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f837c078b90 0x7f837c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:51.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.848+0000 7f8396000640 1 -- 172.21.15.42:0/873095238 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5911+0+0 (secure 0 0 0) 0x7f83900bbd10 con 0x7f8384003a50 2024-09-17T01:34:51.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.849+0000 7f8397e00640 1 --2- 172.21.15.42:0/873095238 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f837c078b90 0x7f837c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:51.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.849+0000 7f8397e00640 1 --2- 172.21.15.42:0/873095238 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f837c078b90 0x7f837c07b0a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f83a0077540 tx=0x7f8388006b70 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:51.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:51.851+0000 7f8396000640 1 -- 172.21.15.42:0/873095238 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f83a0073e50 con 0x7f8384003a50 2024-09-17T01:34:52.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.045+0000 7f839f200640 1 -- 172.21.15.42:0/873095238 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f83a00ad910 con 0x7f8384003a50 2024-09-17T01:34:52.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.579+0000 7f8396000640 1 -- 172.21.15.42:0/873095238 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) ==== 181+0+0 (secure 0 0 0) 0x7f83900840f0 con 0x7f8384003a50 2024-09-17T01:34:52.577 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-09-17T01:34:52.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.582+0000 7f839f200640 1 -- 172.21.15.42:0/873095238 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f837c078b90 msgr2=0x7f837c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:52.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.582+0000 7f839f200640 1 --2- 172.21.15.42:0/873095238 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f837c078b90 0x7f837c07b0a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f83a0077540 tx=0x7f8388006b70 comp rx=0 tx=0).stop 2024-09-17T01:34:52.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.582+0000 7f839f200640 1 -- 172.21.15.42:0/873095238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8384003a50 msgr2=0x7f83a01f9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:52.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.582+0000 7f839f200640 1 --2- 172.21.15.42:0/873095238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8384003a50 0x7f83a01f9100 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f839000c350 tx=0x7f8390006d20 comp rx=0 tx=0).stop 2024-09-17T01:34:52.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.583+0000 7f839f200640 1 -- 172.21.15.42:0/873095238 shutdown_connections 2024-09-17T01:34:52.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.583+0000 7f839f200640 1 --2- 172.21.15.42:0/873095238 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f837c078b90 0x7f837c07b0a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:52.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.583+0000 7f839f200640 1 --2- 172.21.15.42:0/873095238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83a01f8b20 0x7f83a01f9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:52.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.583+0000 7f839f200640 1 --2- 172.21.15.42:0/873095238 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f83a0073500 0x7f83a0073910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:52.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.583+0000 7f839f200640 1 --2- 172.21.15.42:0/873095238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8384003a50 0x7f83a01f9100 secure :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f839000c350 tx=0x7f8390006d20 comp rx=0 tx=0).stop 2024-09-17T01:34:52.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.583+0000 7f839f200640 1 -- 172.21.15.42:0/873095238 >> 172.21.15.42:0/873095238 conn(0x7f83a00b25d0 msgr2=0x7f83a01eaed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:52.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.583+0000 7f839f200640 1 -- 172.21.15.42:0/873095238 shutdown_connections 2024-09-17T01:34:52.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.584+0000 7f839f200640 1 -- 172.21.15.42:0/873095238 wait complete. 2024-09-17T01:34:52.609 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T01:34:52.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.853+0000 7fa4a3c00640 1 -- 172.21.15.42:0/217242775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa49c06dd30 msgr2=0x7fa49c06e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:52.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.853+0000 7fa4a3c00640 1 --2- 172.21.15.42:0/217242775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa49c06dd30 0x7fa49c06e140 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa488009830 tx=0x7fa48802a5c0 comp rx=0 tx=0).stop 2024-09-17T01:34:52.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.853+0000 7fa4a3c00640 1 -- 172.21.15.42:0/217242775 shutdown_connections 2024-09-17T01:34:52.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.853+0000 7fa4a3c00640 1 --2- 172.21.15.42:0/217242775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa49c06dd30 0x7fa49c06e140 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:52.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.853+0000 7fa4a3c00640 1 -- 172.21.15.42:0/217242775 >> 172.21.15.42:0/217242775 conn(0x7fa49c073aa0 msgr2=0x7fa49c073eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:52.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.853+0000 7fa4a3c00640 1 -- 172.21.15.42:0/217242775 shutdown_connections 2024-09-17T01:34:52.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.853+0000 7fa4a3c00640 1 -- 172.21.15.42:0/217242775 wait complete. 2024-09-17T01:34:52.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.855+0000 7fa4a3c00640 1 Processor -- start 2024-09-17T01:34:52.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.855+0000 7fa4a3c00640 1 -- start start 2024-09-17T01:34:52.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.857+0000 7fa4a3c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa49c06dd30 0x7fa49c1f98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:52.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.857+0000 7fa4a3c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa49c0aee40 0x7fa49c142800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:52.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.857+0000 7fa4a3c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa49c15f2b0 0x7fa49c0b2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:52.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.857+0000 7fa4a3c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c0af250 con 0x7fa49c15f2b0 2024-09-17T01:34:52.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.857+0000 7fa4a3c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c0b0070 con 0x7fa49c0aee40 2024-09-17T01:34:52.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.857+0000 7fa4a3c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa49c158440 con 0x7fa49c06dd30 2024-09-17T01:34:52.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.857+0000 7fa4a1c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa49c15f2b0 0x7fa49c0b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:52.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.857+0000 7fa4a1c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa49c15f2b0 0x7fa49c0b2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56064/0 (socket says 172.21.15.42:56064) 2024-09-17T01:34:52.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.857+0000 7fa4a1c00640 1 -- 172.21.15.42:0/3193753715 learned_addr learned my addr 172.21.15.42:0/3193753715 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:52.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.857+0000 7fa49be00640 1 --2- 172.21.15.42:0/3193753715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa49c0aee40 0x7fa49c142800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:52.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.857+0000 7fa4a1200640 1 --2- 172.21.15.42:0/3193753715 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa49c06dd30 0x7fa49c1f98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:52.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.858+0000 7fa4a1c00640 1 -- 172.21.15.42:0/3193753715 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa49c06dd30 msgr2=0x7fa49c1f98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:52.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.858+0000 7fa4a1c00640 1 --2- 172.21.15.42:0/3193753715 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa49c06dd30 0x7fa49c1f98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:52.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.858+0000 7fa4a1c00640 1 -- 172.21.15.42:0/3193753715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa49c0aee40 msgr2=0x7fa49c142800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:52.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.858+0000 7fa4a1c00640 1 --2- 172.21.15.42:0/3193753715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa49c0aee40 0x7fa49c142800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:52.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.858+0000 7fa4a1c00640 1 -- 172.21.15.42:0/3193753715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c1f9df0 con 0x7fa49c15f2b0 2024-09-17T01:34:52.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.858+0000 7fa4a1c00640 1 --2- 172.21.15.42:0/3193753715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa49c15f2b0 0x7fa49c0b2580 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa49400c760 tx=0x7fa49400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:52.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.858+0000 7fa498c00640 1 -- 172.21.15.42:0/3193753715 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa494003b70 con 0x7fa49c15f2b0 2024-09-17T01:34:52.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.858+0000 7fa498c00640 1 -- 172.21.15.42:0/3193753715 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa494003d30 con 0x7fa49c15f2b0 2024-09-17T01:34:52.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.858+0000 7fa498c00640 1 -- 172.21.15.42:0/3193753715 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4940052d0 con 0x7fa49c15f2b0 2024-09-17T01:34:52.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.858+0000 7fa4a3c00640 1 -- 172.21.15.42:0/3193753715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa49c1f5860 con 0x7fa49c15f2b0 2024-09-17T01:34:52.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.858+0000 7fa4a3c00640 1 -- 172.21.15.42:0/3193753715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa49c1f60f0 con 0x7fa49c15f2b0 2024-09-17T01:34:52.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.859+0000 7fa4a3c00640 1 -- 172.21.15.42:0/3193753715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa49c06e140 con 0x7fa49c15f2b0 2024-09-17T01:34:52.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.860+0000 7fa498c00640 1 -- 172.21.15.42:0/3193753715 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa494005470 con 0x7fa49c15f2b0 2024-09-17T01:34:52.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.862+0000 7fa498c00640 1 --2- 172.21.15.42:0/3193753715 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa47c078b90 0x7fa47c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:52.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.862+0000 7fa498c00640 1 -- 172.21.15.42:0/3193753715 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5473+0+0 (secure 0 0 0) 0x7fa49409a900 con 0x7fa49c15f2b0 2024-09-17T01:34:52.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.863+0000 7fa4a1200640 1 --2- 172.21.15.42:0/3193753715 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa47c078b90 0x7fa47c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:52.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.864+0000 7fa4a1200640 1 --2- 172.21.15.42:0/3193753715 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa47c078b90 0x7fa47c07b0a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa490000f60 tx=0x7fa490009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:52.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:52.867+0000 7fa498c00640 1 -- 172.21.15.42:0/3193753715 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa49c1f9df0 con 0x7fa49c15f2b0 2024-09-17T01:34:53.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.060+0000 7fa4a3c00640 1 -- 172.21.15.42:0/3193753715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa49c0b3380 con 0x7fa49c15f2b0 2024-09-17T01:34:53.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.585+0000 7fa498c00640 1 -- 172.21.15.42:0/3193753715 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) ==== 169+0+0 (secure 0 0 0) 0x7fa49c06e680 con 0x7fa49c15f2b0 2024-09-17T01:34:53.583 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-09-17T01:34:53.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.589+0000 7fa4a3c00640 1 -- 172.21.15.42:0/3193753715 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa47c078b90 msgr2=0x7fa47c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:53.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.589+0000 7fa4a3c00640 1 --2- 172.21.15.42:0/3193753715 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa47c078b90 0x7fa47c07b0a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa490000f60 tx=0x7fa490009040 comp rx=0 tx=0).stop 2024-09-17T01:34:53.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.590+0000 7fa4a3c00640 1 -- 172.21.15.42:0/3193753715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa49c15f2b0 msgr2=0x7fa49c0b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:53.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.590+0000 7fa4a3c00640 1 --2- 172.21.15.42:0/3193753715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa49c15f2b0 0x7fa49c0b2580 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa49400c760 tx=0x7fa49400cc20 comp rx=0 tx=0).stop 2024-09-17T01:34:53.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.590+0000 7fa4a3c00640 1 -- 172.21.15.42:0/3193753715 shutdown_connections 2024-09-17T01:34:53.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.590+0000 7fa4a3c00640 1 --2- 172.21.15.42:0/3193753715 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa47c078b90 0x7fa47c07b0a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:53.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.590+0000 7fa4a3c00640 1 --2- 172.21.15.42:0/3193753715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa49c0aee40 0x7fa49c142800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:53.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.590+0000 7fa4a3c00640 1 --2- 172.21.15.42:0/3193753715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa49c15f2b0 0x7fa49c0b2580 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:53.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.590+0000 7fa4a3c00640 1 --2- 172.21.15.42:0/3193753715 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa49c06dd30 0x7fa49c1f98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:53.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.590+0000 7fa4a3c00640 1 -- 172.21.15.42:0/3193753715 >> 172.21.15.42:0/3193753715 conn(0x7fa49c073aa0 msgr2=0x7fa49c068d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:53.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.590+0000 7fa4a3c00640 1 -- 172.21.15.42:0/3193753715 shutdown_connections 2024-09-17T01:34:53.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.590+0000 7fa4a3c00640 1 -- 172.21.15.42:0/3193753715 wait complete. 2024-09-17T01:34:53.625 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T01:34:53.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.860+0000 7f2f46a00640 1 -- 172.21.15.42:0/190512899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f24004800 msgr2=0x7f2f24004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:53.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.860+0000 7f2f46a00640 1 --2- 172.21.15.42:0/190512899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f24004800 0x7f2f24004c10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2f400cf8f0 tx=0x7f2f24005830 comp rx=0 tx=0).stop 2024-09-17T01:34:53.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.860+0000 7f2f44a00640 1 -- 172.21.15.42:0/190512899 reap_dead start 2024-09-17T01:34:53.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.860+0000 7f2f46a00640 1 -- 172.21.15.42:0/190512899 shutdown_connections 2024-09-17T01:34:53.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.860+0000 7f2f46a00640 1 -- 172.21.15.42:0/190512899 >> 172.21.15.42:0/190512899 conn(0x7f2f400b2930 msgr2=0x7f2f4006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:53.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.860+0000 7f2f46a00640 1 -- 172.21.15.42:0/190512899 shutdown_connections 2024-09-17T01:34:53.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.860+0000 7f2f46a00640 1 -- 172.21.15.42:0/190512899 wait complete. 2024-09-17T01:34:53.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.862+0000 7f2f46a00640 1 Processor -- start 2024-09-17T01:34:53.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.862+0000 7f2f46a00640 1 -- start start 2024-09-17T01:34:53.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.864+0000 7f2f46a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f24004800 0x7f2f4014fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:53.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.864+0000 7f2f46a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f401f6410 0x7f2f40149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:53.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.864+0000 7f2f46a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f401506f0 0x7f2f40150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:53.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.864+0000 7f2f46a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4006dbd0 con 0x7f2f401f6410 2024-09-17T01:34:53.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.864+0000 7f2f46a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4006da50 con 0x7f2f401506f0 2024-09-17T01:34:53.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.864+0000 7f2f46a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2f40073450 con 0x7f2f24004800 2024-09-17T01:34:53.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.864+0000 7f2f3f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f401f6410 0x7f2f40149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:53.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.864+0000 7f2f3f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f401f6410 0x7f2f40149110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56084/0 (socket says 172.21.15.42:56084) 2024-09-17T01:34:53.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.864+0000 7f2f3f400640 1 -- 172.21.15.42:0/4123156110 learned_addr learned my addr 172.21.15.42:0/4123156110 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:53.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.864+0000 7f2f3fe00640 1 --2- 172.21.15.42:0/4123156110 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f24004800 0x7f2f4014fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:53.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.864+0000 7f2f44a00640 1 --2- 172.21.15.42:0/4123156110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f401506f0 0x7f2f40150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:53.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.864+0000 7f2f3f400640 1 -- 172.21.15.42:0/4123156110 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f24004800 msgr2=0x7f2f4014fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:53.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.865+0000 7f2f3f400640 1 --2- 172.21.15.42:0/4123156110 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f24004800 0x7f2f4014fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:53.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.865+0000 7f2f3f400640 1 -- 172.21.15.42:0/4123156110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f401506f0 msgr2=0x7f2f40150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:53.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.865+0000 7f2f3f400640 1 --2- 172.21.15.42:0/4123156110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f401506f0 0x7f2f40150b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:53.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.865+0000 7f2f3f400640 1 -- 172.21.15.42:0/4123156110 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f40151040 con 0x7f2f401f6410 2024-09-17T01:34:53.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.865+0000 7f2f3f400640 1 --2- 172.21.15.42:0/4123156110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f401f6410 0x7f2f40149110 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c02af40 tx=0x7f2f2c032640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:53.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.865+0000 7f2f37e00640 1 -- 172.21.15.42:0/4123156110 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c004230 con 0x7f2f401f6410 2024-09-17T01:34:53.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.865+0000 7f2f37e00640 1 -- 172.21.15.42:0/4123156110 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f2c032830 con 0x7f2f401f6410 2024-09-17T01:34:53.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.865+0000 7f2f37e00640 1 -- 172.21.15.42:0/4123156110 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c0044c0 con 0x7f2f401f6410 2024-09-17T01:34:53.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.865+0000 7f2f46a00640 1 -- 172.21.15.42:0/4123156110 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f40149d90 con 0x7f2f401f6410 2024-09-17T01:34:53.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.865+0000 7f2f46a00640 1 -- 172.21.15.42:0/4123156110 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f4014a350 con 0x7f2f401f6410 2024-09-17T01:34:53.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.867+0000 7f2f46a00640 1 -- 172.21.15.42:0/4123156110 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f4015f890 con 0x7f2f401f6410 2024-09-17T01:34:53.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.868+0000 7f2f37e00640 1 -- 172.21.15.42:0/4123156110 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2f2c032c60 con 0x7f2f401f6410 2024-09-17T01:34:53.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.868+0000 7f2f37e00640 1 --2- 172.21.15.42:0/4123156110 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f20078bc0 0x7f2f2007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:53.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.869+0000 7f2f37e00640 1 -- 172.21.15.42:0/4123156110 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f2f2c0bb760 con 0x7f2f401f6410 2024-09-17T01:34:53.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.869+0000 7f2f3fe00640 1 --2- 172.21.15.42:0/4123156110 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f20078bc0 0x7f2f2007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:53.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.870+0000 7f2f3fe00640 1 --2- 172.21.15.42:0/4123156110 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f20078bc0 0x7f2f2007b0d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2f30001dd0 tx=0x7f2f30001d60 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:53.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:53.873+0000 7f2f37e00640 1 -- 172.21.15.42:0/4123156110 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2f40151040 con 0x7f2f401f6410 2024-09-17T01:34:54.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.066+0000 7f2f46a00640 1 -- 172.21.15.42:0/4123156110 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f2f4006a170 con 0x7f2f401f6410 2024-09-17T01:34:54.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.070+0000 7f2f37e00640 1 -- 172.21.15.42:0/4123156110 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v33) ==== 71+0+0 (secure 0 0 0) 0x7f2f2c040070 con 0x7f2f401f6410 2024-09-17T01:34:54.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.072+0000 7f2f46a00640 1 -- 172.21.15.42:0/4123156110 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f20078bc0 msgr2=0x7f2f2007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:54.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.072+0000 7f2f46a00640 1 --2- 172.21.15.42:0/4123156110 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f20078bc0 0x7f2f2007b0d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2f30001dd0 tx=0x7f2f30001d60 comp rx=0 tx=0).stop 2024-09-17T01:34:54.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.072+0000 7f2f46a00640 1 -- 172.21.15.42:0/4123156110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f401f6410 msgr2=0x7f2f40149110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:54.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.072+0000 7f2f46a00640 1 --2- 172.21.15.42:0/4123156110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f401f6410 0x7f2f40149110 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c02af40 tx=0x7f2f2c032640 comp rx=0 tx=0).stop 2024-09-17T01:34:54.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.073+0000 7f2f46a00640 1 -- 172.21.15.42:0/4123156110 shutdown_connections 2024-09-17T01:34:54.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.073+0000 7f2f46a00640 1 --2- 172.21.15.42:0/4123156110 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f20078bc0 0x7f2f2007b0d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:54.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.073+0000 7f2f46a00640 1 --2- 172.21.15.42:0/4123156110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f401506f0 0x7f2f40150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:54.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.073+0000 7f2f46a00640 1 --2- 172.21.15.42:0/4123156110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f401f6410 0x7f2f40149110 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:54.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.073+0000 7f2f46a00640 1 --2- 172.21.15.42:0/4123156110 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f24004800 0x7f2f4014fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:54.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.073+0000 7f2f46a00640 1 -- 172.21.15.42:0/4123156110 >> 172.21.15.42:0/4123156110 conn(0x7f2f400b2930 msgr2=0x7f2f400ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:54.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.073+0000 7f2f46a00640 1 -- 172.21.15.42:0/4123156110 shutdown_connections 2024-09-17T01:34:54.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.073+0000 7f2f46a00640 1 -- 172.21.15.42:0/4123156110 wait complete. 2024-09-17T01:34:54.091 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-09-17T01:34:54.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.323+0000 7fa1bb200640 1 -- 172.21.15.42:0/2773110277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1a00041c0 msgr2=0x7fa1a0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:54.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.323+0000 7fa1bb200640 1 --2- 172.21.15.42:0/2773110277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1a00041c0 0x7fa1a0004800 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8001830 tx=0x7fa1a0005830 comp rx=0 tx=0).stop 2024-09-17T01:34:54.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.323+0000 7fa1ba800640 1 -- 172.21.15.42:0/2773110277 reap_dead start 2024-09-17T01:34:54.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.323+0000 7fa1bb200640 1 -- 172.21.15.42:0/2773110277 shutdown_connections 2024-09-17T01:34:54.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.323+0000 7fa1bb200640 1 -- 172.21.15.42:0/2773110277 >> 172.21.15.42:0/2773110277 conn(0x7fa1bc0b25f0 msgr2=0x7fa1bc0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:54.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.323+0000 7fa1bb200640 1 -- 172.21.15.42:0/2773110277 shutdown_connections 2024-09-17T01:34:54.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.323+0000 7fa1bb200640 1 -- 172.21.15.42:0/2773110277 wait complete. 2024-09-17T01:34:54.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.325+0000 7fa1bb200640 1 Processor -- start 2024-09-17T01:34:54.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.325+0000 7fa1bb200640 1 -- start start 2024-09-17T01:34:54.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.327+0000 7fa1bb200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1a00041c0 0x7fa1bc0cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:54.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.327+0000 7fa1bb200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa1bc1e79f0 0x7fa1bc0747b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:54.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.327+0000 7fa1bb200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1bc1f5ea0 0x7fa1bc1f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:54.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.327+0000 7fa1bb200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa1bc15d6b0 con 0x7fa1a00041c0 2024-09-17T01:34:54.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.327+0000 7fa1bb200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa1bc0b4310 con 0x7fa1bc1f5ea0 2024-09-17T01:34:54.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.327+0000 7fa1bb200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa1bc15d830 con 0x7fa1bc1e79f0 2024-09-17T01:34:54.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.327+0000 7fa1b9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1a00041c0 0x7fa1bc0cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:54.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.327+0000 7fa1b9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1a00041c0 0x7fa1bc0cc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56090/0 (socket says 172.21.15.42:56090) 2024-09-17T01:34:54.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.327+0000 7fa1b9e00640 1 -- 172.21.15.42:0/698097099 learned_addr learned my addr 172.21.15.42:0/698097099 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:54.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.327+0000 7fa1b9400640 1 --2- 172.21.15.42:0/698097099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa1bc1e79f0 0x7fa1bc0747b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:54.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.327+0000 7fa1ba800640 1 --2- 172.21.15.42:0/698097099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1bc1f5ea0 0x7fa1bc1f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:54.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.328+0000 7fa1b9e00640 1 -- 172.21.15.42:0/698097099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa1bc1e79f0 msgr2=0x7fa1bc0747b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:54.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.328+0000 7fa1b9e00640 1 --2- 172.21.15.42:0/698097099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa1bc1e79f0 0x7fa1bc0747b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:54.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.328+0000 7fa1b9e00640 1 -- 172.21.15.42:0/698097099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1bc1f5ea0 msgr2=0x7fa1bc1f62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:54.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.328+0000 7fa1b9e00640 1 --2- 172.21.15.42:0/698097099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1bc1f5ea0 0x7fa1bc1f62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:54.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.328+0000 7fa1b9e00640 1 -- 172.21.15.42:0/698097099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1bc1f6c50 con 0x7fa1a00041c0 2024-09-17T01:34:54.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.328+0000 7fa1ba800640 1 --2- 172.21.15.42:0/698097099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1bc1f5ea0 0x7fa1bc1f62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:34:54.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.328+0000 7fa1b9400640 1 --2- 172.21.15.42:0/698097099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa1bc1e79f0 0x7fa1bc0747b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:34:54.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.328+0000 7fa1b9e00640 1 --2- 172.21.15.42:0/698097099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1a00041c0 0x7fa1bc0cc420 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac011b10 tx=0x7fa1ac009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:54.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.328+0000 7fa1b2000640 1 -- 172.21.15.42:0/698097099 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac01e070 con 0x7fa1a00041c0 2024-09-17T01:34:54.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.328+0000 7fa1b2000640 1 -- 172.21.15.42:0/698097099 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1ac004050 con 0x7fa1a00041c0 2024-09-17T01:34:54.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.328+0000 7fa1b2000640 1 -- 172.21.15.42:0/698097099 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac00fea0 con 0x7fa1a00041c0 2024-09-17T01:34:54.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.328+0000 7fa1bb200640 1 -- 172.21.15.42:0/698097099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1bc0cb180 con 0x7fa1a00041c0 2024-09-17T01:34:54.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.328+0000 7fa1bb200640 1 -- 172.21.15.42:0/698097099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1bc0cb740 con 0x7fa1a00041c0 2024-09-17T01:34:54.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.329+0000 7fa1bb200640 1 -- 172.21.15.42:0/698097099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1bc0b1610 con 0x7fa1a00041c0 2024-09-17T01:34:54.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.331+0000 7fa1b2000640 1 -- 172.21.15.42:0/698097099 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa1ac021070 con 0x7fa1a00041c0 2024-09-17T01:34:54.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.331+0000 7fa1b2000640 1 --2- 172.21.15.42:0/698097099 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa19c078bf0 0x7fa19c07b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:54.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.332+0000 7fa1b2000640 1 -- 172.21.15.42:0/698097099 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7fa1ac09b410 con 0x7fa1a00041c0 2024-09-17T01:34:54.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.332+0000 7fa1b9400640 1 --2- 172.21.15.42:0/698097099 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa19c078bf0 0x7fa19c07b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:54.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.333+0000 7fa1b9400640 1 --2- 172.21.15.42:0/698097099 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa19c078bf0 0x7fa19c07b100 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8032000 tx=0x7fa1a8001360 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:54.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.336+0000 7fa1b2000640 1 -- 172.21.15.42:0/698097099 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa1bc0b1610 con 0x7fa1a00041c0 2024-09-17T01:34:54.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:54.603+0000 7fa1bb200640 1 -- 172.21.15.42:0/698097099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) -- 0x7fa1bc153750 con 0x7fa1a00041c0 2024-09-17T01:34:55.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.593+0000 7fa1b2000640 1 -- 172.21.15.42:0/698097099 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v143) ==== 148+0+0 (secure 0 0 0) 0x7fa1ac0635b0 con 0x7fa1a00041c0 2024-09-17T01:34:55.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.596+0000 7fa1bb200640 1 -- 172.21.15.42:0/698097099 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa19c078bf0 msgr2=0x7fa19c07b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:55.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.596+0000 7fa1bb200640 1 --2- 172.21.15.42:0/698097099 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa19c078bf0 0x7fa19c07b100 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8032000 tx=0x7fa1a8001360 comp rx=0 tx=0).stop 2024-09-17T01:34:55.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.596+0000 7fa1bb200640 1 -- 172.21.15.42:0/698097099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1a00041c0 msgr2=0x7fa1bc0cc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:55.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.596+0000 7fa1bb200640 1 --2- 172.21.15.42:0/698097099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1a00041c0 0x7fa1bc0cc420 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac011b10 tx=0x7fa1ac009e90 comp rx=0 tx=0).stop 2024-09-17T01:34:55.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.597+0000 7fa1bb200640 1 -- 172.21.15.42:0/698097099 shutdown_connections 2024-09-17T01:34:55.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.597+0000 7fa1bb200640 1 --2- 172.21.15.42:0/698097099 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa19c078bf0 0x7fa19c07b100 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:55.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.597+0000 7fa1bb200640 1 --2- 172.21.15.42:0/698097099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1bc1f5ea0 0x7fa1bc1f62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:55.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.597+0000 7fa1bb200640 1 --2- 172.21.15.42:0/698097099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa1bc1e79f0 0x7fa1bc0747b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:55.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.597+0000 7fa1bb200640 1 --2- 172.21.15.42:0/698097099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1a00041c0 0x7fa1bc0cc420 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:55.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.597+0000 7fa1bb200640 1 -- 172.21.15.42:0/698097099 >> 172.21.15.42:0/698097099 conn(0x7fa1bc0b25f0 msgr2=0x7fa1bc0ce580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:55.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.597+0000 7fa1bb200640 1 -- 172.21.15.42:0/698097099 shutdown_connections 2024-09-17T01:34:55.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.597+0000 7fa1bb200640 1 -- 172.21.15.42:0/698097099 wait complete. 2024-09-17T01:34:55.621 INFO:tasks.cephfs_test_runner:test flag scrub_mdsdir ... ok 2024-09-17T01:34:55.621 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-17T01:34:55.622 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:34:55.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.858+0000 7f89c9600640 1 -- 172.21.15.42:0/2229288760 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89c40b4be0 msgr2=0x7f89c415d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:55.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.858+0000 7f89c9600640 1 --2- 172.21.15.42:0/2229288760 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89c40b4be0 0x7f89c415d6b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f89b4009830 tx=0x7f89b402a540 comp rx=0 tx=0).stop 2024-09-17T01:34:55.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.858+0000 7f89c9600640 1 -- 172.21.15.42:0/2229288760 shutdown_connections 2024-09-17T01:34:55.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.858+0000 7f89c9600640 1 --2- 172.21.15.42:0/2229288760 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89c40b4be0 0x7f89c415d6b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:55.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.858+0000 7f89c9600640 1 -- 172.21.15.42:0/2229288760 >> 172.21.15.42:0/2229288760 conn(0x7f89c40b25f0 msgr2=0x7f89c40d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:55.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.858+0000 7f89c9600640 1 -- 172.21.15.42:0/2229288760 shutdown_connections 2024-09-17T01:34:55.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.858+0000 7f89c9600640 1 -- 172.21.15.42:0/2229288760 wait complete. 2024-09-17T01:34:55.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.860+0000 7f89c9600640 1 Processor -- start 2024-09-17T01:34:55.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.860+0000 7f89c9600640 1 -- start start 2024-09-17T01:34:55.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.861+0000 7f89c9600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89c40b4be0 0x7f89c4074040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:55.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.861+0000 7f89c9600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f89c40cf7c0 0x7f89c40aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:55.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.862+0000 7f89c9600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89c41e5f10 0x7f89c41e6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:55.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.862+0000 7f89c9600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f89c41535e0 con 0x7f89c40b4be0 2024-09-17T01:34:55.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.862+0000 7f89c9600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f89c40b4340 con 0x7f89c41e5f10 2024-09-17T01:34:55.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.862+0000 7f89c9600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f89c4153760 con 0x7f89c40cf7c0 2024-09-17T01:34:55.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.862+0000 7f89c3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89c40b4be0 0x7f89c4074040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:55.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.862+0000 7f89c3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89c40b4be0 0x7f89c4074040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38574/0 (socket says 172.21.15.42:38574) 2024-09-17T01:34:55.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.862+0000 7f89c3e00640 1 -- 172.21.15.42:0/989772251 learned_addr learned my addr 172.21.15.42:0/989772251 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:55.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.862+0000 7f89bb400640 1 --2- 172.21.15.42:0/989772251 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f89c40cf7c0 0x7f89c40aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:55.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.862+0000 7f89c8c00640 1 --2- 172.21.15.42:0/989772251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89c41e5f10 0x7f89c41e6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:55.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.862+0000 7f89c3e00640 1 -- 172.21.15.42:0/989772251 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f89c40cf7c0 msgr2=0x7f89c40aeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:55.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.862+0000 7f89c3e00640 1 --2- 172.21.15.42:0/989772251 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f89c40cf7c0 0x7f89c40aeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:55.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.862+0000 7f89c3e00640 1 -- 172.21.15.42:0/989772251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89c41e5f10 msgr2=0x7f89c41e6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:55.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.862+0000 7f89c3e00640 1 --2- 172.21.15.42:0/989772251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89c41e5f10 0x7f89c41e6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:55.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.862+0000 7f89c3e00640 1 -- 172.21.15.42:0/989772251 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c41e6860 con 0x7f89c40b4be0 2024-09-17T01:34:55.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.862+0000 7f89c8c00640 1 --2- 172.21.15.42:0/989772251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89c41e5f10 0x7f89c41e6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:34:55.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.862+0000 7f89bb400640 1 --2- 172.21.15.42:0/989772251 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f89c40cf7c0 0x7f89c40aeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:34:55.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.863+0000 7f89c3e00640 1 --2- 172.21.15.42:0/989772251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89c40b4be0 0x7f89c4074040 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f89b402ab30 tx=0x7f89b4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:55.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.863+0000 7f89c0c00640 1 -- 172.21.15.42:0/989772251 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b4005c90 con 0x7f89c40b4be0 2024-09-17T01:34:55.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.863+0000 7f89c0c00640 1 -- 172.21.15.42:0/989772251 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89b4005020 con 0x7f89c40b4be0 2024-09-17T01:34:55.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.863+0000 7f89c9600640 1 -- 172.21.15.42:0/989772251 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89c41f5dc0 con 0x7f89c40b4be0 2024-09-17T01:34:55.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.863+0000 7f89c0c00640 1 -- 172.21.15.42:0/989772251 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b4005450 con 0x7f89c40b4be0 2024-09-17T01:34:55.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.863+0000 7f89c9600640 1 -- 172.21.15.42:0/989772251 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89c41f6380 con 0x7f89c40b4be0 2024-09-17T01:34:55.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.864+0000 7f89c9600640 1 -- 172.21.15.42:0/989772251 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89c415d6b0 con 0x7f89c40b4be0 2024-09-17T01:34:55.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.865+0000 7f89c0c00640 1 -- 172.21.15.42:0/989772251 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f89b40317c0 con 0x7f89c40b4be0 2024-09-17T01:34:55.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.867+0000 7f89c0c00640 1 --2- 172.21.15.42:0/989772251 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f89a0078b90 0x7f89a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:55.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.867+0000 7f89c0c00640 1 -- 172.21.15.42:0/989772251 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f89b40bbb30 con 0x7f89c40b4be0 2024-09-17T01:34:55.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.867+0000 7f89bb400640 1 --2- 172.21.15.42:0/989772251 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f89a0078b90 0x7f89a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:55.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.868+0000 7f89bb400640 1 --2- 172.21.15.42:0/989772251 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f89a0078b90 0x7f89a007b0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f89ac001eb0 tx=0x7f89ac009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:55.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:55.872+0000 7f89c0c00640 1 -- 172.21.15.42:0/989772251 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f89c41e6860 con 0x7f89c40b4be0 2024-09-17T01:34:56.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.066+0000 7f89c9600640 1 -- 172.21.15.42:0/989772251 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89c40cd310 con 0x7f89c40b4be0 2024-09-17T01:34:56.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.067+0000 7f89c0c00640 1 -- 172.21.15.42:0/989772251 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+12984 (secure 0 0 0) 0x7f89b403f030 con 0x7f89c40b4be0 2024-09-17T01:34:56.065 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:34:56.065 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":40,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:34:53.580311+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6835/3278817895":"2024-09-18T01:34:50.569717+0000","172.21.15.42:6834/3278817895":"2024-09-18T01:34:50.569717+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:34:56.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.069+0000 7f89c9600640 1 -- 172.21.15.42:0/989772251 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f89a0078b90 msgr2=0x7f89a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:56.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.069+0000 7f89c9600640 1 --2- 172.21.15.42:0/989772251 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f89a0078b90 0x7f89a007b0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f89ac001eb0 tx=0x7f89ac009040 comp rx=0 tx=0).stop 2024-09-17T01:34:56.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.069+0000 7f89c9600640 1 -- 172.21.15.42:0/989772251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89c40b4be0 msgr2=0x7f89c4074040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:56.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.069+0000 7f89c9600640 1 --2- 172.21.15.42:0/989772251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89c40b4be0 0x7f89c4074040 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f89b402ab30 tx=0x7f89b4003c10 comp rx=0 tx=0).stop 2024-09-17T01:34:56.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.069+0000 7f89c9600640 1 -- 172.21.15.42:0/989772251 shutdown_connections 2024-09-17T01:34:56.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.069+0000 7f89c9600640 1 --2- 172.21.15.42:0/989772251 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f89a0078b90 0x7f89a007b0a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.069+0000 7f89c9600640 1 --2- 172.21.15.42:0/989772251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89c41e5f10 0x7f89c41e6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.069+0000 7f89c9600640 1 --2- 172.21.15.42:0/989772251 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f89c40cf7c0 0x7f89c40aeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.069+0000 7f89c9600640 1 --2- 172.21.15.42:0/989772251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89c40b4be0 0x7f89c4074040 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.069+0000 7f89c9600640 1 -- 172.21.15.42:0/989772251 >> 172.21.15.42:0/989772251 conn(0x7f89c40b25f0 msgr2=0x7f89c415c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:56.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.070+0000 7f89c9600640 1 -- 172.21.15.42:0/989772251 shutdown_connections 2024-09-17T01:34:56.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.070+0000 7f89c9600640 1 -- 172.21.15.42:0/989772251 wait complete. 2024-09-17T01:34:56.089 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T01:31:55.004951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T01:34:56.089 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T01:34:56.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.323+0000 7f691c600640 1 -- 172.21.15.42:0/1257224762 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69140d1900 msgr2=0x7f6914169a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:56.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.323+0000 7f691c600640 1 --2- 172.21.15.42:0/1257224762 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69140d1900 0x7f6914169a10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f690c005fd0 tx=0x7f690c02a8b0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.323+0000 7f691c600640 1 -- 172.21.15.42:0/1257224762 shutdown_connections 2024-09-17T01:34:56.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.323+0000 7f691c600640 1 --2- 172.21.15.42:0/1257224762 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69140d1900 0x7f6914169a10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.323+0000 7f691c600640 1 -- 172.21.15.42:0/1257224762 >> 172.21.15.42:0/1257224762 conn(0x7f691406cd20 msgr2=0x7f691406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:56.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.323+0000 7f691c600640 1 -- 172.21.15.42:0/1257224762 shutdown_connections 2024-09-17T01:34:56.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.323+0000 7f691c600640 1 -- 172.21.15.42:0/1257224762 wait complete. 2024-09-17T01:34:56.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.325+0000 7f691c600640 1 Processor -- start 2024-09-17T01:34:56.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.326+0000 7f691c600640 1 -- start start 2024-09-17T01:34:56.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.327+0000 7f691c600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69140b3c80 0x7f69141596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:56.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.327+0000 7f691c600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69140cf360 0x7f69141f9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:56.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.327+0000 7f691c600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6914161cf0 0x7f6914160170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:56.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.327+0000 7f691c600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f691416a160 con 0x7f69140b3c80 2024-09-17T01:34:56.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.327+0000 7f691c600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f69140b4090 con 0x7f6914161cf0 2024-09-17T01:34:56.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.327+0000 7f691c600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f691416a2e0 con 0x7f69140cf360 2024-09-17T01:34:56.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.327+0000 7f6919c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69140b3c80 0x7f69141596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:56.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.327+0000 7f6919c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69140b3c80 0x7f69141596e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38596/0 (socket says 172.21.15.42:38596) 2024-09-17T01:34:56.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.327+0000 7f6919c00640 1 -- 172.21.15.42:0/3402811013 learned_addr learned my addr 172.21.15.42:0/3402811013 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:56.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.327+0000 7f691a600640 1 --2- 172.21.15.42:0/3402811013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6914161cf0 0x7f6914160170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:56.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.327+0000 7f6919200640 1 --2- 172.21.15.42:0/3402811013 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69140cf360 0x7f69141f9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:56.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.328+0000 7f6919c00640 1 -- 172.21.15.42:0/3402811013 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69140cf360 msgr2=0x7f69141f9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:56.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.328+0000 7f6919c00640 1 --2- 172.21.15.42:0/3402811013 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69140cf360 0x7f69141f9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.328+0000 7f6919c00640 1 -- 172.21.15.42:0/3402811013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6914161cf0 msgr2=0x7f6914160170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:56.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.328+0000 7f6919c00640 1 --2- 172.21.15.42:0/3402811013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6914161cf0 0x7f6914160170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.328+0000 7f6919c00640 1 -- 172.21.15.42:0/3402811013 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691414fa90 con 0x7f69140b3c80 2024-09-17T01:34:56.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.328+0000 7f6919c00640 1 --2- 172.21.15.42:0/3402811013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69140b3c80 0x7f69141596e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f690800c430 tx=0x7f690800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:56.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.328+0000 7f6911600640 1 -- 172.21.15.42:0/3402811013 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6908011790 con 0x7f69140b3c80 2024-09-17T01:34:56.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.328+0000 7f6911600640 1 -- 172.21.15.42:0/3402811013 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6908017070 con 0x7f69140b3c80 2024-09-17T01:34:56.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.328+0000 7f6911600640 1 -- 172.21.15.42:0/3402811013 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6908011ca0 con 0x7f69140b3c80 2024-09-17T01:34:56.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.328+0000 7f691c600640 1 -- 172.21.15.42:0/3402811013 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f691414fd70 con 0x7f69140b3c80 2024-09-17T01:34:56.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.328+0000 7f691c600640 1 -- 172.21.15.42:0/3402811013 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69141f9460 con 0x7f69140b3c80 2024-09-17T01:34:56.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.330+0000 7f691c600640 1 -- 172.21.15.42:0/3402811013 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f691415eb60 con 0x7f69140b3c80 2024-09-17T01:34:56.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.331+0000 7f6911600640 1 -- 172.21.15.42:0/3402811013 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f690801c460 con 0x7f69140b3c80 2024-09-17T01:34:56.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.332+0000 7f6911600640 1 --2- 172.21.15.42:0/3402811013 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f68f4078b90 0x7f68f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:56.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.332+0000 7f6911600640 1 -- 172.21.15.42:0/3402811013 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f690809a910 con 0x7f69140b3c80 2024-09-17T01:34:56.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.333+0000 7f6919200640 1 --2- 172.21.15.42:0/3402811013 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f68f4078b90 0x7f68f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:56.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.334+0000 7f6919200640 1 --2- 172.21.15.42:0/3402811013 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f68f4078b90 0x7f68f407b0a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f69141506b0 tx=0x7f6900009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:56.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.337+0000 7f6911600640 1 -- 172.21.15.42:0/3402811013 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6908062fb0 con 0x7f69140b3c80 2024-09-17T01:34:56.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.532+0000 7f691c600640 1 -- 172.21.15.42:0/3402811013 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6914157140 con 0x7f69140b3c80 2024-09-17T01:34:56.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.532+0000 7f6911600640 1 -- 172.21.15.42:0/3402811013 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) ==== 93+0+10 (secure 0 0 0) 0x7f69080628b0 con 0x7f69140b3c80 2024-09-17T01:34:56.530 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-09-17T01:34:56.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.535+0000 7f691c600640 1 -- 172.21.15.42:0/3402811013 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f68f4078b90 msgr2=0x7f68f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:56.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.535+0000 7f691c600640 1 --2- 172.21.15.42:0/3402811013 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f68f4078b90 0x7f68f407b0a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f69141506b0 tx=0x7f6900009040 comp rx=0 tx=0).stop 2024-09-17T01:34:56.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.535+0000 7f691c600640 1 -- 172.21.15.42:0/3402811013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69140b3c80 msgr2=0x7f69141596e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:56.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.535+0000 7f691c600640 1 --2- 172.21.15.42:0/3402811013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69140b3c80 0x7f69141596e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f690800c430 tx=0x7f690800c8f0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.535+0000 7f691c600640 1 -- 172.21.15.42:0/3402811013 shutdown_connections 2024-09-17T01:34:56.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.535+0000 7f691c600640 1 --2- 172.21.15.42:0/3402811013 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f68f4078b90 0x7f68f407b0a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.535+0000 7f691c600640 1 --2- 172.21.15.42:0/3402811013 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6914161cf0 0x7f6914160170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.535+0000 7f691c600640 1 --2- 172.21.15.42:0/3402811013 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69140cf360 0x7f69141f9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.535+0000 7f691c600640 1 --2- 172.21.15.42:0/3402811013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f69140b3c80 0x7f69141596e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.535+0000 7f691c600640 1 -- 172.21.15.42:0/3402811013 >> 172.21.15.42:0/3402811013 conn(0x7f691406cd20 msgr2=0x7f691415a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:56.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.535+0000 7f691c600640 1 -- 172.21.15.42:0/3402811013 shutdown_connections 2024-09-17T01:34:56.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.535+0000 7f691c600640 1 -- 172.21.15.42:0/3402811013 wait complete. 2024-09-17T01:34:56.557 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-09-17T01:34:56.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.789+0000 7f1ce4c00640 1 -- 172.21.15.42:0/810489699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ce00b4be0 msgr2=0x7f1ce015d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:56.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.789+0000 7f1ce4c00640 1 --2- 172.21.15.42:0/810489699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ce00b4be0 0x7f1ce015d6b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009830 tx=0x7f1cd002a510 comp rx=0 tx=0).stop 2024-09-17T01:34:56.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.789+0000 7f1ce4c00640 1 -- 172.21.15.42:0/810489699 shutdown_connections 2024-09-17T01:34:56.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.789+0000 7f1ce4c00640 1 --2- 172.21.15.42:0/810489699 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ce00cf7c0 0x7f1ce006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.789+0000 7f1ce4c00640 1 --2- 172.21.15.42:0/810489699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ce00b4be0 0x7f1ce015d6b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.789+0000 7f1ce4c00640 1 -- 172.21.15.42:0/810489699 >> 172.21.15.42:0/810489699 conn(0x7f1ce00b25f0 msgr2=0x7f1ce00d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:56.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.790+0000 7f1ce4c00640 1 -- 172.21.15.42:0/810489699 shutdown_connections 2024-09-17T01:34:56.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.790+0000 7f1ce4c00640 1 -- 172.21.15.42:0/810489699 wait complete. 2024-09-17T01:34:56.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.792+0000 7f1ce4c00640 1 Processor -- start 2024-09-17T01:34:56.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.792+0000 7f1ce4c00640 1 -- start start 2024-09-17T01:34:56.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.793+0000 7f1ce4c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ce006d260 0x7f1ce01461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:56.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.793+0000 7f1ce4c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ce00b4be0 0x7f1ce0072050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:56.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.793+0000 7f1ce4c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ce00cf7c0 0x7f1ce0072590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:56.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.793+0000 7f1ce4c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce01537f0 con 0x7f1ce006d260 2024-09-17T01:34:56.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.793+0000 7f1ce4c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce00cfdc0 con 0x7f1ce00b4be0 2024-09-17T01:34:56.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.793+0000 7f1ce4c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce0153970 con 0x7f1ce00cf7c0 2024-09-17T01:34:56.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.793+0000 7f1cdf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ce006d260 0x7f1ce01461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:56.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.794+0000 7f1cdf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ce006d260 0x7f1ce01461f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38616/0 (socket says 172.21.15.42:38616) 2024-09-17T01:34:56.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.794+0000 7f1cdf400640 1 -- 172.21.15.42:0/2064325536 learned_addr learned my addr 172.21.15.42:0/2064325536 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:56.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.794+0000 7f1cdea00640 1 --2- 172.21.15.42:0/2064325536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ce00b4be0 0x7f1ce0072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:56.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.794+0000 7f1cdfe00640 1 --2- 172.21.15.42:0/2064325536 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ce00cf7c0 0x7f1ce0072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:56.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.794+0000 7f1cdf400640 1 -- 172.21.15.42:0/2064325536 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ce00cf7c0 msgr2=0x7f1ce0072590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:56.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.794+0000 7f1cdf400640 1 --2- 172.21.15.42:0/2064325536 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ce00cf7c0 0x7f1ce0072590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.794+0000 7f1cdf400640 1 -- 172.21.15.42:0/2064325536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ce00b4be0 msgr2=0x7f1ce0072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:56.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.794+0000 7f1cdf400640 1 --2- 172.21.15.42:0/2064325536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ce00b4be0 0x7f1ce0072050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.794+0000 7f1cdf400640 1 -- 172.21.15.42:0/2064325536 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce015ef70 con 0x7f1ce006d260 2024-09-17T01:34:56.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.794+0000 7f1cdf400640 1 --2- 172.21.15.42:0/2064325536 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ce006d260 0x7f1ce01461f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009950 tx=0x7f1cd0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:56.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.795+0000 7f1cd7400640 1 -- 172.21.15.42:0/2064325536 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0005220 con 0x7f1ce006d260 2024-09-17T01:34:56.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.795+0000 7f1cd7400640 1 -- 172.21.15.42:0/2064325536 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1cd00054b0 con 0x7f1ce006d260 2024-09-17T01:34:56.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.795+0000 7f1ce4c00640 1 -- 172.21.15.42:0/2064325536 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce015f250 con 0x7f1ce006d260 2024-09-17T01:34:56.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.795+0000 7f1cd7400640 1 -- 172.21.15.42:0/2064325536 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0004a00 con 0x7f1ce006d260 2024-09-17T01:34:56.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.795+0000 7f1ce4c00640 1 -- 172.21.15.42:0/2064325536 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce015f810 con 0x7f1ce006d260 2024-09-17T01:34:56.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.796+0000 7f1ce4c00640 1 -- 172.21.15.42:0/2064325536 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce015d6b0 con 0x7f1ce006d260 2024-09-17T01:34:56.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.797+0000 7f1cd7400640 1 -- 172.21.15.42:0/2064325536 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1cd0004ba0 con 0x7f1ce006d260 2024-09-17T01:34:56.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.798+0000 7f1cd7400640 1 --2- 172.21.15.42:0/2064325536 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1cc0078b90 0x7f1cc007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:56.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.798+0000 7f1cd7400640 1 -- 172.21.15.42:0/2064325536 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f1cd00bbe50 con 0x7f1ce006d260 2024-09-17T01:34:56.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.799+0000 7f1cdea00640 1 --2- 172.21.15.42:0/2064325536 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1cc0078b90 0x7f1cc007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:56.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.799+0000 7f1cdea00640 1 --2- 172.21.15.42:0/2064325536 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1cc0078b90 0x7f1cc007b0a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0150350 tx=0x7f1ccc005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:56.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:56.803+0000 7f1cd7400640 1 -- 172.21.15.42:0/2064325536 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1cd003f030 con 0x7f1ce006d260 2024-09-17T01:34:57.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.069+0000 7f1ce4c00640 1 -- 172.21.15.42:0/2064325536 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) -- 0x7f1ce00b0720 con 0x7f1ce006d260 2024-09-17T01:34:57.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.601+0000 7f1cd7400640 1 -- 172.21.15.42:0/2064325536 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v145) ==== 146+0+0 (secure 0 0 0) 0x7f1cd0031770 con 0x7f1ce006d260 2024-09-17T01:34:57.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.604+0000 7f1ce4c00640 1 -- 172.21.15.42:0/2064325536 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1cc0078b90 msgr2=0x7f1cc007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:57.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.604+0000 7f1ce4c00640 1 --2- 172.21.15.42:0/2064325536 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1cc0078b90 0x7f1cc007b0a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0150350 tx=0x7f1ccc005f90 comp rx=0 tx=0).stop 2024-09-17T01:34:57.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.604+0000 7f1ce4c00640 1 -- 172.21.15.42:0/2064325536 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ce006d260 msgr2=0x7f1ce01461f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:57.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.604+0000 7f1ce4c00640 1 --2- 172.21.15.42:0/2064325536 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ce006d260 0x7f1ce01461f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009950 tx=0x7f1cd0004270 comp rx=0 tx=0).stop 2024-09-17T01:34:57.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.604+0000 7f1ce4c00640 1 -- 172.21.15.42:0/2064325536 shutdown_connections 2024-09-17T01:34:57.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.604+0000 7f1ce4c00640 1 --2- 172.21.15.42:0/2064325536 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1cc0078b90 0x7f1cc007b0a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:57.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.604+0000 7f1ce4c00640 1 --2- 172.21.15.42:0/2064325536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ce00b4be0 0x7f1ce0072050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:57.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.604+0000 7f1ce4c00640 1 --2- 172.21.15.42:0/2064325536 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ce00cf7c0 0x7f1ce0072590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:57.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.604+0000 7f1ce4c00640 1 --2- 172.21.15.42:0/2064325536 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ce006d260 0x7f1ce01461f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:57.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.604+0000 7f1ce4c00640 1 -- 172.21.15.42:0/2064325536 >> 172.21.15.42:0/2064325536 conn(0x7f1ce00b25f0 msgr2=0x7f1ce00c9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:57.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.604+0000 7f1ce4c00640 1 -- 172.21.15.42:0/2064325536 shutdown_connections 2024-09-17T01:34:57.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.604+0000 7f1ce4c00640 1 -- 172.21.15.42:0/2064325536 wait complete. 2024-09-17T01:34:57.629 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T01:34:57.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.865+0000 7fd593200640 1 -- 172.21.15.42:0/841159870 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd58c142f40 msgr2=0x7fd58c072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:57.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.865+0000 7fd593200640 1 --2- 172.21.15.42:0/841159870 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd58c142f40 0x7fd58c072950 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd574009830 tx=0x7fd57402a530 comp rx=0 tx=0).stop 2024-09-17T01:34:57.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.865+0000 7fd593200640 1 -- 172.21.15.42:0/841159870 shutdown_connections 2024-09-17T01:34:57.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.865+0000 7fd593200640 1 --2- 172.21.15.42:0/841159870 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd58c142f40 0x7fd58c072950 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:57.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.865+0000 7fd593200640 1 -- 172.21.15.42:0/841159870 >> 172.21.15.42:0/841159870 conn(0x7fd58c0b2930 msgr2=0x7fd58c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:57.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.865+0000 7fd593200640 1 -- 172.21.15.42:0/841159870 shutdown_connections 2024-09-17T01:34:57.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.866+0000 7fd593200640 1 -- 172.21.15.42:0/841159870 wait complete. 2024-09-17T01:34:57.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.868+0000 7fd593200640 1 Processor -- start 2024-09-17T01:34:57.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.868+0000 7fd593200640 1 -- start start 2024-09-17T01:34:57.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.869+0000 7fd593200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd58c072e90 0x7fd58c0b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:57.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.869+0000 7fd593200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd58c0b3550 0x7fd58c155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:57.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.869+0000 7fd593200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd58c142f40 0x7fd58c167640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:57.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.869+0000 7fd593200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd58c06d900 con 0x7fd58c072e90 2024-09-17T01:34:57.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.869+0000 7fd593200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd58c06d780 con 0x7fd58c0b3550 2024-09-17T01:34:57.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.869+0000 7fd593200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd58c06da80 con 0x7fd58c142f40 2024-09-17T01:34:57.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.870+0000 7fd58be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd58c072e90 0x7fd58c0b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:57.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.870+0000 7fd58be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd58c072e90 0x7fd58c0b0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38630/0 (socket says 172.21.15.42:38630) 2024-09-17T01:34:57.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.870+0000 7fd58be00640 1 -- 172.21.15.42:0/1645000555 learned_addr learned my addr 172.21.15.42:0/1645000555 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:57.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.870+0000 7fd583400640 1 --2- 172.21.15.42:0/1645000555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd58c0b3550 0x7fd58c155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:57.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.870+0000 7fd591200640 1 --2- 172.21.15.42:0/1645000555 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd58c142f40 0x7fd58c167640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:57.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.870+0000 7fd58be00640 1 -- 172.21.15.42:0/1645000555 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd58c142f40 msgr2=0x7fd58c167640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:57.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.870+0000 7fd58be00640 1 --2- 172.21.15.42:0/1645000555 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd58c142f40 0x7fd58c167640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:57.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.870+0000 7fd58be00640 1 -- 172.21.15.42:0/1645000555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd58c0b3550 msgr2=0x7fd58c155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:57.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.870+0000 7fd58be00640 1 --2- 172.21.15.42:0/1645000555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd58c0b3550 0x7fd58c155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:57.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.870+0000 7fd58be00640 1 -- 172.21.15.42:0/1645000555 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd58c1422e0 con 0x7fd58c072e90 2024-09-17T01:34:57.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.870+0000 7fd58be00640 1 --2- 172.21.15.42:0/1645000555 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd58c072e90 0x7fd58c0b0e40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00c3a0 tx=0x7fd57c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:57.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.871+0000 7fd588c00640 1 -- 172.21.15.42:0/1645000555 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c017070 con 0x7fd58c072e90 2024-09-17T01:34:57.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.871+0000 7fd588c00640 1 -- 172.21.15.42:0/1645000555 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd57c0035f0 con 0x7fd58c072e90 2024-09-17T01:34:57.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.871+0000 7fd588c00640 1 -- 172.21.15.42:0/1645000555 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c003a40 con 0x7fd58c072e90 2024-09-17T01:34:57.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.871+0000 7fd593200640 1 -- 172.21.15.42:0/1645000555 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd58c1f5f10 con 0x7fd58c072e90 2024-09-17T01:34:57.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.871+0000 7fd593200640 1 -- 172.21.15.42:0/1645000555 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd58c1f64d0 con 0x7fd58c072e90 2024-09-17T01:34:57.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.872+0000 7fd593200640 1 -- 172.21.15.42:0/1645000555 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd58c06a170 con 0x7fd58c072e90 2024-09-17T01:34:57.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.873+0000 7fd588c00640 1 -- 172.21.15.42:0/1645000555 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd57c01a070 con 0x7fd58c072e90 2024-09-17T01:34:57.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.875+0000 7fd588c00640 1 --2- 172.21.15.42:0/1645000555 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd568078bc0 0x7fd56807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:57.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.875+0000 7fd588c00640 1 -- 172.21.15.42:0/1645000555 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7fd57c099c60 con 0x7fd58c072e90 2024-09-17T01:34:57.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.875+0000 7fd583400640 1 --2- 172.21.15.42:0/1645000555 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd568078bc0 0x7fd56807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:57.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.876+0000 7fd583400640 1 --2- 172.21.15.42:0/1645000555 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd568078bc0 0x7fd56807b0d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd574034000 tx=0x7fd574004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:57.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:57.879+0000 7fd588c00640 1 -- 172.21.15.42:0/1645000555 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd57c0623a0 con 0x7fd58c072e90 2024-09-17T01:34:58.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.072+0000 7fd593200640 1 -- 172.21.15.42:0/1645000555 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fd58c0cdc80 con 0x7fd58c072e90 2024-09-17T01:34:58.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.072+0000 7fd588c00640 1 -- 172.21.15.42:0/1645000555 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+2294 (secure 0 0 0) 0x7fd57c061ca0 con 0x7fd58c072e90 2024-09-17T01:34:58.070 INFO:teuthology.orchestra.run.smithi042.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T01:34:58.070 INFO:teuthology.orchestra.run.smithi042.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T01:34:58.070 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced client_mount_timeout 30 2024-09-17T01:34:58.070 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_client 20/20 2024-09-17T01:34:58.070 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_mgr 20/20 2024-09-17T01:34:58.071 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_ms 1/1 2024-09-17T01:34:58.071 INFO:teuthology.orchestra.run.smithi042.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T01:34:58.071 INFO:teuthology.orchestra.run.smithi042.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T01:34:58.071 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3683.959260 2024-09-17T01:34:58.071 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4350.010833 2024-09-17T01:34:58.071 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4316.776055 2024-09-17T01:34:58.071 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3885.595082 2024-09-17T01:34:58.071 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3602.000737 2024-09-17T01:34:58.071 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4883.364748 2024-09-17T01:34:58.071 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3752.484811 2024-09-17T01:34:58.071 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3775.035963 2024-09-17T01:34:58.071 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds 20/20 2024-09-17T01:34:58.071 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T01:34:58.071 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_ms 2/2 2024-09-17T01:34:58.072 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_frag true 2024-09-17T01:34:58.072 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_scatterstat true 2024-09-17T01:34:58.072 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T01:34:58.072 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_verify_scatter true 2024-09-17T01:34:58.072 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T01:34:58.072 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T01:34:58.072 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T01:34:58.072 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced client_mount_timeout 600 2024-09-17T01:34:58.072 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_client 20/20 2024-09-17T01:34:58.072 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_ms 1/1 2024-09-17T01:34:58.072 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T01:34:58.072 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T01:34:58.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.074+0000 7fd593200640 1 -- 172.21.15.42:0/1645000555 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd568078bc0 msgr2=0x7fd56807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:58.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.074+0000 7fd593200640 1 --2- 172.21.15.42:0/1645000555 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd568078bc0 0x7fd56807b0d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd574034000 tx=0x7fd574004730 comp rx=0 tx=0).stop 2024-09-17T01:34:58.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.074+0000 7fd593200640 1 -- 172.21.15.42:0/1645000555 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd58c072e90 msgr2=0x7fd58c0b0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:58.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.074+0000 7fd593200640 1 --2- 172.21.15.42:0/1645000555 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd58c072e90 0x7fd58c0b0e40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00c3a0 tx=0x7fd57c00c860 comp rx=0 tx=0).stop 2024-09-17T01:34:58.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.075+0000 7fd593200640 1 -- 172.21.15.42:0/1645000555 shutdown_connections 2024-09-17T01:34:58.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.075+0000 7fd593200640 1 --2- 172.21.15.42:0/1645000555 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd568078bc0 0x7fd56807b0d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:58.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.075+0000 7fd593200640 1 --2- 172.21.15.42:0/1645000555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd58c0b3550 0x7fd58c155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:58.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.075+0000 7fd593200640 1 --2- 172.21.15.42:0/1645000555 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd58c142f40 0x7fd58c167640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:58.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.075+0000 7fd593200640 1 --2- 172.21.15.42:0/1645000555 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd58c072e90 0x7fd58c0b0e40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:58.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.075+0000 7fd593200640 1 -- 172.21.15.42:0/1645000555 >> 172.21.15.42:0/1645000555 conn(0x7fd58c0b2930 msgr2=0x7fd58c15ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:58.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.075+0000 7fd593200640 1 -- 172.21.15.42:0/1645000555 shutdown_connections 2024-09-17T01:34:58.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.075+0000 7fd593200640 1 -- 172.21.15.42:0/1645000555 wait complete. 2024-09-17T01:34:58.097 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T01:34:58.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.330+0000 7f1040c00640 1 -- 172.21.15.42:0/253302958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f103c15f480 msgr2=0x7f103c15f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:58.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.330+0000 7f1040c00640 1 --2- 172.21.15.42:0/253302958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f103c15f480 0x7f103c15f890 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f103c071ef0 tx=0x7f103402aa10 comp rx=0 tx=0).stop 2024-09-17T01:34:58.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.330+0000 7f1040c00640 1 -- 172.21.15.42:0/253302958 shutdown_connections 2024-09-17T01:34:58.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.330+0000 7f1040c00640 1 --2- 172.21.15.42:0/253302958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f103c15f480 0x7f103c15f890 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:58.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.330+0000 7f1040c00640 1 --2- 172.21.15.42:0/253302958 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f103c06d430 0x7f103c06d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:58.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.330+0000 7f1040c00640 1 --2- 172.21.15.42:0/253302958 >> v2:172.21.15.43:3300/0 conn(0x7f103c15cb80 0x7f103c152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:58.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.330+0000 7f1040c00640 1 -- 172.21.15.42:0/253302958 >> 172.21.15.42:0/253302958 conn(0x7f103c0b2930 msgr2=0x7f103c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:58.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.330+0000 7f1040c00640 1 -- 172.21.15.42:0/253302958 shutdown_connections 2024-09-17T01:34:58.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.330+0000 7f1040c00640 1 -- 172.21.15.42:0/253302958 wait complete. 2024-09-17T01:34:58.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.332+0000 7f1040c00640 1 Processor -- start 2024-09-17T01:34:58.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.332+0000 7f1040c00640 1 -- start start 2024-09-17T01:34:58.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.334+0000 7f1040c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f103c06d430 0x7f103c13ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:58.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.334+0000 7f1040c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f103c15cb80 0x7f103c1507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:58.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.334+0000 7f1040c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f103c15f480 0x7f103c150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:58.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.334+0000 7f1040c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f103c073820 con 0x7f103c15cb80 2024-09-17T01:34:58.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.334+0000 7f1040c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f103c0736a0 con 0x7f103c15f480 2024-09-17T01:34:58.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.334+0000 7f1040c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f103c0739a0 con 0x7f103c06d430 2024-09-17T01:34:58.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.334+0000 7f1039400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f103c15cb80 0x7f103c1507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:58.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.334+0000 7f1039400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f103c15cb80 0x7f103c1507a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38640/0 (socket says 172.21.15.42:38640) 2024-09-17T01:34:58.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.334+0000 7f1039400640 1 -- 172.21.15.42:0/890171403 learned_addr learned my addr 172.21.15.42:0/890171403 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:58.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.334+0000 7f1039e00640 1 --2- 172.21.15.42:0/890171403 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f103c06d430 0x7f103c13ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:58.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.334+0000 7f103a800640 1 --2- 172.21.15.42:0/890171403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f103c15f480 0x7f103c150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:58.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.334+0000 7f1039400640 1 -- 172.21.15.42:0/890171403 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f103c06d430 msgr2=0x7f103c13ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:58.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.334+0000 7f1039400640 1 --2- 172.21.15.42:0/890171403 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f103c06d430 0x7f103c13ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:58.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.334+0000 7f1039400640 1 -- 172.21.15.42:0/890171403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f103c15f480 msgr2=0x7f103c150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:58.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.334+0000 7f1039400640 1 --2- 172.21.15.42:0/890171403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f103c15f480 0x7f103c150ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:58.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.334+0000 7f1039400640 1 -- 172.21.15.42:0/890171403 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103c0b07d0 con 0x7f103c15cb80 2024-09-17T01:34:58.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.335+0000 7f1039e00640 1 --2- 172.21.15.42:0/890171403 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f103c06d430 0x7f103c13ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:34:58.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.335+0000 7f103a800640 1 --2- 172.21.15.42:0/890171403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f103c15f480 0x7f103c150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:34:58.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.335+0000 7f1039400640 1 --2- 172.21.15.42:0/890171403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f103c15cb80 0x7f103c1507a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f102800c940 tx=0x7f102800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:58.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.335+0000 7f1032000640 1 -- 172.21.15.42:0/890171403 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1028007bb0 con 0x7f103c15cb80 2024-09-17T01:34:58.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.335+0000 7f1032000640 1 -- 172.21.15.42:0/890171403 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1028007e40 con 0x7f103c15cb80 2024-09-17T01:34:58.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.335+0000 7f1032000640 1 -- 172.21.15.42:0/890171403 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102800f6b0 con 0x7f103c15cb80 2024-09-17T01:34:58.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.335+0000 7f1040c00640 1 -- 172.21.15.42:0/890171403 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f103c13b150 con 0x7f103c15cb80 2024-09-17T01:34:58.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.335+0000 7f1040c00640 1 -- 172.21.15.42:0/890171403 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f103c149f70 con 0x7f103c15cb80 2024-09-17T01:34:58.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.336+0000 7f1040c00640 1 -- 172.21.15.42:0/890171403 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f103c073ec0 con 0x7f103c15cb80 2024-09-17T01:34:58.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.338+0000 7f1032000640 1 -- 172.21.15.42:0/890171403 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f102800f850 con 0x7f103c15cb80 2024-09-17T01:34:58.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.338+0000 7f1032000640 1 --2- 172.21.15.42:0/890171403 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f101c078b90 0x7f101c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:58.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.339+0000 7f1032000640 1 -- 172.21.15.42:0/890171403 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f102809b280 con 0x7f103c15cb80 2024-09-17T01:34:58.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.339+0000 7f1039e00640 1 --2- 172.21.15.42:0/890171403 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f101c078b90 0x7f101c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:58.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.340+0000 7f1039e00640 1 --2- 172.21.15.42:0/890171403 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f101c078b90 0x7f101c07b0a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f102c00ab40 tx=0x7f102c00a520 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:58.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.343+0000 7f1032000640 1 -- 172.21.15.42:0/890171403 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1028014030 con 0x7f103c15cb80 2024-09-17T01:34:58.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.539+0000 7f1040c00640 1 -- 172.21.15.42:0/890171403 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f103c06a170 con 0x7f103c15cb80 2024-09-17T01:34:58.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.543+0000 7f1032000640 1 -- 172.21.15.42:0/890171403 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7f1028063920 con 0x7f103c15cb80 2024-09-17T01:34:58.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.545+0000 7f1040c00640 1 -- 172.21.15.42:0/890171403 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f101c078b90 msgr2=0x7f101c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:58.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.545+0000 7f1040c00640 1 --2- 172.21.15.42:0/890171403 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f101c078b90 0x7f101c07b0a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f102c00ab40 tx=0x7f102c00a520 comp rx=0 tx=0).stop 2024-09-17T01:34:58.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.545+0000 7f1040c00640 1 -- 172.21.15.42:0/890171403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f103c15cb80 msgr2=0x7f103c1507a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:58.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.545+0000 7f1040c00640 1 --2- 172.21.15.42:0/890171403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f103c15cb80 0x7f103c1507a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f102800c940 tx=0x7f102800ce00 comp rx=0 tx=0).stop 2024-09-17T01:34:58.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.545+0000 7f1040c00640 1 -- 172.21.15.42:0/890171403 shutdown_connections 2024-09-17T01:34:58.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.545+0000 7f1040c00640 1 --2- 172.21.15.42:0/890171403 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f101c078b90 0x7f101c07b0a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:58.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.545+0000 7f1040c00640 1 --2- 172.21.15.42:0/890171403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f103c15f480 0x7f103c150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:58.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.545+0000 7f1040c00640 1 --2- 172.21.15.42:0/890171403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f103c15cb80 0x7f103c1507a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:58.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.545+0000 7f1040c00640 1 --2- 172.21.15.42:0/890171403 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f103c06d430 0x7f103c13ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:58.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.545+0000 7f1040c00640 1 -- 172.21.15.42:0/890171403 >> 172.21.15.42:0/890171403 conn(0x7f103c0b2930 msgr2=0x7f103c15eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:58.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.545+0000 7f1040c00640 1 -- 172.21.15.42:0/890171403 shutdown_connections 2024-09-17T01:34:58.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:58.545+0000 7f1040c00640 1 -- 172.21.15.42:0/890171403 wait complete. 2024-09-17T01:34:58.565 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:34:58.565 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:34:58.644 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:34:58.745 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:34:58.745 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:34:58.745 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:34:58.782 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:34:58.782 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:34:58.782 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:34:58.821 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:34:58.822 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:34:58.822 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:34:58.860 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:34:58.860 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:34:58.861 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:34:58.899 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:34:58.900 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T01:34:58.900 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:34:59.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.134+0000 7f6ba9c00640 1 -- 172.21.15.42:0/2959021177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ba4073340 msgr2=0x7f6ba40d2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:59.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.134+0000 7f6ba9c00640 1 --2- 172.21.15.42:0/2959021177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ba4073340 0x7f6ba40d2810 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6b94009830 tx=0x7f6b9402a4d0 comp rx=0 tx=0).stop 2024-09-17T01:34:59.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.134+0000 7f6ba9c00640 1 -- 172.21.15.42:0/2959021177 shutdown_connections 2024-09-17T01:34:59.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.134+0000 7f6ba9c00640 1 --2- 172.21.15.42:0/2959021177 >> v2:172.21.15.43:3300/0 conn(0x7f6ba4162fa0 0x7f6ba415e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:59.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.134+0000 7f6ba9c00640 1 --2- 172.21.15.42:0/2959021177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ba4073340 0x7f6ba40d2810 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:59.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.134+0000 7f6ba9c00640 1 -- 172.21.15.42:0/2959021177 >> 172.21.15.42:0/2959021177 conn(0x7f6ba40d1210 msgr2=0x7f6ba40d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:59.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.134+0000 7f6ba9c00640 1 -- 172.21.15.42:0/2959021177 shutdown_connections 2024-09-17T01:34:59.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.134+0000 7f6ba9c00640 1 -- 172.21.15.42:0/2959021177 wait complete. 2024-09-17T01:34:59.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.136+0000 7f6ba9c00640 1 Processor -- start 2024-09-17T01:34:59.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.136+0000 7f6ba9c00640 1 -- start start 2024-09-17T01:34:59.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.137+0000 7f6ba9c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ba4073340 0x7f6ba40c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:59.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.137+0000 7f6ba9c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ba40b6030 0x7f6ba4156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:59.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.138+0000 7f6ba9c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ba4162fa0 0x7f6ba41f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:59.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.138+0000 7f6ba9c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba415f850 con 0x7f6ba40b6030 2024-09-17T01:34:59.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.138+0000 7f6ba9c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba415f6d0 con 0x7f6ba4162fa0 2024-09-17T01:34:59.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.138+0000 7f6ba9c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6ba415f9d0 con 0x7f6ba4073340 2024-09-17T01:34:59.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.138+0000 7f6b9be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ba40b6030 0x7f6ba4156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:59.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.138+0000 7f6b9be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ba40b6030 0x7f6ba4156d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38656/0 (socket says 172.21.15.42:38656) 2024-09-17T01:34:59.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.138+0000 7f6b9be00640 1 -- 172.21.15.42:0/1062857551 learned_addr learned my addr 172.21.15.42:0/1062857551 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:34:59.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.138+0000 7f6ba3e00640 1 --2- 172.21.15.42:0/1062857551 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ba4073340 0x7f6ba40c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:59.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.138+0000 7f6ba9200640 1 --2- 172.21.15.42:0/1062857551 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ba4162fa0 0x7f6ba41f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:59.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.138+0000 7f6b9be00640 1 -- 172.21.15.42:0/1062857551 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ba4073340 msgr2=0x7f6ba40c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:59.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.138+0000 7f6b9be00640 1 --2- 172.21.15.42:0/1062857551 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ba4073340 0x7f6ba40c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:59.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.138+0000 7f6b9be00640 1 -- 172.21.15.42:0/1062857551 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ba4162fa0 msgr2=0x7f6ba41f5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:59.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.138+0000 7f6b9be00640 1 --2- 172.21.15.42:0/1062857551 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ba4162fa0 0x7f6ba41f5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:59.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.138+0000 7f6b9be00640 1 -- 172.21.15.42:0/1062857551 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba4156a20 con 0x7f6ba40b6030 2024-09-17T01:34:59.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.139+0000 7f6b9be00640 1 --2- 172.21.15.42:0/1062857551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ba40b6030 0x7f6ba4156d10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00e790 tx=0x7f6b8c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:59.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.139+0000 7f6ba0c00640 1 -- 172.21.15.42:0/1062857551 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c00eea0 con 0x7f6ba40b6030 2024-09-17T01:34:59.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.139+0000 7f6ba0c00640 1 -- 172.21.15.42:0/1062857551 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b8c00cdb0 con 0x7f6ba40b6030 2024-09-17T01:34:59.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.139+0000 7f6ba0c00640 1 -- 172.21.15.42:0/1062857551 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c010690 con 0x7f6ba40b6030 2024-09-17T01:34:59.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.139+0000 7f6ba9c00640 1 -- 172.21.15.42:0/1062857551 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ba4156460 con 0x7f6ba40b6030 2024-09-17T01:34:59.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.139+0000 7f6ba9c00640 1 -- 172.21.15.42:0/1062857551 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ba40c8670 con 0x7f6ba40b6030 2024-09-17T01:34:59.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.140+0000 7f6ba9c00640 1 -- 172.21.15.42:0/1062857551 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ba41f66f0 con 0x7f6ba40b6030 2024-09-17T01:34:59.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.141+0000 7f6ba0c00640 1 -- 172.21.15.42:0/1062857551 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6b8c010830 con 0x7f6ba40b6030 2024-09-17T01:34:59.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.142+0000 7f6ba0c00640 1 --2- 172.21.15.42:0/1062857551 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6b80078b90 0x7f6b8007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:59.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.142+0000 7f6ba0c00640 1 -- 172.21.15.42:0/1062857551 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f6b8c09b360 con 0x7f6ba40b6030 2024-09-17T01:34:59.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.143+0000 7f6ba3e00640 1 --2- 172.21.15.42:0/1062857551 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6b80078b90 0x7f6b8007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:59.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.144+0000 7f6ba3e00640 1 --2- 172.21.15.42:0/1062857551 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6b80078b90 0x7f6b8007b0a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6b94034000 tx=0x7f6b94004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:59.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.147+0000 7f6ba0c00640 1 -- 172.21.15.42:0/1062857551 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6b8c0634d0 con 0x7f6ba40b6030 2024-09-17T01:34:59.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.394+0000 7f6ba9c00640 1 -- 172.21.15.42:0/1062857551 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ba41586b0 con 0x7f6ba40b6030 2024-09-17T01:34:59.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.395+0000 7f6ba0c00640 1 -- 172.21.15.42:0/1062857551 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+3911 (secure 0 0 0) 0x7f6b8c067f00 con 0x7f6ba40b6030 2024-09-17T01:34:59.393 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:34:59.393 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":20,"btime":"2024-09-17T01:34:51:572287+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4628,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/2560567328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2560567328},{"type":"v1","addr":"172.21.15.42:6833","nonce":2560567328}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1462836032","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1462836032},{"type":"v1","addr":"172.21.15.43:6836","nonce":1462836032}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4798,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3719448578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3719448578},{"type":"v1","addr":"172.21.15.43:6837","nonce":3719448578}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5181,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1492499907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1492499907},{"type":"v1","addr":"172.21.15.42:6835","nonce":1492499907}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[]} 2024-09-17T01:34:59.394 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 20 2024-09-17T01:34:59.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.397+0000 7f6ba9c00640 1 -- 172.21.15.42:0/1062857551 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6b80078b90 msgr2=0x7f6b8007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:59.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.397+0000 7f6ba9c00640 1 --2- 172.21.15.42:0/1062857551 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6b80078b90 0x7f6b8007b0a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6b94034000 tx=0x7f6b94004730 comp rx=0 tx=0).stop 2024-09-17T01:34:59.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.397+0000 7f6ba9c00640 1 -- 172.21.15.42:0/1062857551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ba40b6030 msgr2=0x7f6ba4156d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:59.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.397+0000 7f6ba9c00640 1 --2- 172.21.15.42:0/1062857551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ba40b6030 0x7f6ba4156d10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00e790 tx=0x7f6b8c00ec50 comp rx=0 tx=0).stop 2024-09-17T01:34:59.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.398+0000 7f6ba9c00640 1 -- 172.21.15.42:0/1062857551 shutdown_connections 2024-09-17T01:34:59.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.398+0000 7f6ba9c00640 1 --2- 172.21.15.42:0/1062857551 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6b80078b90 0x7f6b8007b0a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:59.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.398+0000 7f6ba9c00640 1 --2- 172.21.15.42:0/1062857551 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ba4162fa0 0x7f6ba41f5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:59.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.398+0000 7f6ba9c00640 1 --2- 172.21.15.42:0/1062857551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ba40b6030 0x7f6ba4156d10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:59.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.398+0000 7f6ba9c00640 1 --2- 172.21.15.42:0/1062857551 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ba4073340 0x7f6ba40c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:59.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.398+0000 7f6ba9c00640 1 -- 172.21.15.42:0/1062857551 >> 172.21.15.42:0/1062857551 conn(0x7f6ba40d1210 msgr2=0x7f6ba415ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:59.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.398+0000 7f6ba9c00640 1 -- 172.21.15.42:0/1062857551 shutdown_connections 2024-09-17T01:34:59.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:34:59.398+0000 7f6ba9c00640 1 -- 172.21.15.42:0/1062857551 wait complete. 2024-09-17T01:34:59.417 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T01:34:59.418 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T01:34:59.418 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T01:34:59.418 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:34:59.418 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T01:34:59.418 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T01:34:59.418 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T01:34:59.419 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:34:59.419 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T01:34:59.419 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T01:34:59.419 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T01:34:59.419 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:34:59.419 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T01:34:59.419 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T01:34:59.420 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T01:34:59.420 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:34:59.444 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T01:34:59.444 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T01:34:59.445 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T01:34:59.445 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T01:34:59.446 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T01:34:59.446 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T01:34:59.489 INFO:tasks.ceph.mds.a:Started 2024-09-17T01:34:59.489 DEBUG:teuthology.parallel:result is None 2024-09-17T01:34:59.489 INFO:tasks.ceph.mds.b:Started 2024-09-17T01:34:59.490 DEBUG:teuthology.parallel:result is None 2024-09-17T01:34:59.492 INFO:tasks.ceph.mds.d:Started 2024-09-17T01:34:59.492 DEBUG:teuthology.parallel:result is None 2024-09-17T01:34:59.685 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:34:59.695 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-09-17T01:34:59.695 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-09-17T01:35:01.514 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-09-17T01:35:05.445 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T01:35:05.445 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T01:35:05.450 INFO:tasks.ceph.mds.c:Started 2024-09-17T01:35:05.450 DEBUG:teuthology.parallel:result is None 2024-09-17T01:35:05.451 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T01:35:05.657 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:35:05.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.699+0000 7fc757e00640 1 -- 172.21.15.42:0/3423690482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc75806cd20 msgr2=0x7fc75806d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:05.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.699+0000 7fc757e00640 1 --2- 172.21.15.42:0/3423690482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc75806cd20 0x7fc75806d130 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc7580cdc90 tx=0x7fc74802a5f0 comp rx=0 tx=0).stop 2024-09-17T01:35:05.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.699+0000 7fc757e00640 1 -- 172.21.15.42:0/3423690482 shutdown_connections 2024-09-17T01:35:05.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.699+0000 7fc757e00640 1 --2- 172.21.15.42:0/3423690482 >> v2:172.21.15.43:3300/0 conn(0x7fc7580cf230 0x7fc7580cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:05.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.699+0000 7fc757e00640 1 --2- 172.21.15.42:0/3423690482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc75806cd20 0x7fc75806d130 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:05.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.699+0000 7fc757e00640 1 -- 172.21.15.42:0/3423690482 >> 172.21.15.42:0/3423690482 conn(0x7fc7580b25f0 msgr2=0x7fc7580d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:05.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.699+0000 7fc757e00640 1 -- 172.21.15.42:0/3423690482 shutdown_connections 2024-09-17T01:35:05.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.699+0000 7fc757e00640 1 -- 172.21.15.42:0/3423690482 wait complete. 2024-09-17T01:35:05.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.701+0000 7fc757e00640 1 Processor -- start 2024-09-17T01:35:05.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.701+0000 7fc757e00640 1 -- start start 2024-09-17T01:35:05.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.703+0000 7fc757e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc75806cd20 0x7fc7580ad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:05.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.703+0000 7fc757e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7580cf230 0x7fc7580ada90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:05.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.703+0000 7fc757e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc75815e3c0 0x7fc7581500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:05.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.703+0000 7fc757e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc758155120 con 0x7fc75806cd20 2024-09-17T01:35:05.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.703+0000 7fc757e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc7580cfb80 con 0x7fc7580cf230 2024-09-17T01:35:05.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.703+0000 7fc757e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc7581552a0 con 0x7fc75815e3c0 2024-09-17T01:35:05.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.703+0000 7fc756a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc75806cd20 0x7fc7580ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:05.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.703+0000 7fc756a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc75806cd20 0x7fc7580ad080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38710/0 (socket says 172.21.15.42:38710) 2024-09-17T01:35:05.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.703+0000 7fc756a00640 1 -- 172.21.15.42:0/3131978964 learned_addr learned my addr 172.21.15.42:0/3131978964 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:05.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.703+0000 7fc74fe00640 1 --2- 172.21.15.42:0/3131978964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7580cf230 0x7fc7580ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:05.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.703+0000 7fc757400640 1 --2- 172.21.15.42:0/3131978964 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc75815e3c0 0x7fc7581500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:05.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.703+0000 7fc756a00640 1 -- 172.21.15.42:0/3131978964 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc75815e3c0 msgr2=0x7fc7581500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:05.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.703+0000 7fc756a00640 1 --2- 172.21.15.42:0/3131978964 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc75815e3c0 0x7fc7581500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:05.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.703+0000 7fc756a00640 1 -- 172.21.15.42:0/3131978964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7580cf230 msgr2=0x7fc7580ada90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:05.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.703+0000 7fc756a00640 1 --2- 172.21.15.42:0/3131978964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7580cf230 0x7fc7580ada90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:05.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.703+0000 7fc756a00640 1 -- 172.21.15.42:0/3131978964 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7581531a0 con 0x7fc75806cd20 2024-09-17T01:35:05.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.704+0000 7fc756a00640 1 --2- 172.21.15.42:0/3131978964 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc75806cd20 0x7fc7580ad080 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc748034040 tx=0x7fc748003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:05.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.704+0000 7fc74ea00640 1 -- 172.21.15.42:0/3131978964 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74803e030 con 0x7fc75806cd20 2024-09-17T01:35:05.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.704+0000 7fc74ea00640 1 -- 172.21.15.42:0/3131978964 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc748003e00 con 0x7fc75806cd20 2024-09-17T01:35:05.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.704+0000 7fc74ea00640 1 -- 172.21.15.42:0/3131978964 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc748035040 con 0x7fc75806cd20 2024-09-17T01:35:05.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.704+0000 7fc757e00640 1 -- 172.21.15.42:0/3131978964 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc758074ba0 con 0x7fc75806cd20 2024-09-17T01:35:05.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.704+0000 7fc757e00640 1 -- 172.21.15.42:0/3131978964 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7580721e0 con 0x7fc75806cd20 2024-09-17T01:35:05.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.705+0000 7fc757e00640 1 -- 172.21.15.42:0/3131978964 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc75806d130 con 0x7fc75806cd20 2024-09-17T01:35:05.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.707+0000 7fc74ea00640 1 -- 172.21.15.42:0/3131978964 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc748041030 con 0x7fc75806cd20 2024-09-17T01:35:05.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.708+0000 7fc74ea00640 1 --2- 172.21.15.42:0/3131978964 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc734078b90 0x7fc73407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:05.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.708+0000 7fc74ea00640 1 -- 172.21.15.42:0/3131978964 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7fc7480bb260 con 0x7fc75806cd20 2024-09-17T01:35:05.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.709+0000 7fc74fe00640 1 --2- 172.21.15.42:0/3131978964 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc734078b90 0x7fc73407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:05.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.709+0000 7fc74fe00640 1 --2- 172.21.15.42:0/3131978964 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc734078b90 0x7fc73407b0a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc7580af6c0 tx=0x7fc74000b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:05.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.713+0000 7fc74ea00640 1 -- 172.21.15.42:0/3131978964 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc7480832b0 con 0x7fc75806cd20 2024-09-17T01:35:05.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:05.929+0000 7fc757e00640 1 -- 172.21.15.42:0/3131978964 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fc758072410 con 0x7fc75806cd20 2024-09-17T01:35:07.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.625+0000 7fc74ea00640 1 -- 172.21.15.42:0/3131978964 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v45) ==== 97+0+0 (secure 0 0 0) 0x7fc748087ce0 con 0x7fc75806cd20 2024-09-17T01:35:07.623 INFO:teuthology.orchestra.run.smithi042.stderr: removed all blocklist entries 2024-09-17T01:35:07.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.628+0000 7fc757e00640 1 -- 172.21.15.42:0/3131978964 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc734078b90 msgr2=0x7fc73407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:07.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.628+0000 7fc757e00640 1 --2- 172.21.15.42:0/3131978964 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc734078b90 0x7fc73407b0a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc7580af6c0 tx=0x7fc74000b2e0 comp rx=0 tx=0).stop 2024-09-17T01:35:07.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.628+0000 7fc757e00640 1 -- 172.21.15.42:0/3131978964 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc75806cd20 msgr2=0x7fc7580ad080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:07.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.628+0000 7fc757e00640 1 --2- 172.21.15.42:0/3131978964 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc75806cd20 0x7fc7580ad080 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc748034040 tx=0x7fc748003910 comp rx=0 tx=0).stop 2024-09-17T01:35:07.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.629+0000 7fc757e00640 1 -- 172.21.15.42:0/3131978964 shutdown_connections 2024-09-17T01:35:07.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.629+0000 7fc757e00640 1 --2- 172.21.15.42:0/3131978964 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc734078b90 0x7fc73407b0a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:07.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.629+0000 7fc757e00640 1 --2- 172.21.15.42:0/3131978964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7580cf230 0x7fc7580ada90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:07.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.629+0000 7fc757e00640 1 --2- 172.21.15.42:0/3131978964 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc75815e3c0 0x7fc7581500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:07.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.629+0000 7fc757e00640 1 --2- 172.21.15.42:0/3131978964 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc75806cd20 0x7fc7580ad080 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:07.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.629+0000 7fc757e00640 1 -- 172.21.15.42:0/3131978964 >> 172.21.15.42:0/3131978964 conn(0x7fc7580b25f0 msgr2=0x7fc7580ca900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:07.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.629+0000 7fc757e00640 1 -- 172.21.15.42:0/3131978964 shutdown_connections 2024-09-17T01:35:07.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.629+0000 7fc757e00640 1 -- 172.21.15.42:0/3131978964 wait complete. 2024-09-17T01:35:07.652 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T01:35:07.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.887+0000 7f785a600640 1 -- 172.21.15.42:0/2102478620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78540cf7c0 msgr2=0x7f785406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:07.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.887+0000 7f785a600640 1 --2- 172.21.15.42:0/2102478620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78540cf7c0 0x7f785406cd20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7854071cb0 tx=0x7f784002a560 comp rx=0 tx=0).stop 2024-09-17T01:35:07.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.887+0000 7f785a600640 1 -- 172.21.15.42:0/2102478620 shutdown_connections 2024-09-17T01:35:07.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.887+0000 7f785a600640 1 --2- 172.21.15.42:0/2102478620 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f785406d260 0x7f7854152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:07.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.887+0000 7f785a600640 1 --2- 172.21.15.42:0/2102478620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78540cf7c0 0x7f785406cd20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:07.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.887+0000 7f785a600640 1 --2- 172.21.15.42:0/2102478620 >> v2:172.21.15.43:3300/0 conn(0x7f78540b4be0 0x7f785415d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:07.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.887+0000 7f785a600640 1 -- 172.21.15.42:0/2102478620 >> 172.21.15.42:0/2102478620 conn(0x7f78540b25f0 msgr2=0x7f78540d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:07.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.887+0000 7f785a600640 1 -- 172.21.15.42:0/2102478620 shutdown_connections 2024-09-17T01:35:07.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.887+0000 7f785a600640 1 -- 172.21.15.42:0/2102478620 wait complete. 2024-09-17T01:35:07.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.889+0000 7f785a600640 1 Processor -- start 2024-09-17T01:35:07.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.889+0000 7f785a600640 1 -- start start 2024-09-17T01:35:07.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.891+0000 7f785a600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f785406d260 0x7f78541f7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:07.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.891+0000 7f785a600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78540b4be0 0x7f78541f7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:07.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.891+0000 7f785a600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78540cf7c0 0x7f78541f8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:07.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.891+0000 7f785a600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f78541537a0 con 0x7f78540b4be0 2024-09-17T01:35:07.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.891+0000 7f785a600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7854153620 con 0x7f78540cf7c0 2024-09-17T01:35:07.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.891+0000 7f785a600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7854153920 con 0x7f785406d260 2024-09-17T01:35:07.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.891+0000 7f7853e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78540b4be0 0x7f78541f7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:07.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.891+0000 7f7853e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78540b4be0 0x7f78541f7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33478/0 (socket says 172.21.15.42:33478) 2024-09-17T01:35:07.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.891+0000 7f7853e00640 1 -- 172.21.15.42:0/3734879942 learned_addr learned my addr 172.21.15.42:0/3734879942 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:07.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.891+0000 7f7859200640 1 --2- 172.21.15.42:0/3734879942 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f785406d260 0x7f78541f7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:07.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.891+0000 7f7859c00640 1 --2- 172.21.15.42:0/3734879942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78540cf7c0 0x7f78541f8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:07.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.891+0000 7f7853e00640 1 -- 172.21.15.42:0/3734879942 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f785406d260 msgr2=0x7f78541f7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:07.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.891+0000 7f7853e00640 1 --2- 172.21.15.42:0/3734879942 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f785406d260 0x7f78541f7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:07.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.891+0000 7f7853e00640 1 -- 172.21.15.42:0/3734879942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78540cf7c0 msgr2=0x7f78541f8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:07.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.891+0000 7f7853e00640 1 --2- 172.21.15.42:0/3734879942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78540cf7c0 0x7f78541f8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:07.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.891+0000 7f7853e00640 1 -- 172.21.15.42:0/3734879942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78540cc6b0 con 0x7f78540b4be0 2024-09-17T01:35:07.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.892+0000 7f7853e00640 1 --2- 172.21.15.42:0/3734879942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78540b4be0 0x7f78541f7e50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f78400099c0 tx=0x7f78400039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:07.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.892+0000 7f7850c00640 1 -- 172.21.15.42:0/3734879942 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784003e030 con 0x7f78540b4be0 2024-09-17T01:35:07.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.892+0000 7f7850c00640 1 -- 172.21.15.42:0/3734879942 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78400047a0 con 0x7f78540b4be0 2024-09-17T01:35:07.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.892+0000 7f7850c00640 1 -- 172.21.15.42:0/3734879942 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7840035040 con 0x7f78540b4be0 2024-09-17T01:35:07.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.892+0000 7f785a600640 1 -- 172.21.15.42:0/3734879942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78541f6b50 con 0x7f78540b4be0 2024-09-17T01:35:07.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.892+0000 7f785a600640 1 -- 172.21.15.42:0/3734879942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78541f7110 con 0x7f78540b4be0 2024-09-17T01:35:07.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.893+0000 7f785a600640 1 -- 172.21.15.42:0/3734879942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f785415d6b0 con 0x7f78540b4be0 2024-09-17T01:35:07.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.894+0000 7f7850c00640 1 -- 172.21.15.42:0/3734879942 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7840041030 con 0x7f78540b4be0 2024-09-17T01:35:07.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.895+0000 7f7850c00640 1 --2- 172.21.15.42:0/3734879942 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7834078bc0 0x7f783407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:07.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.895+0000 7f7850c00640 1 -- 172.21.15.42:0/3734879942 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 4857+0+0 (secure 0 0 0) 0x7f78400bb2f0 con 0x7f78540b4be0 2024-09-17T01:35:07.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.896+0000 7f7859200640 1 --2- 172.21.15.42:0/3734879942 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7834078bc0 0x7f783407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:07.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.897+0000 7f7859200640 1 --2- 172.21.15.42:0/3734879942 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7834078bc0 0x7f783407b0d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7848005fd0 tx=0x7f784800a250 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:07.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:07.901+0000 7f7850c00640 1 -- 172.21.15.42:0/3734879942 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7840083390 con 0x7f78540b4be0 2024-09-17T01:35:08.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.164+0000 7f785a600640 1 -- 172.21.15.42:0/3734879942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f78540afe40 con 0x7f78540b4be0 2024-09-17T01:35:08.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.165+0000 7f7850c00640 1 -- 172.21.15.42:0/3734879942 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v29) ==== 80+0+5304 (secure 0 0 0) 0x7f7840087dc0 con 0x7f78540b4be0 2024-09-17T01:35:08.163 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:35:08.163 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:08.163 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_dump": [ 2024-09-17T01:35:08.163 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:35:08.163 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.a", 2024-09-17T01:35:08.163 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmyJK4HRAAIC4E4V7p1fqIEfPIICMxZg==", 2024-09-17T01:35:08.163 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:35:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:35:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:35:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:35:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:35:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:35:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.b", 2024-09-17T01:35:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmXv3vORAALPrYIM6Vtz0g1pOxVhrUig==", 2024-09-17T01:35:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:35:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:35:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:35:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:35:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:35:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:35:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.c", 2024-09-17T01:35:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmPE7MKxAA9mGG+EO9C3VGVMerOm92+Q==", 2024-09-17T01:35:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:35:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:35:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:35:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:35:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:35:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:35:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.d", 2024-09-17T01:35:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmaOBSDBAATU4tpjM5IMcuvzZFE7N5bQ==", 2024-09-17T01:35:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:35:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:35:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:35:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:35:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:35:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:35:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.0", 2024-09-17T01:35:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDP2+hmEJebExAAAdGEoSzM96ybGT9h7t7OkA==", 2024-09-17T01:35:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:35:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:35:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:35:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:35:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:35:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.1", 2024-09-17T01:35:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDS2+hm7dWoMBAAagktrUl0O2/mgKCEfpAstA==", 2024-09-17T01:35:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:35:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:35:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:35:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:35:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:35:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.2", 2024-09-17T01:35:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDW2+hmEfSPBBAAPAa6EZt27yUcJSfZyCKheg==", 2024-09-17T01:35:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:35:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:35:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:35:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:35:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:35:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.3", 2024-09-17T01:35:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDZ2+hmHQhXFRAAj84g+IKqH6KMP7LjRtFvLw==", 2024-09-17T01:35:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:35:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:35:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:35:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:35:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:35:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.4", 2024-09-17T01:35:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDd2+hmaNcMNBAAx1GV/oFdfssMjFWFN5M0VQ==", 2024-09-17T01:35:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:35:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:35:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:35:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:35:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:35:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.5", 2024-09-17T01:35:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDh2+hm301NJhAAnSUH5AAvqhPwM7loH6frww==", 2024-09-17T01:35:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:35:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:35:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:35:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:35:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:35:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.6", 2024-09-17T01:35:08.171 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDk2+hm61WNNRAAbCvVvsUpB4fgt4ja60DRZA==", 2024-09-17T01:35:08.171 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:35:08.171 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:35:08.171 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:35:08.171 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:35:08.171 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:08.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:08.171 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:35:08.171 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.7", 2024-09-17T01:35:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDo2+hmesiLFhAA29n1eageNvP+lkRyh6gGMw==", 2024-09-17T01:35:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:35:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:35:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:35:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:35:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:35:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.0", 2024-09-17T01:35:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA==", 2024-09-17T01:35:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:35:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:35:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow r", 2024-09-17T01:35:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T01:35:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:35:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.1", 2024-09-17T01:35:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmZLygLhAABlauZgnidFWvfCCPuBLObg==", 2024-09-17T01:35:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:35:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:35:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:35:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:35:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:35:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:35:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.2", 2024-09-17T01:35:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hm8lnZIxAAN0a2CVMMtu/Nz50OG4a02A==", 2024-09-17T01:35:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:35:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:35:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:35:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:35:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:35:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:35:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.3", 2024-09-17T01:35:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmgXdAORAAM5Uy66I4nnTJ9Vhkn9JoBw==", 2024-09-17T01:35:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:35:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:35:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:35:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:35:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:35:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:35:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.admin", 2024-09-17T01:35:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDL2+hmvCreHBAA4CSAhosssViGqD93U+I7Iw==", 2024-09-17T01:35:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:35:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:35:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:35:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:35:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:35:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:35:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.x", 2024-09-17T01:35:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmYPnlEhAAIcQ11ktWZyMXYdbAONiLog==", 2024-09-17T01:35:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:35:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:35:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:35:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:35:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:35:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.y", 2024-09-17T01:35:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmpCZtBxAAp5tXMc6aEq1aOny2LJZAiA==", 2024-09-17T01:35:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:35:08.177 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:35:08.177 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:35:08.177 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:35:08.177 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:08.177 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:08.177 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-17T01:35:08.177 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:08.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.168+0000 7f785a600640 1 -- 172.21.15.42:0/3734879942 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7834078bc0 msgr2=0x7f783407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:08.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.168+0000 7f785a600640 1 --2- 172.21.15.42:0/3734879942 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7834078bc0 0x7f783407b0d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7848005fd0 tx=0x7f784800a250 comp rx=0 tx=0).stop 2024-09-17T01:35:08.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.168+0000 7f785a600640 1 -- 172.21.15.42:0/3734879942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78540b4be0 msgr2=0x7f78541f7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:08.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.168+0000 7f785a600640 1 --2- 172.21.15.42:0/3734879942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78540b4be0 0x7f78541f7e50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f78400099c0 tx=0x7f78400039e0 comp rx=0 tx=0).stop 2024-09-17T01:35:08.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.168+0000 7f785a600640 1 -- 172.21.15.42:0/3734879942 shutdown_connections 2024-09-17T01:35:08.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.168+0000 7f785a600640 1 --2- 172.21.15.42:0/3734879942 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7834078bc0 0x7f783407b0d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:08.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.168+0000 7f785a600640 1 --2- 172.21.15.42:0/3734879942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78540cf7c0 0x7f78541f8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:08.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.168+0000 7f785a600640 1 --2- 172.21.15.42:0/3734879942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78540b4be0 0x7f78541f7e50 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:08.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.168+0000 7f785a600640 1 --2- 172.21.15.42:0/3734879942 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f785406d260 0x7f78541f7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:08.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.168+0000 7f785a600640 1 -- 172.21.15.42:0/3734879942 >> 172.21.15.42:0/3734879942 conn(0x7f78540b25f0 msgr2=0x7f78540ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:08.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.168+0000 7f785a600640 1 -- 172.21.15.42:0/3734879942 shutdown_connections 2024-09-17T01:35:08.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.168+0000 7f785a600640 1 -- 172.21.15.42:0/3734879942 wait complete. 2024-09-17T01:35:08.188 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T01:35:08.226 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-09-17T01:35:08.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.418+0000 7f7450400640 1 -- 172.21.15.42:0/247806021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74480b3550 msgr2=0x7f744815cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:08.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.418+0000 7f7450400640 1 --2- 172.21.15.42:0/247806021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74480b3550 0x7f744815cec0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f743c005fd0 tx=0x7f743c02a540 comp rx=0 tx=0).stop 2024-09-17T01:35:08.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.418+0000 7f7450400640 1 -- 172.21.15.42:0/247806021 shutdown_connections 2024-09-17T01:35:08.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.418+0000 7f7450400640 1 --2- 172.21.15.42:0/247806021 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74480cec40 0x7f74480cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:08.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.418+0000 7f7450400640 1 --2- 172.21.15.42:0/247806021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74480b3550 0x7f744815cec0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:08.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.418+0000 7f7450400640 1 -- 172.21.15.42:0/247806021 >> 172.21.15.42:0/247806021 conn(0x7f74480b2930 msgr2=0x7f744806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:08.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.419+0000 7f7450400640 1 -- 172.21.15.42:0/247806021 shutdown_connections 2024-09-17T01:35:08.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.419+0000 7f7450400640 1 -- 172.21.15.42:0/247806021 wait complete. 2024-09-17T01:35:08.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.421+0000 7f7450400640 1 Processor -- start 2024-09-17T01:35:08.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.421+0000 7f7450400640 1 -- start start 2024-09-17T01:35:08.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.422+0000 7f7450400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74480b3550 0x7f7448133ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:08.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.422+0000 7f7450400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74480cec40 0x7f7448073350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:08.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.422+0000 7f7450400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7448142f40 0x7f7448073890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:08.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.422+0000 7f7450400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f744806d7c0 con 0x7f7448142f40 2024-09-17T01:35:08.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.422+0000 7f7450400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f744806d640 con 0x7f74480b3550 2024-09-17T01:35:08.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.422+0000 7f7450400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f744806d940 con 0x7f74480cec40 2024-09-17T01:35:08.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.423+0000 7f744e400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7448142f40 0x7f7448073890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:08.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.423+0000 7f744e400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7448142f40 0x7f7448073890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33486/0 (socket says 172.21.15.42:33486) 2024-09-17T01:35:08.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.423+0000 7f744e400640 1 -- 172.21.15.42:0/1682598426 learned_addr learned my addr 172.21.15.42:0/1682598426 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:08.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.423+0000 7f744d000640 1 --2- 172.21.15.42:0/1682598426 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74480cec40 0x7f7448073350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:08.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.423+0000 7f744da00640 1 --2- 172.21.15.42:0/1682598426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74480b3550 0x7f7448133ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:08.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.423+0000 7f744e400640 1 -- 172.21.15.42:0/1682598426 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74480cec40 msgr2=0x7f7448073350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:08.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.423+0000 7f744e400640 1 --2- 172.21.15.42:0/1682598426 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74480cec40 0x7f7448073350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:08.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.423+0000 7f744e400640 1 -- 172.21.15.42:0/1682598426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74480b3550 msgr2=0x7f7448133ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:08.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.423+0000 7f744e400640 1 --2- 172.21.15.42:0/1682598426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74480b3550 0x7f7448133ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:08.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.423+0000 7f744e400640 1 -- 172.21.15.42:0/1682598426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74481340e0 con 0x7f7448142f40 2024-09-17T01:35:08.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.423+0000 7f744da00640 1 --2- 172.21.15.42:0/1682598426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74480b3550 0x7f7448133ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:08.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.423+0000 7f744e400640 1 --2- 172.21.15.42:0/1682598426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7448142f40 0x7f7448073890 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f744000ea10 tx=0x7f744000eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:08.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.424+0000 7f7445600640 1 -- 172.21.15.42:0/1682598426 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744000cde0 con 0x7f7448142f40 2024-09-17T01:35:08.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.424+0000 7f7445600640 1 -- 172.21.15.42:0/1682598426 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7440004c10 con 0x7f7448142f40 2024-09-17T01:35:08.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.424+0000 7f7450400640 1 -- 172.21.15.42:0/1682598426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74481f7580 con 0x7f7448142f40 2024-09-17T01:35:08.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.424+0000 7f7445600640 1 -- 172.21.15.42:0/1682598426 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7440005020 con 0x7f7448142f40 2024-09-17T01:35:08.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.424+0000 7f7450400640 1 -- 172.21.15.42:0/1682598426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74481f7b40 con 0x7f7448142f40 2024-09-17T01:35:08.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.425+0000 7f7450400640 1 -- 172.21.15.42:0/1682598426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74481f72f0 con 0x7f7448142f40 2024-09-17T01:35:08.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.426+0000 7f7445600640 1 -- 172.21.15.42:0/1682598426 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f74400051c0 con 0x7f7448142f40 2024-09-17T01:35:08.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.427+0000 7f7445600640 1 --2- 172.21.15.42:0/1682598426 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7428078b90 0x7f742807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:08.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.427+0000 7f7445600640 1 -- 172.21.15.42:0/1682598426 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 4857+0+0 (secure 0 0 0) 0x7f744009b6f0 con 0x7f7448142f40 2024-09-17T01:35:08.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.428+0000 7f744da00640 1 --2- 172.21.15.42:0/1682598426 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7428078b90 0x7f742807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:08.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.428+0000 7f744da00640 1 --2- 172.21.15.42:0/1682598426 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7428078b90 0x7f742807b0a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f743c033000 tx=0x7f743c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:08.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.432+0000 7f7445600640 1 -- 172.21.15.42:0/1682598426 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7440063f00 con 0x7f7448142f40 2024-09-17T01:35:08.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.627+0000 7f7450400640 1 -- 172.21.15.42:0/1682598426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f744815cec0 con 0x7f7448142f40 2024-09-17T01:35:08.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.627+0000 7f7445600640 1 -- 172.21.15.42:0/1682598426 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v45) ==== 84+0+65 (secure 0 0 0) 0x7f7440063800 con 0x7f7448142f40 2024-09-17T01:35:08.625 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:35:08.625 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-09-17T01:35:08.625 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:35:08.625 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-09-17T01:35:08.626 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-09-17T01:35:08.626 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:08.626 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-09-17T01:35:08.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.629+0000 7f7450400640 1 -- 172.21.15.42:0/1682598426 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7428078b90 msgr2=0x7f742807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:08.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.629+0000 7f7450400640 1 --2- 172.21.15.42:0/1682598426 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7428078b90 0x7f742807b0a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f743c033000 tx=0x7f743c004730 comp rx=0 tx=0).stop 2024-09-17T01:35:08.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.629+0000 7f7450400640 1 -- 172.21.15.42:0/1682598426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7448142f40 msgr2=0x7f7448073890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:08.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.629+0000 7f7450400640 1 --2- 172.21.15.42:0/1682598426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7448142f40 0x7f7448073890 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f744000ea10 tx=0x7f744000eed0 comp rx=0 tx=0).stop 2024-09-17T01:35:08.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.629+0000 7f7450400640 1 -- 172.21.15.42:0/1682598426 shutdown_connections 2024-09-17T01:35:08.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.630+0000 7f7450400640 1 --2- 172.21.15.42:0/1682598426 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7428078b90 0x7f742807b0a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:08.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.630+0000 7f7450400640 1 --2- 172.21.15.42:0/1682598426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7448142f40 0x7f7448073890 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:08.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.630+0000 7f7450400640 1 --2- 172.21.15.42:0/1682598426 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74480cec40 0x7f7448073350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:08.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.630+0000 7f7450400640 1 --2- 172.21.15.42:0/1682598426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74480b3550 0x7f7448133ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:08.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.630+0000 7f7450400640 1 -- 172.21.15.42:0/1682598426 >> 172.21.15.42:0/1682598426 conn(0x7f74480b2930 msgr2=0x7f744806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:08.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.630+0000 7f7450400640 1 -- 172.21.15.42:0/1682598426 shutdown_connections 2024-09-17T01:35:08.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.630+0000 7f7450400640 1 -- 172.21.15.42:0/1682598426 wait complete. 2024-09-17T01:35:08.652 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T01:35:08.652 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T01:35:08.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.887+0000 7f6114e00640 1 -- 172.21.15.42:0/10770378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61100cdb20 msgr2=0x7f61100cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:08.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.887+0000 7f6114e00640 1 --2- 172.21.15.42:0/10770378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61100cdb20 0x7f61100cdf30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f60f8005fd0 tx=0x7f60f802a520 comp rx=0 tx=0).stop 2024-09-17T01:35:08.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.887+0000 7f6114e00640 1 -- 172.21.15.42:0/10770378 shutdown_connections 2024-09-17T01:35:08.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.887+0000 7f6114e00640 1 --2- 172.21.15.42:0/10770378 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f611006d430 0x7f611006d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:08.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.887+0000 7f6114e00640 1 --2- 172.21.15.42:0/10770378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61100cdb20 0x7f61100cdf30 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:08.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.887+0000 7f6114e00640 1 -- 172.21.15.42:0/10770378 >> 172.21.15.42:0/10770378 conn(0x7f61100b28f0 msgr2=0x7f611006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:08.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.887+0000 7f6114e00640 1 -- 172.21.15.42:0/10770378 shutdown_connections 2024-09-17T01:35:08.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.887+0000 7f6114e00640 1 -- 172.21.15.42:0/10770378 wait complete. 2024-09-17T01:35:08.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.889+0000 7f6114e00640 1 Processor -- start 2024-09-17T01:35:08.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.889+0000 7f6114e00640 1 -- start start 2024-09-17T01:35:08.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.891+0000 7f6114e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f611006d430 0x7f611015c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:08.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.891+0000 7f6114e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f61100b56d0 0x7f61100c5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:08.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.891+0000 7f6114e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61100cdb20 0x7f61100c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:08.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.891+0000 7f6114e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f611015d560 con 0x7f611006d430 2024-09-17T01:35:08.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.891+0000 7f6114e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f611015d3e0 con 0x7f61100cdb20 2024-09-17T01:35:08.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.891+0000 7f6114e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f611015d6e0 con 0x7f61100b56d0 2024-09-17T01:35:08.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.891+0000 7f610de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f611006d430 0x7f611015c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:08.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.891+0000 7f610de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f611006d430 0x7f611015c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33498/0 (socket says 172.21.15.42:33498) 2024-09-17T01:35:08.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.891+0000 7f610de00640 1 -- 172.21.15.42:0/822054757 learned_addr learned my addr 172.21.15.42:0/822054757 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:08.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.891+0000 7f6107e00640 1 --2- 172.21.15.42:0/822054757 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f61100b56d0 0x7f61100c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:08.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.891+0000 7f610e800640 1 --2- 172.21.15.42:0/822054757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61100cdb20 0x7f61100c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:08.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.892+0000 7f610de00640 1 -- 172.21.15.42:0/822054757 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f61100b56d0 msgr2=0x7f61100c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:08.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.892+0000 7f610de00640 1 --2- 172.21.15.42:0/822054757 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f61100b56d0 0x7f61100c5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:08.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.892+0000 7f610de00640 1 -- 172.21.15.42:0/822054757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61100cdb20 msgr2=0x7f61100c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:08.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.892+0000 7f610de00640 1 --2- 172.21.15.42:0/822054757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61100cdb20 0x7f61100c5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:08.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.892+0000 7f610de00640 1 -- 172.21.15.42:0/822054757 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6110145280 con 0x7f611006d430 2024-09-17T01:35:08.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.892+0000 7f610de00640 1 --2- 172.21.15.42:0/822054757 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f611006d430 0x7f611015c5c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f610000b3f0 tx=0x7f610000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:08.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.892+0000 7f6106000640 1 -- 172.21.15.42:0/822054757 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6100015020 con 0x7f611006d430 2024-09-17T01:35:08.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.892+0000 7f6106000640 1 -- 172.21.15.42:0/822054757 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6100011920 con 0x7f611006d430 2024-09-17T01:35:08.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.892+0000 7f6106000640 1 -- 172.21.15.42:0/822054757 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6100011d70 con 0x7f611006d430 2024-09-17T01:35:08.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.893+0000 7f6114e00640 1 -- 172.21.15.42:0/822054757 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61101e9ea0 con 0x7f611006d430 2024-09-17T01:35:08.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.893+0000 7f6114e00640 1 -- 172.21.15.42:0/822054757 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61101ea420 con 0x7f611006d430 2024-09-17T01:35:08.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.894+0000 7f6114e00640 1 -- 172.21.15.42:0/822054757 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f611015dc40 con 0x7f611006d430 2024-09-17T01:35:08.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.895+0000 7f6106000640 1 -- 172.21.15.42:0/822054757 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6100018020 con 0x7f611006d430 2024-09-17T01:35:08.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.896+0000 7f6106000640 1 --2- 172.21.15.42:0/822054757 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f60ec078b90 0x7f60ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:08.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.896+0000 7f6106000640 1 -- 172.21.15.42:0/822054757 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 4857+0+0 (secure 0 0 0) 0x7f610009a880 con 0x7f611006d430 2024-09-17T01:35:08.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.897+0000 7f6107e00640 1 --2- 172.21.15.42:0/822054757 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f60ec078b90 0x7f60ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:08.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.897+0000 7f6107e00640 1 --2- 172.21.15.42:0/822054757 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f60ec078b90 0x7f60ec07b0a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f60f8033000 tx=0x7f60f8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:08.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:08.900+0000 7f6106000640 1 -- 172.21.15.42:0/822054757 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f610001f020 con 0x7f611006d430 2024-09-17T01:35:09.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.111+0000 7f6114e00640 1 -- 172.21.15.42:0/822054757 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f61100b05f0 con 0x7f611006d430 2024-09-17T01:35:09.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.640+0000 7f6106000640 1 -- 172.21.15.42:0/822054757 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v46) ==== 138+0+0 (secure 0 0 0) 0x7f6110145280 con 0x7f611006d430 2024-09-17T01:35:09.638 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-09-17T01:35:09.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.644+0000 7f6114e00640 1 -- 172.21.15.42:0/822054757 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f60ec078b90 msgr2=0x7f60ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:09.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.644+0000 7f6114e00640 1 --2- 172.21.15.42:0/822054757 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f60ec078b90 0x7f60ec07b0a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f60f8033000 tx=0x7f60f8004730 comp rx=0 tx=0).stop 2024-09-17T01:35:09.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.644+0000 7f6114e00640 1 -- 172.21.15.42:0/822054757 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f611006d430 msgr2=0x7f611015c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:09.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.644+0000 7f6114e00640 1 --2- 172.21.15.42:0/822054757 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f611006d430 0x7f611015c5c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f610000b3f0 tx=0x7f610000b8b0 comp rx=0 tx=0).stop 2024-09-17T01:35:09.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.644+0000 7f6114e00640 1 -- 172.21.15.42:0/822054757 shutdown_connections 2024-09-17T01:35:09.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.644+0000 7f6114e00640 1 --2- 172.21.15.42:0/822054757 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f60ec078b90 0x7f60ec07b0a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:09.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.644+0000 7f6114e00640 1 --2- 172.21.15.42:0/822054757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61100cdb20 0x7f61100c5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:09.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.644+0000 7f6114e00640 1 --2- 172.21.15.42:0/822054757 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f61100b56d0 0x7f61100c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:09.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.644+0000 7f6114e00640 1 --2- 172.21.15.42:0/822054757 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f611006d430 0x7f611015c5c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:09.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.644+0000 7f6114e00640 1 -- 172.21.15.42:0/822054757 >> 172.21.15.42:0/822054757 conn(0x7f61100b28f0 msgr2=0x7f61100ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:09.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.644+0000 7f6114e00640 1 -- 172.21.15.42:0/822054757 shutdown_connections 2024-09-17T01:35:09.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.644+0000 7f6114e00640 1 -- 172.21.15.42:0/822054757 wait complete. 2024-09-17T01:35:09.670 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T01:35:09.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.911+0000 7fed01c00640 1 -- 172.21.15.42:0/4129993561 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecfc0cef70 msgr2=0x7fecfc156e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:09.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.911+0000 7fed01c00640 1 --2- 172.21.15.42:0/4129993561 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecfc0cef70 0x7fecfc156e50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fece4009860 tx=0x7fece402a4f0 comp rx=0 tx=0).stop 2024-09-17T01:35:09.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.911+0000 7fed01c00640 1 -- 172.21.15.42:0/4129993561 shutdown_connections 2024-09-17T01:35:09.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.911+0000 7fed01c00640 1 --2- 172.21.15.42:0/4129993561 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecfc0cef70 0x7fecfc156e50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:09.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.911+0000 7fed01c00640 1 -- 172.21.15.42:0/4129993561 >> 172.21.15.42:0/4129993561 conn(0x7fecfc0b2930 msgr2=0x7fecfc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:09.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.911+0000 7fed01c00640 1 -- 172.21.15.42:0/4129993561 shutdown_connections 2024-09-17T01:35:09.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.911+0000 7fed01c00640 1 -- 172.21.15.42:0/4129993561 wait complete. 2024-09-17T01:35:09.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.913+0000 7fed01c00640 1 Processor -- start 2024-09-17T01:35:09.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.914+0000 7fed01c00640 1 -- start start 2024-09-17T01:35:09.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.915+0000 7fed01c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecfc06d430 0x7fecfc14cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:09.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.915+0000 7fed01c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecfc0b5100 0x7fecfc1f6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:09.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.915+0000 7fed01c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fecfc0cef70 0x7fecfc1f7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:09.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.915+0000 7fed01c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc073bd0 con 0x7fecfc06d430 2024-09-17T01:35:09.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.915+0000 7fed01c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc073a50 con 0x7fecfc0b5100 2024-09-17T01:35:09.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.915+0000 7fed01c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fecfc073d50 con 0x7fecfc0cef70 2024-09-17T01:35:09.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.915+0000 7fecfaa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecfc06d430 0x7fecfc14cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:09.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.915+0000 7fecfaa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecfc06d430 0x7fecfc14cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33500/0 (socket says 172.21.15.42:33500) 2024-09-17T01:35:09.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.915+0000 7fecfaa00640 1 -- 172.21.15.42:0/72113273 learned_addr learned my addr 172.21.15.42:0/72113273 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:09.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.916+0000 7fecf2000640 1 --2- 172.21.15.42:0/72113273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecfc0b5100 0x7fecfc1f6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:09.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.916+0000 7fecfb400640 1 --2- 172.21.15.42:0/72113273 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fecfc0cef70 0x7fecfc1f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:09.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.916+0000 7fecfaa00640 1 -- 172.21.15.42:0/72113273 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fecfc0cef70 msgr2=0x7fecfc1f7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:09.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.916+0000 7fecfaa00640 1 --2- 172.21.15.42:0/72113273 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fecfc0cef70 0x7fecfc1f7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:09.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.916+0000 7fecfaa00640 1 -- 172.21.15.42:0/72113273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecfc0b5100 msgr2=0x7fecfc1f6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:09.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.916+0000 7fecfaa00640 1 --2- 172.21.15.42:0/72113273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecfc0b5100 0x7fecfc1f6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:09.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.916+0000 7fecfaa00640 1 -- 172.21.15.42:0/72113273 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecfc158eb0 con 0x7fecfc06d430 2024-09-17T01:35:09.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.916+0000 7fecfaa00640 1 --2- 172.21.15.42:0/72113273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecfc06d430 0x7fecfc14cb60 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fecec00c4d0 tx=0x7fecec00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:09.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.917+0000 7fecf3400640 1 -- 172.21.15.42:0/72113273 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec017070 con 0x7fecfc06d430 2024-09-17T01:35:09.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.917+0000 7fecf3400640 1 -- 172.21.15.42:0/72113273 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fecec0035f0 con 0x7fecfc06d430 2024-09-17T01:35:09.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.917+0000 7fed01c00640 1 -- 172.21.15.42:0/72113273 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecfc150e80 con 0x7fecfc06d430 2024-09-17T01:35:09.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.917+0000 7fecf3400640 1 -- 172.21.15.42:0/72113273 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec003a40 con 0x7fecfc06d430 2024-09-17T01:35:09.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.917+0000 7fed01c00640 1 -- 172.21.15.42:0/72113273 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecfc150ba0 con 0x7fecfc06d430 2024-09-17T01:35:09.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.918+0000 7fed01c00640 1 -- 172.21.15.42:0/72113273 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecfc151120 con 0x7fecfc06d430 2024-09-17T01:35:09.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.919+0000 7fecf3400640 1 -- 172.21.15.42:0/72113273 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fecec01a070 con 0x7fecfc06d430 2024-09-17T01:35:09.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.920+0000 7fecf3400640 1 --2- 172.21.15.42:0/72113273 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fecd8078bc0 0x7fecd807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:09.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.920+0000 7fecf3400640 1 -- 172.21.15.42:0/72113273 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5227+0+0 (secure 0 0 0) 0x7fecec09a2b0 con 0x7fecfc06d430 2024-09-17T01:35:09.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.921+0000 7fecf2000640 1 --2- 172.21.15.42:0/72113273 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fecd8078bc0 0x7fecd807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:09.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.922+0000 7fecf2000640 1 --2- 172.21.15.42:0/72113273 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fecd8078bc0 0x7fecd807b0d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fece4034000 tx=0x7fece4004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:09.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:09.924+0000 7fecf3400640 1 -- 172.21.15.42:0/72113273 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fecec021020 con 0x7fecfc06d430 2024-09-17T01:35:10.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.119+0000 7fed01c00640 1 -- 172.21.15.42:0/72113273 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fecfc1561d0 con 0x7fecfc06d430 2024-09-17T01:35:10.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.649+0000 7fecf3400640 1 -- 172.21.15.42:0/72113273 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v47) ==== 170+0+0 (secure 0 0 0) 0x7fecfc1561d0 con 0x7fecfc06d430 2024-09-17T01:35:10.647 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-09-17T01:35:10.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.653+0000 7fed01c00640 1 -- 172.21.15.42:0/72113273 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fecd8078bc0 msgr2=0x7fecd807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:10.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.653+0000 7fed01c00640 1 --2- 172.21.15.42:0/72113273 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fecd8078bc0 0x7fecd807b0d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fece4034000 tx=0x7fece4004730 comp rx=0 tx=0).stop 2024-09-17T01:35:10.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.653+0000 7fed01c00640 1 -- 172.21.15.42:0/72113273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecfc06d430 msgr2=0x7fecfc14cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:10.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.653+0000 7fed01c00640 1 --2- 172.21.15.42:0/72113273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecfc06d430 0x7fecfc14cb60 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fecec00c4d0 tx=0x7fecec00c990 comp rx=0 tx=0).stop 2024-09-17T01:35:10.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.653+0000 7fed01c00640 1 -- 172.21.15.42:0/72113273 shutdown_connections 2024-09-17T01:35:10.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.653+0000 7fed01c00640 1 --2- 172.21.15.42:0/72113273 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fecd8078bc0 0x7fecd807b0d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:10.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.653+0000 7fed01c00640 1 --2- 172.21.15.42:0/72113273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecfc0b5100 0x7fecfc1f6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:10.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.653+0000 7fed01c00640 1 --2- 172.21.15.42:0/72113273 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fecfc0cef70 0x7fecfc1f7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:10.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.653+0000 7fed01c00640 1 --2- 172.21.15.42:0/72113273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fecfc06d430 0x7fecfc14cb60 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:10.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.653+0000 7fed01c00640 1 -- 172.21.15.42:0/72113273 >> 172.21.15.42:0/72113273 conn(0x7fecfc0b2930 msgr2=0x7fecfc1564f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:10.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.654+0000 7fed01c00640 1 -- 172.21.15.42:0/72113273 shutdown_connections 2024-09-17T01:35:10.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.654+0000 7fed01c00640 1 -- 172.21.15.42:0/72113273 wait complete. 2024-09-17T01:35:10.692 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T01:35:10.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.928+0000 7f3589c00640 1 -- 172.21.15.42:0/2809247847 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f35840b4be0 msgr2=0x7f358415d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:10.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.928+0000 7f3589c00640 1 --2- 172.21.15.42:0/2809247847 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f35840b4be0 0x7f358415d6b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3574005fd0 tx=0x7f357402a5c0 comp rx=0 tx=0).stop 2024-09-17T01:35:10.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.928+0000 7f3589c00640 1 -- 172.21.15.42:0/2809247847 shutdown_connections 2024-09-17T01:35:10.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.928+0000 7f3589c00640 1 --2- 172.21.15.42:0/2809247847 >> v2:172.21.15.43:3300/0 conn(0x7f35840cf7c0 0x7f358406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:10.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.928+0000 7f3589c00640 1 --2- 172.21.15.42:0/2809247847 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f35840b4be0 0x7f358415d6b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:10.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.928+0000 7f3589c00640 1 -- 172.21.15.42:0/2809247847 >> 172.21.15.42:0/2809247847 conn(0x7f35840b25f0 msgr2=0x7f35840d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:10.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.928+0000 7f3589c00640 1 -- 172.21.15.42:0/2809247847 shutdown_connections 2024-09-17T01:35:10.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.928+0000 7f3589c00640 1 -- 172.21.15.42:0/2809247847 wait complete. 2024-09-17T01:35:10.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.931+0000 7f3589c00640 1 Processor -- start 2024-09-17T01:35:10.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.931+0000 7f3589c00640 1 -- start start 2024-09-17T01:35:10.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.932+0000 7f3589c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f358406d260 0x7f35841436c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:10.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.932+0000 7f3589c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35840b4be0 0x7f3584151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:10.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.932+0000 7f3589c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35840cf7c0 0x7f35841f3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:10.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.932+0000 7f3589c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f35841537f0 con 0x7f35840b4be0 2024-09-17T01:35:10.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.932+0000 7f3589c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f35840cfdc0 con 0x7f35840cf7c0 2024-09-17T01:35:10.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.932+0000 7f3589c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3584153970 con 0x7f358406d260 2024-09-17T01:35:10.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.933+0000 7f3583400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35840b4be0 0x7f3584151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:10.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.933+0000 7f3583400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35840b4be0 0x7f3584151450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33512/0 (socket says 172.21.15.42:33512) 2024-09-17T01:35:10.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.933+0000 7f3583400640 1 -- 172.21.15.42:0/4251295848 learned_addr learned my addr 172.21.15.42:0/4251295848 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:10.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.933+0000 7f3583e00640 1 --2- 172.21.15.42:0/4251295848 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f358406d260 0x7f35841436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:10.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.933+0000 7f3589200640 1 --2- 172.21.15.42:0/4251295848 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35840cf7c0 0x7f35841f3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:10.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.933+0000 7f3583400640 1 -- 172.21.15.42:0/4251295848 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f358406d260 msgr2=0x7f35841436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:10.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.933+0000 7f3583400640 1 --2- 172.21.15.42:0/4251295848 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f358406d260 0x7f35841436c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:10.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.933+0000 7f3583400640 1 -- 172.21.15.42:0/4251295848 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35840cf7c0 msgr2=0x7f35841f3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:10.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.933+0000 7f3583400640 1 --2- 172.21.15.42:0/4251295848 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35840cf7c0 0x7f35841f3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:10.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.933+0000 7f3583400640 1 -- 172.21.15.42:0/4251295848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3584151990 con 0x7f35840b4be0 2024-09-17T01:35:10.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.934+0000 7f3583400640 1 --2- 172.21.15.42:0/4251295848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35840b4be0 0x7f3584151450 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f357000e7c0 tx=0x7f357000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:10.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.934+0000 7f357be00640 1 -- 172.21.15.42:0/4251295848 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357000ccc0 con 0x7f35840b4be0 2024-09-17T01:35:10.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.934+0000 7f357be00640 1 -- 172.21.15.42:0/4251295848 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3570010430 con 0x7f35840b4be0 2024-09-17T01:35:10.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.934+0000 7f357be00640 1 -- 172.21.15.42:0/4251295848 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3570010860 con 0x7f35840b4be0 2024-09-17T01:35:10.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.934+0000 7f3589c00640 1 -- 172.21.15.42:0/4251295848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35841503b0 con 0x7f35840b4be0 2024-09-17T01:35:10.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.934+0000 7f3589c00640 1 -- 172.21.15.42:0/4251295848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3584150970 con 0x7f35840b4be0 2024-09-17T01:35:10.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.935+0000 7f3589c00640 1 -- 172.21.15.42:0/4251295848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3584150120 con 0x7f35840b4be0 2024-09-17T01:35:10.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.937+0000 7f357be00640 1 -- 172.21.15.42:0/4251295848 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3570010a00 con 0x7f35840b4be0 2024-09-17T01:35:10.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.938+0000 7f357be00640 1 --2- 172.21.15.42:0/4251295848 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3564078b90 0x7f356407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:10.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.938+0000 7f357be00640 1 -- 172.21.15.42:0/4251295848 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5609+0+0 (secure 0 0 0) 0x7f357009be80 con 0x7f35840b4be0 2024-09-17T01:35:10.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.939+0000 7f3583e00640 1 --2- 172.21.15.42:0/4251295848 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3564078b90 0x7f356407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:10.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.940+0000 7f3583e00640 1 --2- 172.21.15.42:0/4251295848 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3564078b90 0x7f356407b0a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3574033000 tx=0x7f3574004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:10.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:10.942+0000 7f357be00640 1 -- 172.21.15.42:0/4251295848 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3570063d50 con 0x7f35840b4be0 2024-09-17T01:35:11.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.174+0000 7f3589c00640 1 -- 172.21.15.42:0/4251295848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f358415d6b0 con 0x7f35840b4be0 2024-09-17T01:35:11.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.662+0000 7f357be00640 1 -- 172.21.15.42:0/4251295848 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v24) ==== 172+0+0 (secure 0 0 0) 0x7f3570068780 con 0x7f35840b4be0 2024-09-17T01:35:11.660 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 6 and data pool 7 2024-09-17T01:35:11.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.666+0000 7f3589c00640 1 -- 172.21.15.42:0/4251295848 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3564078b90 msgr2=0x7f356407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:11.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.666+0000 7f3589c00640 1 --2- 172.21.15.42:0/4251295848 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3564078b90 0x7f356407b0a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3574033000 tx=0x7f3574004730 comp rx=0 tx=0).stop 2024-09-17T01:35:11.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.666+0000 7f3589c00640 1 -- 172.21.15.42:0/4251295848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35840b4be0 msgr2=0x7f3584151450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:11.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.666+0000 7f3589c00640 1 --2- 172.21.15.42:0/4251295848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35840b4be0 0x7f3584151450 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f357000e7c0 tx=0x7f357000ec80 comp rx=0 tx=0).stop 2024-09-17T01:35:11.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.666+0000 7f3589c00640 1 -- 172.21.15.42:0/4251295848 shutdown_connections 2024-09-17T01:35:11.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.666+0000 7f3589c00640 1 --2- 172.21.15.42:0/4251295848 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3564078b90 0x7f356407b0a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:11.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.666+0000 7f3589c00640 1 --2- 172.21.15.42:0/4251295848 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f35840cf7c0 0x7f35841f3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:11.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.666+0000 7f3589c00640 1 --2- 172.21.15.42:0/4251295848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f35840b4be0 0x7f3584151450 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:11.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.666+0000 7f3589c00640 1 --2- 172.21.15.42:0/4251295848 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f358406d260 0x7f35841436c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:11.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.666+0000 7f3589c00640 1 -- 172.21.15.42:0/4251295848 >> 172.21.15.42:0/4251295848 conn(0x7f35840b25f0 msgr2=0x7f35840afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:11.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.667+0000 7f3589c00640 1 -- 172.21.15.42:0/4251295848 shutdown_connections 2024-09-17T01:35:11.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.667+0000 7f3589c00640 1 -- 172.21.15.42:0/4251295848 wait complete. 2024-09-17T01:35:11.707 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:35:11.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.937+0000 7f2825200640 1 -- 172.21.15.42:0/4072565249 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28200b4be0 msgr2=0x7f282015d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:11.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.937+0000 7f2825200640 1 --2- 172.21.15.42:0/4072565249 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28200b4be0 0x7f282015d6b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f282006deb0 tx=0x7f281002a540 comp rx=0 tx=0).stop 2024-09-17T01:35:11.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.937+0000 7f2825200640 1 -- 172.21.15.42:0/4072565249 shutdown_connections 2024-09-17T01:35:11.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.937+0000 7f2825200640 1 --2- 172.21.15.42:0/4072565249 >> v2:172.21.15.43:3300/0 conn(0x7f282006d430 0x7f2820152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:11.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.937+0000 7f2825200640 1 --2- 172.21.15.42:0/4072565249 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28200b4be0 0x7f282015d6b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:11.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.937+0000 7f2825200640 1 -- 172.21.15.42:0/4072565249 >> 172.21.15.42:0/4072565249 conn(0x7f28200b25f0 msgr2=0x7f28200d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:11.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.937+0000 7f2825200640 1 -- 172.21.15.42:0/4072565249 shutdown_connections 2024-09-17T01:35:11.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.937+0000 7f2825200640 1 -- 172.21.15.42:0/4072565249 wait complete. 2024-09-17T01:35:11.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.939+0000 7f2825200640 1 Processor -- start 2024-09-17T01:35:11.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.940+0000 7f2825200640 1 -- start start 2024-09-17T01:35:11.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.941+0000 7f2825200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28200b4be0 0x7f2820142490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:11.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.941+0000 7f2825200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28200cf7c0 0x7f28201f6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:11.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.941+0000 7f2825200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28201f70f0 0x7f28201f7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:11.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.941+0000 7f2825200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f28201537a0 con 0x7f28200b4be0 2024-09-17T01:35:11.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.941+0000 7f2825200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2820153620 con 0x7f28201f70f0 2024-09-17T01:35:11.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.941+0000 7f2825200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2820153920 con 0x7f28200cf7c0 2024-09-17T01:35:11.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.941+0000 7f281f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28200b4be0 0x7f2820142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:11.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.941+0000 7f281f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28200b4be0 0x7f2820142490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33534/0 (socket says 172.21.15.42:33534) 2024-09-17T01:35:11.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.941+0000 7f281f400640 1 -- 172.21.15.42:0/1711245738 learned_addr learned my addr 172.21.15.42:0/1711245738 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:11.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.942+0000 7f281fe00640 1 --2- 172.21.15.42:0/1711245738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28201f70f0 0x7f28201f7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:11.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.942+0000 7f2817e00640 1 --2- 172.21.15.42:0/1711245738 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28200cf7c0 0x7f28201f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:11.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.942+0000 7f281f400640 1 -- 172.21.15.42:0/1711245738 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28200cf7c0 msgr2=0x7f28201f6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:11.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.942+0000 7f281f400640 1 --2- 172.21.15.42:0/1711245738 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28200cf7c0 0x7f28201f6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:11.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.942+0000 7f281f400640 1 -- 172.21.15.42:0/1711245738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28201f70f0 msgr2=0x7f28201f7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:11.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.942+0000 7f281f400640 1 --2- 172.21.15.42:0/1711245738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28201f70f0 0x7f28201f7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:11.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.942+0000 7f281f400640 1 -- 172.21.15.42:0/1711245738 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28200748e0 con 0x7f28200b4be0 2024-09-17T01:35:11.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.942+0000 7f2817e00640 1 --2- 172.21.15.42:0/1711245738 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28200cf7c0 0x7f28201f6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:11.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.942+0000 7f281f400640 1 --2- 172.21.15.42:0/1711245738 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28200b4be0 0x7f2820142490 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f281002ab30 tx=0x7f2810033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:11.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.942+0000 7f2817400640 1 -- 172.21.15.42:0/1711245738 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2810031d60 con 0x7f28200b4be0 2024-09-17T01:35:11.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.942+0000 7f2817400640 1 -- 172.21.15.42:0/1711245738 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2810033e10 con 0x7f28200b4be0 2024-09-17T01:35:11.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.942+0000 7f2825200640 1 -- 172.21.15.42:0/1711245738 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2820074b50 con 0x7f28200b4be0 2024-09-17T01:35:11.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.942+0000 7f2817400640 1 -- 172.21.15.42:0/1711245738 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2810005260 con 0x7f28200b4be0 2024-09-17T01:35:11.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.943+0000 7f2825200640 1 -- 172.21.15.42:0/1711245738 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2820073470 con 0x7f28200b4be0 2024-09-17T01:35:11.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.944+0000 7f2825200640 1 -- 172.21.15.42:0/1711245738 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28200736d0 con 0x7f28200b4be0 2024-09-17T01:35:11.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.945+0000 7f2817400640 1 -- 172.21.15.42:0/1711245738 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2810005400 con 0x7f28200b4be0 2024-09-17T01:35:11.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.946+0000 7f2817400640 1 --2- 172.21.15.42:0/1711245738 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f27fc078b90 0x7f27fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:11.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.946+0000 7f2817400640 1 -- 172.21.15.42:0/1711245738 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f28100bc010 con 0x7f28200b4be0 2024-09-17T01:35:11.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.946+0000 7f2817e00640 1 --2- 172.21.15.42:0/1711245738 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f27fc078b90 0x7f27fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:11.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.947+0000 7f2817e00640 1 --2- 172.21.15.42:0/1711245738 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f27fc078b90 0x7f27fc07b0a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2820149250 tx=0x7f2808009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:11.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:11.950+0000 7f2817400640 1 -- 172.21.15.42:0/1711245738 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f281003f030 con 0x7f28200b4be0 2024-09-17T01:35:12.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.146+0000 7f2825200640 1 -- 172.21.15.42:0/1711245738 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2820152ed0 con 0x7f28200b4be0 2024-09-17T01:35:12.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.147+0000 7f2817400640 1 -- 172.21.15.42:0/1711245738 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16634 (secure 0 0 0) 0x7f2810031770 con 0x7f28200b4be0 2024-09-17T01:35:12.146 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:35:12.146 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":48,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:35:11.176128+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:35:09.123920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T01:35:10.132232+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:35:12.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.150+0000 7f2825200640 1 -- 172.21.15.42:0/1711245738 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f27fc078b90 msgr2=0x7f27fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:12.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.150+0000 7f2825200640 1 --2- 172.21.15.42:0/1711245738 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f27fc078b90 0x7f27fc07b0a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2820149250 tx=0x7f2808009040 comp rx=0 tx=0).stop 2024-09-17T01:35:12.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.150+0000 7f2825200640 1 -- 172.21.15.42:0/1711245738 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28200b4be0 msgr2=0x7f2820142490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:12.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.150+0000 7f2825200640 1 --2- 172.21.15.42:0/1711245738 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28200b4be0 0x7f2820142490 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f281002ab30 tx=0x7f2810033c20 comp rx=0 tx=0).stop 2024-09-17T01:35:12.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.150+0000 7f2825200640 1 -- 172.21.15.42:0/1711245738 shutdown_connections 2024-09-17T01:35:12.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.150+0000 7f2825200640 1 --2- 172.21.15.42:0/1711245738 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f27fc078b90 0x7f27fc07b0a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:12.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.150+0000 7f2825200640 1 --2- 172.21.15.42:0/1711245738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28201f70f0 0x7f28201f7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:12.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.150+0000 7f2825200640 1 --2- 172.21.15.42:0/1711245738 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28200cf7c0 0x7f28201f6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:12.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.150+0000 7f2825200640 1 --2- 172.21.15.42:0/1711245738 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28200b4be0 0x7f2820142490 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:12.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.150+0000 7f2825200640 1 -- 172.21.15.42:0/1711245738 >> 172.21.15.42:0/1711245738 conn(0x7f28200b25f0 msgr2=0x7f28200d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:12.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.150+0000 7f2825200640 1 -- 172.21.15.42:0/1711245738 shutdown_connections 2024-09-17T01:35:12.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.150+0000 7f2825200640 1 -- 172.21.15.42:0/1711245738 wait complete. 2024-09-17T01:35:12.173 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:35:12.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.401+0000 7fcaf0a00640 1 -- 172.21.15.42:0/741094057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcaec0750b0 msgr2=0x7fcaec06cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:12.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.401+0000 7fcaf0a00640 1 --2- 172.21.15.42:0/741094057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcaec0750b0 0x7fcaec06cf30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fcad4005fd0 tx=0x7fcad402a540 comp rx=0 tx=0).stop 2024-09-17T01:35:12.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.401+0000 7fcaf0a00640 1 -- 172.21.15.42:0/741094057 shutdown_connections 2024-09-17T01:35:12.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.401+0000 7fcaf0a00640 1 --2- 172.21.15.42:0/741094057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcaec0750b0 0x7fcaec06cf30 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:12.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.401+0000 7fcaf0a00640 1 --2- 172.21.15.42:0/741094057 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcaec0cd660 0x7fcaec15c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:12.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.401+0000 7fcaf0a00640 1 -- 172.21.15.42:0/741094057 >> 172.21.15.42:0/741094057 conn(0x7fcaec073510 msgr2=0x7fcaec0b6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:12.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.401+0000 7fcaf0a00640 1 -- 172.21.15.42:0/741094057 shutdown_connections 2024-09-17T01:35:12.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.401+0000 7fcaf0a00640 1 -- 172.21.15.42:0/741094057 wait complete. 2024-09-17T01:35:12.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.404+0000 7fcaf0a00640 1 Processor -- start 2024-09-17T01:35:12.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.404+0000 7fcaf0a00640 1 -- start start 2024-09-17T01:35:12.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.405+0000 7fcaf0a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcaec06d470 0x7fcaec1e6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:12.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.405+0000 7fcaf0a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcaec0750b0 0x7fcaec15ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:12.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.405+0000 7fcaf0a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcaec0cd660 0x7fcaec146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:12.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.405+0000 7fcaf0a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcaec160930 con 0x7fcaec06d470 2024-09-17T01:35:12.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.405+0000 7fcaf0a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcaec0b27c0 con 0x7fcaec0750b0 2024-09-17T01:35:12.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.405+0000 7fcaf0a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fcaec160ab0 con 0x7fcaec0cd660 2024-09-17T01:35:12.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.406+0000 7fcaeb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcaec06d470 0x7fcaec1e6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:12.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.406+0000 7fcaeb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcaec06d470 0x7fcaec1e6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33552/0 (socket says 172.21.15.42:33552) 2024-09-17T01:35:12.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.406+0000 7fcaeb400640 1 -- 172.21.15.42:0/2063096131 learned_addr learned my addr 172.21.15.42:0/2063096131 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:12.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.406+0000 7fcaebe00640 1 --2- 172.21.15.42:0/2063096131 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcaec0cd660 0x7fcaec146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:12.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.406+0000 7fcae3e00640 1 --2- 172.21.15.42:0/2063096131 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcaec0750b0 0x7fcaec15ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:12.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.406+0000 7fcaeb400640 1 -- 172.21.15.42:0/2063096131 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcaec0cd660 msgr2=0x7fcaec146fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:12.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.406+0000 7fcaeb400640 1 --2- 172.21.15.42:0/2063096131 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcaec0cd660 0x7fcaec146fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:12.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.406+0000 7fcaeb400640 1 -- 172.21.15.42:0/2063096131 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcaec0750b0 msgr2=0x7fcaec15ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:12.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.406+0000 7fcaeb400640 1 --2- 172.21.15.42:0/2063096131 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcaec0750b0 0x7fcaec15ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:12.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.406+0000 7fcaeb400640 1 -- 172.21.15.42:0/2063096131 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaec0cdab0 con 0x7fcaec06d470 2024-09-17T01:35:12.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.406+0000 7fcae3e00640 1 --2- 172.21.15.42:0/2063096131 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcaec0750b0 0x7fcaec15ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:12.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.406+0000 7fcaeb400640 1 --2- 172.21.15.42:0/2063096131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcaec06d470 0x7fcaec1e6060 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fcadc00e7c0 tx=0x7fcadc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:12.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.407+0000 7fcae3400640 1 -- 172.21.15.42:0/2063096131 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc00ccc0 con 0x7fcaec06d470 2024-09-17T01:35:12.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.407+0000 7fcae3400640 1 -- 172.21.15.42:0/2063096131 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcadc010430 con 0x7fcaec06d470 2024-09-17T01:35:12.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.407+0000 7fcae3400640 1 -- 172.21.15.42:0/2063096131 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc010860 con 0x7fcaec06d470 2024-09-17T01:35:12.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.407+0000 7fcaf0a00640 1 -- 172.21.15.42:0/2063096131 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaec0cdd90 con 0x7fcaec06d470 2024-09-17T01:35:12.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.407+0000 7fcaf0a00640 1 -- 172.21.15.42:0/2063096131 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaec0ce350 con 0x7fcaec06d470 2024-09-17T01:35:12.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.408+0000 7fcaf0a00640 1 -- 172.21.15.42:0/2063096131 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaec06cf30 con 0x7fcaec06d470 2024-09-17T01:35:12.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.409+0000 7fcae3400640 1 -- 172.21.15.42:0/2063096131 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcadc010a00 con 0x7fcaec06d470 2024-09-17T01:35:12.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.410+0000 7fcae3400640 1 --2- 172.21.15.42:0/2063096131 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcac8078b90 0x7fcac807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:12.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.411+0000 7fcae3400640 1 -- 172.21.15.42:0/2063096131 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7fcadc09b7f0 con 0x7fcaec06d470 2024-09-17T01:35:12.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.411+0000 7fcae3e00640 1 --2- 172.21.15.42:0/2063096131 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcac8078b90 0x7fcac807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:12.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.412+0000 7fcae3e00640 1 --2- 172.21.15.42:0/2063096131 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcac8078b90 0x7fcac807b0a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcad4033000 tx=0x7fcad4004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:12.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.415+0000 7fcae3400640 1 -- 172.21.15.42:0/2063096131 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcadc063b90 con 0x7fcaec06d470 2024-09-17T01:35:12.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.609+0000 7fcaf0a00640 1 -- 172.21.15.42:0/2063096131 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcaec0cd230 con 0x7fcaec06d470 2024-09-17T01:35:12.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.610+0000 7fcae3400640 1 -- 172.21.15.42:0/2063096131 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16634 (secure 0 0 0) 0x7fcadc063490 con 0x7fcaec06d470 2024-09-17T01:35:12.608 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:35:12.608 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":48,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:35:11.176128+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:35:09.123920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T01:35:10.132232+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:35:12.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.612+0000 7fcaf0a00640 1 -- 172.21.15.42:0/2063096131 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcac8078b90 msgr2=0x7fcac807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:12.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.612+0000 7fcaf0a00640 1 --2- 172.21.15.42:0/2063096131 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcac8078b90 0x7fcac807b0a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcad4033000 tx=0x7fcad4004730 comp rx=0 tx=0).stop 2024-09-17T01:35:12.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.612+0000 7fcaf0a00640 1 -- 172.21.15.42:0/2063096131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcaec06d470 msgr2=0x7fcaec1e6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:12.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.612+0000 7fcaf0a00640 1 --2- 172.21.15.42:0/2063096131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcaec06d470 0x7fcaec1e6060 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fcadc00e7c0 tx=0x7fcadc00ec80 comp rx=0 tx=0).stop 2024-09-17T01:35:12.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.612+0000 7fcaf0a00640 1 -- 172.21.15.42:0/2063096131 shutdown_connections 2024-09-17T01:35:12.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.612+0000 7fcaf0a00640 1 --2- 172.21.15.42:0/2063096131 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcac8078b90 0x7fcac807b0a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:12.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.612+0000 7fcaf0a00640 1 --2- 172.21.15.42:0/2063096131 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcaec0750b0 0x7fcaec15ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:12.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.612+0000 7fcaf0a00640 1 --2- 172.21.15.42:0/2063096131 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcaec0cd660 0x7fcaec146fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:12.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.612+0000 7fcaf0a00640 1 --2- 172.21.15.42:0/2063096131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcaec06d470 0x7fcaec1e6060 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:12.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.612+0000 7fcaf0a00640 1 -- 172.21.15.42:0/2063096131 >> 172.21.15.42:0/2063096131 conn(0x7fcaec073510 msgr2=0x7fcaec158c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:12.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.612+0000 7fcaf0a00640 1 -- 172.21.15.42:0/2063096131 shutdown_connections 2024-09-17T01:35:12.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.613+0000 7fcaf0a00640 1 -- 172.21.15.42:0/2063096131 wait complete. 2024-09-17T01:35:12.632 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T01:35:12.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.869+0000 7fe297000640 1 -- 172.21.15.42:0/2199344825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2900cf7c0 msgr2=0x7fe29006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:12.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.869+0000 7fe297000640 1 --2- 172.21.15.42:0/2199344825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2900cf7c0 0x7fe29006cd20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe27c005fd0 tx=0x7fe27c02a670 comp rx=0 tx=0).stop 2024-09-17T01:35:12.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.870+0000 7fe297000640 1 -- 172.21.15.42:0/2199344825 shutdown_connections 2024-09-17T01:35:12.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.870+0000 7fe297000640 1 --2- 172.21.15.42:0/2199344825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2900cf7c0 0x7fe29006cd20 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:12.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.870+0000 7fe297000640 1 -- 172.21.15.42:0/2199344825 >> 172.21.15.42:0/2199344825 conn(0x7fe2900b25f0 msgr2=0x7fe2900d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:12.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.870+0000 7fe297000640 1 -- 172.21.15.42:0/2199344825 shutdown_connections 2024-09-17T01:35:12.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.870+0000 7fe297000640 1 -- 172.21.15.42:0/2199344825 wait complete. 2024-09-17T01:35:12.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.872+0000 7fe297000640 1 Processor -- start 2024-09-17T01:35:12.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.872+0000 7fe297000640 1 -- start start 2024-09-17T01:35:12.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.874+0000 7fe297000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe29006d260 0x7fe2901e4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:12.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.874+0000 7fe297000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2900b4be0 0x7fe2901e5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:12.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.874+0000 7fe297000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe2900cf7c0 0x7fe2901f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:12.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.874+0000 7fe297000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe2901535e0 con 0x7fe2900b4be0 2024-09-17T01:35:12.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.874+0000 7fe297000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe2900b4340 con 0x7fe29006d260 2024-09-17T01:35:12.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.874+0000 7fe297000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe290153760 con 0x7fe2900cf7c0 2024-09-17T01:35:12.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.874+0000 7fe295200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2900b4be0 0x7fe2901e5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:12.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.874+0000 7fe295200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2900b4be0 0x7fe2901e5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33582/0 (socket says 172.21.15.42:33582) 2024-09-17T01:35:12.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.874+0000 7fe295c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe29006d260 0x7fe2901e4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:12.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.874+0000 7fe295200640 1 -- 172.21.15.42:0/1718943469 learned_addr learned my addr 172.21.15.42:0/1718943469 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:12.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.874+0000 7fe296600640 1 --2- 172.21.15.42:0/1718943469 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe2900cf7c0 0x7fe2901f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:12.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.874+0000 7fe295200640 1 -- 172.21.15.42:0/1718943469 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe2900cf7c0 msgr2=0x7fe2901f3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:12.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.874+0000 7fe295200640 1 --2- 172.21.15.42:0/1718943469 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe2900cf7c0 0x7fe2901f3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:12.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.874+0000 7fe295200640 1 -- 172.21.15.42:0/1718943469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe29006d260 msgr2=0x7fe2901e4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:12.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.874+0000 7fe295200640 1 --2- 172.21.15.42:0/1718943469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe29006d260 0x7fe2901e4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:12.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.875+0000 7fe295200640 1 -- 172.21.15.42:0/1718943469 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe29013d0c0 con 0x7fe2900b4be0 2024-09-17T01:35:12.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.875+0000 7fe295200640 1 --2- 172.21.15.42:0/1718943469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2900b4be0 0x7fe2901e5400 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe27c009230 tx=0x7fe27c003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:12.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.875+0000 7fe28d600640 1 -- 172.21.15.42:0/1718943469 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c03e030 con 0x7fe2900b4be0 2024-09-17T01:35:12.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.875+0000 7fe28d600640 1 -- 172.21.15.42:0/1718943469 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe27c003e00 con 0x7fe2900b4be0 2024-09-17T01:35:12.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.875+0000 7fe28d600640 1 -- 172.21.15.42:0/1718943469 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c035040 con 0x7fe2900b4be0 2024-09-17T01:35:12.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.875+0000 7fe297000640 1 -- 172.21.15.42:0/1718943469 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe290073500 con 0x7fe2900b4be0 2024-09-17T01:35:12.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.875+0000 7fe297000640 1 -- 172.21.15.42:0/1718943469 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2900737d0 con 0x7fe2900b4be0 2024-09-17T01:35:12.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.877+0000 7fe297000640 1 -- 172.21.15.42:0/1718943469 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe29006cd20 con 0x7fe2900b4be0 2024-09-17T01:35:12.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.878+0000 7fe28d600640 1 -- 172.21.15.42:0/1718943469 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe27c041030 con 0x7fe2900b4be0 2024-09-17T01:35:12.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.879+0000 7fe28d600640 1 --2- 172.21.15.42:0/1718943469 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe270078bc0 0x7fe27007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:12.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.879+0000 7fe28d600640 1 -- 172.21.15.42:0/1718943469 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fe27c0bb510 con 0x7fe2900b4be0 2024-09-17T01:35:12.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.879+0000 7fe295c00640 1 --2- 172.21.15.42:0/1718943469 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe270078bc0 0x7fe27007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:12.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.880+0000 7fe295c00640 1 --2- 172.21.15.42:0/1718943469 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe270078bc0 0x7fe27007b0d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe284000f60 tx=0x7fe284009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:12.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:12.883+0000 7fe28d600640 1 -- 172.21.15.42:0/1718943469 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe27c083420 con 0x7fe2900b4be0 2024-09-17T01:35:13.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.114+0000 7fe297000640 1 -- 172.21.15.42:0/1718943469 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe290073e90 con 0x7fe2900b4be0 2024-09-17T01:35:13.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.680+0000 7fe28d600640 1 -- 172.21.15.42:0/1718943469 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v27) ==== 118+0+0 (secure 0 0 0) 0x7fe27c087e50 con 0x7fe2900b4be0 2024-09-17T01:35:13.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.684+0000 7fe297000640 1 -- 172.21.15.42:0/1718943469 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe270078bc0 msgr2=0x7fe27007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:13.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.684+0000 7fe297000640 1 --2- 172.21.15.42:0/1718943469 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe270078bc0 0x7fe27007b0d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe284000f60 tx=0x7fe284009040 comp rx=0 tx=0).stop 2024-09-17T01:35:13.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.684+0000 7fe297000640 1 -- 172.21.15.42:0/1718943469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2900b4be0 msgr2=0x7fe2901e5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:13.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.684+0000 7fe297000640 1 --2- 172.21.15.42:0/1718943469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2900b4be0 0x7fe2901e5400 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe27c009230 tx=0x7fe27c003910 comp rx=0 tx=0).stop 2024-09-17T01:35:13.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.684+0000 7fe297000640 1 -- 172.21.15.42:0/1718943469 shutdown_connections 2024-09-17T01:35:13.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.684+0000 7fe297000640 1 --2- 172.21.15.42:0/1718943469 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe270078bc0 0x7fe27007b0d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:13.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.684+0000 7fe297000640 1 --2- 172.21.15.42:0/1718943469 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe2900cf7c0 0x7fe2901f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:13.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.684+0000 7fe297000640 1 --2- 172.21.15.42:0/1718943469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2900b4be0 0x7fe2901e5400 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:13.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.684+0000 7fe297000640 1 --2- 172.21.15.42:0/1718943469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe29006d260 0x7fe2901e4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:13.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.684+0000 7fe297000640 1 -- 172.21.15.42:0/1718943469 >> 172.21.15.42:0/1718943469 conn(0x7fe2900b25f0 msgr2=0x7fe2900b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:13.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.684+0000 7fe297000640 1 -- 172.21.15.42:0/1718943469 shutdown_connections 2024-09-17T01:35:13.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.684+0000 7fe297000640 1 -- 172.21.15.42:0/1718943469 wait complete. 2024-09-17T01:35:13.704 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T01:35:13.705 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T01:35:13.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.938+0000 7f36be400640 1 -- 172.21.15.42:0/2558531630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b80d0d80 msgr2=0x7f36b806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:13.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.938+0000 7f36be400640 1 --2- 172.21.15.42:0/2558531630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b80d0d80 0x7f36b806cd20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f36ac009830 tx=0x7f36ac02a5c0 comp rx=0 tx=0).stop 2024-09-17T01:35:13.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.938+0000 7f36be400640 1 -- 172.21.15.42:0/2558531630 shutdown_connections 2024-09-17T01:35:13.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.938+0000 7f36be400640 1 --2- 172.21.15.42:0/2558531630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b80d0d80 0x7f36b806cd20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:13.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.938+0000 7f36be400640 1 -- 172.21.15.42:0/2558531630 >> 172.21.15.42:0/2558531630 conn(0x7f36b80b25f0 msgr2=0x7f36b80d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:13.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.938+0000 7f36be400640 1 -- 172.21.15.42:0/2558531630 shutdown_connections 2024-09-17T01:35:13.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.938+0000 7f36be400640 1 -- 172.21.15.42:0/2558531630 wait complete. 2024-09-17T01:35:13.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.940+0000 7f36be400640 1 Processor -- start 2024-09-17T01:35:13.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.941+0000 7f36be400640 1 -- start start 2024-09-17T01:35:13.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.942+0000 7f36be400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36b806d260 0x7f36b8151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:13.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.942+0000 7f36be400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b80af460 0x7f36b8160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:13.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.942+0000 7f36be400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b80d0d80 0x7f36b8161420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:13.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.942+0000 7f36be400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f36b81632b0 con 0x7f36b80af460 2024-09-17T01:35:13.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.942+0000 7f36be400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f36b8163130 con 0x7f36b80d0d80 2024-09-17T01:35:13.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.942+0000 7f36be400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f36b815ea00 con 0x7f36b806d260 2024-09-17T01:35:13.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.942+0000 7f36b7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b80af460 0x7f36b8160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:13.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.942+0000 7f36b7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b80af460 0x7f36b8160ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33598/0 (socket says 172.21.15.42:33598) 2024-09-17T01:35:13.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.942+0000 7f36b7e00640 1 -- 172.21.15.42:0/640494975 learned_addr learned my addr 172.21.15.42:0/640494975 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:13.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.942+0000 7f36bd000640 1 --2- 172.21.15.42:0/640494975 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36b806d260 0x7f36b8151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:13.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.942+0000 7f36bda00640 1 --2- 172.21.15.42:0/640494975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b80d0d80 0x7f36b8161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:13.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.943+0000 7f36b7e00640 1 -- 172.21.15.42:0/640494975 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36b806d260 msgr2=0x7f36b8151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:13.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.943+0000 7f36b7e00640 1 --2- 172.21.15.42:0/640494975 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36b806d260 0x7f36b8151f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:13.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.943+0000 7f36b7e00640 1 -- 172.21.15.42:0/640494975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b80d0d80 msgr2=0x7f36b8161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:13.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.943+0000 7f36b7e00640 1 --2- 172.21.15.42:0/640494975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b80d0d80 0x7f36b8161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:13.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.943+0000 7f36b7e00640 1 -- 172.21.15.42:0/640494975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b81f9040 con 0x7f36b80af460 2024-09-17T01:35:13.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.943+0000 7f36bda00640 1 --2- 172.21.15.42:0/640494975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b80d0d80 0x7f36b8161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:13.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.943+0000 7f36b7e00640 1 --2- 172.21.15.42:0/640494975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b80af460 0x7f36b8160ee0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f36a400c3a0 tx=0x7f36a400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:13.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.943+0000 7f36b4c00640 1 -- 172.21.15.42:0/640494975 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4017070 con 0x7f36b80af460 2024-09-17T01:35:13.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.943+0000 7f36b4c00640 1 -- 172.21.15.42:0/640494975 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36a40035f0 con 0x7f36b80af460 2024-09-17T01:35:13.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.943+0000 7f36be400640 1 -- 172.21.15.42:0/640494975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36b81f9c50 con 0x7f36b80af460 2024-09-17T01:35:13.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.943+0000 7f36b4c00640 1 -- 172.21.15.42:0/640494975 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4003a40 con 0x7f36b80af460 2024-09-17T01:35:13.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.944+0000 7f36be400640 1 -- 172.21.15.42:0/640494975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36b81f9600 con 0x7f36b80af460 2024-09-17T01:35:13.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.944+0000 7f36be400640 1 -- 172.21.15.42:0/640494975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36b806cd20 con 0x7f36b80af460 2024-09-17T01:35:13.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.946+0000 7f36b4c00640 1 -- 172.21.15.42:0/640494975 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f36a401a070 con 0x7f36b80af460 2024-09-17T01:35:13.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.947+0000 7f36b4c00640 1 --2- 172.21.15.42:0/640494975 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3698078b90 0x7f369807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:13.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.947+0000 7f36b4c00640 1 -- 172.21.15.42:0/640494975 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f36a409a060 con 0x7f36b80af460 2024-09-17T01:35:13.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.947+0000 7f36bd000640 1 --2- 172.21.15.42:0/640494975 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3698078b90 0x7f369807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:13.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.948+0000 7f36bd000640 1 --2- 172.21.15.42:0/640494975 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3698078b90 0x7f369807b0a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f36ac034000 tx=0x7f36ac004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:13.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:13.951+0000 7f36b4c00640 1 -- 172.21.15.42:0/640494975 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f36b806d670 con 0x7f36b80af460 2024-09-17T01:35:14.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.183+0000 7f36be400640 1 -- 172.21.15.42:0/640494975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f36b815bc70 con 0x7f36b80af460 2024-09-17T01:35:14.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.687+0000 7f36b4c00640 1 -- 172.21.15.42:0/640494975 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f36a4061db0 con 0x7f36b80af460 2024-09-17T01:35:14.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.690+0000 7f36be400640 1 -- 172.21.15.42:0/640494975 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3698078b90 msgr2=0x7f369807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:14.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.690+0000 7f36be400640 1 --2- 172.21.15.42:0/640494975 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3698078b90 0x7f369807b0a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f36ac034000 tx=0x7f36ac004730 comp rx=0 tx=0).stop 2024-09-17T01:35:14.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.690+0000 7f36be400640 1 -- 172.21.15.42:0/640494975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b80af460 msgr2=0x7f36b8160ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:14.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.690+0000 7f36be400640 1 --2- 172.21.15.42:0/640494975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b80af460 0x7f36b8160ee0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f36a400c3a0 tx=0x7f36a400c860 comp rx=0 tx=0).stop 2024-09-17T01:35:14.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.690+0000 7f36be400640 1 -- 172.21.15.42:0/640494975 shutdown_connections 2024-09-17T01:35:14.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.690+0000 7f36be400640 1 --2- 172.21.15.42:0/640494975 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3698078b90 0x7f369807b0a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:14.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.690+0000 7f36be400640 1 --2- 172.21.15.42:0/640494975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b80d0d80 0x7f36b8161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:14.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.690+0000 7f36be400640 1 --2- 172.21.15.42:0/640494975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b80af460 0x7f36b8160ee0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:14.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.690+0000 7f36be400640 1 --2- 172.21.15.42:0/640494975 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36b806d260 0x7f36b8151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:14.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.690+0000 7f36be400640 1 -- 172.21.15.42:0/640494975 >> 172.21.15.42:0/640494975 conn(0x7f36b80b25f0 msgr2=0x7f36b8075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:14.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.690+0000 7f36be400640 1 -- 172.21.15.42:0/640494975 shutdown_connections 2024-09-17T01:35:14.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.690+0000 7f36be400640 1 -- 172.21.15.42:0/640494975 wait complete. 2024-09-17T01:35:14.715 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T01:35:14.715 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:35:14.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.950+0000 7f5a0ec00640 1 -- 172.21.15.42:0/1351350659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a0806cd20 msgr2=0x7f5a0806d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:14.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.950+0000 7f5a0ec00640 1 --2- 172.21.15.42:0/1351350659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a0806cd20 0x7f5a0806d130 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f59fc00a940 tx=0x7f59fc02b8f0 comp rx=0 tx=0).stop 2024-09-17T01:35:14.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.950+0000 7f5a0ec00640 1 -- 172.21.15.42:0/1351350659 shutdown_connections 2024-09-17T01:35:14.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.950+0000 7f5a0ec00640 1 --2- 172.21.15.42:0/1351350659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a0806cd20 0x7f5a0806d130 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:14.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.950+0000 7f5a0ec00640 1 -- 172.21.15.42:0/1351350659 >> 172.21.15.42:0/1351350659 conn(0x7f5a080b25f0 msgr2=0x7f5a080d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:14.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.950+0000 7f5a0ec00640 1 -- 172.21.15.42:0/1351350659 shutdown_connections 2024-09-17T01:35:14.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.950+0000 7f5a0ec00640 1 -- 172.21.15.42:0/1351350659 wait complete. 2024-09-17T01:35:14.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.952+0000 7f5a0ec00640 1 Processor -- start 2024-09-17T01:35:14.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.953+0000 7f5a0ec00640 1 -- start start 2024-09-17T01:35:14.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.954+0000 7f5a0ec00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a0806cd20 0x7f5a081f6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:14.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.954+0000 7f5a0ec00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a080b30a0 0x7f5a08149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:14.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.954+0000 7f5a0ec00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a080cf230 0x7f5a0815d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:14.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.954+0000 7f5a0ec00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5a08070470 con 0x7f5a080b30a0 2024-09-17T01:35:14.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.954+0000 7f5a0ec00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5a080702f0 con 0x7f5a0806cd20 2024-09-17T01:35:14.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.954+0000 7f5a0ec00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5a080b3bc0 con 0x7f5a080cf230 2024-09-17T01:35:14.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.954+0000 7f5a0ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a080b30a0 0x7f5a08149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:14.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.954+0000 7f5a0ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a080b30a0 0x7f5a08149140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33616/0 (socket says 172.21.15.42:33616) 2024-09-17T01:35:14.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.954+0000 7f5a0ce00640 1 -- 172.21.15.42:0/655003692 learned_addr learned my addr 172.21.15.42:0/655003692 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:14.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.954+0000 7f5a0d800640 1 --2- 172.21.15.42:0/655003692 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a0806cd20 0x7f5a081f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:14.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.954+0000 7f5a0e200640 1 --2- 172.21.15.42:0/655003692 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a080cf230 0x7f5a0815d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:14.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.955+0000 7f5a0ce00640 1 -- 172.21.15.42:0/655003692 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a080cf230 msgr2=0x7f5a0815d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:14.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.955+0000 7f5a0ce00640 1 --2- 172.21.15.42:0/655003692 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a080cf230 0x7f5a0815d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:14.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.955+0000 7f5a0ce00640 1 -- 172.21.15.42:0/655003692 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a0806cd20 msgr2=0x7f5a081f6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:14.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.955+0000 7f5a0ce00640 1 --2- 172.21.15.42:0/655003692 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a0806cd20 0x7f5a081f6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:14.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.955+0000 7f5a0ce00640 1 -- 172.21.15.42:0/655003692 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a08146840 con 0x7f5a080b30a0 2024-09-17T01:35:14.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.955+0000 7f5a0ce00640 1 --2- 172.21.15.42:0/655003692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a080b30a0 0x7f5a08149140 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f59f400c370 tx=0x7f59f400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:14.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.955+0000 7f5a05600640 1 -- 172.21.15.42:0/655003692 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f4017070 con 0x7f5a080b30a0 2024-09-17T01:35:14.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.955+0000 7f5a05600640 1 -- 172.21.15.42:0/655003692 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59f40035f0 con 0x7f5a080b30a0 2024-09-17T01:35:14.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.955+0000 7f5a05600640 1 -- 172.21.15.42:0/655003692 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f4003a40 con 0x7f5a080b30a0 2024-09-17T01:35:14.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.955+0000 7f5a0ec00640 1 -- 172.21.15.42:0/655003692 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a081f6a40 con 0x7f5a080b30a0 2024-09-17T01:35:14.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.956+0000 7f5a0ec00640 1 -- 172.21.15.42:0/655003692 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a081f7550 con 0x7f5a080b30a0 2024-09-17T01:35:14.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.957+0000 7f5a0ec00640 1 -- 172.21.15.42:0/655003692 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a081f6fe0 con 0x7f5a080b30a0 2024-09-17T01:35:14.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.958+0000 7f5a05600640 1 -- 172.21.15.42:0/655003692 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f59f401a070 con 0x7f5a080b30a0 2024-09-17T01:35:14.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.959+0000 7f5a05600640 1 --2- 172.21.15.42:0/655003692 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f59e8078b90 0x7f59e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:14.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.960+0000 7f5a05600640 1 -- 172.21.15.42:0/655003692 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f59f4099fd0 con 0x7f5a080b30a0 2024-09-17T01:35:14.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.960+0000 7f5a0d800640 1 --2- 172.21.15.42:0/655003692 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f59e8078b90 0x7f59e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:14.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.961+0000 7f5a0d800640 1 --2- 172.21.15.42:0/655003692 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f59e8078b90 0x7f59e807b0a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f59fc036000 tx=0x7f59fc004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:14.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:14.964+0000 7f5a05600640 1 -- 172.21.15.42:0/655003692 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5a081f6a40 con 0x7f5a080b30a0 2024-09-17T01:35:15.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.198+0000 7f5a0ec00640 1 -- 172.21.15.42:0/655003692 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a080b4070 con 0x7f5a080b30a0 2024-09-17T01:35:15.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.198+0000 7f5a05600640 1 -- 172.21.15.42:0/655003692 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5223 (secure 0 0 0) 0x7f5a0806d670 con 0x7f5a080b30a0 2024-09-17T01:35:15.196 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:35:15.196 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":28,"btime":"2024-09-17T01:35:14:681513+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5209,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4107697732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":4107697732},{"type":"v1","addr":"172.21.15.43:6837","nonce":4107697732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1959050852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1959050852},{"type":"v1","addr":"172.21.15.42:6833","nonce":1959050852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5271,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2487768756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2487768756},{"type":"v1","addr":"172.21.15.43:6836","nonce":2487768756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:35:11.176089+0000","modified":"2024-09-17T01:35:14.184451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1094322669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1094322669},{"type":"v1","addr":"172.21.15.42:6835","nonce":1094322669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-17T01:35:15.197 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 28 2024-09-17T01:35:15.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.201+0000 7f5a0ec00640 1 -- 172.21.15.42:0/655003692 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f59e8078b90 msgr2=0x7f59e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:15.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.201+0000 7f5a0ec00640 1 --2- 172.21.15.42:0/655003692 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f59e8078b90 0x7f59e807b0a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f59fc036000 tx=0x7f59fc004730 comp rx=0 tx=0).stop 2024-09-17T01:35:15.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.201+0000 7f5a0ec00640 1 -- 172.21.15.42:0/655003692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a080b30a0 msgr2=0x7f5a08149140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:15.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.201+0000 7f5a0ec00640 1 --2- 172.21.15.42:0/655003692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a080b30a0 0x7f5a08149140 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f59f400c370 tx=0x7f59f400c830 comp rx=0 tx=0).stop 2024-09-17T01:35:15.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.201+0000 7f5a0ec00640 1 -- 172.21.15.42:0/655003692 shutdown_connections 2024-09-17T01:35:15.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.201+0000 7f5a0ec00640 1 --2- 172.21.15.42:0/655003692 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f59e8078b90 0x7f59e807b0a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:15.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.201+0000 7f5a0ec00640 1 --2- 172.21.15.42:0/655003692 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a080cf230 0x7f5a0815d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:15.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.201+0000 7f5a0ec00640 1 --2- 172.21.15.42:0/655003692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a080b30a0 0x7f5a08149140 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:15.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.201+0000 7f5a0ec00640 1 --2- 172.21.15.42:0/655003692 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a0806cd20 0x7f5a081f6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:15.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.201+0000 7f5a0ec00640 1 -- 172.21.15.42:0/655003692 >> 172.21.15.42:0/655003692 conn(0x7f5a080b25f0 msgr2=0x7f5a080743f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:15.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.201+0000 7f5a0ec00640 1 -- 172.21.15.42:0/655003692 shutdown_connections 2024-09-17T01:35:15.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.201+0000 7f5a0ec00640 1 -- 172.21.15.42:0/655003692 wait complete. 2024-09-17T01:35:15.222 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:35:15.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.452+0000 7f4add200640 1 -- 172.21.15.42:0/318684940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ad806d430 msgr2=0x7f4ad8152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:15.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.452+0000 7f4add200640 1 --2- 172.21.15.42:0/318684940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ad806d430 0x7f4ad8152ed0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0005fd0 tx=0x7f4ad002a8b0 comp rx=0 tx=0).stop 2024-09-17T01:35:15.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.452+0000 7f4add200640 1 -- 172.21.15.42:0/318684940 shutdown_connections 2024-09-17T01:35:15.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.452+0000 7f4add200640 1 --2- 172.21.15.42:0/318684940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ad806d430 0x7f4ad8152ed0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:15.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.452+0000 7f4add200640 1 -- 172.21.15.42:0/318684940 >> 172.21.15.42:0/318684940 conn(0x7f4ad80b25f0 msgr2=0x7f4ad80d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:15.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.452+0000 7f4add200640 1 -- 172.21.15.42:0/318684940 shutdown_connections 2024-09-17T01:35:15.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.452+0000 7f4add200640 1 -- 172.21.15.42:0/318684940 wait complete. 2024-09-17T01:35:15.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.454+0000 7f4add200640 1 Processor -- start 2024-09-17T01:35:15.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.454+0000 7f4add200640 1 -- start start 2024-09-17T01:35:15.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.456+0000 7f4add200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4ad80b4be0 0x7f4ad8073ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:15.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.456+0000 7f4add200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ad80cf7c0 0x7f4ad81511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:15.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.456+0000 7f4add200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ad80c9420 0x7f4ad80c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:15.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.456+0000 7f4add200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad8153590 con 0x7f4ad80c9420 2024-09-17T01:35:15.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.456+0000 7f4add200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad8153410 con 0x7f4ad80cf7c0 2024-09-17T01:35:15.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.456+0000 7f4add200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4ad8153710 con 0x7f4ad80b4be0 2024-09-17T01:35:15.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.456+0000 7f4ad7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ad80c9420 0x7f4ad80c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:15.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.456+0000 7f4ad7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ad80c9420 0x7f4ad80c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33628/0 (socket says 172.21.15.42:33628) 2024-09-17T01:35:15.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.456+0000 7f4ad7e00640 1 -- 172.21.15.42:0/453874132 learned_addr learned my addr 172.21.15.42:0/453874132 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:15.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.456+0000 7f4ad7400640 1 --2- 172.21.15.42:0/453874132 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4ad80b4be0 0x7f4ad8073ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:15.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.456+0000 7f4acfe00640 1 --2- 172.21.15.42:0/453874132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ad80cf7c0 0x7f4ad81511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:15.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.456+0000 7f4ad7e00640 1 -- 172.21.15.42:0/453874132 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4ad80b4be0 msgr2=0x7f4ad8073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:15.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.456+0000 7f4ad7e00640 1 --2- 172.21.15.42:0/453874132 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4ad80b4be0 0x7f4ad8073ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:15.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.456+0000 7f4ad7e00640 1 -- 172.21.15.42:0/453874132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ad80cf7c0 msgr2=0x7f4ad81511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:15.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.456+0000 7f4ad7e00640 1 --2- 172.21.15.42:0/453874132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ad80cf7c0 0x7f4ad81511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:15.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.456+0000 7f4ad7e00640 1 -- 172.21.15.42:0/453874132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad80c9d70 con 0x7f4ad80c9420 2024-09-17T01:35:15.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.457+0000 7f4ad7e00640 1 --2- 172.21.15.42:0/453874132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ad80c9420 0x7f4ad80c9830 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4ad002aea0 tx=0x7f4ad00039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:15.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.457+0000 7f4acf400640 1 -- 172.21.15.42:0/453874132 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0031990 con 0x7f4ad80c9420 2024-09-17T01:35:15.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.457+0000 7f4acf400640 1 -- 172.21.15.42:0/453874132 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ad0031c20 con 0x7f4ad80c9420 2024-09-17T01:35:15.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.457+0000 7f4add200640 1 -- 172.21.15.42:0/453874132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ad8074530 con 0x7f4ad80c9420 2024-09-17T01:35:15.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.457+0000 7f4acf400640 1 -- 172.21.15.42:0/453874132 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad00330d0 con 0x7f4ad80c9420 2024-09-17T01:35:15.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.457+0000 7f4add200640 1 -- 172.21.15.42:0/453874132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ad80ca800 con 0x7f4ad80c9420 2024-09-17T01:35:15.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.458+0000 7f4add200640 1 -- 172.21.15.42:0/453874132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ad8152ed0 con 0x7f4ad80c9420 2024-09-17T01:35:15.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.460+0000 7f4acf400640 1 -- 172.21.15.42:0/453874132 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4ad0033290 con 0x7f4ad80c9420 2024-09-17T01:35:15.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.461+0000 7f4acf400640 1 --2- 172.21.15.42:0/453874132 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4ab4078b90 0x7f4ab407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:15.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.461+0000 7f4acf400640 1 -- 172.21.15.42:0/453874132 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f4ad00bc260 con 0x7f4ad80c9420 2024-09-17T01:35:15.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.461+0000 7f4ad7400640 1 --2- 172.21.15.42:0/453874132 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4ab4078b90 0x7f4ab407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:15.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.462+0000 7f4ad7400640 1 --2- 172.21.15.42:0/453874132 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4ab4078b90 0x7f4ab407b0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8000f60 tx=0x7f4ac8009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:15.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.465+0000 7f4acf400640 1 -- 172.21.15.42:0/453874132 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4ad80c9d70 con 0x7f4ad80c9420 2024-09-17T01:35:15.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.661+0000 7f4add200640 1 -- 172.21.15.42:0/453874132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4ad8073ff0 con 0x7f4ad80c9420 2024-09-17T01:35:15.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.663+0000 7f4acf400640 1 -- 172.21.15.42:0/453874132 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+16621 (secure 0 0 0) 0x7f4ad003f030 con 0x7f4ad80c9420 2024-09-17T01:35:15.660 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:35:15.661 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":49,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:35:12.660992+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:35:09.123920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T01:35:10.132232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:35:15.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.665+0000 7f4add200640 1 -- 172.21.15.42:0/453874132 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4ab4078b90 msgr2=0x7f4ab407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:15.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.665+0000 7f4add200640 1 --2- 172.21.15.42:0/453874132 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4ab4078b90 0x7f4ab407b0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8000f60 tx=0x7f4ac8009040 comp rx=0 tx=0).stop 2024-09-17T01:35:15.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.665+0000 7f4add200640 1 -- 172.21.15.42:0/453874132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ad80c9420 msgr2=0x7f4ad80c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:15.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.665+0000 7f4add200640 1 --2- 172.21.15.42:0/453874132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ad80c9420 0x7f4ad80c9830 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4ad002aea0 tx=0x7f4ad00039f0 comp rx=0 tx=0).stop 2024-09-17T01:35:15.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.665+0000 7f4add200640 1 -- 172.21.15.42:0/453874132 shutdown_connections 2024-09-17T01:35:15.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.665+0000 7f4add200640 1 --2- 172.21.15.42:0/453874132 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4ab4078b90 0x7f4ab407b0a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:15.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.665+0000 7f4add200640 1 --2- 172.21.15.42:0/453874132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ad80cf7c0 0x7f4ad81511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:15.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.665+0000 7f4add200640 1 --2- 172.21.15.42:0/453874132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ad80c9420 0x7f4ad80c9830 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:15.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.665+0000 7f4add200640 1 --2- 172.21.15.42:0/453874132 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4ad80b4be0 0x7f4ad8073ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:15.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.665+0000 7f4add200640 1 -- 172.21.15.42:0/453874132 >> 172.21.15.42:0/453874132 conn(0x7f4ad80b25f0 msgr2=0x7f4ad80b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:15.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.666+0000 7f4add200640 1 -- 172.21.15.42:0/453874132 shutdown_connections 2024-09-17T01:35:15.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.666+0000 7f4add200640 1 -- 172.21.15.42:0/453874132 wait complete. 2024-09-17T01:35:15.689 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T01:35:15.689 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:35:15.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.920+0000 7fd539600640 1 -- 172.21.15.42:0/2554226447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd518003a50 msgr2=0x7fd518003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:15.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.920+0000 7fd539600640 1 --2- 172.21.15.42:0/2554226447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd518003a50 0x7fd518003ec0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd524001dc0 tx=0x7fd518005830 comp rx=0 tx=0).stop 2024-09-17T01:35:15.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.920+0000 7fd539600640 1 -- 172.21.15.42:0/2554226447 shutdown_connections 2024-09-17T01:35:15.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.920+0000 7fd539600640 1 --2- 172.21.15.42:0/2554226447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd518003a50 0x7fd518003ec0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:15.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.921+0000 7fd539600640 1 -- 172.21.15.42:0/2554226447 >> 172.21.15.42:0/2554226447 conn(0x7fd5340b2930 msgr2=0x7fd53406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:15.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.921+0000 7fd539600640 1 -- 172.21.15.42:0/2554226447 shutdown_connections 2024-09-17T01:35:15.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.921+0000 7fd539600640 1 -- 172.21.15.42:0/2554226447 wait complete. 2024-09-17T01:35:15.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.923+0000 7fd539600640 1 Processor -- start 2024-09-17T01:35:15.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.923+0000 7fd539600640 1 -- start start 2024-09-17T01:35:15.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.924+0000 7fd539600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd518003a50 0x7fd53413ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:15.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.924+0000 7fd539600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd53413d710 0x7fd5341e98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:15.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.924+0000 7fd539600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5341e7a80 0x7fd5341e7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:15.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.924+0000 7fd539600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd53415fc20 con 0x7fd5341e7a80 2024-09-17T01:35:15.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.924+0000 7fd539600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd53415faa0 con 0x7fd518003a50 2024-09-17T01:35:15.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.924+0000 7fd539600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd53415fda0 con 0x7fd53413d710 2024-09-17T01:35:15.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.925+0000 7fd533400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5341e7a80 0x7fd5341e7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:15.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.925+0000 7fd533400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5341e7a80 0x7fd5341e7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52750/0 (socket says 172.21.15.42:52750) 2024-09-17T01:35:15.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.925+0000 7fd533400640 1 -- 172.21.15.42:0/333445602 learned_addr learned my addr 172.21.15.42:0/333445602 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:15.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.925+0000 7fd52a000640 1 --2- 172.21.15.42:0/333445602 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd53413d710 0x7fd5341e98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:15.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.925+0000 7fd532a00640 1 --2- 172.21.15.42:0/333445602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd518003a50 0x7fd53413ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:15.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.925+0000 7fd533400640 1 -- 172.21.15.42:0/333445602 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd53413d710 msgr2=0x7fd5341e98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:15.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.925+0000 7fd533400640 1 --2- 172.21.15.42:0/333445602 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd53413d710 0x7fd5341e98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:15.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.925+0000 7fd533400640 1 -- 172.21.15.42:0/333445602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd518003a50 msgr2=0x7fd53413ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:15.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.925+0000 7fd533400640 1 --2- 172.21.15.42:0/333445602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd518003a50 0x7fd53413ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:15.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.925+0000 7fd533400640 1 -- 172.21.15.42:0/333445602 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5341e8840 con 0x7fd5341e7a80 2024-09-17T01:35:15.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.925+0000 7fd533400640 1 --2- 172.21.15.42:0/333445602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5341e7a80 0x7fd5341e7e90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd534074300 tx=0x7fd52c011c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:15.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.926+0000 7fd52b400640 1 -- 172.21.15.42:0/333445602 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52c004440 con 0x7fd5341e7a80 2024-09-17T01:35:15.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.926+0000 7fd52b400640 1 -- 172.21.15.42:0/333445602 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd52c00f920 con 0x7fd5341e7a80 2024-09-17T01:35:15.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.926+0000 7fd539600640 1 -- 172.21.15.42:0/333445602 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5341e8b20 con 0x7fd5341e7a80 2024-09-17T01:35:15.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.926+0000 7fd52b400640 1 -- 172.21.15.42:0/333445602 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52c00fd70 con 0x7fd5341e7a80 2024-09-17T01:35:15.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.926+0000 7fd539600640 1 -- 172.21.15.42:0/333445602 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5341e90e0 con 0x7fd5341e7a80 2024-09-17T01:35:15.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.927+0000 7fd539600640 1 -- 172.21.15.42:0/333445602 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd534152610 con 0x7fd5341e7a80 2024-09-17T01:35:15.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.928+0000 7fd52b400640 1 -- 172.21.15.42:0/333445602 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd52c0035f0 con 0x7fd5341e7a80 2024-09-17T01:35:15.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.929+0000 7fd52b400640 1 --2- 172.21.15.42:0/333445602 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd510078b90 0x7fd51007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:15.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.929+0000 7fd52b400640 1 -- 172.21.15.42:0/333445602 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fd52c09b560 con 0x7fd5341e7a80 2024-09-17T01:35:15.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.930+0000 7fd532a00640 1 --2- 172.21.15.42:0/333445602 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd510078b90 0x7fd51007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:15.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.930+0000 7fd532a00640 1 --2- 172.21.15.42:0/333445602 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd510078b90 0x7fd51007b0a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd524032000 tx=0x7fd524001510 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:15.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:15.934+0000 7fd52b400640 1 -- 172.21.15.42:0/333445602 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd52c063340 con 0x7fd5341e7a80 2024-09-17T01:35:16.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.123+0000 7fd539600640 1 -- 172.21.15.42:0/333445602 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd5341e85d0 con 0x7fd510078b90 2024-09-17T01:35:16.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.129+0000 7fd52b400640 1 -- 172.21.15.42:0/333445602 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250596 (secure 0 0 0) 0x7fd5341e85d0 con 0x7fd510078b90 2024-09-17T01:35:16.130 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:35:16.131 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:35:16.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.133+0000 7fd539600640 1 -- 172.21.15.42:0/333445602 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd510078b90 msgr2=0x7fd51007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:16.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.133+0000 7fd539600640 1 --2- 172.21.15.42:0/333445602 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd510078b90 0x7fd51007b0a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd524032000 tx=0x7fd524001510 comp rx=0 tx=0).stop 2024-09-17T01:35:16.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.133+0000 7fd539600640 1 -- 172.21.15.42:0/333445602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5341e7a80 msgr2=0x7fd5341e7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:16.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.133+0000 7fd539600640 1 --2- 172.21.15.42:0/333445602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5341e7a80 0x7fd5341e7e90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd534074300 tx=0x7fd52c011c60 comp rx=0 tx=0).stop 2024-09-17T01:35:16.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.133+0000 7fd539600640 1 -- 172.21.15.42:0/333445602 shutdown_connections 2024-09-17T01:35:16.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.133+0000 7fd539600640 1 --2- 172.21.15.42:0/333445602 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd510078b90 0x7fd51007b0a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:16.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.133+0000 7fd539600640 1 --2- 172.21.15.42:0/333445602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5341e7a80 0x7fd5341e7e90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:16.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.133+0000 7fd539600640 1 --2- 172.21.15.42:0/333445602 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd53413d710 0x7fd5341e98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:16.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.133+0000 7fd539600640 1 --2- 172.21.15.42:0/333445602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd518003a50 0x7fd53413ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:16.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.133+0000 7fd539600640 1 -- 172.21.15.42:0/333445602 >> 172.21.15.42:0/333445602 conn(0x7fd5340b2930 msgr2=0x7fd534075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:16.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.133+0000 7fd539600640 1 -- 172.21.15.42:0/333445602 shutdown_connections 2024-09-17T01:35:16.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.133+0000 7fd539600640 1 -- 172.21.15.42:0/333445602 wait complete. 2024-09-17T01:35:16.156 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-09-17T01:35:15.028524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":142,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":176,"acting":176,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":152,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":317552,"kb_used_data":5632,"kb_used_omap":12,"kb_used_meta":311731,"kb_avail":754657168,"statfs":{"total":773094113280,"available":772768940032,"internally_reserved":0,"allocated":5767168,"data_stored":3035548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":319213108},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2320,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.385419"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166861+0000","last_change":"2024-09-17T01:35:11.679886+0000","last_active":"2024-09-17T01:35:13.166861+0000","last_peered":"2024-09-17T01:35:13.166861+0000","last_clean":"2024-09-17T01:35:13.166861+0000","last_became_active":"2024-09-17T01:35:11.679571+0000","last_became_peered":"2024-09-17T01:35:11.679571+0000","last_unstale":"2024-09-17T01:35:13.166861+0000","last_undegraded":"2024-09-17T01:35:13.166861+0000","last_fullsized":"2024-09-17T01:35:13.166861+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:35:44.406490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:35:10.641797+0000","last_change":"2024-09-17T01:35:10.641797+0000","last_active":"2024-09-17T01:35:10.641797+0000","last_peered":"2024-09-17T01:35:10.641797+0000","last_clean":"2024-09-17T01:35:10.641797+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:35:10.641797+0000","last_undegraded":"2024-09-17T01:35:10.641797+0000","last_fullsized":"2024-09-17T01:35:10.641797+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665916+0000","last_change":"2024-09-17T01:35:11.677052+0000","last_active":"2024-09-17T01:35:12.665916+0000","last_peered":"2024-09-17T01:35:12.665916+0000","last_clean":"2024-09-17T01:35:12.665916+0000","last_became_active":"2024-09-17T01:35:11.676449+0000","last_became_peered":"2024-09-17T01:35:11.676449+0000","last_unstale":"2024-09-17T01:35:12.665916+0000","last_undegraded":"2024-09-17T01:35:12.665916+0000","last_fullsized":"2024-09-17T01:35:12.665916+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:02.322600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693381+0000","last_change":"2024-09-17T01:35:11.689284+0000","last_active":"2024-09-17T01:35:12.693381+0000","last_peered":"2024-09-17T01:35:12.693381+0000","last_clean":"2024-09-17T01:35:12.693381+0000","last_became_active":"2024-09-17T01:35:11.688877+0000","last_became_peered":"2024-09-17T01:35:11.688877+0000","last_unstale":"2024-09-17T01:35:12.693381+0000","last_undegraded":"2024-09-17T01:35:12.693381+0000","last_fullsized":"2024-09-17T01:35:12.693381+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:50.547621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166637+0000","last_change":"2024-09-17T01:35:11.686633+0000","last_active":"2024-09-17T01:35:13.166637+0000","last_peered":"2024-09-17T01:35:13.166637+0000","last_clean":"2024-09-17T01:35:13.166637+0000","last_became_active":"2024-09-17T01:35:11.684636+0000","last_became_peered":"2024-09-17T01:35:11.684636+0000","last_unstale":"2024-09-17T01:35:13.166637+0000","last_undegraded":"2024-09-17T01:35:13.166637+0000","last_fullsized":"2024-09-17T01:35:13.166637+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:17.721407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668732+0000","last_change":"2024-09-17T01:35:11.681613+0000","last_active":"2024-09-17T01:35:12.668732+0000","last_peered":"2024-09-17T01:35:12.668732+0000","last_clean":"2024-09-17T01:35:12.668732+0000","last_became_active":"2024-09-17T01:35:11.681218+0000","last_became_peered":"2024-09-17T01:35:11.681218+0000","last_unstale":"2024-09-17T01:35:12.668732+0000","last_undegraded":"2024-09-17T01:35:12.668732+0000","last_fullsized":"2024-09-17T01:35:12.668732+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:49.882671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696431+0000","last_change":"2024-09-17T01:35:11.680337+0000","last_active":"2024-09-17T01:35:12.696431+0000","last_peered":"2024-09-17T01:35:12.696431+0000","last_clean":"2024-09-17T01:35:12.696431+0000","last_became_active":"2024-09-17T01:35:11.680026+0000","last_became_peered":"2024-09-17T01:35:11.680026+0000","last_unstale":"2024-09-17T01:35:12.696431+0000","last_undegraded":"2024-09-17T01:35:12.696431+0000","last_fullsized":"2024-09-17T01:35:12.696431+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:05:04.721108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693368+0000","last_change":"2024-09-17T01:35:11.675558+0000","last_active":"2024-09-17T01:35:12.693368+0000","last_peered":"2024-09-17T01:35:12.693368+0000","last_clean":"2024-09-17T01:35:12.693368+0000","last_became_active":"2024-09-17T01:35:11.675027+0000","last_became_peered":"2024-09-17T01:35:11.675027+0000","last_unstale":"2024-09-17T01:35:12.693368+0000","last_undegraded":"2024-09-17T01:35:12.693368+0000","last_fullsized":"2024-09-17T01:35:12.693368+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:41.955029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668628+0000","last_change":"2024-09-17T01:35:11.686595+0000","last_active":"2024-09-17T01:35:12.668628+0000","last_peered":"2024-09-17T01:35:12.668628+0000","last_clean":"2024-09-17T01:35:12.668628+0000","last_became_active":"2024-09-17T01:35:11.686231+0000","last_became_peered":"2024-09-17T01:35:11.686231+0000","last_unstale":"2024-09-17T01:35:12.668628+0000","last_undegraded":"2024-09-17T01:35:12.668628+0000","last_fullsized":"2024-09-17T01:35:12.668628+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:08.753759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668301+0000","last_change":"2024-09-17T01:35:11.667098+0000","last_active":"2024-09-17T01:35:12.668301+0000","last_peered":"2024-09-17T01:35:12.668301+0000","last_clean":"2024-09-17T01:35:12.668301+0000","last_became_active":"2024-09-17T01:35:11.666559+0000","last_became_peered":"2024-09-17T01:35:11.666559+0000","last_unstale":"2024-09-17T01:35:12.668301+0000","last_undegraded":"2024-09-17T01:35:12.668301+0000","last_fullsized":"2024-09-17T01:35:12.668301+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:08.755783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693835+0000","last_change":"2024-09-17T01:35:11.691137+0000","last_active":"2024-09-17T01:35:12.693835+0000","last_peered":"2024-09-17T01:35:12.693835+0000","last_clean":"2024-09-17T01:35:12.693835+0000","last_became_active":"2024-09-17T01:35:11.690602+0000","last_became_peered":"2024-09-17T01:35:11.690602+0000","last_unstale":"2024-09-17T01:35:12.693835+0000","last_undegraded":"2024-09-17T01:35:12.693835+0000","last_fullsized":"2024-09-17T01:35:12.693835+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:38.506225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:35:10.641797+0000","last_change":"2024-09-17T01:35:10.641797+0000","last_active":"2024-09-17T01:35:10.641797+0000","last_peered":"2024-09-17T01:35:10.641797+0000","last_clean":"2024-09-17T01:35:10.641797+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:35:10.641797+0000","last_undegraded":"2024-09-17T01:35:10.641797+0000","last_fullsized":"2024-09-17T01:35:10.641797+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668910+0000","last_change":"2024-09-17T01:35:11.682294+0000","last_active":"2024-09-17T01:35:12.668910+0000","last_peered":"2024-09-17T01:35:12.668910+0000","last_clean":"2024-09-17T01:35:12.668910+0000","last_became_active":"2024-09-17T01:35:11.681948+0000","last_became_peered":"2024-09-17T01:35:11.681948+0000","last_unstale":"2024-09-17T01:35:12.668910+0000","last_undegraded":"2024-09-17T01:35:12.668910+0000","last_fullsized":"2024-09-17T01:35:12.668910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:51.076106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693756+0000","last_change":"2024-09-17T01:35:11.684238+0000","last_active":"2024-09-17T01:35:12.693756+0000","last_peered":"2024-09-17T01:35:12.693756+0000","last_clean":"2024-09-17T01:35:12.693756+0000","last_became_active":"2024-09-17T01:35:11.683881+0000","last_became_peered":"2024-09-17T01:35:11.683881+0000","last_unstale":"2024-09-17T01:35:12.693756+0000","last_undegraded":"2024-09-17T01:35:12.693756+0000","last_fullsized":"2024-09-17T01:35:12.693756+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:08.054097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693215+0000","last_change":"2024-09-17T01:35:11.675869+0000","last_active":"2024-09-17T01:35:12.693215+0000","last_peered":"2024-09-17T01:35:12.693215+0000","last_clean":"2024-09-17T01:35:12.693215+0000","last_became_active":"2024-09-17T01:35:11.675515+0000","last_became_peered":"2024-09-17T01:35:11.675515+0000","last_unstale":"2024-09-17T01:35:12.693215+0000","last_undegraded":"2024-09-17T01:35:12.693215+0000","last_fullsized":"2024-09-17T01:35:12.693215+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:19.830835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166406+0000","last_change":"2024-09-17T01:35:11.682552+0000","last_active":"2024-09-17T01:35:13.166406+0000","last_peered":"2024-09-17T01:35:13.166406+0000","last_clean":"2024-09-17T01:35:13.166406+0000","last_became_active":"2024-09-17T01:35:11.680943+0000","last_became_peered":"2024-09-17T01:35:11.680943+0000","last_unstale":"2024-09-17T01:35:13.166406+0000","last_undegraded":"2024-09-17T01:35:13.166406+0000","last_fullsized":"2024-09-17T01:35:13.166406+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:44:50.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:35:10.641797+0000","last_change":"2024-09-17T01:35:10.641797+0000","last_active":"2024-09-17T01:35:10.641797+0000","last_peered":"2024-09-17T01:35:10.641797+0000","last_clean":"2024-09-17T01:35:10.641797+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:35:10.641797+0000","last_undegraded":"2024-09-17T01:35:10.641797+0000","last_fullsized":"2024-09-17T01:35:10.641797+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666193+0000","last_change":"2024-09-17T01:35:11.685570+0000","last_active":"2024-09-17T01:35:12.666193+0000","last_peered":"2024-09-17T01:35:12.666193+0000","last_clean":"2024-09-17T01:35:12.666193+0000","last_became_active":"2024-09-17T01:35:11.685257+0000","last_became_peered":"2024-09-17T01:35:11.685257+0000","last_unstale":"2024-09-17T01:35:12.666193+0000","last_undegraded":"2024-09-17T01:35:12.666193+0000","last_fullsized":"2024-09-17T01:35:12.666193+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:30.801288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166734+0000","last_change":"2024-09-17T01:35:11.690839+0000","last_active":"2024-09-17T01:35:13.166734+0000","last_peered":"2024-09-17T01:35:13.166734+0000","last_clean":"2024-09-17T01:35:13.166734+0000","last_became_active":"2024-09-17T01:35:11.690498+0000","last_became_peered":"2024-09-17T01:35:11.690498+0000","last_unstale":"2024-09-17T01:35:13.166734+0000","last_undegraded":"2024-09-17T01:35:13.166734+0000","last_fullsized":"2024-09-17T01:35:13.166734+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:11.517652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667435+0000","last_change":"2024-09-17T01:35:11.669110+0000","last_active":"2024-09-17T01:35:12.667435+0000","last_peered":"2024-09-17T01:35:12.667435+0000","last_clean":"2024-09-17T01:35:12.667435+0000","last_became_active":"2024-09-17T01:35:11.668359+0000","last_became_peered":"2024-09-17T01:35:11.668359+0000","last_unstale":"2024-09-17T01:35:12.667435+0000","last_undegraded":"2024-09-17T01:35:12.667435+0000","last_fullsized":"2024-09-17T01:35:12.667435+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:07:06.732155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693613+0000","last_change":"2024-09-17T01:35:11.678510+0000","last_active":"2024-09-17T01:35:12.693613+0000","last_peered":"2024-09-17T01:35:12.693613+0000","last_clean":"2024-09-17T01:35:12.693613+0000","last_became_active":"2024-09-17T01:35:11.678067+0000","last_became_peered":"2024-09-17T01:35:11.678067+0000","last_unstale":"2024-09-17T01:35:12.693613+0000","last_undegraded":"2024-09-17T01:35:12.693613+0000","last_fullsized":"2024-09-17T01:35:12.693613+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:17.926468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166985+0000","last_change":"2024-09-17T01:35:11.675603+0000","last_active":"2024-09-17T01:35:13.166985+0000","last_peered":"2024-09-17T01:35:13.166985+0000","last_clean":"2024-09-17T01:35:13.166985+0000","last_became_active":"2024-09-17T01:35:11.675290+0000","last_became_peered":"2024-09-17T01:35:11.675290+0000","last_unstale":"2024-09-17T01:35:13.166985+0000","last_undegraded":"2024-09-17T01:35:13.166985+0000","last_fullsized":"2024-09-17T01:35:13.166985+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:04.530089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696764+0000","last_change":"2024-09-17T01:35:11.668987+0000","last_active":"2024-09-17T01:35:12.696764+0000","last_peered":"2024-09-17T01:35:12.696764+0000","last_clean":"2024-09-17T01:35:12.696764+0000","last_became_active":"2024-09-17T01:35:11.668644+0000","last_became_peered":"2024-09-17T01:35:11.668644+0000","last_unstale":"2024-09-17T01:35:12.696764+0000","last_undegraded":"2024-09-17T01:35:12.696764+0000","last_fullsized":"2024-09-17T01:35:12.696764+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:28:33.791232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:35:10.641797+0000","last_change":"2024-09-17T01:35:10.641797+0000","last_active":"2024-09-17T01:35:10.641797+0000","last_peered":"2024-09-17T01:35:10.641797+0000","last_clean":"2024-09-17T01:35:10.641797+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:35:10.641797+0000","last_undegraded":"2024-09-17T01:35:10.641797+0000","last_fullsized":"2024-09-17T01:35:10.641797+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166850+0000","last_change":"2024-09-17T01:35:11.678418+0000","last_active":"2024-09-17T01:35:13.166850+0000","last_peered":"2024-09-17T01:35:13.166850+0000","last_clean":"2024-09-17T01:35:13.166850+0000","last_became_active":"2024-09-17T01:35:11.678096+0000","last_became_peered":"2024-09-17T01:35:11.678096+0000","last_unstale":"2024-09-17T01:35:13.166850+0000","last_undegraded":"2024-09-17T01:35:13.166850+0000","last_fullsized":"2024-09-17T01:35:13.166850+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:24.131701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693997+0000","last_change":"2024-09-17T01:35:11.687021+0000","last_active":"2024-09-17T01:35:12.693997+0000","last_peered":"2024-09-17T01:35:12.693997+0000","last_clean":"2024-09-17T01:35:12.693997+0000","last_became_active":"2024-09-17T01:35:11.685533+0000","last_became_peered":"2024-09-17T01:35:11.685533+0000","last_unstale":"2024-09-17T01:35:12.693997+0000","last_undegraded":"2024-09-17T01:35:12.693997+0000","last_fullsized":"2024-09-17T01:35:12.693997+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:20.511127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696562+0000","last_change":"2024-09-17T01:35:11.673221+0000","last_active":"2024-09-17T01:35:12.696562+0000","last_peered":"2024-09-17T01:35:12.696562+0000","last_clean":"2024-09-17T01:35:12.696562+0000","last_became_active":"2024-09-17T01:35:11.670852+0000","last_became_peered":"2024-09-17T01:35:11.670852+0000","last_unstale":"2024-09-17T01:35:12.696562+0000","last_undegraded":"2024-09-17T01:35:12.696562+0000","last_fullsized":"2024-09-17T01:35:12.696562+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:40.426585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696743+0000","last_change":"2024-09-17T01:35:11.671861+0000","last_active":"2024-09-17T01:35:12.696743+0000","last_peered":"2024-09-17T01:35:12.696743+0000","last_clean":"2024-09-17T01:35:12.696743+0000","last_became_active":"2024-09-17T01:35:11.671539+0000","last_became_peered":"2024-09-17T01:35:11.671539+0000","last_unstale":"2024-09-17T01:35:12.696743+0000","last_undegraded":"2024-09-17T01:35:12.696743+0000","last_fullsized":"2024-09-17T01:35:12.696743+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:59.339611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166574+0000","last_change":"2024-09-17T01:35:11.687865+0000","last_active":"2024-09-17T01:35:13.166574+0000","last_peered":"2024-09-17T01:35:13.166574+0000","last_clean":"2024-09-17T01:35:13.166574+0000","last_became_active":"2024-09-17T01:35:11.684764+0000","last_became_peered":"2024-09-17T01:35:11.684764+0000","last_unstale":"2024-09-17T01:35:13.166574+0000","last_undegraded":"2024-09-17T01:35:13.166574+0000","last_fullsized":"2024-09-17T01:35:13.166574+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:35.323990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:35:10.641797+0000","last_change":"2024-09-17T01:35:10.641797+0000","last_active":"2024-09-17T01:35:10.641797+0000","last_peered":"2024-09-17T01:35:10.641797+0000","last_clean":"2024-09-17T01:35:10.641797+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:35:10.641797+0000","last_undegraded":"2024-09-17T01:35:10.641797+0000","last_fullsized":"2024-09-17T01:35:10.641797+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666875+0000","last_change":"2024-09-17T01:35:11.676283+0000","last_active":"2024-09-17T01:35:12.666875+0000","last_peered":"2024-09-17T01:35:12.666875+0000","last_clean":"2024-09-17T01:35:12.666875+0000","last_became_active":"2024-09-17T01:35:11.675947+0000","last_became_peered":"2024-09-17T01:35:11.675947+0000","last_unstale":"2024-09-17T01:35:12.666875+0000","last_undegraded":"2024-09-17T01:35:12.666875+0000","last_fullsized":"2024-09-17T01:35:12.666875+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:39.573816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693187+0000","last_change":"2024-09-17T01:35:11.678889+0000","last_active":"2024-09-17T01:35:12.693187+0000","last_peered":"2024-09-17T01:35:12.693187+0000","last_clean":"2024-09-17T01:35:12.693187+0000","last_became_active":"2024-09-17T01:35:11.678542+0000","last_became_peered":"2024-09-17T01:35:11.678542+0000","last_unstale":"2024-09-17T01:35:12.693187+0000","last_undegraded":"2024-09-17T01:35:12.693187+0000","last_fullsized":"2024-09-17T01:35:12.693187+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:18.255811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.167081+0000","last_change":"2024-09-17T01:35:11.670813+0000","last_active":"2024-09-17T01:35:13.167081+0000","last_peered":"2024-09-17T01:35:13.167081+0000","last_clean":"2024-09-17T01:35:13.167081+0000","last_became_active":"2024-09-17T01:35:11.670399+0000","last_became_peered":"2024-09-17T01:35:11.670399+0000","last_unstale":"2024-09-17T01:35:13.167081+0000","last_undegraded":"2024-09-17T01:35:13.167081+0000","last_fullsized":"2024-09-17T01:35:13.167081+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:51.896304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"48'4","reported_seq":19,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668630+0000","last_change":"2024-09-17T01:35:10.676051+0000","last_active":"2024-09-17T01:35:12.668630+0000","last_peered":"2024-09-17T01:35:12.668630+0000","last_clean":"2024-09-17T01:35:12.668630+0000","last_became_active":"2024-09-17T01:35:10.675678+0000","last_became_peered":"2024-09-17T01:35:10.675678+0000","last_unstale":"2024-09-17T01:35:12.668630+0000","last_undegraded":"2024-09-17T01:35:12.668630+0000","last_fullsized":"2024-09-17T01:35:12.668630+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:29.304564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166984+0000","last_change":"2024-09-17T01:35:11.688201+0000","last_active":"2024-09-17T01:35:13.166984+0000","last_peered":"2024-09-17T01:35:13.166984+0000","last_clean":"2024-09-17T01:35:13.166984+0000","last_became_active":"2024-09-17T01:35:11.684393+0000","last_became_peered":"2024-09-17T01:35:11.684393+0000","last_unstale":"2024-09-17T01:35:13.166984+0000","last_undegraded":"2024-09-17T01:35:13.166984+0000","last_fullsized":"2024-09-17T01:35:13.166984+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:36:30.634041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696918+0000","last_change":"2024-09-17T01:35:10.669339+0000","last_active":"2024-09-17T01:35:12.696918+0000","last_peered":"2024-09-17T01:35:12.696918+0000","last_clean":"2024-09-17T01:35:12.696918+0000","last_became_active":"2024-09-17T01:35:10.666719+0000","last_became_peered":"2024-09-17T01:35:10.666719+0000","last_unstale":"2024-09-17T01:35:12.696918+0000","last_undegraded":"2024-09-17T01:35:12.696918+0000","last_fullsized":"2024-09-17T01:35:12.696918+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:11.436388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:35:10.641797+0000","last_change":"2024-09-17T01:35:10.641797+0000","last_active":"2024-09-17T01:35:10.641797+0000","last_peered":"2024-09-17T01:35:10.641797+0000","last_clean":"2024-09-17T01:35:10.641797+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:35:10.641797+0000","last_undegraded":"2024-09-17T01:35:10.641797+0000","last_fullsized":"2024-09-17T01:35:10.641797+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668026+0000","last_change":"2024-09-17T01:35:10.682029+0000","last_active":"2024-09-17T01:35:12.668026+0000","last_peered":"2024-09-17T01:35:12.668026+0000","last_clean":"2024-09-17T01:35:12.668026+0000","last_became_active":"2024-09-17T01:35:10.681689+0000","last_became_peered":"2024-09-17T01:35:10.681689+0000","last_unstale":"2024-09-17T01:35:12.668026+0000","last_undegraded":"2024-09-17T01:35:12.668026+0000","last_fullsized":"2024-09-17T01:35:12.668026+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:10.562332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693888+0000","last_change":"2024-09-17T01:35:11.690091+0000","last_active":"2024-09-17T01:35:12.693888+0000","last_peered":"2024-09-17T01:35:12.693888+0000","last_clean":"2024-09-17T01:35:12.693888+0000","last_became_active":"2024-09-17T01:35:11.688955+0000","last_became_peered":"2024-09-17T01:35:11.688955+0000","last_unstale":"2024-09-17T01:35:12.693888+0000","last_undegraded":"2024-09-17T01:35:12.693888+0000","last_fullsized":"2024-09-17T01:35:12.693888+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:30.638574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696617+0000","last_change":"2024-09-17T01:35:10.672378+0000","last_active":"2024-09-17T01:35:12.696617+0000","last_peered":"2024-09-17T01:35:12.696617+0000","last_clean":"2024-09-17T01:35:12.696617+0000","last_became_active":"2024-09-17T01:35:10.670878+0000","last_became_peered":"2024-09-17T01:35:10.670878+0000","last_unstale":"2024-09-17T01:35:12.696617+0000","last_undegraded":"2024-09-17T01:35:12.696617+0000","last_fullsized":"2024-09-17T01:35:12.696617+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:44:02.998010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696488+0000","last_change":"2024-09-17T01:35:11.672199+0000","last_active":"2024-09-17T01:35:12.696488+0000","last_peered":"2024-09-17T01:35:12.696488+0000","last_clean":"2024-09-17T01:35:12.696488+0000","last_became_active":"2024-09-17T01:35:11.671902+0000","last_became_peered":"2024-09-17T01:35:11.671902+0000","last_unstale":"2024-09-17T01:35:12.696488+0000","last_undegraded":"2024-09-17T01:35:12.696488+0000","last_fullsized":"2024-09-17T01:35:12.696488+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:40.681886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668842+0000","last_change":"2024-09-17T01:35:10.666527+0000","last_active":"2024-09-17T01:35:12.668842+0000","last_peered":"2024-09-17T01:35:12.668842+0000","last_clean":"2024-09-17T01:35:12.668842+0000","last_became_active":"2024-09-17T01:35:10.666251+0000","last_became_peered":"2024-09-17T01:35:10.666251+0000","last_unstale":"2024-09-17T01:35:12.668842+0000","last_undegraded":"2024-09-17T01:35:12.668842+0000","last_fullsized":"2024-09-17T01:35:12.668842+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:08.974997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667219+0000","last_change":"2024-09-17T01:35:11.679799+0000","last_active":"2024-09-17T01:35:12.667219+0000","last_peered":"2024-09-17T01:35:12.667219+0000","last_clean":"2024-09-17T01:35:12.667219+0000","last_became_active":"2024-09-17T01:35:11.675735+0000","last_became_peered":"2024-09-17T01:35:11.675735+0000","last_unstale":"2024-09-17T01:35:12.667219+0000","last_undegraded":"2024-09-17T01:35:12.667219+0000","last_fullsized":"2024-09-17T01:35:12.667219+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:53.242251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696421+0000","last_change":"2024-09-17T01:35:10.683902+0000","last_active":"2024-09-17T01:35:12.696421+0000","last_peered":"2024-09-17T01:35:12.696421+0000","last_clean":"2024-09-17T01:35:12.696421+0000","last_became_active":"2024-09-17T01:35:10.683540+0000","last_became_peered":"2024-09-17T01:35:10.683540+0000","last_unstale":"2024-09-17T01:35:12.696421+0000","last_undegraded":"2024-09-17T01:35:12.696421+0000","last_fullsized":"2024-09-17T01:35:12.696421+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:14:50.086073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666898+0000","last_change":"2024-09-17T01:35:11.667959+0000","last_active":"2024-09-17T01:35:12.666898+0000","last_peered":"2024-09-17T01:35:12.666898+0000","last_clean":"2024-09-17T01:35:12.666898+0000","last_became_active":"2024-09-17T01:35:11.667618+0000","last_became_peered":"2024-09-17T01:35:11.667618+0000","last_unstale":"2024-09-17T01:35:12.666898+0000","last_undegraded":"2024-09-17T01:35:12.666898+0000","last_fullsized":"2024-09-17T01:35:12.666898+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:06.513791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166436+0000","last_change":"2024-09-17T01:35:10.683282+0000","last_active":"2024-09-17T01:35:13.166436+0000","last_peered":"2024-09-17T01:35:13.166436+0000","last_clean":"2024-09-17T01:35:13.166436+0000","last_became_active":"2024-09-17T01:35:10.682938+0000","last_became_peered":"2024-09-17T01:35:10.682938+0000","last_unstale":"2024-09-17T01:35:13.166436+0000","last_undegraded":"2024-09-17T01:35:13.166436+0000","last_fullsized":"2024-09-17T01:35:13.166436+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:31.273868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696437+0000","last_change":"2024-09-17T01:35:11.682324+0000","last_active":"2024-09-17T01:35:12.696437+0000","last_peered":"2024-09-17T01:35:12.696437+0000","last_clean":"2024-09-17T01:35:12.696437+0000","last_became_active":"2024-09-17T01:35:11.682037+0000","last_became_peered":"2024-09-17T01:35:11.682037+0000","last_unstale":"2024-09-17T01:35:12.696437+0000","last_undegraded":"2024-09-17T01:35:12.696437+0000","last_fullsized":"2024-09-17T01:35:12.696437+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:08.755783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666831+0000","last_change":"2024-09-17T01:35:10.676447+0000","last_active":"2024-09-17T01:35:12.666831+0000","last_peered":"2024-09-17T01:35:12.666831+0000","last_clean":"2024-09-17T01:35:12.666831+0000","last_became_active":"2024-09-17T01:35:10.676026+0000","last_became_peered":"2024-09-17T01:35:10.676026+0000","last_unstale":"2024-09-17T01:35:12.666831+0000","last_undegraded":"2024-09-17T01:35:12.666831+0000","last_fullsized":"2024-09-17T01:35:12.666831+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:36.004994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666229+0000","last_change":"2024-09-17T01:35:11.673386+0000","last_active":"2024-09-17T01:35:12.666229+0000","last_peered":"2024-09-17T01:35:12.666229+0000","last_clean":"2024-09-17T01:35:12.666229+0000","last_became_active":"2024-09-17T01:35:11.673001+0000","last_became_peered":"2024-09-17T01:35:11.673001+0000","last_unstale":"2024-09-17T01:35:12.666229+0000","last_undegraded":"2024-09-17T01:35:12.666229+0000","last_fullsized":"2024-09-17T01:35:12.666229+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:55.318960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665797+0000","last_change":"2024-09-17T01:35:10.669932+0000","last_active":"2024-09-17T01:35:12.665797+0000","last_peered":"2024-09-17T01:35:12.665797+0000","last_clean":"2024-09-17T01:35:12.665797+0000","last_became_active":"2024-09-17T01:35:10.669651+0000","last_became_peered":"2024-09-17T01:35:10.669651+0000","last_unstale":"2024-09-17T01:35:12.665797+0000","last_undegraded":"2024-09-17T01:35:12.665797+0000","last_fullsized":"2024-09-17T01:35:12.665797+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:55.136983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665664+0000","last_change":"2024-09-17T01:35:11.681534+0000","last_active":"2024-09-17T01:35:12.665664+0000","last_peered":"2024-09-17T01:35:12.665664+0000","last_clean":"2024-09-17T01:35:12.665664+0000","last_became_active":"2024-09-17T01:35:11.681247+0000","last_became_peered":"2024-09-17T01:35:11.681247+0000","last_unstale":"2024-09-17T01:35:12.665664+0000","last_undegraded":"2024-09-17T01:35:12.665664+0000","last_fullsized":"2024-09-17T01:35:12.665664+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:40.773263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668340+0000","last_change":"2024-09-17T01:35:10.679164+0000","last_active":"2024-09-17T01:35:12.668340+0000","last_peered":"2024-09-17T01:35:12.668340+0000","last_clean":"2024-09-17T01:35:12.668340+0000","last_became_active":"2024-09-17T01:35:10.677983+0000","last_became_peered":"2024-09-17T01:35:10.677983+0000","last_unstale":"2024-09-17T01:35:12.668340+0000","last_undegraded":"2024-09-17T01:35:12.668340+0000","last_fullsized":"2024-09-17T01:35:12.668340+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:31.801763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693799+0000","last_change":"2024-09-17T01:35:11.683421+0000","last_active":"2024-09-17T01:35:12.693799+0000","last_peered":"2024-09-17T01:35:12.693799+0000","last_clean":"2024-09-17T01:35:12.693799+0000","last_became_active":"2024-09-17T01:35:11.683075+0000","last_became_peered":"2024-09-17T01:35:11.683075+0000","last_unstale":"2024-09-17T01:35:12.693799+0000","last_undegraded":"2024-09-17T01:35:12.693799+0000","last_fullsized":"2024-09-17T01:35:12.693799+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:38.873835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-17T01:35:09.645810+0000","last_change":"2024-09-17T01:35:09.645810+0000","last_active":"2024-09-17T01:35:09.633343+0000","last_peered":"2024-09-17T01:35:09.633343+0000","last_clean":"2024-09-17T01:35:09.633343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:35:09.645810+0000","last_undegraded":"2024-09-17T01:35:09.645810+0000","last_fullsized":"2024-09-17T01:35:09.645810+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696933+0000","last_change":"2024-09-17T01:35:11.678867+0000","last_active":"2024-09-17T01:35:12.696933+0000","last_peered":"2024-09-17T01:35:12.696933+0000","last_clean":"2024-09-17T01:35:12.696933+0000","last_became_active":"2024-09-17T01:35:11.678581+0000","last_became_peered":"2024-09-17T01:35:11.678581+0000","last_unstale":"2024-09-17T01:35:12.696933+0000","last_undegraded":"2024-09-17T01:35:12.696933+0000","last_fullsized":"2024-09-17T01:35:12.696933+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:30.558833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"48'6","reported_seq":21,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667586+0000","last_change":"2024-09-17T01:35:10.672677+0000","last_active":"2024-09-17T01:35:12.667586+0000","last_peered":"2024-09-17T01:35:12.667586+0000","last_clean":"2024-09-17T01:35:12.667586+0000","last_became_active":"2024-09-17T01:35:10.672338+0000","last_became_peered":"2024-09-17T01:35:10.672338+0000","last_unstale":"2024-09-17T01:35:12.667586+0000","last_undegraded":"2024-09-17T01:35:12.667586+0000","last_fullsized":"2024-09-17T01:35:12.667586+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:23.123246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665774+0000","last_change":"2024-09-17T01:35:11.675401+0000","last_active":"2024-09-17T01:35:12.665774+0000","last_peered":"2024-09-17T01:35:12.665774+0000","last_clean":"2024-09-17T01:35:12.665774+0000","last_became_active":"2024-09-17T01:35:11.674946+0000","last_became_peered":"2024-09-17T01:35:11.674946+0000","last_unstale":"2024-09-17T01:35:12.665774+0000","last_undegraded":"2024-09-17T01:35:12.665774+0000","last_fullsized":"2024-09-17T01:35:12.665774+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:16.229827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166584+0000","last_change":"2024-09-17T01:35:10.671105+0000","last_active":"2024-09-17T01:35:13.166584+0000","last_peered":"2024-09-17T01:35:13.166584+0000","last_clean":"2024-09-17T01:35:13.166584+0000","last_became_active":"2024-09-17T01:35:10.670646+0000","last_became_peered":"2024-09-17T01:35:10.670646+0000","last_unstale":"2024-09-17T01:35:13.166584+0000","last_undegraded":"2024-09-17T01:35:13.166584+0000","last_fullsized":"2024-09-17T01:35:13.166584+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:31.761461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166938+0000","last_change":"2024-09-17T01:35:11.671482+0000","last_active":"2024-09-17T01:35:13.166938+0000","last_peered":"2024-09-17T01:35:13.166938+0000","last_clean":"2024-09-17T01:35:13.166938+0000","last_became_active":"2024-09-17T01:35:11.671159+0000","last_became_peered":"2024-09-17T01:35:11.671159+0000","last_unstale":"2024-09-17T01:35:13.166938+0000","last_undegraded":"2024-09-17T01:35:13.166938+0000","last_fullsized":"2024-09-17T01:35:13.166938+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:22.007933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166393+0000","last_change":"2024-09-17T01:35:10.677803+0000","last_active":"2024-09-17T01:35:13.166393+0000","last_peered":"2024-09-17T01:35:13.166393+0000","last_clean":"2024-09-17T01:35:13.166393+0000","last_became_active":"2024-09-17T01:35:10.677510+0000","last_became_peered":"2024-09-17T01:35:10.677510+0000","last_unstale":"2024-09-17T01:35:13.166393+0000","last_undegraded":"2024-09-17T01:35:13.166393+0000","last_fullsized":"2024-09-17T01:35:13.166393+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:05:45.762431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166796+0000","last_change":"2024-09-17T01:35:11.673836+0000","last_active":"2024-09-17T01:35:13.166796+0000","last_peered":"2024-09-17T01:35:13.166796+0000","last_clean":"2024-09-17T01:35:13.166796+0000","last_became_active":"2024-09-17T01:35:11.669992+0000","last_became_peered":"2024-09-17T01:35:11.669992+0000","last_unstale":"2024-09-17T01:35:13.166796+0000","last_undegraded":"2024-09-17T01:35:13.166796+0000","last_fullsized":"2024-09-17T01:35:13.166796+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:40.901698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667026+0000","last_change":"2024-09-17T01:35:10.664520+0000","last_active":"2024-09-17T01:35:12.667026+0000","last_peered":"2024-09-17T01:35:12.667026+0000","last_clean":"2024-09-17T01:35:12.667026+0000","last_became_active":"2024-09-17T01:35:10.663413+0000","last_became_peered":"2024-09-17T01:35:10.663413+0000","last_unstale":"2024-09-17T01:35:12.667026+0000","last_undegraded":"2024-09-17T01:35:12.667026+0000","last_fullsized":"2024-09-17T01:35:12.667026+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:11.217933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:35:10.641797+0000","last_change":"2024-09-17T01:35:10.641797+0000","last_active":"2024-09-17T01:35:10.641797+0000","last_peered":"2024-09-17T01:35:10.641797+0000","last_clean":"2024-09-17T01:35:10.641797+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:35:10.641797+0000","last_undegraded":"2024-09-17T01:35:10.641797+0000","last_fullsized":"2024-09-17T01:35:10.641797+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"48'8","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668429+0000","last_change":"2024-09-17T01:35:10.668450+0000","last_active":"2024-09-17T01:35:12.668429+0000","last_peered":"2024-09-17T01:35:12.668429+0000","last_clean":"2024-09-17T01:35:12.668429+0000","last_became_active":"2024-09-17T01:35:10.668097+0000","last_became_peered":"2024-09-17T01:35:10.668097+0000","last_unstale":"2024-09-17T01:35:12.668429+0000","last_undegraded":"2024-09-17T01:35:12.668429+0000","last_fullsized":"2024-09-17T01:35:12.668429+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:52.159951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.167034+0000","last_change":"2024-09-17T01:35:11.677620+0000","last_active":"2024-09-17T01:35:13.167034+0000","last_peered":"2024-09-17T01:35:13.167034+0000","last_clean":"2024-09-17T01:35:13.167034+0000","last_became_active":"2024-09-17T01:35:11.677084+0000","last_became_peered":"2024-09-17T01:35:11.677084+0000","last_unstale":"2024-09-17T01:35:13.167034+0000","last_undegraded":"2024-09-17T01:35:13.167034+0000","last_fullsized":"2024-09-17T01:35:13.167034+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:12:39.675385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693994+0000","last_change":"2024-09-17T01:35:10.672120+0000","last_active":"2024-09-17T01:35:12.693994+0000","last_peered":"2024-09-17T01:35:12.693994+0000","last_clean":"2024-09-17T01:35:12.693994+0000","last_became_active":"2024-09-17T01:35:10.671797+0000","last_became_peered":"2024-09-17T01:35:10.671797+0000","last_unstale":"2024-09-17T01:35:12.693994+0000","last_undegraded":"2024-09-17T01:35:12.693994+0000","last_fullsized":"2024-09-17T01:35:12.693994+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:47:27.327278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.167111+0000","last_change":"2024-09-17T01:35:11.678099+0000","last_active":"2024-09-17T01:35:13.167111+0000","last_peered":"2024-09-17T01:35:13.167111+0000","last_clean":"2024-09-17T01:35:13.167111+0000","last_became_active":"2024-09-17T01:35:11.677064+0000","last_became_peered":"2024-09-17T01:35:11.677064+0000","last_unstale":"2024-09-17T01:35:13.167111+0000","last_undegraded":"2024-09-17T01:35:13.167111+0000","last_fullsized":"2024-09-17T01:35:13.167111+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:59.219211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666337+0000","last_change":"2024-09-17T01:35:10.663348+0000","last_active":"2024-09-17T01:35:12.666337+0000","last_peered":"2024-09-17T01:35:12.666337+0000","last_clean":"2024-09-17T01:35:12.666337+0000","last_became_active":"2024-09-17T01:35:10.662887+0000","last_became_peered":"2024-09-17T01:35:10.662887+0000","last_unstale":"2024-09-17T01:35:12.666337+0000","last_undegraded":"2024-09-17T01:35:12.666337+0000","last_fullsized":"2024-09-17T01:35:12.666337+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:24.816236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:35:10.641797+0000","last_change":"2024-09-17T01:35:10.641797+0000","last_active":"2024-09-17T01:35:10.641797+0000","last_peered":"2024-09-17T01:35:10.641797+0000","last_clean":"2024-09-17T01:35:10.641797+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:35:10.641797+0000","last_undegraded":"2024-09-17T01:35:10.641797+0000","last_fullsized":"2024-09-17T01:35:10.641797+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666047+0000","last_change":"2024-09-17T01:35:10.676459+0000","last_active":"2024-09-17T01:35:12.666047+0000","last_peered":"2024-09-17T01:35:12.666047+0000","last_clean":"2024-09-17T01:35:12.666047+0000","last_became_active":"2024-09-17T01:35:10.676141+0000","last_became_peered":"2024-09-17T01:35:10.676141+0000","last_unstale":"2024-09-17T01:35:12.666047+0000","last_undegraded":"2024-09-17T01:35:12.666047+0000","last_fullsized":"2024-09-17T01:35:12.666047+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:40.090233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665974+0000","last_change":"2024-09-17T01:35:11.676736+0000","last_active":"2024-09-17T01:35:12.665974+0000","last_peered":"2024-09-17T01:35:12.665974+0000","last_clean":"2024-09-17T01:35:12.665974+0000","last_became_active":"2024-09-17T01:35:11.676057+0000","last_became_peered":"2024-09-17T01:35:11.676057+0000","last_unstale":"2024-09-17T01:35:12.665974+0000","last_undegraded":"2024-09-17T01:35:12.665974+0000","last_fullsized":"2024-09-17T01:35:12.665974+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:09.879854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667410+0000","last_change":"2024-09-17T01:35:10.662974+0000","last_active":"2024-09-17T01:35:12.667410+0000","last_peered":"2024-09-17T01:35:12.667410+0000","last_clean":"2024-09-17T01:35:12.667410+0000","last_became_active":"2024-09-17T01:35:10.662581+0000","last_became_peered":"2024-09-17T01:35:10.662581+0000","last_unstale":"2024-09-17T01:35:12.667410+0000","last_undegraded":"2024-09-17T01:35:12.667410+0000","last_fullsized":"2024-09-17T01:35:12.667410+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:36.554201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667139+0000","last_change":"2024-09-17T01:35:11.681718+0000","last_active":"2024-09-17T01:35:12.667139+0000","last_peered":"2024-09-17T01:35:12.667139+0000","last_clean":"2024-09-17T01:35:12.667139+0000","last_became_active":"2024-09-17T01:35:11.681374+0000","last_became_peered":"2024-09-17T01:35:11.681374+0000","last_unstale":"2024-09-17T01:35:12.667139+0000","last_undegraded":"2024-09-17T01:35:12.667139+0000","last_fullsized":"2024-09-17T01:35:12.667139+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:45.555304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667551+0000","last_change":"2024-09-17T01:35:10.678608+0000","last_active":"2024-09-17T01:35:12.667551+0000","last_peered":"2024-09-17T01:35:12.667551+0000","last_clean":"2024-09-17T01:35:12.667551+0000","last_became_active":"2024-09-17T01:35:10.678289+0000","last_became_peered":"2024-09-17T01:35:10.678289+0000","last_unstale":"2024-09-17T01:35:12.667551+0000","last_undegraded":"2024-09-17T01:35:12.667551+0000","last_fullsized":"2024-09-17T01:35:12.667551+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:41.559466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668635+0000","last_change":"2024-09-17T01:35:11.681503+0000","last_active":"2024-09-17T01:35:12.668635+0000","last_peered":"2024-09-17T01:35:12.668635+0000","last_clean":"2024-09-17T01:35:12.668635+0000","last_became_active":"2024-09-17T01:35:11.681145+0000","last_became_peered":"2024-09-17T01:35:11.681145+0000","last_unstale":"2024-09-17T01:35:12.668635+0000","last_undegraded":"2024-09-17T01:35:12.668635+0000","last_fullsized":"2024-09-17T01:35:12.668635+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:46.719967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166440+0000","last_change":"2024-09-17T01:35:10.679163+0000","last_active":"2024-09-17T01:35:13.166440+0000","last_peered":"2024-09-17T01:35:13.166440+0000","last_clean":"2024-09-17T01:35:13.166440+0000","last_became_active":"2024-09-17T01:35:10.678887+0000","last_became_peered":"2024-09-17T01:35:10.678887+0000","last_unstale":"2024-09-17T01:35:13.166440+0000","last_undegraded":"2024-09-17T01:35:13.166440+0000","last_fullsized":"2024-09-17T01:35:13.166440+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:34:24.704092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693539+0000","last_change":"2024-09-17T01:35:11.674494+0000","last_active":"2024-09-17T01:35:12.693539+0000","last_peered":"2024-09-17T01:35:12.693539+0000","last_clean":"2024-09-17T01:35:12.693539+0000","last_became_active":"2024-09-17T01:35:11.674130+0000","last_became_peered":"2024-09-17T01:35:11.674130+0000","last_unstale":"2024-09-17T01:35:12.693539+0000","last_undegraded":"2024-09-17T01:35:12.693539+0000","last_fullsized":"2024-09-17T01:35:12.693539+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:16.826974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666489+0000","last_change":"2024-09-17T01:35:10.678454+0000","last_active":"2024-09-17T01:35:12.666489+0000","last_peered":"2024-09-17T01:35:12.666489+0000","last_clean":"2024-09-17T01:35:12.666489+0000","last_became_active":"2024-09-17T01:35:10.678074+0000","last_became_peered":"2024-09-17T01:35:10.678074+0000","last_unstale":"2024-09-17T01:35:12.666489+0000","last_undegraded":"2024-09-17T01:35:12.666489+0000","last_fullsized":"2024-09-17T01:35:12.666489+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:36:20.417566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693618+0000","last_change":"2024-09-17T01:35:11.685970+0000","last_active":"2024-09-17T01:35:12.693618+0000","last_peered":"2024-09-17T01:35:12.693618+0000","last_clean":"2024-09-17T01:35:12.693618+0000","last_became_active":"2024-09-17T01:35:11.685585+0000","last_became_peered":"2024-09-17T01:35:11.685585+0000","last_unstale":"2024-09-17T01:35:12.693618+0000","last_undegraded":"2024-09-17T01:35:12.693618+0000","last_fullsized":"2024-09-17T01:35:12.693618+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:01.388599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696251+0000","last_change":"2024-09-17T01:35:10.665577+0000","last_active":"2024-09-17T01:35:12.696251+0000","last_peered":"2024-09-17T01:35:12.696251+0000","last_clean":"2024-09-17T01:35:12.696251+0000","last_became_active":"2024-09-17T01:35:10.665243+0000","last_became_peered":"2024-09-17T01:35:10.665243+0000","last_unstale":"2024-09-17T01:35:12.696251+0000","last_undegraded":"2024-09-17T01:35:12.696251+0000","last_fullsized":"2024-09-17T01:35:12.696251+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:57.645499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696995+0000","last_change":"2024-09-17T01:35:11.684591+0000","last_active":"2024-09-17T01:35:12.696995+0000","last_peered":"2024-09-17T01:35:12.696995+0000","last_clean":"2024-09-17T01:35:12.696995+0000","last_became_active":"2024-09-17T01:35:11.681538+0000","last_became_peered":"2024-09-17T01:35:11.681538+0000","last_unstale":"2024-09-17T01:35:12.696995+0000","last_undegraded":"2024-09-17T01:35:12.696995+0000","last_fullsized":"2024-09-17T01:35:12.696995+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:56.992382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"49'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.695895+0000","last_change":"2024-09-17T01:35:10.679073+0000","last_active":"2024-09-17T01:35:12.695895+0000","last_peered":"2024-09-17T01:35:12.695895+0000","last_clean":"2024-09-17T01:35:12.695895+0000","last_became_active":"2024-09-17T01:35:10.678723+0000","last_became_peered":"2024-09-17T01:35:10.678723+0000","last_unstale":"2024-09-17T01:35:12.695895+0000","last_undegraded":"2024-09-17T01:35:12.695895+0000","last_fullsized":"2024-09-17T01:35:12.695895+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:38.851484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667634+0000","last_change":"2024-09-17T01:35:11.667624+0000","last_active":"2024-09-17T01:35:12.667634+0000","last_peered":"2024-09-17T01:35:12.667634+0000","last_clean":"2024-09-17T01:35:12.667634+0000","last_became_active":"2024-09-17T01:35:11.667288+0000","last_became_peered":"2024-09-17T01:35:11.667288+0000","last_unstale":"2024-09-17T01:35:12.667634+0000","last_undegraded":"2024-09-17T01:35:12.667634+0000","last_fullsized":"2024-09-17T01:35:12.667634+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:26.724398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166719+0000","last_change":"2024-09-17T01:35:10.681971+0000","last_active":"2024-09-17T01:35:13.166719+0000","last_peered":"2024-09-17T01:35:13.166719+0000","last_clean":"2024-09-17T01:35:13.166719+0000","last_became_active":"2024-09-17T01:35:10.681433+0000","last_became_peered":"2024-09-17T01:35:10.681433+0000","last_unstale":"2024-09-17T01:35:13.166719+0000","last_undegraded":"2024-09-17T01:35:13.166719+0000","last_fullsized":"2024-09-17T01:35:13.166719+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:16.135683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696950+0000","last_change":"2024-09-17T01:35:11.678557+0000","last_active":"2024-09-17T01:35:12.696950+0000","last_peered":"2024-09-17T01:35:12.696950+0000","last_clean":"2024-09-17T01:35:12.696950+0000","last_became_active":"2024-09-17T01:35:11.678094+0000","last_became_peered":"2024-09-17T01:35:11.678094+0000","last_unstale":"2024-09-17T01:35:12.696950+0000","last_undegraded":"2024-09-17T01:35:12.696950+0000","last_fullsized":"2024-09-17T01:35:12.696950+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:08.579234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.167004+0000","last_change":"2024-09-17T01:35:10.678632+0000","last_active":"2024-09-17T01:35:13.167004+0000","last_peered":"2024-09-17T01:35:13.167004+0000","last_clean":"2024-09-17T01:35:13.167004+0000","last_became_active":"2024-09-17T01:35:10.678323+0000","last_became_peered":"2024-09-17T01:35:10.678323+0000","last_unstale":"2024-09-17T01:35:13.167004+0000","last_undegraded":"2024-09-17T01:35:13.167004+0000","last_fullsized":"2024-09-17T01:35:13.167004+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:14.905269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667429+0000","last_change":"2024-09-17T01:35:11.678900+0000","last_active":"2024-09-17T01:35:12.667429+0000","last_peered":"2024-09-17T01:35:12.667429+0000","last_clean":"2024-09-17T01:35:12.667429+0000","last_became_active":"2024-09-17T01:35:11.676137+0000","last_became_peered":"2024-09-17T01:35:11.676137+0000","last_unstale":"2024-09-17T01:35:12.667429+0000","last_undegraded":"2024-09-17T01:35:12.667429+0000","last_fullsized":"2024-09-17T01:35:12.667429+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:54.371997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166734+0000","last_change":"2024-09-17T01:35:10.680728+0000","last_active":"2024-09-17T01:35:13.166734+0000","last_peered":"2024-09-17T01:35:13.166734+0000","last_clean":"2024-09-17T01:35:13.166734+0000","last_became_active":"2024-09-17T01:35:10.680427+0000","last_became_peered":"2024-09-17T01:35:10.680427+0000","last_unstale":"2024-09-17T01:35:13.166734+0000","last_undegraded":"2024-09-17T01:35:13.166734+0000","last_fullsized":"2024-09-17T01:35:13.166734+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:29.304564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693363+0000","last_change":"2024-09-17T01:35:11.683785+0000","last_active":"2024-09-17T01:35:12.693363+0000","last_peered":"2024-09-17T01:35:12.693363+0000","last_clean":"2024-09-17T01:35:12.693363+0000","last_became_active":"2024-09-17T01:35:11.683033+0000","last_became_peered":"2024-09-17T01:35:11.683033+0000","last_unstale":"2024-09-17T01:35:12.693363+0000","last_undegraded":"2024-09-17T01:35:12.693363+0000","last_fullsized":"2024-09-17T01:35:12.693363+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:49.124332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696736+0000","last_change":"2024-09-17T01:35:10.673488+0000","last_active":"2024-09-17T01:35:12.696736+0000","last_peered":"2024-09-17T01:35:12.696736+0000","last_clean":"2024-09-17T01:35:12.696736+0000","last_became_active":"2024-09-17T01:35:10.672037+0000","last_became_peered":"2024-09-17T01:35:10.672037+0000","last_unstale":"2024-09-17T01:35:12.696736+0000","last_undegraded":"2024-09-17T01:35:12.696736+0000","last_fullsized":"2024-09-17T01:35:12.696736+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:22.555314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665401+0000","last_change":"2024-09-17T01:35:11.680098+0000","last_active":"2024-09-17T01:35:12.665401+0000","last_peered":"2024-09-17T01:35:12.665401+0000","last_clean":"2024-09-17T01:35:12.665401+0000","last_became_active":"2024-09-17T01:35:11.679805+0000","last_became_peered":"2024-09-17T01:35:11.679805+0000","last_unstale":"2024-09-17T01:35:12.665401+0000","last_undegraded":"2024-09-17T01:35:12.665401+0000","last_fullsized":"2024-09-17T01:35:12.665401+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:05.444230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667129+0000","last_change":"2024-09-17T01:35:10.668738+0000","last_active":"2024-09-17T01:35:12.667129+0000","last_peered":"2024-09-17T01:35:12.667129+0000","last_clean":"2024-09-17T01:35:12.667129+0000","last_became_active":"2024-09-17T01:35:10.668414+0000","last_became_peered":"2024-09-17T01:35:10.668414+0000","last_unstale":"2024-09-17T01:35:12.667129+0000","last_undegraded":"2024-09-17T01:35:12.667129+0000","last_fullsized":"2024-09-17T01:35:12.667129+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:05:45.762431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:35:10.641797+0000","last_change":"2024-09-17T01:35:10.641797+0000","last_active":"2024-09-17T01:35:10.641797+0000","last_peered":"2024-09-17T01:35:10.641797+0000","last_clean":"2024-09-17T01:35:10.641797+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:35:10.641797+0000","last_undegraded":"2024-09-17T01:35:10.641797+0000","last_fullsized":"2024-09-17T01:35:10.641797+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166762+0000","last_change":"2024-09-17T01:35:10.676420+0000","last_active":"2024-09-17T01:35:13.166762+0000","last_peered":"2024-09-17T01:35:13.166762+0000","last_clean":"2024-09-17T01:35:13.166762+0000","last_became_active":"2024-09-17T01:35:10.676110+0000","last_became_peered":"2024-09-17T01:35:10.676110+0000","last_unstale":"2024-09-17T01:35:13.166762+0000","last_undegraded":"2024-09-17T01:35:13.166762+0000","last_fullsized":"2024-09-17T01:35:13.166762+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:31.612370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693943+0000","last_change":"2024-09-17T01:35:11.680053+0000","last_active":"2024-09-17T01:35:12.693943+0000","last_peered":"2024-09-17T01:35:12.693943+0000","last_clean":"2024-09-17T01:35:12.693943+0000","last_became_active":"2024-09-17T01:35:11.679222+0000","last_became_peered":"2024-09-17T01:35:11.679222+0000","last_unstale":"2024-09-17T01:35:12.693943+0000","last_undegraded":"2024-09-17T01:35:12.693943+0000","last_fullsized":"2024-09-17T01:35:12.693943+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:24.543661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696895+0000","last_change":"2024-09-17T01:35:10.676225+0000","last_active":"2024-09-17T01:35:12.696895+0000","last_peered":"2024-09-17T01:35:12.696895+0000","last_clean":"2024-09-17T01:35:12.696895+0000","last_became_active":"2024-09-17T01:35:10.675871+0000","last_became_peered":"2024-09-17T01:35:10.675871+0000","last_unstale":"2024-09-17T01:35:12.696895+0000","last_undegraded":"2024-09-17T01:35:12.696895+0000","last_fullsized":"2024-09-17T01:35:12.696895+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:10.491485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":161,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665290+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:35:12.665290+0000","last_peered":"2024-09-17T01:35:12.665290+0000","last_clean":"2024-09-17T01:35:12.665290+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:35:12.665290+0000","last_undegraded":"2024-09-17T01:35:12.665290+0000","last_fullsized":"2024-09-17T01:35:12.665290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":110,"acting":110,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2320,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476779,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40028,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331812,"statfs":{"total":96636764160,"available":96595775488,"internally_reserved":0,"allocated":532480,"data_stored":214329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35908,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335932,"statfs":{"total":96636764160,"available":96599994368,"internally_reserved":0,"allocated":573440,"data_stored":233713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509482,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40072,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331768,"statfs":{"total":96636764160,"available":96595730432,"internally_reserved":0,"allocated":577536,"data_stored":234295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509483,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40084,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331756,"statfs":{"total":96636764160,"available":96595718144,"internally_reserved":0,"allocated":589824,"data_stored":235383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509483,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44244,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327596,"statfs":{"total":96636764160,"available":96591458304,"internally_reserved":0,"allocated":581632,"data_stored":235291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509482,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40648,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331192,"statfs":{"total":96636764160,"available":96595140608,"internally_reserved":0,"allocated":1167360,"data_stored":824117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509484,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35916,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335924,"statfs":{"total":96636764160,"available":96599986176,"internally_reserved":0,"allocated":577536,"data_stored":234351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542188,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40652,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331188,"statfs":{"total":96636764160,"available":96595136512,"internally_reserved":0,"allocated":1167360,"data_stored":824069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:35:16.162 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:35:16.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.426+0000 7fe84c000640 1 -- 172.21.15.42:0/118799256 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe84415f480 msgr2=0x7fe84415f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:16.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.426+0000 7fe84c000640 1 --2- 172.21.15.42:0/118799256 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe84415f480 0x7fe84415f890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe83c005fd0 tx=0x7fe83c02aa90 comp rx=0 tx=0).stop 2024-09-17T01:35:16.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.426+0000 7fe84c000640 1 -- 172.21.15.42:0/118799256 shutdown_connections 2024-09-17T01:35:16.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.426+0000 7fe84c000640 1 --2- 172.21.15.42:0/118799256 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe84415f480 0x7fe84415f890 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:16.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.426+0000 7fe84c000640 1 --2- 172.21.15.42:0/118799256 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe84406d430 0x7fe84406d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:16.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.426+0000 7fe84c000640 1 -- 172.21.15.42:0/118799256 >> 172.21.15.42:0/118799256 conn(0x7fe8440b2930 msgr2=0x7fe84406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:16.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.426+0000 7fe84c000640 1 -- 172.21.15.42:0/118799256 shutdown_connections 2024-09-17T01:35:16.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.427+0000 7fe84c000640 1 -- 172.21.15.42:0/118799256 wait complete. 2024-09-17T01:35:16.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.429+0000 7fe84c000640 1 Processor -- start 2024-09-17T01:35:16.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.429+0000 7fe84c000640 1 -- start start 2024-09-17T01:35:16.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.430+0000 7fe84c000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe84406d430 0x7fe8440ab010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:16.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.430+0000 7fe84c000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe84415cb80 0x7fe8441f7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:16.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.430+0000 7fe84c000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe84415f480 0x7fe8440ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:16.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.430+0000 7fe84c000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe8440737e0 con 0x7fe84415f480 2024-09-17T01:35:16.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.430+0000 7fe84c000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe844073660 con 0x7fe84415cb80 2024-09-17T01:35:16.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.430+0000 7fe84c000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe844073960 con 0x7fe84406d430 2024-09-17T01:35:16.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.431+0000 7fe84a000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe84415f480 0x7fe8440ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:16.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.431+0000 7fe84a000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe84415f480 0x7fe8440ae340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52758/0 (socket says 172.21.15.42:52758) 2024-09-17T01:35:16.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.431+0000 7fe84a000640 1 -- 172.21.15.42:0/3425665036 learned_addr learned my addr 172.21.15.42:0/3425665036 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:16.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.431+0000 7fe848c00640 1 --2- 172.21.15.42:0/3425665036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe84415cb80 0x7fe8441f7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:16.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.431+0000 7fe849600640 1 --2- 172.21.15.42:0/3425665036 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe84406d430 0x7fe8440ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:16.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.431+0000 7fe84a000640 1 -- 172.21.15.42:0/3425665036 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe84406d430 msgr2=0x7fe8440ab010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:16.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.431+0000 7fe84a000640 1 --2- 172.21.15.42:0/3425665036 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe84406d430 0x7fe8440ab010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:16.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.431+0000 7fe84a000640 1 -- 172.21.15.42:0/3425665036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe84415cb80 msgr2=0x7fe8441f7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:16.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.431+0000 7fe84a000640 1 --2- 172.21.15.42:0/3425665036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe84415cb80 0x7fe8441f7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:16.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.431+0000 7fe84a000640 1 -- 172.21.15.42:0/3425665036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe844150120 con 0x7fe84415f480 2024-09-17T01:35:16.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.432+0000 7fe84a000640 1 --2- 172.21.15.42:0/3425665036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe84415f480 0x7fe8440ae340 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009d90 tx=0x7fe83c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:16.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.432+0000 7fe841600640 1 -- 172.21.15.42:0/3425665036 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83c044070 con 0x7fe84415f480 2024-09-17T01:35:16.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.432+0000 7fe841600640 1 -- 172.21.15.42:0/3425665036 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe83c004040 con 0x7fe84415f480 2024-09-17T01:35:16.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.432+0000 7fe841600640 1 -- 172.21.15.42:0/3425665036 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83c004430 con 0x7fe84415f480 2024-09-17T01:35:16.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.432+0000 7fe84c000640 1 -- 172.21.15.42:0/3425665036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8441f7de0 con 0x7fe84415f480 2024-09-17T01:35:16.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.432+0000 7fe84c000640 1 -- 172.21.15.42:0/3425665036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8440aa530 con 0x7fe84415f480 2024-09-17T01:35:16.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.433+0000 7fe84c000640 1 -- 172.21.15.42:0/3425665036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe844073e80 con 0x7fe84415f480 2024-09-17T01:35:16.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.434+0000 7fe841600640 1 -- 172.21.15.42:0/3425665036 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe83c047070 con 0x7fe84415f480 2024-09-17T01:35:16.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.435+0000 7fe841600640 1 --2- 172.21.15.42:0/3425665036 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe824078b90 0x7fe82407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:16.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.435+0000 7fe841600640 1 -- 172.21.15.42:0/3425665036 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fe83c0bbc80 con 0x7fe84415f480 2024-09-17T01:35:16.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.436+0000 7fe849600640 1 --2- 172.21.15.42:0/3425665036 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe824078b90 0x7fe82407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:16.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.437+0000 7fe849600640 1 --2- 172.21.15.42:0/3425665036 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe824078b90 0x7fe82407b0a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe838001720 tx=0x7fe838009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:16.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.439+0000 7fe841600640 1 -- 172.21.15.42:0/3425665036 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe83c032030 con 0x7fe84415f480 2024-09-17T01:35:16.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.636+0000 7fe84c000640 1 -- 172.21.15.42:0/3425665036 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe84406a170 con 0x7fe824078b90 2024-09-17T01:35:16.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.641+0000 7fe841600640 1 -- 172.21.15.42:0/3425665036 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250596 (secure 0 0 0) 0x7fe84406a170 con 0x7fe824078b90 2024-09-17T01:35:16.642 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:35:16.643 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:35:16.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.645+0000 7fe84c000640 1 -- 172.21.15.42:0/3425665036 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe824078b90 msgr2=0x7fe82407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:16.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.645+0000 7fe84c000640 1 --2- 172.21.15.42:0/3425665036 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe824078b90 0x7fe82407b0a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe838001720 tx=0x7fe838009040 comp rx=0 tx=0).stop 2024-09-17T01:35:16.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.645+0000 7fe84c000640 1 -- 172.21.15.42:0/3425665036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe84415f480 msgr2=0x7fe8440ae340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:16.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.645+0000 7fe84c000640 1 --2- 172.21.15.42:0/3425665036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe84415f480 0x7fe8440ae340 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009d90 tx=0x7fe83c003ce0 comp rx=0 tx=0).stop 2024-09-17T01:35:16.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.645+0000 7fe84c000640 1 -- 172.21.15.42:0/3425665036 shutdown_connections 2024-09-17T01:35:16.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.645+0000 7fe84c000640 1 --2- 172.21.15.42:0/3425665036 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe824078b90 0x7fe82407b0a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:16.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.645+0000 7fe84c000640 1 --2- 172.21.15.42:0/3425665036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe84415cb80 0x7fe8441f7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:16.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.645+0000 7fe84c000640 1 --2- 172.21.15.42:0/3425665036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe84415f480 0x7fe8440ae340 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:16.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.645+0000 7fe84c000640 1 --2- 172.21.15.42:0/3425665036 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe84406d430 0x7fe8440ab010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:16.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.645+0000 7fe84c000640 1 -- 172.21.15.42:0/3425665036 >> 172.21.15.42:0/3425665036 conn(0x7fe8440b2930 msgr2=0x7fe844072900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:16.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.645+0000 7fe84c000640 1 -- 172.21.15.42:0/3425665036 shutdown_connections 2024-09-17T01:35:16.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.645+0000 7fe84c000640 1 -- 172.21.15.42:0/3425665036 wait complete. 2024-09-17T01:35:16.668 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-09-17T01:35:15.028524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":142,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":176,"acting":176,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":152,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":317552,"kb_used_data":5632,"kb_used_omap":12,"kb_used_meta":311731,"kb_avail":754657168,"statfs":{"total":773094113280,"available":772768940032,"internally_reserved":0,"allocated":5767168,"data_stored":3035548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":319213108},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2320,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.385419"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166861+0000","last_change":"2024-09-17T01:35:11.679886+0000","last_active":"2024-09-17T01:35:13.166861+0000","last_peered":"2024-09-17T01:35:13.166861+0000","last_clean":"2024-09-17T01:35:13.166861+0000","last_became_active":"2024-09-17T01:35:11.679571+0000","last_became_peered":"2024-09-17T01:35:11.679571+0000","last_unstale":"2024-09-17T01:35:13.166861+0000","last_undegraded":"2024-09-17T01:35:13.166861+0000","last_fullsized":"2024-09-17T01:35:13.166861+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:35:44.406490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:35:10.641797+0000","last_change":"2024-09-17T01:35:10.641797+0000","last_active":"2024-09-17T01:35:10.641797+0000","last_peered":"2024-09-17T01:35:10.641797+0000","last_clean":"2024-09-17T01:35:10.641797+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:35:10.641797+0000","last_undegraded":"2024-09-17T01:35:10.641797+0000","last_fullsized":"2024-09-17T01:35:10.641797+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665916+0000","last_change":"2024-09-17T01:35:11.677052+0000","last_active":"2024-09-17T01:35:12.665916+0000","last_peered":"2024-09-17T01:35:12.665916+0000","last_clean":"2024-09-17T01:35:12.665916+0000","last_became_active":"2024-09-17T01:35:11.676449+0000","last_became_peered":"2024-09-17T01:35:11.676449+0000","last_unstale":"2024-09-17T01:35:12.665916+0000","last_undegraded":"2024-09-17T01:35:12.665916+0000","last_fullsized":"2024-09-17T01:35:12.665916+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:02.322600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693381+0000","last_change":"2024-09-17T01:35:11.689284+0000","last_active":"2024-09-17T01:35:12.693381+0000","last_peered":"2024-09-17T01:35:12.693381+0000","last_clean":"2024-09-17T01:35:12.693381+0000","last_became_active":"2024-09-17T01:35:11.688877+0000","last_became_peered":"2024-09-17T01:35:11.688877+0000","last_unstale":"2024-09-17T01:35:12.693381+0000","last_undegraded":"2024-09-17T01:35:12.693381+0000","last_fullsized":"2024-09-17T01:35:12.693381+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:50.547621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166637+0000","last_change":"2024-09-17T01:35:11.686633+0000","last_active":"2024-09-17T01:35:13.166637+0000","last_peered":"2024-09-17T01:35:13.166637+0000","last_clean":"2024-09-17T01:35:13.166637+0000","last_became_active":"2024-09-17T01:35:11.684636+0000","last_became_peered":"2024-09-17T01:35:11.684636+0000","last_unstale":"2024-09-17T01:35:13.166637+0000","last_undegraded":"2024-09-17T01:35:13.166637+0000","last_fullsized":"2024-09-17T01:35:13.166637+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:17.721407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668732+0000","last_change":"2024-09-17T01:35:11.681613+0000","last_active":"2024-09-17T01:35:12.668732+0000","last_peered":"2024-09-17T01:35:12.668732+0000","last_clean":"2024-09-17T01:35:12.668732+0000","last_became_active":"2024-09-17T01:35:11.681218+0000","last_became_peered":"2024-09-17T01:35:11.681218+0000","last_unstale":"2024-09-17T01:35:12.668732+0000","last_undegraded":"2024-09-17T01:35:12.668732+0000","last_fullsized":"2024-09-17T01:35:12.668732+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:49.882671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696431+0000","last_change":"2024-09-17T01:35:11.680337+0000","last_active":"2024-09-17T01:35:12.696431+0000","last_peered":"2024-09-17T01:35:12.696431+0000","last_clean":"2024-09-17T01:35:12.696431+0000","last_became_active":"2024-09-17T01:35:11.680026+0000","last_became_peered":"2024-09-17T01:35:11.680026+0000","last_unstale":"2024-09-17T01:35:12.696431+0000","last_undegraded":"2024-09-17T01:35:12.696431+0000","last_fullsized":"2024-09-17T01:35:12.696431+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:05:04.721108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693368+0000","last_change":"2024-09-17T01:35:11.675558+0000","last_active":"2024-09-17T01:35:12.693368+0000","last_peered":"2024-09-17T01:35:12.693368+0000","last_clean":"2024-09-17T01:35:12.693368+0000","last_became_active":"2024-09-17T01:35:11.675027+0000","last_became_peered":"2024-09-17T01:35:11.675027+0000","last_unstale":"2024-09-17T01:35:12.693368+0000","last_undegraded":"2024-09-17T01:35:12.693368+0000","last_fullsized":"2024-09-17T01:35:12.693368+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:41.955029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668628+0000","last_change":"2024-09-17T01:35:11.686595+0000","last_active":"2024-09-17T01:35:12.668628+0000","last_peered":"2024-09-17T01:35:12.668628+0000","last_clean":"2024-09-17T01:35:12.668628+0000","last_became_active":"2024-09-17T01:35:11.686231+0000","last_became_peered":"2024-09-17T01:35:11.686231+0000","last_unstale":"2024-09-17T01:35:12.668628+0000","last_undegraded":"2024-09-17T01:35:12.668628+0000","last_fullsized":"2024-09-17T01:35:12.668628+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:08.753759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668301+0000","last_change":"2024-09-17T01:35:11.667098+0000","last_active":"2024-09-17T01:35:12.668301+0000","last_peered":"2024-09-17T01:35:12.668301+0000","last_clean":"2024-09-17T01:35:12.668301+0000","last_became_active":"2024-09-17T01:35:11.666559+0000","last_became_peered":"2024-09-17T01:35:11.666559+0000","last_unstale":"2024-09-17T01:35:12.668301+0000","last_undegraded":"2024-09-17T01:35:12.668301+0000","last_fullsized":"2024-09-17T01:35:12.668301+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:08.755783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693835+0000","last_change":"2024-09-17T01:35:11.691137+0000","last_active":"2024-09-17T01:35:12.693835+0000","last_peered":"2024-09-17T01:35:12.693835+0000","last_clean":"2024-09-17T01:35:12.693835+0000","last_became_active":"2024-09-17T01:35:11.690602+0000","last_became_peered":"2024-09-17T01:35:11.690602+0000","last_unstale":"2024-09-17T01:35:12.693835+0000","last_undegraded":"2024-09-17T01:35:12.693835+0000","last_fullsized":"2024-09-17T01:35:12.693835+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:38.506225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:35:10.641797+0000","last_change":"2024-09-17T01:35:10.641797+0000","last_active":"2024-09-17T01:35:10.641797+0000","last_peered":"2024-09-17T01:35:10.641797+0000","last_clean":"2024-09-17T01:35:10.641797+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:35:10.641797+0000","last_undegraded":"2024-09-17T01:35:10.641797+0000","last_fullsized":"2024-09-17T01:35:10.641797+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668910+0000","last_change":"2024-09-17T01:35:11.682294+0000","last_active":"2024-09-17T01:35:12.668910+0000","last_peered":"2024-09-17T01:35:12.668910+0000","last_clean":"2024-09-17T01:35:12.668910+0000","last_became_active":"2024-09-17T01:35:11.681948+0000","last_became_peered":"2024-09-17T01:35:11.681948+0000","last_unstale":"2024-09-17T01:35:12.668910+0000","last_undegraded":"2024-09-17T01:35:12.668910+0000","last_fullsized":"2024-09-17T01:35:12.668910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:51.076106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693756+0000","last_change":"2024-09-17T01:35:11.684238+0000","last_active":"2024-09-17T01:35:12.693756+0000","last_peered":"2024-09-17T01:35:12.693756+0000","last_clean":"2024-09-17T01:35:12.693756+0000","last_became_active":"2024-09-17T01:35:11.683881+0000","last_became_peered":"2024-09-17T01:35:11.683881+0000","last_unstale":"2024-09-17T01:35:12.693756+0000","last_undegraded":"2024-09-17T01:35:12.693756+0000","last_fullsized":"2024-09-17T01:35:12.693756+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:08.054097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693215+0000","last_change":"2024-09-17T01:35:11.675869+0000","last_active":"2024-09-17T01:35:12.693215+0000","last_peered":"2024-09-17T01:35:12.693215+0000","last_clean":"2024-09-17T01:35:12.693215+0000","last_became_active":"2024-09-17T01:35:11.675515+0000","last_became_peered":"2024-09-17T01:35:11.675515+0000","last_unstale":"2024-09-17T01:35:12.693215+0000","last_undegraded":"2024-09-17T01:35:12.693215+0000","last_fullsized":"2024-09-17T01:35:12.693215+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:19.830835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166406+0000","last_change":"2024-09-17T01:35:11.682552+0000","last_active":"2024-09-17T01:35:13.166406+0000","last_peered":"2024-09-17T01:35:13.166406+0000","last_clean":"2024-09-17T01:35:13.166406+0000","last_became_active":"2024-09-17T01:35:11.680943+0000","last_became_peered":"2024-09-17T01:35:11.680943+0000","last_unstale":"2024-09-17T01:35:13.166406+0000","last_undegraded":"2024-09-17T01:35:13.166406+0000","last_fullsized":"2024-09-17T01:35:13.166406+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:44:50.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:35:10.641797+0000","last_change":"2024-09-17T01:35:10.641797+0000","last_active":"2024-09-17T01:35:10.641797+0000","last_peered":"2024-09-17T01:35:10.641797+0000","last_clean":"2024-09-17T01:35:10.641797+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:35:10.641797+0000","last_undegraded":"2024-09-17T01:35:10.641797+0000","last_fullsized":"2024-09-17T01:35:10.641797+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666193+0000","last_change":"2024-09-17T01:35:11.685570+0000","last_active":"2024-09-17T01:35:12.666193+0000","last_peered":"2024-09-17T01:35:12.666193+0000","last_clean":"2024-09-17T01:35:12.666193+0000","last_became_active":"2024-09-17T01:35:11.685257+0000","last_became_peered":"2024-09-17T01:35:11.685257+0000","last_unstale":"2024-09-17T01:35:12.666193+0000","last_undegraded":"2024-09-17T01:35:12.666193+0000","last_fullsized":"2024-09-17T01:35:12.666193+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:30.801288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166734+0000","last_change":"2024-09-17T01:35:11.690839+0000","last_active":"2024-09-17T01:35:13.166734+0000","last_peered":"2024-09-17T01:35:13.166734+0000","last_clean":"2024-09-17T01:35:13.166734+0000","last_became_active":"2024-09-17T01:35:11.690498+0000","last_became_peered":"2024-09-17T01:35:11.690498+0000","last_unstale":"2024-09-17T01:35:13.166734+0000","last_undegraded":"2024-09-17T01:35:13.166734+0000","last_fullsized":"2024-09-17T01:35:13.166734+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:11.517652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667435+0000","last_change":"2024-09-17T01:35:11.669110+0000","last_active":"2024-09-17T01:35:12.667435+0000","last_peered":"2024-09-17T01:35:12.667435+0000","last_clean":"2024-09-17T01:35:12.667435+0000","last_became_active":"2024-09-17T01:35:11.668359+0000","last_became_peered":"2024-09-17T01:35:11.668359+0000","last_unstale":"2024-09-17T01:35:12.667435+0000","last_undegraded":"2024-09-17T01:35:12.667435+0000","last_fullsized":"2024-09-17T01:35:12.667435+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:07:06.732155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693613+0000","last_change":"2024-09-17T01:35:11.678510+0000","last_active":"2024-09-17T01:35:12.693613+0000","last_peered":"2024-09-17T01:35:12.693613+0000","last_clean":"2024-09-17T01:35:12.693613+0000","last_became_active":"2024-09-17T01:35:11.678067+0000","last_became_peered":"2024-09-17T01:35:11.678067+0000","last_unstale":"2024-09-17T01:35:12.693613+0000","last_undegraded":"2024-09-17T01:35:12.693613+0000","last_fullsized":"2024-09-17T01:35:12.693613+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:17.926468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166985+0000","last_change":"2024-09-17T01:35:11.675603+0000","last_active":"2024-09-17T01:35:13.166985+0000","last_peered":"2024-09-17T01:35:13.166985+0000","last_clean":"2024-09-17T01:35:13.166985+0000","last_became_active":"2024-09-17T01:35:11.675290+0000","last_became_peered":"2024-09-17T01:35:11.675290+0000","last_unstale":"2024-09-17T01:35:13.166985+0000","last_undegraded":"2024-09-17T01:35:13.166985+0000","last_fullsized":"2024-09-17T01:35:13.166985+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:04.530089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696764+0000","last_change":"2024-09-17T01:35:11.668987+0000","last_active":"2024-09-17T01:35:12.696764+0000","last_peered":"2024-09-17T01:35:12.696764+0000","last_clean":"2024-09-17T01:35:12.696764+0000","last_became_active":"2024-09-17T01:35:11.668644+0000","last_became_peered":"2024-09-17T01:35:11.668644+0000","last_unstale":"2024-09-17T01:35:12.696764+0000","last_undegraded":"2024-09-17T01:35:12.696764+0000","last_fullsized":"2024-09-17T01:35:12.696764+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:28:33.791232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:35:10.641797+0000","last_change":"2024-09-17T01:35:10.641797+0000","last_active":"2024-09-17T01:35:10.641797+0000","last_peered":"2024-09-17T01:35:10.641797+0000","last_clean":"2024-09-17T01:35:10.641797+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:35:10.641797+0000","last_undegraded":"2024-09-17T01:35:10.641797+0000","last_fullsized":"2024-09-17T01:35:10.641797+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166850+0000","last_change":"2024-09-17T01:35:11.678418+0000","last_active":"2024-09-17T01:35:13.166850+0000","last_peered":"2024-09-17T01:35:13.166850+0000","last_clean":"2024-09-17T01:35:13.166850+0000","last_became_active":"2024-09-17T01:35:11.678096+0000","last_became_peered":"2024-09-17T01:35:11.678096+0000","last_unstale":"2024-09-17T01:35:13.166850+0000","last_undegraded":"2024-09-17T01:35:13.166850+0000","last_fullsized":"2024-09-17T01:35:13.166850+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:24.131701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693997+0000","last_change":"2024-09-17T01:35:11.687021+0000","last_active":"2024-09-17T01:35:12.693997+0000","last_peered":"2024-09-17T01:35:12.693997+0000","last_clean":"2024-09-17T01:35:12.693997+0000","last_became_active":"2024-09-17T01:35:11.685533+0000","last_became_peered":"2024-09-17T01:35:11.685533+0000","last_unstale":"2024-09-17T01:35:12.693997+0000","last_undegraded":"2024-09-17T01:35:12.693997+0000","last_fullsized":"2024-09-17T01:35:12.693997+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:20.511127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696562+0000","last_change":"2024-09-17T01:35:11.673221+0000","last_active":"2024-09-17T01:35:12.696562+0000","last_peered":"2024-09-17T01:35:12.696562+0000","last_clean":"2024-09-17T01:35:12.696562+0000","last_became_active":"2024-09-17T01:35:11.670852+0000","last_became_peered":"2024-09-17T01:35:11.670852+0000","last_unstale":"2024-09-17T01:35:12.696562+0000","last_undegraded":"2024-09-17T01:35:12.696562+0000","last_fullsized":"2024-09-17T01:35:12.696562+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:40.426585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696743+0000","last_change":"2024-09-17T01:35:11.671861+0000","last_active":"2024-09-17T01:35:12.696743+0000","last_peered":"2024-09-17T01:35:12.696743+0000","last_clean":"2024-09-17T01:35:12.696743+0000","last_became_active":"2024-09-17T01:35:11.671539+0000","last_became_peered":"2024-09-17T01:35:11.671539+0000","last_unstale":"2024-09-17T01:35:12.696743+0000","last_undegraded":"2024-09-17T01:35:12.696743+0000","last_fullsized":"2024-09-17T01:35:12.696743+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:59.339611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166574+0000","last_change":"2024-09-17T01:35:11.687865+0000","last_active":"2024-09-17T01:35:13.166574+0000","last_peered":"2024-09-17T01:35:13.166574+0000","last_clean":"2024-09-17T01:35:13.166574+0000","last_became_active":"2024-09-17T01:35:11.684764+0000","last_became_peered":"2024-09-17T01:35:11.684764+0000","last_unstale":"2024-09-17T01:35:13.166574+0000","last_undegraded":"2024-09-17T01:35:13.166574+0000","last_fullsized":"2024-09-17T01:35:13.166574+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:35.323990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:35:10.641797+0000","last_change":"2024-09-17T01:35:10.641797+0000","last_active":"2024-09-17T01:35:10.641797+0000","last_peered":"2024-09-17T01:35:10.641797+0000","last_clean":"2024-09-17T01:35:10.641797+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:35:10.641797+0000","last_undegraded":"2024-09-17T01:35:10.641797+0000","last_fullsized":"2024-09-17T01:35:10.641797+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666875+0000","last_change":"2024-09-17T01:35:11.676283+0000","last_active":"2024-09-17T01:35:12.666875+0000","last_peered":"2024-09-17T01:35:12.666875+0000","last_clean":"2024-09-17T01:35:12.666875+0000","last_became_active":"2024-09-17T01:35:11.675947+0000","last_became_peered":"2024-09-17T01:35:11.675947+0000","last_unstale":"2024-09-17T01:35:12.666875+0000","last_undegraded":"2024-09-17T01:35:12.666875+0000","last_fullsized":"2024-09-17T01:35:12.666875+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:39.573816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693187+0000","last_change":"2024-09-17T01:35:11.678889+0000","last_active":"2024-09-17T01:35:12.693187+0000","last_peered":"2024-09-17T01:35:12.693187+0000","last_clean":"2024-09-17T01:35:12.693187+0000","last_became_active":"2024-09-17T01:35:11.678542+0000","last_became_peered":"2024-09-17T01:35:11.678542+0000","last_unstale":"2024-09-17T01:35:12.693187+0000","last_undegraded":"2024-09-17T01:35:12.693187+0000","last_fullsized":"2024-09-17T01:35:12.693187+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:18.255811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.167081+0000","last_change":"2024-09-17T01:35:11.670813+0000","last_active":"2024-09-17T01:35:13.167081+0000","last_peered":"2024-09-17T01:35:13.167081+0000","last_clean":"2024-09-17T01:35:13.167081+0000","last_became_active":"2024-09-17T01:35:11.670399+0000","last_became_peered":"2024-09-17T01:35:11.670399+0000","last_unstale":"2024-09-17T01:35:13.167081+0000","last_undegraded":"2024-09-17T01:35:13.167081+0000","last_fullsized":"2024-09-17T01:35:13.167081+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:51.896304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"48'4","reported_seq":19,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668630+0000","last_change":"2024-09-17T01:35:10.676051+0000","last_active":"2024-09-17T01:35:12.668630+0000","last_peered":"2024-09-17T01:35:12.668630+0000","last_clean":"2024-09-17T01:35:12.668630+0000","last_became_active":"2024-09-17T01:35:10.675678+0000","last_became_peered":"2024-09-17T01:35:10.675678+0000","last_unstale":"2024-09-17T01:35:12.668630+0000","last_undegraded":"2024-09-17T01:35:12.668630+0000","last_fullsized":"2024-09-17T01:35:12.668630+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:29.304564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166984+0000","last_change":"2024-09-17T01:35:11.688201+0000","last_active":"2024-09-17T01:35:13.166984+0000","last_peered":"2024-09-17T01:35:13.166984+0000","last_clean":"2024-09-17T01:35:13.166984+0000","last_became_active":"2024-09-17T01:35:11.684393+0000","last_became_peered":"2024-09-17T01:35:11.684393+0000","last_unstale":"2024-09-17T01:35:13.166984+0000","last_undegraded":"2024-09-17T01:35:13.166984+0000","last_fullsized":"2024-09-17T01:35:13.166984+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:36:30.634041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696918+0000","last_change":"2024-09-17T01:35:10.669339+0000","last_active":"2024-09-17T01:35:12.696918+0000","last_peered":"2024-09-17T01:35:12.696918+0000","last_clean":"2024-09-17T01:35:12.696918+0000","last_became_active":"2024-09-17T01:35:10.666719+0000","last_became_peered":"2024-09-17T01:35:10.666719+0000","last_unstale":"2024-09-17T01:35:12.696918+0000","last_undegraded":"2024-09-17T01:35:12.696918+0000","last_fullsized":"2024-09-17T01:35:12.696918+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:11.436388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:35:10.641797+0000","last_change":"2024-09-17T01:35:10.641797+0000","last_active":"2024-09-17T01:35:10.641797+0000","last_peered":"2024-09-17T01:35:10.641797+0000","last_clean":"2024-09-17T01:35:10.641797+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:35:10.641797+0000","last_undegraded":"2024-09-17T01:35:10.641797+0000","last_fullsized":"2024-09-17T01:35:10.641797+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668026+0000","last_change":"2024-09-17T01:35:10.682029+0000","last_active":"2024-09-17T01:35:12.668026+0000","last_peered":"2024-09-17T01:35:12.668026+0000","last_clean":"2024-09-17T01:35:12.668026+0000","last_became_active":"2024-09-17T01:35:10.681689+0000","last_became_peered":"2024-09-17T01:35:10.681689+0000","last_unstale":"2024-09-17T01:35:12.668026+0000","last_undegraded":"2024-09-17T01:35:12.668026+0000","last_fullsized":"2024-09-17T01:35:12.668026+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:10.562332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693888+0000","last_change":"2024-09-17T01:35:11.690091+0000","last_active":"2024-09-17T01:35:12.693888+0000","last_peered":"2024-09-17T01:35:12.693888+0000","last_clean":"2024-09-17T01:35:12.693888+0000","last_became_active":"2024-09-17T01:35:11.688955+0000","last_became_peered":"2024-09-17T01:35:11.688955+0000","last_unstale":"2024-09-17T01:35:12.693888+0000","last_undegraded":"2024-09-17T01:35:12.693888+0000","last_fullsized":"2024-09-17T01:35:12.693888+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:30.638574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696617+0000","last_change":"2024-09-17T01:35:10.672378+0000","last_active":"2024-09-17T01:35:12.696617+0000","last_peered":"2024-09-17T01:35:12.696617+0000","last_clean":"2024-09-17T01:35:12.696617+0000","last_became_active":"2024-09-17T01:35:10.670878+0000","last_became_peered":"2024-09-17T01:35:10.670878+0000","last_unstale":"2024-09-17T01:35:12.696617+0000","last_undegraded":"2024-09-17T01:35:12.696617+0000","last_fullsized":"2024-09-17T01:35:12.696617+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:44:02.998010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696488+0000","last_change":"2024-09-17T01:35:11.672199+0000","last_active":"2024-09-17T01:35:12.696488+0000","last_peered":"2024-09-17T01:35:12.696488+0000","last_clean":"2024-09-17T01:35:12.696488+0000","last_became_active":"2024-09-17T01:35:11.671902+0000","last_became_peered":"2024-09-17T01:35:11.671902+0000","last_unstale":"2024-09-17T01:35:12.696488+0000","last_undegraded":"2024-09-17T01:35:12.696488+0000","last_fullsized":"2024-09-17T01:35:12.696488+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:40.681886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668842+0000","last_change":"2024-09-17T01:35:10.666527+0000","last_active":"2024-09-17T01:35:12.668842+0000","last_peered":"2024-09-17T01:35:12.668842+0000","last_clean":"2024-09-17T01:35:12.668842+0000","last_became_active":"2024-09-17T01:35:10.666251+0000","last_became_peered":"2024-09-17T01:35:10.666251+0000","last_unstale":"2024-09-17T01:35:12.668842+0000","last_undegraded":"2024-09-17T01:35:12.668842+0000","last_fullsized":"2024-09-17T01:35:12.668842+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:08.974997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667219+0000","last_change":"2024-09-17T01:35:11.679799+0000","last_active":"2024-09-17T01:35:12.667219+0000","last_peered":"2024-09-17T01:35:12.667219+0000","last_clean":"2024-09-17T01:35:12.667219+0000","last_became_active":"2024-09-17T01:35:11.675735+0000","last_became_peered":"2024-09-17T01:35:11.675735+0000","last_unstale":"2024-09-17T01:35:12.667219+0000","last_undegraded":"2024-09-17T01:35:12.667219+0000","last_fullsized":"2024-09-17T01:35:12.667219+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:53.242251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696421+0000","last_change":"2024-09-17T01:35:10.683902+0000","last_active":"2024-09-17T01:35:12.696421+0000","last_peered":"2024-09-17T01:35:12.696421+0000","last_clean":"2024-09-17T01:35:12.696421+0000","last_became_active":"2024-09-17T01:35:10.683540+0000","last_became_peered":"2024-09-17T01:35:10.683540+0000","last_unstale":"2024-09-17T01:35:12.696421+0000","last_undegraded":"2024-09-17T01:35:12.696421+0000","last_fullsized":"2024-09-17T01:35:12.696421+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:14:50.086073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666898+0000","last_change":"2024-09-17T01:35:11.667959+0000","last_active":"2024-09-17T01:35:12.666898+0000","last_peered":"2024-09-17T01:35:12.666898+0000","last_clean":"2024-09-17T01:35:12.666898+0000","last_became_active":"2024-09-17T01:35:11.667618+0000","last_became_peered":"2024-09-17T01:35:11.667618+0000","last_unstale":"2024-09-17T01:35:12.666898+0000","last_undegraded":"2024-09-17T01:35:12.666898+0000","last_fullsized":"2024-09-17T01:35:12.666898+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:06.513791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166436+0000","last_change":"2024-09-17T01:35:10.683282+0000","last_active":"2024-09-17T01:35:13.166436+0000","last_peered":"2024-09-17T01:35:13.166436+0000","last_clean":"2024-09-17T01:35:13.166436+0000","last_became_active":"2024-09-17T01:35:10.682938+0000","last_became_peered":"2024-09-17T01:35:10.682938+0000","last_unstale":"2024-09-17T01:35:13.166436+0000","last_undegraded":"2024-09-17T01:35:13.166436+0000","last_fullsized":"2024-09-17T01:35:13.166436+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:31.273868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696437+0000","last_change":"2024-09-17T01:35:11.682324+0000","last_active":"2024-09-17T01:35:12.696437+0000","last_peered":"2024-09-17T01:35:12.696437+0000","last_clean":"2024-09-17T01:35:12.696437+0000","last_became_active":"2024-09-17T01:35:11.682037+0000","last_became_peered":"2024-09-17T01:35:11.682037+0000","last_unstale":"2024-09-17T01:35:12.696437+0000","last_undegraded":"2024-09-17T01:35:12.696437+0000","last_fullsized":"2024-09-17T01:35:12.696437+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:08.755783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666831+0000","last_change":"2024-09-17T01:35:10.676447+0000","last_active":"2024-09-17T01:35:12.666831+0000","last_peered":"2024-09-17T01:35:12.666831+0000","last_clean":"2024-09-17T01:35:12.666831+0000","last_became_active":"2024-09-17T01:35:10.676026+0000","last_became_peered":"2024-09-17T01:35:10.676026+0000","last_unstale":"2024-09-17T01:35:12.666831+0000","last_undegraded":"2024-09-17T01:35:12.666831+0000","last_fullsized":"2024-09-17T01:35:12.666831+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:36.004994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666229+0000","last_change":"2024-09-17T01:35:11.673386+0000","last_active":"2024-09-17T01:35:12.666229+0000","last_peered":"2024-09-17T01:35:12.666229+0000","last_clean":"2024-09-17T01:35:12.666229+0000","last_became_active":"2024-09-17T01:35:11.673001+0000","last_became_peered":"2024-09-17T01:35:11.673001+0000","last_unstale":"2024-09-17T01:35:12.666229+0000","last_undegraded":"2024-09-17T01:35:12.666229+0000","last_fullsized":"2024-09-17T01:35:12.666229+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:55.318960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665797+0000","last_change":"2024-09-17T01:35:10.669932+0000","last_active":"2024-09-17T01:35:12.665797+0000","last_peered":"2024-09-17T01:35:12.665797+0000","last_clean":"2024-09-17T01:35:12.665797+0000","last_became_active":"2024-09-17T01:35:10.669651+0000","last_became_peered":"2024-09-17T01:35:10.669651+0000","last_unstale":"2024-09-17T01:35:12.665797+0000","last_undegraded":"2024-09-17T01:35:12.665797+0000","last_fullsized":"2024-09-17T01:35:12.665797+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:55.136983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665664+0000","last_change":"2024-09-17T01:35:11.681534+0000","last_active":"2024-09-17T01:35:12.665664+0000","last_peered":"2024-09-17T01:35:12.665664+0000","last_clean":"2024-09-17T01:35:12.665664+0000","last_became_active":"2024-09-17T01:35:11.681247+0000","last_became_peered":"2024-09-17T01:35:11.681247+0000","last_unstale":"2024-09-17T01:35:12.665664+0000","last_undegraded":"2024-09-17T01:35:12.665664+0000","last_fullsized":"2024-09-17T01:35:12.665664+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:40.773263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668340+0000","last_change":"2024-09-17T01:35:10.679164+0000","last_active":"2024-09-17T01:35:12.668340+0000","last_peered":"2024-09-17T01:35:12.668340+0000","last_clean":"2024-09-17T01:35:12.668340+0000","last_became_active":"2024-09-17T01:35:10.677983+0000","last_became_peered":"2024-09-17T01:35:10.677983+0000","last_unstale":"2024-09-17T01:35:12.668340+0000","last_undegraded":"2024-09-17T01:35:12.668340+0000","last_fullsized":"2024-09-17T01:35:12.668340+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:31.801763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693799+0000","last_change":"2024-09-17T01:35:11.683421+0000","last_active":"2024-09-17T01:35:12.693799+0000","last_peered":"2024-09-17T01:35:12.693799+0000","last_clean":"2024-09-17T01:35:12.693799+0000","last_became_active":"2024-09-17T01:35:11.683075+0000","last_became_peered":"2024-09-17T01:35:11.683075+0000","last_unstale":"2024-09-17T01:35:12.693799+0000","last_undegraded":"2024-09-17T01:35:12.693799+0000","last_fullsized":"2024-09-17T01:35:12.693799+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:38.873835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-09-17T01:35:09.645810+0000","last_change":"2024-09-17T01:35:09.645810+0000","last_active":"2024-09-17T01:35:09.633343+0000","last_peered":"2024-09-17T01:35:09.633343+0000","last_clean":"2024-09-17T01:35:09.633343+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:35:09.645810+0000","last_undegraded":"2024-09-17T01:35:09.645810+0000","last_fullsized":"2024-09-17T01:35:09.645810+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696933+0000","last_change":"2024-09-17T01:35:11.678867+0000","last_active":"2024-09-17T01:35:12.696933+0000","last_peered":"2024-09-17T01:35:12.696933+0000","last_clean":"2024-09-17T01:35:12.696933+0000","last_became_active":"2024-09-17T01:35:11.678581+0000","last_became_peered":"2024-09-17T01:35:11.678581+0000","last_unstale":"2024-09-17T01:35:12.696933+0000","last_undegraded":"2024-09-17T01:35:12.696933+0000","last_fullsized":"2024-09-17T01:35:12.696933+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:30.558833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"48'6","reported_seq":21,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667586+0000","last_change":"2024-09-17T01:35:10.672677+0000","last_active":"2024-09-17T01:35:12.667586+0000","last_peered":"2024-09-17T01:35:12.667586+0000","last_clean":"2024-09-17T01:35:12.667586+0000","last_became_active":"2024-09-17T01:35:10.672338+0000","last_became_peered":"2024-09-17T01:35:10.672338+0000","last_unstale":"2024-09-17T01:35:12.667586+0000","last_undegraded":"2024-09-17T01:35:12.667586+0000","last_fullsized":"2024-09-17T01:35:12.667586+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:23.123246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665774+0000","last_change":"2024-09-17T01:35:11.675401+0000","last_active":"2024-09-17T01:35:12.665774+0000","last_peered":"2024-09-17T01:35:12.665774+0000","last_clean":"2024-09-17T01:35:12.665774+0000","last_became_active":"2024-09-17T01:35:11.674946+0000","last_became_peered":"2024-09-17T01:35:11.674946+0000","last_unstale":"2024-09-17T01:35:12.665774+0000","last_undegraded":"2024-09-17T01:35:12.665774+0000","last_fullsized":"2024-09-17T01:35:12.665774+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:16.229827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166584+0000","last_change":"2024-09-17T01:35:10.671105+0000","last_active":"2024-09-17T01:35:13.166584+0000","last_peered":"2024-09-17T01:35:13.166584+0000","last_clean":"2024-09-17T01:35:13.166584+0000","last_became_active":"2024-09-17T01:35:10.670646+0000","last_became_peered":"2024-09-17T01:35:10.670646+0000","last_unstale":"2024-09-17T01:35:13.166584+0000","last_undegraded":"2024-09-17T01:35:13.166584+0000","last_fullsized":"2024-09-17T01:35:13.166584+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:31.761461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166938+0000","last_change":"2024-09-17T01:35:11.671482+0000","last_active":"2024-09-17T01:35:13.166938+0000","last_peered":"2024-09-17T01:35:13.166938+0000","last_clean":"2024-09-17T01:35:13.166938+0000","last_became_active":"2024-09-17T01:35:11.671159+0000","last_became_peered":"2024-09-17T01:35:11.671159+0000","last_unstale":"2024-09-17T01:35:13.166938+0000","last_undegraded":"2024-09-17T01:35:13.166938+0000","last_fullsized":"2024-09-17T01:35:13.166938+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:22.007933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166393+0000","last_change":"2024-09-17T01:35:10.677803+0000","last_active":"2024-09-17T01:35:13.166393+0000","last_peered":"2024-09-17T01:35:13.166393+0000","last_clean":"2024-09-17T01:35:13.166393+0000","last_became_active":"2024-09-17T01:35:10.677510+0000","last_became_peered":"2024-09-17T01:35:10.677510+0000","last_unstale":"2024-09-17T01:35:13.166393+0000","last_undegraded":"2024-09-17T01:35:13.166393+0000","last_fullsized":"2024-09-17T01:35:13.166393+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:05:45.762431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166796+0000","last_change":"2024-09-17T01:35:11.673836+0000","last_active":"2024-09-17T01:35:13.166796+0000","last_peered":"2024-09-17T01:35:13.166796+0000","last_clean":"2024-09-17T01:35:13.166796+0000","last_became_active":"2024-09-17T01:35:11.669992+0000","last_became_peered":"2024-09-17T01:35:11.669992+0000","last_unstale":"2024-09-17T01:35:13.166796+0000","last_undegraded":"2024-09-17T01:35:13.166796+0000","last_fullsized":"2024-09-17T01:35:13.166796+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:40.901698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667026+0000","last_change":"2024-09-17T01:35:10.664520+0000","last_active":"2024-09-17T01:35:12.667026+0000","last_peered":"2024-09-17T01:35:12.667026+0000","last_clean":"2024-09-17T01:35:12.667026+0000","last_became_active":"2024-09-17T01:35:10.663413+0000","last_became_peered":"2024-09-17T01:35:10.663413+0000","last_unstale":"2024-09-17T01:35:12.667026+0000","last_undegraded":"2024-09-17T01:35:12.667026+0000","last_fullsized":"2024-09-17T01:35:12.667026+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:11.217933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:35:10.641797+0000","last_change":"2024-09-17T01:35:10.641797+0000","last_active":"2024-09-17T01:35:10.641797+0000","last_peered":"2024-09-17T01:35:10.641797+0000","last_clean":"2024-09-17T01:35:10.641797+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:35:10.641797+0000","last_undegraded":"2024-09-17T01:35:10.641797+0000","last_fullsized":"2024-09-17T01:35:10.641797+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"48'8","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668429+0000","last_change":"2024-09-17T01:35:10.668450+0000","last_active":"2024-09-17T01:35:12.668429+0000","last_peered":"2024-09-17T01:35:12.668429+0000","last_clean":"2024-09-17T01:35:12.668429+0000","last_became_active":"2024-09-17T01:35:10.668097+0000","last_became_peered":"2024-09-17T01:35:10.668097+0000","last_unstale":"2024-09-17T01:35:12.668429+0000","last_undegraded":"2024-09-17T01:35:12.668429+0000","last_fullsized":"2024-09-17T01:35:12.668429+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:52.159951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.167034+0000","last_change":"2024-09-17T01:35:11.677620+0000","last_active":"2024-09-17T01:35:13.167034+0000","last_peered":"2024-09-17T01:35:13.167034+0000","last_clean":"2024-09-17T01:35:13.167034+0000","last_became_active":"2024-09-17T01:35:11.677084+0000","last_became_peered":"2024-09-17T01:35:11.677084+0000","last_unstale":"2024-09-17T01:35:13.167034+0000","last_undegraded":"2024-09-17T01:35:13.167034+0000","last_fullsized":"2024-09-17T01:35:13.167034+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:12:39.675385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693994+0000","last_change":"2024-09-17T01:35:10.672120+0000","last_active":"2024-09-17T01:35:12.693994+0000","last_peered":"2024-09-17T01:35:12.693994+0000","last_clean":"2024-09-17T01:35:12.693994+0000","last_became_active":"2024-09-17T01:35:10.671797+0000","last_became_peered":"2024-09-17T01:35:10.671797+0000","last_unstale":"2024-09-17T01:35:12.693994+0000","last_undegraded":"2024-09-17T01:35:12.693994+0000","last_fullsized":"2024-09-17T01:35:12.693994+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:47:27.327278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.167111+0000","last_change":"2024-09-17T01:35:11.678099+0000","last_active":"2024-09-17T01:35:13.167111+0000","last_peered":"2024-09-17T01:35:13.167111+0000","last_clean":"2024-09-17T01:35:13.167111+0000","last_became_active":"2024-09-17T01:35:11.677064+0000","last_became_peered":"2024-09-17T01:35:11.677064+0000","last_unstale":"2024-09-17T01:35:13.167111+0000","last_undegraded":"2024-09-17T01:35:13.167111+0000","last_fullsized":"2024-09-17T01:35:13.167111+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:59.219211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666337+0000","last_change":"2024-09-17T01:35:10.663348+0000","last_active":"2024-09-17T01:35:12.666337+0000","last_peered":"2024-09-17T01:35:12.666337+0000","last_clean":"2024-09-17T01:35:12.666337+0000","last_became_active":"2024-09-17T01:35:10.662887+0000","last_became_peered":"2024-09-17T01:35:10.662887+0000","last_unstale":"2024-09-17T01:35:12.666337+0000","last_undegraded":"2024-09-17T01:35:12.666337+0000","last_fullsized":"2024-09-17T01:35:12.666337+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:24.816236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:35:10.641797+0000","last_change":"2024-09-17T01:35:10.641797+0000","last_active":"2024-09-17T01:35:10.641797+0000","last_peered":"2024-09-17T01:35:10.641797+0000","last_clean":"2024-09-17T01:35:10.641797+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:35:10.641797+0000","last_undegraded":"2024-09-17T01:35:10.641797+0000","last_fullsized":"2024-09-17T01:35:10.641797+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666047+0000","last_change":"2024-09-17T01:35:10.676459+0000","last_active":"2024-09-17T01:35:12.666047+0000","last_peered":"2024-09-17T01:35:12.666047+0000","last_clean":"2024-09-17T01:35:12.666047+0000","last_became_active":"2024-09-17T01:35:10.676141+0000","last_became_peered":"2024-09-17T01:35:10.676141+0000","last_unstale":"2024-09-17T01:35:12.666047+0000","last_undegraded":"2024-09-17T01:35:12.666047+0000","last_fullsized":"2024-09-17T01:35:12.666047+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:40.090233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665974+0000","last_change":"2024-09-17T01:35:11.676736+0000","last_active":"2024-09-17T01:35:12.665974+0000","last_peered":"2024-09-17T01:35:12.665974+0000","last_clean":"2024-09-17T01:35:12.665974+0000","last_became_active":"2024-09-17T01:35:11.676057+0000","last_became_peered":"2024-09-17T01:35:11.676057+0000","last_unstale":"2024-09-17T01:35:12.665974+0000","last_undegraded":"2024-09-17T01:35:12.665974+0000","last_fullsized":"2024-09-17T01:35:12.665974+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:09.879854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667410+0000","last_change":"2024-09-17T01:35:10.662974+0000","last_active":"2024-09-17T01:35:12.667410+0000","last_peered":"2024-09-17T01:35:12.667410+0000","last_clean":"2024-09-17T01:35:12.667410+0000","last_became_active":"2024-09-17T01:35:10.662581+0000","last_became_peered":"2024-09-17T01:35:10.662581+0000","last_unstale":"2024-09-17T01:35:12.667410+0000","last_undegraded":"2024-09-17T01:35:12.667410+0000","last_fullsized":"2024-09-17T01:35:12.667410+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:36.554201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667139+0000","last_change":"2024-09-17T01:35:11.681718+0000","last_active":"2024-09-17T01:35:12.667139+0000","last_peered":"2024-09-17T01:35:12.667139+0000","last_clean":"2024-09-17T01:35:12.667139+0000","last_became_active":"2024-09-17T01:35:11.681374+0000","last_became_peered":"2024-09-17T01:35:11.681374+0000","last_unstale":"2024-09-17T01:35:12.667139+0000","last_undegraded":"2024-09-17T01:35:12.667139+0000","last_fullsized":"2024-09-17T01:35:12.667139+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:45.555304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667551+0000","last_change":"2024-09-17T01:35:10.678608+0000","last_active":"2024-09-17T01:35:12.667551+0000","last_peered":"2024-09-17T01:35:12.667551+0000","last_clean":"2024-09-17T01:35:12.667551+0000","last_became_active":"2024-09-17T01:35:10.678289+0000","last_became_peered":"2024-09-17T01:35:10.678289+0000","last_unstale":"2024-09-17T01:35:12.667551+0000","last_undegraded":"2024-09-17T01:35:12.667551+0000","last_fullsized":"2024-09-17T01:35:12.667551+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:41.559466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668635+0000","last_change":"2024-09-17T01:35:11.681503+0000","last_active":"2024-09-17T01:35:12.668635+0000","last_peered":"2024-09-17T01:35:12.668635+0000","last_clean":"2024-09-17T01:35:12.668635+0000","last_became_active":"2024-09-17T01:35:11.681145+0000","last_became_peered":"2024-09-17T01:35:11.681145+0000","last_unstale":"2024-09-17T01:35:12.668635+0000","last_undegraded":"2024-09-17T01:35:12.668635+0000","last_fullsized":"2024-09-17T01:35:12.668635+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:46.719967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166440+0000","last_change":"2024-09-17T01:35:10.679163+0000","last_active":"2024-09-17T01:35:13.166440+0000","last_peered":"2024-09-17T01:35:13.166440+0000","last_clean":"2024-09-17T01:35:13.166440+0000","last_became_active":"2024-09-17T01:35:10.678887+0000","last_became_peered":"2024-09-17T01:35:10.678887+0000","last_unstale":"2024-09-17T01:35:13.166440+0000","last_undegraded":"2024-09-17T01:35:13.166440+0000","last_fullsized":"2024-09-17T01:35:13.166440+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:34:24.704092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693539+0000","last_change":"2024-09-17T01:35:11.674494+0000","last_active":"2024-09-17T01:35:12.693539+0000","last_peered":"2024-09-17T01:35:12.693539+0000","last_clean":"2024-09-17T01:35:12.693539+0000","last_became_active":"2024-09-17T01:35:11.674130+0000","last_became_peered":"2024-09-17T01:35:11.674130+0000","last_unstale":"2024-09-17T01:35:12.693539+0000","last_undegraded":"2024-09-17T01:35:12.693539+0000","last_fullsized":"2024-09-17T01:35:12.693539+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:16.826974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666489+0000","last_change":"2024-09-17T01:35:10.678454+0000","last_active":"2024-09-17T01:35:12.666489+0000","last_peered":"2024-09-17T01:35:12.666489+0000","last_clean":"2024-09-17T01:35:12.666489+0000","last_became_active":"2024-09-17T01:35:10.678074+0000","last_became_peered":"2024-09-17T01:35:10.678074+0000","last_unstale":"2024-09-17T01:35:12.666489+0000","last_undegraded":"2024-09-17T01:35:12.666489+0000","last_fullsized":"2024-09-17T01:35:12.666489+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:36:20.417566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693618+0000","last_change":"2024-09-17T01:35:11.685970+0000","last_active":"2024-09-17T01:35:12.693618+0000","last_peered":"2024-09-17T01:35:12.693618+0000","last_clean":"2024-09-17T01:35:12.693618+0000","last_became_active":"2024-09-17T01:35:11.685585+0000","last_became_peered":"2024-09-17T01:35:11.685585+0000","last_unstale":"2024-09-17T01:35:12.693618+0000","last_undegraded":"2024-09-17T01:35:12.693618+0000","last_fullsized":"2024-09-17T01:35:12.693618+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:01.388599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696251+0000","last_change":"2024-09-17T01:35:10.665577+0000","last_active":"2024-09-17T01:35:12.696251+0000","last_peered":"2024-09-17T01:35:12.696251+0000","last_clean":"2024-09-17T01:35:12.696251+0000","last_became_active":"2024-09-17T01:35:10.665243+0000","last_became_peered":"2024-09-17T01:35:10.665243+0000","last_unstale":"2024-09-17T01:35:12.696251+0000","last_undegraded":"2024-09-17T01:35:12.696251+0000","last_fullsized":"2024-09-17T01:35:12.696251+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:57.645499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696995+0000","last_change":"2024-09-17T01:35:11.684591+0000","last_active":"2024-09-17T01:35:12.696995+0000","last_peered":"2024-09-17T01:35:12.696995+0000","last_clean":"2024-09-17T01:35:12.696995+0000","last_became_active":"2024-09-17T01:35:11.681538+0000","last_became_peered":"2024-09-17T01:35:11.681538+0000","last_unstale":"2024-09-17T01:35:12.696995+0000","last_undegraded":"2024-09-17T01:35:12.696995+0000","last_fullsized":"2024-09-17T01:35:12.696995+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:56.992382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"49'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.695895+0000","last_change":"2024-09-17T01:35:10.679073+0000","last_active":"2024-09-17T01:35:12.695895+0000","last_peered":"2024-09-17T01:35:12.695895+0000","last_clean":"2024-09-17T01:35:12.695895+0000","last_became_active":"2024-09-17T01:35:10.678723+0000","last_became_peered":"2024-09-17T01:35:10.678723+0000","last_unstale":"2024-09-17T01:35:12.695895+0000","last_undegraded":"2024-09-17T01:35:12.695895+0000","last_fullsized":"2024-09-17T01:35:12.695895+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:38.851484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667634+0000","last_change":"2024-09-17T01:35:11.667624+0000","last_active":"2024-09-17T01:35:12.667634+0000","last_peered":"2024-09-17T01:35:12.667634+0000","last_clean":"2024-09-17T01:35:12.667634+0000","last_became_active":"2024-09-17T01:35:11.667288+0000","last_became_peered":"2024-09-17T01:35:11.667288+0000","last_unstale":"2024-09-17T01:35:12.667634+0000","last_undegraded":"2024-09-17T01:35:12.667634+0000","last_fullsized":"2024-09-17T01:35:12.667634+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:26.724398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166719+0000","last_change":"2024-09-17T01:35:10.681971+0000","last_active":"2024-09-17T01:35:13.166719+0000","last_peered":"2024-09-17T01:35:13.166719+0000","last_clean":"2024-09-17T01:35:13.166719+0000","last_became_active":"2024-09-17T01:35:10.681433+0000","last_became_peered":"2024-09-17T01:35:10.681433+0000","last_unstale":"2024-09-17T01:35:13.166719+0000","last_undegraded":"2024-09-17T01:35:13.166719+0000","last_fullsized":"2024-09-17T01:35:13.166719+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:16.135683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696950+0000","last_change":"2024-09-17T01:35:11.678557+0000","last_active":"2024-09-17T01:35:12.696950+0000","last_peered":"2024-09-17T01:35:12.696950+0000","last_clean":"2024-09-17T01:35:12.696950+0000","last_became_active":"2024-09-17T01:35:11.678094+0000","last_became_peered":"2024-09-17T01:35:11.678094+0000","last_unstale":"2024-09-17T01:35:12.696950+0000","last_undegraded":"2024-09-17T01:35:12.696950+0000","last_fullsized":"2024-09-17T01:35:12.696950+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:08.579234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.167004+0000","last_change":"2024-09-17T01:35:10.678632+0000","last_active":"2024-09-17T01:35:13.167004+0000","last_peered":"2024-09-17T01:35:13.167004+0000","last_clean":"2024-09-17T01:35:13.167004+0000","last_became_active":"2024-09-17T01:35:10.678323+0000","last_became_peered":"2024-09-17T01:35:10.678323+0000","last_unstale":"2024-09-17T01:35:13.167004+0000","last_undegraded":"2024-09-17T01:35:13.167004+0000","last_fullsized":"2024-09-17T01:35:13.167004+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:14.905269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667429+0000","last_change":"2024-09-17T01:35:11.678900+0000","last_active":"2024-09-17T01:35:12.667429+0000","last_peered":"2024-09-17T01:35:12.667429+0000","last_clean":"2024-09-17T01:35:12.667429+0000","last_became_active":"2024-09-17T01:35:11.676137+0000","last_became_peered":"2024-09-17T01:35:11.676137+0000","last_unstale":"2024-09-17T01:35:12.667429+0000","last_undegraded":"2024-09-17T01:35:12.667429+0000","last_fullsized":"2024-09-17T01:35:12.667429+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:54.371997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166734+0000","last_change":"2024-09-17T01:35:10.680728+0000","last_active":"2024-09-17T01:35:13.166734+0000","last_peered":"2024-09-17T01:35:13.166734+0000","last_clean":"2024-09-17T01:35:13.166734+0000","last_became_active":"2024-09-17T01:35:10.680427+0000","last_became_peered":"2024-09-17T01:35:10.680427+0000","last_unstale":"2024-09-17T01:35:13.166734+0000","last_undegraded":"2024-09-17T01:35:13.166734+0000","last_fullsized":"2024-09-17T01:35:13.166734+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:29.304564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693363+0000","last_change":"2024-09-17T01:35:11.683785+0000","last_active":"2024-09-17T01:35:12.693363+0000","last_peered":"2024-09-17T01:35:12.693363+0000","last_clean":"2024-09-17T01:35:12.693363+0000","last_became_active":"2024-09-17T01:35:11.683033+0000","last_became_peered":"2024-09-17T01:35:11.683033+0000","last_unstale":"2024-09-17T01:35:12.693363+0000","last_undegraded":"2024-09-17T01:35:12.693363+0000","last_fullsized":"2024-09-17T01:35:12.693363+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:49.124332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696736+0000","last_change":"2024-09-17T01:35:10.673488+0000","last_active":"2024-09-17T01:35:12.696736+0000","last_peered":"2024-09-17T01:35:12.696736+0000","last_clean":"2024-09-17T01:35:12.696736+0000","last_became_active":"2024-09-17T01:35:10.672037+0000","last_became_peered":"2024-09-17T01:35:10.672037+0000","last_unstale":"2024-09-17T01:35:12.696736+0000","last_undegraded":"2024-09-17T01:35:12.696736+0000","last_fullsized":"2024-09-17T01:35:12.696736+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:22.555314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665401+0000","last_change":"2024-09-17T01:35:11.680098+0000","last_active":"2024-09-17T01:35:12.665401+0000","last_peered":"2024-09-17T01:35:12.665401+0000","last_clean":"2024-09-17T01:35:12.665401+0000","last_became_active":"2024-09-17T01:35:11.679805+0000","last_became_peered":"2024-09-17T01:35:11.679805+0000","last_unstale":"2024-09-17T01:35:12.665401+0000","last_undegraded":"2024-09-17T01:35:12.665401+0000","last_fullsized":"2024-09-17T01:35:12.665401+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:05.444230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667129+0000","last_change":"2024-09-17T01:35:10.668738+0000","last_active":"2024-09-17T01:35:12.667129+0000","last_peered":"2024-09-17T01:35:12.667129+0000","last_clean":"2024-09-17T01:35:12.667129+0000","last_became_active":"2024-09-17T01:35:10.668414+0000","last_became_peered":"2024-09-17T01:35:10.668414+0000","last_unstale":"2024-09-17T01:35:12.667129+0000","last_undegraded":"2024-09-17T01:35:12.667129+0000","last_fullsized":"2024-09-17T01:35:12.667129+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:05:45.762431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:35:10.641797+0000","last_change":"2024-09-17T01:35:10.641797+0000","last_active":"2024-09-17T01:35:10.641797+0000","last_peered":"2024-09-17T01:35:10.641797+0000","last_clean":"2024-09-17T01:35:10.641797+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:35:10.641797+0000","last_undegraded":"2024-09-17T01:35:10.641797+0000","last_fullsized":"2024-09-17T01:35:10.641797+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166762+0000","last_change":"2024-09-17T01:35:10.676420+0000","last_active":"2024-09-17T01:35:13.166762+0000","last_peered":"2024-09-17T01:35:13.166762+0000","last_clean":"2024-09-17T01:35:13.166762+0000","last_became_active":"2024-09-17T01:35:10.676110+0000","last_became_peered":"2024-09-17T01:35:10.676110+0000","last_unstale":"2024-09-17T01:35:13.166762+0000","last_undegraded":"2024-09-17T01:35:13.166762+0000","last_fullsized":"2024-09-17T01:35:13.166762+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:31.612370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693943+0000","last_change":"2024-09-17T01:35:11.680053+0000","last_active":"2024-09-17T01:35:12.693943+0000","last_peered":"2024-09-17T01:35:12.693943+0000","last_clean":"2024-09-17T01:35:12.693943+0000","last_became_active":"2024-09-17T01:35:11.679222+0000","last_became_peered":"2024-09-17T01:35:11.679222+0000","last_unstale":"2024-09-17T01:35:12.693943+0000","last_undegraded":"2024-09-17T01:35:12.693943+0000","last_fullsized":"2024-09-17T01:35:12.693943+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:24.543661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696895+0000","last_change":"2024-09-17T01:35:10.676225+0000","last_active":"2024-09-17T01:35:12.696895+0000","last_peered":"2024-09-17T01:35:12.696895+0000","last_clean":"2024-09-17T01:35:12.696895+0000","last_became_active":"2024-09-17T01:35:10.675871+0000","last_became_peered":"2024-09-17T01:35:10.675871+0000","last_unstale":"2024-09-17T01:35:12.696895+0000","last_undegraded":"2024-09-17T01:35:12.696895+0000","last_fullsized":"2024-09-17T01:35:12.696895+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:10.491485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":161,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665290+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:35:12.665290+0000","last_peered":"2024-09-17T01:35:12.665290+0000","last_clean":"2024-09-17T01:35:12.665290+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:35:12.665290+0000","last_undegraded":"2024-09-17T01:35:12.665290+0000","last_fullsized":"2024-09-17T01:35:12.665290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":110,"acting":110,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2320,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476779,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40028,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331812,"statfs":{"total":96636764160,"available":96595775488,"internally_reserved":0,"allocated":532480,"data_stored":214329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35908,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335932,"statfs":{"total":96636764160,"available":96599994368,"internally_reserved":0,"allocated":573440,"data_stored":233713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509482,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40072,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331768,"statfs":{"total":96636764160,"available":96595730432,"internally_reserved":0,"allocated":577536,"data_stored":234295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509483,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40084,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331756,"statfs":{"total":96636764160,"available":96595718144,"internally_reserved":0,"allocated":589824,"data_stored":235383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509483,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44244,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327596,"statfs":{"total":96636764160,"available":96591458304,"internally_reserved":0,"allocated":581632,"data_stored":235291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509482,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40648,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331192,"statfs":{"total":96636764160,"available":96595140608,"internally_reserved":0,"allocated":1167360,"data_stored":824117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509484,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35916,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335924,"statfs":{"total":96636764160,"available":96599986176,"internally_reserved":0,"allocated":577536,"data_stored":234351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542188,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40652,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331188,"statfs":{"total":96636764160,"available":96595136512,"internally_reserved":0,"allocated":1167360,"data_stored":824069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:35:16.673 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:35:16.838 INFO:tasks.ceph.mds.c.smithi042.stderr:2024-09-17T01:35:16.840+0000 7f1955c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:35:16.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.937+0000 7f67bca00640 1 -- 172.21.15.42:0/3243627473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67b8162520 msgr2=0x7f67b80cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:16.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.937+0000 7f67bca00640 1 --2- 172.21.15.42:0/3243627473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67b8162520 0x7f67b80cf840 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f67a0005fd0 tx=0x7f67a002a540 comp rx=0 tx=0).stop 2024-09-17T01:35:16.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.937+0000 7f67bca00640 1 -- 172.21.15.42:0/3243627473 shutdown_connections 2024-09-17T01:35:16.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.937+0000 7f67bca00640 1 --2- 172.21.15.42:0/3243627473 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f67b80cfd80 0x7f67b80d2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:16.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.937+0000 7f67bca00640 1 --2- 172.21.15.42:0/3243627473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67b8162520 0x7f67b80cf840 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:16.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.937+0000 7f67bca00640 1 -- 172.21.15.42:0/3243627473 >> 172.21.15.42:0/3243627473 conn(0x7f67b8073f20 msgr2=0x7f67b806cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:16.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.938+0000 7f67bca00640 1 -- 172.21.15.42:0/3243627473 shutdown_connections 2024-09-17T01:35:16.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.938+0000 7f67bca00640 1 -- 172.21.15.42:0/3243627473 wait complete. 2024-09-17T01:35:16.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.940+0000 7f67bca00640 1 Processor -- start 2024-09-17T01:35:16.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.940+0000 7f67bca00640 1 -- start start 2024-09-17T01:35:16.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.941+0000 7f67bca00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b80cfd80 0x7f67b8155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:16.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.941+0000 7f67bca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67b815fbe0 0x7f67b80b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:16.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.941+0000 7f67bca00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f67b8162520 0x7f67b80c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:16.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.941+0000 7f67bca00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f67b80d0d00 con 0x7f67b815fbe0 2024-09-17T01:35:16.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.941+0000 7f67bca00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f67b80d3900 con 0x7f67b80cfd80 2024-09-17T01:35:16.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.941+0000 7f67bca00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f67b80d0e80 con 0x7f67b8162520 2024-09-17T01:35:16.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.942+0000 7f67afe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67b815fbe0 0x7f67b80b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:16.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.942+0000 7f67afe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67b815fbe0 0x7f67b80b57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52782/0 (socket says 172.21.15.42:52782) 2024-09-17T01:35:16.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.942+0000 7f67afe00640 1 -- 172.21.15.42:0/2132272917 learned_addr learned my addr 172.21.15.42:0/2132272917 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:16.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.942+0000 7f67b7200640 1 --2- 172.21.15.42:0/2132272917 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f67b8162520 0x7f67b80c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:16.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.942+0000 7f67b6800640 1 --2- 172.21.15.42:0/2132272917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b80cfd80 0x7f67b8155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:16.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.942+0000 7f67afe00640 1 -- 172.21.15.42:0/2132272917 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f67b8162520 msgr2=0x7f67b80c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:16.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.942+0000 7f67afe00640 1 --2- 172.21.15.42:0/2132272917 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f67b8162520 0x7f67b80c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:16.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.942+0000 7f67afe00640 1 -- 172.21.15.42:0/2132272917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b80cfd80 msgr2=0x7f67b8155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:16.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.942+0000 7f67afe00640 1 --2- 172.21.15.42:0/2132272917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b80cfd80 0x7f67b8155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:16.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.942+0000 7f67afe00640 1 -- 172.21.15.42:0/2132272917 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b80cabd0 con 0x7f67b815fbe0 2024-09-17T01:35:16.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.942+0000 7f67afe00640 1 --2- 172.21.15.42:0/2132272917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67b815fbe0 0x7f67b80b57d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f67a0034040 tx=0x7f67a0003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:16.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.943+0000 7f67aea00640 1 -- 172.21.15.42:0/2132272917 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a003e030 con 0x7f67b815fbe0 2024-09-17T01:35:16.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.943+0000 7f67aea00640 1 -- 172.21.15.42:0/2132272917 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67a0003e00 con 0x7f67b815fbe0 2024-09-17T01:35:16.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.943+0000 7f67bca00640 1 -- 172.21.15.42:0/2132272917 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b80caeb0 con 0x7f67b815fbe0 2024-09-17T01:35:16.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.943+0000 7f67aea00640 1 -- 172.21.15.42:0/2132272917 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a0035040 con 0x7f67b815fbe0 2024-09-17T01:35:16.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.943+0000 7f67bca00640 1 -- 172.21.15.42:0/2132272917 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b80b52b0 con 0x7f67b815fbe0 2024-09-17T01:35:16.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.944+0000 7f67bca00640 1 -- 172.21.15.42:0/2132272917 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67b80d13a0 con 0x7f67b815fbe0 2024-09-17T01:35:16.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.945+0000 7f67aea00640 1 -- 172.21.15.42:0/2132272917 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f67a0041030 con 0x7f67b815fbe0 2024-09-17T01:35:16.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.946+0000 7f67aea00640 1 --2- 172.21.15.42:0/2132272917 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6794078bc0 0x7f679407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:16.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.946+0000 7f67aea00640 1 -- 172.21.15.42:0/2132272917 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f67a00bb590 con 0x7f67b815fbe0 2024-09-17T01:35:16.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.947+0000 7f67b6800640 1 --2- 172.21.15.42:0/2132272917 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6794078bc0 0x7f679407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:16.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.947+0000 7f67b6800640 1 --2- 172.21.15.42:0/2132272917 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6794078bc0 0x7f679407b0d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f67a8007fd0 tx=0x7f67a8009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:16.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:16.951+0000 7f67aea00640 1 -- 172.21.15.42:0/2132272917 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f67a00839c0 con 0x7f67b815fbe0 2024-09-17T01:35:17.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.145+0000 7f67bca00640 1 -- 172.21.15.42:0/2132272917 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f67b80b3440 con 0x7f6794078bc0 2024-09-17T01:35:17.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.150+0000 7f67aea00640 1 -- 172.21.15.42:0/2132272917 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7f67b80b3440 con 0x7f6794078bc0 2024-09-17T01:35:17.153 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:35:17.155 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:35:17.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.154+0000 7f67bca00640 1 -- 172.21.15.42:0/2132272917 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6794078bc0 msgr2=0x7f679407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:17.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.154+0000 7f67bca00640 1 --2- 172.21.15.42:0/2132272917 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6794078bc0 0x7f679407b0d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f67a8007fd0 tx=0x7f67a8009040 comp rx=0 tx=0).stop 2024-09-17T01:35:17.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.154+0000 7f67bca00640 1 -- 172.21.15.42:0/2132272917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67b815fbe0 msgr2=0x7f67b80b57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:17.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.154+0000 7f67bca00640 1 --2- 172.21.15.42:0/2132272917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67b815fbe0 0x7f67b80b57d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f67a0034040 tx=0x7f67a0003910 comp rx=0 tx=0).stop 2024-09-17T01:35:17.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.154+0000 7f67bca00640 1 -- 172.21.15.42:0/2132272917 shutdown_connections 2024-09-17T01:35:17.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.154+0000 7f67bca00640 1 --2- 172.21.15.42:0/2132272917 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6794078bc0 0x7f679407b0d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:17.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.154+0000 7f67bca00640 1 --2- 172.21.15.42:0/2132272917 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f67b8162520 0x7f67b80c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:17.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.155+0000 7f67bca00640 1 --2- 172.21.15.42:0/2132272917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67b815fbe0 0x7f67b80b57d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:17.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.155+0000 7f67bca00640 1 --2- 172.21.15.42:0/2132272917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67b80cfd80 0x7f67b8155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:17.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.155+0000 7f67bca00640 1 -- 172.21.15.42:0/2132272917 >> 172.21.15.42:0/2132272917 conn(0x7f67b8073f20 msgr2=0x7f67b815c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:17.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.155+0000 7f67bca00640 1 -- 172.21.15.42:0/2132272917 shutdown_connections 2024-09-17T01:35:17.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.155+0000 7f67bca00640 1 -- 172.21.15.42:0/2132272917 wait complete. 2024-09-17T01:35:17.178 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-09-17T01:35:17.029153+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":317592,"kb_used_data":5672,"kb_used_omap":12,"kb_used_meta":311731,"kb_avail":754657128,"statfs":{"total":773094113280,"available":772768899072,"internally_reserved":0,"allocated":5808128,"data_stored":3054988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":319213108},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.377258"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166861+0000","last_change":"2024-09-17T01:35:11.679886+0000","last_active":"2024-09-17T01:35:13.166861+0000","last_peered":"2024-09-17T01:35:13.166861+0000","last_clean":"2024-09-17T01:35:13.166861+0000","last_became_active":"2024-09-17T01:35:11.679571+0000","last_became_peered":"2024-09-17T01:35:11.679571+0000","last_unstale":"2024-09-17T01:35:13.166861+0000","last_undegraded":"2024-09-17T01:35:13.166861+0000","last_fullsized":"2024-09-17T01:35:13.166861+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:35:44.406490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.798095+0000","last_change":"2024-09-17T01:35:11.669384+0000","last_active":"2024-09-17T01:35:12.798095+0000","last_peered":"2024-09-17T01:35:12.798095+0000","last_clean":"2024-09-17T01:35:12.798095+0000","last_became_active":"2024-09-17T01:35:11.668632+0000","last_became_peered":"2024-09-17T01:35:11.668632+0000","last_unstale":"2024-09-17T01:35:12.798095+0000","last_undegraded":"2024-09-17T01:35:12.798095+0000","last_fullsized":"2024-09-17T01:35:12.798095+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:38.661375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665916+0000","last_change":"2024-09-17T01:35:11.677052+0000","last_active":"2024-09-17T01:35:12.665916+0000","last_peered":"2024-09-17T01:35:12.665916+0000","last_clean":"2024-09-17T01:35:12.665916+0000","last_became_active":"2024-09-17T01:35:11.676449+0000","last_became_peered":"2024-09-17T01:35:11.676449+0000","last_unstale":"2024-09-17T01:35:12.665916+0000","last_undegraded":"2024-09-17T01:35:12.665916+0000","last_fullsized":"2024-09-17T01:35:12.665916+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:02.322600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693381+0000","last_change":"2024-09-17T01:35:11.689284+0000","last_active":"2024-09-17T01:35:12.693381+0000","last_peered":"2024-09-17T01:35:12.693381+0000","last_clean":"2024-09-17T01:35:12.693381+0000","last_became_active":"2024-09-17T01:35:11.688877+0000","last_became_peered":"2024-09-17T01:35:11.688877+0000","last_unstale":"2024-09-17T01:35:12.693381+0000","last_undegraded":"2024-09-17T01:35:12.693381+0000","last_fullsized":"2024-09-17T01:35:12.693381+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:50.547621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166637+0000","last_change":"2024-09-17T01:35:11.686633+0000","last_active":"2024-09-17T01:35:13.166637+0000","last_peered":"2024-09-17T01:35:13.166637+0000","last_clean":"2024-09-17T01:35:13.166637+0000","last_became_active":"2024-09-17T01:35:11.684636+0000","last_became_peered":"2024-09-17T01:35:11.684636+0000","last_unstale":"2024-09-17T01:35:13.166637+0000","last_undegraded":"2024-09-17T01:35:13.166637+0000","last_fullsized":"2024-09-17T01:35:13.166637+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:17.721407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668732+0000","last_change":"2024-09-17T01:35:11.681613+0000","last_active":"2024-09-17T01:35:12.668732+0000","last_peered":"2024-09-17T01:35:12.668732+0000","last_clean":"2024-09-17T01:35:12.668732+0000","last_became_active":"2024-09-17T01:35:11.681218+0000","last_became_peered":"2024-09-17T01:35:11.681218+0000","last_unstale":"2024-09-17T01:35:12.668732+0000","last_undegraded":"2024-09-17T01:35:12.668732+0000","last_fullsized":"2024-09-17T01:35:12.668732+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:49.882671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696431+0000","last_change":"2024-09-17T01:35:11.680337+0000","last_active":"2024-09-17T01:35:12.696431+0000","last_peered":"2024-09-17T01:35:12.696431+0000","last_clean":"2024-09-17T01:35:12.696431+0000","last_became_active":"2024-09-17T01:35:11.680026+0000","last_became_peered":"2024-09-17T01:35:11.680026+0000","last_unstale":"2024-09-17T01:35:12.696431+0000","last_undegraded":"2024-09-17T01:35:12.696431+0000","last_fullsized":"2024-09-17T01:35:12.696431+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:05:04.721108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693368+0000","last_change":"2024-09-17T01:35:11.675558+0000","last_active":"2024-09-17T01:35:12.693368+0000","last_peered":"2024-09-17T01:35:12.693368+0000","last_clean":"2024-09-17T01:35:12.693368+0000","last_became_active":"2024-09-17T01:35:11.675027+0000","last_became_peered":"2024-09-17T01:35:11.675027+0000","last_unstale":"2024-09-17T01:35:12.693368+0000","last_undegraded":"2024-09-17T01:35:12.693368+0000","last_fullsized":"2024-09-17T01:35:12.693368+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:41.955029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668628+0000","last_change":"2024-09-17T01:35:11.686595+0000","last_active":"2024-09-17T01:35:12.668628+0000","last_peered":"2024-09-17T01:35:12.668628+0000","last_clean":"2024-09-17T01:35:12.668628+0000","last_became_active":"2024-09-17T01:35:11.686231+0000","last_became_peered":"2024-09-17T01:35:11.686231+0000","last_unstale":"2024-09-17T01:35:12.668628+0000","last_undegraded":"2024-09-17T01:35:12.668628+0000","last_fullsized":"2024-09-17T01:35:12.668628+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:08.753759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668301+0000","last_change":"2024-09-17T01:35:11.667098+0000","last_active":"2024-09-17T01:35:12.668301+0000","last_peered":"2024-09-17T01:35:12.668301+0000","last_clean":"2024-09-17T01:35:12.668301+0000","last_became_active":"2024-09-17T01:35:11.666559+0000","last_became_peered":"2024-09-17T01:35:11.666559+0000","last_unstale":"2024-09-17T01:35:12.668301+0000","last_undegraded":"2024-09-17T01:35:12.668301+0000","last_fullsized":"2024-09-17T01:35:12.668301+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:08.755783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693835+0000","last_change":"2024-09-17T01:35:11.691137+0000","last_active":"2024-09-17T01:35:12.693835+0000","last_peered":"2024-09-17T01:35:12.693835+0000","last_clean":"2024-09-17T01:35:12.693835+0000","last_became_active":"2024-09-17T01:35:11.690602+0000","last_became_peered":"2024-09-17T01:35:11.690602+0000","last_unstale":"2024-09-17T01:35:12.693835+0000","last_undegraded":"2024-09-17T01:35:12.693835+0000","last_fullsized":"2024-09-17T01:35:12.693835+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:38.506225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.798281+0000","last_change":"2024-09-17T01:35:11.669729+0000","last_active":"2024-09-17T01:35:12.798281+0000","last_peered":"2024-09-17T01:35:12.798281+0000","last_clean":"2024-09-17T01:35:12.798281+0000","last_became_active":"2024-09-17T01:35:11.669057+0000","last_became_peered":"2024-09-17T01:35:11.669057+0000","last_unstale":"2024-09-17T01:35:12.798281+0000","last_undegraded":"2024-09-17T01:35:12.798281+0000","last_fullsized":"2024-09-17T01:35:12.798281+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:40.883493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668910+0000","last_change":"2024-09-17T01:35:11.682294+0000","last_active":"2024-09-17T01:35:12.668910+0000","last_peered":"2024-09-17T01:35:12.668910+0000","last_clean":"2024-09-17T01:35:12.668910+0000","last_became_active":"2024-09-17T01:35:11.681948+0000","last_became_peered":"2024-09-17T01:35:11.681948+0000","last_unstale":"2024-09-17T01:35:12.668910+0000","last_undegraded":"2024-09-17T01:35:12.668910+0000","last_fullsized":"2024-09-17T01:35:12.668910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:51.076106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693756+0000","last_change":"2024-09-17T01:35:11.684238+0000","last_active":"2024-09-17T01:35:12.693756+0000","last_peered":"2024-09-17T01:35:12.693756+0000","last_clean":"2024-09-17T01:35:12.693756+0000","last_became_active":"2024-09-17T01:35:11.683881+0000","last_became_peered":"2024-09-17T01:35:11.683881+0000","last_unstale":"2024-09-17T01:35:12.693756+0000","last_undegraded":"2024-09-17T01:35:12.693756+0000","last_fullsized":"2024-09-17T01:35:12.693756+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:08.054097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693215+0000","last_change":"2024-09-17T01:35:11.675869+0000","last_active":"2024-09-17T01:35:12.693215+0000","last_peered":"2024-09-17T01:35:12.693215+0000","last_clean":"2024-09-17T01:35:12.693215+0000","last_became_active":"2024-09-17T01:35:11.675515+0000","last_became_peered":"2024-09-17T01:35:11.675515+0000","last_unstale":"2024-09-17T01:35:12.693215+0000","last_undegraded":"2024-09-17T01:35:12.693215+0000","last_fullsized":"2024-09-17T01:35:12.693215+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:19.830835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166406+0000","last_change":"2024-09-17T01:35:11.682552+0000","last_active":"2024-09-17T01:35:13.166406+0000","last_peered":"2024-09-17T01:35:13.166406+0000","last_clean":"2024-09-17T01:35:13.166406+0000","last_became_active":"2024-09-17T01:35:11.680943+0000","last_became_peered":"2024-09-17T01:35:11.680943+0000","last_unstale":"2024-09-17T01:35:13.166406+0000","last_undegraded":"2024-09-17T01:35:13.166406+0000","last_fullsized":"2024-09-17T01:35:13.166406+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:44:50.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.798152+0000","last_change":"2024-09-17T01:35:11.685292+0000","last_active":"2024-09-17T01:35:12.798152+0000","last_peered":"2024-09-17T01:35:12.798152+0000","last_clean":"2024-09-17T01:35:12.798152+0000","last_became_active":"2024-09-17T01:35:11.684950+0000","last_became_peered":"2024-09-17T01:35:11.684950+0000","last_unstale":"2024-09-17T01:35:12.798152+0000","last_undegraded":"2024-09-17T01:35:12.798152+0000","last_fullsized":"2024-09-17T01:35:12.798152+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:16.816739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666193+0000","last_change":"2024-09-17T01:35:11.685570+0000","last_active":"2024-09-17T01:35:12.666193+0000","last_peered":"2024-09-17T01:35:12.666193+0000","last_clean":"2024-09-17T01:35:12.666193+0000","last_became_active":"2024-09-17T01:35:11.685257+0000","last_became_peered":"2024-09-17T01:35:11.685257+0000","last_unstale":"2024-09-17T01:35:12.666193+0000","last_undegraded":"2024-09-17T01:35:12.666193+0000","last_fullsized":"2024-09-17T01:35:12.666193+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:30.801288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166734+0000","last_change":"2024-09-17T01:35:11.690839+0000","last_active":"2024-09-17T01:35:13.166734+0000","last_peered":"2024-09-17T01:35:13.166734+0000","last_clean":"2024-09-17T01:35:13.166734+0000","last_became_active":"2024-09-17T01:35:11.690498+0000","last_became_peered":"2024-09-17T01:35:11.690498+0000","last_unstale":"2024-09-17T01:35:13.166734+0000","last_undegraded":"2024-09-17T01:35:13.166734+0000","last_fullsized":"2024-09-17T01:35:13.166734+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:11.517652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667435+0000","last_change":"2024-09-17T01:35:11.669110+0000","last_active":"2024-09-17T01:35:12.667435+0000","last_peered":"2024-09-17T01:35:12.667435+0000","last_clean":"2024-09-17T01:35:12.667435+0000","last_became_active":"2024-09-17T01:35:11.668359+0000","last_became_peered":"2024-09-17T01:35:11.668359+0000","last_unstale":"2024-09-17T01:35:12.667435+0000","last_undegraded":"2024-09-17T01:35:12.667435+0000","last_fullsized":"2024-09-17T01:35:12.667435+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:07:06.732155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693613+0000","last_change":"2024-09-17T01:35:11.678510+0000","last_active":"2024-09-17T01:35:12.693613+0000","last_peered":"2024-09-17T01:35:12.693613+0000","last_clean":"2024-09-17T01:35:12.693613+0000","last_became_active":"2024-09-17T01:35:11.678067+0000","last_became_peered":"2024-09-17T01:35:11.678067+0000","last_unstale":"2024-09-17T01:35:12.693613+0000","last_undegraded":"2024-09-17T01:35:12.693613+0000","last_fullsized":"2024-09-17T01:35:12.693613+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:17.926468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166985+0000","last_change":"2024-09-17T01:35:11.675603+0000","last_active":"2024-09-17T01:35:13.166985+0000","last_peered":"2024-09-17T01:35:13.166985+0000","last_clean":"2024-09-17T01:35:13.166985+0000","last_became_active":"2024-09-17T01:35:11.675290+0000","last_became_peered":"2024-09-17T01:35:11.675290+0000","last_unstale":"2024-09-17T01:35:13.166985+0000","last_undegraded":"2024-09-17T01:35:13.166985+0000","last_fullsized":"2024-09-17T01:35:13.166985+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:04.530089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696764+0000","last_change":"2024-09-17T01:35:11.668987+0000","last_active":"2024-09-17T01:35:12.696764+0000","last_peered":"2024-09-17T01:35:12.696764+0000","last_clean":"2024-09-17T01:35:12.696764+0000","last_became_active":"2024-09-17T01:35:11.668644+0000","last_became_peered":"2024-09-17T01:35:11.668644+0000","last_unstale":"2024-09-17T01:35:12.696764+0000","last_undegraded":"2024-09-17T01:35:12.696764+0000","last_fullsized":"2024-09-17T01:35:12.696764+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:28:33.791232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.798013+0000","last_change":"2024-09-17T01:35:11.677804+0000","last_active":"2024-09-17T01:35:12.798013+0000","last_peered":"2024-09-17T01:35:12.798013+0000","last_clean":"2024-09-17T01:35:12.798013+0000","last_became_active":"2024-09-17T01:35:11.676351+0000","last_became_peered":"2024-09-17T01:35:11.676351+0000","last_unstale":"2024-09-17T01:35:12.798013+0000","last_undegraded":"2024-09-17T01:35:12.798013+0000","last_fullsized":"2024-09-17T01:35:12.798013+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:21.153437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166850+0000","last_change":"2024-09-17T01:35:11.678418+0000","last_active":"2024-09-17T01:35:13.166850+0000","last_peered":"2024-09-17T01:35:13.166850+0000","last_clean":"2024-09-17T01:35:13.166850+0000","last_became_active":"2024-09-17T01:35:11.678096+0000","last_became_peered":"2024-09-17T01:35:11.678096+0000","last_unstale":"2024-09-17T01:35:13.166850+0000","last_undegraded":"2024-09-17T01:35:13.166850+0000","last_fullsized":"2024-09-17T01:35:13.166850+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:24.131701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693997+0000","last_change":"2024-09-17T01:35:11.687021+0000","last_active":"2024-09-17T01:35:12.693997+0000","last_peered":"2024-09-17T01:35:12.693997+0000","last_clean":"2024-09-17T01:35:12.693997+0000","last_became_active":"2024-09-17T01:35:11.685533+0000","last_became_peered":"2024-09-17T01:35:11.685533+0000","last_unstale":"2024-09-17T01:35:12.693997+0000","last_undegraded":"2024-09-17T01:35:12.693997+0000","last_fullsized":"2024-09-17T01:35:12.693997+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:20.511127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696562+0000","last_change":"2024-09-17T01:35:11.673221+0000","last_active":"2024-09-17T01:35:12.696562+0000","last_peered":"2024-09-17T01:35:12.696562+0000","last_clean":"2024-09-17T01:35:12.696562+0000","last_became_active":"2024-09-17T01:35:11.670852+0000","last_became_peered":"2024-09-17T01:35:11.670852+0000","last_unstale":"2024-09-17T01:35:12.696562+0000","last_undegraded":"2024-09-17T01:35:12.696562+0000","last_fullsized":"2024-09-17T01:35:12.696562+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:40.426585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696743+0000","last_change":"2024-09-17T01:35:11.671861+0000","last_active":"2024-09-17T01:35:12.696743+0000","last_peered":"2024-09-17T01:35:12.696743+0000","last_clean":"2024-09-17T01:35:12.696743+0000","last_became_active":"2024-09-17T01:35:11.671539+0000","last_became_peered":"2024-09-17T01:35:11.671539+0000","last_unstale":"2024-09-17T01:35:12.696743+0000","last_undegraded":"2024-09-17T01:35:12.696743+0000","last_fullsized":"2024-09-17T01:35:12.696743+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:59.339611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166574+0000","last_change":"2024-09-17T01:35:11.687865+0000","last_active":"2024-09-17T01:35:13.166574+0000","last_peered":"2024-09-17T01:35:13.166574+0000","last_clean":"2024-09-17T01:35:13.166574+0000","last_became_active":"2024-09-17T01:35:11.684764+0000","last_became_peered":"2024-09-17T01:35:11.684764+0000","last_unstale":"2024-09-17T01:35:13.166574+0000","last_undegraded":"2024-09-17T01:35:13.166574+0000","last_fullsized":"2024-09-17T01:35:13.166574+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:35.323990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.797854+0000","last_change":"2024-09-17T01:35:11.670525+0000","last_active":"2024-09-17T01:35:12.797854+0000","last_peered":"2024-09-17T01:35:12.797854+0000","last_clean":"2024-09-17T01:35:12.797854+0000","last_became_active":"2024-09-17T01:35:11.669140+0000","last_became_peered":"2024-09-17T01:35:11.669140+0000","last_unstale":"2024-09-17T01:35:12.797854+0000","last_undegraded":"2024-09-17T01:35:12.797854+0000","last_fullsized":"2024-09-17T01:35:12.797854+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:36.476274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666875+0000","last_change":"2024-09-17T01:35:11.676283+0000","last_active":"2024-09-17T01:35:12.666875+0000","last_peered":"2024-09-17T01:35:12.666875+0000","last_clean":"2024-09-17T01:35:12.666875+0000","last_became_active":"2024-09-17T01:35:11.675947+0000","last_became_peered":"2024-09-17T01:35:11.675947+0000","last_unstale":"2024-09-17T01:35:12.666875+0000","last_undegraded":"2024-09-17T01:35:12.666875+0000","last_fullsized":"2024-09-17T01:35:12.666875+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:39.573816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693187+0000","last_change":"2024-09-17T01:35:11.678889+0000","last_active":"2024-09-17T01:35:12.693187+0000","last_peered":"2024-09-17T01:35:12.693187+0000","last_clean":"2024-09-17T01:35:12.693187+0000","last_became_active":"2024-09-17T01:35:11.678542+0000","last_became_peered":"2024-09-17T01:35:11.678542+0000","last_unstale":"2024-09-17T01:35:12.693187+0000","last_undegraded":"2024-09-17T01:35:12.693187+0000","last_fullsized":"2024-09-17T01:35:12.693187+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:18.255811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.167081+0000","last_change":"2024-09-17T01:35:11.670813+0000","last_active":"2024-09-17T01:35:13.167081+0000","last_peered":"2024-09-17T01:35:13.167081+0000","last_clean":"2024-09-17T01:35:13.167081+0000","last_became_active":"2024-09-17T01:35:11.670399+0000","last_became_peered":"2024-09-17T01:35:11.670399+0000","last_unstale":"2024-09-17T01:35:13.167081+0000","last_undegraded":"2024-09-17T01:35:13.167081+0000","last_fullsized":"2024-09-17T01:35:13.167081+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:51.896304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"48'4","reported_seq":19,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668630+0000","last_change":"2024-09-17T01:35:10.676051+0000","last_active":"2024-09-17T01:35:12.668630+0000","last_peered":"2024-09-17T01:35:12.668630+0000","last_clean":"2024-09-17T01:35:12.668630+0000","last_became_active":"2024-09-17T01:35:10.675678+0000","last_became_peered":"2024-09-17T01:35:10.675678+0000","last_unstale":"2024-09-17T01:35:12.668630+0000","last_undegraded":"2024-09-17T01:35:12.668630+0000","last_fullsized":"2024-09-17T01:35:12.668630+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:29.304564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166984+0000","last_change":"2024-09-17T01:35:11.688201+0000","last_active":"2024-09-17T01:35:13.166984+0000","last_peered":"2024-09-17T01:35:13.166984+0000","last_clean":"2024-09-17T01:35:13.166984+0000","last_became_active":"2024-09-17T01:35:11.684393+0000","last_became_peered":"2024-09-17T01:35:11.684393+0000","last_unstale":"2024-09-17T01:35:13.166984+0000","last_undegraded":"2024-09-17T01:35:13.166984+0000","last_fullsized":"2024-09-17T01:35:13.166984+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:36:30.634041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696918+0000","last_change":"2024-09-17T01:35:10.669339+0000","last_active":"2024-09-17T01:35:12.696918+0000","last_peered":"2024-09-17T01:35:12.696918+0000","last_clean":"2024-09-17T01:35:12.696918+0000","last_became_active":"2024-09-17T01:35:10.666719+0000","last_became_peered":"2024-09-17T01:35:10.666719+0000","last_unstale":"2024-09-17T01:35:12.696918+0000","last_undegraded":"2024-09-17T01:35:12.696918+0000","last_fullsized":"2024-09-17T01:35:12.696918+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:11.436388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.798456+0000","last_change":"2024-09-17T01:35:11.671915+0000","last_active":"2024-09-17T01:35:12.798456+0000","last_peered":"2024-09-17T01:35:12.798456+0000","last_clean":"2024-09-17T01:35:12.798456+0000","last_became_active":"2024-09-17T01:35:11.669856+0000","last_became_peered":"2024-09-17T01:35:11.669856+0000","last_unstale":"2024-09-17T01:35:12.798456+0000","last_undegraded":"2024-09-17T01:35:12.798456+0000","last_fullsized":"2024-09-17T01:35:12.798456+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:55:08.951179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668026+0000","last_change":"2024-09-17T01:35:10.682029+0000","last_active":"2024-09-17T01:35:12.668026+0000","last_peered":"2024-09-17T01:35:12.668026+0000","last_clean":"2024-09-17T01:35:12.668026+0000","last_became_active":"2024-09-17T01:35:10.681689+0000","last_became_peered":"2024-09-17T01:35:10.681689+0000","last_unstale":"2024-09-17T01:35:12.668026+0000","last_undegraded":"2024-09-17T01:35:12.668026+0000","last_fullsized":"2024-09-17T01:35:12.668026+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:10.562332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693888+0000","last_change":"2024-09-17T01:35:11.690091+0000","last_active":"2024-09-17T01:35:12.693888+0000","last_peered":"2024-09-17T01:35:12.693888+0000","last_clean":"2024-09-17T01:35:12.693888+0000","last_became_active":"2024-09-17T01:35:11.688955+0000","last_became_peered":"2024-09-17T01:35:11.688955+0000","last_unstale":"2024-09-17T01:35:12.693888+0000","last_undegraded":"2024-09-17T01:35:12.693888+0000","last_fullsized":"2024-09-17T01:35:12.693888+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:30.638574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696617+0000","last_change":"2024-09-17T01:35:10.672378+0000","last_active":"2024-09-17T01:35:12.696617+0000","last_peered":"2024-09-17T01:35:12.696617+0000","last_clean":"2024-09-17T01:35:12.696617+0000","last_became_active":"2024-09-17T01:35:10.670878+0000","last_became_peered":"2024-09-17T01:35:10.670878+0000","last_unstale":"2024-09-17T01:35:12.696617+0000","last_undegraded":"2024-09-17T01:35:12.696617+0000","last_fullsized":"2024-09-17T01:35:12.696617+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:44:02.998010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696488+0000","last_change":"2024-09-17T01:35:11.672199+0000","last_active":"2024-09-17T01:35:12.696488+0000","last_peered":"2024-09-17T01:35:12.696488+0000","last_clean":"2024-09-17T01:35:12.696488+0000","last_became_active":"2024-09-17T01:35:11.671902+0000","last_became_peered":"2024-09-17T01:35:11.671902+0000","last_unstale":"2024-09-17T01:35:12.696488+0000","last_undegraded":"2024-09-17T01:35:12.696488+0000","last_fullsized":"2024-09-17T01:35:12.696488+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:40.681886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668842+0000","last_change":"2024-09-17T01:35:10.666527+0000","last_active":"2024-09-17T01:35:12.668842+0000","last_peered":"2024-09-17T01:35:12.668842+0000","last_clean":"2024-09-17T01:35:12.668842+0000","last_became_active":"2024-09-17T01:35:10.666251+0000","last_became_peered":"2024-09-17T01:35:10.666251+0000","last_unstale":"2024-09-17T01:35:12.668842+0000","last_undegraded":"2024-09-17T01:35:12.668842+0000","last_fullsized":"2024-09-17T01:35:12.668842+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:08.974997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667219+0000","last_change":"2024-09-17T01:35:11.679799+0000","last_active":"2024-09-17T01:35:12.667219+0000","last_peered":"2024-09-17T01:35:12.667219+0000","last_clean":"2024-09-17T01:35:12.667219+0000","last_became_active":"2024-09-17T01:35:11.675735+0000","last_became_peered":"2024-09-17T01:35:11.675735+0000","last_unstale":"2024-09-17T01:35:12.667219+0000","last_undegraded":"2024-09-17T01:35:12.667219+0000","last_fullsized":"2024-09-17T01:35:12.667219+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:53.242251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696421+0000","last_change":"2024-09-17T01:35:10.683902+0000","last_active":"2024-09-17T01:35:12.696421+0000","last_peered":"2024-09-17T01:35:12.696421+0000","last_clean":"2024-09-17T01:35:12.696421+0000","last_became_active":"2024-09-17T01:35:10.683540+0000","last_became_peered":"2024-09-17T01:35:10.683540+0000","last_unstale":"2024-09-17T01:35:12.696421+0000","last_undegraded":"2024-09-17T01:35:12.696421+0000","last_fullsized":"2024-09-17T01:35:12.696421+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:14:50.086073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666898+0000","last_change":"2024-09-17T01:35:11.667959+0000","last_active":"2024-09-17T01:35:12.666898+0000","last_peered":"2024-09-17T01:35:12.666898+0000","last_clean":"2024-09-17T01:35:12.666898+0000","last_became_active":"2024-09-17T01:35:11.667618+0000","last_became_peered":"2024-09-17T01:35:11.667618+0000","last_unstale":"2024-09-17T01:35:12.666898+0000","last_undegraded":"2024-09-17T01:35:12.666898+0000","last_fullsized":"2024-09-17T01:35:12.666898+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:06.513791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166436+0000","last_change":"2024-09-17T01:35:10.683282+0000","last_active":"2024-09-17T01:35:13.166436+0000","last_peered":"2024-09-17T01:35:13.166436+0000","last_clean":"2024-09-17T01:35:13.166436+0000","last_became_active":"2024-09-17T01:35:10.682938+0000","last_became_peered":"2024-09-17T01:35:10.682938+0000","last_unstale":"2024-09-17T01:35:13.166436+0000","last_undegraded":"2024-09-17T01:35:13.166436+0000","last_fullsized":"2024-09-17T01:35:13.166436+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:31.273868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696437+0000","last_change":"2024-09-17T01:35:11.682324+0000","last_active":"2024-09-17T01:35:12.696437+0000","last_peered":"2024-09-17T01:35:12.696437+0000","last_clean":"2024-09-17T01:35:12.696437+0000","last_became_active":"2024-09-17T01:35:11.682037+0000","last_became_peered":"2024-09-17T01:35:11.682037+0000","last_unstale":"2024-09-17T01:35:12.696437+0000","last_undegraded":"2024-09-17T01:35:12.696437+0000","last_fullsized":"2024-09-17T01:35:12.696437+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:08.755783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666831+0000","last_change":"2024-09-17T01:35:10.676447+0000","last_active":"2024-09-17T01:35:12.666831+0000","last_peered":"2024-09-17T01:35:12.666831+0000","last_clean":"2024-09-17T01:35:12.666831+0000","last_became_active":"2024-09-17T01:35:10.676026+0000","last_became_peered":"2024-09-17T01:35:10.676026+0000","last_unstale":"2024-09-17T01:35:12.666831+0000","last_undegraded":"2024-09-17T01:35:12.666831+0000","last_fullsized":"2024-09-17T01:35:12.666831+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:36.004994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666229+0000","last_change":"2024-09-17T01:35:11.673386+0000","last_active":"2024-09-17T01:35:12.666229+0000","last_peered":"2024-09-17T01:35:12.666229+0000","last_clean":"2024-09-17T01:35:12.666229+0000","last_became_active":"2024-09-17T01:35:11.673001+0000","last_became_peered":"2024-09-17T01:35:11.673001+0000","last_unstale":"2024-09-17T01:35:12.666229+0000","last_undegraded":"2024-09-17T01:35:12.666229+0000","last_fullsized":"2024-09-17T01:35:12.666229+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:55.318960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665797+0000","last_change":"2024-09-17T01:35:10.669932+0000","last_active":"2024-09-17T01:35:12.665797+0000","last_peered":"2024-09-17T01:35:12.665797+0000","last_clean":"2024-09-17T01:35:12.665797+0000","last_became_active":"2024-09-17T01:35:10.669651+0000","last_became_peered":"2024-09-17T01:35:10.669651+0000","last_unstale":"2024-09-17T01:35:12.665797+0000","last_undegraded":"2024-09-17T01:35:12.665797+0000","last_fullsized":"2024-09-17T01:35:12.665797+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:55.136983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665664+0000","last_change":"2024-09-17T01:35:11.681534+0000","last_active":"2024-09-17T01:35:12.665664+0000","last_peered":"2024-09-17T01:35:12.665664+0000","last_clean":"2024-09-17T01:35:12.665664+0000","last_became_active":"2024-09-17T01:35:11.681247+0000","last_became_peered":"2024-09-17T01:35:11.681247+0000","last_unstale":"2024-09-17T01:35:12.665664+0000","last_undegraded":"2024-09-17T01:35:12.665664+0000","last_fullsized":"2024-09-17T01:35:12.665664+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:40.773263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668340+0000","last_change":"2024-09-17T01:35:10.679164+0000","last_active":"2024-09-17T01:35:12.668340+0000","last_peered":"2024-09-17T01:35:12.668340+0000","last_clean":"2024-09-17T01:35:12.668340+0000","last_became_active":"2024-09-17T01:35:10.677983+0000","last_became_peered":"2024-09-17T01:35:10.677983+0000","last_unstale":"2024-09-17T01:35:12.668340+0000","last_undegraded":"2024-09-17T01:35:12.668340+0000","last_fullsized":"2024-09-17T01:35:12.668340+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:31.801763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693799+0000","last_change":"2024-09-17T01:35:11.683421+0000","last_active":"2024-09-17T01:35:12.693799+0000","last_peered":"2024-09-17T01:35:12.693799+0000","last_clean":"2024-09-17T01:35:12.693799+0000","last_became_active":"2024-09-17T01:35:11.683075+0000","last_became_peered":"2024-09-17T01:35:11.683075+0000","last_unstale":"2024-09-17T01:35:12.693799+0000","last_undegraded":"2024-09-17T01:35:12.693799+0000","last_fullsized":"2024-09-17T01:35:12.693799+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:38.873835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"48'3","reported_seq":18,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.797908+0000","last_change":"2024-09-17T01:35:10.682143+0000","last_active":"2024-09-17T01:35:12.797908+0000","last_peered":"2024-09-17T01:35:12.797908+0000","last_clean":"2024-09-17T01:35:12.797908+0000","last_became_active":"2024-09-17T01:35:10.681743+0000","last_became_peered":"2024-09-17T01:35:10.681743+0000","last_unstale":"2024-09-17T01:35:12.797908+0000","last_undegraded":"2024-09-17T01:35:12.797908+0000","last_fullsized":"2024-09-17T01:35:12.797908+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:50.162612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696933+0000","last_change":"2024-09-17T01:35:11.678867+0000","last_active":"2024-09-17T01:35:12.696933+0000","last_peered":"2024-09-17T01:35:12.696933+0000","last_clean":"2024-09-17T01:35:12.696933+0000","last_became_active":"2024-09-17T01:35:11.678581+0000","last_became_peered":"2024-09-17T01:35:11.678581+0000","last_unstale":"2024-09-17T01:35:12.696933+0000","last_undegraded":"2024-09-17T01:35:12.696933+0000","last_fullsized":"2024-09-17T01:35:12.696933+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:30.558833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"48'6","reported_seq":21,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667586+0000","last_change":"2024-09-17T01:35:10.672677+0000","last_active":"2024-09-17T01:35:12.667586+0000","last_peered":"2024-09-17T01:35:12.667586+0000","last_clean":"2024-09-17T01:35:12.667586+0000","last_became_active":"2024-09-17T01:35:10.672338+0000","last_became_peered":"2024-09-17T01:35:10.672338+0000","last_unstale":"2024-09-17T01:35:12.667586+0000","last_undegraded":"2024-09-17T01:35:12.667586+0000","last_fullsized":"2024-09-17T01:35:12.667586+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:23.123246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665774+0000","last_change":"2024-09-17T01:35:11.675401+0000","last_active":"2024-09-17T01:35:12.665774+0000","last_peered":"2024-09-17T01:35:12.665774+0000","last_clean":"2024-09-17T01:35:12.665774+0000","last_became_active":"2024-09-17T01:35:11.674946+0000","last_became_peered":"2024-09-17T01:35:11.674946+0000","last_unstale":"2024-09-17T01:35:12.665774+0000","last_undegraded":"2024-09-17T01:35:12.665774+0000","last_fullsized":"2024-09-17T01:35:12.665774+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:16.229827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166584+0000","last_change":"2024-09-17T01:35:10.671105+0000","last_active":"2024-09-17T01:35:13.166584+0000","last_peered":"2024-09-17T01:35:13.166584+0000","last_clean":"2024-09-17T01:35:13.166584+0000","last_became_active":"2024-09-17T01:35:10.670646+0000","last_became_peered":"2024-09-17T01:35:10.670646+0000","last_unstale":"2024-09-17T01:35:13.166584+0000","last_undegraded":"2024-09-17T01:35:13.166584+0000","last_fullsized":"2024-09-17T01:35:13.166584+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:31.761461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166938+0000","last_change":"2024-09-17T01:35:11.671482+0000","last_active":"2024-09-17T01:35:13.166938+0000","last_peered":"2024-09-17T01:35:13.166938+0000","last_clean":"2024-09-17T01:35:13.166938+0000","last_became_active":"2024-09-17T01:35:11.671159+0000","last_became_peered":"2024-09-17T01:35:11.671159+0000","last_unstale":"2024-09-17T01:35:13.166938+0000","last_undegraded":"2024-09-17T01:35:13.166938+0000","last_fullsized":"2024-09-17T01:35:13.166938+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:22.007933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166393+0000","last_change":"2024-09-17T01:35:10.677803+0000","last_active":"2024-09-17T01:35:13.166393+0000","last_peered":"2024-09-17T01:35:13.166393+0000","last_clean":"2024-09-17T01:35:13.166393+0000","last_became_active":"2024-09-17T01:35:10.677510+0000","last_became_peered":"2024-09-17T01:35:10.677510+0000","last_unstale":"2024-09-17T01:35:13.166393+0000","last_undegraded":"2024-09-17T01:35:13.166393+0000","last_fullsized":"2024-09-17T01:35:13.166393+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:05:45.762431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166796+0000","last_change":"2024-09-17T01:35:11.673836+0000","last_active":"2024-09-17T01:35:13.166796+0000","last_peered":"2024-09-17T01:35:13.166796+0000","last_clean":"2024-09-17T01:35:13.166796+0000","last_became_active":"2024-09-17T01:35:11.669992+0000","last_became_peered":"2024-09-17T01:35:11.669992+0000","last_unstale":"2024-09-17T01:35:13.166796+0000","last_undegraded":"2024-09-17T01:35:13.166796+0000","last_fullsized":"2024-09-17T01:35:13.166796+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:40.901698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667026+0000","last_change":"2024-09-17T01:35:10.664520+0000","last_active":"2024-09-17T01:35:12.667026+0000","last_peered":"2024-09-17T01:35:12.667026+0000","last_clean":"2024-09-17T01:35:12.667026+0000","last_became_active":"2024-09-17T01:35:10.663413+0000","last_became_peered":"2024-09-17T01:35:10.663413+0000","last_unstale":"2024-09-17T01:35:12.667026+0000","last_undegraded":"2024-09-17T01:35:12.667026+0000","last_fullsized":"2024-09-17T01:35:12.667026+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:11.217933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.797847+0000","last_change":"2024-09-17T01:35:11.672649+0000","last_active":"2024-09-17T01:35:12.797847+0000","last_peered":"2024-09-17T01:35:12.797847+0000","last_clean":"2024-09-17T01:35:12.797847+0000","last_became_active":"2024-09-17T01:35:11.672408+0000","last_became_peered":"2024-09-17T01:35:11.672408+0000","last_unstale":"2024-09-17T01:35:12.797847+0000","last_undegraded":"2024-09-17T01:35:12.797847+0000","last_fullsized":"2024-09-17T01:35:12.797847+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:43.861115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"48'8","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668429+0000","last_change":"2024-09-17T01:35:10.668450+0000","last_active":"2024-09-17T01:35:12.668429+0000","last_peered":"2024-09-17T01:35:12.668429+0000","last_clean":"2024-09-17T01:35:12.668429+0000","last_became_active":"2024-09-17T01:35:10.668097+0000","last_became_peered":"2024-09-17T01:35:10.668097+0000","last_unstale":"2024-09-17T01:35:12.668429+0000","last_undegraded":"2024-09-17T01:35:12.668429+0000","last_fullsized":"2024-09-17T01:35:12.668429+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:52.159951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.167034+0000","last_change":"2024-09-17T01:35:11.677620+0000","last_active":"2024-09-17T01:35:13.167034+0000","last_peered":"2024-09-17T01:35:13.167034+0000","last_clean":"2024-09-17T01:35:13.167034+0000","last_became_active":"2024-09-17T01:35:11.677084+0000","last_became_peered":"2024-09-17T01:35:11.677084+0000","last_unstale":"2024-09-17T01:35:13.167034+0000","last_undegraded":"2024-09-17T01:35:13.167034+0000","last_fullsized":"2024-09-17T01:35:13.167034+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:12:39.675385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693994+0000","last_change":"2024-09-17T01:35:10.672120+0000","last_active":"2024-09-17T01:35:12.693994+0000","last_peered":"2024-09-17T01:35:12.693994+0000","last_clean":"2024-09-17T01:35:12.693994+0000","last_became_active":"2024-09-17T01:35:10.671797+0000","last_became_peered":"2024-09-17T01:35:10.671797+0000","last_unstale":"2024-09-17T01:35:12.693994+0000","last_undegraded":"2024-09-17T01:35:12.693994+0000","last_fullsized":"2024-09-17T01:35:12.693994+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:47:27.327278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.167111+0000","last_change":"2024-09-17T01:35:11.678099+0000","last_active":"2024-09-17T01:35:13.167111+0000","last_peered":"2024-09-17T01:35:13.167111+0000","last_clean":"2024-09-17T01:35:13.167111+0000","last_became_active":"2024-09-17T01:35:11.677064+0000","last_became_peered":"2024-09-17T01:35:11.677064+0000","last_unstale":"2024-09-17T01:35:13.167111+0000","last_undegraded":"2024-09-17T01:35:13.167111+0000","last_fullsized":"2024-09-17T01:35:13.167111+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:59.219211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666337+0000","last_change":"2024-09-17T01:35:10.663348+0000","last_active":"2024-09-17T01:35:12.666337+0000","last_peered":"2024-09-17T01:35:12.666337+0000","last_clean":"2024-09-17T01:35:12.666337+0000","last_became_active":"2024-09-17T01:35:10.662887+0000","last_became_peered":"2024-09-17T01:35:10.662887+0000","last_unstale":"2024-09-17T01:35:12.666337+0000","last_undegraded":"2024-09-17T01:35:12.666337+0000","last_fullsized":"2024-09-17T01:35:12.666337+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:24.816236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.798511+0000","last_change":"2024-09-17T01:35:11.679814+0000","last_active":"2024-09-17T01:35:12.798511+0000","last_peered":"2024-09-17T01:35:12.798511+0000","last_clean":"2024-09-17T01:35:12.798511+0000","last_became_active":"2024-09-17T01:35:11.679510+0000","last_became_peered":"2024-09-17T01:35:11.679510+0000","last_unstale":"2024-09-17T01:35:12.798511+0000","last_undegraded":"2024-09-17T01:35:12.798511+0000","last_fullsized":"2024-09-17T01:35:12.798511+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:21.756303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666047+0000","last_change":"2024-09-17T01:35:10.676459+0000","last_active":"2024-09-17T01:35:12.666047+0000","last_peered":"2024-09-17T01:35:12.666047+0000","last_clean":"2024-09-17T01:35:12.666047+0000","last_became_active":"2024-09-17T01:35:10.676141+0000","last_became_peered":"2024-09-17T01:35:10.676141+0000","last_unstale":"2024-09-17T01:35:12.666047+0000","last_undegraded":"2024-09-17T01:35:12.666047+0000","last_fullsized":"2024-09-17T01:35:12.666047+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:40.090233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665974+0000","last_change":"2024-09-17T01:35:11.676736+0000","last_active":"2024-09-17T01:35:12.665974+0000","last_peered":"2024-09-17T01:35:12.665974+0000","last_clean":"2024-09-17T01:35:12.665974+0000","last_became_active":"2024-09-17T01:35:11.676057+0000","last_became_peered":"2024-09-17T01:35:11.676057+0000","last_unstale":"2024-09-17T01:35:12.665974+0000","last_undegraded":"2024-09-17T01:35:12.665974+0000","last_fullsized":"2024-09-17T01:35:12.665974+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:09.879854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667410+0000","last_change":"2024-09-17T01:35:10.662974+0000","last_active":"2024-09-17T01:35:12.667410+0000","last_peered":"2024-09-17T01:35:12.667410+0000","last_clean":"2024-09-17T01:35:12.667410+0000","last_became_active":"2024-09-17T01:35:10.662581+0000","last_became_peered":"2024-09-17T01:35:10.662581+0000","last_unstale":"2024-09-17T01:35:12.667410+0000","last_undegraded":"2024-09-17T01:35:12.667410+0000","last_fullsized":"2024-09-17T01:35:12.667410+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:36.554201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667139+0000","last_change":"2024-09-17T01:35:11.681718+0000","last_active":"2024-09-17T01:35:12.667139+0000","last_peered":"2024-09-17T01:35:12.667139+0000","last_clean":"2024-09-17T01:35:12.667139+0000","last_became_active":"2024-09-17T01:35:11.681374+0000","last_became_peered":"2024-09-17T01:35:11.681374+0000","last_unstale":"2024-09-17T01:35:12.667139+0000","last_undegraded":"2024-09-17T01:35:12.667139+0000","last_fullsized":"2024-09-17T01:35:12.667139+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:45.555304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667551+0000","last_change":"2024-09-17T01:35:10.678608+0000","last_active":"2024-09-17T01:35:12.667551+0000","last_peered":"2024-09-17T01:35:12.667551+0000","last_clean":"2024-09-17T01:35:12.667551+0000","last_became_active":"2024-09-17T01:35:10.678289+0000","last_became_peered":"2024-09-17T01:35:10.678289+0000","last_unstale":"2024-09-17T01:35:12.667551+0000","last_undegraded":"2024-09-17T01:35:12.667551+0000","last_fullsized":"2024-09-17T01:35:12.667551+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:41.559466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668635+0000","last_change":"2024-09-17T01:35:11.681503+0000","last_active":"2024-09-17T01:35:12.668635+0000","last_peered":"2024-09-17T01:35:12.668635+0000","last_clean":"2024-09-17T01:35:12.668635+0000","last_became_active":"2024-09-17T01:35:11.681145+0000","last_became_peered":"2024-09-17T01:35:11.681145+0000","last_unstale":"2024-09-17T01:35:12.668635+0000","last_undegraded":"2024-09-17T01:35:12.668635+0000","last_fullsized":"2024-09-17T01:35:12.668635+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:46.719967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166440+0000","last_change":"2024-09-17T01:35:10.679163+0000","last_active":"2024-09-17T01:35:13.166440+0000","last_peered":"2024-09-17T01:35:13.166440+0000","last_clean":"2024-09-17T01:35:13.166440+0000","last_became_active":"2024-09-17T01:35:10.678887+0000","last_became_peered":"2024-09-17T01:35:10.678887+0000","last_unstale":"2024-09-17T01:35:13.166440+0000","last_undegraded":"2024-09-17T01:35:13.166440+0000","last_fullsized":"2024-09-17T01:35:13.166440+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:34:24.704092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693539+0000","last_change":"2024-09-17T01:35:11.674494+0000","last_active":"2024-09-17T01:35:12.693539+0000","last_peered":"2024-09-17T01:35:12.693539+0000","last_clean":"2024-09-17T01:35:12.693539+0000","last_became_active":"2024-09-17T01:35:11.674130+0000","last_became_peered":"2024-09-17T01:35:11.674130+0000","last_unstale":"2024-09-17T01:35:12.693539+0000","last_undegraded":"2024-09-17T01:35:12.693539+0000","last_fullsized":"2024-09-17T01:35:12.693539+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:16.826974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666489+0000","last_change":"2024-09-17T01:35:10.678454+0000","last_active":"2024-09-17T01:35:12.666489+0000","last_peered":"2024-09-17T01:35:12.666489+0000","last_clean":"2024-09-17T01:35:12.666489+0000","last_became_active":"2024-09-17T01:35:10.678074+0000","last_became_peered":"2024-09-17T01:35:10.678074+0000","last_unstale":"2024-09-17T01:35:12.666489+0000","last_undegraded":"2024-09-17T01:35:12.666489+0000","last_fullsized":"2024-09-17T01:35:12.666489+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:36:20.417566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693618+0000","last_change":"2024-09-17T01:35:11.685970+0000","last_active":"2024-09-17T01:35:12.693618+0000","last_peered":"2024-09-17T01:35:12.693618+0000","last_clean":"2024-09-17T01:35:12.693618+0000","last_became_active":"2024-09-17T01:35:11.685585+0000","last_became_peered":"2024-09-17T01:35:11.685585+0000","last_unstale":"2024-09-17T01:35:12.693618+0000","last_undegraded":"2024-09-17T01:35:12.693618+0000","last_fullsized":"2024-09-17T01:35:12.693618+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:01.388599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696251+0000","last_change":"2024-09-17T01:35:10.665577+0000","last_active":"2024-09-17T01:35:12.696251+0000","last_peered":"2024-09-17T01:35:12.696251+0000","last_clean":"2024-09-17T01:35:12.696251+0000","last_became_active":"2024-09-17T01:35:10.665243+0000","last_became_peered":"2024-09-17T01:35:10.665243+0000","last_unstale":"2024-09-17T01:35:12.696251+0000","last_undegraded":"2024-09-17T01:35:12.696251+0000","last_fullsized":"2024-09-17T01:35:12.696251+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:57.645499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696995+0000","last_change":"2024-09-17T01:35:11.684591+0000","last_active":"2024-09-17T01:35:12.696995+0000","last_peered":"2024-09-17T01:35:12.696995+0000","last_clean":"2024-09-17T01:35:12.696995+0000","last_became_active":"2024-09-17T01:35:11.681538+0000","last_became_peered":"2024-09-17T01:35:11.681538+0000","last_unstale":"2024-09-17T01:35:12.696995+0000","last_undegraded":"2024-09-17T01:35:12.696995+0000","last_fullsized":"2024-09-17T01:35:12.696995+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:56.992382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"49'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.695895+0000","last_change":"2024-09-17T01:35:10.679073+0000","last_active":"2024-09-17T01:35:12.695895+0000","last_peered":"2024-09-17T01:35:12.695895+0000","last_clean":"2024-09-17T01:35:12.695895+0000","last_became_active":"2024-09-17T01:35:10.678723+0000","last_became_peered":"2024-09-17T01:35:10.678723+0000","last_unstale":"2024-09-17T01:35:12.695895+0000","last_undegraded":"2024-09-17T01:35:12.695895+0000","last_fullsized":"2024-09-17T01:35:12.695895+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:38.851484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667634+0000","last_change":"2024-09-17T01:35:11.667624+0000","last_active":"2024-09-17T01:35:12.667634+0000","last_peered":"2024-09-17T01:35:12.667634+0000","last_clean":"2024-09-17T01:35:12.667634+0000","last_became_active":"2024-09-17T01:35:11.667288+0000","last_became_peered":"2024-09-17T01:35:11.667288+0000","last_unstale":"2024-09-17T01:35:12.667634+0000","last_undegraded":"2024-09-17T01:35:12.667634+0000","last_fullsized":"2024-09-17T01:35:12.667634+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:26.724398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166719+0000","last_change":"2024-09-17T01:35:10.681971+0000","last_active":"2024-09-17T01:35:13.166719+0000","last_peered":"2024-09-17T01:35:13.166719+0000","last_clean":"2024-09-17T01:35:13.166719+0000","last_became_active":"2024-09-17T01:35:10.681433+0000","last_became_peered":"2024-09-17T01:35:10.681433+0000","last_unstale":"2024-09-17T01:35:13.166719+0000","last_undegraded":"2024-09-17T01:35:13.166719+0000","last_fullsized":"2024-09-17T01:35:13.166719+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:16.135683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696950+0000","last_change":"2024-09-17T01:35:11.678557+0000","last_active":"2024-09-17T01:35:12.696950+0000","last_peered":"2024-09-17T01:35:12.696950+0000","last_clean":"2024-09-17T01:35:12.696950+0000","last_became_active":"2024-09-17T01:35:11.678094+0000","last_became_peered":"2024-09-17T01:35:11.678094+0000","last_unstale":"2024-09-17T01:35:12.696950+0000","last_undegraded":"2024-09-17T01:35:12.696950+0000","last_fullsized":"2024-09-17T01:35:12.696950+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:08.579234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.167004+0000","last_change":"2024-09-17T01:35:10.678632+0000","last_active":"2024-09-17T01:35:13.167004+0000","last_peered":"2024-09-17T01:35:13.167004+0000","last_clean":"2024-09-17T01:35:13.167004+0000","last_became_active":"2024-09-17T01:35:10.678323+0000","last_became_peered":"2024-09-17T01:35:10.678323+0000","last_unstale":"2024-09-17T01:35:13.167004+0000","last_undegraded":"2024-09-17T01:35:13.167004+0000","last_fullsized":"2024-09-17T01:35:13.167004+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:14.905269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667429+0000","last_change":"2024-09-17T01:35:11.678900+0000","last_active":"2024-09-17T01:35:12.667429+0000","last_peered":"2024-09-17T01:35:12.667429+0000","last_clean":"2024-09-17T01:35:12.667429+0000","last_became_active":"2024-09-17T01:35:11.676137+0000","last_became_peered":"2024-09-17T01:35:11.676137+0000","last_unstale":"2024-09-17T01:35:12.667429+0000","last_undegraded":"2024-09-17T01:35:12.667429+0000","last_fullsized":"2024-09-17T01:35:12.667429+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:54.371997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166734+0000","last_change":"2024-09-17T01:35:10.680728+0000","last_active":"2024-09-17T01:35:13.166734+0000","last_peered":"2024-09-17T01:35:13.166734+0000","last_clean":"2024-09-17T01:35:13.166734+0000","last_became_active":"2024-09-17T01:35:10.680427+0000","last_became_peered":"2024-09-17T01:35:10.680427+0000","last_unstale":"2024-09-17T01:35:13.166734+0000","last_undegraded":"2024-09-17T01:35:13.166734+0000","last_fullsized":"2024-09-17T01:35:13.166734+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:29.304564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693363+0000","last_change":"2024-09-17T01:35:11.683785+0000","last_active":"2024-09-17T01:35:12.693363+0000","last_peered":"2024-09-17T01:35:12.693363+0000","last_clean":"2024-09-17T01:35:12.693363+0000","last_became_active":"2024-09-17T01:35:11.683033+0000","last_became_peered":"2024-09-17T01:35:11.683033+0000","last_unstale":"2024-09-17T01:35:12.693363+0000","last_undegraded":"2024-09-17T01:35:12.693363+0000","last_fullsized":"2024-09-17T01:35:12.693363+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:49.124332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696736+0000","last_change":"2024-09-17T01:35:10.673488+0000","last_active":"2024-09-17T01:35:12.696736+0000","last_peered":"2024-09-17T01:35:12.696736+0000","last_clean":"2024-09-17T01:35:12.696736+0000","last_became_active":"2024-09-17T01:35:10.672037+0000","last_became_peered":"2024-09-17T01:35:10.672037+0000","last_unstale":"2024-09-17T01:35:12.696736+0000","last_undegraded":"2024-09-17T01:35:12.696736+0000","last_fullsized":"2024-09-17T01:35:12.696736+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:22.555314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665401+0000","last_change":"2024-09-17T01:35:11.680098+0000","last_active":"2024-09-17T01:35:12.665401+0000","last_peered":"2024-09-17T01:35:12.665401+0000","last_clean":"2024-09-17T01:35:12.665401+0000","last_became_active":"2024-09-17T01:35:11.679805+0000","last_became_peered":"2024-09-17T01:35:11.679805+0000","last_unstale":"2024-09-17T01:35:12.665401+0000","last_undegraded":"2024-09-17T01:35:12.665401+0000","last_fullsized":"2024-09-17T01:35:12.665401+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:05.444230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667129+0000","last_change":"2024-09-17T01:35:10.668738+0000","last_active":"2024-09-17T01:35:12.667129+0000","last_peered":"2024-09-17T01:35:12.667129+0000","last_clean":"2024-09-17T01:35:12.667129+0000","last_became_active":"2024-09-17T01:35:10.668414+0000","last_became_peered":"2024-09-17T01:35:10.668414+0000","last_unstale":"2024-09-17T01:35:12.667129+0000","last_undegraded":"2024-09-17T01:35:12.667129+0000","last_fullsized":"2024-09-17T01:35:12.667129+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:05:45.762431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.798131+0000","last_change":"2024-09-17T01:35:11.675535+0000","last_active":"2024-09-17T01:35:12.798131+0000","last_peered":"2024-09-17T01:35:12.798131+0000","last_clean":"2024-09-17T01:35:12.798131+0000","last_became_active":"2024-09-17T01:35:11.675201+0000","last_became_peered":"2024-09-17T01:35:11.675201+0000","last_unstale":"2024-09-17T01:35:12.798131+0000","last_undegraded":"2024-09-17T01:35:12.798131+0000","last_fullsized":"2024-09-17T01:35:12.798131+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:47.961294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166762+0000","last_change":"2024-09-17T01:35:10.676420+0000","last_active":"2024-09-17T01:35:13.166762+0000","last_peered":"2024-09-17T01:35:13.166762+0000","last_clean":"2024-09-17T01:35:13.166762+0000","last_became_active":"2024-09-17T01:35:10.676110+0000","last_became_peered":"2024-09-17T01:35:10.676110+0000","last_unstale":"2024-09-17T01:35:13.166762+0000","last_undegraded":"2024-09-17T01:35:13.166762+0000","last_fullsized":"2024-09-17T01:35:13.166762+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:31.612370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693943+0000","last_change":"2024-09-17T01:35:11.680053+0000","last_active":"2024-09-17T01:35:12.693943+0000","last_peered":"2024-09-17T01:35:12.693943+0000","last_clean":"2024-09-17T01:35:12.693943+0000","last_became_active":"2024-09-17T01:35:11.679222+0000","last_became_peered":"2024-09-17T01:35:11.679222+0000","last_unstale":"2024-09-17T01:35:12.693943+0000","last_undegraded":"2024-09-17T01:35:12.693943+0000","last_fullsized":"2024-09-17T01:35:12.693943+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:24.543661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696895+0000","last_change":"2024-09-17T01:35:10.676225+0000","last_active":"2024-09-17T01:35:12.696895+0000","last_peered":"2024-09-17T01:35:12.696895+0000","last_clean":"2024-09-17T01:35:12.696895+0000","last_became_active":"2024-09-17T01:35:10.675871+0000","last_became_peered":"2024-09-17T01:35:10.675871+0000","last_unstale":"2024-09-17T01:35:12.696895+0000","last_undegraded":"2024-09-17T01:35:12.696895+0000","last_fullsized":"2024-09-17T01:35:12.696895+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:10.491485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":161,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665290+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:35:12.665290+0000","last_peered":"2024-09-17T01:35:12.665290+0000","last_clean":"2024-09-17T01:35:12.665290+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:35:12.665290+0000","last_undegraded":"2024-09-17T01:35:12.665290+0000","last_fullsized":"2024-09-17T01:35:12.665290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476780,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40068,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331772,"statfs":{"total":96636764160,"available":96595734528,"internally_reserved":0,"allocated":573440,"data_stored":233769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35908,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335932,"statfs":{"total":96636764160,"available":96599994368,"internally_reserved":0,"allocated":573440,"data_stored":233713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509482,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40072,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331768,"statfs":{"total":96636764160,"available":96595730432,"internally_reserved":0,"allocated":577536,"data_stored":234295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509483,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40084,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331756,"statfs":{"total":96636764160,"available":96595718144,"internally_reserved":0,"allocated":589824,"data_stored":235383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509483,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44244,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327596,"statfs":{"total":96636764160,"available":96591458304,"internally_reserved":0,"allocated":581632,"data_stored":235291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509482,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40648,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331192,"statfs":{"total":96636764160,"available":96595140608,"internally_reserved":0,"allocated":1167360,"data_stored":824117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509484,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35916,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335924,"statfs":{"total":96636764160,"available":96599986176,"internally_reserved":0,"allocated":577536,"data_stored":234351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542188,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40652,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331188,"statfs":{"total":96636764160,"available":96595136512,"internally_reserved":0,"allocated":1167360,"data_stored":824069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:35:17.183 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:35:17.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.448+0000 7f3fd5000640 1 -- 172.21.15.42:0/1324802253 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3fd015f480 msgr2=0x7f3fd015f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:17.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.448+0000 7f3fd5000640 1 --2- 172.21.15.42:0/1324802253 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3fd015f480 0x7f3fd015f890 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8005fd0 tx=0x7f3fc802aaa0 comp rx=0 tx=0).stop 2024-09-17T01:35:17.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.449+0000 7f3fd5000640 1 -- 172.21.15.42:0/1324802253 shutdown_connections 2024-09-17T01:35:17.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.449+0000 7f3fd5000640 1 --2- 172.21.15.42:0/1324802253 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3fd015f480 0x7f3fd015f890 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:17.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.449+0000 7f3fd5000640 1 --2- 172.21.15.42:0/1324802253 >> v2:172.21.15.43:3300/0 conn(0x7f3fd015cb80 0x7f3fd0152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:17.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.449+0000 7f3fd5000640 1 -- 172.21.15.42:0/1324802253 >> 172.21.15.42:0/1324802253 conn(0x7f3fd00b2930 msgr2=0x7f3fd006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:17.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.449+0000 7f3fd5000640 1 -- 172.21.15.42:0/1324802253 shutdown_connections 2024-09-17T01:35:17.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.449+0000 7f3fd5000640 1 -- 172.21.15.42:0/1324802253 wait complete. 2024-09-17T01:35:17.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.451+0000 7f3fd5000640 1 Processor -- start 2024-09-17T01:35:17.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.451+0000 7f3fd5000640 1 -- start start 2024-09-17T01:35:17.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.452+0000 7f3fd5000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3fd006d430 0x7f3fd0150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:17.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.452+0000 7f3fd5000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fd015cb80 0x7f3fd00aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:17.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.452+0000 7f3fd5000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fd015f480 0x7f3fd0155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:17.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.452+0000 7f3fd5000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd00737e0 con 0x7f3fd015cb80 2024-09-17T01:35:17.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.452+0000 7f3fd5000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd0073660 con 0x7f3fd015f480 2024-09-17T01:35:17.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.452+0000 7f3fd5000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3fd0073960 con 0x7f3fd006d430 2024-09-17T01:35:17.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.453+0000 7f3fc7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fd015cb80 0x7f3fd00aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:17.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.453+0000 7f3fc7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fd015cb80 0x7f3fd00aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52790/0 (socket says 172.21.15.42:52790) 2024-09-17T01:35:17.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.453+0000 7f3fc7e00640 1 -- 172.21.15.42:0/3675547717 learned_addr learned my addr 172.21.15.42:0/3675547717 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:17.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.453+0000 7f3fcde00640 1 --2- 172.21.15.42:0/3675547717 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3fd006d430 0x7f3fd0150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:17.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.453+0000 7f3fce800640 1 --2- 172.21.15.42:0/3675547717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fd015f480 0x7f3fd0155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:17.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.453+0000 7f3fc7e00640 1 -- 172.21.15.42:0/3675547717 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3fd006d430 msgr2=0x7f3fd0150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:17.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.453+0000 7f3fc7e00640 1 --2- 172.21.15.42:0/3675547717 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3fd006d430 0x7f3fd0150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:17.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.453+0000 7f3fc7e00640 1 -- 172.21.15.42:0/3675547717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fd015f480 msgr2=0x7f3fd0155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:17.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.453+0000 7f3fc7e00640 1 --2- 172.21.15.42:0/3675547717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fd015f480 0x7f3fd0155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:17.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.453+0000 7f3fc7e00640 1 -- 172.21.15.42:0/3675547717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd01f7020 con 0x7f3fd015cb80 2024-09-17T01:35:17.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.454+0000 7f3fc7e00640 1 --2- 172.21.15.42:0/3675547717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fd015cb80 0x7f3fd00aebb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800c3d0 tx=0x7f3fb800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:17.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.454+0000 7f3fc6000640 1 -- 172.21.15.42:0/3675547717 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8017070 con 0x7f3fd015cb80 2024-09-17T01:35:17.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.454+0000 7f3fc6000640 1 -- 172.21.15.42:0/3675547717 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fb80053c0 con 0x7f3fd015cb80 2024-09-17T01:35:17.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.454+0000 7f3fd5000640 1 -- 172.21.15.42:0/3675547717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fd01f7290 con 0x7f3fd015cb80 2024-09-17T01:35:17.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.454+0000 7f3fc6000640 1 -- 172.21.15.42:0/3675547717 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8003850 con 0x7f3fd015cb80 2024-09-17T01:35:17.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.454+0000 7f3fd5000640 1 -- 172.21.15.42:0/3675547717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fd01f7850 con 0x7f3fd015cb80 2024-09-17T01:35:17.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.455+0000 7f3fd5000640 1 -- 172.21.15.42:0/3675547717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fd01561a0 con 0x7f3fd015cb80 2024-09-17T01:35:17.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.456+0000 7f3fc6000640 1 -- 172.21.15.42:0/3675547717 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3fb801a070 con 0x7f3fd015cb80 2024-09-17T01:35:17.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.457+0000 7f3fc6000640 1 --2- 172.21.15.42:0/3675547717 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3fac078b90 0x7f3fac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:17.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.458+0000 7f3fc6000640 1 -- 172.21.15.42:0/3675547717 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f3fb8099ff0 con 0x7f3fd015cb80 2024-09-17T01:35:17.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.458+0000 7f3fcde00640 1 --2- 172.21.15.42:0/3675547717 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3fac078b90 0x7f3fac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:17.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.459+0000 7f3fcde00640 1 --2- 172.21.15.42:0/3675547717 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3fac078b90 0x7f3fac07b0a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009b30 tx=0x7f3fc0005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:17.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.462+0000 7f3fc6000640 1 -- 172.21.15.42:0/3675547717 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3fd01561a0 con 0x7f3fd015cb80 2024-09-17T01:35:17.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.732+0000 7f3fd5000640 1 -- 172.21.15.42:0/3675547717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f3fd0073e80 con 0x7f3fd015cb80 2024-09-17T01:35:17.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.733+0000 7f3fc6000640 1 -- 172.21.15.42:0/3675547717 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1056 (secure 0 0 0) 0x7f3fd015be20 con 0x7f3fd015cb80 2024-09-17T01:35:17.731 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:35:17.731 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":218,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":49,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":325214208,"bytes_avail":772768899072,"bytes_total":773094113280,"write_bytes_sec":2247,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":28,"btime":"2024-09-17T01:35:14:681513+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5283}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2024-09-17T01:34:51.022426+0000","services":{}},"progress_events":{}} 2024-09-17T01:35:17.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.735+0000 7f3fd5000640 1 -- 172.21.15.42:0/3675547717 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3fac078b90 msgr2=0x7f3fac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:17.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.735+0000 7f3fd5000640 1 --2- 172.21.15.42:0/3675547717 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3fac078b90 0x7f3fac07b0a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009b30 tx=0x7f3fc0005f90 comp rx=0 tx=0).stop 2024-09-17T01:35:17.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.735+0000 7f3fd5000640 1 -- 172.21.15.42:0/3675547717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fd015cb80 msgr2=0x7f3fd00aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:17.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.735+0000 7f3fd5000640 1 --2- 172.21.15.42:0/3675547717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fd015cb80 0x7f3fd00aebb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800c3d0 tx=0x7f3fb800c890 comp rx=0 tx=0).stop 2024-09-17T01:35:17.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.735+0000 7f3fd5000640 1 -- 172.21.15.42:0/3675547717 shutdown_connections 2024-09-17T01:35:17.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.735+0000 7f3fd5000640 1 --2- 172.21.15.42:0/3675547717 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3fac078b90 0x7f3fac07b0a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:17.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.735+0000 7f3fd5000640 1 --2- 172.21.15.42:0/3675547717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fd015f480 0x7f3fd0155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:17.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.735+0000 7f3fd5000640 1 --2- 172.21.15.42:0/3675547717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fd015cb80 0x7f3fd00aebb0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:17.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.735+0000 7f3fd5000640 1 --2- 172.21.15.42:0/3675547717 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3fd006d430 0x7f3fd0150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:17.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.735+0000 7f3fd5000640 1 -- 172.21.15.42:0/3675547717 >> 172.21.15.42:0/3675547717 conn(0x7f3fd00b2930 msgr2=0x7f3fd0072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:17.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.735+0000 7f3fd5000640 1 -- 172.21.15.42:0/3675547717 shutdown_connections 2024-09-17T01:35:17.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.735+0000 7f3fd5000640 1 -- 172.21.15.42:0/3675547717 wait complete. 2024-09-17T01:35:17.755 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T01:35:17.755 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:35:17.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.985+0000 7f876ec00640 1 -- 172.21.15.42:0/795077800 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8750004d40 msgr2=0x7f8750005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:17.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.985+0000 7f876ec00640 1 --2- 172.21.15.42:0/795077800 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8750004d40 0x7f8750005150 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f87680b4890 tx=0x7f8750005830 comp rx=0 tx=0).stop 2024-09-17T01:35:17.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.985+0000 7f876e200640 1 -- 172.21.15.42:0/795077800 reap_dead start 2024-09-17T01:35:17.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.985+0000 7f876ec00640 1 -- 172.21.15.42:0/795077800 shutdown_connections 2024-09-17T01:35:17.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.985+0000 7f876ec00640 1 -- 172.21.15.42:0/795077800 >> 172.21.15.42:0/795077800 conn(0x7f87680b25f0 msgr2=0x7f87680d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:17.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.985+0000 7f876ec00640 1 -- 172.21.15.42:0/795077800 shutdown_connections 2024-09-17T01:35:17.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.985+0000 7f876ec00640 1 -- 172.21.15.42:0/795077800 wait complete. 2024-09-17T01:35:17.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.987+0000 7f876ec00640 1 Processor -- start 2024-09-17T01:35:17.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.987+0000 7f876ec00640 1 -- start start 2024-09-17T01:35:17.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.989+0000 7f876ec00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8750004d40 0x7f8768074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:17.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.989+0000 7f876ec00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8768150da0 0x7f876815bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:17.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.989+0000 7f876ec00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f876814ab00 0x7f876814af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:17.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.989+0000 7f876ec00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f876806d0b0 con 0x7f8768150da0 2024-09-17T01:35:17.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.989+0000 7f876ec00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f876806cf30 con 0x7f8750004d40 2024-09-17T01:35:17.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.989+0000 7f876ec00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8768153410 con 0x7f876814ab00 2024-09-17T01:35:17.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.989+0000 7f876ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8768150da0 0x7f876815bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:17.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.989+0000 7f876ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8768150da0 0x7f876815bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52808/0 (socket says 172.21.15.42:52808) 2024-09-17T01:35:17.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.989+0000 7f876ce00640 1 -- 172.21.15.42:0/3137670277 learned_addr learned my addr 172.21.15.42:0/3137670277 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:17.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.989+0000 7f876ce00640 1 -- 172.21.15.42:0/3137670277 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f876814ab00 msgr2=0x7f876814af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:17.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.989+0000 7f876ce00640 1 --2- 172.21.15.42:0/3137670277 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f876814ab00 0x7f876814af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:17.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.989+0000 7f876ce00640 1 -- 172.21.15.42:0/3137670277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8750004d40 msgr2=0x7f8768074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:17.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.989+0000 7f876ce00640 1 --2- 172.21.15.42:0/3137670277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8750004d40 0x7f8768074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:17.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.989+0000 7f876ce00640 1 -- 172.21.15.42:0/3137670277 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876814b450 con 0x7f8768150da0 2024-09-17T01:35:17.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.990+0000 7f876ce00640 1 --2- 172.21.15.42:0/3137670277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8768150da0 0x7f876815bb40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8754011ae0 tx=0x7f8754009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:17.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.990+0000 7f8765600640 1 -- 172.21.15.42:0/3137670277 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875401e070 con 0x7f8768150da0 2024-09-17T01:35:17.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.990+0000 7f8765600640 1 -- 172.21.15.42:0/3137670277 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8754004460 con 0x7f8768150da0 2024-09-17T01:35:17.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.990+0000 7f8765600640 1 -- 172.21.15.42:0/3137670277 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875400fc40 con 0x7f8768150da0 2024-09-17T01:35:17.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.990+0000 7f876ec00640 1 -- 172.21.15.42:0/3137670277 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87681f9270 con 0x7f8768150da0 2024-09-17T01:35:17.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.990+0000 7f876ec00640 1 -- 172.21.15.42:0/3137670277 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87681f9830 con 0x7f8768150da0 2024-09-17T01:35:17.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.991+0000 7f876ec00640 1 -- 172.21.15.42:0/3137670277 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8768153900 con 0x7f8768150da0 2024-09-17T01:35:17.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.992+0000 7f8765600640 1 -- 172.21.15.42:0/3137670277 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8754021070 con 0x7f8768150da0 2024-09-17T01:35:17.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.993+0000 7f8765600640 1 --2- 172.21.15.42:0/3137670277 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8748078b90 0x7f874807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:17.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.994+0000 7f8765600640 1 -- 172.21.15.42:0/3137670277 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f875409b800 con 0x7f8768150da0 2024-09-17T01:35:17.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.994+0000 7f876d800640 1 --2- 172.21.15.42:0/3137670277 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8748078b90 0x7f874807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:17.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.995+0000 7f876d800640 1 --2- 172.21.15.42:0/3137670277 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8748078b90 0x7f874807b0a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f875c0013f0 tx=0x7f875c001d40 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:17.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:17.998+0000 7f8765600640 1 -- 172.21.15.42:0/3137670277 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f876814b450 con 0x7f8768150da0 2024-09-17T01:35:18.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:18.193+0000 7f876ec00640 1 -- 172.21.15.42:0/3137670277 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8768152100 con 0x7f8748078b90 2024-09-17T01:35:18.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:18.198+0000 7f8765600640 1 -- 172.21.15.42:0/3137670277 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7f8768152100 con 0x7f8748078b90 2024-09-17T01:35:18.199 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:35:18.200 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:35:18.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:18.202+0000 7f876ec00640 1 -- 172.21.15.42:0/3137670277 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8748078b90 msgr2=0x7f874807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:18.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:18.202+0000 7f876ec00640 1 --2- 172.21.15.42:0/3137670277 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8748078b90 0x7f874807b0a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f875c0013f0 tx=0x7f875c001d40 comp rx=0 tx=0).stop 2024-09-17T01:35:18.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:18.202+0000 7f876ec00640 1 -- 172.21.15.42:0/3137670277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8768150da0 msgr2=0x7f876815bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:18.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:18.202+0000 7f876ec00640 1 --2- 172.21.15.42:0/3137670277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8768150da0 0x7f876815bb40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8754011ae0 tx=0x7f8754009e90 comp rx=0 tx=0).stop 2024-09-17T01:35:18.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:18.202+0000 7f876ec00640 1 -- 172.21.15.42:0/3137670277 shutdown_connections 2024-09-17T01:35:18.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:18.202+0000 7f876ec00640 1 --2- 172.21.15.42:0/3137670277 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8748078b90 0x7f874807b0a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:18.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:18.202+0000 7f876ec00640 1 --2- 172.21.15.42:0/3137670277 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f876814ab00 0x7f876814af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:18.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:18.202+0000 7f876ec00640 1 --2- 172.21.15.42:0/3137670277 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8768150da0 0x7f876815bb40 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:18.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:18.202+0000 7f876ec00640 1 --2- 172.21.15.42:0/3137670277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8750004d40 0x7f8768074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:18.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:18.202+0000 7f876ec00640 1 -- 172.21.15.42:0/3137670277 >> 172.21.15.42:0/3137670277 conn(0x7f87680b25f0 msgr2=0x7f87680aef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:18.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:18.202+0000 7f876ec00640 1 -- 172.21.15.42:0/3137670277 shutdown_connections 2024-09-17T01:35:18.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:18.202+0000 7f876ec00640 1 -- 172.21.15.42:0/3137670277 wait complete. 2024-09-17T01:35:18.221 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-09-17T01:35:17.029153+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":317592,"kb_used_data":5672,"kb_used_omap":12,"kb_used_meta":311731,"kb_avail":754657128,"statfs":{"total":773094113280,"available":772768899072,"internally_reserved":0,"allocated":5808128,"data_stored":3054988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":319213108},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.377258"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166861+0000","last_change":"2024-09-17T01:35:11.679886+0000","last_active":"2024-09-17T01:35:13.166861+0000","last_peered":"2024-09-17T01:35:13.166861+0000","last_clean":"2024-09-17T01:35:13.166861+0000","last_became_active":"2024-09-17T01:35:11.679571+0000","last_became_peered":"2024-09-17T01:35:11.679571+0000","last_unstale":"2024-09-17T01:35:13.166861+0000","last_undegraded":"2024-09-17T01:35:13.166861+0000","last_fullsized":"2024-09-17T01:35:13.166861+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:35:44.406490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.798095+0000","last_change":"2024-09-17T01:35:11.669384+0000","last_active":"2024-09-17T01:35:12.798095+0000","last_peered":"2024-09-17T01:35:12.798095+0000","last_clean":"2024-09-17T01:35:12.798095+0000","last_became_active":"2024-09-17T01:35:11.668632+0000","last_became_peered":"2024-09-17T01:35:11.668632+0000","last_unstale":"2024-09-17T01:35:12.798095+0000","last_undegraded":"2024-09-17T01:35:12.798095+0000","last_fullsized":"2024-09-17T01:35:12.798095+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:38.661375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665916+0000","last_change":"2024-09-17T01:35:11.677052+0000","last_active":"2024-09-17T01:35:12.665916+0000","last_peered":"2024-09-17T01:35:12.665916+0000","last_clean":"2024-09-17T01:35:12.665916+0000","last_became_active":"2024-09-17T01:35:11.676449+0000","last_became_peered":"2024-09-17T01:35:11.676449+0000","last_unstale":"2024-09-17T01:35:12.665916+0000","last_undegraded":"2024-09-17T01:35:12.665916+0000","last_fullsized":"2024-09-17T01:35:12.665916+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:02.322600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693381+0000","last_change":"2024-09-17T01:35:11.689284+0000","last_active":"2024-09-17T01:35:12.693381+0000","last_peered":"2024-09-17T01:35:12.693381+0000","last_clean":"2024-09-17T01:35:12.693381+0000","last_became_active":"2024-09-17T01:35:11.688877+0000","last_became_peered":"2024-09-17T01:35:11.688877+0000","last_unstale":"2024-09-17T01:35:12.693381+0000","last_undegraded":"2024-09-17T01:35:12.693381+0000","last_fullsized":"2024-09-17T01:35:12.693381+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:50.547621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166637+0000","last_change":"2024-09-17T01:35:11.686633+0000","last_active":"2024-09-17T01:35:13.166637+0000","last_peered":"2024-09-17T01:35:13.166637+0000","last_clean":"2024-09-17T01:35:13.166637+0000","last_became_active":"2024-09-17T01:35:11.684636+0000","last_became_peered":"2024-09-17T01:35:11.684636+0000","last_unstale":"2024-09-17T01:35:13.166637+0000","last_undegraded":"2024-09-17T01:35:13.166637+0000","last_fullsized":"2024-09-17T01:35:13.166637+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:17.721407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668732+0000","last_change":"2024-09-17T01:35:11.681613+0000","last_active":"2024-09-17T01:35:12.668732+0000","last_peered":"2024-09-17T01:35:12.668732+0000","last_clean":"2024-09-17T01:35:12.668732+0000","last_became_active":"2024-09-17T01:35:11.681218+0000","last_became_peered":"2024-09-17T01:35:11.681218+0000","last_unstale":"2024-09-17T01:35:12.668732+0000","last_undegraded":"2024-09-17T01:35:12.668732+0000","last_fullsized":"2024-09-17T01:35:12.668732+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:49.882671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696431+0000","last_change":"2024-09-17T01:35:11.680337+0000","last_active":"2024-09-17T01:35:12.696431+0000","last_peered":"2024-09-17T01:35:12.696431+0000","last_clean":"2024-09-17T01:35:12.696431+0000","last_became_active":"2024-09-17T01:35:11.680026+0000","last_became_peered":"2024-09-17T01:35:11.680026+0000","last_unstale":"2024-09-17T01:35:12.696431+0000","last_undegraded":"2024-09-17T01:35:12.696431+0000","last_fullsized":"2024-09-17T01:35:12.696431+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:05:04.721108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693368+0000","last_change":"2024-09-17T01:35:11.675558+0000","last_active":"2024-09-17T01:35:12.693368+0000","last_peered":"2024-09-17T01:35:12.693368+0000","last_clean":"2024-09-17T01:35:12.693368+0000","last_became_active":"2024-09-17T01:35:11.675027+0000","last_became_peered":"2024-09-17T01:35:11.675027+0000","last_unstale":"2024-09-17T01:35:12.693368+0000","last_undegraded":"2024-09-17T01:35:12.693368+0000","last_fullsized":"2024-09-17T01:35:12.693368+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:41.955029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668628+0000","last_change":"2024-09-17T01:35:11.686595+0000","last_active":"2024-09-17T01:35:12.668628+0000","last_peered":"2024-09-17T01:35:12.668628+0000","last_clean":"2024-09-17T01:35:12.668628+0000","last_became_active":"2024-09-17T01:35:11.686231+0000","last_became_peered":"2024-09-17T01:35:11.686231+0000","last_unstale":"2024-09-17T01:35:12.668628+0000","last_undegraded":"2024-09-17T01:35:12.668628+0000","last_fullsized":"2024-09-17T01:35:12.668628+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:08.753759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668301+0000","last_change":"2024-09-17T01:35:11.667098+0000","last_active":"2024-09-17T01:35:12.668301+0000","last_peered":"2024-09-17T01:35:12.668301+0000","last_clean":"2024-09-17T01:35:12.668301+0000","last_became_active":"2024-09-17T01:35:11.666559+0000","last_became_peered":"2024-09-17T01:35:11.666559+0000","last_unstale":"2024-09-17T01:35:12.668301+0000","last_undegraded":"2024-09-17T01:35:12.668301+0000","last_fullsized":"2024-09-17T01:35:12.668301+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:08.755783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693835+0000","last_change":"2024-09-17T01:35:11.691137+0000","last_active":"2024-09-17T01:35:12.693835+0000","last_peered":"2024-09-17T01:35:12.693835+0000","last_clean":"2024-09-17T01:35:12.693835+0000","last_became_active":"2024-09-17T01:35:11.690602+0000","last_became_peered":"2024-09-17T01:35:11.690602+0000","last_unstale":"2024-09-17T01:35:12.693835+0000","last_undegraded":"2024-09-17T01:35:12.693835+0000","last_fullsized":"2024-09-17T01:35:12.693835+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:38.506225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.798281+0000","last_change":"2024-09-17T01:35:11.669729+0000","last_active":"2024-09-17T01:35:12.798281+0000","last_peered":"2024-09-17T01:35:12.798281+0000","last_clean":"2024-09-17T01:35:12.798281+0000","last_became_active":"2024-09-17T01:35:11.669057+0000","last_became_peered":"2024-09-17T01:35:11.669057+0000","last_unstale":"2024-09-17T01:35:12.798281+0000","last_undegraded":"2024-09-17T01:35:12.798281+0000","last_fullsized":"2024-09-17T01:35:12.798281+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:40.883493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668910+0000","last_change":"2024-09-17T01:35:11.682294+0000","last_active":"2024-09-17T01:35:12.668910+0000","last_peered":"2024-09-17T01:35:12.668910+0000","last_clean":"2024-09-17T01:35:12.668910+0000","last_became_active":"2024-09-17T01:35:11.681948+0000","last_became_peered":"2024-09-17T01:35:11.681948+0000","last_unstale":"2024-09-17T01:35:12.668910+0000","last_undegraded":"2024-09-17T01:35:12.668910+0000","last_fullsized":"2024-09-17T01:35:12.668910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:51.076106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693756+0000","last_change":"2024-09-17T01:35:11.684238+0000","last_active":"2024-09-17T01:35:12.693756+0000","last_peered":"2024-09-17T01:35:12.693756+0000","last_clean":"2024-09-17T01:35:12.693756+0000","last_became_active":"2024-09-17T01:35:11.683881+0000","last_became_peered":"2024-09-17T01:35:11.683881+0000","last_unstale":"2024-09-17T01:35:12.693756+0000","last_undegraded":"2024-09-17T01:35:12.693756+0000","last_fullsized":"2024-09-17T01:35:12.693756+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:08.054097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693215+0000","last_change":"2024-09-17T01:35:11.675869+0000","last_active":"2024-09-17T01:35:12.693215+0000","last_peered":"2024-09-17T01:35:12.693215+0000","last_clean":"2024-09-17T01:35:12.693215+0000","last_became_active":"2024-09-17T01:35:11.675515+0000","last_became_peered":"2024-09-17T01:35:11.675515+0000","last_unstale":"2024-09-17T01:35:12.693215+0000","last_undegraded":"2024-09-17T01:35:12.693215+0000","last_fullsized":"2024-09-17T01:35:12.693215+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:19.830835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166406+0000","last_change":"2024-09-17T01:35:11.682552+0000","last_active":"2024-09-17T01:35:13.166406+0000","last_peered":"2024-09-17T01:35:13.166406+0000","last_clean":"2024-09-17T01:35:13.166406+0000","last_became_active":"2024-09-17T01:35:11.680943+0000","last_became_peered":"2024-09-17T01:35:11.680943+0000","last_unstale":"2024-09-17T01:35:13.166406+0000","last_undegraded":"2024-09-17T01:35:13.166406+0000","last_fullsized":"2024-09-17T01:35:13.166406+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:44:50.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.798152+0000","last_change":"2024-09-17T01:35:11.685292+0000","last_active":"2024-09-17T01:35:12.798152+0000","last_peered":"2024-09-17T01:35:12.798152+0000","last_clean":"2024-09-17T01:35:12.798152+0000","last_became_active":"2024-09-17T01:35:11.684950+0000","last_became_peered":"2024-09-17T01:35:11.684950+0000","last_unstale":"2024-09-17T01:35:12.798152+0000","last_undegraded":"2024-09-17T01:35:12.798152+0000","last_fullsized":"2024-09-17T01:35:12.798152+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:16.816739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666193+0000","last_change":"2024-09-17T01:35:11.685570+0000","last_active":"2024-09-17T01:35:12.666193+0000","last_peered":"2024-09-17T01:35:12.666193+0000","last_clean":"2024-09-17T01:35:12.666193+0000","last_became_active":"2024-09-17T01:35:11.685257+0000","last_became_peered":"2024-09-17T01:35:11.685257+0000","last_unstale":"2024-09-17T01:35:12.666193+0000","last_undegraded":"2024-09-17T01:35:12.666193+0000","last_fullsized":"2024-09-17T01:35:12.666193+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:30.801288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166734+0000","last_change":"2024-09-17T01:35:11.690839+0000","last_active":"2024-09-17T01:35:13.166734+0000","last_peered":"2024-09-17T01:35:13.166734+0000","last_clean":"2024-09-17T01:35:13.166734+0000","last_became_active":"2024-09-17T01:35:11.690498+0000","last_became_peered":"2024-09-17T01:35:11.690498+0000","last_unstale":"2024-09-17T01:35:13.166734+0000","last_undegraded":"2024-09-17T01:35:13.166734+0000","last_fullsized":"2024-09-17T01:35:13.166734+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:11.517652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667435+0000","last_change":"2024-09-17T01:35:11.669110+0000","last_active":"2024-09-17T01:35:12.667435+0000","last_peered":"2024-09-17T01:35:12.667435+0000","last_clean":"2024-09-17T01:35:12.667435+0000","last_became_active":"2024-09-17T01:35:11.668359+0000","last_became_peered":"2024-09-17T01:35:11.668359+0000","last_unstale":"2024-09-17T01:35:12.667435+0000","last_undegraded":"2024-09-17T01:35:12.667435+0000","last_fullsized":"2024-09-17T01:35:12.667435+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:07:06.732155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693613+0000","last_change":"2024-09-17T01:35:11.678510+0000","last_active":"2024-09-17T01:35:12.693613+0000","last_peered":"2024-09-17T01:35:12.693613+0000","last_clean":"2024-09-17T01:35:12.693613+0000","last_became_active":"2024-09-17T01:35:11.678067+0000","last_became_peered":"2024-09-17T01:35:11.678067+0000","last_unstale":"2024-09-17T01:35:12.693613+0000","last_undegraded":"2024-09-17T01:35:12.693613+0000","last_fullsized":"2024-09-17T01:35:12.693613+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:17.926468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166985+0000","last_change":"2024-09-17T01:35:11.675603+0000","last_active":"2024-09-17T01:35:13.166985+0000","last_peered":"2024-09-17T01:35:13.166985+0000","last_clean":"2024-09-17T01:35:13.166985+0000","last_became_active":"2024-09-17T01:35:11.675290+0000","last_became_peered":"2024-09-17T01:35:11.675290+0000","last_unstale":"2024-09-17T01:35:13.166985+0000","last_undegraded":"2024-09-17T01:35:13.166985+0000","last_fullsized":"2024-09-17T01:35:13.166985+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:04.530089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696764+0000","last_change":"2024-09-17T01:35:11.668987+0000","last_active":"2024-09-17T01:35:12.696764+0000","last_peered":"2024-09-17T01:35:12.696764+0000","last_clean":"2024-09-17T01:35:12.696764+0000","last_became_active":"2024-09-17T01:35:11.668644+0000","last_became_peered":"2024-09-17T01:35:11.668644+0000","last_unstale":"2024-09-17T01:35:12.696764+0000","last_undegraded":"2024-09-17T01:35:12.696764+0000","last_fullsized":"2024-09-17T01:35:12.696764+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:28:33.791232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.798013+0000","last_change":"2024-09-17T01:35:11.677804+0000","last_active":"2024-09-17T01:35:12.798013+0000","last_peered":"2024-09-17T01:35:12.798013+0000","last_clean":"2024-09-17T01:35:12.798013+0000","last_became_active":"2024-09-17T01:35:11.676351+0000","last_became_peered":"2024-09-17T01:35:11.676351+0000","last_unstale":"2024-09-17T01:35:12.798013+0000","last_undegraded":"2024-09-17T01:35:12.798013+0000","last_fullsized":"2024-09-17T01:35:12.798013+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:21.153437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166850+0000","last_change":"2024-09-17T01:35:11.678418+0000","last_active":"2024-09-17T01:35:13.166850+0000","last_peered":"2024-09-17T01:35:13.166850+0000","last_clean":"2024-09-17T01:35:13.166850+0000","last_became_active":"2024-09-17T01:35:11.678096+0000","last_became_peered":"2024-09-17T01:35:11.678096+0000","last_unstale":"2024-09-17T01:35:13.166850+0000","last_undegraded":"2024-09-17T01:35:13.166850+0000","last_fullsized":"2024-09-17T01:35:13.166850+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:24.131701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693997+0000","last_change":"2024-09-17T01:35:11.687021+0000","last_active":"2024-09-17T01:35:12.693997+0000","last_peered":"2024-09-17T01:35:12.693997+0000","last_clean":"2024-09-17T01:35:12.693997+0000","last_became_active":"2024-09-17T01:35:11.685533+0000","last_became_peered":"2024-09-17T01:35:11.685533+0000","last_unstale":"2024-09-17T01:35:12.693997+0000","last_undegraded":"2024-09-17T01:35:12.693997+0000","last_fullsized":"2024-09-17T01:35:12.693997+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:20.511127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696562+0000","last_change":"2024-09-17T01:35:11.673221+0000","last_active":"2024-09-17T01:35:12.696562+0000","last_peered":"2024-09-17T01:35:12.696562+0000","last_clean":"2024-09-17T01:35:12.696562+0000","last_became_active":"2024-09-17T01:35:11.670852+0000","last_became_peered":"2024-09-17T01:35:11.670852+0000","last_unstale":"2024-09-17T01:35:12.696562+0000","last_undegraded":"2024-09-17T01:35:12.696562+0000","last_fullsized":"2024-09-17T01:35:12.696562+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:40.426585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696743+0000","last_change":"2024-09-17T01:35:11.671861+0000","last_active":"2024-09-17T01:35:12.696743+0000","last_peered":"2024-09-17T01:35:12.696743+0000","last_clean":"2024-09-17T01:35:12.696743+0000","last_became_active":"2024-09-17T01:35:11.671539+0000","last_became_peered":"2024-09-17T01:35:11.671539+0000","last_unstale":"2024-09-17T01:35:12.696743+0000","last_undegraded":"2024-09-17T01:35:12.696743+0000","last_fullsized":"2024-09-17T01:35:12.696743+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:59.339611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166574+0000","last_change":"2024-09-17T01:35:11.687865+0000","last_active":"2024-09-17T01:35:13.166574+0000","last_peered":"2024-09-17T01:35:13.166574+0000","last_clean":"2024-09-17T01:35:13.166574+0000","last_became_active":"2024-09-17T01:35:11.684764+0000","last_became_peered":"2024-09-17T01:35:11.684764+0000","last_unstale":"2024-09-17T01:35:13.166574+0000","last_undegraded":"2024-09-17T01:35:13.166574+0000","last_fullsized":"2024-09-17T01:35:13.166574+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:35.323990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.797854+0000","last_change":"2024-09-17T01:35:11.670525+0000","last_active":"2024-09-17T01:35:12.797854+0000","last_peered":"2024-09-17T01:35:12.797854+0000","last_clean":"2024-09-17T01:35:12.797854+0000","last_became_active":"2024-09-17T01:35:11.669140+0000","last_became_peered":"2024-09-17T01:35:11.669140+0000","last_unstale":"2024-09-17T01:35:12.797854+0000","last_undegraded":"2024-09-17T01:35:12.797854+0000","last_fullsized":"2024-09-17T01:35:12.797854+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:36.476274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666875+0000","last_change":"2024-09-17T01:35:11.676283+0000","last_active":"2024-09-17T01:35:12.666875+0000","last_peered":"2024-09-17T01:35:12.666875+0000","last_clean":"2024-09-17T01:35:12.666875+0000","last_became_active":"2024-09-17T01:35:11.675947+0000","last_became_peered":"2024-09-17T01:35:11.675947+0000","last_unstale":"2024-09-17T01:35:12.666875+0000","last_undegraded":"2024-09-17T01:35:12.666875+0000","last_fullsized":"2024-09-17T01:35:12.666875+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:39.573816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693187+0000","last_change":"2024-09-17T01:35:11.678889+0000","last_active":"2024-09-17T01:35:12.693187+0000","last_peered":"2024-09-17T01:35:12.693187+0000","last_clean":"2024-09-17T01:35:12.693187+0000","last_became_active":"2024-09-17T01:35:11.678542+0000","last_became_peered":"2024-09-17T01:35:11.678542+0000","last_unstale":"2024-09-17T01:35:12.693187+0000","last_undegraded":"2024-09-17T01:35:12.693187+0000","last_fullsized":"2024-09-17T01:35:12.693187+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:18.255811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.167081+0000","last_change":"2024-09-17T01:35:11.670813+0000","last_active":"2024-09-17T01:35:13.167081+0000","last_peered":"2024-09-17T01:35:13.167081+0000","last_clean":"2024-09-17T01:35:13.167081+0000","last_became_active":"2024-09-17T01:35:11.670399+0000","last_became_peered":"2024-09-17T01:35:11.670399+0000","last_unstale":"2024-09-17T01:35:13.167081+0000","last_undegraded":"2024-09-17T01:35:13.167081+0000","last_fullsized":"2024-09-17T01:35:13.167081+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:51.896304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"48'4","reported_seq":19,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668630+0000","last_change":"2024-09-17T01:35:10.676051+0000","last_active":"2024-09-17T01:35:12.668630+0000","last_peered":"2024-09-17T01:35:12.668630+0000","last_clean":"2024-09-17T01:35:12.668630+0000","last_became_active":"2024-09-17T01:35:10.675678+0000","last_became_peered":"2024-09-17T01:35:10.675678+0000","last_unstale":"2024-09-17T01:35:12.668630+0000","last_undegraded":"2024-09-17T01:35:12.668630+0000","last_fullsized":"2024-09-17T01:35:12.668630+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:29.304564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166984+0000","last_change":"2024-09-17T01:35:11.688201+0000","last_active":"2024-09-17T01:35:13.166984+0000","last_peered":"2024-09-17T01:35:13.166984+0000","last_clean":"2024-09-17T01:35:13.166984+0000","last_became_active":"2024-09-17T01:35:11.684393+0000","last_became_peered":"2024-09-17T01:35:11.684393+0000","last_unstale":"2024-09-17T01:35:13.166984+0000","last_undegraded":"2024-09-17T01:35:13.166984+0000","last_fullsized":"2024-09-17T01:35:13.166984+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:36:30.634041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696918+0000","last_change":"2024-09-17T01:35:10.669339+0000","last_active":"2024-09-17T01:35:12.696918+0000","last_peered":"2024-09-17T01:35:12.696918+0000","last_clean":"2024-09-17T01:35:12.696918+0000","last_became_active":"2024-09-17T01:35:10.666719+0000","last_became_peered":"2024-09-17T01:35:10.666719+0000","last_unstale":"2024-09-17T01:35:12.696918+0000","last_undegraded":"2024-09-17T01:35:12.696918+0000","last_fullsized":"2024-09-17T01:35:12.696918+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:11.436388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.798456+0000","last_change":"2024-09-17T01:35:11.671915+0000","last_active":"2024-09-17T01:35:12.798456+0000","last_peered":"2024-09-17T01:35:12.798456+0000","last_clean":"2024-09-17T01:35:12.798456+0000","last_became_active":"2024-09-17T01:35:11.669856+0000","last_became_peered":"2024-09-17T01:35:11.669856+0000","last_unstale":"2024-09-17T01:35:12.798456+0000","last_undegraded":"2024-09-17T01:35:12.798456+0000","last_fullsized":"2024-09-17T01:35:12.798456+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:55:08.951179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668026+0000","last_change":"2024-09-17T01:35:10.682029+0000","last_active":"2024-09-17T01:35:12.668026+0000","last_peered":"2024-09-17T01:35:12.668026+0000","last_clean":"2024-09-17T01:35:12.668026+0000","last_became_active":"2024-09-17T01:35:10.681689+0000","last_became_peered":"2024-09-17T01:35:10.681689+0000","last_unstale":"2024-09-17T01:35:12.668026+0000","last_undegraded":"2024-09-17T01:35:12.668026+0000","last_fullsized":"2024-09-17T01:35:12.668026+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:10.562332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693888+0000","last_change":"2024-09-17T01:35:11.690091+0000","last_active":"2024-09-17T01:35:12.693888+0000","last_peered":"2024-09-17T01:35:12.693888+0000","last_clean":"2024-09-17T01:35:12.693888+0000","last_became_active":"2024-09-17T01:35:11.688955+0000","last_became_peered":"2024-09-17T01:35:11.688955+0000","last_unstale":"2024-09-17T01:35:12.693888+0000","last_undegraded":"2024-09-17T01:35:12.693888+0000","last_fullsized":"2024-09-17T01:35:12.693888+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:30.638574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696617+0000","last_change":"2024-09-17T01:35:10.672378+0000","last_active":"2024-09-17T01:35:12.696617+0000","last_peered":"2024-09-17T01:35:12.696617+0000","last_clean":"2024-09-17T01:35:12.696617+0000","last_became_active":"2024-09-17T01:35:10.670878+0000","last_became_peered":"2024-09-17T01:35:10.670878+0000","last_unstale":"2024-09-17T01:35:12.696617+0000","last_undegraded":"2024-09-17T01:35:12.696617+0000","last_fullsized":"2024-09-17T01:35:12.696617+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:44:02.998010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696488+0000","last_change":"2024-09-17T01:35:11.672199+0000","last_active":"2024-09-17T01:35:12.696488+0000","last_peered":"2024-09-17T01:35:12.696488+0000","last_clean":"2024-09-17T01:35:12.696488+0000","last_became_active":"2024-09-17T01:35:11.671902+0000","last_became_peered":"2024-09-17T01:35:11.671902+0000","last_unstale":"2024-09-17T01:35:12.696488+0000","last_undegraded":"2024-09-17T01:35:12.696488+0000","last_fullsized":"2024-09-17T01:35:12.696488+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:40.681886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668842+0000","last_change":"2024-09-17T01:35:10.666527+0000","last_active":"2024-09-17T01:35:12.668842+0000","last_peered":"2024-09-17T01:35:12.668842+0000","last_clean":"2024-09-17T01:35:12.668842+0000","last_became_active":"2024-09-17T01:35:10.666251+0000","last_became_peered":"2024-09-17T01:35:10.666251+0000","last_unstale":"2024-09-17T01:35:12.668842+0000","last_undegraded":"2024-09-17T01:35:12.668842+0000","last_fullsized":"2024-09-17T01:35:12.668842+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:08.974997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667219+0000","last_change":"2024-09-17T01:35:11.679799+0000","last_active":"2024-09-17T01:35:12.667219+0000","last_peered":"2024-09-17T01:35:12.667219+0000","last_clean":"2024-09-17T01:35:12.667219+0000","last_became_active":"2024-09-17T01:35:11.675735+0000","last_became_peered":"2024-09-17T01:35:11.675735+0000","last_unstale":"2024-09-17T01:35:12.667219+0000","last_undegraded":"2024-09-17T01:35:12.667219+0000","last_fullsized":"2024-09-17T01:35:12.667219+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:53.242251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696421+0000","last_change":"2024-09-17T01:35:10.683902+0000","last_active":"2024-09-17T01:35:12.696421+0000","last_peered":"2024-09-17T01:35:12.696421+0000","last_clean":"2024-09-17T01:35:12.696421+0000","last_became_active":"2024-09-17T01:35:10.683540+0000","last_became_peered":"2024-09-17T01:35:10.683540+0000","last_unstale":"2024-09-17T01:35:12.696421+0000","last_undegraded":"2024-09-17T01:35:12.696421+0000","last_fullsized":"2024-09-17T01:35:12.696421+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:14:50.086073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666898+0000","last_change":"2024-09-17T01:35:11.667959+0000","last_active":"2024-09-17T01:35:12.666898+0000","last_peered":"2024-09-17T01:35:12.666898+0000","last_clean":"2024-09-17T01:35:12.666898+0000","last_became_active":"2024-09-17T01:35:11.667618+0000","last_became_peered":"2024-09-17T01:35:11.667618+0000","last_unstale":"2024-09-17T01:35:12.666898+0000","last_undegraded":"2024-09-17T01:35:12.666898+0000","last_fullsized":"2024-09-17T01:35:12.666898+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:06.513791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166436+0000","last_change":"2024-09-17T01:35:10.683282+0000","last_active":"2024-09-17T01:35:13.166436+0000","last_peered":"2024-09-17T01:35:13.166436+0000","last_clean":"2024-09-17T01:35:13.166436+0000","last_became_active":"2024-09-17T01:35:10.682938+0000","last_became_peered":"2024-09-17T01:35:10.682938+0000","last_unstale":"2024-09-17T01:35:13.166436+0000","last_undegraded":"2024-09-17T01:35:13.166436+0000","last_fullsized":"2024-09-17T01:35:13.166436+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:31.273868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696437+0000","last_change":"2024-09-17T01:35:11.682324+0000","last_active":"2024-09-17T01:35:12.696437+0000","last_peered":"2024-09-17T01:35:12.696437+0000","last_clean":"2024-09-17T01:35:12.696437+0000","last_became_active":"2024-09-17T01:35:11.682037+0000","last_became_peered":"2024-09-17T01:35:11.682037+0000","last_unstale":"2024-09-17T01:35:12.696437+0000","last_undegraded":"2024-09-17T01:35:12.696437+0000","last_fullsized":"2024-09-17T01:35:12.696437+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:08.755783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666831+0000","last_change":"2024-09-17T01:35:10.676447+0000","last_active":"2024-09-17T01:35:12.666831+0000","last_peered":"2024-09-17T01:35:12.666831+0000","last_clean":"2024-09-17T01:35:12.666831+0000","last_became_active":"2024-09-17T01:35:10.676026+0000","last_became_peered":"2024-09-17T01:35:10.676026+0000","last_unstale":"2024-09-17T01:35:12.666831+0000","last_undegraded":"2024-09-17T01:35:12.666831+0000","last_fullsized":"2024-09-17T01:35:12.666831+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:36.004994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666229+0000","last_change":"2024-09-17T01:35:11.673386+0000","last_active":"2024-09-17T01:35:12.666229+0000","last_peered":"2024-09-17T01:35:12.666229+0000","last_clean":"2024-09-17T01:35:12.666229+0000","last_became_active":"2024-09-17T01:35:11.673001+0000","last_became_peered":"2024-09-17T01:35:11.673001+0000","last_unstale":"2024-09-17T01:35:12.666229+0000","last_undegraded":"2024-09-17T01:35:12.666229+0000","last_fullsized":"2024-09-17T01:35:12.666229+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:55.318960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665797+0000","last_change":"2024-09-17T01:35:10.669932+0000","last_active":"2024-09-17T01:35:12.665797+0000","last_peered":"2024-09-17T01:35:12.665797+0000","last_clean":"2024-09-17T01:35:12.665797+0000","last_became_active":"2024-09-17T01:35:10.669651+0000","last_became_peered":"2024-09-17T01:35:10.669651+0000","last_unstale":"2024-09-17T01:35:12.665797+0000","last_undegraded":"2024-09-17T01:35:12.665797+0000","last_fullsized":"2024-09-17T01:35:12.665797+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:55.136983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665664+0000","last_change":"2024-09-17T01:35:11.681534+0000","last_active":"2024-09-17T01:35:12.665664+0000","last_peered":"2024-09-17T01:35:12.665664+0000","last_clean":"2024-09-17T01:35:12.665664+0000","last_became_active":"2024-09-17T01:35:11.681247+0000","last_became_peered":"2024-09-17T01:35:11.681247+0000","last_unstale":"2024-09-17T01:35:12.665664+0000","last_undegraded":"2024-09-17T01:35:12.665664+0000","last_fullsized":"2024-09-17T01:35:12.665664+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:40.773263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668340+0000","last_change":"2024-09-17T01:35:10.679164+0000","last_active":"2024-09-17T01:35:12.668340+0000","last_peered":"2024-09-17T01:35:12.668340+0000","last_clean":"2024-09-17T01:35:12.668340+0000","last_became_active":"2024-09-17T01:35:10.677983+0000","last_became_peered":"2024-09-17T01:35:10.677983+0000","last_unstale":"2024-09-17T01:35:12.668340+0000","last_undegraded":"2024-09-17T01:35:12.668340+0000","last_fullsized":"2024-09-17T01:35:12.668340+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:31.801763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693799+0000","last_change":"2024-09-17T01:35:11.683421+0000","last_active":"2024-09-17T01:35:12.693799+0000","last_peered":"2024-09-17T01:35:12.693799+0000","last_clean":"2024-09-17T01:35:12.693799+0000","last_became_active":"2024-09-17T01:35:11.683075+0000","last_became_peered":"2024-09-17T01:35:11.683075+0000","last_unstale":"2024-09-17T01:35:12.693799+0000","last_undegraded":"2024-09-17T01:35:12.693799+0000","last_fullsized":"2024-09-17T01:35:12.693799+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:38.873835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"48'3","reported_seq":18,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.797908+0000","last_change":"2024-09-17T01:35:10.682143+0000","last_active":"2024-09-17T01:35:12.797908+0000","last_peered":"2024-09-17T01:35:12.797908+0000","last_clean":"2024-09-17T01:35:12.797908+0000","last_became_active":"2024-09-17T01:35:10.681743+0000","last_became_peered":"2024-09-17T01:35:10.681743+0000","last_unstale":"2024-09-17T01:35:12.797908+0000","last_undegraded":"2024-09-17T01:35:12.797908+0000","last_fullsized":"2024-09-17T01:35:12.797908+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:50.162612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696933+0000","last_change":"2024-09-17T01:35:11.678867+0000","last_active":"2024-09-17T01:35:12.696933+0000","last_peered":"2024-09-17T01:35:12.696933+0000","last_clean":"2024-09-17T01:35:12.696933+0000","last_became_active":"2024-09-17T01:35:11.678581+0000","last_became_peered":"2024-09-17T01:35:11.678581+0000","last_unstale":"2024-09-17T01:35:12.696933+0000","last_undegraded":"2024-09-17T01:35:12.696933+0000","last_fullsized":"2024-09-17T01:35:12.696933+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:30.558833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"48'6","reported_seq":21,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667586+0000","last_change":"2024-09-17T01:35:10.672677+0000","last_active":"2024-09-17T01:35:12.667586+0000","last_peered":"2024-09-17T01:35:12.667586+0000","last_clean":"2024-09-17T01:35:12.667586+0000","last_became_active":"2024-09-17T01:35:10.672338+0000","last_became_peered":"2024-09-17T01:35:10.672338+0000","last_unstale":"2024-09-17T01:35:12.667586+0000","last_undegraded":"2024-09-17T01:35:12.667586+0000","last_fullsized":"2024-09-17T01:35:12.667586+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:23.123246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665774+0000","last_change":"2024-09-17T01:35:11.675401+0000","last_active":"2024-09-17T01:35:12.665774+0000","last_peered":"2024-09-17T01:35:12.665774+0000","last_clean":"2024-09-17T01:35:12.665774+0000","last_became_active":"2024-09-17T01:35:11.674946+0000","last_became_peered":"2024-09-17T01:35:11.674946+0000","last_unstale":"2024-09-17T01:35:12.665774+0000","last_undegraded":"2024-09-17T01:35:12.665774+0000","last_fullsized":"2024-09-17T01:35:12.665774+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:16.229827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166584+0000","last_change":"2024-09-17T01:35:10.671105+0000","last_active":"2024-09-17T01:35:13.166584+0000","last_peered":"2024-09-17T01:35:13.166584+0000","last_clean":"2024-09-17T01:35:13.166584+0000","last_became_active":"2024-09-17T01:35:10.670646+0000","last_became_peered":"2024-09-17T01:35:10.670646+0000","last_unstale":"2024-09-17T01:35:13.166584+0000","last_undegraded":"2024-09-17T01:35:13.166584+0000","last_fullsized":"2024-09-17T01:35:13.166584+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:31.761461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166938+0000","last_change":"2024-09-17T01:35:11.671482+0000","last_active":"2024-09-17T01:35:13.166938+0000","last_peered":"2024-09-17T01:35:13.166938+0000","last_clean":"2024-09-17T01:35:13.166938+0000","last_became_active":"2024-09-17T01:35:11.671159+0000","last_became_peered":"2024-09-17T01:35:11.671159+0000","last_unstale":"2024-09-17T01:35:13.166938+0000","last_undegraded":"2024-09-17T01:35:13.166938+0000","last_fullsized":"2024-09-17T01:35:13.166938+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:22.007933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166393+0000","last_change":"2024-09-17T01:35:10.677803+0000","last_active":"2024-09-17T01:35:13.166393+0000","last_peered":"2024-09-17T01:35:13.166393+0000","last_clean":"2024-09-17T01:35:13.166393+0000","last_became_active":"2024-09-17T01:35:10.677510+0000","last_became_peered":"2024-09-17T01:35:10.677510+0000","last_unstale":"2024-09-17T01:35:13.166393+0000","last_undegraded":"2024-09-17T01:35:13.166393+0000","last_fullsized":"2024-09-17T01:35:13.166393+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:05:45.762431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166796+0000","last_change":"2024-09-17T01:35:11.673836+0000","last_active":"2024-09-17T01:35:13.166796+0000","last_peered":"2024-09-17T01:35:13.166796+0000","last_clean":"2024-09-17T01:35:13.166796+0000","last_became_active":"2024-09-17T01:35:11.669992+0000","last_became_peered":"2024-09-17T01:35:11.669992+0000","last_unstale":"2024-09-17T01:35:13.166796+0000","last_undegraded":"2024-09-17T01:35:13.166796+0000","last_fullsized":"2024-09-17T01:35:13.166796+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:40.901698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667026+0000","last_change":"2024-09-17T01:35:10.664520+0000","last_active":"2024-09-17T01:35:12.667026+0000","last_peered":"2024-09-17T01:35:12.667026+0000","last_clean":"2024-09-17T01:35:12.667026+0000","last_became_active":"2024-09-17T01:35:10.663413+0000","last_became_peered":"2024-09-17T01:35:10.663413+0000","last_unstale":"2024-09-17T01:35:12.667026+0000","last_undegraded":"2024-09-17T01:35:12.667026+0000","last_fullsized":"2024-09-17T01:35:12.667026+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:11.217933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.797847+0000","last_change":"2024-09-17T01:35:11.672649+0000","last_active":"2024-09-17T01:35:12.797847+0000","last_peered":"2024-09-17T01:35:12.797847+0000","last_clean":"2024-09-17T01:35:12.797847+0000","last_became_active":"2024-09-17T01:35:11.672408+0000","last_became_peered":"2024-09-17T01:35:11.672408+0000","last_unstale":"2024-09-17T01:35:12.797847+0000","last_undegraded":"2024-09-17T01:35:12.797847+0000","last_fullsized":"2024-09-17T01:35:12.797847+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:43.861115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"48'8","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668429+0000","last_change":"2024-09-17T01:35:10.668450+0000","last_active":"2024-09-17T01:35:12.668429+0000","last_peered":"2024-09-17T01:35:12.668429+0000","last_clean":"2024-09-17T01:35:12.668429+0000","last_became_active":"2024-09-17T01:35:10.668097+0000","last_became_peered":"2024-09-17T01:35:10.668097+0000","last_unstale":"2024-09-17T01:35:12.668429+0000","last_undegraded":"2024-09-17T01:35:12.668429+0000","last_fullsized":"2024-09-17T01:35:12.668429+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:52.159951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.167034+0000","last_change":"2024-09-17T01:35:11.677620+0000","last_active":"2024-09-17T01:35:13.167034+0000","last_peered":"2024-09-17T01:35:13.167034+0000","last_clean":"2024-09-17T01:35:13.167034+0000","last_became_active":"2024-09-17T01:35:11.677084+0000","last_became_peered":"2024-09-17T01:35:11.677084+0000","last_unstale":"2024-09-17T01:35:13.167034+0000","last_undegraded":"2024-09-17T01:35:13.167034+0000","last_fullsized":"2024-09-17T01:35:13.167034+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:12:39.675385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693994+0000","last_change":"2024-09-17T01:35:10.672120+0000","last_active":"2024-09-17T01:35:12.693994+0000","last_peered":"2024-09-17T01:35:12.693994+0000","last_clean":"2024-09-17T01:35:12.693994+0000","last_became_active":"2024-09-17T01:35:10.671797+0000","last_became_peered":"2024-09-17T01:35:10.671797+0000","last_unstale":"2024-09-17T01:35:12.693994+0000","last_undegraded":"2024-09-17T01:35:12.693994+0000","last_fullsized":"2024-09-17T01:35:12.693994+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:47:27.327278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.167111+0000","last_change":"2024-09-17T01:35:11.678099+0000","last_active":"2024-09-17T01:35:13.167111+0000","last_peered":"2024-09-17T01:35:13.167111+0000","last_clean":"2024-09-17T01:35:13.167111+0000","last_became_active":"2024-09-17T01:35:11.677064+0000","last_became_peered":"2024-09-17T01:35:11.677064+0000","last_unstale":"2024-09-17T01:35:13.167111+0000","last_undegraded":"2024-09-17T01:35:13.167111+0000","last_fullsized":"2024-09-17T01:35:13.167111+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:59.219211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666337+0000","last_change":"2024-09-17T01:35:10.663348+0000","last_active":"2024-09-17T01:35:12.666337+0000","last_peered":"2024-09-17T01:35:12.666337+0000","last_clean":"2024-09-17T01:35:12.666337+0000","last_became_active":"2024-09-17T01:35:10.662887+0000","last_became_peered":"2024-09-17T01:35:10.662887+0000","last_unstale":"2024-09-17T01:35:12.666337+0000","last_undegraded":"2024-09-17T01:35:12.666337+0000","last_fullsized":"2024-09-17T01:35:12.666337+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:24.816236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.798511+0000","last_change":"2024-09-17T01:35:11.679814+0000","last_active":"2024-09-17T01:35:12.798511+0000","last_peered":"2024-09-17T01:35:12.798511+0000","last_clean":"2024-09-17T01:35:12.798511+0000","last_became_active":"2024-09-17T01:35:11.679510+0000","last_became_peered":"2024-09-17T01:35:11.679510+0000","last_unstale":"2024-09-17T01:35:12.798511+0000","last_undegraded":"2024-09-17T01:35:12.798511+0000","last_fullsized":"2024-09-17T01:35:12.798511+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:21.756303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666047+0000","last_change":"2024-09-17T01:35:10.676459+0000","last_active":"2024-09-17T01:35:12.666047+0000","last_peered":"2024-09-17T01:35:12.666047+0000","last_clean":"2024-09-17T01:35:12.666047+0000","last_became_active":"2024-09-17T01:35:10.676141+0000","last_became_peered":"2024-09-17T01:35:10.676141+0000","last_unstale":"2024-09-17T01:35:12.666047+0000","last_undegraded":"2024-09-17T01:35:12.666047+0000","last_fullsized":"2024-09-17T01:35:12.666047+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:40.090233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665974+0000","last_change":"2024-09-17T01:35:11.676736+0000","last_active":"2024-09-17T01:35:12.665974+0000","last_peered":"2024-09-17T01:35:12.665974+0000","last_clean":"2024-09-17T01:35:12.665974+0000","last_became_active":"2024-09-17T01:35:11.676057+0000","last_became_peered":"2024-09-17T01:35:11.676057+0000","last_unstale":"2024-09-17T01:35:12.665974+0000","last_undegraded":"2024-09-17T01:35:12.665974+0000","last_fullsized":"2024-09-17T01:35:12.665974+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:09.879854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667410+0000","last_change":"2024-09-17T01:35:10.662974+0000","last_active":"2024-09-17T01:35:12.667410+0000","last_peered":"2024-09-17T01:35:12.667410+0000","last_clean":"2024-09-17T01:35:12.667410+0000","last_became_active":"2024-09-17T01:35:10.662581+0000","last_became_peered":"2024-09-17T01:35:10.662581+0000","last_unstale":"2024-09-17T01:35:12.667410+0000","last_undegraded":"2024-09-17T01:35:12.667410+0000","last_fullsized":"2024-09-17T01:35:12.667410+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:36.554201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667139+0000","last_change":"2024-09-17T01:35:11.681718+0000","last_active":"2024-09-17T01:35:12.667139+0000","last_peered":"2024-09-17T01:35:12.667139+0000","last_clean":"2024-09-17T01:35:12.667139+0000","last_became_active":"2024-09-17T01:35:11.681374+0000","last_became_peered":"2024-09-17T01:35:11.681374+0000","last_unstale":"2024-09-17T01:35:12.667139+0000","last_undegraded":"2024-09-17T01:35:12.667139+0000","last_fullsized":"2024-09-17T01:35:12.667139+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:45.555304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667551+0000","last_change":"2024-09-17T01:35:10.678608+0000","last_active":"2024-09-17T01:35:12.667551+0000","last_peered":"2024-09-17T01:35:12.667551+0000","last_clean":"2024-09-17T01:35:12.667551+0000","last_became_active":"2024-09-17T01:35:10.678289+0000","last_became_peered":"2024-09-17T01:35:10.678289+0000","last_unstale":"2024-09-17T01:35:12.667551+0000","last_undegraded":"2024-09-17T01:35:12.667551+0000","last_fullsized":"2024-09-17T01:35:12.667551+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:41.559466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668635+0000","last_change":"2024-09-17T01:35:11.681503+0000","last_active":"2024-09-17T01:35:12.668635+0000","last_peered":"2024-09-17T01:35:12.668635+0000","last_clean":"2024-09-17T01:35:12.668635+0000","last_became_active":"2024-09-17T01:35:11.681145+0000","last_became_peered":"2024-09-17T01:35:11.681145+0000","last_unstale":"2024-09-17T01:35:12.668635+0000","last_undegraded":"2024-09-17T01:35:12.668635+0000","last_fullsized":"2024-09-17T01:35:12.668635+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:46.719967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166440+0000","last_change":"2024-09-17T01:35:10.679163+0000","last_active":"2024-09-17T01:35:13.166440+0000","last_peered":"2024-09-17T01:35:13.166440+0000","last_clean":"2024-09-17T01:35:13.166440+0000","last_became_active":"2024-09-17T01:35:10.678887+0000","last_became_peered":"2024-09-17T01:35:10.678887+0000","last_unstale":"2024-09-17T01:35:13.166440+0000","last_undegraded":"2024-09-17T01:35:13.166440+0000","last_fullsized":"2024-09-17T01:35:13.166440+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:34:24.704092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693539+0000","last_change":"2024-09-17T01:35:11.674494+0000","last_active":"2024-09-17T01:35:12.693539+0000","last_peered":"2024-09-17T01:35:12.693539+0000","last_clean":"2024-09-17T01:35:12.693539+0000","last_became_active":"2024-09-17T01:35:11.674130+0000","last_became_peered":"2024-09-17T01:35:11.674130+0000","last_unstale":"2024-09-17T01:35:12.693539+0000","last_undegraded":"2024-09-17T01:35:12.693539+0000","last_fullsized":"2024-09-17T01:35:12.693539+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:16.826974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666489+0000","last_change":"2024-09-17T01:35:10.678454+0000","last_active":"2024-09-17T01:35:12.666489+0000","last_peered":"2024-09-17T01:35:12.666489+0000","last_clean":"2024-09-17T01:35:12.666489+0000","last_became_active":"2024-09-17T01:35:10.678074+0000","last_became_peered":"2024-09-17T01:35:10.678074+0000","last_unstale":"2024-09-17T01:35:12.666489+0000","last_undegraded":"2024-09-17T01:35:12.666489+0000","last_fullsized":"2024-09-17T01:35:12.666489+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:36:20.417566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693618+0000","last_change":"2024-09-17T01:35:11.685970+0000","last_active":"2024-09-17T01:35:12.693618+0000","last_peered":"2024-09-17T01:35:12.693618+0000","last_clean":"2024-09-17T01:35:12.693618+0000","last_became_active":"2024-09-17T01:35:11.685585+0000","last_became_peered":"2024-09-17T01:35:11.685585+0000","last_unstale":"2024-09-17T01:35:12.693618+0000","last_undegraded":"2024-09-17T01:35:12.693618+0000","last_fullsized":"2024-09-17T01:35:12.693618+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:01.388599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696251+0000","last_change":"2024-09-17T01:35:10.665577+0000","last_active":"2024-09-17T01:35:12.696251+0000","last_peered":"2024-09-17T01:35:12.696251+0000","last_clean":"2024-09-17T01:35:12.696251+0000","last_became_active":"2024-09-17T01:35:10.665243+0000","last_became_peered":"2024-09-17T01:35:10.665243+0000","last_unstale":"2024-09-17T01:35:12.696251+0000","last_undegraded":"2024-09-17T01:35:12.696251+0000","last_fullsized":"2024-09-17T01:35:12.696251+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:57.645499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696995+0000","last_change":"2024-09-17T01:35:11.684591+0000","last_active":"2024-09-17T01:35:12.696995+0000","last_peered":"2024-09-17T01:35:12.696995+0000","last_clean":"2024-09-17T01:35:12.696995+0000","last_became_active":"2024-09-17T01:35:11.681538+0000","last_became_peered":"2024-09-17T01:35:11.681538+0000","last_unstale":"2024-09-17T01:35:12.696995+0000","last_undegraded":"2024-09-17T01:35:12.696995+0000","last_fullsized":"2024-09-17T01:35:12.696995+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:56.992382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"49'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.695895+0000","last_change":"2024-09-17T01:35:10.679073+0000","last_active":"2024-09-17T01:35:12.695895+0000","last_peered":"2024-09-17T01:35:12.695895+0000","last_clean":"2024-09-17T01:35:12.695895+0000","last_became_active":"2024-09-17T01:35:10.678723+0000","last_became_peered":"2024-09-17T01:35:10.678723+0000","last_unstale":"2024-09-17T01:35:12.695895+0000","last_undegraded":"2024-09-17T01:35:12.695895+0000","last_fullsized":"2024-09-17T01:35:12.695895+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:38.851484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667634+0000","last_change":"2024-09-17T01:35:11.667624+0000","last_active":"2024-09-17T01:35:12.667634+0000","last_peered":"2024-09-17T01:35:12.667634+0000","last_clean":"2024-09-17T01:35:12.667634+0000","last_became_active":"2024-09-17T01:35:11.667288+0000","last_became_peered":"2024-09-17T01:35:11.667288+0000","last_unstale":"2024-09-17T01:35:12.667634+0000","last_undegraded":"2024-09-17T01:35:12.667634+0000","last_fullsized":"2024-09-17T01:35:12.667634+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:26.724398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166719+0000","last_change":"2024-09-17T01:35:10.681971+0000","last_active":"2024-09-17T01:35:13.166719+0000","last_peered":"2024-09-17T01:35:13.166719+0000","last_clean":"2024-09-17T01:35:13.166719+0000","last_became_active":"2024-09-17T01:35:10.681433+0000","last_became_peered":"2024-09-17T01:35:10.681433+0000","last_unstale":"2024-09-17T01:35:13.166719+0000","last_undegraded":"2024-09-17T01:35:13.166719+0000","last_fullsized":"2024-09-17T01:35:13.166719+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:16.135683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696950+0000","last_change":"2024-09-17T01:35:11.678557+0000","last_active":"2024-09-17T01:35:12.696950+0000","last_peered":"2024-09-17T01:35:12.696950+0000","last_clean":"2024-09-17T01:35:12.696950+0000","last_became_active":"2024-09-17T01:35:11.678094+0000","last_became_peered":"2024-09-17T01:35:11.678094+0000","last_unstale":"2024-09-17T01:35:12.696950+0000","last_undegraded":"2024-09-17T01:35:12.696950+0000","last_fullsized":"2024-09-17T01:35:12.696950+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:08.579234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.167004+0000","last_change":"2024-09-17T01:35:10.678632+0000","last_active":"2024-09-17T01:35:13.167004+0000","last_peered":"2024-09-17T01:35:13.167004+0000","last_clean":"2024-09-17T01:35:13.167004+0000","last_became_active":"2024-09-17T01:35:10.678323+0000","last_became_peered":"2024-09-17T01:35:10.678323+0000","last_unstale":"2024-09-17T01:35:13.167004+0000","last_undegraded":"2024-09-17T01:35:13.167004+0000","last_fullsized":"2024-09-17T01:35:13.167004+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:14.905269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667429+0000","last_change":"2024-09-17T01:35:11.678900+0000","last_active":"2024-09-17T01:35:12.667429+0000","last_peered":"2024-09-17T01:35:12.667429+0000","last_clean":"2024-09-17T01:35:12.667429+0000","last_became_active":"2024-09-17T01:35:11.676137+0000","last_became_peered":"2024-09-17T01:35:11.676137+0000","last_unstale":"2024-09-17T01:35:12.667429+0000","last_undegraded":"2024-09-17T01:35:12.667429+0000","last_fullsized":"2024-09-17T01:35:12.667429+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:54.371997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166734+0000","last_change":"2024-09-17T01:35:10.680728+0000","last_active":"2024-09-17T01:35:13.166734+0000","last_peered":"2024-09-17T01:35:13.166734+0000","last_clean":"2024-09-17T01:35:13.166734+0000","last_became_active":"2024-09-17T01:35:10.680427+0000","last_became_peered":"2024-09-17T01:35:10.680427+0000","last_unstale":"2024-09-17T01:35:13.166734+0000","last_undegraded":"2024-09-17T01:35:13.166734+0000","last_fullsized":"2024-09-17T01:35:13.166734+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:29.304564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693363+0000","last_change":"2024-09-17T01:35:11.683785+0000","last_active":"2024-09-17T01:35:12.693363+0000","last_peered":"2024-09-17T01:35:12.693363+0000","last_clean":"2024-09-17T01:35:12.693363+0000","last_became_active":"2024-09-17T01:35:11.683033+0000","last_became_peered":"2024-09-17T01:35:11.683033+0000","last_unstale":"2024-09-17T01:35:12.693363+0000","last_undegraded":"2024-09-17T01:35:12.693363+0000","last_fullsized":"2024-09-17T01:35:12.693363+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:49.124332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696736+0000","last_change":"2024-09-17T01:35:10.673488+0000","last_active":"2024-09-17T01:35:12.696736+0000","last_peered":"2024-09-17T01:35:12.696736+0000","last_clean":"2024-09-17T01:35:12.696736+0000","last_became_active":"2024-09-17T01:35:10.672037+0000","last_became_peered":"2024-09-17T01:35:10.672037+0000","last_unstale":"2024-09-17T01:35:12.696736+0000","last_undegraded":"2024-09-17T01:35:12.696736+0000","last_fullsized":"2024-09-17T01:35:12.696736+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:22.555314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665401+0000","last_change":"2024-09-17T01:35:11.680098+0000","last_active":"2024-09-17T01:35:12.665401+0000","last_peered":"2024-09-17T01:35:12.665401+0000","last_clean":"2024-09-17T01:35:12.665401+0000","last_became_active":"2024-09-17T01:35:11.679805+0000","last_became_peered":"2024-09-17T01:35:11.679805+0000","last_unstale":"2024-09-17T01:35:12.665401+0000","last_undegraded":"2024-09-17T01:35:12.665401+0000","last_fullsized":"2024-09-17T01:35:12.665401+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:05.444230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667129+0000","last_change":"2024-09-17T01:35:10.668738+0000","last_active":"2024-09-17T01:35:12.667129+0000","last_peered":"2024-09-17T01:35:12.667129+0000","last_clean":"2024-09-17T01:35:12.667129+0000","last_became_active":"2024-09-17T01:35:10.668414+0000","last_became_peered":"2024-09-17T01:35:10.668414+0000","last_unstale":"2024-09-17T01:35:12.667129+0000","last_undegraded":"2024-09-17T01:35:12.667129+0000","last_fullsized":"2024-09-17T01:35:12.667129+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:05:45.762431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.798131+0000","last_change":"2024-09-17T01:35:11.675535+0000","last_active":"2024-09-17T01:35:12.798131+0000","last_peered":"2024-09-17T01:35:12.798131+0000","last_clean":"2024-09-17T01:35:12.798131+0000","last_became_active":"2024-09-17T01:35:11.675201+0000","last_became_peered":"2024-09-17T01:35:11.675201+0000","last_unstale":"2024-09-17T01:35:12.798131+0000","last_undegraded":"2024-09-17T01:35:12.798131+0000","last_fullsized":"2024-09-17T01:35:12.798131+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:47.961294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166762+0000","last_change":"2024-09-17T01:35:10.676420+0000","last_active":"2024-09-17T01:35:13.166762+0000","last_peered":"2024-09-17T01:35:13.166762+0000","last_clean":"2024-09-17T01:35:13.166762+0000","last_became_active":"2024-09-17T01:35:10.676110+0000","last_became_peered":"2024-09-17T01:35:10.676110+0000","last_unstale":"2024-09-17T01:35:13.166762+0000","last_undegraded":"2024-09-17T01:35:13.166762+0000","last_fullsized":"2024-09-17T01:35:13.166762+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:31.612370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693943+0000","last_change":"2024-09-17T01:35:11.680053+0000","last_active":"2024-09-17T01:35:12.693943+0000","last_peered":"2024-09-17T01:35:12.693943+0000","last_clean":"2024-09-17T01:35:12.693943+0000","last_became_active":"2024-09-17T01:35:11.679222+0000","last_became_peered":"2024-09-17T01:35:11.679222+0000","last_unstale":"2024-09-17T01:35:12.693943+0000","last_undegraded":"2024-09-17T01:35:12.693943+0000","last_fullsized":"2024-09-17T01:35:12.693943+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:24.543661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696895+0000","last_change":"2024-09-17T01:35:10.676225+0000","last_active":"2024-09-17T01:35:12.696895+0000","last_peered":"2024-09-17T01:35:12.696895+0000","last_clean":"2024-09-17T01:35:12.696895+0000","last_became_active":"2024-09-17T01:35:10.675871+0000","last_became_peered":"2024-09-17T01:35:10.675871+0000","last_unstale":"2024-09-17T01:35:12.696895+0000","last_undegraded":"2024-09-17T01:35:12.696895+0000","last_fullsized":"2024-09-17T01:35:12.696895+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:10.491485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":161,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665290+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:35:12.665290+0000","last_peered":"2024-09-17T01:35:12.665290+0000","last_clean":"2024-09-17T01:35:12.665290+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:35:12.665290+0000","last_undegraded":"2024-09-17T01:35:12.665290+0000","last_fullsized":"2024-09-17T01:35:12.665290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476780,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40068,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331772,"statfs":{"total":96636764160,"available":96595734528,"internally_reserved":0,"allocated":573440,"data_stored":233769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35908,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335932,"statfs":{"total":96636764160,"available":96599994368,"internally_reserved":0,"allocated":573440,"data_stored":233713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509482,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40072,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331768,"statfs":{"total":96636764160,"available":96595730432,"internally_reserved":0,"allocated":577536,"data_stored":234295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509483,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40084,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331756,"statfs":{"total":96636764160,"available":96595718144,"internally_reserved":0,"allocated":589824,"data_stored":235383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509483,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44244,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327596,"statfs":{"total":96636764160,"available":96591458304,"internally_reserved":0,"allocated":581632,"data_stored":235291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509482,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40648,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331192,"statfs":{"total":96636764160,"available":96595140608,"internally_reserved":0,"allocated":1167360,"data_stored":824117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509484,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35916,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335924,"statfs":{"total":96636764160,"available":96599986176,"internally_reserved":0,"allocated":577536,"data_stored":234351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542188,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40652,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331188,"statfs":{"total":96636764160,"available":96595136512,"internally_reserved":0,"allocated":1167360,"data_stored":824069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:35:19.533 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:35:19.538 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:35:21.226 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:35:21.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.465+0000 7f3eee600640 1 -- 172.21.15.42:0/4029067324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ee80b4be0 msgr2=0x7f3ee815d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:21.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.465+0000 7f3eee600640 1 --2- 172.21.15.42:0/4029067324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ee80b4be0 0x7f3ee815d6b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3ee80b4870 tx=0x7f3edc02a560 comp rx=0 tx=0).stop 2024-09-17T01:35:21.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.465+0000 7f3eee600640 1 -- 172.21.15.42:0/4029067324 shutdown_connections 2024-09-17T01:35:21.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.465+0000 7f3eee600640 1 --2- 172.21.15.42:0/4029067324 >> v2:172.21.15.43:3300/0 conn(0x7f3ee80cf7c0 0x7f3ee806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:21.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.465+0000 7f3eee600640 1 --2- 172.21.15.42:0/4029067324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ee80b4be0 0x7f3ee815d6b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:21.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.465+0000 7f3eee600640 1 -- 172.21.15.42:0/4029067324 >> 172.21.15.42:0/4029067324 conn(0x7f3ee80b25f0 msgr2=0x7f3ee80d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:21.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.466+0000 7f3eee600640 1 -- 172.21.15.42:0/4029067324 shutdown_connections 2024-09-17T01:35:21.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.466+0000 7f3eee600640 1 -- 172.21.15.42:0/4029067324 wait complete. 2024-09-17T01:35:21.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.468+0000 7f3eee600640 1 Processor -- start 2024-09-17T01:35:21.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.468+0000 7f3eee600640 1 -- start start 2024-09-17T01:35:21.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.469+0000 7f3eee600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3ee806d260 0x7f3ee8148810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:21.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.469+0000 7f3eee600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ee80b4be0 0x7f3ee81e4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:21.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.469+0000 7f3eee600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ee80cf7c0 0x7f3ee80ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:21.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.469+0000 7f3eee600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee8153970 con 0x7f3ee80cf7c0 2024-09-17T01:35:21.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.469+0000 7f3eee600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee81537f0 con 0x7f3ee80b4be0 2024-09-17T01:35:21.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.469+0000 7f3eee600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3ee8153af0 con 0x7f3ee806d260 2024-09-17T01:35:21.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.470+0000 7f3eedc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ee80cf7c0 0x7f3ee80ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:21.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.470+0000 7f3eedc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ee80cf7c0 0x7f3ee80ae0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52818/0 (socket says 172.21.15.42:52818) 2024-09-17T01:35:21.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.470+0000 7f3eedc00640 1 -- 172.21.15.42:0/2496279017 learned_addr learned my addr 172.21.15.42:0/2496279017 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:21.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.470+0000 7f3eed200640 1 --2- 172.21.15.42:0/2496279017 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3ee806d260 0x7f3ee8148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:21.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.470+0000 7f3ee7e00640 1 --2- 172.21.15.42:0/2496279017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ee80b4be0 0x7f3ee81e4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:21.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.470+0000 7f3eedc00640 1 -- 172.21.15.42:0/2496279017 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3ee806d260 msgr2=0x7f3ee8148810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:21.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.470+0000 7f3eedc00640 1 --2- 172.21.15.42:0/2496279017 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3ee806d260 0x7f3ee8148810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:21.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.470+0000 7f3eedc00640 1 -- 172.21.15.42:0/2496279017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ee80b4be0 msgr2=0x7f3ee81e4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:21.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.470+0000 7f3eedc00640 1 --2- 172.21.15.42:0/2496279017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ee80b4be0 0x7f3ee81e4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:21.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.470+0000 7f3eedc00640 1 -- 172.21.15.42:0/2496279017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee81e5400 con 0x7f3ee80cf7c0 2024-09-17T01:35:21.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.471+0000 7f3eedc00640 1 --2- 172.21.15.42:0/2496279017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ee80cf7c0 0x7f3ee80ae0d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000b9e0 tx=0x7f3ee000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:21.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.471+0000 7f3ee4c00640 1 -- 172.21.15.42:0/2496279017 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0003b70 con 0x7f3ee80cf7c0 2024-09-17T01:35:21.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.471+0000 7f3ee4c00640 1 -- 172.21.15.42:0/2496279017 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ee0003e00 con 0x7f3ee80cf7c0 2024-09-17T01:35:21.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.471+0000 7f3ee4c00640 1 -- 172.21.15.42:0/2496279017 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee000cb80 con 0x7f3ee80cf7c0 2024-09-17T01:35:21.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.471+0000 7f3eee600640 1 -- 172.21.15.42:0/2496279017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ee80725d0 con 0x7f3ee80cf7c0 2024-09-17T01:35:21.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.471+0000 7f3eee600640 1 -- 172.21.15.42:0/2496279017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ee8072b90 con 0x7f3ee80cf7c0 2024-09-17T01:35:21.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.472+0000 7f3eee600640 1 -- 172.21.15.42:0/2496279017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ee815d6b0 con 0x7f3ee80cf7c0 2024-09-17T01:35:21.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.473+0000 7f3ee4c00640 1 -- 172.21.15.42:0/2496279017 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3ee0004000 con 0x7f3ee80cf7c0 2024-09-17T01:35:21.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.475+0000 7f3ee4c00640 1 --2- 172.21.15.42:0/2496279017 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3ec8078b90 0x7f3ec807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:21.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.475+0000 7f3ee4c00640 1 -- 172.21.15.42:0/2496279017 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f3ee009ab90 con 0x7f3ee80cf7c0 2024-09-17T01:35:21.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.475+0000 7f3eed200640 1 --2- 172.21.15.42:0/2496279017 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3ec8078b90 0x7f3ec807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:21.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.476+0000 7f3eed200640 1 --2- 172.21.15.42:0/2496279017 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3ec8078b90 0x7f3ec807b0a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3edc033000 tx=0x7f3edc004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:21.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.480+0000 7f3ee4c00640 1 -- 172.21.15.42:0/2496279017 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3ee0062970 con 0x7f3ee80cf7c0 2024-09-17T01:35:21.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.671+0000 7f3eee600640 1 -- 172.21.15.42:0/2496279017 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3ee80b33d0 con 0x7f3ec8078b90 2024-09-17T01:35:21.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.677+0000 7f3ee4c00640 1 -- 172.21.15.42:0/2496279017 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f3ee80b33d0 con 0x7f3ec8078b90 2024-09-17T01:35:21.678 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:35:21.680 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:35:21.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.681+0000 7f3eee600640 1 -- 172.21.15.42:0/2496279017 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3ec8078b90 msgr2=0x7f3ec807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:21.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.681+0000 7f3eee600640 1 --2- 172.21.15.42:0/2496279017 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3ec8078b90 0x7f3ec807b0a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3edc033000 tx=0x7f3edc004730 comp rx=0 tx=0).stop 2024-09-17T01:35:21.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.681+0000 7f3eee600640 1 -- 172.21.15.42:0/2496279017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ee80cf7c0 msgr2=0x7f3ee80ae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:21.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.681+0000 7f3eee600640 1 --2- 172.21.15.42:0/2496279017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ee80cf7c0 0x7f3ee80ae0d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000b9e0 tx=0x7f3ee000bea0 comp rx=0 tx=0).stop 2024-09-17T01:35:21.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.681+0000 7f3eee600640 1 -- 172.21.15.42:0/2496279017 shutdown_connections 2024-09-17T01:35:21.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.681+0000 7f3eee600640 1 --2- 172.21.15.42:0/2496279017 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3ec8078b90 0x7f3ec807b0a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:21.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.681+0000 7f3eee600640 1 --2- 172.21.15.42:0/2496279017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ee80b4be0 0x7f3ee81e4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:21.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.681+0000 7f3eee600640 1 --2- 172.21.15.42:0/2496279017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ee80cf7c0 0x7f3ee80ae0d0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:21.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.681+0000 7f3eee600640 1 --2- 172.21.15.42:0/2496279017 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3ee806d260 0x7f3ee8148810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:21.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.681+0000 7f3eee600640 1 -- 172.21.15.42:0/2496279017 >> 172.21.15.42:0/2496279017 conn(0x7f3ee80b25f0 msgr2=0x7f3ee80b1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:21.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.681+0000 7f3eee600640 1 -- 172.21.15.42:0/2496279017 shutdown_connections 2024-09-17T01:35:21.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.681+0000 7f3eee600640 1 -- 172.21.15.42:0/2496279017 wait complete. 2024-09-17T01:35:21.701 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-09-17T01:35:21.030360+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":317592,"kb_used_data":5672,"kb_used_omap":12,"kb_used_meta":311731,"kb_avail":754657128,"statfs":{"total":773094113280,"available":772768899072,"internally_reserved":0,"allocated":5808128,"data_stored":3054988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":319213108},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.376416"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166861+0000","last_change":"2024-09-17T01:35:11.679886+0000","last_active":"2024-09-17T01:35:13.166861+0000","last_peered":"2024-09-17T01:35:13.166861+0000","last_clean":"2024-09-17T01:35:13.166861+0000","last_became_active":"2024-09-17T01:35:11.679571+0000","last_became_peered":"2024-09-17T01:35:11.679571+0000","last_unstale":"2024-09-17T01:35:13.166861+0000","last_undegraded":"2024-09-17T01:35:13.166861+0000","last_fullsized":"2024-09-17T01:35:13.166861+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:35:44.406490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.798095+0000","last_change":"2024-09-17T01:35:11.669384+0000","last_active":"2024-09-17T01:35:12.798095+0000","last_peered":"2024-09-17T01:35:12.798095+0000","last_clean":"2024-09-17T01:35:12.798095+0000","last_became_active":"2024-09-17T01:35:11.668632+0000","last_became_peered":"2024-09-17T01:35:11.668632+0000","last_unstale":"2024-09-17T01:35:12.798095+0000","last_undegraded":"2024-09-17T01:35:12.798095+0000","last_fullsized":"2024-09-17T01:35:12.798095+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:38.661375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665916+0000","last_change":"2024-09-17T01:35:11.677052+0000","last_active":"2024-09-17T01:35:12.665916+0000","last_peered":"2024-09-17T01:35:12.665916+0000","last_clean":"2024-09-17T01:35:12.665916+0000","last_became_active":"2024-09-17T01:35:11.676449+0000","last_became_peered":"2024-09-17T01:35:11.676449+0000","last_unstale":"2024-09-17T01:35:12.665916+0000","last_undegraded":"2024-09-17T01:35:12.665916+0000","last_fullsized":"2024-09-17T01:35:12.665916+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:02.322600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693381+0000","last_change":"2024-09-17T01:35:11.689284+0000","last_active":"2024-09-17T01:35:12.693381+0000","last_peered":"2024-09-17T01:35:12.693381+0000","last_clean":"2024-09-17T01:35:12.693381+0000","last_became_active":"2024-09-17T01:35:11.688877+0000","last_became_peered":"2024-09-17T01:35:11.688877+0000","last_unstale":"2024-09-17T01:35:12.693381+0000","last_undegraded":"2024-09-17T01:35:12.693381+0000","last_fullsized":"2024-09-17T01:35:12.693381+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:50.547621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166637+0000","last_change":"2024-09-17T01:35:11.686633+0000","last_active":"2024-09-17T01:35:13.166637+0000","last_peered":"2024-09-17T01:35:13.166637+0000","last_clean":"2024-09-17T01:35:13.166637+0000","last_became_active":"2024-09-17T01:35:11.684636+0000","last_became_peered":"2024-09-17T01:35:11.684636+0000","last_unstale":"2024-09-17T01:35:13.166637+0000","last_undegraded":"2024-09-17T01:35:13.166637+0000","last_fullsized":"2024-09-17T01:35:13.166637+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:17.721407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668732+0000","last_change":"2024-09-17T01:35:11.681613+0000","last_active":"2024-09-17T01:35:12.668732+0000","last_peered":"2024-09-17T01:35:12.668732+0000","last_clean":"2024-09-17T01:35:12.668732+0000","last_became_active":"2024-09-17T01:35:11.681218+0000","last_became_peered":"2024-09-17T01:35:11.681218+0000","last_unstale":"2024-09-17T01:35:12.668732+0000","last_undegraded":"2024-09-17T01:35:12.668732+0000","last_fullsized":"2024-09-17T01:35:12.668732+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:49.882671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696431+0000","last_change":"2024-09-17T01:35:11.680337+0000","last_active":"2024-09-17T01:35:12.696431+0000","last_peered":"2024-09-17T01:35:12.696431+0000","last_clean":"2024-09-17T01:35:12.696431+0000","last_became_active":"2024-09-17T01:35:11.680026+0000","last_became_peered":"2024-09-17T01:35:11.680026+0000","last_unstale":"2024-09-17T01:35:12.696431+0000","last_undegraded":"2024-09-17T01:35:12.696431+0000","last_fullsized":"2024-09-17T01:35:12.696431+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:05:04.721108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693368+0000","last_change":"2024-09-17T01:35:11.675558+0000","last_active":"2024-09-17T01:35:12.693368+0000","last_peered":"2024-09-17T01:35:12.693368+0000","last_clean":"2024-09-17T01:35:12.693368+0000","last_became_active":"2024-09-17T01:35:11.675027+0000","last_became_peered":"2024-09-17T01:35:11.675027+0000","last_unstale":"2024-09-17T01:35:12.693368+0000","last_undegraded":"2024-09-17T01:35:12.693368+0000","last_fullsized":"2024-09-17T01:35:12.693368+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:41.955029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668628+0000","last_change":"2024-09-17T01:35:11.686595+0000","last_active":"2024-09-17T01:35:12.668628+0000","last_peered":"2024-09-17T01:35:12.668628+0000","last_clean":"2024-09-17T01:35:12.668628+0000","last_became_active":"2024-09-17T01:35:11.686231+0000","last_became_peered":"2024-09-17T01:35:11.686231+0000","last_unstale":"2024-09-17T01:35:12.668628+0000","last_undegraded":"2024-09-17T01:35:12.668628+0000","last_fullsized":"2024-09-17T01:35:12.668628+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:08.753759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668301+0000","last_change":"2024-09-17T01:35:11.667098+0000","last_active":"2024-09-17T01:35:12.668301+0000","last_peered":"2024-09-17T01:35:12.668301+0000","last_clean":"2024-09-17T01:35:12.668301+0000","last_became_active":"2024-09-17T01:35:11.666559+0000","last_became_peered":"2024-09-17T01:35:11.666559+0000","last_unstale":"2024-09-17T01:35:12.668301+0000","last_undegraded":"2024-09-17T01:35:12.668301+0000","last_fullsized":"2024-09-17T01:35:12.668301+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:08.755783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693835+0000","last_change":"2024-09-17T01:35:11.691137+0000","last_active":"2024-09-17T01:35:12.693835+0000","last_peered":"2024-09-17T01:35:12.693835+0000","last_clean":"2024-09-17T01:35:12.693835+0000","last_became_active":"2024-09-17T01:35:11.690602+0000","last_became_peered":"2024-09-17T01:35:11.690602+0000","last_unstale":"2024-09-17T01:35:12.693835+0000","last_undegraded":"2024-09-17T01:35:12.693835+0000","last_fullsized":"2024-09-17T01:35:12.693835+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:38.506225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.798281+0000","last_change":"2024-09-17T01:35:11.669729+0000","last_active":"2024-09-17T01:35:12.798281+0000","last_peered":"2024-09-17T01:35:12.798281+0000","last_clean":"2024-09-17T01:35:12.798281+0000","last_became_active":"2024-09-17T01:35:11.669057+0000","last_became_peered":"2024-09-17T01:35:11.669057+0000","last_unstale":"2024-09-17T01:35:12.798281+0000","last_undegraded":"2024-09-17T01:35:12.798281+0000","last_fullsized":"2024-09-17T01:35:12.798281+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:40.883493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668910+0000","last_change":"2024-09-17T01:35:11.682294+0000","last_active":"2024-09-17T01:35:12.668910+0000","last_peered":"2024-09-17T01:35:12.668910+0000","last_clean":"2024-09-17T01:35:12.668910+0000","last_became_active":"2024-09-17T01:35:11.681948+0000","last_became_peered":"2024-09-17T01:35:11.681948+0000","last_unstale":"2024-09-17T01:35:12.668910+0000","last_undegraded":"2024-09-17T01:35:12.668910+0000","last_fullsized":"2024-09-17T01:35:12.668910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:51.076106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693756+0000","last_change":"2024-09-17T01:35:11.684238+0000","last_active":"2024-09-17T01:35:12.693756+0000","last_peered":"2024-09-17T01:35:12.693756+0000","last_clean":"2024-09-17T01:35:12.693756+0000","last_became_active":"2024-09-17T01:35:11.683881+0000","last_became_peered":"2024-09-17T01:35:11.683881+0000","last_unstale":"2024-09-17T01:35:12.693756+0000","last_undegraded":"2024-09-17T01:35:12.693756+0000","last_fullsized":"2024-09-17T01:35:12.693756+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:08.054097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693215+0000","last_change":"2024-09-17T01:35:11.675869+0000","last_active":"2024-09-17T01:35:12.693215+0000","last_peered":"2024-09-17T01:35:12.693215+0000","last_clean":"2024-09-17T01:35:12.693215+0000","last_became_active":"2024-09-17T01:35:11.675515+0000","last_became_peered":"2024-09-17T01:35:11.675515+0000","last_unstale":"2024-09-17T01:35:12.693215+0000","last_undegraded":"2024-09-17T01:35:12.693215+0000","last_fullsized":"2024-09-17T01:35:12.693215+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:19.830835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166406+0000","last_change":"2024-09-17T01:35:11.682552+0000","last_active":"2024-09-17T01:35:13.166406+0000","last_peered":"2024-09-17T01:35:13.166406+0000","last_clean":"2024-09-17T01:35:13.166406+0000","last_became_active":"2024-09-17T01:35:11.680943+0000","last_became_peered":"2024-09-17T01:35:11.680943+0000","last_unstale":"2024-09-17T01:35:13.166406+0000","last_undegraded":"2024-09-17T01:35:13.166406+0000","last_fullsized":"2024-09-17T01:35:13.166406+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:44:50.417740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.798152+0000","last_change":"2024-09-17T01:35:11.685292+0000","last_active":"2024-09-17T01:35:12.798152+0000","last_peered":"2024-09-17T01:35:12.798152+0000","last_clean":"2024-09-17T01:35:12.798152+0000","last_became_active":"2024-09-17T01:35:11.684950+0000","last_became_peered":"2024-09-17T01:35:11.684950+0000","last_unstale":"2024-09-17T01:35:12.798152+0000","last_undegraded":"2024-09-17T01:35:12.798152+0000","last_fullsized":"2024-09-17T01:35:12.798152+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:16.816739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666193+0000","last_change":"2024-09-17T01:35:11.685570+0000","last_active":"2024-09-17T01:35:12.666193+0000","last_peered":"2024-09-17T01:35:12.666193+0000","last_clean":"2024-09-17T01:35:12.666193+0000","last_became_active":"2024-09-17T01:35:11.685257+0000","last_became_peered":"2024-09-17T01:35:11.685257+0000","last_unstale":"2024-09-17T01:35:12.666193+0000","last_undegraded":"2024-09-17T01:35:12.666193+0000","last_fullsized":"2024-09-17T01:35:12.666193+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:30.801288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166734+0000","last_change":"2024-09-17T01:35:11.690839+0000","last_active":"2024-09-17T01:35:13.166734+0000","last_peered":"2024-09-17T01:35:13.166734+0000","last_clean":"2024-09-17T01:35:13.166734+0000","last_became_active":"2024-09-17T01:35:11.690498+0000","last_became_peered":"2024-09-17T01:35:11.690498+0000","last_unstale":"2024-09-17T01:35:13.166734+0000","last_undegraded":"2024-09-17T01:35:13.166734+0000","last_fullsized":"2024-09-17T01:35:13.166734+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:11.517652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667435+0000","last_change":"2024-09-17T01:35:11.669110+0000","last_active":"2024-09-17T01:35:12.667435+0000","last_peered":"2024-09-17T01:35:12.667435+0000","last_clean":"2024-09-17T01:35:12.667435+0000","last_became_active":"2024-09-17T01:35:11.668359+0000","last_became_peered":"2024-09-17T01:35:11.668359+0000","last_unstale":"2024-09-17T01:35:12.667435+0000","last_undegraded":"2024-09-17T01:35:12.667435+0000","last_fullsized":"2024-09-17T01:35:12.667435+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:07:06.732155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693613+0000","last_change":"2024-09-17T01:35:11.678510+0000","last_active":"2024-09-17T01:35:12.693613+0000","last_peered":"2024-09-17T01:35:12.693613+0000","last_clean":"2024-09-17T01:35:12.693613+0000","last_became_active":"2024-09-17T01:35:11.678067+0000","last_became_peered":"2024-09-17T01:35:11.678067+0000","last_unstale":"2024-09-17T01:35:12.693613+0000","last_undegraded":"2024-09-17T01:35:12.693613+0000","last_fullsized":"2024-09-17T01:35:12.693613+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:17.926468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166985+0000","last_change":"2024-09-17T01:35:11.675603+0000","last_active":"2024-09-17T01:35:13.166985+0000","last_peered":"2024-09-17T01:35:13.166985+0000","last_clean":"2024-09-17T01:35:13.166985+0000","last_became_active":"2024-09-17T01:35:11.675290+0000","last_became_peered":"2024-09-17T01:35:11.675290+0000","last_unstale":"2024-09-17T01:35:13.166985+0000","last_undegraded":"2024-09-17T01:35:13.166985+0000","last_fullsized":"2024-09-17T01:35:13.166985+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:04.530089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696764+0000","last_change":"2024-09-17T01:35:11.668987+0000","last_active":"2024-09-17T01:35:12.696764+0000","last_peered":"2024-09-17T01:35:12.696764+0000","last_clean":"2024-09-17T01:35:12.696764+0000","last_became_active":"2024-09-17T01:35:11.668644+0000","last_became_peered":"2024-09-17T01:35:11.668644+0000","last_unstale":"2024-09-17T01:35:12.696764+0000","last_undegraded":"2024-09-17T01:35:12.696764+0000","last_fullsized":"2024-09-17T01:35:12.696764+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:28:33.791232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.798013+0000","last_change":"2024-09-17T01:35:11.677804+0000","last_active":"2024-09-17T01:35:12.798013+0000","last_peered":"2024-09-17T01:35:12.798013+0000","last_clean":"2024-09-17T01:35:12.798013+0000","last_became_active":"2024-09-17T01:35:11.676351+0000","last_became_peered":"2024-09-17T01:35:11.676351+0000","last_unstale":"2024-09-17T01:35:12.798013+0000","last_undegraded":"2024-09-17T01:35:12.798013+0000","last_fullsized":"2024-09-17T01:35:12.798013+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:21.153437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166850+0000","last_change":"2024-09-17T01:35:11.678418+0000","last_active":"2024-09-17T01:35:13.166850+0000","last_peered":"2024-09-17T01:35:13.166850+0000","last_clean":"2024-09-17T01:35:13.166850+0000","last_became_active":"2024-09-17T01:35:11.678096+0000","last_became_peered":"2024-09-17T01:35:11.678096+0000","last_unstale":"2024-09-17T01:35:13.166850+0000","last_undegraded":"2024-09-17T01:35:13.166850+0000","last_fullsized":"2024-09-17T01:35:13.166850+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:24.131701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693997+0000","last_change":"2024-09-17T01:35:11.687021+0000","last_active":"2024-09-17T01:35:12.693997+0000","last_peered":"2024-09-17T01:35:12.693997+0000","last_clean":"2024-09-17T01:35:12.693997+0000","last_became_active":"2024-09-17T01:35:11.685533+0000","last_became_peered":"2024-09-17T01:35:11.685533+0000","last_unstale":"2024-09-17T01:35:12.693997+0000","last_undegraded":"2024-09-17T01:35:12.693997+0000","last_fullsized":"2024-09-17T01:35:12.693997+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:20.511127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696562+0000","last_change":"2024-09-17T01:35:11.673221+0000","last_active":"2024-09-17T01:35:12.696562+0000","last_peered":"2024-09-17T01:35:12.696562+0000","last_clean":"2024-09-17T01:35:12.696562+0000","last_became_active":"2024-09-17T01:35:11.670852+0000","last_became_peered":"2024-09-17T01:35:11.670852+0000","last_unstale":"2024-09-17T01:35:12.696562+0000","last_undegraded":"2024-09-17T01:35:12.696562+0000","last_fullsized":"2024-09-17T01:35:12.696562+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:40.426585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696743+0000","last_change":"2024-09-17T01:35:11.671861+0000","last_active":"2024-09-17T01:35:12.696743+0000","last_peered":"2024-09-17T01:35:12.696743+0000","last_clean":"2024-09-17T01:35:12.696743+0000","last_became_active":"2024-09-17T01:35:11.671539+0000","last_became_peered":"2024-09-17T01:35:11.671539+0000","last_unstale":"2024-09-17T01:35:12.696743+0000","last_undegraded":"2024-09-17T01:35:12.696743+0000","last_fullsized":"2024-09-17T01:35:12.696743+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:59.339611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166574+0000","last_change":"2024-09-17T01:35:11.687865+0000","last_active":"2024-09-17T01:35:13.166574+0000","last_peered":"2024-09-17T01:35:13.166574+0000","last_clean":"2024-09-17T01:35:13.166574+0000","last_became_active":"2024-09-17T01:35:11.684764+0000","last_became_peered":"2024-09-17T01:35:11.684764+0000","last_unstale":"2024-09-17T01:35:13.166574+0000","last_undegraded":"2024-09-17T01:35:13.166574+0000","last_fullsized":"2024-09-17T01:35:13.166574+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:35.323990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.797854+0000","last_change":"2024-09-17T01:35:11.670525+0000","last_active":"2024-09-17T01:35:12.797854+0000","last_peered":"2024-09-17T01:35:12.797854+0000","last_clean":"2024-09-17T01:35:12.797854+0000","last_became_active":"2024-09-17T01:35:11.669140+0000","last_became_peered":"2024-09-17T01:35:11.669140+0000","last_unstale":"2024-09-17T01:35:12.797854+0000","last_undegraded":"2024-09-17T01:35:12.797854+0000","last_fullsized":"2024-09-17T01:35:12.797854+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:36.476274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666875+0000","last_change":"2024-09-17T01:35:11.676283+0000","last_active":"2024-09-17T01:35:12.666875+0000","last_peered":"2024-09-17T01:35:12.666875+0000","last_clean":"2024-09-17T01:35:12.666875+0000","last_became_active":"2024-09-17T01:35:11.675947+0000","last_became_peered":"2024-09-17T01:35:11.675947+0000","last_unstale":"2024-09-17T01:35:12.666875+0000","last_undegraded":"2024-09-17T01:35:12.666875+0000","last_fullsized":"2024-09-17T01:35:12.666875+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:39.573816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693187+0000","last_change":"2024-09-17T01:35:11.678889+0000","last_active":"2024-09-17T01:35:12.693187+0000","last_peered":"2024-09-17T01:35:12.693187+0000","last_clean":"2024-09-17T01:35:12.693187+0000","last_became_active":"2024-09-17T01:35:11.678542+0000","last_became_peered":"2024-09-17T01:35:11.678542+0000","last_unstale":"2024-09-17T01:35:12.693187+0000","last_undegraded":"2024-09-17T01:35:12.693187+0000","last_fullsized":"2024-09-17T01:35:12.693187+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:18.255811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.167081+0000","last_change":"2024-09-17T01:35:11.670813+0000","last_active":"2024-09-17T01:35:13.167081+0000","last_peered":"2024-09-17T01:35:13.167081+0000","last_clean":"2024-09-17T01:35:13.167081+0000","last_became_active":"2024-09-17T01:35:11.670399+0000","last_became_peered":"2024-09-17T01:35:11.670399+0000","last_unstale":"2024-09-17T01:35:13.167081+0000","last_undegraded":"2024-09-17T01:35:13.167081+0000","last_fullsized":"2024-09-17T01:35:13.167081+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:51.896304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"48'4","reported_seq":19,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668630+0000","last_change":"2024-09-17T01:35:10.676051+0000","last_active":"2024-09-17T01:35:12.668630+0000","last_peered":"2024-09-17T01:35:12.668630+0000","last_clean":"2024-09-17T01:35:12.668630+0000","last_became_active":"2024-09-17T01:35:10.675678+0000","last_became_peered":"2024-09-17T01:35:10.675678+0000","last_unstale":"2024-09-17T01:35:12.668630+0000","last_undegraded":"2024-09-17T01:35:12.668630+0000","last_fullsized":"2024-09-17T01:35:12.668630+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:29.304564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166984+0000","last_change":"2024-09-17T01:35:11.688201+0000","last_active":"2024-09-17T01:35:13.166984+0000","last_peered":"2024-09-17T01:35:13.166984+0000","last_clean":"2024-09-17T01:35:13.166984+0000","last_became_active":"2024-09-17T01:35:11.684393+0000","last_became_peered":"2024-09-17T01:35:11.684393+0000","last_unstale":"2024-09-17T01:35:13.166984+0000","last_undegraded":"2024-09-17T01:35:13.166984+0000","last_fullsized":"2024-09-17T01:35:13.166984+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:36:30.634041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696918+0000","last_change":"2024-09-17T01:35:10.669339+0000","last_active":"2024-09-17T01:35:12.696918+0000","last_peered":"2024-09-17T01:35:12.696918+0000","last_clean":"2024-09-17T01:35:12.696918+0000","last_became_active":"2024-09-17T01:35:10.666719+0000","last_became_peered":"2024-09-17T01:35:10.666719+0000","last_unstale":"2024-09-17T01:35:12.696918+0000","last_undegraded":"2024-09-17T01:35:12.696918+0000","last_fullsized":"2024-09-17T01:35:12.696918+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:11.436388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.798456+0000","last_change":"2024-09-17T01:35:11.671915+0000","last_active":"2024-09-17T01:35:12.798456+0000","last_peered":"2024-09-17T01:35:12.798456+0000","last_clean":"2024-09-17T01:35:12.798456+0000","last_became_active":"2024-09-17T01:35:11.669856+0000","last_became_peered":"2024-09-17T01:35:11.669856+0000","last_unstale":"2024-09-17T01:35:12.798456+0000","last_undegraded":"2024-09-17T01:35:12.798456+0000","last_fullsized":"2024-09-17T01:35:12.798456+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:55:08.951179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668026+0000","last_change":"2024-09-17T01:35:10.682029+0000","last_active":"2024-09-17T01:35:12.668026+0000","last_peered":"2024-09-17T01:35:12.668026+0000","last_clean":"2024-09-17T01:35:12.668026+0000","last_became_active":"2024-09-17T01:35:10.681689+0000","last_became_peered":"2024-09-17T01:35:10.681689+0000","last_unstale":"2024-09-17T01:35:12.668026+0000","last_undegraded":"2024-09-17T01:35:12.668026+0000","last_fullsized":"2024-09-17T01:35:12.668026+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:10.562332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693888+0000","last_change":"2024-09-17T01:35:11.690091+0000","last_active":"2024-09-17T01:35:12.693888+0000","last_peered":"2024-09-17T01:35:12.693888+0000","last_clean":"2024-09-17T01:35:12.693888+0000","last_became_active":"2024-09-17T01:35:11.688955+0000","last_became_peered":"2024-09-17T01:35:11.688955+0000","last_unstale":"2024-09-17T01:35:12.693888+0000","last_undegraded":"2024-09-17T01:35:12.693888+0000","last_fullsized":"2024-09-17T01:35:12.693888+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:30.638574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696617+0000","last_change":"2024-09-17T01:35:10.672378+0000","last_active":"2024-09-17T01:35:12.696617+0000","last_peered":"2024-09-17T01:35:12.696617+0000","last_clean":"2024-09-17T01:35:12.696617+0000","last_became_active":"2024-09-17T01:35:10.670878+0000","last_became_peered":"2024-09-17T01:35:10.670878+0000","last_unstale":"2024-09-17T01:35:12.696617+0000","last_undegraded":"2024-09-17T01:35:12.696617+0000","last_fullsized":"2024-09-17T01:35:12.696617+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:44:02.998010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696488+0000","last_change":"2024-09-17T01:35:11.672199+0000","last_active":"2024-09-17T01:35:12.696488+0000","last_peered":"2024-09-17T01:35:12.696488+0000","last_clean":"2024-09-17T01:35:12.696488+0000","last_became_active":"2024-09-17T01:35:11.671902+0000","last_became_peered":"2024-09-17T01:35:11.671902+0000","last_unstale":"2024-09-17T01:35:12.696488+0000","last_undegraded":"2024-09-17T01:35:12.696488+0000","last_fullsized":"2024-09-17T01:35:12.696488+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:40.681886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668842+0000","last_change":"2024-09-17T01:35:10.666527+0000","last_active":"2024-09-17T01:35:12.668842+0000","last_peered":"2024-09-17T01:35:12.668842+0000","last_clean":"2024-09-17T01:35:12.668842+0000","last_became_active":"2024-09-17T01:35:10.666251+0000","last_became_peered":"2024-09-17T01:35:10.666251+0000","last_unstale":"2024-09-17T01:35:12.668842+0000","last_undegraded":"2024-09-17T01:35:12.668842+0000","last_fullsized":"2024-09-17T01:35:12.668842+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:08.974997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667219+0000","last_change":"2024-09-17T01:35:11.679799+0000","last_active":"2024-09-17T01:35:12.667219+0000","last_peered":"2024-09-17T01:35:12.667219+0000","last_clean":"2024-09-17T01:35:12.667219+0000","last_became_active":"2024-09-17T01:35:11.675735+0000","last_became_peered":"2024-09-17T01:35:11.675735+0000","last_unstale":"2024-09-17T01:35:12.667219+0000","last_undegraded":"2024-09-17T01:35:12.667219+0000","last_fullsized":"2024-09-17T01:35:12.667219+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:53.242251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696421+0000","last_change":"2024-09-17T01:35:10.683902+0000","last_active":"2024-09-17T01:35:12.696421+0000","last_peered":"2024-09-17T01:35:12.696421+0000","last_clean":"2024-09-17T01:35:12.696421+0000","last_became_active":"2024-09-17T01:35:10.683540+0000","last_became_peered":"2024-09-17T01:35:10.683540+0000","last_unstale":"2024-09-17T01:35:12.696421+0000","last_undegraded":"2024-09-17T01:35:12.696421+0000","last_fullsized":"2024-09-17T01:35:12.696421+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:14:50.086073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666898+0000","last_change":"2024-09-17T01:35:11.667959+0000","last_active":"2024-09-17T01:35:12.666898+0000","last_peered":"2024-09-17T01:35:12.666898+0000","last_clean":"2024-09-17T01:35:12.666898+0000","last_became_active":"2024-09-17T01:35:11.667618+0000","last_became_peered":"2024-09-17T01:35:11.667618+0000","last_unstale":"2024-09-17T01:35:12.666898+0000","last_undegraded":"2024-09-17T01:35:12.666898+0000","last_fullsized":"2024-09-17T01:35:12.666898+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:06.513791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166436+0000","last_change":"2024-09-17T01:35:10.683282+0000","last_active":"2024-09-17T01:35:13.166436+0000","last_peered":"2024-09-17T01:35:13.166436+0000","last_clean":"2024-09-17T01:35:13.166436+0000","last_became_active":"2024-09-17T01:35:10.682938+0000","last_became_peered":"2024-09-17T01:35:10.682938+0000","last_unstale":"2024-09-17T01:35:13.166436+0000","last_undegraded":"2024-09-17T01:35:13.166436+0000","last_fullsized":"2024-09-17T01:35:13.166436+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:31.273868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696437+0000","last_change":"2024-09-17T01:35:11.682324+0000","last_active":"2024-09-17T01:35:12.696437+0000","last_peered":"2024-09-17T01:35:12.696437+0000","last_clean":"2024-09-17T01:35:12.696437+0000","last_became_active":"2024-09-17T01:35:11.682037+0000","last_became_peered":"2024-09-17T01:35:11.682037+0000","last_unstale":"2024-09-17T01:35:12.696437+0000","last_undegraded":"2024-09-17T01:35:12.696437+0000","last_fullsized":"2024-09-17T01:35:12.696437+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:08.755783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666831+0000","last_change":"2024-09-17T01:35:10.676447+0000","last_active":"2024-09-17T01:35:12.666831+0000","last_peered":"2024-09-17T01:35:12.666831+0000","last_clean":"2024-09-17T01:35:12.666831+0000","last_became_active":"2024-09-17T01:35:10.676026+0000","last_became_peered":"2024-09-17T01:35:10.676026+0000","last_unstale":"2024-09-17T01:35:12.666831+0000","last_undegraded":"2024-09-17T01:35:12.666831+0000","last_fullsized":"2024-09-17T01:35:12.666831+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:36.004994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666229+0000","last_change":"2024-09-17T01:35:11.673386+0000","last_active":"2024-09-17T01:35:12.666229+0000","last_peered":"2024-09-17T01:35:12.666229+0000","last_clean":"2024-09-17T01:35:12.666229+0000","last_became_active":"2024-09-17T01:35:11.673001+0000","last_became_peered":"2024-09-17T01:35:11.673001+0000","last_unstale":"2024-09-17T01:35:12.666229+0000","last_undegraded":"2024-09-17T01:35:12.666229+0000","last_fullsized":"2024-09-17T01:35:12.666229+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:55.318960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665797+0000","last_change":"2024-09-17T01:35:10.669932+0000","last_active":"2024-09-17T01:35:12.665797+0000","last_peered":"2024-09-17T01:35:12.665797+0000","last_clean":"2024-09-17T01:35:12.665797+0000","last_became_active":"2024-09-17T01:35:10.669651+0000","last_became_peered":"2024-09-17T01:35:10.669651+0000","last_unstale":"2024-09-17T01:35:12.665797+0000","last_undegraded":"2024-09-17T01:35:12.665797+0000","last_fullsized":"2024-09-17T01:35:12.665797+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:55.136983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665664+0000","last_change":"2024-09-17T01:35:11.681534+0000","last_active":"2024-09-17T01:35:12.665664+0000","last_peered":"2024-09-17T01:35:12.665664+0000","last_clean":"2024-09-17T01:35:12.665664+0000","last_became_active":"2024-09-17T01:35:11.681247+0000","last_became_peered":"2024-09-17T01:35:11.681247+0000","last_unstale":"2024-09-17T01:35:12.665664+0000","last_undegraded":"2024-09-17T01:35:12.665664+0000","last_fullsized":"2024-09-17T01:35:12.665664+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:40.773263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668340+0000","last_change":"2024-09-17T01:35:10.679164+0000","last_active":"2024-09-17T01:35:12.668340+0000","last_peered":"2024-09-17T01:35:12.668340+0000","last_clean":"2024-09-17T01:35:12.668340+0000","last_became_active":"2024-09-17T01:35:10.677983+0000","last_became_peered":"2024-09-17T01:35:10.677983+0000","last_unstale":"2024-09-17T01:35:12.668340+0000","last_undegraded":"2024-09-17T01:35:12.668340+0000","last_fullsized":"2024-09-17T01:35:12.668340+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:31.801763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693799+0000","last_change":"2024-09-17T01:35:11.683421+0000","last_active":"2024-09-17T01:35:12.693799+0000","last_peered":"2024-09-17T01:35:12.693799+0000","last_clean":"2024-09-17T01:35:12.693799+0000","last_became_active":"2024-09-17T01:35:11.683075+0000","last_became_peered":"2024-09-17T01:35:11.683075+0000","last_unstale":"2024-09-17T01:35:12.693799+0000","last_undegraded":"2024-09-17T01:35:12.693799+0000","last_fullsized":"2024-09-17T01:35:12.693799+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:38.873835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"48'3","reported_seq":18,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.797908+0000","last_change":"2024-09-17T01:35:10.682143+0000","last_active":"2024-09-17T01:35:12.797908+0000","last_peered":"2024-09-17T01:35:12.797908+0000","last_clean":"2024-09-17T01:35:12.797908+0000","last_became_active":"2024-09-17T01:35:10.681743+0000","last_became_peered":"2024-09-17T01:35:10.681743+0000","last_unstale":"2024-09-17T01:35:12.797908+0000","last_undegraded":"2024-09-17T01:35:12.797908+0000","last_fullsized":"2024-09-17T01:35:12.797908+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:50.162612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696933+0000","last_change":"2024-09-17T01:35:11.678867+0000","last_active":"2024-09-17T01:35:12.696933+0000","last_peered":"2024-09-17T01:35:12.696933+0000","last_clean":"2024-09-17T01:35:12.696933+0000","last_became_active":"2024-09-17T01:35:11.678581+0000","last_became_peered":"2024-09-17T01:35:11.678581+0000","last_unstale":"2024-09-17T01:35:12.696933+0000","last_undegraded":"2024-09-17T01:35:12.696933+0000","last_fullsized":"2024-09-17T01:35:12.696933+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:30.558833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"48'6","reported_seq":21,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667586+0000","last_change":"2024-09-17T01:35:10.672677+0000","last_active":"2024-09-17T01:35:12.667586+0000","last_peered":"2024-09-17T01:35:12.667586+0000","last_clean":"2024-09-17T01:35:12.667586+0000","last_became_active":"2024-09-17T01:35:10.672338+0000","last_became_peered":"2024-09-17T01:35:10.672338+0000","last_unstale":"2024-09-17T01:35:12.667586+0000","last_undegraded":"2024-09-17T01:35:12.667586+0000","last_fullsized":"2024-09-17T01:35:12.667586+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:23.123246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665774+0000","last_change":"2024-09-17T01:35:11.675401+0000","last_active":"2024-09-17T01:35:12.665774+0000","last_peered":"2024-09-17T01:35:12.665774+0000","last_clean":"2024-09-17T01:35:12.665774+0000","last_became_active":"2024-09-17T01:35:11.674946+0000","last_became_peered":"2024-09-17T01:35:11.674946+0000","last_unstale":"2024-09-17T01:35:12.665774+0000","last_undegraded":"2024-09-17T01:35:12.665774+0000","last_fullsized":"2024-09-17T01:35:12.665774+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:16.229827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166584+0000","last_change":"2024-09-17T01:35:10.671105+0000","last_active":"2024-09-17T01:35:13.166584+0000","last_peered":"2024-09-17T01:35:13.166584+0000","last_clean":"2024-09-17T01:35:13.166584+0000","last_became_active":"2024-09-17T01:35:10.670646+0000","last_became_peered":"2024-09-17T01:35:10.670646+0000","last_unstale":"2024-09-17T01:35:13.166584+0000","last_undegraded":"2024-09-17T01:35:13.166584+0000","last_fullsized":"2024-09-17T01:35:13.166584+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:31.761461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166938+0000","last_change":"2024-09-17T01:35:11.671482+0000","last_active":"2024-09-17T01:35:13.166938+0000","last_peered":"2024-09-17T01:35:13.166938+0000","last_clean":"2024-09-17T01:35:13.166938+0000","last_became_active":"2024-09-17T01:35:11.671159+0000","last_became_peered":"2024-09-17T01:35:11.671159+0000","last_unstale":"2024-09-17T01:35:13.166938+0000","last_undegraded":"2024-09-17T01:35:13.166938+0000","last_fullsized":"2024-09-17T01:35:13.166938+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:22.007933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166393+0000","last_change":"2024-09-17T01:35:10.677803+0000","last_active":"2024-09-17T01:35:13.166393+0000","last_peered":"2024-09-17T01:35:13.166393+0000","last_clean":"2024-09-17T01:35:13.166393+0000","last_became_active":"2024-09-17T01:35:10.677510+0000","last_became_peered":"2024-09-17T01:35:10.677510+0000","last_unstale":"2024-09-17T01:35:13.166393+0000","last_undegraded":"2024-09-17T01:35:13.166393+0000","last_fullsized":"2024-09-17T01:35:13.166393+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:05:45.762431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166796+0000","last_change":"2024-09-17T01:35:11.673836+0000","last_active":"2024-09-17T01:35:13.166796+0000","last_peered":"2024-09-17T01:35:13.166796+0000","last_clean":"2024-09-17T01:35:13.166796+0000","last_became_active":"2024-09-17T01:35:11.669992+0000","last_became_peered":"2024-09-17T01:35:11.669992+0000","last_unstale":"2024-09-17T01:35:13.166796+0000","last_undegraded":"2024-09-17T01:35:13.166796+0000","last_fullsized":"2024-09-17T01:35:13.166796+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:40.901698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667026+0000","last_change":"2024-09-17T01:35:10.664520+0000","last_active":"2024-09-17T01:35:12.667026+0000","last_peered":"2024-09-17T01:35:12.667026+0000","last_clean":"2024-09-17T01:35:12.667026+0000","last_became_active":"2024-09-17T01:35:10.663413+0000","last_became_peered":"2024-09-17T01:35:10.663413+0000","last_unstale":"2024-09-17T01:35:12.667026+0000","last_undegraded":"2024-09-17T01:35:12.667026+0000","last_fullsized":"2024-09-17T01:35:12.667026+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:11.217933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.797847+0000","last_change":"2024-09-17T01:35:11.672649+0000","last_active":"2024-09-17T01:35:12.797847+0000","last_peered":"2024-09-17T01:35:12.797847+0000","last_clean":"2024-09-17T01:35:12.797847+0000","last_became_active":"2024-09-17T01:35:11.672408+0000","last_became_peered":"2024-09-17T01:35:11.672408+0000","last_unstale":"2024-09-17T01:35:12.797847+0000","last_undegraded":"2024-09-17T01:35:12.797847+0000","last_fullsized":"2024-09-17T01:35:12.797847+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:43.861115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"48'8","reported_seq":23,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668429+0000","last_change":"2024-09-17T01:35:10.668450+0000","last_active":"2024-09-17T01:35:12.668429+0000","last_peered":"2024-09-17T01:35:12.668429+0000","last_clean":"2024-09-17T01:35:12.668429+0000","last_became_active":"2024-09-17T01:35:10.668097+0000","last_became_peered":"2024-09-17T01:35:10.668097+0000","last_unstale":"2024-09-17T01:35:12.668429+0000","last_undegraded":"2024-09-17T01:35:12.668429+0000","last_fullsized":"2024-09-17T01:35:12.668429+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:52.159951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.167034+0000","last_change":"2024-09-17T01:35:11.677620+0000","last_active":"2024-09-17T01:35:13.167034+0000","last_peered":"2024-09-17T01:35:13.167034+0000","last_clean":"2024-09-17T01:35:13.167034+0000","last_became_active":"2024-09-17T01:35:11.677084+0000","last_became_peered":"2024-09-17T01:35:11.677084+0000","last_unstale":"2024-09-17T01:35:13.167034+0000","last_undegraded":"2024-09-17T01:35:13.167034+0000","last_fullsized":"2024-09-17T01:35:13.167034+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:12:39.675385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693994+0000","last_change":"2024-09-17T01:35:10.672120+0000","last_active":"2024-09-17T01:35:12.693994+0000","last_peered":"2024-09-17T01:35:12.693994+0000","last_clean":"2024-09-17T01:35:12.693994+0000","last_became_active":"2024-09-17T01:35:10.671797+0000","last_became_peered":"2024-09-17T01:35:10.671797+0000","last_unstale":"2024-09-17T01:35:12.693994+0000","last_undegraded":"2024-09-17T01:35:12.693994+0000","last_fullsized":"2024-09-17T01:35:12.693994+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:47:27.327278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.167111+0000","last_change":"2024-09-17T01:35:11.678099+0000","last_active":"2024-09-17T01:35:13.167111+0000","last_peered":"2024-09-17T01:35:13.167111+0000","last_clean":"2024-09-17T01:35:13.167111+0000","last_became_active":"2024-09-17T01:35:11.677064+0000","last_became_peered":"2024-09-17T01:35:11.677064+0000","last_unstale":"2024-09-17T01:35:13.167111+0000","last_undegraded":"2024-09-17T01:35:13.167111+0000","last_fullsized":"2024-09-17T01:35:13.167111+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:59.219211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666337+0000","last_change":"2024-09-17T01:35:10.663348+0000","last_active":"2024-09-17T01:35:12.666337+0000","last_peered":"2024-09-17T01:35:12.666337+0000","last_clean":"2024-09-17T01:35:12.666337+0000","last_became_active":"2024-09-17T01:35:10.662887+0000","last_became_peered":"2024-09-17T01:35:10.662887+0000","last_unstale":"2024-09-17T01:35:12.666337+0000","last_undegraded":"2024-09-17T01:35:12.666337+0000","last_fullsized":"2024-09-17T01:35:12.666337+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:24.816236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.798511+0000","last_change":"2024-09-17T01:35:11.679814+0000","last_active":"2024-09-17T01:35:12.798511+0000","last_peered":"2024-09-17T01:35:12.798511+0000","last_clean":"2024-09-17T01:35:12.798511+0000","last_became_active":"2024-09-17T01:35:11.679510+0000","last_became_peered":"2024-09-17T01:35:11.679510+0000","last_unstale":"2024-09-17T01:35:12.798511+0000","last_undegraded":"2024-09-17T01:35:12.798511+0000","last_fullsized":"2024-09-17T01:35:12.798511+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:21.756303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"48'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666047+0000","last_change":"2024-09-17T01:35:10.676459+0000","last_active":"2024-09-17T01:35:12.666047+0000","last_peered":"2024-09-17T01:35:12.666047+0000","last_clean":"2024-09-17T01:35:12.666047+0000","last_became_active":"2024-09-17T01:35:10.676141+0000","last_became_peered":"2024-09-17T01:35:10.676141+0000","last_unstale":"2024-09-17T01:35:12.666047+0000","last_undegraded":"2024-09-17T01:35:12.666047+0000","last_fullsized":"2024-09-17T01:35:12.666047+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:40.090233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665974+0000","last_change":"2024-09-17T01:35:11.676736+0000","last_active":"2024-09-17T01:35:12.665974+0000","last_peered":"2024-09-17T01:35:12.665974+0000","last_clean":"2024-09-17T01:35:12.665974+0000","last_became_active":"2024-09-17T01:35:11.676057+0000","last_became_peered":"2024-09-17T01:35:11.676057+0000","last_unstale":"2024-09-17T01:35:12.665974+0000","last_undegraded":"2024-09-17T01:35:12.665974+0000","last_fullsized":"2024-09-17T01:35:12.665974+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:09.879854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667410+0000","last_change":"2024-09-17T01:35:10.662974+0000","last_active":"2024-09-17T01:35:12.667410+0000","last_peered":"2024-09-17T01:35:12.667410+0000","last_clean":"2024-09-17T01:35:12.667410+0000","last_became_active":"2024-09-17T01:35:10.662581+0000","last_became_peered":"2024-09-17T01:35:10.662581+0000","last_unstale":"2024-09-17T01:35:12.667410+0000","last_undegraded":"2024-09-17T01:35:12.667410+0000","last_fullsized":"2024-09-17T01:35:12.667410+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:36.554201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667139+0000","last_change":"2024-09-17T01:35:11.681718+0000","last_active":"2024-09-17T01:35:12.667139+0000","last_peered":"2024-09-17T01:35:12.667139+0000","last_clean":"2024-09-17T01:35:12.667139+0000","last_became_active":"2024-09-17T01:35:11.681374+0000","last_became_peered":"2024-09-17T01:35:11.681374+0000","last_unstale":"2024-09-17T01:35:12.667139+0000","last_undegraded":"2024-09-17T01:35:12.667139+0000","last_fullsized":"2024-09-17T01:35:12.667139+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:45.555304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667551+0000","last_change":"2024-09-17T01:35:10.678608+0000","last_active":"2024-09-17T01:35:12.667551+0000","last_peered":"2024-09-17T01:35:12.667551+0000","last_clean":"2024-09-17T01:35:12.667551+0000","last_became_active":"2024-09-17T01:35:10.678289+0000","last_became_peered":"2024-09-17T01:35:10.678289+0000","last_unstale":"2024-09-17T01:35:12.667551+0000","last_undegraded":"2024-09-17T01:35:12.667551+0000","last_fullsized":"2024-09-17T01:35:12.667551+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:41.559466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.668635+0000","last_change":"2024-09-17T01:35:11.681503+0000","last_active":"2024-09-17T01:35:12.668635+0000","last_peered":"2024-09-17T01:35:12.668635+0000","last_clean":"2024-09-17T01:35:12.668635+0000","last_became_active":"2024-09-17T01:35:11.681145+0000","last_became_peered":"2024-09-17T01:35:11.681145+0000","last_unstale":"2024-09-17T01:35:12.668635+0000","last_undegraded":"2024-09-17T01:35:12.668635+0000","last_fullsized":"2024-09-17T01:35:12.668635+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:46.719967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166440+0000","last_change":"2024-09-17T01:35:10.679163+0000","last_active":"2024-09-17T01:35:13.166440+0000","last_peered":"2024-09-17T01:35:13.166440+0000","last_clean":"2024-09-17T01:35:13.166440+0000","last_became_active":"2024-09-17T01:35:10.678887+0000","last_became_peered":"2024-09-17T01:35:10.678887+0000","last_unstale":"2024-09-17T01:35:13.166440+0000","last_undegraded":"2024-09-17T01:35:13.166440+0000","last_fullsized":"2024-09-17T01:35:13.166440+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:34:24.704092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693539+0000","last_change":"2024-09-17T01:35:11.674494+0000","last_active":"2024-09-17T01:35:12.693539+0000","last_peered":"2024-09-17T01:35:12.693539+0000","last_clean":"2024-09-17T01:35:12.693539+0000","last_became_active":"2024-09-17T01:35:11.674130+0000","last_became_peered":"2024-09-17T01:35:11.674130+0000","last_unstale":"2024-09-17T01:35:12.693539+0000","last_undegraded":"2024-09-17T01:35:12.693539+0000","last_fullsized":"2024-09-17T01:35:12.693539+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:16.826974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.666489+0000","last_change":"2024-09-17T01:35:10.678454+0000","last_active":"2024-09-17T01:35:12.666489+0000","last_peered":"2024-09-17T01:35:12.666489+0000","last_clean":"2024-09-17T01:35:12.666489+0000","last_became_active":"2024-09-17T01:35:10.678074+0000","last_became_peered":"2024-09-17T01:35:10.678074+0000","last_unstale":"2024-09-17T01:35:12.666489+0000","last_undegraded":"2024-09-17T01:35:12.666489+0000","last_fullsized":"2024-09-17T01:35:12.666489+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:36:20.417566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693618+0000","last_change":"2024-09-17T01:35:11.685970+0000","last_active":"2024-09-17T01:35:12.693618+0000","last_peered":"2024-09-17T01:35:12.693618+0000","last_clean":"2024-09-17T01:35:12.693618+0000","last_became_active":"2024-09-17T01:35:11.685585+0000","last_became_peered":"2024-09-17T01:35:11.685585+0000","last_unstale":"2024-09-17T01:35:12.693618+0000","last_undegraded":"2024-09-17T01:35:12.693618+0000","last_fullsized":"2024-09-17T01:35:12.693618+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:01.388599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696251+0000","last_change":"2024-09-17T01:35:10.665577+0000","last_active":"2024-09-17T01:35:12.696251+0000","last_peered":"2024-09-17T01:35:12.696251+0000","last_clean":"2024-09-17T01:35:12.696251+0000","last_became_active":"2024-09-17T01:35:10.665243+0000","last_became_peered":"2024-09-17T01:35:10.665243+0000","last_unstale":"2024-09-17T01:35:12.696251+0000","last_undegraded":"2024-09-17T01:35:12.696251+0000","last_fullsized":"2024-09-17T01:35:12.696251+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:57.645499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696995+0000","last_change":"2024-09-17T01:35:11.684591+0000","last_active":"2024-09-17T01:35:12.696995+0000","last_peered":"2024-09-17T01:35:12.696995+0000","last_clean":"2024-09-17T01:35:12.696995+0000","last_became_active":"2024-09-17T01:35:11.681538+0000","last_became_peered":"2024-09-17T01:35:11.681538+0000","last_unstale":"2024-09-17T01:35:12.696995+0000","last_undegraded":"2024-09-17T01:35:12.696995+0000","last_fullsized":"2024-09-17T01:35:12.696995+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:56.992382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"49'1","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.695895+0000","last_change":"2024-09-17T01:35:10.679073+0000","last_active":"2024-09-17T01:35:12.695895+0000","last_peered":"2024-09-17T01:35:12.695895+0000","last_clean":"2024-09-17T01:35:12.695895+0000","last_became_active":"2024-09-17T01:35:10.678723+0000","last_became_peered":"2024-09-17T01:35:10.678723+0000","last_unstale":"2024-09-17T01:35:12.695895+0000","last_undegraded":"2024-09-17T01:35:12.695895+0000","last_fullsized":"2024-09-17T01:35:12.695895+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:38.851484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667634+0000","last_change":"2024-09-17T01:35:11.667624+0000","last_active":"2024-09-17T01:35:12.667634+0000","last_peered":"2024-09-17T01:35:12.667634+0000","last_clean":"2024-09-17T01:35:12.667634+0000","last_became_active":"2024-09-17T01:35:11.667288+0000","last_became_peered":"2024-09-17T01:35:11.667288+0000","last_unstale":"2024-09-17T01:35:12.667634+0000","last_undegraded":"2024-09-17T01:35:12.667634+0000","last_fullsized":"2024-09-17T01:35:12.667634+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:26.724398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166719+0000","last_change":"2024-09-17T01:35:10.681971+0000","last_active":"2024-09-17T01:35:13.166719+0000","last_peered":"2024-09-17T01:35:13.166719+0000","last_clean":"2024-09-17T01:35:13.166719+0000","last_became_active":"2024-09-17T01:35:10.681433+0000","last_became_peered":"2024-09-17T01:35:10.681433+0000","last_unstale":"2024-09-17T01:35:13.166719+0000","last_undegraded":"2024-09-17T01:35:13.166719+0000","last_fullsized":"2024-09-17T01:35:13.166719+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:16.135683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696950+0000","last_change":"2024-09-17T01:35:11.678557+0000","last_active":"2024-09-17T01:35:12.696950+0000","last_peered":"2024-09-17T01:35:12.696950+0000","last_clean":"2024-09-17T01:35:12.696950+0000","last_became_active":"2024-09-17T01:35:11.678094+0000","last_became_peered":"2024-09-17T01:35:11.678094+0000","last_unstale":"2024-09-17T01:35:12.696950+0000","last_undegraded":"2024-09-17T01:35:12.696950+0000","last_fullsized":"2024-09-17T01:35:12.696950+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:08.579234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.167004+0000","last_change":"2024-09-17T01:35:10.678632+0000","last_active":"2024-09-17T01:35:13.167004+0000","last_peered":"2024-09-17T01:35:13.167004+0000","last_clean":"2024-09-17T01:35:13.167004+0000","last_became_active":"2024-09-17T01:35:10.678323+0000","last_became_peered":"2024-09-17T01:35:10.678323+0000","last_unstale":"2024-09-17T01:35:13.167004+0000","last_undegraded":"2024-09-17T01:35:13.167004+0000","last_fullsized":"2024-09-17T01:35:13.167004+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:14.905269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667429+0000","last_change":"2024-09-17T01:35:11.678900+0000","last_active":"2024-09-17T01:35:12.667429+0000","last_peered":"2024-09-17T01:35:12.667429+0000","last_clean":"2024-09-17T01:35:12.667429+0000","last_became_active":"2024-09-17T01:35:11.676137+0000","last_became_peered":"2024-09-17T01:35:11.676137+0000","last_unstale":"2024-09-17T01:35:12.667429+0000","last_undegraded":"2024-09-17T01:35:12.667429+0000","last_fullsized":"2024-09-17T01:35:12.667429+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:54.371997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166734+0000","last_change":"2024-09-17T01:35:10.680728+0000","last_active":"2024-09-17T01:35:13.166734+0000","last_peered":"2024-09-17T01:35:13.166734+0000","last_clean":"2024-09-17T01:35:13.166734+0000","last_became_active":"2024-09-17T01:35:10.680427+0000","last_became_peered":"2024-09-17T01:35:10.680427+0000","last_unstale":"2024-09-17T01:35:13.166734+0000","last_undegraded":"2024-09-17T01:35:13.166734+0000","last_fullsized":"2024-09-17T01:35:13.166734+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:29.304564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693363+0000","last_change":"2024-09-17T01:35:11.683785+0000","last_active":"2024-09-17T01:35:12.693363+0000","last_peered":"2024-09-17T01:35:12.693363+0000","last_clean":"2024-09-17T01:35:12.693363+0000","last_became_active":"2024-09-17T01:35:11.683033+0000","last_became_peered":"2024-09-17T01:35:11.683033+0000","last_unstale":"2024-09-17T01:35:12.693363+0000","last_undegraded":"2024-09-17T01:35:12.693363+0000","last_fullsized":"2024-09-17T01:35:12.693363+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:49.124332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696736+0000","last_change":"2024-09-17T01:35:10.673488+0000","last_active":"2024-09-17T01:35:12.696736+0000","last_peered":"2024-09-17T01:35:12.696736+0000","last_clean":"2024-09-17T01:35:12.696736+0000","last_became_active":"2024-09-17T01:35:10.672037+0000","last_became_peered":"2024-09-17T01:35:10.672037+0000","last_unstale":"2024-09-17T01:35:12.696736+0000","last_undegraded":"2024-09-17T01:35:12.696736+0000","last_fullsized":"2024-09-17T01:35:12.696736+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:22.555314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665401+0000","last_change":"2024-09-17T01:35:11.680098+0000","last_active":"2024-09-17T01:35:12.665401+0000","last_peered":"2024-09-17T01:35:12.665401+0000","last_clean":"2024-09-17T01:35:12.665401+0000","last_became_active":"2024-09-17T01:35:11.679805+0000","last_became_peered":"2024-09-17T01:35:11.679805+0000","last_unstale":"2024-09-17T01:35:12.665401+0000","last_undegraded":"2024-09-17T01:35:12.665401+0000","last_fullsized":"2024-09-17T01:35:12.665401+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:05.444230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.667129+0000","last_change":"2024-09-17T01:35:10.668738+0000","last_active":"2024-09-17T01:35:12.667129+0000","last_peered":"2024-09-17T01:35:12.667129+0000","last_clean":"2024-09-17T01:35:12.667129+0000","last_became_active":"2024-09-17T01:35:10.668414+0000","last_became_peered":"2024-09-17T01:35:10.668414+0000","last_unstale":"2024-09-17T01:35:12.667129+0000","last_undegraded":"2024-09-17T01:35:12.667129+0000","last_fullsized":"2024-09-17T01:35:12.667129+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:05:45.762431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.798131+0000","last_change":"2024-09-17T01:35:11.675535+0000","last_active":"2024-09-17T01:35:12.798131+0000","last_peered":"2024-09-17T01:35:12.798131+0000","last_clean":"2024-09-17T01:35:12.798131+0000","last_became_active":"2024-09-17T01:35:11.675201+0000","last_became_peered":"2024-09-17T01:35:11.675201+0000","last_unstale":"2024-09-17T01:35:12.798131+0000","last_undegraded":"2024-09-17T01:35:12.798131+0000","last_fullsized":"2024-09-17T01:35:12.798131+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:47.961294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:13.166762+0000","last_change":"2024-09-17T01:35:10.676420+0000","last_active":"2024-09-17T01:35:13.166762+0000","last_peered":"2024-09-17T01:35:13.166762+0000","last_clean":"2024-09-17T01:35:13.166762+0000","last_became_active":"2024-09-17T01:35:10.676110+0000","last_became_peered":"2024-09-17T01:35:10.676110+0000","last_unstale":"2024-09-17T01:35:13.166762+0000","last_undegraded":"2024-09-17T01:35:13.166762+0000","last_fullsized":"2024-09-17T01:35:13.166762+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:31.612370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.693943+0000","last_change":"2024-09-17T01:35:11.680053+0000","last_active":"2024-09-17T01:35:12.693943+0000","last_peered":"2024-09-17T01:35:12.693943+0000","last_clean":"2024-09-17T01:35:12.693943+0000","last_became_active":"2024-09-17T01:35:11.679222+0000","last_became_peered":"2024-09-17T01:35:11.679222+0000","last_unstale":"2024-09-17T01:35:12.693943+0000","last_undegraded":"2024-09-17T01:35:12.693943+0000","last_fullsized":"2024-09-17T01:35:12.693943+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:10.641797+0000","last_clean_scrub_stamp":"2024-09-17T01:35:10.641797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:24.543661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"48'2","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.696895+0000","last_change":"2024-09-17T01:35:10.676225+0000","last_active":"2024-09-17T01:35:12.696895+0000","last_peered":"2024-09-17T01:35:12.696895+0000","last_clean":"2024-09-17T01:35:12.696895+0000","last_became_active":"2024-09-17T01:35:10.675871+0000","last_became_peered":"2024-09-17T01:35:10.675871+0000","last_unstale":"2024-09-17T01:35:12.696895+0000","last_undegraded":"2024-09-17T01:35:12.696895+0000","last_fullsized":"2024-09-17T01:35:12.696895+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:35:09.633343+0000","last_clean_scrub_stamp":"2024-09-17T01:35:09.633343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:10.491485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":161,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T01:35:12.665290+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:35:12.665290+0000","last_peered":"2024-09-17T01:35:12.665290+0000","last_clean":"2024-09-17T01:35:12.665290+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:35:12.665290+0000","last_undegraded":"2024-09-17T01:35:12.665290+0000","last_fullsized":"2024-09-17T01:35:12.665290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476781,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40068,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331772,"statfs":{"total":96636764160,"available":96595734528,"internally_reserved":0,"allocated":573440,"data_stored":233769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509484,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35908,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335932,"statfs":{"total":96636764160,"available":96599994368,"internally_reserved":0,"allocated":573440,"data_stored":233713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509483,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40072,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331768,"statfs":{"total":96636764160,"available":96595730432,"internally_reserved":0,"allocated":577536,"data_stored":234295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509484,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40084,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331756,"statfs":{"total":96636764160,"available":96595718144,"internally_reserved":0,"allocated":589824,"data_stored":235383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509484,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44244,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327596,"statfs":{"total":96636764160,"available":96591458304,"internally_reserved":0,"allocated":581632,"data_stored":235291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":44693959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509483,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40648,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331192,"statfs":{"total":96636764160,"available":96595140608,"internally_reserved":0,"allocated":1167360,"data_stored":824117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509485,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35916,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335924,"statfs":{"total":96636764160,"available":96599986176,"internally_reserved":0,"allocated":577536,"data_stored":234351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542189,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40652,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331188,"statfs":{"total":96636764160,"available":96595136512,"internally_reserved":0,"allocated":1167360,"data_stored":824069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:35:21.705 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T01:35:21.705 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T01:35:21.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.976+0000 7feec4a00640 1 -- 172.21.15.42:0/1186652729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec00b4be0 msgr2=0x7feec015d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:21.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.976+0000 7feec4a00640 1 --2- 172.21.15.42:0/1186652729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec00b4be0 0x7feec015d6b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7feeb0005fd0 tx=0x7feeb002a5d0 comp rx=0 tx=0).stop 2024-09-17T01:35:21.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.976+0000 7feec4a00640 1 -- 172.21.15.42:0/1186652729 shutdown_connections 2024-09-17T01:35:21.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.976+0000 7feec4a00640 1 --2- 172.21.15.42:0/1186652729 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feec00cf7c0 0x7feec006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:21.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.976+0000 7feec4a00640 1 --2- 172.21.15.42:0/1186652729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec00b4be0 0x7feec015d6b0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:21.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.976+0000 7feec4a00640 1 -- 172.21.15.42:0/1186652729 >> 172.21.15.42:0/1186652729 conn(0x7feec00b25f0 msgr2=0x7feec00d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:21.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.976+0000 7feec4a00640 1 -- 172.21.15.42:0/1186652729 shutdown_connections 2024-09-17T01:35:21.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.976+0000 7feec4a00640 1 -- 172.21.15.42:0/1186652729 wait complete. 2024-09-17T01:35:21.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.979+0000 7feec4a00640 1 Processor -- start 2024-09-17T01:35:21.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.979+0000 7feec4a00640 1 -- start start 2024-09-17T01:35:21.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.980+0000 7feec4a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feec006d260 0x7feec014fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:21.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.980+0000 7feec4a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec00b4be0 0x7feec00adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:21.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.980+0000 7feec4a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feec00cf7c0 0x7feec01f8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:21.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.980+0000 7feec4a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7feec01537f0 con 0x7feec00b4be0 2024-09-17T01:35:21.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.980+0000 7feec4a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7feec00cfdc0 con 0x7feec00cf7c0 2024-09-17T01:35:21.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.980+0000 7feec4a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7feec0153970 con 0x7feec006d260 2024-09-17T01:35:21.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.980+0000 7feeb6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec00b4be0 0x7feec00adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:21.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.980+0000 7feeb6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec00b4be0 0x7feec00adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52834/0 (socket says 172.21.15.42:52834) 2024-09-17T01:35:21.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.980+0000 7feeb6a00640 1 -- 172.21.15.42:0/3928204045 learned_addr learned my addr 172.21.15.42:0/3928204045 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:21.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.981+0000 7feebf400640 1 --2- 172.21.15.42:0/3928204045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feec006d260 0x7feec014fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:21.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.981+0000 7feebfe00640 1 --2- 172.21.15.42:0/3928204045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feec00cf7c0 0x7feec01f8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:21.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.981+0000 7feeb6a00640 1 -- 172.21.15.42:0/3928204045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feec006d260 msgr2=0x7feec014fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:21.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.981+0000 7feeb6a00640 1 --2- 172.21.15.42:0/3928204045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feec006d260 0x7feec014fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:21.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.981+0000 7feeb6a00640 1 -- 172.21.15.42:0/3928204045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feec00cf7c0 msgr2=0x7feec01f8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:21.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.981+0000 7feeb6a00640 1 --2- 172.21.15.42:0/3928204045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feec00cf7c0 0x7feec01f8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:21.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.981+0000 7feeb6a00640 1 -- 172.21.15.42:0/3928204045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec0072330 con 0x7feec00b4be0 2024-09-17T01:35:21.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.981+0000 7feebfe00640 1 --2- 172.21.15.42:0/3928204045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feec00cf7c0 0x7feec01f8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:21.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.981+0000 7feeb6a00640 1 --2- 172.21.15.42:0/3928204045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec00b4be0 0x7feec00adfb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7feea800e7c0 tx=0x7feea800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:21.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.982+0000 7feeb7e00640 1 -- 172.21.15.42:0/3928204045 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea800ccc0 con 0x7feec00b4be0 2024-09-17T01:35:21.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.982+0000 7feeb7e00640 1 -- 172.21.15.42:0/3928204045 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feea8010430 con 0x7feec00b4be0 2024-09-17T01:35:21.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.982+0000 7feec4a00640 1 -- 172.21.15.42:0/3928204045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec01f9900 con 0x7feec00b4be0 2024-09-17T01:35:21.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.982+0000 7feeb7e00640 1 -- 172.21.15.42:0/3928204045 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea8010860 con 0x7feec00b4be0 2024-09-17T01:35:21.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.982+0000 7feec4a00640 1 -- 172.21.15.42:0/3928204045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec00728f0 con 0x7feec00b4be0 2024-09-17T01:35:21.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.983+0000 7feec4a00640 1 -- 172.21.15.42:0/3928204045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feec015d6b0 con 0x7feec00b4be0 2024-09-17T01:35:21.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.984+0000 7feeb7e00640 1 -- 172.21.15.42:0/3928204045 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feea8010a00 con 0x7feec00b4be0 2024-09-17T01:35:21.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.986+0000 7feeb7e00640 1 --2- 172.21.15.42:0/3928204045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fee9c078b90 0x7fee9c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:21.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.986+0000 7feeb7e00640 1 -- 172.21.15.42:0/3928204045 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7feea809b620 con 0x7feec00b4be0 2024-09-17T01:35:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.986+0000 7feebf400640 1 --2- 172.21.15.42:0/3928204045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fee9c078b90 0x7fee9c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:21.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.987+0000 7feebf400640 1 --2- 172.21.15.42:0/3928204045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fee9c078b90 0x7fee9c07b0a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feeb0033000 tx=0x7feeb0004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:21.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:21.990+0000 7feeb7e00640 1 -- 172.21.15.42:0/3928204045 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feea8063490 con 0x7feec00b4be0 2024-09-17T01:35:22.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.254+0000 7feec4a00640 1 -- 172.21.15.42:0/3928204045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7feec00cc770 con 0x7feec00b4be0 2024-09-17T01:35:22.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.258+0000 7feeb7e00640 1 -- 172.21.15.42:0/3928204045 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v30) ==== 190+0+147 (secure 0 0 0) 0x7feea806c020 con 0x7feec00b4be0 2024-09-17T01:35:22.256 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-09-17T01:35:22.257 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA== 2024-09-17T01:35:22.257 INFO:teuthology.orchestra.run.smithi042.stdout: caps mds = "allow" 2024-09-17T01:35:22.257 INFO:teuthology.orchestra.run.smithi042.stdout: caps mon = "allow r" 2024-09-17T01:35:22.257 INFO:teuthology.orchestra.run.smithi042.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T01:35:22.257 INFO:teuthology.orchestra.run.smithi042.stderr:updated caps for client.0 2024-09-17T01:35:22.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.260+0000 7feec4a00640 1 -- 172.21.15.42:0/3928204045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fee9c078b90 msgr2=0x7fee9c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:22.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.260+0000 7feec4a00640 1 --2- 172.21.15.42:0/3928204045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fee9c078b90 0x7fee9c07b0a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feeb0033000 tx=0x7feeb0004730 comp rx=0 tx=0).stop 2024-09-17T01:35:22.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.260+0000 7feec4a00640 1 -- 172.21.15.42:0/3928204045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec00b4be0 msgr2=0x7feec00adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:22.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.260+0000 7feec4a00640 1 --2- 172.21.15.42:0/3928204045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec00b4be0 0x7feec00adfb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7feea800e7c0 tx=0x7feea800ec80 comp rx=0 tx=0).stop 2024-09-17T01:35:22.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.260+0000 7feec4a00640 1 -- 172.21.15.42:0/3928204045 shutdown_connections 2024-09-17T01:35:22.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.260+0000 7feec4a00640 1 --2- 172.21.15.42:0/3928204045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fee9c078b90 0x7fee9c07b0a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:22.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.260+0000 7feec4a00640 1 --2- 172.21.15.42:0/3928204045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feec00cf7c0 0x7feec01f8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:22.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.260+0000 7feec4a00640 1 --2- 172.21.15.42:0/3928204045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec00b4be0 0x7feec00adfb0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:22.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.260+0000 7feec4a00640 1 --2- 172.21.15.42:0/3928204045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feec006d260 0x7feec014fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:22.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.260+0000 7feec4a00640 1 -- 172.21.15.42:0/3928204045 >> 172.21.15.42:0/3928204045 conn(0x7feec00b25f0 msgr2=0x7feec00afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:22.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.260+0000 7feec4a00640 1 -- 172.21.15.42:0/3928204045 shutdown_connections 2024-09-17T01:35:22.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.260+0000 7feec4a00640 1 -- 172.21.15.42:0/3928204045 wait complete. 2024-09-17T01:35:22.285 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:35:22.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.514+0000 7f8f1d200640 1 -- 172.21.15.42:0/2186107298 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8f180cec40 msgr2=0x7f8f180cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:22.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.514+0000 7f8f1d200640 1 --2- 172.21.15.42:0/2186107298 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8f180cec40 0x7f8f180cf050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8f10005fd0 tx=0x7f8f1002a910 comp rx=0 tx=0).stop 2024-09-17T01:35:22.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.515+0000 7f8f1d200640 1 -- 172.21.15.42:0/2186107298 shutdown_connections 2024-09-17T01:35:22.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.515+0000 7f8f1d200640 1 --2- 172.21.15.42:0/2186107298 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8f180cec40 0x7f8f180cf050 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:22.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.515+0000 7f8f1d200640 1 --2- 172.21.15.42:0/2186107298 >> v2:172.21.15.43:3300/0 conn(0x7f8f180b3550 0x7f8f1815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:22.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.515+0000 7f8f1d200640 1 -- 172.21.15.42:0/2186107298 >> 172.21.15.42:0/2186107298 conn(0x7f8f180b2930 msgr2=0x7f8f1806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:22.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.515+0000 7f8f1d200640 1 -- 172.21.15.42:0/2186107298 shutdown_connections 2024-09-17T01:35:22.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.515+0000 7f8f1d200640 1 -- 172.21.15.42:0/2186107298 wait complete. 2024-09-17T01:35:22.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.517+0000 7f8f1d200640 1 Processor -- start 2024-09-17T01:35:22.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.517+0000 7f8f1d200640 1 -- start start 2024-09-17T01:35:22.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.518+0000 7f8f1d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f180b3550 0x7f8f181f4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:22.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.518+0000 7f8f1d200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8f180cec40 0x7f8f181f0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:22.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.518+0000 7f8f1d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f18142f40 0x7f8f180ac710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:22.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.518+0000 7f8f1d200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1806d7c0 con 0x7f8f18142f40 2024-09-17T01:35:22.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.518+0000 7f8f1d200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1806d640 con 0x7f8f180b3550 2024-09-17T01:35:22.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.518+0000 7f8f1d200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8f1806d940 con 0x7f8f180cec40 2024-09-17T01:35:22.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.519+0000 7f8f16800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f18142f40 0x7f8f180ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:22.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.519+0000 7f8f16800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f18142f40 0x7f8f180ac710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52844/0 (socket says 172.21.15.42:52844) 2024-09-17T01:35:22.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.519+0000 7f8f16800640 1 -- 172.21.15.42:0/4180173509 learned_addr learned my addr 172.21.15.42:0/4180173509 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:22.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.519+0000 7f8f15e00640 1 --2- 172.21.15.42:0/4180173509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f180b3550 0x7f8f181f4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:22.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.519+0000 7f8f0fe00640 1 --2- 172.21.15.42:0/4180173509 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8f180cec40 0x7f8f181f0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:22.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.519+0000 7f8f16800640 1 -- 172.21.15.42:0/4180173509 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8f180cec40 msgr2=0x7f8f181f0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:22.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.519+0000 7f8f16800640 1 --2- 172.21.15.42:0/4180173509 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8f180cec40 0x7f8f181f0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:22.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.519+0000 7f8f16800640 1 -- 172.21.15.42:0/4180173509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f180b3550 msgr2=0x7f8f181f4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:22.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.519+0000 7f8f16800640 1 --2- 172.21.15.42:0/4180173509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f180b3550 0x7f8f181f4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:22.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.519+0000 7f8f16800640 1 -- 172.21.15.42:0/4180173509 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f180aa490 con 0x7f8f18142f40 2024-09-17T01:35:22.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.520+0000 7f8f16800640 1 --2- 172.21.15.42:0/4180173509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f18142f40 0x7f8f180ac710 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009d90 tx=0x7f8f100045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:22.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.520+0000 7f8f0e000640 1 -- 172.21.15.42:0/4180173509 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10030750 con 0x7f8f18142f40 2024-09-17T01:35:22.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.520+0000 7f8f0e000640 1 -- 172.21.15.42:0/4180173509 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f100308f0 con 0x7f8f18142f40 2024-09-17T01:35:22.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.520+0000 7f8f0e000640 1 -- 172.21.15.42:0/4180173509 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10030d00 con 0x7f8f18142f40 2024-09-17T01:35:22.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.520+0000 7f8f1d200640 1 -- 172.21.15.42:0/4180173509 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f180b1680 con 0x7f8f18142f40 2024-09-17T01:35:22.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.520+0000 7f8f1d200640 1 -- 172.21.15.42:0/4180173509 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f1813f8f0 con 0x7f8f18142f40 2024-09-17T01:35:22.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.521+0000 7f8f1d200640 1 -- 172.21.15.42:0/4180173509 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f180aa660 con 0x7f8f18142f40 2024-09-17T01:35:22.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.523+0000 7f8f0e000640 1 -- 172.21.15.42:0/4180173509 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8f10032440 con 0x7f8f18142f40 2024-09-17T01:35:22.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.524+0000 7f8f0e000640 1 --2- 172.21.15.42:0/4180173509 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ef4078bc0 0x7f8ef407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:22.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.524+0000 7f8f0e000640 1 -- 172.21.15.42:0/4180173509 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f8f100bbff0 con 0x7f8f18142f40 2024-09-17T01:35:22.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.525+0000 7f8f15e00640 1 --2- 172.21.15.42:0/4180173509 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ef4078bc0 0x7f8ef407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:22.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.526+0000 7f8f15e00640 1 --2- 172.21.15.42:0/4180173509 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ef4078bc0 0x7f8ef407b0d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8f080095f0 tx=0x7f8f08005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:22.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.529+0000 7f8f0e000640 1 -- 172.21.15.42:0/4180173509 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8f10040030 con 0x7f8f18142f40 2024-09-17T01:35:22.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.765+0000 7f8f1d200640 1 -- 172.21.15.42:0/4180173509 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f1815cec0 con 0x7f8f18142f40 2024-09-17T01:35:22.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.766+0000 7f8f0e000640 1 -- 172.21.15.42:0/4180173509 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5223 (secure 0 0 0) 0x7f8f10083df0 con 0x7f8f18142f40 2024-09-17T01:35:22.765 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:35:22.765 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":28,"btime":"2024-09-17T01:35:14:681513+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5209,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4107697732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":4107697732},{"type":"v1","addr":"172.21.15.43:6837","nonce":4107697732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1959050852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1959050852},{"type":"v1","addr":"172.21.15.42:6833","nonce":1959050852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5271,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2487768756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2487768756},{"type":"v1","addr":"172.21.15.43:6836","nonce":2487768756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:35:11.176089+0000","modified":"2024-09-17T01:35:14.184451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1094322669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1094322669},{"type":"v1","addr":"172.21.15.42:6835","nonce":1094322669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-17T01:35:22.765 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 28 2024-09-17T01:35:22.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.768+0000 7f8f1d200640 1 -- 172.21.15.42:0/4180173509 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ef4078bc0 msgr2=0x7f8ef407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:22.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.768+0000 7f8f1d200640 1 --2- 172.21.15.42:0/4180173509 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ef4078bc0 0x7f8ef407b0d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8f080095f0 tx=0x7f8f08005f90 comp rx=0 tx=0).stop 2024-09-17T01:35:22.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.768+0000 7f8f1d200640 1 -- 172.21.15.42:0/4180173509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f18142f40 msgr2=0x7f8f180ac710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:22.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.768+0000 7f8f1d200640 1 --2- 172.21.15.42:0/4180173509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f18142f40 0x7f8f180ac710 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009d90 tx=0x7f8f100045e0 comp rx=0 tx=0).stop 2024-09-17T01:35:22.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.768+0000 7f8f1d200640 1 -- 172.21.15.42:0/4180173509 shutdown_connections 2024-09-17T01:35:22.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.768+0000 7f8f1d200640 1 --2- 172.21.15.42:0/4180173509 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ef4078bc0 0x7f8ef407b0d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:22.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.768+0000 7f8f1d200640 1 --2- 172.21.15.42:0/4180173509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f18142f40 0x7f8f180ac710 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:22.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.768+0000 7f8f1d200640 1 --2- 172.21.15.42:0/4180173509 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8f180cec40 0x7f8f181f0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:22.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.768+0000 7f8f1d200640 1 --2- 172.21.15.42:0/4180173509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8f180b3550 0x7f8f181f4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:22.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.768+0000 7f8f1d200640 1 -- 172.21.15.42:0/4180173509 >> 172.21.15.42:0/4180173509 conn(0x7f8f180b2930 msgr2=0x7f8f1806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:22.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.769+0000 7f8f1d200640 1 -- 172.21.15.42:0/4180173509 shutdown_connections 2024-09-17T01:35:22.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:22.769+0000 7f8f1d200640 1 -- 172.21.15.42:0/4180173509 wait complete. 2024-09-17T01:35:23.194 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:35:11.176089+0000', 'modified': '2024-09-17T01:35:14.184451+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5283}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5283': {'gid': 5283, 'name': 'c', 'rank': 0, 'incarnation': 24, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.42:6835/1094322669', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6834', 'nonce': 1094322669}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 1094322669}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5283, 'qdb_cluster': [5283]} 2024-09-17T01:35:23.195 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T01:35:23.195 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T01:35:23.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.426+0000 7f728d400640 1 -- 172.21.15.42:0/1915886424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72880b3550 msgr2=0x7f728815cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:23.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.426+0000 7f728d400640 1 --2- 172.21.15.42:0/1915886424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72880b3550 0x7f728815cec0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7278005fd0 tx=0x7f727802a540 comp rx=0 tx=0).stop 2024-09-17T01:35:23.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.426+0000 7f728d400640 1 -- 172.21.15.42:0/1915886424 shutdown_connections 2024-09-17T01:35:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.426+0000 7f728d400640 1 --2- 172.21.15.42:0/1915886424 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72880cec40 0x7f72880cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.426+0000 7f728d400640 1 --2- 172.21.15.42:0/1915886424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72880b3550 0x7f728815cec0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.426+0000 7f728d400640 1 -- 172.21.15.42:0/1915886424 >> 172.21.15.42:0/1915886424 conn(0x7f72880b2930 msgr2=0x7f728806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.426+0000 7f728d400640 1 -- 172.21.15.42:0/1915886424 shutdown_connections 2024-09-17T01:35:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.426+0000 7f728d400640 1 -- 172.21.15.42:0/1915886424 wait complete. 2024-09-17T01:35:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.428+0000 7f728d400640 1 Processor -- start 2024-09-17T01:35:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.429+0000 7f728d400640 1 -- start start 2024-09-17T01:35:23.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.430+0000 7f728d400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72880b3550 0x7f72881f67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:23.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.430+0000 7f728d400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72880cec40 0x7f72881f7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:23.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.430+0000 7f728d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7288142f40 0x7f72881f75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:23.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.430+0000 7f728d400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f728806d7c0 con 0x7f7288142f40 2024-09-17T01:35:23.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.430+0000 7f728d400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f728806d640 con 0x7f72880cec40 2024-09-17T01:35:23.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.430+0000 7f728d400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f728806d940 con 0x7f72880b3550 2024-09-17T01:35:23.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.430+0000 7f7287200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7288142f40 0x7f72881f75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:23.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.430+0000 7f7287200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7288142f40 0x7f72881f75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52856/0 (socket says 172.21.15.42:52856) 2024-09-17T01:35:23.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.430+0000 7f7287200640 1 -- 172.21.15.42:0/395994696 learned_addr learned my addr 172.21.15.42:0/395994696 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:23.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.430+0000 7f727fe00640 1 --2- 172.21.15.42:0/395994696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72880cec40 0x7f72881f7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:23.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.430+0000 7f7286800640 1 --2- 172.21.15.42:0/395994696 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72880b3550 0x7f72881f67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:23.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.431+0000 7f7287200640 1 -- 172.21.15.42:0/395994696 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72880b3550 msgr2=0x7f72881f67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:23.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.431+0000 7f7287200640 1 --2- 172.21.15.42:0/395994696 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72880b3550 0x7f72881f67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.431+0000 7f7287200640 1 -- 172.21.15.42:0/395994696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72880cec40 msgr2=0x7f72881f7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:23.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.431+0000 7f7287200640 1 --2- 172.21.15.42:0/395994696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72880cec40 0x7f72881f7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.431+0000 7f7287200640 1 -- 172.21.15.42:0/395994696 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7288140160 con 0x7f7288142f40 2024-09-17T01:35:23.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.431+0000 7f7287200640 1 --2- 172.21.15.42:0/395994696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7288142f40 0x7f72881f75b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f728000e960 tx=0x7f728000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:23.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.431+0000 7f727ea00640 1 -- 172.21.15.42:0/395994696 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7280004d20 con 0x7f7288142f40 2024-09-17T01:35:23.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.431+0000 7f727ea00640 1 -- 172.21.15.42:0/395994696 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f728000cac0 con 0x7f7288142f40 2024-09-17T01:35:23.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.431+0000 7f727ea00640 1 -- 172.21.15.42:0/395994696 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7280005020 con 0x7f7288142f40 2024-09-17T01:35:23.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.431+0000 7f728d400640 1 -- 172.21.15.42:0/395994696 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7288140440 con 0x7f7288142f40 2024-09-17T01:35:23.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.432+0000 7f728d400640 1 -- 172.21.15.42:0/395994696 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7288140a00 con 0x7f7288142f40 2024-09-17T01:35:23.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.434+0000 7f727ea00640 1 -- 172.21.15.42:0/395994696 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f72800051c0 con 0x7f7288142f40 2024-09-17T01:35:23.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.435+0000 7f727ea00640 1 --2- 172.21.15.42:0/395994696 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7264078b90 0x7f726407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:23.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.435+0000 7f727ea00640 1 -- 172.21.15.42:0/395994696 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f728009b5c0 con 0x7f7288142f40 2024-09-17T01:35:23.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.435+0000 7f7294424740 1 Processor -- start 2024-09-17T01:35:23.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.435+0000 7f7294424740 1 -- start start 2024-09-17T01:35:23.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.436+0000 7f7286800640 1 --2- 172.21.15.42:0/395994696 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7264078b90 0x7f726407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:23.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.436+0000 7f7286800640 1 --2- 172.21.15.42:0/395994696 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7264078b90 0x7f726407b0a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7278033000 tx=0x7f7278004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:23.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.437+0000 7f7294424740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b94a7e1270 0x55b94abcca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:23.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.437+0000 7f7294424740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b94a7b83b0 0x55b94ab81f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:23.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.437+0000 7f7294424740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7c0590 0x55b94ab824a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:23.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.437+0000 7f7294424740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b94ab0b430 con 0x55b94a7c0590 2024-09-17T01:35:23.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.437+0000 7f7294424740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b94aafb5d0 con 0x55b94a7e1270 2024-09-17T01:35:23.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.437+0000 7f7294424740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55b94aaeaa00 con 0x55b94a7b83b0 2024-09-17T01:35:23.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.437+0000 7f7287200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7c0590 0x55b94ab824a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:23.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.437+0000 7f7287200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7c0590 0x55b94ab824a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52858/0 (socket says 172.21.15.42:52858) 2024-09-17T01:35:23.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.437+0000 7f7287200640 1 -- 172.21.15.42:0/1085962759 learned_addr learned my addr 172.21.15.42:0/1085962759 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:23.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.437+0000 7f7286800640 1 --2- 172.21.15.42:0/1085962759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b94a7e1270 0x55b94abcca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:23.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.437+0000 7f727fe00640 1 --2- 172.21.15.42:0/1085962759 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b94a7b83b0 0x55b94ab81f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:23.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.438+0000 7f7287200640 1 -- 172.21.15.42:0/1085962759 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b94a7b83b0 msgr2=0x55b94ab81f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:23.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.438+0000 7f7287200640 1 --2- 172.21.15.42:0/1085962759 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b94a7b83b0 0x55b94ab81f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.438+0000 7f7287200640 1 -- 172.21.15.42:0/1085962759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b94a7e1270 msgr2=0x55b94abcca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:23.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.438+0000 7f7287200640 1 --2- 172.21.15.42:0/1085962759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b94a7e1270 0x55b94abcca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.438+0000 7f7287200640 1 -- 172.21.15.42:0/1085962759 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b94aab3520 con 0x55b94a7c0590 2024-09-17T01:35:23.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.438+0000 7f727fe00640 1 --2- 172.21.15.42:0/1085962759 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b94a7b83b0 0x55b94ab81f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:23.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.438+0000 7f7286800640 1 --2- 172.21.15.42:0/1085962759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b94a7e1270 0x55b94abcca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:23.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.438+0000 7f7287200640 1 --2- 172.21.15.42:0/1085962759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7c0590 0x55b94ab824a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f72800630a0 tx=0x7f7280062b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04aeddfad65d94f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:23.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.438+0000 7f7277000640 1 -- 172.21.15.42:0/1085962759 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728001f070 con 0x55b94a7c0590 2024-09-17T01:35:23.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.438+0000 7f7277000640 1 -- 172.21.15.42:0/1085962759 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7280067dd0 con 0x55b94a7c0590 2024-09-17T01:35:23.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.438+0000 7f7277000640 1 -- 172.21.15.42:0/1085962759 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728006a2b0 con 0x55b94a7c0590 2024-09-17T01:35:23.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.439+0000 7f7294424740 1 -- 172.21.15.42:0/1085962759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7c0590 msgr2=0x55b94ab824a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:23.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.439+0000 7f7294424740 1 --2- 172.21.15.42:0/1085962759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7c0590 0x55b94ab824a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f72800630a0 tx=0x7f7280062b10 comp rx=0 tx=0).stop 2024-09-17T01:35:23.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.439+0000 7f7294424740 1 -- 172.21.15.42:0/1085962759 shutdown_connections 2024-09-17T01:35:23.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.439+0000 7f7294424740 1 --2- 172.21.15.42:0/1085962759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7c0590 0x55b94ab824a0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.439+0000 7f7294424740 1 --2- 172.21.15.42:0/1085962759 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b94a7b83b0 0x55b94ab81f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.439+0000 7f7294424740 1 --2- 172.21.15.42:0/1085962759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b94a7e1270 0x55b94abcca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.439+0000 7f7294424740 1 -- 172.21.15.42:0/1085962759 >> 172.21.15.42:0/1085962759 conn(0x55b94a7d53c0 msgr2=0x55b94ab87970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:23.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.439+0000 7f7294424740 1 -- 172.21.15.42:0/1085962759 shutdown_connections 2024-09-17T01:35:23.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.439+0000 7f7294424740 1 -- 172.21.15.42:0/1085962759 wait complete. 2024-09-17T01:35:23.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.440+0000 7f7294424740 1 -- start start 2024-09-17T01:35:23.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.440+0000 7f7294424740 1 Processor -- start 2024-09-17T01:35:23.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.442+0000 7f7294424740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7b83b0 0x55b94abd0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:23.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.442+0000 7f7294424740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b94a7c0590 0x55b94abe0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:23.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.442+0000 7f7294424740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b94a7e1270 0x55b94abcf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:23.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.442+0000 7f7294424740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b94aa91330 con 0x55b94a7b83b0 2024-09-17T01:35:23.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.442+0000 7f7294424740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b94aaee810 con 0x55b94a7e1270 2024-09-17T01:35:23.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.442+0000 7f7294424740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55b94a85b620 con 0x55b94a7c0590 2024-09-17T01:35:23.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.442+0000 7f7294424740 10 client.0 _ll_register_callbacks cb 0x55b94aa96420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:23.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.442+0000 7f7286800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7b83b0 0x55b94abd0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:23.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.442+0000 7f7286800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7b83b0 0x55b94abd0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52872/0 (socket says 172.21.15.42:52872) 2024-09-17T01:35:23.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.442+0000 7f7286800640 1 -- 172.21.15.42:0/3496051004 learned_addr learned my addr 172.21.15.42:0/3496051004 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:23.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.442+0000 7f727fe00640 1 --2- 172.21.15.42:0/3496051004 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b94a7c0590 0x55b94abe0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:23.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.442+0000 7f7287200640 1 --2- 172.21.15.42:0/3496051004 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b94a7e1270 0x55b94abcf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:23.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.443+0000 7f7286800640 1 -- 172.21.15.42:0/3496051004 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b94a7c0590 msgr2=0x55b94abe0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:23.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.443+0000 7f7286800640 1 --2- 172.21.15.42:0/3496051004 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b94a7c0590 0x55b94abe0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.443+0000 7f7286800640 1 -- 172.21.15.42:0/3496051004 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b94a7e1270 msgr2=0x55b94abcf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:23.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.443+0000 7f7286800640 1 --2- 172.21.15.42:0/3496051004 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b94a7e1270 0x55b94abcf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.443+0000 7f7286800640 1 -- 172.21.15.42:0/3496051004 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b94a84c850 con 0x55b94a7b83b0 2024-09-17T01:35:23.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.443+0000 7f7286800640 1 --2- 172.21.15.42:0/3496051004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7b83b0 0x55b94abd0370 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7278009230 tx=0x7f7278009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f303d79d3814a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:23.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.443+0000 7f726b400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:23.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.443+0000 7f726b400640 1 -- 172.21.15.42:0/3496051004 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727804d020 con 0x55b94a7b83b0 2024-09-17T01:35:23.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.443+0000 7f7294424740 1 -- 172.21.15.42:0/3496051004 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7280067dd0 con 0x55b94a7b83b0 2024-09-17T01:35:23.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.443+0000 7f726b400640 1 -- 172.21.15.42:0/3496051004 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f7278003d50 con 0x55b94a7b83b0 2024-09-17T01:35:23.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.444+0000 7f726b400640 1 -- 172.21.15.42:0/3496051004 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7278057050 con 0x55b94a7b83b0 2024-09-17T01:35:23.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.444+0000 7f7294424740 10 client.5427 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:23.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.444+0000 7f7294424740 1 -- 172.21.15.42:0/3496051004 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x55b94a8c36b0 con 0x55b94a7b83b0 2024-09-17T01:35:23.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.444+0000 7f726b400640 1 -- 172.21.15.42:0/3496051004 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7280067dd0 con 0x55b94a7b83b0 2024-09-17T01:35:23.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.444+0000 7f726b400640 1 -- 172.21.15.42:0/3496051004 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f727805a020 con 0x55b94a7b83b0 2024-09-17T01:35:23.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.444+0000 7f7294424740 10 client.5427 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:23.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.444+0000 7f7294424740 10 client.5427 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:35:23.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.444+0000 7f7294424740 20 client.5427 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:23.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.444+0000 7f7294424740 1 --2- 172.21.15.42:0/3496051004 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55b94a79fe40 0x55b94abe3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:23.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.444+0000 7f7294424740 4 client.5427 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:23.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.444+0000 7f7294424740 1 -- 172.21.15.42:0/3496051004 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b94aafd520 con 0x55b94a79fe40 2024-09-17T01:35:23.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.444+0000 7f727fe00640 1 --2- 172.21.15.42:0/3496051004 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55b94a79fe40 0x55b94abe3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:23.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.445+0000 7f727fe00640 1 --2- 172.21.15.42:0/3496051004 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55b94a79fe40 0x55b94abe3640 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6910d6ed7cdb5d2b server_cookie=1bcc7009266d9d6a in_seq=0 out_seq=0 2024-09-17T01:35:23.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.445+0000 7f726b400640 10 client.5427 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.446+0000 7f726b400640 1 -- 172.21.15.42:0/3496051004 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b94aafd520 con 0x55b94a79fe40 2024-09-17T01:35:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.446+0000 7f726b400640 10 client.5427 handle_command_reply: tid=0 2024-09-17T01:35:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.446+0000 7f7294424740 1 client.5427 shutdown 2024-09-17T01:35:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.446+0000 7f7294424740 1 -- 172.21.15.42:0/3496051004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7b83b0 msgr2=0x55b94abd0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.446+0000 7f7294424740 1 --2- 172.21.15.42:0/3496051004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7b83b0 0x55b94abd0370 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7278009230 tx=0x7f7278009260 comp rx=0 tx=0).stop 2024-09-17T01:35:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.446+0000 7f7294424740 1 -- 172.21.15.42:0/3496051004 shutdown_connections 2024-09-17T01:35:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.446+0000 7f7294424740 1 --2- 172.21.15.42:0/3496051004 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55b94a79fe40 0x55b94abe3640 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.446+0000 7f7294424740 1 --2- 172.21.15.42:0/3496051004 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b94a7e1270 0x55b94abcf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.446+0000 7f7294424740 1 --2- 172.21.15.42:0/3496051004 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b94a7c0590 0x55b94abe0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.446+0000 7f7294424740 1 --2- 172.21.15.42:0/3496051004 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7b83b0 0x55b94abd0370 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.446+0000 7f726b400640 0 client.5427 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.446+0000 7f7294424740 1 -- 172.21.15.42:0/3496051004 >> 172.21.15.42:0/3496051004 conn(0x55b94a7d53c0 msgr2=0x55b94abcca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.446+0000 7f7294424740 1 -- 172.21.15.42:0/3496051004 shutdown_connections 2024-09-17T01:35:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.446+0000 7f7294424740 1 -- 172.21.15.42:0/3496051004 wait complete. 2024-09-17T01:35:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.447+0000 7f7294424740 20 client.5427 trim_cache size 0 max 16384 2024-09-17T01:35:23.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.466+0000 7f7294424740 1 Processor -- start 2024-09-17T01:35:23.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.466+0000 7f7294424740 1 -- start start 2024-09-17T01:35:23.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.468+0000 7f7294424740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7b83b0 0x55b94abf3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:23.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.468+0000 7f7294424740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b94a7c0590 0x55b94abf41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:23.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.468+0000 7f7294424740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b94a7e1270 0x55b94abe96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:23.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.468+0000 7f7294424740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f72881fe1f0 con 0x55b94a7b83b0 2024-09-17T01:35:23.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.468+0000 7f7294424740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f728806f3d0 con 0x55b94a7e1270 2024-09-17T01:35:23.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.468+0000 7f7294424740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f72881f4840 con 0x55b94a7c0590 2024-09-17T01:35:23.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.468+0000 7f7286800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7b83b0 0x55b94abf3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:23.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.468+0000 7f7286800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7b83b0 0x55b94abf3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52882/0 (socket says 172.21.15.42:52882) 2024-09-17T01:35:23.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.468+0000 7f7286800640 1 -- 172.21.15.42:0/1124744364 learned_addr learned my addr 172.21.15.42:0/1124744364 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:23.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.468+0000 7f7287200640 1 --2- 172.21.15.42:0/1124744364 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b94a7e1270 0x55b94abe96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:23.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.468+0000 7f727fe00640 1 --2- 172.21.15.42:0/1124744364 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b94a7c0590 0x55b94abf41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:23.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.468+0000 7f7286800640 1 -- 172.21.15.42:0/1124744364 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b94a7c0590 msgr2=0x55b94abf41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:23.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.468+0000 7f7286800640 1 --2- 172.21.15.42:0/1124744364 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b94a7c0590 0x55b94abf41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.468+0000 7f7286800640 1 -- 172.21.15.42:0/1124744364 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b94a7e1270 msgr2=0x55b94abe96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:23.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.468+0000 7f7286800640 1 --2- 172.21.15.42:0/1124744364 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b94a7e1270 0x55b94abe96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.468+0000 7f7286800640 1 -- 172.21.15.42:0/1124744364 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b94abc3590 con 0x55b94a7b83b0 2024-09-17T01:35:23.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.468+0000 7f7287200640 1 --2- 172.21.15.42:0/1124744364 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b94a7e1270 0x55b94abe96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:23.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.469+0000 7f7286800640 1 --2- 172.21.15.42:0/1124744364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7b83b0 0x55b94abf3c90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7278034040 tx=0x7f72780053f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c9527da76ac6ff server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:23.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.469+0000 7f7276600640 1 -- 172.21.15.42:0/1124744364 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7278060070 con 0x55b94a7b83b0 2024-09-17T01:35:23.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.469+0000 7f7276600640 1 -- 172.21.15.42:0/1124744364 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7278004cc0 con 0x55b94a7b83b0 2024-09-17T01:35:23.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.469+0000 7f7276600640 1 -- 172.21.15.42:0/1124744364 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727804d030 con 0x55b94a7b83b0 2024-09-17T01:35:23.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.470+0000 7f7294424740 1 -- 172.21.15.42:0/1124744364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7b83b0 msgr2=0x55b94abf3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:23.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.470+0000 7f7294424740 1 --2- 172.21.15.42:0/1124744364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7b83b0 0x55b94abf3c90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7278034040 tx=0x7f72780053f0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.470+0000 7f7294424740 1 -- 172.21.15.42:0/1124744364 shutdown_connections 2024-09-17T01:35:23.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.470+0000 7f7294424740 1 --2- 172.21.15.42:0/1124744364 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b94a7e1270 0x55b94abe96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.470+0000 7f7294424740 1 --2- 172.21.15.42:0/1124744364 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b94a7c0590 0x55b94abf41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.470+0000 7f7294424740 1 --2- 172.21.15.42:0/1124744364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7b83b0 0x55b94abf3c90 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.470+0000 7f7294424740 1 -- 172.21.15.42:0/1124744364 >> 172.21.15.42:0/1124744364 conn(0x55b94a7d53c0 msgr2=0x55b94abe28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:23.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.470+0000 7f7294424740 1 -- 172.21.15.42:0/1124744364 shutdown_connections 2024-09-17T01:35:23.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.470+0000 7f7294424740 1 -- 172.21.15.42:0/1124744364 wait complete. 2024-09-17T01:35:23.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.471+0000 7f7294424740 1 -- start start 2024-09-17T01:35:23.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.471+0000 7f7294424740 1 Processor -- start 2024-09-17T01:35:23.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.473+0000 7f7294424740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7b83b0 0x55b94ac4e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:23.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.473+0000 7f7294424740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b94a7c0590 0x55b94abc8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:23.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.473+0000 7f7294424740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b94a7e1270 0x55b94abc9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:23.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.473+0000 7f7294424740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b94abafeb0 con 0x55b94a7b83b0 2024-09-17T01:35:23.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.473+0000 7f7294424740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f72881f5a00 con 0x55b94a7c0590 2024-09-17T01:35:23.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.473+0000 7f7294424740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55b94abcebb0 con 0x55b94a7e1270 2024-09-17T01:35:23.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.473+0000 7f7294424740 10 client.0 _ll_register_callbacks cb 0x7f7278004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:23.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.473+0000 7f7286800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7b83b0 0x55b94ac4e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:23.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.473+0000 7f7286800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7b83b0 0x55b94ac4e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52896/0 (socket says 172.21.15.42:52896) 2024-09-17T01:35:23.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.473+0000 7f7286800640 1 -- 172.21.15.42:0/2653450529 learned_addr learned my addr 172.21.15.42:0/2653450529 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:23.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.473+0000 7f727fe00640 1 --2- 172.21.15.42:0/2653450529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b94a7c0590 0x55b94abc8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:23.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.473+0000 7f7287200640 1 --2- 172.21.15.42:0/2653450529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b94a7e1270 0x55b94abc9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.473+0000 7f7286800640 1 -- 172.21.15.42:0/2653450529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b94a7e1270 msgr2=0x55b94abc9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.473+0000 7f7286800640 1 --2- 172.21.15.42:0/2653450529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b94a7e1270 0x55b94abc9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.473+0000 7f7286800640 1 -- 172.21.15.42:0/2653450529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b94a7c0590 msgr2=0x55b94abc8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.473+0000 7f7286800640 1 --2- 172.21.15.42:0/2653450529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b94a7c0590 0x55b94abc8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.473+0000 7f7286800640 1 -- 172.21.15.42:0/2653450529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b94ab85700 con 0x55b94a7b83b0 2024-09-17T01:35:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.473+0000 7f7287200640 1 --2- 172.21.15.42:0/2653450529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b94a7e1270 0x55b94abc9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.474+0000 7f7286800640 1 --2- 172.21.15.42:0/2653450529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7b83b0 0x55b94ac4e3f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7278006010 tx=0x7f7278005120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa8994b9b30ae91 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.474+0000 7f726b400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.474+0000 7f726b400640 1 -- 172.21.15.42:0/2653450529 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7278060070 con 0x55b94a7b83b0 2024-09-17T01:35:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.474+0000 7f726b400640 1 -- 172.21.15.42:0/2653450529 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f7278049660 con 0x55b94a7b83b0 2024-09-17T01:35:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.474+0000 7f7294424740 1 -- 172.21.15.42:0/2653450529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7278004cc0 con 0x55b94a7b83b0 2024-09-17T01:35:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.474+0000 7f726b400640 1 -- 172.21.15.42:0/2653450529 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7278035040 con 0x55b94a7b83b0 2024-09-17T01:35:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.474+0000 7f7294424740 10 client.5433 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.474+0000 7f7294424740 1 -- 172.21.15.42:0/2653450529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x55b94abe57d0 con 0x55b94a7b83b0 2024-09-17T01:35:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.474+0000 7f726b400640 1 -- 172.21.15.42:0/2653450529 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7278004cc0 con 0x55b94a7b83b0 2024-09-17T01:35:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.474+0000 7f726b400640 1 -- 172.21.15.42:0/2653450529 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f727805a040 con 0x55b94a7b83b0 2024-09-17T01:35:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.474+0000 7f7294424740 10 client.5433 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.474+0000 7f7294424740 10 client.5433 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:35:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.474+0000 7f7294424740 20 client.5433 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.474+0000 7f7294424740 1 --2- 172.21.15.42:0/2653450529 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55b94abe9530 0x55b94ac5c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.474+0000 7f7294424740 4 client.5433 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T01:35:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.474+0000 7f7294424740 1 -- 172.21.15.42:0/2653450529 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "status"}) -- 0x55b94aaf8fd0 con 0x55b94abe9530 2024-09-17T01:35:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.475+0000 7f727fe00640 1 --2- 172.21.15.42:0/2653450529 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55b94abe9530 0x55b94ac5c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.475+0000 7f727fe00640 1 --2- 172.21.15.42:0/2653450529 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55b94abe9530 0x55b94ac5c5f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=424702db7efe7088 server_cookie=17b8e852fa55fafa in_seq=0 out_seq=0 2024-09-17T01:35:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.475+0000 7f726b400640 10 client.5433 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.476+0000 7f726b400640 1 -- 172.21.15.42:0/2653450529 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55b94aaf8fd0 con 0x55b94abe9530 2024-09-17T01:35:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.476+0000 7f726b400640 10 client.5433 handle_command_reply: tid=0 2024-09-17T01:35:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.476+0000 7f7294424740 1 client.5433 shutdown 2024-09-17T01:35:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.476+0000 7f7294424740 1 -- 172.21.15.42:0/2653450529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7b83b0 msgr2=0x55b94ac4e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.476+0000 7f7294424740 1 --2- 172.21.15.42:0/2653450529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7b83b0 0x55b94ac4e3f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7278006010 tx=0x7f7278005120 comp rx=0 tx=0).stop 2024-09-17T01:35:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.476+0000 7f7294424740 1 -- 172.21.15.42:0/2653450529 shutdown_connections 2024-09-17T01:35:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.476+0000 7f7294424740 1 --2- 172.21.15.42:0/2653450529 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55b94abe9530 0x55b94ac5c5f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.476+0000 7f7294424740 1 --2- 172.21.15.42:0/2653450529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b94a7c0590 0x55b94abc8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.476+0000 7f7294424740 1 --2- 172.21.15.42:0/2653450529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b94a7e1270 0x55b94abc9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.476+0000 7f7294424740 1 --2- 172.21.15.42:0/2653450529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b94a7b83b0 0x55b94ac4e3f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.476+0000 7f726b400640 0 client.5433 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.476+0000 7f7294424740 1 -- 172.21.15.42:0/2653450529 >> 172.21.15.42:0/2653450529 conn(0x55b94a7d53c0 msgr2=0x55b94abcffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.476+0000 7f7294424740 1 -- 172.21.15.42:0/2653450529 shutdown_connections 2024-09-17T01:35:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.476+0000 7f7294424740 1 -- 172.21.15.42:0/2653450529 wait complete. 2024-09-17T01:35:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.476+0000 7f7294424740 20 client.5433 trim_cache size 0 max 16384 2024-09-17T01:35:23.487 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:23.487 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "fea1c88c-cb05-432f-a745-f9dcbb5f2503", 2024-09-17T01:35:23.488 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-17T01:35:23.488 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 5283, 2024-09-17T01:35:23.488 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-17T01:35:23.488 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-17T01:35:23.488 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-17T01:35:23.488 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 11.814318827999999, 2024-09-17T01:35:23.488 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 28, 2024-09-17T01:35:23.488 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 49, 2024-09-17T01:35:23.488 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 49, 2024-09-17T01:35:23.488 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 17.813944518 2024-09-17T01:35:23.488 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.477+0000 7f728d400640 1 -- 172.21.15.42:0/395994696 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7264078b90 msgr2=0x7f726407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.477+0000 7f728d400640 1 --2- 172.21.15.42:0/395994696 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7264078b90 0x7f726407b0a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7278033000 tx=0x7f7278004730 comp rx=0 tx=0).stop 2024-09-17T01:35:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.477+0000 7f728d400640 1 -- 172.21.15.42:0/395994696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7288142f40 msgr2=0x7f72881f75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.477+0000 7f728d400640 1 --2- 172.21.15.42:0/395994696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7288142f40 0x7f72881f75b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f728000e960 tx=0x7f728000ee20 comp rx=0 tx=0).stop 2024-09-17T01:35:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.477+0000 7f728d400640 1 -- 172.21.15.42:0/395994696 shutdown_connections 2024-09-17T01:35:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.477+0000 7f728d400640 1 --2- 172.21.15.42:0/395994696 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7264078b90 0x7f726407b0a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.477+0000 7f728d400640 1 --2- 172.21.15.42:0/395994696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72880cec40 0x7f72881f7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.477+0000 7f728d400640 1 --2- 172.21.15.42:0/395994696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7288142f40 0x7f72881f75b0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.477+0000 7f728d400640 1 --2- 172.21.15.42:0/395994696 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72880b3550 0x7f72881f67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.477+0000 7f728d400640 1 -- 172.21.15.42:0/395994696 >> 172.21.15.42:0/395994696 conn(0x7f72880b2930 msgr2=0x7f728815f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.477+0000 7f728d400640 1 -- 172.21.15.42:0/395994696 shutdown_connections 2024-09-17T01:35:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.477+0000 7f728d400640 1 -- 172.21.15.42:0/395994696 wait complete. 2024-09-17T01:35:23.499 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T01:35:23.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.727+0000 7fbd72a00640 1 -- 172.21.15.42:0/2676829410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd6c0af3a0 msgr2=0x7fbd6c06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:23.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.727+0000 7fbd72a00640 1 --2- 172.21.15.42:0/2676829410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd6c0af3a0 0x7fbd6c06cd20 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c074ef0 tx=0x7fbd5802a560 comp rx=0 tx=0).stop 2024-09-17T01:35:23.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.727+0000 7fbd72a00640 1 -- 172.21.15.42:0/2676829410 shutdown_connections 2024-09-17T01:35:23.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.727+0000 7fbd72a00640 1 --2- 172.21.15.42:0/2676829410 >> v2:172.21.15.43:3300/0 conn(0x7fbd6c0b7040 0x7fbd6c162870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.727+0000 7fbd72a00640 1 --2- 172.21.15.42:0/2676829410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd6c0af3a0 0x7fbd6c06cd20 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.727+0000 7fbd72a00640 1 -- 172.21.15.42:0/2676829410 >> 172.21.15.42:0/2676829410 conn(0x7fbd6c0b7990 msgr2=0x7fbd6c0b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:23.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.727+0000 7fbd72a00640 1 -- 172.21.15.42:0/2676829410 shutdown_connections 2024-09-17T01:35:23.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.727+0000 7fbd72a00640 1 -- 172.21.15.42:0/2676829410 wait complete. 2024-09-17T01:35:23.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.730+0000 7fbd72a00640 1 Processor -- start 2024-09-17T01:35:23.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.730+0000 7fbd72a00640 1 -- start start 2024-09-17T01:35:23.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.731+0000 7fbd72a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd6c0af3a0 0x7fbd6c1f6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:23.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.731+0000 7fbd72a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd6c0b7040 0x7fbd6c15e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:23.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.731+0000 7fbd72a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd6c0d21b0 0x7fbd6c15cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:23.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.731+0000 7fbd72a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6c162db0 con 0x7fbd6c0af3a0 2024-09-17T01:35:23.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.731+0000 7fbd72a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6c0b7660 con 0x7fbd6c0b7040 2024-09-17T01:35:23.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.731+0000 7fbd72a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbd6c162f30 con 0x7fbd6c0d21b0 2024-09-17T01:35:23.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.731+0000 7fbd6be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd6c0af3a0 0x7fbd6c1f6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:23.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.731+0000 7fbd6be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd6c0af3a0 0x7fbd6c1f6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52928/0 (socket says 172.21.15.42:52928) 2024-09-17T01:35:23.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.732+0000 7fbd6be00640 1 -- 172.21.15.42:0/2680354834 learned_addr learned my addr 172.21.15.42:0/2680354834 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:23.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.732+0000 7fbd6b400640 1 --2- 172.21.15.42:0/2680354834 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd6c0b7040 0x7fbd6c15e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:23.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.732+0000 7fbd70a00640 1 --2- 172.21.15.42:0/2680354834 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd6c0d21b0 0x7fbd6c15cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:23.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.732+0000 7fbd6be00640 1 -- 172.21.15.42:0/2680354834 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd6c0d21b0 msgr2=0x7fbd6c15cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:23.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.732+0000 7fbd6be00640 1 --2- 172.21.15.42:0/2680354834 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd6c0d21b0 0x7fbd6c15cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.732+0000 7fbd6be00640 1 -- 172.21.15.42:0/2680354834 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd6c0b7040 msgr2=0x7fbd6c15e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:23.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.732+0000 7fbd6be00640 1 --2- 172.21.15.42:0/2680354834 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd6c0b7040 0x7fbd6c15e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.732+0000 7fbd6be00640 1 -- 172.21.15.42:0/2680354834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6c1fa130 con 0x7fbd6c0af3a0 2024-09-17T01:35:23.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.732+0000 7fbd6be00640 1 --2- 172.21.15.42:0/2680354834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd6c0af3a0 0x7fbd6c1f6b10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00c3d0 tx=0x7fbd5c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:23.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.733+0000 7fbd63e00640 1 -- 172.21.15.42:0/2680354834 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c017070 con 0x7fbd6c0af3a0 2024-09-17T01:35:23.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.733+0000 7fbd63e00640 1 -- 172.21.15.42:0/2680354834 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd5c0053c0 con 0x7fbd6c0af3a0 2024-09-17T01:35:23.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.733+0000 7fbd63e00640 1 -- 172.21.15.42:0/2680354834 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c003850 con 0x7fbd6c0af3a0 2024-09-17T01:35:23.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.733+0000 7fbd72a00640 1 -- 172.21.15.42:0/2680354834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd6c15ea20 con 0x7fbd6c0af3a0 2024-09-17T01:35:23.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.733+0000 7fbd72a00640 1 -- 172.21.15.42:0/2680354834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd6c1f6310 con 0x7fbd6c0af3a0 2024-09-17T01:35:23.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.734+0000 7fbd72a00640 1 -- 172.21.15.42:0/2680354834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd6c163480 con 0x7fbd6c0af3a0 2024-09-17T01:35:23.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.735+0000 7fbd63e00640 1 -- 172.21.15.42:0/2680354834 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbd5c01a070 con 0x7fbd6c0af3a0 2024-09-17T01:35:23.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.736+0000 7fbd63e00640 1 --2- 172.21.15.42:0/2680354834 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd4c078bc0 0x7fbd4c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:23.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.736+0000 7fbd63e00640 1 -- 172.21.15.42:0/2680354834 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fbd5c09a130 con 0x7fbd6c0af3a0 2024-09-17T01:35:23.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.737+0000 7fbd6b400640 1 --2- 172.21.15.42:0/2680354834 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd4c078bc0 0x7fbd4c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:23.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.737+0000 7fbd6b400640 1 --2- 172.21.15.42:0/2680354834 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd4c078bc0 0x7fbd4c07b0d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbd58033000 tx=0x7fbd58004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:23.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.740+0000 7fbd63e00640 1 -- 172.21.15.42:0/2680354834 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbd6c0b80d0 con 0x7fbd6c0af3a0 2024-09-17T01:35:23.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.970+0000 7fbd72a00640 1 -- 172.21.15.42:0/2680354834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbd6c0b3950 con 0x7fbd6c0af3a0 2024-09-17T01:35:23.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.971+0000 7fbd63e00640 1 -- 172.21.15.42:0/2680354834 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+73 (secure 0 0 0) 0x7fbd5c062560 con 0x7fbd6c0af3a0 2024-09-17T01:35:23.970 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T01:35:23.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.973+0000 7fbd72a00640 1 -- 172.21.15.42:0/2680354834 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd4c078bc0 msgr2=0x7fbd4c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:23.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.973+0000 7fbd72a00640 1 --2- 172.21.15.42:0/2680354834 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd4c078bc0 0x7fbd4c07b0d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbd58033000 tx=0x7fbd58004730 comp rx=0 tx=0).stop 2024-09-17T01:35:23.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.973+0000 7fbd72a00640 1 -- 172.21.15.42:0/2680354834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd6c0af3a0 msgr2=0x7fbd6c1f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:23.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.973+0000 7fbd72a00640 1 --2- 172.21.15.42:0/2680354834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd6c0af3a0 0x7fbd6c1f6b10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00c3d0 tx=0x7fbd5c00c890 comp rx=0 tx=0).stop 2024-09-17T01:35:23.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.973+0000 7fbd72a00640 1 -- 172.21.15.42:0/2680354834 shutdown_connections 2024-09-17T01:35:23.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.973+0000 7fbd72a00640 1 --2- 172.21.15.42:0/2680354834 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd4c078bc0 0x7fbd4c07b0d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.973+0000 7fbd72a00640 1 --2- 172.21.15.42:0/2680354834 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd6c0b7040 0x7fbd6c15e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.973+0000 7fbd72a00640 1 --2- 172.21.15.42:0/2680354834 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd6c0d21b0 0x7fbd6c15cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.973+0000 7fbd72a00640 1 --2- 172.21.15.42:0/2680354834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd6c0af3a0 0x7fbd6c1f6b10 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:23.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.973+0000 7fbd72a00640 1 -- 172.21.15.42:0/2680354834 >> 172.21.15.42:0/2680354834 conn(0x7fbd6c0b7990 msgr2=0x7fbd6c075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:23.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.973+0000 7fbd72a00640 1 -- 172.21.15.42:0/2680354834 shutdown_connections 2024-09-17T01:35:23.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:23.973+0000 7fbd72a00640 1 -- 172.21.15.42:0/2680354834 wait complete. 2024-09-17T01:35:23.994 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T01:35:23.995 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:35:23.995 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-09-17T01:35:23.995 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T01:35:23.995 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:35:23.995 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T01:35:23.995 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T01:35:23.995 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:35:23.995 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:35:23.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:35:23.996 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-09-17T01:35:24.033 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:35:24.033 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:35:24.033 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:35:24.033 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:35:24.034 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-17T01:35:24.034 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:35:24.034 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:35:24.034 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-09-17T01:35:24.034 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-09-17T01:35:24.034 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:35:24.035 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-09-17T01:35:24.035 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-09-17T01:35:24.035 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:35:24.035 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:35:24.035 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-09-17T01:35:24.036 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-17T01:35:24.036 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42484sec preferred_lft 42484sec 2024-09-17T01:35:24.036 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-17T01:35:24.036 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:35:24.036 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:35:24.036 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:35:24.037 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-09-17T01:35:24.037 INFO:teuthology.orchestra.run.smithi042.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T01:35:24.037 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T01:35:24.037 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T01:35:24.037 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:35:24.037 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::68d2:2bff:fe2f:191a/64 scope link 2024-09-17T01:35:24.038 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:35:24.038 INFO:teuthology.orchestra.run.smithi042.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:35:24.038 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether e2:73:3e:9b:8a:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:35:24.038 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::e073:3eff:fe9b:8a00/64 scope link 2024-09-17T01:35:24.038 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:35:24.039 INFO:teuthology.orchestra.run.smithi042.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:35:24.039 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T01:35:24.039 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::240b:bfff:feb7:6e5b/64 scope link 2024-09-17T01:35:24.039 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:35:24.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:35:24.039 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:35:24.127 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-17T01:35:24.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:35:24.130 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-09-17T01:35:24.166 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-09-17T01:35:24.166 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:35:24.166 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-17T01:35:24.166 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-17T01:35:24.166 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:35:24.167 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:35:24.167 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:35:24.167 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T01:35:24.167 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T01:35:24.167 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T01:35:24.167 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:35:24.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:35:24.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:35:24.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:35:24.366 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-17T01:35:24.402 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T01:35:24.402 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T01:35:24.403 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:35:24.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:35:24.403 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-09-17T01:35:24.500 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:35:24.500 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T01:35:24.536 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:35:24.536 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:35:24.536 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:35:24.612 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T01:35:24.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:35:24.613 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:35:24.810 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:35:24.810 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:35:24.811 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:35:24.830 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:35:24.830 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:35:24.831 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:35:24.831 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:35:24.831 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:35:24.862 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:35:24.862 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:35:24.862 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:35:24.862 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:35:24.862 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:35:24.862 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-09-17T01:35:24.862 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-09-17T01:35:24.862 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fea1c88c-cb05-432f-a745-f9dcbb5f2503" will pass to kernel 2024-09-17T01:35:24.863 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T01:35:24.863 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-09-17T01:35:24.864 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T01:35:24.864 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T01:35:24.864 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T01:35:24.866 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T01:35:24.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:35:24.867 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:35:24.923 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:35:25.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:35:25.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:35:25.021 INFO:teuthology.orchestra.run.smithi042.stdout:client5356 2024-09-17T01:35:25.021 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:35:25.022 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:35:25.059 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-17T01:35:25.059 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-09-17T01:35:25.059 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-09-17T01:35:25.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:35:25.060 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-09-17T01:35:25.142 DEBUG:teuthology.orchestra.run.smithi042:> stdin-killer -- python3 -c ' 2024-09-17T01:35:25.142 DEBUG:teuthology.orchestra.run.smithi042:> import os 2024-09-17T01:35:25.142 DEBUG:teuthology.orchestra.run.smithi042:> import stat 2024-09-17T01:35:25.142 DEBUG:teuthology.orchestra.run.smithi042:> import json 2024-09-17T01:35:25.142 DEBUG:teuthology.orchestra.run.smithi042:> import sys 2024-09-17T01:35:25.142 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:35:25.143 DEBUG:teuthology.orchestra.run.smithi042:> try: 2024-09-17T01:35:25.143 DEBUG:teuthology.orchestra.run.smithi042:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-09-17T01:35:25.143 DEBUG:teuthology.orchestra.run.smithi042:> except OSError as e: 2024-09-17T01:35:25.143 DEBUG:teuthology.orchestra.run.smithi042:> sys.exit(e.errno) 2024-09-17T01:35:25.143 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:35:25.143 DEBUG:teuthology.orchestra.run.smithi042:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-17T01:35:25.144 DEBUG:teuthology.orchestra.run.smithi042:> print(json.dumps( 2024-09-17T01:35:25.144 DEBUG:teuthology.orchestra.run.smithi042:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-17T01:35:25.144 DEBUG:teuthology.orchestra.run.smithi042:> indent=2)) 2024-09-17T01:35:25.144 DEBUG:teuthology.orchestra.run.smithi042:> ' 2024-09-17T01:35:25.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:25 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-09-17T01:35:25.295 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T01:35:25.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:35:25.295 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone --branch giant http://github.com/ceph/ceph-qa-suite /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite) 2024-09-17T01:35:25.374 INFO:teuthology.orchestra.run.smithi042.stderr:Cloning into '/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'... 2024-09-17T01:35:25.666 INFO:teuthology.orchestra.run.smithi042.stderr:warning: redirecting to https://github.com/ceph/ceph-qa-suite/ 2024-09-17T01:35:29.488 INFO:teuthology.orchestra.run.smithi042.stderr:Updating files: 45% (641/1398) Updating files: 46% (644/1398) Updating files: 47% (658/1398) Updating files: 48% (672/1398) Updating files: 49% (686/1398) Updating files: 50% (699/1398) Updating files: 51% (713/1398) Updating files: 52% (727/1398) Updating files: 53% (741/1398) Updating files: 54% (755/1398) Updating files: 55% (769/1398) Updating files: 56% (783/1398) Updating files: 57% (797/1398) Updating files: 58% (811/1398) Updating files: 59% (825/1398) Updating files: 60% (839/1398) Updating files: 61% (853/1398) Updating files: 62% (867/1398) Updating files: 63% (881/1398) Updating files: 64% (895/1398) Updating files: 65% (909/1398) Updating files: 66% (923/1398) Updating files: 67% (937/1398) Updating files: 68% (951/1398) Updating files: 69% (965/1398) Updating files: 70% (979/1398) Updating files: 70% (991/1398) Updating files: 71% (993/1398) Updating files: 72% (1007/1398) Updating files: 73% (1021/1398) Updating files: 74% (1035/1398) Updating files: 75% (1049/1398) Updating files: 76% (1063/1398) Updating files: 77% (1077/1398) Updating files: 78% (1091/1398) Updating files: 79% (1105/1398) Updating files: 80% (1119/1398) Updating files: 81% (1133/1398) Updating files: 82% (1147/1398) Updating files: 83% (1161/1398) Updating files: 84% (1175/1398) Updating files: 85% (1189/1398) Updating files: 86% (1203/1398) Updating files: 87% (1217/1398) Updating files: 88% (1231/1398) Updating files: 89% (1245/1398) Updating files: 90% (1259/1398) Updating files: 91% (1273/1398) Updating files: 92% (1287/1398) Updating files: 93% (1301/1398) Updating files: 94% (1315/1398) Updating files: 95% (1329/1398) Updating files: 96% (1343/1398) Updating files: 97% (1357/1398) Updating files: 98% (1371/1398) Updating files: 99% (1385/1398) Updating files: 100% (1398/1398) Updating files: 100% (1398/1398), done. 2024-09-17T01:35:29.495 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 0 2024-09-17T01:35:29.495 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-09-17T01:35:29.495 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/i/dont/exist 2024-09-17T01:35:29.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.769+0000 7fe3e7a00640 1 -- 172.21.15.42:0/3467451947 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3c8004d40 msgr2=0x7fe3c8005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:29.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.769+0000 7fe3e7a00640 1 --2- 172.21.15.42:0/3467451947 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3c8004d40 0x7fe3c8005150 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8009ed0 tx=0x7fe3c8005830 comp rx=0 tx=0).stop 2024-09-17T01:35:29.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.769+0000 7fe3e5a00640 1 -- 172.21.15.42:0/3467451947 reap_dead start 2024-09-17T01:35:29.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.769+0000 7fe3e7a00640 1 -- 172.21.15.42:0/3467451947 shutdown_connections 2024-09-17T01:35:29.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.769+0000 7fe3e7a00640 1 -- 172.21.15.42:0/3467451947 >> 172.21.15.42:0/3467451947 conn(0x7fe3e00b2930 msgr2=0x7fe3e006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:29.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.769+0000 7fe3e7a00640 1 -- 172.21.15.42:0/3467451947 shutdown_connections 2024-09-17T01:35:29.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.769+0000 7fe3e7a00640 1 -- 172.21.15.42:0/3467451947 wait complete. 2024-09-17T01:35:29.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.771+0000 7fe3e7a00640 1 Processor -- start 2024-09-17T01:35:29.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.771+0000 7fe3e7a00640 1 -- start start 2024-09-17T01:35:29.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.773+0000 7fe3e7a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe3c8004d40 0x7fe3e0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:29.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.773+0000 7fe3e7a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3e01f8f90 0x7fe3e014ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:29.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.773+0000 7fe3e7a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3e014fa50 0x7fe3e01e9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:29.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.773+0000 7fe3e7a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e015fde0 con 0x7fe3e01f8f90 2024-09-17T01:35:29.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.773+0000 7fe3e7a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e015fc60 con 0x7fe3e014fa50 2024-09-17T01:35:29.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.773+0000 7fe3e7a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e015ff60 con 0x7fe3c8004d40 2024-09-17T01:35:29.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.773+0000 7fe3dfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3e01f8f90 0x7fe3e014ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:29.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.773+0000 7fe3dfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3e01f8f90 0x7fe3e014ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37204/0 (socket says 172.21.15.42:37204) 2024-09-17T01:35:29.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.773+0000 7fe3dfe00640 1 -- 172.21.15.42:0/1114640917 learned_addr learned my addr 172.21.15.42:0/1114640917 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:29.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.773+0000 7fe3e5000640 1 --2- 172.21.15.42:0/1114640917 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe3c8004d40 0x7fe3e0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:29.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.773+0000 7fe3e5a00640 1 --2- 172.21.15.42:0/1114640917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3e014fa50 0x7fe3e01e9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:29.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.773+0000 7fe3dfe00640 1 -- 172.21.15.42:0/1114640917 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe3c8004d40 msgr2=0x7fe3e0152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:29.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.774+0000 7fe3dfe00640 1 --2- 172.21.15.42:0/1114640917 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe3c8004d40 0x7fe3e0152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.774+0000 7fe3dfe00640 1 -- 172.21.15.42:0/1114640917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3e014fa50 msgr2=0x7fe3e01e9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:29.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.774+0000 7fe3dfe00640 1 --2- 172.21.15.42:0/1114640917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3e014fa50 0x7fe3e01e9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.774+0000 7fe3dfe00640 1 -- 172.21.15.42:0/1114640917 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e01f9a90 con 0x7fe3e01f8f90 2024-09-17T01:35:29.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.774+0000 7fe3dfe00640 1 --2- 172.21.15.42:0/1114640917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3e01f8f90 0x7fe3e014ca00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc006600 tx=0x7fe3cc0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:29.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.774+0000 7fe3dcc00640 1 -- 172.21.15.42:0/1114640917 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc015070 con 0x7fe3e01f8f90 2024-09-17T01:35:29.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.774+0000 7fe3dcc00640 1 -- 172.21.15.42:0/1114640917 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3cc00f960 con 0x7fe3e01f8f90 2024-09-17T01:35:29.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.774+0000 7fe3dcc00640 1 -- 172.21.15.42:0/1114640917 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc00fdb0 con 0x7fe3e01f8f90 2024-09-17T01:35:29.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.774+0000 7fe3e7a00640 1 -- 172.21.15.42:0/1114640917 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3e014ef70 con 0x7fe3e01f8f90 2024-09-17T01:35:29.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.774+0000 7fe3e7a00640 1 -- 172.21.15.42:0/1114640917 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3e014f530 con 0x7fe3e01f8f90 2024-09-17T01:35:29.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.777+0000 7fe3dcc00640 1 -- 172.21.15.42:0/1114640917 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe3cc011430 con 0x7fe3e01f8f90 2024-09-17T01:35:29.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.778+0000 7fe3dcc00640 1 --2- 172.21.15.42:0/1114640917 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe3c0078b90 0x7fe3c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:29.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.778+0000 7fe3dcc00640 1 -- 172.21.15.42:0/1114640917 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fe3cc09bb00 con 0x7fe3e01f8f90 2024-09-17T01:35:29.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.778+0000 7fe3eec2f740 1 Processor -- start 2024-09-17T01:35:29.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.778+0000 7fe3e5000640 1 --2- 172.21.15.42:0/1114640917 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe3c0078b90 0x7fe3c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:29.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.778+0000 7fe3eec2f740 1 -- start start 2024-09-17T01:35:29.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.779+0000 7fe3e5000640 1 --2- 172.21.15.42:0/1114640917 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe3c0078b90 0x7fe3c007b0a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400bcf0 tx=0x7fe3d400b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:29.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.780+0000 7fe3eec2f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6f1530 0x55a8caac2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:29.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.780+0000 7fe3eec2f740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a8ca6c8670 0x55a8caac3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:29.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.780+0000 7fe3eec2f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8ca6d0850 0x55a8caae0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:29.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.780+0000 7fe3eec2f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a8caa0b9d0 con 0x55a8ca6f1530 2024-09-17T01:35:29.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.780+0000 7fe3eec2f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a8ca9fae00 con 0x55a8ca6d0850 2024-09-17T01:35:29.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.780+0000 7fe3eec2f740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55a8ca9fec10 con 0x55a8ca6c8670 2024-09-17T01:35:29.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.780+0000 7fe3e5000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6f1530 0x55a8caac2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:29.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.780+0000 7fe3e5000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6f1530 0x55a8caac2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37210/0 (socket says 172.21.15.42:37210) 2024-09-17T01:35:29.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.780+0000 7fe3e5000640 1 -- 172.21.15.42:0/1508940759 learned_addr learned my addr 172.21.15.42:0/1508940759 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:29.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.780+0000 7fe3dfe00640 1 --2- 172.21.15.42:0/1508940759 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a8ca6c8670 0x55a8caac3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:29.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.780+0000 7fe3e5a00640 1 --2- 172.21.15.42:0/1508940759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8ca6d0850 0x55a8caae0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:29.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.780+0000 7fe3e5000640 1 -- 172.21.15.42:0/1508940759 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a8ca6c8670 msgr2=0x55a8caac3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:29.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.780+0000 7fe3e5000640 1 --2- 172.21.15.42:0/1508940759 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a8ca6c8670 0x55a8caac3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.780+0000 7fe3e5000640 1 -- 172.21.15.42:0/1508940759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8ca6d0850 msgr2=0x55a8caae0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:29.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.780+0000 7fe3e5000640 1 --2- 172.21.15.42:0/1508940759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8ca6d0850 0x55a8caae0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.780+0000 7fe3e5000640 1 -- 172.21.15.42:0/1508940759 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8ca9f7970 con 0x55a8ca6f1530 2024-09-17T01:35:29.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.781+0000 7fe3e5a00640 1 --2- 172.21.15.42:0/1508940759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8ca6d0850 0x55a8caae0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:29.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.781+0000 7fe3e5000640 1 --2- 172.21.15.42:0/1508940759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6f1530 0x55a8caac2f50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe3d401f5f0 tx=0x7fe3d4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1171673d129c622d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:29.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.781+0000 7fe3d1600640 1 -- 172.21.15.42:0/1508940759 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4005020 con 0x55a8ca6f1530 2024-09-17T01:35:29.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.781+0000 7fe3d1600640 1 -- 172.21.15.42:0/1508940759 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3d40051c0 con 0x55a8ca6f1530 2024-09-17T01:35:29.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.781+0000 7fe3d1600640 1 -- 172.21.15.42:0/1508940759 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d40053b0 con 0x55a8ca6f1530 2024-09-17T01:35:29.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.782+0000 7fe3eec2f740 1 -- 172.21.15.42:0/1508940759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6f1530 msgr2=0x55a8caac2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:29.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.782+0000 7fe3eec2f740 1 --2- 172.21.15.42:0/1508940759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6f1530 0x55a8caac2f50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe3d401f5f0 tx=0x7fe3d4016000 comp rx=0 tx=0).stop 2024-09-17T01:35:29.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.782+0000 7fe3eec2f740 1 -- 172.21.15.42:0/1508940759 shutdown_connections 2024-09-17T01:35:29.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.782+0000 7fe3eec2f740 1 --2- 172.21.15.42:0/1508940759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8ca6d0850 0x55a8caae0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.782+0000 7fe3eec2f740 1 --2- 172.21.15.42:0/1508940759 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a8ca6c8670 0x55a8caac3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.782+0000 7fe3eec2f740 1 --2- 172.21.15.42:0/1508940759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6f1530 0x55a8caac2f50 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.782+0000 7fe3eec2f740 1 -- 172.21.15.42:0/1508940759 >> 172.21.15.42:0/1508940759 conn(0x55a8ca6e5680 msgr2=0x55a8caa99210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:29.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.782+0000 7fe3eec2f740 1 -- 172.21.15.42:0/1508940759 shutdown_connections 2024-09-17T01:35:29.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.782+0000 7fe3eec2f740 1 -- 172.21.15.42:0/1508940759 wait complete. 2024-09-17T01:35:29.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.783+0000 7fe3eec2f740 1 -- start start 2024-09-17T01:35:29.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.783+0000 7fe3eec2f740 1 Processor -- start 2024-09-17T01:35:29.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.785+0000 7fe3eec2f740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a8ca6c8670 0x55a8caad4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:29.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.785+0000 7fe3eec2f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6d0850 0x55a8caad6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:29.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.785+0000 7fe3eec2f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8ca6f1530 0x55a8caaf07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:29.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.785+0000 7fe3eec2f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a8ca76b8e0 con 0x55a8ca6d0850 2024-09-17T01:35:29.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.785+0000 7fe3eec2f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a8ca9a1600 con 0x55a8ca6f1530 2024-09-17T01:35:29.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.785+0000 7fe3eec2f740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55a8caac39d0 con 0x55a8ca6c8670 2024-09-17T01:35:29.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.785+0000 7fe3eec2f740 10 client.0 _ll_register_callbacks cb 0x55a8ca99ff10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:29.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.785+0000 7fe3dfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6d0850 0x55a8caad6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:29.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.785+0000 7fe3dfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6d0850 0x55a8caad6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37226/0 (socket says 172.21.15.42:37226) 2024-09-17T01:35:29.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.785+0000 7fe3dfe00640 1 -- 172.21.15.42:0/3863190956 learned_addr learned my addr 172.21.15.42:0/3863190956 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:29.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.785+0000 7fe3e5000640 1 --2- 172.21.15.42:0/3863190956 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a8ca6c8670 0x55a8caad4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:29.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.785+0000 7fe3e5a00640 1 --2- 172.21.15.42:0/3863190956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8ca6f1530 0x55a8caaf07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:29.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.785+0000 7fe3dfe00640 1 -- 172.21.15.42:0/3863190956 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a8ca6c8670 msgr2=0x55a8caad4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:29.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.785+0000 7fe3dfe00640 1 --2- 172.21.15.42:0/3863190956 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a8ca6c8670 0x55a8caad4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.785+0000 7fe3dfe00640 1 -- 172.21.15.42:0/3863190956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8ca6f1530 msgr2=0x55a8caaf07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:29.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.785+0000 7fe3dfe00640 1 --2- 172.21.15.42:0/3863190956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8ca6f1530 0x55a8caaf07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.786+0000 7fe3dfe00640 1 -- 172.21.15.42:0/3863190956 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8ca6ed590 con 0x55a8ca6d0850 2024-09-17T01:35:29.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.786+0000 7fe3e5000640 1 --2- 172.21.15.42:0/3863190956 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a8ca6c8670 0x55a8caad4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:29.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.786+0000 7fe3dfe00640 1 --2- 172.21.15.42:0/3863190956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6d0850 0x55a8caad6960 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc001330 tx=0x7fe3cc063e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92529c1091bfefe7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:29.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.786+0000 7fe3c6000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:29.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.786+0000 7fe3c6000640 1 -- 172.21.15.42:0/3863190956 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc089030 con 0x55a8ca6d0850 2024-09-17T01:35:29.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.786+0000 7fe3c6000640 1 -- 172.21.15.42:0/3863190956 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fe3cc07d800 con 0x55a8ca6d0850 2024-09-17T01:35:29.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.786+0000 7fe3eec2f740 1 -- 172.21.15.42:0/3863190956 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3d40051c0 con 0x55a8ca6d0850 2024-09-17T01:35:29.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.786+0000 7fe3c6000640 1 -- 172.21.15.42:0/3863190956 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe3cc020070 con 0x55a8ca6d0850 2024-09-17T01:35:29.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.786+0000 7fe3eec2f740 10 client.5451 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:29.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.786+0000 7fe3eec2f740 1 -- 172.21.15.42:0/3863190956 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x55a8ca75cb10 con 0x55a8ca6d0850 2024-09-17T01:35:29.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.786+0000 7fe3c6000640 1 -- 172.21.15.42:0/3863190956 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3d40051c0 con 0x55a8ca6d0850 2024-09-17T01:35:29.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.786+0000 7fe3c6000640 1 -- 172.21.15.42:0/3863190956 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7fe3cc05f240 con 0x55a8ca6d0850 2024-09-17T01:35:29.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.787+0000 7fe3eec2f740 10 client.5451 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:29.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.787+0000 7fe3eec2f740 10 client.5451 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:29.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.787+0000 7fe3eec2f740 20 client.5451 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:29.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.787+0000 7fe3eec2f740 1 --2- 172.21.15.42:0/3863190956 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55a8ca6b0100 0x55a8caae0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:29.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.787+0000 7fe3eec2f740 4 client.5451 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:29.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.787+0000 7fe3eec2f740 1 -- 172.21.15.42:0/3863190956 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8caa0d920 con 0x55a8ca6b0100 2024-09-17T01:35:29.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.787+0000 7fe3e5000640 1 --2- 172.21.15.42:0/3863190956 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55a8ca6b0100 0x55a8caae0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:29.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.787+0000 7fe3e5000640 1 --2- 172.21.15.42:0/3863190956 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55a8ca6b0100 0x55a8caae0790 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24a26a3e335118cc server_cookie=cf297b671c26c5c2 in_seq=0 out_seq=0 2024-09-17T01:35:29.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.787+0000 7fe3c6000640 10 client.5451 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:29.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.788+0000 7fe3c6000640 1 -- 172.21.15.42:0/3863190956 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a8caa0d920 con 0x55a8ca6b0100 2024-09-17T01:35:29.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.788+0000 7fe3c6000640 10 client.5451 handle_command_reply: tid=0 2024-09-17T01:35:29.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.788+0000 7fe3eec2f740 1 client.5451 shutdown 2024-09-17T01:35:29.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.788+0000 7fe3eec2f740 1 -- 172.21.15.42:0/3863190956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6d0850 msgr2=0x55a8caad6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:29.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.788+0000 7fe3eec2f740 1 --2- 172.21.15.42:0/3863190956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6d0850 0x55a8caad6960 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc001330 tx=0x7fe3cc063e90 comp rx=0 tx=0).stop 2024-09-17T01:35:29.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.789+0000 7fe3eec2f740 1 -- 172.21.15.42:0/3863190956 shutdown_connections 2024-09-17T01:35:29.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.789+0000 7fe3eec2f740 1 --2- 172.21.15.42:0/3863190956 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55a8ca6b0100 0x55a8caae0790 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.789+0000 7fe3eec2f740 1 --2- 172.21.15.42:0/3863190956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8ca6f1530 0x55a8caaf07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.789+0000 7fe3eec2f740 1 --2- 172.21.15.42:0/3863190956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6d0850 0x55a8caad6960 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.789+0000 7fe3eec2f740 1 --2- 172.21.15.42:0/3863190956 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a8ca6c8670 0x55a8caad4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.789+0000 7fe3c6000640 0 client.5451 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:29.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.789+0000 7fe3eec2f740 1 -- 172.21.15.42:0/3863190956 >> 172.21.15.42:0/3863190956 conn(0x55a8ca6e5680 msgr2=0x55a8caa990c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:29.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.789+0000 7fe3eec2f740 1 -- 172.21.15.42:0/3863190956 shutdown_connections 2024-09-17T01:35:29.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.789+0000 7fe3eec2f740 1 -- 172.21.15.42:0/3863190956 wait complete. 2024-09-17T01:35:29.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.789+0000 7fe3eec2f740 20 client.5451 trim_cache size 0 max 16384 2024-09-17T01:35:29.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.805+0000 7fe3eec2f740 1 Processor -- start 2024-09-17T01:35:29.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.805+0000 7fe3eec2f740 1 -- start start 2024-09-17T01:35:29.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.806+0000 7fe3eec2f740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a8ca6c8670 0x55a8caae9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:29.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.806+0000 7fe3eec2f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8ca6d0850 0x55a8caa9a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:29.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.806+0000 7fe3eec2f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6f1530 0x55a8caa990a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:29.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.806+0000 7fe3eec2f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e02029c0 con 0x55a8ca6f1530 2024-09-17T01:35:29.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.806+0000 7fe3eec2f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e0201a00 con 0x55a8ca6d0850 2024-09-17T01:35:29.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.806+0000 7fe3eec2f740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e01f64d0 con 0x55a8ca6c8670 2024-09-17T01:35:29.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.806+0000 7fe3e5a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6f1530 0x55a8caa990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:29.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.807+0000 7fe3e5a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6f1530 0x55a8caa990a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37238/0 (socket says 172.21.15.42:37238) 2024-09-17T01:35:29.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.807+0000 7fe3e5a00640 1 -- 172.21.15.42:0/1594511903 learned_addr learned my addr 172.21.15.42:0/1594511903 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:29.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.807+0000 7fe3dfe00640 1 --2- 172.21.15.42:0/1594511903 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8ca6d0850 0x55a8caa9a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:29.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.807+0000 7fe3e5000640 1 --2- 172.21.15.42:0/1594511903 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a8ca6c8670 0x55a8caae9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:29.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.807+0000 7fe3e5a00640 1 -- 172.21.15.42:0/1594511903 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a8ca6c8670 msgr2=0x55a8caae9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:29.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.807+0000 7fe3e5a00640 1 --2- 172.21.15.42:0/1594511903 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a8ca6c8670 0x55a8caae9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.807+0000 7fe3e5a00640 1 -- 172.21.15.42:0/1594511903 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8ca6d0850 msgr2=0x55a8caa9a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:29.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.807+0000 7fe3e5a00640 1 --2- 172.21.15.42:0/1594511903 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8ca6d0850 0x55a8caa9a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.807+0000 7fe3e5a00640 1 -- 172.21.15.42:0/1594511903 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8ca7d3970 con 0x55a8ca6f1530 2024-09-17T01:35:29.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.808+0000 7fe3e5a00640 1 --2- 172.21.15.42:0/1594511903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6f1530 0x55a8caa990a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe3d802b870 tx=0x7fe3d8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a2ad7bb7cda21f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:29.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.808+0000 7fe3d0c00640 1 -- 172.21.15.42:0/1594511903 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8046070 con 0x55a8ca6f1530 2024-09-17T01:35:29.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.808+0000 7fe3d0c00640 1 -- 172.21.15.42:0/1594511903 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3d8003c60 con 0x55a8ca6f1530 2024-09-17T01:35:29.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.808+0000 7fe3d0c00640 1 -- 172.21.15.42:0/1594511903 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8038040 con 0x55a8ca6f1530 2024-09-17T01:35:29.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.809+0000 7fe3eec2f740 1 -- 172.21.15.42:0/1594511903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6f1530 msgr2=0x55a8caa990a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:29.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.809+0000 7fe3eec2f740 1 --2- 172.21.15.42:0/1594511903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6f1530 0x55a8caa990a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe3d802b870 tx=0x7fe3d8004ab0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.809+0000 7fe3eec2f740 1 -- 172.21.15.42:0/1594511903 shutdown_connections 2024-09-17T01:35:29.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.809+0000 7fe3eec2f740 1 --2- 172.21.15.42:0/1594511903 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8ca6d0850 0x55a8caa9a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.809+0000 7fe3eec2f740 1 --2- 172.21.15.42:0/1594511903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6f1530 0x55a8caa990a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.809+0000 7fe3eec2f740 1 --2- 172.21.15.42:0/1594511903 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a8ca6c8670 0x55a8caae9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.809+0000 7fe3eec2f740 1 -- 172.21.15.42:0/1594511903 >> 172.21.15.42:0/1594511903 conn(0x55a8ca6e5680 msgr2=0x55a8caa8ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:29.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.809+0000 7fe3eec2f740 1 -- 172.21.15.42:0/1594511903 shutdown_connections 2024-09-17T01:35:29.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.809+0000 7fe3eec2f740 1 -- 172.21.15.42:0/1594511903 wait complete. 2024-09-17T01:35:29.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.810+0000 7fe3eec2f740 1 -- start start 2024-09-17T01:35:29.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.810+0000 7fe3eec2f740 1 Processor -- start 2024-09-17T01:35:29.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.811+0000 7fe3eec2f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6c8670 0x55a8caae0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:29.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.811+0000 7fe3eec2f740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a8ca6d0850 0x55a8cab5a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:29.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.811+0000 7fe3eec2f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8ca6f1530 0x55a8caad6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:29.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.811+0000 7fe3eec2f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e0201410 con 0x55a8ca6c8670 2024-09-17T01:35:29.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.811+0000 7fe3eec2f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a8caa93c00 con 0x55a8ca6f1530 2024-09-17T01:35:29.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.811+0000 7fe3eec2f740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55a8cab5e130 con 0x55a8ca6d0850 2024-09-17T01:35:29.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.811+0000 7fe3eec2f740 10 client.0 _ll_register_callbacks cb 0x7fe3cc05f7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:29.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.812+0000 7fe3e5000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6c8670 0x55a8caae0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:29.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.812+0000 7fe3e5000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6c8670 0x55a8caae0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37244/0 (socket says 172.21.15.42:37244) 2024-09-17T01:35:29.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.812+0000 7fe3e5000640 1 -- 172.21.15.42:0/1500919113 learned_addr learned my addr 172.21.15.42:0/1500919113 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:29.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.812+0000 7fe3e5a00640 1 --2- 172.21.15.42:0/1500919113 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8ca6f1530 0x55a8caad6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:29.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.812+0000 7fe3dfe00640 1 --2- 172.21.15.42:0/1500919113 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a8ca6d0850 0x55a8cab5a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:29.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.812+0000 7fe3e5000640 1 -- 172.21.15.42:0/1500919113 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a8ca6d0850 msgr2=0x55a8cab5a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:29.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.812+0000 7fe3e5000640 1 --2- 172.21.15.42:0/1500919113 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a8ca6d0850 0x55a8cab5a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.812+0000 7fe3e5000640 1 -- 172.21.15.42:0/1500919113 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8ca6f1530 msgr2=0x55a8caad6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:29.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.812+0000 7fe3e5000640 1 --2- 172.21.15.42:0/1500919113 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8ca6f1530 0x55a8caad6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.812+0000 7fe3e5000640 1 -- 172.21.15.42:0/1500919113 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8caae07a0 con 0x55a8ca6c8670 2024-09-17T01:35:29.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.812+0000 7fe3e5000640 1 --2- 172.21.15.42:0/1500919113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6c8670 0x55a8caae0df0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4011ca0 tx=0x7fe3d4005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96dc24abc2690402 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:29.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.812+0000 7fe3c6000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:29.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.813+0000 7fe3c6000640 1 -- 172.21.15.42:0/1500919113 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d400bd20 con 0x55a8ca6c8670 2024-09-17T01:35:29.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.813+0000 7fe3c6000640 1 -- 172.21.15.42:0/1500919113 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fe3d4024040 con 0x55a8ca6c8670 2024-09-17T01:35:29.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.813+0000 7fe3eec2f740 1 -- 172.21.15.42:0/1500919113 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3d8003c60 con 0x55a8ca6c8670 2024-09-17T01:35:29.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.813+0000 7fe3c6000640 1 -- 172.21.15.42:0/1500919113 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe3d4004040 con 0x55a8ca6c8670 2024-09-17T01:35:29.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.813+0000 7fe3eec2f740 10 client.5457 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:29.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.813+0000 7fe3eec2f740 1 -- 172.21.15.42:0/1500919113 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x55a8caac3840 con 0x55a8ca6c8670 2024-09-17T01:35:29.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.813+0000 7fe3c6000640 1 -- 172.21.15.42:0/1500919113 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3d8003c60 con 0x55a8ca6c8670 2024-09-17T01:35:29.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.813+0000 7fe3c6000640 1 -- 172.21.15.42:0/1500919113 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7fe3d40041e0 con 0x55a8ca6c8670 2024-09-17T01:35:29.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.813+0000 7fe3eec2f740 10 client.5457 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:29.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.813+0000 7fe3eec2f740 10 client.5457 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:29.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.813+0000 7fe3eec2f740 20 client.5457 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:29.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.813+0000 7fe3eec2f740 1 --2- 172.21.15.42:0/1500919113 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55a8caad6860 0x55a8cab5d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:29.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.813+0000 7fe3eec2f740 4 client.5457 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-17T01:35:29.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.813+0000 7fe3eec2f740 1 -- 172.21.15.42:0/1500919113 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}) -- 0x55a8caa093d0 con 0x55a8caad6860 2024-09-17T01:35:29.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.814+0000 7fe3dfe00640 1 --2- 172.21.15.42:0/1500919113 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55a8caad6860 0x55a8cab5d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:29.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.814+0000 7fe3dfe00640 1 --2- 172.21.15.42:0/1500919113 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55a8caad6860 0x55a8cab5d350 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78a804f1db1b07f6 server_cookie=1855614a397799a6 in_seq=0 out_seq=0 2024-09-17T01:35:29.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.814+0000 7fe3c6000640 10 client.5457 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:29.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.815+0000 7fe3c6000640 1 -- 172.21.15.42:0/1500919113 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: -2 ) ==== 8+0+45 (crc 0 0 0) 0x55a8caa093d0 con 0x55a8caad6860 2024-09-17T01:35:29.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.815+0000 7fe3c6000640 10 client.5457 handle_command_reply: tid=0 2024-09-17T01:35:29.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.815+0000 7fe3eec2f740 1 client.5457 shutdown 2024-09-17T01:35:29.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.815+0000 7fe3eec2f740 1 -- 172.21.15.42:0/1500919113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6c8670 msgr2=0x55a8caae0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:29.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.815+0000 7fe3eec2f740 1 --2- 172.21.15.42:0/1500919113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6c8670 0x55a8caae0df0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4011ca0 tx=0x7fe3d4005d30 comp rx=0 tx=0).stop 2024-09-17T01:35:29.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.815+0000 7fe3eec2f740 1 -- 172.21.15.42:0/1500919113 shutdown_connections 2024-09-17T01:35:29.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.815+0000 7fe3eec2f740 1 --2- 172.21.15.42:0/1500919113 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55a8caad6860 0x55a8cab5d350 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.815+0000 7fe3eec2f740 1 --2- 172.21.15.42:0/1500919113 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8ca6f1530 0x55a8caad6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.815+0000 7fe3eec2f740 1 --2- 172.21.15.42:0/1500919113 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a8ca6d0850 0x55a8cab5a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.815+0000 7fe3eec2f740 1 --2- 172.21.15.42:0/1500919113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a8ca6c8670 0x55a8caae0df0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:29.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.815+0000 7fe3c6000640 0 client.5457 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:29.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.815+0000 7fe3eec2f740 1 -- 172.21.15.42:0/1500919113 >> 172.21.15.42:0/1500919113 conn(0x55a8ca6e5680 msgr2=0x55a8caa8ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:29.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.815+0000 7fe3eec2f740 1 -- 172.21.15.42:0/1500919113 shutdown_connections 2024-09-17T01:35:29.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.815+0000 7fe3eec2f740 1 -- 172.21.15.42:0/1500919113 wait complete. 2024-09-17T01:35:29.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:29.815+0000 7fe3eec2f740 20 client.5457 trim_cache size 0 max 16384 2024-09-17T01:35:29.822 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:29.822 INFO:teuthology.orchestra.run.smithi042.stdout: "message": "", 2024-09-17T01:35:29.822 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": -2 2024-09-17T01:35:29.822 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:29.822 INFO:teuthology.orchestra.run.smithi042.stderr:Error ENOENT: 2024-09-17T01:35:29.828 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T01:35:29.829 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' returned '{'message': '', 'return_code': -2}' 2024-09-17T01:35:29.829 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-09-17T01:35:29.829 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-09-17T01:35:30.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.060+0000 7fae1ac00640 1 -- 172.21.15.42:0/1973752976 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae140cf7c0 msgr2=0x7fae1406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.060+0000 7fae1ac00640 1 --2- 172.21.15.42:0/1973752976 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae140cf7c0 0x7fae1406cd20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fae14071cb0 tx=0x7fae0002a5f0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.060+0000 7fae1ac00640 1 -- 172.21.15.42:0/1973752976 shutdown_connections 2024-09-17T01:35:30.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.060+0000 7fae1ac00640 1 --2- 172.21.15.42:0/1973752976 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae140cf7c0 0x7fae1406cd20 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.060+0000 7fae1ac00640 1 --2- 172.21.15.42:0/1973752976 >> v2:172.21.15.43:3300/0 conn(0x7fae140b4be0 0x7fae1415d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.060+0000 7fae1ac00640 1 -- 172.21.15.42:0/1973752976 >> 172.21.15.42:0/1973752976 conn(0x7fae140b25f0 msgr2=0x7fae140d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:30.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.061+0000 7fae1ac00640 1 -- 172.21.15.42:0/1973752976 shutdown_connections 2024-09-17T01:35:30.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.061+0000 7fae1ac00640 1 -- 172.21.15.42:0/1973752976 wait complete. 2024-09-17T01:35:30.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.063+0000 7fae1ac00640 1 Processor -- start 2024-09-17T01:35:30.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.063+0000 7fae1ac00640 1 -- start start 2024-09-17T01:35:30.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.064+0000 7fae1ac00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae1406d260 0x7fae141e4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.064+0000 7fae1ac00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae140b4be0 0x7fae1409da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.064+0000 7fae1ac00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fae140cf7c0 0x7fae141f5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.065+0000 7fae1ac00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fae14153970 con 0x7fae1406d260 2024-09-17T01:35:30.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.065+0000 7fae1ac00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fae141537f0 con 0x7fae140b4be0 2024-09-17T01:35:30.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.065+0000 7fae1ac00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fae14153af0 con 0x7fae140cf7c0 2024-09-17T01:35:30.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.065+0000 7fae19800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae1406d260 0x7fae141e4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.065+0000 7fae19800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae1406d260 0x7fae141e4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37262/0 (socket says 172.21.15.42:37262) 2024-09-17T01:35:30.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.065+0000 7fae19800640 1 -- 172.21.15.42:0/2259640592 learned_addr learned my addr 172.21.15.42:0/2259640592 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:30.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.065+0000 7fae1a200640 1 --2- 172.21.15.42:0/2259640592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fae140cf7c0 0x7fae141f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.065+0000 7fae18e00640 1 --2- 172.21.15.42:0/2259640592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae140b4be0 0x7fae1409da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.065+0000 7fae19800640 1 -- 172.21.15.42:0/2259640592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fae140cf7c0 msgr2=0x7fae141f5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.065+0000 7fae19800640 1 --2- 172.21.15.42:0/2259640592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fae140cf7c0 0x7fae141f5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.065+0000 7fae19800640 1 -- 172.21.15.42:0/2259640592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae140b4be0 msgr2=0x7fae1409da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.065+0000 7fae19800640 1 --2- 172.21.15.42:0/2259640592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae140b4be0 0x7fae1409da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.065+0000 7fae19800640 1 -- 172.21.15.42:0/2259640592 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae141f94c0 con 0x7fae1406d260 2024-09-17T01:35:30.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.065+0000 7fae19800640 1 --2- 172.21.15.42:0/2259640592 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae1406d260 0x7fae141e4ec0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fae0800d750 tx=0x7fae0800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:30.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.066+0000 7fae11600640 1 -- 172.21.15.42:0/2259640592 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08017070 con 0x7fae1406d260 2024-09-17T01:35:30.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.066+0000 7fae11600640 1 -- 172.21.15.42:0/2259640592 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae08004310 con 0x7fae1406d260 2024-09-17T01:35:30.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.066+0000 7fae11600640 1 -- 172.21.15.42:0/2259640592 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0800de60 con 0x7fae1406d260 2024-09-17T01:35:30.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.066+0000 7fae1ac00640 1 -- 172.21.15.42:0/2259640592 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae141f97a0 con 0x7fae1406d260 2024-09-17T01:35:30.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.066+0000 7fae1ac00640 1 -- 172.21.15.42:0/2259640592 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae141f5a70 con 0x7fae1406d260 2024-09-17T01:35:30.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.068+0000 7fae11600640 1 -- 172.21.15.42:0/2259640592 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fae08009c30 con 0x7fae1406d260 2024-09-17T01:35:30.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.069+0000 7fae11600640 1 --2- 172.21.15.42:0/2259640592 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fadf4078b90 0x7fadf407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.069+0000 7fae11600640 1 -- 172.21.15.42:0/2259640592 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fae0809b1d0 con 0x7fae1406d260 2024-09-17T01:35:30.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.070+0000 7fae23202740 1 Processor -- start 2024-09-17T01:35:30.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.070+0000 7fae23202740 1 -- start start 2024-09-17T01:35:30.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.070+0000 7fae18e00640 1 --2- 172.21.15.42:0/2259640592 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fadf4078b90 0x7fadf407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.071+0000 7fae18e00640 1 --2- 172.21.15.42:0/2259640592 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fadf4078b90 0x7fadf407b0a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fae00033000 tx=0x7fae00004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:30.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.071+0000 7fae23202740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561b24f1e580 0x561b2530a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.071+0000 7fae23202740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b24ef56c0 0x561b252df120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.071+0000 7fae23202740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24efd8a0 0x561b252df660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.071+0000 7fae23202740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561b25238950 con 0x561b24efd8a0 2024-09-17T01:35:30.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.071+0000 7fae23202740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561b25227d80 con 0x561b24ef56c0 2024-09-17T01:35:30.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.071+0000 7fae23202740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x561b2522bb90 con 0x561b24f1e580 2024-09-17T01:35:30.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.072+0000 7fae1a200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24efd8a0 0x561b252df660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.072+0000 7fae1a200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24efd8a0 0x561b252df660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37274/0 (socket says 172.21.15.42:37274) 2024-09-17T01:35:30.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.072+0000 7fae1a200640 1 -- 172.21.15.42:0/3173774886 learned_addr learned my addr 172.21.15.42:0/3173774886 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:30.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.072+0000 7fae18e00640 1 --2- 172.21.15.42:0/3173774886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b24ef56c0 0x561b252df120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.072+0000 7fae19800640 1 --2- 172.21.15.42:0/3173774886 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561b24f1e580 0x561b2530a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.072+0000 7fae1a200640 1 -- 172.21.15.42:0/3173774886 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561b24f1e580 msgr2=0x561b2530a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:30.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.072+0000 7fae1a200640 1 --2- 172.21.15.42:0/3173774886 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561b24f1e580 0x561b2530a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.072+0000 7fae1a200640 1 -- 172.21.15.42:0/3173774886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b24ef56c0 msgr2=0x561b252df120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:30.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.072+0000 7fae1a200640 1 --2- 172.21.15.42:0/3173774886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b24ef56c0 0x561b252df120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.072+0000 7fae1a200640 1 -- 172.21.15.42:0/3173774886 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b250029f0 con 0x561b24efd8a0 2024-09-17T01:35:30.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.072+0000 7fae1a200640 1 --2- 172.21.15.42:0/3173774886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24efd8a0 0x561b252df660 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fae0c001b90 tx=0x7fae0c002050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b07f6bfc393ac02 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:30.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.073+0000 7fae06000640 1 -- 172.21.15.42:0/3173774886 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c019070 con 0x561b24efd8a0 2024-09-17T01:35:30.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.073+0000 7fae06000640 1 -- 172.21.15.42:0/3173774886 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae0c003b80 con 0x561b24efd8a0 2024-09-17T01:35:30.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.073+0000 7fae06000640 1 -- 172.21.15.42:0/3173774886 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c00e800 con 0x561b24efd8a0 2024-09-17T01:35:30.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.073+0000 7fae23202740 1 -- 172.21.15.42:0/3173774886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24efd8a0 msgr2=0x561b252df660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.073+0000 7fae23202740 1 --2- 172.21.15.42:0/3173774886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24efd8a0 0x561b252df660 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fae0c001b90 tx=0x7fae0c002050 comp rx=0 tx=0).stop 2024-09-17T01:35:30.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.073+0000 7fae23202740 1 -- 172.21.15.42:0/3173774886 shutdown_connections 2024-09-17T01:35:30.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.074+0000 7fae23202740 1 --2- 172.21.15.42:0/3173774886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b24ef56c0 0x561b252df120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.074+0000 7fae23202740 1 --2- 172.21.15.42:0/3173774886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24efd8a0 0x561b252df660 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.074+0000 7fae23202740 1 --2- 172.21.15.42:0/3173774886 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561b24f1e580 0x561b2530a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.074+0000 7fae23202740 1 -- 172.21.15.42:0/3173774886 >> 172.21.15.42:0/3173774886 conn(0x561b24f126d0 msgr2=0x561b252c55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:30.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.074+0000 7fae23202740 1 -- 172.21.15.42:0/3173774886 shutdown_connections 2024-09-17T01:35:30.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.074+0000 7fae23202740 1 -- 172.21.15.42:0/3173774886 wait complete. 2024-09-17T01:35:30.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.075+0000 7fae23202740 1 -- start start 2024-09-17T01:35:30.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.075+0000 7fae23202740 1 Processor -- start 2024-09-17T01:35:30.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.076+0000 7fae23202740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24ef56c0 0x561b25305420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.076+0000 7fae23202740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b24efd8a0 0x561b25301250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.076+0000 7fae23202740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561b24f1e580 0x561b25301790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.076+0000 7fae23202740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561b24f98930 con 0x561b24ef56c0 2024-09-17T01:35:30.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.076+0000 7fae23202740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561b251cd630 con 0x561b24efd8a0 2024-09-17T01:35:30.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.076+0000 7fae23202740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x561b25304b20 con 0x561b24f1e580 2024-09-17T01:35:30.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.076+0000 7fae23202740 10 client.0 _ll_register_callbacks cb 0x561b251d3800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:30.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.077+0000 7fae19800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24ef56c0 0x561b25305420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.077+0000 7fae19800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24ef56c0 0x561b25305420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37280/0 (socket says 172.21.15.42:37280) 2024-09-17T01:35:30.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.077+0000 7fae19800640 1 -- 172.21.15.42:0/1254217632 learned_addr learned my addr 172.21.15.42:0/1254217632 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:30.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.077+0000 7fae18e00640 1 --2- 172.21.15.42:0/1254217632 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b24efd8a0 0x561b25301250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.077+0000 7fae1a200640 1 --2- 172.21.15.42:0/1254217632 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561b24f1e580 0x561b25301790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.077+0000 7fae19800640 1 -- 172.21.15.42:0/1254217632 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561b24f1e580 msgr2=0x561b25301790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:30.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.077+0000 7fae19800640 1 --2- 172.21.15.42:0/1254217632 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561b24f1e580 0x561b25301790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.077+0000 7fae19800640 1 -- 172.21.15.42:0/1254217632 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b24efd8a0 msgr2=0x561b25301250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:30.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.077+0000 7fae19800640 1 --2- 172.21.15.42:0/1254217632 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b24efd8a0 0x561b25301250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.077+0000 7fae19800640 1 -- 172.21.15.42:0/1254217632 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b24f67890 con 0x561b24ef56c0 2024-09-17T01:35:30.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.077+0000 7fae19800640 1 --2- 172.21.15.42:0/1254217632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24ef56c0 0x561b25305420 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fae08099660 tx=0x7fae080625e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe434a5fee8676b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:30.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.077+0000 7fadfaa00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:30.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.077+0000 7fadfaa00640 1 -- 172.21.15.42:0/1254217632 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0804e380 con 0x561b24ef56c0 2024-09-17T01:35:30.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.078+0000 7fadfaa00640 1 -- 172.21.15.42:0/1254217632 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fae0806c400 con 0x561b24ef56c0 2024-09-17T01:35:30.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.078+0000 7fae23202740 1 -- 172.21.15.42:0/1254217632 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae0c003b80 con 0x561b24ef56c0 2024-09-17T01:35:30.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.078+0000 7fadfaa00640 1 -- 172.21.15.42:0/1254217632 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fae08063570 con 0x561b24ef56c0 2024-09-17T01:35:30.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.078+0000 7fae23202740 10 client.5469 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:30.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.078+0000 7fae23202740 1 -- 172.21.15.42:0/1254217632 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x561b25063180 con 0x561b24ef56c0 2024-09-17T01:35:30.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.078+0000 7fadfaa00640 1 -- 172.21.15.42:0/1254217632 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae0c003b80 con 0x561b24ef56c0 2024-09-17T01:35:30.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.078+0000 7fadfaa00640 1 -- 172.21.15.42:0/1254217632 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7fae080620d0 con 0x561b24ef56c0 2024-09-17T01:35:30.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.078+0000 7fae23202740 10 client.5469 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:30.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.078+0000 7fae23202740 10 client.5469 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:30.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.078+0000 7fae23202740 20 client.5469 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:30.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.078+0000 7fae23202740 1 --2- 172.21.15.42:0/1254217632 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561b24edd150 0x561b2531cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.078+0000 7fae23202740 4 client.5469 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:30.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.078+0000 7fae23202740 1 -- 172.21.15.42:0/1254217632 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b2523a8a0 con 0x561b24edd150 2024-09-17T01:35:30.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.079+0000 7fae18e00640 1 --2- 172.21.15.42:0/1254217632 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561b24edd150 0x561b2531cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.079+0000 7fae18e00640 1 --2- 172.21.15.42:0/1254217632 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561b24edd150 0x561b2531cf10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fd2c4ad0d9204f3 server_cookie=3cbdd076b08be901 in_seq=0 out_seq=0 2024-09-17T01:35:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.079+0000 7fadfaa00640 10 client.5469 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.080+0000 7fadfaa00640 1 -- 172.21.15.42:0/1254217632 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561b2523a8a0 con 0x561b24edd150 2024-09-17T01:35:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.080+0000 7fadfaa00640 10 client.5469 handle_command_reply: tid=0 2024-09-17T01:35:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.080+0000 7fae23202740 1 client.5469 shutdown 2024-09-17T01:35:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.080+0000 7fae23202740 1 -- 172.21.15.42:0/1254217632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24ef56c0 msgr2=0x561b25305420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.080+0000 7fae23202740 1 --2- 172.21.15.42:0/1254217632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24ef56c0 0x561b25305420 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fae08099660 tx=0x7fae080625e0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.080+0000 7fae23202740 1 -- 172.21.15.42:0/1254217632 shutdown_connections 2024-09-17T01:35:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.080+0000 7fae23202740 1 --2- 172.21.15.42:0/1254217632 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561b24edd150 0x561b2531cf10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.080+0000 7fae23202740 1 --2- 172.21.15.42:0/1254217632 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b24efd8a0 0x561b25301250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.080+0000 7fae23202740 1 --2- 172.21.15.42:0/1254217632 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561b24f1e580 0x561b25301790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.080+0000 7fae23202740 1 --2- 172.21.15.42:0/1254217632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24ef56c0 0x561b25305420 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.080+0000 7fae23202740 1 -- 172.21.15.42:0/1254217632 >> 172.21.15.42:0/1254217632 conn(0x561b24f126d0 msgr2=0x561b252c02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:30.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.080+0000 7fadfaa00640 0 client.5469 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:30.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.080+0000 7fae23202740 1 -- 172.21.15.42:0/1254217632 shutdown_connections 2024-09-17T01:35:30.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.081+0000 7fae23202740 1 -- 172.21.15.42:0/1254217632 wait complete. 2024-09-17T01:35:30.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.081+0000 7fae23202740 20 client.5469 trim_cache size 0 max 16384 2024-09-17T01:35:30.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.100+0000 7fae23202740 1 Processor -- start 2024-09-17T01:35:30.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.100+0000 7fae23202740 1 -- start start 2024-09-17T01:35:30.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.101+0000 7fae23202740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b24ef56c0 0x561b25301450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.101+0000 7fae23202740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24efd8a0 0x561b25304cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.101+0000 7fae23202740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561b24f1e580 0x561b253051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.101+0000 7fae23202740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fae14202160 con 0x561b24efd8a0 2024-09-17T01:35:30.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.101+0000 7fae23202740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fae142012e0 con 0x561b24ef56c0 2024-09-17T01:35:30.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.101+0000 7fae23202740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fae140722e0 con 0x561b24f1e580 2024-09-17T01:35:30.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.101+0000 7fae18e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24efd8a0 0x561b25304cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.101+0000 7fae18e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24efd8a0 0x561b25304cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37294/0 (socket says 172.21.15.42:37294) 2024-09-17T01:35:30.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.101+0000 7fae18e00640 1 -- 172.21.15.42:0/755006099 learned_addr learned my addr 172.21.15.42:0/755006099 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:30.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.102+0000 7fae1a200640 1 --2- 172.21.15.42:0/755006099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561b24f1e580 0x561b253051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.102+0000 7fae19800640 1 --2- 172.21.15.42:0/755006099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b24ef56c0 0x561b25301450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.102+0000 7fae18e00640 1 -- 172.21.15.42:0/755006099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561b24f1e580 msgr2=0x561b253051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:30.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.102+0000 7fae18e00640 1 --2- 172.21.15.42:0/755006099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561b24f1e580 0x561b253051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.102+0000 7fae18e00640 1 -- 172.21.15.42:0/755006099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b24ef56c0 msgr2=0x561b25301450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:30.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.102+0000 7fae18e00640 1 --2- 172.21.15.42:0/755006099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b24ef56c0 0x561b25301450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.102+0000 7fae18e00640 1 -- 172.21.15.42:0/755006099 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b25000cf0 con 0x561b24efd8a0 2024-09-17T01:35:30.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.102+0000 7fae1a200640 1 --2- 172.21.15.42:0/755006099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561b24f1e580 0x561b253051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:30.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.102+0000 7fae18e00640 1 --2- 172.21.15.42:0/755006099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24efd8a0 0x561b25304cb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fae00009850 tx=0x7fae0003c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331a33bd2e0e6a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:30.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.102+0000 7fae05600640 1 -- 172.21.15.42:0/755006099 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae00035040 con 0x561b24efd8a0 2024-09-17T01:35:30.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.102+0000 7fae05600640 1 -- 172.21.15.42:0/755006099 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae000047a0 con 0x561b24efd8a0 2024-09-17T01:35:30.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.102+0000 7fae05600640 1 -- 172.21.15.42:0/755006099 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae00004b50 con 0x561b24efd8a0 2024-09-17T01:35:30.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.103+0000 7fae23202740 1 -- 172.21.15.42:0/755006099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24efd8a0 msgr2=0x561b25304cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.103+0000 7fae23202740 1 --2- 172.21.15.42:0/755006099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24efd8a0 0x561b25304cb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fae00009850 tx=0x7fae0003c000 comp rx=0 tx=0).stop 2024-09-17T01:35:30.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.103+0000 7fae23202740 1 -- 172.21.15.42:0/755006099 shutdown_connections 2024-09-17T01:35:30.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.103+0000 7fae23202740 1 --2- 172.21.15.42:0/755006099 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561b24f1e580 0x561b253051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.103+0000 7fae23202740 1 --2- 172.21.15.42:0/755006099 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24efd8a0 0x561b25304cb0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.103+0000 7fae23202740 1 --2- 172.21.15.42:0/755006099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b24ef56c0 0x561b25301450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.103+0000 7fae23202740 1 -- 172.21.15.42:0/755006099 >> 172.21.15.42:0/755006099 conn(0x561b24f126d0 msgr2=0x561b252c6610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:30.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.103+0000 7fae23202740 1 -- 172.21.15.42:0/755006099 shutdown_connections 2024-09-17T01:35:30.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.103+0000 7fae23202740 1 -- 172.21.15.42:0/755006099 wait complete. 2024-09-17T01:35:30.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.104+0000 7fae23202740 1 -- start start 2024-09-17T01:35:30.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.104+0000 7fae23202740 1 Processor -- start 2024-09-17T01:35:30.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.106+0000 7fae23202740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561b24ef56c0 0x561b25389bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.106+0000 7fae23202740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24efd8a0 0x561b2538d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.106+0000 7fae23202740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b24f1e580 0x561b25304ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.106+0000 7fae23202740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561b252df940 con 0x561b24efd8a0 2024-09-17T01:35:30.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.106+0000 7fae23202740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fae14072930 con 0x561b24f1e580 2024-09-17T01:35:30.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.106+0000 7fae23202740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x561b252c07f0 con 0x561b24ef56c0 2024-09-17T01:35:30.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.106+0000 7fae23202740 10 client.0 _ll_register_callbacks cb 0x7fae080627c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:30.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.106+0000 7fae18e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24efd8a0 0x561b2538d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.106+0000 7fae18e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24efd8a0 0x561b2538d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37310/0 (socket says 172.21.15.42:37310) 2024-09-17T01:35:30.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.106+0000 7fae18e00640 1 -- 172.21.15.42:0/289539683 learned_addr learned my addr 172.21.15.42:0/289539683 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:30.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.107+0000 7fae19800640 1 --2- 172.21.15.42:0/289539683 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561b24ef56c0 0x561b25389bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.107+0000 7fae1a200640 1 --2- 172.21.15.42:0/289539683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b24f1e580 0x561b25304ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.107+0000 7fae18e00640 1 -- 172.21.15.42:0/289539683 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561b24ef56c0 msgr2=0x561b25389bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:30.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.107+0000 7fae18e00640 1 --2- 172.21.15.42:0/289539683 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561b24ef56c0 0x561b25389bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.107+0000 7fae18e00640 1 -- 172.21.15.42:0/289539683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b24f1e580 msgr2=0x561b25304ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:30.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.107+0000 7fae18e00640 1 --2- 172.21.15.42:0/289539683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b24f1e580 0x561b25304ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.107+0000 7fae18e00640 1 -- 172.21.15.42:0/289539683 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b2532da40 con 0x561b24efd8a0 2024-09-17T01:35:30.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.107+0000 7fae18e00640 1 --2- 172.21.15.42:0/289539683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24efd8a0 0x561b2538d910 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fae00053040 tx=0x7fae00004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d4223f3ad9c692 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:30.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.107+0000 7fadfaa00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:30.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.107+0000 7fadfaa00640 1 -- 172.21.15.42:0/289539683 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae00060060 con 0x561b24efd8a0 2024-09-17T01:35:30.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.107+0000 7fadfaa00640 1 -- 172.21.15.42:0/289539683 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fae00003b80 con 0x561b24efd8a0 2024-09-17T01:35:30.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.107+0000 7fae23202740 1 -- 172.21.15.42:0/289539683 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae000047a0 con 0x561b24efd8a0 2024-09-17T01:35:30.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.108+0000 7fadfaa00640 1 -- 172.21.15.42:0/289539683 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fae00035050 con 0x561b24efd8a0 2024-09-17T01:35:30.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.108+0000 7fae23202740 10 client.5475 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:30.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.108+0000 7fae23202740 1 -- 172.21.15.42:0/289539683 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x561b2538a370 con 0x561b24efd8a0 2024-09-17T01:35:30.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.108+0000 7fadfaa00640 1 -- 172.21.15.42:0/289539683 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae000047a0 con 0x561b24efd8a0 2024-09-17T01:35:30.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.108+0000 7fadfaa00640 1 -- 172.21.15.42:0/289539683 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7fae0003a040 con 0x561b24efd8a0 2024-09-17T01:35:30.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.108+0000 7fae23202740 10 client.5475 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:30.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.108+0000 7fae23202740 10 client.5475 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:30.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.108+0000 7fae23202740 20 client.5475 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:30.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.108+0000 7fae23202740 1 --2- 172.21.15.42:0/289539683 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561b25301850 0x561b25380190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.108+0000 7fae23202740 4 client.5475 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-17T01:35:30.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.108+0000 7fae23202740 1 -- 172.21.15.42:0/289539683 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) -- 0x561b25305d90 con 0x561b25301850 2024-09-17T01:35:30.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.108+0000 7fae19800640 1 --2- 172.21.15.42:0/289539683 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561b25301850 0x561b25380190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.109+0000 7fae19800640 1 --2- 172.21.15.42:0/289539683 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561b25301850 0x561b25380190 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bb415636900d9cd server_cookie=6fbe136b90e35a70 in_seq=0 out_seq=0 2024-09-17T01:35:30.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.109+0000 7fadfaa00640 10 client.5475 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:30.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.109+0000 7fadfaa00640 1 -- 172.21.15.42:0/289539683 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+26 (crc 0 0 0) 0x561b25305d90 con 0x561b25301850 2024-09-17T01:35:30.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.109+0000 7fadfaa00640 10 client.5475 handle_command_reply: tid=0 2024-09-17T01:35:30.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.109+0000 7fae23202740 1 client.5475 shutdown 2024-09-17T01:35:30.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.110+0000 7fae23202740 1 -- 172.21.15.42:0/289539683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24efd8a0 msgr2=0x561b2538d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.110+0000 7fae23202740 1 --2- 172.21.15.42:0/289539683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24efd8a0 0x561b2538d910 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fae00053040 tx=0x7fae00004040 comp rx=0 tx=0).stop 2024-09-17T01:35:30.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.110+0000 7fae23202740 1 -- 172.21.15.42:0/289539683 shutdown_connections 2024-09-17T01:35:30.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.110+0000 7fae23202740 1 --2- 172.21.15.42:0/289539683 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561b25301850 0x561b25380190 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.110+0000 7fae23202740 1 --2- 172.21.15.42:0/289539683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561b24f1e580 0x561b25304ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.110+0000 7fae23202740 1 --2- 172.21.15.42:0/289539683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561b24efd8a0 0x561b2538d910 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.110+0000 7fae23202740 1 --2- 172.21.15.42:0/289539683 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561b24ef56c0 0x561b25389bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.110+0000 7fadfaa00640 0 client.5475 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:30.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.110+0000 7fae23202740 1 -- 172.21.15.42:0/289539683 >> 172.21.15.42:0/289539683 conn(0x561b24f126d0 msgr2=0x561b2530a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:30.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.110+0000 7fae23202740 1 -- 172.21.15.42:0/289539683 shutdown_connections 2024-09-17T01:35:30.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.110+0000 7fae23202740 1 -- 172.21.15.42:0/289539683 wait complete. 2024-09-17T01:35:30.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.110+0000 7fae23202740 20 client.5475 trim_cache size 0 max 16384 2024-09-17T01:35:30.114 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:30.114 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": -2 2024-09-17T01:35:30.114 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:30.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.110+0000 7fae1ac00640 1 -- 172.21.15.42:0/2259640592 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fadf4078b90 msgr2=0x7fadf407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.110+0000 7fae1ac00640 1 --2- 172.21.15.42:0/2259640592 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fadf4078b90 0x7fadf407b0a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fae00033000 tx=0x7fae00004730 comp rx=0 tx=0).stop 2024-09-17T01:35:30.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.110+0000 7fae1ac00640 1 -- 172.21.15.42:0/2259640592 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae1406d260 msgr2=0x7fae141e4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.110+0000 7fae1ac00640 1 --2- 172.21.15.42:0/2259640592 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae1406d260 0x7fae141e4ec0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fae0800d750 tx=0x7fae0800dc10 comp rx=0 tx=0).stop 2024-09-17T01:35:30.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.111+0000 7fae1ac00640 1 -- 172.21.15.42:0/2259640592 shutdown_connections 2024-09-17T01:35:30.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.111+0000 7fae1ac00640 1 --2- 172.21.15.42:0/2259640592 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fadf4078b90 0x7fadf407b0a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.111+0000 7fae1ac00640 1 --2- 172.21.15.42:0/2259640592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae140b4be0 0x7fae1409da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.111+0000 7fae1ac00640 1 --2- 172.21.15.42:0/2259640592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fae140cf7c0 0x7fae141f5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.111+0000 7fae1ac00640 1 --2- 172.21.15.42:0/2259640592 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fae1406d260 0x7fae141e4ec0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.111+0000 7fae1ac00640 1 -- 172.21.15.42:0/2259640592 >> 172.21.15.42:0/2259640592 conn(0x7fae140b25f0 msgr2=0x7fae140ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:30.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.111+0000 7fae1ac00640 1 -- 172.21.15.42:0/2259640592 shutdown_connections 2024-09-17T01:35:30.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.111+0000 7fae1ac00640 1 -- 172.21.15.42:0/2259640592 wait complete. 2024-09-17T01:35:30.131 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-09-17T01:35:30.131 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites 2024-09-17T01:35:30.132 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites' 2024-09-17T01:35:30.132 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/suites 2024-09-17T01:35:30.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.364+0000 7f5a82e00640 1 -- 172.21.15.42:0/2215559609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a7c15cfc0 msgr2=0x7f5a7c0ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.364+0000 7f5a82e00640 1 --2- 172.21.15.42:0/2215559609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a7c15cfc0 0x7f5a7c0ceb40 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c0b3100 tx=0x7f5a6402a560 comp rx=0 tx=0).stop 2024-09-17T01:35:30.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.364+0000 7f5a82e00640 1 -- 172.21.15.42:0/2215559609 shutdown_connections 2024-09-17T01:35:30.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.364+0000 7f5a82e00640 1 --2- 172.21.15.42:0/2215559609 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a7c06d430 0x7f5a7c06d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.364+0000 7f5a82e00640 1 --2- 172.21.15.42:0/2215559609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a7c15cfc0 0x7f5a7c0ceb40 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.364+0000 7f5a82e00640 1 --2- 172.21.15.42:0/2215559609 >> v2:172.21.15.43:3300/0 conn(0x7f5a7c0b3880 0x7f5a7c0af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.364+0000 7f5a82e00640 1 -- 172.21.15.42:0/2215559609 >> 172.21.15.42:0/2215559609 conn(0x7f5a7c0b2930 msgr2=0x7f5a7c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:30.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.364+0000 7f5a82e00640 1 -- 172.21.15.42:0/2215559609 shutdown_connections 2024-09-17T01:35:30.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.364+0000 7f5a82e00640 1 -- 172.21.15.42:0/2215559609 wait complete. 2024-09-17T01:35:30.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.366+0000 7f5a82e00640 1 Processor -- start 2024-09-17T01:35:30.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.367+0000 7f5a82e00640 1 -- start start 2024-09-17T01:35:30.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.368+0000 7f5a82e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a7c06d430 0x7f5a7c14d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.368+0000 7f5a82e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a7c0b3880 0x7f5a7c143b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.368+0000 7f5a82e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a7c15cfc0 0x7f5a7c0b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.368+0000 7f5a82e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c15d550 con 0x7f5a7c06d430 2024-09-17T01:35:30.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.368+0000 7f5a82e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c15d3d0 con 0x7f5a7c0b3880 2024-09-17T01:35:30.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.368+0000 7f5a82e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5a7c1605b0 con 0x7f5a7c15cfc0 2024-09-17T01:35:30.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.368+0000 7f5a7be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a7c06d430 0x7f5a7c14d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.368+0000 7f5a7be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a7c06d430 0x7f5a7c14d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37326/0 (socket says 172.21.15.42:37326) 2024-09-17T01:35:30.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.368+0000 7f5a7be00640 1 -- 172.21.15.42:0/3758471100 learned_addr learned my addr 172.21.15.42:0/3758471100 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:30.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.369+0000 7f5a73400640 1 --2- 172.21.15.42:0/3758471100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a7c0b3880 0x7f5a7c143b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.369+0000 7f5a80e00640 1 --2- 172.21.15.42:0/3758471100 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a7c15cfc0 0x7f5a7c0b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.369+0000 7f5a7be00640 1 -- 172.21.15.42:0/3758471100 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a7c15cfc0 msgr2=0x7f5a7c0b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.369+0000 7f5a7be00640 1 --2- 172.21.15.42:0/3758471100 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a7c15cfc0 0x7f5a7c0b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.369+0000 7f5a7be00640 1 -- 172.21.15.42:0/3758471100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a7c0b3880 msgr2=0x7f5a7c143b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.369+0000 7f5a7be00640 1 --2- 172.21.15.42:0/3758471100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a7c0b3880 0x7f5a7c143b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.369+0000 7f5a7be00640 1 -- 172.21.15.42:0/3758471100 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7c1440b0 con 0x7f5a7c06d430 2024-09-17T01:35:30.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.369+0000 7f5a7be00640 1 --2- 172.21.15.42:0/3758471100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a7c06d430 0x7f5a7c14d080 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00d980 tx=0x7f5a6c00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:30.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.369+0000 7f5a78c00640 1 -- 172.21.15.42:0/3758471100 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c018070 con 0x7f5a7c06d430 2024-09-17T01:35:30.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.369+0000 7f5a78c00640 1 -- 172.21.15.42:0/3758471100 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a6c009c50 con 0x7f5a7c06d430 2024-09-17T01:35:30.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.369+0000 7f5a82e00640 1 -- 172.21.15.42:0/3758471100 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7c155740 con 0x7f5a7c06d430 2024-09-17T01:35:30.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.369+0000 7f5a78c00640 1 -- 172.21.15.42:0/3758471100 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c004290 con 0x7f5a7c06d430 2024-09-17T01:35:30.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.370+0000 7f5a82e00640 1 -- 172.21.15.42:0/3758471100 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a7c155d00 con 0x7f5a7c06d430 2024-09-17T01:35:30.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.372+0000 7f5a78c00640 1 -- 172.21.15.42:0/3758471100 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5a6c012760 con 0x7f5a7c06d430 2024-09-17T01:35:30.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.373+0000 7f5a78c00640 1 --2- 172.21.15.42:0/3758471100 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5a58078bc0 0x7f5a5807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.373+0000 7f5a78c00640 1 -- 172.21.15.42:0/3758471100 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f5a6c09ee20 con 0x7f5a7c06d430 2024-09-17T01:35:30.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.373+0000 7f5a73400640 1 --2- 172.21.15.42:0/3758471100 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5a58078bc0 0x7f5a5807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.373+0000 7f5a8a00e740 1 Processor -- start 2024-09-17T01:35:30.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.374+0000 7f5a8a00e740 1 -- start start 2024-09-17T01:35:30.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.374+0000 7f5a73400640 1 --2- 172.21.15.42:0/3758471100 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5a58078bc0 0x7f5a5807b0d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5a64033000 tx=0x7f5a64004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:30.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.375+0000 7f5a8a00e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560026c66650 0x560027052d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.375+0000 7f5a8a00e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c3d790 0x560027027b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.375+0000 7f5a8a00e740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560026c45970 0x5600270280d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.375+0000 7f5a8a00e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560026f808c0 con 0x560026c3d790 2024-09-17T01:35:30.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.375+0000 7f5a8a00e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560026f6fcf0 con 0x560026c66650 2024-09-17T01:35:30.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.375+0000 7f5a8a00e740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x560026f73b00 con 0x560026c45970 2024-09-17T01:35:30.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.375+0000 7f5a73400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c3d790 0x560027027b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.375+0000 7f5a73400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c3d790 0x560027027b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37340/0 (socket says 172.21.15.42:37340) 2024-09-17T01:35:30.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.375+0000 7f5a73400640 1 -- 172.21.15.42:0/904966973 learned_addr learned my addr 172.21.15.42:0/904966973 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:30.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.376+0000 7f5a7be00640 1 --2- 172.21.15.42:0/904966973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560026c66650 0x560027052d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.376+0000 7f5a73400640 1 -- 172.21.15.42:0/904966973 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560026c45970 msgr2=0x5600270280d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:30.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.376+0000 7f5a73400640 1 --2- 172.21.15.42:0/904966973 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560026c45970 0x5600270280d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.376+0000 7f5a73400640 1 -- 172.21.15.42:0/904966973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560026c66650 msgr2=0x560027052d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:30.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.376+0000 7f5a73400640 1 --2- 172.21.15.42:0/904966973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560026c66650 0x560027052d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.376+0000 7f5a73400640 1 -- 172.21.15.42:0/904966973 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560026cd1c30 con 0x560026c3d790 2024-09-17T01:35:30.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.376+0000 7f5a7be00640 1 --2- 172.21.15.42:0/904966973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560026c66650 0x560027052d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:30.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.376+0000 7f5a73400640 1 --2- 172.21.15.42:0/904966973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c3d790 0x560027027b90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5a64005fd0 tx=0x7f5a6403c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948aa7f164078438 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:30.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.376+0000 7f5a70c00640 1 -- 172.21.15.42:0/904966973 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a64035040 con 0x560026c3d790 2024-09-17T01:35:30.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.376+0000 7f5a70c00640 1 -- 172.21.15.42:0/904966973 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a6404d070 con 0x560026c3d790 2024-09-17T01:35:30.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.376+0000 7f5a70c00640 1 -- 172.21.15.42:0/904966973 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a64003ae0 con 0x560026c3d790 2024-09-17T01:35:30.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.377+0000 7f5a8a00e740 1 -- 172.21.15.42:0/904966973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c3d790 msgr2=0x560027027b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.377+0000 7f5a8a00e740 1 --2- 172.21.15.42:0/904966973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c3d790 0x560027027b90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5a64005fd0 tx=0x7f5a6403c000 comp rx=0 tx=0).stop 2024-09-17T01:35:30.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.377+0000 7f5a8a00e740 1 -- 172.21.15.42:0/904966973 shutdown_connections 2024-09-17T01:35:30.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.377+0000 7f5a8a00e740 1 --2- 172.21.15.42:0/904966973 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560026c45970 0x5600270280d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.377+0000 7f5a8a00e740 1 --2- 172.21.15.42:0/904966973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c3d790 0x560027027b90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.377+0000 7f5a8a00e740 1 --2- 172.21.15.42:0/904966973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560026c66650 0x560027052d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.377+0000 7f5a8a00e740 1 -- 172.21.15.42:0/904966973 >> 172.21.15.42:0/904966973 conn(0x560026c5a7a0 msgr2=0x56002700e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:30.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.377+0000 7f5a8a00e740 1 -- 172.21.15.42:0/904966973 shutdown_connections 2024-09-17T01:35:30.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.377+0000 7f5a8a00e740 1 -- 172.21.15.42:0/904966973 wait complete. 2024-09-17T01:35:30.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.378+0000 7f5a8a00e740 1 -- start start 2024-09-17T01:35:30.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.379+0000 7f5a8a00e740 1 Processor -- start 2024-09-17T01:35:30.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.380+0000 7f5a8a00e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c3d790 0x560027026d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.380+0000 7f5a8a00e740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560026c45970 0x56002704bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.380+0000 7f5a8a00e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560026c66650 0x56002704c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.380+0000 7f5a8a00e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560026ce0a00 con 0x560026c3d790 2024-09-17T01:35:30.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.380+0000 7f5a8a00e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560026f164a0 con 0x560026c66650 2024-09-17T01:35:30.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.380+0000 7f5a8a00e740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56002704c630 con 0x560026c45970 2024-09-17T01:35:30.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.380+0000 7f5a8a00e740 10 client.0 _ll_register_callbacks cb 0x560026f1b6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:30.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.380+0000 7f5a7be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c3d790 0x560027026d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.380+0000 7f5a7be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c3d790 0x560027026d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37344/0 (socket says 172.21.15.42:37344) 2024-09-17T01:35:30.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.380+0000 7f5a7be00640 1 -- 172.21.15.42:0/2056988071 learned_addr learned my addr 172.21.15.42:0/2056988071 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:30.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.380+0000 7f5a73400640 1 --2- 172.21.15.42:0/2056988071 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560026c45970 0x56002704bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.380+0000 7f5a80e00640 1 --2- 172.21.15.42:0/2056988071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560026c66650 0x56002704c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.381+0000 7f5a7be00640 1 -- 172.21.15.42:0/2056988071 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560026c45970 msgr2=0x56002704bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:30.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.381+0000 7f5a7be00640 1 --2- 172.21.15.42:0/2056988071 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560026c45970 0x56002704bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.381+0000 7f5a7be00640 1 -- 172.21.15.42:0/2056988071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560026c66650 msgr2=0x56002704c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:30.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.381+0000 7f5a7be00640 1 --2- 172.21.15.42:0/2056988071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560026c66650 0x56002704c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.381+0000 7f5a7be00640 1 -- 172.21.15.42:0/2056988071 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560026d48a90 con 0x560026c3d790 2024-09-17T01:35:30.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.381+0000 7f5a7be00640 1 --2- 172.21.15.42:0/2056988071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c3d790 0x560027026d10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00dfd0 tx=0x7f5a6c009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfeef2c0e14e5491 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:30.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.381+0000 7f5a69600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:30.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.381+0000 7f5a69600640 1 -- 172.21.15.42:0/2056988071 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c066be0 con 0x560026c3d790 2024-09-17T01:35:30.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.381+0000 7f5a69600640 1 -- 172.21.15.42:0/2056988071 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f5a6c0700e0 con 0x560026c3d790 2024-09-17T01:35:30.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.381+0000 7f5a8a00e740 1 -- 172.21.15.42:0/2056988071 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a6404d070 con 0x560026c3d790 2024-09-17T01:35:30.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.381+0000 7f5a69600640 1 -- 172.21.15.42:0/2056988071 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5a6c06b6c0 con 0x560026c3d790 2024-09-17T01:35:30.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.381+0000 7f5a8a00e740 10 client.5487 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:30.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.381+0000 7f5a8a00e740 1 -- 172.21.15.42:0/2056988071 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x560027027250 con 0x560026c3d790 2024-09-17T01:35:30.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.382+0000 7f5a69600640 1 -- 172.21.15.42:0/2056988071 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a6404d070 con 0x560026c3d790 2024-09-17T01:35:30.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.382+0000 7f5a69600640 1 -- 172.21.15.42:0/2056988071 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f5a6c06b1e0 con 0x560026c3d790 2024-09-17T01:35:30.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.382+0000 7f5a8a00e740 10 client.5487 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:30.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.382+0000 7f5a8a00e740 10 client.5487 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:30.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.382+0000 7f5a8a00e740 20 client.5487 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:30.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.382+0000 7f5a8a00e740 1 --2- 172.21.15.42:0/2056988071 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x560026c25220 0x56002704ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.382+0000 7f5a8a00e740 4 client.5487 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:30.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.382+0000 7f5a8a00e740 1 -- 172.21.15.42:0/2056988071 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560026f82810 con 0x560026c25220 2024-09-17T01:35:30.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.382+0000 7f5a73400640 1 --2- 172.21.15.42:0/2056988071 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x560026c25220 0x56002704ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.383+0000 7f5a73400640 1 --2- 172.21.15.42:0/2056988071 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x560026c25220 0x56002704ea70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b9e22862762956d server_cookie=e53d476e9f47eeb8 in_seq=0 out_seq=0 2024-09-17T01:35:30.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.383+0000 7f5a69600640 10 client.5487 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:30.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.384+0000 7f5a69600640 1 -- 172.21.15.42:0/2056988071 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560026f82810 con 0x560026c25220 2024-09-17T01:35:30.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.384+0000 7f5a69600640 10 client.5487 handle_command_reply: tid=0 2024-09-17T01:35:30.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.384+0000 7f5a8a00e740 1 client.5487 shutdown 2024-09-17T01:35:30.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.384+0000 7f5a8a00e740 1 -- 172.21.15.42:0/2056988071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c3d790 msgr2=0x560027026d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.384+0000 7f5a8a00e740 1 --2- 172.21.15.42:0/2056988071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c3d790 0x560027026d10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00dfd0 tx=0x7f5a6c009e40 comp rx=0 tx=0).stop 2024-09-17T01:35:30.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.384+0000 7f5a8a00e740 1 -- 172.21.15.42:0/2056988071 shutdown_connections 2024-09-17T01:35:30.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.384+0000 7f5a8a00e740 1 --2- 172.21.15.42:0/2056988071 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x560026c25220 0x56002704ea70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.384+0000 7f5a8a00e740 1 --2- 172.21.15.42:0/2056988071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560026c66650 0x56002704c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.384+0000 7f5a8a00e740 1 --2- 172.21.15.42:0/2056988071 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560026c45970 0x56002704bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.384+0000 7f5a8a00e740 1 --2- 172.21.15.42:0/2056988071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c3d790 0x560027026d10 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.384+0000 7f5a8a00e740 1 -- 172.21.15.42:0/2056988071 >> 172.21.15.42:0/2056988071 conn(0x560026c5a7a0 msgr2=0x560027008d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:30.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.384+0000 7f5a69600640 0 client.5487 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:30.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.384+0000 7f5a8a00e740 1 -- 172.21.15.42:0/2056988071 shutdown_connections 2024-09-17T01:35:30.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.384+0000 7f5a8a00e740 1 -- 172.21.15.42:0/2056988071 wait complete. 2024-09-17T01:35:30.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.384+0000 7f5a8a00e740 20 client.5487 trim_cache size 0 max 16384 2024-09-17T01:35:30.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.400+0000 7f5a8a00e740 1 Processor -- start 2024-09-17T01:35:30.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.400+0000 7f5a8a00e740 1 -- start start 2024-09-17T01:35:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.402+0000 7f5a8a00e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560026c3d790 0x560027008a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.402+0000 7f5a8a00e740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560026c45970 0x560027075810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.402+0000 7f5a8a00e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c66650 0x560027075d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.402+0000 7f5a8a00e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c154e00 con 0x560026c66650 2024-09-17T01:35:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.402+0000 7f5a8a00e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c0701c0 con 0x560026c3d790 2024-09-17T01:35:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.402+0000 7f5a8a00e740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5a7c06f520 con 0x560026c45970 2024-09-17T01:35:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.402+0000 7f5a80e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c66650 0x560027075d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.402+0000 7f5a80e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c66650 0x560027075d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37350/0 (socket says 172.21.15.42:37350) 2024-09-17T01:35:30.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.402+0000 7f5a80e00640 1 -- 172.21.15.42:0/1777335511 learned_addr learned my addr 172.21.15.42:0/1777335511 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:30.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.402+0000 7f5a7be00640 1 --2- 172.21.15.42:0/1777335511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560026c3d790 0x560027008a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.402+0000 7f5a73400640 1 --2- 172.21.15.42:0/1777335511 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560026c45970 0x560027075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.403+0000 7f5a80e00640 1 -- 172.21.15.42:0/1777335511 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560026c45970 msgr2=0x560027075810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:30.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.403+0000 7f5a80e00640 1 --2- 172.21.15.42:0/1777335511 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560026c45970 0x560027075810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.403+0000 7f5a80e00640 1 -- 172.21.15.42:0/1777335511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560026c3d790 msgr2=0x560027008a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:30.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.403+0000 7f5a80e00640 1 --2- 172.21.15.42:0/1777335511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560026c3d790 0x560027008a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.403+0000 7f5a80e00640 1 -- 172.21.15.42:0/1777335511 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56002700ab90 con 0x560026c66650 2024-09-17T01:35:30.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.403+0000 7f5a80e00640 1 --2- 172.21.15.42:0/1777335511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c66650 0x560027075d50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009c20 tx=0x7f5a740127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ccebe5b7f2e34ed server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:30.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.403+0000 7f5a6be00640 1 -- 172.21.15.42:0/1777335511 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7401b440 con 0x560026c66650 2024-09-17T01:35:30.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.403+0000 7f5a6be00640 1 -- 172.21.15.42:0/1777335511 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a7401b5e0 con 0x560026c66650 2024-09-17T01:35:30.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.403+0000 7f5a6be00640 1 -- 172.21.15.42:0/1777335511 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7401ba30 con 0x560026c66650 2024-09-17T01:35:30.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.404+0000 7f5a8a00e740 1 -- 172.21.15.42:0/1777335511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c66650 msgr2=0x560027075d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.404+0000 7f5a8a00e740 1 --2- 172.21.15.42:0/1777335511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c66650 0x560027075d50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009c20 tx=0x7f5a740127c0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.404+0000 7f5a8a00e740 1 -- 172.21.15.42:0/1777335511 shutdown_connections 2024-09-17T01:35:30.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.404+0000 7f5a8a00e740 1 --2- 172.21.15.42:0/1777335511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c66650 0x560027075d50 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.404+0000 7f5a8a00e740 1 --2- 172.21.15.42:0/1777335511 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560026c45970 0x560027075810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.404+0000 7f5a8a00e740 1 --2- 172.21.15.42:0/1777335511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560026c3d790 0x560027008a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.404+0000 7f5a8a00e740 1 -- 172.21.15.42:0/1777335511 >> 172.21.15.42:0/1777335511 conn(0x560026c5a7a0 msgr2=0x56002704f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:30.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.404+0000 7f5a8a00e740 1 -- 172.21.15.42:0/1777335511 shutdown_connections 2024-09-17T01:35:30.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.404+0000 7f5a8a00e740 1 -- 172.21.15.42:0/1777335511 wait complete. 2024-09-17T01:35:30.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.405+0000 7f5a8a00e740 1 -- start start 2024-09-17T01:35:30.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.405+0000 7f5a8a00e740 1 Processor -- start 2024-09-17T01:35:30.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.407+0000 7f5a8a00e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560026c3d790 0x5600270d1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.407+0000 7f5a8a00e740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560026c45970 0x56002704d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.407+0000 7f5a8a00e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c66650 0x56002704d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.407+0000 7f5a8a00e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c06fb70 con 0x560026c66650 2024-09-17T01:35:30.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.407+0000 7f5a8a00e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56002704e4b0 con 0x560026c3d790 2024-09-17T01:35:30.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.407+0000 7f5a8a00e740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x560027064a30 con 0x560026c45970 2024-09-17T01:35:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.407+0000 7f5a8a00e740 10 client.0 _ll_register_callbacks cb 0x7f5a6c00b630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.407+0000 7f5a80e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c66650 0x56002704d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.407+0000 7f5a80e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c66650 0x56002704d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37352/0 (socket says 172.21.15.42:37352) 2024-09-17T01:35:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.407+0000 7f5a80e00640 1 -- 172.21.15.42:0/1941748465 learned_addr learned my addr 172.21.15.42:0/1941748465 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.407+0000 7f5a73400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560026c45970 0x56002704d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.407+0000 7f5a7be00640 1 --2- 172.21.15.42:0/1941748465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560026c3d790 0x5600270d1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.408+0000 7f5a80e00640 1 -- 172.21.15.42:0/1941748465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560026c45970 msgr2=0x56002704d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.408+0000 7f5a80e00640 1 --2- 172.21.15.42:0/1941748465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560026c45970 0x56002704d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.408+0000 7f5a80e00640 1 -- 172.21.15.42:0/1941748465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560026c3d790 msgr2=0x5600270d1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.408+0000 7f5a80e00640 1 --2- 172.21.15.42:0/1941748465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560026c3d790 0x5600270d1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.408+0000 7f5a80e00640 1 -- 172.21.15.42:0/1941748465 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560027074640 con 0x560026c66650 2024-09-17T01:35:30.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.408+0000 7f5a73400640 1 --2- 172.21.15.42:0/1941748465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560026c45970 0x56002704d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:35:30.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.408+0000 7f5a80e00640 1 --2- 172.21.15.42:0/1941748465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c66650 0x56002704d770 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009bf0 tx=0x7f5a74009f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b06439c646afaf server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:30.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.408+0000 7f5a69600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:30.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.408+0000 7f5a69600640 1 -- 172.21.15.42:0/1941748465 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a74009840 con 0x560026c66650 2024-09-17T01:35:30.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.408+0000 7f5a8a00e740 1 -- 172.21.15.42:0/1941748465 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a7401b5e0 con 0x560026c66650 2024-09-17T01:35:30.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.408+0000 7f5a69600640 1 -- 172.21.15.42:0/1941748465 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f5a7401b9a0 con 0x560026c66650 2024-09-17T01:35:30.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.409+0000 7f5a69600640 1 -- 172.21.15.42:0/1941748465 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5a7401bba0 con 0x560026c66650 2024-09-17T01:35:30.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.409+0000 7f5a8a00e740 10 client.5493 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:30.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.409+0000 7f5a8a00e740 1 -- 172.21.15.42:0/1941748465 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x560027064770 con 0x560026c66650 2024-09-17T01:35:30.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.409+0000 7f5a69600640 1 -- 172.21.15.42:0/1941748465 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a7401b5e0 con 0x560026c66650 2024-09-17T01:35:30.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.409+0000 7f5a69600640 1 -- 172.21.15.42:0/1941748465 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f5a74024070 con 0x560026c66650 2024-09-17T01:35:30.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.409+0000 7f5a8a00e740 10 client.5493 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:30.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.409+0000 7f5a8a00e740 10 client.5493 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:30.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.409+0000 7f5a8a00e740 20 client.5493 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:30.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.409+0000 7f5a8a00e740 1 --2- 172.21.15.42:0/1941748465 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x560027063920 0x560027063d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.409+0000 7f5a8a00e740 4 client.5493 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-17T01:35:30.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.409+0000 7f5a8a00e740 1 -- 172.21.15.42:0/1941748465 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x560026f7e2c0 con 0x560027063920 2024-09-17T01:35:30.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.409+0000 7f5a7be00640 1 --2- 172.21.15.42:0/1941748465 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x560027063920 0x560027063d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.410+0000 7f5a7be00640 1 --2- 172.21.15.42:0/1941748465 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x560027063920 0x560027063d30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd4d7b50fe837b7e server_cookie=3e166a15eac4af58 in_seq=0 out_seq=0 2024-09-17T01:35:30.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.410+0000 7f5a69600640 10 client.5493 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:30.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.414+0000 7f5a69600640 1 -- 172.21.15.42:0/1941748465 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560026f7e2c0 con 0x560027063920 2024-09-17T01:35:30.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.414+0000 7f5a69600640 10 client.5493 handle_command_reply: tid=0 2024-09-17T01:35:30.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.414+0000 7f5a8a00e740 1 client.5493 shutdown 2024-09-17T01:35:30.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.414+0000 7f5a8a00e740 1 -- 172.21.15.42:0/1941748465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c66650 msgr2=0x56002704d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.414+0000 7f5a8a00e740 1 --2- 172.21.15.42:0/1941748465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c66650 0x56002704d770 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009bf0 tx=0x7f5a74009f40 comp rx=0 tx=0).stop 2024-09-17T01:35:30.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.414+0000 7f5a8a00e740 1 -- 172.21.15.42:0/1941748465 shutdown_connections 2024-09-17T01:35:30.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.414+0000 7f5a8a00e740 1 --2- 172.21.15.42:0/1941748465 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x560027063920 0x560027063d30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.414+0000 7f5a8a00e740 1 --2- 172.21.15.42:0/1941748465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560026c66650 0x56002704d770 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.414+0000 7f5a8a00e740 1 --2- 172.21.15.42:0/1941748465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560026c45970 0x56002704d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.414+0000 7f5a8a00e740 1 --2- 172.21.15.42:0/1941748465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560026c3d790 0x5600270d1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.414+0000 7f5a69600640 0 client.5493 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:30.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.414+0000 7f5a8a00e740 1 -- 172.21.15.42:0/1941748465 >> 172.21.15.42:0/1941748465 conn(0x560026c5a7a0 msgr2=0x5600270482f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:30.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.414+0000 7f5a8a00e740 1 -- 172.21.15.42:0/1941748465 shutdown_connections 2024-09-17T01:35:30.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.414+0000 7f5a8a00e740 1 -- 172.21.15.42:0/1941748465 wait complete. 2024-09-17T01:35:30.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.414+0000 7f5a8a00e740 20 client.5493 trim_cache size 0 max 16384 2024-09-17T01:35:30.415 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:30.415 INFO:teuthology.orchestra.run.smithi042.stdout: "message": "", 2024-09-17T01:35:30.415 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0 2024-09-17T01:35:30.415 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:30.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.415+0000 7f5a82e00640 1 -- 172.21.15.42:0/3758471100 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5a58078bc0 msgr2=0x7f5a5807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.415+0000 7f5a82e00640 1 --2- 172.21.15.42:0/3758471100 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5a58078bc0 0x7f5a5807b0d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5a64033000 tx=0x7f5a64004730 comp rx=0 tx=0).stop 2024-09-17T01:35:30.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.415+0000 7f5a82e00640 1 -- 172.21.15.42:0/3758471100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a7c06d430 msgr2=0x7f5a7c14d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.415+0000 7f5a82e00640 1 --2- 172.21.15.42:0/3758471100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a7c06d430 0x7f5a7c14d080 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00d980 tx=0x7f5a6c00de40 comp rx=0 tx=0).stop 2024-09-17T01:35:30.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.415+0000 7f5a82e00640 1 -- 172.21.15.42:0/3758471100 shutdown_connections 2024-09-17T01:35:30.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.415+0000 7f5a82e00640 1 --2- 172.21.15.42:0/3758471100 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5a58078bc0 0x7f5a5807b0d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.415+0000 7f5a82e00640 1 --2- 172.21.15.42:0/3758471100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a7c0b3880 0x7f5a7c143b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.415+0000 7f5a82e00640 1 --2- 172.21.15.42:0/3758471100 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a7c15cfc0 0x7f5a7c0b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.415+0000 7f5a82e00640 1 --2- 172.21.15.42:0/3758471100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a7c06d430 0x7f5a7c14d080 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.415+0000 7f5a82e00640 1 -- 172.21.15.42:0/3758471100 >> 172.21.15.42:0/3758471100 conn(0x7f5a7c0b2930 msgr2=0x7f5a7c15e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:30.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.415+0000 7f5a82e00640 1 -- 172.21.15.42:0/3758471100 shutdown_connections 2024-09-17T01:35:30.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.415+0000 7f5a82e00640 1 -- 172.21.15.42:0/3758471100 wait complete. 2024-09-17T01:35:30.437 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites' returned '{'message': '', 'return_code': 0}' 2024-09-17T01:35:30.438 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-09-17T01:35:30.438 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-09-17T01:35:30.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.670+0000 7f6cdc800640 1 -- 172.21.15.42:0/2560438193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cd40cdef0 msgr2=0x7f6cd40d0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.670+0000 7f6cdc800640 1 --2- 172.21.15.42:0/2560438193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cd40cdef0 0x7f6cd40d0b90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4005fd0 tx=0x7f6cc402a540 comp rx=0 tx=0).stop 2024-09-17T01:35:30.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.671+0000 7f6cdc800640 1 -- 172.21.15.42:0/2560438193 shutdown_connections 2024-09-17T01:35:30.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.671+0000 7f6cdc800640 1 --2- 172.21.15.42:0/2560438193 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6cd40d10d0 0x7f6cd4160bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.671+0000 7f6cdc800640 1 --2- 172.21.15.42:0/2560438193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cd40cdef0 0x7f6cd40d0b90 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.671+0000 7f6cdc800640 1 -- 172.21.15.42:0/2560438193 >> 172.21.15.42:0/2560438193 conn(0x7f6cd40b42a0 msgr2=0x7f6cd40b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:30.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.671+0000 7f6cdc800640 1 -- 172.21.15.42:0/2560438193 shutdown_connections 2024-09-17T01:35:30.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.671+0000 7f6cdc800640 1 -- 172.21.15.42:0/2560438193 wait complete. 2024-09-17T01:35:30.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.673+0000 7f6cdc800640 1 Processor -- start 2024-09-17T01:35:30.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.673+0000 7f6cdc800640 1 -- start start 2024-09-17T01:35:30.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.675+0000 7f6cdc800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cd40b5fb0 0x7f6cd41f3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.675+0000 7f6cdc800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cd40cdef0 0x7f6cd409fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.675+0000 7f6cdc800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6cd40d10d0 0x7f6cd4149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.675+0000 7f6cdc800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd40b5150 con 0x7f6cd40b5fb0 2024-09-17T01:35:30.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.675+0000 7f6cdc800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd40b4fd0 con 0x7f6cd40cdef0 2024-09-17T01:35:30.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.675+0000 7f6cdc800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6cd40b3540 con 0x7f6cd40d10d0 2024-09-17T01:35:30.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.675+0000 7f6cd9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cd40b5fb0 0x7f6cd41f3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.675+0000 7f6cd9400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cd40cdef0 0x7f6cd409fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.675+0000 7f6cd9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cd40b5fb0 0x7f6cd41f3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37368/0 (socket says 172.21.15.42:37368) 2024-09-17T01:35:30.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.675+0000 7f6cd9e00640 1 -- 172.21.15.42:0/3731018963 learned_addr learned my addr 172.21.15.42:0/3731018963 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:30.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.675+0000 7f6cda800640 1 --2- 172.21.15.42:0/3731018963 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6cd40d10d0 0x7f6cd4149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.676+0000 7f6cd9e00640 1 -- 172.21.15.42:0/3731018963 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6cd40d10d0 msgr2=0x7f6cd4149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.676+0000 7f6cd9e00640 1 --2- 172.21.15.42:0/3731018963 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6cd40d10d0 0x7f6cd4149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.676+0000 7f6cd9e00640 1 -- 172.21.15.42:0/3731018963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cd40cdef0 msgr2=0x7f6cd409fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.676+0000 7f6cd9e00640 1 --2- 172.21.15.42:0/3731018963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cd40cdef0 0x7f6cd409fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.676+0000 7f6cd9e00640 1 -- 172.21.15.42:0/3731018963 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd40a03b0 con 0x7f6cd40b5fb0 2024-09-17T01:35:30.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.676+0000 7f6cd9e00640 1 --2- 172.21.15.42:0/3731018963 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cd40b5fb0 0x7f6cd41f3cb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800c3f0 tx=0x7f6cc800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:30.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.677+0000 7f6cce000640 1 -- 172.21.15.42:0/3731018963 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8017070 con 0x7f6cd40b5fb0 2024-09-17T01:35:30.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.677+0000 7f6cce000640 1 -- 172.21.15.42:0/3731018963 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cc80035f0 con 0x7f6cd40b5fb0 2024-09-17T01:35:30.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.677+0000 7f6cce000640 1 -- 172.21.15.42:0/3731018963 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8003a40 con 0x7f6cd40b5fb0 2024-09-17T01:35:30.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.678+0000 7f6cdc800640 1 -- 172.21.15.42:0/3731018963 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd409edd0 con 0x7f6cd40b5fb0 2024-09-17T01:35:30.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.678+0000 7f6cdc800640 1 -- 172.21.15.42:0/3731018963 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd409f390 con 0x7f6cd40b5fb0 2024-09-17T01:35:30.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.682+0000 7f6cce000640 1 -- 172.21.15.42:0/3731018963 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6cc801a070 con 0x7f6cd40b5fb0 2024-09-17T01:35:30.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.682+0000 7f6ce39d1740 1 Processor -- start 2024-09-17T01:35:30.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.682+0000 7f6ce39d1740 1 -- start start 2024-09-17T01:35:30.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.683+0000 7f6cce000640 1 --2- 172.21.15.42:0/3731018963 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6cb8078b90 0x7f6cb807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.683+0000 7f6cce000640 1 -- 172.21.15.42:0/3731018963 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f6cc8099f70 con 0x7f6cd40b5fb0 2024-09-17T01:35:30.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.683+0000 7f6cda800640 1 --2- 172.21.15.42:0/3731018963 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6cb8078b90 0x7f6cb807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.683+0000 7f6ce39d1740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f759690 0x55776fb2f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.683+0000 7f6ce39d1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55776f7307d0 0x55776fb2f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.683+0000 7f6ce39d1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f7389b0 0x55776fb4c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.683+0000 7f6ce39d1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55776fa73a30 con 0x55776f7389b0 2024-09-17T01:35:30.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.683+0000 7f6ce39d1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55776fa62e60 con 0x55776f7307d0 2024-09-17T01:35:30.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.683+0000 7f6ce39d1740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55776fa66c70 con 0x55776f759690 2024-09-17T01:35:30.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.684+0000 7f6cda800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f7389b0 0x55776fb4c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.684+0000 7f6cd9e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f759690 0x55776fb2f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.684+0000 7f6cd9400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55776f7307d0 0x55776fb2f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.684+0000 7f6cda800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f7389b0 0x55776fb4c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37374/0 (socket says 172.21.15.42:37374) 2024-09-17T01:35:30.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.684+0000 7f6cd9e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f759690 0x55776fb2f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:57086/0 (socket says 172.21.15.42:57086) 2024-09-17T01:35:30.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.684+0000 7f6cda800640 1 -- 172.21.15.42:0/463131214 learned_addr learned my addr 172.21.15.42:0/463131214 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:30.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.684+0000 7f6cd9e00640 1 -- 172.21.15.42:0/463131214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55776f7307d0 msgr2=0x55776fb2f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:30.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.684+0000 7f6cd9e00640 1 --2- 172.21.15.42:0/463131214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55776f7307d0 0x55776fb2f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.684+0000 7f6cd9e00640 1 -- 172.21.15.42:0/463131214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f7389b0 msgr2=0x55776fb4c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:30.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.684+0000 7f6cd9e00640 1 --2- 172.21.15.42:0/463131214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f7389b0 0x55776fb4c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.684+0000 7f6cd9e00640 1 -- 172.21.15.42:0/463131214 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55776f83db00 con 0x55776f759690 2024-09-17T01:35:30.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.685+0000 7f6cda800640 1 --2- 172.21.15.42:0/3731018963 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6cb8078b90 0x7f6cb807b0a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009fd0 tx=0x7f6cd0013b00 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:30.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.685+0000 7f6cd9e00640 1 --2- 172.21.15.42:0/463131214 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f759690 0x55776fb2f270 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6cc80984f0 tx=0x7f6cc80614e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1f0cf4b09b1fffb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.685+0000 7f6cc2600640 1 -- 172.21.15.42:0/463131214 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc80667a0 con 0x55776f759690 2024-09-17T01:35:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.685+0000 7f6cc2600640 1 -- 172.21.15.42:0/463131214 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cc806b650 con 0x55776f759690 2024-09-17T01:35:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.685+0000 7f6cc2600640 1 -- 172.21.15.42:0/463131214 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc806b1c0 con 0x55776f759690 2024-09-17T01:35:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.686+0000 7f6ce39d1740 1 -- 172.21.15.42:0/463131214 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f759690 msgr2=0x55776fb2f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.686+0000 7f6ce39d1740 1 --2- 172.21.15.42:0/463131214 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f759690 0x55776fb2f270 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6cc80984f0 tx=0x7f6cc80614e0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.686+0000 7f6ce39d1740 1 -- 172.21.15.42:0/463131214 shutdown_connections 2024-09-17T01:35:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.686+0000 7f6ce39d1740 1 --2- 172.21.15.42:0/463131214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55776f7307d0 0x55776fb2f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.686+0000 7f6ce39d1740 1 --2- 172.21.15.42:0/463131214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f7389b0 0x55776fb4c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.686+0000 7f6ce39d1740 1 --2- 172.21.15.42:0/463131214 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f759690 0x55776fb2f270 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.686+0000 7f6ce39d1740 1 -- 172.21.15.42:0/463131214 >> 172.21.15.42:0/463131214 conn(0x55776f74d7e0 msgr2=0x55776fb05530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.686+0000 7f6ce39d1740 1 -- 172.21.15.42:0/463131214 shutdown_connections 2024-09-17T01:35:30.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.686+0000 7f6ce39d1740 1 -- 172.21.15.42:0/463131214 wait complete. 2024-09-17T01:35:30.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.687+0000 7f6ce39d1740 1 -- start start 2024-09-17T01:35:30.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.688+0000 7f6ce39d1740 1 Processor -- start 2024-09-17T01:35:30.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.689+0000 7f6ce39d1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55776f7307d0 0x55776fb5d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.689+0000 7f6ce39d1740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f7389b0 0x55776fb448e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.689+0000 7f6ce39d1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f759690 0x55776fb3f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.689+0000 7f6ce39d1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55776f7d3a40 con 0x55776f759690 2024-09-17T01:35:30.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.689+0000 7f6ce39d1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55776fa087c0 con 0x55776f7307d0 2024-09-17T01:35:30.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.689+0000 7f6ce39d1740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55776fb2fcf0 con 0x55776f7389b0 2024-09-17T01:35:30.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.689+0000 7f6ce39d1740 10 client.0 _ll_register_callbacks cb 0x55776f770ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:30.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.690+0000 7f6cda800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f759690 0x55776fb3f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.690+0000 7f6cda800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f759690 0x55776fb3f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37388/0 (socket says 172.21.15.42:37388) 2024-09-17T01:35:30.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.690+0000 7f6cda800640 1 -- 172.21.15.42:0/370514872 learned_addr learned my addr 172.21.15.42:0/370514872 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:30.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.690+0000 7f6cd9e00640 1 --2- 172.21.15.42:0/370514872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55776f7307d0 0x55776fb5d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.690+0000 7f6cd9400640 1 --2- 172.21.15.42:0/370514872 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f7389b0 0x55776fb448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.690+0000 7f6cda800640 1 -- 172.21.15.42:0/370514872 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f7389b0 msgr2=0x55776fb448e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:30.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.690+0000 7f6cda800640 1 --2- 172.21.15.42:0/370514872 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f7389b0 0x55776fb448e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.690+0000 7f6cda800640 1 -- 172.21.15.42:0/370514872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55776f7307d0 msgr2=0x55776fb5d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:30.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.690+0000 7f6cda800640 1 --2- 172.21.15.42:0/370514872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55776f7307d0 0x55776fb5d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.690+0000 7f6cda800640 1 -- 172.21.15.42:0/370514872 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55776f7a29a0 con 0x55776f759690 2024-09-17T01:35:30.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.690+0000 7f6cda800640 1 --2- 172.21.15.42:0/370514872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f759690 0x55776fb3f940 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6cd000fb90 tx=0x7f6cd0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e3f756f3786f28 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.691+0000 7f6cb6a00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.691+0000 7f6cb6a00640 1 -- 172.21.15.42:0/370514872 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0010e00 con 0x55776f759690 2024-09-17T01:35:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.691+0000 7f6cb6a00640 1 -- 172.21.15.42:0/370514872 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f6cd0029470 con 0x55776f759690 2024-09-17T01:35:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.691+0000 7f6ce39d1740 1 -- 172.21.15.42:0/370514872 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cc806b650 con 0x55776f759690 2024-09-17T01:35:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.691+0000 7f6cb6a00640 1 -- 172.21.15.42:0/370514872 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6cd0031050 con 0x55776f759690 2024-09-17T01:35:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.691+0000 7f6ce39d1740 10 client.5508 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.691+0000 7f6ce39d1740 1 -- 172.21.15.42:0/370514872 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x55776f89e290 con 0x55776f759690 2024-09-17T01:35:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.691+0000 7f6cb6a00640 1 -- 172.21.15.42:0/370514872 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cc806b650 con 0x55776f759690 2024-09-17T01:35:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.692+0000 7f6cb6a00640 1 -- 172.21.15.42:0/370514872 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f6cd001f070 con 0x55776f759690 2024-09-17T01:35:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.692+0000 7f6ce39d1740 10 client.5508 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.692+0000 7f6ce39d1740 10 client.5508 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:30.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.692+0000 7f6ce39d1740 20 client.5508 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:30.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.692+0000 7f6ce39d1740 1 --2- 172.21.15.42:0/370514872 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55776f718260 0x55776fafaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.692+0000 7f6ce39d1740 4 client.5508 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:30.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.692+0000 7f6ce39d1740 1 -- 172.21.15.42:0/370514872 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55776fa75980 con 0x55776f718260 2024-09-17T01:35:30.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.692+0000 7f6cd9e00640 1 --2- 172.21.15.42:0/370514872 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55776f718260 0x55776fafaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.693+0000 7f6cb6a00640 10 client.5508 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:30.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.693+0000 7f6cd9e00640 1 --2- 172.21.15.42:0/370514872 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55776f718260 0x55776fafaeb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7fa9520e8c1c872 server_cookie=d5a248eccc3dc722 in_seq=0 out_seq=0 2024-09-17T01:35:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.694+0000 7f6cb6a00640 1 -- 172.21.15.42:0/370514872 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55776fa75980 con 0x55776f718260 2024-09-17T01:35:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.694+0000 7f6cb6a00640 10 client.5508 handle_command_reply: tid=0 2024-09-17T01:35:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.694+0000 7f6ce39d1740 1 client.5508 shutdown 2024-09-17T01:35:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.694+0000 7f6ce39d1740 1 -- 172.21.15.42:0/370514872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f759690 msgr2=0x55776fb3f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.694+0000 7f6ce39d1740 1 --2- 172.21.15.42:0/370514872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f759690 0x55776fb3f940 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6cd000fb90 tx=0x7f6cd0004ab0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.694+0000 7f6ce39d1740 1 -- 172.21.15.42:0/370514872 shutdown_connections 2024-09-17T01:35:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.694+0000 7f6ce39d1740 1 --2- 172.21.15.42:0/370514872 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55776f718260 0x55776fafaeb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.694+0000 7f6ce39d1740 1 --2- 172.21.15.42:0/370514872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f759690 0x55776fb3f940 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.694+0000 7f6ce39d1740 1 --2- 172.21.15.42:0/370514872 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f7389b0 0x55776fb448e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.694+0000 7f6ce39d1740 1 --2- 172.21.15.42:0/370514872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55776f7307d0 0x55776fb5d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.694+0000 7f6ce39d1740 1 -- 172.21.15.42:0/370514872 >> 172.21.15.42:0/370514872 conn(0x55776f74d7e0 msgr2=0x55776fb4bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:30.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.695+0000 7f6cb6a00640 0 client.5508 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:30.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.695+0000 7f6ce39d1740 1 -- 172.21.15.42:0/370514872 shutdown_connections 2024-09-17T01:35:30.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.695+0000 7f6ce39d1740 1 -- 172.21.15.42:0/370514872 wait complete. 2024-09-17T01:35:30.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.695+0000 7f6ce39d1740 20 client.5508 trim_cache size 0 max 16384 2024-09-17T01:35:30.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.730+0000 7f6ce39d1740 1 Processor -- start 2024-09-17T01:35:30.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.730+0000 7f6ce39d1740 1 -- start start 2024-09-17T01:35:30.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.732+0000 7f6ce39d1740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f7307d0 0x55776fb00590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.732+0000 7f6ce39d1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55776f7389b0 0x55776fb00ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.732+0000 7f6ce39d1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f759690 0x55776fb6cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.732+0000 7f6ce39d1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd41fdc70 con 0x55776f759690 2024-09-17T01:35:30.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.732+0000 7f6ce39d1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd406e290 con 0x55776f7389b0 2024-09-17T01:35:30.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.732+0000 7f6ce39d1740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6cd409d130 con 0x55776f7307d0 2024-09-17T01:35:30.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.733+0000 7f6cda800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f759690 0x55776fb6cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.733+0000 7f6cd9e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f7307d0 0x55776fb00590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.733+0000 7f6cd9e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f7307d0 0x55776fb00590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:57110/0 (socket says 172.21.15.42:57110) 2024-09-17T01:35:30.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.733+0000 7f6cda800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f759690 0x55776fb6cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37402/0 (socket says 172.21.15.42:37402) 2024-09-17T01:35:30.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.733+0000 7f6cd9e00640 1 -- 172.21.15.42:0/1459340289 learned_addr learned my addr 172.21.15.42:0/1459340289 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:30.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.733+0000 7f6cd9400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55776f7389b0 0x55776fb00ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.733+0000 7f6cd9e00640 1 -- 172.21.15.42:0/1459340289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55776f7389b0 msgr2=0x55776fb00ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:30.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.733+0000 7f6cd9e00640 1 --2- 172.21.15.42:0/1459340289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55776f7389b0 0x55776fb00ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.733+0000 7f6cd9e00640 1 -- 172.21.15.42:0/1459340289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f759690 msgr2=0x55776fb6cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:30.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.733+0000 7f6cd9e00640 1 --2- 172.21.15.42:0/1459340289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f759690 0x55776fb6cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.733+0000 7f6cd9e00640 1 -- 172.21.15.42:0/1459340289 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55776f83be00 con 0x55776f7307d0 2024-09-17T01:35:30.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.733+0000 7f6cda800640 1 --2- 172.21.15.42:0/1459340289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f759690 0x55776fb6cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:35:30.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.734+0000 7f6cd9e00640 1 --2- 172.21.15.42:0/1459340289 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f7307d0 0x55776fb00590 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800c3c0 tx=0x7f6cc8000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51ecb1bacd5f6bb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:30.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.735+0000 7f6cc1c00640 1 -- 172.21.15.42:0/1459340289 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc806b650 con 0x55776f7307d0 2024-09-17T01:35:30.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.735+0000 7f6cc1c00640 1 -- 172.21.15.42:0/1459340289 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cc807d070 con 0x55776f7307d0 2024-09-17T01:35:30.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.735+0000 7f6cc1c00640 1 -- 172.21.15.42:0/1459340289 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc806b1c0 con 0x55776f7307d0 2024-09-17T01:35:30.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.736+0000 7f6ce39d1740 1 -- 172.21.15.42:0/1459340289 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f7307d0 msgr2=0x55776fb00590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.736+0000 7f6ce39d1740 1 --2- 172.21.15.42:0/1459340289 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f7307d0 0x55776fb00590 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800c3c0 tx=0x7f6cc8000ed0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.736+0000 7f6ce39d1740 1 -- 172.21.15.42:0/1459340289 shutdown_connections 2024-09-17T01:35:30.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.736+0000 7f6ce39d1740 1 --2- 172.21.15.42:0/1459340289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55776f7389b0 0x55776fb00ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.736+0000 7f6ce39d1740 1 --2- 172.21.15.42:0/1459340289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f759690 0x55776fb6cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.736+0000 7f6ce39d1740 1 --2- 172.21.15.42:0/1459340289 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f7307d0 0x55776fb00590 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.736+0000 7f6ce39d1740 1 -- 172.21.15.42:0/1459340289 >> 172.21.15.42:0/1459340289 conn(0x55776f74d7e0 msgr2=0x55776fb06450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:30.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.736+0000 7f6ce39d1740 1 -- 172.21.15.42:0/1459340289 shutdown_connections 2024-09-17T01:35:30.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.736+0000 7f6ce39d1740 1 -- 172.21.15.42:0/1459340289 wait complete. 2024-09-17T01:35:30.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.737+0000 7f6ce39d1740 1 -- start start 2024-09-17T01:35:30.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.738+0000 7f6ce39d1740 1 Processor -- start 2024-09-17T01:35:30.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.739+0000 7f6ce39d1740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f7307d0 0x55776fbcc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.739+0000 7f6ce39d1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55776f7389b0 0x55776fbc2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.740+0000 7f6ce39d1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f759690 0x55776fb6d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.740+0000 7f6ce39d1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd41f7530 con 0x55776f759690 2024-09-17T01:35:30.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.740+0000 7f6ce39d1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55776fbcc990 con 0x55776f7389b0 2024-09-17T01:35:30.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.740+0000 7f6ce39d1740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55776fb2f480 con 0x55776f7307d0 2024-09-17T01:35:30.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.740+0000 7f6ce39d1740 10 client.0 _ll_register_callbacks cb 0x7f6cd0012050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:30.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.740+0000 7f6cd9400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55776f7389b0 0x55776fbc2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.740+0000 7f6cd9e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f7307d0 0x55776fbcc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.740+0000 7f6cda800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f759690 0x55776fb6d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.740+0000 7f6cd9400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55776f7389b0 0x55776fbc2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:58832/0 (socket says 172.21.15.42:58832) 2024-09-17T01:35:30.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.740+0000 7f6cd9e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f7307d0 0x55776fbcc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:57118/0 (socket says 172.21.15.42:57118) 2024-09-17T01:35:30.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.740+0000 7f6cd9400640 1 -- 172.21.15.42:0/2903174794 learned_addr learned my addr 172.21.15.42:0/2903174794 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:30.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.740+0000 7f6cd9400640 1 -- 172.21.15.42:0/2903174794 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f7307d0 msgr2=0x55776fbcc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:30.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.740+0000 7f6cd9400640 1 --2- 172.21.15.42:0/2903174794 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f7307d0 0x55776fbcc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.740+0000 7f6cd9400640 1 -- 172.21.15.42:0/2903174794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f759690 msgr2=0x55776fb6d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:30.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.740+0000 7f6cd9400640 1 --2- 172.21.15.42:0/2903174794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f759690 0x55776fb6d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.740+0000 7f6cd9400640 1 -- 172.21.15.42:0/2903174794 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55776fbc2e90 con 0x55776f7389b0 2024-09-17T01:35:30.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.741+0000 7f6cd9400640 1 --2- 172.21.15.42:0/2903174794 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55776f7389b0 0x55776fbc2950 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009230 tx=0x7f6cc4004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccf7c7ad0ad0a1be server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:30.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.741+0000 7f6cb6a00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-17T01:35:30.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.741+0000 7f6cb6a00640 1 -- 172.21.15.42:0/2903174794 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4035040 con 0x55776f7389b0 2024-09-17T01:35:30.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.741+0000 7f6cb6a00640 1 -- 172.21.15.42:0/2903174794 <== mon.1 v2:172.21.15.43:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f6cc40035f0 con 0x55776f7389b0 2024-09-17T01:35:30.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.741+0000 7f6ce39d1740 1 -- 172.21.15.42:0/2903174794 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cc807d070 con 0x55776f7389b0 2024-09-17T01:35:30.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.742+0000 7f6cb6a00640 1 -- 172.21.15.42:0/2903174794 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6cc4050050 con 0x55776f7389b0 2024-09-17T01:35:30.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.742+0000 7f6ce39d1740 10 client.5425 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:30.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.742+0000 7f6ce39d1740 1 -- 172.21.15.42:0/2903174794 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x55776fb6d840 con 0x55776f7389b0 2024-09-17T01:35:30.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.742+0000 7f6cb6a00640 1 -- 172.21.15.42:0/2903174794 <== mon.1 v2:172.21.15.43:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cc807d070 con 0x55776f7389b0 2024-09-17T01:35:30.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.742+0000 7f6cb6a00640 1 -- 172.21.15.42:0/2903174794 <== mon.1 v2:172.21.15.43:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f6cc4053020 con 0x55776f7389b0 2024-09-17T01:35:30.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.742+0000 7f6ce39d1740 10 client.5425 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:30.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.742+0000 7f6ce39d1740 10 client.5425 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:30.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.742+0000 7f6ce39d1740 20 client.5425 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:30.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.742+0000 7f6ce39d1740 1 --2- 172.21.15.42:0/2903174794 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55776fb2c400 0x55776fb4b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:30.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.742+0000 7f6ce39d1740 4 client.5425 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-17T01:35:30.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.742+0000 7f6ce39d1740 1 -- 172.21.15.42:0/2903174794 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x55776fa71430 con 0x55776fb2c400 2024-09-17T01:35:30.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.742+0000 7f6cd9e00640 1 --2- 172.21.15.42:0/2903174794 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55776fb2c400 0x55776fb4b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:30.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.743+0000 7f6cb6a00640 10 client.5425 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:30.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.743+0000 7f6cd9e00640 1 --2- 172.21.15.42:0/2903174794 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55776fb2c400 0x55776fb4b9c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8a3f7a147210a5d server_cookie=65fcb2564a4f3fb7 in_seq=0 out_seq=0 2024-09-17T01:35:30.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.803+0000 7f6cb6a00640 1 -- 172.21.15.42:0/2903174794 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55776fa71430 con 0x55776fb2c400 2024-09-17T01:35:30.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.803+0000 7f6cb6a00640 10 client.5425 handle_command_reply: tid=0 2024-09-17T01:35:30.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.803+0000 7f6ce39d1740 1 client.5425 shutdown 2024-09-17T01:35:30.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.803+0000 7f6ce39d1740 1 -- 172.21.15.42:0/2903174794 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55776f7389b0 msgr2=0x55776fbc2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.803+0000 7f6ce39d1740 1 --2- 172.21.15.42:0/2903174794 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55776f7389b0 0x55776fbc2950 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009230 tx=0x7f6cc4004270 comp rx=0 tx=0).stop 2024-09-17T01:35:30.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.803+0000 7f6ce39d1740 1 -- 172.21.15.42:0/2903174794 shutdown_connections 2024-09-17T01:35:30.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.803+0000 7f6ce39d1740 1 --2- 172.21.15.42:0/2903174794 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55776fb2c400 0x55776fb4b9c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.803+0000 7f6ce39d1740 1 --2- 172.21.15.42:0/2903174794 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55776f7389b0 0x55776fbc2950 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.803+0000 7f6ce39d1740 1 --2- 172.21.15.42:0/2903174794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55776f759690 0x55776fb6d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.803+0000 7f6ce39d1740 1 --2- 172.21.15.42:0/2903174794 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55776f7307d0 0x55776fbcc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.803+0000 7f6ce39d1740 1 -- 172.21.15.42:0/2903174794 >> 172.21.15.42:0/2903174794 conn(0x55776f74d7e0 msgr2=0x55776fb450f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:30.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.803+0000 7f6cb6a00640 0 client.5425 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:30.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.803+0000 7f6ce39d1740 1 -- 172.21.15.42:0/2903174794 shutdown_connections 2024-09-17T01:35:30.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.803+0000 7f6ce39d1740 1 -- 172.21.15.42:0/2903174794 wait complete. 2024-09-17T01:35:30.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.804+0000 7f6ce39d1740 20 client.5425 trim_cache size 0 max 16384 2024-09-17T01:35:30.804 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:30.804 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-17T01:35:30.804 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "769242e9-0529-44ae-ba31-8514cbaaf3fb", 2024-09-17T01:35:30.804 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-17T01:35:30.804 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:30.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.804+0000 7f6cdc800640 1 -- 172.21.15.42:0/3731018963 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6cb8078b90 msgr2=0x7f6cb807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.805+0000 7f6cdc800640 1 --2- 172.21.15.42:0/3731018963 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6cb8078b90 0x7f6cb807b0a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009fd0 tx=0x7f6cd0013b00 comp rx=0 tx=0).stop 2024-09-17T01:35:30.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.805+0000 7f6cdc800640 1 -- 172.21.15.42:0/3731018963 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cd40b5fb0 msgr2=0x7f6cd41f3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:30.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.805+0000 7f6cdc800640 1 --2- 172.21.15.42:0/3731018963 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cd40b5fb0 0x7f6cd41f3cb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800c3f0 tx=0x7f6cc800c8b0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.805+0000 7f6cdc800640 1 -- 172.21.15.42:0/3731018963 shutdown_connections 2024-09-17T01:35:30.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.805+0000 7f6cdc800640 1 --2- 172.21.15.42:0/3731018963 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6cb8078b90 0x7f6cb807b0a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.805+0000 7f6cdc800640 1 --2- 172.21.15.42:0/3731018963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cd40cdef0 0x7f6cd409fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.805+0000 7f6cdc800640 1 --2- 172.21.15.42:0/3731018963 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6cd40d10d0 0x7f6cd4149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.805+0000 7f6cdc800640 1 --2- 172.21.15.42:0/3731018963 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cd40b5fb0 0x7f6cd41f3cb0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:30.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.805+0000 7f6cdc800640 1 -- 172.21.15.42:0/3731018963 >> 172.21.15.42:0/3731018963 conn(0x7f6cd40b42a0 msgr2=0x7f6cd415df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:30.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.805+0000 7f6cdc800640 1 -- 172.21.15.42:0/3731018963 shutdown_connections 2024-09-17T01:35:30.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:30.805+0000 7f6cdc800640 1 -- 172.21.15.42:0/3731018963 wait complete. 2024-09-17T01:35:30.827 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': '769242e9-0529-44ae-ba31-8514cbaaf3fb', 'mode': 'asynchronous'}' 2024-09-17T01:35:30.827 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-17T01:35:30.827 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-17T01:35:30.827 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-17T01:35:31.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.060+0000 7f3d6ce00640 1 -- 172.21.15.42:0/2888516969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d4c005350 msgr2=0x7f3d4c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.060+0000 7f3d6ce00640 1 --2- 172.21.15.42:0/2888516969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d4c005350 0x7f3d4c00b9c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3d680cf3a0 tx=0x7f3d4c005830 comp rx=0 tx=0).stop 2024-09-17T01:35:31.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.060+0000 7f3d67e00640 1 -- 172.21.15.42:0/2888516969 reap_dead start 2024-09-17T01:35:31.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.060+0000 7f3d6ce00640 1 -- 172.21.15.42:0/2888516969 shutdown_connections 2024-09-17T01:35:31.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.060+0000 7f3d6ce00640 1 -- 172.21.15.42:0/2888516969 >> 172.21.15.42:0/2888516969 conn(0x7f3d6806d440 msgr2=0x7f3d680b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:31.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.060+0000 7f3d6ce00640 1 -- 172.21.15.42:0/2888516969 shutdown_connections 2024-09-17T01:35:31.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.060+0000 7f3d6ce00640 1 -- 172.21.15.42:0/2888516969 wait complete. 2024-09-17T01:35:31.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.063+0000 7f3d6ce00640 1 Processor -- start 2024-09-17T01:35:31.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.063+0000 7f3d6ce00640 1 -- start start 2024-09-17T01:35:31.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.064+0000 7f3d6ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d4c005350 0x7f3d6814ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.064+0000 7f3d6ce00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3d6814ca50 0x7f3d6814ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.064+0000 7f3d6ce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d6814d3a0 0x7f3d68159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.064+0000 7f3d6ce00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6806e2f0 con 0x7f3d4c005350 2024-09-17T01:35:31.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.064+0000 7f3d6ce00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3d680b53a0 con 0x7f3d6814d3a0 2024-09-17T01:35:31.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.064+0000 7f3d6ce00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3d6806e470 con 0x7f3d6814ca50 2024-09-17T01:35:31.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.064+0000 7f3d67400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d4c005350 0x7f3d6814ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.065+0000 7f3d67400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d4c005350 0x7f3d6814ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37418/0 (socket says 172.21.15.42:37418) 2024-09-17T01:35:31.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.065+0000 7f3d67400640 1 -- 172.21.15.42:0/135144976 learned_addr learned my addr 172.21.15.42:0/135144976 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:31.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.065+0000 7f3d5fe00640 1 --2- 172.21.15.42:0/135144976 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3d6814ca50 0x7f3d6814ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.065+0000 7f3d67e00640 1 --2- 172.21.15.42:0/135144976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d6814d3a0 0x7f3d68159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.065+0000 7f3d67400640 1 -- 172.21.15.42:0/135144976 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3d6814ca50 msgr2=0x7f3d6814ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.065+0000 7f3d67400640 1 --2- 172.21.15.42:0/135144976 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3d6814ca50 0x7f3d6814ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.065+0000 7f3d67400640 1 -- 172.21.15.42:0/135144976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d6814d3a0 msgr2=0x7f3d68159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.065+0000 7f3d67400640 1 --2- 172.21.15.42:0/135144976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d6814d3a0 0x7f3d68159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.065+0000 7f3d67400640 1 -- 172.21.15.42:0/135144976 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d6814d7b0 con 0x7f3d4c005350 2024-09-17T01:35:31.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.065+0000 7f3d67e00640 1 --2- 172.21.15.42:0/135144976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d6814d3a0 0x7f3d68159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:31.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.065+0000 7f3d67400640 1 --2- 172.21.15.42:0/135144976 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d4c005350 0x7f3d6814ac90 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3d58003f50 tx=0x7f3d580016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:31.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.065+0000 7f3d5f400640 1 -- 172.21.15.42:0/135144976 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d58011640 con 0x7f3d4c005350 2024-09-17T01:35:31.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.066+0000 7f3d5f400640 1 -- 172.21.15.42:0/135144976 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d58016020 con 0x7f3d4c005350 2024-09-17T01:35:31.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.066+0000 7f3d5f400640 1 -- 172.21.15.42:0/135144976 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d58011a60 con 0x7f3d4c005350 2024-09-17T01:35:31.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.066+0000 7f3d6ce00640 1 -- 172.21.15.42:0/135144976 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d681f5350 con 0x7f3d4c005350 2024-09-17T01:35:31.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.066+0000 7f3d6ce00640 1 -- 172.21.15.42:0/135144976 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d6814df60 con 0x7f3d4c005350 2024-09-17T01:35:31.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.068+0000 7f3d5f400640 1 -- 172.21.15.42:0/135144976 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3d58011c00 con 0x7f3d4c005350 2024-09-17T01:35:31.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.070+0000 7f3d5f400640 1 --2- 172.21.15.42:0/135144976 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3d44078b90 0x7f3d4407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.070+0000 7f3d5f400640 1 -- 172.21.15.42:0/135144976 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f3d5809b930 con 0x7f3d4c005350 2024-09-17T01:35:31.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.070+0000 7f3d5fe00640 1 --2- 172.21.15.42:0/135144976 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3d44078b90 0x7f3d4407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.070+0000 7f3d75465740 1 Processor -- start 2024-09-17T01:35:31.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.071+0000 7f3d75465740 1 -- start start 2024-09-17T01:35:31.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.071+0000 7f3d5fe00640 1 --2- 172.21.15.42:0/135144976 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3d44078b90 0x7f3d4407b0a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3d6815b7a0 tx=0x7f3d50005f00 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:31.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.072+0000 7f3d75465740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558af1fc1a60 0x558af23af610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.072+0000 7f3d75465740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558af1f98ba0 0x558af23922e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.072+0000 7f3d75465740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fa0d80 0x558af2392820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.072+0000 7f3d75465740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558af22db9c0 con 0x558af1fa0d80 2024-09-17T01:35:31.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.072+0000 7f3d75465740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558af22cadf0 con 0x558af1fc1a60 2024-09-17T01:35:31.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.072+0000 7f3d75465740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558af22cec00 con 0x558af1f98ba0 2024-09-17T01:35:31.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.072+0000 7f3d67e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fa0d80 0x558af2392820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.072+0000 7f3d67400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558af1fc1a60 0x558af23af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.072+0000 7f3d67e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fa0d80 0x558af2392820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37426/0 (socket says 172.21.15.42:37426) 2024-09-17T01:35:31.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.072+0000 7f3d67400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558af1fc1a60 0x558af23af610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:58852/0 (socket says 172.21.15.42:58852) 2024-09-17T01:35:31.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.072+0000 7f3d67e00640 1 -- 172.21.15.42:0/1947006467 learned_addr learned my addr 172.21.15.42:0/1947006467 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:31.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.072+0000 7f3d5fe00640 1 --2- 172.21.15.42:0/1947006467 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558af1f98ba0 0x558af23922e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.073+0000 7f3d67e00640 1 -- 172.21.15.42:0/1947006467 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558af1f98ba0 msgr2=0x558af23922e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.073+0000 7f3d67e00640 1 --2- 172.21.15.42:0/1947006467 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558af1f98ba0 0x558af23922e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.073+0000 7f3d67e00640 1 -- 172.21.15.42:0/1947006467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558af1fc1a60 msgr2=0x558af23af610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.073+0000 7f3d67e00640 1 --2- 172.21.15.42:0/1947006467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558af1fc1a60 0x558af23af610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.073+0000 7f3d67e00640 1 -- 172.21.15.42:0/1947006467 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558af2289320 con 0x558af1fa0d80 2024-09-17T01:35:31.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.073+0000 7f3d67e00640 1 --2- 172.21.15.42:0/1947006467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fa0d80 0x558af2392820 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3d60002130 tx=0x7f3d60001d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4e31b5520bf64e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:31.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.073+0000 7f3d57e00640 1 -- 172.21.15.42:0/1947006467 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d60039070 con 0x558af1fa0d80 2024-09-17T01:35:31.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.073+0000 7f3d57e00640 1 -- 172.21.15.42:0/1947006467 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d6002f030 con 0x558af1fa0d80 2024-09-17T01:35:31.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.073+0000 7f3d57e00640 1 -- 172.21.15.42:0/1947006467 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d60001a90 con 0x558af1fa0d80 2024-09-17T01:35:31.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.074+0000 7f3d75465740 1 -- 172.21.15.42:0/1947006467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fa0d80 msgr2=0x558af2392820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.074+0000 7f3d75465740 1 --2- 172.21.15.42:0/1947006467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fa0d80 0x558af2392820 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3d60002130 tx=0x7f3d60001d90 comp rx=0 tx=0).stop 2024-09-17T01:35:31.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.074+0000 7f3d75465740 1 -- 172.21.15.42:0/1947006467 shutdown_connections 2024-09-17T01:35:31.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.074+0000 7f3d75465740 1 --2- 172.21.15.42:0/1947006467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fa0d80 0x558af2392820 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.074+0000 7f3d75465740 1 --2- 172.21.15.42:0/1947006467 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558af1f98ba0 0x558af23922e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.074+0000 7f3d75465740 1 --2- 172.21.15.42:0/1947006467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558af1fc1a60 0x558af23af610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.074+0000 7f3d75465740 1 -- 172.21.15.42:0/1947006467 >> 172.21.15.42:0/1947006467 conn(0x558af1fb5bb0 msgr2=0x558af2368500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:31.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.074+0000 7f3d75465740 1 -- 172.21.15.42:0/1947006467 shutdown_connections 2024-09-17T01:35:31.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.074+0000 7f3d75465740 1 -- 172.21.15.42:0/1947006467 wait complete. 2024-09-17T01:35:31.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.075+0000 7f3d75465740 1 -- start start 2024-09-17T01:35:31.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.076+0000 7f3d75465740 1 Processor -- start 2024-09-17T01:35:31.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.077+0000 7f3d75465740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558af1f98ba0 0x558af23a6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.077+0000 7f3d75465740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558af1fa0d80 0x558af23a8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.077+0000 7f3d75465740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fc1a60 0x558af23802d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.077+0000 7f3d75465740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558af203be10 con 0x558af1fc1a60 2024-09-17T01:35:31.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.077+0000 7f3d75465740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558af2271590 con 0x558af1fa0d80 2024-09-17T01:35:31.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.077+0000 7f3d75465740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558af23a9700 con 0x558af1f98ba0 2024-09-17T01:35:31.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.077+0000 7f3d75465740 10 client.0 _ll_register_callbacks cb 0x558af22767b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:31.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.077+0000 7f3d67e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fc1a60 0x558af23802d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.077+0000 7f3d67e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fc1a60 0x558af23802d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37442/0 (socket says 172.21.15.42:37442) 2024-09-17T01:35:31.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.077+0000 7f3d67e00640 1 -- 172.21.15.42:0/2252530188 learned_addr learned my addr 172.21.15.42:0/2252530188 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:31.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.078+0000 7f3d67400640 1 --2- 172.21.15.42:0/2252530188 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558af1f98ba0 0x558af23a6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.078+0000 7f3d5fe00640 1 --2- 172.21.15.42:0/2252530188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558af1fa0d80 0x558af23a8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.078+0000 7f3d67e00640 1 -- 172.21.15.42:0/2252530188 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558af1f98ba0 msgr2=0x558af23a6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.078+0000 7f3d67e00640 1 --2- 172.21.15.42:0/2252530188 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558af1f98ba0 0x558af23a6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.078+0000 7f3d67e00640 1 -- 172.21.15.42:0/2252530188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558af1fa0d80 msgr2=0x558af23a8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.078+0000 7f3d67e00640 1 --2- 172.21.15.42:0/2252530188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558af1fa0d80 0x558af23a8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.078+0000 7f3d67e00640 1 -- 172.21.15.42:0/2252530188 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558af1fbdac0 con 0x558af1fc1a60 2024-09-17T01:35:31.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.078+0000 7f3d67400640 1 --2- 172.21.15.42:0/2252530188 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558af1f98ba0 0x558af23a6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:31.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.078+0000 7f3d67e00640 1 --2- 172.21.15.42:0/2252530188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fc1a60 0x558af23802d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3d60000f80 tx=0x7f3d60003990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15746f6848ab055e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:31.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.078+0000 7f3d54c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:31.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.078+0000 7f3d54c00640 1 -- 172.21.15.42:0/2252530188 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d60039040 con 0x558af1fc1a60 2024-09-17T01:35:31.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.078+0000 7f3d75465740 1 -- 172.21.15.42:0/2252530188 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d6002f030 con 0x558af1fc1a60 2024-09-17T01:35:31.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.078+0000 7f3d54c00640 1 -- 172.21.15.42:0/2252530188 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f3d60003dd0 con 0x558af1fc1a60 2024-09-17T01:35:31.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.079+0000 7f3d54c00640 1 -- 172.21.15.42:0/2252530188 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3d6004d050 con 0x558af1fc1a60 2024-09-17T01:35:31.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.079+0000 7f3d75465740 10 client.5526 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:31.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.079+0000 7f3d75465740 1 -- 172.21.15.42:0/2252530188 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x558af202d040 con 0x558af1fc1a60 2024-09-17T01:35:31.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.079+0000 7f3d54c00640 1 -- 172.21.15.42:0/2252530188 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d6002f030 con 0x558af1fc1a60 2024-09-17T01:35:31.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.079+0000 7f3d54c00640 1 -- 172.21.15.42:0/2252530188 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f3d60050020 con 0x558af1fc1a60 2024-09-17T01:35:31.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.079+0000 7f3d75465740 10 client.5526 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:31.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.079+0000 7f3d75465740 10 client.5526 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:31.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.079+0000 7f3d75465740 20 client.5526 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:31.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.079+0000 7f3d75465740 1 --2- 172.21.15.42:0/2252530188 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558af1f80630 0x558af23a5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.079+0000 7f3d75465740 4 client.5526 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:31.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.079+0000 7f3d75465740 1 -- 172.21.15.42:0/2252530188 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558af22dd910 con 0x558af1f80630 2024-09-17T01:35:31.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.079+0000 7f3d67400640 1 --2- 172.21.15.42:0/2252530188 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558af1f80630 0x558af23a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.080+0000 7f3d67400640 1 --2- 172.21.15.42:0/2252530188 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558af1f80630 0x558af23a5320 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=872dc88880dc2729 server_cookie=f55a01bf7aed4da9 in_seq=0 out_seq=0 2024-09-17T01:35:31.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.080+0000 7f3d54c00640 10 client.5526 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:31.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.080+0000 7f3d54c00640 1 -- 172.21.15.42:0/2252530188 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558af22dd910 con 0x558af1f80630 2024-09-17T01:35:31.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.080+0000 7f3d54c00640 10 client.5526 handle_command_reply: tid=0 2024-09-17T01:35:31.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.080+0000 7f3d75465740 1 client.5526 shutdown 2024-09-17T01:35:31.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.081+0000 7f3d75465740 1 -- 172.21.15.42:0/2252530188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fc1a60 msgr2=0x558af23802d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.081+0000 7f3d75465740 1 --2- 172.21.15.42:0/2252530188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fc1a60 0x558af23802d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3d60000f80 tx=0x7f3d60003990 comp rx=0 tx=0).stop 2024-09-17T01:35:31.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.081+0000 7f3d75465740 1 -- 172.21.15.42:0/2252530188 shutdown_connections 2024-09-17T01:35:31.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.081+0000 7f3d75465740 1 --2- 172.21.15.42:0/2252530188 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558af1f80630 0x558af23a5320 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.081+0000 7f3d75465740 1 --2- 172.21.15.42:0/2252530188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558af1fa0d80 0x558af23a8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.081+0000 7f3d75465740 1 --2- 172.21.15.42:0/2252530188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fc1a60 0x558af23802d0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.081+0000 7f3d75465740 1 --2- 172.21.15.42:0/2252530188 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558af1f98ba0 0x558af23a6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.081+0000 7f3d54c00640 0 client.5526 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:31.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.081+0000 7f3d75465740 1 -- 172.21.15.42:0/2252530188 >> 172.21.15.42:0/2252530188 conn(0x558af1fb5bb0 msgr2=0x558af2361970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:31.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.081+0000 7f3d75465740 1 -- 172.21.15.42:0/2252530188 shutdown_connections 2024-09-17T01:35:31.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.081+0000 7f3d75465740 1 -- 172.21.15.42:0/2252530188 wait complete. 2024-09-17T01:35:31.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.081+0000 7f3d75465740 20 client.5526 trim_cache size 0 max 16384 2024-09-17T01:35:31.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.097+0000 7f3d75465740 1 Processor -- start 2024-09-17T01:35:31.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.097+0000 7f3d75465740 1 -- start start 2024-09-17T01:35:31.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.098+0000 7f3d75465740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558af1f98ba0 0x558af23a3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.098+0000 7f3d75465740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558af1fa0d80 0x558af23cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.098+0000 7f3d75465740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fc1a60 0x558af23cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.098+0000 7f3d75465740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3d682026a0 con 0x558af1fc1a60 2024-09-17T01:35:31.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.098+0000 7f3d75465740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3d682016c0 con 0x558af1fa0d80 2024-09-17T01:35:31.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.098+0000 7f3d75465740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3d68200a20 con 0x558af1f98ba0 2024-09-17T01:35:31.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.099+0000 7f3d67e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fc1a60 0x558af23cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.099+0000 7f3d67e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fc1a60 0x558af23cfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37456/0 (socket says 172.21.15.42:37456) 2024-09-17T01:35:31.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.099+0000 7f3d67e00640 1 -- 172.21.15.42:0/1984590224 learned_addr learned my addr 172.21.15.42:0/1984590224 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:31.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.099+0000 7f3d5fe00640 1 --2- 172.21.15.42:0/1984590224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558af1fa0d80 0x558af23cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.099+0000 7f3d67400640 1 --2- 172.21.15.42:0/1984590224 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558af1f98ba0 0x558af23a3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.099+0000 7f3d67e00640 1 -- 172.21.15.42:0/1984590224 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558af1f98ba0 msgr2=0x558af23a3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.099+0000 7f3d67e00640 1 --2- 172.21.15.42:0/1984590224 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558af1f98ba0 0x558af23a3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.099+0000 7f3d67e00640 1 -- 172.21.15.42:0/1984590224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558af1fa0d80 msgr2=0x558af23cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.099+0000 7f3d67e00640 1 --2- 172.21.15.42:0/1984590224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558af1fa0d80 0x558af23cf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.099+0000 7f3d67e00640 1 -- 172.21.15.42:0/1984590224 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558af20a5ed0 con 0x558af1fc1a60 2024-09-17T01:35:31.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.099+0000 7f3d67e00640 1 --2- 172.21.15.42:0/1984590224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fc1a60 0x558af23cfe60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3d60003a30 tx=0x7f3d60003a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ff12838c36fa87 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:31.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.100+0000 7f3d57400640 1 -- 172.21.15.42:0/1984590224 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d60039070 con 0x558af1fc1a60 2024-09-17T01:35:31.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.100+0000 7f3d57400640 1 -- 172.21.15.42:0/1984590224 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d6002f070 con 0x558af1fc1a60 2024-09-17T01:35:31.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.100+0000 7f3d57400640 1 -- 172.21.15.42:0/1984590224 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6002bd30 con 0x558af1fc1a60 2024-09-17T01:35:31.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.100+0000 7f3d75465740 1 -- 172.21.15.42:0/1984590224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fc1a60 msgr2=0x558af23cfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.100+0000 7f3d75465740 1 --2- 172.21.15.42:0/1984590224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fc1a60 0x558af23cfe60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3d60003a30 tx=0x7f3d60003a60 comp rx=0 tx=0).stop 2024-09-17T01:35:31.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.100+0000 7f3d75465740 1 -- 172.21.15.42:0/1984590224 shutdown_connections 2024-09-17T01:35:31.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.100+0000 7f3d75465740 1 --2- 172.21.15.42:0/1984590224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558af1fa0d80 0x558af23cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.100+0000 7f3d75465740 1 --2- 172.21.15.42:0/1984590224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fc1a60 0x558af23cfe60 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.100+0000 7f3d75465740 1 --2- 172.21.15.42:0/1984590224 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558af1f98ba0 0x558af23a3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.100+0000 7f3d75465740 1 -- 172.21.15.42:0/1984590224 >> 172.21.15.42:0/1984590224 conn(0x558af1fb5bb0 msgr2=0x558af23922e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:31.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.100+0000 7f3d75465740 1 -- 172.21.15.42:0/1984590224 shutdown_connections 2024-09-17T01:35:31.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.100+0000 7f3d75465740 1 -- 172.21.15.42:0/1984590224 wait complete. 2024-09-17T01:35:31.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.101+0000 7f3d75465740 1 -- start start 2024-09-17T01:35:31.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.101+0000 7f3d75465740 1 Processor -- start 2024-09-17T01:35:31.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.103+0000 7f3d75465740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558af1f98ba0 0x558af242f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.103+0000 7f3d75465740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558af1fa0d80 0x558af242ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.103+0000 7f3d75465740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fc1a60 0x558af237c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.103+0000 7f3d75465740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558af23a3aa0 con 0x558af1fc1a60 2024-09-17T01:35:31.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.103+0000 7f3d75465740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3d68201070 con 0x558af1fa0d80 2024-09-17T01:35:31.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.103+0000 7f3d75465740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558af23a9390 con 0x558af1f98ba0 2024-09-17T01:35:31.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.103+0000 7f3d75465740 10 client.0 _ll_register_callbacks cb 0x7f3d4c005230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:31.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.103+0000 7f3d67e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fc1a60 0x558af237c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.103+0000 7f3d67e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fc1a60 0x558af237c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37470/0 (socket says 172.21.15.42:37470) 2024-09-17T01:35:31.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.103+0000 7f3d67e00640 1 -- 172.21.15.42:0/1782809281 learned_addr learned my addr 172.21.15.42:0/1782809281 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:31.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.103+0000 7f3d67400640 1 --2- 172.21.15.42:0/1782809281 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558af1f98ba0 0x558af242f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.104+0000 7f3d67e00640 1 -- 172.21.15.42:0/1782809281 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558af1f98ba0 msgr2=0x558af242f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.104+0000 7f3d5fe00640 1 --2- 172.21.15.42:0/1782809281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558af1fa0d80 0x558af242ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.104+0000 7f3d67e00640 1 --2- 172.21.15.42:0/1782809281 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558af1f98ba0 0x558af242f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.104+0000 7f3d67e00640 1 -- 172.21.15.42:0/1782809281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558af1fa0d80 msgr2=0x558af242ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.104+0000 7f3d67e00640 1 --2- 172.21.15.42:0/1782809281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558af1fa0d80 0x558af242ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.104+0000 7f3d67e00640 1 -- 172.21.15.42:0/1782809281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558af23a3d50 con 0x558af1fc1a60 2024-09-17T01:35:31.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.104+0000 7f3d67400640 1 --2- 172.21.15.42:0/1782809281 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558af1f98ba0 0x558af242f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:31.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.104+0000 7f3d67e00640 1 --2- 172.21.15.42:0/1782809281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fc1a60 0x558af237c3d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3d60006b20 tx=0x7f3d600021b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc6763469dcd1ef server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:31.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.104+0000 7f3d54c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:31.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.104+0000 7f3d54c00640 1 -- 172.21.15.42:0/1782809281 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d60056060 con 0x558af1fc1a60 2024-09-17T01:35:31.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.104+0000 7f3d54c00640 1 -- 172.21.15.42:0/1782809281 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f3d60006700 con 0x558af1fc1a60 2024-09-17T01:35:31.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.104+0000 7f3d75465740 1 -- 172.21.15.42:0/1782809281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d6002f070 con 0x558af1fc1a60 2024-09-17T01:35:31.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.104+0000 7f3d54c00640 1 -- 172.21.15.42:0/1782809281 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3d60039040 con 0x558af1fc1a60 2024-09-17T01:35:31.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.104+0000 7f3d75465740 10 client.5532 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:31.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.104+0000 7f3d75465740 1 -- 172.21.15.42:0/1782809281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x558af23bb7b0 con 0x558af1fc1a60 2024-09-17T01:35:31.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.105+0000 7f3d54c00640 1 -- 172.21.15.42:0/1782809281 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d6002f070 con 0x558af1fc1a60 2024-09-17T01:35:31.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.105+0000 7f3d54c00640 1 -- 172.21.15.42:0/1782809281 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f3d60050040 con 0x558af1fc1a60 2024-09-17T01:35:31.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.105+0000 7f3d75465740 10 client.5532 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:31.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.105+0000 7f3d75465740 10 client.5532 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:31.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.105+0000 7f3d75465740 20 client.5532 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:31.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.105+0000 7f3d75465740 1 --2- 172.21.15.42:0/1782809281 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558af23a8f50 0x558af237c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.105+0000 7f3d75465740 4 client.5532 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-17T01:35:31.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.105+0000 7f3d75465740 1 -- 172.21.15.42:0/1782809281 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x558af23a67b0 con 0x558af23a8f50 2024-09-17T01:35:31.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.105+0000 7f3d67400640 1 --2- 172.21.15.42:0/1782809281 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558af23a8f50 0x558af237c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.106+0000 7f3d67400640 1 --2- 172.21.15.42:0/1782809281 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558af23a8f50 0x558af237c910 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ac55f123cb5568e server_cookie=fb26f50d88af22b in_seq=0 out_seq=0 2024-09-17T01:35:31.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.106+0000 7f3d54c00640 10 client.5532 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:31.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.109+0000 7f3d54c00640 1 -- 172.21.15.42:0/1782809281 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558af23a67b0 con 0x558af23a8f50 2024-09-17T01:35:31.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.109+0000 7f3d54c00640 10 client.5532 handle_command_reply: tid=0 2024-09-17T01:35:31.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.109+0000 7f3d75465740 1 client.5532 shutdown 2024-09-17T01:35:31.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.110+0000 7f3d75465740 1 -- 172.21.15.42:0/1782809281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fc1a60 msgr2=0x558af237c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.110+0000 7f3d75465740 1 --2- 172.21.15.42:0/1782809281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fc1a60 0x558af237c3d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3d60006b20 tx=0x7f3d600021b0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.110+0000 7f3d75465740 1 -- 172.21.15.42:0/1782809281 shutdown_connections 2024-09-17T01:35:31.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.110+0000 7f3d75465740 1 --2- 172.21.15.42:0/1782809281 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558af23a8f50 0x558af237c910 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.110+0000 7f3d75465740 1 --2- 172.21.15.42:0/1782809281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558af1fa0d80 0x558af242ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.110+0000 7f3d75465740 1 --2- 172.21.15.42:0/1782809281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558af1fc1a60 0x558af237c3d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.110+0000 7f3d75465740 1 --2- 172.21.15.42:0/1782809281 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558af1f98ba0 0x558af242f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.110+0000 7f3d54c00640 0 client.5532 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:31.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.110+0000 7f3d75465740 1 -- 172.21.15.42:0/1782809281 >> 172.21.15.42:0/1782809281 conn(0x558af1fb5bb0 msgr2=0x558af2392500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:31.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.110+0000 7f3d75465740 1 -- 172.21.15.42:0/1782809281 shutdown_connections 2024-09-17T01:35:31.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.110+0000 7f3d75465740 1 -- 172.21.15.42:0/1782809281 wait complete. 2024-09-17T01:35:31.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.110+0000 7f3d75465740 20 client.5532 trim_cache size 0 max 16384 2024-09-17T01:35:31.110 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:31.110 INFO:teuthology.orchestra.run.smithi042.stdout: "message": "", 2024-09-17T01:35:31.110 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0 2024-09-17T01:35:31.110 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:31.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.111+0000 7f3d6ce00640 1 -- 172.21.15.42:0/135144976 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3d44078b90 msgr2=0x7f3d4407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.111+0000 7f3d6ce00640 1 --2- 172.21.15.42:0/135144976 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3d44078b90 0x7f3d4407b0a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3d6815b7a0 tx=0x7f3d50005f00 comp rx=0 tx=0).stop 2024-09-17T01:35:31.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.111+0000 7f3d6ce00640 1 -- 172.21.15.42:0/135144976 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d4c005350 msgr2=0x7f3d6814ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.111+0000 7f3d6ce00640 1 --2- 172.21.15.42:0/135144976 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d4c005350 0x7f3d6814ac90 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3d58003f50 tx=0x7f3d580016f0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.111+0000 7f3d6ce00640 1 -- 172.21.15.42:0/135144976 shutdown_connections 2024-09-17T01:35:31.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.111+0000 7f3d6ce00640 1 --2- 172.21.15.42:0/135144976 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3d44078b90 0x7f3d4407b0a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.111+0000 7f3d6ce00640 1 --2- 172.21.15.42:0/135144976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d6814d3a0 0x7f3d68159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.111+0000 7f3d6ce00640 1 --2- 172.21.15.42:0/135144976 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3d6814ca50 0x7f3d6814ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.111+0000 7f3d6ce00640 1 --2- 172.21.15.42:0/135144976 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d4c005350 0x7f3d6814ac90 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.111+0000 7f3d6ce00640 1 -- 172.21.15.42:0/135144976 >> 172.21.15.42:0/135144976 conn(0x7f3d6806d440 msgr2=0x7f3d68074540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:31.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.111+0000 7f3d6ce00640 1 -- 172.21.15.42:0/135144976 shutdown_connections 2024-09-17T01:35:31.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.111+0000 7f3d6ce00640 1 -- 172.21.15.42:0/135144976 wait complete. 2024-09-17T01:35:31.132 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'message': '', 'return_code': 0}' 2024-09-17T01:35:31.132 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-17T01:35:31.133 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-17T01:35:31.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.364+0000 7fb185e00640 1 -- 172.21.15.42:0/2161385976 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1800d2810 msgr2=0x7fb18015e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.364+0000 7fb185e00640 1 --2- 172.21.15.42:0/2161385976 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1800d2810 0x7fb18015e910 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb16c009830 tx=0x7fb16c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.364+0000 7fb185e00640 1 -- 172.21.15.42:0/2161385976 shutdown_connections 2024-09-17T01:35:31.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.364+0000 7fb185e00640 1 --2- 172.21.15.42:0/2161385976 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1800d2810 0x7fb18015e910 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.364+0000 7fb185e00640 1 -- 172.21.15.42:0/2161385976 >> 172.21.15.42:0/2161385976 conn(0x7fb1800d1210 msgr2=0x7fb1800d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:31.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.364+0000 7fb185e00640 1 -- 172.21.15.42:0/2161385976 shutdown_connections 2024-09-17T01:35:31.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.364+0000 7fb185e00640 1 -- 172.21.15.42:0/2161385976 wait complete. 2024-09-17T01:35:31.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.367+0000 7fb185e00640 1 Processor -- start 2024-09-17T01:35:31.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.367+0000 7fb185e00640 1 -- start start 2024-09-17T01:35:31.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.368+0000 7fb185e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb180073340 0x7fb18014f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.368+0000 7fb185e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1800b6030 0x7fb1801f92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.368+0000 7fb185e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1800d2810 0x7fb1801f97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.368+0000 7fb185e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb18015faa0 con 0x7fb1800d2810 2024-09-17T01:35:31.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.368+0000 7fb185e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb18015f920 con 0x7fb1800b6030 2024-09-17T01:35:31.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.368+0000 7fb185e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb18015fc20 con 0x7fb180073340 2024-09-17T01:35:31.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.368+0000 7fb185400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1800d2810 0x7fb1801f97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.368+0000 7fb184a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb180073340 0x7fb18014f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.368+0000 7fb185400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1800d2810 0x7fb1801f97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37494/0 (socket says 172.21.15.42:37494) 2024-09-17T01:35:31.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.368+0000 7fb185400640 1 -- 172.21.15.42:0/488022399 learned_addr learned my addr 172.21.15.42:0/488022399 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:31.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.368+0000 7fb17fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1800b6030 0x7fb1801f92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.369+0000 7fb185400640 1 -- 172.21.15.42:0/488022399 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb180073340 msgr2=0x7fb18014f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.369+0000 7fb185400640 1 --2- 172.21.15.42:0/488022399 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb180073340 0x7fb18014f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.369+0000 7fb185400640 1 -- 172.21.15.42:0/488022399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1800b6030 msgr2=0x7fb1801f92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.369+0000 7fb185400640 1 --2- 172.21.15.42:0/488022399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1800b6030 0x7fb1801f92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.369+0000 7fb185400640 1 -- 172.21.15.42:0/488022399 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb180161740 con 0x7fb1800d2810 2024-09-17T01:35:31.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.369+0000 7fb185400640 1 --2- 172.21.15.42:0/488022399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1800d2810 0x7fb1801f97f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb178002230 tx=0x7fb17800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:31.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.369+0000 7fb17cc00640 1 -- 172.21.15.42:0/488022399 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb178003b70 con 0x7fb1800d2810 2024-09-17T01:35:31.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.370+0000 7fb17cc00640 1 -- 172.21.15.42:0/488022399 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb178003d10 con 0x7fb1800d2810 2024-09-17T01:35:31.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.370+0000 7fb17cc00640 1 -- 172.21.15.42:0/488022399 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb178005330 con 0x7fb1800d2810 2024-09-17T01:35:31.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.370+0000 7fb185e00640 1 -- 172.21.15.42:0/488022399 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb180161a20 con 0x7fb1800d2810 2024-09-17T01:35:31.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.370+0000 7fb185e00640 1 -- 172.21.15.42:0/488022399 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1800ca070 con 0x7fb1800d2810 2024-09-17T01:35:31.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.372+0000 7fb17cc00640 1 -- 172.21.15.42:0/488022399 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb1780054d0 con 0x7fb1800d2810 2024-09-17T01:35:31.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.373+0000 7fb17cc00640 1 --2- 172.21.15.42:0/488022399 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb160078c10 0x7fb16007b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.373+0000 7fb17cc00640 1 -- 172.21.15.42:0/488022399 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fb17809a950 con 0x7fb1800d2810 2024-09-17T01:35:31.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.374+0000 7fb18e467740 1 Processor -- start 2024-09-17T01:35:31.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.374+0000 7fb184a00640 1 --2- 172.21.15.42:0/488022399 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb160078c10 0x7fb16007b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.374+0000 7fb18e467740 1 -- start start 2024-09-17T01:35:31.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.374+0000 7fb184a00640 1 --2- 172.21.15.42:0/488022399 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb160078c10 0x7fb16007b120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb174000f60 tx=0x7fb174009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:31.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.375+0000 7fb18e467740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5575a2e9ca90 0x5575a3289000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.375+0000 7fb18e467740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575a2e73bd0 0x5575a325de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.375+0000 7fb18e467740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e7bdb0 0x5575a325e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.375+0000 7fb18e467740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5575a31b6d80 con 0x5575a2e7bdb0 2024-09-17T01:35:31.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.375+0000 7fb18e467740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5575a31a61b0 con 0x5575a2e73bd0 2024-09-17T01:35:31.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.375+0000 7fb18e467740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5575a31a9fc0 con 0x5575a2e9ca90 2024-09-17T01:35:31.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.375+0000 7fb185400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e7bdb0 0x5575a325e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.375+0000 7fb185400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e7bdb0 0x5575a325e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37508/0 (socket says 172.21.15.42:37508) 2024-09-17T01:35:31.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.375+0000 7fb185400640 1 -- 172.21.15.42:0/2970211584 learned_addr learned my addr 172.21.15.42:0/2970211584 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:31.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.376+0000 7fb184a00640 1 --2- 172.21.15.42:0/2970211584 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5575a2e9ca90 0x5575a3289000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.376+0000 7fb17fe00640 1 --2- 172.21.15.42:0/2970211584 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575a2e73bd0 0x5575a325de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.376+0000 7fb185400640 1 -- 172.21.15.42:0/2970211584 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5575a2e9ca90 msgr2=0x5575a3289000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.376+0000 7fb185400640 1 --2- 172.21.15.42:0/2970211584 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5575a2e9ca90 0x5575a3289000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.376+0000 7fb185400640 1 -- 172.21.15.42:0/2970211584 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575a2e73bd0 msgr2=0x5575a325de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.376+0000 7fb185400640 1 --2- 172.21.15.42:0/2970211584 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575a2e73bd0 0x5575a325de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.376+0000 7fb185400640 1 -- 172.21.15.42:0/2970211584 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575a2f80f00 con 0x5575a2e7bdb0 2024-09-17T01:35:31.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.376+0000 7fb185400640 1 --2- 172.21.15.42:0/2970211584 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e7bdb0 0x5575a325e390 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb178062740 tx=0x7fb178061f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1edb43212156ac server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:31.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.376+0000 7fb171200640 1 -- 172.21.15.42:0/2970211584 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1780671e0 con 0x5575a2e7bdb0 2024-09-17T01:35:31.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.376+0000 7fb171200640 1 -- 172.21.15.42:0/2970211584 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb17806c090 con 0x5575a2e7bdb0 2024-09-17T01:35:31.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.376+0000 7fb171200640 1 -- 172.21.15.42:0/2970211584 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb178006d90 con 0x5575a2e7bdb0 2024-09-17T01:35:31.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.377+0000 7fb18e467740 1 -- 172.21.15.42:0/2970211584 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e7bdb0 msgr2=0x5575a325e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.377+0000 7fb18e467740 1 --2- 172.21.15.42:0/2970211584 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e7bdb0 0x5575a325e390 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb178062740 tx=0x7fb178061f20 comp rx=0 tx=0).stop 2024-09-17T01:35:31.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.377+0000 7fb18e467740 1 -- 172.21.15.42:0/2970211584 shutdown_connections 2024-09-17T01:35:31.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.377+0000 7fb18e467740 1 --2- 172.21.15.42:0/2970211584 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575a2e73bd0 0x5575a325de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.377+0000 7fb18e467740 1 --2- 172.21.15.42:0/2970211584 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e7bdb0 0x5575a325e390 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.377+0000 7fb18e467740 1 --2- 172.21.15.42:0/2970211584 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5575a2e9ca90 0x5575a3289000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.377+0000 7fb18e467740 1 -- 172.21.15.42:0/2970211584 >> 172.21.15.42:0/2970211584 conn(0x5575a2e90be0 msgr2=0x5575a32442f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:31.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.377+0000 7fb18e467740 1 -- 172.21.15.42:0/2970211584 shutdown_connections 2024-09-17T01:35:31.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.377+0000 7fb18e467740 1 -- 172.21.15.42:0/2970211584 wait complete. 2024-09-17T01:35:31.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.378+0000 7fb18e467740 1 -- start start 2024-09-17T01:35:31.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.378+0000 7fb18e467740 1 Processor -- start 2024-09-17T01:35:31.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.380+0000 7fb18e467740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e73bd0 0x5575a327f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.380+0000 7fb18e467740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5575a2e7bdb0 0x5575a3283a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.380+0000 7fb18e467740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575a2e9ca90 0x5575a325c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.380+0000 7fb18e467740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5575a2f16e40 con 0x5575a2e73bd0 2024-09-17T01:35:31.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.380+0000 7fb18e467740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5575a314bb30 con 0x5575a2e9ca90 2024-09-17T01:35:31.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.380+0000 7fb18e467740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5575a3284490 con 0x5575a2e7bdb0 2024-09-17T01:35:31.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.380+0000 7fb18e467740 10 client.0 _ll_register_callbacks cb 0x5575a319f640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:31.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.380+0000 7fb184a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e73bd0 0x5575a327f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.380+0000 7fb184a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e73bd0 0x5575a327f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37520/0 (socket says 172.21.15.42:37520) 2024-09-17T01:35:31.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.380+0000 7fb184a00640 1 -- 172.21.15.42:0/1157496894 learned_addr learned my addr 172.21.15.42:0/1157496894 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:31.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.380+0000 7fb185400640 1 --2- 172.21.15.42:0/1157496894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575a2e9ca90 0x5575a325c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.380+0000 7fb17fe00640 1 --2- 172.21.15.42:0/1157496894 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5575a2e7bdb0 0x5575a3283a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.381+0000 7fb184a00640 1 -- 172.21.15.42:0/1157496894 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5575a2e7bdb0 msgr2=0x5575a3283a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.381+0000 7fb184a00640 1 --2- 172.21.15.42:0/1157496894 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5575a2e7bdb0 0x5575a3283a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.381+0000 7fb184a00640 1 -- 172.21.15.42:0/1157496894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575a2e9ca90 msgr2=0x5575a325c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.381+0000 7fb184a00640 1 --2- 172.21.15.42:0/1157496894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575a2e9ca90 0x5575a325c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.381+0000 7fb184a00640 1 -- 172.21.15.42:0/1157496894 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575a2ee5da0 con 0x5575a2e73bd0 2024-09-17T01:35:31.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.381+0000 7fb184a00640 1 --2- 172.21.15.42:0/1157496894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e73bd0 0x5575a327f590 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb174014730 tx=0x7fb174000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4f3149691f9bbc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:31.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.381+0000 7fb165600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:31.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.381+0000 7fb165600640 1 -- 172.21.15.42:0/1157496894 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1740013e0 con 0x5575a2e73bd0 2024-09-17T01:35:31.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.381+0000 7fb165600640 1 -- 172.21.15.42:0/1157496894 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fb1740135c0 con 0x5575a2e73bd0 2024-09-17T01:35:31.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.381+0000 7fb18e467740 1 -- 172.21.15.42:0/1157496894 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb17806c090 con 0x5575a2e73bd0 2024-09-17T01:35:31.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.382+0000 7fb165600640 1 -- 172.21.15.42:0/1157496894 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb17402e050 con 0x5575a2e73bd0 2024-09-17T01:35:31.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.382+0000 7fb18e467740 10 client.5547 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:31.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.382+0000 7fb18e467740 1 -- 172.21.15.42:0/1157496894 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x5575a2fe1690 con 0x5575a2e73bd0 2024-09-17T01:35:31.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.382+0000 7fb165600640 1 -- 172.21.15.42:0/1157496894 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb17806c090 con 0x5575a2e73bd0 2024-09-17T01:35:31.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.382+0000 7fb165600640 1 -- 172.21.15.42:0/1157496894 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7fb174031020 con 0x5575a2e73bd0 2024-09-17T01:35:31.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.382+0000 7fb18e467740 10 client.5547 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:31.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.382+0000 7fb18e467740 10 client.5547 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:31.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.382+0000 7fb18e467740 20 client.5547 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:31.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.382+0000 7fb18e467740 1 --2- 172.21.15.42:0/1157496894 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5575a2e5b660 0x5575a3246500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.382+0000 7fb18e467740 4 client.5547 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:31.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.382+0000 7fb18e467740 1 -- 172.21.15.42:0/1157496894 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575a31b8cd0 con 0x5575a2e5b660 2024-09-17T01:35:31.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.382+0000 7fb17fe00640 1 --2- 172.21.15.42:0/1157496894 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5575a2e5b660 0x5575a3246500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.383+0000 7fb17fe00640 1 --2- 172.21.15.42:0/1157496894 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5575a2e5b660 0x5575a3246500 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2106c2df81ad5848 server_cookie=a029f7db45f967c8 in_seq=0 out_seq=0 2024-09-17T01:35:31.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.383+0000 7fb165600640 10 client.5547 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:31.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.384+0000 7fb165600640 1 -- 172.21.15.42:0/1157496894 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5575a31b8cd0 con 0x5575a2e5b660 2024-09-17T01:35:31.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.384+0000 7fb165600640 10 client.5547 handle_command_reply: tid=0 2024-09-17T01:35:31.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.384+0000 7fb18e467740 1 client.5547 shutdown 2024-09-17T01:35:31.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.384+0000 7fb18e467740 1 -- 172.21.15.42:0/1157496894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e73bd0 msgr2=0x5575a327f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.384+0000 7fb18e467740 1 --2- 172.21.15.42:0/1157496894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e73bd0 0x5575a327f590 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb174014730 tx=0x7fb174000ed0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.384+0000 7fb18e467740 1 -- 172.21.15.42:0/1157496894 shutdown_connections 2024-09-17T01:35:31.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.384+0000 7fb18e467740 1 --2- 172.21.15.42:0/1157496894 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5575a2e5b660 0x5575a3246500 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.384+0000 7fb18e467740 1 --2- 172.21.15.42:0/1157496894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575a2e9ca90 0x5575a325c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.384+0000 7fb18e467740 1 --2- 172.21.15.42:0/1157496894 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5575a2e7bdb0 0x5575a3283a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.384+0000 7fb165600640 0 client.5547 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:31.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.384+0000 7fb18e467740 1 --2- 172.21.15.42:0/1157496894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e73bd0 0x5575a327f590 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.384+0000 7fb18e467740 1 -- 172.21.15.42:0/1157496894 >> 172.21.15.42:0/1157496894 conn(0x5575a2e90be0 msgr2=0x5575a323e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:31.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.384+0000 7fb18e467740 1 -- 172.21.15.42:0/1157496894 shutdown_connections 2024-09-17T01:35:31.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.384+0000 7fb18e467740 1 -- 172.21.15.42:0/1157496894 wait complete. 2024-09-17T01:35:31.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.384+0000 7fb18e467740 20 client.5547 trim_cache size 0 max 16384 2024-09-17T01:35:31.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.403+0000 7fb18e467740 1 Processor -- start 2024-09-17T01:35:31.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.403+0000 7fb18e467740 1 -- start start 2024-09-17T01:35:31.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.405+0000 7fb18e467740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575a2e73bd0 0x5575a323e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.405+0000 7fb18e467740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5575a2e7bdb0 0x5575a323da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.405+0000 7fb18e467740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e9ca90 0x5575a326b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.405+0000 7fb18e467740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb180202040 con 0x5575a2e9ca90 2024-09-17T01:35:31.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.405+0000 7fb18e467740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb180161180 con 0x5575a2e73bd0 2024-09-17T01:35:31.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.405+0000 7fb18e467740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb1801604e0 con 0x5575a2e7bdb0 2024-09-17T01:35:31.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.405+0000 7fb185400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e9ca90 0x5575a326b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.405+0000 7fb185400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e9ca90 0x5575a326b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37534/0 (socket says 172.21.15.42:37534) 2024-09-17T01:35:31.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.405+0000 7fb185400640 1 -- 172.21.15.42:0/4240350359 learned_addr learned my addr 172.21.15.42:0/4240350359 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:31.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.405+0000 7fb184a00640 1 --2- 172.21.15.42:0/4240350359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575a2e73bd0 0x5575a323e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.405+0000 7fb17fe00640 1 --2- 172.21.15.42:0/4240350359 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5575a2e7bdb0 0x5575a323da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.405+0000 7fb185400640 1 -- 172.21.15.42:0/4240350359 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5575a2e7bdb0 msgr2=0x5575a323da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.405+0000 7fb185400640 1 --2- 172.21.15.42:0/4240350359 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5575a2e7bdb0 0x5575a323da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.405+0000 7fb185400640 1 -- 172.21.15.42:0/4240350359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575a2e73bd0 msgr2=0x5575a323e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.405+0000 7fb185400640 1 --2- 172.21.15.42:0/4240350359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575a2e73bd0 0x5575a323e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.405+0000 7fb185400640 1 -- 172.21.15.42:0/4240350359 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575a2f7f200 con 0x5575a2e9ca90 2024-09-17T01:35:31.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.406+0000 7fb185400640 1 --2- 172.21.15.42:0/4240350359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e9ca90 0x5575a326b720 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb178062740 tx=0x7fb178005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffc414eb45764d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:31.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.406+0000 7fb167e00640 1 -- 172.21.15.42:0/4240350359 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1780671e0 con 0x5575a2e9ca90 2024-09-17T01:35:31.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.406+0000 7fb167e00640 1 -- 172.21.15.42:0/4240350359 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb178001720 con 0x5575a2e9ca90 2024-09-17T01:35:31.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.406+0000 7fb167e00640 1 -- 172.21.15.42:0/4240350359 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17807ce20 con 0x5575a2e9ca90 2024-09-17T01:35:31.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.407+0000 7fb18e467740 1 -- 172.21.15.42:0/4240350359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e9ca90 msgr2=0x5575a326b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.407+0000 7fb18e467740 1 --2- 172.21.15.42:0/4240350359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e9ca90 0x5575a326b720 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb178062740 tx=0x7fb178005040 comp rx=0 tx=0).stop 2024-09-17T01:35:31.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.407+0000 7fb18e467740 1 -- 172.21.15.42:0/4240350359 shutdown_connections 2024-09-17T01:35:31.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.407+0000 7fb18e467740 1 --2- 172.21.15.42:0/4240350359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e9ca90 0x5575a326b720 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.407+0000 7fb18e467740 1 --2- 172.21.15.42:0/4240350359 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5575a2e7bdb0 0x5575a323da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.407+0000 7fb18e467740 1 --2- 172.21.15.42:0/4240350359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575a2e73bd0 0x5575a323e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.407+0000 7fb18e467740 1 -- 172.21.15.42:0/4240350359 >> 172.21.15.42:0/4240350359 conn(0x5575a2e90be0 msgr2=0x5575a3288c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:31.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.407+0000 7fb18e467740 1 -- 172.21.15.42:0/4240350359 shutdown_connections 2024-09-17T01:35:31.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.407+0000 7fb18e467740 1 -- 172.21.15.42:0/4240350359 wait complete. 2024-09-17T01:35:31.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.408+0000 7fb18e467740 1 -- start start 2024-09-17T01:35:31.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.408+0000 7fb18e467740 1 Processor -- start 2024-09-17T01:35:31.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.410+0000 7fb18e467740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5575a2e73bd0 0x5575a3308ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.410+0000 7fb18e467740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e7bdb0 0x5575a32ff710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.410+0000 7fb18e467740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575a2e9ca90 0x5575a330cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.410+0000 7fb18e467740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb180160b30 con 0x5575a2e7bdb0 2024-09-17T01:35:31.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.410+0000 7fb18e467740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5575a3246f40 con 0x5575a2e9ca90 2024-09-17T01:35:31.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.410+0000 7fb18e467740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5575a327f740 con 0x5575a2e73bd0 2024-09-17T01:35:31.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.410+0000 7fb18e467740 10 client.0 _ll_register_callbacks cb 0x7fb174017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:31.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.410+0000 7fb17fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e7bdb0 0x5575a32ff710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.410+0000 7fb17fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e7bdb0 0x5575a32ff710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37536/0 (socket says 172.21.15.42:37536) 2024-09-17T01:35:31.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.410+0000 7fb17fe00640 1 -- 172.21.15.42:0/4075795086 learned_addr learned my addr 172.21.15.42:0/4075795086 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:31.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.410+0000 7fb184a00640 1 --2- 172.21.15.42:0/4075795086 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5575a2e73bd0 0x5575a3308ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.410+0000 7fb185400640 1 --2- 172.21.15.42:0/4075795086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575a2e9ca90 0x5575a330cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.410+0000 7fb17fe00640 1 -- 172.21.15.42:0/4075795086 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5575a2e73bd0 msgr2=0x5575a3308ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.410+0000 7fb17fe00640 1 --2- 172.21.15.42:0/4075795086 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5575a2e73bd0 0x5575a3308ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.410+0000 7fb17fe00640 1 -- 172.21.15.42:0/4075795086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575a2e9ca90 msgr2=0x5575a330cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.410+0000 7fb17fe00640 1 --2- 172.21.15.42:0/4075795086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575a2e9ca90 0x5575a330cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.410+0000 7fb17fe00640 1 -- 172.21.15.42:0/4075795086 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575a330c660 con 0x5575a2e7bdb0 2024-09-17T01:35:31.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.411+0000 7fb17fe00640 1 --2- 172.21.15.42:0/4075795086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e7bdb0 0x5575a32ff710 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb16c009830 tx=0x7fb16c02aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1502353c356c18 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:31.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.411+0000 7fb165600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:31.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.411+0000 7fb165600640 1 -- 172.21.15.42:0/4075795086 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c005220 con 0x5575a2e7bdb0 2024-09-17T01:35:31.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.411+0000 7fb165600640 1 -- 172.21.15.42:0/4075795086 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fb16c0053c0 con 0x5575a2e7bdb0 2024-09-17T01:35:31.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.411+0000 7fb18e467740 1 -- 172.21.15.42:0/4075795086 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb178001720 con 0x5575a2e7bdb0 2024-09-17T01:35:31.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.411+0000 7fb165600640 1 -- 172.21.15.42:0/4075795086 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb16c056050 con 0x5575a2e7bdb0 2024-09-17T01:35:31.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.411+0000 7fb18e467740 10 client.5553 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:31.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.411+0000 7fb18e467740 1 -- 172.21.15.42:0/4075795086 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x5575a3309650 con 0x5575a2e7bdb0 2024-09-17T01:35:31.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.412+0000 7fb165600640 1 -- 172.21.15.42:0/4075795086 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb178001720 con 0x5575a2e7bdb0 2024-09-17T01:35:31.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.412+0000 7fb165600640 1 -- 172.21.15.42:0/4075795086 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7fb16c059020 con 0x5575a2e7bdb0 2024-09-17T01:35:31.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.412+0000 7fb18e467740 10 client.5553 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:31.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.412+0000 7fb18e467740 10 client.5553 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:31.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.412+0000 7fb18e467740 20 client.5553 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:31.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.412+0000 7fb18e467740 1 --2- 172.21.15.42:0/4075795086 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5575a330d080 0x5575a326b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.412+0000 7fb18e467740 4 client.5553 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-17T01:35:31.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.412+0000 7fb18e467740 1 -- 172.21.15.42:0/4075795086 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x5575a31b4780 con 0x5575a330d080 2024-09-17T01:35:31.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.412+0000 7fb184a00640 1 --2- 172.21.15.42:0/4075795086 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5575a330d080 0x5575a326b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.413+0000 7fb184a00640 1 --2- 172.21.15.42:0/4075795086 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5575a330d080 0x5575a326b6b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74c0019a00540484 server_cookie=3f8b3e359f166217 in_seq=0 out_seq=0 2024-09-17T01:35:31.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.413+0000 7fb165600640 10 client.5553 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:31.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.414+0000 7fb165600640 1 -- 172.21.15.42:0/4075795086 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5575a31b4780 con 0x5575a330d080 2024-09-17T01:35:31.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.414+0000 7fb165600640 10 client.5553 handle_command_reply: tid=0 2024-09-17T01:35:31.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.414+0000 7fb18e467740 1 client.5553 shutdown 2024-09-17T01:35:31.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.414+0000 7fb18e467740 1 -- 172.21.15.42:0/4075795086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e7bdb0 msgr2=0x5575a32ff710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.414+0000 7fb18e467740 1 --2- 172.21.15.42:0/4075795086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e7bdb0 0x5575a32ff710 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb16c009830 tx=0x7fb16c02aba0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.414+0000 7fb18e467740 1 -- 172.21.15.42:0/4075795086 shutdown_connections 2024-09-17T01:35:31.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.414+0000 7fb18e467740 1 --2- 172.21.15.42:0/4075795086 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5575a330d080 0x5575a326b6b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.414+0000 7fb18e467740 1 --2- 172.21.15.42:0/4075795086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575a2e9ca90 0x5575a330cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.414+0000 7fb18e467740 1 --2- 172.21.15.42:0/4075795086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575a2e7bdb0 0x5575a32ff710 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.414+0000 7fb18e467740 1 --2- 172.21.15.42:0/4075795086 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5575a2e73bd0 0x5575a3308ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.414+0000 7fb165600640 0 client.5553 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:31.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.414+0000 7fb18e467740 1 -- 172.21.15.42:0/4075795086 >> 172.21.15.42:0/4075795086 conn(0x5575a2e90be0 msgr2=0x5575a323da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:31.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.414+0000 7fb18e467740 1 -- 172.21.15.42:0/4075795086 shutdown_connections 2024-09-17T01:35:31.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.414+0000 7fb18e467740 1 -- 172.21.15.42:0/4075795086 wait complete. 2024-09-17T01:35:31.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.414+0000 7fb18e467740 20 client.5553 trim_cache size 0 max 16384 2024-09-17T01:35:31.416 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:31.416 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-17T01:35:31.416 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "1ab47091-12eb-4ca6-b40a-fff283cd28c5", 2024-09-17T01:35:31.416 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-17T01:35:31.416 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:31.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.415+0000 7fb185e00640 1 -- 172.21.15.42:0/488022399 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb160078c10 msgr2=0x7fb16007b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.415+0000 7fb185e00640 1 --2- 172.21.15.42:0/488022399 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb160078c10 0x7fb16007b120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb174000f60 tx=0x7fb174009040 comp rx=0 tx=0).stop 2024-09-17T01:35:31.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.415+0000 7fb185e00640 1 -- 172.21.15.42:0/488022399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1800d2810 msgr2=0x7fb1801f97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.415+0000 7fb185e00640 1 --2- 172.21.15.42:0/488022399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1800d2810 0x7fb1801f97f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb178002230 tx=0x7fb17800cb90 comp rx=0 tx=0).stop 2024-09-17T01:35:31.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.415+0000 7fb185e00640 1 -- 172.21.15.42:0/488022399 shutdown_connections 2024-09-17T01:35:31.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.415+0000 7fb185e00640 1 --2- 172.21.15.42:0/488022399 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb160078c10 0x7fb16007b120 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.415+0000 7fb185e00640 1 --2- 172.21.15.42:0/488022399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1800b6030 0x7fb1801f92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.415+0000 7fb185e00640 1 --2- 172.21.15.42:0/488022399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1800d2810 0x7fb1801f97f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.415+0000 7fb185e00640 1 --2- 172.21.15.42:0/488022399 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb180073340 0x7fb18014f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.415+0000 7fb185e00640 1 -- 172.21.15.42:0/488022399 >> 172.21.15.42:0/488022399 conn(0x7fb1800d1210 msgr2=0x7fb1800d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:31.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.415+0000 7fb185e00640 1 -- 172.21.15.42:0/488022399 shutdown_connections 2024-09-17T01:35:31.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.415+0000 7fb185e00640 1 -- 172.21.15.42:0/488022399 wait complete. 2024-09-17T01:35:31.435 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '1ab47091-12eb-4ca6-b40a-fff283cd28c5', 'mode': 'asynchronous'}' 2024-09-17T01:35:31.435 INFO:tasks.cephfs.test_scrub_checks:First run: flushing base dir / 2024-09-17T01:35:31.435 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-17T01:35:31.435 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-17T01:35:31.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.665+0000 7f0f74e00640 1 -- 172.21.15.42:0/3541253605 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f700af910 msgr2=0x7f0f700ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.665+0000 7f0f74e00640 1 --2- 172.21.15.42:0/3541253605 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f700af910 0x7f0f700ccb90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0f60009830 tx=0x7f0f6002a480 comp rx=0 tx=0).stop 2024-09-17T01:35:31.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.665+0000 7f0f74e00640 1 -- 172.21.15.42:0/3541253605 shutdown_connections 2024-09-17T01:35:31.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.665+0000 7f0f74e00640 1 --2- 172.21.15.42:0/3541253605 >> v2:172.21.15.43:3300/0 conn(0x7f0f7015c6c0 0x7f0f700cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.665+0000 7f0f74e00640 1 --2- 172.21.15.42:0/3541253605 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f700af910 0x7f0f700ccb90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.665+0000 7f0f74e00640 1 -- 172.21.15.42:0/3541253605 >> 172.21.15.42:0/3541253605 conn(0x7f0f7006d440 msgr2=0x7f0f700b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:31.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.665+0000 7f0f74e00640 1 -- 172.21.15.42:0/3541253605 shutdown_connections 2024-09-17T01:35:31.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.665+0000 7f0f74e00640 1 -- 172.21.15.42:0/3541253605 wait complete. 2024-09-17T01:35:31.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.667+0000 7f0f74e00640 1 Processor -- start 2024-09-17T01:35:31.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.667+0000 7f0f74e00640 1 -- start start 2024-09-17T01:35:31.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.669+0000 7f0f74e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f700af910 0x7f0f700ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.669+0000 7f0f74e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f700b32b0 0x7f0f701f61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.669+0000 7f0f74e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f7015c6c0 0x7f0f701ef4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.669+0000 7f0f74e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7006e680 con 0x7f0f700b32b0 2024-09-17T01:35:31.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.669+0000 7f0f74e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7006e500 con 0x7f0f700af910 2024-09-17T01:35:31.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.669+0000 7f0f74e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0f7006e800 con 0x7f0f7015c6c0 2024-09-17T01:35:31.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.669+0000 7f0f6ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f700b32b0 0x7f0f701f61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.669+0000 7f0f6ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f700b32b0 0x7f0f701f61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37542/0 (socket says 172.21.15.42:37542) 2024-09-17T01:35:31.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.669+0000 7f0f6ea00640 1 -- 172.21.15.42:0/1340580850 learned_addr learned my addr 172.21.15.42:0/1340580850 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:31.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.669+0000 7f0f6f400640 1 --2- 172.21.15.42:0/1340580850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f700af910 0x7f0f700ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.669+0000 7f0f6fe00640 1 --2- 172.21.15.42:0/1340580850 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f7015c6c0 0x7f0f701ef4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.670+0000 7f0f6ea00640 1 -- 172.21.15.42:0/1340580850 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f7015c6c0 msgr2=0x7f0f701ef4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.670+0000 7f0f6ea00640 1 --2- 172.21.15.42:0/1340580850 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f7015c6c0 0x7f0f701ef4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.670+0000 7f0f6ea00640 1 -- 172.21.15.42:0/1340580850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f700af910 msgr2=0x7f0f700ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.670+0000 7f0f6ea00640 1 --2- 172.21.15.42:0/1340580850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f700af910 0x7f0f700ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.670+0000 7f0f6ea00640 1 -- 172.21.15.42:0/1340580850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f700ad610 con 0x7f0f700b32b0 2024-09-17T01:35:31.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.670+0000 7f0f6ea00640 1 --2- 172.21.15.42:0/1340580850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f700b32b0 0x7f0f701f61b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00ea20 tx=0x7f0f5c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:31.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.670+0000 7f0f67400640 1 -- 172.21.15.42:0/1340580850 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c00ce40 con 0x7f0f700b32b0 2024-09-17T01:35:31.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.670+0000 7f0f67400640 1 -- 172.21.15.42:0/1340580850 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f5c004020 con 0x7f0f700b32b0 2024-09-17T01:35:31.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.670+0000 7f0f74e00640 1 -- 172.21.15.42:0/1340580850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f700ad8f0 con 0x7f0f700b32b0 2024-09-17T01:35:31.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.670+0000 7f0f67400640 1 -- 172.21.15.42:0/1340580850 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c004470 con 0x7f0f700b32b0 2024-09-17T01:35:31.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.670+0000 7f0f74e00640 1 -- 172.21.15.42:0/1340580850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f700adeb0 con 0x7f0f700b32b0 2024-09-17T01:35:31.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.673+0000 7f0f67400640 1 -- 172.21.15.42:0/1340580850 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0f5c0035f0 con 0x7f0f700b32b0 2024-09-17T01:35:31.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.674+0000 7f0f67400640 1 --2- 172.21.15.42:0/1340580850 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0f50078bc0 0x7f0f5007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.674+0000 7f0f67400640 1 -- 172.21.15.42:0/1340580850 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f0f5c09b7b0 con 0x7f0f700b32b0 2024-09-17T01:35:31.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.674+0000 7f0f7cffd740 1 Processor -- start 2024-09-17T01:35:31.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.674+0000 7f0f6f400640 1 --2- 172.21.15.42:0/1340580850 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0f50078bc0 0x7f0f5007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.674+0000 7f0f7cffd740 1 -- start start 2024-09-17T01:35:31.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.675+0000 7f0f6f400640 1 --2- 172.21.15.42:0/1340580850 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0f50078bc0 0x7f0f5007b0d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0f60034000 tx=0x7f0f60004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:31.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.676+0000 7f0f7cffd740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5571e41da1e0 0x5571e45aac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.676+0000 7f0f7cffd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571e41b1320 0x5571e45ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.676+0000 7f0f7cffd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41b9500 0x5571e457b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.676+0000 7f0f7cffd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5571e4504500 con 0x5571e41b9500 2024-09-17T01:35:31.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.676+0000 7f0f7cffd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5571e44f46a0 con 0x5571e41b1320 2024-09-17T01:35:31.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.676+0000 7f0f7cffd740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5571e44e3ad0 con 0x5571e41da1e0 2024-09-17T01:35:31.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.676+0000 7f0f6fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41b9500 0x5571e457b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.676+0000 7f0f6fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41b9500 0x5571e457b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37546/0 (socket says 172.21.15.42:37546) 2024-09-17T01:35:31.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.676+0000 7f0f6fe00640 1 -- 172.21.15.42:0/486329298 learned_addr learned my addr 172.21.15.42:0/486329298 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:31.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.676+0000 7f0f6ea00640 1 --2- 172.21.15.42:0/486329298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571e41b1320 0x5571e45ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.676+0000 7f0f6f400640 1 --2- 172.21.15.42:0/486329298 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5571e41da1e0 0x5571e45aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.676+0000 7f0f6fe00640 1 -- 172.21.15.42:0/486329298 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5571e41da1e0 msgr2=0x5571e45aac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.676+0000 7f0f6fe00640 1 --2- 172.21.15.42:0/486329298 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5571e41da1e0 0x5571e45aac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.676+0000 7f0f6fe00640 1 -- 172.21.15.42:0/486329298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571e41b1320 msgr2=0x5571e45ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.676+0000 7f0f6fe00640 1 --2- 172.21.15.42:0/486329298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571e41b1320 0x5571e45ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.676+0000 7f0f6fe00640 1 -- 172.21.15.42:0/486329298 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571e44ac5f0 con 0x5571e41b9500 2024-09-17T01:35:31.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.676+0000 7f0f6ea00640 1 --2- 172.21.15.42:0/486329298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571e41b1320 0x5571e45ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:31.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.677+0000 7f0f6fe00640 1 --2- 172.21.15.42:0/486329298 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41b9500 0x5571e457b220 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800f1d0 tx=0x7f0f6800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2cb0012cfcb90c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:31.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.677+0000 7f0f5be00640 1 -- 172.21.15.42:0/486329298 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68018020 con 0x5571e41b9500 2024-09-17T01:35:31.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.677+0000 7f0f5be00640 1 -- 172.21.15.42:0/486329298 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f68014680 con 0x5571e41b9500 2024-09-17T01:35:31.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.677+0000 7f0f5be00640 1 -- 172.21.15.42:0/486329298 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68014ab0 con 0x5571e41b9500 2024-09-17T01:35:31.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.678+0000 7f0f7cffd740 1 -- 172.21.15.42:0/486329298 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41b9500 msgr2=0x5571e457b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.678+0000 7f0f7cffd740 1 --2- 172.21.15.42:0/486329298 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41b9500 0x5571e457b220 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800f1d0 tx=0x7f0f6800f690 comp rx=0 tx=0).stop 2024-09-17T01:35:31.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.678+0000 7f0f7cffd740 1 -- 172.21.15.42:0/486329298 shutdown_connections 2024-09-17T01:35:31.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.678+0000 7f0f7cffd740 1 --2- 172.21.15.42:0/486329298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571e41b1320 0x5571e45ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.678+0000 7f0f7cffd740 1 --2- 172.21.15.42:0/486329298 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41b9500 0x5571e457b220 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.678+0000 7f0f7cffd740 1 --2- 172.21.15.42:0/486329298 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5571e41da1e0 0x5571e45aac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.678+0000 7f0f7cffd740 1 -- 172.21.15.42:0/486329298 >> 172.21.15.42:0/486329298 conn(0x5571e41ce330 msgr2=0x5571e4580c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:31.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.678+0000 7f0f7cffd740 1 -- 172.21.15.42:0/486329298 shutdown_connections 2024-09-17T01:35:31.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.678+0000 7f0f7cffd740 1 -- 172.21.15.42:0/486329298 wait complete. 2024-09-17T01:35:31.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.679+0000 7f0f7cffd740 1 -- start start 2024-09-17T01:35:31.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.679+0000 7f0f7cffd740 1 Processor -- start 2024-09-17T01:35:31.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.681+0000 7f0f7cffd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41b1320 0x5571e45c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.681+0000 7f0f7cffd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571e41b9500 0x5571e45c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.681+0000 7f0f7cffd740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5571e41da1e0 0x5571e45d8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.681+0000 7f0f7cffd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5571e448a400 con 0x5571e41b1320 2024-09-17T01:35:31.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.681+0000 7f0f7cffd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5571e44e78e0 con 0x5571e41b9500 2024-09-17T01:35:31.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.681+0000 7f0f7cffd740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5571e4254590 con 0x5571e41da1e0 2024-09-17T01:35:31.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.681+0000 7f0f7cffd740 10 client.0 _ll_register_callbacks cb 0x5571e448f4f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:31.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.681+0000 7f0f6f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41b1320 0x5571e45c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.681+0000 7f0f6f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41b1320 0x5571e45c6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37552/0 (socket says 172.21.15.42:37552) 2024-09-17T01:35:31.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.681+0000 7f0f6f400640 1 -- 172.21.15.42:0/2999956669 learned_addr learned my addr 172.21.15.42:0/2999956669 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:31.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.681+0000 7f0f6fe00640 1 --2- 172.21.15.42:0/2999956669 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5571e41da1e0 0x5571e45d8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.681+0000 7f0f6ea00640 1 --2- 172.21.15.42:0/2999956669 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571e41b9500 0x5571e45c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.681+0000 7f0f6f400640 1 -- 172.21.15.42:0/2999956669 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5571e41da1e0 msgr2=0x5571e45d8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.681+0000 7f0f6f400640 1 --2- 172.21.15.42:0/2999956669 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5571e41da1e0 0x5571e45d8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.681+0000 7f0f6f400640 1 -- 172.21.15.42:0/2999956669 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571e41b9500 msgr2=0x5571e45c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.681+0000 7f0f6f400640 1 --2- 172.21.15.42:0/2999956669 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571e41b9500 0x5571e45c6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.681+0000 7f0f6f400640 1 -- 172.21.15.42:0/2999956669 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571e42457c0 con 0x5571e41b1320 2024-09-17T01:35:31.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.682+0000 7f0f6f400640 1 --2- 172.21.15.42:0/2999956669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41b1320 0x5571e45c6ab0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0f6002aa70 tx=0x7f0f60005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a2d14ff42d285d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:31.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.682+0000 7f0f58c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:31.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.682+0000 7f0f58c00640 1 -- 172.21.15.42:0/2999956669 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60003d00 con 0x5571e41b1320 2024-09-17T01:35:31.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.682+0000 7f0f58c00640 1 -- 172.21.15.42:0/2999956669 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f0f60052ad0 con 0x5571e41b1320 2024-09-17T01:35:31.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.682+0000 7f0f7cffd740 1 -- 172.21.15.42:0/2999956669 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f68014680 con 0x5571e41b1320 2024-09-17T01:35:31.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.682+0000 7f0f58c00640 1 -- 172.21.15.42:0/2999956669 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0f60052cd0 con 0x5571e41b1320 2024-09-17T01:35:31.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.682+0000 7f0f7cffd740 10 client.5565 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:31.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.682+0000 7f0f7cffd740 1 -- 172.21.15.42:0/2999956669 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x5571e42bc620 con 0x5571e41b1320 2024-09-17T01:35:31.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.682+0000 7f0f58c00640 1 -- 172.21.15.42:0/2999956669 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f68014680 con 0x5571e41b1320 2024-09-17T01:35:31.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.683+0000 7f0f58c00640 1 -- 172.21.15.42:0/2999956669 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f0f60043040 con 0x5571e41b1320 2024-09-17T01:35:31.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.683+0000 7f0f7cffd740 10 client.5565 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:31.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.683+0000 7f0f7cffd740 10 client.5565 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:31.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.683+0000 7f0f7cffd740 20 client.5565 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:31.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.683+0000 7f0f7cffd740 1 --2- 172.21.15.42:0/2999956669 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5571e4198fc0 0x5571e45a3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.683+0000 7f0f7cffd740 4 client.5565 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:31.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.683+0000 7f0f7cffd740 1 -- 172.21.15.42:0/2999956669 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571e44f65f0 con 0x5571e4198fc0 2024-09-17T01:35:31.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.683+0000 7f0f6ea00640 1 --2- 172.21.15.42:0/2999956669 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5571e4198fc0 0x5571e45a3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.683+0000 7f0f6ea00640 1 --2- 172.21.15.42:0/2999956669 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5571e4198fc0 0x5571e45a3e20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=feb75a15f41d23c5 server_cookie=74294e26b6f04bac in_seq=0 out_seq=0 2024-09-17T01:35:31.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.683+0000 7f0f58c00640 10 client.5565 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:31.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.684+0000 7f0f58c00640 1 -- 172.21.15.42:0/2999956669 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5571e44f65f0 con 0x5571e4198fc0 2024-09-17T01:35:31.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.684+0000 7f0f58c00640 10 client.5565 handle_command_reply: tid=0 2024-09-17T01:35:31.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.684+0000 7f0f7cffd740 1 client.5565 shutdown 2024-09-17T01:35:31.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.684+0000 7f0f7cffd740 1 -- 172.21.15.42:0/2999956669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41b1320 msgr2=0x5571e45c6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.684+0000 7f0f7cffd740 1 --2- 172.21.15.42:0/2999956669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41b1320 0x5571e45c6ab0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0f6002aa70 tx=0x7f0f60005f90 comp rx=0 tx=0).stop 2024-09-17T01:35:31.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.685+0000 7f0f7cffd740 1 -- 172.21.15.42:0/2999956669 shutdown_connections 2024-09-17T01:35:31.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.685+0000 7f0f7cffd740 1 --2- 172.21.15.42:0/2999956669 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5571e4198fc0 0x5571e45a3e20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.685+0000 7f0f7cffd740 1 --2- 172.21.15.42:0/2999956669 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571e41b9500 0x5571e45c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.685+0000 7f0f7cffd740 1 --2- 172.21.15.42:0/2999956669 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5571e41da1e0 0x5571e45d8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.685+0000 7f0f7cffd740 1 --2- 172.21.15.42:0/2999956669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41b1320 0x5571e45c6ab0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.685+0000 7f0f7cffd740 1 -- 172.21.15.42:0/2999956669 >> 172.21.15.42:0/2999956669 conn(0x5571e41ce330 msgr2=0x5571e457c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:31.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.685+0000 7f0f58c00640 0 client.5565 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:31.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.685+0000 7f0f7cffd740 1 -- 172.21.15.42:0/2999956669 shutdown_connections 2024-09-17T01:35:31.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.685+0000 7f0f7cffd740 1 -- 172.21.15.42:0/2999956669 wait complete. 2024-09-17T01:35:31.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.685+0000 7f0f7cffd740 20 client.5565 trim_cache size 0 max 16384 2024-09-17T01:35:31.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.701+0000 7f0f7cffd740 1 Processor -- start 2024-09-17T01:35:31.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.701+0000 7f0f7cffd740 1 -- start start 2024-09-17T01:35:31.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.703+0000 7f0f7cffd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41b1320 0x5571e45c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.703+0000 7f0f7cffd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571e41b9500 0x5571e45c7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.703+0000 7f0f7cffd740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5571e41da1e0 0x5571e463fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.703+0000 7f0f7cffd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0f70202000 con 0x5571e41b1320 2024-09-17T01:35:31.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.703+0000 7f0f7cffd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0f702010b0 con 0x5571e41b9500 2024-09-17T01:35:31.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.703+0000 7f0f7cffd740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0f701f9070 con 0x5571e41da1e0 2024-09-17T01:35:31.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.703+0000 7f0f6f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41b1320 0x5571e45c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.703+0000 7f0f6f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41b1320 0x5571e45c6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37562/0 (socket says 172.21.15.42:37562) 2024-09-17T01:35:31.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.703+0000 7f0f6f400640 1 -- 172.21.15.42:0/2017932416 learned_addr learned my addr 172.21.15.42:0/2017932416 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:31.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.703+0000 7f0f6ea00640 1 --2- 172.21.15.42:0/2017932416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571e41b9500 0x5571e45c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.703+0000 7f0f6fe00640 1 --2- 172.21.15.42:0/2017932416 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5571e41da1e0 0x5571e463fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.704+0000 7f0f6f400640 1 -- 172.21.15.42:0/2017932416 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5571e41da1e0 msgr2=0x5571e463fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.704+0000 7f0f6f400640 1 --2- 172.21.15.42:0/2017932416 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5571e41da1e0 0x5571e463fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.704+0000 7f0f6f400640 1 -- 172.21.15.42:0/2017932416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571e41b9500 msgr2=0x5571e45c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.704+0000 7f0f6f400640 1 --2- 172.21.15.42:0/2017932416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571e41b9500 0x5571e45c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.704+0000 7f0f6f400640 1 -- 172.21.15.42:0/2017932416 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571e4581910 con 0x5571e41b1320 2024-09-17T01:35:31.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.704+0000 7f0f6f400640 1 --2- 172.21.15.42:0/2017932416 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41b1320 0x5571e45c6bd0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0f600039b0 tx=0x7f0f60003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ed53f7f29690e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:31.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.704+0000 7f0f5b400640 1 -- 172.21.15.42:0/2017932416 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6004a070 con 0x5571e41b1320 2024-09-17T01:35:31.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.704+0000 7f0f5b400640 1 -- 172.21.15.42:0/2017932416 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f6005f020 con 0x5571e41b1320 2024-09-17T01:35:31.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.704+0000 7f0f5b400640 1 -- 172.21.15.42:0/2017932416 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60005020 con 0x5571e41b1320 2024-09-17T01:35:31.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.705+0000 7f0f7cffd740 1 -- 172.21.15.42:0/2017932416 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41b1320 msgr2=0x5571e45c6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.705+0000 7f0f7cffd740 1 --2- 172.21.15.42:0/2017932416 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41b1320 0x5571e45c6bd0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0f600039b0 tx=0x7f0f60003d00 comp rx=0 tx=0).stop 2024-09-17T01:35:31.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.705+0000 7f0f7cffd740 1 -- 172.21.15.42:0/2017932416 shutdown_connections 2024-09-17T01:35:31.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.705+0000 7f0f7cffd740 1 --2- 172.21.15.42:0/2017932416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571e41b9500 0x5571e45c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.705+0000 7f0f7cffd740 1 --2- 172.21.15.42:0/2017932416 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5571e41da1e0 0x5571e463fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.705+0000 7f0f7cffd740 1 --2- 172.21.15.42:0/2017932416 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41b1320 0x5571e45c6bd0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.705+0000 7f0f7cffd740 1 -- 172.21.15.42:0/2017932416 >> 172.21.15.42:0/2017932416 conn(0x5571e41ce330 msgr2=0x5571e4594960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:31.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.705+0000 7f0f7cffd740 1 -- 172.21.15.42:0/2017932416 shutdown_connections 2024-09-17T01:35:31.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.705+0000 7f0f7cffd740 1 -- 172.21.15.42:0/2017932416 wait complete. 2024-09-17T01:35:31.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.706+0000 7f0f7cffd740 1 -- start start 2024-09-17T01:35:31.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.707+0000 7f0f7cffd740 1 Processor -- start 2024-09-17T01:35:31.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.708+0000 7f0f7cffd740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5571e41b1320 0x5571e463f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.708+0000 7f0f7cffd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571e41b9500 0x5571e45dac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.708+0000 7f0f7cffd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41da1e0 0x5571e45db140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.708+0000 7f0f7cffd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5571e45e9030 con 0x5571e41da1e0 2024-09-17T01:35:31.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.708+0000 7f0f7cffd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0f701f96c0 con 0x5571e41b9500 2024-09-17T01:35:31.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.708+0000 7f0f7cffd740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5571e45a16c0 con 0x5571e41b1320 2024-09-17T01:35:31.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.708+0000 7f0f7cffd740 10 client.0 _ll_register_callbacks cb 0x7f0f600045d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:31.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.708+0000 7f0f6fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41da1e0 0x5571e45db140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.708+0000 7f0f6fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41da1e0 0x5571e45db140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37578/0 (socket says 172.21.15.42:37578) 2024-09-17T01:35:31.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.708+0000 7f0f6fe00640 1 -- 172.21.15.42:0/1773499136 learned_addr learned my addr 172.21.15.42:0/1773499136 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:31.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.709+0000 7f0f6fe00640 1 -- 172.21.15.42:0/1773499136 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5571e41b1320 msgr2=0x5571e463f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.709+0000 7f0f6f400640 1 --2- 172.21.15.42:0/1773499136 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5571e41b1320 0x5571e463f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.709+0000 7f0f6ea00640 1 --2- 172.21.15.42:0/1773499136 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571e41b9500 0x5571e45dac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.709+0000 7f0f6fe00640 1 --2- 172.21.15.42:0/1773499136 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5571e41b1320 0x5571e463f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.709+0000 7f0f6fe00640 1 -- 172.21.15.42:0/1773499136 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571e41b9500 msgr2=0x5571e45dac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.709+0000 7f0f6fe00640 1 --2- 172.21.15.42:0/1773499136 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571e41b9500 0x5571e45dac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.709+0000 7f0f6fe00640 1 -- 172.21.15.42:0/1773499136 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571e463fc40 con 0x5571e41da1e0 2024-09-17T01:35:31.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.709+0000 7f0f6f400640 1 --2- 172.21.15.42:0/1773499136 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5571e41b1320 0x5571e463f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:31.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.709+0000 7f0f6ea00640 1 --2- 172.21.15.42:0/1773499136 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571e41b9500 0x5571e45dac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:31.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.709+0000 7f0f6fe00640 1 --2- 172.21.15.42:0/1773499136 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41da1e0 0x5571e45db140 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0f68000f80 tx=0x7f0f68014b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a11764ed8cd07b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:31.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.709+0000 7f0f58c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:31.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.709+0000 7f0f58c00640 1 -- 172.21.15.42:0/1773499136 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68018040 con 0x5571e41da1e0 2024-09-17T01:35:31.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.709+0000 7f0f58c00640 1 -- 172.21.15.42:0/1773499136 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f0f68004a40 con 0x5571e41da1e0 2024-09-17T01:35:31.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.709+0000 7f0f7cffd740 1 -- 172.21.15.42:0/1773499136 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f6005f020 con 0x5571e41da1e0 2024-09-17T01:35:31.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.710+0000 7f0f58c00640 1 -- 172.21.15.42:0/1773499136 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0f68031050 con 0x5571e41da1e0 2024-09-17T01:35:31.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.710+0000 7f0f7cffd740 10 client.5571 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:31.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.710+0000 7f0f7cffd740 1 -- 172.21.15.42:0/1773499136 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x5571e4646de0 con 0x5571e41da1e0 2024-09-17T01:35:31.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.710+0000 7f0f58c00640 1 -- 172.21.15.42:0/1773499136 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f6005f020 con 0x5571e41da1e0 2024-09-17T01:35:31.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.710+0000 7f0f58c00640 1 -- 172.21.15.42:0/1773499136 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f0f68034020 con 0x5571e41da1e0 2024-09-17T01:35:31.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.710+0000 7f0f7cffd740 10 client.5571 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:31.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.710+0000 7f0f7cffd740 10 client.5571 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:31.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.710+0000 7f0f7cffd740 20 client.5571 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:31.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.710+0000 7f0f7cffd740 1 --2- 172.21.15.42:0/1773499136 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5571e45e7cd0 0x5571e45e80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.710+0000 7f0f7cffd740 4 client.5571 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-17T01:35:31.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.710+0000 7f0f7cffd740 1 -- 172.21.15.42:0/1773499136 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x5571e44f20a0 con 0x5571e45e7cd0 2024-09-17T01:35:31.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.710+0000 7f0f6f400640 1 --2- 172.21.15.42:0/1773499136 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5571e45e7cd0 0x5571e45e80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.711+0000 7f0f6f400640 1 --2- 172.21.15.42:0/1773499136 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5571e45e7cd0 0x5571e45e80e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d533fa0339ff60a server_cookie=bdadeb6cd3c1a443 in_seq=0 out_seq=0 2024-09-17T01:35:31.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.711+0000 7f0f58c00640 10 client.5571 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:31.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.714+0000 7f0f58c00640 1 -- 172.21.15.42:0/1773499136 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5571e44f20a0 con 0x5571e45e7cd0 2024-09-17T01:35:31.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.714+0000 7f0f58c00640 10 client.5571 handle_command_reply: tid=0 2024-09-17T01:35:31.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.714+0000 7f0f7cffd740 1 client.5571 shutdown 2024-09-17T01:35:31.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.714+0000 7f0f7cffd740 1 -- 172.21.15.42:0/1773499136 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41da1e0 msgr2=0x5571e45db140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.714+0000 7f0f7cffd740 1 --2- 172.21.15.42:0/1773499136 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41da1e0 0x5571e45db140 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0f68000f80 tx=0x7f0f68014b70 comp rx=0 tx=0).stop 2024-09-17T01:35:31.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.714+0000 7f0f7cffd740 1 -- 172.21.15.42:0/1773499136 shutdown_connections 2024-09-17T01:35:31.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.714+0000 7f0f7cffd740 1 --2- 172.21.15.42:0/1773499136 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5571e45e7cd0 0x5571e45e80e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.714+0000 7f0f7cffd740 1 --2- 172.21.15.42:0/1773499136 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5571e41b9500 0x5571e45dac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.714+0000 7f0f7cffd740 1 --2- 172.21.15.42:0/1773499136 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5571e41da1e0 0x5571e45db140 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.714+0000 7f0f58c00640 0 client.5571 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:31.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.714+0000 7f0f7cffd740 1 --2- 172.21.15.42:0/1773499136 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5571e41b1320 0x5571e463f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.714+0000 7f0f7cffd740 1 -- 172.21.15.42:0/1773499136 >> 172.21.15.42:0/1773499136 conn(0x5571e41ce330 msgr2=0x5571e45a4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:31.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.714+0000 7f0f7cffd740 1 -- 172.21.15.42:0/1773499136 shutdown_connections 2024-09-17T01:35:31.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.714+0000 7f0f7cffd740 1 -- 172.21.15.42:0/1773499136 wait complete. 2024-09-17T01:35:31.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.714+0000 7f0f7cffd740 20 client.5571 trim_cache size 0 max 16384 2024-09-17T01:35:31.717 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:31.717 INFO:teuthology.orchestra.run.smithi042.stdout: "message": "", 2024-09-17T01:35:31.717 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0 2024-09-17T01:35:31.717 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:31.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.715+0000 7f0f74e00640 1 -- 172.21.15.42:0/1340580850 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0f50078bc0 msgr2=0x7f0f5007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.715+0000 7f0f74e00640 1 --2- 172.21.15.42:0/1340580850 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0f50078bc0 0x7f0f5007b0d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0f60034000 tx=0x7f0f60004730 comp rx=0 tx=0).stop 2024-09-17T01:35:31.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.715+0000 7f0f74e00640 1 -- 172.21.15.42:0/1340580850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f700b32b0 msgr2=0x7f0f701f61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.715+0000 7f0f74e00640 1 --2- 172.21.15.42:0/1340580850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f700b32b0 0x7f0f701f61b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00ea20 tx=0x7f0f5c00eee0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.715+0000 7f0f74e00640 1 -- 172.21.15.42:0/1340580850 shutdown_connections 2024-09-17T01:35:31.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.715+0000 7f0f74e00640 1 --2- 172.21.15.42:0/1340580850 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0f50078bc0 0x7f0f5007b0d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.715+0000 7f0f74e00640 1 --2- 172.21.15.42:0/1340580850 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f7015c6c0 0x7f0f701ef4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.715+0000 7f0f74e00640 1 --2- 172.21.15.42:0/1340580850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f700b32b0 0x7f0f701f61b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.715+0000 7f0f74e00640 1 --2- 172.21.15.42:0/1340580850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f700af910 0x7f0f700ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.715+0000 7f0f74e00640 1 -- 172.21.15.42:0/1340580850 >> 172.21.15.42:0/1340580850 conn(0x7f0f7006d440 msgr2=0x7f0f7015a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:31.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.715+0000 7f0f74e00640 1 -- 172.21.15.42:0/1340580850 shutdown_connections 2024-09-17T01:35:31.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.715+0000 7f0f74e00640 1 -- 172.21.15.42:0/1340580850 wait complete. 2024-09-17T01:35:31.735 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-17T01:35:31.735 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-09-17T01:35:31.735 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-09-17T01:35:31.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.965+0000 7f4913400640 1 -- 172.21.15.42:0/3558380587 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f490c0cec40 msgr2=0x7f490c0cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.965+0000 7f4913400640 1 --2- 172.21.15.42:0/3558380587 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f490c0cec40 0x7f490c0cf050 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f490c071ef0 tx=0x7f490402aa30 comp rx=0 tx=0).stop 2024-09-17T01:35:31.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.965+0000 7f4913400640 1 -- 172.21.15.42:0/3558380587 shutdown_connections 2024-09-17T01:35:31.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.965+0000 7f4913400640 1 --2- 172.21.15.42:0/3558380587 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f490c0cec40 0x7f490c0cf050 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.965+0000 7f4913400640 1 --2- 172.21.15.42:0/3558380587 >> v2:172.21.15.43:3300/0 conn(0x7f490c0b3550 0x7f490c15cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.965+0000 7f4913400640 1 -- 172.21.15.42:0/3558380587 >> 172.21.15.42:0/3558380587 conn(0x7f490c0b2930 msgr2=0x7f490c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:31.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.965+0000 7f4913400640 1 -- 172.21.15.42:0/3558380587 shutdown_connections 2024-09-17T01:35:31.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.965+0000 7f4913400640 1 -- 172.21.15.42:0/3558380587 wait complete. 2024-09-17T01:35:31.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.968+0000 7f4913400640 1 Processor -- start 2024-09-17T01:35:31.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.968+0000 7f4913400640 1 -- start start 2024-09-17T01:35:31.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.969+0000 7f4913400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f490c0b3550 0x7f490c0c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.969+0000 7f4913400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f490c0cec40 0x7f490c1f9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.969+0000 7f4913400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f490c142f40 0x7f490c0aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.969+0000 7f4913400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f490c06d7c0 con 0x7f490c0b3550 2024-09-17T01:35:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.969+0000 7f4913400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f490c06d640 con 0x7f490c0cec40 2024-09-17T01:35:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.969+0000 7f4913400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f490c06d940 con 0x7f490c142f40 2024-09-17T01:35:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.970+0000 7f4910a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f490c0b3550 0x7f490c0c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.970+0000 7f4910a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f490c0b3550 0x7f490c0c7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37584/0 (socket says 172.21.15.42:37584) 2024-09-17T01:35:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.970+0000 7f4910a00640 1 -- 172.21.15.42:0/1906630229 learned_addr learned my addr 172.21.15.42:0/1906630229 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.970+0000 7f4911400640 1 --2- 172.21.15.42:0/1906630229 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f490c142f40 0x7f490c0aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.970+0000 7f4903e00640 1 --2- 172.21.15.42:0/1906630229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f490c0cec40 0x7f490c1f9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.970+0000 7f4910a00640 1 -- 172.21.15.42:0/1906630229 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f490c142f40 msgr2=0x7f490c0aefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.970+0000 7f4910a00640 1 --2- 172.21.15.42:0/1906630229 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f490c142f40 0x7f490c0aefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.970+0000 7f4910a00640 1 -- 172.21.15.42:0/1906630229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f490c0cec40 msgr2=0x7f490c1f9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.970+0000 7f4910a00640 1 --2- 172.21.15.42:0/1906630229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f490c0cec40 0x7f490c1f9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.970+0000 7f4910a00640 1 -- 172.21.15.42:0/1906630229 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f490c1f6440 con 0x7f490c0b3550 2024-09-17T01:35:31.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.970+0000 7f4910a00640 1 --2- 172.21.15.42:0/1906630229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f490c0b3550 0x7f490c0c7ac0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f48fc00e7c0 tx=0x7f48fc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:31.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.971+0000 7f4909600640 1 -- 172.21.15.42:0/1906630229 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc00ccc0 con 0x7f490c0b3550 2024-09-17T01:35:31.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.971+0000 7f4909600640 1 -- 172.21.15.42:0/1906630229 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48fc00ce80 con 0x7f490c0b3550 2024-09-17T01:35:31.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.971+0000 7f4909600640 1 -- 172.21.15.42:0/1906630229 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc005280 con 0x7f490c0b3550 2024-09-17T01:35:31.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.971+0000 7f4913400640 1 -- 172.21.15.42:0/1906630229 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f490c1f6720 con 0x7f490c0b3550 2024-09-17T01:35:31.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.971+0000 7f4913400640 1 -- 172.21.15.42:0/1906630229 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f490c1f6ce0 con 0x7f490c0b3550 2024-09-17T01:35:31.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.973+0000 7f4909600640 1 -- 172.21.15.42:0/1906630229 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f48fc005420 con 0x7f490c0b3550 2024-09-17T01:35:31.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.974+0000 7f4909600640 1 --2- 172.21.15.42:0/1906630229 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f48e8078bc0 0x7f48e807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.975+0000 7f4909600640 1 -- 172.21.15.42:0/1906630229 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f48fc09b600 con 0x7f490c0b3550 2024-09-17T01:35:31.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.975+0000 7f491a453740 1 Processor -- start 2024-09-17T01:35:31.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.975+0000 7f491a453740 1 -- start start 2024-09-17T01:35:31.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.975+0000 7f4903e00640 1 --2- 172.21.15.42:0/1906630229 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f48e8078bc0 0x7f48e807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.976+0000 7f4903e00640 1 --2- 172.21.15.42:0/1906630229 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f48e8078bc0 0x7f48e807b0d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f490c074680 tx=0x7f48f4009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:31.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.976+0000 7f491a453740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab58a220 0x5627ab978e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.976+0000 7f491a453740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5627ab561360 0x5627ab95bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.976+0000 7f491a453740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5627ab569540 0x5627ab95c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.976+0000 7f491a453740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5627ab8a4850 con 0x5627ab58a220 2024-09-17T01:35:31.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.976+0000 7f491a453740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5627ab893c80 con 0x5627ab569540 2024-09-17T01:35:31.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.976+0000 7f491a453740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5627ab897a90 con 0x5627ab561360 2024-09-17T01:35:31.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.977+0000 7f4910a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab58a220 0x5627ab978e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.977+0000 7f4910a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab58a220 0x5627ab978e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37596/0 (socket says 172.21.15.42:37596) 2024-09-17T01:35:31.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.977+0000 7f4910a00640 1 -- 172.21.15.42:0/2594602835 learned_addr learned my addr 172.21.15.42:0/2594602835 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:31.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.977+0000 7f4903e00640 1 --2- 172.21.15.42:0/2594602835 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5627ab561360 0x5627ab95bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.977+0000 7f4911400640 1 --2- 172.21.15.42:0/2594602835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5627ab569540 0x5627ab95c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.977+0000 7f4910a00640 1 -- 172.21.15.42:0/2594602835 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5627ab561360 msgr2=0x5627ab95bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.977+0000 7f4910a00640 1 --2- 172.21.15.42:0/2594602835 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5627ab561360 0x5627ab95bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.977+0000 7f4910a00640 1 -- 172.21.15.42:0/2594602835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5627ab569540 msgr2=0x5627ab95c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.977+0000 7f4910a00640 1 --2- 172.21.15.42:0/2594602835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5627ab569540 0x5627ab95c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.977+0000 7f4910a00640 1 -- 172.21.15.42:0/2594602835 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627ab586280 con 0x5627ab58a220 2024-09-17T01:35:31.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.977+0000 7f4910a00640 1 --2- 172.21.15.42:0/2594602835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab58a220 0x5627ab978e50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f48fc063370 tx=0x7f48fc062b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2cbb9adceeb2f6c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:31.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.977+0000 7f4901200640 1 -- 172.21.15.42:0/2594602835 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc067e10 con 0x5627ab58a220 2024-09-17T01:35:31.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.978+0000 7f4901200640 1 -- 172.21.15.42:0/2594602835 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48fc06ccc0 con 0x5627ab58a220 2024-09-17T01:35:31.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.978+0000 7f4901200640 1 -- 172.21.15.42:0/2594602835 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc06ca30 con 0x5627ab58a220 2024-09-17T01:35:31.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.978+0000 7f491a453740 1 -- 172.21.15.42:0/2594602835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab58a220 msgr2=0x5627ab978e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.978+0000 7f491a453740 1 --2- 172.21.15.42:0/2594602835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab58a220 0x5627ab978e50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f48fc063370 tx=0x7f48fc062b50 comp rx=0 tx=0).stop 2024-09-17T01:35:31.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.978+0000 7f491a453740 1 -- 172.21.15.42:0/2594602835 shutdown_connections 2024-09-17T01:35:31.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.978+0000 7f491a453740 1 --2- 172.21.15.42:0/2594602835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5627ab569540 0x5627ab95c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.978+0000 7f491a453740 1 --2- 172.21.15.42:0/2594602835 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5627ab561360 0x5627ab95bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.978+0000 7f491a453740 1 --2- 172.21.15.42:0/2594602835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab58a220 0x5627ab978e50 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.978+0000 7f491a453740 1 -- 172.21.15.42:0/2594602835 >> 172.21.15.42:0/2594602835 conn(0x5627ab57e370 msgr2=0x5627ab931d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:31.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.979+0000 7f491a453740 1 -- 172.21.15.42:0/2594602835 shutdown_connections 2024-09-17T01:35:31.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.979+0000 7f491a453740 1 -- 172.21.15.42:0/2594602835 wait complete. 2024-09-17T01:35:31.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.980+0000 7f491a453740 1 -- start start 2024-09-17T01:35:31.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.980+0000 7f491a453740 1 Processor -- start 2024-09-17T01:35:31.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.981+0000 7f491a453740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5627ab561360 0x5627ab94a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.981+0000 7f491a453740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5627ab569540 0x5627ab970ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.981+0000 7f491a453740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab58a220 0x5627ab957980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.981+0000 7f491a453740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5627ab6045d0 con 0x5627ab58a220 2024-09-17T01:35:31.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.981+0000 7f491a453740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5627ab839550 con 0x5627ab569540 2024-09-17T01:35:31.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.981+0000 7f491a453740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5627ab9857d0 con 0x5627ab561360 2024-09-17T01:35:31.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.982+0000 7f491a453740 10 client.0 _ll_register_callbacks cb 0x5627ab88dfb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:31.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.982+0000 7f4911400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab58a220 0x5627ab957980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.982+0000 7f4910a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5627ab561360 0x5627ab94a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.982+0000 7f4903e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5627ab569540 0x5627ab970ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.982+0000 7f4910a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5627ab561360 0x5627ab94a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:57320/0 (socket says 172.21.15.42:57320) 2024-09-17T01:35:31.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.982+0000 7f4910a00640 1 -- 172.21.15.42:0/833500473 learned_addr learned my addr 172.21.15.42:0/833500473 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:31.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.982+0000 7f4911400640 1 -- 172.21.15.42:0/833500473 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5627ab561360 msgr2=0x5627ab94a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.982+0000 7f4911400640 1 --2- 172.21.15.42:0/833500473 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5627ab561360 0x5627ab94a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.982+0000 7f4911400640 1 -- 172.21.15.42:0/833500473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5627ab569540 msgr2=0x5627ab970ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:31.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.982+0000 7f4911400640 1 --2- 172.21.15.42:0/833500473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5627ab569540 0x5627ab970ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.982+0000 7f4911400640 1 -- 172.21.15.42:0/833500473 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627ab66e690 con 0x5627ab58a220 2024-09-17T01:35:31.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.982+0000 7f4910a00640 1 --2- 172.21.15.42:0/833500473 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5627ab561360 0x5627ab94a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:35:31.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.982+0000 7f4911400640 1 --2- 172.21.15.42:0/833500473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab58a220 0x5627ab957980 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4904032000 tx=0x7f490402f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0e0f2bd9d7a8f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:31.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.982+0000 7f48f9600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:31.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.983+0000 7f48f9600640 1 -- 172.21.15.42:0/833500473 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4904048060 con 0x5627ab58a220 2024-09-17T01:35:31.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.983+0000 7f48f9600640 1 -- 172.21.15.42:0/833500473 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f4904003d80 con 0x5627ab58a220 2024-09-17T01:35:31.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.983+0000 7f491a453740 1 -- 172.21.15.42:0/833500473 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48fc06ccc0 con 0x5627ab58a220 2024-09-17T01:35:31.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.983+0000 7f48f9600640 1 -- 172.21.15.42:0/833500473 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f490404e050 con 0x5627ab58a220 2024-09-17T01:35:31.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.983+0000 7f491a453740 10 client.5583 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:31.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.983+0000 7f491a453740 1 -- 172.21.15.42:0/833500473 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x5627ab6cee20 con 0x5627ab58a220 2024-09-17T01:35:31.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.983+0000 7f48f9600640 1 -- 172.21.15.42:0/833500473 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48fc06ccc0 con 0x5627ab58a220 2024-09-17T01:35:31.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.983+0000 7f48f9600640 1 -- 172.21.15.42:0/833500473 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f4904051020 con 0x5627ab58a220 2024-09-17T01:35:31.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.984+0000 7f491a453740 10 client.5583 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:31.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.984+0000 7f491a453740 10 client.5583 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:31.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.984+0000 7f491a453740 20 client.5583 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:31.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.984+0000 7f491a453740 1 --2- 172.21.15.42:0/833500473 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5627ab549000 0x5627ab954fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:31.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.984+0000 7f491a453740 4 client.5583 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:31.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.984+0000 7f491a453740 1 -- 172.21.15.42:0/833500473 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627ab8a67a0 con 0x5627ab549000 2024-09-17T01:35:31.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.984+0000 7f4910a00640 1 --2- 172.21.15.42:0/833500473 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5627ab549000 0x5627ab954fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:31.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.984+0000 7f4910a00640 1 --2- 172.21.15.42:0/833500473 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5627ab549000 0x5627ab954fd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25d5aa20c5d27900 server_cookie=dfb61e21dc1391ca in_seq=0 out_seq=0 2024-09-17T01:35:31.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.984+0000 7f48f9600640 10 client.5583 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:31.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.985+0000 7f48f9600640 1 -- 172.21.15.42:0/833500473 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5627ab8a67a0 con 0x5627ab549000 2024-09-17T01:35:31.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.985+0000 7f48f9600640 10 client.5583 handle_command_reply: tid=0 2024-09-17T01:35:31.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.985+0000 7f491a453740 1 client.5583 shutdown 2024-09-17T01:35:31.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.985+0000 7f491a453740 1 -- 172.21.15.42:0/833500473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab58a220 msgr2=0x5627ab957980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:31.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.985+0000 7f491a453740 1 --2- 172.21.15.42:0/833500473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab58a220 0x5627ab957980 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4904032000 tx=0x7f490402f770 comp rx=0 tx=0).stop 2024-09-17T01:35:31.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.985+0000 7f491a453740 1 -- 172.21.15.42:0/833500473 shutdown_connections 2024-09-17T01:35:31.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.985+0000 7f491a453740 1 --2- 172.21.15.42:0/833500473 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5627ab549000 0x5627ab954fd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.985+0000 7f491a453740 1 --2- 172.21.15.42:0/833500473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5627ab569540 0x5627ab970ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.985+0000 7f491a453740 1 --2- 172.21.15.42:0/833500473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab58a220 0x5627ab957980 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.985+0000 7f491a453740 1 --2- 172.21.15.42:0/833500473 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5627ab561360 0x5627ab94a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:31.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.985+0000 7f48f9600640 0 client.5583 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:31.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.985+0000 7f491a453740 1 -- 172.21.15.42:0/833500473 >> 172.21.15.42:0/833500473 conn(0x5627ab57e370 msgr2=0x5627ab931f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:31.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.986+0000 7f491a453740 1 -- 172.21.15.42:0/833500473 shutdown_connections 2024-09-17T01:35:31.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.986+0000 7f491a453740 1 -- 172.21.15.42:0/833500473 wait complete. 2024-09-17T01:35:31.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:31.986+0000 7f491a453740 20 client.5583 trim_cache size 0 max 16384 2024-09-17T01:35:32.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.005+0000 7f491a453740 1 Processor -- start 2024-09-17T01:35:32.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.005+0000 7f491a453740 1 -- start start 2024-09-17T01:35:32.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.006+0000 7f491a453740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5627ab561360 0x5627ab9536a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.006+0000 7f491a453740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab569540 0x5627ab95bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.006+0000 7f491a453740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5627ab58a220 0x5627ab95c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.006+0000 7f491a453740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f490c2023b0 con 0x5627ab569540 2024-09-17T01:35:32.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.006+0000 7f491a453740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f490c2013f0 con 0x5627ab561360 2024-09-17T01:35:32.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.006+0000 7f491a453740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f490c06ef70 con 0x5627ab58a220 2024-09-17T01:35:32.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.007+0000 7f4903e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab569540 0x5627ab95bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.007+0000 7f4903e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab569540 0x5627ab95bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37614/0 (socket says 172.21.15.42:37614) 2024-09-17T01:35:32.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.007+0000 7f4903e00640 1 -- 172.21.15.42:0/2264036114 learned_addr learned my addr 172.21.15.42:0/2264036114 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:32.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.007+0000 7f4910a00640 1 --2- 172.21.15.42:0/2264036114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5627ab561360 0x5627ab9536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.007+0000 7f4911400640 1 --2- 172.21.15.42:0/2264036114 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5627ab58a220 0x5627ab95c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.007+0000 7f4903e00640 1 -- 172.21.15.42:0/2264036114 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5627ab58a220 msgr2=0x5627ab95c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:32.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.007+0000 7f4903e00640 1 --2- 172.21.15.42:0/2264036114 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5627ab58a220 0x5627ab95c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.007+0000 7f4903e00640 1 -- 172.21.15.42:0/2264036114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5627ab561360 msgr2=0x5627ab9536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:32.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.007+0000 7f4903e00640 1 --2- 172.21.15.42:0/2264036114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5627ab561360 0x5627ab9536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.007+0000 7f4903e00640 1 -- 172.21.15.42:0/2264036114 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627ab5d3530 con 0x5627ab569540 2024-09-17T01:35:32.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.007+0000 7f4910a00640 1 --2- 172.21.15.42:0/2264036114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5627ab561360 0x5627ab9536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:32.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.007+0000 7f4911400640 1 --2- 172.21.15.42:0/2264036114 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5627ab58a220 0x5627ab95c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:32.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.007+0000 7f4903e00640 1 --2- 172.21.15.42:0/2264036114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab569540 0x5627ab95bb20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f48f400fb20 tx=0x7f48f4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e7926648dac922c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:32.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.008+0000 7f48fbe00640 1 -- 172.21.15.42:0/2264036114 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f4014ca0 con 0x5627ab569540 2024-09-17T01:35:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.008+0000 7f48fbe00640 1 -- 172.21.15.42:0/2264036114 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48f401b040 con 0x5627ab569540 2024-09-17T01:35:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.008+0000 7f48fbe00640 1 -- 172.21.15.42:0/2264036114 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f40236b0 con 0x5627ab569540 2024-09-17T01:35:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.008+0000 7f491a453740 1 -- 172.21.15.42:0/2264036114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab569540 msgr2=0x5627ab95bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.008+0000 7f491a453740 1 --2- 172.21.15.42:0/2264036114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab569540 0x5627ab95bb20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f48f400fb20 tx=0x7f48f4012000 comp rx=0 tx=0).stop 2024-09-17T01:35:32.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.008+0000 7f491a453740 1 -- 172.21.15.42:0/2264036114 shutdown_connections 2024-09-17T01:35:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.008+0000 7f491a453740 1 --2- 172.21.15.42:0/2264036114 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5627ab58a220 0x5627ab95c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.008+0000 7f491a453740 1 --2- 172.21.15.42:0/2264036114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab569540 0x5627ab95bb20 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.008+0000 7f491a453740 1 --2- 172.21.15.42:0/2264036114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5627ab561360 0x5627ab9536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.008+0000 7f491a453740 1 -- 172.21.15.42:0/2264036114 >> 172.21.15.42:0/2264036114 conn(0x5627ab57e370 msgr2=0x5627ab984dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.009+0000 7f491a453740 1 -- 172.21.15.42:0/2264036114 shutdown_connections 2024-09-17T01:35:32.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.009+0000 7f491a453740 1 -- 172.21.15.42:0/2264036114 wait complete. 2024-09-17T01:35:32.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.010+0000 7f491a453740 1 -- start start 2024-09-17T01:35:32.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.010+0000 7f491a453740 1 Processor -- start 2024-09-17T01:35:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.011+0000 7f491a453740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5627ab561360 0x5627ab9943e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.011+0000 7f491a453740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5627ab569540 0x5627ab95bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.011+0000 7f491a453740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab58a220 0x5627ab95c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.011+0000 7f491a453740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5627ab971820 con 0x5627ab58a220 2024-09-17T01:35:32.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.011+0000 7f491a453740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f490c200da0 con 0x5627ab569540 2024-09-17T01:35:32.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.011+0000 7f491a453740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5627ab953be0 con 0x5627ab561360 2024-09-17T01:35:32.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.011+0000 7f491a453740 10 client.0 _ll_register_callbacks cb 0x7f490402fdf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:32.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.012+0000 7f4911400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab58a220 0x5627ab95c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.012+0000 7f4911400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab58a220 0x5627ab95c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37624/0 (socket says 172.21.15.42:37624) 2024-09-17T01:35:32.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.012+0000 7f4911400640 1 -- 172.21.15.42:0/3917241592 learned_addr learned my addr 172.21.15.42:0/3917241592 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:32.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.012+0000 7f4903e00640 1 --2- 172.21.15.42:0/3917241592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5627ab569540 0x5627ab95bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.012+0000 7f4910a00640 1 --2- 172.21.15.42:0/3917241592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5627ab561360 0x5627ab9943e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.012+0000 7f4911400640 1 -- 172.21.15.42:0/3917241592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5627ab561360 msgr2=0x5627ab9943e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:32.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.012+0000 7f4911400640 1 --2- 172.21.15.42:0/3917241592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5627ab561360 0x5627ab9943e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.012+0000 7f4911400640 1 -- 172.21.15.42:0/3917241592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5627ab569540 msgr2=0x5627ab95bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:32.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.012+0000 7f4911400640 1 --2- 172.21.15.42:0/3917241592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5627ab569540 0x5627ab95bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.012+0000 7f4911400640 1 -- 172.21.15.42:0/3917241592 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627ab932bc0 con 0x5627ab58a220 2024-09-17T01:35:32.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.012+0000 7f4911400640 1 --2- 172.21.15.42:0/3917241592 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab58a220 0x5627ab95c060 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4904009bf0 tx=0x7f4904009590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc54a1aedf36abab server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:32.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.012+0000 7f48f9600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:32.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.013+0000 7f48f9600640 1 -- 172.21.15.42:0/3917241592 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4904057060 con 0x5627ab58a220 2024-09-17T01:35:32.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.013+0000 7f48f9600640 1 -- 172.21.15.42:0/3917241592 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f4904048820 con 0x5627ab58a220 2024-09-17T01:35:32.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.013+0000 7f491a453740 1 -- 172.21.15.42:0/3917241592 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48f401b040 con 0x5627ab58a220 2024-09-17T01:35:32.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.013+0000 7f48f9600640 1 -- 172.21.15.42:0/3917241592 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4904033040 con 0x5627ab58a220 2024-09-17T01:35:32.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.013+0000 7f491a453740 10 client.5589 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:32.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.013+0000 7f491a453740 1 -- 172.21.15.42:0/3917241592 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x5627ab92c330 con 0x5627ab58a220 2024-09-17T01:35:32.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.013+0000 7f48f9600640 1 -- 172.21.15.42:0/3917241592 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48f401b040 con 0x5627ab58a220 2024-09-17T01:35:32.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.013+0000 7f48f9600640 1 -- 172.21.15.42:0/3917241592 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f490404b070 con 0x5627ab58a220 2024-09-17T01:35:32.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.013+0000 7f491a453740 10 client.5589 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:32.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.013+0000 7f491a453740 10 client.5589 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:32.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.013+0000 7f491a453740 20 client.5589 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:32.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.013+0000 7f491a453740 1 --2- 172.21.15.42:0/3917241592 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5627ab952dc0 0x5627ab9f5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.013+0000 7f491a453740 4 client.5589 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-09-17T01:35:32.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.013+0000 7f491a453740 1 -- 172.21.15.42:0/3917241592 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) -- 0x5627ab8a2250 con 0x5627ab952dc0 2024-09-17T01:35:32.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.014+0000 7f4910a00640 1 --2- 172.21.15.42:0/3917241592 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5627ab952dc0 0x5627ab9f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.014+0000 7f4910a00640 1 --2- 172.21.15.42:0/3917241592 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5627ab952dc0 0x5627ab9f5670 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57a0bc3f94cc4956 server_cookie=948c5e1fc4bff92b in_seq=0 out_seq=0 2024-09-17T01:35:32.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.014+0000 7f48f9600640 10 client.5589 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:32.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.015+0000 7f48f9600640 1 -- 172.21.15.42:0/3917241592 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5627ab8a2250 con 0x5627ab952dc0 2024-09-17T01:35:32.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.015+0000 7f48f9600640 10 client.5589 handle_command_reply: tid=0 2024-09-17T01:35:32.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.015+0000 7f491a453740 1 client.5589 shutdown 2024-09-17T01:35:32.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.015+0000 7f491a453740 1 -- 172.21.15.42:0/3917241592 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab58a220 msgr2=0x5627ab95c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:32.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.015+0000 7f491a453740 1 --2- 172.21.15.42:0/3917241592 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab58a220 0x5627ab95c060 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4904009bf0 tx=0x7f4904009590 comp rx=0 tx=0).stop 2024-09-17T01:35:32.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.015+0000 7f491a453740 1 -- 172.21.15.42:0/3917241592 shutdown_connections 2024-09-17T01:35:32.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.015+0000 7f491a453740 1 --2- 172.21.15.42:0/3917241592 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5627ab952dc0 0x5627ab9f5670 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.015+0000 7f491a453740 1 --2- 172.21.15.42:0/3917241592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5627ab569540 0x5627ab95bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.015+0000 7f491a453740 1 --2- 172.21.15.42:0/3917241592 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5627ab58a220 0x5627ab95c060 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.015+0000 7f491a453740 1 --2- 172.21.15.42:0/3917241592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5627ab561360 0x5627ab9943e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.015+0000 7f48f9600640 0 client.5589 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:32.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.015+0000 7f491a453740 1 -- 172.21.15.42:0/3917241592 >> 172.21.15.42:0/3917241592 conn(0x5627ab57e370 msgr2=0x5627ab984dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:32.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.015+0000 7f491a453740 1 -- 172.21.15.42:0/3917241592 shutdown_connections 2024-09-17T01:35:32.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.015+0000 7f491a453740 1 -- 172.21.15.42:0/3917241592 wait complete. 2024-09-17T01:35:32.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.015+0000 7f491a453740 20 client.5589 trim_cache size 0 max 16384 2024-09-17T01:35:32.032 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:32.032 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-17T01:35:32.032 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "da914a30-cdfa-4ea8-b8dd-7b052b0b6e40", 2024-09-17T01:35:32.032 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-17T01:35:32.033 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:32.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.016+0000 7f4913400640 1 -- 172.21.15.42:0/1906630229 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f48e8078bc0 msgr2=0x7f48e807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:32.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.016+0000 7f4913400640 1 --2- 172.21.15.42:0/1906630229 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f48e8078bc0 0x7f48e807b0d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f490c074680 tx=0x7f48f4009040 comp rx=0 tx=0).stop 2024-09-17T01:35:32.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.016+0000 7f4913400640 1 -- 172.21.15.42:0/1906630229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f490c0b3550 msgr2=0x7f490c0c7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:32.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.016+0000 7f4913400640 1 --2- 172.21.15.42:0/1906630229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f490c0b3550 0x7f490c0c7ac0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f48fc00e7c0 tx=0x7f48fc00ec80 comp rx=0 tx=0).stop 2024-09-17T01:35:32.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.016+0000 7f4913400640 1 -- 172.21.15.42:0/1906630229 shutdown_connections 2024-09-17T01:35:32.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.016+0000 7f4913400640 1 --2- 172.21.15.42:0/1906630229 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f48e8078bc0 0x7f48e807b0d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.016+0000 7f4913400640 1 --2- 172.21.15.42:0/1906630229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f490c0cec40 0x7f490c1f9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.016+0000 7f4913400640 1 --2- 172.21.15.42:0/1906630229 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f490c142f40 0x7f490c0aefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.016+0000 7f4913400640 1 --2- 172.21.15.42:0/1906630229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f490c0b3550 0x7f490c0c7ac0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.016+0000 7f4913400640 1 -- 172.21.15.42:0/1906630229 >> 172.21.15.42:0/1906630229 conn(0x7f490c0b2930 msgr2=0x7f490c15af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:32.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.016+0000 7f4913400640 1 -- 172.21.15.42:0/1906630229 shutdown_connections 2024-09-17T01:35:32.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.016+0000 7f4913400640 1 -- 172.21.15.42:0/1906630229 wait complete. 2024-09-17T01:35:32.038 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': 'da914a30-cdfa-4ea8-b8dd-7b052b0b6e40', 'mode': 'asynchronous'}' 2024-09-17T01:35:32.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:35:32.039 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_0) 2024-09-17T01:35:32.076 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' 2024-09-17T01:35:32.076 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_dir_0 2024-09-17T01:35:32.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.344+0000 7fd974200640 1 -- 172.21.15.42:0/3051323628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd96c15cec0 msgr2=0x7fd96c15d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:32.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.344+0000 7fd974200640 1 --2- 172.21.15.42:0/3051323628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd96c15cec0 0x7fd96c15d2d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd960005fd0 tx=0x7fd96002a5d0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.344+0000 7fd974200640 1 -- 172.21.15.42:0/3051323628 shutdown_connections 2024-09-17T01:35:32.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.344+0000 7fd974200640 1 --2- 172.21.15.42:0/3051323628 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd96c0cecb0 0x7fd96c0cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.344+0000 7fd974200640 1 --2- 172.21.15.42:0/3051323628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd96c15cec0 0x7fd96c15d2d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.345+0000 7fd974200640 1 -- 172.21.15.42:0/3051323628 >> 172.21.15.42:0/3051323628 conn(0x7fd96c0b2930 msgr2=0x7fd96c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:32.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.345+0000 7fd974200640 1 -- 172.21.15.42:0/3051323628 shutdown_connections 2024-09-17T01:35:32.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.345+0000 7fd974200640 1 -- 172.21.15.42:0/3051323628 wait complete. 2024-09-17T01:35:32.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.347+0000 7fd974200640 1 Processor -- start 2024-09-17T01:35:32.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.347+0000 7fd974200640 1 -- start start 2024-09-17T01:35:32.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.349+0000 7fd974200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd96c072950 0x7fd96c156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.349+0000 7fd974200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd96c0cecb0 0x7fd96c153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.349+0000 7fd974200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd96c15cec0 0x7fd96c0c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.349+0000 7fd974200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd96c06dd50 con 0x7fd96c0cecb0 2024-09-17T01:35:32.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.349+0000 7fd974200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd96c072d60 con 0x7fd96c072950 2024-09-17T01:35:32.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.349+0000 7fd974200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd96c156fa0 con 0x7fd96c15cec0 2024-09-17T01:35:32.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.349+0000 7fd970e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd96c0cecb0 0x7fd96c153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.349+0000 7fd970e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd96c0cecb0 0x7fd96c153d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37644/0 (socket says 172.21.15.42:37644) 2024-09-17T01:35:32.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.349+0000 7fd971800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd96c072950 0x7fd96c156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.349+0000 7fd970e00640 1 -- 172.21.15.42:0/3173515262 learned_addr learned my addr 172.21.15.42:0/3173515262 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:32.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.349+0000 7fd972200640 1 --2- 172.21.15.42:0/3173515262 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd96c15cec0 0x7fd96c0c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.349+0000 7fd970e00640 1 -- 172.21.15.42:0/3173515262 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd96c15cec0 msgr2=0x7fd96c0c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:32.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.349+0000 7fd970e00640 1 --2- 172.21.15.42:0/3173515262 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd96c15cec0 0x7fd96c0c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.349+0000 7fd970e00640 1 -- 172.21.15.42:0/3173515262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd96c072950 msgr2=0x7fd96c156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:32.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.349+0000 7fd970e00640 1 --2- 172.21.15.42:0/3173515262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd96c072950 0x7fd96c156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.349+0000 7fd970e00640 1 -- 172.21.15.42:0/3173515262 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd96c06e360 con 0x7fd96c0cecb0 2024-09-17T01:35:32.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.350+0000 7fd970e00640 1 --2- 172.21.15.42:0/3173515262 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd96c0cecb0 0x7fd96c153d10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd95800e790 tx=0x7fd95800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:32.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.350+0000 7fd969600640 1 -- 172.21.15.42:0/3173515262 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95800eea0 con 0x7fd96c0cecb0 2024-09-17T01:35:32.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.350+0000 7fd969600640 1 -- 172.21.15.42:0/3173515262 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd95800cc60 con 0x7fd96c0cecb0 2024-09-17T01:35:32.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.350+0000 7fd969600640 1 -- 172.21.15.42:0/3173515262 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958005280 con 0x7fd96c0cecb0 2024-09-17T01:35:32.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.350+0000 7fd974200640 1 -- 172.21.15.42:0/3173515262 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd96c1574d0 con 0x7fd96c0cecb0 2024-09-17T01:35:32.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.350+0000 7fd974200640 1 -- 172.21.15.42:0/3173515262 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd96c06e600 con 0x7fd96c0cecb0 2024-09-17T01:35:32.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.352+0000 7fd969600640 1 -- 172.21.15.42:0/3173515262 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd958005420 con 0x7fd96c0cecb0 2024-09-17T01:35:32.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.353+0000 7fd969600640 1 --2- 172.21.15.42:0/3173515262 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd94c078b90 0x7fd94c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.353+0000 7fd969600640 1 -- 172.21.15.42:0/3173515262 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fd95809b510 con 0x7fd96c0cecb0 2024-09-17T01:35:32.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.354+0000 7fd971800640 1 --2- 172.21.15.42:0/3173515262 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd94c078b90 0x7fd94c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.354+0000 7fd97b276740 1 Processor -- start 2024-09-17T01:35:32.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.354+0000 7fd97b276740 1 -- start start 2024-09-17T01:35:32.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.354+0000 7fd971800640 1 --2- 172.21.15.42:0/3173515262 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd94c078b90 0x7fd94c07b0a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd960033000 tx=0x7fd960004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:32.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.355+0000 7fd97b276740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce99f750 0x5645ced68160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.355+0000 7fd97b276740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5645ce976890 0x5645ced686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.355+0000 7fd97b276740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5645ce97ea70 0x5645ced70ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.355+0000 7fd97b276740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5645cecb98d0 con 0x5645ce99f750 2024-09-17T01:35:32.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.355+0000 7fd97b276740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5645ceca8d00 con 0x5645ce976890 2024-09-17T01:35:32.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.355+0000 7fd97b276740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5645cecacb10 con 0x5645ce97ea70 2024-09-17T01:35:32.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.356+0000 7fd971800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce99f750 0x5645ced68160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.356+0000 7fd970e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5645ce976890 0x5645ced686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.356+0000 7fd971800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce99f750 0x5645ced68160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37658/0 (socket says 172.21.15.42:37658) 2024-09-17T01:35:32.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.356+0000 7fd970e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5645ce976890 0x5645ced686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:59034/0 (socket says 172.21.15.42:59034) 2024-09-17T01:35:32.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.356+0000 7fd971800640 1 -- 172.21.15.42:0/2425592912 learned_addr learned my addr 172.21.15.42:0/2425592912 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:32.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.356+0000 7fd972200640 1 --2- 172.21.15.42:0/2425592912 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5645ce97ea70 0x5645ced70ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.356+0000 7fd971800640 1 -- 172.21.15.42:0/2425592912 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5645ce97ea70 msgr2=0x5645ced70ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:32.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.356+0000 7fd971800640 1 --2- 172.21.15.42:0/2425592912 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5645ce97ea70 0x5645ced70ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.356+0000 7fd971800640 1 -- 172.21.15.42:0/2425592912 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5645ce976890 msgr2=0x5645ced686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:32.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.356+0000 7fd971800640 1 --2- 172.21.15.42:0/2425592912 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5645ce976890 0x5645ced686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.356+0000 7fd971800640 1 -- 172.21.15.42:0/2425592912 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645cea0ad30 con 0x5645ce99f750 2024-09-17T01:35:32.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.356+0000 7fd970e00640 1 --2- 172.21.15.42:0/2425592912 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5645ce976890 0x5645ced686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:35:32.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.356+0000 7fd971800640 1 --2- 172.21.15.42:0/2425592912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce99f750 0x5645ced68160 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd960006010 tx=0x7fd96003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c55042c11b81435 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:32.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.357+0000 7fd95e000640 1 -- 172.21.15.42:0/2425592912 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd960035040 con 0x5645ce99f750 2024-09-17T01:35:32.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.357+0000 7fd95e000640 1 -- 172.21.15.42:0/2425592912 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd96004d070 con 0x5645ce99f750 2024-09-17T01:35:32.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.357+0000 7fd95e000640 1 -- 172.21.15.42:0/2425592912 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd960003a80 con 0x5645ce99f750 2024-09-17T01:35:32.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.357+0000 7fd97b276740 1 -- 172.21.15.42:0/2425592912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce99f750 msgr2=0x5645ced68160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:32.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.357+0000 7fd97b276740 1 --2- 172.21.15.42:0/2425592912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce99f750 0x5645ced68160 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd960006010 tx=0x7fd96003d000 comp rx=0 tx=0).stop 2024-09-17T01:35:32.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.358+0000 7fd97b276740 1 -- 172.21.15.42:0/2425592912 shutdown_connections 2024-09-17T01:35:32.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.358+0000 7fd97b276740 1 --2- 172.21.15.42:0/2425592912 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5645ce976890 0x5645ced686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.358+0000 7fd97b276740 1 --2- 172.21.15.42:0/2425592912 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5645ce97ea70 0x5645ced70ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.358+0000 7fd97b276740 1 --2- 172.21.15.42:0/2425592912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce99f750 0x5645ced68160 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.358+0000 7fd97b276740 1 -- 172.21.15.42:0/2425592912 >> 172.21.15.42:0/2425592912 conn(0x5645ce9938a0 msgr2=0x5645ced46df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:32.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.358+0000 7fd97b276740 1 -- 172.21.15.42:0/2425592912 shutdown_connections 2024-09-17T01:35:32.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.358+0000 7fd97b276740 1 -- 172.21.15.42:0/2425592912 wait complete. 2024-09-17T01:35:32.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.359+0000 7fd97b276740 1 -- start start 2024-09-17T01:35:32.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.359+0000 7fd97b276740 1 Processor -- start 2024-09-17T01:35:32.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.360+0000 7fd97b276740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5645ce976890 0x5645ced852a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.360+0000 7fd97b276740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5645ce97ea70 0x5645ced9b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.360+0000 7fd97b276740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce99f750 0x5645ced9e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.360+0000 7fd97b276740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5645cea19b00 con 0x5645ce99f750 2024-09-17T01:35:32.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.360+0000 7fd97b276740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5645cec4f470 con 0x5645ce97ea70 2024-09-17T01:35:32.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.360+0000 7fd97b276740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5645ced563d0 con 0x5645ce976890 2024-09-17T01:35:32.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.360+0000 7fd97b276740 10 client.0 _ll_register_callbacks cb 0x5645cec546c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:32.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.361+0000 7fd972200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce99f750 0x5645ced9e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.361+0000 7fd972200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce99f750 0x5645ced9e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37672/0 (socket says 172.21.15.42:37672) 2024-09-17T01:35:32.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.361+0000 7fd972200640 1 -- 172.21.15.42:0/1323226738 learned_addr learned my addr 172.21.15.42:0/1323226738 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:32.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.361+0000 7fd971800640 1 --2- 172.21.15.42:0/1323226738 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5645ce976890 0x5645ced852a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.361+0000 7fd970e00640 1 --2- 172.21.15.42:0/1323226738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5645ce97ea70 0x5645ced9b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.361+0000 7fd972200640 1 -- 172.21.15.42:0/1323226738 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5645ce976890 msgr2=0x5645ced852a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:32.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.361+0000 7fd972200640 1 --2- 172.21.15.42:0/1323226738 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5645ce976890 0x5645ced852a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.361+0000 7fd972200640 1 -- 172.21.15.42:0/1323226738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5645ce97ea70 msgr2=0x5645ced9b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:32.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.361+0000 7fd972200640 1 --2- 172.21.15.42:0/1323226738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5645ce97ea70 0x5645ced9b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.361+0000 7fd972200640 1 -- 172.21.15.42:0/1323226738 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645cea81b90 con 0x5645ce99f750 2024-09-17T01:35:32.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.361+0000 7fd972200640 1 --2- 172.21.15.42:0/1323226738 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce99f750 0x5645ced9e810 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd964012530 tx=0x7fd964012930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec51720a7cea1b13 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:32.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.361+0000 7fd952a00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:32.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.362+0000 7fd952a00640 1 -- 172.21.15.42:0/1323226738 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd964006d60 con 0x5645ce99f750 2024-09-17T01:35:32.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.362+0000 7fd952a00640 1 -- 172.21.15.42:0/1323226738 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fd964003970 con 0x5645ce99f750 2024-09-17T01:35:32.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.362+0000 7fd97b276740 1 -- 172.21.15.42:0/1323226738 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd96004d070 con 0x5645ce99f750 2024-09-17T01:35:32.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.362+0000 7fd952a00640 1 -- 172.21.15.42:0/1323226738 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd964003bb0 con 0x5645ce99f750 2024-09-17T01:35:32.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.362+0000 7fd97b276740 10 client.5601 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:32.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.362+0000 7fd97b276740 1 -- 172.21.15.42:0/1323226738 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x5645ced56110 con 0x5645ce99f750 2024-09-17T01:35:32.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.362+0000 7fd952a00640 1 -- 172.21.15.42:0/1323226738 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd96004d070 con 0x5645ce99f750 2024-09-17T01:35:32.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.362+0000 7fd952a00640 1 -- 172.21.15.42:0/1323226738 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7fd964005110 con 0x5645ce99f750 2024-09-17T01:35:32.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.362+0000 7fd97b276740 10 client.5601 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:32.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.362+0000 7fd97b276740 10 client.5601 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:32.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.362+0000 7fd97b276740 20 client.5601 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:32.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.362+0000 7fd97b276740 1 --2- 172.21.15.42:0/1323226738 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5645ce95e320 0x5645ced9ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.362+0000 7fd97b276740 4 client.5601 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:32.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.362+0000 7fd97b276740 1 -- 172.21.15.42:0/1323226738 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645cecbb820 con 0x5645ce95e320 2024-09-17T01:35:32.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.363+0000 7fd971800640 1 --2- 172.21.15.42:0/1323226738 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5645ce95e320 0x5645ced9ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.363+0000 7fd971800640 1 --2- 172.21.15.42:0/1323226738 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5645ce95e320 0x5645ced9ed50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c418c7f15d7e7ef server_cookie=85da95f58bee4e4f in_seq=0 out_seq=0 2024-09-17T01:35:32.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.363+0000 7fd952a00640 10 client.5601 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:32.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.364+0000 7fd952a00640 1 -- 172.21.15.42:0/1323226738 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5645cecbb820 con 0x5645ce95e320 2024-09-17T01:35:32.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.364+0000 7fd952a00640 10 client.5601 handle_command_reply: tid=0 2024-09-17T01:35:32.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.364+0000 7fd97b276740 1 client.5601 shutdown 2024-09-17T01:35:32.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.364+0000 7fd97b276740 1 -- 172.21.15.42:0/1323226738 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce99f750 msgr2=0x5645ced9e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:32.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.364+0000 7fd97b276740 1 --2- 172.21.15.42:0/1323226738 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce99f750 0x5645ced9e810 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd964012530 tx=0x7fd964012930 comp rx=0 tx=0).stop 2024-09-17T01:35:32.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.364+0000 7fd97b276740 1 -- 172.21.15.42:0/1323226738 shutdown_connections 2024-09-17T01:35:32.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.364+0000 7fd97b276740 1 --2- 172.21.15.42:0/1323226738 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5645ce95e320 0x5645ced9ed50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.364+0000 7fd97b276740 1 --2- 172.21.15.42:0/1323226738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5645ce97ea70 0x5645ced9b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.364+0000 7fd97b276740 1 --2- 172.21.15.42:0/1323226738 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce99f750 0x5645ced9e810 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.364+0000 7fd97b276740 1 --2- 172.21.15.42:0/1323226738 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5645ce976890 0x5645ced852a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.364+0000 7fd952a00640 0 client.5601 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:32.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.364+0000 7fd97b276740 1 -- 172.21.15.42:0/1323226738 >> 172.21.15.42:0/1323226738 conn(0x5645ce9938a0 msgr2=0x5645ced46a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:32.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.365+0000 7fd97b276740 1 -- 172.21.15.42:0/1323226738 shutdown_connections 2024-09-17T01:35:32.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.365+0000 7fd97b276740 1 -- 172.21.15.42:0/1323226738 wait complete. 2024-09-17T01:35:32.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.365+0000 7fd97b276740 20 client.5601 trim_cache size 0 max 16384 2024-09-17T01:35:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.381+0000 7fd97b276740 1 Processor -- start 2024-09-17T01:35:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.381+0000 7fd97b276740 1 -- start start 2024-09-17T01:35:32.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.382+0000 7fd97b276740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5645ce976890 0x5645ced46c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.382+0000 7fd97b276740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce97ea70 0x5645cedadd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.382+0000 7fd97b276740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5645ce99f750 0x5645cedae260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.382+0000 7fd97b276740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd96c2023e0 con 0x5645ce97ea70 2024-09-17T01:35:32.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.382+0000 7fd97b276740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd96c201500 con 0x5645ce976890 2024-09-17T01:35:32.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.382+0000 7fd97b276740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd96c1f9360 con 0x5645ce99f750 2024-09-17T01:35:32.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.382+0000 7fd970e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce97ea70 0x5645cedadd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.382+0000 7fd970e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce97ea70 0x5645cedadd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37684/0 (socket says 172.21.15.42:37684) 2024-09-17T01:35:32.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.382+0000 7fd970e00640 1 -- 172.21.15.42:0/2940963804 learned_addr learned my addr 172.21.15.42:0/2940963804 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:32.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.382+0000 7fd971800640 1 --2- 172.21.15.42:0/2940963804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5645ce976890 0x5645ced46c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.383+0000 7fd972200640 1 --2- 172.21.15.42:0/2940963804 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5645ce99f750 0x5645cedae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.383+0000 7fd970e00640 1 -- 172.21.15.42:0/2940963804 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5645ce99f750 msgr2=0x5645cedae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:32.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.383+0000 7fd970e00640 1 --2- 172.21.15.42:0/2940963804 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5645ce99f750 0x5645cedae260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.383+0000 7fd970e00640 1 -- 172.21.15.42:0/2940963804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5645ce976890 msgr2=0x5645ced46c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:32.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.383+0000 7fd970e00640 1 --2- 172.21.15.42:0/2940963804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5645ce976890 0x5645ced46c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.383+0000 7fd970e00640 1 -- 172.21.15.42:0/2940963804 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645ced85460 con 0x5645ce97ea70 2024-09-17T01:35:32.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.383+0000 7fd970e00640 1 --2- 172.21.15.42:0/2940963804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce97ea70 0x5645cedadd20 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd9580999e0 tx=0x7fd958066040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc76b4e9b8e7debe server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:32.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.383+0000 7fd95d600640 1 -- 172.21.15.42:0/2940963804 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958099e60 con 0x5645ce97ea70 2024-09-17T01:35:32.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.383+0000 7fd95d600640 1 -- 172.21.15.42:0/2940963804 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd958067d30 con 0x5645ce97ea70 2024-09-17T01:35:32.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.383+0000 7fd95d600640 1 -- 172.21.15.42:0/2940963804 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95806ca00 con 0x5645ce97ea70 2024-09-17T01:35:32.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.384+0000 7fd97b276740 1 -- 172.21.15.42:0/2940963804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce97ea70 msgr2=0x5645cedadd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:32.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.384+0000 7fd97b276740 1 --2- 172.21.15.42:0/2940963804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce97ea70 0x5645cedadd20 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd9580999e0 tx=0x7fd958066040 comp rx=0 tx=0).stop 2024-09-17T01:35:32.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.384+0000 7fd97b276740 1 -- 172.21.15.42:0/2940963804 shutdown_connections 2024-09-17T01:35:32.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.384+0000 7fd97b276740 1 --2- 172.21.15.42:0/2940963804 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5645ce99f750 0x5645cedae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.384+0000 7fd97b276740 1 --2- 172.21.15.42:0/2940963804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce97ea70 0x5645cedadd20 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.384+0000 7fd97b276740 1 --2- 172.21.15.42:0/2940963804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5645ce976890 0x5645ced46c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.384+0000 7fd97b276740 1 -- 172.21.15.42:0/2940963804 >> 172.21.15.42:0/2940963804 conn(0x5645ce9938a0 msgr2=0x5645ced420d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:32.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.384+0000 7fd97b276740 1 -- 172.21.15.42:0/2940963804 shutdown_connections 2024-09-17T01:35:32.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.384+0000 7fd97b276740 1 -- 172.21.15.42:0/2940963804 wait complete. 2024-09-17T01:35:32.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.385+0000 7fd97b276740 1 -- start start 2024-09-17T01:35:32.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.385+0000 7fd97b276740 1 Processor -- start 2024-09-17T01:35:32.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.387+0000 7fd97b276740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5645ce976890 0x5645cedae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.387+0000 7fd97b276740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce97ea70 0x5645ceda4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.387+0000 7fd97b276740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5645ce99f750 0x5645ced82a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.387+0000 7fd97b276740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5645ced48380 con 0x5645ce97ea70 2024-09-17T01:35:32.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.387+0000 7fd97b276740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd96c1f99b0 con 0x5645ce99f750 2024-09-17T01:35:32.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.387+0000 7fd97b276740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5645ced9e690 con 0x5645ce976890 2024-09-17T01:35:32.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.387+0000 7fd97b276740 10 client.0 _ll_register_callbacks cb 0x7fd964002100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:32.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.387+0000 7fd970e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce97ea70 0x5645ceda4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.387+0000 7fd970e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce97ea70 0x5645ceda4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37690/0 (socket says 172.21.15.42:37690) 2024-09-17T01:35:32.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.387+0000 7fd970e00640 1 -- 172.21.15.42:0/1279181700 learned_addr learned my addr 172.21.15.42:0/1279181700 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:32.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.387+0000 7fd971800640 1 --2- 172.21.15.42:0/1279181700 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5645ce976890 0x5645cedae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.387+0000 7fd972200640 1 --2- 172.21.15.42:0/1279181700 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5645ce99f750 0x5645ced82a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.387+0000 7fd970e00640 1 -- 172.21.15.42:0/1279181700 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5645ce976890 msgr2=0x5645cedae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:32.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.387+0000 7fd970e00640 1 --2- 172.21.15.42:0/1279181700 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5645ce976890 0x5645cedae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.387+0000 7fd970e00640 1 -- 172.21.15.42:0/1279181700 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5645ce99f750 msgr2=0x5645ced82a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:32.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.387+0000 7fd970e00640 1 --2- 172.21.15.42:0/1279181700 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5645ce99f750 0x5645ced82a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.387+0000 7fd970e00640 1 -- 172.21.15.42:0/1279181700 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645ced88380 con 0x5645ce97ea70 2024-09-17T01:35:32.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.388+0000 7fd970e00640 1 --2- 172.21.15.42:0/1279181700 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce97ea70 0x5645ceda4e30 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd958063290 tx=0x7fd95809b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b5cac2354fe8d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:32.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.388+0000 7fd952a00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:32.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.388+0000 7fd952a00640 1 -- 172.21.15.42:0/1279181700 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958099e60 con 0x5645ce97ea70 2024-09-17T01:35:32.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.388+0000 7fd952a00640 1 -- 172.21.15.42:0/1279181700 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fd958062770 con 0x5645ce97ea70 2024-09-17T01:35:32.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.388+0000 7fd97b276740 1 -- 172.21.15.42:0/1279181700 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd958067d30 con 0x5645ce97ea70 2024-09-17T01:35:32.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.388+0000 7fd952a00640 1 -- 172.21.15.42:0/1279181700 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd95806cc70 con 0x5645ce97ea70 2024-09-17T01:35:32.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.388+0000 7fd97b276740 10 client.5607 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:32.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.388+0000 7fd97b276740 1 -- 172.21.15.42:0/1279181700 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x5645ceda5570 con 0x5645ce97ea70 2024-09-17T01:35:32.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.388+0000 7fd952a00640 1 -- 172.21.15.42:0/1279181700 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd958067d30 con 0x5645ce97ea70 2024-09-17T01:35:32.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.389+0000 7fd952a00640 1 -- 172.21.15.42:0/1279181700 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7fd95805ec50 con 0x5645ce97ea70 2024-09-17T01:35:32.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.389+0000 7fd97b276740 10 client.5607 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:32.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.389+0000 7fd97b276740 10 client.5607 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:32.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.389+0000 7fd97b276740 20 client.5607 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:32.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.389+0000 7fd97b276740 1 --2- 172.21.15.42:0/1279181700 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5645cedf50c0 0x5645ced82f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.389+0000 7fd97b276740 4 client.5607 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_0"}] 2024-09-17T01:35:32.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.389+0000 7fd97b276740 1 -- 172.21.15.42:0/1279181700 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_0"}) -- 0x5645ced89e60 con 0x5645cedf50c0 2024-09-17T01:35:32.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.389+0000 7fd971800640 1 --2- 172.21.15.42:0/1279181700 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5645cedf50c0 0x5645ced82f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.389+0000 7fd971800640 1 --2- 172.21.15.42:0/1279181700 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5645cedf50c0 0x5645ced82f70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=384d0139ade3c5d1 server_cookie=d2f6fcf15ed8e03 in_seq=0 out_seq=0 2024-09-17T01:35:32.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.389+0000 7fd952a00640 10 client.5607 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:32.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.395+0000 7fd952a00640 1 -- 172.21.15.42:0/1279181700 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5645ced89e60 con 0x5645cedf50c0 2024-09-17T01:35:32.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.395+0000 7fd952a00640 10 client.5607 handle_command_reply: tid=0 2024-09-17T01:35:32.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.395+0000 7fd97b276740 1 client.5607 shutdown 2024-09-17T01:35:32.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.395+0000 7fd97b276740 1 -- 172.21.15.42:0/1279181700 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce97ea70 msgr2=0x5645ceda4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:32.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.395+0000 7fd97b276740 1 --2- 172.21.15.42:0/1279181700 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce97ea70 0x5645ceda4e30 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd958063290 tx=0x7fd95809b2e0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.395+0000 7fd97b276740 1 -- 172.21.15.42:0/1279181700 shutdown_connections 2024-09-17T01:35:32.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.395+0000 7fd97b276740 1 --2- 172.21.15.42:0/1279181700 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5645cedf50c0 0x5645ced82f70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.395+0000 7fd97b276740 1 --2- 172.21.15.42:0/1279181700 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5645ce99f750 0x5645ced82a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.395+0000 7fd97b276740 1 --2- 172.21.15.42:0/1279181700 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5645ce97ea70 0x5645ceda4e30 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.395+0000 7fd97b276740 1 --2- 172.21.15.42:0/1279181700 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5645ce976890 0x5645cedae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.395+0000 7fd952a00640 0 client.5607 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:32.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.395+0000 7fd97b276740 1 -- 172.21.15.42:0/1279181700 >> 172.21.15.42:0/1279181700 conn(0x5645ce9938a0 msgr2=0x5645ced9ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:32.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.395+0000 7fd97b276740 1 -- 172.21.15.42:0/1279181700 shutdown_connections 2024-09-17T01:35:32.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.395+0000 7fd97b276740 1 -- 172.21.15.42:0/1279181700 wait complete. 2024-09-17T01:35:32.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.396+0000 7fd97b276740 20 client.5607 trim_cache size 0 max 16384 2024-09-17T01:35:32.397 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:32.397 INFO:teuthology.orchestra.run.smithi042.stdout: "message": "", 2024-09-17T01:35:32.397 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0 2024-09-17T01:35:32.398 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:32.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.396+0000 7fd974200640 1 -- 172.21.15.42:0/3173515262 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd94c078b90 msgr2=0x7fd94c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:32.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.396+0000 7fd974200640 1 --2- 172.21.15.42:0/3173515262 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd94c078b90 0x7fd94c07b0a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd960033000 tx=0x7fd960004730 comp rx=0 tx=0).stop 2024-09-17T01:35:32.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.396+0000 7fd974200640 1 -- 172.21.15.42:0/3173515262 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd96c0cecb0 msgr2=0x7fd96c153d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:32.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.396+0000 7fd974200640 1 --2- 172.21.15.42:0/3173515262 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd96c0cecb0 0x7fd96c153d10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd95800e790 tx=0x7fd95800ec50 comp rx=0 tx=0).stop 2024-09-17T01:35:32.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.396+0000 7fd974200640 1 -- 172.21.15.42:0/3173515262 shutdown_connections 2024-09-17T01:35:32.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.396+0000 7fd974200640 1 --2- 172.21.15.42:0/3173515262 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd94c078b90 0x7fd94c07b0a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.396+0000 7fd974200640 1 --2- 172.21.15.42:0/3173515262 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd96c15cec0 0x7fd96c0c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.396+0000 7fd974200640 1 --2- 172.21.15.42:0/3173515262 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd96c0cecb0 0x7fd96c153d10 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.396+0000 7fd974200640 1 --2- 172.21.15.42:0/3173515262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd96c072950 0x7fd96c156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.396+0000 7fd974200640 1 -- 172.21.15.42:0/3173515262 >> 172.21.15.42:0/3173515262 conn(0x7fd96c0b2930 msgr2=0x7fd96c15c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:32.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.396+0000 7fd974200640 1 -- 172.21.15.42:0/3173515262 shutdown_connections 2024-09-17T01:35:32.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.396+0000 7fd974200640 1 -- 172.21.15.42:0/3173515262 wait complete. 2024-09-17T01:35:32.415 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' returned '{'message': '', 'return_code': 0}' 2024-09-17T01:35:32.415 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:35:32.415 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:35:32.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:35:32.451 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T01:35:32.549 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:35:32.550 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:35:32.550 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215593 s, 48.6 MB/s 2024-09-17T01:35:32.551 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' 2024-09-17T01:35:32.551 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_file_0 2024-09-17T01:35:32.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.782+0000 7f4304c00640 1 -- 172.21.15.42:0/2454729498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43000af910 msgr2=0x7f43000ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:32.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.782+0000 7f4304c00640 1 --2- 172.21.15.42:0/2454729498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43000af910 0x7f43000ccb90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f43000b3000 tx=0x7f42f002a4d0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.782+0000 7f4304c00640 1 -- 172.21.15.42:0/2454729498 shutdown_connections 2024-09-17T01:35:32.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.782+0000 7f4304c00640 1 --2- 172.21.15.42:0/2454729498 >> v2:172.21.15.43:3300/0 conn(0x7f43000b32b0 0x7f43000b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.782+0000 7f4304c00640 1 --2- 172.21.15.42:0/2454729498 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f430015c6c0 0x7f43000cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.782+0000 7f4304c00640 1 --2- 172.21.15.42:0/2454729498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43000af910 0x7f43000ccb90 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.782+0000 7f4304c00640 1 -- 172.21.15.42:0/2454729498 >> 172.21.15.42:0/2454729498 conn(0x7f430006d440 msgr2=0x7f43000b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:32.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.782+0000 7f4304c00640 1 -- 172.21.15.42:0/2454729498 shutdown_connections 2024-09-17T01:35:32.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.782+0000 7f4304c00640 1 -- 172.21.15.42:0/2454729498 wait complete. 2024-09-17T01:35:32.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.784+0000 7f4304c00640 1 Processor -- start 2024-09-17T01:35:32.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.785+0000 7f4304c00640 1 -- start start 2024-09-17T01:35:32.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.786+0000 7f4304c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f43000af910 0x7f430014f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.786+0000 7f4304c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43000b32b0 0x7f43001f4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.786+0000 7f4304c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f430015c6c0 0x7f4300073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.786+0000 7f4304c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f430006e470 con 0x7f43000b32b0 2024-09-17T01:35:32.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.786+0000 7f4304c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f430006e2f0 con 0x7f430015c6c0 2024-09-17T01:35:32.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.786+0000 7f4304c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f430006e5f0 con 0x7f43000af910 2024-09-17T01:35:32.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.786+0000 7f42f7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43000b32b0 0x7f43001f4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.786+0000 7f42f7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43000b32b0 0x7f43001f4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37712/0 (socket says 172.21.15.42:37712) 2024-09-17T01:35:32.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.786+0000 7f42f7e00640 1 -- 172.21.15.42:0/2610311234 learned_addr learned my addr 172.21.15.42:0/2610311234 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:32.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.787+0000 7f42ffe00640 1 --2- 172.21.15.42:0/2610311234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f430015c6c0 0x7f4300073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.787+0000 7f42ff400640 1 --2- 172.21.15.42:0/2610311234 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f43000af910 0x7f430014f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.787+0000 7f42f7e00640 1 -- 172.21.15.42:0/2610311234 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f43000af910 msgr2=0x7f430014f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:32.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.787+0000 7f42f7e00640 1 --2- 172.21.15.42:0/2610311234 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f43000af910 0x7f430014f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.787+0000 7f42f7e00640 1 -- 172.21.15.42:0/2610311234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f430015c6c0 msgr2=0x7f4300073eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:32.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.787+0000 7f42f7e00640 1 --2- 172.21.15.42:0/2610311234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f430015c6c0 0x7f4300073eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.787+0000 7f42f7e00640 1 -- 172.21.15.42:0/2610311234 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430015e3a0 con 0x7f43000b32b0 2024-09-17T01:35:32.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.787+0000 7f42ff400640 1 --2- 172.21.15.42:0/2610311234 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f43000af910 0x7f430014f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:32.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.787+0000 7f42ffe00640 1 --2- 172.21.15.42:0/2610311234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f430015c6c0 0x7f4300073eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:32.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.787+0000 7f42f7e00640 1 --2- 172.21.15.42:0/2610311234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43000b32b0 0x7f43001f4530 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f42e800e780 tx=0x7f42e800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:32.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.787+0000 7f42f7400640 1 -- 172.21.15.42:0/2610311234 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e800ccc0 con 0x7f43000b32b0 2024-09-17T01:35:32.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.787+0000 7f42f7400640 1 -- 172.21.15.42:0/2610311234 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42e800ee90 con 0x7f43000b32b0 2024-09-17T01:35:32.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.787+0000 7f42f7400640 1 -- 172.21.15.42:0/2610311234 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e8005280 con 0x7f43000b32b0 2024-09-17T01:35:32.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.787+0000 7f4304c00640 1 -- 172.21.15.42:0/2610311234 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f430015e680 con 0x7f43000b32b0 2024-09-17T01:35:32.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.788+0000 7f4304c00640 1 -- 172.21.15.42:0/2610311234 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f430015dc90 con 0x7f43000b32b0 2024-09-17T01:35:32.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.790+0000 7f42f7400640 1 -- 172.21.15.42:0/2610311234 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f42e8005420 con 0x7f43000b32b0 2024-09-17T01:35:32.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.791+0000 7f42f7400640 1 --2- 172.21.15.42:0/2610311234 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f42dc078bc0 0x7f42dc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.791+0000 7f42f7400640 1 -- 172.21.15.42:0/2610311234 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f42e809b6f0 con 0x7f43000b32b0 2024-09-17T01:35:32.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.791+0000 7f430d289740 1 Processor -- start 2024-09-17T01:35:32.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.792+0000 7f430d289740 1 -- start start 2024-09-17T01:35:32.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.792+0000 7f42ff400640 1 --2- 172.21.15.42:0/2610311234 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f42dc078bc0 0x7f42dc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.792+0000 7f42ff400640 1 --2- 172.21.15.42:0/2610311234 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f42dc078bc0 0x7f42dc07b0d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f42f0033000 tx=0x7f42f0004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:32.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.793+0000 7f430d289740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564199508750 0x5641998f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.793+0000 7f430d289740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 0x5641998aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.793+0000 7f430d289740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641994e7a70 0x5641998ae010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.793+0000 7f430d289740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5641998228d0 con 0x5641994df890 2024-09-17T01:35:32.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.793+0000 7f430d289740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564199811d00 con 0x5641994e7a70 2024-09-17T01:35:32.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.793+0000 7f430d289740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x564199815b10 con 0x564199508750 2024-09-17T01:35:32.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.793+0000 7f42f7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 0x5641998aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.793+0000 7f42f7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 0x5641998aa5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37720/0 (socket says 172.21.15.42:37720) 2024-09-17T01:35:32.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.793+0000 7f42f7e00640 1 -- 172.21.15.42:0/238266149 learned_addr learned my addr 172.21.15.42:0/238266149 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:32.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.793+0000 7f42ff400640 1 --2- 172.21.15.42:0/238266149 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564199508750 0x5641998f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.793+0000 7f42ffe00640 1 --2- 172.21.15.42:0/238266149 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641994e7a70 0x5641998ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.794+0000 7f42f7e00640 1 -- 172.21.15.42:0/238266149 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564199508750 msgr2=0x5641998f4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:32.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.794+0000 7f42f7e00640 1 --2- 172.21.15.42:0/238266149 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564199508750 0x5641998f4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.794+0000 7f42f7e00640 1 -- 172.21.15.42:0/238266149 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641994e7a70 msgr2=0x5641998ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:32.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.794+0000 7f42f7e00640 1 --2- 172.21.15.42:0/238266149 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641994e7a70 0x5641998ae010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.794+0000 7f42f7e00640 1 -- 172.21.15.42:0/238266149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564199573d30 con 0x5641994df890 2024-09-17T01:35:32.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.794+0000 7f42f7e00640 1 --2- 172.21.15.42:0/238266149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 0x5641998aa5e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f42e8063320 tx=0x7f42e8063290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378bcb28975f2f7b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:32.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.794+0000 7f42ef400640 1 -- 172.21.15.42:0/238266149 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e8063390 con 0x5641994df890 2024-09-17T01:35:32.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.794+0000 7f42ef400640 1 -- 172.21.15.42:0/238266149 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42e8089030 con 0x5641994df890 2024-09-17T01:35:32.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.794+0000 7f42ef400640 1 -- 172.21.15.42:0/238266149 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e8067e70 con 0x5641994df890 2024-09-17T01:35:32.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.795+0000 7f430d289740 1 -- 172.21.15.42:0/238266149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 msgr2=0x5641998aa5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:32.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.795+0000 7f430d289740 1 --2- 172.21.15.42:0/238266149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 0x5641998aa5e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f42e8063320 tx=0x7f42e8063290 comp rx=0 tx=0).stop 2024-09-17T01:35:32.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.795+0000 7f430d289740 1 -- 172.21.15.42:0/238266149 shutdown_connections 2024-09-17T01:35:32.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.795+0000 7f430d289740 1 --2- 172.21.15.42:0/238266149 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641994e7a70 0x5641998ae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.795+0000 7f430d289740 1 --2- 172.21.15.42:0/238266149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 0x5641998aa5e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.795+0000 7f430d289740 1 --2- 172.21.15.42:0/238266149 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564199508750 0x5641998f4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.795+0000 7f430d289740 1 -- 172.21.15.42:0/238266149 >> 172.21.15.42:0/238266149 conn(0x5641994fc8a0 msgr2=0x5641998af910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:32.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.795+0000 7f430d289740 1 -- 172.21.15.42:0/238266149 shutdown_connections 2024-09-17T01:35:32.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.795+0000 7f430d289740 1 -- 172.21.15.42:0/238266149 wait complete. 2024-09-17T01:35:32.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.796+0000 7f430d289740 1 -- start start 2024-09-17T01:35:32.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.796+0000 7f430d289740 1 Processor -- start 2024-09-17T01:35:32.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.798+0000 7f430d289740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 0x5641998f35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.798+0000 7f430d289740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641994e7a70 0x5641998c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.798+0000 7f430d289740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564199508750 0x5641998af780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.798+0000 7f430d289740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564199582b00 con 0x5641994df890 2024-09-17T01:35:32.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.798+0000 7f430d289740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5641997b8470 con 0x5641994e7a70 2024-09-17T01:35:32.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.798+0000 7f430d289740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5641998ed1c0 con 0x564199508750 2024-09-17T01:35:32.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.798+0000 7f430d289740 10 client.0 _ll_register_callbacks cb 0x5641997bd6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:32.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.798+0000 7f42ff400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 0x5641998f35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.798+0000 7f42ff400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 0x5641998f35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37730/0 (socket says 172.21.15.42:37730) 2024-09-17T01:35:32.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.798+0000 7f42ff400640 1 -- 172.21.15.42:0/3280731123 learned_addr learned my addr 172.21.15.42:0/3280731123 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:32.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.798+0000 7f42f7e00640 1 --2- 172.21.15.42:0/3280731123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641994e7a70 0x5641998c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.798+0000 7f42ffe00640 1 --2- 172.21.15.42:0/3280731123 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564199508750 0x5641998af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.799+0000 7f42ff400640 1 -- 172.21.15.42:0/3280731123 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564199508750 msgr2=0x5641998af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:32.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.799+0000 7f42ff400640 1 --2- 172.21.15.42:0/3280731123 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564199508750 0x5641998af780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.799+0000 7f42ff400640 1 -- 172.21.15.42:0/3280731123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641994e7a70 msgr2=0x5641998c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:32.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.799+0000 7f42ff400640 1 --2- 172.21.15.42:0/3280731123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641994e7a70 0x5641998c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.799+0000 7f42ff400640 1 -- 172.21.15.42:0/3280731123 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641995eab90 con 0x5641994df890 2024-09-17T01:35:32.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.799+0000 7f42f7e00640 1 --2- 172.21.15.42:0/3280731123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641994e7a70 0x5641998c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:32.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.799+0000 7f42ff400640 1 --2- 172.21.15.42:0/3280731123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 0x5641998f35f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f42f00099c0 tx=0x7f42f0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458a1d2046d5192d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:32.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.799+0000 7f42e3e00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:32.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.799+0000 7f42e3e00640 1 -- 172.21.15.42:0/3280731123 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f004c020 con 0x5641994df890 2024-09-17T01:35:32.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.799+0000 7f42e3e00640 1 -- 172.21.15.42:0/3280731123 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f42f00047a0 con 0x5641994df890 2024-09-17T01:35:32.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.799+0000 7f430d289740 1 -- 172.21.15.42:0/3280731123 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42e8089030 con 0x5641994df890 2024-09-17T01:35:32.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.800+0000 7f42e3e00640 1 -- 172.21.15.42:0/3280731123 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f42f0056050 con 0x5641994df890 2024-09-17T01:35:32.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.800+0000 7f430d289740 10 client.5619 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:32.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.800+0000 7f430d289740 1 -- 172.21.15.42:0/3280731123 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x5641998ecf00 con 0x5641994df890 2024-09-17T01:35:32.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.800+0000 7f42e3e00640 1 -- 172.21.15.42:0/3280731123 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42e8089030 con 0x5641994df890 2024-09-17T01:35:32.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.800+0000 7f42e3e00640 1 -- 172.21.15.42:0/3280731123 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f42f0059020 con 0x5641994df890 2024-09-17T01:35:32.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.800+0000 7f430d289740 10 client.5619 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:32.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.800+0000 7f430d289740 10 client.5619 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:32.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.800+0000 7f430d289740 20 client.5619 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:32.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.800+0000 7f430d289740 1 --2- 172.21.15.42:0/3280731123 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5641994c7320 0x564199907100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.800+0000 7f430d289740 4 client.5619 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:32.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.800+0000 7f430d289740 1 -- 172.21.15.42:0/3280731123 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564199824820 con 0x5641994c7320 2024-09-17T01:35:32.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.800+0000 7f42f7e00640 1 --2- 172.21.15.42:0/3280731123 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5641994c7320 0x564199907100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.801+0000 7f42f7e00640 1 --2- 172.21.15.42:0/3280731123 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5641994c7320 0x564199907100 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6a22563c404ca07 server_cookie=93a0305aa50eaca1 in_seq=0 out_seq=0 2024-09-17T01:35:32.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.801+0000 7f42e3e00640 10 client.5619 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:32.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.801+0000 7f42e3e00640 1 -- 172.21.15.42:0/3280731123 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564199824820 con 0x5641994c7320 2024-09-17T01:35:32.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.801+0000 7f42e3e00640 10 client.5619 handle_command_reply: tid=0 2024-09-17T01:35:32.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.801+0000 7f430d289740 1 client.5619 shutdown 2024-09-17T01:35:32.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.802+0000 7f430d289740 1 -- 172.21.15.42:0/3280731123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 msgr2=0x5641998f35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:32.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.802+0000 7f430d289740 1 --2- 172.21.15.42:0/3280731123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 0x5641998f35f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f42f00099c0 tx=0x7f42f0009260 comp rx=0 tx=0).stop 2024-09-17T01:35:32.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.802+0000 7f430d289740 1 -- 172.21.15.42:0/3280731123 shutdown_connections 2024-09-17T01:35:32.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.802+0000 7f430d289740 1 --2- 172.21.15.42:0/3280731123 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5641994c7320 0x564199907100 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.802+0000 7f430d289740 1 --2- 172.21.15.42:0/3280731123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641994e7a70 0x5641998c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.802+0000 7f430d289740 1 --2- 172.21.15.42:0/3280731123 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564199508750 0x5641998af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.802+0000 7f430d289740 1 --2- 172.21.15.42:0/3280731123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 0x5641998f35f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.802+0000 7f430d289740 1 -- 172.21.15.42:0/3280731123 >> 172.21.15.42:0/3280731123 conn(0x5641994fc8a0 msgr2=0x5641998a8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:32.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.802+0000 7f42e3e00640 0 client.5619 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:32.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.802+0000 7f430d289740 1 -- 172.21.15.42:0/3280731123 shutdown_connections 2024-09-17T01:35:32.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.802+0000 7f430d289740 1 -- 172.21.15.42:0/3280731123 wait complete. 2024-09-17T01:35:32.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.802+0000 7f430d289740 20 client.5619 trim_cache size 0 max 16384 2024-09-17T01:35:32.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.818+0000 7f430d289740 1 Processor -- start 2024-09-17T01:35:32.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.818+0000 7f430d289740 1 -- start start 2024-09-17T01:35:32.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.819+0000 7f430d289740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 0x56419990d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.819+0000 7f430d289740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641994e7a70 0x564199917be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.819+0000 7f430d289740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564199508750 0x5641998edb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.819+0000 7f430d289740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5641998ed9f0 con 0x5641994df890 2024-09-17T01:35:32.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.819+0000 7f430d289740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f43001ffe80 con 0x5641994e7a70 2024-09-17T01:35:32.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.819+0000 7f430d289740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f43001f7d40 con 0x564199508750 2024-09-17T01:35:32.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.820+0000 7f42ff400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 0x56419990d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.820+0000 7f42ff400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 0x56419990d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37746/0 (socket says 172.21.15.42:37746) 2024-09-17T01:35:32.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.820+0000 7f42ff400640 1 -- 172.21.15.42:0/4070787952 learned_addr learned my addr 172.21.15.42:0/4070787952 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:32.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.820+0000 7f42ffe00640 1 --2- 172.21.15.42:0/4070787952 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564199508750 0x5641998edb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.820+0000 7f42f7e00640 1 --2- 172.21.15.42:0/4070787952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641994e7a70 0x564199917be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.820+0000 7f42ff400640 1 -- 172.21.15.42:0/4070787952 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564199508750 msgr2=0x5641998edb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:32.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.820+0000 7f42ff400640 1 --2- 172.21.15.42:0/4070787952 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564199508750 0x5641998edb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.820+0000 7f42ff400640 1 -- 172.21.15.42:0/4070787952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641994e7a70 msgr2=0x564199917be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:32.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.820+0000 7f42ff400640 1 --2- 172.21.15.42:0/4070787952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641994e7a70 0x564199917be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.820+0000 7f42ff400640 1 -- 172.21.15.42:0/4070787952 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641998c6af0 con 0x5641994df890 2024-09-17T01:35:32.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.820+0000 7f42ff400640 1 --2- 172.21.15.42:0/4070787952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 0x56419990d9d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f42f002aac0 tx=0x7f42f00056f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26bba643b853450a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:32.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.821+0000 7f42eea00640 1 -- 172.21.15.42:0/4070787952 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f004c070 con 0x5641994df890 2024-09-17T01:35:32.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.821+0000 7f42eea00640 1 -- 172.21.15.42:0/4070787952 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42f00049a0 con 0x5641994df890 2024-09-17T01:35:32.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.821+0000 7f42eea00640 1 -- 172.21.15.42:0/4070787952 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f0035050 con 0x5641994df890 2024-09-17T01:35:32.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.821+0000 7f430d289740 1 -- 172.21.15.42:0/4070787952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 msgr2=0x56419990d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:32.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.821+0000 7f430d289740 1 --2- 172.21.15.42:0/4070787952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 0x56419990d9d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f42f002aac0 tx=0x7f42f00056f0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.821+0000 7f430d289740 1 -- 172.21.15.42:0/4070787952 shutdown_connections 2024-09-17T01:35:32.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.821+0000 7f430d289740 1 --2- 172.21.15.42:0/4070787952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641994e7a70 0x564199917be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.821+0000 7f430d289740 1 --2- 172.21.15.42:0/4070787952 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564199508750 0x5641998edb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.821+0000 7f430d289740 1 --2- 172.21.15.42:0/4070787952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 0x56419990d9d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.821+0000 7f430d289740 1 -- 172.21.15.42:0/4070787952 >> 172.21.15.42:0/4070787952 conn(0x5641994fc8a0 msgr2=0x5641998adfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:32.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.821+0000 7f430d289740 1 -- 172.21.15.42:0/4070787952 shutdown_connections 2024-09-17T01:35:32.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.822+0000 7f430d289740 1 -- 172.21.15.42:0/4070787952 wait complete. 2024-09-17T01:35:32.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.822+0000 7f430d289740 1 -- start start 2024-09-17T01:35:32.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.823+0000 7f430d289740 1 Processor -- start 2024-09-17T01:35:32.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.824+0000 7f430d289740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 0x5641998edb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.824+0000 7f430d289740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5641994e7a70 0x5641998f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.824+0000 7f430d289740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564199508750 0x56419996eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.824+0000 7f430d289740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f43001f76f0 con 0x5641994df890 2024-09-17T01:35:32.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.824+0000 7f430d289740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f43001f70a0 con 0x564199508750 2024-09-17T01:35:32.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.824+0000 7f430d289740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x564199978a30 con 0x5641994e7a70 2024-09-17T01:35:32.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.824+0000 7f430d289740 10 client.0 _ll_register_callbacks cb 0x7f42f0004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:32.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.824+0000 7f42ff400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 0x5641998edb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.824+0000 7f42ff400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 0x5641998edb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37760/0 (socket says 172.21.15.42:37760) 2024-09-17T01:35:32.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.824+0000 7f42ff400640 1 -- 172.21.15.42:0/3765626165 learned_addr learned my addr 172.21.15.42:0/3765626165 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:32.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.825+0000 7f42ffe00640 1 --2- 172.21.15.42:0/3765626165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564199508750 0x56419996eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.825+0000 7f42f7e00640 1 --2- 172.21.15.42:0/3765626165 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5641994e7a70 0x5641998f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.825+0000 7f42ff400640 1 -- 172.21.15.42:0/3765626165 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5641994e7a70 msgr2=0x5641998f4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:32.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.825+0000 7f42ff400640 1 --2- 172.21.15.42:0/3765626165 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5641994e7a70 0x5641998f4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.825+0000 7f42ff400640 1 -- 172.21.15.42:0/3765626165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564199508750 msgr2=0x56419996eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:32.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.825+0000 7f42ff400640 1 --2- 172.21.15.42:0/3765626165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564199508750 0x56419996eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.825+0000 7f42ff400640 1 -- 172.21.15.42:0/3765626165 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564199978560 con 0x5641994df890 2024-09-17T01:35:32.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.825+0000 7f42f7e00640 1 --2- 172.21.15.42:0/3765626165 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5641994e7a70 0x5641998f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:32.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.825+0000 7f42ffe00640 1 --2- 172.21.15.42:0/3765626165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564199508750 0x56419996eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:32.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.825+0000 7f42ff400640 1 --2- 172.21.15.42:0/3765626165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 0x5641998edb70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f42f00099c0 tx=0x7f42f0004d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa4659db58551ece server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:32.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.825+0000 7f42e3e00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:32.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.825+0000 7f42e3e00640 1 -- 172.21.15.42:0/3765626165 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f0035070 con 0x5641994df890 2024-09-17T01:35:32.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.825+0000 7f42e3e00640 1 -- 172.21.15.42:0/3765626165 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f42f0049ac0 con 0x5641994df890 2024-09-17T01:35:32.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.825+0000 7f430d289740 1 -- 172.21.15.42:0/3765626165 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42f00049a0 con 0x5641994df890 2024-09-17T01:35:32.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.826+0000 7f42e3e00640 1 -- 172.21.15.42:0/3765626165 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f42f004c040 con 0x5641994df890 2024-09-17T01:35:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.826+0000 7f430d289740 10 client.5625 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.826+0000 7f430d289740 1 -- 172.21.15.42:0/3765626165 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x5641998f5260 con 0x5641994df890 2024-09-17T01:35:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.826+0000 7f42e3e00640 1 -- 172.21.15.42:0/3765626165 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42f00049a0 con 0x5641994df890 2024-09-17T01:35:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.826+0000 7f42e3e00640 1 -- 172.21.15.42:0/3765626165 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f42f0059070 con 0x5641994df890 2024-09-17T01:35:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.826+0000 7f430d289740 10 client.5625 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.826+0000 7f430d289740 10 client.5625 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.826+0000 7f430d289740 20 client.5625 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.826+0000 7f430d289740 1 --2- 172.21.15.42:0/3765626165 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56419996f050 0x56419997bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.826+0000 7f430d289740 4 client.5625 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2024-09-17T01:35:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.826+0000 7f430d289740 1 -- 172.21.15.42:0/3765626165 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) -- 0x5641998202d0 con 0x56419996f050 2024-09-17T01:35:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.826+0000 7f42f7e00640 1 --2- 172.21.15.42:0/3765626165 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56419996f050 0x56419997bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.827+0000 7f42f7e00640 1 --2- 172.21.15.42:0/3765626165 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56419996f050 0x56419997bd70 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c95a9d5512b75899 server_cookie=c606224de156ee83 in_seq=0 out_seq=0 2024-09-17T01:35:32.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.827+0000 7f42e3e00640 10 client.5625 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:32.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.833+0000 7f42e3e00640 1 -- 172.21.15.42:0/3765626165 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5641998202d0 con 0x56419996f050 2024-09-17T01:35:32.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.833+0000 7f42e3e00640 10 client.5625 handle_command_reply: tid=0 2024-09-17T01:35:32.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.833+0000 7f430d289740 1 client.5625 shutdown 2024-09-17T01:35:32.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.833+0000 7f430d289740 1 -- 172.21.15.42:0/3765626165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 msgr2=0x5641998edb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:32.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.833+0000 7f430d289740 1 --2- 172.21.15.42:0/3765626165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 0x5641998edb70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f42f00099c0 tx=0x7f42f0004d80 comp rx=0 tx=0).stop 2024-09-17T01:35:32.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.833+0000 7f430d289740 1 -- 172.21.15.42:0/3765626165 shutdown_connections 2024-09-17T01:35:32.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.833+0000 7f430d289740 1 --2- 172.21.15.42:0/3765626165 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56419996f050 0x56419997bd70 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.833+0000 7f430d289740 1 --2- 172.21.15.42:0/3765626165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564199508750 0x56419996eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.833+0000 7f430d289740 1 --2- 172.21.15.42:0/3765626165 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5641994e7a70 0x5641998f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.833+0000 7f42e3e00640 0 client.5625 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:32.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.833+0000 7f430d289740 1 --2- 172.21.15.42:0/3765626165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5641994df890 0x5641998edb70 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.833+0000 7f430d289740 1 -- 172.21.15.42:0/3765626165 >> 172.21.15.42:0/3765626165 conn(0x5641994fc8a0 msgr2=0x5641998c7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:32.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.833+0000 7f430d289740 1 -- 172.21.15.42:0/3765626165 shutdown_connections 2024-09-17T01:35:32.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.833+0000 7f430d289740 1 -- 172.21.15.42:0/3765626165 wait complete. 2024-09-17T01:35:32.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.833+0000 7f430d289740 20 client.5625 trim_cache size 0 max 16384 2024-09-17T01:35:32.833 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:32.833 INFO:teuthology.orchestra.run.smithi042.stdout: "message": "", 2024-09-17T01:35:32.834 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0 2024-09-17T01:35:32.834 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:32.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.834+0000 7f4304c00640 1 -- 172.21.15.42:0/2610311234 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f42dc078bc0 msgr2=0x7f42dc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:32.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.834+0000 7f4304c00640 1 --2- 172.21.15.42:0/2610311234 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f42dc078bc0 0x7f42dc07b0d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f42f0033000 tx=0x7f42f0004730 comp rx=0 tx=0).stop 2024-09-17T01:35:32.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.834+0000 7f4304c00640 1 -- 172.21.15.42:0/2610311234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43000b32b0 msgr2=0x7f43001f4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:32.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.834+0000 7f4304c00640 1 --2- 172.21.15.42:0/2610311234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43000b32b0 0x7f43001f4530 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f42e800e780 tx=0x7f42e800ec40 comp rx=0 tx=0).stop 2024-09-17T01:35:32.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.834+0000 7f4304c00640 1 -- 172.21.15.42:0/2610311234 shutdown_connections 2024-09-17T01:35:32.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.834+0000 7f4304c00640 1 --2- 172.21.15.42:0/2610311234 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f42dc078bc0 0x7f42dc07b0d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.834+0000 7f4304c00640 1 --2- 172.21.15.42:0/2610311234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f430015c6c0 0x7f4300073eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.834+0000 7f4304c00640 1 --2- 172.21.15.42:0/2610311234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43000b32b0 0x7f43001f4530 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.834+0000 7f4304c00640 1 --2- 172.21.15.42:0/2610311234 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f43000af910 0x7f430014f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:32.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.834+0000 7f4304c00640 1 -- 172.21.15.42:0/2610311234 >> 172.21.15.42:0/2610311234 conn(0x7f430006d440 msgr2=0x7f430006edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:32.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.834+0000 7f4304c00640 1 -- 172.21.15.42:0/2610311234 shutdown_connections 2024-09-17T01:35:32.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32.834+0000 7f4304c00640 1 -- 172.21.15.42:0/2610311234 wait complete. 2024-09-17T01:35:32.854 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'message': '', 'return_code': 0}' 2024-09-17T01:35:32.854 DEBUG:teuthology.orchestra.run.smithi042:> stdin-killer -- python3 -c ' 2024-09-17T01:35:32.854 DEBUG:teuthology.orchestra.run.smithi042:> import os 2024-09-17T01:35:32.854 DEBUG:teuthology.orchestra.run.smithi042:> import stat 2024-09-17T01:35:32.854 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:35:32.855 DEBUG:teuthology.orchestra.run.smithi042:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0").st_ino) 2024-09-17T01:35:32.855 DEBUG:teuthology.orchestra.run.smithi042:> ' 2024-09-17T01:35:32.955 INFO:teuthology.orchestra.run.smithi042.stdout:1099511630412 2024-09-17T01:35:32.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:35:32.966 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-17T01:35:33.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.236+0000 7fe6b4e00640 1 -- 172.21.15.42:0/2818314638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b00cec40 msgr2=0x7fe6b00cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:33.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.236+0000 7fe6b4e00640 1 --2- 172.21.15.42:0/2818314638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b00cec40 0x7fe6b00cf050 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8005fd0 tx=0x7fe6a802a820 comp rx=0 tx=0).stop 2024-09-17T01:35:33.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.237+0000 7fe6b4e00640 1 -- 172.21.15.42:0/2818314638 shutdown_connections 2024-09-17T01:35:33.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.237+0000 7fe6b4e00640 1 --2- 172.21.15.42:0/2818314638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b00cec40 0x7fe6b00cf050 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.237+0000 7fe6b4e00640 1 -- 172.21.15.42:0/2818314638 >> 172.21.15.42:0/2818314638 conn(0x7fe6b00b2930 msgr2=0x7fe6b006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:33.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.237+0000 7fe6b4e00640 1 -- 172.21.15.42:0/2818314638 shutdown_connections 2024-09-17T01:35:33.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.237+0000 7fe6b4e00640 1 -- 172.21.15.42:0/2818314638 wait complete. 2024-09-17T01:35:33.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.239+0000 7fe6b4e00640 1 Processor -- start 2024-09-17T01:35:33.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.239+0000 7fe6b4e00640 1 -- start start 2024-09-17T01:35:33.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.240+0000 7fe6b4e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b00b3550 0x7fe6b015c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.240+0000 7fe6b4e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe6b00cec40 0x7fe6b013c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.240+0000 7fe6b4e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6b0142f40 0x7fe6b01551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.240+0000 7fe6b4e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b006d910 con 0x7fe6b00b3550 2024-09-17T01:35:33.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.240+0000 7fe6b4e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b006d790 con 0x7fe6b0142f40 2024-09-17T01:35:33.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.240+0000 7fe6b4e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe6b006da90 con 0x7fe6b00cec40 2024-09-17T01:35:33.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.241+0000 7fe6ade00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b00b3550 0x7fe6b015c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.241+0000 7fe6ade00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b00b3550 0x7fe6b015c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37778/0 (socket says 172.21.15.42:37778) 2024-09-17T01:35:33.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.241+0000 7fe6ade00640 1 -- 172.21.15.42:0/151498857 learned_addr learned my addr 172.21.15.42:0/151498857 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:33.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.241+0000 7fe6ae800640 1 --2- 172.21.15.42:0/151498857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6b0142f40 0x7fe6b01551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.241+0000 7fe6a7e00640 1 --2- 172.21.15.42:0/151498857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe6b00cec40 0x7fe6b013c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.241+0000 7fe6ade00640 1 -- 172.21.15.42:0/151498857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe6b00cec40 msgr2=0x7fe6b013c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:33.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.241+0000 7fe6ade00640 1 --2- 172.21.15.42:0/151498857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe6b00cec40 0x7fe6b013c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.241+0000 7fe6ade00640 1 -- 172.21.15.42:0/151498857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6b0142f40 msgr2=0x7fe6b01551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:33.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.241+0000 7fe6ade00640 1 --2- 172.21.15.42:0/151498857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6b0142f40 0x7fe6b01551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.241+0000 7fe6ade00640 1 -- 172.21.15.42:0/151498857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b01401a0 con 0x7fe6b00b3550 2024-09-17T01:35:33.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.242+0000 7fe6ade00640 1 --2- 172.21.15.42:0/151498857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b00b3550 0x7fe6b015c550 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000b3f0 tx=0x7fe6a000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:33.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.242+0000 7fe6a6000640 1 -- 172.21.15.42:0/151498857 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0015020 con 0x7fe6b00b3550 2024-09-17T01:35:33.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.242+0000 7fe6a6000640 1 -- 172.21.15.42:0/151498857 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6a0011920 con 0x7fe6b00b3550 2024-09-17T01:35:33.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.242+0000 7fe6b4e00640 1 -- 172.21.15.42:0/151498857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6b0140480 con 0x7fe6b00b3550 2024-09-17T01:35:33.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.242+0000 7fe6a6000640 1 -- 172.21.15.42:0/151498857 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0011d70 con 0x7fe6b00b3550 2024-09-17T01:35:33.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.242+0000 7fe6b4e00640 1 -- 172.21.15.42:0/151498857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6b0140a40 con 0x7fe6b00b3550 2024-09-17T01:35:33.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.245+0000 7fe6a6000640 1 -- 172.21.15.42:0/151498857 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe6a0018020 con 0x7fe6b00b3550 2024-09-17T01:35:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.246+0000 7fe6a6000640 1 --2- 172.21.15.42:0/151498857 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe68c078bc0 0x7fe68c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.246+0000 7fe6a6000640 1 -- 172.21.15.42:0/151498857 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fe6a009a810 con 0x7fe6b00b3550 2024-09-17T01:35:33.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.246+0000 7fe6bbe78740 1 Processor -- start 2024-09-17T01:35:33.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.246+0000 7fe6bbe78740 1 -- start start 2024-09-17T01:35:33.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.246+0000 7fe6a7e00640 1 --2- 172.21.15.42:0/151498857 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe68c078bc0 0x7fe68c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.247+0000 7fe6a7e00640 1 --2- 172.21.15.42:0/151498857 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe68c078bc0 0x7fe68c07b0d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe6b01591d0 tx=0x7fe698009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:33.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.247+0000 7fe6bbe78740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561909e7a390 0x56190a266300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.247+0000 7fe6bbe78740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e514d0 0x56190a23b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.248+0000 7fe6bbe78740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561909e596b0 0x56190a23b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.248+0000 7fe6bbe78740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56190a1946f0 con 0x561909e514d0 2024-09-17T01:35:33.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.248+0000 7fe6bbe78740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56190a183b20 con 0x561909e596b0 2024-09-17T01:35:33.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.248+0000 7fe6bbe78740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56190a187930 con 0x561909e7a390 2024-09-17T01:35:33.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.248+0000 7fe6a7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e514d0 0x56190a23b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.248+0000 7fe6a7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e514d0 0x56190a23b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37784/0 (socket says 172.21.15.42:37784) 2024-09-17T01:35:33.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.248+0000 7fe6a7e00640 1 -- 172.21.15.42:0/2986249697 learned_addr learned my addr 172.21.15.42:0/2986249697 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:33.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.248+0000 7fe6ae800640 1 --2- 172.21.15.42:0/2986249697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561909e596b0 0x56190a23b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.248+0000 7fe6ade00640 1 --2- 172.21.15.42:0/2986249697 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561909e7a390 0x56190a266300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.248+0000 7fe6a7e00640 1 -- 172.21.15.42:0/2986249697 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561909e7a390 msgr2=0x56190a266300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:33.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.248+0000 7fe6a7e00640 1 --2- 172.21.15.42:0/2986249697 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561909e7a390 0x56190a266300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.248+0000 7fe6a7e00640 1 -- 172.21.15.42:0/2986249697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561909e596b0 msgr2=0x56190a23b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:33.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.248+0000 7fe6a7e00640 1 --2- 172.21.15.42:0/2986249697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561909e596b0 0x56190a23b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.248+0000 7fe6a7e00640 1 -- 172.21.15.42:0/2986249697 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561909ee5970 con 0x561909e514d0 2024-09-17T01:35:33.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.249+0000 7fe6a7e00640 1 --2- 172.21.15.42:0/2986249697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e514d0 0x56190a23b150 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe69800f990 tx=0x7fe698012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832c2be8053ebb28 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:33.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.249+0000 7fe69ea00640 1 -- 172.21.15.42:0/2986249697 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe698025070 con 0x561909e514d0 2024-09-17T01:35:33.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.249+0000 7fe69ea00640 1 -- 172.21.15.42:0/2986249697 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe69801b050 con 0x561909e514d0 2024-09-17T01:35:33.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.249+0000 7fe69ea00640 1 -- 172.21.15.42:0/2986249697 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe698014e00 con 0x561909e514d0 2024-09-17T01:35:33.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.250+0000 7fe6bbe78740 1 -- 172.21.15.42:0/2986249697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e514d0 msgr2=0x56190a23b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:33.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.250+0000 7fe6bbe78740 1 --2- 172.21.15.42:0/2986249697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e514d0 0x56190a23b150 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe69800f990 tx=0x7fe698012000 comp rx=0 tx=0).stop 2024-09-17T01:35:33.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.250+0000 7fe6bbe78740 1 -- 172.21.15.42:0/2986249697 shutdown_connections 2024-09-17T01:35:33.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.250+0000 7fe6bbe78740 1 --2- 172.21.15.42:0/2986249697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561909e596b0 0x56190a23b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.250+0000 7fe6bbe78740 1 --2- 172.21.15.42:0/2986249697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e514d0 0x56190a23b150 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.250+0000 7fe6bbe78740 1 --2- 172.21.15.42:0/2986249697 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561909e7a390 0x56190a266300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.250+0000 7fe6bbe78740 1 -- 172.21.15.42:0/2986249697 >> 172.21.15.42:0/2986249697 conn(0x561909e6e4e0 msgr2=0x56190a2215f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:33.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.250+0000 7fe6bbe78740 1 -- 172.21.15.42:0/2986249697 shutdown_connections 2024-09-17T01:35:33.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.250+0000 7fe6bbe78740 1 -- 172.21.15.42:0/2986249697 wait complete. 2024-09-17T01:35:33.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.251+0000 7fe6bbe78740 1 -- start start 2024-09-17T01:35:33.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.251+0000 7fe6bbe78740 1 Processor -- start 2024-09-17T01:35:33.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.252+0000 7fe6bbe78740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561909e514d0 0x56190a260060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.252+0000 7fe6bbe78740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561909e596b0 0x56190a25d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.252+0000 7fe6bbe78740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e7a390 0x56190a274dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.253+0000 7fe6bbe78740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561909ef4740 con 0x561909e7a390 2024-09-17T01:35:33.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.253+0000 7fe6bbe78740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56190a12a290 con 0x561909e514d0 2024-09-17T01:35:33.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.253+0000 7fe6bbe78740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56190a25dd70 con 0x561909e596b0 2024-09-17T01:35:33.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.253+0000 7fe6bbe78740 10 client.0 _ll_register_callbacks cb 0x56190a1071e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.253+0000 7fe6ae800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e7a390 0x56190a274dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.253+0000 7fe6ae800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e7a390 0x56190a274dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37792/0 (socket says 172.21.15.42:37792) 2024-09-17T01:35:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.253+0000 7fe6ae800640 1 -- 172.21.15.42:0/407354858 learned_addr learned my addr 172.21.15.42:0/407354858 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.253+0000 7fe6ade00640 1 --2- 172.21.15.42:0/407354858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561909e514d0 0x56190a260060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.253+0000 7fe6a7e00640 1 --2- 172.21.15.42:0/407354858 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561909e596b0 0x56190a25d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.253+0000 7fe6ae800640 1 -- 172.21.15.42:0/407354858 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561909e596b0 msgr2=0x56190a25d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.253+0000 7fe6ae800640 1 --2- 172.21.15.42:0/407354858 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561909e596b0 0x56190a25d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.253+0000 7fe6ae800640 1 -- 172.21.15.42:0/407354858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561909e514d0 msgr2=0x56190a260060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.253+0000 7fe6ae800640 1 --2- 172.21.15.42:0/407354858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561909e514d0 0x56190a260060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.253+0000 7fe6ae800640 1 -- 172.21.15.42:0/407354858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561909f5c7d0 con 0x561909e7a390 2024-09-17T01:35:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.253+0000 7fe6a7e00640 1 --2- 172.21.15.42:0/407354858 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561909e596b0 0x56190a25d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.254+0000 7fe6ae800640 1 --2- 172.21.15.42:0/407354858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e7a390 0x56190a274dd0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8009cd0 tx=0x7fe6a8003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54cab7203e8a24b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:33.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.254+0000 7fe693400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:33.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.254+0000 7fe693400640 1 -- 172.21.15.42:0/407354858 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8037040 con 0x561909e7a390 2024-09-17T01:35:33.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.254+0000 7fe6bbe78740 1 -- 172.21.15.42:0/407354858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe69801b050 con 0x561909e7a390 2024-09-17T01:35:33.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.254+0000 7fe693400640 1 -- 172.21.15.42:0/407354858 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fe6a8004410 con 0x561909e7a390 2024-09-17T01:35:33.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.254+0000 7fe693400640 1 -- 172.21.15.42:0/407354858 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe6a8050050 con 0x561909e7a390 2024-09-17T01:35:33.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.254+0000 7fe6bbe78740 10 client.5640 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:33.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.254+0000 7fe6bbe78740 1 -- 172.21.15.42:0/407354858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x56190a25dab0 con 0x561909e7a390 2024-09-17T01:35:33.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.254+0000 7fe693400640 1 -- 172.21.15.42:0/407354858 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe69801b050 con 0x561909e7a390 2024-09-17T01:35:33.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.255+0000 7fe693400640 1 -- 172.21.15.42:0/407354858 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7fe6a8053020 con 0x561909e7a390 2024-09-17T01:35:33.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.255+0000 7fe6bbe78740 10 client.5640 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:33.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.255+0000 7fe6bbe78740 10 client.5640 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:33.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.255+0000 7fe6bbe78740 20 client.5640 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:33.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.255+0000 7fe6bbe78740 1 --2- 172.21.15.42:0/407354858 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561909e38f60 0x56190a22b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.255+0000 7fe6bbe78740 4 client.5640 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:33.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.255+0000 7fe6bbe78740 1 -- 172.21.15.42:0/407354858 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56190a196640 con 0x561909e38f60 2024-09-17T01:35:33.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.255+0000 7fe6ade00640 1 --2- 172.21.15.42:0/407354858 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561909e38f60 0x56190a22b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.255+0000 7fe6ade00640 1 --2- 172.21.15.42:0/407354858 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561909e38f60 0x56190a22b900 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e72ded3d53ba8a3 server_cookie=8dcc7da0a169dc2 in_seq=0 out_seq=0 2024-09-17T01:35:33.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.255+0000 7fe693400640 10 client.5640 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:33.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.256+0000 7fe693400640 1 -- 172.21.15.42:0/407354858 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56190a196640 con 0x561909e38f60 2024-09-17T01:35:33.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.256+0000 7fe693400640 10 client.5640 handle_command_reply: tid=0 2024-09-17T01:35:33.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.256+0000 7fe6bbe78740 1 client.5640 shutdown 2024-09-17T01:35:33.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.256+0000 7fe6bbe78740 1 -- 172.21.15.42:0/407354858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e7a390 msgr2=0x56190a274dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:33.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.256+0000 7fe6bbe78740 1 --2- 172.21.15.42:0/407354858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e7a390 0x56190a274dd0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8009cd0 tx=0x7fe6a8003f40 comp rx=0 tx=0).stop 2024-09-17T01:35:33.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.257+0000 7fe6bbe78740 1 -- 172.21.15.42:0/407354858 shutdown_connections 2024-09-17T01:35:33.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.257+0000 7fe6bbe78740 1 --2- 172.21.15.42:0/407354858 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561909e38f60 0x56190a22b900 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.257+0000 7fe6bbe78740 1 --2- 172.21.15.42:0/407354858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e7a390 0x56190a274dd0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.257+0000 7fe6bbe78740 1 --2- 172.21.15.42:0/407354858 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561909e596b0 0x56190a25d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.257+0000 7fe6bbe78740 1 --2- 172.21.15.42:0/407354858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561909e514d0 0x56190a260060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.257+0000 7fe693400640 0 client.5640 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:33.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.257+0000 7fe6bbe78740 1 -- 172.21.15.42:0/407354858 >> 172.21.15.42:0/407354858 conn(0x561909e6e4e0 msgr2=0x56190a268ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:33.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.257+0000 7fe6bbe78740 1 -- 172.21.15.42:0/407354858 shutdown_connections 2024-09-17T01:35:33.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.257+0000 7fe6bbe78740 1 -- 172.21.15.42:0/407354858 wait complete. 2024-09-17T01:35:33.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.257+0000 7fe6bbe78740 20 client.5640 trim_cache size 0 max 16384 2024-09-17T01:35:33.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.271+0000 7fe6bbe78740 1 Processor -- start 2024-09-17T01:35:33.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.271+0000 7fe6bbe78740 1 -- start start 2024-09-17T01:35:33.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.273+0000 7fe6bbe78740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e514d0 0x56190a248560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.273+0000 7fe6bbe78740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561909e596b0 0x56190a248aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.273+0000 7fe6bbe78740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561909e7a390 0x56190a266300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.273+0000 7fe6bbe78740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b0200010 con 0x561909e514d0 2024-09-17T01:35:33.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.273+0000 7fe6bbe78740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b01ff070 con 0x561909e596b0 2024-09-17T01:35:33.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.273+0000 7fe6bbe78740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe6b0154690 con 0x561909e7a390 2024-09-17T01:35:33.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.273+0000 7fe6ade00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e514d0 0x56190a248560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.273+0000 7fe6ade00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e514d0 0x56190a248560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37808/0 (socket says 172.21.15.42:37808) 2024-09-17T01:35:33.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.273+0000 7fe6ade00640 1 -- 172.21.15.42:0/366680233 learned_addr learned my addr 172.21.15.42:0/366680233 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:33.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.273+0000 7fe6a7e00640 1 --2- 172.21.15.42:0/366680233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561909e596b0 0x56190a248aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.273+0000 7fe6ae800640 1 --2- 172.21.15.42:0/366680233 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561909e7a390 0x56190a266300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.273+0000 7fe6ade00640 1 -- 172.21.15.42:0/366680233 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561909e7a390 msgr2=0x56190a266300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:33.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.273+0000 7fe6ade00640 1 --2- 172.21.15.42:0/366680233 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561909e7a390 0x56190a266300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.273+0000 7fe6ade00640 1 -- 172.21.15.42:0/366680233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561909e596b0 msgr2=0x56190a248aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:33.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.273+0000 7fe6ade00640 1 --2- 172.21.15.42:0/366680233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561909e596b0 0x56190a248aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.273+0000 7fe6ade00640 1 -- 172.21.15.42:0/366680233 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56190a220ad0 con 0x561909e514d0 2024-09-17T01:35:33.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.273+0000 7fe6ade00640 1 --2- 172.21.15.42:0/366680233 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e514d0 0x56190a248560 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe6a005f900 tx=0x7fe6a0065040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee29f13ece96bfa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:33.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.274+0000 7fe69e000640 1 -- 172.21.15.42:0/366680233 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a006bf70 con 0x561909e514d0 2024-09-17T01:35:33.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.274+0000 7fe69e000640 1 -- 172.21.15.42:0/366680233 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6a005e900 con 0x561909e514d0 2024-09-17T01:35:33.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.274+0000 7fe69e000640 1 -- 172.21.15.42:0/366680233 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0061b50 con 0x561909e514d0 2024-09-17T01:35:33.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.274+0000 7fe6bbe78740 1 -- 172.21.15.42:0/366680233 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e514d0 msgr2=0x56190a248560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:33.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.274+0000 7fe6bbe78740 1 --2- 172.21.15.42:0/366680233 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e514d0 0x56190a248560 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe6a005f900 tx=0x7fe6a0065040 comp rx=0 tx=0).stop 2024-09-17T01:35:33.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.274+0000 7fe6bbe78740 1 -- 172.21.15.42:0/366680233 shutdown_connections 2024-09-17T01:35:33.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.274+0000 7fe6bbe78740 1 --2- 172.21.15.42:0/366680233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561909e596b0 0x56190a248aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.274+0000 7fe6bbe78740 1 --2- 172.21.15.42:0/366680233 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561909e7a390 0x56190a266300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.274+0000 7fe6bbe78740 1 --2- 172.21.15.42:0/366680233 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e514d0 0x56190a248560 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.274+0000 7fe6bbe78740 1 -- 172.21.15.42:0/366680233 >> 172.21.15.42:0/366680233 conn(0x561909e6e4e0 msgr2=0x56190a2749b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:33.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.275+0000 7fe6bbe78740 1 -- 172.21.15.42:0/366680233 shutdown_connections 2024-09-17T01:35:33.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.275+0000 7fe6bbe78740 1 -- 172.21.15.42:0/366680233 wait complete. 2024-09-17T01:35:33.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.275+0000 7fe6bbe78740 1 -- start start 2024-09-17T01:35:33.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.276+0000 7fe6bbe78740 1 Processor -- start 2024-09-17T01:35:33.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.277+0000 7fe6bbe78740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561909e514d0 0x56190a2df940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.277+0000 7fe6bbe78740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561909e596b0 0x56190a248510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.277+0000 7fe6bbe78740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e7a390 0x56190a248a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.277+0000 7fe6bbe78740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b0141ba0 con 0x561909e7a390 2024-09-17T01:35:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.277+0000 7fe6bbe78740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56190a263240 con 0x561909e596b0 2024-09-17T01:35:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.277+0000 7fe6bbe78740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56190a2e5ef0 con 0x561909e514d0 2024-09-17T01:35:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.277+0000 7fe6bbe78740 10 client.0 _ll_register_callbacks cb 0x7fe6a8009920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.277+0000 7fe6ae800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e7a390 0x56190a248a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.277+0000 7fe6ae800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e7a390 0x56190a248a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37814/0 (socket says 172.21.15.42:37814) 2024-09-17T01:35:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.277+0000 7fe6ae800640 1 -- 172.21.15.42:0/1186392598 learned_addr learned my addr 172.21.15.42:0/1186392598 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.278+0000 7fe6a7e00640 1 --2- 172.21.15.42:0/1186392598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561909e596b0 0x56190a248510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.278+0000 7fe6ade00640 1 --2- 172.21.15.42:0/1186392598 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561909e514d0 0x56190a2df940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.278+0000 7fe6ae800640 1 -- 172.21.15.42:0/1186392598 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561909e514d0 msgr2=0x56190a2df940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.278+0000 7fe6ae800640 1 --2- 172.21.15.42:0/1186392598 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561909e514d0 0x56190a2df940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.278+0000 7fe6ae800640 1 -- 172.21.15.42:0/1186392598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561909e596b0 msgr2=0x56190a248510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:33.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.278+0000 7fe6ae800640 1 --2- 172.21.15.42:0/1186392598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561909e596b0 0x56190a248510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.278+0000 7fe6ae800640 1 -- 172.21.15.42:0/1186392598 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56190a289060 con 0x561909e7a390 2024-09-17T01:35:33.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.278+0000 7fe6a7e00640 1 --2- 172.21.15.42:0/1186392598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561909e596b0 0x56190a248510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:33.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.278+0000 7fe6ae800640 1 --2- 172.21.15.42:0/1186392598 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e7a390 0x56190a248a50 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x56190a21dee0 tx=0x7fe6a802aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ebc5620628eff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:33.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.278+0000 7fe693400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:33.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.278+0000 7fe693400640 1 -- 172.21.15.42:0/1186392598 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8059060 con 0x561909e7a390 2024-09-17T01:35:33.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.278+0000 7fe693400640 1 -- 172.21.15.42:0/1186392598 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fe6a804ab00 con 0x561909e7a390 2024-09-17T01:35:33.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.278+0000 7fe6bbe78740 1 -- 172.21.15.42:0/1186392598 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6a005e900 con 0x561909e7a390 2024-09-17T01:35:33.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.279+0000 7fe693400640 1 -- 172.21.15.42:0/1186392598 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe6a8037040 con 0x561909e7a390 2024-09-17T01:35:33.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.279+0000 7fe6bbe78740 10 client.5646 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:33.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.279+0000 7fe6bbe78740 1 -- 172.21.15.42:0/1186392598 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x56190a2e5900 con 0x561909e7a390 2024-09-17T01:35:33.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.279+0000 7fe693400640 1 -- 172.21.15.42:0/1186392598 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6a005e900 con 0x561909e7a390 2024-09-17T01:35:33.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.279+0000 7fe693400640 1 -- 172.21.15.42:0/1186392598 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7fe6a8053040 con 0x561909e7a390 2024-09-17T01:35:33.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.279+0000 7fe6bbe78740 10 client.5646 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:33.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.279+0000 7fe6bbe78740 10 client.5646 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:33.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.279+0000 7fe6bbe78740 20 client.5646 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:33.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.279+0000 7fe6bbe78740 1 --2- 172.21.15.42:0/1186392598 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56190a239530 0x56190a2e9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.279+0000 7fe6bbe78740 4 client.5646 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-17T01:35:33.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.279+0000 7fe6bbe78740 1 -- 172.21.15.42:0/1186392598 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56190a1920f0 con 0x56190a239530 2024-09-17T01:35:33.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.279+0000 7fe6ade00640 1 --2- 172.21.15.42:0/1186392598 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56190a239530 0x56190a2e9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.280+0000 7fe6ade00640 1 --2- 172.21.15.42:0/1186392598 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56190a239530 0x56190a2e9260 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b943f96f56556a6 server_cookie=6d5003b48b08280c in_seq=0 out_seq=0 2024-09-17T01:35:33.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.280+0000 7fe693400640 10 client.5646 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:33.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.280+0000 7fe693400640 1 -- 172.21.15.42:0/1186392598 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56190a1920f0 con 0x56190a239530 2024-09-17T01:35:33.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.280+0000 7fe693400640 10 client.5646 handle_command_reply: tid=0 2024-09-17T01:35:33.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.280+0000 7fe6bbe78740 1 client.5646 shutdown 2024-09-17T01:35:33.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.280+0000 7fe6bbe78740 1 -- 172.21.15.42:0/1186392598 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e7a390 msgr2=0x56190a248a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:33.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.280+0000 7fe6bbe78740 1 --2- 172.21.15.42:0/1186392598 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e7a390 0x56190a248a50 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x56190a21dee0 tx=0x7fe6a802aea0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.280+0000 7fe6bbe78740 1 -- 172.21.15.42:0/1186392598 shutdown_connections 2024-09-17T01:35:33.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.280+0000 7fe6bbe78740 1 --2- 172.21.15.42:0/1186392598 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56190a239530 0x56190a2e9260 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.280+0000 7fe6bbe78740 1 --2- 172.21.15.42:0/1186392598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561909e596b0 0x56190a248510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.280+0000 7fe6bbe78740 1 --2- 172.21.15.42:0/1186392598 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561909e7a390 0x56190a248a50 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.280+0000 7fe6bbe78740 1 --2- 172.21.15.42:0/1186392598 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561909e514d0 0x56190a2df940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.280+0000 7fe693400640 0 client.5646 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:33.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.280+0000 7fe6bbe78740 1 -- 172.21.15.42:0/1186392598 >> 172.21.15.42:0/1186392598 conn(0x561909e6e4e0 msgr2=0x56190a239c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:33.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.281+0000 7fe6bbe78740 1 -- 172.21.15.42:0/1186392598 shutdown_connections 2024-09-17T01:35:33.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.281+0000 7fe6bbe78740 1 -- 172.21.15.42:0/1186392598 wait complete. 2024-09-17T01:35:33.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.281+0000 7fe6bbe78740 20 client.5646 trim_cache size 0 max 16384 2024-09-17T01:35:33.284 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-17T01:35:33.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.281+0000 7fe6b4e00640 1 -- 172.21.15.42:0/151498857 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe68c078bc0 msgr2=0x7fe68c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:33.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.281+0000 7fe6b4e00640 1 --2- 172.21.15.42:0/151498857 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe68c078bc0 0x7fe68c07b0d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe6b01591d0 tx=0x7fe698009040 comp rx=0 tx=0).stop 2024-09-17T01:35:33.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.281+0000 7fe6b4e00640 1 -- 172.21.15.42:0/151498857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b00b3550 msgr2=0x7fe6b015c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:33.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.281+0000 7fe6b4e00640 1 --2- 172.21.15.42:0/151498857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b00b3550 0x7fe6b015c550 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000b3f0 tx=0x7fe6a000b8b0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.282+0000 7fe6b4e00640 1 -- 172.21.15.42:0/151498857 shutdown_connections 2024-09-17T01:35:33.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.282+0000 7fe6b4e00640 1 --2- 172.21.15.42:0/151498857 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe68c078bc0 0x7fe68c07b0d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.282+0000 7fe6b4e00640 1 --2- 172.21.15.42:0/151498857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6b0142f40 0x7fe6b01551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.282+0000 7fe6b4e00640 1 --2- 172.21.15.42:0/151498857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe6b00cec40 0x7fe6b013c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.282+0000 7fe6b4e00640 1 --2- 172.21.15.42:0/151498857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b00b3550 0x7fe6b015c550 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.282+0000 7fe6b4e00640 1 -- 172.21.15.42:0/151498857 >> 172.21.15.42:0/151498857 conn(0x7fe6b00b2930 msgr2=0x7fe6b01580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:33.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.282+0000 7fe6b4e00640 1 -- 172.21.15.42:0/151498857 shutdown_connections 2024-09-17T01:35:33.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.282+0000 7fe6b4e00640 1 -- 172.21.15.42:0/151498857 wait complete. 2024-09-17T01:35:33.301 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 10000000a4c.00000000 parent 2024-09-17T01:35:33.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.446+0000 7fc62cef3f40 1 Processor -- start 2024-09-17T01:35:33.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.446+0000 7fc62cef3f40 1 -- start start 2024-09-17T01:35:33.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.448+0000 7fc62cef3f40 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558306a34290 0x558306b0c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.448+0000 7fc62cef3f40 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558306a63f50 0x558306b05160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.448+0000 7fc62cef3f40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558306a7f0f0 0x558306b09470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.448+0000 7fc62cef3f40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558306982c60 con 0x558306a7f0f0 2024-09-17T01:35:33.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.448+0000 7fc62cef3f40 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5583069e11d0 con 0x558306a63f50 2024-09-17T01:35:33.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.448+0000 7fc62cef3f40 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558306a64360 con 0x558306a34290 2024-09-17T01:35:33.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.448+0000 7fc626a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558306a7f0f0 0x558306b09470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.448+0000 7fc626a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558306a7f0f0 0x558306b09470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37832/0 (socket says 172.21.15.42:37832) 2024-09-17T01:35:33.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.448+0000 7fc626a00640 1 -- 172.21.15.42:0/1808881462 learned_addr learned my addr 172.21.15.42:0/1808881462 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:33.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.448+0000 7fc625600640 1 --2- 172.21.15.42:0/1808881462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558306a63f50 0x558306b05160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.448+0000 7fc626000640 1 --2- 172.21.15.42:0/1808881462 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558306a34290 0x558306b0c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.448+0000 7fc626a00640 1 -- 172.21.15.42:0/1808881462 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558306a34290 msgr2=0x558306b0c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:33.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.448+0000 7fc626a00640 1 --2- 172.21.15.42:0/1808881462 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558306a34290 0x558306b0c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.448+0000 7fc626a00640 1 -- 172.21.15.42:0/1808881462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558306a63f50 msgr2=0x558306b05160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:33.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.448+0000 7fc626a00640 1 --2- 172.21.15.42:0/1808881462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558306a63f50 0x558306b05160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.448+0000 7fc626a00640 1 -- 172.21.15.42:0/1808881462 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558306b04d60 con 0x558306a7f0f0 2024-09-17T01:35:33.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.448+0000 7fc626a00640 1 --2- 172.21.15.42:0/1808881462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558306a7f0f0 0x558306b09470 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc620025d10 tx=0x7fc620003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a643161465fe12 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:33.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.449+0000 7fc61fe00640 1 -- 172.21.15.42:0/1808881462 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620064030 con 0x558306a7f0f0 2024-09-17T01:35:33.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.449+0000 7fc61fe00640 1 -- 172.21.15.42:0/1808881462 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc620004020 con 0x558306a7f0f0 2024-09-17T01:35:33.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.449+0000 7fc61fe00640 1 -- 172.21.15.42:0/1808881462 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620004270 con 0x558306a7f0f0 2024-09-17T01:35:33.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.449+0000 7fc62cef3f40 1 -- 172.21.15.42:0/1808881462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558306a7f0f0 msgr2=0x558306b09470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:33.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.449+0000 7fc62cef3f40 1 --2- 172.21.15.42:0/1808881462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558306a7f0f0 0x558306b09470 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc620025d10 tx=0x7fc620003330 comp rx=0 tx=0).stop 2024-09-17T01:35:33.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.449+0000 7fc62cef3f40 1 -- 172.21.15.42:0/1808881462 shutdown_connections 2024-09-17T01:35:33.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.449+0000 7fc62cef3f40 1 --2- 172.21.15.42:0/1808881462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558306a63f50 0x558306b05160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.449+0000 7fc62cef3f40 1 --2- 172.21.15.42:0/1808881462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558306a7f0f0 0x558306b09470 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.449+0000 7fc62cef3f40 1 --2- 172.21.15.42:0/1808881462 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558306a34290 0x558306b0c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.449+0000 7fc62cef3f40 1 -- 172.21.15.42:0/1808881462 >> 172.21.15.42:0/1808881462 conn(0x558306953ac0 msgr2=0x558306a62070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:33.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.450+0000 7fc62cef3f40 1 -- 172.21.15.42:0/1808881462 shutdown_connections 2024-09-17T01:35:33.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.450+0000 7fc62cef3f40 1 -- 172.21.15.42:0/1808881462 wait complete. 2024-09-17T01:35:33.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.451+0000 7fc62cef3f40 1 Processor -- start 2024-09-17T01:35:33.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.451+0000 7fc62cef3f40 1 -- start start 2024-09-17T01:35:33.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.452+0000 7fc62cef3f40 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558306a34290 0x558306a782a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.452+0000 7fc62cef3f40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558306a63f50 0x558306af6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.452+0000 7fc62cef3f40 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558306a7f0f0 0x558306a34de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.452+0000 7fc62cef3f40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558306a363b0 con 0x558306a63f50 2024-09-17T01:35:33.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.452+0000 7fc62cef3f40 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558306a36650 con 0x558306a7f0f0 2024-09-17T01:35:33.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.452+0000 7fc62cef3f40 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558306af54a0 con 0x558306a34290 2024-09-17T01:35:33.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.452+0000 7fc625600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558306a63f50 0x558306af6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.452+0000 7fc625600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558306a63f50 0x558306af6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37844/0 (socket says 172.21.15.42:37844) 2024-09-17T01:35:33.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.452+0000 7fc625600640 1 -- 172.21.15.42:0/180954640 learned_addr learned my addr 172.21.15.42:0/180954640 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:33.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.452+0000 7fc626000640 1 --2- 172.21.15.42:0/180954640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558306a34290 0x558306a782a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.453+0000 7fc626a00640 1 --2- 172.21.15.42:0/180954640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558306a7f0f0 0x558306a34de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.453+0000 7fc625600640 1 -- 172.21.15.42:0/180954640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558306a34290 msgr2=0x558306a782a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:33.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.453+0000 7fc625600640 1 --2- 172.21.15.42:0/180954640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558306a34290 0x558306a782a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.453+0000 7fc625600640 1 -- 172.21.15.42:0/180954640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558306a7f0f0 msgr2=0x558306a34de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:33.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.453+0000 7fc625600640 1 --2- 172.21.15.42:0/180954640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558306a7f0f0 0x558306a34de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.453+0000 7fc625600640 1 -- 172.21.15.42:0/180954640 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558306b0a600 con 0x558306a63f50 2024-09-17T01:35:33.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.453+0000 7fc626a00640 1 --2- 172.21.15.42:0/180954640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558306a7f0f0 0x558306a34de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:33.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.453+0000 7fc625600640 1 --2- 172.21.15.42:0/180954640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558306a63f50 0x558306af6cf0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc61400a6e0 tx=0x7fc61400aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:33.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.453+0000 7fc61ea00640 1 -- 172.21.15.42:0/180954640 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc614009ba0 con 0x558306a63f50 2024-09-17T01:35:33.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.453+0000 7fc61ea00640 1 -- 172.21.15.42:0/180954640 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc614009d40 con 0x558306a63f50 2024-09-17T01:35:33.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.453+0000 7fc62cef3f40 1 -- 172.21.15.42:0/180954640 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558306a787e0 con 0x558306a63f50 2024-09-17T01:35:33.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.453+0000 7fc61ea00640 1 -- 172.21.15.42:0/180954640 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc614008680 con 0x558306a63f50 2024-09-17T01:35:33.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.454+0000 7fc62cef3f40 1 -- 172.21.15.42:0/180954640 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558306b03740 con 0x558306a63f50 2024-09-17T01:35:33.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.456+0000 7fc61ea00640 1 -- 172.21.15.42:0/180954640 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc614008820 con 0x558306a63f50 2024-09-17T01:35:33.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.457+0000 7fc61ea00640 1 --2- 172.21.15.42:0/180954640 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc608077570 0x7fc608079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.457+0000 7fc61ea00640 1 -- 172.21.15.42:0/180954640 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fc61409abf0 con 0x558306a63f50 2024-09-17T01:35:33.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.457+0000 7fc62cef3f40 1 --2- 172.21.15.42:0/180954640 >> [v2:172.21.15.43:6826/3742263700,v1:172.21.15.43:6827/3742263700] conn(0x558306af4200 0x558306af4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.457+0000 7fc626000640 1 --2- 172.21.15.42:0/180954640 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc608077570 0x7fc608079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.457+0000 7fc62cef3f40 1 -- 172.21.15.42:0/180954640 --> [v2:172.21.15.43:6826/3742263700,v1:172.21.15.43:6827/3742263700] -- osd_op(unknown.0.0:1 7.3a 7:5fa3b718:::10000000a4c.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) -- 0x558306af4b50 con 0x558306af4200 2024-09-17T01:35:33.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.457+0000 7fc626a00640 1 --2- 172.21.15.42:0/180954640 >> [v2:172.21.15.43:6826/3742263700,v1:172.21.15.43:6827/3742263700] conn(0x558306af4200 0x558306af4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.458+0000 7fc626000640 1 --2- 172.21.15.42:0/180954640 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc608077570 0x7fc608079a80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc618001200 tx=0x7fc618001190 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:33.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.458+0000 7fc626a00640 1 --2- 172.21.15.42:0/180954640 >> [v2:172.21.15.43:6826/3742263700,v1:172.21.15.43:6827/3742263700] conn(0x558306af4200 0x558306af4610 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:33.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.460+0000 7fc626a00640 1 -- 172.21.15.42:0/180954640 <== osd.6 v2:172.21.15.43:6826/3742263700 1 ==== osd_op_reply(1 10000000a4c.00000000 [rmxattr] v49'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc62000b040 con 0x558306af4200 2024-09-17T01:35:33.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.460+0000 7fc62cef3f40 1 -- 172.21.15.42:0/180954640 >> [v2:172.21.15.43:6826/3742263700,v1:172.21.15.43:6827/3742263700] conn(0x558306af4200 msgr2=0x558306af4610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:33.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.460+0000 7fc62cef3f40 1 --2- 172.21.15.42:0/180954640 >> [v2:172.21.15.43:6826/3742263700,v1:172.21.15.43:6827/3742263700] conn(0x558306af4200 0x558306af4610 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.460+0000 7fc62cef3f40 1 -- 172.21.15.42:0/180954640 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc608077570 msgr2=0x7fc608079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:33.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.460+0000 7fc62cef3f40 1 --2- 172.21.15.42:0/180954640 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc608077570 0x7fc608079a80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc618001200 tx=0x7fc618001190 comp rx=0 tx=0).stop 2024-09-17T01:35:33.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.460+0000 7fc62cef3f40 1 -- 172.21.15.42:0/180954640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558306a63f50 msgr2=0x558306af6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:33.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.460+0000 7fc62cef3f40 1 --2- 172.21.15.42:0/180954640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558306a63f50 0x558306af6cf0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc61400a6e0 tx=0x7fc61400aba0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.460+0000 7fc626a00640 1 -- 172.21.15.42:0/180954640 reap_dead start 2024-09-17T01:35:33.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.460+0000 7fc62cef3f40 1 -- 172.21.15.42:0/180954640 shutdown_connections 2024-09-17T01:35:33.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.460+0000 7fc62cef3f40 1 -- 172.21.15.42:0/180954640 >> 172.21.15.42:0/180954640 conn(0x558306953ac0 msgr2=0x558306a7deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:33.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.460+0000 7fc62cef3f40 1 -- 172.21.15.42:0/180954640 shutdown_connections 2024-09-17T01:35:33.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.460+0000 7fc62cef3f40 1 -- 172.21.15.42:0/180954640 wait complete. 2024-09-17T01:35:33.471 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' 2024-09-17T01:35:33.471 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_0 2024-09-17T01:35:33.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.704+0000 7f8995000640 1 -- 172.21.15.42:0/2956198461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8990162e90 msgr2=0x7f89900b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:33.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.704+0000 7f8995000640 1 --2- 172.21.15.42:0/2956198461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8990162e90 0x7f89900b3750 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f8990163420 tx=0x7f898002a5d0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.704+0000 7f8995000640 1 -- 172.21.15.42:0/2956198461 shutdown_connections 2024-09-17T01:35:33.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.704+0000 7f8995000640 1 --2- 172.21.15.42:0/2956198461 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f89900aefb0 0x7f899015f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.704+0000 7f8995000640 1 --2- 172.21.15.42:0/2956198461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8990162e90 0x7f89900b3750 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.704+0000 7f8995000640 1 -- 172.21.15.42:0/2956198461 >> 172.21.15.42:0/2956198461 conn(0x7f899006d890 msgr2=0x7f89900b2330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:33.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.704+0000 7f8995000640 1 -- 172.21.15.42:0/2956198461 shutdown_connections 2024-09-17T01:35:33.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.704+0000 7f8995000640 1 -- 172.21.15.42:0/2956198461 wait complete. 2024-09-17T01:35:33.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.706+0000 7f8995000640 1 Processor -- start 2024-09-17T01:35:33.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.706+0000 7f8995000640 1 -- start start 2024-09-17T01:35:33.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.708+0000 7f8995000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8990073d50 0x7f8990152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.708+0000 7f8995000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8990162e90 0x7f899015f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.708+0000 7f8995000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8990152cf0 0x7f899015f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.708+0000 7f8995000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8990072c50 con 0x7f8990073d50 2024-09-17T01:35:33.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.708+0000 7f8995000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8990072ad0 con 0x7f8990162e90 2024-09-17T01:35:33.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.708+0000 7f8995000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8990072dd0 con 0x7f8990152cf0 2024-09-17T01:35:33.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.708+0000 7f898f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8990073d50 0x7f8990152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.708+0000 7f898f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8990073d50 0x7f8990152710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37856/0 (socket says 172.21.15.42:37856) 2024-09-17T01:35:33.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.708+0000 7f898f400640 1 -- 172.21.15.42:0/563256050 learned_addr learned my addr 172.21.15.42:0/563256050 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:33.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.708+0000 7f898fe00640 1 --2- 172.21.15.42:0/563256050 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8990152cf0 0x7f899015f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.708+0000 7f8987e00640 1 --2- 172.21.15.42:0/563256050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8990162e90 0x7f899015f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.709+0000 7f898f400640 1 -- 172.21.15.42:0/563256050 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8990152cf0 msgr2=0x7f899015f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:33.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.709+0000 7f898f400640 1 --2- 172.21.15.42:0/563256050 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8990152cf0 0x7f899015f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.709+0000 7f898f400640 1 -- 172.21.15.42:0/563256050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8990162e90 msgr2=0x7f899015f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:33.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.709+0000 7f898f400640 1 --2- 172.21.15.42:0/563256050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8990162e90 0x7f899015f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.709+0000 7f898f400640 1 -- 172.21.15.42:0/563256050 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899015c500 con 0x7f8990073d50 2024-09-17T01:35:33.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.709+0000 7f898f400640 1 --2- 172.21.15.42:0/563256050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8990073d50 0x7f8990152710 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f8980034040 tx=0x7f8980003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:33.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.709+0000 7f8987400640 1 -- 172.21.15.42:0/563256050 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898003e030 con 0x7f8990073d50 2024-09-17T01:35:33.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.709+0000 7f8987400640 1 -- 172.21.15.42:0/563256050 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8980003c20 con 0x7f8990073d50 2024-09-17T01:35:33.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.709+0000 7f8987400640 1 -- 172.21.15.42:0/563256050 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8980035040 con 0x7f8990073d50 2024-09-17T01:35:33.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.709+0000 7f8995000640 1 -- 172.21.15.42:0/563256050 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f899015c7e0 con 0x7f8990073d50 2024-09-17T01:35:33.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.709+0000 7f8995000640 1 -- 172.21.15.42:0/563256050 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f899015cda0 con 0x7f8990073d50 2024-09-17T01:35:33.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.712+0000 7f8987400640 1 -- 172.21.15.42:0/563256050 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8980041030 con 0x7f8990073d50 2024-09-17T01:35:33.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.713+0000 7f8987400640 1 --2- 172.21.15.42:0/563256050 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f896c078b90 0x7f896c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.713+0000 7f8987400640 1 -- 172.21.15.42:0/563256050 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f89800bb2f0 con 0x7f8990073d50 2024-09-17T01:35:33.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.713+0000 7f8987e00640 1 --2- 172.21.15.42:0/563256050 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f896c078b90 0x7f896c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.713+0000 7f899d675740 1 Processor -- start 2024-09-17T01:35:33.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.714+0000 7f899d675740 1 -- start start 2024-09-17T01:35:33.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.714+0000 7f8987e00640 1 --2- 172.21.15.42:0/563256050 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f896c078b90 0x7f896c07b0a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f899006ff60 tx=0x7f8978009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:33.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.715+0000 7f899d675740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314b24a790 0x56314b639220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.715+0000 7f899d675740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b2218d0 0x56314b61bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.715+0000 7f899d675740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314b229ab0 0x56314b61c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.715+0000 7f899d675740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56314b564a30 con 0x56314b2218d0 2024-09-17T01:35:33.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.715+0000 7f899d675740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56314b553e60 con 0x56314b229ab0 2024-09-17T01:35:33.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.715+0000 7f899d675740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56314b557c70 con 0x56314b24a790 2024-09-17T01:35:33.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.715+0000 7f8987e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b2218d0 0x56314b61bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.715+0000 7f8987e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b2218d0 0x56314b61bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37866/0 (socket says 172.21.15.42:37866) 2024-09-17T01:35:33.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.715+0000 7f8987e00640 1 -- 172.21.15.42:0/2103497441 learned_addr learned my addr 172.21.15.42:0/2103497441 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:33.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.716+0000 7f898fe00640 1 --2- 172.21.15.42:0/2103497441 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314b229ab0 0x56314b61c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.716+0000 7f898f400640 1 --2- 172.21.15.42:0/2103497441 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314b24a790 0x56314b639220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.716+0000 7f8987e00640 1 -- 172.21.15.42:0/2103497441 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314b24a790 msgr2=0x56314b639220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:33.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.716+0000 7f8987e00640 1 --2- 172.21.15.42:0/2103497441 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314b24a790 0x56314b639220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.716+0000 7f8987e00640 1 -- 172.21.15.42:0/2103497441 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314b229ab0 msgr2=0x56314b61c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:33.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.716+0000 7f8987e00640 1 --2- 172.21.15.42:0/2103497441 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314b229ab0 0x56314b61c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.716+0000 7f8987e00640 1 -- 172.21.15.42:0/2103497441 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56314b32ec00 con 0x56314b2218d0 2024-09-17T01:35:33.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.716+0000 7f8987e00640 1 --2- 172.21.15.42:0/2103497441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b2218d0 0x56314b61bef0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f89780052f0 tx=0x7f8978011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a1e6bbf7e047db server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:33.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.716+0000 7f897fe00640 1 -- 172.21.15.42:0/2103497441 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8978021450 con 0x56314b2218d0 2024-09-17T01:35:33.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.716+0000 7f897fe00640 1 -- 172.21.15.42:0/2103497441 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89780216e0 con 0x56314b2218d0 2024-09-17T01:35:33.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.716+0000 7f897fe00640 1 -- 172.21.15.42:0/2103497441 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8978021ad0 con 0x56314b2218d0 2024-09-17T01:35:33.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.717+0000 7f899d675740 1 -- 172.21.15.42:0/2103497441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b2218d0 msgr2=0x56314b61bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:33.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.717+0000 7f899d675740 1 --2- 172.21.15.42:0/2103497441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b2218d0 0x56314b61bef0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f89780052f0 tx=0x7f8978011000 comp rx=0 tx=0).stop 2024-09-17T01:35:33.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.717+0000 7f899d675740 1 -- 172.21.15.42:0/2103497441 shutdown_connections 2024-09-17T01:35:33.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.717+0000 7f899d675740 1 --2- 172.21.15.42:0/2103497441 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314b229ab0 0x56314b61c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.717+0000 7f899d675740 1 --2- 172.21.15.42:0/2103497441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b2218d0 0x56314b61bef0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.717+0000 7f899d675740 1 --2- 172.21.15.42:0/2103497441 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314b24a790 0x56314b639220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.717+0000 7f899d675740 1 -- 172.21.15.42:0/2103497441 >> 172.21.15.42:0/2103497441 conn(0x56314b23e8e0 msgr2=0x56314b5f2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:33.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.717+0000 7f899d675740 1 -- 172.21.15.42:0/2103497441 shutdown_connections 2024-09-17T01:35:33.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.718+0000 7f899d675740 1 -- 172.21.15.42:0/2103497441 wait complete. 2024-09-17T01:35:33.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.719+0000 7f899d675740 1 -- start start 2024-09-17T01:35:33.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.719+0000 7f899d675740 1 Processor -- start 2024-09-17T01:35:33.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.720+0000 7f899d675740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314b2218d0 0x56314b649c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.720+0000 7f899d675740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b229ab0 0x56314b632d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.720+0000 7f899d675740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314b24a790 0x56314b60a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.720+0000 7f899d675740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56314b2c4b40 con 0x56314b229ab0 2024-09-17T01:35:33.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.720+0000 7f899d675740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56314b4f9710 con 0x56314b24a790 2024-09-17T01:35:33.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.720+0000 7f899d675740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56314b646940 con 0x56314b2218d0 2024-09-17T01:35:33.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.720+0000 7f899d675740 10 client.0 _ll_register_callbacks cb 0x56314b4ff8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:33.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.721+0000 7f8987e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b229ab0 0x56314b632d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.721+0000 7f898f400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314b2218d0 0x56314b649c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.721+0000 7f8987e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b229ab0 0x56314b632d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37880/0 (socket says 172.21.15.42:37880) 2024-09-17T01:35:33.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.721+0000 7f8987e00640 1 -- 172.21.15.42:0/663901150 learned_addr learned my addr 172.21.15.42:0/663901150 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:33.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.721+0000 7f898f400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314b2218d0 0x56314b649c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:57530/0 (socket says 172.21.15.42:57530) 2024-09-17T01:35:33.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.721+0000 7f898fe00640 1 --2- 172.21.15.42:0/663901150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314b24a790 0x56314b60a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.721+0000 7f898f400640 1 -- 172.21.15.42:0/663901150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314b24a790 msgr2=0x56314b60a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:33.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.721+0000 7f898f400640 1 --2- 172.21.15.42:0/663901150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314b24a790 0x56314b60a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.721+0000 7f898f400640 1 -- 172.21.15.42:0/663901150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b229ab0 msgr2=0x56314b632d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:33.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.721+0000 7f898f400640 1 --2- 172.21.15.42:0/663901150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b229ab0 0x56314b632d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.721+0000 7f898f400640 1 -- 172.21.15.42:0/663901150 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x56314b293aa0 con 0x56314b2218d0 2024-09-17T01:35:33.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.721+0000 7f8987e00640 1 --2- 172.21.15.42:0/663901150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b229ab0 0x56314b632d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:35:33.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.721+0000 7f898f400640 1 --2- 172.21.15.42:0/663901150 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314b2218d0 0x56314b649c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f89800b9750 tx=0x7f8980082870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcfc1ff825403660 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:33.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.721+0000 7f897cc00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3301/0 2024-09-17T01:35:33.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.722+0000 7f897cc00640 1 -- 172.21.15.42:0/663901150 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89800a9030 con 0x56314b2218d0 2024-09-17T01:35:33.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.722+0000 7f899d675740 1 -- 172.21.15.42:0/663901150 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89780216e0 con 0x56314b2218d0 2024-09-17T01:35:33.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.722+0000 7f897cc00640 1 -- 172.21.15.42:0/663901150 <== mon.2 v2:172.21.15.43:3301/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f89800a91d0 con 0x56314b2218d0 2024-09-17T01:35:33.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.722+0000 7f897cc00640 1 -- 172.21.15.42:0/663901150 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8980048040 con 0x56314b2218d0 2024-09-17T01:35:33.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.722+0000 7f899d675740 10 client.5231 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:33.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.722+0000 7f899d675740 1 -- 172.21.15.42:0/663901150 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x56314b38f390 con 0x56314b2218d0 2024-09-17T01:35:33.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.722+0000 7f897cc00640 1 -- 172.21.15.42:0/663901150 <== mon.2 v2:172.21.15.43:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89780216e0 con 0x56314b2218d0 2024-09-17T01:35:33.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.722+0000 7f897cc00640 1 -- 172.21.15.42:0/663901150 <== mon.2 v2:172.21.15.43:3301/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f89800832a0 con 0x56314b2218d0 2024-09-17T01:35:33.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.722+0000 7f899d675740 10 client.5231 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:33.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.722+0000 7f899d675740 10 client.5231 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:33.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.722+0000 7f899d675740 20 client.5231 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:33.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.723+0000 7f899d675740 1 --2- 172.21.15.42:0/663901150 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56314b209360 0x56314b5f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.723+0000 7f899d675740 4 client.5231 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:33.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.723+0000 7f899d675740 1 -- 172.21.15.42:0/663901150 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56314b566980 con 0x56314b209360 2024-09-17T01:35:33.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.723+0000 7f8987e00640 1 --2- 172.21.15.42:0/663901150 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56314b209360 0x56314b5f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.723+0000 7f8987e00640 1 --2- 172.21.15.42:0/663901150 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56314b209360 0x56314b5f11e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60d639fb9d9a20c6 server_cookie=85bbf8e6d8b63ad9 in_seq=0 out_seq=0 2024-09-17T01:35:33.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.723+0000 7f897cc00640 10 client.5231 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:33.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.724+0000 7f897cc00640 1 -- 172.21.15.42:0/663901150 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56314b566980 con 0x56314b209360 2024-09-17T01:35:33.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.724+0000 7f897cc00640 10 client.5231 handle_command_reply: tid=0 2024-09-17T01:35:33.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.724+0000 7f899d675740 1 client.5231 shutdown 2024-09-17T01:35:33.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.724+0000 7f899d675740 1 -- 172.21.15.42:0/663901150 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314b2218d0 msgr2=0x56314b649c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:33.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.724+0000 7f899d675740 1 --2- 172.21.15.42:0/663901150 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314b2218d0 0x56314b649c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f89800b9750 tx=0x7f8980082870 comp rx=0 tx=0).stop 2024-09-17T01:35:33.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.725+0000 7f899d675740 1 -- 172.21.15.42:0/663901150 shutdown_connections 2024-09-17T01:35:33.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.725+0000 7f899d675740 1 --2- 172.21.15.42:0/663901150 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56314b209360 0x56314b5f11e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.725+0000 7f899d675740 1 --2- 172.21.15.42:0/663901150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314b24a790 0x56314b60a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.725+0000 7f899d675740 1 --2- 172.21.15.42:0/663901150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b229ab0 0x56314b632d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.725+0000 7f897cc00640 0 client.5231 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:33.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.725+0000 7f899d675740 1 --2- 172.21.15.42:0/663901150 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314b2218d0 0x56314b649c50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.725+0000 7f899d675740 1 -- 172.21.15.42:0/663901150 >> 172.21.15.42:0/663901150 conn(0x56314b23e8e0 msgr2=0x56314b63a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:33.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.725+0000 7f899d675740 1 -- 172.21.15.42:0/663901150 shutdown_connections 2024-09-17T01:35:33.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.725+0000 7f899d675740 1 -- 172.21.15.42:0/663901150 wait complete. 2024-09-17T01:35:33.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.725+0000 7f899d675740 20 client.5231 trim_cache size 0 max 16384 2024-09-17T01:35:33.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.744+0000 7f899d675740 1 Processor -- start 2024-09-17T01:35:33.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.744+0000 7f899d675740 1 -- start start 2024-09-17T01:35:33.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.745+0000 7f899d675740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314b2218d0 0x56314b648cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.745+0000 7f899d675740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314b229ab0 0x56314b63a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.745+0000 7f899d675740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b24a790 0x56314b63aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.745+0000 7f899d675740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8990202120 con 0x56314b24a790 2024-09-17T01:35:33.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.745+0000 7f899d675740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8990201160 con 0x56314b2218d0 2024-09-17T01:35:33.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.745+0000 7f899d675740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f89901e8e10 con 0x56314b229ab0 2024-09-17T01:35:33.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.746+0000 7f898fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b24a790 0x56314b63aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.746+0000 7f898fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b24a790 0x56314b63aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37894/0 (socket says 172.21.15.42:37894) 2024-09-17T01:35:33.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.746+0000 7f898fe00640 1 -- 172.21.15.42:0/3951783185 learned_addr learned my addr 172.21.15.42:0/3951783185 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:33.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.746+0000 7f8987e00640 1 --2- 172.21.15.42:0/3951783185 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314b229ab0 0x56314b63a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.746+0000 7f898f400640 1 --2- 172.21.15.42:0/3951783185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314b2218d0 0x56314b648cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.746+0000 7f898fe00640 1 -- 172.21.15.42:0/3951783185 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314b229ab0 msgr2=0x56314b63a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:33.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.746+0000 7f898fe00640 1 --2- 172.21.15.42:0/3951783185 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314b229ab0 0x56314b63a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.746+0000 7f898fe00640 1 -- 172.21.15.42:0/3951783185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314b2218d0 msgr2=0x56314b648cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:33.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.746+0000 7f898fe00640 1 --2- 172.21.15.42:0/3951783185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314b2218d0 0x56314b648cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.746+0000 7f898fe00640 1 -- 172.21.15.42:0/3951783185 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56314b32cf00 con 0x56314b24a790 2024-09-17T01:35:33.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.746+0000 7f898fe00640 1 --2- 172.21.15.42:0/3951783185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b24a790 0x56314b63aa80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8988003cc0 tx=0x7f8988004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd5383147660e9c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:33.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.747+0000 7f897f400640 1 -- 172.21.15.42:0/3951783185 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8988020070 con 0x56314b24a790 2024-09-17T01:35:33.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.747+0000 7f897f400640 1 -- 172.21.15.42:0/3951783185 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8988010630 con 0x56314b24a790 2024-09-17T01:35:33.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.747+0000 7f897f400640 1 -- 172.21.15.42:0/3951783185 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8988010a00 con 0x56314b24a790 2024-09-17T01:35:33.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.747+0000 7f899d675740 1 -- 172.21.15.42:0/3951783185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b24a790 msgr2=0x56314b63aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:33.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.747+0000 7f899d675740 1 --2- 172.21.15.42:0/3951783185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b24a790 0x56314b63aa80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8988003cc0 tx=0x7f8988004410 comp rx=0 tx=0).stop 2024-09-17T01:35:33.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.748+0000 7f899d675740 1 -- 172.21.15.42:0/3951783185 shutdown_connections 2024-09-17T01:35:33.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.748+0000 7f899d675740 1 --2- 172.21.15.42:0/3951783185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b24a790 0x56314b63aa80 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.748+0000 7f899d675740 1 --2- 172.21.15.42:0/3951783185 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314b229ab0 0x56314b63a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.748+0000 7f899d675740 1 --2- 172.21.15.42:0/3951783185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314b2218d0 0x56314b648cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.748+0000 7f899d675740 1 -- 172.21.15.42:0/3951783185 >> 172.21.15.42:0/3951783185 conn(0x56314b23e8e0 msgr2=0x56314b630af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:33.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.748+0000 7f899d675740 1 -- 172.21.15.42:0/3951783185 shutdown_connections 2024-09-17T01:35:33.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.748+0000 7f899d675740 1 -- 172.21.15.42:0/3951783185 wait complete. 2024-09-17T01:35:33.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.749+0000 7f899d675740 1 -- start start 2024-09-17T01:35:33.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.749+0000 7f899d675740 1 Processor -- start 2024-09-17T01:35:33.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.750+0000 7f899d675740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b2218d0 0x56314b6b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.750+0000 7f899d675740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314b229ab0 0x56314b618b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.750+0000 7f899d675740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314b24a790 0x56314b6312c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.750+0000 7f899d675740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f899015dd10 con 0x56314b2218d0 2024-09-17T01:35:33.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.750+0000 7f899d675740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56314b5f1c20 con 0x56314b229ab0 2024-09-17T01:35:33.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.750+0000 7f899d675740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56314b631e60 con 0x56314b24a790 2024-09-17T01:35:33.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.750+0000 7f899d675740 10 client.0 _ll_register_callbacks cb 0x7f8980082ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.751+0000 7f898f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b2218d0 0x56314b6b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.751+0000 7f898f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b2218d0 0x56314b6b4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37908/0 (socket says 172.21.15.42:37908) 2024-09-17T01:35:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.751+0000 7f898f400640 1 -- 172.21.15.42:0/1379887093 learned_addr learned my addr 172.21.15.42:0/1379887093 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.751+0000 7f8987e00640 1 --2- 172.21.15.42:0/1379887093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314b229ab0 0x56314b618b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.751+0000 7f898fe00640 1 --2- 172.21.15.42:0/1379887093 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314b24a790 0x56314b6312c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.751+0000 7f898f400640 1 -- 172.21.15.42:0/1379887093 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314b24a790 msgr2=0x56314b6312c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.751+0000 7f898f400640 1 --2- 172.21.15.42:0/1379887093 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314b24a790 0x56314b6312c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.751+0000 7f898f400640 1 -- 172.21.15.42:0/1379887093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314b229ab0 msgr2=0x56314b618b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.751+0000 7f898f400640 1 --2- 172.21.15.42:0/1379887093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314b229ab0 0x56314b618b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.751+0000 7f898f400640 1 -- 172.21.15.42:0/1379887093 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56314b6b54b0 con 0x56314b2218d0 2024-09-17T01:35:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.751+0000 7f898fe00640 1 --2- 172.21.15.42:0/1379887093 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314b24a790 0x56314b6312c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.751+0000 7f898f400640 1 --2- 172.21.15.42:0/1379887093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b2218d0 0x56314b6b4f70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f89800099c0 tx=0x7f898008c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe9ac7cecd18e2c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:33.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.751+0000 7f897cc00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.752+0000 7f897cc00640 1 -- 172.21.15.42:0/1379887093 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89800a9040 con 0x56314b2218d0 2024-09-17T01:35:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.752+0000 7f897cc00640 1 -- 172.21.15.42:0/1379887093 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f898007f2b0 con 0x56314b2218d0 2024-09-17T01:35:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.752+0000 7f899d675740 1 -- 172.21.15.42:0/1379887093 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8988010630 con 0x56314b2218d0 2024-09-17T01:35:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.752+0000 7f897cc00640 1 -- 172.21.15.42:0/1379887093 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8980094050 con 0x56314b2218d0 2024-09-17T01:35:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.752+0000 7f899d675740 10 client.5679 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.752+0000 7f899d675740 1 -- 172.21.15.42:0/1379887093 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x56314b6b54b0 con 0x56314b2218d0 2024-09-17T01:35:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.752+0000 7f897cc00640 1 -- 172.21.15.42:0/1379887093 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8988010630 con 0x56314b2218d0 2024-09-17T01:35:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.752+0000 7f897cc00640 1 -- 172.21.15.42:0/1379887093 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f8980097020 con 0x56314b2218d0 2024-09-17T01:35:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.752+0000 7f899d675740 10 client.5679 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.752+0000 7f899d675740 10 client.5679 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.752+0000 7f899d675740 20 client.5679 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.752+0000 7f899d675740 1 --2- 172.21.15.42:0/1379887093 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56314b6587d0 0x56314b658be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.752+0000 7f899d675740 4 client.5679 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2024-09-17T01:35:33.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.752+0000 7f899d675740 1 -- 172.21.15.42:0/1379887093 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) -- 0x56314b562430 con 0x56314b6587d0 2024-09-17T01:35:33.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.753+0000 7f8987e00640 1 --2- 172.21.15.42:0/1379887093 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56314b6587d0 0x56314b658be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:33.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.753+0000 7f8987e00640 1 --2- 172.21.15.42:0/1379887093 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56314b6587d0 0x56314b658be0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e98b8e1dec26e8c server_cookie=3be6185e0efbe5e9 in_seq=0 out_seq=0 2024-09-17T01:35:33.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.753+0000 7f897cc00640 10 client.5679 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:33.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.754+0000 7f897cc00640 1 -- 172.21.15.42:0/1379887093 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56314b562430 con 0x56314b6587d0 2024-09-17T01:35:33.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.754+0000 7f897cc00640 10 client.5679 handle_command_reply: tid=0 2024-09-17T01:35:33.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.754+0000 7f899d675740 1 client.5679 shutdown 2024-09-17T01:35:33.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.754+0000 7f899d675740 1 -- 172.21.15.42:0/1379887093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b2218d0 msgr2=0x56314b6b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:33.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.754+0000 7f899d675740 1 --2- 172.21.15.42:0/1379887093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b2218d0 0x56314b6b4f70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f89800099c0 tx=0x7f898008c7d0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.754+0000 7f899d675740 1 -- 172.21.15.42:0/1379887093 shutdown_connections 2024-09-17T01:35:33.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.754+0000 7f899d675740 1 --2- 172.21.15.42:0/1379887093 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56314b6587d0 0x56314b658be0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.754+0000 7f899d675740 1 --2- 172.21.15.42:0/1379887093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314b229ab0 0x56314b618b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.754+0000 7f899d675740 1 --2- 172.21.15.42:0/1379887093 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314b24a790 0x56314b6312c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.754+0000 7f899d675740 1 --2- 172.21.15.42:0/1379887093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314b2218d0 0x56314b6b4f70 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.754+0000 7f899d675740 1 -- 172.21.15.42:0/1379887093 >> 172.21.15.42:0/1379887093 conn(0x56314b23e8e0 msgr2=0x56314b649a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:33.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.754+0000 7f897cc00640 0 client.5679 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:33.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.754+0000 7f899d675740 1 -- 172.21.15.42:0/1379887093 shutdown_connections 2024-09-17T01:35:33.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.754+0000 7f899d675740 1 -- 172.21.15.42:0/1379887093 wait complete. 2024-09-17T01:35:33.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.754+0000 7f899d675740 20 client.5679 trim_cache size 0 max 16384 2024-09-17T01:35:33.757 INFO:tasks.ceph.mds.c.smithi042.stderr:2024-09-17T01:35:33.755+0000 7f1950c00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a4c [2,head] /scrub_test_path/ceph-qa-suite/new_file_0 auth v431 pv433 ap=4 s=0 n(v0 1=1+0)->n(v0 rc2024-09-17T01:35:32.534891+0000 b1048576 1=1+0) (iauth excl) (ifile lock->excl w=1) (ixattr excl) (iquiesce lock w=1) cr={5356=0-4194304@1} caps={5356=pAsxLsXsxFcb/pAsxXsxFxwb@3},l=5356 | ptrwaiter=1 request=1 lock=3 caps=1 dirtyparent=0 dirty=0 waiter=1 authpin=1 scrubqueue=0 0x557114415700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000a4c:[<0x10000000001/new_file_0 v431>,<0x10000000000/ceph-qa-suite v51>,<0x1/scrub_test_path v22>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-09-17T01:35:33.757 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:33.757 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-17T01:35:33.757 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "0a9c13dc-362e-4bde-95c2-3e723b5c9972", 2024-09-17T01:35:33.757 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-17T01:35:33.757 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:33.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.755+0000 7f8995000640 1 -- 172.21.15.42:0/563256050 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f896c078b90 msgr2=0x7f896c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:33.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.755+0000 7f8995000640 1 --2- 172.21.15.42:0/563256050 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f896c078b90 0x7f896c07b0a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f899006ff60 tx=0x7f8978009040 comp rx=0 tx=0).stop 2024-09-17T01:35:33.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.755+0000 7f8995000640 1 -- 172.21.15.42:0/563256050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8990073d50 msgr2=0x7f8990152710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:33.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.755+0000 7f8995000640 1 --2- 172.21.15.42:0/563256050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8990073d50 0x7f8990152710 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f8980034040 tx=0x7f8980003820 comp rx=0 tx=0).stop 2024-09-17T01:35:33.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.755+0000 7f8995000640 1 -- 172.21.15.42:0/563256050 shutdown_connections 2024-09-17T01:35:33.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.755+0000 7f8995000640 1 --2- 172.21.15.42:0/563256050 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f896c078b90 0x7f896c07b0a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.755+0000 7f8995000640 1 --2- 172.21.15.42:0/563256050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8990162e90 0x7f899015f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.755+0000 7f8995000640 1 --2- 172.21.15.42:0/563256050 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8990152cf0 0x7f899015f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.755+0000 7f8995000640 1 --2- 172.21.15.42:0/563256050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8990073d50 0x7f8990152710 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:33.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.755+0000 7f8995000640 1 -- 172.21.15.42:0/563256050 >> 172.21.15.42:0/563256050 conn(0x7f899006d890 msgr2=0x7f8990153a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:33.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.755+0000 7f8995000640 1 -- 172.21.15.42:0/563256050 shutdown_connections 2024-09-17T01:35:33.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:33.755+0000 7f8995000640 1 -- 172.21.15.42:0/563256050 wait complete. 2024-09-17T01:35:33.778 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'return_code': 0, 'scrub_tag': '0a9c13dc-362e-4bde-95c2-3e723b5c9972', 'mode': 'asynchronous'}' 2024-09-17T01:35:33.778 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T01:35:33.778 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-17T01:35:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.009+0000 7fd0abe00640 1 -- 172.21.15.42:0/2982935724 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0a415f480 msgr2=0x7fd0a415f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.009+0000 7fd0abe00640 1 --2- 172.21.15.42:0/2982935724 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0a415f480 0x7fd0a415f890 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd09c005fd0 tx=0x7fd09c02a7a0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.010+0000 7fd0abe00640 1 -- 172.21.15.42:0/2982935724 shutdown_connections 2024-09-17T01:35:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.010+0000 7fd0abe00640 1 --2- 172.21.15.42:0/2982935724 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0a415f480 0x7fd0a415f890 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.010+0000 7fd0abe00640 1 --2- 172.21.15.42:0/2982935724 >> v2:172.21.15.43:3300/0 conn(0x7fd0a406d430 0x7fd0a406d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.010+0000 7fd0abe00640 1 -- 172.21.15.42:0/2982935724 >> 172.21.15.42:0/2982935724 conn(0x7fd0a40b2930 msgr2=0x7fd0a406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.010+0000 7fd0abe00640 1 -- 172.21.15.42:0/2982935724 shutdown_connections 2024-09-17T01:35:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.010+0000 7fd0abe00640 1 -- 172.21.15.42:0/2982935724 wait complete. 2024-09-17T01:35:34.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.012+0000 7fd0abe00640 1 Processor -- start 2024-09-17T01:35:34.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.012+0000 7fd0abe00640 1 -- start start 2024-09-17T01:35:34.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.014+0000 7fd0abe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0a406d430 0x7fd0a4145e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:34.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.014+0000 7fd0abe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0a415cb80 0x7fd0a415dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:34.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.014+0000 7fd0abe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a415f480 0x7fd0a415e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:34.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.014+0000 7fd0abe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a40736a0 con 0x7fd0a415f480 2024-09-17T01:35:34.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.014+0000 7fd0abe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a415ff90 con 0x7fd0a406d430 2024-09-17T01:35:34.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.014+0000 7fd0abe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd0a4073820 con 0x7fd0a415cb80 2024-09-17T01:35:34.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.014+0000 7fd0a9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a415f480 0x7fd0a415e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:34.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.014+0000 7fd0a9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a415f480 0x7fd0a415e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37924/0 (socket says 172.21.15.42:37924) 2024-09-17T01:35:34.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.014+0000 7fd0a9e00640 1 -- 172.21.15.42:0/1043709003 learned_addr learned my addr 172.21.15.42:0/1043709003 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:34.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.014+0000 7fd0a9400640 1 --2- 172.21.15.42:0/1043709003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0a406d430 0x7fd0a4145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:34.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.014+0000 7fd0a8a00640 1 --2- 172.21.15.42:0/1043709003 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0a415cb80 0x7fd0a415dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:34.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.014+0000 7fd0a9e00640 1 -- 172.21.15.42:0/1043709003 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0a415cb80 msgr2=0x7fd0a415dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:34.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.014+0000 7fd0a9e00640 1 --2- 172.21.15.42:0/1043709003 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0a415cb80 0x7fd0a415dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.014+0000 7fd0a9e00640 1 -- 172.21.15.42:0/1043709003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0a406d430 msgr2=0x7fd0a4145e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:34.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.014+0000 7fd0a9e00640 1 --2- 172.21.15.42:0/1043709003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0a406d430 0x7fd0a4145e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.014+0000 7fd0a9e00640 1 -- 172.21.15.42:0/1043709003 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a40af060 con 0x7fd0a415f480 2024-09-17T01:35:34.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.015+0000 7fd0a9e00640 1 --2- 172.21.15.42:0/1043709003 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a415f480 0x7fd0a415e520 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd09c009cd0 tx=0x7fd09c032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:34.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.015+0000 7fd0a1600640 1 -- 172.21.15.42:0/1043709003 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c041020 con 0x7fd0a415f480 2024-09-17T01:35:34.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.015+0000 7fd0abe00640 1 -- 172.21.15.42:0/1043709003 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0a40af320 con 0x7fd0a415f480 2024-09-17T01:35:34.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.015+0000 7fd0a1600640 1 -- 172.21.15.42:0/1043709003 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd09c032e50 con 0x7fd0a415f480 2024-09-17T01:35:34.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.015+0000 7fd0a1600640 1 -- 172.21.15.42:0/1043709003 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c036040 con 0x7fd0a415f480 2024-09-17T01:35:34.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.015+0000 7fd0abe00640 1 -- 172.21.15.42:0/1043709003 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0a4153dd0 con 0x7fd0a415f480 2024-09-17T01:35:34.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.018+0000 7fd0a1600640 1 -- 172.21.15.42:0/1043709003 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd09c044020 con 0x7fd0a415f480 2024-09-17T01:35:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.019+0000 7fd0a1600640 1 --2- 172.21.15.42:0/1043709003 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd084078b90 0x7fd08407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.019+0000 7fd0a1600640 1 -- 172.21.15.42:0/1043709003 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fd09c0bbda0 con 0x7fd0a415f480 2024-09-17T01:35:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.020+0000 7fd0b2e59740 1 Processor -- start 2024-09-17T01:35:34.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.020+0000 7fd0a9400640 1 --2- 172.21.15.42:0/1043709003 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd084078b90 0x7fd08407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:34.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.020+0000 7fd0b2e59740 1 -- start start 2024-09-17T01:35:34.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.021+0000 7fd0a9400640 1 --2- 172.21.15.42:0/1043709003 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd084078b90 0x7fd08407b0a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd098001eb0 tx=0x7fd098009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:34.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.021+0000 7fd0b2e59740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563855927390 0x563855d15550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:34.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.021+0000 7fd0b2e59740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638558fe4d0 0x563855cf8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:34.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.021+0000 7fd0b2e59740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638559066b0 0x563855cf8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:34.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.021+0000 7fd0b2e59740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563855c2e1c0 con 0x563855927390 2024-09-17T01:35:34.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.021+0000 7fd0b2e59740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563855c41870 con 0x5638559066b0 2024-09-17T01:35:34.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.021+0000 7fd0b2e59740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x563855c30ca0 con 0x5638558fe4d0 2024-09-17T01:35:34.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.022+0000 7fd0a9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563855927390 0x563855d15550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:34.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.022+0000 7fd0a9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563855927390 0x563855d15550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37938/0 (socket says 172.21.15.42:37938) 2024-09-17T01:35:34.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.022+0000 7fd0a9400640 1 -- 172.21.15.42:0/743458833 learned_addr learned my addr 172.21.15.42:0/743458833 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:34.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.022+0000 7fd0a8a00640 1 --2- 172.21.15.42:0/743458833 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638558fe4d0 0x563855cf8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:34.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.022+0000 7fd0a9e00640 1 --2- 172.21.15.42:0/743458833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638559066b0 0x563855cf8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:34.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.022+0000 7fd0a9400640 1 -- 172.21.15.42:0/743458833 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638558fe4d0 msgr2=0x563855cf8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:34.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.022+0000 7fd0a9400640 1 --2- 172.21.15.42:0/743458833 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638558fe4d0 0x563855cf8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.022+0000 7fd0a9400640 1 -- 172.21.15.42:0/743458833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638559066b0 msgr2=0x563855cf8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:34.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.022+0000 7fd0a9400640 1 --2- 172.21.15.42:0/743458833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638559066b0 0x563855cf8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.022+0000 7fd0a9400640 1 -- 172.21.15.42:0/743458833 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563855a097d0 con 0x563855927390 2024-09-17T01:35:34.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.022+0000 7fd0a8a00640 1 --2- 172.21.15.42:0/743458833 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638558fe4d0 0x563855cf8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:34.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.022+0000 7fd0a9e00640 1 --2- 172.21.15.42:0/743458833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638559066b0 0x563855cf8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:34.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.023+0000 7fd0a9400640 1 --2- 172.21.15.42:0/743458833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563855927390 0x563855d15550 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd09800e810 tx=0x7fd098011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4ea530eb479ac5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:34.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.023+0000 7fd095c00640 1 -- 172.21.15.42:0/743458833 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd098025070 con 0x563855927390 2024-09-17T01:35:34.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.023+0000 7fd095c00640 1 -- 172.21.15.42:0/743458833 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd098015bc0 con 0x563855927390 2024-09-17T01:35:34.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.023+0000 7fd095c00640 1 -- 172.21.15.42:0/743458833 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd098020400 con 0x563855927390 2024-09-17T01:35:34.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.024+0000 7fd0b2e59740 1 -- 172.21.15.42:0/743458833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563855927390 msgr2=0x563855d15550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:34.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.024+0000 7fd0b2e59740 1 --2- 172.21.15.42:0/743458833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563855927390 0x563855d15550 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd09800e810 tx=0x7fd098011000 comp rx=0 tx=0).stop 2024-09-17T01:35:34.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.024+0000 7fd0b2e59740 1 -- 172.21.15.42:0/743458833 shutdown_connections 2024-09-17T01:35:34.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.024+0000 7fd0b2e59740 1 --2- 172.21.15.42:0/743458833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638559066b0 0x563855cf8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.024+0000 7fd0b2e59740 1 --2- 172.21.15.42:0/743458833 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638558fe4d0 0x563855cf8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.024+0000 7fd0b2e59740 1 --2- 172.21.15.42:0/743458833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563855927390 0x563855d15550 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.024+0000 7fd0b2e59740 1 -- 172.21.15.42:0/743458833 >> 172.21.15.42:0/743458833 conn(0x56385591b4e0 msgr2=0x563855cce440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:34.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.024+0000 7fd0b2e59740 1 -- 172.21.15.42:0/743458833 shutdown_connections 2024-09-17T01:35:34.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.024+0000 7fd0b2e59740 1 -- 172.21.15.42:0/743458833 wait complete. 2024-09-17T01:35:34.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.025+0000 7fd0b2e59740 1 -- start start 2024-09-17T01:35:34.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.025+0000 7fd0b2e59740 1 Processor -- start 2024-09-17T01:35:34.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.027+0000 7fd0b2e59740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638558fe4d0 0x563855cf5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:34.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.027+0000 7fd0b2e59740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638559066b0 0x563855d0c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:34.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.027+0000 7fd0b2e59740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563855927390 0x563855d257d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:34.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.027+0000 7fd0b2e59740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563855bd7410 con 0x5638558fe4d0 2024-09-17T01:35:34.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.027+0000 7fd0b2e59740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563855c34ab0 con 0x563855927390 2024-09-17T01:35:34.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.027+0000 7fd0b2e59740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5638559a1740 con 0x5638559066b0 2024-09-17T01:35:34.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.027+0000 7fd0b2e59740 10 client.0 _ll_register_callbacks cb 0x563855bb4360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:34.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.027+0000 7fd0a9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638558fe4d0 0x563855cf5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:34.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.027+0000 7fd0a9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638558fe4d0 0x563855cf5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37942/0 (socket says 172.21.15.42:37942) 2024-09-17T01:35:34.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.027+0000 7fd0a9400640 1 -- 172.21.15.42:0/579137248 learned_addr learned my addr 172.21.15.42:0/579137248 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:34.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.027+0000 7fd0a8a00640 1 --2- 172.21.15.42:0/579137248 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638559066b0 0x563855d0c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:34.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.027+0000 7fd0a9e00640 1 --2- 172.21.15.42:0/579137248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563855927390 0x563855d257d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:34.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.027+0000 7fd0a9400640 1 -- 172.21.15.42:0/579137248 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638559066b0 msgr2=0x563855d0c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:34.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.027+0000 7fd0a9400640 1 --2- 172.21.15.42:0/579137248 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638559066b0 0x563855d0c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.027+0000 7fd0a9400640 1 -- 172.21.15.42:0/579137248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563855927390 msgr2=0x563855d257d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:34.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.027+0000 7fd0a9400640 1 --2- 172.21.15.42:0/579137248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563855927390 0x563855d257d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.027+0000 7fd0a9400640 1 -- 172.21.15.42:0/579137248 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563855992970 con 0x5638558fe4d0 2024-09-17T01:35:34.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.027+0000 7fd0a9e00640 1 --2- 172.21.15.42:0/579137248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563855927390 0x563855d257d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:34.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.028+0000 7fd0a9400640 1 --2- 172.21.15.42:0/579137248 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638558fe4d0 0x563855cf5240 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd098023040 tx=0x7fd098000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0c62f37038ef0a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:34.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.028+0000 7fd08a000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:34.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.028+0000 7fd08a000640 1 -- 172.21.15.42:0/579137248 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd098025040 con 0x5638558fe4d0 2024-09-17T01:35:34.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.028+0000 7fd0b2e59740 1 -- 172.21.15.42:0/579137248 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd098015bc0 con 0x5638558fe4d0 2024-09-17T01:35:34.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.028+0000 7fd08a000640 1 -- 172.21.15.42:0/579137248 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fd098020800 con 0x5638558fe4d0 2024-09-17T01:35:34.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.028+0000 7fd08a000640 1 -- 172.21.15.42:0/579137248 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd098035050 con 0x5638558fe4d0 2024-09-17T01:35:34.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.028+0000 7fd0b2e59740 10 client.5691 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:34.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.028+0000 7fd0b2e59740 1 -- 172.21.15.42:0/579137248 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x5638559706a0 con 0x5638558fe4d0 2024-09-17T01:35:34.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.029+0000 7fd08a000640 1 -- 172.21.15.42:0/579137248 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd098015bc0 con 0x5638558fe4d0 2024-09-17T01:35:34.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.029+0000 7fd08a000640 1 -- 172.21.15.42:0/579137248 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7fd098038020 con 0x5638558fe4d0 2024-09-17T01:35:34.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.029+0000 7fd0b2e59740 10 client.5691 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:34.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.029+0000 7fd0b2e59740 10 client.5691 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:34.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.029+0000 7fd0b2e59740 20 client.5691 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:34.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.029+0000 7fd0b2e59740 1 --2- 172.21.15.42:0/579137248 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5638558e5f60 0x563855cf0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:34.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.029+0000 7fd0b2e59740 4 client.5691 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:34.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.029+0000 7fd0b2e59740 1 -- 172.21.15.42:0/579137248 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563855c437c0 con 0x5638558e5f60 2024-09-17T01:35:34.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.029+0000 7fd0a8a00640 1 --2- 172.21.15.42:0/579137248 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5638558e5f60 0x563855cf0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:34.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.030+0000 7fd08a000640 10 client.5691 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:34.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.030+0000 7fd0a8a00640 1 --2- 172.21.15.42:0/579137248 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5638558e5f60 0x563855cf0550 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd8a4c9dcf3503f server_cookie=979602a394b8d4cb in_seq=0 out_seq=0 2024-09-17T01:35:34.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.030+0000 7fd08a000640 1 -- 172.21.15.42:0/579137248 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563855c437c0 con 0x5638558e5f60 2024-09-17T01:35:34.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.030+0000 7fd08a000640 10 client.5691 handle_command_reply: tid=0 2024-09-17T01:35:34.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.030+0000 7fd0b2e59740 1 client.5691 shutdown 2024-09-17T01:35:34.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.031+0000 7fd0b2e59740 1 -- 172.21.15.42:0/579137248 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638558fe4d0 msgr2=0x563855cf5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:34.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.031+0000 7fd0b2e59740 1 --2- 172.21.15.42:0/579137248 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638558fe4d0 0x563855cf5240 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd098023040 tx=0x7fd098000ed0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.031+0000 7fd0b2e59740 1 -- 172.21.15.42:0/579137248 shutdown_connections 2024-09-17T01:35:34.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.031+0000 7fd0b2e59740 1 --2- 172.21.15.42:0/579137248 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5638558e5f60 0x563855cf0550 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.031+0000 7fd0b2e59740 1 --2- 172.21.15.42:0/579137248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563855927390 0x563855d257d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.031+0000 7fd0b2e59740 1 --2- 172.21.15.42:0/579137248 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638559066b0 0x563855d0c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.031+0000 7fd0b2e59740 1 --2- 172.21.15.42:0/579137248 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638558fe4d0 0x563855cf5240 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.031+0000 7fd08a000640 0 client.5691 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:34.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.031+0000 7fd0b2e59740 1 -- 172.21.15.42:0/579137248 >> 172.21.15.42:0/579137248 conn(0x56385591b4e0 msgr2=0x563855cc7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:34.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.031+0000 7fd0b2e59740 1 -- 172.21.15.42:0/579137248 shutdown_connections 2024-09-17T01:35:34.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.031+0000 7fd0b2e59740 1 -- 172.21.15.42:0/579137248 wait complete. 2024-09-17T01:35:34.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.031+0000 7fd0b2e59740 20 client.5691 trim_cache size 0 max 16384 2024-09-17T01:35:34.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.050+0000 7fd0b2e59740 1 Processor -- start 2024-09-17T01:35:34.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.050+0000 7fd0b2e59740 1 -- start start 2024-09-17T01:35:34.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.051+0000 7fd0b2e59740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638558fe4d0 0x563855cf4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:34.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.051+0000 7fd0b2e59740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638559066b0 0x563855d0b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:34.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.051+0000 7fd0b2e59740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563855927390 0x563855d35ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:34.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.051+0000 7fd0b2e59740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563855cc9cd0 con 0x563855927390 2024-09-17T01:35:34.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.051+0000 7fd0b2e59740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563855cf2ea0 con 0x5638558fe4d0 2024-09-17T01:35:34.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.051+0000 7fd0b2e59740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd0a42020e0 con 0x5638559066b0 2024-09-17T01:35:34.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.051+0000 7fd0a9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563855927390 0x563855d35ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:34.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.051+0000 7fd0a9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563855927390 0x563855d35ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37956/0 (socket says 172.21.15.42:37956) 2024-09-17T01:35:34.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.051+0000 7fd0a9e00640 1 -- 172.21.15.42:0/1661018992 learned_addr learned my addr 172.21.15.42:0/1661018992 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:34.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.052+0000 7fd0a9e00640 1 -- 172.21.15.42:0/1661018992 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638559066b0 msgr2=0x563855d0b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:34.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.052+0000 7fd0a9e00640 1 --2- 172.21.15.42:0/1661018992 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638559066b0 0x563855d0b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.052+0000 7fd0a9400640 1 --2- 172.21.15.42:0/1661018992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638558fe4d0 0x563855cf4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:34.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.052+0000 7fd0a9e00640 1 -- 172.21.15.42:0/1661018992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638558fe4d0 msgr2=0x563855cf4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:34.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.052+0000 7fd0a9e00640 1 --2- 172.21.15.42:0/1661018992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638558fe4d0 0x563855cf4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.052+0000 7fd0a9e00640 1 -- 172.21.15.42:0/1661018992 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563855cf51c0 con 0x563855927390 2024-09-17T01:35:34.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.052+0000 7fd0a9400640 1 --2- 172.21.15.42:0/1661018992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638558fe4d0 0x563855cf4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:34.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.052+0000 7fd0a9e00640 1 --2- 172.21.15.42:0/1661018992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563855927390 0x563855d35ce0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd09c083a70 tx=0x7fd09c083310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d65a668e38b2b57 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:34.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.052+0000 7fd095200640 1 -- 172.21.15.42:0/1661018992 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c0835f0 con 0x563855927390 2024-09-17T01:35:34.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.052+0000 7fd095200640 1 -- 172.21.15.42:0/1661018992 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd09c0841e0 con 0x563855927390 2024-09-17T01:35:34.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.052+0000 7fd095200640 1 -- 172.21.15.42:0/1661018992 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c083ae0 con 0x563855927390 2024-09-17T01:35:34.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.053+0000 7fd0b2e59740 1 -- 172.21.15.42:0/1661018992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563855927390 msgr2=0x563855d35ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:34.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.053+0000 7fd0b2e59740 1 --2- 172.21.15.42:0/1661018992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563855927390 0x563855d35ce0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd09c083a70 tx=0x7fd09c083310 comp rx=0 tx=0).stop 2024-09-17T01:35:34.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.053+0000 7fd0b2e59740 1 -- 172.21.15.42:0/1661018992 shutdown_connections 2024-09-17T01:35:34.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.053+0000 7fd0b2e59740 1 --2- 172.21.15.42:0/1661018992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563855927390 0x563855d35ce0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.053+0000 7fd0b2e59740 1 --2- 172.21.15.42:0/1661018992 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638559066b0 0x563855d0b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.053+0000 7fd0b2e59740 1 --2- 172.21.15.42:0/1661018992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638558fe4d0 0x563855cf4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.053+0000 7fd0b2e59740 1 -- 172.21.15.42:0/1661018992 >> 172.21.15.42:0/1661018992 conn(0x56385591b4e0 msgr2=0x563855ccdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:34.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.053+0000 7fd0b2e59740 1 -- 172.21.15.42:0/1661018992 shutdown_connections 2024-09-17T01:35:34.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.053+0000 7fd0b2e59740 1 -- 172.21.15.42:0/1661018992 wait complete. 2024-09-17T01:35:34.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.054+0000 7fd0b2e59740 1 -- start start 2024-09-17T01:35:34.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.054+0000 7fd0b2e59740 1 Processor -- start 2024-09-17T01:35:34.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.056+0000 7fd0b2e59740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638558fe4d0 0x563855d94d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:34.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.056+0000 7fd0b2e59740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638559066b0 0x563855d881d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:34.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.056+0000 7fd0b2e59740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563855927390 0x563855ceebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:34.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.056+0000 7fd0b2e59740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a41f9b50 con 0x5638559066b0 2024-09-17T01:35:34.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.056+0000 7fd0b2e59740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a4155560 con 0x5638558fe4d0 2024-09-17T01:35:34.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.056+0000 7fd0b2e59740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd0a4154f10 con 0x563855927390 2024-09-17T01:35:34.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.056+0000 7fd0b2e59740 10 client.0 _ll_register_callbacks cb 0x7fd098023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:34.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.056+0000 7fd0a9400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638558fe4d0 0x563855d94d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:34.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.056+0000 7fd0a8a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638559066b0 0x563855d881d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:34.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.056+0000 7fd0a9400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638558fe4d0 0x563855d94d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:59290/0 (socket says 172.21.15.42:59290) 2024-09-17T01:35:34.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.056+0000 7fd0a9400640 1 -- 172.21.15.42:0/2289595739 learned_addr learned my addr 172.21.15.42:0/2289595739 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:34.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.056+0000 7fd0a9e00640 1 --2- 172.21.15.42:0/2289595739 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563855927390 0x563855ceebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:34.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.056+0000 7fd0a8a00640 1 -- 172.21.15.42:0/2289595739 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563855927390 msgr2=0x563855ceebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:34.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.056+0000 7fd0a8a00640 1 --2- 172.21.15.42:0/2289595739 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563855927390 0x563855ceebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.056+0000 7fd0a8a00640 1 -- 172.21.15.42:0/2289595739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638558fe4d0 msgr2=0x563855d94d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:34.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.056+0000 7fd0a8a00640 1 --2- 172.21.15.42:0/2289595739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638558fe4d0 0x563855d94d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.056+0000 7fd0a8a00640 1 -- 172.21.15.42:0/2289595739 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563855d95370 con 0x5638559066b0 2024-09-17T01:35:34.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.056+0000 7fd0a9400640 1 --2- 172.21.15.42:0/2289595739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638558fe4d0 0x563855d94d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:35:34.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.057+0000 7fd0a8a00640 1 --2- 172.21.15.42:0/2289595739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638559066b0 0x563855d881d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x563855ccddb0 tx=0x7fd090014840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135c5111d62bfab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:34.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.057+0000 7fd08a000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:34.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.057+0000 7fd08a000640 1 -- 172.21.15.42:0/2289595739 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd090005020 con 0x5638559066b0 2024-09-17T01:35:34.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.057+0000 7fd08a000640 1 -- 172.21.15.42:0/2289595739 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fd0900051c0 con 0x5638559066b0 2024-09-17T01:35:34.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.057+0000 7fd0b2e59740 1 -- 172.21.15.42:0/2289595739 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd09c0841e0 con 0x5638559066b0 2024-09-17T01:35:34.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.057+0000 7fd08a000640 1 -- 172.21.15.42:0/2289595739 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd09002b050 con 0x5638559066b0 2024-09-17T01:35:34.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.057+0000 7fd0b2e59740 10 client.5697 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:34.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.057+0000 7fd0b2e59740 1 -- 172.21.15.42:0/2289595739 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x563855cef230 con 0x5638559066b0 2024-09-17T01:35:34.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.057+0000 7fd08a000640 1 -- 172.21.15.42:0/2289595739 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd09c0841e0 con 0x5638559066b0 2024-09-17T01:35:34.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.057+0000 7fd08a000640 1 -- 172.21.15.42:0/2289595739 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7fd09002e020 con 0x5638559066b0 2024-09-17T01:35:34.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.058+0000 7fd0b2e59740 10 client.5697 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:34.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.058+0000 7fd0b2e59740 10 client.5697 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:34.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.058+0000 7fd0b2e59740 20 client.5697 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:34.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.058+0000 7fd0b2e59740 1 --2- 172.21.15.42:0/2289595739 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x563855d91df0 0x563855d92200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:34.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.058+0000 7fd0b2e59740 4 client.5697 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:35:34.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.058+0000 7fd0b2e59740 1 -- 172.21.15.42:0/2289595739 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563855c3f270 con 0x563855d91df0 2024-09-17T01:35:34.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.058+0000 7fd0a9400640 1 --2- 172.21.15.42:0/2289595739 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x563855d91df0 0x563855d92200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:34.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.058+0000 7fd0a9400640 1 --2- 172.21.15.42:0/2289595739 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x563855d91df0 0x563855d92200 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2007743812a0e457 server_cookie=ffdb7aafc53d5f75 in_seq=0 out_seq=0 2024-09-17T01:35:34.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.058+0000 7fd08a000640 10 client.5697 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:34.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.059+0000 7fd08a000640 1 -- 172.21.15.42:0/2289595739 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2212 (crc 0 0 0) 0x563855c3f270 con 0x563855d91df0 2024-09-17T01:35:34.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.059+0000 7fd08a000640 10 client.5697 handle_command_reply: tid=0 2024-09-17T01:35:34.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.059+0000 7fd0b2e59740 1 client.5697 shutdown 2024-09-17T01:35:34.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.059+0000 7fd0b2e59740 1 -- 172.21.15.42:0/2289595739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638559066b0 msgr2=0x563855d881d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:34.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.059+0000 7fd0b2e59740 1 --2- 172.21.15.42:0/2289595739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638559066b0 0x563855d881d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x563855ccddb0 tx=0x7fd090014840 comp rx=0 tx=0).stop 2024-09-17T01:35:34.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.059+0000 7fd0b2e59740 1 -- 172.21.15.42:0/2289595739 shutdown_connections 2024-09-17T01:35:34.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.059+0000 7fd0b2e59740 1 --2- 172.21.15.42:0/2289595739 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x563855d91df0 0x563855d92200 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.059+0000 7fd0b2e59740 1 --2- 172.21.15.42:0/2289595739 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563855927390 0x563855ceebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.059+0000 7fd0b2e59740 1 --2- 172.21.15.42:0/2289595739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638559066b0 0x563855d881d0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.059+0000 7fd08a000640 0 client.5697 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:34.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.059+0000 7fd0b2e59740 1 --2- 172.21.15.42:0/2289595739 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638558fe4d0 0x563855d94d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.059+0000 7fd0b2e59740 1 -- 172.21.15.42:0/2289595739 >> 172.21.15.42:0/2289595739 conn(0x56385591b4e0 msgr2=0x563855ccdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:34.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.059+0000 7fd0b2e59740 1 -- 172.21.15.42:0/2289595739 shutdown_connections 2024-09-17T01:35:34.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.059+0000 7fd0b2e59740 1 -- 172.21.15.42:0/2289595739 wait complete. 2024-09-17T01:35:34.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.059+0000 7fd0b2e59740 20 client.5697 trim_cache size 0 max 16384 2024-09-17T01:35:34.062 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:34.062 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T01:35:34.062 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-09-17T01:35:34.062 INFO:teuthology.orchestra.run.smithi042.stdout: "0a9c13dc-362e-4bde-95c2-3e723b5c9972": { 2024-09-17T01:35:34.062 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-17T01:35:34.062 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "0a9c13dc-362e-4bde-95c2-3e723b5c9972", 2024-09-17T01:35:34.063 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "" 2024-09-17T01:35:34.063 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:34.063 INFO:teuthology.orchestra.run.smithi042.stdout: "1ab47091-12eb-4ca6-b40a-fff283cd28c5": { 2024-09-17T01:35:34.063 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-17T01:35:34.063 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "1ab47091-12eb-4ca6-b40a-fff283cd28c5", 2024-09-17T01:35:34.063 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "" 2024-09-17T01:35:34.063 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:34.063 INFO:teuthology.orchestra.run.smithi042.stdout: "769242e9-0529-44ae-ba31-8514cbaaf3fb": { 2024-09-17T01:35:34.063 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-17T01:35:34.063 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "769242e9-0529-44ae-ba31-8514cbaaf3fb", 2024-09-17T01:35:34.063 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "" 2024-09-17T01:35:34.063 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:34.063 INFO:teuthology.orchestra.run.smithi042.stdout: "da914a30-cdfa-4ea8-b8dd-7b052b0b6e40": { 2024-09-17T01:35:34.064 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-17T01:35:34.064 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "da914a30-cdfa-4ea8-b8dd-7b052b0b6e40", 2024-09-17T01:35:34.064 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "" 2024-09-17T01:35:34.064 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:34.064 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:34.064 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_stats": { 2024-09-17T01:35:34.064 INFO:teuthology.orchestra.run.smithi042.stdout: "da914a30-cdfa-4ea8-b8dd-7b052b0b6e40": { 2024-09-17T01:35:34.064 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:35:32.014895+0000", 2024-09-17T01:35:34.064 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-17T01:35:34.064 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:35:34.064 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:35:34.064 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:35:34.065 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:35:34.065 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:34.065 INFO:teuthology.orchestra.run.smithi042.stdout: "1ab47091-12eb-4ca6-b40a-fff283cd28c5": { 2024-09-17T01:35:34.065 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:35:31.413900+0000", 2024-09-17T01:35:34.065 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-17T01:35:34.065 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:35:34.065 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:35:34.065 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:35:34.065 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:35:34.065 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:34.065 INFO:teuthology.orchestra.run.smithi042.stdout: "0a9c13dc-362e-4bde-95c2-3e723b5c9972": { 2024-09-17T01:35:34.065 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:35:33.753881+0000", 2024-09-17T01:35:34.065 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-17T01:35:34.066 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:35:34.066 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:35:34.066 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:35:34.066 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:35:34.066 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:34.066 INFO:teuthology.orchestra.run.smithi042.stdout: "769242e9-0529-44ae-ba31-8514cbaaf3fb": { 2024-09-17T01:35:34.066 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:35:30.802905+0000", 2024-09-17T01:35:34.066 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-17T01:35:34.066 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:35:34.066 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:35:34.066 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:35:34.066 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:35:34.066 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:34.067 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:34.067 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:34.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.060+0000 7fd0abe00640 1 -- 172.21.15.42:0/1043709003 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd084078b90 msgr2=0x7fd08407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:34.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.060+0000 7fd0abe00640 1 --2- 172.21.15.42:0/1043709003 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd084078b90 0x7fd08407b0a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd098001eb0 tx=0x7fd098009040 comp rx=0 tx=0).stop 2024-09-17T01:35:34.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.060+0000 7fd0abe00640 1 -- 172.21.15.42:0/1043709003 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a415f480 msgr2=0x7fd0a415e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:34.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.060+0000 7fd0abe00640 1 --2- 172.21.15.42:0/1043709003 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a415f480 0x7fd0a415e520 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd09c009cd0 tx=0x7fd09c032c60 comp rx=0 tx=0).stop 2024-09-17T01:35:34.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.060+0000 7fd0abe00640 1 -- 172.21.15.42:0/1043709003 shutdown_connections 2024-09-17T01:35:34.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.060+0000 7fd0abe00640 1 --2- 172.21.15.42:0/1043709003 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd084078b90 0x7fd08407b0a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.060+0000 7fd0abe00640 1 --2- 172.21.15.42:0/1043709003 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a415f480 0x7fd0a415e520 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.060+0000 7fd0abe00640 1 --2- 172.21.15.42:0/1043709003 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0a415cb80 0x7fd0a415dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.060+0000 7fd0abe00640 1 --2- 172.21.15.42:0/1043709003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0a406d430 0x7fd0a4145e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:34.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.060+0000 7fd0abe00640 1 -- 172.21.15.42:0/1043709003 >> 172.21.15.42:0/1043709003 conn(0x7fd0a40b2930 msgr2=0x7fd0a4072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:34.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.060+0000 7fd0abe00640 1 -- 172.21.15.42:0/1043709003 shutdown_connections 2024-09-17T01:35:34.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:34.060+0000 7fd0abe00640 1 -- 172.21.15.42:0/1043709003 wait complete. 2024-09-17T01:35:39.081 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T01:35:39.082 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-17T01:35:39.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.321+0000 7fca8e600640 1 -- 172.21.15.42:0/3728069294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca880af980 msgr2=0x7fca880ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:39.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.321+0000 7fca8e600640 1 --2- 172.21.15.42:0/3728069294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca880af980 0x7fca880ceb40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fca70005fd0 tx=0x7fca7002a5d0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.321+0000 7fca8e600640 1 -- 172.21.15.42:0/3728069294 shutdown_connections 2024-09-17T01:35:39.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.321+0000 7fca8e600640 1 --2- 172.21.15.42:0/3728069294 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca8806d430 0x7fca8806d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.321+0000 7fca8e600640 1 --2- 172.21.15.42:0/3728069294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca880af980 0x7fca880ceb40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.321+0000 7fca8e600640 1 -- 172.21.15.42:0/3728069294 >> 172.21.15.42:0/3728069294 conn(0x7fca880b2930 msgr2=0x7fca8806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:39.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.321+0000 7fca8e600640 1 -- 172.21.15.42:0/3728069294 shutdown_connections 2024-09-17T01:35:39.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.321+0000 7fca8e600640 1 -- 172.21.15.42:0/3728069294 wait complete. 2024-09-17T01:35:39.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.323+0000 7fca8e600640 1 Processor -- start 2024-09-17T01:35:39.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.323+0000 7fca8e600640 1 -- start start 2024-09-17T01:35:39.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.325+0000 7fca8e600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca8806d430 0x7fca881f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.325+0000 7fca8e600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca880af980 0x7fca88144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.325+0000 7fca8e600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca880b3880 0x7fca8806e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.325+0000 7fca8e600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fca88072ad0 con 0x7fca8806d430 2024-09-17T01:35:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.325+0000 7fca8e600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fca88072950 con 0x7fca880af980 2024-09-17T01:35:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.325+0000 7fca8e600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fca88072c50 con 0x7fca880b3880 2024-09-17T01:35:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.325+0000 7fca87400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca8806d430 0x7fca881f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.325+0000 7fca87400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca8806d430 0x7fca881f5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37452/0 (socket says 172.21.15.42:37452) 2024-09-17T01:35:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.325+0000 7fca87400640 1 -- 172.21.15.42:0/34588223 learned_addr learned my addr 172.21.15.42:0/34588223 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.326+0000 7fca7ea00640 1 --2- 172.21.15.42:0/34588223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca880af980 0x7fca88144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.326+0000 7fca87e00640 1 --2- 172.21.15.42:0/34588223 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca880b3880 0x7fca8806e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.326+0000 7fca87400640 1 -- 172.21.15.42:0/34588223 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca880b3880 msgr2=0x7fca8806e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.326+0000 7fca87400640 1 --2- 172.21.15.42:0/34588223 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca880b3880 0x7fca8806e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.326+0000 7fca87400640 1 -- 172.21.15.42:0/34588223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca880af980 msgr2=0x7fca88144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.326+0000 7fca87400640 1 --2- 172.21.15.42:0/34588223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca880af980 0x7fca88144cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.326+0000 7fca87400640 1 -- 172.21.15.42:0/34588223 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca880aeb20 con 0x7fca8806d430 2024-09-17T01:35:39.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.326+0000 7fca87400640 1 --2- 172.21.15.42:0/34588223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca8806d430 0x7fca881f5b30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fca7800c760 tx=0x7fca7800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:39.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.326+0000 7fca7fe00640 1 -- 172.21.15.42:0/34588223 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca78016020 con 0x7fca8806d430 2024-09-17T01:35:39.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.326+0000 7fca7fe00640 1 -- 172.21.15.42:0/34588223 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca78003990 con 0x7fca8806d430 2024-09-17T01:35:39.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.326+0000 7fca8e600640 1 -- 172.21.15.42:0/34588223 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca880aee00 con 0x7fca8806d430 2024-09-17T01:35:39.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.326+0000 7fca7fe00640 1 -- 172.21.15.42:0/34588223 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca78006e60 con 0x7fca8806d430 2024-09-17T01:35:39.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.327+0000 7fca8e600640 1 -- 172.21.15.42:0/34588223 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca8815a380 con 0x7fca8806d430 2024-09-17T01:35:39.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.330+0000 7fca7fe00640 1 -- 172.21.15.42:0/34588223 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fca7800a7f0 con 0x7fca8806d430 2024-09-17T01:35:39.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.331+0000 7fca7fe00640 1 --2- 172.21.15.42:0/34588223 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fca64078b90 0x7fca6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.331+0000 7fca7fe00640 1 -- 172.21.15.42:0/34588223 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fca7809a9d0 con 0x7fca8806d430 2024-09-17T01:35:39.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.331+0000 7fca9581f740 1 Processor -- start 2024-09-17T01:35:39.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.331+0000 7fca9581f740 1 -- start start 2024-09-17T01:35:39.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.332+0000 7fca7ea00640 1 --2- 172.21.15.42:0/34588223 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fca64078b90 0x7fca6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.332+0000 7fca7ea00640 1 --2- 172.21.15.42:0/34588223 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fca64078b90 0x7fca6407b0a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fca70033000 tx=0x7fca70004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:39.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.333+0000 7fca9581f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ba631d390 0x558ba670b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.333+0000 7fca9581f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba62f44d0 0x558ba66ee220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.333+0000 7fca9581f740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ba62fc6b0 0x558ba66ee760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.333+0000 7fca9581f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558ba66241c0 con 0x558ba62f44d0 2024-09-17T01:35:39.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.333+0000 7fca9581f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558ba6637870 con 0x558ba631d390 2024-09-17T01:35:39.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.333+0000 7fca9581f740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558ba6626ca0 con 0x558ba62fc6b0 2024-09-17T01:35:39.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.333+0000 7fca7ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba62f44d0 0x558ba66ee220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.333+0000 7fca7ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba62f44d0 0x558ba66ee220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37460/0 (socket says 172.21.15.42:37460) 2024-09-17T01:35:39.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.333+0000 7fca7ea00640 1 -- 172.21.15.42:0/162864562 learned_addr learned my addr 172.21.15.42:0/162864562 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:39.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.333+0000 7fca87e00640 1 --2- 172.21.15.42:0/162864562 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ba62fc6b0 0x558ba66ee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.333+0000 7fca87400640 1 --2- 172.21.15.42:0/162864562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ba631d390 0x558ba670b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.333+0000 7fca7ea00640 1 -- 172.21.15.42:0/162864562 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ba62fc6b0 msgr2=0x558ba66ee760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:39.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.333+0000 7fca7ea00640 1 --2- 172.21.15.42:0/162864562 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ba62fc6b0 0x558ba66ee760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.333+0000 7fca7ea00640 1 -- 172.21.15.42:0/162864562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ba631d390 msgr2=0x558ba670b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:39.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.333+0000 7fca7ea00640 1 --2- 172.21.15.42:0/162864562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ba631d390 0x558ba670b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.333+0000 7fca7ea00640 1 -- 172.21.15.42:0/162864562 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ba63ff7d0 con 0x558ba62f44d0 2024-09-17T01:35:39.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.334+0000 7fca7ea00640 1 --2- 172.21.15.42:0/162864562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba62f44d0 0x558ba66ee220 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fca700099c0 tx=0x7fca7003c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef56f7ecb05995 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:39.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.334+0000 7fca77e00640 1 -- 172.21.15.42:0/162864562 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca70035040 con 0x558ba62f44d0 2024-09-17T01:35:39.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.334+0000 7fca77e00640 1 -- 172.21.15.42:0/162864562 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca7004c070 con 0x558ba62f44d0 2024-09-17T01:35:39.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.334+0000 7fca77e00640 1 -- 172.21.15.42:0/162864562 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca70003ae0 con 0x558ba62f44d0 2024-09-17T01:35:39.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.335+0000 7fca9581f740 1 -- 172.21.15.42:0/162864562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba62f44d0 msgr2=0x558ba66ee220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:39.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.335+0000 7fca9581f740 1 --2- 172.21.15.42:0/162864562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba62f44d0 0x558ba66ee220 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fca700099c0 tx=0x7fca7003c000 comp rx=0 tx=0).stop 2024-09-17T01:35:39.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.335+0000 7fca9581f740 1 -- 172.21.15.42:0/162864562 shutdown_connections 2024-09-17T01:35:39.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.335+0000 7fca9581f740 1 --2- 172.21.15.42:0/162864562 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ba62fc6b0 0x558ba66ee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.335+0000 7fca9581f740 1 --2- 172.21.15.42:0/162864562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba62f44d0 0x558ba66ee220 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.335+0000 7fca9581f740 1 --2- 172.21.15.42:0/162864562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ba631d390 0x558ba670b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.335+0000 7fca9581f740 1 -- 172.21.15.42:0/162864562 >> 172.21.15.42:0/162864562 conn(0x558ba63114e0 msgr2=0x558ba66c4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:39.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.335+0000 7fca9581f740 1 -- 172.21.15.42:0/162864562 shutdown_connections 2024-09-17T01:35:39.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.335+0000 7fca9581f740 1 -- 172.21.15.42:0/162864562 wait complete. 2024-09-17T01:35:39.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.336+0000 7fca9581f740 1 -- start start 2024-09-17T01:35:39.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.336+0000 7fca9581f740 1 Processor -- start 2024-09-17T01:35:39.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.338+0000 7fca9581f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ba62f44d0 0x558ba66dc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.338+0000 7fca9581f740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ba62fc6b0 0x558ba671b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.338+0000 7fca9581f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba631d390 0x558ba6718cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.338+0000 7fca9581f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558ba65cd410 con 0x558ba631d390 2024-09-17T01:35:39.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.338+0000 7fca9581f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558ba662aab0 con 0x558ba62f44d0 2024-09-17T01:35:39.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.338+0000 7fca9581f740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558ba6397740 con 0x558ba62fc6b0 2024-09-17T01:35:39.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.338+0000 7fca9581f740 10 client.0 _ll_register_callbacks cb 0x558ba65aa360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:39.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.338+0000 7fca87e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba631d390 0x558ba6718cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.338+0000 7fca87e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba631d390 0x558ba6718cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37468/0 (socket says 172.21.15.42:37468) 2024-09-17T01:35:39.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.338+0000 7fca87e00640 1 -- 172.21.15.42:0/2337659748 learned_addr learned my addr 172.21.15.42:0/2337659748 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:39.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.338+0000 7fca87400640 1 --2- 172.21.15.42:0/2337659748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ba62f44d0 0x558ba66dc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.338+0000 7fca7ea00640 1 --2- 172.21.15.42:0/2337659748 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ba62fc6b0 0x558ba671b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.338+0000 7fca87e00640 1 -- 172.21.15.42:0/2337659748 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ba62fc6b0 msgr2=0x558ba671b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:39.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.338+0000 7fca87e00640 1 --2- 172.21.15.42:0/2337659748 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ba62fc6b0 0x558ba671b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.338+0000 7fca87e00640 1 -- 172.21.15.42:0/2337659748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ba62f44d0 msgr2=0x558ba66dc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:39.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.338+0000 7fca87e00640 1 --2- 172.21.15.42:0/2337659748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ba62f44d0 0x558ba66dc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.338+0000 7fca87e00640 1 -- 172.21.15.42:0/2337659748 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ba6388970 con 0x558ba631d390 2024-09-17T01:35:39.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.339+0000 7fca87e00640 1 --2- 172.21.15.42:0/2337659748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba631d390 0x558ba6718cf0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fca880704d0 tx=0x7fca800138f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641e2ec362a8fc4e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:39.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.339+0000 7fca74c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:39.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.339+0000 7fca74c00640 1 -- 172.21.15.42:0/2337659748 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca80020060 con 0x558ba631d390 2024-09-17T01:35:39.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.339+0000 7fca74c00640 1 -- 172.21.15.42:0/2337659748 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fca800118b0 con 0x558ba631d390 2024-09-17T01:35:39.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.339+0000 7fca9581f740 1 -- 172.21.15.42:0/2337659748 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca7004c070 con 0x558ba631d390 2024-09-17T01:35:39.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.339+0000 7fca74c00640 1 -- 172.21.15.42:0/2337659748 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fca80026050 con 0x558ba631d390 2024-09-17T01:35:39.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.339+0000 7fca9581f740 10 client.5706 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:39.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.339+0000 7fca9581f740 1 -- 172.21.15.42:0/2337659748 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x558ba63666a0 con 0x558ba631d390 2024-09-17T01:35:39.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.339+0000 7fca74c00640 1 -- 172.21.15.42:0/2337659748 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca7004c070 con 0x558ba631d390 2024-09-17T01:35:39.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.340+0000 7fca74c00640 1 -- 172.21.15.42:0/2337659748 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7fca80029020 con 0x558ba631d390 2024-09-17T01:35:39.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.340+0000 7fca9581f740 10 client.5706 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:39.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.340+0000 7fca9581f740 10 client.5706 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:39.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.340+0000 7fca9581f740 20 client.5706 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:39.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.340+0000 7fca9581f740 1 --2- 172.21.15.42:0/2337659748 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558ba62dbf60 0x558ba66fff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.340+0000 7fca9581f740 4 client.5706 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:39.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.340+0000 7fca9581f740 1 -- 172.21.15.42:0/2337659748 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ba66397c0 con 0x558ba62dbf60 2024-09-17T01:35:39.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.340+0000 7fca87400640 1 --2- 172.21.15.42:0/2337659748 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558ba62dbf60 0x558ba66fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.341+0000 7fca87400640 1 --2- 172.21.15.42:0/2337659748 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558ba62dbf60 0x558ba66fff90 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44fab20b39946588 server_cookie=a08f372832a21b72 in_seq=0 out_seq=0 2024-09-17T01:35:39.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.341+0000 7fca74c00640 10 client.5706 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:39.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.341+0000 7fca74c00640 1 -- 172.21.15.42:0/2337659748 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558ba66397c0 con 0x558ba62dbf60 2024-09-17T01:35:39.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.341+0000 7fca74c00640 10 client.5706 handle_command_reply: tid=0 2024-09-17T01:35:39.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.341+0000 7fca9581f740 1 client.5706 shutdown 2024-09-17T01:35:39.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.342+0000 7fca9581f740 1 -- 172.21.15.42:0/2337659748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba631d390 msgr2=0x558ba6718cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:39.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.342+0000 7fca9581f740 1 --2- 172.21.15.42:0/2337659748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba631d390 0x558ba6718cf0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fca880704d0 tx=0x7fca800138f0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.342+0000 7fca9581f740 1 -- 172.21.15.42:0/2337659748 shutdown_connections 2024-09-17T01:35:39.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.342+0000 7fca9581f740 1 --2- 172.21.15.42:0/2337659748 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558ba62dbf60 0x558ba66fff90 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.342+0000 7fca9581f740 1 --2- 172.21.15.42:0/2337659748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba631d390 0x558ba6718cf0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.342+0000 7fca9581f740 1 --2- 172.21.15.42:0/2337659748 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ba62fc6b0 0x558ba671b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.342+0000 7fca74c00640 0 client.5706 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:39.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.342+0000 7fca9581f740 1 --2- 172.21.15.42:0/2337659748 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ba62f44d0 0x558ba66dc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.342+0000 7fca9581f740 1 -- 172.21.15.42:0/2337659748 >> 172.21.15.42:0/2337659748 conn(0x558ba63114e0 msgr2=0x558ba670cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:39.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.342+0000 7fca9581f740 1 -- 172.21.15.42:0/2337659748 shutdown_connections 2024-09-17T01:35:39.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.342+0000 7fca9581f740 1 -- 172.21.15.42:0/2337659748 wait complete. 2024-09-17T01:35:39.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.342+0000 7fca9581f740 20 client.5706 trim_cache size 0 max 16384 2024-09-17T01:35:39.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.361+0000 7fca9581f740 1 Processor -- start 2024-09-17T01:35:39.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.361+0000 7fca9581f740 1 -- start start 2024-09-17T01:35:39.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.362+0000 7fca9581f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba62f44d0 0x558ba66c5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.362+0000 7fca9581f740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ba62fc6b0 0x558ba66e5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.362+0000 7fca9581f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ba631d390 0x558ba66e5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.362+0000 7fca9581f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fca882021f0 con 0x558ba62f44d0 2024-09-17T01:35:39.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.362+0000 7fca9581f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fca88156680 con 0x558ba631d390 2024-09-17T01:35:39.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.362+0000 7fca9581f740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fca881559e0 con 0x558ba62fc6b0 2024-09-17T01:35:39.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.362+0000 7fca87400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba62f44d0 0x558ba66c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.362+0000 7fca87400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba62f44d0 0x558ba66c5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37484/0 (socket says 172.21.15.42:37484) 2024-09-17T01:35:39.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.362+0000 7fca87400640 1 -- 172.21.15.42:0/3775795170 learned_addr learned my addr 172.21.15.42:0/3775795170 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:39.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.362+0000 7fca87e00640 1 --2- 172.21.15.42:0/3775795170 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ba631d390 0x558ba66e5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.362+0000 7fca7ea00640 1 --2- 172.21.15.42:0/3775795170 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ba62fc6b0 0x558ba66e5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.363+0000 7fca87400640 1 -- 172.21.15.42:0/3775795170 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ba62fc6b0 msgr2=0x558ba66e5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:39.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.363+0000 7fca87400640 1 --2- 172.21.15.42:0/3775795170 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ba62fc6b0 0x558ba66e5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.363+0000 7fca87400640 1 -- 172.21.15.42:0/3775795170 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ba631d390 msgr2=0x558ba66e5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:39.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.363+0000 7fca87400640 1 --2- 172.21.15.42:0/3775795170 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ba631d390 0x558ba66e5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.363+0000 7fca87400640 1 -- 172.21.15.42:0/3775795170 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ba670d250 con 0x558ba62f44d0 2024-09-17T01:35:39.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.363+0000 7fca87400640 1 --2- 172.21.15.42:0/3775795170 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba62f44d0 0x558ba66c5580 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fca7800a430 tx=0x7fca78065040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e2b4bb80078d32 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:39.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.363+0000 7fca77400640 1 -- 172.21.15.42:0/3775795170 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca780671e0 con 0x558ba62f44d0 2024-09-17T01:35:39.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.363+0000 7fca77400640 1 -- 172.21.15.42:0/3775795170 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca7806c090 con 0x558ba62f44d0 2024-09-17T01:35:39.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.363+0000 7fca77400640 1 -- 172.21.15.42:0/3775795170 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca78061960 con 0x558ba62f44d0 2024-09-17T01:35:39.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.364+0000 7fca9581f740 1 -- 172.21.15.42:0/3775795170 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba62f44d0 msgr2=0x558ba66c5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:39.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.364+0000 7fca9581f740 1 --2- 172.21.15.42:0/3775795170 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba62f44d0 0x558ba66c5580 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fca7800a430 tx=0x7fca78065040 comp rx=0 tx=0).stop 2024-09-17T01:35:39.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.364+0000 7fca9581f740 1 -- 172.21.15.42:0/3775795170 shutdown_connections 2024-09-17T01:35:39.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.364+0000 7fca9581f740 1 --2- 172.21.15.42:0/3775795170 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ba631d390 0x558ba66e5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.364+0000 7fca9581f740 1 --2- 172.21.15.42:0/3775795170 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ba62fc6b0 0x558ba66e5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.364+0000 7fca9581f740 1 --2- 172.21.15.42:0/3775795170 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba62f44d0 0x558ba66c5580 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.364+0000 7fca9581f740 1 -- 172.21.15.42:0/3775795170 >> 172.21.15.42:0/3775795170 conn(0x558ba63114e0 msgr2=0x558ba671b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:39.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.364+0000 7fca9581f740 1 -- 172.21.15.42:0/3775795170 shutdown_connections 2024-09-17T01:35:39.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.364+0000 7fca9581f740 1 -- 172.21.15.42:0/3775795170 wait complete. 2024-09-17T01:35:39.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.365+0000 7fca9581f740 1 -- start start 2024-09-17T01:35:39.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.365+0000 7fca9581f740 1 Processor -- start 2024-09-17T01:35:39.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.367+0000 7fca9581f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ba62f44d0 0x558ba6701340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.367+0000 7fca9581f740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ba62fc6b0 0x558ba678b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.367+0000 7fca9581f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba631d390 0x558ba678bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.367+0000 7fca9581f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558ba66c0cc0 con 0x558ba631d390 2024-09-17T01:35:39.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.367+0000 7fca9581f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fca88156030 con 0x558ba62f44d0 2024-09-17T01:35:39.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.367+0000 7fca9581f740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558ba678c4f0 con 0x558ba62fc6b0 2024-09-17T01:35:39.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.367+0000 7fca9581f740 10 client.0 _ll_register_callbacks cb 0x7fca80009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:39.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.367+0000 7fca87e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba631d390 0x558ba678bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.367+0000 7fca87e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba631d390 0x558ba678bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37488/0 (socket says 172.21.15.42:37488) 2024-09-17T01:35:39.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.367+0000 7fca87e00640 1 -- 172.21.15.42:0/4134888888 learned_addr learned my addr 172.21.15.42:0/4134888888 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:39.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.367+0000 7fca7ea00640 1 --2- 172.21.15.42:0/4134888888 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ba62fc6b0 0x558ba678b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.367+0000 7fca87400640 1 --2- 172.21.15.42:0/4134888888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ba62f44d0 0x558ba6701340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.367+0000 7fca87e00640 1 -- 172.21.15.42:0/4134888888 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ba62fc6b0 msgr2=0x558ba678b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:39.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.367+0000 7fca87e00640 1 --2- 172.21.15.42:0/4134888888 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ba62fc6b0 0x558ba678b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.367+0000 7fca87e00640 1 -- 172.21.15.42:0/4134888888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ba62f44d0 msgr2=0x558ba6701340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:39.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.367+0000 7fca87e00640 1 --2- 172.21.15.42:0/4134888888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ba62f44d0 0x558ba6701340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.367+0000 7fca87e00640 1 -- 172.21.15.42:0/4134888888 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ba6700560 con 0x558ba631d390 2024-09-17T01:35:39.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.368+0000 7fca87e00640 1 --2- 172.21.15.42:0/4134888888 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba631d390 0x558ba678bca0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fca80004700 tx=0x7fca80005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f5b00fbe1dcd39 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:39.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.368+0000 7fca74c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:39.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.368+0000 7fca74c00640 1 -- 172.21.15.42:0/4134888888 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8002e030 con 0x558ba631d390 2024-09-17T01:35:39.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.368+0000 7fca74c00640 1 -- 172.21.15.42:0/4134888888 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fca8000f660 con 0x558ba631d390 2024-09-17T01:35:39.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.368+0000 7fca9581f740 1 -- 172.21.15.42:0/4134888888 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca7806c090 con 0x558ba631d390 2024-09-17T01:35:39.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.368+0000 7fca74c00640 1 -- 172.21.15.42:0/4134888888 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fca80037050 con 0x558ba631d390 2024-09-17T01:35:39.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.368+0000 7fca9581f740 10 client.5712 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:39.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.368+0000 7fca9581f740 1 -- 172.21.15.42:0/4134888888 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x558ba678c230 con 0x558ba631d390 2024-09-17T01:35:39.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.369+0000 7fca74c00640 1 -- 172.21.15.42:0/4134888888 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca7806c090 con 0x558ba631d390 2024-09-17T01:35:39.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.369+0000 7fca74c00640 1 -- 172.21.15.42:0/4134888888 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7fca8003a020 con 0x558ba631d390 2024-09-17T01:35:39.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.369+0000 7fca9581f740 10 client.5712 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:39.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.369+0000 7fca9581f740 10 client.5712 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:39.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.369+0000 7fca9581f740 20 client.5712 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:39.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.369+0000 7fca9581f740 1 --2- 172.21.15.42:0/4134888888 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558ba67049b0 0x558ba66e5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.369+0000 7fca9581f740 4 client.5712 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:35:39.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.369+0000 7fca9581f740 1 -- 172.21.15.42:0/4134888888 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558ba6635270 con 0x558ba67049b0 2024-09-17T01:35:39.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.369+0000 7fca87400640 1 --2- 172.21.15.42:0/4134888888 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558ba67049b0 0x558ba66e5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.369+0000 7fca87400640 1 --2- 172.21.15.42:0/4134888888 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558ba67049b0 0x558ba66e5980 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5186178b2f09376 server_cookie=7c3d233bb2b5ab07 in_seq=0 out_seq=0 2024-09-17T01:35:39.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.369+0000 7fca74c00640 10 client.5712 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:39.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.370+0000 7fca74c00640 1 -- 172.21.15.42:0/4134888888 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1372 (crc 0 0 0) 0x558ba6635270 con 0x558ba67049b0 2024-09-17T01:35:39.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.370+0000 7fca74c00640 10 client.5712 handle_command_reply: tid=0 2024-09-17T01:35:39.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.370+0000 7fca9581f740 1 client.5712 shutdown 2024-09-17T01:35:39.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.370+0000 7fca9581f740 1 -- 172.21.15.42:0/4134888888 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba631d390 msgr2=0x558ba678bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:39.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.370+0000 7fca9581f740 1 --2- 172.21.15.42:0/4134888888 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba631d390 0x558ba678bca0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fca80004700 tx=0x7fca80005db0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.370+0000 7fca9581f740 1 -- 172.21.15.42:0/4134888888 shutdown_connections 2024-09-17T01:35:39.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.370+0000 7fca9581f740 1 --2- 172.21.15.42:0/4134888888 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558ba67049b0 0x558ba66e5980 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.370+0000 7fca9581f740 1 --2- 172.21.15.42:0/4134888888 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ba631d390 0x558ba678bca0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.370+0000 7fca9581f740 1 --2- 172.21.15.42:0/4134888888 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ba62fc6b0 0x558ba678b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.370+0000 7fca9581f740 1 --2- 172.21.15.42:0/4134888888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ba62f44d0 0x558ba6701340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.370+0000 7fca74c00640 0 client.5712 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:39.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.370+0000 7fca9581f740 1 -- 172.21.15.42:0/4134888888 >> 172.21.15.42:0/4134888888 conn(0x558ba63114e0 msgr2=0x558ba66b9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:39.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.370+0000 7fca9581f740 1 -- 172.21.15.42:0/4134888888 shutdown_connections 2024-09-17T01:35:39.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.370+0000 7fca9581f740 1 -- 172.21.15.42:0/4134888888 wait complete. 2024-09-17T01:35:39.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.370+0000 7fca9581f740 20 client.5712 trim_cache size 0 max 16384 2024-09-17T01:35:39.373 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:39.373 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-09-17T01:35:39.373 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {}, 2024-09-17T01:35:39.373 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_stats": { 2024-09-17T01:35:39.373 INFO:teuthology.orchestra.run.smithi042.stdout: "da914a30-cdfa-4ea8-b8dd-7b052b0b6e40": { 2024-09-17T01:35:39.373 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:35:32.014895+0000", 2024-09-17T01:35:39.373 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-17T01:35:39.373 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:35:39.373 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:35:39.373 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:35:39.373 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:35:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: "1ab47091-12eb-4ca6-b40a-fff283cd28c5": { 2024-09-17T01:35:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:35:31.413900+0000", 2024-09-17T01:35:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-17T01:35:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:35:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:35:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:35:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:35:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: "0a9c13dc-362e-4bde-95c2-3e723b5c9972": { 2024-09-17T01:35:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:35:33.753881+0000", 2024-09-17T01:35:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-17T01:35:39.374 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:35:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:35:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:35:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:35:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: "769242e9-0529-44ae-ba31-8514cbaaf3fb": { 2024-09-17T01:35:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:35:30.802905+0000", 2024-09-17T01:35:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-17T01:35:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:35:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:35:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:35:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:35:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:39.375 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:39.376 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:39.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.371+0000 7fca8e600640 1 -- 172.21.15.42:0/34588223 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fca64078b90 msgr2=0x7fca6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:39.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.371+0000 7fca8e600640 1 --2- 172.21.15.42:0/34588223 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fca64078b90 0x7fca6407b0a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fca70033000 tx=0x7fca70004730 comp rx=0 tx=0).stop 2024-09-17T01:35:39.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.371+0000 7fca8e600640 1 -- 172.21.15.42:0/34588223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca8806d430 msgr2=0x7fca881f5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:39.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.371+0000 7fca8e600640 1 --2- 172.21.15.42:0/34588223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca8806d430 0x7fca881f5b30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fca7800c760 tx=0x7fca7800cc20 comp rx=0 tx=0).stop 2024-09-17T01:35:39.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.371+0000 7fca8e600640 1 -- 172.21.15.42:0/34588223 shutdown_connections 2024-09-17T01:35:39.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.371+0000 7fca8e600640 1 --2- 172.21.15.42:0/34588223 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fca64078b90 0x7fca6407b0a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.371+0000 7fca8e600640 1 --2- 172.21.15.42:0/34588223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca880af980 0x7fca88144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.371+0000 7fca8e600640 1 --2- 172.21.15.42:0/34588223 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca880b3880 0x7fca8806e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.371+0000 7fca8e600640 1 --2- 172.21.15.42:0/34588223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca8806d430 0x7fca881f5b30 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.371+0000 7fca8e600640 1 -- 172.21.15.42:0/34588223 >> 172.21.15.42:0/34588223 conn(0x7fca880b2930 msgr2=0x7fca8815cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:39.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.371+0000 7fca8e600640 1 -- 172.21.15.42:0/34588223 shutdown_connections 2024-09-17T01:35:39.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.371+0000 7fca8e600640 1 -- 172.21.15.42:0/34588223 wait complete. 2024-09-17T01:35:39.390 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T01:35:39.390 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-17T01:35:39.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.620+0000 7f3cb6a00640 1 -- 172.21.15.42:0/382215854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c98004800 msgr2=0x7f3c98004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:39.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.620+0000 7f3cb6a00640 1 --2- 172.21.15.42:0/382215854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c98004800 0x7f3c98004c10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0072240 tx=0x7f3c98005830 comp rx=0 tx=0).stop 2024-09-17T01:35:39.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.620+0000 7f3cb6000640 1 -- 172.21.15.42:0/382215854 reap_dead start 2024-09-17T01:35:39.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.620+0000 7f3cb6a00640 1 -- 172.21.15.42:0/382215854 shutdown_connections 2024-09-17T01:35:39.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.620+0000 7f3cb6a00640 1 -- 172.21.15.42:0/382215854 >> 172.21.15.42:0/382215854 conn(0x7f3cb006d440 msgr2=0x7f3cb00b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:39.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.620+0000 7f3cb6a00640 1 -- 172.21.15.42:0/382215854 shutdown_connections 2024-09-17T01:35:39.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.620+0000 7f3cb6a00640 1 -- 172.21.15.42:0/382215854 wait complete. 2024-09-17T01:35:39.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.622+0000 7f3cb6a00640 1 Processor -- start 2024-09-17T01:35:39.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.622+0000 7f3cb6a00640 1 -- start start 2024-09-17T01:35:39.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.624+0000 7f3cb6a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c98004800 0x7f3cb0149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.624+0000 7f3cb6a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cb00ad3e0 0x7f3cb00ad7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.624+0000 7f3cb6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cb01462c0 0x7f3cb01466d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.624+0000 7f3cb6a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb015c8d0 con 0x7f3cb01462c0 2024-09-17T01:35:39.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.624+0000 7f3cb6a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb00b53a0 con 0x7f3c98004800 2024-09-17T01:35:39.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.624+0000 7f3cb6a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3cb015ca50 con 0x7f3cb00ad3e0 2024-09-17T01:35:39.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.624+0000 7f3cb6000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cb01462c0 0x7f3cb01466d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.624+0000 7f3cb6000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cb01462c0 0x7f3cb01466d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37500/0 (socket says 172.21.15.42:37500) 2024-09-17T01:35:39.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.624+0000 7f3cb6000640 1 -- 172.21.15.42:0/4291765701 learned_addr learned my addr 172.21.15.42:0/4291765701 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:39.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.624+0000 7f3cb5600640 1 --2- 172.21.15.42:0/4291765701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c98004800 0x7f3cb0149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.624+0000 7f3cb4c00640 1 --2- 172.21.15.42:0/4291765701 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cb00ad3e0 0x7f3cb00ad7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.625+0000 7f3cb6000640 1 -- 172.21.15.42:0/4291765701 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cb00ad3e0 msgr2=0x7f3cb00ad7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:39.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.625+0000 7f3cb6000640 1 --2- 172.21.15.42:0/4291765701 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cb00ad3e0 0x7f3cb00ad7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.625+0000 7f3cb6000640 1 -- 172.21.15.42:0/4291765701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c98004800 msgr2=0x7f3cb0149ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:39.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.625+0000 7f3cb6000640 1 --2- 172.21.15.42:0/4291765701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c98004800 0x7f3cb0149ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.625+0000 7f3cb6000640 1 -- 172.21.15.42:0/4291765701 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb0146c10 con 0x7f3cb01462c0 2024-09-17T01:35:39.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.625+0000 7f3cb4c00640 1 --2- 172.21.15.42:0/4291765701 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cb00ad3e0 0x7f3cb00ad7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:39.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.625+0000 7f3cb6000640 1 --2- 172.21.15.42:0/4291765701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cb01462c0 0x7f3cb01466d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0072090 tx=0x7f3ca800f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:39.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.625+0000 7f3cad600640 1 -- 172.21.15.42:0/4291765701 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8004b20 con 0x7f3cb01462c0 2024-09-17T01:35:39.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.625+0000 7f3cad600640 1 -- 172.21.15.42:0/4291765701 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ca8004cc0 con 0x7f3cb01462c0 2024-09-17T01:35:39.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.625+0000 7f3cb6a00640 1 -- 172.21.15.42:0/4291765701 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb00ae150 con 0x7f3cb01462c0 2024-09-17T01:35:39.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.625+0000 7f3cad600640 1 -- 172.21.15.42:0/4291765701 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8003bd0 con 0x7f3cb01462c0 2024-09-17T01:35:39.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.625+0000 7f3cb6a00640 1 -- 172.21.15.42:0/4291765701 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb00ae710 con 0x7f3cb01462c0 2024-09-17T01:35:39.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.628+0000 7f3cad600640 1 -- 172.21.15.42:0/4291765701 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3ca8004030 con 0x7f3cb01462c0 2024-09-17T01:35:39.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.629+0000 7f3cad600640 1 --2- 172.21.15.42:0/4291765701 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3c90078b90 0x7f3c9007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.629+0000 7f3cad600640 1 -- 172.21.15.42:0/4291765701 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f3ca809b250 con 0x7f3cb01462c0 2024-09-17T01:35:39.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.629+0000 7f3cb5600640 1 --2- 172.21.15.42:0/4291765701 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3c90078b90 0x7f3c9007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.629+0000 7f3cbf24d740 1 Processor -- start 2024-09-17T01:35:39.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.629+0000 7f3cbf24d740 1 -- start start 2024-09-17T01:35:39.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.630+0000 7f3cb5600640 1 --2- 172.21.15.42:0/4291765701 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3c90078b90 0x7f3c9007b0a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4000fd0 tx=0x7f3ca40067d0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:39.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.631+0000 7f3cbf24d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e21c390 0x56417e6084c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.631+0000 7f3cbf24d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56417e1f34d0 0x56417e5dd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.631+0000 7f3cbf24d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56417e1fb6b0 0x56417e5dd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.631+0000 7f3cbf24d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56417e5366f0 con 0x56417e21c390 2024-09-17T01:35:39.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.631+0000 7f3cbf24d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56417e525b20 con 0x56417e1f34d0 2024-09-17T01:35:39.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.631+0000 7f3cbf24d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56417e529930 con 0x56417e1fb6b0 2024-09-17T01:35:39.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.631+0000 7f3cb5600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e21c390 0x56417e6084c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.631+0000 7f3cb5600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e21c390 0x56417e6084c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37514/0 (socket says 172.21.15.42:37514) 2024-09-17T01:35:39.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.631+0000 7f3cb5600640 1 -- 172.21.15.42:0/4214369186 learned_addr learned my addr 172.21.15.42:0/4214369186 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:39.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.631+0000 7f3cb4c00640 1 --2- 172.21.15.42:0/4214369186 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56417e1f34d0 0x56417e5dd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.631+0000 7f3cb6000640 1 --2- 172.21.15.42:0/4214369186 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56417e1fb6b0 0x56417e5dd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.632+0000 7f3cb5600640 1 -- 172.21.15.42:0/4214369186 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56417e1fb6b0 msgr2=0x56417e5dd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:39.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.632+0000 7f3cb5600640 1 --2- 172.21.15.42:0/4214369186 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56417e1fb6b0 0x56417e5dd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.632+0000 7f3cb5600640 1 -- 172.21.15.42:0/4214369186 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56417e1f34d0 msgr2=0x56417e5dd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:39.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.632+0000 7f3cb5600640 1 --2- 172.21.15.42:0/4214369186 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56417e1f34d0 0x56417e5dd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.632+0000 7f3cb5600640 1 -- 172.21.15.42:0/4214369186 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56417e287970 con 0x56417e21c390 2024-09-17T01:35:39.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.632+0000 7f3cb6000640 1 --2- 172.21.15.42:0/4214369186 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56417e1fb6b0 0x56417e5dd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:35:39.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.632+0000 7f3cb5600640 1 --2- 172.21.15.42:0/4214369186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e21c390 0x56417e6084c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4005a60 tx=0x7f3ca4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6727ac3b1e9bac1c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:39.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.632+0000 7f3ca1c00640 1 -- 172.21.15.42:0/4214369186 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4012780 con 0x56417e21c390 2024-09-17T01:35:39.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.632+0000 7f3ca1c00640 1 -- 172.21.15.42:0/4214369186 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ca4022030 con 0x56417e21c390 2024-09-17T01:35:39.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.632+0000 7f3ca1c00640 1 -- 172.21.15.42:0/4214369186 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4012b40 con 0x56417e21c390 2024-09-17T01:35:39.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.633+0000 7f3cbf24d740 1 -- 172.21.15.42:0/4214369186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e21c390 msgr2=0x56417e6084c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:39.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.633+0000 7f3cbf24d740 1 --2- 172.21.15.42:0/4214369186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e21c390 0x56417e6084c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4005a60 tx=0x7f3ca4014000 comp rx=0 tx=0).stop 2024-09-17T01:35:39.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.633+0000 7f3cbf24d740 1 -- 172.21.15.42:0/4214369186 shutdown_connections 2024-09-17T01:35:39.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.633+0000 7f3cbf24d740 1 --2- 172.21.15.42:0/4214369186 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56417e1f34d0 0x56417e5dd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.633+0000 7f3cbf24d740 1 --2- 172.21.15.42:0/4214369186 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56417e1fb6b0 0x56417e5dd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.633+0000 7f3cbf24d740 1 --2- 172.21.15.42:0/4214369186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e21c390 0x56417e6084c0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.633+0000 7f3cbf24d740 1 -- 172.21.15.42:0/4214369186 >> 172.21.15.42:0/4214369186 conn(0x56417e2104e0 msgr2=0x56417e5c37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:39.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.633+0000 7f3cbf24d740 1 -- 172.21.15.42:0/4214369186 shutdown_connections 2024-09-17T01:35:39.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.633+0000 7f3cbf24d740 1 -- 172.21.15.42:0/4214369186 wait complete. 2024-09-17T01:35:39.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.634+0000 7f3cbf24d740 1 -- start start 2024-09-17T01:35:39.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.634+0000 7f3cbf24d740 1 Processor -- start 2024-09-17T01:35:39.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.636+0000 7f3cbf24d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56417e1f34d0 0x56417e61b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.636+0000 7f3cbf24d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e1fb6b0 0x56417e5dbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.636+0000 7f3cbf24d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56417e21c390 0x56417e6049e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.636+0000 7f3cbf24d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56417e296740 con 0x56417e1fb6b0 2024-09-17T01:35:39.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.636+0000 7f3cbf24d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56417e4cc290 con 0x56417e21c390 2024-09-17T01:35:39.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.636+0000 7f3cbf24d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56417e5ff4d0 con 0x56417e1f34d0 2024-09-17T01:35:39.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.636+0000 7f3cbf24d740 10 client.0 _ll_register_callbacks cb 0x56417e4a91e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:39.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.636+0000 7f3cb4c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e1fb6b0 0x56417e5dbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.636+0000 7f3cb4c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e1fb6b0 0x56417e5dbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37516/0 (socket says 172.21.15.42:37516) 2024-09-17T01:35:39.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.636+0000 7f3cb4c00640 1 -- 172.21.15.42:0/745418770 learned_addr learned my addr 172.21.15.42:0/745418770 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:39.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.637+0000 7f3cb4c00640 1 -- 172.21.15.42:0/745418770 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56417e1f34d0 msgr2=0x56417e61b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:39.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.637+0000 7f3cb4c00640 1 --2- 172.21.15.42:0/745418770 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56417e1f34d0 0x56417e61b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.637+0000 7f3cb4c00640 1 -- 172.21.15.42:0/745418770 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56417e21c390 msgr2=0x56417e6049e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:39.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.637+0000 7f3cb6000640 1 --2- 172.21.15.42:0/745418770 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56417e21c390 0x56417e6049e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.637+0000 7f3cb4c00640 1 --2- 172.21.15.42:0/745418770 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56417e21c390 0x56417e6049e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.637+0000 7f3cb4c00640 1 -- 172.21.15.42:0/745418770 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56417e2fe7d0 con 0x56417e1fb6b0 2024-09-17T01:35:39.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.637+0000 7f3cb6000640 1 --2- 172.21.15.42:0/745418770 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56417e21c390 0x56417e6049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:39.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.637+0000 7f3cb4c00640 1 --2- 172.21.15.42:0/745418770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e1fb6b0 0x56417e5dbc90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c02a8e0 tx=0x7f3c9c0064d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af7de93828e2b3a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:39.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.637+0000 7f3c96000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:39.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.637+0000 7f3c96000640 1 -- 172.21.15.42:0/745418770 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c006920 con 0x56417e1fb6b0 2024-09-17T01:35:39.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.637+0000 7f3c96000640 1 -- 172.21.15.42:0/745418770 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f3c9c003a00 con 0x56417e1fb6b0 2024-09-17T01:35:39.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.637+0000 7f3cbf24d740 1 -- 172.21.15.42:0/745418770 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ca4022030 con 0x56417e1fb6b0 2024-09-17T01:35:39.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.637+0000 7f3c96000640 1 -- 172.21.15.42:0/745418770 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3c9c04b050 con 0x56417e1fb6b0 2024-09-17T01:35:39.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.638+0000 7f3cbf24d740 10 client.5724 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:39.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.638+0000 7f3cbf24d740 1 -- 172.21.15.42:0/745418770 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x56417e5dc1d0 con 0x56417e1fb6b0 2024-09-17T01:35:39.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.638+0000 7f3c96000640 1 -- 172.21.15.42:0/745418770 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ca4022030 con 0x56417e1fb6b0 2024-09-17T01:35:39.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.638+0000 7f3c96000640 1 -- 172.21.15.42:0/745418770 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f3c9c04e020 con 0x56417e1fb6b0 2024-09-17T01:35:39.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.638+0000 7f3cbf24d740 10 client.5724 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:39.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.638+0000 7f3cbf24d740 10 client.5724 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:39.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.638+0000 7f3cbf24d740 20 client.5724 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:39.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.638+0000 7f3cbf24d740 1 --2- 172.21.15.42:0/745418770 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56417e1daf60 0x56417e6032f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.638+0000 7f3cbf24d740 4 client.5724 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:39.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.638+0000 7f3cbf24d740 1 -- 172.21.15.42:0/745418770 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56417e538640 con 0x56417e1daf60 2024-09-17T01:35:39.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.638+0000 7f3cb5600640 1 --2- 172.21.15.42:0/745418770 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56417e1daf60 0x56417e6032f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.639+0000 7f3cb5600640 1 --2- 172.21.15.42:0/745418770 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56417e1daf60 0x56417e6032f0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c30012496763fc9c server_cookie=6664cf78af50539b in_seq=0 out_seq=0 2024-09-17T01:35:39.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.639+0000 7f3c96000640 10 client.5724 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:39.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.639+0000 7f3c96000640 1 -- 172.21.15.42:0/745418770 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56417e538640 con 0x56417e1daf60 2024-09-17T01:35:39.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.639+0000 7f3c96000640 10 client.5724 handle_command_reply: tid=0 2024-09-17T01:35:39.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.640+0000 7f3cbf24d740 1 client.5724 shutdown 2024-09-17T01:35:39.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.640+0000 7f3cbf24d740 1 -- 172.21.15.42:0/745418770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e1fb6b0 msgr2=0x56417e5dbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:39.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.640+0000 7f3cbf24d740 1 --2- 172.21.15.42:0/745418770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e1fb6b0 0x56417e5dbc90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c02a8e0 tx=0x7f3c9c0064d0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.640+0000 7f3cbf24d740 1 -- 172.21.15.42:0/745418770 shutdown_connections 2024-09-17T01:35:39.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.640+0000 7f3cbf24d740 1 --2- 172.21.15.42:0/745418770 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56417e1daf60 0x56417e6032f0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.640+0000 7f3cbf24d740 1 --2- 172.21.15.42:0/745418770 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56417e21c390 0x56417e6049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.640+0000 7f3cbf24d740 1 --2- 172.21.15.42:0/745418770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e1fb6b0 0x56417e5dbc90 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.640+0000 7f3c96000640 0 client.5724 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:39.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.640+0000 7f3cbf24d740 1 --2- 172.21.15.42:0/745418770 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56417e1f34d0 0x56417e61b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.640+0000 7f3cbf24d740 1 -- 172.21.15.42:0/745418770 >> 172.21.15.42:0/745418770 conn(0x56417e2104e0 msgr2=0x56417e5be4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:39.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.640+0000 7f3cbf24d740 1 -- 172.21.15.42:0/745418770 shutdown_connections 2024-09-17T01:35:39.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.640+0000 7f3cbf24d740 1 -- 172.21.15.42:0/745418770 wait complete. 2024-09-17T01:35:39.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.640+0000 7f3cbf24d740 20 client.5724 trim_cache size 0 max 16384 2024-09-17T01:35:39.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.654+0000 7f3cbf24d740 1 Processor -- start 2024-09-17T01:35:39.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.655+0000 7f3cbf24d740 1 -- start start 2024-09-17T01:35:39.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.656+0000 7f3cbf24d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e1f34d0 0x56417e5c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.656+0000 7f3cbf24d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56417e1fb6b0 0x56417e5c3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.656+0000 7f3cbf24d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56417e21c390 0x56417e629c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.656+0000 7f3cbf24d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb0202260 con 0x56417e1f34d0 2024-09-17T01:35:39.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.656+0000 7f3cbf24d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb0201260 con 0x56417e1fb6b0 2024-09-17T01:35:39.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.656+0000 7f3cbf24d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3cb0145370 con 0x56417e21c390 2024-09-17T01:35:39.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.656+0000 7f3cb5600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e1f34d0 0x56417e5c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.656+0000 7f3cb5600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e1f34d0 0x56417e5c3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37522/0 (socket says 172.21.15.42:37522) 2024-09-17T01:35:39.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.656+0000 7f3cb5600640 1 -- 172.21.15.42:0/2834725980 learned_addr learned my addr 172.21.15.42:0/2834725980 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:39.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.656+0000 7f3cb4c00640 1 --2- 172.21.15.42:0/2834725980 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56417e1fb6b0 0x56417e5c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.656+0000 7f3cb6000640 1 --2- 172.21.15.42:0/2834725980 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56417e21c390 0x56417e629c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.657+0000 7f3cb5600640 1 -- 172.21.15.42:0/2834725980 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56417e21c390 msgr2=0x56417e629c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:39.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.657+0000 7f3cb5600640 1 --2- 172.21.15.42:0/2834725980 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56417e21c390 0x56417e629c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.657+0000 7f3cb5600640 1 -- 172.21.15.42:0/2834725980 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56417e1fb6b0 msgr2=0x56417e5c3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:39.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.657+0000 7f3cb5600640 1 --2- 172.21.15.42:0/2834725980 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56417e1fb6b0 0x56417e5c3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.657+0000 7f3cb5600640 1 -- 172.21.15.42:0/2834725980 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56417e5ea990 con 0x56417e1f34d0 2024-09-17T01:35:39.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.657+0000 7f3cb5600640 1 --2- 172.21.15.42:0/2834725980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e1f34d0 0x56417e5c3220 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4001260 tx=0x7f3ca40051e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12dde10a7e4bc18a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:39.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.657+0000 7f3ca1200640 1 -- 172.21.15.42:0/2834725980 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca40055d0 con 0x56417e1f34d0 2024-09-17T01:35:39.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.657+0000 7f3ca1200640 1 -- 172.21.15.42:0/2834725980 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ca40036b0 con 0x56417e1f34d0 2024-09-17T01:35:39.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.657+0000 7f3ca1200640 1 -- 172.21.15.42:0/2834725980 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4003ae0 con 0x56417e1f34d0 2024-09-17T01:35:39.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.658+0000 7f3cbf24d740 1 -- 172.21.15.42:0/2834725980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e1f34d0 msgr2=0x56417e5c3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:39.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.658+0000 7f3cbf24d740 1 --2- 172.21.15.42:0/2834725980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e1f34d0 0x56417e5c3220 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4001260 tx=0x7f3ca40051e0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.658+0000 7f3cbf24d740 1 -- 172.21.15.42:0/2834725980 shutdown_connections 2024-09-17T01:35:39.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.658+0000 7f3cbf24d740 1 --2- 172.21.15.42:0/2834725980 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56417e1fb6b0 0x56417e5c3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.658+0000 7f3cbf24d740 1 --2- 172.21.15.42:0/2834725980 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56417e21c390 0x56417e629c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.658+0000 7f3cbf24d740 1 --2- 172.21.15.42:0/2834725980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e1f34d0 0x56417e5c3220 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.658+0000 7f3cbf24d740 1 -- 172.21.15.42:0/2834725980 >> 172.21.15.42:0/2834725980 conn(0x56417e2104e0 msgr2=0x56417e5ed5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:39.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.658+0000 7f3cbf24d740 1 -- 172.21.15.42:0/2834725980 shutdown_connections 2024-09-17T01:35:39.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.658+0000 7f3cbf24d740 1 -- 172.21.15.42:0/2834725980 wait complete. 2024-09-17T01:35:39.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.659+0000 7f3cbf24d740 1 -- start start 2024-09-17T01:35:39.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.659+0000 7f3cbf24d740 1 Processor -- start 2024-09-17T01:35:39.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.661+0000 7f3cbf24d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56417e1f34d0 0x56417e5be4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.661+0000 7f3cbf24d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e1fb6b0 0x56417e66a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.661+0000 7f3cbf24d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56417e21c390 0x56417e5c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.661+0000 7f3cbf24d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56417e602570 con 0x56417e1fb6b0 2024-09-17T01:35:39.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.661+0000 7f3cbf24d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb0200c10 con 0x56417e21c390 2024-09-17T01:35:39.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.661+0000 7f3cbf24d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56417e5bef80 con 0x56417e1f34d0 2024-09-17T01:35:39.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.661+0000 7f3cbf24d740 10 client.0 _ll_register_callbacks cb 0x7f3ca80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:39.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.661+0000 7f3cb4c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e1fb6b0 0x56417e66a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.661+0000 7f3cb4c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e1fb6b0 0x56417e66a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37538/0 (socket says 172.21.15.42:37538) 2024-09-17T01:35:39.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.661+0000 7f3cb4c00640 1 -- 172.21.15.42:0/350671339 learned_addr learned my addr 172.21.15.42:0/350671339 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:39.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.661+0000 7f3cb4c00640 1 -- 172.21.15.42:0/350671339 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56417e1f34d0 msgr2=0x56417e5be4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:39.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.661+0000 7f3cb4c00640 1 --2- 172.21.15.42:0/350671339 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56417e1f34d0 0x56417e5be4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.661+0000 7f3cb4c00640 1 -- 172.21.15.42:0/350671339 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56417e21c390 msgr2=0x56417e5c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:39.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.661+0000 7f3cb4c00640 1 --2- 172.21.15.42:0/350671339 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56417e21c390 0x56417e5c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.661+0000 7f3cb4c00640 1 -- 172.21.15.42:0/350671339 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56417e687590 con 0x56417e1fb6b0 2024-09-17T01:35:39.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.662+0000 7f3cb4c00640 1 --2- 172.21.15.42:0/350671339 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e1fb6b0 0x56417e66a010 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c003cb0 tx=0x7f3c9c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2a25cd5387d9fe server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:39.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.662+0000 7f3c96000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:39.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.662+0000 7f3c96000640 1 -- 172.21.15.42:0/350671339 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c03e930 con 0x56417e1fb6b0 2024-09-17T01:35:39.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.662+0000 7f3c96000640 1 -- 172.21.15.42:0/350671339 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f3c9c03ead0 con 0x56417e1fb6b0 2024-09-17T01:35:39.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.662+0000 7f3cbf24d740 1 -- 172.21.15.42:0/350671339 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ca40036b0 con 0x56417e1fb6b0 2024-09-17T01:35:39.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.662+0000 7f3c96000640 1 -- 172.21.15.42:0/350671339 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3c9c05b050 con 0x56417e1fb6b0 2024-09-17T01:35:39.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.662+0000 7f3cbf24d740 10 client.5730 fetch_fsmap learned FSMap version 28 2024-09-17T01:35:39.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.662+0000 7f3cbf24d740 1 -- 172.21.15.42:0/350671339 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x56417e61e940 con 0x56417e1fb6b0 2024-09-17T01:35:39.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.662+0000 7f3c96000640 1 -- 172.21.15.42:0/350671339 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ca40036b0 con 0x56417e1fb6b0 2024-09-17T01:35:39.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.662+0000 7f3c96000640 1 -- 172.21.15.42:0/350671339 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f3c9c05e020 con 0x56417e1fb6b0 2024-09-17T01:35:39.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.662+0000 7f3cbf24d740 10 client.5730 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T01:35:39.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.662+0000 7f3cbf24d740 10 client.5730 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:39.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.662+0000 7f3cbf24d740 20 client.5730 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:39.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.662+0000 7f3cbf24d740 1 --2- 172.21.15.42:0/350671339 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56417e5c3760 0x56417e61dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.662+0000 7f3cbf24d740 4 client.5730 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-17T01:35:39.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.662+0000 7f3cbf24d740 1 -- 172.21.15.42:0/350671339 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56417e5340f0 con 0x56417e5c3760 2024-09-17T01:35:39.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.663+0000 7f3cb5600640 1 --2- 172.21.15.42:0/350671339 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56417e5c3760 0x56417e61dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.663+0000 7f3cb5600640 1 --2- 172.21.15.42:0/350671339 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56417e5c3760 0x56417e61dc70 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e65a1ca4b2ccb76 server_cookie=c5260d3ef5ca6bed in_seq=0 out_seq=0 2024-09-17T01:35:39.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.663+0000 7f3c96000640 10 client.5730 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:39.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.664+0000 7f3c96000640 1 -- 172.21.15.42:0/350671339 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+167 (crc 0 0 0) 0x56417e5340f0 con 0x56417e5c3760 2024-09-17T01:35:39.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.664+0000 7f3c96000640 10 client.5730 handle_command_reply: tid=0 2024-09-17T01:35:39.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.664+0000 7f3cbf24d740 1 client.5730 shutdown 2024-09-17T01:35:39.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.664+0000 7f3cbf24d740 1 -- 172.21.15.42:0/350671339 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e1fb6b0 msgr2=0x56417e66a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:39.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.664+0000 7f3cbf24d740 1 --2- 172.21.15.42:0/350671339 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e1fb6b0 0x56417e66a010 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c003cb0 tx=0x7f3c9c003ce0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.664+0000 7f3cbf24d740 1 -- 172.21.15.42:0/350671339 shutdown_connections 2024-09-17T01:35:39.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.664+0000 7f3cbf24d740 1 --2- 172.21.15.42:0/350671339 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56417e5c3760 0x56417e61dc70 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.664+0000 7f3cbf24d740 1 --2- 172.21.15.42:0/350671339 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56417e21c390 0x56417e5c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.664+0000 7f3cbf24d740 1 --2- 172.21.15.42:0/350671339 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56417e1fb6b0 0x56417e66a010 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.664+0000 7f3c96000640 0 client.5730 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:39.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.664+0000 7f3cbf24d740 1 --2- 172.21.15.42:0/350671339 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56417e1f34d0 0x56417e5be4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.664+0000 7f3cbf24d740 1 -- 172.21.15.42:0/350671339 >> 172.21.15.42:0/350671339 conn(0x56417e2104e0 msgr2=0x56417e5ed670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:39.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.664+0000 7f3cbf24d740 1 -- 172.21.15.42:0/350671339 shutdown_connections 2024-09-17T01:35:39.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.664+0000 7f3cbf24d740 1 -- 172.21.15.42:0/350671339 wait complete. 2024-09-17T01:35:39.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.664+0000 7f3cbf24d740 20 client.5730 trim_cache size 0 max 16384 2024-09-17T01:35:39.666 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-09-17T01:35:39.666 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:35:39.666 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-09-17T01:35:39.666 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 560875946, 2024-09-17T01:35:39.666 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511630412, 2024-09-17T01:35:39.666 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0" 2024-09-17T01:35:39.667 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:39.667 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-09-17T01:35:39.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.665+0000 7f3cb6a00640 1 -- 172.21.15.42:0/4291765701 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3c90078b90 msgr2=0x7f3c9007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:39.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.665+0000 7f3cb6a00640 1 --2- 172.21.15.42:0/4291765701 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3c90078b90 0x7f3c9007b0a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4000fd0 tx=0x7f3ca40067d0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.665+0000 7f3cb6a00640 1 -- 172.21.15.42:0/4291765701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cb01462c0 msgr2=0x7f3cb01466d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:39.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.665+0000 7f3cb6a00640 1 --2- 172.21.15.42:0/4291765701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cb01462c0 0x7f3cb01466d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0072090 tx=0x7f3ca800f3c0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.665+0000 7f3cb6a00640 1 -- 172.21.15.42:0/4291765701 shutdown_connections 2024-09-17T01:35:39.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.665+0000 7f3cb6a00640 1 --2- 172.21.15.42:0/4291765701 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3c90078b90 0x7f3c9007b0a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.665+0000 7f3cb6a00640 1 --2- 172.21.15.42:0/4291765701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cb01462c0 0x7f3cb01466d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.665+0000 7f3cb6a00640 1 --2- 172.21.15.42:0/4291765701 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cb00ad3e0 0x7f3cb00ad7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.665+0000 7f3cb6a00640 1 --2- 172.21.15.42:0/4291765701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c98004800 0x7f3cb0149ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.665+0000 7f3cb6a00640 1 -- 172.21.15.42:0/4291765701 >> 172.21.15.42:0/4291765701 conn(0x7f3cb006d440 msgr2=0x7f3cb01526a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:39.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.665+0000 7f3cb6a00640 1 -- 172.21.15.42:0/4291765701 shutdown_connections 2024-09-17T01:35:39.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.665+0000 7f3cb6a00640 1 -- 172.21.15.42:0/4291765701 wait complete. 2024-09-17T01:35:39.685 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:35:39.749 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-17T01:35:39.751+0000 7f9965000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-17T01:35:39.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.915+0000 7fa42de00640 1 -- 172.21.15.42:0/938541854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa40c004d40 msgr2=0x7fa40c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:39.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.915+0000 7fa42de00640 1 --2- 172.21.15.42:0/938541854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa40c004d40 0x7fa40c005150 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa420005fd0 tx=0x7fa40c005830 comp rx=0 tx=0).stop 2024-09-17T01:35:39.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.915+0000 7fa427400640 1 -- 172.21.15.42:0/938541854 reap_dead start 2024-09-17T01:35:39.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.915+0000 7fa42de00640 1 -- 172.21.15.42:0/938541854 shutdown_connections 2024-09-17T01:35:39.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.915+0000 7fa42de00640 1 -- 172.21.15.42:0/938541854 >> 172.21.15.42:0/938541854 conn(0x7fa4280b2930 msgr2=0x7fa42806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:39.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.915+0000 7fa42de00640 1 -- 172.21.15.42:0/938541854 shutdown_connections 2024-09-17T01:35:39.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.915+0000 7fa42de00640 1 -- 172.21.15.42:0/938541854 wait complete. 2024-09-17T01:35:39.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.918+0000 7fa42de00640 1 Processor -- start 2024-09-17T01:35:39.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.918+0000 7fa42de00640 1 -- start start 2024-09-17T01:35:39.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.919+0000 7fa42de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa40c004d40 0x7fa42806e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.919+0000 7fa42de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa42806ff10 0x7fa42813ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.919+0000 7fa42de00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa4281410e0 0x7fa4281414f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.919+0000 7fa42de00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa42815d3b0 con 0x7fa42806ff10 2024-09-17T01:35:39.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.919+0000 7fa42de00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa42815d230 con 0x7fa40c004d40 2024-09-17T01:35:39.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.919+0000 7fa42de00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa42815d530 con 0x7fa4281410e0 2024-09-17T01:35:39.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.919+0000 7fa41e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa42806ff10 0x7fa42813ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.919+0000 7fa41e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa42806ff10 0x7fa42813ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37548/0 (socket says 172.21.15.42:37548) 2024-09-17T01:35:39.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.919+0000 7fa41e000640 1 -- 172.21.15.42:0/3690188379 learned_addr learned my addr 172.21.15.42:0/3690188379 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:39.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.920+0000 7fa427400640 1 --2- 172.21.15.42:0/3690188379 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa4281410e0 0x7fa4281414f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.920+0000 7fa426a00640 1 --2- 172.21.15.42:0/3690188379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa40c004d40 0x7fa42806e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.920+0000 7fa41e000640 1 -- 172.21.15.42:0/3690188379 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa4281410e0 msgr2=0x7fa4281414f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:39.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.920+0000 7fa41e000640 1 --2- 172.21.15.42:0/3690188379 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa4281410e0 0x7fa4281414f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.920+0000 7fa41e000640 1 -- 172.21.15.42:0/3690188379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa40c004d40 msgr2=0x7fa42806e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:39.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.920+0000 7fa41e000640 1 --2- 172.21.15.42:0/3690188379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa40c004d40 0x7fa42806e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:39.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.920+0000 7fa41e000640 1 -- 172.21.15.42:0/3690188379 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa428141a30 con 0x7fa42806ff10 2024-09-17T01:35:39.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.920+0000 7fa426a00640 1 --2- 172.21.15.42:0/3690188379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa40c004d40 0x7fa42806e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:39.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.920+0000 7fa41e000640 1 --2- 172.21.15.42:0/3690188379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa42806ff10 0x7fa42813ed50 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa41000e730 tx=0x7fa41000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:39.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.920+0000 7fa41fe00640 1 -- 172.21.15.42:0/3690188379 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa410004230 con 0x7fa42806ff10 2024-09-17T01:35:39.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.920+0000 7fa41fe00640 1 -- 172.21.15.42:0/3690188379 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa410016070 con 0x7fa42806ff10 2024-09-17T01:35:39.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.920+0000 7fa41fe00640 1 -- 172.21.15.42:0/3690188379 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41000caa0 con 0x7fa42806ff10 2024-09-17T01:35:39.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.920+0000 7fa42de00640 1 -- 172.21.15.42:0/3690188379 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa42806eaa0 con 0x7fa42806ff10 2024-09-17T01:35:39.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.921+0000 7fa42de00640 1 -- 172.21.15.42:0/3690188379 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa42806f060 con 0x7fa42806ff10 2024-09-17T01:35:39.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.922+0000 7fa42de00640 1 -- 172.21.15.42:0/3690188379 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4280cf050 con 0x7fa42806ff10 2024-09-17T01:35:39.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.923+0000 7fa41fe00640 1 -- 172.21.15.42:0/3690188379 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa41000cc40 con 0x7fa42806ff10 2024-09-17T01:35:39.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.924+0000 7fa41fe00640 1 --2- 172.21.15.42:0/3690188379 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa404078bc0 0x7fa40407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:39.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.924+0000 7fa41fe00640 1 -- 172.21.15.42:0/3690188379 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fa41009b080 con 0x7fa42806ff10 2024-09-17T01:35:39.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.924+0000 7fa426a00640 1 --2- 172.21.15.42:0/3690188379 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa404078bc0 0x7fa40407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:39.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.925+0000 7fa426a00640 1 --2- 172.21.15.42:0/3690188379 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa404078bc0 0x7fa40407b0d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa418009c50 tx=0x7fa418005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:39.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:39.929+0000 7fa41fe00640 1 -- 172.21.15.42:0/3690188379 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa428141a30 con 0x7fa42806ff10 2024-09-17T01:35:40.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.158+0000 7fa42de00640 1 -- 172.21.15.42:0/3690188379 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa42806a170 con 0x7fa42806ff10 2024-09-17T01:35:40.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.159+0000 7fa41fe00640 1 -- 172.21.15.42:0/3690188379 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5224 (secure 0 0 0) 0x7fa4100635e0 con 0x7fa42806ff10 2024-09-17T01:35:40.158 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:35:40.158 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":29,"btime":"2024-09-17T01:35:39:752893+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5209,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4107697732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":4107697732},{"type":"v1","addr":"172.21.15.43:6837","nonce":4107697732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1959050852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1959050852},{"type":"v1","addr":"172.21.15.42:6833","nonce":1959050852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5271,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2487768756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2487768756},{"type":"v1","addr":"172.21.15.43:6836","nonce":2487768756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:35:11.176089+0000","modified":"2024-09-17T01:35:39.706506+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.42:6835/1094322669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1094322669},{"type":"v1","addr":"172.21.15.42:6835","nonce":1094322669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-17T01:35:40.158 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 29 2024-09-17T01:35:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.161+0000 7fa42de00640 1 -- 172.21.15.42:0/3690188379 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa404078bc0 msgr2=0x7fa40407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.161+0000 7fa42de00640 1 --2- 172.21.15.42:0/3690188379 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa404078bc0 0x7fa40407b0d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa418009c50 tx=0x7fa418005f90 comp rx=0 tx=0).stop 2024-09-17T01:35:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.161+0000 7fa42de00640 1 -- 172.21.15.42:0/3690188379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa42806ff10 msgr2=0x7fa42813ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.161+0000 7fa42de00640 1 --2- 172.21.15.42:0/3690188379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa42806ff10 0x7fa42813ed50 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa41000e730 tx=0x7fa41000ebf0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.161+0000 7fa42de00640 1 -- 172.21.15.42:0/3690188379 shutdown_connections 2024-09-17T01:35:40.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.161+0000 7fa42de00640 1 --2- 172.21.15.42:0/3690188379 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa404078bc0 0x7fa40407b0d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.161+0000 7fa42de00640 1 --2- 172.21.15.42:0/3690188379 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa4281410e0 0x7fa4281414f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.161+0000 7fa42de00640 1 --2- 172.21.15.42:0/3690188379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa42806ff10 0x7fa42813ed50 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.161+0000 7fa42de00640 1 --2- 172.21.15.42:0/3690188379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa40c004d40 0x7fa42806e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.161+0000 7fa42de00640 1 -- 172.21.15.42:0/3690188379 >> 172.21.15.42:0/3690188379 conn(0x7fa4280b2930 msgr2=0x7fa428160440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:40.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.161+0000 7fa42de00640 1 -- 172.21.15.42:0/3690188379 shutdown_connections 2024-09-17T01:35:40.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.161+0000 7fa42de00640 1 -- 172.21.15.42:0/3690188379 wait complete. 2024-09-17T01:35:40.183 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage rm 560875946 2024-09-17T01:35:40.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.414+0000 7f0e37600640 1 -- 172.21.15.42:0/3202000458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e300b3550 msgr2=0x7f0e3015cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:40.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.414+0000 7f0e37600640 1 --2- 172.21.15.42:0/3202000458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e300b3550 0x7f0e3015cec0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0e24009830 tx=0x7f0e2402a480 comp rx=0 tx=0).stop 2024-09-17T01:35:40.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.414+0000 7f0e37600640 1 -- 172.21.15.42:0/3202000458 shutdown_connections 2024-09-17T01:35:40.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.414+0000 7f0e37600640 1 --2- 172.21.15.42:0/3202000458 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0e30142f40 0x7f0e30072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.414+0000 7f0e37600640 1 --2- 172.21.15.42:0/3202000458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e300b3550 0x7f0e3015cec0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.414+0000 7f0e37600640 1 -- 172.21.15.42:0/3202000458 >> 172.21.15.42:0/3202000458 conn(0x7f0e300b2930 msgr2=0x7f0e3006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:40.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.414+0000 7f0e37600640 1 -- 172.21.15.42:0/3202000458 shutdown_connections 2024-09-17T01:35:40.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.414+0000 7f0e37600640 1 -- 172.21.15.42:0/3202000458 wait complete. 2024-09-17T01:35:40.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.416+0000 7f0e37600640 1 Processor -- start 2024-09-17T01:35:40.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.416+0000 7f0e37600640 1 -- start start 2024-09-17T01:35:40.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.417+0000 7f0e37600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e30072e90 0x7f0e300ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.418+0000 7f0e37600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e300b3550 0x7f0e300aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.418+0000 7f0e37600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0e30142f40 0x7f0e301f9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.418+0000 7f0e37600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3006d7c0 con 0x7f0e300b3550 2024-09-17T01:35:40.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.418+0000 7f0e37600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3006d640 con 0x7f0e30072e90 2024-09-17T01:35:40.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.418+0000 7f0e37600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0e3006d940 con 0x7f0e30142f40 2024-09-17T01:35:40.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.418+0000 7f0e2fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e300b3550 0x7f0e300aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.418+0000 7f0e2fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e300b3550 0x7f0e300aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37564/0 (socket says 172.21.15.42:37564) 2024-09-17T01:35:40.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.418+0000 7f0e2fe00640 1 -- 172.21.15.42:0/1006993735 learned_addr learned my addr 172.21.15.42:0/1006993735 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:40.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.418+0000 7f0e34c00640 1 --2- 172.21.15.42:0/1006993735 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e30072e90 0x7f0e300ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.418+0000 7f0e35600640 1 --2- 172.21.15.42:0/1006993735 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0e30142f40 0x7f0e301f9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.418+0000 7f0e2fe00640 1 -- 172.21.15.42:0/1006993735 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0e30142f40 msgr2=0x7f0e301f9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:40.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.418+0000 7f0e2fe00640 1 --2- 172.21.15.42:0/1006993735 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0e30142f40 0x7f0e301f9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.418+0000 7f0e2fe00640 1 -- 172.21.15.42:0/1006993735 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e30072e90 msgr2=0x7f0e300ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:40.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.418+0000 7f0e2fe00640 1 --2- 172.21.15.42:0/1006993735 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e30072e90 0x7f0e300ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.418+0000 7f0e2fe00640 1 -- 172.21.15.42:0/1006993735 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3006eec0 con 0x7f0e300b3550 2024-09-17T01:35:40.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.419+0000 7f0e2fe00640 1 --2- 172.21.15.42:0/1006993735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e300b3550 0x7f0e300aede0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00d740 tx=0x7f0e1c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:40.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.419+0000 7f0e2cc00640 1 -- 172.21.15.42:0/1006993735 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c017070 con 0x7f0e300b3550 2024-09-17T01:35:40.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.419+0000 7f0e2cc00640 1 -- 172.21.15.42:0/1006993735 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e1c009d20 con 0x7f0e300b3550 2024-09-17T01:35:40.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.419+0000 7f0e2cc00640 1 -- 172.21.15.42:0/1006993735 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c0106c0 con 0x7f0e300b3550 2024-09-17T01:35:40.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.419+0000 7f0e37600640 1 -- 172.21.15.42:0/1006993735 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e3006f1a0 con 0x7f0e300b3550 2024-09-17T01:35:40.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.419+0000 7f0e37600640 1 -- 172.21.15.42:0/1006993735 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e3006f760 con 0x7f0e300b3550 2024-09-17T01:35:40.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.423+0000 7f0e2cc00640 1 -- 172.21.15.42:0/1006993735 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0e1c01a070 con 0x7f0e300b3550 2024-09-17T01:35:40.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.424+0000 7f0e2cc00640 1 --2- 172.21.15.42:0/1006993735 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0e10078b90 0x7f0e1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.424+0000 7f0e2cc00640 1 -- 172.21.15.42:0/1006993735 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f0e1c09add0 con 0x7f0e300b3550 2024-09-17T01:35:40.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.424+0000 7f0e3e6a2740 1 Processor -- start 2024-09-17T01:35:40.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.424+0000 7f0e3e6a2740 1 -- start start 2024-09-17T01:35:40.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.424+0000 7f0e34c00640 1 --2- 172.21.15.42:0/1006993735 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0e10078b90 0x7f0e1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.425+0000 7f0e34c00640 1 --2- 172.21.15.42:0/1006993735 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0e10078b90 0x7f0e1007b0a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0e24034000 tx=0x7f0e24004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:40.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.425+0000 7f0e3e6a2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f650490 0x55b28fa3cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.425+0000 7f0e3e6a2740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b28f6275d0 0x55b28fa11a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.425+0000 7f0e3e6a2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b28f62f7b0 0x55b28fa11f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.425+0000 7f0e3e6a2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b28f96a8e0 con 0x55b28f650490 2024-09-17T01:35:40.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.425+0000 7f0e3e6a2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b28f959d10 con 0x55b28f62f7b0 2024-09-17T01:35:40.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.425+0000 7f0e3e6a2740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55b28f95db20 con 0x55b28f6275d0 2024-09-17T01:35:40.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.426+0000 7f0e34c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f650490 0x55b28fa3cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.426+0000 7f0e34c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f650490 0x55b28fa3cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37566/0 (socket says 172.21.15.42:37566) 2024-09-17T01:35:40.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.426+0000 7f0e34c00640 1 -- 172.21.15.42:0/3768430470 learned_addr learned my addr 172.21.15.42:0/3768430470 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:40.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.426+0000 7f0e35600640 1 --2- 172.21.15.42:0/3768430470 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b28f62f7b0 0x55b28fa11f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.426+0000 7f0e2fe00640 1 --2- 172.21.15.42:0/3768430470 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b28f6275d0 0x55b28fa11a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.426+0000 7f0e34c00640 1 -- 172.21.15.42:0/3768430470 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b28f6275d0 msgr2=0x55b28fa11a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:40.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.426+0000 7f0e34c00640 1 --2- 172.21.15.42:0/3768430470 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b28f6275d0 0x55b28fa11a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.426+0000 7f0e34c00640 1 -- 172.21.15.42:0/3768430470 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b28f62f7b0 msgr2=0x55b28fa11f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:40.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.426+0000 7f0e34c00640 1 --2- 172.21.15.42:0/3768430470 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b28f62f7b0 0x55b28fa11f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.426+0000 7f0e34c00640 1 -- 172.21.15.42:0/3768430470 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b28f734900 con 0x55b28f650490 2024-09-17T01:35:40.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.426+0000 7f0e34c00640 1 --2- 172.21.15.42:0/3768430470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f650490 0x55b28fa3cbd0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0e24009780 tx=0x7f0e2403e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b29960ee1d0d3ea server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:40.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.427+0000 7f0e21200640 1 -- 172.21.15.42:0/3768430470 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e24003ec0 con 0x55b28f650490 2024-09-17T01:35:40.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.427+0000 7f0e21200640 1 -- 172.21.15.42:0/3768430470 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e24047510 con 0x55b28f650490 2024-09-17T01:35:40.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.427+0000 7f0e21200640 1 -- 172.21.15.42:0/3768430470 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e24047960 con 0x55b28f650490 2024-09-17T01:35:40.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.428+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/3768430470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f650490 msgr2=0x55b28fa3cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:40.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.428+0000 7f0e3e6a2740 1 --2- 172.21.15.42:0/3768430470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f650490 0x55b28fa3cbd0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0e24009780 tx=0x7f0e2403e070 comp rx=0 tx=0).stop 2024-09-17T01:35:40.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.428+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/3768430470 shutdown_connections 2024-09-17T01:35:40.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.428+0000 7f0e3e6a2740 1 --2- 172.21.15.42:0/3768430470 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b28f62f7b0 0x55b28fa11f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.428+0000 7f0e3e6a2740 1 --2- 172.21.15.42:0/3768430470 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b28f6275d0 0x55b28fa11a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.428+0000 7f0e3e6a2740 1 --2- 172.21.15.42:0/3768430470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f650490 0x55b28fa3cbd0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.428+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/3768430470 >> 172.21.15.42:0/3768430470 conn(0x55b28f6445e0 msgr2=0x55b28f9f7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:40.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.428+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/3768430470 shutdown_connections 2024-09-17T01:35:40.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.428+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/3768430470 wait complete. 2024-09-17T01:35:40.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.429+0000 7f0e3e6a2740 1 -- start start 2024-09-17T01:35:40.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.429+0000 7f0e3e6a2740 1 Processor -- start 2024-09-17T01:35:40.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.431+0000 7f0e3e6a2740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b28f6275d0 0x55b28fa224d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.431+0000 7f0e3e6a2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b28f62f7b0 0x55b28fa4b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.431+0000 7f0e3e6a2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f650490 0x55b28fa4b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.431+0000 7f0e3e6a2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b28f6ca840 con 0x55b28f650490 2024-09-17T01:35:40.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.431+0000 7f0e3e6a2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b28f8ff6f0 con 0x55b28f62f7b0 2024-09-17T01:35:40.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.431+0000 7f0e3e6a2740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55b28fa016a0 con 0x55b28f6275d0 2024-09-17T01:35:40.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.431+0000 7f0e3e6a2740 10 client.0 _ll_register_callbacks cb 0x55b28f905700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:40.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.431+0000 7f0e35600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f650490 0x55b28fa4b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.431+0000 7f0e35600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f650490 0x55b28fa4b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37570/0 (socket says 172.21.15.42:37570) 2024-09-17T01:35:40.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.431+0000 7f0e35600640 1 -- 172.21.15.42:0/257377352 learned_addr learned my addr 172.21.15.42:0/257377352 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:40.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.431+0000 7f0e34c00640 1 --2- 172.21.15.42:0/257377352 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b28f6275d0 0x55b28fa224d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.431+0000 7f0e2fe00640 1 --2- 172.21.15.42:0/257377352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b28f62f7b0 0x55b28fa4b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.431+0000 7f0e35600640 1 -- 172.21.15.42:0/257377352 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b28f6275d0 msgr2=0x55b28fa224d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:40.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.431+0000 7f0e35600640 1 --2- 172.21.15.42:0/257377352 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b28f6275d0 0x55b28fa224d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.431+0000 7f0e35600640 1 -- 172.21.15.42:0/257377352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b28f62f7b0 msgr2=0x55b28fa4b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:40.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.431+0000 7f0e35600640 1 --2- 172.21.15.42:0/257377352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b28f62f7b0 0x55b28fa4b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.431+0000 7f0e35600640 1 -- 172.21.15.42:0/257377352 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b28f6997a0 con 0x55b28f650490 2024-09-17T01:35:40.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.432+0000 7f0e35600640 1 --2- 172.21.15.42:0/257377352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f650490 0x55b28fa4b6c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0e28012d20 tx=0x7f0e28010610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212b6ca74f278298 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:40.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.432+0000 7f0e15600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:40.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.432+0000 7f0e15600640 1 -- 172.21.15.42:0/257377352 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e2801a070 con 0x55b28f650490 2024-09-17T01:35:40.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.432+0000 7f0e15600640 1 -- 172.21.15.42:0/257377352 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f0e28001ec0 con 0x55b28f650490 2024-09-17T01:35:40.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.432+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/257377352 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e24047510 con 0x55b28f650490 2024-09-17T01:35:40.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.432+0000 7f0e15600640 1 -- 172.21.15.42:0/257377352 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0e28025050 con 0x55b28f650490 2024-09-17T01:35:40.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.432+0000 7f0e3e6a2740 10 client.5751 fetch_fsmap learned FSMap version 29 2024-09-17T01:35:40.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.432+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/257377352 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55b28f795090 con 0x55b28f650490 2024-09-17T01:35:40.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.432+0000 7f0e15600640 1 -- 172.21.15.42:0/257377352 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e24047510 con 0x55b28f650490 2024-09-17T01:35:40.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.432+0000 7f0e15600640 1 -- 172.21.15.42:0/257377352 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f0e28028020 con 0x55b28f650490 2024-09-17T01:35:40.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.432+0000 7f0e3e6a2740 10 client.5751 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T01:35:40.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.432+0000 7f0e3e6a2740 10 client.5751 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:35:40.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.433+0000 7f0e3e6a2740 20 client.5751 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:40.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.433+0000 7f0e3e6a2740 1 --2- 172.21.15.42:0/257377352 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55b28f60f060 0x55b28fa02550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.433+0000 7f0e3e6a2740 4 client.5751 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:40.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.433+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/257377352 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b28f96c830 con 0x55b28f60f060 2024-09-17T01:35:40.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.433+0000 7f0e34c00640 1 --2- 172.21.15.42:0/257377352 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55b28f60f060 0x55b28fa02550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.433+0000 7f0e34c00640 1 --2- 172.21.15.42:0/257377352 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55b28f60f060 0x55b28fa02550 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bcd55b21c3681dd server_cookie=febe5f308dc16e9b in_seq=0 out_seq=0 2024-09-17T01:35:40.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.433+0000 7f0e15600640 10 client.5751 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:40.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.434+0000 7f0e15600640 1 -- 172.21.15.42:0/257377352 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b28f96c830 con 0x55b28f60f060 2024-09-17T01:35:40.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.434+0000 7f0e15600640 10 client.5751 handle_command_reply: tid=0 2024-09-17T01:35:40.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.434+0000 7f0e3e6a2740 1 client.5751 shutdown 2024-09-17T01:35:40.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.434+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/257377352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f650490 msgr2=0x55b28fa4b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:40.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.434+0000 7f0e3e6a2740 1 --2- 172.21.15.42:0/257377352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f650490 0x55b28fa4b6c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0e28012d20 tx=0x7f0e28010610 comp rx=0 tx=0).stop 2024-09-17T01:35:40.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.434+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/257377352 shutdown_connections 2024-09-17T01:35:40.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.434+0000 7f0e3e6a2740 1 --2- 172.21.15.42:0/257377352 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55b28f60f060 0x55b28fa02550 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.434+0000 7f0e3e6a2740 1 --2- 172.21.15.42:0/257377352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b28f62f7b0 0x55b28fa4b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.434+0000 7f0e3e6a2740 1 --2- 172.21.15.42:0/257377352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f650490 0x55b28fa4b6c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.434+0000 7f0e3e6a2740 1 --2- 172.21.15.42:0/257377352 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b28f6275d0 0x55b28fa224d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.434+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/257377352 >> 172.21.15.42:0/257377352 conn(0x55b28f6445e0 msgr2=0x55b28f9f7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:40.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.434+0000 7f0e15600640 0 client.5751 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:40.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.435+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/257377352 shutdown_connections 2024-09-17T01:35:40.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.435+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/257377352 wait complete. 2024-09-17T01:35:40.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.435+0000 7f0e3e6a2740 20 client.5751 trim_cache size 0 max 16384 2024-09-17T01:35:40.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.449+0000 7f0e3e6a2740 1 Processor -- start 2024-09-17T01:35:40.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.449+0000 7f0e3e6a2740 1 -- start start 2024-09-17T01:35:40.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.451+0000 7f0e3e6a2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b28f6275d0 0x55b28fa39820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.451+0000 7f0e3e6a2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f62f7b0 0x55b28fa107e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.451+0000 7f0e3e6a2740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b28f650490 0x55b28fa1e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.451+0000 7f0e3e6a2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0e300c60f0 con 0x55b28f62f7b0 2024-09-17T01:35:40.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.451+0000 7f0e3e6a2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0e300c5430 con 0x55b28f6275d0 2024-09-17T01:35:40.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.451+0000 7f0e3e6a2740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0e300c5a80 con 0x55b28f650490 2024-09-17T01:35:40.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.451+0000 7f0e2fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f62f7b0 0x55b28fa107e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.451+0000 7f0e2fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f62f7b0 0x55b28fa107e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37582/0 (socket says 172.21.15.42:37582) 2024-09-17T01:35:40.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.451+0000 7f0e2fe00640 1 -- 172.21.15.42:0/2492788919 learned_addr learned my addr 172.21.15.42:0/2492788919 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:40.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.451+0000 7f0e2fe00640 1 -- 172.21.15.42:0/2492788919 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b28f650490 msgr2=0x55b28fa1e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:40.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.451+0000 7f0e2fe00640 1 --2- 172.21.15.42:0/2492788919 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b28f650490 0x55b28fa1e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.451+0000 7f0e2fe00640 1 -- 172.21.15.42:0/2492788919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b28f6275d0 msgr2=0x55b28fa39820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:40.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.451+0000 7f0e2fe00640 1 --2- 172.21.15.42:0/2492788919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b28f6275d0 0x55b28fa39820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.451+0000 7f0e2fe00640 1 -- 172.21.15.42:0/2492788919 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b28f732c00 con 0x55b28f62f7b0 2024-09-17T01:35:40.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.451+0000 7f0e2fe00640 1 --2- 172.21.15.42:0/2492788919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f62f7b0 0x55b28fa107e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c062950 tx=0x7f0e1c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea907aa7bc8aeda8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:40.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.452+0000 7f0e17e00640 1 -- 172.21.15.42:0/2492788919 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c04e020 con 0x55b28f62f7b0 2024-09-17T01:35:40.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.452+0000 7f0e17e00640 1 -- 172.21.15.42:0/2492788919 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e1c04e1c0 con 0x55b28f62f7b0 2024-09-17T01:35:40.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.452+0000 7f0e17e00640 1 -- 172.21.15.42:0/2492788919 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c021040 con 0x55b28f62f7b0 2024-09-17T01:35:40.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.452+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/2492788919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f62f7b0 msgr2=0x55b28fa107e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:40.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.452+0000 7f0e3e6a2740 1 --2- 172.21.15.42:0/2492788919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f62f7b0 0x55b28fa107e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c062950 tx=0x7f0e1c000bc0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.452+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/2492788919 shutdown_connections 2024-09-17T01:35:40.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.452+0000 7f0e3e6a2740 1 --2- 172.21.15.42:0/2492788919 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b28f650490 0x55b28fa1e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.452+0000 7f0e3e6a2740 1 --2- 172.21.15.42:0/2492788919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f62f7b0 0x55b28fa107e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.452+0000 7f0e3e6a2740 1 --2- 172.21.15.42:0/2492788919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b28f6275d0 0x55b28fa39820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.452+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/2492788919 >> 172.21.15.42:0/2492788919 conn(0x55b28f6445e0 msgr2=0x55b28fa39110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:40.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.452+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/2492788919 shutdown_connections 2024-09-17T01:35:40.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.452+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/2492788919 wait complete. 2024-09-17T01:35:40.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.453+0000 7f0e3e6a2740 1 -- start start 2024-09-17T01:35:40.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.454+0000 7f0e3e6a2740 1 Processor -- start 2024-09-17T01:35:40.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.455+0000 7f0e3e6a2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b28f6275d0 0x55b28fab2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.455+0000 7f0e3e6a2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f62f7b0 0x55b28fa39110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.455+0000 7f0e3e6a2740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b28f650490 0x55b28fa39650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.455+0000 7f0e3e6a2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b28fa00390 con 0x55b28f62f7b0 2024-09-17T01:35:40.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.455+0000 7f0e3e6a2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b28fa4bcb0 con 0x55b28f6275d0 2024-09-17T01:35:40.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.455+0000 7f0e3e6a2740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55b28fa009b0 con 0x55b28f650490 2024-09-17T01:35:40.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.455+0000 7f0e3e6a2740 10 client.0 _ll_register_callbacks cb 0x7f0e280129b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:40.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.455+0000 7f0e2fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f62f7b0 0x55b28fa39110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.455+0000 7f0e2fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f62f7b0 0x55b28fa39110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37590/0 (socket says 172.21.15.42:37590) 2024-09-17T01:35:40.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.455+0000 7f0e2fe00640 1 -- 172.21.15.42:0/1560638806 learned_addr learned my addr 172.21.15.42:0/1560638806 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:40.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.456+0000 7f0e34c00640 1 --2- 172.21.15.42:0/1560638806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b28f6275d0 0x55b28fab2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.456+0000 7f0e35600640 1 --2- 172.21.15.42:0/1560638806 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b28f650490 0x55b28fa39650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.456+0000 7f0e2fe00640 1 -- 172.21.15.42:0/1560638806 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b28f650490 msgr2=0x55b28fa39650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:40.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.456+0000 7f0e2fe00640 1 --2- 172.21.15.42:0/1560638806 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b28f650490 0x55b28fa39650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.456+0000 7f0e2fe00640 1 -- 172.21.15.42:0/1560638806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b28f6275d0 msgr2=0x55b28fab2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:40.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.456+0000 7f0e2fe00640 1 --2- 172.21.15.42:0/1560638806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b28f6275d0 0x55b28fab2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.456+0000 7f0e2fe00640 1 -- 172.21.15.42:0/1560638806 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b28f9f8190 con 0x55b28f62f7b0 2024-09-17T01:35:40.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.456+0000 7f0e2fe00640 1 --2- 172.21.15.42:0/1560638806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f62f7b0 0x55b28fa39110 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c062950 tx=0x7f0e1c0673f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c153adf5b58b86 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:40.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.456+0000 7f0e15600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:40.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.456+0000 7f0e15600640 1 -- 172.21.15.42:0/1560638806 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c04e020 con 0x55b28f62f7b0 2024-09-17T01:35:40.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.456+0000 7f0e15600640 1 -- 172.21.15.42:0/1560638806 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f0e1c0620c0 con 0x55b28f62f7b0 2024-09-17T01:35:40.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.456+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/1560638806 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b28f9682e0 con 0x55b28f62f7b0 2024-09-17T01:35:40.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.457+0000 7f0e15600640 1 -- 172.21.15.42:0/1560638806 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0e1c081070 con 0x55b28f62f7b0 2024-09-17T01:35:40.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.457+0000 7f0e3e6a2740 10 client.5757 fetch_fsmap learned FSMap version 29 2024-09-17T01:35:40.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.457+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/1560638806 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55b28f9f8430 con 0x55b28f62f7b0 2024-09-17T01:35:40.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.457+0000 7f0e15600640 1 -- 172.21.15.42:0/1560638806 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b28f9682e0 con 0x55b28f62f7b0 2024-09-17T01:35:40.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.457+0000 7f0e15600640 1 -- 172.21.15.42:0/1560638806 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f0e1c05e5a0 con 0x55b28f62f7b0 2024-09-17T01:35:40.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.457+0000 7f0e3e6a2740 10 client.5757 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T01:35:40.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.457+0000 7f0e3e6a2740 10 client.5757 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:35:40.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.457+0000 7f0e3e6a2740 20 client.5757 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:40.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.457+0000 7f0e3e6a2740 1 --2- 172.21.15.42:0/1560638806 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55b28fabc6e0 0x55b28fa4de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.457+0000 7f0e3e6a2740 4 client.5757 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 560875946}] 2024-09-17T01:35:40.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.457+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/1560638806 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "damage rm", "damage_id": 560875946}) -- 0x55b28f965710 con 0x55b28fabc6e0 2024-09-17T01:35:40.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.457+0000 7f0e34c00640 1 --2- 172.21.15.42:0/1560638806 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55b28fabc6e0 0x55b28fa4de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.458+0000 7f0e15600640 10 client.5757 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:40.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.458+0000 7f0e34c00640 1 --2- 172.21.15.42:0/1560638806 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55b28fabc6e0 0x55b28fa4de40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c00827ca2ebb33db server_cookie=57c926c5cefde7e1 in_seq=0 out_seq=0 2024-09-17T01:35:40.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.458+0000 7f0e15600640 1 -- 172.21.15.42:0/1560638806 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x55b28f965710 con 0x55b28fabc6e0 2024-09-17T01:35:40.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.458+0000 7f0e15600640 10 client.5757 handle_command_reply: tid=0 2024-09-17T01:35:40.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.458+0000 7f0e3e6a2740 1 client.5757 shutdown 2024-09-17T01:35:40.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.458+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/1560638806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f62f7b0 msgr2=0x55b28fa39110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:40.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.458+0000 7f0e3e6a2740 1 --2- 172.21.15.42:0/1560638806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f62f7b0 0x55b28fa39110 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c062950 tx=0x7f0e1c0673f0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.458+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/1560638806 shutdown_connections 2024-09-17T01:35:40.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.458+0000 7f0e3e6a2740 1 --2- 172.21.15.42:0/1560638806 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55b28fabc6e0 0x55b28fa4de40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.458+0000 7f0e3e6a2740 1 --2- 172.21.15.42:0/1560638806 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b28f650490 0x55b28fa39650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.458+0000 7f0e3e6a2740 1 --2- 172.21.15.42:0/1560638806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b28f62f7b0 0x55b28fa39110 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.458+0000 7f0e3e6a2740 1 --2- 172.21.15.42:0/1560638806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b28f6275d0 0x55b28fab2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.458+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/1560638806 >> 172.21.15.42:0/1560638806 conn(0x55b28f6445e0 msgr2=0x55b28fa3cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:40.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.458+0000 7f0e15600640 0 client.5757 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:40.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.458+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/1560638806 shutdown_connections 2024-09-17T01:35:40.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.459+0000 7f0e3e6a2740 1 -- 172.21.15.42:0/1560638806 wait complete. 2024-09-17T01:35:40.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.459+0000 7f0e3e6a2740 20 client.5757 trim_cache size 0 max 16384 2024-09-17T01:35:40.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.459+0000 7f0e37600640 1 -- 172.21.15.42:0/1006993735 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0e10078b90 msgr2=0x7f0e1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:40.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.459+0000 7f0e37600640 1 --2- 172.21.15.42:0/1006993735 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0e10078b90 0x7f0e1007b0a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0e24034000 tx=0x7f0e24004730 comp rx=0 tx=0).stop 2024-09-17T01:35:40.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.459+0000 7f0e37600640 1 -- 172.21.15.42:0/1006993735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e300b3550 msgr2=0x7f0e300aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:40.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.459+0000 7f0e37600640 1 --2- 172.21.15.42:0/1006993735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e300b3550 0x7f0e300aede0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00d740 tx=0x7f0e1c00dc00 comp rx=0 tx=0).stop 2024-09-17T01:35:40.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.459+0000 7f0e37600640 1 -- 172.21.15.42:0/1006993735 shutdown_connections 2024-09-17T01:35:40.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.459+0000 7f0e37600640 1 --2- 172.21.15.42:0/1006993735 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0e10078b90 0x7f0e1007b0a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.459+0000 7f0e37600640 1 --2- 172.21.15.42:0/1006993735 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0e30142f40 0x7f0e301f9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.459+0000 7f0e37600640 1 --2- 172.21.15.42:0/1006993735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0e300b3550 0x7f0e300aede0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.459+0000 7f0e37600640 1 --2- 172.21.15.42:0/1006993735 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e30072e90 0x7f0e300ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.459+0000 7f0e37600640 1 -- 172.21.15.42:0/1006993735 >> 172.21.15.42:0/1006993735 conn(0x7f0e300b2930 msgr2=0x7f0e3015f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:40.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.459+0000 7f0e37600640 1 -- 172.21.15.42:0/1006993735 shutdown_connections 2024-09-17T01:35:40.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.459+0000 7f0e37600640 1 -- 172.21.15.42:0/1006993735 wait complete. 2024-09-17T01:35:40.479 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-17T01:35:40.479 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-17T01:35:40.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.709+0000 7f8cbb400640 1 -- 172.21.15.42:0/1164769036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cb40b3550 msgr2=0x7f8cb415cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:40.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.709+0000 7f8cbb400640 1 --2- 172.21.15.42:0/1164769036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cb40b3550 0x7f8cb415cec0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8cb40704d0 tx=0x7f8ca802a560 comp rx=0 tx=0).stop 2024-09-17T01:35:40.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.710+0000 7f8cbb400640 1 -- 172.21.15.42:0/1164769036 shutdown_connections 2024-09-17T01:35:40.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.710+0000 7f8cbb400640 1 --2- 172.21.15.42:0/1164769036 >> v2:172.21.15.43:3300/0 conn(0x7f8cb4142f40 0x7f8cb4072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.710+0000 7f8cbb400640 1 --2- 172.21.15.42:0/1164769036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cb40b3550 0x7f8cb415cec0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.710+0000 7f8cbb400640 1 -- 172.21.15.42:0/1164769036 >> 172.21.15.42:0/1164769036 conn(0x7f8cb40b2930 msgr2=0x7f8cb406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:40.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.710+0000 7f8cbb400640 1 -- 172.21.15.42:0/1164769036 shutdown_connections 2024-09-17T01:35:40.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.710+0000 7f8cbb400640 1 -- 172.21.15.42:0/1164769036 wait complete. 2024-09-17T01:35:40.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.712+0000 7f8cbb400640 1 Processor -- start 2024-09-17T01:35:40.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.712+0000 7f8cbb400640 1 -- start start 2024-09-17T01:35:40.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.713+0000 7f8cbb400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cb4072e90 0x7f8cb4159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.713+0000 7f8cbb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cb40b3550 0x7f8cb4131b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.714+0000 7f8cbb400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cb4142f40 0x7f8cb4132050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.714+0000 7f8cbb400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb406d5b0 con 0x7f8cb40b3550 2024-09-17T01:35:40.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.714+0000 7f8cbb400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb406d430 con 0x7f8cb4142f40 2024-09-17T01:35:40.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.714+0000 7f8cbb400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8cb406d730 con 0x7f8cb4072e90 2024-09-17T01:35:40.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.714+0000 7f8cb3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cb40b3550 0x7f8cb4131b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.714+0000 7f8cb3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cb40b3550 0x7f8cb4131b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37604/0 (socket says 172.21.15.42:37604) 2024-09-17T01:35:40.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.714+0000 7f8cb3e00640 1 -- 172.21.15.42:0/4142775900 learned_addr learned my addr 172.21.15.42:0/4142775900 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:40.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.714+0000 7f8cb8a00640 1 --2- 172.21.15.42:0/4142775900 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cb4072e90 0x7f8cb4159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.714+0000 7f8cb9400640 1 --2- 172.21.15.42:0/4142775900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cb4142f40 0x7f8cb4132050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.714+0000 7f8cb3e00640 1 -- 172.21.15.42:0/4142775900 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cb4072e90 msgr2=0x7f8cb4159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:40.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.714+0000 7f8cb3e00640 1 --2- 172.21.15.42:0/4142775900 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cb4072e90 0x7f8cb4159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.714+0000 7f8cb3e00640 1 -- 172.21.15.42:0/4142775900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cb4142f40 msgr2=0x7f8cb4132050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:40.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.714+0000 7f8cb3e00640 1 --2- 172.21.15.42:0/4142775900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cb4142f40 0x7f8cb4132050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.714+0000 7f8cb3e00640 1 -- 172.21.15.42:0/4142775900 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb41f6eb0 con 0x7f8cb40b3550 2024-09-17T01:35:40.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.715+0000 7f8cb3e00640 1 --2- 172.21.15.42:0/4142775900 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cb40b3550 0x7f8cb4131b10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000e770 tx=0x7f8ca000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:40.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.715+0000 7f8cb0c00640 1 -- 172.21.15.42:0/4142775900 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca000ccc0 con 0x7f8cb40b3550 2024-09-17T01:35:40.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.715+0000 7f8cb0c00640 1 -- 172.21.15.42:0/4142775900 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ca000ee80 con 0x7f8cb40b3550 2024-09-17T01:35:40.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.715+0000 7f8cb0c00640 1 -- 172.21.15.42:0/4142775900 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0004290 con 0x7f8cb40b3550 2024-09-17T01:35:40.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.715+0000 7f8cbb400640 1 -- 172.21.15.42:0/4142775900 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb41f73b0 con 0x7f8cb40b3550 2024-09-17T01:35:40.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.715+0000 7f8cbb400640 1 -- 172.21.15.42:0/4142775900 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb41f7970 con 0x7f8cb40b3550 2024-09-17T01:35:40.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.717+0000 7f8cb0c00640 1 -- 172.21.15.42:0/4142775900 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8ca00035f0 con 0x7f8cb40b3550 2024-09-17T01:35:40.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.718+0000 7f8cb0c00640 1 --2- 172.21.15.42:0/4142775900 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8c94078bc0 0x7f8c9407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.718+0000 7f8cb0c00640 1 -- 172.21.15.42:0/4142775900 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f8ca009b550 con 0x7f8cb40b3550 2024-09-17T01:35:40.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.719+0000 7f8cc2468740 1 Processor -- start 2024-09-17T01:35:40.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.719+0000 7f8cb8a00640 1 --2- 172.21.15.42:0/4142775900 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8c94078bc0 0x7f8c9407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.719+0000 7f8cc2468740 1 -- start start 2024-09-17T01:35:40.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.720+0000 7f8cb8a00640 1 --2- 172.21.15.42:0/4142775900 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8c94078bc0 0x7f8c9407b0d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8033000 tx=0x7f8ca8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:40.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.721+0000 7f8cc2468740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563771b271e0 0x563771f12af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.721+0000 7f8cc2468740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771afe320 0x563771ec8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.721+0000 7f8cc2468740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563771b06500 0x563771ec8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.721+0000 7f8cc2468740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563771e51500 con 0x563771afe320 2024-09-17T01:35:40.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.721+0000 7f8cc2468740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563771e416a0 con 0x563771b06500 2024-09-17T01:35:40.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.721+0000 7f8cc2468740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x563771e30ad0 con 0x563771b271e0 2024-09-17T01:35:40.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.721+0000 7f8cb3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771afe320 0x563771ec8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.721+0000 7f8cb3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771afe320 0x563771ec8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37616/0 (socket says 172.21.15.42:37616) 2024-09-17T01:35:40.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.721+0000 7f8cb3e00640 1 -- 172.21.15.42:0/1778103084 learned_addr learned my addr 172.21.15.42:0/1778103084 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:40.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.721+0000 7f8cb8a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563771b271e0 0x563771f12af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.721+0000 7f8cb9400640 1 --2- 172.21.15.42:0/1778103084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563771b06500 0x563771ec8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.721+0000 7f8cb3e00640 1 -- 172.21.15.42:0/1778103084 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563771b271e0 msgr2=0x563771f12af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:40.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.721+0000 7f8cb3e00640 1 --2- 172.21.15.42:0/1778103084 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563771b271e0 0x563771f12af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.721+0000 7f8cb3e00640 1 -- 172.21.15.42:0/1778103084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563771b06500 msgr2=0x563771ec8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:40.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.721+0000 7f8cb3e00640 1 --2- 172.21.15.42:0/1778103084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563771b06500 0x563771ec8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.721+0000 7f8cb3e00640 1 -- 172.21.15.42:0/1778103084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563771df95f0 con 0x563771afe320 2024-09-17T01:35:40.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.722+0000 7f8cb3e00640 1 --2- 172.21.15.42:0/1778103084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771afe320 0x563771ec8030 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8ca005faf0 tx=0x7f8ca000ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d2342d1779734f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:40.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.722+0000 7f8ca5200640 1 -- 172.21.15.42:0/1778103084 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0067d60 con 0x563771afe320 2024-09-17T01:35:40.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.722+0000 7f8ca5200640 1 -- 172.21.15.42:0/1778103084 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ca005f5a0 con 0x563771afe320 2024-09-17T01:35:40.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.722+0000 7f8ca5200640 1 -- 172.21.15.42:0/1778103084 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca006a290 con 0x563771afe320 2024-09-17T01:35:40.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.723+0000 7f8cc2468740 1 -- 172.21.15.42:0/1778103084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771afe320 msgr2=0x563771ec8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:40.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.723+0000 7f8cc2468740 1 --2- 172.21.15.42:0/1778103084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771afe320 0x563771ec8030 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8ca005faf0 tx=0x7f8ca000ce80 comp rx=0 tx=0).stop 2024-09-17T01:35:40.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.723+0000 7f8cc2468740 1 -- 172.21.15.42:0/1778103084 shutdown_connections 2024-09-17T01:35:40.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.723+0000 7f8cc2468740 1 --2- 172.21.15.42:0/1778103084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563771b06500 0x563771ec8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.723+0000 7f8cc2468740 1 --2- 172.21.15.42:0/1778103084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771afe320 0x563771ec8030 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.723+0000 7f8cc2468740 1 --2- 172.21.15.42:0/1778103084 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563771b271e0 0x563771f12af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.723+0000 7f8cc2468740 1 -- 172.21.15.42:0/1778103084 >> 172.21.15.42:0/1778103084 conn(0x563771b1b330 msgr2=0x563771ecda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:40.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.723+0000 7f8cc2468740 1 -- 172.21.15.42:0/1778103084 shutdown_connections 2024-09-17T01:35:40.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.723+0000 7f8cc2468740 1 -- 172.21.15.42:0/1778103084 wait complete. 2024-09-17T01:35:40.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.724+0000 7f8cc2468740 1 -- start start 2024-09-17T01:35:40.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.724+0000 7f8cc2468740 1 Processor -- start 2024-09-17T01:35:40.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.725+0000 7f8cc2468740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563771afe320 0x563771ee4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.725+0000 7f8cc2468740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563771b06500 0x563771f0b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.725+0000 7f8cc2468740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771b271e0 0x563771f14590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.726+0000 7f8cc2468740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563771dd7400 con 0x563771b271e0 2024-09-17T01:35:40.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.726+0000 7f8cc2468740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563771e348e0 con 0x563771afe320 2024-09-17T01:35:40.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.726+0000 7f8cc2468740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x563771ba1590 con 0x563771b06500 2024-09-17T01:35:40.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.726+0000 7f8cc2468740 10 client.0 _ll_register_callbacks cb 0x563771ddc4f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:40.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.726+0000 7f8cb9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771b271e0 0x563771f14590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.726+0000 7f8cb8a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563771afe320 0x563771ee4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.726+0000 7f8cb3e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563771b06500 0x563771f0b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.726+0000 7f8cb8a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563771afe320 0x563771ee4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:49550/0 (socket says 172.21.15.42:49550) 2024-09-17T01:35:40.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.726+0000 7f8cb8a00640 1 -- 172.21.15.42:0/1844544677 learned_addr learned my addr 172.21.15.42:0/1844544677 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:40.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.726+0000 7f8cb9400640 1 -- 172.21.15.42:0/1844544677 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563771b06500 msgr2=0x563771f0b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:40.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.726+0000 7f8cb9400640 1 --2- 172.21.15.42:0/1844544677 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563771b06500 0x563771f0b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.726+0000 7f8cb9400640 1 -- 172.21.15.42:0/1844544677 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563771afe320 msgr2=0x563771ee4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:40.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.726+0000 7f8cb9400640 1 --2- 172.21.15.42:0/1844544677 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563771afe320 0x563771ee4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.726+0000 7f8cb9400640 1 -- 172.21.15.42:0/1844544677 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563771b927c0 con 0x563771b271e0 2024-09-17T01:35:40.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.727+0000 7f8cb9400640 1 --2- 172.21.15.42:0/1844544677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771b271e0 0x563771f14590 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8cac0012e0 tx=0x7f8cac0129f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08a2199b7230bbd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:40.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.727+0000 7f8c99600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:40.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.727+0000 7f8c99600640 1 -- 172.21.15.42:0/1844544677 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac019020 con 0x563771b271e0 2024-09-17T01:35:40.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.727+0000 7f8cc2468740 1 -- 172.21.15.42:0/1844544677 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ca005f5a0 con 0x563771b271e0 2024-09-17T01:35:40.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.727+0000 7f8c99600640 1 -- 172.21.15.42:0/1844544677 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f8cac003c40 con 0x563771b271e0 2024-09-17T01:35:40.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.727+0000 7f8c99600640 1 -- 172.21.15.42:0/1844544677 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8cac023050 con 0x563771b271e0 2024-09-17T01:35:40.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.727+0000 7f8cc2468740 10 client.5769 fetch_fsmap learned FSMap version 29 2024-09-17T01:35:40.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.727+0000 7f8cc2468740 1 -- 172.21.15.42:0/1844544677 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x563771c09620 con 0x563771b271e0 2024-09-17T01:35:40.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.727+0000 7f8c99600640 1 -- 172.21.15.42:0/1844544677 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ca005f5a0 con 0x563771b271e0 2024-09-17T01:35:40.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.728+0000 7f8c99600640 1 -- 172.21.15.42:0/1844544677 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f8cac026020 con 0x563771b271e0 2024-09-17T01:35:40.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.728+0000 7f8cc2468740 10 client.5769 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T01:35:40.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.728+0000 7f8cc2468740 10 client.5769 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:40.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.728+0000 7f8cc2468740 20 client.5769 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:40.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.728+0000 7f8cc2468740 1 --2- 172.21.15.42:0/1844544677 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x563771ae5fc0 0x563771f299c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.728+0000 7f8cc2468740 4 client.5769 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:40.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.728+0000 7f8cc2468740 1 -- 172.21.15.42:0/1844544677 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563771e435f0 con 0x563771ae5fc0 2024-09-17T01:35:40.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.728+0000 7f8cb8a00640 1 --2- 172.21.15.42:0/1844544677 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x563771ae5fc0 0x563771f299c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.729+0000 7f8c99600640 10 client.5769 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:40.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.729+0000 7f8cb8a00640 1 --2- 172.21.15.42:0/1844544677 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x563771ae5fc0 0x563771f299c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10257994580c74a4 server_cookie=cadd14b8c585c768 in_seq=0 out_seq=0 2024-09-17T01:35:40.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.729+0000 7f8c99600640 1 -- 172.21.15.42:0/1844544677 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563771e435f0 con 0x563771ae5fc0 2024-09-17T01:35:40.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.729+0000 7f8c99600640 10 client.5769 handle_command_reply: tid=0 2024-09-17T01:35:40.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.729+0000 7f8cc2468740 1 client.5769 shutdown 2024-09-17T01:35:40.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.730+0000 7f8cc2468740 1 -- 172.21.15.42:0/1844544677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771b271e0 msgr2=0x563771f14590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:40.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.730+0000 7f8cc2468740 1 --2- 172.21.15.42:0/1844544677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771b271e0 0x563771f14590 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8cac0012e0 tx=0x7f8cac0129f0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.730+0000 7f8cc2468740 1 -- 172.21.15.42:0/1844544677 shutdown_connections 2024-09-17T01:35:40.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.730+0000 7f8cc2468740 1 --2- 172.21.15.42:0/1844544677 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x563771ae5fc0 0x563771f299c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.730+0000 7f8cc2468740 1 --2- 172.21.15.42:0/1844544677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771b271e0 0x563771f14590 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.730+0000 7f8cc2468740 1 --2- 172.21.15.42:0/1844544677 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563771b06500 0x563771f0b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.730+0000 7f8cc2468740 1 --2- 172.21.15.42:0/1844544677 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563771afe320 0x563771ee4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.730+0000 7f8c99600640 0 client.5769 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:40.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.730+0000 7f8cc2468740 1 -- 172.21.15.42:0/1844544677 >> 172.21.15.42:0/1844544677 conn(0x563771b1b330 msgr2=0x563771ef4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:40.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.730+0000 7f8cc2468740 1 -- 172.21.15.42:0/1844544677 shutdown_connections 2024-09-17T01:35:40.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.730+0000 7f8cc2468740 1 -- 172.21.15.42:0/1844544677 wait complete. 2024-09-17T01:35:40.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.730+0000 7f8cc2468740 20 client.5769 trim_cache size 0 max 16384 2024-09-17T01:35:40.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.746+0000 7f8cc2468740 1 Processor -- start 2024-09-17T01:35:40.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.746+0000 7f8cc2468740 1 -- start start 2024-09-17T01:35:40.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.747+0000 7f8cc2468740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563771afe320 0x563771f12830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.747+0000 7f8cc2468740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771b06500 0x563771f14270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.747+0000 7f8cc2468740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563771b271e0 0x563771ee1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.747+0000 7f8cc2468740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb41fe030 con 0x563771b06500 2024-09-17T01:35:40.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.747+0000 7f8cc2468740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb41f3910 con 0x563771b271e0 2024-09-17T01:35:40.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.747+0000 7f8cc2468740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8cb406f6a0 con 0x563771afe320 2024-09-17T01:35:40.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.747+0000 7f8cb3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771b06500 0x563771f14270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.747+0000 7f8cb3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771b06500 0x563771f14270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37628/0 (socket says 172.21.15.42:37628) 2024-09-17T01:35:40.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.747+0000 7f8cb3e00640 1 -- 172.21.15.42:0/3508212315 learned_addr learned my addr 172.21.15.42:0/3508212315 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:40.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.748+0000 7f8cb8a00640 1 --2- 172.21.15.42:0/3508212315 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563771afe320 0x563771f12830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.748+0000 7f8cb9400640 1 --2- 172.21.15.42:0/3508212315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563771b271e0 0x563771ee1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.748+0000 7f8cb3e00640 1 -- 172.21.15.42:0/3508212315 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563771afe320 msgr2=0x563771f12830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:40.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.748+0000 7f8cb3e00640 1 --2- 172.21.15.42:0/3508212315 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563771afe320 0x563771f12830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.748+0000 7f8cb3e00640 1 -- 172.21.15.42:0/3508212315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563771b271e0 msgr2=0x563771ee1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:40.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.748+0000 7f8cb3e00640 1 --2- 172.21.15.42:0/3508212315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563771b271e0 0x563771ee1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.748+0000 7f8cb3e00640 1 -- 172.21.15.42:0/3508212315 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563771ecea40 con 0x563771b06500 2024-09-17T01:35:40.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.748+0000 7f8cb9400640 1 --2- 172.21.15.42:0/3508212315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563771b271e0 0x563771ee1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:40.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.748+0000 7f8cb3e00640 1 --2- 172.21.15.42:0/3508212315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771b06500 0x563771f14270 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0009250 tx=0x7f8ca00998b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb84ec13d974bbd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:40.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.748+0000 7f8c9be00640 1 -- 172.21.15.42:0/3508212315 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0067d60 con 0x563771b06500 2024-09-17T01:35:40.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.748+0000 7f8c9be00640 1 -- 172.21.15.42:0/3508212315 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ca005f5a0 con 0x563771b06500 2024-09-17T01:35:40.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.748+0000 7f8c9be00640 1 -- 172.21.15.42:0/3508212315 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca006a290 con 0x563771b06500 2024-09-17T01:35:40.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.749+0000 7f8cc2468740 1 -- 172.21.15.42:0/3508212315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771b06500 msgr2=0x563771f14270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:40.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.749+0000 7f8cc2468740 1 --2- 172.21.15.42:0/3508212315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771b06500 0x563771f14270 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0009250 tx=0x7f8ca00998b0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.749+0000 7f8cc2468740 1 -- 172.21.15.42:0/3508212315 shutdown_connections 2024-09-17T01:35:40.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.749+0000 7f8cc2468740 1 --2- 172.21.15.42:0/3508212315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563771b271e0 0x563771ee1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.749+0000 7f8cc2468740 1 --2- 172.21.15.42:0/3508212315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771b06500 0x563771f14270 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.749+0000 7f8cc2468740 1 --2- 172.21.15.42:0/3508212315 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563771afe320 0x563771f12830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.749+0000 7f8cc2468740 1 -- 172.21.15.42:0/3508212315 >> 172.21.15.42:0/3508212315 conn(0x563771b1b330 msgr2=0x563771f0a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:40.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.749+0000 7f8cc2468740 1 -- 172.21.15.42:0/3508212315 shutdown_connections 2024-09-17T01:35:40.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.749+0000 7f8cc2468740 1 -- 172.21.15.42:0/3508212315 wait complete. 2024-09-17T01:35:40.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.750+0000 7f8cc2468740 1 -- start start 2024-09-17T01:35:40.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.750+0000 7f8cc2468740 1 Processor -- start 2024-09-17T01:35:40.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.752+0000 7f8cc2468740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563771afe320 0x563771f9b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.752+0000 7f8cc2468740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563771b06500 0x563771ecd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.752+0000 7f8cc2468740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771b271e0 0x563771f101a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.752+0000 7f8cc2468740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb406fcf0 con 0x563771b271e0 2024-09-17T01:35:40.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.752+0000 7f8cc2468740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563771ecece0 con 0x563771afe320 2024-09-17T01:35:40.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.752+0000 7f8cc2468740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x563771f9a9b0 con 0x563771b06500 2024-09-17T01:35:40.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.752+0000 7f8cc2468740 10 client.0 _ll_register_callbacks cb 0x7f8cac002140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:40.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.752+0000 7f8cb9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771b271e0 0x563771f101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.752+0000 7f8cb9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771b271e0 0x563771f101a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37634/0 (socket says 172.21.15.42:37634) 2024-09-17T01:35:40.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.752+0000 7f8cb9400640 1 -- 172.21.15.42:0/724437371 learned_addr learned my addr 172.21.15.42:0/724437371 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:40.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.752+0000 7f8cb3e00640 1 --2- 172.21.15.42:0/724437371 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563771b06500 0x563771ecd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.752+0000 7f8cb8a00640 1 --2- 172.21.15.42:0/724437371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563771afe320 0x563771f9b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.753+0000 7f8cb9400640 1 -- 172.21.15.42:0/724437371 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563771b06500 msgr2=0x563771ecd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:40.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.753+0000 7f8cb9400640 1 --2- 172.21.15.42:0/724437371 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563771b06500 0x563771ecd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.753+0000 7f8cb9400640 1 -- 172.21.15.42:0/724437371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563771afe320 msgr2=0x563771f9b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:40.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.753+0000 7f8cb9400640 1 --2- 172.21.15.42:0/724437371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563771afe320 0x563771f9b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.753+0000 7f8cb9400640 1 -- 172.21.15.42:0/724437371 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563771ee3bd0 con 0x563771b271e0 2024-09-17T01:35:40.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.753+0000 7f8cb9400640 1 --2- 172.21.15.42:0/724437371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771b271e0 0x563771f101a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8cac002230 tx=0x7f8cac016b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef0c32c4579ea68 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:40.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.753+0000 7f8c99600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:40.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.753+0000 7f8c99600640 1 -- 172.21.15.42:0/724437371 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac02b070 con 0x563771b271e0 2024-09-17T01:35:40.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.753+0000 7f8cc2468740 1 -- 172.21.15.42:0/724437371 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ca005f5a0 con 0x563771b271e0 2024-09-17T01:35:40.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.753+0000 7f8c99600640 1 -- 172.21.15.42:0/724437371 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f8cac007b80 con 0x563771b271e0 2024-09-17T01:35:40.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.753+0000 7f8c99600640 1 -- 172.21.15.42:0/724437371 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8cac036050 con 0x563771b271e0 2024-09-17T01:35:40.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.754+0000 7f8cc2468740 10 client.5775 fetch_fsmap learned FSMap version 29 2024-09-17T01:35:40.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.754+0000 7f8cc2468740 1 -- 172.21.15.42:0/724437371 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x563771ee41f0 con 0x563771b271e0 2024-09-17T01:35:40.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.754+0000 7f8c99600640 1 -- 172.21.15.42:0/724437371 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ca005f5a0 con 0x563771b271e0 2024-09-17T01:35:40.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.754+0000 7f8c99600640 1 -- 172.21.15.42:0/724437371 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f8cac039020 con 0x563771b271e0 2024-09-17T01:35:40.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.754+0000 7f8cc2468740 10 client.5775 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T01:35:40.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.754+0000 7f8cc2468740 10 client.5775 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:40.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.754+0000 7f8cc2468740 20 client.5775 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:40.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.754+0000 7f8cc2468740 1 --2- 172.21.15.42:0/724437371 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x563771f106e0 0x563771f7c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:40.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.754+0000 7f8cc2468740 4 client.5775 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-17T01:35:40.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.754+0000 7f8cc2468740 1 -- 172.21.15.42:0/724437371 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x563771e3f0a0 con 0x563771f106e0 2024-09-17T01:35:40.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.754+0000 7f8cb8a00640 1 --2- 172.21.15.42:0/724437371 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x563771f106e0 0x563771f7c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:40.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.755+0000 7f8cb8a00640 1 --2- 172.21.15.42:0/724437371 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x563771f106e0 0x563771f7c5a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afd6ee55d019a86b server_cookie=bc15502fc6348bfe in_seq=0 out_seq=0 2024-09-17T01:35:40.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.755+0000 7f8c99600640 10 client.5775 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:40.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.758+0000 7f8c99600640 1 -- 172.21.15.42:0/724437371 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563771e3f0a0 con 0x563771f106e0 2024-09-17T01:35:40.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.758+0000 7f8c99600640 10 client.5775 handle_command_reply: tid=0 2024-09-17T01:35:40.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.758+0000 7f8cc2468740 1 client.5775 shutdown 2024-09-17T01:35:40.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.758+0000 7f8cc2468740 1 -- 172.21.15.42:0/724437371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771b271e0 msgr2=0x563771f101a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:40.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.758+0000 7f8cc2468740 1 --2- 172.21.15.42:0/724437371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771b271e0 0x563771f101a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8cac002230 tx=0x7f8cac016b70 comp rx=0 tx=0).stop 2024-09-17T01:35:40.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.758+0000 7f8cc2468740 1 -- 172.21.15.42:0/724437371 shutdown_connections 2024-09-17T01:35:40.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.758+0000 7f8cc2468740 1 --2- 172.21.15.42:0/724437371 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x563771f106e0 0x563771f7c5a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.758+0000 7f8cc2468740 1 --2- 172.21.15.42:0/724437371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563771b271e0 0x563771f101a0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.758+0000 7f8cc2468740 1 --2- 172.21.15.42:0/724437371 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563771b06500 0x563771ecd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.758+0000 7f8c99600640 0 client.5775 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:40.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.758+0000 7f8cc2468740 1 --2- 172.21.15.42:0/724437371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563771afe320 0x563771f9b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.758+0000 7f8cc2468740 1 -- 172.21.15.42:0/724437371 >> 172.21.15.42:0/724437371 conn(0x563771b1b330 msgr2=0x563771f0ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:40.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.758+0000 7f8cc2468740 1 -- 172.21.15.42:0/724437371 shutdown_connections 2024-09-17T01:35:40.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.758+0000 7f8cc2468740 1 -- 172.21.15.42:0/724437371 wait complete. 2024-09-17T01:35:40.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.758+0000 7f8cc2468740 20 client.5775 trim_cache size 0 max 16384 2024-09-17T01:35:40.758 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:40.758 INFO:teuthology.orchestra.run.smithi042.stdout: "message": "", 2024-09-17T01:35:40.759 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0 2024-09-17T01:35:40.759 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:40.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.759+0000 7f8cbb400640 1 -- 172.21.15.42:0/4142775900 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8c94078bc0 msgr2=0x7f8c9407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:40.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.759+0000 7f8cbb400640 1 --2- 172.21.15.42:0/4142775900 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8c94078bc0 0x7f8c9407b0d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8033000 tx=0x7f8ca8004730 comp rx=0 tx=0).stop 2024-09-17T01:35:40.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.759+0000 7f8cbb400640 1 -- 172.21.15.42:0/4142775900 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cb40b3550 msgr2=0x7f8cb4131b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:40.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.759+0000 7f8cbb400640 1 --2- 172.21.15.42:0/4142775900 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cb40b3550 0x7f8cb4131b10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000e770 tx=0x7f8ca000ec30 comp rx=0 tx=0).stop 2024-09-17T01:35:40.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.759+0000 7f8cbb400640 1 -- 172.21.15.42:0/4142775900 shutdown_connections 2024-09-17T01:35:40.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.759+0000 7f8cbb400640 1 --2- 172.21.15.42:0/4142775900 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8c94078bc0 0x7f8c9407b0d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.759+0000 7f8cbb400640 1 --2- 172.21.15.42:0/4142775900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cb4142f40 0x7f8cb4132050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.759+0000 7f8cbb400640 1 --2- 172.21.15.42:0/4142775900 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cb40b3550 0x7f8cb4131b10 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.759+0000 7f8cbb400640 1 --2- 172.21.15.42:0/4142775900 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cb4072e90 0x7f8cb4159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:40.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.759+0000 7f8cbb400640 1 -- 172.21.15.42:0/4142775900 >> 172.21.15.42:0/4142775900 conn(0x7f8cb40b2930 msgr2=0x7f8cb415f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:40.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.759+0000 7f8cbb400640 1 -- 172.21.15.42:0/4142775900 shutdown_connections 2024-09-17T01:35:40.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40.759+0000 7f8cbb400640 1 -- 172.21.15.42:0/4142775900 wait complete. 2024-09-17T01:35:40.781 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-17T01:35:40.781 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-17T01:35:40.781 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-09-17T01:35:40.781 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-09-17T01:35:40.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:35:40.781 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-09-17T01:35:40.818 DEBUG:teuthology.orchestra.run.smithi042:> stdin-killer -- python3 -c ' 2024-09-17T01:35:40.819 DEBUG:teuthology.orchestra.run.smithi042:> import os 2024-09-17T01:35:40.819 DEBUG:teuthology.orchestra.run.smithi042:> import stat 2024-09-17T01:35:40.819 DEBUG:teuthology.orchestra.run.smithi042:> import json 2024-09-17T01:35:40.819 DEBUG:teuthology.orchestra.run.smithi042:> import sys 2024-09-17T01:35:40.819 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:35:40.819 DEBUG:teuthology.orchestra.run.smithi042:> try: 2024-09-17T01:35:40.819 DEBUG:teuthology.orchestra.run.smithi042:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-09-17T01:35:40.819 DEBUG:teuthology.orchestra.run.smithi042:> except OSError as e: 2024-09-17T01:35:40.819 DEBUG:teuthology.orchestra.run.smithi042:> sys.exit(e.errno) 2024-09-17T01:35:40.819 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:35:40.819 DEBUG:teuthology.orchestra.run.smithi042:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-17T01:35:40.819 DEBUG:teuthology.orchestra.run.smithi042:> print(json.dumps( 2024-09-17T01:35:40.819 DEBUG:teuthology.orchestra.run.smithi042:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-17T01:35:40.820 DEBUG:teuthology.orchestra.run.smithi042:> indent=2)) 2024-09-17T01:35:40.820 DEBUG:teuthology.orchestra.run.smithi042:> ' 2024-09-17T01:35:40.960 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:40.960 INFO:teuthology.orchestra.run.smithi042.stdout: "st_mode": 16877, 2024-09-17T01:35:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: "st_ino": 1099511627777, 2024-09-17T01:35:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: "st_dev": 43, 2024-09-17T01:35:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: "st_nlink": 16, 2024-09-17T01:35:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: "st_uid": 1000, 2024-09-17T01:35:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: "st_gid": 1333, 2024-09-17T01:35:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: "st_size": 18, 2024-09-17T01:35:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: "st_atime": 1726536925.3759499, 2024-09-17T01:35:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: "st_mtime": 1726536932.5288918, 2024-09-17T01:35:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: "st_ctime": 1726536932.5288918 2024-09-17T01:35:40.961 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:40.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:35:40.972 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 1 2024-09-17T01:35:40.972 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-09-17T01:35:40.972 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/i/dont/exist 2024-09-17T01:35:41.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.242+0000 7f126ea00640 1 -- 172.21.15.42:0/1263509940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1268072e90 msgr2=0x7f12680cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.242+0000 7f126ea00640 1 --2- 172.21.15.42:0/1263509940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1268072e90 0x7f12680cec40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f12680704d0 tx=0x7f126002aa30 comp rx=0 tx=0).stop 2024-09-17T01:35:41.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.243+0000 7f126ea00640 1 -- 172.21.15.42:0/1263509940 shutdown_connections 2024-09-17T01:35:41.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.243+0000 7f126ea00640 1 --2- 172.21.15.42:0/1263509940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1268072e90 0x7f12680cec40 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.243+0000 7f126ea00640 1 --2- 172.21.15.42:0/1263509940 >> v2:172.21.15.43:3300/0 conn(0x7f1268142f40 0x7f1268072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.243+0000 7f126ea00640 1 -- 172.21.15.42:0/1263509940 >> 172.21.15.42:0/1263509940 conn(0x7f12680b2930 msgr2=0x7f126806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:41.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.243+0000 7f126ea00640 1 -- 172.21.15.42:0/1263509940 shutdown_connections 2024-09-17T01:35:41.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.243+0000 7f126ea00640 1 -- 172.21.15.42:0/1263509940 wait complete. 2024-09-17T01:35:41.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.245+0000 7f126ea00640 1 Processor -- start 2024-09-17T01:35:41.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.245+0000 7f126ea00640 1 -- start start 2024-09-17T01:35:41.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.246+0000 7f126ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1268072e90 0x7f126806fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.246+0000 7f126ea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12680b3550 0x7f126813cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.247+0000 7f126ea00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1268142f40 0x7f12680ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.247+0000 7f126ea00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f126806d5b0 con 0x7f1268072e90 2024-09-17T01:35:41.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.247+0000 7f126ea00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f126806d430 con 0x7f12680b3550 2024-09-17T01:35:41.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.247+0000 7f126ea00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f126806d730 con 0x7f1268142f40 2024-09-17T01:35:41.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.247+0000 7f1267e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1268072e90 0x7f126806fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.247+0000 7f1267e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1268072e90 0x7f126806fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37660/0 (socket says 172.21.15.42:37660) 2024-09-17T01:35:41.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.247+0000 7f1267e00640 1 -- 172.21.15.42:0/1571641477 learned_addr learned my addr 172.21.15.42:0/1571641477 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:41.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.247+0000 7f1267400640 1 --2- 172.21.15.42:0/1571641477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12680b3550 0x7f126813cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.247+0000 7f126ca00640 1 --2- 172.21.15.42:0/1571641477 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1268142f40 0x7f12680ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.247+0000 7f1267e00640 1 -- 172.21.15.42:0/1571641477 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1268142f40 msgr2=0x7f12680ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.247+0000 7f1267e00640 1 --2- 172.21.15.42:0/1571641477 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1268142f40 0x7f12680ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.247+0000 7f1267e00640 1 -- 172.21.15.42:0/1571641477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12680b3550 msgr2=0x7f126813cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.247+0000 7f1267e00640 1 --2- 172.21.15.42:0/1571641477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12680b3550 0x7f126813cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.247+0000 7f1267e00640 1 -- 172.21.15.42:0/1571641477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12681f8f30 con 0x7f1268072e90 2024-09-17T01:35:41.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.248+0000 7f1267e00640 1 --2- 172.21.15.42:0/1571641477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1268072e90 0x7f126806fb70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f125800c3c0 tx=0x7f125800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:41.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.248+0000 7f125fe00640 1 -- 172.21.15.42:0/1571641477 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1258017070 con 0x7f1268072e90 2024-09-17T01:35:41.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.248+0000 7f125fe00640 1 -- 172.21.15.42:0/1571641477 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12580035f0 con 0x7f1268072e90 2024-09-17T01:35:41.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.248+0000 7f125fe00640 1 -- 172.21.15.42:0/1571641477 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1258003a80 con 0x7f1268072e90 2024-09-17T01:35:41.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.248+0000 7f126ea00640 1 -- 172.21.15.42:0/1571641477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12681f9210 con 0x7f1268072e90 2024-09-17T01:35:41.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.248+0000 7f126ea00640 1 -- 172.21.15.42:0/1571641477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12681f97d0 con 0x7f1268072e90 2024-09-17T01:35:41.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.251+0000 7f125fe00640 1 -- 172.21.15.42:0/1571641477 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f125801a070 con 0x7f1268072e90 2024-09-17T01:35:41.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.252+0000 7f125fe00640 1 --2- 172.21.15.42:0/1571641477 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1248078b90 0x7f124807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.252+0000 7f125fe00640 1 -- 172.21.15.42:0/1571641477 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f1258099f50 con 0x7f1268072e90 2024-09-17T01:35:41.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.252+0000 7f1267400640 1 --2- 172.21.15.42:0/1571641477 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1248078b90 0x7f124807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.252+0000 7f1275a3d740 1 Processor -- start 2024-09-17T01:35:41.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.252+0000 7f1275a3d740 1 -- start start 2024-09-17T01:35:41.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.253+0000 7f1267400640 1 --2- 172.21.15.42:0/1571641477 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1248078b90 0x7f124807b0a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f12681f8d80 tx=0x7f125400b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:41.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.254+0000 7f1275a3d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561eb104d530 0x561eb141ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.254+0000 7f1275a3d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561eb1024670 0x561eb141f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.254+0000 7f1275a3d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb102c850 0x561eb143c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.254+0000 7f1275a3d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561eb13679d0 con 0x561eb102c850 2024-09-17T01:35:41.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.254+0000 7f1275a3d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561eb1356e00 con 0x561eb104d530 2024-09-17T01:35:41.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.254+0000 7f1275a3d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x561eb135ac10 con 0x561eb1024670 2024-09-17T01:35:41.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.254+0000 7f126ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb102c850 0x561eb143c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.254+0000 7f126ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb102c850 0x561eb143c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37668/0 (socket says 172.21.15.42:37668) 2024-09-17T01:35:41.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.254+0000 7f126ca00640 1 -- 172.21.15.42:0/1165050597 learned_addr learned my addr 172.21.15.42:0/1165050597 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:41.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.254+0000 7f1267400640 1 --2- 172.21.15.42:0/1165050597 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561eb1024670 0x561eb141f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.254+0000 7f1267e00640 1 --2- 172.21.15.42:0/1165050597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561eb104d530 0x561eb141ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.255+0000 7f126ca00640 1 -- 172.21.15.42:0/1165050597 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561eb1024670 msgr2=0x561eb141f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:41.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.255+0000 7f126ca00640 1 --2- 172.21.15.42:0/1165050597 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561eb1024670 0x561eb141f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.255+0000 7f126ca00640 1 -- 172.21.15.42:0/1165050597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561eb104d530 msgr2=0x561eb141ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:41.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.255+0000 7f126ca00640 1 --2- 172.21.15.42:0/1165050597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561eb104d530 0x561eb141ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.255+0000 7f126ca00640 1 -- 172.21.15.42:0/1165050597 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561eb1353970 con 0x561eb102c850 2024-09-17T01:35:41.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.255+0000 7f1267400640 1 --2- 172.21.15.42:0/1165050597 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561eb1024670 0x561eb141f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:41.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.255+0000 7f126ca00640 1 --2- 172.21.15.42:0/1165050597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb102c850 0x561eb143c390 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f126002b020 tx=0x7f1260004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9590c7fdd2332e62 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:41.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.255+0000 7f1253e00640 1 -- 172.21.15.42:0/1165050597 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260047070 con 0x561eb102c850 2024-09-17T01:35:41.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.255+0000 7f1253e00640 1 -- 172.21.15.42:0/1165050597 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f126002fdc0 con 0x561eb102c850 2024-09-17T01:35:41.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.255+0000 7f1253e00640 1 -- 172.21.15.42:0/1165050597 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260033070 con 0x561eb102c850 2024-09-17T01:35:41.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.256+0000 7f1275a3d740 1 -- 172.21.15.42:0/1165050597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb102c850 msgr2=0x561eb143c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.256+0000 7f1275a3d740 1 --2- 172.21.15.42:0/1165050597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb102c850 0x561eb143c390 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f126002b020 tx=0x7f1260004ab0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.256+0000 7f1275a3d740 1 -- 172.21.15.42:0/1165050597 shutdown_connections 2024-09-17T01:35:41.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.256+0000 7f1275a3d740 1 --2- 172.21.15.42:0/1165050597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb102c850 0x561eb143c390 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.256+0000 7f1275a3d740 1 --2- 172.21.15.42:0/1165050597 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561eb1024670 0x561eb141f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.256+0000 7f1275a3d740 1 --2- 172.21.15.42:0/1165050597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561eb104d530 0x561eb141ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.256+0000 7f1275a3d740 1 -- 172.21.15.42:0/1165050597 >> 172.21.15.42:0/1165050597 conn(0x561eb1041680 msgr2=0x561eb13f5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:41.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.256+0000 7f1275a3d740 1 -- 172.21.15.42:0/1165050597 shutdown_connections 2024-09-17T01:35:41.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.256+0000 7f1275a3d740 1 -- 172.21.15.42:0/1165050597 wait complete. 2024-09-17T01:35:41.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.257+0000 7f1275a3d740 1 -- start start 2024-09-17T01:35:41.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.257+0000 7f1275a3d740 1 Processor -- start 2024-09-17T01:35:41.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.259+0000 7f1275a3d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561eb1024670 0x561eb140d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.259+0000 7f1275a3d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561eb102c850 0x561eb1434b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.259+0000 7f1275a3d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb104d530 0x561eb14350c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.259+0000 7f1275a3d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561eb10c78e0 con 0x561eb104d530 2024-09-17T01:35:41.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.259+0000 7f1275a3d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561eb12fd600 con 0x561eb1024670 2024-09-17T01:35:41.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.259+0000 7f1275a3d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x561eb141f9d0 con 0x561eb102c850 2024-09-17T01:35:41.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.259+0000 7f1275a3d740 10 client.0 _ll_register_callbacks cb 0x561eb12fbf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:41.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.259+0000 7f126ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb104d530 0x561eb14350c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.259+0000 7f126ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb104d530 0x561eb14350c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37674/0 (socket says 172.21.15.42:37674) 2024-09-17T01:35:41.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.259+0000 7f126ca00640 1 -- 172.21.15.42:0/399579885 learned_addr learned my addr 172.21.15.42:0/399579885 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:41.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.260+0000 7f1267400640 1 --2- 172.21.15.42:0/399579885 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561eb102c850 0x561eb1434b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.259+0000 7f1267e00640 1 --2- 172.21.15.42:0/399579885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561eb1024670 0x561eb140d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.260+0000 7f126ca00640 1 -- 172.21.15.42:0/399579885 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561eb102c850 msgr2=0x561eb1434b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:41.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.260+0000 7f126ca00640 1 --2- 172.21.15.42:0/399579885 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561eb102c850 0x561eb1434b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.260+0000 7f126ca00640 1 -- 172.21.15.42:0/399579885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561eb1024670 msgr2=0x561eb140d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:41.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.260+0000 7f126ca00640 1 --2- 172.21.15.42:0/399579885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561eb1024670 0x561eb140d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.260+0000 7f126ca00640 1 -- 172.21.15.42:0/399579885 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561eb1049590 con 0x561eb104d530 2024-09-17T01:35:41.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.260+0000 7f1267400640 1 --2- 172.21.15.42:0/399579885 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561eb102c850 0x561eb1434b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:41.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.260+0000 7f1267e00640 1 --2- 172.21.15.42:0/399579885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561eb1024670 0x561eb140d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:41.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.260+0000 7f126ca00640 1 --2- 172.21.15.42:0/399579885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb104d530 0x561eb14350c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1260031000 tx=0x7f1260003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330cde11d75c1ede server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:41.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.260+0000 7f1250c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:41.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.260+0000 7f1250c00640 1 -- 172.21.15.42:0/399579885 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260051060 con 0x561eb104d530 2024-09-17T01:35:41.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.260+0000 7f1250c00640 1 -- 172.21.15.42:0/399579885 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f1260038660 con 0x561eb104d530 2024-09-17T01:35:41.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.260+0000 7f1275a3d740 1 -- 172.21.15.42:0/399579885 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f126002fdc0 con 0x561eb104d530 2024-09-17T01:35:41.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.260+0000 7f1250c00640 1 -- 172.21.15.42:0/399579885 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1260047070 con 0x561eb104d530 2024-09-17T01:35:41.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.260+0000 7f1275a3d740 10 client.5790 fetch_fsmap learned FSMap version 29 2024-09-17T01:35:41.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.260+0000 7f1275a3d740 1 -- 172.21.15.42:0/399579885 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x561eb10b8b10 con 0x561eb104d530 2024-09-17T01:35:41.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.261+0000 7f1250c00640 1 -- 172.21.15.42:0/399579885 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f126002fdc0 con 0x561eb104d530 2024-09-17T01:35:41.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.261+0000 7f1250c00640 1 -- 172.21.15.42:0/399579885 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f1260038860 con 0x561eb104d530 2024-09-17T01:35:41.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.261+0000 7f1275a3d740 10 client.5790 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T01:35:41.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.261+0000 7f1275a3d740 10 client.5790 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:41.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.261+0000 7f1275a3d740 20 client.5790 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:41.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.261+0000 7f1275a3d740 1 --2- 172.21.15.42:0/399579885 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561eb100c100 0x561eb143c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.261+0000 7f1275a3d740 4 client.5790 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:41.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.261+0000 7f1275a3d740 1 -- 172.21.15.42:0/399579885 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561eb1369920 con 0x561eb100c100 2024-09-17T01:35:41.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.261+0000 7f1267e00640 1 --2- 172.21.15.42:0/399579885 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561eb100c100 0x561eb143c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.262+0000 7f1250c00640 10 client.5790 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:41.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.262+0000 7f1267e00640 1 --2- 172.21.15.42:0/399579885 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561eb100c100 0x561eb143c180 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c537ba8e869988f server_cookie=233dccaf4f9b5f08 in_seq=0 out_seq=0 2024-09-17T01:35:41.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.262+0000 7f1250c00640 1 -- 172.21.15.42:0/399579885 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561eb1369920 con 0x561eb100c100 2024-09-17T01:35:41.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.262+0000 7f1250c00640 10 client.5790 handle_command_reply: tid=0 2024-09-17T01:35:41.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.262+0000 7f1275a3d740 1 client.5790 shutdown 2024-09-17T01:35:41.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.263+0000 7f1275a3d740 1 -- 172.21.15.42:0/399579885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb104d530 msgr2=0x561eb14350c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.263+0000 7f1275a3d740 1 --2- 172.21.15.42:0/399579885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb104d530 0x561eb14350c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1260031000 tx=0x7f1260003c20 comp rx=0 tx=0).stop 2024-09-17T01:35:41.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.263+0000 7f1275a3d740 1 -- 172.21.15.42:0/399579885 shutdown_connections 2024-09-17T01:35:41.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.263+0000 7f1275a3d740 1 --2- 172.21.15.42:0/399579885 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561eb100c100 0x561eb143c180 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.263+0000 7f1275a3d740 1 --2- 172.21.15.42:0/399579885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb104d530 0x561eb14350c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.263+0000 7f1275a3d740 1 --2- 172.21.15.42:0/399579885 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561eb102c850 0x561eb1434b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.263+0000 7f1275a3d740 1 --2- 172.21.15.42:0/399579885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561eb1024670 0x561eb140d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.263+0000 7f1250c00640 0 client.5790 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:41.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.263+0000 7f1275a3d740 1 -- 172.21.15.42:0/399579885 >> 172.21.15.42:0/399579885 conn(0x561eb1041680 msgr2=0x561eb13ef8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:41.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.263+0000 7f1275a3d740 1 -- 172.21.15.42:0/399579885 shutdown_connections 2024-09-17T01:35:41.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.263+0000 7f1275a3d740 1 -- 172.21.15.42:0/399579885 wait complete. 2024-09-17T01:35:41.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.263+0000 7f1275a3d740 20 client.5790 trim_cache size 0 max 16384 2024-09-17T01:35:41.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.279+0000 7f1275a3d740 1 Processor -- start 2024-09-17T01:35:41.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.279+0000 7f1275a3d740 1 -- start start 2024-09-17T01:35:41.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.280+0000 7f1275a3d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561eb1024670 0x561eb13f6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.280+0000 7f1275a3d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb102c850 0x561eb13f4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.280+0000 7f1275a3d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561eb104d530 0x561eb142ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.280+0000 7f1275a3d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f12682020c0 con 0x561eb102c850 2024-09-17T01:35:41.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.280+0000 7f1275a3d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f12682011b0 con 0x561eb104d530 2024-09-17T01:35:41.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.280+0000 7f1275a3d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f126813fe10 con 0x561eb1024670 2024-09-17T01:35:41.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.281+0000 7f1267400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb102c850 0x561eb13f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.281+0000 7f1267400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb102c850 0x561eb13f4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37676/0 (socket says 172.21.15.42:37676) 2024-09-17T01:35:41.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.281+0000 7f1267400640 1 -- 172.21.15.42:0/3084690147 learned_addr learned my addr 172.21.15.42:0/3084690147 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:41.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.281+0000 7f126ca00640 1 --2- 172.21.15.42:0/3084690147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561eb104d530 0x561eb142ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.281+0000 7f1267e00640 1 --2- 172.21.15.42:0/3084690147 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561eb1024670 0x561eb13f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.281+0000 7f1267400640 1 -- 172.21.15.42:0/3084690147 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561eb1024670 msgr2=0x561eb13f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:41.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.281+0000 7f1267400640 1 --2- 172.21.15.42:0/3084690147 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561eb1024670 0x561eb13f6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.281+0000 7f1267400640 1 -- 172.21.15.42:0/3084690147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561eb104d530 msgr2=0x561eb142ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:41.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.281+0000 7f1267400640 1 --2- 172.21.15.42:0/3084690147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561eb104d530 0x561eb142ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.281+0000 7f1267400640 1 -- 172.21.15.42:0/3084690147 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561eb112f970 con 0x561eb102c850 2024-09-17T01:35:41.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.281+0000 7f1267400640 1 --2- 172.21.15.42:0/3084690147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb102c850 0x561eb13f4140 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f12680cfa70 tx=0x7f1254013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c819819ae6559b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:41.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.282+0000 7f1253400640 1 -- 172.21.15.42:0/3084690147 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1254004250 con 0x561eb102c850 2024-09-17T01:35:41.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.282+0000 7f1253400640 1 -- 172.21.15.42:0/3084690147 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1254024030 con 0x561eb102c850 2024-09-17T01:35:41.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.282+0000 7f1253400640 1 -- 172.21.15.42:0/3084690147 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12540044e0 con 0x561eb102c850 2024-09-17T01:35:41.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.282+0000 7f1275a3d740 1 -- 172.21.15.42:0/3084690147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb102c850 msgr2=0x561eb13f4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.282+0000 7f1275a3d740 1 --2- 172.21.15.42:0/3084690147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb102c850 0x561eb13f4140 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f12680cfa70 tx=0x7f1254013000 comp rx=0 tx=0).stop 2024-09-17T01:35:41.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.282+0000 7f1275a3d740 1 -- 172.21.15.42:0/3084690147 shutdown_connections 2024-09-17T01:35:41.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.282+0000 7f1275a3d740 1 --2- 172.21.15.42:0/3084690147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561eb104d530 0x561eb142ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.282+0000 7f1275a3d740 1 --2- 172.21.15.42:0/3084690147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb102c850 0x561eb13f4140 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.282+0000 7f1275a3d740 1 --2- 172.21.15.42:0/3084690147 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561eb1024670 0x561eb13f6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.282+0000 7f1275a3d740 1 -- 172.21.15.42:0/3084690147 >> 172.21.15.42:0/3084690147 conn(0x561eb1041680 msgr2=0x561eb14324a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:41.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.282+0000 7f1275a3d740 1 -- 172.21.15.42:0/3084690147 shutdown_connections 2024-09-17T01:35:41.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.283+0000 7f1275a3d740 1 -- 172.21.15.42:0/3084690147 wait complete. 2024-09-17T01:35:41.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.283+0000 7f1275a3d740 1 -- start start 2024-09-17T01:35:41.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.284+0000 7f1275a3d740 1 Processor -- start 2024-09-17T01:35:41.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.285+0000 7f1275a3d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561eb1024670 0x561eb14bb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.285+0000 7f1275a3d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb102c850 0x561eb13f3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.285+0000 7f1275a3d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561eb104d530 0x561eb145bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.285+0000 7f1275a3d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1268140460 con 0x561eb102c850 2024-09-17T01:35:41.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.285+0000 7f1275a3d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561eb145c4f0 con 0x561eb104d530 2024-09-17T01:35:41.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.285+0000 7f1275a3d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x561eb1432eb0 con 0x561eb1024670 2024-09-17T01:35:41.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.285+0000 7f1275a3d740 10 client.0 _ll_register_callbacks cb 0x7f1260045070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:41.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.285+0000 7f1267400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb102c850 0x561eb13f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.285+0000 7f1267400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb102c850 0x561eb13f3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37686/0 (socket says 172.21.15.42:37686) 2024-09-17T01:35:41.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.285+0000 7f1267400640 1 -- 172.21.15.42:0/1264290232 learned_addr learned my addr 172.21.15.42:0/1264290232 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:41.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.286+0000 7f1267e00640 1 --2- 172.21.15.42:0/1264290232 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561eb1024670 0x561eb14bb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.286+0000 7f126ca00640 1 --2- 172.21.15.42:0/1264290232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561eb104d530 0x561eb145bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.286+0000 7f1267400640 1 -- 172.21.15.42:0/1264290232 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561eb1024670 msgr2=0x561eb14bb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:41.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.286+0000 7f1267400640 1 --2- 172.21.15.42:0/1264290232 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561eb1024670 0x561eb14bb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.286+0000 7f1267400640 1 -- 172.21.15.42:0/1264290232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561eb104d530 msgr2=0x561eb145bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:41.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.286+0000 7f1267400640 1 --2- 172.21.15.42:0/1264290232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561eb104d530 0x561eb145bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.286+0000 7f1267400640 1 -- 172.21.15.42:0/1264290232 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561eb14530f0 con 0x561eb102c850 2024-09-17T01:35:41.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.286+0000 7f126ca00640 1 --2- 172.21.15.42:0/1264290232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561eb104d530 0x561eb145bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:41.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.286+0000 7f1267400640 1 --2- 172.21.15.42:0/1264290232 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb102c850 0x561eb13f3570 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x561eb145db50 tx=0x7f1254004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7449501da132008d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:41.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.286+0000 7f1250c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:41.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.286+0000 7f1250c00640 1 -- 172.21.15.42:0/1264290232 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1254038060 con 0x561eb102c850 2024-09-17T01:35:41.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.286+0000 7f1250c00640 1 -- 172.21.15.42:0/1264290232 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f12540037f0 con 0x561eb102c850 2024-09-17T01:35:41.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.286+0000 7f1275a3d740 1 -- 172.21.15.42:0/1264290232 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1254024030 con 0x561eb102c850 2024-09-17T01:35:41.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.287+0000 7f1250c00640 1 -- 172.21.15.42:0/1264290232 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f125403e050 con 0x561eb102c850 2024-09-17T01:35:41.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.287+0000 7f1275a3d740 10 client.5796 fetch_fsmap learned FSMap version 29 2024-09-17T01:35:41.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.287+0000 7f1275a3d740 1 -- 172.21.15.42:0/1264290232 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x561eb13eff60 con 0x561eb102c850 2024-09-17T01:35:41.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.287+0000 7f1250c00640 1 -- 172.21.15.42:0/1264290232 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1254024030 con 0x561eb102c850 2024-09-17T01:35:41.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.287+0000 7f1250c00640 1 -- 172.21.15.42:0/1264290232 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f1254041020 con 0x561eb102c850 2024-09-17T01:35:41.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.287+0000 7f1275a3d740 10 client.5796 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T01:35:41.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.287+0000 7f1275a3d740 10 client.5796 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:41.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.287+0000 7f1275a3d740 20 client.5796 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:41.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.287+0000 7f1275a3d740 1 --2- 172.21.15.42:0/1264290232 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561eb140e6a0 0x561eb140eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.287+0000 7f1275a3d740 4 client.5796 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-17T01:35:41.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.287+0000 7f1275a3d740 1 -- 172.21.15.42:0/1264290232 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}) -- 0x561eb13653d0 con 0x561eb140e6a0 2024-09-17T01:35:41.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.287+0000 7f1267e00640 1 --2- 172.21.15.42:0/1264290232 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561eb140e6a0 0x561eb140eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.288+0000 7f1267e00640 1 --2- 172.21.15.42:0/1264290232 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561eb140e6a0 0x561eb140eab0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6eb3bac9f88b1630 server_cookie=5159aca2e744aa29 in_seq=0 out_seq=0 2024-09-17T01:35:41.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.288+0000 7f1250c00640 10 client.5796 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:41.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.288+0000 7f1250c00640 1 -- 172.21.15.42:0/1264290232 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: -2 ) ==== 8+0+45 (crc 0 0 0) 0x561eb13653d0 con 0x561eb140e6a0 2024-09-17T01:35:41.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.288+0000 7f1250c00640 10 client.5796 handle_command_reply: tid=0 2024-09-17T01:35:41.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.288+0000 7f1275a3d740 1 client.5796 shutdown 2024-09-17T01:35:41.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.288+0000 7f1275a3d740 1 -- 172.21.15.42:0/1264290232 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb102c850 msgr2=0x561eb13f3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.288+0000 7f1275a3d740 1 --2- 172.21.15.42:0/1264290232 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb102c850 0x561eb13f3570 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x561eb145db50 tx=0x7f1254004610 comp rx=0 tx=0).stop 2024-09-17T01:35:41.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.289+0000 7f1275a3d740 1 -- 172.21.15.42:0/1264290232 shutdown_connections 2024-09-17T01:35:41.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.289+0000 7f1275a3d740 1 --2- 172.21.15.42:0/1264290232 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561eb140e6a0 0x561eb140eab0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.289+0000 7f1275a3d740 1 --2- 172.21.15.42:0/1264290232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561eb104d530 0x561eb145bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.289+0000 7f1275a3d740 1 --2- 172.21.15.42:0/1264290232 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561eb102c850 0x561eb13f3570 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.289+0000 7f1275a3d740 1 --2- 172.21.15.42:0/1264290232 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561eb1024670 0x561eb14bb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.289+0000 7f1275a3d740 1 -- 172.21.15.42:0/1264290232 >> 172.21.15.42:0/1264290232 conn(0x561eb1041680 msgr2=0x561eb13ef850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:41.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.289+0000 7f1250c00640 0 client.5796 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:41.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.289+0000 7f1275a3d740 1 -- 172.21.15.42:0/1264290232 shutdown_connections 2024-09-17T01:35:41.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.289+0000 7f1275a3d740 1 -- 172.21.15.42:0/1264290232 wait complete. 2024-09-17T01:35:41.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.289+0000 7f1275a3d740 20 client.5796 trim_cache size 0 max 16384 2024-09-17T01:35:41.291 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:41.292 INFO:teuthology.orchestra.run.smithi042.stdout: "message": "", 2024-09-17T01:35:41.292 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": -2 2024-09-17T01:35:41.292 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:41.292 INFO:teuthology.orchestra.run.smithi042.stderr:Error ENOENT: 2024-09-17T01:35:41.303 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T01:35:41.303 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' returned '{'message': '', 'return_code': -2}' 2024-09-17T01:35:41.304 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-09-17T01:35:41.304 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-09-17T01:35:41.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.535+0000 7f90fb600640 1 -- 172.21.15.42:0/1477631940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90dc0041c0 msgr2=0x7f90dc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.535+0000 7f90fb600640 1 --2- 172.21.15.42:0/1477631940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90dc0041c0 0x7f90dc004800 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f90e0009b50 tx=0x7f90dc005830 comp rx=0 tx=0).stop 2024-09-17T01:35:41.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.535+0000 7f90f9600640 1 -- 172.21.15.42:0/1477631940 reap_dead start 2024-09-17T01:35:41.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.536+0000 7f90fb600640 1 -- 172.21.15.42:0/1477631940 shutdown_connections 2024-09-17T01:35:41.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.536+0000 7f90fb600640 1 -- 172.21.15.42:0/1477631940 >> 172.21.15.42:0/1477631940 conn(0x7f90f40b2930 msgr2=0x7f90f406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:41.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.536+0000 7f90fb600640 1 -- 172.21.15.42:0/1477631940 shutdown_connections 2024-09-17T01:35:41.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.536+0000 7f90fb600640 1 -- 172.21.15.42:0/1477631940 wait complete. 2024-09-17T01:35:41.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.538+0000 7f90fb600640 1 Processor -- start 2024-09-17T01:35:41.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.538+0000 7f90fb600640 1 -- start start 2024-09-17T01:35:41.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.539+0000 7f90fb600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f90dc0041c0 0x7f90f41f5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.539+0000 7f90fb600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90f414f3a0 0x7f90f414c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.539+0000 7f90fb600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90f40ae8d0 0x7f90f40aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.539+0000 7f90fb600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f90f406d430 con 0x7f90f414f3a0 2024-09-17T01:35:41.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.539+0000 7f90fb600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f90f4072c10 con 0x7f90f40ae8d0 2024-09-17T01:35:41.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.539+0000 7f90fb600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f90f406d5b0 con 0x7f90dc0041c0 2024-09-17T01:35:41.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.540+0000 7f90f3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90f414f3a0 0x7f90f414c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.540+0000 7f90f3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90f414f3a0 0x7f90f414c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37696/0 (socket says 172.21.15.42:37696) 2024-09-17T01:35:41.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.540+0000 7f90f3e00640 1 -- 172.21.15.42:0/1713076625 learned_addr learned my addr 172.21.15.42:0/1713076625 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:41.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.540+0000 7f90f8c00640 1 --2- 172.21.15.42:0/1713076625 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f90dc0041c0 0x7f90f41f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.540+0000 7f90f9600640 1 --2- 172.21.15.42:0/1713076625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90f40ae8d0 0x7f90f40aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.540+0000 7f90f3e00640 1 -- 172.21.15.42:0/1713076625 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f90dc0041c0 msgr2=0x7f90f41f5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.540+0000 7f90f3e00640 1 --2- 172.21.15.42:0/1713076625 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f90dc0041c0 0x7f90f41f5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.540+0000 7f90f3e00640 1 -- 172.21.15.42:0/1713076625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90f40ae8d0 msgr2=0x7f90f40aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.540+0000 7f90f3e00640 1 --2- 172.21.15.42:0/1713076625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90f40ae8d0 0x7f90f40aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.540+0000 7f90f3e00640 1 -- 172.21.15.42:0/1713076625 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90f406e260 con 0x7f90f414f3a0 2024-09-17T01:35:41.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.541+0000 7f90f3e00640 1 --2- 172.21.15.42:0/1713076625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90f414f3a0 0x7f90f414c8e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f90e0036040 tx=0x7f90e00336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:41.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.541+0000 7f90f0c00640 1 -- 172.21.15.42:0/1713076625 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e0038040 con 0x7f90f414f3a0 2024-09-17T01:35:41.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.541+0000 7f90f0c00640 1 -- 172.21.15.42:0/1713076625 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90e00338e0 con 0x7f90f414f3a0 2024-09-17T01:35:41.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.541+0000 7f90f0c00640 1 -- 172.21.15.42:0/1713076625 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e0033d10 con 0x7f90f414f3a0 2024-09-17T01:35:41.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.541+0000 7f90fb600640 1 -- 172.21.15.42:0/1713076625 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90f40af220 con 0x7f90f414f3a0 2024-09-17T01:35:41.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.541+0000 7f90fb600640 1 -- 172.21.15.42:0/1713076625 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90f406fde0 con 0x7f90f414f3a0 2024-09-17T01:35:41.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.543+0000 7f90f0c00640 1 -- 172.21.15.42:0/1713076625 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f90e0043020 con 0x7f90f414f3a0 2024-09-17T01:35:41.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.544+0000 7f90f0c00640 1 --2- 172.21.15.42:0/1713076625 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f90d4078bc0 0x7f90d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.544+0000 7f90f0c00640 1 -- 172.21.15.42:0/1713076625 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f90e00bae10 con 0x7f90f414f3a0 2024-09-17T01:35:41.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.545+0000 7f9102820740 1 Processor -- start 2024-09-17T01:35:41.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.545+0000 7f90f8c00640 1 --2- 172.21.15.42:0/1713076625 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f90d4078bc0 0x7f90d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.545+0000 7f9102820740 1 -- start start 2024-09-17T01:35:41.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.545+0000 7f90f8c00640 1 --2- 172.21.15.42:0/1713076625 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f90d4078bc0 0x7f90d407b0d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f90e8006fd0 tx=0x7f90e8006b10 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:41.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.546+0000 7f9102820740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a10ada4580 0x55a10b190100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.546+0000 7f9102820740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ad7b6c0 0x55a10b164f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.546+0000 7f9102820740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a10ad838a0 0x55a10b165490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.546+0000 7f9102820740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a10b0be950 con 0x55a10ad7b6c0 2024-09-17T01:35:41.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.546+0000 7f9102820740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a10b0add80 con 0x55a10ad838a0 2024-09-17T01:35:41.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.546+0000 7f9102820740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55a10b0b1b90 con 0x55a10ada4580 2024-09-17T01:35:41.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.547+0000 7f90f3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ad7b6c0 0x55a10b164f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.547+0000 7f90f3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ad7b6c0 0x55a10b164f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37702/0 (socket says 172.21.15.42:37702) 2024-09-17T01:35:41.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.547+0000 7f90f3e00640 1 -- 172.21.15.42:0/2774649362 learned_addr learned my addr 172.21.15.42:0/2774649362 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:41.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.547+0000 7f90f8c00640 1 --2- 172.21.15.42:0/2774649362 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a10ada4580 0x55a10b190100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.547+0000 7f90f9600640 1 --2- 172.21.15.42:0/2774649362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a10ad838a0 0x55a10b165490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.547+0000 7f90f3e00640 1 -- 172.21.15.42:0/2774649362 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a10ada4580 msgr2=0x55a10b190100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:41.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.547+0000 7f90f3e00640 1 --2- 172.21.15.42:0/2774649362 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a10ada4580 0x55a10b190100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.547+0000 7f90f3e00640 1 -- 172.21.15.42:0/2774649362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a10ad838a0 msgr2=0x55a10b165490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:41.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.547+0000 7f90f3e00640 1 --2- 172.21.15.42:0/2774649362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a10ad838a0 0x55a10b165490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.547+0000 7f90f3e00640 1 -- 172.21.15.42:0/2774649362 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a10ae889f0 con 0x55a10ad7b6c0 2024-09-17T01:35:41.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.547+0000 7f90f3e00640 1 --2- 172.21.15.42:0/2774649362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ad7b6c0 0x55a10b164f50 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f90e0082af0 tx=0x7f90e007f2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97ab122661ea6eb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:41.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.548+0000 7f90e5200640 1 -- 172.21.15.42:0/2774649362 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e0082b60 con 0x55a10ad7b6c0 2024-09-17T01:35:41.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.548+0000 7f90e5200640 1 -- 172.21.15.42:0/2774649362 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90e008c4d0 con 0x55a10ad7b6c0 2024-09-17T01:35:41.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.548+0000 7f90e5200640 1 -- 172.21.15.42:0/2774649362 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e007edd0 con 0x55a10ad7b6c0 2024-09-17T01:35:41.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.548+0000 7f9102820740 1 -- 172.21.15.42:0/2774649362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ad7b6c0 msgr2=0x55a10b164f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.548+0000 7f9102820740 1 --2- 172.21.15.42:0/2774649362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ad7b6c0 0x55a10b164f50 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f90e0082af0 tx=0x7f90e007f2e0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.548+0000 7f9102820740 1 -- 172.21.15.42:0/2774649362 shutdown_connections 2024-09-17T01:35:41.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.548+0000 7f9102820740 1 --2- 172.21.15.42:0/2774649362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a10ad838a0 0x55a10b165490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.548+0000 7f9102820740 1 --2- 172.21.15.42:0/2774649362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ad7b6c0 0x55a10b164f50 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.548+0000 7f9102820740 1 --2- 172.21.15.42:0/2774649362 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a10ada4580 0x55a10b190100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.548+0000 7f9102820740 1 -- 172.21.15.42:0/2774649362 >> 172.21.15.42:0/2774649362 conn(0x55a10ad986d0 msgr2=0x55a10b14b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:41.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.549+0000 7f9102820740 1 -- 172.21.15.42:0/2774649362 shutdown_connections 2024-09-17T01:35:41.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.549+0000 7f9102820740 1 -- 172.21.15.42:0/2774649362 wait complete. 2024-09-17T01:35:41.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.550+0000 7f9102820740 1 -- start start 2024-09-17T01:35:41.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.550+0000 7f9102820740 1 Processor -- start 2024-09-17T01:35:41.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.551+0000 7f9102820740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a10ad7b6c0 0x55a10b18cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.551+0000 7f9102820740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ad838a0 0x55a10b173ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.551+0000 7f9102820740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a10ada4580 0x55a10b18b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.551+0000 7f9102820740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a10ae1e930 con 0x55a10ad838a0 2024-09-17T01:35:41.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.551+0000 7f9102820740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a10b053630 con 0x55a10ad7b6c0 2024-09-17T01:35:41.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.551+0000 7f9102820740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55a10b0add80 con 0x55a10ada4580 2024-09-17T01:35:41.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.551+0000 7f9102820740 10 client.0 _ll_register_callbacks cb 0x55a10b059800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:41.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.552+0000 7f90f3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ad838a0 0x55a10b173ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.552+0000 7f90f3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ad838a0 0x55a10b173ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37714/0 (socket says 172.21.15.42:37714) 2024-09-17T01:35:41.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.552+0000 7f90f3e00640 1 -- 172.21.15.42:0/1376628802 learned_addr learned my addr 172.21.15.42:0/1376628802 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:41.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.552+0000 7f90f8c00640 1 --2- 172.21.15.42:0/1376628802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a10ad7b6c0 0x55a10b18cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.552+0000 7f90f9600640 1 --2- 172.21.15.42:0/1376628802 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a10ada4580 0x55a10b18b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.552+0000 7f90f3e00640 1 -- 172.21.15.42:0/1376628802 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a10ada4580 msgr2=0x55a10b18b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:41.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.552+0000 7f90f3e00640 1 --2- 172.21.15.42:0/1376628802 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a10ada4580 0x55a10b18b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.552+0000 7f90f3e00640 1 -- 172.21.15.42:0/1376628802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a10ad7b6c0 msgr2=0x55a10b18cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:41.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.552+0000 7f90f3e00640 1 --2- 172.21.15.42:0/1376628802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a10ad7b6c0 0x55a10b18cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.552+0000 7f90f3e00640 1 -- 172.21.15.42:0/1376628802 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a10aded890 con 0x55a10ad838a0 2024-09-17T01:35:41.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.552+0000 7f90f8c00640 1 --2- 172.21.15.42:0/1376628802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a10ad7b6c0 0x55a10b18cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:41.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.552+0000 7f90f9600640 1 --2- 172.21.15.42:0/1376628802 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a10ada4580 0x55a10b18b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:41.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.552+0000 7f90f3e00640 1 --2- 172.21.15.42:0/1376628802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ad838a0 0x55a10b173ae0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f90e002bfd0 tx=0x7f90e0009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84339eb1a12306f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:41.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.552+0000 7f90d9600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:41.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.553+0000 7f90d9600640 1 -- 172.21.15.42:0/1376628802 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e008c250 con 0x55a10ad838a0 2024-09-17T01:35:41.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.553+0000 7f90d9600640 1 -- 172.21.15.42:0/1376628802 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f90e00870c0 con 0x55a10ad838a0 2024-09-17T01:35:41.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.553+0000 7f9102820740 1 -- 172.21.15.42:0/1376628802 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90e008c4d0 con 0x55a10ad838a0 2024-09-17T01:35:41.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.553+0000 7f90d9600640 1 -- 172.21.15.42:0/1376628802 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f90e00872c0 con 0x55a10ad838a0 2024-09-17T01:35:41.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.553+0000 7f9102820740 10 client.5808 fetch_fsmap learned FSMap version 29 2024-09-17T01:35:41.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.553+0000 7f9102820740 1 -- 172.21.15.42:0/1376628802 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55a10aee9180 con 0x55a10ad838a0 2024-09-17T01:35:41.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.553+0000 7f90d9600640 1 -- 172.21.15.42:0/1376628802 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90e008c4d0 con 0x55a10ad838a0 2024-09-17T01:35:41.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.553+0000 7f90d9600640 1 -- 172.21.15.42:0/1376628802 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f90e003b070 con 0x55a10ad838a0 2024-09-17T01:35:41.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.553+0000 7f9102820740 10 client.5808 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T01:35:41.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.553+0000 7f9102820740 10 client.5808 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:41.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.553+0000 7f9102820740 20 client.5808 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:41.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.553+0000 7f9102820740 1 --2- 172.21.15.42:0/1376628802 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55a10ad63150 0x55a10b18bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.553+0000 7f9102820740 4 client.5808 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:41.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.553+0000 7f9102820740 1 -- 172.21.15.42:0/1376628802 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a10b0c08a0 con 0x55a10ad63150 2024-09-17T01:35:41.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.553+0000 7f90f8c00640 1 --2- 172.21.15.42:0/1376628802 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55a10ad63150 0x55a10b18bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.554+0000 7f90f8c00640 1 --2- 172.21.15.42:0/1376628802 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55a10ad63150 0x55a10b18bcd0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4554586fb3a3ec71 server_cookie=7c6d3164d7d8be12 in_seq=0 out_seq=0 2024-09-17T01:35:41.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.554+0000 7f90d9600640 10 client.5808 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:41.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.555+0000 7f90d9600640 1 -- 172.21.15.42:0/1376628802 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a10b0c08a0 con 0x55a10ad63150 2024-09-17T01:35:41.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.555+0000 7f90d9600640 10 client.5808 handle_command_reply: tid=0 2024-09-17T01:35:41.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.555+0000 7f9102820740 1 client.5808 shutdown 2024-09-17T01:35:41.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.555+0000 7f9102820740 1 -- 172.21.15.42:0/1376628802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ad838a0 msgr2=0x55a10b173ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.555+0000 7f9102820740 1 --2- 172.21.15.42:0/1376628802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ad838a0 0x55a10b173ae0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f90e002bfd0 tx=0x7f90e0009820 comp rx=0 tx=0).stop 2024-09-17T01:35:41.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.555+0000 7f9102820740 1 -- 172.21.15.42:0/1376628802 shutdown_connections 2024-09-17T01:35:41.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.555+0000 7f9102820740 1 --2- 172.21.15.42:0/1376628802 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55a10ad63150 0x55a10b18bcd0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.555+0000 7f9102820740 1 --2- 172.21.15.42:0/1376628802 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a10ada4580 0x55a10b18b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.555+0000 7f9102820740 1 --2- 172.21.15.42:0/1376628802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ad838a0 0x55a10b173ae0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.555+0000 7f90d9600640 0 client.5808 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:41.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.555+0000 7f9102820740 1 --2- 172.21.15.42:0/1376628802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a10ad7b6c0 0x55a10b18cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.555+0000 7f9102820740 1 -- 172.21.15.42:0/1376628802 >> 172.21.15.42:0/1376628802 conn(0x55a10ad986d0 msgr2=0x55a10b164ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:41.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.555+0000 7f9102820740 1 -- 172.21.15.42:0/1376628802 shutdown_connections 2024-09-17T01:35:41.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.555+0000 7f9102820740 1 -- 172.21.15.42:0/1376628802 wait complete. 2024-09-17T01:35:41.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.555+0000 7f9102820740 20 client.5808 trim_cache size 0 max 16384 2024-09-17T01:35:41.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.574+0000 7f9102820740 1 Processor -- start 2024-09-17T01:35:41.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.574+0000 7f9102820740 1 -- start start 2024-09-17T01:35:41.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.575+0000 7f9102820740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a10ad7b6c0 0x55a10b141160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.575+0000 7f9102820740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a10ad838a0 0x55a10b173b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.576+0000 7f9102820740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ada4580 0x55a10b2094b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.576+0000 7f9102820740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f90f41f9640 con 0x55a10ada4580 2024-09-17T01:35:41.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.576+0000 7f9102820740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f90f40c65b0 con 0x55a10ad838a0 2024-09-17T01:35:41.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.576+0000 7f9102820740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f90f4152c80 con 0x55a10ad7b6c0 2024-09-17T01:35:41.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.576+0000 7f90f9600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ada4580 0x55a10b2094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.576+0000 7f90f9600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ada4580 0x55a10b2094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37722/0 (socket says 172.21.15.42:37722) 2024-09-17T01:35:41.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.576+0000 7f90f9600640 1 -- 172.21.15.42:0/453884920 learned_addr learned my addr 172.21.15.42:0/453884920 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:41.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.576+0000 7f90f8c00640 1 --2- 172.21.15.42:0/453884920 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a10ad7b6c0 0x55a10b141160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.576+0000 7f90f3e00640 1 --2- 172.21.15.42:0/453884920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a10ad838a0 0x55a10b173b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.576+0000 7f90f9600640 1 -- 172.21.15.42:0/453884920 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a10ad7b6c0 msgr2=0x55a10b141160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:41.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.576+0000 7f90f9600640 1 --2- 172.21.15.42:0/453884920 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a10ad7b6c0 0x55a10b141160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.576+0000 7f90f9600640 1 -- 172.21.15.42:0/453884920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a10ad838a0 msgr2=0x55a10b173b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:41.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.576+0000 7f90f9600640 1 --2- 172.21.15.42:0/453884920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a10ad838a0 0x55a10b173b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.576+0000 7f90f9600640 1 -- 172.21.15.42:0/453884920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a10ae86cf0 con 0x55a10ada4580 2024-09-17T01:35:41.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.576+0000 7f90f9600640 1 --2- 172.21.15.42:0/453884920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ada4580 0x55a10b2094b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f90ec003c80 tx=0x7f90ec006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ccc5b0985abb0b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:41.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.577+0000 7f90dbe00640 1 -- 172.21.15.42:0/453884920 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ec004090 con 0x55a10ada4580 2024-09-17T01:35:41.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.577+0000 7f90dbe00640 1 -- 172.21.15.42:0/453884920 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90ec004250 con 0x55a10ada4580 2024-09-17T01:35:41.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.577+0000 7f90dbe00640 1 -- 172.21.15.42:0/453884920 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ec0046a0 con 0x55a10ada4580 2024-09-17T01:35:41.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.577+0000 7f9102820740 1 -- 172.21.15.42:0/453884920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ada4580 msgr2=0x55a10b2094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.577+0000 7f9102820740 1 --2- 172.21.15.42:0/453884920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ada4580 0x55a10b2094b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f90ec003c80 tx=0x7f90ec006040 comp rx=0 tx=0).stop 2024-09-17T01:35:41.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.577+0000 7f9102820740 1 -- 172.21.15.42:0/453884920 shutdown_connections 2024-09-17T01:35:41.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.577+0000 7f9102820740 1 --2- 172.21.15.42:0/453884920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a10ad838a0 0x55a10b173b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.577+0000 7f9102820740 1 --2- 172.21.15.42:0/453884920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ada4580 0x55a10b2094b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.577+0000 7f9102820740 1 --2- 172.21.15.42:0/453884920 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a10ad7b6c0 0x55a10b141160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.577+0000 7f9102820740 1 -- 172.21.15.42:0/453884920 >> 172.21.15.42:0/453884920 conn(0x55a10ad986d0 msgr2=0x55a10b19e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:41.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.578+0000 7f9102820740 1 -- 172.21.15.42:0/453884920 shutdown_connections 2024-09-17T01:35:41.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.578+0000 7f9102820740 1 -- 172.21.15.42:0/453884920 wait complete. 2024-09-17T01:35:41.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.578+0000 7f9102820740 1 -- start start 2024-09-17T01:35:41.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.579+0000 7f9102820740 1 Processor -- start 2024-09-17T01:35:41.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.580+0000 7f9102820740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ad7b6c0 0x55a10b1edcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.580+0000 7f9102820740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a10ad838a0 0x55a10b1ee1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.580+0000 7f9102820740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a10ada4580 0x55a10b18a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.580+0000 7f9102820740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a10b0be950 con 0x55a10ad7b6c0 2024-09-17T01:35:41.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.580+0000 7f9102820740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f90f41532d0 con 0x55a10ada4580 2024-09-17T01:35:41.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.580+0000 7f9102820740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55a10b1eebd0 con 0x55a10ad838a0 2024-09-17T01:35:41.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.580+0000 7f9102820740 10 client.0 _ll_register_callbacks cb 0x7f90e007ea90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:41.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.580+0000 7f90f8c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ad7b6c0 0x55a10b1edcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.580+0000 7f90f8c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ad7b6c0 0x55a10b1edcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37736/0 (socket says 172.21.15.42:37736) 2024-09-17T01:35:41.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.580+0000 7f90f8c00640 1 -- 172.21.15.42:0/1513667243 learned_addr learned my addr 172.21.15.42:0/1513667243 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:41.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.580+0000 7f90f3e00640 1 --2- 172.21.15.42:0/1513667243 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a10ad838a0 0x55a10b1ee1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.581+0000 7f90f9600640 1 --2- 172.21.15.42:0/1513667243 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a10ada4580 0x55a10b18a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.581+0000 7f90f8c00640 1 -- 172.21.15.42:0/1513667243 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a10ad838a0 msgr2=0x55a10b1ee1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:41.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.581+0000 7f90f8c00640 1 --2- 172.21.15.42:0/1513667243 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a10ad838a0 0x55a10b1ee1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.581+0000 7f90f8c00640 1 -- 172.21.15.42:0/1513667243 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a10ada4580 msgr2=0x55a10b18a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:41.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.581+0000 7f90f8c00640 1 --2- 172.21.15.42:0/1513667243 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a10ada4580 0x55a10b18a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.581+0000 7f90f8c00640 1 -- 172.21.15.42:0/1513667243 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a10b205370 con 0x55a10ad7b6c0 2024-09-17T01:35:41.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.581+0000 7f90f3e00640 1 --2- 172.21.15.42:0/1513667243 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a10ad838a0 0x55a10b1ee1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:41.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.581+0000 7f90f8c00640 1 --2- 172.21.15.42:0/1513667243 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ad7b6c0 0x55a10b1edcb0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f90e8001930 tx=0x7f90e8001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee63f7d210b9df5e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:41.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.581+0000 7f90d9600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:41.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.581+0000 7f90d9600640 1 -- 172.21.15.42:0/1513667243 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e8013aa0 con 0x55a10ad7b6c0 2024-09-17T01:35:41.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.581+0000 7f90d9600640 1 -- 172.21.15.42:0/1513667243 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f90e8013c40 con 0x55a10ad7b6c0 2024-09-17T01:35:41.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.581+0000 7f9102820740 1 -- 172.21.15.42:0/1513667243 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90ec004250 con 0x55a10ad7b6c0 2024-09-17T01:35:41.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.582+0000 7f90d9600640 1 -- 172.21.15.42:0/1513667243 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f90e8036050 con 0x55a10ad7b6c0 2024-09-17T01:35:41.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.582+0000 7f9102820740 10 client.5814 fetch_fsmap learned FSMap version 29 2024-09-17T01:35:41.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.582+0000 7f9102820740 1 -- 172.21.15.42:0/1513667243 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55a10b1ee910 con 0x55a10ad7b6c0 2024-09-17T01:35:41.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.582+0000 7f90d9600640 1 -- 172.21.15.42:0/1513667243 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90ec004250 con 0x55a10ad7b6c0 2024-09-17T01:35:41.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.582+0000 7f90d9600640 1 -- 172.21.15.42:0/1513667243 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f90e8039020 con 0x55a10ad7b6c0 2024-09-17T01:35:41.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.582+0000 7f9102820740 10 client.5814 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T01:35:41.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.582+0000 7f9102820740 10 client.5814 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:41.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.582+0000 7f9102820740 20 client.5814 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:41.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.582+0000 7f9102820740 1 --2- 172.21.15.42:0/1513667243 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55a10b206410 0x55a10b18ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.582+0000 7f9102820740 4 client.5814 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-17T01:35:41.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.582+0000 7f9102820740 1 -- 172.21.15.42:0/1513667243 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) -- 0x55a10b0bc350 con 0x55a10b206410 2024-09-17T01:35:41.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.582+0000 7f90f3e00640 1 --2- 172.21.15.42:0/1513667243 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55a10b206410 0x55a10b18ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.583+0000 7f90f3e00640 1 --2- 172.21.15.42:0/1513667243 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55a10b206410 0x55a10b18ab60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43bdc0832e5dfaf3 server_cookie=b2dde97842a0eaff in_seq=0 out_seq=0 2024-09-17T01:35:41.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.583+0000 7f90d9600640 10 client.5814 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:41.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.583+0000 7f90d9600640 1 -- 172.21.15.42:0/1513667243 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+26 (crc 0 0 0) 0x55a10b0bc350 con 0x55a10b206410 2024-09-17T01:35:41.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.583+0000 7f90d9600640 10 client.5814 handle_command_reply: tid=0 2024-09-17T01:35:41.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.583+0000 7f9102820740 1 client.5814 shutdown 2024-09-17T01:35:41.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.584+0000 7f9102820740 1 -- 172.21.15.42:0/1513667243 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ad7b6c0 msgr2=0x55a10b1edcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.584+0000 7f9102820740 1 --2- 172.21.15.42:0/1513667243 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ad7b6c0 0x55a10b1edcb0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f90e8001930 tx=0x7f90e8001360 comp rx=0 tx=0).stop 2024-09-17T01:35:41.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.584+0000 7f9102820740 1 -- 172.21.15.42:0/1513667243 shutdown_connections 2024-09-17T01:35:41.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.584+0000 7f9102820740 1 --2- 172.21.15.42:0/1513667243 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55a10b206410 0x55a10b18ab60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.584+0000 7f9102820740 1 --2- 172.21.15.42:0/1513667243 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a10ada4580 0x55a10b18a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.584+0000 7f9102820740 1 --2- 172.21.15.42:0/1513667243 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a10ad838a0 0x55a10b1ee1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.584+0000 7f9102820740 1 --2- 172.21.15.42:0/1513667243 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a10ad7b6c0 0x55a10b1edcb0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.584+0000 7f90d9600640 0 client.5814 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:41.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.584+0000 7f9102820740 1 -- 172.21.15.42:0/1513667243 >> 172.21.15.42:0/1513667243 conn(0x55a10ad986d0 msgr2=0x55a10b140e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:41.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.584+0000 7f9102820740 1 -- 172.21.15.42:0/1513667243 shutdown_connections 2024-09-17T01:35:41.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.584+0000 7f9102820740 1 -- 172.21.15.42:0/1513667243 wait complete. 2024-09-17T01:35:41.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.584+0000 7f9102820740 20 client.5814 trim_cache size 0 max 16384 2024-09-17T01:35:41.586 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:41.586 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": -2 2024-09-17T01:35:41.586 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:41.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.585+0000 7f90fb600640 1 -- 172.21.15.42:0/1713076625 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f90d4078bc0 msgr2=0x7f90d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.585+0000 7f90fb600640 1 --2- 172.21.15.42:0/1713076625 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f90d4078bc0 0x7f90d407b0d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f90e8006fd0 tx=0x7f90e8006b10 comp rx=0 tx=0).stop 2024-09-17T01:35:41.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.585+0000 7f90fb600640 1 -- 172.21.15.42:0/1713076625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90f414f3a0 msgr2=0x7f90f414c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.585+0000 7f90fb600640 1 --2- 172.21.15.42:0/1713076625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90f414f3a0 0x7f90f414c8e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f90e0036040 tx=0x7f90e00336f0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.585+0000 7f90fb600640 1 -- 172.21.15.42:0/1713076625 shutdown_connections 2024-09-17T01:35:41.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.585+0000 7f90fb600640 1 --2- 172.21.15.42:0/1713076625 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f90d4078bc0 0x7f90d407b0d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.585+0000 7f90fb600640 1 --2- 172.21.15.42:0/1713076625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90f40ae8d0 0x7f90f40aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.585+0000 7f90fb600640 1 --2- 172.21.15.42:0/1713076625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90f414f3a0 0x7f90f414c8e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.585+0000 7f90fb600640 1 --2- 172.21.15.42:0/1713076625 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f90dc0041c0 0x7f90f41f5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.585+0000 7f90fb600640 1 -- 172.21.15.42:0/1713076625 >> 172.21.15.42:0/1713076625 conn(0x7f90f40b2930 msgr2=0x7f90f415e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:41.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.585+0000 7f90fb600640 1 -- 172.21.15.42:0/1713076625 shutdown_connections 2024-09-17T01:35:41.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.585+0000 7f90fb600640 1 -- 172.21.15.42:0/1713076625 wait complete. 2024-09-17T01:35:41.607 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-09-17T01:35:41.607 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-09-17T01:35:41.608 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-09-17T01:35:41.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.841+0000 7f5931800640 1 -- 172.21.15.42:0/4118246013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f592c0cf7c0 msgr2=0x7f592c06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.841+0000 7f5931800640 1 --2- 172.21.15.42:0/4118246013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f592c0cf7c0 0x7f592c06cd20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5914005fd0 tx=0x7f591402a5d0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.841+0000 7f5931800640 1 -- 172.21.15.42:0/4118246013 shutdown_connections 2024-09-17T01:35:41.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.841+0000 7f5931800640 1 --2- 172.21.15.42:0/4118246013 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f592c06d260 0x7f592c152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.841+0000 7f5931800640 1 --2- 172.21.15.42:0/4118246013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f592c0cf7c0 0x7f592c06cd20 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.841+0000 7f5931800640 1 -- 172.21.15.42:0/4118246013 >> 172.21.15.42:0/4118246013 conn(0x7f592c0b25f0 msgr2=0x7f592c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:41.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.841+0000 7f5931800640 1 -- 172.21.15.42:0/4118246013 shutdown_connections 2024-09-17T01:35:41.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.841+0000 7f5931800640 1 -- 172.21.15.42:0/4118246013 wait complete. 2024-09-17T01:35:41.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.843+0000 7f5931800640 1 Processor -- start 2024-09-17T01:35:41.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.844+0000 7f5931800640 1 -- start start 2024-09-17T01:35:41.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.845+0000 7f5931800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f592c06d260 0x7f592c15b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.845+0000 7f5931800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f592c0b4be0 0x7f592c15ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.845+0000 7f5931800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f592c0cf7c0 0x7f592c0736a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.845+0000 7f5931800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f592c153850 con 0x7f592c06d260 2024-09-17T01:35:41.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.845+0000 7f5931800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f592c1536d0 con 0x7f592c0cf7c0 2024-09-17T01:35:41.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.845+0000 7f5931800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f592c1539d0 con 0x7f592c0b4be0 2024-09-17T01:35:41.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.845+0000 7f592be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f592c06d260 0x7f592c15b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.845+0000 7f592be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f592c06d260 0x7f592c15b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37756/0 (socket says 172.21.15.42:37756) 2024-09-17T01:35:41.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.845+0000 7f592be00640 1 -- 172.21.15.42:0/2570959189 learned_addr learned my addr 172.21.15.42:0/2570959189 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:41.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.846+0000 7f5923e00640 1 --2- 172.21.15.42:0/2570959189 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f592c0b4be0 0x7f592c15ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.846+0000 7f5930e00640 1 --2- 172.21.15.42:0/2570959189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f592c0cf7c0 0x7f592c0736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.846+0000 7f592be00640 1 -- 172.21.15.42:0/2570959189 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f592c0b4be0 msgr2=0x7f592c15ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.846+0000 7f592be00640 1 --2- 172.21.15.42:0/2570959189 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f592c0b4be0 0x7f592c15ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.846+0000 7f592be00640 1 -- 172.21.15.42:0/2570959189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f592c0cf7c0 msgr2=0x7f592c0736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.846+0000 7f592be00640 1 --2- 172.21.15.42:0/2570959189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f592c0cf7c0 0x7f592c0736a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.846+0000 7f592be00640 1 -- 172.21.15.42:0/2570959189 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592c1f3b50 con 0x7f592c06d260 2024-09-17T01:35:41.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.846+0000 7f5930e00640 1 --2- 172.21.15.42:0/2570959189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f592c0cf7c0 0x7f592c0736a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:41.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.846+0000 7f5923e00640 1 --2- 172.21.15.42:0/2570959189 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f592c0b4be0 0x7f592c15ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:41.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.846+0000 7f592be00640 1 --2- 172.21.15.42:0/2570959189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f592c06d260 0x7f592c15b4e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f591c00c370 tx=0x7f591c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:41.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.846+0000 7f5928c00640 1 -- 172.21.15.42:0/2570959189 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c0052d0 con 0x7f592c06d260 2024-09-17T01:35:41.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.846+0000 7f5928c00640 1 -- 172.21.15.42:0/2570959189 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f591c007020 con 0x7f592c06d260 2024-09-17T01:35:41.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.846+0000 7f5928c00640 1 -- 172.21.15.42:0/2570959189 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c007470 con 0x7f592c06d260 2024-09-17T01:35:41.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.846+0000 7f5931800640 1 -- 172.21.15.42:0/2570959189 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f592c1f3e10 con 0x7f592c06d260 2024-09-17T01:35:41.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.846+0000 7f5931800640 1 -- 172.21.15.42:0/2570959189 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f592c1f43d0 con 0x7f592c06d260 2024-09-17T01:35:41.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.849+0000 7f5928c00640 1 -- 172.21.15.42:0/2570959189 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f591c0067d0 con 0x7f592c06d260 2024-09-17T01:35:41.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.851+0000 7f5928c00640 1 --2- 172.21.15.42:0/2570959189 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5908078b90 0x7f590807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.851+0000 7f5928c00640 1 -- 172.21.15.42:0/2570959189 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f591c09a2c0 con 0x7f592c06d260 2024-09-17T01:35:41.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.851+0000 7f5923e00640 1 --2- 172.21.15.42:0/2570959189 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5908078b90 0x7f590807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.851+0000 7f5939e5b740 1 Processor -- start 2024-09-17T01:35:41.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.852+0000 7f5939e5b740 1 -- start start 2024-09-17T01:35:41.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.852+0000 7f5923e00640 1 --2- 172.21.15.42:0/2570959189 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5908078b90 0x7f590807b0a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5914033000 tx=0x7f5914004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:41.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.853+0000 7f5939e5b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 0x555c3fcb6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.853+0000 7f5939e5b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c3f8bb7d0 0x555c3fcb6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.853+0000 7f5939e5b740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555c3f8c39b0 0x555c3fcd3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.853+0000 7f5939e5b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555c3fbfea30 con 0x555c3f8e4690 2024-09-17T01:35:41.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.853+0000 7f5939e5b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555c3fbede60 con 0x555c3f8bb7d0 2024-09-17T01:35:41.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.853+0000 7f5939e5b740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x555c3fbf1c70 con 0x555c3f8c39b0 2024-09-17T01:35:41.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.853+0000 7f592be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 0x555c3fcb6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.853+0000 7f592be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 0x555c3fcb6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37762/0 (socket says 172.21.15.42:37762) 2024-09-17T01:35:41.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.853+0000 7f592be00640 1 -- 172.21.15.42:0/1021808258 learned_addr learned my addr 172.21.15.42:0/1021808258 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:41.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.853+0000 7f5923e00640 1 --2- 172.21.15.42:0/1021808258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c3f8bb7d0 0x555c3fcb6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.853+0000 7f5930e00640 1 --2- 172.21.15.42:0/1021808258 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555c3f8c39b0 0x555c3fcd3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.854+0000 7f592be00640 1 -- 172.21.15.42:0/1021808258 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555c3f8c39b0 msgr2=0x555c3fcd3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:41.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.854+0000 7f592be00640 1 --2- 172.21.15.42:0/1021808258 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555c3f8c39b0 0x555c3fcd3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.854+0000 7f592be00640 1 -- 172.21.15.42:0/1021808258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c3f8bb7d0 msgr2=0x555c3fcb6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:41.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.854+0000 7f592be00640 1 --2- 172.21.15.42:0/1021808258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c3f8bb7d0 0x555c3fcb6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.854+0000 7f592be00640 1 -- 172.21.15.42:0/1021808258 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c3f9c8b00 con 0x555c3f8e4690 2024-09-17T01:35:41.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.854+0000 7f592be00640 1 --2- 172.21.15.42:0/1021808258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 0x555c3fcb6050 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f591c061ef0 tx=0x7f591c061a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c5c8175491a065 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:41.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.854+0000 7f5920c00640 1 -- 172.21.15.42:0/1021808258 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c061f60 con 0x555c3f8e4690 2024-09-17T01:35:41.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.854+0000 7f5920c00640 1 -- 172.21.15.42:0/1021808258 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f591c066a40 con 0x555c3f8e4690 2024-09-17T01:35:41.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.854+0000 7f5920c00640 1 -- 172.21.15.42:0/1021808258 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c06b980 con 0x555c3f8e4690 2024-09-17T01:35:41.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.855+0000 7f5939e5b740 1 -- 172.21.15.42:0/1021808258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 msgr2=0x555c3fcb6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.855+0000 7f5939e5b740 1 --2- 172.21.15.42:0/1021808258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 0x555c3fcb6050 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f591c061ef0 tx=0x7f591c061a70 comp rx=0 tx=0).stop 2024-09-17T01:35:41.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.855+0000 7f5939e5b740 1 -- 172.21.15.42:0/1021808258 shutdown_connections 2024-09-17T01:35:41.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.855+0000 7f5939e5b740 1 --2- 172.21.15.42:0/1021808258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c3f8bb7d0 0x555c3fcb6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.855+0000 7f5939e5b740 1 --2- 172.21.15.42:0/1021808258 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555c3f8c39b0 0x555c3fcd3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.855+0000 7f5939e5b740 1 --2- 172.21.15.42:0/1021808258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 0x555c3fcb6050 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.855+0000 7f5939e5b740 1 -- 172.21.15.42:0/1021808258 >> 172.21.15.42:0/1021808258 conn(0x555c3f8d87e0 msgr2=0x555c3fc8c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:41.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.855+0000 7f5939e5b740 1 -- 172.21.15.42:0/1021808258 shutdown_connections 2024-09-17T01:35:41.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.855+0000 7f5939e5b740 1 -- 172.21.15.42:0/1021808258 wait complete. 2024-09-17T01:35:41.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.856+0000 7f5939e5b740 1 -- start start 2024-09-17T01:35:41.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.856+0000 7f5939e5b740 1 Processor -- start 2024-09-17T01:35:41.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.858+0000 7f5939e5b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c3f8bb7d0 0x555c3fca46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.858+0000 7f5939e5b740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555c3f8c39b0 0x555c3fcd1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.858+0000 7f5939e5b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 0x555c3fccbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.858+0000 7f5939e5b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555c3f95ea40 con 0x555c3f8e4690 2024-09-17T01:35:41.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.858+0000 7f5939e5b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555c3fb937c0 con 0x555c3f8bb7d0 2024-09-17T01:35:41.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.858+0000 7f5939e5b740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x555c3fcb6ad0 con 0x555c3f8c39b0 2024-09-17T01:35:41.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.858+0000 7f5939e5b740 10 client.0 _ll_register_callbacks cb 0x555c3f8fbee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:41.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.858+0000 7f5930e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 0x555c3fccbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.858+0000 7f5930e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 0x555c3fccbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37770/0 (socket says 172.21.15.42:37770) 2024-09-17T01:35:41.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.858+0000 7f5930e00640 1 -- 172.21.15.42:0/3069100158 learned_addr learned my addr 172.21.15.42:0/3069100158 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:41.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.859+0000 7f592be00640 1 --2- 172.21.15.42:0/3069100158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c3f8bb7d0 0x555c3fca46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.859+0000 7f5923e00640 1 --2- 172.21.15.42:0/3069100158 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555c3f8c39b0 0x555c3fcd1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.859+0000 7f5930e00640 1 -- 172.21.15.42:0/3069100158 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555c3f8c39b0 msgr2=0x555c3fcd1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:41.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.859+0000 7f5930e00640 1 --2- 172.21.15.42:0/3069100158 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555c3f8c39b0 0x555c3fcd1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.859+0000 7f5930e00640 1 -- 172.21.15.42:0/3069100158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c3f8bb7d0 msgr2=0x555c3fca46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:41.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.859+0000 7f5930e00640 1 --2- 172.21.15.42:0/3069100158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c3f8bb7d0 0x555c3fca46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.859+0000 7f5930e00640 1 -- 172.21.15.42:0/3069100158 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c3f92d9a0 con 0x555c3f8e4690 2024-09-17T01:35:41.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.859+0000 7f5930e00640 1 --2- 172.21.15.42:0/3069100158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 0x555c3fccbe50 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5924009b30 tx=0x7f5924004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adfb4b536232404a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:41.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.859+0000 7f5919600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:41.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.860+0000 7f5919600640 1 -- 172.21.15.42:0/3069100158 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592401b670 con 0x555c3f8e4690 2024-09-17T01:35:41.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.860+0000 7f5919600640 1 -- 172.21.15.42:0/3069100158 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f592401b810 con 0x555c3f8e4690 2024-09-17T01:35:41.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.860+0000 7f5939e5b740 1 -- 172.21.15.42:0/3069100158 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f591c066a40 con 0x555c3f8e4690 2024-09-17T01:35:41.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.860+0000 7f5919600640 1 -- 172.21.15.42:0/3069100158 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5924023050 con 0x555c3f8e4690 2024-09-17T01:35:41.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.860+0000 7f5939e5b740 10 client.5826 fetch_fsmap learned FSMap version 29 2024-09-17T01:35:41.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.860+0000 7f5939e5b740 1 -- 172.21.15.42:0/3069100158 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x555c3fa29290 con 0x555c3f8e4690 2024-09-17T01:35:41.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.860+0000 7f5919600640 1 -- 172.21.15.42:0/3069100158 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f591c066a40 con 0x555c3f8e4690 2024-09-17T01:35:41.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.860+0000 7f5919600640 1 -- 172.21.15.42:0/3069100158 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f5924026020 con 0x555c3f8e4690 2024-09-17T01:35:41.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.860+0000 7f5939e5b740 10 client.5826 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T01:35:41.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.860+0000 7f5939e5b740 10 client.5826 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:41.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.860+0000 7f5939e5b740 20 client.5826 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:41.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.860+0000 7f5939e5b740 1 --2- 172.21.15.42:0/3069100158 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x555c3f8a3260 0x555c3fcc8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.860+0000 7f5939e5b740 4 client.5826 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:41.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.860+0000 7f5939e5b740 1 -- 172.21.15.42:0/3069100158 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c3fc00980 con 0x555c3f8a3260 2024-09-17T01:35:41.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.861+0000 7f592be00640 1 --2- 172.21.15.42:0/3069100158 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x555c3f8a3260 0x555c3fcc8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.861+0000 7f592be00640 1 --2- 172.21.15.42:0/3069100158 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x555c3f8a3260 0x555c3fcc8160 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1c0260c1506dd2b server_cookie=98b86e2185ad6261 in_seq=0 out_seq=0 2024-09-17T01:35:41.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.861+0000 7f5919600640 10 client.5826 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:41.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.862+0000 7f5919600640 1 -- 172.21.15.42:0/3069100158 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555c3fc00980 con 0x555c3f8a3260 2024-09-17T01:35:41.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.862+0000 7f5919600640 10 client.5826 handle_command_reply: tid=0 2024-09-17T01:35:41.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.862+0000 7f5939e5b740 1 client.5826 shutdown 2024-09-17T01:35:41.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.862+0000 7f5939e5b740 1 -- 172.21.15.42:0/3069100158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 msgr2=0x555c3fccbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.862+0000 7f5939e5b740 1 --2- 172.21.15.42:0/3069100158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 0x555c3fccbe50 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5924009b30 tx=0x7f5924004040 comp rx=0 tx=0).stop 2024-09-17T01:35:41.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.862+0000 7f5939e5b740 1 -- 172.21.15.42:0/3069100158 shutdown_connections 2024-09-17T01:35:41.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.862+0000 7f5939e5b740 1 --2- 172.21.15.42:0/3069100158 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x555c3f8a3260 0x555c3fcc8160 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.862+0000 7f5939e5b740 1 --2- 172.21.15.42:0/3069100158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 0x555c3fccbe50 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.862+0000 7f5939e5b740 1 --2- 172.21.15.42:0/3069100158 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555c3f8c39b0 0x555c3fcd1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.862+0000 7f5939e5b740 1 --2- 172.21.15.42:0/3069100158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c3f8bb7d0 0x555c3fca46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.862+0000 7f5919600640 0 client.5826 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:41.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.862+0000 7f5939e5b740 1 -- 172.21.15.42:0/3069100158 >> 172.21.15.42:0/3069100158 conn(0x555c3f8d87e0 msgr2=0x555c3fcd2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:41.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.862+0000 7f5939e5b740 1 -- 172.21.15.42:0/3069100158 shutdown_connections 2024-09-17T01:35:41.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.862+0000 7f5939e5b740 1 -- 172.21.15.42:0/3069100158 wait complete. 2024-09-17T01:35:41.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.863+0000 7f5939e5b740 20 client.5826 trim_cache size 0 max 16384 2024-09-17T01:35:41.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.883+0000 7f5939e5b740 1 Processor -- start 2024-09-17T01:35:41.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.883+0000 7f5939e5b740 1 -- start start 2024-09-17T01:35:41.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.884+0000 7f5939e5b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c3f8bb7d0 0x555c3fcdfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.884+0000 7f5939e5b740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555c3f8c39b0 0x555c3fcc8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.884+0000 7f5939e5b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 0x555c3fcc8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.884+0000 7f5939e5b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f592c0cb430 con 0x555c3f8e4690 2024-09-17T01:35:41.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.884+0000 7f5939e5b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f592c145900 con 0x555c3f8bb7d0 2024-09-17T01:35:41.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.884+0000 7f5939e5b740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f592c1f7de0 con 0x555c3f8c39b0 2024-09-17T01:35:41.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.885+0000 7f5930e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 0x555c3fcc8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.885+0000 7f5930e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 0x555c3fcc8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37776/0 (socket says 172.21.15.42:37776) 2024-09-17T01:35:41.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.885+0000 7f5930e00640 1 -- 172.21.15.42:0/1480850628 learned_addr learned my addr 172.21.15.42:0/1480850628 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:41.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.885+0000 7f592be00640 1 --2- 172.21.15.42:0/1480850628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c3f8bb7d0 0x555c3fcdfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.885+0000 7f5923e00640 1 --2- 172.21.15.42:0/1480850628 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555c3f8c39b0 0x555c3fcc8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.885+0000 7f5930e00640 1 -- 172.21.15.42:0/1480850628 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555c3f8c39b0 msgr2=0x555c3fcc8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:41.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.885+0000 7f5930e00640 1 --2- 172.21.15.42:0/1480850628 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555c3f8c39b0 0x555c3fcc8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.885+0000 7f5930e00640 1 -- 172.21.15.42:0/1480850628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c3f8bb7d0 msgr2=0x555c3fcdfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:41.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.885+0000 7f5930e00640 1 --2- 172.21.15.42:0/1480850628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c3f8bb7d0 0x555c3fcdfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.885+0000 7f5930e00640 1 -- 172.21.15.42:0/1480850628 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c3f9c6e00 con 0x555c3f8e4690 2024-09-17T01:35:41.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.885+0000 7f5923e00640 1 --2- 172.21.15.42:0/1480850628 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555c3f8c39b0 0x555c3fcc8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:41.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.885+0000 7f5930e00640 1 --2- 172.21.15.42:0/1480850628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 0x555c3fcc8680 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f592401b630 tx=0x7f592401b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a0a8fde0eb3cb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:41.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.886+0000 7f591be00640 1 -- 172.21.15.42:0/1480850628 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5924012650 con 0x555c3f8e4690 2024-09-17T01:35:41.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.886+0000 7f591be00640 1 -- 172.21.15.42:0/1480850628 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5924016070 con 0x555c3f8e4690 2024-09-17T01:35:41.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.886+0000 7f591be00640 1 -- 172.21.15.42:0/1480850628 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5924012ab0 con 0x555c3f8e4690 2024-09-17T01:35:41.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.886+0000 7f5939e5b740 1 -- 172.21.15.42:0/1480850628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 msgr2=0x555c3fcc8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.886+0000 7f5939e5b740 1 --2- 172.21.15.42:0/1480850628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 0x555c3fcc8680 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f592401b630 tx=0x7f592401b660 comp rx=0 tx=0).stop 2024-09-17T01:35:41.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.886+0000 7f5939e5b740 1 -- 172.21.15.42:0/1480850628 shutdown_connections 2024-09-17T01:35:41.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.886+0000 7f5939e5b740 1 --2- 172.21.15.42:0/1480850628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 0x555c3fcc8680 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.886+0000 7f5939e5b740 1 --2- 172.21.15.42:0/1480850628 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555c3f8c39b0 0x555c3fcc8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.886+0000 7f5939e5b740 1 --2- 172.21.15.42:0/1480850628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c3f8bb7d0 0x555c3fcdfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.886+0000 7f5939e5b740 1 -- 172.21.15.42:0/1480850628 >> 172.21.15.42:0/1480850628 conn(0x555c3f8d87e0 msgr2=0x555c3fc8c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:41.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.886+0000 7f5939e5b740 1 -- 172.21.15.42:0/1480850628 shutdown_connections 2024-09-17T01:35:41.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.887+0000 7f5939e5b740 1 -- 172.21.15.42:0/1480850628 wait complete. 2024-09-17T01:35:41.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.887+0000 7f5939e5b740 1 -- start start 2024-09-17T01:35:41.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.888+0000 7f5939e5b740 1 Processor -- start 2024-09-17T01:35:41.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.889+0000 7f5939e5b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c3f8bb7d0 0x555c3fd4f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.889+0000 7f5939e5b740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555c3f8c39b0 0x555c3fcf3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.889+0000 7f5939e5b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 0x555c3fcc9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.889+0000 7f5939e5b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f592c1452b0 con 0x555c3f8e4690 2024-09-17T01:35:41.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.889+0000 7f5939e5b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555c3fc8c200 con 0x555c3f8bb7d0 2024-09-17T01:35:41.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.889+0000 7f5939e5b740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x555c3fcf46c0 con 0x555c3f8c39b0 2024-09-17T01:35:41.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.889+0000 7f5939e5b740 10 client.0 _ll_register_callbacks cb 0x7f5924003f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:41.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.889+0000 7f5930e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 0x555c3fcc9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.890+0000 7f5930e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 0x555c3fcc9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37780/0 (socket says 172.21.15.42:37780) 2024-09-17T01:35:41.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.890+0000 7f5930e00640 1 -- 172.21.15.42:0/1295834665 learned_addr learned my addr 172.21.15.42:0/1295834665 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:41.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.890+0000 7f592be00640 1 --2- 172.21.15.42:0/1295834665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c3f8bb7d0 0x555c3fd4f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.890+0000 7f5923e00640 1 --2- 172.21.15.42:0/1295834665 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555c3f8c39b0 0x555c3fcf3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.890+0000 7f5930e00640 1 -- 172.21.15.42:0/1295834665 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555c3f8c39b0 msgr2=0x555c3fcf3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:41.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.890+0000 7f5930e00640 1 --2- 172.21.15.42:0/1295834665 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555c3f8c39b0 0x555c3fcf3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.890+0000 7f5930e00640 1 -- 172.21.15.42:0/1295834665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c3f8bb7d0 msgr2=0x555c3fd4f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:41.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.890+0000 7f5930e00640 1 --2- 172.21.15.42:0/1295834665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c3f8bb7d0 0x555c3fd4f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.890+0000 7f5930e00640 1 -- 172.21.15.42:0/1295834665 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c3fc86090 con 0x555c3f8e4690 2024-09-17T01:35:41.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.890+0000 7f592be00640 1 --2- 172.21.15.42:0/1295834665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c3f8bb7d0 0x555c3fd4f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:41.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.890+0000 7f5930e00640 1 --2- 172.21.15.42:0/1295834665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 0x555c3fcc9b60 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5924002230 tx=0x7f5924031a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959baac96766dfc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:41.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.890+0000 7f5919600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:41.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.891+0000 7f5919600640 1 -- 172.21.15.42:0/1295834665 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592401b470 con 0x555c3f8e4690 2024-09-17T01:35:41.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.891+0000 7f5919600640 1 -- 172.21.15.42:0/1295834665 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f5924031dc0 con 0x555c3f8e4690 2024-09-17T01:35:41.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.891+0000 7f5939e5b740 1 -- 172.21.15.42:0/1295834665 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5924016070 con 0x555c3f8e4690 2024-09-17T01:35:41.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.891+0000 7f5919600640 1 -- 172.21.15.42:0/1295834665 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f592403b460 con 0x555c3f8e4690 2024-09-17T01:35:41.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.891+0000 7f5939e5b740 10 client.5832 fetch_fsmap learned FSMap version 29 2024-09-17T01:35:41.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.891+0000 7f5939e5b740 1 -- 172.21.15.42:0/1295834665 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x555c3fcf44c0 con 0x555c3f8e4690 2024-09-17T01:35:41.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.891+0000 7f5919600640 1 -- 172.21.15.42:0/1295834665 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5924016070 con 0x555c3f8e4690 2024-09-17T01:35:41.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.891+0000 7f5919600640 1 -- 172.21.15.42:0/1295834665 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f5924026070 con 0x555c3f8e4690 2024-09-17T01:35:41.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.891+0000 7f5939e5b740 10 client.5832 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T01:35:41.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.891+0000 7f5939e5b740 10 client.5832 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:41.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.891+0000 7f5939e5b740 20 client.5832 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:41.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.891+0000 7f5939e5b740 1 --2- 172.21.15.42:0/1295834665 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x555c3fc8c6a0 0x555c3fcca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:41.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.891+0000 7f5939e5b740 4 client.5832 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-17T01:35:41.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.891+0000 7f5939e5b740 1 -- 172.21.15.42:0/1295834665 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x555c3fbfc430 con 0x555c3fc8c6a0 2024-09-17T01:35:41.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.892+0000 7f592be00640 1 --2- 172.21.15.42:0/1295834665 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x555c3fc8c6a0 0x555c3fcca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:41.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.892+0000 7f592be00640 1 --2- 172.21.15.42:0/1295834665 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x555c3fc8c6a0 0x555c3fcca0a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe5fc3d608e93691 server_cookie=2e2eb1e0be85ff10 in_seq=0 out_seq=0 2024-09-17T01:35:41.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.892+0000 7f5919600640 10 client.5832 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:41.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.893+0000 7f5919600640 1 -- 172.21.15.42:0/1295834665 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555c3fbfc430 con 0x555c3fc8c6a0 2024-09-17T01:35:41.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.893+0000 7f5919600640 10 client.5832 handle_command_reply: tid=0 2024-09-17T01:35:41.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.893+0000 7f5939e5b740 1 client.5832 shutdown 2024-09-17T01:35:41.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.893+0000 7f5939e5b740 1 -- 172.21.15.42:0/1295834665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 msgr2=0x555c3fcc9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.893+0000 7f5939e5b740 1 --2- 172.21.15.42:0/1295834665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 0x555c3fcc9b60 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5924002230 tx=0x7f5924031a40 comp rx=0 tx=0).stop 2024-09-17T01:35:41.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.893+0000 7f5939e5b740 1 -- 172.21.15.42:0/1295834665 shutdown_connections 2024-09-17T01:35:41.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.893+0000 7f5939e5b740 1 --2- 172.21.15.42:0/1295834665 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x555c3fc8c6a0 0x555c3fcca0a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.893+0000 7f5939e5b740 1 --2- 172.21.15.42:0/1295834665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c3f8e4690 0x555c3fcc9b60 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.893+0000 7f5939e5b740 1 --2- 172.21.15.42:0/1295834665 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555c3f8c39b0 0x555c3fcf3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.893+0000 7f5939e5b740 1 --2- 172.21.15.42:0/1295834665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555c3f8bb7d0 0x555c3fd4f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.893+0000 7f5939e5b740 1 -- 172.21.15.42:0/1295834665 >> 172.21.15.42:0/1295834665 conn(0x555c3f8d87e0 msgr2=0x555c3fcb6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:41.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.893+0000 7f5919600640 0 client.5832 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:41.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.893+0000 7f5939e5b740 1 -- 172.21.15.42:0/1295834665 shutdown_connections 2024-09-17T01:35:41.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.893+0000 7f5939e5b740 1 -- 172.21.15.42:0/1295834665 wait complete. 2024-09-17T01:35:41.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.893+0000 7f5939e5b740 20 client.5832 trim_cache size 0 max 16384 2024-09-17T01:35:41.896 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:41.896 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-17T01:35:41.896 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "b5862f57-9478-4629-a66e-83eb1b5c23ee", 2024-09-17T01:35:41.896 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-17T01:35:41.896 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:41.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.894+0000 7f5931800640 1 -- 172.21.15.42:0/2570959189 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5908078b90 msgr2=0x7f590807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.894+0000 7f5931800640 1 --2- 172.21.15.42:0/2570959189 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5908078b90 0x7f590807b0a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5914033000 tx=0x7f5914004730 comp rx=0 tx=0).stop 2024-09-17T01:35:41.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.894+0000 7f5931800640 1 -- 172.21.15.42:0/2570959189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f592c06d260 msgr2=0x7f592c15b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:41.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.894+0000 7f5931800640 1 --2- 172.21.15.42:0/2570959189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f592c06d260 0x7f592c15b4e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f591c00c370 tx=0x7f591c00c830 comp rx=0 tx=0).stop 2024-09-17T01:35:41.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.894+0000 7f5931800640 1 -- 172.21.15.42:0/2570959189 shutdown_connections 2024-09-17T01:35:41.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.894+0000 7f5931800640 1 --2- 172.21.15.42:0/2570959189 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5908078b90 0x7f590807b0a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.894+0000 7f5931800640 1 --2- 172.21.15.42:0/2570959189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f592c0cf7c0 0x7f592c0736a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.894+0000 7f5931800640 1 --2- 172.21.15.42:0/2570959189 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f592c0b4be0 0x7f592c15ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.894+0000 7f5931800640 1 --2- 172.21.15.42:0/2570959189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f592c06d260 0x7f592c15b4e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:41.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.894+0000 7f5931800640 1 -- 172.21.15.42:0/2570959189 >> 172.21.15.42:0/2570959189 conn(0x7f592c0b25f0 msgr2=0x7f592c15f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:41.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.894+0000 7f5931800640 1 -- 172.21.15.42:0/2570959189 shutdown_connections 2024-09-17T01:35:41.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:41.894+0000 7f5931800640 1 -- 172.21.15.42:0/2570959189 wait complete. 2024-09-17T01:35:41.914 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': 'b5862f57-9478-4629-a66e-83eb1b5c23ee', 'mode': 'asynchronous'}' 2024-09-17T01:35:41.914 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-17T01:35:41.914 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-17T01:35:42.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.147+0000 7f9708a00640 1 -- 172.21.15.42:0/4239072951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96e8003fd0 msgr2=0x7f96e8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.147+0000 7f9708a00640 1 --2- 172.21.15.42:0/4239072951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96e8003fd0 0x7f96e8004800 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f96ec001eb0 tx=0x7f96e8005830 comp rx=0 tx=0).stop 2024-09-17T01:35:42.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.147+0000 7f9702800640 1 -- 172.21.15.42:0/4239072951 reap_dead start 2024-09-17T01:35:42.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.147+0000 7f9708a00640 1 -- 172.21.15.42:0/4239072951 shutdown_connections 2024-09-17T01:35:42.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.147+0000 7f9708a00640 1 -- 172.21.15.42:0/4239072951 >> 172.21.15.42:0/4239072951 conn(0x7f97040b2930 msgr2=0x7f970406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:42.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.147+0000 7f9708a00640 1 -- 172.21.15.42:0/4239072951 shutdown_connections 2024-09-17T01:35:42.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.147+0000 7f9708a00640 1 -- 172.21.15.42:0/4239072951 wait complete. 2024-09-17T01:35:42.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.149+0000 7f9708a00640 1 Processor -- start 2024-09-17T01:35:42.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.150+0000 7f9708a00640 1 -- start start 2024-09-17T01:35:42.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.151+0000 7f9708a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96e8003fd0 0x7f97041f60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.151+0000 7f9708a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97041f8e00 0x7f97041f9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.151+0000 7f9708a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97040b1190 0x7f97040b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.151+0000 7f9708a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f970415d410 con 0x7f96e8003fd0 2024-09-17T01:35:42.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.151+0000 7f9708a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f970415d290 con 0x7f97040b1190 2024-09-17T01:35:42.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.151+0000 7f9708a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f970415d590 con 0x7f97041f8e00 2024-09-17T01:35:42.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.151+0000 7f9701e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96e8003fd0 0x7f97041f60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.151+0000 7f9701e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96e8003fd0 0x7f97041f60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37794/0 (socket says 172.21.15.42:37794) 2024-09-17T01:35:42.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.151+0000 7f9701e00640 1 -- 172.21.15.42:0/3467167040 learned_addr learned my addr 172.21.15.42:0/3467167040 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:42.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.152+0000 7f9701e00640 1 -- 172.21.15.42:0/3467167040 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97041f8e00 msgr2=0x7f97041f9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.152+0000 7f9701e00640 1 --2- 172.21.15.42:0/3467167040 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97041f8e00 0x7f97041f9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.152+0000 7f9701e00640 1 -- 172.21.15.42:0/3467167040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97040b1190 msgr2=0x7f97040b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.152+0000 7f9701e00640 1 --2- 172.21.15.42:0/3467167040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97040b1190 0x7f97040b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.152+0000 7f9701e00640 1 -- 172.21.15.42:0/3467167040 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97041f65f0 con 0x7f96e8003fd0 2024-09-17T01:35:42.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.152+0000 7f9701e00640 1 --2- 172.21.15.42:0/3467167040 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96e8003fd0 0x7f97041f60b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f96f4011ae0 tx=0x7f96f4009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:42.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.152+0000 7f96fa000640 1 -- 172.21.15.42:0/3467167040 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f401e070 con 0x7f96e8003fd0 2024-09-17T01:35:42.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.152+0000 7f96fa000640 1 -- 172.21.15.42:0/3467167040 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96f4004460 con 0x7f96e8003fd0 2024-09-17T01:35:42.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.152+0000 7f96fa000640 1 -- 172.21.15.42:0/3467167040 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f400fc40 con 0x7f96e8003fd0 2024-09-17T01:35:42.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.152+0000 7f9708a00640 1 -- 172.21.15.42:0/3467167040 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97040aa6a0 con 0x7f96e8003fd0 2024-09-17T01:35:42.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.152+0000 7f9708a00640 1 -- 172.21.15.42:0/3467167040 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f970406e410 con 0x7f96e8003fd0 2024-09-17T01:35:42.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.155+0000 7f96fa000640 1 -- 172.21.15.42:0/3467167040 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f96f4021070 con 0x7f96e8003fd0 2024-09-17T01:35:42.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.156+0000 7f96fa000640 1 --2- 172.21.15.42:0/3467167040 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f96e0078bc0 0x7f96e007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.156+0000 7f96fa000640 1 -- 172.21.15.42:0/3467167040 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f96f409b600 con 0x7f96e8003fd0 2024-09-17T01:35:42.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.156+0000 7f970fbc3740 1 Processor -- start 2024-09-17T01:35:42.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.156+0000 7f96fbe00640 1 --2- 172.21.15.42:0/3467167040 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f96e0078bc0 0x7f96e007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.156+0000 7f970fbc3740 1 -- start start 2024-09-17T01:35:42.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.157+0000 7f96fbe00640 1 --2- 172.21.15.42:0/3467167040 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f96e0078bc0 0x7f96e007b0d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f96ec033000 tx=0x7f970415dd50 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:42.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.157+0000 7f970fbc3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c3563a90 0x55e5c394fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.158+0000 7f970fbc3740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e5c353abd0 0x55e5c3924c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.158+0000 7f970fbc3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5c3542db0 0x55e5c39251c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.158+0000 7f970fbc3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e5c387dd80 con 0x55e5c3563a90 2024-09-17T01:35:42.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.158+0000 7f970fbc3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e5c386d1b0 con 0x55e5c3542db0 2024-09-17T01:35:42.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.158+0000 7f970fbc3740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55e5c3870fc0 con 0x55e5c353abd0 2024-09-17T01:35:42.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.158+0000 7f9701e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c3563a90 0x55e5c394fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.158+0000 7f9701e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c3563a90 0x55e5c394fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37810/0 (socket says 172.21.15.42:37810) 2024-09-17T01:35:42.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.158+0000 7f9701e00640 1 -- 172.21.15.42:0/3143817502 learned_addr learned my addr 172.21.15.42:0/3143817502 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:42.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.158+0000 7f96fbe00640 1 --2- 172.21.15.42:0/3143817502 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e5c353abd0 0x55e5c3924c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.158+0000 7f9702800640 1 --2- 172.21.15.42:0/3143817502 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5c3542db0 0x55e5c39251c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.158+0000 7f9701e00640 1 -- 172.21.15.42:0/3143817502 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e5c353abd0 msgr2=0x55e5c3924c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:42.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.158+0000 7f9701e00640 1 --2- 172.21.15.42:0/3143817502 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e5c353abd0 0x55e5c3924c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.158+0000 7f9701e00640 1 -- 172.21.15.42:0/3143817502 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5c3542db0 msgr2=0x55e5c39251c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:42.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.158+0000 7f9701e00640 1 --2- 172.21.15.42:0/3143817502 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5c3542db0 0x55e5c39251c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.158+0000 7f9701e00640 1 -- 172.21.15.42:0/3143817502 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5c3647f00 con 0x55e5c3563a90 2024-09-17T01:35:42.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.158+0000 7f9701e00640 1 --2- 172.21.15.42:0/3143817502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c3563a90 0x55e5c394fe30 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f96f4099b50 tx=0x7f96f4063050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7008837a3dbf2a6d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:42.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.159+0000 7f96f2600640 1 -- 172.21.15.42:0/3143817502 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f4067f70 con 0x55e5c3563a90 2024-09-17T01:35:42.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.159+0000 7f96f2600640 1 -- 172.21.15.42:0/3143817502 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96f406ce20 con 0x55e5c3563a90 2024-09-17T01:35:42.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.159+0000 7f96f2600640 1 -- 172.21.15.42:0/3143817502 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f4085b40 con 0x55e5c3563a90 2024-09-17T01:35:42.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.159+0000 7f970fbc3740 1 -- 172.21.15.42:0/3143817502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c3563a90 msgr2=0x55e5c394fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.159+0000 7f970fbc3740 1 --2- 172.21.15.42:0/3143817502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c3563a90 0x55e5c394fe30 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f96f4099b50 tx=0x7f96f4063050 comp rx=0 tx=0).stop 2024-09-17T01:35:42.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.159+0000 7f970fbc3740 1 -- 172.21.15.42:0/3143817502 shutdown_connections 2024-09-17T01:35:42.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.160+0000 7f970fbc3740 1 --2- 172.21.15.42:0/3143817502 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5c3542db0 0x55e5c39251c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.160+0000 7f970fbc3740 1 --2- 172.21.15.42:0/3143817502 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e5c353abd0 0x55e5c3924c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.160+0000 7f970fbc3740 1 --2- 172.21.15.42:0/3143817502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c3563a90 0x55e5c394fe30 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.160+0000 7f970fbc3740 1 -- 172.21.15.42:0/3143817502 >> 172.21.15.42:0/3143817502 conn(0x55e5c3557be0 msgr2=0x55e5c390b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:42.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.160+0000 7f970fbc3740 1 -- 172.21.15.42:0/3143817502 shutdown_connections 2024-09-17T01:35:42.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.160+0000 7f970fbc3740 1 -- 172.21.15.42:0/3143817502 wait complete. 2024-09-17T01:35:42.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.161+0000 7f970fbc3740 1 -- start start 2024-09-17T01:35:42.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.161+0000 7f970fbc3740 1 Processor -- start 2024-09-17T01:35:42.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.162+0000 7f970fbc3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c353abd0 0x55e5c3945b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.162+0000 7f970fbc3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5c3542db0 0x55e5c3909a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.162+0000 7f970fbc3740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e5c3563a90 0x55e5c3909f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.162+0000 7f970fbc3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e5c35dde40 con 0x55e5c353abd0 2024-09-17T01:35:42.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.163+0000 7f970fbc3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e5c3812b30 con 0x55e5c3542db0 2024-09-17T01:35:42.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.163+0000 7f970fbc3740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55e5c394a840 con 0x55e5c3563a90 2024-09-17T01:35:42.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.163+0000 7f970fbc3740 10 client.0 _ll_register_callbacks cb 0x55e5c3866640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:42.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.163+0000 7f9701e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c353abd0 0x55e5c3945b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.163+0000 7f9701e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c353abd0 0x55e5c3945b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37816/0 (socket says 172.21.15.42:37816) 2024-09-17T01:35:42.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.163+0000 7f9701e00640 1 -- 172.21.15.42:0/546059043 learned_addr learned my addr 172.21.15.42:0/546059043 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:42.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.163+0000 7f9702800640 1 --2- 172.21.15.42:0/546059043 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e5c3563a90 0x55e5c3909f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.163+0000 7f96fbe00640 1 --2- 172.21.15.42:0/546059043 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5c3542db0 0x55e5c3909a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.163+0000 7f9701e00640 1 -- 172.21.15.42:0/546059043 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e5c3563a90 msgr2=0x55e5c3909f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:42.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.163+0000 7f9701e00640 1 --2- 172.21.15.42:0/546059043 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e5c3563a90 0x55e5c3909f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.163+0000 7f9701e00640 1 -- 172.21.15.42:0/546059043 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5c3542db0 msgr2=0x55e5c3909a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:42.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.163+0000 7f9701e00640 1 --2- 172.21.15.42:0/546059043 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5c3542db0 0x55e5c3909a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.163+0000 7f9701e00640 1 -- 172.21.15.42:0/546059043 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5c35acda0 con 0x55e5c353abd0 2024-09-17T01:35:42.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.164+0000 7f9701e00640 1 --2- 172.21.15.42:0/546059043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c353abd0 0x55e5c3945b50 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f96f405f550 tx=0x7f96f4068060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2119ae43b5d1b85 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:42.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.164+0000 7f96e6a00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:42.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.164+0000 7f96e6a00640 1 -- 172.21.15.42:0/546059043 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f4082060 con 0x55e5c353abd0 2024-09-17T01:35:42.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.164+0000 7f96e6a00640 1 -- 172.21.15.42:0/546059043 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f96f4085b40 con 0x55e5c353abd0 2024-09-17T01:35:42.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.164+0000 7f970fbc3740 1 -- 172.21.15.42:0/546059043 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96f406ce20 con 0x55e5c353abd0 2024-09-17T01:35:42.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.164+0000 7f96e6a00640 1 -- 172.21.15.42:0/546059043 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f96f404e030 con 0x55e5c353abd0 2024-09-17T01:35:42.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.164+0000 7f970fbc3740 10 client.5844 fetch_fsmap learned FSMap version 29 2024-09-17T01:35:42.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.164+0000 7f970fbc3740 1 -- 172.21.15.42:0/546059043 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55e5c36a8690 con 0x55e5c353abd0 2024-09-17T01:35:42.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.164+0000 7f96e6a00640 1 -- 172.21.15.42:0/546059043 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96f406ce20 con 0x55e5c353abd0 2024-09-17T01:35:42.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.164+0000 7f96e6a00640 1 -- 172.21.15.42:0/546059043 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f96f406a180 con 0x55e5c353abd0 2024-09-17T01:35:42.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.164+0000 7f970fbc3740 10 client.5844 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T01:35:42.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.164+0000 7f970fbc3740 10 client.5844 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:42.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.164+0000 7f970fbc3740 20 client.5844 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:42.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.164+0000 7f970fbc3740 1 --2- 172.21.15.42:0/546059043 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55e5c3522660 0x55e5c3963100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.164+0000 7f970fbc3740 4 client.5844 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:42.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.164+0000 7f970fbc3740 1 -- 172.21.15.42:0/546059043 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5c387fcd0 con 0x55e5c3522660 2024-09-17T01:35:42.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.165+0000 7f96fbe00640 1 --2- 172.21.15.42:0/546059043 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55e5c3522660 0x55e5c3963100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.165+0000 7f96fbe00640 1 --2- 172.21.15.42:0/546059043 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55e5c3522660 0x55e5c3963100 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8450ba098ed13b server_cookie=a03014a9687b255a in_seq=0 out_seq=0 2024-09-17T01:35:42.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.165+0000 7f96e6a00640 10 client.5844 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:42.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.166+0000 7f96e6a00640 1 -- 172.21.15.42:0/546059043 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e5c387fcd0 con 0x55e5c3522660 2024-09-17T01:35:42.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.166+0000 7f96e6a00640 10 client.5844 handle_command_reply: tid=0 2024-09-17T01:35:42.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.166+0000 7f970fbc3740 1 client.5844 shutdown 2024-09-17T01:35:42.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.166+0000 7f970fbc3740 1 -- 172.21.15.42:0/546059043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c353abd0 msgr2=0x55e5c3945b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.166+0000 7f970fbc3740 1 --2- 172.21.15.42:0/546059043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c353abd0 0x55e5c3945b50 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f96f405f550 tx=0x7f96f4068060 comp rx=0 tx=0).stop 2024-09-17T01:35:42.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.166+0000 7f970fbc3740 1 -- 172.21.15.42:0/546059043 shutdown_connections 2024-09-17T01:35:42.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.166+0000 7f970fbc3740 1 --2- 172.21.15.42:0/546059043 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55e5c3522660 0x55e5c3963100 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.166+0000 7f970fbc3740 1 --2- 172.21.15.42:0/546059043 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5c3542db0 0x55e5c3909a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.166+0000 7f970fbc3740 1 --2- 172.21.15.42:0/546059043 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e5c3563a90 0x55e5c3909f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.166+0000 7f970fbc3740 1 --2- 172.21.15.42:0/546059043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c353abd0 0x55e5c3945b50 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.166+0000 7f96e6a00640 0 client.5844 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:42.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.166+0000 7f970fbc3740 1 -- 172.21.15.42:0/546059043 >> 172.21.15.42:0/546059043 conn(0x55e5c3557be0 msgr2=0x55e5c39252d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:42.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.167+0000 7f970fbc3740 1 -- 172.21.15.42:0/546059043 shutdown_connections 2024-09-17T01:35:42.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.167+0000 7f970fbc3740 1 -- 172.21.15.42:0/546059043 wait complete. 2024-09-17T01:35:42.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.167+0000 7f970fbc3740 20 client.5844 trim_cache size 0 max 16384 2024-09-17T01:35:42.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.185+0000 7f970fbc3740 1 Processor -- start 2024-09-17T01:35:42.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.186+0000 7f970fbc3740 1 -- start start 2024-09-17T01:35:42.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.187+0000 7f970fbc3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5c353abd0 0x55e5c39725b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.187+0000 7f970fbc3740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e5c3542db0 0x55e5c3969280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.187+0000 7f970fbc3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c3563a90 0x55e5c39697c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.187+0000 7f970fbc3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9704202930 con 0x55e5c3563a90 2024-09-17T01:35:42.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.187+0000 7f970fbc3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9704134230 con 0x55e5c353abd0 2024-09-17T01:35:42.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.187+0000 7f970fbc3740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f970406fc60 con 0x55e5c3542db0 2024-09-17T01:35:42.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.187+0000 7f9702800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c3563a90 0x55e5c39697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.187+0000 7f9702800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c3563a90 0x55e5c39697c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37822/0 (socket says 172.21.15.42:37822) 2024-09-17T01:35:42.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.187+0000 7f9702800640 1 -- 172.21.15.42:0/3317973890 learned_addr learned my addr 172.21.15.42:0/3317973890 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:42.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.187+0000 7f96fbe00640 1 --2- 172.21.15.42:0/3317973890 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e5c3542db0 0x55e5c3969280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.187+0000 7f9701e00640 1 --2- 172.21.15.42:0/3317973890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5c353abd0 0x55e5c39725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.188+0000 7f9702800640 1 -- 172.21.15.42:0/3317973890 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e5c3542db0 msgr2=0x55e5c3969280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:42.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.188+0000 7f9702800640 1 --2- 172.21.15.42:0/3317973890 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e5c3542db0 0x55e5c3969280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.188+0000 7f9702800640 1 -- 172.21.15.42:0/3317973890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5c353abd0 msgr2=0x55e5c39725b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:42.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.188+0000 7f9702800640 1 --2- 172.21.15.42:0/3317973890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5c353abd0 0x55e5c39725b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.188+0000 7f9702800640 1 -- 172.21.15.42:0/3317973890 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5c3646200 con 0x55e5c3563a90 2024-09-17T01:35:42.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.188+0000 7f9702800640 1 --2- 172.21.15.42:0/3317973890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c3563a90 0x55e5c39697c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f96fc005fd0 tx=0x7f96fc003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5cefca5f95c81c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:42.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.188+0000 7f96f1c00640 1 -- 172.21.15.42:0/3317973890 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96fc004560 con 0x55e5c3563a90 2024-09-17T01:35:42.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.188+0000 7f96f1c00640 1 -- 172.21.15.42:0/3317973890 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96fc004700 con 0x55e5c3563a90 2024-09-17T01:35:42.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.188+0000 7f96f1c00640 1 -- 172.21.15.42:0/3317973890 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96fc0116a0 con 0x55e5c3563a90 2024-09-17T01:35:42.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.189+0000 7f970fbc3740 1 -- 172.21.15.42:0/3317973890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c3563a90 msgr2=0x55e5c39697c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.189+0000 7f970fbc3740 1 --2- 172.21.15.42:0/3317973890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c3563a90 0x55e5c39697c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f96fc005fd0 tx=0x7f96fc003eb0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.189+0000 7f970fbc3740 1 -- 172.21.15.42:0/3317973890 shutdown_connections 2024-09-17T01:35:42.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.189+0000 7f970fbc3740 1 --2- 172.21.15.42:0/3317973890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c3563a90 0x55e5c39697c0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.189+0000 7f970fbc3740 1 --2- 172.21.15.42:0/3317973890 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e5c3542db0 0x55e5c3969280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.189+0000 7f970fbc3740 1 --2- 172.21.15.42:0/3317973890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5c353abd0 0x55e5c39725b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.189+0000 7f970fbc3740 1 -- 172.21.15.42:0/3317973890 >> 172.21.15.42:0/3317973890 conn(0x55e5c3557be0 msgr2=0x55e5c3904500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:42.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.189+0000 7f970fbc3740 1 -- 172.21.15.42:0/3317973890 shutdown_connections 2024-09-17T01:35:42.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.189+0000 7f970fbc3740 1 -- 172.21.15.42:0/3317973890 wait complete. 2024-09-17T01:35:42.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.190+0000 7f970fbc3740 1 -- start start 2024-09-17T01:35:42.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.190+0000 7f970fbc3740 1 Processor -- start 2024-09-17T01:35:42.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.192+0000 7f970fbc3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c353abd0 0x55e5c39c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.192+0000 7f970fbc3740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e5c3542db0 0x55e5c3945780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.192+0000 7f970fbc3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5c3563a90 0x55e5c3945cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.192+0000 7f970fbc3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e5c3924140 con 0x55e5c353abd0 2024-09-17T01:35:42.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.192+0000 7f970fbc3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9704133be0 con 0x55e5c3563a90 2024-09-17T01:35:42.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.192+0000 7f970fbc3740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55e5c38734f0 con 0x55e5c3542db0 2024-09-17T01:35:42.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.192+0000 7f970fbc3740 10 client.0 _ll_register_callbacks cb 0x7f96f4088070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:42.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.192+0000 7f9701e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c353abd0 0x55e5c39c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.192+0000 7f9701e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c353abd0 0x55e5c39c8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37834/0 (socket says 172.21.15.42:37834) 2024-09-17T01:35:42.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.192+0000 7f9701e00640 1 -- 172.21.15.42:0/3601216466 learned_addr learned my addr 172.21.15.42:0/3601216466 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:42.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.192+0000 7f9702800640 1 --2- 172.21.15.42:0/3601216466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5c3563a90 0x55e5c3945cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.192+0000 7f96fbe00640 1 --2- 172.21.15.42:0/3601216466 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e5c3542db0 0x55e5c3945780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.193+0000 7f9701e00640 1 -- 172.21.15.42:0/3601216466 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e5c3542db0 msgr2=0x55e5c3945780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:42.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.193+0000 7f9701e00640 1 --2- 172.21.15.42:0/3601216466 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e5c3542db0 0x55e5c3945780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.193+0000 7f9701e00640 1 -- 172.21.15.42:0/3601216466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5c3563a90 msgr2=0x55e5c3945cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:42.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.193+0000 7f9701e00640 1 --2- 172.21.15.42:0/3601216466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5c3563a90 0x55e5c3945cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.193+0000 7f9701e00640 1 -- 172.21.15.42:0/3601216466 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5c39504b0 con 0x55e5c353abd0 2024-09-17T01:35:42.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.193+0000 7f9701e00640 1 --2- 172.21.15.42:0/3601216466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c353abd0 0x55e5c39c8b20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f96f40634d0 tx=0x7f96f405fb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8163d8aa7ebe310d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:42.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.193+0000 7f96e6a00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:42.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.193+0000 7f96e6a00640 1 -- 172.21.15.42:0/3601216466 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f405f090 con 0x55e5c353abd0 2024-09-17T01:35:42.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.193+0000 7f96e6a00640 1 -- 172.21.15.42:0/3601216466 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f96f409b0b0 con 0x55e5c353abd0 2024-09-17T01:35:42.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.193+0000 7f970fbc3740 1 -- 172.21.15.42:0/3601216466 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96fc004700 con 0x55e5c353abd0 2024-09-17T01:35:42.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.193+0000 7f96e6a00640 1 -- 172.21.15.42:0/3601216466 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f96f4085d50 con 0x55e5c353abd0 2024-09-17T01:35:42.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.193+0000 7f970fbc3740 10 client.5850 fetch_fsmap learned FSMap version 29 2024-09-17T01:35:42.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.193+0000 7f970fbc3740 1 -- 172.21.15.42:0/3601216466 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55e5c39ceda0 con 0x55e5c353abd0 2024-09-17T01:35:42.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.194+0000 7f96e6a00640 1 -- 172.21.15.42:0/3601216466 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96fc004700 con 0x55e5c353abd0 2024-09-17T01:35:42.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.194+0000 7f96e6a00640 1 -- 172.21.15.42:0/3601216466 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f96f4091070 con 0x55e5c353abd0 2024-09-17T01:35:42.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.194+0000 7f970fbc3740 10 client.5850 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T01:35:42.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.194+0000 7f970fbc3740 10 client.5850 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:42.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.194+0000 7f970fbc3740 20 client.5850 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:42.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.194+0000 7f970fbc3740 1 --2- 172.21.15.42:0/3601216466 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55e5c3905c00 0x55e5c39d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.194+0000 7f970fbc3740 4 client.5850 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-17T01:35:42.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.194+0000 7f970fbc3740 1 -- 172.21.15.42:0/3601216466 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x55e5c387b780 con 0x55e5c3905c00 2024-09-17T01:35:42.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.194+0000 7f96fbe00640 1 --2- 172.21.15.42:0/3601216466 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55e5c3905c00 0x55e5c39d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.195+0000 7f96e6a00640 10 client.5850 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:42.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.195+0000 7f96fbe00640 1 --2- 172.21.15.42:0/3601216466 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55e5c3905c00 0x55e5c39d26c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=305bb5a4e876a599 server_cookie=b75aaf2fe7defd24 in_seq=0 out_seq=0 2024-09-17T01:35:42.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.196+0000 7f96e6a00640 1 -- 172.21.15.42:0/3601216466 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e5c387b780 con 0x55e5c3905c00 2024-09-17T01:35:42.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.196+0000 7f96e6a00640 10 client.5850 handle_command_reply: tid=0 2024-09-17T01:35:42.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.196+0000 7f970fbc3740 1 client.5850 shutdown 2024-09-17T01:35:42.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.196+0000 7f970fbc3740 1 -- 172.21.15.42:0/3601216466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c353abd0 msgr2=0x55e5c39c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.196+0000 7f970fbc3740 1 --2- 172.21.15.42:0/3601216466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c353abd0 0x55e5c39c8b20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f96f40634d0 tx=0x7f96f405fb90 comp rx=0 tx=0).stop 2024-09-17T01:35:42.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.196+0000 7f970fbc3740 1 -- 172.21.15.42:0/3601216466 shutdown_connections 2024-09-17T01:35:42.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.196+0000 7f970fbc3740 1 --2- 172.21.15.42:0/3601216466 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55e5c3905c00 0x55e5c39d26c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.196+0000 7f970fbc3740 1 --2- 172.21.15.42:0/3601216466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5c3563a90 0x55e5c3945cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.196+0000 7f970fbc3740 1 --2- 172.21.15.42:0/3601216466 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e5c3542db0 0x55e5c3945780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.196+0000 7f970fbc3740 1 --2- 172.21.15.42:0/3601216466 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c353abd0 0x55e5c39c8b20 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.196+0000 7f970fbc3740 1 -- 172.21.15.42:0/3601216466 >> 172.21.15.42:0/3601216466 conn(0x55e5c3557be0 msgr2=0x55e5c39242c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:42.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.196+0000 7f96e6a00640 0 client.5850 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:42.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.196+0000 7f970fbc3740 1 -- 172.21.15.42:0/3601216466 shutdown_connections 2024-09-17T01:35:42.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.196+0000 7f970fbc3740 1 -- 172.21.15.42:0/3601216466 wait complete. 2024-09-17T01:35:42.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.196+0000 7f970fbc3740 20 client.5850 trim_cache size 0 max 16384 2024-09-17T01:35:42.207 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:42.207 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-17T01:35:42.207 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "ffb2ac9a-c36e-4852-9189-6f5c07718d47", 2024-09-17T01:35:42.208 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-17T01:35:42.208 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:42.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.197+0000 7f9708a00640 1 -- 172.21.15.42:0/3467167040 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f96e0078bc0 msgr2=0x7f96e007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.197+0000 7f9708a00640 1 --2- 172.21.15.42:0/3467167040 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f96e0078bc0 0x7f96e007b0d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f96ec033000 tx=0x7f970415dd50 comp rx=0 tx=0).stop 2024-09-17T01:35:42.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.197+0000 7f9708a00640 1 -- 172.21.15.42:0/3467167040 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96e8003fd0 msgr2=0x7f97041f60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.197+0000 7f9708a00640 1 --2- 172.21.15.42:0/3467167040 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96e8003fd0 0x7f97041f60b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f96f4011ae0 tx=0x7f96f4009e90 comp rx=0 tx=0).stop 2024-09-17T01:35:42.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.197+0000 7f9708a00640 1 -- 172.21.15.42:0/3467167040 shutdown_connections 2024-09-17T01:35:42.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.197+0000 7f9708a00640 1 --2- 172.21.15.42:0/3467167040 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f96e0078bc0 0x7f96e007b0d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.197+0000 7f9708a00640 1 --2- 172.21.15.42:0/3467167040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97040b1190 0x7f97040b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.197+0000 7f9708a00640 1 --2- 172.21.15.42:0/3467167040 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97041f8e00 0x7f97041f9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.197+0000 7f9708a00640 1 --2- 172.21.15.42:0/3467167040 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96e8003fd0 0x7f97041f60b0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.197+0000 7f9708a00640 1 -- 172.21.15.42:0/3467167040 >> 172.21.15.42:0/3467167040 conn(0x7f97040b2930 msgr2=0x7f97041425b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:42.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.197+0000 7f9708a00640 1 -- 172.21.15.42:0/3467167040 shutdown_connections 2024-09-17T01:35:42.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.197+0000 7f9708a00640 1 -- 172.21.15.42:0/3467167040 wait complete. 2024-09-17T01:35:42.218 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': 'ffb2ac9a-c36e-4852-9189-6f5c07718d47', 'mode': 'asynchronous'}' 2024-09-17T01:35:42.218 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-09-17T01:35:42.218 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-09-17T01:35:42.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.450+0000 7fefbb200640 1 -- 172.21.15.42:0/3523742497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefbc070fc0 msgr2=0x7fefbc167410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.450+0000 7fefbb200640 1 --2- 172.21.15.42:0/3523742497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefbc070fc0 0x7fefbc167410 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fefb4005fd0 tx=0x7fefb402a820 comp rx=0 tx=0).stop 2024-09-17T01:35:42.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.450+0000 7fefbb200640 1 -- 172.21.15.42:0/3523742497 shutdown_connections 2024-09-17T01:35:42.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.450+0000 7fefbb200640 1 --2- 172.21.15.42:0/3523742497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefbc070fc0 0x7fefbc167410 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.450+0000 7fefbb200640 1 -- 172.21.15.42:0/3523742497 >> 172.21.15.42:0/3523742497 conn(0x7fefbc0d0df0 msgr2=0x7fefbc0d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:42.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.450+0000 7fefbb200640 1 -- 172.21.15.42:0/3523742497 shutdown_connections 2024-09-17T01:35:42.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.450+0000 7fefbb200640 1 -- 172.21.15.42:0/3523742497 wait complete. 2024-09-17T01:35:42.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.452+0000 7fefbb200640 1 Processor -- start 2024-09-17T01:35:42.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.452+0000 7fefbb200640 1 -- start start 2024-09-17T01:35:42.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.454+0000 7fefbb200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fefbc0748d0 0x7fefbc14e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.454+0000 7fefbb200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fefbc0d02c0 0x7fefbc14b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.454+0000 7fefbb200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefbc153de0 0x7fefbc14f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.454+0000 7fefbb200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fefbc167d30 con 0x7fefbc153de0 2024-09-17T01:35:42.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.454+0000 7fefbb200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fefbc167bb0 con 0x7fefbc0d02c0 2024-09-17T01:35:42.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.454+0000 7fefbb200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fefbc167eb0 con 0x7fefbc0748d0 2024-09-17T01:35:42.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.454+0000 7fefba800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefbc153de0 0x7fefbc14f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.454+0000 7fefba800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefbc153de0 0x7fefbc14f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37838/0 (socket says 172.21.15.42:37838) 2024-09-17T01:35:42.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.454+0000 7fefba800640 1 -- 172.21.15.42:0/2575995538 learned_addr learned my addr 172.21.15.42:0/2575995538 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:42.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.454+0000 7fefb9e00640 1 --2- 172.21.15.42:0/2575995538 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fefbc0748d0 0x7fefbc14e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.454+0000 7fefb3e00640 1 --2- 172.21.15.42:0/2575995538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fefbc0d02c0 0x7fefbc14b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.454+0000 7fefba800640 1 -- 172.21.15.42:0/2575995538 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fefbc0748d0 msgr2=0x7fefbc14e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.454+0000 7fefba800640 1 --2- 172.21.15.42:0/2575995538 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fefbc0748d0 0x7fefbc14e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.454+0000 7fefba800640 1 -- 172.21.15.42:0/2575995538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fefbc0d02c0 msgr2=0x7fefbc14b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.454+0000 7fefba800640 1 --2- 172.21.15.42:0/2575995538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fefbc0d02c0 0x7fefbc14b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.454+0000 7fefba800640 1 -- 172.21.15.42:0/2575995538 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefbc15fcb0 con 0x7fefbc153de0 2024-09-17T01:35:42.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.454+0000 7fefb9e00640 1 --2- 172.21.15.42:0/2575995538 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fefbc0748d0 0x7fefbc14e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:42.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.455+0000 7fefba800640 1 --2- 172.21.15.42:0/2575995538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefbc153de0 0x7fefbc14f4f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fefb4009b30 tx=0x7fefb4032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:42.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.455+0000 7fefb2000640 1 -- 172.21.15.42:0/2575995538 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb4037040 con 0x7fefbc153de0 2024-09-17T01:35:42.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.455+0000 7fefb2000640 1 -- 172.21.15.42:0/2575995538 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fefb4042070 con 0x7fefbc153de0 2024-09-17T01:35:42.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.455+0000 7fefb2000640 1 -- 172.21.15.42:0/2575995538 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb40042a0 con 0x7fefbc153de0 2024-09-17T01:35:42.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.455+0000 7fefbb200640 1 -- 172.21.15.42:0/2575995538 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefbc15ff90 con 0x7fefbc153de0 2024-09-17T01:35:42.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.455+0000 7fefbb200640 1 -- 172.21.15.42:0/2575995538 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefbc154220 con 0x7fefbc153de0 2024-09-17T01:35:42.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.458+0000 7fefb2000640 1 -- 172.21.15.42:0/2575995538 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fefb4004440 con 0x7fefbc153de0 2024-09-17T01:35:42.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.459+0000 7fefb2000640 1 --2- 172.21.15.42:0/2575995538 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fef98078b90 0x7fef9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.459+0000 7fefb2000640 1 -- 172.21.15.42:0/2575995538 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fefb40bba90 con 0x7fefbc153de0 2024-09-17T01:35:42.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.460+0000 7fefb9e00640 1 --2- 172.21.15.42:0/2575995538 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fef98078b90 0x7fef9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.460+0000 7fefc829d740 1 Processor -- start 2024-09-17T01:35:42.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.460+0000 7fefc829d740 1 -- start start 2024-09-17T01:35:42.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.461+0000 7fefb9e00640 1 --2- 172.21.15.42:0/2575995538 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fef98078b90 0x7fef9807b0a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fefac0046b0 tx=0x7fefac009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:42.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.461+0000 7fefc829d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc30220 0x5620dd01f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.461+0000 7fefc829d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620dcc07360 0x5620dd001ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.461+0000 7fefc829d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5620dcc0f540 0x5620dd002220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.461+0000 7fefc829d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5620dcf4a850 con 0x5620dcc30220 2024-09-17T01:35:42.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.461+0000 7fefc829d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5620dcf39c80 con 0x5620dcc07360 2024-09-17T01:35:42.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.461+0000 7fefc829d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5620dcf3da90 con 0x5620dcc0f540 2024-09-17T01:35:42.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.462+0000 7fefb9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc30220 0x5620dd01f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.462+0000 7fefb9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc30220 0x5620dd01f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37848/0 (socket says 172.21.15.42:37848) 2024-09-17T01:35:42.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.462+0000 7fefb9e00640 1 -- 172.21.15.42:0/4227439160 learned_addr learned my addr 172.21.15.42:0/4227439160 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:42.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.462+0000 7fefba800640 1 --2- 172.21.15.42:0/4227439160 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5620dcc0f540 0x5620dd002220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.462+0000 7fefb3e00640 1 --2- 172.21.15.42:0/4227439160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620dcc07360 0x5620dd001ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.462+0000 7fefb9e00640 1 -- 172.21.15.42:0/4227439160 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5620dcc0f540 msgr2=0x5620dd002220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:42.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.462+0000 7fefb9e00640 1 --2- 172.21.15.42:0/4227439160 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5620dcc0f540 0x5620dd002220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.462+0000 7fefb9e00640 1 -- 172.21.15.42:0/4227439160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620dcc07360 msgr2=0x5620dd001ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:42.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.462+0000 7fefb9e00640 1 --2- 172.21.15.42:0/4227439160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620dcc07360 0x5620dd001ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.462+0000 7fefb9e00640 1 -- 172.21.15.42:0/4227439160 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620dcc2c280 con 0x5620dcc30220 2024-09-17T01:35:42.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.463+0000 7fefb9e00640 1 --2- 172.21.15.42:0/4227439160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc30220 0x5620dd01f010 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fefac00e7c0 tx=0x7fefac011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e379ceaf18381f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:42.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.463+0000 7fefaaa00640 1 -- 172.21.15.42:0/4227439160 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefac025070 con 0x5620dcc30220 2024-09-17T01:35:42.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.463+0000 7fefaaa00640 1 -- 172.21.15.42:0/4227439160 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fefac0159b0 con 0x5620dcc30220 2024-09-17T01:35:42.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.463+0000 7fefaaa00640 1 -- 172.21.15.42:0/4227439160 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefac015d80 con 0x5620dcc30220 2024-09-17T01:35:42.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.464+0000 7fefc829d740 1 -- 172.21.15.42:0/4227439160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc30220 msgr2=0x5620dd01f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.464+0000 7fefc829d740 1 --2- 172.21.15.42:0/4227439160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc30220 0x5620dd01f010 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fefac00e7c0 tx=0x7fefac011000 comp rx=0 tx=0).stop 2024-09-17T01:35:42.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.464+0000 7fefc829d740 1 -- 172.21.15.42:0/4227439160 shutdown_connections 2024-09-17T01:35:42.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.464+0000 7fefc829d740 1 --2- 172.21.15.42:0/4227439160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620dcc07360 0x5620dd001ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.464+0000 7fefc829d740 1 --2- 172.21.15.42:0/4227439160 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5620dcc0f540 0x5620dd002220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.464+0000 7fefc829d740 1 --2- 172.21.15.42:0/4227439160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc30220 0x5620dd01f010 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.464+0000 7fefc829d740 1 -- 172.21.15.42:0/4227439160 >> 172.21.15.42:0/4227439160 conn(0x5620dcc24370 msgr2=0x5620dcfd7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:42.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.464+0000 7fefc829d740 1 -- 172.21.15.42:0/4227439160 shutdown_connections 2024-09-17T01:35:42.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.464+0000 7fefc829d740 1 -- 172.21.15.42:0/4227439160 wait complete. 2024-09-17T01:35:42.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.465+0000 7fefc829d740 1 -- start start 2024-09-17T01:35:42.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.465+0000 7fefc829d740 1 Processor -- start 2024-09-17T01:35:42.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.467+0000 7fefc829d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5620dcc07360 0x5620dd016010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.467+0000 7fefc829d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620dcc0f540 0x5620dcffa010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.467+0000 7fefc829d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc30220 0x5620dcffa550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.467+0000 7fefc829d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5620dccaa5d0 con 0x5620dcc30220 2024-09-17T01:35:42.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.467+0000 7fefc829d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5620dcedf550 con 0x5620dcc0f540 2024-09-17T01:35:42.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.467+0000 7fefc829d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5620dcffe4e0 con 0x5620dcc07360 2024-09-17T01:35:42.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.467+0000 7fefc829d740 10 client.0 _ll_register_callbacks cb 0x5620dcf33fb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:42.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.467+0000 7fefba800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc30220 0x5620dcffa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.467+0000 7fefba800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc30220 0x5620dcffa550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37862/0 (socket says 172.21.15.42:37862) 2024-09-17T01:35:42.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.467+0000 7fefba800640 1 -- 172.21.15.42:0/467337096 learned_addr learned my addr 172.21.15.42:0/467337096 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:42.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.467+0000 7fefb9e00640 1 --2- 172.21.15.42:0/467337096 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5620dcc07360 0x5620dd016010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.467+0000 7fefb3e00640 1 --2- 172.21.15.42:0/467337096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620dcc0f540 0x5620dcffa010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.467+0000 7fefba800640 1 -- 172.21.15.42:0/467337096 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5620dcc07360 msgr2=0x5620dd016010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:42.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.467+0000 7fefba800640 1 --2- 172.21.15.42:0/467337096 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5620dcc07360 0x5620dd016010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.467+0000 7fefba800640 1 -- 172.21.15.42:0/467337096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620dcc0f540 msgr2=0x5620dcffa010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:42.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.467+0000 7fefba800640 1 --2- 172.21.15.42:0/467337096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620dcc0f540 0x5620dcffa010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.467+0000 7fefba800640 1 -- 172.21.15.42:0/467337096 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620dcd14690 con 0x5620dcc30220 2024-09-17T01:35:42.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.468+0000 7fefba800640 1 --2- 172.21.15.42:0/467337096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc30220 0x5620dcffa550 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fefb4009420 tx=0x7fefb4004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ed7a689e4b9005 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:42.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.468+0000 7fef9f400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:42.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.468+0000 7fef9f400640 1 -- 172.21.15.42:0/467337096 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb4083360 con 0x5620dcc30220 2024-09-17T01:35:42.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.468+0000 7fef9f400640 1 -- 172.21.15.42:0/467337096 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fefb4084b80 con 0x5620dcc30220 2024-09-17T01:35:42.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.468+0000 7fefc829d740 1 -- 172.21.15.42:0/467337096 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefac0159b0 con 0x5620dcc30220 2024-09-17T01:35:42.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.468+0000 7fef9f400640 1 -- 172.21.15.42:0/467337096 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fefb4083f50 con 0x5620dcc30220 2024-09-17T01:35:42.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.468+0000 7fefc829d740 10 client.5865 fetch_fsmap learned FSMap version 29 2024-09-17T01:35:42.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.468+0000 7fefc829d740 1 -- 172.21.15.42:0/467337096 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x5620dcd74e20 con 0x5620dcc30220 2024-09-17T01:35:42.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.469+0000 7fef9f400640 1 -- 172.21.15.42:0/467337096 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fefac0159b0 con 0x5620dcc30220 2024-09-17T01:35:42.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.469+0000 7fef9f400640 1 -- 172.21.15.42:0/467337096 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7fefb403a030 con 0x5620dcc30220 2024-09-17T01:35:42.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.469+0000 7fefc829d740 10 client.5865 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T01:35:42.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.469+0000 7fefc829d740 10 client.5865 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:42.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.469+0000 7fefc829d740 20 client.5865 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:42.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.469+0000 7fefc829d740 1 --2- 172.21.15.42:0/467337096 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5620dcbef000 0x5620dcffd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.469+0000 7fefc829d740 4 client.5865 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:42.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.469+0000 7fefc829d740 1 -- 172.21.15.42:0/467337096 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620dcf4c7a0 con 0x5620dcbef000 2024-09-17T01:35:42.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.469+0000 7fefb9e00640 1 --2- 172.21.15.42:0/467337096 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5620dcbef000 0x5620dcffd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.470+0000 7fefb9e00640 1 --2- 172.21.15.42:0/467337096 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5620dcbef000 0x5620dcffd1a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4153dc1ecc1ec95 server_cookie=69ee890e2f177cf3 in_seq=0 out_seq=0 2024-09-17T01:35:42.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.470+0000 7fef9f400640 10 client.5865 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:42.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.470+0000 7fef9f400640 1 -- 172.21.15.42:0/467337096 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5620dcf4c7a0 con 0x5620dcbef000 2024-09-17T01:35:42.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.470+0000 7fef9f400640 10 client.5865 handle_command_reply: tid=0 2024-09-17T01:35:42.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.470+0000 7fefc829d740 1 client.5865 shutdown 2024-09-17T01:35:42.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.471+0000 7fefc829d740 1 -- 172.21.15.42:0/467337096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc30220 msgr2=0x5620dcffa550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.471+0000 7fefc829d740 1 --2- 172.21.15.42:0/467337096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc30220 0x5620dcffa550 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fefb4009420 tx=0x7fefb4004990 comp rx=0 tx=0).stop 2024-09-17T01:35:42.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.471+0000 7fefc829d740 1 -- 172.21.15.42:0/467337096 shutdown_connections 2024-09-17T01:35:42.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.471+0000 7fefc829d740 1 --2- 172.21.15.42:0/467337096 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5620dcbef000 0x5620dcffd1a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.471+0000 7fefc829d740 1 --2- 172.21.15.42:0/467337096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620dcc0f540 0x5620dcffa010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.471+0000 7fefc829d740 1 --2- 172.21.15.42:0/467337096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc30220 0x5620dcffa550 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.471+0000 7fef9f400640 0 client.5865 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:42.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.471+0000 7fefc829d740 1 --2- 172.21.15.42:0/467337096 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5620dcc07360 0x5620dd016010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.471+0000 7fefc829d740 1 -- 172.21.15.42:0/467337096 >> 172.21.15.42:0/467337096 conn(0x5620dcc24370 msgr2=0x5620dcfd11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:42.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.471+0000 7fefc829d740 1 -- 172.21.15.42:0/467337096 shutdown_connections 2024-09-17T01:35:42.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.471+0000 7fefc829d740 1 -- 172.21.15.42:0/467337096 wait complete. 2024-09-17T01:35:42.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.471+0000 7fefc829d740 20 client.5865 trim_cache size 0 max 16384 2024-09-17T01:35:42.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.490+0000 7fefc829d740 1 Processor -- start 2024-09-17T01:35:42.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.490+0000 7fefc829d740 1 -- start start 2024-09-17T01:35:42.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.491+0000 7fefc829d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc07360 0x5620dd001ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.491+0000 7fefc829d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5620dcc0f540 0x5620dd002220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.491+0000 7fefc829d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620dcc30220 0x5620dd03f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.491+0000 7fefc829d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fefbc2022b0 con 0x5620dcc07360 2024-09-17T01:35:42.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.491+0000 7fefc829d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fefbc201340 con 0x5620dcc30220 2024-09-17T01:35:42.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.491+0000 7fefc829d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fefbc0b09a0 con 0x5620dcc0f540 2024-09-17T01:35:42.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.492+0000 7fefb9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc07360 0x5620dd001ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.492+0000 7fefb9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc07360 0x5620dd001ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37874/0 (socket says 172.21.15.42:37874) 2024-09-17T01:35:42.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.492+0000 7fefb9e00640 1 -- 172.21.15.42:0/946434600 learned_addr learned my addr 172.21.15.42:0/946434600 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:42.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.492+0000 7fefba800640 1 --2- 172.21.15.42:0/946434600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620dcc30220 0x5620dd03f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.492+0000 7fefb3e00640 1 --2- 172.21.15.42:0/946434600 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5620dcc0f540 0x5620dd002220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.492+0000 7fefb9e00640 1 -- 172.21.15.42:0/946434600 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5620dcc0f540 msgr2=0x5620dd002220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:42.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.492+0000 7fefb9e00640 1 --2- 172.21.15.42:0/946434600 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5620dcc0f540 0x5620dd002220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.492+0000 7fefb9e00640 1 -- 172.21.15.42:0/946434600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620dcc30220 msgr2=0x5620dd03f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:42.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.492+0000 7fefb9e00640 1 --2- 172.21.15.42:0/946434600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620dcc30220 0x5620dd03f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.492+0000 7fefb9e00640 1 -- 172.21.15.42:0/946434600 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620dd018440 con 0x5620dcc07360 2024-09-17T01:35:42.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.492+0000 7fefb9e00640 1 --2- 172.21.15.42:0/946434600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc07360 0x5620dd001ce0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fefac00e790 tx=0x7fefac010040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da67d5fbc4873f5d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:42.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.492+0000 7fefaa000640 1 -- 172.21.15.42:0/946434600 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefac038070 con 0x5620dcc07360 2024-09-17T01:35:42.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.493+0000 7fefaa000640 1 -- 172.21.15.42:0/946434600 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fefac02c420 con 0x5620dcc07360 2024-09-17T01:35:42.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.493+0000 7fefaa000640 1 -- 172.21.15.42:0/946434600 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefac025040 con 0x5620dcc07360 2024-09-17T01:35:42.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.493+0000 7fefc829d740 1 -- 172.21.15.42:0/946434600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc07360 msgr2=0x5620dd001ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.493+0000 7fefc829d740 1 --2- 172.21.15.42:0/946434600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc07360 0x5620dd001ce0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fefac00e790 tx=0x7fefac010040 comp rx=0 tx=0).stop 2024-09-17T01:35:42.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.493+0000 7fefc829d740 1 -- 172.21.15.42:0/946434600 shutdown_connections 2024-09-17T01:35:42.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.493+0000 7fefc829d740 1 --2- 172.21.15.42:0/946434600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620dcc30220 0x5620dd03f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.493+0000 7fefc829d740 1 --2- 172.21.15.42:0/946434600 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5620dcc0f540 0x5620dd002220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.493+0000 7fefc829d740 1 --2- 172.21.15.42:0/946434600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc07360 0x5620dd001ce0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.493+0000 7fefc829d740 1 -- 172.21.15.42:0/946434600 >> 172.21.15.42:0/946434600 conn(0x5620dcc24370 msgr2=0x5620dcff9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:42.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.493+0000 7fefc829d740 1 -- 172.21.15.42:0/946434600 shutdown_connections 2024-09-17T01:35:42.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.493+0000 7fefc829d740 1 -- 172.21.15.42:0/946434600 wait complete. 2024-09-17T01:35:42.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.494+0000 7fefc829d740 1 -- start start 2024-09-17T01:35:42.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.494+0000 7fefc829d740 1 Processor -- start 2024-09-17T01:35:42.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.496+0000 7fefc829d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5620dcc07360 0x5620dd001ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.496+0000 7fefc829d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620dcc0f540 0x5620dd002220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.496+0000 7fefc829d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc30220 0x5620dcffaf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.496+0000 7fefc829d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fefbc0b0ff0 con 0x5620dcc30220 2024-09-17T01:35:42.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.496+0000 7fefc829d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5620dcfd9340 con 0x5620dcc0f540 2024-09-17T01:35:42.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.496+0000 7fefc829d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5620dd012240 con 0x5620dcc07360 2024-09-17T01:35:42.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.496+0000 7fefc829d740 10 client.0 _ll_register_callbacks cb 0x7fefb40098d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:42.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.496+0000 7fefba800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc30220 0x5620dcffaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.496+0000 7fefba800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc30220 0x5620dcffaf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37884/0 (socket says 172.21.15.42:37884) 2024-09-17T01:35:42.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.496+0000 7fefba800640 1 -- 172.21.15.42:0/196496438 learned_addr learned my addr 172.21.15.42:0/196496438 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:42.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.497+0000 7fefb3e00640 1 --2- 172.21.15.42:0/196496438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620dcc0f540 0x5620dd002220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.497+0000 7fefb9e00640 1 --2- 172.21.15.42:0/196496438 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5620dcc07360 0x5620dd001ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.497+0000 7fefba800640 1 -- 172.21.15.42:0/196496438 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5620dcc07360 msgr2=0x5620dd001ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:42.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.497+0000 7fefba800640 1 --2- 172.21.15.42:0/196496438 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5620dcc07360 0x5620dd001ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.497+0000 7fefba800640 1 -- 172.21.15.42:0/196496438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620dcc0f540 msgr2=0x5620dd002220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:42.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.497+0000 7fefba800640 1 --2- 172.21.15.42:0/196496438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620dcc0f540 0x5620dd002220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.497+0000 7fefba800640 1 -- 172.21.15.42:0/196496438 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620dd015a00 con 0x5620dcc30220 2024-09-17T01:35:42.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.497+0000 7fefb3e00640 1 --2- 172.21.15.42:0/196496438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620dcc0f540 0x5620dd002220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:42.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.497+0000 7fefb9e00640 1 --2- 172.21.15.42:0/196496438 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5620dcc07360 0x5620dd001ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:42.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.497+0000 7fefba800640 1 --2- 172.21.15.42:0/196496438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc30220 0x5620dcffaf60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fefb40883c0 tx=0x7fefb4083260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ffb625c2218628 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:42.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.497+0000 7fef9f400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:42.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.497+0000 7fef9f400640 1 -- 172.21.15.42:0/196496438 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb40a2060 con 0x5620dcc30220 2024-09-17T01:35:42.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.497+0000 7fef9f400640 1 -- 172.21.15.42:0/196496438 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fefb4082ab0 con 0x5620dcc30220 2024-09-17T01:35:42.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.497+0000 7fefc829d740 1 -- 172.21.15.42:0/196496438 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefac02c420 con 0x5620dcc30220 2024-09-17T01:35:42.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.498+0000 7fef9f400640 1 -- 172.21.15.42:0/196496438 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fefb407f6f0 con 0x5620dcc30220 2024-09-17T01:35:42.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.498+0000 7fefc829d740 10 client.5871 fetch_fsmap learned FSMap version 29 2024-09-17T01:35:42.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.498+0000 7fefc829d740 1 -- 172.21.15.42:0/196496438 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x5620dcc79530 con 0x5620dcc30220 2024-09-17T01:35:42.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.498+0000 7fef9f400640 1 -- 172.21.15.42:0/196496438 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fefac02c420 con 0x5620dcc30220 2024-09-17T01:35:42.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.498+0000 7fef9f400640 1 -- 172.21.15.42:0/196496438 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7fefb407f1a0 con 0x5620dcc30220 2024-09-17T01:35:42.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.498+0000 7fefc829d740 10 client.5871 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T01:35:42.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.498+0000 7fefc829d740 10 client.5871 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:42.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.498+0000 7fefc829d740 20 client.5871 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:42.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.498+0000 7fefc829d740 1 --2- 172.21.15.42:0/196496438 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5620dcffb4a0 0x5620dcffb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.498+0000 7fefc829d740 4 client.5871 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-09-17T01:35:42.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.498+0000 7fefc829d740 1 -- 172.21.15.42:0/196496438 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) -- 0x5620dcf48250 con 0x5620dcffb4a0 2024-09-17T01:35:42.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.498+0000 7fefb9e00640 1 --2- 172.21.15.42:0/196496438 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5620dcffb4a0 0x5620dcffb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.499+0000 7fefb9e00640 1 --2- 172.21.15.42:0/196496438 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5620dcffb4a0 0x5620dcffb8b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9142620cf55f5f4d server_cookie=ca1fadd72320a4f7 in_seq=0 out_seq=0 2024-09-17T01:35:42.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.499+0000 7fef9f400640 10 client.5871 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:42.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.499+0000 7fef9f400640 1 -- 172.21.15.42:0/196496438 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5620dcf48250 con 0x5620dcffb4a0 2024-09-17T01:35:42.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.499+0000 7fef9f400640 10 client.5871 handle_command_reply: tid=0 2024-09-17T01:35:42.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.499+0000 7fefc829d740 1 client.5871 shutdown 2024-09-17T01:35:42.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.499+0000 7fefc829d740 1 -- 172.21.15.42:0/196496438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc30220 msgr2=0x5620dcffaf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.499+0000 7fefc829d740 1 --2- 172.21.15.42:0/196496438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc30220 0x5620dcffaf60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fefb40883c0 tx=0x7fefb4083260 comp rx=0 tx=0).stop 2024-09-17T01:35:42.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.500+0000 7fefc829d740 1 -- 172.21.15.42:0/196496438 shutdown_connections 2024-09-17T01:35:42.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.500+0000 7fefc829d740 1 --2- 172.21.15.42:0/196496438 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5620dcffb4a0 0x5620dcffb8b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.500+0000 7fefc829d740 1 --2- 172.21.15.42:0/196496438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620dcc0f540 0x5620dd002220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.500+0000 7fefc829d740 1 --2- 172.21.15.42:0/196496438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5620dcc30220 0x5620dcffaf60 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.500+0000 7fefc829d740 1 --2- 172.21.15.42:0/196496438 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5620dcc07360 0x5620dd001ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.500+0000 7fefc829d740 1 -- 172.21.15.42:0/196496438 >> 172.21.15.42:0/196496438 conn(0x5620dcc24370 msgr2=0x5620dcff92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:42.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.500+0000 7fef9f400640 0 client.5871 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:42.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.500+0000 7fefc829d740 1 -- 172.21.15.42:0/196496438 shutdown_connections 2024-09-17T01:35:42.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.500+0000 7fefc829d740 1 -- 172.21.15.42:0/196496438 wait complete. 2024-09-17T01:35:42.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.500+0000 7fefc829d740 20 client.5871 trim_cache size 0 max 16384 2024-09-17T01:35:42.502 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:42.503 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-17T01:35:42.503 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "97a36f58-64a4-4cdc-be7b-bf937c7480b0", 2024-09-17T01:35:42.503 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-17T01:35:42.503 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:42.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.501+0000 7fefbb200640 1 -- 172.21.15.42:0/2575995538 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fef98078b90 msgr2=0x7fef9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.501+0000 7fefbb200640 1 --2- 172.21.15.42:0/2575995538 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fef98078b90 0x7fef9807b0a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fefac0046b0 tx=0x7fefac009040 comp rx=0 tx=0).stop 2024-09-17T01:35:42.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.501+0000 7fefbb200640 1 -- 172.21.15.42:0/2575995538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefbc153de0 msgr2=0x7fefbc14f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.501+0000 7fefbb200640 1 --2- 172.21.15.42:0/2575995538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefbc153de0 0x7fefbc14f4f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fefb4009b30 tx=0x7fefb4032c90 comp rx=0 tx=0).stop 2024-09-17T01:35:42.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.501+0000 7fefbb200640 1 -- 172.21.15.42:0/2575995538 shutdown_connections 2024-09-17T01:35:42.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.501+0000 7fefbb200640 1 --2- 172.21.15.42:0/2575995538 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fef98078b90 0x7fef9807b0a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.501+0000 7fefbb200640 1 --2- 172.21.15.42:0/2575995538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fefbc0d02c0 0x7fefbc14b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.501+0000 7fefbb200640 1 --2- 172.21.15.42:0/2575995538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fefbc153de0 0x7fefbc14f4f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.501+0000 7fefbb200640 1 --2- 172.21.15.42:0/2575995538 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fefbc0748d0 0x7fefbc14e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.501+0000 7fefbb200640 1 -- 172.21.15.42:0/2575995538 >> 172.21.15.42:0/2575995538 conn(0x7fefbc0d0df0 msgr2=0x7fefbc0d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:42.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.501+0000 7fefbb200640 1 -- 172.21.15.42:0/2575995538 shutdown_connections 2024-09-17T01:35:42.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.501+0000 7fefbb200640 1 -- 172.21.15.42:0/2575995538 wait complete. 2024-09-17T01:35:42.522 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': '97a36f58-64a4-4cdc-be7b-bf937c7480b0', 'mode': 'asynchronous'}' 2024-09-17T01:35:42.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:35:42.523 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_1) 2024-09-17T01:35:42.560 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' 2024-09-17T01:35:42.561 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_dir_1 2024-09-17T01:35:42.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.832+0000 7f2579400640 1 -- 172.21.15.42:0/4121640887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2558004d40 msgr2=0x7f25580051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.832+0000 7f2579400640 1 --2- 172.21.15.42:0/4121640887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2558004d40 0x7f25580051f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f256c009ed0 tx=0x7f2558005830 comp rx=0 tx=0).stop 2024-09-17T01:35:42.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.832+0000 7f2573200640 1 -- 172.21.15.42:0/4121640887 reap_dead start 2024-09-17T01:35:42.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.832+0000 7f2579400640 1 -- 172.21.15.42:0/4121640887 shutdown_connections 2024-09-17T01:35:42.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.832+0000 7f2579400640 1 -- 172.21.15.42:0/4121640887 >> 172.21.15.42:0/4121640887 conn(0x7f25740b2930 msgr2=0x7f257406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:42.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.833+0000 7f2579400640 1 -- 172.21.15.42:0/4121640887 shutdown_connections 2024-09-17T01:35:42.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.833+0000 7f2579400640 1 -- 172.21.15.42:0/4121640887 wait complete. 2024-09-17T01:35:42.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.835+0000 7f2579400640 1 Processor -- start 2024-09-17T01:35:42.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.835+0000 7f2579400640 1 -- start start 2024-09-17T01:35:42.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.836+0000 7f2579400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2558004d40 0x7f257413aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.836+0000 7f2579400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25741f9f70 0x7f257406f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.836+0000 7f2579400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2574145b30 0x7f257406f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.836+0000 7f2579400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f25740735d0 con 0x7f2574145b30 2024-09-17T01:35:42.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.836+0000 7f2579400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2574073450 con 0x7f25741f9f70 2024-09-17T01:35:42.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.836+0000 7f2579400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2574073750 con 0x7f2558004d40 2024-09-17T01:35:42.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.837+0000 7f2573200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2574145b30 0x7f257406f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.837+0000 7f2573200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2574145b30 0x7f257406f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37900/0 (socket says 172.21.15.42:37900) 2024-09-17T01:35:42.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.837+0000 7f2573200640 1 -- 172.21.15.42:0/2275855292 learned_addr learned my addr 172.21.15.42:0/2275855292 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:42.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.837+0000 7f2572800640 1 --2- 172.21.15.42:0/2275855292 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2558004d40 0x7f257413aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.837+0000 7f2571e00640 1 --2- 172.21.15.42:0/2275855292 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25741f9f70 0x7f257406f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.837+0000 7f2573200640 1 -- 172.21.15.42:0/2275855292 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2558004d40 msgr2=0x7f257413aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.837+0000 7f2573200640 1 --2- 172.21.15.42:0/2275855292 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2558004d40 0x7f257413aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.837+0000 7f2573200640 1 -- 172.21.15.42:0/2275855292 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25741f9f70 msgr2=0x7f257406f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.837+0000 7f2573200640 1 --2- 172.21.15.42:0/2275855292 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25741f9f70 0x7f257406f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.837+0000 7f2573200640 1 -- 172.21.15.42:0/2275855292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f257415f170 con 0x7f2574145b30 2024-09-17T01:35:42.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.837+0000 7f2573200640 1 --2- 172.21.15.42:0/2275855292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2574145b30 0x7f257406f570 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f256c002230 tx=0x7f256c034c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:42.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.838+0000 7f256aa00640 1 -- 172.21.15.42:0/2275855292 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256c043070 con 0x7f2574145b30 2024-09-17T01:35:42.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.838+0000 7f2579400640 1 -- 172.21.15.42:0/2275855292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f257415f410 con 0x7f2574145b30 2024-09-17T01:35:42.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.838+0000 7f256aa00640 1 -- 172.21.15.42:0/2275855292 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f256c034d30 con 0x7f2574145b30 2024-09-17T01:35:42.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.838+0000 7f256aa00640 1 -- 172.21.15.42:0/2275855292 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256c038040 con 0x7f2574145b30 2024-09-17T01:35:42.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.838+0000 7f2579400640 1 -- 172.21.15.42:0/2275855292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25741e65e0 con 0x7f2574145b30 2024-09-17T01:35:42.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.840+0000 7f256aa00640 1 -- 172.21.15.42:0/2275855292 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f256c046070 con 0x7f2574145b30 2024-09-17T01:35:42.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.841+0000 7f256aa00640 1 --2- 172.21.15.42:0/2275855292 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2554078b90 0x7f255407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.841+0000 7f256aa00640 1 -- 172.21.15.42:0/2275855292 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f256c0bafa0 con 0x7f2574145b30 2024-09-17T01:35:42.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.841+0000 7f2580621740 1 Processor -- start 2024-09-17T01:35:42.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.842+0000 7f2580621740 1 -- start start 2024-09-17T01:35:42.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.842+0000 7f2572800640 1 --2- 172.21.15.42:0/2275855292 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2554078b90 0x7f255407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.842+0000 7f2572800640 1 --2- 172.21.15.42:0/2275855292 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2554078b90 0x7f255407b0a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2564000c00 tx=0x7f2564006b70 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:42.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.843+0000 7f2580621740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55997dbc3750 0x55997df8c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.843+0000 7f2580621740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997db9a890 0x55997df8c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.843+0000 7f2580621740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55997dba2a70 0x55997df94ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.843+0000 7f2580621740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55997dedd8d0 con 0x55997db9a890 2024-09-17T01:35:42.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.843+0000 7f2580621740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55997deccd00 con 0x55997dbc3750 2024-09-17T01:35:42.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.843+0000 7f2580621740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55997ded0b10 con 0x55997dba2a70 2024-09-17T01:35:42.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.843+0000 7f2571e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997db9a890 0x55997df8c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.843+0000 7f2571e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997db9a890 0x55997df8c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37916/0 (socket says 172.21.15.42:37916) 2024-09-17T01:35:42.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.843+0000 7f2571e00640 1 -- 172.21.15.42:0/1607244693 learned_addr learned my addr 172.21.15.42:0/1607244693 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:42.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.843+0000 7f2572800640 1 --2- 172.21.15.42:0/1607244693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55997dbc3750 0x55997df8c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.843+0000 7f2573200640 1 --2- 172.21.15.42:0/1607244693 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55997dba2a70 0x55997df94ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.844+0000 7f2571e00640 1 -- 172.21.15.42:0/1607244693 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55997dba2a70 msgr2=0x55997df94ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:42.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.844+0000 7f2571e00640 1 --2- 172.21.15.42:0/1607244693 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55997dba2a70 0x55997df94ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.844+0000 7f2571e00640 1 -- 172.21.15.42:0/1607244693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55997dbc3750 msgr2=0x55997df8c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:42.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.844+0000 7f2571e00640 1 --2- 172.21.15.42:0/1607244693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55997dbc3750 0x55997df8c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.844+0000 7f2571e00640 1 -- 172.21.15.42:0/1607244693 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55997dc2ed30 con 0x55997db9a890 2024-09-17T01:35:42.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.844+0000 7f2573200640 1 --2- 172.21.15.42:0/1607244693 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55997dba2a70 0x55997df94ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:42.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.844+0000 7f2571e00640 1 --2- 172.21.15.42:0/1607244693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997db9a890 0x55997df8c6a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f25600063f0 tx=0x7f2560006c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62185522ced3de5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:42.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.844+0000 7f255f000640 1 -- 172.21.15.42:0/1607244693 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2560006e60 con 0x55997db9a890 2024-09-17T01:35:42.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.844+0000 7f255f000640 1 -- 172.21.15.42:0/1607244693 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2560004cd0 con 0x55997db9a890 2024-09-17T01:35:42.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.844+0000 7f255f000640 1 -- 172.21.15.42:0/1607244693 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25600126a0 con 0x55997db9a890 2024-09-17T01:35:42.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.845+0000 7f2580621740 1 -- 172.21.15.42:0/1607244693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997db9a890 msgr2=0x55997df8c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.845+0000 7f2580621740 1 --2- 172.21.15.42:0/1607244693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997db9a890 0x55997df8c6a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f25600063f0 tx=0x7f2560006c10 comp rx=0 tx=0).stop 2024-09-17T01:35:42.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.845+0000 7f2580621740 1 -- 172.21.15.42:0/1607244693 shutdown_connections 2024-09-17T01:35:42.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.845+0000 7f2580621740 1 --2- 172.21.15.42:0/1607244693 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55997dba2a70 0x55997df94ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.845+0000 7f2580621740 1 --2- 172.21.15.42:0/1607244693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997db9a890 0x55997df8c6a0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.845+0000 7f2580621740 1 --2- 172.21.15.42:0/1607244693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55997dbc3750 0x55997df8c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.845+0000 7f2580621740 1 -- 172.21.15.42:0/1607244693 >> 172.21.15.42:0/1607244693 conn(0x55997dbb78a0 msgr2=0x55997df6adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:42.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.845+0000 7f2580621740 1 -- 172.21.15.42:0/1607244693 shutdown_connections 2024-09-17T01:35:42.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.845+0000 7f2580621740 1 -- 172.21.15.42:0/1607244693 wait complete. 2024-09-17T01:35:42.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.846+0000 7f2580621740 1 -- start start 2024-09-17T01:35:42.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.846+0000 7f2580621740 1 Processor -- start 2024-09-17T01:35:42.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.848+0000 7f2580621740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55997db9a890 0x55997dfabb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.848+0000 7f2580621740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55997dba2a70 0x55997dfaae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.848+0000 7f2580621740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997dbc3750 0x55997df8a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.848+0000 7f2580621740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55997dc3db00 con 0x55997dbc3750 2024-09-17T01:35:42.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.848+0000 7f2580621740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55997de73470 con 0x55997dba2a70 2024-09-17T01:35:42.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.848+0000 7f2580621740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55997dfa72a0 con 0x55997db9a890 2024-09-17T01:35:42.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.848+0000 7f2580621740 10 client.0 _ll_register_callbacks cb 0x55997de786c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:42.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.848+0000 7f2573200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997dbc3750 0x55997df8a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.848+0000 7f2573200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997dbc3750 0x55997df8a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37932/0 (socket says 172.21.15.42:37932) 2024-09-17T01:35:42.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.848+0000 7f2573200640 1 -- 172.21.15.42:0/3268572666 learned_addr learned my addr 172.21.15.42:0/3268572666 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:42.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.848+0000 7f2572800640 1 --2- 172.21.15.42:0/3268572666 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55997db9a890 0x55997dfabb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.848+0000 7f2571e00640 1 --2- 172.21.15.42:0/3268572666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55997dba2a70 0x55997dfaae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.849+0000 7f2573200640 1 -- 172.21.15.42:0/3268572666 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55997db9a890 msgr2=0x55997dfabb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:42.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.849+0000 7f2573200640 1 --2- 172.21.15.42:0/3268572666 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55997db9a890 0x55997dfabb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.849+0000 7f2573200640 1 -- 172.21.15.42:0/3268572666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55997dba2a70 msgr2=0x55997dfaae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:42.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.849+0000 7f2573200640 1 --2- 172.21.15.42:0/3268572666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55997dba2a70 0x55997dfaae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.849+0000 7f2573200640 1 -- 172.21.15.42:0/3268572666 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55997dca5b90 con 0x55997dbc3750 2024-09-17T01:35:42.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.849+0000 7f2571e00640 1 --2- 172.21.15.42:0/3268572666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55997dba2a70 0x55997dfaae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:42.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.849+0000 7f2573200640 1 --2- 172.21.15.42:0/3268572666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997dbc3750 0x55997df8a8d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f256c009e20 tx=0x7f256c08c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1096533b380b92b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:42.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.849+0000 7f2553400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:42.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.849+0000 7f2553400640 1 -- 172.21.15.42:0/3268572666 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256c0824f0 con 0x55997dbc3750 2024-09-17T01:35:42.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.849+0000 7f2553400640 1 -- 172.21.15.42:0/3268572666 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f256c0821f0 con 0x55997dbc3750 2024-09-17T01:35:42.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.849+0000 7f2580621740 1 -- 172.21.15.42:0/3268572666 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2560004cd0 con 0x55997dbc3750 2024-09-17T01:35:42.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.849+0000 7f2553400640 1 -- 172.21.15.42:0/3268572666 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f256c0a4050 con 0x55997dbc3750 2024-09-17T01:35:42.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.849+0000 7f2580621740 10 client.5883 fetch_fsmap learned FSMap version 29 2024-09-17T01:35:42.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.849+0000 7f2580621740 1 -- 172.21.15.42:0/3268572666 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55997df8ae70 con 0x55997dbc3750 2024-09-17T01:35:42.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.850+0000 7f2553400640 1 -- 172.21.15.42:0/3268572666 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2560004cd0 con 0x55997dbc3750 2024-09-17T01:35:42.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.850+0000 7f2553400640 1 -- 172.21.15.42:0/3268572666 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f256c03b050 con 0x55997dbc3750 2024-09-17T01:35:42.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.850+0000 7f2580621740 10 client.5883 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T01:35:42.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.850+0000 7f2580621740 10 client.5883 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:42.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.850+0000 7f2580621740 20 client.5883 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:42.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.850+0000 7f2580621740 1 --2- 172.21.15.42:0/3268572666 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55997db82320 0x55997dfa67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.850+0000 7f2580621740 4 client.5883 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:42.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.850+0000 7f2580621740 1 -- 172.21.15.42:0/3268572666 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55997dedf820 con 0x55997db82320 2024-09-17T01:35:42.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.850+0000 7f2572800640 1 --2- 172.21.15.42:0/3268572666 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55997db82320 0x55997dfa67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.851+0000 7f2572800640 1 --2- 172.21.15.42:0/3268572666 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55997db82320 0x55997dfa67b0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8e9dc817f72bc63 server_cookie=bea7fc1812923957 in_seq=0 out_seq=0 2024-09-17T01:35:42.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.851+0000 7f2553400640 10 client.5883 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:42.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.851+0000 7f2553400640 1 -- 172.21.15.42:0/3268572666 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55997dedf820 con 0x55997db82320 2024-09-17T01:35:42.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.851+0000 7f2553400640 10 client.5883 handle_command_reply: tid=0 2024-09-17T01:35:42.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.851+0000 7f2580621740 1 client.5883 shutdown 2024-09-17T01:35:42.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.852+0000 7f2580621740 1 -- 172.21.15.42:0/3268572666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997dbc3750 msgr2=0x55997df8a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.852+0000 7f2580621740 1 --2- 172.21.15.42:0/3268572666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997dbc3750 0x55997df8a8d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f256c009e20 tx=0x7f256c08c450 comp rx=0 tx=0).stop 2024-09-17T01:35:42.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.852+0000 7f2580621740 1 -- 172.21.15.42:0/3268572666 shutdown_connections 2024-09-17T01:35:42.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.852+0000 7f2580621740 1 --2- 172.21.15.42:0/3268572666 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55997db82320 0x55997dfa67b0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.852+0000 7f2580621740 1 --2- 172.21.15.42:0/3268572666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55997dba2a70 0x55997dfaae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.852+0000 7f2580621740 1 --2- 172.21.15.42:0/3268572666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997dbc3750 0x55997df8a8d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.852+0000 7f2580621740 1 --2- 172.21.15.42:0/3268572666 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55997db9a890 0x55997dfabb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.852+0000 7f2553400640 0 client.5883 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:42.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.852+0000 7f2580621740 1 -- 172.21.15.42:0/3268572666 >> 172.21.15.42:0/3268572666 conn(0x55997dbb78a0 msgr2=0x55997df92440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:42.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.852+0000 7f2580621740 1 -- 172.21.15.42:0/3268572666 shutdown_connections 2024-09-17T01:35:42.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.852+0000 7f2580621740 1 -- 172.21.15.42:0/3268572666 wait complete. 2024-09-17T01:35:42.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.852+0000 7f2580621740 20 client.5883 trim_cache size 0 max 16384 2024-09-17T01:35:42.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.868+0000 7f2580621740 1 Processor -- start 2024-09-17T01:35:42.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.868+0000 7f2580621740 1 -- start start 2024-09-17T01:35:42.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.870+0000 7f2580621740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55997db9a890 0x55997df6b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.870+0000 7f2580621740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997dba2a70 0x55997df8c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.870+0000 7f2580621740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55997dbc3750 0x55997df6bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.870+0000 7f2580621740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55997dfa8800 con 0x55997dba2a70 2024-09-17T01:35:42.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.870+0000 7f2580621740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f25742029f0 con 0x55997dbc3750 2024-09-17T01:35:42.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.870+0000 7f2580621740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2574201a10 con 0x55997db9a890 2024-09-17T01:35:42.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.870+0000 7f2571e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997dba2a70 0x55997df8c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.870+0000 7f2572800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55997db9a890 0x55997df6b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.870+0000 7f2571e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997dba2a70 0x55997df8c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37944/0 (socket says 172.21.15.42:37944) 2024-09-17T01:35:42.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.870+0000 7f2571e00640 1 -- 172.21.15.42:0/2034627331 learned_addr learned my addr 172.21.15.42:0/2034627331 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:42.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.870+0000 7f2573200640 1 --2- 172.21.15.42:0/2034627331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55997dbc3750 0x55997df6bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.870+0000 7f2571e00640 1 -- 172.21.15.42:0/2034627331 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55997db9a890 msgr2=0x55997df6b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:42.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.870+0000 7f2571e00640 1 --2- 172.21.15.42:0/2034627331 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55997db9a890 0x55997df6b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.870+0000 7f2571e00640 1 -- 172.21.15.42:0/2034627331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55997dbc3750 msgr2=0x55997df6bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:42.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.870+0000 7f2571e00640 1 --2- 172.21.15.42:0/2034627331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55997dbc3750 0x55997df6bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.870+0000 7f2571e00640 1 -- 172.21.15.42:0/2034627331 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55997df957d0 con 0x55997dba2a70 2024-09-17T01:35:42.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.871+0000 7f2571e00640 1 --2- 172.21.15.42:0/2034627331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997dba2a70 0x55997df8c3d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f25600061d0 tx=0x7f25740ce960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2d576f04dad8a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:42.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.871+0000 7f255e600640 1 -- 172.21.15.42:0/2034627331 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2560004cd0 con 0x55997dba2a70 2024-09-17T01:35:42.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.871+0000 7f255e600640 1 -- 172.21.15.42:0/2034627331 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2560012440 con 0x55997dba2a70 2024-09-17T01:35:42.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.871+0000 7f255e600640 1 -- 172.21.15.42:0/2034627331 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2560012890 con 0x55997dba2a70 2024-09-17T01:35:42.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.872+0000 7f2580621740 1 -- 172.21.15.42:0/2034627331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997dba2a70 msgr2=0x55997df8c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.872+0000 7f2580621740 1 --2- 172.21.15.42:0/2034627331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997dba2a70 0x55997df8c3d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f25600061d0 tx=0x7f25740ce960 comp rx=0 tx=0).stop 2024-09-17T01:35:42.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.872+0000 7f2580621740 1 -- 172.21.15.42:0/2034627331 shutdown_connections 2024-09-17T01:35:42.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.872+0000 7f2580621740 1 --2- 172.21.15.42:0/2034627331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55997dbc3750 0x55997df6bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.872+0000 7f2580621740 1 --2- 172.21.15.42:0/2034627331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997dba2a70 0x55997df8c3d0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.872+0000 7f2580621740 1 --2- 172.21.15.42:0/2034627331 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55997db9a890 0x55997df6b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.872+0000 7f2580621740 1 -- 172.21.15.42:0/2034627331 >> 172.21.15.42:0/2034627331 conn(0x55997dbb78a0 msgr2=0x55997dfa9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:42.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.872+0000 7f2580621740 1 -- 172.21.15.42:0/2034627331 shutdown_connections 2024-09-17T01:35:42.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.872+0000 7f2580621740 1 -- 172.21.15.42:0/2034627331 wait complete. 2024-09-17T01:35:42.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.873+0000 7f2580621740 1 -- start start 2024-09-17T01:35:42.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.873+0000 7f2580621740 1 Processor -- start 2024-09-17T01:35:42.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.875+0000 7f2580621740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997db9a890 0x55997df66440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.875+0000 7f2580621740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55997dba2a70 0x55997df98380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.875+0000 7f2580621740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55997dbc3750 0x55997df6bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.875+0000 7f2580621740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f25741e7a80 con 0x55997db9a890 2024-09-17T01:35:42.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.875+0000 7f2580621740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f25741e7460 con 0x55997dbc3750 2024-09-17T01:35:42.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.875+0000 7f2580621740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55997df669b0 con 0x55997dba2a70 2024-09-17T01:35:42.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.875+0000 7f2580621740 10 client.0 _ll_register_callbacks cb 0x7f256c07eb90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:42.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.875+0000 7f2572800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997db9a890 0x55997df66440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.875+0000 7f2572800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997db9a890 0x55997df66440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37946/0 (socket says 172.21.15.42:37946) 2024-09-17T01:35:42.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.875+0000 7f2572800640 1 -- 172.21.15.42:0/2088412465 learned_addr learned my addr 172.21.15.42:0/2088412465 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:42.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.875+0000 7f2573200640 1 --2- 172.21.15.42:0/2088412465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55997dbc3750 0x55997df6bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.875+0000 7f2571e00640 1 --2- 172.21.15.42:0/2088412465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55997dba2a70 0x55997df98380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.875+0000 7f2572800640 1 -- 172.21.15.42:0/2088412465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55997dba2a70 msgr2=0x55997df98380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:42.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.875+0000 7f2572800640 1 --2- 172.21.15.42:0/2088412465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55997dba2a70 0x55997df98380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.875+0000 7f2572800640 1 -- 172.21.15.42:0/2088412465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55997dbc3750 msgr2=0x55997df6bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:42.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.875+0000 7f2572800640 1 --2- 172.21.15.42:0/2088412465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55997dbc3750 0x55997df6bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.875+0000 7f2572800640 1 -- 172.21.15.42:0/2088412465 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55997e034020 con 0x55997db9a890 2024-09-17T01:35:42.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.875+0000 7f2571e00640 1 --2- 172.21.15.42:0/2088412465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55997dba2a70 0x55997df98380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:42.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.876+0000 7f2572800640 1 --2- 172.21.15.42:0/2088412465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997db9a890 0x55997df66440 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x55997dfa6ee0 tx=0x7f2564001190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644a072bdf130430 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:42.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.876+0000 7f2553400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:42.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.876+0000 7f2553400640 1 -- 172.21.15.42:0/2088412465 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2564037060 con 0x55997db9a890 2024-09-17T01:35:42.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.876+0000 7f2553400640 1 -- 172.21.15.42:0/2088412465 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f2564032b20 con 0x55997db9a890 2024-09-17T01:35:42.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.876+0000 7f2580621740 1 -- 172.21.15.42:0/2088412465 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2560012440 con 0x55997db9a890 2024-09-17T01:35:42.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.876+0000 7f2553400640 1 -- 172.21.15.42:0/2088412465 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2564032d20 con 0x55997db9a890 2024-09-17T01:35:42.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.876+0000 7f2580621740 10 client.5889 fetch_fsmap learned FSMap version 29 2024-09-17T01:35:42.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.876+0000 7f2580621740 1 -- 172.21.15.42:0/2088412465 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55997df970a0 con 0x55997db9a890 2024-09-17T01:35:42.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.876+0000 7f2553400640 1 -- 172.21.15.42:0/2088412465 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2560012440 con 0x55997db9a890 2024-09-17T01:35:42.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.876+0000 7f2553400640 1 -- 172.21.15.42:0/2088412465 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f256401eae0 con 0x55997db9a890 2024-09-17T01:35:42.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.877+0000 7f2580621740 10 client.5889 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T01:35:42.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.877+0000 7f2580621740 10 client.5889 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:42.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.877+0000 7f2580621740 20 client.5889 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:42.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.877+0000 7f2580621740 1 --2- 172.21.15.42:0/2088412465 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55997df6c100 0x55997e0182c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.877+0000 7f2580621740 4 client.5889 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_1"}] 2024-09-17T01:35:42.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.877+0000 7f2580621740 1 -- 172.21.15.42:0/2088412465 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_1"}) -- 0x55997dedb2d0 con 0x55997df6c100 2024-09-17T01:35:42.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.877+0000 7f2571e00640 1 --2- 172.21.15.42:0/2088412465 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55997df6c100 0x55997e0182c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.877+0000 7f2571e00640 1 --2- 172.21.15.42:0/2088412465 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55997df6c100 0x55997e0182c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35a334990518398b server_cookie=f236ecd71f1645bc in_seq=0 out_seq=0 2024-09-17T01:35:42.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.877+0000 7f2553400640 10 client.5889 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:42.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.884+0000 7f2553400640 1 -- 172.21.15.42:0/2088412465 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55997dedb2d0 con 0x55997df6c100 2024-09-17T01:35:42.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.884+0000 7f2553400640 10 client.5889 handle_command_reply: tid=0 2024-09-17T01:35:42.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.884+0000 7f2580621740 1 client.5889 shutdown 2024-09-17T01:35:42.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.884+0000 7f2580621740 1 -- 172.21.15.42:0/2088412465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997db9a890 msgr2=0x55997df66440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.884+0000 7f2580621740 1 --2- 172.21.15.42:0/2088412465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997db9a890 0x55997df66440 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x55997dfa6ee0 tx=0x7f2564001190 comp rx=0 tx=0).stop 2024-09-17T01:35:42.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.884+0000 7f2580621740 1 -- 172.21.15.42:0/2088412465 shutdown_connections 2024-09-17T01:35:42.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.884+0000 7f2580621740 1 --2- 172.21.15.42:0/2088412465 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x55997df6c100 0x55997e0182c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.884+0000 7f2580621740 1 --2- 172.21.15.42:0/2088412465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55997dbc3750 0x55997df6bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.884+0000 7f2580621740 1 --2- 172.21.15.42:0/2088412465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55997dba2a70 0x55997df98380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.884+0000 7f2580621740 1 --2- 172.21.15.42:0/2088412465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55997db9a890 0x55997df66440 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.884+0000 7f2553400640 0 client.5889 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:42.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.884+0000 7f2580621740 1 -- 172.21.15.42:0/2088412465 >> 172.21.15.42:0/2088412465 conn(0x55997dbb78a0 msgr2=0x55997df6b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:42.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.884+0000 7f2580621740 1 -- 172.21.15.42:0/2088412465 shutdown_connections 2024-09-17T01:35:42.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.884+0000 7f2580621740 1 -- 172.21.15.42:0/2088412465 wait complete. 2024-09-17T01:35:42.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.884+0000 7f2580621740 20 client.5889 trim_cache size 0 max 16384 2024-09-17T01:35:42.884 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:42.885 INFO:teuthology.orchestra.run.smithi042.stdout: "message": "", 2024-09-17T01:35:42.885 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0 2024-09-17T01:35:42.885 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:42.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.885+0000 7f2579400640 1 -- 172.21.15.42:0/2275855292 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2554078b90 msgr2=0x7f255407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.885+0000 7f2579400640 1 --2- 172.21.15.42:0/2275855292 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2554078b90 0x7f255407b0a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2564000c00 tx=0x7f2564006b70 comp rx=0 tx=0).stop 2024-09-17T01:35:42.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.885+0000 7f2579400640 1 -- 172.21.15.42:0/2275855292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2574145b30 msgr2=0x7f257406f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.885+0000 7f2579400640 1 --2- 172.21.15.42:0/2275855292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2574145b30 0x7f257406f570 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f256c002230 tx=0x7f256c034c40 comp rx=0 tx=0).stop 2024-09-17T01:35:42.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.885+0000 7f2579400640 1 -- 172.21.15.42:0/2275855292 shutdown_connections 2024-09-17T01:35:42.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.885+0000 7f2579400640 1 --2- 172.21.15.42:0/2275855292 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2554078b90 0x7f255407b0a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.885+0000 7f2579400640 1 --2- 172.21.15.42:0/2275855292 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25741f9f70 0x7f257406f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.885+0000 7f2579400640 1 --2- 172.21.15.42:0/2275855292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2574145b30 0x7f257406f570 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.885+0000 7f2579400640 1 --2- 172.21.15.42:0/2275855292 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2558004d40 0x7f257413aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.885+0000 7f2579400640 1 -- 172.21.15.42:0/2275855292 >> 172.21.15.42:0/2275855292 conn(0x7f25740b2930 msgr2=0x7f2574160350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:42.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.885+0000 7f2579400640 1 -- 172.21.15.42:0/2275855292 shutdown_connections 2024-09-17T01:35:42.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:42.885+0000 7f2579400640 1 -- 172.21.15.42:0/2275855292 wait complete. 2024-09-17T01:35:42.905 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' returned '{'message': '', 'return_code': 0}' 2024-09-17T01:35:42.905 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:35:42.906 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:35:42.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:35:42.941 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T01:35:43.034 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:35:43.034 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:35:43.034 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017063 s, 61.5 MB/s 2024-09-17T01:35:43.035 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' 2024-09-17T01:35:43.036 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_file_1 2024-09-17T01:35:43.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.266+0000 7f1efe400640 1 -- 172.21.15.42:0/654461575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ef8142f40 msgr2=0x7f1ef8072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:43.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.266+0000 7f1efe400640 1 --2- 172.21.15.42:0/654461575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ef8142f40 0x7f1ef8072950 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0009830 tx=0x7f1ee002a480 comp rx=0 tx=0).stop 2024-09-17T01:35:43.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.266+0000 7f1efe400640 1 -- 172.21.15.42:0/654461575 shutdown_connections 2024-09-17T01:35:43.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.266+0000 7f1efe400640 1 --2- 172.21.15.42:0/654461575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ef8142f40 0x7f1ef8072950 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.266+0000 7f1efe400640 1 --2- 172.21.15.42:0/654461575 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ef80b3550 0x7f1ef815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.266+0000 7f1efe400640 1 -- 172.21.15.42:0/654461575 >> 172.21.15.42:0/654461575 conn(0x7f1ef80b2930 msgr2=0x7f1ef806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:43.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.266+0000 7f1efe400640 1 -- 172.21.15.42:0/654461575 shutdown_connections 2024-09-17T01:35:43.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.267+0000 7f1efe400640 1 -- 172.21.15.42:0/654461575 wait complete. 2024-09-17T01:35:43.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.269+0000 7f1efe400640 1 Processor -- start 2024-09-17T01:35:43.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.269+0000 7f1efe400640 1 -- start start 2024-09-17T01:35:43.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.270+0000 7f1efe400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ef8072e90 0x7f1ef8159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.270+0000 7f1efe400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ef80b3550 0x7f1ef81f4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.270+0000 7f1efe400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ef8142f40 0x7f1ef81f5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.270+0000 7f1efe400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef806d7c0 con 0x7f1ef8072e90 2024-09-17T01:35:43.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.270+0000 7f1efe400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef806d640 con 0x7f1ef8142f40 2024-09-17T01:35:43.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.270+0000 7f1efe400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef806d940 con 0x7f1ef80b3550 2024-09-17T01:35:43.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.270+0000 7f1ef7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ef8072e90 0x7f1ef8159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.271+0000 7f1ef7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ef8072e90 0x7f1ef8159da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37952/0 (socket says 172.21.15.42:37952) 2024-09-17T01:35:43.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.271+0000 7f1ef7400640 1 -- 172.21.15.42:0/948534945 learned_addr learned my addr 172.21.15.42:0/948534945 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:43.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.271+0000 7f1eefe00640 1 --2- 172.21.15.42:0/948534945 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ef80b3550 0x7f1ef81f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.271+0000 7f1ef7e00640 1 --2- 172.21.15.42:0/948534945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ef8142f40 0x7f1ef81f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.271+0000 7f1ef7400640 1 -- 172.21.15.42:0/948534945 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ef80b3550 msgr2=0x7f1ef81f4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:43.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.271+0000 7f1ef7400640 1 --2- 172.21.15.42:0/948534945 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ef80b3550 0x7f1ef81f4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.271+0000 7f1ef7400640 1 -- 172.21.15.42:0/948534945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ef8142f40 msgr2=0x7f1ef81f5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:43.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.271+0000 7f1ef7400640 1 --2- 172.21.15.42:0/948534945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ef8142f40 0x7f1ef81f5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.271+0000 7f1ef7400640 1 -- 172.21.15.42:0/948534945 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef81eadd0 con 0x7f1ef8072e90 2024-09-17T01:35:43.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.271+0000 7f1ef7400640 1 --2- 172.21.15.42:0/948534945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ef8072e90 0x7f1ef8159da0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800d740 tx=0x7f1ee800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:43.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.272+0000 7f1eef400640 1 -- 172.21.15.42:0/948534945 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8017070 con 0x7f1ef8072e90 2024-09-17T01:35:43.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.272+0000 7f1eef400640 1 -- 172.21.15.42:0/948534945 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ee8009d20 con 0x7f1ef8072e90 2024-09-17T01:35:43.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.272+0000 7f1eef400640 1 -- 172.21.15.42:0/948534945 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee80106c0 con 0x7f1ef8072e90 2024-09-17T01:35:43.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.272+0000 7f1efe400640 1 -- 172.21.15.42:0/948534945 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ef81e6e80 con 0x7f1ef8072e90 2024-09-17T01:35:43.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.272+0000 7f1efe400640 1 -- 172.21.15.42:0/948534945 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ef81e7440 con 0x7f1ef8072e90 2024-09-17T01:35:43.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.274+0000 7f1eef400640 1 -- 172.21.15.42:0/948534945 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1ee801a070 con 0x7f1ef8072e90 2024-09-17T01:35:43.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.275+0000 7f1eef400640 1 --2- 172.21.15.42:0/948534945 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1ed4078b90 0x7f1ed407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.275+0000 7f1eef400640 1 -- 172.21.15.42:0/948534945 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f1ee809afb0 con 0x7f1ef8072e90 2024-09-17T01:35:43.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.275+0000 7f1eefe00640 1 --2- 172.21.15.42:0/948534945 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1ed4078b90 0x7f1ed407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.276+0000 7f1f055ec740 1 Processor -- start 2024-09-17T01:35:43.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.276+0000 7f1f055ec740 1 -- start start 2024-09-17T01:35:43.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.276+0000 7f1eefe00640 1 --2- 172.21.15.42:0/948534945 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1ed4078b90 0x7f1ed407b0a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0034000 tx=0x7f1ee0004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:43.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.277+0000 7f1f055ec740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f7917b750 0x561f79567900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.277+0000 7f1f055ec740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561f79152890 0x561f7951d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.277+0000 7f1f055ec740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561f7915aa70 0x561f79520e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.277+0000 7f1f055ec740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561f794958d0 con 0x561f7917b750 2024-09-17T01:35:43.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.277+0000 7f1f055ec740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561f79484d00 con 0x561f7915aa70 2024-09-17T01:35:43.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.277+0000 7f1f055ec740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x561f79488b10 con 0x561f79152890 2024-09-17T01:35:43.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.278+0000 7f1ef7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f7917b750 0x561f79567900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.278+0000 7f1ef7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f7917b750 0x561f79567900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37962/0 (socket says 172.21.15.42:37962) 2024-09-17T01:35:43.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.278+0000 7f1ef7400640 1 -- 172.21.15.42:0/481501587 learned_addr learned my addr 172.21.15.42:0/481501587 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:43.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.278+0000 7f1eefe00640 1 --2- 172.21.15.42:0/481501587 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561f79152890 0x561f7951d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.278+0000 7f1ef7e00640 1 --2- 172.21.15.42:0/481501587 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561f7915aa70 0x561f79520e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.278+0000 7f1ef7400640 1 -- 172.21.15.42:0/481501587 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561f79152890 msgr2=0x561f7951d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:43.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.278+0000 7f1ef7400640 1 --2- 172.21.15.42:0/481501587 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561f79152890 0x561f7951d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.278+0000 7f1ef7400640 1 -- 172.21.15.42:0/481501587 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561f7915aa70 msgr2=0x561f79520e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:43.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.278+0000 7f1ef7400640 1 --2- 172.21.15.42:0/481501587 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561f7915aa70 0x561f79520e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.278+0000 7f1ef7400640 1 -- 172.21.15.42:0/481501587 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f791e6d30 con 0x561f7917b750 2024-09-17T01:35:43.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.278+0000 7f1eefe00640 1 --2- 172.21.15.42:0/481501587 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561f79152890 0x561f7951d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:43.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.278+0000 7f1ef7e00640 1 --2- 172.21.15.42:0/481501587 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561f7915aa70 0x561f79520e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:43.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.278+0000 7f1ef7400640 1 --2- 172.21.15.42:0/481501587 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f7917b750 0x561f79567900 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8062be0 tx=0x7f1ee8062760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d3404d7cf99f96 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:43.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.278+0000 7f1ee7e00640 1 -- 172.21.15.42:0/481501587 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8021040 con 0x561f7917b750 2024-09-17T01:35:43.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.278+0000 7f1ee7e00640 1 -- 172.21.15.42:0/481501587 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ee8067730 con 0x561f7917b750 2024-09-17T01:35:43.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.278+0000 7f1ee7e00640 1 -- 172.21.15.42:0/481501587 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee80620f0 con 0x561f7917b750 2024-09-17T01:35:43.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.279+0000 7f1f055ec740 1 -- 172.21.15.42:0/481501587 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f7917b750 msgr2=0x561f79567900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:43.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.279+0000 7f1f055ec740 1 --2- 172.21.15.42:0/481501587 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f7917b750 0x561f79567900 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8062be0 tx=0x7f1ee8062760 comp rx=0 tx=0).stop 2024-09-17T01:35:43.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.279+0000 7f1f055ec740 1 -- 172.21.15.42:0/481501587 shutdown_connections 2024-09-17T01:35:43.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.279+0000 7f1f055ec740 1 --2- 172.21.15.42:0/481501587 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561f7915aa70 0x561f79520e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.279+0000 7f1f055ec740 1 --2- 172.21.15.42:0/481501587 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561f79152890 0x561f7951d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.279+0000 7f1f055ec740 1 --2- 172.21.15.42:0/481501587 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f7917b750 0x561f79567900 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.279+0000 7f1f055ec740 1 -- 172.21.15.42:0/481501587 >> 172.21.15.42:0/481501587 conn(0x561f7916f8a0 msgr2=0x561f79522740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:43.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.279+0000 7f1f055ec740 1 -- 172.21.15.42:0/481501587 shutdown_connections 2024-09-17T01:35:43.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.279+0000 7f1f055ec740 1 -- 172.21.15.42:0/481501587 wait complete. 2024-09-17T01:35:43.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.280+0000 7f1f055ec740 1 -- start start 2024-09-17T01:35:43.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.281+0000 7f1f055ec740 1 Processor -- start 2024-09-17T01:35:43.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.282+0000 7f1f055ec740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f79152890 0x561f7953b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.282+0000 7f1f055ec740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561f7915aa70 0x561f7954d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.282+0000 7f1f055ec740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561f7917b750 0x561f79579e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.282+0000 7f1f055ec740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561f791f5b00 con 0x561f79152890 2024-09-17T01:35:43.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.282+0000 7f1f055ec740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561f7942b470 con 0x561f7915aa70 2024-09-17T01:35:43.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.282+0000 7f1f055ec740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x561f79539330 con 0x561f7917b750 2024-09-17T01:35:43.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.282+0000 7f1f055ec740 10 client.0 _ll_register_callbacks cb 0x561f794306c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:43.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.282+0000 7f1ef7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f79152890 0x561f7953b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.283+0000 7f1ef7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f79152890 0x561f7953b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37970/0 (socket says 172.21.15.42:37970) 2024-09-17T01:35:43.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.283+0000 7f1ef7400640 1 -- 172.21.15.42:0/582707187 learned_addr learned my addr 172.21.15.42:0/582707187 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:43.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.283+0000 7f1eefe00640 1 --2- 172.21.15.42:0/582707187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561f7915aa70 0x561f7954d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.283+0000 7f1ef7e00640 1 --2- 172.21.15.42:0/582707187 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561f7917b750 0x561f79579e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.283+0000 7f1ef7400640 1 -- 172.21.15.42:0/582707187 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561f7917b750 msgr2=0x561f79579e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:43.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.283+0000 7f1ef7400640 1 --2- 172.21.15.42:0/582707187 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561f7917b750 0x561f79579e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.283+0000 7f1ef7400640 1 -- 172.21.15.42:0/582707187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561f7915aa70 msgr2=0x561f7954d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:43.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.283+0000 7f1ef7400640 1 --2- 172.21.15.42:0/582707187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561f7915aa70 0x561f7954d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.283+0000 7f1ef7400640 1 -- 172.21.15.42:0/582707187 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f7925db90 con 0x561f79152890 2024-09-17T01:35:43.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.283+0000 7f1eefe00640 1 --2- 172.21.15.42:0/582707187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561f7915aa70 0x561f7954d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:43.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.283+0000 7f1ef7400640 1 --2- 172.21.15.42:0/582707187 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f79152890 0x561f7953b550 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009610 tx=0x7f1ee80620e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c899305c600aae7e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:43.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.283+0000 7f1ee4c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:43.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.283+0000 7f1ee4c00640 1 -- 172.21.15.42:0/582707187 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8021040 con 0x561f79152890 2024-09-17T01:35:43.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.283+0000 7f1ee4c00640 1 -- 172.21.15.42:0/582707187 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f1ee805eec0 con 0x561f79152890 2024-09-17T01:35:43.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.283+0000 7f1f055ec740 1 -- 172.21.15.42:0/582707187 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ee8067730 con 0x561f79152890 2024-09-17T01:35:43.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.284+0000 7f1ee4c00640 1 -- 172.21.15.42:0/582707187 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1ee800de50 con 0x561f79152890 2024-09-17T01:35:43.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.284+0000 7f1f055ec740 10 client.5904 fetch_fsmap learned FSMap version 29 2024-09-17T01:35:43.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.284+0000 7f1f055ec740 1 -- 172.21.15.42:0/582707187 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x561f7954ac60 con 0x561f79152890 2024-09-17T01:35:43.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.284+0000 7f1ee4c00640 1 -- 172.21.15.42:0/582707187 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ee8067730 con 0x561f79152890 2024-09-17T01:35:43.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.284+0000 7f1ee4c00640 1 -- 172.21.15.42:0/582707187 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f1ee806aab0 con 0x561f79152890 2024-09-17T01:35:43.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.284+0000 7f1f055ec740 10 client.5904 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T01:35:43.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.284+0000 7f1f055ec740 10 client.5904 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:43.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.284+0000 7f1f055ec740 20 client.5904 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:43.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.284+0000 7f1f055ec740 1 --2- 172.21.15.42:0/582707187 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561f7913a320 0x561f7954b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.284+0000 7f1f055ec740 4 client.5904 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:43.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.284+0000 7f1f055ec740 1 -- 172.21.15.42:0/582707187 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f79497820 con 0x561f7913a320 2024-09-17T01:35:43.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.284+0000 7f1eefe00640 1 --2- 172.21.15.42:0/582707187 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561f7913a320 0x561f7954b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.285+0000 7f1eefe00640 1 --2- 172.21.15.42:0/582707187 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561f7913a320 0x561f7954b460 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7cf174e7acca183 server_cookie=b057302516d99bc4 in_seq=0 out_seq=0 2024-09-17T01:35:43.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.285+0000 7f1ee4c00640 10 client.5904 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:43.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.286+0000 7f1ee4c00640 1 -- 172.21.15.42:0/582707187 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561f79497820 con 0x561f7913a320 2024-09-17T01:35:43.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.286+0000 7f1ee4c00640 10 client.5904 handle_command_reply: tid=0 2024-09-17T01:35:43.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.286+0000 7f1f055ec740 1 client.5904 shutdown 2024-09-17T01:35:43.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.286+0000 7f1f055ec740 1 -- 172.21.15.42:0/582707187 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f79152890 msgr2=0x561f7953b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:43.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.286+0000 7f1f055ec740 1 --2- 172.21.15.42:0/582707187 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f79152890 0x561f7953b550 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009610 tx=0x7f1ee80620e0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.286+0000 7f1f055ec740 1 -- 172.21.15.42:0/582707187 shutdown_connections 2024-09-17T01:35:43.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.286+0000 7f1f055ec740 1 --2- 172.21.15.42:0/582707187 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561f7913a320 0x561f7954b460 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.286+0000 7f1f055ec740 1 --2- 172.21.15.42:0/582707187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561f7915aa70 0x561f7954d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.286+0000 7f1f055ec740 1 --2- 172.21.15.42:0/582707187 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561f7917b750 0x561f79579e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.286+0000 7f1ee4c00640 0 client.5904 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:43.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.286+0000 7f1f055ec740 1 --2- 172.21.15.42:0/582707187 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f79152890 0x561f7953b550 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.286+0000 7f1f055ec740 1 -- 172.21.15.42:0/582707187 >> 172.21.15.42:0/582707187 conn(0x561f7916f8a0 msgr2=0x561f79569f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:43.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.286+0000 7f1f055ec740 1 -- 172.21.15.42:0/582707187 shutdown_connections 2024-09-17T01:35:43.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.286+0000 7f1f055ec740 1 -- 172.21.15.42:0/582707187 wait complete. 2024-09-17T01:35:43.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.286+0000 7f1f055ec740 20 client.5904 trim_cache size 0 max 16384 2024-09-17T01:35:43.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.302+0000 7f1f055ec740 1 Processor -- start 2024-09-17T01:35:43.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.302+0000 7f1f055ec740 1 -- start start 2024-09-17T01:35:43.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.304+0000 7f1f055ec740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561f7916f8a0 0x561f7955dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.304+0000 7f1f055ec740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561f79152890 0x561f79537fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.304+0000 7f1f055ec740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f7915aa70 0x561f7951e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.304+0000 7f1f055ec740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef81fffe0 con 0x561f7915aa70 2024-09-17T01:35:43.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.304+0000 7f1f055ec740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef81f4740 con 0x561f79152890 2024-09-17T01:35:43.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.304+0000 7f1f055ec740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef81f3aa0 con 0x561f7916f8a0 2024-09-17T01:35:43.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.304+0000 7f1ef7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f7915aa70 0x561f7951e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.304+0000 7f1ef7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f7915aa70 0x561f7951e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37986/0 (socket says 172.21.15.42:37986) 2024-09-17T01:35:43.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.304+0000 7f1ef7e00640 1 -- 172.21.15.42:0/2721475612 learned_addr learned my addr 172.21.15.42:0/2721475612 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:43.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.304+0000 7f1eefe00640 1 --2- 172.21.15.42:0/2721475612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561f79152890 0x561f79537fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.304+0000 7f1ef7400640 1 --2- 172.21.15.42:0/2721475612 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561f7916f8a0 0x561f7955dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.304+0000 7f1ef7e00640 1 -- 172.21.15.42:0/2721475612 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561f7916f8a0 msgr2=0x561f7955dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:43.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.304+0000 7f1ef7e00640 1 --2- 172.21.15.42:0/2721475612 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561f7916f8a0 0x561f7955dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.304+0000 7f1ef7e00640 1 -- 172.21.15.42:0/2721475612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561f79152890 msgr2=0x561f79537fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:43.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.304+0000 7f1ef7e00640 1 --2- 172.21.15.42:0/2721475612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561f79152890 0x561f79537fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.304+0000 7f1ef7e00640 1 -- 172.21.15.42:0/2721475612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f7953ce00 con 0x561f7915aa70 2024-09-17T01:35:43.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.304+0000 7f1ef7400640 1 --2- 172.21.15.42:0/2721475612 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561f7916f8a0 0x561f7955dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:43.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.305+0000 7f1ef7e00640 1 --2- 172.21.15.42:0/2721475612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f7915aa70 0x561f7951e0c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0005100 tx=0x7f1ef00055c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b31ae3f88a206b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:43.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.305+0000 7f1ee7400640 1 -- 172.21.15.42:0/2721475612 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0005810 con 0x561f7915aa70 2024-09-17T01:35:43.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.305+0000 7f1ee7400640 1 -- 172.21.15.42:0/2721475612 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ef001b070 con 0x561f7915aa70 2024-09-17T01:35:43.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.305+0000 7f1ee7400640 1 -- 172.21.15.42:0/2721475612 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0001e30 con 0x561f7915aa70 2024-09-17T01:35:43.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.306+0000 7f1f055ec740 1 -- 172.21.15.42:0/2721475612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f7915aa70 msgr2=0x561f7951e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:43.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.306+0000 7f1f055ec740 1 --2- 172.21.15.42:0/2721475612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f7915aa70 0x561f7951e0c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0005100 tx=0x7f1ef00055c0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.306+0000 7f1f055ec740 1 -- 172.21.15.42:0/2721475612 shutdown_connections 2024-09-17T01:35:43.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.306+0000 7f1f055ec740 1 --2- 172.21.15.42:0/2721475612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561f79152890 0x561f79537fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.306+0000 7f1f055ec740 1 --2- 172.21.15.42:0/2721475612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f7915aa70 0x561f7951e0c0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.306+0000 7f1f055ec740 1 --2- 172.21.15.42:0/2721475612 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561f7916f8a0 0x561f7955dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.306+0000 7f1f055ec740 1 -- 172.21.15.42:0/2721475612 >> 172.21.15.42:0/2721475612 conn(0x561f7953a9d0 msgr2=0x561f7951d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:43.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.306+0000 7f1f055ec740 1 -- 172.21.15.42:0/2721475612 shutdown_connections 2024-09-17T01:35:43.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.306+0000 7f1f055ec740 1 -- 172.21.15.42:0/2721475612 wait complete. 2024-09-17T01:35:43.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.307+0000 7f1f055ec740 1 -- start start 2024-09-17T01:35:43.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.307+0000 7f1f055ec740 1 Processor -- start 2024-09-17T01:35:43.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.309+0000 7f1f055ec740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f79152890 0x561f795eabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.309+0000 7f1f055ec740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561f7915aa70 0x561f79561d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.309+0000 7f1f055ec740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561f7916f8a0 0x561f79562270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.309+0000 7f1f055ec740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561f79580bd0 con 0x561f79152890 2024-09-17T01:35:43.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.309+0000 7f1f055ec740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef81f40f0 con 0x561f7915aa70 2024-09-17T01:35:43.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.309+0000 7f1f055ec740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x561f79520dd0 con 0x561f7916f8a0 2024-09-17T01:35:43.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.309+0000 7f1f055ec740 10 client.0 _ll_register_callbacks cb 0x561f794306c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:43.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.309+0000 7f1ef7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f79152890 0x561f795eabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.309+0000 7f1ef7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f79152890 0x561f795eabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37998/0 (socket says 172.21.15.42:37998) 2024-09-17T01:35:43.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.309+0000 7f1ef7400640 1 -- 172.21.15.42:0/2351778097 learned_addr learned my addr 172.21.15.42:0/2351778097 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:43.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.309+0000 7f1ef7e00640 1 --2- 172.21.15.42:0/2351778097 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561f7916f8a0 0x561f79562270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.309+0000 7f1eefe00640 1 --2- 172.21.15.42:0/2351778097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561f7915aa70 0x561f79561d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.309+0000 7f1ef7400640 1 -- 172.21.15.42:0/2351778097 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561f7916f8a0 msgr2=0x561f79562270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:43.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.309+0000 7f1ef7400640 1 --2- 172.21.15.42:0/2351778097 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561f7916f8a0 0x561f79562270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.309+0000 7f1ef7400640 1 -- 172.21.15.42:0/2351778097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561f7915aa70 msgr2=0x561f79561d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:43.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.309+0000 7f1ef7400640 1 --2- 172.21.15.42:0/2351778097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561f7915aa70 0x561f79561d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.309+0000 7f1ef7400640 1 -- 172.21.15.42:0/2351778097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f795754a0 con 0x561f79152890 2024-09-17T01:35:43.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.309+0000 7f1ef7e00640 1 --2- 172.21.15.42:0/2351778097 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561f7916f8a0 0x561f79562270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:43.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.310+0000 7f1ef7400640 1 --2- 172.21.15.42:0/2351778097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f79152890 0x561f795eabf0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8062be0 tx=0x7f1ee8009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31613c770844797 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:43.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.310+0000 7f1ee4c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:43.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.310+0000 7f1ee4c00640 1 -- 172.21.15.42:0/2351778097 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8021040 con 0x561f79152890 2024-09-17T01:35:43.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.310+0000 7f1ee4c00640 1 -- 172.21.15.42:0/2351778097 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f1ee805eec0 con 0x561f79152890 2024-09-17T01:35:43.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.310+0000 7f1f055ec740 1 -- 172.21.15.42:0/2351778097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ef001b070 con 0x561f79152890 2024-09-17T01:35:43.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.310+0000 7f1ee4c00640 1 -- 172.21.15.42:0/2351778097 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1ee8067730 con 0x561f79152890 2024-09-17T01:35:43.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.310+0000 7f1f055ec740 10 client.5910 fetch_fsmap learned FSMap version 29 2024-09-17T01:35:43.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.310+0000 7f1f055ec740 1 -- 172.21.15.42:0/2351778097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x561f795754a0 con 0x561f79152890 2024-09-17T01:35:43.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.310+0000 7f1ee4c00640 1 -- 172.21.15.42:0/2351778097 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ef001b070 con 0x561f79152890 2024-09-17T01:35:43.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.310+0000 7f1ee4c00640 1 -- 172.21.15.42:0/2351778097 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f1ee806aab0 con 0x561f79152890 2024-09-17T01:35:43.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.310+0000 7f1f055ec740 10 client.5910 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T01:35:43.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.310+0000 7f1f055ec740 10 client.5910 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:43.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.310+0000 7f1f055ec740 20 client.5910 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:43.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.310+0000 7f1f055ec740 1 --2- 172.21.15.42:0/2351778097 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561f7910f760 0x561f795eeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.311+0000 7f1f055ec740 4 client.5910 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2024-09-17T01:35:43.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.311+0000 7f1f055ec740 1 -- 172.21.15.42:0/2351778097 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) -- 0x561f794932d0 con 0x561f7910f760 2024-09-17T01:35:43.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.311+0000 7f1eefe00640 1 --2- 172.21.15.42:0/2351778097 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561f7910f760 0x561f795eeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.311+0000 7f1eefe00640 1 --2- 172.21.15.42:0/2351778097 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561f7910f760 0x561f795eeb10 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4c0bb8a3fb08a13 server_cookie=e0d0cda0d5984aa2 in_seq=0 out_seq=0 2024-09-17T01:35:43.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.311+0000 7f1ee4c00640 10 client.5910 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:43.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.317+0000 7f1ee4c00640 1 -- 172.21.15.42:0/2351778097 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561f794932d0 con 0x561f7910f760 2024-09-17T01:35:43.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.317+0000 7f1ee4c00640 10 client.5910 handle_command_reply: tid=0 2024-09-17T01:35:43.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.317+0000 7f1f055ec740 1 client.5910 shutdown 2024-09-17T01:35:43.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.317+0000 7f1f055ec740 1 -- 172.21.15.42:0/2351778097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f79152890 msgr2=0x561f795eabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:43.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.317+0000 7f1f055ec740 1 --2- 172.21.15.42:0/2351778097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f79152890 0x561f795eabf0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8062be0 tx=0x7f1ee8009740 comp rx=0 tx=0).stop 2024-09-17T01:35:43.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.317+0000 7f1f055ec740 1 -- 172.21.15.42:0/2351778097 shutdown_connections 2024-09-17T01:35:43.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.317+0000 7f1f055ec740 1 --2- 172.21.15.42:0/2351778097 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x561f7910f760 0x561f795eeb10 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.317+0000 7f1f055ec740 1 --2- 172.21.15.42:0/2351778097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561f7915aa70 0x561f79561d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.317+0000 7f1f055ec740 1 --2- 172.21.15.42:0/2351778097 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561f7916f8a0 0x561f79562270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.317+0000 7f1f055ec740 1 --2- 172.21.15.42:0/2351778097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f79152890 0x561f795eabf0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.317+0000 7f1ee4c00640 0 client.5910 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:43.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.317+0000 7f1f055ec740 1 -- 172.21.15.42:0/2351778097 >> 172.21.15.42:0/2351778097 conn(0x561f7953a9d0 msgr2=0x561f79537fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:43.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.317+0000 7f1f055ec740 1 -- 172.21.15.42:0/2351778097 shutdown_connections 2024-09-17T01:35:43.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.317+0000 7f1f055ec740 1 -- 172.21.15.42:0/2351778097 wait complete. 2024-09-17T01:35:43.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.318+0000 7f1f055ec740 20 client.5910 trim_cache size 0 max 16384 2024-09-17T01:35:43.318 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:43.318 INFO:teuthology.orchestra.run.smithi042.stdout: "message": "", 2024-09-17T01:35:43.318 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0 2024-09-17T01:35:43.318 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:43.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.318+0000 7f1efe400640 1 -- 172.21.15.42:0/948534945 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1ed4078b90 msgr2=0x7f1ed407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:43.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.318+0000 7f1efe400640 1 --2- 172.21.15.42:0/948534945 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1ed4078b90 0x7f1ed407b0a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0034000 tx=0x7f1ee0004730 comp rx=0 tx=0).stop 2024-09-17T01:35:43.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.318+0000 7f1efe400640 1 -- 172.21.15.42:0/948534945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ef8072e90 msgr2=0x7f1ef8159da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:43.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.318+0000 7f1efe400640 1 --2- 172.21.15.42:0/948534945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ef8072e90 0x7f1ef8159da0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800d740 tx=0x7f1ee800dc00 comp rx=0 tx=0).stop 2024-09-17T01:35:43.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.318+0000 7f1efe400640 1 -- 172.21.15.42:0/948534945 shutdown_connections 2024-09-17T01:35:43.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.318+0000 7f1efe400640 1 --2- 172.21.15.42:0/948534945 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1ed4078b90 0x7f1ed407b0a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.318+0000 7f1efe400640 1 --2- 172.21.15.42:0/948534945 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ef8142f40 0x7f1ef81f5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.318+0000 7f1efe400640 1 --2- 172.21.15.42:0/948534945 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1ef80b3550 0x7f1ef81f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.318+0000 7f1efe400640 1 --2- 172.21.15.42:0/948534945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ef8072e90 0x7f1ef8159da0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.318+0000 7f1efe400640 1 -- 172.21.15.42:0/948534945 >> 172.21.15.42:0/948534945 conn(0x7f1ef80b2930 msgr2=0x7f1ef815f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:43.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.318+0000 7f1efe400640 1 -- 172.21.15.42:0/948534945 shutdown_connections 2024-09-17T01:35:43.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.319+0000 7f1efe400640 1 -- 172.21.15.42:0/948534945 wait complete. 2024-09-17T01:35:43.338 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'message': '', 'return_code': 0}' 2024-09-17T01:35:43.338 DEBUG:teuthology.orchestra.run.smithi042:> stdin-killer -- python3 -c ' 2024-09-17T01:35:43.338 DEBUG:teuthology.orchestra.run.smithi042:> import os 2024-09-17T01:35:43.339 DEBUG:teuthology.orchestra.run.smithi042:> import stat 2024-09-17T01:35:43.339 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:35:43.339 DEBUG:teuthology.orchestra.run.smithi042:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1").st_ino) 2024-09-17T01:35:43.339 DEBUG:teuthology.orchestra.run.smithi042:> ' 2024-09-17T01:35:43.439 INFO:teuthology.orchestra.run.smithi042.stdout:1099511630414 2024-09-17T01:35:43.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:35:43.451 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-17T01:35:43.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.725+0000 7fc91fe00640 1 -- 172.21.15.42:0/1544356347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9200d0d20 msgr2=0x7fc9200d1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:43.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.725+0000 7fc91fe00640 1 --2- 172.21.15.42:0/1544356347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9200d0d20 0x7fc9200d1130 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009830 tx=0x7fc90c02a480 comp rx=0 tx=0).stop 2024-09-17T01:35:43.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.726+0000 7fc91fe00640 1 -- 172.21.15.42:0/1544356347 shutdown_connections 2024-09-17T01:35:43.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.726+0000 7fc91fe00640 1 --2- 172.21.15.42:0/1544356347 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc92015ede0 0x7fc92015f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.726+0000 7fc91fe00640 1 --2- 172.21.15.42:0/1544356347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9200d0d20 0x7fc9200d1130 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.726+0000 7fc91fe00640 1 -- 172.21.15.42:0/1544356347 >> 172.21.15.42:0/1544356347 conn(0x7fc92006cd20 msgr2=0x7fc92006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:43.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.726+0000 7fc91fe00640 1 -- 172.21.15.42:0/1544356347 shutdown_connections 2024-09-17T01:35:43.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.726+0000 7fc91fe00640 1 -- 172.21.15.42:0/1544356347 wait complete. 2024-09-17T01:35:43.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.728+0000 7fc91fe00640 1 Processor -- start 2024-09-17T01:35:43.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.728+0000 7fc91fe00640 1 -- start start 2024-09-17T01:35:43.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.729+0000 7fc91fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9200d0d20 0x7fc920159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.729+0000 7fc91fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9200d3e40 0x7fc9201ea790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.729+0000 7fc91fe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc92015ede0 0x7fc9201eacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.729+0000 7fc91fe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc9200d2bd0 con 0x7fc9200d3e40 2024-09-17T01:35:43.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.729+0000 7fc91fe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc9200d2a50 con 0x7fc9200d0d20 2024-09-17T01:35:43.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.729+0000 7fc91fe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc9200d2d50 con 0x7fc92015ede0 2024-09-17T01:35:43.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.730+0000 7fc91e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9200d3e40 0x7fc9201ea790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.730+0000 7fc91e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9200d3e40 0x7fc9201ea790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38002/0 (socket says 172.21.15.42:38002) 2024-09-17T01:35:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.730+0000 7fc91e000640 1 -- 172.21.15.42:0/3490192665 learned_addr learned my addr 172.21.15.42:0/3490192665 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.730+0000 7fc91f400640 1 --2- 172.21.15.42:0/3490192665 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc92015ede0 0x7fc9201eacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.730+0000 7fc91ea00640 1 --2- 172.21.15.42:0/3490192665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9200d0d20 0x7fc920159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.730+0000 7fc91e000640 1 -- 172.21.15.42:0/3490192665 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc92015ede0 msgr2=0x7fc9201eacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.730+0000 7fc91e000640 1 --2- 172.21.15.42:0/3490192665 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc92015ede0 0x7fc9201eacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.730+0000 7fc91e000640 1 -- 172.21.15.42:0/3490192665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9200d0d20 msgr2=0x7fc920159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.730+0000 7fc91e000640 1 --2- 172.21.15.42:0/3490192665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9200d0d20 0x7fc920159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.730+0000 7fc91e000640 1 -- 172.21.15.42:0/3490192665 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9201e99d0 con 0x7fc9200d3e40 2024-09-17T01:35:43.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.731+0000 7fc91e000640 1 --2- 172.21.15.42:0/3490192665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9200d3e40 0x7fc9201ea790 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009950 tx=0x7fc90c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:43.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.731+0000 7fc916a00640 1 -- 172.21.15.42:0/3490192665 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90c005c90 con 0x7fc9200d3e40 2024-09-17T01:35:43.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.731+0000 7fc916a00640 1 -- 172.21.15.42:0/3490192665 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc90c031e50 con 0x7fc9200d3e40 2024-09-17T01:35:43.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.731+0000 7fc916a00640 1 -- 172.21.15.42:0/3490192665 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90c005260 con 0x7fc9200d3e40 2024-09-17T01:35:43.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.731+0000 7fc91fe00640 1 -- 172.21.15.42:0/3490192665 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9201e9cb0 con 0x7fc9200d3e40 2024-09-17T01:35:43.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.731+0000 7fc91fe00640 1 -- 172.21.15.42:0/3490192665 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9201ea270 con 0x7fc9200d3e40 2024-09-17T01:35:43.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.733+0000 7fc916a00640 1 -- 172.21.15.42:0/3490192665 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc90c005400 con 0x7fc9200d3e40 2024-09-17T01:35:43.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.734+0000 7fc916a00640 1 --2- 172.21.15.42:0/3490192665 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc900078b90 0x7fc90007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.734+0000 7fc916a00640 1 -- 172.21.15.42:0/3490192665 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fc90c0bbe40 con 0x7fc9200d3e40 2024-09-17T01:35:43.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.735+0000 7fc91ea00640 1 --2- 172.21.15.42:0/3490192665 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc900078b90 0x7fc90007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.735+0000 7fc92cbfb740 1 Processor -- start 2024-09-17T01:35:43.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.735+0000 7fc92cbfb740 1 -- start start 2024-09-17T01:35:43.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.736+0000 7fc91ea00640 1 --2- 172.21.15.42:0/3490192665 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc900078b90 0x7fc90007b0a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc910001720 tx=0x7fc910007e90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:43.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.737+0000 7fc92cbfb740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314f437390 0x56314f8234c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.737+0000 7fc92cbfb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f40e4d0 0x56314f7f8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.737+0000 7fc92cbfb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314f4166b0 0x56314f7f8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.737+0000 7fc92cbfb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56314f7516f0 con 0x56314f40e4d0 2024-09-17T01:35:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.737+0000 7fc92cbfb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56314f740b20 con 0x56314f4166b0 2024-09-17T01:35:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.737+0000 7fc92cbfb740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56314f744930 con 0x56314f437390 2024-09-17T01:35:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.737+0000 7fc91e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f40e4d0 0x56314f7f8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.737+0000 7fc91ea00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314f437390 0x56314f8234c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.737+0000 7fc91e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f40e4d0 0x56314f7f8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38004/0 (socket says 172.21.15.42:38004) 2024-09-17T01:35:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.737+0000 7fc91e000640 1 -- 172.21.15.42:0/558230701 learned_addr learned my addr 172.21.15.42:0/558230701 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.737+0000 7fc91f400640 1 --2- 172.21.15.42:0/558230701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314f4166b0 0x56314f7f8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.737+0000 7fc91e000640 1 -- 172.21.15.42:0/558230701 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314f437390 msgr2=0x56314f8234c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.737+0000 7fc91e000640 1 --2- 172.21.15.42:0/558230701 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314f437390 0x56314f8234c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.737+0000 7fc91e000640 1 -- 172.21.15.42:0/558230701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314f4166b0 msgr2=0x56314f7f8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:43.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.737+0000 7fc91e000640 1 --2- 172.21.15.42:0/558230701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314f4166b0 0x56314f7f8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.737+0000 7fc91e000640 1 -- 172.21.15.42:0/558230701 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56314f4a2970 con 0x56314f40e4d0 2024-09-17T01:35:43.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.738+0000 7fc91e000640 1 --2- 172.21.15.42:0/558230701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f40e4d0 0x56314f7f8310 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc90c083b20 tx=0x7fc90c0834e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d9133a6d99ddf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:43.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.738+0000 7fc90b400640 1 -- 172.21.15.42:0/558230701 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90c048070 con 0x56314f40e4d0 2024-09-17T01:35:43.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.738+0000 7fc90b400640 1 -- 172.21.15.42:0/558230701 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc90c0885c0 con 0x56314f40e4d0 2024-09-17T01:35:43.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.738+0000 7fc90b400640 1 -- 172.21.15.42:0/558230701 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90c084050 con 0x56314f40e4d0 2024-09-17T01:35:43.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.739+0000 7fc92cbfb740 1 -- 172.21.15.42:0/558230701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f40e4d0 msgr2=0x56314f7f8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:43.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.739+0000 7fc92cbfb740 1 --2- 172.21.15.42:0/558230701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f40e4d0 0x56314f7f8310 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc90c083b20 tx=0x7fc90c0834e0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.739+0000 7fc92cbfb740 1 -- 172.21.15.42:0/558230701 shutdown_connections 2024-09-17T01:35:43.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.739+0000 7fc92cbfb740 1 --2- 172.21.15.42:0/558230701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314f4166b0 0x56314f7f8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.739+0000 7fc92cbfb740 1 --2- 172.21.15.42:0/558230701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f40e4d0 0x56314f7f8310 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.739+0000 7fc92cbfb740 1 --2- 172.21.15.42:0/558230701 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314f437390 0x56314f8234c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.739+0000 7fc92cbfb740 1 -- 172.21.15.42:0/558230701 >> 172.21.15.42:0/558230701 conn(0x56314f42b4e0 msgr2=0x56314f7de7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:43.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.739+0000 7fc92cbfb740 1 -- 172.21.15.42:0/558230701 shutdown_connections 2024-09-17T01:35:43.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.739+0000 7fc92cbfb740 1 -- 172.21.15.42:0/558230701 wait complete. 2024-09-17T01:35:43.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.740+0000 7fc92cbfb740 1 -- start start 2024-09-17T01:35:43.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.740+0000 7fc92cbfb740 1 Processor -- start 2024-09-17T01:35:43.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.741+0000 7fc92cbfb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f40e4d0 0x56314f820450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.742+0000 7fc92cbfb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314f4166b0 0x56314f7f4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.742+0000 7fc92cbfb740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314f437390 0x56314f825a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.742+0000 7fc92cbfb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56314f4b1740 con 0x56314f40e4d0 2024-09-17T01:35:43.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.742+0000 7fc92cbfb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56314f6e7290 con 0x56314f4166b0 2024-09-17T01:35:43.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.742+0000 7fc92cbfb740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56314f7516f0 con 0x56314f437390 2024-09-17T01:35:43.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.742+0000 7fc92cbfb740 10 client.0 _ll_register_callbacks cb 0x56314f6c41e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:43.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.742+0000 7fc91ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f40e4d0 0x56314f820450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.742+0000 7fc91ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f40e4d0 0x56314f820450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38018/0 (socket says 172.21.15.42:38018) 2024-09-17T01:35:43.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.742+0000 7fc91ea00640 1 -- 172.21.15.42:0/3047107699 learned_addr learned my addr 172.21.15.42:0/3047107699 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:43.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.742+0000 7fc91ea00640 1 -- 172.21.15.42:0/3047107699 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314f437390 msgr2=0x56314f825a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:43.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.742+0000 7fc91ea00640 1 --2- 172.21.15.42:0/3047107699 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314f437390 0x56314f825a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.742+0000 7fc91ea00640 1 -- 172.21.15.42:0/3047107699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314f4166b0 msgr2=0x56314f7f4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:43.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.742+0000 7fc91ea00640 1 --2- 172.21.15.42:0/3047107699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314f4166b0 0x56314f7f4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.742+0000 7fc91ea00640 1 -- 172.21.15.42:0/3047107699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56314f5197d0 con 0x56314f40e4d0 2024-09-17T01:35:43.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.742+0000 7fc91ea00640 1 --2- 172.21.15.42:0/3047107699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f40e4d0 0x56314f820450 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc9100146d0 tx=0x7fc910000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937cef6810a1cee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:43.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.742+0000 7fc8ffe00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:43.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.743+0000 7fc8ffe00640 1 -- 172.21.15.42:0/3047107699 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc910025070 con 0x56314f40e4d0 2024-09-17T01:35:43.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.743+0000 7fc8ffe00640 1 -- 172.21.15.42:0/3047107699 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fc9100157d0 con 0x56314f40e4d0 2024-09-17T01:35:43.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.743+0000 7fc92cbfb740 1 -- 172.21.15.42:0/3047107699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc90c0885c0 con 0x56314f40e4d0 2024-09-17T01:35:43.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.743+0000 7fc8ffe00640 1 -- 172.21.15.42:0/3047107699 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc910030050 con 0x56314f40e4d0 2024-09-17T01:35:43.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.743+0000 7fc92cbfb740 10 client.5919 fetch_fsmap learned FSMap version 29 2024-09-17T01:35:43.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.743+0000 7fc92cbfb740 1 -- 172.21.15.42:0/3047107699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x56314f7f7ae0 con 0x56314f40e4d0 2024-09-17T01:35:43.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.743+0000 7fc8ffe00640 1 -- 172.21.15.42:0/3047107699 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc90c0885c0 con 0x56314f40e4d0 2024-09-17T01:35:43.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.743+0000 7fc8ffe00640 1 -- 172.21.15.42:0/3047107699 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7fc910033020 con 0x56314f40e4d0 2024-09-17T01:35:43.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.743+0000 7fc92cbfb740 10 client.5919 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T01:35:43.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.743+0000 7fc92cbfb740 10 client.5919 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:43.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.743+0000 7fc92cbfb740 20 client.5919 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:43.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.743+0000 7fc92cbfb740 1 --2- 172.21.15.42:0/3047107699 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56314f3f5f60 0x56314f831f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.743+0000 7fc92cbfb740 4 client.5919 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:43.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.743+0000 7fc92cbfb740 1 -- 172.21.15.42:0/3047107699 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56314f753640 con 0x56314f3f5f60 2024-09-17T01:35:43.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.744+0000 7fc91e000640 1 --2- 172.21.15.42:0/3047107699 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56314f3f5f60 0x56314f831f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.744+0000 7fc91e000640 1 --2- 172.21.15.42:0/3047107699 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56314f3f5f60 0x56314f831f70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cd8ee2ad89745dc server_cookie=46b30e0d0ff405e0 in_seq=0 out_seq=0 2024-09-17T01:35:43.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.744+0000 7fc8ffe00640 10 client.5919 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:43.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.745+0000 7fc8ffe00640 1 -- 172.21.15.42:0/3047107699 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56314f753640 con 0x56314f3f5f60 2024-09-17T01:35:43.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.745+0000 7fc8ffe00640 10 client.5919 handle_command_reply: tid=0 2024-09-17T01:35:43.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.745+0000 7fc92cbfb740 1 client.5919 shutdown 2024-09-17T01:35:43.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.745+0000 7fc92cbfb740 1 -- 172.21.15.42:0/3047107699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f40e4d0 msgr2=0x56314f820450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:43.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.745+0000 7fc92cbfb740 1 --2- 172.21.15.42:0/3047107699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f40e4d0 0x56314f820450 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc9100146d0 tx=0x7fc910000ed0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.745+0000 7fc92cbfb740 1 -- 172.21.15.42:0/3047107699 shutdown_connections 2024-09-17T01:35:43.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.745+0000 7fc92cbfb740 1 --2- 172.21.15.42:0/3047107699 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56314f3f5f60 0x56314f831f70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.745+0000 7fc92cbfb740 1 --2- 172.21.15.42:0/3047107699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314f4166b0 0x56314f7f4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.745+0000 7fc92cbfb740 1 --2- 172.21.15.42:0/3047107699 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314f437390 0x56314f825a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.745+0000 7fc92cbfb740 1 --2- 172.21.15.42:0/3047107699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f40e4d0 0x56314f820450 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.745+0000 7fc92cbfb740 1 -- 172.21.15.42:0/3047107699 >> 172.21.15.42:0/3047107699 conn(0x56314f42b4e0 msgr2=0x56314f7f8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:43.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.745+0000 7fc8ffe00640 0 client.5919 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:43.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.746+0000 7fc92cbfb740 1 -- 172.21.15.42:0/3047107699 shutdown_connections 2024-09-17T01:35:43.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.746+0000 7fc92cbfb740 1 -- 172.21.15.42:0/3047107699 wait complete. 2024-09-17T01:35:43.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.746+0000 7fc92cbfb740 20 client.5919 trim_cache size 0 max 16384 2024-09-17T01:35:43.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.760+0000 7fc92cbfb740 1 Processor -- start 2024-09-17T01:35:43.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.760+0000 7fc92cbfb740 1 -- start start 2024-09-17T01:35:43.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.761+0000 7fc92cbfb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314f4166b0 0x56314f846080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.761+0000 7fc92cbfb740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314f437390 0x56314f8199b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.761+0000 7fc92cbfb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f3cb3a0 0x56314f8309d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.761+0000 7fc92cbfb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc920202170 con 0x56314f3cb3a0 2024-09-17T01:35:43.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.761+0000 7fc92cbfb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc920201170 con 0x56314f4166b0 2024-09-17T01:35:43.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.761+0000 7fc92cbfb740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc92015e710 con 0x56314f437390 2024-09-17T01:35:43.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.762+0000 7fc91f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f3cb3a0 0x56314f8309d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.762+0000 7fc91f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f3cb3a0 0x56314f8309d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38034/0 (socket says 172.21.15.42:38034) 2024-09-17T01:35:43.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.762+0000 7fc91f400640 1 -- 172.21.15.42:0/3432961911 learned_addr learned my addr 172.21.15.42:0/3432961911 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:43.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.762+0000 7fc91ea00640 1 --2- 172.21.15.42:0/3432961911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314f4166b0 0x56314f846080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.762+0000 7fc91e000640 1 --2- 172.21.15.42:0/3432961911 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314f437390 0x56314f8199b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.762+0000 7fc91f400640 1 -- 172.21.15.42:0/3432961911 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314f437390 msgr2=0x56314f8199b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:43.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.762+0000 7fc91f400640 1 --2- 172.21.15.42:0/3432961911 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314f437390 0x56314f8199b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.762+0000 7fc91f400640 1 -- 172.21.15.42:0/3432961911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314f4166b0 msgr2=0x56314f846080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:43.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.762+0000 7fc91f400640 1 --2- 172.21.15.42:0/3432961911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314f4166b0 0x56314f846080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.762+0000 7fc91f400640 1 -- 172.21.15.42:0/3432961911 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56314f7db310 con 0x56314f3cb3a0 2024-09-17T01:35:43.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.762+0000 7fc91f400640 1 --2- 172.21.15.42:0/3432961911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f3cb3a0 0x56314f8309d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc918012530 tx=0x7fc9180129f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae51952e22ee694b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:43.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.763+0000 7fc90aa00640 1 -- 172.21.15.42:0/3432961911 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918012110 con 0x56314f3cb3a0 2024-09-17T01:35:43.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.763+0000 7fc90aa00640 1 -- 172.21.15.42:0/3432961911 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc918003970 con 0x56314f3cb3a0 2024-09-17T01:35:43.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.763+0000 7fc90aa00640 1 -- 172.21.15.42:0/3432961911 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9180122b0 con 0x56314f3cb3a0 2024-09-17T01:35:43.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.763+0000 7fc92cbfb740 1 -- 172.21.15.42:0/3432961911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f3cb3a0 msgr2=0x56314f8309d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:43.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.763+0000 7fc92cbfb740 1 --2- 172.21.15.42:0/3432961911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f3cb3a0 0x56314f8309d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc918012530 tx=0x7fc9180129f0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.763+0000 7fc92cbfb740 1 -- 172.21.15.42:0/3432961911 shutdown_connections 2024-09-17T01:35:43.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.763+0000 7fc92cbfb740 1 --2- 172.21.15.42:0/3432961911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f3cb3a0 0x56314f8309d0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.763+0000 7fc92cbfb740 1 --2- 172.21.15.42:0/3432961911 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314f437390 0x56314f8199b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.763+0000 7fc92cbfb740 1 --2- 172.21.15.42:0/3432961911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314f4166b0 0x56314f846080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.763+0000 7fc92cbfb740 1 -- 172.21.15.42:0/3432961911 >> 172.21.15.42:0/3432961911 conn(0x56314f42b4e0 msgr2=0x56314f805a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:43.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.763+0000 7fc92cbfb740 1 -- 172.21.15.42:0/3432961911 shutdown_connections 2024-09-17T01:35:43.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.763+0000 7fc92cbfb740 1 -- 172.21.15.42:0/3432961911 wait complete. 2024-09-17T01:35:43.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.764+0000 7fc92cbfb740 1 -- start start 2024-09-17T01:35:43.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.765+0000 7fc92cbfb740 1 Processor -- start 2024-09-17T01:35:43.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.766+0000 7fc92cbfb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314f3cb3a0 0x56314f8a6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.766+0000 7fc92cbfb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f4166b0 0x56314f8a3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.766+0000 7fc92cbfb740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314f437390 0x56314f7f4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.766+0000 7fc92cbfb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56314f7f7250 con 0x56314f4166b0 2024-09-17T01:35:43.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.766+0000 7fc92cbfb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc920147480 con 0x56314f3cb3a0 2024-09-17T01:35:43.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.766+0000 7fc92cbfb740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56314f835000 con 0x56314f437390 2024-09-17T01:35:43.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.766+0000 7fc92cbfb740 10 client.0 _ll_register_callbacks cb 0x7fc910001d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:43.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.766+0000 7fc91e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f4166b0 0x56314f8a3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.766+0000 7fc91e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f4166b0 0x56314f8a3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38040/0 (socket says 172.21.15.42:38040) 2024-09-17T01:35:43.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.766+0000 7fc91e000640 1 -- 172.21.15.42:0/3864588825 learned_addr learned my addr 172.21.15.42:0/3864588825 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:43.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.767+0000 7fc91ea00640 1 --2- 172.21.15.42:0/3864588825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314f3cb3a0 0x56314f8a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.767+0000 7fc91f400640 1 --2- 172.21.15.42:0/3864588825 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314f437390 0x56314f7f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.767+0000 7fc91e000640 1 -- 172.21.15.42:0/3864588825 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314f437390 msgr2=0x56314f7f4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:43.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.767+0000 7fc91e000640 1 --2- 172.21.15.42:0/3864588825 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314f437390 0x56314f7f4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.767+0000 7fc91e000640 1 -- 172.21.15.42:0/3864588825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314f3cb3a0 msgr2=0x56314f8a6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:43.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.767+0000 7fc91e000640 1 --2- 172.21.15.42:0/3864588825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314f3cb3a0 0x56314f8a6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.767+0000 7fc91e000640 1 -- 172.21.15.42:0/3864588825 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56314f8a2d70 con 0x56314f4166b0 2024-09-17T01:35:43.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.767+0000 7fc91f400640 1 --2- 172.21.15.42:0/3864588825 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314f437390 0x56314f7f4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:43.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.767+0000 7fc91e000640 1 --2- 172.21.15.42:0/3864588825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f4166b0 0x56314f8a3500 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009830 tx=0x7fc90c06d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8aedcfc9da4c6e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:43.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.767+0000 7fc8ffe00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:43.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.767+0000 7fc8ffe00640 1 -- 172.21.15.42:0/3864588825 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90c048040 con 0x56314f4166b0 2024-09-17T01:35:43.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.767+0000 7fc8ffe00640 1 -- 172.21.15.42:0/3864588825 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fc90c084000 con 0x56314f4166b0 2024-09-17T01:35:43.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.767+0000 7fc92cbfb740 1 -- 172.21.15.42:0/3864588825 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc918003970 con 0x56314f4166b0 2024-09-17T01:35:43.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.767+0000 7fc8ffe00640 1 -- 172.21.15.42:0/3864588825 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc90c0885c0 con 0x56314f4166b0 2024-09-17T01:35:43.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.767+0000 7fc92cbfb740 10 client.5925 fetch_fsmap learned FSMap version 29 2024-09-17T01:35:43.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.768+0000 7fc92cbfb740 1 -- 172.21.15.42:0/3864588825 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x56314f818d70 con 0x56314f4166b0 2024-09-17T01:35:43.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.768+0000 7fc8ffe00640 1 -- 172.21.15.42:0/3864588825 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc918003970 con 0x56314f4166b0 2024-09-17T01:35:43.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.768+0000 7fc8ffe00640 1 -- 172.21.15.42:0/3864588825 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7fc90c08d070 con 0x56314f4166b0 2024-09-17T01:35:43.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.768+0000 7fc92cbfb740 10 client.5925 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T01:35:43.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.768+0000 7fc92cbfb740 10 client.5925 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:43.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.768+0000 7fc92cbfb740 20 client.5925 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:43.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.768+0000 7fc92cbfb740 1 --2- 172.21.15.42:0/3864588825 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56314f8345d0 0x56314f7f4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.768+0000 7fc92cbfb740 4 client.5925 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-17T01:35:43.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.768+0000 7fc92cbfb740 1 -- 172.21.15.42:0/3864588825 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56314f74f0f0 con 0x56314f8345d0 2024-09-17T01:35:43.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.768+0000 7fc91ea00640 1 --2- 172.21.15.42:0/3864588825 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56314f8345d0 0x56314f7f4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.769+0000 7fc91ea00640 1 --2- 172.21.15.42:0/3864588825 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56314f8345d0 0x56314f7f4950 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b0d03767a8a07bf server_cookie=5d5dbcb674ab569f in_seq=0 out_seq=0 2024-09-17T01:35:43.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.769+0000 7fc8ffe00640 10 client.5925 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:43.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.769+0000 7fc8ffe00640 1 -- 172.21.15.42:0/3864588825 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56314f74f0f0 con 0x56314f8345d0 2024-09-17T01:35:43.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.769+0000 7fc8ffe00640 10 client.5925 handle_command_reply: tid=0 2024-09-17T01:35:43.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.769+0000 7fc92cbfb740 1 client.5925 shutdown 2024-09-17T01:35:43.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.769+0000 7fc92cbfb740 1 -- 172.21.15.42:0/3864588825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f4166b0 msgr2=0x56314f8a3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:43.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.769+0000 7fc92cbfb740 1 --2- 172.21.15.42:0/3864588825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f4166b0 0x56314f8a3500 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009830 tx=0x7fc90c06d040 comp rx=0 tx=0).stop 2024-09-17T01:35:43.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.769+0000 7fc92cbfb740 1 -- 172.21.15.42:0/3864588825 shutdown_connections 2024-09-17T01:35:43.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.769+0000 7fc92cbfb740 1 --2- 172.21.15.42:0/3864588825 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56314f8345d0 0x56314f7f4950 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.769+0000 7fc92cbfb740 1 --2- 172.21.15.42:0/3864588825 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56314f437390 0x56314f7f4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.769+0000 7fc92cbfb740 1 --2- 172.21.15.42:0/3864588825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56314f4166b0 0x56314f8a3500 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.769+0000 7fc92cbfb740 1 --2- 172.21.15.42:0/3864588825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56314f3cb3a0 0x56314f8a6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.769+0000 7fc8ffe00640 0 client.5925 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:43.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.769+0000 7fc92cbfb740 1 -- 172.21.15.42:0/3864588825 >> 172.21.15.42:0/3864588825 conn(0x56314f42b4e0 msgr2=0x56314f846190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:43.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.769+0000 7fc92cbfb740 1 -- 172.21.15.42:0/3864588825 shutdown_connections 2024-09-17T01:35:43.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.769+0000 7fc92cbfb740 1 -- 172.21.15.42:0/3864588825 wait complete. 2024-09-17T01:35:43.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.769+0000 7fc92cbfb740 20 client.5925 trim_cache size 0 max 16384 2024-09-17T01:35:43.773 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-17T01:35:43.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.770+0000 7fc91fe00640 1 -- 172.21.15.42:0/3490192665 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc900078b90 msgr2=0x7fc90007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:43.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.770+0000 7fc91fe00640 1 --2- 172.21.15.42:0/3490192665 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc900078b90 0x7fc90007b0a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc910001720 tx=0x7fc910007e90 comp rx=0 tx=0).stop 2024-09-17T01:35:43.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.770+0000 7fc91fe00640 1 -- 172.21.15.42:0/3490192665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9200d3e40 msgr2=0x7fc9201ea790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:43.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.770+0000 7fc91fe00640 1 --2- 172.21.15.42:0/3490192665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9200d3e40 0x7fc9201ea790 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009950 tx=0x7fc90c033c20 comp rx=0 tx=0).stop 2024-09-17T01:35:43.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.770+0000 7fc91fe00640 1 -- 172.21.15.42:0/3490192665 shutdown_connections 2024-09-17T01:35:43.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.770+0000 7fc91fe00640 1 --2- 172.21.15.42:0/3490192665 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc900078b90 0x7fc90007b0a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.770+0000 7fc91fe00640 1 --2- 172.21.15.42:0/3490192665 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc92015ede0 0x7fc9201eacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.770+0000 7fc91fe00640 1 --2- 172.21.15.42:0/3490192665 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9200d3e40 0x7fc9201ea790 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.770+0000 7fc91fe00640 1 --2- 172.21.15.42:0/3490192665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9200d0d20 0x7fc920159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.770+0000 7fc91fe00640 1 -- 172.21.15.42:0/3490192665 >> 172.21.15.42:0/3490192665 conn(0x7fc92006cd20 msgr2=0x7fc920158b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:43.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.770+0000 7fc91fe00640 1 -- 172.21.15.42:0/3490192665 shutdown_connections 2024-09-17T01:35:43.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.770+0000 7fc91fe00640 1 -- 172.21.15.42:0/3490192665 wait complete. 2024-09-17T01:35:43.793 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 10000000a4e.00000000 parent 2024-09-17T01:35:43.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.939+0000 7fadec529f40 1 Processor -- start 2024-09-17T01:35:43.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.939+0000 7fadec529f40 1 -- start start 2024-09-17T01:35:43.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.940+0000 7fadec529f40 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556efa7d7290 0x556efa8a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.940+0000 7fadec529f40 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556efa806f50 0x556efa8a88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.940+0000 7fadec529f40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556efa8220f0 0x556efa93cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.940+0000 7fadec529f40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556efa807d10 con 0x556efa8220f0 2024-09-17T01:35:43.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.940+0000 7fadec529f40 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556efa725c60 con 0x556efa806f50 2024-09-17T01:35:43.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.940+0000 7fadec529f40 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x556efa807360 con 0x556efa7d7290 2024-09-17T01:35:43.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.940+0000 7fade6000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556efa8220f0 0x556efa93cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.940+0000 7fade6000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556efa8220f0 0x556efa93cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38060/0 (socket says 172.21.15.42:38060) 2024-09-17T01:35:43.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.940+0000 7fade6000640 1 -- 172.21.15.42:0/3050612349 learned_addr learned my addr 172.21.15.42:0/3050612349 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:43.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.941+0000 7fade5600640 1 --2- 172.21.15.42:0/3050612349 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556efa7d7290 0x556efa8a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.941+0000 7fade4c00640 1 --2- 172.21.15.42:0/3050612349 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556efa806f50 0x556efa8a88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.941+0000 7fade6000640 1 -- 172.21.15.42:0/3050612349 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556efa7d7290 msgr2=0x556efa8a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:43.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.941+0000 7fade6000640 1 --2- 172.21.15.42:0/3050612349 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556efa7d7290 0x556efa8a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.941+0000 7fade6000640 1 -- 172.21.15.42:0/3050612349 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556efa806f50 msgr2=0x556efa8a88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:43.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.941+0000 7fade6000640 1 --2- 172.21.15.42:0/3050612349 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556efa806f50 0x556efa8a88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.941+0000 7fade6000640 1 -- 172.21.15.42:0/3050612349 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556efa6fdf10 con 0x556efa8220f0 2024-09-17T01:35:43.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.941+0000 7fade4c00640 1 --2- 172.21.15.42:0/3050612349 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556efa806f50 0x556efa8a88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:43.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.941+0000 7fade6000640 1 --2- 172.21.15.42:0/3050612349 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556efa8220f0 0x556efa93cd40 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fade000b650 tx=0x7fade000bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ffd14a0c0c0bc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:43.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.941+0000 7faddf400640 1 -- 172.21.15.42:0/3050612349 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade0009a30 con 0x556efa8220f0 2024-09-17T01:35:43.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.941+0000 7faddf400640 1 -- 172.21.15.42:0/3050612349 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fade0009ce0 con 0x556efa8220f0 2024-09-17T01:35:43.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.941+0000 7faddf400640 1 -- 172.21.15.42:0/3050612349 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade000e6b0 con 0x556efa8220f0 2024-09-17T01:35:43.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.942+0000 7fadec529f40 1 -- 172.21.15.42:0/3050612349 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556efa8220f0 msgr2=0x556efa93cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:43.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.942+0000 7fadec529f40 1 --2- 172.21.15.42:0/3050612349 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556efa8220f0 0x556efa93cd40 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fade000b650 tx=0x7fade000bb10 comp rx=0 tx=0).stop 2024-09-17T01:35:43.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.942+0000 7fadec529f40 1 -- 172.21.15.42:0/3050612349 shutdown_connections 2024-09-17T01:35:43.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.942+0000 7fadec529f40 1 --2- 172.21.15.42:0/3050612349 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556efa806f50 0x556efa8a88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.942+0000 7fadec529f40 1 --2- 172.21.15.42:0/3050612349 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556efa8220f0 0x556efa93cd40 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.942+0000 7fadec529f40 1 --2- 172.21.15.42:0/3050612349 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556efa7d7290 0x556efa8a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.942+0000 7fadec529f40 1 -- 172.21.15.42:0/3050612349 >> 172.21.15.42:0/3050612349 conn(0x556efa6f6ac0 msgr2=0x556efa7d5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:43.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.942+0000 7fadec529f40 1 -- 172.21.15.42:0/3050612349 shutdown_connections 2024-09-17T01:35:43.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.942+0000 7fadec529f40 1 -- 172.21.15.42:0/3050612349 wait complete. 2024-09-17T01:35:43.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.943+0000 7fadec529f40 1 Processor -- start 2024-09-17T01:35:43.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.943+0000 7fadec529f40 1 -- start start 2024-09-17T01:35:43.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.945+0000 7fadec529f40 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556efa7d7290 0x556efa81d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.945+0000 7fadec529f40 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556efa806f50 0x556efa947f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.945+0000 7fadec529f40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556efa8220f0 0x556efa7d5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.945+0000 7fadec529f40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556efa8a0430 con 0x556efa8220f0 2024-09-17T01:35:43.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.945+0000 7fadec529f40 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556efa89e950 con 0x556efa806f50 2024-09-17T01:35:43.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.945+0000 7fadec529f40 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x556efa9489d0 con 0x556efa7d7290 2024-09-17T01:35:43.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.945+0000 7fade6000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556efa8220f0 0x556efa7d5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.945+0000 7fade6000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556efa8220f0 0x556efa7d5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38068/0 (socket says 172.21.15.42:38068) 2024-09-17T01:35:43.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.945+0000 7fade6000640 1 -- 172.21.15.42:0/3437411948 learned_addr learned my addr 172.21.15.42:0/3437411948 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:43.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.945+0000 7fade5600640 1 --2- 172.21.15.42:0/3437411948 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556efa7d7290 0x556efa81d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.945+0000 7fade4c00640 1 --2- 172.21.15.42:0/3437411948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556efa806f50 0x556efa947f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.945+0000 7fade6000640 1 -- 172.21.15.42:0/3437411948 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556efa7d7290 msgr2=0x556efa81d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:43.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.945+0000 7fade6000640 1 --2- 172.21.15.42:0/3437411948 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556efa7d7290 0x556efa81d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.945+0000 7fade6000640 1 -- 172.21.15.42:0/3437411948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556efa806f50 msgr2=0x556efa947f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:43.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.945+0000 7fade6000640 1 --2- 172.21.15.42:0/3437411948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556efa806f50 0x556efa947f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.945+0000 7fade6000640 1 -- 172.21.15.42:0/3437411948 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556efa948c20 con 0x556efa8220f0 2024-09-17T01:35:43.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.946+0000 7fade6000640 1 --2- 172.21.15.42:0/3437411948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556efa8220f0 0x556efa7d5de0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fade000bfb0 tx=0x7fade0004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:43.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.946+0000 7fadde000640 1 -- 172.21.15.42:0/3437411948 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade0024070 con 0x556efa8220f0 2024-09-17T01:35:43.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.946+0000 7fadde000640 1 -- 172.21.15.42:0/3437411948 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fade001f450 con 0x556efa8220f0 2024-09-17T01:35:43.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.946+0000 7fadec529f40 1 -- 172.21.15.42:0/3437411948 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556efa89cb30 con 0x556efa8220f0 2024-09-17T01:35:43.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.946+0000 7fadde000640 1 -- 172.21.15.42:0/3437411948 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade001b070 con 0x556efa8220f0 2024-09-17T01:35:43.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.946+0000 7fadec529f40 1 -- 172.21.15.42:0/3437411948 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556efa89e690 con 0x556efa8220f0 2024-09-17T01:35:43.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.948+0000 7fadde000640 1 -- 172.21.15.42:0/3437411948 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fade0027070 con 0x556efa8220f0 2024-09-17T01:35:43.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.949+0000 7fadde000640 1 --2- 172.21.15.42:0/3437411948 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fadc80775a0 0x7fadc8079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.949+0000 7fadde000640 1 -- 172.21.15.42:0/3437411948 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fade009b350 con 0x556efa8220f0 2024-09-17T01:35:43.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.950+0000 7fadec529f40 1 --2- 172.21.15.42:0/3437411948 >> [v2:172.21.15.43:6818/3453529013,v1:172.21.15.43:6819/3453529013] conn(0x556efa9484a0 0x556efa89db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:43.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.950+0000 7fadec529f40 1 -- 172.21.15.42:0/3437411948 --> [v2:172.21.15.43:6818/3453529013,v1:172.21.15.43:6819/3453529013] -- osd_op(unknown.0.0:1 7.2 7:43adcc81:::10000000a4e.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49) -- 0x556efa89e060 con 0x556efa9484a0 2024-09-17T01:35:43.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.950+0000 7fade5600640 1 --2- 172.21.15.42:0/3437411948 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fadc80775a0 0x7fadc8079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.950+0000 7fade4c00640 1 --2- 172.21.15.42:0/3437411948 >> [v2:172.21.15.43:6818/3453529013,v1:172.21.15.43:6819/3453529013] conn(0x556efa9484a0 0x556efa89db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:43.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.951+0000 7fade5600640 1 --2- 172.21.15.42:0/3437411948 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fadc80775a0 0x7fadc8079ab0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fadd8055000 tx=0x7fadd8003020 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:43.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.951+0000 7fade4c00640 1 --2- 172.21.15.42:0/3437411948 >> [v2:172.21.15.43:6818/3453529013,v1:172.21.15.43:6819/3453529013] conn(0x556efa9484a0 0x556efa89db20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:43.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.953+0000 7fade4c00640 1 -- 172.21.15.42:0/3437411948 <== osd.4 v2:172.21.15.43:6818/3453529013 1 ==== osd_op_reply(1 10000000a4e.00000000 [rmxattr] v49'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fadd400b040 con 0x556efa9484a0 2024-09-17T01:35:43.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.953+0000 7fadec529f40 1 -- 172.21.15.42:0/3437411948 >> [v2:172.21.15.43:6818/3453529013,v1:172.21.15.43:6819/3453529013] conn(0x556efa9484a0 msgr2=0x556efa89db20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:43.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.953+0000 7fadec529f40 1 --2- 172.21.15.42:0/3437411948 >> [v2:172.21.15.43:6818/3453529013,v1:172.21.15.43:6819/3453529013] conn(0x556efa9484a0 0x556efa89db20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:43.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.953+0000 7fadec529f40 1 -- 172.21.15.42:0/3437411948 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fadc80775a0 msgr2=0x7fadc8079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:43.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.953+0000 7fadec529f40 1 --2- 172.21.15.42:0/3437411948 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fadc80775a0 0x7fadc8079ab0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fadd8055000 tx=0x7fadd8003020 comp rx=0 tx=0).stop 2024-09-17T01:35:43.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.953+0000 7fadec529f40 1 -- 172.21.15.42:0/3437411948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556efa8220f0 msgr2=0x556efa7d5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:43.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.953+0000 7fadec529f40 1 --2- 172.21.15.42:0/3437411948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556efa8220f0 0x556efa7d5de0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fade000bfb0 tx=0x7fade0004e60 comp rx=0 tx=0).stop 2024-09-17T01:35:43.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.953+0000 7fade6000640 1 -- 172.21.15.42:0/3437411948 reap_dead start 2024-09-17T01:35:43.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.953+0000 7fadec529f40 1 -- 172.21.15.42:0/3437411948 shutdown_connections 2024-09-17T01:35:43.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.953+0000 7fadec529f40 1 -- 172.21.15.42:0/3437411948 >> 172.21.15.42:0/3437411948 conn(0x556efa6f6ac0 msgr2=0x556efa89efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:43.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.953+0000 7fadec529f40 1 -- 172.21.15.42:0/3437411948 shutdown_connections 2024-09-17T01:35:43.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:43.953+0000 7fadec529f40 1 -- 172.21.15.42:0/3437411948 wait complete. 2024-09-17T01:35:43.965 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' 2024-09-17T01:35:43.965 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_1 2024-09-17T01:35:44.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.195+0000 7f8cfce00640 1 -- 172.21.15.42:0/3196179480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cf806d430 msgr2=0x7f8cf8152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:44.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.195+0000 7f8cfce00640 1 --2- 172.21.15.42:0/3196179480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cf806d430 0x7f8cf8152ed0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0005fd0 tx=0x7f8cf002aaa0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.195+0000 7f8cfce00640 1 -- 172.21.15.42:0/3196179480 shutdown_connections 2024-09-17T01:35:44.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.195+0000 7f8cfce00640 1 --2- 172.21.15.42:0/3196179480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cf806d430 0x7f8cf8152ed0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.195+0000 7f8cfce00640 1 -- 172.21.15.42:0/3196179480 >> 172.21.15.42:0/3196179480 conn(0x7f8cf80b25f0 msgr2=0x7f8cf80d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:44.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.195+0000 7f8cfce00640 1 -- 172.21.15.42:0/3196179480 shutdown_connections 2024-09-17T01:35:44.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.195+0000 7f8cfce00640 1 -- 172.21.15.42:0/3196179480 wait complete. 2024-09-17T01:35:44.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.197+0000 7f8cfce00640 1 Processor -- start 2024-09-17T01:35:44.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.197+0000 7f8cfce00640 1 -- start start 2024-09-17T01:35:44.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.198+0000 7f8cfce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cf80b4be0 0x7f8cf8153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.198+0000 7f8cfce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cf80cf7c0 0x7f8cf814b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.199+0000 7f8cfce00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cf80c9420 0x7f8cf80c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.199+0000 7f8cfce00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf8153620 con 0x7f8cf80cf7c0 2024-09-17T01:35:44.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.199+0000 7f8cfce00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf80b4380 con 0x7f8cf80b4be0 2024-09-17T01:35:44.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.199+0000 7f8cfce00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8cf81537a0 con 0x7f8cf80c9420 2024-09-17T01:35:44.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.199+0000 7f8cf6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cf80cf7c0 0x7f8cf814b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.199+0000 7f8cf6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cf80cf7c0 0x7f8cf814b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38082/0 (socket says 172.21.15.42:38082) 2024-09-17T01:35:44.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.199+0000 7f8cf6a00640 1 -- 172.21.15.42:0/1807225619 learned_addr learned my addr 172.21.15.42:0/1807225619 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:44.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.199+0000 7f8cf7400640 1 --2- 172.21.15.42:0/1807225619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cf80b4be0 0x7f8cf8153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.199+0000 7f8cf7e00640 1 --2- 172.21.15.42:0/1807225619 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cf80c9420 0x7f8cf80c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.199+0000 7f8cf6a00640 1 -- 172.21.15.42:0/1807225619 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cf80c9420 msgr2=0x7f8cf80c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:44.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.199+0000 7f8cf6a00640 1 --2- 172.21.15.42:0/1807225619 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cf80c9420 0x7f8cf80c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.199+0000 7f8cf6a00640 1 -- 172.21.15.42:0/1807225619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cf80b4be0 msgr2=0x7f8cf8153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:44.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.199+0000 7f8cf6a00640 1 --2- 172.21.15.42:0/1807225619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cf80b4be0 0x7f8cf8153c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.199+0000 7f8cf6a00640 1 -- 172.21.15.42:0/1807225619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf80c9d70 con 0x7f8cf80cf7c0 2024-09-17T01:35:44.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.200+0000 7f8cf6a00640 1 --2- 172.21.15.42:0/1807225619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cf80cf7c0 0x7f8cf814b740 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8ce400b3f0 tx=0x7f8ce400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:44.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.200+0000 7f8cef400640 1 -- 172.21.15.42:0/1807225619 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce4015020 con 0x7f8cf80cf7c0 2024-09-17T01:35:44.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.200+0000 7f8cef400640 1 -- 172.21.15.42:0/1807225619 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ce4011920 con 0x7f8cf80cf7c0 2024-09-17T01:35:44.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.200+0000 7f8cfce00640 1 -- 172.21.15.42:0/1807225619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf814bc80 con 0x7f8cf80cf7c0 2024-09-17T01:35:44.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.200+0000 7f8cef400640 1 -- 172.21.15.42:0/1807225619 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce4011d70 con 0x7f8cf80cf7c0 2024-09-17T01:35:44.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.200+0000 7f8cfce00640 1 -- 172.21.15.42:0/1807225619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf8073140 con 0x7f8cf80cf7c0 2024-09-17T01:35:44.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.202+0000 7f8cef400640 1 -- 172.21.15.42:0/1807225619 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8ce4018020 con 0x7f8cf80cf7c0 2024-09-17T01:35:44.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.203+0000 7f8cef400640 1 --2- 172.21.15.42:0/1807225619 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8cd8078bc0 0x7f8cd807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.204+0000 7f8cef400640 1 -- 172.21.15.42:0/1807225619 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f8ce409ab80 con 0x7f8cf80cf7c0 2024-09-17T01:35:44.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.204+0000 7f8d05645740 1 Processor -- start 2024-09-17T01:35:44.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.204+0000 7f8cf7400640 1 --2- 172.21.15.42:0/1807225619 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8cd8078bc0 0x7f8cd807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.204+0000 7f8d05645740 1 -- start start 2024-09-17T01:35:44.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.205+0000 7f8cf7400640 1 --2- 172.21.15.42:0/1807225619 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8cd8078bc0 0x7f8cd807b0d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8001720 tx=0x7f8ce8009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:44.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.205+0000 7f8d05645740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56118df06790 0x56118e2f5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.205+0000 7f8d05645740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dedd8d0 0x56118e2d7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.205+0000 7f8d05645740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56118dee5ab0 0x56118e2d8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.205+0000 7f8d05645740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56118e220a30 con 0x56118dedd8d0 2024-09-17T01:35:44.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.205+0000 7f8d05645740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56118e20fe60 con 0x56118df06790 2024-09-17T01:35:44.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.205+0000 7f8d05645740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56118e213c70 con 0x56118dee5ab0 2024-09-17T01:35:44.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.206+0000 7f8cf6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dedd8d0 0x56118e2d7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.206+0000 7f8cf6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dedd8d0 0x56118e2d7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38086/0 (socket says 172.21.15.42:38086) 2024-09-17T01:35:44.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.206+0000 7f8cf6a00640 1 -- 172.21.15.42:0/950257474 learned_addr learned my addr 172.21.15.42:0/950257474 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:44.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.206+0000 7f8cf7e00640 1 --2- 172.21.15.42:0/950257474 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56118dee5ab0 0x56118e2d8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.206+0000 7f8cf7400640 1 --2- 172.21.15.42:0/950257474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56118df06790 0x56118e2f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.206+0000 7f8cf6a00640 1 -- 172.21.15.42:0/950257474 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56118dee5ab0 msgr2=0x56118e2d8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:44.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.206+0000 7f8cf6a00640 1 --2- 172.21.15.42:0/950257474 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56118dee5ab0 0x56118e2d8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.206+0000 7f8cf6a00640 1 -- 172.21.15.42:0/950257474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56118df06790 msgr2=0x56118e2f5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:44.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.206+0000 7f8cf6a00640 1 --2- 172.21.15.42:0/950257474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56118df06790 0x56118e2f5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.206+0000 7f8cf6a00640 1 -- 172.21.15.42:0/950257474 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56118dfeac00 con 0x56118dedd8d0 2024-09-17T01:35:44.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.206+0000 7f8cf6a00640 1 --2- 172.21.15.42:0/950257474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dedd8d0 0x56118e2d7ef0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4062150 tx=0x7f8ce4062470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491942080e187fe4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:44.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.207+0000 7f8ce3e00640 1 -- 172.21.15.42:0/950257474 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce4067390 con 0x56118dedd8d0 2024-09-17T01:35:44.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.207+0000 7f8ce3e00640 1 -- 172.21.15.42:0/950257474 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ce406c240 con 0x56118dedd8d0 2024-09-17T01:35:44.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.207+0000 7f8ce3e00640 1 -- 172.21.15.42:0/950257474 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce4063be0 con 0x56118dedd8d0 2024-09-17T01:35:44.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.207+0000 7f8d05645740 1 -- 172.21.15.42:0/950257474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dedd8d0 msgr2=0x56118e2d7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:44.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.207+0000 7f8d05645740 1 --2- 172.21.15.42:0/950257474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dedd8d0 0x56118e2d7ef0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4062150 tx=0x7f8ce4062470 comp rx=0 tx=0).stop 2024-09-17T01:35:44.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.207+0000 7f8d05645740 1 -- 172.21.15.42:0/950257474 shutdown_connections 2024-09-17T01:35:44.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.207+0000 7f8d05645740 1 --2- 172.21.15.42:0/950257474 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56118dee5ab0 0x56118e2d8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.207+0000 7f8d05645740 1 --2- 172.21.15.42:0/950257474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dedd8d0 0x56118e2d7ef0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.207+0000 7f8d05645740 1 --2- 172.21.15.42:0/950257474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56118df06790 0x56118e2f5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.207+0000 7f8d05645740 1 -- 172.21.15.42:0/950257474 >> 172.21.15.42:0/950257474 conn(0x56118defa8e0 msgr2=0x56118e2ae110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:44.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.208+0000 7f8d05645740 1 -- 172.21.15.42:0/950257474 shutdown_connections 2024-09-17T01:35:44.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.208+0000 7f8d05645740 1 -- 172.21.15.42:0/950257474 wait complete. 2024-09-17T01:35:44.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.209+0000 7f8d05645740 1 -- start start 2024-09-17T01:35:44.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.209+0000 7f8d05645740 1 Processor -- start 2024-09-17T01:35:44.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.210+0000 7f8d05645740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dedd8d0 0x56118e2d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.210+0000 7f8d05645740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56118dee5ab0 0x56118e2ec600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.210+0000 7f8d05645740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56118df06790 0x56118e305820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.210+0000 7f8d05645740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56118df80b40 con 0x56118dedd8d0 2024-09-17T01:35:44.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.210+0000 7f8d05645740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56118e1b5710 con 0x56118df06790 2024-09-17T01:35:44.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.210+0000 7f8d05645740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56118e2b5b00 con 0x56118dee5ab0 2024-09-17T01:35:44.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.211+0000 7f8d05645740 10 client.0 _ll_register_callbacks cb 0x56118e1bb8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:44.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.211+0000 7f8cf7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dedd8d0 0x56118e2d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.211+0000 7f8cf7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dedd8d0 0x56118e2d0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38096/0 (socket says 172.21.15.42:38096) 2024-09-17T01:35:44.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.211+0000 7f8cf7400640 1 -- 172.21.15.42:0/2850295215 learned_addr learned my addr 172.21.15.42:0/2850295215 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:44.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.211+0000 7f8cf7e00640 1 --2- 172.21.15.42:0/2850295215 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56118df06790 0x56118e305820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.211+0000 7f8cf6a00640 1 --2- 172.21.15.42:0/2850295215 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56118dee5ab0 0x56118e2ec600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.211+0000 7f8cf7400640 1 -- 172.21.15.42:0/2850295215 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56118dee5ab0 msgr2=0x56118e2ec600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:44.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.211+0000 7f8cf7400640 1 --2- 172.21.15.42:0/2850295215 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56118dee5ab0 0x56118e2ec600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.211+0000 7f8cf7400640 1 -- 172.21.15.42:0/2850295215 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56118df06790 msgr2=0x56118e305820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:44.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.211+0000 7f8cf7400640 1 --2- 172.21.15.42:0/2850295215 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56118df06790 0x56118e305820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.211+0000 7f8cf7400640 1 -- 172.21.15.42:0/2850295215 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56118df4faa0 con 0x56118dedd8d0 2024-09-17T01:35:44.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.212+0000 7f8cf7400640 1 --2- 172.21.15.42:0/2850295215 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dedd8d0 0x56118e2d0e80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8014760 tx=0x7f8ce8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0e863ec8e87017 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:44.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.212+0000 7f8ce0c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:44.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.212+0000 7f8ce0c00640 1 -- 172.21.15.42:0/2850295215 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8025020 con 0x56118dedd8d0 2024-09-17T01:35:44.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.212+0000 7f8ce0c00640 1 -- 172.21.15.42:0/2850295215 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f8ce80216d0 con 0x56118dedd8d0 2024-09-17T01:35:44.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.212+0000 7f8d05645740 1 -- 172.21.15.42:0/2850295215 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ce406c240 con 0x56118dedd8d0 2024-09-17T01:35:44.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.212+0000 7f8ce0c00640 1 -- 172.21.15.42:0/2850295215 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8ce802f050 con 0x56118dedd8d0 2024-09-17T01:35:44.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.212+0000 7f8d05645740 10 client.5949 fetch_fsmap learned FSMap version 30 2024-09-17T01:35:44.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.212+0000 7f8d05645740 1 -- 172.21.15.42:0/2850295215 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x56118e04b390 con 0x56118dedd8d0 2024-09-17T01:35:44.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.212+0000 7f8ce0c00640 1 -- 172.21.15.42:0/2850295215 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ce406c240 con 0x56118dedd8d0 2024-09-17T01:35:44.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.212+0000 7f8ce0c00640 1 -- 172.21.15.42:0/2850295215 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7f8ce8032020 con 0x56118dedd8d0 2024-09-17T01:35:44.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.212+0000 7f8d05645740 10 client.5949 fetch_fsmap finished waiting for FSMap version 30 2024-09-17T01:35:44.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.212+0000 7f8d05645740 10 client.5949 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:44.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.213+0000 7f8d05645740 20 client.5949 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:44.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.213+0000 7f8d05645740 1 --2- 172.21.15.42:0/2850295215 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56118dec5360 0x56118e2ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.213+0000 7f8d05645740 4 client.5949 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:44.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.213+0000 7f8d05645740 1 -- 172.21.15.42:0/2850295215 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56118e222980 con 0x56118dec5360 2024-09-17T01:35:44.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.213+0000 7f8cf6a00640 1 --2- 172.21.15.42:0/2850295215 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56118dec5360 0x56118e2ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.213+0000 7f8cf6a00640 1 --2- 172.21.15.42:0/2850295215 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56118dec5360 0x56118e2ad5b0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92358c5e2a510eb0 server_cookie=be90492aeb28f817 in_seq=0 out_seq=0 2024-09-17T01:35:44.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.213+0000 7f8ce0c00640 10 client.5949 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:44.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.214+0000 7f8ce0c00640 1 -- 172.21.15.42:0/2850295215 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56118e222980 con 0x56118dec5360 2024-09-17T01:35:44.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.214+0000 7f8ce0c00640 10 client.5949 handle_command_reply: tid=0 2024-09-17T01:35:44.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.214+0000 7f8d05645740 1 client.5949 shutdown 2024-09-17T01:35:44.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.214+0000 7f8d05645740 1 -- 172.21.15.42:0/2850295215 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dedd8d0 msgr2=0x56118e2d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:44.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.214+0000 7f8d05645740 1 --2- 172.21.15.42:0/2850295215 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dedd8d0 0x56118e2d0e80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8014760 tx=0x7f8ce8000ed0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.215+0000 7f8d05645740 1 -- 172.21.15.42:0/2850295215 shutdown_connections 2024-09-17T01:35:44.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.215+0000 7f8d05645740 1 --2- 172.21.15.42:0/2850295215 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56118dec5360 0x56118e2ad5b0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.215+0000 7f8d05645740 1 --2- 172.21.15.42:0/2850295215 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56118df06790 0x56118e305820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.215+0000 7f8d05645740 1 --2- 172.21.15.42:0/2850295215 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56118dee5ab0 0x56118e2ec600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.215+0000 7f8d05645740 1 --2- 172.21.15.42:0/2850295215 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dedd8d0 0x56118e2d0e80 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.215+0000 7f8ce0c00640 0 client.5949 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:44.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.215+0000 7f8d05645740 1 -- 172.21.15.42:0/2850295215 >> 172.21.15.42:0/2850295215 conn(0x56118defa8e0 msgr2=0x56118e2d8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:44.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.215+0000 7f8d05645740 1 -- 172.21.15.42:0/2850295215 shutdown_connections 2024-09-17T01:35:44.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.215+0000 7f8d05645740 1 -- 172.21.15.42:0/2850295215 wait complete. 2024-09-17T01:35:44.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.215+0000 7f8d05645740 20 client.5949 trim_cache size 0 max 16384 2024-09-17T01:35:44.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.234+0000 7f8d05645740 1 Processor -- start 2024-09-17T01:35:44.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.234+0000 7f8d05645740 1 -- start start 2024-09-17T01:35:44.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.235+0000 7f8d05645740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dedd8d0 0x56118e2f6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.235+0000 7f8d05645740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56118dee5ab0 0x56118e2d7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.235+0000 7f8d05645740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56118df06790 0x56118e2d8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.235+0000 7f8d05645740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf82021e0 con 0x56118dedd8d0 2024-09-17T01:35:44.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.235+0000 7f8d05645740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf82011c0 con 0x56118dee5ab0 2024-09-17T01:35:44.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.235+0000 7f8d05645740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8cf81f9310 con 0x56118df06790 2024-09-17T01:35:44.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.235+0000 7f8cf7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dedd8d0 0x56118e2f6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.235+0000 7f8cf7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dedd8d0 0x56118e2f6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38098/0 (socket says 172.21.15.42:38098) 2024-09-17T01:35:44.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.235+0000 7f8cf7400640 1 -- 172.21.15.42:0/459073254 learned_addr learned my addr 172.21.15.42:0/459073254 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:44.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.236+0000 7f8cf6a00640 1 --2- 172.21.15.42:0/459073254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56118dee5ab0 0x56118e2d7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.236+0000 7f8cf7e00640 1 --2- 172.21.15.42:0/459073254 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56118df06790 0x56118e2d8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.236+0000 7f8cf7400640 1 -- 172.21.15.42:0/459073254 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56118df06790 msgr2=0x56118e2d8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:44.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.236+0000 7f8cf7400640 1 --2- 172.21.15.42:0/459073254 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56118df06790 0x56118e2d8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.236+0000 7f8cf7400640 1 -- 172.21.15.42:0/459073254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56118dee5ab0 msgr2=0x56118e2d7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:44.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.236+0000 7f8cf7400640 1 --2- 172.21.15.42:0/459073254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56118dee5ab0 0x56118e2d7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.236+0000 7f8cf7400640 1 -- 172.21.15.42:0/459073254 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56118e2ec970 con 0x56118dedd8d0 2024-09-17T01:35:44.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.236+0000 7f8cf7400640 1 --2- 172.21.15.42:0/459073254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dedd8d0 0x56118e2f6420 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8001550 tx=0x7f8ce8007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3285ddd39b3610c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:44.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.236+0000 7f8ce3400640 1 -- 172.21.15.42:0/459073254 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8038070 con 0x56118dedd8d0 2024-09-17T01:35:44.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.236+0000 7f8ce3400640 1 -- 172.21.15.42:0/459073254 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ce801b070 con 0x56118dedd8d0 2024-09-17T01:35:44.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.236+0000 7f8ce3400640 1 -- 172.21.15.42:0/459073254 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8025070 con 0x56118dedd8d0 2024-09-17T01:35:44.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.237+0000 7f8d05645740 1 -- 172.21.15.42:0/459073254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dedd8d0 msgr2=0x56118e2f6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:44.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.237+0000 7f8d05645740 1 --2- 172.21.15.42:0/459073254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dedd8d0 0x56118e2f6420 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8001550 tx=0x7f8ce8007ea0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.237+0000 7f8d05645740 1 -- 172.21.15.42:0/459073254 shutdown_connections 2024-09-17T01:35:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.237+0000 7f8d05645740 1 --2- 172.21.15.42:0/459073254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56118dee5ab0 0x56118e2d7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.237+0000 7f8d05645740 1 --2- 172.21.15.42:0/459073254 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56118df06790 0x56118e2d8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.237+0000 7f8d05645740 1 --2- 172.21.15.42:0/459073254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dedd8d0 0x56118e2f6420 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.237+0000 7f8d05645740 1 -- 172.21.15.42:0/459073254 >> 172.21.15.42:0/459073254 conn(0x56118defa8e0 msgr2=0x56118e2a3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.237+0000 7f8d05645740 1 -- 172.21.15.42:0/459073254 shutdown_connections 2024-09-17T01:35:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.237+0000 7f8d05645740 1 -- 172.21.15.42:0/459073254 wait complete. 2024-09-17T01:35:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.238+0000 7f8d05645740 1 -- start start 2024-09-17T01:35:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.238+0000 7f8d05645740 1 Processor -- start 2024-09-17T01:35:44.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.240+0000 7f8d05645740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56118dedd8d0 0x56118e36ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.240+0000 7f8d05645740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dee5ab0 0x56118e2d3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.240+0000 7f8d05645740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56118df06790 0x56118e376060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.240+0000 7f8d05645740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56118e2b4f10 con 0x56118dee5ab0 2024-09-17T01:35:44.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.240+0000 7f8d05645740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf8200d90 con 0x56118dedd8d0 2024-09-17T01:35:44.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.240+0000 7f8d05645740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56118e2aee90 con 0x56118df06790 2024-09-17T01:35:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.240+0000 7f8d05645740 10 client.0 _ll_register_callbacks cb 0x7f8ce800fe80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.240+0000 7f8cf7400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56118dedd8d0 0x56118e36ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.240+0000 7f8cf6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dee5ab0 0x56118e2d3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.240+0000 7f8cf7400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56118dedd8d0 0x56118e36ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:50146/0 (socket says 172.21.15.42:50146) 2024-09-17T01:35:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.240+0000 7f8cf7400640 1 -- 172.21.15.42:0/3100406120 learned_addr learned my addr 172.21.15.42:0/3100406120 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.240+0000 7f8cf7e00640 1 --2- 172.21.15.42:0/3100406120 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56118df06790 0x56118e376060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.240+0000 7f8cf6a00640 1 -- 172.21.15.42:0/3100406120 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56118df06790 msgr2=0x56118e376060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.240+0000 7f8cf6a00640 1 --2- 172.21.15.42:0/3100406120 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56118df06790 0x56118e376060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.241+0000 7f8cf6a00640 1 -- 172.21.15.42:0/3100406120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56118dedd8d0 msgr2=0x56118e36ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.241+0000 7f8cf6a00640 1 --2- 172.21.15.42:0/3100406120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56118dedd8d0 0x56118e36ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.241+0000 7f8cf6a00640 1 -- 172.21.15.42:0/3100406120 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56118dfe8f00 con 0x56118dee5ab0 2024-09-17T01:35:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.241+0000 7f8cf7400640 1 --2- 172.21.15.42:0/3100406120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56118dedd8d0 0x56118e36ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:35:44.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.241+0000 7f8cf6a00640 1 --2- 172.21.15.42:0/3100406120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dee5ab0 0x56118e2d3350 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f8ce405fbd0 tx=0x7f8ce40625a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ad3e489ef4cd0c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.241+0000 7f8ce0c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.241+0000 7f8ce0c00640 1 -- 172.21.15.42:0/3100406120 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce407c040 con 0x56118dee5ab0 2024-09-17T01:35:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.241+0000 7f8ce0c00640 1 -- 172.21.15.42:0/3100406120 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f8ce4063de0 con 0x56118dee5ab0 2024-09-17T01:35:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.241+0000 7f8d05645740 1 -- 172.21.15.42:0/3100406120 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ce801b070 con 0x56118dee5ab0 2024-09-17T01:35:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.241+0000 7f8ce0c00640 1 -- 172.21.15.42:0/3100406120 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8ce4067100 con 0x56118dee5ab0 2024-09-17T01:35:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.241+0000 7f8d05645740 10 client.5955 fetch_fsmap learned FSMap version 30 2024-09-17T01:35:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.241+0000 7f8d05645740 1 -- 172.21.15.42:0/3100406120 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x56118e3769b0 con 0x56118dee5ab0 2024-09-17T01:35:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.242+0000 7f8ce0c00640 1 -- 172.21.15.42:0/3100406120 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ce801b070 con 0x56118dee5ab0 2024-09-17T01:35:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.242+0000 7f8ce0c00640 1 -- 172.21.15.42:0/3100406120 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7f8ce4061bc0 con 0x56118dee5ab0 2024-09-17T01:35:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.242+0000 7f8d05645740 10 client.5955 fetch_fsmap finished waiting for FSMap version 30 2024-09-17T01:35:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.242+0000 7f8d05645740 10 client.5955 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.242+0000 7f8d05645740 20 client.5955 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:44.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.242+0000 7f8d05645740 1 --2- 172.21.15.42:0/3100406120 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56118e2d7ef0 0x56118e2d8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.242+0000 7f8d05645740 4 client.5955 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2024-09-17T01:35:44.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.242+0000 7f8d05645740 1 -- 172.21.15.42:0/3100406120 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) -- 0x56118e21e430 con 0x56118e2d7ef0 2024-09-17T01:35:44.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.242+0000 7f8cf7400640 1 --2- 172.21.15.42:0/3100406120 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56118e2d7ef0 0x56118e2d8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.243+0000 7f8cf7400640 1 --2- 172.21.15.42:0/3100406120 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56118e2d7ef0 0x56118e2d8300 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b38740269aef03f8 server_cookie=3a1047571d3724a7 in_seq=0 out_seq=0 2024-09-17T01:35:44.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.243+0000 7f8ce0c00640 10 client.5955 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:44.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.243+0000 7f8ce0c00640 1 -- 172.21.15.42:0/3100406120 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56118e21e430 con 0x56118e2d7ef0 2024-09-17T01:35:44.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.243+0000 7f8ce0c00640 10 client.5955 handle_command_reply: tid=0 2024-09-17T01:35:44.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.243+0000 7f8d05645740 1 client.5955 shutdown 2024-09-17T01:35:44.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.243+0000 7f8d05645740 1 -- 172.21.15.42:0/3100406120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dee5ab0 msgr2=0x56118e2d3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:44.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.243+0000 7f8d05645740 1 --2- 172.21.15.42:0/3100406120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dee5ab0 0x56118e2d3350 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f8ce405fbd0 tx=0x7f8ce40625a0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.244+0000 7f8d05645740 1 -- 172.21.15.42:0/3100406120 shutdown_connections 2024-09-17T01:35:44.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.244+0000 7f8d05645740 1 --2- 172.21.15.42:0/3100406120 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x56118e2d7ef0 0x56118e2d8300 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.244+0000 7f8d05645740 1 --2- 172.21.15.42:0/3100406120 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56118df06790 0x56118e376060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.244+0000 7f8d05645740 1 --2- 172.21.15.42:0/3100406120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56118dee5ab0 0x56118e2d3350 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.244+0000 7f8d05645740 1 --2- 172.21.15.42:0/3100406120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56118dedd8d0 0x56118e36ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.244+0000 7f8d05645740 1 -- 172.21.15.42:0/3100406120 >> 172.21.15.42:0/3100406120 conn(0x56118defa8e0 msgr2=0x56118e2af1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:44.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.244+0000 7f8ce0c00640 0 client.5955 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:44.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.244+0000 7f8d05645740 1 -- 172.21.15.42:0/3100406120 shutdown_connections 2024-09-17T01:35:44.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.244+0000 7f8d05645740 1 -- 172.21.15.42:0/3100406120 wait complete. 2024-09-17T01:35:44.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.244+0000 7f8d05645740 20 client.5955 trim_cache size 0 max 16384 2024-09-17T01:35:44.246 INFO:tasks.ceph.mds.c.smithi042.stderr:2024-09-17T01:35:44.244+0000 7f1950c00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a4e [2,head] /scrub_test_path/ceph-qa-suite/new_file_1 auth v459 pv461 ap=4 s=0 n(v0 1=1+0)->n(v0 rc2024-09-17T01:35:43.024806+0000 b1048576 1=1+0) (iauth excl) (ifile lock->excl w=1) (ixattr excl) (iquiesce lock w=1) cr={5356=0-4194304@1} caps={5356=pAsxLsXsxFcb/pAsxXsxFxwb@3},l=5356 | ptrwaiter=1 request=1 lock=3 caps=1 dirtyparent=0 dirty=0 waiter=1 authpin=1 scrubqueue=0 0x557113fe2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000a4e:[<0x10000000001/new_file_1 v459>,<0x10000000000/ceph-qa-suite v72>,<0x1/scrub_test_path v30>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-09-17T01:35:44.247 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:44.247 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-17T01:35:44.247 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "0a3e0898-b504-4a99-b50d-430316b9ef6c", 2024-09-17T01:35:44.247 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-17T01:35:44.247 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:44.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.245+0000 7f8cfce00640 1 -- 172.21.15.42:0/1807225619 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8cd8078bc0 msgr2=0x7f8cd807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:44.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.245+0000 7f8cfce00640 1 --2- 172.21.15.42:0/1807225619 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8cd8078bc0 0x7f8cd807b0d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8001720 tx=0x7f8ce8009040 comp rx=0 tx=0).stop 2024-09-17T01:35:44.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.245+0000 7f8cfce00640 1 -- 172.21.15.42:0/1807225619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cf80cf7c0 msgr2=0x7f8cf814b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:44.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.245+0000 7f8cfce00640 1 --2- 172.21.15.42:0/1807225619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cf80cf7c0 0x7f8cf814b740 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8ce400b3f0 tx=0x7f8ce400b8b0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.245+0000 7f8cfce00640 1 -- 172.21.15.42:0/1807225619 shutdown_connections 2024-09-17T01:35:44.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.245+0000 7f8cfce00640 1 --2- 172.21.15.42:0/1807225619 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8cd8078bc0 0x7f8cd807b0d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.245+0000 7f8cfce00640 1 --2- 172.21.15.42:0/1807225619 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cf80c9420 0x7f8cf80c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.245+0000 7f8cfce00640 1 --2- 172.21.15.42:0/1807225619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cf80cf7c0 0x7f8cf814b740 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.245+0000 7f8cfce00640 1 --2- 172.21.15.42:0/1807225619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cf80b4be0 0x7f8cf8153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.245+0000 7f8cfce00640 1 -- 172.21.15.42:0/1807225619 >> 172.21.15.42:0/1807225619 conn(0x7f8cf80b25f0 msgr2=0x7f8cf815f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:44.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.245+0000 7f8cfce00640 1 -- 172.21.15.42:0/1807225619 shutdown_connections 2024-09-17T01:35:44.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.245+0000 7f8cfce00640 1 -- 172.21.15.42:0/1807225619 wait complete. 2024-09-17T01:35:44.265 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'return_code': 0, 'scrub_tag': '0a3e0898-b504-4a99-b50d-430316b9ef6c', 'mode': 'asynchronous'}' 2024-09-17T01:35:44.265 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T01:35:44.265 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-17T01:35:44.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.497+0000 7f7ae7600640 1 -- 172.21.15.42:0/2362068365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ae00b5450 msgr2=0x7f7ae00b5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:44.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.497+0000 7f7ae7600640 1 --2- 172.21.15.42:0/2362068365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ae00b5450 0x7f7ae00b5860 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7ae00714c0 tx=0x7f7acc02a560 comp rx=0 tx=0).stop 2024-09-17T01:35:44.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.498+0000 7f7ae7600640 1 -- 172.21.15.42:0/2362068365 shutdown_connections 2024-09-17T01:35:44.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.498+0000 7f7ae7600640 1 --2- 172.21.15.42:0/2362068365 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ae015f390 0x7f7ae015f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.498+0000 7f7ae7600640 1 --2- 172.21.15.42:0/2362068365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ae00b5450 0x7f7ae00b5860 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.498+0000 7f7ae7600640 1 --2- 172.21.15.42:0/2362068365 >> v2:172.21.15.43:3300/0 conn(0x7f7ae0145210 0x7f7ae0070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.498+0000 7f7ae7600640 1 -- 172.21.15.42:0/2362068365 >> 172.21.15.42:0/2362068365 conn(0x7f7ae00746c0 msgr2=0x7f7ae006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:44.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.498+0000 7f7ae7600640 1 -- 172.21.15.42:0/2362068365 shutdown_connections 2024-09-17T01:35:44.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.498+0000 7f7ae7600640 1 -- 172.21.15.42:0/2362068365 wait complete. 2024-09-17T01:35:44.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.500+0000 7f7ae7600640 1 Processor -- start 2024-09-17T01:35:44.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.500+0000 7f7ae7600640 1 -- start start 2024-09-17T01:35:44.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.501+0000 7f7ae7600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ae00b5450 0x7f7ae00aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.501+0000 7f7ae7600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ae0145210 0x7f7ae01410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.502+0000 7f7ae7600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ae015f390 0x7f7ae015dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.502+0000 7f7ae7600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae00d0b40 con 0x7f7ae0145210 2024-09-17T01:35:44.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.502+0000 7f7ae7600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae00b76f0 con 0x7f7ae015f390 2024-09-17T01:35:44.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.502+0000 7f7ae7600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7ae00d0cc0 con 0x7f7ae00b5450 2024-09-17T01:35:44.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.502+0000 7f7adfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ae0145210 0x7f7ae01410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.502+0000 7f7adfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ae0145210 0x7f7ae01410b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38116/0 (socket says 172.21.15.42:38116) 2024-09-17T01:35:44.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.502+0000 7f7adfe00640 1 -- 172.21.15.42:0/3587068051 learned_addr learned my addr 172.21.15.42:0/3587068051 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:44.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.502+0000 7f7ae4c00640 1 --2- 172.21.15.42:0/3587068051 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ae00b5450 0x7f7ae00aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.502+0000 7f7ae5600640 1 --2- 172.21.15.42:0/3587068051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ae015f390 0x7f7ae015dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.502+0000 7f7adfe00640 1 -- 172.21.15.42:0/3587068051 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ae00b5450 msgr2=0x7f7ae00aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:44.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.502+0000 7f7adfe00640 1 --2- 172.21.15.42:0/3587068051 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ae00b5450 0x7f7ae00aa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.502+0000 7f7adfe00640 1 -- 172.21.15.42:0/3587068051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ae015f390 msgr2=0x7f7ae015dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:44.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.502+0000 7f7adfe00640 1 --2- 172.21.15.42:0/3587068051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ae015f390 0x7f7ae015dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.502+0000 7f7adfe00640 1 -- 172.21.15.42:0/3587068051 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae01f6230 con 0x7f7ae0145210 2024-09-17T01:35:44.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.503+0000 7f7adfe00640 1 --2- 172.21.15.42:0/3587068051 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ae0145210 0x7f7ae01410b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7acc034040 tx=0x7f7acc003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:44.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.503+0000 7f7adcc00640 1 -- 172.21.15.42:0/3587068051 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7acc03e030 con 0x7f7ae0145210 2024-09-17T01:35:44.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.503+0000 7f7adcc00640 1 -- 172.21.15.42:0/3587068051 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7acc003e00 con 0x7f7ae0145210 2024-09-17T01:35:44.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.503+0000 7f7adcc00640 1 -- 172.21.15.42:0/3587068051 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7acc035040 con 0x7f7ae0145210 2024-09-17T01:35:44.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.503+0000 7f7ae7600640 1 -- 172.21.15.42:0/3587068051 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae01f6510 con 0x7f7ae0145210 2024-09-17T01:35:44.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.503+0000 7f7ae7600640 1 -- 172.21.15.42:0/3587068051 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae01f6ad0 con 0x7f7ae0145210 2024-09-17T01:35:44.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.506+0000 7f7adcc00640 1 -- 172.21.15.42:0/3587068051 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7acc041030 con 0x7f7ae0145210 2024-09-17T01:35:44.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.507+0000 7f7adcc00640 1 --2- 172.21.15.42:0/3587068051 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7ac0078b90 0x7f7ac007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.507+0000 7f7adcc00640 1 -- 172.21.15.42:0/3587068051 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f7acc0bb4d0 con 0x7f7ae0145210 2024-09-17T01:35:44.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.507+0000 7f7aee801740 1 Processor -- start 2024-09-17T01:35:44.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.507+0000 7f7ae4c00640 1 --2- 172.21.15.42:0/3587068051 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7ac0078b90 0x7f7ac007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.507+0000 7f7aee801740 1 -- start start 2024-09-17T01:35:44.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.508+0000 7f7ae4c00640 1 --2- 172.21.15.42:0/3587068051 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7ac0078b90 0x7f7ac007b0a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4005fd0 tx=0x7f7ad400b260 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.509+0000 7f7aee801740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558d8106f390 0x558d8145d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.509+0000 7f7aee801740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558d810464d0 0x558d81440220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.509+0000 7f7aee801740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8104e6b0 0x558d81440760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.509+0000 7f7aee801740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558d813761c0 con 0x558d8104e6b0 2024-09-17T01:35:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.509+0000 7f7aee801740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558d81389870 con 0x558d810464d0 2024-09-17T01:35:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.509+0000 7f7aee801740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558d81378ca0 con 0x558d8106f390 2024-09-17T01:35:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.509+0000 7f7ae5600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8104e6b0 0x558d81440760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.509+0000 7f7ae5600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8104e6b0 0x558d81440760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38132/0 (socket says 172.21.15.42:38132) 2024-09-17T01:35:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.509+0000 7f7ae5600640 1 -- 172.21.15.42:0/3860679633 learned_addr learned my addr 172.21.15.42:0/3860679633 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.509+0000 7f7adfe00640 1 --2- 172.21.15.42:0/3860679633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558d810464d0 0x558d81440220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.509+0000 7f7ae4c00640 1 --2- 172.21.15.42:0/3860679633 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558d8106f390 0x558d8145d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.509+0000 7f7ae5600640 1 -- 172.21.15.42:0/3860679633 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558d8106f390 msgr2=0x558d8145d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.509+0000 7f7ae5600640 1 --2- 172.21.15.42:0/3860679633 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558d8106f390 0x558d8145d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.509+0000 7f7ae5600640 1 -- 172.21.15.42:0/3860679633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558d810464d0 msgr2=0x558d81440220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:44.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.509+0000 7f7ae5600640 1 --2- 172.21.15.42:0/3860679633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558d810464d0 0x558d81440220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.509+0000 7f7ae5600640 1 -- 172.21.15.42:0/3860679633 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d811517d0 con 0x558d8104e6b0 2024-09-17T01:35:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.509+0000 7f7adfe00640 1 --2- 172.21.15.42:0/3860679633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558d810464d0 0x558d81440220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.510+0000 7f7ae5600640 1 --2- 172.21.15.42:0/3860679633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8104e6b0 0x558d81440760 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8009f80 tx=0x7f7ad8010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76d1954897fb0294 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.510+0000 7f7ad1200640 1 -- 172.21.15.42:0/3860679633 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8016070 con 0x558d8104e6b0 2024-09-17T01:35:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.510+0000 7f7ad1200640 1 -- 172.21.15.42:0/3860679633 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ad8004e10 con 0x558d8104e6b0 2024-09-17T01:35:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.510+0000 7f7ad1200640 1 -- 172.21.15.42:0/3860679633 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8012750 con 0x558d8104e6b0 2024-09-17T01:35:44.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.511+0000 7f7aee801740 1 -- 172.21.15.42:0/3860679633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8104e6b0 msgr2=0x558d81440760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:44.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.511+0000 7f7aee801740 1 --2- 172.21.15.42:0/3860679633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8104e6b0 0x558d81440760 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8009f80 tx=0x7f7ad8010800 comp rx=0 tx=0).stop 2024-09-17T01:35:44.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.511+0000 7f7aee801740 1 -- 172.21.15.42:0/3860679633 shutdown_connections 2024-09-17T01:35:44.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.511+0000 7f7aee801740 1 --2- 172.21.15.42:0/3860679633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558d810464d0 0x558d81440220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.511+0000 7f7aee801740 1 --2- 172.21.15.42:0/3860679633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8104e6b0 0x558d81440760 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.511+0000 7f7aee801740 1 --2- 172.21.15.42:0/3860679633 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558d8106f390 0x558d8145d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.511+0000 7f7aee801740 1 -- 172.21.15.42:0/3860679633 >> 172.21.15.42:0/3860679633 conn(0x558d810634e0 msgr2=0x558d81416440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:44.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.511+0000 7f7aee801740 1 -- 172.21.15.42:0/3860679633 shutdown_connections 2024-09-17T01:35:44.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.511+0000 7f7aee801740 1 -- 172.21.15.42:0/3860679633 wait complete. 2024-09-17T01:35:44.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.512+0000 7f7aee801740 1 -- start start 2024-09-17T01:35:44.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.512+0000 7f7aee801740 1 Processor -- start 2024-09-17T01:35:44.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.514+0000 7f7aee801740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558d810464d0 0x558d8142e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.514+0000 7f7aee801740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8104e6b0 0x558d8143cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.514+0000 7f7aee801740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558d8106f390 0x558d8146d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.514+0000 7f7aee801740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558d8131f410 con 0x558d8104e6b0 2024-09-17T01:35:44.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.514+0000 7f7aee801740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558d8137cab0 con 0x558d8106f390 2024-09-17T01:35:44.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.514+0000 7f7aee801740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558d810e9740 con 0x558d810464d0 2024-09-17T01:35:44.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.514+0000 7f7aee801740 10 client.0 _ll_register_callbacks cb 0x558d812fc360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:44.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.514+0000 7f7adfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8104e6b0 0x558d8143cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.514+0000 7f7adfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8104e6b0 0x558d8143cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38148/0 (socket says 172.21.15.42:38148) 2024-09-17T01:35:44.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.514+0000 7f7adfe00640 1 -- 172.21.15.42:0/3164080257 learned_addr learned my addr 172.21.15.42:0/3164080257 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:44.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.514+0000 7f7ae4c00640 1 --2- 172.21.15.42:0/3164080257 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558d810464d0 0x558d8142e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.514+0000 7f7ae5600640 1 --2- 172.21.15.42:0/3164080257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558d8106f390 0x558d8146d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.514+0000 7f7adfe00640 1 -- 172.21.15.42:0/3164080257 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558d810464d0 msgr2=0x558d8142e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:44.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.514+0000 7f7adfe00640 1 --2- 172.21.15.42:0/3164080257 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558d810464d0 0x558d8142e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.514+0000 7f7adfe00640 1 -- 172.21.15.42:0/3164080257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558d8106f390 msgr2=0x558d8146d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:44.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.514+0000 7f7adfe00640 1 --2- 172.21.15.42:0/3164080257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558d8106f390 0x558d8146d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.514+0000 7f7adfe00640 1 -- 172.21.15.42:0/3164080257 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d810da970 con 0x558d8104e6b0 2024-09-17T01:35:44.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.514+0000 7f7ae5600640 1 --2- 172.21.15.42:0/3164080257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558d8106f390 0x558d8146d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:44.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.515+0000 7f7adfe00640 1 --2- 172.21.15.42:0/3164080257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8104e6b0 0x558d8143cf80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f7acc080520 tx=0x7f7acc082cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b3aa77fe2f773 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:44.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.515+0000 7f7ac5600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:44.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.515+0000 7f7ac5600640 1 -- 172.21.15.42:0/3164080257 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7acc048040 con 0x558d8104e6b0 2024-09-17T01:35:44.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.515+0000 7f7ac5600640 1 -- 172.21.15.42:0/3164080257 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f7acc08c700 con 0x558d8104e6b0 2024-09-17T01:35:44.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.515+0000 7f7aee801740 1 -- 172.21.15.42:0/3164080257 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ad8004e10 con 0x558d8104e6b0 2024-09-17T01:35:44.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.515+0000 7f7ac5600640 1 -- 172.21.15.42:0/3164080257 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7acc087ce0 con 0x558d8104e6b0 2024-09-17T01:35:44.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.515+0000 7f7aee801740 10 client.5967 fetch_fsmap learned FSMap version 30 2024-09-17T01:35:44.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.515+0000 7f7aee801740 1 -- 172.21.15.42:0/3164080257 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x558d810b86a0 con 0x558d8104e6b0 2024-09-17T01:35:44.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.515+0000 7f7ac5600640 1 -- 172.21.15.42:0/3164080257 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ad8004e10 con 0x558d8104e6b0 2024-09-17T01:35:44.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.515+0000 7f7ac5600640 1 -- 172.21.15.42:0/3164080257 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7f7acc082510 con 0x558d8104e6b0 2024-09-17T01:35:44.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.515+0000 7f7aee801740 10 client.5967 fetch_fsmap finished waiting for FSMap version 30 2024-09-17T01:35:44.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.515+0000 7f7aee801740 10 client.5967 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:44.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.515+0000 7f7aee801740 20 client.5967 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:44.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.515+0000 7f7aee801740 1 --2- 172.21.15.42:0/3164080257 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558d8102df60 0x558d81455860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.515+0000 7f7aee801740 4 client.5967 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:44.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.515+0000 7f7aee801740 1 -- 172.21.15.42:0/3164080257 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d8138b7c0 con 0x558d8102df60 2024-09-17T01:35:44.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.516+0000 7f7ae4c00640 1 --2- 172.21.15.42:0/3164080257 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558d8102df60 0x558d81455860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.516+0000 7f7ae4c00640 1 --2- 172.21.15.42:0/3164080257 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558d8102df60 0x558d81455860 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38928d9758d2319f server_cookie=43def73336f3d9f5 in_seq=0 out_seq=0 2024-09-17T01:35:44.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.516+0000 7f7ac5600640 10 client.5967 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:44.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.517+0000 7f7ac5600640 1 -- 172.21.15.42:0/3164080257 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558d8138b7c0 con 0x558d8102df60 2024-09-17T01:35:44.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.517+0000 7f7ac5600640 10 client.5967 handle_command_reply: tid=0 2024-09-17T01:35:44.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.517+0000 7f7aee801740 1 client.5967 shutdown 2024-09-17T01:35:44.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.517+0000 7f7aee801740 1 -- 172.21.15.42:0/3164080257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8104e6b0 msgr2=0x558d8143cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:44.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.517+0000 7f7aee801740 1 --2- 172.21.15.42:0/3164080257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8104e6b0 0x558d8143cf80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f7acc080520 tx=0x7f7acc082cc0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.517+0000 7f7aee801740 1 -- 172.21.15.42:0/3164080257 shutdown_connections 2024-09-17T01:35:44.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.517+0000 7f7aee801740 1 --2- 172.21.15.42:0/3164080257 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558d8102df60 0x558d81455860 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.517+0000 7f7aee801740 1 --2- 172.21.15.42:0/3164080257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558d8106f390 0x558d8146d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.517+0000 7f7aee801740 1 --2- 172.21.15.42:0/3164080257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8104e6b0 0x558d8143cf80 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.517+0000 7f7ac5600640 0 client.5967 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:44.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.517+0000 7f7aee801740 1 --2- 172.21.15.42:0/3164080257 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558d810464d0 0x558d8142e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.517+0000 7f7aee801740 1 -- 172.21.15.42:0/3164080257 >> 172.21.15.42:0/3164080257 conn(0x558d810634e0 msgr2=0x558d8140f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:44.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.518+0000 7f7aee801740 1 -- 172.21.15.42:0/3164080257 shutdown_connections 2024-09-17T01:35:44.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.518+0000 7f7aee801740 1 -- 172.21.15.42:0/3164080257 wait complete. 2024-09-17T01:35:44.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.518+0000 7f7aee801740 20 client.5967 trim_cache size 0 max 16384 2024-09-17T01:35:44.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.536+0000 7f7aee801740 1 Processor -- start 2024-09-17T01:35:44.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.536+0000 7f7aee801740 1 -- start start 2024-09-17T01:35:44.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.538+0000 7f7aee801740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558d810464d0 0x558d81417310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.538+0000 7f7aee801740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558d8104e6b0 0x558d81417850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.538+0000 7f7aee801740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8106f390 0x558d81416260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.538+0000 7f7aee801740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae0202290 con 0x558d8106f390 2024-09-17T01:35:44.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.538+0000 7f7aee801740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae0165510 con 0x558d810464d0 2024-09-17T01:35:44.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.538+0000 7f7aee801740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7ae01648d0 con 0x558d8104e6b0 2024-09-17T01:35:44.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.538+0000 7f7ae5600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8106f390 0x558d81416260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.538+0000 7f7ae5600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8106f390 0x558d81416260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38156/0 (socket says 172.21.15.42:38156) 2024-09-17T01:35:44.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.538+0000 7f7ae5600640 1 -- 172.21.15.42:0/1567169141 learned_addr learned my addr 172.21.15.42:0/1567169141 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:44.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.538+0000 7f7ae4c00640 1 --2- 172.21.15.42:0/1567169141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558d810464d0 0x558d81417310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.538+0000 7f7adfe00640 1 --2- 172.21.15.42:0/1567169141 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558d8104e6b0 0x558d81417850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.538+0000 7f7ae5600640 1 -- 172.21.15.42:0/1567169141 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558d8104e6b0 msgr2=0x558d81417850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:44.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.538+0000 7f7ae5600640 1 --2- 172.21.15.42:0/1567169141 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558d8104e6b0 0x558d81417850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.538+0000 7f7ae5600640 1 -- 172.21.15.42:0/1567169141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558d810464d0 msgr2=0x558d81417310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:44.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.538+0000 7f7ae5600640 1 --2- 172.21.15.42:0/1567169141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558d810464d0 0x558d81417310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.538+0000 7f7ae5600640 1 -- 172.21.15.42:0/1567169141 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d81440ad0 con 0x558d8106f390 2024-09-17T01:35:44.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.538+0000 7f7adfe00640 1 --2- 172.21.15.42:0/1567169141 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558d8104e6b0 0x558d81417850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:44.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.539+0000 7f7ae5600640 1 --2- 172.21.15.42:0/1567169141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8106f390 0x558d81416260 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8000f80 tx=0x7f7ad8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa4b6237cd44186 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:44.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.539+0000 7f7ac7e00640 1 -- 172.21.15.42:0/1567169141 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8029070 con 0x558d8106f390 2024-09-17T01:35:44.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.539+0000 7f7ac7e00640 1 -- 172.21.15.42:0/1567169141 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ad8003b90 con 0x558d8106f390 2024-09-17T01:35:44.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.539+0000 7f7ac7e00640 1 -- 172.21.15.42:0/1567169141 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8016050 con 0x558d8106f390 2024-09-17T01:35:44.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.540+0000 7f7aee801740 1 -- 172.21.15.42:0/1567169141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8106f390 msgr2=0x558d81416260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:44.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.540+0000 7f7aee801740 1 --2- 172.21.15.42:0/1567169141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8106f390 0x558d81416260 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8000f80 tx=0x7f7ad8004ab0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.540+0000 7f7aee801740 1 -- 172.21.15.42:0/1567169141 shutdown_connections 2024-09-17T01:35:44.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.540+0000 7f7aee801740 1 --2- 172.21.15.42:0/1567169141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8106f390 0x558d81416260 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.540+0000 7f7aee801740 1 --2- 172.21.15.42:0/1567169141 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558d8104e6b0 0x558d81417850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.540+0000 7f7aee801740 1 --2- 172.21.15.42:0/1567169141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558d810464d0 0x558d81417310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.540+0000 7f7aee801740 1 -- 172.21.15.42:0/1567169141 >> 172.21.15.42:0/1567169141 conn(0x558d810634e0 msgr2=0x558d8142f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:44.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.540+0000 7f7aee801740 1 -- 172.21.15.42:0/1567169141 shutdown_connections 2024-09-17T01:35:44.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.540+0000 7f7aee801740 1 -- 172.21.15.42:0/1567169141 wait complete. 2024-09-17T01:35:44.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.541+0000 7f7aee801740 1 -- start start 2024-09-17T01:35:44.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.541+0000 7f7aee801740 1 Processor -- start 2024-09-17T01:35:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.543+0000 7f7aee801740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558d810464d0 0x558d814d9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.543+0000 7f7aee801740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558d8104e6b0 0x558d8145d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.543+0000 7f7aee801740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8106f390 0x558d814665f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.543+0000 7f7aee801740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae0164ec0 con 0x558d8106f390 2024-09-17T01:35:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.543+0000 7f7aee801740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558d81454e90 con 0x558d810464d0 2024-09-17T01:35:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.543+0000 7f7aee801740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558d8147d300 con 0x558d8104e6b0 2024-09-17T01:35:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.543+0000 7f7aee801740 10 client.0 _ll_register_callbacks cb 0x7f7ad4005e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.543+0000 7f7ae5600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8106f390 0x558d814665f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.543+0000 7f7ae5600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8106f390 0x558d814665f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38170/0 (socket says 172.21.15.42:38170) 2024-09-17T01:35:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.543+0000 7f7ae5600640 1 -- 172.21.15.42:0/263939209 learned_addr learned my addr 172.21.15.42:0/263939209 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.543+0000 7f7ae4c00640 1 --2- 172.21.15.42:0/263939209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558d810464d0 0x558d814d9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.543+0000 7f7adfe00640 1 --2- 172.21.15.42:0/263939209 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558d8104e6b0 0x558d8145d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.543+0000 7f7ae5600640 1 -- 172.21.15.42:0/263939209 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558d8104e6b0 msgr2=0x558d8145d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.543+0000 7f7ae5600640 1 --2- 172.21.15.42:0/263939209 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558d8104e6b0 0x558d8145d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.543+0000 7f7ae5600640 1 -- 172.21.15.42:0/263939209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558d810464d0 msgr2=0x558d814d9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.543+0000 7f7ae5600640 1 --2- 172.21.15.42:0/263939209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558d810464d0 0x558d814d9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.543+0000 7f7ae5600640 1 -- 172.21.15.42:0/263939209 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d81417a20 con 0x558d8106f390 2024-09-17T01:35:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.544+0000 7f7ae5600640 1 --2- 172.21.15.42:0/263939209 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8106f390 0x558d814665f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8015040 tx=0x7f7ad8009c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b69f89e66db198a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.544+0000 7f7ac5600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.544+0000 7f7ac5600640 1 -- 172.21.15.42:0/263939209 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8033060 con 0x558d8106f390 2024-09-17T01:35:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.544+0000 7f7ac5600640 1 -- 172.21.15.42:0/263939209 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f7ad8012920 con 0x558d8106f390 2024-09-17T01:35:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.544+0000 7f7aee801740 1 -- 172.21.15.42:0/263939209 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ad8003b90 con 0x558d8106f390 2024-09-17T01:35:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.544+0000 7f7ac5600640 1 -- 172.21.15.42:0/263939209 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7ad8039050 con 0x558d8106f390 2024-09-17T01:35:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.544+0000 7f7aee801740 10 client.5973 fetch_fsmap learned FSMap version 30 2024-09-17T01:35:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.544+0000 7f7aee801740 1 -- 172.21.15.42:0/263939209 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x558d814da030 con 0x558d8106f390 2024-09-17T01:35:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.544+0000 7f7ac5600640 1 -- 172.21.15.42:0/263939209 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ad8003b90 con 0x558d8106f390 2024-09-17T01:35:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.545+0000 7f7ac5600640 1 -- 172.21.15.42:0/263939209 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7f7ad803c020 con 0x558d8106f390 2024-09-17T01:35:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.545+0000 7f7aee801740 10 client.5973 fetch_fsmap finished waiting for FSMap version 30 2024-09-17T01:35:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.545+0000 7f7aee801740 10 client.5973 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.545+0000 7f7aee801740 20 client.5973 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.545+0000 7f7aee801740 1 --2- 172.21.15.42:0/263939209 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558d8145d640 0x558d81466b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.545+0000 7f7aee801740 4 client.5973 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:35:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.545+0000 7f7aee801740 1 -- 172.21.15.42:0/263939209 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558d81387270 con 0x558d8145d640 2024-09-17T01:35:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.545+0000 7f7ae4c00640 1 --2- 172.21.15.42:0/263939209 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558d8145d640 0x558d81466b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.545+0000 7f7ae4c00640 1 --2- 172.21.15.42:0/263939209 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558d8145d640 0x558d81466b30 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c63b55d9aa3a113 server_cookie=e042c5ba7e7f0def in_seq=0 out_seq=0 2024-09-17T01:35:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.545+0000 7f7ac5600640 10 client.5973 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.546+0000 7f7ac5600640 1 -- 172.21.15.42:0/263939209 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3494 (crc 0 0 0) 0x558d81387270 con 0x558d8145d640 2024-09-17T01:35:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.546+0000 7f7ac5600640 10 client.5973 handle_command_reply: tid=0 2024-09-17T01:35:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.546+0000 7f7aee801740 1 client.5973 shutdown 2024-09-17T01:35:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.546+0000 7f7aee801740 1 -- 172.21.15.42:0/263939209 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8106f390 msgr2=0x558d814665f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.546+0000 7f7aee801740 1 --2- 172.21.15.42:0/263939209 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8106f390 0x558d814665f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8015040 tx=0x7f7ad8009c10 comp rx=0 tx=0).stop 2024-09-17T01:35:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.546+0000 7f7aee801740 1 -- 172.21.15.42:0/263939209 shutdown_connections 2024-09-17T01:35:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.546+0000 7f7aee801740 1 --2- 172.21.15.42:0/263939209 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558d8145d640 0x558d81466b30 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.546+0000 7f7aee801740 1 --2- 172.21.15.42:0/263939209 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558d8106f390 0x558d814665f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.546+0000 7f7aee801740 1 --2- 172.21.15.42:0/263939209 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558d8104e6b0 0x558d8145d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.546+0000 7f7aee801740 1 --2- 172.21.15.42:0/263939209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558d810464d0 0x558d814d9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.546+0000 7f7aee801740 1 -- 172.21.15.42:0/263939209 >> 172.21.15.42:0/263939209 conn(0x558d810634e0 msgr2=0x558d81417310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.546+0000 7f7ac5600640 0 client.5973 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.546+0000 7f7aee801740 1 -- 172.21.15.42:0/263939209 shutdown_connections 2024-09-17T01:35:44.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.546+0000 7f7aee801740 1 -- 172.21.15.42:0/263939209 wait complete. 2024-09-17T01:35:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.547+0000 7f7aee801740 20 client.5973 trim_cache size 0 max 16384 2024-09-17T01:35:44.550 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:44.550 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T01:35:44.550 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-09-17T01:35:44.550 INFO:teuthology.orchestra.run.smithi042.stdout: "0a3e0898-b504-4a99-b50d-430316b9ef6c": { 2024-09-17T01:35:44.550 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1", 2024-09-17T01:35:44.550 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "0a3e0898-b504-4a99-b50d-430316b9ef6c", 2024-09-17T01:35:44.550 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "" 2024-09-17T01:35:44.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: "97a36f58-64a4-4cdc-be7b-bf937c7480b0": { 2024-09-17T01:35:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-17T01:35:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "97a36f58-64a4-4cdc-be7b-bf937c7480b0", 2024-09-17T01:35:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "" 2024-09-17T01:35:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: "b5862f57-9478-4629-a66e-83eb1b5c23ee": { 2024-09-17T01:35:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-17T01:35:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "b5862f57-9478-4629-a66e-83eb1b5c23ee", 2024-09-17T01:35:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "" 2024-09-17T01:35:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: "ffb2ac9a-c36e-4852-9189-6f5c07718d47": { 2024-09-17T01:35:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-17T01:35:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "ffb2ac9a-c36e-4852-9189-6f5c07718d47", 2024-09-17T01:35:44.551 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "" 2024-09-17T01:35:44.552 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:44.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:44.552 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_stats": { 2024-09-17T01:35:44.552 INFO:teuthology.orchestra.run.smithi042.stdout: "0a3e0898-b504-4a99-b50d-430316b9ef6c": { 2024-09-17T01:35:44.552 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:35:44.243796+0000", 2024-09-17T01:35:44.552 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1", 2024-09-17T01:35:44.552 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:35:44.552 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:35:44.552 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:35:44.552 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:35:44.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:44.553 INFO:teuthology.orchestra.run.smithi042.stdout: "97a36f58-64a4-4cdc-be7b-bf937c7480b0": { 2024-09-17T01:35:44.553 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:35:42.499810+0000", 2024-09-17T01:35:44.553 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-17T01:35:44.553 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:35:44.553 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:35:44.553 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:35:44.553 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:35:44.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:44.553 INFO:teuthology.orchestra.run.smithi042.stdout: "ffb2ac9a-c36e-4852-9189-6f5c07718d47": { 2024-09-17T01:35:44.553 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:35:42.195813+0000", 2024-09-17T01:35:44.553 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-17T01:35:44.553 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:35:44.554 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:35:44.554 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:35:44.554 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:35:44.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:44.554 INFO:teuthology.orchestra.run.smithi042.stdout: "b5862f57-9478-4629-a66e-83eb1b5c23ee": { 2024-09-17T01:35:44.554 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:35:41.892815+0000", 2024-09-17T01:35:44.554 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-17T01:35:44.554 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:35:44.554 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:35:44.554 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:35:44.554 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:35:44.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:44.554 INFO:teuthology.orchestra.run.smithi042.stdout: "da914a30-cdfa-4ea8-b8dd-7b052b0b6e40": { 2024-09-17T01:35:44.555 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:35:32.014895+0000", 2024-09-17T01:35:44.555 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-17T01:35:44.555 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:35:44.555 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:35:44.555 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:35:44.555 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:35:44.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:44.555 INFO:teuthology.orchestra.run.smithi042.stdout: "1ab47091-12eb-4ca6-b40a-fff283cd28c5": { 2024-09-17T01:35:44.555 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:35:31.413900+0000", 2024-09-17T01:35:44.555 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-17T01:35:44.555 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:35:44.555 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:35:44.555 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:35:44.556 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:35:44.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:44.556 INFO:teuthology.orchestra.run.smithi042.stdout: "0a9c13dc-362e-4bde-95c2-3e723b5c9972": { 2024-09-17T01:35:44.556 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:35:33.753881+0000", 2024-09-17T01:35:44.556 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-17T01:35:44.556 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:35:44.556 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:35:44.556 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:35:44.556 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:35:44.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:44.556 INFO:teuthology.orchestra.run.smithi042.stdout: "769242e9-0529-44ae-ba31-8514cbaaf3fb": { 2024-09-17T01:35:44.556 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:35:30.802905+0000", 2024-09-17T01:35:44.556 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-17T01:35:44.557 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:35:44.557 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:35:44.557 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:35:44.557 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:35:44.557 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:44.557 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:44.557 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:44.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.547+0000 7f7ae7600640 1 -- 172.21.15.42:0/3587068051 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7ac0078b90 msgr2=0x7f7ac007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:44.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.547+0000 7f7ae7600640 1 --2- 172.21.15.42:0/3587068051 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7ac0078b90 0x7f7ac007b0a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4005fd0 tx=0x7f7ad400b260 comp rx=0 tx=0).stop 2024-09-17T01:35:44.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.547+0000 7f7ae7600640 1 -- 172.21.15.42:0/3587068051 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ae0145210 msgr2=0x7f7ae01410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:44.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.547+0000 7f7ae7600640 1 --2- 172.21.15.42:0/3587068051 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ae0145210 0x7f7ae01410b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7acc034040 tx=0x7f7acc003910 comp rx=0 tx=0).stop 2024-09-17T01:35:44.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.547+0000 7f7ae7600640 1 -- 172.21.15.42:0/3587068051 shutdown_connections 2024-09-17T01:35:44.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.547+0000 7f7ae7600640 1 --2- 172.21.15.42:0/3587068051 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7ac0078b90 0x7f7ac007b0a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.547+0000 7f7ae7600640 1 --2- 172.21.15.42:0/3587068051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ae015f390 0x7f7ae015dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.547+0000 7f7ae7600640 1 --2- 172.21.15.42:0/3587068051 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ae0145210 0x7f7ae01410b0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.547+0000 7f7ae7600640 1 --2- 172.21.15.42:0/3587068051 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ae00b5450 0x7f7ae00aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:44.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.547+0000 7f7ae7600640 1 -- 172.21.15.42:0/3587068051 >> 172.21.15.42:0/3587068051 conn(0x7f7ae00746c0 msgr2=0x7f7ae006d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:44.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.547+0000 7f7ae7600640 1 -- 172.21.15.42:0/3587068051 shutdown_connections 2024-09-17T01:35:44.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:44.547+0000 7f7ae7600640 1 -- 172.21.15.42:0/3587068051 wait complete. 2024-09-17T01:35:47.821 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-17T01:35:47.822+0000 7f9965000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-17T01:35:49.571 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T01:35:49.571 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-17T01:35:49.631 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:35:49.635 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:35:49.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.819+0000 7eff0f600640 1 -- 172.21.15.42:0/3755138572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efef0004800 msgr2=0x7efef0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:49.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.819+0000 7eff0f600640 1 --2- 172.21.15.42:0/3755138572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efef0004800 0x7efef0004c10 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7eff080b00e0 tx=0x7efef0005830 comp rx=0 tx=0).stop 2024-09-17T01:35:49.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.819+0000 7eff0d600640 1 -- 172.21.15.42:0/3755138572 reap_dead start 2024-09-17T01:35:49.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.819+0000 7eff0f600640 1 -- 172.21.15.42:0/3755138572 shutdown_connections 2024-09-17T01:35:49.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.819+0000 7eff0f600640 1 -- 172.21.15.42:0/3755138572 >> 172.21.15.42:0/3755138572 conn(0x7eff080b2930 msgr2=0x7eff0806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:49.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.819+0000 7eff0f600640 1 -- 172.21.15.42:0/3755138572 shutdown_connections 2024-09-17T01:35:49.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.819+0000 7eff0f600640 1 -- 172.21.15.42:0/3755138572 wait complete. 2024-09-17T01:35:49.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.821+0000 7eff0f600640 1 Processor -- start 2024-09-17T01:35:49.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.822+0000 7eff0f600640 1 -- start start 2024-09-17T01:35:49.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.823+0000 7eff0f600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efef0004800 0x7eff08156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:49.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.823+0000 7eff0f600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7eff080afa70 0x7eff08143620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:49.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.823+0000 7eff0f600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff080ae8a0 0x7eff080aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:49.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.823+0000 7eff0f600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7eff08074130 con 0x7efef0004800 2024-09-17T01:35:49.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.823+0000 7eff0f600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7eff08073fb0 con 0x7eff080ae8a0 2024-09-17T01:35:49.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.823+0000 7eff0f600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7eff0806d430 con 0x7eff080afa70 2024-09-17T01:35:49.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.823+0000 7eff0cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efef0004800 0x7eff08156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:49.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.823+0000 7eff0cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efef0004800 0x7eff08156490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34546/0 (socket says 172.21.15.42:34546) 2024-09-17T01:35:49.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.823+0000 7eff0cc00640 1 -- 172.21.15.42:0/630973063 learned_addr learned my addr 172.21.15.42:0/630973063 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:49.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.824+0000 7eff0d600640 1 --2- 172.21.15.42:0/630973063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff080ae8a0 0x7eff080aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:49.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.824+0000 7eff07e00640 1 --2- 172.21.15.42:0/630973063 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7eff080afa70 0x7eff08143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:49.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.824+0000 7eff0cc00640 1 -- 172.21.15.42:0/630973063 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7eff080afa70 msgr2=0x7eff08143620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:49.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.824+0000 7eff0cc00640 1 --2- 172.21.15.42:0/630973063 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7eff080afa70 0x7eff08143620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.824+0000 7eff0cc00640 1 -- 172.21.15.42:0/630973063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff080ae8a0 msgr2=0x7eff080aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:49.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.824+0000 7eff0cc00640 1 --2- 172.21.15.42:0/630973063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff080ae8a0 0x7eff080aecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.824+0000 7eff0cc00640 1 -- 172.21.15.42:0/630973063 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff08157660 con 0x7efef0004800 2024-09-17T01:35:49.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.824+0000 7eff0d600640 1 --2- 172.21.15.42:0/630973063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff080ae8a0 0x7eff080aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:49.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.824+0000 7eff0cc00640 1 --2- 172.21.15.42:0/630973063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efef0004800 0x7eff08156490 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7efefc011830 tx=0x7efefc011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:49.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.824+0000 7eff04c00640 1 -- 172.21.15.42:0/630973063 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc004460 con 0x7efef0004800 2024-09-17T01:35:49.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.824+0000 7eff04c00640 1 -- 172.21.15.42:0/630973063 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efefc016070 con 0x7efef0004800 2024-09-17T01:35:49.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.824+0000 7eff04c00640 1 -- 172.21.15.42:0/630973063 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc00fb80 con 0x7efef0004800 2024-09-17T01:35:49.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.824+0000 7eff0f600640 1 -- 172.21.15.42:0/630973063 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff080af1f0 con 0x7efef0004800 2024-09-17T01:35:49.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.825+0000 7eff0f600640 1 -- 172.21.15.42:0/630973063 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff081570a0 con 0x7efef0004800 2024-09-17T01:35:49.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.828+0000 7eff04c00640 1 -- 172.21.15.42:0/630973063 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efefc018030 con 0x7efef0004800 2024-09-17T01:35:49.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.829+0000 7eff04c00640 1 --2- 172.21.15.42:0/630973063 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efee8078bc0 0x7efee807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:49.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.829+0000 7eff04c00640 1 -- 172.21.15.42:0/630973063 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5854+0+0 (secure 0 0 0) 0x7efefc09b690 con 0x7efef0004800 2024-09-17T01:35:49.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.829+0000 7eff16683740 1 Processor -- start 2024-09-17T01:35:49.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.830+0000 7eff16683740 1 -- start start 2024-09-17T01:35:49.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.830+0000 7eff07e00640 1 --2- 172.21.15.42:0/630973063 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efee8078bc0 0x7efee807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:49.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.830+0000 7eff07e00640 1 --2- 172.21.15.42:0/630973063 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efee8078bc0 0x7efee807b0d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7eff080b00e0 tx=0x7eff0815ddc0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:49.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.831+0000 7eff16683740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55658733c390 0x55658772a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:49.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.831+0000 7eff16683740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565873134d0 0x55658770d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:49.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.831+0000 7eff16683740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55658731b6b0 0x55658770d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:49.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.831+0000 7eff16683740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5565876431c0 con 0x55658731b6b0 2024-09-17T01:35:49.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.831+0000 7eff16683740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556587656870 con 0x5565873134d0 2024-09-17T01:35:49.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.831+0000 7eff16683740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x556587645ca0 con 0x55658733c390 2024-09-17T01:35:49.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.831+0000 7eff0d600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55658731b6b0 0x55658770d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:49.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.831+0000 7eff0d600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55658731b6b0 0x55658770d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34562/0 (socket says 172.21.15.42:34562) 2024-09-17T01:35:49.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.831+0000 7eff0d600640 1 -- 172.21.15.42:0/2788929280 learned_addr learned my addr 172.21.15.42:0/2788929280 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:49.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.832+0000 7eff07e00640 1 --2- 172.21.15.42:0/2788929280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565873134d0 0x55658770d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:49.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.832+0000 7eff0cc00640 1 --2- 172.21.15.42:0/2788929280 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55658733c390 0x55658772a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:49.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.832+0000 7eff0d600640 1 -- 172.21.15.42:0/2788929280 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55658733c390 msgr2=0x55658772a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:49.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.832+0000 7eff0d600640 1 --2- 172.21.15.42:0/2788929280 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55658733c390 0x55658772a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.832+0000 7eff0d600640 1 -- 172.21.15.42:0/2788929280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565873134d0 msgr2=0x55658770d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:49.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.832+0000 7eff0d600640 1 --2- 172.21.15.42:0/2788929280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565873134d0 0x55658770d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.832+0000 7eff0d600640 1 -- 172.21.15.42:0/2788929280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55658741e7d0 con 0x55658731b6b0 2024-09-17T01:35:49.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.832+0000 7eff07e00640 1 --2- 172.21.15.42:0/2788929280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565873134d0 0x55658770d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:49.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.832+0000 7eff0d600640 1 --2- 172.21.15.42:0/2788929280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55658731b6b0 0x55658770d760 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7eff00005fd0 tx=0x7eff00012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ded60883f39470 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:49.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.832+0000 7efef9200640 1 -- 172.21.15.42:0/2788929280 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff00003b70 con 0x55658731b6b0 2024-09-17T01:35:49.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.832+0000 7efef9200640 1 -- 172.21.15.42:0/2788929280 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff00003e00 con 0x55658731b6b0 2024-09-17T01:35:49.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.832+0000 7efef9200640 1 -- 172.21.15.42:0/2788929280 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff00004260 con 0x55658731b6b0 2024-09-17T01:35:49.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.833+0000 7eff16683740 1 -- 172.21.15.42:0/2788929280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55658731b6b0 msgr2=0x55658770d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:49.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.833+0000 7eff16683740 1 --2- 172.21.15.42:0/2788929280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55658731b6b0 0x55658770d760 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7eff00005fd0 tx=0x7eff00012820 comp rx=0 tx=0).stop 2024-09-17T01:35:49.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.833+0000 7eff16683740 1 -- 172.21.15.42:0/2788929280 shutdown_connections 2024-09-17T01:35:49.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.833+0000 7eff16683740 1 --2- 172.21.15.42:0/2788929280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565873134d0 0x55658770d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.833+0000 7eff16683740 1 --2- 172.21.15.42:0/2788929280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55658731b6b0 0x55658770d760 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.833+0000 7eff16683740 1 --2- 172.21.15.42:0/2788929280 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55658733c390 0x55658772a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.833+0000 7eff16683740 1 -- 172.21.15.42:0/2788929280 >> 172.21.15.42:0/2788929280 conn(0x5565873304e0 msgr2=0x5565876e3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:49.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.833+0000 7eff16683740 1 -- 172.21.15.42:0/2788929280 shutdown_connections 2024-09-17T01:35:49.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.833+0000 7eff16683740 1 -- 172.21.15.42:0/2788929280 wait complete. 2024-09-17T01:35:49.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.835+0000 7eff16683740 1 -- start start 2024-09-17T01:35:49.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.835+0000 7eff16683740 1 Processor -- start 2024-09-17T01:35:49.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.836+0000 7eff16683740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565873134d0 0x556587728b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:49.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.836+0000 7eff16683740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55658731b6b0 0x556587721450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:49.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.836+0000 7eff16683740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55658733c390 0x5565876e25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:49.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.836+0000 7eff16683740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5565875ec410 con 0x5565873134d0 2024-09-17T01:35:49.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.836+0000 7eff16683740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556587649ab0 con 0x55658731b6b0 2024-09-17T01:35:49.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.836+0000 7eff16683740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5565873b6740 con 0x55658733c390 2024-09-17T01:35:49.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.836+0000 7eff16683740 10 client.0 _ll_register_callbacks cb 0x5565875c9360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:49.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.837+0000 7eff0cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565873134d0 0x556587728b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:49.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.837+0000 7eff0cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565873134d0 0x556587728b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34570/0 (socket says 172.21.15.42:34570) 2024-09-17T01:35:49.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.837+0000 7eff0cc00640 1 -- 172.21.15.42:0/4089506336 learned_addr learned my addr 172.21.15.42:0/4089506336 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:49.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.837+0000 7eff07e00640 1 --2- 172.21.15.42:0/4089506336 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55658731b6b0 0x556587721450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:49.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.837+0000 7eff0d600640 1 --2- 172.21.15.42:0/4089506336 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55658733c390 0x5565876e25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:49.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.837+0000 7eff0cc00640 1 -- 172.21.15.42:0/4089506336 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55658733c390 msgr2=0x5565876e25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:49.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.837+0000 7eff0cc00640 1 --2- 172.21.15.42:0/4089506336 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55658733c390 0x5565876e25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.837+0000 7eff0cc00640 1 -- 172.21.15.42:0/4089506336 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55658731b6b0 msgr2=0x556587721450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:49.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.837+0000 7eff0cc00640 1 --2- 172.21.15.42:0/4089506336 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55658731b6b0 0x556587721450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.837+0000 7eff0cc00640 1 -- 172.21.15.42:0/4089506336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565873a7970 con 0x5565873134d0 2024-09-17T01:35:49.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.837+0000 7eff0cc00640 1 --2- 172.21.15.42:0/4089506336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565873134d0 0x556587728b40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7efefc00f730 tx=0x7efefc062f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4379aa904374496f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:49.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.837+0000 7efeed600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:49.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.838+0000 7efeed600640 1 -- 172.21.15.42:0/4089506336 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc06ccc0 con 0x5565873134d0 2024-09-17T01:35:49.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.838+0000 7eff16683740 1 -- 172.21.15.42:0/4089506336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff00003e00 con 0x5565873134d0 2024-09-17T01:35:49.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.838+0000 7efeed600640 1 -- 172.21.15.42:0/4089506336 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 5854+0+0 (secure 0 0 0) 0x7efefc062590 con 0x5565873134d0 2024-09-17T01:35:49.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.838+0000 7efeed600640 1 -- 172.21.15.42:0/4089506336 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7efefc062790 con 0x5565873134d0 2024-09-17T01:35:49.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.838+0000 7eff16683740 10 client.5985 fetch_fsmap learned FSMap version 31 2024-09-17T01:35:49.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.838+0000 7eff16683740 1 -- 172.21.15.42:0/4089506336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x5565873856a0 con 0x5565873134d0 2024-09-17T01:35:49.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.838+0000 7efeed600640 1 -- 172.21.15.42:0/4089506336 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff00003e00 con 0x5565873134d0 2024-09-17T01:35:49.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.839+0000 7efeed600640 1 -- 172.21.15.42:0/4089506336 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 3502+0+0 (secure 0 0 0) 0x7efefc05ec80 con 0x5565873134d0 2024-09-17T01:35:49.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.839+0000 7eff16683740 10 client.5985 fetch_fsmap finished waiting for FSMap version 31 2024-09-17T01:35:49.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.839+0000 7eff16683740 10 client.5985 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:49.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.839+0000 7eff16683740 20 client.5985 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:49.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.839+0000 7eff16683740 1 --2- 172.21.15.42:0/4089506336 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5565872faf60 0x5565876e2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:49.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.839+0000 7eff16683740 4 client.5985 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:49.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.839+0000 7eff16683740 1 -- 172.21.15.42:0/4089506336 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565876587c0 con 0x5565872faf60 2024-09-17T01:35:49.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.839+0000 7eff07e00640 1 --2- 172.21.15.42:0/4089506336 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5565872faf60 0x5565876e2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:49.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.840+0000 7efeed600640 10 client.5985 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:49.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.840+0000 7eff07e00640 1 --2- 172.21.15.42:0/4089506336 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5565872faf60 0x5565876e2af0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88e7807c89ad3176 server_cookie=8aceabec61ba11ca in_seq=0 out_seq=0 2024-09-17T01:35:49.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.840+0000 7efeed600640 1 -- 172.21.15.42:0/4089506336 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5565876587c0 con 0x5565872faf60 2024-09-17T01:35:49.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.840+0000 7efeed600640 10 client.5985 handle_command_reply: tid=0 2024-09-17T01:35:49.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.840+0000 7eff16683740 1 client.5985 shutdown 2024-09-17T01:35:49.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.841+0000 7eff16683740 1 -- 172.21.15.42:0/4089506336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565873134d0 msgr2=0x556587728b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:49.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.841+0000 7eff16683740 1 --2- 172.21.15.42:0/4089506336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565873134d0 0x556587728b40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7efefc00f730 tx=0x7efefc062f70 comp rx=0 tx=0).stop 2024-09-17T01:35:49.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.841+0000 7eff16683740 1 -- 172.21.15.42:0/4089506336 shutdown_connections 2024-09-17T01:35:49.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.841+0000 7eff16683740 1 --2- 172.21.15.42:0/4089506336 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x5565872faf60 0x5565876e2af0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.841+0000 7eff16683740 1 --2- 172.21.15.42:0/4089506336 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55658731b6b0 0x556587721450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.841+0000 7eff16683740 1 --2- 172.21.15.42:0/4089506336 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55658733c390 0x5565876e25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.841+0000 7eff16683740 1 --2- 172.21.15.42:0/4089506336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5565873134d0 0x556587728b40 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.841+0000 7efeed600640 0 client.5985 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:49.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.841+0000 7eff16683740 1 -- 172.21.15.42:0/4089506336 >> 172.21.15.42:0/4089506336 conn(0x5565873304e0 msgr2=0x5565876dc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:49.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.841+0000 7eff16683740 1 -- 172.21.15.42:0/4089506336 shutdown_connections 2024-09-17T01:35:49.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.841+0000 7eff16683740 1 -- 172.21.15.42:0/4089506336 wait complete. 2024-09-17T01:35:49.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.841+0000 7eff16683740 20 client.5985 trim_cache size 0 max 16384 2024-09-17T01:35:49.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.860+0000 7eff16683740 1 Processor -- start 2024-09-17T01:35:49.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.860+0000 7eff16683740 1 -- start start 2024-09-17T01:35:49.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.861+0000 7eff16683740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5565873134d0 0x5565877249b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:49.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.861+0000 7eff16683740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55658731b6b0 0x556587727d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:49.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.861+0000 7eff16683740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55658733c390 0x556587728250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:49.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.861+0000 7eff16683740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7eff08202aa0 con 0x55658731b6b0 2024-09-17T01:35:49.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.861+0000 7eff16683740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7eff08201ab0 con 0x55658733c390 2024-09-17T01:35:49.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.861+0000 7eff16683740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7eff08145510 con 0x5565873134d0 2024-09-17T01:35:49.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.862+0000 7eff07e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55658731b6b0 0x556587727d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:49.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.862+0000 7eff07e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55658731b6b0 0x556587727d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34578/0 (socket says 172.21.15.42:34578) 2024-09-17T01:35:49.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.862+0000 7eff07e00640 1 -- 172.21.15.42:0/2883367370 learned_addr learned my addr 172.21.15.42:0/2883367370 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:49.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.862+0000 7eff0cc00640 1 --2- 172.21.15.42:0/2883367370 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5565873134d0 0x5565877249b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:49.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.862+0000 7eff0d600640 1 --2- 172.21.15.42:0/2883367370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55658733c390 0x556587728250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:49.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.862+0000 7eff07e00640 1 -- 172.21.15.42:0/2883367370 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5565873134d0 msgr2=0x5565877249b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:49.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.862+0000 7eff07e00640 1 --2- 172.21.15.42:0/2883367370 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5565873134d0 0x5565877249b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.862+0000 7eff07e00640 1 -- 172.21.15.42:0/2883367370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55658733c390 msgr2=0x556587728250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:49.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.862+0000 7eff07e00640 1 --2- 172.21.15.42:0/2883367370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55658733c390 0x556587728250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.862+0000 7eff07e00640 1 -- 172.21.15.42:0/2883367370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556587720e40 con 0x55658731b6b0 2024-09-17T01:35:49.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.862+0000 7eff07e00640 1 --2- 172.21.15.42:0/2883367370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55658731b6b0 0x556587727d10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7efef402b0b0 tx=0x7efef403d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9435cf1060afbe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:49.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.863+0000 7efeefe00640 1 -- 172.21.15.42:0/2883367370 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4031040 con 0x55658731b6b0 2024-09-17T01:35:49.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.863+0000 7efeefe00640 1 -- 172.21.15.42:0/2883367370 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efef4003d80 con 0x55658731b6b0 2024-09-17T01:35:49.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.863+0000 7efeefe00640 1 -- 172.21.15.42:0/2883367370 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef40506b0 con 0x55658731b6b0 2024-09-17T01:35:49.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.864+0000 7eff16683740 1 -- 172.21.15.42:0/2883367370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55658731b6b0 msgr2=0x556587727d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:49.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.864+0000 7eff16683740 1 --2- 172.21.15.42:0/2883367370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55658731b6b0 0x556587727d10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7efef402b0b0 tx=0x7efef403d000 comp rx=0 tx=0).stop 2024-09-17T01:35:49.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.864+0000 7eff16683740 1 -- 172.21.15.42:0/2883367370 shutdown_connections 2024-09-17T01:35:49.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.864+0000 7eff16683740 1 --2- 172.21.15.42:0/2883367370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55658733c390 0x556587728250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.864+0000 7eff16683740 1 --2- 172.21.15.42:0/2883367370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55658731b6b0 0x556587727d10 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.864+0000 7eff16683740 1 --2- 172.21.15.42:0/2883367370 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5565873134d0 0x5565877249b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.864+0000 7eff16683740 1 -- 172.21.15.42:0/2883367370 >> 172.21.15.42:0/2883367370 conn(0x5565873304e0 msgr2=0x5565876dccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:49.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.864+0000 7eff16683740 1 -- 172.21.15.42:0/2883367370 shutdown_connections 2024-09-17T01:35:49.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.864+0000 7eff16683740 1 -- 172.21.15.42:0/2883367370 wait complete. 2024-09-17T01:35:49.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.865+0000 7eff16683740 1 -- start start 2024-09-17T01:35:49.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.865+0000 7eff16683740 1 Processor -- start 2024-09-17T01:35:49.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.866+0000 7eff16683740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565873134d0 0x5565877a41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:49.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.866+0000 7eff16683740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55658731b6b0 0x556587733fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:49.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.866+0000 7eff16683740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55658733c390 0x5565877344f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:49.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.866+0000 7eff16683740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7eff08201440 con 0x55658731b6b0 2024-09-17T01:35:49.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.866+0000 7eff16683740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5565877290f0 con 0x5565873134d0 2024-09-17T01:35:49.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.866+0000 7eff16683740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5565877aa9c0 con 0x55658733c390 2024-09-17T01:35:49.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.867+0000 7eff16683740 10 client.0 _ll_register_callbacks cb 0x7efefc05f1d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:49.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.867+0000 7eff07e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55658731b6b0 0x556587733fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:49.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.867+0000 7eff07e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55658731b6b0 0x556587733fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34586/0 (socket says 172.21.15.42:34586) 2024-09-17T01:35:49.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.867+0000 7eff07e00640 1 -- 172.21.15.42:0/360312143 learned_addr learned my addr 172.21.15.42:0/360312143 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:49.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.867+0000 7eff0cc00640 1 --2- 172.21.15.42:0/360312143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565873134d0 0x5565877a41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:49.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.867+0000 7eff0d600640 1 --2- 172.21.15.42:0/360312143 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55658733c390 0x5565877344f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:49.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.867+0000 7eff07e00640 1 -- 172.21.15.42:0/360312143 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55658733c390 msgr2=0x5565877344f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:49.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.867+0000 7eff07e00640 1 --2- 172.21.15.42:0/360312143 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55658733c390 0x5565877344f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.867+0000 7eff07e00640 1 -- 172.21.15.42:0/360312143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565873134d0 msgr2=0x5565877a41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:49.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.867+0000 7eff07e00640 1 --2- 172.21.15.42:0/360312143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565873134d0 0x5565877a41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.867+0000 7eff07e00640 1 -- 172.21.15.42:0/360312143 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565876dca40 con 0x55658731b6b0 2024-09-17T01:35:49.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.867+0000 7eff07e00640 1 --2- 172.21.15.42:0/360312143 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55658731b6b0 0x556587733fb0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7efef4039040 tx=0x7efef4006710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22089b853e12a9a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:49.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.868+0000 7efeed600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:49.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.868+0000 7efeed600640 1 -- 172.21.15.42:0/360312143 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef405b020 con 0x55658731b6b0 2024-09-17T01:35:49.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.868+0000 7efeed600640 1 -- 172.21.15.42:0/360312143 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 5854+0+0 (secure 0 0 0) 0x7efef4050450 con 0x55658731b6b0 2024-09-17T01:35:49.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.868+0000 7eff16683740 1 -- 172.21.15.42:0/360312143 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efef4003d80 con 0x55658731b6b0 2024-09-17T01:35:49.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.868+0000 7efeed600640 1 -- 172.21.15.42:0/360312143 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7efef4031070 con 0x55658731b6b0 2024-09-17T01:35:49.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.868+0000 7eff16683740 10 client.5991 fetch_fsmap learned FSMap version 31 2024-09-17T01:35:49.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.868+0000 7eff16683740 1 -- 172.21.15.42:0/360312143 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x5565877aa7c0 con 0x55658731b6b0 2024-09-17T01:35:49.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.868+0000 7efeed600640 1 -- 172.21.15.42:0/360312143 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efef4003d80 con 0x55658731b6b0 2024-09-17T01:35:49.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.868+0000 7efeed600640 1 -- 172.21.15.42:0/360312143 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 3502+0+0 (secure 0 0 0) 0x7efefc00fd20 con 0x55658731b6b0 2024-09-17T01:35:49.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.868+0000 7eff16683740 10 client.5991 fetch_fsmap finished waiting for FSMap version 31 2024-09-17T01:35:49.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.868+0000 7eff16683740 10 client.5991 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:49.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.868+0000 7eff16683740 20 client.5991 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:49.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.868+0000 7eff16683740 1 --2- 172.21.15.42:0/360312143 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x556587725270 0x5565877a71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:49.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.869+0000 7eff16683740 4 client.5991 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:35:49.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.869+0000 7eff16683740 1 -- 172.21.15.42:0/360312143 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556587654270 con 0x556587725270 2024-09-17T01:35:49.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.869+0000 7eff0cc00640 1 --2- 172.21.15.42:0/360312143 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x556587725270 0x5565877a71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:49.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.869+0000 7efeed600640 10 client.5991 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:49.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.869+0000 7eff0cc00640 1 --2- 172.21.15.42:0/360312143 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x556587725270 0x5565877a71a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=219462b32366c67c server_cookie=16272e4ef4062836 in_seq=0 out_seq=0 2024-09-17T01:35:49.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.870+0000 7efeed600640 1 -- 172.21.15.42:0/360312143 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2654 (crc 0 0 0) 0x556587654270 con 0x556587725270 2024-09-17T01:35:49.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.870+0000 7efeed600640 10 client.5991 handle_command_reply: tid=0 2024-09-17T01:35:49.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.870+0000 7eff16683740 1 client.5991 shutdown 2024-09-17T01:35:49.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.870+0000 7eff16683740 1 -- 172.21.15.42:0/360312143 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55658731b6b0 msgr2=0x556587733fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:49.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.870+0000 7eff16683740 1 --2- 172.21.15.42:0/360312143 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55658731b6b0 0x556587733fb0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7efef4039040 tx=0x7efef4006710 comp rx=0 tx=0).stop 2024-09-17T01:35:49.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.870+0000 7eff16683740 1 -- 172.21.15.42:0/360312143 shutdown_connections 2024-09-17T01:35:49.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.870+0000 7eff16683740 1 --2- 172.21.15.42:0/360312143 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x556587725270 0x5565877a71a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.870+0000 7eff16683740 1 --2- 172.21.15.42:0/360312143 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55658733c390 0x5565877344f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.870+0000 7eff16683740 1 --2- 172.21.15.42:0/360312143 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55658731b6b0 0x556587733fb0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.870+0000 7efeed600640 0 client.5991 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:49.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.870+0000 7eff16683740 1 --2- 172.21.15.42:0/360312143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5565873134d0 0x5565877a41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.870+0000 7eff16683740 1 -- 172.21.15.42:0/360312143 >> 172.21.15.42:0/360312143 conn(0x5565873304e0 msgr2=0x5565876faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:49.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.870+0000 7eff16683740 1 -- 172.21.15.42:0/360312143 shutdown_connections 2024-09-17T01:35:49.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.870+0000 7eff16683740 1 -- 172.21.15.42:0/360312143 wait complete. 2024-09-17T01:35:49.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.870+0000 7eff16683740 20 client.5991 trim_cache size 0 max 16384 2024-09-17T01:35:49.872 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:49.872 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-09-17T01:35:49.873 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {}, 2024-09-17T01:35:49.873 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_stats": { 2024-09-17T01:35:49.873 INFO:teuthology.orchestra.run.smithi042.stdout: "0a3e0898-b504-4a99-b50d-430316b9ef6c": { 2024-09-17T01:35:49.873 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:35:44.243796+0000", 2024-09-17T01:35:49.873 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1", 2024-09-17T01:35:49.873 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:35:49.873 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:35:49.873 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:35:49.873 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:35:49.873 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:49.873 INFO:teuthology.orchestra.run.smithi042.stdout: "97a36f58-64a4-4cdc-be7b-bf937c7480b0": { 2024-09-17T01:35:49.873 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:35:42.499810+0000", 2024-09-17T01:35:49.873 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-17T01:35:49.873 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:35:49.874 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:35:49.874 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:35:49.874 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:35:49.874 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:49.874 INFO:teuthology.orchestra.run.smithi042.stdout: "ffb2ac9a-c36e-4852-9189-6f5c07718d47": { 2024-09-17T01:35:49.874 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:35:42.195813+0000", 2024-09-17T01:35:49.874 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-17T01:35:49.874 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:35:49.874 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:35:49.874 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:35:49.874 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:35:49.874 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:49.874 INFO:teuthology.orchestra.run.smithi042.stdout: "b5862f57-9478-4629-a66e-83eb1b5c23ee": { 2024-09-17T01:35:49.874 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:35:41.892815+0000", 2024-09-17T01:35:49.874 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-17T01:35:49.875 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:35:49.875 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:35:49.875 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:35:49.875 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:35:49.875 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:49.875 INFO:teuthology.orchestra.run.smithi042.stdout: "da914a30-cdfa-4ea8-b8dd-7b052b0b6e40": { 2024-09-17T01:35:49.875 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:35:32.014895+0000", 2024-09-17T01:35:49.875 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-17T01:35:49.875 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:35:49.875 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:35:49.875 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:35:49.875 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:35:49.875 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:49.875 INFO:teuthology.orchestra.run.smithi042.stdout: "1ab47091-12eb-4ca6-b40a-fff283cd28c5": { 2024-09-17T01:35:49.875 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:35:31.413900+0000", 2024-09-17T01:35:49.876 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-17T01:35:49.876 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:35:49.876 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:35:49.876 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:35:49.876 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:35:49.876 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:49.876 INFO:teuthology.orchestra.run.smithi042.stdout: "0a9c13dc-362e-4bde-95c2-3e723b5c9972": { 2024-09-17T01:35:49.876 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:35:33.753881+0000", 2024-09-17T01:35:49.876 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-17T01:35:49.876 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:35:49.876 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:35:49.876 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:35:49.876 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:35:49.876 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:35:49.876 INFO:teuthology.orchestra.run.smithi042.stdout: "769242e9-0529-44ae-ba31-8514cbaaf3fb": { 2024-09-17T01:35:49.877 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:35:30.802905+0000", 2024-09-17T01:35:49.877 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-17T01:35:49.877 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:35:49.877 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:35:49.877 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:35:49.877 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:35:49.877 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:49.877 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:49.877 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:49.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.871+0000 7eff0f600640 1 -- 172.21.15.42:0/630973063 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efee8078bc0 msgr2=0x7efee807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:49.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.871+0000 7eff0f600640 1 --2- 172.21.15.42:0/630973063 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efee8078bc0 0x7efee807b0d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7eff080b00e0 tx=0x7eff0815ddc0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.871+0000 7eff0f600640 1 -- 172.21.15.42:0/630973063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efef0004800 msgr2=0x7eff08156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:49.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.871+0000 7eff0f600640 1 --2- 172.21.15.42:0/630973063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efef0004800 0x7eff08156490 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7efefc011830 tx=0x7efefc011cf0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.871+0000 7eff0f600640 1 -- 172.21.15.42:0/630973063 shutdown_connections 2024-09-17T01:35:49.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.871+0000 7eff0f600640 1 --2- 172.21.15.42:0/630973063 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efee8078bc0 0x7efee807b0d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.871+0000 7eff0f600640 1 --2- 172.21.15.42:0/630973063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff080ae8a0 0x7eff080aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.871+0000 7eff0f600640 1 --2- 172.21.15.42:0/630973063 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7eff080afa70 0x7eff08143620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.871+0000 7eff0f600640 1 --2- 172.21.15.42:0/630973063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efef0004800 0x7eff08156490 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:49.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.871+0000 7eff0f600640 1 -- 172.21.15.42:0/630973063 >> 172.21.15.42:0/630973063 conn(0x7eff080b2930 msgr2=0x7eff0806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:49.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.871+0000 7eff0f600640 1 -- 172.21.15.42:0/630973063 shutdown_connections 2024-09-17T01:35:49.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:49.871+0000 7eff0f600640 1 -- 172.21.15.42:0/630973063 wait complete. 2024-09-17T01:35:49.892 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T01:35:49.892 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-17T01:35:50.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.124+0000 7fde51600640 1 -- 172.21.15.42:0/646325177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde4c0b32b0 msgr2=0x7fde4c0b36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:50.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.124+0000 7fde51600640 1 --2- 172.21.15.42:0/646325177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde4c0b32b0 0x7fde4c0b36c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0b4370 tx=0x7fde4402aa30 comp rx=0 tx=0).stop 2024-09-17T01:35:50.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.124+0000 7fde51600640 1 -- 172.21.15.42:0/646325177 shutdown_connections 2024-09-17T01:35:50.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.124+0000 7fde51600640 1 --2- 172.21.15.42:0/646325177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde4c0b32b0 0x7fde4c0b36c0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.124+0000 7fde51600640 1 --2- 172.21.15.42:0/646325177 >> v2:172.21.15.43:3300/0 conn(0x7fde4c0ccb90 0x7fde4c15c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.124+0000 7fde51600640 1 -- 172.21.15.42:0/646325177 >> 172.21.15.42:0/646325177 conn(0x7fde4c06d440 msgr2=0x7fde4c0b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:50.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.124+0000 7fde51600640 1 -- 172.21.15.42:0/646325177 shutdown_connections 2024-09-17T01:35:50.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.124+0000 7fde51600640 1 -- 172.21.15.42:0/646325177 wait complete. 2024-09-17T01:35:50.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.126+0000 7fde51600640 1 Processor -- start 2024-09-17T01:35:50.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.127+0000 7fde51600640 1 -- start start 2024-09-17T01:35:50.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.128+0000 7fde51600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde4c0af910 0x7fde4c0b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.128+0000 7fde51600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde4c0b32b0 0x7fde4c073530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.128+0000 7fde51600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde4c0ccb90 0x7fde4c09d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.128+0000 7fde51600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c06e680 con 0x7fde4c0af910 2024-09-17T01:35:50.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.128+0000 7fde51600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c06e500 con 0x7fde4c0ccb90 2024-09-17T01:35:50.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.128+0000 7fde51600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fde4c06e800 con 0x7fde4c0b32b0 2024-09-17T01:35:50.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.128+0000 7fde4be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde4c0af910 0x7fde4c0b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.128+0000 7fde4be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde4c0af910 0x7fde4c0b0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34604/0 (socket says 172.21.15.42:34604) 2024-09-17T01:35:50.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.128+0000 7fde4be00640 1 -- 172.21.15.42:0/688503934 learned_addr learned my addr 172.21.15.42:0/688503934 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:50.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.128+0000 7fde43400640 1 --2- 172.21.15.42:0/688503934 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde4c0b32b0 0x7fde4c073530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.128+0000 7fde50c00640 1 --2- 172.21.15.42:0/688503934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde4c0ccb90 0x7fde4c09d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.129+0000 7fde4be00640 1 -- 172.21.15.42:0/688503934 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde4c0b32b0 msgr2=0x7fde4c073530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:50.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.129+0000 7fde4be00640 1 --2- 172.21.15.42:0/688503934 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde4c0b32b0 0x7fde4c073530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.129+0000 7fde4be00640 1 -- 172.21.15.42:0/688503934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde4c0ccb90 msgr2=0x7fde4c09d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:50.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.129+0000 7fde4be00640 1 --2- 172.21.15.42:0/688503934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde4c0ccb90 0x7fde4c09d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.129+0000 7fde4be00640 1 -- 172.21.15.42:0/688503934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde4c0b1800 con 0x7fde4c0af910 2024-09-17T01:35:50.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.129+0000 7fde4be00640 1 --2- 172.21.15.42:0/688503934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde4c0af910 0x7fde4c0b0f00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fde3c00c3d0 tx=0x7fde3c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:50.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.129+0000 7fde48c00640 1 -- 172.21.15.42:0/688503934 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c017070 con 0x7fde4c0af910 2024-09-17T01:35:50.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.130+0000 7fde48c00640 1 -- 172.21.15.42:0/688503934 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde3c0053c0 con 0x7fde4c0af910 2024-09-17T01:35:50.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.130+0000 7fde48c00640 1 -- 172.21.15.42:0/688503934 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c003850 con 0x7fde4c0af910 2024-09-17T01:35:50.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.130+0000 7fde51600640 1 -- 172.21.15.42:0/688503934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde4c1f9120 con 0x7fde4c0af910 2024-09-17T01:35:50.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.130+0000 7fde51600640 1 -- 172.21.15.42:0/688503934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde4c1f66c0 con 0x7fde4c0af910 2024-09-17T01:35:50.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.132+0000 7fde48c00640 1 -- 172.21.15.42:0/688503934 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fde3c01a070 con 0x7fde4c0af910 2024-09-17T01:35:50.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.133+0000 7fde48c00640 1 --2- 172.21.15.42:0/688503934 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde28078b90 0x7fde2807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.133+0000 7fde48c00640 1 -- 172.21.15.42:0/688503934 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5854+0+0 (secure 0 0 0) 0x7fde3c09a0c0 con 0x7fde4c0af910 2024-09-17T01:35:50.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.133+0000 7fde59e21740 1 Processor -- start 2024-09-17T01:35:50.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.133+0000 7fde59e21740 1 -- start start 2024-09-17T01:35:50.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.134+0000 7fde43400640 1 --2- 172.21.15.42:0/688503934 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde28078b90 0x7fde2807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.134+0000 7fde43400640 1 --2- 172.21.15.42:0/688503934 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde28078b90 0x7fde2807b0a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0ad9c0 tx=0x7fde34005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:50.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.135+0000 7fde59e21740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ff8cb6390 0x558ff90a22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.135+0000 7fde59e21740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8c8d4d0 0x558ff90a2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.135+0000 7fde59e21740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ff8c956b0 0x558ff9087440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.135+0000 7fde59e21740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558ff8fd06f0 con 0x558ff8c8d4d0 2024-09-17T01:35:50.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.135+0000 7fde59e21740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558ff8fbfb20 con 0x558ff8c956b0 2024-09-17T01:35:50.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.135+0000 7fde59e21740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558ff8fc3930 con 0x558ff8cb6390 2024-09-17T01:35:50.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.135+0000 7fde43400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8c8d4d0 0x558ff90a2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.135+0000 7fde43400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8c8d4d0 0x558ff90a2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34618/0 (socket says 172.21.15.42:34618) 2024-09-17T01:35:50.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.135+0000 7fde43400640 1 -- 172.21.15.42:0/2064446424 learned_addr learned my addr 172.21.15.42:0/2064446424 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:50.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.135+0000 7fde4be00640 1 --2- 172.21.15.42:0/2064446424 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ff8cb6390 0x558ff90a22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.135+0000 7fde50c00640 1 --2- 172.21.15.42:0/2064446424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ff8c956b0 0x558ff9087440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.136+0000 7fde43400640 1 -- 172.21.15.42:0/2064446424 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ff8cb6390 msgr2=0x558ff90a22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:50.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.136+0000 7fde43400640 1 --2- 172.21.15.42:0/2064446424 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ff8cb6390 0x558ff90a22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.136+0000 7fde43400640 1 -- 172.21.15.42:0/2064446424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ff8c956b0 msgr2=0x558ff9087440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:50.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.136+0000 7fde43400640 1 --2- 172.21.15.42:0/2064446424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ff8c956b0 0x558ff9087440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.136+0000 7fde43400640 1 -- 172.21.15.42:0/2064446424 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ff8d21970 con 0x558ff8c8d4d0 2024-09-17T01:35:50.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.136+0000 7fde50c00640 1 --2- 172.21.15.42:0/2064446424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ff8c956b0 0x558ff9087440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:50.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.136+0000 7fde43400640 1 --2- 172.21.15.42:0/2064446424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8c8d4d0 0x558ff90a2810 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fde34009650 tx=0x7fde34014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53e0a5f23416a27 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:50.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.136+0000 7fde3be00640 1 -- 172.21.15.42:0/2064446424 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde34004220 con 0x558ff8c8d4d0 2024-09-17T01:35:50.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.136+0000 7fde3be00640 1 -- 172.21.15.42:0/2064446424 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde3400e930 con 0x558ff8c8d4d0 2024-09-17T01:35:50.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.136+0000 7fde3be00640 1 -- 172.21.15.42:0/2064446424 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3400ed40 con 0x558ff8c8d4d0 2024-09-17T01:35:50.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.137+0000 7fde59e21740 1 -- 172.21.15.42:0/2064446424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8c8d4d0 msgr2=0x558ff90a2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:50.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.137+0000 7fde59e21740 1 --2- 172.21.15.42:0/2064446424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8c8d4d0 0x558ff90a2810 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fde34009650 tx=0x7fde34014000 comp rx=0 tx=0).stop 2024-09-17T01:35:50.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.137+0000 7fde59e21740 1 -- 172.21.15.42:0/2064446424 shutdown_connections 2024-09-17T01:35:50.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.137+0000 7fde59e21740 1 --2- 172.21.15.42:0/2064446424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ff8c956b0 0x558ff9087440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.137+0000 7fde59e21740 1 --2- 172.21.15.42:0/2064446424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8c8d4d0 0x558ff90a2810 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.137+0000 7fde59e21740 1 --2- 172.21.15.42:0/2064446424 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ff8cb6390 0x558ff90a22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.137+0000 7fde59e21740 1 -- 172.21.15.42:0/2064446424 >> 172.21.15.42:0/2064446424 conn(0x558ff8caa4e0 msgr2=0x558ff905d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:50.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.137+0000 7fde59e21740 1 -- 172.21.15.42:0/2064446424 shutdown_connections 2024-09-17T01:35:50.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.137+0000 7fde59e21740 1 -- 172.21.15.42:0/2064446424 wait complete. 2024-09-17T01:35:50.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.138+0000 7fde59e21740 1 -- start start 2024-09-17T01:35:50.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.138+0000 7fde59e21740 1 Processor -- start 2024-09-17T01:35:50.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.140+0000 7fde59e21740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ff8c8d4d0 0x558ff9088da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.140+0000 7fde59e21740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ff8c956b0 0x558ff909f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.140+0000 7fde59e21740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8cb6390 0x558ff90a1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.140+0000 7fde59e21740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558ff8d30740 con 0x558ff8cb6390 2024-09-17T01:35:50.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.140+0000 7fde59e21740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558ff8f66290 con 0x558ff8c8d4d0 2024-09-17T01:35:50.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.140+0000 7fde59e21740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558ff908ba10 con 0x558ff8c956b0 2024-09-17T01:35:50.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.140+0000 7fde59e21740 10 client.0 _ll_register_callbacks cb 0x558ff8f431e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:50.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.140+0000 7fde50c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8cb6390 0x558ff90a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.140+0000 7fde4be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ff8c8d4d0 0x558ff9088da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.140+0000 7fde43400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ff8c956b0 0x558ff909f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.140+0000 7fde4be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ff8c8d4d0 0x558ff9088da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:51620/0 (socket says 172.21.15.42:51620) 2024-09-17T01:35:50.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.140+0000 7fde4be00640 1 -- 172.21.15.42:0/73824674 learned_addr learned my addr 172.21.15.42:0/73824674 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:50.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.140+0000 7fde50c00640 1 --2- 172.21.15.42:0/73824674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8cb6390 0x558ff90a1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34626/0 (socket says 172.21.15.42:34626) 2024-09-17T01:35:50.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.141+0000 7fde4be00640 1 -- 172.21.15.42:0/73824674 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ff8c956b0 msgr2=0x558ff909f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:50.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.141+0000 7fde4be00640 1 --2- 172.21.15.42:0/73824674 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ff8c956b0 0x558ff909f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.141+0000 7fde4be00640 1 -- 172.21.15.42:0/73824674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8cb6390 msgr2=0x558ff90a1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:50.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.141+0000 7fde4be00640 1 --2- 172.21.15.42:0/73824674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8cb6390 0x558ff90a1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.141+0000 7fde4be00640 1 -- 172.21.15.42:0/73824674 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ff8d987d0 con 0x558ff8c8d4d0 2024-09-17T01:35:50.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.141+0000 7fde4be00640 1 --2- 172.21.15.42:0/73824674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ff8c8d4d0 0x558ff9088da0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fde3c098460 tx=0x7fde3c0615f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e774afb99db6438 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:50.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.141+0000 7fde38c00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-17T01:35:50.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.141+0000 7fde38c00640 1 -- 172.21.15.42:0/73824674 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c088070 con 0x558ff8c8d4d0 2024-09-17T01:35:50.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.141+0000 7fde38c00640 1 -- 172.21.15.42:0/73824674 <== mon.1 v2:172.21.15.43:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 5854+0+0 (secure 0 0 0) 0x7fde3c05d760 con 0x558ff8c8d4d0 2024-09-17T01:35:50.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.141+0000 7fde59e21740 1 -- 172.21.15.42:0/73824674 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde3400e930 con 0x558ff8c8d4d0 2024-09-17T01:35:50.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.142+0000 7fde38c00640 1 -- 172.21.15.42:0/73824674 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fde3c07c020 con 0x558ff8c8d4d0 2024-09-17T01:35:50.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.142+0000 7fde59e21740 10 client.5833 fetch_fsmap learned FSMap version 31 2024-09-17T01:35:50.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.142+0000 7fde59e21740 1 -- 172.21.15.42:0/73824674 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x558ff908b7e0 con 0x558ff8c8d4d0 2024-09-17T01:35:50.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.142+0000 7fde38c00640 1 -- 172.21.15.42:0/73824674 <== mon.1 v2:172.21.15.43:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde3400e930 con 0x558ff8c8d4d0 2024-09-17T01:35:50.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.142+0000 7fde38c00640 1 -- 172.21.15.42:0/73824674 <== mon.1 v2:172.21.15.43:3300/0 5 ==== fsmap(e 31) ==== 3502+0+0 (secure 0 0 0) 0x7fde3c05d960 con 0x558ff8c8d4d0 2024-09-17T01:35:50.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.142+0000 7fde59e21740 10 client.5833 fetch_fsmap finished waiting for FSMap version 31 2024-09-17T01:35:50.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.142+0000 7fde59e21740 10 client.5833 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:50.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.142+0000 7fde59e21740 20 client.5833 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:50.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.142+0000 7fde59e21740 1 --2- 172.21.15.42:0/73824674 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558ff8c74f60 0x558ff908a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.142+0000 7fde59e21740 4 client.5833 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:50.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.142+0000 7fde59e21740 1 -- 172.21.15.42:0/73824674 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ff8fd2640 con 0x558ff8c74f60 2024-09-17T01:35:50.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.142+0000 7fde43400640 1 --2- 172.21.15.42:0/73824674 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558ff8c74f60 0x558ff908a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.143+0000 7fde43400640 1 --2- 172.21.15.42:0/73824674 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558ff8c74f60 0x558ff908a900 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f5f67dce3bb854f server_cookie=d5e55806b05a72eb in_seq=0 out_seq=0 2024-09-17T01:35:50.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.143+0000 7fde38c00640 10 client.5833 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:50.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.144+0000 7fde38c00640 1 -- 172.21.15.42:0/73824674 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558ff8fd2640 con 0x558ff8c74f60 2024-09-17T01:35:50.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.144+0000 7fde38c00640 10 client.5833 handle_command_reply: tid=0 2024-09-17T01:35:50.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.144+0000 7fde59e21740 1 client.5833 shutdown 2024-09-17T01:35:50.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.144+0000 7fde59e21740 1 -- 172.21.15.42:0/73824674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ff8c8d4d0 msgr2=0x558ff9088da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:50.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.144+0000 7fde59e21740 1 --2- 172.21.15.42:0/73824674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ff8c8d4d0 0x558ff9088da0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fde3c098460 tx=0x7fde3c0615f0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.144+0000 7fde59e21740 1 -- 172.21.15.42:0/73824674 shutdown_connections 2024-09-17T01:35:50.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.144+0000 7fde59e21740 1 --2- 172.21.15.42:0/73824674 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558ff8c74f60 0x558ff908a900 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.144+0000 7fde59e21740 1 --2- 172.21.15.42:0/73824674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8cb6390 0x558ff90a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.144+0000 7fde59e21740 1 --2- 172.21.15.42:0/73824674 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ff8c956b0 0x558ff909f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.144+0000 7fde59e21740 1 --2- 172.21.15.42:0/73824674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ff8c8d4d0 0x558ff9088da0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.144+0000 7fde59e21740 1 -- 172.21.15.42:0/73824674 >> 172.21.15.42:0/73824674 conn(0x558ff8caa4e0 msgr2=0x558ff90a2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:50.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.144+0000 7fde38c00640 0 client.5833 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:50.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.144+0000 7fde59e21740 1 -- 172.21.15.42:0/73824674 shutdown_connections 2024-09-17T01:35:50.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.144+0000 7fde59e21740 1 -- 172.21.15.42:0/73824674 wait complete. 2024-09-17T01:35:50.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.144+0000 7fde59e21740 20 client.5833 trim_cache size 0 max 16384 2024-09-17T01:35:50.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.159+0000 7fde59e21740 1 Processor -- start 2024-09-17T01:35:50.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.159+0000 7fde59e21740 1 -- start start 2024-09-17T01:35:50.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.160+0000 7fde59e21740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ff8c8d4d0 0x558ff9056cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.160+0000 7fde59e21740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ff8c956b0 0x558ff90840d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.160+0000 7fde59e21740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8cb6390 0x558ff9084610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.160+0000 7fde59e21740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c15eee0 con 0x558ff8cb6390 2024-09-17T01:35:50.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.160+0000 7fde59e21740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c15df70 con 0x558ff8c956b0 2024-09-17T01:35:50.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.160+0000 7fde59e21740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fde4c1536a0 con 0x558ff8c8d4d0 2024-09-17T01:35:50.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.160+0000 7fde50c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8cb6390 0x558ff9084610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.160+0000 7fde50c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8cb6390 0x558ff9084610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34628/0 (socket says 172.21.15.42:34628) 2024-09-17T01:35:50.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.160+0000 7fde50c00640 1 -- 172.21.15.42:0/1633900274 learned_addr learned my addr 172.21.15.42:0/1633900274 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:50.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.161+0000 7fde4be00640 1 --2- 172.21.15.42:0/1633900274 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ff8c8d4d0 0x558ff9056cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.161+0000 7fde43400640 1 --2- 172.21.15.42:0/1633900274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ff8c956b0 0x558ff90840d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.161+0000 7fde50c00640 1 -- 172.21.15.42:0/1633900274 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ff8c8d4d0 msgr2=0x558ff9056cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:50.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.161+0000 7fde50c00640 1 --2- 172.21.15.42:0/1633900274 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ff8c8d4d0 0x558ff9056cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.161+0000 7fde50c00640 1 -- 172.21.15.42:0/1633900274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ff8c956b0 msgr2=0x558ff90840d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:50.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.161+0000 7fde50c00640 1 --2- 172.21.15.42:0/1633900274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ff8c956b0 0x558ff90840d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.161+0000 7fde50c00640 1 -- 172.21.15.42:0/1633900274 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ff905db80 con 0x558ff8cb6390 2024-09-17T01:35:50.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.161+0000 7fde50c00640 1 --2- 172.21.15.42:0/1633900274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8cb6390 0x558ff9084610 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fde44009d60 tx=0x7fde44004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c20f2f51ddb50fa server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:50.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.161+0000 7fde3b400640 1 -- 172.21.15.42:0/1633900274 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde44033040 con 0x558ff8cb6390 2024-09-17T01:35:50.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.161+0000 7fde3b400640 1 -- 172.21.15.42:0/1633900274 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde44048070 con 0x558ff8cb6390 2024-09-17T01:35:50.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.161+0000 7fde3b400640 1 -- 172.21.15.42:0/1633900274 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde44003970 con 0x558ff8cb6390 2024-09-17T01:35:50.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.162+0000 7fde59e21740 1 -- 172.21.15.42:0/1633900274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8cb6390 msgr2=0x558ff9084610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:50.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.162+0000 7fde59e21740 1 --2- 172.21.15.42:0/1633900274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8cb6390 0x558ff9084610 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fde44009d60 tx=0x7fde44004ab0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.162+0000 7fde59e21740 1 -- 172.21.15.42:0/1633900274 shutdown_connections 2024-09-17T01:35:50.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.162+0000 7fde59e21740 1 --2- 172.21.15.42:0/1633900274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ff8c956b0 0x558ff90840d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.162+0000 7fde59e21740 1 --2- 172.21.15.42:0/1633900274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8cb6390 0x558ff9084610 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.162+0000 7fde59e21740 1 --2- 172.21.15.42:0/1633900274 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ff8c8d4d0 0x558ff9056cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.162+0000 7fde59e21740 1 -- 172.21.15.42:0/1633900274 >> 172.21.15.42:0/1633900274 conn(0x558ff8caa4e0 msgr2=0x558ff9088bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:50.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.162+0000 7fde59e21740 1 -- 172.21.15.42:0/1633900274 shutdown_connections 2024-09-17T01:35:50.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.162+0000 7fde59e21740 1 -- 172.21.15.42:0/1633900274 wait complete. 2024-09-17T01:35:50.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.163+0000 7fde59e21740 1 -- start start 2024-09-17T01:35:50.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.163+0000 7fde59e21740 1 Processor -- start 2024-09-17T01:35:50.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.165+0000 7fde59e21740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8c8d4d0 0x558ff9121150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.165+0000 7fde59e21740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ff8c956b0 0x558ff909b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.165+0000 7fde59e21740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ff8cb6390 0x558ff909bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.165+0000 7fde59e21740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c153cf0 con 0x558ff8c8d4d0 2024-09-17T01:35:50.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.165+0000 7fde59e21740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558ff912ada0 con 0x558ff8c956b0 2024-09-17T01:35:50.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.165+0000 7fde59e21740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558ff90586f0 con 0x558ff8cb6390 2024-09-17T01:35:50.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.165+0000 7fde59e21740 10 client.0 _ll_register_callbacks cb 0x7fde3c061be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:50.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.165+0000 7fde4be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8c8d4d0 0x558ff9121150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.165+0000 7fde4be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8c8d4d0 0x558ff9121150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34634/0 (socket says 172.21.15.42:34634) 2024-09-17T01:35:50.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.165+0000 7fde4be00640 1 -- 172.21.15.42:0/1510770017 learned_addr learned my addr 172.21.15.42:0/1510770017 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:50.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.165+0000 7fde43400640 1 --2- 172.21.15.42:0/1510770017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ff8c956b0 0x558ff909b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.165+0000 7fde50c00640 1 --2- 172.21.15.42:0/1510770017 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ff8cb6390 0x558ff909bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.166+0000 7fde4be00640 1 -- 172.21.15.42:0/1510770017 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ff8cb6390 msgr2=0x558ff909bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:50.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.166+0000 7fde4be00640 1 --2- 172.21.15.42:0/1510770017 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ff8cb6390 0x558ff909bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.166+0000 7fde4be00640 1 -- 172.21.15.42:0/1510770017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ff8c956b0 msgr2=0x558ff909b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:50.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.166+0000 7fde4be00640 1 --2- 172.21.15.42:0/1510770017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ff8c956b0 0x558ff909b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.166+0000 7fde4be00640 1 -- 172.21.15.42:0/1510770017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ff9052780 con 0x558ff8c8d4d0 2024-09-17T01:35:50.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.166+0000 7fde43400640 1 --2- 172.21.15.42:0/1510770017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ff8c956b0 0x558ff909b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:50.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.166+0000 7fde4be00640 1 --2- 172.21.15.42:0/1510770017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8c8d4d0 0x558ff9121150 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fde3c000fd0 tx=0x7fde3c0614b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea97864959bf115 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:50.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.166+0000 7fde38c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:50.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.166+0000 7fde38c00640 1 -- 172.21.15.42:0/1510770017 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c088040 con 0x558ff8c8d4d0 2024-09-17T01:35:50.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.166+0000 7fde38c00640 1 -- 172.21.15.42:0/1510770017 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 5854+0+0 (secure 0 0 0) 0x7fde3c060ae0 con 0x558ff8c8d4d0 2024-09-17T01:35:50.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.166+0000 7fde59e21740 1 -- 172.21.15.42:0/1510770017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde44048070 con 0x558ff8c8d4d0 2024-09-17T01:35:50.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.166+0000 7fde38c00640 1 -- 172.21.15.42:0/1510770017 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fde3c066070 con 0x558ff8c8d4d0 2024-09-17T01:35:50.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.166+0000 7fde59e21740 10 client.6009 fetch_fsmap learned FSMap version 31 2024-09-17T01:35:50.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.166+0000 7fde59e21740 1 -- 172.21.15.42:0/1510770017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x558ff912aae0 con 0x558ff8c8d4d0 2024-09-17T01:35:50.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.167+0000 7fde38c00640 1 -- 172.21.15.42:0/1510770017 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde44048070 con 0x558ff8c8d4d0 2024-09-17T01:35:50.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.167+0000 7fde38c00640 1 -- 172.21.15.42:0/1510770017 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 3502+0+0 (secure 0 0 0) 0x7fde3c060ce0 con 0x558ff8c8d4d0 2024-09-17T01:35:50.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.167+0000 7fde59e21740 10 client.6009 fetch_fsmap finished waiting for FSMap version 31 2024-09-17T01:35:50.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.167+0000 7fde59e21740 10 client.6009 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:50.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.167+0000 7fde59e21740 20 client.6009 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:50.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.167+0000 7fde59e21740 1 --2- 172.21.15.42:0/1510770017 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558ff90a2350 0x558ff90a2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.167+0000 7fde59e21740 4 client.6009 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-17T01:35:50.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.167+0000 7fde59e21740 1 -- 172.21.15.42:0/1510770017 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558ff908a190 con 0x558ff90a2350 2024-09-17T01:35:50.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.167+0000 7fde43400640 1 --2- 172.21.15.42:0/1510770017 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558ff90a2350 0x558ff90a2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.167+0000 7fde43400640 1 --2- 172.21.15.42:0/1510770017 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558ff90a2350 0x558ff90a2760 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3231e2ac896a8226 server_cookie=38c2a2ef81a46540 in_seq=0 out_seq=0 2024-09-17T01:35:50.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.167+0000 7fde38c00640 10 client.6009 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:50.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.168+0000 7fde38c00640 1 -- 172.21.15.42:0/1510770017 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+168 (crc 0 0 0) 0x558ff908a190 con 0x558ff90a2350 2024-09-17T01:35:50.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.168+0000 7fde38c00640 10 client.6009 handle_command_reply: tid=0 2024-09-17T01:35:50.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.168+0000 7fde59e21740 1 client.6009 shutdown 2024-09-17T01:35:50.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.168+0000 7fde59e21740 1 -- 172.21.15.42:0/1510770017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8c8d4d0 msgr2=0x558ff9121150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:50.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.168+0000 7fde59e21740 1 --2- 172.21.15.42:0/1510770017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8c8d4d0 0x558ff9121150 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fde3c000fd0 tx=0x7fde3c0614b0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.168+0000 7fde59e21740 1 -- 172.21.15.42:0/1510770017 shutdown_connections 2024-09-17T01:35:50.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.168+0000 7fde59e21740 1 --2- 172.21.15.42:0/1510770017 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x558ff90a2350 0x558ff90a2760 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.168+0000 7fde59e21740 1 --2- 172.21.15.42:0/1510770017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558ff8c956b0 0x558ff909b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.168+0000 7fde59e21740 1 --2- 172.21.15.42:0/1510770017 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558ff8cb6390 0x558ff909bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.168+0000 7fde38c00640 0 client.6009 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:50.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.168+0000 7fde59e21740 1 --2- 172.21.15.42:0/1510770017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558ff8c8d4d0 0x558ff9121150 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.168+0000 7fde59e21740 1 -- 172.21.15.42:0/1510770017 >> 172.21.15.42:0/1510770017 conn(0x558ff8caa4e0 msgr2=0x558ff9056f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:50.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.168+0000 7fde59e21740 1 -- 172.21.15.42:0/1510770017 shutdown_connections 2024-09-17T01:35:50.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.168+0000 7fde59e21740 1 -- 172.21.15.42:0/1510770017 wait complete. 2024-09-17T01:35:50.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.168+0000 7fde59e21740 20 client.6009 trim_cache size 0 max 16384 2024-09-17T01:35:50.170 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-09-17T01:35:50.170 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:35:50.170 INFO:teuthology.orchestra.run.smithi042.stdout: "damage_type": "backtrace", 2024-09-17T01:35:50.170 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 3202077941, 2024-09-17T01:35:50.170 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511630414, 2024-09-17T01:35:50.170 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1" 2024-09-17T01:35:50.171 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:35:50.171 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-09-17T01:35:50.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.169+0000 7fde51600640 1 -- 172.21.15.42:0/688503934 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde28078b90 msgr2=0x7fde2807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:50.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.169+0000 7fde51600640 1 --2- 172.21.15.42:0/688503934 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde28078b90 0x7fde2807b0a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0ad9c0 tx=0x7fde34005f90 comp rx=0 tx=0).stop 2024-09-17T01:35:50.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.169+0000 7fde51600640 1 -- 172.21.15.42:0/688503934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde4c0af910 msgr2=0x7fde4c0b0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:50.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.169+0000 7fde51600640 1 --2- 172.21.15.42:0/688503934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde4c0af910 0x7fde4c0b0f00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fde3c00c3d0 tx=0x7fde3c00c890 comp rx=0 tx=0).stop 2024-09-17T01:35:50.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.169+0000 7fde51600640 1 -- 172.21.15.42:0/688503934 shutdown_connections 2024-09-17T01:35:50.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.169+0000 7fde51600640 1 --2- 172.21.15.42:0/688503934 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde28078b90 0x7fde2807b0a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.169+0000 7fde51600640 1 --2- 172.21.15.42:0/688503934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde4c0ccb90 0x7fde4c09d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.169+0000 7fde51600640 1 --2- 172.21.15.42:0/688503934 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde4c0b32b0 0x7fde4c073530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.169+0000 7fde51600640 1 --2- 172.21.15.42:0/688503934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde4c0af910 0x7fde4c0b0f00 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.169+0000 7fde51600640 1 -- 172.21.15.42:0/688503934 >> 172.21.15.42:0/688503934 conn(0x7fde4c06d440 msgr2=0x7fde4c15bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:50.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.169+0000 7fde51600640 1 -- 172.21.15.42:0/688503934 shutdown_connections 2024-09-17T01:35:50.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.169+0000 7fde51600640 1 -- 172.21.15.42:0/688503934 wait complete. 2024-09-17T01:35:50.191 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:35:50.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.419+0000 7f2e6f000640 1 -- 172.21.15.42:0/3567514142 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2e6815d2d0 msgr2=0x7f2e68072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:50.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.419+0000 7f2e6f000640 1 --2- 172.21.15.42:0/3567514142 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2e6815d2d0 0x7f2e68072950 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2e50009860 tx=0x7f2e5002a510 comp rx=0 tx=0).stop 2024-09-17T01:35:50.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.420+0000 7f2e6f000640 1 -- 172.21.15.42:0/3567514142 shutdown_connections 2024-09-17T01:35:50.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.420+0000 7f2e6f000640 1 --2- 172.21.15.42:0/3567514142 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2e6815d2d0 0x7f2e68072950 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.420+0000 7f2e6f000640 1 -- 172.21.15.42:0/3567514142 >> 172.21.15.42:0/3567514142 conn(0x7f2e680b2930 msgr2=0x7f2e6806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:50.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.420+0000 7f2e6f000640 1 -- 172.21.15.42:0/3567514142 shutdown_connections 2024-09-17T01:35:50.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.420+0000 7f2e6f000640 1 -- 172.21.15.42:0/3567514142 wait complete. 2024-09-17T01:35:50.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.422+0000 7f2e6f000640 1 Processor -- start 2024-09-17T01:35:50.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.422+0000 7f2e6f000640 1 -- start start 2024-09-17T01:35:50.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.423+0000 7f2e6f000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e68072e90 0x7f2e681595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.423+0000 7f2e6f000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2e6815cec0 0x7f2e68157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.423+0000 7f2e6f000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e6815d2d0 0x7f2e681f3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.423+0000 7f2e6f000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2e68074130 con 0x7f2e6815d2d0 2024-09-17T01:35:50.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.423+0000 7f2e6f000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2e68073fb0 con 0x7f2e68072e90 2024-09-17T01:35:50.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.423+0000 7f2e6f000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2e6806db40 con 0x7f2e6815cec0 2024-09-17T01:35:50.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.424+0000 7f2e6d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e6815d2d0 0x7f2e681f3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.424+0000 7f2e6d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e6815d2d0 0x7f2e681f3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34646/0 (socket says 172.21.15.42:34646) 2024-09-17T01:35:50.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.424+0000 7f2e6d000640 1 -- 172.21.15.42:0/566685428 learned_addr learned my addr 172.21.15.42:0/566685428 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:50.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.424+0000 7f2e5fe00640 1 --2- 172.21.15.42:0/566685428 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2e6815cec0 0x7f2e68157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.424+0000 7f2e67e00640 1 --2- 172.21.15.42:0/566685428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e68072e90 0x7f2e681595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.424+0000 7f2e6d000640 1 -- 172.21.15.42:0/566685428 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2e6815cec0 msgr2=0x7f2e68157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:50.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.424+0000 7f2e6d000640 1 --2- 172.21.15.42:0/566685428 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2e6815cec0 0x7f2e68157e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.424+0000 7f2e6d000640 1 -- 172.21.15.42:0/566685428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e68072e90 msgr2=0x7f2e681595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:50.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.424+0000 7f2e6d000640 1 --2- 172.21.15.42:0/566685428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e68072e90 0x7f2e681595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.424+0000 7f2e6d000640 1 -- 172.21.15.42:0/566685428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e68153fc0 con 0x7f2e6815d2d0 2024-09-17T01:35:50.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.424+0000 7f2e67e00640 1 --2- 172.21.15.42:0/566685428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e68072e90 0x7f2e681595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:50.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.424+0000 7f2e6d000640 1 --2- 172.21.15.42:0/566685428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e6815d2d0 0x7f2e681f3bd0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2e6000c760 tx=0x7f2e6000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:50.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.425+0000 7f2e64c00640 1 -- 172.21.15.42:0/566685428 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e60003b70 con 0x7f2e6815d2d0 2024-09-17T01:35:50.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.425+0000 7f2e64c00640 1 -- 172.21.15.42:0/566685428 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e60003d10 con 0x7f2e6815d2d0 2024-09-17T01:35:50.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.425+0000 7f2e64c00640 1 -- 172.21.15.42:0/566685428 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6000aab0 con 0x7f2e6815d2d0 2024-09-17T01:35:50.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.425+0000 7f2e6f000640 1 -- 172.21.15.42:0/566685428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e681542a0 con 0x7f2e6815d2d0 2024-09-17T01:35:50.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.425+0000 7f2e6f000640 1 -- 172.21.15.42:0/566685428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e6815c710 con 0x7f2e6815d2d0 2024-09-17T01:35:50.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.426+0000 7f2e6f000640 1 -- 172.21.15.42:0/566685428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e6815c970 con 0x7f2e6815d2d0 2024-09-17T01:35:50.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.427+0000 7f2e64c00640 1 -- 172.21.15.42:0/566685428 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2e6000ac50 con 0x7f2e6815d2d0 2024-09-17T01:35:50.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.429+0000 7f2e64c00640 1 --2- 172.21.15.42:0/566685428 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2e44078bc0 0x7f2e4407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.429+0000 7f2e64c00640 1 -- 172.21.15.42:0/566685428 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5854+0+0 (secure 0 0 0) 0x7f2e6009abb0 con 0x7f2e6815d2d0 2024-09-17T01:35:50.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.429+0000 7f2e67e00640 1 --2- 172.21.15.42:0/566685428 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2e44078bc0 0x7f2e4407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.430+0000 7f2e67e00640 1 --2- 172.21.15.42:0/566685428 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2e44078bc0 0x7f2e4407b0d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2e680708a0 tx=0x7f2e58009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:50.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.434+0000 7f2e64c00640 1 -- 172.21.15.42:0/566685428 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2e60062ec0 con 0x7f2e6815d2d0 2024-09-17T01:35:50.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.666+0000 7f2e6f000640 1 -- 172.21.15.42:0/566685428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e68153d50 con 0x7f2e6815d2d0 2024-09-17T01:35:50.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.667+0000 7f2e64c00640 1 -- 172.21.15.42:0/566685428 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5224 (secure 0 0 0) 0x7f2e600627c0 con 0x7f2e6815d2d0 2024-09-17T01:35:50.665 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:35:50.665 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":31,"btime":"2024-09-17T01:35:47:824511+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5209,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4107697732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":4107697732},{"type":"v1","addr":"172.21.15.43:6837","nonce":4107697732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1959050852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1959050852},{"type":"v1","addr":"172.21.15.42:6833","nonce":1959050852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5271,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2487768756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2487768756},{"type":"v1","addr":"172.21.15.43:6836","nonce":2487768756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:35:11.176089+0000","modified":"2024-09-17T01:35:47.706461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.42:6835/1094322669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1094322669},{"type":"v1","addr":"172.21.15.42:6835","nonce":1094322669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-17T01:35:50.665 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 31 2024-09-17T01:35:50.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.669+0000 7f2e6f000640 1 -- 172.21.15.42:0/566685428 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2e44078bc0 msgr2=0x7f2e4407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:50.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.670+0000 7f2e6f000640 1 --2- 172.21.15.42:0/566685428 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2e44078bc0 0x7f2e4407b0d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2e680708a0 tx=0x7f2e58009040 comp rx=0 tx=0).stop 2024-09-17T01:35:50.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.670+0000 7f2e6f000640 1 -- 172.21.15.42:0/566685428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e6815d2d0 msgr2=0x7f2e681f3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:50.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.670+0000 7f2e6f000640 1 --2- 172.21.15.42:0/566685428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e6815d2d0 0x7f2e681f3bd0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2e6000c760 tx=0x7f2e6000cc20 comp rx=0 tx=0).stop 2024-09-17T01:35:50.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.670+0000 7f2e6f000640 1 -- 172.21.15.42:0/566685428 shutdown_connections 2024-09-17T01:35:50.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.670+0000 7f2e6f000640 1 --2- 172.21.15.42:0/566685428 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2e44078bc0 0x7f2e4407b0d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.670+0000 7f2e6f000640 1 --2- 172.21.15.42:0/566685428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e6815d2d0 0x7f2e681f3bd0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.670+0000 7f2e6f000640 1 --2- 172.21.15.42:0/566685428 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2e6815cec0 0x7f2e68157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.670+0000 7f2e6f000640 1 --2- 172.21.15.42:0/566685428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e68072e90 0x7f2e681595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.670+0000 7f2e6f000640 1 -- 172.21.15.42:0/566685428 >> 172.21.15.42:0/566685428 conn(0x7f2e680b2930 msgr2=0x7f2e68158610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:50.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.670+0000 7f2e6f000640 1 -- 172.21.15.42:0/566685428 shutdown_connections 2024-09-17T01:35:50.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.670+0000 7f2e6f000640 1 -- 172.21.15.42:0/566685428 wait complete. 2024-09-17T01:35:50.693 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage rm 3202077941 2024-09-17T01:35:50.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.932+0000 7f4848800640 1 -- 172.21.15.42:0/2816241175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4840072e90 msgr2=0x7f48400cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:50.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.932+0000 7f4848800640 1 --2- 172.21.15.42:0/2816241175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4840072e90 0x7f48400cec40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f483c005fd0 tx=0x7f483c02aa10 comp rx=0 tx=0).stop 2024-09-17T01:35:50.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.932+0000 7f4848800640 1 -- 172.21.15.42:0/2816241175 shutdown_connections 2024-09-17T01:35:50.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.932+0000 7f4848800640 1 --2- 172.21.15.42:0/2816241175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4840072e90 0x7f48400cec40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.932+0000 7f4848800640 1 --2- 172.21.15.42:0/2816241175 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4840142f40 0x7f4840072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.932+0000 7f4848800640 1 -- 172.21.15.42:0/2816241175 >> 172.21.15.42:0/2816241175 conn(0x7f48400b2930 msgr2=0x7f484006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:50.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.932+0000 7f4848800640 1 -- 172.21.15.42:0/2816241175 shutdown_connections 2024-09-17T01:35:50.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.932+0000 7f4848800640 1 -- 172.21.15.42:0/2816241175 wait complete. 2024-09-17T01:35:50.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.934+0000 7f4848800640 1 Processor -- start 2024-09-17T01:35:50.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.935+0000 7f4848800640 1 -- start start 2024-09-17T01:35:50.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.936+0000 7f4848800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4840072e90 0x7f48400b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.936+0000 7f4848800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48400b3550 0x7f48400b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.936+0000 7f4848800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4840142f40 0x7f48401f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.936+0000 7f4848800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f484006d7c0 con 0x7f48400b3550 2024-09-17T01:35:50.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.936+0000 7f4848800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f484006d640 con 0x7f4840072e90 2024-09-17T01:35:50.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.936+0000 7f4848800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f484006d940 con 0x7f4840142f40 2024-09-17T01:35:50.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.936+0000 7f4845400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48400b3550 0x7f48400b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.936+0000 7f4845400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48400b3550 0x7f48400b1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34662/0 (socket says 172.21.15.42:34662) 2024-09-17T01:35:50.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.936+0000 7f4845400640 1 -- 172.21.15.42:0/4087914045 learned_addr learned my addr 172.21.15.42:0/4087914045 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:50.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.937+0000 7f4846800640 1 --2- 172.21.15.42:0/4087914045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4840142f40 0x7f48401f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.937+0000 7f4845e00640 1 --2- 172.21.15.42:0/4087914045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4840072e90 0x7f48400b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.937+0000 7f4845400640 1 -- 172.21.15.42:0/4087914045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4840142f40 msgr2=0x7f48401f5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:50.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.937+0000 7f4845400640 1 --2- 172.21.15.42:0/4087914045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4840142f40 0x7f48401f5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.937+0000 7f4845400640 1 -- 172.21.15.42:0/4087914045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4840072e90 msgr2=0x7f48400b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:50.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.937+0000 7f4845400640 1 --2- 172.21.15.42:0/4087914045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4840072e90 0x7f48400b15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.937+0000 7f4845400640 1 -- 172.21.15.42:0/4087914045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48401426d0 con 0x7f48400b3550 2024-09-17T01:35:50.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.937+0000 7f4845400640 1 --2- 172.21.15.42:0/4087914045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48400b3550 0x7f48400b1b20 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f483000e790 tx=0x7f483000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:50.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.937+0000 7f483a000640 1 -- 172.21.15.42:0/4087914045 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483000eea0 con 0x7f48400b3550 2024-09-17T01:35:50.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.937+0000 7f483a000640 1 -- 172.21.15.42:0/4087914045 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f483000cdb0 con 0x7f48400b3550 2024-09-17T01:35:50.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.937+0000 7f4848800640 1 -- 172.21.15.42:0/4087914045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f484006f4b0 con 0x7f48400b3550 2024-09-17T01:35:50.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.938+0000 7f483a000640 1 -- 172.21.15.42:0/4087914045 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830010690 con 0x7f48400b3550 2024-09-17T01:35:50.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.938+0000 7f4848800640 1 -- 172.21.15.42:0/4087914045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f484006fa70 con 0x7f48400b3550 2024-09-17T01:35:50.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.940+0000 7f483a000640 1 -- 172.21.15.42:0/4087914045 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4830010830 con 0x7f48400b3550 2024-09-17T01:35:50.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.941+0000 7f483a000640 1 --2- 172.21.15.42:0/4087914045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4824078b90 0x7f482407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.941+0000 7f483a000640 1 -- 172.21.15.42:0/4087914045 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5854+0+0 (secure 0 0 0) 0x7f483009b8c0 con 0x7f48400b3550 2024-09-17T01:35:50.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.942+0000 7f484f8a4740 1 Processor -- start 2024-09-17T01:35:50.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.942+0000 7f4845e00640 1 --2- 172.21.15.42:0/4087914045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4824078b90 0x7f482407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.942+0000 7f484f8a4740 1 -- start start 2024-09-17T01:35:50.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.942+0000 7f4845e00640 1 --2- 172.21.15.42:0/4087914045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4824078b90 0x7f482407b0a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4834007fd0 tx=0x7f4834009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:50.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.943+0000 7f484f8a4740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562cd75992a0 0x562cd7984ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.943+0000 7f484f8a4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd75703e0 0x562cd7959b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.943+0000 7f484f8a4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75785c0 0x562cd795a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.943+0000 7f484f8a4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562cd78b3740 con 0x562cd75785c0 2024-09-17T01:35:50.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.943+0000 7f484f8a4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562cd78a2b70 con 0x562cd75703e0 2024-09-17T01:35:50.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.943+0000 7f484f8a4740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x562cd78a6980 con 0x562cd75992a0 2024-09-17T01:35:50.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.944+0000 7f4845e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562cd75992a0 0x562cd7984ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.944+0000 7f4846800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75785c0 0x562cd795a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.944+0000 7f4845400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd75703e0 0x562cd7959b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.944+0000 7f4845e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562cd75992a0 0x562cd7984ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:39412/0 (socket says 172.21.15.42:39412) 2024-09-17T01:35:50.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.944+0000 7f4845e00640 1 -- 172.21.15.42:0/2330493234 learned_addr learned my addr 172.21.15.42:0/2330493234 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:50.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.944+0000 7f4845400640 1 -- 172.21.15.42:0/2330493234 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562cd75992a0 msgr2=0x562cd7984ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:50.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.944+0000 7f4845400640 1 --2- 172.21.15.42:0/2330493234 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562cd75992a0 0x562cd7984ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.944+0000 7f4845400640 1 -- 172.21.15.42:0/2330493234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75785c0 msgr2=0x562cd795a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:50.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.944+0000 7f4845400640 1 --2- 172.21.15.42:0/2330493234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75785c0 0x562cd795a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.944+0000 7f4845400640 1 -- 172.21.15.42:0/2330493234 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cd767d710 con 0x562cd75703e0 2024-09-17T01:35:50.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.944+0000 7f4845e00640 1 --2- 172.21.15.42:0/2330493234 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562cd75992a0 0x562cd7984ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:35:50.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.944+0000 7f4846800640 1 --2- 172.21.15.42:0/2330493234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75785c0 0x562cd795a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:35:50.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.945+0000 7f4845400640 1 --2- 172.21.15.42:0/2330493234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd75703e0 0x562cd7959b30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4830099c90 tx=0x7f4830062fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb41670878a4e568 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:50.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.945+0000 7f482e600640 1 -- 172.21.15.42:0/2330493234 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830067fb0 con 0x562cd75703e0 2024-09-17T01:35:50.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.945+0000 7f482e600640 1 -- 172.21.15.42:0/2330493234 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f483006cef0 con 0x562cd75703e0 2024-09-17T01:35:50.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.945+0000 7f482e600640 1 -- 172.21.15.42:0/2330493234 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830062990 con 0x562cd75703e0 2024-09-17T01:35:50.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.946+0000 7f484f8a4740 1 -- 172.21.15.42:0/2330493234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd75703e0 msgr2=0x562cd7959b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:50.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.946+0000 7f484f8a4740 1 --2- 172.21.15.42:0/2330493234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd75703e0 0x562cd7959b30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4830099c90 tx=0x7f4830062fe0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.946+0000 7f484f8a4740 1 -- 172.21.15.42:0/2330493234 shutdown_connections 2024-09-17T01:35:50.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.946+0000 7f484f8a4740 1 --2- 172.21.15.42:0/2330493234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd75703e0 0x562cd7959b30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.946+0000 7f484f8a4740 1 --2- 172.21.15.42:0/2330493234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75785c0 0x562cd795a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.946+0000 7f484f8a4740 1 --2- 172.21.15.42:0/2330493234 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562cd75992a0 0x562cd7984ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.946+0000 7f484f8a4740 1 -- 172.21.15.42:0/2330493234 >> 172.21.15.42:0/2330493234 conn(0x562cd758d3f0 msgr2=0x562cd793ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:50.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.946+0000 7f484f8a4740 1 -- 172.21.15.42:0/2330493234 shutdown_connections 2024-09-17T01:35:50.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.946+0000 7f484f8a4740 1 -- 172.21.15.42:0/2330493234 wait complete. 2024-09-17T01:35:50.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.947+0000 7f484f8a4740 1 -- start start 2024-09-17T01:35:50.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.947+0000 7f484f8a4740 1 Processor -- start 2024-09-17T01:35:50.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.949+0000 7f484f8a4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd75703e0 0x562cd797a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.949+0000 7f484f8a4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75785c0 0x562cd79872a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.949+0000 7f484f8a4740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562cd75992a0 0x562cd79877e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.949+0000 7f484f8a4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562cd7613650 con 0x562cd75785c0 2024-09-17T01:35:50.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.949+0000 7f484f8a4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562cd7848480 con 0x562cd75703e0 2024-09-17T01:35:50.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.949+0000 7f484f8a4740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x562cd796abf0 con 0x562cd75992a0 2024-09-17T01:35:50.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.949+0000 7f484f8a4740 10 client.0 _ll_register_callbacks cb 0x562cd784e560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:50.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.949+0000 7f4845400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75785c0 0x562cd79872a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.949+0000 7f4845e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd75703e0 0x562cd797a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.949+0000 7f4845400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75785c0 0x562cd79872a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34674/0 (socket says 172.21.15.42:34674) 2024-09-17T01:35:50.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.949+0000 7f4845e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd75703e0 0x562cd797a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:51676/0 (socket says 172.21.15.42:51676) 2024-09-17T01:35:50.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.949+0000 7f4845400640 1 -- 172.21.15.42:0/845811654 learned_addr learned my addr 172.21.15.42:0/845811654 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:50.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.949+0000 7f4846800640 1 --2- 172.21.15.42:0/845811654 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562cd75992a0 0x562cd79877e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.949+0000 7f4845400640 1 -- 172.21.15.42:0/845811654 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562cd75992a0 msgr2=0x562cd79877e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:50.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.949+0000 7f4845400640 1 --2- 172.21.15.42:0/845811654 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562cd75992a0 0x562cd79877e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.949+0000 7f4845400640 1 -- 172.21.15.42:0/845811654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd75703e0 msgr2=0x562cd797a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:50.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.949+0000 7f4845400640 1 --2- 172.21.15.42:0/845811654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd75703e0 0x562cd797a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.949+0000 7f4845400640 1 -- 172.21.15.42:0/845811654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cd76ddea0 con 0x562cd75785c0 2024-09-17T01:35:50.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.950+0000 7f4845e00640 1 --2- 172.21.15.42:0/845811654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd75703e0 0x562cd797a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:35:50.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.950+0000 7f4845400640 1 --2- 172.21.15.42:0/845811654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75785c0 0x562cd79872a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4830099c90 tx=0x7f4830062960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b156a0469aa4ea server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:50.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.950+0000 7f4822a00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:50.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.950+0000 7f4822a00640 1 -- 172.21.15.42:0/845811654 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830010d20 con 0x562cd75785c0 2024-09-17T01:35:50.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.950+0000 7f4822a00640 1 -- 172.21.15.42:0/845811654 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 5854+0+0 (secure 0 0 0) 0x7f483005ee20 con 0x562cd75785c0 2024-09-17T01:35:50.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.950+0000 7f484f8a4740 1 -- 172.21.15.42:0/845811654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f483006cef0 con 0x562cd75785c0 2024-09-17T01:35:50.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.950+0000 7f4822a00640 1 -- 172.21.15.42:0/845811654 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f483005f020 con 0x562cd75785c0 2024-09-17T01:35:50.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.950+0000 7f484f8a4740 10 client.6024 fetch_fsmap learned FSMap version 31 2024-09-17T01:35:50.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.950+0000 7f484f8a4740 1 -- 172.21.15.42:0/845811654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x562cd75e25b0 con 0x562cd75785c0 2024-09-17T01:35:50.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.950+0000 7f4822a00640 1 -- 172.21.15.42:0/845811654 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f483006cef0 con 0x562cd75785c0 2024-09-17T01:35:50.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.951+0000 7f4822a00640 1 -- 172.21.15.42:0/845811654 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 3502+0+0 (secure 0 0 0) 0x7f48300621a0 con 0x562cd75785c0 2024-09-17T01:35:50.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.951+0000 7f484f8a4740 10 client.6024 fetch_fsmap finished waiting for FSMap version 31 2024-09-17T01:35:50.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.951+0000 7f484f8a4740 10 client.6024 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:35:50.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.951+0000 7f484f8a4740 20 client.6024 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:50.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.951+0000 7f484f8a4740 1 --2- 172.21.15.42:0/845811654 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x562cd7558080 0x562cd79698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.951+0000 7f484f8a4740 4 client.6024 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:50.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.951+0000 7f484f8a4740 1 -- 172.21.15.42:0/845811654 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cd78b5690 con 0x562cd7558080 2024-09-17T01:35:50.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.951+0000 7f4845e00640 1 --2- 172.21.15.42:0/845811654 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x562cd7558080 0x562cd79698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.951+0000 7f4845e00640 1 --2- 172.21.15.42:0/845811654 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x562cd7558080 0x562cd79698b0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6904799fa5897a92 server_cookie=3744a0fa983773e6 in_seq=0 out_seq=0 2024-09-17T01:35:50.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.951+0000 7f4822a00640 10 client.6024 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:50.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.952+0000 7f4822a00640 1 -- 172.21.15.42:0/845811654 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562cd78b5690 con 0x562cd7558080 2024-09-17T01:35:50.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.952+0000 7f4822a00640 10 client.6024 handle_command_reply: tid=0 2024-09-17T01:35:50.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.952+0000 7f484f8a4740 1 client.6024 shutdown 2024-09-17T01:35:50.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.952+0000 7f484f8a4740 1 -- 172.21.15.42:0/845811654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75785c0 msgr2=0x562cd79872a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:50.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.952+0000 7f484f8a4740 1 --2- 172.21.15.42:0/845811654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75785c0 0x562cd79872a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4830099c90 tx=0x7f4830062960 comp rx=0 tx=0).stop 2024-09-17T01:35:50.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.953+0000 7f484f8a4740 1 -- 172.21.15.42:0/845811654 shutdown_connections 2024-09-17T01:35:50.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.953+0000 7f484f8a4740 1 --2- 172.21.15.42:0/845811654 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x562cd7558080 0x562cd79698b0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.953+0000 7f484f8a4740 1 --2- 172.21.15.42:0/845811654 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562cd75992a0 0x562cd79877e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.953+0000 7f484f8a4740 1 --2- 172.21.15.42:0/845811654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75785c0 0x562cd79872a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.953+0000 7f484f8a4740 1 --2- 172.21.15.42:0/845811654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd75703e0 0x562cd797a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.953+0000 7f4822a00640 0 client.6024 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:50.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.953+0000 7f484f8a4740 1 -- 172.21.15.42:0/845811654 >> 172.21.15.42:0/845811654 conn(0x562cd758d3f0 msgr2=0x562cd7984ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:50.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.953+0000 7f484f8a4740 1 -- 172.21.15.42:0/845811654 shutdown_connections 2024-09-17T01:35:50.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.953+0000 7f484f8a4740 1 -- 172.21.15.42:0/845811654 wait complete. 2024-09-17T01:35:50.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.953+0000 7f484f8a4740 20 client.6024 trim_cache size 0 max 16384 2024-09-17T01:35:50.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.967+0000 7f484f8a4740 1 Processor -- start 2024-09-17T01:35:50.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.967+0000 7f484f8a4740 1 -- start start 2024-09-17T01:35:50.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.969+0000 7f484f8a4740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562cd75703e0 0x562cd7974dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.969+0000 7f484f8a4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75785c0 0x562cd7975310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.969+0000 7f484f8a4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd75992a0 0x562cd79a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.969+0000 7f484f8a4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f48402024a0 con 0x562cd75785c0 2024-09-17T01:35:50.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.969+0000 7f484f8a4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4840201480 con 0x562cd75992a0 2024-09-17T01:35:50.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.969+0000 7f484f8a4740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f484006f090 con 0x562cd75703e0 2024-09-17T01:35:50.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.969+0000 7f4845400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75785c0 0x562cd7975310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.969+0000 7f4845400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75785c0 0x562cd7975310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34688/0 (socket says 172.21.15.42:34688) 2024-09-17T01:35:50.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.969+0000 7f4845400640 1 -- 172.21.15.42:0/2298168282 learned_addr learned my addr 172.21.15.42:0/2298168282 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:50.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.969+0000 7f4845e00640 1 --2- 172.21.15.42:0/2298168282 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562cd75703e0 0x562cd7974dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.969+0000 7f4846800640 1 --2- 172.21.15.42:0/2298168282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd75992a0 0x562cd79a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.969+0000 7f4845400640 1 -- 172.21.15.42:0/2298168282 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562cd75703e0 msgr2=0x562cd7974dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:50.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.969+0000 7f4845400640 1 --2- 172.21.15.42:0/2298168282 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562cd75703e0 0x562cd7974dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.969+0000 7f4845400640 1 -- 172.21.15.42:0/2298168282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd75992a0 msgr2=0x562cd79a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:50.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.969+0000 7f4845400640 1 --2- 172.21.15.42:0/2298168282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd75992a0 0x562cd79a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.969+0000 7f4845400640 1 -- 172.21.15.42:0/2298168282 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cd7980510 con 0x562cd75785c0 2024-09-17T01:35:50.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.970+0000 7f4845400640 1 --2- 172.21.15.42:0/2298168282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75785c0 0x562cd7975310 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f4830062c60 tx=0x7f4830062fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf012e3b710813e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:50.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.970+0000 7f482dc00640 1 -- 172.21.15.42:0/2298168282 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483005fb20 con 0x562cd75785c0 2024-09-17T01:35:50.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.970+0000 7f482dc00640 1 -- 172.21.15.42:0/2298168282 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4830082070 con 0x562cd75785c0 2024-09-17T01:35:50.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.970+0000 7f482dc00640 1 -- 172.21.15.42:0/2298168282 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483006cef0 con 0x562cd75785c0 2024-09-17T01:35:50.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.971+0000 7f484f8a4740 1 -- 172.21.15.42:0/2298168282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75785c0 msgr2=0x562cd7975310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:50.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.971+0000 7f484f8a4740 1 --2- 172.21.15.42:0/2298168282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75785c0 0x562cd7975310 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f4830062c60 tx=0x7f4830062fe0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.971+0000 7f484f8a4740 1 -- 172.21.15.42:0/2298168282 shutdown_connections 2024-09-17T01:35:50.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.971+0000 7f484f8a4740 1 --2- 172.21.15.42:0/2298168282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd75992a0 0x562cd79a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.971+0000 7f484f8a4740 1 --2- 172.21.15.42:0/2298168282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75785c0 0x562cd7975310 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.971+0000 7f484f8a4740 1 --2- 172.21.15.42:0/2298168282 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562cd75703e0 0x562cd7974dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.971+0000 7f484f8a4740 1 -- 172.21.15.42:0/2298168282 >> 172.21.15.42:0/2298168282 conn(0x562cd758d3f0 msgr2=0x562cd793aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:50.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.971+0000 7f484f8a4740 1 -- 172.21.15.42:0/2298168282 shutdown_connections 2024-09-17T01:35:50.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.971+0000 7f484f8a4740 1 -- 172.21.15.42:0/2298168282 wait complete. 2024-09-17T01:35:50.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.972+0000 7f484f8a4740 1 -- start start 2024-09-17T01:35:50.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.972+0000 7f484f8a4740 1 Processor -- start 2024-09-17T01:35:50.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.973+0000 7f484f8a4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd75703e0 0x562cd79fe420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.973+0000 7f484f8a4740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562cd75785c0 0x562cd793e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.973+0000 7f484f8a4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75992a0 0x562cd7974dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.973+0000 7f484f8a4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562cd797b7f0 con 0x562cd75992a0 2024-09-17T01:35:50.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.973+0000 7f484f8a4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4840200df0 con 0x562cd75703e0 2024-09-17T01:35:50.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.973+0000 7f484f8a4740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x562cd79802c0 con 0x562cd75785c0 2024-09-17T01:35:50.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.973+0000 7f484f8a4740 10 client.0 _ll_register_callbacks cb 0x7f4830063350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:50.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.974+0000 7f4846800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75992a0 0x562cd7974dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.974+0000 7f4846800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75992a0 0x562cd7974dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34696/0 (socket says 172.21.15.42:34696) 2024-09-17T01:35:50.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.974+0000 7f4846800640 1 -- 172.21.15.42:0/4058268916 learned_addr learned my addr 172.21.15.42:0/4058268916 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:50.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.974+0000 7f4845400640 1 --2- 172.21.15.42:0/4058268916 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562cd75785c0 0x562cd793e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.974+0000 7f4846800640 1 -- 172.21.15.42:0/4058268916 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562cd75785c0 msgr2=0x562cd793e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:50.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.974+0000 7f4845e00640 1 --2- 172.21.15.42:0/4058268916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd75703e0 0x562cd79fe420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.974+0000 7f4846800640 1 --2- 172.21.15.42:0/4058268916 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562cd75785c0 0x562cd793e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.974+0000 7f4846800640 1 -- 172.21.15.42:0/4058268916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd75703e0 msgr2=0x562cd79fe420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:50.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.974+0000 7f4846800640 1 --2- 172.21.15.42:0/4058268916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd75703e0 0x562cd79fe420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.974+0000 7f4846800640 1 -- 172.21.15.42:0/4058268916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cd7a04870 con 0x562cd75992a0 2024-09-17T01:35:50.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.974+0000 7f4845400640 1 --2- 172.21.15.42:0/4058268916 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562cd75785c0 0x562cd793e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:50.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.974+0000 7f4845e00640 1 --2- 172.21.15.42:0/4058268916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd75703e0 0x562cd79fe420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:50.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.974+0000 7f4846800640 1 --2- 172.21.15.42:0/4058268916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75992a0 0x562cd7974dd0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f483c009d90 tx=0x7f483c02fb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e35ebd2534342fd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:50.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.974+0000 7f4822a00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:50.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.975+0000 7f4822a00640 1 -- 172.21.15.42:0/4058268916 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483c033050 con 0x562cd75992a0 2024-09-17T01:35:50.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.975+0000 7f484f8a4740 1 -- 172.21.15.42:0/4058268916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4830082070 con 0x562cd75992a0 2024-09-17T01:35:50.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.975+0000 7f4822a00640 1 -- 172.21.15.42:0/4058268916 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 5854+0+0 (secure 0 0 0) 0x7f483c004240 con 0x562cd75992a0 2024-09-17T01:35:50.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.975+0000 7f4822a00640 1 -- 172.21.15.42:0/4058268916 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f483c04f050 con 0x562cd75992a0 2024-09-17T01:35:50.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.975+0000 7f484f8a4740 10 client.6030 fetch_fsmap learned FSMap version 31 2024-09-17T01:35:50.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.975+0000 7f484f8a4740 1 -- 172.21.15.42:0/4058268916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x562cd79a7280 con 0x562cd75992a0 2024-09-17T01:35:50.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.975+0000 7f4822a00640 1 -- 172.21.15.42:0/4058268916 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4830082070 con 0x562cd75992a0 2024-09-17T01:35:50.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.975+0000 7f4822a00640 1 -- 172.21.15.42:0/4058268916 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 3502+0+0 (secure 0 0 0) 0x7f483c052020 con 0x562cd75992a0 2024-09-17T01:35:50.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.975+0000 7f484f8a4740 10 client.6030 fetch_fsmap finished waiting for FSMap version 31 2024-09-17T01:35:50.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.975+0000 7f484f8a4740 10 client.6030 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:35:50.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.975+0000 7f484f8a4740 20 client.6030 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:50.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.975+0000 7f484f8a4740 1 --2- 172.21.15.42:0/4058268916 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x562cd797a530 0x562cd797a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:50.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.975+0000 7f484f8a4740 4 client.6030 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 3202077941}] 2024-09-17T01:35:50.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.975+0000 7f484f8a4740 1 -- 172.21.15.42:0/4058268916 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "damage rm", "damage_id": 3202077941}) -- 0x562cd78b1140 con 0x562cd797a530 2024-09-17T01:35:50.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.976+0000 7f4845e00640 1 --2- 172.21.15.42:0/4058268916 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x562cd797a530 0x562cd797a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:50.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.976+0000 7f4845e00640 1 --2- 172.21.15.42:0/4058268916 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x562cd797a530 0x562cd797a940 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f2dbd254b043528 server_cookie=82e0b6a8526f165a in_seq=0 out_seq=0 2024-09-17T01:35:50.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.976+0000 7f4822a00640 10 client.6030 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:50.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.977+0000 7f4822a00640 1 -- 172.21.15.42:0/4058268916 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x562cd78b1140 con 0x562cd797a530 2024-09-17T01:35:50.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.977+0000 7f4822a00640 10 client.6030 handle_command_reply: tid=0 2024-09-17T01:35:50.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.977+0000 7f484f8a4740 1 client.6030 shutdown 2024-09-17T01:35:50.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.977+0000 7f484f8a4740 1 -- 172.21.15.42:0/4058268916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75992a0 msgr2=0x562cd7974dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:50.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.977+0000 7f484f8a4740 1 --2- 172.21.15.42:0/4058268916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75992a0 0x562cd7974dd0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f483c009d90 tx=0x7f483c02fb90 comp rx=0 tx=0).stop 2024-09-17T01:35:50.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.977+0000 7f484f8a4740 1 -- 172.21.15.42:0/4058268916 shutdown_connections 2024-09-17T01:35:50.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.977+0000 7f484f8a4740 1 --2- 172.21.15.42:0/4058268916 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x562cd797a530 0x562cd797a940 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.977+0000 7f484f8a4740 1 --2- 172.21.15.42:0/4058268916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cd75992a0 0x562cd7974dd0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.977+0000 7f484f8a4740 1 --2- 172.21.15.42:0/4058268916 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562cd75785c0 0x562cd793e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.977+0000 7f4822a00640 0 client.6030 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:50.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.977+0000 7f484f8a4740 1 --2- 172.21.15.42:0/4058268916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562cd75703e0 0x562cd79fe420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.977+0000 7f484f8a4740 1 -- 172.21.15.42:0/4058268916 >> 172.21.15.42:0/4058268916 conn(0x562cd758d3f0 msgr2=0x562cd7957790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:50.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.977+0000 7f484f8a4740 1 -- 172.21.15.42:0/4058268916 shutdown_connections 2024-09-17T01:35:50.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.977+0000 7f484f8a4740 1 -- 172.21.15.42:0/4058268916 wait complete. 2024-09-17T01:35:50.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.977+0000 7f484f8a4740 20 client.6030 trim_cache size 0 max 16384 2024-09-17T01:35:50.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.978+0000 7f4848800640 1 -- 172.21.15.42:0/4087914045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4824078b90 msgr2=0x7f482407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:50.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.978+0000 7f4848800640 1 --2- 172.21.15.42:0/4087914045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4824078b90 0x7f482407b0a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4834007fd0 tx=0x7f4834009040 comp rx=0 tx=0).stop 2024-09-17T01:35:50.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.978+0000 7f4848800640 1 -- 172.21.15.42:0/4087914045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48400b3550 msgr2=0x7f48400b1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:50.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.978+0000 7f4848800640 1 --2- 172.21.15.42:0/4087914045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48400b3550 0x7f48400b1b20 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f483000e790 tx=0x7f483000ec50 comp rx=0 tx=0).stop 2024-09-17T01:35:50.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.978+0000 7f4848800640 1 -- 172.21.15.42:0/4087914045 shutdown_connections 2024-09-17T01:35:50.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.978+0000 7f4848800640 1 --2- 172.21.15.42:0/4087914045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4824078b90 0x7f482407b0a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.978+0000 7f4848800640 1 --2- 172.21.15.42:0/4087914045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4840142f40 0x7f48401f5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.978+0000 7f4848800640 1 --2- 172.21.15.42:0/4087914045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48400b3550 0x7f48400b1b20 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.978+0000 7f4848800640 1 --2- 172.21.15.42:0/4087914045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4840072e90 0x7f48400b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:50.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.978+0000 7f4848800640 1 -- 172.21.15.42:0/4087914045 >> 172.21.15.42:0/4087914045 conn(0x7f48400b2930 msgr2=0x7f4840073680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:50.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.978+0000 7f4848800640 1 -- 172.21.15.42:0/4087914045 shutdown_connections 2024-09-17T01:35:50.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:50.978+0000 7f4848800640 1 -- 172.21.15.42:0/4087914045 wait complete. 2024-09-17T01:35:50.997 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-17T01:35:50.997 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-17T01:35:51.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.229+0000 7f2571c00640 1 -- 172.21.15.42:0/1954979818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2550004800 msgr2=0x7f2550004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:51.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.229+0000 7f2571c00640 1 --2- 172.21.15.42:0/1954979818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2550004800 0x7f2550004c10 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2554009b50 tx=0x7f2550005830 comp rx=0 tx=0).stop 2024-09-17T01:35:51.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.229+0000 7f256b400640 1 -- 172.21.15.42:0/1954979818 reap_dead start 2024-09-17T01:35:51.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.229+0000 7f2571c00640 1 -- 172.21.15.42:0/1954979818 shutdown_connections 2024-09-17T01:35:51.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.229+0000 7f2571c00640 1 -- 172.21.15.42:0/1954979818 >> 172.21.15.42:0/1954979818 conn(0x7f256c0746c0 msgr2=0x7f256c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:51.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.230+0000 7f2571c00640 1 -- 172.21.15.42:0/1954979818 shutdown_connections 2024-09-17T01:35:51.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.230+0000 7f2571c00640 1 -- 172.21.15.42:0/1954979818 wait complete. 2024-09-17T01:35:51.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.232+0000 7f2571c00640 1 Processor -- start 2024-09-17T01:35:51.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.232+0000 7f2571c00640 1 -- start start 2024-09-17T01:35:51.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.234+0000 7f2571c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2550004800 0x7f256c1516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:51.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.234+0000 7f2571c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f256c0ae3c0 0x7f256c1f9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:51.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.234+0000 7f2571c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f256c147b00 0x7f256c147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:51.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.234+0000 7f2571c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f256c0b53f0 con 0x7f2550004800 2024-09-17T01:35:51.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.234+0000 7f2571c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f256c0b5270 con 0x7f256c147b00 2024-09-17T01:35:51.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.234+0000 7f2571c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f256c0b5be0 con 0x7f256c0ae3c0 2024-09-17T01:35:51.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.234+0000 7f256aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2550004800 0x7f256c1516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:51.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.234+0000 7f256aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2550004800 0x7f256c1516a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34712/0 (socket says 172.21.15.42:34712) 2024-09-17T01:35:51.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.234+0000 7f256aa00640 1 -- 172.21.15.42:0/1998443113 learned_addr learned my addr 172.21.15.42:0/1998443113 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:51.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.234+0000 7f2563e00640 1 --2- 172.21.15.42:0/1998443113 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f256c0ae3c0 0x7f256c1f9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:51.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.234+0000 7f256b400640 1 --2- 172.21.15.42:0/1998443113 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f256c147b00 0x7f256c147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:51.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.234+0000 7f256aa00640 1 -- 172.21.15.42:0/1998443113 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f256c0ae3c0 msgr2=0x7f256c1f9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:51.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.234+0000 7f256aa00640 1 --2- 172.21.15.42:0/1998443113 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f256c0ae3c0 0x7f256c1f9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.234+0000 7f256aa00640 1 -- 172.21.15.42:0/1998443113 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f256c147b00 msgr2=0x7f256c147f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:51.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.234+0000 7f256aa00640 1 --2- 172.21.15.42:0/1998443113 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f256c147b00 0x7f256c147f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.234+0000 7f256aa00640 1 -- 172.21.15.42:0/1998443113 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256c148450 con 0x7f2550004800 2024-09-17T01:35:51.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.234+0000 7f256b400640 1 --2- 172.21.15.42:0/1998443113 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f256c147b00 0x7f256c147f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:51.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.235+0000 7f256aa00640 1 --2- 172.21.15.42:0/1998443113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2550004800 0x7f256c1516a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f255c006680 tx=0x7f255c0066b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:51.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.235+0000 7f2562a00640 1 -- 172.21.15.42:0/1998443113 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c015070 con 0x7f2550004800 2024-09-17T01:35:51.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.235+0000 7f2562a00640 1 -- 172.21.15.42:0/1998443113 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f255c011920 con 0x7f2550004800 2024-09-17T01:35:51.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.235+0000 7f2571c00640 1 -- 172.21.15.42:0/1998443113 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f256c145cc0 con 0x7f2550004800 2024-09-17T01:35:51.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.235+0000 7f2562a00640 1 -- 172.21.15.42:0/1998443113 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c011d70 con 0x7f2550004800 2024-09-17T01:35:51.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.235+0000 7f2571c00640 1 -- 172.21.15.42:0/1998443113 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f256c146280 con 0x7f2550004800 2024-09-17T01:35:51.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.239+0000 7f2562a00640 1 -- 172.21.15.42:0/1998443113 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f255c018070 con 0x7f2550004800 2024-09-17T01:35:51.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.239+0000 7f2562a00640 1 --2- 172.21.15.42:0/1998443113 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2548078b90 0x7f254807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:51.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.240+0000 7f2562a00640 1 -- 172.21.15.42:0/1998443113 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5854+0+0 (secure 0 0 0) 0x7f255c09baf0 con 0x7f2550004800 2024-09-17T01:35:51.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.240+0000 7f2578c03740 1 Processor -- start 2024-09-17T01:35:51.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.240+0000 7f2578c03740 1 -- start start 2024-09-17T01:35:51.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.240+0000 7f2563e00640 1 --2- 172.21.15.42:0/1998443113 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2548078b90 0x7f254807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:51.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.241+0000 7f2563e00640 1 --2- 172.21.15.42:0/1998443113 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2548078b90 0x7f254807b0a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2554035000 tx=0x7f255402d040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:51.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.241+0000 7f2578c03740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557089821e0 0x555708d52a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:51.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.241+0000 7f2578c03740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555708959320 0x555708d52f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:51.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.241+0000 7f2578c03740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708961500 0x555708d23030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:51.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.241+0000 7f2578c03740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555708cac500 con 0x555708961500 2024-09-17T01:35:51.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.241+0000 7f2578c03740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555708c9c6a0 con 0x5557089821e0 2024-09-17T01:35:51.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.241+0000 7f2578c03740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x555708c8bad0 con 0x555708959320 2024-09-17T01:35:51.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.242+0000 7f256b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708961500 0x555708d23030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:51.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.242+0000 7f256aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557089821e0 0x555708d52a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:51.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.242+0000 7f256aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557089821e0 0x555708d52a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:51714/0 (socket says 172.21.15.42:51714) 2024-09-17T01:35:51.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.242+0000 7f256aa00640 1 -- 172.21.15.42:0/3235273449 learned_addr learned my addr 172.21.15.42:0/3235273449 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:51.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.242+0000 7f2563e00640 1 --2- 172.21.15.42:0/3235273449 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555708959320 0x555708d52f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:51.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.242+0000 7f256aa00640 1 -- 172.21.15.42:0/3235273449 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555708959320 msgr2=0x555708d52f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:51.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.242+0000 7f256aa00640 1 --2- 172.21.15.42:0/3235273449 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555708959320 0x555708d52f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.242+0000 7f256aa00640 1 -- 172.21.15.42:0/3235273449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708961500 msgr2=0x555708d23030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:51.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.242+0000 7f256aa00640 1 --2- 172.21.15.42:0/3235273449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708961500 0x555708d23030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.242+0000 7f256aa00640 1 -- 172.21.15.42:0/3235273449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555708c545f0 con 0x5557089821e0 2024-09-17T01:35:51.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.242+0000 7f256b400640 1 --2- 172.21.15.42:0/3235273449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708961500 0x555708d23030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:35:51.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.242+0000 7f256aa00640 1 --2- 172.21.15.42:0/3235273449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557089821e0 0x555708d52a40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f255c063030 tx=0x7f255c063350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2da9b1f7091f8889 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:51.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.243+0000 7f255b400640 1 -- 172.21.15.42:0/3235273449 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c01f040 con 0x5557089821e0 2024-09-17T01:35:51.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.243+0000 7f255b400640 1 -- 172.21.15.42:0/3235273449 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f255c04c070 con 0x5557089821e0 2024-09-17T01:35:51.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.243+0000 7f255b400640 1 -- 172.21.15.42:0/3235273449 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c06ced0 con 0x5557089821e0 2024-09-17T01:35:51.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.243+0000 7f2578c03740 1 -- 172.21.15.42:0/3235273449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557089821e0 msgr2=0x555708d52a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:51.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.243+0000 7f2578c03740 1 --2- 172.21.15.42:0/3235273449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557089821e0 0x555708d52a40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f255c063030 tx=0x7f255c063350 comp rx=0 tx=0).stop 2024-09-17T01:35:51.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.244+0000 7f2578c03740 1 -- 172.21.15.42:0/3235273449 shutdown_connections 2024-09-17T01:35:51.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.244+0000 7f2578c03740 1 --2- 172.21.15.42:0/3235273449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708961500 0x555708d23030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.244+0000 7f2578c03740 1 --2- 172.21.15.42:0/3235273449 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555708959320 0x555708d52f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.244+0000 7f2578c03740 1 --2- 172.21.15.42:0/3235273449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557089821e0 0x555708d52a40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.244+0000 7f2578c03740 1 -- 172.21.15.42:0/3235273449 >> 172.21.15.42:0/3235273449 conn(0x555708976330 msgr2=0x555708d28a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:51.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.244+0000 7f2578c03740 1 -- 172.21.15.42:0/3235273449 shutdown_connections 2024-09-17T01:35:51.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.244+0000 7f2578c03740 1 -- 172.21.15.42:0/3235273449 wait complete. 2024-09-17T01:35:51.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.245+0000 7f2578c03740 1 -- start start 2024-09-17T01:35:51.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.245+0000 7f2578c03740 1 Processor -- start 2024-09-17T01:35:51.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.246+0000 7f2578c03740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708959320 0x555708d48e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:51.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.246+0000 7f2578c03740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555708961500 0x555708d671f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:51.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.246+0000 7f2578c03740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557089821e0 0x555708d67730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:51.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.246+0000 7f2578c03740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555708c32400 con 0x555708959320 2024-09-17T01:35:51.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.246+0000 7f2578c03740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555708c8f8e0 con 0x5557089821e0 2024-09-17T01:35:51.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.246+0000 7f2578c03740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5557089fc590 con 0x555708961500 2024-09-17T01:35:51.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.247+0000 7f2578c03740 10 client.0 _ll_register_callbacks cb 0x555708c374f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:51.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.247+0000 7f256aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708959320 0x555708d48e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:51.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.247+0000 7f256aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708959320 0x555708d48e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34728/0 (socket says 172.21.15.42:34728) 2024-09-17T01:35:51.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.247+0000 7f256aa00640 1 -- 172.21.15.42:0/1714250540 learned_addr learned my addr 172.21.15.42:0/1714250540 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:51.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.247+0000 7f256b400640 1 --2- 172.21.15.42:0/1714250540 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557089821e0 0x555708d67730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:51.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.247+0000 7f2563e00640 1 --2- 172.21.15.42:0/1714250540 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555708961500 0x555708d671f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:51.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.247+0000 7f256aa00640 1 -- 172.21.15.42:0/1714250540 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555708961500 msgr2=0x555708d671f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:51.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.247+0000 7f256aa00640 1 --2- 172.21.15.42:0/1714250540 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555708961500 0x555708d671f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.247+0000 7f256aa00640 1 -- 172.21.15.42:0/1714250540 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557089821e0 msgr2=0x555708d67730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:51.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.247+0000 7f256aa00640 1 --2- 172.21.15.42:0/1714250540 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557089821e0 0x555708d67730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.247+0000 7f256aa00640 1 -- 172.21.15.42:0/1714250540 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557089ed7c0 con 0x555708959320 2024-09-17T01:35:51.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.247+0000 7f256aa00640 1 --2- 172.21.15.42:0/1714250540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708959320 0x555708d48e90 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f255c060ab0 tx=0x7f255c062cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1426819b879e6e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:51.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.248+0000 7f254fe00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:51.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.248+0000 7f254fe00640 1 -- 172.21.15.42:0/1714250540 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c01f040 con 0x555708959320 2024-09-17T01:35:51.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.248+0000 7f254fe00640 1 -- 172.21.15.42:0/1714250540 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 5854+0+0 (secure 0 0 0) 0x7f255c05f3a0 con 0x555708959320 2024-09-17T01:35:51.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.248+0000 7f2578c03740 1 -- 172.21.15.42:0/1714250540 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f255c04c070 con 0x555708959320 2024-09-17T01:35:51.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.248+0000 7f254fe00640 1 -- 172.21.15.42:0/1714250540 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f255c068270 con 0x555708959320 2024-09-17T01:35:51.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.248+0000 7f2578c03740 10 client.6042 fetch_fsmap learned FSMap version 31 2024-09-17T01:35:51.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.248+0000 7f2578c03740 1 -- 172.21.15.42:0/1714250540 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x555708a64620 con 0x555708959320 2024-09-17T01:35:51.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.248+0000 7f254fe00640 1 -- 172.21.15.42:0/1714250540 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f255c04c070 con 0x555708959320 2024-09-17T01:35:51.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.248+0000 7f254fe00640 1 -- 172.21.15.42:0/1714250540 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 3502+0+0 (secure 0 0 0) 0x7f255c064ac0 con 0x555708959320 2024-09-17T01:35:51.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.248+0000 7f2578c03740 10 client.6042 fetch_fsmap finished waiting for FSMap version 31 2024-09-17T01:35:51.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.248+0000 7f2578c03740 10 client.6042 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:51.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.248+0000 7f2578c03740 20 client.6042 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:51.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.248+0000 7f2578c03740 1 --2- 172.21.15.42:0/1714250540 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x555708940fc0 0x555708d4c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:51.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.248+0000 7f2578c03740 4 client.6042 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:35:51.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.248+0000 7f2578c03740 1 -- 172.21.15.42:0/1714250540 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555708c9e5f0 con 0x555708940fc0 2024-09-17T01:35:51.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.249+0000 7f2563e00640 1 --2- 172.21.15.42:0/1714250540 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x555708940fc0 0x555708d4c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:51.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.249+0000 7f2563e00640 1 --2- 172.21.15.42:0/1714250540 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x555708940fc0 0x555708d4c250 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebfb2c09be275b70 server_cookie=b2b2e85cb4a144ba in_seq=0 out_seq=0 2024-09-17T01:35:51.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.249+0000 7f254fe00640 10 client.6042 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:51.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.250+0000 7f254fe00640 1 -- 172.21.15.42:0/1714250540 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555708c9e5f0 con 0x555708940fc0 2024-09-17T01:35:51.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.250+0000 7f254fe00640 10 client.6042 handle_command_reply: tid=0 2024-09-17T01:35:51.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.250+0000 7f2578c03740 1 client.6042 shutdown 2024-09-17T01:35:51.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.250+0000 7f2578c03740 1 -- 172.21.15.42:0/1714250540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708959320 msgr2=0x555708d48e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:51.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.250+0000 7f2578c03740 1 --2- 172.21.15.42:0/1714250540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708959320 0x555708d48e90 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f255c060ab0 tx=0x7f255c062cd0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.250+0000 7f2578c03740 1 -- 172.21.15.42:0/1714250540 shutdown_connections 2024-09-17T01:35:51.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.250+0000 7f2578c03740 1 --2- 172.21.15.42:0/1714250540 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x555708940fc0 0x555708d4c250 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.250+0000 7f2578c03740 1 --2- 172.21.15.42:0/1714250540 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557089821e0 0x555708d67730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.250+0000 7f2578c03740 1 --2- 172.21.15.42:0/1714250540 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555708961500 0x555708d671f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.250+0000 7f2578c03740 1 --2- 172.21.15.42:0/1714250540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708959320 0x555708d48e90 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.250+0000 7f254fe00640 0 client.6042 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:51.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.250+0000 7f2578c03740 1 -- 172.21.15.42:0/1714250540 >> 172.21.15.42:0/1714250540 conn(0x555708976330 msgr2=0x555708d70dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:51.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.251+0000 7f2578c03740 1 -- 172.21.15.42:0/1714250540 shutdown_connections 2024-09-17T01:35:51.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.251+0000 7f2578c03740 1 -- 172.21.15.42:0/1714250540 wait complete. 2024-09-17T01:35:51.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.251+0000 7f2578c03740 20 client.6042 trim_cache size 0 max 16384 2024-09-17T01:35:51.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.267+0000 7f2578c03740 1 Processor -- start 2024-09-17T01:35:51.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.267+0000 7f2578c03740 1 -- start start 2024-09-17T01:35:51.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.268+0000 7f2578c03740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708976330 0x555708d671a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:51.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.268+0000 7f2578c03740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555708959320 0x555708d71490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:51.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.268+0000 7f2578c03740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555708961500 0x555708de37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:51.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.268+0000 7f2578c03740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555708d708e0 con 0x555708976330 2024-09-17T01:35:51.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.268+0000 7f2578c03740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f256c206e60 con 0x555708959320 2024-09-17T01:35:51.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.268+0000 7f2578c03740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f256c205e80 con 0x555708961500 2024-09-17T01:35:51.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.268+0000 7f256aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708976330 0x555708d671a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:51.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.268+0000 7f256aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708976330 0x555708d671a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34740/0 (socket says 172.21.15.42:34740) 2024-09-17T01:35:51.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.268+0000 7f256aa00640 1 -- 172.21.15.42:0/2289384563 learned_addr learned my addr 172.21.15.42:0/2289384563 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:51.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.268+0000 7f2563e00640 1 --2- 172.21.15.42:0/2289384563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555708959320 0x555708d71490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:51.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.268+0000 7f256b400640 1 --2- 172.21.15.42:0/2289384563 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555708961500 0x555708de37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:51.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.269+0000 7f256aa00640 1 -- 172.21.15.42:0/2289384563 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555708961500 msgr2=0x555708de37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:51.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.269+0000 7f256aa00640 1 --2- 172.21.15.42:0/2289384563 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555708961500 0x555708de37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.269+0000 7f256aa00640 1 -- 172.21.15.42:0/2289384563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555708959320 msgr2=0x555708d71490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:51.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.269+0000 7f256aa00640 1 --2- 172.21.15.42:0/2289384563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555708959320 0x555708d71490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.269+0000 7f256aa00640 1 -- 172.21.15.42:0/2289384563 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555708d6de70 con 0x555708976330 2024-09-17T01:35:51.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.269+0000 7f256aa00640 1 --2- 172.21.15.42:0/2289384563 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708976330 0x555708d671a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f255c063540 tx=0x7f255c063350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0b7ae4e7371ec0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:51.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.269+0000 7f255aa00640 1 -- 172.21.15.42:0/2289384563 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c074070 con 0x555708976330 2024-09-17T01:35:51.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.269+0000 7f255aa00640 1 -- 172.21.15.42:0/2289384563 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f255c04c070 con 0x555708976330 2024-09-17T01:35:51.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.269+0000 7f255aa00640 1 -- 172.21.15.42:0/2289384563 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c01f050 con 0x555708976330 2024-09-17T01:35:51.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.270+0000 7f2578c03740 1 -- 172.21.15.42:0/2289384563 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708976330 msgr2=0x555708d671a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:51.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.270+0000 7f2578c03740 1 --2- 172.21.15.42:0/2289384563 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708976330 0x555708d671a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f255c063540 tx=0x7f255c063350 comp rx=0 tx=0).stop 2024-09-17T01:35:51.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.270+0000 7f2578c03740 1 -- 172.21.15.42:0/2289384563 shutdown_connections 2024-09-17T01:35:51.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.270+0000 7f2578c03740 1 --2- 172.21.15.42:0/2289384563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555708959320 0x555708d71490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.270+0000 7f2578c03740 1 --2- 172.21.15.42:0/2289384563 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555708961500 0x555708de37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.270+0000 7f2578c03740 1 --2- 172.21.15.42:0/2289384563 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708976330 0x555708d671a0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.270+0000 7f2578c03740 1 -- 172.21.15.42:0/2289384563 >> 172.21.15.42:0/2289384563 conn(0x555708d66a00 msgr2=0x555708d524f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:51.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.270+0000 7f2578c03740 1 -- 172.21.15.42:0/2289384563 shutdown_connections 2024-09-17T01:35:51.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.270+0000 7f2578c03740 1 -- 172.21.15.42:0/2289384563 wait complete. 2024-09-17T01:35:51.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.271+0000 7f2578c03740 1 -- start start 2024-09-17T01:35:51.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.271+0000 7f2578c03740 1 Processor -- start 2024-09-17T01:35:51.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.273+0000 7f2578c03740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555708959320 0x555708dca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:51.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.273+0000 7f2578c03740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555708961500 0x555708de2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:51.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.273+0000 7f2578c03740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708976330 0x555708d7bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:51.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.273+0000 7f2578c03740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f256c205830 con 0x555708976330 2024-09-17T01:35:51.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.273+0000 7f2578c03740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f256c14f9d0 con 0x555708961500 2024-09-17T01:35:51.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.273+0000 7f2578c03740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x555708d90b50 con 0x555708959320 2024-09-17T01:35:51.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.273+0000 7f2578c03740 10 client.0 _ll_register_callbacks cb 0x7f255c063220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:35:51.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.273+0000 7f256b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708976330 0x555708d7bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:51.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.273+0000 7f256b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708976330 0x555708d7bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34754/0 (socket says 172.21.15.42:34754) 2024-09-17T01:35:51.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.273+0000 7f256b400640 1 -- 172.21.15.42:0/187119655 learned_addr learned my addr 172.21.15.42:0/187119655 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:51.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.273+0000 7f256aa00640 1 --2- 172.21.15.42:0/187119655 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555708959320 0x555708dca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:51.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.273+0000 7f2563e00640 1 --2- 172.21.15.42:0/187119655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555708961500 0x555708de2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:51.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.274+0000 7f256b400640 1 -- 172.21.15.42:0/187119655 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555708959320 msgr2=0x555708dca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:51.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.274+0000 7f256b400640 1 --2- 172.21.15.42:0/187119655 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555708959320 0x555708dca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.274+0000 7f256b400640 1 -- 172.21.15.42:0/187119655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555708961500 msgr2=0x555708de2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:35:51.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.274+0000 7f256b400640 1 --2- 172.21.15.42:0/187119655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555708961500 0x555708de2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.274+0000 7f256b400640 1 -- 172.21.15.42:0/187119655 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555708dcae20 con 0x555708976330 2024-09-17T01:35:51.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.274+0000 7f256b400640 1 --2- 172.21.15.42:0/187119655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708976330 0x555708d7bda0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f256c0b0e30 tx=0x7f2564001a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef107274855a94f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:51.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.274+0000 7f254fe00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:35:51.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.274+0000 7f254fe00640 1 -- 172.21.15.42:0/187119655 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2564022060 con 0x555708976330 2024-09-17T01:35:51.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.274+0000 7f254fe00640 1 -- 172.21.15.42:0/187119655 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 5854+0+0 (secure 0 0 0) 0x7f2564013860 con 0x555708976330 2024-09-17T01:35:51.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.274+0000 7f2578c03740 1 -- 172.21.15.42:0/187119655 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f255c04c070 con 0x555708976330 2024-09-17T01:35:51.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.274+0000 7f254fe00640 1 -- 172.21.15.42:0/187119655 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2564028050 con 0x555708976330 2024-09-17T01:35:51.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.274+0000 7f2578c03740 10 client.6048 fetch_fsmap learned FSMap version 31 2024-09-17T01:35:51.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.274+0000 7f2578c03740 1 -- 172.21.15.42:0/187119655 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x555708de2fc0 con 0x555708976330 2024-09-17T01:35:51.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.275+0000 7f254fe00640 1 -- 172.21.15.42:0/187119655 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f255c04c070 con 0x555708976330 2024-09-17T01:35:51.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.275+0000 7f254fe00640 1 -- 172.21.15.42:0/187119655 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 31) ==== 3502+0+0 (secure 0 0 0) 0x7f256402b020 con 0x555708976330 2024-09-17T01:35:51.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.275+0000 7f2578c03740 10 client.6048 fetch_fsmap finished waiting for FSMap version 31 2024-09-17T01:35:51.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.275+0000 7f2578c03740 10 client.6048 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-09-17T01:35:51.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.275+0000 7f2578c03740 20 client.6048 populate_metadata read hostname 'smithi042' 2024-09-17T01:35:51.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.275+0000 7f2578c03740 1 --2- 172.21.15.42:0/187119655 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x555708916400 0x555708d7c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:51.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.275+0000 7f2578c03740 4 client.6048 mds_command: new command op to 5283 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-17T01:35:51.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.275+0000 7f2578c03740 1 -- 172.21.15.42:0/187119655 --> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x555708c9a0a0 con 0x555708916400 2024-09-17T01:35:51.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.275+0000 7f256aa00640 1 --2- 172.21.15.42:0/187119655 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x555708916400 0x555708d7c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:51.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.276+0000 7f256aa00640 1 --2- 172.21.15.42:0/187119655 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x555708916400 0x555708d7c2e0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3cdaa11177c9120 server_cookie=81c9eb2957b64586 in_seq=0 out_seq=0 2024-09-17T01:35:51.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.276+0000 7f254fe00640 10 client.6048 ms_handle_connect on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:51.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.278+0000 7f254fe00640 1 -- 172.21.15.42:0/187119655 <== mds.0 v2:172.21.15.42:6834/1094322669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555708c9a0a0 con 0x555708916400 2024-09-17T01:35:51.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.278+0000 7f254fe00640 10 client.6048 handle_command_reply: tid=0 2024-09-17T01:35:51.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.278+0000 7f2578c03740 1 client.6048 shutdown 2024-09-17T01:35:51.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.278+0000 7f2578c03740 1 -- 172.21.15.42:0/187119655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708976330 msgr2=0x555708d7bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:51.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.278+0000 7f2578c03740 1 --2- 172.21.15.42:0/187119655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708976330 0x555708d7bda0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f256c0b0e30 tx=0x7f2564001a90 comp rx=0 tx=0).stop 2024-09-17T01:35:51.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.278+0000 7f2578c03740 1 -- 172.21.15.42:0/187119655 shutdown_connections 2024-09-17T01:35:51.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.278+0000 7f2578c03740 1 --2- 172.21.15.42:0/187119655 >> [v2:172.21.15.42:6834/1094322669,v1:172.21.15.42:6835/1094322669] conn(0x555708916400 0x555708d7c2e0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.278+0000 7f2578c03740 1 --2- 172.21.15.42:0/187119655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555708961500 0x555708de2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.278+0000 7f2578c03740 1 --2- 172.21.15.42:0/187119655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555708976330 0x555708d7bda0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.278+0000 7f2578c03740 1 --2- 172.21.15.42:0/187119655 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555708959320 0x555708dca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.278+0000 7f254fe00640 0 client.6048 ms_handle_reset on v2:172.21.15.42:6834/1094322669 2024-09-17T01:35:51.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.278+0000 7f2578c03740 1 -- 172.21.15.42:0/187119655 >> 172.21.15.42:0/187119655 conn(0x555708d66a00 msgr2=0x555708d70d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:51.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.279+0000 7f2578c03740 1 -- 172.21.15.42:0/187119655 shutdown_connections 2024-09-17T01:35:51.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.279+0000 7f2578c03740 1 -- 172.21.15.42:0/187119655 wait complete. 2024-09-17T01:35:51.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.279+0000 7f2578c03740 20 client.6048 trim_cache size 0 max 16384 2024-09-17T01:35:51.278 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:35:51.278 INFO:teuthology.orchestra.run.smithi042.stdout: "message": "", 2024-09-17T01:35:51.278 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0 2024-09-17T01:35:51.278 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:35:51.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.279+0000 7f2571c00640 1 -- 172.21.15.42:0/1998443113 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2548078b90 msgr2=0x7f254807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:51.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.279+0000 7f2571c00640 1 --2- 172.21.15.42:0/1998443113 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2548078b90 0x7f254807b0a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2554035000 tx=0x7f255402d040 comp rx=0 tx=0).stop 2024-09-17T01:35:51.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.279+0000 7f2571c00640 1 -- 172.21.15.42:0/1998443113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2550004800 msgr2=0x7f256c1516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:51.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.279+0000 7f2571c00640 1 --2- 172.21.15.42:0/1998443113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2550004800 0x7f256c1516a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f255c006680 tx=0x7f255c0066b0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.279+0000 7f2571c00640 1 -- 172.21.15.42:0/1998443113 shutdown_connections 2024-09-17T01:35:51.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.279+0000 7f2571c00640 1 --2- 172.21.15.42:0/1998443113 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2548078b90 0x7f254807b0a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.279+0000 7f2571c00640 1 --2- 172.21.15.42:0/1998443113 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f256c147b00 0x7f256c147f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.279+0000 7f2571c00640 1 --2- 172.21.15.42:0/1998443113 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f256c0ae3c0 0x7f256c1f9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.279+0000 7f2571c00640 1 --2- 172.21.15.42:0/1998443113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2550004800 0x7f256c1516a0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.279+0000 7f2571c00640 1 -- 172.21.15.42:0/1998443113 >> 172.21.15.42:0/1998443113 conn(0x7f256c0746c0 msgr2=0x7f256c15de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:51.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.280+0000 7f2571c00640 1 -- 172.21.15.42:0/1998443113 shutdown_connections 2024-09-17T01:35:51.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.280+0000 7f2571c00640 1 -- 172.21.15.42:0/1998443113 wait complete. 2024-09-17T01:35:51.301 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-17T01:35:51.301 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:35:51.301 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:35:51.385 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:35:51.485 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:35:51.485 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:35:51.485 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:35:51.485 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:35:51.521 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:35:51.521 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:35:51.597 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T01:35:51.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.870+0000 7f4b2cc00640 1 -- 172.21.15.42:0/3726051240 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b2806d430 msgr2=0x7f4b28152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:51.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.870+0000 7f4b2cc00640 1 --2- 172.21.15.42:0/3726051240 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b2806d430 0x7f4b28152ed0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4b28071cb0 tx=0x7f4b2002aac0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.870+0000 7f4b2cc00640 1 -- 172.21.15.42:0/3726051240 shutdown_connections 2024-09-17T01:35:51.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.870+0000 7f4b2cc00640 1 --2- 172.21.15.42:0/3726051240 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b2806d430 0x7f4b28152ed0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.870+0000 7f4b2cc00640 1 --2- 172.21.15.42:0/3726051240 >> v2:172.21.15.43:3300/0 conn(0x7f4b280b4be0 0x7f4b2815d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.870+0000 7f4b2cc00640 1 -- 172.21.15.42:0/3726051240 >> 172.21.15.42:0/3726051240 conn(0x7f4b280b25f0 msgr2=0x7f4b280d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:51.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.870+0000 7f4b2cc00640 1 -- 172.21.15.42:0/3726051240 shutdown_connections 2024-09-17T01:35:51.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.870+0000 7f4b2cc00640 1 -- 172.21.15.42:0/3726051240 wait complete. 2024-09-17T01:35:51.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.873+0000 7f4b2cc00640 1 Processor -- start 2024-09-17T01:35:51.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.873+0000 7f4b2cc00640 1 -- start start 2024-09-17T01:35:51.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.874+0000 7f4b2cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b280b4be0 0x7f4b281f8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:51.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.874+0000 7f4b2cc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4b280cf7c0 0x7f4b281f6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:51.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.874+0000 7f4b2cc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b281519c0 0x7f4b280ad470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:51.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.874+0000 7f4b2cc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4b28153850 con 0x7f4b280b4be0 2024-09-17T01:35:51.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.874+0000 7f4b2cc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4b281536d0 con 0x7f4b281519c0 2024-09-17T01:35:51.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.874+0000 7f4b2cc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4b281539d0 con 0x7f4b280cf7c0 2024-09-17T01:35:51.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.875+0000 7f4b27400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b280b4be0 0x7f4b281f8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:51.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.875+0000 7f4b27400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b280b4be0 0x7f4b281f8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34776/0 (socket says 172.21.15.42:34776) 2024-09-17T01:35:51.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.875+0000 7f4b27400640 1 -- 172.21.15.42:0/1440017719 learned_addr learned my addr 172.21.15.42:0/1440017719 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:51.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.875+0000 7f4b27e00640 1 --2- 172.21.15.42:0/1440017719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b281519c0 0x7f4b280ad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:51.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.875+0000 7f4b1fe00640 1 --2- 172.21.15.42:0/1440017719 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4b280cf7c0 0x7f4b281f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:51.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.875+0000 7f4b27400640 1 -- 172.21.15.42:0/1440017719 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4b280cf7c0 msgr2=0x7f4b281f6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:51.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.875+0000 7f4b27400640 1 --2- 172.21.15.42:0/1440017719 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4b280cf7c0 0x7f4b281f6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.875+0000 7f4b27400640 1 -- 172.21.15.42:0/1440017719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b281519c0 msgr2=0x7f4b280ad470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:51.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.875+0000 7f4b27400640 1 --2- 172.21.15.42:0/1440017719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b281519c0 0x7f4b280ad470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:51.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.875+0000 7f4b27400640 1 -- 172.21.15.42:0/1440017719 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b281f92c0 con 0x7f4b280b4be0 2024-09-17T01:35:51.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.875+0000 7f4b1fe00640 1 --2- 172.21.15.42:0/1440017719 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4b280cf7c0 0x7f4b281f6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:51.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.875+0000 7f4b27400640 1 --2- 172.21.15.42:0/1440017719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b280b4be0 0x7f4b281f8d80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4b1800d770 tx=0x7f4b1800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:51.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.876+0000 7f4b1f400640 1 -- 172.21.15.42:0/1440017719 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b18017070 con 0x7f4b280b4be0 2024-09-17T01:35:51.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.876+0000 7f4b1f400640 1 -- 172.21.15.42:0/1440017719 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b18009d20 con 0x7f4b280b4be0 2024-09-17T01:35:51.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.876+0000 7f4b1f400640 1 -- 172.21.15.42:0/1440017719 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b180106c0 con 0x7f4b280b4be0 2024-09-17T01:35:51.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.876+0000 7f4b2cc00640 1 -- 172.21.15.42:0/1440017719 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b281f9790 con 0x7f4b280b4be0 2024-09-17T01:35:51.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.876+0000 7f4b2cc00640 1 -- 172.21.15.42:0/1440017719 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b281f5980 con 0x7f4b280b4be0 2024-09-17T01:35:51.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.878+0000 7f4b2cc00640 1 -- 172.21.15.42:0/1440017719 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b28152ed0 con 0x7f4b280b4be0 2024-09-17T01:35:51.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.878+0000 7f4b1f400640 1 -- 172.21.15.42:0/1440017719 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4b1801a070 con 0x7f4b280b4be0 2024-09-17T01:35:51.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.879+0000 7f4b1f400640 1 --2- 172.21.15.42:0/1440017719 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4b04078b90 0x7f4b0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:51.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.880+0000 7f4b1f400640 1 -- 172.21.15.42:0/1440017719 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5854+0+0 (secure 0 0 0) 0x7f4b1809af30 con 0x7f4b280b4be0 2024-09-17T01:35:51.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.880+0000 7f4b1fe00640 1 --2- 172.21.15.42:0/1440017719 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4b04078b90 0x7f4b0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:51.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.881+0000 7f4b1fe00640 1 --2- 172.21.15.42:0/1440017719 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4b04078b90 0x7f4b0407b0a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4b10007fd0 tx=0x7f4b10009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:51.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:51.884+0000 7f4b1f400640 1 -- 172.21.15.42:0/1440017719 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4b18062bf0 con 0x7f4b280b4be0 2024-09-17T01:35:52.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:52.092+0000 7f4b2cc00640 1 -- 172.21.15.42:0/1440017719 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4b280764d0 con 0x7f4b280b4be0 2024-09-17T01:35:52.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:52.092+0000 7f4b1f400640 1 -- 172.21.15.42:0/1440017719 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v51) ==== 80+0+0 (secure 0 0 0) 0x7f4b18067620 con 0x7f4b280b4be0 2024-09-17T01:35:52.090 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-17T01:35:52.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:52.095+0000 7f4b2cc00640 1 -- 172.21.15.42:0/1440017719 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4b04078b90 msgr2=0x7f4b0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:52.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:52.095+0000 7f4b2cc00640 1 --2- 172.21.15.42:0/1440017719 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4b04078b90 0x7f4b0407b0a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4b10007fd0 tx=0x7f4b10009040 comp rx=0 tx=0).stop 2024-09-17T01:35:52.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:52.095+0000 7f4b2cc00640 1 -- 172.21.15.42:0/1440017719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b280b4be0 msgr2=0x7f4b281f8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:52.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:52.095+0000 7f4b2cc00640 1 --2- 172.21.15.42:0/1440017719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b280b4be0 0x7f4b281f8d80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4b1800d770 tx=0x7f4b1800dc30 comp rx=0 tx=0).stop 2024-09-17T01:35:52.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:52.095+0000 7f4b2cc00640 1 -- 172.21.15.42:0/1440017719 shutdown_connections 2024-09-17T01:35:52.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:52.095+0000 7f4b2cc00640 1 --2- 172.21.15.42:0/1440017719 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4b04078b90 0x7f4b0407b0a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:52.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:52.095+0000 7f4b2cc00640 1 --2- 172.21.15.42:0/1440017719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b281519c0 0x7f4b280ad470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:52.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:52.095+0000 7f4b2cc00640 1 --2- 172.21.15.42:0/1440017719 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4b280cf7c0 0x7f4b281f6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:52.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:52.095+0000 7f4b2cc00640 1 --2- 172.21.15.42:0/1440017719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b280b4be0 0x7f4b281f8d80 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:52.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:52.095+0000 7f4b2cc00640 1 -- 172.21.15.42:0/1440017719 >> 172.21.15.42:0/1440017719 conn(0x7f4b280b25f0 msgr2=0x7f4b28152380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:52.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:52.095+0000 7f4b2cc00640 1 -- 172.21.15.42:0/1440017719 shutdown_connections 2024-09-17T01:35:52.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:52.095+0000 7f4b2cc00640 1 -- 172.21.15.42:0/1440017719 wait complete. 2024-09-17T01:35:52.117 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T01:35:52.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:35:52.118 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T01:35:53.618 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:35:53.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:35:53.618 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T01:35:53.654 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:35:53.654 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:35:53.654 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:35:53.690 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:35:53.690 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:35:53.690 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:35:53.690 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:35:53.730 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:35:53.731 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:35:53.731 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:35:53.731 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:35:53.767 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:35:53.767 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:35:54.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.003+0000 7f78c9600640 1 -- 172.21.15.42:0/3090827660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78c406d430 msgr2=0x7f78c406d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:54.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.003+0000 7f78c9600640 1 --2- 172.21.15.42:0/3090827660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78c406d430 0x7f78c406d840 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009830 tx=0x7f78b002a520 comp rx=0 tx=0).stop 2024-09-17T01:35:54.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.003+0000 7f78c9600640 1 -- 172.21.15.42:0/3090827660 shutdown_connections 2024-09-17T01:35:54.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.003+0000 7f78c9600640 1 --2- 172.21.15.42:0/3090827660 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f78c415f480 0x7f78c415f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:54.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.003+0000 7f78c9600640 1 --2- 172.21.15.42:0/3090827660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78c406d430 0x7f78c406d840 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:54.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.003+0000 7f78c9600640 1 -- 172.21.15.42:0/3090827660 >> 172.21.15.42:0/3090827660 conn(0x7f78c40b2930 msgr2=0x7f78c406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:54.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.003+0000 7f78c9600640 1 -- 172.21.15.42:0/3090827660 shutdown_connections 2024-09-17T01:35:54.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.003+0000 7f78c9600640 1 -- 172.21.15.42:0/3090827660 wait complete. 2024-09-17T01:35:54.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.006+0000 7f78c9600640 1 Processor -- start 2024-09-17T01:35:54.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.006+0000 7f78c9600640 1 -- start start 2024-09-17T01:35:54.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.007+0000 7f78c9600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78c406d430 0x7f78c414ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:54.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.007+0000 7f78c9600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78c415cb80 0x7f78c4155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:54.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.007+0000 7f78c9600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f78c415f480 0x7f78c4155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:54.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.007+0000 7f78c9600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f78c4073820 con 0x7f78c406d430 2024-09-17T01:35:54.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.007+0000 7f78c9600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f78c40736a0 con 0x7f78c415cb80 2024-09-17T01:35:54.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.007+0000 7f78c9600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f78c40739a0 con 0x7f78c415f480 2024-09-17T01:35:54.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.008+0000 7f78c2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78c406d430 0x7f78c414ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:54.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.008+0000 7f78c2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78c406d430 0x7f78c414ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34800/0 (socket says 172.21.15.42:34800) 2024-09-17T01:35:54.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.008+0000 7f78c2a00640 1 -- 172.21.15.42:0/3327613493 learned_addr learned my addr 172.21.15.42:0/3327613493 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:54.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.008+0000 7f78c2000640 1 --2- 172.21.15.42:0/3327613493 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78c415cb80 0x7f78c4155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:54.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.008+0000 7f78c3400640 1 --2- 172.21.15.42:0/3327613493 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f78c415f480 0x7f78c4155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:54.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.008+0000 7f78c2a00640 1 -- 172.21.15.42:0/3327613493 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f78c415f480 msgr2=0x7f78c4155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:54.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.008+0000 7f78c2a00640 1 --2- 172.21.15.42:0/3327613493 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f78c415f480 0x7f78c4155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:54.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.008+0000 7f78c2a00640 1 -- 172.21.15.42:0/3327613493 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78c415cb80 msgr2=0x7f78c4155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:54.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.008+0000 7f78c2a00640 1 --2- 172.21.15.42:0/3327613493 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78c415cb80 0x7f78c4155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:54.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.008+0000 7f78c2a00640 1 -- 172.21.15.42:0/3327613493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c41530c0 con 0x7f78c406d430 2024-09-17T01:35:54.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.008+0000 7f78c2a00640 1 --2- 172.21.15.42:0/3327613493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78c406d430 0x7f78c414ae10 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f78b400c3a0 tx=0x7f78b400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:54.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.009+0000 7f78baa00640 1 -- 172.21.15.42:0/3327613493 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b4011790 con 0x7f78c406d430 2024-09-17T01:35:54.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.009+0000 7f78baa00640 1 -- 172.21.15.42:0/3327613493 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78b4017070 con 0x7f78c406d430 2024-09-17T01:35:54.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.009+0000 7f78c9600640 1 -- 172.21.15.42:0/3327613493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78c40aedc0 con 0x7f78c406d430 2024-09-17T01:35:54.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.009+0000 7f78baa00640 1 -- 172.21.15.42:0/3327613493 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b4011cc0 con 0x7f78c406d430 2024-09-17T01:35:54.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.009+0000 7f78c9600640 1 -- 172.21.15.42:0/3327613493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78c40af380 con 0x7f78c406d430 2024-09-17T01:35:54.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.010+0000 7f78c9600640 1 -- 172.21.15.42:0/3327613493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78c4073ec0 con 0x7f78c406d430 2024-09-17T01:35:54.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.011+0000 7f78baa00640 1 -- 172.21.15.42:0/3327613493 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f78b401c460 con 0x7f78c406d430 2024-09-17T01:35:54.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.012+0000 7f78baa00640 1 --2- 172.21.15.42:0/3327613493 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f78a4078b90 0x7f78a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:54.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.012+0000 7f78baa00640 1 -- 172.21.15.42:0/3327613493 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5854+0+0 (secure 0 0 0) 0x7f78b409a9e0 con 0x7f78c406d430 2024-09-17T01:35:54.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.013+0000 7f78c2000640 1 --2- 172.21.15.42:0/3327613493 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f78a4078b90 0x7f78a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:54.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.013+0000 7f78c2000640 1 --2- 172.21.15.42:0/3327613493 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f78a4078b90 0x7f78a407b0a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f78b0034000 tx=0x7f78b0004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:54.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.017+0000 7f78baa00640 1 -- 172.21.15.42:0/3327613493 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f78c415be20 con 0x7f78c406d430 2024-09-17T01:35:54.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.250+0000 7f78c9600640 1 -- 172.21.15.42:0/3327613493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78c406a170 con 0x7f78c406d430 2024-09-17T01:35:54.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.250+0000 7f78baa00640 1 -- 172.21.15.42:0/3327613493 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5224 (secure 0 0 0) 0x7f78b40627c0 con 0x7f78c406d430 2024-09-17T01:35:54.283 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:35:54.283 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":31,"btime":"2024-09-17T01:35:47:824511+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5209,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4107697732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":4107697732},{"type":"v1","addr":"172.21.15.43:6837","nonce":4107697732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1959050852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1959050852},{"type":"v1","addr":"172.21.15.42:6833","nonce":1959050852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5271,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2487768756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2487768756},{"type":"v1","addr":"172.21.15.43:6836","nonce":2487768756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:35:11.176089+0000","modified":"2024-09-17T01:35:47.706461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.42:6835/1094322669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1094322669},{"type":"v1","addr":"172.21.15.42:6835","nonce":1094322669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-17T01:35:54.285 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 31 2024-09-17T01:35:54.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.253+0000 7f78c9600640 1 -- 172.21.15.42:0/3327613493 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f78a4078b90 msgr2=0x7f78a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:54.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.253+0000 7f78c9600640 1 --2- 172.21.15.42:0/3327613493 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f78a4078b90 0x7f78a407b0a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f78b0034000 tx=0x7f78b0004730 comp rx=0 tx=0).stop 2024-09-17T01:35:54.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.253+0000 7f78c9600640 1 -- 172.21.15.42:0/3327613493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78c406d430 msgr2=0x7f78c414ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:54.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.253+0000 7f78c9600640 1 --2- 172.21.15.42:0/3327613493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78c406d430 0x7f78c414ae10 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f78b400c3a0 tx=0x7f78b400c860 comp rx=0 tx=0).stop 2024-09-17T01:35:54.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.253+0000 7f78c9600640 1 -- 172.21.15.42:0/3327613493 shutdown_connections 2024-09-17T01:35:54.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.253+0000 7f78c9600640 1 --2- 172.21.15.42:0/3327613493 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f78a4078b90 0x7f78a407b0a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:54.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.253+0000 7f78c9600640 1 --2- 172.21.15.42:0/3327613493 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78c415cb80 0x7f78c4155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:54.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.253+0000 7f78c9600640 1 --2- 172.21.15.42:0/3327613493 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f78c415f480 0x7f78c4155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:54.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.253+0000 7f78c9600640 1 --2- 172.21.15.42:0/3327613493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78c406d430 0x7f78c414ae10 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:54.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.253+0000 7f78c9600640 1 -- 172.21.15.42:0/3327613493 >> 172.21.15.42:0/3327613493 conn(0x7f78c40b2930 msgr2=0x7f78c4072c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:54.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.253+0000 7f78c9600640 1 -- 172.21.15.42:0/3327613493 shutdown_connections 2024-09-17T01:35:54.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.253+0000 7f78c9600640 1 -- 172.21.15.42:0/3327613493 wait complete. 2024-09-17T01:35:54.286 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:35:54.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.517+0000 7fd182e00640 1 -- 172.21.15.42:0/3382381607 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd17c0cf7c0 msgr2=0x7fd17c06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:54.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.517+0000 7fd182e00640 1 --2- 172.21.15.42:0/3382381607 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd17c0cf7c0 0x7fd17c06cd20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd168009830 tx=0x7fd16802a540 comp rx=0 tx=0).stop 2024-09-17T01:35:54.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.517+0000 7fd182e00640 1 -- 172.21.15.42:0/3382381607 shutdown_connections 2024-09-17T01:35:54.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.517+0000 7fd182e00640 1 --2- 172.21.15.42:0/3382381607 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd17c0cf7c0 0x7fd17c06cd20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:54.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.517+0000 7fd182e00640 1 -- 172.21.15.42:0/3382381607 >> 172.21.15.42:0/3382381607 conn(0x7fd17c0b25f0 msgr2=0x7fd17c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:54.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.517+0000 7fd182e00640 1 -- 172.21.15.42:0/3382381607 shutdown_connections 2024-09-17T01:35:54.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.517+0000 7fd182e00640 1 -- 172.21.15.42:0/3382381607 wait complete. 2024-09-17T01:35:54.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.519+0000 7fd182e00640 1 Processor -- start 2024-09-17T01:35:54.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.520+0000 7fd182e00640 1 -- start start 2024-09-17T01:35:54.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.521+0000 7fd182e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd17c06d260 0x7fd17c073720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:54.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.521+0000 7fd182e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd17c0b4be0 0x7fd17c1e4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:54.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.521+0000 7fd182e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd17c0cf7c0 0x7fd17c09dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:54.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.521+0000 7fd182e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c1535e0 con 0x7fd17c0b4be0 2024-09-17T01:35:54.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.521+0000 7fd182e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c0b4340 con 0x7fd17c0cf7c0 2024-09-17T01:35:54.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.521+0000 7fd182e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd17c153760 con 0x7fd17c06d260 2024-09-17T01:35:54.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.521+0000 7fd181000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd17c0b4be0 0x7fd17c1e4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:54.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.521+0000 7fd181000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd17c0b4be0 0x7fd17c1e4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34802/0 (socket says 172.21.15.42:34802) 2024-09-17T01:35:54.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.521+0000 7fd181000640 1 -- 172.21.15.42:0/1309341019 learned_addr learned my addr 172.21.15.42:0/1309341019 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:54.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.521+0000 7fd182400640 1 --2- 172.21.15.42:0/1309341019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd17c0cf7c0 0x7fd17c09dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:54.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.521+0000 7fd181a00640 1 --2- 172.21.15.42:0/1309341019 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd17c06d260 0x7fd17c073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:54.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.522+0000 7fd181000640 1 -- 172.21.15.42:0/1309341019 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd17c06d260 msgr2=0x7fd17c073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:54.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.522+0000 7fd181000640 1 --2- 172.21.15.42:0/1309341019 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd17c06d260 0x7fd17c073720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:54.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.522+0000 7fd181000640 1 -- 172.21.15.42:0/1309341019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd17c0cf7c0 msgr2=0x7fd17c09dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:54.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.522+0000 7fd181000640 1 --2- 172.21.15.42:0/1309341019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd17c0cf7c0 0x7fd17c09dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:54.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.522+0000 7fd181000640 1 -- 172.21.15.42:0/1309341019 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd17c073c60 con 0x7fd17c0b4be0 2024-09-17T01:35:54.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.522+0000 7fd181000640 1 --2- 172.21.15.42:0/1309341019 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd17c0b4be0 0x7fd17c1e4f30 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd16802ab30 tx=0x7fd168003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:54.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.522+0000 7fd179600640 1 -- 172.21.15.42:0/1309341019 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd168005c90 con 0x7fd17c0b4be0 2024-09-17T01:35:54.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.522+0000 7fd179600640 1 -- 172.21.15.42:0/1309341019 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd168005020 con 0x7fd17c0b4be0 2024-09-17T01:35:54.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.522+0000 7fd179600640 1 -- 172.21.15.42:0/1309341019 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd168005450 con 0x7fd17c0b4be0 2024-09-17T01:35:54.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.522+0000 7fd182e00640 1 -- 172.21.15.42:0/1309341019 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd17c1e5470 con 0x7fd17c0b4be0 2024-09-17T01:35:54.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.523+0000 7fd182e00640 1 -- 172.21.15.42:0/1309341019 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd17c1f96b0 con 0x7fd17c0b4be0 2024-09-17T01:35:54.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.524+0000 7fd182e00640 1 -- 172.21.15.42:0/1309341019 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd17c06cd20 con 0x7fd17c0b4be0 2024-09-17T01:35:54.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.525+0000 7fd179600640 1 -- 172.21.15.42:0/1309341019 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd1680317c0 con 0x7fd17c0b4be0 2024-09-17T01:35:54.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.526+0000 7fd179600640 1 --2- 172.21.15.42:0/1309341019 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd15c078b90 0x7fd15c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:54.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.527+0000 7fd179600640 1 -- 172.21.15.42:0/1309341019 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5854+0+0 (secure 0 0 0) 0x7fd1680bbd80 con 0x7fd17c0b4be0 2024-09-17T01:35:54.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.527+0000 7fd181a00640 1 --2- 172.21.15.42:0/1309341019 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd15c078b90 0x7fd15c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:54.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.527+0000 7fd181a00640 1 --2- 172.21.15.42:0/1309341019 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd15c078b90 0x7fd15c07b0a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd1700010e0 tx=0x7fd1700018a0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:54.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.531+0000 7fd179600640 1 -- 172.21.15.42:0/1309341019 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd16803f030 con 0x7fd17c0b4be0 2024-09-17T01:35:54.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.765+0000 7fd182e00640 1 -- 172.21.15.42:0/1309341019 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd17c0ca3a0 con 0x7fd17c0b4be0 2024-09-17T01:35:54.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.766+0000 7fd179600640 1 -- 172.21.15.42:0/1309341019 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5224 (secure 0 0 0) 0x7fd168083b60 con 0x7fd17c0b4be0 2024-09-17T01:35:54.764 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:35:54.764 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":31,"btime":"2024-09-17T01:35:47:824511+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5209,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4107697732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":4107697732},{"type":"v1","addr":"172.21.15.43:6837","nonce":4107697732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1959050852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1959050852},{"type":"v1","addr":"172.21.15.42:6833","nonce":1959050852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5271,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2487768756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2487768756},{"type":"v1","addr":"172.21.15.43:6836","nonce":2487768756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:35:11.176089+0000","modified":"2024-09-17T01:35:47.706461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.42:6835/1094322669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1094322669},{"type":"v1","addr":"172.21.15.42:6835","nonce":1094322669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-17T01:35:54.764 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 31 2024-09-17T01:35:54.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.768+0000 7fd182e00640 1 -- 172.21.15.42:0/1309341019 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd15c078b90 msgr2=0x7fd15c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:54.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.768+0000 7fd182e00640 1 --2- 172.21.15.42:0/1309341019 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd15c078b90 0x7fd15c07b0a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd1700010e0 tx=0x7fd1700018a0 comp rx=0 tx=0).stop 2024-09-17T01:35:54.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.768+0000 7fd182e00640 1 -- 172.21.15.42:0/1309341019 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd17c0b4be0 msgr2=0x7fd17c1e4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:54.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.768+0000 7fd182e00640 1 --2- 172.21.15.42:0/1309341019 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd17c0b4be0 0x7fd17c1e4f30 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd16802ab30 tx=0x7fd168003c10 comp rx=0 tx=0).stop 2024-09-17T01:35:54.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.768+0000 7fd182e00640 1 -- 172.21.15.42:0/1309341019 shutdown_connections 2024-09-17T01:35:54.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.768+0000 7fd182e00640 1 --2- 172.21.15.42:0/1309341019 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd15c078b90 0x7fd15c07b0a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:54.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.768+0000 7fd182e00640 1 --2- 172.21.15.42:0/1309341019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd17c0cf7c0 0x7fd17c09dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:54.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.768+0000 7fd182e00640 1 --2- 172.21.15.42:0/1309341019 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd17c0b4be0 0x7fd17c1e4f30 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:54.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.768+0000 7fd182e00640 1 --2- 172.21.15.42:0/1309341019 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd17c06d260 0x7fd17c073720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:54.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.768+0000 7fd182e00640 1 -- 172.21.15.42:0/1309341019 >> 172.21.15.42:0/1309341019 conn(0x7fd17c0b25f0 msgr2=0x7fd17c0afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:54.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.768+0000 7fd182e00640 1 -- 172.21.15.42:0/1309341019 shutdown_connections 2024-09-17T01:35:54.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:54.768+0000 7fd182e00640 1 -- 172.21.15.42:0/1309341019 wait complete. 2024-09-17T01:35:54.787 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:35:55.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.019+0000 7f05a8c00640 1 -- 172.21.15.42:0/2025874010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05a4142f40 msgr2=0x7f05a4072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:55.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.019+0000 7f05a8c00640 1 --2- 172.21.15.42:0/2025874010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05a4142f40 0x7f05a4072950 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f058c005fd0 tx=0x7f058c02a540 comp rx=0 tx=0).stop 2024-09-17T01:35:55.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.019+0000 7f05a8c00640 1 -- 172.21.15.42:0/2025874010 shutdown_connections 2024-09-17T01:35:55.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.019+0000 7f05a8c00640 1 --2- 172.21.15.42:0/2025874010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05a4142f40 0x7f05a4072950 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:55.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.019+0000 7f05a8c00640 1 --2- 172.21.15.42:0/2025874010 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f05a40b3550 0x7f05a415cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:55.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.019+0000 7f05a8c00640 1 -- 172.21.15.42:0/2025874010 >> 172.21.15.42:0/2025874010 conn(0x7f05a40b2930 msgr2=0x7f05a406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:55.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.019+0000 7f05a8c00640 1 -- 172.21.15.42:0/2025874010 shutdown_connections 2024-09-17T01:35:55.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.019+0000 7f05a8c00640 1 -- 172.21.15.42:0/2025874010 wait complete. 2024-09-17T01:35:55.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.021+0000 7f05a8c00640 1 Processor -- start 2024-09-17T01:35:55.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.022+0000 7f05a8c00640 1 -- start start 2024-09-17T01:35:55.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.023+0000 7f05a8c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05a4072e90 0x7f05a413ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:55.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.023+0000 7f05a8c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05a40b3550 0x7f05a41f91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:55.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.023+0000 7f05a8c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f05a4142f40 0x7f05a40ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:55.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.023+0000 7f05a8c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f05a406d640 con 0x7f05a40b3550 2024-09-17T01:35:55.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.023+0000 7f05a8c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f05a415d680 con 0x7f05a4072e90 2024-09-17T01:35:55.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.023+0000 7f05a8c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f05a406d7c0 con 0x7f05a4142f40 2024-09-17T01:35:55.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.023+0000 7f0599400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05a40b3550 0x7f05a41f91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:55.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.023+0000 7f0599400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05a40b3550 0x7f05a41f91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34822/0 (socket says 172.21.15.42:34822) 2024-09-17T01:35:55.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.023+0000 7f0599400640 1 -- 172.21.15.42:0/1066313142 learned_addr learned my addr 172.21.15.42:0/1066313142 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:55.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.023+0000 7f05a1e00640 1 --2- 172.21.15.42:0/1066313142 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05a4072e90 0x7f05a413ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:55.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.023+0000 7f05a2800640 1 --2- 172.21.15.42:0/1066313142 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f05a4142f40 0x7f05a40ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:55.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.024+0000 7f0599400640 1 -- 172.21.15.42:0/1066313142 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f05a4142f40 msgr2=0x7f05a40ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:55.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.024+0000 7f0599400640 1 --2- 172.21.15.42:0/1066313142 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f05a4142f40 0x7f05a40ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:55.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.024+0000 7f0599400640 1 -- 172.21.15.42:0/1066313142 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05a4072e90 msgr2=0x7f05a413ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:55.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.024+0000 7f0599400640 1 --2- 172.21.15.42:0/1066313142 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05a4072e90 0x7f05a413ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:55.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.024+0000 7f0599400640 1 -- 172.21.15.42:0/1066313142 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a41f9f40 con 0x7f05a40b3550 2024-09-17T01:35:55.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.024+0000 7f05a2800640 1 --2- 172.21.15.42:0/1066313142 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f05a4142f40 0x7f05a40ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:55.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.024+0000 7f0599400640 1 --2- 172.21.15.42:0/1066313142 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05a40b3550 0x7f05a41f91d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f058c006010 tx=0x7f058c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:55.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.024+0000 7f059aa00640 1 -- 172.21.15.42:0/1066313142 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058c03e030 con 0x7f05a40b3550 2024-09-17T01:35:55.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.024+0000 7f059aa00640 1 -- 172.21.15.42:0/1066313142 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f058c003d90 con 0x7f05a40b3550 2024-09-17T01:35:55.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.024+0000 7f059aa00640 1 -- 172.21.15.42:0/1066313142 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058c035040 con 0x7f05a40b3550 2024-09-17T01:35:55.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.024+0000 7f05a8c00640 1 -- 172.21.15.42:0/1066313142 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a41f5e50 con 0x7f05a40b3550 2024-09-17T01:35:55.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.025+0000 7f05a8c00640 1 -- 172.21.15.42:0/1066313142 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a406ef30 con 0x7f05a40b3550 2024-09-17T01:35:55.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.025+0000 7f05a8c00640 1 -- 172.21.15.42:0/1066313142 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05a406dce0 con 0x7f05a40b3550 2024-09-17T01:35:55.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.027+0000 7f059aa00640 1 -- 172.21.15.42:0/1066313142 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f058c041030 con 0x7f05a40b3550 2024-09-17T01:35:55.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.028+0000 7f059aa00640 1 --2- 172.21.15.42:0/1066313142 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0580078b90 0x7f058007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:55.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.028+0000 7f059aa00640 1 -- 172.21.15.42:0/1066313142 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5854+0+0 (secure 0 0 0) 0x7f058c0bb470 con 0x7f05a40b3550 2024-09-17T01:35:55.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.028+0000 7f05a1e00640 1 --2- 172.21.15.42:0/1066313142 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0580078b90 0x7f058007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:55.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.029+0000 7f05a1e00640 1 --2- 172.21.15.42:0/1066313142 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0580078b90 0x7f058007b0a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0594004630 tx=0x7f059400b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:55.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.032+0000 7f059aa00640 1 -- 172.21.15.42:0/1066313142 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f058c083260 con 0x7f05a40b3550 2024-09-17T01:35:55.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.226+0000 7f05a8c00640 1 -- 172.21.15.42:0/1066313142 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05a41f9cd0 con 0x7f05a40b3550 2024-09-17T01:35:55.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.227+0000 7f059aa00640 1 -- 172.21.15.42:0/1066313142 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16914 (secure 0 0 0) 0x7f058c088e20 con 0x7f05a40b3550 2024-09-17T01:35:55.225 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:35:55.225 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":51,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:35:47.817559+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:35:09.123920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T01:35:10.132232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.15","mappings":[{"from":5,"to":0}]},{"pgid":"7.1d","mappings":[{"from":5,"to":7}]},{"pgid":"7.2e","mappings":[{"from":5,"to":7}]},{"pgid":"7.31","mappings":[{"from":5,"to":7}]},{"pgid":"7.38","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:35:55.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.229+0000 7f05a8c00640 1 -- 172.21.15.42:0/1066313142 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0580078b90 msgr2=0x7f058007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:55.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.229+0000 7f05a8c00640 1 --2- 172.21.15.42:0/1066313142 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0580078b90 0x7f058007b0a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0594004630 tx=0x7f059400b2e0 comp rx=0 tx=0).stop 2024-09-17T01:35:55.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.229+0000 7f05a8c00640 1 -- 172.21.15.42:0/1066313142 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05a40b3550 msgr2=0x7f05a41f91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:55.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.229+0000 7f05a8c00640 1 --2- 172.21.15.42:0/1066313142 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05a40b3550 0x7f05a41f91d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f058c006010 tx=0x7f058c0038a0 comp rx=0 tx=0).stop 2024-09-17T01:35:55.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.229+0000 7f05a8c00640 1 -- 172.21.15.42:0/1066313142 shutdown_connections 2024-09-17T01:35:55.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.229+0000 7f05a8c00640 1 --2- 172.21.15.42:0/1066313142 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0580078b90 0x7f058007b0a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:55.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.229+0000 7f05a8c00640 1 --2- 172.21.15.42:0/1066313142 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f05a4142f40 0x7f05a40ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:55.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.229+0000 7f05a8c00640 1 --2- 172.21.15.42:0/1066313142 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05a40b3550 0x7f05a41f91d0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:55.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.229+0000 7f05a8c00640 1 --2- 172.21.15.42:0/1066313142 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f05a4072e90 0x7f05a413ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:55.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.229+0000 7f05a8c00640 1 -- 172.21.15.42:0/1066313142 >> 172.21.15.42:0/1066313142 conn(0x7f05a40b2930 msgr2=0x7f05a40738a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:55.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.229+0000 7f05a8c00640 1 -- 172.21.15.42:0/1066313142 shutdown_connections 2024-09-17T01:35:55.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.229+0000 7f05a8c00640 1 -- 172.21.15.42:0/1066313142 wait complete. 2024-09-17T01:35:55.251 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T01:35:55.251 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:35:55.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.481+0000 7f7481c00640 1 -- 172.21.15.42:0/2597753147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f747c06d430 msgr2=0x7f747c152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:55.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.481+0000 7f7481c00640 1 --2- 172.21.15.42:0/2597753147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f747c06d430 0x7f747c152ed0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7474005fd0 tx=0x7f747402ab40 comp rx=0 tx=0).stop 2024-09-17T01:35:55.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.481+0000 7f7481c00640 1 -- 172.21.15.42:0/2597753147 shutdown_connections 2024-09-17T01:35:55.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.481+0000 7f7481c00640 1 --2- 172.21.15.42:0/2597753147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f747c06d430 0x7f747c152ed0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:55.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.481+0000 7f7481c00640 1 -- 172.21.15.42:0/2597753147 >> 172.21.15.42:0/2597753147 conn(0x7f747c0b25f0 msgr2=0x7f747c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:55.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.481+0000 7f7481c00640 1 -- 172.21.15.42:0/2597753147 shutdown_connections 2024-09-17T01:35:55.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.481+0000 7f7481c00640 1 -- 172.21.15.42:0/2597753147 wait complete. 2024-09-17T01:35:55.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.484+0000 7f7481c00640 1 Processor -- start 2024-09-17T01:35:55.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.484+0000 7f7481c00640 1 -- start start 2024-09-17T01:35:55.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.485+0000 7f7481c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f747c0b4be0 0x7f747c1f6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:55.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.485+0000 7f7481c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f747c0cf7c0 0x7f747c151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:55.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.485+0000 7f7481c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f747c1f8e80 0x7f747c145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:55.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.485+0000 7f7481c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f747c153620 con 0x7f747c0b4be0 2024-09-17T01:35:55.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.485+0000 7f7481c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f747c0b4380 con 0x7f747c1f8e80 2024-09-17T01:35:55.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.485+0000 7f7481c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f747c1537a0 con 0x7f747c0cf7c0 2024-09-17T01:35:55.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.485+0000 7f747be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f747c0b4be0 0x7f747c1f6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:55.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.486+0000 7f747be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f747c0b4be0 0x7f747c1f6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34850/0 (socket says 172.21.15.42:34850) 2024-09-17T01:35:55.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.486+0000 7f747be00640 1 -- 172.21.15.42:0/1160552263 learned_addr learned my addr 172.21.15.42:0/1160552263 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:55.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.486+0000 7f7481200640 1 --2- 172.21.15.42:0/1160552263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f747c1f8e80 0x7f747c145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:55.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.486+0000 7f747b400640 1 --2- 172.21.15.42:0/1160552263 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f747c0cf7c0 0x7f747c151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:55.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.486+0000 7f747be00640 1 -- 172.21.15.42:0/1160552263 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f747c0cf7c0 msgr2=0x7f747c151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:55.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.486+0000 7f747be00640 1 --2- 172.21.15.42:0/1160552263 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f747c0cf7c0 0x7f747c151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:55.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.486+0000 7f747be00640 1 -- 172.21.15.42:0/1160552263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f747c1f8e80 msgr2=0x7f747c145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:55.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.486+0000 7f747be00640 1 --2- 172.21.15.42:0/1160552263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f747c1f8e80 0x7f747c145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:55.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.486+0000 7f747be00640 1 -- 172.21.15.42:0/1160552263 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f747c153f10 con 0x7f747c0b4be0 2024-09-17T01:35:55.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.486+0000 7f7481200640 1 --2- 172.21.15.42:0/1160552263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f747c1f8e80 0x7f747c145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:55.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.486+0000 7f747b400640 1 --2- 172.21.15.42:0/1160552263 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f747c0cf7c0 0x7f747c151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:55.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.486+0000 7f747be00640 1 --2- 172.21.15.42:0/1160552263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f747c0b4be0 0x7f747c1f6480 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f746c00c3d0 tx=0x7f746c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:55.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.486+0000 7f7473e00640 1 -- 172.21.15.42:0/1160552263 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746c017070 con 0x7f747c0b4be0 2024-09-17T01:35:55.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.487+0000 7f7473e00640 1 -- 172.21.15.42:0/1160552263 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f746c0053c0 con 0x7f747c0b4be0 2024-09-17T01:35:55.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.487+0000 7f7473e00640 1 -- 172.21.15.42:0/1160552263 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746c003850 con 0x7f747c0b4be0 2024-09-17T01:35:55.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.487+0000 7f7481c00640 1 -- 172.21.15.42:0/1160552263 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f747c1f9a60 con 0x7f747c0b4be0 2024-09-17T01:35:55.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.487+0000 7f7481c00640 1 -- 172.21.15.42:0/1160552263 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f747c1f59a0 con 0x7f747c0b4be0 2024-09-17T01:35:55.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.488+0000 7f7481c00640 1 -- 172.21.15.42:0/1160552263 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f747c0b4500 con 0x7f747c0b4be0 2024-09-17T01:35:55.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.489+0000 7f7473e00640 1 -- 172.21.15.42:0/1160552263 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f746c01a070 con 0x7f747c0b4be0 2024-09-17T01:35:55.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.490+0000 7f7473e00640 1 --2- 172.21.15.42:0/1160552263 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f745c078b90 0x7f745c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:55.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.490+0000 7f7473e00640 1 -- 172.21.15.42:0/1160552263 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5854+0+0 (secure 0 0 0) 0x7f746c09a230 con 0x7f747c0b4be0 2024-09-17T01:35:55.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.491+0000 7f747b400640 1 --2- 172.21.15.42:0/1160552263 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f745c078b90 0x7f745c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:55.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.491+0000 7f747b400640 1 --2- 172.21.15.42:0/1160552263 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f745c078b90 0x7f745c07b0a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f747c0b1b80 tx=0x7f7468009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:55.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.494+0000 7f7473e00640 1 -- 172.21.15.42:0/1160552263 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f747c0b4500 con 0x7f747c0b4be0 2024-09-17T01:35:55.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.726+0000 7f7481c00640 1 -- 172.21.15.42:0/1160552263 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f747c152ed0 con 0x7f747c0b4be0 2024-09-17T01:35:55.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.727+0000 7f7473e00640 1 -- 172.21.15.42:0/1160552263 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5224 (secure 0 0 0) 0x7f746c062540 con 0x7f747c0b4be0 2024-09-17T01:35:55.725 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:35:55.725 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":31,"btime":"2024-09-17T01:35:47:824511+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5209,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4107697732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":4107697732},{"type":"v1","addr":"172.21.15.43:6837","nonce":4107697732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1959050852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1959050852},{"type":"v1","addr":"172.21.15.42:6833","nonce":1959050852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5271,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2487768756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2487768756},{"type":"v1","addr":"172.21.15.43:6836","nonce":2487768756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:35:11.176089+0000","modified":"2024-09-17T01:35:47.706461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.42:6835/1094322669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1094322669},{"type":"v1","addr":"172.21.15.42:6835","nonce":1094322669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-17T01:35:55.725 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 31 2024-09-17T01:35:55.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.730+0000 7f7481c00640 1 -- 172.21.15.42:0/1160552263 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f745c078b90 msgr2=0x7f745c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:55.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.730+0000 7f7481c00640 1 --2- 172.21.15.42:0/1160552263 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f745c078b90 0x7f745c07b0a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f747c0b1b80 tx=0x7f7468009040 comp rx=0 tx=0).stop 2024-09-17T01:35:55.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.730+0000 7f7481c00640 1 -- 172.21.15.42:0/1160552263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f747c0b4be0 msgr2=0x7f747c1f6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:55.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.730+0000 7f7481c00640 1 --2- 172.21.15.42:0/1160552263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f747c0b4be0 0x7f747c1f6480 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f746c00c3d0 tx=0x7f746c00c890 comp rx=0 tx=0).stop 2024-09-17T01:35:55.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.730+0000 7f7481c00640 1 -- 172.21.15.42:0/1160552263 shutdown_connections 2024-09-17T01:35:55.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.730+0000 7f7481c00640 1 --2- 172.21.15.42:0/1160552263 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f745c078b90 0x7f745c07b0a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:55.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.730+0000 7f7481c00640 1 --2- 172.21.15.42:0/1160552263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f747c1f8e80 0x7f747c145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:55.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.730+0000 7f7481c00640 1 --2- 172.21.15.42:0/1160552263 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f747c0cf7c0 0x7f747c151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:55.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.730+0000 7f7481c00640 1 --2- 172.21.15.42:0/1160552263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f747c0b4be0 0x7f747c1f6480 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:55.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.730+0000 7f7481c00640 1 -- 172.21.15.42:0/1160552263 >> 172.21.15.42:0/1160552263 conn(0x7f747c0b25f0 msgr2=0x7f747c0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:55.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.730+0000 7f7481c00640 1 -- 172.21.15.42:0/1160552263 shutdown_connections 2024-09-17T01:35:55.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.730+0000 7f7481c00640 1 -- 172.21.15.42:0/1160552263 wait complete. 2024-09-17T01:35:55.749 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:35:55.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.979+0000 7fa35d200640 1 -- 172.21.15.42:0/3971226496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa33c003a00 msgr2=0x7fa33c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:55.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.979+0000 7fa35d200640 1 --2- 172.21.15.42:0/3971226496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa33c003a00 0x7fa33c003e70 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa348009d00 tx=0x7fa33c005830 comp rx=0 tx=0).stop 2024-09-17T01:35:55.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.979+0000 7fa357e00640 1 -- 172.21.15.42:0/3971226496 reap_dead start 2024-09-17T01:35:55.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.979+0000 7fa35d200640 1 -- 172.21.15.42:0/3971226496 shutdown_connections 2024-09-17T01:35:55.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.979+0000 7fa35d200640 1 -- 172.21.15.42:0/3971226496 >> 172.21.15.42:0/3971226496 conn(0x7fa3580b25f0 msgr2=0x7fa3580d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:55.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.979+0000 7fa35d200640 1 -- 172.21.15.42:0/3971226496 shutdown_connections 2024-09-17T01:35:55.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.979+0000 7fa35d200640 1 -- 172.21.15.42:0/3971226496 wait complete. 2024-09-17T01:35:55.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.981+0000 7fa35d200640 1 Processor -- start 2024-09-17T01:35:55.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.982+0000 7fa35d200640 1 -- start start 2024-09-17T01:35:55.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.983+0000 7fa35d200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa33c003a00 0x7fa35809d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:55.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.983+0000 7fa35d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa358149c10 0x7fa35814b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:55.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.983+0000 7fa35d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3581496c0 0x7fa35814b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:55.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.983+0000 7fa35d200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa358152ed0 con 0x7fa3581496c0 2024-09-17T01:35:55.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.983+0000 7fa35d200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa35806d640 con 0x7fa358149c10 2024-09-17T01:35:55.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.983+0000 7fa35d200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa358153050 con 0x7fa33c003a00 2024-09-17T01:35:55.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.983+0000 7fa357e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3581496c0 0x7fa35814b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:55.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.983+0000 7fa357e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3581496c0 0x7fa35814b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59592/0 (socket says 172.21.15.42:59592) 2024-09-17T01:35:55.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.983+0000 7fa357e00640 1 -- 172.21.15.42:0/3715781469 learned_addr learned my addr 172.21.15.42:0/3715781469 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:55.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.983+0000 7fa357400640 1 --2- 172.21.15.42:0/3715781469 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa33c003a00 0x7fa35809d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:55.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.984+0000 7fa34fe00640 1 --2- 172.21.15.42:0/3715781469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa358149c10 0x7fa35814b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:55.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.984+0000 7fa357e00640 1 -- 172.21.15.42:0/3715781469 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa33c003a00 msgr2=0x7fa35809d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:55.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.984+0000 7fa357e00640 1 --2- 172.21.15.42:0/3715781469 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa33c003a00 0x7fa35809d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:55.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.984+0000 7fa357e00640 1 -- 172.21.15.42:0/3715781469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa358149c10 msgr2=0x7fa35814b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:55.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.984+0000 7fa357e00640 1 --2- 172.21.15.42:0/3715781469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa358149c10 0x7fa35814b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:55.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.984+0000 7fa357e00640 1 -- 172.21.15.42:0/3715781469 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa35814a3d0 con 0x7fa3581496c0 2024-09-17T01:35:55.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.984+0000 7fa357400640 1 --2- 172.21.15.42:0/3715781469 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa33c003a00 0x7fa35809d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:55.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.984+0000 7fa34fe00640 1 --2- 172.21.15.42:0/3715781469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa358149c10 0x7fa35814b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:55.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.984+0000 7fa357e00640 1 --2- 172.21.15.42:0/3715781469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3581496c0 0x7fa35814b9b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa350005fd0 tx=0x7fa35000f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:55.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.984+0000 7fa34f400640 1 -- 172.21.15.42:0/3715781469 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350004b20 con 0x7fa3581496c0 2024-09-17T01:35:55.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.984+0000 7fa34f400640 1 -- 172.21.15.42:0/3715781469 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa350004cc0 con 0x7fa3581496c0 2024-09-17T01:35:55.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.984+0000 7fa34f400640 1 -- 172.21.15.42:0/3715781469 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350003bd0 con 0x7fa3581496c0 2024-09-17T01:35:55.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.984+0000 7fa35d200640 1 -- 172.21.15.42:0/3715781469 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa35814a6b0 con 0x7fa3581496c0 2024-09-17T01:35:55.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.984+0000 7fa35d200640 1 -- 172.21.15.42:0/3715781469 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa35814ac70 con 0x7fa3581496c0 2024-09-17T01:35:55.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.986+0000 7fa35d200640 1 -- 172.21.15.42:0/3715781469 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa35815d6b0 con 0x7fa3581496c0 2024-09-17T01:35:55.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.987+0000 7fa34f400640 1 -- 172.21.15.42:0/3715781469 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa350004030 con 0x7fa3581496c0 2024-09-17T01:35:55.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.988+0000 7fa34f400640 1 --2- 172.21.15.42:0/3715781469 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa334078b90 0x7fa33407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:55.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.988+0000 7fa34f400640 1 -- 172.21.15.42:0/3715781469 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5854+0+0 (secure 0 0 0) 0x7fa35009b290 con 0x7fa3581496c0 2024-09-17T01:35:55.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.988+0000 7fa357400640 1 --2- 172.21.15.42:0/3715781469 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa334078b90 0x7fa33407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:55.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.989+0000 7fa357400640 1 --2- 172.21.15.42:0/3715781469 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa334078b90 0x7fa33407b0a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa348035000 tx=0x7fa3480046c0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:55.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:55.992+0000 7fa34f400640 1 -- 172.21.15.42:0/3715781469 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa350063630 con 0x7fa3581496c0 2024-09-17T01:35:56.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.240+0000 7fa35d200640 1 -- 172.21.15.42:0/3715781469 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa35814a160 con 0x7fa3581496c0 2024-09-17T01:35:56.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.241+0000 7fa34f400640 1 -- 172.21.15.42:0/3715781469 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5224 (secure 0 0 0) 0x7fa350062f30 con 0x7fa3581496c0 2024-09-17T01:35:56.239 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:35:56.239 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":32,"btime":"2024-09-17T01:35:55:857727+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5209,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4107697732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":4107697732},{"type":"v1","addr":"172.21.15.43:6837","nonce":4107697732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1959050852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1959050852},{"type":"v1","addr":"172.21.15.42:6833","nonce":1959050852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5271,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2487768756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2487768756},{"type":"v1","addr":"172.21.15.43:6836","nonce":2487768756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:35:11.176089+0000","modified":"2024-09-17T01:35:55.708543+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5283":{"gid":5283,"name":"c","rank":0,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.42:6835/1094322669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1094322669},{"type":"v1","addr":"172.21.15.42:6835","nonce":1094322669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5283,"qdb_cluster":[5283]},"id":3}]} 2024-09-17T01:35:56.239 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 32 2024-09-17T01:35:56.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.243+0000 7fa35d200640 1 -- 172.21.15.42:0/3715781469 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa334078b90 msgr2=0x7fa33407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:56.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.243+0000 7fa35d200640 1 --2- 172.21.15.42:0/3715781469 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa334078b90 0x7fa33407b0a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa348035000 tx=0x7fa3480046c0 comp rx=0 tx=0).stop 2024-09-17T01:35:56.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.243+0000 7fa35d200640 1 -- 172.21.15.42:0/3715781469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3581496c0 msgr2=0x7fa35814b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:56.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.243+0000 7fa35d200640 1 --2- 172.21.15.42:0/3715781469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3581496c0 0x7fa35814b9b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa350005fd0 tx=0x7fa35000f3c0 comp rx=0 tx=0).stop 2024-09-17T01:35:56.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.243+0000 7fa35d200640 1 -- 172.21.15.42:0/3715781469 shutdown_connections 2024-09-17T01:35:56.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.243+0000 7fa35d200640 1 --2- 172.21.15.42:0/3715781469 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa334078b90 0x7fa33407b0a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:56.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.243+0000 7fa35d200640 1 --2- 172.21.15.42:0/3715781469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa358149c10 0x7fa35814b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:56.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.243+0000 7fa35d200640 1 --2- 172.21.15.42:0/3715781469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3581496c0 0x7fa35814b9b0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:56.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.243+0000 7fa35d200640 1 --2- 172.21.15.42:0/3715781469 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa33c003a00 0x7fa35809d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:56.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.243+0000 7fa35d200640 1 -- 172.21.15.42:0/3715781469 >> 172.21.15.42:0/3715781469 conn(0x7fa3580b25f0 msgr2=0x7fa35815f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:56.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.243+0000 7fa35d200640 1 -- 172.21.15.42:0/3715781469 shutdown_connections 2024-09-17T01:35:56.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.243+0000 7fa35d200640 1 -- 172.21.15.42:0/3715781469 wait complete. 2024-09-17T01:35:56.262 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:35:56.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.495+0000 7fa073e00640 1 -- 172.21.15.42:0/921756984 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0741602e0 msgr2=0x7fa07415ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:56.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.495+0000 7fa073e00640 1 --2- 172.21.15.42:0/921756984 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0741602e0 0x7fa07415ccc0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa0740d04d0 tx=0x7fa06402a4d0 comp rx=0 tx=0).stop 2024-09-17T01:35:56.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.496+0000 7fa073e00640 1 -- 172.21.15.42:0/921756984 shutdown_connections 2024-09-17T01:35:56.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.496+0000 7fa073e00640 1 --2- 172.21.15.42:0/921756984 >> v2:172.21.15.43:3300/0 conn(0x7fa0741537c0 0x7fa074071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:56.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.496+0000 7fa073e00640 1 --2- 172.21.15.42:0/921756984 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0741602e0 0x7fa07415ccc0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:56.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.496+0000 7fa073e00640 1 -- 172.21.15.42:0/921756984 >> 172.21.15.42:0/921756984 conn(0x7fa074070360 msgr2=0x7fa074070770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:56.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.496+0000 7fa073e00640 1 -- 172.21.15.42:0/921756984 shutdown_connections 2024-09-17T01:35:56.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.496+0000 7fa073e00640 1 -- 172.21.15.42:0/921756984 wait complete. 2024-09-17T01:35:56.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.498+0000 7fa073e00640 1 Processor -- start 2024-09-17T01:35:56.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.498+0000 7fa073e00640 1 -- start start 2024-09-17T01:35:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.499+0000 7fa073e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa074072000 0x7fa0740aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.499+0000 7fa073e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0741537c0 0x7fa074146d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.499+0000 7fa073e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0741602e0 0x7fa07415b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.499+0000 7fa073e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa074074a50 con 0x7fa0741537c0 2024-09-17T01:35:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.499+0000 7fa073e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa0740d1c10 con 0x7fa074072000 2024-09-17T01:35:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.500+0000 7fa073e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa074074bd0 con 0x7fa0741602e0 2024-09-17T01:35:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.500+0000 7fa06a000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0741537c0 0x7fa074146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.500+0000 7fa06a000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0741537c0 0x7fa074146d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59606/0 (socket says 172.21.15.42:59606) 2024-09-17T01:35:56.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.500+0000 7fa06a000640 1 -- 172.21.15.42:0/2893111777 learned_addr learned my addr 172.21.15.42:0/2893111777 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:56.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.500+0000 7fa072a00640 1 --2- 172.21.15.42:0/2893111777 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa074072000 0x7fa0740aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:56.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.500+0000 7fa073400640 1 --2- 172.21.15.42:0/2893111777 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0741602e0 0x7fa07415b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:56.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.500+0000 7fa06a000640 1 -- 172.21.15.42:0/2893111777 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0741602e0 msgr2=0x7fa07415b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:56.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.500+0000 7fa06a000640 1 --2- 172.21.15.42:0/2893111777 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0741602e0 0x7fa07415b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:56.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.500+0000 7fa06a000640 1 -- 172.21.15.42:0/2893111777 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa074072000 msgr2=0x7fa0740aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:56.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.500+0000 7fa06a000640 1 --2- 172.21.15.42:0/2893111777 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa074072000 0x7fa0740aa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:56.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.500+0000 7fa06a000640 1 -- 172.21.15.42:0/2893111777 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa074158430 con 0x7fa0741537c0 2024-09-17T01:35:56.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.501+0000 7fa06a000640 1 --2- 172.21.15.42:0/2893111777 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0741537c0 0x7fa074146d00 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00d6d0 tx=0x7fa05c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:56.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.501+0000 7fa06b400640 1 -- 172.21.15.42:0/2893111777 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c017070 con 0x7fa0741537c0 2024-09-17T01:35:56.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.501+0000 7fa06b400640 1 -- 172.21.15.42:0/2893111777 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa05c004330 con 0x7fa0741537c0 2024-09-17T01:35:56.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.501+0000 7fa06b400640 1 -- 172.21.15.42:0/2893111777 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c009a80 con 0x7fa0741537c0 2024-09-17T01:35:56.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.501+0000 7fa073e00640 1 -- 172.21.15.42:0/2893111777 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa074158710 con 0x7fa0741537c0 2024-09-17T01:35:56.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.501+0000 7fa073e00640 1 -- 172.21.15.42:0/2893111777 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa074158cd0 con 0x7fa0741537c0 2024-09-17T01:35:56.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.502+0000 7fa073e00640 1 -- 172.21.15.42:0/2893111777 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa074075140 con 0x7fa0741537c0 2024-09-17T01:35:56.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.503+0000 7fa06b400640 1 -- 172.21.15.42:0/2893111777 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa05c009c20 con 0x7fa0741537c0 2024-09-17T01:35:56.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.504+0000 7fa06b400640 1 --2- 172.21.15.42:0/2893111777 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa050078b90 0x7fa05007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:56.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.504+0000 7fa06b400640 1 -- 172.21.15.42:0/2893111777 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5854+0+0 (secure 0 0 0) 0x7fa05c09af00 con 0x7fa0741537c0 2024-09-17T01:35:56.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.505+0000 7fa072a00640 1 --2- 172.21.15.42:0/2893111777 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa050078b90 0x7fa05007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:56.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.506+0000 7fa072a00640 1 --2- 172.21.15.42:0/2893111777 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa050078b90 0x7fa05007b0a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa064033000 tx=0x7fa064004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:56.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.509+0000 7fa06b400640 1 -- 172.21.15.42:0/2893111777 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa05c062bc0 con 0x7fa0741537c0 2024-09-17T01:35:56.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.709+0000 7fa073e00640 1 -- 172.21.15.42:0/2893111777 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa0740b3cd0 con 0x7fa0741537c0 2024-09-17T01:35:56.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.711+0000 7fa06b400640 1 -- 172.21.15.42:0/2893111777 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16914 (secure 0 0 0) 0x7fa05c0675f0 con 0x7fa0741537c0 2024-09-17T01:35:56.709 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:35:56.709 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":51,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:35:47.817559+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:35:09.123920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T01:35:10.132232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.15","mappings":[{"from":5,"to":0}]},{"pgid":"7.1d","mappings":[{"from":5,"to":7}]},{"pgid":"7.2e","mappings":[{"from":5,"to":7}]},{"pgid":"7.31","mappings":[{"from":5,"to":7}]},{"pgid":"7.38","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:35:56.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.713+0000 7fa073e00640 1 -- 172.21.15.42:0/2893111777 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa050078b90 msgr2=0x7fa05007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:56.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.713+0000 7fa073e00640 1 --2- 172.21.15.42:0/2893111777 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa050078b90 0x7fa05007b0a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa064033000 tx=0x7fa064004730 comp rx=0 tx=0).stop 2024-09-17T01:35:56.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.713+0000 7fa073e00640 1 -- 172.21.15.42:0/2893111777 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0741537c0 msgr2=0x7fa074146d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:56.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.713+0000 7fa073e00640 1 --2- 172.21.15.42:0/2893111777 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0741537c0 0x7fa074146d00 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00d6d0 tx=0x7fa05c00db90 comp rx=0 tx=0).stop 2024-09-17T01:35:56.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.713+0000 7fa073e00640 1 -- 172.21.15.42:0/2893111777 shutdown_connections 2024-09-17T01:35:56.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.713+0000 7fa073e00640 1 --2- 172.21.15.42:0/2893111777 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa050078b90 0x7fa05007b0a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:56.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.713+0000 7fa073e00640 1 --2- 172.21.15.42:0/2893111777 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0741602e0 0x7fa07415b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:56.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.713+0000 7fa073e00640 1 --2- 172.21.15.42:0/2893111777 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0741537c0 0x7fa074146d00 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:56.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.713+0000 7fa073e00640 1 --2- 172.21.15.42:0/2893111777 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa074072000 0x7fa0740aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:56.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.714+0000 7fa073e00640 1 -- 172.21.15.42:0/2893111777 >> 172.21.15.42:0/2893111777 conn(0x7fa074070360 msgr2=0x7fa0740b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:56.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.714+0000 7fa073e00640 1 -- 172.21.15.42:0/2893111777 shutdown_connections 2024-09-17T01:35:56.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.714+0000 7fa073e00640 1 -- 172.21.15.42:0/2893111777 wait complete. 2024-09-17T01:35:56.732 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T01:35:56.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.968+0000 7fb7bfa00640 1 -- 172.21.15.42:0/1160605318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7b815cb80 msgr2=0x7fb7b8152710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:56.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.968+0000 7fb7bfa00640 1 --2- 172.21.15.42:0/1160605318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7b815cb80 0x7fb7b8152710 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009830 tx=0x7fb7ac02a5c0 comp rx=0 tx=0).stop 2024-09-17T01:35:56.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.968+0000 7fb7bfa00640 1 -- 172.21.15.42:0/1160605318 shutdown_connections 2024-09-17T01:35:56.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.968+0000 7fb7bfa00640 1 --2- 172.21.15.42:0/1160605318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7b815cb80 0x7fb7b8152710 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:56.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.968+0000 7fb7bfa00640 1 -- 172.21.15.42:0/1160605318 >> 172.21.15.42:0/1160605318 conn(0x7fb7b80b2930 msgr2=0x7fb7b806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:56.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.968+0000 7fb7bfa00640 1 -- 172.21.15.42:0/1160605318 shutdown_connections 2024-09-17T01:35:56.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.968+0000 7fb7bfa00640 1 -- 172.21.15.42:0/1160605318 wait complete. 2024-09-17T01:35:56.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.971+0000 7fb7bfa00640 1 Processor -- start 2024-09-17T01:35:56.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.971+0000 7fb7bfa00640 1 -- start start 2024-09-17T01:35:56.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.972+0000 7fb7bfa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7b806d430 0x7fb7b8154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:56.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.972+0000 7fb7bfa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7b815cb80 0x7fb7b80ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:56.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.972+0000 7fb7bfa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7b815f480 0x7fb7b81f9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:56.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.972+0000 7fb7bfa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b8073900 con 0x7fb7b815f480 2024-09-17T01:35:56.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.972+0000 7fb7bfa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b8073780 con 0x7fb7b815cb80 2024-09-17T01:35:56.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.972+0000 7fb7bfa00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb7b8073a80 con 0x7fb7b806d430 2024-09-17T01:35:56.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.973+0000 7fb7bda00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7b815f480 0x7fb7b81f9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:56.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.973+0000 7fb7bda00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7b815f480 0x7fb7b81f9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59614/0 (socket says 172.21.15.42:59614) 2024-09-17T01:35:56.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.973+0000 7fb7bda00640 1 -- 172.21.15.42:0/1155326523 learned_addr learned my addr 172.21.15.42:0/1155326523 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:56.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.973+0000 7fb7bd000640 1 --2- 172.21.15.42:0/1155326523 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7b806d430 0x7fb7b8154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:56.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.973+0000 7fb7b7e00640 1 --2- 172.21.15.42:0/1155326523 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7b815cb80 0x7fb7b80ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:56.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.973+0000 7fb7bda00640 1 -- 172.21.15.42:0/1155326523 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7b806d430 msgr2=0x7fb7b8154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:56.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.973+0000 7fb7bda00640 1 --2- 172.21.15.42:0/1155326523 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7b806d430 0x7fb7b8154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:56.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.973+0000 7fb7bda00640 1 -- 172.21.15.42:0/1155326523 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7b815cb80 msgr2=0x7fb7b80ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:56.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.973+0000 7fb7bda00640 1 --2- 172.21.15.42:0/1155326523 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7b815cb80 0x7fb7b80ab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:56.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.973+0000 7fb7bda00640 1 -- 172.21.15.42:0/1155326523 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b8155750 con 0x7fb7b815f480 2024-09-17T01:35:56.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.974+0000 7fb7bda00640 1 --2- 172.21.15.42:0/1155326523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7b815f480 0x7fb7b81f9d00 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb7b000cb10 tx=0x7fb7b000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:56.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.974+0000 7fb7b4c00640 1 -- 172.21.15.42:0/1155326523 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b0016020 con 0x7fb7b815f480 2024-09-17T01:35:56.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.974+0000 7fb7b4c00640 1 -- 172.21.15.42:0/1155326523 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7b000ad60 con 0x7fb7b815f480 2024-09-17T01:35:56.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.974+0000 7fb7bfa00640 1 -- 172.21.15.42:0/1155326523 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7b8155190 con 0x7fb7b815f480 2024-09-17T01:35:56.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.974+0000 7fb7b4c00640 1 -- 172.21.15.42:0/1155326523 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b0012680 con 0x7fb7b815f480 2024-09-17T01:35:56.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.974+0000 7fb7bfa00640 1 -- 172.21.15.42:0/1155326523 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7b81f9500 con 0x7fb7b815f480 2024-09-17T01:35:56.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.975+0000 7fb7bfa00640 1 -- 172.21.15.42:0/1155326523 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7b8154f00 con 0x7fb7b815f480 2024-09-17T01:35:56.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.976+0000 7fb7b4c00640 1 -- 172.21.15.42:0/1155326523 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb7b0019020 con 0x7fb7b815f480 2024-09-17T01:35:56.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.977+0000 7fb7b4c00640 1 --2- 172.21.15.42:0/1155326523 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb798078bc0 0x7fb79807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:56.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.977+0000 7fb7b4c00640 1 -- 172.21.15.42:0/1155326523 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5854+0+0 (secure 0 0 0) 0x7fb7b009afb0 con 0x7fb7b815f480 2024-09-17T01:35:56.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.978+0000 7fb7bd000640 1 --2- 172.21.15.42:0/1155326523 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb798078bc0 0x7fb79807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:56.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.979+0000 7fb7bd000640 1 --2- 172.21.15.42:0/1155326523 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb798078bc0 0x7fb79807b0d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac034000 tx=0x7fb7ac004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:56.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:56.982+0000 7fb7b4c00640 1 -- 172.21.15.42:0/1155326523 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb7b0020030 con 0x7fb7b815f480 2024-09-17T01:35:57.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.216+0000 7fb7bfa00640 1 -- 172.21.15.42:0/1155326523 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb7b8152710 con 0x7fb7b815f480 2024-09-17T01:35:57.214 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-17T01:35:57.217+0000 7f9961e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:35:57.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.219+0000 7fb7b4c00640 1 -- 172.21.15.42:0/1155326523 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) ==== 161+0+0 (secure 0 0 0) 0x7fb7b815be20 con 0x7fb7b815f480 2024-09-17T01:35:57.216 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T01:35:57.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.222+0000 7fb7bfa00640 1 -- 172.21.15.42:0/1155326523 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb798078bc0 msgr2=0x7fb79807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:57.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.222+0000 7fb7bfa00640 1 --2- 172.21.15.42:0/1155326523 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb798078bc0 0x7fb79807b0d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac034000 tx=0x7fb7ac004730 comp rx=0 tx=0).stop 2024-09-17T01:35:57.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.222+0000 7fb7bfa00640 1 -- 172.21.15.42:0/1155326523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7b815f480 msgr2=0x7fb7b81f9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:57.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.222+0000 7fb7bfa00640 1 --2- 172.21.15.42:0/1155326523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7b815f480 0x7fb7b81f9d00 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb7b000cb10 tx=0x7fb7b000a060 comp rx=0 tx=0).stop 2024-09-17T01:35:57.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.222+0000 7fb7bfa00640 1 -- 172.21.15.42:0/1155326523 shutdown_connections 2024-09-17T01:35:57.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.222+0000 7fb7bfa00640 1 --2- 172.21.15.42:0/1155326523 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb798078bc0 0x7fb79807b0d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:57.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.222+0000 7fb7bfa00640 1 --2- 172.21.15.42:0/1155326523 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7b815cb80 0x7fb7b80ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:57.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.222+0000 7fb7bfa00640 1 --2- 172.21.15.42:0/1155326523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7b815f480 0x7fb7b81f9d00 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:57.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.222+0000 7fb7bfa00640 1 --2- 172.21.15.42:0/1155326523 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7b806d430 0x7fb7b8154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:57.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.222+0000 7fb7bfa00640 1 -- 172.21.15.42:0/1155326523 >> 172.21.15.42:0/1155326523 conn(0x7fb7b80b2930 msgr2=0x7fb7b80b53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:57.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.223+0000 7fb7bfa00640 1 -- 172.21.15.42:0/1155326523 shutdown_connections 2024-09-17T01:35:57.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.223+0000 7fb7bfa00640 1 -- 172.21.15.42:0/1155326523 wait complete. 2024-09-17T01:35:57.242 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T01:35:57.365 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:35:57.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.480+0000 7fc0d0800640 1 -- 172.21.15.42:0/3277589674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0c815f000 msgr2=0x7fc0c80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:57.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.480+0000 7fc0d0800640 1 --2- 172.21.15.42:0/3277589674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0c815f000 0x7fc0c80b32e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009830 tx=0x7fc0bc02a380 comp rx=0 tx=0).stop 2024-09-17T01:35:57.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.480+0000 7fc0d0800640 1 -- 172.21.15.42:0/3277589674 shutdown_connections 2024-09-17T01:35:57.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.480+0000 7fc0d0800640 1 --2- 172.21.15.42:0/3277589674 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc0c80b6950 0x7fc0c80cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:57.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.480+0000 7fc0d0800640 1 --2- 172.21.15.42:0/3277589674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0c815f000 0x7fc0c80b32e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:57.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.480+0000 7fc0d0800640 1 -- 172.21.15.42:0/3277589674 >> 172.21.15.42:0/3277589674 conn(0x7fc0c806d140 msgr2=0x7fc0c806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:57.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.480+0000 7fc0d0800640 1 -- 172.21.15.42:0/3277589674 shutdown_connections 2024-09-17T01:35:57.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.480+0000 7fc0d0800640 1 -- 172.21.15.42:0/3277589674 wait complete. 2024-09-17T01:35:57.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.482+0000 7fc0d0800640 1 Processor -- start 2024-09-17T01:35:57.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.482+0000 7fc0d0800640 1 -- start start 2024-09-17T01:35:57.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.484+0000 7fc0d0800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0c80d4110 0x7fc0c81574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:57.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.484+0000 7fc0d0800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0c815f000 0x7fc0c815c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:57.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.484+0000 7fc0d0800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc0c8157fc0 0x7fc0c815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:57.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.484+0000 7fc0d0800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c80d2860 con 0x7fc0c80d4110 2024-09-17T01:35:57.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.484+0000 7fc0d0800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c80d26e0 con 0x7fc0c815f000 2024-09-17T01:35:57.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.484+0000 7fc0d0800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc0c80d29e0 con 0x7fc0c8157fc0 2024-09-17T01:35:57.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.484+0000 7fc0cde00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0c80d4110 0x7fc0c81574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:57.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.484+0000 7fc0cde00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0c80d4110 0x7fc0c81574f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59630/0 (socket says 172.21.15.42:59630) 2024-09-17T01:35:57.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.484+0000 7fc0cde00640 1 -- 172.21.15.42:0/144760609 learned_addr learned my addr 172.21.15.42:0/144760609 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:57.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.484+0000 7fc0ce800640 1 --2- 172.21.15.42:0/144760609 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc0c8157fc0 0x7fc0c815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:57.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.484+0000 7fc0cd400640 1 --2- 172.21.15.42:0/144760609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0c815f000 0x7fc0c815c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:57.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.484+0000 7fc0cde00640 1 -- 172.21.15.42:0/144760609 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc0c8157fc0 msgr2=0x7fc0c815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:57.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.484+0000 7fc0cde00640 1 --2- 172.21.15.42:0/144760609 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc0c8157fc0 0x7fc0c815d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:57.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.484+0000 7fc0cde00640 1 -- 172.21.15.42:0/144760609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0c815f000 msgr2=0x7fc0c815c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:57.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.484+0000 7fc0cde00640 1 --2- 172.21.15.42:0/144760609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0c815f000 0x7fc0c815c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:57.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.484+0000 7fc0cde00640 1 -- 172.21.15.42:0/144760609 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c815b5f0 con 0x7fc0c80d4110 2024-09-17T01:35:57.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.484+0000 7fc0ce800640 1 --2- 172.21.15.42:0/144760609 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc0c8157fc0 0x7fc0c815d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:57.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.485+0000 7fc0cde00640 1 --2- 172.21.15.42:0/144760609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0c80d4110 0x7fc0c81574f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc02a970 tx=0x7fc0bc003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:57.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.485+0000 7fc0c2000640 1 -- 172.21.15.42:0/144760609 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc03f030 con 0x7fc0c80d4110 2024-09-17T01:35:57.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.485+0000 7fc0d0800640 1 -- 172.21.15.42:0/144760609 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c815b890 con 0x7fc0c80d4110 2024-09-17T01:35:57.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.485+0000 7fc0c2000640 1 -- 172.21.15.42:0/144760609 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0bc003d50 con 0x7fc0c80d4110 2024-09-17T01:35:57.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.485+0000 7fc0c2000640 1 -- 172.21.15.42:0/144760609 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc037040 con 0x7fc0c80d4110 2024-09-17T01:35:57.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.485+0000 7fc0d0800640 1 -- 172.21.15.42:0/144760609 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c8157a70 con 0x7fc0c80d4110 2024-09-17T01:35:57.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.486+0000 7fc0d0800640 1 -- 172.21.15.42:0/144760609 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0c80d0940 con 0x7fc0c80d4110 2024-09-17T01:35:57.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.487+0000 7fc0c2000640 1 -- 172.21.15.42:0/144760609 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc0bc042070 con 0x7fc0c80d4110 2024-09-17T01:35:57.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.489+0000 7fc0c2000640 1 --2- 172.21.15.42:0/144760609 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc0ac078bc0 0x7fc0ac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:57.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.489+0000 7fc0c2000640 1 -- 172.21.15.42:0/144760609 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5940+0+0 (secure 0 0 0) 0x7fc0bc0bacc0 con 0x7fc0c80d4110 2024-09-17T01:35:57.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.490+0000 7fc0cd400640 1 --2- 172.21.15.42:0/144760609 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc0ac078bc0 0x7fc0ac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:57.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.490+0000 7fc0cd400640 1 --2- 172.21.15.42:0/144760609 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc0ac078bc0 0x7fc0ac07b0d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8001eb0 tx=0x7fc0b8009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:57.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.494+0000 7fc0c2000640 1 -- 172.21.15.42:0/144760609 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc0c80d0940 con 0x7fc0c80d4110 2024-09-17T01:35:57.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:57.727+0000 7fc0d0800640 1 -- 172.21.15.42:0/144760609 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc0c80d2f70 con 0x7fc0c80d4110 2024-09-17T01:35:58.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.220+0000 7fc0c2000640 1 -- 172.21.15.42:0/144760609 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) ==== 104+0+0 (secure 0 0 0) 0x7fc0bc0c1080 con 0x7fc0c80d4110 2024-09-17T01:35:58.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.223+0000 7fc0d0800640 1 -- 172.21.15.42:0/144760609 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc0ac078bc0 msgr2=0x7fc0ac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:58.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.223+0000 7fc0d0800640 1 --2- 172.21.15.42:0/144760609 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc0ac078bc0 0x7fc0ac07b0d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8001eb0 tx=0x7fc0b8009040 comp rx=0 tx=0).stop 2024-09-17T01:35:58.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.223+0000 7fc0d0800640 1 -- 172.21.15.42:0/144760609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0c80d4110 msgr2=0x7fc0c81574f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:58.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.223+0000 7fc0d0800640 1 --2- 172.21.15.42:0/144760609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0c80d4110 0x7fc0c81574f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc02a970 tx=0x7fc0bc003b60 comp rx=0 tx=0).stop 2024-09-17T01:35:58.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.223+0000 7fc0d0800640 1 -- 172.21.15.42:0/144760609 shutdown_connections 2024-09-17T01:35:58.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.223+0000 7fc0d0800640 1 --2- 172.21.15.42:0/144760609 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc0ac078bc0 0x7fc0ac07b0d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:58.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.223+0000 7fc0d0800640 1 --2- 172.21.15.42:0/144760609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0c815f000 0x7fc0c815c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:58.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.223+0000 7fc0d0800640 1 --2- 172.21.15.42:0/144760609 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc0c8157fc0 0x7fc0c815d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:58.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.223+0000 7fc0d0800640 1 --2- 172.21.15.42:0/144760609 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0c80d4110 0x7fc0c81574f0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:58.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.223+0000 7fc0d0800640 1 -- 172.21.15.42:0/144760609 >> 172.21.15.42:0/144760609 conn(0x7fc0c806d140 msgr2=0x7fc0c80b9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:58.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.224+0000 7fc0d0800640 1 -- 172.21.15.42:0/144760609 shutdown_connections 2024-09-17T01:35:58.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.224+0000 7fc0d0800640 1 -- 172.21.15.42:0/144760609 wait complete. 2024-09-17T01:35:58.247 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T01:35:58.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.480+0000 7ff219600640 1 -- 172.21.15.42:0/110233712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2140cdb20 msgr2=0x7ff2140cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:58.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.480+0000 7ff219600640 1 --2- 172.21.15.42:0/110233712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2140cdb20 0x7ff2140cdf30 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ff2140747b0 tx=0x7ff20002a560 comp rx=0 tx=0).stop 2024-09-17T01:35:58.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.480+0000 7ff219600640 1 -- 172.21.15.42:0/110233712 shutdown_connections 2024-09-17T01:35:58.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.480+0000 7ff219600640 1 --2- 172.21.15.42:0/110233712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2140cdb20 0x7ff2140cdf30 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:58.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.480+0000 7ff219600640 1 --2- 172.21.15.42:0/110233712 >> v2:172.21.15.43:3300/0 conn(0x7ff2140b56d0 0x7ff2140b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:58.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.480+0000 7ff219600640 1 -- 172.21.15.42:0/110233712 >> 172.21.15.42:0/110233712 conn(0x7ff2140b28f0 msgr2=0x7ff21406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:58.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.481+0000 7ff219600640 1 -- 172.21.15.42:0/110233712 shutdown_connections 2024-09-17T01:35:58.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.481+0000 7ff219600640 1 -- 172.21.15.42:0/110233712 wait complete. 2024-09-17T01:35:58.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.483+0000 7ff219600640 1 Processor -- start 2024-09-17T01:35:58.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.483+0000 7ff219600640 1 -- start start 2024-09-17T01:35:58.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.484+0000 7ff219600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff21406d430 0x7ff214142fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:58.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.484+0000 7ff219600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2140b56d0 0x7ff2141f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:58.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.484+0000 7ff219600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2140cdb20 0x7ff2141f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:58.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.484+0000 7ff219600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff21415d560 con 0x7ff2140b56d0 2024-09-17T01:35:58.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.484+0000 7ff219600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff21415d3e0 con 0x7ff2140cdb20 2024-09-17T01:35:58.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.484+0000 7ff219600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff21415d6e0 con 0x7ff21406d430 2024-09-17T01:35:58.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.485+0000 7ff212000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2140b56d0 0x7ff2141f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:58.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.485+0000 7ff212000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2140b56d0 0x7ff2141f5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59642/0 (socket says 172.21.15.42:59642) 2024-09-17T01:35:58.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.485+0000 7ff212000640 1 -- 172.21.15.42:0/3638885036 learned_addr learned my addr 172.21.15.42:0/3638885036 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:58.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.485+0000 7ff212a00640 1 --2- 172.21.15.42:0/3638885036 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff21406d430 0x7ff214142fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:58.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.485+0000 7ff213400640 1 --2- 172.21.15.42:0/3638885036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2140cdb20 0x7ff2141f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:58.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.485+0000 7ff212000640 1 -- 172.21.15.42:0/3638885036 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff21406d430 msgr2=0x7ff214142fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:58.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.485+0000 7ff212000640 1 --2- 172.21.15.42:0/3638885036 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff21406d430 0x7ff214142fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:58.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.485+0000 7ff212000640 1 -- 172.21.15.42:0/3638885036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2140cdb20 msgr2=0x7ff2141f60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:58.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.485+0000 7ff212000640 1 --2- 172.21.15.42:0/3638885036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2140cdb20 0x7ff2141f60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:58.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.485+0000 7ff212000640 1 -- 172.21.15.42:0/3638885036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2141e77a0 con 0x7ff2140b56d0 2024-09-17T01:35:58.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.485+0000 7ff212000640 1 --2- 172.21.15.42:0/3638885036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2140b56d0 0x7ff2141f5b80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff200034040 tx=0x7ff2000039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:58.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.486+0000 7ff20aa00640 1 -- 172.21.15.42:0/3638885036 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20003e030 con 0x7ff2140b56d0 2024-09-17T01:35:58.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.486+0000 7ff20aa00640 1 -- 172.21.15.42:0/3638885036 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2000047a0 con 0x7ff2140b56d0 2024-09-17T01:35:58.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.486+0000 7ff20aa00640 1 -- 172.21.15.42:0/3638885036 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff200035040 con 0x7ff2140b56d0 2024-09-17T01:35:58.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.486+0000 7ff219600640 1 -- 172.21.15.42:0/3638885036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2141434f0 con 0x7ff2140b56d0 2024-09-17T01:35:58.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.486+0000 7ff219600640 1 -- 172.21.15.42:0/3638885036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2140c5f40 con 0x7ff2140b56d0 2024-09-17T01:35:58.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.487+0000 7ff219600640 1 -- 172.21.15.42:0/3638885036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff21415dc00 con 0x7ff2140b56d0 2024-09-17T01:35:58.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.488+0000 7ff20aa00640 1 -- 172.21.15.42:0/3638885036 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff200041030 con 0x7ff2140b56d0 2024-09-17T01:35:58.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.490+0000 7ff20aa00640 1 --2- 172.21.15.42:0/3638885036 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff1f4078bc0 0x7ff1f407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:58.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.490+0000 7ff20aa00640 1 -- 172.21.15.42:0/3638885036 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5940+0+0 (secure 0 0 0) 0x7ff2000bb690 con 0x7ff2140b56d0 2024-09-17T01:35:58.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.490+0000 7ff212a00640 1 --2- 172.21.15.42:0/3638885036 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff1f4078bc0 0x7ff1f407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:58.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.491+0000 7ff212a00640 1 --2- 172.21.15.42:0/3638885036 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff1f4078bc0 0x7ff1f407b0d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff204005fd0 tx=0x7ff204005850 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:58.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.494+0000 7ff20aa00640 1 -- 172.21.15.42:0/3638885036 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff2000839d0 con 0x7ff2140b56d0 2024-09-17T01:35:58.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:58.691+0000 7ff219600640 1 -- 172.21.15.42:0/3638885036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff2140af820 con 0x7ff2140b56d0 2024-09-17T01:35:59.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.222+0000 7ff20aa00640 1 -- 172.21.15.42:0/3638885036 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) ==== 181+0+0 (secure 0 0 0) 0x7ff2000832d0 con 0x7ff2140b56d0 2024-09-17T01:35:59.220 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-09-17T01:35:59.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.226+0000 7ff219600640 1 -- 172.21.15.42:0/3638885036 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff1f4078bc0 msgr2=0x7ff1f407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:59.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.226+0000 7ff219600640 1 --2- 172.21.15.42:0/3638885036 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff1f4078bc0 0x7ff1f407b0d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff204005fd0 tx=0x7ff204005850 comp rx=0 tx=0).stop 2024-09-17T01:35:59.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.226+0000 7ff219600640 1 -- 172.21.15.42:0/3638885036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2140b56d0 msgr2=0x7ff2141f5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:59.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.226+0000 7ff219600640 1 --2- 172.21.15.42:0/3638885036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2140b56d0 0x7ff2141f5b80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff200034040 tx=0x7ff2000039e0 comp rx=0 tx=0).stop 2024-09-17T01:35:59.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.226+0000 7ff219600640 1 -- 172.21.15.42:0/3638885036 shutdown_connections 2024-09-17T01:35:59.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.227+0000 7ff219600640 1 --2- 172.21.15.42:0/3638885036 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff1f4078bc0 0x7ff1f407b0d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:59.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.227+0000 7ff219600640 1 --2- 172.21.15.42:0/3638885036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2140cdb20 0x7ff2141f60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:59.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.227+0000 7ff219600640 1 --2- 172.21.15.42:0/3638885036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2140b56d0 0x7ff2141f5b80 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:59.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.227+0000 7ff219600640 1 --2- 172.21.15.42:0/3638885036 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff21406d430 0x7ff214142fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:59.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.227+0000 7ff219600640 1 -- 172.21.15.42:0/3638885036 >> 172.21.15.42:0/3638885036 conn(0x7ff2140b28f0 msgr2=0x7ff2140b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:59.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.227+0000 7ff219600640 1 -- 172.21.15.42:0/3638885036 shutdown_connections 2024-09-17T01:35:59.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.227+0000 7ff219600640 1 -- 172.21.15.42:0/3638885036 wait complete. 2024-09-17T01:35:59.252 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T01:35:59.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.484+0000 7fa374a00640 1 -- 172.21.15.42:0/1692555344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3700b56d0 msgr2=0x7fa3700b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:59.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.484+0000 7fa374a00640 1 --2- 172.21.15.42:0/1692555344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3700b56d0 0x7fa3700b46f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa360005fd0 tx=0x7fa36002a5d0 comp rx=0 tx=0).stop 2024-09-17T01:35:59.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.484+0000 7fa374a00640 1 -- 172.21.15.42:0/1692555344 shutdown_connections 2024-09-17T01:35:59.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.484+0000 7fa374a00640 1 --2- 172.21.15.42:0/1692555344 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa3700cdb20 0x7fa3700cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:59.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.484+0000 7fa374a00640 1 --2- 172.21.15.42:0/1692555344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3700b56d0 0x7fa3700b46f0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:59.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.484+0000 7fa374a00640 1 -- 172.21.15.42:0/1692555344 >> 172.21.15.42:0/1692555344 conn(0x7fa3700b28f0 msgr2=0x7fa37006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:59.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.484+0000 7fa374a00640 1 -- 172.21.15.42:0/1692555344 shutdown_connections 2024-09-17T01:35:59.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.484+0000 7fa374a00640 1 -- 172.21.15.42:0/1692555344 wait complete. 2024-09-17T01:35:59.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.487+0000 7fa374a00640 1 Processor -- start 2024-09-17T01:35:59.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.487+0000 7fa374a00640 1 -- start start 2024-09-17T01:35:59.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.488+0000 7fa374a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa37006d430 0x7fa37015c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:59.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.488+0000 7fa374a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3700b56d0 0x7fa370139610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:59.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.488+0000 7fa374a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa3700cdb20 0x7fa370139b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:59.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.488+0000 7fa374a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa37015d560 con 0x7fa37006d430 2024-09-17T01:35:59.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.488+0000 7fa374a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa37015d3e0 con 0x7fa3700b56d0 2024-09-17T01:35:59.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.488+0000 7fa374a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa37015d6e0 con 0x7fa3700cdb20 2024-09-17T01:35:59.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.489+0000 7fa36de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa37006d430 0x7fa37015c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:59.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.489+0000 7fa36de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa37006d430 0x7fa37015c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59660/0 (socket says 172.21.15.42:59660) 2024-09-17T01:35:59.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.489+0000 7fa36de00640 1 -- 172.21.15.42:0/1555608716 learned_addr learned my addr 172.21.15.42:0/1555608716 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:35:59.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.489+0000 7fa367e00640 1 --2- 172.21.15.42:0/1555608716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3700b56d0 0x7fa370139610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:59.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.489+0000 7fa36e800640 1 --2- 172.21.15.42:0/1555608716 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa3700cdb20 0x7fa370139b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:59.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.489+0000 7fa36de00640 1 -- 172.21.15.42:0/1555608716 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa3700cdb20 msgr2=0x7fa370139b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:59.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.489+0000 7fa36de00640 1 --2- 172.21.15.42:0/1555608716 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa3700cdb20 0x7fa370139b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:59.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.489+0000 7fa36de00640 1 -- 172.21.15.42:0/1555608716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3700b56d0 msgr2=0x7fa370139610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:59.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.489+0000 7fa36de00640 1 --2- 172.21.15.42:0/1555608716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3700b56d0 0x7fa370139610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:59.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.489+0000 7fa36de00640 1 -- 172.21.15.42:0/1555608716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa370074430 con 0x7fa37006d430 2024-09-17T01:35:59.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.489+0000 7fa36de00640 1 --2- 172.21.15.42:0/1555608716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa37006d430 0x7fa37015c540 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa360034040 tx=0x7fa3600038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:59.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.490+0000 7fa366000640 1 -- 172.21.15.42:0/1555608716 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36003e030 con 0x7fa37006d430 2024-09-17T01:35:59.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.490+0000 7fa366000640 1 -- 172.21.15.42:0/1555608716 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa360003ca0 con 0x7fa37006d430 2024-09-17T01:35:59.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.490+0000 7fa366000640 1 -- 172.21.15.42:0/1555608716 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa360035040 con 0x7fa37006d430 2024-09-17T01:35:59.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.490+0000 7fa374a00640 1 -- 172.21.15.42:0/1555608716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa370073b90 con 0x7fa37006d430 2024-09-17T01:35:59.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.490+0000 7fa374a00640 1 -- 172.21.15.42:0/1555608716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa370074150 con 0x7fa37006d430 2024-09-17T01:35:59.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.491+0000 7fa374a00640 1 -- 172.21.15.42:0/1555608716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa37015dc00 con 0x7fa37006d430 2024-09-17T01:35:59.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.492+0000 7fa366000640 1 -- 172.21.15.42:0/1555608716 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa360041030 con 0x7fa37006d430 2024-09-17T01:35:59.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.493+0000 7fa366000640 1 --2- 172.21.15.42:0/1555608716 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa34c078b90 0x7fa34c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:59.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.493+0000 7fa366000640 1 -- 172.21.15.42:0/1555608716 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5502+0+0 (secure 0 0 0) 0x7fa3600bb130 con 0x7fa37006d430 2024-09-17T01:35:59.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.494+0000 7fa367e00640 1 --2- 172.21.15.42:0/1555608716 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa34c078b90 0x7fa34c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:59.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.495+0000 7fa367e00640 1 --2- 172.21.15.42:0/1555608716 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa34c078b90 0x7fa34c07b0a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa3700725f0 tx=0x7fa35800b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:59.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.498+0000 7fa366000640 1 -- 172.21.15.42:0/1555608716 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa360082ff0 con 0x7fa37006d430 2024-09-17T01:35:59.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:35:59.695+0000 7fa374a00640 1 -- 172.21.15.42:0/1555608716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa370076040 con 0x7fa37006d430 2024-09-17T01:36:00.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.229+0000 7fa366000640 1 -- 172.21.15.42:0/1555608716 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) ==== 169+0+0 (secure 0 0 0) 0x7fa360087a20 con 0x7fa37006d430 2024-09-17T01:36:00.227 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-09-17T01:36:00.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.234+0000 7fa374a00640 1 -- 172.21.15.42:0/1555608716 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa34c078b90 msgr2=0x7fa34c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:00.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.234+0000 7fa374a00640 1 --2- 172.21.15.42:0/1555608716 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa34c078b90 0x7fa34c07b0a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa3700725f0 tx=0x7fa35800b2e0 comp rx=0 tx=0).stop 2024-09-17T01:36:00.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.234+0000 7fa374a00640 1 -- 172.21.15.42:0/1555608716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa37006d430 msgr2=0x7fa37015c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:00.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.234+0000 7fa374a00640 1 --2- 172.21.15.42:0/1555608716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa37006d430 0x7fa37015c540 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa360034040 tx=0x7fa3600038a0 comp rx=0 tx=0).stop 2024-09-17T01:36:00.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.234+0000 7fa374a00640 1 -- 172.21.15.42:0/1555608716 shutdown_connections 2024-09-17T01:36:00.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.234+0000 7fa374a00640 1 --2- 172.21.15.42:0/1555608716 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa34c078b90 0x7fa34c07b0a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:00.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.234+0000 7fa374a00640 1 --2- 172.21.15.42:0/1555608716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3700b56d0 0x7fa370139610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:00.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.234+0000 7fa374a00640 1 --2- 172.21.15.42:0/1555608716 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa3700cdb20 0x7fa370139b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:00.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.234+0000 7fa374a00640 1 --2- 172.21.15.42:0/1555608716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa37006d430 0x7fa37015c540 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:00.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.234+0000 7fa374a00640 1 -- 172.21.15.42:0/1555608716 >> 172.21.15.42:0/1555608716 conn(0x7fa3700b28f0 msgr2=0x7fa370145db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:00.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.234+0000 7fa374a00640 1 -- 172.21.15.42:0/1555608716 shutdown_connections 2024-09-17T01:36:00.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.234+0000 7fa374a00640 1 -- 172.21.15.42:0/1555608716 wait complete. 2024-09-17T01:36:00.257 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T01:36:00.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.504+0000 7f23fe400640 1 -- 172.21.15.42:0/1881754761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23dc003a00 msgr2=0x7f23dc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:00.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.504+0000 7f23fe400640 1 --2- 172.21.15.42:0/1881754761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23dc003a00 0x7f23dc003e70 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f23e8009b50 tx=0x7f23dc005830 comp rx=0 tx=0).stop 2024-09-17T01:36:00.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.504+0000 7f23f7e00640 1 -- 172.21.15.42:0/1881754761 reap_dead start 2024-09-17T01:36:00.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.504+0000 7f23fe400640 1 -- 172.21.15.42:0/1881754761 shutdown_connections 2024-09-17T01:36:00.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.504+0000 7f23fe400640 1 -- 172.21.15.42:0/1881754761 >> 172.21.15.42:0/1881754761 conn(0x7f23f80b2930 msgr2=0x7f23f806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:00.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.504+0000 7f23fe400640 1 -- 172.21.15.42:0/1881754761 shutdown_connections 2024-09-17T01:36:00.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.504+0000 7f23fe400640 1 -- 172.21.15.42:0/1881754761 wait complete. 2024-09-17T01:36:00.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.506+0000 7f23fe400640 1 Processor -- start 2024-09-17T01:36:00.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.507+0000 7f23fe400640 1 -- start start 2024-09-17T01:36:00.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.508+0000 7f23fe400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23dc003a00 0x7f23f8145f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:00.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.508+0000 7f23fe400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23f81472f0 0x7f23f81f5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:00.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.508+0000 7f23fe400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23f81f5760 0x7f23f80cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:00.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.508+0000 7f23fe400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f23f806d840 con 0x7f23dc003a00 2024-09-17T01:36:00.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.508+0000 7f23fe400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f23f815d5e0 con 0x7f23f81f5760 2024-09-17T01:36:00.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.508+0000 7f23fe400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f23f806d9c0 con 0x7f23f81472f0 2024-09-17T01:36:00.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.508+0000 7f23f7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23dc003a00 0x7f23f8145f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:00.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.508+0000 7f23f7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23dc003a00 0x7f23f8145f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59682/0 (socket says 172.21.15.42:59682) 2024-09-17T01:36:00.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.508+0000 7f23f7400640 1 -- 172.21.15.42:0/4222451299 learned_addr learned my addr 172.21.15.42:0/4222451299 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:00.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.509+0000 7f23eea00640 1 --2- 172.21.15.42:0/4222451299 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23f81472f0 0x7f23f81f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:00.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.509+0000 7f23f7e00640 1 --2- 172.21.15.42:0/4222451299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23f81f5760 0x7f23f80cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:00.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.509+0000 7f23f7400640 1 -- 172.21.15.42:0/4222451299 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23f81472f0 msgr2=0x7f23f81f5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:00.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.509+0000 7f23f7400640 1 --2- 172.21.15.42:0/4222451299 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23f81472f0 0x7f23f81f5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:00.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.509+0000 7f23f7400640 1 -- 172.21.15.42:0/4222451299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23f81f5760 msgr2=0x7f23f80cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:00.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.509+0000 7f23f7400640 1 --2- 172.21.15.42:0/4222451299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23f81f5760 0x7f23f80cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:00.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.509+0000 7f23f7400640 1 -- 172.21.15.42:0/4222451299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f81f5f10 con 0x7f23dc003a00 2024-09-17T01:36:00.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.509+0000 7f23f7400640 1 --2- 172.21.15.42:0/4222451299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23dc003a00 0x7f23f8145f60 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f23e8009a70 tx=0x7f23e8009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:00.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.510+0000 7f23efe00640 1 -- 172.21.15.42:0/4222451299 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e8038050 con 0x7f23dc003a00 2024-09-17T01:36:00.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.510+0000 7f23efe00640 1 -- 172.21.15.42:0/4222451299 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23e8039040 con 0x7f23dc003a00 2024-09-17T01:36:00.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.510+0000 7f23efe00640 1 -- 172.21.15.42:0/4222451299 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e8033e40 con 0x7f23dc003a00 2024-09-17T01:36:00.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.510+0000 7f23fe400640 1 -- 172.21.15.42:0/4222451299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23f8146810 con 0x7f23dc003a00 2024-09-17T01:36:00.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.510+0000 7f23fe400640 1 -- 172.21.15.42:0/4222451299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23f81464a0 con 0x7f23dc003a00 2024-09-17T01:36:00.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.511+0000 7f23fe400640 1 -- 172.21.15.42:0/4222451299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23f80af980 con 0x7f23dc003a00 2024-09-17T01:36:00.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.512+0000 7f23efe00640 1 -- 172.21.15.42:0/4222451299 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f23e802b8c0 con 0x7f23dc003a00 2024-09-17T01:36:00.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.513+0000 7f23efe00640 1 --2- 172.21.15.42:0/4222451299 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f23d4078b90 0x7f23d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:00.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.513+0000 7f23efe00640 1 -- 172.21.15.42:0/4222451299 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f23e80bbac0 con 0x7f23dc003a00 2024-09-17T01:36:00.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.514+0000 7f23eea00640 1 --2- 172.21.15.42:0/4222451299 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f23d4078b90 0x7f23d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:00.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.515+0000 7f23eea00640 1 --2- 172.21.15.42:0/4222451299 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f23d4078b90 0x7f23d407b0a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f23e0001880 tx=0x7f23e0006040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:00.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.517+0000 7f23efe00640 1 -- 172.21.15.42:0/4222451299 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f23e8083c40 con 0x7f23dc003a00 2024-09-17T01:36:00.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.712+0000 7f23fe400640 1 -- 172.21.15.42:0/4222451299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f23f806a170 con 0x7f23dc003a00 2024-09-17T01:36:00.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.716+0000 7f23efe00640 1 -- 172.21.15.42:0/4222451299 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v35) ==== 71+0+0 (secure 0 0 0) 0x7f23e8088670 con 0x7f23dc003a00 2024-09-17T01:36:00.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.719+0000 7f23fe400640 1 -- 172.21.15.42:0/4222451299 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f23d4078b90 msgr2=0x7f23d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:00.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.719+0000 7f23fe400640 1 --2- 172.21.15.42:0/4222451299 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f23d4078b90 0x7f23d407b0a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f23e0001880 tx=0x7f23e0006040 comp rx=0 tx=0).stop 2024-09-17T01:36:00.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.719+0000 7f23fe400640 1 -- 172.21.15.42:0/4222451299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23dc003a00 msgr2=0x7f23f8145f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:00.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.719+0000 7f23fe400640 1 --2- 172.21.15.42:0/4222451299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23dc003a00 0x7f23f8145f60 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f23e8009a70 tx=0x7f23e8009850 comp rx=0 tx=0).stop 2024-09-17T01:36:00.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.719+0000 7f23fe400640 1 -- 172.21.15.42:0/4222451299 shutdown_connections 2024-09-17T01:36:00.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.719+0000 7f23fe400640 1 --2- 172.21.15.42:0/4222451299 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f23d4078b90 0x7f23d407b0a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:00.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.719+0000 7f23fe400640 1 --2- 172.21.15.42:0/4222451299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23f81f5760 0x7f23f80cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:00.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.719+0000 7f23fe400640 1 --2- 172.21.15.42:0/4222451299 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23f81472f0 0x7f23f81f5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:00.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.719+0000 7f23fe400640 1 --2- 172.21.15.42:0/4222451299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23dc003a00 0x7f23f8145f60 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:00.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.719+0000 7f23fe400640 1 -- 172.21.15.42:0/4222451299 >> 172.21.15.42:0/4222451299 conn(0x7f23f80b2930 msgr2=0x7f23f80b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:00.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.719+0000 7f23fe400640 1 -- 172.21.15.42:0/4222451299 shutdown_connections 2024-09-17T01:36:00.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.719+0000 7f23fe400640 1 -- 172.21.15.42:0/4222451299 wait complete. 2024-09-17T01:36:00.738 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-09-17T01:36:00.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.966+0000 7f539b400640 1 -- 172.21.15.42:0/3861108060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53940cf250 msgr2=0x7f53940b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:00.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.966+0000 7f539b400640 1 --2- 172.21.15.42:0/3861108060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53940cf250 0x7f53940b5060 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f5380005fd0 tx=0x7f538002a670 comp rx=0 tx=0).stop 2024-09-17T01:36:00.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.966+0000 7f539b400640 1 -- 172.21.15.42:0/3861108060 shutdown_connections 2024-09-17T01:36:00.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.966+0000 7f539b400640 1 --2- 172.21.15.42:0/3861108060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53940cf250 0x7f53940b5060 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:00.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.966+0000 7f539b400640 1 -- 172.21.15.42:0/3861108060 >> 172.21.15.42:0/3861108060 conn(0x7f53940746c0 msgr2=0x7f539406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:00.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.966+0000 7f539b400640 1 -- 172.21.15.42:0/3861108060 shutdown_connections 2024-09-17T01:36:00.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.966+0000 7f539b400640 1 -- 172.21.15.42:0/3861108060 wait complete. 2024-09-17T01:36:00.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.968+0000 7f539b400640 1 Processor -- start 2024-09-17T01:36:00.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.968+0000 7f539b400640 1 -- start start 2024-09-17T01:36:00.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.970+0000 7f539b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53940b55a0 0x7f5394144490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:00.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.970+0000 7f539b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53940cf250 0x7f53940acab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:00.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.970+0000 7f539b400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53940d12a0 0x7f539414a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:00.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.970+0000 7f539b400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f53940b5f70 con 0x7f53940b55a0 2024-09-17T01:36:00.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.970+0000 7f539b400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f53940b5df0 con 0x7f53940cf250 2024-09-17T01:36:00.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.970+0000 7f539b400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f53940b60f0 con 0x7f53940d12a0 2024-09-17T01:36:00.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.970+0000 7f5398a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53940b55a0 0x7f5394144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:00.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.970+0000 7f5398a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53940b55a0 0x7f5394144490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59706/0 (socket says 172.21.15.42:59706) 2024-09-17T01:36:00.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.970+0000 7f5398a00640 1 -- 172.21.15.42:0/943440504 learned_addr learned my addr 172.21.15.42:0/943440504 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:00.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.970+0000 7f5393e00640 1 --2- 172.21.15.42:0/943440504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53940cf250 0x7f53940acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:00.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.970+0000 7f5398a00640 1 -- 172.21.15.42:0/943440504 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53940d12a0 msgr2=0x7f539414a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:00.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.970+0000 7f5398a00640 1 --2- 172.21.15.42:0/943440504 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53940d12a0 0x7f539414a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:00.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.970+0000 7f5398a00640 1 -- 172.21.15.42:0/943440504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53940cf250 msgr2=0x7f53940acab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:00.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.970+0000 7f5398a00640 1 --2- 172.21.15.42:0/943440504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53940cf250 0x7f53940acab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:00.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.970+0000 7f5398a00640 1 -- 172.21.15.42:0/943440504 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53941449d0 con 0x7f53940b55a0 2024-09-17T01:36:00.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.971+0000 7f5398a00640 1 --2- 172.21.15.42:0/943440504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53940b55a0 0x7f5394144490 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f538800c3a0 tx=0x7f538800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:00.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.971+0000 7f5390c00640 1 -- 172.21.15.42:0/943440504 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5388017070 con 0x7f53940b55a0 2024-09-17T01:36:00.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.971+0000 7f5390c00640 1 -- 172.21.15.42:0/943440504 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53880053c0 con 0x7f53940b55a0 2024-09-17T01:36:00.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.971+0000 7f539b400640 1 -- 172.21.15.42:0/943440504 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5394154490 con 0x7f53940b55a0 2024-09-17T01:36:00.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.971+0000 7f5390c00640 1 -- 172.21.15.42:0/943440504 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5388003850 con 0x7f53940b55a0 2024-09-17T01:36:00.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.971+0000 7f539b400640 1 -- 172.21.15.42:0/943440504 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5394154a50 con 0x7f53940b55a0 2024-09-17T01:36:00.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.972+0000 7f539b400640 1 -- 172.21.15.42:0/943440504 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53940b6c60 con 0x7f53940b55a0 2024-09-17T01:36:00.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.974+0000 7f5390c00640 1 -- 172.21.15.42:0/943440504 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f538801a070 con 0x7f53940b55a0 2024-09-17T01:36:00.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.975+0000 7f5390c00640 1 --2- 172.21.15.42:0/943440504 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5374078b90 0x7f537407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:00.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.975+0000 7f5390c00640 1 -- 172.21.15.42:0/943440504 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f5388099ea0 con 0x7f53940b55a0 2024-09-17T01:36:00.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.976+0000 7f5393e00640 1 --2- 172.21.15.42:0/943440504 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5374078b90 0x7f537407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:00.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.976+0000 7f5393e00640 1 --2- 172.21.15.42:0/943440504 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5374078b90 0x7f537407b0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5380033000 tx=0x7f5380004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:00.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:00.980+0000 7f5390c00640 1 -- 172.21.15.42:0/943440504 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f53940b6c60 con 0x7f53940b55a0 2024-09-17T01:36:01.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:01.255+0000 7f539b400640 1 -- 172.21.15.42:0/943440504 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) -- 0x7f53940b5060 con 0x7f53940b55a0 2024-09-17T01:36:02.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.233+0000 7f5390c00640 1 -- 172.21.15.42:0/943440504 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v198) ==== 143+0+0 (secure 0 0 0) 0x7f5388062540 con 0x7f53940b55a0 2024-09-17T01:36:02.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.236+0000 7f539b400640 1 -- 172.21.15.42:0/943440504 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5374078b90 msgr2=0x7f537407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:02.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.236+0000 7f539b400640 1 --2- 172.21.15.42:0/943440504 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5374078b90 0x7f537407b0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5380033000 tx=0x7f5380004730 comp rx=0 tx=0).stop 2024-09-17T01:36:02.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.236+0000 7f539b400640 1 -- 172.21.15.42:0/943440504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53940b55a0 msgr2=0x7f5394144490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:02.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.236+0000 7f539b400640 1 --2- 172.21.15.42:0/943440504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53940b55a0 0x7f5394144490 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f538800c3a0 tx=0x7f538800c860 comp rx=0 tx=0).stop 2024-09-17T01:36:02.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.236+0000 7f539b400640 1 -- 172.21.15.42:0/943440504 shutdown_connections 2024-09-17T01:36:02.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.236+0000 7f539b400640 1 --2- 172.21.15.42:0/943440504 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5374078b90 0x7f537407b0a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:02.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.236+0000 7f539b400640 1 --2- 172.21.15.42:0/943440504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53940cf250 0x7f53940acab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:02.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.236+0000 7f539b400640 1 --2- 172.21.15.42:0/943440504 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53940d12a0 0x7f539414a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:02.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.236+0000 7f539b400640 1 --2- 172.21.15.42:0/943440504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53940b55a0 0x7f5394144490 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:02.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.236+0000 7f539b400640 1 -- 172.21.15.42:0/943440504 >> 172.21.15.42:0/943440504 conn(0x7f53940746c0 msgr2=0x7f539415f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:02.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.237+0000 7f539b400640 1 -- 172.21.15.42:0/943440504 shutdown_connections 2024-09-17T01:36:02.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.237+0000 7f539b400640 1 -- 172.21.15.42:0/943440504 wait complete. 2024-09-17T01:36:02.262 INFO:tasks.cephfs_test_runner:test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-09-17T01:36:02.263 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_merge_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) That a directory is merged during scrub. 2024-09-17T01:36:02.263 INFO:tasks.cephfs_test_runner:test_scrub_merge_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-17T01:36:02.263 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:36:02.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.497+0000 7ff2d4e00640 1 -- 172.21.15.42:0/3113963163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b4003a30 msgr2=0x7ff2b4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:02.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.497+0000 7ff2d4e00640 1 --2- 172.21.15.42:0/3113963163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b4003a30 0x7ff2b4003ea0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00016f0 tx=0x7ff2b4005830 comp rx=0 tx=0).stop 2024-09-17T01:36:02.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.497+0000 7ff2cfe00640 1 -- 172.21.15.42:0/3113963163 reap_dead start 2024-09-17T01:36:02.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.497+0000 7ff2d4e00640 1 -- 172.21.15.42:0/3113963163 shutdown_connections 2024-09-17T01:36:02.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.497+0000 7ff2d4e00640 1 -- 172.21.15.42:0/3113963163 >> 172.21.15.42:0/3113963163 conn(0x7ff2d00734a0 msgr2=0x7ff2d00b61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:02.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.497+0000 7ff2d4e00640 1 -- 172.21.15.42:0/3113963163 shutdown_connections 2024-09-17T01:36:02.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.497+0000 7ff2d4e00640 1 -- 172.21.15.42:0/3113963163 wait complete. 2024-09-17T01:36:02.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.500+0000 7ff2d4e00640 1 Processor -- start 2024-09-17T01:36:02.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.500+0000 7ff2d4e00640 1 -- start start 2024-09-17T01:36:02.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.501+0000 7ff2d4e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b4003a30 0x7ff2d0154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:02.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.501+0000 7ff2d4e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2d01f8b90 0x7ff2d01f8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:02.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.501+0000 7ff2d4e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2d01454c0 0x7ff2d01458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:02.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.501+0000 7ff2d4e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d0068d40 con 0x7ff2b4003a30 2024-09-17T01:36:02.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.501+0000 7ff2d4e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d00b1ac0 con 0x7ff2d01f8b90 2024-09-17T01:36:02.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.501+0000 7ff2d4e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff2d0068ec0 con 0x7ff2d01454c0 2024-09-17T01:36:02.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.501+0000 7ff2cf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b4003a30 0x7ff2d0154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:02.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.502+0000 7ff2cf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b4003a30 0x7ff2d0154190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59718/0 (socket says 172.21.15.42:59718) 2024-09-17T01:36:02.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.502+0000 7ff2cf400640 1 -- 172.21.15.42:0/1606317646 learned_addr learned my addr 172.21.15.42:0/1606317646 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:02.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.502+0000 7ff2cfe00640 1 --2- 172.21.15.42:0/1606317646 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2d01454c0 0x7ff2d01458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:02.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.502+0000 7ff2c6a00640 1 --2- 172.21.15.42:0/1606317646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2d01f8b90 0x7ff2d01f8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:02.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.502+0000 7ff2cf400640 1 -- 172.21.15.42:0/1606317646 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2d01454c0 msgr2=0x7ff2d01458d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:02.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.502+0000 7ff2cf400640 1 --2- 172.21.15.42:0/1606317646 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2d01454c0 0x7ff2d01458d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:02.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.502+0000 7ff2cf400640 1 -- 172.21.15.42:0/1606317646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2d01f8b90 msgr2=0x7ff2d01f8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:02.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.502+0000 7ff2cf400640 1 --2- 172.21.15.42:0/1606317646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2d01f8b90 0x7ff2d01f8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:02.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.502+0000 7ff2cf400640 1 -- 172.21.15.42:0/1606317646 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d0155b30 con 0x7ff2b4003a30 2024-09-17T01:36:02.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.502+0000 7ff2cf400640 1 --2- 172.21.15.42:0/1606317646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b4003a30 0x7ff2d0154190 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff2c002a990 tx=0x7ff2c0006310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:02.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.502+0000 7ff2c7e00640 1 -- 172.21.15.42:0/1606317646 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0041070 con 0x7ff2b4003a30 2024-09-17T01:36:02.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.503+0000 7ff2c7e00640 1 -- 172.21.15.42:0/1606317646 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2c0003af0 con 0x7ff2b4003a30 2024-09-17T01:36:02.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.503+0000 7ff2c7e00640 1 -- 172.21.15.42:0/1606317646 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0038070 con 0x7ff2b4003a30 2024-09-17T01:36:02.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.503+0000 7ff2d4e00640 1 -- 172.21.15.42:0/1606317646 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d0154a90 con 0x7ff2b4003a30 2024-09-17T01:36:02.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.503+0000 7ff2d4e00640 1 -- 172.21.15.42:0/1606317646 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d0155050 con 0x7ff2b4003a30 2024-09-17T01:36:02.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.504+0000 7ff2d4e00640 1 -- 172.21.15.42:0/1606317646 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2d0075280 con 0x7ff2b4003a30 2024-09-17T01:36:02.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.505+0000 7ff2c7e00640 1 -- 172.21.15.42:0/1606317646 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff2c0030070 con 0x7ff2b4003a30 2024-09-17T01:36:02.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.506+0000 7ff2c7e00640 1 --2- 172.21.15.42:0/1606317646 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff2ac078b90 0x7ff2ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:02.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.507+0000 7ff2c7e00640 1 -- 172.21.15.42:0/1606317646 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7ff2c00b9ff0 con 0x7ff2b4003a30 2024-09-17T01:36:02.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.507+0000 7ff2c6a00640 1 --2- 172.21.15.42:0/1606317646 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff2ac078b90 0x7ff2ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:02.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.508+0000 7ff2c6a00640 1 --2- 172.21.15.42:0/1606317646 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff2ac078b90 0x7ff2ac07b0a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff2d009f2c0 tx=0x7ff2b8005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:02.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.511+0000 7ff2c7e00640 1 -- 172.21.15.42:0/1606317646 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff2c0006500 con 0x7ff2b4003a30 2024-09-17T01:36:02.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.705+0000 7ff2d4e00640 1 -- 172.21.15.42:0/1606317646 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2d00b62d0 con 0x7ff2b4003a30 2024-09-17T01:36:02.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.706+0000 7ff2c7e00640 1 -- 172.21.15.42:0/1606317646 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+12984 (secure 0 0 0) 0x7ff2c00826b0 con 0x7ff2b4003a30 2024-09-17T01:36:02.704 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:02.704 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":54,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:36:00.223924+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6835/1094322669":"2024-09-18T01:35:57.217625+0000","172.21.15.42:6834/1094322669":"2024-09-18T01:35:57.217625+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:36:02.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.709+0000 7ff2d4e00640 1 -- 172.21.15.42:0/1606317646 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff2ac078b90 msgr2=0x7ff2ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:02.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.709+0000 7ff2d4e00640 1 --2- 172.21.15.42:0/1606317646 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff2ac078b90 0x7ff2ac07b0a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff2d009f2c0 tx=0x7ff2b8005f90 comp rx=0 tx=0).stop 2024-09-17T01:36:02.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.709+0000 7ff2d4e00640 1 -- 172.21.15.42:0/1606317646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b4003a30 msgr2=0x7ff2d0154190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:02.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.709+0000 7ff2d4e00640 1 --2- 172.21.15.42:0/1606317646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b4003a30 0x7ff2d0154190 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff2c002a990 tx=0x7ff2c0006310 comp rx=0 tx=0).stop 2024-09-17T01:36:02.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.709+0000 7ff2d4e00640 1 -- 172.21.15.42:0/1606317646 shutdown_connections 2024-09-17T01:36:02.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.709+0000 7ff2d4e00640 1 --2- 172.21.15.42:0/1606317646 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff2ac078b90 0x7ff2ac07b0a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:02.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.709+0000 7ff2d4e00640 1 --2- 172.21.15.42:0/1606317646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2d01f8b90 0x7ff2d01f8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:02.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.709+0000 7ff2d4e00640 1 --2- 172.21.15.42:0/1606317646 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2d01454c0 0x7ff2d01458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:02.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.709+0000 7ff2d4e00640 1 --2- 172.21.15.42:0/1606317646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b4003a30 0x7ff2d0154190 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:02.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.709+0000 7ff2d4e00640 1 -- 172.21.15.42:0/1606317646 >> 172.21.15.42:0/1606317646 conn(0x7ff2d00734a0 msgr2=0x7ff2d00afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:02.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.709+0000 7ff2d4e00640 1 -- 172.21.15.42:0/1606317646 shutdown_connections 2024-09-17T01:36:02.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.709+0000 7ff2d4e00640 1 -- 172.21.15.42:0/1606317646 wait complete. 2024-09-17T01:36:02.731 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T01:31:55.004951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T01:36:02.731 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T01:36:02.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.962+0000 7f77f6400640 1 -- 172.21.15.42:0/3300324659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77f00d14a0 msgr2=0x7f77f0162bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:02.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.962+0000 7f77f6400640 1 --2- 172.21.15.42:0/3300324659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77f00d14a0 0x7f77f0162bb0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f77f00d58f0 tx=0x7f77d802a5f0 comp rx=0 tx=0).stop 2024-09-17T01:36:02.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.962+0000 7f77f6400640 1 -- 172.21.15.42:0/3300324659 shutdown_connections 2024-09-17T01:36:02.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.962+0000 7f77f6400640 1 --2- 172.21.15.42:0/3300324659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77f00d14a0 0x7f77f0162bb0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:02.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.962+0000 7f77f6400640 1 --2- 172.21.15.42:0/3300324659 >> v2:172.21.15.43:3300/0 conn(0x7f77f0155dc0 0x7f77f00d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:02.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.962+0000 7f77f6400640 1 -- 172.21.15.42:0/3300324659 >> 172.21.15.42:0/3300324659 conn(0x7f77f006cd20 msgr2=0x7f77f006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:02.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.962+0000 7f77f6400640 1 -- 172.21.15.42:0/3300324659 shutdown_connections 2024-09-17T01:36:02.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.962+0000 7f77f6400640 1 -- 172.21.15.42:0/3300324659 wait complete. 2024-09-17T01:36:02.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.964+0000 7f77f6400640 1 Processor -- start 2024-09-17T01:36:02.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.964+0000 7f77f6400640 1 -- start start 2024-09-17T01:36:02.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.966+0000 7f77f6400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77f00d14a0 0x7f77f0153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:02.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.966+0000 7f77f6400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77f0155dc0 0x7f77f015bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:02.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.966+0000 7f77f6400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77f01630f0 0x7f77f015c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:02.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.966+0000 7f77f6400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f77f0163680 con 0x7f77f0155dc0 2024-09-17T01:36:02.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.966+0000 7f77f6400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f77f0163500 con 0x7f77f00d14a0 2024-09-17T01:36:02.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.966+0000 7f77f6400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f77f00b6a30 con 0x7f77f01630f0 2024-09-17T01:36:02.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.966+0000 7f77e7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77f0155dc0 0x7f77f015bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:02.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.966+0000 7f77e7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77f0155dc0 0x7f77f015bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59746/0 (socket says 172.21.15.42:59746) 2024-09-17T01:36:02.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.966+0000 7f77e7e00640 1 -- 172.21.15.42:0/2099870363 learned_addr learned my addr 172.21.15.42:0/2099870363 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:02.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.966+0000 7f77ef400640 1 --2- 172.21.15.42:0/2099870363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77f00d14a0 0x7f77f0153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:02.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.966+0000 7f77efe00640 1 --2- 172.21.15.42:0/2099870363 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77f01630f0 0x7f77f015c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:02.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.966+0000 7f77e7e00640 1 -- 172.21.15.42:0/2099870363 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77f01630f0 msgr2=0x7f77f015c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:02.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.966+0000 7f77e7e00640 1 --2- 172.21.15.42:0/2099870363 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77f01630f0 0x7f77f015c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:02.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.966+0000 7f77e7e00640 1 -- 172.21.15.42:0/2099870363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77f00d14a0 msgr2=0x7f77f0153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:02.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.966+0000 7f77e7e00640 1 --2- 172.21.15.42:0/2099870363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77f00d14a0 0x7f77f0153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:02.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.966+0000 7f77e7e00640 1 -- 172.21.15.42:0/2099870363 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f00cdd40 con 0x7f77f0155dc0 2024-09-17T01:36:02.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.966+0000 7f77ef400640 1 --2- 172.21.15.42:0/2099870363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77f00d14a0 0x7f77f0153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:36:02.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.967+0000 7f77e7e00640 1 --2- 172.21.15.42:0/2099870363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77f0155dc0 0x7f77f015bbb0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f77d8034040 tx=0x7f77d8003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:02.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.967+0000 7f77e7400640 1 -- 172.21.15.42:0/2099870363 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d803e030 con 0x7f77f0155dc0 2024-09-17T01:36:02.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.967+0000 7f77e7400640 1 -- 172.21.15.42:0/2099870363 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77d8003e00 con 0x7f77f0155dc0 2024-09-17T01:36:02.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.967+0000 7f77f6400640 1 -- 172.21.15.42:0/2099870363 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77f00ce020 con 0x7f77f0155dc0 2024-09-17T01:36:02.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.967+0000 7f77e7400640 1 -- 172.21.15.42:0/2099870363 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d8035040 con 0x7f77f0155dc0 2024-09-17T01:36:02.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.967+0000 7f77f6400640 1 -- 172.21.15.42:0/2099870363 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77f00ce5e0 con 0x7f77f0155dc0 2024-09-17T01:36:02.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.968+0000 7f77f6400640 1 -- 172.21.15.42:0/2099870363 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77f0159250 con 0x7f77f0155dc0 2024-09-17T01:36:02.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.969+0000 7f77e7400640 1 -- 172.21.15.42:0/2099870363 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f77d8041030 con 0x7f77f0155dc0 2024-09-17T01:36:02.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.970+0000 7f77e7400640 1 --2- 172.21.15.42:0/2099870363 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f77cc078bc0 0x7f77cc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:02.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.970+0000 7f77e7400640 1 -- 172.21.15.42:0/2099870363 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f77d80bb2b0 con 0x7f77f0155dc0 2024-09-17T01:36:02.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.971+0000 7f77ef400640 1 --2- 172.21.15.42:0/2099870363 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f77cc078bc0 0x7f77cc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:02.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.972+0000 7f77ef400640 1 --2- 172.21.15.42:0/2099870363 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f77cc078bc0 0x7f77cc07b0d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f77e0005fd0 tx=0x7f77e000f360 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:02.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:02.975+0000 7f77e7400640 1 -- 172.21.15.42:0/2099870363 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f77d8083950 con 0x7f77f0155dc0 2024-09-17T01:36:03.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.169+0000 7f77f6400640 1 -- 172.21.15.42:0/2099870363 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f77f00b6ef0 con 0x7f77f0155dc0 2024-09-17T01:36:03.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.169+0000 7f77e7400640 1 -- 172.21.15.42:0/2099870363 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) ==== 93+0+10 (secure 0 0 0) 0x7f77d8083250 con 0x7f77f0155dc0 2024-09-17T01:36:03.167 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-09-17T01:36:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.172+0000 7f77f6400640 1 -- 172.21.15.42:0/2099870363 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f77cc078bc0 msgr2=0x7f77cc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.172+0000 7f77f6400640 1 --2- 172.21.15.42:0/2099870363 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f77cc078bc0 0x7f77cc07b0d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f77e0005fd0 tx=0x7f77e000f360 comp rx=0 tx=0).stop 2024-09-17T01:36:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.172+0000 7f77f6400640 1 -- 172.21.15.42:0/2099870363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77f0155dc0 msgr2=0x7f77f015bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.172+0000 7f77f6400640 1 --2- 172.21.15.42:0/2099870363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77f0155dc0 0x7f77f015bbb0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f77d8034040 tx=0x7f77d8003910 comp rx=0 tx=0).stop 2024-09-17T01:36:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.172+0000 7f77f6400640 1 -- 172.21.15.42:0/2099870363 shutdown_connections 2024-09-17T01:36:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.172+0000 7f77f6400640 1 --2- 172.21.15.42:0/2099870363 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f77cc078bc0 0x7f77cc07b0d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.172+0000 7f77f6400640 1 --2- 172.21.15.42:0/2099870363 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77f01630f0 0x7f77f015c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.172+0000 7f77f6400640 1 --2- 172.21.15.42:0/2099870363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77f0155dc0 0x7f77f015bbb0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.172+0000 7f77f6400640 1 --2- 172.21.15.42:0/2099870363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77f00d14a0 0x7f77f0153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.172+0000 7f77f6400640 1 -- 172.21.15.42:0/2099870363 >> 172.21.15.42:0/2099870363 conn(0x7f77f006cd20 msgr2=0x7f77f00ba030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:03.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.172+0000 7f77f6400640 1 -- 172.21.15.42:0/2099870363 shutdown_connections 2024-09-17T01:36:03.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.172+0000 7f77f6400640 1 -- 172.21.15.42:0/2099870363 wait complete. 2024-09-17T01:36:03.191 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags' 2024-09-17T01:36:03.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.423+0000 7fb713000640 1 -- 172.21.15.42:0/4003937947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb70c0d0d80 msgr2=0x7fb70c06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:03.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.423+0000 7fb713000640 1 --2- 172.21.15.42:0/4003937947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb70c0d0d80 0x7fb70c06cd20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb700005fd0 tx=0x7fb70002a5d0 comp rx=0 tx=0).stop 2024-09-17T01:36:03.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.423+0000 7fb713000640 1 -- 172.21.15.42:0/4003937947 shutdown_connections 2024-09-17T01:36:03.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.423+0000 7fb713000640 1 --2- 172.21.15.42:0/4003937947 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb70c06d260 0x7fb70c0c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:03.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.423+0000 7fb713000640 1 --2- 172.21.15.42:0/4003937947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb70c0d0d80 0x7fb70c06cd20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:03.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.423+0000 7fb713000640 1 -- 172.21.15.42:0/4003937947 >> 172.21.15.42:0/4003937947 conn(0x7fb70c0b25f0 msgr2=0x7fb70c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:03.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.423+0000 7fb713000640 1 -- 172.21.15.42:0/4003937947 shutdown_connections 2024-09-17T01:36:03.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.423+0000 7fb713000640 1 -- 172.21.15.42:0/4003937947 wait complete. 2024-09-17T01:36:03.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.425+0000 7fb713000640 1 Processor -- start 2024-09-17T01:36:03.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.425+0000 7fb713000640 1 -- start start 2024-09-17T01:36:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.427+0000 7fb713000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb70c06d260 0x7fb70c15feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.427+0000 7fb713000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb70c0af460 0x7fb70c0b4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.427+0000 7fb713000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb70c0d0d80 0x7fb70c075e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.427+0000 7fb713000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c1632b0 con 0x7fb70c06d260 2024-09-17T01:36:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.427+0000 7fb713000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c163130 con 0x7fb70c0d0d80 2024-09-17T01:36:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.427+0000 7fb713000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb70c0ca070 con 0x7fb70c0af460 2024-09-17T01:36:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.427+0000 7fb711c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb70c06d260 0x7fb70c15feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.427+0000 7fb711c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb70c06d260 0x7fb70c15feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59748/0 (socket says 172.21.15.42:59748) 2024-09-17T01:36:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.427+0000 7fb711c00640 1 -- 172.21.15.42:0/386968676 learned_addr learned my addr 172.21.15.42:0/386968676 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.427+0000 7fb711200640 1 --2- 172.21.15.42:0/386968676 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb70c0af460 0x7fb70c0b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.427+0000 7fb712600640 1 --2- 172.21.15.42:0/386968676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb70c0d0d80 0x7fb70c075e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:03.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.428+0000 7fb711c00640 1 -- 172.21.15.42:0/386968676 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb70c0af460 msgr2=0x7fb70c0b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:03.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.428+0000 7fb711c00640 1 --2- 172.21.15.42:0/386968676 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb70c0af460 0x7fb70c0b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:03.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.428+0000 7fb711c00640 1 -- 172.21.15.42:0/386968676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb70c0d0d80 msgr2=0x7fb70c075e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:03.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.428+0000 7fb711c00640 1 --2- 172.21.15.42:0/386968676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb70c0d0d80 0x7fb70c075e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:03.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.428+0000 7fb711c00640 1 -- 172.21.15.42:0/386968676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70c073040 con 0x7fb70c06d260 2024-09-17T01:36:03.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.428+0000 7fb711c00640 1 --2- 172.21.15.42:0/386968676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb70c06d260 0x7fb70c15feb0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb700000c00 tx=0x7fb700005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:03.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.428+0000 7fb709600640 1 -- 172.21.15.42:0/386968676 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70003e030 con 0x7fb70c06d260 2024-09-17T01:36:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.428+0000 7fb709600640 1 -- 172.21.15.42:0/386968676 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb700003a90 con 0x7fb70c06d260 2024-09-17T01:36:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.428+0000 7fb713000640 1 -- 172.21.15.42:0/386968676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb70c0b3eb0 con 0x7fb70c06d260 2024-09-17T01:36:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.428+0000 7fb709600640 1 -- 172.21.15.42:0/386968676 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb700035040 con 0x7fb70c06d260 2024-09-17T01:36:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.428+0000 7fb713000640 1 -- 172.21.15.42:0/386968676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb70c0735c0 con 0x7fb70c06d260 2024-09-17T01:36:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.429+0000 7fb713000640 1 -- 172.21.15.42:0/386968676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb70c0b1030 con 0x7fb70c06d260 2024-09-17T01:36:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.431+0000 7fb709600640 1 -- 172.21.15.42:0/386968676 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb700041030 con 0x7fb70c06d260 2024-09-17T01:36:03.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.432+0000 7fb709600640 1 --2- 172.21.15.42:0/386968676 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb6ec078bc0 0x7fb6ec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:03.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.432+0000 7fb709600640 1 -- 172.21.15.42:0/386968676 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7fb7000badb0 con 0x7fb70c06d260 2024-09-17T01:36:03.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.433+0000 7fb711200640 1 --2- 172.21.15.42:0/386968676 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb6ec078bc0 0x7fb6ec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:03.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.434+0000 7fb711200640 1 --2- 172.21.15.42:0/386968676 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb6ec078bc0 0x7fb6ec07b0d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb70c1622a0 tx=0x7fb6f8009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:03.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.437+0000 7fb709600640 1 -- 172.21.15.42:0/386968676 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb70c0b1030 con 0x7fb70c06d260 2024-09-17T01:36:03.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:03.703+0000 7fb713000640 1 -- 172.21.15.42:0/386968676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]} v 0) -- 0x7fb70c15eb70 con 0x7fb70c06d260 2024-09-17T01:36:04.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.240+0000 7fb709600640 1 -- 172.21.15.42:0/386968676 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]}]=0 v200) ==== 154+0+0 (secure 0 0 0) 0x7fb7000bf070 con 0x7fb70c06d260 2024-09-17T01:36:04.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.243+0000 7fb713000640 1 -- 172.21.15.42:0/386968676 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb6ec078bc0 msgr2=0x7fb6ec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:04.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.243+0000 7fb713000640 1 --2- 172.21.15.42:0/386968676 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb6ec078bc0 0x7fb6ec07b0d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb70c1622a0 tx=0x7fb6f8009040 comp rx=0 tx=0).stop 2024-09-17T01:36:04.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.243+0000 7fb713000640 1 -- 172.21.15.42:0/386968676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb70c06d260 msgr2=0x7fb70c15feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:04.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.243+0000 7fb713000640 1 --2- 172.21.15.42:0/386968676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb70c06d260 0x7fb70c15feb0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb700000c00 tx=0x7fb700005770 comp rx=0 tx=0).stop 2024-09-17T01:36:04.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.243+0000 7fb713000640 1 -- 172.21.15.42:0/386968676 shutdown_connections 2024-09-17T01:36:04.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.243+0000 7fb713000640 1 --2- 172.21.15.42:0/386968676 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb6ec078bc0 0x7fb6ec07b0d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:04.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.243+0000 7fb713000640 1 --2- 172.21.15.42:0/386968676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb70c0d0d80 0x7fb70c075e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:04.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.243+0000 7fb713000640 1 --2- 172.21.15.42:0/386968676 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb70c0af460 0x7fb70c0b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:04.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.243+0000 7fb713000640 1 --2- 172.21.15.42:0/386968676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb70c06d260 0x7fb70c15feb0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:04.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.243+0000 7fb713000640 1 -- 172.21.15.42:0/386968676 >> 172.21.15.42:0/386968676 conn(0x7fb70c0b25f0 msgr2=0x7fb70c0cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:04.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.243+0000 7fb713000640 1 -- 172.21.15.42:0/386968676 shutdown_connections 2024-09-17T01:36:04.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.243+0000 7fb713000640 1 -- 172.21.15.42:0/386968676 wait complete. 2024-09-17T01:36:04.264 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T01:36:04.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.496+0000 7f74c9a00640 1 -- 172.21.15.42:0/3343038255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74a8005350 msgr2=0x7f74a800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:04.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.496+0000 7f74c9a00640 1 --2- 172.21.15.42:0/3343038255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74a8005350 0x7f74a800b9c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009ed0 tx=0x7f74a8005830 comp rx=0 tx=0).stop 2024-09-17T01:36:04.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.496+0000 7f74c9a00640 1 -- 172.21.15.42:0/3343038255 shutdown_connections 2024-09-17T01:36:04.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.496+0000 7f74c9a00640 1 --2- 172.21.15.42:0/3343038255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74a8005350 0x7f74a800b9c0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:04.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.496+0000 7f74c9a00640 1 -- 172.21.15.42:0/3343038255 >> 172.21.15.42:0/3343038255 conn(0x7f74c40b2930 msgr2=0x7f74c406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:04.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.496+0000 7f74c9a00640 1 -- 172.21.15.42:0/3343038255 shutdown_connections 2024-09-17T01:36:04.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.496+0000 7f74c9a00640 1 -- 172.21.15.42:0/3343038255 wait complete. 2024-09-17T01:36:04.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.499+0000 7f74c9a00640 1 Processor -- start 2024-09-17T01:36:04.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.499+0000 7f74c9a00640 1 -- start start 2024-09-17T01:36:04.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.500+0000 7f74c9a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74a8005350 0x7f74c406e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:04.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.500+0000 7f74c9a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74c406ec80 0x7f74c41f88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:04.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.500+0000 7f74c9a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74c41f8de0 0x7f74c41f6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:04.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.500+0000 7f74c9a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f74c415d040 con 0x7f74a8005350 2024-09-17T01:36:04.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.500+0000 7f74c9a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f74c415cec0 con 0x7f74c406ec80 2024-09-17T01:36:04.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.500+0000 7f74c9a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f74c415d1c0 con 0x7f74c41f8de0 2024-09-17T01:36:04.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.500+0000 7f74c2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74a8005350 0x7f74c406e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:04.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.500+0000 7f74c2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74a8005350 0x7f74c406e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59772/0 (socket says 172.21.15.42:59772) 2024-09-17T01:36:04.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.500+0000 7f74c2a00640 1 -- 172.21.15.42:0/956740081 learned_addr learned my addr 172.21.15.42:0/956740081 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:04.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.501+0000 7f74ba000640 1 --2- 172.21.15.42:0/956740081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74c406ec80 0x7f74c41f88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:04.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.501+0000 7f74c3400640 1 --2- 172.21.15.42:0/956740081 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74c41f8de0 0x7f74c41f6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:04.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.501+0000 7f74c2a00640 1 -- 172.21.15.42:0/956740081 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74c41f8de0 msgr2=0x7f74c41f6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:04.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.501+0000 7f74c2a00640 1 --2- 172.21.15.42:0/956740081 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74c41f8de0 0x7f74c41f6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:04.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.501+0000 7f74c2a00640 1 -- 172.21.15.42:0/956740081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74c406ec80 msgr2=0x7f74c41f88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:04.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.501+0000 7f74c2a00640 1 --2- 172.21.15.42:0/956740081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74c406ec80 0x7f74c41f88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:04.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.501+0000 7f74c2a00640 1 -- 172.21.15.42:0/956740081 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c41f91f0 con 0x7f74a8005350 2024-09-17T01:36:04.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.501+0000 7f74c2a00640 1 --2- 172.21.15.42:0/956740081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74a8005350 0x7f74c406e740 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f74b4006680 tx=0x7f74b40039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:04.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.501+0000 7f74bb400640 1 -- 172.21.15.42:0/956740081 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b4015020 con 0x7f74a8005350 2024-09-17T01:36:04.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.501+0000 7f74bb400640 1 -- 172.21.15.42:0/956740081 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74b4011900 con 0x7f74a8005350 2024-09-17T01:36:04.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.501+0000 7f74bb400640 1 -- 172.21.15.42:0/956740081 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b4011d50 con 0x7f74a8005350 2024-09-17T01:36:04.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.501+0000 7f74c9a00640 1 -- 172.21.15.42:0/956740081 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74c406f4e0 con 0x7f74a8005350 2024-09-17T01:36:04.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.502+0000 7f74c9a00640 1 -- 172.21.15.42:0/956740081 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74c406faa0 con 0x7f74a8005350 2024-09-17T01:36:04.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.503+0000 7f74c9a00640 1 -- 172.21.15.42:0/956740081 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74c415d550 con 0x7f74a8005350 2024-09-17T01:36:04.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.504+0000 7f74bb400640 1 -- 172.21.15.42:0/956740081 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f74b4018020 con 0x7f74a8005350 2024-09-17T01:36:04.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.505+0000 7f74bb400640 1 --2- 172.21.15.42:0/956740081 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74a0078bc0 0x7f74a007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:04.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.506+0000 7f74bb400640 1 -- 172.21.15.42:0/956740081 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f74b409b310 con 0x7f74a8005350 2024-09-17T01:36:04.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.506+0000 7f74ba000640 1 --2- 172.21.15.42:0/956740081 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74a0078bc0 0x7f74a007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:04.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.507+0000 7f74ba000640 1 --2- 172.21.15.42:0/956740081 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74a0078bc0 0x7f74a007b0d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f74ac000c00 tx=0x7f74ac006ae0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:04.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.510+0000 7f74bb400640 1 -- 172.21.15.42:0/956740081 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f74b401f030 con 0x7f74a8005350 2024-09-17T01:36:04.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.704+0000 7f74c9a00640 1 -- 172.21.15.42:0/956740081 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f74c406a170 con 0x7f74a8005350 2024-09-17T01:36:04.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.704+0000 7f74bb400640 1 -- 172.21.15.42:0/956740081 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v35) ==== 59+0+2294 (secure 0 0 0) 0x7f74c41f91f0 con 0x7f74a8005350 2024-09-17T01:36:04.702 INFO:teuthology.orchestra.run.smithi042.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T01:36:04.702 INFO:teuthology.orchestra.run.smithi042.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T01:36:04.702 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced client_mount_timeout 30 2024-09-17T01:36:04.702 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_client 20/20 2024-09-17T01:36:04.703 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_mgr 20/20 2024-09-17T01:36:04.703 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_ms 1/1 2024-09-17T01:36:04.703 INFO:teuthology.orchestra.run.smithi042.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T01:36:04.703 INFO:teuthology.orchestra.run.smithi042.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T01:36:04.703 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3683.959260 2024-09-17T01:36:04.703 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4350.010833 2024-09-17T01:36:04.703 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4316.776055 2024-09-17T01:36:04.703 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3885.595082 2024-09-17T01:36:04.703 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3602.000737 2024-09-17T01:36:04.703 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4883.364748 2024-09-17T01:36:04.703 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3752.484811 2024-09-17T01:36:04.703 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3775.035963 2024-09-17T01:36:04.703 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds 20/20 2024-09-17T01:36:04.704 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T01:36:04.704 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_ms 2/2 2024-09-17T01:36:04.704 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_frag true 2024-09-17T01:36:04.704 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_scatterstat true 2024-09-17T01:36:04.704 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T01:36:04.704 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_verify_scatter true 2024-09-17T01:36:04.704 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T01:36:04.704 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T01:36:04.704 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T01:36:04.704 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced client_mount_timeout 600 2024-09-17T01:36:04.704 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_client 20/20 2024-09-17T01:36:04.704 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_ms 1/1 2024-09-17T01:36:04.704 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T01:36:04.705 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T01:36:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.706+0000 7f74c9a00640 1 -- 172.21.15.42:0/956740081 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74a0078bc0 msgr2=0x7f74a007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.706+0000 7f74c9a00640 1 --2- 172.21.15.42:0/956740081 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74a0078bc0 0x7f74a007b0d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f74ac000c00 tx=0x7f74ac006ae0 comp rx=0 tx=0).stop 2024-09-17T01:36:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.707+0000 7f74c9a00640 1 -- 172.21.15.42:0/956740081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74a8005350 msgr2=0x7f74c406e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.707+0000 7f74c9a00640 1 --2- 172.21.15.42:0/956740081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74a8005350 0x7f74c406e740 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f74b4006680 tx=0x7f74b40039c0 comp rx=0 tx=0).stop 2024-09-17T01:36:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.707+0000 7f74c9a00640 1 -- 172.21.15.42:0/956740081 shutdown_connections 2024-09-17T01:36:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.707+0000 7f74c9a00640 1 --2- 172.21.15.42:0/956740081 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74a0078bc0 0x7f74a007b0d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.707+0000 7f74c9a00640 1 --2- 172.21.15.42:0/956740081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74c406ec80 0x7f74c41f88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.707+0000 7f74c9a00640 1 --2- 172.21.15.42:0/956740081 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74c41f8de0 0x7f74c41f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.707+0000 7f74c9a00640 1 --2- 172.21.15.42:0/956740081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74a8005350 0x7f74c406e740 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.707+0000 7f74c9a00640 1 -- 172.21.15.42:0/956740081 >> 172.21.15.42:0/956740081 conn(0x7f74c40b2930 msgr2=0x7f74c406d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.707+0000 7f74c9a00640 1 -- 172.21.15.42:0/956740081 shutdown_connections 2024-09-17T01:36:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.707+0000 7f74c9a00640 1 -- 172.21.15.42:0/956740081 wait complete. 2024-09-17T01:36:04.729 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T01:36:04.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.961+0000 7fa472000640 1 -- 172.21.15.42:0/1496261998 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa450003f90 msgr2=0x7fa450004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:04.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.961+0000 7fa472000640 1 --2- 172.21.15.42:0/1496261998 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa450003f90 0x7fa450004800 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa45800c290 tx=0x7fa450005830 comp rx=0 tx=0).stop 2024-09-17T01:36:04.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.961+0000 7fa46be00640 1 -- 172.21.15.42:0/1496261998 reap_dead start 2024-09-17T01:36:04.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.961+0000 7fa472000640 1 -- 172.21.15.42:0/1496261998 shutdown_connections 2024-09-17T01:36:04.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.961+0000 7fa472000640 1 -- 172.21.15.42:0/1496261998 >> 172.21.15.42:0/1496261998 conn(0x7fa46c0b2930 msgr2=0x7fa46c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:04.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.961+0000 7fa472000640 1 -- 172.21.15.42:0/1496261998 shutdown_connections 2024-09-17T01:36:04.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.961+0000 7fa472000640 1 -- 172.21.15.42:0/1496261998 wait complete. 2024-09-17T01:36:04.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.963+0000 7fa472000640 1 Processor -- start 2024-09-17T01:36:04.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.963+0000 7fa472000640 1 -- start start 2024-09-17T01:36:04.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.964+0000 7fa472000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa450003f90 0x7fa46c1595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:04.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.965+0000 7fa472000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa46c1f9680 0x7fa46c140160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:04.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.965+0000 7fa472000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa46c1f8ae0 0x7fa46c1f8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:04.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.965+0000 7fa472000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c0cf3e0 con 0x7fa46c1f8ae0 2024-09-17T01:36:04.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.965+0000 7fa472000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c0cf260 con 0x7fa46c1f9680 2024-09-17T01:36:04.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.965+0000 7fa472000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa46c0cf560 con 0x7fa450003f90 2024-09-17T01:36:04.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.965+0000 7fa46be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa46c1f8ae0 0x7fa46c1f8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:04.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.965+0000 7fa46be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa46c1f8ae0 0x7fa46c1f8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59790/0 (socket says 172.21.15.42:59790) 2024-09-17T01:36:04.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.965+0000 7fa46be00640 1 -- 172.21.15.42:0/2916585544 learned_addr learned my addr 172.21.15.42:0/2916585544 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:04.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.965+0000 7fa46b400640 1 --2- 172.21.15.42:0/2916585544 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa450003f90 0x7fa46c1595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:04.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.965+0000 7fa46aa00640 1 --2- 172.21.15.42:0/2916585544 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa46c1f9680 0x7fa46c140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:04.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.965+0000 7fa46be00640 1 -- 172.21.15.42:0/2916585544 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa450003f90 msgr2=0x7fa46c1595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:04.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.965+0000 7fa46be00640 1 --2- 172.21.15.42:0/2916585544 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa450003f90 0x7fa46c1595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:04.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.965+0000 7fa46be00640 1 -- 172.21.15.42:0/2916585544 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa46c1f9680 msgr2=0x7fa46c140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:04.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.965+0000 7fa46be00640 1 --2- 172.21.15.42:0/2916585544 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa46c1f9680 0x7fa46c140160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:04.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.965+0000 7fa46be00640 1 -- 172.21.15.42:0/2916585544 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46c0aa530 con 0x7fa46c1f8ae0 2024-09-17T01:36:04.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.966+0000 7fa46be00640 1 --2- 172.21.15.42:0/2916585544 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa46c1f8ae0 0x7fa46c1f8ef0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0cf940 tx=0x7fa464006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:04.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.966+0000 7fa463400640 1 -- 172.21.15.42:0/2916585544 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464011900 con 0x7fa46c1f8ae0 2024-09-17T01:36:04.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.966+0000 7fa463400640 1 -- 172.21.15.42:0/2916585544 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa464018070 con 0x7fa46c1f8ae0 2024-09-17T01:36:04.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.966+0000 7fa472000640 1 -- 172.21.15.42:0/2916585544 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa46c1f9430 con 0x7fa46c1f8ae0 2024-09-17T01:36:04.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.966+0000 7fa463400640 1 -- 172.21.15.42:0/2916585544 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464011d40 con 0x7fa46c1f8ae0 2024-09-17T01:36:04.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.966+0000 7fa472000640 1 -- 172.21.15.42:0/2916585544 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa46c0aaab0 con 0x7fa46c1f8ae0 2024-09-17T01:36:04.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.967+0000 7fa472000640 1 -- 172.21.15.42:0/2916585544 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa46c0b40c0 con 0x7fa46c1f8ae0 2024-09-17T01:36:04.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.968+0000 7fa463400640 1 -- 172.21.15.42:0/2916585544 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa46401d460 con 0x7fa46c1f8ae0 2024-09-17T01:36:04.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.969+0000 7fa463400640 1 --2- 172.21.15.42:0/2916585544 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa44c078b90 0x7fa44c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:04.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.970+0000 7fa463400640 1 -- 172.21.15.42:0/2916585544 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7fa46409b3b0 con 0x7fa46c1f8ae0 2024-09-17T01:36:04.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.970+0000 7fa46b400640 1 --2- 172.21.15.42:0/2916585544 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa44c078b90 0x7fa44c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:04.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.971+0000 7fa46b400640 1 --2- 172.21.15.42:0/2916585544 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa44c078b90 0x7fa44c07b0a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009c50 tx=0x7fa45c005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:04.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:04.974+0000 7fa463400640 1 -- 172.21.15.42:0/2916585544 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa46c0b40c0 con 0x7fa46c1f8ae0 2024-09-17T01:36:05.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.169+0000 7fa472000640 1 -- 172.21.15.42:0/2916585544 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa46c15d2a0 con 0x7fa46c1f8ae0 2024-09-17T01:36:05.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.173+0000 7fa463400640 1 -- 172.21.15.42:0/2916585544 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7fa46c1f9430 con 0x7fa46c1f8ae0 2024-09-17T01:36:05.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.175+0000 7fa472000640 1 -- 172.21.15.42:0/2916585544 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa44c078b90 msgr2=0x7fa44c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:05.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.175+0000 7fa472000640 1 --2- 172.21.15.42:0/2916585544 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa44c078b90 0x7fa44c07b0a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009c50 tx=0x7fa45c005f90 comp rx=0 tx=0).stop 2024-09-17T01:36:05.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.175+0000 7fa472000640 1 -- 172.21.15.42:0/2916585544 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa46c1f8ae0 msgr2=0x7fa46c1f8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:05.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.175+0000 7fa472000640 1 --2- 172.21.15.42:0/2916585544 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa46c1f8ae0 0x7fa46c1f8ef0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0cf940 tx=0x7fa464006430 comp rx=0 tx=0).stop 2024-09-17T01:36:05.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.175+0000 7fa472000640 1 -- 172.21.15.42:0/2916585544 shutdown_connections 2024-09-17T01:36:05.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.175+0000 7fa472000640 1 --2- 172.21.15.42:0/2916585544 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa44c078b90 0x7fa44c07b0a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:05.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.175+0000 7fa472000640 1 --2- 172.21.15.42:0/2916585544 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa46c1f9680 0x7fa46c140160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:05.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.175+0000 7fa472000640 1 --2- 172.21.15.42:0/2916585544 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa46c1f8ae0 0x7fa46c1f8ef0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:05.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.175+0000 7fa472000640 1 --2- 172.21.15.42:0/2916585544 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa450003f90 0x7fa46c1595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:05.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.175+0000 7fa472000640 1 -- 172.21.15.42:0/2916585544 >> 172.21.15.42:0/2916585544 conn(0x7fa46c0b2930 msgr2=0x7fa46c072950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:05.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.176+0000 7fa472000640 1 -- 172.21.15.42:0/2916585544 shutdown_connections 2024-09-17T01:36:05.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.176+0000 7fa472000640 1 -- 172.21.15.42:0/2916585544 wait complete. 2024-09-17T01:36:05.198 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:36:05.199 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:36:05.277 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:36:05.371 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:36:05.371 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:36:05.371 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:36:05.406 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:36:05.406 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:36:05.407 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:36:05.444 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:36:05.444 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:36:05.444 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:36:05.482 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:36:05.482 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:36:05.483 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:36:05.520 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:36:05.520 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T01:36:05.520 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:36:05.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.752+0000 7f708ba00640 1 -- 172.21.15.42:0/1900043026 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7084072e00 msgr2=0x7f708415bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:05.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.752+0000 7f708ba00640 1 --2- 172.21.15.42:0/1900043026 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7084072e00 0x7f708415bc50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f7078005fd0 tx=0x7f707802b910 comp rx=0 tx=0).stop 2024-09-17T01:36:05.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.753+0000 7f708ba00640 1 -- 172.21.15.42:0/1900043026 shutdown_connections 2024-09-17T01:36:05.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.753+0000 7f708ba00640 1 --2- 172.21.15.42:0/1900043026 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7084072e00 0x7f708415bc50 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:05.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.753+0000 7f708ba00640 1 -- 172.21.15.42:0/1900043026 >> 172.21.15.42:0/1900043026 conn(0x7f70840b2930 msgr2=0x7f708406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:05.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.753+0000 7f708ba00640 1 -- 172.21.15.42:0/1900043026 shutdown_connections 2024-09-17T01:36:05.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.753+0000 7f708ba00640 1 -- 172.21.15.42:0/1900043026 wait complete. 2024-09-17T01:36:05.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.755+0000 7f708ba00640 1 Processor -- start 2024-09-17T01:36:05.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.755+0000 7f708ba00640 1 -- start start 2024-09-17T01:36:05.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.757+0000 7f708ba00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7084072e00 0x7f7084145ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:05.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.757+0000 7f708ba00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f708415f190 0x7f70840b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:05.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.757+0000 7f708ba00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70840ae8a0 0x7f70840aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:05.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.757+0000 7f708ba00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7084151c30 con 0x7f70840ae8a0 2024-09-17T01:36:05.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.757+0000 7f708ba00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7084070740 con 0x7f7084072e00 2024-09-17T01:36:05.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.757+0000 7f708ba00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7084151db0 con 0x7f708415f190 2024-09-17T01:36:05.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.757+0000 7f7089a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70840ae8a0 0x7f70840aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:05.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.757+0000 7f7089a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70840ae8a0 0x7f70840aecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59806/0 (socket says 172.21.15.42:59806) 2024-09-17T01:36:05.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.757+0000 7f7089a00640 1 -- 172.21.15.42:0/1145676852 learned_addr learned my addr 172.21.15.42:0/1145676852 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:05.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.757+0000 7f7083e00640 1 --2- 172.21.15.42:0/1145676852 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f708415f190 0x7f70840b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:05.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.757+0000 7f7089000640 1 --2- 172.21.15.42:0/1145676852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7084072e00 0x7f7084145ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:05.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.757+0000 7f7089a00640 1 -- 172.21.15.42:0/1145676852 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f708415f190 msgr2=0x7f70840b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:05.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.757+0000 7f7089a00640 1 --2- 172.21.15.42:0/1145676852 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f708415f190 0x7f70840b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:05.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.757+0000 7f7089a00640 1 -- 172.21.15.42:0/1145676852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7084072e00 msgr2=0x7f7084145ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:05.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.757+0000 7f7089a00640 1 --2- 172.21.15.42:0/1145676852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7084072e00 0x7f7084145ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:05.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.757+0000 7f7089a00640 1 -- 172.21.15.42:0/1145676852 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70840af1f0 con 0x7f70840ae8a0 2024-09-17T01:36:05.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.757+0000 7f7083e00640 1 --2- 172.21.15.42:0/1145676852 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f708415f190 0x7f70840b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:36:05.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.757+0000 7f7089000640 1 --2- 172.21.15.42:0/1145676852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7084072e00 0x7f7084145ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:36:05.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.758+0000 7f7089a00640 1 --2- 172.21.15.42:0/1145676852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70840ae8a0 0x7f70840aecb0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f707c00c700 tx=0x7f707c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:05.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.758+0000 7f7080c00640 1 -- 172.21.15.42:0/1145676852 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c003b70 con 0x7f70840ae8a0 2024-09-17T01:36:05.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.758+0000 7f7080c00640 1 -- 172.21.15.42:0/1145676852 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f707c003d10 con 0x7f70840ae8a0 2024-09-17T01:36:05.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.758+0000 7f7080c00640 1 -- 172.21.15.42:0/1145676852 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c00aa50 con 0x7f70840ae8a0 2024-09-17T01:36:05.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.758+0000 7f708ba00640 1 -- 172.21.15.42:0/1145676852 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70841e78d0 con 0x7f70840ae8a0 2024-09-17T01:36:05.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.758+0000 7f708ba00640 1 -- 172.21.15.42:0/1145676852 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70841e7e90 con 0x7f70840ae8a0 2024-09-17T01:36:05.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.759+0000 7f708ba00640 1 -- 172.21.15.42:0/1145676852 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f708415bc50 con 0x7f70840ae8a0 2024-09-17T01:36:05.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.760+0000 7f7080c00640 1 -- 172.21.15.42:0/1145676852 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f707c00abf0 con 0x7f70840ae8a0 2024-09-17T01:36:05.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.761+0000 7f7080c00640 1 --2- 172.21.15.42:0/1145676852 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7064078bc0 0x7f706407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:05.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.761+0000 7f7080c00640 1 -- 172.21.15.42:0/1145676852 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f707c09a7a0 con 0x7f70840ae8a0 2024-09-17T01:36:05.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.762+0000 7f7089000640 1 --2- 172.21.15.42:0/1145676852 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7064078bc0 0x7f706407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:05.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.762+0000 7f7089000640 1 --2- 172.21.15.42:0/1145676852 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7064078bc0 0x7f706407b0d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7078035000 tx=0x7f7078004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:05.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.766+0000 7f7080c00640 1 -- 172.21.15.42:0/1145676852 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f707c062ed0 con 0x7f70840ae8a0 2024-09-17T01:36:05.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.996+0000 7f708ba00640 1 -- 172.21.15.42:0/1145676852 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f708406a170 con 0x7f70840ae8a0 2024-09-17T01:36:05.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.997+0000 7f7080c00640 1 -- 172.21.15.42:0/1145676852 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+3905 (secure 0 0 0) 0x7f707c0627d0 con 0x7f70840ae8a0 2024-09-17T01:36:05.995 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:05.995 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":34,"btime":"2024-09-17T01:35:58:219761+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5209,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4107697732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":4107697732},{"type":"v1","addr":"172.21.15.43:6837","nonce":4107697732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1959050852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1959050852},{"type":"v1","addr":"172.21.15.42:6833","nonce":1959050852}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5271,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2487768756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2487768756},{"type":"v1","addr":"172.21.15.43:6836","nonce":2487768756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":6111,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/10427485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":10427485},{"type":"v1","addr":"172.21.15.42:6835","nonce":10427485}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[]} 2024-09-17T01:36:05.995 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 34 2024-09-17T01:36:05.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.999+0000 7f708ba00640 1 -- 172.21.15.42:0/1145676852 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7064078bc0 msgr2=0x7f706407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:05.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.999+0000 7f708ba00640 1 --2- 172.21.15.42:0/1145676852 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7064078bc0 0x7f706407b0d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7078035000 tx=0x7f7078004730 comp rx=0 tx=0).stop 2024-09-17T01:36:05.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.999+0000 7f708ba00640 1 -- 172.21.15.42:0/1145676852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70840ae8a0 msgr2=0x7f70840aecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:05.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.999+0000 7f708ba00640 1 --2- 172.21.15.42:0/1145676852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70840ae8a0 0x7f70840aecb0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f707c00c700 tx=0x7f707c00cbc0 comp rx=0 tx=0).stop 2024-09-17T01:36:05.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.999+0000 7f708ba00640 1 -- 172.21.15.42:0/1145676852 shutdown_connections 2024-09-17T01:36:05.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.999+0000 7f708ba00640 1 --2- 172.21.15.42:0/1145676852 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7064078bc0 0x7f706407b0d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:05.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.999+0000 7f708ba00640 1 --2- 172.21.15.42:0/1145676852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70840ae8a0 0x7f70840aecb0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:05.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.999+0000 7f708ba00640 1 --2- 172.21.15.42:0/1145676852 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f708415f190 0x7f70840b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:05.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.999+0000 7f708ba00640 1 --2- 172.21.15.42:0/1145676852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7084072e00 0x7f7084145ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:05.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:05.999+0000 7f708ba00640 1 -- 172.21.15.42:0/1145676852 >> 172.21.15.42:0/1145676852 conn(0x7f70840b2930 msgr2=0x7f708415e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:05.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.000+0000 7f708ba00640 1 -- 172.21.15.42:0/1145676852 shutdown_connections 2024-09-17T01:36:05.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.000+0000 7f708ba00640 1 -- 172.21.15.42:0/1145676852 wait complete. 2024-09-17T01:36:06.021 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T01:36:06.021 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T01:36:06.021 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T01:36:06.021 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:36:06.021 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T01:36:06.022 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T01:36:06.022 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T01:36:06.022 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:36:06.022 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T01:36:06.022 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T01:36:06.022 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T01:36:06.022 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:36:06.023 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T01:36:06.023 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T01:36:06.023 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T01:36:06.023 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:36:06.042 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T01:36:06.042 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T01:36:06.043 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T01:36:06.043 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T01:36:06.056 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T01:36:06.056 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T01:36:06.058 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T01:36:06.058 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T01:36:06.086 INFO:tasks.ceph.mds.a:Started 2024-09-17T01:36:06.087 DEBUG:teuthology.parallel:result is None 2024-09-17T01:36:06.089 INFO:tasks.ceph.mds.c:Started 2024-09-17T01:36:06.089 DEBUG:teuthology.parallel:result is None 2024-09-17T01:36:06.102 INFO:tasks.ceph.mds.b:Started 2024-09-17T01:36:06.103 DEBUG:teuthology.parallel:result is None 2024-09-17T01:36:06.105 INFO:tasks.ceph.mds.d:Started 2024-09-17T01:36:06.105 DEBUG:teuthology.parallel:result is None 2024-09-17T01:36:06.106 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T01:36:06.283 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:36:06.284 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:36:06.304 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-09-17T01:36:06.305 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-09-17T01:36:06.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.344+0000 7fcc5b600640 1 -- 172.21.15.42:0/1986785902 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcc54073df0 msgr2=0x7fcc54074200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:06.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.344+0000 7fcc5b600640 1 --2- 172.21.15.42:0/1986785902 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcc54073df0 0x7fcc54074200 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c009be0 tx=0x7fcc4c02a820 comp rx=0 tx=0).stop 2024-09-17T01:36:06.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.345+0000 7fcc5b600640 1 -- 172.21.15.42:0/1986785902 shutdown_connections 2024-09-17T01:36:06.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.345+0000 7fcc5b600640 1 --2- 172.21.15.42:0/1986785902 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcc54073df0 0x7fcc54074200 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:06.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.345+0000 7fcc5b600640 1 -- 172.21.15.42:0/1986785902 >> 172.21.15.42:0/1986785902 conn(0x7fcc540b2930 msgr2=0x7fcc5406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:06.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.345+0000 7fcc5b600640 1 -- 172.21.15.42:0/1986785902 shutdown_connections 2024-09-17T01:36:06.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.345+0000 7fcc5b600640 1 -- 172.21.15.42:0/1986785902 wait complete. 2024-09-17T01:36:06.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.347+0000 7fcc5b600640 1 Processor -- start 2024-09-17T01:36:06.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.347+0000 7fcc5b600640 1 -- start start 2024-09-17T01:36:06.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.348+0000 7fcc5b600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc5406ee90 0x7fcc541f9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:06.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.349+0000 7fcc5b600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc5406f2a0 0x7fcc541586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:06.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.349+0000 7fcc5b600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcc54073df0 0x7fcc54148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:06.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.349+0000 7fcc5b600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcc540cf0c0 con 0x7fcc5406ee90 2024-09-17T01:36:06.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.349+0000 7fcc5b600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcc540cef40 con 0x7fcc5406f2a0 2024-09-17T01:36:06.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.349+0000 7fcc5b600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fcc540cf240 con 0x7fcc54073df0 2024-09-17T01:36:06.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.349+0000 7fcc58c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc5406ee90 0x7fcc541f9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:06.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.349+0000 7fcc58c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc5406ee90 0x7fcc541f9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43894/0 (socket says 172.21.15.42:43894) 2024-09-17T01:36:06.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.349+0000 7fcc58c00640 1 -- 172.21.15.42:0/2222184301 learned_addr learned my addr 172.21.15.42:0/2222184301 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:06.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.349+0000 7fcc59600640 1 --2- 172.21.15.42:0/2222184301 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcc54073df0 0x7fcc54148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:06.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.349+0000 7fcc4be00640 1 --2- 172.21.15.42:0/2222184301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc5406f2a0 0x7fcc541586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:06.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.349+0000 7fcc58c00640 1 -- 172.21.15.42:0/2222184301 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcc54073df0 msgr2=0x7fcc54148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:06.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.349+0000 7fcc58c00640 1 --2- 172.21.15.42:0/2222184301 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcc54073df0 0x7fcc54148c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:06.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.349+0000 7fcc58c00640 1 -- 172.21.15.42:0/2222184301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc5406f2a0 msgr2=0x7fcc541586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:06.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.349+0000 7fcc58c00640 1 --2- 172.21.15.42:0/2222184301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc5406f2a0 0x7fcc541586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:06.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.349+0000 7fcc58c00640 1 -- 172.21.15.42:0/2222184301 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc541f9450 con 0x7fcc5406ee90 2024-09-17T01:36:06.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.350+0000 7fcc58c00640 1 --2- 172.21.15.42:0/2222184301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc5406ee90 0x7fcc541f9c10 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fcc4400c760 tx=0x7fcc4400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:06.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.350+0000 7fcc51600640 1 -- 172.21.15.42:0/2222184301 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc44016020 con 0x7fcc5406ee90 2024-09-17T01:36:06.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.350+0000 7fcc51600640 1 -- 172.21.15.42:0/2222184301 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc4400ab40 con 0x7fcc5406ee90 2024-09-17T01:36:06.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.350+0000 7fcc5b600640 1 -- 172.21.15.42:0/2222184301 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc54157130 con 0x7fcc5406ee90 2024-09-17T01:36:06.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.350+0000 7fcc51600640 1 -- 172.21.15.42:0/2222184301 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4400ce10 con 0x7fcc5406ee90 2024-09-17T01:36:06.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.350+0000 7fcc5b600640 1 -- 172.21.15.42:0/2222184301 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc54156e50 con 0x7fcc5406ee90 2024-09-17T01:36:06.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.351+0000 7fcc5b600640 1 -- 172.21.15.42:0/2222184301 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc540cf6a0 con 0x7fcc5406ee90 2024-09-17T01:36:06.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.352+0000 7fcc51600640 1 -- 172.21.15.42:0/2222184301 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcc44019020 con 0x7fcc5406ee90 2024-09-17T01:36:06.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.353+0000 7fcc51600640 1 --2- 172.21.15.42:0/2222184301 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcc30078bc0 0x7fcc3007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:06.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.354+0000 7fcc51600640 1 -- 172.21.15.42:0/2222184301 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7fcc4409ac10 con 0x7fcc5406ee90 2024-09-17T01:36:06.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.354+0000 7fcc4be00640 1 --2- 172.21.15.42:0/2222184301 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcc30078bc0 0x7fcc3007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:06.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.355+0000 7fcc4be00640 1 --2- 172.21.15.42:0/2222184301 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcc30078bc0 0x7fcc3007b0d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcc541f9210 tx=0x7fcc3c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:06.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.358+0000 7fcc51600640 1 -- 172.21.15.42:0/2222184301 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcc44020020 con 0x7fcc5406ee90 2024-09-17T01:36:06.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:06.566+0000 7fcc5b600640 1 -- 172.21.15.42:0/2222184301 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fcc5406a170 con 0x7fcc5406ee90 2024-09-17T01:36:07.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.260+0000 7fcc51600640 1 -- 172.21.15.42:0/2222184301 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v56) ==== 97+0+0 (secure 0 0 0) 0x7fcc54074740 con 0x7fcc5406ee90 2024-09-17T01:36:07.258 INFO:teuthology.orchestra.run.smithi042.stderr: removed all blocklist entries 2024-09-17T01:36:07.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.264+0000 7fcc5b600640 1 -- 172.21.15.42:0/2222184301 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcc30078bc0 msgr2=0x7fcc3007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:07.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.264+0000 7fcc5b600640 1 --2- 172.21.15.42:0/2222184301 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcc30078bc0 0x7fcc3007b0d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcc541f9210 tx=0x7fcc3c009040 comp rx=0 tx=0).stop 2024-09-17T01:36:07.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.264+0000 7fcc5b600640 1 -- 172.21.15.42:0/2222184301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc5406ee90 msgr2=0x7fcc541f9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:07.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.264+0000 7fcc5b600640 1 --2- 172.21.15.42:0/2222184301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc5406ee90 0x7fcc541f9c10 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fcc4400c760 tx=0x7fcc4400cc20 comp rx=0 tx=0).stop 2024-09-17T01:36:07.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.264+0000 7fcc5b600640 1 -- 172.21.15.42:0/2222184301 shutdown_connections 2024-09-17T01:36:07.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.264+0000 7fcc5b600640 1 --2- 172.21.15.42:0/2222184301 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcc30078bc0 0x7fcc3007b0d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:07.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.264+0000 7fcc5b600640 1 --2- 172.21.15.42:0/2222184301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc5406f2a0 0x7fcc541586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:07.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.264+0000 7fcc5b600640 1 --2- 172.21.15.42:0/2222184301 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcc54073df0 0x7fcc54148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:07.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.264+0000 7fcc5b600640 1 --2- 172.21.15.42:0/2222184301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc5406ee90 0x7fcc541f9c10 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:07.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.264+0000 7fcc5b600640 1 -- 172.21.15.42:0/2222184301 >> 172.21.15.42:0/2222184301 conn(0x7fcc540b2930 msgr2=0x7fcc5406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:07.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.264+0000 7fcc5b600640 1 -- 172.21.15.42:0/2222184301 shutdown_connections 2024-09-17T01:36:07.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.264+0000 7fcc5b600640 1 -- 172.21.15.42:0/2222184301 wait complete. 2024-09-17T01:36:07.289 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T01:36:07.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.522+0000 7f5ae7e00640 1 -- 172.21.15.42:0/978457975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ae806d430 msgr2=0x7f5ae8152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:07.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.522+0000 7f5ae7e00640 1 --2- 172.21.15.42:0/978457975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ae806d430 0x7f5ae8152ed0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0005fd0 tx=0x7f5ae002aa90 comp rx=0 tx=0).stop 2024-09-17T01:36:07.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.522+0000 7f5ae7e00640 1 -- 172.21.15.42:0/978457975 shutdown_connections 2024-09-17T01:36:07.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.522+0000 7f5ae7e00640 1 --2- 172.21.15.42:0/978457975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ae806d430 0x7f5ae8152ed0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:07.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.522+0000 7f5ae7e00640 1 -- 172.21.15.42:0/978457975 >> 172.21.15.42:0/978457975 conn(0x7f5ae80b25f0 msgr2=0x7f5ae80d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:07.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.522+0000 7f5ae7e00640 1 -- 172.21.15.42:0/978457975 shutdown_connections 2024-09-17T01:36:07.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.522+0000 7f5ae7e00640 1 -- 172.21.15.42:0/978457975 wait complete. 2024-09-17T01:36:07.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.524+0000 7f5ae7e00640 1 Processor -- start 2024-09-17T01:36:07.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.524+0000 7f5ae7e00640 1 -- start start 2024-09-17T01:36:07.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.526+0000 7f5ae7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ae80b4be0 0x7f5ae80c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:07.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.526+0000 7f5ae7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ae80cf7c0 0x7f5ae80cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:07.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.526+0000 7f5ae7e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ae8146340 0x7f5ae80ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:07.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.526+0000 7f5ae7e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae8153620 con 0x7f5ae80cf7c0 2024-09-17T01:36:07.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.526+0000 7f5ae7e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae80b4380 con 0x7f5ae80b4be0 2024-09-17T01:36:07.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.526+0000 7f5ae7e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5ae81537a0 con 0x7f5ae8146340 2024-09-17T01:36:07.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.526+0000 7f5adfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ae80cf7c0 0x7f5ae80cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:07.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.526+0000 7f5adfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ae80cf7c0 0x7f5ae80cca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43902/0 (socket says 172.21.15.42:43902) 2024-09-17T01:36:07.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.526+0000 7f5adfe00640 1 -- 172.21.15.42:0/1880551989 learned_addr learned my addr 172.21.15.42:0/1880551989 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:07.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.527+0000 7f5ae6a00640 1 --2- 172.21.15.42:0/1880551989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ae80b4be0 0x7f5ae80c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:07.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.527+0000 7f5adfe00640 1 -- 172.21.15.42:0/1880551989 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ae8146340 msgr2=0x7f5ae80ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:07.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.527+0000 7f5ae7400640 1 --2- 172.21.15.42:0/1880551989 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ae8146340 0x7f5ae80ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:07.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.527+0000 7f5adfe00640 1 --2- 172.21.15.42:0/1880551989 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ae8146340 0x7f5ae80ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:07.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.527+0000 7f5adfe00640 1 -- 172.21.15.42:0/1880551989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ae80b4be0 msgr2=0x7f5ae80c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:07.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.527+0000 7f5adfe00640 1 --2- 172.21.15.42:0/1880551989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ae80b4be0 0x7f5ae80c7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:07.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.527+0000 7f5adfe00640 1 -- 172.21.15.42:0/1880551989 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ae81f7530 con 0x7f5ae80cf7c0 2024-09-17T01:36:07.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.527+0000 7f5ae6a00640 1 --2- 172.21.15.42:0/1880551989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ae80b4be0 0x7f5ae80c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:36:07.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.527+0000 7f5ae7400640 1 --2- 172.21.15.42:0/1880551989 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ae8146340 0x7f5ae80ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:36:07.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.527+0000 7f5adfe00640 1 --2- 172.21.15.42:0/1880551989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ae80cf7c0 0x7f5ae80cca10 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000c3a0 tx=0x7f5ad000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:07.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.527+0000 7f5adea00640 1 -- 172.21.15.42:0/1880551989 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0017070 con 0x7f5ae80cf7c0 2024-09-17T01:36:07.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.527+0000 7f5adea00640 1 -- 172.21.15.42:0/1880551989 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ad00053c0 con 0x7f5ae80cf7c0 2024-09-17T01:36:07.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.527+0000 7f5ae7e00640 1 -- 172.21.15.42:0/1880551989 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ae8145860 con 0x7f5ae80cf7c0 2024-09-17T01:36:07.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.527+0000 7f5adea00640 1 -- 172.21.15.42:0/1880551989 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0003850 con 0x7f5ae80cf7c0 2024-09-17T01:36:07.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.527+0000 7f5ae7e00640 1 -- 172.21.15.42:0/1880551989 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ae8145e20 con 0x7f5ae80cf7c0 2024-09-17T01:36:07.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.528+0000 7f5ae7e00640 1 -- 172.21.15.42:0/1880551989 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ae8152ed0 con 0x7f5ae80cf7c0 2024-09-17T01:36:07.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.530+0000 7f5adea00640 1 -- 172.21.15.42:0/1880551989 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5ad001a070 con 0x7f5ae80cf7c0 2024-09-17T01:36:07.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.531+0000 7f5adea00640 1 --2- 172.21.15.42:0/1880551989 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5ac4078bf0 0x7f5ac407b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:07.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.531+0000 7f5adea00640 1 -- 172.21.15.42:0/1880551989 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4857+0+0 (secure 0 0 0) 0x7f5ad0099da0 con 0x7f5ae80cf7c0 2024-09-17T01:36:07.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.531+0000 7f5ae6a00640 1 --2- 172.21.15.42:0/1880551989 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5ac4078bf0 0x7f5ac407b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:07.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.532+0000 7f5ae6a00640 1 --2- 172.21.15.42:0/1880551989 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5ac4078bf0 0x7f5ac407b100 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5ad800a830 tx=0x7f5ad8008040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:07.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.535+0000 7f5adea00640 1 -- 172.21.15.42:0/1880551989 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5ad0062520 con 0x7f5ae80cf7c0 2024-09-17T01:36:07.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.806+0000 7f5ae7e00640 1 -- 172.21.15.42:0/1880551989 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f5ae80d0300 con 0x7f5ae80cf7c0 2024-09-17T01:36:07.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.807+0000 7f5adea00640 1 -- 172.21.15.42:0/1880551989 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v30) ==== 80+0+5304 (secure 0 0 0) 0x7f5ad0061e20 con 0x7f5ae80cf7c0 2024-09-17T01:36:07.805 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:07.805 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:36:07.805 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_dump": [ 2024-09-17T01:36:07.805 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:07.805 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.a", 2024-09-17T01:36:07.805 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmyJK4HRAAIC4E4V7p1fqIEfPIICMxZg==", 2024-09-17T01:36:07.805 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:07.805 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:36:07.805 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:36:07.805 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:36:07.805 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:07.805 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:07.806 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:07.806 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:07.806 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.b", 2024-09-17T01:36:07.806 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmXv3vORAALPrYIM6Vtz0g1pOxVhrUig==", 2024-09-17T01:36:07.806 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:07.806 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:36:07.806 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:36:07.806 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:36:07.806 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:07.806 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:07.806 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:07.806 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:07.807 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.c", 2024-09-17T01:36:07.807 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmPE7MKxAA9mGG+EO9C3VGVMerOm92+Q==", 2024-09-17T01:36:07.807 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:07.807 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:36:07.807 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:36:07.807 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:36:07.807 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:07.807 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:07.807 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:07.807 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:07.807 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.d", 2024-09-17T01:36:07.807 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmaOBSDBAATU4tpjM5IMcuvzZFE7N5bQ==", 2024-09-17T01:36:07.807 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:07.807 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:36:07.808 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:36:07.808 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:36:07.808 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:07.808 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:07.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:07.808 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:07.808 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.0", 2024-09-17T01:36:07.808 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDP2+hmEJebExAAAdGEoSzM96ybGT9h7t7OkA==", 2024-09-17T01:36:07.808 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:07.808 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:36:07.808 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:36:07.808 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:07.808 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:07.809 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:07.809 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:07.809 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.1", 2024-09-17T01:36:07.809 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDS2+hm7dWoMBAAagktrUl0O2/mgKCEfpAstA==", 2024-09-17T01:36:07.809 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:07.809 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:36:07.809 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:36:07.809 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:07.809 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:07.809 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:07.809 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:07.809 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.2", 2024-09-17T01:36:07.809 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDW2+hmEfSPBBAAPAa6EZt27yUcJSfZyCKheg==", 2024-09-17T01:36:07.809 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:07.810 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:36:07.810 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:36:07.810 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:07.810 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:07.810 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:07.810 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:07.810 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.3", 2024-09-17T01:36:07.810 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDZ2+hmHQhXFRAAj84g+IKqH6KMP7LjRtFvLw==", 2024-09-17T01:36:07.810 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:07.810 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:36:07.810 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:36:07.810 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:07.810 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:07.811 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:07.811 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:07.811 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.4", 2024-09-17T01:36:07.811 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDd2+hmaNcMNBAAx1GV/oFdfssMjFWFN5M0VQ==", 2024-09-17T01:36:07.811 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:07.811 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:36:07.811 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:36:07.811 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:07.811 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:07.811 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:07.811 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:07.811 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.5", 2024-09-17T01:36:07.811 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDh2+hm301NJhAAnSUH5AAvqhPwM7loH6frww==", 2024-09-17T01:36:07.811 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:07.812 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:36:07.812 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:36:07.812 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:07.812 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:07.812 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:07.812 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:07.812 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.6", 2024-09-17T01:36:07.812 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDk2+hm61WNNRAAbCvVvsUpB4fgt4ja60DRZA==", 2024-09-17T01:36:07.812 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:07.812 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:36:07.812 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:36:07.812 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:07.812 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:07.812 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:07.813 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:07.813 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.7", 2024-09-17T01:36:07.813 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDo2+hmesiLFhAA29n1eageNvP+lkRyh6gGMw==", 2024-09-17T01:36:07.813 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:07.813 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:36:07.813 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:36:07.813 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:07.813 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:07.813 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:07.813 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:07.813 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.0", 2024-09-17T01:36:07.813 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA==", 2024-09-17T01:36:07.813 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:07.814 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:36:07.814 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow r", 2024-09-17T01:36:07.814 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T01:36:07.814 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:07.814 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:07.814 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:07.814 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.1", 2024-09-17T01:36:07.814 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmZLygLhAABlauZgnidFWvfCCPuBLObg==", 2024-09-17T01:36:07.814 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:07.814 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:36:07.814 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:36:07.814 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:36:07.815 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:36:07.815 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:07.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:07.815 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:07.815 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.2", 2024-09-17T01:36:07.815 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hm8lnZIxAAN0a2CVMMtu/Nz50OG4a02A==", 2024-09-17T01:36:07.815 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:07.815 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:36:07.815 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:36:07.815 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:36:07.815 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:36:07.815 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:07.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:07.815 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:07.816 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.3", 2024-09-17T01:36:07.816 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmgXdAORAAM5Uy66I4nnTJ9Vhkn9JoBw==", 2024-09-17T01:36:07.816 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:07.816 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:36:07.816 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:36:07.816 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:36:07.816 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:36:07.816 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:07.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:07.816 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:07.816 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.admin", 2024-09-17T01:36:07.816 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDL2+hmvCreHBAA4CSAhosssViGqD93U+I7Iw==", 2024-09-17T01:36:07.816 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:07.816 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:36:07.816 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:36:07.817 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:36:07.817 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:07.817 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:07.817 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:07.817 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:07.817 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.x", 2024-09-17T01:36:07.817 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmYPnlEhAAIcQ11ktWZyMXYdbAONiLog==", 2024-09-17T01:36:07.817 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:07.817 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:36:07.817 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:36:07.817 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:07.817 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:07.817 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:07.817 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:07.818 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.y", 2024-09-17T01:36:07.818 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmpCZtBxAAp5tXMc6aEq1aOny2LJZAiA==", 2024-09-17T01:36:07.818 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:07.818 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:36:07.818 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:36:07.818 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:07.818 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:07.818 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:07.818 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-17T01:36:07.818 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:36:07.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.809+0000 7f5ae7e00640 1 -- 172.21.15.42:0/1880551989 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5ac4078bf0 msgr2=0x7f5ac407b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:07.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.809+0000 7f5ae7e00640 1 --2- 172.21.15.42:0/1880551989 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5ac4078bf0 0x7f5ac407b100 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5ad800a830 tx=0x7f5ad8008040 comp rx=0 tx=0).stop 2024-09-17T01:36:07.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.809+0000 7f5ae7e00640 1 -- 172.21.15.42:0/1880551989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ae80cf7c0 msgr2=0x7f5ae80cca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:07.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.809+0000 7f5ae7e00640 1 --2- 172.21.15.42:0/1880551989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ae80cf7c0 0x7f5ae80cca10 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000c3a0 tx=0x7f5ad000c860 comp rx=0 tx=0).stop 2024-09-17T01:36:07.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.809+0000 7f5ae7e00640 1 -- 172.21.15.42:0/1880551989 shutdown_connections 2024-09-17T01:36:07.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.809+0000 7f5ae7e00640 1 --2- 172.21.15.42:0/1880551989 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5ac4078bf0 0x7f5ac407b100 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:07.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.809+0000 7f5ae7e00640 1 --2- 172.21.15.42:0/1880551989 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ae8146340 0x7f5ae80ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:07.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.809+0000 7f5ae7e00640 1 --2- 172.21.15.42:0/1880551989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ae80cf7c0 0x7f5ae80cca10 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:07.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.809+0000 7f5ae7e00640 1 --2- 172.21.15.42:0/1880551989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ae80b4be0 0x7f5ae80c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:07.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.809+0000 7f5ae7e00640 1 -- 172.21.15.42:0/1880551989 >> 172.21.15.42:0/1880551989 conn(0x7f5ae80b25f0 msgr2=0x7f5ae80aec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:07.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.809+0000 7f5ae7e00640 1 -- 172.21.15.42:0/1880551989 shutdown_connections 2024-09-17T01:36:07.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:07.809+0000 7f5ae7e00640 1 -- 172.21.15.42:0/1880551989 wait complete. 2024-09-17T01:36:07.830 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T01:36:08.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.059+0000 7f0c0c400640 1 -- 172.21.15.42:0/3584848767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c040b3550 msgr2=0x7f0c0415cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:08.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.059+0000 7f0c0c400640 1 --2- 172.21.15.42:0/3584848767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c040b3550 0x7f0c0415cec0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009830 tx=0x7f0bf802a480 comp rx=0 tx=0).stop 2024-09-17T01:36:08.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.060+0000 7f0c0c400640 1 -- 172.21.15.42:0/3584848767 shutdown_connections 2024-09-17T01:36:08.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.060+0000 7f0c0c400640 1 --2- 172.21.15.42:0/3584848767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c040b3550 0x7f0c0415cec0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:08.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.060+0000 7f0c0c400640 1 -- 172.21.15.42:0/3584848767 >> 172.21.15.42:0/3584848767 conn(0x7f0c040b2930 msgr2=0x7f0c0406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:08.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.060+0000 7f0c0c400640 1 -- 172.21.15.42:0/3584848767 shutdown_connections 2024-09-17T01:36:08.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.060+0000 7f0c0c400640 1 -- 172.21.15.42:0/3584848767 wait complete. 2024-09-17T01:36:08.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.062+0000 7f0c0c400640 1 Processor -- start 2024-09-17T01:36:08.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.062+0000 7f0c0c400640 1 -- start start 2024-09-17T01:36:08.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.063+0000 7f0c0c400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c040b3550 0x7f0c041e62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:08.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.063+0000 7f0c0c400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c040cec40 0x7f0c0406f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:08.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.063+0000 7f0c0c400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0c04142f40 0x7f0c041595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:08.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.063+0000 7f0c0c400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0c040cf050 con 0x7f0c040b3550 2024-09-17T01:36:08.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.063+0000 7f0c0c400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0406dd50 con 0x7f0c040cec40 2024-09-17T01:36:08.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.063+0000 7f0c0c400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0c040cf1d0 con 0x7f0c04142f40 2024-09-17T01:36:08.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.064+0000 7f0c09a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c040b3550 0x7f0c041e62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:08.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.064+0000 7f0c09a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c040b3550 0x7f0c041e62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43910/0 (socket says 172.21.15.42:43910) 2024-09-17T01:36:08.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.064+0000 7f0c09a00640 1 -- 172.21.15.42:0/589637785 learned_addr learned my addr 172.21.15.42:0/589637785 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:08.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.064+0000 7f0c0a400640 1 --2- 172.21.15.42:0/589637785 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0c04142f40 0x7f0c041595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:08.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.064+0000 7f0c09000640 1 --2- 172.21.15.42:0/589637785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c040cec40 0x7f0c0406f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:08.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.064+0000 7f0c09a00640 1 -- 172.21.15.42:0/589637785 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0c04142f40 msgr2=0x7f0c041595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:08.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.064+0000 7f0c09a00640 1 --2- 172.21.15.42:0/589637785 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0c04142f40 0x7f0c041595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:08.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.064+0000 7f0c09a00640 1 -- 172.21.15.42:0/589637785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c040cec40 msgr2=0x7f0c0406f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:08.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.064+0000 7f0c09a00640 1 --2- 172.21.15.42:0/589637785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c040cec40 0x7f0c0406f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:08.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.064+0000 7f0c09a00640 1 -- 172.21.15.42:0/589637785 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c041f5900 con 0x7f0c040b3550 2024-09-17T01:36:08.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.064+0000 7f0c09a00640 1 --2- 172.21.15.42:0/589637785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c040b3550 0x7f0c041e62f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8000c00 tx=0x7f0bf8033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:08.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.065+0000 7f0c01600640 1 -- 172.21.15.42:0/589637785 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8031d60 con 0x7f0c040b3550 2024-09-17T01:36:08.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.065+0000 7f0c01600640 1 -- 172.21.15.42:0/589637785 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bf80330d0 con 0x7f0c040b3550 2024-09-17T01:36:08.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.065+0000 7f0c01600640 1 -- 172.21.15.42:0/589637785 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8033520 con 0x7f0c040b3550 2024-09-17T01:36:08.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.065+0000 7f0c0c400640 1 -- 172.21.15.42:0/589637785 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c041f5be0 con 0x7f0c040b3550 2024-09-17T01:36:08.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.065+0000 7f0c0c400640 1 -- 172.21.15.42:0/589637785 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c041f61a0 con 0x7f0c040b3550 2024-09-17T01:36:08.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.066+0000 7f0c0c400640 1 -- 172.21.15.42:0/589637785 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c0415cec0 con 0x7f0c040b3550 2024-09-17T01:36:08.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.067+0000 7f0c01600640 1 -- 172.21.15.42:0/589637785 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0bf80035f0 con 0x7f0c040b3550 2024-09-17T01:36:08.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.068+0000 7f0c01600640 1 --2- 172.21.15.42:0/589637785 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0be4078b90 0x7f0be407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:08.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.068+0000 7f0c01600640 1 -- 172.21.15.42:0/589637785 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4857+0+0 (secure 0 0 0) 0x7f0bf80bbe60 con 0x7f0c040b3550 2024-09-17T01:36:08.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.069+0000 7f0c09000640 1 --2- 172.21.15.42:0/589637785 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0be4078b90 0x7f0be407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:08.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.069+0000 7f0c09000640 1 --2- 172.21.15.42:0/589637785 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0be4078b90 0x7f0be407b0a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0c0415fe20 tx=0x7f0bf0009060 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:08.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.072+0000 7f0c01600640 1 -- 172.21.15.42:0/589637785 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0bf803f030 con 0x7f0c040b3550 2024-09-17T01:36:08.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.270+0000 7f0c0c400640 1 -- 172.21.15.42:0/589637785 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f0c0406a170 con 0x7f0c040b3550 2024-09-17T01:36:08.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.270+0000 7f0c01600640 1 -- 172.21.15.42:0/589637785 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v58) ==== 84+0+65 (secure 0 0 0) 0x7f0bf8083f00 con 0x7f0c040b3550 2024-09-17T01:36:08.268 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:08.268 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-09-17T01:36:08.268 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:08.269 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-09-17T01:36:08.269 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-09-17T01:36:08.269 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:08.269 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-09-17T01:36:08.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.273+0000 7f0c0c400640 1 -- 172.21.15.42:0/589637785 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0be4078b90 msgr2=0x7f0be407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:08.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.273+0000 7f0c0c400640 1 --2- 172.21.15.42:0/589637785 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0be4078b90 0x7f0be407b0a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0c0415fe20 tx=0x7f0bf0009060 comp rx=0 tx=0).stop 2024-09-17T01:36:08.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.273+0000 7f0c0c400640 1 -- 172.21.15.42:0/589637785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c040b3550 msgr2=0x7f0c041e62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:08.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.273+0000 7f0c0c400640 1 --2- 172.21.15.42:0/589637785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c040b3550 0x7f0c041e62f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8000c00 tx=0x7f0bf8033d60 comp rx=0 tx=0).stop 2024-09-17T01:36:08.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.273+0000 7f0c0c400640 1 -- 172.21.15.42:0/589637785 shutdown_connections 2024-09-17T01:36:08.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.273+0000 7f0c0c400640 1 --2- 172.21.15.42:0/589637785 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0be4078b90 0x7f0be407b0a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:08.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.273+0000 7f0c0c400640 1 --2- 172.21.15.42:0/589637785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c040cec40 0x7f0c0406f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:08.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.273+0000 7f0c0c400640 1 --2- 172.21.15.42:0/589637785 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0c04142f40 0x7f0c041595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:08.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.273+0000 7f0c0c400640 1 --2- 172.21.15.42:0/589637785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c040b3550 0x7f0c041e62f0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:08.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.273+0000 7f0c0c400640 1 -- 172.21.15.42:0/589637785 >> 172.21.15.42:0/589637785 conn(0x7f0c040b2930 msgr2=0x7f0c040ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:08.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.273+0000 7f0c0c400640 1 -- 172.21.15.42:0/589637785 shutdown_connections 2024-09-17T01:36:08.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.273+0000 7f0c0c400640 1 -- 172.21.15.42:0/589637785 wait complete. 2024-09-17T01:36:08.293 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T01:36:08.293 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T01:36:08.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.528+0000 7efe62c00640 1 -- 172.21.15.42:0/87400483 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe5c06db40 msgr2=0x7efe5c0cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:08.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.528+0000 7efe62c00640 1 --2- 172.21.15.42:0/87400483 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe5c06db40 0x7efe5c0cdf30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efe54005fd0 tx=0x7efe5402a8b0 comp rx=0 tx=0).stop 2024-09-17T01:36:08.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.528+0000 7efe62c00640 1 -- 172.21.15.42:0/87400483 shutdown_connections 2024-09-17T01:36:08.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.528+0000 7efe62c00640 1 --2- 172.21.15.42:0/87400483 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe5c06db40 0x7efe5c0cdf30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:08.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.528+0000 7efe62c00640 1 --2- 172.21.15.42:0/87400483 >> v2:172.21.15.43:3300/0 conn(0x7efe5c0b56d0 0x7efe5c0b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:08.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.528+0000 7efe62c00640 1 -- 172.21.15.42:0/87400483 >> 172.21.15.42:0/87400483 conn(0x7efe5c0b28f0 msgr2=0x7efe5c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:08.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.528+0000 7efe62c00640 1 -- 172.21.15.42:0/87400483 shutdown_connections 2024-09-17T01:36:08.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.528+0000 7efe62c00640 1 -- 172.21.15.42:0/87400483 wait complete. 2024-09-17T01:36:08.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.530+0000 7efe62c00640 1 Processor -- start 2024-09-17T01:36:08.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.531+0000 7efe62c00640 1 -- start start 2024-09-17T01:36:08.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.532+0000 7efe62c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe5c0b56d0 0x7efe5c06e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:08.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.532+0000 7efe62c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe5c0cdb20 0x7efe5c06e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:08.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.532+0000 7efe62c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe5c1f6720 0x7efe5c1f5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:08.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.532+0000 7efe62c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efe5c15d560 con 0x7efe5c0b56d0 2024-09-17T01:36:08.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.532+0000 7efe62c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efe5c15d3e0 con 0x7efe5c0cdb20 2024-09-17T01:36:08.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.532+0000 7efe62c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7efe5c15d6e0 con 0x7efe5c1f6720 2024-09-17T01:36:08.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.532+0000 7efe5be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe5c0b56d0 0x7efe5c06e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:08.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.532+0000 7efe5be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe5c0b56d0 0x7efe5c06e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43926/0 (socket says 172.21.15.42:43926) 2024-09-17T01:36:08.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.532+0000 7efe5be00640 1 -- 172.21.15.42:0/3352572674 learned_addr learned my addr 172.21.15.42:0/3352572674 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:08.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.533+0000 7efe5b400640 1 --2- 172.21.15.42:0/3352572674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe5c0cdb20 0x7efe5c06e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:08.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.533+0000 7efe60c00640 1 --2- 172.21.15.42:0/3352572674 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe5c1f6720 0x7efe5c1f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:08.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.533+0000 7efe5be00640 1 -- 172.21.15.42:0/3352572674 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe5c1f6720 msgr2=0x7efe5c1f5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:08.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.533+0000 7efe5be00640 1 --2- 172.21.15.42:0/3352572674 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe5c1f6720 0x7efe5c1f5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:08.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.533+0000 7efe5be00640 1 -- 172.21.15.42:0/3352572674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe5c0cdb20 msgr2=0x7efe5c06e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:08.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.533+0000 7efe5be00640 1 --2- 172.21.15.42:0/3352572674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe5c0cdb20 0x7efe5c06e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:08.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.533+0000 7efe5be00640 1 -- 172.21.15.42:0/3352572674 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe5c1f4860 con 0x7efe5c0b56d0 2024-09-17T01:36:08.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.533+0000 7efe5be00640 1 --2- 172.21.15.42:0/3352572674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe5c0b56d0 0x7efe5c06e2e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00e9c0 tx=0x7efe4c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:08.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.533+0000 7efe53e00640 1 -- 172.21.15.42:0/3352572674 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4c00cd20 con 0x7efe5c0b56d0 2024-09-17T01:36:08.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.533+0000 7efe53e00640 1 -- 172.21.15.42:0/3352572674 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe4c004020 con 0x7efe5c0b56d0 2024-09-17T01:36:08.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.533+0000 7efe53e00640 1 -- 172.21.15.42:0/3352572674 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4c004450 con 0x7efe5c0b56d0 2024-09-17T01:36:08.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.533+0000 7efe62c00640 1 -- 172.21.15.42:0/3352572674 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe5c1f4b40 con 0x7efe5c0b56d0 2024-09-17T01:36:08.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.534+0000 7efe62c00640 1 -- 172.21.15.42:0/3352572674 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe5c1f5100 con 0x7efe5c0b56d0 2024-09-17T01:36:08.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.535+0000 7efe62c00640 1 -- 172.21.15.42:0/3352572674 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe5c15dc00 con 0x7efe5c0b56d0 2024-09-17T01:36:08.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.536+0000 7efe53e00640 1 -- 172.21.15.42:0/3352572674 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efe4c0035f0 con 0x7efe5c0b56d0 2024-09-17T01:36:08.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.537+0000 7efe53e00640 1 --2- 172.21.15.42:0/3352572674 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efe3c078b90 0x7efe3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:08.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.537+0000 7efe53e00640 1 -- 172.21.15.42:0/3352572674 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4857+0+0 (secure 0 0 0) 0x7efe4c09b3a0 con 0x7efe5c0b56d0 2024-09-17T01:36:08.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.537+0000 7efe5b400640 1 --2- 172.21.15.42:0/3352572674 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efe3c078b90 0x7efe3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:08.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.538+0000 7efe5b400640 1 --2- 172.21.15.42:0/3352572674 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efe3c078b90 0x7efe3c07b0a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efe5c15c690 tx=0x7efe48009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:08.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.541+0000 7efe53e00640 1 -- 172.21.15.42:0/3352572674 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efe4c063a90 con 0x7efe5c0b56d0 2024-09-17T01:36:08.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:08.733+0000 7efe62c00640 1 -- 172.21.15.42:0/3352572674 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7efe5c0ce250 con 0x7efe5c0b56d0 2024-09-17T01:36:09.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.264+0000 7efe53e00640 1 -- 172.21.15.42:0/3352572674 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v59) ==== 138+0+0 (secure 0 0 0) 0x7efe4c063390 con 0x7efe5c0b56d0 2024-09-17T01:36:09.262 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-09-17T01:36:09.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.266+0000 7efe62c00640 1 -- 172.21.15.42:0/3352572674 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efe3c078b90 msgr2=0x7efe3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:09.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.266+0000 7efe62c00640 1 --2- 172.21.15.42:0/3352572674 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efe3c078b90 0x7efe3c07b0a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efe5c15c690 tx=0x7efe48009040 comp rx=0 tx=0).stop 2024-09-17T01:36:09.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.266+0000 7efe62c00640 1 -- 172.21.15.42:0/3352572674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe5c0b56d0 msgr2=0x7efe5c06e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:09.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.266+0000 7efe62c00640 1 --2- 172.21.15.42:0/3352572674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe5c0b56d0 0x7efe5c06e2e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00e9c0 tx=0x7efe4c00ee80 comp rx=0 tx=0).stop 2024-09-17T01:36:09.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.267+0000 7efe62c00640 1 -- 172.21.15.42:0/3352572674 shutdown_connections 2024-09-17T01:36:09.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.267+0000 7efe62c00640 1 --2- 172.21.15.42:0/3352572674 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efe3c078b90 0x7efe3c07b0a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:09.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.267+0000 7efe62c00640 1 --2- 172.21.15.42:0/3352572674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe5c0cdb20 0x7efe5c06e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:09.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.267+0000 7efe62c00640 1 --2- 172.21.15.42:0/3352572674 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe5c1f6720 0x7efe5c1f5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:09.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.267+0000 7efe62c00640 1 --2- 172.21.15.42:0/3352572674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe5c0b56d0 0x7efe5c06e2e0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:09.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.267+0000 7efe62c00640 1 -- 172.21.15.42:0/3352572674 >> 172.21.15.42:0/3352572674 conn(0x7efe5c0b28f0 msgr2=0x7efe5c145d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:09.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.267+0000 7efe62c00640 1 -- 172.21.15.42:0/3352572674 shutdown_connections 2024-09-17T01:36:09.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.267+0000 7efe62c00640 1 -- 172.21.15.42:0/3352572674 wait complete. 2024-09-17T01:36:09.292 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T01:36:09.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.532+0000 7f78aae00640 1 -- 172.21.15.42:0/1202723742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78a4160310 msgr2=0x7f78a4071b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:09.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.532+0000 7f78aae00640 1 --2- 172.21.15.42:0/1202723742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78a4160310 0x7f78a4071b30 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f7890009830 tx=0x7f789002a510 comp rx=0 tx=0).stop 2024-09-17T01:36:09.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.532+0000 7f78aae00640 1 -- 172.21.15.42:0/1202723742 shutdown_connections 2024-09-17T01:36:09.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.532+0000 7f78aae00640 1 --2- 172.21.15.42:0/1202723742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78a4160310 0x7f78a4071b30 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:09.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.532+0000 7f78aae00640 1 --2- 172.21.15.42:0/1202723742 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f78a41538e0 0x7f78a415cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:09.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.532+0000 7f78aae00640 1 -- 172.21.15.42:0/1202723742 >> 172.21.15.42:0/1202723742 conn(0x7f78a4070770 msgr2=0x7f78a4070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:09.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.532+0000 7f78aae00640 1 -- 172.21.15.42:0/1202723742 shutdown_connections 2024-09-17T01:36:09.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.532+0000 7f78aae00640 1 -- 172.21.15.42:0/1202723742 wait complete. 2024-09-17T01:36:09.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.534+0000 7f78aae00640 1 Processor -- start 2024-09-17T01:36:09.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.534+0000 7f78aae00640 1 -- start start 2024-09-17T01:36:09.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.536+0000 7f78aae00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78a4072070 0x7f78a40b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:09.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.536+0000 7f78aae00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78a41538e0 0x7f78a4147d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:09.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.536+0000 7f78aae00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f78a4160310 0x7f78a4150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:09.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.536+0000 7f78aae00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f78a40749e0 con 0x7f78a41538e0 2024-09-17T01:36:09.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.536+0000 7f78aae00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f78a40d1df0 con 0x7f78a4072070 2024-09-17T01:36:09.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.536+0000 7f78aae00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f78a4074b60 con 0x7f78a4160310 2024-09-17T01:36:09.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.536+0000 7f78a9000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78a41538e0 0x7f78a4147d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:09.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.536+0000 7f78a9000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78a41538e0 0x7f78a4147d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43956/0 (socket says 172.21.15.42:43956) 2024-09-17T01:36:09.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.536+0000 7f78a9000640 1 -- 172.21.15.42:0/2783758928 learned_addr learned my addr 172.21.15.42:0/2783758928 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:09.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.536+0000 7f78a9a00640 1 --2- 172.21.15.42:0/2783758928 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78a4072070 0x7f78a40b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:09.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.536+0000 7f78aa400640 1 --2- 172.21.15.42:0/2783758928 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f78a4160310 0x7f78a4150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:09.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.536+0000 7f78a9000640 1 -- 172.21.15.42:0/2783758928 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f78a4160310 msgr2=0x7f78a4150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:09.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.536+0000 7f78a9000640 1 --2- 172.21.15.42:0/2783758928 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f78a4160310 0x7f78a4150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:09.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.536+0000 7f78a9000640 1 -- 172.21.15.42:0/2783758928 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78a4072070 msgr2=0x7f78a40b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:09.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.536+0000 7f78a9000640 1 --2- 172.21.15.42:0/2783758928 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78a4072070 0x7f78a40b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:09.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.536+0000 7f78a9000640 1 -- 172.21.15.42:0/2783758928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a4154240 con 0x7f78a41538e0 2024-09-17T01:36:09.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.537+0000 7f78a9000640 1 --2- 172.21.15.42:0/2783758928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78a41538e0 0x7f78a4147d30 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f7890009950 tx=0x7f7890033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:09.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.537+0000 7f78a1600640 1 -- 172.21.15.42:0/2783758928 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7890005c90 con 0x7f78a41538e0 2024-09-17T01:36:09.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.537+0000 7f78a1600640 1 -- 172.21.15.42:0/2783758928 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7890031e50 con 0x7f78a41538e0 2024-09-17T01:36:09.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.537+0000 7f78aae00640 1 -- 172.21.15.42:0/2783758928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a4154520 con 0x7f78a41538e0 2024-09-17T01:36:09.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.537+0000 7f78a1600640 1 -- 172.21.15.42:0/2783758928 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7890033310 con 0x7f78a41538e0 2024-09-17T01:36:09.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.537+0000 7f78aae00640 1 -- 172.21.15.42:0/2783758928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a4154ae0 con 0x7f78a41538e0 2024-09-17T01:36:09.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.538+0000 7f78aae00640 1 -- 172.21.15.42:0/2783758928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78a4153f90 con 0x7f78a41538e0 2024-09-17T01:36:09.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.540+0000 7f78a1600640 1 -- 172.21.15.42:0/2783758928 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f78900334b0 con 0x7f78a41538e0 2024-09-17T01:36:09.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.541+0000 7f78a1600640 1 --2- 172.21.15.42:0/2783758928 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7884078b90 0x7f788407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:09.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.541+0000 7f78a1600640 1 -- 172.21.15.42:0/2783758928 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5227+0+0 (secure 0 0 0) 0x7f78900bc520 con 0x7f78a41538e0 2024-09-17T01:36:09.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.541+0000 7f78a9a00640 1 --2- 172.21.15.42:0/2783758928 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7884078b90 0x7f788407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:09.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.542+0000 7f78a9a00640 1 --2- 172.21.15.42:0/2783758928 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7884078b90 0x7f788407b0a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7898005fd0 tx=0x7f7898005850 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:09.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.545+0000 7f78a1600640 1 -- 172.21.15.42:0/2783758928 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f789004a020 con 0x7f78a41538e0 2024-09-17T01:36:09.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:09.741+0000 7f78aae00640 1 -- 172.21.15.42:0/2783758928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f78a4075080 con 0x7f78a41538e0 2024-09-17T01:36:10.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.267+0000 7f78a1600640 1 -- 172.21.15.42:0/2783758928 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v60) ==== 170+0+0 (secure 0 0 0) 0x7f789003f030 con 0x7f78a41538e0 2024-09-17T01:36:10.265 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-09-17T01:36:10.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.270+0000 7f78aae00640 1 -- 172.21.15.42:0/2783758928 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7884078b90 msgr2=0x7f788407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:10.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.270+0000 7f78aae00640 1 --2- 172.21.15.42:0/2783758928 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7884078b90 0x7f788407b0a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7898005fd0 tx=0x7f7898005850 comp rx=0 tx=0).stop 2024-09-17T01:36:10.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.270+0000 7f78aae00640 1 -- 172.21.15.42:0/2783758928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78a41538e0 msgr2=0x7f78a4147d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:10.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.270+0000 7f78aae00640 1 --2- 172.21.15.42:0/2783758928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78a41538e0 0x7f78a4147d30 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f7890009950 tx=0x7f7890033c90 comp rx=0 tx=0).stop 2024-09-17T01:36:10.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.270+0000 7f78aae00640 1 -- 172.21.15.42:0/2783758928 shutdown_connections 2024-09-17T01:36:10.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.270+0000 7f78aae00640 1 --2- 172.21.15.42:0/2783758928 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7884078b90 0x7f788407b0a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:10.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.270+0000 7f78aae00640 1 --2- 172.21.15.42:0/2783758928 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f78a4160310 0x7f78a4150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:10.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.270+0000 7f78aae00640 1 --2- 172.21.15.42:0/2783758928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78a41538e0 0x7f78a4147d30 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:10.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.270+0000 7f78aae00640 1 --2- 172.21.15.42:0/2783758928 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78a4072070 0x7f78a40b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:10.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.270+0000 7f78aae00640 1 -- 172.21.15.42:0/2783758928 >> 172.21.15.42:0/2783758928 conn(0x7f78a4070770 msgr2=0x7f78a40b5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:10.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.271+0000 7f78aae00640 1 -- 172.21.15.42:0/2783758928 shutdown_connections 2024-09-17T01:36:10.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.271+0000 7f78aae00640 1 -- 172.21.15.42:0/2783758928 wait complete. 2024-09-17T01:36:10.309 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T01:36:10.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.543+0000 7f50b5e00640 1 -- 172.21.15.42:0/2112313618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50b0072e90 msgr2=0x7f50b00cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:10.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.543+0000 7f50b5e00640 1 --2- 172.21.15.42:0/2112313618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50b0072e90 0x7f50b00cec40 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f50a8005fd0 tx=0x7f50a802a820 comp rx=0 tx=0).stop 2024-09-17T01:36:10.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.543+0000 7f50b5e00640 1 -- 172.21.15.42:0/2112313618 shutdown_connections 2024-09-17T01:36:10.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.543+0000 7f50b5e00640 1 --2- 172.21.15.42:0/2112313618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50b0072e90 0x7f50b00cec40 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:10.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.543+0000 7f50b5e00640 1 --2- 172.21.15.42:0/2112313618 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50b0142f40 0x7f50b0072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:10.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.543+0000 7f50b5e00640 1 -- 172.21.15.42:0/2112313618 >> 172.21.15.42:0/2112313618 conn(0x7f50b00b2930 msgr2=0x7f50b006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:10.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.543+0000 7f50b5e00640 1 -- 172.21.15.42:0/2112313618 shutdown_connections 2024-09-17T01:36:10.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.543+0000 7f50b5e00640 1 -- 172.21.15.42:0/2112313618 wait complete. 2024-09-17T01:36:10.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.545+0000 7f50b5e00640 1 Processor -- start 2024-09-17T01:36:10.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.546+0000 7f50b5e00640 1 -- start start 2024-09-17T01:36:10.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.547+0000 7f50b5e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50b0072e90 0x7f50b01f8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:10.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.547+0000 7f50b5e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50b00b3550 0x7f50b00c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:10.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.547+0000 7f50b5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50b0142f40 0x7f50b014fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:10.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.547+0000 7f50b5e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f50b006d7c0 con 0x7f50b0142f40 2024-09-17T01:36:10.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.547+0000 7f50b5e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f50b006d640 con 0x7f50b0072e90 2024-09-17T01:36:10.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.547+0000 7f50b5e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f50b006d940 con 0x7f50b00b3550 2024-09-17T01:36:10.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.547+0000 7f50af400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50b0142f40 0x7f50b014fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:10.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.547+0000 7f50af400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50b0142f40 0x7f50b014fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:43980/0 (socket says 172.21.15.42:43980) 2024-09-17T01:36:10.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.547+0000 7f50af400640 1 -- 172.21.15.42:0/2901728876 learned_addr learned my addr 172.21.15.42:0/2901728876 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:10.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.548+0000 7f50aea00640 1 --2- 172.21.15.42:0/2901728876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50b0072e90 0x7f50b01f8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:10.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.548+0000 7f50a7e00640 1 --2- 172.21.15.42:0/2901728876 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50b00b3550 0x7f50b00c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:10.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.548+0000 7f50af400640 1 -- 172.21.15.42:0/2901728876 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50b00b3550 msgr2=0x7f50b00c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:10.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.548+0000 7f50af400640 1 --2- 172.21.15.42:0/2901728876 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50b00b3550 0x7f50b00c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:10.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.548+0000 7f50af400640 1 -- 172.21.15.42:0/2901728876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50b0072e90 msgr2=0x7f50b01f8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:10.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.548+0000 7f50af400640 1 --2- 172.21.15.42:0/2901728876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50b0072e90 0x7f50b01f8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:10.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.548+0000 7f50af400640 1 -- 172.21.15.42:0/2901728876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b01f9840 con 0x7f50b0142f40 2024-09-17T01:36:10.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.548+0000 7f50af400640 1 --2- 172.21.15.42:0/2901728876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50b0142f40 0x7f50b014fc10 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f50a8006010 tx=0x7f50a8032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:10.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.548+0000 7f50a7400640 1 -- 172.21.15.42:0/2901728876 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a8037040 con 0x7f50b0142f40 2024-09-17T01:36:10.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.549+0000 7f50a7400640 1 -- 172.21.15.42:0/2901728876 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50a8042070 con 0x7f50b0142f40 2024-09-17T01:36:10.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.549+0000 7f50b5e00640 1 -- 172.21.15.42:0/2901728876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50b01f9b20 con 0x7f50b0142f40 2024-09-17T01:36:10.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.549+0000 7f50a7400640 1 -- 172.21.15.42:0/2901728876 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a80042a0 con 0x7f50b0142f40 2024-09-17T01:36:10.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.549+0000 7f50b5e00640 1 -- 172.21.15.42:0/2901728876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50b014f410 con 0x7f50b0142f40 2024-09-17T01:36:10.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.550+0000 7f50b5e00640 1 -- 172.21.15.42:0/2901728876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50b00cec40 con 0x7f50b0142f40 2024-09-17T01:36:10.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.551+0000 7f50a7400640 1 -- 172.21.15.42:0/2901728876 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f50a8004440 con 0x7f50b0142f40 2024-09-17T01:36:10.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.552+0000 7f50a7400640 1 --2- 172.21.15.42:0/2901728876 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f508c078b90 0x7f508c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:10.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.552+0000 7f50a7400640 1 -- 172.21.15.42:0/2901728876 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5609+0+0 (secure 0 0 0) 0x7f50a80bc5e0 con 0x7f50b0142f40 2024-09-17T01:36:10.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.553+0000 7f50aea00640 1 --2- 172.21.15.42:0/2901728876 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f508c078b90 0x7f508c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:10.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.553+0000 7f50aea00640 1 --2- 172.21.15.42:0/2901728876 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f508c078b90 0x7f508c07b0a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f50a00015b0 tx=0x7f50a0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:10.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.556+0000 7f50a7400640 1 -- 172.21.15.42:0/2901728876 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f50a8084af0 con 0x7f50b0142f40 2024-09-17T01:36:10.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:10.788+0000 7f50b5e00640 1 -- 172.21.15.42:0/2901728876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f50b006a170 con 0x7f50b0142f40 2024-09-17T01:36:11.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.292+0000 7f50a7400640 1 -- 172.21.15.42:0/2901728876 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v37) ==== 172+0+0 (secure 0 0 0) 0x7f50a80843f0 con 0x7f50b0142f40 2024-09-17T01:36:11.290 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 8 and data pool 9 2024-09-17T01:36:11.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.300+0000 7f50b5e00640 1 -- 172.21.15.42:0/2901728876 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f508c078b90 msgr2=0x7f508c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:11.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.300+0000 7f50b5e00640 1 --2- 172.21.15.42:0/2901728876 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f508c078b90 0x7f508c07b0a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f50a00015b0 tx=0x7f50a0009040 comp rx=0 tx=0).stop 2024-09-17T01:36:11.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.300+0000 7f50b5e00640 1 -- 172.21.15.42:0/2901728876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50b0142f40 msgr2=0x7f50b014fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:11.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.300+0000 7f50b5e00640 1 --2- 172.21.15.42:0/2901728876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50b0142f40 0x7f50b014fc10 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f50a8006010 tx=0x7f50a8032c90 comp rx=0 tx=0).stop 2024-09-17T01:36:11.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.300+0000 7f50b5e00640 1 -- 172.21.15.42:0/2901728876 shutdown_connections 2024-09-17T01:36:11.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.300+0000 7f50b5e00640 1 --2- 172.21.15.42:0/2901728876 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f508c078b90 0x7f508c07b0a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:11.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.300+0000 7f50b5e00640 1 --2- 172.21.15.42:0/2901728876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50b0142f40 0x7f50b014fc10 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:11.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.300+0000 7f50b5e00640 1 --2- 172.21.15.42:0/2901728876 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50b00b3550 0x7f50b00c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:11.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.300+0000 7f50b5e00640 1 --2- 172.21.15.42:0/2901728876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50b0072e90 0x7f50b01f8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:11.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.300+0000 7f50b5e00640 1 -- 172.21.15.42:0/2901728876 >> 172.21.15.42:0/2901728876 conn(0x7f50b00b2930 msgr2=0x7f50b015f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:11.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.301+0000 7f50b5e00640 1 -- 172.21.15.42:0/2901728876 shutdown_connections 2024-09-17T01:36:11.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.301+0000 7f50b5e00640 1 -- 172.21.15.42:0/2901728876 wait complete. 2024-09-17T01:36:11.341 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:36:11.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.572+0000 7f4e79e00640 1 -- 172.21.15.42:0/2651212963 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e740d2810 msgr2=0x7f4e7415e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:11.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.572+0000 7f4e79e00640 1 --2- 172.21.15.42:0/2651212963 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e740d2810 0x7f4e7415e910 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009830 tx=0x7f4e6002a480 comp rx=0 tx=0).stop 2024-09-17T01:36:11.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.572+0000 7f4e79e00640 1 -- 172.21.15.42:0/2651212963 shutdown_connections 2024-09-17T01:36:11.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.572+0000 7f4e79e00640 1 --2- 172.21.15.42:0/2651212963 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4e740b6030 0x7f4e740b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:11.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.572+0000 7f4e79e00640 1 --2- 172.21.15.42:0/2651212963 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e740d2810 0x7f4e7415e910 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:11.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.572+0000 7f4e79e00640 1 -- 172.21.15.42:0/2651212963 >> 172.21.15.42:0/2651212963 conn(0x7f4e740d1210 msgr2=0x7f4e740d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:11.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.572+0000 7f4e79e00640 1 -- 172.21.15.42:0/2651212963 shutdown_connections 2024-09-17T01:36:11.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.572+0000 7f4e79e00640 1 -- 172.21.15.42:0/2651212963 wait complete. 2024-09-17T01:36:11.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.574+0000 7f4e79e00640 1 Processor -- start 2024-09-17T01:36:11.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.574+0000 7f4e79e00640 1 -- start start 2024-09-17T01:36:11.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.576+0000 7f4e79e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e74073340 0x7f4e740c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:11.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.576+0000 7f4e79e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e740b6030 0x7f4e7415a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:11.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.576+0000 7f4e79e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4e740d2810 0x7f4e741497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:11.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.576+0000 7f4e79e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7415f880 con 0x7f4e740b6030 2024-09-17T01:36:11.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.576+0000 7f4e79e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7415f700 con 0x7f4e74073340 2024-09-17T01:36:11.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.576+0000 7f4e79e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4e7415fa00 con 0x7f4e740d2810 2024-09-17T01:36:11.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.576+0000 7f4e73e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e740b6030 0x7f4e7415a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:11.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.576+0000 7f4e73e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e740b6030 0x7f4e7415a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44006/0 (socket says 172.21.15.42:44006) 2024-09-17T01:36:11.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.576+0000 7f4e73e00640 1 -- 172.21.15.42:0/3396528371 learned_addr learned my addr 172.21.15.42:0/3396528371 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:11.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.576+0000 7f4e78a00640 1 --2- 172.21.15.42:0/3396528371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e74073340 0x7f4e740c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:11.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.576+0000 7f4e79400640 1 --2- 172.21.15.42:0/3396528371 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4e740d2810 0x7f4e741497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:11.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.576+0000 7f4e73e00640 1 -- 172.21.15.42:0/3396528371 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4e740d2810 msgr2=0x7f4e741497e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:11.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.576+0000 7f4e73e00640 1 --2- 172.21.15.42:0/3396528371 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4e740d2810 0x7f4e741497e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:11.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.576+0000 7f4e73e00640 1 -- 172.21.15.42:0/3396528371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e74073340 msgr2=0x7f4e740c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:11.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.576+0000 7f4e73e00640 1 --2- 172.21.15.42:0/3396528371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e74073340 0x7f4e740c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:11.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.576+0000 7f4e73e00640 1 -- 172.21.15.42:0/3396528371 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e740c9b90 con 0x7f4e740b6030 2024-09-17T01:36:11.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.576+0000 7f4e79400640 1 --2- 172.21.15.42:0/3396528371 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4e740d2810 0x7f4e741497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:36:11.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.576+0000 7f4e78a00640 1 --2- 172.21.15.42:0/3396528371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e74073340 0x7f4e740c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:36:11.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.577+0000 7f4e73e00640 1 --2- 172.21.15.42:0/3396528371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e740b6030 0x7f4e7415a060 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f4e6002aa70 tx=0x7f4e60033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:11.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.577+0000 7f4e70c00640 1 -- 172.21.15.42:0/3396528371 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60031d60 con 0x7f4e740b6030 2024-09-17T01:36:11.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.577+0000 7f4e70c00640 1 -- 172.21.15.42:0/3396528371 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e60033e10 con 0x7f4e740b6030 2024-09-17T01:36:11.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.577+0000 7f4e79e00640 1 -- 172.21.15.42:0/3396528371 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e74158310 con 0x7f4e740b6030 2024-09-17T01:36:11.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.577+0000 7f4e70c00640 1 -- 172.21.15.42:0/3396528371 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60005260 con 0x7f4e740b6030 2024-09-17T01:36:11.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.577+0000 7f4e79e00640 1 -- 172.21.15.42:0/3396528371 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e741588d0 con 0x7f4e740b6030 2024-09-17T01:36:11.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.578+0000 7f4e79e00640 1 -- 172.21.15.42:0/3396528371 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e74158b10 con 0x7f4e740b6030 2024-09-17T01:36:11.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.580+0000 7f4e70c00640 1 -- 172.21.15.42:0/3396528371 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4e60005400 con 0x7f4e740b6030 2024-09-17T01:36:11.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.581+0000 7f4e70c00640 1 --2- 172.21.15.42:0/3396528371 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4e54078bc0 0x7f4e5407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:11.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.581+0000 7f4e70c00640 1 -- 172.21.15.42:0/3396528371 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f4e600bbfe0 con 0x7f4e740b6030 2024-09-17T01:36:11.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.581+0000 7f4e78a00640 1 --2- 172.21.15.42:0/3396528371 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4e54078bc0 0x7f4e5407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:11.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.582+0000 7f4e78a00640 1 --2- 172.21.15.42:0/3396528371 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4e54078bc0 0x7f4e5407b0d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4e68000f60 tx=0x7f4e68009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:11.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.585+0000 7f4e70c00640 1 -- 172.21.15.42:0/3396528371 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4e6003f030 con 0x7f4e740b6030 2024-09-17T01:36:11.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.783+0000 7f4e79e00640 1 -- 172.21.15.42:0/3396528371 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e7415ff20 con 0x7f4e740b6030 2024-09-17T01:36:11.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.784+0000 7f4e70c00640 1 -- 172.21.15.42:0/3396528371 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16690 (secure 0 0 0) 0x7f4e60084380 con 0x7f4e740b6030 2024-09-17T01:36:11.782 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:11.782 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":61,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:36:10.790125+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:36:08.745986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T01:36:09.754042+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:36:11.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.786+0000 7f4e79e00640 1 -- 172.21.15.42:0/3396528371 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4e54078bc0 msgr2=0x7f4e5407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.786+0000 7f4e79e00640 1 --2- 172.21.15.42:0/3396528371 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4e54078bc0 0x7f4e5407b0d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4e68000f60 tx=0x7f4e68009040 comp rx=0 tx=0).stop 2024-09-17T01:36:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.786+0000 7f4e79e00640 1 -- 172.21.15.42:0/3396528371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e740b6030 msgr2=0x7f4e7415a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.786+0000 7f4e79e00640 1 --2- 172.21.15.42:0/3396528371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e740b6030 0x7f4e7415a060 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f4e6002aa70 tx=0x7f4e60033c20 comp rx=0 tx=0).stop 2024-09-17T01:36:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.786+0000 7f4e79e00640 1 -- 172.21.15.42:0/3396528371 shutdown_connections 2024-09-17T01:36:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.786+0000 7f4e79e00640 1 --2- 172.21.15.42:0/3396528371 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4e54078bc0 0x7f4e5407b0d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.786+0000 7f4e79e00640 1 --2- 172.21.15.42:0/3396528371 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4e740d2810 0x7f4e741497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.786+0000 7f4e79e00640 1 --2- 172.21.15.42:0/3396528371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e740b6030 0x7f4e7415a060 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.786+0000 7f4e79e00640 1 --2- 172.21.15.42:0/3396528371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e74073340 0x7f4e740c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.786+0000 7f4e79e00640 1 -- 172.21.15.42:0/3396528371 >> 172.21.15.42:0/3396528371 conn(0x7f4e740d1210 msgr2=0x7f4e741624f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:11.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.787+0000 7f4e79e00640 1 -- 172.21.15.42:0/3396528371 shutdown_connections 2024-09-17T01:36:11.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:11.787+0000 7f4e79e00640 1 -- 172.21.15.42:0/3396528371 wait complete. 2024-09-17T01:36:11.806 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:36:12.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.035+0000 7f8e61000640 1 -- 172.21.15.42:0/3029774493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e40003c10 msgr2=0x7f8e40004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:12.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.035+0000 7f8e61000640 1 --2- 172.21.15.42:0/3029774493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e40003c10 0x7f8e40004060 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c009b20 tx=0x7f8e40005830 comp rx=0 tx=0).stop 2024-09-17T01:36:12.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.035+0000 7f8e5be00640 1 -- 172.21.15.42:0/3029774493 reap_dead start 2024-09-17T01:36:12.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.035+0000 7f8e61000640 1 -- 172.21.15.42:0/3029774493 shutdown_connections 2024-09-17T01:36:12.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.035+0000 7f8e61000640 1 -- 172.21.15.42:0/3029774493 >> 172.21.15.42:0/3029774493 conn(0x7f8e5c06d890 msgr2=0x7f8e5c0b2330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:12.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.036+0000 7f8e61000640 1 -- 172.21.15.42:0/3029774493 shutdown_connections 2024-09-17T01:36:12.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.036+0000 7f8e61000640 1 -- 172.21.15.42:0/3029774493 wait complete. 2024-09-17T01:36:12.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.038+0000 7f8e61000640 1 Processor -- start 2024-09-17T01:36:12.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.038+0000 7f8e61000640 1 -- start start 2024-09-17T01:36:12.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.039+0000 7f8e61000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8e40003c10 0x7f8e5c0abe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:12.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.039+0000 7f8e61000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e5c0ac360 0x7f8e5c1f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:12.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.039+0000 7f8e61000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e5c1f72e0 0x7f8e5c1599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:12.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.039+0000 7f8e61000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5c073fd0 con 0x7f8e5c0ac360 2024-09-17T01:36:12.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.039+0000 7f8e61000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5c073e50 con 0x7f8e5c1f72e0 2024-09-17T01:36:12.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.039+0000 7f8e61000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8e5c0ce530 con 0x7f8e40003c10 2024-09-17T01:36:12.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.040+0000 7f8e5aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e5c0ac360 0x7f8e5c1f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:12.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.040+0000 7f8e5aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e5c0ac360 0x7f8e5c1f6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44014/0 (socket says 172.21.15.42:44014) 2024-09-17T01:36:12.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.040+0000 7f8e5aa00640 1 -- 172.21.15.42:0/3639431764 learned_addr learned my addr 172.21.15.42:0/3639431764 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:12.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.040+0000 7f8e5be00640 1 --2- 172.21.15.42:0/3639431764 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e5c1f72e0 0x7f8e5c1599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:12.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.040+0000 7f8e5b400640 1 --2- 172.21.15.42:0/3639431764 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8e40003c10 0x7f8e5c0abe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:12.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.040+0000 7f8e5aa00640 1 -- 172.21.15.42:0/3639431764 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8e40003c10 msgr2=0x7f8e5c0abe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:12.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.040+0000 7f8e5aa00640 1 --2- 172.21.15.42:0/3639431764 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8e40003c10 0x7f8e5c0abe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:12.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.040+0000 7f8e5aa00640 1 -- 172.21.15.42:0/3639431764 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e5c1f72e0 msgr2=0x7f8e5c1599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:12.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.040+0000 7f8e5aa00640 1 --2- 172.21.15.42:0/3639431764 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e5c1f72e0 0x7f8e5c1599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:12.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.040+0000 7f8e5aa00640 1 -- 172.21.15.42:0/3639431764 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e5c1f30c0 con 0x7f8e5c0ac360 2024-09-17T01:36:12.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.040+0000 7f8e5aa00640 1 --2- 172.21.15.42:0/3639431764 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e5c0ac360 0x7f8e5c1f6da0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f8e4800e5c0 tx=0x7f8e4800ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:12.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.041+0000 7f8e53400640 1 -- 172.21.15.42:0/3639431764 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e48015070 con 0x7f8e5c0ac360 2024-09-17T01:36:12.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.041+0000 7f8e53400640 1 -- 172.21.15.42:0/3639431764 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e480109a0 con 0x7f8e5c0ac360 2024-09-17T01:36:12.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.041+0000 7f8e61000640 1 -- 172.21.15.42:0/3639431764 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e5c0ac8a0 con 0x7f8e5c0ac360 2024-09-17T01:36:12.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.041+0000 7f8e53400640 1 -- 172.21.15.42:0/3639431764 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e48010df0 con 0x7f8e5c0ac360 2024-09-17T01:36:12.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.041+0000 7f8e61000640 1 -- 172.21.15.42:0/3639431764 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e5c1f3660 con 0x7f8e5c0ac360 2024-09-17T01:36:12.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.042+0000 7f8e61000640 1 -- 172.21.15.42:0/3639431764 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e5c160930 con 0x7f8e5c0ac360 2024-09-17T01:36:12.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.044+0000 7f8e53400640 1 -- 172.21.15.42:0/3639431764 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8e48018070 con 0x7f8e5c0ac360 2024-09-17T01:36:12.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.044+0000 7f8e53400640 1 --2- 172.21.15.42:0/3639431764 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8e3c078b90 0x7f8e3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:12.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.045+0000 7f8e53400640 1 -- 172.21.15.42:0/3639431764 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5709+0+0 (secure 0 0 0) 0x7f8e4809b060 con 0x7f8e5c0ac360 2024-09-17T01:36:12.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.045+0000 7f8e5b400640 1 --2- 172.21.15.42:0/3639431764 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8e3c078b90 0x7f8e3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:12.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.046+0000 7f8e5b400640 1 --2- 172.21.15.42:0/3639431764 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8e3c078b90 0x7f8e3c07b0a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c035000 tx=0x7f8e4c02d040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:12.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.049+0000 7f8e53400640 1 -- 172.21.15.42:0/3639431764 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8e48062db0 con 0x7f8e5c0ac360 2024-09-17T01:36:12.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.242+0000 7f8e61000640 1 -- 172.21.15.42:0/3639431764 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e5c15f1e0 con 0x7f8e5c0ac360 2024-09-17T01:36:12.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.243+0000 7f8e53400640 1 -- 172.21.15.42:0/3639431764 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16690 (secure 0 0 0) 0x7f8e480677e0 con 0x7f8e5c0ac360 2024-09-17T01:36:12.241 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:12.241 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":61,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:36:10.790125+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:36:08.745986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T01:36:09.754042+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:36:12.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.245+0000 7f8e61000640 1 -- 172.21.15.42:0/3639431764 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8e3c078b90 msgr2=0x7f8e3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:12.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.245+0000 7f8e61000640 1 --2- 172.21.15.42:0/3639431764 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8e3c078b90 0x7f8e3c07b0a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c035000 tx=0x7f8e4c02d040 comp rx=0 tx=0).stop 2024-09-17T01:36:12.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.245+0000 7f8e61000640 1 -- 172.21.15.42:0/3639431764 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e5c0ac360 msgr2=0x7f8e5c1f6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:12.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.245+0000 7f8e61000640 1 --2- 172.21.15.42:0/3639431764 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e5c0ac360 0x7f8e5c1f6da0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f8e4800e5c0 tx=0x7f8e4800ea80 comp rx=0 tx=0).stop 2024-09-17T01:36:12.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.246+0000 7f8e61000640 1 -- 172.21.15.42:0/3639431764 shutdown_connections 2024-09-17T01:36:12.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.246+0000 7f8e61000640 1 --2- 172.21.15.42:0/3639431764 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8e3c078b90 0x7f8e3c07b0a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:12.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.246+0000 7f8e61000640 1 --2- 172.21.15.42:0/3639431764 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e5c1f72e0 0x7f8e5c1599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:12.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.246+0000 7f8e61000640 1 --2- 172.21.15.42:0/3639431764 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e5c0ac360 0x7f8e5c1f6da0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:12.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.246+0000 7f8e61000640 1 --2- 172.21.15.42:0/3639431764 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8e40003c10 0x7f8e5c0abe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:12.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.246+0000 7f8e61000640 1 -- 172.21.15.42:0/3639431764 >> 172.21.15.42:0/3639431764 conn(0x7f8e5c06d890 msgr2=0x7f8e5c15a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:12.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.246+0000 7f8e61000640 1 -- 172.21.15.42:0/3639431764 shutdown_connections 2024-09-17T01:36:12.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.246+0000 7f8e61000640 1 -- 172.21.15.42:0/3639431764 wait complete. 2024-09-17T01:36:12.267 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T01:36:12.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.504+0000 7fbf3f200640 1 -- 172.21.15.42:0/939107285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf1c004d40 msgr2=0x7fbf1c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:12.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.504+0000 7fbf3f200640 1 --2- 172.21.15.42:0/939107285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf1c004d40 0x7fbf1c005150 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fbf380cce70 tx=0x7fbf1c005830 comp rx=0 tx=0).stop 2024-09-17T01:36:12.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.504+0000 7fbf3d200640 1 -- 172.21.15.42:0/939107285 reap_dead start 2024-09-17T01:36:12.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.504+0000 7fbf3f200640 1 -- 172.21.15.42:0/939107285 shutdown_connections 2024-09-17T01:36:12.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.504+0000 7fbf3f200640 1 -- 172.21.15.42:0/939107285 >> 172.21.15.42:0/939107285 conn(0x7fbf380b2930 msgr2=0x7fbf3806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:12.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.505+0000 7fbf3f200640 1 -- 172.21.15.42:0/939107285 shutdown_connections 2024-09-17T01:36:12.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.505+0000 7fbf3f200640 1 -- 172.21.15.42:0/939107285 wait complete. 2024-09-17T01:36:12.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.507+0000 7fbf3f200640 1 Processor -- start 2024-09-17T01:36:12.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.507+0000 7fbf3f200640 1 -- start start 2024-09-17T01:36:12.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.508+0000 7fbf3f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf1c004d40 0x7fbf380aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:12.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.508+0000 7fbf3f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf3813eb20 0x7fbf380b1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:12.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.508+0000 7fbf3f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf3813ef30 0x7fbf380b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:12.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.509+0000 7fbf3f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbf380cf2e0 con 0x7fbf1c004d40 2024-09-17T01:36:12.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.509+0000 7fbf3f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbf380cf160 con 0x7fbf3813ef30 2024-09-17T01:36:12.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.509+0000 7fbf3f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbf380cf460 con 0x7fbf3813eb20 2024-09-17T01:36:12.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.509+0000 7fbf37e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf1c004d40 0x7fbf380aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:12.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.509+0000 7fbf37e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf1c004d40 0x7fbf380aa490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44030/0 (socket says 172.21.15.42:44030) 2024-09-17T01:36:12.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.509+0000 7fbf37e00640 1 -- 172.21.15.42:0/4037486765 learned_addr learned my addr 172.21.15.42:0/4037486765 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:12.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.509+0000 7fbf2fe00640 1 --2- 172.21.15.42:0/4037486765 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf3813eb20 0x7fbf380b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:12.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.509+0000 7fbf3d200640 1 --2- 172.21.15.42:0/4037486765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf3813ef30 0x7fbf380b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:12.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.509+0000 7fbf37e00640 1 -- 172.21.15.42:0/4037486765 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf3813eb20 msgr2=0x7fbf380b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:12.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.509+0000 7fbf37e00640 1 --2- 172.21.15.42:0/4037486765 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf3813eb20 0x7fbf380b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:12.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.509+0000 7fbf37e00640 1 -- 172.21.15.42:0/4037486765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf3813ef30 msgr2=0x7fbf380b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:12.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.509+0000 7fbf37e00640 1 --2- 172.21.15.42:0/4037486765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf3813ef30 0x7fbf380b19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:12.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.509+0000 7fbf37e00640 1 -- 172.21.15.42:0/4037486765 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf380aa9d0 con 0x7fbf1c004d40 2024-09-17T01:36:12.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.510+0000 7fbf37e00640 1 --2- 172.21.15.42:0/4037486765 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf1c004d40 0x7fbf380aa490 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800e630 tx=0x7fbf2800ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:12.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.510+0000 7fbf34c00640 1 -- 172.21.15.42:0/4037486765 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf28015070 con 0x7fbf1c004d40 2024-09-17T01:36:12.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.510+0000 7fbf34c00640 1 -- 172.21.15.42:0/4037486765 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf28004330 con 0x7fbf1c004d40 2024-09-17T01:36:12.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.510+0000 7fbf3f200640 1 -- 172.21.15.42:0/4037486765 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf380aae50 con 0x7fbf1c004d40 2024-09-17T01:36:12.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.510+0000 7fbf34c00640 1 -- 172.21.15.42:0/4037486765 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2800c950 con 0x7fbf1c004d40 2024-09-17T01:36:12.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.510+0000 7fbf3f200640 1 -- 172.21.15.42:0/4037486765 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf380ab410 con 0x7fbf1c004d40 2024-09-17T01:36:12.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.511+0000 7fbf3f200640 1 -- 172.21.15.42:0/4037486765 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf380b39a0 con 0x7fbf1c004d40 2024-09-17T01:36:12.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.512+0000 7fbf34c00640 1 -- 172.21.15.42:0/4037486765 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbf2800caf0 con 0x7fbf1c004d40 2024-09-17T01:36:12.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.513+0000 7fbf34c00640 1 --2- 172.21.15.42:0/4037486765 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbf14078b90 0x7fbf1407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:12.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.513+0000 7fbf34c00640 1 -- 172.21.15.42:0/4037486765 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7fbf2809b190 con 0x7fbf1c004d40 2024-09-17T01:36:12.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.514+0000 7fbf2fe00640 1 --2- 172.21.15.42:0/4037486765 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbf14078b90 0x7fbf1407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:12.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.515+0000 7fbf2fe00640 1 --2- 172.21.15.42:0/4037486765 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbf14078b90 0x7fbf1407b0a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbf3806fd80 tx=0x7fbf20005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:12.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.518+0000 7fbf34c00640 1 -- 172.21.15.42:0/4037486765 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbf380b39a0 con 0x7fbf1c004d40 2024-09-17T01:36:12.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:12.752+0000 7fbf3f200640 1 -- 172.21.15.42:0/4037486765 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fbf3806a170 con 0x7fbf1c004d40 2024-09-17T01:36:13.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.304+0000 7fbf34c00640 1 -- 172.21.15.42:0/4037486765 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v40) ==== 118+0+0 (secure 0 0 0) 0x7fbf28062ee0 con 0x7fbf1c004d40 2024-09-17T01:36:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.308+0000 7fbf3f200640 1 -- 172.21.15.42:0/4037486765 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbf14078b90 msgr2=0x7fbf1407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.308+0000 7fbf3f200640 1 --2- 172.21.15.42:0/4037486765 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbf14078b90 0x7fbf1407b0a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbf3806fd80 tx=0x7fbf20005f90 comp rx=0 tx=0).stop 2024-09-17T01:36:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.308+0000 7fbf3f200640 1 -- 172.21.15.42:0/4037486765 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf1c004d40 msgr2=0x7fbf380aa490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.308+0000 7fbf3f200640 1 --2- 172.21.15.42:0/4037486765 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf1c004d40 0x7fbf380aa490 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800e630 tx=0x7fbf2800ea30 comp rx=0 tx=0).stop 2024-09-17T01:36:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.308+0000 7fbf3f200640 1 -- 172.21.15.42:0/4037486765 shutdown_connections 2024-09-17T01:36:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.308+0000 7fbf3f200640 1 --2- 172.21.15.42:0/4037486765 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbf14078b90 0x7fbf1407b0a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.308+0000 7fbf3f200640 1 --2- 172.21.15.42:0/4037486765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf3813ef30 0x7fbf380b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.308+0000 7fbf3f200640 1 --2- 172.21.15.42:0/4037486765 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf3813eb20 0x7fbf380b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.308+0000 7fbf3f200640 1 --2- 172.21.15.42:0/4037486765 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf1c004d40 0x7fbf380aa490 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:13.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.308+0000 7fbf3f200640 1 -- 172.21.15.42:0/4037486765 >> 172.21.15.42:0/4037486765 conn(0x7fbf380b2930 msgr2=0x7fbf3815b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:13.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.308+0000 7fbf3f200640 1 -- 172.21.15.42:0/4037486765 shutdown_connections 2024-09-17T01:36:13.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.308+0000 7fbf3f200640 1 -- 172.21.15.42:0/4037486765 wait complete. 2024-09-17T01:36:13.332 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T01:36:13.332 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T01:36:13.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.565+0000 7f8bb5a00640 1 -- 172.21.15.42:0/3060776826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bb00b3550 msgr2=0x7f8bb015cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:13.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.565+0000 7f8bb5a00640 1 --2- 172.21.15.42:0/3060776826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bb00b3550 0x7f8bb015cec0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0009830 tx=0x7f8ba002a530 comp rx=0 tx=0).stop 2024-09-17T01:36:13.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.565+0000 7f8bb5a00640 1 -- 172.21.15.42:0/3060776826 shutdown_connections 2024-09-17T01:36:13.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.565+0000 7f8bb5a00640 1 --2- 172.21.15.42:0/3060776826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bb00b3550 0x7f8bb015cec0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:13.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.565+0000 7f8bb5a00640 1 -- 172.21.15.42:0/3060776826 >> 172.21.15.42:0/3060776826 conn(0x7f8bb00b2930 msgr2=0x7f8bb006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:13.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.565+0000 7f8bb5a00640 1 -- 172.21.15.42:0/3060776826 shutdown_connections 2024-09-17T01:36:13.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.565+0000 7f8bb5a00640 1 -- 172.21.15.42:0/3060776826 wait complete. 2024-09-17T01:36:13.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.567+0000 7f8bb5a00640 1 Processor -- start 2024-09-17T01:36:13.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.568+0000 7f8bb5a00640 1 -- start start 2024-09-17T01:36:13.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.569+0000 7f8bb5a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8bb00b3550 0x7f8bb0159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:13.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.569+0000 7f8bb5a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bb00cec40 0x7f8bb00b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:13.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.569+0000 7f8bb5a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bb0142f40 0x7f8bb00b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:13.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.569+0000 7f8bb5a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb00cf050 con 0x7f8bb00cec40 2024-09-17T01:36:13.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.569+0000 7f8bb5a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb006dd50 con 0x7f8bb0142f40 2024-09-17T01:36:13.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.569+0000 7f8bb5a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb00cf1d0 con 0x7f8bb00b3550 2024-09-17T01:36:13.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.569+0000 7f8ba7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bb00cec40 0x7f8bb00b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:13.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.569+0000 7f8ba7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bb00cec40 0x7f8bb00b1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44040/0 (socket says 172.21.15.42:44040) 2024-09-17T01:36:13.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.569+0000 7f8ba7e00640 1 -- 172.21.15.42:0/3004183514 learned_addr learned my addr 172.21.15.42:0/3004183514 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:13.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.570+0000 7f8ba7e00640 1 -- 172.21.15.42:0/3004183514 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8bb00b3550 msgr2=0x7f8bb0159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:13.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.570+0000 7f8baea00640 1 --2- 172.21.15.42:0/3004183514 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8bb00b3550 0x7f8bb0159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:13.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.570+0000 7f8ba7e00640 1 --2- 172.21.15.42:0/3004183514 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8bb00b3550 0x7f8bb0159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:13.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.570+0000 7f8baf400640 1 --2- 172.21.15.42:0/3004183514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bb0142f40 0x7f8bb00b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:13.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.570+0000 7f8ba7e00640 1 -- 172.21.15.42:0/3004183514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bb0142f40 msgr2=0x7f8bb00b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:13.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.570+0000 7f8ba7e00640 1 --2- 172.21.15.42:0/3004183514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bb0142f40 0x7f8bb00b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:13.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.570+0000 7f8ba7e00640 1 -- 172.21.15.42:0/3004183514 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb00c5fc0 con 0x7f8bb00cec40 2024-09-17T01:36:13.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.570+0000 7f8baea00640 1 --2- 172.21.15.42:0/3004183514 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8bb00b3550 0x7f8bb0159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:36:13.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.570+0000 7f8baf400640 1 --2- 172.21.15.42:0/3004183514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bb0142f40 0x7f8bb00b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:36:13.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.570+0000 7f8ba7e00640 1 --2- 172.21.15.42:0/3004183514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bb00cec40 0x7f8bb00b1000 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8b9800c400 tx=0x7f8b9800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:13.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.570+0000 7f8ba6a00640 1 -- 172.21.15.42:0/3004183514 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b98017070 con 0x7f8bb00cec40 2024-09-17T01:36:13.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.570+0000 7f8ba6a00640 1 -- 172.21.15.42:0/3004183514 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b980053c0 con 0x7f8bb00cec40 2024-09-17T01:36:13.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.570+0000 7f8ba6a00640 1 -- 172.21.15.42:0/3004183514 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b98003830 con 0x7f8bb00cec40 2024-09-17T01:36:13.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.571+0000 7f8bb5a00640 1 -- 172.21.15.42:0/3004183514 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb00c6260 con 0x7f8bb00cec40 2024-09-17T01:36:13.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.571+0000 7f8bb5a00640 1 -- 172.21.15.42:0/3004183514 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb00b0ae0 con 0x7f8bb00cec40 2024-09-17T01:36:13.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.572+0000 7f8bb5a00640 1 -- 172.21.15.42:0/3004183514 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bb015cec0 con 0x7f8bb00cec40 2024-09-17T01:36:13.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.573+0000 7f8ba6a00640 1 -- 172.21.15.42:0/3004183514 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b9801a070 con 0x7f8bb00cec40 2024-09-17T01:36:13.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.574+0000 7f8ba6a00640 1 --2- 172.21.15.42:0/3004183514 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b8c078b90 0x7f8b8c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:13.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.574+0000 7f8ba6a00640 1 -- 172.21.15.42:0/3004183514 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f8b9809a1e0 con 0x7f8bb00cec40 2024-09-17T01:36:13.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.574+0000 7f8baea00640 1 --2- 172.21.15.42:0/3004183514 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b8c078b90 0x7f8b8c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:13.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.575+0000 7f8baea00640 1 --2- 172.21.15.42:0/3004183514 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b8c078b90 0x7f8b8c07b0a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0034000 tx=0x7f8ba0004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:13.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.578+0000 7f8ba6a00640 1 -- 172.21.15.42:0/3004183514 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8b98062580 con 0x7f8bb00cec40 2024-09-17T01:36:13.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:13.808+0000 7f8bb5a00640 1 -- 172.21.15.42:0/3004183514 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f8bb00c58c0 con 0x7f8bb00cec40 2024-09-17T01:36:14.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.312+0000 7f8ba6a00640 1 -- 172.21.15.42:0/3004183514 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v41) ==== 122+0+0 (secure 0 0 0) 0x7f8b98061e80 con 0x7f8bb00cec40 2024-09-17T01:36:14.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.316+0000 7f8bb5a00640 1 -- 172.21.15.42:0/3004183514 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b8c078b90 msgr2=0x7f8b8c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:14.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.316+0000 7f8bb5a00640 1 --2- 172.21.15.42:0/3004183514 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b8c078b90 0x7f8b8c07b0a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0034000 tx=0x7f8ba0004730 comp rx=0 tx=0).stop 2024-09-17T01:36:14.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.316+0000 7f8bb5a00640 1 -- 172.21.15.42:0/3004183514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bb00cec40 msgr2=0x7f8bb00b1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:14.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.316+0000 7f8bb5a00640 1 --2- 172.21.15.42:0/3004183514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bb00cec40 0x7f8bb00b1000 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8b9800c400 tx=0x7f8b9800c8c0 comp rx=0 tx=0).stop 2024-09-17T01:36:14.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.316+0000 7f8bb5a00640 1 -- 172.21.15.42:0/3004183514 shutdown_connections 2024-09-17T01:36:14.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.316+0000 7f8bb5a00640 1 --2- 172.21.15.42:0/3004183514 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b8c078b90 0x7f8b8c07b0a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:14.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.316+0000 7f8bb5a00640 1 --2- 172.21.15.42:0/3004183514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bb0142f40 0x7f8bb00b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:14.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.316+0000 7f8bb5a00640 1 --2- 172.21.15.42:0/3004183514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8bb00cec40 0x7f8bb00b1000 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:14.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.316+0000 7f8bb5a00640 1 --2- 172.21.15.42:0/3004183514 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8bb00b3550 0x7f8bb0159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:14.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.316+0000 7f8bb5a00640 1 -- 172.21.15.42:0/3004183514 >> 172.21.15.42:0/3004183514 conn(0x7f8bb00b2930 msgr2=0x7f8bb015f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:14.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.316+0000 7f8bb5a00640 1 -- 172.21.15.42:0/3004183514 shutdown_connections 2024-09-17T01:36:14.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.316+0000 7f8bb5a00640 1 -- 172.21.15.42:0/3004183514 wait complete. 2024-09-17T01:36:14.341 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T01:36:14.341 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:36:14.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.572+0000 7fc466c00640 1 -- 172.21.15.42:0/47036958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc46015f480 msgr2=0x7fc46015f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:14.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.572+0000 7fc466c00640 1 --2- 172.21.15.42:0/47036958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc46015f480 0x7fc46015f890 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc458005fd0 tx=0x7fc45802aa10 comp rx=0 tx=0).stop 2024-09-17T01:36:14.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.573+0000 7fc466c00640 1 -- 172.21.15.42:0/47036958 shutdown_connections 2024-09-17T01:36:14.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.573+0000 7fc466c00640 1 --2- 172.21.15.42:0/47036958 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc46015f480 0x7fc46015f890 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:14.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.573+0000 7fc466c00640 1 --2- 172.21.15.42:0/47036958 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc46006d430 0x7fc46006d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:14.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.573+0000 7fc466c00640 1 -- 172.21.15.42:0/47036958 >> 172.21.15.42:0/47036958 conn(0x7fc4600b2930 msgr2=0x7fc46006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:14.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.573+0000 7fc466c00640 1 -- 172.21.15.42:0/47036958 shutdown_connections 2024-09-17T01:36:14.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.573+0000 7fc466c00640 1 -- 172.21.15.42:0/47036958 wait complete. 2024-09-17T01:36:14.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.575+0000 7fc466c00640 1 Processor -- start 2024-09-17T01:36:14.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.575+0000 7fc466c00640 1 -- start start 2024-09-17T01:36:14.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.576+0000 7fc466c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc46006d430 0x7fc4601f7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:14.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.577+0000 7fc466c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc46015cb80 0x7fc460148670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:14.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.577+0000 7fc466c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc46015f480 0x7fc46014cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:14.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.577+0000 7fc466c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc460073820 con 0x7fc46006d430 2024-09-17T01:36:14.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.577+0000 7fc466c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc4600736a0 con 0x7fc46015cb80 2024-09-17T01:36:14.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.577+0000 7fc466c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc4600739a0 con 0x7fc46015f480 2024-09-17T01:36:14.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.577+0000 7fc45fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc46006d430 0x7fc4601f7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:14.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.577+0000 7fc45fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc46006d430 0x7fc4601f7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44058/0 (socket says 172.21.15.42:44058) 2024-09-17T01:36:14.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.577+0000 7fc45fe00640 1 -- 172.21.15.42:0/2371676126 learned_addr learned my addr 172.21.15.42:0/2371676126 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:14.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.577+0000 7fc464c00640 1 --2- 172.21.15.42:0/2371676126 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc46015f480 0x7fc46014cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:14.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.577+0000 7fc457e00640 1 --2- 172.21.15.42:0/2371676126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc46015cb80 0x7fc460148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:14.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.577+0000 7fc45fe00640 1 -- 172.21.15.42:0/2371676126 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc46015f480 msgr2=0x7fc46014cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:14.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.577+0000 7fc45fe00640 1 --2- 172.21.15.42:0/2371676126 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc46015f480 0x7fc46014cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:14.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.577+0000 7fc45fe00640 1 -- 172.21.15.42:0/2371676126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc46015cb80 msgr2=0x7fc460148670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:14.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.577+0000 7fc45fe00640 1 --2- 172.21.15.42:0/2371676126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc46015cb80 0x7fc460148670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:14.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.577+0000 7fc45fe00640 1 -- 172.21.15.42:0/2371676126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4601f7110 con 0x7fc46006d430 2024-09-17T01:36:14.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.577+0000 7fc457e00640 1 --2- 172.21.15.42:0/2371676126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc46015cb80 0x7fc460148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:36:14.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.578+0000 7fc45fe00640 1 --2- 172.21.15.42:0/2371676126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc46006d430 0x7fc4601f7bb0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc45000b3e0 tx=0x7fc45000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:14.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.578+0000 7fc45cc00640 1 -- 172.21.15.42:0/2371676126 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc450015020 con 0x7fc46006d430 2024-09-17T01:36:14.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.578+0000 7fc45cc00640 1 -- 172.21.15.42:0/2371676126 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc450011940 con 0x7fc46006d430 2024-09-17T01:36:14.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.578+0000 7fc45cc00640 1 -- 172.21.15.42:0/2371676126 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc450011d90 con 0x7fc46006d430 2024-09-17T01:36:14.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.578+0000 7fc466c00640 1 -- 172.21.15.42:0/2371676126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc46014a090 con 0x7fc46006d430 2024-09-17T01:36:14.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.578+0000 7fc466c00640 1 -- 172.21.15.42:0/2371676126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4601f7690 con 0x7fc46006d430 2024-09-17T01:36:14.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.579+0000 7fc466c00640 1 -- 172.21.15.42:0/2371676126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4600746b0 con 0x7fc46006d430 2024-09-17T01:36:14.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.580+0000 7fc45cc00640 1 -- 172.21.15.42:0/2371676126 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc450018020 con 0x7fc46006d430 2024-09-17T01:36:14.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.581+0000 7fc45cc00640 1 --2- 172.21.15.42:0/2371676126 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc43c078b90 0x7fc43c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:14.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.581+0000 7fc45cc00640 1 -- 172.21.15.42:0/2371676126 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7fc45009ac30 con 0x7fc46006d430 2024-09-17T01:36:14.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.582+0000 7fc457e00640 1 --2- 172.21.15.42:0/2371676126 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc43c078b90 0x7fc43c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:14.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.582+0000 7fc457e00640 1 --2- 172.21.15.42:0/2371676126 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc43c078b90 0x7fc43c07b0a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc4600af750 tx=0x7fc448008040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:14.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.586+0000 7fc45cc00640 1 -- 172.21.15.42:0/2371676126 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc4600746b0 con 0x7fc46006d430 2024-09-17T01:36:14.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.815+0000 7fc466c00640 1 -- 172.21.15.42:0/2371676126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc46006d840 con 0x7fc46006d430 2024-09-17T01:36:14.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.816+0000 7fc45cc00640 1 -- 172.21.15.42:0/2371676126 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5217 (secure 0 0 0) 0x7fc45001f020 con 0x7fc46006d430 2024-09-17T01:36:14.814 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:14.814 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":41,"btime":"2024-09-17T01:36:14:305356+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5627,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/87636391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":87636391},{"type":"v1","addr":"172.21.15.42:6834","nonce":87636391}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6031,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2536194102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2536194102},{"type":"v1","addr":"172.21.15.43:6836","nonce":2536194102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6034,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2289964334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2289964334},{"type":"v1","addr":"172.21.15.43:6837","nonce":2289964334}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:36:10.790086+0000","modified":"2024-09-17T01:36:13.810139+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6195},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6195":{"gid":6195,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/2030017417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":2030017417},{"type":"v1","addr":"172.21.15.42:6835","nonce":2030017417}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6195,"qdb_cluster":[6195]},"id":4}]} 2024-09-17T01:36:14.814 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 41 2024-09-17T01:36:14.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.819+0000 7fc466c00640 1 -- 172.21.15.42:0/2371676126 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc43c078b90 msgr2=0x7fc43c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:14.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.819+0000 7fc466c00640 1 --2- 172.21.15.42:0/2371676126 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc43c078b90 0x7fc43c07b0a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc4600af750 tx=0x7fc448008040 comp rx=0 tx=0).stop 2024-09-17T01:36:14.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.819+0000 7fc466c00640 1 -- 172.21.15.42:0/2371676126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc46006d430 msgr2=0x7fc4601f7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:14.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.819+0000 7fc466c00640 1 --2- 172.21.15.42:0/2371676126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc46006d430 0x7fc4601f7bb0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc45000b3e0 tx=0x7fc45000b8a0 comp rx=0 tx=0).stop 2024-09-17T01:36:14.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.819+0000 7fc466c00640 1 -- 172.21.15.42:0/2371676126 shutdown_connections 2024-09-17T01:36:14.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.819+0000 7fc466c00640 1 --2- 172.21.15.42:0/2371676126 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc43c078b90 0x7fc43c07b0a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:14.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.819+0000 7fc466c00640 1 --2- 172.21.15.42:0/2371676126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc46015cb80 0x7fc460148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:14.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.819+0000 7fc466c00640 1 --2- 172.21.15.42:0/2371676126 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc46015f480 0x7fc46014cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:14.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.819+0000 7fc466c00640 1 --2- 172.21.15.42:0/2371676126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc46006d430 0x7fc4601f7bb0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:14.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.819+0000 7fc466c00640 1 -- 172.21.15.42:0/2371676126 >> 172.21.15.42:0/2371676126 conn(0x7fc4600b2930 msgr2=0x7fc460072900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:14.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.819+0000 7fc466c00640 1 -- 172.21.15.42:0/2371676126 shutdown_connections 2024-09-17T01:36:14.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:14.819+0000 7fc466c00640 1 -- 172.21.15.42:0/2371676126 wait complete. 2024-09-17T01:36:14.842 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:36:15.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.071+0000 7fbe47e00640 1 -- 172.21.15.42:0/2064581905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe400b3550 msgr2=0x7fbe4015cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:15.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.071+0000 7fbe47e00640 1 --2- 172.21.15.42:0/2064581905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe400b3550 0x7fbe4015cec0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbe34009830 tx=0x7fbe3402a4b0 comp rx=0 tx=0).stop 2024-09-17T01:36:15.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.071+0000 7fbe47e00640 1 -- 172.21.15.42:0/2064581905 shutdown_connections 2024-09-17T01:36:15.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.071+0000 7fbe47e00640 1 --2- 172.21.15.42:0/2064581905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe400b3550 0x7fbe4015cec0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:15.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.071+0000 7fbe47e00640 1 -- 172.21.15.42:0/2064581905 >> 172.21.15.42:0/2064581905 conn(0x7fbe400b2930 msgr2=0x7fbe4006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:15.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.071+0000 7fbe47e00640 1 -- 172.21.15.42:0/2064581905 shutdown_connections 2024-09-17T01:36:15.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.071+0000 7fbe47e00640 1 -- 172.21.15.42:0/2064581905 wait complete. 2024-09-17T01:36:15.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.073+0000 7fbe47e00640 1 Processor -- start 2024-09-17T01:36:15.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.074+0000 7fbe47e00640 1 -- start start 2024-09-17T01:36:15.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.075+0000 7fbe47e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbe400b3550 0x7fbe401f5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:15.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.075+0000 7fbe47e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe400cec40 0x7fbe40141b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:15.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.075+0000 7fbe47e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe40142f40 0x7fbe400b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:15.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.075+0000 7fbe47e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbe400cf050 con 0x7fbe400cec40 2024-09-17T01:36:15.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.075+0000 7fbe47e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4006dd50 con 0x7fbe40142f40 2024-09-17T01:36:15.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.075+0000 7fbe47e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbe400cf1d0 con 0x7fbe400b3550 2024-09-17T01:36:15.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.075+0000 7fbe44a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe400cec40 0x7fbe40141b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:15.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.075+0000 7fbe44a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe400cec40 0x7fbe40141b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44074/0 (socket says 172.21.15.42:44074) 2024-09-17T01:36:15.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.075+0000 7fbe44a00640 1 -- 172.21.15.42:0/1873613180 learned_addr learned my addr 172.21.15.42:0/1873613180 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:15.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.076+0000 7fbe45e00640 1 --2- 172.21.15.42:0/1873613180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe40142f40 0x7fbe400b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:15.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.076+0000 7fbe45400640 1 --2- 172.21.15.42:0/1873613180 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbe400b3550 0x7fbe401f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:15.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.076+0000 7fbe44a00640 1 -- 172.21.15.42:0/1873613180 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbe400b3550 msgr2=0x7fbe401f5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:15.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.076+0000 7fbe44a00640 1 --2- 172.21.15.42:0/1873613180 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbe400b3550 0x7fbe401f5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:15.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.076+0000 7fbe44a00640 1 -- 172.21.15.42:0/1873613180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe40142f40 msgr2=0x7fbe400b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:15.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.076+0000 7fbe44a00640 1 --2- 172.21.15.42:0/1873613180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe40142f40 0x7fbe400b1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:15.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.076+0000 7fbe44a00640 1 -- 172.21.15.42:0/1873613180 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe4014de20 con 0x7fbe400cec40 2024-09-17T01:36:15.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.076+0000 7fbe44a00640 1 --2- 172.21.15.42:0/1873613180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe400cec40 0x7fbe40141b70 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c00c4d0 tx=0x7fbe2c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:15.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.077+0000 7fbe3d600640 1 -- 172.21.15.42:0/1873613180 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c012830 con 0x7fbe400cec40 2024-09-17T01:36:15.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.077+0000 7fbe3d600640 1 -- 172.21.15.42:0/1873613180 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe2c017070 con 0x7fbe400cec40 2024-09-17T01:36:15.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.077+0000 7fbe47e00640 1 -- 172.21.15.42:0/1873613180 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe4014e100 con 0x7fbe400cec40 2024-09-17T01:36:15.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.077+0000 7fbe3d600640 1 -- 172.21.15.42:0/1873613180 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c012d20 con 0x7fbe400cec40 2024-09-17T01:36:15.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.077+0000 7fbe47e00640 1 -- 172.21.15.42:0/1873613180 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe4014e6c0 con 0x7fbe400cec40 2024-09-17T01:36:15.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.078+0000 7fbe47e00640 1 -- 172.21.15.42:0/1873613180 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe4015cec0 con 0x7fbe400cec40 2024-09-17T01:36:15.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.079+0000 7fbe3d600640 1 -- 172.21.15.42:0/1873613180 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbe2c01c460 con 0x7fbe400cec40 2024-09-17T01:36:15.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.080+0000 7fbe3d600640 1 --2- 172.21.15.42:0/1873613180 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbe20078b90 0x7fbe2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:15.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.080+0000 7fbe3d600640 1 -- 172.21.15.42:0/1873613180 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7fbe2c09aa20 con 0x7fbe400cec40 2024-09-17T01:36:15.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.081+0000 7fbe45400640 1 --2- 172.21.15.42:0/1873613180 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbe20078b90 0x7fbe2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:15.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.082+0000 7fbe45400640 1 --2- 172.21.15.42:0/1873613180 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbe20078b90 0x7fbe2007b0a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbe34034000 tx=0x7fbe34004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:15.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.084+0000 7fbe3d600640 1 -- 172.21.15.42:0/1873613180 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbe2c062800 con 0x7fbe400cec40 2024-09-17T01:36:15.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.277+0000 7fbe47e00640 1 -- 172.21.15.42:0/1873613180 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe40142420 con 0x7fbe400cec40 2024-09-17T01:36:15.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.278+0000 7fbe3d600640 1 -- 172.21.15.42:0/1873613180 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+16677 (secure 0 0 0) 0x7fbe2c067230 con 0x7fbe400cec40 2024-09-17T01:36:15.276 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:15.277 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":62,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:36:12.292515+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:36:08.745986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T01:36:09.754042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:36:15.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.281+0000 7fbe47e00640 1 -- 172.21.15.42:0/1873613180 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbe20078b90 msgr2=0x7fbe2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:15.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.281+0000 7fbe47e00640 1 --2- 172.21.15.42:0/1873613180 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbe20078b90 0x7fbe2007b0a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbe34034000 tx=0x7fbe34004730 comp rx=0 tx=0).stop 2024-09-17T01:36:15.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.281+0000 7fbe47e00640 1 -- 172.21.15.42:0/1873613180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe400cec40 msgr2=0x7fbe40141b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:15.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.281+0000 7fbe47e00640 1 --2- 172.21.15.42:0/1873613180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe400cec40 0x7fbe40141b70 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c00c4d0 tx=0x7fbe2c00c990 comp rx=0 tx=0).stop 2024-09-17T01:36:15.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.281+0000 7fbe47e00640 1 -- 172.21.15.42:0/1873613180 shutdown_connections 2024-09-17T01:36:15.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.281+0000 7fbe47e00640 1 --2- 172.21.15.42:0/1873613180 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbe20078b90 0x7fbe2007b0a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:15.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.281+0000 7fbe47e00640 1 --2- 172.21.15.42:0/1873613180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe40142f40 0x7fbe400b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:15.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.281+0000 7fbe47e00640 1 --2- 172.21.15.42:0/1873613180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe400cec40 0x7fbe40141b70 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:15.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.281+0000 7fbe47e00640 1 --2- 172.21.15.42:0/1873613180 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbe400b3550 0x7fbe401f5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:15.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.281+0000 7fbe47e00640 1 -- 172.21.15.42:0/1873613180 >> 172.21.15.42:0/1873613180 conn(0x7fbe400b2930 msgr2=0x7fbe40073330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:15.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.281+0000 7fbe47e00640 1 -- 172.21.15.42:0/1873613180 shutdown_connections 2024-09-17T01:36:15.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.281+0000 7fbe47e00640 1 -- 172.21.15.42:0/1873613180 wait complete. 2024-09-17T01:36:15.301 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T01:36:15.301 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:36:15.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.531+0000 7fed3ae00640 1 -- 172.21.15.42:0/1094795037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed1c004800 msgr2=0x7fed1c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:15.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.531+0000 7fed3ae00640 1 --2- 172.21.15.42:0/1094795037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed1c004800 0x7fed1c004c10 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fed2000c310 tx=0x7fed1c005830 comp rx=0 tx=0).stop 2024-09-17T01:36:15.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.531+0000 7fed3ae00640 1 -- 172.21.15.42:0/1094795037 shutdown_connections 2024-09-17T01:36:15.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.531+0000 7fed3ae00640 1 --2- 172.21.15.42:0/1094795037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed1c004800 0x7fed1c004c10 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:15.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.531+0000 7fed3ae00640 1 -- 172.21.15.42:0/1094795037 >> 172.21.15.42:0/1094795037 conn(0x7fed340b25f0 msgr2=0x7fed340d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:15.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.531+0000 7fed3ae00640 1 -- 172.21.15.42:0/1094795037 shutdown_connections 2024-09-17T01:36:15.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.531+0000 7fed3ae00640 1 -- 172.21.15.42:0/1094795037 wait complete. 2024-09-17T01:36:15.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.534+0000 7fed3ae00640 1 Processor -- start 2024-09-17T01:36:15.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.534+0000 7fed3ae00640 1 -- start start 2024-09-17T01:36:15.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.535+0000 7fed3ae00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed1c004800 0x7fed34153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:15.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.535+0000 7fed3ae00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed34074d40 0x7fed340c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:15.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.535+0000 7fed3ae00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed340c9960 0x7fed341e70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:15.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.535+0000 7fed3ae00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fed3415db50 con 0x7fed340c9960 2024-09-17T01:36:15.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.535+0000 7fed3ae00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fed3415d9d0 con 0x7fed34074d40 2024-09-17T01:36:15.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.535+0000 7fed3ae00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fed3406cd20 con 0x7fed1c004800 2024-09-17T01:36:15.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.535+0000 7fed3a400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed340c9960 0x7fed341e70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:15.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.535+0000 7fed3a400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed340c9960 0x7fed341e70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44090/0 (socket says 172.21.15.42:44090) 2024-09-17T01:36:15.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.536+0000 7fed3a400640 1 -- 172.21.15.42:0/2440134968 learned_addr learned my addr 172.21.15.42:0/2440134968 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:15.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.536+0000 7fed39a00640 1 --2- 172.21.15.42:0/2440134968 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed1c004800 0x7fed34153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:15.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.536+0000 7fed3a400640 1 -- 172.21.15.42:0/2440134968 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed1c004800 msgr2=0x7fed34153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:15.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.536+0000 7fed3a400640 1 --2- 172.21.15.42:0/2440134968 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed1c004800 0x7fed34153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:15.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.536+0000 7fed3a400640 1 -- 172.21.15.42:0/2440134968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed34074d40 msgr2=0x7fed340c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:15.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.536+0000 7fed39000640 1 --2- 172.21.15.42:0/2440134968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed34074d40 0x7fed340c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:15.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.536+0000 7fed3a400640 1 --2- 172.21.15.42:0/2440134968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed34074d40 0x7fed340c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:15.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.536+0000 7fed3a400640 1 -- 172.21.15.42:0/2440134968 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed340c9d70 con 0x7fed340c9960 2024-09-17T01:36:15.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.536+0000 7fed39a00640 1 --2- 172.21.15.42:0/2440134968 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed1c004800 0x7fed34153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:36:15.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.536+0000 7fed39000640 1 --2- 172.21.15.42:0/2440134968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed34074d40 0x7fed340c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:36:15.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.536+0000 7fed3a400640 1 --2- 172.21.15.42:0/2440134968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed340c9960 0x7fed341e70b0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fed340cca40 tx=0x7fed2c010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:15.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.536+0000 7fed31600640 1 -- 172.21.15.42:0/2440134968 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c00ee70 con 0x7fed340c9960 2024-09-17T01:36:15.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.537+0000 7fed31600640 1 -- 172.21.15.42:0/2440134968 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed2c015070 con 0x7fed340c9960 2024-09-17T01:36:15.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.537+0000 7fed3ae00640 1 -- 172.21.15.42:0/2440134968 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed341543c0 con 0x7fed340c9960 2024-09-17T01:36:15.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.537+0000 7fed31600640 1 -- 172.21.15.42:0/2440134968 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c003d00 con 0x7fed340c9960 2024-09-17T01:36:15.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.537+0000 7fed3ae00640 1 -- 172.21.15.42:0/2440134968 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed341f94e0 con 0x7fed340c9960 2024-09-17T01:36:15.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.538+0000 7fed3ae00640 1 -- 172.21.15.42:0/2440134968 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed3406d280 con 0x7fed340c9960 2024-09-17T01:36:15.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.539+0000 7fed31600640 1 -- 172.21.15.42:0/2440134968 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fed2c004030 con 0x7fed340c9960 2024-09-17T01:36:15.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.540+0000 7fed31600640 1 --2- 172.21.15.42:0/2440134968 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fed14078b90 0x7fed1407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:15.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.540+0000 7fed31600640 1 -- 172.21.15.42:0/2440134968 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7fed2c09be30 con 0x7fed340c9960 2024-09-17T01:36:15.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.541+0000 7fed39a00640 1 --2- 172.21.15.42:0/2440134968 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fed14078b90 0x7fed1407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:15.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.541+0000 7fed39a00640 1 --2- 172.21.15.42:0/2440134968 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fed14078b90 0x7fed1407b0a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fed280065f0 tx=0x7fed28006b70 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:15.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.543+0000 7fed31600640 1 -- 172.21.15.42:0/2440134968 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fed340c9d70 con 0x7fed340c9960 2024-09-17T01:36:15.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.732+0000 7fed3ae00640 1 -- 172.21.15.42:0/2440134968 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed3406d620 con 0x7fed14078b90 2024-09-17T01:36:15.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.738+0000 7fed31600640 1 -- 172.21.15.42:0/2440134968 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251127 (secure 0 0 0) 0x7fed3406d620 con 0x7fed14078b90 2024-09-17T01:36:15.738 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:15.740 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:36:15.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.742+0000 7fed3ae00640 1 -- 172.21.15.42:0/2440134968 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fed14078b90 msgr2=0x7fed1407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:15.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.742+0000 7fed3ae00640 1 --2- 172.21.15.42:0/2440134968 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fed14078b90 0x7fed1407b0a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fed280065f0 tx=0x7fed28006b70 comp rx=0 tx=0).stop 2024-09-17T01:36:15.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.742+0000 7fed3ae00640 1 -- 172.21.15.42:0/2440134968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed340c9960 msgr2=0x7fed341e70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:15.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.742+0000 7fed3ae00640 1 --2- 172.21.15.42:0/2440134968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed340c9960 0x7fed341e70b0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fed340cca40 tx=0x7fed2c010f40 comp rx=0 tx=0).stop 2024-09-17T01:36:15.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.742+0000 7fed3ae00640 1 -- 172.21.15.42:0/2440134968 shutdown_connections 2024-09-17T01:36:15.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.742+0000 7fed3ae00640 1 --2- 172.21.15.42:0/2440134968 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fed14078b90 0x7fed1407b0a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:15.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.742+0000 7fed3ae00640 1 --2- 172.21.15.42:0/2440134968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed34074d40 0x7fed340c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:15.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.742+0000 7fed3ae00640 1 --2- 172.21.15.42:0/2440134968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed340c9960 0x7fed341e70b0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:15.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.742+0000 7fed3ae00640 1 --2- 172.21.15.42:0/2440134968 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed1c004800 0x7fed34153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:15.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.742+0000 7fed3ae00640 1 -- 172.21.15.42:0/2440134968 >> 172.21.15.42:0/2440134968 conn(0x7fed340b25f0 msgr2=0x7fed340b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:15.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.742+0000 7fed3ae00640 1 -- 172.21.15.42:0/2440134968 shutdown_connections 2024-09-17T01:36:15.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:15.742+0000 7fed3ae00640 1 -- 172.21.15.42:0/2440134968 wait complete. 2024-09-17T01:36:15.764 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-09-17T01:36:15.046401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289716,"kb_used_data":6928,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754685004,"statfs":{"total":773094113280,"available":772797444096,"internally_reserved":0,"allocated":7094272,"data_stored":3640682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":289394228},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.779745"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304704+0000","last_change":"2024-09-17T01:36:11.317189+0000","last_active":"2024-09-17T01:36:12.304704+0000","last_peered":"2024-09-17T01:36:12.304704+0000","last_clean":"2024-09-17T01:36:12.304704+0000","last_became_active":"2024-09-17T01:36:11.316776+0000","last_became_peered":"2024-09-17T01:36:11.316776+0000","last_unstale":"2024-09-17T01:36:12.304704+0000","last_undegraded":"2024-09-17T01:36:12.304704+0000","last_fullsized":"2024-09-17T01:36:12.304704+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:35.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023723+0000","last_change":"2024-09-17T01:36:11.325731+0000","last_active":"2024-09-17T01:36:13.023723+0000","last_peered":"2024-09-17T01:36:13.023723+0000","last_clean":"2024-09-17T01:36:13.023723+0000","last_became_active":"2024-09-17T01:36:11.325325+0000","last_became_peered":"2024-09-17T01:36:11.325325+0000","last_unstale":"2024-09-17T01:36:13.023723+0000","last_undegraded":"2024-09-17T01:36:13.023723+0000","last_fullsized":"2024-09-17T01:36:13.023723+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:12.067713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.286381+0000","last_change":"2024-09-17T01:36:10.286381+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.286381+0000","last_undegraded":"2024-09-17T01:36:10.286381+0000","last_fullsized":"2024-09-17T01:36:10.286381+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076816+0000","last_change":"2024-09-17T01:36:11.319236+0000","last_active":"2024-09-17T01:36:13.076816+0000","last_peered":"2024-09-17T01:36:13.076816+0000","last_clean":"2024-09-17T01:36:13.076816+0000","last_became_active":"2024-09-17T01:36:11.318786+0000","last_became_peered":"2024-09-17T01:36:11.318786+0000","last_unstale":"2024-09-17T01:36:13.076816+0000","last_undegraded":"2024-09-17T01:36:13.076816+0000","last_fullsized":"2024-09-17T01:36:13.076816+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:56:37.137202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304383+0000","last_change":"2024-09-17T01:36:11.295952+0000","last_active":"2024-09-17T01:36:12.304383+0000","last_peered":"2024-09-17T01:36:12.304383+0000","last_clean":"2024-09-17T01:36:12.304383+0000","last_became_active":"2024-09-17T01:36:11.295523+0000","last_became_peered":"2024-09-17T01:36:11.295523+0000","last_unstale":"2024-09-17T01:36:12.304383+0000","last_undegraded":"2024-09-17T01:36:12.304383+0000","last_fullsized":"2024-09-17T01:36:12.304383+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:08.202105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304321+0000","last_change":"2024-09-17T01:36:11.303156+0000","last_active":"2024-09-17T01:36:12.304321+0000","last_peered":"2024-09-17T01:36:12.304321+0000","last_clean":"2024-09-17T01:36:12.304321+0000","last_became_active":"2024-09-17T01:36:11.302790+0000","last_became_peered":"2024-09-17T01:36:11.302790+0000","last_unstale":"2024-09-17T01:36:12.304321+0000","last_undegraded":"2024-09-17T01:36:12.304321+0000","last_fullsized":"2024-09-17T01:36:12.304321+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:30.181703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076553+0000","last_change":"2024-09-17T01:36:11.293632+0000","last_active":"2024-09-17T01:36:13.076553+0000","last_peered":"2024-09-17T01:36:13.076553+0000","last_clean":"2024-09-17T01:36:13.076553+0000","last_became_active":"2024-09-17T01:36:11.293324+0000","last_became_peered":"2024-09-17T01:36:11.293324+0000","last_unstale":"2024-09-17T01:36:13.076553+0000","last_undegraded":"2024-09-17T01:36:13.076553+0000","last_fullsized":"2024-09-17T01:36:13.076553+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:51.396274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.302970+0000","last_change":"2024-09-17T01:36:11.317048+0000","last_active":"2024-09-17T01:36:12.302970+0000","last_peered":"2024-09-17T01:36:12.302970+0000","last_clean":"2024-09-17T01:36:12.302970+0000","last_became_active":"2024-09-17T01:36:11.315266+0000","last_became_peered":"2024-09-17T01:36:11.315266+0000","last_unstale":"2024-09-17T01:36:12.302970+0000","last_undegraded":"2024-09-17T01:36:12.302970+0000","last_fullsized":"2024-09-17T01:36:12.302970+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:17.967682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866481+0000","last_change":"2024-09-17T01:36:11.303422+0000","last_active":"2024-09-17T01:36:12.866481+0000","last_peered":"2024-09-17T01:36:12.866481+0000","last_clean":"2024-09-17T01:36:12.866481+0000","last_became_active":"2024-09-17T01:36:11.303095+0000","last_became_peered":"2024-09-17T01:36:11.303095+0000","last_unstale":"2024-09-17T01:36:12.866481+0000","last_undegraded":"2024-09-17T01:36:12.866481+0000","last_fullsized":"2024-09-17T01:36:12.866481+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:06.849909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304675+0000","last_change":"2024-09-17T01:36:11.311252+0000","last_active":"2024-09-17T01:36:12.304675+0000","last_peered":"2024-09-17T01:36:12.304675+0000","last_clean":"2024-09-17T01:36:12.304675+0000","last_became_active":"2024-09-17T01:36:11.304478+0000","last_became_peered":"2024-09-17T01:36:11.304478+0000","last_unstale":"2024-09-17T01:36:12.304675+0000","last_undegraded":"2024-09-17T01:36:12.304675+0000","last_fullsized":"2024-09-17T01:36:12.304675+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:24.361465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925132+0000","last_change":"2024-09-17T01:36:11.315637+0000","last_active":"2024-09-17T01:36:12.925132+0000","last_peered":"2024-09-17T01:36:12.925132+0000","last_clean":"2024-09-17T01:36:12.925132+0000","last_became_active":"2024-09-17T01:36:11.314795+0000","last_became_peered":"2024-09-17T01:36:11.314795+0000","last_unstale":"2024-09-17T01:36:12.925132+0000","last_undegraded":"2024-09-17T01:36:12.925132+0000","last_fullsized":"2024-09-17T01:36:12.925132+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:18.981223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866361+0000","last_change":"2024-09-17T01:36:11.313898+0000","last_active":"2024-09-17T01:36:12.866361+0000","last_peered":"2024-09-17T01:36:12.866361+0000","last_clean":"2024-09-17T01:36:12.866361+0000","last_became_active":"2024-09-17T01:36:11.313556+0000","last_became_peered":"2024-09-17T01:36:11.313556+0000","last_unstale":"2024-09-17T01:36:12.866361+0000","last_undegraded":"2024-09-17T01:36:12.866361+0000","last_fullsized":"2024-09-17T01:36:12.866361+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:22:02.980623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992700+0000","last_change":"2024-09-17T01:36:11.308618+0000","last_active":"2024-09-17T01:36:12.992700+0000","last_peered":"2024-09-17T01:36:12.992700+0000","last_clean":"2024-09-17T01:36:12.992700+0000","last_became_active":"2024-09-17T01:36:11.308319+0000","last_became_peered":"2024-09-17T01:36:11.308319+0000","last_unstale":"2024-09-17T01:36:12.992700+0000","last_undegraded":"2024-09-17T01:36:12.992700+0000","last_fullsized":"2024-09-17T01:36:12.992700+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:34.276355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.285301+0000","last_change":"2024-09-17T01:36:10.285301+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.285301+0000","last_undegraded":"2024-09-17T01:36:10.285301+0000","last_fullsized":"2024-09-17T01:36:10.285301+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992453+0000","last_change":"2024-09-17T01:36:11.318165+0000","last_active":"2024-09-17T01:36:12.992453+0000","last_peered":"2024-09-17T01:36:12.992453+0000","last_clean":"2024-09-17T01:36:12.992453+0000","last_became_active":"2024-09-17T01:36:11.317875+0000","last_became_peered":"2024-09-17T01:36:11.317875+0000","last_unstale":"2024-09-17T01:36:12.992453+0000","last_undegraded":"2024-09-17T01:36:12.992453+0000","last_fullsized":"2024-09-17T01:36:12.992453+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:00.765527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303951+0000","last_change":"2024-09-17T01:36:11.297004+0000","last_active":"2024-09-17T01:36:12.303951+0000","last_peered":"2024-09-17T01:36:12.303951+0000","last_clean":"2024-09-17T01:36:12.303951+0000","last_became_active":"2024-09-17T01:36:11.296661+0000","last_became_peered":"2024-09-17T01:36:11.296661+0000","last_unstale":"2024-09-17T01:36:12.303951+0000","last_undegraded":"2024-09-17T01:36:12.303951+0000","last_fullsized":"2024-09-17T01:36:12.303951+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:18.099170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305020+0000","last_change":"2024-09-17T01:36:11.303184+0000","last_active":"2024-09-17T01:36:12.305020+0000","last_peered":"2024-09-17T01:36:12.305020+0000","last_clean":"2024-09-17T01:36:12.305020+0000","last_became_active":"2024-09-17T01:36:11.302826+0000","last_became_peered":"2024-09-17T01:36:11.302826+0000","last_unstale":"2024-09-17T01:36:12.305020+0000","last_undegraded":"2024-09-17T01:36:12.305020+0000","last_fullsized":"2024-09-17T01:36:12.305020+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:59.362677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.278679+0000","last_change":"2024-09-17T01:36:10.278679+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.278679+0000","last_undegraded":"2024-09-17T01:36:10.278679+0000","last_fullsized":"2024-09-17T01:36:10.278679+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023564+0000","last_change":"2024-09-17T01:36:11.323204+0000","last_active":"2024-09-17T01:36:13.023564+0000","last_peered":"2024-09-17T01:36:13.023564+0000","last_clean":"2024-09-17T01:36:13.023564+0000","last_became_active":"2024-09-17T01:36:11.322063+0000","last_became_peered":"2024-09-17T01:36:11.322063+0000","last_unstale":"2024-09-17T01:36:13.023564+0000","last_undegraded":"2024-09-17T01:36:13.023564+0000","last_fullsized":"2024-09-17T01:36:13.023564+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:11.122810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925263+0000","last_change":"2024-09-17T01:36:11.315695+0000","last_active":"2024-09-17T01:36:12.925263+0000","last_peered":"2024-09-17T01:36:12.925263+0000","last_clean":"2024-09-17T01:36:12.925263+0000","last_became_active":"2024-09-17T01:36:11.315143+0000","last_became_peered":"2024-09-17T01:36:11.315143+0000","last_unstale":"2024-09-17T01:36:12.925263+0000","last_undegraded":"2024-09-17T01:36:12.925263+0000","last_fullsized":"2024-09-17T01:36:12.925263+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:35.194646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992684+0000","last_change":"2024-09-17T01:36:11.323619+0000","last_active":"2024-09-17T01:36:12.992684+0000","last_peered":"2024-09-17T01:36:12.992684+0000","last_clean":"2024-09-17T01:36:12.992684+0000","last_became_active":"2024-09-17T01:36:11.323346+0000","last_became_peered":"2024-09-17T01:36:11.323346+0000","last_unstale":"2024-09-17T01:36:12.992684+0000","last_undegraded":"2024-09-17T01:36:12.992684+0000","last_fullsized":"2024-09-17T01:36:12.992684+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:08.202105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925295+0000","last_change":"2024-09-17T01:36:11.305911+0000","last_active":"2024-09-17T01:36:12.925295+0000","last_peered":"2024-09-17T01:36:12.925295+0000","last_clean":"2024-09-17T01:36:12.925295+0000","last_became_active":"2024-09-17T01:36:11.305567+0000","last_became_peered":"2024-09-17T01:36:11.305567+0000","last_unstale":"2024-09-17T01:36:12.925295+0000","last_undegraded":"2024-09-17T01:36:12.925295+0000","last_fullsized":"2024-09-17T01:36:12.925295+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:07.419500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076616+0000","last_change":"2024-09-17T01:36:11.310245+0000","last_active":"2024-09-17T01:36:13.076616+0000","last_peered":"2024-09-17T01:36:13.076616+0000","last_clean":"2024-09-17T01:36:13.076616+0000","last_became_active":"2024-09-17T01:36:11.309949+0000","last_became_peered":"2024-09-17T01:36:11.309949+0000","last_unstale":"2024-09-17T01:36:13.076616+0000","last_undegraded":"2024-09-17T01:36:13.076616+0000","last_fullsized":"2024-09-17T01:36:13.076616+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:42.594893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866214+0000","last_change":"2024-09-17T01:36:11.318149+0000","last_active":"2024-09-17T01:36:12.866214+0000","last_peered":"2024-09-17T01:36:12.866214+0000","last_clean":"2024-09-17T01:36:12.866214+0000","last_became_active":"2024-09-17T01:36:11.317798+0000","last_became_peered":"2024-09-17T01:36:11.317798+0000","last_unstale":"2024-09-17T01:36:12.866214+0000","last_undegraded":"2024-09-17T01:36:12.866214+0000","last_fullsized":"2024-09-17T01:36:12.866214+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:52.367069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023788+0000","last_change":"2024-09-17T01:36:11.325158+0000","last_active":"2024-09-17T01:36:13.023788+0000","last_peered":"2024-09-17T01:36:13.023788+0000","last_clean":"2024-09-17T01:36:13.023788+0000","last_became_active":"2024-09-17T01:36:11.323928+0000","last_became_peered":"2024-09-17T01:36:11.323928+0000","last_unstale":"2024-09-17T01:36:13.023788+0000","last_undegraded":"2024-09-17T01:36:13.023788+0000","last_fullsized":"2024-09-17T01:36:13.023788+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:26.441833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.993007+0000","last_change":"2024-09-17T01:36:11.314300+0000","last_active":"2024-09-17T01:36:12.993007+0000","last_peered":"2024-09-17T01:36:12.993007+0000","last_clean":"2024-09-17T01:36:12.993007+0000","last_became_active":"2024-09-17T01:36:11.313197+0000","last_became_peered":"2024-09-17T01:36:11.313197+0000","last_unstale":"2024-09-17T01:36:12.993007+0000","last_undegraded":"2024-09-17T01:36:12.993007+0000","last_fullsized":"2024-09-17T01:36:12.993007+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:24.449150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023920+0000","last_change":"2024-09-17T01:36:11.318641+0000","last_active":"2024-09-17T01:36:13.023920+0000","last_peered":"2024-09-17T01:36:13.023920+0000","last_clean":"2024-09-17T01:36:13.023920+0000","last_became_active":"2024-09-17T01:36:11.317933+0000","last_became_peered":"2024-09-17T01:36:11.317933+0000","last_unstale":"2024-09-17T01:36:13.023920+0000","last_undegraded":"2024-09-17T01:36:13.023920+0000","last_fullsized":"2024-09-17T01:36:13.023920+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:07:47.466557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303627+0000","last_change":"2024-09-17T01:36:11.317931+0000","last_active":"2024-09-17T01:36:12.303627+0000","last_peered":"2024-09-17T01:36:12.303627+0000","last_clean":"2024-09-17T01:36:12.303627+0000","last_became_active":"2024-09-17T01:36:11.310928+0000","last_became_peered":"2024-09-17T01:36:11.310928+0000","last_unstale":"2024-09-17T01:36:12.303627+0000","last_undegraded":"2024-09-17T01:36:12.303627+0000","last_fullsized":"2024-09-17T01:36:12.303627+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:04.246558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304597+0000","last_change":"2024-09-17T01:36:11.308715+0000","last_active":"2024-09-17T01:36:12.304597+0000","last_peered":"2024-09-17T01:36:12.304597+0000","last_clean":"2024-09-17T01:36:12.304597+0000","last_became_active":"2024-09-17T01:36:11.308287+0000","last_became_peered":"2024-09-17T01:36:11.308287+0000","last_unstale":"2024-09-17T01:36:12.304597+0000","last_undegraded":"2024-09-17T01:36:12.304597+0000","last_fullsized":"2024-09-17T01:36:12.304597+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:57.671724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076588+0000","last_change":"2024-09-17T01:36:11.304384+0000","last_active":"2024-09-17T01:36:13.076588+0000","last_peered":"2024-09-17T01:36:13.076588+0000","last_clean":"2024-09-17T01:36:13.076588+0000","last_became_active":"2024-09-17T01:36:11.302561+0000","last_became_peered":"2024-09-17T01:36:11.302561+0000","last_unstale":"2024-09-17T01:36:13.076588+0000","last_undegraded":"2024-09-17T01:36:13.076588+0000","last_fullsized":"2024-09-17T01:36:13.076588+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:36.574249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023288+0000","last_change":"2024-09-17T01:36:11.313970+0000","last_active":"2024-09-17T01:36:13.023288+0000","last_peered":"2024-09-17T01:36:13.023288+0000","last_clean":"2024-09-17T01:36:13.023288+0000","last_became_active":"2024-09-17T01:36:11.310156+0000","last_became_peered":"2024-09-17T01:36:11.310156+0000","last_unstale":"2024-09-17T01:36:13.023288+0000","last_undegraded":"2024-09-17T01:36:13.023288+0000","last_fullsized":"2024-09-17T01:36:13.023288+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:58.276824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925181+0000","last_change":"2024-09-17T01:36:11.306107+0000","last_active":"2024-09-17T01:36:12.925181+0000","last_peered":"2024-09-17T01:36:12.925181+0000","last_clean":"2024-09-17T01:36:12.925181+0000","last_became_active":"2024-09-17T01:36:11.305764+0000","last_became_peered":"2024-09-17T01:36:11.305764+0000","last_unstale":"2024-09-17T01:36:12.925181+0000","last_undegraded":"2024-09-17T01:36:12.925181+0000","last_fullsized":"2024-09-17T01:36:12.925181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:09.482083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305187+0000","last_change":"2024-09-17T01:36:11.297563+0000","last_active":"2024-09-17T01:36:12.305187+0000","last_peered":"2024-09-17T01:36:12.305187+0000","last_clean":"2024-09-17T01:36:12.305187+0000","last_became_active":"2024-09-17T01:36:11.297236+0000","last_became_peered":"2024-09-17T01:36:11.297236+0000","last_unstale":"2024-09-17T01:36:12.305187+0000","last_undegraded":"2024-09-17T01:36:12.305187+0000","last_fullsized":"2024-09-17T01:36:12.305187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:28.959565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925285+0000","last_change":"2024-09-17T01:36:10.292457+0000","last_active":"2024-09-17T01:36:12.925285+0000","last_peered":"2024-09-17T01:36:12.925285+0000","last_clean":"2024-09-17T01:36:12.925285+0000","last_became_active":"2024-09-17T01:36:10.292073+0000","last_became_peered":"2024-09-17T01:36:10.292073+0000","last_unstale":"2024-09-17T01:36:12.925285+0000","last_undegraded":"2024-09-17T01:36:12.925285+0000","last_fullsized":"2024-09-17T01:36:12.925285+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:47.680334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305127+0000","last_change":"2024-09-17T01:36:11.314223+0000","last_active":"2024-09-17T01:36:12.305127+0000","last_peered":"2024-09-17T01:36:12.305127+0000","last_clean":"2024-09-17T01:36:12.305127+0000","last_became_active":"2024-09-17T01:36:11.313462+0000","last_became_peered":"2024-09-17T01:36:11.313462+0000","last_unstale":"2024-09-17T01:36:12.305127+0000","last_undegraded":"2024-09-17T01:36:12.305127+0000","last_fullsized":"2024-09-17T01:36:12.305127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:48.686497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023531+0000","last_change":"2024-09-17T01:36:10.295597+0000","last_active":"2024-09-17T01:36:13.023531+0000","last_peered":"2024-09-17T01:36:13.023531+0000","last_clean":"2024-09-17T01:36:13.023531+0000","last_became_active":"2024-09-17T01:36:10.295269+0000","last_became_peered":"2024-09-17T01:36:10.295269+0000","last_unstale":"2024-09-17T01:36:13.023531+0000","last_undegraded":"2024-09-17T01:36:13.023531+0000","last_fullsized":"2024-09-17T01:36:13.023531+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:07.370466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303912+0000","last_change":"2024-09-17T01:36:11.320059+0000","last_active":"2024-09-17T01:36:12.303912+0000","last_peered":"2024-09-17T01:36:12.303912+0000","last_clean":"2024-09-17T01:36:12.303912+0000","last_became_active":"2024-09-17T01:36:11.319721+0000","last_became_peered":"2024-09-17T01:36:11.319721+0000","last_unstale":"2024-09-17T01:36:12.303912+0000","last_undegraded":"2024-09-17T01:36:12.303912+0000","last_fullsized":"2024-09-17T01:36:12.303912+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:59.228610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303898+0000","last_change":"2024-09-17T01:36:10.286360+0000","last_active":"2024-09-17T01:36:12.303898+0000","last_peered":"2024-09-17T01:36:12.303898+0000","last_clean":"2024-09-17T01:36:12.303898+0000","last_became_active":"2024-09-17T01:36:10.285959+0000","last_became_peered":"2024-09-17T01:36:10.285959+0000","last_unstale":"2024-09-17T01:36:12.303898+0000","last_undegraded":"2024-09-17T01:36:12.303898+0000","last_fullsized":"2024-09-17T01:36:12.303898+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:11.061550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305368+0000","last_change":"2024-09-17T01:36:11.309231+0000","last_active":"2024-09-17T01:36:12.305368+0000","last_peered":"2024-09-17T01:36:12.305368+0000","last_clean":"2024-09-17T01:36:12.305368+0000","last_became_active":"2024-09-17T01:36:11.304902+0000","last_became_peered":"2024-09-17T01:36:11.304902+0000","last_unstale":"2024-09-17T01:36:12.305368+0000","last_undegraded":"2024-09-17T01:36:12.305368+0000","last_fullsized":"2024-09-17T01:36:12.305368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:56.613111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076709+0000","last_change":"2024-09-17T01:36:10.300133+0000","last_active":"2024-09-17T01:36:13.076709+0000","last_peered":"2024-09-17T01:36:13.076709+0000","last_clean":"2024-09-17T01:36:13.076709+0000","last_became_active":"2024-09-17T01:36:10.299955+0000","last_became_peered":"2024-09-17T01:36:10.299955+0000","last_unstale":"2024-09-17T01:36:13.076709+0000","last_undegraded":"2024-09-17T01:36:13.076709+0000","last_fullsized":"2024-09-17T01:36:13.076709+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:48.285259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303509+0000","last_change":"2024-09-17T01:36:11.323505+0000","last_active":"2024-09-17T01:36:12.303509+0000","last_peered":"2024-09-17T01:36:12.303509+0000","last_clean":"2024-09-17T01:36:12.303509+0000","last_became_active":"2024-09-17T01:36:11.323174+0000","last_became_peered":"2024-09-17T01:36:11.323174+0000","last_unstale":"2024-09-17T01:36:12.303509+0000","last_undegraded":"2024-09-17T01:36:12.303509+0000","last_fullsized":"2024-09-17T01:36:12.303509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:48.884777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T01:36:10.298847+0000","last_change":"2024-09-17T01:36:10.291224+0000","last_active":"2024-09-17T01:36:10.298847+0000","last_peered":"2024-09-17T01:36:10.298847+0000","last_clean":"2024-09-17T01:36:10.298847+0000","last_became_active":"2024-09-17T01:36:10.290471+0000","last_became_peered":"2024-09-17T01:36:10.290471+0000","last_unstale":"2024-09-17T01:36:10.298847+0000","last_undegraded":"2024-09-17T01:36:10.298847+0000","last_fullsized":"2024-09-17T01:36:10.298847+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:05.843746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925183+0000","last_change":"2024-09-17T01:36:11.310201+0000","last_active":"2024-09-17T01:36:12.925183+0000","last_peered":"2024-09-17T01:36:12.925183+0000","last_clean":"2024-09-17T01:36:12.925183+0000","last_became_active":"2024-09-17T01:36:11.310003+0000","last_became_peered":"2024-09-17T01:36:11.310003+0000","last_unstale":"2024-09-17T01:36:12.925183+0000","last_undegraded":"2024-09-17T01:36:12.925183+0000","last_fullsized":"2024-09-17T01:36:12.925183+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:45.948182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305179+0000","last_change":"2024-09-17T01:36:10.293072+0000","last_active":"2024-09-17T01:36:12.305179+0000","last_peered":"2024-09-17T01:36:12.305179+0000","last_clean":"2024-09-17T01:36:12.305179+0000","last_became_active":"2024-09-17T01:36:10.290949+0000","last_became_peered":"2024-09-17T01:36:10.290949+0000","last_unstale":"2024-09-17T01:36:12.305179+0000","last_undegraded":"2024-09-17T01:36:12.305179+0000","last_fullsized":"2024-09-17T01:36:12.305179+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:40.448306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.277116+0000","last_change":"2024-09-17T01:36:10.277116+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.277116+0000","last_undegraded":"2024-09-17T01:36:10.277116+0000","last_fullsized":"2024-09-17T01:36:10.277116+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.865999+0000","last_change":"2024-09-17T01:36:10.296734+0000","last_active":"2024-09-17T01:36:12.865999+0000","last_peered":"2024-09-17T01:36:12.865999+0000","last_clean":"2024-09-17T01:36:12.865999+0000","last_became_active":"2024-09-17T01:36:10.296463+0000","last_became_peered":"2024-09-17T01:36:10.296463+0000","last_unstale":"2024-09-17T01:36:12.865999+0000","last_undegraded":"2024-09-17T01:36:12.865999+0000","last_fullsized":"2024-09-17T01:36:12.865999+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:19.770144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303645+0000","last_change":"2024-09-17T01:36:11.306806+0000","last_active":"2024-09-17T01:36:12.303645+0000","last_peered":"2024-09-17T01:36:12.303645+0000","last_clean":"2024-09-17T01:36:12.303645+0000","last_became_active":"2024-09-17T01:36:11.306392+0000","last_became_peered":"2024-09-17T01:36:11.306392+0000","last_unstale":"2024-09-17T01:36:12.303645+0000","last_undegraded":"2024-09-17T01:36:12.303645+0000","last_fullsized":"2024-09-17T01:36:12.303645+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:58.962482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992402+0000","last_change":"2024-09-17T01:36:10.289402+0000","last_active":"2024-09-17T01:36:12.992402+0000","last_peered":"2024-09-17T01:36:12.992402+0000","last_clean":"2024-09-17T01:36:12.992402+0000","last_became_active":"2024-09-17T01:36:10.289028+0000","last_became_peered":"2024-09-17T01:36:10.289028+0000","last_unstale":"2024-09-17T01:36:12.992402+0000","last_undegraded":"2024-09-17T01:36:12.992402+0000","last_fullsized":"2024-09-17T01:36:12.992402+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:54.956235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.993014+0000","last_change":"2024-09-17T01:36:11.302630+0000","last_active":"2024-09-17T01:36:12.993014+0000","last_peered":"2024-09-17T01:36:12.993014+0000","last_clean":"2024-09-17T01:36:12.993014+0000","last_became_active":"2024-09-17T01:36:11.302324+0000","last_became_peered":"2024-09-17T01:36:11.302324+0000","last_unstale":"2024-09-17T01:36:12.993014+0000","last_undegraded":"2024-09-17T01:36:12.993014+0000","last_fullsized":"2024-09-17T01:36:12.993014+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:35.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866234+0000","last_change":"2024-09-17T01:36:10.293964+0000","last_active":"2024-09-17T01:36:12.866234+0000","last_peered":"2024-09-17T01:36:12.866234+0000","last_clean":"2024-09-17T01:36:12.866234+0000","last_became_active":"2024-09-17T01:36:10.293658+0000","last_became_peered":"2024-09-17T01:36:10.293658+0000","last_unstale":"2024-09-17T01:36:12.866234+0000","last_undegraded":"2024-09-17T01:36:12.866234+0000","last_fullsized":"2024-09-17T01:36:12.866234+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:37.278082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.285012+0000","last_change":"2024-09-17T01:36:10.285012+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.285012+0000","last_undegraded":"2024-09-17T01:36:10.285012+0000","last_fullsized":"2024-09-17T01:36:10.285012+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304174+0000","last_change":"2024-09-17T01:36:10.294720+0000","last_active":"2024-09-17T01:36:12.304174+0000","last_peered":"2024-09-17T01:36:12.304174+0000","last_clean":"2024-09-17T01:36:12.304174+0000","last_became_active":"2024-09-17T01:36:10.294012+0000","last_became_peered":"2024-09-17T01:36:10.294012+0000","last_unstale":"2024-09-17T01:36:12.304174+0000","last_undegraded":"2024-09-17T01:36:12.304174+0000","last_fullsized":"2024-09-17T01:36:12.304174+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:29.017109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304165+0000","last_change":"2024-09-17T01:36:11.319252+0000","last_active":"2024-09-17T01:36:12.304165+0000","last_peered":"2024-09-17T01:36:12.304165+0000","last_clean":"2024-09-17T01:36:12.304165+0000","last_became_active":"2024-09-17T01:36:11.316127+0000","last_became_peered":"2024-09-17T01:36:11.316127+0000","last_unstale":"2024-09-17T01:36:12.304165+0000","last_undegraded":"2024-09-17T01:36:12.304165+0000","last_fullsized":"2024-09-17T01:36:12.304165+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:57:36.447976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.077184+0000","last_change":"2024-09-17T01:36:10.298237+0000","last_active":"2024-09-17T01:36:13.077184+0000","last_peered":"2024-09-17T01:36:13.077184+0000","last_clean":"2024-09-17T01:36:13.077184+0000","last_became_active":"2024-09-17T01:36:10.297914+0000","last_became_peered":"2024-09-17T01:36:10.297914+0000","last_unstale":"2024-09-17T01:36:13.077184+0000","last_undegraded":"2024-09-17T01:36:13.077184+0000","last_fullsized":"2024-09-17T01:36:13.077184+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:58.586762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076884+0000","last_change":"2024-09-17T01:36:11.310102+0000","last_active":"2024-09-17T01:36:13.076884+0000","last_peered":"2024-09-17T01:36:13.076884+0000","last_clean":"2024-09-17T01:36:13.076884+0000","last_became_active":"2024-09-17T01:36:11.309689+0000","last_became_peered":"2024-09-17T01:36:11.309689+0000","last_unstale":"2024-09-17T01:36:13.076884+0000","last_undegraded":"2024-09-17T01:36:13.076884+0000","last_fullsized":"2024-09-17T01:36:13.076884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:00.158245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":21,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992768+0000","last_change":"2024-09-17T01:36:10.292473+0000","last_active":"2024-09-17T01:36:12.992768+0000","last_peered":"2024-09-17T01:36:12.992768+0000","last_clean":"2024-09-17T01:36:12.992768+0000","last_became_active":"2024-09-17T01:36:10.292161+0000","last_became_peered":"2024-09-17T01:36:10.292161+0000","last_unstale":"2024-09-17T01:36:12.992768+0000","last_undegraded":"2024-09-17T01:36:12.992768+0000","last_fullsized":"2024-09-17T01:36:12.992768+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:03.337816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866232+0000","last_change":"2024-09-17T01:36:11.308108+0000","last_active":"2024-09-17T01:36:12.866232+0000","last_peered":"2024-09-17T01:36:12.866232+0000","last_clean":"2024-09-17T01:36:12.866232+0000","last_became_active":"2024-09-17T01:36:11.307801+0000","last_became_peered":"2024-09-17T01:36:11.307801+0000","last_unstale":"2024-09-17T01:36:12.866232+0000","last_undegraded":"2024-09-17T01:36:12.866232+0000","last_fullsized":"2024-09-17T01:36:12.866232+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:42.954974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303899+0000","last_change":"2024-09-17T01:36:10.293577+0000","last_active":"2024-09-17T01:36:12.303899+0000","last_peered":"2024-09-17T01:36:12.303899+0000","last_clean":"2024-09-17T01:36:12.303899+0000","last_became_active":"2024-09-17T01:36:10.291934+0000","last_became_peered":"2024-09-17T01:36:10.291934+0000","last_unstale":"2024-09-17T01:36:12.303899+0000","last_undegraded":"2024-09-17T01:36:12.303899+0000","last_fullsized":"2024-09-17T01:36:12.303899+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:15.757296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.282960+0000","last_change":"2024-09-17T01:36:10.282960+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.282960+0000","last_undegraded":"2024-09-17T01:36:10.282960+0000","last_fullsized":"2024-09-17T01:36:10.282960+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076416+0000","last_change":"2024-09-17T01:36:10.291611+0000","last_active":"2024-09-17T01:36:13.076416+0000","last_peered":"2024-09-17T01:36:13.076416+0000","last_clean":"2024-09-17T01:36:13.076416+0000","last_became_active":"2024-09-17T01:36:10.291234+0000","last_became_peered":"2024-09-17T01:36:10.291234+0000","last_unstale":"2024-09-17T01:36:13.076416+0000","last_undegraded":"2024-09-17T01:36:13.076416+0000","last_fullsized":"2024-09-17T01:36:13.076416+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:22.528484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866341+0000","last_change":"2024-09-17T01:36:11.313891+0000","last_active":"2024-09-17T01:36:12.866341+0000","last_peered":"2024-09-17T01:36:12.866341+0000","last_clean":"2024-09-17T01:36:12.866341+0000","last_became_active":"2024-09-17T01:36:11.313582+0000","last_became_peered":"2024-09-17T01:36:11.313582+0000","last_unstale":"2024-09-17T01:36:12.866341+0000","last_undegraded":"2024-09-17T01:36:12.866341+0000","last_fullsized":"2024-09-17T01:36:12.866341+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:22.521895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076693+0000","last_change":"2024-09-17T01:36:10.286012+0000","last_active":"2024-09-17T01:36:13.076693+0000","last_peered":"2024-09-17T01:36:13.076693+0000","last_clean":"2024-09-17T01:36:13.076693+0000","last_became_active":"2024-09-17T01:36:10.284940+0000","last_became_peered":"2024-09-17T01:36:10.284940+0000","last_unstale":"2024-09-17T01:36:13.076693+0000","last_undegraded":"2024-09-17T01:36:13.076693+0000","last_fullsized":"2024-09-17T01:36:13.076693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:00.539807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076838+0000","last_change":"2024-09-17T01:36:11.309989+0000","last_active":"2024-09-17T01:36:13.076838+0000","last_peered":"2024-09-17T01:36:13.076838+0000","last_clean":"2024-09-17T01:36:13.076838+0000","last_became_active":"2024-09-17T01:36:11.309641+0000","last_became_peered":"2024-09-17T01:36:11.309641+0000","last_unstale":"2024-09-17T01:36:13.076838+0000","last_undegraded":"2024-09-17T01:36:13.076838+0000","last_fullsized":"2024-09-17T01:36:13.076838+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:40.530982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":23,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076341+0000","last_change":"2024-09-17T01:36:10.295240+0000","last_active":"2024-09-17T01:36:13.076341+0000","last_peered":"2024-09-17T01:36:13.076341+0000","last_clean":"2024-09-17T01:36:13.076341+0000","last_became_active":"2024-09-17T01:36:10.294945+0000","last_became_peered":"2024-09-17T01:36:10.294945+0000","last_unstale":"2024-09-17T01:36:13.076341+0000","last_undegraded":"2024-09-17T01:36:13.076341+0000","last_fullsized":"2024-09-17T01:36:13.076341+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:55.304271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.278156+0000","last_change":"2024-09-17T01:36:10.278156+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.278156+0000","last_undegraded":"2024-09-17T01:36:10.278156+0000","last_fullsized":"2024-09-17T01:36:10.278156+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023621+0000","last_change":"2024-09-17T01:36:10.298316+0000","last_active":"2024-09-17T01:36:13.023621+0000","last_peered":"2024-09-17T01:36:13.023621+0000","last_clean":"2024-09-17T01:36:13.023621+0000","last_became_active":"2024-09-17T01:36:10.297999+0000","last_became_peered":"2024-09-17T01:36:10.297999+0000","last_unstale":"2024-09-17T01:36:13.023621+0000","last_undegraded":"2024-09-17T01:36:13.023621+0000","last_fullsized":"2024-09-17T01:36:13.023621+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:38:13.536708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.284537+0000","last_change":"2024-09-17T01:36:10.284537+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.284537+0000","last_undegraded":"2024-09-17T01:36:10.284537+0000","last_fullsized":"2024-09-17T01:36:10.284537+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304328+0000","last_change":"2024-09-17T01:36:10.294353+0000","last_active":"2024-09-17T01:36:12.304328+0000","last_peered":"2024-09-17T01:36:12.304328+0000","last_clean":"2024-09-17T01:36:12.304328+0000","last_became_active":"2024-09-17T01:36:10.293440+0000","last_became_peered":"2024-09-17T01:36:10.293440+0000","last_unstale":"2024-09-17T01:36:12.304328+0000","last_undegraded":"2024-09-17T01:36:12.304328+0000","last_fullsized":"2024-09-17T01:36:12.304328+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:33.626765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023594+0000","last_change":"2024-09-17T01:36:11.320250+0000","last_active":"2024-09-17T01:36:13.023594+0000","last_peered":"2024-09-17T01:36:13.023594+0000","last_clean":"2024-09-17T01:36:13.023594+0000","last_became_active":"2024-09-17T01:36:11.319913+0000","last_became_peered":"2024-09-17T01:36:11.319913+0000","last_unstale":"2024-09-17T01:36:13.023594+0000","last_undegraded":"2024-09-17T01:36:13.023594+0000","last_fullsized":"2024-09-17T01:36:13.023594+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:03.629335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T01:36:10.299567+0000","last_change":"2024-09-17T01:36:10.294281+0000","last_active":"2024-09-17T01:36:10.299567+0000","last_peered":"2024-09-17T01:36:10.299567+0000","last_clean":"2024-09-17T01:36:10.299567+0000","last_became_active":"2024-09-17T01:36:10.293955+0000","last_became_peered":"2024-09-17T01:36:10.293955+0000","last_unstale":"2024-09-17T01:36:10.299567+0000","last_undegraded":"2024-09-17T01:36:10.299567+0000","last_fullsized":"2024-09-17T01:36:10.299567+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:38.320555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.077112+0000","last_change":"2024-09-17T01:36:11.320342+0000","last_active":"2024-09-17T01:36:13.077112+0000","last_peered":"2024-09-17T01:36:13.077112+0000","last_clean":"2024-09-17T01:36:13.077112+0000","last_became_active":"2024-09-17T01:36:11.320023+0000","last_became_peered":"2024-09-17T01:36:11.320023+0000","last_unstale":"2024-09-17T01:36:13.077112+0000","last_undegraded":"2024-09-17T01:36:13.077112+0000","last_fullsized":"2024-09-17T01:36:13.077112+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:26.695707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304315+0000","last_change":"2024-09-17T01:36:10.289087+0000","last_active":"2024-09-17T01:36:12.304315+0000","last_peered":"2024-09-17T01:36:12.304315+0000","last_clean":"2024-09-17T01:36:12.304315+0000","last_became_active":"2024-09-17T01:36:10.288721+0000","last_became_peered":"2024-09-17T01:36:10.288721+0000","last_unstale":"2024-09-17T01:36:12.304315+0000","last_undegraded":"2024-09-17T01:36:12.304315+0000","last_fullsized":"2024-09-17T01:36:12.304315+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:24:11.811046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866397+0000","last_change":"2024-09-17T01:36:11.319574+0000","last_active":"2024-09-17T01:36:12.866397+0000","last_peered":"2024-09-17T01:36:12.866397+0000","last_clean":"2024-09-17T01:36:12.866397+0000","last_became_active":"2024-09-17T01:36:11.317100+0000","last_became_peered":"2024-09-17T01:36:11.317100+0000","last_unstale":"2024-09-17T01:36:12.866397+0000","last_undegraded":"2024-09-17T01:36:12.866397+0000","last_fullsized":"2024-09-17T01:36:12.866397+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:50.155552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.924945+0000","last_change":"2024-09-17T01:36:10.295963+0000","last_active":"2024-09-17T01:36:12.924945+0000","last_peered":"2024-09-17T01:36:12.924945+0000","last_clean":"2024-09-17T01:36:12.924945+0000","last_became_active":"2024-09-17T01:36:10.294487+0000","last_became_peered":"2024-09-17T01:36:10.294487+0000","last_unstale":"2024-09-17T01:36:12.924945+0000","last_undegraded":"2024-09-17T01:36:12.924945+0000","last_fullsized":"2024-09-17T01:36:12.924945+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:18:44.054224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303371+0000","last_change":"2024-09-17T01:36:11.314041+0000","last_active":"2024-09-17T01:36:12.303371+0000","last_peered":"2024-09-17T01:36:12.303371+0000","last_clean":"2024-09-17T01:36:12.303371+0000","last_became_active":"2024-09-17T01:36:11.313573+0000","last_became_peered":"2024-09-17T01:36:11.313573+0000","last_unstale":"2024-09-17T01:36:12.303371+0000","last_undegraded":"2024-09-17T01:36:12.303371+0000","last_fullsized":"2024-09-17T01:36:12.303371+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:30.847327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303084+0000","last_change":"2024-09-17T01:36:10.293477+0000","last_active":"2024-09-17T01:36:12.303084+0000","last_peered":"2024-09-17T01:36:12.303084+0000","last_clean":"2024-09-17T01:36:12.303084+0000","last_became_active":"2024-09-17T01:36:10.293119+0000","last_became_peered":"2024-09-17T01:36:10.293119+0000","last_unstale":"2024-09-17T01:36:12.303084+0000","last_undegraded":"2024-09-17T01:36:12.303084+0000","last_fullsized":"2024-09-17T01:36:12.303084+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:02.386471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303044+0000","last_change":"2024-09-17T01:36:11.315150+0000","last_active":"2024-09-17T01:36:12.303044+0000","last_peered":"2024-09-17T01:36:12.303044+0000","last_clean":"2024-09-17T01:36:12.303044+0000","last_became_active":"2024-09-17T01:36:11.314846+0000","last_became_peered":"2024-09-17T01:36:11.314846+0000","last_unstale":"2024-09-17T01:36:12.303044+0000","last_undegraded":"2024-09-17T01:36:12.303044+0000","last_fullsized":"2024-09-17T01:36:12.303044+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:08.297937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866344+0000","last_change":"2024-09-17T01:36:10.280718+0000","last_active":"2024-09-17T01:36:12.866344+0000","last_peered":"2024-09-17T01:36:12.866344+0000","last_clean":"2024-09-17T01:36:12.866344+0000","last_became_active":"2024-09-17T01:36:10.280401+0000","last_became_peered":"2024-09-17T01:36:10.280401+0000","last_unstale":"2024-09-17T01:36:12.866344+0000","last_undegraded":"2024-09-17T01:36:12.866344+0000","last_fullsized":"2024-09-17T01:36:12.866344+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:46.578001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.277627+0000","last_change":"2024-09-17T01:36:10.277627+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.277627+0000","last_undegraded":"2024-09-17T01:36:10.277627+0000","last_fullsized":"2024-09-17T01:36:10.277627+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023788+0000","last_change":"2024-09-17T01:36:10.298876+0000","last_active":"2024-09-17T01:36:13.023788+0000","last_peered":"2024-09-17T01:36:13.023788+0000","last_clean":"2024-09-17T01:36:13.023788+0000","last_became_active":"2024-09-17T01:36:10.298564+0000","last_became_peered":"2024-09-17T01:36:10.298564+0000","last_unstale":"2024-09-17T01:36:13.023788+0000","last_undegraded":"2024-09-17T01:36:13.023788+0000","last_fullsized":"2024-09-17T01:36:13.023788+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:48.499379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.277174+0000","last_change":"2024-09-17T01:36:10.277174+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.277174+0000","last_undegraded":"2024-09-17T01:36:10.277174+0000","last_fullsized":"2024-09-17T01:36:10.277174+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"62'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305072+0000","last_change":"2024-09-17T01:36:10.290784+0000","last_active":"2024-09-17T01:36:12.305072+0000","last_peered":"2024-09-17T01:36:12.305072+0000","last_clean":"2024-09-17T01:36:12.305072+0000","last_became_active":"2024-09-17T01:36:10.288289+0000","last_became_peered":"2024-09-17T01:36:10.288289+0000","last_unstale":"2024-09-17T01:36:12.305072+0000","last_undegraded":"2024-09-17T01:36:12.305072+0000","last_fullsized":"2024-09-17T01:36:12.305072+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:25.435670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023456+0000","last_change":"2024-09-17T01:36:11.316442+0000","last_active":"2024-09-17T01:36:13.023456+0000","last_peered":"2024-09-17T01:36:13.023456+0000","last_clean":"2024-09-17T01:36:13.023456+0000","last_became_active":"2024-09-17T01:36:11.315668+0000","last_became_peered":"2024-09-17T01:36:11.315668+0000","last_unstale":"2024-09-17T01:36:13.023456+0000","last_undegraded":"2024-09-17T01:36:13.023456+0000","last_fullsized":"2024-09-17T01:36:13.023456+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:15:50.717398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866158+0000","last_change":"2024-09-17T01:36:10.289540+0000","last_active":"2024-09-17T01:36:12.866158+0000","last_peered":"2024-09-17T01:36:12.866158+0000","last_clean":"2024-09-17T01:36:12.866158+0000","last_became_active":"2024-09-17T01:36:10.289239+0000","last_became_peered":"2024-09-17T01:36:10.289239+0000","last_unstale":"2024-09-17T01:36:12.866158+0000","last_undegraded":"2024-09-17T01:36:12.866158+0000","last_fullsized":"2024-09-17T01:36:12.866158+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:41.502277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303227+0000","last_change":"2024-09-17T01:36:11.309355+0000","last_active":"2024-09-17T01:36:12.303227+0000","last_peered":"2024-09-17T01:36:12.303227+0000","last_clean":"2024-09-17T01:36:12.303227+0000","last_became_active":"2024-09-17T01:36:11.308670+0000","last_became_peered":"2024-09-17T01:36:11.308670+0000","last_unstale":"2024-09-17T01:36:12.303227+0000","last_undegraded":"2024-09-17T01:36:12.303227+0000","last_fullsized":"2024-09-17T01:36:12.303227+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:52:53.600454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T01:36:10.299909+0000","last_change":"2024-09-17T01:36:10.297976+0000","last_active":"2024-09-17T01:36:10.299909+0000","last_peered":"2024-09-17T01:36:10.299909+0000","last_clean":"2024-09-17T01:36:10.299909+0000","last_became_active":"2024-09-17T01:36:10.297673+0000","last_became_peered":"2024-09-17T01:36:10.297673+0000","last_unstale":"2024-09-17T01:36:10.299909+0000","last_undegraded":"2024-09-17T01:36:10.299909+0000","last_fullsized":"2024-09-17T01:36:10.299909+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:13:21.070126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304632+0000","last_change":"2024-09-17T01:36:11.300517+0000","last_active":"2024-09-17T01:36:12.304632+0000","last_peered":"2024-09-17T01:36:12.304632+0000","last_clean":"2024-09-17T01:36:12.304632+0000","last_became_active":"2024-09-17T01:36:11.300185+0000","last_became_peered":"2024-09-17T01:36:11.300185+0000","last_unstale":"2024-09-17T01:36:12.304632+0000","last_undegraded":"2024-09-17T01:36:12.304632+0000","last_fullsized":"2024-09-17T01:36:12.304632+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:56.615253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023327+0000","last_change":"2024-09-17T01:36:10.298497+0000","last_active":"2024-09-17T01:36:13.023327+0000","last_peered":"2024-09-17T01:36:13.023327+0000","last_clean":"2024-09-17T01:36:13.023327+0000","last_became_active":"2024-09-17T01:36:10.298121+0000","last_became_peered":"2024-09-17T01:36:10.298121+0000","last_unstale":"2024-09-17T01:36:13.023327+0000","last_undegraded":"2024-09-17T01:36:13.023327+0000","last_fullsized":"2024-09-17T01:36:13.023327+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:38.190524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992863+0000","last_change":"2024-09-17T01:36:11.321630+0000","last_active":"2024-09-17T01:36:12.992863+0000","last_peered":"2024-09-17T01:36:12.992863+0000","last_clean":"2024-09-17T01:36:12.992863+0000","last_became_active":"2024-09-17T01:36:11.321328+0000","last_became_peered":"2024-09-17T01:36:11.321328+0000","last_unstale":"2024-09-17T01:36:12.992863+0000","last_undegraded":"2024-09-17T01:36:12.992863+0000","last_fullsized":"2024-09-17T01:36:12.992863+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:39.391906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T01:36:10.300301+0000","last_change":"2024-09-17T01:36:10.296407+0000","last_active":"2024-09-17T01:36:10.300301+0000","last_peered":"2024-09-17T01:36:10.300301+0000","last_clean":"2024-09-17T01:36:10.300301+0000","last_became_active":"2024-09-17T01:36:10.296089+0000","last_became_peered":"2024-09-17T01:36:10.296089+0000","last_unstale":"2024-09-17T01:36:10.300301+0000","last_undegraded":"2024-09-17T01:36:10.300301+0000","last_fullsized":"2024-09-17T01:36:10.300301+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:04.809194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.302818+0000","last_change":"2024-09-17T01:36:11.310738+0000","last_active":"2024-09-17T01:36:12.302818+0000","last_peered":"2024-09-17T01:36:12.302818+0000","last_clean":"2024-09-17T01:36:12.302818+0000","last_became_active":"2024-09-17T01:36:11.310431+0000","last_became_peered":"2024-09-17T01:36:11.310431+0000","last_unstale":"2024-09-17T01:36:12.302818+0000","last_undegraded":"2024-09-17T01:36:12.302818+0000","last_fullsized":"2024-09-17T01:36:12.302818+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:54.749692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303734+0000","last_change":"2024-09-17T01:36:10.290312+0000","last_active":"2024-09-17T01:36:12.303734+0000","last_peered":"2024-09-17T01:36:12.303734+0000","last_clean":"2024-09-17T01:36:12.303734+0000","last_became_active":"2024-09-17T01:36:10.287956+0000","last_became_peered":"2024-09-17T01:36:10.287956+0000","last_unstale":"2024-09-17T01:36:12.303734+0000","last_undegraded":"2024-09-17T01:36:12.303734+0000","last_fullsized":"2024-09-17T01:36:12.303734+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:02.623172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023505+0000","last_change":"2024-09-17T01:36:11.319336+0000","last_active":"2024-09-17T01:36:13.023505+0000","last_peered":"2024-09-17T01:36:13.023505+0000","last_clean":"2024-09-17T01:36:13.023505+0000","last_became_active":"2024-09-17T01:36:11.319012+0000","last_became_peered":"2024-09-17T01:36:11.319012+0000","last_unstale":"2024-09-17T01:36:13.023505+0000","last_undegraded":"2024-09-17T01:36:13.023505+0000","last_fullsized":"2024-09-17T01:36:13.023505+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:23.186639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303218+0000","last_change":"2024-09-17T01:36:10.289718+0000","last_active":"2024-09-17T01:36:12.303218+0000","last_peered":"2024-09-17T01:36:12.303218+0000","last_clean":"2024-09-17T01:36:12.303218+0000","last_became_active":"2024-09-17T01:36:10.289409+0000","last_became_peered":"2024-09-17T01:36:10.289409+0000","last_unstale":"2024-09-17T01:36:12.303218+0000","last_undegraded":"2024-09-17T01:36:12.303218+0000","last_fullsized":"2024-09-17T01:36:12.303218+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:57.059026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304882+0000","last_change":"2024-09-17T01:36:11.309282+0000","last_active":"2024-09-17T01:36:12.304882+0000","last_peered":"2024-09-17T01:36:12.304882+0000","last_clean":"2024-09-17T01:36:12.304882+0000","last_became_active":"2024-09-17T01:36:11.308775+0000","last_became_peered":"2024-09-17T01:36:11.308775+0000","last_unstale":"2024-09-17T01:36:12.304882+0000","last_undegraded":"2024-09-17T01:36:12.304882+0000","last_fullsized":"2024-09-17T01:36:12.304882+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:20.099586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992452+0000","last_change":"2024-09-17T01:36:10.294227+0000","last_active":"2024-09-17T01:36:12.992452+0000","last_peered":"2024-09-17T01:36:12.992452+0000","last_clean":"2024-09-17T01:36:12.992452+0000","last_became_active":"2024-09-17T01:36:10.291395+0000","last_became_peered":"2024-09-17T01:36:10.291395+0000","last_unstale":"2024-09-17T01:36:12.992452+0000","last_undegraded":"2024-09-17T01:36:12.992452+0000","last_fullsized":"2024-09-17T01:36:12.992452+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:05.348862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":187,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.865857+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:36:12.865857+0000","last_peered":"2024-09-17T01:36:12.865857+0000","last_clean":"2024-09-17T01:36:12.865857+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:36:12.865857+0000","last_undegraded":"2024-09-17T01:36:12.865857+0000","last_fullsized":"2024-09-17T01:36:12.865857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476791,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":700416,"data_stored":290181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509495,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36076,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335764,"statfs":{"total":96636764160,"available":96599822336,"internally_reserved":0,"allocated":745472,"data_stored":309623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40232,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331608,"statfs":{"total":96636764160,"available":96595566592,"internally_reserved":0,"allocated":741376,"data_stored":309553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509495,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40236,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331604,"statfs":{"total":96636764160,"available":96595562496,"internally_reserved":0,"allocated":745472,"data_stored":310147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509495,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":309621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509494,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40812,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331028,"statfs":{"total":96636764160,"available":96594972672,"internally_reserved":0,"allocated":1335296,"data_stored":900481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509496,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36080,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335760,"statfs":{"total":96636764160,"available":96599818240,"internally_reserved":0,"allocated":749568,"data_stored":311143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542200,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40812,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331028,"statfs":{"total":96636764160,"available":96594972672,"internally_reserved":0,"allocated":1335296,"data_stored":899933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:36:15.768 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:36:16.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.035+0000 7fb1bb200640 1 -- 172.21.15.42:0/3085481923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1bc0d2810 msgr2=0x7fb1bc15e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:16.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.035+0000 7fb1bb200640 1 --2- 172.21.15.42:0/3085481923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1bc0d2810 0x7fb1bc15e910 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009830 tx=0x7fb1a402a480 comp rx=0 tx=0).stop 2024-09-17T01:36:16.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.036+0000 7fb1bb200640 1 -- 172.21.15.42:0/3085481923 shutdown_connections 2024-09-17T01:36:16.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.036+0000 7fb1bb200640 1 --2- 172.21.15.42:0/3085481923 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1bc0b6030 0x7fb1bc0b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:16.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.036+0000 7fb1bb200640 1 --2- 172.21.15.42:0/3085481923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1bc0d2810 0x7fb1bc15e910 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:16.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.036+0000 7fb1bb200640 1 -- 172.21.15.42:0/3085481923 >> 172.21.15.42:0/3085481923 conn(0x7fb1bc0d1210 msgr2=0x7fb1bc0d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:16.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.036+0000 7fb1bb200640 1 -- 172.21.15.42:0/3085481923 shutdown_connections 2024-09-17T01:36:16.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.036+0000 7fb1bb200640 1 -- 172.21.15.42:0/3085481923 wait complete. 2024-09-17T01:36:16.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.038+0000 7fb1bb200640 1 Processor -- start 2024-09-17T01:36:16.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.038+0000 7fb1bb200640 1 -- start start 2024-09-17T01:36:16.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.039+0000 7fb1bb200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1bc073340 0x7fb1bc15d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:16.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.039+0000 7fb1bb200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1bc0b6030 0x7fb1bc15db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:16.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.039+0000 7fb1bb200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1bc0d2810 0x7fb1bc1f9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:16.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.039+0000 7fb1bb200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc15f880 con 0x7fb1bc073340 2024-09-17T01:36:16.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.039+0000 7fb1bb200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc15f700 con 0x7fb1bc0d2810 2024-09-17T01:36:16.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.039+0000 7fb1bb200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb1bc15fa00 con 0x7fb1bc0b6030 2024-09-17T01:36:16.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.040+0000 7fb1b9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1bc073340 0x7fb1bc15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:16.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.040+0000 7fb1b9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1bc073340 0x7fb1bc15d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51964/0 (socket says 172.21.15.42:51964) 2024-09-17T01:36:16.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.040+0000 7fb1b9e00640 1 -- 172.21.15.42:0/3147525016 learned_addr learned my addr 172.21.15.42:0/3147525016 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:16.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.040+0000 7fb1ba800640 1 --2- 172.21.15.42:0/3147525016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1bc0d2810 0x7fb1bc1f9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:16.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.040+0000 7fb1b1400640 1 --2- 172.21.15.42:0/3147525016 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1bc0b6030 0x7fb1bc15db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:16.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.040+0000 7fb1b9e00640 1 -- 172.21.15.42:0/3147525016 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1bc0b6030 msgr2=0x7fb1bc15db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:16.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.040+0000 7fb1b9e00640 1 --2- 172.21.15.42:0/3147525016 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1bc0b6030 0x7fb1bc15db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:16.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.040+0000 7fb1b9e00640 1 -- 172.21.15.42:0/3147525016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1bc0d2810 msgr2=0x7fb1bc1f9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:16.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.040+0000 7fb1b9e00640 1 --2- 172.21.15.42:0/3147525016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1bc0d2810 0x7fb1bc1f9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:16.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.040+0000 7fb1b9e00640 1 -- 172.21.15.42:0/3147525016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1bc1f59d0 con 0x7fb1bc073340 2024-09-17T01:36:16.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.040+0000 7fb1ba800640 1 --2- 172.21.15.42:0/3147525016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1bc0d2810 0x7fb1bc1f9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:36:16.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.041+0000 7fb1b9e00640 1 --2- 172.21.15.42:0/3147525016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1bc073340 0x7fb1bc15d630 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00c760 tx=0x7fb1ac00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:16.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.041+0000 7fb1b2a00640 1 -- 172.21.15.42:0/3147525016 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac016020 con 0x7fb1bc073340 2024-09-17T01:36:16.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.041+0000 7fb1b2a00640 1 -- 172.21.15.42:0/3147525016 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1ac00a8f0 con 0x7fb1bc073340 2024-09-17T01:36:16.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.041+0000 7fb1bb200640 1 -- 172.21.15.42:0/3147525016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1bc1f5cb0 con 0x7fb1bc073340 2024-09-17T01:36:16.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.041+0000 7fb1b2a00640 1 -- 172.21.15.42:0/3147525016 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac00ad40 con 0x7fb1bc073340 2024-09-17T01:36:16.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.041+0000 7fb1bb200640 1 -- 172.21.15.42:0/3147525016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1bc155630 con 0x7fb1bc073340 2024-09-17T01:36:16.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.042+0000 7fb1bb200640 1 -- 172.21.15.42:0/3147525016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1bc0b5c80 con 0x7fb1bc073340 2024-09-17T01:36:16.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.043+0000 7fb1b2a00640 1 -- 172.21.15.42:0/3147525016 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb1ac019020 con 0x7fb1bc073340 2024-09-17T01:36:16.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.044+0000 7fb1b2a00640 1 --2- 172.21.15.42:0/3147525016 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb198078b90 0x7fb19807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:16.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.044+0000 7fb1b2a00640 1 -- 172.21.15.42:0/3147525016 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7fb1ac09ac90 con 0x7fb1bc073340 2024-09-17T01:36:16.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.045+0000 7fb1b1400640 1 --2- 172.21.15.42:0/3147525016 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb198078b90 0x7fb19807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:16.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.046+0000 7fb1b1400640 1 --2- 172.21.15.42:0/3147525016 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb198078b90 0x7fb19807b0a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4034000 tx=0x7fb1a4004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:16.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.049+0000 7fb1b2a00640 1 -- 172.21.15.42:0/3147525016 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb1ac020020 con 0x7fb1bc073340 2024-09-17T01:36:16.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.240+0000 7fb1bb200640 1 -- 172.21.15.42:0/3147525016 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb1bc1558d0 con 0x7fb198078b90 2024-09-17T01:36:16.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.246+0000 7fb1b2a00640 1 -- 172.21.15.42:0/3147525016 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251127 (secure 0 0 0) 0x7fb1bc1558d0 con 0x7fb198078b90 2024-09-17T01:36:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:16.247 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:36:16.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.250+0000 7fb1bb200640 1 -- 172.21.15.42:0/3147525016 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb198078b90 msgr2=0x7fb19807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:16.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.250+0000 7fb1bb200640 1 --2- 172.21.15.42:0/3147525016 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb198078b90 0x7fb19807b0a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4034000 tx=0x7fb1a4004730 comp rx=0 tx=0).stop 2024-09-17T01:36:16.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.250+0000 7fb1bb200640 1 -- 172.21.15.42:0/3147525016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1bc073340 msgr2=0x7fb1bc15d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:16.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.250+0000 7fb1bb200640 1 --2- 172.21.15.42:0/3147525016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1bc073340 0x7fb1bc15d630 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00c760 tx=0x7fb1ac00cc20 comp rx=0 tx=0).stop 2024-09-17T01:36:16.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.250+0000 7fb1bb200640 1 -- 172.21.15.42:0/3147525016 shutdown_connections 2024-09-17T01:36:16.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.250+0000 7fb1bb200640 1 --2- 172.21.15.42:0/3147525016 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb198078b90 0x7fb19807b0a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:16.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.250+0000 7fb1bb200640 1 --2- 172.21.15.42:0/3147525016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1bc0d2810 0x7fb1bc1f9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:16.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.250+0000 7fb1bb200640 1 --2- 172.21.15.42:0/3147525016 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1bc0b6030 0x7fb1bc15db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:16.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.250+0000 7fb1bb200640 1 --2- 172.21.15.42:0/3147525016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1bc073340 0x7fb1bc15d630 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:16.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.250+0000 7fb1bb200640 1 -- 172.21.15.42:0/3147525016 >> 172.21.15.42:0/3147525016 conn(0x7fb1bc0d1210 msgr2=0x7fb1bc15cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:16.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.250+0000 7fb1bb200640 1 -- 172.21.15.42:0/3147525016 shutdown_connections 2024-09-17T01:36:16.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.250+0000 7fb1bb200640 1 -- 172.21.15.42:0/3147525016 wait complete. 2024-09-17T01:36:16.272 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-09-17T01:36:15.046401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289716,"kb_used_data":6928,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754685004,"statfs":{"total":773094113280,"available":772797444096,"internally_reserved":0,"allocated":7094272,"data_stored":3640682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":289394228},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.779745"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304704+0000","last_change":"2024-09-17T01:36:11.317189+0000","last_active":"2024-09-17T01:36:12.304704+0000","last_peered":"2024-09-17T01:36:12.304704+0000","last_clean":"2024-09-17T01:36:12.304704+0000","last_became_active":"2024-09-17T01:36:11.316776+0000","last_became_peered":"2024-09-17T01:36:11.316776+0000","last_unstale":"2024-09-17T01:36:12.304704+0000","last_undegraded":"2024-09-17T01:36:12.304704+0000","last_fullsized":"2024-09-17T01:36:12.304704+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:35.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023723+0000","last_change":"2024-09-17T01:36:11.325731+0000","last_active":"2024-09-17T01:36:13.023723+0000","last_peered":"2024-09-17T01:36:13.023723+0000","last_clean":"2024-09-17T01:36:13.023723+0000","last_became_active":"2024-09-17T01:36:11.325325+0000","last_became_peered":"2024-09-17T01:36:11.325325+0000","last_unstale":"2024-09-17T01:36:13.023723+0000","last_undegraded":"2024-09-17T01:36:13.023723+0000","last_fullsized":"2024-09-17T01:36:13.023723+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:12.067713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.286381+0000","last_change":"2024-09-17T01:36:10.286381+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.286381+0000","last_undegraded":"2024-09-17T01:36:10.286381+0000","last_fullsized":"2024-09-17T01:36:10.286381+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076816+0000","last_change":"2024-09-17T01:36:11.319236+0000","last_active":"2024-09-17T01:36:13.076816+0000","last_peered":"2024-09-17T01:36:13.076816+0000","last_clean":"2024-09-17T01:36:13.076816+0000","last_became_active":"2024-09-17T01:36:11.318786+0000","last_became_peered":"2024-09-17T01:36:11.318786+0000","last_unstale":"2024-09-17T01:36:13.076816+0000","last_undegraded":"2024-09-17T01:36:13.076816+0000","last_fullsized":"2024-09-17T01:36:13.076816+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:56:37.137202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304383+0000","last_change":"2024-09-17T01:36:11.295952+0000","last_active":"2024-09-17T01:36:12.304383+0000","last_peered":"2024-09-17T01:36:12.304383+0000","last_clean":"2024-09-17T01:36:12.304383+0000","last_became_active":"2024-09-17T01:36:11.295523+0000","last_became_peered":"2024-09-17T01:36:11.295523+0000","last_unstale":"2024-09-17T01:36:12.304383+0000","last_undegraded":"2024-09-17T01:36:12.304383+0000","last_fullsized":"2024-09-17T01:36:12.304383+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:08.202105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304321+0000","last_change":"2024-09-17T01:36:11.303156+0000","last_active":"2024-09-17T01:36:12.304321+0000","last_peered":"2024-09-17T01:36:12.304321+0000","last_clean":"2024-09-17T01:36:12.304321+0000","last_became_active":"2024-09-17T01:36:11.302790+0000","last_became_peered":"2024-09-17T01:36:11.302790+0000","last_unstale":"2024-09-17T01:36:12.304321+0000","last_undegraded":"2024-09-17T01:36:12.304321+0000","last_fullsized":"2024-09-17T01:36:12.304321+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:30.181703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076553+0000","last_change":"2024-09-17T01:36:11.293632+0000","last_active":"2024-09-17T01:36:13.076553+0000","last_peered":"2024-09-17T01:36:13.076553+0000","last_clean":"2024-09-17T01:36:13.076553+0000","last_became_active":"2024-09-17T01:36:11.293324+0000","last_became_peered":"2024-09-17T01:36:11.293324+0000","last_unstale":"2024-09-17T01:36:13.076553+0000","last_undegraded":"2024-09-17T01:36:13.076553+0000","last_fullsized":"2024-09-17T01:36:13.076553+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:51.396274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.302970+0000","last_change":"2024-09-17T01:36:11.317048+0000","last_active":"2024-09-17T01:36:12.302970+0000","last_peered":"2024-09-17T01:36:12.302970+0000","last_clean":"2024-09-17T01:36:12.302970+0000","last_became_active":"2024-09-17T01:36:11.315266+0000","last_became_peered":"2024-09-17T01:36:11.315266+0000","last_unstale":"2024-09-17T01:36:12.302970+0000","last_undegraded":"2024-09-17T01:36:12.302970+0000","last_fullsized":"2024-09-17T01:36:12.302970+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:17.967682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866481+0000","last_change":"2024-09-17T01:36:11.303422+0000","last_active":"2024-09-17T01:36:12.866481+0000","last_peered":"2024-09-17T01:36:12.866481+0000","last_clean":"2024-09-17T01:36:12.866481+0000","last_became_active":"2024-09-17T01:36:11.303095+0000","last_became_peered":"2024-09-17T01:36:11.303095+0000","last_unstale":"2024-09-17T01:36:12.866481+0000","last_undegraded":"2024-09-17T01:36:12.866481+0000","last_fullsized":"2024-09-17T01:36:12.866481+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:06.849909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304675+0000","last_change":"2024-09-17T01:36:11.311252+0000","last_active":"2024-09-17T01:36:12.304675+0000","last_peered":"2024-09-17T01:36:12.304675+0000","last_clean":"2024-09-17T01:36:12.304675+0000","last_became_active":"2024-09-17T01:36:11.304478+0000","last_became_peered":"2024-09-17T01:36:11.304478+0000","last_unstale":"2024-09-17T01:36:12.304675+0000","last_undegraded":"2024-09-17T01:36:12.304675+0000","last_fullsized":"2024-09-17T01:36:12.304675+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:24.361465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925132+0000","last_change":"2024-09-17T01:36:11.315637+0000","last_active":"2024-09-17T01:36:12.925132+0000","last_peered":"2024-09-17T01:36:12.925132+0000","last_clean":"2024-09-17T01:36:12.925132+0000","last_became_active":"2024-09-17T01:36:11.314795+0000","last_became_peered":"2024-09-17T01:36:11.314795+0000","last_unstale":"2024-09-17T01:36:12.925132+0000","last_undegraded":"2024-09-17T01:36:12.925132+0000","last_fullsized":"2024-09-17T01:36:12.925132+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:18.981223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866361+0000","last_change":"2024-09-17T01:36:11.313898+0000","last_active":"2024-09-17T01:36:12.866361+0000","last_peered":"2024-09-17T01:36:12.866361+0000","last_clean":"2024-09-17T01:36:12.866361+0000","last_became_active":"2024-09-17T01:36:11.313556+0000","last_became_peered":"2024-09-17T01:36:11.313556+0000","last_unstale":"2024-09-17T01:36:12.866361+0000","last_undegraded":"2024-09-17T01:36:12.866361+0000","last_fullsized":"2024-09-17T01:36:12.866361+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:22:02.980623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992700+0000","last_change":"2024-09-17T01:36:11.308618+0000","last_active":"2024-09-17T01:36:12.992700+0000","last_peered":"2024-09-17T01:36:12.992700+0000","last_clean":"2024-09-17T01:36:12.992700+0000","last_became_active":"2024-09-17T01:36:11.308319+0000","last_became_peered":"2024-09-17T01:36:11.308319+0000","last_unstale":"2024-09-17T01:36:12.992700+0000","last_undegraded":"2024-09-17T01:36:12.992700+0000","last_fullsized":"2024-09-17T01:36:12.992700+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:34.276355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.285301+0000","last_change":"2024-09-17T01:36:10.285301+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.285301+0000","last_undegraded":"2024-09-17T01:36:10.285301+0000","last_fullsized":"2024-09-17T01:36:10.285301+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992453+0000","last_change":"2024-09-17T01:36:11.318165+0000","last_active":"2024-09-17T01:36:12.992453+0000","last_peered":"2024-09-17T01:36:12.992453+0000","last_clean":"2024-09-17T01:36:12.992453+0000","last_became_active":"2024-09-17T01:36:11.317875+0000","last_became_peered":"2024-09-17T01:36:11.317875+0000","last_unstale":"2024-09-17T01:36:12.992453+0000","last_undegraded":"2024-09-17T01:36:12.992453+0000","last_fullsized":"2024-09-17T01:36:12.992453+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:00.765527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303951+0000","last_change":"2024-09-17T01:36:11.297004+0000","last_active":"2024-09-17T01:36:12.303951+0000","last_peered":"2024-09-17T01:36:12.303951+0000","last_clean":"2024-09-17T01:36:12.303951+0000","last_became_active":"2024-09-17T01:36:11.296661+0000","last_became_peered":"2024-09-17T01:36:11.296661+0000","last_unstale":"2024-09-17T01:36:12.303951+0000","last_undegraded":"2024-09-17T01:36:12.303951+0000","last_fullsized":"2024-09-17T01:36:12.303951+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:18.099170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305020+0000","last_change":"2024-09-17T01:36:11.303184+0000","last_active":"2024-09-17T01:36:12.305020+0000","last_peered":"2024-09-17T01:36:12.305020+0000","last_clean":"2024-09-17T01:36:12.305020+0000","last_became_active":"2024-09-17T01:36:11.302826+0000","last_became_peered":"2024-09-17T01:36:11.302826+0000","last_unstale":"2024-09-17T01:36:12.305020+0000","last_undegraded":"2024-09-17T01:36:12.305020+0000","last_fullsized":"2024-09-17T01:36:12.305020+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:59.362677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.278679+0000","last_change":"2024-09-17T01:36:10.278679+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.278679+0000","last_undegraded":"2024-09-17T01:36:10.278679+0000","last_fullsized":"2024-09-17T01:36:10.278679+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023564+0000","last_change":"2024-09-17T01:36:11.323204+0000","last_active":"2024-09-17T01:36:13.023564+0000","last_peered":"2024-09-17T01:36:13.023564+0000","last_clean":"2024-09-17T01:36:13.023564+0000","last_became_active":"2024-09-17T01:36:11.322063+0000","last_became_peered":"2024-09-17T01:36:11.322063+0000","last_unstale":"2024-09-17T01:36:13.023564+0000","last_undegraded":"2024-09-17T01:36:13.023564+0000","last_fullsized":"2024-09-17T01:36:13.023564+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:11.122810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925263+0000","last_change":"2024-09-17T01:36:11.315695+0000","last_active":"2024-09-17T01:36:12.925263+0000","last_peered":"2024-09-17T01:36:12.925263+0000","last_clean":"2024-09-17T01:36:12.925263+0000","last_became_active":"2024-09-17T01:36:11.315143+0000","last_became_peered":"2024-09-17T01:36:11.315143+0000","last_unstale":"2024-09-17T01:36:12.925263+0000","last_undegraded":"2024-09-17T01:36:12.925263+0000","last_fullsized":"2024-09-17T01:36:12.925263+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:35.194646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992684+0000","last_change":"2024-09-17T01:36:11.323619+0000","last_active":"2024-09-17T01:36:12.992684+0000","last_peered":"2024-09-17T01:36:12.992684+0000","last_clean":"2024-09-17T01:36:12.992684+0000","last_became_active":"2024-09-17T01:36:11.323346+0000","last_became_peered":"2024-09-17T01:36:11.323346+0000","last_unstale":"2024-09-17T01:36:12.992684+0000","last_undegraded":"2024-09-17T01:36:12.992684+0000","last_fullsized":"2024-09-17T01:36:12.992684+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:08.202105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925295+0000","last_change":"2024-09-17T01:36:11.305911+0000","last_active":"2024-09-17T01:36:12.925295+0000","last_peered":"2024-09-17T01:36:12.925295+0000","last_clean":"2024-09-17T01:36:12.925295+0000","last_became_active":"2024-09-17T01:36:11.305567+0000","last_became_peered":"2024-09-17T01:36:11.305567+0000","last_unstale":"2024-09-17T01:36:12.925295+0000","last_undegraded":"2024-09-17T01:36:12.925295+0000","last_fullsized":"2024-09-17T01:36:12.925295+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:07.419500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076616+0000","last_change":"2024-09-17T01:36:11.310245+0000","last_active":"2024-09-17T01:36:13.076616+0000","last_peered":"2024-09-17T01:36:13.076616+0000","last_clean":"2024-09-17T01:36:13.076616+0000","last_became_active":"2024-09-17T01:36:11.309949+0000","last_became_peered":"2024-09-17T01:36:11.309949+0000","last_unstale":"2024-09-17T01:36:13.076616+0000","last_undegraded":"2024-09-17T01:36:13.076616+0000","last_fullsized":"2024-09-17T01:36:13.076616+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:42.594893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866214+0000","last_change":"2024-09-17T01:36:11.318149+0000","last_active":"2024-09-17T01:36:12.866214+0000","last_peered":"2024-09-17T01:36:12.866214+0000","last_clean":"2024-09-17T01:36:12.866214+0000","last_became_active":"2024-09-17T01:36:11.317798+0000","last_became_peered":"2024-09-17T01:36:11.317798+0000","last_unstale":"2024-09-17T01:36:12.866214+0000","last_undegraded":"2024-09-17T01:36:12.866214+0000","last_fullsized":"2024-09-17T01:36:12.866214+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:52.367069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023788+0000","last_change":"2024-09-17T01:36:11.325158+0000","last_active":"2024-09-17T01:36:13.023788+0000","last_peered":"2024-09-17T01:36:13.023788+0000","last_clean":"2024-09-17T01:36:13.023788+0000","last_became_active":"2024-09-17T01:36:11.323928+0000","last_became_peered":"2024-09-17T01:36:11.323928+0000","last_unstale":"2024-09-17T01:36:13.023788+0000","last_undegraded":"2024-09-17T01:36:13.023788+0000","last_fullsized":"2024-09-17T01:36:13.023788+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:26.441833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.993007+0000","last_change":"2024-09-17T01:36:11.314300+0000","last_active":"2024-09-17T01:36:12.993007+0000","last_peered":"2024-09-17T01:36:12.993007+0000","last_clean":"2024-09-17T01:36:12.993007+0000","last_became_active":"2024-09-17T01:36:11.313197+0000","last_became_peered":"2024-09-17T01:36:11.313197+0000","last_unstale":"2024-09-17T01:36:12.993007+0000","last_undegraded":"2024-09-17T01:36:12.993007+0000","last_fullsized":"2024-09-17T01:36:12.993007+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:24.449150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023920+0000","last_change":"2024-09-17T01:36:11.318641+0000","last_active":"2024-09-17T01:36:13.023920+0000","last_peered":"2024-09-17T01:36:13.023920+0000","last_clean":"2024-09-17T01:36:13.023920+0000","last_became_active":"2024-09-17T01:36:11.317933+0000","last_became_peered":"2024-09-17T01:36:11.317933+0000","last_unstale":"2024-09-17T01:36:13.023920+0000","last_undegraded":"2024-09-17T01:36:13.023920+0000","last_fullsized":"2024-09-17T01:36:13.023920+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:07:47.466557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303627+0000","last_change":"2024-09-17T01:36:11.317931+0000","last_active":"2024-09-17T01:36:12.303627+0000","last_peered":"2024-09-17T01:36:12.303627+0000","last_clean":"2024-09-17T01:36:12.303627+0000","last_became_active":"2024-09-17T01:36:11.310928+0000","last_became_peered":"2024-09-17T01:36:11.310928+0000","last_unstale":"2024-09-17T01:36:12.303627+0000","last_undegraded":"2024-09-17T01:36:12.303627+0000","last_fullsized":"2024-09-17T01:36:12.303627+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:04.246558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304597+0000","last_change":"2024-09-17T01:36:11.308715+0000","last_active":"2024-09-17T01:36:12.304597+0000","last_peered":"2024-09-17T01:36:12.304597+0000","last_clean":"2024-09-17T01:36:12.304597+0000","last_became_active":"2024-09-17T01:36:11.308287+0000","last_became_peered":"2024-09-17T01:36:11.308287+0000","last_unstale":"2024-09-17T01:36:12.304597+0000","last_undegraded":"2024-09-17T01:36:12.304597+0000","last_fullsized":"2024-09-17T01:36:12.304597+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:57.671724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076588+0000","last_change":"2024-09-17T01:36:11.304384+0000","last_active":"2024-09-17T01:36:13.076588+0000","last_peered":"2024-09-17T01:36:13.076588+0000","last_clean":"2024-09-17T01:36:13.076588+0000","last_became_active":"2024-09-17T01:36:11.302561+0000","last_became_peered":"2024-09-17T01:36:11.302561+0000","last_unstale":"2024-09-17T01:36:13.076588+0000","last_undegraded":"2024-09-17T01:36:13.076588+0000","last_fullsized":"2024-09-17T01:36:13.076588+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:36.574249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023288+0000","last_change":"2024-09-17T01:36:11.313970+0000","last_active":"2024-09-17T01:36:13.023288+0000","last_peered":"2024-09-17T01:36:13.023288+0000","last_clean":"2024-09-17T01:36:13.023288+0000","last_became_active":"2024-09-17T01:36:11.310156+0000","last_became_peered":"2024-09-17T01:36:11.310156+0000","last_unstale":"2024-09-17T01:36:13.023288+0000","last_undegraded":"2024-09-17T01:36:13.023288+0000","last_fullsized":"2024-09-17T01:36:13.023288+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:58.276824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925181+0000","last_change":"2024-09-17T01:36:11.306107+0000","last_active":"2024-09-17T01:36:12.925181+0000","last_peered":"2024-09-17T01:36:12.925181+0000","last_clean":"2024-09-17T01:36:12.925181+0000","last_became_active":"2024-09-17T01:36:11.305764+0000","last_became_peered":"2024-09-17T01:36:11.305764+0000","last_unstale":"2024-09-17T01:36:12.925181+0000","last_undegraded":"2024-09-17T01:36:12.925181+0000","last_fullsized":"2024-09-17T01:36:12.925181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:09.482083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305187+0000","last_change":"2024-09-17T01:36:11.297563+0000","last_active":"2024-09-17T01:36:12.305187+0000","last_peered":"2024-09-17T01:36:12.305187+0000","last_clean":"2024-09-17T01:36:12.305187+0000","last_became_active":"2024-09-17T01:36:11.297236+0000","last_became_peered":"2024-09-17T01:36:11.297236+0000","last_unstale":"2024-09-17T01:36:12.305187+0000","last_undegraded":"2024-09-17T01:36:12.305187+0000","last_fullsized":"2024-09-17T01:36:12.305187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:28.959565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925285+0000","last_change":"2024-09-17T01:36:10.292457+0000","last_active":"2024-09-17T01:36:12.925285+0000","last_peered":"2024-09-17T01:36:12.925285+0000","last_clean":"2024-09-17T01:36:12.925285+0000","last_became_active":"2024-09-17T01:36:10.292073+0000","last_became_peered":"2024-09-17T01:36:10.292073+0000","last_unstale":"2024-09-17T01:36:12.925285+0000","last_undegraded":"2024-09-17T01:36:12.925285+0000","last_fullsized":"2024-09-17T01:36:12.925285+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:47.680334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305127+0000","last_change":"2024-09-17T01:36:11.314223+0000","last_active":"2024-09-17T01:36:12.305127+0000","last_peered":"2024-09-17T01:36:12.305127+0000","last_clean":"2024-09-17T01:36:12.305127+0000","last_became_active":"2024-09-17T01:36:11.313462+0000","last_became_peered":"2024-09-17T01:36:11.313462+0000","last_unstale":"2024-09-17T01:36:12.305127+0000","last_undegraded":"2024-09-17T01:36:12.305127+0000","last_fullsized":"2024-09-17T01:36:12.305127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:48.686497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023531+0000","last_change":"2024-09-17T01:36:10.295597+0000","last_active":"2024-09-17T01:36:13.023531+0000","last_peered":"2024-09-17T01:36:13.023531+0000","last_clean":"2024-09-17T01:36:13.023531+0000","last_became_active":"2024-09-17T01:36:10.295269+0000","last_became_peered":"2024-09-17T01:36:10.295269+0000","last_unstale":"2024-09-17T01:36:13.023531+0000","last_undegraded":"2024-09-17T01:36:13.023531+0000","last_fullsized":"2024-09-17T01:36:13.023531+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:07.370466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303912+0000","last_change":"2024-09-17T01:36:11.320059+0000","last_active":"2024-09-17T01:36:12.303912+0000","last_peered":"2024-09-17T01:36:12.303912+0000","last_clean":"2024-09-17T01:36:12.303912+0000","last_became_active":"2024-09-17T01:36:11.319721+0000","last_became_peered":"2024-09-17T01:36:11.319721+0000","last_unstale":"2024-09-17T01:36:12.303912+0000","last_undegraded":"2024-09-17T01:36:12.303912+0000","last_fullsized":"2024-09-17T01:36:12.303912+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:59.228610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303898+0000","last_change":"2024-09-17T01:36:10.286360+0000","last_active":"2024-09-17T01:36:12.303898+0000","last_peered":"2024-09-17T01:36:12.303898+0000","last_clean":"2024-09-17T01:36:12.303898+0000","last_became_active":"2024-09-17T01:36:10.285959+0000","last_became_peered":"2024-09-17T01:36:10.285959+0000","last_unstale":"2024-09-17T01:36:12.303898+0000","last_undegraded":"2024-09-17T01:36:12.303898+0000","last_fullsized":"2024-09-17T01:36:12.303898+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:11.061550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305368+0000","last_change":"2024-09-17T01:36:11.309231+0000","last_active":"2024-09-17T01:36:12.305368+0000","last_peered":"2024-09-17T01:36:12.305368+0000","last_clean":"2024-09-17T01:36:12.305368+0000","last_became_active":"2024-09-17T01:36:11.304902+0000","last_became_peered":"2024-09-17T01:36:11.304902+0000","last_unstale":"2024-09-17T01:36:12.305368+0000","last_undegraded":"2024-09-17T01:36:12.305368+0000","last_fullsized":"2024-09-17T01:36:12.305368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:56.613111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076709+0000","last_change":"2024-09-17T01:36:10.300133+0000","last_active":"2024-09-17T01:36:13.076709+0000","last_peered":"2024-09-17T01:36:13.076709+0000","last_clean":"2024-09-17T01:36:13.076709+0000","last_became_active":"2024-09-17T01:36:10.299955+0000","last_became_peered":"2024-09-17T01:36:10.299955+0000","last_unstale":"2024-09-17T01:36:13.076709+0000","last_undegraded":"2024-09-17T01:36:13.076709+0000","last_fullsized":"2024-09-17T01:36:13.076709+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:48.285259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303509+0000","last_change":"2024-09-17T01:36:11.323505+0000","last_active":"2024-09-17T01:36:12.303509+0000","last_peered":"2024-09-17T01:36:12.303509+0000","last_clean":"2024-09-17T01:36:12.303509+0000","last_became_active":"2024-09-17T01:36:11.323174+0000","last_became_peered":"2024-09-17T01:36:11.323174+0000","last_unstale":"2024-09-17T01:36:12.303509+0000","last_undegraded":"2024-09-17T01:36:12.303509+0000","last_fullsized":"2024-09-17T01:36:12.303509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:48.884777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T01:36:10.298847+0000","last_change":"2024-09-17T01:36:10.291224+0000","last_active":"2024-09-17T01:36:10.298847+0000","last_peered":"2024-09-17T01:36:10.298847+0000","last_clean":"2024-09-17T01:36:10.298847+0000","last_became_active":"2024-09-17T01:36:10.290471+0000","last_became_peered":"2024-09-17T01:36:10.290471+0000","last_unstale":"2024-09-17T01:36:10.298847+0000","last_undegraded":"2024-09-17T01:36:10.298847+0000","last_fullsized":"2024-09-17T01:36:10.298847+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:05.843746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925183+0000","last_change":"2024-09-17T01:36:11.310201+0000","last_active":"2024-09-17T01:36:12.925183+0000","last_peered":"2024-09-17T01:36:12.925183+0000","last_clean":"2024-09-17T01:36:12.925183+0000","last_became_active":"2024-09-17T01:36:11.310003+0000","last_became_peered":"2024-09-17T01:36:11.310003+0000","last_unstale":"2024-09-17T01:36:12.925183+0000","last_undegraded":"2024-09-17T01:36:12.925183+0000","last_fullsized":"2024-09-17T01:36:12.925183+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:45.948182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305179+0000","last_change":"2024-09-17T01:36:10.293072+0000","last_active":"2024-09-17T01:36:12.305179+0000","last_peered":"2024-09-17T01:36:12.305179+0000","last_clean":"2024-09-17T01:36:12.305179+0000","last_became_active":"2024-09-17T01:36:10.290949+0000","last_became_peered":"2024-09-17T01:36:10.290949+0000","last_unstale":"2024-09-17T01:36:12.305179+0000","last_undegraded":"2024-09-17T01:36:12.305179+0000","last_fullsized":"2024-09-17T01:36:12.305179+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:40.448306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.277116+0000","last_change":"2024-09-17T01:36:10.277116+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.277116+0000","last_undegraded":"2024-09-17T01:36:10.277116+0000","last_fullsized":"2024-09-17T01:36:10.277116+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.865999+0000","last_change":"2024-09-17T01:36:10.296734+0000","last_active":"2024-09-17T01:36:12.865999+0000","last_peered":"2024-09-17T01:36:12.865999+0000","last_clean":"2024-09-17T01:36:12.865999+0000","last_became_active":"2024-09-17T01:36:10.296463+0000","last_became_peered":"2024-09-17T01:36:10.296463+0000","last_unstale":"2024-09-17T01:36:12.865999+0000","last_undegraded":"2024-09-17T01:36:12.865999+0000","last_fullsized":"2024-09-17T01:36:12.865999+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:19.770144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303645+0000","last_change":"2024-09-17T01:36:11.306806+0000","last_active":"2024-09-17T01:36:12.303645+0000","last_peered":"2024-09-17T01:36:12.303645+0000","last_clean":"2024-09-17T01:36:12.303645+0000","last_became_active":"2024-09-17T01:36:11.306392+0000","last_became_peered":"2024-09-17T01:36:11.306392+0000","last_unstale":"2024-09-17T01:36:12.303645+0000","last_undegraded":"2024-09-17T01:36:12.303645+0000","last_fullsized":"2024-09-17T01:36:12.303645+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:58.962482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992402+0000","last_change":"2024-09-17T01:36:10.289402+0000","last_active":"2024-09-17T01:36:12.992402+0000","last_peered":"2024-09-17T01:36:12.992402+0000","last_clean":"2024-09-17T01:36:12.992402+0000","last_became_active":"2024-09-17T01:36:10.289028+0000","last_became_peered":"2024-09-17T01:36:10.289028+0000","last_unstale":"2024-09-17T01:36:12.992402+0000","last_undegraded":"2024-09-17T01:36:12.992402+0000","last_fullsized":"2024-09-17T01:36:12.992402+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:54.956235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.993014+0000","last_change":"2024-09-17T01:36:11.302630+0000","last_active":"2024-09-17T01:36:12.993014+0000","last_peered":"2024-09-17T01:36:12.993014+0000","last_clean":"2024-09-17T01:36:12.993014+0000","last_became_active":"2024-09-17T01:36:11.302324+0000","last_became_peered":"2024-09-17T01:36:11.302324+0000","last_unstale":"2024-09-17T01:36:12.993014+0000","last_undegraded":"2024-09-17T01:36:12.993014+0000","last_fullsized":"2024-09-17T01:36:12.993014+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:35.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866234+0000","last_change":"2024-09-17T01:36:10.293964+0000","last_active":"2024-09-17T01:36:12.866234+0000","last_peered":"2024-09-17T01:36:12.866234+0000","last_clean":"2024-09-17T01:36:12.866234+0000","last_became_active":"2024-09-17T01:36:10.293658+0000","last_became_peered":"2024-09-17T01:36:10.293658+0000","last_unstale":"2024-09-17T01:36:12.866234+0000","last_undegraded":"2024-09-17T01:36:12.866234+0000","last_fullsized":"2024-09-17T01:36:12.866234+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:37.278082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.285012+0000","last_change":"2024-09-17T01:36:10.285012+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.285012+0000","last_undegraded":"2024-09-17T01:36:10.285012+0000","last_fullsized":"2024-09-17T01:36:10.285012+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304174+0000","last_change":"2024-09-17T01:36:10.294720+0000","last_active":"2024-09-17T01:36:12.304174+0000","last_peered":"2024-09-17T01:36:12.304174+0000","last_clean":"2024-09-17T01:36:12.304174+0000","last_became_active":"2024-09-17T01:36:10.294012+0000","last_became_peered":"2024-09-17T01:36:10.294012+0000","last_unstale":"2024-09-17T01:36:12.304174+0000","last_undegraded":"2024-09-17T01:36:12.304174+0000","last_fullsized":"2024-09-17T01:36:12.304174+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:29.017109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304165+0000","last_change":"2024-09-17T01:36:11.319252+0000","last_active":"2024-09-17T01:36:12.304165+0000","last_peered":"2024-09-17T01:36:12.304165+0000","last_clean":"2024-09-17T01:36:12.304165+0000","last_became_active":"2024-09-17T01:36:11.316127+0000","last_became_peered":"2024-09-17T01:36:11.316127+0000","last_unstale":"2024-09-17T01:36:12.304165+0000","last_undegraded":"2024-09-17T01:36:12.304165+0000","last_fullsized":"2024-09-17T01:36:12.304165+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:57:36.447976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.077184+0000","last_change":"2024-09-17T01:36:10.298237+0000","last_active":"2024-09-17T01:36:13.077184+0000","last_peered":"2024-09-17T01:36:13.077184+0000","last_clean":"2024-09-17T01:36:13.077184+0000","last_became_active":"2024-09-17T01:36:10.297914+0000","last_became_peered":"2024-09-17T01:36:10.297914+0000","last_unstale":"2024-09-17T01:36:13.077184+0000","last_undegraded":"2024-09-17T01:36:13.077184+0000","last_fullsized":"2024-09-17T01:36:13.077184+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:58.586762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076884+0000","last_change":"2024-09-17T01:36:11.310102+0000","last_active":"2024-09-17T01:36:13.076884+0000","last_peered":"2024-09-17T01:36:13.076884+0000","last_clean":"2024-09-17T01:36:13.076884+0000","last_became_active":"2024-09-17T01:36:11.309689+0000","last_became_peered":"2024-09-17T01:36:11.309689+0000","last_unstale":"2024-09-17T01:36:13.076884+0000","last_undegraded":"2024-09-17T01:36:13.076884+0000","last_fullsized":"2024-09-17T01:36:13.076884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:00.158245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":21,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992768+0000","last_change":"2024-09-17T01:36:10.292473+0000","last_active":"2024-09-17T01:36:12.992768+0000","last_peered":"2024-09-17T01:36:12.992768+0000","last_clean":"2024-09-17T01:36:12.992768+0000","last_became_active":"2024-09-17T01:36:10.292161+0000","last_became_peered":"2024-09-17T01:36:10.292161+0000","last_unstale":"2024-09-17T01:36:12.992768+0000","last_undegraded":"2024-09-17T01:36:12.992768+0000","last_fullsized":"2024-09-17T01:36:12.992768+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:03.337816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866232+0000","last_change":"2024-09-17T01:36:11.308108+0000","last_active":"2024-09-17T01:36:12.866232+0000","last_peered":"2024-09-17T01:36:12.866232+0000","last_clean":"2024-09-17T01:36:12.866232+0000","last_became_active":"2024-09-17T01:36:11.307801+0000","last_became_peered":"2024-09-17T01:36:11.307801+0000","last_unstale":"2024-09-17T01:36:12.866232+0000","last_undegraded":"2024-09-17T01:36:12.866232+0000","last_fullsized":"2024-09-17T01:36:12.866232+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:42.954974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303899+0000","last_change":"2024-09-17T01:36:10.293577+0000","last_active":"2024-09-17T01:36:12.303899+0000","last_peered":"2024-09-17T01:36:12.303899+0000","last_clean":"2024-09-17T01:36:12.303899+0000","last_became_active":"2024-09-17T01:36:10.291934+0000","last_became_peered":"2024-09-17T01:36:10.291934+0000","last_unstale":"2024-09-17T01:36:12.303899+0000","last_undegraded":"2024-09-17T01:36:12.303899+0000","last_fullsized":"2024-09-17T01:36:12.303899+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:15.757296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.282960+0000","last_change":"2024-09-17T01:36:10.282960+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.282960+0000","last_undegraded":"2024-09-17T01:36:10.282960+0000","last_fullsized":"2024-09-17T01:36:10.282960+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076416+0000","last_change":"2024-09-17T01:36:10.291611+0000","last_active":"2024-09-17T01:36:13.076416+0000","last_peered":"2024-09-17T01:36:13.076416+0000","last_clean":"2024-09-17T01:36:13.076416+0000","last_became_active":"2024-09-17T01:36:10.291234+0000","last_became_peered":"2024-09-17T01:36:10.291234+0000","last_unstale":"2024-09-17T01:36:13.076416+0000","last_undegraded":"2024-09-17T01:36:13.076416+0000","last_fullsized":"2024-09-17T01:36:13.076416+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:22.528484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866341+0000","last_change":"2024-09-17T01:36:11.313891+0000","last_active":"2024-09-17T01:36:12.866341+0000","last_peered":"2024-09-17T01:36:12.866341+0000","last_clean":"2024-09-17T01:36:12.866341+0000","last_became_active":"2024-09-17T01:36:11.313582+0000","last_became_peered":"2024-09-17T01:36:11.313582+0000","last_unstale":"2024-09-17T01:36:12.866341+0000","last_undegraded":"2024-09-17T01:36:12.866341+0000","last_fullsized":"2024-09-17T01:36:12.866341+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:22.521895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076693+0000","last_change":"2024-09-17T01:36:10.286012+0000","last_active":"2024-09-17T01:36:13.076693+0000","last_peered":"2024-09-17T01:36:13.076693+0000","last_clean":"2024-09-17T01:36:13.076693+0000","last_became_active":"2024-09-17T01:36:10.284940+0000","last_became_peered":"2024-09-17T01:36:10.284940+0000","last_unstale":"2024-09-17T01:36:13.076693+0000","last_undegraded":"2024-09-17T01:36:13.076693+0000","last_fullsized":"2024-09-17T01:36:13.076693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:00.539807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076838+0000","last_change":"2024-09-17T01:36:11.309989+0000","last_active":"2024-09-17T01:36:13.076838+0000","last_peered":"2024-09-17T01:36:13.076838+0000","last_clean":"2024-09-17T01:36:13.076838+0000","last_became_active":"2024-09-17T01:36:11.309641+0000","last_became_peered":"2024-09-17T01:36:11.309641+0000","last_unstale":"2024-09-17T01:36:13.076838+0000","last_undegraded":"2024-09-17T01:36:13.076838+0000","last_fullsized":"2024-09-17T01:36:13.076838+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:40.530982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":23,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076341+0000","last_change":"2024-09-17T01:36:10.295240+0000","last_active":"2024-09-17T01:36:13.076341+0000","last_peered":"2024-09-17T01:36:13.076341+0000","last_clean":"2024-09-17T01:36:13.076341+0000","last_became_active":"2024-09-17T01:36:10.294945+0000","last_became_peered":"2024-09-17T01:36:10.294945+0000","last_unstale":"2024-09-17T01:36:13.076341+0000","last_undegraded":"2024-09-17T01:36:13.076341+0000","last_fullsized":"2024-09-17T01:36:13.076341+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:55.304271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.278156+0000","last_change":"2024-09-17T01:36:10.278156+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.278156+0000","last_undegraded":"2024-09-17T01:36:10.278156+0000","last_fullsized":"2024-09-17T01:36:10.278156+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023621+0000","last_change":"2024-09-17T01:36:10.298316+0000","last_active":"2024-09-17T01:36:13.023621+0000","last_peered":"2024-09-17T01:36:13.023621+0000","last_clean":"2024-09-17T01:36:13.023621+0000","last_became_active":"2024-09-17T01:36:10.297999+0000","last_became_peered":"2024-09-17T01:36:10.297999+0000","last_unstale":"2024-09-17T01:36:13.023621+0000","last_undegraded":"2024-09-17T01:36:13.023621+0000","last_fullsized":"2024-09-17T01:36:13.023621+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:38:13.536708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.284537+0000","last_change":"2024-09-17T01:36:10.284537+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.284537+0000","last_undegraded":"2024-09-17T01:36:10.284537+0000","last_fullsized":"2024-09-17T01:36:10.284537+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304328+0000","last_change":"2024-09-17T01:36:10.294353+0000","last_active":"2024-09-17T01:36:12.304328+0000","last_peered":"2024-09-17T01:36:12.304328+0000","last_clean":"2024-09-17T01:36:12.304328+0000","last_became_active":"2024-09-17T01:36:10.293440+0000","last_became_peered":"2024-09-17T01:36:10.293440+0000","last_unstale":"2024-09-17T01:36:12.304328+0000","last_undegraded":"2024-09-17T01:36:12.304328+0000","last_fullsized":"2024-09-17T01:36:12.304328+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:33.626765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023594+0000","last_change":"2024-09-17T01:36:11.320250+0000","last_active":"2024-09-17T01:36:13.023594+0000","last_peered":"2024-09-17T01:36:13.023594+0000","last_clean":"2024-09-17T01:36:13.023594+0000","last_became_active":"2024-09-17T01:36:11.319913+0000","last_became_peered":"2024-09-17T01:36:11.319913+0000","last_unstale":"2024-09-17T01:36:13.023594+0000","last_undegraded":"2024-09-17T01:36:13.023594+0000","last_fullsized":"2024-09-17T01:36:13.023594+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:03.629335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T01:36:10.299567+0000","last_change":"2024-09-17T01:36:10.294281+0000","last_active":"2024-09-17T01:36:10.299567+0000","last_peered":"2024-09-17T01:36:10.299567+0000","last_clean":"2024-09-17T01:36:10.299567+0000","last_became_active":"2024-09-17T01:36:10.293955+0000","last_became_peered":"2024-09-17T01:36:10.293955+0000","last_unstale":"2024-09-17T01:36:10.299567+0000","last_undegraded":"2024-09-17T01:36:10.299567+0000","last_fullsized":"2024-09-17T01:36:10.299567+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:38.320555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.077112+0000","last_change":"2024-09-17T01:36:11.320342+0000","last_active":"2024-09-17T01:36:13.077112+0000","last_peered":"2024-09-17T01:36:13.077112+0000","last_clean":"2024-09-17T01:36:13.077112+0000","last_became_active":"2024-09-17T01:36:11.320023+0000","last_became_peered":"2024-09-17T01:36:11.320023+0000","last_unstale":"2024-09-17T01:36:13.077112+0000","last_undegraded":"2024-09-17T01:36:13.077112+0000","last_fullsized":"2024-09-17T01:36:13.077112+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:26.695707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304315+0000","last_change":"2024-09-17T01:36:10.289087+0000","last_active":"2024-09-17T01:36:12.304315+0000","last_peered":"2024-09-17T01:36:12.304315+0000","last_clean":"2024-09-17T01:36:12.304315+0000","last_became_active":"2024-09-17T01:36:10.288721+0000","last_became_peered":"2024-09-17T01:36:10.288721+0000","last_unstale":"2024-09-17T01:36:12.304315+0000","last_undegraded":"2024-09-17T01:36:12.304315+0000","last_fullsized":"2024-09-17T01:36:12.304315+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:24:11.811046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866397+0000","last_change":"2024-09-17T01:36:11.319574+0000","last_active":"2024-09-17T01:36:12.866397+0000","last_peered":"2024-09-17T01:36:12.866397+0000","last_clean":"2024-09-17T01:36:12.866397+0000","last_became_active":"2024-09-17T01:36:11.317100+0000","last_became_peered":"2024-09-17T01:36:11.317100+0000","last_unstale":"2024-09-17T01:36:12.866397+0000","last_undegraded":"2024-09-17T01:36:12.866397+0000","last_fullsized":"2024-09-17T01:36:12.866397+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:50.155552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.924945+0000","last_change":"2024-09-17T01:36:10.295963+0000","last_active":"2024-09-17T01:36:12.924945+0000","last_peered":"2024-09-17T01:36:12.924945+0000","last_clean":"2024-09-17T01:36:12.924945+0000","last_became_active":"2024-09-17T01:36:10.294487+0000","last_became_peered":"2024-09-17T01:36:10.294487+0000","last_unstale":"2024-09-17T01:36:12.924945+0000","last_undegraded":"2024-09-17T01:36:12.924945+0000","last_fullsized":"2024-09-17T01:36:12.924945+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:18:44.054224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303371+0000","last_change":"2024-09-17T01:36:11.314041+0000","last_active":"2024-09-17T01:36:12.303371+0000","last_peered":"2024-09-17T01:36:12.303371+0000","last_clean":"2024-09-17T01:36:12.303371+0000","last_became_active":"2024-09-17T01:36:11.313573+0000","last_became_peered":"2024-09-17T01:36:11.313573+0000","last_unstale":"2024-09-17T01:36:12.303371+0000","last_undegraded":"2024-09-17T01:36:12.303371+0000","last_fullsized":"2024-09-17T01:36:12.303371+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:30.847327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303084+0000","last_change":"2024-09-17T01:36:10.293477+0000","last_active":"2024-09-17T01:36:12.303084+0000","last_peered":"2024-09-17T01:36:12.303084+0000","last_clean":"2024-09-17T01:36:12.303084+0000","last_became_active":"2024-09-17T01:36:10.293119+0000","last_became_peered":"2024-09-17T01:36:10.293119+0000","last_unstale":"2024-09-17T01:36:12.303084+0000","last_undegraded":"2024-09-17T01:36:12.303084+0000","last_fullsized":"2024-09-17T01:36:12.303084+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:02.386471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303044+0000","last_change":"2024-09-17T01:36:11.315150+0000","last_active":"2024-09-17T01:36:12.303044+0000","last_peered":"2024-09-17T01:36:12.303044+0000","last_clean":"2024-09-17T01:36:12.303044+0000","last_became_active":"2024-09-17T01:36:11.314846+0000","last_became_peered":"2024-09-17T01:36:11.314846+0000","last_unstale":"2024-09-17T01:36:12.303044+0000","last_undegraded":"2024-09-17T01:36:12.303044+0000","last_fullsized":"2024-09-17T01:36:12.303044+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:08.297937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866344+0000","last_change":"2024-09-17T01:36:10.280718+0000","last_active":"2024-09-17T01:36:12.866344+0000","last_peered":"2024-09-17T01:36:12.866344+0000","last_clean":"2024-09-17T01:36:12.866344+0000","last_became_active":"2024-09-17T01:36:10.280401+0000","last_became_peered":"2024-09-17T01:36:10.280401+0000","last_unstale":"2024-09-17T01:36:12.866344+0000","last_undegraded":"2024-09-17T01:36:12.866344+0000","last_fullsized":"2024-09-17T01:36:12.866344+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:46.578001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.277627+0000","last_change":"2024-09-17T01:36:10.277627+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.277627+0000","last_undegraded":"2024-09-17T01:36:10.277627+0000","last_fullsized":"2024-09-17T01:36:10.277627+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023788+0000","last_change":"2024-09-17T01:36:10.298876+0000","last_active":"2024-09-17T01:36:13.023788+0000","last_peered":"2024-09-17T01:36:13.023788+0000","last_clean":"2024-09-17T01:36:13.023788+0000","last_became_active":"2024-09-17T01:36:10.298564+0000","last_became_peered":"2024-09-17T01:36:10.298564+0000","last_unstale":"2024-09-17T01:36:13.023788+0000","last_undegraded":"2024-09-17T01:36:13.023788+0000","last_fullsized":"2024-09-17T01:36:13.023788+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:48.499379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.277174+0000","last_change":"2024-09-17T01:36:10.277174+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.277174+0000","last_undegraded":"2024-09-17T01:36:10.277174+0000","last_fullsized":"2024-09-17T01:36:10.277174+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"62'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305072+0000","last_change":"2024-09-17T01:36:10.290784+0000","last_active":"2024-09-17T01:36:12.305072+0000","last_peered":"2024-09-17T01:36:12.305072+0000","last_clean":"2024-09-17T01:36:12.305072+0000","last_became_active":"2024-09-17T01:36:10.288289+0000","last_became_peered":"2024-09-17T01:36:10.288289+0000","last_unstale":"2024-09-17T01:36:12.305072+0000","last_undegraded":"2024-09-17T01:36:12.305072+0000","last_fullsized":"2024-09-17T01:36:12.305072+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:25.435670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023456+0000","last_change":"2024-09-17T01:36:11.316442+0000","last_active":"2024-09-17T01:36:13.023456+0000","last_peered":"2024-09-17T01:36:13.023456+0000","last_clean":"2024-09-17T01:36:13.023456+0000","last_became_active":"2024-09-17T01:36:11.315668+0000","last_became_peered":"2024-09-17T01:36:11.315668+0000","last_unstale":"2024-09-17T01:36:13.023456+0000","last_undegraded":"2024-09-17T01:36:13.023456+0000","last_fullsized":"2024-09-17T01:36:13.023456+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:15:50.717398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866158+0000","last_change":"2024-09-17T01:36:10.289540+0000","last_active":"2024-09-17T01:36:12.866158+0000","last_peered":"2024-09-17T01:36:12.866158+0000","last_clean":"2024-09-17T01:36:12.866158+0000","last_became_active":"2024-09-17T01:36:10.289239+0000","last_became_peered":"2024-09-17T01:36:10.289239+0000","last_unstale":"2024-09-17T01:36:12.866158+0000","last_undegraded":"2024-09-17T01:36:12.866158+0000","last_fullsized":"2024-09-17T01:36:12.866158+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:41.502277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303227+0000","last_change":"2024-09-17T01:36:11.309355+0000","last_active":"2024-09-17T01:36:12.303227+0000","last_peered":"2024-09-17T01:36:12.303227+0000","last_clean":"2024-09-17T01:36:12.303227+0000","last_became_active":"2024-09-17T01:36:11.308670+0000","last_became_peered":"2024-09-17T01:36:11.308670+0000","last_unstale":"2024-09-17T01:36:12.303227+0000","last_undegraded":"2024-09-17T01:36:12.303227+0000","last_fullsized":"2024-09-17T01:36:12.303227+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:52:53.600454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T01:36:10.299909+0000","last_change":"2024-09-17T01:36:10.297976+0000","last_active":"2024-09-17T01:36:10.299909+0000","last_peered":"2024-09-17T01:36:10.299909+0000","last_clean":"2024-09-17T01:36:10.299909+0000","last_became_active":"2024-09-17T01:36:10.297673+0000","last_became_peered":"2024-09-17T01:36:10.297673+0000","last_unstale":"2024-09-17T01:36:10.299909+0000","last_undegraded":"2024-09-17T01:36:10.299909+0000","last_fullsized":"2024-09-17T01:36:10.299909+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:13:21.070126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304632+0000","last_change":"2024-09-17T01:36:11.300517+0000","last_active":"2024-09-17T01:36:12.304632+0000","last_peered":"2024-09-17T01:36:12.304632+0000","last_clean":"2024-09-17T01:36:12.304632+0000","last_became_active":"2024-09-17T01:36:11.300185+0000","last_became_peered":"2024-09-17T01:36:11.300185+0000","last_unstale":"2024-09-17T01:36:12.304632+0000","last_undegraded":"2024-09-17T01:36:12.304632+0000","last_fullsized":"2024-09-17T01:36:12.304632+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:56.615253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023327+0000","last_change":"2024-09-17T01:36:10.298497+0000","last_active":"2024-09-17T01:36:13.023327+0000","last_peered":"2024-09-17T01:36:13.023327+0000","last_clean":"2024-09-17T01:36:13.023327+0000","last_became_active":"2024-09-17T01:36:10.298121+0000","last_became_peered":"2024-09-17T01:36:10.298121+0000","last_unstale":"2024-09-17T01:36:13.023327+0000","last_undegraded":"2024-09-17T01:36:13.023327+0000","last_fullsized":"2024-09-17T01:36:13.023327+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:38.190524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992863+0000","last_change":"2024-09-17T01:36:11.321630+0000","last_active":"2024-09-17T01:36:12.992863+0000","last_peered":"2024-09-17T01:36:12.992863+0000","last_clean":"2024-09-17T01:36:12.992863+0000","last_became_active":"2024-09-17T01:36:11.321328+0000","last_became_peered":"2024-09-17T01:36:11.321328+0000","last_unstale":"2024-09-17T01:36:12.992863+0000","last_undegraded":"2024-09-17T01:36:12.992863+0000","last_fullsized":"2024-09-17T01:36:12.992863+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:39.391906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T01:36:10.300301+0000","last_change":"2024-09-17T01:36:10.296407+0000","last_active":"2024-09-17T01:36:10.300301+0000","last_peered":"2024-09-17T01:36:10.300301+0000","last_clean":"2024-09-17T01:36:10.300301+0000","last_became_active":"2024-09-17T01:36:10.296089+0000","last_became_peered":"2024-09-17T01:36:10.296089+0000","last_unstale":"2024-09-17T01:36:10.300301+0000","last_undegraded":"2024-09-17T01:36:10.300301+0000","last_fullsized":"2024-09-17T01:36:10.300301+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:04.809194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.302818+0000","last_change":"2024-09-17T01:36:11.310738+0000","last_active":"2024-09-17T01:36:12.302818+0000","last_peered":"2024-09-17T01:36:12.302818+0000","last_clean":"2024-09-17T01:36:12.302818+0000","last_became_active":"2024-09-17T01:36:11.310431+0000","last_became_peered":"2024-09-17T01:36:11.310431+0000","last_unstale":"2024-09-17T01:36:12.302818+0000","last_undegraded":"2024-09-17T01:36:12.302818+0000","last_fullsized":"2024-09-17T01:36:12.302818+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:54.749692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303734+0000","last_change":"2024-09-17T01:36:10.290312+0000","last_active":"2024-09-17T01:36:12.303734+0000","last_peered":"2024-09-17T01:36:12.303734+0000","last_clean":"2024-09-17T01:36:12.303734+0000","last_became_active":"2024-09-17T01:36:10.287956+0000","last_became_peered":"2024-09-17T01:36:10.287956+0000","last_unstale":"2024-09-17T01:36:12.303734+0000","last_undegraded":"2024-09-17T01:36:12.303734+0000","last_fullsized":"2024-09-17T01:36:12.303734+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:02.623172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023505+0000","last_change":"2024-09-17T01:36:11.319336+0000","last_active":"2024-09-17T01:36:13.023505+0000","last_peered":"2024-09-17T01:36:13.023505+0000","last_clean":"2024-09-17T01:36:13.023505+0000","last_became_active":"2024-09-17T01:36:11.319012+0000","last_became_peered":"2024-09-17T01:36:11.319012+0000","last_unstale":"2024-09-17T01:36:13.023505+0000","last_undegraded":"2024-09-17T01:36:13.023505+0000","last_fullsized":"2024-09-17T01:36:13.023505+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:23.186639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303218+0000","last_change":"2024-09-17T01:36:10.289718+0000","last_active":"2024-09-17T01:36:12.303218+0000","last_peered":"2024-09-17T01:36:12.303218+0000","last_clean":"2024-09-17T01:36:12.303218+0000","last_became_active":"2024-09-17T01:36:10.289409+0000","last_became_peered":"2024-09-17T01:36:10.289409+0000","last_unstale":"2024-09-17T01:36:12.303218+0000","last_undegraded":"2024-09-17T01:36:12.303218+0000","last_fullsized":"2024-09-17T01:36:12.303218+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:57.059026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304882+0000","last_change":"2024-09-17T01:36:11.309282+0000","last_active":"2024-09-17T01:36:12.304882+0000","last_peered":"2024-09-17T01:36:12.304882+0000","last_clean":"2024-09-17T01:36:12.304882+0000","last_became_active":"2024-09-17T01:36:11.308775+0000","last_became_peered":"2024-09-17T01:36:11.308775+0000","last_unstale":"2024-09-17T01:36:12.304882+0000","last_undegraded":"2024-09-17T01:36:12.304882+0000","last_fullsized":"2024-09-17T01:36:12.304882+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:20.099586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992452+0000","last_change":"2024-09-17T01:36:10.294227+0000","last_active":"2024-09-17T01:36:12.992452+0000","last_peered":"2024-09-17T01:36:12.992452+0000","last_clean":"2024-09-17T01:36:12.992452+0000","last_became_active":"2024-09-17T01:36:10.291395+0000","last_became_peered":"2024-09-17T01:36:10.291395+0000","last_unstale":"2024-09-17T01:36:12.992452+0000","last_undegraded":"2024-09-17T01:36:12.992452+0000","last_fullsized":"2024-09-17T01:36:12.992452+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:05.348862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":187,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.865857+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:36:12.865857+0000","last_peered":"2024-09-17T01:36:12.865857+0000","last_clean":"2024-09-17T01:36:12.865857+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:36:12.865857+0000","last_undegraded":"2024-09-17T01:36:12.865857+0000","last_fullsized":"2024-09-17T01:36:12.865857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476791,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":700416,"data_stored":290181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509495,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36076,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335764,"statfs":{"total":96636764160,"available":96599822336,"internally_reserved":0,"allocated":745472,"data_stored":309623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40232,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331608,"statfs":{"total":96636764160,"available":96595566592,"internally_reserved":0,"allocated":741376,"data_stored":309553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509495,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40236,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331604,"statfs":{"total":96636764160,"available":96595562496,"internally_reserved":0,"allocated":745472,"data_stored":310147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509495,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":309621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509494,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40812,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331028,"statfs":{"total":96636764160,"available":96594972672,"internally_reserved":0,"allocated":1335296,"data_stored":900481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509496,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36080,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335760,"statfs":{"total":96636764160,"available":96599818240,"internally_reserved":0,"allocated":749568,"data_stored":311143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542200,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40812,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331028,"statfs":{"total":96636764160,"available":96594972672,"internally_reserved":0,"allocated":1335296,"data_stored":899933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:36:16.276 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:36:16.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.543+0000 7f12d9a00640 1 -- 172.21.15.42:0/593874959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12d415f190 msgr2=0x7f12d406fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:16.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.543+0000 7f12d9a00640 1 --2- 172.21.15.42:0/593874959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12d415f190 0x7f12d406fe40 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f12cc005fd0 tx=0x7f12cc02aa00 comp rx=0 tx=0).stop 2024-09-17T01:36:16.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.543+0000 7f12d9a00640 1 -- 172.21.15.42:0/593874959 shutdown_connections 2024-09-17T01:36:16.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.543+0000 7f12d9a00640 1 --2- 172.21.15.42:0/593874959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12d415f190 0x7f12d406fe40 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:16.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.543+0000 7f12d9a00640 1 --2- 172.21.15.42:0/593874959 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f12d406db40 0x7f12d415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:16.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.543+0000 7f12d9a00640 1 -- 172.21.15.42:0/593874959 >> 172.21.15.42:0/593874959 conn(0x7f12d40b2930 msgr2=0x7f12d406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:16.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.543+0000 7f12d9a00640 1 -- 172.21.15.42:0/593874959 shutdown_connections 2024-09-17T01:36:16.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.543+0000 7f12d9a00640 1 -- 172.21.15.42:0/593874959 wait complete. 2024-09-17T01:36:16.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.545+0000 7f12d9a00640 1 Processor -- start 2024-09-17T01:36:16.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.545+0000 7f12d9a00640 1 -- start start 2024-09-17T01:36:16.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.546+0000 7f12d9a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12d4072e00 0x7f12d4141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:16.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.547+0000 7f12d9a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12d415f190 0x7f12d414a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:16.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.547+0000 7f12d9a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f12d414bbf0 0x7f12d414abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:16.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.547+0000 7f12d9a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f12d4151520 con 0x7f12d4072e00 2024-09-17T01:36:16.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.547+0000 7f12d9a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f12d4070740 con 0x7f12d415f190 2024-09-17T01:36:16.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.547+0000 7f12d9a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f12d41516a0 con 0x7f12d414bbf0 2024-09-17T01:36:16.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.547+0000 7f12d2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12d4072e00 0x7f12d4141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:16.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.547+0000 7f12d2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12d4072e00 0x7f12d4141ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51970/0 (socket says 172.21.15.42:51970) 2024-09-17T01:36:16.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.547+0000 7f12d2a00640 1 -- 172.21.15.42:0/2636136045 learned_addr learned my addr 172.21.15.42:0/2636136045 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:16.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.547+0000 7f12cbe00640 1 --2- 172.21.15.42:0/2636136045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12d415f190 0x7f12d414a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:16.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.547+0000 7f12d3400640 1 --2- 172.21.15.42:0/2636136045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f12d414bbf0 0x7f12d414abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:16.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.547+0000 7f12d2a00640 1 -- 172.21.15.42:0/2636136045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f12d414bbf0 msgr2=0x7f12d414abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:16.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.547+0000 7f12d2a00640 1 --2- 172.21.15.42:0/2636136045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f12d414bbf0 0x7f12d414abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:16.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.547+0000 7f12d2a00640 1 -- 172.21.15.42:0/2636136045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12d415f190 msgr2=0x7f12d414a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:16.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.547+0000 7f12d2a00640 1 --2- 172.21.15.42:0/2636136045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12d415f190 0x7f12d414a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:16.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.547+0000 7f12d2a00640 1 -- 172.21.15.42:0/2636136045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d41534b0 con 0x7f12d4072e00 2024-09-17T01:36:16.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.548+0000 7f12d2a00640 1 --2- 172.21.15.42:0/2636136045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12d4072e00 0x7f12d4141ac0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f12c400b450 tx=0x7f12c400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:16.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.548+0000 7f12caa00640 1 -- 172.21.15.42:0/2636136045 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c4015020 con 0x7f12d4072e00 2024-09-17T01:36:16.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.548+0000 7f12caa00640 1 -- 172.21.15.42:0/2636136045 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12c4011980 con 0x7f12d4072e00 2024-09-17T01:36:16.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.548+0000 7f12d9a00640 1 -- 172.21.15.42:0/2636136045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12d41447f0 con 0x7f12d4072e00 2024-09-17T01:36:16.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.548+0000 7f12caa00640 1 -- 172.21.15.42:0/2636136045 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c4011dd0 con 0x7f12d4072e00 2024-09-17T01:36:16.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.548+0000 7f12d9a00640 1 -- 172.21.15.42:0/2636136045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12d4148870 con 0x7f12d4072e00 2024-09-17T01:36:16.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.549+0000 7f12d9a00640 1 -- 172.21.15.42:0/2636136045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12d415bc50 con 0x7f12d4072e00 2024-09-17T01:36:16.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.550+0000 7f12caa00640 1 -- 172.21.15.42:0/2636136045 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f12c4018020 con 0x7f12d4072e00 2024-09-17T01:36:16.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.551+0000 7f12caa00640 1 --2- 172.21.15.42:0/2636136045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f12b0078b90 0x7f12b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:16.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.552+0000 7f12caa00640 1 -- 172.21.15.42:0/2636136045 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f12c409aa20 con 0x7f12d4072e00 2024-09-17T01:36:16.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.552+0000 7f12cbe00640 1 --2- 172.21.15.42:0/2636136045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f12b0078b90 0x7f12b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:16.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.553+0000 7f12cbe00640 1 --2- 172.21.15.42:0/2636136045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f12b0078b90 0x7f12b007b0a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f12d40cfdd0 tx=0x7f12bc00a420 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:16.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.556+0000 7f12caa00640 1 -- 172.21.15.42:0/2636136045 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f12c401f030 con 0x7f12d4072e00 2024-09-17T01:36:16.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.751+0000 7f12d9a00640 1 -- 172.21.15.42:0/2636136045 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f12d4144ad0 con 0x7f12b0078b90 2024-09-17T01:36:16.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.756+0000 7f12caa00640 1 -- 172.21.15.42:0/2636136045 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251127 (secure 0 0 0) 0x7f12d4144ad0 con 0x7f12b0078b90 2024-09-17T01:36:16.757 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:16.758 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:36:16.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.761+0000 7f12d9a00640 1 -- 172.21.15.42:0/2636136045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f12b0078b90 msgr2=0x7f12b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:16.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.761+0000 7f12d9a00640 1 --2- 172.21.15.42:0/2636136045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f12b0078b90 0x7f12b007b0a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f12d40cfdd0 tx=0x7f12bc00a420 comp rx=0 tx=0).stop 2024-09-17T01:36:16.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.761+0000 7f12d9a00640 1 -- 172.21.15.42:0/2636136045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12d4072e00 msgr2=0x7f12d4141ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:16.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.761+0000 7f12d9a00640 1 --2- 172.21.15.42:0/2636136045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12d4072e00 0x7f12d4141ac0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f12c400b450 tx=0x7f12c400b910 comp rx=0 tx=0).stop 2024-09-17T01:36:16.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.761+0000 7f12d9a00640 1 -- 172.21.15.42:0/2636136045 shutdown_connections 2024-09-17T01:36:16.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.761+0000 7f12d9a00640 1 --2- 172.21.15.42:0/2636136045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f12b0078b90 0x7f12b007b0a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:16.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.761+0000 7f12d9a00640 1 --2- 172.21.15.42:0/2636136045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12d415f190 0x7f12d414a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:16.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.761+0000 7f12d9a00640 1 --2- 172.21.15.42:0/2636136045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f12d414bbf0 0x7f12d414abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:16.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.761+0000 7f12d9a00640 1 --2- 172.21.15.42:0/2636136045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12d4072e00 0x7f12d4141ac0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:16.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.761+0000 7f12d9a00640 1 -- 172.21.15.42:0/2636136045 >> 172.21.15.42:0/2636136045 conn(0x7f12d40b2930 msgr2=0x7f12d406f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:16.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.761+0000 7f12d9a00640 1 -- 172.21.15.42:0/2636136045 shutdown_connections 2024-09-17T01:36:16.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:16.761+0000 7f12d9a00640 1 -- 172.21.15.42:0/2636136045 wait complete. 2024-09-17T01:36:16.783 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-09-17T01:36:15.046401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289716,"kb_used_data":6928,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754685004,"statfs":{"total":773094113280,"available":772797444096,"internally_reserved":0,"allocated":7094272,"data_stored":3640682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":289394228},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.779745"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304704+0000","last_change":"2024-09-17T01:36:11.317189+0000","last_active":"2024-09-17T01:36:12.304704+0000","last_peered":"2024-09-17T01:36:12.304704+0000","last_clean":"2024-09-17T01:36:12.304704+0000","last_became_active":"2024-09-17T01:36:11.316776+0000","last_became_peered":"2024-09-17T01:36:11.316776+0000","last_unstale":"2024-09-17T01:36:12.304704+0000","last_undegraded":"2024-09-17T01:36:12.304704+0000","last_fullsized":"2024-09-17T01:36:12.304704+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:35.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023723+0000","last_change":"2024-09-17T01:36:11.325731+0000","last_active":"2024-09-17T01:36:13.023723+0000","last_peered":"2024-09-17T01:36:13.023723+0000","last_clean":"2024-09-17T01:36:13.023723+0000","last_became_active":"2024-09-17T01:36:11.325325+0000","last_became_peered":"2024-09-17T01:36:11.325325+0000","last_unstale":"2024-09-17T01:36:13.023723+0000","last_undegraded":"2024-09-17T01:36:13.023723+0000","last_fullsized":"2024-09-17T01:36:13.023723+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:12.067713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.286381+0000","last_change":"2024-09-17T01:36:10.286381+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.286381+0000","last_undegraded":"2024-09-17T01:36:10.286381+0000","last_fullsized":"2024-09-17T01:36:10.286381+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076816+0000","last_change":"2024-09-17T01:36:11.319236+0000","last_active":"2024-09-17T01:36:13.076816+0000","last_peered":"2024-09-17T01:36:13.076816+0000","last_clean":"2024-09-17T01:36:13.076816+0000","last_became_active":"2024-09-17T01:36:11.318786+0000","last_became_peered":"2024-09-17T01:36:11.318786+0000","last_unstale":"2024-09-17T01:36:13.076816+0000","last_undegraded":"2024-09-17T01:36:13.076816+0000","last_fullsized":"2024-09-17T01:36:13.076816+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:56:37.137202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304383+0000","last_change":"2024-09-17T01:36:11.295952+0000","last_active":"2024-09-17T01:36:12.304383+0000","last_peered":"2024-09-17T01:36:12.304383+0000","last_clean":"2024-09-17T01:36:12.304383+0000","last_became_active":"2024-09-17T01:36:11.295523+0000","last_became_peered":"2024-09-17T01:36:11.295523+0000","last_unstale":"2024-09-17T01:36:12.304383+0000","last_undegraded":"2024-09-17T01:36:12.304383+0000","last_fullsized":"2024-09-17T01:36:12.304383+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:08.202105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304321+0000","last_change":"2024-09-17T01:36:11.303156+0000","last_active":"2024-09-17T01:36:12.304321+0000","last_peered":"2024-09-17T01:36:12.304321+0000","last_clean":"2024-09-17T01:36:12.304321+0000","last_became_active":"2024-09-17T01:36:11.302790+0000","last_became_peered":"2024-09-17T01:36:11.302790+0000","last_unstale":"2024-09-17T01:36:12.304321+0000","last_undegraded":"2024-09-17T01:36:12.304321+0000","last_fullsized":"2024-09-17T01:36:12.304321+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:30.181703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076553+0000","last_change":"2024-09-17T01:36:11.293632+0000","last_active":"2024-09-17T01:36:13.076553+0000","last_peered":"2024-09-17T01:36:13.076553+0000","last_clean":"2024-09-17T01:36:13.076553+0000","last_became_active":"2024-09-17T01:36:11.293324+0000","last_became_peered":"2024-09-17T01:36:11.293324+0000","last_unstale":"2024-09-17T01:36:13.076553+0000","last_undegraded":"2024-09-17T01:36:13.076553+0000","last_fullsized":"2024-09-17T01:36:13.076553+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:51.396274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.302970+0000","last_change":"2024-09-17T01:36:11.317048+0000","last_active":"2024-09-17T01:36:12.302970+0000","last_peered":"2024-09-17T01:36:12.302970+0000","last_clean":"2024-09-17T01:36:12.302970+0000","last_became_active":"2024-09-17T01:36:11.315266+0000","last_became_peered":"2024-09-17T01:36:11.315266+0000","last_unstale":"2024-09-17T01:36:12.302970+0000","last_undegraded":"2024-09-17T01:36:12.302970+0000","last_fullsized":"2024-09-17T01:36:12.302970+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:17.967682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866481+0000","last_change":"2024-09-17T01:36:11.303422+0000","last_active":"2024-09-17T01:36:12.866481+0000","last_peered":"2024-09-17T01:36:12.866481+0000","last_clean":"2024-09-17T01:36:12.866481+0000","last_became_active":"2024-09-17T01:36:11.303095+0000","last_became_peered":"2024-09-17T01:36:11.303095+0000","last_unstale":"2024-09-17T01:36:12.866481+0000","last_undegraded":"2024-09-17T01:36:12.866481+0000","last_fullsized":"2024-09-17T01:36:12.866481+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:06.849909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304675+0000","last_change":"2024-09-17T01:36:11.311252+0000","last_active":"2024-09-17T01:36:12.304675+0000","last_peered":"2024-09-17T01:36:12.304675+0000","last_clean":"2024-09-17T01:36:12.304675+0000","last_became_active":"2024-09-17T01:36:11.304478+0000","last_became_peered":"2024-09-17T01:36:11.304478+0000","last_unstale":"2024-09-17T01:36:12.304675+0000","last_undegraded":"2024-09-17T01:36:12.304675+0000","last_fullsized":"2024-09-17T01:36:12.304675+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:24.361465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925132+0000","last_change":"2024-09-17T01:36:11.315637+0000","last_active":"2024-09-17T01:36:12.925132+0000","last_peered":"2024-09-17T01:36:12.925132+0000","last_clean":"2024-09-17T01:36:12.925132+0000","last_became_active":"2024-09-17T01:36:11.314795+0000","last_became_peered":"2024-09-17T01:36:11.314795+0000","last_unstale":"2024-09-17T01:36:12.925132+0000","last_undegraded":"2024-09-17T01:36:12.925132+0000","last_fullsized":"2024-09-17T01:36:12.925132+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:18.981223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866361+0000","last_change":"2024-09-17T01:36:11.313898+0000","last_active":"2024-09-17T01:36:12.866361+0000","last_peered":"2024-09-17T01:36:12.866361+0000","last_clean":"2024-09-17T01:36:12.866361+0000","last_became_active":"2024-09-17T01:36:11.313556+0000","last_became_peered":"2024-09-17T01:36:11.313556+0000","last_unstale":"2024-09-17T01:36:12.866361+0000","last_undegraded":"2024-09-17T01:36:12.866361+0000","last_fullsized":"2024-09-17T01:36:12.866361+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:22:02.980623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992700+0000","last_change":"2024-09-17T01:36:11.308618+0000","last_active":"2024-09-17T01:36:12.992700+0000","last_peered":"2024-09-17T01:36:12.992700+0000","last_clean":"2024-09-17T01:36:12.992700+0000","last_became_active":"2024-09-17T01:36:11.308319+0000","last_became_peered":"2024-09-17T01:36:11.308319+0000","last_unstale":"2024-09-17T01:36:12.992700+0000","last_undegraded":"2024-09-17T01:36:12.992700+0000","last_fullsized":"2024-09-17T01:36:12.992700+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:34.276355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.285301+0000","last_change":"2024-09-17T01:36:10.285301+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.285301+0000","last_undegraded":"2024-09-17T01:36:10.285301+0000","last_fullsized":"2024-09-17T01:36:10.285301+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992453+0000","last_change":"2024-09-17T01:36:11.318165+0000","last_active":"2024-09-17T01:36:12.992453+0000","last_peered":"2024-09-17T01:36:12.992453+0000","last_clean":"2024-09-17T01:36:12.992453+0000","last_became_active":"2024-09-17T01:36:11.317875+0000","last_became_peered":"2024-09-17T01:36:11.317875+0000","last_unstale":"2024-09-17T01:36:12.992453+0000","last_undegraded":"2024-09-17T01:36:12.992453+0000","last_fullsized":"2024-09-17T01:36:12.992453+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:00.765527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303951+0000","last_change":"2024-09-17T01:36:11.297004+0000","last_active":"2024-09-17T01:36:12.303951+0000","last_peered":"2024-09-17T01:36:12.303951+0000","last_clean":"2024-09-17T01:36:12.303951+0000","last_became_active":"2024-09-17T01:36:11.296661+0000","last_became_peered":"2024-09-17T01:36:11.296661+0000","last_unstale":"2024-09-17T01:36:12.303951+0000","last_undegraded":"2024-09-17T01:36:12.303951+0000","last_fullsized":"2024-09-17T01:36:12.303951+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:18.099170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305020+0000","last_change":"2024-09-17T01:36:11.303184+0000","last_active":"2024-09-17T01:36:12.305020+0000","last_peered":"2024-09-17T01:36:12.305020+0000","last_clean":"2024-09-17T01:36:12.305020+0000","last_became_active":"2024-09-17T01:36:11.302826+0000","last_became_peered":"2024-09-17T01:36:11.302826+0000","last_unstale":"2024-09-17T01:36:12.305020+0000","last_undegraded":"2024-09-17T01:36:12.305020+0000","last_fullsized":"2024-09-17T01:36:12.305020+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:59.362677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.278679+0000","last_change":"2024-09-17T01:36:10.278679+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.278679+0000","last_undegraded":"2024-09-17T01:36:10.278679+0000","last_fullsized":"2024-09-17T01:36:10.278679+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023564+0000","last_change":"2024-09-17T01:36:11.323204+0000","last_active":"2024-09-17T01:36:13.023564+0000","last_peered":"2024-09-17T01:36:13.023564+0000","last_clean":"2024-09-17T01:36:13.023564+0000","last_became_active":"2024-09-17T01:36:11.322063+0000","last_became_peered":"2024-09-17T01:36:11.322063+0000","last_unstale":"2024-09-17T01:36:13.023564+0000","last_undegraded":"2024-09-17T01:36:13.023564+0000","last_fullsized":"2024-09-17T01:36:13.023564+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:11.122810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925263+0000","last_change":"2024-09-17T01:36:11.315695+0000","last_active":"2024-09-17T01:36:12.925263+0000","last_peered":"2024-09-17T01:36:12.925263+0000","last_clean":"2024-09-17T01:36:12.925263+0000","last_became_active":"2024-09-17T01:36:11.315143+0000","last_became_peered":"2024-09-17T01:36:11.315143+0000","last_unstale":"2024-09-17T01:36:12.925263+0000","last_undegraded":"2024-09-17T01:36:12.925263+0000","last_fullsized":"2024-09-17T01:36:12.925263+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:35.194646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992684+0000","last_change":"2024-09-17T01:36:11.323619+0000","last_active":"2024-09-17T01:36:12.992684+0000","last_peered":"2024-09-17T01:36:12.992684+0000","last_clean":"2024-09-17T01:36:12.992684+0000","last_became_active":"2024-09-17T01:36:11.323346+0000","last_became_peered":"2024-09-17T01:36:11.323346+0000","last_unstale":"2024-09-17T01:36:12.992684+0000","last_undegraded":"2024-09-17T01:36:12.992684+0000","last_fullsized":"2024-09-17T01:36:12.992684+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:08.202105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925295+0000","last_change":"2024-09-17T01:36:11.305911+0000","last_active":"2024-09-17T01:36:12.925295+0000","last_peered":"2024-09-17T01:36:12.925295+0000","last_clean":"2024-09-17T01:36:12.925295+0000","last_became_active":"2024-09-17T01:36:11.305567+0000","last_became_peered":"2024-09-17T01:36:11.305567+0000","last_unstale":"2024-09-17T01:36:12.925295+0000","last_undegraded":"2024-09-17T01:36:12.925295+0000","last_fullsized":"2024-09-17T01:36:12.925295+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:07.419500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076616+0000","last_change":"2024-09-17T01:36:11.310245+0000","last_active":"2024-09-17T01:36:13.076616+0000","last_peered":"2024-09-17T01:36:13.076616+0000","last_clean":"2024-09-17T01:36:13.076616+0000","last_became_active":"2024-09-17T01:36:11.309949+0000","last_became_peered":"2024-09-17T01:36:11.309949+0000","last_unstale":"2024-09-17T01:36:13.076616+0000","last_undegraded":"2024-09-17T01:36:13.076616+0000","last_fullsized":"2024-09-17T01:36:13.076616+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:42.594893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866214+0000","last_change":"2024-09-17T01:36:11.318149+0000","last_active":"2024-09-17T01:36:12.866214+0000","last_peered":"2024-09-17T01:36:12.866214+0000","last_clean":"2024-09-17T01:36:12.866214+0000","last_became_active":"2024-09-17T01:36:11.317798+0000","last_became_peered":"2024-09-17T01:36:11.317798+0000","last_unstale":"2024-09-17T01:36:12.866214+0000","last_undegraded":"2024-09-17T01:36:12.866214+0000","last_fullsized":"2024-09-17T01:36:12.866214+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:52.367069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023788+0000","last_change":"2024-09-17T01:36:11.325158+0000","last_active":"2024-09-17T01:36:13.023788+0000","last_peered":"2024-09-17T01:36:13.023788+0000","last_clean":"2024-09-17T01:36:13.023788+0000","last_became_active":"2024-09-17T01:36:11.323928+0000","last_became_peered":"2024-09-17T01:36:11.323928+0000","last_unstale":"2024-09-17T01:36:13.023788+0000","last_undegraded":"2024-09-17T01:36:13.023788+0000","last_fullsized":"2024-09-17T01:36:13.023788+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:26.441833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.993007+0000","last_change":"2024-09-17T01:36:11.314300+0000","last_active":"2024-09-17T01:36:12.993007+0000","last_peered":"2024-09-17T01:36:12.993007+0000","last_clean":"2024-09-17T01:36:12.993007+0000","last_became_active":"2024-09-17T01:36:11.313197+0000","last_became_peered":"2024-09-17T01:36:11.313197+0000","last_unstale":"2024-09-17T01:36:12.993007+0000","last_undegraded":"2024-09-17T01:36:12.993007+0000","last_fullsized":"2024-09-17T01:36:12.993007+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:24.449150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023920+0000","last_change":"2024-09-17T01:36:11.318641+0000","last_active":"2024-09-17T01:36:13.023920+0000","last_peered":"2024-09-17T01:36:13.023920+0000","last_clean":"2024-09-17T01:36:13.023920+0000","last_became_active":"2024-09-17T01:36:11.317933+0000","last_became_peered":"2024-09-17T01:36:11.317933+0000","last_unstale":"2024-09-17T01:36:13.023920+0000","last_undegraded":"2024-09-17T01:36:13.023920+0000","last_fullsized":"2024-09-17T01:36:13.023920+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:07:47.466557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303627+0000","last_change":"2024-09-17T01:36:11.317931+0000","last_active":"2024-09-17T01:36:12.303627+0000","last_peered":"2024-09-17T01:36:12.303627+0000","last_clean":"2024-09-17T01:36:12.303627+0000","last_became_active":"2024-09-17T01:36:11.310928+0000","last_became_peered":"2024-09-17T01:36:11.310928+0000","last_unstale":"2024-09-17T01:36:12.303627+0000","last_undegraded":"2024-09-17T01:36:12.303627+0000","last_fullsized":"2024-09-17T01:36:12.303627+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:04.246558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304597+0000","last_change":"2024-09-17T01:36:11.308715+0000","last_active":"2024-09-17T01:36:12.304597+0000","last_peered":"2024-09-17T01:36:12.304597+0000","last_clean":"2024-09-17T01:36:12.304597+0000","last_became_active":"2024-09-17T01:36:11.308287+0000","last_became_peered":"2024-09-17T01:36:11.308287+0000","last_unstale":"2024-09-17T01:36:12.304597+0000","last_undegraded":"2024-09-17T01:36:12.304597+0000","last_fullsized":"2024-09-17T01:36:12.304597+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:57.671724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076588+0000","last_change":"2024-09-17T01:36:11.304384+0000","last_active":"2024-09-17T01:36:13.076588+0000","last_peered":"2024-09-17T01:36:13.076588+0000","last_clean":"2024-09-17T01:36:13.076588+0000","last_became_active":"2024-09-17T01:36:11.302561+0000","last_became_peered":"2024-09-17T01:36:11.302561+0000","last_unstale":"2024-09-17T01:36:13.076588+0000","last_undegraded":"2024-09-17T01:36:13.076588+0000","last_fullsized":"2024-09-17T01:36:13.076588+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:36.574249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023288+0000","last_change":"2024-09-17T01:36:11.313970+0000","last_active":"2024-09-17T01:36:13.023288+0000","last_peered":"2024-09-17T01:36:13.023288+0000","last_clean":"2024-09-17T01:36:13.023288+0000","last_became_active":"2024-09-17T01:36:11.310156+0000","last_became_peered":"2024-09-17T01:36:11.310156+0000","last_unstale":"2024-09-17T01:36:13.023288+0000","last_undegraded":"2024-09-17T01:36:13.023288+0000","last_fullsized":"2024-09-17T01:36:13.023288+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:58.276824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925181+0000","last_change":"2024-09-17T01:36:11.306107+0000","last_active":"2024-09-17T01:36:12.925181+0000","last_peered":"2024-09-17T01:36:12.925181+0000","last_clean":"2024-09-17T01:36:12.925181+0000","last_became_active":"2024-09-17T01:36:11.305764+0000","last_became_peered":"2024-09-17T01:36:11.305764+0000","last_unstale":"2024-09-17T01:36:12.925181+0000","last_undegraded":"2024-09-17T01:36:12.925181+0000","last_fullsized":"2024-09-17T01:36:12.925181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:09.482083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305187+0000","last_change":"2024-09-17T01:36:11.297563+0000","last_active":"2024-09-17T01:36:12.305187+0000","last_peered":"2024-09-17T01:36:12.305187+0000","last_clean":"2024-09-17T01:36:12.305187+0000","last_became_active":"2024-09-17T01:36:11.297236+0000","last_became_peered":"2024-09-17T01:36:11.297236+0000","last_unstale":"2024-09-17T01:36:12.305187+0000","last_undegraded":"2024-09-17T01:36:12.305187+0000","last_fullsized":"2024-09-17T01:36:12.305187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:28.959565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925285+0000","last_change":"2024-09-17T01:36:10.292457+0000","last_active":"2024-09-17T01:36:12.925285+0000","last_peered":"2024-09-17T01:36:12.925285+0000","last_clean":"2024-09-17T01:36:12.925285+0000","last_became_active":"2024-09-17T01:36:10.292073+0000","last_became_peered":"2024-09-17T01:36:10.292073+0000","last_unstale":"2024-09-17T01:36:12.925285+0000","last_undegraded":"2024-09-17T01:36:12.925285+0000","last_fullsized":"2024-09-17T01:36:12.925285+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:47.680334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305127+0000","last_change":"2024-09-17T01:36:11.314223+0000","last_active":"2024-09-17T01:36:12.305127+0000","last_peered":"2024-09-17T01:36:12.305127+0000","last_clean":"2024-09-17T01:36:12.305127+0000","last_became_active":"2024-09-17T01:36:11.313462+0000","last_became_peered":"2024-09-17T01:36:11.313462+0000","last_unstale":"2024-09-17T01:36:12.305127+0000","last_undegraded":"2024-09-17T01:36:12.305127+0000","last_fullsized":"2024-09-17T01:36:12.305127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:48.686497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023531+0000","last_change":"2024-09-17T01:36:10.295597+0000","last_active":"2024-09-17T01:36:13.023531+0000","last_peered":"2024-09-17T01:36:13.023531+0000","last_clean":"2024-09-17T01:36:13.023531+0000","last_became_active":"2024-09-17T01:36:10.295269+0000","last_became_peered":"2024-09-17T01:36:10.295269+0000","last_unstale":"2024-09-17T01:36:13.023531+0000","last_undegraded":"2024-09-17T01:36:13.023531+0000","last_fullsized":"2024-09-17T01:36:13.023531+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:07.370466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303912+0000","last_change":"2024-09-17T01:36:11.320059+0000","last_active":"2024-09-17T01:36:12.303912+0000","last_peered":"2024-09-17T01:36:12.303912+0000","last_clean":"2024-09-17T01:36:12.303912+0000","last_became_active":"2024-09-17T01:36:11.319721+0000","last_became_peered":"2024-09-17T01:36:11.319721+0000","last_unstale":"2024-09-17T01:36:12.303912+0000","last_undegraded":"2024-09-17T01:36:12.303912+0000","last_fullsized":"2024-09-17T01:36:12.303912+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:59.228610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303898+0000","last_change":"2024-09-17T01:36:10.286360+0000","last_active":"2024-09-17T01:36:12.303898+0000","last_peered":"2024-09-17T01:36:12.303898+0000","last_clean":"2024-09-17T01:36:12.303898+0000","last_became_active":"2024-09-17T01:36:10.285959+0000","last_became_peered":"2024-09-17T01:36:10.285959+0000","last_unstale":"2024-09-17T01:36:12.303898+0000","last_undegraded":"2024-09-17T01:36:12.303898+0000","last_fullsized":"2024-09-17T01:36:12.303898+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:11.061550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305368+0000","last_change":"2024-09-17T01:36:11.309231+0000","last_active":"2024-09-17T01:36:12.305368+0000","last_peered":"2024-09-17T01:36:12.305368+0000","last_clean":"2024-09-17T01:36:12.305368+0000","last_became_active":"2024-09-17T01:36:11.304902+0000","last_became_peered":"2024-09-17T01:36:11.304902+0000","last_unstale":"2024-09-17T01:36:12.305368+0000","last_undegraded":"2024-09-17T01:36:12.305368+0000","last_fullsized":"2024-09-17T01:36:12.305368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:56.613111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076709+0000","last_change":"2024-09-17T01:36:10.300133+0000","last_active":"2024-09-17T01:36:13.076709+0000","last_peered":"2024-09-17T01:36:13.076709+0000","last_clean":"2024-09-17T01:36:13.076709+0000","last_became_active":"2024-09-17T01:36:10.299955+0000","last_became_peered":"2024-09-17T01:36:10.299955+0000","last_unstale":"2024-09-17T01:36:13.076709+0000","last_undegraded":"2024-09-17T01:36:13.076709+0000","last_fullsized":"2024-09-17T01:36:13.076709+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:48.285259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303509+0000","last_change":"2024-09-17T01:36:11.323505+0000","last_active":"2024-09-17T01:36:12.303509+0000","last_peered":"2024-09-17T01:36:12.303509+0000","last_clean":"2024-09-17T01:36:12.303509+0000","last_became_active":"2024-09-17T01:36:11.323174+0000","last_became_peered":"2024-09-17T01:36:11.323174+0000","last_unstale":"2024-09-17T01:36:12.303509+0000","last_undegraded":"2024-09-17T01:36:12.303509+0000","last_fullsized":"2024-09-17T01:36:12.303509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:48.884777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T01:36:10.298847+0000","last_change":"2024-09-17T01:36:10.291224+0000","last_active":"2024-09-17T01:36:10.298847+0000","last_peered":"2024-09-17T01:36:10.298847+0000","last_clean":"2024-09-17T01:36:10.298847+0000","last_became_active":"2024-09-17T01:36:10.290471+0000","last_became_peered":"2024-09-17T01:36:10.290471+0000","last_unstale":"2024-09-17T01:36:10.298847+0000","last_undegraded":"2024-09-17T01:36:10.298847+0000","last_fullsized":"2024-09-17T01:36:10.298847+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:05.843746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925183+0000","last_change":"2024-09-17T01:36:11.310201+0000","last_active":"2024-09-17T01:36:12.925183+0000","last_peered":"2024-09-17T01:36:12.925183+0000","last_clean":"2024-09-17T01:36:12.925183+0000","last_became_active":"2024-09-17T01:36:11.310003+0000","last_became_peered":"2024-09-17T01:36:11.310003+0000","last_unstale":"2024-09-17T01:36:12.925183+0000","last_undegraded":"2024-09-17T01:36:12.925183+0000","last_fullsized":"2024-09-17T01:36:12.925183+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:45.948182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305179+0000","last_change":"2024-09-17T01:36:10.293072+0000","last_active":"2024-09-17T01:36:12.305179+0000","last_peered":"2024-09-17T01:36:12.305179+0000","last_clean":"2024-09-17T01:36:12.305179+0000","last_became_active":"2024-09-17T01:36:10.290949+0000","last_became_peered":"2024-09-17T01:36:10.290949+0000","last_unstale":"2024-09-17T01:36:12.305179+0000","last_undegraded":"2024-09-17T01:36:12.305179+0000","last_fullsized":"2024-09-17T01:36:12.305179+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:40.448306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.277116+0000","last_change":"2024-09-17T01:36:10.277116+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.277116+0000","last_undegraded":"2024-09-17T01:36:10.277116+0000","last_fullsized":"2024-09-17T01:36:10.277116+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.865999+0000","last_change":"2024-09-17T01:36:10.296734+0000","last_active":"2024-09-17T01:36:12.865999+0000","last_peered":"2024-09-17T01:36:12.865999+0000","last_clean":"2024-09-17T01:36:12.865999+0000","last_became_active":"2024-09-17T01:36:10.296463+0000","last_became_peered":"2024-09-17T01:36:10.296463+0000","last_unstale":"2024-09-17T01:36:12.865999+0000","last_undegraded":"2024-09-17T01:36:12.865999+0000","last_fullsized":"2024-09-17T01:36:12.865999+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:19.770144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303645+0000","last_change":"2024-09-17T01:36:11.306806+0000","last_active":"2024-09-17T01:36:12.303645+0000","last_peered":"2024-09-17T01:36:12.303645+0000","last_clean":"2024-09-17T01:36:12.303645+0000","last_became_active":"2024-09-17T01:36:11.306392+0000","last_became_peered":"2024-09-17T01:36:11.306392+0000","last_unstale":"2024-09-17T01:36:12.303645+0000","last_undegraded":"2024-09-17T01:36:12.303645+0000","last_fullsized":"2024-09-17T01:36:12.303645+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:58.962482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992402+0000","last_change":"2024-09-17T01:36:10.289402+0000","last_active":"2024-09-17T01:36:12.992402+0000","last_peered":"2024-09-17T01:36:12.992402+0000","last_clean":"2024-09-17T01:36:12.992402+0000","last_became_active":"2024-09-17T01:36:10.289028+0000","last_became_peered":"2024-09-17T01:36:10.289028+0000","last_unstale":"2024-09-17T01:36:12.992402+0000","last_undegraded":"2024-09-17T01:36:12.992402+0000","last_fullsized":"2024-09-17T01:36:12.992402+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:54.956235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.993014+0000","last_change":"2024-09-17T01:36:11.302630+0000","last_active":"2024-09-17T01:36:12.993014+0000","last_peered":"2024-09-17T01:36:12.993014+0000","last_clean":"2024-09-17T01:36:12.993014+0000","last_became_active":"2024-09-17T01:36:11.302324+0000","last_became_peered":"2024-09-17T01:36:11.302324+0000","last_unstale":"2024-09-17T01:36:12.993014+0000","last_undegraded":"2024-09-17T01:36:12.993014+0000","last_fullsized":"2024-09-17T01:36:12.993014+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:35.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866234+0000","last_change":"2024-09-17T01:36:10.293964+0000","last_active":"2024-09-17T01:36:12.866234+0000","last_peered":"2024-09-17T01:36:12.866234+0000","last_clean":"2024-09-17T01:36:12.866234+0000","last_became_active":"2024-09-17T01:36:10.293658+0000","last_became_peered":"2024-09-17T01:36:10.293658+0000","last_unstale":"2024-09-17T01:36:12.866234+0000","last_undegraded":"2024-09-17T01:36:12.866234+0000","last_fullsized":"2024-09-17T01:36:12.866234+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:37.278082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.285012+0000","last_change":"2024-09-17T01:36:10.285012+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.285012+0000","last_undegraded":"2024-09-17T01:36:10.285012+0000","last_fullsized":"2024-09-17T01:36:10.285012+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304174+0000","last_change":"2024-09-17T01:36:10.294720+0000","last_active":"2024-09-17T01:36:12.304174+0000","last_peered":"2024-09-17T01:36:12.304174+0000","last_clean":"2024-09-17T01:36:12.304174+0000","last_became_active":"2024-09-17T01:36:10.294012+0000","last_became_peered":"2024-09-17T01:36:10.294012+0000","last_unstale":"2024-09-17T01:36:12.304174+0000","last_undegraded":"2024-09-17T01:36:12.304174+0000","last_fullsized":"2024-09-17T01:36:12.304174+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:29.017109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304165+0000","last_change":"2024-09-17T01:36:11.319252+0000","last_active":"2024-09-17T01:36:12.304165+0000","last_peered":"2024-09-17T01:36:12.304165+0000","last_clean":"2024-09-17T01:36:12.304165+0000","last_became_active":"2024-09-17T01:36:11.316127+0000","last_became_peered":"2024-09-17T01:36:11.316127+0000","last_unstale":"2024-09-17T01:36:12.304165+0000","last_undegraded":"2024-09-17T01:36:12.304165+0000","last_fullsized":"2024-09-17T01:36:12.304165+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:57:36.447976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.077184+0000","last_change":"2024-09-17T01:36:10.298237+0000","last_active":"2024-09-17T01:36:13.077184+0000","last_peered":"2024-09-17T01:36:13.077184+0000","last_clean":"2024-09-17T01:36:13.077184+0000","last_became_active":"2024-09-17T01:36:10.297914+0000","last_became_peered":"2024-09-17T01:36:10.297914+0000","last_unstale":"2024-09-17T01:36:13.077184+0000","last_undegraded":"2024-09-17T01:36:13.077184+0000","last_fullsized":"2024-09-17T01:36:13.077184+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:58.586762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076884+0000","last_change":"2024-09-17T01:36:11.310102+0000","last_active":"2024-09-17T01:36:13.076884+0000","last_peered":"2024-09-17T01:36:13.076884+0000","last_clean":"2024-09-17T01:36:13.076884+0000","last_became_active":"2024-09-17T01:36:11.309689+0000","last_became_peered":"2024-09-17T01:36:11.309689+0000","last_unstale":"2024-09-17T01:36:13.076884+0000","last_undegraded":"2024-09-17T01:36:13.076884+0000","last_fullsized":"2024-09-17T01:36:13.076884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:00.158245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":21,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992768+0000","last_change":"2024-09-17T01:36:10.292473+0000","last_active":"2024-09-17T01:36:12.992768+0000","last_peered":"2024-09-17T01:36:12.992768+0000","last_clean":"2024-09-17T01:36:12.992768+0000","last_became_active":"2024-09-17T01:36:10.292161+0000","last_became_peered":"2024-09-17T01:36:10.292161+0000","last_unstale":"2024-09-17T01:36:12.992768+0000","last_undegraded":"2024-09-17T01:36:12.992768+0000","last_fullsized":"2024-09-17T01:36:12.992768+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:03.337816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866232+0000","last_change":"2024-09-17T01:36:11.308108+0000","last_active":"2024-09-17T01:36:12.866232+0000","last_peered":"2024-09-17T01:36:12.866232+0000","last_clean":"2024-09-17T01:36:12.866232+0000","last_became_active":"2024-09-17T01:36:11.307801+0000","last_became_peered":"2024-09-17T01:36:11.307801+0000","last_unstale":"2024-09-17T01:36:12.866232+0000","last_undegraded":"2024-09-17T01:36:12.866232+0000","last_fullsized":"2024-09-17T01:36:12.866232+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:42.954974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303899+0000","last_change":"2024-09-17T01:36:10.293577+0000","last_active":"2024-09-17T01:36:12.303899+0000","last_peered":"2024-09-17T01:36:12.303899+0000","last_clean":"2024-09-17T01:36:12.303899+0000","last_became_active":"2024-09-17T01:36:10.291934+0000","last_became_peered":"2024-09-17T01:36:10.291934+0000","last_unstale":"2024-09-17T01:36:12.303899+0000","last_undegraded":"2024-09-17T01:36:12.303899+0000","last_fullsized":"2024-09-17T01:36:12.303899+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:15.757296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.282960+0000","last_change":"2024-09-17T01:36:10.282960+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.282960+0000","last_undegraded":"2024-09-17T01:36:10.282960+0000","last_fullsized":"2024-09-17T01:36:10.282960+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076416+0000","last_change":"2024-09-17T01:36:10.291611+0000","last_active":"2024-09-17T01:36:13.076416+0000","last_peered":"2024-09-17T01:36:13.076416+0000","last_clean":"2024-09-17T01:36:13.076416+0000","last_became_active":"2024-09-17T01:36:10.291234+0000","last_became_peered":"2024-09-17T01:36:10.291234+0000","last_unstale":"2024-09-17T01:36:13.076416+0000","last_undegraded":"2024-09-17T01:36:13.076416+0000","last_fullsized":"2024-09-17T01:36:13.076416+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:22.528484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866341+0000","last_change":"2024-09-17T01:36:11.313891+0000","last_active":"2024-09-17T01:36:12.866341+0000","last_peered":"2024-09-17T01:36:12.866341+0000","last_clean":"2024-09-17T01:36:12.866341+0000","last_became_active":"2024-09-17T01:36:11.313582+0000","last_became_peered":"2024-09-17T01:36:11.313582+0000","last_unstale":"2024-09-17T01:36:12.866341+0000","last_undegraded":"2024-09-17T01:36:12.866341+0000","last_fullsized":"2024-09-17T01:36:12.866341+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:22.521895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076693+0000","last_change":"2024-09-17T01:36:10.286012+0000","last_active":"2024-09-17T01:36:13.076693+0000","last_peered":"2024-09-17T01:36:13.076693+0000","last_clean":"2024-09-17T01:36:13.076693+0000","last_became_active":"2024-09-17T01:36:10.284940+0000","last_became_peered":"2024-09-17T01:36:10.284940+0000","last_unstale":"2024-09-17T01:36:13.076693+0000","last_undegraded":"2024-09-17T01:36:13.076693+0000","last_fullsized":"2024-09-17T01:36:13.076693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:00.539807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076838+0000","last_change":"2024-09-17T01:36:11.309989+0000","last_active":"2024-09-17T01:36:13.076838+0000","last_peered":"2024-09-17T01:36:13.076838+0000","last_clean":"2024-09-17T01:36:13.076838+0000","last_became_active":"2024-09-17T01:36:11.309641+0000","last_became_peered":"2024-09-17T01:36:11.309641+0000","last_unstale":"2024-09-17T01:36:13.076838+0000","last_undegraded":"2024-09-17T01:36:13.076838+0000","last_fullsized":"2024-09-17T01:36:13.076838+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:40.530982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":23,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076341+0000","last_change":"2024-09-17T01:36:10.295240+0000","last_active":"2024-09-17T01:36:13.076341+0000","last_peered":"2024-09-17T01:36:13.076341+0000","last_clean":"2024-09-17T01:36:13.076341+0000","last_became_active":"2024-09-17T01:36:10.294945+0000","last_became_peered":"2024-09-17T01:36:10.294945+0000","last_unstale":"2024-09-17T01:36:13.076341+0000","last_undegraded":"2024-09-17T01:36:13.076341+0000","last_fullsized":"2024-09-17T01:36:13.076341+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:55.304271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.278156+0000","last_change":"2024-09-17T01:36:10.278156+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.278156+0000","last_undegraded":"2024-09-17T01:36:10.278156+0000","last_fullsized":"2024-09-17T01:36:10.278156+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023621+0000","last_change":"2024-09-17T01:36:10.298316+0000","last_active":"2024-09-17T01:36:13.023621+0000","last_peered":"2024-09-17T01:36:13.023621+0000","last_clean":"2024-09-17T01:36:13.023621+0000","last_became_active":"2024-09-17T01:36:10.297999+0000","last_became_peered":"2024-09-17T01:36:10.297999+0000","last_unstale":"2024-09-17T01:36:13.023621+0000","last_undegraded":"2024-09-17T01:36:13.023621+0000","last_fullsized":"2024-09-17T01:36:13.023621+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:38:13.536708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.284537+0000","last_change":"2024-09-17T01:36:10.284537+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.284537+0000","last_undegraded":"2024-09-17T01:36:10.284537+0000","last_fullsized":"2024-09-17T01:36:10.284537+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304328+0000","last_change":"2024-09-17T01:36:10.294353+0000","last_active":"2024-09-17T01:36:12.304328+0000","last_peered":"2024-09-17T01:36:12.304328+0000","last_clean":"2024-09-17T01:36:12.304328+0000","last_became_active":"2024-09-17T01:36:10.293440+0000","last_became_peered":"2024-09-17T01:36:10.293440+0000","last_unstale":"2024-09-17T01:36:12.304328+0000","last_undegraded":"2024-09-17T01:36:12.304328+0000","last_fullsized":"2024-09-17T01:36:12.304328+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:33.626765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023594+0000","last_change":"2024-09-17T01:36:11.320250+0000","last_active":"2024-09-17T01:36:13.023594+0000","last_peered":"2024-09-17T01:36:13.023594+0000","last_clean":"2024-09-17T01:36:13.023594+0000","last_became_active":"2024-09-17T01:36:11.319913+0000","last_became_peered":"2024-09-17T01:36:11.319913+0000","last_unstale":"2024-09-17T01:36:13.023594+0000","last_undegraded":"2024-09-17T01:36:13.023594+0000","last_fullsized":"2024-09-17T01:36:13.023594+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:03.629335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T01:36:10.299567+0000","last_change":"2024-09-17T01:36:10.294281+0000","last_active":"2024-09-17T01:36:10.299567+0000","last_peered":"2024-09-17T01:36:10.299567+0000","last_clean":"2024-09-17T01:36:10.299567+0000","last_became_active":"2024-09-17T01:36:10.293955+0000","last_became_peered":"2024-09-17T01:36:10.293955+0000","last_unstale":"2024-09-17T01:36:10.299567+0000","last_undegraded":"2024-09-17T01:36:10.299567+0000","last_fullsized":"2024-09-17T01:36:10.299567+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:38.320555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.077112+0000","last_change":"2024-09-17T01:36:11.320342+0000","last_active":"2024-09-17T01:36:13.077112+0000","last_peered":"2024-09-17T01:36:13.077112+0000","last_clean":"2024-09-17T01:36:13.077112+0000","last_became_active":"2024-09-17T01:36:11.320023+0000","last_became_peered":"2024-09-17T01:36:11.320023+0000","last_unstale":"2024-09-17T01:36:13.077112+0000","last_undegraded":"2024-09-17T01:36:13.077112+0000","last_fullsized":"2024-09-17T01:36:13.077112+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:26.695707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304315+0000","last_change":"2024-09-17T01:36:10.289087+0000","last_active":"2024-09-17T01:36:12.304315+0000","last_peered":"2024-09-17T01:36:12.304315+0000","last_clean":"2024-09-17T01:36:12.304315+0000","last_became_active":"2024-09-17T01:36:10.288721+0000","last_became_peered":"2024-09-17T01:36:10.288721+0000","last_unstale":"2024-09-17T01:36:12.304315+0000","last_undegraded":"2024-09-17T01:36:12.304315+0000","last_fullsized":"2024-09-17T01:36:12.304315+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:24:11.811046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866397+0000","last_change":"2024-09-17T01:36:11.319574+0000","last_active":"2024-09-17T01:36:12.866397+0000","last_peered":"2024-09-17T01:36:12.866397+0000","last_clean":"2024-09-17T01:36:12.866397+0000","last_became_active":"2024-09-17T01:36:11.317100+0000","last_became_peered":"2024-09-17T01:36:11.317100+0000","last_unstale":"2024-09-17T01:36:12.866397+0000","last_undegraded":"2024-09-17T01:36:12.866397+0000","last_fullsized":"2024-09-17T01:36:12.866397+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:50.155552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.924945+0000","last_change":"2024-09-17T01:36:10.295963+0000","last_active":"2024-09-17T01:36:12.924945+0000","last_peered":"2024-09-17T01:36:12.924945+0000","last_clean":"2024-09-17T01:36:12.924945+0000","last_became_active":"2024-09-17T01:36:10.294487+0000","last_became_peered":"2024-09-17T01:36:10.294487+0000","last_unstale":"2024-09-17T01:36:12.924945+0000","last_undegraded":"2024-09-17T01:36:12.924945+0000","last_fullsized":"2024-09-17T01:36:12.924945+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:18:44.054224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303371+0000","last_change":"2024-09-17T01:36:11.314041+0000","last_active":"2024-09-17T01:36:12.303371+0000","last_peered":"2024-09-17T01:36:12.303371+0000","last_clean":"2024-09-17T01:36:12.303371+0000","last_became_active":"2024-09-17T01:36:11.313573+0000","last_became_peered":"2024-09-17T01:36:11.313573+0000","last_unstale":"2024-09-17T01:36:12.303371+0000","last_undegraded":"2024-09-17T01:36:12.303371+0000","last_fullsized":"2024-09-17T01:36:12.303371+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:30.847327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303084+0000","last_change":"2024-09-17T01:36:10.293477+0000","last_active":"2024-09-17T01:36:12.303084+0000","last_peered":"2024-09-17T01:36:12.303084+0000","last_clean":"2024-09-17T01:36:12.303084+0000","last_became_active":"2024-09-17T01:36:10.293119+0000","last_became_peered":"2024-09-17T01:36:10.293119+0000","last_unstale":"2024-09-17T01:36:12.303084+0000","last_undegraded":"2024-09-17T01:36:12.303084+0000","last_fullsized":"2024-09-17T01:36:12.303084+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:02.386471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303044+0000","last_change":"2024-09-17T01:36:11.315150+0000","last_active":"2024-09-17T01:36:12.303044+0000","last_peered":"2024-09-17T01:36:12.303044+0000","last_clean":"2024-09-17T01:36:12.303044+0000","last_became_active":"2024-09-17T01:36:11.314846+0000","last_became_peered":"2024-09-17T01:36:11.314846+0000","last_unstale":"2024-09-17T01:36:12.303044+0000","last_undegraded":"2024-09-17T01:36:12.303044+0000","last_fullsized":"2024-09-17T01:36:12.303044+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:08.297937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866344+0000","last_change":"2024-09-17T01:36:10.280718+0000","last_active":"2024-09-17T01:36:12.866344+0000","last_peered":"2024-09-17T01:36:12.866344+0000","last_clean":"2024-09-17T01:36:12.866344+0000","last_became_active":"2024-09-17T01:36:10.280401+0000","last_became_peered":"2024-09-17T01:36:10.280401+0000","last_unstale":"2024-09-17T01:36:12.866344+0000","last_undegraded":"2024-09-17T01:36:12.866344+0000","last_fullsized":"2024-09-17T01:36:12.866344+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:46.578001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.277627+0000","last_change":"2024-09-17T01:36:10.277627+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.277627+0000","last_undegraded":"2024-09-17T01:36:10.277627+0000","last_fullsized":"2024-09-17T01:36:10.277627+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023788+0000","last_change":"2024-09-17T01:36:10.298876+0000","last_active":"2024-09-17T01:36:13.023788+0000","last_peered":"2024-09-17T01:36:13.023788+0000","last_clean":"2024-09-17T01:36:13.023788+0000","last_became_active":"2024-09-17T01:36:10.298564+0000","last_became_peered":"2024-09-17T01:36:10.298564+0000","last_unstale":"2024-09-17T01:36:13.023788+0000","last_undegraded":"2024-09-17T01:36:13.023788+0000","last_fullsized":"2024-09-17T01:36:13.023788+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:48.499379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":60,"state":"creating+peering","last_fresh":"2024-09-17T01:36:10.277174+0000","last_change":"2024-09-17T01:36:10.277174+0000","last_active":"2024-09-17T01:36:10.264668+0000","last_peered":"2024-09-17T01:36:10.264668+0000","last_clean":"2024-09-17T01:36:10.264668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:10.277174+0000","last_undegraded":"2024-09-17T01:36:10.277174+0000","last_fullsized":"2024-09-17T01:36:10.277174+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"62'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305072+0000","last_change":"2024-09-17T01:36:10.290784+0000","last_active":"2024-09-17T01:36:12.305072+0000","last_peered":"2024-09-17T01:36:12.305072+0000","last_clean":"2024-09-17T01:36:12.305072+0000","last_became_active":"2024-09-17T01:36:10.288289+0000","last_became_peered":"2024-09-17T01:36:10.288289+0000","last_unstale":"2024-09-17T01:36:12.305072+0000","last_undegraded":"2024-09-17T01:36:12.305072+0000","last_fullsized":"2024-09-17T01:36:12.305072+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:25.435670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023456+0000","last_change":"2024-09-17T01:36:11.316442+0000","last_active":"2024-09-17T01:36:13.023456+0000","last_peered":"2024-09-17T01:36:13.023456+0000","last_clean":"2024-09-17T01:36:13.023456+0000","last_became_active":"2024-09-17T01:36:11.315668+0000","last_became_peered":"2024-09-17T01:36:11.315668+0000","last_unstale":"2024-09-17T01:36:13.023456+0000","last_undegraded":"2024-09-17T01:36:13.023456+0000","last_fullsized":"2024-09-17T01:36:13.023456+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:15:50.717398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866158+0000","last_change":"2024-09-17T01:36:10.289540+0000","last_active":"2024-09-17T01:36:12.866158+0000","last_peered":"2024-09-17T01:36:12.866158+0000","last_clean":"2024-09-17T01:36:12.866158+0000","last_became_active":"2024-09-17T01:36:10.289239+0000","last_became_peered":"2024-09-17T01:36:10.289239+0000","last_unstale":"2024-09-17T01:36:12.866158+0000","last_undegraded":"2024-09-17T01:36:12.866158+0000","last_fullsized":"2024-09-17T01:36:12.866158+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:41.502277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303227+0000","last_change":"2024-09-17T01:36:11.309355+0000","last_active":"2024-09-17T01:36:12.303227+0000","last_peered":"2024-09-17T01:36:12.303227+0000","last_clean":"2024-09-17T01:36:12.303227+0000","last_became_active":"2024-09-17T01:36:11.308670+0000","last_became_peered":"2024-09-17T01:36:11.308670+0000","last_unstale":"2024-09-17T01:36:12.303227+0000","last_undegraded":"2024-09-17T01:36:12.303227+0000","last_fullsized":"2024-09-17T01:36:12.303227+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:52:53.600454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T01:36:10.299909+0000","last_change":"2024-09-17T01:36:10.297976+0000","last_active":"2024-09-17T01:36:10.299909+0000","last_peered":"2024-09-17T01:36:10.299909+0000","last_clean":"2024-09-17T01:36:10.299909+0000","last_became_active":"2024-09-17T01:36:10.297673+0000","last_became_peered":"2024-09-17T01:36:10.297673+0000","last_unstale":"2024-09-17T01:36:10.299909+0000","last_undegraded":"2024-09-17T01:36:10.299909+0000","last_fullsized":"2024-09-17T01:36:10.299909+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:13:21.070126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304632+0000","last_change":"2024-09-17T01:36:11.300517+0000","last_active":"2024-09-17T01:36:12.304632+0000","last_peered":"2024-09-17T01:36:12.304632+0000","last_clean":"2024-09-17T01:36:12.304632+0000","last_became_active":"2024-09-17T01:36:11.300185+0000","last_became_peered":"2024-09-17T01:36:11.300185+0000","last_unstale":"2024-09-17T01:36:12.304632+0000","last_undegraded":"2024-09-17T01:36:12.304632+0000","last_fullsized":"2024-09-17T01:36:12.304632+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:56.615253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023327+0000","last_change":"2024-09-17T01:36:10.298497+0000","last_active":"2024-09-17T01:36:13.023327+0000","last_peered":"2024-09-17T01:36:13.023327+0000","last_clean":"2024-09-17T01:36:13.023327+0000","last_became_active":"2024-09-17T01:36:10.298121+0000","last_became_peered":"2024-09-17T01:36:10.298121+0000","last_unstale":"2024-09-17T01:36:13.023327+0000","last_undegraded":"2024-09-17T01:36:13.023327+0000","last_fullsized":"2024-09-17T01:36:13.023327+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:38.190524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992863+0000","last_change":"2024-09-17T01:36:11.321630+0000","last_active":"2024-09-17T01:36:12.992863+0000","last_peered":"2024-09-17T01:36:12.992863+0000","last_clean":"2024-09-17T01:36:12.992863+0000","last_became_active":"2024-09-17T01:36:11.321328+0000","last_became_peered":"2024-09-17T01:36:11.321328+0000","last_unstale":"2024-09-17T01:36:12.992863+0000","last_undegraded":"2024-09-17T01:36:12.992863+0000","last_fullsized":"2024-09-17T01:36:12.992863+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:39.391906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T01:36:10.300301+0000","last_change":"2024-09-17T01:36:10.296407+0000","last_active":"2024-09-17T01:36:10.300301+0000","last_peered":"2024-09-17T01:36:10.300301+0000","last_clean":"2024-09-17T01:36:10.300301+0000","last_became_active":"2024-09-17T01:36:10.296089+0000","last_became_peered":"2024-09-17T01:36:10.296089+0000","last_unstale":"2024-09-17T01:36:10.300301+0000","last_undegraded":"2024-09-17T01:36:10.300301+0000","last_fullsized":"2024-09-17T01:36:10.300301+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:04.809194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.302818+0000","last_change":"2024-09-17T01:36:11.310738+0000","last_active":"2024-09-17T01:36:12.302818+0000","last_peered":"2024-09-17T01:36:12.302818+0000","last_clean":"2024-09-17T01:36:12.302818+0000","last_became_active":"2024-09-17T01:36:11.310431+0000","last_became_peered":"2024-09-17T01:36:11.310431+0000","last_unstale":"2024-09-17T01:36:12.302818+0000","last_undegraded":"2024-09-17T01:36:12.302818+0000","last_fullsized":"2024-09-17T01:36:12.302818+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:54.749692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303734+0000","last_change":"2024-09-17T01:36:10.290312+0000","last_active":"2024-09-17T01:36:12.303734+0000","last_peered":"2024-09-17T01:36:12.303734+0000","last_clean":"2024-09-17T01:36:12.303734+0000","last_became_active":"2024-09-17T01:36:10.287956+0000","last_became_peered":"2024-09-17T01:36:10.287956+0000","last_unstale":"2024-09-17T01:36:12.303734+0000","last_undegraded":"2024-09-17T01:36:12.303734+0000","last_fullsized":"2024-09-17T01:36:12.303734+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:02.623172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023505+0000","last_change":"2024-09-17T01:36:11.319336+0000","last_active":"2024-09-17T01:36:13.023505+0000","last_peered":"2024-09-17T01:36:13.023505+0000","last_clean":"2024-09-17T01:36:13.023505+0000","last_became_active":"2024-09-17T01:36:11.319012+0000","last_became_peered":"2024-09-17T01:36:11.319012+0000","last_unstale":"2024-09-17T01:36:13.023505+0000","last_undegraded":"2024-09-17T01:36:13.023505+0000","last_fullsized":"2024-09-17T01:36:13.023505+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:23.186639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303218+0000","last_change":"2024-09-17T01:36:10.289718+0000","last_active":"2024-09-17T01:36:12.303218+0000","last_peered":"2024-09-17T01:36:12.303218+0000","last_clean":"2024-09-17T01:36:12.303218+0000","last_became_active":"2024-09-17T01:36:10.289409+0000","last_became_peered":"2024-09-17T01:36:10.289409+0000","last_unstale":"2024-09-17T01:36:12.303218+0000","last_undegraded":"2024-09-17T01:36:12.303218+0000","last_fullsized":"2024-09-17T01:36:12.303218+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:57.059026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304882+0000","last_change":"2024-09-17T01:36:11.309282+0000","last_active":"2024-09-17T01:36:12.304882+0000","last_peered":"2024-09-17T01:36:12.304882+0000","last_clean":"2024-09-17T01:36:12.304882+0000","last_became_active":"2024-09-17T01:36:11.308775+0000","last_became_peered":"2024-09-17T01:36:11.308775+0000","last_unstale":"2024-09-17T01:36:12.304882+0000","last_undegraded":"2024-09-17T01:36:12.304882+0000","last_fullsized":"2024-09-17T01:36:12.304882+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:20.099586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992452+0000","last_change":"2024-09-17T01:36:10.294227+0000","last_active":"2024-09-17T01:36:12.992452+0000","last_peered":"2024-09-17T01:36:12.992452+0000","last_clean":"2024-09-17T01:36:12.992452+0000","last_became_active":"2024-09-17T01:36:10.291395+0000","last_became_peered":"2024-09-17T01:36:10.291395+0000","last_unstale":"2024-09-17T01:36:12.992452+0000","last_undegraded":"2024-09-17T01:36:12.992452+0000","last_fullsized":"2024-09-17T01:36:12.992452+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:05.348862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":187,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.865857+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:36:12.865857+0000","last_peered":"2024-09-17T01:36:12.865857+0000","last_clean":"2024-09-17T01:36:12.865857+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:36:12.865857+0000","last_undegraded":"2024-09-17T01:36:12.865857+0000","last_fullsized":"2024-09-17T01:36:12.865857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476791,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":700416,"data_stored":290181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509495,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36076,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335764,"statfs":{"total":96636764160,"available":96599822336,"internally_reserved":0,"allocated":745472,"data_stored":309623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40232,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331608,"statfs":{"total":96636764160,"available":96595566592,"internally_reserved":0,"allocated":741376,"data_stored":309553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509495,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40236,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331604,"statfs":{"total":96636764160,"available":96595562496,"internally_reserved":0,"allocated":745472,"data_stored":310147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509495,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":309621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509494,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40812,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331028,"statfs":{"total":96636764160,"available":96594972672,"internally_reserved":0,"allocated":1335296,"data_stored":900481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509496,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36080,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335760,"statfs":{"total":96636764160,"available":96599818240,"internally_reserved":0,"allocated":749568,"data_stored":311143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542200,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40812,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331028,"statfs":{"total":96636764160,"available":96594972672,"internally_reserved":0,"allocated":1335296,"data_stored":899933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:36:16.787 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3d is not active+clean 2024-09-17T01:36:16.787 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:36:10.286381+0000', 'last_change': '2024-09-17T01:36:10.286381+0000', 'last_active': '2024-09-17T01:36:10.264668+0000', 'last_peered': '2024-09-17T01:36:10.264668+0000', 'last_clean': '2024-09-17T01:36:10.264668+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:36:10.286381+0000', 'last_undegraded': '2024-09-17T01:36:10.286381+0000', 'last_fullsized': '2024-09-17T01:36:10.286381+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'last_clean_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T01:36:16.787 INFO:tasks.ceph.ceph_manager.ceph:PG 9.32 is not active+clean 2024-09-17T01:36:16.787 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:36:10.285301+0000', 'last_change': '2024-09-17T01:36:10.285301+0000', 'last_active': '2024-09-17T01:36:10.264668+0000', 'last_peered': '2024-09-17T01:36:10.264668+0000', 'last_clean': '2024-09-17T01:36:10.264668+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:36:10.285301+0000', 'last_undegraded': '2024-09-17T01:36:10.285301+0000', 'last_fullsized': '2024-09-17T01:36:10.285301+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'last_clean_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T01:36:16.787 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2e is not active+clean 2024-09-17T01:36:16.787 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:36:10.278679+0000', 'last_change': '2024-09-17T01:36:10.278679+0000', 'last_active': '2024-09-17T01:36:10.264668+0000', 'last_peered': '2024-09-17T01:36:10.264668+0000', 'last_clean': '2024-09-17T01:36:10.264668+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:36:10.278679+0000', 'last_undegraded': '2024-09-17T01:36:10.278679+0000', 'last_fullsized': '2024-09-17T01:36:10.278679+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'last_clean_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T01:36:16.788 INFO:tasks.ceph.ceph_manager.ceph:PG 9.18 is not active+clean 2024-09-17T01:36:16.788 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:36:10.277116+0000', 'last_change': '2024-09-17T01:36:10.277116+0000', 'last_active': '2024-09-17T01:36:10.264668+0000', 'last_peered': '2024-09-17T01:36:10.264668+0000', 'last_clean': '2024-09-17T01:36:10.264668+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:36:10.277116+0000', 'last_undegraded': '2024-09-17T01:36:10.277116+0000', 'last_fullsized': '2024-09-17T01:36:10.277116+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'last_clean_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T01:36:16.788 INFO:tasks.ceph.ceph_manager.ceph:PG 9.17 is not active+clean 2024-09-17T01:36:16.788 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:36:10.285012+0000', 'last_change': '2024-09-17T01:36:10.285012+0000', 'last_active': '2024-09-17T01:36:10.264668+0000', 'last_peered': '2024-09-17T01:36:10.264668+0000', 'last_clean': '2024-09-17T01:36:10.264668+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:36:10.285012+0000', 'last_undegraded': '2024-09-17T01:36:10.285012+0000', 'last_fullsized': '2024-09-17T01:36:10.285012+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'last_clean_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T01:36:16.788 INFO:tasks.ceph.ceph_manager.ceph:PG 9.13 is not active+clean 2024-09-17T01:36:16.788 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:36:10.282960+0000', 'last_change': '2024-09-17T01:36:10.282960+0000', 'last_active': '2024-09-17T01:36:10.264668+0000', 'last_peered': '2024-09-17T01:36:10.264668+0000', 'last_clean': '2024-09-17T01:36:10.264668+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:36:10.282960+0000', 'last_undegraded': '2024-09-17T01:36:10.282960+0000', 'last_fullsized': '2024-09-17T01:36:10.282960+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'last_clean_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T01:36:16.788 INFO:tasks.ceph.ceph_manager.ceph:PG 9.e is not active+clean 2024-09-17T01:36:16.788 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:36:10.278156+0000', 'last_change': '2024-09-17T01:36:10.278156+0000', 'last_active': '2024-09-17T01:36:10.264668+0000', 'last_peered': '2024-09-17T01:36:10.264668+0000', 'last_clean': '2024-09-17T01:36:10.264668+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:36:10.278156+0000', 'last_undegraded': '2024-09-17T01:36:10.278156+0000', 'last_fullsized': '2024-09-17T01:36:10.278156+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'last_clean_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T01:36:16.788 INFO:tasks.ceph.ceph_manager.ceph:PG 9.f is not active+clean 2024-09-17T01:36:16.788 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:36:10.284537+0000', 'last_change': '2024-09-17T01:36:10.284537+0000', 'last_active': '2024-09-17T01:36:10.264668+0000', 'last_peered': '2024-09-17T01:36:10.264668+0000', 'last_clean': '2024-09-17T01:36:10.264668+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:36:10.284537+0000', 'last_undegraded': '2024-09-17T01:36:10.284537+0000', 'last_fullsized': '2024-09-17T01:36:10.284537+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'last_clean_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T01:36:16.788 INFO:tasks.ceph.ceph_manager.ceph:PG 9.6 is not active+clean 2024-09-17T01:36:16.789 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:36:10.277627+0000', 'last_change': '2024-09-17T01:36:10.277627+0000', 'last_active': '2024-09-17T01:36:10.264668+0000', 'last_peered': '2024-09-17T01:36:10.264668+0000', 'last_clean': '2024-09-17T01:36:10.264668+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:36:10.277627+0000', 'last_undegraded': '2024-09-17T01:36:10.277627+0000', 'last_fullsized': '2024-09-17T01:36:10.277627+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'last_clean_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T01:36:16.789 INFO:tasks.ceph.ceph_manager.ceph:PG 9.7 is not active+clean 2024-09-17T01:36:16.789 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 60, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:36:10.277174+0000', 'last_change': '2024-09-17T01:36:10.277174+0000', 'last_active': '2024-09-17T01:36:10.264668+0000', 'last_peered': '2024-09-17T01:36:10.264668+0000', 'last_clean': '2024-09-17T01:36:10.264668+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:36:10.277174+0000', 'last_undegraded': '2024-09-17T01:36:10.277174+0000', 'last_fullsized': '2024-09-17T01:36:10.277174+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'last_clean_scrub_stamp': '2024-09-17T01:36:10.264668+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T01:36:16.789 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:36:17.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.052+0000 7fd3b7e00640 1 -- 172.21.15.42:0/2144445185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3b806d430 msgr2=0x7fd3b8152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:17.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.052+0000 7fd3b7e00640 1 --2- 172.21.15.42:0/2144445185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3b806d430 0x7fd3b8152ed0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0005fd0 tx=0x7fd3b002a5d0 comp rx=0 tx=0).stop 2024-09-17T01:36:17.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.052+0000 7fd3b7e00640 1 -- 172.21.15.42:0/2144445185 shutdown_connections 2024-09-17T01:36:17.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.052+0000 7fd3b7e00640 1 --2- 172.21.15.42:0/2144445185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3b806d430 0x7fd3b8152ed0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:17.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.052+0000 7fd3b7e00640 1 --2- 172.21.15.42:0/2144445185 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3b80b4be0 0x7fd3b815d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:17.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.052+0000 7fd3b7e00640 1 -- 172.21.15.42:0/2144445185 >> 172.21.15.42:0/2144445185 conn(0x7fd3b80b25f0 msgr2=0x7fd3b80d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:17.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.052+0000 7fd3b7e00640 1 -- 172.21.15.42:0/2144445185 shutdown_connections 2024-09-17T01:36:17.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.052+0000 7fd3b7e00640 1 -- 172.21.15.42:0/2144445185 wait complete. 2024-09-17T01:36:17.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.054+0000 7fd3b7e00640 1 Processor -- start 2024-09-17T01:36:17.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.054+0000 7fd3b7e00640 1 -- start start 2024-09-17T01:36:17.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.056+0000 7fd3b7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3b80b4be0 0x7fd3b81f8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:17.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.056+0000 7fd3b7e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3b80cf7c0 0x7fd3b8148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:17.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.056+0000 7fd3b7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3b8074d70 0x7fd3b80ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:17.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.056+0000 7fd3b7e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b8153850 con 0x7fd3b80b4be0 2024-09-17T01:36:17.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.056+0000 7fd3b7e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b81536d0 con 0x7fd3b8074d70 2024-09-17T01:36:17.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.056+0000 7fd3b7e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd3b81539d0 con 0x7fd3b80cf7c0 2024-09-17T01:36:17.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.056+0000 7fd3b6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3b80b4be0 0x7fd3b81f8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:17.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.056+0000 7fd3b6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3b80b4be0 0x7fd3b81f8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51986/0 (socket says 172.21.15.42:51986) 2024-09-17T01:36:17.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.056+0000 7fd3b6a00640 1 -- 172.21.15.42:0/3451935663 learned_addr learned my addr 172.21.15.42:0/3451935663 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:17.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.056+0000 7fd3ae000640 1 --2- 172.21.15.42:0/3451935663 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3b80cf7c0 0x7fd3b8148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:17.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.056+0000 7fd3b7400640 1 --2- 172.21.15.42:0/3451935663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3b8074d70 0x7fd3b80ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:17.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.057+0000 7fd3b6a00640 1 -- 172.21.15.42:0/3451935663 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3b80cf7c0 msgr2=0x7fd3b8148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:17.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.057+0000 7fd3b6a00640 1 --2- 172.21.15.42:0/3451935663 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3b80cf7c0 0x7fd3b8148a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:17.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.057+0000 7fd3b6a00640 1 -- 172.21.15.42:0/3451935663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3b8074d70 msgr2=0x7fd3b80ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:17.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.057+0000 7fd3b6a00640 1 --2- 172.21.15.42:0/3451935663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3b8074d70 0x7fd3b80ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:17.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.057+0000 7fd3b6a00640 1 -- 172.21.15.42:0/3451935663 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b8148f70 con 0x7fd3b80b4be0 2024-09-17T01:36:17.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.057+0000 7fd3b6a00640 1 --2- 172.21.15.42:0/3451935663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3b80b4be0 0x7fd3b81f8a60 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800ea20 tx=0x7fd3a800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:17.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.058+0000 7fd3afe00640 1 -- 172.21.15.42:0/3451935663 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a800cde0 con 0x7fd3b80b4be0 2024-09-17T01:36:17.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.058+0000 7fd3afe00640 1 -- 172.21.15.42:0/3451935663 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3a8011560 con 0x7fd3b80b4be0 2024-09-17T01:36:17.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.058+0000 7fd3afe00640 1 -- 172.21.15.42:0/3451935663 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8011990 con 0x7fd3b80b4be0 2024-09-17T01:36:17.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.058+0000 7fd3b7e00640 1 -- 172.21.15.42:0/3451935663 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3b81f93b0 con 0x7fd3b80b4be0 2024-09-17T01:36:17.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.058+0000 7fd3b7e00640 1 -- 172.21.15.42:0/3451935663 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3b8073240 con 0x7fd3b80b4be0 2024-09-17T01:36:17.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.059+0000 7fd3b7e00640 1 -- 172.21.15.42:0/3451935663 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3b81f98d0 con 0x7fd3b80b4be0 2024-09-17T01:36:17.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.060+0000 7fd3afe00640 1 -- 172.21.15.42:0/3451935663 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd3a8011b30 con 0x7fd3b80b4be0 2024-09-17T01:36:17.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.062+0000 7fd3afe00640 1 --2- 172.21.15.42:0/3451935663 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd394078b90 0x7fd39407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:17.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.062+0000 7fd3afe00640 1 -- 172.21.15.42:0/3451935663 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7fd3a809b840 con 0x7fd3b80b4be0 2024-09-17T01:36:17.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.062+0000 7fd3ae000640 1 --2- 172.21.15.42:0/3451935663 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd394078b90 0x7fd39407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:17.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.063+0000 7fd3ae000640 1 --2- 172.21.15.42:0/3451935663 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd394078b90 0x7fd39407b0a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8152000 tx=0x7fd3a0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:17.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.067+0000 7fd3afe00640 1 -- 172.21.15.42:0/3451935663 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd3b81f98d0 con 0x7fd3b80b4be0 2024-09-17T01:36:17.263 INFO:tasks.ceph.mds.c.smithi042.stderr:2024-09-17T01:36:17.265+0000 7f3b8e600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:36:17.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.337+0000 7fd3b7e00640 1 -- 172.21.15.42:0/3451935663 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd3b8152ed0 con 0x7fd3b80b4be0 2024-09-17T01:36:17.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.338+0000 7fd3afe00640 1 -- 172.21.15.42:0/3451935663 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1217 (secure 0 0 0) 0x7fd3a8016030 con 0x7fd3b80b4be0 2024-09-17T01:36:17.336 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:17.336 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":277,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":62,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":296730624,"bytes_avail":772797382656,"bytes_total":773094113280,"write_bytes_sec":2115,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":41,"btime":"2024-09-17T01:36:14:305356+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":6195}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":15,"modified":"2024-09-17T01:36:03.043290+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:36:17.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.340+0000 7fd3b7e00640 1 -- 172.21.15.42:0/3451935663 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd394078b90 msgr2=0x7fd39407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:17.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.340+0000 7fd3b7e00640 1 --2- 172.21.15.42:0/3451935663 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd394078b90 0x7fd39407b0a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8152000 tx=0x7fd3a0009040 comp rx=0 tx=0).stop 2024-09-17T01:36:17.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.340+0000 7fd3b7e00640 1 -- 172.21.15.42:0/3451935663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3b80b4be0 msgr2=0x7fd3b81f8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:17.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.340+0000 7fd3b7e00640 1 --2- 172.21.15.42:0/3451935663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3b80b4be0 0x7fd3b81f8a60 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800ea20 tx=0x7fd3a800eee0 comp rx=0 tx=0).stop 2024-09-17T01:36:17.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.340+0000 7fd3b7e00640 1 -- 172.21.15.42:0/3451935663 shutdown_connections 2024-09-17T01:36:17.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.340+0000 7fd3b7e00640 1 --2- 172.21.15.42:0/3451935663 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd394078b90 0x7fd39407b0a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:17.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.340+0000 7fd3b7e00640 1 --2- 172.21.15.42:0/3451935663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3b8074d70 0x7fd3b80ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:17.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.340+0000 7fd3b7e00640 1 --2- 172.21.15.42:0/3451935663 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3b80cf7c0 0x7fd3b8148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:17.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.340+0000 7fd3b7e00640 1 --2- 172.21.15.42:0/3451935663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3b80b4be0 0x7fd3b81f8a60 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:17.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.340+0000 7fd3b7e00640 1 -- 172.21.15.42:0/3451935663 >> 172.21.15.42:0/3451935663 conn(0x7fd3b80b25f0 msgr2=0x7fd3b80afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:17.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.340+0000 7fd3b7e00640 1 -- 172.21.15.42:0/3451935663 shutdown_connections 2024-09-17T01:36:17.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.340+0000 7fd3b7e00640 1 -- 172.21.15.42:0/3451935663 wait complete. 2024-09-17T01:36:17.360 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T01:36:17.360 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:36:17.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.589+0000 7f7361600640 1 -- 172.21.15.42:0/2618740491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f735c0ccd80 msgr2=0x7f735c0ce2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:17.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.589+0000 7f7361600640 1 --2- 172.21.15.42:0/2618740491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f735c0ccd80 0x7f735c0ce2e0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f734c009830 tx=0x7f734c02a5c0 comp rx=0 tx=0).stop 2024-09-17T01:36:17.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.589+0000 7f7361600640 1 -- 172.21.15.42:0/2618740491 shutdown_connections 2024-09-17T01:36:17.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.589+0000 7f7361600640 1 --2- 172.21.15.42:0/2618740491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f735c0ccd80 0x7f735c0ce2e0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:17.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.589+0000 7f7361600640 1 -- 172.21.15.42:0/2618740491 >> 172.21.15.42:0/2618740491 conn(0x7f735c0b3ed0 msgr2=0x7f735c0b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:17.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.589+0000 7f7361600640 1 -- 172.21.15.42:0/2618740491 shutdown_connections 2024-09-17T01:36:17.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.589+0000 7f7361600640 1 -- 172.21.15.42:0/2618740491 wait complete. 2024-09-17T01:36:17.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.591+0000 7f7361600640 1 Processor -- start 2024-09-17T01:36:17.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.591+0000 7f7361600640 1 -- start start 2024-09-17T01:36:17.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.593+0000 7f7361600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f735c0b7610 0x7f735c1575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:17.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.593+0000 7f7361600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f735c0b7b80 0x7f735c144f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:17.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.593+0000 7f7361600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f735c1470d0 0x7f735c1454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:17.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.593+0000 7f7361600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f735c0cf6a0 con 0x7f735c0b7b80 2024-09-17T01:36:17.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.593+0000 7f7361600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f735c0cf820 con 0x7f735c1470d0 2024-09-17T01:36:17.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.593+0000 7f7361600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f735c0cf9a0 con 0x7f735c0b7610 2024-09-17T01:36:17.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.593+0000 7f7353e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f735c0b7b80 0x7f735c144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:17.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.593+0000 7f7353e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f735c0b7b80 0x7f735c144f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52000/0 (socket says 172.21.15.42:52000) 2024-09-17T01:36:17.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.593+0000 7f7353e00640 1 -- 172.21.15.42:0/176442126 learned_addr learned my addr 172.21.15.42:0/176442126 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:17.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.594+0000 7f735be00640 1 --2- 172.21.15.42:0/176442126 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f735c0b7610 0x7f735c1575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:17.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.594+0000 7f7360c00640 1 --2- 172.21.15.42:0/176442126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f735c1470d0 0x7f735c1454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:17.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.594+0000 7f7353e00640 1 -- 172.21.15.42:0/176442126 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f735c0b7610 msgr2=0x7f735c1575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:17.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.594+0000 7f7353e00640 1 --2- 172.21.15.42:0/176442126 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f735c0b7610 0x7f735c1575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:17.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.594+0000 7f7353e00640 1 -- 172.21.15.42:0/176442126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f735c1470d0 msgr2=0x7f735c1454a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:17.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.594+0000 7f7353e00640 1 --2- 172.21.15.42:0/176442126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f735c1470d0 0x7f735c1454a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:17.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.594+0000 7f7353e00640 1 -- 172.21.15.42:0/176442126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f735c157b00 con 0x7f735c0b7b80 2024-09-17T01:36:17.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.594+0000 7f735be00640 1 --2- 172.21.15.42:0/176442126 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f735c0b7610 0x7f735c1575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:36:17.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.594+0000 7f7360c00640 1 --2- 172.21.15.42:0/176442126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f735c1470d0 0x7f735c1454a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:36:17.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.594+0000 7f7353e00640 1 --2- 172.21.15.42:0/176442126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f735c0b7b80 0x7f735c144f60 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f734400c3f0 tx=0x7f734400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:17.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.594+0000 7f7358c00640 1 -- 172.21.15.42:0/176442126 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7344017070 con 0x7f735c0b7b80 2024-09-17T01:36:17.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.594+0000 7f7358c00640 1 -- 172.21.15.42:0/176442126 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73440035f0 con 0x7f735c0b7b80 2024-09-17T01:36:17.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.594+0000 7f7358c00640 1 -- 172.21.15.42:0/176442126 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7344003a40 con 0x7f735c0b7b80 2024-09-17T01:36:17.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.594+0000 7f7361600640 1 -- 172.21.15.42:0/176442126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f735c143ec0 con 0x7f735c0b7b80 2024-09-17T01:36:17.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.594+0000 7f7361600640 1 -- 172.21.15.42:0/176442126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f735c144480 con 0x7f735c0b7b80 2024-09-17T01:36:17.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.595+0000 7f7361600640 1 -- 172.21.15.42:0/176442126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f735c075cf0 con 0x7f735c0b7b80 2024-09-17T01:36:17.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.597+0000 7f7358c00640 1 -- 172.21.15.42:0/176442126 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f734401a070 con 0x7f735c0b7b80 2024-09-17T01:36:17.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.598+0000 7f7358c00640 1 --2- 172.21.15.42:0/176442126 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7338078bc0 0x7f733807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:17.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.598+0000 7f7358c00640 1 -- 172.21.15.42:0/176442126 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f734409a2e0 con 0x7f735c0b7b80 2024-09-17T01:36:17.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.599+0000 7f735be00640 1 --2- 172.21.15.42:0/176442126 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7338078bc0 0x7f733807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:17.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.599+0000 7f735be00640 1 --2- 172.21.15.42:0/176442126 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7338078bc0 0x7f733807b0d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f734c034000 tx=0x7f734c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:17.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.601+0000 7f7358c00640 1 -- 172.21.15.42:0/176442126 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f735c075cf0 con 0x7f735c0b7b80 2024-09-17T01:36:17.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.793+0000 7f7361600640 1 -- 172.21.15.42:0/176442126 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f735c1459e0 con 0x7f7338078bc0 2024-09-17T01:36:17.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.798+0000 7f7358c00640 1 -- 172.21.15.42:0/176442126 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7f734c0043b0 con 0x7f7338078bc0 2024-09-17T01:36:17.798 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:17.799 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:36:17.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.802+0000 7f7361600640 1 -- 172.21.15.42:0/176442126 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7338078bc0 msgr2=0x7f733807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:17.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.802+0000 7f7361600640 1 --2- 172.21.15.42:0/176442126 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7338078bc0 0x7f733807b0d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f734c034000 tx=0x7f734c004730 comp rx=0 tx=0).stop 2024-09-17T01:36:17.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.802+0000 7f7361600640 1 -- 172.21.15.42:0/176442126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f735c0b7b80 msgr2=0x7f735c144f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:17.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.802+0000 7f7361600640 1 --2- 172.21.15.42:0/176442126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f735c0b7b80 0x7f735c144f60 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f734400c3f0 tx=0x7f734400c8b0 comp rx=0 tx=0).stop 2024-09-17T01:36:17.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.802+0000 7f7361600640 1 -- 172.21.15.42:0/176442126 shutdown_connections 2024-09-17T01:36:17.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.802+0000 7f7361600640 1 --2- 172.21.15.42:0/176442126 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7338078bc0 0x7f733807b0d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:17.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.802+0000 7f7361600640 1 --2- 172.21.15.42:0/176442126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f735c1470d0 0x7f735c1454a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:17.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.802+0000 7f7361600640 1 --2- 172.21.15.42:0/176442126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f735c0b7b80 0x7f735c144f60 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:17.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.802+0000 7f7361600640 1 --2- 172.21.15.42:0/176442126 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f735c0b7610 0x7f735c1575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:17.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.802+0000 7f7361600640 1 -- 172.21.15.42:0/176442126 >> 172.21.15.42:0/176442126 conn(0x7f735c0b3ed0 msgr2=0x7f735c15b480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:17.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.802+0000 7f7361600640 1 -- 172.21.15.42:0/176442126 shutdown_connections 2024-09-17T01:36:17.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:17.802+0000 7f7361600640 1 -- 172.21.15.42:0/176442126 wait complete. 2024-09-17T01:36:17.824 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":187,"stamp":"2024-09-17T01:36:17.047086+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289776,"kb_used_data":6984,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754684944,"statfs":{"total":773094113280,"available":772797382656,"internally_reserved":0,"allocated":7151616,"data_stored":3661804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":289394228},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.777868"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304704+0000","last_change":"2024-09-17T01:36:11.317189+0000","last_active":"2024-09-17T01:36:12.304704+0000","last_peered":"2024-09-17T01:36:12.304704+0000","last_clean":"2024-09-17T01:36:12.304704+0000","last_became_active":"2024-09-17T01:36:11.316776+0000","last_became_peered":"2024-09-17T01:36:11.316776+0000","last_unstale":"2024-09-17T01:36:12.304704+0000","last_undegraded":"2024-09-17T01:36:12.304704+0000","last_fullsized":"2024-09-17T01:36:12.304704+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:35.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023723+0000","last_change":"2024-09-17T01:36:11.325731+0000","last_active":"2024-09-17T01:36:13.023723+0000","last_peered":"2024-09-17T01:36:13.023723+0000","last_clean":"2024-09-17T01:36:13.023723+0000","last_became_active":"2024-09-17T01:36:11.325325+0000","last_became_peered":"2024-09-17T01:36:11.325325+0000","last_unstale":"2024-09-17T01:36:13.023723+0000","last_undegraded":"2024-09-17T01:36:13.023723+0000","last_fullsized":"2024-09-17T01:36:13.023723+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:12.067713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301489+0000","last_change":"2024-09-17T01:36:11.306785+0000","last_active":"2024-09-17T01:36:12.301489+0000","last_peered":"2024-09-17T01:36:12.301489+0000","last_clean":"2024-09-17T01:36:12.301489+0000","last_became_active":"2024-09-17T01:36:11.305122+0000","last_became_peered":"2024-09-17T01:36:11.305122+0000","last_unstale":"2024-09-17T01:36:12.301489+0000","last_undegraded":"2024-09-17T01:36:12.301489+0000","last_fullsized":"2024-09-17T01:36:12.301489+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:19.634502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076816+0000","last_change":"2024-09-17T01:36:11.319236+0000","last_active":"2024-09-17T01:36:13.076816+0000","last_peered":"2024-09-17T01:36:13.076816+0000","last_clean":"2024-09-17T01:36:13.076816+0000","last_became_active":"2024-09-17T01:36:11.318786+0000","last_became_peered":"2024-09-17T01:36:11.318786+0000","last_unstale":"2024-09-17T01:36:13.076816+0000","last_undegraded":"2024-09-17T01:36:13.076816+0000","last_fullsized":"2024-09-17T01:36:13.076816+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:56:37.137202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304383+0000","last_change":"2024-09-17T01:36:11.295952+0000","last_active":"2024-09-17T01:36:12.304383+0000","last_peered":"2024-09-17T01:36:12.304383+0000","last_clean":"2024-09-17T01:36:12.304383+0000","last_became_active":"2024-09-17T01:36:11.295523+0000","last_became_peered":"2024-09-17T01:36:11.295523+0000","last_unstale":"2024-09-17T01:36:12.304383+0000","last_undegraded":"2024-09-17T01:36:12.304383+0000","last_fullsized":"2024-09-17T01:36:12.304383+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:08.202105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304321+0000","last_change":"2024-09-17T01:36:11.303156+0000","last_active":"2024-09-17T01:36:12.304321+0000","last_peered":"2024-09-17T01:36:12.304321+0000","last_clean":"2024-09-17T01:36:12.304321+0000","last_became_active":"2024-09-17T01:36:11.302790+0000","last_became_peered":"2024-09-17T01:36:11.302790+0000","last_unstale":"2024-09-17T01:36:12.304321+0000","last_undegraded":"2024-09-17T01:36:12.304321+0000","last_fullsized":"2024-09-17T01:36:12.304321+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:30.181703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076553+0000","last_change":"2024-09-17T01:36:11.293632+0000","last_active":"2024-09-17T01:36:13.076553+0000","last_peered":"2024-09-17T01:36:13.076553+0000","last_clean":"2024-09-17T01:36:13.076553+0000","last_became_active":"2024-09-17T01:36:11.293324+0000","last_became_peered":"2024-09-17T01:36:11.293324+0000","last_unstale":"2024-09-17T01:36:13.076553+0000","last_undegraded":"2024-09-17T01:36:13.076553+0000","last_fullsized":"2024-09-17T01:36:13.076553+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:51.396274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.302970+0000","last_change":"2024-09-17T01:36:11.317048+0000","last_active":"2024-09-17T01:36:12.302970+0000","last_peered":"2024-09-17T01:36:12.302970+0000","last_clean":"2024-09-17T01:36:12.302970+0000","last_became_active":"2024-09-17T01:36:11.315266+0000","last_became_peered":"2024-09-17T01:36:11.315266+0000","last_unstale":"2024-09-17T01:36:12.302970+0000","last_undegraded":"2024-09-17T01:36:12.302970+0000","last_fullsized":"2024-09-17T01:36:12.302970+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:17.967682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866481+0000","last_change":"2024-09-17T01:36:11.303422+0000","last_active":"2024-09-17T01:36:12.866481+0000","last_peered":"2024-09-17T01:36:12.866481+0000","last_clean":"2024-09-17T01:36:12.866481+0000","last_became_active":"2024-09-17T01:36:11.303095+0000","last_became_peered":"2024-09-17T01:36:11.303095+0000","last_unstale":"2024-09-17T01:36:12.866481+0000","last_undegraded":"2024-09-17T01:36:12.866481+0000","last_fullsized":"2024-09-17T01:36:12.866481+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:06.849909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304675+0000","last_change":"2024-09-17T01:36:11.311252+0000","last_active":"2024-09-17T01:36:12.304675+0000","last_peered":"2024-09-17T01:36:12.304675+0000","last_clean":"2024-09-17T01:36:12.304675+0000","last_became_active":"2024-09-17T01:36:11.304478+0000","last_became_peered":"2024-09-17T01:36:11.304478+0000","last_unstale":"2024-09-17T01:36:12.304675+0000","last_undegraded":"2024-09-17T01:36:12.304675+0000","last_fullsized":"2024-09-17T01:36:12.304675+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:24.361465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925132+0000","last_change":"2024-09-17T01:36:11.315637+0000","last_active":"2024-09-17T01:36:12.925132+0000","last_peered":"2024-09-17T01:36:12.925132+0000","last_clean":"2024-09-17T01:36:12.925132+0000","last_became_active":"2024-09-17T01:36:11.314795+0000","last_became_peered":"2024-09-17T01:36:11.314795+0000","last_unstale":"2024-09-17T01:36:12.925132+0000","last_undegraded":"2024-09-17T01:36:12.925132+0000","last_fullsized":"2024-09-17T01:36:12.925132+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:18.981223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866361+0000","last_change":"2024-09-17T01:36:11.313898+0000","last_active":"2024-09-17T01:36:12.866361+0000","last_peered":"2024-09-17T01:36:12.866361+0000","last_clean":"2024-09-17T01:36:12.866361+0000","last_became_active":"2024-09-17T01:36:11.313556+0000","last_became_peered":"2024-09-17T01:36:11.313556+0000","last_unstale":"2024-09-17T01:36:12.866361+0000","last_undegraded":"2024-09-17T01:36:12.866361+0000","last_fullsized":"2024-09-17T01:36:12.866361+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:22:02.980623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992700+0000","last_change":"2024-09-17T01:36:11.308618+0000","last_active":"2024-09-17T01:36:12.992700+0000","last_peered":"2024-09-17T01:36:12.992700+0000","last_clean":"2024-09-17T01:36:12.992700+0000","last_became_active":"2024-09-17T01:36:11.308319+0000","last_became_peered":"2024-09-17T01:36:11.308319+0000","last_unstale":"2024-09-17T01:36:12.992700+0000","last_undegraded":"2024-09-17T01:36:12.992700+0000","last_fullsized":"2024-09-17T01:36:12.992700+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:34.276355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.300991+0000","last_change":"2024-09-17T01:36:11.326823+0000","last_active":"2024-09-17T01:36:12.300991+0000","last_peered":"2024-09-17T01:36:12.300991+0000","last_clean":"2024-09-17T01:36:12.300991+0000","last_became_active":"2024-09-17T01:36:11.326477+0000","last_became_peered":"2024-09-17T01:36:11.326477+0000","last_unstale":"2024-09-17T01:36:12.300991+0000","last_undegraded":"2024-09-17T01:36:12.300991+0000","last_fullsized":"2024-09-17T01:36:12.300991+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:55:12.981794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992453+0000","last_change":"2024-09-17T01:36:11.318165+0000","last_active":"2024-09-17T01:36:12.992453+0000","last_peered":"2024-09-17T01:36:12.992453+0000","last_clean":"2024-09-17T01:36:12.992453+0000","last_became_active":"2024-09-17T01:36:11.317875+0000","last_became_peered":"2024-09-17T01:36:11.317875+0000","last_unstale":"2024-09-17T01:36:12.992453+0000","last_undegraded":"2024-09-17T01:36:12.992453+0000","last_fullsized":"2024-09-17T01:36:12.992453+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:00.765527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303951+0000","last_change":"2024-09-17T01:36:11.297004+0000","last_active":"2024-09-17T01:36:12.303951+0000","last_peered":"2024-09-17T01:36:12.303951+0000","last_clean":"2024-09-17T01:36:12.303951+0000","last_became_active":"2024-09-17T01:36:11.296661+0000","last_became_peered":"2024-09-17T01:36:11.296661+0000","last_unstale":"2024-09-17T01:36:12.303951+0000","last_undegraded":"2024-09-17T01:36:12.303951+0000","last_fullsized":"2024-09-17T01:36:12.303951+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:18.099170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305020+0000","last_change":"2024-09-17T01:36:11.303184+0000","last_active":"2024-09-17T01:36:12.305020+0000","last_peered":"2024-09-17T01:36:12.305020+0000","last_clean":"2024-09-17T01:36:12.305020+0000","last_became_active":"2024-09-17T01:36:11.302826+0000","last_became_peered":"2024-09-17T01:36:11.302826+0000","last_unstale":"2024-09-17T01:36:12.305020+0000","last_undegraded":"2024-09-17T01:36:12.305020+0000","last_fullsized":"2024-09-17T01:36:12.305020+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:59.362677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301563+0000","last_change":"2024-09-17T01:36:11.313129+0000","last_active":"2024-09-17T01:36:12.301563+0000","last_peered":"2024-09-17T01:36:12.301563+0000","last_clean":"2024-09-17T01:36:12.301563+0000","last_became_active":"2024-09-17T01:36:11.312821+0000","last_became_peered":"2024-09-17T01:36:11.312821+0000","last_unstale":"2024-09-17T01:36:12.301563+0000","last_undegraded":"2024-09-17T01:36:12.301563+0000","last_fullsized":"2024-09-17T01:36:12.301563+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:14.012926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023564+0000","last_change":"2024-09-17T01:36:11.323204+0000","last_active":"2024-09-17T01:36:13.023564+0000","last_peered":"2024-09-17T01:36:13.023564+0000","last_clean":"2024-09-17T01:36:13.023564+0000","last_became_active":"2024-09-17T01:36:11.322063+0000","last_became_peered":"2024-09-17T01:36:11.322063+0000","last_unstale":"2024-09-17T01:36:13.023564+0000","last_undegraded":"2024-09-17T01:36:13.023564+0000","last_fullsized":"2024-09-17T01:36:13.023564+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:11.122810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925263+0000","last_change":"2024-09-17T01:36:11.315695+0000","last_active":"2024-09-17T01:36:12.925263+0000","last_peered":"2024-09-17T01:36:12.925263+0000","last_clean":"2024-09-17T01:36:12.925263+0000","last_became_active":"2024-09-17T01:36:11.315143+0000","last_became_peered":"2024-09-17T01:36:11.315143+0000","last_unstale":"2024-09-17T01:36:12.925263+0000","last_undegraded":"2024-09-17T01:36:12.925263+0000","last_fullsized":"2024-09-17T01:36:12.925263+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:35.194646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992684+0000","last_change":"2024-09-17T01:36:11.323619+0000","last_active":"2024-09-17T01:36:12.992684+0000","last_peered":"2024-09-17T01:36:12.992684+0000","last_clean":"2024-09-17T01:36:12.992684+0000","last_became_active":"2024-09-17T01:36:11.323346+0000","last_became_peered":"2024-09-17T01:36:11.323346+0000","last_unstale":"2024-09-17T01:36:12.992684+0000","last_undegraded":"2024-09-17T01:36:12.992684+0000","last_fullsized":"2024-09-17T01:36:12.992684+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:08.202105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925295+0000","last_change":"2024-09-17T01:36:11.305911+0000","last_active":"2024-09-17T01:36:12.925295+0000","last_peered":"2024-09-17T01:36:12.925295+0000","last_clean":"2024-09-17T01:36:12.925295+0000","last_became_active":"2024-09-17T01:36:11.305567+0000","last_became_peered":"2024-09-17T01:36:11.305567+0000","last_unstale":"2024-09-17T01:36:12.925295+0000","last_undegraded":"2024-09-17T01:36:12.925295+0000","last_fullsized":"2024-09-17T01:36:12.925295+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:07.419500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076616+0000","last_change":"2024-09-17T01:36:11.310245+0000","last_active":"2024-09-17T01:36:13.076616+0000","last_peered":"2024-09-17T01:36:13.076616+0000","last_clean":"2024-09-17T01:36:13.076616+0000","last_became_active":"2024-09-17T01:36:11.309949+0000","last_became_peered":"2024-09-17T01:36:11.309949+0000","last_unstale":"2024-09-17T01:36:13.076616+0000","last_undegraded":"2024-09-17T01:36:13.076616+0000","last_fullsized":"2024-09-17T01:36:13.076616+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:42.594893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866214+0000","last_change":"2024-09-17T01:36:11.318149+0000","last_active":"2024-09-17T01:36:12.866214+0000","last_peered":"2024-09-17T01:36:12.866214+0000","last_clean":"2024-09-17T01:36:12.866214+0000","last_became_active":"2024-09-17T01:36:11.317798+0000","last_became_peered":"2024-09-17T01:36:11.317798+0000","last_unstale":"2024-09-17T01:36:12.866214+0000","last_undegraded":"2024-09-17T01:36:12.866214+0000","last_fullsized":"2024-09-17T01:36:12.866214+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:52.367069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023788+0000","last_change":"2024-09-17T01:36:11.325158+0000","last_active":"2024-09-17T01:36:13.023788+0000","last_peered":"2024-09-17T01:36:13.023788+0000","last_clean":"2024-09-17T01:36:13.023788+0000","last_became_active":"2024-09-17T01:36:11.323928+0000","last_became_peered":"2024-09-17T01:36:11.323928+0000","last_unstale":"2024-09-17T01:36:13.023788+0000","last_undegraded":"2024-09-17T01:36:13.023788+0000","last_fullsized":"2024-09-17T01:36:13.023788+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:26.441833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.993007+0000","last_change":"2024-09-17T01:36:11.314300+0000","last_active":"2024-09-17T01:36:12.993007+0000","last_peered":"2024-09-17T01:36:12.993007+0000","last_clean":"2024-09-17T01:36:12.993007+0000","last_became_active":"2024-09-17T01:36:11.313197+0000","last_became_peered":"2024-09-17T01:36:11.313197+0000","last_unstale":"2024-09-17T01:36:12.993007+0000","last_undegraded":"2024-09-17T01:36:12.993007+0000","last_fullsized":"2024-09-17T01:36:12.993007+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:24.449150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023920+0000","last_change":"2024-09-17T01:36:11.318641+0000","last_active":"2024-09-17T01:36:13.023920+0000","last_peered":"2024-09-17T01:36:13.023920+0000","last_clean":"2024-09-17T01:36:13.023920+0000","last_became_active":"2024-09-17T01:36:11.317933+0000","last_became_peered":"2024-09-17T01:36:11.317933+0000","last_unstale":"2024-09-17T01:36:13.023920+0000","last_undegraded":"2024-09-17T01:36:13.023920+0000","last_fullsized":"2024-09-17T01:36:13.023920+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:07:47.466557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303627+0000","last_change":"2024-09-17T01:36:11.317931+0000","last_active":"2024-09-17T01:36:12.303627+0000","last_peered":"2024-09-17T01:36:12.303627+0000","last_clean":"2024-09-17T01:36:12.303627+0000","last_became_active":"2024-09-17T01:36:11.310928+0000","last_became_peered":"2024-09-17T01:36:11.310928+0000","last_unstale":"2024-09-17T01:36:12.303627+0000","last_undegraded":"2024-09-17T01:36:12.303627+0000","last_fullsized":"2024-09-17T01:36:12.303627+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:04.246558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304597+0000","last_change":"2024-09-17T01:36:11.308715+0000","last_active":"2024-09-17T01:36:12.304597+0000","last_peered":"2024-09-17T01:36:12.304597+0000","last_clean":"2024-09-17T01:36:12.304597+0000","last_became_active":"2024-09-17T01:36:11.308287+0000","last_became_peered":"2024-09-17T01:36:11.308287+0000","last_unstale":"2024-09-17T01:36:12.304597+0000","last_undegraded":"2024-09-17T01:36:12.304597+0000","last_fullsized":"2024-09-17T01:36:12.304597+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:57.671724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076588+0000","last_change":"2024-09-17T01:36:11.304384+0000","last_active":"2024-09-17T01:36:13.076588+0000","last_peered":"2024-09-17T01:36:13.076588+0000","last_clean":"2024-09-17T01:36:13.076588+0000","last_became_active":"2024-09-17T01:36:11.302561+0000","last_became_peered":"2024-09-17T01:36:11.302561+0000","last_unstale":"2024-09-17T01:36:13.076588+0000","last_undegraded":"2024-09-17T01:36:13.076588+0000","last_fullsized":"2024-09-17T01:36:13.076588+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:36.574249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023288+0000","last_change":"2024-09-17T01:36:11.313970+0000","last_active":"2024-09-17T01:36:13.023288+0000","last_peered":"2024-09-17T01:36:13.023288+0000","last_clean":"2024-09-17T01:36:13.023288+0000","last_became_active":"2024-09-17T01:36:11.310156+0000","last_became_peered":"2024-09-17T01:36:11.310156+0000","last_unstale":"2024-09-17T01:36:13.023288+0000","last_undegraded":"2024-09-17T01:36:13.023288+0000","last_fullsized":"2024-09-17T01:36:13.023288+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:58.276824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925181+0000","last_change":"2024-09-17T01:36:11.306107+0000","last_active":"2024-09-17T01:36:12.925181+0000","last_peered":"2024-09-17T01:36:12.925181+0000","last_clean":"2024-09-17T01:36:12.925181+0000","last_became_active":"2024-09-17T01:36:11.305764+0000","last_became_peered":"2024-09-17T01:36:11.305764+0000","last_unstale":"2024-09-17T01:36:12.925181+0000","last_undegraded":"2024-09-17T01:36:12.925181+0000","last_fullsized":"2024-09-17T01:36:12.925181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:09.482083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305187+0000","last_change":"2024-09-17T01:36:11.297563+0000","last_active":"2024-09-17T01:36:12.305187+0000","last_peered":"2024-09-17T01:36:12.305187+0000","last_clean":"2024-09-17T01:36:12.305187+0000","last_became_active":"2024-09-17T01:36:11.297236+0000","last_became_peered":"2024-09-17T01:36:11.297236+0000","last_unstale":"2024-09-17T01:36:12.305187+0000","last_undegraded":"2024-09-17T01:36:12.305187+0000","last_fullsized":"2024-09-17T01:36:12.305187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:28.959565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925285+0000","last_change":"2024-09-17T01:36:10.292457+0000","last_active":"2024-09-17T01:36:12.925285+0000","last_peered":"2024-09-17T01:36:12.925285+0000","last_clean":"2024-09-17T01:36:12.925285+0000","last_became_active":"2024-09-17T01:36:10.292073+0000","last_became_peered":"2024-09-17T01:36:10.292073+0000","last_unstale":"2024-09-17T01:36:12.925285+0000","last_undegraded":"2024-09-17T01:36:12.925285+0000","last_fullsized":"2024-09-17T01:36:12.925285+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:47.680334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305127+0000","last_change":"2024-09-17T01:36:11.314223+0000","last_active":"2024-09-17T01:36:12.305127+0000","last_peered":"2024-09-17T01:36:12.305127+0000","last_clean":"2024-09-17T01:36:12.305127+0000","last_became_active":"2024-09-17T01:36:11.313462+0000","last_became_peered":"2024-09-17T01:36:11.313462+0000","last_unstale":"2024-09-17T01:36:12.305127+0000","last_undegraded":"2024-09-17T01:36:12.305127+0000","last_fullsized":"2024-09-17T01:36:12.305127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:48.686497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023531+0000","last_change":"2024-09-17T01:36:10.295597+0000","last_active":"2024-09-17T01:36:13.023531+0000","last_peered":"2024-09-17T01:36:13.023531+0000","last_clean":"2024-09-17T01:36:13.023531+0000","last_became_active":"2024-09-17T01:36:10.295269+0000","last_became_peered":"2024-09-17T01:36:10.295269+0000","last_unstale":"2024-09-17T01:36:13.023531+0000","last_undegraded":"2024-09-17T01:36:13.023531+0000","last_fullsized":"2024-09-17T01:36:13.023531+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:07.370466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303912+0000","last_change":"2024-09-17T01:36:11.320059+0000","last_active":"2024-09-17T01:36:12.303912+0000","last_peered":"2024-09-17T01:36:12.303912+0000","last_clean":"2024-09-17T01:36:12.303912+0000","last_became_active":"2024-09-17T01:36:11.319721+0000","last_became_peered":"2024-09-17T01:36:11.319721+0000","last_unstale":"2024-09-17T01:36:12.303912+0000","last_undegraded":"2024-09-17T01:36:12.303912+0000","last_fullsized":"2024-09-17T01:36:12.303912+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:59.228610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303898+0000","last_change":"2024-09-17T01:36:10.286360+0000","last_active":"2024-09-17T01:36:12.303898+0000","last_peered":"2024-09-17T01:36:12.303898+0000","last_clean":"2024-09-17T01:36:12.303898+0000","last_became_active":"2024-09-17T01:36:10.285959+0000","last_became_peered":"2024-09-17T01:36:10.285959+0000","last_unstale":"2024-09-17T01:36:12.303898+0000","last_undegraded":"2024-09-17T01:36:12.303898+0000","last_fullsized":"2024-09-17T01:36:12.303898+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:11.061550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305368+0000","last_change":"2024-09-17T01:36:11.309231+0000","last_active":"2024-09-17T01:36:12.305368+0000","last_peered":"2024-09-17T01:36:12.305368+0000","last_clean":"2024-09-17T01:36:12.305368+0000","last_became_active":"2024-09-17T01:36:11.304902+0000","last_became_peered":"2024-09-17T01:36:11.304902+0000","last_unstale":"2024-09-17T01:36:12.305368+0000","last_undegraded":"2024-09-17T01:36:12.305368+0000","last_fullsized":"2024-09-17T01:36:12.305368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:56.613111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076709+0000","last_change":"2024-09-17T01:36:10.300133+0000","last_active":"2024-09-17T01:36:13.076709+0000","last_peered":"2024-09-17T01:36:13.076709+0000","last_clean":"2024-09-17T01:36:13.076709+0000","last_became_active":"2024-09-17T01:36:10.299955+0000","last_became_peered":"2024-09-17T01:36:10.299955+0000","last_unstale":"2024-09-17T01:36:13.076709+0000","last_undegraded":"2024-09-17T01:36:13.076709+0000","last_fullsized":"2024-09-17T01:36:13.076709+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:48.285259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303509+0000","last_change":"2024-09-17T01:36:11.323505+0000","last_active":"2024-09-17T01:36:12.303509+0000","last_peered":"2024-09-17T01:36:12.303509+0000","last_clean":"2024-09-17T01:36:12.303509+0000","last_became_active":"2024-09-17T01:36:11.323174+0000","last_became_peered":"2024-09-17T01:36:11.323174+0000","last_unstale":"2024-09-17T01:36:12.303509+0000","last_undegraded":"2024-09-17T01:36:12.303509+0000","last_fullsized":"2024-09-17T01:36:12.303509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:48.884777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301265+0000","last_change":"2024-09-17T01:36:10.291224+0000","last_active":"2024-09-17T01:36:12.301265+0000","last_peered":"2024-09-17T01:36:12.301265+0000","last_clean":"2024-09-17T01:36:12.301265+0000","last_became_active":"2024-09-17T01:36:10.290471+0000","last_became_peered":"2024-09-17T01:36:10.290471+0000","last_unstale":"2024-09-17T01:36:12.301265+0000","last_undegraded":"2024-09-17T01:36:12.301265+0000","last_fullsized":"2024-09-17T01:36:12.301265+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:22:02.505106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925183+0000","last_change":"2024-09-17T01:36:11.310201+0000","last_active":"2024-09-17T01:36:12.925183+0000","last_peered":"2024-09-17T01:36:12.925183+0000","last_clean":"2024-09-17T01:36:12.925183+0000","last_became_active":"2024-09-17T01:36:11.310003+0000","last_became_peered":"2024-09-17T01:36:11.310003+0000","last_unstale":"2024-09-17T01:36:12.925183+0000","last_undegraded":"2024-09-17T01:36:12.925183+0000","last_fullsized":"2024-09-17T01:36:12.925183+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:45.948182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305179+0000","last_change":"2024-09-17T01:36:10.293072+0000","last_active":"2024-09-17T01:36:12.305179+0000","last_peered":"2024-09-17T01:36:12.305179+0000","last_clean":"2024-09-17T01:36:12.305179+0000","last_became_active":"2024-09-17T01:36:10.290949+0000","last_became_peered":"2024-09-17T01:36:10.290949+0000","last_unstale":"2024-09-17T01:36:12.305179+0000","last_undegraded":"2024-09-17T01:36:12.305179+0000","last_fullsized":"2024-09-17T01:36:12.305179+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:40.448306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301070+0000","last_change":"2024-09-17T01:36:11.297597+0000","last_active":"2024-09-17T01:36:12.301070+0000","last_peered":"2024-09-17T01:36:12.301070+0000","last_clean":"2024-09-17T01:36:12.301070+0000","last_became_active":"2024-09-17T01:36:11.297261+0000","last_became_peered":"2024-09-17T01:36:11.297261+0000","last_unstale":"2024-09-17T01:36:12.301070+0000","last_undegraded":"2024-09-17T01:36:12.301070+0000","last_fullsized":"2024-09-17T01:36:12.301070+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:16.405238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.865999+0000","last_change":"2024-09-17T01:36:10.296734+0000","last_active":"2024-09-17T01:36:12.865999+0000","last_peered":"2024-09-17T01:36:12.865999+0000","last_clean":"2024-09-17T01:36:12.865999+0000","last_became_active":"2024-09-17T01:36:10.296463+0000","last_became_peered":"2024-09-17T01:36:10.296463+0000","last_unstale":"2024-09-17T01:36:12.865999+0000","last_undegraded":"2024-09-17T01:36:12.865999+0000","last_fullsized":"2024-09-17T01:36:12.865999+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:19.770144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303645+0000","last_change":"2024-09-17T01:36:11.306806+0000","last_active":"2024-09-17T01:36:12.303645+0000","last_peered":"2024-09-17T01:36:12.303645+0000","last_clean":"2024-09-17T01:36:12.303645+0000","last_became_active":"2024-09-17T01:36:11.306392+0000","last_became_peered":"2024-09-17T01:36:11.306392+0000","last_unstale":"2024-09-17T01:36:12.303645+0000","last_undegraded":"2024-09-17T01:36:12.303645+0000","last_fullsized":"2024-09-17T01:36:12.303645+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:58.962482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992402+0000","last_change":"2024-09-17T01:36:10.289402+0000","last_active":"2024-09-17T01:36:12.992402+0000","last_peered":"2024-09-17T01:36:12.992402+0000","last_clean":"2024-09-17T01:36:12.992402+0000","last_became_active":"2024-09-17T01:36:10.289028+0000","last_became_peered":"2024-09-17T01:36:10.289028+0000","last_unstale":"2024-09-17T01:36:12.992402+0000","last_undegraded":"2024-09-17T01:36:12.992402+0000","last_fullsized":"2024-09-17T01:36:12.992402+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:54.956235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.993014+0000","last_change":"2024-09-17T01:36:11.302630+0000","last_active":"2024-09-17T01:36:12.993014+0000","last_peered":"2024-09-17T01:36:12.993014+0000","last_clean":"2024-09-17T01:36:12.993014+0000","last_became_active":"2024-09-17T01:36:11.302324+0000","last_became_peered":"2024-09-17T01:36:11.302324+0000","last_unstale":"2024-09-17T01:36:12.993014+0000","last_undegraded":"2024-09-17T01:36:12.993014+0000","last_fullsized":"2024-09-17T01:36:12.993014+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:35.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866234+0000","last_change":"2024-09-17T01:36:10.293964+0000","last_active":"2024-09-17T01:36:12.866234+0000","last_peered":"2024-09-17T01:36:12.866234+0000","last_clean":"2024-09-17T01:36:12.866234+0000","last_became_active":"2024-09-17T01:36:10.293658+0000","last_became_peered":"2024-09-17T01:36:10.293658+0000","last_unstale":"2024-09-17T01:36:12.866234+0000","last_undegraded":"2024-09-17T01:36:12.866234+0000","last_fullsized":"2024-09-17T01:36:12.866234+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:37.278082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301761+0000","last_change":"2024-09-17T01:36:11.326023+0000","last_active":"2024-09-17T01:36:12.301761+0000","last_peered":"2024-09-17T01:36:12.301761+0000","last_clean":"2024-09-17T01:36:12.301761+0000","last_became_active":"2024-09-17T01:36:11.325355+0000","last_became_peered":"2024-09-17T01:36:11.325355+0000","last_unstale":"2024-09-17T01:36:12.301761+0000","last_undegraded":"2024-09-17T01:36:12.301761+0000","last_fullsized":"2024-09-17T01:36:12.301761+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:18.945861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304174+0000","last_change":"2024-09-17T01:36:10.294720+0000","last_active":"2024-09-17T01:36:12.304174+0000","last_peered":"2024-09-17T01:36:12.304174+0000","last_clean":"2024-09-17T01:36:12.304174+0000","last_became_active":"2024-09-17T01:36:10.294012+0000","last_became_peered":"2024-09-17T01:36:10.294012+0000","last_unstale":"2024-09-17T01:36:12.304174+0000","last_undegraded":"2024-09-17T01:36:12.304174+0000","last_fullsized":"2024-09-17T01:36:12.304174+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:29.017109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304165+0000","last_change":"2024-09-17T01:36:11.319252+0000","last_active":"2024-09-17T01:36:12.304165+0000","last_peered":"2024-09-17T01:36:12.304165+0000","last_clean":"2024-09-17T01:36:12.304165+0000","last_became_active":"2024-09-17T01:36:11.316127+0000","last_became_peered":"2024-09-17T01:36:11.316127+0000","last_unstale":"2024-09-17T01:36:12.304165+0000","last_undegraded":"2024-09-17T01:36:12.304165+0000","last_fullsized":"2024-09-17T01:36:12.304165+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:57:36.447976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.077184+0000","last_change":"2024-09-17T01:36:10.298237+0000","last_active":"2024-09-17T01:36:13.077184+0000","last_peered":"2024-09-17T01:36:13.077184+0000","last_clean":"2024-09-17T01:36:13.077184+0000","last_became_active":"2024-09-17T01:36:10.297914+0000","last_became_peered":"2024-09-17T01:36:10.297914+0000","last_unstale":"2024-09-17T01:36:13.077184+0000","last_undegraded":"2024-09-17T01:36:13.077184+0000","last_fullsized":"2024-09-17T01:36:13.077184+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:58.586762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076884+0000","last_change":"2024-09-17T01:36:11.310102+0000","last_active":"2024-09-17T01:36:13.076884+0000","last_peered":"2024-09-17T01:36:13.076884+0000","last_clean":"2024-09-17T01:36:13.076884+0000","last_became_active":"2024-09-17T01:36:11.309689+0000","last_became_peered":"2024-09-17T01:36:11.309689+0000","last_unstale":"2024-09-17T01:36:13.076884+0000","last_undegraded":"2024-09-17T01:36:13.076884+0000","last_fullsized":"2024-09-17T01:36:13.076884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:00.158245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":21,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992768+0000","last_change":"2024-09-17T01:36:10.292473+0000","last_active":"2024-09-17T01:36:12.992768+0000","last_peered":"2024-09-17T01:36:12.992768+0000","last_clean":"2024-09-17T01:36:12.992768+0000","last_became_active":"2024-09-17T01:36:10.292161+0000","last_became_peered":"2024-09-17T01:36:10.292161+0000","last_unstale":"2024-09-17T01:36:12.992768+0000","last_undegraded":"2024-09-17T01:36:12.992768+0000","last_fullsized":"2024-09-17T01:36:12.992768+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:03.337816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866232+0000","last_change":"2024-09-17T01:36:11.308108+0000","last_active":"2024-09-17T01:36:12.866232+0000","last_peered":"2024-09-17T01:36:12.866232+0000","last_clean":"2024-09-17T01:36:12.866232+0000","last_became_active":"2024-09-17T01:36:11.307801+0000","last_became_peered":"2024-09-17T01:36:11.307801+0000","last_unstale":"2024-09-17T01:36:12.866232+0000","last_undegraded":"2024-09-17T01:36:12.866232+0000","last_fullsized":"2024-09-17T01:36:12.866232+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:42.954974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303899+0000","last_change":"2024-09-17T01:36:10.293577+0000","last_active":"2024-09-17T01:36:12.303899+0000","last_peered":"2024-09-17T01:36:12.303899+0000","last_clean":"2024-09-17T01:36:12.303899+0000","last_became_active":"2024-09-17T01:36:10.291934+0000","last_became_peered":"2024-09-17T01:36:10.291934+0000","last_unstale":"2024-09-17T01:36:12.303899+0000","last_undegraded":"2024-09-17T01:36:12.303899+0000","last_fullsized":"2024-09-17T01:36:12.303899+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:15.757296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301178+0000","last_change":"2024-09-17T01:36:11.304308+0000","last_active":"2024-09-17T01:36:12.301178+0000","last_peered":"2024-09-17T01:36:12.301178+0000","last_clean":"2024-09-17T01:36:12.301178+0000","last_became_active":"2024-09-17T01:36:11.303985+0000","last_became_peered":"2024-09-17T01:36:11.303985+0000","last_unstale":"2024-09-17T01:36:12.301178+0000","last_undegraded":"2024-09-17T01:36:12.301178+0000","last_fullsized":"2024-09-17T01:36:12.301178+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:26.808029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076416+0000","last_change":"2024-09-17T01:36:10.291611+0000","last_active":"2024-09-17T01:36:13.076416+0000","last_peered":"2024-09-17T01:36:13.076416+0000","last_clean":"2024-09-17T01:36:13.076416+0000","last_became_active":"2024-09-17T01:36:10.291234+0000","last_became_peered":"2024-09-17T01:36:10.291234+0000","last_unstale":"2024-09-17T01:36:13.076416+0000","last_undegraded":"2024-09-17T01:36:13.076416+0000","last_fullsized":"2024-09-17T01:36:13.076416+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:22.528484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866341+0000","last_change":"2024-09-17T01:36:11.313891+0000","last_active":"2024-09-17T01:36:12.866341+0000","last_peered":"2024-09-17T01:36:12.866341+0000","last_clean":"2024-09-17T01:36:12.866341+0000","last_became_active":"2024-09-17T01:36:11.313582+0000","last_became_peered":"2024-09-17T01:36:11.313582+0000","last_unstale":"2024-09-17T01:36:12.866341+0000","last_undegraded":"2024-09-17T01:36:12.866341+0000","last_fullsized":"2024-09-17T01:36:12.866341+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:22.521895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076693+0000","last_change":"2024-09-17T01:36:10.286012+0000","last_active":"2024-09-17T01:36:13.076693+0000","last_peered":"2024-09-17T01:36:13.076693+0000","last_clean":"2024-09-17T01:36:13.076693+0000","last_became_active":"2024-09-17T01:36:10.284940+0000","last_became_peered":"2024-09-17T01:36:10.284940+0000","last_unstale":"2024-09-17T01:36:13.076693+0000","last_undegraded":"2024-09-17T01:36:13.076693+0000","last_fullsized":"2024-09-17T01:36:13.076693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:00.539807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076838+0000","last_change":"2024-09-17T01:36:11.309989+0000","last_active":"2024-09-17T01:36:13.076838+0000","last_peered":"2024-09-17T01:36:13.076838+0000","last_clean":"2024-09-17T01:36:13.076838+0000","last_became_active":"2024-09-17T01:36:11.309641+0000","last_became_peered":"2024-09-17T01:36:11.309641+0000","last_unstale":"2024-09-17T01:36:13.076838+0000","last_undegraded":"2024-09-17T01:36:13.076838+0000","last_fullsized":"2024-09-17T01:36:13.076838+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:40.530982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":23,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076341+0000","last_change":"2024-09-17T01:36:10.295240+0000","last_active":"2024-09-17T01:36:13.076341+0000","last_peered":"2024-09-17T01:36:13.076341+0000","last_clean":"2024-09-17T01:36:13.076341+0000","last_became_active":"2024-09-17T01:36:10.294945+0000","last_became_peered":"2024-09-17T01:36:10.294945+0000","last_unstale":"2024-09-17T01:36:13.076341+0000","last_undegraded":"2024-09-17T01:36:13.076341+0000","last_fullsized":"2024-09-17T01:36:13.076341+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:55.304271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301589+0000","last_change":"2024-09-17T01:36:11.307572+0000","last_active":"2024-09-17T01:36:12.301589+0000","last_peered":"2024-09-17T01:36:12.301589+0000","last_clean":"2024-09-17T01:36:12.301589+0000","last_became_active":"2024-09-17T01:36:11.307269+0000","last_became_peered":"2024-09-17T01:36:11.307269+0000","last_unstale":"2024-09-17T01:36:12.301589+0000","last_undegraded":"2024-09-17T01:36:12.301589+0000","last_fullsized":"2024-09-17T01:36:12.301589+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:13.770369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023621+0000","last_change":"2024-09-17T01:36:10.298316+0000","last_active":"2024-09-17T01:36:13.023621+0000","last_peered":"2024-09-17T01:36:13.023621+0000","last_clean":"2024-09-17T01:36:13.023621+0000","last_became_active":"2024-09-17T01:36:10.297999+0000","last_became_peered":"2024-09-17T01:36:10.297999+0000","last_unstale":"2024-09-17T01:36:13.023621+0000","last_undegraded":"2024-09-17T01:36:13.023621+0000","last_fullsized":"2024-09-17T01:36:13.023621+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:38:13.536708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301796+0000","last_change":"2024-09-17T01:36:11.326191+0000","last_active":"2024-09-17T01:36:12.301796+0000","last_peered":"2024-09-17T01:36:12.301796+0000","last_clean":"2024-09-17T01:36:12.301796+0000","last_became_active":"2024-09-17T01:36:11.325735+0000","last_became_peered":"2024-09-17T01:36:11.325735+0000","last_unstale":"2024-09-17T01:36:12.301796+0000","last_undegraded":"2024-09-17T01:36:12.301796+0000","last_fullsized":"2024-09-17T01:36:12.301796+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:08.466853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304328+0000","last_change":"2024-09-17T01:36:10.294353+0000","last_active":"2024-09-17T01:36:12.304328+0000","last_peered":"2024-09-17T01:36:12.304328+0000","last_clean":"2024-09-17T01:36:12.304328+0000","last_became_active":"2024-09-17T01:36:10.293440+0000","last_became_peered":"2024-09-17T01:36:10.293440+0000","last_unstale":"2024-09-17T01:36:12.304328+0000","last_undegraded":"2024-09-17T01:36:12.304328+0000","last_fullsized":"2024-09-17T01:36:12.304328+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:33.626765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023594+0000","last_change":"2024-09-17T01:36:11.320250+0000","last_active":"2024-09-17T01:36:13.023594+0000","last_peered":"2024-09-17T01:36:13.023594+0000","last_clean":"2024-09-17T01:36:13.023594+0000","last_became_active":"2024-09-17T01:36:11.319913+0000","last_became_peered":"2024-09-17T01:36:11.319913+0000","last_unstale":"2024-09-17T01:36:13.023594+0000","last_undegraded":"2024-09-17T01:36:13.023594+0000","last_fullsized":"2024-09-17T01:36:13.023594+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:03.629335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301619+0000","last_change":"2024-09-17T01:36:10.294281+0000","last_active":"2024-09-17T01:36:12.301619+0000","last_peered":"2024-09-17T01:36:12.301619+0000","last_clean":"2024-09-17T01:36:12.301619+0000","last_became_active":"2024-09-17T01:36:10.293955+0000","last_became_peered":"2024-09-17T01:36:10.293955+0000","last_unstale":"2024-09-17T01:36:12.301619+0000","last_undegraded":"2024-09-17T01:36:12.301619+0000","last_fullsized":"2024-09-17T01:36:12.301619+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:42.019276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.077112+0000","last_change":"2024-09-17T01:36:11.320342+0000","last_active":"2024-09-17T01:36:13.077112+0000","last_peered":"2024-09-17T01:36:13.077112+0000","last_clean":"2024-09-17T01:36:13.077112+0000","last_became_active":"2024-09-17T01:36:11.320023+0000","last_became_peered":"2024-09-17T01:36:11.320023+0000","last_unstale":"2024-09-17T01:36:13.077112+0000","last_undegraded":"2024-09-17T01:36:13.077112+0000","last_fullsized":"2024-09-17T01:36:13.077112+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:26.695707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304315+0000","last_change":"2024-09-17T01:36:10.289087+0000","last_active":"2024-09-17T01:36:12.304315+0000","last_peered":"2024-09-17T01:36:12.304315+0000","last_clean":"2024-09-17T01:36:12.304315+0000","last_became_active":"2024-09-17T01:36:10.288721+0000","last_became_peered":"2024-09-17T01:36:10.288721+0000","last_unstale":"2024-09-17T01:36:12.304315+0000","last_undegraded":"2024-09-17T01:36:12.304315+0000","last_fullsized":"2024-09-17T01:36:12.304315+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:24:11.811046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866397+0000","last_change":"2024-09-17T01:36:11.319574+0000","last_active":"2024-09-17T01:36:12.866397+0000","last_peered":"2024-09-17T01:36:12.866397+0000","last_clean":"2024-09-17T01:36:12.866397+0000","last_became_active":"2024-09-17T01:36:11.317100+0000","last_became_peered":"2024-09-17T01:36:11.317100+0000","last_unstale":"2024-09-17T01:36:12.866397+0000","last_undegraded":"2024-09-17T01:36:12.866397+0000","last_fullsized":"2024-09-17T01:36:12.866397+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:50.155552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.924945+0000","last_change":"2024-09-17T01:36:10.295963+0000","last_active":"2024-09-17T01:36:12.924945+0000","last_peered":"2024-09-17T01:36:12.924945+0000","last_clean":"2024-09-17T01:36:12.924945+0000","last_became_active":"2024-09-17T01:36:10.294487+0000","last_became_peered":"2024-09-17T01:36:10.294487+0000","last_unstale":"2024-09-17T01:36:12.924945+0000","last_undegraded":"2024-09-17T01:36:12.924945+0000","last_fullsized":"2024-09-17T01:36:12.924945+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:18:44.054224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303371+0000","last_change":"2024-09-17T01:36:11.314041+0000","last_active":"2024-09-17T01:36:12.303371+0000","last_peered":"2024-09-17T01:36:12.303371+0000","last_clean":"2024-09-17T01:36:12.303371+0000","last_became_active":"2024-09-17T01:36:11.313573+0000","last_became_peered":"2024-09-17T01:36:11.313573+0000","last_unstale":"2024-09-17T01:36:12.303371+0000","last_undegraded":"2024-09-17T01:36:12.303371+0000","last_fullsized":"2024-09-17T01:36:12.303371+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:30.847327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303084+0000","last_change":"2024-09-17T01:36:10.293477+0000","last_active":"2024-09-17T01:36:12.303084+0000","last_peered":"2024-09-17T01:36:12.303084+0000","last_clean":"2024-09-17T01:36:12.303084+0000","last_became_active":"2024-09-17T01:36:10.293119+0000","last_became_peered":"2024-09-17T01:36:10.293119+0000","last_unstale":"2024-09-17T01:36:12.303084+0000","last_undegraded":"2024-09-17T01:36:12.303084+0000","last_fullsized":"2024-09-17T01:36:12.303084+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:02.386471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303044+0000","last_change":"2024-09-17T01:36:11.315150+0000","last_active":"2024-09-17T01:36:12.303044+0000","last_peered":"2024-09-17T01:36:12.303044+0000","last_clean":"2024-09-17T01:36:12.303044+0000","last_became_active":"2024-09-17T01:36:11.314846+0000","last_became_peered":"2024-09-17T01:36:11.314846+0000","last_unstale":"2024-09-17T01:36:12.303044+0000","last_undegraded":"2024-09-17T01:36:12.303044+0000","last_fullsized":"2024-09-17T01:36:12.303044+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:08.297937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866344+0000","last_change":"2024-09-17T01:36:10.280718+0000","last_active":"2024-09-17T01:36:12.866344+0000","last_peered":"2024-09-17T01:36:12.866344+0000","last_clean":"2024-09-17T01:36:12.866344+0000","last_became_active":"2024-09-17T01:36:10.280401+0000","last_became_peered":"2024-09-17T01:36:10.280401+0000","last_unstale":"2024-09-17T01:36:12.866344+0000","last_undegraded":"2024-09-17T01:36:12.866344+0000","last_fullsized":"2024-09-17T01:36:12.866344+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:46.578001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301843+0000","last_change":"2024-09-17T01:36:11.311989+0000","last_active":"2024-09-17T01:36:12.301843+0000","last_peered":"2024-09-17T01:36:12.301843+0000","last_clean":"2024-09-17T01:36:12.301843+0000","last_became_active":"2024-09-17T01:36:11.310340+0000","last_became_peered":"2024-09-17T01:36:11.310340+0000","last_unstale":"2024-09-17T01:36:12.301843+0000","last_undegraded":"2024-09-17T01:36:12.301843+0000","last_fullsized":"2024-09-17T01:36:12.301843+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:29.823125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023788+0000","last_change":"2024-09-17T01:36:10.298876+0000","last_active":"2024-09-17T01:36:13.023788+0000","last_peered":"2024-09-17T01:36:13.023788+0000","last_clean":"2024-09-17T01:36:13.023788+0000","last_became_active":"2024-09-17T01:36:10.298564+0000","last_became_peered":"2024-09-17T01:36:10.298564+0000","last_unstale":"2024-09-17T01:36:13.023788+0000","last_undegraded":"2024-09-17T01:36:13.023788+0000","last_fullsized":"2024-09-17T01:36:13.023788+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:48.499379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301928+0000","last_change":"2024-09-17T01:36:11.301724+0000","last_active":"2024-09-17T01:36:12.301928+0000","last_peered":"2024-09-17T01:36:12.301928+0000","last_clean":"2024-09-17T01:36:12.301928+0000","last_became_active":"2024-09-17T01:36:11.300895+0000","last_became_peered":"2024-09-17T01:36:11.300895+0000","last_unstale":"2024-09-17T01:36:12.301928+0000","last_undegraded":"2024-09-17T01:36:12.301928+0000","last_fullsized":"2024-09-17T01:36:12.301928+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:48:57.820654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"62'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305072+0000","last_change":"2024-09-17T01:36:10.290784+0000","last_active":"2024-09-17T01:36:12.305072+0000","last_peered":"2024-09-17T01:36:12.305072+0000","last_clean":"2024-09-17T01:36:12.305072+0000","last_became_active":"2024-09-17T01:36:10.288289+0000","last_became_peered":"2024-09-17T01:36:10.288289+0000","last_unstale":"2024-09-17T01:36:12.305072+0000","last_undegraded":"2024-09-17T01:36:12.305072+0000","last_fullsized":"2024-09-17T01:36:12.305072+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:25.435670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023456+0000","last_change":"2024-09-17T01:36:11.316442+0000","last_active":"2024-09-17T01:36:13.023456+0000","last_peered":"2024-09-17T01:36:13.023456+0000","last_clean":"2024-09-17T01:36:13.023456+0000","last_became_active":"2024-09-17T01:36:11.315668+0000","last_became_peered":"2024-09-17T01:36:11.315668+0000","last_unstale":"2024-09-17T01:36:13.023456+0000","last_undegraded":"2024-09-17T01:36:13.023456+0000","last_fullsized":"2024-09-17T01:36:13.023456+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:15:50.717398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866158+0000","last_change":"2024-09-17T01:36:10.289540+0000","last_active":"2024-09-17T01:36:12.866158+0000","last_peered":"2024-09-17T01:36:12.866158+0000","last_clean":"2024-09-17T01:36:12.866158+0000","last_became_active":"2024-09-17T01:36:10.289239+0000","last_became_peered":"2024-09-17T01:36:10.289239+0000","last_unstale":"2024-09-17T01:36:12.866158+0000","last_undegraded":"2024-09-17T01:36:12.866158+0000","last_fullsized":"2024-09-17T01:36:12.866158+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:41.502277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303227+0000","last_change":"2024-09-17T01:36:11.309355+0000","last_active":"2024-09-17T01:36:12.303227+0000","last_peered":"2024-09-17T01:36:12.303227+0000","last_clean":"2024-09-17T01:36:12.303227+0000","last_became_active":"2024-09-17T01:36:11.308670+0000","last_became_peered":"2024-09-17T01:36:11.308670+0000","last_unstale":"2024-09-17T01:36:12.303227+0000","last_undegraded":"2024-09-17T01:36:12.303227+0000","last_fullsized":"2024-09-17T01:36:12.303227+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:52:53.600454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301188+0000","last_change":"2024-09-17T01:36:10.297976+0000","last_active":"2024-09-17T01:36:12.301188+0000","last_peered":"2024-09-17T01:36:12.301188+0000","last_clean":"2024-09-17T01:36:12.301188+0000","last_became_active":"2024-09-17T01:36:10.297673+0000","last_became_peered":"2024-09-17T01:36:10.297673+0000","last_unstale":"2024-09-17T01:36:12.301188+0000","last_undegraded":"2024-09-17T01:36:12.301188+0000","last_fullsized":"2024-09-17T01:36:12.301188+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:37.540406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304632+0000","last_change":"2024-09-17T01:36:11.300517+0000","last_active":"2024-09-17T01:36:12.304632+0000","last_peered":"2024-09-17T01:36:12.304632+0000","last_clean":"2024-09-17T01:36:12.304632+0000","last_became_active":"2024-09-17T01:36:11.300185+0000","last_became_peered":"2024-09-17T01:36:11.300185+0000","last_unstale":"2024-09-17T01:36:12.304632+0000","last_undegraded":"2024-09-17T01:36:12.304632+0000","last_fullsized":"2024-09-17T01:36:12.304632+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:56.615253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023327+0000","last_change":"2024-09-17T01:36:10.298497+0000","last_active":"2024-09-17T01:36:13.023327+0000","last_peered":"2024-09-17T01:36:13.023327+0000","last_clean":"2024-09-17T01:36:13.023327+0000","last_became_active":"2024-09-17T01:36:10.298121+0000","last_became_peered":"2024-09-17T01:36:10.298121+0000","last_unstale":"2024-09-17T01:36:13.023327+0000","last_undegraded":"2024-09-17T01:36:13.023327+0000","last_fullsized":"2024-09-17T01:36:13.023327+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:38.190524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992863+0000","last_change":"2024-09-17T01:36:11.321630+0000","last_active":"2024-09-17T01:36:12.992863+0000","last_peered":"2024-09-17T01:36:12.992863+0000","last_clean":"2024-09-17T01:36:12.992863+0000","last_became_active":"2024-09-17T01:36:11.321328+0000","last_became_peered":"2024-09-17T01:36:11.321328+0000","last_unstale":"2024-09-17T01:36:12.992863+0000","last_undegraded":"2024-09-17T01:36:12.992863+0000","last_fullsized":"2024-09-17T01:36:12.992863+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:39.391906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301050+0000","last_change":"2024-09-17T01:36:10.296407+0000","last_active":"2024-09-17T01:36:12.301050+0000","last_peered":"2024-09-17T01:36:12.301050+0000","last_clean":"2024-09-17T01:36:12.301050+0000","last_became_active":"2024-09-17T01:36:10.296089+0000","last_became_peered":"2024-09-17T01:36:10.296089+0000","last_unstale":"2024-09-17T01:36:12.301050+0000","last_undegraded":"2024-09-17T01:36:12.301050+0000","last_fullsized":"2024-09-17T01:36:12.301050+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:43.430188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.302818+0000","last_change":"2024-09-17T01:36:11.310738+0000","last_active":"2024-09-17T01:36:12.302818+0000","last_peered":"2024-09-17T01:36:12.302818+0000","last_clean":"2024-09-17T01:36:12.302818+0000","last_became_active":"2024-09-17T01:36:11.310431+0000","last_became_peered":"2024-09-17T01:36:11.310431+0000","last_unstale":"2024-09-17T01:36:12.302818+0000","last_undegraded":"2024-09-17T01:36:12.302818+0000","last_fullsized":"2024-09-17T01:36:12.302818+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:54.749692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303734+0000","last_change":"2024-09-17T01:36:10.290312+0000","last_active":"2024-09-17T01:36:12.303734+0000","last_peered":"2024-09-17T01:36:12.303734+0000","last_clean":"2024-09-17T01:36:12.303734+0000","last_became_active":"2024-09-17T01:36:10.287956+0000","last_became_peered":"2024-09-17T01:36:10.287956+0000","last_unstale":"2024-09-17T01:36:12.303734+0000","last_undegraded":"2024-09-17T01:36:12.303734+0000","last_fullsized":"2024-09-17T01:36:12.303734+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:02.623172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023505+0000","last_change":"2024-09-17T01:36:11.319336+0000","last_active":"2024-09-17T01:36:13.023505+0000","last_peered":"2024-09-17T01:36:13.023505+0000","last_clean":"2024-09-17T01:36:13.023505+0000","last_became_active":"2024-09-17T01:36:11.319012+0000","last_became_peered":"2024-09-17T01:36:11.319012+0000","last_unstale":"2024-09-17T01:36:13.023505+0000","last_undegraded":"2024-09-17T01:36:13.023505+0000","last_fullsized":"2024-09-17T01:36:13.023505+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:23.186639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303218+0000","last_change":"2024-09-17T01:36:10.289718+0000","last_active":"2024-09-17T01:36:12.303218+0000","last_peered":"2024-09-17T01:36:12.303218+0000","last_clean":"2024-09-17T01:36:12.303218+0000","last_became_active":"2024-09-17T01:36:10.289409+0000","last_became_peered":"2024-09-17T01:36:10.289409+0000","last_unstale":"2024-09-17T01:36:12.303218+0000","last_undegraded":"2024-09-17T01:36:12.303218+0000","last_fullsized":"2024-09-17T01:36:12.303218+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:57.059026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304882+0000","last_change":"2024-09-17T01:36:11.309282+0000","last_active":"2024-09-17T01:36:12.304882+0000","last_peered":"2024-09-17T01:36:12.304882+0000","last_clean":"2024-09-17T01:36:12.304882+0000","last_became_active":"2024-09-17T01:36:11.308775+0000","last_became_peered":"2024-09-17T01:36:11.308775+0000","last_unstale":"2024-09-17T01:36:12.304882+0000","last_undegraded":"2024-09-17T01:36:12.304882+0000","last_fullsized":"2024-09-17T01:36:12.304882+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:20.099586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992452+0000","last_change":"2024-09-17T01:36:10.294227+0000","last_active":"2024-09-17T01:36:12.992452+0000","last_peered":"2024-09-17T01:36:12.992452+0000","last_clean":"2024-09-17T01:36:12.992452+0000","last_became_active":"2024-09-17T01:36:10.291395+0000","last_became_peered":"2024-09-17T01:36:10.291395+0000","last_unstale":"2024-09-17T01:36:12.992452+0000","last_undegraded":"2024-09-17T01:36:12.992452+0000","last_fullsized":"2024-09-17T01:36:12.992452+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:05.348862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":187,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.865857+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:36:12.865857+0000","last_peered":"2024-09-17T01:36:12.865857+0000","last_clean":"2024-09-17T01:36:12.865857+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:36:12.865857+0000","last_undegraded":"2024-09-17T01:36:12.865857+0000","last_fullsized":"2024-09-17T01:36:12.865857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476792,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":757760,"data_stored":311303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509495,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36076,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335764,"statfs":{"total":96636764160,"available":96599822336,"internally_reserved":0,"allocated":745472,"data_stored":309623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40232,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331608,"statfs":{"total":96636764160,"available":96595566592,"internally_reserved":0,"allocated":741376,"data_stored":309553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509495,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40236,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331604,"statfs":{"total":96636764160,"available":96595562496,"internally_reserved":0,"allocated":745472,"data_stored":310147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509495,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":309621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509494,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40812,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331028,"statfs":{"total":96636764160,"available":96594972672,"internally_reserved":0,"allocated":1335296,"data_stored":900481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509496,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36080,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335760,"statfs":{"total":96636764160,"available":96599818240,"internally_reserved":0,"allocated":749568,"data_stored":311143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542200,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40812,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331028,"statfs":{"total":96636764160,"available":96594972672,"internally_reserved":0,"allocated":1335296,"data_stored":899933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:36:19.750 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:36:19.755 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:36:20.828 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:36:21.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.070+0000 7fc110600640 1 -- 172.21.15.42:0/3612141006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc10815f190 msgr2=0x7fc10806fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:21.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.070+0000 7fc110600640 1 --2- 172.21.15.42:0/3612141006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc10815f190 0x7fc10806fe40 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fc1080b5b30 tx=0x7fc10002aa10 comp rx=0 tx=0).stop 2024-09-17T01:36:21.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.070+0000 7fc110600640 1 -- 172.21.15.42:0/3612141006 shutdown_connections 2024-09-17T01:36:21.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.070+0000 7fc110600640 1 --2- 172.21.15.42:0/3612141006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc10815f190 0x7fc10806fe40 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:21.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.070+0000 7fc110600640 1 --2- 172.21.15.42:0/3612141006 >> v2:172.21.15.43:3300/0 conn(0x7fc10806db40 0x7fc10815bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:21.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.070+0000 7fc110600640 1 -- 172.21.15.42:0/3612141006 >> 172.21.15.42:0/3612141006 conn(0x7fc1080b2930 msgr2=0x7fc10806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:21.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.070+0000 7fc110600640 1 -- 172.21.15.42:0/3612141006 shutdown_connections 2024-09-17T01:36:21.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.070+0000 7fc110600640 1 -- 172.21.15.42:0/3612141006 wait complete. 2024-09-17T01:36:21.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.072+0000 7fc110600640 1 Processor -- start 2024-09-17T01:36:21.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.072+0000 7fc110600640 1 -- start start 2024-09-17T01:36:21.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.074+0000 7fc110600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc108072e00 0x7fc108143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:21.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.074+0000 7fc110600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc10815f190 0x7fc1081542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:21.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.074+0000 7fc110600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc108142d10 0x7fc10806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:21.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.074+0000 7fc110600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc10815f650 con 0x7fc10815f190 2024-09-17T01:36:21.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.074+0000 7fc110600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc108070740 con 0x7fc108142d10 2024-09-17T01:36:21.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.074+0000 7fc110600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc108151520 con 0x7fc108072e00 2024-09-17T01:36:21.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.074+0000 7fc10d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc10815f190 0x7fc1081542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:21.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.074+0000 7fc10d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc10815f190 0x7fc1081542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52030/0 (socket says 172.21.15.42:52030) 2024-09-17T01:36:21.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.074+0000 7fc10d200640 1 -- 172.21.15.42:0/2975779874 learned_addr learned my addr 172.21.15.42:0/2975779874 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:21.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.074+0000 7fc10dc00640 1 --2- 172.21.15.42:0/2975779874 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc108072e00 0x7fc108143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:21.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.074+0000 7fc10e600640 1 --2- 172.21.15.42:0/2975779874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc108142d10 0x7fc10806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:21.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.075+0000 7fc10d200640 1 -- 172.21.15.42:0/2975779874 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc108072e00 msgr2=0x7fc108143640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:21.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.075+0000 7fc10d200640 1 --2- 172.21.15.42:0/2975779874 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc108072e00 0x7fc108143640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:21.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.075+0000 7fc10d200640 1 -- 172.21.15.42:0/2975779874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc108142d10 msgr2=0x7fc10806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:21.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.075+0000 7fc10d200640 1 --2- 172.21.15.42:0/2975779874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc108142d10 0x7fc10806cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:21.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.075+0000 7fc10d200640 1 -- 172.21.15.42:0/2975779874 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc108154800 con 0x7fc10815f190 2024-09-17T01:36:21.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.075+0000 7fc10d200640 1 --2- 172.21.15.42:0/2975779874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc10815f190 0x7fc1081542c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fc0f400c9a0 tx=0x7fc0f400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:21.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.075+0000 7fc105600640 1 -- 172.21.15.42:0/2975779874 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4007bb0 con 0x7fc10815f190 2024-09-17T01:36:21.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.075+0000 7fc105600640 1 -- 172.21.15.42:0/2975779874 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0f4007e40 con 0x7fc10815f190 2024-09-17T01:36:21.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.075+0000 7fc105600640 1 -- 172.21.15.42:0/2975779874 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f400f690 con 0x7fc10815f190 2024-09-17T01:36:21.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.075+0000 7fc110600640 1 -- 172.21.15.42:0/2975779874 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc108146590 con 0x7fc10815f190 2024-09-17T01:36:21.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.076+0000 7fc110600640 1 -- 172.21.15.42:0/2975779874 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc108145fd0 con 0x7fc10815f190 2024-09-17T01:36:21.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.077+0000 7fc110600640 1 -- 172.21.15.42:0/2975779874 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1080d0060 con 0x7fc10815f190 2024-09-17T01:36:21.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.078+0000 7fc105600640 1 -- 172.21.15.42:0/2975779874 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc0f400f830 con 0x7fc10815f190 2024-09-17T01:36:21.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.079+0000 7fc105600640 1 --2- 172.21.15.42:0/2975779874 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc0e8078b90 0x7fc0e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:21.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.079+0000 7fc105600640 1 -- 172.21.15.42:0/2975779874 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7fc0f409b480 con 0x7fc10815f190 2024-09-17T01:36:21.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.080+0000 7fc10dc00640 1 --2- 172.21.15.42:0/2975779874 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc0e8078b90 0x7fc0e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:21.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.080+0000 7fc10dc00640 1 --2- 172.21.15.42:0/2975779874 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc0e8078b90 0x7fc0e807b0a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc006fd0 tx=0x7fc0fc009060 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:21.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.084+0000 7fc105600640 1 -- 172.21.15.42:0/2975779874 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc1080d0060 con 0x7fc10815f190 2024-09-17T01:36:21.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.277+0000 7fc110600640 1 -- 172.21.15.42:0/2975779874 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc10815bc50 con 0x7fc0e8078b90 2024-09-17T01:36:21.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.283+0000 7fc105600640 1 -- 172.21.15.42:0/2975779874 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7fc10815bc50 con 0x7fc0e8078b90 2024-09-17T01:36:21.284 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:21.285 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:36:21.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.287+0000 7fc110600640 1 -- 172.21.15.42:0/2975779874 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc0e8078b90 msgr2=0x7fc0e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:21.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.287+0000 7fc110600640 1 --2- 172.21.15.42:0/2975779874 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc0e8078b90 0x7fc0e807b0a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc006fd0 tx=0x7fc0fc009060 comp rx=0 tx=0).stop 2024-09-17T01:36:21.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.287+0000 7fc110600640 1 -- 172.21.15.42:0/2975779874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc10815f190 msgr2=0x7fc1081542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:21.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.287+0000 7fc110600640 1 --2- 172.21.15.42:0/2975779874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc10815f190 0x7fc1081542c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fc0f400c9a0 tx=0x7fc0f400ce60 comp rx=0 tx=0).stop 2024-09-17T01:36:21.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.287+0000 7fc110600640 1 -- 172.21.15.42:0/2975779874 shutdown_connections 2024-09-17T01:36:21.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.287+0000 7fc110600640 1 --2- 172.21.15.42:0/2975779874 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc0e8078b90 0x7fc0e807b0a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:21.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.287+0000 7fc110600640 1 --2- 172.21.15.42:0/2975779874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc108142d10 0x7fc10806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:21.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.287+0000 7fc110600640 1 --2- 172.21.15.42:0/2975779874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc10815f190 0x7fc1081542c0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:21.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.287+0000 7fc110600640 1 --2- 172.21.15.42:0/2975779874 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc108072e00 0x7fc108143640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:21.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.287+0000 7fc110600640 1 -- 172.21.15.42:0/2975779874 >> 172.21.15.42:0/2975779874 conn(0x7fc1080b2930 msgr2=0x7fc1080b0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:21.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.287+0000 7fc110600640 1 -- 172.21.15.42:0/2975779874 shutdown_connections 2024-09-17T01:36:21.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.287+0000 7fc110600640 1 -- 172.21.15.42:0/2975779874 wait complete. 2024-09-17T01:36:21.308 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-09-17T01:36:21.048404+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289776,"kb_used_data":6984,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754684944,"statfs":{"total":773094113280,"available":772797382656,"internally_reserved":0,"allocated":7151616,"data_stored":3661804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":289394228},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.763240"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304704+0000","last_change":"2024-09-17T01:36:11.317189+0000","last_active":"2024-09-17T01:36:12.304704+0000","last_peered":"2024-09-17T01:36:12.304704+0000","last_clean":"2024-09-17T01:36:12.304704+0000","last_became_active":"2024-09-17T01:36:11.316776+0000","last_became_peered":"2024-09-17T01:36:11.316776+0000","last_unstale":"2024-09-17T01:36:12.304704+0000","last_undegraded":"2024-09-17T01:36:12.304704+0000","last_fullsized":"2024-09-17T01:36:12.304704+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:35.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023723+0000","last_change":"2024-09-17T01:36:11.325731+0000","last_active":"2024-09-17T01:36:13.023723+0000","last_peered":"2024-09-17T01:36:13.023723+0000","last_clean":"2024-09-17T01:36:13.023723+0000","last_became_active":"2024-09-17T01:36:11.325325+0000","last_became_peered":"2024-09-17T01:36:11.325325+0000","last_unstale":"2024-09-17T01:36:13.023723+0000","last_undegraded":"2024-09-17T01:36:13.023723+0000","last_fullsized":"2024-09-17T01:36:13.023723+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:12.067713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301489+0000","last_change":"2024-09-17T01:36:11.306785+0000","last_active":"2024-09-17T01:36:12.301489+0000","last_peered":"2024-09-17T01:36:12.301489+0000","last_clean":"2024-09-17T01:36:12.301489+0000","last_became_active":"2024-09-17T01:36:11.305122+0000","last_became_peered":"2024-09-17T01:36:11.305122+0000","last_unstale":"2024-09-17T01:36:12.301489+0000","last_undegraded":"2024-09-17T01:36:12.301489+0000","last_fullsized":"2024-09-17T01:36:12.301489+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:19.634502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076816+0000","last_change":"2024-09-17T01:36:11.319236+0000","last_active":"2024-09-17T01:36:13.076816+0000","last_peered":"2024-09-17T01:36:13.076816+0000","last_clean":"2024-09-17T01:36:13.076816+0000","last_became_active":"2024-09-17T01:36:11.318786+0000","last_became_peered":"2024-09-17T01:36:11.318786+0000","last_unstale":"2024-09-17T01:36:13.076816+0000","last_undegraded":"2024-09-17T01:36:13.076816+0000","last_fullsized":"2024-09-17T01:36:13.076816+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:56:37.137202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304383+0000","last_change":"2024-09-17T01:36:11.295952+0000","last_active":"2024-09-17T01:36:12.304383+0000","last_peered":"2024-09-17T01:36:12.304383+0000","last_clean":"2024-09-17T01:36:12.304383+0000","last_became_active":"2024-09-17T01:36:11.295523+0000","last_became_peered":"2024-09-17T01:36:11.295523+0000","last_unstale":"2024-09-17T01:36:12.304383+0000","last_undegraded":"2024-09-17T01:36:12.304383+0000","last_fullsized":"2024-09-17T01:36:12.304383+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:08.202105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304321+0000","last_change":"2024-09-17T01:36:11.303156+0000","last_active":"2024-09-17T01:36:12.304321+0000","last_peered":"2024-09-17T01:36:12.304321+0000","last_clean":"2024-09-17T01:36:12.304321+0000","last_became_active":"2024-09-17T01:36:11.302790+0000","last_became_peered":"2024-09-17T01:36:11.302790+0000","last_unstale":"2024-09-17T01:36:12.304321+0000","last_undegraded":"2024-09-17T01:36:12.304321+0000","last_fullsized":"2024-09-17T01:36:12.304321+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:30.181703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076553+0000","last_change":"2024-09-17T01:36:11.293632+0000","last_active":"2024-09-17T01:36:13.076553+0000","last_peered":"2024-09-17T01:36:13.076553+0000","last_clean":"2024-09-17T01:36:13.076553+0000","last_became_active":"2024-09-17T01:36:11.293324+0000","last_became_peered":"2024-09-17T01:36:11.293324+0000","last_unstale":"2024-09-17T01:36:13.076553+0000","last_undegraded":"2024-09-17T01:36:13.076553+0000","last_fullsized":"2024-09-17T01:36:13.076553+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:51.396274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.302970+0000","last_change":"2024-09-17T01:36:11.317048+0000","last_active":"2024-09-17T01:36:12.302970+0000","last_peered":"2024-09-17T01:36:12.302970+0000","last_clean":"2024-09-17T01:36:12.302970+0000","last_became_active":"2024-09-17T01:36:11.315266+0000","last_became_peered":"2024-09-17T01:36:11.315266+0000","last_unstale":"2024-09-17T01:36:12.302970+0000","last_undegraded":"2024-09-17T01:36:12.302970+0000","last_fullsized":"2024-09-17T01:36:12.302970+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:17.967682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866481+0000","last_change":"2024-09-17T01:36:11.303422+0000","last_active":"2024-09-17T01:36:12.866481+0000","last_peered":"2024-09-17T01:36:12.866481+0000","last_clean":"2024-09-17T01:36:12.866481+0000","last_became_active":"2024-09-17T01:36:11.303095+0000","last_became_peered":"2024-09-17T01:36:11.303095+0000","last_unstale":"2024-09-17T01:36:12.866481+0000","last_undegraded":"2024-09-17T01:36:12.866481+0000","last_fullsized":"2024-09-17T01:36:12.866481+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:06.849909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304675+0000","last_change":"2024-09-17T01:36:11.311252+0000","last_active":"2024-09-17T01:36:12.304675+0000","last_peered":"2024-09-17T01:36:12.304675+0000","last_clean":"2024-09-17T01:36:12.304675+0000","last_became_active":"2024-09-17T01:36:11.304478+0000","last_became_peered":"2024-09-17T01:36:11.304478+0000","last_unstale":"2024-09-17T01:36:12.304675+0000","last_undegraded":"2024-09-17T01:36:12.304675+0000","last_fullsized":"2024-09-17T01:36:12.304675+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:24.361465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925132+0000","last_change":"2024-09-17T01:36:11.315637+0000","last_active":"2024-09-17T01:36:12.925132+0000","last_peered":"2024-09-17T01:36:12.925132+0000","last_clean":"2024-09-17T01:36:12.925132+0000","last_became_active":"2024-09-17T01:36:11.314795+0000","last_became_peered":"2024-09-17T01:36:11.314795+0000","last_unstale":"2024-09-17T01:36:12.925132+0000","last_undegraded":"2024-09-17T01:36:12.925132+0000","last_fullsized":"2024-09-17T01:36:12.925132+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:18.981223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866361+0000","last_change":"2024-09-17T01:36:11.313898+0000","last_active":"2024-09-17T01:36:12.866361+0000","last_peered":"2024-09-17T01:36:12.866361+0000","last_clean":"2024-09-17T01:36:12.866361+0000","last_became_active":"2024-09-17T01:36:11.313556+0000","last_became_peered":"2024-09-17T01:36:11.313556+0000","last_unstale":"2024-09-17T01:36:12.866361+0000","last_undegraded":"2024-09-17T01:36:12.866361+0000","last_fullsized":"2024-09-17T01:36:12.866361+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:22:02.980623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992700+0000","last_change":"2024-09-17T01:36:11.308618+0000","last_active":"2024-09-17T01:36:12.992700+0000","last_peered":"2024-09-17T01:36:12.992700+0000","last_clean":"2024-09-17T01:36:12.992700+0000","last_became_active":"2024-09-17T01:36:11.308319+0000","last_became_peered":"2024-09-17T01:36:11.308319+0000","last_unstale":"2024-09-17T01:36:12.992700+0000","last_undegraded":"2024-09-17T01:36:12.992700+0000","last_fullsized":"2024-09-17T01:36:12.992700+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:34.276355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.300991+0000","last_change":"2024-09-17T01:36:11.326823+0000","last_active":"2024-09-17T01:36:12.300991+0000","last_peered":"2024-09-17T01:36:12.300991+0000","last_clean":"2024-09-17T01:36:12.300991+0000","last_became_active":"2024-09-17T01:36:11.326477+0000","last_became_peered":"2024-09-17T01:36:11.326477+0000","last_unstale":"2024-09-17T01:36:12.300991+0000","last_undegraded":"2024-09-17T01:36:12.300991+0000","last_fullsized":"2024-09-17T01:36:12.300991+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:55:12.981794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992453+0000","last_change":"2024-09-17T01:36:11.318165+0000","last_active":"2024-09-17T01:36:12.992453+0000","last_peered":"2024-09-17T01:36:12.992453+0000","last_clean":"2024-09-17T01:36:12.992453+0000","last_became_active":"2024-09-17T01:36:11.317875+0000","last_became_peered":"2024-09-17T01:36:11.317875+0000","last_unstale":"2024-09-17T01:36:12.992453+0000","last_undegraded":"2024-09-17T01:36:12.992453+0000","last_fullsized":"2024-09-17T01:36:12.992453+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:00.765527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303951+0000","last_change":"2024-09-17T01:36:11.297004+0000","last_active":"2024-09-17T01:36:12.303951+0000","last_peered":"2024-09-17T01:36:12.303951+0000","last_clean":"2024-09-17T01:36:12.303951+0000","last_became_active":"2024-09-17T01:36:11.296661+0000","last_became_peered":"2024-09-17T01:36:11.296661+0000","last_unstale":"2024-09-17T01:36:12.303951+0000","last_undegraded":"2024-09-17T01:36:12.303951+0000","last_fullsized":"2024-09-17T01:36:12.303951+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:18.099170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305020+0000","last_change":"2024-09-17T01:36:11.303184+0000","last_active":"2024-09-17T01:36:12.305020+0000","last_peered":"2024-09-17T01:36:12.305020+0000","last_clean":"2024-09-17T01:36:12.305020+0000","last_became_active":"2024-09-17T01:36:11.302826+0000","last_became_peered":"2024-09-17T01:36:11.302826+0000","last_unstale":"2024-09-17T01:36:12.305020+0000","last_undegraded":"2024-09-17T01:36:12.305020+0000","last_fullsized":"2024-09-17T01:36:12.305020+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:59.362677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301563+0000","last_change":"2024-09-17T01:36:11.313129+0000","last_active":"2024-09-17T01:36:12.301563+0000","last_peered":"2024-09-17T01:36:12.301563+0000","last_clean":"2024-09-17T01:36:12.301563+0000","last_became_active":"2024-09-17T01:36:11.312821+0000","last_became_peered":"2024-09-17T01:36:11.312821+0000","last_unstale":"2024-09-17T01:36:12.301563+0000","last_undegraded":"2024-09-17T01:36:12.301563+0000","last_fullsized":"2024-09-17T01:36:12.301563+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:14.012926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023564+0000","last_change":"2024-09-17T01:36:11.323204+0000","last_active":"2024-09-17T01:36:13.023564+0000","last_peered":"2024-09-17T01:36:13.023564+0000","last_clean":"2024-09-17T01:36:13.023564+0000","last_became_active":"2024-09-17T01:36:11.322063+0000","last_became_peered":"2024-09-17T01:36:11.322063+0000","last_unstale":"2024-09-17T01:36:13.023564+0000","last_undegraded":"2024-09-17T01:36:13.023564+0000","last_fullsized":"2024-09-17T01:36:13.023564+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:11.122810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925263+0000","last_change":"2024-09-17T01:36:11.315695+0000","last_active":"2024-09-17T01:36:12.925263+0000","last_peered":"2024-09-17T01:36:12.925263+0000","last_clean":"2024-09-17T01:36:12.925263+0000","last_became_active":"2024-09-17T01:36:11.315143+0000","last_became_peered":"2024-09-17T01:36:11.315143+0000","last_unstale":"2024-09-17T01:36:12.925263+0000","last_undegraded":"2024-09-17T01:36:12.925263+0000","last_fullsized":"2024-09-17T01:36:12.925263+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:35.194646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992684+0000","last_change":"2024-09-17T01:36:11.323619+0000","last_active":"2024-09-17T01:36:12.992684+0000","last_peered":"2024-09-17T01:36:12.992684+0000","last_clean":"2024-09-17T01:36:12.992684+0000","last_became_active":"2024-09-17T01:36:11.323346+0000","last_became_peered":"2024-09-17T01:36:11.323346+0000","last_unstale":"2024-09-17T01:36:12.992684+0000","last_undegraded":"2024-09-17T01:36:12.992684+0000","last_fullsized":"2024-09-17T01:36:12.992684+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:08.202105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925295+0000","last_change":"2024-09-17T01:36:11.305911+0000","last_active":"2024-09-17T01:36:12.925295+0000","last_peered":"2024-09-17T01:36:12.925295+0000","last_clean":"2024-09-17T01:36:12.925295+0000","last_became_active":"2024-09-17T01:36:11.305567+0000","last_became_peered":"2024-09-17T01:36:11.305567+0000","last_unstale":"2024-09-17T01:36:12.925295+0000","last_undegraded":"2024-09-17T01:36:12.925295+0000","last_fullsized":"2024-09-17T01:36:12.925295+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:07.419500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076616+0000","last_change":"2024-09-17T01:36:11.310245+0000","last_active":"2024-09-17T01:36:13.076616+0000","last_peered":"2024-09-17T01:36:13.076616+0000","last_clean":"2024-09-17T01:36:13.076616+0000","last_became_active":"2024-09-17T01:36:11.309949+0000","last_became_peered":"2024-09-17T01:36:11.309949+0000","last_unstale":"2024-09-17T01:36:13.076616+0000","last_undegraded":"2024-09-17T01:36:13.076616+0000","last_fullsized":"2024-09-17T01:36:13.076616+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:42.594893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866214+0000","last_change":"2024-09-17T01:36:11.318149+0000","last_active":"2024-09-17T01:36:12.866214+0000","last_peered":"2024-09-17T01:36:12.866214+0000","last_clean":"2024-09-17T01:36:12.866214+0000","last_became_active":"2024-09-17T01:36:11.317798+0000","last_became_peered":"2024-09-17T01:36:11.317798+0000","last_unstale":"2024-09-17T01:36:12.866214+0000","last_undegraded":"2024-09-17T01:36:12.866214+0000","last_fullsized":"2024-09-17T01:36:12.866214+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:52.367069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023788+0000","last_change":"2024-09-17T01:36:11.325158+0000","last_active":"2024-09-17T01:36:13.023788+0000","last_peered":"2024-09-17T01:36:13.023788+0000","last_clean":"2024-09-17T01:36:13.023788+0000","last_became_active":"2024-09-17T01:36:11.323928+0000","last_became_peered":"2024-09-17T01:36:11.323928+0000","last_unstale":"2024-09-17T01:36:13.023788+0000","last_undegraded":"2024-09-17T01:36:13.023788+0000","last_fullsized":"2024-09-17T01:36:13.023788+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:26.441833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.993007+0000","last_change":"2024-09-17T01:36:11.314300+0000","last_active":"2024-09-17T01:36:12.993007+0000","last_peered":"2024-09-17T01:36:12.993007+0000","last_clean":"2024-09-17T01:36:12.993007+0000","last_became_active":"2024-09-17T01:36:11.313197+0000","last_became_peered":"2024-09-17T01:36:11.313197+0000","last_unstale":"2024-09-17T01:36:12.993007+0000","last_undegraded":"2024-09-17T01:36:12.993007+0000","last_fullsized":"2024-09-17T01:36:12.993007+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:24.449150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023920+0000","last_change":"2024-09-17T01:36:11.318641+0000","last_active":"2024-09-17T01:36:13.023920+0000","last_peered":"2024-09-17T01:36:13.023920+0000","last_clean":"2024-09-17T01:36:13.023920+0000","last_became_active":"2024-09-17T01:36:11.317933+0000","last_became_peered":"2024-09-17T01:36:11.317933+0000","last_unstale":"2024-09-17T01:36:13.023920+0000","last_undegraded":"2024-09-17T01:36:13.023920+0000","last_fullsized":"2024-09-17T01:36:13.023920+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:07:47.466557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303627+0000","last_change":"2024-09-17T01:36:11.317931+0000","last_active":"2024-09-17T01:36:12.303627+0000","last_peered":"2024-09-17T01:36:12.303627+0000","last_clean":"2024-09-17T01:36:12.303627+0000","last_became_active":"2024-09-17T01:36:11.310928+0000","last_became_peered":"2024-09-17T01:36:11.310928+0000","last_unstale":"2024-09-17T01:36:12.303627+0000","last_undegraded":"2024-09-17T01:36:12.303627+0000","last_fullsized":"2024-09-17T01:36:12.303627+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:04.246558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304597+0000","last_change":"2024-09-17T01:36:11.308715+0000","last_active":"2024-09-17T01:36:12.304597+0000","last_peered":"2024-09-17T01:36:12.304597+0000","last_clean":"2024-09-17T01:36:12.304597+0000","last_became_active":"2024-09-17T01:36:11.308287+0000","last_became_peered":"2024-09-17T01:36:11.308287+0000","last_unstale":"2024-09-17T01:36:12.304597+0000","last_undegraded":"2024-09-17T01:36:12.304597+0000","last_fullsized":"2024-09-17T01:36:12.304597+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:57.671724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076588+0000","last_change":"2024-09-17T01:36:11.304384+0000","last_active":"2024-09-17T01:36:13.076588+0000","last_peered":"2024-09-17T01:36:13.076588+0000","last_clean":"2024-09-17T01:36:13.076588+0000","last_became_active":"2024-09-17T01:36:11.302561+0000","last_became_peered":"2024-09-17T01:36:11.302561+0000","last_unstale":"2024-09-17T01:36:13.076588+0000","last_undegraded":"2024-09-17T01:36:13.076588+0000","last_fullsized":"2024-09-17T01:36:13.076588+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:36.574249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023288+0000","last_change":"2024-09-17T01:36:11.313970+0000","last_active":"2024-09-17T01:36:13.023288+0000","last_peered":"2024-09-17T01:36:13.023288+0000","last_clean":"2024-09-17T01:36:13.023288+0000","last_became_active":"2024-09-17T01:36:11.310156+0000","last_became_peered":"2024-09-17T01:36:11.310156+0000","last_unstale":"2024-09-17T01:36:13.023288+0000","last_undegraded":"2024-09-17T01:36:13.023288+0000","last_fullsized":"2024-09-17T01:36:13.023288+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:58.276824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925181+0000","last_change":"2024-09-17T01:36:11.306107+0000","last_active":"2024-09-17T01:36:12.925181+0000","last_peered":"2024-09-17T01:36:12.925181+0000","last_clean":"2024-09-17T01:36:12.925181+0000","last_became_active":"2024-09-17T01:36:11.305764+0000","last_became_peered":"2024-09-17T01:36:11.305764+0000","last_unstale":"2024-09-17T01:36:12.925181+0000","last_undegraded":"2024-09-17T01:36:12.925181+0000","last_fullsized":"2024-09-17T01:36:12.925181+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:09.482083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305187+0000","last_change":"2024-09-17T01:36:11.297563+0000","last_active":"2024-09-17T01:36:12.305187+0000","last_peered":"2024-09-17T01:36:12.305187+0000","last_clean":"2024-09-17T01:36:12.305187+0000","last_became_active":"2024-09-17T01:36:11.297236+0000","last_became_peered":"2024-09-17T01:36:11.297236+0000","last_unstale":"2024-09-17T01:36:12.305187+0000","last_undegraded":"2024-09-17T01:36:12.305187+0000","last_fullsized":"2024-09-17T01:36:12.305187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:28.959565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925285+0000","last_change":"2024-09-17T01:36:10.292457+0000","last_active":"2024-09-17T01:36:12.925285+0000","last_peered":"2024-09-17T01:36:12.925285+0000","last_clean":"2024-09-17T01:36:12.925285+0000","last_became_active":"2024-09-17T01:36:10.292073+0000","last_became_peered":"2024-09-17T01:36:10.292073+0000","last_unstale":"2024-09-17T01:36:12.925285+0000","last_undegraded":"2024-09-17T01:36:12.925285+0000","last_fullsized":"2024-09-17T01:36:12.925285+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:47.680334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305127+0000","last_change":"2024-09-17T01:36:11.314223+0000","last_active":"2024-09-17T01:36:12.305127+0000","last_peered":"2024-09-17T01:36:12.305127+0000","last_clean":"2024-09-17T01:36:12.305127+0000","last_became_active":"2024-09-17T01:36:11.313462+0000","last_became_peered":"2024-09-17T01:36:11.313462+0000","last_unstale":"2024-09-17T01:36:12.305127+0000","last_undegraded":"2024-09-17T01:36:12.305127+0000","last_fullsized":"2024-09-17T01:36:12.305127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:48.686497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023531+0000","last_change":"2024-09-17T01:36:10.295597+0000","last_active":"2024-09-17T01:36:13.023531+0000","last_peered":"2024-09-17T01:36:13.023531+0000","last_clean":"2024-09-17T01:36:13.023531+0000","last_became_active":"2024-09-17T01:36:10.295269+0000","last_became_peered":"2024-09-17T01:36:10.295269+0000","last_unstale":"2024-09-17T01:36:13.023531+0000","last_undegraded":"2024-09-17T01:36:13.023531+0000","last_fullsized":"2024-09-17T01:36:13.023531+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:07.370466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303912+0000","last_change":"2024-09-17T01:36:11.320059+0000","last_active":"2024-09-17T01:36:12.303912+0000","last_peered":"2024-09-17T01:36:12.303912+0000","last_clean":"2024-09-17T01:36:12.303912+0000","last_became_active":"2024-09-17T01:36:11.319721+0000","last_became_peered":"2024-09-17T01:36:11.319721+0000","last_unstale":"2024-09-17T01:36:12.303912+0000","last_undegraded":"2024-09-17T01:36:12.303912+0000","last_fullsized":"2024-09-17T01:36:12.303912+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:59.228610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303898+0000","last_change":"2024-09-17T01:36:10.286360+0000","last_active":"2024-09-17T01:36:12.303898+0000","last_peered":"2024-09-17T01:36:12.303898+0000","last_clean":"2024-09-17T01:36:12.303898+0000","last_became_active":"2024-09-17T01:36:10.285959+0000","last_became_peered":"2024-09-17T01:36:10.285959+0000","last_unstale":"2024-09-17T01:36:12.303898+0000","last_undegraded":"2024-09-17T01:36:12.303898+0000","last_fullsized":"2024-09-17T01:36:12.303898+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:11.061550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305368+0000","last_change":"2024-09-17T01:36:11.309231+0000","last_active":"2024-09-17T01:36:12.305368+0000","last_peered":"2024-09-17T01:36:12.305368+0000","last_clean":"2024-09-17T01:36:12.305368+0000","last_became_active":"2024-09-17T01:36:11.304902+0000","last_became_peered":"2024-09-17T01:36:11.304902+0000","last_unstale":"2024-09-17T01:36:12.305368+0000","last_undegraded":"2024-09-17T01:36:12.305368+0000","last_fullsized":"2024-09-17T01:36:12.305368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:56.613111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076709+0000","last_change":"2024-09-17T01:36:10.300133+0000","last_active":"2024-09-17T01:36:13.076709+0000","last_peered":"2024-09-17T01:36:13.076709+0000","last_clean":"2024-09-17T01:36:13.076709+0000","last_became_active":"2024-09-17T01:36:10.299955+0000","last_became_peered":"2024-09-17T01:36:10.299955+0000","last_unstale":"2024-09-17T01:36:13.076709+0000","last_undegraded":"2024-09-17T01:36:13.076709+0000","last_fullsized":"2024-09-17T01:36:13.076709+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:48.285259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303509+0000","last_change":"2024-09-17T01:36:11.323505+0000","last_active":"2024-09-17T01:36:12.303509+0000","last_peered":"2024-09-17T01:36:12.303509+0000","last_clean":"2024-09-17T01:36:12.303509+0000","last_became_active":"2024-09-17T01:36:11.323174+0000","last_became_peered":"2024-09-17T01:36:11.323174+0000","last_unstale":"2024-09-17T01:36:12.303509+0000","last_undegraded":"2024-09-17T01:36:12.303509+0000","last_fullsized":"2024-09-17T01:36:12.303509+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:48.884777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301265+0000","last_change":"2024-09-17T01:36:10.291224+0000","last_active":"2024-09-17T01:36:12.301265+0000","last_peered":"2024-09-17T01:36:12.301265+0000","last_clean":"2024-09-17T01:36:12.301265+0000","last_became_active":"2024-09-17T01:36:10.290471+0000","last_became_peered":"2024-09-17T01:36:10.290471+0000","last_unstale":"2024-09-17T01:36:12.301265+0000","last_undegraded":"2024-09-17T01:36:12.301265+0000","last_fullsized":"2024-09-17T01:36:12.301265+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:22:02.505106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.925183+0000","last_change":"2024-09-17T01:36:11.310201+0000","last_active":"2024-09-17T01:36:12.925183+0000","last_peered":"2024-09-17T01:36:12.925183+0000","last_clean":"2024-09-17T01:36:12.925183+0000","last_became_active":"2024-09-17T01:36:11.310003+0000","last_became_peered":"2024-09-17T01:36:11.310003+0000","last_unstale":"2024-09-17T01:36:12.925183+0000","last_undegraded":"2024-09-17T01:36:12.925183+0000","last_fullsized":"2024-09-17T01:36:12.925183+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:45.948182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305179+0000","last_change":"2024-09-17T01:36:10.293072+0000","last_active":"2024-09-17T01:36:12.305179+0000","last_peered":"2024-09-17T01:36:12.305179+0000","last_clean":"2024-09-17T01:36:12.305179+0000","last_became_active":"2024-09-17T01:36:10.290949+0000","last_became_peered":"2024-09-17T01:36:10.290949+0000","last_unstale":"2024-09-17T01:36:12.305179+0000","last_undegraded":"2024-09-17T01:36:12.305179+0000","last_fullsized":"2024-09-17T01:36:12.305179+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:40.448306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301070+0000","last_change":"2024-09-17T01:36:11.297597+0000","last_active":"2024-09-17T01:36:12.301070+0000","last_peered":"2024-09-17T01:36:12.301070+0000","last_clean":"2024-09-17T01:36:12.301070+0000","last_became_active":"2024-09-17T01:36:11.297261+0000","last_became_peered":"2024-09-17T01:36:11.297261+0000","last_unstale":"2024-09-17T01:36:12.301070+0000","last_undegraded":"2024-09-17T01:36:12.301070+0000","last_fullsized":"2024-09-17T01:36:12.301070+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:16.405238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.865999+0000","last_change":"2024-09-17T01:36:10.296734+0000","last_active":"2024-09-17T01:36:12.865999+0000","last_peered":"2024-09-17T01:36:12.865999+0000","last_clean":"2024-09-17T01:36:12.865999+0000","last_became_active":"2024-09-17T01:36:10.296463+0000","last_became_peered":"2024-09-17T01:36:10.296463+0000","last_unstale":"2024-09-17T01:36:12.865999+0000","last_undegraded":"2024-09-17T01:36:12.865999+0000","last_fullsized":"2024-09-17T01:36:12.865999+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:19.770144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303645+0000","last_change":"2024-09-17T01:36:11.306806+0000","last_active":"2024-09-17T01:36:12.303645+0000","last_peered":"2024-09-17T01:36:12.303645+0000","last_clean":"2024-09-17T01:36:12.303645+0000","last_became_active":"2024-09-17T01:36:11.306392+0000","last_became_peered":"2024-09-17T01:36:11.306392+0000","last_unstale":"2024-09-17T01:36:12.303645+0000","last_undegraded":"2024-09-17T01:36:12.303645+0000","last_fullsized":"2024-09-17T01:36:12.303645+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:58.962482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992402+0000","last_change":"2024-09-17T01:36:10.289402+0000","last_active":"2024-09-17T01:36:12.992402+0000","last_peered":"2024-09-17T01:36:12.992402+0000","last_clean":"2024-09-17T01:36:12.992402+0000","last_became_active":"2024-09-17T01:36:10.289028+0000","last_became_peered":"2024-09-17T01:36:10.289028+0000","last_unstale":"2024-09-17T01:36:12.992402+0000","last_undegraded":"2024-09-17T01:36:12.992402+0000","last_fullsized":"2024-09-17T01:36:12.992402+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:54.956235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.993014+0000","last_change":"2024-09-17T01:36:11.302630+0000","last_active":"2024-09-17T01:36:12.993014+0000","last_peered":"2024-09-17T01:36:12.993014+0000","last_clean":"2024-09-17T01:36:12.993014+0000","last_became_active":"2024-09-17T01:36:11.302324+0000","last_became_peered":"2024-09-17T01:36:11.302324+0000","last_unstale":"2024-09-17T01:36:12.993014+0000","last_undegraded":"2024-09-17T01:36:12.993014+0000","last_fullsized":"2024-09-17T01:36:12.993014+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:35.263900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866234+0000","last_change":"2024-09-17T01:36:10.293964+0000","last_active":"2024-09-17T01:36:12.866234+0000","last_peered":"2024-09-17T01:36:12.866234+0000","last_clean":"2024-09-17T01:36:12.866234+0000","last_became_active":"2024-09-17T01:36:10.293658+0000","last_became_peered":"2024-09-17T01:36:10.293658+0000","last_unstale":"2024-09-17T01:36:12.866234+0000","last_undegraded":"2024-09-17T01:36:12.866234+0000","last_fullsized":"2024-09-17T01:36:12.866234+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:37.278082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301761+0000","last_change":"2024-09-17T01:36:11.326023+0000","last_active":"2024-09-17T01:36:12.301761+0000","last_peered":"2024-09-17T01:36:12.301761+0000","last_clean":"2024-09-17T01:36:12.301761+0000","last_became_active":"2024-09-17T01:36:11.325355+0000","last_became_peered":"2024-09-17T01:36:11.325355+0000","last_unstale":"2024-09-17T01:36:12.301761+0000","last_undegraded":"2024-09-17T01:36:12.301761+0000","last_fullsized":"2024-09-17T01:36:12.301761+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:18.945861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304174+0000","last_change":"2024-09-17T01:36:10.294720+0000","last_active":"2024-09-17T01:36:12.304174+0000","last_peered":"2024-09-17T01:36:12.304174+0000","last_clean":"2024-09-17T01:36:12.304174+0000","last_became_active":"2024-09-17T01:36:10.294012+0000","last_became_peered":"2024-09-17T01:36:10.294012+0000","last_unstale":"2024-09-17T01:36:12.304174+0000","last_undegraded":"2024-09-17T01:36:12.304174+0000","last_fullsized":"2024-09-17T01:36:12.304174+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:29.017109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304165+0000","last_change":"2024-09-17T01:36:11.319252+0000","last_active":"2024-09-17T01:36:12.304165+0000","last_peered":"2024-09-17T01:36:12.304165+0000","last_clean":"2024-09-17T01:36:12.304165+0000","last_became_active":"2024-09-17T01:36:11.316127+0000","last_became_peered":"2024-09-17T01:36:11.316127+0000","last_unstale":"2024-09-17T01:36:12.304165+0000","last_undegraded":"2024-09-17T01:36:12.304165+0000","last_fullsized":"2024-09-17T01:36:12.304165+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:57:36.447976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.077184+0000","last_change":"2024-09-17T01:36:10.298237+0000","last_active":"2024-09-17T01:36:13.077184+0000","last_peered":"2024-09-17T01:36:13.077184+0000","last_clean":"2024-09-17T01:36:13.077184+0000","last_became_active":"2024-09-17T01:36:10.297914+0000","last_became_peered":"2024-09-17T01:36:10.297914+0000","last_unstale":"2024-09-17T01:36:13.077184+0000","last_undegraded":"2024-09-17T01:36:13.077184+0000","last_fullsized":"2024-09-17T01:36:13.077184+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:58.586762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076884+0000","last_change":"2024-09-17T01:36:11.310102+0000","last_active":"2024-09-17T01:36:13.076884+0000","last_peered":"2024-09-17T01:36:13.076884+0000","last_clean":"2024-09-17T01:36:13.076884+0000","last_became_active":"2024-09-17T01:36:11.309689+0000","last_became_peered":"2024-09-17T01:36:11.309689+0000","last_unstale":"2024-09-17T01:36:13.076884+0000","last_undegraded":"2024-09-17T01:36:13.076884+0000","last_fullsized":"2024-09-17T01:36:13.076884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:00.158245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":21,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992768+0000","last_change":"2024-09-17T01:36:10.292473+0000","last_active":"2024-09-17T01:36:12.992768+0000","last_peered":"2024-09-17T01:36:12.992768+0000","last_clean":"2024-09-17T01:36:12.992768+0000","last_became_active":"2024-09-17T01:36:10.292161+0000","last_became_peered":"2024-09-17T01:36:10.292161+0000","last_unstale":"2024-09-17T01:36:12.992768+0000","last_undegraded":"2024-09-17T01:36:12.992768+0000","last_fullsized":"2024-09-17T01:36:12.992768+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:03.337816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866232+0000","last_change":"2024-09-17T01:36:11.308108+0000","last_active":"2024-09-17T01:36:12.866232+0000","last_peered":"2024-09-17T01:36:12.866232+0000","last_clean":"2024-09-17T01:36:12.866232+0000","last_became_active":"2024-09-17T01:36:11.307801+0000","last_became_peered":"2024-09-17T01:36:11.307801+0000","last_unstale":"2024-09-17T01:36:12.866232+0000","last_undegraded":"2024-09-17T01:36:12.866232+0000","last_fullsized":"2024-09-17T01:36:12.866232+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:42.954974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303899+0000","last_change":"2024-09-17T01:36:10.293577+0000","last_active":"2024-09-17T01:36:12.303899+0000","last_peered":"2024-09-17T01:36:12.303899+0000","last_clean":"2024-09-17T01:36:12.303899+0000","last_became_active":"2024-09-17T01:36:10.291934+0000","last_became_peered":"2024-09-17T01:36:10.291934+0000","last_unstale":"2024-09-17T01:36:12.303899+0000","last_undegraded":"2024-09-17T01:36:12.303899+0000","last_fullsized":"2024-09-17T01:36:12.303899+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:15.757296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301178+0000","last_change":"2024-09-17T01:36:11.304308+0000","last_active":"2024-09-17T01:36:12.301178+0000","last_peered":"2024-09-17T01:36:12.301178+0000","last_clean":"2024-09-17T01:36:12.301178+0000","last_became_active":"2024-09-17T01:36:11.303985+0000","last_became_peered":"2024-09-17T01:36:11.303985+0000","last_unstale":"2024-09-17T01:36:12.301178+0000","last_undegraded":"2024-09-17T01:36:12.301178+0000","last_fullsized":"2024-09-17T01:36:12.301178+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:26.808029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076416+0000","last_change":"2024-09-17T01:36:10.291611+0000","last_active":"2024-09-17T01:36:13.076416+0000","last_peered":"2024-09-17T01:36:13.076416+0000","last_clean":"2024-09-17T01:36:13.076416+0000","last_became_active":"2024-09-17T01:36:10.291234+0000","last_became_peered":"2024-09-17T01:36:10.291234+0000","last_unstale":"2024-09-17T01:36:13.076416+0000","last_undegraded":"2024-09-17T01:36:13.076416+0000","last_fullsized":"2024-09-17T01:36:13.076416+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:22.528484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866341+0000","last_change":"2024-09-17T01:36:11.313891+0000","last_active":"2024-09-17T01:36:12.866341+0000","last_peered":"2024-09-17T01:36:12.866341+0000","last_clean":"2024-09-17T01:36:12.866341+0000","last_became_active":"2024-09-17T01:36:11.313582+0000","last_became_peered":"2024-09-17T01:36:11.313582+0000","last_unstale":"2024-09-17T01:36:12.866341+0000","last_undegraded":"2024-09-17T01:36:12.866341+0000","last_fullsized":"2024-09-17T01:36:12.866341+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:22.521895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076693+0000","last_change":"2024-09-17T01:36:10.286012+0000","last_active":"2024-09-17T01:36:13.076693+0000","last_peered":"2024-09-17T01:36:13.076693+0000","last_clean":"2024-09-17T01:36:13.076693+0000","last_became_active":"2024-09-17T01:36:10.284940+0000","last_became_peered":"2024-09-17T01:36:10.284940+0000","last_unstale":"2024-09-17T01:36:13.076693+0000","last_undegraded":"2024-09-17T01:36:13.076693+0000","last_fullsized":"2024-09-17T01:36:13.076693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:00.539807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076838+0000","last_change":"2024-09-17T01:36:11.309989+0000","last_active":"2024-09-17T01:36:13.076838+0000","last_peered":"2024-09-17T01:36:13.076838+0000","last_clean":"2024-09-17T01:36:13.076838+0000","last_became_active":"2024-09-17T01:36:11.309641+0000","last_became_peered":"2024-09-17T01:36:11.309641+0000","last_unstale":"2024-09-17T01:36:13.076838+0000","last_undegraded":"2024-09-17T01:36:13.076838+0000","last_fullsized":"2024-09-17T01:36:13.076838+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:40.530982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":23,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.076341+0000","last_change":"2024-09-17T01:36:10.295240+0000","last_active":"2024-09-17T01:36:13.076341+0000","last_peered":"2024-09-17T01:36:13.076341+0000","last_clean":"2024-09-17T01:36:13.076341+0000","last_became_active":"2024-09-17T01:36:10.294945+0000","last_became_peered":"2024-09-17T01:36:10.294945+0000","last_unstale":"2024-09-17T01:36:13.076341+0000","last_undegraded":"2024-09-17T01:36:13.076341+0000","last_fullsized":"2024-09-17T01:36:13.076341+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:55.304271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301589+0000","last_change":"2024-09-17T01:36:11.307572+0000","last_active":"2024-09-17T01:36:12.301589+0000","last_peered":"2024-09-17T01:36:12.301589+0000","last_clean":"2024-09-17T01:36:12.301589+0000","last_became_active":"2024-09-17T01:36:11.307269+0000","last_became_peered":"2024-09-17T01:36:11.307269+0000","last_unstale":"2024-09-17T01:36:12.301589+0000","last_undegraded":"2024-09-17T01:36:12.301589+0000","last_fullsized":"2024-09-17T01:36:12.301589+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:13.770369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023621+0000","last_change":"2024-09-17T01:36:10.298316+0000","last_active":"2024-09-17T01:36:13.023621+0000","last_peered":"2024-09-17T01:36:13.023621+0000","last_clean":"2024-09-17T01:36:13.023621+0000","last_became_active":"2024-09-17T01:36:10.297999+0000","last_became_peered":"2024-09-17T01:36:10.297999+0000","last_unstale":"2024-09-17T01:36:13.023621+0000","last_undegraded":"2024-09-17T01:36:13.023621+0000","last_fullsized":"2024-09-17T01:36:13.023621+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:38:13.536708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301796+0000","last_change":"2024-09-17T01:36:11.326191+0000","last_active":"2024-09-17T01:36:12.301796+0000","last_peered":"2024-09-17T01:36:12.301796+0000","last_clean":"2024-09-17T01:36:12.301796+0000","last_became_active":"2024-09-17T01:36:11.325735+0000","last_became_peered":"2024-09-17T01:36:11.325735+0000","last_unstale":"2024-09-17T01:36:12.301796+0000","last_undegraded":"2024-09-17T01:36:12.301796+0000","last_fullsized":"2024-09-17T01:36:12.301796+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:08.466853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304328+0000","last_change":"2024-09-17T01:36:10.294353+0000","last_active":"2024-09-17T01:36:12.304328+0000","last_peered":"2024-09-17T01:36:12.304328+0000","last_clean":"2024-09-17T01:36:12.304328+0000","last_became_active":"2024-09-17T01:36:10.293440+0000","last_became_peered":"2024-09-17T01:36:10.293440+0000","last_unstale":"2024-09-17T01:36:12.304328+0000","last_undegraded":"2024-09-17T01:36:12.304328+0000","last_fullsized":"2024-09-17T01:36:12.304328+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:33.626765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023594+0000","last_change":"2024-09-17T01:36:11.320250+0000","last_active":"2024-09-17T01:36:13.023594+0000","last_peered":"2024-09-17T01:36:13.023594+0000","last_clean":"2024-09-17T01:36:13.023594+0000","last_became_active":"2024-09-17T01:36:11.319913+0000","last_became_peered":"2024-09-17T01:36:11.319913+0000","last_unstale":"2024-09-17T01:36:13.023594+0000","last_undegraded":"2024-09-17T01:36:13.023594+0000","last_fullsized":"2024-09-17T01:36:13.023594+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:03.629335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301619+0000","last_change":"2024-09-17T01:36:10.294281+0000","last_active":"2024-09-17T01:36:12.301619+0000","last_peered":"2024-09-17T01:36:12.301619+0000","last_clean":"2024-09-17T01:36:12.301619+0000","last_became_active":"2024-09-17T01:36:10.293955+0000","last_became_peered":"2024-09-17T01:36:10.293955+0000","last_unstale":"2024-09-17T01:36:12.301619+0000","last_undegraded":"2024-09-17T01:36:12.301619+0000","last_fullsized":"2024-09-17T01:36:12.301619+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:42.019276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.077112+0000","last_change":"2024-09-17T01:36:11.320342+0000","last_active":"2024-09-17T01:36:13.077112+0000","last_peered":"2024-09-17T01:36:13.077112+0000","last_clean":"2024-09-17T01:36:13.077112+0000","last_became_active":"2024-09-17T01:36:11.320023+0000","last_became_peered":"2024-09-17T01:36:11.320023+0000","last_unstale":"2024-09-17T01:36:13.077112+0000","last_undegraded":"2024-09-17T01:36:13.077112+0000","last_fullsized":"2024-09-17T01:36:13.077112+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:26.695707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304315+0000","last_change":"2024-09-17T01:36:10.289087+0000","last_active":"2024-09-17T01:36:12.304315+0000","last_peered":"2024-09-17T01:36:12.304315+0000","last_clean":"2024-09-17T01:36:12.304315+0000","last_became_active":"2024-09-17T01:36:10.288721+0000","last_became_peered":"2024-09-17T01:36:10.288721+0000","last_unstale":"2024-09-17T01:36:12.304315+0000","last_undegraded":"2024-09-17T01:36:12.304315+0000","last_fullsized":"2024-09-17T01:36:12.304315+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:24:11.811046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866397+0000","last_change":"2024-09-17T01:36:11.319574+0000","last_active":"2024-09-17T01:36:12.866397+0000","last_peered":"2024-09-17T01:36:12.866397+0000","last_clean":"2024-09-17T01:36:12.866397+0000","last_became_active":"2024-09-17T01:36:11.317100+0000","last_became_peered":"2024-09-17T01:36:11.317100+0000","last_unstale":"2024-09-17T01:36:12.866397+0000","last_undegraded":"2024-09-17T01:36:12.866397+0000","last_fullsized":"2024-09-17T01:36:12.866397+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:50.155552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.924945+0000","last_change":"2024-09-17T01:36:10.295963+0000","last_active":"2024-09-17T01:36:12.924945+0000","last_peered":"2024-09-17T01:36:12.924945+0000","last_clean":"2024-09-17T01:36:12.924945+0000","last_became_active":"2024-09-17T01:36:10.294487+0000","last_became_peered":"2024-09-17T01:36:10.294487+0000","last_unstale":"2024-09-17T01:36:12.924945+0000","last_undegraded":"2024-09-17T01:36:12.924945+0000","last_fullsized":"2024-09-17T01:36:12.924945+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:18:44.054224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303371+0000","last_change":"2024-09-17T01:36:11.314041+0000","last_active":"2024-09-17T01:36:12.303371+0000","last_peered":"2024-09-17T01:36:12.303371+0000","last_clean":"2024-09-17T01:36:12.303371+0000","last_became_active":"2024-09-17T01:36:11.313573+0000","last_became_peered":"2024-09-17T01:36:11.313573+0000","last_unstale":"2024-09-17T01:36:12.303371+0000","last_undegraded":"2024-09-17T01:36:12.303371+0000","last_fullsized":"2024-09-17T01:36:12.303371+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:30.847327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303084+0000","last_change":"2024-09-17T01:36:10.293477+0000","last_active":"2024-09-17T01:36:12.303084+0000","last_peered":"2024-09-17T01:36:12.303084+0000","last_clean":"2024-09-17T01:36:12.303084+0000","last_became_active":"2024-09-17T01:36:10.293119+0000","last_became_peered":"2024-09-17T01:36:10.293119+0000","last_unstale":"2024-09-17T01:36:12.303084+0000","last_undegraded":"2024-09-17T01:36:12.303084+0000","last_fullsized":"2024-09-17T01:36:12.303084+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:02.386471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303044+0000","last_change":"2024-09-17T01:36:11.315150+0000","last_active":"2024-09-17T01:36:12.303044+0000","last_peered":"2024-09-17T01:36:12.303044+0000","last_clean":"2024-09-17T01:36:12.303044+0000","last_became_active":"2024-09-17T01:36:11.314846+0000","last_became_peered":"2024-09-17T01:36:11.314846+0000","last_unstale":"2024-09-17T01:36:12.303044+0000","last_undegraded":"2024-09-17T01:36:12.303044+0000","last_fullsized":"2024-09-17T01:36:12.303044+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:08.297937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866344+0000","last_change":"2024-09-17T01:36:10.280718+0000","last_active":"2024-09-17T01:36:12.866344+0000","last_peered":"2024-09-17T01:36:12.866344+0000","last_clean":"2024-09-17T01:36:12.866344+0000","last_became_active":"2024-09-17T01:36:10.280401+0000","last_became_peered":"2024-09-17T01:36:10.280401+0000","last_unstale":"2024-09-17T01:36:12.866344+0000","last_undegraded":"2024-09-17T01:36:12.866344+0000","last_fullsized":"2024-09-17T01:36:12.866344+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:46.578001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301843+0000","last_change":"2024-09-17T01:36:11.311989+0000","last_active":"2024-09-17T01:36:12.301843+0000","last_peered":"2024-09-17T01:36:12.301843+0000","last_clean":"2024-09-17T01:36:12.301843+0000","last_became_active":"2024-09-17T01:36:11.310340+0000","last_became_peered":"2024-09-17T01:36:11.310340+0000","last_unstale":"2024-09-17T01:36:12.301843+0000","last_undegraded":"2024-09-17T01:36:12.301843+0000","last_fullsized":"2024-09-17T01:36:12.301843+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:29.823125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023788+0000","last_change":"2024-09-17T01:36:10.298876+0000","last_active":"2024-09-17T01:36:13.023788+0000","last_peered":"2024-09-17T01:36:13.023788+0000","last_clean":"2024-09-17T01:36:13.023788+0000","last_became_active":"2024-09-17T01:36:10.298564+0000","last_became_peered":"2024-09-17T01:36:10.298564+0000","last_unstale":"2024-09-17T01:36:13.023788+0000","last_undegraded":"2024-09-17T01:36:13.023788+0000","last_fullsized":"2024-09-17T01:36:13.023788+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:48.499379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301928+0000","last_change":"2024-09-17T01:36:11.301724+0000","last_active":"2024-09-17T01:36:12.301928+0000","last_peered":"2024-09-17T01:36:12.301928+0000","last_clean":"2024-09-17T01:36:12.301928+0000","last_became_active":"2024-09-17T01:36:11.300895+0000","last_became_peered":"2024-09-17T01:36:11.300895+0000","last_unstale":"2024-09-17T01:36:12.301928+0000","last_undegraded":"2024-09-17T01:36:12.301928+0000","last_fullsized":"2024-09-17T01:36:12.301928+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:48:57.820654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"62'1","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.305072+0000","last_change":"2024-09-17T01:36:10.290784+0000","last_active":"2024-09-17T01:36:12.305072+0000","last_peered":"2024-09-17T01:36:12.305072+0000","last_clean":"2024-09-17T01:36:12.305072+0000","last_became_active":"2024-09-17T01:36:10.288289+0000","last_became_peered":"2024-09-17T01:36:10.288289+0000","last_unstale":"2024-09-17T01:36:12.305072+0000","last_undegraded":"2024-09-17T01:36:12.305072+0000","last_fullsized":"2024-09-17T01:36:12.305072+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:25.435670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023456+0000","last_change":"2024-09-17T01:36:11.316442+0000","last_active":"2024-09-17T01:36:13.023456+0000","last_peered":"2024-09-17T01:36:13.023456+0000","last_clean":"2024-09-17T01:36:13.023456+0000","last_became_active":"2024-09-17T01:36:11.315668+0000","last_became_peered":"2024-09-17T01:36:11.315668+0000","last_unstale":"2024-09-17T01:36:13.023456+0000","last_undegraded":"2024-09-17T01:36:13.023456+0000","last_fullsized":"2024-09-17T01:36:13.023456+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:15:50.717398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.866158+0000","last_change":"2024-09-17T01:36:10.289540+0000","last_active":"2024-09-17T01:36:12.866158+0000","last_peered":"2024-09-17T01:36:12.866158+0000","last_clean":"2024-09-17T01:36:12.866158+0000","last_became_active":"2024-09-17T01:36:10.289239+0000","last_became_peered":"2024-09-17T01:36:10.289239+0000","last_unstale":"2024-09-17T01:36:12.866158+0000","last_undegraded":"2024-09-17T01:36:12.866158+0000","last_fullsized":"2024-09-17T01:36:12.866158+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:41.502277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303227+0000","last_change":"2024-09-17T01:36:11.309355+0000","last_active":"2024-09-17T01:36:12.303227+0000","last_peered":"2024-09-17T01:36:12.303227+0000","last_clean":"2024-09-17T01:36:12.303227+0000","last_became_active":"2024-09-17T01:36:11.308670+0000","last_became_peered":"2024-09-17T01:36:11.308670+0000","last_unstale":"2024-09-17T01:36:12.303227+0000","last_undegraded":"2024-09-17T01:36:12.303227+0000","last_fullsized":"2024-09-17T01:36:12.303227+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:52:53.600454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301188+0000","last_change":"2024-09-17T01:36:10.297976+0000","last_active":"2024-09-17T01:36:12.301188+0000","last_peered":"2024-09-17T01:36:12.301188+0000","last_clean":"2024-09-17T01:36:12.301188+0000","last_became_active":"2024-09-17T01:36:10.297673+0000","last_became_peered":"2024-09-17T01:36:10.297673+0000","last_unstale":"2024-09-17T01:36:12.301188+0000","last_undegraded":"2024-09-17T01:36:12.301188+0000","last_fullsized":"2024-09-17T01:36:12.301188+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:37.540406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304632+0000","last_change":"2024-09-17T01:36:11.300517+0000","last_active":"2024-09-17T01:36:12.304632+0000","last_peered":"2024-09-17T01:36:12.304632+0000","last_clean":"2024-09-17T01:36:12.304632+0000","last_became_active":"2024-09-17T01:36:11.300185+0000","last_became_peered":"2024-09-17T01:36:11.300185+0000","last_unstale":"2024-09-17T01:36:12.304632+0000","last_undegraded":"2024-09-17T01:36:12.304632+0000","last_fullsized":"2024-09-17T01:36:12.304632+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:56.615253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023327+0000","last_change":"2024-09-17T01:36:10.298497+0000","last_active":"2024-09-17T01:36:13.023327+0000","last_peered":"2024-09-17T01:36:13.023327+0000","last_clean":"2024-09-17T01:36:13.023327+0000","last_became_active":"2024-09-17T01:36:10.298121+0000","last_became_peered":"2024-09-17T01:36:10.298121+0000","last_unstale":"2024-09-17T01:36:13.023327+0000","last_undegraded":"2024-09-17T01:36:13.023327+0000","last_fullsized":"2024-09-17T01:36:13.023327+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:38.190524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992863+0000","last_change":"2024-09-17T01:36:11.321630+0000","last_active":"2024-09-17T01:36:12.992863+0000","last_peered":"2024-09-17T01:36:12.992863+0000","last_clean":"2024-09-17T01:36:12.992863+0000","last_became_active":"2024-09-17T01:36:11.321328+0000","last_became_peered":"2024-09-17T01:36:11.321328+0000","last_unstale":"2024-09-17T01:36:12.992863+0000","last_undegraded":"2024-09-17T01:36:12.992863+0000","last_fullsized":"2024-09-17T01:36:12.992863+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:39.391906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.301050+0000","last_change":"2024-09-17T01:36:10.296407+0000","last_active":"2024-09-17T01:36:12.301050+0000","last_peered":"2024-09-17T01:36:12.301050+0000","last_clean":"2024-09-17T01:36:12.301050+0000","last_became_active":"2024-09-17T01:36:10.296089+0000","last_became_peered":"2024-09-17T01:36:10.296089+0000","last_unstale":"2024-09-17T01:36:12.301050+0000","last_undegraded":"2024-09-17T01:36:12.301050+0000","last_fullsized":"2024-09-17T01:36:12.301050+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:43.430188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.302818+0000","last_change":"2024-09-17T01:36:11.310738+0000","last_active":"2024-09-17T01:36:12.302818+0000","last_peered":"2024-09-17T01:36:12.302818+0000","last_clean":"2024-09-17T01:36:12.302818+0000","last_became_active":"2024-09-17T01:36:11.310431+0000","last_became_peered":"2024-09-17T01:36:11.310431+0000","last_unstale":"2024-09-17T01:36:12.302818+0000","last_undegraded":"2024-09-17T01:36:12.302818+0000","last_fullsized":"2024-09-17T01:36:12.302818+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:54.749692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303734+0000","last_change":"2024-09-17T01:36:10.290312+0000","last_active":"2024-09-17T01:36:12.303734+0000","last_peered":"2024-09-17T01:36:12.303734+0000","last_clean":"2024-09-17T01:36:12.303734+0000","last_became_active":"2024-09-17T01:36:10.287956+0000","last_became_peered":"2024-09-17T01:36:10.287956+0000","last_unstale":"2024-09-17T01:36:12.303734+0000","last_undegraded":"2024-09-17T01:36:12.303734+0000","last_fullsized":"2024-09-17T01:36:12.303734+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:02.623172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:13.023505+0000","last_change":"2024-09-17T01:36:11.319336+0000","last_active":"2024-09-17T01:36:13.023505+0000","last_peered":"2024-09-17T01:36:13.023505+0000","last_clean":"2024-09-17T01:36:13.023505+0000","last_became_active":"2024-09-17T01:36:11.319012+0000","last_became_peered":"2024-09-17T01:36:11.319012+0000","last_unstale":"2024-09-17T01:36:13.023505+0000","last_undegraded":"2024-09-17T01:36:13.023505+0000","last_fullsized":"2024-09-17T01:36:13.023505+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:23.186639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.303218+0000","last_change":"2024-09-17T01:36:10.289718+0000","last_active":"2024-09-17T01:36:12.303218+0000","last_peered":"2024-09-17T01:36:12.303218+0000","last_clean":"2024-09-17T01:36:12.303218+0000","last_became_active":"2024-09-17T01:36:10.289409+0000","last_became_peered":"2024-09-17T01:36:10.289409+0000","last_unstale":"2024-09-17T01:36:12.303218+0000","last_undegraded":"2024-09-17T01:36:12.303218+0000","last_fullsized":"2024-09-17T01:36:12.303218+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:57.059026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.304882+0000","last_change":"2024-09-17T01:36:11.309282+0000","last_active":"2024-09-17T01:36:12.304882+0000","last_peered":"2024-09-17T01:36:12.304882+0000","last_clean":"2024-09-17T01:36:12.304882+0000","last_became_active":"2024-09-17T01:36:11.308775+0000","last_became_peered":"2024-09-17T01:36:11.308775+0000","last_unstale":"2024-09-17T01:36:12.304882+0000","last_undegraded":"2024-09-17T01:36:12.304882+0000","last_fullsized":"2024-09-17T01:36:12.304882+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:10.264668+0000","last_clean_scrub_stamp":"2024-09-17T01:36:10.264668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:20.099586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.992452+0000","last_change":"2024-09-17T01:36:10.294227+0000","last_active":"2024-09-17T01:36:12.992452+0000","last_peered":"2024-09-17T01:36:12.992452+0000","last_clean":"2024-09-17T01:36:12.992452+0000","last_became_active":"2024-09-17T01:36:10.291395+0000","last_became_peered":"2024-09-17T01:36:10.291395+0000","last_unstale":"2024-09-17T01:36:12.992452+0000","last_undegraded":"2024-09-17T01:36:12.992452+0000","last_fullsized":"2024-09-17T01:36:12.992452+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:09.258505+0000","last_clean_scrub_stamp":"2024-09-17T01:36:09.258505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:05.348862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":187,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T01:36:12.865857+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:36:12.865857+0000","last_peered":"2024-09-17T01:36:12.865857+0000","last_clean":"2024-09-17T01:36:12.865857+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:36:12.865857+0000","last_undegraded":"2024-09-17T01:36:12.865857+0000","last_fullsized":"2024-09-17T01:36:12.865857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476793,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":757760,"data_stored":311303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36076,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335764,"statfs":{"total":96636764160,"available":96599822336,"internally_reserved":0,"allocated":745472,"data_stored":309623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509495,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40232,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331608,"statfs":{"total":96636764160,"available":96595566592,"internally_reserved":0,"allocated":741376,"data_stored":309553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509496,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40236,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331604,"statfs":{"total":96636764160,"available":96595562496,"internally_reserved":0,"allocated":745472,"data_stored":310147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509496,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":741376,"data_stored":309621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509495,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40812,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331028,"statfs":{"total":96636764160,"available":96594972672,"internally_reserved":0,"allocated":1335296,"data_stored":900481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509497,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36080,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335760,"statfs":{"total":96636764160,"available":96599818240,"internally_reserved":0,"allocated":749568,"data_stored":311143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542201,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40812,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331028,"statfs":{"total":96636764160,"available":96594972672,"internally_reserved":0,"allocated":1335296,"data_stored":899933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:36:21.312 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T01:36:21.312 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T01:36:21.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.585+0000 7f192d800640 1 -- 172.21.15.42:0/3277066514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19280b4be0 msgr2=0x7f192815d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:21.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.585+0000 7f192d800640 1 --2- 172.21.15.42:0/3277066514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19280b4be0 0x7f192815d6b0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f1918005fd0 tx=0x7f191802a530 comp rx=0 tx=0).stop 2024-09-17T01:36:21.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.585+0000 7f192d800640 1 -- 172.21.15.42:0/3277066514 shutdown_connections 2024-09-17T01:36:21.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.585+0000 7f192d800640 1 --2- 172.21.15.42:0/3277066514 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f19280cf7c0 0x7f192806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:21.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.585+0000 7f192d800640 1 --2- 172.21.15.42:0/3277066514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19280b4be0 0x7f192815d6b0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:21.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.585+0000 7f192d800640 1 -- 172.21.15.42:0/3277066514 >> 172.21.15.42:0/3277066514 conn(0x7f19280b25f0 msgr2=0x7f19280d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:21.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.585+0000 7f192d800640 1 -- 172.21.15.42:0/3277066514 shutdown_connections 2024-09-17T01:36:21.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.585+0000 7f192d800640 1 -- 172.21.15.42:0/3277066514 wait complete. 2024-09-17T01:36:21.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.588+0000 7f192d800640 1 Processor -- start 2024-09-17T01:36:21.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.588+0000 7f192d800640 1 -- start start 2024-09-17T01:36:21.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.589+0000 7f192d800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f192806d260 0x7f19280749f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:21.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.589+0000 7f192d800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19280b4be0 0x7f1928149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:21.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.589+0000 7f192d800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19280cf7c0 0x7f1928072a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:21.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.589+0000 7f192d800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1928153970 con 0x7f19280cf7c0 2024-09-17T01:36:21.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.589+0000 7f192d800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f19281537f0 con 0x7f19280b4be0 2024-09-17T01:36:21.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.589+0000 7f192d800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1928153af0 con 0x7f192806d260 2024-09-17T01:36:21.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.589+0000 7f192ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19280cf7c0 0x7f1928072a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:21.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.590+0000 7f192ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19280cf7c0 0x7f1928072a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52054/0 (socket says 172.21.15.42:52054) 2024-09-17T01:36:21.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.590+0000 7f192ce00640 1 -- 172.21.15.42:0/1785513540 learned_addr learned my addr 172.21.15.42:0/1785513540 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:21.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.590+0000 7f1927e00640 1 --2- 172.21.15.42:0/1785513540 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f192806d260 0x7f19280749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:21.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.590+0000 7f191fe00640 1 --2- 172.21.15.42:0/1785513540 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19280b4be0 0x7f1928149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:21.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.590+0000 7f192ce00640 1 -- 172.21.15.42:0/1785513540 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f192806d260 msgr2=0x7f19280749f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:21.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.590+0000 7f192ce00640 1 --2- 172.21.15.42:0/1785513540 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f192806d260 0x7f19280749f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:21.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.590+0000 7f192ce00640 1 -- 172.21.15.42:0/1785513540 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19280b4be0 msgr2=0x7f1928149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:21.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.590+0000 7f192ce00640 1 --2- 172.21.15.42:0/1785513540 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19280b4be0 0x7f1928149790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:21.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.590+0000 7f192ce00640 1 -- 172.21.15.42:0/1785513540 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f192815e7e0 con 0x7f19280cf7c0 2024-09-17T01:36:21.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.590+0000 7f192ce00640 1 --2- 172.21.15.42:0/1785513540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19280cf7c0 0x7f1928072a80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f192000be60 tx=0x7f192000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:21.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.591+0000 7f1924c00640 1 -- 172.21.15.42:0/1785513540 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1920019070 con 0x7f19280cf7c0 2024-09-17T01:36:21.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.591+0000 7f1924c00640 1 -- 172.21.15.42:0/1785513540 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1920014440 con 0x7f19280cf7c0 2024-09-17T01:36:21.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.591+0000 7f192d800640 1 -- 172.21.15.42:0/1785513540 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f192815ece0 con 0x7f19280cf7c0 2024-09-17T01:36:21.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.591+0000 7f1924c00640 1 -- 172.21.15.42:0/1785513540 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1920014890 con 0x7f19280cf7c0 2024-09-17T01:36:21.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.591+0000 7f192d800640 1 -- 172.21.15.42:0/1785513540 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f192815f2a0 con 0x7f19280cf7c0 2024-09-17T01:36:21.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.592+0000 7f192d800640 1 -- 172.21.15.42:0/1785513540 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f192815d6b0 con 0x7f19280cf7c0 2024-09-17T01:36:21.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.593+0000 7f1924c00640 1 -- 172.21.15.42:0/1785513540 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f192001c070 con 0x7f19280cf7c0 2024-09-17T01:36:21.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.594+0000 7f1924c00640 1 --2- 172.21.15.42:0/1785513540 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1904078b90 0x7f190407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:21.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.594+0000 7f1924c00640 1 -- 172.21.15.42:0/1785513540 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f192009ad30 con 0x7f19280cf7c0 2024-09-17T01:36:21.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.595+0000 7f1927e00640 1 --2- 172.21.15.42:0/1785513540 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1904078b90 0x7f190407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:21.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.596+0000 7f1927e00640 1 --2- 172.21.15.42:0/1785513540 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1904078b90 0x7f190407b0a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1918033000 tx=0x7f1918004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:21.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.598+0000 7f1924c00640 1 -- 172.21.15.42:0/1785513540 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1920063170 con 0x7f19280cf7c0 2024-09-17T01:36:21.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.863+0000 7f192d800640 1 -- 172.21.15.42:0/1785513540 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f192815ea70 con 0x7f19280cf7c0 2024-09-17T01:36:21.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.866+0000 7f1924c00640 1 -- 172.21.15.42:0/1785513540 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v31) ==== 190+0+147 (secure 0 0 0) 0x7f1920062a70 con 0x7f19280cf7c0 2024-09-17T01:36:21.864 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-09-17T01:36:21.864 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA== 2024-09-17T01:36:21.864 INFO:teuthology.orchestra.run.smithi042.stdout: caps mds = "allow" 2024-09-17T01:36:21.864 INFO:teuthology.orchestra.run.smithi042.stdout: caps mon = "allow r" 2024-09-17T01:36:21.864 INFO:teuthology.orchestra.run.smithi042.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T01:36:21.864 INFO:teuthology.orchestra.run.smithi042.stderr:updated caps for client.0 2024-09-17T01:36:21.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.868+0000 7f192d800640 1 -- 172.21.15.42:0/1785513540 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1904078b90 msgr2=0x7f190407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:21.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.868+0000 7f192d800640 1 --2- 172.21.15.42:0/1785513540 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1904078b90 0x7f190407b0a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1918033000 tx=0x7f1918004730 comp rx=0 tx=0).stop 2024-09-17T01:36:21.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.868+0000 7f192d800640 1 -- 172.21.15.42:0/1785513540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19280cf7c0 msgr2=0x7f1928072a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:21.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.868+0000 7f192d800640 1 --2- 172.21.15.42:0/1785513540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19280cf7c0 0x7f1928072a80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f192000be60 tx=0x7f192000bf50 comp rx=0 tx=0).stop 2024-09-17T01:36:21.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.868+0000 7f192d800640 1 -- 172.21.15.42:0/1785513540 shutdown_connections 2024-09-17T01:36:21.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.868+0000 7f192d800640 1 --2- 172.21.15.42:0/1785513540 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1904078b90 0x7f190407b0a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:21.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.868+0000 7f192d800640 1 --2- 172.21.15.42:0/1785513540 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19280b4be0 0x7f1928149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:21.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.868+0000 7f192d800640 1 --2- 172.21.15.42:0/1785513540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f19280cf7c0 0x7f1928072a80 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:21.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.868+0000 7f192d800640 1 --2- 172.21.15.42:0/1785513540 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f192806d260 0x7f19280749f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:21.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.868+0000 7f192d800640 1 -- 172.21.15.42:0/1785513540 >> 172.21.15.42:0/1785513540 conn(0x7f19280b25f0 msgr2=0x7f19280ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:21.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.868+0000 7f192d800640 1 -- 172.21.15.42:0/1785513540 shutdown_connections 2024-09-17T01:36:21.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:21.868+0000 7f192d800640 1 -- 172.21.15.42:0/1785513540 wait complete. 2024-09-17T01:36:21.890 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:36:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.120+0000 7f196be00640 1 -- 172.21.15.42:0/249119563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f196406db40 msgr2=0x7f196415bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.120+0000 7f196be00640 1 --2- 172.21.15.42:0/249119563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f196406db40 0x7f196415bc50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1950009830 tx=0x7f195002a510 comp rx=0 tx=0).stop 2024-09-17T01:36:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.120+0000 7f196be00640 1 -- 172.21.15.42:0/249119563 shutdown_connections 2024-09-17T01:36:22.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.120+0000 7f196be00640 1 --2- 172.21.15.42:0/249119563 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f196415f190 0x7f196406fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:22.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.120+0000 7f196be00640 1 --2- 172.21.15.42:0/249119563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f196406db40 0x7f196415bc50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:22.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.120+0000 7f196be00640 1 -- 172.21.15.42:0/249119563 >> 172.21.15.42:0/249119563 conn(0x7f19640b2930 msgr2=0x7f196406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:22.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.120+0000 7f196be00640 1 -- 172.21.15.42:0/249119563 shutdown_connections 2024-09-17T01:36:22.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.120+0000 7f196be00640 1 -- 172.21.15.42:0/249119563 wait complete. 2024-09-17T01:36:22.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.123+0000 7f196be00640 1 Processor -- start 2024-09-17T01:36:22.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.123+0000 7f196be00640 1 -- start start 2024-09-17T01:36:22.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.124+0000 7f196be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1964072e00 0x7f196414d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:22.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.124+0000 7f196be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f196415f190 0x7f1964150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:22.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.124+0000 7f196be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1964158600 0x7f1964138fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:22.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.124+0000 7f196be00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1964151520 con 0x7f196415f190 2024-09-17T01:36:22.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.124+0000 7f196be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1964070740 con 0x7f1964072e00 2024-09-17T01:36:22.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.124+0000 7f196be00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f19641516a0 con 0x7f1964158600 2024-09-17T01:36:22.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.124+0000 7f1968a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f196415f190 0x7f1964150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:22.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.124+0000 7f1968a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f196415f190 0x7f1964150d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52062/0 (socket says 172.21.15.42:52062) 2024-09-17T01:36:22.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.124+0000 7f1968a00640 1 -- 172.21.15.42:0/235466559 learned_addr learned my addr 172.21.15.42:0/235466559 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:22.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.125+0000 7f1969e00640 1 --2- 172.21.15.42:0/235466559 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1964158600 0x7f1964138fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:22.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.125+0000 7f1969400640 1 --2- 172.21.15.42:0/235466559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1964072e00 0x7f196414d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:22.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.125+0000 7f1968a00640 1 -- 172.21.15.42:0/235466559 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1964158600 msgr2=0x7f1964138fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:22.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.125+0000 7f1968a00640 1 --2- 172.21.15.42:0/235466559 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1964158600 0x7f1964138fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:22.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.125+0000 7f1968a00640 1 -- 172.21.15.42:0/235466559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1964072e00 msgr2=0x7f196414d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:22.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.125+0000 7f1968a00640 1 --2- 172.21.15.42:0/235466559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1964072e00 0x7f196414d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:22.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.125+0000 7f1968a00640 1 -- 172.21.15.42:0/235466559 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f196414fca0 con 0x7f196415f190 2024-09-17T01:36:22.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.125+0000 7f1968a00640 1 --2- 172.21.15.42:0/235466559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f196415f190 0x7f1964150d40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1950009950 tx=0x7f1950033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:22.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.126+0000 7f1961600640 1 -- 172.21.15.42:0/235466559 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1950005c90 con 0x7f196415f190 2024-09-17T01:36:22.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.126+0000 7f1961600640 1 -- 172.21.15.42:0/235466559 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1950031e50 con 0x7f196415f190 2024-09-17T01:36:22.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.126+0000 7f196be00640 1 -- 172.21.15.42:0/235466559 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f196414ff80 con 0x7f196415f190 2024-09-17T01:36:22.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.126+0000 7f1961600640 1 -- 172.21.15.42:0/235466559 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1950005260 con 0x7f196415f190 2024-09-17T01:36:22.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.126+0000 7f196be00640 1 -- 172.21.15.42:0/235466559 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1964150540 con 0x7f196415f190 2024-09-17T01:36:22.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.127+0000 7f196be00640 1 -- 172.21.15.42:0/235466559 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f196415bc50 con 0x7f196415f190 2024-09-17T01:36:22.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.128+0000 7f1961600640 1 -- 172.21.15.42:0/235466559 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1950005400 con 0x7f196415f190 2024-09-17T01:36:22.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.129+0000 7f1961600640 1 --2- 172.21.15.42:0/235466559 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1944078b90 0x7f194407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:22.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.129+0000 7f1961600640 1 -- 172.21.15.42:0/235466559 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f19500bc1d0 con 0x7f196415f190 2024-09-17T01:36:22.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.130+0000 7f1969400640 1 --2- 172.21.15.42:0/235466559 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1944078b90 0x7f194407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.130+0000 7f1969400640 1 --2- 172.21.15.42:0/235466559 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1944078b90 0x7f194407b0a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f19640b3020 tx=0x7f1958009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.132+0000 7f1961600640 1 -- 172.21.15.42:0/235466559 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f195003f030 con 0x7f196415f190 2024-09-17T01:36:22.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.362+0000 7f196be00640 1 -- 172.21.15.42:0/235466559 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f196406a170 con 0x7f196415f190 2024-09-17T01:36:22.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.363+0000 7f1961600640 1 -- 172.21.15.42:0/235466559 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5217 (secure 0 0 0) 0x7f1950083fa0 con 0x7f196415f190 2024-09-17T01:36:22.361 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:22.361 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":41,"btime":"2024-09-17T01:36:14:305356+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5627,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/87636391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":87636391},{"type":"v1","addr":"172.21.15.42:6834","nonce":87636391}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6031,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2536194102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2536194102},{"type":"v1","addr":"172.21.15.43:6836","nonce":2536194102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6034,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2289964334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2289964334},{"type":"v1","addr":"172.21.15.43:6837","nonce":2289964334}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:36:10.790086+0000","modified":"2024-09-17T01:36:13.810139+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6195},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6195":{"gid":6195,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/2030017417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":2030017417},{"type":"v1","addr":"172.21.15.42:6835","nonce":2030017417}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6195,"qdb_cluster":[6195]},"id":4}]} 2024-09-17T01:36:22.361 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 41 2024-09-17T01:36:22.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.365+0000 7f196be00640 1 -- 172.21.15.42:0/235466559 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1944078b90 msgr2=0x7f194407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:22.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.365+0000 7f196be00640 1 --2- 172.21.15.42:0/235466559 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1944078b90 0x7f194407b0a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f19640b3020 tx=0x7f1958009040 comp rx=0 tx=0).stop 2024-09-17T01:36:22.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.365+0000 7f196be00640 1 -- 172.21.15.42:0/235466559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f196415f190 msgr2=0x7f1964150d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:22.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.365+0000 7f196be00640 1 --2- 172.21.15.42:0/235466559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f196415f190 0x7f1964150d40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1950009950 tx=0x7f1950033c20 comp rx=0 tx=0).stop 2024-09-17T01:36:22.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.365+0000 7f196be00640 1 -- 172.21.15.42:0/235466559 shutdown_connections 2024-09-17T01:36:22.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.365+0000 7f196be00640 1 --2- 172.21.15.42:0/235466559 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1944078b90 0x7f194407b0a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:22.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.365+0000 7f196be00640 1 --2- 172.21.15.42:0/235466559 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1964158600 0x7f1964138fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:22.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.365+0000 7f196be00640 1 --2- 172.21.15.42:0/235466559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f196415f190 0x7f1964150d40 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:22.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.365+0000 7f196be00640 1 --2- 172.21.15.42:0/235466559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1964072e00 0x7f196414d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:22.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.365+0000 7f196be00640 1 -- 172.21.15.42:0/235466559 >> 172.21.15.42:0/235466559 conn(0x7f19640b2930 msgr2=0x7f196415c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:22.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.365+0000 7f196be00640 1 -- 172.21.15.42:0/235466559 shutdown_connections 2024-09-17T01:36:22.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:22.365+0000 7f196be00640 1 -- 172.21.15.42:0/235466559 wait complete. 2024-09-17T01:36:22.787 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:36:10.790086+0000', 'modified': '2024-09-17T01:36:13.810139+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6195}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6195': {'gid': 6195, 'name': 'c', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.42:6835/2030017417', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6833', 'nonce': 2030017417}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 2030017417}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6195, 'qdb_cluster': [6195]} 2024-09-17T01:36:22.788 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T01:36:22.788 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T01:36:23.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.022+0000 7f6202200640 1 -- 172.21.15.42:0/1577127516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61fc142f40 msgr2=0x7f61fc072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:23.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.022+0000 7f6202200640 1 --2- 172.21.15.42:0/1577127516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61fc142f40 0x7f61fc072950 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f61e4009830 tx=0x7f61e402a480 comp rx=0 tx=0).stop 2024-09-17T01:36:23.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.022+0000 7f6202200640 1 -- 172.21.15.42:0/1577127516 shutdown_connections 2024-09-17T01:36:23.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.023+0000 7f6202200640 1 --2- 172.21.15.42:0/1577127516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61fc142f40 0x7f61fc072950 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.023+0000 7f6202200640 1 --2- 172.21.15.42:0/1577127516 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f61fc0b3550 0x7f61fc15cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.023+0000 7f6202200640 1 -- 172.21.15.42:0/1577127516 >> 172.21.15.42:0/1577127516 conn(0x7f61fc0b2930 msgr2=0x7f61fc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:23.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.023+0000 7f6202200640 1 -- 172.21.15.42:0/1577127516 shutdown_connections 2024-09-17T01:36:23.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.023+0000 7f6202200640 1 -- 172.21.15.42:0/1577127516 wait complete. 2024-09-17T01:36:23.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.025+0000 7f6202200640 1 Processor -- start 2024-09-17T01:36:23.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.025+0000 7f6202200640 1 -- start start 2024-09-17T01:36:23.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.026+0000 7f6202200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61fc072e90 0x7f61fc142100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:23.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.026+0000 7f6202200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f61fc0b3550 0x7f61fc13ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:23.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.026+0000 7f6202200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61fc142f40 0x7f61fc0ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:23.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.026+0000 7f6202200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc06d7c0 con 0x7f61fc142f40 2024-09-17T01:36:23.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.026+0000 7f6202200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc06d640 con 0x7f61fc072e90 2024-09-17T01:36:23.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.026+0000 7f6202200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f61fc06d940 con 0x7f61fc0b3550 2024-09-17T01:36:23.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.027+0000 7f61fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61fc142f40 0x7f61fc0ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:23.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.027+0000 7f61fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61fc142f40 0x7f61fc0ade50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52084/0 (socket says 172.21.15.42:52084) 2024-09-17T01:36:23.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.027+0000 7f61fbe00640 1 -- 172.21.15.42:0/1198669275 learned_addr learned my addr 172.21.15.42:0/1198669275 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:23.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.027+0000 7f61f2a00640 1 --2- 172.21.15.42:0/1198669275 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f61fc0b3550 0x7f61fc13ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:23.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.027+0000 7f61fb400640 1 --2- 172.21.15.42:0/1198669275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61fc072e90 0x7f61fc142100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:23.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.027+0000 7f61fbe00640 1 -- 172.21.15.42:0/1198669275 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f61fc0b3550 msgr2=0x7f61fc13ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:23.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.027+0000 7f61fbe00640 1 --2- 172.21.15.42:0/1198669275 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f61fc0b3550 0x7f61fc13ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.027+0000 7f61fbe00640 1 -- 172.21.15.42:0/1198669275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61fc072e90 msgr2=0x7f61fc142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:23.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.027+0000 7f61fbe00640 1 --2- 172.21.15.42:0/1198669275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61fc072e90 0x7f61fc142100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.027+0000 7f61fbe00640 1 -- 172.21.15.42:0/1198669275 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61fc1f69f0 con 0x7f61fc142f40 2024-09-17T01:36:23.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.028+0000 7f61fbe00640 1 --2- 172.21.15.42:0/1198669275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61fc142f40 0x7f61fc0ade50 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f61f400cae0 tx=0x7f61f400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:23.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.028+0000 7f61f3e00640 1 -- 172.21.15.42:0/1198669275 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f4016020 con 0x7f61fc142f40 2024-09-17T01:36:23.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.028+0000 7f61f3e00640 1 -- 172.21.15.42:0/1198669275 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61f400ad30 con 0x7f61fc142f40 2024-09-17T01:36:23.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.028+0000 7f61f3e00640 1 -- 172.21.15.42:0/1198669275 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f4012680 con 0x7f61fc142f40 2024-09-17T01:36:23.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.028+0000 7f6202200640 1 -- 172.21.15.42:0/1198669275 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61fc1f48d0 con 0x7f61fc142f40 2024-09-17T01:36:23.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.028+0000 7f6202200640 1 -- 172.21.15.42:0/1198669275 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61fc1f4e90 con 0x7f61fc142f40 2024-09-17T01:36:23.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.031+0000 7f61f3e00640 1 -- 172.21.15.42:0/1198669275 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f61f4019020 con 0x7f61fc142f40 2024-09-17T01:36:23.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.031+0000 7f61f3e00640 1 --2- 172.21.15.42:0/1198669275 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f61d8078bc0 0x7f61d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:23.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.032+0000 7f61f3e00640 1 -- 172.21.15.42:0/1198669275 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f61f409b2f0 con 0x7f61fc142f40 2024-09-17T01:36:23.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.032+0000 7f620923f740 1 Processor -- start 2024-09-17T01:36:23.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.032+0000 7f61fb400640 1 --2- 172.21.15.42:0/1198669275 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f61d8078bc0 0x7f61d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:23.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.032+0000 7f620923f740 1 -- start start 2024-09-17T01:36:23.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.033+0000 7f61fb400640 1 --2- 172.21.15.42:0/1198669275 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f61d8078bc0 0x7f61d807b0d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f61ec004590 tx=0x7f61ec00b390 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:23.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.033+0000 7f620923f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55807fa79270 0x55807fe49970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:23.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.033+0000 7f620923f740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55807fa503b0 0x55807fe49eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:23.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.033+0000 7f620923f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa58590 0x55807fe19f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:23.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.033+0000 7f620923f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55807fda3430 con 0x55807fa58590 2024-09-17T01:36:23.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.033+0000 7f620923f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55807fd935d0 con 0x55807fa79270 2024-09-17T01:36:23.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.033+0000 7f620923f740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55807fd82a00 con 0x55807fa503b0 2024-09-17T01:36:23.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.034+0000 7f61fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa58590 0x55807fe19f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:23.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.034+0000 7f61f2a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55807fa503b0 0x55807fe49eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:23.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.034+0000 7f61fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa58590 0x55807fe19f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52100/0 (socket says 172.21.15.42:52100) 2024-09-17T01:36:23.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.034+0000 7f61fbe00640 1 -- 172.21.15.42:0/1772243773 learned_addr learned my addr 172.21.15.42:0/1772243773 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:23.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.034+0000 7f61fb400640 1 --2- 172.21.15.42:0/1772243773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55807fa79270 0x55807fe49970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:23.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.034+0000 7f61fbe00640 1 -- 172.21.15.42:0/1772243773 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55807fa503b0 msgr2=0x55807fe49eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:23.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.034+0000 7f61fbe00640 1 --2- 172.21.15.42:0/1772243773 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55807fa503b0 0x55807fe49eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.034+0000 7f61fbe00640 1 -- 172.21.15.42:0/1772243773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55807fa79270 msgr2=0x55807fe49970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:23.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.034+0000 7f61fbe00640 1 --2- 172.21.15.42:0/1772243773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55807fa79270 0x55807fe49970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.034+0000 7f61fbe00640 1 -- 172.21.15.42:0/1772243773 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55807fd4b520 con 0x55807fa58590 2024-09-17T01:36:23.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.034+0000 7f61fbe00640 1 --2- 172.21.15.42:0/1772243773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa58590 0x55807fe19f60 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f61f40996f0 tx=0x7f61f4062b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b51b749f66ba021 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:23.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.035+0000 7f61eb400640 1 -- 172.21.15.42:0/1772243773 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f406c9b0 con 0x55807fa58590 2024-09-17T01:36:23.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.035+0000 7f61eb400640 1 -- 172.21.15.42:0/1772243773 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61f405f3a0 con 0x55807fa58590 2024-09-17T01:36:23.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.035+0000 7f61eb400640 1 -- 172.21.15.42:0/1772243773 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f40893d0 con 0x55807fa58590 2024-09-17T01:36:23.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.035+0000 7f620923f740 1 -- 172.21.15.42:0/1772243773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa58590 msgr2=0x55807fe19f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:23.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.035+0000 7f620923f740 1 --2- 172.21.15.42:0/1772243773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa58590 0x55807fe19f60 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f61f40996f0 tx=0x7f61f4062b50 comp rx=0 tx=0).stop 2024-09-17T01:36:23.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.035+0000 7f620923f740 1 -- 172.21.15.42:0/1772243773 shutdown_connections 2024-09-17T01:36:23.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.035+0000 7f620923f740 1 --2- 172.21.15.42:0/1772243773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa58590 0x55807fe19f60 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.035+0000 7f620923f740 1 --2- 172.21.15.42:0/1772243773 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55807fa503b0 0x55807fe49eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.035+0000 7f620923f740 1 --2- 172.21.15.42:0/1772243773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55807fa79270 0x55807fe49970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.035+0000 7f620923f740 1 -- 172.21.15.42:0/1772243773 >> 172.21.15.42:0/1772243773 conn(0x55807fa6d3c0 msgr2=0x55807fe1f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:23.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.036+0000 7f620923f740 1 -- 172.21.15.42:0/1772243773 shutdown_connections 2024-09-17T01:36:23.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.036+0000 7f620923f740 1 -- 172.21.15.42:0/1772243773 wait complete. 2024-09-17T01:36:23.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.037+0000 7f620923f740 1 -- start start 2024-09-17T01:36:23.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.037+0000 7f620923f740 1 Processor -- start 2024-09-17T01:36:23.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.038+0000 7f620923f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa503b0 0x55807fe65110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:23.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.038+0000 7f620923f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55807fa58590 0x55807fe44bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:23.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.038+0000 7f620923f740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55807fa79270 0x55807fe40060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:23.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.038+0000 7f620923f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55807fd29330 con 0x55807fa503b0 2024-09-17T01:36:23.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.038+0000 7f620923f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55807fd86810 con 0x55807fa58590 2024-09-17T01:36:23.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.038+0000 7f620923f740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55807faf3620 con 0x55807fa79270 2024-09-17T01:36:23.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.038+0000 7f620923f740 10 client.0 _ll_register_callbacks cb 0x55807fd2e420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:36:23.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.039+0000 7f61fb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa503b0 0x55807fe65110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:23.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.039+0000 7f61fb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa503b0 0x55807fe65110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52102/0 (socket says 172.21.15.42:52102) 2024-09-17T01:36:23.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.039+0000 7f61fb400640 1 -- 172.21.15.42:0/1228735166 learned_addr learned my addr 172.21.15.42:0/1228735166 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:23.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.039+0000 7f61f2a00640 1 --2- 172.21.15.42:0/1228735166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55807fa58590 0x55807fe44bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:23.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.039+0000 7f61fbe00640 1 --2- 172.21.15.42:0/1228735166 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55807fa79270 0x55807fe40060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:23.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.039+0000 7f61fb400640 1 -- 172.21.15.42:0/1228735166 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55807fa79270 msgr2=0x55807fe40060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:23.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.039+0000 7f61fb400640 1 --2- 172.21.15.42:0/1228735166 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55807fa79270 0x55807fe40060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.039+0000 7f61fb400640 1 -- 172.21.15.42:0/1228735166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55807fa58590 msgr2=0x55807fe44bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:23.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.039+0000 7f61fb400640 1 --2- 172.21.15.42:0/1228735166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55807fa58590 0x55807fe44bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.039+0000 7f61fb400640 1 -- 172.21.15.42:0/1228735166 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55807fae4850 con 0x55807fa503b0 2024-09-17T01:36:23.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.039+0000 7f61fb400640 1 --2- 172.21.15.42:0/1228735166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa503b0 0x55807fe65110 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f61ec003fb0 tx=0x7f61ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10cc38605be20047 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:23.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.039+0000 7f61dfe00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:36:23.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.040+0000 7f61dfe00640 1 -- 172.21.15.42:0/1228735166 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ec01e830 con 0x55807fa503b0 2024-09-17T01:36:23.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.040+0000 7f61dfe00640 1 -- 172.21.15.42:0/1228735166 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f61ec01e9d0 con 0x55807fa503b0 2024-09-17T01:36:23.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.040+0000 7f620923f740 1 -- 172.21.15.42:0/1228735166 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61f405f3a0 con 0x55807fa503b0 2024-09-17T01:36:23.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.040+0000 7f61dfe00640 1 -- 172.21.15.42:0/1228735166 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f61ec011e50 con 0x55807fa503b0 2024-09-17T01:36:23.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.040+0000 7f620923f740 10 client.6360 fetch_fsmap learned FSMap version 41 2024-09-17T01:36:23.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.040+0000 7f620923f740 1 -- 172.21.15.42:0/1228735166 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x55807fb5b6b0 con 0x55807fa503b0 2024-09-17T01:36:23.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.040+0000 7f61dfe00640 1 -- 172.21.15.42:0/1228735166 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61f405f3a0 con 0x55807fa503b0 2024-09-17T01:36:23.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.040+0000 7f61dfe00640 1 -- 172.21.15.42:0/1228735166 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 41) ==== 3502+0+0 (secure 0 0 0) 0x7f61ec033080 con 0x55807fa503b0 2024-09-17T01:36:23.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.040+0000 7f620923f740 10 client.6360 fetch_fsmap finished waiting for FSMap version 41 2024-09-17T01:36:23.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.040+0000 7f620923f740 10 client.6360 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:36:23.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.040+0000 7f620923f740 20 client.6360 populate_metadata read hostname 'smithi042' 2024-09-17T01:36:23.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.040+0000 7f620923f740 1 --2- 172.21.15.42:0/1228735166 >> [v2:172.21.15.42:6833/2030017417,v1:172.21.15.42:6835/2030017417] conn(0x55807fa37e40 0x55807fe73df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:23.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.040+0000 7f620923f740 4 client.6360 mds_command: new command op to 6195 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:36:23.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.040+0000 7f620923f740 1 -- 172.21.15.42:0/1228735166 --> [v2:172.21.15.42:6833/2030017417,v1:172.21.15.42:6835/2030017417] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55807fd95520 con 0x55807fa37e40 2024-09-17T01:36:23.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.041+0000 7f61f2a00640 1 --2- 172.21.15.42:0/1228735166 >> [v2:172.21.15.42:6833/2030017417,v1:172.21.15.42:6835/2030017417] conn(0x55807fa37e40 0x55807fe73df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:23.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.041+0000 7f61f2a00640 1 --2- 172.21.15.42:0/1228735166 >> [v2:172.21.15.42:6833/2030017417,v1:172.21.15.42:6835/2030017417] conn(0x55807fa37e40 0x55807fe73df0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b029ecbfe0477164 server_cookie=600e2d0f85299fc1 in_seq=0 out_seq=0 2024-09-17T01:36:23.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.041+0000 7f61dfe00640 10 client.6360 ms_handle_connect on v2:172.21.15.42:6833/2030017417 2024-09-17T01:36:23.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.042+0000 7f61dfe00640 1 -- 172.21.15.42:0/1228735166 <== mds.0 v2:172.21.15.42:6833/2030017417 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55807fd95520 con 0x55807fa37e40 2024-09-17T01:36:23.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.042+0000 7f61dfe00640 10 client.6360 handle_command_reply: tid=0 2024-09-17T01:36:23.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.042+0000 7f620923f740 1 client.6360 shutdown 2024-09-17T01:36:23.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.042+0000 7f620923f740 1 -- 172.21.15.42:0/1228735166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa503b0 msgr2=0x55807fe65110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:23.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.042+0000 7f620923f740 1 --2- 172.21.15.42:0/1228735166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa503b0 0x55807fe65110 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f61ec003fb0 tx=0x7f61ec004730 comp rx=0 tx=0).stop 2024-09-17T01:36:23.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.042+0000 7f620923f740 1 -- 172.21.15.42:0/1228735166 shutdown_connections 2024-09-17T01:36:23.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.042+0000 7f620923f740 1 --2- 172.21.15.42:0/1228735166 >> [v2:172.21.15.42:6833/2030017417,v1:172.21.15.42:6835/2030017417] conn(0x55807fa37e40 0x55807fe73df0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.042+0000 7f620923f740 1 --2- 172.21.15.42:0/1228735166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55807fa58590 0x55807fe44bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.042+0000 7f61dfe00640 0 client.6360 ms_handle_reset on v2:172.21.15.42:6833/2030017417 2024-09-17T01:36:23.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.042+0000 7f620923f740 1 --2- 172.21.15.42:0/1228735166 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55807fa79270 0x55807fe40060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.042+0000 7f620923f740 1 --2- 172.21.15.42:0/1228735166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa503b0 0x55807fe65110 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.042+0000 7f620923f740 1 -- 172.21.15.42:0/1228735166 >> 172.21.15.42:0/1228735166 conn(0x55807fa6d3c0 msgr2=0x55807fe1b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:23.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.043+0000 7f620923f740 1 -- 172.21.15.42:0/1228735166 shutdown_connections 2024-09-17T01:36:23.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.043+0000 7f620923f740 1 -- 172.21.15.42:0/1228735166 wait complete. 2024-09-17T01:36:23.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.043+0000 7f620923f740 20 client.6360 trim_cache size 0 max 16384 2024-09-17T01:36:23.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.063+0000 7f620923f740 1 Processor -- start 2024-09-17T01:36:23.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.063+0000 7f620923f740 1 -- start start 2024-09-17T01:36:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.064+0000 7f620923f740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55807fa503b0 0x55807fe47e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.064+0000 7f620923f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa58590 0x55807fe483b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.064+0000 7f620923f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55807fa79270 0x55807fe67cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.064+0000 7f620923f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc1ff190 con 0x55807fa58590 2024-09-17T01:36:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.064+0000 7f620923f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc1f66e0 con 0x55807fa79270 2024-09-17T01:36:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.064+0000 7f620923f740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f61fc1f77b0 con 0x55807fa503b0 2024-09-17T01:36:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.064+0000 7f61f2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa58590 0x55807fe483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.064+0000 7f61f2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa58590 0x55807fe483b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52118/0 (socket says 172.21.15.42:52118) 2024-09-17T01:36:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.064+0000 7f61f2a00640 1 -- 172.21.15.42:0/2571288986 learned_addr learned my addr 172.21.15.42:0/2571288986 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:23.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.065+0000 7f61f2a00640 1 -- 172.21.15.42:0/2571288986 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55807fa503b0 msgr2=0x55807fe47e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:23.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.065+0000 7f61f2a00640 1 --2- 172.21.15.42:0/2571288986 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55807fa503b0 0x55807fe47e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.065+0000 7f61f2a00640 1 -- 172.21.15.42:0/2571288986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55807fa79270 msgr2=0x55807fe67cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.065+0000 7f61f2a00640 1 --2- 172.21.15.42:0/2571288986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55807fa79270 0x55807fe67cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.065+0000 7f61f2a00640 1 -- 172.21.15.42:0/2571288986 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55807fe1d740 con 0x55807fa58590 2024-09-17T01:36:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.065+0000 7f61f2a00640 1 --2- 172.21.15.42:0/2571288986 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa58590 0x55807fe483b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f61e4005eb0 tx=0x7f61e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78a7bf56b7a4584 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.065+0000 7f61eaa00640 1 -- 172.21.15.42:0/2571288986 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e4004470 con 0x55807fa58590 2024-09-17T01:36:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.065+0000 7f61eaa00640 1 -- 172.21.15.42:0/2571288986 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61e4005020 con 0x55807fa58590 2024-09-17T01:36:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.065+0000 7f61eaa00640 1 -- 172.21.15.42:0/2571288986 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e4005410 con 0x55807fa58590 2024-09-17T01:36:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.066+0000 7f620923f740 1 -- 172.21.15.42:0/2571288986 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa58590 msgr2=0x55807fe483b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.066+0000 7f620923f740 1 --2- 172.21.15.42:0/2571288986 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa58590 0x55807fe483b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f61e4005eb0 tx=0x7f61e4004730 comp rx=0 tx=0).stop 2024-09-17T01:36:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.066+0000 7f620923f740 1 -- 172.21.15.42:0/2571288986 shutdown_connections 2024-09-17T01:36:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.066+0000 7f620923f740 1 --2- 172.21.15.42:0/2571288986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55807fa79270 0x55807fe67cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.066+0000 7f620923f740 1 --2- 172.21.15.42:0/2571288986 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa58590 0x55807fe483b0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.066+0000 7f620923f740 1 --2- 172.21.15.42:0/2571288986 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55807fa503b0 0x55807fe47e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.066+0000 7f620923f740 1 -- 172.21.15.42:0/2571288986 >> 172.21.15.42:0/2571288986 conn(0x55807fa6d3c0 msgr2=0x55807fe1dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:23.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.066+0000 7f620923f740 1 -- 172.21.15.42:0/2571288986 shutdown_connections 2024-09-17T01:36:23.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.066+0000 7f620923f740 1 -- 172.21.15.42:0/2571288986 wait complete. 2024-09-17T01:36:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.067+0000 7f620923f740 1 -- start start 2024-09-17T01:36:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.067+0000 7f620923f740 1 Processor -- start 2024-09-17T01:36:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.069+0000 7f620923f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa503b0 0x55807fe669a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.069+0000 7f620923f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55807fa58590 0x55807fe72800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.069+0000 7f620923f740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55807fa79270 0x55807fe72d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.069+0000 7f620923f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55807fe441b0 con 0x55807fa503b0 2024-09-17T01:36:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.069+0000 7f620923f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55807fe45260 con 0x55807fa58590 2024-09-17T01:36:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.069+0000 7f620923f740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55807fe77250 con 0x55807fa79270 2024-09-17T01:36:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.069+0000 7f620923f740 10 client.0 _ll_register_callbacks cb 0x7f61ec003c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:36:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.069+0000 7f61fb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa503b0 0x55807fe669a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.069+0000 7f61fb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa503b0 0x55807fe669a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52124/0 (socket says 172.21.15.42:52124) 2024-09-17T01:36:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.069+0000 7f61fb400640 1 -- 172.21.15.42:0/2554299411 learned_addr learned my addr 172.21.15.42:0/2554299411 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.069+0000 7f61f2a00640 1 --2- 172.21.15.42:0/2554299411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55807fa58590 0x55807fe72800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.069+0000 7f61fbe00640 1 --2- 172.21.15.42:0/2554299411 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55807fa79270 0x55807fe72d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:23.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.069+0000 7f61fb400640 1 -- 172.21.15.42:0/2554299411 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55807fa79270 msgr2=0x55807fe72d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:23.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.069+0000 7f61fb400640 1 --2- 172.21.15.42:0/2554299411 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55807fa79270 0x55807fe72d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.069+0000 7f61fb400640 1 -- 172.21.15.42:0/2554299411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55807fa58590 msgr2=0x55807fe72800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:23.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.069+0000 7f61fb400640 1 --2- 172.21.15.42:0/2554299411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55807fa58590 0x55807fe72800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.069+0000 7f61fb400640 1 -- 172.21.15.42:0/2554299411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55807fe88480 con 0x55807fa503b0 2024-09-17T01:36:23.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.070+0000 7f61fb400640 1 --2- 172.21.15.42:0/2554299411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa503b0 0x55807fe669a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f61ec029790 tx=0x7f61ec0297c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9823860428078df server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:23.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.070+0000 7f61dfe00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:36:23.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.070+0000 7f61dfe00640 1 -- 172.21.15.42:0/2554299411 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ec029bf0 con 0x55807fa503b0 2024-09-17T01:36:23.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.070+0000 7f620923f740 1 -- 172.21.15.42:0/2554299411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61e4005020 con 0x55807fa503b0 2024-09-17T01:36:23.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.070+0000 7f61dfe00640 1 -- 172.21.15.42:0/2554299411 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f61ec01e630 con 0x55807fa503b0 2024-09-17T01:36:23.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.070+0000 7f61dfe00640 1 -- 172.21.15.42:0/2554299411 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f61ec029d90 con 0x55807fa503b0 2024-09-17T01:36:23.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.070+0000 7f620923f740 10 client.6366 fetch_fsmap learned FSMap version 41 2024-09-17T01:36:23.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.070+0000 7f620923f740 1 -- 172.21.15.42:0/2554299411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x55807fe66ee0 con 0x55807fa503b0 2024-09-17T01:36:23.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.071+0000 7f61dfe00640 1 -- 172.21.15.42:0/2554299411 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61ec02d020 con 0x55807fa503b0 2024-09-17T01:36:23.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.071+0000 7f61dfe00640 1 -- 172.21.15.42:0/2554299411 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 41) ==== 3502+0+0 (secure 0 0 0) 0x7f61ec026020 con 0x55807fa503b0 2024-09-17T01:36:23.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.071+0000 7f620923f740 10 client.6366 fetch_fsmap finished waiting for FSMap version 41 2024-09-17T01:36:23.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.071+0000 7f620923f740 10 client.6366 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:36:23.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.071+0000 7f620923f740 20 client.6366 populate_metadata read hostname 'smithi042' 2024-09-17T01:36:23.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.071+0000 7f620923f740 1 --2- 172.21.15.42:0/2554299411 >> [v2:172.21.15.42:6833/2030017417,v1:172.21.15.42:6835/2030017417] conn(0x55807fe683d0 0x55807fee58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:23.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.071+0000 7f620923f740 4 client.6366 mds_command: new command op to 6195 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T01:36:23.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.071+0000 7f620923f740 1 -- 172.21.15.42:0/2554299411 --> [v2:172.21.15.42:6833/2030017417,v1:172.21.15.42:6835/2030017417] -- command(tid 0: {"prefix": "status"}) -- 0x55807fd90fd0 con 0x55807fe683d0 2024-09-17T01:36:23.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.071+0000 7f61f2a00640 1 --2- 172.21.15.42:0/2554299411 >> [v2:172.21.15.42:6833/2030017417,v1:172.21.15.42:6835/2030017417] conn(0x55807fe683d0 0x55807fee58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:23.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.072+0000 7f61f2a00640 1 --2- 172.21.15.42:0/2554299411 >> [v2:172.21.15.42:6833/2030017417,v1:172.21.15.42:6835/2030017417] conn(0x55807fe683d0 0x55807fee58e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3da26ca7eeb8b4c server_cookie=5099838ddab30a6 in_seq=0 out_seq=0 2024-09-17T01:36:23.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.072+0000 7f61dfe00640 10 client.6366 ms_handle_connect on v2:172.21.15.42:6833/2030017417 2024-09-17T01:36:23.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.072+0000 7f61dfe00640 1 -- 172.21.15.42:0/2554299411 <== mds.0 v2:172.21.15.42:6833/2030017417 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55807fd90fd0 con 0x55807fe683d0 2024-09-17T01:36:23.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.072+0000 7f61dfe00640 10 client.6366 handle_command_reply: tid=0 2024-09-17T01:36:23.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.072+0000 7f620923f740 1 client.6366 shutdown 2024-09-17T01:36:23.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.072+0000 7f620923f740 1 -- 172.21.15.42:0/2554299411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa503b0 msgr2=0x55807fe669a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:23.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.072+0000 7f620923f740 1 --2- 172.21.15.42:0/2554299411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa503b0 0x55807fe669a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f61ec029790 tx=0x7f61ec0297c0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.072+0000 7f620923f740 1 -- 172.21.15.42:0/2554299411 shutdown_connections 2024-09-17T01:36:23.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.072+0000 7f620923f740 1 --2- 172.21.15.42:0/2554299411 >> [v2:172.21.15.42:6833/2030017417,v1:172.21.15.42:6835/2030017417] conn(0x55807fe683d0 0x55807fee58e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.072+0000 7f620923f740 1 --2- 172.21.15.42:0/2554299411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55807fa58590 0x55807fe72800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.072+0000 7f620923f740 1 --2- 172.21.15.42:0/2554299411 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55807fa79270 0x55807fe72d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.072+0000 7f620923f740 1 --2- 172.21.15.42:0/2554299411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55807fa503b0 0x55807fe669a0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.072+0000 7f61dfe00640 0 client.6366 ms_handle_reset on v2:172.21.15.42:6833/2030017417 2024-09-17T01:36:23.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.072+0000 7f620923f740 1 -- 172.21.15.42:0/2554299411 >> 172.21.15.42:0/2554299411 conn(0x55807fa6d3c0 msgr2=0x55807fe67cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:23.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.072+0000 7f620923f740 1 -- 172.21.15.42:0/2554299411 shutdown_connections 2024-09-17T01:36:23.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.072+0000 7f620923f740 1 -- 172.21.15.42:0/2554299411 wait complete. 2024-09-17T01:36:23.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.073+0000 7f620923f740 20 client.6366 trim_cache size 0 max 16384 2024-09-17T01:36:23.074 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:36:23.074 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "fea1c88c-cb05-432f-a745-f9dcbb5f2503", 2024-09-17T01:36:23.074 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-17T01:36:23.075 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 6195, 2024-09-17T01:36:23.075 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-17T01:36:23.075 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-17T01:36:23.075 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-17T01:36:23.075 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 11.778865682999999, 2024-09-17T01:36:23.075 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 41, 2024-09-17T01:36:23.075 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 62, 2024-09-17T01:36:23.075 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 62, 2024-09-17T01:36:23.075 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 16.780625421 2024-09-17T01:36:23.075 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:36:23.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.073+0000 7f6202200640 1 -- 172.21.15.42:0/1198669275 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f61d8078bc0 msgr2=0x7f61d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:23.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.073+0000 7f6202200640 1 --2- 172.21.15.42:0/1198669275 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f61d8078bc0 0x7f61d807b0d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f61ec004590 tx=0x7f61ec00b390 comp rx=0 tx=0).stop 2024-09-17T01:36:23.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.073+0000 7f6202200640 1 -- 172.21.15.42:0/1198669275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61fc142f40 msgr2=0x7f61fc0ade50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:23.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.073+0000 7f6202200640 1 --2- 172.21.15.42:0/1198669275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61fc142f40 0x7f61fc0ade50 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f61f400cae0 tx=0x7f61f400a060 comp rx=0 tx=0).stop 2024-09-17T01:36:23.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.073+0000 7f6202200640 1 -- 172.21.15.42:0/1198669275 shutdown_connections 2024-09-17T01:36:23.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.073+0000 7f6202200640 1 --2- 172.21.15.42:0/1198669275 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f61d8078bc0 0x7f61d807b0d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.073+0000 7f6202200640 1 --2- 172.21.15.42:0/1198669275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61fc142f40 0x7f61fc0ade50 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.073+0000 7f6202200640 1 --2- 172.21.15.42:0/1198669275 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f61fc0b3550 0x7f61fc13ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.073+0000 7f6202200640 1 --2- 172.21.15.42:0/1198669275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61fc072e90 0x7f61fc142100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.073+0000 7f6202200640 1 -- 172.21.15.42:0/1198669275 >> 172.21.15.42:0/1198669275 conn(0x7f61fc0b2930 msgr2=0x7f61fc15f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:23.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.073+0000 7f6202200640 1 -- 172.21.15.42:0/1198669275 shutdown_connections 2024-09-17T01:36:23.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.073+0000 7f6202200640 1 -- 172.21.15.42:0/1198669275 wait complete. 2024-09-17T01:36:23.097 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T01:36:23.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.326+0000 7f8816400640 1 -- 172.21.15.42:0/190563248 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88100cfba0 msgr2=0x7f88100b9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:23.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.326+0000 7f8816400640 1 --2- 172.21.15.42:0/190563248 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88100cfba0 0x7f88100b9fb0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f88100b4040 tx=0x7f880402a560 comp rx=0 tx=0).stop 2024-09-17T01:36:23.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.326+0000 7f8816400640 1 -- 172.21.15.42:0/190563248 shutdown_connections 2024-09-17T01:36:23.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.326+0000 7f8816400640 1 --2- 172.21.15.42:0/190563248 >> v2:172.21.15.43:3300/0 conn(0x7f8810162500 0x7f8810162910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.326+0000 7f8816400640 1 --2- 172.21.15.42:0/190563248 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f88100d0e10 0x7f88100d1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.326+0000 7f8816400640 1 --2- 172.21.15.42:0/190563248 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88100cfba0 0x7f88100b9fb0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.326+0000 7f8816400640 1 -- 172.21.15.42:0/190563248 >> 172.21.15.42:0/190563248 conn(0x7f88100b6140 msgr2=0x7f88100b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:23.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.326+0000 7f8816400640 1 -- 172.21.15.42:0/190563248 shutdown_connections 2024-09-17T01:36:23.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.326+0000 7f8816400640 1 -- 172.21.15.42:0/190563248 wait complete. 2024-09-17T01:36:23.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.328+0000 7f8816400640 1 Processor -- start 2024-09-17T01:36:23.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.328+0000 7f8816400640 1 -- start start 2024-09-17T01:36:23.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.330+0000 7f8816400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88100cfba0 0x7f88100b4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:23.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.330+0000 7f8816400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88100d0e10 0x7f881015a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:23.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.330+0000 7f8816400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8810162500 0x7f8810155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:23.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.330+0000 7f8816400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f88100b3060 con 0x7f88100cfba0 2024-09-17T01:36:23.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.330+0000 7f8816400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f88100ba600 con 0x7f88100d0e10 2024-09-17T01:36:23.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.330+0000 7f8816400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f88100b31e0 con 0x7f8810162500 2024-09-17T01:36:23.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.330+0000 7f8815000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88100cfba0 0x7f88100b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:23.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.330+0000 7f8815000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88100cfba0 0x7f88100b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52142/0 (socket says 172.21.15.42:52142) 2024-09-17T01:36:23.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.330+0000 7f8815000640 1 -- 172.21.15.42:0/1409786174 learned_addr learned my addr 172.21.15.42:0/1409786174 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:23.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.330+0000 7f8815a00640 1 --2- 172.21.15.42:0/1409786174 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8810162500 0x7f8810155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:23.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.330+0000 7f880fe00640 1 --2- 172.21.15.42:0/1409786174 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88100d0e10 0x7f881015a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:23.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.330+0000 7f8815000640 1 -- 172.21.15.42:0/1409786174 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8810162500 msgr2=0x7f8810155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:23.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.330+0000 7f8815000640 1 --2- 172.21.15.42:0/1409786174 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8810162500 0x7f8810155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.330+0000 7f8815000640 1 -- 172.21.15.42:0/1409786174 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88100d0e10 msgr2=0x7f881015a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:23.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.330+0000 7f8815000640 1 --2- 172.21.15.42:0/1409786174 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88100d0e10 0x7f881015a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.330+0000 7f8815000640 1 -- 172.21.15.42:0/1409786174 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88100ca650 con 0x7f88100cfba0 2024-09-17T01:36:23.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.331+0000 7f8815000640 1 --2- 172.21.15.42:0/1409786174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88100cfba0 0x7f88100b4980 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f8804034040 tx=0x7f8804003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:23.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.331+0000 7f880cc00640 1 -- 172.21.15.42:0/1409786174 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880403e030 con 0x7f88100cfba0 2024-09-17T01:36:23.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.331+0000 7f880cc00640 1 -- 172.21.15.42:0/1409786174 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8804003d10 con 0x7f88100cfba0 2024-09-17T01:36:23.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.331+0000 7f8816400640 1 -- 172.21.15.42:0/1409786174 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88100ca930 con 0x7f88100cfba0 2024-09-17T01:36:23.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.331+0000 7f880cc00640 1 -- 172.21.15.42:0/1409786174 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8804035040 con 0x7f88100cfba0 2024-09-17T01:36:23.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.331+0000 7f8816400640 1 -- 172.21.15.42:0/1409786174 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88100c8600 con 0x7f88100cfba0 2024-09-17T01:36:23.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.332+0000 7f8816400640 1 -- 172.21.15.42:0/1409786174 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88100cab70 con 0x7f88100cfba0 2024-09-17T01:36:23.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.334+0000 7f880cc00640 1 -- 172.21.15.42:0/1409786174 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8804041030 con 0x7f88100cfba0 2024-09-17T01:36:23.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.334+0000 7f880cc00640 1 --2- 172.21.15.42:0/1409786174 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f87f0078bc0 0x7f87f007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:23.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.335+0000 7f880cc00640 1 -- 172.21.15.42:0/1409786174 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f88040bb4c0 con 0x7f88100cfba0 2024-09-17T01:36:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.335+0000 7f880fe00640 1 --2- 172.21.15.42:0/1409786174 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f87f0078bc0 0x7f87f007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.336+0000 7f880fe00640 1 --2- 172.21.15.42:0/1409786174 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f87f0078bc0 0x7f87f007b0d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f88101f8b10 tx=0x7f87fc005f30 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.340+0000 7f880cc00640 1 -- 172.21.15.42:0/1409786174 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f88100cab70 con 0x7f88100cfba0 2024-09-17T01:36:23.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.577+0000 7f8816400640 1 -- 172.21.15.42:0/1409786174 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f88100d1220 con 0x7f88100cfba0 2024-09-17T01:36:23.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.577+0000 7f880cc00640 1 -- 172.21.15.42:0/1409786174 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v41) ==== 53+0+73 (secure 0 0 0) 0x7f8804083900 con 0x7f88100cfba0 2024-09-17T01:36:23.575 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T01:36:23.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.580+0000 7f8816400640 1 -- 172.21.15.42:0/1409786174 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f87f0078bc0 msgr2=0x7f87f007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:23.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.580+0000 7f8816400640 1 --2- 172.21.15.42:0/1409786174 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f87f0078bc0 0x7f87f007b0d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f88101f8b10 tx=0x7f87fc005f30 comp rx=0 tx=0).stop 2024-09-17T01:36:23.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.580+0000 7f8816400640 1 -- 172.21.15.42:0/1409786174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88100cfba0 msgr2=0x7f88100b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:23.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.580+0000 7f8816400640 1 --2- 172.21.15.42:0/1409786174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88100cfba0 0x7f88100b4980 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f8804034040 tx=0x7f8804003820 comp rx=0 tx=0).stop 2024-09-17T01:36:23.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.580+0000 7f8816400640 1 -- 172.21.15.42:0/1409786174 shutdown_connections 2024-09-17T01:36:23.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.580+0000 7f8816400640 1 --2- 172.21.15.42:0/1409786174 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f87f0078bc0 0x7f87f007b0d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.580+0000 7f8816400640 1 --2- 172.21.15.42:0/1409786174 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88100d0e10 0x7f881015a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.580+0000 7f8816400640 1 --2- 172.21.15.42:0/1409786174 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8810162500 0x7f8810155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.580+0000 7f8816400640 1 --2- 172.21.15.42:0/1409786174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88100cfba0 0x7f88100b4980 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:23.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.580+0000 7f8816400640 1 -- 172.21.15.42:0/1409786174 >> 172.21.15.42:0/1409786174 conn(0x7f88100b6140 msgr2=0x7f881015f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:23.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.580+0000 7f8816400640 1 -- 172.21.15.42:0/1409786174 shutdown_connections 2024-09-17T01:36:23.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23.580+0000 7f8816400640 1 -- 172.21.15.42:0/1409786174 wait complete. 2024-09-17T01:36:23.600 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T01:36:23.600 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:36:23.600 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-09-17T01:36:23.600 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T01:36:23.600 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:36:23.600 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T01:36:23.600 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T01:36:23.600 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:36:23.600 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:36:23.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:36:23.601 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-09-17T01:36:23.636 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:36:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:36:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:36:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:36:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-17T01:36:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:36:23.637 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:36:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-09-17T01:36:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-09-17T01:36:23.637 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:36:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-09-17T01:36:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-09-17T01:36:23.637 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:36:23.637 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:36:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-09-17T01:36:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-17T01:36:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42424sec preferred_lft 42424sec 2024-09-17T01:36:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-17T01:36:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:36:23.638 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:36:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:36:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-09-17T01:36:23.638 INFO:teuthology.orchestra.run.smithi042.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T01:36:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T01:36:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T01:36:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:36:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::68d2:2bff:fe2f:191a/64 scope link 2024-09-17T01:36:23.638 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:36:23.638 INFO:teuthology.orchestra.run.smithi042.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:36:23.639 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether e2:73:3e:9b:8a:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:36:23.639 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::e073:3eff:fe9b:8a00/64 scope link 2024-09-17T01:36:23.639 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:36:23.639 INFO:teuthology.orchestra.run.smithi042.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:36:23.639 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T01:36:23.639 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::240b:bfff:feb7:6e5b/64 scope link 2024-09-17T01:36:23.639 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:36:23.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:36:23.639 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:36:23.731 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-17T01:36:23.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:36:23.734 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-09-17T01:36:23.770 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-09-17T01:36:23.770 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:36:23.770 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-17T01:36:23.770 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-17T01:36:23.770 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:36:23.771 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:36:23.771 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:36:23.771 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T01:36:23.771 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T01:36:23.771 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T01:36:23.771 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:36:23.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:36:23.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:36:23.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:36:23.969 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-17T01:36:24.004 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T01:36:24.004 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T01:36:24.005 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:36:24.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:36:24.005 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-09-17T01:36:24.101 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:36:24.102 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T01:36:24.136 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:36:24.137 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:36:24.137 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:36:24.211 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T01:36:24.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:36:24.212 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:36:24.410 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:36:24.410 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:36:24.410 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:36:24.431 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:36:24.431 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:36:24.431 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:36:24.431 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:36:24.431 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:36:24.461 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:36:24.461 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:36:24.461 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:36:24.461 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:36:24.461 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:36:24.461 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-09-17T01:36:24.461 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-09-17T01:36:24.461 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fea1c88c-cb05-432f-a745-f9dcbb5f2503" will pass to kernel 2024-09-17T01:36:24.462 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T01:36:24.463 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-09-17T01:36:24.463 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T01:36:24.463 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T01:36:24.463 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T01:36:24.466 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T01:36:24.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:36:24.466 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:36:24.523 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:36:24.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:36:24.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:36:24.620 INFO:teuthology.orchestra.run.smithi042.stdout:client6375 2024-09-17T01:36:24.620 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:36:24.620 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:36:24.656 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 20 2024-09-17T01:36:24.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.930+0000 7fd536a00640 1 -- 172.21.15.42:0/471881023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd514004800 msgr2=0x7fd514004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:24.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.930+0000 7fd536a00640 1 --2- 172.21.15.42:0/471881023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd514004800 0x7fd514004c10 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fd530161580 tx=0x7fd514005830 comp rx=0 tx=0).stop 2024-09-17T01:36:24.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.931+0000 7fd536a00640 1 -- 172.21.15.42:0/471881023 shutdown_connections 2024-09-17T01:36:24.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.931+0000 7fd536a00640 1 --2- 172.21.15.42:0/471881023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd514004800 0x7fd514004c10 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:24.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.931+0000 7fd536a00640 1 -- 172.21.15.42:0/471881023 >> 172.21.15.42:0/471881023 conn(0x7fd5300b2930 msgr2=0x7fd53006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:24.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.931+0000 7fd536a00640 1 -- 172.21.15.42:0/471881023 shutdown_connections 2024-09-17T01:36:24.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.931+0000 7fd536a00640 1 -- 172.21.15.42:0/471881023 wait complete. 2024-09-17T01:36:24.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.933+0000 7fd536a00640 1 Processor -- start 2024-09-17T01:36:24.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.933+0000 7fd536a00640 1 -- start start 2024-09-17T01:36:24.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.934+0000 7fd536a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd514004800 0x7fd530144680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:24.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.934+0000 7fd536a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5301f92c0 0x7fd5301f96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:24.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.934+0000 7fd536a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd530073860 0x7fd530073c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:24.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.934+0000 7fd536a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd530156fd0 con 0x7fd5301f92c0 2024-09-17T01:36:24.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.934+0000 7fd536a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd530156e50 con 0x7fd530073860 2024-09-17T01:36:24.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.934+0000 7fd536a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd530157150 con 0x7fd514004800 2024-09-17T01:36:24.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.935+0000 7fd527e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5301f92c0 0x7fd5301f96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:24.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.935+0000 7fd527e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5301f92c0 0x7fd5301f96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52164/0 (socket says 172.21.15.42:52164) 2024-09-17T01:36:24.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.935+0000 7fd527e00640 1 -- 172.21.15.42:0/1955125474 learned_addr learned my addr 172.21.15.42:0/1955125474 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:24.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.935+0000 7fd52fe00640 1 --2- 172.21.15.42:0/1955125474 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd514004800 0x7fd530144680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:24.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.935+0000 7fd534a00640 1 --2- 172.21.15.42:0/1955125474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd530073860 0x7fd530073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:24.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.935+0000 7fd527e00640 1 -- 172.21.15.42:0/1955125474 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd514004800 msgr2=0x7fd530144680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:24.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.935+0000 7fd527e00640 1 --2- 172.21.15.42:0/1955125474 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd514004800 0x7fd530144680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:24.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.935+0000 7fd527e00640 1 -- 172.21.15.42:0/1955125474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd530073860 msgr2=0x7fd530073c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:24.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.935+0000 7fd527e00640 1 --2- 172.21.15.42:0/1955125474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd530073860 0x7fd530073c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:24.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.935+0000 7fd527e00640 1 -- 172.21.15.42:0/1955125474 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5300741b0 con 0x7fd5301f92c0 2024-09-17T01:36:24.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.935+0000 7fd527e00640 1 --2- 172.21.15.42:0/1955125474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5301f92c0 0x7fd5301f96d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fd51800c4b0 tx=0x7fd518001340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:24.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.936+0000 7fd52cc00640 1 -- 172.21.15.42:0/1955125474 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd518042070 con 0x7fd5301f92c0 2024-09-17T01:36:24.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.936+0000 7fd52cc00640 1 -- 172.21.15.42:0/1955125474 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd518006430 con 0x7fd5301f92c0 2024-09-17T01:36:24.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.936+0000 7fd52cc00640 1 -- 172.21.15.42:0/1955125474 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5180035f0 con 0x7fd5301f92c0 2024-09-17T01:36:24.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.936+0000 7fd536a00640 1 -- 172.21.15.42:0/1955125474 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd530147f90 con 0x7fd5301f92c0 2024-09-17T01:36:24.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.936+0000 7fd536a00640 1 -- 172.21.15.42:0/1955125474 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5301474b0 con 0x7fd5301f92c0 2024-09-17T01:36:24.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.937+0000 7fd536a00640 1 -- 172.21.15.42:0/1955125474 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5301f9de0 con 0x7fd5301f92c0 2024-09-17T01:36:24.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.938+0000 7fd52cc00640 1 -- 172.21.15.42:0/1955125474 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd518003790 con 0x7fd5301f92c0 2024-09-17T01:36:24.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.939+0000 7fd52cc00640 1 --2- 172.21.15.42:0/1955125474 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd50c078b90 0x7fd50c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:24.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.939+0000 7fd52cc00640 1 -- 172.21.15.42:0/1955125474 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7fd5180ba4b0 con 0x7fd5301f92c0 2024-09-17T01:36:24.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.940+0000 7fd52fe00640 1 --2- 172.21.15.42:0/1955125474 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd50c078b90 0x7fd50c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:24.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.940+0000 7fd52fe00640 1 --2- 172.21.15.42:0/1955125474 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd50c078b90 0x7fd50c07b0a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd530077840 tx=0x7fd520005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:24.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:24.944+0000 7fd52cc00640 1 -- 172.21.15.42:0/1955125474 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd5300741b0 con 0x7fd5301f92c0 2024-09-17T01:36:25.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.138+0000 7fd536a00640 1 -- 172.21.15.42:0/1955125474 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fd53006d9b0 con 0x7fd5301f92c0 2024-09-17T01:36:25.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.143+0000 7fd52cc00640 1 -- 172.21.15.42:0/1955125474 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v37)=0 v37) ==== 117+0+0 (secure 0 0 0) 0x7fd53015de90 con 0x7fd5301f92c0 2024-09-17T01:36:25.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.145+0000 7fd536a00640 1 -- 172.21.15.42:0/1955125474 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd50c078b90 msgr2=0x7fd50c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:25.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.145+0000 7fd536a00640 1 --2- 172.21.15.42:0/1955125474 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd50c078b90 0x7fd50c07b0a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd530077840 tx=0x7fd520005f90 comp rx=0 tx=0).stop 2024-09-17T01:36:25.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.145+0000 7fd536a00640 1 -- 172.21.15.42:0/1955125474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5301f92c0 msgr2=0x7fd5301f96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:25.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.145+0000 7fd536a00640 1 --2- 172.21.15.42:0/1955125474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5301f92c0 0x7fd5301f96d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fd51800c4b0 tx=0x7fd518001340 comp rx=0 tx=0).stop 2024-09-17T01:36:25.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.145+0000 7fd536a00640 1 -- 172.21.15.42:0/1955125474 shutdown_connections 2024-09-17T01:36:25.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.145+0000 7fd536a00640 1 --2- 172.21.15.42:0/1955125474 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd50c078b90 0x7fd50c07b0a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:25.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.145+0000 7fd536a00640 1 --2- 172.21.15.42:0/1955125474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd530073860 0x7fd530073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:25.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.145+0000 7fd536a00640 1 --2- 172.21.15.42:0/1955125474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5301f92c0 0x7fd5301f96d0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:25.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.145+0000 7fd536a00640 1 --2- 172.21.15.42:0/1955125474 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd514004800 0x7fd530144680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:25.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.145+0000 7fd536a00640 1 -- 172.21.15.42:0/1955125474 >> 172.21.15.42:0/1955125474 conn(0x7fd5300b2930 msgr2=0x7fd53015b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:25.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.146+0000 7fd536a00640 1 -- 172.21.15.42:0/1955125474 shutdown_connections 2024-09-17T01:36:25.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.146+0000 7fd536a00640 1 -- 172.21.15.42:0/1955125474 wait complete. 2024-09-17T01:36:25.168 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-09-17T01:36:25.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.399+0000 7f897c600640 1 -- 172.21.15.42:0/4014614311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f897415c920 msgr2=0x7f89740d0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:25.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.399+0000 7f897c600640 1 --2- 172.21.15.42:0/4014614311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f897415c920 0x7f89740d0e90 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f89740b3e00 tx=0x7f896002a510 comp rx=0 tx=0).stop 2024-09-17T01:36:25.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.400+0000 7f897c600640 1 -- 172.21.15.42:0/4014614311 shutdown_connections 2024-09-17T01:36:25.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.400+0000 7f897c600640 1 --2- 172.21.15.42:0/4014614311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f897415c920 0x7f89740d0e90 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:25.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.400+0000 7f897c600640 1 -- 172.21.15.42:0/4014614311 >> 172.21.15.42:0/4014614311 conn(0x7f897406cf00 msgr2=0x7f897406d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:25.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.400+0000 7f897c600640 1 -- 172.21.15.42:0/4014614311 shutdown_connections 2024-09-17T01:36:25.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.400+0000 7f897c600640 1 -- 172.21.15.42:0/4014614311 wait complete. 2024-09-17T01:36:25.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.402+0000 7f897c600640 1 Processor -- start 2024-09-17T01:36:25.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.402+0000 7f897c600640 1 -- start start 2024-09-17T01:36:25.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.403+0000 7f897c600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89740d13d0 0x7f89741f47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:25.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.403+0000 7f897c600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f897415bd50 0x7f89740cef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:25.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.404+0000 7f897c600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f897415c920 0x7f89740b2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:25.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.404+0000 7f897c600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f89741526c0 con 0x7f897415c920 2024-09-17T01:36:25.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.404+0000 7f897c600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8974152540 con 0x7f89740d13d0 2024-09-17T01:36:25.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.404+0000 7f897c600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8974152840 con 0x7f897415bd50 2024-09-17T01:36:25.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.404+0000 7f897a600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f897415c920 0x7f89740b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:25.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.404+0000 7f897a600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f897415c920 0x7f89740b2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52184/0 (socket says 172.21.15.42:52184) 2024-09-17T01:36:25.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.404+0000 7f897a600640 1 -- 172.21.15.42:0/1375007550 learned_addr learned my addr 172.21.15.42:0/1375007550 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:25.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.404+0000 7f8979200640 1 --2- 172.21.15.42:0/1375007550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f897415bd50 0x7f89740cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:25.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.404+0000 7f8979c00640 1 --2- 172.21.15.42:0/1375007550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89740d13d0 0x7f89741f47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:25.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.404+0000 7f897a600640 1 -- 172.21.15.42:0/1375007550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f897415bd50 msgr2=0x7f89740cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:25.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.404+0000 7f897a600640 1 --2- 172.21.15.42:0/1375007550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f897415bd50 0x7f89740cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:25.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.404+0000 7f897a600640 1 -- 172.21.15.42:0/1375007550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89740d13d0 msgr2=0x7f89741f47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:25.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.404+0000 7f897a600640 1 --2- 172.21.15.42:0/1375007550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89740d13d0 0x7f89741f47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:25.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.404+0000 7f897a600640 1 -- 172.21.15.42:0/1375007550 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89740cd390 con 0x7f897415c920 2024-09-17T01:36:25.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.404+0000 7f8979200640 1 --2- 172.21.15.42:0/1375007550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f897415bd50 0x7f89740cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:36:25.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.405+0000 7f897a600640 1 --2- 172.21.15.42:0/1375007550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f897415c920 0x7f89740b2400 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f896c00c6f0 tx=0x7f896c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:25.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.405+0000 7f8971600640 1 -- 172.21.15.42:0/1375007550 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c017070 con 0x7f897415c920 2024-09-17T01:36:25.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.405+0000 7f8971600640 1 -- 172.21.15.42:0/1375007550 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f896c003c90 con 0x7f897415c920 2024-09-17T01:36:25.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.405+0000 7f897c600640 1 -- 172.21.15.42:0/1375007550 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89740cd630 con 0x7f897415c920 2024-09-17T01:36:25.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.405+0000 7f8971600640 1 -- 172.21.15.42:0/1375007550 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c003e60 con 0x7f897415c920 2024-09-17T01:36:25.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.405+0000 7f897c600640 1 -- 172.21.15.42:0/1375007550 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89740cdbf0 con 0x7f897415c920 2024-09-17T01:36:25.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.406+0000 7f897c600640 1 -- 172.21.15.42:0/1375007550 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89740d0e90 con 0x7f897415c920 2024-09-17T01:36:25.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.407+0000 7f8971600640 1 -- 172.21.15.42:0/1375007550 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f896c01a070 con 0x7f897415c920 2024-09-17T01:36:25.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.408+0000 7f8971600640 1 --2- 172.21.15.42:0/1375007550 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8954078b90 0x7f895407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:25.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.408+0000 7f8971600640 1 -- 172.21.15.42:0/1375007550 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f896c09a2e0 con 0x7f897415c920 2024-09-17T01:36:25.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.409+0000 7f8979c00640 1 --2- 172.21.15.42:0/1375007550 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8954078b90 0x7f895407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:25.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.409+0000 7f8979c00640 1 --2- 172.21.15.42:0/1375007550 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8954078b90 0x7f895407b0a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8968006fd0 tx=0x7f8968009060 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:25.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.413+0000 7f8971600640 1 -- 172.21.15.42:0/1375007550 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f89740d17e0 con 0x7f897415c920 2024-09-17T01:36:25.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.606+0000 7f897c600640 1 -- 172.21.15.42:0/1375007550 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f89740704e0 con 0x7f897415c920 2024-09-17T01:36:25.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.610+0000 7f8971600640 1 -- 172.21.15.42:0/1375007550 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v38)=0 v38) ==== 116+0+0 (secure 0 0 0) 0x7f896c0620c0 con 0x7f897415c920 2024-09-17T01:36:25.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.613+0000 7f897c600640 1 -- 172.21.15.42:0/1375007550 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8954078b90 msgr2=0x7f895407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:25.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.613+0000 7f897c600640 1 --2- 172.21.15.42:0/1375007550 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8954078b90 0x7f895407b0a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8968006fd0 tx=0x7f8968009060 comp rx=0 tx=0).stop 2024-09-17T01:36:25.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.613+0000 7f897c600640 1 -- 172.21.15.42:0/1375007550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f897415c920 msgr2=0x7f89740b2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:25.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.613+0000 7f897c600640 1 --2- 172.21.15.42:0/1375007550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f897415c920 0x7f89740b2400 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f896c00c6f0 tx=0x7f896c00cbb0 comp rx=0 tx=0).stop 2024-09-17T01:36:25.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.613+0000 7f897c600640 1 -- 172.21.15.42:0/1375007550 shutdown_connections 2024-09-17T01:36:25.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.613+0000 7f897c600640 1 --2- 172.21.15.42:0/1375007550 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8954078b90 0x7f895407b0a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:25.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.613+0000 7f897c600640 1 --2- 172.21.15.42:0/1375007550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f897415c920 0x7f89740b2400 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:25.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.613+0000 7f897c600640 1 --2- 172.21.15.42:0/1375007550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f897415bd50 0x7f89740cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:25.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.613+0000 7f897c600640 1 --2- 172.21.15.42:0/1375007550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89740d13d0 0x7f89741f47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:25.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.613+0000 7f897c600640 1 -- 172.21.15.42:0/1375007550 >> 172.21.15.42:0/1375007550 conn(0x7f897406cf00 msgr2=0x7f89740b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:25.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.613+0000 7f897c600640 1 -- 172.21.15.42:0/1375007550 shutdown_connections 2024-09-17T01:36:25.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.613+0000 7f897c600640 1 -- 172.21.15.42:0/1375007550 wait complete. 2024-09-17T01:36:25.634 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_bits 1 2024-09-17T01:36:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.867+0000 7f17d2200640 1 -- 172.21.15.42:0/1781734479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17cc142f40 msgr2=0x7f17cc072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.867+0000 7f17d2200640 1 --2- 172.21.15.42:0/1781734479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17cc142f40 0x7f17cc072950 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f17cc15aab0 tx=0x7f17b802a560 comp rx=0 tx=0).stop 2024-09-17T01:36:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.868+0000 7f17d2200640 1 -- 172.21.15.42:0/1781734479 shutdown_connections 2024-09-17T01:36:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.868+0000 7f17d2200640 1 --2- 172.21.15.42:0/1781734479 >> v2:172.21.15.43:3300/0 conn(0x7f17cc072e90 0x7f17cc0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.868+0000 7f17d2200640 1 --2- 172.21.15.42:0/1781734479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17cc142f40 0x7f17cc072950 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.868+0000 7f17d2200640 1 -- 172.21.15.42:0/1781734479 >> 172.21.15.42:0/1781734479 conn(0x7f17cc0b2930 msgr2=0x7f17cc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.868+0000 7f17d2200640 1 -- 172.21.15.42:0/1781734479 shutdown_connections 2024-09-17T01:36:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.868+0000 7f17d2200640 1 -- 172.21.15.42:0/1781734479 wait complete. 2024-09-17T01:36:25.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.870+0000 7f17d2200640 1 Processor -- start 2024-09-17T01:36:25.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.870+0000 7f17d2200640 1 -- start start 2024-09-17T01:36:25.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.871+0000 7f17d2200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17cc072e90 0x7f17cc140080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:25.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.871+0000 7f17d2200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17cc0b3550 0x7f17cc1376b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:25.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.871+0000 7f17d2200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17cc142f40 0x7f17cc137bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:25.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.871+0000 7f17d2200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f17cc06d5b0 con 0x7f17cc0b3550 2024-09-17T01:36:25.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.871+0000 7f17d2200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f17cc06d430 con 0x7f17cc142f40 2024-09-17T01:36:25.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.871+0000 7f17d2200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f17cc06d730 con 0x7f17cc072e90 2024-09-17T01:36:25.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.872+0000 7f17caa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17cc0b3550 0x7f17cc1376b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:25.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.872+0000 7f17caa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17cc0b3550 0x7f17cc1376b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54550/0 (socket says 172.21.15.42:54550) 2024-09-17T01:36:25.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.872+0000 7f17caa00640 1 -- 172.21.15.42:0/3777716052 learned_addr learned my addr 172.21.15.42:0/3777716052 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:25.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.872+0000 7f17cbe00640 1 --2- 172.21.15.42:0/3777716052 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17cc142f40 0x7f17cc137bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:25.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.872+0000 7f17cb400640 1 --2- 172.21.15.42:0/3777716052 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17cc072e90 0x7f17cc140080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:25.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.872+0000 7f17caa00640 1 -- 172.21.15.42:0/3777716052 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17cc072e90 msgr2=0x7f17cc140080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:25.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.872+0000 7f17caa00640 1 --2- 172.21.15.42:0/3777716052 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17cc072e90 0x7f17cc140080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:25.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.872+0000 7f17caa00640 1 -- 172.21.15.42:0/3777716052 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17cc142f40 msgr2=0x7f17cc137bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:25.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.872+0000 7f17caa00640 1 --2- 172.21.15.42:0/3777716052 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17cc142f40 0x7f17cc137bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:25.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.872+0000 7f17caa00640 1 -- 172.21.15.42:0/3777716052 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17cc138130 con 0x7f17cc0b3550 2024-09-17T01:36:25.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.873+0000 7f17caa00640 1 --2- 172.21.15.42:0/3777716052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17cc0b3550 0x7f17cc1376b0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f17b8034040 tx=0x7f17b80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:25.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.873+0000 7f17c3400640 1 -- 172.21.15.42:0/3777716052 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b803e030 con 0x7f17cc0b3550 2024-09-17T01:36:25.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.873+0000 7f17c3400640 1 -- 172.21.15.42:0/3777716052 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17b8003db0 con 0x7f17cc0b3550 2024-09-17T01:36:25.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.873+0000 7f17d2200640 1 -- 172.21.15.42:0/3777716052 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17cc1409f0 con 0x7f17cc0b3550 2024-09-17T01:36:25.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.873+0000 7f17c3400640 1 -- 172.21.15.42:0/3777716052 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b8035040 con 0x7f17cc0b3550 2024-09-17T01:36:25.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.873+0000 7f17d2200640 1 -- 172.21.15.42:0/3777716052 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17cc140fb0 con 0x7f17cc0b3550 2024-09-17T01:36:25.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.874+0000 7f17d2200640 1 -- 172.21.15.42:0/3777716052 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17cc140760 con 0x7f17cc0b3550 2024-09-17T01:36:25.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.875+0000 7f17c3400640 1 -- 172.21.15.42:0/3777716052 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f17b8041030 con 0x7f17cc0b3550 2024-09-17T01:36:25.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.876+0000 7f17c3400640 1 --2- 172.21.15.42:0/3777716052 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f17ac078b90 0x7f17ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:25.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.876+0000 7f17c3400640 1 -- 172.21.15.42:0/3777716052 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f17b80bb750 con 0x7f17cc0b3550 2024-09-17T01:36:25.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.877+0000 7f17cb400640 1 --2- 172.21.15.42:0/3777716052 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f17ac078b90 0x7f17ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:25.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.877+0000 7f17cb400640 1 --2- 172.21.15.42:0/3777716052 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f17ac078b90 0x7f17ac07b0a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f17bc000f60 tx=0x7f17bc009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:25.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:25.881+0000 7f17c3400640 1 -- 172.21.15.42:0/3777716052 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f17b80834b0 con 0x7f17cc0b3550 2024-09-17T01:36:26.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.077+0000 7f17d2200640 1 -- 172.21.15.42:0/3777716052 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f17cc076880 con 0x7f17cc0b3550 2024-09-17T01:36:26.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.081+0000 7f17c3400640 1 -- 172.21.15.42:0/3777716052 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v39)=0 v39) ==== 116+0+0 (secure 0 0 0) 0x7f17cc076880 con 0x7f17cc0b3550 2024-09-17T01:36:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.084+0000 7f17d2200640 1 -- 172.21.15.42:0/3777716052 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f17ac078b90 msgr2=0x7f17ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.084+0000 7f17d2200640 1 --2- 172.21.15.42:0/3777716052 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f17ac078b90 0x7f17ac07b0a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f17bc000f60 tx=0x7f17bc009040 comp rx=0 tx=0).stop 2024-09-17T01:36:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.084+0000 7f17d2200640 1 -- 172.21.15.42:0/3777716052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17cc0b3550 msgr2=0x7f17cc1376b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.084+0000 7f17d2200640 1 --2- 172.21.15.42:0/3777716052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17cc0b3550 0x7f17cc1376b0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f17b8034040 tx=0x7f17b80038a0 comp rx=0 tx=0).stop 2024-09-17T01:36:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.084+0000 7f17d2200640 1 -- 172.21.15.42:0/3777716052 shutdown_connections 2024-09-17T01:36:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.084+0000 7f17d2200640 1 --2- 172.21.15.42:0/3777716052 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f17ac078b90 0x7f17ac07b0a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:26.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.084+0000 7f17d2200640 1 --2- 172.21.15.42:0/3777716052 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17cc142f40 0x7f17cc137bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:26.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.084+0000 7f17d2200640 1 --2- 172.21.15.42:0/3777716052 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17cc0b3550 0x7f17cc1376b0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:26.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.084+0000 7f17d2200640 1 --2- 172.21.15.42:0/3777716052 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17cc072e90 0x7f17cc140080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:26.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.084+0000 7f17d2200640 1 -- 172.21.15.42:0/3777716052 >> 172.21.15.42:0/3777716052 conn(0x7f17cc0b2930 msgr2=0x7f17cc160440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:26.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.084+0000 7f17d2200640 1 -- 172.21.15.42:0/3777716052 shutdown_connections 2024-09-17T01:36:26.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.084+0000 7f17d2200640 1 -- 172.21.15.42:0/3777716052 wait complete. 2024-09-17T01:36:26.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:36:26.106 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-09-17T01:36:26.148 DEBUG:teuthology.orchestra.run.smithi042:> stdin-killer -- python3 -c ' 2024-09-17T01:36:26.148 DEBUG:teuthology.orchestra.run.smithi042:> import os 2024-09-17T01:36:26.148 DEBUG:teuthology.orchestra.run.smithi042:> import stat 2024-09-17T01:36:26.148 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:36:26.149 DEBUG:teuthology.orchestra.run.smithi042:> print(os.stat("/home/ubuntu/cephtest/mnt.0/testdir").st_ino) 2024-09-17T01:36:26.149 DEBUG:teuthology.orchestra.run.smithi042:> ' 2024-09-17T01:36:26.290 INFO:teuthology.orchestra.run.smithi042.stdout:1099511627776 2024-09-17T01:36:26.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:36:26.301 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:36:26.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.571+0000 7fd5d1e00640 1 -- 172.21.15.42:0/711222733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5cc15f830 msgr2=0x7fd5cc15fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:26.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.571+0000 7fd5d1e00640 1 --2- 172.21.15.42:0/711222733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5cc15f830 0x7fd5cc15fcc0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4005fd0 tx=0x7fd5b402a5d0 comp rx=0 tx=0).stop 2024-09-17T01:36:26.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.571+0000 7fd5d1e00640 1 -- 172.21.15.42:0/711222733 shutdown_connections 2024-09-17T01:36:26.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.571+0000 7fd5d1e00640 1 --2- 172.21.15.42:0/711222733 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd5cc0cafe0 0x7fd5cc06e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:26.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.571+0000 7fd5d1e00640 1 --2- 172.21.15.42:0/711222733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5cc15f830 0x7fd5cc15fcc0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:26.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.571+0000 7fd5d1e00640 1 -- 172.21.15.42:0/711222733 >> 172.21.15.42:0/711222733 conn(0x7fd5cc0b25f0 msgr2=0x7fd5cc0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:26.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.571+0000 7fd5d1e00640 1 -- 172.21.15.42:0/711222733 shutdown_connections 2024-09-17T01:36:26.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.571+0000 7fd5d1e00640 1 -- 172.21.15.42:0/711222733 wait complete. 2024-09-17T01:36:26.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.573+0000 7fd5d1e00640 1 Processor -- start 2024-09-17T01:36:26.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.573+0000 7fd5d1e00640 1 -- start start 2024-09-17T01:36:26.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.575+0000 7fd5d1e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd5cc0cafe0 0x7fd5cc156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:26.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.575+0000 7fd5d1e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5cc15b680 0x7fd5cc1e8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:26.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.575+0000 7fd5d1e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5cc1e96f0 0x7fd5cc1e9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:26.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.575+0000 7fd5d1e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd5cc06f530 con 0x7fd5cc1e96f0 2024-09-17T01:36:26.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.575+0000 7fd5d1e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd5cc06f3b0 con 0x7fd5cc15b680 2024-09-17T01:36:26.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.575+0000 7fd5d1e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd5cc06f6b0 con 0x7fd5cc0cafe0 2024-09-17T01:36:26.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.575+0000 7fd5d1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5cc1e96f0 0x7fd5cc1e9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:26.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.575+0000 7fd5d1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5cc1e96f0 0x7fd5cc1e9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54572/0 (socket says 172.21.15.42:54572) 2024-09-17T01:36:26.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.575+0000 7fd5d1400640 1 -- 172.21.15.42:0/681762638 learned_addr learned my addr 172.21.15.42:0/681762638 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:26.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.575+0000 7fd5d0a00640 1 --2- 172.21.15.42:0/681762638 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd5cc0cafe0 0x7fd5cc156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:26.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.575+0000 7fd5c3e00640 1 --2- 172.21.15.42:0/681762638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5cc15b680 0x7fd5cc1e8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:26.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.576+0000 7fd5d1400640 1 -- 172.21.15.42:0/681762638 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd5cc0cafe0 msgr2=0x7fd5cc156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:26.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.576+0000 7fd5d1400640 1 --2- 172.21.15.42:0/681762638 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd5cc0cafe0 0x7fd5cc156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:26.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.576+0000 7fd5d1400640 1 -- 172.21.15.42:0/681762638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5cc15b680 msgr2=0x7fd5cc1e8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:26.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.576+0000 7fd5d1400640 1 --2- 172.21.15.42:0/681762638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5cc15b680 0x7fd5cc1e8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:26.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.576+0000 7fd5d1400640 1 -- 172.21.15.42:0/681762638 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5cc1ea040 con 0x7fd5cc1e96f0 2024-09-17T01:36:26.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.576+0000 7fd5d1400640 1 --2- 172.21.15.42:0/681762638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5cc1e96f0 0x7fd5cc1e9b00 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400e990 tx=0x7fd5c400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:26.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.576+0000 7fd5c9600640 1 -- 172.21.15.42:0/681762638 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4004d20 con 0x7fd5cc1e96f0 2024-09-17T01:36:26.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.576+0000 7fd5c9600640 1 -- 172.21.15.42:0/681762638 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5c400caa0 con 0x7fd5cc1e96f0 2024-09-17T01:36:26.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.576+0000 7fd5c9600640 1 -- 172.21.15.42:0/681762638 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4005020 con 0x7fd5cc1e96f0 2024-09-17T01:36:26.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.576+0000 7fd5d1e00640 1 -- 172.21.15.42:0/681762638 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5cc1f5980 con 0x7fd5cc1e96f0 2024-09-17T01:36:26.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.577+0000 7fd5d1e00640 1 -- 172.21.15.42:0/681762638 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5cc1f5f40 con 0x7fd5cc1e96f0 2024-09-17T01:36:26.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.578+0000 7fd5d1e00640 1 -- 172.21.15.42:0/681762638 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5cc06fbd0 con 0x7fd5cc1e96f0 2024-09-17T01:36:26.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.579+0000 7fd5c9600640 1 -- 172.21.15.42:0/681762638 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd5c40051c0 con 0x7fd5cc1e96f0 2024-09-17T01:36:26.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.580+0000 7fd5c9600640 1 --2- 172.21.15.42:0/681762638 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd5a8078b90 0x7fd5a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:26.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.580+0000 7fd5c9600640 1 -- 172.21.15.42:0/681762638 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7fd5c409b4b0 con 0x7fd5cc1e96f0 2024-09-17T01:36:26.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.580+0000 7fd5d0a00640 1 --2- 172.21.15.42:0/681762638 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd5a8078b90 0x7fd5a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:26.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.581+0000 7fd5d0a00640 1 --2- 172.21.15.42:0/681762638 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd5a8078b90 0x7fd5a807b0a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc001720 tx=0x7fd5bc009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:26.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.584+0000 7fd5c9600640 1 -- 172.21.15.42:0/681762638 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd5cc1ea040 con 0x7fd5cc1e96f0 2024-09-17T01:36:26.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.821+0000 7fd5d1e00640 1 -- 172.21.15.42:0/681762638 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5cc15fdd0 con 0x7fd5cc1e96f0 2024-09-17T01:36:26.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.822+0000 7fd5c9600640 1 -- 172.21.15.42:0/681762638 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5217 (secure 0 0 0) 0x7fd5c4016030 con 0x7fd5cc1e96f0 2024-09-17T01:36:26.820 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:26.820 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":41,"btime":"2024-09-17T01:36:14:305356+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5627,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/87636391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":87636391},{"type":"v1","addr":"172.21.15.42:6834","nonce":87636391}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6031,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2536194102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2536194102},{"type":"v1","addr":"172.21.15.43:6836","nonce":2536194102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6034,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2289964334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2289964334},{"type":"v1","addr":"172.21.15.43:6837","nonce":2289964334}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:36:10.790086+0000","modified":"2024-09-17T01:36:13.810139+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6195},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6195":{"gid":6195,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/2030017417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":2030017417},{"type":"v1","addr":"172.21.15.42:6835","nonce":2030017417}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6195,"qdb_cluster":[6195]},"id":4}]} 2024-09-17T01:36:26.820 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 41 2024-09-17T01:36:26.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.824+0000 7fd5d1e00640 1 -- 172.21.15.42:0/681762638 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd5a8078b90 msgr2=0x7fd5a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:26.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.824+0000 7fd5d1e00640 1 --2- 172.21.15.42:0/681762638 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd5a8078b90 0x7fd5a807b0a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc001720 tx=0x7fd5bc009040 comp rx=0 tx=0).stop 2024-09-17T01:36:26.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.824+0000 7fd5d1e00640 1 -- 172.21.15.42:0/681762638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5cc1e96f0 msgr2=0x7fd5cc1e9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:26.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.824+0000 7fd5d1e00640 1 --2- 172.21.15.42:0/681762638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5cc1e96f0 0x7fd5cc1e9b00 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400e990 tx=0x7fd5c400ee50 comp rx=0 tx=0).stop 2024-09-17T01:36:26.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.824+0000 7fd5d1e00640 1 -- 172.21.15.42:0/681762638 shutdown_connections 2024-09-17T01:36:26.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.824+0000 7fd5d1e00640 1 --2- 172.21.15.42:0/681762638 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd5a8078b90 0x7fd5a807b0a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:26.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.824+0000 7fd5d1e00640 1 --2- 172.21.15.42:0/681762638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5cc15b680 0x7fd5cc1e8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:26.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.824+0000 7fd5d1e00640 1 --2- 172.21.15.42:0/681762638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd5cc1e96f0 0x7fd5cc1e9b00 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:26.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.824+0000 7fd5d1e00640 1 --2- 172.21.15.42:0/681762638 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd5cc0cafe0 0x7fd5cc156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:26.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.824+0000 7fd5d1e00640 1 -- 172.21.15.42:0/681762638 >> 172.21.15.42:0/681762638 conn(0x7fd5cc0b25f0 msgr2=0x7fd5cc15f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:26.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.824+0000 7fd5d1e00640 1 -- 172.21.15.42:0/681762638 shutdown_connections 2024-09-17T01:36:26.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:26.824+0000 7fd5d1e00640 1 -- 172.21.15.42:0/681762638 wait complete. 2024-09-17T01:36:26.847 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-09-17T01:36:27.092 INFO:teuthology.orchestra.run.smithi042.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-17T01:36:26.146456+0000","btime":"2024-09-17T01:36:26.146456+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-17T01:36:26.146456+0000","atime":"2024-09-17T01:36:26.146456+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","type":"iauth","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","type":"ixattr","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":6375,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":6375,"want_loner":6375,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-17T01:36:27.092 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-17T01:36:26.146456+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "iauth", "xlock_by": {} }, "backtrace_version": 2, "btime": "2024-09-17T01:36:26.146456+0000", "change_attr": 0, "client_caps": [ { "client_id": 6375, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-09-17T01:36:26.146456+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1333, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 6375, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-17T01:36:26.146456+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 6375, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ixattr", "xlock_by": {} }, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-17T01:36:27.093 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:36:27.093 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:36:27.128 DEBUG:teuthology.orchestra.run.smithi042:> stdin-killer -- python3 -c ' 2024-09-17T01:36:27.128 DEBUG:teuthology.orchestra.run.smithi042:> import os 2024-09-17T01:36:27.129 DEBUG:teuthology.orchestra.run.smithi042:> import uuid 2024-09-17T01:36:27.129 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:36:27.129 DEBUG:teuthology.orchestra.run.smithi042:> n = 40 2024-09-17T01:36:27.129 DEBUG:teuthology.orchestra.run.smithi042:> create_hard_links = False 2024-09-17T01:36:27.129 DEBUG:teuthology.orchestra.run.smithi042:> if 0 > 0: 2024-09-17T01:36:27.129 DEBUG:teuthology.orchestra.run.smithi042:> create_hard_links = True 2024-09-17T01:36:27.129 DEBUG:teuthology.orchestra.run.smithi042:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file" 2024-09-17T01:36:27.129 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:36:27.129 DEBUG:teuthology.orchestra.run.smithi042:> dpath = os.path.dirname(path) 2024-09-17T01:36:27.129 DEBUG:teuthology.orchestra.run.smithi042:> fnameprefix = os.path.basename(path) 2024-09-17T01:36:27.129 DEBUG:teuthology.orchestra.run.smithi042:> os.makedirs(dpath, exist_ok=True) 2024-09-17T01:36:27.129 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:36:27.129 DEBUG:teuthology.orchestra.run.smithi042:> try: 2024-09-17T01:36:27.129 DEBUG:teuthology.orchestra.run.smithi042:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-17T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi042:> for i in range(n): 2024-09-17T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi042:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-17T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi042:> with open(fpath, '"'"'w'"'"') as f: 2024-09-17T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi042:> f.write(f"{i}") 2024-09-17T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi042:> if False: 2024-09-17T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi042:> f.flush() 2024-09-17T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi042:> os.fsync(f.fileno()) 2024-09-17T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi042:> if False: 2024-09-17T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi042:> os.unlink(fpath) 2024-09-17T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi042:> if False: 2024-09-17T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi042:> os.fsync(dirfd) 2024-09-17T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi042:> if create_hard_links: 2024-09-17T01:36:27.130 DEBUG:teuthology.orchestra.run.smithi042:> for j in range(0): 2024-09-17T01:36:27.131 DEBUG:teuthology.orchestra.run.smithi042:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-17T01:36:27.131 DEBUG:teuthology.orchestra.run.smithi042:> if False: 2024-09-17T01:36:27.131 DEBUG:teuthology.orchestra.run.smithi042:> os.fsync(dirfd) 2024-09-17T01:36:27.131 DEBUG:teuthology.orchestra.run.smithi042:> finally: 2024-09-17T01:36:27.131 DEBUG:teuthology.orchestra.run.smithi042:> os.close(dirfd) 2024-09-17T01:36:27.131 DEBUG:teuthology.orchestra.run.smithi042:> ' 2024-09-17T01:36:27.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:36:27.352 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:36:27.352 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:36:27.428 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:36:27.428 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:36:27.504 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T01:36:27.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.773+0000 7fc753200640 1 -- 172.21.15.42:0/3176062865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc754162520 msgr2=0x7fc7540cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:27.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.773+0000 7fc753200640 1 --2- 172.21.15.42:0/3176062865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc754162520 0x7fc7540cf840 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fc73c005fd0 tx=0x7fc73c02a540 comp rx=0 tx=0).stop 2024-09-17T01:36:27.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.773+0000 7fc753200640 1 -- 172.21.15.42:0/3176062865 shutdown_connections 2024-09-17T01:36:27.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.773+0000 7fc753200640 1 --2- 172.21.15.42:0/3176062865 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc7540cfd80 0x7fc7540d2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:27.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.773+0000 7fc753200640 1 --2- 172.21.15.42:0/3176062865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc754162520 0x7fc7540cf840 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:27.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.773+0000 7fc753200640 1 -- 172.21.15.42:0/3176062865 >> 172.21.15.42:0/3176062865 conn(0x7fc754073f20 msgr2=0x7fc75406cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:27.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.773+0000 7fc753200640 1 -- 172.21.15.42:0/3176062865 shutdown_connections 2024-09-17T01:36:27.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.773+0000 7fc753200640 1 -- 172.21.15.42:0/3176062865 wait complete. 2024-09-17T01:36:27.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.775+0000 7fc753200640 1 Processor -- start 2024-09-17T01:36:27.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.775+0000 7fc753200640 1 -- start start 2024-09-17T01:36:27.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.777+0000 7fc753200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc7540cfd80 0x7fc7540b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:27.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.777+0000 7fc753200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc75415fbe0 0x7fc75415ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:27.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.777+0000 7fc753200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc754162520 0x7fc7540ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:27.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.777+0000 7fc753200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc7540d0d00 con 0x7fc754162520 2024-09-17T01:36:27.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.777+0000 7fc753200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc7540d3900 con 0x7fc75415fbe0 2024-09-17T01:36:27.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.777+0000 7fc753200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc7540d0e80 con 0x7fc7540cfd80 2024-09-17T01:36:27.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.777+0000 7fc752800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc754162520 0x7fc7540ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:27.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.777+0000 7fc752800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc754162520 0x7fc7540ca2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54582/0 (socket says 172.21.15.42:54582) 2024-09-17T01:36:27.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.777+0000 7fc752800640 1 -- 172.21.15.42:0/2476455281 learned_addr learned my addr 172.21.15.42:0/2476455281 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:27.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.777+0000 7fc74be00640 1 --2- 172.21.15.42:0/2476455281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc75415fbe0 0x7fc75415ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:27.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.777+0000 7fc751e00640 1 --2- 172.21.15.42:0/2476455281 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc7540cfd80 0x7fc7540b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:27.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.777+0000 7fc752800640 1 -- 172.21.15.42:0/2476455281 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc7540cfd80 msgr2=0x7fc7540b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:27.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.777+0000 7fc752800640 1 --2- 172.21.15.42:0/2476455281 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc7540cfd80 0x7fc7540b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:27.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.777+0000 7fc752800640 1 -- 172.21.15.42:0/2476455281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc75415fbe0 msgr2=0x7fc75415ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:27.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.777+0000 7fc752800640 1 --2- 172.21.15.42:0/2476455281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc75415fbe0 0x7fc75415ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:27.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.777+0000 7fc752800640 1 -- 172.21.15.42:0/2476455281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7540cba20 con 0x7fc754162520 2024-09-17T01:36:27.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.778+0000 7fc752800640 1 --2- 172.21.15.42:0/2476455281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc754162520 0x7fc7540ca2b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc74c00ea80 tx=0x7fc74c00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:27.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.778+0000 7fc74a000640 1 -- 172.21.15.42:0/2476455281 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74c004b20 con 0x7fc754162520 2024-09-17T01:36:27.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.778+0000 7fc74a000640 1 -- 172.21.15.42:0/2476455281 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc74c004ce0 con 0x7fc754162520 2024-09-17T01:36:27.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.778+0000 7fc74a000640 1 -- 172.21.15.42:0/2476455281 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74c005280 con 0x7fc754162520 2024-09-17T01:36:27.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.778+0000 7fc753200640 1 -- 172.21.15.42:0/2476455281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7540cbd00 con 0x7fc754162520 2024-09-17T01:36:27.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.778+0000 7fc753200640 1 -- 172.21.15.42:0/2476455281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7540cc2c0 con 0x7fc754162520 2024-09-17T01:36:27.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.779+0000 7fc753200640 1 -- 172.21.15.42:0/2476455281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7540d13a0 con 0x7fc754162520 2024-09-17T01:36:27.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.780+0000 7fc74a000640 1 -- 172.21.15.42:0/2476455281 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc74c005420 con 0x7fc754162520 2024-09-17T01:36:27.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.782+0000 7fc74a000640 1 --2- 172.21.15.42:0/2476455281 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc730078b90 0x7fc73007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:27.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.782+0000 7fc74a000640 1 -- 172.21.15.42:0/2476455281 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7fc74c09ba80 con 0x7fc754162520 2024-09-17T01:36:27.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.783+0000 7fc751e00640 1 --2- 172.21.15.42:0/2476455281 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc730078b90 0x7fc73007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:27.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.783+0000 7fc751e00640 1 --2- 172.21.15.42:0/2476455281 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc730078b90 0x7fc73007b0a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc7440015e0 tx=0x7fc744009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:27.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.787+0000 7fc74a000640 1 -- 172.21.15.42:0/2476455281 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc74c09de20 con 0x7fc754162520 2024-09-17T01:36:27.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.990+0000 7fc753200640 1 -- 172.21.15.42:0/2476455281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc7540cb340 con 0x7fc754162520 2024-09-17T01:36:27.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.991+0000 7fc74a000640 1 -- 172.21.15.42:0/2476455281 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v62) ==== 80+0+0 (secure 0 0 0) 0x7fc74c063eb0 con 0x7fc754162520 2024-09-17T01:36:27.988 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-17T01:36:27.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.993+0000 7fc753200640 1 -- 172.21.15.42:0/2476455281 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc730078b90 msgr2=0x7fc73007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:27.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.993+0000 7fc753200640 1 --2- 172.21.15.42:0/2476455281 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc730078b90 0x7fc73007b0a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc7440015e0 tx=0x7fc744009040 comp rx=0 tx=0).stop 2024-09-17T01:36:27.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.993+0000 7fc753200640 1 -- 172.21.15.42:0/2476455281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc754162520 msgr2=0x7fc7540ca2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:27.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.993+0000 7fc753200640 1 --2- 172.21.15.42:0/2476455281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc754162520 0x7fc7540ca2b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc74c00ea80 tx=0x7fc74c00ef40 comp rx=0 tx=0).stop 2024-09-17T01:36:27.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.993+0000 7fc753200640 1 -- 172.21.15.42:0/2476455281 shutdown_connections 2024-09-17T01:36:27.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.993+0000 7fc753200640 1 --2- 172.21.15.42:0/2476455281 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc730078b90 0x7fc73007b0a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:27.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.993+0000 7fc753200640 1 --2- 172.21.15.42:0/2476455281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc75415fbe0 0x7fc75415ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:27.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.993+0000 7fc753200640 1 --2- 172.21.15.42:0/2476455281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc754162520 0x7fc7540ca2b0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:27.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.993+0000 7fc753200640 1 --2- 172.21.15.42:0/2476455281 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc7540cfd80 0x7fc7540b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:27.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.993+0000 7fc753200640 1 -- 172.21.15.42:0/2476455281 >> 172.21.15.42:0/2476455281 conn(0x7fc754073f20 msgr2=0x7fc7540b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:27.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.993+0000 7fc753200640 1 -- 172.21.15.42:0/2476455281 shutdown_connections 2024-09-17T01:36:27.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:27.993+0000 7fc753200640 1 -- 172.21.15.42:0/2476455281 wait complete. 2024-09-17T01:36:28.015 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T01:36:28.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:36:28.015 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T01:36:28.167 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:36:28.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:36:28.168 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T01:36:28.206 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 flush journal 2024-09-17T01:36:28.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.476+0000 7f2f67200640 1 -- 172.21.15.42:0/3719788549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f600cd4a0 msgr2=0x7f2f6015b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:28.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.476+0000 7f2f67200640 1 --2- 172.21.15.42:0/3719788549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f600cd4a0 0x7f2f6015b6d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009830 tx=0x7f2f5402a5b0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.476+0000 7f2f67200640 1 -- 172.21.15.42:0/3719788549 shutdown_connections 2024-09-17T01:36:28.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.476+0000 7f2f67200640 1 --2- 172.21.15.42:0/3719788549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f600cd4a0 0x7f2f6015b6d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.476+0000 7f2f67200640 1 -- 172.21.15.42:0/3719788549 >> 172.21.15.42:0/3719788549 conn(0x7f2f6006d440 msgr2=0x7f2f600b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:28.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.476+0000 7f2f67200640 1 -- 172.21.15.42:0/3719788549 shutdown_connections 2024-09-17T01:36:28.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.476+0000 7f2f67200640 1 -- 172.21.15.42:0/3719788549 wait complete. 2024-09-17T01:36:28.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.478+0000 7f2f67200640 1 Processor -- start 2024-09-17T01:36:28.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.478+0000 7f2f67200640 1 -- start start 2024-09-17T01:36:28.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.480+0000 7f2f67200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f600ae820 0x7f2f60149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.480+0000 7f2f67200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f600cd4a0 0x7f2f60155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.480+0000 7f2f67200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f6014a3f0 0x7f2f60155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.480+0000 7f2f67200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2f600b4340 con 0x7f2f600ae820 2024-09-17T01:36:28.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.480+0000 7f2f67200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2f600b41c0 con 0x7f2f600cd4a0 2024-09-17T01:36:28.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.480+0000 7f2f67200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2f600b44c0 con 0x7f2f6014a3f0 2024-09-17T01:36:28.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.480+0000 7f2f65e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f600ae820 0x7f2f60149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.480+0000 7f2f65e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f600ae820 0x7f2f60149eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54596/0 (socket says 172.21.15.42:54596) 2024-09-17T01:36:28.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.480+0000 7f2f65e00640 1 -- 172.21.15.42:0/2746160868 learned_addr learned my addr 172.21.15.42:0/2746160868 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.480+0000 7f2f65400640 1 --2- 172.21.15.42:0/2746160868 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f600cd4a0 0x7f2f60155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.480+0000 7f2f66800640 1 --2- 172.21.15.42:0/2746160868 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f6014a3f0 0x7f2f60155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.480+0000 7f2f65e00640 1 -- 172.21.15.42:0/2746160868 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f6014a3f0 msgr2=0x7f2f60155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.480+0000 7f2f65e00640 1 --2- 172.21.15.42:0/2746160868 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f6014a3f0 0x7f2f60155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.480+0000 7f2f65e00640 1 -- 172.21.15.42:0/2746160868 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f600cd4a0 msgr2=0x7f2f60155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.480+0000 7f2f65e00640 1 --2- 172.21.15.42:0/2746160868 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f600cd4a0 0x7f2f60155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.480+0000 7f2f65e00640 1 -- 172.21.15.42:0/2746160868 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f600d0910 con 0x7f2f600ae820 2024-09-17T01:36:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.480+0000 7f2f65400640 1 --2- 172.21.15.42:0/2746160868 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f600cd4a0 0x7f2f60155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:36:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.481+0000 7f2f66800640 1 --2- 172.21.15.42:0/2746160868 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f6014a3f0 0x7f2f60155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:36:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.481+0000 7f2f65e00640 1 --2- 172.21.15.42:0/2746160868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f600ae820 0x7f2f60149eb0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f2f5402aba0 tx=0x7f2f54033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.481+0000 7f2f5a000640 1 -- 172.21.15.42:0/2746160868 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f54005c90 con 0x7f2f600ae820 2024-09-17T01:36:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.481+0000 7f2f5a000640 1 -- 172.21.15.42:0/2746160868 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f54031e50 con 0x7f2f600ae820 2024-09-17T01:36:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.481+0000 7f2f67200640 1 -- 172.21.15.42:0/2746160868 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f60159950 con 0x7f2f600ae820 2024-09-17T01:36:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.481+0000 7f2f5a000640 1 -- 172.21.15.42:0/2746160868 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f54005260 con 0x7f2f600ae820 2024-09-17T01:36:28.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.481+0000 7f2f67200640 1 -- 172.21.15.42:0/2746160868 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f60155d80 con 0x7f2f600ae820 2024-09-17T01:36:28.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.485+0000 7f2f5a000640 1 -- 172.21.15.42:0/2746160868 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2f54005400 con 0x7f2f600ae820 2024-09-17T01:36:28.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.486+0000 7f2f5a000640 1 --2- 172.21.15.42:0/2746160868 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f44078b90 0x7f2f4407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.486+0000 7f2f5a000640 1 -- 172.21.15.42:0/2746160868 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f2f540bbdf0 con 0x7f2f600ae820 2024-09-17T01:36:28.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.486+0000 7f2f6f86e740 1 Processor -- start 2024-09-17T01:36:28.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.486+0000 7f2f6f86e740 1 -- start start 2024-09-17T01:36:28.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.487+0000 7f2f65400640 1 --2- 172.21.15.42:0/2746160868 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f44078b90 0x7f2f4407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.487+0000 7f2f65400640 1 --2- 172.21.15.42:0/2746160868 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f44078b90 0x7f2f4407b0a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2f50001220 tx=0x7f2f50009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:28.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.488+0000 7f2f6f86e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56231eb89390 0x56231ef77730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.488+0000 7f2f6f86e740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56231eb604d0 0x56231ef5a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.488+0000 7f2f6f86e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb686b0 0x56231ef5a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.488+0000 7f2f6f86e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56231ee901c0 con 0x56231eb686b0 2024-09-17T01:36:28.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.488+0000 7f2f6f86e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56231eea3870 con 0x56231eb89390 2024-09-17T01:36:28.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.488+0000 7f2f6f86e740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56231ee92ca0 con 0x56231eb604d0 2024-09-17T01:36:28.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.488+0000 7f2f66800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb686b0 0x56231ef5a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.488+0000 7f2f66800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb686b0 0x56231ef5a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54610/0 (socket says 172.21.15.42:54610) 2024-09-17T01:36:28.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.488+0000 7f2f66800640 1 -- 172.21.15.42:0/3020418525 learned_addr learned my addr 172.21.15.42:0/3020418525 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:28.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.489+0000 7f2f65400640 1 --2- 172.21.15.42:0/3020418525 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56231eb604d0 0x56231ef5a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.489+0000 7f2f65e00640 1 --2- 172.21.15.42:0/3020418525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56231eb89390 0x56231ef77730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.489+0000 7f2f66800640 1 -- 172.21.15.42:0/3020418525 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56231eb604d0 msgr2=0x56231ef5a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:28.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.489+0000 7f2f66800640 1 --2- 172.21.15.42:0/3020418525 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56231eb604d0 0x56231ef5a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.489+0000 7f2f66800640 1 -- 172.21.15.42:0/3020418525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56231eb89390 msgr2=0x56231ef77730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:28.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.489+0000 7f2f66800640 1 --2- 172.21.15.42:0/3020418525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56231eb89390 0x56231ef77730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.489+0000 7f2f66800640 1 -- 172.21.15.42:0/3020418525 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56231ec6b7d0 con 0x56231eb686b0 2024-09-17T01:36:28.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.489+0000 7f2f65400640 1 --2- 172.21.15.42:0/3020418525 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56231eb604d0 0x56231ef5a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:36:28.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.489+0000 7f2f65e00640 1 --2- 172.21.15.42:0/3020418525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56231eb89390 0x56231ef77730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:36:28.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.489+0000 7f2f66800640 1 --2- 172.21.15.42:0/3020418525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb686b0 0x56231ef5a940 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c001d60 tx=0x7f2f5c00d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96720db3d9fd77e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:28.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.489+0000 7f2f4e600640 1 -- 172.21.15.42:0/3020418525 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c016030 con 0x56231eb686b0 2024-09-17T01:36:28.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.490+0000 7f2f4e600640 1 -- 172.21.15.42:0/3020418525 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f5c006b50 con 0x56231eb686b0 2024-09-17T01:36:28.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.490+0000 7f2f4e600640 1 -- 172.21.15.42:0/3020418525 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c00db90 con 0x56231eb686b0 2024-09-17T01:36:28.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.490+0000 7f2f6f86e740 1 -- 172.21.15.42:0/3020418525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb686b0 msgr2=0x56231ef5a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:28.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.490+0000 7f2f6f86e740 1 --2- 172.21.15.42:0/3020418525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb686b0 0x56231ef5a940 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c001d60 tx=0x7f2f5c00d150 comp rx=0 tx=0).stop 2024-09-17T01:36:28.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.490+0000 7f2f6f86e740 1 -- 172.21.15.42:0/3020418525 shutdown_connections 2024-09-17T01:36:28.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.490+0000 7f2f6f86e740 1 --2- 172.21.15.42:0/3020418525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb686b0 0x56231ef5a940 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.490+0000 7f2f6f86e740 1 --2- 172.21.15.42:0/3020418525 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56231eb604d0 0x56231ef5a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.490+0000 7f2f6f86e740 1 --2- 172.21.15.42:0/3020418525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56231eb89390 0x56231ef77730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.490+0000 7f2f6f86e740 1 -- 172.21.15.42:0/3020418525 >> 172.21.15.42:0/3020418525 conn(0x56231eb7d4e0 msgr2=0x56231ef30620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:28.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.491+0000 7f2f6f86e740 1 -- 172.21.15.42:0/3020418525 shutdown_connections 2024-09-17T01:36:28.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.491+0000 7f2f6f86e740 1 -- 172.21.15.42:0/3020418525 wait complete. 2024-09-17T01:36:28.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.492+0000 7f2f6f86e740 1 -- start start 2024-09-17T01:36:28.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.492+0000 7f2f6f86e740 1 Processor -- start 2024-09-17T01:36:28.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.493+0000 7f2f6f86e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb604d0 0x56231ef71730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.493+0000 7f2f6f86e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56231eb686b0 0x56231ef2f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.493+0000 7f2f6f86e740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56231eb89390 0x56231ef2fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.493+0000 7f2f6f86e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56231ee39410 con 0x56231eb604d0 2024-09-17T01:36:28.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.493+0000 7f2f6f86e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56231ee96ab0 con 0x56231eb686b0 2024-09-17T01:36:28.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.493+0000 7f2f6f86e740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56231ec03740 con 0x56231eb89390 2024-09-17T01:36:28.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.493+0000 7f2f6f86e740 10 client.0 _ll_register_callbacks cb 0x56231ee16360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:36:28.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.493+0000 7f2f65e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb604d0 0x56231ef71730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.494+0000 7f2f65e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb604d0 0x56231ef71730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54620/0 (socket says 172.21.15.42:54620) 2024-09-17T01:36:28.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.494+0000 7f2f65e00640 1 -- 172.21.15.42:0/408921273 learned_addr learned my addr 172.21.15.42:0/408921273 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:28.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.494+0000 7f2f66800640 1 --2- 172.21.15.42:0/408921273 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56231eb89390 0x56231ef2fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.494+0000 7f2f65400640 1 --2- 172.21.15.42:0/408921273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56231eb686b0 0x56231ef2f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.494+0000 7f2f65e00640 1 -- 172.21.15.42:0/408921273 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56231eb89390 msgr2=0x56231ef2fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:28.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.494+0000 7f2f65e00640 1 --2- 172.21.15.42:0/408921273 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56231eb89390 0x56231ef2fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.494+0000 7f2f65e00640 1 -- 172.21.15.42:0/408921273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56231eb686b0 msgr2=0x56231ef2f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:28.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.494+0000 7f2f65e00640 1 --2- 172.21.15.42:0/408921273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56231eb686b0 0x56231ef2f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.494+0000 7f2f65e00640 1 -- 172.21.15.42:0/408921273 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56231ebf4970 con 0x56231eb604d0 2024-09-17T01:36:28.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.494+0000 7f2f65e00640 1 --2- 172.21.15.42:0/408921273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb604d0 0x56231ef71730 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009230 tx=0x7f2f54084100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c72bb100ee3f384 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:28.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.494+0000 7f2f42a00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:36:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.494+0000 7f2f42a00640 1 -- 172.21.15.42:0/408921273 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f54048070 con 0x56231eb604d0 2024-09-17T01:36:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.494+0000 7f2f42a00640 1 -- 172.21.15.42:0/408921273 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f2f54088150 con 0x56231eb604d0 2024-09-17T01:36:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.494+0000 7f2f6f86e740 1 -- 172.21.15.42:0/408921273 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f5c006b50 con 0x56231eb604d0 2024-09-17T01:36:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.495+0000 7f2f42a00640 1 -- 172.21.15.42:0/408921273 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f2f54085e60 con 0x56231eb604d0 2024-09-17T01:36:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.495+0000 7f2f6f86e740 10 client.6423 fetch_fsmap learned FSMap version 41 2024-09-17T01:36:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.495+0000 7f2f6f86e740 1 -- 172.21.15.42:0/408921273 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x56231ebd26a0 con 0x56231eb604d0 2024-09-17T01:36:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.495+0000 7f2f42a00640 1 -- 172.21.15.42:0/408921273 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f5c006b50 con 0x56231eb604d0 2024-09-17T01:36:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.495+0000 7f2f42a00640 1 -- 172.21.15.42:0/408921273 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 41) ==== 3502+0+0 (secure 0 0 0) 0x7f2f540a8070 con 0x56231eb604d0 2024-09-17T01:36:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.495+0000 7f2f6f86e740 10 client.6423 fetch_fsmap finished waiting for FSMap version 41 2024-09-17T01:36:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.495+0000 7f2f6f86e740 10 client.6423 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T01:36:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.495+0000 7f2f6f86e740 20 client.6423 populate_metadata read hostname 'smithi042' 2024-09-17T01:36:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.495+0000 7f2f6f86e740 1 --2- 172.21.15.42:0/408921273 >> [v2:172.21.15.42:6833/2030017417,v1:172.21.15.42:6835/2030017417] conn(0x56231eb47f60 0x56231ef6f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.495+0000 7f2f6f86e740 4 client.6423 mds_command: new command op to 6195 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:36:28.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.495+0000 7f2f6f86e740 1 -- 172.21.15.42:0/408921273 --> [v2:172.21.15.42:6833/2030017417,v1:172.21.15.42:6835/2030017417] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56231eea57c0 con 0x56231eb47f60 2024-09-17T01:36:28.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.495+0000 7f2f65400640 1 --2- 172.21.15.42:0/408921273 >> [v2:172.21.15.42:6833/2030017417,v1:172.21.15.42:6835/2030017417] conn(0x56231eb47f60 0x56231ef6f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.496+0000 7f2f65400640 1 --2- 172.21.15.42:0/408921273 >> [v2:172.21.15.42:6833/2030017417,v1:172.21.15.42:6835/2030017417] conn(0x56231eb47f60 0x56231ef6f7d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81602f599e0c569 server_cookie=744819b201ff42f9 in_seq=0 out_seq=0 2024-09-17T01:36:28.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.496+0000 7f2f42a00640 10 client.6423 ms_handle_connect on v2:172.21.15.42:6833/2030017417 2024-09-17T01:36:28.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.497+0000 7f2f42a00640 1 -- 172.21.15.42:0/408921273 <== mds.0 v2:172.21.15.42:6833/2030017417 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56231eea57c0 con 0x56231eb47f60 2024-09-17T01:36:28.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.497+0000 7f2f42a00640 10 client.6423 handle_command_reply: tid=0 2024-09-17T01:36:28.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.497+0000 7f2f6f86e740 1 client.6423 shutdown 2024-09-17T01:36:28.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.497+0000 7f2f6f86e740 1 -- 172.21.15.42:0/408921273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb604d0 msgr2=0x56231ef71730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:28.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.497+0000 7f2f6f86e740 1 --2- 172.21.15.42:0/408921273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb604d0 0x56231ef71730 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009230 tx=0x7f2f54084100 comp rx=0 tx=0).stop 2024-09-17T01:36:28.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.497+0000 7f2f6f86e740 1 -- 172.21.15.42:0/408921273 shutdown_connections 2024-09-17T01:36:28.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.497+0000 7f2f6f86e740 1 --2- 172.21.15.42:0/408921273 >> [v2:172.21.15.42:6833/2030017417,v1:172.21.15.42:6835/2030017417] conn(0x56231eb47f60 0x56231ef6f7d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.497+0000 7f2f6f86e740 1 --2- 172.21.15.42:0/408921273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56231eb686b0 0x56231ef2f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.497+0000 7f2f6f86e740 1 --2- 172.21.15.42:0/408921273 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56231eb89390 0x56231ef2fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.497+0000 7f2f6f86e740 1 --2- 172.21.15.42:0/408921273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb604d0 0x56231ef71730 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.497+0000 7f2f42a00640 0 client.6423 ms_handle_reset on v2:172.21.15.42:6833/2030017417 2024-09-17T01:36:28.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.497+0000 7f2f6f86e740 1 -- 172.21.15.42:0/408921273 >> 172.21.15.42:0/408921273 conn(0x56231eb7d4e0 msgr2=0x56231ef49bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:28.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.497+0000 7f2f6f86e740 1 -- 172.21.15.42:0/408921273 shutdown_connections 2024-09-17T01:36:28.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.497+0000 7f2f6f86e740 1 -- 172.21.15.42:0/408921273 wait complete. 2024-09-17T01:36:28.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.497+0000 7f2f6f86e740 20 client.6423 trim_cache size 0 max 16384 2024-09-17T01:36:28.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.513+0000 7f2f6f86e740 1 Processor -- start 2024-09-17T01:36:28.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.514+0000 7f2f6f86e740 1 -- start start 2024-09-17T01:36:28.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.515+0000 7f2f6f86e740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56231eb604d0 0x56231ef70fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.515+0000 7f2f6f86e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56231eb686b0 0x56231ef71510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.515+0000 7f2f6f86e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb89390 0x56231ef8db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.515+0000 7f2f6f86e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2f60202220 con 0x56231eb89390 2024-09-17T01:36:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.515+0000 7f2f6f86e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6014cda0 con 0x56231eb686b0 2024-09-17T01:36:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.515+0000 7f2f6f86e740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2f601f9b40 con 0x56231eb604d0 2024-09-17T01:36:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.515+0000 7f2f66800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb89390 0x56231ef8db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.515+0000 7f2f66800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb89390 0x56231ef8db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54628/0 (socket says 172.21.15.42:54628) 2024-09-17T01:36:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.515+0000 7f2f66800640 1 -- 172.21.15.42:0/890559229 learned_addr learned my addr 172.21.15.42:0/890559229 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.515+0000 7f2f65400640 1 --2- 172.21.15.42:0/890559229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56231eb686b0 0x56231ef71510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.515+0000 7f2f65e00640 1 --2- 172.21.15.42:0/890559229 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56231eb604d0 0x56231ef70fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.515+0000 7f2f66800640 1 -- 172.21.15.42:0/890559229 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56231eb604d0 msgr2=0x56231ef70fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:28.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.515+0000 7f2f66800640 1 --2- 172.21.15.42:0/890559229 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56231eb604d0 0x56231ef70fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.516+0000 7f2f66800640 1 -- 172.21.15.42:0/890559229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56231eb686b0 msgr2=0x56231ef71510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:28.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.516+0000 7f2f66800640 1 --2- 172.21.15.42:0/890559229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56231eb686b0 0x56231ef71510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.516+0000 7f2f66800640 1 -- 172.21.15.42:0/890559229 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56231ef72ff0 con 0x56231eb89390 2024-09-17T01:36:28.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.516+0000 7f2f66800640 1 --2- 172.21.15.42:0/890559229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb89390 0x56231ef8db20 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c001d30 tx=0x7f2f5c007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d4512296e78438 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:28.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.516+0000 7f2f4dc00640 1 -- 172.21.15.42:0/890559229 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c003b70 con 0x56231eb89390 2024-09-17T01:36:28.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.516+0000 7f2f4dc00640 1 -- 172.21.15.42:0/890559229 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f5c003e20 con 0x56231eb89390 2024-09-17T01:36:28.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.516+0000 7f2f4dc00640 1 -- 172.21.15.42:0/890559229 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c005350 con 0x56231eb89390 2024-09-17T01:36:28.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.517+0000 7f2f6f86e740 1 -- 172.21.15.42:0/890559229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb89390 msgr2=0x56231ef8db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:28.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.517+0000 7f2f6f86e740 1 --2- 172.21.15.42:0/890559229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb89390 0x56231ef8db20 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c001d30 tx=0x7f2f5c007c70 comp rx=0 tx=0).stop 2024-09-17T01:36:28.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.517+0000 7f2f6f86e740 1 -- 172.21.15.42:0/890559229 shutdown_connections 2024-09-17T01:36:28.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.517+0000 7f2f6f86e740 1 --2- 172.21.15.42:0/890559229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56231eb686b0 0x56231ef71510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.517+0000 7f2f6f86e740 1 --2- 172.21.15.42:0/890559229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb89390 0x56231ef8db20 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.517+0000 7f2f6f86e740 1 --2- 172.21.15.42:0/890559229 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56231eb604d0 0x56231ef70fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.517+0000 7f2f6f86e740 1 -- 172.21.15.42:0/890559229 >> 172.21.15.42:0/890559229 conn(0x56231eb7d4e0 msgr2=0x56231ef6e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:28.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.517+0000 7f2f6f86e740 1 -- 172.21.15.42:0/890559229 shutdown_connections 2024-09-17T01:36:28.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.517+0000 7f2f6f86e740 1 -- 172.21.15.42:0/890559229 wait complete. 2024-09-17T01:36:28.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.518+0000 7f2f6f86e740 1 -- start start 2024-09-17T01:36:28.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.518+0000 7f2f6f86e740 1 Processor -- start 2024-09-17T01:36:28.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.520+0000 7f2f6f86e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56231eb604d0 0x56231eff3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.520+0000 7f2f6f86e740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56231eb686b0 0x56231ef6d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.520+0000 7f2f6f86e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb89390 0x56231ef6d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.520+0000 7f2f6f86e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6014b750 con 0x56231eb89390 2024-09-17T01:36:28.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.520+0000 7f2f6f86e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56231ef87290 con 0x56231eb604d0 2024-09-17T01:36:28.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.520+0000 7f2f6f86e740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56231ef87e90 con 0x56231eb686b0 2024-09-17T01:36:28.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.520+0000 7f2f6f86e740 10 client.0 _ll_register_callbacks cb 0x7f2f54005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:36:28.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.520+0000 7f2f66800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb89390 0x56231ef6d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.520+0000 7f2f65e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56231eb604d0 0x56231eff3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.520+0000 7f2f66800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb89390 0x56231ef6d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54632/0 (socket says 172.21.15.42:54632) 2024-09-17T01:36:28.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.520+0000 7f2f66800640 1 -- 172.21.15.42:0/777083027 learned_addr learned my addr 172.21.15.42:0/777083027 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:28.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.520+0000 7f2f65400640 1 --2- 172.21.15.42:0/777083027 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56231eb686b0 0x56231ef6d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.520+0000 7f2f66800640 1 -- 172.21.15.42:0/777083027 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56231eb686b0 msgr2=0x56231ef6d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:28.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.520+0000 7f2f66800640 1 --2- 172.21.15.42:0/777083027 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56231eb686b0 0x56231ef6d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.520+0000 7f2f66800640 1 -- 172.21.15.42:0/777083027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56231eb604d0 msgr2=0x56231eff3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:28.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.520+0000 7f2f66800640 1 --2- 172.21.15.42:0/777083027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56231eb604d0 0x56231eff3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.520+0000 7f2f66800640 1 -- 172.21.15.42:0/777083027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56231ef31c80 con 0x56231eb89390 2024-09-17T01:36:28.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.521+0000 7f2f66800640 1 --2- 172.21.15.42:0/777083027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb89390 0x56231ef6d920 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c000f80 tx=0x7f2f5c005240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19fe91724803feea server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:28.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.521+0000 7f2f42a00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:36:28.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.521+0000 7f2f42a00640 1 -- 172.21.15.42:0/777083027 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c033060 con 0x56231eb89390 2024-09-17T01:36:28.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.521+0000 7f2f42a00640 1 -- 172.21.15.42:0/777083027 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f2f5c0055b0 con 0x56231eb89390 2024-09-17T01:36:28.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.521+0000 7f2f6f86e740 1 -- 172.21.15.42:0/777083027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56231ef30990 con 0x56231eb89390 2024-09-17T01:36:28.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.521+0000 7f2f42a00640 1 -- 172.21.15.42:0/777083027 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f2f5c016050 con 0x56231eb89390 2024-09-17T01:36:28.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.521+0000 7f2f6f86e740 10 client.6429 fetch_fsmap learned FSMap version 41 2024-09-17T01:36:28.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.521+0000 7f2f6f86e740 1 -- 172.21.15.42:0/777083027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x56231eff4190 con 0x56231eb89390 2024-09-17T01:36:28.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.522+0000 7f2f42a00640 1 -- 172.21.15.42:0/777083027 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56231ef30990 con 0x56231eb89390 2024-09-17T01:36:28.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.522+0000 7f2f42a00640 1 -- 172.21.15.42:0/777083027 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 41) ==== 3502+0+0 (secure 0 0 0) 0x7f2f5c02d030 con 0x56231eb89390 2024-09-17T01:36:28.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.522+0000 7f2f6f86e740 10 client.6429 fetch_fsmap finished waiting for FSMap version 41 2024-09-17T01:36:28.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.522+0000 7f2f6f86e740 10 client.6429 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T01:36:28.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.522+0000 7f2f6f86e740 20 client.6429 populate_metadata read hostname 'smithi042' 2024-09-17T01:36:28.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.522+0000 7f2f6f86e740 1 --2- 172.21.15.42:0/777083027 >> [v2:172.21.15.42:6833/2030017417,v1:172.21.15.42:6835/2030017417] conn(0x56231ef8e580 0x56231ef455c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.522+0000 7f2f6f86e740 4 client.6429 mds_command: new command op to 6195 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-17T01:36:28.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.522+0000 7f2f6f86e740 1 -- 172.21.15.42:0/777083027 --> [v2:172.21.15.42:6833/2030017417,v1:172.21.15.42:6835/2030017417] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56231ef2c580 con 0x56231ef8e580 2024-09-17T01:36:28.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.522+0000 7f2f65e00640 1 --2- 172.21.15.42:0/777083027 >> [v2:172.21.15.42:6833/2030017417,v1:172.21.15.42:6835/2030017417] conn(0x56231ef8e580 0x56231ef455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.523+0000 7f2f65e00640 1 --2- 172.21.15.42:0/777083027 >> [v2:172.21.15.42:6833/2030017417,v1:172.21.15.42:6835/2030017417] conn(0x56231ef8e580 0x56231ef455c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50de26828ded42c5 server_cookie=aa477f5e4edaa706 in_seq=0 out_seq=0 2024-09-17T01:36:28.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.523+0000 7f2f42a00640 10 client.6429 ms_handle_connect on v2:172.21.15.42:6833/2030017417 2024-09-17T01:36:28.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.541+0000 7f2f42a00640 1 -- 172.21.15.42:0/777083027 <== mds.0 v2:172.21.15.42:6833/2030017417 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56231ef2c580 con 0x56231ef8e580 2024-09-17T01:36:28.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.541+0000 7f2f42a00640 10 client.6429 handle_command_reply: tid=0 2024-09-17T01:36:28.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.541+0000 7f2f6f86e740 1 client.6429 shutdown 2024-09-17T01:36:28.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.541+0000 7f2f6f86e740 1 -- 172.21.15.42:0/777083027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb89390 msgr2=0x56231ef6d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:28.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.541+0000 7f2f6f86e740 1 --2- 172.21.15.42:0/777083027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb89390 0x56231ef6d920 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c000f80 tx=0x7f2f5c005240 comp rx=0 tx=0).stop 2024-09-17T01:36:28.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.542+0000 7f2f6f86e740 1 -- 172.21.15.42:0/777083027 shutdown_connections 2024-09-17T01:36:28.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.542+0000 7f2f6f86e740 1 --2- 172.21.15.42:0/777083027 >> [v2:172.21.15.42:6833/2030017417,v1:172.21.15.42:6835/2030017417] conn(0x56231ef8e580 0x56231ef455c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.542+0000 7f2f6f86e740 1 --2- 172.21.15.42:0/777083027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56231eb89390 0x56231ef6d920 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.542+0000 7f2f6f86e740 1 --2- 172.21.15.42:0/777083027 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56231eb686b0 0x56231ef6d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.542+0000 7f2f6f86e740 1 --2- 172.21.15.42:0/777083027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56231eb604d0 0x56231eff3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.542+0000 7f2f42a00640 0 client.6429 ms_handle_reset on v2:172.21.15.42:6833/2030017417 2024-09-17T01:36:28.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.542+0000 7f2f6f86e740 1 -- 172.21.15.42:0/777083027 >> 172.21.15.42:0/777083027 conn(0x56231eb7d4e0 msgr2=0x56231ef487f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:28.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.542+0000 7f2f6f86e740 1 -- 172.21.15.42:0/777083027 shutdown_connections 2024-09-17T01:36:28.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.542+0000 7f2f6f86e740 1 -- 172.21.15.42:0/777083027 wait complete. 2024-09-17T01:36:28.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.542+0000 7f2f6f86e740 20 client.6429 trim_cache size 0 max 16384 2024-09-17T01:36:28.541 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:36:28.541 INFO:teuthology.orchestra.run.smithi042.stdout: "message": "", 2024-09-17T01:36:28.541 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0 2024-09-17T01:36:28.541 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:36:28.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.543+0000 7f2f67200640 1 -- 172.21.15.42:0/2746160868 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f44078b90 msgr2=0x7f2f4407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:28.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.543+0000 7f2f67200640 1 --2- 172.21.15.42:0/2746160868 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f44078b90 0x7f2f4407b0a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2f50001220 tx=0x7f2f50009040 comp rx=0 tx=0).stop 2024-09-17T01:36:28.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.543+0000 7f2f67200640 1 -- 172.21.15.42:0/2746160868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f600ae820 msgr2=0x7f2f60149eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:28.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.543+0000 7f2f67200640 1 --2- 172.21.15.42:0/2746160868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f600ae820 0x7f2f60149eb0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f2f5402aba0 tx=0x7f2f54033c20 comp rx=0 tx=0).stop 2024-09-17T01:36:28.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.543+0000 7f2f67200640 1 -- 172.21.15.42:0/2746160868 shutdown_connections 2024-09-17T01:36:28.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.543+0000 7f2f67200640 1 --2- 172.21.15.42:0/2746160868 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f44078b90 0x7f2f4407b0a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.543+0000 7f2f67200640 1 --2- 172.21.15.42:0/2746160868 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f600cd4a0 0x7f2f60155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.543+0000 7f2f67200640 1 --2- 172.21.15.42:0/2746160868 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f6014a3f0 0x7f2f60155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.543+0000 7f2f67200640 1 --2- 172.21.15.42:0/2746160868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f600ae820 0x7f2f60149eb0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.543+0000 7f2f67200640 1 -- 172.21.15.42:0/2746160868 >> 172.21.15.42:0/2746160868 conn(0x7f2f6006d440 msgr2=0x7f2f6006f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:28.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.543+0000 7f2f67200640 1 -- 172.21.15.42:0/2746160868 shutdown_connections 2024-09-17T01:36:28.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.543+0000 7f2f67200640 1 -- 172.21.15.42:0/2746160868 wait complete. 2024-09-17T01:36:28.562 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T01:36:28.562 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:36:28.563 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T01:36:28.563 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:36:28.563 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T01:36:28.563 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:36:28.564 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T01:36:28.564 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:36:28.588 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T01:36:28.588 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-17T01:36:28.589 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T01:36:28.589 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-17T01:36:28.591 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T01:36:28.591 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-17T01:36:28.595 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T01:36:28.595 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-17T01:36:28.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.834+0000 7f7e97200640 1 -- 172.21.15.42:0/3805949768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e980b4be0 msgr2=0x7f7e9815d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:28.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.834+0000 7f7e97200640 1 --2- 172.21.15.42:0/3805949768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e980b4be0 0x7f7e9815d6b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7e98071cb0 tx=0x7f7e8802a440 comp rx=0 tx=0).stop 2024-09-17T01:36:28.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.834+0000 7f7e97200640 1 -- 172.21.15.42:0/3805949768 shutdown_connections 2024-09-17T01:36:28.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.834+0000 7f7e97200640 1 --2- 172.21.15.42:0/3805949768 >> v2:172.21.15.42:3300/0 conn(0x7f7e9806d430 0x7f7e98152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.834+0000 7f7e97200640 1 --2- 172.21.15.42:0/3805949768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e980b4be0 0x7f7e9815d6b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.834+0000 7f7e97200640 1 -- 172.21.15.42:0/3805949768 >> 172.21.15.42:0/3805949768 conn(0x7f7e980b25f0 msgr2=0x7f7e980d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:28.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.834+0000 7f7e97200640 1 -- 172.21.15.42:0/3805949768 shutdown_connections 2024-09-17T01:36:28.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.834+0000 7f7e97200640 1 -- 172.21.15.42:0/3805949768 wait complete. 2024-09-17T01:36:28.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.834+0000 7ff2a3000640 1 -- 172.21.15.42:0/2177616350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff29c0af980 msgr2=0x7ff29c0ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:28.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.834+0000 7ff2a3000640 1 --2- 172.21.15.42:0/2177616350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff29c0af980 0x7ff29c0ceb40 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0704b0 tx=0x7ff28802a5f0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.834+0000 7ff2a3000640 1 -- 172.21.15.42:0/2177616350 shutdown_connections 2024-09-17T01:36:28.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.835+0000 7ff2a3000640 1 --2- 172.21.15.42:0/2177616350 >> v2:172.21.15.43:3300/0 conn(0x7ff29c06d430 0x7ff29c06d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.835+0000 7ff2a3000640 1 --2- 172.21.15.42:0/2177616350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff29c0af980 0x7ff29c0ceb40 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.835+0000 7ff2a3000640 1 -- 172.21.15.42:0/2177616350 >> 172.21.15.42:0/2177616350 conn(0x7ff29c0b2930 msgr2=0x7ff29c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:28.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.835+0000 7ff2a3000640 1 -- 172.21.15.42:0/2177616350 shutdown_connections 2024-09-17T01:36:28.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.835+0000 7ff2a3000640 1 -- 172.21.15.42:0/2177616350 wait complete. 2024-09-17T01:36:28.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.837+0000 7f7e97200640 1 Processor -- start 2024-09-17T01:36:28.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.837+0000 7f7e97200640 1 -- start start 2024-09-17T01:36:28.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.837+0000 7ff2a3000640 1 Processor -- start 2024-09-17T01:36:28.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.837+0000 7ff2a3000640 1 -- start start 2024-09-17T01:36:28.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.839+0000 7f7e97200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e980b4be0 0x7f7e980c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.839+0000 7f7e97200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e980cf7c0 0x7f7e980744b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.839+0000 7f7e97200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e98143550 0x7f7e981f6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.839+0000 7f7e97200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7e98153850 con 0x7f7e980cf7c0 2024-09-17T01:36:28.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.839+0000 7f7e97200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7e981536d0 con 0x7f7e980b4be0 2024-09-17T01:36:28.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.839+0000 7f7e97200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7e981539d0 con 0x7f7e98143550 2024-09-17T01:36:28.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.839+0000 7ff2a3000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff29c06d430 0x7ff29c14e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.839+0000 7ff2a3000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff29c0af980 0x7ff29c13e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.839+0000 7ff2a3000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff29c0b3880 0x7ff29c15e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.839+0000 7ff2a3000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff29c072ad0 con 0x7ff29c06d430 2024-09-17T01:36:28.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.839+0000 7ff2a3000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff29c072950 con 0x7ff29c0b3880 2024-09-17T01:36:28.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.839+0000 7ff2a3000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff29c072c50 con 0x7ff29c0af980 2024-09-17T01:36:28.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.840+0000 7f7e95e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e980b4be0 0x7f7e980c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.840+0000 7f7e95400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e980cf7c0 0x7f7e980744b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.840+0000 7f7e96800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e98143550 0x7f7e981f6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.840+0000 7f7e96800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e98143550 0x7f7e981f6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:57066/0 (socket says 172.21.15.42:57066) 2024-09-17T01:36:28.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.840+0000 7f7e95400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e980cf7c0 0x7f7e980744b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54664/0 (socket says 172.21.15.42:54664) 2024-09-17T01:36:28.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.840+0000 7f7e96800640 1 -- 172.21.15.42:0/783205477 learned_addr learned my addr 172.21.15.42:0/783205477 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:28.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.840+0000 7ff29b400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff29c0af980 0x7ff29c13e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.840+0000 7ff29b400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff29c0af980 0x7ff29c13e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:57082/0 (socket says 172.21.15.42:57082) 2024-09-17T01:36:28.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.840+0000 7ff29b400640 1 -- 172.21.15.42:0/531956623 learned_addr learned my addr 172.21.15.42:0/531956623 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:28.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.840+0000 7ff29be00640 1 --2- 172.21.15.42:0/531956623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff29c06d430 0x7ff29c14e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.840+0000 7ff2a1000640 1 --2- 172.21.15.42:0/531956623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff29c0b3880 0x7ff29c15e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.840+0000 7f7e95400640 1 -- 172.21.15.42:0/783205477 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e98143550 msgr2=0x7f7e981f6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:28.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.840+0000 7f7e95400640 1 --2- 172.21.15.42:0/783205477 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e98143550 0x7f7e981f6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.840+0000 7f7e95400640 1 -- 172.21.15.42:0/783205477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e980b4be0 msgr2=0x7f7e980c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:28.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.840+0000 7f7e95400640 1 --2- 172.21.15.42:0/783205477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e980b4be0 0x7f7e980c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.840+0000 7f7e95400640 1 -- 172.21.15.42:0/783205477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e980749f0 con 0x7f7e980cf7c0 2024-09-17T01:36:28.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.841+0000 7ff29b400640 1 -- 172.21.15.42:0/531956623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff29c0b3880 msgr2=0x7ff29c15e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:28.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.841+0000 7ff29b400640 1 --2- 172.21.15.42:0/531956623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff29c0b3880 0x7ff29c15e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.841+0000 7ff29b400640 1 -- 172.21.15.42:0/531956623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff29c06d430 msgr2=0x7ff29c14e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:28.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.841+0000 7ff29b400640 1 --2- 172.21.15.42:0/531956623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff29c06d430 0x7ff29c14e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.841+0000 7ff29b400640 1 -- 172.21.15.42:0/531956623 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff29c14e230 con 0x7ff29c0af980 2024-09-17T01:36:28.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.841+0000 7f7e95400640 1 --2- 172.21.15.42:0/783205477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e980cf7c0 0x7f7e980744b0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400c760 tx=0x7f7e8400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:28.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.841+0000 7ff29b400640 1 --2- 172.21.15.42:0/531956623 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff29c0af980 0x7ff29c13e5d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff288000c00 tx=0x7ff288003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:28.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.841+0000 7f7e8e000640 1 -- 172.21.15.42:0/783205477 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e84017070 con 0x7f7e980cf7c0 2024-09-17T01:36:28.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.841+0000 7f7e8e000640 1 -- 172.21.15.42:0/783205477 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e8400ce10 con 0x7f7e980cf7c0 2024-09-17T01:36:28.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.841+0000 7f7e8e000640 1 -- 172.21.15.42:0/783205477 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8400a8a0 con 0x7f7e980cf7c0 2024-09-17T01:36:28.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.842+0000 7f7e97200640 1 -- 172.21.15.42:0/783205477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e98073410 con 0x7f7e980cf7c0 2024-09-17T01:36:28.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.842+0000 7ff293e00640 1 -- 172.21.15.42:0/531956623 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28803e030 con 0x7ff29c0af980 2024-09-17T01:36:28.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.842+0000 7ff293e00640 1 -- 172.21.15.42:0/531956623 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff288003d10 con 0x7ff29c0af980 2024-09-17T01:36:28.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.842+0000 7ff2a3000640 1 -- 172.21.15.42:0/531956623 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff29c13eb10 con 0x7ff29c0af980 2024-09-17T01:36:28.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.842+0000 7ff293e00640 1 -- 172.21.15.42:0/531956623 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff288035040 con 0x7ff29c0af980 2024-09-17T01:36:28.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.842+0000 7ff2a3000640 1 -- 172.21.15.42:0/531956623 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff29c1f72e0 con 0x7ff29c0af980 2024-09-17T01:36:28.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.842+0000 7f7e97200640 1 -- 172.21.15.42:0/783205477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e980739d0 con 0x7f7e980cf7c0 2024-09-17T01:36:28.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.843+0000 7fe111200640 1 -- 172.21.15.42:0/3365312999 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe10c0b63a0 msgr2=0x7fe10c068d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:28.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.843+0000 7fe111200640 1 --2- 172.21.15.42:0/3365312999 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe10c0b63a0 0x7fe10c068d40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009830 tx=0x7fe0fc02a510 comp rx=0 tx=0).stop 2024-09-17T01:36:28.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.843+0000 7fe111200640 1 -- 172.21.15.42:0/3365312999 shutdown_connections 2024-09-17T01:36:28.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.843+0000 7fe111200640 1 --2- 172.21.15.42:0/3365312999 >> v2:172.21.15.42:3300/0 conn(0x7fe10c15f730 0x7fe10c0b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.843+0000 7fe111200640 1 --2- 172.21.15.42:0/3365312999 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe10c0b63a0 0x7fe10c068d40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.843+0000 7fe111200640 1 -- 172.21.15.42:0/3365312999 >> 172.21.15.42:0/3365312999 conn(0x7fe10c0d1880 msgr2=0x7fe10c0d1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:28.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.844+0000 7fe111200640 1 -- 172.21.15.42:0/3365312999 shutdown_connections 2024-09-17T01:36:28.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.844+0000 7ff2a3000640 1 -- 172.21.15.42:0/531956623 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff29c06d840 con 0x7ff29c0af980 2024-09-17T01:36:28.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.844+0000 7f7e97200640 1 -- 172.21.15.42:0/783205477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e98152ed0 con 0x7f7e980cf7c0 2024-09-17T01:36:28.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.844+0000 7fe111200640 1 -- 172.21.15.42:0/3365312999 wait complete. 2024-09-17T01:36:28.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.845+0000 7ff293e00640 1 -- 172.21.15.42:0/531956623 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff288041030 con 0x7ff29c0af980 2024-09-17T01:36:28.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.846+0000 7f7e8e000640 1 -- 172.21.15.42:0/783205477 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7e8401a070 con 0x7f7e980cf7c0 2024-09-17T01:36:28.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.846+0000 7ff293e00640 1 --2- 172.21.15.42:0/531956623 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff27c078b90 0x7ff27c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.847+0000 7ff293e00640 1 -- 172.21.15.42:0/531956623 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7ff2880bb480 con 0x7ff29c0af980 2024-09-17T01:36:28.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.847+0000 7ff29be00640 1 --2- 172.21.15.42:0/531956623 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff27c078b90 0x7ff27c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.846+0000 7fe111200640 1 Processor -- start 2024-09-17T01:36:28.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.847+0000 7fe111200640 1 -- start start 2024-09-17T01:36:28.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.848+0000 7fe111200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe10c069280 0x7fe10c1e80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.848+0000 7fe111200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe10c0b63a0 0x7fe10c1459f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.848+0000 7fe111200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe10c15f730 0x7fe10c159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.848+0000 7fe111200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe10c0b4fc0 con 0x7fe10c15f730 2024-09-17T01:36:28.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.848+0000 7fe111200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe10c0b4e40 con 0x7fe10c069280 2024-09-17T01:36:28.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.848+0000 7fe111200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe10c0b5140 con 0x7fe10c0b63a0 2024-09-17T01:36:28.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.848+0000 7f7e8e000640 1 --2- 172.21.15.42:0/783205477 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7e78078be0 0x7f7e7807b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.848+0000 7f7e8e000640 1 -- 172.21.15.42:0/783205477 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7f7e8409a6b0 con 0x7f7e980cf7c0 2024-09-17T01:36:28.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.849+0000 7fe10be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe10c15f730 0x7fe10c159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.849+0000 7fe10be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe10c15f730 0x7fe10c159570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54706/0 (socket says 172.21.15.42:54706) 2024-09-17T01:36:28.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.849+0000 7fe10be00640 1 -- 172.21.15.42:0/4024614663 learned_addr learned my addr 172.21.15.42:0/4024614663 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:28.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.849+0000 7fe10b400640 1 --2- 172.21.15.42:0/4024614663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe10c069280 0x7fe10c1e80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.849+0000 7fe10aa00640 1 --2- 172.21.15.42:0/4024614663 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe10c0b63a0 0x7fe10c1459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.849+0000 7f7e95e00640 1 --2- 172.21.15.42:0/783205477 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7e78078be0 0x7f7e7807b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.849+0000 7ff29be00640 1 --2- 172.21.15.42:0/531956623 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff27c078b90 0x7ff27c07b0a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff28c001720 tx=0x7ff28c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:28.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.849+0000 7fe10be00640 1 -- 172.21.15.42:0/4024614663 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe10c0b63a0 msgr2=0x7fe10c1459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:28.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.849+0000 7fe10be00640 1 --2- 172.21.15.42:0/4024614663 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe10c0b63a0 0x7fe10c1459f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.849+0000 7fe10be00640 1 -- 172.21.15.42:0/4024614663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe10c069280 msgr2=0x7fe10c1e80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:28.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.849+0000 7fe10be00640 1 --2- 172.21.15.42:0/4024614663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe10c069280 0x7fe10c1e80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.849+0000 7fe10be00640 1 -- 172.21.15.42:0/4024614663 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10c1464e0 con 0x7fe10c15f730 2024-09-17T01:36:28.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.850+0000 7fe10be00640 1 --2- 172.21.15.42:0/4024614663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe10c15f730 0x7fe10c159570 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fe10400ebf0 tx=0x7fe10400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:28.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.850+0000 7f7e95e00640 1 --2- 172.21.15.42:0/783205477 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7e78078be0 0x7f7e7807b0f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7e88034000 tx=0x7f7e88004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:28.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.850+0000 7fd2da000640 1 -- 172.21.15.42:0/2598679621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2d415fbe0 msgr2=0x7fd2d415c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:28.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.850+0000 7fd2da000640 1 --2- 172.21.15.42:0/2598679621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2d415fbe0 0x7fd2d415c3c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd2d40b70b0 tx=0x7fd2c802a4b0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.850+0000 7fd2da000640 1 -- 172.21.15.42:0/2598679621 shutdown_connections 2024-09-17T01:36:28.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.850+0000 7fd2da000640 1 --2- 172.21.15.42:0/2598679621 >> v2:172.21.15.42:3300/0 conn(0x7fd2d4162930 0x7fd2d40d2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.850+0000 7fd2da000640 1 --2- 172.21.15.42:0/2598679621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2d415fbe0 0x7fd2d415c3c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.850+0000 7fd2da000640 1 -- 172.21.15.42:0/2598679621 >> 172.21.15.42:0/2598679621 conn(0x7fd2d4073f20 msgr2=0x7fd2d406cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:28.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.850+0000 7fd2da000640 1 -- 172.21.15.42:0/2598679621 shutdown_connections 2024-09-17T01:36:28.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.850+0000 7fd2da000640 1 -- 172.21.15.42:0/2598679621 wait complete. 2024-09-17T01:36:28.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.851+0000 7fe103400640 1 -- 172.21.15.42:0/4024614663 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe104010630 con 0x7fe10c15f730 2024-09-17T01:36:28.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.851+0000 7fe111200640 1 -- 172.21.15.42:0/4024614663 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe10c1e7300 con 0x7fe10c15f730 2024-09-17T01:36:28.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.851+0000 7fe103400640 1 -- 172.21.15.42:0/4024614663 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1040107d0 con 0x7fe10c15f730 2024-09-17T01:36:28.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.851+0000 7fe103400640 1 -- 172.21.15.42:0/4024614663 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe104010c20 con 0x7fe10c15f730 2024-09-17T01:36:28.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.852+0000 7fe111200640 1 -- 172.21.15.42:0/4024614663 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe10c1e78c0 con 0x7fe10c15f730 2024-09-17T01:36:28.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.852+0000 7f7e8e000640 1 -- 172.21.15.42:0/783205477 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7e84021020 con 0x7f7e980cf7c0 2024-09-17T01:36:28.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.852+0000 7ff293e00640 1 -- 172.21.15.42:0/531956623 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff29c14e230 con 0x7ff29c0af980 2024-09-17T01:36:28.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.853+0000 7fe111200640 1 -- 172.21.15.42:0/4024614663 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe10c15c5e0 con 0x7fe10c15f730 2024-09-17T01:36:28.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.854+0000 7fd2da000640 1 Processor -- start 2024-09-17T01:36:28.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.854+0000 7fd2da000640 1 -- start start 2024-09-17T01:36:28.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.855+0000 7fe103400640 1 -- 172.21.15.42:0/4024614663 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe104021440 con 0x7fe10c15f730 2024-09-17T01:36:28.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.855+0000 7fe103400640 1 --2- 172.21.15.42:0/4024614663 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe0ec078b90 0x7fe0ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.856+0000 7fe103400640 1 -- 172.21.15.42:0/4024614663 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7fe10409bc80 con 0x7fe10c15f730 2024-09-17T01:36:28.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.856+0000 7fe10b400640 1 --2- 172.21.15.42:0/4024614663 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe0ec078b90 0x7fe0ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.857+0000 7fd2da000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2d415fbe0 0x7fd2d414f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.857+0000 7fd2da000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd2d4162520 0x7fd2d40b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.857+0000 7fd2da000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd2d4162930 0x7fd2d40b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.857+0000 7fd2da000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d40d0d00 con 0x7fd2d4162930 2024-09-17T01:36:28.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.857+0000 7fd2da000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d40d38b0 con 0x7fd2d415fbe0 2024-09-17T01:36:28.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.857+0000 7fd2da000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd2d40d0e80 con 0x7fd2d4162520 2024-09-17T01:36:28.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.857+0000 7fe10b400640 1 --2- 172.21.15.42:0/4024614663 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe0ec078b90 0x7fe0ec07b0a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc034000 tx=0x7fe0fc004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:28.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.857+0000 7fd2d8c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2d415fbe0 0x7fd2d414f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.857+0000 7fd2d8c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2d415fbe0 0x7fd2d414f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:33328/0 (socket says 172.21.15.42:33328) 2024-09-17T01:36:28.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.857+0000 7fd2d8c00640 1 -- 172.21.15.42:0/2138278015 learned_addr learned my addr 172.21.15.42:0/2138278015 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:28.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.857+0000 7fd2d9600640 1 --2- 172.21.15.42:0/2138278015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd2d4162930 0x7fd2d40b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.858+0000 7fd2d8c00640 1 -- 172.21.15.42:0/2138278015 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd2d4162520 msgr2=0x7fd2d40b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:28.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.858+0000 7fd2d8c00640 1 --2- 172.21.15.42:0/2138278015 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd2d4162520 0x7fd2d40b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.858+0000 7fd2d8c00640 1 -- 172.21.15.42:0/2138278015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd2d4162930 msgr2=0x7fd2d40b5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:28.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.858+0000 7fd2d8c00640 1 --2- 172.21.15.42:0/2138278015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd2d4162930 0x7fd2d40b5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:28.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.858+0000 7fd2d8c00640 1 -- 172.21.15.42:0/2138278015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d414f650 con 0x7fd2d415fbe0 2024-09-17T01:36:28.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.858+0000 7fd2d9600640 1 --2- 172.21.15.42:0/2138278015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd2d4162930 0x7fd2d40b5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:36:28.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.859+0000 7fd2d8c00640 1 --2- 172.21.15.42:0/2138278015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2d415fbe0 0x7fd2d414f110 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009780 tx=0x7fd2c8033c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:28.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.859+0000 7fd2d0c00640 1 -- 172.21.15.42:0/2138278015 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8031d60 con 0x7fd2d415fbe0 2024-09-17T01:36:28.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.859+0000 7fd2d0c00640 1 -- 172.21.15.42:0/2138278015 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2c8033e10 con 0x7fd2d415fbe0 2024-09-17T01:36:28.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.859+0000 7fd2d0c00640 1 -- 172.21.15.42:0/2138278015 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8005260 con 0x7fd2d415fbe0 2024-09-17T01:36:28.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.859+0000 7fd2da000640 1 -- 172.21.15.42:0/2138278015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2d41fd510 con 0x7fd2d415fbe0 2024-09-17T01:36:28.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.859+0000 7fd2da000640 1 -- 172.21.15.42:0/2138278015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2d41fdad0 con 0x7fd2d415fbe0 2024-09-17T01:36:28.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.861+0000 7fd2da000640 1 -- 172.21.15.42:0/2138278015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2d415c3c0 con 0x7fd2d415fbe0 2024-09-17T01:36:28.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.861+0000 7fe103400640 1 -- 172.21.15.42:0/4024614663 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe1040a2080 con 0x7fe10c15f730 2024-09-17T01:36:28.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.862+0000 7fd2d0c00640 1 -- 172.21.15.42:0/2138278015 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd2c8005400 con 0x7fd2d415fbe0 2024-09-17T01:36:28.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.864+0000 7fd2d0c00640 1 --2- 172.21.15.42:0/2138278015 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd2b4078bc0 0x7fd2b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:28.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.864+0000 7fd2d0c00640 1 -- 172.21.15.42:0/2138278015 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5709+0+0 (secure 0 0 0) 0x7fd2c80bbf00 con 0x7fd2d415fbe0 2024-09-17T01:36:28.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.864+0000 7fd2d3e00640 1 --2- 172.21.15.42:0/2138278015 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd2b4078bc0 0x7fd2b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:28.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.865+0000 7fd2d3e00640 1 --2- 172.21.15.42:0/2138278015 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd2b4078bc0 0x7fd2b407b0d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0007fd0 tx=0x7fd2c0007900 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:28.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:28.867+0000 7fd2d0c00640 1 -- 172.21.15.42:0/2138278015 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd2c803f030 con 0x7fd2d415fbe0 2024-09-17T01:36:29.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.123+0000 7ff2a3000640 1 -- 172.21.15.42:0/531956623 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7ff29c141d00 con 0x7ff29c0af980 2024-09-17T01:36:29.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.128+0000 7f7e97200640 1 -- 172.21.15.42:0/783205477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7f7e980731a0 con 0x7f7e980cf7c0 2024-09-17T01:36:29.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.132+0000 7fe111200640 1 -- 172.21.15.42:0/4024614663 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7fe10c0b55f0 con 0x7fe10c15f730 2024-09-17T01:36:29.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.142+0000 7fd2da000640 1 -- 172.21.15.42:0/2138278015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7fd2d415bc20 con 0x7fd2d415fbe0 2024-09-17T01:36:29.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.170+0000 7ff293e00640 1 -- 172.21.15.42:0/531956623 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 6031 v42) ==== 95+0+0 (secure 0 0 0) 0x7ff288088e20 con 0x7ff29c0af980 2024-09-17T01:36:29.168 INFO:teuthology.orchestra.run.smithi042.stderr:failed mds gid 6031 2024-09-17T01:36:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.172+0000 7ff2a3000640 1 -- 172.21.15.42:0/531956623 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff27c078b90 msgr2=0x7ff27c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.172+0000 7ff2a3000640 1 --2- 172.21.15.42:0/531956623 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff27c078b90 0x7ff27c07b0a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff28c001720 tx=0x7ff28c009040 comp rx=0 tx=0).stop 2024-09-17T01:36:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.172+0000 7ff2a3000640 1 -- 172.21.15.42:0/531956623 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff29c0af980 msgr2=0x7ff29c13e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.172+0000 7ff2a3000640 1 --2- 172.21.15.42:0/531956623 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff29c0af980 0x7ff29c13e5d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff288000c00 tx=0x7ff288003820 comp rx=0 tx=0).stop 2024-09-17T01:36:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.173+0000 7ff2a3000640 1 -- 172.21.15.42:0/531956623 shutdown_connections 2024-09-17T01:36:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.173+0000 7ff2a3000640 1 --2- 172.21.15.42:0/531956623 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff27c078b90 0x7ff27c07b0a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.173+0000 7ff2a3000640 1 --2- 172.21.15.42:0/531956623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff29c0b3880 0x7ff29c15e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.173+0000 7ff2a3000640 1 --2- 172.21.15.42:0/531956623 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff29c0af980 0x7ff29c13e5d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.173+0000 7ff2a3000640 1 --2- 172.21.15.42:0/531956623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff29c06d430 0x7ff29c14e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.173+0000 7ff2a3000640 1 -- 172.21.15.42:0/531956623 >> 172.21.15.42:0/531956623 conn(0x7ff29c0b2930 msgr2=0x7ff29c15c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.173+0000 7ff2a3000640 1 -- 172.21.15.42:0/531956623 shutdown_connections 2024-09-17T01:36:29.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.173+0000 7ff2a3000640 1 -- 172.21.15.42:0/531956623 wait complete. 2024-09-17T01:36:29.177 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-17T01:36:29.179+0000 7f995ec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:36:29.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.183+0000 7f7e8e000640 1 -- 172.21.15.42:0/783205477 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6034 v43) ==== 95+0+0 (secure 0 0 0) 0x7f7e9815dbf0 con 0x7f7e980cf7c0 2024-09-17T01:36:29.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.183+0000 7fe103400640 1 -- 172.21.15.42:0/4024614663 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 5627 v43) ==== 95+0+0 (secure 0 0 0) 0x7fe1040640c0 con 0x7fe10c15f730 2024-09-17T01:36:29.181 INFO:teuthology.orchestra.run.smithi042.stderr:failed mds gid 6034 2024-09-17T01:36:29.181 INFO:teuthology.orchestra.run.smithi042.stderr:failed mds gid 5627 2024-09-17T01:36:29.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.186+0000 7fe111200640 1 -- 172.21.15.42:0/4024614663 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe0ec078b90 msgr2=0x7fe0ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:29.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.186+0000 7fe111200640 1 --2- 172.21.15.42:0/4024614663 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe0ec078b90 0x7fe0ec07b0a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc034000 tx=0x7fe0fc004730 comp rx=0 tx=0).stop 2024-09-17T01:36:29.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.186+0000 7fe111200640 1 -- 172.21.15.42:0/4024614663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe10c15f730 msgr2=0x7fe10c159570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:29.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.186+0000 7fe111200640 1 --2- 172.21.15.42:0/4024614663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe10c15f730 0x7fe10c159570 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fe10400ebf0 tx=0x7fe10400c6a0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.186+0000 7fe111200640 1 -- 172.21.15.42:0/4024614663 shutdown_connections 2024-09-17T01:36:29.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.186+0000 7fe111200640 1 --2- 172.21.15.42:0/4024614663 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe0ec078b90 0x7fe0ec07b0a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.186+0000 7fe111200640 1 --2- 172.21.15.42:0/4024614663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe10c15f730 0x7fe10c159570 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.186+0000 7fe111200640 1 --2- 172.21.15.42:0/4024614663 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe10c0b63a0 0x7fe10c1459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.186+0000 7fe111200640 1 --2- 172.21.15.42:0/4024614663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe10c069280 0x7fe10c1e80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.186+0000 7fe111200640 1 -- 172.21.15.42:0/4024614663 >> 172.21.15.42:0/4024614663 conn(0x7fe10c0d1880 msgr2=0x7fe10c15e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:29.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.186+0000 7fe111200640 1 -- 172.21.15.42:0/4024614663 shutdown_connections 2024-09-17T01:36:29.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.186+0000 7fe111200640 1 -- 172.21.15.42:0/4024614663 wait complete. 2024-09-17T01:36:29.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.187+0000 7f7e97200640 1 -- 172.21.15.42:0/783205477 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7e78078be0 msgr2=0x7f7e7807b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:29.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.187+0000 7f7e97200640 1 --2- 172.21.15.42:0/783205477 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7e78078be0 0x7f7e7807b0f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7e88034000 tx=0x7f7e88004730 comp rx=0 tx=0).stop 2024-09-17T01:36:29.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.187+0000 7f7e97200640 1 -- 172.21.15.42:0/783205477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e980cf7c0 msgr2=0x7f7e980744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:29.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.187+0000 7f7e97200640 1 --2- 172.21.15.42:0/783205477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e980cf7c0 0x7f7e980744b0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400c760 tx=0x7f7e8400cc20 comp rx=0 tx=0).stop 2024-09-17T01:36:29.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.187+0000 7f7e97200640 1 -- 172.21.15.42:0/783205477 shutdown_connections 2024-09-17T01:36:29.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.187+0000 7f7e97200640 1 --2- 172.21.15.42:0/783205477 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7e78078be0 0x7f7e7807b0f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.187+0000 7f7e97200640 1 --2- 172.21.15.42:0/783205477 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e98143550 0x7f7e981f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.187+0000 7f7e97200640 1 --2- 172.21.15.42:0/783205477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e980cf7c0 0x7f7e980744b0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.187+0000 7f7e97200640 1 --2- 172.21.15.42:0/783205477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e980b4be0 0x7f7e980c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.187+0000 7f7e97200640 1 -- 172.21.15.42:0/783205477 >> 172.21.15.42:0/783205477 conn(0x7f7e980b25f0 msgr2=0x7f7e980cdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:29.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.187+0000 7f7e97200640 1 -- 172.21.15.42:0/783205477 shutdown_connections 2024-09-17T01:36:29.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.188+0000 7f7e97200640 1 -- 172.21.15.42:0/783205477 wait complete. 2024-09-17T01:36:29.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.188+0000 7fd2d0c00640 1 -- 172.21.15.42:0/2138278015 <== mon.1 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6195 v43) ==== 95+0+0 (secure 0 0 0) 0x7fd2c8083d60 con 0x7fd2d415fbe0 2024-09-17T01:36:29.187 INFO:teuthology.orchestra.run.smithi042.stderr:failed mds gid 6195 2024-09-17T01:36:29.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.191+0000 7fd2da000640 1 -- 172.21.15.42:0/2138278015 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd2b4078bc0 msgr2=0x7fd2b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:29.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.191+0000 7fd2da000640 1 --2- 172.21.15.42:0/2138278015 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd2b4078bc0 0x7fd2b407b0d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0007fd0 tx=0x7fd2c0007900 comp rx=0 tx=0).stop 2024-09-17T01:36:29.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.191+0000 7fd2da000640 1 -- 172.21.15.42:0/2138278015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2d415fbe0 msgr2=0x7fd2d414f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:29.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.192+0000 7fd2da000640 1 --2- 172.21.15.42:0/2138278015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2d415fbe0 0x7fd2d414f110 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009780 tx=0x7fd2c8033c20 comp rx=0 tx=0).stop 2024-09-17T01:36:29.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.192+0000 7fd2da000640 1 -- 172.21.15.42:0/2138278015 shutdown_connections 2024-09-17T01:36:29.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.192+0000 7fd2da000640 1 --2- 172.21.15.42:0/2138278015 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd2b4078bc0 0x7fd2b407b0d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.192+0000 7fd2da000640 1 --2- 172.21.15.42:0/2138278015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd2d4162930 0x7fd2d40b5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.192+0000 7fd2da000640 1 --2- 172.21.15.42:0/2138278015 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd2d4162520 0x7fd2d40b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.192+0000 7fd2da000640 1 --2- 172.21.15.42:0/2138278015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2d415fbe0 0x7fd2d414f110 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.192+0000 7fd2da000640 1 -- 172.21.15.42:0/2138278015 >> 172.21.15.42:0/2138278015 conn(0x7fd2d4073f20 msgr2=0x7fd2d4160280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:29.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.192+0000 7fd2da000640 1 -- 172.21.15.42:0/2138278015 shutdown_connections 2024-09-17T01:36:29.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.192+0000 7fd2da000640 1 -- 172.21.15.42:0/2138278015 wait complete. 2024-09-17T01:36:29.199 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T01:36:29.199 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T01:36:29.203 INFO:tasks.ceph.mds.d:Started 2024-09-17T01:36:29.204 DEBUG:teuthology.parallel:result is None 2024-09-17T01:36:29.211 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T01:36:29.211 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T01:36:29.221 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T01:36:29.221 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T01:36:29.226 INFO:tasks.ceph.mds.b:Started 2024-09-17T01:36:29.226 DEBUG:teuthology.parallel:result is None 2024-09-17T01:36:29.230 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T01:36:29.230 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T01:36:29.232 INFO:tasks.ceph.mds.a:Started 2024-09-17T01:36:29.232 DEBUG:teuthology.parallel:result is None 2024-09-17T01:36:29.235 INFO:tasks.ceph.mds.c:Started 2024-09-17T01:36:29.235 DEBUG:teuthology.parallel:result is None 2024-09-17T01:36:29.235 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:36:29.405 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-09-17T01:36:29.426 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-09-17T01:36:29.429 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:36:29.430 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:36:29.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.481+0000 7efe67e00640 1 -- 172.21.15.42:0/2464660518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe680d0e10 msgr2=0x7efe680d1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:29.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.481+0000 7efe67e00640 1 --2- 172.21.15.42:0/2464660518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe680d0e10 0x7efe680d1220 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efe54009820 tx=0x7efe5402a510 comp rx=0 tx=0).stop 2024-09-17T01:36:29.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.482+0000 7efe67e00640 1 -- 172.21.15.42:0/2464660518 shutdown_connections 2024-09-17T01:36:29.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.482+0000 7efe67e00640 1 --2- 172.21.15.42:0/2464660518 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe68162500 0x7efe68162910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.482+0000 7efe67e00640 1 --2- 172.21.15.42:0/2464660518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe680d0e10 0x7efe680d1220 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.482+0000 7efe67e00640 1 -- 172.21.15.42:0/2464660518 >> 172.21.15.42:0/2464660518 conn(0x7efe680b6140 msgr2=0x7efe680b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:29.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.482+0000 7efe67e00640 1 -- 172.21.15.42:0/2464660518 shutdown_connections 2024-09-17T01:36:29.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.482+0000 7efe67e00640 1 -- 172.21.15.42:0/2464660518 wait complete. 2024-09-17T01:36:29.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.484+0000 7efe67e00640 1 Processor -- start 2024-09-17T01:36:29.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.484+0000 7efe67e00640 1 -- start start 2024-09-17T01:36:29.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.485+0000 7efe67e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe680cfba0 0x7efe680ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:29.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.485+0000 7efe67e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe680d0e10 0x7efe68157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:29.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.485+0000 7efe67e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe68162500 0x7efe68158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:29.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.485+0000 7efe67e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efe680b31e0 con 0x7efe68162500 2024-09-17T01:36:29.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.485+0000 7efe67e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efe680b3060 con 0x7efe680d0e10 2024-09-17T01:36:29.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.485+0000 7efe67e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7efe680b3360 con 0x7efe680cfba0 2024-09-17T01:36:29.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.486+0000 7efe67400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe68162500 0x7efe68158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:29.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.486+0000 7efe67400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe68162500 0x7efe68158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54740/0 (socket says 172.21.15.42:54740) 2024-09-17T01:36:29.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.486+0000 7efe67400640 1 -- 172.21.15.42:0/1010794057 learned_addr learned my addr 172.21.15.42:0/1010794057 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:29.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.486+0000 7efe66a00640 1 --2- 172.21.15.42:0/1010794057 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe680cfba0 0x7efe680ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:29.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.486+0000 7efe66000640 1 --2- 172.21.15.42:0/1010794057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe680d0e10 0x7efe68157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:29.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.486+0000 7efe67400640 1 -- 172.21.15.42:0/1010794057 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe680cfba0 msgr2=0x7efe680ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:29.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.486+0000 7efe67400640 1 --2- 172.21.15.42:0/1010794057 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe680cfba0 0x7efe680ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.486+0000 7efe67400640 1 -- 172.21.15.42:0/1010794057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe680d0e10 msgr2=0x7efe68157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:29.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.486+0000 7efe67400640 1 --2- 172.21.15.42:0/1010794057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe680d0e10 0x7efe68157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.486+0000 7efe67400640 1 -- 172.21.15.42:0/1010794057 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe68158880 con 0x7efe68162500 2024-09-17T01:36:29.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.486+0000 7efe66000640 1 --2- 172.21.15.42:0/1010794057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe680d0e10 0x7efe68157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:36:29.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.487+0000 7efe67400640 1 --2- 172.21.15.42:0/1010794057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe68162500 0x7efe68158040 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7efe6000ebf0 tx=0x7efe6000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:29.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.487+0000 7efe5ea00640 1 -- 172.21.15.42:0/1010794057 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60003b70 con 0x7efe68162500 2024-09-17T01:36:29.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.487+0000 7efe5ea00640 1 -- 172.21.15.42:0/1010794057 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe60003d10 con 0x7efe68162500 2024-09-17T01:36:29.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.487+0000 7efe67e00640 1 -- 172.21.15.42:0/1010794057 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe68158b60 con 0x7efe68162500 2024-09-17T01:36:29.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.487+0000 7efe5ea00640 1 -- 172.21.15.42:0/1010794057 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60004280 con 0x7efe68162500 2024-09-17T01:36:29.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.487+0000 7efe67e00640 1 -- 172.21.15.42:0/1010794057 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe681f6850 con 0x7efe68162500 2024-09-17T01:36:29.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.488+0000 7efe67e00640 1 -- 172.21.15.42:0/1010794057 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe681f6c90 con 0x7efe68162500 2024-09-17T01:36:29.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.490+0000 7efe5ea00640 1 -- 172.21.15.42:0/1010794057 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efe60004420 con 0x7efe68162500 2024-09-17T01:36:29.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.490+0000 7efe5ea00640 1 --2- 172.21.15.42:0/1010794057 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efe48078bc0 0x7efe4807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:29.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.491+0000 7efe5ea00640 1 -- 172.21.15.42:0/1010794057 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5795+0+0 (secure 0 0 0) 0x7efe6009b9b0 con 0x7efe68162500 2024-09-17T01:36:29.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.491+0000 7efe66a00640 1 --2- 172.21.15.42:0/1010794057 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efe48078bc0 0x7efe4807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:29.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.492+0000 7efe66a00640 1 --2- 172.21.15.42:0/1010794057 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efe48078bc0 0x7efe4807b0d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efe58007fd0 tx=0x7efe58001370 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:29.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.495+0000 7efe5ea00640 1 -- 172.21.15.42:0/1010794057 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efe60063d80 con 0x7efe68162500 2024-09-17T01:36:29.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.727+0000 7efe67e00640 1 -- 172.21.15.42:0/1010794057 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe68158610 con 0x7efe68162500 2024-09-17T01:36:29.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.727+0000 7efe5ea00640 1 -- 172.21.15.42:0/1010794057 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5214 (secure 0 0 0) 0x7efe60063680 con 0x7efe68162500 2024-09-17T01:36:29.725 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:29.725 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":44,"btime":"2024-09-17T01:36:29:443650+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2214729520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2214729520},{"type":"v1","addr":"172.21.15.43:6835","nonce":2214729520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/983475498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":983475498},{"type":"v1","addr":"172.21.15.43:6837","nonce":983475498}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1213307380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1213307380},{"type":"v1","addr":"172.21.15.42:6833","nonce":1213307380}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:36:10.790086+0000","modified":"2024-09-17T01:36:29.443631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":66,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6492":{"gid":6492,"name":"c","rank":0,"incarnation":44,"state":"up:replay","state_seq":1,"addr":"172.21.15.42:6835/4251885944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":4251885944},{"type":"v1","addr":"172.21.15.42:6835","nonce":4251885944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-09-17T01:36:29.726 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 44 2024-09-17T01:36:29.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.730+0000 7efe67e00640 1 -- 172.21.15.42:0/1010794057 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efe48078bc0 msgr2=0x7efe4807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:29.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.730+0000 7efe67e00640 1 --2- 172.21.15.42:0/1010794057 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efe48078bc0 0x7efe4807b0d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efe58007fd0 tx=0x7efe58001370 comp rx=0 tx=0).stop 2024-09-17T01:36:29.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.730+0000 7efe67e00640 1 -- 172.21.15.42:0/1010794057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe68162500 msgr2=0x7efe68158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:29.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.730+0000 7efe67e00640 1 --2- 172.21.15.42:0/1010794057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe68162500 0x7efe68158040 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7efe6000ebf0 tx=0x7efe6000c6a0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.730+0000 7efe67e00640 1 -- 172.21.15.42:0/1010794057 shutdown_connections 2024-09-17T01:36:29.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.730+0000 7efe67e00640 1 --2- 172.21.15.42:0/1010794057 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efe48078bc0 0x7efe4807b0d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.730+0000 7efe67e00640 1 --2- 172.21.15.42:0/1010794057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe680d0e10 0x7efe68157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.730+0000 7efe67e00640 1 --2- 172.21.15.42:0/1010794057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe68162500 0x7efe68158040 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.730+0000 7efe67e00640 1 --2- 172.21.15.42:0/1010794057 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe680cfba0 0x7efe680ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:29.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.730+0000 7efe67e00640 1 -- 172.21.15.42:0/1010794057 >> 172.21.15.42:0/1010794057 conn(0x7efe680b6140 msgr2=0x7efe6815bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:29.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.730+0000 7efe67e00640 1 -- 172.21.15.42:0/1010794057 shutdown_connections 2024-09-17T01:36:29.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:29.730+0000 7efe67e00640 1 -- 172.21.15.42:0/1010794057 wait complete. 2024-09-17T01:36:30.155 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:36:10.790086+0000', 'modified': '2024-09-17T01:36:29.443631+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 66, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6492}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6492': {'gid': 6492, 'name': 'c', 'rank': 0, 'incarnation': 44, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.42:6835/4251885944', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6834', 'nonce': 4251885944}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 4251885944}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T01:36:30.155 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6492:up:replay 2024-09-17T01:36:31.156 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:36:31.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.391+0000 7f8585e00640 1 -- 172.21.15.42:0/2861958858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85800cf7c0 msgr2=0x7f858006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:31.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.391+0000 7f8585e00640 1 --2- 172.21.15.42:0/2861958858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85800cf7c0 0x7f858006cd20 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f856c009830 tx=0x7f856c02a5b0 comp rx=0 tx=0).stop 2024-09-17T01:36:31.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.391+0000 7f8585e00640 1 -- 172.21.15.42:0/2861958858 shutdown_connections 2024-09-17T01:36:31.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.391+0000 7f8585e00640 1 --2- 172.21.15.42:0/2861958858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85800cf7c0 0x7f858006cd20 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:31.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.391+0000 7f8585e00640 1 -- 172.21.15.42:0/2861958858 >> 172.21.15.42:0/2861958858 conn(0x7f85800b25f0 msgr2=0x7f85800d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:31.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.391+0000 7f8585e00640 1 -- 172.21.15.42:0/2861958858 shutdown_connections 2024-09-17T01:36:31.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.391+0000 7f8585e00640 1 -- 172.21.15.42:0/2861958858 wait complete. 2024-09-17T01:36:31.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.394+0000 7f8585e00640 1 Processor -- start 2024-09-17T01:36:31.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.394+0000 7f8585e00640 1 -- start start 2024-09-17T01:36:31.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.395+0000 7f8585e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f858006d260 0x7f85801f9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:31.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.395+0000 7f8585e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85800b4be0 0x7f8580152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:31.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.395+0000 7f8585e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85800cf7c0 0x7f858015f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:31.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.395+0000 7f8585e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f85801535e0 con 0x7f85800cf7c0 2024-09-17T01:36:31.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.395+0000 7f8585e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f85800b4340 con 0x7f85800b4be0 2024-09-17T01:36:31.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.395+0000 7f8585e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8580153760 con 0x7f858006d260 2024-09-17T01:36:31.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.396+0000 7f8585400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85800cf7c0 0x7f858015f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:31.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.396+0000 7f8585400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85800cf7c0 0x7f858015f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54764/0 (socket says 172.21.15.42:54764) 2024-09-17T01:36:31.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.396+0000 7f8585400640 1 -- 172.21.15.42:0/3739205795 learned_addr learned my addr 172.21.15.42:0/3739205795 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:31.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.396+0000 7f857fe00640 1 --2- 172.21.15.42:0/3739205795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85800b4be0 0x7f8580152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:31.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.396+0000 7f8584a00640 1 --2- 172.21.15.42:0/3739205795 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f858006d260 0x7f85801f9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:31.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.396+0000 7f8585400640 1 -- 172.21.15.42:0/3739205795 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f858006d260 msgr2=0x7f85801f9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:31.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.396+0000 7f8585400640 1 --2- 172.21.15.42:0/3739205795 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f858006d260 0x7f85801f9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:31.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.396+0000 7f8585400640 1 -- 172.21.15.42:0/3739205795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85800b4be0 msgr2=0x7f8580152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:31.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.396+0000 7f8585400640 1 --2- 172.21.15.42:0/3739205795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85800b4be0 0x7f8580152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:31.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.396+0000 7f8585400640 1 -- 172.21.15.42:0/3739205795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85801f9cc0 con 0x7f85800cf7c0 2024-09-17T01:36:31.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.396+0000 7f8584a00640 1 --2- 172.21.15.42:0/3739205795 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f858006d260 0x7f85801f9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:36:31.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.396+0000 7f8585400640 1 --2- 172.21.15.42:0/3739205795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85800cf7c0 0x7f858015f4c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f857800cb40 tx=0x7f857800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:31.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.397+0000 7f857cc00640 1 -- 172.21.15.42:0/3739205795 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8578016020 con 0x7f85800cf7c0 2024-09-17T01:36:31.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.397+0000 7f857cc00640 1 -- 172.21.15.42:0/3739205795 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f857800acd0 con 0x7f85800cf7c0 2024-09-17T01:36:31.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.397+0000 7f857cc00640 1 -- 172.21.15.42:0/3739205795 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8578012680 con 0x7f85800cf7c0 2024-09-17T01:36:31.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.397+0000 7f8585e00640 1 -- 172.21.15.42:0/3739205795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8580074060 con 0x7f85800cf7c0 2024-09-17T01:36:31.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.397+0000 7f8585e00640 1 -- 172.21.15.42:0/3739205795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8580074620 con 0x7f85800cf7c0 2024-09-17T01:36:31.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.398+0000 7f8585e00640 1 -- 172.21.15.42:0/3739205795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85800d04b0 con 0x7f85800cf7c0 2024-09-17T01:36:31.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.399+0000 7f857cc00640 1 -- 172.21.15.42:0/3739205795 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8578019020 con 0x7f85800cf7c0 2024-09-17T01:36:31.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.400+0000 7f857cc00640 1 --2- 172.21.15.42:0/3739205795 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8560078bc0 0x7f856007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:31.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.400+0000 7f857cc00640 1 -- 172.21.15.42:0/3739205795 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5795+0+0 (secure 0 0 0) 0x7f857809aff0 con 0x7f85800cf7c0 2024-09-17T01:36:31.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.401+0000 7f8584a00640 1 --2- 172.21.15.42:0/3739205795 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8560078bc0 0x7f856007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:31.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.402+0000 7f8584a00640 1 --2- 172.21.15.42:0/3739205795 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8560078bc0 0x7f856007b0d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8574007fd0 tx=0x7f8574009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:31.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.405+0000 7f857cc00640 1 -- 172.21.15.42:0/3739205795 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f85800d04b0 con 0x7f85800cf7c0 2024-09-17T01:36:31.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.641+0000 7f8585e00640 1 -- 172.21.15.42:0/3739205795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f858006cd20 con 0x7f85800cf7c0 2024-09-17T01:36:31.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.642+0000 7f857cc00640 1 -- 172.21.15.42:0/3739205795 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5214 (secure 0 0 0) 0x7f8578020030 con 0x7f85800cf7c0 2024-09-17T01:36:31.640 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:31.640 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":46,"btime":"2024-09-17T01:36:31:447790+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2214729520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2214729520},{"type":"v1","addr":"172.21.15.43:6835","nonce":2214729520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/983475498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":983475498},{"type":"v1","addr":"172.21.15.43:6837","nonce":983475498}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1213307380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1213307380},{"type":"v1","addr":"172.21.15.42:6833","nonce":1213307380}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:36:10.790086+0000","modified":"2024-09-17T01:36:30.449987+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":66,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6492":{"gid":6492,"name":"c","rank":0,"incarnation":44,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.42:6835/4251885944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":4251885944},{"type":"v1","addr":"172.21.15.42:6835","nonce":4251885944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-09-17T01:36:31.640 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 46 2024-09-17T01:36:31.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.644+0000 7f8585e00640 1 -- 172.21.15.42:0/3739205795 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8560078bc0 msgr2=0x7f856007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:31.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.644+0000 7f8585e00640 1 --2- 172.21.15.42:0/3739205795 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8560078bc0 0x7f856007b0d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8574007fd0 tx=0x7f8574009040 comp rx=0 tx=0).stop 2024-09-17T01:36:31.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.644+0000 7f8585e00640 1 -- 172.21.15.42:0/3739205795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85800cf7c0 msgr2=0x7f858015f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:31.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.644+0000 7f8585e00640 1 --2- 172.21.15.42:0/3739205795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85800cf7c0 0x7f858015f4c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f857800cb40 tx=0x7f857800a060 comp rx=0 tx=0).stop 2024-09-17T01:36:31.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.644+0000 7f8585e00640 1 -- 172.21.15.42:0/3739205795 shutdown_connections 2024-09-17T01:36:31.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.644+0000 7f8585e00640 1 --2- 172.21.15.42:0/3739205795 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8560078bc0 0x7f856007b0d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:31.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.644+0000 7f8585e00640 1 --2- 172.21.15.42:0/3739205795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85800b4be0 0x7f8580152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:31.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.644+0000 7f8585e00640 1 --2- 172.21.15.42:0/3739205795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85800cf7c0 0x7f858015f4c0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:31.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.644+0000 7f8585e00640 1 --2- 172.21.15.42:0/3739205795 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f858006d260 0x7f85801f9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:31.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.644+0000 7f8585e00640 1 -- 172.21.15.42:0/3739205795 >> 172.21.15.42:0/3739205795 conn(0x7f85800b25f0 msgr2=0x7f85800b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:31.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.644+0000 7f8585e00640 1 -- 172.21.15.42:0/3739205795 shutdown_connections 2024-09-17T01:36:31.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:31.645+0000 7f8585e00640 1 -- 172.21.15.42:0/3739205795 wait complete. 2024-09-17T01:36:32.067 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:36:10.790086+0000', 'modified': '2024-09-17T01:36:30.449987+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 66, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6492}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6492': {'gid': 6492, 'name': 'c', 'rank': 0, 'incarnation': 44, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.42:6835/4251885944', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6834', 'nonce': 4251885944}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 4251885944}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T01:36:32.067 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6492:up:rejoin 2024-09-17T01:36:33.068 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:36:33.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.310+0000 7fe84ae00640 1 -- 172.21.15.42:0/435854163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe84406d430 msgr2=0x7fe84406d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:33.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.310+0000 7fe84ae00640 1 --2- 172.21.15.42:0/435854163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe84406d430 0x7fe84406d840 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe844071ef0 tx=0x7fe82c02a560 comp rx=0 tx=0).stop 2024-09-17T01:36:33.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.310+0000 7fe84ae00640 1 -- 172.21.15.42:0/435854163 shutdown_connections 2024-09-17T01:36:33.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.310+0000 7fe84ae00640 1 --2- 172.21.15.42:0/435854163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe84406d430 0x7fe84406d840 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:33.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.310+0000 7fe84ae00640 1 --2- 172.21.15.42:0/435854163 >> v2:172.21.15.43:3300/0 conn(0x7fe84415cb80 0x7fe844152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:33.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.310+0000 7fe84ae00640 1 -- 172.21.15.42:0/435854163 >> 172.21.15.42:0/435854163 conn(0x7fe8440b2930 msgr2=0x7fe84406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:33.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.310+0000 7fe84ae00640 1 -- 172.21.15.42:0/435854163 shutdown_connections 2024-09-17T01:36:33.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.310+0000 7fe84ae00640 1 -- 172.21.15.42:0/435854163 wait complete. 2024-09-17T01:36:33.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.313+0000 7fe84ae00640 1 Processor -- start 2024-09-17T01:36:33.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.313+0000 7fe84ae00640 1 -- start start 2024-09-17T01:36:33.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.314+0000 7fe84ae00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe84406d430 0x7fe8441f9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:33.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.314+0000 7fe84ae00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe84415cb80 0x7fe844155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:33.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.314+0000 7fe84ae00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe84415f480 0x7fe844145c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:33.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.314+0000 7fe84ae00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe844073820 con 0x7fe84406d430 2024-09-17T01:36:33.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.314+0000 7fe84ae00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe8440736a0 con 0x7fe84415f480 2024-09-17T01:36:33.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.314+0000 7fe84ae00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe8440739a0 con 0x7fe84415cb80 2024-09-17T01:36:33.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.314+0000 7fe843e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe84406d430 0x7fe8441f9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:33.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.314+0000 7fe843e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe84406d430 0x7fe8441f9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54782/0 (socket says 172.21.15.42:54782) 2024-09-17T01:36:33.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.314+0000 7fe843e00640 1 -- 172.21.15.42:0/1567726635 learned_addr learned my addr 172.21.15.42:0/1567726635 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:33.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.315+0000 7fe83be00640 1 --2- 172.21.15.42:0/1567726635 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe84415cb80 0x7fe844155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:33.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.315+0000 7fe848e00640 1 --2- 172.21.15.42:0/1567726635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe84415f480 0x7fe844145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:33.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.315+0000 7fe843e00640 1 -- 172.21.15.42:0/1567726635 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe84415cb80 msgr2=0x7fe844155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:33.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.315+0000 7fe843e00640 1 --2- 172.21.15.42:0/1567726635 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe84415cb80 0x7fe844155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:33.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.315+0000 7fe843e00640 1 -- 172.21.15.42:0/1567726635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe84415f480 msgr2=0x7fe844145c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:33.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.315+0000 7fe843e00640 1 --2- 172.21.15.42:0/1567726635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe84415f480 0x7fe844145c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:33.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.315+0000 7fe843e00640 1 -- 172.21.15.42:0/1567726635 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8441562f0 con 0x7fe84406d430 2024-09-17T01:36:33.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.315+0000 7fe848e00640 1 --2- 172.21.15.42:0/1567726635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe84415f480 0x7fe844145c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:36:33.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.315+0000 7fe843e00640 1 --2- 172.21.15.42:0/1567726635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe84406d430 0x7fe8441f9b00 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe83400d700 tx=0x7fe83400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:33.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.315+0000 7fe840c00640 1 -- 172.21.15.42:0/1567726635 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe834017070 con 0x7fe84406d430 2024-09-17T01:36:33.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.316+0000 7fe840c00640 1 -- 172.21.15.42:0/1567726635 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe834005310 con 0x7fe84406d430 2024-09-17T01:36:33.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.316+0000 7fe840c00640 1 -- 172.21.15.42:0/1567726635 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe834009820 con 0x7fe84406d430 2024-09-17T01:36:33.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.316+0000 7fe84ae00640 1 -- 172.21.15.42:0/1567726635 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe844146190 con 0x7fe84406d430 2024-09-17T01:36:33.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.316+0000 7fe84ae00640 1 -- 172.21.15.42:0/1567726635 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8441539d0 con 0x7fe84406d430 2024-09-17T01:36:33.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.317+0000 7fe84ae00640 1 -- 172.21.15.42:0/1567726635 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8440af260 con 0x7fe84406d430 2024-09-17T01:36:33.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.318+0000 7fe840c00640 1 -- 172.21.15.42:0/1567726635 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe8340099c0 con 0x7fe84406d430 2024-09-17T01:36:33.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.319+0000 7fe840c00640 1 --2- 172.21.15.42:0/1567726635 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe820078b90 0x7fe82007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:33.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.319+0000 7fe840c00640 1 -- 172.21.15.42:0/1567726635 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5795+0+0 (secure 0 0 0) 0x7fe83409af40 con 0x7fe84406d430 2024-09-17T01:36:33.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.319+0000 7fe83be00640 1 --2- 172.21.15.42:0/1567726635 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe820078b90 0x7fe82007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:33.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.321+0000 7fe83be00640 1 --2- 172.21.15.42:0/1567726635 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe820078b90 0x7fe82007b0a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe82c033000 tx=0x7fe82c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:33.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.324+0000 7fe840c00640 1 -- 172.21.15.42:0/1567726635 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe8440af260 con 0x7fe84406d430 2024-09-17T01:36:33.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.556+0000 7fe84ae00640 1 -- 172.21.15.42:0/1567726635 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe844073e90 con 0x7fe84406d430 2024-09-17T01:36:33.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.556+0000 7fe840c00640 1 -- 172.21.15.42:0/1567726635 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5221 (secure 0 0 0) 0x7fe834063310 con 0x7fe84406d430 2024-09-17T01:36:33.554 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:33.554 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":47,"btime":"2024-09-17T01:36:32:454373+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2214729520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2214729520},{"type":"v1","addr":"172.21.15.43:6835","nonce":2214729520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/983475498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":983475498},{"type":"v1","addr":"172.21.15.43:6837","nonce":983475498}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1213307380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1213307380},{"type":"v1","addr":"172.21.15.42:6833","nonce":1213307380}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:36:10.790086+0000","modified":"2024-09-17T01:36:32.454363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":66,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6492":{"gid":6492,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6835/4251885944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":4251885944},{"type":"v1","addr":"172.21.15.42:6835","nonce":4251885944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6492,"qdb_cluster":[6492]},"id":4}]} 2024-09-17T01:36:33.555 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 47 2024-09-17T01:36:33.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.559+0000 7fe84ae00640 1 -- 172.21.15.42:0/1567726635 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe820078b90 msgr2=0x7fe82007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:33.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.559+0000 7fe84ae00640 1 --2- 172.21.15.42:0/1567726635 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe820078b90 0x7fe82007b0a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe82c033000 tx=0x7fe82c004730 comp rx=0 tx=0).stop 2024-09-17T01:36:33.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.559+0000 7fe84ae00640 1 -- 172.21.15.42:0/1567726635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe84406d430 msgr2=0x7fe8441f9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:33.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.559+0000 7fe84ae00640 1 --2- 172.21.15.42:0/1567726635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe84406d430 0x7fe8441f9b00 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe83400d700 tx=0x7fe83400dbc0 comp rx=0 tx=0).stop 2024-09-17T01:36:33.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.559+0000 7fe84ae00640 1 -- 172.21.15.42:0/1567726635 shutdown_connections 2024-09-17T01:36:33.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.559+0000 7fe84ae00640 1 --2- 172.21.15.42:0/1567726635 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe820078b90 0x7fe82007b0a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:33.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.559+0000 7fe84ae00640 1 --2- 172.21.15.42:0/1567726635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe84415f480 0x7fe844145c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:33.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.559+0000 7fe84ae00640 1 --2- 172.21.15.42:0/1567726635 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe84415cb80 0x7fe844155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:33.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.559+0000 7fe84ae00640 1 --2- 172.21.15.42:0/1567726635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe84406d430 0x7fe8441f9b00 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:33.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.559+0000 7fe84ae00640 1 -- 172.21.15.42:0/1567726635 >> 172.21.15.42:0/1567726635 conn(0x7fe8440b2930 msgr2=0x7fe8440cd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:33.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.559+0000 7fe84ae00640 1 -- 172.21.15.42:0/1567726635 shutdown_connections 2024-09-17T01:36:33.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:33.559+0000 7fe84ae00640 1 -- 172.21.15.42:0/1567726635 wait complete. 2024-09-17T01:36:33.981 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:36:10.790086+0000', 'modified': '2024-09-17T01:36:32.454363+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 66, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6492}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6492': {'gid': 6492, 'name': 'c', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.42:6835/4251885944', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6834', 'nonce': 4251885944}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 4251885944}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6492, 'qdb_cluster': [6492]} 2024-09-17T01:36:33.981 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T01:36:33.981 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T01:36:34.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.212+0000 7f7515800640 1 -- 172.21.15.42:0/2353603948 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f751006d430 msgr2=0x7f751006d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:34.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.212+0000 7f7515800640 1 --2- 172.21.15.42:0/2353603948 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f751006d430 0x7f751006d840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f74f8009830 tx=0x7f74f802a510 comp rx=0 tx=0).stop 2024-09-17T01:36:34.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.213+0000 7f7515800640 1 -- 172.21.15.42:0/2353603948 shutdown_connections 2024-09-17T01:36:34.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.213+0000 7f7515800640 1 --2- 172.21.15.42:0/2353603948 >> v2:172.21.15.43:3300/0 conn(0x7f751015f480 0x7f751015f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.213+0000 7f7515800640 1 --2- 172.21.15.42:0/2353603948 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f751006d430 0x7f751006d840 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.213+0000 7f7515800640 1 -- 172.21.15.42:0/2353603948 >> 172.21.15.42:0/2353603948 conn(0x7f75100b2930 msgr2=0x7f751006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:34.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.213+0000 7f7515800640 1 -- 172.21.15.42:0/2353603948 shutdown_connections 2024-09-17T01:36:34.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.213+0000 7f7515800640 1 -- 172.21.15.42:0/2353603948 wait complete. 2024-09-17T01:36:34.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.215+0000 7f7515800640 1 Processor -- start 2024-09-17T01:36:34.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.215+0000 7f7515800640 1 -- start start 2024-09-17T01:36:34.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.216+0000 7f7515800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f751006d430 0x7f75101458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.216+0000 7f7515800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f751015cb80 0x7f7510142430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.217+0000 7f7515800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f751015f480 0x7f75101f6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.217+0000 7f7515800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f75100737e0 con 0x7f751015f480 2024-09-17T01:36:34.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.217+0000 7f7515800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7510073660 con 0x7f751015cb80 2024-09-17T01:36:34.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.217+0000 7f7515800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7510073960 con 0x7f751006d430 2024-09-17T01:36:34.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.217+0000 7f750f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f751015f480 0x7f75101f6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.217+0000 7f7506000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f751015cb80 0x7f7510142430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.217+0000 7f750f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f751015f480 0x7f75101f6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54786/0 (socket says 172.21.15.42:54786) 2024-09-17T01:36:34.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.217+0000 7f750f400640 1 -- 172.21.15.42:0/2892287293 learned_addr learned my addr 172.21.15.42:0/2892287293 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:34.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.217+0000 7f750ea00640 1 --2- 172.21.15.42:0/2892287293 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f751006d430 0x7f75101458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.217+0000 7f750f400640 1 -- 172.21.15.42:0/2892287293 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f751006d430 msgr2=0x7f75101458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:34.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.217+0000 7f750f400640 1 --2- 172.21.15.42:0/2892287293 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f751006d430 0x7f75101458b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.217+0000 7f750f400640 1 -- 172.21.15.42:0/2892287293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f751015cb80 msgr2=0x7f7510142430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:34.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.217+0000 7f750f400640 1 --2- 172.21.15.42:0/2892287293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f751015cb80 0x7f7510142430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.217+0000 7f750f400640 1 -- 172.21.15.42:0/2892287293 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7510156f70 con 0x7f751015f480 2024-09-17T01:36:34.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.218+0000 7f750f400640 1 --2- 172.21.15.42:0/2892287293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f751015f480 0x7f75101f6df0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f750800efc0 tx=0x7f750800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:34.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.218+0000 7f7507400640 1 -- 172.21.15.42:0/2892287293 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7508003970 con 0x7f751015f480 2024-09-17T01:36:34.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.218+0000 7f7507400640 1 -- 172.21.15.42:0/2892287293 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7508003c00 con 0x7f751015f480 2024-09-17T01:36:34.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.218+0000 7f7515800640 1 -- 172.21.15.42:0/2892287293 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7510151090 con 0x7f751015f480 2024-09-17T01:36:34.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.218+0000 7f7507400640 1 -- 172.21.15.42:0/2892287293 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7508004020 con 0x7f751015f480 2024-09-17T01:36:34.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.218+0000 7f7515800640 1 -- 172.21.15.42:0/2892287293 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75101f7c40 con 0x7f751015f480 2024-09-17T01:36:34.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.221+0000 7f7507400640 1 -- 172.21.15.42:0/2892287293 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f750801d020 con 0x7f751015f480 2024-09-17T01:36:34.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.222+0000 7f7507400640 1 --2- 172.21.15.42:0/2892287293 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74ec078b90 0x7f74ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.223+0000 7f7507400640 1 -- 172.21.15.42:0/2892287293 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5795+0+0 (secure 0 0 0) 0x7f750809b330 con 0x7f751015f480 2024-09-17T01:36:34.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.223+0000 7f751c830740 1 Processor -- start 2024-09-17T01:36:34.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.223+0000 7f750ea00640 1 --2- 172.21.15.42:0/2892287293 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74ec078b90 0x7f74ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.223+0000 7f751c830740 1 -- start start 2024-09-17T01:36:34.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.224+0000 7f750ea00640 1 --2- 172.21.15.42:0/2892287293 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74ec078b90 0x7f74ec07b0a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7500000f60 tx=0x7f7500009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:34.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.224+0000 7f751c830740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5568ab72e270 0x5568abb19a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.225+0000 7f751c830740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568ab7053b0 0x5568abacef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.225+0000 7f751c830740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab70d590 0x5568abacf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.225+0000 7f751c830740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5568aba58430 con 0x5568ab70d590 2024-09-17T01:36:34.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.225+0000 7f751c830740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5568aba485d0 con 0x5568ab7053b0 2024-09-17T01:36:34.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.225+0000 7f751c830740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5568aba37a00 con 0x5568ab72e270 2024-09-17T01:36:34.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.225+0000 7f750f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab70d590 0x5568abacf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.225+0000 7f750f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab70d590 0x5568abacf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54802/0 (socket says 172.21.15.42:54802) 2024-09-17T01:36:34.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.225+0000 7f750f400640 1 -- 172.21.15.42:0/1501135114 learned_addr learned my addr 172.21.15.42:0/1501135114 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:34.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.225+0000 7f750ea00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5568ab72e270 0x5568abb19a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.225+0000 7f7506000640 1 --2- 172.21.15.42:0/1501135114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568ab7053b0 0x5568abacef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.225+0000 7f750f400640 1 -- 172.21.15.42:0/1501135114 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5568ab72e270 msgr2=0x5568abb19a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:34.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.225+0000 7f750f400640 1 --2- 172.21.15.42:0/1501135114 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5568ab72e270 0x5568abb19a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.225+0000 7f750f400640 1 -- 172.21.15.42:0/1501135114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568ab7053b0 msgr2=0x5568abacef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:34.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.225+0000 7f750f400640 1 --2- 172.21.15.42:0/1501135114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568ab7053b0 0x5568abacef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.225+0000 7f750f400640 1 -- 172.21.15.42:0/1501135114 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568aba00520 con 0x5568ab70d590 2024-09-17T01:36:34.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.226+0000 7f750f400640 1 --2- 172.21.15.42:0/1501135114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab70d590 0x5568abacf4a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7508062d20 tx=0x7f7508062b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ecb196af4b8d3d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:34.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.226+0000 7f74ff400640 1 -- 172.21.15.42:0/1501135114 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7508067a50 con 0x5568ab70d590 2024-09-17T01:36:34.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.226+0000 7f74ff400640 1 -- 172.21.15.42:0/1501135114 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f750806c990 con 0x5568ab70d590 2024-09-17T01:36:34.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.226+0000 7f74ff400640 1 -- 172.21.15.42:0/1501135114 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750806c500 con 0x5568ab70d590 2024-09-17T01:36:34.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.226+0000 7f751c830740 1 -- 172.21.15.42:0/1501135114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab70d590 msgr2=0x5568abacf4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:34.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.226+0000 7f751c830740 1 --2- 172.21.15.42:0/1501135114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab70d590 0x5568abacf4a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7508062d20 tx=0x7f7508062b30 comp rx=0 tx=0).stop 2024-09-17T01:36:34.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.227+0000 7f751c830740 1 -- 172.21.15.42:0/1501135114 shutdown_connections 2024-09-17T01:36:34.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.227+0000 7f751c830740 1 --2- 172.21.15.42:0/1501135114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568ab7053b0 0x5568abacef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.227+0000 7f751c830740 1 --2- 172.21.15.42:0/1501135114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab70d590 0x5568abacf4a0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.227+0000 7f751c830740 1 --2- 172.21.15.42:0/1501135114 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5568ab72e270 0x5568abb19a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.227+0000 7f751c830740 1 -- 172.21.15.42:0/1501135114 >> 172.21.15.42:0/1501135114 conn(0x5568ab7223c0 msgr2=0x5568abad4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:34.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.227+0000 7f751c830740 1 -- 172.21.15.42:0/1501135114 shutdown_connections 2024-09-17T01:36:34.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.227+0000 7f751c830740 1 -- 172.21.15.42:0/1501135114 wait complete. 2024-09-17T01:36:34.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.228+0000 7f751c830740 1 -- start start 2024-09-17T01:36:34.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.228+0000 7f751c830740 1 Processor -- start 2024-09-17T01:36:34.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.229+0000 7f751c830740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568ab7053b0 0x5568abb10070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.229+0000 7f751c830740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5568ab70d590 0x5568abb131f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.229+0000 7f751c830740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab72e270 0x5568abb30640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.229+0000 7f751c830740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5568ab9de330 con 0x5568ab72e270 2024-09-17T01:36:34.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.229+0000 7f751c830740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5568aba3b810 con 0x5568ab7053b0 2024-09-17T01:36:34.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.229+0000 7f751c830740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5568ab7a8620 con 0x5568ab70d590 2024-09-17T01:36:34.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.229+0000 7f751c830740 10 client.0 _ll_register_callbacks cb 0x5568ab9e3420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:36:34.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.230+0000 7f750f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab72e270 0x5568abb30640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.230+0000 7f750f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab72e270 0x5568abb30640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54818/0 (socket says 172.21.15.42:54818) 2024-09-17T01:36:34.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.230+0000 7f750f400640 1 -- 172.21.15.42:0/2444197390 learned_addr learned my addr 172.21.15.42:0/2444197390 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:34.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.230+0000 7f750ea00640 1 --2- 172.21.15.42:0/2444197390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568ab7053b0 0x5568abb10070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.230+0000 7f7506000640 1 --2- 172.21.15.42:0/2444197390 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5568ab70d590 0x5568abb131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.230+0000 7f750f400640 1 -- 172.21.15.42:0/2444197390 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5568ab70d590 msgr2=0x5568abb131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:34.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.230+0000 7f750f400640 1 --2- 172.21.15.42:0/2444197390 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5568ab70d590 0x5568abb131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.230+0000 7f750f400640 1 -- 172.21.15.42:0/2444197390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568ab7053b0 msgr2=0x5568abb10070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:34.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.230+0000 7f750f400640 1 --2- 172.21.15.42:0/2444197390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568ab7053b0 0x5568abb10070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.230+0000 7f750f400640 1 -- 172.21.15.42:0/2444197390 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568ab799850 con 0x5568ab72e270 2024-09-17T01:36:34.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.230+0000 7f750ea00640 1 --2- 172.21.15.42:0/2444197390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568ab7053b0 0x5568abb10070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:36:34.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.230+0000 7f750f400640 1 --2- 172.21.15.42:0/2444197390 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab72e270 0x5568abb30640 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f750800cfd0 tx=0x7f7508067ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b12584ff684166 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:34.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.230+0000 7f74f3e00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:36:34.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.231+0000 7f74f3e00640 1 -- 172.21.15.42:0/2444197390 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7508099dc0 con 0x5568ab72e270 2024-09-17T01:36:34.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.231+0000 7f74f3e00640 1 -- 172.21.15.42:0/2444197390 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 5795+0+0 (secure 0 0 0) 0x7f7508062280 con 0x5568ab72e270 2024-09-17T01:36:34.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.231+0000 7f751c830740 1 -- 172.21.15.42:0/2444197390 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f750806c990 con 0x5568ab72e270 2024-09-17T01:36:34.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.231+0000 7f74f3e00640 1 -- 172.21.15.42:0/2444197390 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f75080624a0 con 0x5568ab72e270 2024-09-17T01:36:34.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.231+0000 7f751c830740 10 client.6519 fetch_fsmap learned FSMap version 47 2024-09-17T01:36:34.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.231+0000 7f751c830740 1 -- 172.21.15.42:0/2444197390 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) -- 0x5568ab8106b0 con 0x5568ab72e270 2024-09-17T01:36:34.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.231+0000 7f74f3e00640 1 -- 172.21.15.42:0/2444197390 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f750806c990 con 0x5568ab72e270 2024-09-17T01:36:34.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.231+0000 7f74f3e00640 1 -- 172.21.15.42:0/2444197390 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 47) ==== 3502+0+0 (secure 0 0 0) 0x7f750800b040 con 0x5568ab72e270 2024-09-17T01:36:34.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.231+0000 7f751c830740 10 client.6519 fetch_fsmap finished waiting for FSMap version 47 2024-09-17T01:36:34.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.231+0000 7f751c830740 10 client.6519 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:36:34.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.231+0000 7f751c830740 20 client.6519 populate_metadata read hostname 'smithi042' 2024-09-17T01:36:34.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.231+0000 7f751c830740 1 --2- 172.21.15.42:0/2444197390 >> [v2:172.21.15.42:6834/4251885944,v1:172.21.15.42:6835/4251885944] conn(0x5568ab6ece40 0x5568abb2d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.231+0000 7f751c830740 4 client.6519 mds_command: new command op to 6492 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:36:34.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.231+0000 7f751c830740 1 -- 172.21.15.42:0/2444197390 --> [v2:172.21.15.42:6834/4251885944,v1:172.21.15.42:6835/4251885944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568aba4a520 con 0x5568ab6ece40 2024-09-17T01:36:34.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.232+0000 7f750ea00640 1 --2- 172.21.15.42:0/2444197390 >> [v2:172.21.15.42:6834/4251885944,v1:172.21.15.42:6835/4251885944] conn(0x5568ab6ece40 0x5568abb2d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.232+0000 7f750ea00640 1 --2- 172.21.15.42:0/2444197390 >> [v2:172.21.15.42:6834/4251885944,v1:172.21.15.42:6835/4251885944] conn(0x5568ab6ece40 0x5568abb2d050 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a80a7ac76fde4dba server_cookie=a707bcfdbdf5124c in_seq=0 out_seq=0 2024-09-17T01:36:34.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.232+0000 7f74f3e00640 10 client.6519 ms_handle_connect on v2:172.21.15.42:6834/4251885944 2024-09-17T01:36:34.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.233+0000 7f74f3e00640 1 -- 172.21.15.42:0/2444197390 <== mds.0 v2:172.21.15.42:6834/4251885944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5568aba4a520 con 0x5568ab6ece40 2024-09-17T01:36:34.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.233+0000 7f74f3e00640 10 client.6519 handle_command_reply: tid=0 2024-09-17T01:36:34.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.233+0000 7f751c830740 1 client.6519 shutdown 2024-09-17T01:36:34.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.233+0000 7f751c830740 1 -- 172.21.15.42:0/2444197390 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab72e270 msgr2=0x5568abb30640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:34.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.233+0000 7f751c830740 1 --2- 172.21.15.42:0/2444197390 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab72e270 0x5568abb30640 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f750800cfd0 tx=0x7f7508067ac0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.233+0000 7f751c830740 1 -- 172.21.15.42:0/2444197390 shutdown_connections 2024-09-17T01:36:34.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.233+0000 7f751c830740 1 --2- 172.21.15.42:0/2444197390 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab72e270 0x5568abb30640 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.233+0000 7f751c830740 1 --2- 172.21.15.42:0/2444197390 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5568ab70d590 0x5568abb131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.233+0000 7f751c830740 1 --2- 172.21.15.42:0/2444197390 >> [v2:172.21.15.42:6834/4251885944,v1:172.21.15.42:6835/4251885944] conn(0x5568ab6ece40 0x5568abb2d050 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.233+0000 7f751c830740 1 --2- 172.21.15.42:0/2444197390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568ab7053b0 0x5568abb10070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.233+0000 7f751c830740 1 -- 172.21.15.42:0/2444197390 >> 172.21.15.42:0/2444197390 conn(0x5568ab7223c0 msgr2=0x5568abafb580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:34.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.233+0000 7f74f3e00640 0 client.6519 ms_handle_reset on v2:172.21.15.42:6834/4251885944 2024-09-17T01:36:34.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.234+0000 7f751c830740 1 -- 172.21.15.42:0/2444197390 shutdown_connections 2024-09-17T01:36:34.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.234+0000 7f751c830740 1 -- 172.21.15.42:0/2444197390 wait complete. 2024-09-17T01:36:34.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.234+0000 7f751c830740 20 client.6519 trim_cache size 0 max 16384 2024-09-17T01:36:34.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.253+0000 7f751c830740 1 Processor -- start 2024-09-17T01:36:34.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.253+0000 7f751c830740 1 -- start start 2024-09-17T01:36:34.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.254+0000 7f751c830740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5568ab7053b0 0x5568abafb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.254+0000 7f751c830740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568ab70d590 0x5568abb2c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.255+0000 7f751c830740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab72e270 0x5568abb2c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.255+0000 7f751c830740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7510154310 con 0x5568ab72e270 2024-09-17T01:36:34.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.255+0000 7f751c830740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f75100ac170 con 0x5568ab70d590 2024-09-17T01:36:34.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.255+0000 7f751c830740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f75101f4200 con 0x5568ab7053b0 2024-09-17T01:36:34.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.255+0000 7f750f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab72e270 0x5568abb2c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.255+0000 7f750f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab72e270 0x5568abb2c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54834/0 (socket says 172.21.15.42:54834) 2024-09-17T01:36:34.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.255+0000 7f750f400640 1 -- 172.21.15.42:0/1815863538 learned_addr learned my addr 172.21.15.42:0/1815863538 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:34.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.255+0000 7f750f400640 1 -- 172.21.15.42:0/1815863538 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5568ab7053b0 msgr2=0x5568abafb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:34.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.255+0000 7f7506000640 1 --2- 172.21.15.42:0/1815863538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568ab70d590 0x5568abb2c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.255+0000 7f750ea00640 1 --2- 172.21.15.42:0/1815863538 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5568ab7053b0 0x5568abafb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.255+0000 7f750f400640 1 --2- 172.21.15.42:0/1815863538 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5568ab7053b0 0x5568abafb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.255+0000 7f750f400640 1 -- 172.21.15.42:0/1815863538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568ab70d590 msgr2=0x5568abb2c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:34.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.255+0000 7f750f400640 1 --2- 172.21.15.42:0/1815863538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568ab70d590 0x5568abb2c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.255+0000 7f750f400640 1 -- 172.21.15.42:0/1815863538 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568abaff340 con 0x5568ab72e270 2024-09-17T01:36:34.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.255+0000 7f7506000640 1 --2- 172.21.15.42:0/1815863538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568ab70d590 0x5568abb2c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:36:34.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.256+0000 7f750f400640 1 --2- 172.21.15.42:0/1815863538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab72e270 0x5568abb2c660 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f750805f5a0 tx=0x7f7508004a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9caa0448c9590458 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:34.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.256+0000 7f74fea00640 1 -- 172.21.15.42:0/1815863538 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750806c990 con 0x5568ab72e270 2024-09-17T01:36:34.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.256+0000 7f74fea00640 1 -- 172.21.15.42:0/1815863538 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f750800e1d0 con 0x5568ab72e270 2024-09-17T01:36:34.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.256+0000 7f74fea00640 1 -- 172.21.15.42:0/1815863538 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7508085310 con 0x5568ab72e270 2024-09-17T01:36:34.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.256+0000 7f751c830740 1 -- 172.21.15.42:0/1815863538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab72e270 msgr2=0x5568abb2c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:34.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.256+0000 7f751c830740 1 --2- 172.21.15.42:0/1815863538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab72e270 0x5568abb2c660 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f750805f5a0 tx=0x7f7508004a80 comp rx=0 tx=0).stop 2024-09-17T01:36:34.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.256+0000 7f751c830740 1 -- 172.21.15.42:0/1815863538 shutdown_connections 2024-09-17T01:36:34.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.256+0000 7f751c830740 1 --2- 172.21.15.42:0/1815863538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568ab70d590 0x5568abb2c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.256+0000 7f751c830740 1 --2- 172.21.15.42:0/1815863538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab72e270 0x5568abb2c660 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.256+0000 7f751c830740 1 --2- 172.21.15.42:0/1815863538 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5568ab7053b0 0x5568abafb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.257+0000 7f751c830740 1 -- 172.21.15.42:0/1815863538 >> 172.21.15.42:0/1815863538 conn(0x5568ab7223c0 msgr2=0x5568abafdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:34.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.257+0000 7f751c830740 1 -- 172.21.15.42:0/1815863538 shutdown_connections 2024-09-17T01:36:34.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.257+0000 7f751c830740 1 -- 172.21.15.42:0/1815863538 wait complete. 2024-09-17T01:36:34.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.258+0000 7f751c830740 1 -- start start 2024-09-17T01:36:34.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.258+0000 7f751c830740 1 Processor -- start 2024-09-17T01:36:34.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.259+0000 7f751c830740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab7053b0 0x5568abb9fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.259+0000 7f751c830740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5568ab70d590 0x5568abb13820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.259+0000 7f751c830740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568ab72e270 0x5568abb13d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.259+0000 7f751c830740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5568ab9de330 con 0x5568ab7053b0 2024-09-17T01:36:34.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.259+0000 7f751c830740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5568aba3b810 con 0x5568ab72e270 2024-09-17T01:36:34.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.259+0000 7f751c830740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5568abb115d0 con 0x5568ab70d590 2024-09-17T01:36:34.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.259+0000 7f751c830740 10 client.0 _ll_register_callbacks cb 0x7f7508062a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:36:34.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.259+0000 7f750ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab7053b0 0x5568abb9fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.260+0000 7f750ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab7053b0 0x5568abb9fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54846/0 (socket says 172.21.15.42:54846) 2024-09-17T01:36:34.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.260+0000 7f750ea00640 1 -- 172.21.15.42:0/127659010 learned_addr learned my addr 172.21.15.42:0/127659010 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:34.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.260+0000 7f7506000640 1 --2- 172.21.15.42:0/127659010 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5568ab70d590 0x5568abb13820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.260+0000 7f750f400640 1 --2- 172.21.15.42:0/127659010 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568ab72e270 0x5568abb13d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.260+0000 7f750ea00640 1 -- 172.21.15.42:0/127659010 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5568ab70d590 msgr2=0x5568abb13820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:34.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.260+0000 7f750ea00640 1 --2- 172.21.15.42:0/127659010 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5568ab70d590 0x5568abb13820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.260+0000 7f750ea00640 1 -- 172.21.15.42:0/127659010 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568ab72e270 msgr2=0x5568abb13d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:34.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.260+0000 7f750ea00640 1 --2- 172.21.15.42:0/127659010 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568ab72e270 0x5568abb13d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.260+0000 7f750ea00640 1 -- 172.21.15.42:0/127659010 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568abb2cbd0 con 0x5568ab7053b0 2024-09-17T01:36:34.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.260+0000 7f750ea00640 1 --2- 172.21.15.42:0/127659010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab7053b0 0x5568abb9fa20 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x5568abb14980 tx=0x7f7500001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd437c68be3b94c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:34.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.260+0000 7f74f3e00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:36:34.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.260+0000 7f74f3e00640 1 -- 172.21.15.42:0/127659010 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750002f060 con 0x5568ab7053b0 2024-09-17T01:36:34.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.261+0000 7f74f3e00640 1 -- 172.21.15.42:0/127659010 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 5795+0+0 (secure 0 0 0) 0x7f7500010040 con 0x5568ab7053b0 2024-09-17T01:36:34.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.261+0000 7f751c830740 1 -- 172.21.15.42:0/127659010 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f750800e1d0 con 0x5568ab7053b0 2024-09-17T01:36:34.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.261+0000 7f74f3e00640 1 -- 172.21.15.42:0/127659010 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f7500035050 con 0x5568ab7053b0 2024-09-17T01:36:34.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.261+0000 7f751c830740 10 client.6525 fetch_fsmap learned FSMap version 47 2024-09-17T01:36:34.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.261+0000 7f751c830740 1 -- 172.21.15.42:0/127659010 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) -- 0x5568abb9ff60 con 0x5568ab7053b0 2024-09-17T01:36:34.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.261+0000 7f74f3e00640 1 -- 172.21.15.42:0/127659010 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f750800e1d0 con 0x5568ab7053b0 2024-09-17T01:36:34.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.261+0000 7f74f3e00640 1 -- 172.21.15.42:0/127659010 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 47) ==== 3502+0+0 (secure 0 0 0) 0x7f7500038020 con 0x5568ab7053b0 2024-09-17T01:36:34.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.261+0000 7f751c830740 10 client.6525 fetch_fsmap finished waiting for FSMap version 47 2024-09-17T01:36:34.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.261+0000 7f751c830740 10 client.6525 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:36:34.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.261+0000 7f751c830740 20 client.6525 populate_metadata read hostname 'smithi042' 2024-09-17T01:36:34.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.261+0000 7f751c830740 1 --2- 172.21.15.42:0/127659010 >> [v2:172.21.15.42:6834/4251885944,v1:172.21.15.42:6835/4251885944] conn(0x5568abad4b60 0x5568abb149b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.261+0000 7f751c830740 4 client.6525 mds_command: new command op to 6492 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T01:36:34.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.261+0000 7f751c830740 1 -- 172.21.15.42:0/127659010 --> [v2:172.21.15.42:6834/4251885944,v1:172.21.15.42:6835/4251885944] -- command(tid 0: {"prefix": "status"}) -- 0x5568aba45fd0 con 0x5568abad4b60 2024-09-17T01:36:34.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.261+0000 7f7506000640 1 --2- 172.21.15.42:0/127659010 >> [v2:172.21.15.42:6834/4251885944,v1:172.21.15.42:6835/4251885944] conn(0x5568abad4b60 0x5568abb149b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.262+0000 7f7506000640 1 --2- 172.21.15.42:0/127659010 >> [v2:172.21.15.42:6834/4251885944,v1:172.21.15.42:6835/4251885944] conn(0x5568abad4b60 0x5568abb149b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21f3149433cc54e7 server_cookie=f2d4349dc847dae4 in_seq=0 out_seq=0 2024-09-17T01:36:34.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.262+0000 7f74f3e00640 10 client.6525 ms_handle_connect on v2:172.21.15.42:6834/4251885944 2024-09-17T01:36:34.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.262+0000 7f74f3e00640 1 -- 172.21.15.42:0/127659010 <== mds.0 v2:172.21.15.42:6834/4251885944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5568aba45fd0 con 0x5568abad4b60 2024-09-17T01:36:34.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.262+0000 7f74f3e00640 10 client.6525 handle_command_reply: tid=0 2024-09-17T01:36:34.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.262+0000 7f751c830740 1 client.6525 shutdown 2024-09-17T01:36:34.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.262+0000 7f751c830740 1 -- 172.21.15.42:0/127659010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab7053b0 msgr2=0x5568abb9fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:34.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.262+0000 7f751c830740 1 --2- 172.21.15.42:0/127659010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab7053b0 0x5568abb9fa20 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x5568abb14980 tx=0x7f7500001080 comp rx=0 tx=0).stop 2024-09-17T01:36:34.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.263+0000 7f751c830740 1 -- 172.21.15.42:0/127659010 shutdown_connections 2024-09-17T01:36:34.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.263+0000 7f751c830740 1 --2- 172.21.15.42:0/127659010 >> [v2:172.21.15.42:6834/4251885944,v1:172.21.15.42:6835/4251885944] conn(0x5568abad4b60 0x5568abb149b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.263+0000 7f751c830740 1 --2- 172.21.15.42:0/127659010 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568ab72e270 0x5568abb13d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.263+0000 7f751c830740 1 --2- 172.21.15.42:0/127659010 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5568ab70d590 0x5568abb13820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.263+0000 7f74f3e00640 0 client.6525 ms_handle_reset on v2:172.21.15.42:6834/4251885944 2024-09-17T01:36:34.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.263+0000 7f751c830740 1 --2- 172.21.15.42:0/127659010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ab7053b0 0x5568abb9fa20 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.263+0000 7f751c830740 1 -- 172.21.15.42:0/127659010 >> 172.21.15.42:0/127659010 conn(0x5568ab7223c0 msgr2=0x5568abad2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:34.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.263+0000 7f751c830740 1 -- 172.21.15.42:0/127659010 shutdown_connections 2024-09-17T01:36:34.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.263+0000 7f751c830740 1 -- 172.21.15.42:0/127659010 wait complete. 2024-09-17T01:36:34.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.263+0000 7f751c830740 20 client.6525 trim_cache size 0 max 16384 2024-09-17T01:36:34.267 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:36:34.267 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "fea1c88c-cb05-432f-a745-f9dcbb5f2503", 2024-09-17T01:36:34.267 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-17T01:36:34.267 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 6492, 2024-09-17T01:36:34.267 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-17T01:36:34.267 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-17T01:36:34.268 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-17T01:36:34.268 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 4.8171124949999999, 2024-09-17T01:36:34.268 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 47, 2024-09-17T01:36:34.268 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 66, 2024-09-17T01:36:34.268 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 66, 2024-09-17T01:36:34.268 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 4.8252869020000002 2024-09-17T01:36:34.268 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:36:34.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.263+0000 7f7515800640 1 -- 172.21.15.42:0/2892287293 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74ec078b90 msgr2=0x7f74ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:34.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.263+0000 7f7515800640 1 --2- 172.21.15.42:0/2892287293 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74ec078b90 0x7f74ec07b0a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7500000f60 tx=0x7f7500009040 comp rx=0 tx=0).stop 2024-09-17T01:36:34.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.263+0000 7f7515800640 1 -- 172.21.15.42:0/2892287293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f751015f480 msgr2=0x7f75101f6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:34.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.263+0000 7f7515800640 1 --2- 172.21.15.42:0/2892287293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f751015f480 0x7f75101f6df0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f750800efc0 tx=0x7f750800c800 comp rx=0 tx=0).stop 2024-09-17T01:36:34.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.264+0000 7f7515800640 1 -- 172.21.15.42:0/2892287293 shutdown_connections 2024-09-17T01:36:34.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.264+0000 7f7515800640 1 --2- 172.21.15.42:0/2892287293 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74ec078b90 0x7f74ec07b0a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.264+0000 7f7515800640 1 --2- 172.21.15.42:0/2892287293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f751015cb80 0x7f7510142430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.264+0000 7f7515800640 1 --2- 172.21.15.42:0/2892287293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f751015f480 0x7f75101f6df0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.264+0000 7f7515800640 1 --2- 172.21.15.42:0/2892287293 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f751006d430 0x7f75101458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.264+0000 7f7515800640 1 -- 172.21.15.42:0/2892287293 >> 172.21.15.42:0/2892287293 conn(0x7f75100b2930 msgr2=0x7f75100ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:34.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.264+0000 7f7515800640 1 -- 172.21.15.42:0/2892287293 shutdown_connections 2024-09-17T01:36:34.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.264+0000 7f7515800640 1 -- 172.21.15.42:0/2892287293 wait complete. 2024-09-17T01:36:34.286 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 100 2024-09-17T01:36:34.451 INFO:tasks.ceph.mds.c.smithi042.stderr:2024-09-17T01:36:34.453+0000 7f2e64200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:36:34.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.521+0000 7f30a1400640 1 -- 172.21.15.42:0/2187238480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f309c06d430 msgr2=0x7f309c06d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:34.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.521+0000 7f30a1400640 1 --2- 172.21.15.42:0/2187238480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f309c06d430 0x7f309c06d840 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f3084009830 tx=0x7f308402a5b0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.521+0000 7f30a1400640 1 -- 172.21.15.42:0/2187238480 shutdown_connections 2024-09-17T01:36:34.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.521+0000 7f30a1400640 1 --2- 172.21.15.42:0/2187238480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f309c06d430 0x7f309c06d840 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.521+0000 7f30a1400640 1 -- 172.21.15.42:0/2187238480 >> 172.21.15.42:0/2187238480 conn(0x7f309c0b2930 msgr2=0x7f309c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:34.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.522+0000 7f30a1400640 1 -- 172.21.15.42:0/2187238480 shutdown_connections 2024-09-17T01:36:34.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.522+0000 7f30a1400640 1 -- 172.21.15.42:0/2187238480 wait complete. 2024-09-17T01:36:34.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.524+0000 7f30a1400640 1 Processor -- start 2024-09-17T01:36:34.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.524+0000 7f30a1400640 1 -- start start 2024-09-17T01:36:34.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.525+0000 7f30a1400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f309c06d430 0x7f309c1503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.525+0000 7f30a1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f309c15cb80 0x7f309c152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.525+0000 7f30a1400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f309c15f480 0x7f309c1f62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.525+0000 7f30a1400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f309c073960 con 0x7f309c15cb80 2024-09-17T01:36:34.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.525+0000 7f30a1400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f309c0737e0 con 0x7f309c06d430 2024-09-17T01:36:34.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.525+0000 7f30a1400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f309c073ae0 con 0x7f309c15f480 2024-09-17T01:36:34.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.526+0000 7f3093e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f309c15cb80 0x7f309c152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.526+0000 7f3093e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f309c15cb80 0x7f309c152f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54870/0 (socket says 172.21.15.42:54870) 2024-09-17T01:36:34.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.526+0000 7f3093e00640 1 -- 172.21.15.42:0/3955066845 learned_addr learned my addr 172.21.15.42:0/3955066845 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:34.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.526+0000 7f309a800640 1 --2- 172.21.15.42:0/3955066845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f309c06d430 0x7f309c1503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.526+0000 7f309b200640 1 --2- 172.21.15.42:0/3955066845 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f309c15f480 0x7f309c1f62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.526+0000 7f3093e00640 1 -- 172.21.15.42:0/3955066845 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f309c15f480 msgr2=0x7f309c1f62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:34.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.526+0000 7f3093e00640 1 --2- 172.21.15.42:0/3955066845 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f309c15f480 0x7f309c1f62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.526+0000 7f3093e00640 1 -- 172.21.15.42:0/3955066845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f309c06d430 msgr2=0x7f309c1503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:34.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.526+0000 7f3093e00640 1 --2- 172.21.15.42:0/3955066845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f309c06d430 0x7f309c1503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.526+0000 7f3093e00640 1 -- 172.21.15.42:0/3955066845 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f309c1f9840 con 0x7f309c15cb80 2024-09-17T01:36:34.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.526+0000 7f3093e00640 1 --2- 172.21.15.42:0/3955066845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f309c15cb80 0x7f309c152f40 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f3084009950 tx=0x7f3084033ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:34.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.527+0000 7f3092a00640 1 -- 172.21.15.42:0/3955066845 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3084031d60 con 0x7f309c15cb80 2024-09-17T01:36:34.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.527+0000 7f3092a00640 1 -- 172.21.15.42:0/3955066845 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3084005020 con 0x7f309c15cb80 2024-09-17T01:36:34.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.527+0000 7f30a1400640 1 -- 172.21.15.42:0/3955066845 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f309c1f9b20 con 0x7f309c15cb80 2024-09-17T01:36:34.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.527+0000 7f3092a00640 1 -- 172.21.15.42:0/3955066845 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3084005470 con 0x7f309c15cb80 2024-09-17T01:36:34.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.527+0000 7f30a1400640 1 -- 172.21.15.42:0/3955066845 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f309c1f5da0 con 0x7f309c15cb80 2024-09-17T01:36:34.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.528+0000 7f30a1400640 1 -- 172.21.15.42:0/3955066845 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f309c1f95b0 con 0x7f309c15cb80 2024-09-17T01:36:34.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.529+0000 7f3092a00640 1 -- 172.21.15.42:0/3955066845 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f30840047a0 con 0x7f309c15cb80 2024-09-17T01:36:34.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.530+0000 7f3092a00640 1 --2- 172.21.15.42:0/3955066845 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3078078bc0 0x7f307807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.531+0000 7f3092a00640 1 -- 172.21.15.42:0/3955066845 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5795+0+0 (secure 0 0 0) 0x7f30840bc180 con 0x7f309c15cb80 2024-09-17T01:36:34.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.531+0000 7f309a800640 1 --2- 172.21.15.42:0/3955066845 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3078078bc0 0x7f307807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.532+0000 7f309a800640 1 --2- 172.21.15.42:0/3955066845 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3078078bc0 0x7f307807b0d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f308c001720 tx=0x7f308c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:34.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.534+0000 7f3092a00640 1 -- 172.21.15.42:0/3955066845 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f308403f030 con 0x7f309c15cb80 2024-09-17T01:36:34.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.728+0000 7f30a1400640 1 -- 172.21.15.42:0/3955066845 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f309c06d840 con 0x7f309c15cb80 2024-09-17T01:36:34.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.732+0000 7f3092a00640 1 -- 172.21.15.42:0/3955066845 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v40)=0 v40) ==== 118+0+0 (secure 0 0 0) 0x7f3084084110 con 0x7f309c15cb80 2024-09-17T01:36:34.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.735+0000 7f30a1400640 1 -- 172.21.15.42:0/3955066845 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3078078bc0 msgr2=0x7f307807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:34.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.735+0000 7f30a1400640 1 --2- 172.21.15.42:0/3955066845 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3078078bc0 0x7f307807b0d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f308c001720 tx=0x7f308c009040 comp rx=0 tx=0).stop 2024-09-17T01:36:34.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.735+0000 7f30a1400640 1 -- 172.21.15.42:0/3955066845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f309c15cb80 msgr2=0x7f309c152f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:34.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.735+0000 7f30a1400640 1 --2- 172.21.15.42:0/3955066845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f309c15cb80 0x7f309c152f40 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f3084009950 tx=0x7f3084033ce0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.735+0000 7f30a1400640 1 -- 172.21.15.42:0/3955066845 shutdown_connections 2024-09-17T01:36:34.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.735+0000 7f30a1400640 1 --2- 172.21.15.42:0/3955066845 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3078078bc0 0x7f307807b0d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.735+0000 7f30a1400640 1 --2- 172.21.15.42:0/3955066845 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f309c15f480 0x7f309c1f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.735+0000 7f30a1400640 1 --2- 172.21.15.42:0/3955066845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f309c15cb80 0x7f309c152f40 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.735+0000 7f30a1400640 1 --2- 172.21.15.42:0/3955066845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f309c06d430 0x7f309c1503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.735+0000 7f30a1400640 1 -- 172.21.15.42:0/3955066845 >> 172.21.15.42:0/3955066845 conn(0x7f309c0b2930 msgr2=0x7f309c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:34.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.735+0000 7f30a1400640 1 -- 172.21.15.42:0/3955066845 shutdown_connections 2024-09-17T01:36:34.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.735+0000 7f30a1400640 1 -- 172.21.15.42:0/3955066845 wait complete. 2024-09-17T01:36:34.759 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 30 2024-09-17T01:36:34.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.992+0000 7fd80c000640 1 -- 172.21.15.42:0/1369068856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8040cec40 msgr2=0x7fd8040cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:34.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.992+0000 7fd80c000640 1 --2- 172.21.15.42:0/1369068856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8040cec40 0x7fd8040cf050 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc005fd0 tx=0x7fd7fc02a820 comp rx=0 tx=0).stop 2024-09-17T01:36:34.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.992+0000 7fd80c000640 1 -- 172.21.15.42:0/1369068856 shutdown_connections 2024-09-17T01:36:34.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.992+0000 7fd80c000640 1 --2- 172.21.15.42:0/1369068856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8040cec40 0x7fd8040cf050 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.992+0000 7fd80c000640 1 --2- 172.21.15.42:0/1369068856 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd8040b3550 0x7fd80415cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.992+0000 7fd80c000640 1 -- 172.21.15.42:0/1369068856 >> 172.21.15.42:0/1369068856 conn(0x7fd8040b2930 msgr2=0x7fd80406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:34.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.993+0000 7fd80c000640 1 -- 172.21.15.42:0/1369068856 shutdown_connections 2024-09-17T01:36:34.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.993+0000 7fd80c000640 1 -- 172.21.15.42:0/1369068856 wait complete. 2024-09-17T01:36:34.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.995+0000 7fd80c000640 1 Processor -- start 2024-09-17T01:36:34.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.995+0000 7fd80c000640 1 -- start start 2024-09-17T01:36:34.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.996+0000 7fd80c000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8040b3550 0x7fd804141a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.996+0000 7fd80c000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8040cec40 0x7fd804141f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.996+0000 7fd80c000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd804142f40 0x7fd80414d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.996+0000 7fd80c000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd80406d7c0 con 0x7fd8040cec40 2024-09-17T01:36:34.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.996+0000 7fd80c000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd80406d640 con 0x7fd8040b3550 2024-09-17T01:36:34.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.996+0000 7fd80c000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd80406d940 con 0x7fd804142f40 2024-09-17T01:36:34.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.997+0000 7fd808c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8040cec40 0x7fd804141f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.997+0000 7fd808c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8040cec40 0x7fd804141f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54894/0 (socket says 172.21.15.42:54894) 2024-09-17T01:36:34.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.997+0000 7fd808c00640 1 -- 172.21.15.42:0/3197629625 learned_addr learned my addr 172.21.15.42:0/3197629625 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:34.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.997+0000 7fd80a000640 1 --2- 172.21.15.42:0/3197629625 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd804142f40 0x7fd80414d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.997+0000 7fd809600640 1 --2- 172.21.15.42:0/3197629625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8040b3550 0x7fd804141a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:34.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.997+0000 7fd808c00640 1 -- 172.21.15.42:0/3197629625 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd804142f40 msgr2=0x7fd80414d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:34.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.997+0000 7fd808c00640 1 --2- 172.21.15.42:0/3197629625 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd804142f40 0x7fd80414d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.997+0000 7fd808c00640 1 -- 172.21.15.42:0/3197629625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8040b3550 msgr2=0x7fd804141a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:34.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.997+0000 7fd808c00640 1 --2- 172.21.15.42:0/3197629625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8040b3550 0x7fd804141a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:34.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.997+0000 7fd808c00640 1 -- 172.21.15.42:0/3197629625 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8040ab4a0 con 0x7fd8040cec40 2024-09-17T01:36:34.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.997+0000 7fd808c00640 1 --2- 172.21.15.42:0/3197629625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8040cec40 0x7fd804141f80 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000c430 tx=0x7fd7f000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:34.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.998+0000 7fd801600640 1 -- 172.21.15.42:0/3197629625 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0011790 con 0x7fd8040cec40 2024-09-17T01:36:34.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.998+0000 7fd801600640 1 -- 172.21.15.42:0/3197629625 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7f0017070 con 0x7fd8040cec40 2024-09-17T01:36:34.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.998+0000 7fd801600640 1 -- 172.21.15.42:0/3197629625 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0011ce0 con 0x7fd8040cec40 2024-09-17T01:36:34.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.998+0000 7fd80c000640 1 -- 172.21.15.42:0/3197629625 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8040aac00 con 0x7fd8040cec40 2024-09-17T01:36:34.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.998+0000 7fd80c000640 1 -- 172.21.15.42:0/3197629625 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8040ab1c0 con 0x7fd8040cec40 2024-09-17T01:36:34.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:34.999+0000 7fd80c000640 1 -- 172.21.15.42:0/3197629625 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8040aa970 con 0x7fd8040cec40 2024-09-17T01:36:34.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.000+0000 7fd801600640 1 -- 172.21.15.42:0/3197629625 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd7f001c460 con 0x7fd8040cec40 2024-09-17T01:36:34.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.001+0000 7fd801600640 1 --2- 172.21.15.42:0/3197629625 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd7e4078b90 0x7fd7e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:34.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.001+0000 7fd801600640 1 -- 172.21.15.42:0/3197629625 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5795+0+0 (secure 0 0 0) 0x7fd7f009ac60 con 0x7fd8040cec40 2024-09-17T01:36:34.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.002+0000 7fd809600640 1 --2- 172.21.15.42:0/3197629625 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd7e4078b90 0x7fd7e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:35.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.002+0000 7fd809600640 1 --2- 172.21.15.42:0/3197629625 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd7e4078b90 0x7fd7e407b0a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8005fd0 tx=0x7fd7f8005850 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:35.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.005+0000 7fd801600640 1 -- 172.21.15.42:0/3197629625 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd7f0062fa0 con 0x7fd8040cec40 2024-09-17T01:36:35.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.201+0000 7fd80c000640 1 -- 172.21.15.42:0/3197629625 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fd80415cec0 con 0x7fd8040cec40 2024-09-17T01:36:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.205+0000 7fd801600640 1 -- 172.21.15.42:0/3197629625 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v41)=0 v41) ==== 117+0+0 (secure 0 0 0) 0x7fd7f00628a0 con 0x7fd8040cec40 2024-09-17T01:36:35.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.208+0000 7fd80c000640 1 -- 172.21.15.42:0/3197629625 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd7e4078b90 msgr2=0x7fd7e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:35.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.208+0000 7fd80c000640 1 --2- 172.21.15.42:0/3197629625 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd7e4078b90 0x7fd7e407b0a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8005fd0 tx=0x7fd7f8005850 comp rx=0 tx=0).stop 2024-09-17T01:36:35.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.208+0000 7fd80c000640 1 -- 172.21.15.42:0/3197629625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8040cec40 msgr2=0x7fd804141f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.208+0000 7fd80c000640 1 --2- 172.21.15.42:0/3197629625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8040cec40 0x7fd804141f80 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000c430 tx=0x7fd7f000c8f0 comp rx=0 tx=0).stop 2024-09-17T01:36:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.208+0000 7fd80c000640 1 -- 172.21.15.42:0/3197629625 shutdown_connections 2024-09-17T01:36:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.208+0000 7fd80c000640 1 --2- 172.21.15.42:0/3197629625 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd7e4078b90 0x7fd7e407b0a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.208+0000 7fd80c000640 1 --2- 172.21.15.42:0/3197629625 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd804142f40 0x7fd80414d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.208+0000 7fd80c000640 1 --2- 172.21.15.42:0/3197629625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8040cec40 0x7fd804141f80 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.208+0000 7fd80c000640 1 --2- 172.21.15.42:0/3197629625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8040b3550 0x7fd804141a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.208+0000 7fd80c000640 1 -- 172.21.15.42:0/3197629625 >> 172.21.15.42:0/3197629625 conn(0x7fd8040b2930 msgr2=0x7fd8040b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.208+0000 7fd80c000640 1 -- 172.21.15.42:0/3197629625 shutdown_connections 2024-09-17T01:36:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.208+0000 7fd80c000640 1 -- 172.21.15.42:0/3197629625 wait complete. 2024-09-17T01:36:35.228 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:36:35.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.459+0000 7f8399200640 1 -- 172.21.15.42:0/3532471830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f839406d430 msgr2=0x7f839406d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:35.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.459+0000 7f8399200640 1 --2- 172.21.15.42:0/3532471830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f839406d430 0x7f839406d840 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f8394070530 tx=0x7f838c02aa50 comp rx=0 tx=0).stop 2024-09-17T01:36:35.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.459+0000 7f8399200640 1 -- 172.21.15.42:0/3532471830 shutdown_connections 2024-09-17T01:36:35.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.459+0000 7f8399200640 1 --2- 172.21.15.42:0/3532471830 >> v2:172.21.15.43:3300/0 conn(0x7f839415cfc0 0x7f83940ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:35.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.459+0000 7f8399200640 1 --2- 172.21.15.42:0/3532471830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f839406d430 0x7f839406d840 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:35.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.459+0000 7f8399200640 1 --2- 172.21.15.42:0/3532471830 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f83940b3880 0x7f83940af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:35.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.459+0000 7f8399200640 1 -- 172.21.15.42:0/3532471830 >> 172.21.15.42:0/3532471830 conn(0x7f83940b2930 msgr2=0x7f839406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:35.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.459+0000 7f8399200640 1 -- 172.21.15.42:0/3532471830 shutdown_connections 2024-09-17T01:36:35.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.459+0000 7f8399200640 1 -- 172.21.15.42:0/3532471830 wait complete. 2024-09-17T01:36:35.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.461+0000 7f8399200640 1 Processor -- start 2024-09-17T01:36:35.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.462+0000 7f8399200640 1 -- start start 2024-09-17T01:36:35.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.463+0000 7f8399200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f839406d430 0x7f8394156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:35.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.463+0000 7f8399200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83940b3880 0x7f8394148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:35.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.463+0000 7f8399200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f839415cfc0 0x7f83941522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:35.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.463+0000 7f8399200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f839415d5e0 con 0x7f83940b3880 2024-09-17T01:36:35.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.463+0000 7f8399200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f83941605b0 con 0x7f839415cfc0 2024-09-17T01:36:35.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.463+0000 7f8399200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f83941f66e0 con 0x7f839406d430 2024-09-17T01:36:35.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.463+0000 7f8391400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83940b3880 0x7f8394148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:35.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.463+0000 7f8391400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83940b3880 0x7f8394148e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54906/0 (socket says 172.21.15.42:54906) 2024-09-17T01:36:35.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.463+0000 7f8391400640 1 -- 172.21.15.42:0/396779342 learned_addr learned my addr 172.21.15.42:0/396779342 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:35.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.464+0000 7f8391e00640 1 --2- 172.21.15.42:0/396779342 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f839406d430 0x7f8394156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:35.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.464+0000 7f8392800640 1 --2- 172.21.15.42:0/396779342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f839415cfc0 0x7f83941522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:35.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.464+0000 7f8391400640 1 -- 172.21.15.42:0/396779342 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f839406d430 msgr2=0x7f8394156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:35.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.464+0000 7f8391400640 1 --2- 172.21.15.42:0/396779342 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f839406d430 0x7f8394156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:35.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.464+0000 7f8391400640 1 -- 172.21.15.42:0/396779342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f839415cfc0 msgr2=0x7f83941522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:35.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.464+0000 7f8391400640 1 --2- 172.21.15.42:0/396779342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f839415cfc0 0x7f83941522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:35.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.464+0000 7f8391400640 1 -- 172.21.15.42:0/396779342 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8394150130 con 0x7f83940b3880 2024-09-17T01:36:35.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.464+0000 7f8391e00640 1 --2- 172.21.15.42:0/396779342 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f839406d430 0x7f8394156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:36:35.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.464+0000 7f8392800640 1 --2- 172.21.15.42:0/396779342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f839415cfc0 0x7f83941522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:36:35.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.464+0000 7f8391400640 1 --2- 172.21.15.42:0/396779342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83940b3880 0x7f8394148e80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f838000e7c0 tx=0x7f838000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:35.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.464+0000 7f838a000640 1 -- 172.21.15.42:0/396779342 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838000ccc0 con 0x7f83940b3880 2024-09-17T01:36:35.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.464+0000 7f838a000640 1 -- 172.21.15.42:0/396779342 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f838000ee70 con 0x7f83940b3880 2024-09-17T01:36:35.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.464+0000 7f838a000640 1 -- 172.21.15.42:0/396779342 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8380010690 con 0x7f83940b3880 2024-09-17T01:36:35.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.464+0000 7f8399200640 1 -- 172.21.15.42:0/396779342 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83940b1e10 con 0x7f83940b3880 2024-09-17T01:36:35.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.465+0000 7f8399200640 1 -- 172.21.15.42:0/396779342 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8394151ae0 con 0x7f83940b3880 2024-09-17T01:36:35.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.466+0000 7f8399200640 1 -- 172.21.15.42:0/396779342 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83940af980 con 0x7f83940b3880 2024-09-17T01:36:35.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.467+0000 7f838a000640 1 -- 172.21.15.42:0/396779342 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8380010830 con 0x7f83940b3880 2024-09-17T01:36:35.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.468+0000 7f838a000640 1 --2- 172.21.15.42:0/396779342 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8374078b90 0x7f837407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:35.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.468+0000 7f838a000640 1 -- 172.21.15.42:0/396779342 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5795+0+0 (secure 0 0 0) 0x7f838009b770 con 0x7f83940b3880 2024-09-17T01:36:35.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.468+0000 7f8391e00640 1 --2- 172.21.15.42:0/396779342 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8374078b90 0x7f837407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:35.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.469+0000 7f8391e00640 1 --2- 172.21.15.42:0/396779342 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8374078b90 0x7f837407b0a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8384009b80 tx=0x7f8384005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:35.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.473+0000 7f838a000640 1 -- 172.21.15.42:0/396779342 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8380063b40 con 0x7f83940b3880 2024-09-17T01:36:35.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.706+0000 7f8399200640 1 -- 172.21.15.42:0/396779342 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83940b1ba0 con 0x7f83940b3880 2024-09-17T01:36:35.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.706+0000 7f838a000640 1 -- 172.21.15.42:0/396779342 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5221 (secure 0 0 0) 0x7f8380063440 con 0x7f83940b3880 2024-09-17T01:36:35.705 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:35.705 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":47,"btime":"2024-09-17T01:36:32:454373+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2214729520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2214729520},{"type":"v1","addr":"172.21.15.43:6835","nonce":2214729520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/983475498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":983475498},{"type":"v1","addr":"172.21.15.43:6837","nonce":983475498}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1213307380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1213307380},{"type":"v1","addr":"172.21.15.42:6833","nonce":1213307380}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:36:10.790086+0000","modified":"2024-09-17T01:36:32.454363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":66,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6492":{"gid":6492,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6835/4251885944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":4251885944},{"type":"v1","addr":"172.21.15.42:6835","nonce":4251885944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6492,"qdb_cluster":[6492]},"id":4}]} 2024-09-17T01:36:35.705 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 47 2024-09-17T01:36:35.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.709+0000 7f8399200640 1 -- 172.21.15.42:0/396779342 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8374078b90 msgr2=0x7f837407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:35.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.709+0000 7f8399200640 1 --2- 172.21.15.42:0/396779342 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8374078b90 0x7f837407b0a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8384009b80 tx=0x7f8384005f90 comp rx=0 tx=0).stop 2024-09-17T01:36:35.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.709+0000 7f8399200640 1 -- 172.21.15.42:0/396779342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83940b3880 msgr2=0x7f8394148e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:35.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.709+0000 7f8399200640 1 --2- 172.21.15.42:0/396779342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83940b3880 0x7f8394148e80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f838000e7c0 tx=0x7f838000ec80 comp rx=0 tx=0).stop 2024-09-17T01:36:35.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.709+0000 7f8399200640 1 -- 172.21.15.42:0/396779342 shutdown_connections 2024-09-17T01:36:35.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.709+0000 7f8399200640 1 --2- 172.21.15.42:0/396779342 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8374078b90 0x7f837407b0a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:35.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.709+0000 7f8399200640 1 --2- 172.21.15.42:0/396779342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f839415cfc0 0x7f83941522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:35.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.709+0000 7f8399200640 1 --2- 172.21.15.42:0/396779342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83940b3880 0x7f8394148e80 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:35.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.709+0000 7f8399200640 1 --2- 172.21.15.42:0/396779342 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f839406d430 0x7f8394156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:35.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.709+0000 7f8399200640 1 -- 172.21.15.42:0/396779342 >> 172.21.15.42:0/396779342 conn(0x7f83940b2930 msgr2=0x7f839415fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:35.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.709+0000 7f8399200640 1 -- 172.21.15.42:0/396779342 shutdown_connections 2024-09-17T01:36:35.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:35.709+0000 7f8399200640 1 -- 172.21.15.42:0/396779342 wait complete. 2024-09-17T01:36:35.730 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-09-17T01:36:35.974 INFO:teuthology.orchestra.run.smithi042.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-17T01:36:27.340446+0000","btime":"2024-09-17T01:36:26.146456+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-17T01:36:27.340446+0000","atime":"2024-09-17T01:36:26.146456+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-17T01:36:27.340446+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-17T01:36:27.341446+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-17T01:36:27.341446+0000"},"version":244,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{},"nref":0,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-17T01:36:35.975 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-17T01:36:27.341446+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-17T01:36:26.146456+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-17T01:36:26.146456+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-17T01:36:27.340446+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-17T01:36:27.340446+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-17T01:36:27.340446+0000", "nestlock": {}, "nlink": 1, "nref": 0, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": {}, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-17T01:36:27.341446+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 244, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-17T01:36:35.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:36:35.975 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start /testdir recursive 2024-09-17T01:36:36.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.209+0000 7f0da4600640 1 -- 172.21.15.42:0/1987813123 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0d9c0b56d0 msgr2=0x7f0d9c0b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:36.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.209+0000 7f0da4600640 1 --2- 172.21.15.42:0/1987813123 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0d9c0b56d0 0x7f0d9c0b46f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0d90009860 tx=0x7f0d9002a5a0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.209+0000 7f0da4600640 1 -- 172.21.15.42:0/1987813123 shutdown_connections 2024-09-17T01:36:36.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.209+0000 7f0da4600640 1 --2- 172.21.15.42:0/1987813123 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0d9c0b56d0 0x7f0d9c0b46f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.209+0000 7f0da4600640 1 -- 172.21.15.42:0/1987813123 >> 172.21.15.42:0/1987813123 conn(0x7f0d9c0b28f0 msgr2=0x7f0d9c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:36.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.209+0000 7f0da4600640 1 -- 172.21.15.42:0/1987813123 shutdown_connections 2024-09-17T01:36:36.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.209+0000 7f0da4600640 1 -- 172.21.15.42:0/1987813123 wait complete. 2024-09-17T01:36:36.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.211+0000 7f0da4600640 1 Processor -- start 2024-09-17T01:36:36.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.211+0000 7f0da4600640 1 -- start start 2024-09-17T01:36:36.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.213+0000 7f0da4600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d9c0b56d0 0x7f0d9c0b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:36.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.213+0000 7f0da4600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d9c0cdb20 0x7f0d9c0b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:36.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.213+0000 7f0da4600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0d9c0cba50 0x7f0d9c138f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:36.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.213+0000 7f0da4600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c15dd80 con 0x7f0d9c0b56d0 2024-09-17T01:36:36.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.213+0000 7f0da4600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c15dc00 con 0x7f0d9c0cdb20 2024-09-17T01:36:36.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.213+0000 7f0da4600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0d9c0cdf30 con 0x7f0d9c0cba50 2024-09-17T01:36:36.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.213+0000 7f0da1c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d9c0b56d0 0x7f0d9c0b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:36.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.213+0000 7f0da1c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d9c0b56d0 0x7f0d9c0b1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48882/0 (socket says 172.21.15.42:48882) 2024-09-17T01:36:36.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.213+0000 7f0da1c00640 1 -- 172.21.15.42:0/4152912073 learned_addr learned my addr 172.21.15.42:0/4152912073 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:36.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.213+0000 7f0da1200640 1 --2- 172.21.15.42:0/4152912073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d9c0cdb20 0x7f0d9c0b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:36.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.213+0000 7f0da2600640 1 --2- 172.21.15.42:0/4152912073 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0d9c0cba50 0x7f0d9c138f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:36.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.213+0000 7f0da1c00640 1 -- 172.21.15.42:0/4152912073 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0d9c0cba50 msgr2=0x7f0d9c138f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:36.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.213+0000 7f0da1c00640 1 --2- 172.21.15.42:0/4152912073 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0d9c0cba50 0x7f0d9c138f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.213+0000 7f0da1c00640 1 -- 172.21.15.42:0/4152912073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d9c0cdb20 msgr2=0x7f0d9c0b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:36.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.213+0000 7f0da1c00640 1 --2- 172.21.15.42:0/4152912073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d9c0cdb20 0x7f0d9c0b18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.213+0000 7f0da1c00640 1 -- 172.21.15.42:0/4152912073 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9c0cc4a0 con 0x7f0d9c0b56d0 2024-09-17T01:36:36.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.214+0000 7f0da1200640 1 --2- 172.21.15.42:0/4152912073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d9c0cdb20 0x7f0d9c0b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:36:36.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.214+0000 7f0da1c00640 1 --2- 172.21.15.42:0/4152912073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d9c0b56d0 0x7f0d9c0b1370 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0d9002ab90 tx=0x7f0d90033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:36.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.214+0000 7f0d99600640 1 -- 172.21.15.42:0/4152912073 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d90005c90 con 0x7f0d9c0b56d0 2024-09-17T01:36:36.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.214+0000 7f0d99600640 1 -- 172.21.15.42:0/4152912073 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d90031e50 con 0x7f0d9c0b56d0 2024-09-17T01:36:36.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.214+0000 7f0da4600640 1 -- 172.21.15.42:0/4152912073 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9c0cc1c0 con 0x7f0d9c0b56d0 2024-09-17T01:36:36.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.214+0000 7f0d99600640 1 -- 172.21.15.42:0/4152912073 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d90005260 con 0x7f0d9c0b56d0 2024-09-17T01:36:36.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.214+0000 7f0da4600640 1 -- 172.21.15.42:0/4152912073 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d9c137240 con 0x7f0d9c0b56d0 2024-09-17T01:36:36.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.217+0000 7f0d99600640 1 -- 172.21.15.42:0/4152912073 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0d90005400 con 0x7f0d9c0b56d0 2024-09-17T01:36:36.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.218+0000 7f0d99600640 1 --2- 172.21.15.42:0/4152912073 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0d7c078b90 0x7f0d7c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:36.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.218+0000 7f0d99600640 1 -- 172.21.15.42:0/4152912073 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5795+0+0 (secure 0 0 0) 0x7f0d900bbd00 con 0x7f0d9c0b56d0 2024-09-17T01:36:36.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.218+0000 7f0da1200640 1 --2- 172.21.15.42:0/4152912073 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0d7c078b90 0x7f0d7c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:36.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.218+0000 7f0dab7db740 1 Processor -- start 2024-09-17T01:36:36.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.219+0000 7f0dab7db740 1 -- start start 2024-09-17T01:36:36.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.219+0000 7f0da1200640 1 --2- 172.21.15.42:0/4152912073 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0d7c078b90 0x7f0d7c07b0a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c076a30 tx=0x7f0d88009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:36.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.220+0000 7f0dab7db740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56218db695b0 0x56218df559a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:36.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.220+0000 7f0dab7db740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db406f0 0x56218df2a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:36.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.220+0000 7f0dab7db740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56218db488d0 0x56218df2ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:36.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.220+0000 7f0dab7db740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56218de83970 con 0x56218db406f0 2024-09-17T01:36:36.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.220+0000 7f0dab7db740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56218de72da0 con 0x56218db488d0 2024-09-17T01:36:36.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.220+0000 7f0dab7db740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56218de76bb0 con 0x56218db695b0 2024-09-17T01:36:36.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.220+0000 7f0da1200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db406f0 0x56218df2a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:36.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.220+0000 7f0da1200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db406f0 0x56218df2a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48896/0 (socket says 172.21.15.42:48896) 2024-09-17T01:36:36.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.220+0000 7f0da1200640 1 -- 172.21.15.42:0/3153984176 learned_addr learned my addr 172.21.15.42:0/3153984176 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:36.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.221+0000 7f0da1c00640 1 --2- 172.21.15.42:0/3153984176 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56218db695b0 0x56218df559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:36.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.221+0000 7f0da2600640 1 --2- 172.21.15.42:0/3153984176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56218db488d0 0x56218df2ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:36.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.221+0000 7f0da1200640 1 -- 172.21.15.42:0/3153984176 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56218db695b0 msgr2=0x56218df559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:36.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.221+0000 7f0da1200640 1 --2- 172.21.15.42:0/3153984176 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56218db695b0 0x56218df559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.221+0000 7f0da1200640 1 -- 172.21.15.42:0/3153984176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56218db488d0 msgr2=0x56218df2ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:36.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.221+0000 7f0da1200640 1 --2- 172.21.15.42:0/3153984176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56218db488d0 0x56218df2ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.221+0000 7f0da1200640 1 -- 172.21.15.42:0/3153984176 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56218dc4da20 con 0x56218db406f0 2024-09-17T01:36:36.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.221+0000 7f0da1c00640 1 --2- 172.21.15.42:0/3153984176 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56218db695b0 0x56218df559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:36:36.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.221+0000 7f0da2600640 1 --2- 172.21.15.42:0/3153984176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56218db488d0 0x56218df2ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:36:36.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.221+0000 7f0da1200640 1 --2- 172.21.15.42:0/3153984176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db406f0 0x56218df2a7f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0d88001e30 tx=0x7f0d88011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca569b54ce8883f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:36.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.221+0000 7f0d8e000640 1 -- 172.21.15.42:0/3153984176 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d880035f0 con 0x56218db406f0 2024-09-17T01:36:36.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.221+0000 7f0d8e000640 1 -- 172.21.15.42:0/3153984176 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d88003880 con 0x56218db406f0 2024-09-17T01:36:36.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.221+0000 7f0d8e000640 1 -- 172.21.15.42:0/3153984176 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d88003c70 con 0x56218db406f0 2024-09-17T01:36:36.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.222+0000 7f0dab7db740 1 -- 172.21.15.42:0/3153984176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db406f0 msgr2=0x56218df2a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:36.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.222+0000 7f0dab7db740 1 --2- 172.21.15.42:0/3153984176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db406f0 0x56218df2a7f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0d88001e30 tx=0x7f0d88011000 comp rx=0 tx=0).stop 2024-09-17T01:36:36.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.222+0000 7f0dab7db740 1 -- 172.21.15.42:0/3153984176 shutdown_connections 2024-09-17T01:36:36.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.222+0000 7f0dab7db740 1 --2- 172.21.15.42:0/3153984176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56218db488d0 0x56218df2ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.222+0000 7f0dab7db740 1 --2- 172.21.15.42:0/3153984176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db406f0 0x56218df2a7f0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.222+0000 7f0dab7db740 1 --2- 172.21.15.42:0/3153984176 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56218db695b0 0x56218df559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.222+0000 7f0dab7db740 1 -- 172.21.15.42:0/3153984176 >> 172.21.15.42:0/3153984176 conn(0x56218db5d700 msgr2=0x56218df10c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:36.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.222+0000 7f0dab7db740 1 -- 172.21.15.42:0/3153984176 shutdown_connections 2024-09-17T01:36:36.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.222+0000 7f0dab7db740 1 -- 172.21.15.42:0/3153984176 wait complete. 2024-09-17T01:36:36.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.223+0000 7f0dab7db740 1 -- start start 2024-09-17T01:36:36.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.223+0000 7f0dab7db740 1 Processor -- start 2024-09-17T01:36:36.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.225+0000 7f0dab7db740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56218db406f0 0x56218df68360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:36.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.225+0000 7f0dab7db740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56218db488d0 0x56218df688a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:36.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.225+0000 7f0dab7db740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db695b0 0x56218df51bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:36.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.225+0000 7f0dab7db740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56218dbe3960 con 0x56218db695b0 2024-09-17T01:36:36.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.225+0000 7f0dab7db740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56218de18780 con 0x56218db406f0 2024-09-17T01:36:36.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.225+0000 7f0dab7db740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56218df4c3a0 con 0x56218db488d0 2024-09-17T01:36:36.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.225+0000 7f0dab7db740 10 client.0 _ll_register_callbacks cb 0x56218de6f4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:36:36.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.225+0000 7f0da2600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db695b0 0x56218df51bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:36.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.225+0000 7f0da2600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db695b0 0x56218df51bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48904/0 (socket says 172.21.15.42:48904) 2024-09-17T01:36:36.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.225+0000 7f0da2600640 1 -- 172.21.15.42:0/2609792071 learned_addr learned my addr 172.21.15.42:0/2609792071 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:36.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.225+0000 7f0da1200640 1 --2- 172.21.15.42:0/2609792071 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56218db488d0 0x56218df688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:36.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.225+0000 7f0da1c00640 1 --2- 172.21.15.42:0/2609792071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56218db406f0 0x56218df68360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:36.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.226+0000 7f0da2600640 1 -- 172.21.15.42:0/2609792071 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56218db488d0 msgr2=0x56218df688a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:36.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.226+0000 7f0da2600640 1 --2- 172.21.15.42:0/2609792071 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56218db488d0 0x56218df688a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.226+0000 7f0da2600640 1 -- 172.21.15.42:0/2609792071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56218db406f0 msgr2=0x56218df68360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:36.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.226+0000 7f0da2600640 1 --2- 172.21.15.42:0/2609792071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56218db406f0 0x56218df68360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.226+0000 7f0da2600640 1 -- 172.21.15.42:0/2609792071 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56218dbb28c0 con 0x56218db695b0 2024-09-17T01:36:36.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.226+0000 7f0da2600640 1 --2- 172.21.15.42:0/2609792071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db695b0 0x56218df51bf0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0d94010a30 tx=0x7f0d94010ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0e265319b69cba server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:36.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.226+0000 7f0d82a00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:36:36.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.226+0000 7f0d82a00640 1 -- 172.21.15.42:0/2609792071 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9401a030 con 0x56218db695b0 2024-09-17T01:36:36.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.226+0000 7f0d82a00640 1 -- 172.21.15.42:0/2609792071 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 5795+0+0 (secure 0 0 0) 0x7f0d94004a40 con 0x56218db695b0 2024-09-17T01:36:36.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.226+0000 7f0dab7db740 1 -- 172.21.15.42:0/2609792071 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d88003880 con 0x56218db695b0 2024-09-17T01:36:36.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.227+0000 7f0d82a00640 1 -- 172.21.15.42:0/2609792071 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f0d94023050 con 0x56218db695b0 2024-09-17T01:36:36.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.227+0000 7f0dab7db740 10 client.6561 fetch_fsmap learned FSMap version 47 2024-09-17T01:36:36.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.227+0000 7f0dab7db740 1 -- 172.21.15.42:0/2609792071 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) -- 0x56218dcae1b0 con 0x56218db695b0 2024-09-17T01:36:36.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.227+0000 7f0d82a00640 1 -- 172.21.15.42:0/2609792071 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d88003880 con 0x56218db695b0 2024-09-17T01:36:36.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.227+0000 7f0d82a00640 1 -- 172.21.15.42:0/2609792071 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 47) ==== 3502+0+0 (secure 0 0 0) 0x7f0d94026020 con 0x56218db695b0 2024-09-17T01:36:36.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.227+0000 7f0dab7db740 10 client.6561 fetch_fsmap finished waiting for FSMap version 47 2024-09-17T01:36:36.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.227+0000 7f0dab7db740 10 client.6561 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T01:36:36.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.227+0000 7f0dab7db740 20 client.6561 populate_metadata read hostname 'smithi042' 2024-09-17T01:36:36.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.227+0000 7f0dab7db740 1 --2- 172.21.15.42:0/2609792071 >> [v2:172.21.15.42:6834/4251885944,v1:172.21.15.42:6835/4251885944] conn(0x56218db28180 0x56218df52600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:36.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.227+0000 7f0dab7db740 4 client.6561 mds_command: new command op to 6492 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:36:36.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.227+0000 7f0dab7db740 1 -- 172.21.15.42:0/2609792071 --> [v2:172.21.15.42:6834/4251885944,v1:172.21.15.42:6835/4251885944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56218de858c0 con 0x56218db28180 2024-09-17T01:36:36.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.228+0000 7f0da1c00640 1 --2- 172.21.15.42:0/2609792071 >> [v2:172.21.15.42:6834/4251885944,v1:172.21.15.42:6835/4251885944] conn(0x56218db28180 0x56218df52600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:36.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.228+0000 7f0d82a00640 10 client.6561 ms_handle_connect on v2:172.21.15.42:6834/4251885944 2024-09-17T01:36:36.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.228+0000 7f0da1c00640 1 --2- 172.21.15.42:0/2609792071 >> [v2:172.21.15.42:6834/4251885944,v1:172.21.15.42:6835/4251885944] conn(0x56218db28180 0x56218df52600 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5620d5ddb32628a server_cookie=119a935f30188a2b in_seq=0 out_seq=0 2024-09-17T01:36:36.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.229+0000 7f0d82a00640 1 -- 172.21.15.42:0/2609792071 <== mds.0 v2:172.21.15.42:6834/4251885944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56218de858c0 con 0x56218db28180 2024-09-17T01:36:36.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.229+0000 7f0d82a00640 10 client.6561 handle_command_reply: tid=0 2024-09-17T01:36:36.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.229+0000 7f0dab7db740 1 client.6561 shutdown 2024-09-17T01:36:36.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.229+0000 7f0dab7db740 1 -- 172.21.15.42:0/2609792071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db695b0 msgr2=0x56218df51bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:36.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.229+0000 7f0dab7db740 1 --2- 172.21.15.42:0/2609792071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db695b0 0x56218df51bf0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0d94010a30 tx=0x7f0d94010ef0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.229+0000 7f0dab7db740 1 -- 172.21.15.42:0/2609792071 shutdown_connections 2024-09-17T01:36:36.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.229+0000 7f0dab7db740 1 --2- 172.21.15.42:0/2609792071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db695b0 0x56218df51bf0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.229+0000 7f0dab7db740 1 --2- 172.21.15.42:0/2609792071 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56218db488d0 0x56218df688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.229+0000 7f0dab7db740 1 --2- 172.21.15.42:0/2609792071 >> [v2:172.21.15.42:6834/4251885944,v1:172.21.15.42:6835/4251885944] conn(0x56218db28180 0x56218df52600 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.229+0000 7f0dab7db740 1 --2- 172.21.15.42:0/2609792071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56218db406f0 0x56218df68360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.229+0000 7f0dab7db740 1 -- 172.21.15.42:0/2609792071 >> 172.21.15.42:0/2609792071 conn(0x56218db5d700 msgr2=0x56218df559a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:36.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.229+0000 7f0d82a00640 0 client.6561 ms_handle_reset on v2:172.21.15.42:6834/4251885944 2024-09-17T01:36:36.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.229+0000 7f0dab7db740 1 -- 172.21.15.42:0/2609792071 shutdown_connections 2024-09-17T01:36:36.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.229+0000 7f0dab7db740 1 -- 172.21.15.42:0/2609792071 wait complete. 2024-09-17T01:36:36.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.229+0000 7f0dab7db740 20 client.6561 trim_cache size 0 max 16384 2024-09-17T01:36:36.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.248+0000 7f0dab7db740 1 Processor -- start 2024-09-17T01:36:36.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.248+0000 7f0dab7db740 1 -- start start 2024-09-17T01:36:36.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.250+0000 7f0dab7db740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56218db406f0 0x56218dfcc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:36.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.250+0000 7f0dab7db740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56218db488d0 0x56218df0b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:36.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.250+0000 7f0dab7db740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db695b0 0x56218df0bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:36.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.250+0000 7f0dab7db740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c2024a0 con 0x56218db695b0 2024-09-17T01:36:36.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.250+0000 7f0dab7db740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c2014c0 con 0x56218db488d0 2024-09-17T01:36:36.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.250+0000 7f0dab7db740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0d9c200980 con 0x56218db406f0 2024-09-17T01:36:36.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.250+0000 7f0da2600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db695b0 0x56218df0bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:36.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.250+0000 7f0da2600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db695b0 0x56218df0bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48912/0 (socket says 172.21.15.42:48912) 2024-09-17T01:36:36.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.250+0000 7f0da2600640 1 -- 172.21.15.42:0/1922739253 learned_addr learned my addr 172.21.15.42:0/1922739253 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:36.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.250+0000 7f0da1200640 1 --2- 172.21.15.42:0/1922739253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56218db488d0 0x56218df0b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:36.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.250+0000 7f0da1c00640 1 --2- 172.21.15.42:0/1922739253 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56218db406f0 0x56218dfcc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:36.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.250+0000 7f0da2600640 1 -- 172.21.15.42:0/1922739253 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56218db406f0 msgr2=0x56218dfcc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:36.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.250+0000 7f0da2600640 1 --2- 172.21.15.42:0/1922739253 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56218db406f0 0x56218dfcc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.250+0000 7f0da2600640 1 -- 172.21.15.42:0/1922739253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56218db488d0 msgr2=0x56218df0b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:36.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.250+0000 7f0da2600640 1 --2- 172.21.15.42:0/1922739253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56218db488d0 0x56218df0b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.250+0000 7f0da2600640 1 -- 172.21.15.42:0/1922739253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56218dc4bd20 con 0x56218db695b0 2024-09-17T01:36:36.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.250+0000 7f0da2600640 1 --2- 172.21.15.42:0/1922739253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db695b0 0x56218df0bef0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0d94002180 tx=0x7f0d940106a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58eea1d451cbe6bf server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:36.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.251+0000 7f0d8d600640 1 -- 172.21.15.42:0/1922739253 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9401a070 con 0x56218db695b0 2024-09-17T01:36:36.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.251+0000 7f0d8d600640 1 -- 172.21.15.42:0/1922739253 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d9401b040 con 0x56218db695b0 2024-09-17T01:36:36.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.251+0000 7f0d8d600640 1 -- 172.21.15.42:0/1922739253 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94003bd0 con 0x56218db695b0 2024-09-17T01:36:36.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.252+0000 7f0dab7db740 1 -- 172.21.15.42:0/1922739253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db695b0 msgr2=0x56218df0bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:36.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.252+0000 7f0dab7db740 1 --2- 172.21.15.42:0/1922739253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db695b0 0x56218df0bef0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0d94002180 tx=0x7f0d940106a0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.252+0000 7f0dab7db740 1 -- 172.21.15.42:0/1922739253 shutdown_connections 2024-09-17T01:36:36.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.252+0000 7f0dab7db740 1 --2- 172.21.15.42:0/1922739253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56218db488d0 0x56218df0b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.252+0000 7f0dab7db740 1 --2- 172.21.15.42:0/1922739253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db695b0 0x56218df0bef0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.252+0000 7f0dab7db740 1 --2- 172.21.15.42:0/1922739253 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56218db406f0 0x56218dfcc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.252+0000 7f0dab7db740 1 -- 172.21.15.42:0/1922739253 >> 172.21.15.42:0/1922739253 conn(0x56218db5d700 msgr2=0x56218df2c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:36.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.252+0000 7f0dab7db740 1 -- 172.21.15.42:0/1922739253 shutdown_connections 2024-09-17T01:36:36.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.252+0000 7f0dab7db740 1 -- 172.21.15.42:0/1922739253 wait complete. 2024-09-17T01:36:36.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.253+0000 7f0dab7db740 1 -- start start 2024-09-17T01:36:36.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.253+0000 7f0dab7db740 1 Processor -- start 2024-09-17T01:36:36.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.254+0000 7f0dab7db740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56218db406f0 0x56218dfc8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:36.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.254+0000 7f0dab7db740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56218db488d0 0x56218df0b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:36.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.254+0000 7f0dab7db740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db695b0 0x56218df0bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:36.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.254+0000 7f0dab7db740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56218df29d20 con 0x56218db695b0 2024-09-17T01:36:36.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.254+0000 7f0dab7db740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c200ea0 con 0x56218db406f0 2024-09-17T01:36:36.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.254+0000 7f0dab7db740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56218ddf8740 con 0x56218db488d0 2024-09-17T01:36:36.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.254+0000 7f0dab7db740 10 client.0 _ll_register_callbacks cb 0x7f0d94001cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:36:36.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.255+0000 7f0da2600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db695b0 0x56218df0bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:36.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.255+0000 7f0da1c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56218db406f0 0x56218dfc8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:36.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.255+0000 7f0da1c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56218db406f0 0x56218dfc8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:52038/0 (socket says 172.21.15.42:52038) 2024-09-17T01:36:36.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.255+0000 7f0da1200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56218db488d0 0x56218df0b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:36.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.255+0000 7f0da1c00640 1 -- 172.21.15.42:0/390043163 learned_addr learned my addr 172.21.15.42:0/390043163 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:36.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.255+0000 7f0da2600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db695b0 0x56218df0bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48920/0 (socket says 172.21.15.42:48920) 2024-09-17T01:36:36.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.255+0000 7f0da2600640 1 -- 172.21.15.42:0/390043163 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56218db488d0 msgr2=0x56218df0b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:36.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.255+0000 7f0da2600640 1 --2- 172.21.15.42:0/390043163 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56218db488d0 0x56218df0b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.255+0000 7f0da2600640 1 -- 172.21.15.42:0/390043163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56218db406f0 msgr2=0x56218dfc8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:36:36.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.255+0000 7f0da2600640 1 --2- 172.21.15.42:0/390043163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56218db406f0 0x56218dfc8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.255+0000 7f0da2600640 1 -- 172.21.15.42:0/390043163 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56218dfcb1a0 con 0x56218db695b0 2024-09-17T01:36:36.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.255+0000 7f0da1c00640 1 --2- 172.21.15.42:0/390043163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56218db406f0 0x56218dfc8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:36:36.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.255+0000 7f0da2600640 1 --2- 172.21.15.42:0/390043163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db695b0 0x56218df0bef0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f0d94026000 tx=0x7f0d9400fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84bf0f27a3fdeba0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:36.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.255+0000 7f0d82a00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:36:36.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.256+0000 7f0d82a00640 1 -- 172.21.15.42:0/390043163 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94033070 con 0x56218db695b0 2024-09-17T01:36:36.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.256+0000 7f0d82a00640 1 -- 172.21.15.42:0/390043163 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 5795+0+0 (secure 0 0 0) 0x7f0d94003e00 con 0x56218db695b0 2024-09-17T01:36:36.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.256+0000 7f0dab7db740 1 -- 172.21.15.42:0/390043163 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56218df2c120 con 0x56218db695b0 2024-09-17T01:36:36.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.256+0000 7f0d82a00640 1 -- 172.21.15.42:0/390043163 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f0d9401a040 con 0x56218db695b0 2024-09-17T01:36:36.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.256+0000 7f0dab7db740 10 client.6567 fetch_fsmap learned FSMap version 47 2024-09-17T01:36:36.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.256+0000 7f0dab7db740 1 -- 172.21.15.42:0/390043163 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) -- 0x56218dfc9190 con 0x56218db695b0 2024-09-17T01:36:36.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.256+0000 7f0d82a00640 1 -- 172.21.15.42:0/390043163 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56218df2c120 con 0x56218db695b0 2024-09-17T01:36:36.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.257+0000 7f0d82a00640 1 -- 172.21.15.42:0/390043163 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 47) ==== 3502+0+0 (secure 0 0 0) 0x7f0d94041020 con 0x56218db695b0 2024-09-17T01:36:36.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.257+0000 7f0dab7db740 10 client.6567 fetch_fsmap finished waiting for FSMap version 47 2024-09-17T01:36:36.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.257+0000 7f0dab7db740 10 client.6567 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T01:36:36.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.257+0000 7f0dab7db740 20 client.6567 populate_metadata read hostname 'smithi042' 2024-09-17T01:36:36.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.257+0000 7f0dab7db740 1 --2- 172.21.15.42:0/390043163 >> [v2:172.21.15.42:6834/4251885944,v1:172.21.15.42:6835/4251885944] conn(0x56218dfc8c40 0x56218df4fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:36.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.257+0000 7f0dab7db740 4 client.6567 mds_command: new command op to 6492 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}] 2024-09-17T01:36:36.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.257+0000 7f0dab7db740 1 -- 172.21.15.42:0/390043163 --> [v2:172.21.15.42:6834/4251885944,v1:172.21.15.42:6835/4251885944] -- command(tid 0: {"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}) -- 0x56218df4d3d0 con 0x56218dfc8c40 2024-09-17T01:36:36.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.257+0000 7f0da1c00640 1 --2- 172.21.15.42:0/390043163 >> [v2:172.21.15.42:6834/4251885944,v1:172.21.15.42:6835/4251885944] conn(0x56218dfc8c40 0x56218df4fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:36.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.257+0000 7f0da1c00640 1 --2- 172.21.15.42:0/390043163 >> [v2:172.21.15.42:6834/4251885944,v1:172.21.15.42:6835/4251885944] conn(0x56218dfc8c40 0x56218df4fee0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70ba3967e1395e2 server_cookie=3d9cc73e0947146b in_seq=0 out_seq=0 2024-09-17T01:36:36.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.257+0000 7f0d82a00640 10 client.6567 ms_handle_connect on v2:172.21.15.42:6834/4251885944 2024-09-17T01:36:36.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.258+0000 7f0d82a00640 1 -- 172.21.15.42:0/390043163 <== mds.0 v2:172.21.15.42:6834/4251885944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56218df4d3d0 con 0x56218dfc8c40 2024-09-17T01:36:36.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.258+0000 7f0d82a00640 10 client.6567 handle_command_reply: tid=0 2024-09-17T01:36:36.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.258+0000 7f0dab7db740 1 client.6567 shutdown 2024-09-17T01:36:36.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.258+0000 7f0dab7db740 1 -- 172.21.15.42:0/390043163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db695b0 msgr2=0x56218df0bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:36.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.258+0000 7f0dab7db740 1 --2- 172.21.15.42:0/390043163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db695b0 0x56218df0bef0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f0d94026000 tx=0x7f0d9400fb10 comp rx=0 tx=0).stop 2024-09-17T01:36:36.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.258+0000 7f0dab7db740 1 -- 172.21.15.42:0/390043163 shutdown_connections 2024-09-17T01:36:36.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.258+0000 7f0dab7db740 1 --2- 172.21.15.42:0/390043163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56218db695b0 0x56218df0bef0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.258+0000 7f0dab7db740 1 --2- 172.21.15.42:0/390043163 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56218db488d0 0x56218df0b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.258+0000 7f0dab7db740 1 --2- 172.21.15.42:0/390043163 >> [v2:172.21.15.42:6834/4251885944,v1:172.21.15.42:6835/4251885944] conn(0x56218dfc8c40 0x56218df4fee0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.258+0000 7f0dab7db740 1 --2- 172.21.15.42:0/390043163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56218db406f0 0x56218dfc8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.258+0000 7f0dab7db740 1 -- 172.21.15.42:0/390043163 >> 172.21.15.42:0/390043163 conn(0x56218db5d700 msgr2=0x56218df10d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:36.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.259+0000 7f0d82a00640 0 client.6567 ms_handle_reset on v2:172.21.15.42:6834/4251885944 2024-09-17T01:36:36.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.259+0000 7f0dab7db740 1 -- 172.21.15.42:0/390043163 shutdown_connections 2024-09-17T01:36:36.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.259+0000 7f0dab7db740 1 -- 172.21.15.42:0/390043163 wait complete. 2024-09-17T01:36:36.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.259+0000 7f0dab7db740 20 client.6567 trim_cache size 0 max 16384 2024-09-17T01:36:36.260 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:36:36.260 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-17T01:36:36.260 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "9dc0117c-146f-458b-bb85-2f1958e587db", 2024-09-17T01:36:36.260 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-17T01:36:36.260 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:36:36.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.260+0000 7f0da4600640 1 -- 172.21.15.42:0/4152912073 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0d7c078b90 msgr2=0x7f0d7c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:36.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.260+0000 7f0da4600640 1 --2- 172.21.15.42:0/4152912073 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0d7c078b90 0x7f0d7c07b0a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c076a30 tx=0x7f0d88009040 comp rx=0 tx=0).stop 2024-09-17T01:36:36.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.260+0000 7f0da4600640 1 -- 172.21.15.42:0/4152912073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d9c0b56d0 msgr2=0x7f0d9c0b1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:36.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.260+0000 7f0da4600640 1 --2- 172.21.15.42:0/4152912073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d9c0b56d0 0x7f0d9c0b1370 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0d9002ab90 tx=0x7f0d90033c20 comp rx=0 tx=0).stop 2024-09-17T01:36:36.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.260+0000 7f0da4600640 1 -- 172.21.15.42:0/4152912073 shutdown_connections 2024-09-17T01:36:36.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.260+0000 7f0da4600640 1 --2- 172.21.15.42:0/4152912073 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0d7c078b90 0x7f0d7c07b0a0 secure :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c076a30 tx=0x7f0d88009040 comp rx=0 tx=0).stop 2024-09-17T01:36:36.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.260+0000 7f0da4600640 1 --2- 172.21.15.42:0/4152912073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d9c0cdb20 0x7f0d9c0b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.260+0000 7f0da4600640 1 --2- 172.21.15.42:0/4152912073 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0d9c0cba50 0x7f0d9c138f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.260+0000 7f0da4600640 1 --2- 172.21.15.42:0/4152912073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d9c0b56d0 0x7f0d9c0b1370 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.260+0000 7f0da4600640 1 -- 172.21.15.42:0/4152912073 >> 172.21.15.42:0/4152912073 conn(0x7f0d9c0b28f0 msgr2=0x7f0d9c145d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:36.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.260+0000 7f0da4600640 1 -- 172.21.15.42:0/4152912073 shutdown_connections 2024-09-17T01:36:36.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.260+0000 7f0da4600640 1 -- 172.21.15.42:0/4152912073 wait complete. 2024-09-17T01:36:36.286 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:36:36.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.516+0000 7f8425200640 1 -- 172.21.15.42:0/1549113165 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f84200b5100 msgr2=0x7f842015d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:36.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.516+0000 7f8425200640 1 --2- 172.21.15.42:0/1549113165 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f84200b5100 0x7f842015d950 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8410009860 tx=0x7f841002a5a0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.516+0000 7f8425200640 1 -- 172.21.15.42:0/1549113165 shutdown_connections 2024-09-17T01:36:36.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.516+0000 7f8425200640 1 --2- 172.21.15.42:0/1549113165 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f84200b5100 0x7f842015d950 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.516+0000 7f8425200640 1 -- 172.21.15.42:0/1549113165 >> 172.21.15.42:0/1549113165 conn(0x7f84200b2930 msgr2=0x7f842006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:36.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.516+0000 7f8425200640 1 -- 172.21.15.42:0/1549113165 shutdown_connections 2024-09-17T01:36:36.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.516+0000 7f8425200640 1 -- 172.21.15.42:0/1549113165 wait complete. 2024-09-17T01:36:36.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.518+0000 7f8425200640 1 Processor -- start 2024-09-17T01:36:36.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.518+0000 7f8425200640 1 -- start start 2024-09-17T01:36:36.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.520+0000 7f8425200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f842006d430 0x7f842006fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:36.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.520+0000 7f8425200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84200b5100 0x7f8420148df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:36.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.520+0000 7f8425200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84200cef70 0x7f84201f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:36.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.520+0000 7f8425200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8420073bd0 con 0x7f84200cef70 2024-09-17T01:36:36.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.520+0000 7f8425200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8420073a50 con 0x7f84200b5100 2024-09-17T01:36:36.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.520+0000 7f8425200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8420073d50 con 0x7f842006d430 2024-09-17T01:36:36.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.520+0000 7f841e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84200cef70 0x7f84201f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:36.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.520+0000 7f841e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84200cef70 0x7f84201f5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48924/0 (socket says 172.21.15.42:48924) 2024-09-17T01:36:36.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.520+0000 7f841e800640 1 -- 172.21.15.42:0/4009685727 learned_addr learned my addr 172.21.15.42:0/4009685727 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:36.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.520+0000 7f841de00640 1 --2- 172.21.15.42:0/4009685727 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f842006d430 0x7f842006fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:36.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.520+0000 7f8417e00640 1 --2- 172.21.15.42:0/4009685727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84200b5100 0x7f8420148df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:36.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.521+0000 7f841e800640 1 -- 172.21.15.42:0/4009685727 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f842006d430 msgr2=0x7f842006fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:36.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.521+0000 7f841e800640 1 --2- 172.21.15.42:0/4009685727 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f842006d430 0x7f842006fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.521+0000 7f841e800640 1 -- 172.21.15.42:0/4009685727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84200b5100 msgr2=0x7f8420148df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:36.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.521+0000 7f841e800640 1 --2- 172.21.15.42:0/4009685727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84200b5100 0x7f8420148df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.521+0000 7f841e800640 1 -- 172.21.15.42:0/4009685727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84200b18b0 con 0x7f84200cef70 2024-09-17T01:36:36.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.521+0000 7f841e800640 1 --2- 172.21.15.42:0/4009685727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84200cef70 0x7f84201f5bd0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f841800c730 tx=0x7f841800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:36.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.521+0000 7f8416000640 1 -- 172.21.15.42:0/4009685727 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418003b70 con 0x7f84200cef70 2024-09-17T01:36:36.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.521+0000 7f8416000640 1 -- 172.21.15.42:0/4009685727 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8418003d10 con 0x7f84200cef70 2024-09-17T01:36:36.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.521+0000 7f8416000640 1 -- 172.21.15.42:0/4009685727 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841800aa50 con 0x7f84200cef70 2024-09-17T01:36:36.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.521+0000 7f8425200640 1 -- 172.21.15.42:0/4009685727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84200b15d0 con 0x7f84200cef70 2024-09-17T01:36:36.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.521+0000 7f8425200640 1 -- 172.21.15.42:0/4009685727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f842006f550 con 0x7f84200cef70 2024-09-17T01:36:36.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.522+0000 7f8425200640 1 -- 172.21.15.42:0/4009685727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84200b1340 con 0x7f84200cef70 2024-09-17T01:36:36.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.524+0000 7f8416000640 1 -- 172.21.15.42:0/4009685727 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f841800abf0 con 0x7f84200cef70 2024-09-17T01:36:36.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.525+0000 7f8416000640 1 --2- 172.21.15.42:0/4009685727 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f83fc078bc0 0x7f83fc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:36.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.525+0000 7f8416000640 1 -- 172.21.15.42:0/4009685727 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5795+0+0 (secure 0 0 0) 0x7f841809a950 con 0x7f84200cef70 2024-09-17T01:36:36.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.526+0000 7f841de00640 1 --2- 172.21.15.42:0/4009685727 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f83fc078bc0 0x7f83fc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:36.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.526+0000 7f841de00640 1 --2- 172.21.15.42:0/4009685727 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f83fc078bc0 0x7f83fc07b0d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8410034000 tx=0x7f8410004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:36.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.529+0000 7f8416000640 1 -- 172.21.15.42:0/4009685727 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8418062770 con 0x7f84200cef70 2024-09-17T01:36:36.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.761+0000 7f8425200640 1 -- 172.21.15.42:0/4009685727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f842015d950 con 0x7f84200cef70 2024-09-17T01:36:36.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.762+0000 7f8416000640 1 -- 172.21.15.42:0/4009685727 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5221 (secure 0 0 0) 0x7f84180671a0 con 0x7f84200cef70 2024-09-17T01:36:36.760 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:36.760 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":47,"btime":"2024-09-17T01:36:32:454373+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2214729520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2214729520},{"type":"v1","addr":"172.21.15.43:6835","nonce":2214729520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/983475498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":983475498},{"type":"v1","addr":"172.21.15.43:6837","nonce":983475498}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1213307380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1213307380},{"type":"v1","addr":"172.21.15.42:6833","nonce":1213307380}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:36:10.790086+0000","modified":"2024-09-17T01:36:32.454363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":66,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6492":{"gid":6492,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6835/4251885944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":4251885944},{"type":"v1","addr":"172.21.15.42:6835","nonce":4251885944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6492,"qdb_cluster":[6492]},"id":4}]} 2024-09-17T01:36:36.761 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 47 2024-09-17T01:36:36.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.764+0000 7f8425200640 1 -- 172.21.15.42:0/4009685727 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f83fc078bc0 msgr2=0x7f83fc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:36.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.764+0000 7f8425200640 1 --2- 172.21.15.42:0/4009685727 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f83fc078bc0 0x7f83fc07b0d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8410034000 tx=0x7f8410004730 comp rx=0 tx=0).stop 2024-09-17T01:36:36.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.765+0000 7f8425200640 1 -- 172.21.15.42:0/4009685727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84200cef70 msgr2=0x7f84201f5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:36.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.765+0000 7f8425200640 1 --2- 172.21.15.42:0/4009685727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84200cef70 0x7f84201f5bd0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f841800c730 tx=0x7f841800cbf0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.765+0000 7f8425200640 1 -- 172.21.15.42:0/4009685727 shutdown_connections 2024-09-17T01:36:36.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.765+0000 7f8425200640 1 --2- 172.21.15.42:0/4009685727 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f83fc078bc0 0x7f83fc07b0d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.765+0000 7f8425200640 1 --2- 172.21.15.42:0/4009685727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84200b5100 0x7f8420148df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.765+0000 7f8425200640 1 --2- 172.21.15.42:0/4009685727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84200cef70 0x7f84201f5bd0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.765+0000 7f8425200640 1 --2- 172.21.15.42:0/4009685727 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f842006d430 0x7f842006fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:36.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.765+0000 7f8425200640 1 -- 172.21.15.42:0/4009685727 >> 172.21.15.42:0/4009685727 conn(0x7f84200b2930 msgr2=0x7f842006d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:36.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.765+0000 7f8425200640 1 -- 172.21.15.42:0/4009685727 shutdown_connections 2024-09-17T01:36:36.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:36.765+0000 7f8425200640 1 -- 172.21.15.42:0/4009685727 wait complete. 2024-09-17T01:36:36.789 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-09-17T01:36:37.034 INFO:teuthology.orchestra.run.smithi042.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-17T01:36:27.340446+0000","btime":"2024-09-17T01:36:26.146456+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-17T01:36:27.340446+0000","atime":"2024-09-17T01:36:26.146456+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-17T01:36:27.340446+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-17T01:36:27.341446+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-17T01:36:27.341446+0000"},"version":244,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":2,"authpin":0,"scrubqueue":0},"nref":2,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-17T01:36:37.035 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-17T01:36:27.341446+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-17T01:36:26.146456+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-17T01:36:26.146456+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-17T01:36:27.340446+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-17T01:36:27.340446+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-17T01:36:27.340446+0000", "nestlock": {}, "nlink": 1, "nref": 2, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 2, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-17T01:36:27.341446+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 244, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-17T01:36:37.035 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-17T01:36:42.036 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:36:42.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.278+0000 7f1f45a00640 1 -- 172.21.15.42:0/1569768701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f40072e90 msgr2=0x7f1f400cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:42.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.278+0000 7f1f45a00640 1 --2- 172.21.15.42:0/1569768701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f40072e90 0x7f1f400cec40 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f1f400704d0 tx=0x7f1f3802a980 comp rx=0 tx=0).stop 2024-09-17T01:36:42.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.278+0000 7f1f45a00640 1 -- 172.21.15.42:0/1569768701 shutdown_connections 2024-09-17T01:36:42.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.278+0000 7f1f45a00640 1 --2- 172.21.15.42:0/1569768701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f40072e90 0x7f1f400cec40 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:42.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.278+0000 7f1f45a00640 1 --2- 172.21.15.42:0/1569768701 >> v2:172.21.15.43:3300/0 conn(0x7f1f40142f40 0x7f1f40072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:42.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.278+0000 7f1f45a00640 1 -- 172.21.15.42:0/1569768701 >> 172.21.15.42:0/1569768701 conn(0x7f1f400b2930 msgr2=0x7f1f4006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:42.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.278+0000 7f1f45a00640 1 -- 172.21.15.42:0/1569768701 shutdown_connections 2024-09-17T01:36:42.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.278+0000 7f1f45a00640 1 -- 172.21.15.42:0/1569768701 wait complete. 2024-09-17T01:36:42.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.281+0000 7f1f45a00640 1 Processor -- start 2024-09-17T01:36:42.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.281+0000 7f1f45a00640 1 -- start start 2024-09-17T01:36:42.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.282+0000 7f1f45a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f40072e90 0x7f1f4013e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:42.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.282+0000 7f1f45a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f400b3550 0x7f1f401f6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:42.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.282+0000 7f1f45a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f40142f40 0x7f1f401f7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:42.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.282+0000 7f1f45a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4006d5b0 con 0x7f1f400b3550 2024-09-17T01:36:42.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.282+0000 7f1f45a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4006d430 con 0x7f1f40142f40 2024-09-17T01:36:42.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.282+0000 7f1f45a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1f4006d730 con 0x7f1f40072e90 2024-09-17T01:36:42.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.283+0000 7f1f3e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f400b3550 0x7f1f401f6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:42.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.283+0000 7f1f3e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f400b3550 0x7f1f401f6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48956/0 (socket says 172.21.15.42:48956) 2024-09-17T01:36:42.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.283+0000 7f1f3e000640 1 -- 172.21.15.42:0/1244623836 learned_addr learned my addr 172.21.15.42:0/1244623836 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:42.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.283+0000 7f1f3ea00640 1 --2- 172.21.15.42:0/1244623836 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f40072e90 0x7f1f4013e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:42.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.283+0000 7f1f3f400640 1 --2- 172.21.15.42:0/1244623836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f40142f40 0x7f1f401f7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:42.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.283+0000 7f1f3e000640 1 -- 172.21.15.42:0/1244623836 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f40072e90 msgr2=0x7f1f4013e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:42.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.283+0000 7f1f3e000640 1 --2- 172.21.15.42:0/1244623836 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f40072e90 0x7f1f4013e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:42.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.283+0000 7f1f3e000640 1 -- 172.21.15.42:0/1244623836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f40142f40 msgr2=0x7f1f401f7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:42.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.283+0000 7f1f3e000640 1 --2- 172.21.15.42:0/1244623836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f40142f40 0x7f1f401f7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:42.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.283+0000 7f1f3e000640 1 -- 172.21.15.42:0/1244623836 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f4013edf0 con 0x7f1f400b3550 2024-09-17T01:36:42.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.283+0000 7f1f3e000640 1 --2- 172.21.15.42:0/1244623836 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f400b3550 0x7f1f401f6de0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00d750 tx=0x7f1f2c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:42.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.284+0000 7f1f36a00640 1 -- 172.21.15.42:0/1244623836 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c017070 con 0x7f1f400b3550 2024-09-17T01:36:42.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.284+0000 7f1f36a00640 1 -- 172.21.15.42:0/1244623836 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f2c009b20 con 0x7f1f400b3550 2024-09-17T01:36:42.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.284+0000 7f1f45a00640 1 -- 172.21.15.42:0/1244623836 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f401416b0 con 0x7f1f400b3550 2024-09-17T01:36:42.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.284+0000 7f1f36a00640 1 -- 172.21.15.42:0/1244623836 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c010460 con 0x7f1f400b3550 2024-09-17T01:36:42.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.284+0000 7f1f45a00640 1 -- 172.21.15.42:0/1244623836 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f40141c70 con 0x7f1f400b3550 2024-09-17T01:36:42.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.285+0000 7f1f45a00640 1 -- 172.21.15.42:0/1244623836 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f4006dc90 con 0x7f1f400b3550 2024-09-17T01:36:42.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.286+0000 7f1f36a00640 1 -- 172.21.15.42:0/1244623836 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1f2c01a070 con 0x7f1f400b3550 2024-09-17T01:36:42.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.287+0000 7f1f36a00640 1 --2- 172.21.15.42:0/1244623836 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1f20078b90 0x7f1f2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:42.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.287+0000 7f1f36a00640 1 -- 172.21.15.42:0/1244623836 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5795+0+0 (secure 0 0 0) 0x7f1f2c09afc0 con 0x7f1f400b3550 2024-09-17T01:36:42.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.288+0000 7f1f3ea00640 1 --2- 172.21.15.42:0/1244623836 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1f20078b90 0x7f1f2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:42.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.289+0000 7f1f3ea00640 1 --2- 172.21.15.42:0/1244623836 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1f20078b90 0x7f1f2007b0a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1f30006fd0 tx=0x7f1f30008040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:42.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.292+0000 7f1f36a00640 1 -- 172.21.15.42:0/1244623836 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1f4013edf0 con 0x7f1f400b3550 2024-09-17T01:36:42.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.527+0000 7f1f45a00640 1 -- 172.21.15.42:0/1244623836 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f401f7d50 con 0x7f1f400b3550 2024-09-17T01:36:42.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.527+0000 7f1f36a00640 1 -- 172.21.15.42:0/1244623836 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5221 (secure 0 0 0) 0x7f1f2c063390 con 0x7f1f400b3550 2024-09-17T01:36:42.525 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:42.525 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":47,"btime":"2024-09-17T01:36:32:454373+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2214729520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2214729520},{"type":"v1","addr":"172.21.15.43:6835","nonce":2214729520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/983475498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":983475498},{"type":"v1","addr":"172.21.15.43:6837","nonce":983475498}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1213307380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1213307380},{"type":"v1","addr":"172.21.15.42:6833","nonce":1213307380}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:36:10.790086+0000","modified":"2024-09-17T01:36:32.454363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":66,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6492":{"gid":6492,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6835/4251885944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":4251885944},{"type":"v1","addr":"172.21.15.42:6835","nonce":4251885944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6492,"qdb_cluster":[6492]},"id":4}]} 2024-09-17T01:36:42.526 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 47 2024-09-17T01:36:42.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.530+0000 7f1f45a00640 1 -- 172.21.15.42:0/1244623836 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1f20078b90 msgr2=0x7f1f2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:42.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.530+0000 7f1f45a00640 1 --2- 172.21.15.42:0/1244623836 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1f20078b90 0x7f1f2007b0a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1f30006fd0 tx=0x7f1f30008040 comp rx=0 tx=0).stop 2024-09-17T01:36:42.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.530+0000 7f1f45a00640 1 -- 172.21.15.42:0/1244623836 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f400b3550 msgr2=0x7f1f401f6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:42.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.530+0000 7f1f45a00640 1 --2- 172.21.15.42:0/1244623836 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f400b3550 0x7f1f401f6de0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00d750 tx=0x7f1f2c00dc10 comp rx=0 tx=0).stop 2024-09-17T01:36:42.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.530+0000 7f1f45a00640 1 -- 172.21.15.42:0/1244623836 shutdown_connections 2024-09-17T01:36:42.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.530+0000 7f1f45a00640 1 --2- 172.21.15.42:0/1244623836 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1f20078b90 0x7f1f2007b0a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:42.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.530+0000 7f1f45a00640 1 --2- 172.21.15.42:0/1244623836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f40142f40 0x7f1f401f7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:42.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.530+0000 7f1f45a00640 1 --2- 172.21.15.42:0/1244623836 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f400b3550 0x7f1f401f6de0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:42.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.530+0000 7f1f45a00640 1 --2- 172.21.15.42:0/1244623836 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f40072e90 0x7f1f4013e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:42.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.530+0000 7f1f45a00640 1 -- 172.21.15.42:0/1244623836 >> 172.21.15.42:0/1244623836 conn(0x7f1f400b2930 msgr2=0x7f1f4015be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:42.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.530+0000 7f1f45a00640 1 -- 172.21.15.42:0/1244623836 shutdown_connections 2024-09-17T01:36:42.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:42.530+0000 7f1f45a00640 1 -- 172.21.15.42:0/1244623836 wait complete. 2024-09-17T01:36:42.550 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-09-17T01:36:42.795 INFO:teuthology.orchestra.run.smithi042.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-17T01:36:27.340446+0000","btime":"2024-09-17T01:36:26.146456+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-17T01:36:27.340446+0000","atime":"2024-09-17T01:36:26.146456+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-17T01:36:27.340446+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-17T01:36:27.341446+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-17T01:36:27.341446+0000"},"version":247,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"2024-09-17T01:36:36.261308+0000","last_scrub_version":244,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":1,"dirtyrstat":1,"dirty":1,"authpin":0,"scrubqueue":0},"nref":3,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyrstat"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-17T01:36:42.795 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-17T01:36:27.341446+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-17T01:36:26.146456+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-17T01:36:26.146456+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-17T01:36:27.340446+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-17T01:36:27.340446+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "2024-09-17T01:36:36.261308+0000", "last_scrub_version": 244, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-17T01:36:27.340446+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 1, "dirty": 1, "dirtyrstat": 1, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-17T01:36:27.341446+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyrstat" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 247, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-17T01:36:42.796 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-17T01:36:42.796 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:36:42.796 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:36:42.885 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:36:42.987 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:36:42.987 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:36:42.987 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:36:42.987 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:36:43.023 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:36:43.023 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:36:43.023 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:36:43.023 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:36:43.060 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:36:43.060 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:36:43.061 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:36:43.061 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:36:43.098 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:36:43.098 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:36:43.098 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:36:43.098 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:36:43.136 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:36:43.137 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:36:43.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.371+0000 7fb0dfa00640 1 -- 172.21.15.42:0/41762473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0d80cecb0 msgr2=0x7fb0d80cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:43.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.371+0000 7fb0dfa00640 1 --2- 172.21.15.42:0/41762473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0d80cecb0 0x7fb0d80cf0c0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0009830 tx=0x7fb0c002a510 comp rx=0 tx=0).stop 2024-09-17T01:36:43.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.371+0000 7fb0dfa00640 1 -- 172.21.15.42:0/41762473 shutdown_connections 2024-09-17T01:36:43.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.371+0000 7fb0dfa00640 1 --2- 172.21.15.42:0/41762473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0d80cecb0 0x7fb0d80cf0c0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:43.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.371+0000 7fb0dfa00640 1 --2- 172.21.15.42:0/41762473 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0d815cec0 0x7fb0d815d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:43.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.371+0000 7fb0dfa00640 1 -- 172.21.15.42:0/41762473 >> 172.21.15.42:0/41762473 conn(0x7fb0d80b2930 msgr2=0x7fb0d806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:43.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.371+0000 7fb0dfa00640 1 -- 172.21.15.42:0/41762473 shutdown_connections 2024-09-17T01:36:43.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.371+0000 7fb0dfa00640 1 -- 172.21.15.42:0/41762473 wait complete. 2024-09-17T01:36:43.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.374+0000 7fb0dfa00640 1 Processor -- start 2024-09-17T01:36:43.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.374+0000 7fb0dfa00640 1 -- start start 2024-09-17T01:36:43.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.375+0000 7fb0dfa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0d8072950 0x7fb0d814b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:43.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.375+0000 7fb0dfa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0d80cecb0 0x7fb0d80c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:43.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.375+0000 7fb0dfa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0d815cec0 0x7fb0d80b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:43.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.375+0000 7fb0dfa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d806dd50 con 0x7fb0d80cecb0 2024-09-17T01:36:43.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.375+0000 7fb0dfa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d8072d60 con 0x7fb0d8072950 2024-09-17T01:36:43.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.375+0000 7fb0dfa00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb0d80cb7b0 con 0x7fb0d815cec0 2024-09-17T01:36:43.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.375+0000 7fb0cfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0d80cecb0 0x7fb0d80c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:43.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.376+0000 7fb0cfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0d80cecb0 0x7fb0d80c96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48972/0 (socket says 172.21.15.42:48972) 2024-09-17T01:36:43.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.376+0000 7fb0cfe00640 1 -- 172.21.15.42:0/190696045 learned_addr learned my addr 172.21.15.42:0/190696045 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:43.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.376+0000 7fb0dd000640 1 --2- 172.21.15.42:0/190696045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0d8072950 0x7fb0d814b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:43.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.376+0000 7fb0dda00640 1 --2- 172.21.15.42:0/190696045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0d815cec0 0x7fb0d80b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:43.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.376+0000 7fb0cfe00640 1 -- 172.21.15.42:0/190696045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0d815cec0 msgr2=0x7fb0d80b0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:43.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.376+0000 7fb0cfe00640 1 --2- 172.21.15.42:0/190696045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0d815cec0 0x7fb0d80b0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:43.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.376+0000 7fb0cfe00640 1 -- 172.21.15.42:0/190696045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0d8072950 msgr2=0x7fb0d814b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:43.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.376+0000 7fb0cfe00640 1 --2- 172.21.15.42:0/190696045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0d8072950 0x7fb0d814b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:43.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.376+0000 7fb0cfe00640 1 -- 172.21.15.42:0/190696045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d814be10 con 0x7fb0d80cecb0 2024-09-17T01:36:43.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.376+0000 7fb0cfe00640 1 --2- 172.21.15.42:0/190696045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0d80cecb0 0x7fb0d80c96f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0009950 tx=0x7fb0c0033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:43.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.377+0000 7fb0d5600640 1 -- 172.21.15.42:0/190696045 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0005c90 con 0x7fb0d80cecb0 2024-09-17T01:36:43.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.377+0000 7fb0d5600640 1 -- 172.21.15.42:0/190696045 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0c0031e50 con 0x7fb0d80cecb0 2024-09-17T01:36:43.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.377+0000 7fb0dfa00640 1 -- 172.21.15.42:0/190696045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d81f5a90 con 0x7fb0d80cecb0 2024-09-17T01:36:43.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.377+0000 7fb0d5600640 1 -- 172.21.15.42:0/190696045 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0005260 con 0x7fb0d80cecb0 2024-09-17T01:36:43.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.377+0000 7fb0dfa00640 1 -- 172.21.15.42:0/190696045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d81f6050 con 0x7fb0d80cecb0 2024-09-17T01:36:43.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.378+0000 7fb0dfa00640 1 -- 172.21.15.42:0/190696045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d8073180 con 0x7fb0d80cecb0 2024-09-17T01:36:43.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.379+0000 7fb0d5600640 1 -- 172.21.15.42:0/190696045 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb0c0005400 con 0x7fb0d80cecb0 2024-09-17T01:36:43.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.381+0000 7fb0d5600640 1 --2- 172.21.15.42:0/190696045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb0b4078b90 0x7fb0b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:43.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.381+0000 7fb0d5600640 1 -- 172.21.15.42:0/190696045 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5795+0+0 (secure 0 0 0) 0x7fb0c00bbfb0 con 0x7fb0d80cecb0 2024-09-17T01:36:43.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.381+0000 7fb0dd000640 1 --2- 172.21.15.42:0/190696045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb0b4078b90 0x7fb0b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:43.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.382+0000 7fb0dd000640 1 --2- 172.21.15.42:0/190696045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb0b4078b90 0x7fb0b407b0a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb0d80708a0 tx=0x7fb0c8005e30 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:43.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.385+0000 7fb0d5600640 1 -- 172.21.15.42:0/190696045 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb0c003f030 con 0x7fb0d80cecb0 2024-09-17T01:36:43.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.617+0000 7fb0dfa00640 1 -- 172.21.15.42:0/190696045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0d806a170 con 0x7fb0d80cecb0 2024-09-17T01:36:43.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.617+0000 7fb0d5600640 1 -- 172.21.15.42:0/190696045 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5221 (secure 0 0 0) 0x7fb0c0084380 con 0x7fb0d80cecb0 2024-09-17T01:36:43.616 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:43.616 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":47,"btime":"2024-09-17T01:36:32:454373+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2214729520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2214729520},{"type":"v1","addr":"172.21.15.43:6835","nonce":2214729520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/983475498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":983475498},{"type":"v1","addr":"172.21.15.43:6837","nonce":983475498}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1213307380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1213307380},{"type":"v1","addr":"172.21.15.42:6833","nonce":1213307380}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:36:10.790086+0000","modified":"2024-09-17T01:36:32.454363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":66,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6492":{"gid":6492,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6835/4251885944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":4251885944},{"type":"v1","addr":"172.21.15.42:6835","nonce":4251885944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6492,"qdb_cluster":[6492]},"id":4}]} 2024-09-17T01:36:43.617 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 47 2024-09-17T01:36:43.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.620+0000 7fb0dfa00640 1 -- 172.21.15.42:0/190696045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb0b4078b90 msgr2=0x7fb0b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:43.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.620+0000 7fb0dfa00640 1 --2- 172.21.15.42:0/190696045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb0b4078b90 0x7fb0b407b0a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb0d80708a0 tx=0x7fb0c8005e30 comp rx=0 tx=0).stop 2024-09-17T01:36:43.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.620+0000 7fb0dfa00640 1 -- 172.21.15.42:0/190696045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0d80cecb0 msgr2=0x7fb0d80c96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:43.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.620+0000 7fb0dfa00640 1 --2- 172.21.15.42:0/190696045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0d80cecb0 0x7fb0d80c96f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0009950 tx=0x7fb0c0033c90 comp rx=0 tx=0).stop 2024-09-17T01:36:43.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.620+0000 7fb0dfa00640 1 -- 172.21.15.42:0/190696045 shutdown_connections 2024-09-17T01:36:43.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.620+0000 7fb0dfa00640 1 --2- 172.21.15.42:0/190696045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb0b4078b90 0x7fb0b407b0a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:43.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.620+0000 7fb0dfa00640 1 --2- 172.21.15.42:0/190696045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb0d815cec0 0x7fb0d80b0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:43.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.620+0000 7fb0dfa00640 1 --2- 172.21.15.42:0/190696045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0d80cecb0 0x7fb0d80c96f0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:43.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.620+0000 7fb0dfa00640 1 --2- 172.21.15.42:0/190696045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0d8072950 0x7fb0d814b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:43.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.620+0000 7fb0dfa00640 1 -- 172.21.15.42:0/190696045 >> 172.21.15.42:0/190696045 conn(0x7fb0d80b2930 msgr2=0x7fb0d80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:43.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.620+0000 7fb0dfa00640 1 -- 172.21.15.42:0/190696045 shutdown_connections 2024-09-17T01:36:43.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.620+0000 7fb0dfa00640 1 -- 172.21.15.42:0/190696045 wait complete. 2024-09-17T01:36:43.642 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:36:43.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.870+0000 7f06ffe00640 1 -- 172.21.15.42:0/1990158118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f070006cd20 msgr2=0x7f070006d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:43.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.870+0000 7f06ffe00640 1 --2- 172.21.15.42:0/1990158118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f070006cd20 0x7f070006d130 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f07000afcc0 tx=0x7f06f002a540 comp rx=0 tx=0).stop 2024-09-17T01:36:43.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.870+0000 7f06ffe00640 1 -- 172.21.15.42:0/1990158118 shutdown_connections 2024-09-17T01:36:43.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.870+0000 7f06ffe00640 1 --2- 172.21.15.42:0/1990158118 >> v2:172.21.15.43:3300/0 conn(0x7f07000b30a0 0x7f07000b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:43.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.870+0000 7f06ffe00640 1 --2- 172.21.15.42:0/1990158118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f070006cd20 0x7f070006d130 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:43.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.870+0000 7f06ffe00640 1 -- 172.21.15.42:0/1990158118 >> 172.21.15.42:0/1990158118 conn(0x7f07000b25f0 msgr2=0x7f07000d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:43.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.870+0000 7f06ffe00640 1 -- 172.21.15.42:0/1990158118 shutdown_connections 2024-09-17T01:36:43.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.871+0000 7f06ffe00640 1 -- 172.21.15.42:0/1990158118 wait complete. 2024-09-17T01:36:43.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.873+0000 7f06ffe00640 1 Processor -- start 2024-09-17T01:36:43.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.873+0000 7f06ffe00640 1 -- start start 2024-09-17T01:36:43.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.874+0000 7f06ffe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f070006cd20 0x7f0700150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:43.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.874+0000 7f06ffe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07000b30a0 0x7f070014c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:43.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.874+0000 7f06ffe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07000cf230 0x7f07001f9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:43.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.874+0000 7f06ffe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0700070470 con 0x7f070006cd20 2024-09-17T01:36:43.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.874+0000 7f06ffe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f07000702f0 con 0x7f07000cf230 2024-09-17T01:36:43.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.874+0000 7f06ffe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f07000b39f0 con 0x7f07000b30a0 2024-09-17T01:36:43.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.875+0000 7f06fea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f070006cd20 0x7f0700150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:43.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.875+0000 7f06fea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f070006cd20 0x7f0700150cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48992/0 (socket says 172.21.15.42:48992) 2024-09-17T01:36:43.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.875+0000 7f06fea00640 1 -- 172.21.15.42:0/3037396021 learned_addr learned my addr 172.21.15.42:0/3037396021 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:43.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.875+0000 7f06fe000640 1 --2- 172.21.15.42:0/3037396021 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07000b30a0 0x7f070014c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:43.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.875+0000 7f06ff400640 1 --2- 172.21.15.42:0/3037396021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07000cf230 0x7f07001f9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:43.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.875+0000 7f06fea00640 1 -- 172.21.15.42:0/3037396021 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07000b30a0 msgr2=0x7f070014c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:43.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.875+0000 7f06fea00640 1 --2- 172.21.15.42:0/3037396021 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07000b30a0 0x7f070014c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:43.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.875+0000 7f06fea00640 1 -- 172.21.15.42:0/3037396021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07000cf230 msgr2=0x7f07001f9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:43.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.875+0000 7f06fea00640 1 --2- 172.21.15.42:0/3037396021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07000cf230 0x7f07001f9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:43.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.875+0000 7f06fea00640 1 -- 172.21.15.42:0/3037396021 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0700151820 con 0x7f070006cd20 2024-09-17T01:36:43.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.875+0000 7f06fea00640 1 --2- 172.21.15.42:0/3037396021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f070006cd20 0x7f0700150cb0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f06f002ab30 tx=0x7f06f0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:43.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.876+0000 7f06f6a00640 1 -- 172.21.15.42:0/3037396021 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f0031d60 con 0x7f070006cd20 2024-09-17T01:36:43.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.876+0000 7f06f6a00640 1 -- 172.21.15.42:0/3037396021 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06f0033e10 con 0x7f070006cd20 2024-09-17T01:36:43.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.876+0000 7f06f6a00640 1 -- 172.21.15.42:0/3037396021 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f0005260 con 0x7f070006cd20 2024-09-17T01:36:43.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.876+0000 7f06ffe00640 1 -- 172.21.15.42:0/3037396021 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0700151b00 con 0x7f070006cd20 2024-09-17T01:36:43.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.876+0000 7f06ffe00640 1 -- 172.21.15.42:0/3037396021 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07001520c0 con 0x7f070006cd20 2024-09-17T01:36:43.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.877+0000 7f06ffe00640 1 -- 172.21.15.42:0/3037396021 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f070015e630 con 0x7f070006cd20 2024-09-17T01:36:43.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.878+0000 7f06f6a00640 1 -- 172.21.15.42:0/3037396021 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f06f0005400 con 0x7f070006cd20 2024-09-17T01:36:43.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.879+0000 7f06f6a00640 1 --2- 172.21.15.42:0/3037396021 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f06e0078b90 0x7f06e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:43.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.879+0000 7f06f6a00640 1 -- 172.21.15.42:0/3037396021 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5795+0+0 (secure 0 0 0) 0x7f06f00bbf70 con 0x7f070006cd20 2024-09-17T01:36:43.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.879+0000 7f06fe000640 1 --2- 172.21.15.42:0/3037396021 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f06e0078b90 0x7f06e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:43.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.880+0000 7f06fe000640 1 --2- 172.21.15.42:0/3037396021 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f06e0078b90 0x7f06e007b0a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f06ec000f60 tx=0x7f06ec009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:43.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:43.884+0000 7f06f6a00640 1 -- 172.21.15.42:0/3037396021 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f070015e630 con 0x7f070006cd20 2024-09-17T01:36:44.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.116+0000 7f06ffe00640 1 -- 172.21.15.42:0/3037396021 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07000b3f10 con 0x7f070006cd20 2024-09-17T01:36:44.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.116+0000 7f06f6a00640 1 -- 172.21.15.42:0/3037396021 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5221 (secure 0 0 0) 0x7f06f003f030 con 0x7f070006cd20 2024-09-17T01:36:44.114 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:44.115 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":47,"btime":"2024-09-17T01:36:32:454373+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2214729520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2214729520},{"type":"v1","addr":"172.21.15.43:6835","nonce":2214729520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/983475498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":983475498},{"type":"v1","addr":"172.21.15.43:6837","nonce":983475498}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1213307380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1213307380},{"type":"v1","addr":"172.21.15.42:6833","nonce":1213307380}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:36:10.790086+0000","modified":"2024-09-17T01:36:32.454363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":66,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6492":{"gid":6492,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6835/4251885944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":4251885944},{"type":"v1","addr":"172.21.15.42:6835","nonce":4251885944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6492,"qdb_cluster":[6492]},"id":4}]} 2024-09-17T01:36:44.115 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 47 2024-09-17T01:36:44.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.119+0000 7f06ffe00640 1 -- 172.21.15.42:0/3037396021 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f06e0078b90 msgr2=0x7f06e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:44.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.119+0000 7f06ffe00640 1 --2- 172.21.15.42:0/3037396021 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f06e0078b90 0x7f06e007b0a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f06ec000f60 tx=0x7f06ec009040 comp rx=0 tx=0).stop 2024-09-17T01:36:44.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.119+0000 7f06ffe00640 1 -- 172.21.15.42:0/3037396021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f070006cd20 msgr2=0x7f0700150cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:44.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.119+0000 7f06ffe00640 1 --2- 172.21.15.42:0/3037396021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f070006cd20 0x7f0700150cb0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f06f002ab30 tx=0x7f06f0033c20 comp rx=0 tx=0).stop 2024-09-17T01:36:44.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.119+0000 7f06ffe00640 1 -- 172.21.15.42:0/3037396021 shutdown_connections 2024-09-17T01:36:44.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.119+0000 7f06ffe00640 1 --2- 172.21.15.42:0/3037396021 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f06e0078b90 0x7f06e007b0a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:44.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.119+0000 7f06ffe00640 1 --2- 172.21.15.42:0/3037396021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07000cf230 0x7f07001f9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:44.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.119+0000 7f06ffe00640 1 --2- 172.21.15.42:0/3037396021 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07000b30a0 0x7f070014c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:44.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.119+0000 7f06ffe00640 1 --2- 172.21.15.42:0/3037396021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f070006cd20 0x7f0700150cb0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:44.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.119+0000 7f06ffe00640 1 -- 172.21.15.42:0/3037396021 >> 172.21.15.42:0/3037396021 conn(0x7f07000b25f0 msgr2=0x7f070015e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:44.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.119+0000 7f06ffe00640 1 -- 172.21.15.42:0/3037396021 shutdown_connections 2024-09-17T01:36:44.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.119+0000 7f06ffe00640 1 -- 172.21.15.42:0/3037396021 wait complete. 2024-09-17T01:36:44.143 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:36:44.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.372+0000 7fdaf1c00640 1 -- 172.21.15.42:0/2415449314 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdaec06db40 msgr2=0x7fdaec06fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:44.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.372+0000 7fdaf1c00640 1 --2- 172.21.15.42:0/2415449314 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdaec06db40 0x7fdaec06fe40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdae4005fd0 tx=0x7fdae402aaa0 comp rx=0 tx=0).stop 2024-09-17T01:36:44.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.372+0000 7fdaf1c00640 1 -- 172.21.15.42:0/2415449314 shutdown_connections 2024-09-17T01:36:44.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.372+0000 7fdaf1c00640 1 --2- 172.21.15.42:0/2415449314 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdaec06db40 0x7fdaec06fe40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:44.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.372+0000 7fdaf1c00640 1 --2- 172.21.15.42:0/2415449314 >> v2:172.21.15.43:3300/0 conn(0x7fdaec072e00 0x7fdaec15bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:44.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.372+0000 7fdaf1c00640 1 -- 172.21.15.42:0/2415449314 >> 172.21.15.42:0/2415449314 conn(0x7fdaec0b2930 msgr2=0x7fdaec06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:44.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.372+0000 7fdaf1c00640 1 -- 172.21.15.42:0/2415449314 shutdown_connections 2024-09-17T01:36:44.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.372+0000 7fdaf1c00640 1 -- 172.21.15.42:0/2415449314 wait complete. 2024-09-17T01:36:44.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.374+0000 7fdaf1c00640 1 Processor -- start 2024-09-17T01:36:44.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.374+0000 7fdaf1c00640 1 -- start start 2024-09-17T01:36:44.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.376+0000 7fdaf1c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdaec072e00 0x7fdaec0b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:44.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.376+0000 7fdaf1c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdaec15f190 0x7fdaec0b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:44.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.376+0000 7fdaf1c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdaec141110 0x7fdaec12f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:44.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.376+0000 7fdaf1c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdaec151520 con 0x7fdaec15f190 2024-09-17T01:36:44.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.376+0000 7fdaf1c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdaec070740 con 0x7fdaec141110 2024-09-17T01:36:44.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.376+0000 7fdaf1c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fdaec1516a0 con 0x7fdaec072e00 2024-09-17T01:36:44.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.376+0000 7fdaea000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdaec15f190 0x7fdaec0b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:44.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.376+0000 7fdaea000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdaec15f190 0x7fdaec0b4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49006/0 (socket says 172.21.15.42:49006) 2024-09-17T01:36:44.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.376+0000 7fdaea000640 1 -- 172.21.15.42:0/3949401612 learned_addr learned my addr 172.21.15.42:0/3949401612 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:44.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.376+0000 7fdaeaa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdaec072e00 0x7fdaec0b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:44.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.376+0000 7fdaeb400640 1 --2- 172.21.15.42:0/3949401612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdaec141110 0x7fdaec12f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:44.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.377+0000 7fdaea000640 1 -- 172.21.15.42:0/3949401612 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdaec072e00 msgr2=0x7fdaec0b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:44.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.377+0000 7fdaea000640 1 --2- 172.21.15.42:0/3949401612 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdaec072e00 0x7fdaec0b4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:44.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.377+0000 7fdaea000640 1 -- 172.21.15.42:0/3949401612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdaec141110 msgr2=0x7fdaec12f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:44.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.377+0000 7fdaea000640 1 --2- 172.21.15.42:0/3949401612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdaec141110 0x7fdaec12f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:44.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.377+0000 7fdaea000640 1 -- 172.21.15.42:0/3949401612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaec15d000 con 0x7fdaec15f190 2024-09-17T01:36:44.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.377+0000 7fdaeaa00640 1 --2- 172.21.15.42:0/3949401612 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdaec072e00 0x7fdaec0b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:36:44.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.377+0000 7fdaea000640 1 --2- 172.21.15.42:0/3949401612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdaec15f190 0x7fdaec0b4b80 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fdad800c370 tx=0x7fdad800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:44.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.377+0000 7fdae2a00640 1 -- 172.21.15.42:0/3949401612 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad80052d0 con 0x7fdaec15f190 2024-09-17T01:36:44.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.377+0000 7fdae2a00640 1 -- 172.21.15.42:0/3949401612 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdad8007020 con 0x7fdaec15f190 2024-09-17T01:36:44.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.377+0000 7fdaf1c00640 1 -- 172.21.15.42:0/3949401612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaec15d2e0 con 0x7fdaec15f190 2024-09-17T01:36:44.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.377+0000 7fdae2a00640 1 -- 172.21.15.42:0/3949401612 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad8007470 con 0x7fdaec15f190 2024-09-17T01:36:44.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.377+0000 7fdaf1c00640 1 -- 172.21.15.42:0/3949401612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaec15d8a0 con 0x7fdaec15f190 2024-09-17T01:36:44.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.378+0000 7fdaf1c00640 1 -- 172.21.15.42:0/3949401612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaec06fe40 con 0x7fdaec15f190 2024-09-17T01:36:44.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.380+0000 7fdae2a00640 1 -- 172.21.15.42:0/3949401612 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdad80067d0 con 0x7fdaec15f190 2024-09-17T01:36:44.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.381+0000 7fdae2a00640 1 --2- 172.21.15.42:0/3949401612 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdacc078b90 0x7fdacc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:44.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.381+0000 7fdae2a00640 1 -- 172.21.15.42:0/3949401612 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5795+0+0 (secure 0 0 0) 0x7fdad809a260 con 0x7fdaec15f190 2024-09-17T01:36:44.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.381+0000 7fdaeaa00640 1 --2- 172.21.15.42:0/3949401612 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdacc078b90 0x7fdacc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:44.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.382+0000 7fdaeaa00640 1 --2- 172.21.15.42:0/3949401612 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdacc078b90 0x7fdacc07b0a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdadc009f20 tx=0x7fdadc005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:44.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.385+0000 7fdae2a00640 1 -- 172.21.15.42:0/3949401612 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdad8061f60 con 0x7fdaec15f190 2024-09-17T01:36:44.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.581+0000 7fdaf1c00640 1 -- 172.21.15.42:0/3949401612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdaec06a170 con 0x7fdaec15f190 2024-09-17T01:36:44.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.582+0000 7fdae2a00640 1 -- 172.21.15.42:0/3949401612 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) ==== 74+0+16806 (secure 0 0 0) 0x7fdad8066990 con 0x7fdaec15f190 2024-09-17T01:36:44.581 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:44.581 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":66,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:36:29.180093+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:36:08.745986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T01:36:09.754042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6835/2030017417":"2024-09-18T01:36:29.180067+0000","172.21.15.42:6833/2030017417":"2024-09-18T01:36:29.180067+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:36:44.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.585+0000 7fdaf1c00640 1 -- 172.21.15.42:0/3949401612 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdacc078b90 msgr2=0x7fdacc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:44.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.585+0000 7fdaf1c00640 1 --2- 172.21.15.42:0/3949401612 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdacc078b90 0x7fdacc07b0a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdadc009f20 tx=0x7fdadc005f90 comp rx=0 tx=0).stop 2024-09-17T01:36:44.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.585+0000 7fdaf1c00640 1 -- 172.21.15.42:0/3949401612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdaec15f190 msgr2=0x7fdaec0b4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:44.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.585+0000 7fdaf1c00640 1 --2- 172.21.15.42:0/3949401612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdaec15f190 0x7fdaec0b4b80 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fdad800c370 tx=0x7fdad800c830 comp rx=0 tx=0).stop 2024-09-17T01:36:44.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.585+0000 7fdaf1c00640 1 -- 172.21.15.42:0/3949401612 shutdown_connections 2024-09-17T01:36:44.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.585+0000 7fdaf1c00640 1 --2- 172.21.15.42:0/3949401612 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdacc078b90 0x7fdacc07b0a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:44.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.585+0000 7fdaf1c00640 1 --2- 172.21.15.42:0/3949401612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdaec141110 0x7fdaec12f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:44.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.585+0000 7fdaf1c00640 1 --2- 172.21.15.42:0/3949401612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdaec15f190 0x7fdaec0b4b80 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:44.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.585+0000 7fdaf1c00640 1 --2- 172.21.15.42:0/3949401612 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdaec072e00 0x7fdaec0b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:44.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.585+0000 7fdaf1c00640 1 -- 172.21.15.42:0/3949401612 >> 172.21.15.42:0/3949401612 conn(0x7fdaec0b2930 msgr2=0x7fdaec0ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:44.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.585+0000 7fdaf1c00640 1 -- 172.21.15.42:0/3949401612 shutdown_connections 2024-09-17T01:36:44.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.585+0000 7fdaf1c00640 1 -- 172.21.15.42:0/3949401612 wait complete. 2024-09-17T01:36:44.606 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T01:36:44.607 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:36:44.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.837+0000 7f428d200640 1 -- 172.21.15.42:0/2207587468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f428815f190 msgr2=0x7f428806fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:44.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.837+0000 7f428d200640 1 --2- 172.21.15.42:0/2207587468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f428815f190 0x7f428806fe40 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4280005fd0 tx=0x7f428002a8b0 comp rx=0 tx=0).stop 2024-09-17T01:36:44.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.837+0000 7f428d200640 1 -- 172.21.15.42:0/2207587468 shutdown_connections 2024-09-17T01:36:44.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.837+0000 7f428d200640 1 --2- 172.21.15.42:0/2207587468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f428815f190 0x7f428806fe40 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:44.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.837+0000 7f428d200640 1 --2- 172.21.15.42:0/2207587468 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f428806db40 0x7f428815bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:44.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.837+0000 7f428d200640 1 -- 172.21.15.42:0/2207587468 >> 172.21.15.42:0/2207587468 conn(0x7f42880b2930 msgr2=0x7f428806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:44.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.838+0000 7f428d200640 1 -- 172.21.15.42:0/2207587468 shutdown_connections 2024-09-17T01:36:44.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.838+0000 7f428d200640 1 -- 172.21.15.42:0/2207587468 wait complete. 2024-09-17T01:36:44.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.840+0000 7f428d200640 1 Processor -- start 2024-09-17T01:36:44.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.840+0000 7f428d200640 1 -- start start 2024-09-17T01:36:44.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.841+0000 7f428d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4288072e00 0x7f428806cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:44.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.841+0000 7f428d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f428815f190 0x7f428813b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:44.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.841+0000 7f428d200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f428806d440 0x7f428813b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:44.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.841+0000 7f428d200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4288151520 con 0x7f4288072e00 2024-09-17T01:36:44.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.841+0000 7f428d200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4288070740 con 0x7f428815f190 2024-09-17T01:36:44.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.841+0000 7f428d200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f42881516a0 con 0x7f428806d440 2024-09-17T01:36:44.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.841+0000 7f4285e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4288072e00 0x7f428806cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:44.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.842+0000 7f4285e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4288072e00 0x7f428806cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49022/0 (socket says 172.21.15.42:49022) 2024-09-17T01:36:44.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.842+0000 7f4285e00640 1 -- 172.21.15.42:0/3217415130 learned_addr learned my addr 172.21.15.42:0/3217415130 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:44.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.842+0000 7f4285400640 1 --2- 172.21.15.42:0/3217415130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f428815f190 0x7f428813b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:44.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.842+0000 7f4286800640 1 --2- 172.21.15.42:0/3217415130 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f428806d440 0x7f428813b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:44.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.842+0000 7f4285e00640 1 -- 172.21.15.42:0/3217415130 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f428806d440 msgr2=0x7f428813b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:44.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.842+0000 7f4285e00640 1 --2- 172.21.15.42:0/3217415130 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f428806d440 0x7f428813b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:44.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.842+0000 7f4285e00640 1 -- 172.21.15.42:0/3217415130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f428815f190 msgr2=0x7f428813b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:44.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.842+0000 7f4285e00640 1 --2- 172.21.15.42:0/3217415130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f428815f190 0x7f428813b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:44.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.842+0000 7f4285e00640 1 -- 172.21.15.42:0/3217415130 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42880b4af0 con 0x7f4288072e00 2024-09-17T01:36:44.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.842+0000 7f4285e00640 1 --2- 172.21.15.42:0/3217415130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4288072e00 0x7f428806cf00 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f427800c460 tx=0x7f427800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:44.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.843+0000 7f427e000640 1 -- 172.21.15.42:0/3217415130 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4278016020 con 0x7f4288072e00 2024-09-17T01:36:44.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.843+0000 7f427e000640 1 -- 172.21.15.42:0/3217415130 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4278012940 con 0x7f4288072e00 2024-09-17T01:36:44.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.843+0000 7f427e000640 1 -- 172.21.15.42:0/3217415130 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4278012d90 con 0x7f4288072e00 2024-09-17T01:36:44.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.843+0000 7f428d200640 1 -- 172.21.15.42:0/3217415130 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42880b4dd0 con 0x7f4288072e00 2024-09-17T01:36:44.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.843+0000 7f428d200640 1 -- 172.21.15.42:0/3217415130 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42880b5390 con 0x7f4288072e00 2024-09-17T01:36:44.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.844+0000 7f428d200640 1 -- 172.21.15.42:0/3217415130 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f428815bc50 con 0x7f4288072e00 2024-09-17T01:36:44.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.845+0000 7f427e000640 1 -- 172.21.15.42:0/3217415130 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4278019020 con 0x7f4288072e00 2024-09-17T01:36:44.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.846+0000 7f427e000640 1 --2- 172.21.15.42:0/3217415130 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4268078b90 0x7f426807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:44.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.846+0000 7f427e000640 1 -- 172.21.15.42:0/3217415130 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5795+0+0 (secure 0 0 0) 0x7f427809abe0 con 0x7f4288072e00 2024-09-17T01:36:44.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.846+0000 7f4285400640 1 --2- 172.21.15.42:0/3217415130 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4268078b90 0x7f426807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:44.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.847+0000 7f4285400640 1 --2- 172.21.15.42:0/3217415130 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4268078b90 0x7f426807b0a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f428806dca0 tx=0x7f427400b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:44.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:44.850+0000 7f427e000640 1 -- 172.21.15.42:0/3217415130 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4278020020 con 0x7f4288072e00 2024-09-17T01:36:45.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.085+0000 7f428d200640 1 -- 172.21.15.42:0/3217415130 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f428806a170 con 0x7f4288072e00 2024-09-17T01:36:45.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.086+0000 7f427e000640 1 -- 172.21.15.42:0/3217415130 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5221 (secure 0 0 0) 0x7f4278062960 con 0x7f4288072e00 2024-09-17T01:36:45.084 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:45.084 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":47,"btime":"2024-09-17T01:36:32:454373+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2214729520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2214729520},{"type":"v1","addr":"172.21.15.43:6835","nonce":2214729520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/983475498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":983475498},{"type":"v1","addr":"172.21.15.43:6837","nonce":983475498}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1213307380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1213307380},{"type":"v1","addr":"172.21.15.42:6833","nonce":1213307380}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:36:10.790086+0000","modified":"2024-09-17T01:36:32.454363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":66,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6492":{"gid":6492,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6835/4251885944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":4251885944},{"type":"v1","addr":"172.21.15.42:6835","nonce":4251885944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6492,"qdb_cluster":[6492]},"id":4}]} 2024-09-17T01:36:45.084 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 47 2024-09-17T01:36:45.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.088+0000 7f428d200640 1 -- 172.21.15.42:0/3217415130 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4268078b90 msgr2=0x7f426807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:45.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.088+0000 7f428d200640 1 --2- 172.21.15.42:0/3217415130 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4268078b90 0x7f426807b0a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f428806dca0 tx=0x7f427400b2e0 comp rx=0 tx=0).stop 2024-09-17T01:36:45.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.088+0000 7f428d200640 1 -- 172.21.15.42:0/3217415130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4288072e00 msgr2=0x7f428806cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:45.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.088+0000 7f428d200640 1 --2- 172.21.15.42:0/3217415130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4288072e00 0x7f428806cf00 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f427800c460 tx=0x7f427800c920 comp rx=0 tx=0).stop 2024-09-17T01:36:45.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.088+0000 7f428d200640 1 -- 172.21.15.42:0/3217415130 shutdown_connections 2024-09-17T01:36:45.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.088+0000 7f428d200640 1 --2- 172.21.15.42:0/3217415130 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4268078b90 0x7f426807b0a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:45.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.088+0000 7f428d200640 1 --2- 172.21.15.42:0/3217415130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f428815f190 0x7f428813b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:45.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.088+0000 7f428d200640 1 --2- 172.21.15.42:0/3217415130 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f428806d440 0x7f428813b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:45.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.088+0000 7f428d200640 1 --2- 172.21.15.42:0/3217415130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4288072e00 0x7f428806cf00 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:45.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.088+0000 7f428d200640 1 -- 172.21.15.42:0/3217415130 >> 172.21.15.42:0/3217415130 conn(0x7f42880b2930 msgr2=0x7f428806f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:45.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.088+0000 7f428d200640 1 -- 172.21.15.42:0/3217415130 shutdown_connections 2024-09-17T01:36:45.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.088+0000 7f428d200640 1 -- 172.21.15.42:0/3217415130 wait complete. 2024-09-17T01:36:45.109 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:36:45.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.339+0000 7f98fbe00640 1 -- 172.21.15.42:0/3418502948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98fc0cf7c0 msgr2=0x7f98fc06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:45.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.339+0000 7f98fbe00640 1 --2- 172.21.15.42:0/3418502948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98fc0cf7c0 0x7f98fc06cd20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f98e4005fd0 tx=0x7f98e402a5d0 comp rx=0 tx=0).stop 2024-09-17T01:36:45.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.339+0000 7f98fbe00640 1 -- 172.21.15.42:0/3418502948 shutdown_connections 2024-09-17T01:36:45.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.339+0000 7f98fbe00640 1 --2- 172.21.15.42:0/3418502948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98fc0cf7c0 0x7f98fc06cd20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:45.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.339+0000 7f98fbe00640 1 --2- 172.21.15.42:0/3418502948 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f98fc0b4be0 0x7f98fc15d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:45.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.339+0000 7f98fbe00640 1 -- 172.21.15.42:0/3418502948 >> 172.21.15.42:0/3418502948 conn(0x7f98fc0b25f0 msgr2=0x7f98fc0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:45.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.339+0000 7f98fbe00640 1 -- 172.21.15.42:0/3418502948 shutdown_connections 2024-09-17T01:36:45.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.339+0000 7f98fbe00640 1 -- 172.21.15.42:0/3418502948 wait complete. 2024-09-17T01:36:45.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.341+0000 7f98fbe00640 1 Processor -- start 2024-09-17T01:36:45.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.342+0000 7f98fbe00640 1 -- start start 2024-09-17T01:36:45.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.343+0000 7f98fbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98fc06d260 0x7f98fc14f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:45.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.343+0000 7f98fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98fc0b4be0 0x7f98fc1f6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:45.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.343+0000 7f98fbe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f98fc0cf7c0 0x7f98fc151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:45.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.343+0000 7f98fbe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc153970 con 0x7f98fc0b4be0 2024-09-17T01:36:45.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.343+0000 7f98fbe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc1537f0 con 0x7f98fc06d260 2024-09-17T01:36:45.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.343+0000 7f98fbe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f98fc153af0 con 0x7f98fc0cf7c0 2024-09-17T01:36:45.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.343+0000 7f98f3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98fc0b4be0 0x7f98fc1f6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:45.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.343+0000 7f98f3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98fc0b4be0 0x7f98fc1f6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49024/0 (socket says 172.21.15.42:49024) 2024-09-17T01:36:45.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.343+0000 7f98f3e00640 1 -- 172.21.15.42:0/780919552 learned_addr learned my addr 172.21.15.42:0/780919552 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:45.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.343+0000 7f98faa00640 1 --2- 172.21.15.42:0/780919552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98fc06d260 0x7f98fc14f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:45.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.343+0000 7f98fb400640 1 --2- 172.21.15.42:0/780919552 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f98fc0cf7c0 0x7f98fc151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:45.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.344+0000 7f98f3e00640 1 -- 172.21.15.42:0/780919552 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f98fc0cf7c0 msgr2=0x7f98fc151260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:45.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.344+0000 7f98f3e00640 1 --2- 172.21.15.42:0/780919552 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f98fc0cf7c0 0x7f98fc151260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:45.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.344+0000 7f98f3e00640 1 -- 172.21.15.42:0/780919552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98fc06d260 msgr2=0x7f98fc14f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:45.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.344+0000 7f98f3e00640 1 --2- 172.21.15.42:0/780919552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98fc06d260 0x7f98fc14f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:45.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.344+0000 7f98f3e00640 1 -- 172.21.15.42:0/780919552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98fc1f4fc0 con 0x7f98fc0b4be0 2024-09-17T01:36:45.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.344+0000 7f98f3e00640 1 --2- 172.21.15.42:0/780919552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98fc0b4be0 0x7f98fc1f6060 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f98e4034040 tx=0x7f98e40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:45.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.344+0000 7f98f2a00640 1 -- 172.21.15.42:0/780919552 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e403e030 con 0x7f98fc0b4be0 2024-09-17T01:36:45.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.344+0000 7f98f2a00640 1 -- 172.21.15.42:0/780919552 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98e4003ca0 con 0x7f98fc0b4be0 2024-09-17T01:36:45.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.344+0000 7f98f2a00640 1 -- 172.21.15.42:0/780919552 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e4035040 con 0x7f98fc0b4be0 2024-09-17T01:36:45.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.345+0000 7f98fbe00640 1 -- 172.21.15.42:0/780919552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98fc14f7b0 con 0x7f98fc0b4be0 2024-09-17T01:36:45.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.345+0000 7f98fbe00640 1 -- 172.21.15.42:0/780919552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98fc1f5580 con 0x7f98fc0b4be0 2024-09-17T01:36:45.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.346+0000 7f98fbe00640 1 -- 172.21.15.42:0/780919552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98fc15d6b0 con 0x7f98fc0b4be0 2024-09-17T01:36:45.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.347+0000 7f98f2a00640 1 -- 172.21.15.42:0/780919552 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f98e4041030 con 0x7f98fc0b4be0 2024-09-17T01:36:45.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.348+0000 7f98f2a00640 1 --2- 172.21.15.42:0/780919552 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f98d8078b90 0x7f98d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:45.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.348+0000 7f98f2a00640 1 -- 172.21.15.42:0/780919552 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5795+0+0 (secure 0 0 0) 0x7f98e40bb280 con 0x7f98fc0b4be0 2024-09-17T01:36:45.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.348+0000 7f98faa00640 1 --2- 172.21.15.42:0/780919552 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f98d8078b90 0x7f98d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:45.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.349+0000 7f98faa00640 1 --2- 172.21.15.42:0/780919552 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f98d8078b90 0x7f98d807b0a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f98ec0095f0 tx=0x7f98ec005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:45.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.353+0000 7f98f2a00640 1 -- 172.21.15.42:0/780919552 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f98e4083000 con 0x7f98fc0b4be0 2024-09-17T01:36:45.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.581+0000 7f98fbe00640 1 -- 172.21.15.42:0/780919552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98fc0d0290 con 0x7f98fc0b4be0 2024-09-17T01:36:45.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.582+0000 7f98f2a00640 1 -- 172.21.15.42:0/780919552 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5221 (secure 0 0 0) 0x7f98e4087a30 con 0x7f98fc0b4be0 2024-09-17T01:36:45.580 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:45.580 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":47,"btime":"2024-09-17T01:36:32:454373+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2214729520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2214729520},{"type":"v1","addr":"172.21.15.43:6835","nonce":2214729520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/983475498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":983475498},{"type":"v1","addr":"172.21.15.43:6837","nonce":983475498}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1213307380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1213307380},{"type":"v1","addr":"172.21.15.42:6833","nonce":1213307380}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:36:10.790086+0000","modified":"2024-09-17T01:36:32.454363+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":66,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6492},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6492":{"gid":6492,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6835/4251885944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":4251885944},{"type":"v1","addr":"172.21.15.42:6835","nonce":4251885944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6492,"qdb_cluster":[6492]},"id":4}]} 2024-09-17T01:36:45.580 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 47 2024-09-17T01:36:45.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.584+0000 7f98fbe00640 1 -- 172.21.15.42:0/780919552 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f98d8078b90 msgr2=0x7f98d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:45.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.584+0000 7f98fbe00640 1 --2- 172.21.15.42:0/780919552 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f98d8078b90 0x7f98d807b0a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f98ec0095f0 tx=0x7f98ec005f90 comp rx=0 tx=0).stop 2024-09-17T01:36:45.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.585+0000 7f98fbe00640 1 -- 172.21.15.42:0/780919552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98fc0b4be0 msgr2=0x7f98fc1f6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:45.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.585+0000 7f98fbe00640 1 --2- 172.21.15.42:0/780919552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98fc0b4be0 0x7f98fc1f6060 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f98e4034040 tx=0x7f98e40038a0 comp rx=0 tx=0).stop 2024-09-17T01:36:45.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.585+0000 7f98fbe00640 1 -- 172.21.15.42:0/780919552 shutdown_connections 2024-09-17T01:36:45.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.585+0000 7f98fbe00640 1 --2- 172.21.15.42:0/780919552 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f98d8078b90 0x7f98d807b0a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:45.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.585+0000 7f98fbe00640 1 --2- 172.21.15.42:0/780919552 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f98fc0cf7c0 0x7f98fc151260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:45.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.585+0000 7f98fbe00640 1 --2- 172.21.15.42:0/780919552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98fc0b4be0 0x7f98fc1f6060 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:45.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.585+0000 7f98fbe00640 1 --2- 172.21.15.42:0/780919552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98fc06d260 0x7f98fc14f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:45.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.585+0000 7f98fbe00640 1 -- 172.21.15.42:0/780919552 >> 172.21.15.42:0/780919552 conn(0x7f98fc0b25f0 msgr2=0x7f98fc15e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:45.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.585+0000 7f98fbe00640 1 -- 172.21.15.42:0/780919552 shutdown_connections 2024-09-17T01:36:45.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.585+0000 7f98fbe00640 1 -- 172.21.15.42:0/780919552 wait complete. 2024-09-17T01:36:45.604 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:36:45.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.832+0000 7f3873e00640 1 -- 172.21.15.42:0/2388303813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38740b7b80 msgr2=0x7f387415e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:45.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.832+0000 7f3873e00640 1 --2- 172.21.15.42:0/2388303813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38740b7b80 0x7f387415e320 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f385c005fd0 tx=0x7f385c02a530 comp rx=0 tx=0).stop 2024-09-17T01:36:45.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.832+0000 7f3873e00640 1 -- 172.21.15.42:0/2388303813 shutdown_connections 2024-09-17T01:36:45.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.832+0000 7f3873e00640 1 --2- 172.21.15.42:0/2388303813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38740b7b80 0x7f387415e320 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:45.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.832+0000 7f3873e00640 1 --2- 172.21.15.42:0/2388303813 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f38740ccd80 0x7f38740ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:45.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.832+0000 7f3873e00640 1 -- 172.21.15.42:0/2388303813 >> 172.21.15.42:0/2388303813 conn(0x7f38740b3ed0 msgr2=0x7f38740b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:45.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.832+0000 7f3873e00640 1 -- 172.21.15.42:0/2388303813 shutdown_connections 2024-09-17T01:36:45.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.832+0000 7f3873e00640 1 -- 172.21.15.42:0/2388303813 wait complete. 2024-09-17T01:36:45.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.835+0000 7f3873e00640 1 Processor -- start 2024-09-17T01:36:45.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.835+0000 7f3873e00640 1 -- start start 2024-09-17T01:36:45.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.836+0000 7f3873e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38740b7610 0x7f387414c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:45.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.836+0000 7f3873e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38740b7b80 0x7f38740afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:45.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.836+0000 7f3873e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f387409ed70 0x7f387409f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:45.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.836+0000 7f3873e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f387415ebf0 con 0x7f38740b7b80 2024-09-17T01:36:45.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.836+0000 7f3873e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f387415ea70 con 0x7f38740b7610 2024-09-17T01:36:45.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.836+0000 7f3873e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f38740cf6a0 con 0x7f387409ed70 2024-09-17T01:36:45.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.836+0000 7f386be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38740b7b80 0x7f38740afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:45.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.836+0000 7f386be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38740b7b80 0x7f38740afbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36364/0 (socket says 172.21.15.42:36364) 2024-09-17T01:36:45.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.836+0000 7f386be00640 1 -- 172.21.15.42:0/3982885145 learned_addr learned my addr 172.21.15.42:0/3982885145 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:45.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.837+0000 7f3872a00640 1 --2- 172.21.15.42:0/3982885145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38740b7610 0x7f387414c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:45.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.837+0000 7f3873400640 1 --2- 172.21.15.42:0/3982885145 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f387409ed70 0x7f387409f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:45.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.837+0000 7f386be00640 1 -- 172.21.15.42:0/3982885145 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f387409ed70 msgr2=0x7f387409f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:45.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.837+0000 7f386be00640 1 --2- 172.21.15.42:0/3982885145 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f387409ed70 0x7f387409f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:45.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.837+0000 7f386be00640 1 -- 172.21.15.42:0/3982885145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38740b7610 msgr2=0x7f387414c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:45.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.837+0000 7f386be00640 1 --2- 172.21.15.42:0/3982885145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38740b7610 0x7f387414c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:45.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.837+0000 7f386be00640 1 -- 172.21.15.42:0/3982885145 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387409f6c0 con 0x7f38740b7b80 2024-09-17T01:36:45.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.837+0000 7f386be00640 1 --2- 172.21.15.42:0/3982885145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38740b7b80 0x7f38740afbc0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f385c034040 tx=0x7f385c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:45.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.837+0000 7f386b400640 1 -- 172.21.15.42:0/3982885145 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c03e030 con 0x7f38740b7b80 2024-09-17T01:36:45.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.837+0000 7f386b400640 1 -- 172.21.15.42:0/3982885145 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f385c003d90 con 0x7f38740b7b80 2024-09-17T01:36:45.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.838+0000 7f386b400640 1 -- 172.21.15.42:0/3982885145 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c035040 con 0x7f38740b7b80 2024-09-17T01:36:45.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.838+0000 7f3873e00640 1 -- 172.21.15.42:0/3982885145 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f387414cd20 con 0x7f38740b7b80 2024-09-17T01:36:45.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.838+0000 7f3873e00640 1 -- 172.21.15.42:0/3982885145 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f387414d2e0 con 0x7f38740b7b80 2024-09-17T01:36:45.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.839+0000 7f3873e00640 1 -- 172.21.15.42:0/3982885145 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38740ccd80 con 0x7f38740b7b80 2024-09-17T01:36:45.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.840+0000 7f386b400640 1 -- 172.21.15.42:0/3982885145 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f385c041030 con 0x7f38740b7b80 2024-09-17T01:36:45.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.841+0000 7f386b400640 1 --2- 172.21.15.42:0/3982885145 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3850078b90 0x7f385007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:45.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.841+0000 7f386b400640 1 -- 172.21.15.42:0/3982885145 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5795+0+0 (secure 0 0 0) 0x7f385c0bb970 con 0x7f38740b7b80 2024-09-17T01:36:45.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.841+0000 7f3872a00640 1 --2- 172.21.15.42:0/3982885145 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3850078b90 0x7f385007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:45.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.842+0000 7f3872a00640 1 --2- 172.21.15.42:0/3982885145 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3850078b90 0x7f385007b0a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3864005fd0 tx=0x7f3864005850 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:45.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:45.845+0000 7f386b400640 1 -- 172.21.15.42:0/3982885145 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f387409f6c0 con 0x7f38740b7b80 2024-09-17T01:36:46.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.039+0000 7f3873e00640 1 -- 172.21.15.42:0/3982885145 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38740ce250 con 0x7f38740b7b80 2024-09-17T01:36:46.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.040+0000 7f386b400640 1 -- 172.21.15.42:0/3982885145 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) ==== 74+0+16806 (secure 0 0 0) 0x7f385c083cb0 con 0x7f38740b7b80 2024-09-17T01:36:46.038 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:46.038 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":66,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:36:29.180093+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:36:08.745986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T01:36:09.754042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6835/2030017417":"2024-09-18T01:36:29.180067+0000","172.21.15.42:6833/2030017417":"2024-09-18T01:36:29.180067+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:36:46.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.042+0000 7f3873e00640 1 -- 172.21.15.42:0/3982885145 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3850078b90 msgr2=0x7f385007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:46.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.042+0000 7f3873e00640 1 --2- 172.21.15.42:0/3982885145 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3850078b90 0x7f385007b0a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3864005fd0 tx=0x7f3864005850 comp rx=0 tx=0).stop 2024-09-17T01:36:46.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.042+0000 7f3873e00640 1 -- 172.21.15.42:0/3982885145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38740b7b80 msgr2=0x7f38740afbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:46.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.042+0000 7f3873e00640 1 --2- 172.21.15.42:0/3982885145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38740b7b80 0x7f38740afbc0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f385c034040 tx=0x7f385c0038a0 comp rx=0 tx=0).stop 2024-09-17T01:36:46.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.043+0000 7f3873e00640 1 -- 172.21.15.42:0/3982885145 shutdown_connections 2024-09-17T01:36:46.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.043+0000 7f3873e00640 1 --2- 172.21.15.42:0/3982885145 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3850078b90 0x7f385007b0a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:46.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.043+0000 7f3873e00640 1 --2- 172.21.15.42:0/3982885145 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f387409ed70 0x7f387409f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:46.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.043+0000 7f3873e00640 1 --2- 172.21.15.42:0/3982885145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38740b7b80 0x7f38740afbc0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:46.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.043+0000 7f3873e00640 1 --2- 172.21.15.42:0/3982885145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38740b7610 0x7f387414c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:46.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.043+0000 7f3873e00640 1 -- 172.21.15.42:0/3982885145 >> 172.21.15.42:0/3982885145 conn(0x7f38740b3ed0 msgr2=0x7f38740b6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:46.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.043+0000 7f3873e00640 1 -- 172.21.15.42:0/3982885145 shutdown_connections 2024-09-17T01:36:46.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.043+0000 7f3873e00640 1 -- 172.21.15.42:0/3982885145 wait complete. 2024-09-17T01:36:46.066 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T01:36:46.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.297+0000 7fa1b9600640 1 -- 172.21.15.42:0/4257813974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1b415fbe0 msgr2=0x7fa1b415c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:46.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.297+0000 7fa1b9600640 1 --2- 172.21.15.42:0/4257813974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1b415fbe0 0x7fa1b415c3c0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009830 tx=0x7fa1a402a520 comp rx=0 tx=0).stop 2024-09-17T01:36:46.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.297+0000 7fa1b9600640 1 -- 172.21.15.42:0/4257813974 shutdown_connections 2024-09-17T01:36:46.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.297+0000 7fa1b9600640 1 --2- 172.21.15.42:0/4257813974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1b415fbe0 0x7fa1b415c3c0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:46.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.297+0000 7fa1b9600640 1 -- 172.21.15.42:0/4257813974 >> 172.21.15.42:0/4257813974 conn(0x7fa1b4073f20 msgr2=0x7fa1b406cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:46.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.297+0000 7fa1b9600640 1 -- 172.21.15.42:0/4257813974 shutdown_connections 2024-09-17T01:36:46.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.297+0000 7fa1b9600640 1 -- 172.21.15.42:0/4257813974 wait complete. 2024-09-17T01:36:46.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.299+0000 7fa1b9600640 1 Processor -- start 2024-09-17T01:36:46.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.299+0000 7fa1b9600640 1 -- start start 2024-09-17T01:36:46.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.301+0000 7fa1b9600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1b415fbe0 0x7fa1b40cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:46.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.301+0000 7fa1b9600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1b4162520 0x7fa1b40cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:46.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.301+0000 7fa1b9600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa1b4162930 0x7fa1b40c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:46.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.301+0000 7fa1b9600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b40d0e80 con 0x7fa1b415fbe0 2024-09-17T01:36:46.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.301+0000 7fa1b9600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b40d0d00 con 0x7fa1b4162520 2024-09-17T01:36:46.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.301+0000 7fa1b9600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa1b40d1000 con 0x7fa1b4162930 2024-09-17T01:36:46.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.301+0000 7fa1b3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1b415fbe0 0x7fa1b40cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:46.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.301+0000 7fa1b3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1b415fbe0 0x7fa1b40cdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36382/0 (socket says 172.21.15.42:36382) 2024-09-17T01:36:46.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.301+0000 7fa1b3e00640 1 -- 172.21.15.42:0/3539833753 learned_addr learned my addr 172.21.15.42:0/3539833753 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:46.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.301+0000 7fa1ab400640 1 --2- 172.21.15.42:0/3539833753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1b4162520 0x7fa1b40cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:46.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.301+0000 7fa1b8c00640 1 --2- 172.21.15.42:0/3539833753 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa1b4162930 0x7fa1b40c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:46.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.302+0000 7fa1b3e00640 1 -- 172.21.15.42:0/3539833753 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa1b4162930 msgr2=0x7fa1b40c9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:46.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.302+0000 7fa1b3e00640 1 --2- 172.21.15.42:0/3539833753 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa1b4162930 0x7fa1b40c9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:46.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.302+0000 7fa1b3e00640 1 -- 172.21.15.42:0/3539833753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1b4162520 msgr2=0x7fa1b40cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:46.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.302+0000 7fa1b3e00640 1 --2- 172.21.15.42:0/3539833753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1b4162520 0x7fa1b40cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:46.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.302+0000 7fa1b3e00640 1 -- 172.21.15.42:0/3539833753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b40ce590 con 0x7fa1b415fbe0 2024-09-17T01:36:46.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.302+0000 7fa1b3e00640 1 --2- 172.21.15.42:0/3539833753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1b415fbe0 0x7fa1b40cdcb0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa1a402ab10 tx=0x7fa1a4033c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:46.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.302+0000 7fa1b0c00640 1 -- 172.21.15.42:0/3539833753 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4031b60 con 0x7fa1b415fbe0 2024-09-17T01:36:46.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.302+0000 7fa1b0c00640 1 -- 172.21.15.42:0/3539833753 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1a4031df0 con 0x7fa1b415fbe0 2024-09-17T01:36:46.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.302+0000 7fa1b0c00640 1 -- 172.21.15.42:0/3539833753 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4005280 con 0x7fa1b415fbe0 2024-09-17T01:36:46.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.302+0000 7fa1b9600640 1 -- 172.21.15.42:0/3539833753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1b40c8180 con 0x7fa1b415fbe0 2024-09-17T01:36:46.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.302+0000 7fa1b9600640 1 -- 172.21.15.42:0/3539833753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1b40c8740 con 0x7fa1b415fbe0 2024-09-17T01:36:46.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.303+0000 7fa1b9600640 1 -- 172.21.15.42:0/3539833753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1b40c7c60 con 0x7fa1b415fbe0 2024-09-17T01:36:46.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.305+0000 7fa1b0c00640 1 -- 172.21.15.42:0/3539833753 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa1a4005420 con 0x7fa1b415fbe0 2024-09-17T01:36:46.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.306+0000 7fa1b0c00640 1 --2- 172.21.15.42:0/3539833753 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa190078b90 0x7fa19007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:46.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.306+0000 7fa1b0c00640 1 -- 172.21.15.42:0/3539833753 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5795+0+0 (secure 0 0 0) 0x7fa1a40bbfe0 con 0x7fa1b415fbe0 2024-09-17T01:36:46.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.306+0000 7fa1ab400640 1 --2- 172.21.15.42:0/3539833753 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa190078b90 0x7fa19007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:46.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.307+0000 7fa1ab400640 1 --2- 172.21.15.42:0/3539833753 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa190078b90 0x7fa19007b0a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa19c007fd0 tx=0x7fa19c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:46.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.310+0000 7fa1b0c00640 1 -- 172.21.15.42:0/3539833753 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa1b40c7c60 con 0x7fa1b415fbe0 2024-09-17T01:36:46.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.545+0000 7fa1b9600640 1 -- 172.21.15.42:0/3539833753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa1b406cd20 con 0x7fa1b415fbe0 2024-09-17T01:36:46.543 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-17T01:36:46.545+0000 7f9961e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:36:46.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.547+0000 7fa1b0c00640 1 -- 172.21.15.42:0/3539833753 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) ==== 161+0+0 (secure 0 0 0) 0x7fa1b406cd20 con 0x7fa1b415fbe0 2024-09-17T01:36:46.545 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T01:36:46.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.551+0000 7fa1b9600640 1 -- 172.21.15.42:0/3539833753 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa190078b90 msgr2=0x7fa19007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:46.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.551+0000 7fa1b9600640 1 --2- 172.21.15.42:0/3539833753 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa190078b90 0x7fa19007b0a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa19c007fd0 tx=0x7fa19c009040 comp rx=0 tx=0).stop 2024-09-17T01:36:46.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.551+0000 7fa1b9600640 1 -- 172.21.15.42:0/3539833753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1b415fbe0 msgr2=0x7fa1b40cdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:46.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.551+0000 7fa1b9600640 1 --2- 172.21.15.42:0/3539833753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1b415fbe0 0x7fa1b40cdcb0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa1a402ab10 tx=0x7fa1a4033c10 comp rx=0 tx=0).stop 2024-09-17T01:36:46.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.551+0000 7fa1b9600640 1 -- 172.21.15.42:0/3539833753 shutdown_connections 2024-09-17T01:36:46.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.551+0000 7fa1b9600640 1 --2- 172.21.15.42:0/3539833753 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa190078b90 0x7fa19007b0a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:46.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.551+0000 7fa1b9600640 1 --2- 172.21.15.42:0/3539833753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1b4162520 0x7fa1b40cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:46.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.551+0000 7fa1b9600640 1 --2- 172.21.15.42:0/3539833753 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa1b4162930 0x7fa1b40c9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:46.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.551+0000 7fa1b9600640 1 --2- 172.21.15.42:0/3539833753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1b415fbe0 0x7fa1b40cdcb0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:46.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.551+0000 7fa1b9600640 1 -- 172.21.15.42:0/3539833753 >> 172.21.15.42:0/3539833753 conn(0x7fa1b4073f20 msgr2=0x7fa1b415cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:46.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.551+0000 7fa1b9600640 1 -- 172.21.15.42:0/3539833753 shutdown_connections 2024-09-17T01:36:46.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.551+0000 7fa1b9600640 1 -- 172.21.15.42:0/3539833753 wait complete. 2024-09-17T01:36:46.558 INFO:tasks.ceph.mds.c.smithi042.stderr: -5364> 2024-09-17T01:36:34.453+0000 7f2e64200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:36:46.576 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T01:36:46.686 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:36:46.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.814+0000 7f9b47800640 1 -- 172.21.15.42:0/3047406506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b400b3550 msgr2=0x7f9b4015cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:46.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.814+0000 7f9b47800640 1 --2- 172.21.15.42:0/3047406506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b400b3550 0x7f9b4015cec0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f9b30009830 tx=0x7f9b3002a480 comp rx=0 tx=0).stop 2024-09-17T01:36:46.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.814+0000 7f9b47800640 1 -- 172.21.15.42:0/3047406506 shutdown_connections 2024-09-17T01:36:46.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.814+0000 7f9b47800640 1 --2- 172.21.15.42:0/3047406506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b400b3550 0x7f9b4015cec0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:46.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.814+0000 7f9b47800640 1 -- 172.21.15.42:0/3047406506 >> 172.21.15.42:0/3047406506 conn(0x7f9b400b2930 msgr2=0x7f9b4006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:46.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.815+0000 7f9b47800640 1 -- 172.21.15.42:0/3047406506 shutdown_connections 2024-09-17T01:36:46.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.815+0000 7f9b47800640 1 -- 172.21.15.42:0/3047406506 wait complete. 2024-09-17T01:36:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.817+0000 7f9b47800640 1 Processor -- start 2024-09-17T01:36:46.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.817+0000 7f9b47800640 1 -- start start 2024-09-17T01:36:46.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.818+0000 7f9b47800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9b400b3550 0x7f9b401415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:46.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.818+0000 7f9b47800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b400cec40 0x7f9b4013ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:46.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.818+0000 7f9b47800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b40142f40 0x7f9b400b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:46.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.818+0000 7f9b47800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9b400cf050 con 0x7f9b40142f40 2024-09-17T01:36:46.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.818+0000 7f9b47800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4006dd50 con 0x7f9b400cec40 2024-09-17T01:36:46.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.818+0000 7f9b47800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9b400cf1d0 con 0x7f9b400b3550 2024-09-17T01:36:46.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.819+0000 7f9b37e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b400cec40 0x7f9b4013ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:46.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.819+0000 7f9b37e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b400cec40 0x7f9b4013ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:57568/0 (socket says 172.21.15.42:57568) 2024-09-17T01:36:46.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.819+0000 7f9b37e00640 1 -- 172.21.15.42:0/1103187947 learned_addr learned my addr 172.21.15.42:0/1103187947 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:46.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.819+0000 7f9b44e00640 1 --2- 172.21.15.42:0/1103187947 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9b400b3550 0x7f9b401415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:46.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.819+0000 7f9b45800640 1 --2- 172.21.15.42:0/1103187947 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b40142f40 0x7f9b400b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:46.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.819+0000 7f9b37e00640 1 -- 172.21.15.42:0/1103187947 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9b400b3550 msgr2=0x7f9b401415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:46.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.819+0000 7f9b37e00640 1 --2- 172.21.15.42:0/1103187947 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9b400b3550 0x7f9b401415a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:46.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.819+0000 7f9b37e00640 1 -- 172.21.15.42:0/1103187947 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b40142f40 msgr2=0x7f9b400b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:46.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.819+0000 7f9b37e00640 1 --2- 172.21.15.42:0/1103187947 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b40142f40 0x7f9b400b1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:46.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.819+0000 7f9b37e00640 1 -- 172.21.15.42:0/1103187947 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b400ab260 con 0x7f9b400cec40 2024-09-17T01:36:46.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.820+0000 7f9b37e00640 1 --2- 172.21.15.42:0/1103187947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b400cec40 0x7f9b4013ed50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9b2800b3c0 tx=0x7f9b2800b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:46.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.820+0000 7f9b3d600640 1 -- 172.21.15.42:0/1103187947 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b28011830 con 0x7f9b400cec40 2024-09-17T01:36:46.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.820+0000 7f9b3d600640 1 -- 172.21.15.42:0/1103187947 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b28016070 con 0x7f9b400cec40 2024-09-17T01:36:46.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.820+0000 7f9b3d600640 1 -- 172.21.15.42:0/1103187947 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b28011da0 con 0x7f9b400cec40 2024-09-17T01:36:46.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.820+0000 7f9b47800640 1 -- 172.21.15.42:0/1103187947 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b400ab540 con 0x7f9b400cec40 2024-09-17T01:36:46.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.820+0000 7f9b47800640 1 -- 172.21.15.42:0/1103187947 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b400abb00 con 0x7f9b400cec40 2024-09-17T01:36:46.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.821+0000 7f9b47800640 1 -- 172.21.15.42:0/1103187947 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b4015cec0 con 0x7f9b400cec40 2024-09-17T01:36:46.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.823+0000 7f9b3d600640 1 -- 172.21.15.42:0/1103187947 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9b2801b460 con 0x7f9b400cec40 2024-09-17T01:36:46.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.823+0000 7f9b3d600640 1 --2- 172.21.15.42:0/1103187947 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9b1c078b90 0x7f9b1c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:46.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.824+0000 7f9b3d600640 1 -- 172.21.15.42:0/1103187947 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5881+0+0 (secure 0 0 0) 0x7f9b2809a840 con 0x7f9b400cec40 2024-09-17T01:36:46.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.824+0000 7f9b44e00640 1 --2- 172.21.15.42:0/1103187947 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9b1c078b90 0x7f9b1c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:46.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.825+0000 7f9b44e00640 1 --2- 172.21.15.42:0/1103187947 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9b1c078b90 0x7f9b1c07b0a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9b30034000 tx=0x7f9b30004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:46.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:46.830+0000 7f9b3d600640 1 -- 172.21.15.42:0/1103187947 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9b28020020 con 0x7f9b400cec40 2024-09-17T01:36:47.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.064+0000 7f9b47800640 1 -- 172.21.15.42:0/1103187947 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9b4006a170 con 0x7f9b400cec40 2024-09-17T01:36:47.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.553+0000 7f9b3d600640 1 -- 172.21.15.42:0/1103187947 <== mon.1 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v49) ==== 104+0+0 (secure 0 0 0) 0x7f9b28069070 con 0x7f9b400cec40 2024-09-17T01:36:47.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.556+0000 7f9b47800640 1 -- 172.21.15.42:0/1103187947 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9b1c078b90 msgr2=0x7f9b1c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:47.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.556+0000 7f9b47800640 1 --2- 172.21.15.42:0/1103187947 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9b1c078b90 0x7f9b1c07b0a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9b30034000 tx=0x7f9b30004730 comp rx=0 tx=0).stop 2024-09-17T01:36:47.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.556+0000 7f9b47800640 1 -- 172.21.15.42:0/1103187947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b400cec40 msgr2=0x7f9b4013ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:47.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.556+0000 7f9b47800640 1 --2- 172.21.15.42:0/1103187947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b400cec40 0x7f9b4013ed50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9b2800b3c0 tx=0x7f9b2800b880 comp rx=0 tx=0).stop 2024-09-17T01:36:47.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.557+0000 7f9b47800640 1 -- 172.21.15.42:0/1103187947 shutdown_connections 2024-09-17T01:36:47.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.557+0000 7f9b47800640 1 --2- 172.21.15.42:0/1103187947 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9b1c078b90 0x7f9b1c07b0a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:47.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.557+0000 7f9b47800640 1 --2- 172.21.15.42:0/1103187947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b400cec40 0x7f9b4013ed50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:47.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.557+0000 7f9b47800640 1 --2- 172.21.15.42:0/1103187947 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b40142f40 0x7f9b400b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:47.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.557+0000 7f9b47800640 1 --2- 172.21.15.42:0/1103187947 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9b400b3550 0x7f9b401415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:47.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.557+0000 7f9b47800640 1 -- 172.21.15.42:0/1103187947 >> 172.21.15.42:0/1103187947 conn(0x7f9b400b2930 msgr2=0x7f9b4015f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:47.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.557+0000 7f9b47800640 1 -- 172.21.15.42:0/1103187947 shutdown_connections 2024-09-17T01:36:47.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.557+0000 7f9b47800640 1 -- 172.21.15.42:0/1103187947 wait complete. 2024-09-17T01:36:47.578 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T01:36:47.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.816+0000 7ff093e00640 1 -- 172.21.15.42:0/3513124417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff08c0cdb20 msgr2=0x7ff08c0cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:47.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.816+0000 7ff093e00640 1 --2- 172.21.15.42:0/3513124417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff08c0cdb20 0x7ff08c0cdf30 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0747b0 tx=0x7ff07802a560 comp rx=0 tx=0).stop 2024-09-17T01:36:47.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.816+0000 7ff093e00640 1 -- 172.21.15.42:0/3513124417 shutdown_connections 2024-09-17T01:36:47.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.816+0000 7ff093e00640 1 --2- 172.21.15.42:0/3513124417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff08c0cdb20 0x7ff08c0cdf30 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:47.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.816+0000 7ff093e00640 1 --2- 172.21.15.42:0/3513124417 >> v2:172.21.15.43:3300/0 conn(0x7ff08c0b56d0 0x7ff08c0b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:47.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.816+0000 7ff093e00640 1 -- 172.21.15.42:0/3513124417 >> 172.21.15.42:0/3513124417 conn(0x7ff08c0b28f0 msgr2=0x7ff08c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:47.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.816+0000 7ff093e00640 1 -- 172.21.15.42:0/3513124417 shutdown_connections 2024-09-17T01:36:47.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.816+0000 7ff093e00640 1 -- 172.21.15.42:0/3513124417 wait complete. 2024-09-17T01:36:47.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.819+0000 7ff093e00640 1 Processor -- start 2024-09-17T01:36:47.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.819+0000 7ff093e00640 1 -- start start 2024-09-17T01:36:47.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.820+0000 7ff093e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff08c06d430 0x7ff08c1f8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:47.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.820+0000 7ff093e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff08c0b56d0 0x7ff08c15c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:47.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.820+0000 7ff093e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff08c0cdb20 0x7ff08c0ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:47.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.820+0000 7ff093e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c15d560 con 0x7ff08c06d430 2024-09-17T01:36:47.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.820+0000 7ff093e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c15d3e0 con 0x7ff08c0cdb20 2024-09-17T01:36:47.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.820+0000 7ff093e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff08c15d6e0 con 0x7ff08c0b56d0 2024-09-17T01:36:47.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.821+0000 7ff091400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff08c06d430 0x7ff08c1f8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:47.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.821+0000 7ff091400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff08c06d430 0x7ff08c1f8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36444/0 (socket says 172.21.15.42:36444) 2024-09-17T01:36:47.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.821+0000 7ff091400640 1 -- 172.21.15.42:0/568638869 learned_addr learned my addr 172.21.15.42:0/568638869 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:47.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.821+0000 7ff090a00640 1 --2- 172.21.15.42:0/568638869 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff08c0b56d0 0x7ff08c15c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:47.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.821+0000 7ff091e00640 1 --2- 172.21.15.42:0/568638869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff08c0cdb20 0x7ff08c0ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:47.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.821+0000 7ff091400640 1 -- 172.21.15.42:0/568638869 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff08c0b56d0 msgr2=0x7ff08c15c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:47.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.821+0000 7ff091400640 1 --2- 172.21.15.42:0/568638869 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff08c0b56d0 0x7ff08c15c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:47.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.821+0000 7ff091400640 1 -- 172.21.15.42:0/568638869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff08c0cdb20 msgr2=0x7ff08c0ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:47.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.821+0000 7ff091400640 1 --2- 172.21.15.42:0/568638869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff08c0cdb20 0x7ff08c0ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:47.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.821+0000 7ff091400640 1 -- 172.21.15.42:0/568638869 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08c1f9770 con 0x7ff08c06d430 2024-09-17T01:36:47.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.821+0000 7ff091400640 1 --2- 172.21.15.42:0/568638869 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff08c06d430 0x7ff08c1f8e00 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7ff08000c970 tx=0x7ff08000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:47.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.822+0000 7ff089600640 1 -- 172.21.15.42:0/568638869 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff080007bb0 con 0x7ff08c06d430 2024-09-17T01:36:47.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.822+0000 7ff089600640 1 -- 172.21.15.42:0/568638869 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff080007e40 con 0x7ff08c06d430 2024-09-17T01:36:47.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.822+0000 7ff089600640 1 -- 172.21.15.42:0/568638869 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08000f690 con 0x7ff08c06d430 2024-09-17T01:36:47.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.822+0000 7ff093e00640 1 -- 172.21.15.42:0/568638869 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff08c1f9a50 con 0x7ff08c06d430 2024-09-17T01:36:47.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.822+0000 7ff093e00640 1 -- 172.21.15.42:0/568638869 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff08c0c5940 con 0x7ff08c06d430 2024-09-17T01:36:47.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.823+0000 7ff093e00640 1 -- 172.21.15.42:0/568638869 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff08c15dc00 con 0x7ff08c06d430 2024-09-17T01:36:47.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.824+0000 7ff089600640 1 -- 172.21.15.42:0/568638869 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff08000f830 con 0x7ff08c06d430 2024-09-17T01:36:47.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.825+0000 7ff089600640 1 --2- 172.21.15.42:0/568638869 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff06c078b90 0x7ff06c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:47.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.825+0000 7ff089600640 1 -- 172.21.15.42:0/568638869 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5939+0+0 (secure 0 0 0) 0x7ff08009b4e0 con 0x7ff08c06d430 2024-09-17T01:36:47.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.825+0000 7ff090a00640 1 --2- 172.21.15.42:0/568638869 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff06c078b90 0x7ff06c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:47.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.826+0000 7ff090a00640 1 --2- 172.21.15.42:0/568638869 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff06c078b90 0x7ff06c07b0a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff078033000 tx=0x7ff078004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:47.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:47.829+0000 7ff089600640 1 -- 172.21.15.42:0/568638869 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff080014030 con 0x7ff08c06d430 2024-09-17T01:36:48.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:48.024+0000 7ff093e00640 1 -- 172.21.15.42:0/568638869 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff08c145fa0 con 0x7ff08c06d430 2024-09-17T01:36:48.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:48.782+0000 7ff089600640 1 -- 172.21.15.42:0/568638869 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v69) ==== 181+0+0 (secure 0 0 0) 0x7ff080068e20 con 0x7ff08c06d430 2024-09-17T01:36:48.781 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-09-17T01:36:48.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:48.787+0000 7ff093e00640 1 -- 172.21.15.42:0/568638869 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff06c078b90 msgr2=0x7ff06c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:48.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:48.787+0000 7ff093e00640 1 --2- 172.21.15.42:0/568638869 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff06c078b90 0x7ff06c07b0a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff078033000 tx=0x7ff078004730 comp rx=0 tx=0).stop 2024-09-17T01:36:48.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:48.787+0000 7ff093e00640 1 -- 172.21.15.42:0/568638869 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff08c06d430 msgr2=0x7ff08c1f8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:48.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:48.787+0000 7ff093e00640 1 --2- 172.21.15.42:0/568638869 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff08c06d430 0x7ff08c1f8e00 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7ff08000c970 tx=0x7ff08000ce30 comp rx=0 tx=0).stop 2024-09-17T01:36:48.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:48.788+0000 7ff093e00640 1 -- 172.21.15.42:0/568638869 shutdown_connections 2024-09-17T01:36:48.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:48.788+0000 7ff093e00640 1 --2- 172.21.15.42:0/568638869 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff06c078b90 0x7ff06c07b0a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:48.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:48.788+0000 7ff093e00640 1 --2- 172.21.15.42:0/568638869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff08c0cdb20 0x7ff08c0ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:48.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:48.788+0000 7ff093e00640 1 --2- 172.21.15.42:0/568638869 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff08c0b56d0 0x7ff08c15c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:48.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:48.788+0000 7ff093e00640 1 --2- 172.21.15.42:0/568638869 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff08c06d430 0x7ff08c1f8e00 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:48.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:48.788+0000 7ff093e00640 1 -- 172.21.15.42:0/568638869 >> 172.21.15.42:0/568638869 conn(0x7ff08c0b28f0 msgr2=0x7ff08c0b0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:48.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:48.789+0000 7ff093e00640 1 -- 172.21.15.42:0/568638869 shutdown_connections 2024-09-17T01:36:48.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:48.789+0000 7ff093e00640 1 -- 172.21.15.42:0/568638869 wait complete. 2024-09-17T01:36:48.825 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T01:36:49.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.063+0000 7f72d6200640 1 -- 172.21.15.42:0/686906078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72b4004040 msgr2=0x7f72b4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:49.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.063+0000 7f72d6200640 1 --2- 172.21.15.42:0/686906078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72b4004040 0x7f72b4004800 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009b50 tx=0x7f72b4005830 comp rx=0 tx=0).stop 2024-09-17T01:36:49.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.063+0000 7f72cfe00640 1 -- 172.21.15.42:0/686906078 reap_dead start 2024-09-17T01:36:49.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.063+0000 7f72d6200640 1 -- 172.21.15.42:0/686906078 shutdown_connections 2024-09-17T01:36:49.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.063+0000 7f72d6200640 1 -- 172.21.15.42:0/686906078 >> 172.21.15.42:0/686906078 conn(0x7f72d006ed00 msgr2=0x7f72d006f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:49.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.063+0000 7f72d6200640 1 -- 172.21.15.42:0/686906078 shutdown_connections 2024-09-17T01:36:49.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.063+0000 7f72d6200640 1 -- 172.21.15.42:0/686906078 wait complete. 2024-09-17T01:36:49.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.065+0000 7f72d6200640 1 Processor -- start 2024-09-17T01:36:49.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.065+0000 7f72d6200640 1 -- start start 2024-09-17T01:36:49.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.067+0000 7f72d6200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72b4004040 0x7f72d00b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:49.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.067+0000 7f72d6200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72d0144520 0x7f72d01f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:49.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.067+0000 7f72d6200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72d0159c60 0x7f72d015a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:49.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.067+0000 7f72d6200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f72d00732a0 con 0x7f72d0144520 2024-09-17T01:36:49.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.067+0000 7f72d6200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f72d0073120 con 0x7f72b4004040 2024-09-17T01:36:49.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.067+0000 7f72d6200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f72d0073420 con 0x7f72d0159c60 2024-09-17T01:36:49.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.067+0000 7f72c6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72d0144520 0x7f72d01f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:49.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.067+0000 7f72c6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72d0144520 0x7f72d01f57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36458/0 (socket says 172.21.15.42:36458) 2024-09-17T01:36:49.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.067+0000 7f72c6a00640 1 -- 172.21.15.42:0/3402620692 learned_addr learned my addr 172.21.15.42:0/3402620692 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:49.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.067+0000 7f72cf400640 1 --2- 172.21.15.42:0/3402620692 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72b4004040 0x7f72d00b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:49.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.067+0000 7f72cfe00640 1 --2- 172.21.15.42:0/3402620692 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72d0159c60 0x7f72d015a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:49.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.068+0000 7f72c6a00640 1 -- 172.21.15.42:0/3402620692 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72d0159c60 msgr2=0x7f72d015a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:49.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.068+0000 7f72c6a00640 1 --2- 172.21.15.42:0/3402620692 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72d0159c60 0x7f72d015a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:49.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.068+0000 7f72c6a00640 1 -- 172.21.15.42:0/3402620692 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72b4004040 msgr2=0x7f72d00b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:49.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.068+0000 7f72c6a00640 1 --2- 172.21.15.42:0/3402620692 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72b4004040 0x7f72d00b0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:49.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.068+0000 7f72c6a00640 1 -- 172.21.15.42:0/3402620692 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d01f6240 con 0x7f72d0144520 2024-09-17T01:36:49.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.068+0000 7f72c6a00640 1 --2- 172.21.15.42:0/3402620692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72d0144520 0x7f72d01f57b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009a70 tx=0x7f72b8009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:49.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.068+0000 7f72c7e00640 1 -- 172.21.15.42:0/3402620692 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b8038050 con 0x7f72d0144520 2024-09-17T01:36:49.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.068+0000 7f72c7e00640 1 -- 172.21.15.42:0/3402620692 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72b8039040 con 0x7f72d0144520 2024-09-17T01:36:49.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.068+0000 7f72d6200640 1 -- 172.21.15.42:0/3402620692 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72d01f6520 con 0x7f72d0144520 2024-09-17T01:36:49.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.068+0000 7f72c7e00640 1 -- 172.21.15.42:0/3402620692 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b8033e40 con 0x7f72d0144520 2024-09-17T01:36:49.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.068+0000 7f72d6200640 1 -- 172.21.15.42:0/3402620692 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72d0159740 con 0x7f72d0144520 2024-09-17T01:36:49.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.070+0000 7f72d6200640 1 -- 172.21.15.42:0/3402620692 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72d01f6740 con 0x7f72d0144520 2024-09-17T01:36:49.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.071+0000 7f72c7e00640 1 -- 172.21.15.42:0/3402620692 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f72b802b8c0 con 0x7f72d0144520 2024-09-17T01:36:49.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.072+0000 7f72c7e00640 1 --2- 172.21.15.42:0/3402620692 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f72ac078bc0 0x7f72ac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:49.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.072+0000 7f72c7e00640 1 -- 172.21.15.42:0/3402620692 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5501+0+0 (secure 0 0 0) 0x7f72b80bbce0 con 0x7f72d0144520 2024-09-17T01:36:49.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.072+0000 7f72cf400640 1 --2- 172.21.15.42:0/3402620692 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f72ac078bc0 0x7f72ac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:49.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.073+0000 7f72cf400640 1 --2- 172.21.15.42:0/3402620692 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f72ac078bc0 0x7f72ac07b0d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f72c0001c00 tx=0x7f72c0001b90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:49.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.077+0000 7f72c7e00640 1 -- 172.21.15.42:0/3402620692 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f72b8083cc0 con 0x7f72d0144520 2024-09-17T01:36:49.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.273+0000 7f72d6200640 1 -- 172.21.15.42:0/3402620692 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f72d01f5fd0 con 0x7f72d0144520 2024-09-17T01:36:49.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.789+0000 7f72c7e00640 1 -- 172.21.15.42:0/3402620692 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v70) ==== 169+0+0 (secure 0 0 0) 0x7f72b80886f0 con 0x7f72d0144520 2024-09-17T01:36:49.787 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-09-17T01:36:49.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.794+0000 7f72d6200640 1 -- 172.21.15.42:0/3402620692 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f72ac078bc0 msgr2=0x7f72ac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:49.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.794+0000 7f72d6200640 1 --2- 172.21.15.42:0/3402620692 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f72ac078bc0 0x7f72ac07b0d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f72c0001c00 tx=0x7f72c0001b90 comp rx=0 tx=0).stop 2024-09-17T01:36:49.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.794+0000 7f72d6200640 1 -- 172.21.15.42:0/3402620692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72d0144520 msgr2=0x7f72d01f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:49.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.794+0000 7f72d6200640 1 --2- 172.21.15.42:0/3402620692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72d0144520 0x7f72d01f57b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009a70 tx=0x7f72b8009850 comp rx=0 tx=0).stop 2024-09-17T01:36:49.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.794+0000 7f72d6200640 1 -- 172.21.15.42:0/3402620692 shutdown_connections 2024-09-17T01:36:49.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.794+0000 7f72d6200640 1 --2- 172.21.15.42:0/3402620692 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f72ac078bc0 0x7f72ac07b0d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:49.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.794+0000 7f72d6200640 1 --2- 172.21.15.42:0/3402620692 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72d0159c60 0x7f72d015a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:49.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.794+0000 7f72d6200640 1 --2- 172.21.15.42:0/3402620692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72d0144520 0x7f72d01f57b0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:49.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.794+0000 7f72d6200640 1 --2- 172.21.15.42:0/3402620692 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72b4004040 0x7f72d00b0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:49.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.794+0000 7f72d6200640 1 -- 172.21.15.42:0/3402620692 >> 172.21.15.42:0/3402620692 conn(0x7f72d006ed00 msgr2=0x7f72d015bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:49.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.794+0000 7f72d6200640 1 -- 172.21.15.42:0/3402620692 shutdown_connections 2024-09-17T01:36:49.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:49.794+0000 7f72d6200640 1 -- 172.21.15.42:0/3402620692 wait complete. 2024-09-17T01:36:49.821 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T01:36:49.844 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:36:49.869 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:36:50.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.063+0000 7f4591400640 1 -- 172.21.15.42:0/3655173361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f458c0af460 msgr2=0x7f458c0ad5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:50.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.063+0000 7f4591400640 1 --2- 172.21.15.42:0/3655173361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f458c0af460 0x7f458c0ad5c0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f458c06def0 tx=0x7f458402aac0 comp rx=0 tx=0).stop 2024-09-17T01:36:50.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.063+0000 7f4591400640 1 -- 172.21.15.42:0/3655173361 shutdown_connections 2024-09-17T01:36:50.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.063+0000 7f4591400640 1 --2- 172.21.15.42:0/3655173361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f458c0af460 0x7f458c0ad5c0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:50.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.063+0000 7f4591400640 1 --2- 172.21.15.42:0/3655173361 >> v2:172.21.15.43:3300/0 conn(0x7f458c06d430 0x7f458c0ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:50.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.063+0000 7f4591400640 1 -- 172.21.15.42:0/3655173361 >> 172.21.15.42:0/3655173361 conn(0x7f458c0b25f0 msgr2=0x7f458c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:50.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.063+0000 7f4591400640 1 -- 172.21.15.42:0/3655173361 shutdown_connections 2024-09-17T01:36:50.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.063+0000 7f4591400640 1 -- 172.21.15.42:0/3655173361 wait complete. 2024-09-17T01:36:50.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.065+0000 7f4591400640 1 Processor -- start 2024-09-17T01:36:50.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.066+0000 7f4591400640 1 -- start start 2024-09-17T01:36:50.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.067+0000 7f4591400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f458c0af460 0x7f458c15feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:50.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.067+0000 7f4591400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f458c0d0d80 0x7f458c15d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:50.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.067+0000 7f4591400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f458c06e720 0x7f458c14f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:50.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.067+0000 7f4591400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f458c0adb00 con 0x7f458c06e720 2024-09-17T01:36:50.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.067+0000 7f4591400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f458c15ec10 con 0x7f458c0af460 2024-09-17T01:36:50.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.067+0000 7f4591400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f458c0adc80 con 0x7f458c0d0d80 2024-09-17T01:36:50.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.067+0000 7f4590a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f458c06e720 0x7f458c14f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:50.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.067+0000 7f458be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f458c0af460 0x7f458c15feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:50.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.067+0000 7f4590a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f458c06e720 0x7f458c14f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36484/0 (socket says 172.21.15.42:36484) 2024-09-17T01:36:50.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.067+0000 7f4590a00640 1 -- 172.21.15.42:0/1825987161 learned_addr learned my addr 172.21.15.42:0/1825987161 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:50.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.068+0000 7f4583400640 1 --2- 172.21.15.42:0/1825987161 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f458c0d0d80 0x7f458c15d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:50.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.068+0000 7f4590a00640 1 -- 172.21.15.42:0/1825987161 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f458c0d0d80 msgr2=0x7f458c15d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:50.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.068+0000 7f4590a00640 1 --2- 172.21.15.42:0/1825987161 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f458c0d0d80 0x7f458c15d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:50.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.068+0000 7f4590a00640 1 -- 172.21.15.42:0/1825987161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f458c0af460 msgr2=0x7f458c15feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:50.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.068+0000 7f4590a00640 1 --2- 172.21.15.42:0/1825987161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f458c0af460 0x7f458c15feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:50.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.068+0000 7f4590a00640 1 -- 172.21.15.42:0/1825987161 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f458c06ecc0 con 0x7f458c06e720 2024-09-17T01:36:50.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.068+0000 7f4590a00640 1 --2- 172.21.15.42:0/1825987161 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f458c06e720 0x7f458c14f7f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4584009d60 tx=0x7f4584003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:50.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.068+0000 7f4588c00640 1 -- 172.21.15.42:0/1825987161 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4584044070 con 0x7f458c06e720 2024-09-17T01:36:50.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.069+0000 7f4588c00640 1 -- 172.21.15.42:0/1825987161 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4584003e50 con 0x7f458c06e720 2024-09-17T01:36:50.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.069+0000 7f4591400640 1 -- 172.21.15.42:0/1825987161 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f458c15cc70 con 0x7f458c06e720 2024-09-17T01:36:50.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.069+0000 7f4588c00640 1 -- 172.21.15.42:0/1825987161 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45840044b0 con 0x7f458c06e720 2024-09-17T01:36:50.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.069+0000 7f4591400640 1 -- 172.21.15.42:0/1825987161 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f458c15d230 con 0x7f458c06e720 2024-09-17T01:36:50.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.070+0000 7f4591400640 1 -- 172.21.15.42:0/1825987161 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f458c15ca90 con 0x7f458c06e720 2024-09-17T01:36:50.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.071+0000 7f4588c00640 1 -- 172.21.15.42:0/1825987161 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4584004650 con 0x7f458c06e720 2024-09-17T01:36:50.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.072+0000 7f4588c00640 1 --2- 172.21.15.42:0/1825987161 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4568078b90 0x7f456807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:50.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.072+0000 7f4588c00640 1 -- 172.21.15.42:0/1825987161 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5029+0+0 (secure 0 0 0) 0x7f45840baff0 con 0x7f458c06e720 2024-09-17T01:36:50.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.072+0000 7f458be00640 1 --2- 172.21.15.42:0/1825987161 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4568078b90 0x7f456807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:50.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.073+0000 7f458be00640 1 --2- 172.21.15.42:0/1825987161 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4568078b90 0x7f456807b0a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f457c001720 tx=0x7f457c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:50.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.076+0000 7f4588c00640 1 -- 172.21.15.42:0/1825987161 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f458c15ca90 con 0x7f458c06e720 2024-09-17T01:36:50.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.270+0000 7f4591400640 1 -- 172.21.15.42:0/1825987161 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f458c0ad080 con 0x7f458c06e720 2024-09-17T01:36:50.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.274+0000 7f4588c00640 1 -- 172.21.15.42:0/1825987161 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v42) ==== 71+0+0 (secure 0 0 0) 0x7f4584032030 con 0x7f458c06e720 2024-09-17T01:36:50.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.277+0000 7f4591400640 1 -- 172.21.15.42:0/1825987161 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4568078b90 msgr2=0x7f456807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:50.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.277+0000 7f4591400640 1 --2- 172.21.15.42:0/1825987161 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4568078b90 0x7f456807b0a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f457c001720 tx=0x7f457c009040 comp rx=0 tx=0).stop 2024-09-17T01:36:50.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.277+0000 7f4591400640 1 -- 172.21.15.42:0/1825987161 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f458c06e720 msgr2=0x7f458c14f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:50.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.277+0000 7f4591400640 1 --2- 172.21.15.42:0/1825987161 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f458c06e720 0x7f458c14f7f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4584009d60 tx=0x7f4584003ce0 comp rx=0 tx=0).stop 2024-09-17T01:36:50.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.277+0000 7f4591400640 1 -- 172.21.15.42:0/1825987161 shutdown_connections 2024-09-17T01:36:50.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.277+0000 7f4591400640 1 --2- 172.21.15.42:0/1825987161 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4568078b90 0x7f456807b0a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:50.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.277+0000 7f4591400640 1 --2- 172.21.15.42:0/1825987161 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f458c06e720 0x7f458c14f7f0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:50.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.277+0000 7f4591400640 1 --2- 172.21.15.42:0/1825987161 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f458c0d0d80 0x7f458c15d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:50.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.277+0000 7f4591400640 1 --2- 172.21.15.42:0/1825987161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f458c0af460 0x7f458c15feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:50.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.277+0000 7f4591400640 1 -- 172.21.15.42:0/1825987161 >> 172.21.15.42:0/1825987161 conn(0x7f458c0b25f0 msgr2=0x7f458c0b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:50.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.277+0000 7f4591400640 1 -- 172.21.15.42:0/1825987161 shutdown_connections 2024-09-17T01:36:50.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.277+0000 7f4591400640 1 -- 172.21.15.42:0/1825987161 wait complete. 2024-09-17T01:36:50.297 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags' 2024-09-17T01:36:50.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.527+0000 7efcd3000640 1 -- 172.21.15.42:0/3413896570 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efccc0ce930 msgr2=0x7efccc0ced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:50.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.527+0000 7efcd3000640 1 --2- 172.21.15.42:0/3413896570 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efccc0ce930 0x7efccc0ced40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7efccc074510 tx=0x7efcb802a560 comp rx=0 tx=0).stop 2024-09-17T01:36:50.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.527+0000 7efcd3000640 1 -- 172.21.15.42:0/3413896570 shutdown_connections 2024-09-17T01:36:50.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.527+0000 7efcd3000640 1 --2- 172.21.15.42:0/3413896570 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efccc0ce930 0x7efccc0ced40 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:50.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.527+0000 7efcd3000640 1 --2- 172.21.15.42:0/3413896570 >> v2:172.21.15.43:3300/0 conn(0x7efccc0d0d30 0x7efccc0b76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:50.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.527+0000 7efcd3000640 1 -- 172.21.15.42:0/3413896570 >> 172.21.15.42:0/3413896570 conn(0x7efccc0b3ed0 msgr2=0x7efccc0b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:50.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.528+0000 7efcd3000640 1 -- 172.21.15.42:0/3413896570 shutdown_connections 2024-09-17T01:36:50.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.528+0000 7efcd3000640 1 -- 172.21.15.42:0/3413896570 wait complete. 2024-09-17T01:36:50.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.530+0000 7efcd3000640 1 Processor -- start 2024-09-17T01:36:50.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.530+0000 7efcd3000640 1 -- start start 2024-09-17T01:36:50.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.531+0000 7efcd3000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efccc0ce930 0x7efccc146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:50.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.531+0000 7efcd3000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efccc0d0d30 0x7efccc15ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:50.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.532+0000 7efcd3000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efccc1f9300 0x7efccc1489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:50.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.532+0000 7efcd3000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efccc0cd380 con 0x7efccc0ce930 2024-09-17T01:36:50.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.532+0000 7efcd3000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efccc071a00 con 0x7efccc0d0d30 2024-09-17T01:36:50.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.532+0000 7efcd3000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7efccc0cd500 con 0x7efccc1f9300 2024-09-17T01:36:50.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.532+0000 7efcd1c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efccc0ce930 0x7efccc146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:50.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.532+0000 7efcd1c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efccc0ce930 0x7efccc146280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36514/0 (socket says 172.21.15.42:36514) 2024-09-17T01:36:50.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.532+0000 7efcd1c00640 1 -- 172.21.15.42:0/457793603 learned_addr learned my addr 172.21.15.42:0/457793603 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:50.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.532+0000 7efcd1200640 1 --2- 172.21.15.42:0/457793603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efccc0d0d30 0x7efccc15ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:50.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.532+0000 7efcd2600640 1 --2- 172.21.15.42:0/457793603 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efccc1f9300 0x7efccc1489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:50.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.532+0000 7efcd1c00640 1 -- 172.21.15.42:0/457793603 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efccc1f9300 msgr2=0x7efccc1489d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:50.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.532+0000 7efcd1c00640 1 --2- 172.21.15.42:0/457793603 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efccc1f9300 0x7efccc1489d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:50.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.532+0000 7efcd1c00640 1 -- 172.21.15.42:0/457793603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efccc0d0d30 msgr2=0x7efccc15ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:50.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.532+0000 7efcd1c00640 1 --2- 172.21.15.42:0/457793603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efccc0d0d30 0x7efccc15ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:50.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.532+0000 7efcd1c00640 1 -- 172.21.15.42:0/457793603 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efccc1f5b90 con 0x7efccc0ce930 2024-09-17T01:36:50.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.532+0000 7efcd2600640 1 --2- 172.21.15.42:0/457793603 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efccc1f9300 0x7efccc1489d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:36:50.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.533+0000 7efcd1c00640 1 --2- 172.21.15.42:0/457793603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efccc0ce930 0x7efccc146280 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7efcc000c970 tx=0x7efcc000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:50.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.533+0000 7efcc9600640 1 -- 172.21.15.42:0/457793603 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc0007bb0 con 0x7efccc0ce930 2024-09-17T01:36:50.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.533+0000 7efcc9600640 1 -- 172.21.15.42:0/457793603 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efcc0007e40 con 0x7efccc0ce930 2024-09-17T01:36:50.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.533+0000 7efcd3000640 1 -- 172.21.15.42:0/457793603 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efccc1f5e70 con 0x7efccc0ce930 2024-09-17T01:36:50.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.533+0000 7efcc9600640 1 -- 172.21.15.42:0/457793603 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc000f690 con 0x7efccc0ce930 2024-09-17T01:36:50.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.533+0000 7efcd3000640 1 -- 172.21.15.42:0/457793603 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efccc15f250 con 0x7efccc0ce930 2024-09-17T01:36:50.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.534+0000 7efcd3000640 1 -- 172.21.15.42:0/457793603 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efccc1482e0 con 0x7efccc0ce930 2024-09-17T01:36:50.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.536+0000 7efcc9600640 1 -- 172.21.15.42:0/457793603 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efcc000f830 con 0x7efccc0ce930 2024-09-17T01:36:50.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.536+0000 7efcc9600640 1 --2- 172.21.15.42:0/457793603 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efcac078b90 0x7efcac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:50.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.537+0000 7efcc9600640 1 -- 172.21.15.42:0/457793603 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5029+0+0 (secure 0 0 0) 0x7efcc009b380 con 0x7efccc0ce930 2024-09-17T01:36:50.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.537+0000 7efcd1200640 1 --2- 172.21.15.42:0/457793603 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efcac078b90 0x7efcac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:50.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.538+0000 7efcd1200640 1 --2- 172.21.15.42:0/457793603 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efcac078b90 0x7efcac07b0a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efcb8033000 tx=0x7efcb8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:50.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.541+0000 7efcc9600640 1 -- 172.21.15.42:0/457793603 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efcc0014030 con 0x7efccc0ce930 2024-09-17T01:36:50.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:50.805+0000 7efcd3000640 1 -- 172.21.15.42:0/457793603 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]} v 0) -- 0x7efccc1f6390 con 0x7efccc0ce930 2024-09-17T01:36:51.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:51.797+0000 7efcc9600640 1 -- 172.21.15.42:0/457793603 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]}]=0 v242) ==== 151+0+0 (secure 0 0 0) 0x7efccc1f6390 con 0x7efccc0ce930 2024-09-17T01:36:51.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:51.800+0000 7efcd3000640 1 -- 172.21.15.42:0/457793603 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efcac078b90 msgr2=0x7efcac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:51.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:51.800+0000 7efcd3000640 1 --2- 172.21.15.42:0/457793603 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efcac078b90 0x7efcac07b0a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efcb8033000 tx=0x7efcb8004730 comp rx=0 tx=0).stop 2024-09-17T01:36:51.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:51.800+0000 7efcd3000640 1 -- 172.21.15.42:0/457793603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efccc0ce930 msgr2=0x7efccc146280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:51.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:51.800+0000 7efcd3000640 1 --2- 172.21.15.42:0/457793603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efccc0ce930 0x7efccc146280 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7efcc000c970 tx=0x7efcc000ce30 comp rx=0 tx=0).stop 2024-09-17T01:36:51.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:51.800+0000 7efcd3000640 1 -- 172.21.15.42:0/457793603 shutdown_connections 2024-09-17T01:36:51.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:51.800+0000 7efcd3000640 1 --2- 172.21.15.42:0/457793603 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efcac078b90 0x7efcac07b0a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:51.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:51.800+0000 7efcd3000640 1 --2- 172.21.15.42:0/457793603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efccc0d0d30 0x7efccc15ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:51.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:51.800+0000 7efcd3000640 1 --2- 172.21.15.42:0/457793603 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efccc1f9300 0x7efccc1489d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:51.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:51.800+0000 7efcd3000640 1 --2- 172.21.15.42:0/457793603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efccc0ce930 0x7efccc146280 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:51.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:51.800+0000 7efcd3000640 1 -- 172.21.15.42:0/457793603 >> 172.21.15.42:0/457793603 conn(0x7efccc0b3ed0 msgr2=0x7efccc06d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:51.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:51.801+0000 7efcd3000640 1 -- 172.21.15.42:0/457793603 shutdown_connections 2024-09-17T01:36:51.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:51.801+0000 7efcd3000640 1 -- 172.21.15.42:0/457793603 wait complete. 2024-09-17T01:36:51.827 INFO:tasks.cephfs_test_runner:That a directory is merged during scrub. ... ok 2024-09-17T01:36:51.827 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-17T01:36:51.827 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:36:52.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.061+0000 7fe3f6400640 1 -- 172.21.15.42:0/2810614682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3d4003a00 msgr2=0x7fe3d4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:52.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.061+0000 7fe3f6400640 1 --2- 172.21.15.42:0/2810614682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3d4003a00 0x7fe3d4003e70 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009b50 tx=0x7fe3d4005830 comp rx=0 tx=0).stop 2024-09-17T01:36:52.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.061+0000 7fe3efe00640 1 -- 172.21.15.42:0/2810614682 reap_dead start 2024-09-17T01:36:52.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.062+0000 7fe3f6400640 1 -- 172.21.15.42:0/2810614682 shutdown_connections 2024-09-17T01:36:52.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.062+0000 7fe3f6400640 1 -- 172.21.15.42:0/2810614682 >> 172.21.15.42:0/2810614682 conn(0x7fe3f00b2930 msgr2=0x7fe3f006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:52.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.062+0000 7fe3f6400640 1 -- 172.21.15.42:0/2810614682 shutdown_connections 2024-09-17T01:36:52.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.062+0000 7fe3f6400640 1 -- 172.21.15.42:0/2810614682 wait complete. 2024-09-17T01:36:52.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.064+0000 7fe3f6400640 1 Processor -- start 2024-09-17T01:36:52.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.064+0000 7fe3f6400640 1 -- start start 2024-09-17T01:36:52.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.066+0000 7fe3f6400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3d4003a00 0x7fe3f0155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:52.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.066+0000 7fe3f6400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe3f01f5390 0x7fe3f0146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:52.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.066+0000 7fe3f6400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3f00ccf30 0x7fe3f00cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:52.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.066+0000 7fe3f6400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f015fe10 con 0x7fe3d4003a00 2024-09-17T01:36:52.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.066+0000 7fe3f6400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f015fc90 con 0x7fe3f00ccf30 2024-09-17T01:36:52.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.066+0000 7fe3f6400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe3f015ff90 con 0x7fe3f01f5390 2024-09-17T01:36:52.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.066+0000 7fe3ef400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3d4003a00 0x7fe3f0155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:52.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.066+0000 7fe3ef400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3d4003a00 0x7fe3f0155a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36532/0 (socket says 172.21.15.42:36532) 2024-09-17T01:36:52.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.066+0000 7fe3ef400640 1 -- 172.21.15.42:0/2344804951 learned_addr learned my addr 172.21.15.42:0/2344804951 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:52.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.066+0000 7fe3eea00640 1 --2- 172.21.15.42:0/2344804951 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe3f01f5390 0x7fe3f0146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:52.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.066+0000 7fe3efe00640 1 --2- 172.21.15.42:0/2344804951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3f00ccf30 0x7fe3f00cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:52.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.066+0000 7fe3ef400640 1 -- 172.21.15.42:0/2344804951 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe3f01f5390 msgr2=0x7fe3f0146cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:52.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.066+0000 7fe3ef400640 1 --2- 172.21.15.42:0/2344804951 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe3f01f5390 0x7fe3f0146cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:52.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.066+0000 7fe3ef400640 1 -- 172.21.15.42:0/2344804951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3f00ccf30 msgr2=0x7fe3f00cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:52.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.066+0000 7fe3ef400640 1 --2- 172.21.15.42:0/2344804951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3f00ccf30 0x7fe3f00cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:52.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.066+0000 7fe3ef400640 1 -- 172.21.15.42:0/2344804951 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f00cd880 con 0x7fe3d4003a00 2024-09-17T01:36:52.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.067+0000 7fe3ef400640 1 --2- 172.21.15.42:0/2344804951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3d4003a00 0x7fe3f0155a10 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009a70 tx=0x7fe3e0033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:52.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.067+0000 7fe3e7400640 1 -- 172.21.15.42:0/2344804951 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0038040 con 0x7fe3d4003a00 2024-09-17T01:36:52.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.067+0000 7fe3e7400640 1 -- 172.21.15.42:0/2344804951 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3e0004110 con 0x7fe3d4003a00 2024-09-17T01:36:52.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.067+0000 7fe3e7400640 1 -- 172.21.15.42:0/2344804951 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e00337e0 con 0x7fe3d4003a00 2024-09-17T01:36:52.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.067+0000 7fe3f6400640 1 -- 172.21.15.42:0/2344804951 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3f01f1620 con 0x7fe3d4003a00 2024-09-17T01:36:52.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.067+0000 7fe3f6400640 1 -- 172.21.15.42:0/2344804951 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f01f1be0 con 0x7fe3d4003a00 2024-09-17T01:36:52.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.068+0000 7fe3f6400640 1 -- 172.21.15.42:0/2344804951 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3f0152710 con 0x7fe3d4003a00 2024-09-17T01:36:52.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.070+0000 7fe3e7400640 1 -- 172.21.15.42:0/2344804951 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe3e0045020 con 0x7fe3d4003a00 2024-09-17T01:36:52.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.070+0000 7fe3e7400640 1 --2- 172.21.15.42:0/2344804951 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe3d0078b90 0x7fe3d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:52.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.071+0000 7fe3e7400640 1 -- 172.21.15.42:0/2344804951 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5029+0+0 (secure 0 0 0) 0x7fe3e00bb4d0 con 0x7fe3d4003a00 2024-09-17T01:36:52.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.071+0000 7fe3eea00640 1 --2- 172.21.15.42:0/2344804951 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe3d0078b90 0x7fe3d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:52.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.072+0000 7fe3eea00640 1 --2- 172.21.15.42:0/2344804951 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe3d0078b90 0x7fe3d007b0a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc001840 tx=0x7fe3dc0017d0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:52.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.075+0000 7fe3e7400640 1 -- 172.21.15.42:0/2344804951 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe3f00cd880 con 0x7fe3d4003a00 2024-09-17T01:36:52.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.271+0000 7fe3f6400640 1 -- 172.21.15.42:0/2344804951 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe3f006a170 con 0x7fe3d4003a00 2024-09-17T01:36:52.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.272+0000 7fe3e7400640 1 -- 172.21.15.42:0/2344804951 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+13114 (secure 0 0 0) 0x7fe3e0083550 con 0x7fe3d4003a00 2024-09-17T01:36:52.270 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:52.270 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":70,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:36:49.783856+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6835/4251885944":"2024-09-18T01:36:46.546221+0000","172.21.15.42:6834/4251885944":"2024-09-18T01:36:46.546221+0000","172.21.15.42:6835/2030017417":"2024-09-18T01:36:29.180067+0000","172.21.15.42:6833/2030017417":"2024-09-18T01:36:29.180067+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:36:52.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.274+0000 7fe3f6400640 1 -- 172.21.15.42:0/2344804951 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe3d0078b90 msgr2=0x7fe3d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:52.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.274+0000 7fe3f6400640 1 --2- 172.21.15.42:0/2344804951 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe3d0078b90 0x7fe3d007b0a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc001840 tx=0x7fe3dc0017d0 comp rx=0 tx=0).stop 2024-09-17T01:36:52.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.274+0000 7fe3f6400640 1 -- 172.21.15.42:0/2344804951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3d4003a00 msgr2=0x7fe3f0155a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:52.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.274+0000 7fe3f6400640 1 --2- 172.21.15.42:0/2344804951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3d4003a00 0x7fe3f0155a10 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009a70 tx=0x7fe3e0033670 comp rx=0 tx=0).stop 2024-09-17T01:36:52.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.274+0000 7fe3f6400640 1 -- 172.21.15.42:0/2344804951 shutdown_connections 2024-09-17T01:36:52.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.274+0000 7fe3f6400640 1 --2- 172.21.15.42:0/2344804951 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe3d0078b90 0x7fe3d007b0a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:52.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.274+0000 7fe3f6400640 1 --2- 172.21.15.42:0/2344804951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3f00ccf30 0x7fe3f00cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:52.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.274+0000 7fe3f6400640 1 --2- 172.21.15.42:0/2344804951 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe3f01f5390 0x7fe3f0146cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:52.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.274+0000 7fe3f6400640 1 --2- 172.21.15.42:0/2344804951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3d4003a00 0x7fe3f0155a10 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:52.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.274+0000 7fe3f6400640 1 -- 172.21.15.42:0/2344804951 >> 172.21.15.42:0/2344804951 conn(0x7fe3f00b2930 msgr2=0x7fe3f0073810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:52.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.274+0000 7fe3f6400640 1 -- 172.21.15.42:0/2344804951 shutdown_connections 2024-09-17T01:36:52.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.274+0000 7fe3f6400640 1 -- 172.21.15.42:0/2344804951 wait complete. 2024-09-17T01:36:52.294 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T01:31:55.004951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T01:36:52.294 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T01:36:52.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.528+0000 7fcbfac00640 1 -- 172.21.15.42:0/4287106346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbdc005210 msgr2=0x7fcbdc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:52.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.528+0000 7fcbfac00640 1 --2- 172.21.15.42:0/4287106346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbdc005210 0x7fcbdc00b9c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fcbec001f00 tx=0x7fcbdc005830 comp rx=0 tx=0).stop 2024-09-17T01:36:52.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.528+0000 7fcbfa200640 1 -- 172.21.15.42:0/4287106346 reap_dead start 2024-09-17T01:36:52.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.528+0000 7fcbfac00640 1 -- 172.21.15.42:0/4287106346 shutdown_connections 2024-09-17T01:36:52.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.528+0000 7fcbfac00640 1 -- 172.21.15.42:0/4287106346 >> 172.21.15.42:0/4287106346 conn(0x7fcbf40d0df0 msgr2=0x7fcbf40d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:52.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.528+0000 7fcbfac00640 1 -- 172.21.15.42:0/4287106346 shutdown_connections 2024-09-17T01:36:52.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.528+0000 7fcbfac00640 1 -- 172.21.15.42:0/4287106346 wait complete. 2024-09-17T01:36:52.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.530+0000 7fcbfac00640 1 Processor -- start 2024-09-17T01:36:52.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.530+0000 7fcbfac00640 1 -- start start 2024-09-17T01:36:52.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.532+0000 7fcbfac00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbdc005210 0x7fcbf40cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:52.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.532+0000 7fcbfac00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcbf40cfe10 0x7fcbf414f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:52.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.532+0000 7fcbfac00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbf414ff50 0x7fcbf414f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:52.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.532+0000 7fcbfac00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf40ce070 con 0x7fcbdc005210 2024-09-17T01:36:52.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.532+0000 7fcbfac00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf40cdef0 con 0x7fcbf414ff50 2024-09-17T01:36:52.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.532+0000 7fcbfac00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fcbf40ce1f0 con 0x7fcbf40cfe10 2024-09-17T01:36:52.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.532+0000 7fcbf9800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbdc005210 0x7fcbf40cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:52.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.532+0000 7fcbf9800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbdc005210 0x7fcbf40cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36554/0 (socket says 172.21.15.42:36554) 2024-09-17T01:36:52.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.532+0000 7fcbf9800640 1 -- 172.21.15.42:0/3359661603 learned_addr learned my addr 172.21.15.42:0/3359661603 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:52.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.532+0000 7fcbfa200640 1 --2- 172.21.15.42:0/3359661603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbf414ff50 0x7fcbf414f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:52.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.532+0000 7fcbf8e00640 1 --2- 172.21.15.42:0/3359661603 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcbf40cfe10 0x7fcbf414f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:52.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.533+0000 7fcbf9800640 1 -- 172.21.15.42:0/3359661603 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcbf40cfe10 msgr2=0x7fcbf414f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:52.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.533+0000 7fcbf9800640 1 --2- 172.21.15.42:0/3359661603 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcbf40cfe10 0x7fcbf414f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:52.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.533+0000 7fcbf9800640 1 -- 172.21.15.42:0/3359661603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbf414ff50 msgr2=0x7fcbf414f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:52.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.533+0000 7fcbf9800640 1 --2- 172.21.15.42:0/3359661603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbf414ff50 0x7fcbf414f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:52.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.533+0000 7fcbf9800640 1 -- 172.21.15.42:0/3359661603 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf415e6c0 con 0x7fcbdc005210 2024-09-17T01:36:52.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.533+0000 7fcbfa200640 1 --2- 172.21.15.42:0/3359661603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbf414ff50 0x7fcbf414f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:36:52.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.533+0000 7fcbf9800640 1 --2- 172.21.15.42:0/3359661603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbdc005210 0x7fcbf40cf8d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8006f60 tx=0x7fcbe8006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:52.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.533+0000 7fcbf1600640 1 -- 172.21.15.42:0/3359661603 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8015020 con 0x7fcbdc005210 2024-09-17T01:36:52.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.533+0000 7fcbf1600640 1 -- 172.21.15.42:0/3359661603 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbe800eaa0 con 0x7fcbdc005210 2024-09-17T01:36:52.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.533+0000 7fcbf1600640 1 -- 172.21.15.42:0/3359661603 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011460 con 0x7fcbdc005210 2024-09-17T01:36:52.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.533+0000 7fcbfac00640 1 -- 172.21.15.42:0/3359661603 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf415da00 con 0x7fcbdc005210 2024-09-17T01:36:52.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.533+0000 7fcbfac00640 1 -- 172.21.15.42:0/3359661603 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbf41f9cd0 con 0x7fcbdc005210 2024-09-17T01:36:52.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.534+0000 7fcbfac00640 1 -- 172.21.15.42:0/3359661603 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbf40cd7e0 con 0x7fcbdc005210 2024-09-17T01:36:52.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.536+0000 7fcbf1600640 1 -- 172.21.15.42:0/3359661603 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcbe8018020 con 0x7fcbdc005210 2024-09-17T01:36:52.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.537+0000 7fcbf1600640 1 --2- 172.21.15.42:0/3359661603 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcbd4078bc0 0x7fcbd407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:52.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.537+0000 7fcbf1600640 1 -- 172.21.15.42:0/3359661603 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5029+0+0 (secure 0 0 0) 0x7fcbe809b270 con 0x7fcbdc005210 2024-09-17T01:36:52.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.537+0000 7fcbf8e00640 1 --2- 172.21.15.42:0/3359661603 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcbd4078bc0 0x7fcbd407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:52.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.538+0000 7fcbf8e00640 1 --2- 172.21.15.42:0/3359661603 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcbd4078bc0 0x7fcbd407b0d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40af6f0 tx=0x7fcbe0005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:52.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.541+0000 7fcbf1600640 1 -- 172.21.15.42:0/3359661603 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcbe801f030 con 0x7fcbdc005210 2024-09-17T01:36:52.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.735+0000 7fcbfac00640 1 -- 172.21.15.42:0/3359661603 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcbf41ea540 con 0x7fcbdc005210 2024-09-17T01:36:52.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.735+0000 7fcbf1600640 1 -- 172.21.15.42:0/3359661603 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) ==== 93+0+10 (secure 0 0 0) 0x7fcbf4074500 con 0x7fcbdc005210 2024-09-17T01:36:52.733 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-09-17T01:36:52.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.737+0000 7fcbfac00640 1 -- 172.21.15.42:0/3359661603 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcbd4078bc0 msgr2=0x7fcbd407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:52.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.737+0000 7fcbfac00640 1 --2- 172.21.15.42:0/3359661603 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcbd4078bc0 0x7fcbd407b0d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40af6f0 tx=0x7fcbe0005f90 comp rx=0 tx=0).stop 2024-09-17T01:36:52.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.737+0000 7fcbfac00640 1 -- 172.21.15.42:0/3359661603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbdc005210 msgr2=0x7fcbf40cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:52.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.737+0000 7fcbfac00640 1 --2- 172.21.15.42:0/3359661603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbdc005210 0x7fcbf40cf8d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8006f60 tx=0x7fcbe8006f90 comp rx=0 tx=0).stop 2024-09-17T01:36:52.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.737+0000 7fcbfac00640 1 -- 172.21.15.42:0/3359661603 shutdown_connections 2024-09-17T01:36:52.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.737+0000 7fcbfac00640 1 --2- 172.21.15.42:0/3359661603 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcbd4078bc0 0x7fcbd407b0d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:52.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.737+0000 7fcbfac00640 1 --2- 172.21.15.42:0/3359661603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbf414ff50 0x7fcbf414f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:52.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.737+0000 7fcbfac00640 1 --2- 172.21.15.42:0/3359661603 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcbf40cfe10 0x7fcbf414f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:52.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.737+0000 7fcbfac00640 1 --2- 172.21.15.42:0/3359661603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbdc005210 0x7fcbf40cf8d0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:52.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.737+0000 7fcbfac00640 1 -- 172.21.15.42:0/3359661603 >> 172.21.15.42:0/3359661603 conn(0x7fcbf40d0df0 msgr2=0x7fcbf41eb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:52.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.738+0000 7fcbfac00640 1 -- 172.21.15.42:0/3359661603 shutdown_connections 2024-09-17T01:36:52.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.738+0000 7fcbfac00640 1 -- 172.21.15.42:0/3359661603 wait complete. 2024-09-17T01:36:52.760 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-09-17T01:36:52.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.992+0000 7f2c58c00640 1 -- 172.21.15.42:0/3933194445 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c540b4be0 msgr2=0x7f2c5415d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:52.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.992+0000 7f2c58c00640 1 --2- 172.21.15.42:0/3933194445 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c540b4be0 0x7f2c5415d6b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009860 tx=0x7f2c4402a5a0 comp rx=0 tx=0).stop 2024-09-17T01:36:52.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.992+0000 7f2c58c00640 1 -- 172.21.15.42:0/3933194445 shutdown_connections 2024-09-17T01:36:52.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.992+0000 7f2c58c00640 1 --2- 172.21.15.42:0/3933194445 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c540b4be0 0x7f2c5415d6b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:52.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.992+0000 7f2c58c00640 1 -- 172.21.15.42:0/3933194445 >> 172.21.15.42:0/3933194445 conn(0x7f2c540b25f0 msgr2=0x7f2c540d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:52.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.992+0000 7f2c58c00640 1 -- 172.21.15.42:0/3933194445 shutdown_connections 2024-09-17T01:36:52.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.992+0000 7f2c58c00640 1 -- 172.21.15.42:0/3933194445 wait complete. 2024-09-17T01:36:52.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.994+0000 7f2c58c00640 1 Processor -- start 2024-09-17T01:36:52.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.994+0000 7f2c58c00640 1 -- start start 2024-09-17T01:36:52.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.996+0000 7f2c58c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c540b4be0 0x7f2c5414bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:52.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.996+0000 7f2c58c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c540cf7c0 0x7f2c54151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:52.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.996+0000 7f2c58c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c5414c530 0x7f2c54152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:52.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.996+0000 7f2c58c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2c54153760 con 0x7f2c5414c530 2024-09-17T01:36:52.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.996+0000 7f2c58c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2c541535e0 con 0x7f2c540cf7c0 2024-09-17T01:36:52.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.996+0000 7f2c58c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2c541538e0 con 0x7f2c540b4be0 2024-09-17T01:36:52.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.996+0000 7f2c53e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c5414c530 0x7f2c54152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:52.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.996+0000 7f2c53e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c5414c530 0x7f2c54152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36568/0 (socket says 172.21.15.42:36568) 2024-09-17T01:36:52.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.996+0000 7f2c53e00640 1 -- 172.21.15.42:0/1150750732 learned_addr learned my addr 172.21.15.42:0/1150750732 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:52.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.996+0000 7f2c53400640 1 --2- 172.21.15.42:0/1150750732 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c540b4be0 0x7f2c5414bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:52.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.996+0000 7f2c4be00640 1 --2- 172.21.15.42:0/1150750732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c540cf7c0 0x7f2c54151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:52.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.996+0000 7f2c53e00640 1 -- 172.21.15.42:0/1150750732 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c540b4be0 msgr2=0x7f2c5414bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:52.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.997+0000 7f2c53e00640 1 --2- 172.21.15.42:0/1150750732 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c540b4be0 0x7f2c5414bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:52.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.997+0000 7f2c53e00640 1 -- 172.21.15.42:0/1150750732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c540cf7c0 msgr2=0x7f2c54151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:52.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.997+0000 7f2c53e00640 1 --2- 172.21.15.42:0/1150750732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c540cf7c0 0x7f2c54151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:52.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.997+0000 7f2c53e00640 1 -- 172.21.15.42:0/1150750732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c54072d40 con 0x7f2c5414c530 2024-09-17T01:36:52.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.997+0000 7f2c53e00640 1 --2- 172.21.15.42:0/1150750732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c5414c530 0x7f2c54152250 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00cc30 tx=0x7f2c4c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:52.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.997+0000 7f2c4b400640 1 -- 172.21.15.42:0/1150750732 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c016020 con 0x7f2c5414c530 2024-09-17T01:36:52.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.997+0000 7f2c4b400640 1 -- 172.21.15.42:0/1150750732 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c4c00ce40 con 0x7f2c5414c530 2024-09-17T01:36:52.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.997+0000 7f2c4b400640 1 -- 172.21.15.42:0/1150750732 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c012680 con 0x7f2c5414c530 2024-09-17T01:36:52.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.997+0000 7f2c58c00640 1 -- 172.21.15.42:0/1150750732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c54073020 con 0x7f2c5414c530 2024-09-17T01:36:52.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.997+0000 7f2c58c00640 1 -- 172.21.15.42:0/1150750732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c540735e0 con 0x7f2c5414c530 2024-09-17T01:36:52.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.998+0000 7f2c58c00640 1 -- 172.21.15.42:0/1150750732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c5415d6b0 con 0x7f2c5414c530 2024-09-17T01:36:52.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:52.999+0000 7f2c4b400640 1 -- 172.21.15.42:0/1150750732 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2c4c019020 con 0x7f2c5414c530 2024-09-17T01:36:52.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:53.000+0000 7f2c4b400640 1 --2- 172.21.15.42:0/1150750732 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2c30078b90 0x7f2c3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:52.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:53.001+0000 7f2c4b400640 1 -- 172.21.15.42:0/1150750732 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5029+0+0 (secure 0 0 0) 0x7f2c4c09b240 con 0x7f2c5414c530 2024-09-17T01:36:52.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:53.001+0000 7f2c53400640 1 --2- 172.21.15.42:0/1150750732 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2c30078b90 0x7f2c3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:52.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:53.002+0000 7f2c53400640 1 --2- 172.21.15.42:0/1150750732 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2c30078b90 0x7f2c3007b0a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2c44034000 tx=0x7f2c44004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:53.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:53.005+0000 7f2c4b400640 1 -- 172.21.15.42:0/1150750732 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2c4c020020 con 0x7f2c5414c530 2024-09-17T01:36:53.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:53.270+0000 7f2c58c00640 1 -- 172.21.15.42:0/1150750732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) -- 0x7f2c54072ad0 con 0x7f2c5414c530 2024-09-17T01:36:53.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:53.804+0000 7f2c4b400640 1 -- 172.21.15.42:0/1150750732 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v244) ==== 146+0+0 (secure 0 0 0) 0x7f2c5415dbf0 con 0x7f2c5414c530 2024-09-17T01:36:53.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:53.807+0000 7f2c58c00640 1 -- 172.21.15.42:0/1150750732 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2c30078b90 msgr2=0x7f2c3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:53.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:53.807+0000 7f2c58c00640 1 --2- 172.21.15.42:0/1150750732 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2c30078b90 0x7f2c3007b0a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2c44034000 tx=0x7f2c44004730 comp rx=0 tx=0).stop 2024-09-17T01:36:53.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:53.807+0000 7f2c58c00640 1 -- 172.21.15.42:0/1150750732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c5414c530 msgr2=0x7f2c54152250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:53.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:53.807+0000 7f2c58c00640 1 --2- 172.21.15.42:0/1150750732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c5414c530 0x7f2c54152250 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00cc30 tx=0x7f2c4c00a430 comp rx=0 tx=0).stop 2024-09-17T01:36:53.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:53.807+0000 7f2c58c00640 1 -- 172.21.15.42:0/1150750732 shutdown_connections 2024-09-17T01:36:53.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:53.807+0000 7f2c58c00640 1 --2- 172.21.15.42:0/1150750732 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2c30078b90 0x7f2c3007b0a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:53.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:53.807+0000 7f2c58c00640 1 --2- 172.21.15.42:0/1150750732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c540cf7c0 0x7f2c54151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:53.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:53.807+0000 7f2c58c00640 1 --2- 172.21.15.42:0/1150750732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c5414c530 0x7f2c54152250 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:53.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:53.807+0000 7f2c58c00640 1 --2- 172.21.15.42:0/1150750732 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c540b4be0 0x7f2c5414bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:53.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:53.807+0000 7f2c58c00640 1 -- 172.21.15.42:0/1150750732 >> 172.21.15.42:0/1150750732 conn(0x7f2c540b25f0 msgr2=0x7f2c540b14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:53.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:53.808+0000 7f2c58c00640 1 -- 172.21.15.42:0/1150750732 shutdown_connections 2024-09-17T01:36:53.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:53.808+0000 7f2c58c00640 1 -- 172.21.15.42:0/1150750732 wait complete. 2024-09-17T01:36:53.830 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T01:36:54.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.065+0000 7fdc0b000640 1 -- 172.21.15.42:0/3538364058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbec004800 msgr2=0x7fdbec004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:54.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.065+0000 7fdc0b000640 1 --2- 172.21.15.42:0/3538364058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbec004800 0x7fdbec004c10 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0009b50 tx=0x7fdbec005830 comp rx=0 tx=0).stop 2024-09-17T01:36:54.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.065+0000 7fdc0a600640 1 -- 172.21.15.42:0/3538364058 reap_dead start 2024-09-17T01:36:54.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.065+0000 7fdc0b000640 1 -- 172.21.15.42:0/3538364058 shutdown_connections 2024-09-17T01:36:54.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.065+0000 7fdc0b000640 1 -- 172.21.15.42:0/3538364058 >> 172.21.15.42:0/3538364058 conn(0x7fdc040b25f0 msgr2=0x7fdc040d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:54.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.065+0000 7fdc0b000640 1 -- 172.21.15.42:0/3538364058 shutdown_connections 2024-09-17T01:36:54.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.065+0000 7fdc0b000640 1 -- 172.21.15.42:0/3538364058 wait complete. 2024-09-17T01:36:54.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.067+0000 7fdc0b000640 1 Processor -- start 2024-09-17T01:36:54.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.068+0000 7fdc0b000640 1 -- start start 2024-09-17T01:36:54.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.069+0000 7fdc0b000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbec004800 0x7fdc04099a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:54.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.069+0000 7fdc0b000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc04073ab0 0x7fdc04073ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:54.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.069+0000 7fdc0b000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdc041f0fa0 0x7fdc041f13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:54.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.069+0000 7fdc0b000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdc04070470 con 0x7fdbec004800 2024-09-17T01:36:54.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.069+0000 7fdc0b000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdc040702f0 con 0x7fdc04073ab0 2024-09-17T01:36:54.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.069+0000 7fdc0b000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fdc0415eee0 con 0x7fdc041f0fa0 2024-09-17T01:36:54.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.069+0000 7fdc09c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbec004800 0x7fdc04099a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:54.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.069+0000 7fdc09c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbec004800 0x7fdc04099a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36574/0 (socket says 172.21.15.42:36574) 2024-09-17T01:36:54.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.069+0000 7fdc09c00640 1 -- 172.21.15.42:0/3387021077 learned_addr learned my addr 172.21.15.42:0/3387021077 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:54.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.070+0000 7fdc09200640 1 --2- 172.21.15.42:0/3387021077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc04073ab0 0x7fdc04073ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:54.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.070+0000 7fdc0a600640 1 --2- 172.21.15.42:0/3387021077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdc041f0fa0 0x7fdc041f13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:54.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.070+0000 7fdc09c00640 1 -- 172.21.15.42:0/3387021077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdc041f0fa0 msgr2=0x7fdc041f13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:54.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.070+0000 7fdc09c00640 1 --2- 172.21.15.42:0/3387021077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdc041f0fa0 0x7fdc041f13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:54.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.070+0000 7fdc09c00640 1 -- 172.21.15.42:0/3387021077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc04073ab0 msgr2=0x7fdc04073ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:54.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.070+0000 7fdc09c00640 1 --2- 172.21.15.42:0/3387021077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc04073ab0 0x7fdc04073ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:54.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.070+0000 7fdc09c00640 1 -- 172.21.15.42:0/3387021077 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc040747e0 con 0x7fdbec004800 2024-09-17T01:36:54.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.070+0000 7fdc09200640 1 --2- 172.21.15.42:0/3387021077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc04073ab0 0x7fdc04073ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:36:54.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.070+0000 7fdc09c00640 1 --2- 172.21.15.42:0/3387021077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbec004800 0x7fdc04099a10 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8011a80 tx=0x7fdbf8011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:54.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.070+0000 7fdc01600640 1 -- 172.21.15.42:0/3387021077 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf801f070 con 0x7fdbec004800 2024-09-17T01:36:54.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.071+0000 7fdc01600640 1 -- 172.21.15.42:0/3387021077 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbf8012450 con 0x7fdbec004800 2024-09-17T01:36:54.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.071+0000 7fdc0b000640 1 -- 172.21.15.42:0/3387021077 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc04074ac0 con 0x7fdbec004800 2024-09-17T01:36:54.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.071+0000 7fdc01600640 1 -- 172.21.15.42:0/3387021077 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8012840 con 0x7fdbec004800 2024-09-17T01:36:54.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.071+0000 7fdc0b000640 1 -- 172.21.15.42:0/3387021077 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc04144520 con 0x7fdbec004800 2024-09-17T01:36:54.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.072+0000 7fdc0b000640 1 -- 172.21.15.42:0/3387021077 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc0406d130 con 0x7fdbec004800 2024-09-17T01:36:54.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.073+0000 7fdc01600640 1 -- 172.21.15.42:0/3387021077 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdbf8022070 con 0x7fdbec004800 2024-09-17T01:36:54.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.074+0000 7fdc01600640 1 --2- 172.21.15.42:0/3387021077 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdbe4078b90 0x7fdbe407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:54.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.074+0000 7fdc01600640 1 -- 172.21.15.42:0/3387021077 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5029+0+0 (secure 0 0 0) 0x7fdbf809b7e0 con 0x7fdbec004800 2024-09-17T01:36:54.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.074+0000 7fdc09200640 1 --2- 172.21.15.42:0/3387021077 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdbe4078b90 0x7fdbe407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:54.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.075+0000 7fdc09200640 1 --2- 172.21.15.42:0/3387021077 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdbe4078b90 0x7fdbe407b0a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0035000 tx=0x7fdbf002d040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:54.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.078+0000 7fdc01600640 1 -- 172.21.15.42:0/3387021077 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdbf8063750 con 0x7fdbec004800 2024-09-17T01:36:54.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.271+0000 7fdc0b000640 1 -- 172.21.15.42:0/3387021077 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fdc040b17d0 con 0x7fdbec004800 2024-09-17T01:36:54.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.271+0000 7fdc01600640 1 -- 172.21.15.42:0/3387021077 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v42) ==== 59+0+2294 (secure 0 0 0) 0x7fdbf8068180 con 0x7fdbec004800 2024-09-17T01:36:54.269 INFO:teuthology.orchestra.run.smithi042.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T01:36:54.269 INFO:teuthology.orchestra.run.smithi042.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T01:36:54.269 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced client_mount_timeout 30 2024-09-17T01:36:54.269 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_client 20/20 2024-09-17T01:36:54.269 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_mgr 20/20 2024-09-17T01:36:54.269 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_ms 1/1 2024-09-17T01:36:54.269 INFO:teuthology.orchestra.run.smithi042.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T01:36:54.270 INFO:teuthology.orchestra.run.smithi042.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T01:36:54.270 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3683.959260 2024-09-17T01:36:54.270 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4350.010833 2024-09-17T01:36:54.270 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4316.776055 2024-09-17T01:36:54.270 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3885.595082 2024-09-17T01:36:54.270 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3602.000737 2024-09-17T01:36:54.270 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4883.364748 2024-09-17T01:36:54.270 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3752.484811 2024-09-17T01:36:54.270 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3775.035963 2024-09-17T01:36:54.270 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds 20/20 2024-09-17T01:36:54.270 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T01:36:54.270 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_ms 2/2 2024-09-17T01:36:54.270 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_frag true 2024-09-17T01:36:54.270 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_scatterstat true 2024-09-17T01:36:54.271 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T01:36:54.271 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_verify_scatter true 2024-09-17T01:36:54.271 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T01:36:54.271 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T01:36:54.271 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T01:36:54.271 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced client_mount_timeout 600 2024-09-17T01:36:54.271 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_client 20/20 2024-09-17T01:36:54.271 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_ms 1/1 2024-09-17T01:36:54.271 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T01:36:54.271 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T01:36:54.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.273+0000 7fdc0b000640 1 -- 172.21.15.42:0/3387021077 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdbe4078b90 msgr2=0x7fdbe407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:54.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.273+0000 7fdc0b000640 1 --2- 172.21.15.42:0/3387021077 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdbe4078b90 0x7fdbe407b0a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0035000 tx=0x7fdbf002d040 comp rx=0 tx=0).stop 2024-09-17T01:36:54.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.273+0000 7fdc0b000640 1 -- 172.21.15.42:0/3387021077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbec004800 msgr2=0x7fdc04099a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:54.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.273+0000 7fdc0b000640 1 --2- 172.21.15.42:0/3387021077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbec004800 0x7fdc04099a10 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8011a80 tx=0x7fdbf8011f40 comp rx=0 tx=0).stop 2024-09-17T01:36:54.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.274+0000 7fdc0b000640 1 -- 172.21.15.42:0/3387021077 shutdown_connections 2024-09-17T01:36:54.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.274+0000 7fdc0b000640 1 --2- 172.21.15.42:0/3387021077 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdbe4078b90 0x7fdbe407b0a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:54.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.274+0000 7fdc0b000640 1 --2- 172.21.15.42:0/3387021077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc04073ab0 0x7fdc04073ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:54.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.274+0000 7fdc0b000640 1 --2- 172.21.15.42:0/3387021077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdc041f0fa0 0x7fdc041f13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:54.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.274+0000 7fdc0b000640 1 --2- 172.21.15.42:0/3387021077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbec004800 0x7fdc04099a10 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:54.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.274+0000 7fdc0b000640 1 -- 172.21.15.42:0/3387021077 >> 172.21.15.42:0/3387021077 conn(0x7fdc040b25f0 msgr2=0x7fdc04075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:54.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.274+0000 7fdc0b000640 1 -- 172.21.15.42:0/3387021077 shutdown_connections 2024-09-17T01:36:54.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.274+0000 7fdc0b000640 1 -- 172.21.15.42:0/3387021077 wait complete. 2024-09-17T01:36:54.293 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T01:36:54.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.526+0000 7fe5e2600640 1 -- 172.21.15.42:0/169417743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5dc0cecb0 msgr2=0x7fe5dc0cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:54.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.526+0000 7fe5e2600640 1 --2- 172.21.15.42:0/169417743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5dc0cecb0 0x7fe5dc0cf0c0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc071ef0 tx=0x7fe5c802a560 comp rx=0 tx=0).stop 2024-09-17T01:36:54.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.527+0000 7fe5e2600640 1 -- 172.21.15.42:0/169417743 shutdown_connections 2024-09-17T01:36:54.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.527+0000 7fe5e2600640 1 --2- 172.21.15.42:0/169417743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5dc0cecb0 0x7fe5dc0cf0c0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:54.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.527+0000 7fe5e2600640 1 --2- 172.21.15.42:0/169417743 >> v2:172.21.15.43:3300/0 conn(0x7fe5dc15cec0 0x7fe5dc15d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:54.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.527+0000 7fe5e2600640 1 -- 172.21.15.42:0/169417743 >> 172.21.15.42:0/169417743 conn(0x7fe5dc0b2930 msgr2=0x7fe5dc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:54.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.527+0000 7fe5e2600640 1 -- 172.21.15.42:0/169417743 shutdown_connections 2024-09-17T01:36:54.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.527+0000 7fe5e2600640 1 -- 172.21.15.42:0/169417743 wait complete. 2024-09-17T01:36:54.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.529+0000 7fe5e2600640 1 Processor -- start 2024-09-17T01:36:54.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.529+0000 7fe5e2600640 1 -- start start 2024-09-17T01:36:54.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.531+0000 7fe5e2600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5dc072950 0x7fe5dc1f2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:54.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.531+0000 7fe5e2600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe5dc0cecb0 0x7fe5dc06f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:54.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.531+0000 7fe5e2600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5dc15cec0 0x7fe5dc0b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:54.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.531+0000 7fe5e2600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc0741d0 con 0x7fe5dc072950 2024-09-17T01:36:54.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.531+0000 7fe5e2600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc06dd50 con 0x7fe5dc15cec0 2024-09-17T01:36:54.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.531+0000 7fe5e2600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe5dc072d60 con 0x7fe5dc0cecb0 2024-09-17T01:36:54.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.531+0000 7fe5db400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5dc072950 0x7fe5dc1f2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:54.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.531+0000 7fe5db400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5dc072950 0x7fe5dc1f2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36598/0 (socket says 172.21.15.42:36598) 2024-09-17T01:36:54.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.531+0000 7fe5db400640 1 -- 172.21.15.42:0/1517402980 learned_addr learned my addr 172.21.15.42:0/1517402980 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:54.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.531+0000 7fe5daa00640 1 --2- 172.21.15.42:0/1517402980 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe5dc0cecb0 0x7fe5dc06f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:54.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.531+0000 7fe5dbe00640 1 --2- 172.21.15.42:0/1517402980 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5dc15cec0 0x7fe5dc0b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:54.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.531+0000 7fe5db400640 1 -- 172.21.15.42:0/1517402980 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe5dc0cecb0 msgr2=0x7fe5dc06f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:54.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.531+0000 7fe5db400640 1 --2- 172.21.15.42:0/1517402980 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe5dc0cecb0 0x7fe5dc06f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:54.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.531+0000 7fe5db400640 1 -- 172.21.15.42:0/1517402980 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5dc15cec0 msgr2=0x7fe5dc0b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:54.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.531+0000 7fe5db400640 1 --2- 172.21.15.42:0/1517402980 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5dc15cec0 0x7fe5dc0b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:54.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.531+0000 7fe5db400640 1 -- 172.21.15.42:0/1517402980 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5dc1f3020 con 0x7fe5dc072950 2024-09-17T01:36:54.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.532+0000 7fe5db400640 1 --2- 172.21.15.42:0/1517402980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5dc072950 0x7fe5dc1f2ae0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc009fd0 tx=0x7fe5cc00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:54.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.532+0000 7fe5d3400640 1 -- 172.21.15.42:0/1517402980 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc004220 con 0x7fe5dc072950 2024-09-17T01:36:54.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.532+0000 7fe5d3400640 1 -- 172.21.15.42:0/1517402980 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5cc0043c0 con 0x7fe5dc072950 2024-09-17T01:36:54.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.532+0000 7fe5d3400640 1 -- 172.21.15.42:0/1517402980 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc00cab0 con 0x7fe5dc072950 2024-09-17T01:36:54.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.532+0000 7fe5e2600640 1 -- 172.21.15.42:0/1517402980 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5dc1f8ec0 con 0x7fe5dc072950 2024-09-17T01:36:54.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.532+0000 7fe5e2600640 1 -- 172.21.15.42:0/1517402980 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5dc1f9480 con 0x7fe5dc072950 2024-09-17T01:36:54.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.533+0000 7fe5e2600640 1 -- 172.21.15.42:0/1517402980 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5dc073120 con 0x7fe5dc072950 2024-09-17T01:36:54.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.534+0000 7fe5d3400640 1 -- 172.21.15.42:0/1517402980 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe5cc00cc50 con 0x7fe5dc072950 2024-09-17T01:36:54.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.535+0000 7fe5d3400640 1 --2- 172.21.15.42:0/1517402980 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe5bc078b90 0x7fe5bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:54.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.535+0000 7fe5d3400640 1 -- 172.21.15.42:0/1517402980 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5029+0+0 (secure 0 0 0) 0x7fe5cc09b360 con 0x7fe5dc072950 2024-09-17T01:36:54.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.536+0000 7fe5daa00640 1 --2- 172.21.15.42:0/1517402980 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe5bc078b90 0x7fe5bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:54.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.536+0000 7fe5daa00640 1 --2- 172.21.15.42:0/1517402980 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe5bc078b90 0x7fe5bc07b0a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8033000 tx=0x7fe5c8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:54.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.540+0000 7fe5d3400640 1 -- 172.21.15.42:0/1517402980 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe5cc0639a0 con 0x7fe5dc072950 2024-09-17T01:36:54.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.734+0000 7fe5e2600640 1 -- 172.21.15.42:0/1517402980 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fe5dc06a170 con 0x7fe5dc072950 2024-09-17T01:36:54.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.738+0000 7fe5d3400640 1 -- 172.21.15.42:0/1517402980 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v43)=0 v43) ==== 122+0+0 (secure 0 0 0) 0x7fe5cc0632a0 con 0x7fe5dc072950 2024-09-17T01:36:54.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.741+0000 7fe5e2600640 1 -- 172.21.15.42:0/1517402980 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe5bc078b90 msgr2=0x7fe5bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:54.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.741+0000 7fe5e2600640 1 --2- 172.21.15.42:0/1517402980 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe5bc078b90 0x7fe5bc07b0a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8033000 tx=0x7fe5c8004730 comp rx=0 tx=0).stop 2024-09-17T01:36:54.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.741+0000 7fe5e2600640 1 -- 172.21.15.42:0/1517402980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5dc072950 msgr2=0x7fe5dc1f2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:54.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.741+0000 7fe5e2600640 1 --2- 172.21.15.42:0/1517402980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5dc072950 0x7fe5dc1f2ae0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc009fd0 tx=0x7fe5cc00ec20 comp rx=0 tx=0).stop 2024-09-17T01:36:54.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.741+0000 7fe5e2600640 1 -- 172.21.15.42:0/1517402980 shutdown_connections 2024-09-17T01:36:54.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.741+0000 7fe5e2600640 1 --2- 172.21.15.42:0/1517402980 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe5bc078b90 0x7fe5bc07b0a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:54.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.741+0000 7fe5e2600640 1 --2- 172.21.15.42:0/1517402980 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe5dc15cec0 0x7fe5dc0b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:54.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.741+0000 7fe5e2600640 1 --2- 172.21.15.42:0/1517402980 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe5dc0cecb0 0x7fe5dc06f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:54.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.741+0000 7fe5e2600640 1 --2- 172.21.15.42:0/1517402980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5dc072950 0x7fe5dc1f2ae0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:54.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.741+0000 7fe5e2600640 1 -- 172.21.15.42:0/1517402980 >> 172.21.15.42:0/1517402980 conn(0x7fe5dc0b2930 msgr2=0x7fe5dc15b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:54.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.741+0000 7fe5e2600640 1 -- 172.21.15.42:0/1517402980 shutdown_connections 2024-09-17T01:36:54.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:54.741+0000 7fe5e2600640 1 -- 172.21.15.42:0/1517402980 wait complete. 2024-09-17T01:36:54.764 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:36:54.764 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:36:54.853 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:36:54.943 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:36:54.943 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:36:54.943 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:36:54.978 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:36:54.978 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:36:54.979 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:36:55.015 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:36:55.016 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:36:55.016 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:36:55.054 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:36:55.054 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:36:55.054 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:36:55.092 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:36:55.092 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T01:36:55.093 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:36:55.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.323+0000 7fc56d000640 1 -- 172.21.15.42:0/948747839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc568072e00 msgr2=0x7fc56815bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:55.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.323+0000 7fc56d000640 1 --2- 172.21.15.42:0/948747839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc568072e00 0x7fc56815bc50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc55800a940 tx=0x7fc55802b880 comp rx=0 tx=0).stop 2024-09-17T01:36:55.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.323+0000 7fc56d000640 1 -- 172.21.15.42:0/948747839 shutdown_connections 2024-09-17T01:36:55.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.323+0000 7fc56d000640 1 --2- 172.21.15.42:0/948747839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc568072e00 0x7fc56815bc50 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:55.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.323+0000 7fc56d000640 1 -- 172.21.15.42:0/948747839 >> 172.21.15.42:0/948747839 conn(0x7fc5680b2930 msgr2=0x7fc56806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:55.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.323+0000 7fc56d000640 1 -- 172.21.15.42:0/948747839 shutdown_connections 2024-09-17T01:36:55.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.323+0000 7fc56d000640 1 -- 172.21.15.42:0/948747839 wait complete. 2024-09-17T01:36:55.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.325+0000 7fc56d000640 1 Processor -- start 2024-09-17T01:36:55.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.325+0000 7fc56d000640 1 -- start start 2024-09-17T01:36:55.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.327+0000 7fc56d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc568072e00 0x7fc5681f9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:55.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.327+0000 7fc56d000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc56815f190 0x7fc568154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:55.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.327+0000 7fc56d000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5681f5fa0 0x7fc5680aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:55.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.327+0000 7fc56d000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc568151c30 con 0x7fc568072e00 2024-09-17T01:36:55.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.327+0000 7fc56d000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc568070790 con 0x7fc5681f5fa0 2024-09-17T01:36:55.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.327+0000 7fc56d000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc568151db0 con 0x7fc56815f190 2024-09-17T01:36:55.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.327+0000 7fc565e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc568072e00 0x7fc5681f9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:55.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.327+0000 7fc565e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc568072e00 0x7fc5681f9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36608/0 (socket says 172.21.15.42:36608) 2024-09-17T01:36:55.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.327+0000 7fc565e00640 1 -- 172.21.15.42:0/3895172828 learned_addr learned my addr 172.21.15.42:0/3895172828 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:55.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.327+0000 7fc565e00640 1 -- 172.21.15.42:0/3895172828 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc56815f190 msgr2=0x7fc568154300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:55.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.327+0000 7fc55fe00640 1 --2- 172.21.15.42:0/3895172828 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc56815f190 0x7fc568154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:55.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.327+0000 7fc566800640 1 --2- 172.21.15.42:0/3895172828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5681f5fa0 0x7fc5680aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:55.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.327+0000 7fc565e00640 1 --2- 172.21.15.42:0/3895172828 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc56815f190 0x7fc568154300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:55.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.327+0000 7fc565e00640 1 -- 172.21.15.42:0/3895172828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5681f5fa0 msgr2=0x7fc5680aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:55.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.327+0000 7fc565e00640 1 --2- 172.21.15.42:0/3895172828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5681f5fa0 0x7fc5680aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:55.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.327+0000 7fc565e00640 1 -- 172.21.15.42:0/3895172828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5681f97c0 con 0x7fc568072e00 2024-09-17T01:36:55.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.327+0000 7fc55fe00640 1 --2- 172.21.15.42:0/3895172828 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc56815f190 0x7fc568154300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:36:55.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.327+0000 7fc566800640 1 --2- 172.21.15.42:0/3895172828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5681f5fa0 0x7fc5680aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:36:55.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.328+0000 7fc565e00640 1 --2- 172.21.15.42:0/3895172828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc568072e00 0x7fc5681f9280 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fc55802be70 tx=0x7fc558030ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:55.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.328+0000 7fc55e000640 1 -- 172.21.15.42:0/3895172828 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc558040070 con 0x7fc568072e00 2024-09-17T01:36:55.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.328+0000 7fc55e000640 1 -- 172.21.15.42:0/3895172828 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc558005330 con 0x7fc568072e00 2024-09-17T01:36:55.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.328+0000 7fc56d000640 1 -- 172.21.15.42:0/3895172828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc568154f20 con 0x7fc568072e00 2024-09-17T01:36:55.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.328+0000 7fc55e000640 1 -- 172.21.15.42:0/3895172828 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc558005c90 con 0x7fc568072e00 2024-09-17T01:36:55.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.328+0000 7fc56d000640 1 -- 172.21.15.42:0/3895172828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5681f57a0 con 0x7fc568072e00 2024-09-17T01:36:55.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.329+0000 7fc56d000640 1 -- 172.21.15.42:0/3895172828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5681f52b0 con 0x7fc568072e00 2024-09-17T01:36:55.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.330+0000 7fc55e000640 1 -- 172.21.15.42:0/3895172828 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc55803a040 con 0x7fc568072e00 2024-09-17T01:36:55.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.331+0000 7fc55e000640 1 --2- 172.21.15.42:0/3895172828 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc544078b90 0x7fc54407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:55.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.331+0000 7fc55e000640 1 -- 172.21.15.42:0/3895172828 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5029+0+0 (secure 0 0 0) 0x7fc5580bb950 con 0x7fc568072e00 2024-09-17T01:36:55.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.332+0000 7fc55fe00640 1 --2- 172.21.15.42:0/3895172828 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc544078b90 0x7fc54407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:55.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.332+0000 7fc55fe00640 1 --2- 172.21.15.42:0/3895172828 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc544078b90 0x7fc54407b0a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc550001860 tx=0x7fc550009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:55.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.336+0000 7fc55e000640 1 -- 172.21.15.42:0/3895172828 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc558083f90 con 0x7fc568072e00 2024-09-17T01:36:55.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.571+0000 7fc56d000640 1 -- 172.21.15.42:0/3895172828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc56815bc50 con 0x7fc568072e00 2024-09-17T01:36:55.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.572+0000 7fc55e000640 1 -- 172.21.15.42:0/3895172828 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+3905 (secure 0 0 0) 0x7fc558083890 con 0x7fc568072e00 2024-09-17T01:36:55.570 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:55.570 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":49,"btime":"2024-09-17T01:36:47:548512+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5792,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2214729520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2214729520},{"type":"v1","addr":"172.21.15.43:6835","nonce":2214729520}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/983475498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":983475498},{"type":"v1","addr":"172.21.15.43:6837","nonce":983475498}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1213307380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1213307380},{"type":"v1","addr":"172.21.15.42:6833","nonce":1213307380}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6636,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/466710375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":466710375},{"type":"v1","addr":"172.21.15.42:6835","nonce":466710375}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[]} 2024-09-17T01:36:55.570 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 49 2024-09-17T01:36:55.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.574+0000 7fc56d000640 1 -- 172.21.15.42:0/3895172828 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc544078b90 msgr2=0x7fc54407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:55.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.574+0000 7fc56d000640 1 --2- 172.21.15.42:0/3895172828 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc544078b90 0x7fc54407b0a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc550001860 tx=0x7fc550009040 comp rx=0 tx=0).stop 2024-09-17T01:36:55.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.574+0000 7fc56d000640 1 -- 172.21.15.42:0/3895172828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc568072e00 msgr2=0x7fc5681f9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:55.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.574+0000 7fc56d000640 1 --2- 172.21.15.42:0/3895172828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc568072e00 0x7fc5681f9280 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fc55802be70 tx=0x7fc558030ce0 comp rx=0 tx=0).stop 2024-09-17T01:36:55.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.574+0000 7fc56d000640 1 -- 172.21.15.42:0/3895172828 shutdown_connections 2024-09-17T01:36:55.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.574+0000 7fc56d000640 1 --2- 172.21.15.42:0/3895172828 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc544078b90 0x7fc54407b0a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:55.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.574+0000 7fc56d000640 1 --2- 172.21.15.42:0/3895172828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5681f5fa0 0x7fc5680aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:55.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.574+0000 7fc56d000640 1 --2- 172.21.15.42:0/3895172828 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc56815f190 0x7fc568154300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:55.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.574+0000 7fc56d000640 1 --2- 172.21.15.42:0/3895172828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc568072e00 0x7fc5681f9280 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:55.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.574+0000 7fc56d000640 1 -- 172.21.15.42:0/3895172828 >> 172.21.15.42:0/3895172828 conn(0x7fc5680b2930 msgr2=0x7fc5680b1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:55.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.574+0000 7fc56d000640 1 -- 172.21.15.42:0/3895172828 shutdown_connections 2024-09-17T01:36:55.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.574+0000 7fc56d000640 1 -- 172.21.15.42:0/3895172828 wait complete. 2024-09-17T01:36:55.598 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T01:36:55.598 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T01:36:55.599 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T01:36:55.599 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:36:55.599 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T01:36:55.599 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T01:36:55.599 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T01:36:55.599 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:36:55.600 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T01:36:55.600 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T01:36:55.600 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T01:36:55.600 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:36:55.600 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T01:36:55.600 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T01:36:55.601 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T01:36:55.601 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:36:55.624 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T01:36:55.650 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T01:36:55.651 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T01:36:55.651 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T01:36:55.652 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T01:36:55.652 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T01:36:55.653 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T01:36:55.653 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T01:36:55.669 INFO:tasks.ceph.mds.b:Started 2024-09-17T01:36:55.670 DEBUG:teuthology.parallel:result is None 2024-09-17T01:36:55.672 INFO:tasks.ceph.mds.d:Started 2024-09-17T01:36:55.672 DEBUG:teuthology.parallel:result is None 2024-09-17T01:36:55.696 INFO:tasks.ceph.mds.a:Started 2024-09-17T01:36:55.697 DEBUG:teuthology.parallel:result is None 2024-09-17T01:36:55.699 INFO:tasks.ceph.mds.c:Started 2024-09-17T01:36:55.699 DEBUG:teuthology.parallel:result is None 2024-09-17T01:36:55.699 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T01:36:55.873 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-09-17T01:36:55.876 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-09-17T01:36:55.898 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:36:55.898 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:36:55.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.937+0000 7f2948c00640 1 -- 172.21.15.42:0/150368460 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29440b4be0 msgr2=0x7f294415d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:55.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.937+0000 7f2948c00640 1 --2- 172.21.15.42:0/150368460 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29440b4be0 0x7f294415d6b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f2934005fd0 tx=0x7f293402a5d0 comp rx=0 tx=0).stop 2024-09-17T01:36:55.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.937+0000 7f2948c00640 1 -- 172.21.15.42:0/150368460 shutdown_connections 2024-09-17T01:36:55.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.937+0000 7f2948c00640 1 --2- 172.21.15.42:0/150368460 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29440b4be0 0x7f294415d6b0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:55.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.937+0000 7f2948c00640 1 -- 172.21.15.42:0/150368460 >> 172.21.15.42:0/150368460 conn(0x7f29440b25f0 msgr2=0x7f29440d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:55.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.937+0000 7f2948c00640 1 -- 172.21.15.42:0/150368460 shutdown_connections 2024-09-17T01:36:55.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.937+0000 7f2948c00640 1 -- 172.21.15.42:0/150368460 wait complete. 2024-09-17T01:36:55.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.939+0000 7f2948c00640 1 Processor -- start 2024-09-17T01:36:55.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.939+0000 7f2948c00640 1 -- start start 2024-09-17T01:36:55.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.941+0000 7f2948c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29440b4be0 0x7f294414fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:55.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.941+0000 7f2948c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29440cf7c0 0x7f29440c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:55.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.941+0000 7f2948c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2944074b00 0x7f29440c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.941+0000 7f2948c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f29441535e0 con 0x7f29440b4be0 2024-09-17T01:36:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.941+0000 7f2948c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f29440b4340 con 0x7f29440cf7c0 2024-09-17T01:36:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.941+0000 7f2948c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2944153760 con 0x7f2944074b00 2024-09-17T01:36:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.941+0000 7f2943400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29440b4be0 0x7f294414fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.941+0000 7f2943400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29440b4be0 0x7f294414fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37818/0 (socket says 172.21.15.42:37818) 2024-09-17T01:36:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.941+0000 7f2943400640 1 -- 172.21.15.42:0/1811191531 learned_addr learned my addr 172.21.15.42:0/1811191531 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.941+0000 7f2942a00640 1 --2- 172.21.15.42:0/1811191531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29440cf7c0 0x7f29440c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.941+0000 7f2943e00640 1 --2- 172.21.15.42:0/1811191531 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2944074b00 0x7f29440c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.941+0000 7f2943400640 1 -- 172.21.15.42:0/1811191531 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2944074b00 msgr2=0x7f29440c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.941+0000 7f2943400640 1 --2- 172.21.15.42:0/1811191531 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2944074b00 0x7f29440c6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.941+0000 7f2943400640 1 -- 172.21.15.42:0/1811191531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29440cf7c0 msgr2=0x7f29440c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.941+0000 7f2943400640 1 --2- 172.21.15.42:0/1811191531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29440cf7c0 0x7f29440c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:55.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.941+0000 7f2943400640 1 -- 172.21.15.42:0/1811191531 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2944150830 con 0x7f29440b4be0 2024-09-17T01:36:55.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.942+0000 7f2943400640 1 --2- 172.21.15.42:0/1811191531 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29440b4be0 0x7f294414fe60 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f2934000c00 tx=0x7f29340038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:55.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.942+0000 7f293b400640 1 -- 172.21.15.42:0/1811191531 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293403e030 con 0x7f29440b4be0 2024-09-17T01:36:55.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.942+0000 7f293b400640 1 -- 172.21.15.42:0/1811191531 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2934003ca0 con 0x7f29440b4be0 2024-09-17T01:36:55.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.942+0000 7f293b400640 1 -- 172.21.15.42:0/1811191531 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2934035040 con 0x7f29440b4be0 2024-09-17T01:36:55.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.943+0000 7f2948c00640 1 -- 172.21.15.42:0/1811191531 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29440c8f10 con 0x7f29440b4be0 2024-09-17T01:36:55.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.943+0000 7f2948c00640 1 -- 172.21.15.42:0/1811191531 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29440c94d0 con 0x7f29440b4be0 2024-09-17T01:36:55.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.944+0000 7f2948c00640 1 -- 172.21.15.42:0/1811191531 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f294415d6b0 con 0x7f29440b4be0 2024-09-17T01:36:55.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.945+0000 7f293b400640 1 -- 172.21.15.42:0/1811191531 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2934041030 con 0x7f29440b4be0 2024-09-17T01:36:55.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.947+0000 7f293b400640 1 --2- 172.21.15.42:0/1811191531 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2924078b90 0x7f292407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:55.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.947+0000 7f293b400640 1 -- 172.21.15.42:0/1811191531 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5029+0+0 (secure 0 0 0) 0x7f29340bb070 con 0x7f29440b4be0 2024-09-17T01:36:55.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.947+0000 7f2942a00640 1 --2- 172.21.15.42:0/1811191531 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2924078b90 0x7f292407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:55.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.948+0000 7f2942a00640 1 --2- 172.21.15.42:0/1811191531 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2924078b90 0x7f292407b0a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2944153250 tx=0x7f2930009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:55.952+0000 7f293b400640 1 -- 172.21.15.42:0/1811191531 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2944150830 con 0x7f29440b4be0 2024-09-17T01:36:56.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:56.168+0000 7f2948c00640 1 -- 172.21.15.42:0/1811191531 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f2944152290 con 0x7f29440b4be0 2024-09-17T01:36:56.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:56.826+0000 7f293b400640 1 -- 172.21.15.42:0/1811191531 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v72) ==== 97+0+0 (secure 0 0 0) 0x7f29340830f0 con 0x7f29440b4be0 2024-09-17T01:36:56.824 INFO:teuthology.orchestra.run.smithi042.stderr: removed all blocklist entries 2024-09-17T01:36:56.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:56.829+0000 7f2948c00640 1 -- 172.21.15.42:0/1811191531 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2924078b90 msgr2=0x7f292407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:56.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:56.829+0000 7f2948c00640 1 --2- 172.21.15.42:0/1811191531 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2924078b90 0x7f292407b0a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2944153250 tx=0x7f2930009040 comp rx=0 tx=0).stop 2024-09-17T01:36:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:56.829+0000 7f2948c00640 1 -- 172.21.15.42:0/1811191531 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29440b4be0 msgr2=0x7f294414fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:56.829+0000 7f2948c00640 1 --2- 172.21.15.42:0/1811191531 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29440b4be0 0x7f294414fe60 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f2934000c00 tx=0x7f29340038a0 comp rx=0 tx=0).stop 2024-09-17T01:36:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:56.829+0000 7f2948c00640 1 -- 172.21.15.42:0/1811191531 shutdown_connections 2024-09-17T01:36:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:56.829+0000 7f2948c00640 1 --2- 172.21.15.42:0/1811191531 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2924078b90 0x7f292407b0a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:56.829+0000 7f2948c00640 1 --2- 172.21.15.42:0/1811191531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29440cf7c0 0x7f29440c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:56.829+0000 7f2948c00640 1 --2- 172.21.15.42:0/1811191531 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2944074b00 0x7f29440c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:56.829+0000 7f2948c00640 1 --2- 172.21.15.42:0/1811191531 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29440b4be0 0x7f294414fe60 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:56.829+0000 7f2948c00640 1 -- 172.21.15.42:0/1811191531 >> 172.21.15.42:0/1811191531 conn(0x7f29440b25f0 msgr2=0x7f29441513e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:56.829+0000 7f2948c00640 1 -- 172.21.15.42:0/1811191531 shutdown_connections 2024-09-17T01:36:56.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:56.829+0000 7f2948c00640 1 -- 172.21.15.42:0/1811191531 wait complete. 2024-09-17T01:36:56.855 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T01:36:57.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.089+0000 7fe7ba800640 1 -- 172.21.15.42:0/1654036158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe7b40cfba0 msgr2=0x7fe7b40b9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:57.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.089+0000 7fe7ba800640 1 --2- 172.21.15.42:0/1654036158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe7b40cfba0 0x7fe7b40b9fb0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40d3d90 tx=0x7fe7a802a560 comp rx=0 tx=0).stop 2024-09-17T01:36:57.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.090+0000 7fe7ba800640 1 -- 172.21.15.42:0/1654036158 shutdown_connections 2024-09-17T01:36:57.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.090+0000 7fe7ba800640 1 --2- 172.21.15.42:0/1654036158 >> v2:172.21.15.43:3300/0 conn(0x7fe7b40d0e10 0x7fe7b40d1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:57.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.090+0000 7fe7ba800640 1 --2- 172.21.15.42:0/1654036158 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe7b40cfba0 0x7fe7b40b9fb0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:57.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.090+0000 7fe7ba800640 1 -- 172.21.15.42:0/1654036158 >> 172.21.15.42:0/1654036158 conn(0x7fe7b40b6140 msgr2=0x7fe7b40b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:57.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.090+0000 7fe7ba800640 1 -- 172.21.15.42:0/1654036158 shutdown_connections 2024-09-17T01:36:57.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.090+0000 7fe7ba800640 1 -- 172.21.15.42:0/1654036158 wait complete. 2024-09-17T01:36:57.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.092+0000 7fe7ba800640 1 Processor -- start 2024-09-17T01:36:57.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.092+0000 7fe7ba800640 1 -- start start 2024-09-17T01:36:57.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.093+0000 7fe7ba800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe7b40cfba0 0x7fe7b41577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:57.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.093+0000 7fe7ba800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe7b40d0e10 0x7fe7b40b9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:57.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.093+0000 7fe7ba800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7b4162500 0x7fe7b41f8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:57.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.093+0000 7fe7ba800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b40b31e0 con 0x7fe7b40cfba0 2024-09-17T01:36:57.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.093+0000 7fe7ba800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b40b3060 con 0x7fe7b4162500 2024-09-17T01:36:57.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.093+0000 7fe7ba800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe7b40b3360 con 0x7fe7b40d0e10 2024-09-17T01:36:57.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.094+0000 7fe7b9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe7b40cfba0 0x7fe7b41577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:57.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.094+0000 7fe7b9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe7b40cfba0 0x7fe7b41577c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37842/0 (socket says 172.21.15.42:37842) 2024-09-17T01:36:57.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.094+0000 7fe7b9400640 1 -- 172.21.15.42:0/3385753317 learned_addr learned my addr 172.21.15.42:0/3385753317 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:57.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.094+0000 7fe7b8a00640 1 --2- 172.21.15.42:0/3385753317 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe7b40d0e10 0x7fe7b40b9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:57.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.094+0000 7fe7b9e00640 1 --2- 172.21.15.42:0/3385753317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7b4162500 0x7fe7b41f8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:57.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.094+0000 7fe7b9400640 1 -- 172.21.15.42:0/3385753317 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe7b40d0e10 msgr2=0x7fe7b40b9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:57.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.094+0000 7fe7b9400640 1 --2- 172.21.15.42:0/3385753317 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe7b40d0e10 0x7fe7b40b9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:57.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.094+0000 7fe7b9400640 1 -- 172.21.15.42:0/3385753317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7b4162500 msgr2=0x7fe7b41f8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:57.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.094+0000 7fe7b9400640 1 --2- 172.21.15.42:0/3385753317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7b4162500 0x7fe7b41f8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:57.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.094+0000 7fe7b9400640 1 -- 172.21.15.42:0/3385753317 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b4157d00 con 0x7fe7b40cfba0 2024-09-17T01:36:57.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.095+0000 7fe7b9400640 1 --2- 172.21.15.42:0/3385753317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe7b40cfba0 0x7fe7b41577c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8034040 tx=0x7fe7a80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:57.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.095+0000 7fe7b1600640 1 -- 172.21.15.42:0/3385753317 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a803e030 con 0x7fe7b40cfba0 2024-09-17T01:36:57.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.095+0000 7fe7b1600640 1 -- 172.21.15.42:0/3385753317 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7a80047a0 con 0x7fe7b40cfba0 2024-09-17T01:36:57.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.095+0000 7fe7ba800640 1 -- 172.21.15.42:0/3385753317 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7b4158210 con 0x7fe7b40cfba0 2024-09-17T01:36:57.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.095+0000 7fe7b1600640 1 -- 172.21.15.42:0/3385753317 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a8035040 con 0x7fe7b40cfba0 2024-09-17T01:36:57.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.095+0000 7fe7ba800640 1 -- 172.21.15.42:0/3385753317 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7b41587d0 con 0x7fe7b40cfba0 2024-09-17T01:36:57.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.096+0000 7fe7ba800640 1 -- 172.21.15.42:0/3385753317 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7b40b3830 con 0x7fe7b40cfba0 2024-09-17T01:36:57.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.097+0000 7fe7b1600640 1 -- 172.21.15.42:0/3385753317 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe7a8041030 con 0x7fe7b40cfba0 2024-09-17T01:36:57.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.098+0000 7fe7b1600640 1 --2- 172.21.15.42:0/3385753317 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe794078b90 0x7fe79407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:57.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.099+0000 7fe7b1600640 1 -- 172.21.15.42:0/3385753317 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 4857+0+0 (secure 0 0 0) 0x7fe7a80bb2b0 con 0x7fe7b40cfba0 2024-09-17T01:36:57.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.099+0000 7fe7b8a00640 1 --2- 172.21.15.42:0/3385753317 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe794078b90 0x7fe79407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:57.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.100+0000 7fe7b8a00640 1 --2- 172.21.15.42:0/3385753317 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe794078b90 0x7fe79407b0a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe7b415b8c0 tx=0x7fe7a0005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:57.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.103+0000 7fe7b1600640 1 -- 172.21.15.42:0/3385753317 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe7a8083350 con 0x7fe7b40cfba0 2024-09-17T01:36:57.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.367+0000 7fe7ba800640 1 -- 172.21.15.42:0/3385753317 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe7b415b960 con 0x7fe7b40cfba0 2024-09-17T01:36:57.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.368+0000 7fe7b1600640 1 -- 172.21.15.42:0/3385753317 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v31) ==== 80+0+5304 (secure 0 0 0) 0x7fe7a8087d80 con 0x7fe7b40cfba0 2024-09-17T01:36:57.366 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:57.366 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:36:57.366 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_dump": [ 2024-09-17T01:36:57.366 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:57.366 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.a", 2024-09-17T01:36:57.366 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmyJK4HRAAIC4E4V7p1fqIEfPIICMxZg==", 2024-09-17T01:36:57.366 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:57.366 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:36:57.366 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:36:57.366 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:36:57.367 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:57.367 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:57.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:57.367 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:57.367 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.b", 2024-09-17T01:36:57.367 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmXv3vORAALPrYIM6Vtz0g1pOxVhrUig==", 2024-09-17T01:36:57.367 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:57.367 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:36:57.367 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:36:57.367 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:36:57.367 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:57.367 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:57.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:57.368 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:57.368 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.c", 2024-09-17T01:36:57.368 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmPE7MKxAA9mGG+EO9C3VGVMerOm92+Q==", 2024-09-17T01:36:57.368 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:57.368 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:36:57.368 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:36:57.368 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:36:57.368 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:57.368 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:57.368 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:57.368 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:57.368 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.d", 2024-09-17T01:36:57.368 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmaOBSDBAATU4tpjM5IMcuvzZFE7N5bQ==", 2024-09-17T01:36:57.368 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:57.369 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:36:57.369 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:36:57.369 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:36:57.369 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:57.369 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:57.369 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:57.369 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:57.369 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.0", 2024-09-17T01:36:57.369 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDP2+hmEJebExAAAdGEoSzM96ybGT9h7t7OkA==", 2024-09-17T01:36:57.369 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:57.369 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:36:57.369 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:36:57.369 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:57.370 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:57.370 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:57.370 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:57.370 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.1", 2024-09-17T01:36:57.370 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDS2+hm7dWoMBAAagktrUl0O2/mgKCEfpAstA==", 2024-09-17T01:36:57.370 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:57.370 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:36:57.370 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:36:57.370 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:57.370 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:57.370 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:57.370 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:57.370 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.2", 2024-09-17T01:36:57.370 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDW2+hmEfSPBBAAPAa6EZt27yUcJSfZyCKheg==", 2024-09-17T01:36:57.370 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:57.371 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:36:57.371 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:36:57.371 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:57.371 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:57.371 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:57.371 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:57.371 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.3", 2024-09-17T01:36:57.371 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDZ2+hmHQhXFRAAj84g+IKqH6KMP7LjRtFvLw==", 2024-09-17T01:36:57.371 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:57.371 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:36:57.371 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:36:57.371 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:57.371 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:57.371 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:57.371 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:57.372 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.4", 2024-09-17T01:36:57.372 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDd2+hmaNcMNBAAx1GV/oFdfssMjFWFN5M0VQ==", 2024-09-17T01:36:57.372 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:57.372 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:36:57.372 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:36:57.372 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:57.372 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:57.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:57.372 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:57.372 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.5", 2024-09-17T01:36:57.372 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDh2+hm301NJhAAnSUH5AAvqhPwM7loH6frww==", 2024-09-17T01:36:57.372 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:57.372 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:36:57.372 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:36:57.372 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:57.373 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:57.373 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:57.373 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:57.373 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.6", 2024-09-17T01:36:57.373 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDk2+hm61WNNRAAbCvVvsUpB4fgt4ja60DRZA==", 2024-09-17T01:36:57.373 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:57.373 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:36:57.373 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:36:57.373 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:57.373 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:57.373 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:57.373 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:57.373 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.7", 2024-09-17T01:36:57.374 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDo2+hmesiLFhAA29n1eageNvP+lkRyh6gGMw==", 2024-09-17T01:36:57.374 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:57.374 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:36:57.374 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:36:57.374 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:57.374 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:57.374 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:57.374 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:57.374 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.0", 2024-09-17T01:36:57.374 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA==", 2024-09-17T01:36:57.374 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:57.374 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:36:57.374 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow r", 2024-09-17T01:36:57.375 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T01:36:57.375 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:57.375 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:57.375 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:57.375 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.1", 2024-09-17T01:36:57.375 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmZLygLhAABlauZgnidFWvfCCPuBLObg==", 2024-09-17T01:36:57.375 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:57.375 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:36:57.375 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:36:57.375 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:36:57.375 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:36:57.375 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:57.375 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:57.375 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:57.376 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.2", 2024-09-17T01:36:57.376 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hm8lnZIxAAN0a2CVMMtu/Nz50OG4a02A==", 2024-09-17T01:36:57.376 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:57.376 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:36:57.376 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:36:57.376 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:36:57.376 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:36:57.376 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:57.376 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:57.376 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:57.376 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.3", 2024-09-17T01:36:57.376 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmgXdAORAAM5Uy66I4nnTJ9Vhkn9JoBw==", 2024-09-17T01:36:57.376 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:57.377 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:36:57.377 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:36:57.377 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:36:57.377 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:36:57.377 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:57.377 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:57.377 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:57.377 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.admin", 2024-09-17T01:36:57.377 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDL2+hmvCreHBAA4CSAhosssViGqD93U+I7Iw==", 2024-09-17T01:36:57.377 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:57.377 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:36:57.377 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:36:57.377 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:36:57.377 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:57.378 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:57.378 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:57.378 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:57.378 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.x", 2024-09-17T01:36:57.378 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmYPnlEhAAIcQ11ktWZyMXYdbAONiLog==", 2024-09-17T01:36:57.378 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:57.378 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:36:57.378 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:36:57.378 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:57.378 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:57.378 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:36:57.378 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:57.378 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.y", 2024-09-17T01:36:57.378 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmpCZtBxAAp5tXMc6aEq1aOny2LJZAiA==", 2024-09-17T01:36:57.378 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:36:57.379 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:36:57.379 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:36:57.379 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:36:57.379 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:57.379 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:57.379 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-17T01:36:57.379 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:36:57.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.370+0000 7fe7ba800640 1 -- 172.21.15.42:0/3385753317 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe794078b90 msgr2=0x7fe79407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:57.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.370+0000 7fe7ba800640 1 --2- 172.21.15.42:0/3385753317 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe794078b90 0x7fe79407b0a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe7b415b8c0 tx=0x7fe7a0005f90 comp rx=0 tx=0).stop 2024-09-17T01:36:57.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.370+0000 7fe7ba800640 1 -- 172.21.15.42:0/3385753317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe7b40cfba0 msgr2=0x7fe7b41577c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:57.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.370+0000 7fe7ba800640 1 --2- 172.21.15.42:0/3385753317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe7b40cfba0 0x7fe7b41577c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8034040 tx=0x7fe7a80039e0 comp rx=0 tx=0).stop 2024-09-17T01:36:57.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.370+0000 7fe7ba800640 1 -- 172.21.15.42:0/3385753317 shutdown_connections 2024-09-17T01:36:57.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.370+0000 7fe7ba800640 1 --2- 172.21.15.42:0/3385753317 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe794078b90 0x7fe79407b0a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:57.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.370+0000 7fe7ba800640 1 --2- 172.21.15.42:0/3385753317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7b4162500 0x7fe7b41f8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:57.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.370+0000 7fe7ba800640 1 --2- 172.21.15.42:0/3385753317 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe7b40d0e10 0x7fe7b40b9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:57.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.370+0000 7fe7ba800640 1 --2- 172.21.15.42:0/3385753317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe7b40cfba0 0x7fe7b41577c0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:57.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.370+0000 7fe7ba800640 1 -- 172.21.15.42:0/3385753317 >> 172.21.15.42:0/3385753317 conn(0x7fe7b40b6140 msgr2=0x7fe7b4160040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:57.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.370+0000 7fe7ba800640 1 -- 172.21.15.42:0/3385753317 shutdown_connections 2024-09-17T01:36:57.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.371+0000 7fe7ba800640 1 -- 172.21.15.42:0/3385753317 wait complete. 2024-09-17T01:36:57.390 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T01:36:57.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.621+0000 7fb809e00640 1 -- 172.21.15.42:0/3194235536 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8040b4be0 msgr2=0x7fb80415d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:57.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.621+0000 7fb809e00640 1 --2- 172.21.15.42:0/3194235536 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8040b4be0 0x7fb80415d6b0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fb8040b4870 tx=0x7fb7f402a560 comp rx=0 tx=0).stop 2024-09-17T01:36:57.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.622+0000 7fb809e00640 1 -- 172.21.15.42:0/3194235536 shutdown_connections 2024-09-17T01:36:57.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.622+0000 7fb809e00640 1 --2- 172.21.15.42:0/3194235536 >> v2:172.21.15.43:3300/0 conn(0x7fb8040cf7c0 0x7fb80406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:57.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.622+0000 7fb809e00640 1 --2- 172.21.15.42:0/3194235536 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb80406d260 0x7fb804152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:57.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.622+0000 7fb809e00640 1 --2- 172.21.15.42:0/3194235536 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8040b4be0 0x7fb80415d6b0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:57.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.622+0000 7fb809e00640 1 -- 172.21.15.42:0/3194235536 >> 172.21.15.42:0/3194235536 conn(0x7fb8040b25f0 msgr2=0x7fb8040d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:57.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.622+0000 7fb809e00640 1 -- 172.21.15.42:0/3194235536 shutdown_connections 2024-09-17T01:36:57.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.622+0000 7fb809e00640 1 -- 172.21.15.42:0/3194235536 wait complete. 2024-09-17T01:36:57.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.624+0000 7fb809e00640 1 Processor -- start 2024-09-17T01:36:57.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.624+0000 7fb809e00640 1 -- start start 2024-09-17T01:36:57.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.625+0000 7fb809e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb80406d260 0x7fb8040b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:57.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.625+0000 7fb809e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8040b4be0 0x7fb8040b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:57.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.625+0000 7fb809e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8040cf7c0 0x7fb804146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:57.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.625+0000 7fb809e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb8041537a0 con 0x7fb8040b4be0 2024-09-17T01:36:57.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.625+0000 7fb809e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb804153620 con 0x7fb80406d260 2024-09-17T01:36:57.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.625+0000 7fb809e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb804153920 con 0x7fb8040cf7c0 2024-09-17T01:36:57.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.626+0000 7fb7fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8040b4be0 0x7fb8040b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:57.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.626+0000 7fb7fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8040b4be0 0x7fb8040b12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37862/0 (socket says 172.21.15.42:37862) 2024-09-17T01:36:57.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.626+0000 7fb7fbe00640 1 -- 172.21.15.42:0/2269605465 learned_addr learned my addr 172.21.15.42:0/2269605465 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:57.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.626+0000 7fb808a00640 1 --2- 172.21.15.42:0/2269605465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb80406d260 0x7fb8040b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:57.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.626+0000 7fb809400640 1 --2- 172.21.15.42:0/2269605465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8040cf7c0 0x7fb804146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:57.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.626+0000 7fb7fbe00640 1 -- 172.21.15.42:0/2269605465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8040cf7c0 msgr2=0x7fb804146cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:57.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.626+0000 7fb7fbe00640 1 --2- 172.21.15.42:0/2269605465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8040cf7c0 0x7fb804146cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:57.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.626+0000 7fb7fbe00640 1 -- 172.21.15.42:0/2269605465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb80406d260 msgr2=0x7fb8040b0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:57.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.626+0000 7fb7fbe00640 1 --2- 172.21.15.42:0/2269605465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb80406d260 0x7fb8040b0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:57.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.626+0000 7fb7fbe00640 1 -- 172.21.15.42:0/2269605465 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb804144900 con 0x7fb8040b4be0 2024-09-17T01:36:57.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.626+0000 7fb7fbe00640 1 --2- 172.21.15.42:0/2269605465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8040b4be0 0x7fb8040b12a0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00c970 tx=0x7fb7ec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:57.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.627+0000 7fb801600640 1 -- 172.21.15.42:0/2269605465 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec007bb0 con 0x7fb8040b4be0 2024-09-17T01:36:57.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.627+0000 7fb801600640 1 -- 172.21.15.42:0/2269605465 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7ec007e40 con 0x7fb8040b4be0 2024-09-17T01:36:57.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.627+0000 7fb801600640 1 -- 172.21.15.42:0/2269605465 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec00f690 con 0x7fb8040b4be0 2024-09-17T01:36:57.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.627+0000 7fb809e00640 1 -- 172.21.15.42:0/2269605465 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb804144be0 con 0x7fb8040b4be0 2024-09-17T01:36:57.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.627+0000 7fb809e00640 1 -- 172.21.15.42:0/2269605465 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8040720e0 con 0x7fb8040b4be0 2024-09-17T01:36:57.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.628+0000 7fb809e00640 1 -- 172.21.15.42:0/2269605465 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb80415d6b0 con 0x7fb8040b4be0 2024-09-17T01:36:57.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.629+0000 7fb801600640 1 -- 172.21.15.42:0/2269605465 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb7ec00f830 con 0x7fb8040b4be0 2024-09-17T01:36:57.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.630+0000 7fb801600640 1 --2- 172.21.15.42:0/2269605465 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb7e0078b90 0x7fb7e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:57.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.630+0000 7fb801600640 1 -- 172.21.15.42:0/2269605465 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 4857+0+0 (secure 0 0 0) 0x7fb7ec09b340 con 0x7fb8040b4be0 2024-09-17T01:36:57.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.631+0000 7fb808a00640 1 --2- 172.21.15.42:0/2269605465 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb7e0078b90 0x7fb7e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:57.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.631+0000 7fb808a00640 1 --2- 172.21.15.42:0/2269605465 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb7e0078b90 0x7fb7e007b0a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4033000 tx=0x7fb7f4004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:57.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.634+0000 7fb801600640 1 -- 172.21.15.42:0/2269605465 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb7ec014030 con 0x7fb8040b4be0 2024-09-17T01:36:57.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.832+0000 7fb809e00640 1 -- 172.21.15.42:0/2269605465 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb8040b3e30 con 0x7fb8040b4be0 2024-09-17T01:36:57.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.832+0000 7fb801600640 1 -- 172.21.15.42:0/2269605465 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) ==== 84+0+65 (secure 0 0 0) 0x7fb7ec063a30 con 0x7fb8040b4be0 2024-09-17T01:36:57.831 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:36:57.831 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-09-17T01:36:57.831 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:36:57.831 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-09-17T01:36:57.831 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-09-17T01:36:57.831 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:36:57.831 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-09-17T01:36:57.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.835+0000 7fb809e00640 1 -- 172.21.15.42:0/2269605465 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb7e0078b90 msgr2=0x7fb7e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:57.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.835+0000 7fb809e00640 1 --2- 172.21.15.42:0/2269605465 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb7e0078b90 0x7fb7e007b0a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4033000 tx=0x7fb7f4004730 comp rx=0 tx=0).stop 2024-09-17T01:36:57.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.835+0000 7fb809e00640 1 -- 172.21.15.42:0/2269605465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8040b4be0 msgr2=0x7fb8040b12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:57.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.835+0000 7fb809e00640 1 --2- 172.21.15.42:0/2269605465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8040b4be0 0x7fb8040b12a0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00c970 tx=0x7fb7ec00ce30 comp rx=0 tx=0).stop 2024-09-17T01:36:57.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.835+0000 7fb809e00640 1 -- 172.21.15.42:0/2269605465 shutdown_connections 2024-09-17T01:36:57.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.835+0000 7fb809e00640 1 --2- 172.21.15.42:0/2269605465 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb7e0078b90 0x7fb7e007b0a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:57.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.835+0000 7fb809e00640 1 --2- 172.21.15.42:0/2269605465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8040cf7c0 0x7fb804146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:57.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.835+0000 7fb809e00640 1 --2- 172.21.15.42:0/2269605465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8040b4be0 0x7fb8040b12a0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:57.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.835+0000 7fb809e00640 1 --2- 172.21.15.42:0/2269605465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb80406d260 0x7fb8040b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:57.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.835+0000 7fb809e00640 1 -- 172.21.15.42:0/2269605465 >> 172.21.15.42:0/2269605465 conn(0x7fb8040b25f0 msgr2=0x7fb804151860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:57.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.835+0000 7fb809e00640 1 -- 172.21.15.42:0/2269605465 shutdown_connections 2024-09-17T01:36:57.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:57.835+0000 7fb809e00640 1 -- 172.21.15.42:0/2269605465 wait complete. 2024-09-17T01:36:57.855 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T01:36:57.855 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T01:36:58.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.088+0000 7fc07ce00640 1 -- 172.21.15.42:0/2536497794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0780aebf0 msgr2=0x7fc07815d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:58.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.088+0000 7fc07ce00640 1 --2- 172.21.15.42:0/2536497794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0780aebf0 0x7fc07815d6a0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fc070005fd0 tx=0x7fc07002a8b0 comp rx=0 tx=0).stop 2024-09-17T01:36:58.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.088+0000 7fc07ce00640 1 -- 172.21.15.42:0/2536497794 shutdown_connections 2024-09-17T01:36:58.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.088+0000 7fc07ce00640 1 --2- 172.21.15.42:0/2536497794 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0780aebf0 0x7fc07815d6a0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:58.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.088+0000 7fc07ce00640 1 -- 172.21.15.42:0/2536497794 >> 172.21.15.42:0/2536497794 conn(0x7fc0780b25d0 msgr2=0x7fc0780d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:58.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.088+0000 7fc07ce00640 1 -- 172.21.15.42:0/2536497794 shutdown_connections 2024-09-17T01:36:58.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.088+0000 7fc07ce00640 1 -- 172.21.15.42:0/2536497794 wait complete. 2024-09-17T01:36:58.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.091+0000 7fc07ce00640 1 Processor -- start 2024-09-17T01:36:58.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.091+0000 7fc07ce00640 1 -- start start 2024-09-17T01:36:58.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.092+0000 7fc07ce00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc0780aebf0 0x7fc0780c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:58.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.092+0000 7fc07ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0780af4f0 0x7fc07814d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:58.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.092+0000 7fc07ce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc078073dd0 0x7fc0780741e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:58.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.092+0000 7fc07ce00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc0780b3b40 con 0x7fc0780af4f0 2024-09-17T01:36:58.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.092+0000 7fc07ce00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc0780b39c0 con 0x7fc078073dd0 2024-09-17T01:36:58.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.092+0000 7fc07ce00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc0780b3cc0 con 0x7fc0780aebf0 2024-09-17T01:36:58.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.093+0000 7fc06ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0780af4f0 0x7fc07814d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:58.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.093+0000 7fc06ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0780af4f0 0x7fc07814d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37880/0 (socket says 172.21.15.42:37880) 2024-09-17T01:36:58.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.093+0000 7fc06ea00640 1 -- 172.21.15.42:0/2944523016 learned_addr learned my addr 172.21.15.42:0/2944523016 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:58.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.093+0000 7fc077400640 1 --2- 172.21.15.42:0/2944523016 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc0780aebf0 0x7fc0780c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:58.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.093+0000 7fc077e00640 1 --2- 172.21.15.42:0/2944523016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc078073dd0 0x7fc0780741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:58.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.093+0000 7fc06ea00640 1 -- 172.21.15.42:0/2944523016 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc0780aebf0 msgr2=0x7fc0780c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:58.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.093+0000 7fc06ea00640 1 --2- 172.21.15.42:0/2944523016 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc0780aebf0 0x7fc0780c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:58.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.093+0000 7fc06ea00640 1 -- 172.21.15.42:0/2944523016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc078073dd0 msgr2=0x7fc0780741e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:58.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.093+0000 7fc06ea00640 1 --2- 172.21.15.42:0/2944523016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc078073dd0 0x7fc0780741e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:58.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.093+0000 7fc06ea00640 1 -- 172.21.15.42:0/2944523016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc078074720 con 0x7fc0780af4f0 2024-09-17T01:36:58.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.093+0000 7fc077400640 1 --2- 172.21.15.42:0/2944523016 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc0780aebf0 0x7fc0780c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:36:58.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.094+0000 7fc06ea00640 1 --2- 172.21.15.42:0/2944523016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0780af4f0 0x7fc07814d4b0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc06000c3c0 tx=0x7fc06000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:58.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.094+0000 7fc06fe00640 1 -- 172.21.15.42:0/2944523016 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060017070 con 0x7fc0780af4f0 2024-09-17T01:36:58.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.094+0000 7fc06fe00640 1 -- 172.21.15.42:0/2944523016 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0600035f0 con 0x7fc0780af4f0 2024-09-17T01:36:58.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.094+0000 7fc06fe00640 1 -- 172.21.15.42:0/2944523016 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060003a40 con 0x7fc0780af4f0 2024-09-17T01:36:58.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.094+0000 7fc07ce00640 1 -- 172.21.15.42:0/2944523016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc07814de90 con 0x7fc0780af4f0 2024-09-17T01:36:58.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.094+0000 7fc07ce00640 1 -- 172.21.15.42:0/2944523016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc07814e450 con 0x7fc0780af4f0 2024-09-17T01:36:58.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.095+0000 7fc07ce00640 1 -- 172.21.15.42:0/2944523016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0780c98d0 con 0x7fc0780af4f0 2024-09-17T01:36:58.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.096+0000 7fc06fe00640 1 -- 172.21.15.42:0/2944523016 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc06001a070 con 0x7fc0780af4f0 2024-09-17T01:36:58.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.097+0000 7fc06fe00640 1 --2- 172.21.15.42:0/2944523016 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc054078bc0 0x7fc05407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:58.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.097+0000 7fc06fe00640 1 -- 172.21.15.42:0/2944523016 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 4857+0+0 (secure 0 0 0) 0x7fc060099c90 con 0x7fc0780af4f0 2024-09-17T01:36:58.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.098+0000 7fc077400640 1 --2- 172.21.15.42:0/2944523016 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc054078bc0 0x7fc05407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:58.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.099+0000 7fc077400640 1 --2- 172.21.15.42:0/2944523016 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc054078bc0 0x7fc05407b0d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc068006fd0 tx=0x7fc068008040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:58.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.102+0000 7fc06fe00640 1 -- 172.21.15.42:0/2944523016 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc078074720 con 0x7fc0780af4f0 2024-09-17T01:36:58.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.294+0000 7fc07ce00640 1 -- 172.21.15.42:0/2944523016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc078151d80 con 0x7fc0780af4f0 2024-09-17T01:36:58.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.840+0000 7fc06fe00640 1 -- 172.21.15.42:0/2944523016 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v75) ==== 138+0+0 (secure 0 0 0) 0x7fc060061d30 con 0x7fc0780af4f0 2024-09-17T01:36:58.840 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-09-17T01:36:58.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.843+0000 7fc07ce00640 1 -- 172.21.15.42:0/2944523016 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc054078bc0 msgr2=0x7fc05407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:58.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.843+0000 7fc07ce00640 1 --2- 172.21.15.42:0/2944523016 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc054078bc0 0x7fc05407b0d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc068006fd0 tx=0x7fc068008040 comp rx=0 tx=0).stop 2024-09-17T01:36:58.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.843+0000 7fc07ce00640 1 -- 172.21.15.42:0/2944523016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0780af4f0 msgr2=0x7fc07814d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:58.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.843+0000 7fc07ce00640 1 --2- 172.21.15.42:0/2944523016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0780af4f0 0x7fc07814d4b0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc06000c3c0 tx=0x7fc06000c880 comp rx=0 tx=0).stop 2024-09-17T01:36:58.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.844+0000 7fc07ce00640 1 -- 172.21.15.42:0/2944523016 shutdown_connections 2024-09-17T01:36:58.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.844+0000 7fc07ce00640 1 --2- 172.21.15.42:0/2944523016 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc054078bc0 0x7fc05407b0d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:58.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.844+0000 7fc07ce00640 1 --2- 172.21.15.42:0/2944523016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc078073dd0 0x7fc0780741e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:58.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.844+0000 7fc07ce00640 1 --2- 172.21.15.42:0/2944523016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0780af4f0 0x7fc07814d4b0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:58.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.844+0000 7fc07ce00640 1 --2- 172.21.15.42:0/2944523016 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc0780aebf0 0x7fc0780c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:58.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.844+0000 7fc07ce00640 1 -- 172.21.15.42:0/2944523016 >> 172.21.15.42:0/2944523016 conn(0x7fc0780b25d0 msgr2=0x7fc0780b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:58.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.844+0000 7fc07ce00640 1 -- 172.21.15.42:0/2944523016 shutdown_connections 2024-09-17T01:36:58.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:58.844+0000 7fc07ce00640 1 -- 172.21.15.42:0/2944523016 wait complete. 2024-09-17T01:36:58.872 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T01:36:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.111+0000 7ff3e9600640 1 -- 172.21.15.42:0/1070525644 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff3e4142f40 msgr2=0x7ff3e4072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.111+0000 7ff3e9600640 1 --2- 172.21.15.42:0/1070525644 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff3e4142f40 0x7ff3e4072950 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4071ef0 tx=0x7ff3cc02a580 comp rx=0 tx=0).stop 2024-09-17T01:36:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.111+0000 7ff3e9600640 1 -- 172.21.15.42:0/1070525644 shutdown_connections 2024-09-17T01:36:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.111+0000 7ff3e9600640 1 --2- 172.21.15.42:0/1070525644 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff3e4142f40 0x7ff3e4072950 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.111+0000 7ff3e9600640 1 --2- 172.21.15.42:0/1070525644 >> v2:172.21.15.43:3300/0 conn(0x7ff3e40b3550 0x7ff3e415cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.111+0000 7ff3e9600640 1 -- 172.21.15.42:0/1070525644 >> 172.21.15.42:0/1070525644 conn(0x7ff3e40b2930 msgr2=0x7ff3e406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.111+0000 7ff3e9600640 1 -- 172.21.15.42:0/1070525644 shutdown_connections 2024-09-17T01:36:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.111+0000 7ff3e9600640 1 -- 172.21.15.42:0/1070525644 wait complete. 2024-09-17T01:36:59.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.113+0000 7ff3e9600640 1 Processor -- start 2024-09-17T01:36:59.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.113+0000 7ff3e9600640 1 -- start start 2024-09-17T01:36:59.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.115+0000 7ff3e9600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3e4072e90 0x7ff3e40ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:59.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.115+0000 7ff3e9600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff3e40b3550 0x7ff3e40aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:59.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.115+0000 7ff3e9600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff3e4142f40 0x7ff3e41f90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:59.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.115+0000 7ff3e9600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e406d5b0 con 0x7ff3e40b3550 2024-09-17T01:36:59.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.115+0000 7ff3e9600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e406d430 con 0x7ff3e4072e90 2024-09-17T01:36:59.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.115+0000 7ff3e9600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff3e406d730 con 0x7ff3e4142f40 2024-09-17T01:36:59.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.115+0000 7ff3dbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff3e40b3550 0x7ff3e40aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:59.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.115+0000 7ff3dbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff3e40b3550 0x7ff3e40aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37900/0 (socket says 172.21.15.42:37900) 2024-09-17T01:36:59.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.115+0000 7ff3dbe00640 1 -- 172.21.15.42:0/2903865063 learned_addr learned my addr 172.21.15.42:0/2903865063 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:36:59.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.115+0000 7ff3e2a00640 1 --2- 172.21.15.42:0/2903865063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3e4072e90 0x7ff3e40ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:59.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.115+0000 7ff3e3400640 1 --2- 172.21.15.42:0/2903865063 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff3e4142f40 0x7ff3e41f90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:59.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.115+0000 7ff3dbe00640 1 -- 172.21.15.42:0/2903865063 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff3e4142f40 msgr2=0x7ff3e41f90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:59.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.115+0000 7ff3dbe00640 1 --2- 172.21.15.42:0/2903865063 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff3e4142f40 0x7ff3e41f90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:59.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.115+0000 7ff3dbe00640 1 -- 172.21.15.42:0/2903865063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3e4072e90 msgr2=0x7ff3e40ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:59.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.115+0000 7ff3dbe00640 1 --2- 172.21.15.42:0/2903865063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3e4072e90 0x7ff3e40ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:59.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.115+0000 7ff3dbe00640 1 -- 172.21.15.42:0/2903865063 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e41f5870 con 0x7ff3e40b3550 2024-09-17T01:36:59.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.115+0000 7ff3e3400640 1 --2- 172.21.15.42:0/2903865063 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff3e4142f40 0x7ff3e41f90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:36:59.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.116+0000 7ff3dbe00640 1 --2- 172.21.15.42:0/2903865063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff3e40b3550 0x7ff3e40aede0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc034040 tx=0x7ff3cc003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:59.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.116+0000 7ff3daa00640 1 -- 172.21.15.42:0/2903865063 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc03e030 con 0x7ff3e40b3550 2024-09-17T01:36:59.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.116+0000 7ff3e9600640 1 -- 172.21.15.42:0/2903865063 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e41f5d00 con 0x7ff3e40b3550 2024-09-17T01:36:59.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.116+0000 7ff3daa00640 1 -- 172.21.15.42:0/2903865063 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3cc003e00 con 0x7ff3e40b3550 2024-09-17T01:36:59.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.116+0000 7ff3daa00640 1 -- 172.21.15.42:0/2903865063 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc035040 con 0x7ff3e40b3550 2024-09-17T01:36:59.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.116+0000 7ff3e9600640 1 -- 172.21.15.42:0/2903865063 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e41f62c0 con 0x7ff3e40b3550 2024-09-17T01:36:59.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.117+0000 7ff3e9600640 1 -- 172.21.15.42:0/2903865063 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3e40cf930 con 0x7ff3e40b3550 2024-09-17T01:36:59.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.119+0000 7ff3daa00640 1 -- 172.21.15.42:0/2903865063 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff3cc041030 con 0x7ff3e40b3550 2024-09-17T01:36:59.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.119+0000 7ff3daa00640 1 --2- 172.21.15.42:0/2903865063 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff3c0078b90 0x7ff3c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:59.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.120+0000 7ff3daa00640 1 -- 172.21.15.42:0/2903865063 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5227+0+0 (secure 0 0 0) 0x7ff3cc0bb410 con 0x7ff3e40b3550 2024-09-17T01:36:59.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.120+0000 7ff3e2a00640 1 --2- 172.21.15.42:0/2903865063 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff3c0078b90 0x7ff3c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:59.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.121+0000 7ff3e2a00640 1 --2- 172.21.15.42:0/2903865063 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff3c0078b90 0x7ff3c007b0a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400bb50 tx=0x7ff3d400b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:59.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.124+0000 7ff3daa00640 1 -- 172.21.15.42:0/2903865063 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff3cc083350 con 0x7ff3e40b3550 2024-09-17T01:36:59.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.323+0000 7ff3e9600640 1 -- 172.21.15.42:0/2903865063 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff3e406dbe0 con 0x7ff3e40b3550 2024-09-17T01:36:59.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.847+0000 7ff3daa00640 1 -- 172.21.15.42:0/2903865063 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v76) ==== 170+0+0 (secure 0 0 0) 0x7ff3cc087d80 con 0x7ff3e40b3550 2024-09-17T01:36:59.846 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-09-17T01:36:59.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.851+0000 7ff3e9600640 1 -- 172.21.15.42:0/2903865063 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff3c0078b90 msgr2=0x7ff3c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:59.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.851+0000 7ff3e9600640 1 --2- 172.21.15.42:0/2903865063 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff3c0078b90 0x7ff3c007b0a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400bb50 tx=0x7ff3d400b2e0 comp rx=0 tx=0).stop 2024-09-17T01:36:59.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.851+0000 7ff3e9600640 1 -- 172.21.15.42:0/2903865063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff3e40b3550 msgr2=0x7ff3e40aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:59.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.851+0000 7ff3e9600640 1 --2- 172.21.15.42:0/2903865063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff3e40b3550 0x7ff3e40aede0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc034040 tx=0x7ff3cc003910 comp rx=0 tx=0).stop 2024-09-17T01:36:59.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.851+0000 7ff3e9600640 1 -- 172.21.15.42:0/2903865063 shutdown_connections 2024-09-17T01:36:59.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.851+0000 7ff3e9600640 1 --2- 172.21.15.42:0/2903865063 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff3c0078b90 0x7ff3c007b0a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:59.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.851+0000 7ff3e9600640 1 --2- 172.21.15.42:0/2903865063 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff3e4142f40 0x7ff3e41f90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:59.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.851+0000 7ff3e9600640 1 --2- 172.21.15.42:0/2903865063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff3e40b3550 0x7ff3e40aede0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:59.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.851+0000 7ff3e9600640 1 --2- 172.21.15.42:0/2903865063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff3e4072e90 0x7ff3e40ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:59.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.851+0000 7ff3e9600640 1 -- 172.21.15.42:0/2903865063 >> 172.21.15.42:0/2903865063 conn(0x7ff3e40b2930 msgr2=0x7ff3e415e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:59.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.851+0000 7ff3e9600640 1 -- 172.21.15.42:0/2903865063 shutdown_connections 2024-09-17T01:36:59.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:36:59.851+0000 7ff3e9600640 1 -- 172.21.15.42:0/2903865063 wait complete. 2024-09-17T01:36:59.889 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T01:37:00.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.125+0000 7fc43f400640 1 -- 172.21.15.42:0/1329098808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc438142f40 msgr2=0x7fc438072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:00.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.125+0000 7fc43f400640 1 --2- 172.21.15.42:0/1329098808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc438142f40 0x7fc438072950 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fc438071ef0 tx=0x7fc42402a560 comp rx=0 tx=0).stop 2024-09-17T01:37:00.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.125+0000 7fc43f400640 1 -- 172.21.15.42:0/1329098808 shutdown_connections 2024-09-17T01:37:00.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.125+0000 7fc43f400640 1 --2- 172.21.15.42:0/1329098808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc438142f40 0x7fc438072950 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:00.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.125+0000 7fc43f400640 1 --2- 172.21.15.42:0/1329098808 >> v2:172.21.15.43:3300/0 conn(0x7fc4380b3550 0x7fc43815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:00.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.125+0000 7fc43f400640 1 -- 172.21.15.42:0/1329098808 >> 172.21.15.42:0/1329098808 conn(0x7fc4380b2930 msgr2=0x7fc43806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:00.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.125+0000 7fc43f400640 1 -- 172.21.15.42:0/1329098808 shutdown_connections 2024-09-17T01:37:00.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.125+0000 7fc43f400640 1 -- 172.21.15.42:0/1329098808 wait complete. 2024-09-17T01:37:00.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.128+0000 7fc43f400640 1 Processor -- start 2024-09-17T01:37:00.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.128+0000 7fc43f400640 1 -- start start 2024-09-17T01:37:00.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.129+0000 7fc43f400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc438072e90 0x7fc438156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:00.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.129+0000 7fc43f400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4380b3550 0x7fc438140160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:00.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.129+0000 7fc43f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc438142f40 0x7fc43815aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:00.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.129+0000 7fc43f400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc43806d5b0 con 0x7fc438142f40 2024-09-17T01:37:00.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.129+0000 7fc43f400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc43806d430 con 0x7fc4380b3550 2024-09-17T01:37:00.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.129+0000 7fc43f400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc43806d730 con 0x7fc438072e90 2024-09-17T01:37:00.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.130+0000 7fc43d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc438142f40 0x7fc43815aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:00.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.130+0000 7fc43d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc438142f40 0x7fc43815aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37908/0 (socket says 172.21.15.42:37908) 2024-09-17T01:37:00.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.130+0000 7fc43d400640 1 -- 172.21.15.42:0/3680346253 learned_addr learned my addr 172.21.15.42:0/3680346253 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:00.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.130+0000 7fc437e00640 1 --2- 172.21.15.42:0/3680346253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4380b3550 0x7fc438140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:00.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.130+0000 7fc43ca00640 1 --2- 172.21.15.42:0/3680346253 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc438072e90 0x7fc438156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:00.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.130+0000 7fc43d400640 1 -- 172.21.15.42:0/3680346253 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc438072e90 msgr2=0x7fc438156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:00.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.130+0000 7fc43d400640 1 --2- 172.21.15.42:0/3680346253 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc438072e90 0x7fc438156dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:00.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.130+0000 7fc43d400640 1 -- 172.21.15.42:0/3680346253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4380b3550 msgr2=0x7fc438140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:00.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.130+0000 7fc43d400640 1 --2- 172.21.15.42:0/3680346253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4380b3550 0x7fc438140160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:00.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.130+0000 7fc43d400640 1 -- 172.21.15.42:0/3680346253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4381f8e80 con 0x7fc438142f40 2024-09-17T01:37:00.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.130+0000 7fc437e00640 1 --2- 172.21.15.42:0/3680346253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4380b3550 0x7fc438140160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:00.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.130+0000 7fc43d400640 1 --2- 172.21.15.42:0/3680346253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc438142f40 0x7fc43815aae0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fc43000c6c0 tx=0x7fc43000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:00.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.131+0000 7fc434c00640 1 -- 172.21.15.42:0/3680346253 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc430017070 con 0x7fc438142f40 2024-09-17T01:37:00.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.131+0000 7fc43f400640 1 -- 172.21.15.42:0/3680346253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4381f9380 con 0x7fc438142f40 2024-09-17T01:37:00.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.131+0000 7fc434c00640 1 -- 172.21.15.42:0/3680346253 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc430003c60 con 0x7fc438142f40 2024-09-17T01:37:00.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.131+0000 7fc434c00640 1 -- 172.21.15.42:0/3680346253 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4300052d0 con 0x7fc438142f40 2024-09-17T01:37:00.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.131+0000 7fc43f400640 1 -- 172.21.15.42:0/3680346253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4381f9940 con 0x7fc438142f40 2024-09-17T01:37:00.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.132+0000 7fc43f400640 1 -- 172.21.15.42:0/3680346253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4380b44e0 con 0x7fc438142f40 2024-09-17T01:37:00.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.133+0000 7fc434c00640 1 -- 172.21.15.42:0/3680346253 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc43001a070 con 0x7fc438142f40 2024-09-17T01:37:00.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.135+0000 7fc434c00640 1 --2- 172.21.15.42:0/3680346253 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc418078b90 0x7fc41807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:00.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.135+0000 7fc434c00640 1 -- 172.21.15.42:0/3680346253 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5609+0+0 (secure 0 0 0) 0x7fc43009a800 con 0x7fc438142f40 2024-09-17T01:37:00.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.136+0000 7fc43ca00640 1 --2- 172.21.15.42:0/3680346253 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc418078b90 0x7fc41807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:00.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.137+0000 7fc43ca00640 1 --2- 172.21.15.42:0/3680346253 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc418078b90 0x7fc41807b0a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc42c005fd0 tx=0x7fc42c005850 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:00.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.139+0000 7fc434c00640 1 -- 172.21.15.42:0/3680346253 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc4380b44e0 con 0x7fc438142f40 2024-09-17T01:37:00.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.370+0000 7fc43f400640 1 -- 172.21.15.42:0/3680346253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc43806dbe0 con 0x7fc438142f40 2024-09-17T01:37:00.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.850+0000 7fc434c00640 1 -- 172.21.15.42:0/3680346253 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v52) ==== 174+0+0 (secure 0 0 0) 0x7fc430021020 con 0x7fc438142f40 2024-09-17T01:37:00.848 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 10 and data pool 11 2024-09-17T01:37:00.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.854+0000 7fc43f400640 1 -- 172.21.15.42:0/3680346253 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc418078b90 msgr2=0x7fc41807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:00.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.854+0000 7fc43f400640 1 --2- 172.21.15.42:0/3680346253 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc418078b90 0x7fc41807b0a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc42c005fd0 tx=0x7fc42c005850 comp rx=0 tx=0).stop 2024-09-17T01:37:00.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.855+0000 7fc43f400640 1 -- 172.21.15.42:0/3680346253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc438142f40 msgr2=0x7fc43815aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:00.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.855+0000 7fc43f400640 1 --2- 172.21.15.42:0/3680346253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc438142f40 0x7fc43815aae0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fc43000c6c0 tx=0x7fc43000cb80 comp rx=0 tx=0).stop 2024-09-17T01:37:00.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.857+0000 7fc43f400640 1 -- 172.21.15.42:0/3680346253 shutdown_connections 2024-09-17T01:37:00.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.857+0000 7fc43f400640 1 --2- 172.21.15.42:0/3680346253 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc418078b90 0x7fc41807b0a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:00.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.857+0000 7fc43f400640 1 --2- 172.21.15.42:0/3680346253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4380b3550 0x7fc438140160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:00.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.857+0000 7fc43f400640 1 --2- 172.21.15.42:0/3680346253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc438142f40 0x7fc43815aae0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:00.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.857+0000 7fc43f400640 1 --2- 172.21.15.42:0/3680346253 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc438072e90 0x7fc438156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:00.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.857+0000 7fc43f400640 1 -- 172.21.15.42:0/3680346253 >> 172.21.15.42:0/3680346253 conn(0x7fc4380b2930 msgr2=0x7fc43815a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:00.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.858+0000 7fc43f400640 1 -- 172.21.15.42:0/3680346253 shutdown_connections 2024-09-17T01:37:00.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:00.858+0000 7fc43f400640 1 -- 172.21.15.42:0/3680346253 wait complete. 2024-09-17T01:37:00.908 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:37:01.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.138+0000 7f688a200640 1 -- 172.21.15.42:0/1680349581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f686c004800 msgr2=0x7f686c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:01.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.138+0000 7f688a200640 1 --2- 172.21.15.42:0/1680349581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f686c004800 0x7f686c004c10 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f687000c290 tx=0x7f686c005830 comp rx=0 tx=0).stop 2024-09-17T01:37:01.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.138+0000 7f6889800640 1 -- 172.21.15.42:0/1680349581 reap_dead start 2024-09-17T01:37:01.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.138+0000 7f688a200640 1 -- 172.21.15.42:0/1680349581 shutdown_connections 2024-09-17T01:37:01.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.138+0000 7f688a200640 1 -- 172.21.15.42:0/1680349581 >> 172.21.15.42:0/1680349581 conn(0x7f68840cd4c0 msgr2=0x7f68840cd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:01.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.138+0000 7f688a200640 1 -- 172.21.15.42:0/1680349581 shutdown_connections 2024-09-17T01:37:01.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.138+0000 7f688a200640 1 -- 172.21.15.42:0/1680349581 wait complete. 2024-09-17T01:37:01.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.140+0000 7f688a200640 1 Processor -- start 2024-09-17T01:37:01.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.140+0000 7f688a200640 1 -- start start 2024-09-17T01:37:01.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.142+0000 7f688a200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f686c004800 0x7f68841565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:01.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.142+0000 7f688a200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68841423f0 0x7f68841f8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:01.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.142+0000 7f688a200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f68841f8f50 0x7f68841e2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:01.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.142+0000 7f688a200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6884152ca0 con 0x7f68841423f0 2024-09-17T01:37:01.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.142+0000 7f688a200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6884152e20 con 0x7f686c004800 2024-09-17T01:37:01.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.142+0000 7f688a200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6884152fa0 con 0x7f68841f8f50 2024-09-17T01:37:01.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.142+0000 7f6883e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68841423f0 0x7f68841f8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:01.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.142+0000 7f6883e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68841423f0 0x7f68841f8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37934/0 (socket says 172.21.15.42:37934) 2024-09-17T01:37:01.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.142+0000 7f6883e00640 1 -- 172.21.15.42:0/2090187881 learned_addr learned my addr 172.21.15.42:0/2090187881 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:01.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.142+0000 7f6888e00640 1 --2- 172.21.15.42:0/2090187881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f686c004800 0x7f68841565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:01.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.142+0000 7f6889800640 1 --2- 172.21.15.42:0/2090187881 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f68841f8f50 0x7f68841e2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:01.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.142+0000 7f6883e00640 1 -- 172.21.15.42:0/2090187881 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f68841f8f50 msgr2=0x7f68841e2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:01.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.142+0000 7f6883e00640 1 --2- 172.21.15.42:0/2090187881 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f68841f8f50 0x7f68841e2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:01.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.142+0000 7f6883e00640 1 -- 172.21.15.42:0/2090187881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f686c004800 msgr2=0x7f68841565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:01.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.142+0000 7f6883e00640 1 --2- 172.21.15.42:0/2090187881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f686c004800 0x7f68841565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:01.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.142+0000 7f6883e00640 1 -- 172.21.15.42:0/2090187881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68841556e0 con 0x7f68841423f0 2024-09-17T01:37:01.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.143+0000 7f6883e00640 1 --2- 172.21.15.42:0/2090187881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68841423f0 0x7f68841f8a10 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f687000c3b0 tx=0x7f6870001d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:01.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.143+0000 7f6880c00640 1 -- 172.21.15.42:0/2090187881 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870031040 con 0x7f68841423f0 2024-09-17T01:37:01.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.143+0000 7f6880c00640 1 -- 172.21.15.42:0/2090187881 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68700035f0 con 0x7f68841423f0 2024-09-17T01:37:01.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.143+0000 7f688a200640 1 -- 172.21.15.42:0/2090187881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68841559c0 con 0x7f68841423f0 2024-09-17T01:37:01.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.143+0000 7f6880c00640 1 -- 172.21.15.42:0/2090187881 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870003a40 con 0x7f68841423f0 2024-09-17T01:37:01.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.143+0000 7f688a200640 1 -- 172.21.15.42:0/2090187881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68841e3de0 con 0x7f68841423f0 2024-09-17T01:37:01.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.144+0000 7f688a200640 1 -- 172.21.15.42:0/2090187881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68841f97b0 con 0x7f68841423f0 2024-09-17T01:37:01.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.146+0000 7f6880c00640 1 -- 172.21.15.42:0/2090187881 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6870034070 con 0x7f68841423f0 2024-09-17T01:37:01.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.147+0000 7f6880c00640 1 --2- 172.21.15.42:0/2090187881 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6864078b90 0x7f686407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:01.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.147+0000 7f6880c00640 1 -- 172.21.15.42:0/2090187881 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5709+0+0 (secure 0 0 0) 0x7f68700bb1d0 con 0x7f68841423f0 2024-09-17T01:37:01.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.148+0000 7f6888e00640 1 --2- 172.21.15.42:0/2090187881 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6864078b90 0x7f686407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:01.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.148+0000 7f6888e00640 1 --2- 172.21.15.42:0/2090187881 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6864078b90 0x7f686407b0a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6878009c50 tx=0x7f6878005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:01.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.150+0000 7f6880c00640 1 -- 172.21.15.42:0/2090187881 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f68700835f0 con 0x7f68841423f0 2024-09-17T01:37:01.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.346+0000 7f688a200640 1 -- 172.21.15.42:0/2090187881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f688415cb80 con 0x7f68841423f0 2024-09-17T01:37:01.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.347+0000 7f6880c00640 1 -- 172.21.15.42:0/2090187881 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+16633 (secure 0 0 0) 0x7f6870082ef0 con 0x7f68841423f0 2024-09-17T01:37:01.345 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:01.345 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":77,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:37:00.371875+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:36:58.306928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T01:36:59.336540+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:37:01.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.349+0000 7f688a200640 1 -- 172.21.15.42:0/2090187881 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6864078b90 msgr2=0x7f686407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:01.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.349+0000 7f688a200640 1 --2- 172.21.15.42:0/2090187881 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6864078b90 0x7f686407b0a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6878009c50 tx=0x7f6878005f90 comp rx=0 tx=0).stop 2024-09-17T01:37:01.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.349+0000 7f688a200640 1 -- 172.21.15.42:0/2090187881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68841423f0 msgr2=0x7f68841f8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:01.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.349+0000 7f688a200640 1 --2- 172.21.15.42:0/2090187881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68841423f0 0x7f68841f8a10 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f687000c3b0 tx=0x7f6870001d20 comp rx=0 tx=0).stop 2024-09-17T01:37:01.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.349+0000 7f688a200640 1 -- 172.21.15.42:0/2090187881 shutdown_connections 2024-09-17T01:37:01.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.349+0000 7f688a200640 1 --2- 172.21.15.42:0/2090187881 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6864078b90 0x7f686407b0a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:01.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.349+0000 7f688a200640 1 --2- 172.21.15.42:0/2090187881 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f68841f8f50 0x7f68841e2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:01.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.349+0000 7f688a200640 1 --2- 172.21.15.42:0/2090187881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68841423f0 0x7f68841f8a10 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:01.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.349+0000 7f688a200640 1 --2- 172.21.15.42:0/2090187881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f686c004800 0x7f68841565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:01.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.349+0000 7f688a200640 1 -- 172.21.15.42:0/2090187881 >> 172.21.15.42:0/2090187881 conn(0x7f68840cd4c0 msgr2=0x7f6884074470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:01.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.349+0000 7f688a200640 1 -- 172.21.15.42:0/2090187881 shutdown_connections 2024-09-17T01:37:01.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.350+0000 7f688a200640 1 -- 172.21.15.42:0/2090187881 wait complete. 2024-09-17T01:37:01.373 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:37:01.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.602+0000 7f56a3200640 1 -- 172.21.15.42:0/3794393747 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56a4069450 msgr2=0x7f56a4074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:01.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.602+0000 7f56a3200640 1 --2- 172.21.15.42:0/3794393747 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56a4069450 0x7f56a4074a00 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f56a40738b0 tx=0x7f569c02a8b0 comp rx=0 tx=0).stop 2024-09-17T01:37:01.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.602+0000 7f56a3200640 1 -- 172.21.15.42:0/3794393747 shutdown_connections 2024-09-17T01:37:01.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.602+0000 7f56a3200640 1 --2- 172.21.15.42:0/3794393747 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56a4069450 0x7f56a4074a00 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:01.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.602+0000 7f56a3200640 1 --2- 172.21.15.42:0/3794393747 >> v2:172.21.15.43:3300/0 conn(0x7f56a415a2a0 0x7f56a415d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:01.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.602+0000 7f56a3200640 1 -- 172.21.15.42:0/3794393747 >> 172.21.15.42:0/3794393747 conn(0x7f56a40734a0 msgr2=0x7f56a40b61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:01.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.602+0000 7f56a3200640 1 -- 172.21.15.42:0/3794393747 shutdown_connections 2024-09-17T01:37:01.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.602+0000 7f56a3200640 1 -- 172.21.15.42:0/3794393747 wait complete. 2024-09-17T01:37:01.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.604+0000 7f56a3200640 1 Processor -- start 2024-09-17T01:37:01.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.605+0000 7f56a3200640 1 -- start start 2024-09-17T01:37:01.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.606+0000 7f56a3200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f56a40b14a0 0x7f56a4151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:01.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.606+0000 7f56a3200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56a415a2a0 0x7f56a4151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:01.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.606+0000 7f56a3200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56a40afb20 0x7f56a40ae460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:01.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.606+0000 7f56a3200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f56a40b1ac0 con 0x7f56a415a2a0 2024-09-17T01:37:01.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.606+0000 7f56a3200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f56a4069bd0 con 0x7f56a40afb20 2024-09-17T01:37:01.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.606+0000 7f56a3200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f56a4074f40 con 0x7f56a40b14a0 2024-09-17T01:37:01.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.607+0000 7f569be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56a415a2a0 0x7f56a4151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:01.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.607+0000 7f569be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56a415a2a0 0x7f56a4151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37960/0 (socket says 172.21.15.42:37960) 2024-09-17T01:37:01.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.607+0000 7f569be00640 1 -- 172.21.15.42:0/670000451 learned_addr learned my addr 172.21.15.42:0/670000451 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:01.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.607+0000 7f56a2800640 1 --2- 172.21.15.42:0/670000451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56a40afb20 0x7f56a40ae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:01.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.607+0000 7f56a1e00640 1 --2- 172.21.15.42:0/670000451 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f56a40b14a0 0x7f56a4151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:01.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.607+0000 7f569be00640 1 -- 172.21.15.42:0/670000451 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f56a40b14a0 msgr2=0x7f56a4151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:01.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.607+0000 7f569be00640 1 --2- 172.21.15.42:0/670000451 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f56a40b14a0 0x7f56a4151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:01.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.607+0000 7f569be00640 1 -- 172.21.15.42:0/670000451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56a40afb20 msgr2=0x7f56a40ae460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:01.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.607+0000 7f569be00640 1 --2- 172.21.15.42:0/670000451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56a40afb20 0x7f56a40ae460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:01.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.607+0000 7f569be00640 1 -- 172.21.15.42:0/670000451 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a41f8bb0 con 0x7f56a415a2a0 2024-09-17T01:37:01.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.607+0000 7f569be00640 1 --2- 172.21.15.42:0/670000451 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56a415a2a0 0x7f56a4151c50 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f568c00c390 tx=0x7f568c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:01.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.608+0000 7f569a000640 1 -- 172.21.15.42:0/670000451 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c017070 con 0x7f56a415a2a0 2024-09-17T01:37:01.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.608+0000 7f569a000640 1 -- 172.21.15.42:0/670000451 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f568c0035f0 con 0x7f56a415a2a0 2024-09-17T01:37:01.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.608+0000 7f569a000640 1 -- 172.21.15.42:0/670000451 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c003a20 con 0x7f56a415a2a0 2024-09-17T01:37:01.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.608+0000 7f56a3200640 1 -- 172.21.15.42:0/670000451 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56a41f8e90 con 0x7f56a415a2a0 2024-09-17T01:37:01.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.608+0000 7f56a3200640 1 -- 172.21.15.42:0/670000451 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56a41f9450 con 0x7f56a415a2a0 2024-09-17T01:37:01.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.609+0000 7f56a3200640 1 -- 172.21.15.42:0/670000451 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56a40754a0 con 0x7f56a415a2a0 2024-09-17T01:37:01.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.610+0000 7f569a000640 1 -- 172.21.15.42:0/670000451 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f568c01a070 con 0x7f56a415a2a0 2024-09-17T01:37:01.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.611+0000 7f569a000640 1 --2- 172.21.15.42:0/670000451 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5680078b90 0x7f568007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:01.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.611+0000 7f569a000640 1 -- 172.21.15.42:0/670000451 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5709+0+0 (secure 0 0 0) 0x7f568c099f90 con 0x7f56a415a2a0 2024-09-17T01:37:01.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.611+0000 7f56a1e00640 1 --2- 172.21.15.42:0/670000451 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5680078b90 0x7f568007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:01.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.612+0000 7f56a1e00640 1 --2- 172.21.15.42:0/670000451 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5680078b90 0x7f568007b0a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f569400bb50 tx=0x7f569400b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:01.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.615+0000 7f569a000640 1 -- 172.21.15.42:0/670000451 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f56a415dc60 con 0x7f56a415a2a0 2024-09-17T01:37:01.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.810+0000 7f56a3200640 1 -- 172.21.15.42:0/670000451 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f56a406cdb0 con 0x7f56a415a2a0 2024-09-17T01:37:01.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.811+0000 7f569a000640 1 -- 172.21.15.42:0/670000451 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+16633 (secure 0 0 0) 0x7f568c061d70 con 0x7f56a415a2a0 2024-09-17T01:37:01.809 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:01.810 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":77,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:37:00.371875+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:36:58.306928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T01:36:59.336540+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:37:01.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.814+0000 7f56a3200640 1 -- 172.21.15.42:0/670000451 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5680078b90 msgr2=0x7f568007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:01.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.814+0000 7f56a3200640 1 --2- 172.21.15.42:0/670000451 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5680078b90 0x7f568007b0a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f569400bb50 tx=0x7f569400b2e0 comp rx=0 tx=0).stop 2024-09-17T01:37:01.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.814+0000 7f56a3200640 1 -- 172.21.15.42:0/670000451 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56a415a2a0 msgr2=0x7f56a4151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:01.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.814+0000 7f56a3200640 1 --2- 172.21.15.42:0/670000451 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56a415a2a0 0x7f56a4151c50 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f568c00c390 tx=0x7f568c00c850 comp rx=0 tx=0).stop 2024-09-17T01:37:01.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.814+0000 7f56a3200640 1 -- 172.21.15.42:0/670000451 shutdown_connections 2024-09-17T01:37:01.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.814+0000 7f56a3200640 1 --2- 172.21.15.42:0/670000451 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5680078b90 0x7f568007b0a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:01.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.814+0000 7f56a3200640 1 --2- 172.21.15.42:0/670000451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56a40afb20 0x7f56a40ae460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:01.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.814+0000 7f56a3200640 1 --2- 172.21.15.42:0/670000451 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56a415a2a0 0x7f56a4151c50 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:01.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.814+0000 7f56a3200640 1 --2- 172.21.15.42:0/670000451 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f56a40b14a0 0x7f56a4151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:01.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.814+0000 7f56a3200640 1 -- 172.21.15.42:0/670000451 >> 172.21.15.42:0/670000451 conn(0x7f56a40734a0 msgr2=0x7f56a4152b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:01.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.814+0000 7f56a3200640 1 -- 172.21.15.42:0/670000451 shutdown_connections 2024-09-17T01:37:01.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:01.814+0000 7f56a3200640 1 -- 172.21.15.42:0/670000451 wait complete. 2024-09-17T01:37:01.834 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T01:37:02.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.072+0000 7f55e6c00640 1 -- 172.21.15.42:0/546948982 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55e006d430 msgr2=0x7f55e006d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:02.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.072+0000 7f55e6c00640 1 --2- 172.21.15.42:0/546948982 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55e006d430 0x7f55e006d840 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f55c8005fd0 tx=0x7f55c802a670 comp rx=0 tx=0).stop 2024-09-17T01:37:02.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.072+0000 7f55e6c00640 1 -- 172.21.15.42:0/546948982 shutdown_connections 2024-09-17T01:37:02.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.072+0000 7f55e6c00640 1 --2- 172.21.15.42:0/546948982 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55e006d430 0x7f55e006d840 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:02.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.072+0000 7f55e6c00640 1 -- 172.21.15.42:0/546948982 >> 172.21.15.42:0/546948982 conn(0x7f55e00b2930 msgr2=0x7f55e006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:02.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.073+0000 7f55e6c00640 1 -- 172.21.15.42:0/546948982 shutdown_connections 2024-09-17T01:37:02.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.073+0000 7f55e6c00640 1 -- 172.21.15.42:0/546948982 wait complete. 2024-09-17T01:37:02.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.075+0000 7f55e6c00640 1 Processor -- start 2024-09-17T01:37:02.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.075+0000 7f55e6c00640 1 -- start start 2024-09-17T01:37:02.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.076+0000 7f55e6c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55e006d430 0x7f55e015c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:02.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.076+0000 7f55e6c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55e0072520 0x7f55e01e6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:02.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.076+0000 7f55e6c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55e00afb80 0x7f55e01e71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:02.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.076+0000 7f55e6c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f55e0073250 con 0x7f55e006d430 2024-09-17T01:37:02.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.076+0000 7f55e6c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f55e01463a0 con 0x7f55e0072520 2024-09-17T01:37:02.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.076+0000 7f55e6c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f55e00733d0 con 0x7f55e00afb80 2024-09-17T01:37:02.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.077+0000 7f55dfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55e006d430 0x7f55e015c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:02.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.077+0000 7f55dfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55e006d430 0x7f55e015c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37976/0 (socket says 172.21.15.42:37976) 2024-09-17T01:37:02.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.077+0000 7f55dfe00640 1 -- 172.21.15.42:0/612244716 learned_addr learned my addr 172.21.15.42:0/612244716 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:02.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.077+0000 7f55d7400640 1 --2- 172.21.15.42:0/612244716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55e0072520 0x7f55e01e6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:02.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.077+0000 7f55e4c00640 1 --2- 172.21.15.42:0/612244716 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55e00afb80 0x7f55e01e71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:02.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.077+0000 7f55dfe00640 1 -- 172.21.15.42:0/612244716 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55e00afb80 msgr2=0x7f55e01e71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:02.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.077+0000 7f55dfe00640 1 --2- 172.21.15.42:0/612244716 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55e00afb80 0x7f55e01e71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:02.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.077+0000 7f55dfe00640 1 -- 172.21.15.42:0/612244716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55e0072520 msgr2=0x7f55e01e6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:02.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.077+0000 7f55dfe00640 1 --2- 172.21.15.42:0/612244716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55e0072520 0x7f55e01e6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:02.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.077+0000 7f55dfe00640 1 -- 172.21.15.42:0/612244716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e0144490 con 0x7f55e006d430 2024-09-17T01:37:02.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.077+0000 7f55e4c00640 1 --2- 172.21.15.42:0/612244716 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55e00afb80 0x7f55e01e71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:02.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.077+0000 7f55dfe00640 1 --2- 172.21.15.42:0/612244716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55e006d430 0x7f55e015c300 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f55d000c3d0 tx=0x7f55d000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:02.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.078+0000 7f55dcc00640 1 -- 172.21.15.42:0/612244716 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d0017070 con 0x7f55e006d430 2024-09-17T01:37:02.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.078+0000 7f55dcc00640 1 -- 172.21.15.42:0/612244716 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55d00053c0 con 0x7f55e006d430 2024-09-17T01:37:02.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.078+0000 7f55dcc00640 1 -- 172.21.15.42:0/612244716 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d0003850 con 0x7f55e006d430 2024-09-17T01:37:02.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.078+0000 7f55e6c00640 1 -- 172.21.15.42:0/612244716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e0144800 con 0x7f55e006d430 2024-09-17T01:37:02.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.078+0000 7f55e6c00640 1 -- 172.21.15.42:0/612244716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e01e6460 con 0x7f55e006d430 2024-09-17T01:37:02.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.079+0000 7f55e6c00640 1 -- 172.21.15.42:0/612244716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e015c840 con 0x7f55e006d430 2024-09-17T01:37:02.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.080+0000 7f55dcc00640 1 -- 172.21.15.42:0/612244716 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f55d001a070 con 0x7f55e006d430 2024-09-17T01:37:02.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.082+0000 7f55dcc00640 1 --2- 172.21.15.42:0/612244716 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f55bc078b90 0x7f55bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:02.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.082+0000 7f55dcc00640 1 -- 172.21.15.42:0/612244716 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7f55d009a060 con 0x7f55e006d430 2024-09-17T01:37:02.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.082+0000 7f55d7400640 1 --2- 172.21.15.42:0/612244716 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f55bc078b90 0x7f55bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:02.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.083+0000 7f55d7400640 1 --2- 172.21.15.42:0/612244716 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f55bc078b90 0x7f55bc07b0a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f55c8033000 tx=0x7f55c8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:02.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.086+0000 7f55dcc00640 1 -- 172.21.15.42:0/612244716 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f55e0144490 con 0x7f55e006d430 2024-09-17T01:37:02.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.317+0000 7f55e6c00640 1 -- 172.21.15.42:0/612244716 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f55e006d840 con 0x7f55e006d430 2024-09-17T01:37:02.828 INFO:tasks.ceph.mds.a.smithi042.stderr:2024-09-17T01:37:02.831+0000 7f4d23800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:37:02.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.877+0000 7f55dcc00640 1 -- 172.21.15.42:0/612244716 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v55) ==== 118+0+0 (secure 0 0 0) 0x7f55d0061e40 con 0x7f55e006d430 2024-09-17T01:37:02.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.880+0000 7f55e6c00640 1 -- 172.21.15.42:0/612244716 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f55bc078b90 msgr2=0x7f55bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:02.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.880+0000 7f55e6c00640 1 --2- 172.21.15.42:0/612244716 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f55bc078b90 0x7f55bc07b0a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f55c8033000 tx=0x7f55c8004730 comp rx=0 tx=0).stop 2024-09-17T01:37:02.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.880+0000 7f55e6c00640 1 -- 172.21.15.42:0/612244716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55e006d430 msgr2=0x7f55e015c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:02.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.880+0000 7f55e6c00640 1 --2- 172.21.15.42:0/612244716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55e006d430 0x7f55e015c300 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f55d000c3d0 tx=0x7f55d000c890 comp rx=0 tx=0).stop 2024-09-17T01:37:02.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.880+0000 7f55e6c00640 1 -- 172.21.15.42:0/612244716 shutdown_connections 2024-09-17T01:37:02.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.880+0000 7f55e6c00640 1 --2- 172.21.15.42:0/612244716 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f55bc078b90 0x7f55bc07b0a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:02.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.880+0000 7f55e6c00640 1 --2- 172.21.15.42:0/612244716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55e0072520 0x7f55e01e6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:02.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.880+0000 7f55e6c00640 1 --2- 172.21.15.42:0/612244716 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55e00afb80 0x7f55e01e71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:02.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.880+0000 7f55e6c00640 1 --2- 172.21.15.42:0/612244716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55e006d430 0x7f55e015c300 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:02.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.880+0000 7f55e6c00640 1 -- 172.21.15.42:0/612244716 >> 172.21.15.42:0/612244716 conn(0x7f55e00b2930 msgr2=0x7f55e00ccaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:02.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.880+0000 7f55e6c00640 1 -- 172.21.15.42:0/612244716 shutdown_connections 2024-09-17T01:37:02.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:02.880+0000 7f55e6c00640 1 -- 172.21.15.42:0/612244716 wait complete. 2024-09-17T01:37:02.905 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T01:37:02.906 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T01:37:03.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.142+0000 7f9080800640 1 -- 172.21.15.42:0/2864986464 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9060003a50 msgr2=0x7f9060003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:03.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.142+0000 7f9080800640 1 --2- 172.21.15.42:0/2864986464 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9060003a50 0x7f9060003ec0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f906c009d00 tx=0x7f9060005830 comp rx=0 tx=0).stop 2024-09-17T01:37:03.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.142+0000 7f9080800640 1 -- 172.21.15.42:0/2864986464 shutdown_connections 2024-09-17T01:37:03.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.142+0000 7f9080800640 1 --2- 172.21.15.42:0/2864986464 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9060003a50 0x7f9060003ec0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:03.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.142+0000 7f9080800640 1 -- 172.21.15.42:0/2864986464 >> 172.21.15.42:0/2864986464 conn(0x7f90780b2930 msgr2=0x7f907806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:03.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.142+0000 7f9080800640 1 -- 172.21.15.42:0/2864986464 shutdown_connections 2024-09-17T01:37:03.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.142+0000 7f9080800640 1 -- 172.21.15.42:0/2864986464 wait complete. 2024-09-17T01:37:03.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.144+0000 7f9080800640 1 Processor -- start 2024-09-17T01:37:03.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.145+0000 7f9080800640 1 -- start start 2024-09-17T01:37:03.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.146+0000 7f9080800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9060003a50 0x7f9078150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:03.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.146+0000 7f9080800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f907814df00 0x7f907814bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:03.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.146+0000 7f9080800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f907814e3d0 0x7f907814e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:03.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.146+0000 7f9080800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9078152890 con 0x7f907814df00 2024-09-17T01:37:03.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.146+0000 7f9080800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9078152710 con 0x7f907814e3d0 2024-09-17T01:37:03.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.146+0000 7f9080800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9078152a10 con 0x7f9060003a50 2024-09-17T01:37:03.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.146+0000 7f907d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f907814df00 0x7f907814bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:03.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.146+0000 7f907d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f907814df00 0x7f907814bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37998/0 (socket says 172.21.15.42:37998) 2024-09-17T01:37:03.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.146+0000 7f907d400640 1 -- 172.21.15.42:0/1511653082 learned_addr learned my addr 172.21.15.42:0/1511653082 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:03.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.147+0000 7f907de00640 1 --2- 172.21.15.42:0/1511653082 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9060003a50 0x7f9078150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:03.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.147+0000 7f907e800640 1 --2- 172.21.15.42:0/1511653082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f907814e3d0 0x7f907814e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:03.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.147+0000 7f907d400640 1 -- 172.21.15.42:0/1511653082 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9060003a50 msgr2=0x7f9078150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:03.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.147+0000 7f907d400640 1 --2- 172.21.15.42:0/1511653082 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9060003a50 0x7f9078150360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:03.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.147+0000 7f907d400640 1 -- 172.21.15.42:0/1511653082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f907814e3d0 msgr2=0x7f907814e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:03.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.147+0000 7f907d400640 1 --2- 172.21.15.42:0/1511653082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f907814e3d0 0x7f907814e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:03.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.147+0000 7f907d400640 1 -- 172.21.15.42:0/1511653082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f907814ed20 con 0x7f907814df00 2024-09-17T01:37:03.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.147+0000 7f907e800640 1 --2- 172.21.15.42:0/1511653082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f907814e3d0 0x7f907814e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:03.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.147+0000 7f907d400640 1 --2- 172.21.15.42:0/1511653082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f907814df00 0x7f907814bdb0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f9068001c60 tx=0x7f90680039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:03.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.147+0000 7f9072000640 1 -- 172.21.15.42:0/1511653082 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9068015070 con 0x7f907814df00 2024-09-17T01:37:03.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.148+0000 7f9072000640 1 -- 172.21.15.42:0/1511653082 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9068011920 con 0x7f907814df00 2024-09-17T01:37:03.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.148+0000 7f9080800640 1 -- 172.21.15.42:0/1511653082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9078150c20 con 0x7f907814df00 2024-09-17T01:37:03.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.148+0000 7f9072000640 1 -- 172.21.15.42:0/1511653082 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9068011d70 con 0x7f907814df00 2024-09-17T01:37:03.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.148+0000 7f9080800640 1 -- 172.21.15.42:0/1511653082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90781533a0 con 0x7f907814df00 2024-09-17T01:37:03.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.149+0000 7f9080800640 1 -- 172.21.15.42:0/1511653082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f907815f890 con 0x7f907814df00 2024-09-17T01:37:03.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.150+0000 7f9072000640 1 -- 172.21.15.42:0/1511653082 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9068018070 con 0x7f907814df00 2024-09-17T01:37:03.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.151+0000 7f9072000640 1 --2- 172.21.15.42:0/1511653082 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f905c078b90 0x7f905c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:03.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.152+0000 7f9072000640 1 -- 172.21.15.42:0/1511653082 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7f906809ba80 con 0x7f907814df00 2024-09-17T01:37:03.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.152+0000 7f907de00640 1 --2- 172.21.15.42:0/1511653082 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f905c078b90 0x7f905c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:03.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.153+0000 7f907de00640 1 --2- 172.21.15.42:0/1511653082 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f905c078b90 0x7f905c07b0a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f906c035000 tx=0x7f906c0046c0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:03.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.155+0000 7f9072000640 1 -- 172.21.15.42:0/1511653082 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f906809de20 con 0x7f907814df00 2024-09-17T01:37:03.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.386+0000 7f9080800640 1 -- 172.21.15.42:0/1511653082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f90781509b0 con 0x7f907814df00 2024-09-17T01:37:03.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.883+0000 7f9072000640 1 -- 172.21.15.42:0/1511653082 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v56) ==== 122+0+0 (secure 0 0 0) 0x7f907814ed20 con 0x7f907814df00 2024-09-17T01:37:03.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.886+0000 7f9080800640 1 -- 172.21.15.42:0/1511653082 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f905c078b90 msgr2=0x7f905c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:03.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.886+0000 7f9080800640 1 --2- 172.21.15.42:0/1511653082 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f905c078b90 0x7f905c07b0a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f906c035000 tx=0x7f906c0046c0 comp rx=0 tx=0).stop 2024-09-17T01:37:03.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.886+0000 7f9080800640 1 -- 172.21.15.42:0/1511653082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f907814df00 msgr2=0x7f907814bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:03.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.886+0000 7f9080800640 1 --2- 172.21.15.42:0/1511653082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f907814df00 0x7f907814bdb0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f9068001c60 tx=0x7f90680039c0 comp rx=0 tx=0).stop 2024-09-17T01:37:03.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.886+0000 7f9080800640 1 -- 172.21.15.42:0/1511653082 shutdown_connections 2024-09-17T01:37:03.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.886+0000 7f9080800640 1 --2- 172.21.15.42:0/1511653082 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f905c078b90 0x7f905c07b0a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:03.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.886+0000 7f9080800640 1 --2- 172.21.15.42:0/1511653082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f907814e3d0 0x7f907814e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:03.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.886+0000 7f9080800640 1 --2- 172.21.15.42:0/1511653082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f907814df00 0x7f907814bdb0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:03.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.886+0000 7f9080800640 1 --2- 172.21.15.42:0/1511653082 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9060003a50 0x7f9078150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:03.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.886+0000 7f9080800640 1 -- 172.21.15.42:0/1511653082 >> 172.21.15.42:0/1511653082 conn(0x7f90780b2930 msgr2=0x7f90780724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:03.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.886+0000 7f9080800640 1 -- 172.21.15.42:0/1511653082 shutdown_connections 2024-09-17T01:37:03.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:03.886+0000 7f9080800640 1 -- 172.21.15.42:0/1511653082 wait complete. 2024-09-17T01:37:03.911 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T01:37:03.911 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:37:04.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.143+0000 7f64f1c00640 1 -- 172.21.15.42:0/3219338109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64d0004d40 msgr2=0x7f64d0005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:04.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.143+0000 7f64f1c00640 1 --2- 172.21.15.42:0/3219338109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64d0004d40 0x7f64d0005150 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0b4890 tx=0x7f64d0005830 comp rx=0 tx=0).stop 2024-09-17T01:37:04.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.143+0000 7f64f1200640 1 -- 172.21.15.42:0/3219338109 reap_dead start 2024-09-17T01:37:04.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.143+0000 7f64f1c00640 1 -- 172.21.15.42:0/3219338109 shutdown_connections 2024-09-17T01:37:04.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.143+0000 7f64f1c00640 1 -- 172.21.15.42:0/3219338109 >> 172.21.15.42:0/3219338109 conn(0x7f64ec0b25f0 msgr2=0x7f64ec0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:04.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.143+0000 7f64f1c00640 1 -- 172.21.15.42:0/3219338109 shutdown_connections 2024-09-17T01:37:04.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.143+0000 7f64f1c00640 1 -- 172.21.15.42:0/3219338109 wait complete. 2024-09-17T01:37:04.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.145+0000 7f64f1c00640 1 Processor -- start 2024-09-17T01:37:04.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.146+0000 7f64f1c00640 1 -- start start 2024-09-17T01:37:04.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.147+0000 7f64f1c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64d0004d40 0x7f64ec1551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:04.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.147+0000 7f64f1c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f64ec0742e0 0x7f64ec0749a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:04.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.147+0000 7f64f1c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64ec073760 0x7f64ec073b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:04.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.147+0000 7f64f1c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f64ec06d0b0 con 0x7f64d0004d40 2024-09-17T01:37:04.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.147+0000 7f64f1c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f64ec06cf30 con 0x7f64ec073760 2024-09-17T01:37:04.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.147+0000 7f64f1c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f64ec0cfd70 con 0x7f64ec0742e0 2024-09-17T01:37:04.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.147+0000 7f64ebe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64d0004d40 0x7f64ec1551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:04.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.147+0000 7f64ebe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64d0004d40 0x7f64ec1551a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38018/0 (socket says 172.21.15.42:38018) 2024-09-17T01:37:04.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.147+0000 7f64ebe00640 1 -- 172.21.15.42:0/3948960515 learned_addr learned my addr 172.21.15.42:0/3948960515 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:04.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.148+0000 7f64f1200640 1 --2- 172.21.15.42:0/3948960515 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64ec073760 0x7f64ec073b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:04.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.148+0000 7f64ebe00640 1 -- 172.21.15.42:0/3948960515 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f64ec0742e0 msgr2=0x7f64ec0749a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:04.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.148+0000 7f64e3400640 1 --2- 172.21.15.42:0/3948960515 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f64ec0742e0 0x7f64ec0749a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:04.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.148+0000 7f64ebe00640 1 --2- 172.21.15.42:0/3948960515 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f64ec0742e0 0x7f64ec0749a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:04.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.148+0000 7f64ebe00640 1 -- 172.21.15.42:0/3948960515 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64ec073760 msgr2=0x7f64ec073b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:04.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.148+0000 7f64ebe00640 1 --2- 172.21.15.42:0/3948960515 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64ec073760 0x7f64ec073b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:04.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.148+0000 7f64ebe00640 1 -- 172.21.15.42:0/3948960515 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ec1556e0 con 0x7f64d0004d40 2024-09-17T01:37:04.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.148+0000 7f64f1200640 1 --2- 172.21.15.42:0/3948960515 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64ec073760 0x7f64ec073b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:37:04.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.148+0000 7f64e3400640 1 --2- 172.21.15.42:0/3948960515 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f64ec0742e0 0x7f64ec0749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:37:04.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.148+0000 7f64ebe00640 1 --2- 172.21.15.42:0/3948960515 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64d0004d40 0x7f64ec1551a0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f64dc011ae0 tx=0x7f64dc009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:04.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.148+0000 7f64e8c00640 1 -- 172.21.15.42:0/3948960515 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc00fcb0 con 0x7f64d0004d40 2024-09-17T01:37:04.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.148+0000 7f64e8c00640 1 -- 172.21.15.42:0/3948960515 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64dc00fe50 con 0x7f64d0004d40 2024-09-17T01:37:04.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.148+0000 7f64e8c00640 1 -- 172.21.15.42:0/3948960515 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc004280 con 0x7f64d0004d40 2024-09-17T01:37:04.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.148+0000 7f64f1c00640 1 -- 172.21.15.42:0/3948960515 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64ec1f5c50 con 0x7f64d0004d40 2024-09-17T01:37:04.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.148+0000 7f64f1c00640 1 -- 172.21.15.42:0/3948960515 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64ec1f6210 con 0x7f64d0004d40 2024-09-17T01:37:04.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.149+0000 7f64f1c00640 1 -- 172.21.15.42:0/3948960515 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64ec1519b0 con 0x7f64d0004d40 2024-09-17T01:37:04.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.151+0000 7f64e8c00640 1 -- 172.21.15.42:0/3948960515 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f64dc0035f0 con 0x7f64d0004d40 2024-09-17T01:37:04.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.152+0000 7f64e8c00640 1 --2- 172.21.15.42:0/3948960515 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f64c8078b90 0x7f64c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:04.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.152+0000 7f64e8c00640 1 -- 172.21.15.42:0/3948960515 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7f64dc09b920 con 0x7f64d0004d40 2024-09-17T01:37:04.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.152+0000 7f64e3400640 1 --2- 172.21.15.42:0/3948960515 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f64c8078b90 0x7f64c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:04.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.153+0000 7f64e3400640 1 --2- 172.21.15.42:0/3948960515 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f64c8078b90 0x7f64c807b0a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f64ec074270 tx=0x7f64d4005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:04.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.156+0000 7f64e8c00640 1 -- 172.21.15.42:0/3948960515 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f64dc063d60 con 0x7f64d0004d40 2024-09-17T01:37:04.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.389+0000 7f64f1c00640 1 -- 172.21.15.42:0/3948960515 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64ec0aefe0 con 0x7f64d0004d40 2024-09-17T01:37:04.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.389+0000 7f64e8c00640 1 -- 172.21.15.42:0/3948960515 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5225 (secure 0 0 0) 0x7f64dc063660 con 0x7f64d0004d40 2024-09-17T01:37:04.387 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:04.387 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":56,"btime":"2024-09-17T01:37:03:878707+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/1714334149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1714334149},{"type":"v1","addr":"172.21.15.43:6835","nonce":1714334149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":5975,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/2362335883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2362335883},{"type":"v1","addr":"172.21.15.42:6834","nonce":2362335883}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6433,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1300976792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1300976792},{"type":"v1","addr":"172.21.15.43:6837","nonce":1300976792}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:37:00.371835+0000","modified":"2024-09-17T01:37:03.387633+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6729":{"gid":6729,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3707410924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3707410924},{"type":"v1","addr":"172.21.15.42:6835","nonce":3707410924}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6729,"qdb_cluster":[6729]},"id":5}]} 2024-09-17T01:37:04.388 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 56 2024-09-17T01:37:04.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.392+0000 7f64f1c00640 1 -- 172.21.15.42:0/3948960515 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f64c8078b90 msgr2=0x7f64c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:04.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.392+0000 7f64f1c00640 1 --2- 172.21.15.42:0/3948960515 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f64c8078b90 0x7f64c807b0a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f64ec074270 tx=0x7f64d4005f90 comp rx=0 tx=0).stop 2024-09-17T01:37:04.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.392+0000 7f64f1c00640 1 -- 172.21.15.42:0/3948960515 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64d0004d40 msgr2=0x7f64ec1551a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:04.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.392+0000 7f64f1c00640 1 --2- 172.21.15.42:0/3948960515 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64d0004d40 0x7f64ec1551a0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f64dc011ae0 tx=0x7f64dc009f10 comp rx=0 tx=0).stop 2024-09-17T01:37:04.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.392+0000 7f64f1c00640 1 -- 172.21.15.42:0/3948960515 shutdown_connections 2024-09-17T01:37:04.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.392+0000 7f64f1c00640 1 --2- 172.21.15.42:0/3948960515 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f64c8078b90 0x7f64c807b0a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:04.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.392+0000 7f64f1c00640 1 --2- 172.21.15.42:0/3948960515 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64ec073760 0x7f64ec073b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:04.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.392+0000 7f64f1c00640 1 --2- 172.21.15.42:0/3948960515 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f64ec0742e0 0x7f64ec0749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:04.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.392+0000 7f64f1c00640 1 --2- 172.21.15.42:0/3948960515 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64d0004d40 0x7f64ec1551a0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:04.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.392+0000 7f64f1c00640 1 -- 172.21.15.42:0/3948960515 >> 172.21.15.42:0/3948960515 conn(0x7f64ec0b25f0 msgr2=0x7f64ec0ad080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:04.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.392+0000 7f64f1c00640 1 -- 172.21.15.42:0/3948960515 shutdown_connections 2024-09-17T01:37:04.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.392+0000 7f64f1c00640 1 -- 172.21.15.42:0/3948960515 wait complete. 2024-09-17T01:37:04.412 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:37:04.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.642+0000 7f9724e00640 1 -- 172.21.15.42:0/2408855917 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97200d18b0 msgr2=0x7f97200d2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:04.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.642+0000 7f9724e00640 1 --2- 172.21.15.42:0/2408855917 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97200d18b0 0x7f97200d2840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9708009830 tx=0x7f970802a520 comp rx=0 tx=0).stop 2024-09-17T01:37:04.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.642+0000 7f9724e00640 1 -- 172.21.15.42:0/2408855917 shutdown_connections 2024-09-17T01:37:04.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.642+0000 7f9724e00640 1 --2- 172.21.15.42:0/2408855917 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97200d18b0 0x7f97200d2840 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:04.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.642+0000 7f9724e00640 1 --2- 172.21.15.42:0/2408855917 >> v2:172.21.15.43:3300/0 conn(0x7f972015ea80 0x7f97200d1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:04.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.642+0000 7f9724e00640 1 -- 172.21.15.42:0/2408855917 >> 172.21.15.42:0/2408855917 conn(0x7f972006cf00 msgr2=0x7f972006d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:04.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.642+0000 7f9724e00640 1 -- 172.21.15.42:0/2408855917 shutdown_connections 2024-09-17T01:37:04.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.642+0000 7f9724e00640 1 -- 172.21.15.42:0/2408855917 wait complete. 2024-09-17T01:37:04.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.645+0000 7f9724e00640 1 Processor -- start 2024-09-17T01:37:04.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.645+0000 7f9724e00640 1 -- start start 2024-09-17T01:37:04.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.646+0000 7f9724e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97200d18b0 0x7f972015b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:04.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.646+0000 7f9724e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97200d2d80 0x7f97200ace10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:04.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.646+0000 7f9724e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f972015ea80 0x7f97201586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:04.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.646+0000 7f9724e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f97200b6760 con 0x7f97200d2d80 2024-09-17T01:37:04.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.646+0000 7f9724e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f97200b9550 con 0x7f972015ea80 2024-09-17T01:37:04.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.646+0000 7f9724e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f97200b68e0 con 0x7f97200d18b0 2024-09-17T01:37:04.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.647+0000 7f9717e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97200d2d80 0x7f97200ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:04.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.647+0000 7f9717e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97200d2d80 0x7f97200ace10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38020/0 (socket says 172.21.15.42:38020) 2024-09-17T01:37:04.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.647+0000 7f9717e00640 1 -- 172.21.15.42:0/4288438866 learned_addr learned my addr 172.21.15.42:0/4288438866 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:04.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.647+0000 7f971fe00640 1 --2- 172.21.15.42:0/4288438866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f972015ea80 0x7f97201586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:04.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.647+0000 7f971f400640 1 --2- 172.21.15.42:0/4288438866 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97200d18b0 0x7f972015b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:04.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.647+0000 7f9717e00640 1 -- 172.21.15.42:0/4288438866 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97200d18b0 msgr2=0x7f972015b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:04.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.647+0000 7f9717e00640 1 --2- 172.21.15.42:0/4288438866 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97200d18b0 0x7f972015b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:04.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.647+0000 7f9717e00640 1 -- 172.21.15.42:0/4288438866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f972015ea80 msgr2=0x7f97201586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:04.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.647+0000 7f9717e00640 1 --2- 172.21.15.42:0/4288438866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f972015ea80 0x7f97201586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:04.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.647+0000 7f9717e00640 1 -- 172.21.15.42:0/4288438866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97200ab110 con 0x7f97200d2d80 2024-09-17T01:37:04.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.648+0000 7f9717e00640 1 --2- 172.21.15.42:0/4288438866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97200d2d80 0x7f97200ace10 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f970802ab10 tx=0x7f97080040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:04.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.648+0000 7f9717400640 1 -- 172.21.15.42:0/4288438866 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9708005220 con 0x7f97200d2d80 2024-09-17T01:37:04.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.648+0000 7f9717400640 1 -- 172.21.15.42:0/4288438866 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97080054b0 con 0x7f97200d2d80 2024-09-17T01:37:04.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.648+0000 7f9717400640 1 -- 172.21.15.42:0/4288438866 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9708004a00 con 0x7f97200d2d80 2024-09-17T01:37:04.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.648+0000 7f9724e00640 1 -- 172.21.15.42:0/4288438866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97200ab3f0 con 0x7f97200d2d80 2024-09-17T01:37:04.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.648+0000 7f9724e00640 1 -- 172.21.15.42:0/4288438866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97200ab9b0 con 0x7f97200d2d80 2024-09-17T01:37:04.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.649+0000 7f9724e00640 1 -- 172.21.15.42:0/4288438866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97200b6e00 con 0x7f97200d2d80 2024-09-17T01:37:04.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.650+0000 7f9717400640 1 -- 172.21.15.42:0/4288438866 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9708004ba0 con 0x7f97200d2d80 2024-09-17T01:37:04.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.651+0000 7f9717400640 1 --2- 172.21.15.42:0/4288438866 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f96fc078b90 0x7f96fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:04.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.652+0000 7f9717400640 1 -- 172.21.15.42:0/4288438866 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7f97080bbf50 con 0x7f97200d2d80 2024-09-17T01:37:04.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.652+0000 7f971f400640 1 --2- 172.21.15.42:0/4288438866 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f96fc078b90 0x7f96fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:04.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.653+0000 7f971f400640 1 --2- 172.21.15.42:0/4288438866 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f96fc078b90 0x7f96fc07b0a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9710009b30 tx=0x7f9710005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:04.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.656+0000 7f9717400640 1 -- 172.21.15.42:0/4288438866 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f970803f030 con 0x7f97200d2d80 2024-09-17T01:37:04.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.855+0000 7f9724e00640 1 -- 172.21.15.42:0/4288438866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f97200abd90 con 0x7f97200d2d80 2024-09-17T01:37:04.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.856+0000 7f9717400640 1 -- 172.21.15.42:0/4288438866 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+16620 (secure 0 0 0) 0x7f9708031770 con 0x7f97200d2d80 2024-09-17T01:37:04.854 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:04.854 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":78,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:37:01.862449+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:36:58.306928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T01:36:59.336540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:37:04.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.858+0000 7f9724e00640 1 -- 172.21.15.42:0/4288438866 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f96fc078b90 msgr2=0x7f96fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:04.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.858+0000 7f9724e00640 1 --2- 172.21.15.42:0/4288438866 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f96fc078b90 0x7f96fc07b0a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9710009b30 tx=0x7f9710005f90 comp rx=0 tx=0).stop 2024-09-17T01:37:04.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.858+0000 7f9724e00640 1 -- 172.21.15.42:0/4288438866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97200d2d80 msgr2=0x7f97200ace10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:04.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.858+0000 7f9724e00640 1 --2- 172.21.15.42:0/4288438866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97200d2d80 0x7f97200ace10 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f970802ab10 tx=0x7f97080040c0 comp rx=0 tx=0).stop 2024-09-17T01:37:04.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.858+0000 7f9724e00640 1 -- 172.21.15.42:0/4288438866 shutdown_connections 2024-09-17T01:37:04.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.858+0000 7f9724e00640 1 --2- 172.21.15.42:0/4288438866 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f96fc078b90 0x7f96fc07b0a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:04.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.859+0000 7f9724e00640 1 --2- 172.21.15.42:0/4288438866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f972015ea80 0x7f97201586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:04.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.859+0000 7f9724e00640 1 --2- 172.21.15.42:0/4288438866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97200d2d80 0x7f97200ace10 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:04.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.859+0000 7f9724e00640 1 --2- 172.21.15.42:0/4288438866 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97200d18b0 0x7f972015b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:04.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.859+0000 7f9724e00640 1 -- 172.21.15.42:0/4288438866 >> 172.21.15.42:0/4288438866 conn(0x7f972006cf00 msgr2=0x7f972006d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:04.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.859+0000 7f9724e00640 1 -- 172.21.15.42:0/4288438866 shutdown_connections 2024-09-17T01:37:04.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:04.859+0000 7f9724e00640 1 -- 172.21.15.42:0/4288438866 wait complete. 2024-09-17T01:37:04.879 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T01:37:04.879 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:37:05.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.110+0000 7f892ae00640 1 -- 172.21.15.42:0/144530962 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f890c003a00 msgr2=0x7f890c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:05.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.110+0000 7f892ae00640 1 --2- 172.21.15.42:0/144530962 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f890c003a00 0x7f890c003e70 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f891800c4a0 tx=0x7f890c005830 comp rx=0 tx=0).stop 2024-09-17T01:37:05.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.110+0000 7f892a400640 1 -- 172.21.15.42:0/144530962 reap_dead start 2024-09-17T01:37:05.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.110+0000 7f892ae00640 1 -- 172.21.15.42:0/144530962 shutdown_connections 2024-09-17T01:37:05.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.110+0000 7f892ae00640 1 -- 172.21.15.42:0/144530962 >> 172.21.15.42:0/144530962 conn(0x7f89240d1210 msgr2=0x7f89240d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:05.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.110+0000 7f892ae00640 1 -- 172.21.15.42:0/144530962 shutdown_connections 2024-09-17T01:37:05.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.110+0000 7f892ae00640 1 -- 172.21.15.42:0/144530962 wait complete. 2024-09-17T01:37:05.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.112+0000 7f892ae00640 1 Processor -- start 2024-09-17T01:37:05.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.112+0000 7f892ae00640 1 -- start start 2024-09-17T01:37:05.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.114+0000 7f892ae00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f890c003a00 0x7f892414b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:05.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.114+0000 7f892ae00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89241549f0 0x7f89241f8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:05.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.114+0000 7f892ae00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89241f9290 0x7f89240c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:05.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.114+0000 7f892ae00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f892415efb0 con 0x7f89241f9290 2024-09-17T01:37:05.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.114+0000 7f892ae00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f892415ee30 con 0x7f89241549f0 2024-09-17T01:37:05.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.114+0000 7f892ae00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f892415f4c0 con 0x7f890c003a00 2024-09-17T01:37:05.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.114+0000 7f892a400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89241f9290 0x7f89240c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:05.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.114+0000 7f892a400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89241f9290 0x7f89240c9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38024/0 (socket says 172.21.15.42:38024) 2024-09-17T01:37:05.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.114+0000 7f892a400640 1 -- 172.21.15.42:0/1664489393 learned_addr learned my addr 172.21.15.42:0/1664489393 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:05.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.114+0000 7f8929000640 1 --2- 172.21.15.42:0/1664489393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89241549f0 0x7f89241f8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:05.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.114+0000 7f8929a00640 1 --2- 172.21.15.42:0/1664489393 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f890c003a00 0x7f892414b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:05.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.114+0000 7f892a400640 1 -- 172.21.15.42:0/1664489393 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f890c003a00 msgr2=0x7f892414b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:05.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.114+0000 7f892a400640 1 --2- 172.21.15.42:0/1664489393 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f890c003a00 0x7f892414b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:05.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.114+0000 7f892a400640 1 -- 172.21.15.42:0/1664489393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89241549f0 msgr2=0x7f89241f8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:05.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.114+0000 7f892a400640 1 --2- 172.21.15.42:0/1664489393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89241549f0 0x7f89241f8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:05.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.114+0000 7f892a400640 1 -- 172.21.15.42:0/1664489393 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892414bf00 con 0x7f89241f9290 2024-09-17T01:37:05.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.115+0000 7f892a400640 1 --2- 172.21.15.42:0/1664489393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89241f9290 0x7f89240c9b40 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f891c005fd0 tx=0x7f891c010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:05.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.115+0000 7f8921600640 1 -- 172.21.15.42:0/1664489393 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c00ede0 con 0x7f89241f9290 2024-09-17T01:37:05.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.115+0000 7f8921600640 1 -- 172.21.15.42:0/1664489393 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f891c015070 con 0x7f89241f9290 2024-09-17T01:37:05.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.115+0000 7f8921600640 1 -- 172.21.15.42:0/1664489393 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c003d00 con 0x7f89241f9290 2024-09-17T01:37:05.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.115+0000 7f892ae00640 1 -- 172.21.15.42:0/1664489393 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8924155bb0 con 0x7f89241f9290 2024-09-17T01:37:05.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.115+0000 7f892ae00640 1 -- 172.21.15.42:0/1664489393 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8924158890 con 0x7f89241f9290 2024-09-17T01:37:05.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.116+0000 7f892ae00640 1 -- 172.21.15.42:0/1664489393 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89241f9b60 con 0x7f89241f9290 2024-09-17T01:37:05.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.118+0000 7f8921600640 1 -- 172.21.15.42:0/1664489393 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f891c004030 con 0x7f89241f9290 2024-09-17T01:37:05.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.118+0000 7f8921600640 1 --2- 172.21.15.42:0/1664489393 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8904078b90 0x7f890407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:05.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.119+0000 7f8921600640 1 -- 172.21.15.42:0/1664489393 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7f891c09b3e0 con 0x7f89241f9290 2024-09-17T01:37:05.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.119+0000 7f8929a00640 1 --2- 172.21.15.42:0/1664489393 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8904078b90 0x7f890407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:05.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.120+0000 7f8929a00640 1 --2- 172.21.15.42:0/1664489393 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8904078b90 0x7f890407b0a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f891800c4a0 tx=0x7f8918038040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:05.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.123+0000 7f8921600640 1 -- 172.21.15.42:0/1664489393 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f892414bf00 con 0x7f89241f9290 2024-09-17T01:37:05.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.312+0000 7f892ae00640 1 -- 172.21.15.42:0/1664489393 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f89240b6440 con 0x7f8904078b90 2024-09-17T01:37:05.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.318+0000 7f8921600640 1 -- 172.21.15.42:0/1664489393 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251646 (secure 0 0 0) 0x7f89240b6440 con 0x7f8904078b90 2024-09-17T01:37:05.319 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:05.320 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:37:05.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.322+0000 7f892ae00640 1 -- 172.21.15.42:0/1664489393 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8904078b90 msgr2=0x7f890407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:05.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.322+0000 7f892ae00640 1 --2- 172.21.15.42:0/1664489393 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8904078b90 0x7f890407b0a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f891800c4a0 tx=0x7f8918038040 comp rx=0 tx=0).stop 2024-09-17T01:37:05.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.322+0000 7f892ae00640 1 -- 172.21.15.42:0/1664489393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89241f9290 msgr2=0x7f89240c9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:05.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.322+0000 7f892ae00640 1 --2- 172.21.15.42:0/1664489393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89241f9290 0x7f89240c9b40 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f891c005fd0 tx=0x7f891c010e80 comp rx=0 tx=0).stop 2024-09-17T01:37:05.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.322+0000 7f892ae00640 1 -- 172.21.15.42:0/1664489393 shutdown_connections 2024-09-17T01:37:05.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.322+0000 7f892ae00640 1 --2- 172.21.15.42:0/1664489393 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8904078b90 0x7f890407b0a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:05.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.322+0000 7f892ae00640 1 --2- 172.21.15.42:0/1664489393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89241549f0 0x7f89241f8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:05.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.322+0000 7f892ae00640 1 --2- 172.21.15.42:0/1664489393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89241f9290 0x7f89240c9b40 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:05.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.322+0000 7f892ae00640 1 --2- 172.21.15.42:0/1664489393 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f890c003a00 0x7f892414b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:05.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.322+0000 7f892ae00640 1 -- 172.21.15.42:0/1664489393 >> 172.21.15.42:0/1664489393 conn(0x7f89240d1210 msgr2=0x7f89240d3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:05.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.322+0000 7f892ae00640 1 -- 172.21.15.42:0/1664489393 shutdown_connections 2024-09-17T01:37:05.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.322+0000 7f892ae00640 1 -- 172.21.15.42:0/1664489393 wait complete. 2024-09-17T01:37:05.343 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-09-17T01:37:05.062033+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":139,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":299704,"kb_used_data":8556,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754675016,"statfs":{"total":773094113280,"available":772787216384,"internally_reserved":0,"allocated":8761344,"data_stored":4397899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":297913908},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001765"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.875283+0000","last_change":"2024-09-17T01:37:00.894727+0000","last_active":"2024-09-17T01:37:01.875283+0000","last_peered":"2024-09-17T01:37:01.875283+0000","last_clean":"2024-09-17T01:37:01.875283+0000","last_became_active":"2024-09-17T01:37:00.894422+0000","last_became_peered":"2024-09-17T01:37:00.894422+0000","last_unstale":"2024-09-17T01:37:01.875283+0000","last_undegraded":"2024-09-17T01:37:01.875283+0000","last_fullsized":"2024-09-17T01:37:01.875283+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:07.471265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938210+0000","last_change":"2024-09-17T01:37:00.883141+0000","last_active":"2024-09-17T01:37:01.938210+0000","last_peered":"2024-09-17T01:37:01.938210+0000","last_clean":"2024-09-17T01:37:01.938210+0000","last_became_active":"2024-09-17T01:37:00.882588+0000","last_became_peered":"2024-09-17T01:37:00.882588+0000","last_unstale":"2024-09-17T01:37:01.938210+0000","last_undegraded":"2024-09-17T01:37:01.938210+0000","last_fullsized":"2024-09-17T01:37:01.938210+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:37:06.008340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938115+0000","last_change":"2024-09-17T01:37:00.886235+0000","last_active":"2024-09-17T01:37:01.938115+0000","last_peered":"2024-09-17T01:37:01.938115+0000","last_clean":"2024-09-17T01:37:01.938115+0000","last_became_active":"2024-09-17T01:37:00.884395+0000","last_became_peered":"2024-09-17T01:37:00.884395+0000","last_unstale":"2024-09-17T01:37:01.938115+0000","last_undegraded":"2024-09-17T01:37:01.938115+0000","last_fullsized":"2024-09-17T01:37:01.938115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:46.190213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938091+0000","last_change":"2024-09-17T01:37:00.882991+0000","last_active":"2024-09-17T01:37:01.938091+0000","last_peered":"2024-09-17T01:37:01.938091+0000","last_clean":"2024-09-17T01:37:01.938091+0000","last_became_active":"2024-09-17T01:37:00.882627+0000","last_became_peered":"2024-09-17T01:37:00.882627+0000","last_unstale":"2024-09-17T01:37:01.938091+0000","last_undegraded":"2024-09-17T01:37:01.938091+0000","last_fullsized":"2024-09-17T01:37:01.938091+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:18.536668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937768+0000","last_change":"2024-09-17T01:37:00.879118+0000","last_active":"2024-09-17T01:37:01.937768+0000","last_peered":"2024-09-17T01:37:01.937768+0000","last_clean":"2024-09-17T01:37:01.937768+0000","last_became_active":"2024-09-17T01:37:00.878074+0000","last_became_peered":"2024-09-17T01:37:00.878074+0000","last_unstale":"2024-09-17T01:37:01.937768+0000","last_undegraded":"2024-09-17T01:37:01.937768+0000","last_fullsized":"2024-09-17T01:37:01.937768+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:11.586434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2024-09-17T01:36:59.858191+0000","last_change":"2024-09-17T01:36:59.858191+0000","last_active":"2024-09-17T01:36:59.841771+0000","last_peered":"2024-09-17T01:36:59.841771+0000","last_clean":"2024-09-17T01:36:59.841771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:59.858191+0000","last_undegraded":"2024-09-17T01:36:59.858191+0000","last_fullsized":"2024-09-17T01:36:59.858191+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870613+0000","last_change":"2024-09-17T01:37:00.885660+0000","last_active":"2024-09-17T01:37:01.870613+0000","last_peered":"2024-09-17T01:37:01.870613+0000","last_clean":"2024-09-17T01:37:01.870613+0000","last_became_active":"2024-09-17T01:37:00.875481+0000","last_became_peered":"2024-09-17T01:37:00.875481+0000","last_unstale":"2024-09-17T01:37:01.870613+0000","last_undegraded":"2024-09-17T01:37:01.870613+0000","last_fullsized":"2024-09-17T01:37:01.870613+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:54.284586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874358+0000","last_change":"2024-09-17T01:37:00.887879+0000","last_active":"2024-09-17T01:37:01.874358+0000","last_peered":"2024-09-17T01:37:01.874358+0000","last_clean":"2024-09-17T01:37:01.874358+0000","last_became_active":"2024-09-17T01:37:00.886811+0000","last_became_peered":"2024-09-17T01:37:00.886811+0000","last_unstale":"2024-09-17T01:37:01.874358+0000","last_undegraded":"2024-09-17T01:37:01.874358+0000","last_fullsized":"2024-09-17T01:37:01.874358+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:07.671917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938274+0000","last_change":"2024-09-17T01:37:00.880205+0000","last_active":"2024-09-17T01:37:01.938274+0000","last_peered":"2024-09-17T01:37:01.938274+0000","last_clean":"2024-09-17T01:37:01.938274+0000","last_became_active":"2024-09-17T01:37:00.879875+0000","last_became_peered":"2024-09-17T01:37:00.879875+0000","last_unstale":"2024-09-17T01:37:01.938274+0000","last_undegraded":"2024-09-17T01:37:01.938274+0000","last_fullsized":"2024-09-17T01:37:01.938274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:26.752484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871291+0000","last_change":"2024-09-17T01:37:00.874744+0000","last_active":"2024-09-17T01:37:01.871291+0000","last_peered":"2024-09-17T01:37:01.871291+0000","last_clean":"2024-09-17T01:37:01.871291+0000","last_became_active":"2024-09-17T01:37:00.872129+0000","last_became_peered":"2024-09-17T01:37:00.872129+0000","last_unstale":"2024-09-17T01:37:01.871291+0000","last_undegraded":"2024-09-17T01:37:01.871291+0000","last_fullsized":"2024-09-17T01:37:01.871291+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:40.026790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.875017+0000","last_change":"2024-09-17T01:37:00.886368+0000","last_active":"2024-09-17T01:37:01.875017+0000","last_peered":"2024-09-17T01:37:01.875017+0000","last_clean":"2024-09-17T01:37:01.875017+0000","last_became_active":"2024-09-17T01:37:00.886042+0000","last_became_peered":"2024-09-17T01:37:00.886042+0000","last_unstale":"2024-09-17T01:37:01.875017+0000","last_undegraded":"2024-09-17T01:37:01.875017+0000","last_fullsized":"2024-09-17T01:37:01.875017+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:51.174176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874503+0000","last_change":"2024-09-17T01:37:00.878779+0000","last_active":"2024-09-17T01:37:01.874503+0000","last_peered":"2024-09-17T01:37:01.874503+0000","last_clean":"2024-09-17T01:37:01.874503+0000","last_became_active":"2024-09-17T01:37:00.878431+0000","last_became_peered":"2024-09-17T01:37:00.878431+0000","last_unstale":"2024-09-17T01:37:01.874503+0000","last_undegraded":"2024-09-17T01:37:01.874503+0000","last_fullsized":"2024-09-17T01:37:01.874503+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:54.289027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937788+0000","last_change":"2024-09-17T01:37:00.883220+0000","last_active":"2024-09-17T01:37:01.937788+0000","last_peered":"2024-09-17T01:37:01.937788+0000","last_clean":"2024-09-17T01:37:01.937788+0000","last_became_active":"2024-09-17T01:37:00.882923+0000","last_became_peered":"2024-09-17T01:37:00.882923+0000","last_unstale":"2024-09-17T01:37:01.937788+0000","last_undegraded":"2024-09-17T01:37:01.937788+0000","last_fullsized":"2024-09-17T01:37:01.937788+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:48.939780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872570+0000","last_change":"2024-09-17T01:37:00.883960+0000","last_active":"2024-09-17T01:37:01.872570+0000","last_peered":"2024-09-17T01:37:01.872570+0000","last_clean":"2024-09-17T01:37:01.872570+0000","last_became_active":"2024-09-17T01:37:00.883650+0000","last_became_peered":"2024-09-17T01:37:00.883650+0000","last_unstale":"2024-09-17T01:37:01.872570+0000","last_undegraded":"2024-09-17T01:37:01.872570+0000","last_fullsized":"2024-09-17T01:37:01.872570+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:50:00.925352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872236+0000","last_change":"2024-09-17T01:37:00.874456+0000","last_active":"2024-09-17T01:37:01.872236+0000","last_peered":"2024-09-17T01:37:01.872236+0000","last_clean":"2024-09-17T01:37:01.872236+0000","last_became_active":"2024-09-17T01:37:00.870867+0000","last_became_peered":"2024-09-17T01:37:00.870867+0000","last_unstale":"2024-09-17T01:37:01.872236+0000","last_undegraded":"2024-09-17T01:37:01.872236+0000","last_fullsized":"2024-09-17T01:37:01.872236+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:15:29.982832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874345+0000","last_change":"2024-09-17T01:37:00.893408+0000","last_active":"2024-09-17T01:37:01.874345+0000","last_peered":"2024-09-17T01:37:01.874345+0000","last_clean":"2024-09-17T01:37:01.874345+0000","last_became_active":"2024-09-17T01:37:00.887416+0000","last_became_peered":"2024-09-17T01:37:00.887416+0000","last_unstale":"2024-09-17T01:37:01.874345+0000","last_undegraded":"2024-09-17T01:37:01.874345+0000","last_fullsized":"2024-09-17T01:37:01.874345+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:22.689477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938992+0000","last_change":"2024-09-17T01:37:00.872192+0000","last_active":"2024-09-17T01:37:01.938992+0000","last_peered":"2024-09-17T01:37:01.938992+0000","last_clean":"2024-09-17T01:37:01.938992+0000","last_became_active":"2024-09-17T01:37:00.871809+0000","last_became_peered":"2024-09-17T01:37:00.871809+0000","last_unstale":"2024-09-17T01:37:01.938992+0000","last_undegraded":"2024-09-17T01:37:01.938992+0000","last_fullsized":"2024-09-17T01:37:01.938992+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:55.876836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938793+0000","last_change":"2024-09-17T01:37:00.866290+0000","last_active":"2024-09-17T01:37:01.938793+0000","last_peered":"2024-09-17T01:37:01.938793+0000","last_clean":"2024-09-17T01:37:01.938793+0000","last_became_active":"2024-09-17T01:37:00.865874+0000","last_became_peered":"2024-09-17T01:37:00.865874+0000","last_unstale":"2024-09-17T01:37:01.938793+0000","last_undegraded":"2024-09-17T01:37:01.938793+0000","last_fullsized":"2024-09-17T01:37:01.938793+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:38.896993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874806+0000","last_change":"2024-09-17T01:37:00.897310+0000","last_active":"2024-09-17T01:37:01.874806+0000","last_peered":"2024-09-17T01:37:01.874806+0000","last_clean":"2024-09-17T01:37:01.874806+0000","last_became_active":"2024-09-17T01:37:00.896955+0000","last_became_peered":"2024-09-17T01:37:00.896955+0000","last_unstale":"2024-09-17T01:37:01.874806+0000","last_undegraded":"2024-09-17T01:37:01.874806+0000","last_fullsized":"2024-09-17T01:37:01.874806+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:04:01.328671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938592+0000","last_change":"2024-09-17T01:37:00.866925+0000","last_active":"2024-09-17T01:37:01.938592+0000","last_peered":"2024-09-17T01:37:01.938592+0000","last_clean":"2024-09-17T01:37:01.938592+0000","last_became_active":"2024-09-17T01:37:00.866542+0000","last_became_peered":"2024-09-17T01:37:00.866542+0000","last_unstale":"2024-09-17T01:37:01.938592+0000","last_undegraded":"2024-09-17T01:37:01.938592+0000","last_fullsized":"2024-09-17T01:37:01.938592+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:36.164907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937799+0000","last_change":"2024-09-17T01:37:00.874085+0000","last_active":"2024-09-17T01:37:01.937799+0000","last_peered":"2024-09-17T01:37:01.937799+0000","last_clean":"2024-09-17T01:37:01.937799+0000","last_became_active":"2024-09-17T01:37:00.873522+0000","last_became_peered":"2024-09-17T01:37:00.873522+0000","last_unstale":"2024-09-17T01:37:01.937799+0000","last_undegraded":"2024-09-17T01:37:01.937799+0000","last_fullsized":"2024-09-17T01:37:01.937799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:16.272810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2024-09-17T01:36:59.857702+0000","last_change":"2024-09-17T01:36:59.857702+0000","last_active":"2024-09-17T01:36:59.841771+0000","last_peered":"2024-09-17T01:36:59.841771+0000","last_clean":"2024-09-17T01:36:59.841771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:59.857702+0000","last_undegraded":"2024-09-17T01:36:59.857702+0000","last_fullsized":"2024-09-17T01:36:59.857702+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870493+0000","last_change":"2024-09-17T01:37:00.886408+0000","last_active":"2024-09-17T01:37:01.870493+0000","last_peered":"2024-09-17T01:37:01.870493+0000","last_clean":"2024-09-17T01:37:01.870493+0000","last_became_active":"2024-09-17T01:37:00.886111+0000","last_became_peered":"2024-09-17T01:37:00.886111+0000","last_unstale":"2024-09-17T01:37:01.870493+0000","last_undegraded":"2024-09-17T01:37:01.870493+0000","last_fullsized":"2024-09-17T01:37:01.870493+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:10.335496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874607+0000","last_change":"2024-09-17T01:37:00.874639+0000","last_active":"2024-09-17T01:37:01.874607+0000","last_peered":"2024-09-17T01:37:01.874607+0000","last_clean":"2024-09-17T01:37:01.874607+0000","last_became_active":"2024-09-17T01:37:00.874352+0000","last_became_peered":"2024-09-17T01:37:00.874352+0000","last_unstale":"2024-09-17T01:37:01.874607+0000","last_undegraded":"2024-09-17T01:37:01.874607+0000","last_fullsized":"2024-09-17T01:37:01.874607+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:56.583515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871375+0000","last_change":"2024-09-17T01:37:00.881981+0000","last_active":"2024-09-17T01:37:01.871375+0000","last_peered":"2024-09-17T01:37:01.871375+0000","last_clean":"2024-09-17T01:37:01.871375+0000","last_became_active":"2024-09-17T01:37:00.881639+0000","last_became_peered":"2024-09-17T01:37:00.881639+0000","last_unstale":"2024-09-17T01:37:01.871375+0000","last_undegraded":"2024-09-17T01:37:01.871375+0000","last_fullsized":"2024-09-17T01:37:01.871375+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:58.500831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874725+0000","last_change":"2024-09-17T01:37:00.895616+0000","last_active":"2024-09-17T01:37:01.874725+0000","last_peered":"2024-09-17T01:37:01.874725+0000","last_clean":"2024-09-17T01:37:01.874725+0000","last_became_active":"2024-09-17T01:37:00.895306+0000","last_became_peered":"2024-09-17T01:37:00.895306+0000","last_unstale":"2024-09-17T01:37:01.874725+0000","last_undegraded":"2024-09-17T01:37:01.874725+0000","last_fullsized":"2024-09-17T01:37:01.874725+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:33.147682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938197+0000","last_change":"2024-09-17T01:37:00.883738+0000","last_active":"2024-09-17T01:37:01.938197+0000","last_peered":"2024-09-17T01:37:01.938197+0000","last_clean":"2024-09-17T01:37:01.938197+0000","last_became_active":"2024-09-17T01:37:00.883028+0000","last_became_peered":"2024-09-17T01:37:00.883028+0000","last_unstale":"2024-09-17T01:37:01.938197+0000","last_undegraded":"2024-09-17T01:37:01.938197+0000","last_fullsized":"2024-09-17T01:37:01.938197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:50:15.638098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937702+0000","last_change":"2024-09-17T01:37:00.875084+0000","last_active":"2024-09-17T01:37:01.937702+0000","last_peered":"2024-09-17T01:37:01.937702+0000","last_clean":"2024-09-17T01:37:01.937702+0000","last_became_active":"2024-09-17T01:37:00.873935+0000","last_became_peered":"2024-09-17T01:37:00.873935+0000","last_unstale":"2024-09-17T01:37:01.937702+0000","last_undegraded":"2024-09-17T01:37:01.937702+0000","last_fullsized":"2024-09-17T01:37:01.937702+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:49.735347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937846+0000","last_change":"2024-09-17T01:37:00.881622+0000","last_active":"2024-09-17T01:37:01.937846+0000","last_peered":"2024-09-17T01:37:01.937846+0000","last_clean":"2024-09-17T01:37:01.937846+0000","last_became_active":"2024-09-17T01:37:00.880763+0000","last_became_peered":"2024-09-17T01:37:00.880763+0000","last_unstale":"2024-09-17T01:37:01.937846+0000","last_undegraded":"2024-09-17T01:37:01.937846+0000","last_fullsized":"2024-09-17T01:37:01.937846+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:38.263600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874922+0000","last_change":"2024-09-17T01:37:00.895593+0000","last_active":"2024-09-17T01:37:01.874922+0000","last_peered":"2024-09-17T01:37:01.874922+0000","last_clean":"2024-09-17T01:37:01.874922+0000","last_became_active":"2024-09-17T01:37:00.895223+0000","last_became_peered":"2024-09-17T01:37:00.895223+0000","last_unstale":"2024-09-17T01:37:01.874922+0000","last_undegraded":"2024-09-17T01:37:01.874922+0000","last_fullsized":"2024-09-17T01:37:01.874922+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:27.587846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937475+0000","last_change":"2024-09-17T01:37:00.877026+0000","last_active":"2024-09-17T01:37:01.937475+0000","last_peered":"2024-09-17T01:37:01.937475+0000","last_clean":"2024-09-17T01:37:01.937475+0000","last_became_active":"2024-09-17T01:37:00.876085+0000","last_became_peered":"2024-09-17T01:37:00.876085+0000","last_unstale":"2024-09-17T01:37:01.937475+0000","last_undegraded":"2024-09-17T01:37:01.937475+0000","last_fullsized":"2024-09-17T01:37:01.937475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:30.108084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937154+0000","last_change":"2024-09-17T01:37:00.873456+0000","last_active":"2024-09-17T01:37:01.937154+0000","last_peered":"2024-09-17T01:37:01.937154+0000","last_clean":"2024-09-17T01:37:01.937154+0000","last_became_active":"2024-09-17T01:37:00.873158+0000","last_became_peered":"2024-09-17T01:37:00.873158+0000","last_unstale":"2024-09-17T01:37:01.937154+0000","last_undegraded":"2024-09-17T01:37:01.937154+0000","last_fullsized":"2024-09-17T01:37:01.937154+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:57:26.714304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.875006+0000","last_change":"2024-09-17T01:37:00.881273+0000","last_active":"2024-09-17T01:37:01.875006+0000","last_peered":"2024-09-17T01:37:01.875006+0000","last_clean":"2024-09-17T01:37:01.875006+0000","last_became_active":"2024-09-17T01:37:00.880964+0000","last_became_peered":"2024-09-17T01:37:00.880964+0000","last_unstale":"2024-09-17T01:37:01.875006+0000","last_undegraded":"2024-09-17T01:37:01.875006+0000","last_fullsized":"2024-09-17T01:37:01.875006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.293605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T01:36:59.869549+0000","last_change":"2024-09-17T01:36:59.865695+0000","last_active":"2024-09-17T01:36:59.869549+0000","last_peered":"2024-09-17T01:36:59.869549+0000","last_clean":"2024-09-17T01:36:59.869549+0000","last_became_active":"2024-09-17T01:36:59.865350+0000","last_became_peered":"2024-09-17T01:36:59.865350+0000","last_unstale":"2024-09-17T01:36:59.869549+0000","last_undegraded":"2024-09-17T01:36:59.869549+0000","last_fullsized":"2024-09-17T01:36:59.869549+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:58.866475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938662+0000","last_change":"2024-09-17T01:37:00.877472+0000","last_active":"2024-09-17T01:37:01.938662+0000","last_peered":"2024-09-17T01:37:01.938662+0000","last_clean":"2024-09-17T01:37:01.938662+0000","last_became_active":"2024-09-17T01:37:00.876758+0000","last_became_peered":"2024-09-17T01:37:00.876758+0000","last_unstale":"2024-09-17T01:37:01.938662+0000","last_undegraded":"2024-09-17T01:37:01.938662+0000","last_fullsized":"2024-09-17T01:37:01.938662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:14.801586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.939126+0000","last_change":"2024-09-17T01:36:59.876074+0000","last_active":"2024-09-17T01:37:01.939126+0000","last_peered":"2024-09-17T01:37:01.939126+0000","last_clean":"2024-09-17T01:37:01.939126+0000","last_became_active":"2024-09-17T01:36:59.875702+0000","last_became_peered":"2024-09-17T01:36:59.875702+0000","last_unstale":"2024-09-17T01:37:01.939126+0000","last_undegraded":"2024-09-17T01:37:01.939126+0000","last_fullsized":"2024-09-17T01:37:01.939126+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:54.024362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2024-09-17T01:36:59.859334+0000","last_change":"2024-09-17T01:36:59.859334+0000","last_active":"2024-09-17T01:36:59.841771+0000","last_peered":"2024-09-17T01:36:59.841771+0000","last_clean":"2024-09-17T01:36:59.841771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:59.859334+0000","last_undegraded":"2024-09-17T01:36:59.859334+0000","last_fullsized":"2024-09-17T01:36:59.859334+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874879+0000","last_change":"2024-09-17T01:36:59.867428+0000","last_active":"2024-09-17T01:37:01.874879+0000","last_peered":"2024-09-17T01:37:01.874879+0000","last_clean":"2024-09-17T01:37:01.874879+0000","last_became_active":"2024-09-17T01:36:59.867059+0000","last_became_peered":"2024-09-17T01:36:59.867059+0000","last_unstale":"2024-09-17T01:37:01.874879+0000","last_undegraded":"2024-09-17T01:37:01.874879+0000","last_fullsized":"2024-09-17T01:37:01.874879+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:28.659364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871406+0000","last_change":"2024-09-17T01:37:00.883835+0000","last_active":"2024-09-17T01:37:01.871406+0000","last_peered":"2024-09-17T01:37:01.871406+0000","last_clean":"2024-09-17T01:37:01.871406+0000","last_became_active":"2024-09-17T01:37:00.883481+0000","last_became_peered":"2024-09-17T01:37:00.883481+0000","last_unstale":"2024-09-17T01:37:01.871406+0000","last_undegraded":"2024-09-17T01:37:01.871406+0000","last_fullsized":"2024-09-17T01:37:01.871406+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:31.009628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T01:36:59.877691+0000","last_change":"2024-09-17T01:36:59.868151+0000","last_active":"2024-09-17T01:36:59.877691+0000","last_peered":"2024-09-17T01:36:59.877691+0000","last_clean":"2024-09-17T01:36:59.877691+0000","last_became_active":"2024-09-17T01:36:59.867665+0000","last_became_peered":"2024-09-17T01:36:59.867665+0000","last_unstale":"2024-09-17T01:36:59.877691+0000","last_undegraded":"2024-09-17T01:36:59.877691+0000","last_fullsized":"2024-09-17T01:36:59.877691+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:12.137272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874435+0000","last_change":"2024-09-17T01:37:00.885316+0000","last_active":"2024-09-17T01:37:01.874435+0000","last_peered":"2024-09-17T01:37:01.874435+0000","last_clean":"2024-09-17T01:37:01.874435+0000","last_became_active":"2024-09-17T01:37:00.885035+0000","last_became_peered":"2024-09-17T01:37:00.885035+0000","last_unstale":"2024-09-17T01:37:01.874435+0000","last_undegraded":"2024-09-17T01:37:01.874435+0000","last_fullsized":"2024-09-17T01:37:01.874435+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:24.483354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873515+0000","last_change":"2024-09-17T01:36:59.868131+0000","last_active":"2024-09-17T01:37:01.873515+0000","last_peered":"2024-09-17T01:37:01.873515+0000","last_clean":"2024-09-17T01:37:01.873515+0000","last_became_active":"2024-09-17T01:36:59.867405+0000","last_became_peered":"2024-09-17T01:36:59.867405+0000","last_unstale":"2024-09-17T01:37:01.873515+0000","last_undegraded":"2024-09-17T01:37:01.873515+0000","last_fullsized":"2024-09-17T01:37:01.873515+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:49.866246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2024-09-17T01:36:59.856709+0000","last_change":"2024-09-17T01:36:59.856709+0000","last_active":"2024-09-17T01:36:59.841771+0000","last_peered":"2024-09-17T01:36:59.841771+0000","last_clean":"2024-09-17T01:36:59.841771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:59.856709+0000","last_undegraded":"2024-09-17T01:36:59.856709+0000","last_fullsized":"2024-09-17T01:36:59.856709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870354+0000","last_change":"2024-09-17T01:36:59.879850+0000","last_active":"2024-09-17T01:37:01.870354+0000","last_peered":"2024-09-17T01:37:01.870354+0000","last_clean":"2024-09-17T01:37:01.870354+0000","last_became_active":"2024-09-17T01:36:59.879463+0000","last_became_peered":"2024-09-17T01:36:59.879463+0000","last_unstale":"2024-09-17T01:37:01.870354+0000","last_undegraded":"2024-09-17T01:37:01.870354+0000","last_fullsized":"2024-09-17T01:37:01.870354+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:26:09.389012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872260+0000","last_change":"2024-09-17T01:37:00.868009+0000","last_active":"2024-09-17T01:37:01.872260+0000","last_peered":"2024-09-17T01:37:01.872260+0000","last_clean":"2024-09-17T01:37:01.872260+0000","last_became_active":"2024-09-17T01:37:00.867635+0000","last_became_peered":"2024-09-17T01:37:00.867635+0000","last_unstale":"2024-09-17T01:37:01.872260+0000","last_undegraded":"2024-09-17T01:37:01.872260+0000","last_fullsized":"2024-09-17T01:37:01.872260+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:37.440870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872881+0000","last_change":"2024-09-17T01:36:59.871995+0000","last_active":"2024-09-17T01:37:01.872881+0000","last_peered":"2024-09-17T01:37:01.872881+0000","last_clean":"2024-09-17T01:37:01.872881+0000","last_became_active":"2024-09-17T01:36:59.871288+0000","last_became_peered":"2024-09-17T01:36:59.871288+0000","last_unstale":"2024-09-17T01:37:01.872881+0000","last_undegraded":"2024-09-17T01:37:01.872881+0000","last_fullsized":"2024-09-17T01:37:01.872881+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:22.962787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872280+0000","last_change":"2024-09-17T01:37:00.892376+0000","last_active":"2024-09-17T01:37:01.872280+0000","last_peered":"2024-09-17T01:37:01.872280+0000","last_clean":"2024-09-17T01:37:01.872280+0000","last_became_active":"2024-09-17T01:37:00.891949+0000","last_became_peered":"2024-09-17T01:37:00.891949+0000","last_unstale":"2024-09-17T01:37:01.872280+0000","last_undegraded":"2024-09-17T01:37:01.872280+0000","last_fullsized":"2024-09-17T01:37:01.872280+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:00.313691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871905+0000","last_change":"2024-09-17T01:36:59.866044+0000","last_active":"2024-09-17T01:37:01.871905+0000","last_peered":"2024-09-17T01:37:01.871905+0000","last_clean":"2024-09-17T01:37:01.871905+0000","last_became_active":"2024-09-17T01:36:59.865721+0000","last_became_peered":"2024-09-17T01:36:59.865721+0000","last_unstale":"2024-09-17T01:37:01.871905+0000","last_undegraded":"2024-09-17T01:37:01.871905+0000","last_fullsized":"2024-09-17T01:37:01.871905+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:54.305186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871343+0000","last_change":"2024-09-17T01:37:00.881635+0000","last_active":"2024-09-17T01:37:01.871343+0000","last_peered":"2024-09-17T01:37:01.871343+0000","last_clean":"2024-09-17T01:37:01.871343+0000","last_became_active":"2024-09-17T01:37:00.881315+0000","last_became_peered":"2024-09-17T01:37:00.881315+0000","last_unstale":"2024-09-17T01:37:01.871343+0000","last_undegraded":"2024-09-17T01:37:01.871343+0000","last_fullsized":"2024-09-17T01:37:01.871343+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:44.751005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874740+0000","last_change":"2024-09-17T01:36:59.872074+0000","last_active":"2024-09-17T01:37:01.874740+0000","last_peered":"2024-09-17T01:37:01.874740+0000","last_clean":"2024-09-17T01:37:01.874740+0000","last_became_active":"2024-09-17T01:36:59.871674+0000","last_became_peered":"2024-09-17T01:36:59.871674+0000","last_unstale":"2024-09-17T01:37:01.874740+0000","last_undegraded":"2024-09-17T01:37:01.874740+0000","last_fullsized":"2024-09-17T01:37:01.874740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:05.955545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938478+0000","last_change":"2024-09-17T01:37:00.885008+0000","last_active":"2024-09-17T01:37:01.938478+0000","last_peered":"2024-09-17T01:37:01.938478+0000","last_clean":"2024-09-17T01:37:01.938478+0000","last_became_active":"2024-09-17T01:37:00.884389+0000","last_became_peered":"2024-09-17T01:37:00.884389+0000","last_unstale":"2024-09-17T01:37:01.938478+0000","last_undegraded":"2024-09-17T01:37:01.938478+0000","last_fullsized":"2024-09-17T01:37:01.938478+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:41.769359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938290+0000","last_change":"2024-09-17T01:36:59.878360+0000","last_active":"2024-09-17T01:37:01.938290+0000","last_peered":"2024-09-17T01:37:01.938290+0000","last_clean":"2024-09-17T01:37:01.938290+0000","last_became_active":"2024-09-17T01:36:59.878062+0000","last_became_peered":"2024-09-17T01:36:59.878062+0000","last_unstale":"2024-09-17T01:37:01.938290+0000","last_undegraded":"2024-09-17T01:37:01.938290+0000","last_fullsized":"2024-09-17T01:37:01.938290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:33.686940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874641+0000","last_change":"2024-09-17T01:37:00.894146+0000","last_active":"2024-09-17T01:37:01.874641+0000","last_peered":"2024-09-17T01:37:01.874641+0000","last_clean":"2024-09-17T01:37:01.874641+0000","last_became_active":"2024-09-17T01:37:00.893851+0000","last_became_peered":"2024-09-17T01:37:00.893851+0000","last_unstale":"2024-09-17T01:37:01.874641+0000","last_undegraded":"2024-09-17T01:37:01.874641+0000","last_fullsized":"2024-09-17T01:37:01.874641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:40.958493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"77'3","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874260+0000","last_change":"2024-09-17T01:36:59.870792+0000","last_active":"2024-09-17T01:37:01.874260+0000","last_peered":"2024-09-17T01:37:01.874260+0000","last_clean":"2024-09-17T01:37:01.874260+0000","last_became_active":"2024-09-17T01:36:59.870465+0000","last_became_peered":"2024-09-17T01:36:59.870465+0000","last_unstale":"2024-09-17T01:37:01.874260+0000","last_undegraded":"2024-09-17T01:37:01.874260+0000","last_fullsized":"2024-09-17T01:37:01.874260+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:48.732387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938477+0000","last_change":"2024-09-17T01:37:00.883131+0000","last_active":"2024-09-17T01:37:01.938477+0000","last_peered":"2024-09-17T01:37:01.938477+0000","last_clean":"2024-09-17T01:37:01.938477+0000","last_became_active":"2024-09-17T01:37:00.874476+0000","last_became_peered":"2024-09-17T01:37:00.874476+0000","last_unstale":"2024-09-17T01:37:01.938477+0000","last_undegraded":"2024-09-17T01:37:01.938477+0000","last_fullsized":"2024-09-17T01:37:01.938477+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:55.258607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"77'6","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873687+0000","last_change":"2024-09-17T01:36:59.867187+0000","last_active":"2024-09-17T01:37:01.873687+0000","last_peered":"2024-09-17T01:37:01.873687+0000","last_clean":"2024-09-17T01:37:01.873687+0000","last_became_active":"2024-09-17T01:36:59.866667+0000","last_became_peered":"2024-09-17T01:36:59.866667+0000","last_unstale":"2024-09-17T01:37:01.873687+0000","last_undegraded":"2024-09-17T01:37:01.873687+0000","last_fullsized":"2024-09-17T01:37:01.873687+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:51:46.620956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2024-09-17T01:36:59.856803+0000","last_change":"2024-09-17T01:36:59.856803+0000","last_active":"2024-09-17T01:36:59.841771+0000","last_peered":"2024-09-17T01:36:59.841771+0000","last_clean":"2024-09-17T01:36:59.841771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:59.856803+0000","last_undegraded":"2024-09-17T01:36:59.856803+0000","last_fullsized":"2024-09-17T01:36:59.856803+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873248+0000","last_change":"2024-09-17T01:36:59.877119+0000","last_active":"2024-09-17T01:37:01.873248+0000","last_peered":"2024-09-17T01:37:01.873248+0000","last_clean":"2024-09-17T01:37:01.873248+0000","last_became_active":"2024-09-17T01:36:59.876620+0000","last_became_peered":"2024-09-17T01:36:59.876620+0000","last_unstale":"2024-09-17T01:37:01.873248+0000","last_undegraded":"2024-09-17T01:37:01.873248+0000","last_fullsized":"2024-09-17T01:37:01.873248+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:33.686940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870866+0000","last_change":"2024-09-17T01:37:00.878599+0000","last_active":"2024-09-17T01:37:01.870866+0000","last_peered":"2024-09-17T01:37:01.870866+0000","last_clean":"2024-09-17T01:37:01.870866+0000","last_became_active":"2024-09-17T01:37:00.878274+0000","last_became_peered":"2024-09-17T01:37:00.878274+0000","last_unstale":"2024-09-17T01:37:01.870866+0000","last_undegraded":"2024-09-17T01:37:01.870866+0000","last_fullsized":"2024-09-17T01:37:01.870866+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:51.128375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870403+0000","last_change":"2024-09-17T01:36:59.876949+0000","last_active":"2024-09-17T01:37:01.870403+0000","last_peered":"2024-09-17T01:37:01.870403+0000","last_clean":"2024-09-17T01:37:01.870403+0000","last_became_active":"2024-09-17T01:36:59.876378+0000","last_became_peered":"2024-09-17T01:36:59.876378+0000","last_unstale":"2024-09-17T01:37:01.870403+0000","last_undegraded":"2024-09-17T01:37:01.870403+0000","last_fullsized":"2024-09-17T01:37:01.870403+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:49.485267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937617+0000","last_change":"2024-09-17T01:37:00.866971+0000","last_active":"2024-09-17T01:37:01.937617+0000","last_peered":"2024-09-17T01:37:01.937617+0000","last_clean":"2024-09-17T01:37:01.937617+0000","last_became_active":"2024-09-17T01:37:00.866631+0000","last_became_peered":"2024-09-17T01:37:00.866631+0000","last_unstale":"2024-09-17T01:37:01.937617+0000","last_undegraded":"2024-09-17T01:37:01.937617+0000","last_fullsized":"2024-09-17T01:37:01.937617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:41.130454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870561+0000","last_change":"2024-09-17T01:36:59.870560+0000","last_active":"2024-09-17T01:37:01.870561+0000","last_peered":"2024-09-17T01:37:01.870561+0000","last_clean":"2024-09-17T01:37:01.870561+0000","last_became_active":"2024-09-17T01:36:59.870147+0000","last_became_peered":"2024-09-17T01:36:59.870147+0000","last_unstale":"2024-09-17T01:37:01.870561+0000","last_undegraded":"2024-09-17T01:37:01.870561+0000","last_fullsized":"2024-09-17T01:37:01.870561+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:15.252189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937540+0000","last_change":"2024-09-17T01:37:00.879444+0000","last_active":"2024-09-17T01:37:01.937540+0000","last_peered":"2024-09-17T01:37:01.937540+0000","last_clean":"2024-09-17T01:37:01.937540+0000","last_became_active":"2024-09-17T01:37:00.877381+0000","last_became_peered":"2024-09-17T01:37:00.877381+0000","last_unstale":"2024-09-17T01:37:01.937540+0000","last_undegraded":"2024-09-17T01:37:01.937540+0000","last_fullsized":"2024-09-17T01:37:01.937540+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:24.841003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"77'8","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870188+0000","last_change":"2024-09-17T01:36:59.872221+0000","last_active":"2024-09-17T01:37:01.870188+0000","last_peered":"2024-09-17T01:37:01.870188+0000","last_clean":"2024-09-17T01:37:01.870188+0000","last_became_active":"2024-09-17T01:36:59.871924+0000","last_became_peered":"2024-09-17T01:36:59.871924+0000","last_unstale":"2024-09-17T01:37:01.870188+0000","last_undegraded":"2024-09-17T01:37:01.870188+0000","last_fullsized":"2024-09-17T01:37:01.870188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:26.403466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938258+0000","last_change":"2024-09-17T01:37:00.877693+0000","last_active":"2024-09-17T01:37:01.938258+0000","last_peered":"2024-09-17T01:37:01.938258+0000","last_clean":"2024-09-17T01:37:01.938258+0000","last_became_active":"2024-09-17T01:37:00.877386+0000","last_became_peered":"2024-09-17T01:37:00.877386+0000","last_unstale":"2024-09-17T01:37:01.938258+0000","last_undegraded":"2024-09-17T01:37:01.938258+0000","last_fullsized":"2024-09-17T01:37:01.938258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:14.659829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874878+0000","last_change":"2024-09-17T01:36:59.864804+0000","last_active":"2024-09-17T01:37:01.874878+0000","last_peered":"2024-09-17T01:37:01.874878+0000","last_clean":"2024-09-17T01:37:01.874878+0000","last_became_active":"2024-09-17T01:36:59.863708+0000","last_became_peered":"2024-09-17T01:36:59.863708+0000","last_unstale":"2024-09-17T01:37:01.874878+0000","last_undegraded":"2024-09-17T01:37:01.874878+0000","last_fullsized":"2024-09-17T01:37:01.874878+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:50.272122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938528+0000","last_change":"2024-09-17T01:37:00.881962+0000","last_active":"2024-09-17T01:37:01.938528+0000","last_peered":"2024-09-17T01:37:01.938528+0000","last_clean":"2024-09-17T01:37:01.938528+0000","last_became_active":"2024-09-17T01:37:00.881348+0000","last_became_peered":"2024-09-17T01:37:00.881348+0000","last_unstale":"2024-09-17T01:37:01.938528+0000","last_undegraded":"2024-09-17T01:37:01.938528+0000","last_fullsized":"2024-09-17T01:37:01.938528+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:51.607996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938307+0000","last_change":"2024-09-17T01:36:59.882677+0000","last_active":"2024-09-17T01:37:01.938307+0000","last_peered":"2024-09-17T01:37:01.938307+0000","last_clean":"2024-09-17T01:37:01.938307+0000","last_became_active":"2024-09-17T01:36:59.882324+0000","last_became_peered":"2024-09-17T01:36:59.882324+0000","last_unstale":"2024-09-17T01:37:01.938307+0000","last_undegraded":"2024-09-17T01:37:01.938307+0000","last_fullsized":"2024-09-17T01:37:01.938307+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:25.084810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938669+0000","last_change":"2024-09-17T01:37:00.881768+0000","last_active":"2024-09-17T01:37:01.938669+0000","last_peered":"2024-09-17T01:37:01.938669+0000","last_clean":"2024-09-17T01:37:01.938669+0000","last_became_active":"2024-09-17T01:37:00.880039+0000","last_became_peered":"2024-09-17T01:37:00.880039+0000","last_unstale":"2024-09-17T01:37:01.938669+0000","last_undegraded":"2024-09-17T01:37:01.938669+0000","last_fullsized":"2024-09-17T01:37:01.938669+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:19.860512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937401+0000","last_change":"2024-09-17T01:36:59.880681+0000","last_active":"2024-09-17T01:37:01.937401+0000","last_peered":"2024-09-17T01:37:01.937401+0000","last_clean":"2024-09-17T01:37:01.937401+0000","last_became_active":"2024-09-17T01:36:59.880368+0000","last_became_peered":"2024-09-17T01:36:59.880368+0000","last_unstale":"2024-09-17T01:37:01.937401+0000","last_undegraded":"2024-09-17T01:37:01.937401+0000","last_fullsized":"2024-09-17T01:37:01.937401+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:23.768788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938247+0000","last_change":"2024-09-17T01:37:00.880051+0000","last_active":"2024-09-17T01:37:01.938247+0000","last_peered":"2024-09-17T01:37:01.938247+0000","last_clean":"2024-09-17T01:37:01.938247+0000","last_became_active":"2024-09-17T01:37:00.878651+0000","last_became_peered":"2024-09-17T01:37:00.878651+0000","last_unstale":"2024-09-17T01:37:01.938247+0000","last_undegraded":"2024-09-17T01:37:01.938247+0000","last_fullsized":"2024-09-17T01:37:01.938247+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:50.436558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T01:36:59.880920+0000","last_change":"2024-09-17T01:36:59.877280+0000","last_active":"2024-09-17T01:36:59.880920+0000","last_peered":"2024-09-17T01:36:59.880920+0000","last_clean":"2024-09-17T01:36:59.880920+0000","last_became_active":"2024-09-17T01:36:59.876930+0000","last_became_peered":"2024-09-17T01:36:59.876930+0000","last_unstale":"2024-09-17T01:36:59.880920+0000","last_undegraded":"2024-09-17T01:36:59.880920+0000","last_fullsized":"2024-09-17T01:36:59.880920+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:38.701210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873154+0000","last_change":"2024-09-17T01:37:00.878655+0000","last_active":"2024-09-17T01:37:01.873154+0000","last_peered":"2024-09-17T01:37:01.873154+0000","last_clean":"2024-09-17T01:37:01.873154+0000","last_became_active":"2024-09-17T01:37:00.869157+0000","last_became_peered":"2024-09-17T01:37:00.869157+0000","last_unstale":"2024-09-17T01:37:01.873154+0000","last_undegraded":"2024-09-17T01:37:01.873154+0000","last_fullsized":"2024-09-17T01:37:01.873154+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:50.446321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T01:36:59.881120+0000","last_change":"2024-09-17T01:36:59.876368+0000","last_active":"2024-09-17T01:36:59.881120+0000","last_peered":"2024-09-17T01:36:59.881120+0000","last_clean":"2024-09-17T01:36:59.881120+0000","last_became_active":"2024-09-17T01:36:59.876090+0000","last_became_peered":"2024-09-17T01:36:59.876090+0000","last_unstale":"2024-09-17T01:36:59.881120+0000","last_undegraded":"2024-09-17T01:36:59.881120+0000","last_fullsized":"2024-09-17T01:36:59.881120+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:05.795017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873160+0000","last_change":"2024-09-17T01:37:00.877548+0000","last_active":"2024-09-17T01:37:01.873160+0000","last_peered":"2024-09-17T01:37:01.873160+0000","last_clean":"2024-09-17T01:37:01.873160+0000","last_became_active":"2024-09-17T01:37:00.876225+0000","last_became_peered":"2024-09-17T01:37:00.876225+0000","last_unstale":"2024-09-17T01:37:01.873160+0000","last_undegraded":"2024-09-17T01:37:01.873160+0000","last_fullsized":"2024-09-17T01:37:01.873160+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:59:05.289863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937544+0000","last_change":"2024-09-17T01:36:59.880051+0000","last_active":"2024-09-17T01:37:01.937544+0000","last_peered":"2024-09-17T01:37:01.937544+0000","last_clean":"2024-09-17T01:37:01.937544+0000","last_became_active":"2024-09-17T01:36:59.879720+0000","last_became_peered":"2024-09-17T01:36:59.879720+0000","last_unstale":"2024-09-17T01:37:01.937544+0000","last_undegraded":"2024-09-17T01:37:01.937544+0000","last_fullsized":"2024-09-17T01:37:01.937544+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:25.120880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872544+0000","last_change":"2024-09-17T01:37:00.882269+0000","last_active":"2024-09-17T01:37:01.872544+0000","last_peered":"2024-09-17T01:37:01.872544+0000","last_clean":"2024-09-17T01:37:01.872544+0000","last_became_active":"2024-09-17T01:37:00.881259+0000","last_became_peered":"2024-09-17T01:37:00.881259+0000","last_unstale":"2024-09-17T01:37:01.872544+0000","last_undegraded":"2024-09-17T01:37:01.872544+0000","last_fullsized":"2024-09-17T01:37:01.872544+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:54.281546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937348+0000","last_change":"2024-09-17T01:36:59.878130+0000","last_active":"2024-09-17T01:37:01.937348+0000","last_peered":"2024-09-17T01:37:01.937348+0000","last_clean":"2024-09-17T01:37:01.937348+0000","last_became_active":"2024-09-17T01:36:59.877688+0000","last_became_peered":"2024-09-17T01:36:59.877688+0000","last_unstale":"2024-09-17T01:37:01.937348+0000","last_undegraded":"2024-09-17T01:37:01.937348+0000","last_fullsized":"2024-09-17T01:37:01.937348+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:31.964182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.939045+0000","last_change":"2024-09-17T01:37:00.879111+0000","last_active":"2024-09-17T01:37:01.939045+0000","last_peered":"2024-09-17T01:37:01.939045+0000","last_clean":"2024-09-17T01:37:01.939045+0000","last_became_active":"2024-09-17T01:37:00.874367+0000","last_became_peered":"2024-09-17T01:37:00.874367+0000","last_unstale":"2024-09-17T01:37:01.939045+0000","last_undegraded":"2024-09-17T01:37:01.939045+0000","last_fullsized":"2024-09-17T01:37:01.939045+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:41.447731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.875113+0000","last_change":"2024-09-17T01:36:59.865304+0000","last_active":"2024-09-17T01:37:01.875113+0000","last_peered":"2024-09-17T01:37:01.875113+0000","last_clean":"2024-09-17T01:37:01.875113+0000","last_became_active":"2024-09-17T01:36:59.862462+0000","last_became_peered":"2024-09-17T01:36:59.862462+0000","last_unstale":"2024-09-17T01:37:01.875113+0000","last_undegraded":"2024-09-17T01:37:01.875113+0000","last_fullsized":"2024-09-17T01:37:01.875113+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:53.210356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871401+0000","last_change":"2024-09-17T01:37:00.881114+0000","last_active":"2024-09-17T01:37:01.871401+0000","last_peered":"2024-09-17T01:37:01.871401+0000","last_clean":"2024-09-17T01:37:01.871401+0000","last_became_active":"2024-09-17T01:37:00.880775+0000","last_became_peered":"2024-09-17T01:37:00.880775+0000","last_unstale":"2024-09-17T01:37:01.871401+0000","last_undegraded":"2024-09-17T01:37:01.871401+0000","last_fullsized":"2024-09-17T01:37:01.871401+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:15.044192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"78'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874869+0000","last_change":"2024-09-17T01:36:59.880330+0000","last_active":"2024-09-17T01:37:01.874869+0000","last_peered":"2024-09-17T01:37:01.874869+0000","last_clean":"2024-09-17T01:37:01.874869+0000","last_became_active":"2024-09-17T01:36:59.878802+0000","last_became_peered":"2024-09-17T01:36:59.878802+0000","last_unstale":"2024-09-17T01:37:01.874869+0000","last_undegraded":"2024-09-17T01:37:01.874869+0000","last_fullsized":"2024-09-17T01:37:01.874869+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:53.286067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938018+0000","last_change":"2024-09-17T01:37:00.872505+0000","last_active":"2024-09-17T01:37:01.938018+0000","last_peered":"2024-09-17T01:37:01.938018+0000","last_clean":"2024-09-17T01:37:01.938018+0000","last_became_active":"2024-09-17T01:37:00.872169+0000","last_became_peered":"2024-09-17T01:37:00.872169+0000","last_unstale":"2024-09-17T01:37:01.938018+0000","last_undegraded":"2024-09-17T01:37:01.938018+0000","last_fullsized":"2024-09-17T01:37:01.938018+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:40.396787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874370+0000","last_change":"2024-09-17T01:36:59.863867+0000","last_active":"2024-09-17T01:37:01.874370+0000","last_peered":"2024-09-17T01:37:01.874370+0000","last_clean":"2024-09-17T01:37:01.874370+0000","last_became_active":"2024-09-17T01:36:59.863517+0000","last_became_peered":"2024-09-17T01:36:59.863517+0000","last_unstale":"2024-09-17T01:37:01.874370+0000","last_undegraded":"2024-09-17T01:37:01.874370+0000","last_fullsized":"2024-09-17T01:37:01.874370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:15.269849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871135+0000","last_change":"2024-09-17T01:37:00.882366+0000","last_active":"2024-09-17T01:37:01.871135+0000","last_peered":"2024-09-17T01:37:01.871135+0000","last_clean":"2024-09-17T01:37:01.871135+0000","last_became_active":"2024-09-17T01:37:00.882086+0000","last_became_peered":"2024-09-17T01:37:00.882086+0000","last_unstale":"2024-09-17T01:37:01.871135+0000","last_undegraded":"2024-09-17T01:37:01.871135+0000","last_fullsized":"2024-09-17T01:37:01.871135+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:55:02.373828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873880+0000","last_change":"2024-09-17T01:36:59.869198+0000","last_active":"2024-09-17T01:37:01.873880+0000","last_peered":"2024-09-17T01:37:01.873880+0000","last_clean":"2024-09-17T01:37:01.873880+0000","last_became_active":"2024-09-17T01:36:59.868898+0000","last_became_peered":"2024-09-17T01:36:59.868898+0000","last_unstale":"2024-09-17T01:37:01.873880+0000","last_undegraded":"2024-09-17T01:37:01.873880+0000","last_fullsized":"2024-09-17T01:37:01.873880+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:12:59.919264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938070+0000","last_change":"2024-09-17T01:37:00.873280+0000","last_active":"2024-09-17T01:37:01.938070+0000","last_peered":"2024-09-17T01:37:01.938070+0000","last_clean":"2024-09-17T01:37:01.938070+0000","last_became_active":"2024-09-17T01:37:00.871566+0000","last_became_peered":"2024-09-17T01:37:00.871566+0000","last_unstale":"2024-09-17T01:37:01.938070+0000","last_undegraded":"2024-09-17T01:37:01.938070+0000","last_fullsized":"2024-09-17T01:37:01.938070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:59.796709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873685+0000","last_change":"2024-09-17T01:36:59.867758+0000","last_active":"2024-09-17T01:37:01.873685+0000","last_peered":"2024-09-17T01:37:01.873685+0000","last_clean":"2024-09-17T01:37:01.873685+0000","last_became_active":"2024-09-17T01:36:59.866985+0000","last_became_peered":"2024-09-17T01:36:59.866985+0000","last_unstale":"2024-09-17T01:37:01.873685+0000","last_undegraded":"2024-09-17T01:37:01.873685+0000","last_fullsized":"2024-09-17T01:37:01.873685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:17.223254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874679+0000","last_change":"2024-09-17T01:37:00.883794+0000","last_active":"2024-09-17T01:37:01.874679+0000","last_peered":"2024-09-17T01:37:01.874679+0000","last_clean":"2024-09-17T01:37:01.874679+0000","last_became_active":"2024-09-17T01:37:00.879349+0000","last_became_peered":"2024-09-17T01:37:00.879349+0000","last_unstale":"2024-09-17T01:37:01.874679+0000","last_undegraded":"2024-09-17T01:37:01.874679+0000","last_fullsized":"2024-09-17T01:37:01.874679+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:05.980183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938206+0000","last_change":"2024-09-17T01:36:59.872585+0000","last_active":"2024-09-17T01:37:01.938206+0000","last_peered":"2024-09-17T01:37:01.938206+0000","last_clean":"2024-09-17T01:37:01.938206+0000","last_became_active":"2024-09-17T01:36:59.870276+0000","last_became_peered":"2024-09-17T01:36:59.870276+0000","last_unstale":"2024-09-17T01:37:01.938206+0000","last_undegraded":"2024-09-17T01:37:01.938206+0000","last_fullsized":"2024-09-17T01:37:01.938206+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:51.670979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873386+0000","last_change":"2024-09-17T01:37:00.884276+0000","last_active":"2024-09-17T01:37:01.873386+0000","last_peered":"2024-09-17T01:37:01.873386+0000","last_clean":"2024-09-17T01:37:01.873386+0000","last_became_active":"2024-09-17T01:37:00.883956+0000","last_became_peered":"2024-09-17T01:37:00.883956+0000","last_unstale":"2024-09-17T01:37:01.873386+0000","last_undegraded":"2024-09-17T01:37:01.873386+0000","last_fullsized":"2024-09-17T01:37:01.873386+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:40.973377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937655+0000","last_change":"2024-09-17T01:36:59.883537+0000","last_active":"2024-09-17T01:37:01.937655+0000","last_peered":"2024-09-17T01:37:01.937655+0000","last_clean":"2024-09-17T01:37:01.937655+0000","last_became_active":"2024-09-17T01:36:59.883207+0000","last_became_peered":"2024-09-17T01:36:59.883207+0000","last_unstale":"2024-09-17T01:37:01.937655+0000","last_undegraded":"2024-09-17T01:37:01.937655+0000","last_fullsized":"2024-09-17T01:37:01.937655+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:59.069079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937976+0000","last_change":"2024-09-17T01:37:00.893414+0000","last_active":"2024-09-17T01:37:01.937976+0000","last_peered":"2024-09-17T01:37:01.937976+0000","last_clean":"2024-09-17T01:37:01.937976+0000","last_became_active":"2024-09-17T01:37:00.893040+0000","last_became_peered":"2024-09-17T01:37:00.893040+0000","last_unstale":"2024-09-17T01:37:01.937976+0000","last_undegraded":"2024-09-17T01:37:01.937976+0000","last_fullsized":"2024-09-17T01:37:01.937976+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:51.081350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T01:36:59.883840+0000","last_change":"2024-09-17T01:36:59.881600+0000","last_active":"2024-09-17T01:36:59.883840+0000","last_peered":"2024-09-17T01:36:59.883840+0000","last_clean":"2024-09-17T01:36:59.883840+0000","last_became_active":"2024-09-17T01:36:59.881167+0000","last_became_peered":"2024-09-17T01:36:59.881167+0000","last_unstale":"2024-09-17T01:36:59.883840+0000","last_undegraded":"2024-09-17T01:36:59.883840+0000","last_fullsized":"2024-09-17T01:36:59.883840+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:38.152666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938334+0000","last_change":"2024-09-17T01:37:00.886106+0000","last_active":"2024-09-17T01:37:01.938334+0000","last_peered":"2024-09-17T01:37:01.938334+0000","last_clean":"2024-09-17T01:37:01.938334+0000","last_became_active":"2024-09-17T01:37:00.879587+0000","last_became_peered":"2024-09-17T01:37:00.879587+0000","last_unstale":"2024-09-17T01:37:01.938334+0000","last_undegraded":"2024-09-17T01:37:01.938334+0000","last_fullsized":"2024-09-17T01:37:01.938334+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:02.658087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870731+0000","last_change":"2024-09-17T01:36:59.873087+0000","last_active":"2024-09-17T01:37:01.870731+0000","last_peered":"2024-09-17T01:37:01.870731+0000","last_clean":"2024-09-17T01:37:01.870731+0000","last_became_active":"2024-09-17T01:36:59.872734+0000","last_became_peered":"2024-09-17T01:36:59.872734+0000","last_unstale":"2024-09-17T01:37:01.870731+0000","last_undegraded":"2024-09-17T01:37:01.870731+0000","last_fullsized":"2024-09-17T01:37:01.870731+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:56:01.555936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":217,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870301+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:37:01.870301+0000","last_peered":"2024-09-17T01:37:01.870301+0000","last_clean":"2024-09-17T01:37:01.870301+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:37:01.870301+0000","last_undegraded":"2024-09-17T01:37:01.870301+0000","last_fullsized":"2024-09-17T01:37:01.870301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476801,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":917504,"data_stored":390175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509505,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40444,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331396,"statfs":{"total":96636764160,"available":96595349504,"internally_reserved":0,"allocated":954368,"data_stored":404862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509504,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40448,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331392,"statfs":{"total":96636764160,"available":96595345408,"internally_reserved":0,"allocated":958464,"data_stored":404896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509505,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44604,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327236,"statfs":{"total":96636764160,"available":96591089664,"internally_reserved":0,"allocated":954368,"data_stored":403944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509505,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":954368,"data_stored":403376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509504,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41012,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330828,"statfs":{"total":96636764160,"available":96594767872,"internally_reserved":0,"allocated":1536000,"data_stored":993618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509506,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36280,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335560,"statfs":{"total":96636764160,"available":96599613440,"internally_reserved":0,"allocated":946176,"data_stored":403320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542210,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41020,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330820,"statfs":{"total":96636764160,"available":96594759680,"internally_reserved":0,"allocated":1540096,"data_stored":993708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:37:05.408 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:37:05.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.639+0000 7f927e400640 1 -- 172.21.15.42:0/812977583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92780d0e10 msgr2=0x7f92780d1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:05.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.639+0000 7f927e400640 1 --2- 172.21.15.42:0/812977583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92780d0e10 0x7f92780d1220 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f92640098e0 tx=0x7f926402a5d0 comp rx=0 tx=0).stop 2024-09-17T01:37:05.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.639+0000 7f927e400640 1 -- 172.21.15.42:0/812977583 shutdown_connections 2024-09-17T01:37:05.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.639+0000 7f927e400640 1 --2- 172.21.15.42:0/812977583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92780d0e10 0x7f92780d1220 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:05.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.639+0000 7f927e400640 1 --2- 172.21.15.42:0/812977583 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92780cfba0 0x7f92780b9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:05.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.639+0000 7f927e400640 1 -- 172.21.15.42:0/812977583 >> 172.21.15.42:0/812977583 conn(0x7f92780b6140 msgr2=0x7f92780b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:05.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.639+0000 7f927e400640 1 -- 172.21.15.42:0/812977583 shutdown_connections 2024-09-17T01:37:05.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.639+0000 7f927e400640 1 -- 172.21.15.42:0/812977583 wait complete. 2024-09-17T01:37:05.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.641+0000 7f927e400640 1 Processor -- start 2024-09-17T01:37:05.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.641+0000 7f927e400640 1 -- start start 2024-09-17T01:37:05.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.643+0000 7f927e400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92780cfba0 0x7f92781f5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:05.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.643+0000 7f927e400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92780d0e10 0x7f92780ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:05.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.643+0000 7f927e400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9278162500 0x7f92780b8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:05.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.643+0000 7f927e400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f92780b31e0 con 0x7f9278162500 2024-09-17T01:37:05.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.643+0000 7f927e400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f92780b3060 con 0x7f92780cfba0 2024-09-17T01:37:05.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.643+0000 7f927e400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f92780b3360 con 0x7f92780d0e10 2024-09-17T01:37:05.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.643+0000 7f927da00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9278162500 0x7f92780b8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:05.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.643+0000 7f9277e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92780d0e10 0x7f92780ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:05.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.643+0000 7f927da00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9278162500 0x7f92780b8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38046/0 (socket says 172.21.15.42:38046) 2024-09-17T01:37:05.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.643+0000 7f927d000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92780cfba0 0x7f92781f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:05.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.643+0000 7f927da00640 1 -- 172.21.15.42:0/61941434 learned_addr learned my addr 172.21.15.42:0/61941434 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:05.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.644+0000 7f927d000640 1 -- 172.21.15.42:0/61941434 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92780d0e10 msgr2=0x7f92780ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:05.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.644+0000 7f927d000640 1 --2- 172.21.15.42:0/61941434 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92780d0e10 0x7f92780ce7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:05.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.644+0000 7f927d000640 1 -- 172.21.15.42:0/61941434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9278162500 msgr2=0x7f92780b8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:05.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.644+0000 7f927d000640 1 --2- 172.21.15.42:0/61941434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9278162500 0x7f92780b8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:05.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.644+0000 7f927d000640 1 -- 172.21.15.42:0/61941434 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92780cbbc0 con 0x7f92780cfba0 2024-09-17T01:37:05.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.644+0000 7f927da00640 1 --2- 172.21.15.42:0/61941434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9278162500 0x7f92780b8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:37:05.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.644+0000 7f927d000640 1 --2- 172.21.15.42:0/61941434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92780cfba0 0x7f92781f5f50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f926c00d680 tx=0x7f926c00db40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:05.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.644+0000 7f9274c00640 1 -- 172.21.15.42:0/61941434 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c017070 con 0x7f92780cfba0 2024-09-17T01:37:05.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.645+0000 7f927e400640 1 -- 172.21.15.42:0/61941434 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92780cbea0 con 0x7f92780cfba0 2024-09-17T01:37:05.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.645+0000 7f9274c00640 1 -- 172.21.15.42:0/61941434 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f926c005310 con 0x7f92780cfba0 2024-09-17T01:37:05.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.645+0000 7f9274c00640 1 -- 172.21.15.42:0/61941434 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c0097c0 con 0x7f92780cfba0 2024-09-17T01:37:05.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.645+0000 7f927e400640 1 -- 172.21.15.42:0/61941434 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92780cc460 con 0x7f92780cfba0 2024-09-17T01:37:05.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.646+0000 7f927e400640 1 -- 172.21.15.42:0/61941434 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92780b3810 con 0x7f92780cfba0 2024-09-17T01:37:05.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.647+0000 7f9274c00640 1 -- 172.21.15.42:0/61941434 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f926c009960 con 0x7f92780cfba0 2024-09-17T01:37:05.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.648+0000 7f9274c00640 1 --2- 172.21.15.42:0/61941434 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9258078bc0 0x7f925807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:05.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.648+0000 7f9274c00640 1 -- 172.21.15.42:0/61941434 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7f926c09b070 con 0x7f92780cfba0 2024-09-17T01:37:05.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.649+0000 7f9277e00640 1 --2- 172.21.15.42:0/61941434 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9258078bc0 0x7f925807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:05.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.649+0000 7f9277e00640 1 --2- 172.21.15.42:0/61941434 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9258078bc0 0x7f925807b0d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9264034000 tx=0x7f9264004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:05.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.652+0000 7f9274c00640 1 -- 172.21.15.42:0/61941434 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f926c062ee0 con 0x7f92780cfba0 2024-09-17T01:37:05.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.846+0000 7f927e400640 1 -- 172.21.15.42:0/61941434 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f92780d1430 con 0x7f9258078bc0 2024-09-17T01:37:05.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.851+0000 7f9274c00640 1 -- 172.21.15.42:0/61941434 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251646 (secure 0 0 0) 0x7f92780d1430 con 0x7f9258078bc0 2024-09-17T01:37:05.852 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:05.853 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:37:05.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.855+0000 7f927e400640 1 -- 172.21.15.42:0/61941434 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9258078bc0 msgr2=0x7f925807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:05.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.855+0000 7f927e400640 1 --2- 172.21.15.42:0/61941434 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9258078bc0 0x7f925807b0d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9264034000 tx=0x7f9264004730 comp rx=0 tx=0).stop 2024-09-17T01:37:05.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.855+0000 7f927e400640 1 -- 172.21.15.42:0/61941434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92780cfba0 msgr2=0x7f92781f5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:05.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.855+0000 7f927e400640 1 --2- 172.21.15.42:0/61941434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92780cfba0 0x7f92781f5f50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f926c00d680 tx=0x7f926c00db40 comp rx=0 tx=0).stop 2024-09-17T01:37:05.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.855+0000 7f927e400640 1 -- 172.21.15.42:0/61941434 shutdown_connections 2024-09-17T01:37:05.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.855+0000 7f927e400640 1 --2- 172.21.15.42:0/61941434 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9258078bc0 0x7f925807b0d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:05.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.855+0000 7f927e400640 1 --2- 172.21.15.42:0/61941434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9278162500 0x7f92780b8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:05.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.855+0000 7f927e400640 1 --2- 172.21.15.42:0/61941434 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f92780d0e10 0x7f92780ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:05.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.855+0000 7f927e400640 1 --2- 172.21.15.42:0/61941434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f92780cfba0 0x7f92781f5f50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:05.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.855+0000 7f927e400640 1 -- 172.21.15.42:0/61941434 >> 172.21.15.42:0/61941434 conn(0x7f92780b6140 msgr2=0x7f927815bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:05.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.855+0000 7f927e400640 1 -- 172.21.15.42:0/61941434 shutdown_connections 2024-09-17T01:37:05.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:05.855+0000 7f927e400640 1 -- 172.21.15.42:0/61941434 wait complete. 2024-09-17T01:37:05.875 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-09-17T01:37:05.062033+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":139,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":299704,"kb_used_data":8556,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754675016,"statfs":{"total":773094113280,"available":772787216384,"internally_reserved":0,"allocated":8761344,"data_stored":4397899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":297913908},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001765"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.875283+0000","last_change":"2024-09-17T01:37:00.894727+0000","last_active":"2024-09-17T01:37:01.875283+0000","last_peered":"2024-09-17T01:37:01.875283+0000","last_clean":"2024-09-17T01:37:01.875283+0000","last_became_active":"2024-09-17T01:37:00.894422+0000","last_became_peered":"2024-09-17T01:37:00.894422+0000","last_unstale":"2024-09-17T01:37:01.875283+0000","last_undegraded":"2024-09-17T01:37:01.875283+0000","last_fullsized":"2024-09-17T01:37:01.875283+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:07.471265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938210+0000","last_change":"2024-09-17T01:37:00.883141+0000","last_active":"2024-09-17T01:37:01.938210+0000","last_peered":"2024-09-17T01:37:01.938210+0000","last_clean":"2024-09-17T01:37:01.938210+0000","last_became_active":"2024-09-17T01:37:00.882588+0000","last_became_peered":"2024-09-17T01:37:00.882588+0000","last_unstale":"2024-09-17T01:37:01.938210+0000","last_undegraded":"2024-09-17T01:37:01.938210+0000","last_fullsized":"2024-09-17T01:37:01.938210+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:37:06.008340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938115+0000","last_change":"2024-09-17T01:37:00.886235+0000","last_active":"2024-09-17T01:37:01.938115+0000","last_peered":"2024-09-17T01:37:01.938115+0000","last_clean":"2024-09-17T01:37:01.938115+0000","last_became_active":"2024-09-17T01:37:00.884395+0000","last_became_peered":"2024-09-17T01:37:00.884395+0000","last_unstale":"2024-09-17T01:37:01.938115+0000","last_undegraded":"2024-09-17T01:37:01.938115+0000","last_fullsized":"2024-09-17T01:37:01.938115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:46.190213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938091+0000","last_change":"2024-09-17T01:37:00.882991+0000","last_active":"2024-09-17T01:37:01.938091+0000","last_peered":"2024-09-17T01:37:01.938091+0000","last_clean":"2024-09-17T01:37:01.938091+0000","last_became_active":"2024-09-17T01:37:00.882627+0000","last_became_peered":"2024-09-17T01:37:00.882627+0000","last_unstale":"2024-09-17T01:37:01.938091+0000","last_undegraded":"2024-09-17T01:37:01.938091+0000","last_fullsized":"2024-09-17T01:37:01.938091+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:18.536668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937768+0000","last_change":"2024-09-17T01:37:00.879118+0000","last_active":"2024-09-17T01:37:01.937768+0000","last_peered":"2024-09-17T01:37:01.937768+0000","last_clean":"2024-09-17T01:37:01.937768+0000","last_became_active":"2024-09-17T01:37:00.878074+0000","last_became_peered":"2024-09-17T01:37:00.878074+0000","last_unstale":"2024-09-17T01:37:01.937768+0000","last_undegraded":"2024-09-17T01:37:01.937768+0000","last_fullsized":"2024-09-17T01:37:01.937768+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:11.586434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2024-09-17T01:36:59.858191+0000","last_change":"2024-09-17T01:36:59.858191+0000","last_active":"2024-09-17T01:36:59.841771+0000","last_peered":"2024-09-17T01:36:59.841771+0000","last_clean":"2024-09-17T01:36:59.841771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:59.858191+0000","last_undegraded":"2024-09-17T01:36:59.858191+0000","last_fullsized":"2024-09-17T01:36:59.858191+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870613+0000","last_change":"2024-09-17T01:37:00.885660+0000","last_active":"2024-09-17T01:37:01.870613+0000","last_peered":"2024-09-17T01:37:01.870613+0000","last_clean":"2024-09-17T01:37:01.870613+0000","last_became_active":"2024-09-17T01:37:00.875481+0000","last_became_peered":"2024-09-17T01:37:00.875481+0000","last_unstale":"2024-09-17T01:37:01.870613+0000","last_undegraded":"2024-09-17T01:37:01.870613+0000","last_fullsized":"2024-09-17T01:37:01.870613+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:54.284586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874358+0000","last_change":"2024-09-17T01:37:00.887879+0000","last_active":"2024-09-17T01:37:01.874358+0000","last_peered":"2024-09-17T01:37:01.874358+0000","last_clean":"2024-09-17T01:37:01.874358+0000","last_became_active":"2024-09-17T01:37:00.886811+0000","last_became_peered":"2024-09-17T01:37:00.886811+0000","last_unstale":"2024-09-17T01:37:01.874358+0000","last_undegraded":"2024-09-17T01:37:01.874358+0000","last_fullsized":"2024-09-17T01:37:01.874358+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:07.671917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938274+0000","last_change":"2024-09-17T01:37:00.880205+0000","last_active":"2024-09-17T01:37:01.938274+0000","last_peered":"2024-09-17T01:37:01.938274+0000","last_clean":"2024-09-17T01:37:01.938274+0000","last_became_active":"2024-09-17T01:37:00.879875+0000","last_became_peered":"2024-09-17T01:37:00.879875+0000","last_unstale":"2024-09-17T01:37:01.938274+0000","last_undegraded":"2024-09-17T01:37:01.938274+0000","last_fullsized":"2024-09-17T01:37:01.938274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:26.752484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871291+0000","last_change":"2024-09-17T01:37:00.874744+0000","last_active":"2024-09-17T01:37:01.871291+0000","last_peered":"2024-09-17T01:37:01.871291+0000","last_clean":"2024-09-17T01:37:01.871291+0000","last_became_active":"2024-09-17T01:37:00.872129+0000","last_became_peered":"2024-09-17T01:37:00.872129+0000","last_unstale":"2024-09-17T01:37:01.871291+0000","last_undegraded":"2024-09-17T01:37:01.871291+0000","last_fullsized":"2024-09-17T01:37:01.871291+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:40.026790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.875017+0000","last_change":"2024-09-17T01:37:00.886368+0000","last_active":"2024-09-17T01:37:01.875017+0000","last_peered":"2024-09-17T01:37:01.875017+0000","last_clean":"2024-09-17T01:37:01.875017+0000","last_became_active":"2024-09-17T01:37:00.886042+0000","last_became_peered":"2024-09-17T01:37:00.886042+0000","last_unstale":"2024-09-17T01:37:01.875017+0000","last_undegraded":"2024-09-17T01:37:01.875017+0000","last_fullsized":"2024-09-17T01:37:01.875017+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:51.174176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874503+0000","last_change":"2024-09-17T01:37:00.878779+0000","last_active":"2024-09-17T01:37:01.874503+0000","last_peered":"2024-09-17T01:37:01.874503+0000","last_clean":"2024-09-17T01:37:01.874503+0000","last_became_active":"2024-09-17T01:37:00.878431+0000","last_became_peered":"2024-09-17T01:37:00.878431+0000","last_unstale":"2024-09-17T01:37:01.874503+0000","last_undegraded":"2024-09-17T01:37:01.874503+0000","last_fullsized":"2024-09-17T01:37:01.874503+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:54.289027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937788+0000","last_change":"2024-09-17T01:37:00.883220+0000","last_active":"2024-09-17T01:37:01.937788+0000","last_peered":"2024-09-17T01:37:01.937788+0000","last_clean":"2024-09-17T01:37:01.937788+0000","last_became_active":"2024-09-17T01:37:00.882923+0000","last_became_peered":"2024-09-17T01:37:00.882923+0000","last_unstale":"2024-09-17T01:37:01.937788+0000","last_undegraded":"2024-09-17T01:37:01.937788+0000","last_fullsized":"2024-09-17T01:37:01.937788+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:48.939780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872570+0000","last_change":"2024-09-17T01:37:00.883960+0000","last_active":"2024-09-17T01:37:01.872570+0000","last_peered":"2024-09-17T01:37:01.872570+0000","last_clean":"2024-09-17T01:37:01.872570+0000","last_became_active":"2024-09-17T01:37:00.883650+0000","last_became_peered":"2024-09-17T01:37:00.883650+0000","last_unstale":"2024-09-17T01:37:01.872570+0000","last_undegraded":"2024-09-17T01:37:01.872570+0000","last_fullsized":"2024-09-17T01:37:01.872570+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:50:00.925352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872236+0000","last_change":"2024-09-17T01:37:00.874456+0000","last_active":"2024-09-17T01:37:01.872236+0000","last_peered":"2024-09-17T01:37:01.872236+0000","last_clean":"2024-09-17T01:37:01.872236+0000","last_became_active":"2024-09-17T01:37:00.870867+0000","last_became_peered":"2024-09-17T01:37:00.870867+0000","last_unstale":"2024-09-17T01:37:01.872236+0000","last_undegraded":"2024-09-17T01:37:01.872236+0000","last_fullsized":"2024-09-17T01:37:01.872236+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:15:29.982832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874345+0000","last_change":"2024-09-17T01:37:00.893408+0000","last_active":"2024-09-17T01:37:01.874345+0000","last_peered":"2024-09-17T01:37:01.874345+0000","last_clean":"2024-09-17T01:37:01.874345+0000","last_became_active":"2024-09-17T01:37:00.887416+0000","last_became_peered":"2024-09-17T01:37:00.887416+0000","last_unstale":"2024-09-17T01:37:01.874345+0000","last_undegraded":"2024-09-17T01:37:01.874345+0000","last_fullsized":"2024-09-17T01:37:01.874345+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:22.689477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938992+0000","last_change":"2024-09-17T01:37:00.872192+0000","last_active":"2024-09-17T01:37:01.938992+0000","last_peered":"2024-09-17T01:37:01.938992+0000","last_clean":"2024-09-17T01:37:01.938992+0000","last_became_active":"2024-09-17T01:37:00.871809+0000","last_became_peered":"2024-09-17T01:37:00.871809+0000","last_unstale":"2024-09-17T01:37:01.938992+0000","last_undegraded":"2024-09-17T01:37:01.938992+0000","last_fullsized":"2024-09-17T01:37:01.938992+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:55.876836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938793+0000","last_change":"2024-09-17T01:37:00.866290+0000","last_active":"2024-09-17T01:37:01.938793+0000","last_peered":"2024-09-17T01:37:01.938793+0000","last_clean":"2024-09-17T01:37:01.938793+0000","last_became_active":"2024-09-17T01:37:00.865874+0000","last_became_peered":"2024-09-17T01:37:00.865874+0000","last_unstale":"2024-09-17T01:37:01.938793+0000","last_undegraded":"2024-09-17T01:37:01.938793+0000","last_fullsized":"2024-09-17T01:37:01.938793+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:38.896993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874806+0000","last_change":"2024-09-17T01:37:00.897310+0000","last_active":"2024-09-17T01:37:01.874806+0000","last_peered":"2024-09-17T01:37:01.874806+0000","last_clean":"2024-09-17T01:37:01.874806+0000","last_became_active":"2024-09-17T01:37:00.896955+0000","last_became_peered":"2024-09-17T01:37:00.896955+0000","last_unstale":"2024-09-17T01:37:01.874806+0000","last_undegraded":"2024-09-17T01:37:01.874806+0000","last_fullsized":"2024-09-17T01:37:01.874806+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:04:01.328671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938592+0000","last_change":"2024-09-17T01:37:00.866925+0000","last_active":"2024-09-17T01:37:01.938592+0000","last_peered":"2024-09-17T01:37:01.938592+0000","last_clean":"2024-09-17T01:37:01.938592+0000","last_became_active":"2024-09-17T01:37:00.866542+0000","last_became_peered":"2024-09-17T01:37:00.866542+0000","last_unstale":"2024-09-17T01:37:01.938592+0000","last_undegraded":"2024-09-17T01:37:01.938592+0000","last_fullsized":"2024-09-17T01:37:01.938592+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:36.164907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937799+0000","last_change":"2024-09-17T01:37:00.874085+0000","last_active":"2024-09-17T01:37:01.937799+0000","last_peered":"2024-09-17T01:37:01.937799+0000","last_clean":"2024-09-17T01:37:01.937799+0000","last_became_active":"2024-09-17T01:37:00.873522+0000","last_became_peered":"2024-09-17T01:37:00.873522+0000","last_unstale":"2024-09-17T01:37:01.937799+0000","last_undegraded":"2024-09-17T01:37:01.937799+0000","last_fullsized":"2024-09-17T01:37:01.937799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:16.272810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2024-09-17T01:36:59.857702+0000","last_change":"2024-09-17T01:36:59.857702+0000","last_active":"2024-09-17T01:36:59.841771+0000","last_peered":"2024-09-17T01:36:59.841771+0000","last_clean":"2024-09-17T01:36:59.841771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:59.857702+0000","last_undegraded":"2024-09-17T01:36:59.857702+0000","last_fullsized":"2024-09-17T01:36:59.857702+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870493+0000","last_change":"2024-09-17T01:37:00.886408+0000","last_active":"2024-09-17T01:37:01.870493+0000","last_peered":"2024-09-17T01:37:01.870493+0000","last_clean":"2024-09-17T01:37:01.870493+0000","last_became_active":"2024-09-17T01:37:00.886111+0000","last_became_peered":"2024-09-17T01:37:00.886111+0000","last_unstale":"2024-09-17T01:37:01.870493+0000","last_undegraded":"2024-09-17T01:37:01.870493+0000","last_fullsized":"2024-09-17T01:37:01.870493+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:10.335496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874607+0000","last_change":"2024-09-17T01:37:00.874639+0000","last_active":"2024-09-17T01:37:01.874607+0000","last_peered":"2024-09-17T01:37:01.874607+0000","last_clean":"2024-09-17T01:37:01.874607+0000","last_became_active":"2024-09-17T01:37:00.874352+0000","last_became_peered":"2024-09-17T01:37:00.874352+0000","last_unstale":"2024-09-17T01:37:01.874607+0000","last_undegraded":"2024-09-17T01:37:01.874607+0000","last_fullsized":"2024-09-17T01:37:01.874607+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:56.583515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871375+0000","last_change":"2024-09-17T01:37:00.881981+0000","last_active":"2024-09-17T01:37:01.871375+0000","last_peered":"2024-09-17T01:37:01.871375+0000","last_clean":"2024-09-17T01:37:01.871375+0000","last_became_active":"2024-09-17T01:37:00.881639+0000","last_became_peered":"2024-09-17T01:37:00.881639+0000","last_unstale":"2024-09-17T01:37:01.871375+0000","last_undegraded":"2024-09-17T01:37:01.871375+0000","last_fullsized":"2024-09-17T01:37:01.871375+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:58.500831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874725+0000","last_change":"2024-09-17T01:37:00.895616+0000","last_active":"2024-09-17T01:37:01.874725+0000","last_peered":"2024-09-17T01:37:01.874725+0000","last_clean":"2024-09-17T01:37:01.874725+0000","last_became_active":"2024-09-17T01:37:00.895306+0000","last_became_peered":"2024-09-17T01:37:00.895306+0000","last_unstale":"2024-09-17T01:37:01.874725+0000","last_undegraded":"2024-09-17T01:37:01.874725+0000","last_fullsized":"2024-09-17T01:37:01.874725+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:33.147682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938197+0000","last_change":"2024-09-17T01:37:00.883738+0000","last_active":"2024-09-17T01:37:01.938197+0000","last_peered":"2024-09-17T01:37:01.938197+0000","last_clean":"2024-09-17T01:37:01.938197+0000","last_became_active":"2024-09-17T01:37:00.883028+0000","last_became_peered":"2024-09-17T01:37:00.883028+0000","last_unstale":"2024-09-17T01:37:01.938197+0000","last_undegraded":"2024-09-17T01:37:01.938197+0000","last_fullsized":"2024-09-17T01:37:01.938197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:50:15.638098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937702+0000","last_change":"2024-09-17T01:37:00.875084+0000","last_active":"2024-09-17T01:37:01.937702+0000","last_peered":"2024-09-17T01:37:01.937702+0000","last_clean":"2024-09-17T01:37:01.937702+0000","last_became_active":"2024-09-17T01:37:00.873935+0000","last_became_peered":"2024-09-17T01:37:00.873935+0000","last_unstale":"2024-09-17T01:37:01.937702+0000","last_undegraded":"2024-09-17T01:37:01.937702+0000","last_fullsized":"2024-09-17T01:37:01.937702+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:49.735347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937846+0000","last_change":"2024-09-17T01:37:00.881622+0000","last_active":"2024-09-17T01:37:01.937846+0000","last_peered":"2024-09-17T01:37:01.937846+0000","last_clean":"2024-09-17T01:37:01.937846+0000","last_became_active":"2024-09-17T01:37:00.880763+0000","last_became_peered":"2024-09-17T01:37:00.880763+0000","last_unstale":"2024-09-17T01:37:01.937846+0000","last_undegraded":"2024-09-17T01:37:01.937846+0000","last_fullsized":"2024-09-17T01:37:01.937846+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:38.263600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874922+0000","last_change":"2024-09-17T01:37:00.895593+0000","last_active":"2024-09-17T01:37:01.874922+0000","last_peered":"2024-09-17T01:37:01.874922+0000","last_clean":"2024-09-17T01:37:01.874922+0000","last_became_active":"2024-09-17T01:37:00.895223+0000","last_became_peered":"2024-09-17T01:37:00.895223+0000","last_unstale":"2024-09-17T01:37:01.874922+0000","last_undegraded":"2024-09-17T01:37:01.874922+0000","last_fullsized":"2024-09-17T01:37:01.874922+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:27.587846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937475+0000","last_change":"2024-09-17T01:37:00.877026+0000","last_active":"2024-09-17T01:37:01.937475+0000","last_peered":"2024-09-17T01:37:01.937475+0000","last_clean":"2024-09-17T01:37:01.937475+0000","last_became_active":"2024-09-17T01:37:00.876085+0000","last_became_peered":"2024-09-17T01:37:00.876085+0000","last_unstale":"2024-09-17T01:37:01.937475+0000","last_undegraded":"2024-09-17T01:37:01.937475+0000","last_fullsized":"2024-09-17T01:37:01.937475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:30.108084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937154+0000","last_change":"2024-09-17T01:37:00.873456+0000","last_active":"2024-09-17T01:37:01.937154+0000","last_peered":"2024-09-17T01:37:01.937154+0000","last_clean":"2024-09-17T01:37:01.937154+0000","last_became_active":"2024-09-17T01:37:00.873158+0000","last_became_peered":"2024-09-17T01:37:00.873158+0000","last_unstale":"2024-09-17T01:37:01.937154+0000","last_undegraded":"2024-09-17T01:37:01.937154+0000","last_fullsized":"2024-09-17T01:37:01.937154+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:57:26.714304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.875006+0000","last_change":"2024-09-17T01:37:00.881273+0000","last_active":"2024-09-17T01:37:01.875006+0000","last_peered":"2024-09-17T01:37:01.875006+0000","last_clean":"2024-09-17T01:37:01.875006+0000","last_became_active":"2024-09-17T01:37:00.880964+0000","last_became_peered":"2024-09-17T01:37:00.880964+0000","last_unstale":"2024-09-17T01:37:01.875006+0000","last_undegraded":"2024-09-17T01:37:01.875006+0000","last_fullsized":"2024-09-17T01:37:01.875006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.293605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T01:36:59.869549+0000","last_change":"2024-09-17T01:36:59.865695+0000","last_active":"2024-09-17T01:36:59.869549+0000","last_peered":"2024-09-17T01:36:59.869549+0000","last_clean":"2024-09-17T01:36:59.869549+0000","last_became_active":"2024-09-17T01:36:59.865350+0000","last_became_peered":"2024-09-17T01:36:59.865350+0000","last_unstale":"2024-09-17T01:36:59.869549+0000","last_undegraded":"2024-09-17T01:36:59.869549+0000","last_fullsized":"2024-09-17T01:36:59.869549+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:58.866475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938662+0000","last_change":"2024-09-17T01:37:00.877472+0000","last_active":"2024-09-17T01:37:01.938662+0000","last_peered":"2024-09-17T01:37:01.938662+0000","last_clean":"2024-09-17T01:37:01.938662+0000","last_became_active":"2024-09-17T01:37:00.876758+0000","last_became_peered":"2024-09-17T01:37:00.876758+0000","last_unstale":"2024-09-17T01:37:01.938662+0000","last_undegraded":"2024-09-17T01:37:01.938662+0000","last_fullsized":"2024-09-17T01:37:01.938662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:14.801586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.939126+0000","last_change":"2024-09-17T01:36:59.876074+0000","last_active":"2024-09-17T01:37:01.939126+0000","last_peered":"2024-09-17T01:37:01.939126+0000","last_clean":"2024-09-17T01:37:01.939126+0000","last_became_active":"2024-09-17T01:36:59.875702+0000","last_became_peered":"2024-09-17T01:36:59.875702+0000","last_unstale":"2024-09-17T01:37:01.939126+0000","last_undegraded":"2024-09-17T01:37:01.939126+0000","last_fullsized":"2024-09-17T01:37:01.939126+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:54.024362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2024-09-17T01:36:59.859334+0000","last_change":"2024-09-17T01:36:59.859334+0000","last_active":"2024-09-17T01:36:59.841771+0000","last_peered":"2024-09-17T01:36:59.841771+0000","last_clean":"2024-09-17T01:36:59.841771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:59.859334+0000","last_undegraded":"2024-09-17T01:36:59.859334+0000","last_fullsized":"2024-09-17T01:36:59.859334+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874879+0000","last_change":"2024-09-17T01:36:59.867428+0000","last_active":"2024-09-17T01:37:01.874879+0000","last_peered":"2024-09-17T01:37:01.874879+0000","last_clean":"2024-09-17T01:37:01.874879+0000","last_became_active":"2024-09-17T01:36:59.867059+0000","last_became_peered":"2024-09-17T01:36:59.867059+0000","last_unstale":"2024-09-17T01:37:01.874879+0000","last_undegraded":"2024-09-17T01:37:01.874879+0000","last_fullsized":"2024-09-17T01:37:01.874879+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:28.659364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871406+0000","last_change":"2024-09-17T01:37:00.883835+0000","last_active":"2024-09-17T01:37:01.871406+0000","last_peered":"2024-09-17T01:37:01.871406+0000","last_clean":"2024-09-17T01:37:01.871406+0000","last_became_active":"2024-09-17T01:37:00.883481+0000","last_became_peered":"2024-09-17T01:37:00.883481+0000","last_unstale":"2024-09-17T01:37:01.871406+0000","last_undegraded":"2024-09-17T01:37:01.871406+0000","last_fullsized":"2024-09-17T01:37:01.871406+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:31.009628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T01:36:59.877691+0000","last_change":"2024-09-17T01:36:59.868151+0000","last_active":"2024-09-17T01:36:59.877691+0000","last_peered":"2024-09-17T01:36:59.877691+0000","last_clean":"2024-09-17T01:36:59.877691+0000","last_became_active":"2024-09-17T01:36:59.867665+0000","last_became_peered":"2024-09-17T01:36:59.867665+0000","last_unstale":"2024-09-17T01:36:59.877691+0000","last_undegraded":"2024-09-17T01:36:59.877691+0000","last_fullsized":"2024-09-17T01:36:59.877691+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:12.137272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874435+0000","last_change":"2024-09-17T01:37:00.885316+0000","last_active":"2024-09-17T01:37:01.874435+0000","last_peered":"2024-09-17T01:37:01.874435+0000","last_clean":"2024-09-17T01:37:01.874435+0000","last_became_active":"2024-09-17T01:37:00.885035+0000","last_became_peered":"2024-09-17T01:37:00.885035+0000","last_unstale":"2024-09-17T01:37:01.874435+0000","last_undegraded":"2024-09-17T01:37:01.874435+0000","last_fullsized":"2024-09-17T01:37:01.874435+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:24.483354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873515+0000","last_change":"2024-09-17T01:36:59.868131+0000","last_active":"2024-09-17T01:37:01.873515+0000","last_peered":"2024-09-17T01:37:01.873515+0000","last_clean":"2024-09-17T01:37:01.873515+0000","last_became_active":"2024-09-17T01:36:59.867405+0000","last_became_peered":"2024-09-17T01:36:59.867405+0000","last_unstale":"2024-09-17T01:37:01.873515+0000","last_undegraded":"2024-09-17T01:37:01.873515+0000","last_fullsized":"2024-09-17T01:37:01.873515+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:49.866246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2024-09-17T01:36:59.856709+0000","last_change":"2024-09-17T01:36:59.856709+0000","last_active":"2024-09-17T01:36:59.841771+0000","last_peered":"2024-09-17T01:36:59.841771+0000","last_clean":"2024-09-17T01:36:59.841771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:59.856709+0000","last_undegraded":"2024-09-17T01:36:59.856709+0000","last_fullsized":"2024-09-17T01:36:59.856709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870354+0000","last_change":"2024-09-17T01:36:59.879850+0000","last_active":"2024-09-17T01:37:01.870354+0000","last_peered":"2024-09-17T01:37:01.870354+0000","last_clean":"2024-09-17T01:37:01.870354+0000","last_became_active":"2024-09-17T01:36:59.879463+0000","last_became_peered":"2024-09-17T01:36:59.879463+0000","last_unstale":"2024-09-17T01:37:01.870354+0000","last_undegraded":"2024-09-17T01:37:01.870354+0000","last_fullsized":"2024-09-17T01:37:01.870354+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:26:09.389012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872260+0000","last_change":"2024-09-17T01:37:00.868009+0000","last_active":"2024-09-17T01:37:01.872260+0000","last_peered":"2024-09-17T01:37:01.872260+0000","last_clean":"2024-09-17T01:37:01.872260+0000","last_became_active":"2024-09-17T01:37:00.867635+0000","last_became_peered":"2024-09-17T01:37:00.867635+0000","last_unstale":"2024-09-17T01:37:01.872260+0000","last_undegraded":"2024-09-17T01:37:01.872260+0000","last_fullsized":"2024-09-17T01:37:01.872260+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:37.440870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872881+0000","last_change":"2024-09-17T01:36:59.871995+0000","last_active":"2024-09-17T01:37:01.872881+0000","last_peered":"2024-09-17T01:37:01.872881+0000","last_clean":"2024-09-17T01:37:01.872881+0000","last_became_active":"2024-09-17T01:36:59.871288+0000","last_became_peered":"2024-09-17T01:36:59.871288+0000","last_unstale":"2024-09-17T01:37:01.872881+0000","last_undegraded":"2024-09-17T01:37:01.872881+0000","last_fullsized":"2024-09-17T01:37:01.872881+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:22.962787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872280+0000","last_change":"2024-09-17T01:37:00.892376+0000","last_active":"2024-09-17T01:37:01.872280+0000","last_peered":"2024-09-17T01:37:01.872280+0000","last_clean":"2024-09-17T01:37:01.872280+0000","last_became_active":"2024-09-17T01:37:00.891949+0000","last_became_peered":"2024-09-17T01:37:00.891949+0000","last_unstale":"2024-09-17T01:37:01.872280+0000","last_undegraded":"2024-09-17T01:37:01.872280+0000","last_fullsized":"2024-09-17T01:37:01.872280+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:00.313691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871905+0000","last_change":"2024-09-17T01:36:59.866044+0000","last_active":"2024-09-17T01:37:01.871905+0000","last_peered":"2024-09-17T01:37:01.871905+0000","last_clean":"2024-09-17T01:37:01.871905+0000","last_became_active":"2024-09-17T01:36:59.865721+0000","last_became_peered":"2024-09-17T01:36:59.865721+0000","last_unstale":"2024-09-17T01:37:01.871905+0000","last_undegraded":"2024-09-17T01:37:01.871905+0000","last_fullsized":"2024-09-17T01:37:01.871905+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:54.305186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871343+0000","last_change":"2024-09-17T01:37:00.881635+0000","last_active":"2024-09-17T01:37:01.871343+0000","last_peered":"2024-09-17T01:37:01.871343+0000","last_clean":"2024-09-17T01:37:01.871343+0000","last_became_active":"2024-09-17T01:37:00.881315+0000","last_became_peered":"2024-09-17T01:37:00.881315+0000","last_unstale":"2024-09-17T01:37:01.871343+0000","last_undegraded":"2024-09-17T01:37:01.871343+0000","last_fullsized":"2024-09-17T01:37:01.871343+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:44.751005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874740+0000","last_change":"2024-09-17T01:36:59.872074+0000","last_active":"2024-09-17T01:37:01.874740+0000","last_peered":"2024-09-17T01:37:01.874740+0000","last_clean":"2024-09-17T01:37:01.874740+0000","last_became_active":"2024-09-17T01:36:59.871674+0000","last_became_peered":"2024-09-17T01:36:59.871674+0000","last_unstale":"2024-09-17T01:37:01.874740+0000","last_undegraded":"2024-09-17T01:37:01.874740+0000","last_fullsized":"2024-09-17T01:37:01.874740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:05.955545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938478+0000","last_change":"2024-09-17T01:37:00.885008+0000","last_active":"2024-09-17T01:37:01.938478+0000","last_peered":"2024-09-17T01:37:01.938478+0000","last_clean":"2024-09-17T01:37:01.938478+0000","last_became_active":"2024-09-17T01:37:00.884389+0000","last_became_peered":"2024-09-17T01:37:00.884389+0000","last_unstale":"2024-09-17T01:37:01.938478+0000","last_undegraded":"2024-09-17T01:37:01.938478+0000","last_fullsized":"2024-09-17T01:37:01.938478+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:41.769359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938290+0000","last_change":"2024-09-17T01:36:59.878360+0000","last_active":"2024-09-17T01:37:01.938290+0000","last_peered":"2024-09-17T01:37:01.938290+0000","last_clean":"2024-09-17T01:37:01.938290+0000","last_became_active":"2024-09-17T01:36:59.878062+0000","last_became_peered":"2024-09-17T01:36:59.878062+0000","last_unstale":"2024-09-17T01:37:01.938290+0000","last_undegraded":"2024-09-17T01:37:01.938290+0000","last_fullsized":"2024-09-17T01:37:01.938290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:33.686940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874641+0000","last_change":"2024-09-17T01:37:00.894146+0000","last_active":"2024-09-17T01:37:01.874641+0000","last_peered":"2024-09-17T01:37:01.874641+0000","last_clean":"2024-09-17T01:37:01.874641+0000","last_became_active":"2024-09-17T01:37:00.893851+0000","last_became_peered":"2024-09-17T01:37:00.893851+0000","last_unstale":"2024-09-17T01:37:01.874641+0000","last_undegraded":"2024-09-17T01:37:01.874641+0000","last_fullsized":"2024-09-17T01:37:01.874641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:40.958493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"77'3","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874260+0000","last_change":"2024-09-17T01:36:59.870792+0000","last_active":"2024-09-17T01:37:01.874260+0000","last_peered":"2024-09-17T01:37:01.874260+0000","last_clean":"2024-09-17T01:37:01.874260+0000","last_became_active":"2024-09-17T01:36:59.870465+0000","last_became_peered":"2024-09-17T01:36:59.870465+0000","last_unstale":"2024-09-17T01:37:01.874260+0000","last_undegraded":"2024-09-17T01:37:01.874260+0000","last_fullsized":"2024-09-17T01:37:01.874260+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:48.732387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938477+0000","last_change":"2024-09-17T01:37:00.883131+0000","last_active":"2024-09-17T01:37:01.938477+0000","last_peered":"2024-09-17T01:37:01.938477+0000","last_clean":"2024-09-17T01:37:01.938477+0000","last_became_active":"2024-09-17T01:37:00.874476+0000","last_became_peered":"2024-09-17T01:37:00.874476+0000","last_unstale":"2024-09-17T01:37:01.938477+0000","last_undegraded":"2024-09-17T01:37:01.938477+0000","last_fullsized":"2024-09-17T01:37:01.938477+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:55.258607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"77'6","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873687+0000","last_change":"2024-09-17T01:36:59.867187+0000","last_active":"2024-09-17T01:37:01.873687+0000","last_peered":"2024-09-17T01:37:01.873687+0000","last_clean":"2024-09-17T01:37:01.873687+0000","last_became_active":"2024-09-17T01:36:59.866667+0000","last_became_peered":"2024-09-17T01:36:59.866667+0000","last_unstale":"2024-09-17T01:37:01.873687+0000","last_undegraded":"2024-09-17T01:37:01.873687+0000","last_fullsized":"2024-09-17T01:37:01.873687+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:51:46.620956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2024-09-17T01:36:59.856803+0000","last_change":"2024-09-17T01:36:59.856803+0000","last_active":"2024-09-17T01:36:59.841771+0000","last_peered":"2024-09-17T01:36:59.841771+0000","last_clean":"2024-09-17T01:36:59.841771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:59.856803+0000","last_undegraded":"2024-09-17T01:36:59.856803+0000","last_fullsized":"2024-09-17T01:36:59.856803+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873248+0000","last_change":"2024-09-17T01:36:59.877119+0000","last_active":"2024-09-17T01:37:01.873248+0000","last_peered":"2024-09-17T01:37:01.873248+0000","last_clean":"2024-09-17T01:37:01.873248+0000","last_became_active":"2024-09-17T01:36:59.876620+0000","last_became_peered":"2024-09-17T01:36:59.876620+0000","last_unstale":"2024-09-17T01:37:01.873248+0000","last_undegraded":"2024-09-17T01:37:01.873248+0000","last_fullsized":"2024-09-17T01:37:01.873248+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:33.686940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870866+0000","last_change":"2024-09-17T01:37:00.878599+0000","last_active":"2024-09-17T01:37:01.870866+0000","last_peered":"2024-09-17T01:37:01.870866+0000","last_clean":"2024-09-17T01:37:01.870866+0000","last_became_active":"2024-09-17T01:37:00.878274+0000","last_became_peered":"2024-09-17T01:37:00.878274+0000","last_unstale":"2024-09-17T01:37:01.870866+0000","last_undegraded":"2024-09-17T01:37:01.870866+0000","last_fullsized":"2024-09-17T01:37:01.870866+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:51.128375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870403+0000","last_change":"2024-09-17T01:36:59.876949+0000","last_active":"2024-09-17T01:37:01.870403+0000","last_peered":"2024-09-17T01:37:01.870403+0000","last_clean":"2024-09-17T01:37:01.870403+0000","last_became_active":"2024-09-17T01:36:59.876378+0000","last_became_peered":"2024-09-17T01:36:59.876378+0000","last_unstale":"2024-09-17T01:37:01.870403+0000","last_undegraded":"2024-09-17T01:37:01.870403+0000","last_fullsized":"2024-09-17T01:37:01.870403+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:49.485267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937617+0000","last_change":"2024-09-17T01:37:00.866971+0000","last_active":"2024-09-17T01:37:01.937617+0000","last_peered":"2024-09-17T01:37:01.937617+0000","last_clean":"2024-09-17T01:37:01.937617+0000","last_became_active":"2024-09-17T01:37:00.866631+0000","last_became_peered":"2024-09-17T01:37:00.866631+0000","last_unstale":"2024-09-17T01:37:01.937617+0000","last_undegraded":"2024-09-17T01:37:01.937617+0000","last_fullsized":"2024-09-17T01:37:01.937617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:41.130454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870561+0000","last_change":"2024-09-17T01:36:59.870560+0000","last_active":"2024-09-17T01:37:01.870561+0000","last_peered":"2024-09-17T01:37:01.870561+0000","last_clean":"2024-09-17T01:37:01.870561+0000","last_became_active":"2024-09-17T01:36:59.870147+0000","last_became_peered":"2024-09-17T01:36:59.870147+0000","last_unstale":"2024-09-17T01:37:01.870561+0000","last_undegraded":"2024-09-17T01:37:01.870561+0000","last_fullsized":"2024-09-17T01:37:01.870561+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:15.252189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937540+0000","last_change":"2024-09-17T01:37:00.879444+0000","last_active":"2024-09-17T01:37:01.937540+0000","last_peered":"2024-09-17T01:37:01.937540+0000","last_clean":"2024-09-17T01:37:01.937540+0000","last_became_active":"2024-09-17T01:37:00.877381+0000","last_became_peered":"2024-09-17T01:37:00.877381+0000","last_unstale":"2024-09-17T01:37:01.937540+0000","last_undegraded":"2024-09-17T01:37:01.937540+0000","last_fullsized":"2024-09-17T01:37:01.937540+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:24.841003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"77'8","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870188+0000","last_change":"2024-09-17T01:36:59.872221+0000","last_active":"2024-09-17T01:37:01.870188+0000","last_peered":"2024-09-17T01:37:01.870188+0000","last_clean":"2024-09-17T01:37:01.870188+0000","last_became_active":"2024-09-17T01:36:59.871924+0000","last_became_peered":"2024-09-17T01:36:59.871924+0000","last_unstale":"2024-09-17T01:37:01.870188+0000","last_undegraded":"2024-09-17T01:37:01.870188+0000","last_fullsized":"2024-09-17T01:37:01.870188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:26.403466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938258+0000","last_change":"2024-09-17T01:37:00.877693+0000","last_active":"2024-09-17T01:37:01.938258+0000","last_peered":"2024-09-17T01:37:01.938258+0000","last_clean":"2024-09-17T01:37:01.938258+0000","last_became_active":"2024-09-17T01:37:00.877386+0000","last_became_peered":"2024-09-17T01:37:00.877386+0000","last_unstale":"2024-09-17T01:37:01.938258+0000","last_undegraded":"2024-09-17T01:37:01.938258+0000","last_fullsized":"2024-09-17T01:37:01.938258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:14.659829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874878+0000","last_change":"2024-09-17T01:36:59.864804+0000","last_active":"2024-09-17T01:37:01.874878+0000","last_peered":"2024-09-17T01:37:01.874878+0000","last_clean":"2024-09-17T01:37:01.874878+0000","last_became_active":"2024-09-17T01:36:59.863708+0000","last_became_peered":"2024-09-17T01:36:59.863708+0000","last_unstale":"2024-09-17T01:37:01.874878+0000","last_undegraded":"2024-09-17T01:37:01.874878+0000","last_fullsized":"2024-09-17T01:37:01.874878+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:50.272122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938528+0000","last_change":"2024-09-17T01:37:00.881962+0000","last_active":"2024-09-17T01:37:01.938528+0000","last_peered":"2024-09-17T01:37:01.938528+0000","last_clean":"2024-09-17T01:37:01.938528+0000","last_became_active":"2024-09-17T01:37:00.881348+0000","last_became_peered":"2024-09-17T01:37:00.881348+0000","last_unstale":"2024-09-17T01:37:01.938528+0000","last_undegraded":"2024-09-17T01:37:01.938528+0000","last_fullsized":"2024-09-17T01:37:01.938528+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:51.607996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938307+0000","last_change":"2024-09-17T01:36:59.882677+0000","last_active":"2024-09-17T01:37:01.938307+0000","last_peered":"2024-09-17T01:37:01.938307+0000","last_clean":"2024-09-17T01:37:01.938307+0000","last_became_active":"2024-09-17T01:36:59.882324+0000","last_became_peered":"2024-09-17T01:36:59.882324+0000","last_unstale":"2024-09-17T01:37:01.938307+0000","last_undegraded":"2024-09-17T01:37:01.938307+0000","last_fullsized":"2024-09-17T01:37:01.938307+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:25.084810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938669+0000","last_change":"2024-09-17T01:37:00.881768+0000","last_active":"2024-09-17T01:37:01.938669+0000","last_peered":"2024-09-17T01:37:01.938669+0000","last_clean":"2024-09-17T01:37:01.938669+0000","last_became_active":"2024-09-17T01:37:00.880039+0000","last_became_peered":"2024-09-17T01:37:00.880039+0000","last_unstale":"2024-09-17T01:37:01.938669+0000","last_undegraded":"2024-09-17T01:37:01.938669+0000","last_fullsized":"2024-09-17T01:37:01.938669+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:19.860512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937401+0000","last_change":"2024-09-17T01:36:59.880681+0000","last_active":"2024-09-17T01:37:01.937401+0000","last_peered":"2024-09-17T01:37:01.937401+0000","last_clean":"2024-09-17T01:37:01.937401+0000","last_became_active":"2024-09-17T01:36:59.880368+0000","last_became_peered":"2024-09-17T01:36:59.880368+0000","last_unstale":"2024-09-17T01:37:01.937401+0000","last_undegraded":"2024-09-17T01:37:01.937401+0000","last_fullsized":"2024-09-17T01:37:01.937401+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:23.768788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938247+0000","last_change":"2024-09-17T01:37:00.880051+0000","last_active":"2024-09-17T01:37:01.938247+0000","last_peered":"2024-09-17T01:37:01.938247+0000","last_clean":"2024-09-17T01:37:01.938247+0000","last_became_active":"2024-09-17T01:37:00.878651+0000","last_became_peered":"2024-09-17T01:37:00.878651+0000","last_unstale":"2024-09-17T01:37:01.938247+0000","last_undegraded":"2024-09-17T01:37:01.938247+0000","last_fullsized":"2024-09-17T01:37:01.938247+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:50.436558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T01:36:59.880920+0000","last_change":"2024-09-17T01:36:59.877280+0000","last_active":"2024-09-17T01:36:59.880920+0000","last_peered":"2024-09-17T01:36:59.880920+0000","last_clean":"2024-09-17T01:36:59.880920+0000","last_became_active":"2024-09-17T01:36:59.876930+0000","last_became_peered":"2024-09-17T01:36:59.876930+0000","last_unstale":"2024-09-17T01:36:59.880920+0000","last_undegraded":"2024-09-17T01:36:59.880920+0000","last_fullsized":"2024-09-17T01:36:59.880920+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:38.701210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873154+0000","last_change":"2024-09-17T01:37:00.878655+0000","last_active":"2024-09-17T01:37:01.873154+0000","last_peered":"2024-09-17T01:37:01.873154+0000","last_clean":"2024-09-17T01:37:01.873154+0000","last_became_active":"2024-09-17T01:37:00.869157+0000","last_became_peered":"2024-09-17T01:37:00.869157+0000","last_unstale":"2024-09-17T01:37:01.873154+0000","last_undegraded":"2024-09-17T01:37:01.873154+0000","last_fullsized":"2024-09-17T01:37:01.873154+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:50.446321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T01:36:59.881120+0000","last_change":"2024-09-17T01:36:59.876368+0000","last_active":"2024-09-17T01:36:59.881120+0000","last_peered":"2024-09-17T01:36:59.881120+0000","last_clean":"2024-09-17T01:36:59.881120+0000","last_became_active":"2024-09-17T01:36:59.876090+0000","last_became_peered":"2024-09-17T01:36:59.876090+0000","last_unstale":"2024-09-17T01:36:59.881120+0000","last_undegraded":"2024-09-17T01:36:59.881120+0000","last_fullsized":"2024-09-17T01:36:59.881120+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:05.795017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873160+0000","last_change":"2024-09-17T01:37:00.877548+0000","last_active":"2024-09-17T01:37:01.873160+0000","last_peered":"2024-09-17T01:37:01.873160+0000","last_clean":"2024-09-17T01:37:01.873160+0000","last_became_active":"2024-09-17T01:37:00.876225+0000","last_became_peered":"2024-09-17T01:37:00.876225+0000","last_unstale":"2024-09-17T01:37:01.873160+0000","last_undegraded":"2024-09-17T01:37:01.873160+0000","last_fullsized":"2024-09-17T01:37:01.873160+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:59:05.289863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937544+0000","last_change":"2024-09-17T01:36:59.880051+0000","last_active":"2024-09-17T01:37:01.937544+0000","last_peered":"2024-09-17T01:37:01.937544+0000","last_clean":"2024-09-17T01:37:01.937544+0000","last_became_active":"2024-09-17T01:36:59.879720+0000","last_became_peered":"2024-09-17T01:36:59.879720+0000","last_unstale":"2024-09-17T01:37:01.937544+0000","last_undegraded":"2024-09-17T01:37:01.937544+0000","last_fullsized":"2024-09-17T01:37:01.937544+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:25.120880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872544+0000","last_change":"2024-09-17T01:37:00.882269+0000","last_active":"2024-09-17T01:37:01.872544+0000","last_peered":"2024-09-17T01:37:01.872544+0000","last_clean":"2024-09-17T01:37:01.872544+0000","last_became_active":"2024-09-17T01:37:00.881259+0000","last_became_peered":"2024-09-17T01:37:00.881259+0000","last_unstale":"2024-09-17T01:37:01.872544+0000","last_undegraded":"2024-09-17T01:37:01.872544+0000","last_fullsized":"2024-09-17T01:37:01.872544+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:54.281546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937348+0000","last_change":"2024-09-17T01:36:59.878130+0000","last_active":"2024-09-17T01:37:01.937348+0000","last_peered":"2024-09-17T01:37:01.937348+0000","last_clean":"2024-09-17T01:37:01.937348+0000","last_became_active":"2024-09-17T01:36:59.877688+0000","last_became_peered":"2024-09-17T01:36:59.877688+0000","last_unstale":"2024-09-17T01:37:01.937348+0000","last_undegraded":"2024-09-17T01:37:01.937348+0000","last_fullsized":"2024-09-17T01:37:01.937348+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:31.964182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.939045+0000","last_change":"2024-09-17T01:37:00.879111+0000","last_active":"2024-09-17T01:37:01.939045+0000","last_peered":"2024-09-17T01:37:01.939045+0000","last_clean":"2024-09-17T01:37:01.939045+0000","last_became_active":"2024-09-17T01:37:00.874367+0000","last_became_peered":"2024-09-17T01:37:00.874367+0000","last_unstale":"2024-09-17T01:37:01.939045+0000","last_undegraded":"2024-09-17T01:37:01.939045+0000","last_fullsized":"2024-09-17T01:37:01.939045+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:41.447731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.875113+0000","last_change":"2024-09-17T01:36:59.865304+0000","last_active":"2024-09-17T01:37:01.875113+0000","last_peered":"2024-09-17T01:37:01.875113+0000","last_clean":"2024-09-17T01:37:01.875113+0000","last_became_active":"2024-09-17T01:36:59.862462+0000","last_became_peered":"2024-09-17T01:36:59.862462+0000","last_unstale":"2024-09-17T01:37:01.875113+0000","last_undegraded":"2024-09-17T01:37:01.875113+0000","last_fullsized":"2024-09-17T01:37:01.875113+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:53.210356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871401+0000","last_change":"2024-09-17T01:37:00.881114+0000","last_active":"2024-09-17T01:37:01.871401+0000","last_peered":"2024-09-17T01:37:01.871401+0000","last_clean":"2024-09-17T01:37:01.871401+0000","last_became_active":"2024-09-17T01:37:00.880775+0000","last_became_peered":"2024-09-17T01:37:00.880775+0000","last_unstale":"2024-09-17T01:37:01.871401+0000","last_undegraded":"2024-09-17T01:37:01.871401+0000","last_fullsized":"2024-09-17T01:37:01.871401+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:15.044192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"78'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874869+0000","last_change":"2024-09-17T01:36:59.880330+0000","last_active":"2024-09-17T01:37:01.874869+0000","last_peered":"2024-09-17T01:37:01.874869+0000","last_clean":"2024-09-17T01:37:01.874869+0000","last_became_active":"2024-09-17T01:36:59.878802+0000","last_became_peered":"2024-09-17T01:36:59.878802+0000","last_unstale":"2024-09-17T01:37:01.874869+0000","last_undegraded":"2024-09-17T01:37:01.874869+0000","last_fullsized":"2024-09-17T01:37:01.874869+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:53.286067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938018+0000","last_change":"2024-09-17T01:37:00.872505+0000","last_active":"2024-09-17T01:37:01.938018+0000","last_peered":"2024-09-17T01:37:01.938018+0000","last_clean":"2024-09-17T01:37:01.938018+0000","last_became_active":"2024-09-17T01:37:00.872169+0000","last_became_peered":"2024-09-17T01:37:00.872169+0000","last_unstale":"2024-09-17T01:37:01.938018+0000","last_undegraded":"2024-09-17T01:37:01.938018+0000","last_fullsized":"2024-09-17T01:37:01.938018+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:40.396787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874370+0000","last_change":"2024-09-17T01:36:59.863867+0000","last_active":"2024-09-17T01:37:01.874370+0000","last_peered":"2024-09-17T01:37:01.874370+0000","last_clean":"2024-09-17T01:37:01.874370+0000","last_became_active":"2024-09-17T01:36:59.863517+0000","last_became_peered":"2024-09-17T01:36:59.863517+0000","last_unstale":"2024-09-17T01:37:01.874370+0000","last_undegraded":"2024-09-17T01:37:01.874370+0000","last_fullsized":"2024-09-17T01:37:01.874370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:15.269849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871135+0000","last_change":"2024-09-17T01:37:00.882366+0000","last_active":"2024-09-17T01:37:01.871135+0000","last_peered":"2024-09-17T01:37:01.871135+0000","last_clean":"2024-09-17T01:37:01.871135+0000","last_became_active":"2024-09-17T01:37:00.882086+0000","last_became_peered":"2024-09-17T01:37:00.882086+0000","last_unstale":"2024-09-17T01:37:01.871135+0000","last_undegraded":"2024-09-17T01:37:01.871135+0000","last_fullsized":"2024-09-17T01:37:01.871135+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:55:02.373828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873880+0000","last_change":"2024-09-17T01:36:59.869198+0000","last_active":"2024-09-17T01:37:01.873880+0000","last_peered":"2024-09-17T01:37:01.873880+0000","last_clean":"2024-09-17T01:37:01.873880+0000","last_became_active":"2024-09-17T01:36:59.868898+0000","last_became_peered":"2024-09-17T01:36:59.868898+0000","last_unstale":"2024-09-17T01:37:01.873880+0000","last_undegraded":"2024-09-17T01:37:01.873880+0000","last_fullsized":"2024-09-17T01:37:01.873880+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:12:59.919264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938070+0000","last_change":"2024-09-17T01:37:00.873280+0000","last_active":"2024-09-17T01:37:01.938070+0000","last_peered":"2024-09-17T01:37:01.938070+0000","last_clean":"2024-09-17T01:37:01.938070+0000","last_became_active":"2024-09-17T01:37:00.871566+0000","last_became_peered":"2024-09-17T01:37:00.871566+0000","last_unstale":"2024-09-17T01:37:01.938070+0000","last_undegraded":"2024-09-17T01:37:01.938070+0000","last_fullsized":"2024-09-17T01:37:01.938070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:59.796709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873685+0000","last_change":"2024-09-17T01:36:59.867758+0000","last_active":"2024-09-17T01:37:01.873685+0000","last_peered":"2024-09-17T01:37:01.873685+0000","last_clean":"2024-09-17T01:37:01.873685+0000","last_became_active":"2024-09-17T01:36:59.866985+0000","last_became_peered":"2024-09-17T01:36:59.866985+0000","last_unstale":"2024-09-17T01:37:01.873685+0000","last_undegraded":"2024-09-17T01:37:01.873685+0000","last_fullsized":"2024-09-17T01:37:01.873685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:17.223254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874679+0000","last_change":"2024-09-17T01:37:00.883794+0000","last_active":"2024-09-17T01:37:01.874679+0000","last_peered":"2024-09-17T01:37:01.874679+0000","last_clean":"2024-09-17T01:37:01.874679+0000","last_became_active":"2024-09-17T01:37:00.879349+0000","last_became_peered":"2024-09-17T01:37:00.879349+0000","last_unstale":"2024-09-17T01:37:01.874679+0000","last_undegraded":"2024-09-17T01:37:01.874679+0000","last_fullsized":"2024-09-17T01:37:01.874679+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:05.980183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938206+0000","last_change":"2024-09-17T01:36:59.872585+0000","last_active":"2024-09-17T01:37:01.938206+0000","last_peered":"2024-09-17T01:37:01.938206+0000","last_clean":"2024-09-17T01:37:01.938206+0000","last_became_active":"2024-09-17T01:36:59.870276+0000","last_became_peered":"2024-09-17T01:36:59.870276+0000","last_unstale":"2024-09-17T01:37:01.938206+0000","last_undegraded":"2024-09-17T01:37:01.938206+0000","last_fullsized":"2024-09-17T01:37:01.938206+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:51.670979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873386+0000","last_change":"2024-09-17T01:37:00.884276+0000","last_active":"2024-09-17T01:37:01.873386+0000","last_peered":"2024-09-17T01:37:01.873386+0000","last_clean":"2024-09-17T01:37:01.873386+0000","last_became_active":"2024-09-17T01:37:00.883956+0000","last_became_peered":"2024-09-17T01:37:00.883956+0000","last_unstale":"2024-09-17T01:37:01.873386+0000","last_undegraded":"2024-09-17T01:37:01.873386+0000","last_fullsized":"2024-09-17T01:37:01.873386+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:40.973377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937655+0000","last_change":"2024-09-17T01:36:59.883537+0000","last_active":"2024-09-17T01:37:01.937655+0000","last_peered":"2024-09-17T01:37:01.937655+0000","last_clean":"2024-09-17T01:37:01.937655+0000","last_became_active":"2024-09-17T01:36:59.883207+0000","last_became_peered":"2024-09-17T01:36:59.883207+0000","last_unstale":"2024-09-17T01:37:01.937655+0000","last_undegraded":"2024-09-17T01:37:01.937655+0000","last_fullsized":"2024-09-17T01:37:01.937655+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:59.069079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937976+0000","last_change":"2024-09-17T01:37:00.893414+0000","last_active":"2024-09-17T01:37:01.937976+0000","last_peered":"2024-09-17T01:37:01.937976+0000","last_clean":"2024-09-17T01:37:01.937976+0000","last_became_active":"2024-09-17T01:37:00.893040+0000","last_became_peered":"2024-09-17T01:37:00.893040+0000","last_unstale":"2024-09-17T01:37:01.937976+0000","last_undegraded":"2024-09-17T01:37:01.937976+0000","last_fullsized":"2024-09-17T01:37:01.937976+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:51.081350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T01:36:59.883840+0000","last_change":"2024-09-17T01:36:59.881600+0000","last_active":"2024-09-17T01:36:59.883840+0000","last_peered":"2024-09-17T01:36:59.883840+0000","last_clean":"2024-09-17T01:36:59.883840+0000","last_became_active":"2024-09-17T01:36:59.881167+0000","last_became_peered":"2024-09-17T01:36:59.881167+0000","last_unstale":"2024-09-17T01:36:59.883840+0000","last_undegraded":"2024-09-17T01:36:59.883840+0000","last_fullsized":"2024-09-17T01:36:59.883840+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:38.152666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938334+0000","last_change":"2024-09-17T01:37:00.886106+0000","last_active":"2024-09-17T01:37:01.938334+0000","last_peered":"2024-09-17T01:37:01.938334+0000","last_clean":"2024-09-17T01:37:01.938334+0000","last_became_active":"2024-09-17T01:37:00.879587+0000","last_became_peered":"2024-09-17T01:37:00.879587+0000","last_unstale":"2024-09-17T01:37:01.938334+0000","last_undegraded":"2024-09-17T01:37:01.938334+0000","last_fullsized":"2024-09-17T01:37:01.938334+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:02.658087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870731+0000","last_change":"2024-09-17T01:36:59.873087+0000","last_active":"2024-09-17T01:37:01.870731+0000","last_peered":"2024-09-17T01:37:01.870731+0000","last_clean":"2024-09-17T01:37:01.870731+0000","last_became_active":"2024-09-17T01:36:59.872734+0000","last_became_peered":"2024-09-17T01:36:59.872734+0000","last_unstale":"2024-09-17T01:37:01.870731+0000","last_undegraded":"2024-09-17T01:37:01.870731+0000","last_fullsized":"2024-09-17T01:37:01.870731+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:56:01.555936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":217,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870301+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:37:01.870301+0000","last_peered":"2024-09-17T01:37:01.870301+0000","last_clean":"2024-09-17T01:37:01.870301+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:37:01.870301+0000","last_undegraded":"2024-09-17T01:37:01.870301+0000","last_fullsized":"2024-09-17T01:37:01.870301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476801,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":917504,"data_stored":390175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509505,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40444,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331396,"statfs":{"total":96636764160,"available":96595349504,"internally_reserved":0,"allocated":954368,"data_stored":404862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509504,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40448,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331392,"statfs":{"total":96636764160,"available":96595345408,"internally_reserved":0,"allocated":958464,"data_stored":404896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509505,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44604,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327236,"statfs":{"total":96636764160,"available":96591089664,"internally_reserved":0,"allocated":954368,"data_stored":403944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509505,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":954368,"data_stored":403376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509504,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41012,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330828,"statfs":{"total":96636764160,"available":96594767872,"internally_reserved":0,"allocated":1536000,"data_stored":993618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509506,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36280,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335560,"statfs":{"total":96636764160,"available":96599613440,"internally_reserved":0,"allocated":946176,"data_stored":403320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542210,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41020,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330820,"statfs":{"total":96636764160,"available":96594759680,"internally_reserved":0,"allocated":1540096,"data_stored":993708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:37:05.881 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:37:06.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.144+0000 7f5d9f200640 1 -- 172.21.15.42:0/223174229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5da00cf7c0 msgr2=0x7f5da006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:06.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.144+0000 7f5d9f200640 1 --2- 172.21.15.42:0/223174229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5da00cf7c0 0x7f5da006cd20 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f5da0071cb0 tx=0x7f5d8802a560 comp rx=0 tx=0).stop 2024-09-17T01:37:06.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.144+0000 7f5d9f200640 1 -- 172.21.15.42:0/223174229 shutdown_connections 2024-09-17T01:37:06.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.144+0000 7f5d9f200640 1 --2- 172.21.15.42:0/223174229 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5da006d260 0x7f5da0152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:06.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.144+0000 7f5d9f200640 1 --2- 172.21.15.42:0/223174229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5da00cf7c0 0x7f5da006cd20 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:06.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.144+0000 7f5d9f200640 1 --2- 172.21.15.42:0/223174229 >> v2:172.21.15.43:3300/0 conn(0x7f5da00b4be0 0x7f5da015d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:06.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.144+0000 7f5d9f200640 1 -- 172.21.15.42:0/223174229 >> 172.21.15.42:0/223174229 conn(0x7f5da00b25f0 msgr2=0x7f5da00d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:06.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.144+0000 7f5d9f200640 1 -- 172.21.15.42:0/223174229 shutdown_connections 2024-09-17T01:37:06.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.144+0000 7f5d9f200640 1 -- 172.21.15.42:0/223174229 wait complete. 2024-09-17T01:37:06.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.146+0000 7f5d9f200640 1 Processor -- start 2024-09-17T01:37:06.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.147+0000 7f5d9f200640 1 -- start start 2024-09-17T01:37:06.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.148+0000 7f5d9f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5da006d260 0x7f5da00c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:06.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.148+0000 7f5d9f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5da00b4be0 0x7f5da0073280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:06.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.148+0000 7f5d9f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5da00cf7c0 0x7f5da01516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:06.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.148+0000 7f5d9f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5da01537a0 con 0x7f5da00b4be0 2024-09-17T01:37:06.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.148+0000 7f5d9f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5da0153620 con 0x7f5da006d260 2024-09-17T01:37:06.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.148+0000 7f5d9f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5da0153920 con 0x7f5da00cf7c0 2024-09-17T01:37:06.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.148+0000 7f5d97e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5da00b4be0 0x7f5da0073280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:06.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.148+0000 7f5d97e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5da00b4be0 0x7f5da0073280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53222/0 (socket says 172.21.15.42:53222) 2024-09-17T01:37:06.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.148+0000 7f5d97e00640 1 -- 172.21.15.42:0/925880101 learned_addr learned my addr 172.21.15.42:0/925880101 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:06.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.148+0000 7f5d9de00640 1 --2- 172.21.15.42:0/925880101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5da006d260 0x7f5da00c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:06.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.148+0000 7f5d9e800640 1 --2- 172.21.15.42:0/925880101 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5da00cf7c0 0x7f5da01516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:06.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.149+0000 7f5d97e00640 1 -- 172.21.15.42:0/925880101 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5da00cf7c0 msgr2=0x7f5da01516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:06.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.149+0000 7f5d97e00640 1 --2- 172.21.15.42:0/925880101 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5da00cf7c0 0x7f5da01516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:06.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.149+0000 7f5d97e00640 1 -- 172.21.15.42:0/925880101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5da006d260 msgr2=0x7f5da00c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:06.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.149+0000 7f5d97e00640 1 --2- 172.21.15.42:0/925880101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5da006d260 0x7f5da00c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:06.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.149+0000 7f5d97e00640 1 -- 172.21.15.42:0/925880101 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da0073c90 con 0x7f5da00b4be0 2024-09-17T01:37:06.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.149+0000 7f5d97e00640 1 --2- 172.21.15.42:0/925880101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5da00b4be0 0x7f5da0073280 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f5d88034040 tx=0x7f5d880038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:06.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.149+0000 7f5d96000640 1 -- 172.21.15.42:0/925880101 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8803e030 con 0x7f5da00b4be0 2024-09-17T01:37:06.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.149+0000 7f5d96000640 1 -- 172.21.15.42:0/925880101 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d88003ca0 con 0x7f5da00b4be0 2024-09-17T01:37:06.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.149+0000 7f5d96000640 1 -- 172.21.15.42:0/925880101 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d88035040 con 0x7f5da00b4be0 2024-09-17T01:37:06.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.149+0000 7f5d9f200640 1 -- 172.21.15.42:0/925880101 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5da0073f70 con 0x7f5da00b4be0 2024-09-17T01:37:06.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.149+0000 7f5d9f200640 1 -- 172.21.15.42:0/925880101 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5da0074530 con 0x7f5da00b4be0 2024-09-17T01:37:06.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.150+0000 7f5d9f200640 1 -- 172.21.15.42:0/925880101 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5da015ca50 con 0x7f5da00b4be0 2024-09-17T01:37:06.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.152+0000 7f5d96000640 1 -- 172.21.15.42:0/925880101 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5d88041030 con 0x7f5da00b4be0 2024-09-17T01:37:06.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.153+0000 7f5d96000640 1 --2- 172.21.15.42:0/925880101 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5d7c078bc0 0x7f5d7c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:06.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.153+0000 7f5d96000640 1 -- 172.21.15.42:0/925880101 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7f5d880bb8a0 con 0x7f5da00b4be0 2024-09-17T01:37:06.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.153+0000 7f5d9de00640 1 --2- 172.21.15.42:0/925880101 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5d7c078bc0 0x7f5d7c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:06.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.154+0000 7f5d9de00640 1 --2- 172.21.15.42:0/925880101 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5d7c078bc0 0x7f5d7c07b0d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5d90009ac0 tx=0x7f5d90005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:06.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.156+0000 7f5d96000640 1 -- 172.21.15.42:0/925880101 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5da015ca50 con 0x7f5da00b4be0 2024-09-17T01:37:06.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.347+0000 7f5d9f200640 1 -- 172.21.15.42:0/925880101 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5da015d6b0 con 0x7f5d7c078bc0 2024-09-17T01:37:06.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.352+0000 7f5d96000640 1 -- 172.21.15.42:0/925880101 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251646 (secure 0 0 0) 0x7f5da015d6b0 con 0x7f5d7c078bc0 2024-09-17T01:37:06.354 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:06.356 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:37:06.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.357+0000 7f5d9f200640 1 -- 172.21.15.42:0/925880101 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5d7c078bc0 msgr2=0x7f5d7c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:06.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.357+0000 7f5d9f200640 1 --2- 172.21.15.42:0/925880101 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5d7c078bc0 0x7f5d7c07b0d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5d90009ac0 tx=0x7f5d90005f90 comp rx=0 tx=0).stop 2024-09-17T01:37:06.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.357+0000 7f5d9f200640 1 -- 172.21.15.42:0/925880101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5da00b4be0 msgr2=0x7f5da0073280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:06.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.357+0000 7f5d9f200640 1 --2- 172.21.15.42:0/925880101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5da00b4be0 0x7f5da0073280 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f5d88034040 tx=0x7f5d880038a0 comp rx=0 tx=0).stop 2024-09-17T01:37:06.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.357+0000 7f5d9f200640 1 -- 172.21.15.42:0/925880101 shutdown_connections 2024-09-17T01:37:06.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.357+0000 7f5d9f200640 1 --2- 172.21.15.42:0/925880101 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5d7c078bc0 0x7f5d7c07b0d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:06.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.357+0000 7f5d9f200640 1 --2- 172.21.15.42:0/925880101 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5da00cf7c0 0x7f5da01516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:06.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.357+0000 7f5d9f200640 1 --2- 172.21.15.42:0/925880101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5da00b4be0 0x7f5da0073280 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:06.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.357+0000 7f5d9f200640 1 --2- 172.21.15.42:0/925880101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5da006d260 0x7f5da00c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:06.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.357+0000 7f5d9f200640 1 -- 172.21.15.42:0/925880101 >> 172.21.15.42:0/925880101 conn(0x7f5da00b25f0 msgr2=0x7f5da00ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:06.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.357+0000 7f5d9f200640 1 -- 172.21.15.42:0/925880101 shutdown_connections 2024-09-17T01:37:06.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.357+0000 7f5d9f200640 1 -- 172.21.15.42:0/925880101 wait complete. 2024-09-17T01:37:06.377 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-09-17T01:37:05.062033+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":139,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":299704,"kb_used_data":8556,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754675016,"statfs":{"total":773094113280,"available":772787216384,"internally_reserved":0,"allocated":8761344,"data_stored":4397899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":297913908},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001765"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.875283+0000","last_change":"2024-09-17T01:37:00.894727+0000","last_active":"2024-09-17T01:37:01.875283+0000","last_peered":"2024-09-17T01:37:01.875283+0000","last_clean":"2024-09-17T01:37:01.875283+0000","last_became_active":"2024-09-17T01:37:00.894422+0000","last_became_peered":"2024-09-17T01:37:00.894422+0000","last_unstale":"2024-09-17T01:37:01.875283+0000","last_undegraded":"2024-09-17T01:37:01.875283+0000","last_fullsized":"2024-09-17T01:37:01.875283+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:07.471265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938210+0000","last_change":"2024-09-17T01:37:00.883141+0000","last_active":"2024-09-17T01:37:01.938210+0000","last_peered":"2024-09-17T01:37:01.938210+0000","last_clean":"2024-09-17T01:37:01.938210+0000","last_became_active":"2024-09-17T01:37:00.882588+0000","last_became_peered":"2024-09-17T01:37:00.882588+0000","last_unstale":"2024-09-17T01:37:01.938210+0000","last_undegraded":"2024-09-17T01:37:01.938210+0000","last_fullsized":"2024-09-17T01:37:01.938210+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:37:06.008340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938115+0000","last_change":"2024-09-17T01:37:00.886235+0000","last_active":"2024-09-17T01:37:01.938115+0000","last_peered":"2024-09-17T01:37:01.938115+0000","last_clean":"2024-09-17T01:37:01.938115+0000","last_became_active":"2024-09-17T01:37:00.884395+0000","last_became_peered":"2024-09-17T01:37:00.884395+0000","last_unstale":"2024-09-17T01:37:01.938115+0000","last_undegraded":"2024-09-17T01:37:01.938115+0000","last_fullsized":"2024-09-17T01:37:01.938115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:46.190213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938091+0000","last_change":"2024-09-17T01:37:00.882991+0000","last_active":"2024-09-17T01:37:01.938091+0000","last_peered":"2024-09-17T01:37:01.938091+0000","last_clean":"2024-09-17T01:37:01.938091+0000","last_became_active":"2024-09-17T01:37:00.882627+0000","last_became_peered":"2024-09-17T01:37:00.882627+0000","last_unstale":"2024-09-17T01:37:01.938091+0000","last_undegraded":"2024-09-17T01:37:01.938091+0000","last_fullsized":"2024-09-17T01:37:01.938091+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:18.536668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937768+0000","last_change":"2024-09-17T01:37:00.879118+0000","last_active":"2024-09-17T01:37:01.937768+0000","last_peered":"2024-09-17T01:37:01.937768+0000","last_clean":"2024-09-17T01:37:01.937768+0000","last_became_active":"2024-09-17T01:37:00.878074+0000","last_became_peered":"2024-09-17T01:37:00.878074+0000","last_unstale":"2024-09-17T01:37:01.937768+0000","last_undegraded":"2024-09-17T01:37:01.937768+0000","last_fullsized":"2024-09-17T01:37:01.937768+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:11.586434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2024-09-17T01:36:59.858191+0000","last_change":"2024-09-17T01:36:59.858191+0000","last_active":"2024-09-17T01:36:59.841771+0000","last_peered":"2024-09-17T01:36:59.841771+0000","last_clean":"2024-09-17T01:36:59.841771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:59.858191+0000","last_undegraded":"2024-09-17T01:36:59.858191+0000","last_fullsized":"2024-09-17T01:36:59.858191+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870613+0000","last_change":"2024-09-17T01:37:00.885660+0000","last_active":"2024-09-17T01:37:01.870613+0000","last_peered":"2024-09-17T01:37:01.870613+0000","last_clean":"2024-09-17T01:37:01.870613+0000","last_became_active":"2024-09-17T01:37:00.875481+0000","last_became_peered":"2024-09-17T01:37:00.875481+0000","last_unstale":"2024-09-17T01:37:01.870613+0000","last_undegraded":"2024-09-17T01:37:01.870613+0000","last_fullsized":"2024-09-17T01:37:01.870613+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:54.284586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874358+0000","last_change":"2024-09-17T01:37:00.887879+0000","last_active":"2024-09-17T01:37:01.874358+0000","last_peered":"2024-09-17T01:37:01.874358+0000","last_clean":"2024-09-17T01:37:01.874358+0000","last_became_active":"2024-09-17T01:37:00.886811+0000","last_became_peered":"2024-09-17T01:37:00.886811+0000","last_unstale":"2024-09-17T01:37:01.874358+0000","last_undegraded":"2024-09-17T01:37:01.874358+0000","last_fullsized":"2024-09-17T01:37:01.874358+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:07.671917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938274+0000","last_change":"2024-09-17T01:37:00.880205+0000","last_active":"2024-09-17T01:37:01.938274+0000","last_peered":"2024-09-17T01:37:01.938274+0000","last_clean":"2024-09-17T01:37:01.938274+0000","last_became_active":"2024-09-17T01:37:00.879875+0000","last_became_peered":"2024-09-17T01:37:00.879875+0000","last_unstale":"2024-09-17T01:37:01.938274+0000","last_undegraded":"2024-09-17T01:37:01.938274+0000","last_fullsized":"2024-09-17T01:37:01.938274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:26.752484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871291+0000","last_change":"2024-09-17T01:37:00.874744+0000","last_active":"2024-09-17T01:37:01.871291+0000","last_peered":"2024-09-17T01:37:01.871291+0000","last_clean":"2024-09-17T01:37:01.871291+0000","last_became_active":"2024-09-17T01:37:00.872129+0000","last_became_peered":"2024-09-17T01:37:00.872129+0000","last_unstale":"2024-09-17T01:37:01.871291+0000","last_undegraded":"2024-09-17T01:37:01.871291+0000","last_fullsized":"2024-09-17T01:37:01.871291+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:40.026790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.875017+0000","last_change":"2024-09-17T01:37:00.886368+0000","last_active":"2024-09-17T01:37:01.875017+0000","last_peered":"2024-09-17T01:37:01.875017+0000","last_clean":"2024-09-17T01:37:01.875017+0000","last_became_active":"2024-09-17T01:37:00.886042+0000","last_became_peered":"2024-09-17T01:37:00.886042+0000","last_unstale":"2024-09-17T01:37:01.875017+0000","last_undegraded":"2024-09-17T01:37:01.875017+0000","last_fullsized":"2024-09-17T01:37:01.875017+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:51.174176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874503+0000","last_change":"2024-09-17T01:37:00.878779+0000","last_active":"2024-09-17T01:37:01.874503+0000","last_peered":"2024-09-17T01:37:01.874503+0000","last_clean":"2024-09-17T01:37:01.874503+0000","last_became_active":"2024-09-17T01:37:00.878431+0000","last_became_peered":"2024-09-17T01:37:00.878431+0000","last_unstale":"2024-09-17T01:37:01.874503+0000","last_undegraded":"2024-09-17T01:37:01.874503+0000","last_fullsized":"2024-09-17T01:37:01.874503+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:54.289027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937788+0000","last_change":"2024-09-17T01:37:00.883220+0000","last_active":"2024-09-17T01:37:01.937788+0000","last_peered":"2024-09-17T01:37:01.937788+0000","last_clean":"2024-09-17T01:37:01.937788+0000","last_became_active":"2024-09-17T01:37:00.882923+0000","last_became_peered":"2024-09-17T01:37:00.882923+0000","last_unstale":"2024-09-17T01:37:01.937788+0000","last_undegraded":"2024-09-17T01:37:01.937788+0000","last_fullsized":"2024-09-17T01:37:01.937788+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:48.939780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872570+0000","last_change":"2024-09-17T01:37:00.883960+0000","last_active":"2024-09-17T01:37:01.872570+0000","last_peered":"2024-09-17T01:37:01.872570+0000","last_clean":"2024-09-17T01:37:01.872570+0000","last_became_active":"2024-09-17T01:37:00.883650+0000","last_became_peered":"2024-09-17T01:37:00.883650+0000","last_unstale":"2024-09-17T01:37:01.872570+0000","last_undegraded":"2024-09-17T01:37:01.872570+0000","last_fullsized":"2024-09-17T01:37:01.872570+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:50:00.925352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872236+0000","last_change":"2024-09-17T01:37:00.874456+0000","last_active":"2024-09-17T01:37:01.872236+0000","last_peered":"2024-09-17T01:37:01.872236+0000","last_clean":"2024-09-17T01:37:01.872236+0000","last_became_active":"2024-09-17T01:37:00.870867+0000","last_became_peered":"2024-09-17T01:37:00.870867+0000","last_unstale":"2024-09-17T01:37:01.872236+0000","last_undegraded":"2024-09-17T01:37:01.872236+0000","last_fullsized":"2024-09-17T01:37:01.872236+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:15:29.982832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874345+0000","last_change":"2024-09-17T01:37:00.893408+0000","last_active":"2024-09-17T01:37:01.874345+0000","last_peered":"2024-09-17T01:37:01.874345+0000","last_clean":"2024-09-17T01:37:01.874345+0000","last_became_active":"2024-09-17T01:37:00.887416+0000","last_became_peered":"2024-09-17T01:37:00.887416+0000","last_unstale":"2024-09-17T01:37:01.874345+0000","last_undegraded":"2024-09-17T01:37:01.874345+0000","last_fullsized":"2024-09-17T01:37:01.874345+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:22.689477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938992+0000","last_change":"2024-09-17T01:37:00.872192+0000","last_active":"2024-09-17T01:37:01.938992+0000","last_peered":"2024-09-17T01:37:01.938992+0000","last_clean":"2024-09-17T01:37:01.938992+0000","last_became_active":"2024-09-17T01:37:00.871809+0000","last_became_peered":"2024-09-17T01:37:00.871809+0000","last_unstale":"2024-09-17T01:37:01.938992+0000","last_undegraded":"2024-09-17T01:37:01.938992+0000","last_fullsized":"2024-09-17T01:37:01.938992+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:55.876836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938793+0000","last_change":"2024-09-17T01:37:00.866290+0000","last_active":"2024-09-17T01:37:01.938793+0000","last_peered":"2024-09-17T01:37:01.938793+0000","last_clean":"2024-09-17T01:37:01.938793+0000","last_became_active":"2024-09-17T01:37:00.865874+0000","last_became_peered":"2024-09-17T01:37:00.865874+0000","last_unstale":"2024-09-17T01:37:01.938793+0000","last_undegraded":"2024-09-17T01:37:01.938793+0000","last_fullsized":"2024-09-17T01:37:01.938793+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:38.896993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874806+0000","last_change":"2024-09-17T01:37:00.897310+0000","last_active":"2024-09-17T01:37:01.874806+0000","last_peered":"2024-09-17T01:37:01.874806+0000","last_clean":"2024-09-17T01:37:01.874806+0000","last_became_active":"2024-09-17T01:37:00.896955+0000","last_became_peered":"2024-09-17T01:37:00.896955+0000","last_unstale":"2024-09-17T01:37:01.874806+0000","last_undegraded":"2024-09-17T01:37:01.874806+0000","last_fullsized":"2024-09-17T01:37:01.874806+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:04:01.328671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938592+0000","last_change":"2024-09-17T01:37:00.866925+0000","last_active":"2024-09-17T01:37:01.938592+0000","last_peered":"2024-09-17T01:37:01.938592+0000","last_clean":"2024-09-17T01:37:01.938592+0000","last_became_active":"2024-09-17T01:37:00.866542+0000","last_became_peered":"2024-09-17T01:37:00.866542+0000","last_unstale":"2024-09-17T01:37:01.938592+0000","last_undegraded":"2024-09-17T01:37:01.938592+0000","last_fullsized":"2024-09-17T01:37:01.938592+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:36.164907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937799+0000","last_change":"2024-09-17T01:37:00.874085+0000","last_active":"2024-09-17T01:37:01.937799+0000","last_peered":"2024-09-17T01:37:01.937799+0000","last_clean":"2024-09-17T01:37:01.937799+0000","last_became_active":"2024-09-17T01:37:00.873522+0000","last_became_peered":"2024-09-17T01:37:00.873522+0000","last_unstale":"2024-09-17T01:37:01.937799+0000","last_undegraded":"2024-09-17T01:37:01.937799+0000","last_fullsized":"2024-09-17T01:37:01.937799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:16.272810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2024-09-17T01:36:59.857702+0000","last_change":"2024-09-17T01:36:59.857702+0000","last_active":"2024-09-17T01:36:59.841771+0000","last_peered":"2024-09-17T01:36:59.841771+0000","last_clean":"2024-09-17T01:36:59.841771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:59.857702+0000","last_undegraded":"2024-09-17T01:36:59.857702+0000","last_fullsized":"2024-09-17T01:36:59.857702+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870493+0000","last_change":"2024-09-17T01:37:00.886408+0000","last_active":"2024-09-17T01:37:01.870493+0000","last_peered":"2024-09-17T01:37:01.870493+0000","last_clean":"2024-09-17T01:37:01.870493+0000","last_became_active":"2024-09-17T01:37:00.886111+0000","last_became_peered":"2024-09-17T01:37:00.886111+0000","last_unstale":"2024-09-17T01:37:01.870493+0000","last_undegraded":"2024-09-17T01:37:01.870493+0000","last_fullsized":"2024-09-17T01:37:01.870493+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:10.335496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874607+0000","last_change":"2024-09-17T01:37:00.874639+0000","last_active":"2024-09-17T01:37:01.874607+0000","last_peered":"2024-09-17T01:37:01.874607+0000","last_clean":"2024-09-17T01:37:01.874607+0000","last_became_active":"2024-09-17T01:37:00.874352+0000","last_became_peered":"2024-09-17T01:37:00.874352+0000","last_unstale":"2024-09-17T01:37:01.874607+0000","last_undegraded":"2024-09-17T01:37:01.874607+0000","last_fullsized":"2024-09-17T01:37:01.874607+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:56.583515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871375+0000","last_change":"2024-09-17T01:37:00.881981+0000","last_active":"2024-09-17T01:37:01.871375+0000","last_peered":"2024-09-17T01:37:01.871375+0000","last_clean":"2024-09-17T01:37:01.871375+0000","last_became_active":"2024-09-17T01:37:00.881639+0000","last_became_peered":"2024-09-17T01:37:00.881639+0000","last_unstale":"2024-09-17T01:37:01.871375+0000","last_undegraded":"2024-09-17T01:37:01.871375+0000","last_fullsized":"2024-09-17T01:37:01.871375+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:58.500831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874725+0000","last_change":"2024-09-17T01:37:00.895616+0000","last_active":"2024-09-17T01:37:01.874725+0000","last_peered":"2024-09-17T01:37:01.874725+0000","last_clean":"2024-09-17T01:37:01.874725+0000","last_became_active":"2024-09-17T01:37:00.895306+0000","last_became_peered":"2024-09-17T01:37:00.895306+0000","last_unstale":"2024-09-17T01:37:01.874725+0000","last_undegraded":"2024-09-17T01:37:01.874725+0000","last_fullsized":"2024-09-17T01:37:01.874725+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:33.147682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938197+0000","last_change":"2024-09-17T01:37:00.883738+0000","last_active":"2024-09-17T01:37:01.938197+0000","last_peered":"2024-09-17T01:37:01.938197+0000","last_clean":"2024-09-17T01:37:01.938197+0000","last_became_active":"2024-09-17T01:37:00.883028+0000","last_became_peered":"2024-09-17T01:37:00.883028+0000","last_unstale":"2024-09-17T01:37:01.938197+0000","last_undegraded":"2024-09-17T01:37:01.938197+0000","last_fullsized":"2024-09-17T01:37:01.938197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:50:15.638098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937702+0000","last_change":"2024-09-17T01:37:00.875084+0000","last_active":"2024-09-17T01:37:01.937702+0000","last_peered":"2024-09-17T01:37:01.937702+0000","last_clean":"2024-09-17T01:37:01.937702+0000","last_became_active":"2024-09-17T01:37:00.873935+0000","last_became_peered":"2024-09-17T01:37:00.873935+0000","last_unstale":"2024-09-17T01:37:01.937702+0000","last_undegraded":"2024-09-17T01:37:01.937702+0000","last_fullsized":"2024-09-17T01:37:01.937702+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:49.735347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937846+0000","last_change":"2024-09-17T01:37:00.881622+0000","last_active":"2024-09-17T01:37:01.937846+0000","last_peered":"2024-09-17T01:37:01.937846+0000","last_clean":"2024-09-17T01:37:01.937846+0000","last_became_active":"2024-09-17T01:37:00.880763+0000","last_became_peered":"2024-09-17T01:37:00.880763+0000","last_unstale":"2024-09-17T01:37:01.937846+0000","last_undegraded":"2024-09-17T01:37:01.937846+0000","last_fullsized":"2024-09-17T01:37:01.937846+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:38.263600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874922+0000","last_change":"2024-09-17T01:37:00.895593+0000","last_active":"2024-09-17T01:37:01.874922+0000","last_peered":"2024-09-17T01:37:01.874922+0000","last_clean":"2024-09-17T01:37:01.874922+0000","last_became_active":"2024-09-17T01:37:00.895223+0000","last_became_peered":"2024-09-17T01:37:00.895223+0000","last_unstale":"2024-09-17T01:37:01.874922+0000","last_undegraded":"2024-09-17T01:37:01.874922+0000","last_fullsized":"2024-09-17T01:37:01.874922+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:27.587846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937475+0000","last_change":"2024-09-17T01:37:00.877026+0000","last_active":"2024-09-17T01:37:01.937475+0000","last_peered":"2024-09-17T01:37:01.937475+0000","last_clean":"2024-09-17T01:37:01.937475+0000","last_became_active":"2024-09-17T01:37:00.876085+0000","last_became_peered":"2024-09-17T01:37:00.876085+0000","last_unstale":"2024-09-17T01:37:01.937475+0000","last_undegraded":"2024-09-17T01:37:01.937475+0000","last_fullsized":"2024-09-17T01:37:01.937475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:30.108084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937154+0000","last_change":"2024-09-17T01:37:00.873456+0000","last_active":"2024-09-17T01:37:01.937154+0000","last_peered":"2024-09-17T01:37:01.937154+0000","last_clean":"2024-09-17T01:37:01.937154+0000","last_became_active":"2024-09-17T01:37:00.873158+0000","last_became_peered":"2024-09-17T01:37:00.873158+0000","last_unstale":"2024-09-17T01:37:01.937154+0000","last_undegraded":"2024-09-17T01:37:01.937154+0000","last_fullsized":"2024-09-17T01:37:01.937154+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:57:26.714304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.875006+0000","last_change":"2024-09-17T01:37:00.881273+0000","last_active":"2024-09-17T01:37:01.875006+0000","last_peered":"2024-09-17T01:37:01.875006+0000","last_clean":"2024-09-17T01:37:01.875006+0000","last_became_active":"2024-09-17T01:37:00.880964+0000","last_became_peered":"2024-09-17T01:37:00.880964+0000","last_unstale":"2024-09-17T01:37:01.875006+0000","last_undegraded":"2024-09-17T01:37:01.875006+0000","last_fullsized":"2024-09-17T01:37:01.875006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.293605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T01:36:59.869549+0000","last_change":"2024-09-17T01:36:59.865695+0000","last_active":"2024-09-17T01:36:59.869549+0000","last_peered":"2024-09-17T01:36:59.869549+0000","last_clean":"2024-09-17T01:36:59.869549+0000","last_became_active":"2024-09-17T01:36:59.865350+0000","last_became_peered":"2024-09-17T01:36:59.865350+0000","last_unstale":"2024-09-17T01:36:59.869549+0000","last_undegraded":"2024-09-17T01:36:59.869549+0000","last_fullsized":"2024-09-17T01:36:59.869549+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:58.866475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938662+0000","last_change":"2024-09-17T01:37:00.877472+0000","last_active":"2024-09-17T01:37:01.938662+0000","last_peered":"2024-09-17T01:37:01.938662+0000","last_clean":"2024-09-17T01:37:01.938662+0000","last_became_active":"2024-09-17T01:37:00.876758+0000","last_became_peered":"2024-09-17T01:37:00.876758+0000","last_unstale":"2024-09-17T01:37:01.938662+0000","last_undegraded":"2024-09-17T01:37:01.938662+0000","last_fullsized":"2024-09-17T01:37:01.938662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:14.801586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.939126+0000","last_change":"2024-09-17T01:36:59.876074+0000","last_active":"2024-09-17T01:37:01.939126+0000","last_peered":"2024-09-17T01:37:01.939126+0000","last_clean":"2024-09-17T01:37:01.939126+0000","last_became_active":"2024-09-17T01:36:59.875702+0000","last_became_peered":"2024-09-17T01:36:59.875702+0000","last_unstale":"2024-09-17T01:37:01.939126+0000","last_undegraded":"2024-09-17T01:37:01.939126+0000","last_fullsized":"2024-09-17T01:37:01.939126+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:54.024362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2024-09-17T01:36:59.859334+0000","last_change":"2024-09-17T01:36:59.859334+0000","last_active":"2024-09-17T01:36:59.841771+0000","last_peered":"2024-09-17T01:36:59.841771+0000","last_clean":"2024-09-17T01:36:59.841771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:59.859334+0000","last_undegraded":"2024-09-17T01:36:59.859334+0000","last_fullsized":"2024-09-17T01:36:59.859334+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874879+0000","last_change":"2024-09-17T01:36:59.867428+0000","last_active":"2024-09-17T01:37:01.874879+0000","last_peered":"2024-09-17T01:37:01.874879+0000","last_clean":"2024-09-17T01:37:01.874879+0000","last_became_active":"2024-09-17T01:36:59.867059+0000","last_became_peered":"2024-09-17T01:36:59.867059+0000","last_unstale":"2024-09-17T01:37:01.874879+0000","last_undegraded":"2024-09-17T01:37:01.874879+0000","last_fullsized":"2024-09-17T01:37:01.874879+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:28.659364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871406+0000","last_change":"2024-09-17T01:37:00.883835+0000","last_active":"2024-09-17T01:37:01.871406+0000","last_peered":"2024-09-17T01:37:01.871406+0000","last_clean":"2024-09-17T01:37:01.871406+0000","last_became_active":"2024-09-17T01:37:00.883481+0000","last_became_peered":"2024-09-17T01:37:00.883481+0000","last_unstale":"2024-09-17T01:37:01.871406+0000","last_undegraded":"2024-09-17T01:37:01.871406+0000","last_fullsized":"2024-09-17T01:37:01.871406+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:31.009628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T01:36:59.877691+0000","last_change":"2024-09-17T01:36:59.868151+0000","last_active":"2024-09-17T01:36:59.877691+0000","last_peered":"2024-09-17T01:36:59.877691+0000","last_clean":"2024-09-17T01:36:59.877691+0000","last_became_active":"2024-09-17T01:36:59.867665+0000","last_became_peered":"2024-09-17T01:36:59.867665+0000","last_unstale":"2024-09-17T01:36:59.877691+0000","last_undegraded":"2024-09-17T01:36:59.877691+0000","last_fullsized":"2024-09-17T01:36:59.877691+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:12.137272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874435+0000","last_change":"2024-09-17T01:37:00.885316+0000","last_active":"2024-09-17T01:37:01.874435+0000","last_peered":"2024-09-17T01:37:01.874435+0000","last_clean":"2024-09-17T01:37:01.874435+0000","last_became_active":"2024-09-17T01:37:00.885035+0000","last_became_peered":"2024-09-17T01:37:00.885035+0000","last_unstale":"2024-09-17T01:37:01.874435+0000","last_undegraded":"2024-09-17T01:37:01.874435+0000","last_fullsized":"2024-09-17T01:37:01.874435+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:24.483354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873515+0000","last_change":"2024-09-17T01:36:59.868131+0000","last_active":"2024-09-17T01:37:01.873515+0000","last_peered":"2024-09-17T01:37:01.873515+0000","last_clean":"2024-09-17T01:37:01.873515+0000","last_became_active":"2024-09-17T01:36:59.867405+0000","last_became_peered":"2024-09-17T01:36:59.867405+0000","last_unstale":"2024-09-17T01:37:01.873515+0000","last_undegraded":"2024-09-17T01:37:01.873515+0000","last_fullsized":"2024-09-17T01:37:01.873515+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:49.866246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2024-09-17T01:36:59.856709+0000","last_change":"2024-09-17T01:36:59.856709+0000","last_active":"2024-09-17T01:36:59.841771+0000","last_peered":"2024-09-17T01:36:59.841771+0000","last_clean":"2024-09-17T01:36:59.841771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:59.856709+0000","last_undegraded":"2024-09-17T01:36:59.856709+0000","last_fullsized":"2024-09-17T01:36:59.856709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870354+0000","last_change":"2024-09-17T01:36:59.879850+0000","last_active":"2024-09-17T01:37:01.870354+0000","last_peered":"2024-09-17T01:37:01.870354+0000","last_clean":"2024-09-17T01:37:01.870354+0000","last_became_active":"2024-09-17T01:36:59.879463+0000","last_became_peered":"2024-09-17T01:36:59.879463+0000","last_unstale":"2024-09-17T01:37:01.870354+0000","last_undegraded":"2024-09-17T01:37:01.870354+0000","last_fullsized":"2024-09-17T01:37:01.870354+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:26:09.389012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872260+0000","last_change":"2024-09-17T01:37:00.868009+0000","last_active":"2024-09-17T01:37:01.872260+0000","last_peered":"2024-09-17T01:37:01.872260+0000","last_clean":"2024-09-17T01:37:01.872260+0000","last_became_active":"2024-09-17T01:37:00.867635+0000","last_became_peered":"2024-09-17T01:37:00.867635+0000","last_unstale":"2024-09-17T01:37:01.872260+0000","last_undegraded":"2024-09-17T01:37:01.872260+0000","last_fullsized":"2024-09-17T01:37:01.872260+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:37.440870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872881+0000","last_change":"2024-09-17T01:36:59.871995+0000","last_active":"2024-09-17T01:37:01.872881+0000","last_peered":"2024-09-17T01:37:01.872881+0000","last_clean":"2024-09-17T01:37:01.872881+0000","last_became_active":"2024-09-17T01:36:59.871288+0000","last_became_peered":"2024-09-17T01:36:59.871288+0000","last_unstale":"2024-09-17T01:37:01.872881+0000","last_undegraded":"2024-09-17T01:37:01.872881+0000","last_fullsized":"2024-09-17T01:37:01.872881+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:22.962787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872280+0000","last_change":"2024-09-17T01:37:00.892376+0000","last_active":"2024-09-17T01:37:01.872280+0000","last_peered":"2024-09-17T01:37:01.872280+0000","last_clean":"2024-09-17T01:37:01.872280+0000","last_became_active":"2024-09-17T01:37:00.891949+0000","last_became_peered":"2024-09-17T01:37:00.891949+0000","last_unstale":"2024-09-17T01:37:01.872280+0000","last_undegraded":"2024-09-17T01:37:01.872280+0000","last_fullsized":"2024-09-17T01:37:01.872280+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:00.313691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871905+0000","last_change":"2024-09-17T01:36:59.866044+0000","last_active":"2024-09-17T01:37:01.871905+0000","last_peered":"2024-09-17T01:37:01.871905+0000","last_clean":"2024-09-17T01:37:01.871905+0000","last_became_active":"2024-09-17T01:36:59.865721+0000","last_became_peered":"2024-09-17T01:36:59.865721+0000","last_unstale":"2024-09-17T01:37:01.871905+0000","last_undegraded":"2024-09-17T01:37:01.871905+0000","last_fullsized":"2024-09-17T01:37:01.871905+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:54.305186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871343+0000","last_change":"2024-09-17T01:37:00.881635+0000","last_active":"2024-09-17T01:37:01.871343+0000","last_peered":"2024-09-17T01:37:01.871343+0000","last_clean":"2024-09-17T01:37:01.871343+0000","last_became_active":"2024-09-17T01:37:00.881315+0000","last_became_peered":"2024-09-17T01:37:00.881315+0000","last_unstale":"2024-09-17T01:37:01.871343+0000","last_undegraded":"2024-09-17T01:37:01.871343+0000","last_fullsized":"2024-09-17T01:37:01.871343+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:44.751005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874740+0000","last_change":"2024-09-17T01:36:59.872074+0000","last_active":"2024-09-17T01:37:01.874740+0000","last_peered":"2024-09-17T01:37:01.874740+0000","last_clean":"2024-09-17T01:37:01.874740+0000","last_became_active":"2024-09-17T01:36:59.871674+0000","last_became_peered":"2024-09-17T01:36:59.871674+0000","last_unstale":"2024-09-17T01:37:01.874740+0000","last_undegraded":"2024-09-17T01:37:01.874740+0000","last_fullsized":"2024-09-17T01:37:01.874740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:05.955545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938478+0000","last_change":"2024-09-17T01:37:00.885008+0000","last_active":"2024-09-17T01:37:01.938478+0000","last_peered":"2024-09-17T01:37:01.938478+0000","last_clean":"2024-09-17T01:37:01.938478+0000","last_became_active":"2024-09-17T01:37:00.884389+0000","last_became_peered":"2024-09-17T01:37:00.884389+0000","last_unstale":"2024-09-17T01:37:01.938478+0000","last_undegraded":"2024-09-17T01:37:01.938478+0000","last_fullsized":"2024-09-17T01:37:01.938478+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:41.769359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938290+0000","last_change":"2024-09-17T01:36:59.878360+0000","last_active":"2024-09-17T01:37:01.938290+0000","last_peered":"2024-09-17T01:37:01.938290+0000","last_clean":"2024-09-17T01:37:01.938290+0000","last_became_active":"2024-09-17T01:36:59.878062+0000","last_became_peered":"2024-09-17T01:36:59.878062+0000","last_unstale":"2024-09-17T01:37:01.938290+0000","last_undegraded":"2024-09-17T01:37:01.938290+0000","last_fullsized":"2024-09-17T01:37:01.938290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:33.686940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874641+0000","last_change":"2024-09-17T01:37:00.894146+0000","last_active":"2024-09-17T01:37:01.874641+0000","last_peered":"2024-09-17T01:37:01.874641+0000","last_clean":"2024-09-17T01:37:01.874641+0000","last_became_active":"2024-09-17T01:37:00.893851+0000","last_became_peered":"2024-09-17T01:37:00.893851+0000","last_unstale":"2024-09-17T01:37:01.874641+0000","last_undegraded":"2024-09-17T01:37:01.874641+0000","last_fullsized":"2024-09-17T01:37:01.874641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:40.958493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"77'3","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874260+0000","last_change":"2024-09-17T01:36:59.870792+0000","last_active":"2024-09-17T01:37:01.874260+0000","last_peered":"2024-09-17T01:37:01.874260+0000","last_clean":"2024-09-17T01:37:01.874260+0000","last_became_active":"2024-09-17T01:36:59.870465+0000","last_became_peered":"2024-09-17T01:36:59.870465+0000","last_unstale":"2024-09-17T01:37:01.874260+0000","last_undegraded":"2024-09-17T01:37:01.874260+0000","last_fullsized":"2024-09-17T01:37:01.874260+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:48.732387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938477+0000","last_change":"2024-09-17T01:37:00.883131+0000","last_active":"2024-09-17T01:37:01.938477+0000","last_peered":"2024-09-17T01:37:01.938477+0000","last_clean":"2024-09-17T01:37:01.938477+0000","last_became_active":"2024-09-17T01:37:00.874476+0000","last_became_peered":"2024-09-17T01:37:00.874476+0000","last_unstale":"2024-09-17T01:37:01.938477+0000","last_undegraded":"2024-09-17T01:37:01.938477+0000","last_fullsized":"2024-09-17T01:37:01.938477+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:55.258607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"77'6","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873687+0000","last_change":"2024-09-17T01:36:59.867187+0000","last_active":"2024-09-17T01:37:01.873687+0000","last_peered":"2024-09-17T01:37:01.873687+0000","last_clean":"2024-09-17T01:37:01.873687+0000","last_became_active":"2024-09-17T01:36:59.866667+0000","last_became_peered":"2024-09-17T01:36:59.866667+0000","last_unstale":"2024-09-17T01:37:01.873687+0000","last_undegraded":"2024-09-17T01:37:01.873687+0000","last_fullsized":"2024-09-17T01:37:01.873687+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:51:46.620956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2024-09-17T01:36:59.856803+0000","last_change":"2024-09-17T01:36:59.856803+0000","last_active":"2024-09-17T01:36:59.841771+0000","last_peered":"2024-09-17T01:36:59.841771+0000","last_clean":"2024-09-17T01:36:59.841771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:36:59.856803+0000","last_undegraded":"2024-09-17T01:36:59.856803+0000","last_fullsized":"2024-09-17T01:36:59.856803+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873248+0000","last_change":"2024-09-17T01:36:59.877119+0000","last_active":"2024-09-17T01:37:01.873248+0000","last_peered":"2024-09-17T01:37:01.873248+0000","last_clean":"2024-09-17T01:37:01.873248+0000","last_became_active":"2024-09-17T01:36:59.876620+0000","last_became_peered":"2024-09-17T01:36:59.876620+0000","last_unstale":"2024-09-17T01:37:01.873248+0000","last_undegraded":"2024-09-17T01:37:01.873248+0000","last_fullsized":"2024-09-17T01:37:01.873248+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:33.686940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870866+0000","last_change":"2024-09-17T01:37:00.878599+0000","last_active":"2024-09-17T01:37:01.870866+0000","last_peered":"2024-09-17T01:37:01.870866+0000","last_clean":"2024-09-17T01:37:01.870866+0000","last_became_active":"2024-09-17T01:37:00.878274+0000","last_became_peered":"2024-09-17T01:37:00.878274+0000","last_unstale":"2024-09-17T01:37:01.870866+0000","last_undegraded":"2024-09-17T01:37:01.870866+0000","last_fullsized":"2024-09-17T01:37:01.870866+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:51.128375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870403+0000","last_change":"2024-09-17T01:36:59.876949+0000","last_active":"2024-09-17T01:37:01.870403+0000","last_peered":"2024-09-17T01:37:01.870403+0000","last_clean":"2024-09-17T01:37:01.870403+0000","last_became_active":"2024-09-17T01:36:59.876378+0000","last_became_peered":"2024-09-17T01:36:59.876378+0000","last_unstale":"2024-09-17T01:37:01.870403+0000","last_undegraded":"2024-09-17T01:37:01.870403+0000","last_fullsized":"2024-09-17T01:37:01.870403+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:49.485267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937617+0000","last_change":"2024-09-17T01:37:00.866971+0000","last_active":"2024-09-17T01:37:01.937617+0000","last_peered":"2024-09-17T01:37:01.937617+0000","last_clean":"2024-09-17T01:37:01.937617+0000","last_became_active":"2024-09-17T01:37:00.866631+0000","last_became_peered":"2024-09-17T01:37:00.866631+0000","last_unstale":"2024-09-17T01:37:01.937617+0000","last_undegraded":"2024-09-17T01:37:01.937617+0000","last_fullsized":"2024-09-17T01:37:01.937617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:41.130454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870561+0000","last_change":"2024-09-17T01:36:59.870560+0000","last_active":"2024-09-17T01:37:01.870561+0000","last_peered":"2024-09-17T01:37:01.870561+0000","last_clean":"2024-09-17T01:37:01.870561+0000","last_became_active":"2024-09-17T01:36:59.870147+0000","last_became_peered":"2024-09-17T01:36:59.870147+0000","last_unstale":"2024-09-17T01:37:01.870561+0000","last_undegraded":"2024-09-17T01:37:01.870561+0000","last_fullsized":"2024-09-17T01:37:01.870561+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:15.252189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937540+0000","last_change":"2024-09-17T01:37:00.879444+0000","last_active":"2024-09-17T01:37:01.937540+0000","last_peered":"2024-09-17T01:37:01.937540+0000","last_clean":"2024-09-17T01:37:01.937540+0000","last_became_active":"2024-09-17T01:37:00.877381+0000","last_became_peered":"2024-09-17T01:37:00.877381+0000","last_unstale":"2024-09-17T01:37:01.937540+0000","last_undegraded":"2024-09-17T01:37:01.937540+0000","last_fullsized":"2024-09-17T01:37:01.937540+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:24.841003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"77'8","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870188+0000","last_change":"2024-09-17T01:36:59.872221+0000","last_active":"2024-09-17T01:37:01.870188+0000","last_peered":"2024-09-17T01:37:01.870188+0000","last_clean":"2024-09-17T01:37:01.870188+0000","last_became_active":"2024-09-17T01:36:59.871924+0000","last_became_peered":"2024-09-17T01:36:59.871924+0000","last_unstale":"2024-09-17T01:37:01.870188+0000","last_undegraded":"2024-09-17T01:37:01.870188+0000","last_fullsized":"2024-09-17T01:37:01.870188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:26.403466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938258+0000","last_change":"2024-09-17T01:37:00.877693+0000","last_active":"2024-09-17T01:37:01.938258+0000","last_peered":"2024-09-17T01:37:01.938258+0000","last_clean":"2024-09-17T01:37:01.938258+0000","last_became_active":"2024-09-17T01:37:00.877386+0000","last_became_peered":"2024-09-17T01:37:00.877386+0000","last_unstale":"2024-09-17T01:37:01.938258+0000","last_undegraded":"2024-09-17T01:37:01.938258+0000","last_fullsized":"2024-09-17T01:37:01.938258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:14.659829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874878+0000","last_change":"2024-09-17T01:36:59.864804+0000","last_active":"2024-09-17T01:37:01.874878+0000","last_peered":"2024-09-17T01:37:01.874878+0000","last_clean":"2024-09-17T01:37:01.874878+0000","last_became_active":"2024-09-17T01:36:59.863708+0000","last_became_peered":"2024-09-17T01:36:59.863708+0000","last_unstale":"2024-09-17T01:37:01.874878+0000","last_undegraded":"2024-09-17T01:37:01.874878+0000","last_fullsized":"2024-09-17T01:37:01.874878+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:50.272122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938528+0000","last_change":"2024-09-17T01:37:00.881962+0000","last_active":"2024-09-17T01:37:01.938528+0000","last_peered":"2024-09-17T01:37:01.938528+0000","last_clean":"2024-09-17T01:37:01.938528+0000","last_became_active":"2024-09-17T01:37:00.881348+0000","last_became_peered":"2024-09-17T01:37:00.881348+0000","last_unstale":"2024-09-17T01:37:01.938528+0000","last_undegraded":"2024-09-17T01:37:01.938528+0000","last_fullsized":"2024-09-17T01:37:01.938528+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:51.607996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938307+0000","last_change":"2024-09-17T01:36:59.882677+0000","last_active":"2024-09-17T01:37:01.938307+0000","last_peered":"2024-09-17T01:37:01.938307+0000","last_clean":"2024-09-17T01:37:01.938307+0000","last_became_active":"2024-09-17T01:36:59.882324+0000","last_became_peered":"2024-09-17T01:36:59.882324+0000","last_unstale":"2024-09-17T01:37:01.938307+0000","last_undegraded":"2024-09-17T01:37:01.938307+0000","last_fullsized":"2024-09-17T01:37:01.938307+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:25.084810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938669+0000","last_change":"2024-09-17T01:37:00.881768+0000","last_active":"2024-09-17T01:37:01.938669+0000","last_peered":"2024-09-17T01:37:01.938669+0000","last_clean":"2024-09-17T01:37:01.938669+0000","last_became_active":"2024-09-17T01:37:00.880039+0000","last_became_peered":"2024-09-17T01:37:00.880039+0000","last_unstale":"2024-09-17T01:37:01.938669+0000","last_undegraded":"2024-09-17T01:37:01.938669+0000","last_fullsized":"2024-09-17T01:37:01.938669+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:19.860512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937401+0000","last_change":"2024-09-17T01:36:59.880681+0000","last_active":"2024-09-17T01:37:01.937401+0000","last_peered":"2024-09-17T01:37:01.937401+0000","last_clean":"2024-09-17T01:37:01.937401+0000","last_became_active":"2024-09-17T01:36:59.880368+0000","last_became_peered":"2024-09-17T01:36:59.880368+0000","last_unstale":"2024-09-17T01:37:01.937401+0000","last_undegraded":"2024-09-17T01:37:01.937401+0000","last_fullsized":"2024-09-17T01:37:01.937401+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:23.768788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938247+0000","last_change":"2024-09-17T01:37:00.880051+0000","last_active":"2024-09-17T01:37:01.938247+0000","last_peered":"2024-09-17T01:37:01.938247+0000","last_clean":"2024-09-17T01:37:01.938247+0000","last_became_active":"2024-09-17T01:37:00.878651+0000","last_became_peered":"2024-09-17T01:37:00.878651+0000","last_unstale":"2024-09-17T01:37:01.938247+0000","last_undegraded":"2024-09-17T01:37:01.938247+0000","last_fullsized":"2024-09-17T01:37:01.938247+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:50.436558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T01:36:59.880920+0000","last_change":"2024-09-17T01:36:59.877280+0000","last_active":"2024-09-17T01:36:59.880920+0000","last_peered":"2024-09-17T01:36:59.880920+0000","last_clean":"2024-09-17T01:36:59.880920+0000","last_became_active":"2024-09-17T01:36:59.876930+0000","last_became_peered":"2024-09-17T01:36:59.876930+0000","last_unstale":"2024-09-17T01:36:59.880920+0000","last_undegraded":"2024-09-17T01:36:59.880920+0000","last_fullsized":"2024-09-17T01:36:59.880920+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:38.701210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873154+0000","last_change":"2024-09-17T01:37:00.878655+0000","last_active":"2024-09-17T01:37:01.873154+0000","last_peered":"2024-09-17T01:37:01.873154+0000","last_clean":"2024-09-17T01:37:01.873154+0000","last_became_active":"2024-09-17T01:37:00.869157+0000","last_became_peered":"2024-09-17T01:37:00.869157+0000","last_unstale":"2024-09-17T01:37:01.873154+0000","last_undegraded":"2024-09-17T01:37:01.873154+0000","last_fullsized":"2024-09-17T01:37:01.873154+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:50.446321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T01:36:59.881120+0000","last_change":"2024-09-17T01:36:59.876368+0000","last_active":"2024-09-17T01:36:59.881120+0000","last_peered":"2024-09-17T01:36:59.881120+0000","last_clean":"2024-09-17T01:36:59.881120+0000","last_became_active":"2024-09-17T01:36:59.876090+0000","last_became_peered":"2024-09-17T01:36:59.876090+0000","last_unstale":"2024-09-17T01:36:59.881120+0000","last_undegraded":"2024-09-17T01:36:59.881120+0000","last_fullsized":"2024-09-17T01:36:59.881120+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:05.795017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873160+0000","last_change":"2024-09-17T01:37:00.877548+0000","last_active":"2024-09-17T01:37:01.873160+0000","last_peered":"2024-09-17T01:37:01.873160+0000","last_clean":"2024-09-17T01:37:01.873160+0000","last_became_active":"2024-09-17T01:37:00.876225+0000","last_became_peered":"2024-09-17T01:37:00.876225+0000","last_unstale":"2024-09-17T01:37:01.873160+0000","last_undegraded":"2024-09-17T01:37:01.873160+0000","last_fullsized":"2024-09-17T01:37:01.873160+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:59:05.289863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937544+0000","last_change":"2024-09-17T01:36:59.880051+0000","last_active":"2024-09-17T01:37:01.937544+0000","last_peered":"2024-09-17T01:37:01.937544+0000","last_clean":"2024-09-17T01:37:01.937544+0000","last_became_active":"2024-09-17T01:36:59.879720+0000","last_became_peered":"2024-09-17T01:36:59.879720+0000","last_unstale":"2024-09-17T01:37:01.937544+0000","last_undegraded":"2024-09-17T01:37:01.937544+0000","last_fullsized":"2024-09-17T01:37:01.937544+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:25.120880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872544+0000","last_change":"2024-09-17T01:37:00.882269+0000","last_active":"2024-09-17T01:37:01.872544+0000","last_peered":"2024-09-17T01:37:01.872544+0000","last_clean":"2024-09-17T01:37:01.872544+0000","last_became_active":"2024-09-17T01:37:00.881259+0000","last_became_peered":"2024-09-17T01:37:00.881259+0000","last_unstale":"2024-09-17T01:37:01.872544+0000","last_undegraded":"2024-09-17T01:37:01.872544+0000","last_fullsized":"2024-09-17T01:37:01.872544+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:54.281546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937348+0000","last_change":"2024-09-17T01:36:59.878130+0000","last_active":"2024-09-17T01:37:01.937348+0000","last_peered":"2024-09-17T01:37:01.937348+0000","last_clean":"2024-09-17T01:37:01.937348+0000","last_became_active":"2024-09-17T01:36:59.877688+0000","last_became_peered":"2024-09-17T01:36:59.877688+0000","last_unstale":"2024-09-17T01:37:01.937348+0000","last_undegraded":"2024-09-17T01:37:01.937348+0000","last_fullsized":"2024-09-17T01:37:01.937348+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:31.964182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.939045+0000","last_change":"2024-09-17T01:37:00.879111+0000","last_active":"2024-09-17T01:37:01.939045+0000","last_peered":"2024-09-17T01:37:01.939045+0000","last_clean":"2024-09-17T01:37:01.939045+0000","last_became_active":"2024-09-17T01:37:00.874367+0000","last_became_peered":"2024-09-17T01:37:00.874367+0000","last_unstale":"2024-09-17T01:37:01.939045+0000","last_undegraded":"2024-09-17T01:37:01.939045+0000","last_fullsized":"2024-09-17T01:37:01.939045+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:41.447731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.875113+0000","last_change":"2024-09-17T01:36:59.865304+0000","last_active":"2024-09-17T01:37:01.875113+0000","last_peered":"2024-09-17T01:37:01.875113+0000","last_clean":"2024-09-17T01:37:01.875113+0000","last_became_active":"2024-09-17T01:36:59.862462+0000","last_became_peered":"2024-09-17T01:36:59.862462+0000","last_unstale":"2024-09-17T01:37:01.875113+0000","last_undegraded":"2024-09-17T01:37:01.875113+0000","last_fullsized":"2024-09-17T01:37:01.875113+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:53.210356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871401+0000","last_change":"2024-09-17T01:37:00.881114+0000","last_active":"2024-09-17T01:37:01.871401+0000","last_peered":"2024-09-17T01:37:01.871401+0000","last_clean":"2024-09-17T01:37:01.871401+0000","last_became_active":"2024-09-17T01:37:00.880775+0000","last_became_peered":"2024-09-17T01:37:00.880775+0000","last_unstale":"2024-09-17T01:37:01.871401+0000","last_undegraded":"2024-09-17T01:37:01.871401+0000","last_fullsized":"2024-09-17T01:37:01.871401+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:15.044192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"78'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874869+0000","last_change":"2024-09-17T01:36:59.880330+0000","last_active":"2024-09-17T01:37:01.874869+0000","last_peered":"2024-09-17T01:37:01.874869+0000","last_clean":"2024-09-17T01:37:01.874869+0000","last_became_active":"2024-09-17T01:36:59.878802+0000","last_became_peered":"2024-09-17T01:36:59.878802+0000","last_unstale":"2024-09-17T01:37:01.874869+0000","last_undegraded":"2024-09-17T01:37:01.874869+0000","last_fullsized":"2024-09-17T01:37:01.874869+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:53.286067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938018+0000","last_change":"2024-09-17T01:37:00.872505+0000","last_active":"2024-09-17T01:37:01.938018+0000","last_peered":"2024-09-17T01:37:01.938018+0000","last_clean":"2024-09-17T01:37:01.938018+0000","last_became_active":"2024-09-17T01:37:00.872169+0000","last_became_peered":"2024-09-17T01:37:00.872169+0000","last_unstale":"2024-09-17T01:37:01.938018+0000","last_undegraded":"2024-09-17T01:37:01.938018+0000","last_fullsized":"2024-09-17T01:37:01.938018+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:40.396787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874370+0000","last_change":"2024-09-17T01:36:59.863867+0000","last_active":"2024-09-17T01:37:01.874370+0000","last_peered":"2024-09-17T01:37:01.874370+0000","last_clean":"2024-09-17T01:37:01.874370+0000","last_became_active":"2024-09-17T01:36:59.863517+0000","last_became_peered":"2024-09-17T01:36:59.863517+0000","last_unstale":"2024-09-17T01:37:01.874370+0000","last_undegraded":"2024-09-17T01:37:01.874370+0000","last_fullsized":"2024-09-17T01:37:01.874370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:15.269849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871135+0000","last_change":"2024-09-17T01:37:00.882366+0000","last_active":"2024-09-17T01:37:01.871135+0000","last_peered":"2024-09-17T01:37:01.871135+0000","last_clean":"2024-09-17T01:37:01.871135+0000","last_became_active":"2024-09-17T01:37:00.882086+0000","last_became_peered":"2024-09-17T01:37:00.882086+0000","last_unstale":"2024-09-17T01:37:01.871135+0000","last_undegraded":"2024-09-17T01:37:01.871135+0000","last_fullsized":"2024-09-17T01:37:01.871135+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:55:02.373828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873880+0000","last_change":"2024-09-17T01:36:59.869198+0000","last_active":"2024-09-17T01:37:01.873880+0000","last_peered":"2024-09-17T01:37:01.873880+0000","last_clean":"2024-09-17T01:37:01.873880+0000","last_became_active":"2024-09-17T01:36:59.868898+0000","last_became_peered":"2024-09-17T01:36:59.868898+0000","last_unstale":"2024-09-17T01:37:01.873880+0000","last_undegraded":"2024-09-17T01:37:01.873880+0000","last_fullsized":"2024-09-17T01:37:01.873880+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:12:59.919264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938070+0000","last_change":"2024-09-17T01:37:00.873280+0000","last_active":"2024-09-17T01:37:01.938070+0000","last_peered":"2024-09-17T01:37:01.938070+0000","last_clean":"2024-09-17T01:37:01.938070+0000","last_became_active":"2024-09-17T01:37:00.871566+0000","last_became_peered":"2024-09-17T01:37:00.871566+0000","last_unstale":"2024-09-17T01:37:01.938070+0000","last_undegraded":"2024-09-17T01:37:01.938070+0000","last_fullsized":"2024-09-17T01:37:01.938070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:59.796709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873685+0000","last_change":"2024-09-17T01:36:59.867758+0000","last_active":"2024-09-17T01:37:01.873685+0000","last_peered":"2024-09-17T01:37:01.873685+0000","last_clean":"2024-09-17T01:37:01.873685+0000","last_became_active":"2024-09-17T01:36:59.866985+0000","last_became_peered":"2024-09-17T01:36:59.866985+0000","last_unstale":"2024-09-17T01:37:01.873685+0000","last_undegraded":"2024-09-17T01:37:01.873685+0000","last_fullsized":"2024-09-17T01:37:01.873685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:17.223254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874679+0000","last_change":"2024-09-17T01:37:00.883794+0000","last_active":"2024-09-17T01:37:01.874679+0000","last_peered":"2024-09-17T01:37:01.874679+0000","last_clean":"2024-09-17T01:37:01.874679+0000","last_became_active":"2024-09-17T01:37:00.879349+0000","last_became_peered":"2024-09-17T01:37:00.879349+0000","last_unstale":"2024-09-17T01:37:01.874679+0000","last_undegraded":"2024-09-17T01:37:01.874679+0000","last_fullsized":"2024-09-17T01:37:01.874679+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:05.980183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938206+0000","last_change":"2024-09-17T01:36:59.872585+0000","last_active":"2024-09-17T01:37:01.938206+0000","last_peered":"2024-09-17T01:37:01.938206+0000","last_clean":"2024-09-17T01:37:01.938206+0000","last_became_active":"2024-09-17T01:36:59.870276+0000","last_became_peered":"2024-09-17T01:36:59.870276+0000","last_unstale":"2024-09-17T01:37:01.938206+0000","last_undegraded":"2024-09-17T01:37:01.938206+0000","last_fullsized":"2024-09-17T01:37:01.938206+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:51.670979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873386+0000","last_change":"2024-09-17T01:37:00.884276+0000","last_active":"2024-09-17T01:37:01.873386+0000","last_peered":"2024-09-17T01:37:01.873386+0000","last_clean":"2024-09-17T01:37:01.873386+0000","last_became_active":"2024-09-17T01:37:00.883956+0000","last_became_peered":"2024-09-17T01:37:00.883956+0000","last_unstale":"2024-09-17T01:37:01.873386+0000","last_undegraded":"2024-09-17T01:37:01.873386+0000","last_fullsized":"2024-09-17T01:37:01.873386+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:40.973377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937655+0000","last_change":"2024-09-17T01:36:59.883537+0000","last_active":"2024-09-17T01:37:01.937655+0000","last_peered":"2024-09-17T01:37:01.937655+0000","last_clean":"2024-09-17T01:37:01.937655+0000","last_became_active":"2024-09-17T01:36:59.883207+0000","last_became_peered":"2024-09-17T01:36:59.883207+0000","last_unstale":"2024-09-17T01:37:01.937655+0000","last_undegraded":"2024-09-17T01:37:01.937655+0000","last_fullsized":"2024-09-17T01:37:01.937655+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:59.069079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937976+0000","last_change":"2024-09-17T01:37:00.893414+0000","last_active":"2024-09-17T01:37:01.937976+0000","last_peered":"2024-09-17T01:37:01.937976+0000","last_clean":"2024-09-17T01:37:01.937976+0000","last_became_active":"2024-09-17T01:37:00.893040+0000","last_became_peered":"2024-09-17T01:37:00.893040+0000","last_unstale":"2024-09-17T01:37:01.937976+0000","last_undegraded":"2024-09-17T01:37:01.937976+0000","last_fullsized":"2024-09-17T01:37:01.937976+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:51.081350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-17T01:36:59.883840+0000","last_change":"2024-09-17T01:36:59.881600+0000","last_active":"2024-09-17T01:36:59.883840+0000","last_peered":"2024-09-17T01:36:59.883840+0000","last_clean":"2024-09-17T01:36:59.883840+0000","last_became_active":"2024-09-17T01:36:59.881167+0000","last_became_peered":"2024-09-17T01:36:59.881167+0000","last_unstale":"2024-09-17T01:36:59.883840+0000","last_undegraded":"2024-09-17T01:36:59.883840+0000","last_fullsized":"2024-09-17T01:36:59.883840+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:38.152666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938334+0000","last_change":"2024-09-17T01:37:00.886106+0000","last_active":"2024-09-17T01:37:01.938334+0000","last_peered":"2024-09-17T01:37:01.938334+0000","last_clean":"2024-09-17T01:37:01.938334+0000","last_became_active":"2024-09-17T01:37:00.879587+0000","last_became_peered":"2024-09-17T01:37:00.879587+0000","last_unstale":"2024-09-17T01:37:01.938334+0000","last_undegraded":"2024-09-17T01:37:01.938334+0000","last_fullsized":"2024-09-17T01:37:01.938334+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:02.658087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870731+0000","last_change":"2024-09-17T01:36:59.873087+0000","last_active":"2024-09-17T01:37:01.870731+0000","last_peered":"2024-09-17T01:37:01.870731+0000","last_clean":"2024-09-17T01:37:01.870731+0000","last_became_active":"2024-09-17T01:36:59.872734+0000","last_became_peered":"2024-09-17T01:36:59.872734+0000","last_unstale":"2024-09-17T01:37:01.870731+0000","last_undegraded":"2024-09-17T01:37:01.870731+0000","last_fullsized":"2024-09-17T01:37:01.870731+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:56:01.555936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":217,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870301+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:37:01.870301+0000","last_peered":"2024-09-17T01:37:01.870301+0000","last_clean":"2024-09-17T01:37:01.870301+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:37:01.870301+0000","last_undegraded":"2024-09-17T01:37:01.870301+0000","last_fullsized":"2024-09-17T01:37:01.870301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476801,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":917504,"data_stored":390175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509505,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40444,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331396,"statfs":{"total":96636764160,"available":96595349504,"internally_reserved":0,"allocated":954368,"data_stored":404862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509504,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40448,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331392,"statfs":{"total":96636764160,"available":96595345408,"internally_reserved":0,"allocated":958464,"data_stored":404896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509505,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44604,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327236,"statfs":{"total":96636764160,"available":96591089664,"internally_reserved":0,"allocated":954368,"data_stored":403944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509505,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":954368,"data_stored":403376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509504,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41012,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330828,"statfs":{"total":96636764160,"available":96594767872,"internally_reserved":0,"allocated":1536000,"data_stored":993618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509506,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36280,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335560,"statfs":{"total":96636764160,"available":96599613440,"internally_reserved":0,"allocated":946176,"data_stored":403320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542210,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41020,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330820,"statfs":{"total":96636764160,"available":96594759680,"internally_reserved":0,"allocated":1540096,"data_stored":993708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:37:06.381 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3a is not active+clean 2024-09-17T01:37:06.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 76, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:36:59.858191+0000', 'last_change': '2024-09-17T01:36:59.858191+0000', 'last_active': '2024-09-17T01:36:59.841771+0000', 'last_peered': '2024-09-17T01:36:59.841771+0000', 'last_clean': '2024-09-17T01:36:59.841771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:36:59.858191+0000', 'last_undegraded': '2024-09-17T01:36:59.858191+0000', 'last_fullsized': '2024-09-17T01:36:59.858191+0000', 'mapping_epoch': 76, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 76, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:36:59.841771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:36:59.841771+0000', 'last_clean_scrub_stamp': '2024-09-17T01:36:59.841771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T01:37:06.381 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2a is not active+clean 2024-09-17T01:37:06.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 76, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:36:59.857702+0000', 'last_change': '2024-09-17T01:36:59.857702+0000', 'last_active': '2024-09-17T01:36:59.841771+0000', 'last_peered': '2024-09-17T01:36:59.841771+0000', 'last_clean': '2024-09-17T01:36:59.841771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:36:59.857702+0000', 'last_undegraded': '2024-09-17T01:36:59.857702+0000', 'last_fullsized': '2024-09-17T01:36:59.857702+0000', 'mapping_epoch': 76, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 76, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:36:59.841771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:36:59.841771+0000', 'last_clean_scrub_stamp': '2024-09-17T01:36:59.841771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T01:37:06.381 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1c is not active+clean 2024-09-17T01:37:06.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 76, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:36:59.859334+0000', 'last_change': '2024-09-17T01:36:59.859334+0000', 'last_active': '2024-09-17T01:36:59.841771+0000', 'last_peered': '2024-09-17T01:36:59.841771+0000', 'last_clean': '2024-09-17T01:36:59.841771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:36:59.859334+0000', 'last_undegraded': '2024-09-17T01:36:59.859334+0000', 'last_fullsized': '2024-09-17T01:36:59.859334+0000', 'mapping_epoch': 76, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 76, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:36:59.841771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:36:59.841771+0000', 'last_clean_scrub_stamp': '2024-09-17T01:36:59.841771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T01:37:06.382 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1b is not active+clean 2024-09-17T01:37:06.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 76, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:36:59.856709+0000', 'last_change': '2024-09-17T01:36:59.856709+0000', 'last_active': '2024-09-17T01:36:59.841771+0000', 'last_peered': '2024-09-17T01:36:59.841771+0000', 'last_clean': '2024-09-17T01:36:59.841771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:36:59.856709+0000', 'last_undegraded': '2024-09-17T01:36:59.856709+0000', 'last_fullsized': '2024-09-17T01:36:59.856709+0000', 'mapping_epoch': 76, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 76, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:36:59.841771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:36:59.841771+0000', 'last_clean_scrub_stamp': '2024-09-17T01:36:59.841771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T01:37:06.382 INFO:tasks.ceph.ceph_manager.ceph:PG 11.12 is not active+clean 2024-09-17T01:37:06.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 76, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:36:59.856803+0000', 'last_change': '2024-09-17T01:36:59.856803+0000', 'last_active': '2024-09-17T01:36:59.841771+0000', 'last_peered': '2024-09-17T01:36:59.841771+0000', 'last_clean': '2024-09-17T01:36:59.841771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:36:59.856803+0000', 'last_undegraded': '2024-09-17T01:36:59.856803+0000', 'last_fullsized': '2024-09-17T01:36:59.856803+0000', 'mapping_epoch': 76, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 76, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:36:59.841771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:36:59.841771+0000', 'last_clean_scrub_stamp': '2024-09-17T01:36:59.841771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T01:37:06.382 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:37:06.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.647+0000 7fa329000640 1 -- 172.21.15.42:0/822506961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3240cf7c0 msgr2=0x7fa32406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:06.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.647+0000 7fa329000640 1 --2- 172.21.15.42:0/822506961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3240cf7c0 0x7fa32406cd20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009830 tx=0x7fa30c02a5b0 comp rx=0 tx=0).stop 2024-09-17T01:37:06.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.647+0000 7fa329000640 1 -- 172.21.15.42:0/822506961 shutdown_connections 2024-09-17T01:37:06.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.647+0000 7fa329000640 1 --2- 172.21.15.42:0/822506961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3240cf7c0 0x7fa32406cd20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:06.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.647+0000 7fa329000640 1 -- 172.21.15.42:0/822506961 >> 172.21.15.42:0/822506961 conn(0x7fa3240b25f0 msgr2=0x7fa3240d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:06.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.647+0000 7fa329000640 1 -- 172.21.15.42:0/822506961 shutdown_connections 2024-09-17T01:37:06.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.647+0000 7fa329000640 1 -- 172.21.15.42:0/822506961 wait complete. 2024-09-17T01:37:06.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.649+0000 7fa329000640 1 Processor -- start 2024-09-17T01:37:06.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.649+0000 7fa329000640 1 -- start start 2024-09-17T01:37:06.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.651+0000 7fa329000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa32406d260 0x7fa3240734c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:06.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.651+0000 7fa329000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa3240b4be0 0x7fa3241f5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:06.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.651+0000 7fa329000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3240cf7c0 0x7fa32409dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:06.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.651+0000 7fa329000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa3241535e0 con 0x7fa3240cf7c0 2024-09-17T01:37:06.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.651+0000 7fa329000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa3240b4340 con 0x7fa32406d260 2024-09-17T01:37:06.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.651+0000 7fa329000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa324153760 con 0x7fa3240b4be0 2024-09-17T01:37:06.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.651+0000 7fa323e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3240cf7c0 0x7fa32409dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:06.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.651+0000 7fa323e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3240cf7c0 0x7fa32409dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53226/0 (socket says 172.21.15.42:53226) 2024-09-17T01:37:06.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.651+0000 7fa323e00640 1 -- 172.21.15.42:0/3737546462 learned_addr learned my addr 172.21.15.42:0/3737546462 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:06.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.651+0000 7fa323400640 1 --2- 172.21.15.42:0/3737546462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa32406d260 0x7fa3240734c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:06.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.651+0000 7fa31aa00640 1 --2- 172.21.15.42:0/3737546462 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa3240b4be0 0x7fa3241f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:06.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.651+0000 7fa323e00640 1 -- 172.21.15.42:0/3737546462 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa3240b4be0 msgr2=0x7fa3241f5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:06.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.651+0000 7fa323e00640 1 --2- 172.21.15.42:0/3737546462 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa3240b4be0 0x7fa3241f5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:06.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.651+0000 7fa323e00640 1 -- 172.21.15.42:0/3737546462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa32406d260 msgr2=0x7fa3240734c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:06.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.651+0000 7fa323e00640 1 --2- 172.21.15.42:0/3737546462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa32406d260 0x7fa3240734c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:06.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.651+0000 7fa323e00640 1 -- 172.21.15.42:0/3737546462 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3241f5d40 con 0x7fa3240cf7c0 2024-09-17T01:37:06.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.651+0000 7fa31aa00640 1 --2- 172.21.15.42:0/3737546462 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa3240b4be0 0x7fa3241f5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:06.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.652+0000 7fa323e00640 1 --2- 172.21.15.42:0/3737546462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3240cf7c0 0x7fa32409dc40 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00caa0 tx=0x7fa31c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:06.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.652+0000 7fa31be00640 1 -- 172.21.15.42:0/3737546462 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31c016020 con 0x7fa3240cf7c0 2024-09-17T01:37:06.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.652+0000 7fa31be00640 1 -- 172.21.15.42:0/3737546462 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa31c00ad10 con 0x7fa3240cf7c0 2024-09-17T01:37:06.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.652+0000 7fa31be00640 1 -- 172.21.15.42:0/3737546462 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31c012680 con 0x7fa3240cf7c0 2024-09-17T01:37:06.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.652+0000 7fa329000640 1 -- 172.21.15.42:0/3737546462 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3241f6780 con 0x7fa3240cf7c0 2024-09-17T01:37:06.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.652+0000 7fa329000640 1 -- 172.21.15.42:0/3737546462 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3241f64a0 con 0x7fa3240cf7c0 2024-09-17T01:37:06.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.653+0000 7fa329000640 1 -- 172.21.15.42:0/3737546462 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3241f5f10 con 0x7fa3240cf7c0 2024-09-17T01:37:06.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.654+0000 7fa31be00640 1 -- 172.21.15.42:0/3737546462 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa31c019020 con 0x7fa3240cf7c0 2024-09-17T01:37:06.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.655+0000 7fa31be00640 1 --2- 172.21.15.42:0/3737546462 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa300078bc0 0x7fa30007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:06.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.655+0000 7fa31be00640 1 -- 172.21.15.42:0/3737546462 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7fa31c09ae60 con 0x7fa3240cf7c0 2024-09-17T01:37:06.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.656+0000 7fa323400640 1 --2- 172.21.15.42:0/3737546462 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa300078bc0 0x7fa30007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:06.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.657+0000 7fa323400640 1 --2- 172.21.15.42:0/3737546462 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa300078bc0 0x7fa30007b0d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa314000c00 tx=0x7fa314009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:06.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.660+0000 7fa31be00640 1 -- 172.21.15.42:0/3737546462 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa31c020030 con 0x7fa3240cf7c0 2024-09-17T01:37:06.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.928+0000 7fa329000640 1 -- 172.21.15.42:0/3737546462 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa32406cd20 con 0x7fa3240cf7c0 2024-09-17T01:37:06.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.928+0000 7fa31be00640 1 -- 172.21.15.42:0/3737546462 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1561 (secure 0 0 0) 0x7fa32406d670 con 0x7fa3240cf7c0 2024-09-17T01:37:06.926 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:06.926 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":327,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":78,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":92},{"state_name":"creating+peering","count":5}],"num_pgs":97,"num_pools":3,"num_objects":21,"data_bytes":592196,"bytes_used":306896896,"bytes_avail":772787216384,"bytes_total":773094113280,"inactive_pgs_ratio":0.051546391099691391,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":56,"btime":"2024-09-17T01:37:03:878707+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":6729}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":16,"modified":"2024-09-17T01:36:47.057204+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:37:06.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.931+0000 7fa329000640 1 -- 172.21.15.42:0/3737546462 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa300078bc0 msgr2=0x7fa30007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:06.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.931+0000 7fa329000640 1 --2- 172.21.15.42:0/3737546462 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa300078bc0 0x7fa30007b0d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa314000c00 tx=0x7fa314009040 comp rx=0 tx=0).stop 2024-09-17T01:37:06.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.931+0000 7fa329000640 1 -- 172.21.15.42:0/3737546462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3240cf7c0 msgr2=0x7fa32409dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:06.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.931+0000 7fa329000640 1 --2- 172.21.15.42:0/3737546462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3240cf7c0 0x7fa32409dc40 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00caa0 tx=0x7fa31c00cf60 comp rx=0 tx=0).stop 2024-09-17T01:37:06.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.931+0000 7fa329000640 1 -- 172.21.15.42:0/3737546462 shutdown_connections 2024-09-17T01:37:06.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.931+0000 7fa329000640 1 --2- 172.21.15.42:0/3737546462 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa300078bc0 0x7fa30007b0d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:06.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.931+0000 7fa329000640 1 --2- 172.21.15.42:0/3737546462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3240cf7c0 0x7fa32409dc40 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:06.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.931+0000 7fa329000640 1 --2- 172.21.15.42:0/3737546462 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa3240b4be0 0x7fa3241f5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:06.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.931+0000 7fa329000640 1 --2- 172.21.15.42:0/3737546462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa32406d260 0x7fa3240734c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:06.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.931+0000 7fa329000640 1 -- 172.21.15.42:0/3737546462 >> 172.21.15.42:0/3737546462 conn(0x7fa3240b25f0 msgr2=0x7fa3240ce880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:06.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.931+0000 7fa329000640 1 -- 172.21.15.42:0/3737546462 shutdown_connections 2024-09-17T01:37:06.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:06.931+0000 7fa329000640 1 -- 172.21.15.42:0/3737546462 wait complete. 2024-09-17T01:37:06.950 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T01:37:06.950 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:37:07.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.180+0000 7f6939e00640 1 -- 172.21.15.42:0/3527728378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6918004000 msgr2=0x7f6918004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:07.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.180+0000 7f6939e00640 1 --2- 172.21.15.42:0/3527728378 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6918004000 0x7f6918004800 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f691c00c310 tx=0x7f6918005830 comp rx=0 tx=0).stop 2024-09-17T01:37:07.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.180+0000 7f6939400640 1 -- 172.21.15.42:0/3527728378 reap_dead start 2024-09-17T01:37:07.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.180+0000 7f6939e00640 1 -- 172.21.15.42:0/3527728378 shutdown_connections 2024-09-17T01:37:07.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.180+0000 7f6939e00640 1 -- 172.21.15.42:0/3527728378 >> 172.21.15.42:0/3527728378 conn(0x7f69340b25f0 msgr2=0x7f69340d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:07.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.180+0000 7f6939e00640 1 -- 172.21.15.42:0/3527728378 shutdown_connections 2024-09-17T01:37:07.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.180+0000 7f6939e00640 1 -- 172.21.15.42:0/3527728378 wait complete. 2024-09-17T01:37:07.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.182+0000 7f6939e00640 1 Processor -- start 2024-09-17T01:37:07.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.183+0000 7f6939e00640 1 -- start start 2024-09-17T01:37:07.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.184+0000 7f6939e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6918004000 0x7f6934159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:07.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.184+0000 7f6939e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69340ca4f0 0x7f69340c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:07.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.184+0000 7f6939e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f69340aece0 0x7f69340c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:07.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.184+0000 7f6939e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f693406f1e0 con 0x7f6918004000 2024-09-17T01:37:07.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.184+0000 7f6939e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f693406f060 con 0x7f69340aece0 2024-09-17T01:37:07.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.184+0000 7f6939e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f693406f360 con 0x7f69340ca4f0 2024-09-17T01:37:07.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.184+0000 7f6938a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6918004000 0x7f6934159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:07.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.184+0000 7f6938a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6918004000 0x7f6934159d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53244/0 (socket says 172.21.15.42:53244) 2024-09-17T01:37:07.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.184+0000 7f6938a00640 1 -- 172.21.15.42:0/2880145234 learned_addr learned my addr 172.21.15.42:0/2880145234 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:07.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.185+0000 7f692be00640 1 --2- 172.21.15.42:0/2880145234 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69340ca4f0 0x7f69340c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:07.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.185+0000 7f6939400640 1 --2- 172.21.15.42:0/2880145234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f69340aece0 0x7f69340c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:07.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.185+0000 7f6938a00640 1 -- 172.21.15.42:0/2880145234 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69340ca4f0 msgr2=0x7f69340c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:07.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.185+0000 7f6938a00640 1 --2- 172.21.15.42:0/2880145234 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69340ca4f0 0x7f69340c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:07.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.185+0000 7f6938a00640 1 -- 172.21.15.42:0/2880145234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f69340aece0 msgr2=0x7f69340c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:07.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.185+0000 7f6938a00640 1 --2- 172.21.15.42:0/2880145234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f69340aece0 0x7f69340c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:07.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.185+0000 7f6938a00640 1 -- 172.21.15.42:0/2880145234 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69340ad080 con 0x7f6918004000 2024-09-17T01:37:07.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.185+0000 7f6939400640 1 --2- 172.21.15.42:0/2880145234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f69340aece0 0x7f69340c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:07.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.185+0000 7f6938a00640 1 --2- 172.21.15.42:0/2880145234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6918004000 0x7f6934159d50 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f6924011ae0 tx=0x7f6924009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:07.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.185+0000 7f6931600640 1 -- 172.21.15.42:0/2880145234 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692401e070 con 0x7f6918004000 2024-09-17T01:37:07.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.186+0000 7f6931600640 1 -- 172.21.15.42:0/2880145234 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6924004460 con 0x7f6918004000 2024-09-17T01:37:07.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.186+0000 7f6939e00640 1 -- 172.21.15.42:0/2880145234 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69340ad4f0 con 0x7f6918004000 2024-09-17T01:37:07.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.186+0000 7f6931600640 1 -- 172.21.15.42:0/2880145234 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692400fc60 con 0x7f6918004000 2024-09-17T01:37:07.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.186+0000 7f6939e00640 1 -- 172.21.15.42:0/2880145234 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69340adab0 con 0x7f6918004000 2024-09-17T01:37:07.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.187+0000 7f6939e00640 1 -- 172.21.15.42:0/2880145234 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f693406f860 con 0x7f6918004000 2024-09-17T01:37:07.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.188+0000 7f6931600640 1 -- 172.21.15.42:0/2880145234 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6924021070 con 0x7f6918004000 2024-09-17T01:37:07.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.189+0000 7f6931600640 1 --2- 172.21.15.42:0/2880145234 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6910078b90 0x7f691007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:07.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.189+0000 7f6931600640 1 -- 172.21.15.42:0/2880145234 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7f692409b820 con 0x7f6918004000 2024-09-17T01:37:07.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.189+0000 7f692be00640 1 --2- 172.21.15.42:0/2880145234 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6910078b90 0x7f691007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:07.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.190+0000 7f692be00640 1 --2- 172.21.15.42:0/2880145234 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6910078b90 0x7f691007b0a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f691c033000 tx=0x7f691c0019f0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:07.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.194+0000 7f6931600640 1 -- 172.21.15.42:0/2880145234 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6924063630 con 0x7f6918004000 2024-09-17T01:37:07.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.386+0000 7f6939e00640 1 -- 172.21.15.42:0/2880145234 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f69340ae100 con 0x7f6910078b90 2024-09-17T01:37:07.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.391+0000 7f6931600640 1 -- 172.21.15.42:0/2880145234 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252061 (secure 0 0 0) 0x7f691c0818b0 con 0x7f6910078b90 2024-09-17T01:37:07.392 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:07.393 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:37:07.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.396+0000 7f6939e00640 1 -- 172.21.15.42:0/2880145234 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6910078b90 msgr2=0x7f691007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:07.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.396+0000 7f6939e00640 1 --2- 172.21.15.42:0/2880145234 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6910078b90 0x7f691007b0a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f691c033000 tx=0x7f691c0019f0 comp rx=0 tx=0).stop 2024-09-17T01:37:07.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.396+0000 7f6939e00640 1 -- 172.21.15.42:0/2880145234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6918004000 msgr2=0x7f6934159d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:07.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.396+0000 7f6939e00640 1 --2- 172.21.15.42:0/2880145234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6918004000 0x7f6934159d50 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f6924011ae0 tx=0x7f6924009e90 comp rx=0 tx=0).stop 2024-09-17T01:37:07.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.396+0000 7f6939e00640 1 -- 172.21.15.42:0/2880145234 shutdown_connections 2024-09-17T01:37:07.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.396+0000 7f6939e00640 1 --2- 172.21.15.42:0/2880145234 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6910078b90 0x7f691007b0a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:07.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.396+0000 7f6939e00640 1 --2- 172.21.15.42:0/2880145234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f69340aece0 0x7f69340c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:07.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.396+0000 7f6939e00640 1 --2- 172.21.15.42:0/2880145234 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f69340ca4f0 0x7f69340c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:07.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.396+0000 7f6939e00640 1 --2- 172.21.15.42:0/2880145234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6918004000 0x7f6934159d50 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:07.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.396+0000 7f6939e00640 1 -- 172.21.15.42:0/2880145234 >> 172.21.15.42:0/2880145234 conn(0x7f69340b25f0 msgr2=0x7f69340b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:07.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.396+0000 7f6939e00640 1 -- 172.21.15.42:0/2880145234 shutdown_connections 2024-09-17T01:37:07.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:07.396+0000 7f6939e00640 1 -- 172.21.15.42:0/2880145234 wait complete. 2024-09-17T01:37:07.416 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":228,"stamp":"2024-09-17T01:37:07.062864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":299728,"kb_used_data":8584,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754674992,"statfs":{"total":773094113280,"available":772787191808,"internally_reserved":0,"allocated":8790016,"data_stored":4411556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":297913908},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.212887"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.875283+0000","last_change":"2024-09-17T01:37:00.894727+0000","last_active":"2024-09-17T01:37:01.875283+0000","last_peered":"2024-09-17T01:37:01.875283+0000","last_clean":"2024-09-17T01:37:01.875283+0000","last_became_active":"2024-09-17T01:37:00.894422+0000","last_became_peered":"2024-09-17T01:37:00.894422+0000","last_unstale":"2024-09-17T01:37:01.875283+0000","last_undegraded":"2024-09-17T01:37:01.875283+0000","last_fullsized":"2024-09-17T01:37:01.875283+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:07.471265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938210+0000","last_change":"2024-09-17T01:37:00.883141+0000","last_active":"2024-09-17T01:37:01.938210+0000","last_peered":"2024-09-17T01:37:01.938210+0000","last_clean":"2024-09-17T01:37:01.938210+0000","last_became_active":"2024-09-17T01:37:00.882588+0000","last_became_peered":"2024-09-17T01:37:00.882588+0000","last_unstale":"2024-09-17T01:37:01.938210+0000","last_undegraded":"2024-09-17T01:37:01.938210+0000","last_fullsized":"2024-09-17T01:37:01.938210+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:37:06.008340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938115+0000","last_change":"2024-09-17T01:37:00.886235+0000","last_active":"2024-09-17T01:37:01.938115+0000","last_peered":"2024-09-17T01:37:01.938115+0000","last_clean":"2024-09-17T01:37:01.938115+0000","last_became_active":"2024-09-17T01:37:00.884395+0000","last_became_peered":"2024-09-17T01:37:00.884395+0000","last_unstale":"2024-09-17T01:37:01.938115+0000","last_undegraded":"2024-09-17T01:37:01.938115+0000","last_fullsized":"2024-09-17T01:37:01.938115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:46.190213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938091+0000","last_change":"2024-09-17T01:37:00.882991+0000","last_active":"2024-09-17T01:37:01.938091+0000","last_peered":"2024-09-17T01:37:01.938091+0000","last_clean":"2024-09-17T01:37:01.938091+0000","last_became_active":"2024-09-17T01:37:00.882627+0000","last_became_peered":"2024-09-17T01:37:00.882627+0000","last_unstale":"2024-09-17T01:37:01.938091+0000","last_undegraded":"2024-09-17T01:37:01.938091+0000","last_fullsized":"2024-09-17T01:37:01.938091+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:18.536668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937768+0000","last_change":"2024-09-17T01:37:00.879118+0000","last_active":"2024-09-17T01:37:01.937768+0000","last_peered":"2024-09-17T01:37:01.937768+0000","last_clean":"2024-09-17T01:37:01.937768+0000","last_became_active":"2024-09-17T01:37:00.878074+0000","last_became_peered":"2024-09-17T01:37:00.878074+0000","last_unstale":"2024-09-17T01:37:01.937768+0000","last_undegraded":"2024-09-17T01:37:01.937768+0000","last_fullsized":"2024-09-17T01:37:01.937768+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:11.586434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937221+0000","last_change":"2024-09-17T01:37:00.873819+0000","last_active":"2024-09-17T01:37:01.937221+0000","last_peered":"2024-09-17T01:37:01.937221+0000","last_clean":"2024-09-17T01:37:01.937221+0000","last_became_active":"2024-09-17T01:37:00.873493+0000","last_became_peered":"2024-09-17T01:37:00.873493+0000","last_unstale":"2024-09-17T01:37:01.937221+0000","last_undegraded":"2024-09-17T01:37:01.937221+0000","last_fullsized":"2024-09-17T01:37:01.937221+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:00.534787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870613+0000","last_change":"2024-09-17T01:37:00.885660+0000","last_active":"2024-09-17T01:37:01.870613+0000","last_peered":"2024-09-17T01:37:01.870613+0000","last_clean":"2024-09-17T01:37:01.870613+0000","last_became_active":"2024-09-17T01:37:00.875481+0000","last_became_peered":"2024-09-17T01:37:00.875481+0000","last_unstale":"2024-09-17T01:37:01.870613+0000","last_undegraded":"2024-09-17T01:37:01.870613+0000","last_fullsized":"2024-09-17T01:37:01.870613+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:54.284586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874358+0000","last_change":"2024-09-17T01:37:00.887879+0000","last_active":"2024-09-17T01:37:01.874358+0000","last_peered":"2024-09-17T01:37:01.874358+0000","last_clean":"2024-09-17T01:37:01.874358+0000","last_became_active":"2024-09-17T01:37:00.886811+0000","last_became_peered":"2024-09-17T01:37:00.886811+0000","last_unstale":"2024-09-17T01:37:01.874358+0000","last_undegraded":"2024-09-17T01:37:01.874358+0000","last_fullsized":"2024-09-17T01:37:01.874358+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:07.671917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938274+0000","last_change":"2024-09-17T01:37:00.880205+0000","last_active":"2024-09-17T01:37:01.938274+0000","last_peered":"2024-09-17T01:37:01.938274+0000","last_clean":"2024-09-17T01:37:01.938274+0000","last_became_active":"2024-09-17T01:37:00.879875+0000","last_became_peered":"2024-09-17T01:37:00.879875+0000","last_unstale":"2024-09-17T01:37:01.938274+0000","last_undegraded":"2024-09-17T01:37:01.938274+0000","last_fullsized":"2024-09-17T01:37:01.938274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:26.752484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871291+0000","last_change":"2024-09-17T01:37:00.874744+0000","last_active":"2024-09-17T01:37:01.871291+0000","last_peered":"2024-09-17T01:37:01.871291+0000","last_clean":"2024-09-17T01:37:01.871291+0000","last_became_active":"2024-09-17T01:37:00.872129+0000","last_became_peered":"2024-09-17T01:37:00.872129+0000","last_unstale":"2024-09-17T01:37:01.871291+0000","last_undegraded":"2024-09-17T01:37:01.871291+0000","last_fullsized":"2024-09-17T01:37:01.871291+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:40.026790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.875017+0000","last_change":"2024-09-17T01:37:00.886368+0000","last_active":"2024-09-17T01:37:01.875017+0000","last_peered":"2024-09-17T01:37:01.875017+0000","last_clean":"2024-09-17T01:37:01.875017+0000","last_became_active":"2024-09-17T01:37:00.886042+0000","last_became_peered":"2024-09-17T01:37:00.886042+0000","last_unstale":"2024-09-17T01:37:01.875017+0000","last_undegraded":"2024-09-17T01:37:01.875017+0000","last_fullsized":"2024-09-17T01:37:01.875017+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:51.174176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874503+0000","last_change":"2024-09-17T01:37:00.878779+0000","last_active":"2024-09-17T01:37:01.874503+0000","last_peered":"2024-09-17T01:37:01.874503+0000","last_clean":"2024-09-17T01:37:01.874503+0000","last_became_active":"2024-09-17T01:37:00.878431+0000","last_became_peered":"2024-09-17T01:37:00.878431+0000","last_unstale":"2024-09-17T01:37:01.874503+0000","last_undegraded":"2024-09-17T01:37:01.874503+0000","last_fullsized":"2024-09-17T01:37:01.874503+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:54.289027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937788+0000","last_change":"2024-09-17T01:37:00.883220+0000","last_active":"2024-09-17T01:37:01.937788+0000","last_peered":"2024-09-17T01:37:01.937788+0000","last_clean":"2024-09-17T01:37:01.937788+0000","last_became_active":"2024-09-17T01:37:00.882923+0000","last_became_peered":"2024-09-17T01:37:00.882923+0000","last_unstale":"2024-09-17T01:37:01.937788+0000","last_undegraded":"2024-09-17T01:37:01.937788+0000","last_fullsized":"2024-09-17T01:37:01.937788+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:48.939780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872570+0000","last_change":"2024-09-17T01:37:00.883960+0000","last_active":"2024-09-17T01:37:01.872570+0000","last_peered":"2024-09-17T01:37:01.872570+0000","last_clean":"2024-09-17T01:37:01.872570+0000","last_became_active":"2024-09-17T01:37:00.883650+0000","last_became_peered":"2024-09-17T01:37:00.883650+0000","last_unstale":"2024-09-17T01:37:01.872570+0000","last_undegraded":"2024-09-17T01:37:01.872570+0000","last_fullsized":"2024-09-17T01:37:01.872570+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:50:00.925352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872236+0000","last_change":"2024-09-17T01:37:00.874456+0000","last_active":"2024-09-17T01:37:01.872236+0000","last_peered":"2024-09-17T01:37:01.872236+0000","last_clean":"2024-09-17T01:37:01.872236+0000","last_became_active":"2024-09-17T01:37:00.870867+0000","last_became_peered":"2024-09-17T01:37:00.870867+0000","last_unstale":"2024-09-17T01:37:01.872236+0000","last_undegraded":"2024-09-17T01:37:01.872236+0000","last_fullsized":"2024-09-17T01:37:01.872236+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:15:29.982832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874345+0000","last_change":"2024-09-17T01:37:00.893408+0000","last_active":"2024-09-17T01:37:01.874345+0000","last_peered":"2024-09-17T01:37:01.874345+0000","last_clean":"2024-09-17T01:37:01.874345+0000","last_became_active":"2024-09-17T01:37:00.887416+0000","last_became_peered":"2024-09-17T01:37:00.887416+0000","last_unstale":"2024-09-17T01:37:01.874345+0000","last_undegraded":"2024-09-17T01:37:01.874345+0000","last_fullsized":"2024-09-17T01:37:01.874345+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:22.689477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938992+0000","last_change":"2024-09-17T01:37:00.872192+0000","last_active":"2024-09-17T01:37:01.938992+0000","last_peered":"2024-09-17T01:37:01.938992+0000","last_clean":"2024-09-17T01:37:01.938992+0000","last_became_active":"2024-09-17T01:37:00.871809+0000","last_became_peered":"2024-09-17T01:37:00.871809+0000","last_unstale":"2024-09-17T01:37:01.938992+0000","last_undegraded":"2024-09-17T01:37:01.938992+0000","last_fullsized":"2024-09-17T01:37:01.938992+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:55.876836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938793+0000","last_change":"2024-09-17T01:37:00.866290+0000","last_active":"2024-09-17T01:37:01.938793+0000","last_peered":"2024-09-17T01:37:01.938793+0000","last_clean":"2024-09-17T01:37:01.938793+0000","last_became_active":"2024-09-17T01:37:00.865874+0000","last_became_peered":"2024-09-17T01:37:00.865874+0000","last_unstale":"2024-09-17T01:37:01.938793+0000","last_undegraded":"2024-09-17T01:37:01.938793+0000","last_fullsized":"2024-09-17T01:37:01.938793+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:38.896993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874806+0000","last_change":"2024-09-17T01:37:00.897310+0000","last_active":"2024-09-17T01:37:01.874806+0000","last_peered":"2024-09-17T01:37:01.874806+0000","last_clean":"2024-09-17T01:37:01.874806+0000","last_became_active":"2024-09-17T01:37:00.896955+0000","last_became_peered":"2024-09-17T01:37:00.896955+0000","last_unstale":"2024-09-17T01:37:01.874806+0000","last_undegraded":"2024-09-17T01:37:01.874806+0000","last_fullsized":"2024-09-17T01:37:01.874806+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:04:01.328671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938592+0000","last_change":"2024-09-17T01:37:00.866925+0000","last_active":"2024-09-17T01:37:01.938592+0000","last_peered":"2024-09-17T01:37:01.938592+0000","last_clean":"2024-09-17T01:37:01.938592+0000","last_became_active":"2024-09-17T01:37:00.866542+0000","last_became_peered":"2024-09-17T01:37:00.866542+0000","last_unstale":"2024-09-17T01:37:01.938592+0000","last_undegraded":"2024-09-17T01:37:01.938592+0000","last_fullsized":"2024-09-17T01:37:01.938592+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:36.164907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937799+0000","last_change":"2024-09-17T01:37:00.874085+0000","last_active":"2024-09-17T01:37:01.937799+0000","last_peered":"2024-09-17T01:37:01.937799+0000","last_clean":"2024-09-17T01:37:01.937799+0000","last_became_active":"2024-09-17T01:37:00.873522+0000","last_became_peered":"2024-09-17T01:37:00.873522+0000","last_unstale":"2024-09-17T01:37:01.937799+0000","last_undegraded":"2024-09-17T01:37:01.937799+0000","last_fullsized":"2024-09-17T01:37:01.937799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:16.272810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937282+0000","last_change":"2024-09-17T01:37:00.864433+0000","last_active":"2024-09-17T01:37:01.937282+0000","last_peered":"2024-09-17T01:37:01.937282+0000","last_clean":"2024-09-17T01:37:01.937282+0000","last_became_active":"2024-09-17T01:37:00.864086+0000","last_became_peered":"2024-09-17T01:37:00.864086+0000","last_unstale":"2024-09-17T01:37:01.937282+0000","last_undegraded":"2024-09-17T01:37:01.937282+0000","last_fullsized":"2024-09-17T01:37:01.937282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:23.823387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870493+0000","last_change":"2024-09-17T01:37:00.886408+0000","last_active":"2024-09-17T01:37:01.870493+0000","last_peered":"2024-09-17T01:37:01.870493+0000","last_clean":"2024-09-17T01:37:01.870493+0000","last_became_active":"2024-09-17T01:37:00.886111+0000","last_became_peered":"2024-09-17T01:37:00.886111+0000","last_unstale":"2024-09-17T01:37:01.870493+0000","last_undegraded":"2024-09-17T01:37:01.870493+0000","last_fullsized":"2024-09-17T01:37:01.870493+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:10.335496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874607+0000","last_change":"2024-09-17T01:37:00.874639+0000","last_active":"2024-09-17T01:37:01.874607+0000","last_peered":"2024-09-17T01:37:01.874607+0000","last_clean":"2024-09-17T01:37:01.874607+0000","last_became_active":"2024-09-17T01:37:00.874352+0000","last_became_peered":"2024-09-17T01:37:00.874352+0000","last_unstale":"2024-09-17T01:37:01.874607+0000","last_undegraded":"2024-09-17T01:37:01.874607+0000","last_fullsized":"2024-09-17T01:37:01.874607+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:56.583515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871375+0000","last_change":"2024-09-17T01:37:00.881981+0000","last_active":"2024-09-17T01:37:01.871375+0000","last_peered":"2024-09-17T01:37:01.871375+0000","last_clean":"2024-09-17T01:37:01.871375+0000","last_became_active":"2024-09-17T01:37:00.881639+0000","last_became_peered":"2024-09-17T01:37:00.881639+0000","last_unstale":"2024-09-17T01:37:01.871375+0000","last_undegraded":"2024-09-17T01:37:01.871375+0000","last_fullsized":"2024-09-17T01:37:01.871375+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:58.500831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874725+0000","last_change":"2024-09-17T01:37:00.895616+0000","last_active":"2024-09-17T01:37:01.874725+0000","last_peered":"2024-09-17T01:37:01.874725+0000","last_clean":"2024-09-17T01:37:01.874725+0000","last_became_active":"2024-09-17T01:37:00.895306+0000","last_became_peered":"2024-09-17T01:37:00.895306+0000","last_unstale":"2024-09-17T01:37:01.874725+0000","last_undegraded":"2024-09-17T01:37:01.874725+0000","last_fullsized":"2024-09-17T01:37:01.874725+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:33.147682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938197+0000","last_change":"2024-09-17T01:37:00.883738+0000","last_active":"2024-09-17T01:37:01.938197+0000","last_peered":"2024-09-17T01:37:01.938197+0000","last_clean":"2024-09-17T01:37:01.938197+0000","last_became_active":"2024-09-17T01:37:00.883028+0000","last_became_peered":"2024-09-17T01:37:00.883028+0000","last_unstale":"2024-09-17T01:37:01.938197+0000","last_undegraded":"2024-09-17T01:37:01.938197+0000","last_fullsized":"2024-09-17T01:37:01.938197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:50:15.638098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937702+0000","last_change":"2024-09-17T01:37:00.875084+0000","last_active":"2024-09-17T01:37:01.937702+0000","last_peered":"2024-09-17T01:37:01.937702+0000","last_clean":"2024-09-17T01:37:01.937702+0000","last_became_active":"2024-09-17T01:37:00.873935+0000","last_became_peered":"2024-09-17T01:37:00.873935+0000","last_unstale":"2024-09-17T01:37:01.937702+0000","last_undegraded":"2024-09-17T01:37:01.937702+0000","last_fullsized":"2024-09-17T01:37:01.937702+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:49.735347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937846+0000","last_change":"2024-09-17T01:37:00.881622+0000","last_active":"2024-09-17T01:37:01.937846+0000","last_peered":"2024-09-17T01:37:01.937846+0000","last_clean":"2024-09-17T01:37:01.937846+0000","last_became_active":"2024-09-17T01:37:00.880763+0000","last_became_peered":"2024-09-17T01:37:00.880763+0000","last_unstale":"2024-09-17T01:37:01.937846+0000","last_undegraded":"2024-09-17T01:37:01.937846+0000","last_fullsized":"2024-09-17T01:37:01.937846+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:38.263600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874922+0000","last_change":"2024-09-17T01:37:00.895593+0000","last_active":"2024-09-17T01:37:01.874922+0000","last_peered":"2024-09-17T01:37:01.874922+0000","last_clean":"2024-09-17T01:37:01.874922+0000","last_became_active":"2024-09-17T01:37:00.895223+0000","last_became_peered":"2024-09-17T01:37:00.895223+0000","last_unstale":"2024-09-17T01:37:01.874922+0000","last_undegraded":"2024-09-17T01:37:01.874922+0000","last_fullsized":"2024-09-17T01:37:01.874922+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:27.587846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937475+0000","last_change":"2024-09-17T01:37:00.877026+0000","last_active":"2024-09-17T01:37:01.937475+0000","last_peered":"2024-09-17T01:37:01.937475+0000","last_clean":"2024-09-17T01:37:01.937475+0000","last_became_active":"2024-09-17T01:37:00.876085+0000","last_became_peered":"2024-09-17T01:37:00.876085+0000","last_unstale":"2024-09-17T01:37:01.937475+0000","last_undegraded":"2024-09-17T01:37:01.937475+0000","last_fullsized":"2024-09-17T01:37:01.937475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:30.108084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937154+0000","last_change":"2024-09-17T01:37:00.873456+0000","last_active":"2024-09-17T01:37:01.937154+0000","last_peered":"2024-09-17T01:37:01.937154+0000","last_clean":"2024-09-17T01:37:01.937154+0000","last_became_active":"2024-09-17T01:37:00.873158+0000","last_became_peered":"2024-09-17T01:37:00.873158+0000","last_unstale":"2024-09-17T01:37:01.937154+0000","last_undegraded":"2024-09-17T01:37:01.937154+0000","last_fullsized":"2024-09-17T01:37:01.937154+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:57:26.714304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.875006+0000","last_change":"2024-09-17T01:37:00.881273+0000","last_active":"2024-09-17T01:37:01.875006+0000","last_peered":"2024-09-17T01:37:01.875006+0000","last_clean":"2024-09-17T01:37:01.875006+0000","last_became_active":"2024-09-17T01:37:00.880964+0000","last_became_peered":"2024-09-17T01:37:00.880964+0000","last_unstale":"2024-09-17T01:37:01.875006+0000","last_undegraded":"2024-09-17T01:37:01.875006+0000","last_fullsized":"2024-09-17T01:37:01.875006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.293605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"77'4","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938142+0000","last_change":"2024-09-17T01:36:59.865695+0000","last_active":"2024-09-17T01:37:01.938142+0000","last_peered":"2024-09-17T01:37:01.938142+0000","last_clean":"2024-09-17T01:37:01.938142+0000","last_became_active":"2024-09-17T01:36:59.865350+0000","last_became_peered":"2024-09-17T01:36:59.865350+0000","last_unstale":"2024-09-17T01:37:01.938142+0000","last_undegraded":"2024-09-17T01:37:01.938142+0000","last_fullsized":"2024-09-17T01:37:01.938142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:36.202357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938662+0000","last_change":"2024-09-17T01:37:00.877472+0000","last_active":"2024-09-17T01:37:01.938662+0000","last_peered":"2024-09-17T01:37:01.938662+0000","last_clean":"2024-09-17T01:37:01.938662+0000","last_became_active":"2024-09-17T01:37:00.876758+0000","last_became_peered":"2024-09-17T01:37:00.876758+0000","last_unstale":"2024-09-17T01:37:01.938662+0000","last_undegraded":"2024-09-17T01:37:01.938662+0000","last_fullsized":"2024-09-17T01:37:01.938662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:14.801586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.939126+0000","last_change":"2024-09-17T01:36:59.876074+0000","last_active":"2024-09-17T01:37:01.939126+0000","last_peered":"2024-09-17T01:37:01.939126+0000","last_clean":"2024-09-17T01:37:01.939126+0000","last_became_active":"2024-09-17T01:36:59.875702+0000","last_became_peered":"2024-09-17T01:36:59.875702+0000","last_unstale":"2024-09-17T01:37:01.939126+0000","last_undegraded":"2024-09-17T01:37:01.939126+0000","last_fullsized":"2024-09-17T01:37:01.939126+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:54.024362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937628+0000","last_change":"2024-09-17T01:37:00.879904+0000","last_active":"2024-09-17T01:37:01.937628+0000","last_peered":"2024-09-17T01:37:01.937628+0000","last_clean":"2024-09-17T01:37:01.937628+0000","last_became_active":"2024-09-17T01:37:00.879538+0000","last_became_peered":"2024-09-17T01:37:00.879538+0000","last_unstale":"2024-09-17T01:37:01.937628+0000","last_undegraded":"2024-09-17T01:37:01.937628+0000","last_fullsized":"2024-09-17T01:37:01.937628+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:35.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874879+0000","last_change":"2024-09-17T01:36:59.867428+0000","last_active":"2024-09-17T01:37:01.874879+0000","last_peered":"2024-09-17T01:37:01.874879+0000","last_clean":"2024-09-17T01:37:01.874879+0000","last_became_active":"2024-09-17T01:36:59.867059+0000","last_became_peered":"2024-09-17T01:36:59.867059+0000","last_unstale":"2024-09-17T01:37:01.874879+0000","last_undegraded":"2024-09-17T01:37:01.874879+0000","last_fullsized":"2024-09-17T01:37:01.874879+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:28.659364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871406+0000","last_change":"2024-09-17T01:37:00.883835+0000","last_active":"2024-09-17T01:37:01.871406+0000","last_peered":"2024-09-17T01:37:01.871406+0000","last_clean":"2024-09-17T01:37:01.871406+0000","last_became_active":"2024-09-17T01:37:00.883481+0000","last_became_peered":"2024-09-17T01:37:00.883481+0000","last_unstale":"2024-09-17T01:37:01.871406+0000","last_undegraded":"2024-09-17T01:37:01.871406+0000","last_fullsized":"2024-09-17T01:37:01.871406+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:31.009628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937820+0000","last_change":"2024-09-17T01:36:59.868151+0000","last_active":"2024-09-17T01:37:01.937820+0000","last_peered":"2024-09-17T01:37:01.937820+0000","last_clean":"2024-09-17T01:37:01.937820+0000","last_became_active":"2024-09-17T01:36:59.867665+0000","last_became_peered":"2024-09-17T01:36:59.867665+0000","last_unstale":"2024-09-17T01:37:01.937820+0000","last_undegraded":"2024-09-17T01:37:01.937820+0000","last_fullsized":"2024-09-17T01:37:01.937820+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:13.304795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874435+0000","last_change":"2024-09-17T01:37:00.885316+0000","last_active":"2024-09-17T01:37:01.874435+0000","last_peered":"2024-09-17T01:37:01.874435+0000","last_clean":"2024-09-17T01:37:01.874435+0000","last_became_active":"2024-09-17T01:37:00.885035+0000","last_became_peered":"2024-09-17T01:37:00.885035+0000","last_unstale":"2024-09-17T01:37:01.874435+0000","last_undegraded":"2024-09-17T01:37:01.874435+0000","last_fullsized":"2024-09-17T01:37:01.874435+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:24.483354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873515+0000","last_change":"2024-09-17T01:36:59.868131+0000","last_active":"2024-09-17T01:37:01.873515+0000","last_peered":"2024-09-17T01:37:01.873515+0000","last_clean":"2024-09-17T01:37:01.873515+0000","last_became_active":"2024-09-17T01:36:59.867405+0000","last_became_peered":"2024-09-17T01:36:59.867405+0000","last_unstale":"2024-09-17T01:37:01.873515+0000","last_undegraded":"2024-09-17T01:37:01.873515+0000","last_fullsized":"2024-09-17T01:37:01.873515+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:49.866246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937741+0000","last_change":"2024-09-17T01:37:00.877071+0000","last_active":"2024-09-17T01:37:01.937741+0000","last_peered":"2024-09-17T01:37:01.937741+0000","last_clean":"2024-09-17T01:37:01.937741+0000","last_became_active":"2024-09-17T01:37:00.876770+0000","last_became_peered":"2024-09-17T01:37:00.876770+0000","last_unstale":"2024-09-17T01:37:01.937741+0000","last_undegraded":"2024-09-17T01:37:01.937741+0000","last_fullsized":"2024-09-17T01:37:01.937741+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:35.937945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870354+0000","last_change":"2024-09-17T01:36:59.879850+0000","last_active":"2024-09-17T01:37:01.870354+0000","last_peered":"2024-09-17T01:37:01.870354+0000","last_clean":"2024-09-17T01:37:01.870354+0000","last_became_active":"2024-09-17T01:36:59.879463+0000","last_became_peered":"2024-09-17T01:36:59.879463+0000","last_unstale":"2024-09-17T01:37:01.870354+0000","last_undegraded":"2024-09-17T01:37:01.870354+0000","last_fullsized":"2024-09-17T01:37:01.870354+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:26:09.389012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872260+0000","last_change":"2024-09-17T01:37:00.868009+0000","last_active":"2024-09-17T01:37:01.872260+0000","last_peered":"2024-09-17T01:37:01.872260+0000","last_clean":"2024-09-17T01:37:01.872260+0000","last_became_active":"2024-09-17T01:37:00.867635+0000","last_became_peered":"2024-09-17T01:37:00.867635+0000","last_unstale":"2024-09-17T01:37:01.872260+0000","last_undegraded":"2024-09-17T01:37:01.872260+0000","last_fullsized":"2024-09-17T01:37:01.872260+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:37.440870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872881+0000","last_change":"2024-09-17T01:36:59.871995+0000","last_active":"2024-09-17T01:37:01.872881+0000","last_peered":"2024-09-17T01:37:01.872881+0000","last_clean":"2024-09-17T01:37:01.872881+0000","last_became_active":"2024-09-17T01:36:59.871288+0000","last_became_peered":"2024-09-17T01:36:59.871288+0000","last_unstale":"2024-09-17T01:37:01.872881+0000","last_undegraded":"2024-09-17T01:37:01.872881+0000","last_fullsized":"2024-09-17T01:37:01.872881+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:22.962787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872280+0000","last_change":"2024-09-17T01:37:00.892376+0000","last_active":"2024-09-17T01:37:01.872280+0000","last_peered":"2024-09-17T01:37:01.872280+0000","last_clean":"2024-09-17T01:37:01.872280+0000","last_became_active":"2024-09-17T01:37:00.891949+0000","last_became_peered":"2024-09-17T01:37:00.891949+0000","last_unstale":"2024-09-17T01:37:01.872280+0000","last_undegraded":"2024-09-17T01:37:01.872280+0000","last_fullsized":"2024-09-17T01:37:01.872280+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:00.313691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871905+0000","last_change":"2024-09-17T01:36:59.866044+0000","last_active":"2024-09-17T01:37:01.871905+0000","last_peered":"2024-09-17T01:37:01.871905+0000","last_clean":"2024-09-17T01:37:01.871905+0000","last_became_active":"2024-09-17T01:36:59.865721+0000","last_became_peered":"2024-09-17T01:36:59.865721+0000","last_unstale":"2024-09-17T01:37:01.871905+0000","last_undegraded":"2024-09-17T01:37:01.871905+0000","last_fullsized":"2024-09-17T01:37:01.871905+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:54.305186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871343+0000","last_change":"2024-09-17T01:37:00.881635+0000","last_active":"2024-09-17T01:37:01.871343+0000","last_peered":"2024-09-17T01:37:01.871343+0000","last_clean":"2024-09-17T01:37:01.871343+0000","last_became_active":"2024-09-17T01:37:00.881315+0000","last_became_peered":"2024-09-17T01:37:00.881315+0000","last_unstale":"2024-09-17T01:37:01.871343+0000","last_undegraded":"2024-09-17T01:37:01.871343+0000","last_fullsized":"2024-09-17T01:37:01.871343+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:44.751005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874740+0000","last_change":"2024-09-17T01:36:59.872074+0000","last_active":"2024-09-17T01:37:01.874740+0000","last_peered":"2024-09-17T01:37:01.874740+0000","last_clean":"2024-09-17T01:37:01.874740+0000","last_became_active":"2024-09-17T01:36:59.871674+0000","last_became_peered":"2024-09-17T01:36:59.871674+0000","last_unstale":"2024-09-17T01:37:01.874740+0000","last_undegraded":"2024-09-17T01:37:01.874740+0000","last_fullsized":"2024-09-17T01:37:01.874740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:05.955545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938478+0000","last_change":"2024-09-17T01:37:00.885008+0000","last_active":"2024-09-17T01:37:01.938478+0000","last_peered":"2024-09-17T01:37:01.938478+0000","last_clean":"2024-09-17T01:37:01.938478+0000","last_became_active":"2024-09-17T01:37:00.884389+0000","last_became_peered":"2024-09-17T01:37:00.884389+0000","last_unstale":"2024-09-17T01:37:01.938478+0000","last_undegraded":"2024-09-17T01:37:01.938478+0000","last_fullsized":"2024-09-17T01:37:01.938478+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:41.769359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938290+0000","last_change":"2024-09-17T01:36:59.878360+0000","last_active":"2024-09-17T01:37:01.938290+0000","last_peered":"2024-09-17T01:37:01.938290+0000","last_clean":"2024-09-17T01:37:01.938290+0000","last_became_active":"2024-09-17T01:36:59.878062+0000","last_became_peered":"2024-09-17T01:36:59.878062+0000","last_unstale":"2024-09-17T01:37:01.938290+0000","last_undegraded":"2024-09-17T01:37:01.938290+0000","last_fullsized":"2024-09-17T01:37:01.938290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:33.686940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874641+0000","last_change":"2024-09-17T01:37:00.894146+0000","last_active":"2024-09-17T01:37:01.874641+0000","last_peered":"2024-09-17T01:37:01.874641+0000","last_clean":"2024-09-17T01:37:01.874641+0000","last_became_active":"2024-09-17T01:37:00.893851+0000","last_became_peered":"2024-09-17T01:37:00.893851+0000","last_unstale":"2024-09-17T01:37:01.874641+0000","last_undegraded":"2024-09-17T01:37:01.874641+0000","last_fullsized":"2024-09-17T01:37:01.874641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:40.958493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"77'3","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874260+0000","last_change":"2024-09-17T01:36:59.870792+0000","last_active":"2024-09-17T01:37:01.874260+0000","last_peered":"2024-09-17T01:37:01.874260+0000","last_clean":"2024-09-17T01:37:01.874260+0000","last_became_active":"2024-09-17T01:36:59.870465+0000","last_became_peered":"2024-09-17T01:36:59.870465+0000","last_unstale":"2024-09-17T01:37:01.874260+0000","last_undegraded":"2024-09-17T01:37:01.874260+0000","last_fullsized":"2024-09-17T01:37:01.874260+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:48.732387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938477+0000","last_change":"2024-09-17T01:37:00.883131+0000","last_active":"2024-09-17T01:37:01.938477+0000","last_peered":"2024-09-17T01:37:01.938477+0000","last_clean":"2024-09-17T01:37:01.938477+0000","last_became_active":"2024-09-17T01:37:00.874476+0000","last_became_peered":"2024-09-17T01:37:00.874476+0000","last_unstale":"2024-09-17T01:37:01.938477+0000","last_undegraded":"2024-09-17T01:37:01.938477+0000","last_fullsized":"2024-09-17T01:37:01.938477+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:55.258607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"77'6","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873687+0000","last_change":"2024-09-17T01:36:59.867187+0000","last_active":"2024-09-17T01:37:01.873687+0000","last_peered":"2024-09-17T01:37:01.873687+0000","last_clean":"2024-09-17T01:37:01.873687+0000","last_became_active":"2024-09-17T01:36:59.866667+0000","last_became_peered":"2024-09-17T01:36:59.866667+0000","last_unstale":"2024-09-17T01:37:01.873687+0000","last_undegraded":"2024-09-17T01:37:01.873687+0000","last_fullsized":"2024-09-17T01:37:01.873687+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:51:46.620956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937486+0000","last_change":"2024-09-17T01:37:00.880197+0000","last_active":"2024-09-17T01:37:01.937486+0000","last_peered":"2024-09-17T01:37:01.937486+0000","last_clean":"2024-09-17T01:37:01.937486+0000","last_became_active":"2024-09-17T01:37:00.879829+0000","last_became_peered":"2024-09-17T01:37:00.879829+0000","last_unstale":"2024-09-17T01:37:01.937486+0000","last_undegraded":"2024-09-17T01:37:01.937486+0000","last_fullsized":"2024-09-17T01:37:01.937486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:52.671561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873248+0000","last_change":"2024-09-17T01:36:59.877119+0000","last_active":"2024-09-17T01:37:01.873248+0000","last_peered":"2024-09-17T01:37:01.873248+0000","last_clean":"2024-09-17T01:37:01.873248+0000","last_became_active":"2024-09-17T01:36:59.876620+0000","last_became_peered":"2024-09-17T01:36:59.876620+0000","last_unstale":"2024-09-17T01:37:01.873248+0000","last_undegraded":"2024-09-17T01:37:01.873248+0000","last_fullsized":"2024-09-17T01:37:01.873248+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:33.686940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870866+0000","last_change":"2024-09-17T01:37:00.878599+0000","last_active":"2024-09-17T01:37:01.870866+0000","last_peered":"2024-09-17T01:37:01.870866+0000","last_clean":"2024-09-17T01:37:01.870866+0000","last_became_active":"2024-09-17T01:37:00.878274+0000","last_became_peered":"2024-09-17T01:37:00.878274+0000","last_unstale":"2024-09-17T01:37:01.870866+0000","last_undegraded":"2024-09-17T01:37:01.870866+0000","last_fullsized":"2024-09-17T01:37:01.870866+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:51.128375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870403+0000","last_change":"2024-09-17T01:36:59.876949+0000","last_active":"2024-09-17T01:37:01.870403+0000","last_peered":"2024-09-17T01:37:01.870403+0000","last_clean":"2024-09-17T01:37:01.870403+0000","last_became_active":"2024-09-17T01:36:59.876378+0000","last_became_peered":"2024-09-17T01:36:59.876378+0000","last_unstale":"2024-09-17T01:37:01.870403+0000","last_undegraded":"2024-09-17T01:37:01.870403+0000","last_fullsized":"2024-09-17T01:37:01.870403+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:49.485267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937617+0000","last_change":"2024-09-17T01:37:00.866971+0000","last_active":"2024-09-17T01:37:01.937617+0000","last_peered":"2024-09-17T01:37:01.937617+0000","last_clean":"2024-09-17T01:37:01.937617+0000","last_became_active":"2024-09-17T01:37:00.866631+0000","last_became_peered":"2024-09-17T01:37:00.866631+0000","last_unstale":"2024-09-17T01:37:01.937617+0000","last_undegraded":"2024-09-17T01:37:01.937617+0000","last_fullsized":"2024-09-17T01:37:01.937617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:41.130454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870561+0000","last_change":"2024-09-17T01:36:59.870560+0000","last_active":"2024-09-17T01:37:01.870561+0000","last_peered":"2024-09-17T01:37:01.870561+0000","last_clean":"2024-09-17T01:37:01.870561+0000","last_became_active":"2024-09-17T01:36:59.870147+0000","last_became_peered":"2024-09-17T01:36:59.870147+0000","last_unstale":"2024-09-17T01:37:01.870561+0000","last_undegraded":"2024-09-17T01:37:01.870561+0000","last_fullsized":"2024-09-17T01:37:01.870561+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:15.252189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937540+0000","last_change":"2024-09-17T01:37:00.879444+0000","last_active":"2024-09-17T01:37:01.937540+0000","last_peered":"2024-09-17T01:37:01.937540+0000","last_clean":"2024-09-17T01:37:01.937540+0000","last_became_active":"2024-09-17T01:37:00.877381+0000","last_became_peered":"2024-09-17T01:37:00.877381+0000","last_unstale":"2024-09-17T01:37:01.937540+0000","last_undegraded":"2024-09-17T01:37:01.937540+0000","last_fullsized":"2024-09-17T01:37:01.937540+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:24.841003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"77'8","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870188+0000","last_change":"2024-09-17T01:36:59.872221+0000","last_active":"2024-09-17T01:37:01.870188+0000","last_peered":"2024-09-17T01:37:01.870188+0000","last_clean":"2024-09-17T01:37:01.870188+0000","last_became_active":"2024-09-17T01:36:59.871924+0000","last_became_peered":"2024-09-17T01:36:59.871924+0000","last_unstale":"2024-09-17T01:37:01.870188+0000","last_undegraded":"2024-09-17T01:37:01.870188+0000","last_fullsized":"2024-09-17T01:37:01.870188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:26.403466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938258+0000","last_change":"2024-09-17T01:37:00.877693+0000","last_active":"2024-09-17T01:37:01.938258+0000","last_peered":"2024-09-17T01:37:01.938258+0000","last_clean":"2024-09-17T01:37:01.938258+0000","last_became_active":"2024-09-17T01:37:00.877386+0000","last_became_peered":"2024-09-17T01:37:00.877386+0000","last_unstale":"2024-09-17T01:37:01.938258+0000","last_undegraded":"2024-09-17T01:37:01.938258+0000","last_fullsized":"2024-09-17T01:37:01.938258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:14.659829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874878+0000","last_change":"2024-09-17T01:36:59.864804+0000","last_active":"2024-09-17T01:37:01.874878+0000","last_peered":"2024-09-17T01:37:01.874878+0000","last_clean":"2024-09-17T01:37:01.874878+0000","last_became_active":"2024-09-17T01:36:59.863708+0000","last_became_peered":"2024-09-17T01:36:59.863708+0000","last_unstale":"2024-09-17T01:37:01.874878+0000","last_undegraded":"2024-09-17T01:37:01.874878+0000","last_fullsized":"2024-09-17T01:37:01.874878+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:50.272122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938528+0000","last_change":"2024-09-17T01:37:00.881962+0000","last_active":"2024-09-17T01:37:01.938528+0000","last_peered":"2024-09-17T01:37:01.938528+0000","last_clean":"2024-09-17T01:37:01.938528+0000","last_became_active":"2024-09-17T01:37:00.881348+0000","last_became_peered":"2024-09-17T01:37:00.881348+0000","last_unstale":"2024-09-17T01:37:01.938528+0000","last_undegraded":"2024-09-17T01:37:01.938528+0000","last_fullsized":"2024-09-17T01:37:01.938528+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:51.607996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938307+0000","last_change":"2024-09-17T01:36:59.882677+0000","last_active":"2024-09-17T01:37:01.938307+0000","last_peered":"2024-09-17T01:37:01.938307+0000","last_clean":"2024-09-17T01:37:01.938307+0000","last_became_active":"2024-09-17T01:36:59.882324+0000","last_became_peered":"2024-09-17T01:36:59.882324+0000","last_unstale":"2024-09-17T01:37:01.938307+0000","last_undegraded":"2024-09-17T01:37:01.938307+0000","last_fullsized":"2024-09-17T01:37:01.938307+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:25.084810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938669+0000","last_change":"2024-09-17T01:37:00.881768+0000","last_active":"2024-09-17T01:37:01.938669+0000","last_peered":"2024-09-17T01:37:01.938669+0000","last_clean":"2024-09-17T01:37:01.938669+0000","last_became_active":"2024-09-17T01:37:00.880039+0000","last_became_peered":"2024-09-17T01:37:00.880039+0000","last_unstale":"2024-09-17T01:37:01.938669+0000","last_undegraded":"2024-09-17T01:37:01.938669+0000","last_fullsized":"2024-09-17T01:37:01.938669+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:19.860512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937401+0000","last_change":"2024-09-17T01:36:59.880681+0000","last_active":"2024-09-17T01:37:01.937401+0000","last_peered":"2024-09-17T01:37:01.937401+0000","last_clean":"2024-09-17T01:37:01.937401+0000","last_became_active":"2024-09-17T01:36:59.880368+0000","last_became_peered":"2024-09-17T01:36:59.880368+0000","last_unstale":"2024-09-17T01:37:01.937401+0000","last_undegraded":"2024-09-17T01:37:01.937401+0000","last_fullsized":"2024-09-17T01:37:01.937401+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:23.768788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938247+0000","last_change":"2024-09-17T01:37:00.880051+0000","last_active":"2024-09-17T01:37:01.938247+0000","last_peered":"2024-09-17T01:37:01.938247+0000","last_clean":"2024-09-17T01:37:01.938247+0000","last_became_active":"2024-09-17T01:37:00.878651+0000","last_became_peered":"2024-09-17T01:37:00.878651+0000","last_unstale":"2024-09-17T01:37:01.938247+0000","last_undegraded":"2024-09-17T01:37:01.938247+0000","last_fullsized":"2024-09-17T01:37:01.938247+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:50.436558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937897+0000","last_change":"2024-09-17T01:36:59.877280+0000","last_active":"2024-09-17T01:37:01.937897+0000","last_peered":"2024-09-17T01:37:01.937897+0000","last_clean":"2024-09-17T01:37:01.937897+0000","last_became_active":"2024-09-17T01:36:59.876930+0000","last_became_peered":"2024-09-17T01:36:59.876930+0000","last_unstale":"2024-09-17T01:37:01.937897+0000","last_undegraded":"2024-09-17T01:37:01.937897+0000","last_fullsized":"2024-09-17T01:37:01.937897+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:04.522506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873154+0000","last_change":"2024-09-17T01:37:00.878655+0000","last_active":"2024-09-17T01:37:01.873154+0000","last_peered":"2024-09-17T01:37:01.873154+0000","last_clean":"2024-09-17T01:37:01.873154+0000","last_became_active":"2024-09-17T01:37:00.869157+0000","last_became_peered":"2024-09-17T01:37:00.869157+0000","last_unstale":"2024-09-17T01:37:01.873154+0000","last_undegraded":"2024-09-17T01:37:01.873154+0000","last_fullsized":"2024-09-17T01:37:01.873154+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:50.446321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937464+0000","last_change":"2024-09-17T01:36:59.876368+0000","last_active":"2024-09-17T01:37:01.937464+0000","last_peered":"2024-09-17T01:37:01.937464+0000","last_clean":"2024-09-17T01:37:01.937464+0000","last_became_active":"2024-09-17T01:36:59.876090+0000","last_became_peered":"2024-09-17T01:36:59.876090+0000","last_unstale":"2024-09-17T01:37:01.937464+0000","last_undegraded":"2024-09-17T01:37:01.937464+0000","last_fullsized":"2024-09-17T01:37:01.937464+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:39.464623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873160+0000","last_change":"2024-09-17T01:37:00.877548+0000","last_active":"2024-09-17T01:37:01.873160+0000","last_peered":"2024-09-17T01:37:01.873160+0000","last_clean":"2024-09-17T01:37:01.873160+0000","last_became_active":"2024-09-17T01:37:00.876225+0000","last_became_peered":"2024-09-17T01:37:00.876225+0000","last_unstale":"2024-09-17T01:37:01.873160+0000","last_undegraded":"2024-09-17T01:37:01.873160+0000","last_fullsized":"2024-09-17T01:37:01.873160+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:59:05.289863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937544+0000","last_change":"2024-09-17T01:36:59.880051+0000","last_active":"2024-09-17T01:37:01.937544+0000","last_peered":"2024-09-17T01:37:01.937544+0000","last_clean":"2024-09-17T01:37:01.937544+0000","last_became_active":"2024-09-17T01:36:59.879720+0000","last_became_peered":"2024-09-17T01:36:59.879720+0000","last_unstale":"2024-09-17T01:37:01.937544+0000","last_undegraded":"2024-09-17T01:37:01.937544+0000","last_fullsized":"2024-09-17T01:37:01.937544+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:25.120880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872544+0000","last_change":"2024-09-17T01:37:00.882269+0000","last_active":"2024-09-17T01:37:01.872544+0000","last_peered":"2024-09-17T01:37:01.872544+0000","last_clean":"2024-09-17T01:37:01.872544+0000","last_became_active":"2024-09-17T01:37:00.881259+0000","last_became_peered":"2024-09-17T01:37:00.881259+0000","last_unstale":"2024-09-17T01:37:01.872544+0000","last_undegraded":"2024-09-17T01:37:01.872544+0000","last_fullsized":"2024-09-17T01:37:01.872544+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:54.281546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937348+0000","last_change":"2024-09-17T01:36:59.878130+0000","last_active":"2024-09-17T01:37:01.937348+0000","last_peered":"2024-09-17T01:37:01.937348+0000","last_clean":"2024-09-17T01:37:01.937348+0000","last_became_active":"2024-09-17T01:36:59.877688+0000","last_became_peered":"2024-09-17T01:36:59.877688+0000","last_unstale":"2024-09-17T01:37:01.937348+0000","last_undegraded":"2024-09-17T01:37:01.937348+0000","last_fullsized":"2024-09-17T01:37:01.937348+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:31.964182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.939045+0000","last_change":"2024-09-17T01:37:00.879111+0000","last_active":"2024-09-17T01:37:01.939045+0000","last_peered":"2024-09-17T01:37:01.939045+0000","last_clean":"2024-09-17T01:37:01.939045+0000","last_became_active":"2024-09-17T01:37:00.874367+0000","last_became_peered":"2024-09-17T01:37:00.874367+0000","last_unstale":"2024-09-17T01:37:01.939045+0000","last_undegraded":"2024-09-17T01:37:01.939045+0000","last_fullsized":"2024-09-17T01:37:01.939045+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:41.447731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.875113+0000","last_change":"2024-09-17T01:36:59.865304+0000","last_active":"2024-09-17T01:37:01.875113+0000","last_peered":"2024-09-17T01:37:01.875113+0000","last_clean":"2024-09-17T01:37:01.875113+0000","last_became_active":"2024-09-17T01:36:59.862462+0000","last_became_peered":"2024-09-17T01:36:59.862462+0000","last_unstale":"2024-09-17T01:37:01.875113+0000","last_undegraded":"2024-09-17T01:37:01.875113+0000","last_fullsized":"2024-09-17T01:37:01.875113+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:53.210356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871401+0000","last_change":"2024-09-17T01:37:00.881114+0000","last_active":"2024-09-17T01:37:01.871401+0000","last_peered":"2024-09-17T01:37:01.871401+0000","last_clean":"2024-09-17T01:37:01.871401+0000","last_became_active":"2024-09-17T01:37:00.880775+0000","last_became_peered":"2024-09-17T01:37:00.880775+0000","last_unstale":"2024-09-17T01:37:01.871401+0000","last_undegraded":"2024-09-17T01:37:01.871401+0000","last_fullsized":"2024-09-17T01:37:01.871401+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:15.044192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"78'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874869+0000","last_change":"2024-09-17T01:36:59.880330+0000","last_active":"2024-09-17T01:37:01.874869+0000","last_peered":"2024-09-17T01:37:01.874869+0000","last_clean":"2024-09-17T01:37:01.874869+0000","last_became_active":"2024-09-17T01:36:59.878802+0000","last_became_peered":"2024-09-17T01:36:59.878802+0000","last_unstale":"2024-09-17T01:37:01.874869+0000","last_undegraded":"2024-09-17T01:37:01.874869+0000","last_fullsized":"2024-09-17T01:37:01.874869+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:53.286067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938018+0000","last_change":"2024-09-17T01:37:00.872505+0000","last_active":"2024-09-17T01:37:01.938018+0000","last_peered":"2024-09-17T01:37:01.938018+0000","last_clean":"2024-09-17T01:37:01.938018+0000","last_became_active":"2024-09-17T01:37:00.872169+0000","last_became_peered":"2024-09-17T01:37:00.872169+0000","last_unstale":"2024-09-17T01:37:01.938018+0000","last_undegraded":"2024-09-17T01:37:01.938018+0000","last_fullsized":"2024-09-17T01:37:01.938018+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:40.396787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874370+0000","last_change":"2024-09-17T01:36:59.863867+0000","last_active":"2024-09-17T01:37:01.874370+0000","last_peered":"2024-09-17T01:37:01.874370+0000","last_clean":"2024-09-17T01:37:01.874370+0000","last_became_active":"2024-09-17T01:36:59.863517+0000","last_became_peered":"2024-09-17T01:36:59.863517+0000","last_unstale":"2024-09-17T01:37:01.874370+0000","last_undegraded":"2024-09-17T01:37:01.874370+0000","last_fullsized":"2024-09-17T01:37:01.874370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:15.269849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871135+0000","last_change":"2024-09-17T01:37:00.882366+0000","last_active":"2024-09-17T01:37:01.871135+0000","last_peered":"2024-09-17T01:37:01.871135+0000","last_clean":"2024-09-17T01:37:01.871135+0000","last_became_active":"2024-09-17T01:37:00.882086+0000","last_became_peered":"2024-09-17T01:37:00.882086+0000","last_unstale":"2024-09-17T01:37:01.871135+0000","last_undegraded":"2024-09-17T01:37:01.871135+0000","last_fullsized":"2024-09-17T01:37:01.871135+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:55:02.373828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873880+0000","last_change":"2024-09-17T01:36:59.869198+0000","last_active":"2024-09-17T01:37:01.873880+0000","last_peered":"2024-09-17T01:37:01.873880+0000","last_clean":"2024-09-17T01:37:01.873880+0000","last_became_active":"2024-09-17T01:36:59.868898+0000","last_became_peered":"2024-09-17T01:36:59.868898+0000","last_unstale":"2024-09-17T01:37:01.873880+0000","last_undegraded":"2024-09-17T01:37:01.873880+0000","last_fullsized":"2024-09-17T01:37:01.873880+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:12:59.919264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938070+0000","last_change":"2024-09-17T01:37:00.873280+0000","last_active":"2024-09-17T01:37:01.938070+0000","last_peered":"2024-09-17T01:37:01.938070+0000","last_clean":"2024-09-17T01:37:01.938070+0000","last_became_active":"2024-09-17T01:37:00.871566+0000","last_became_peered":"2024-09-17T01:37:00.871566+0000","last_unstale":"2024-09-17T01:37:01.938070+0000","last_undegraded":"2024-09-17T01:37:01.938070+0000","last_fullsized":"2024-09-17T01:37:01.938070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:59.796709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873685+0000","last_change":"2024-09-17T01:36:59.867758+0000","last_active":"2024-09-17T01:37:01.873685+0000","last_peered":"2024-09-17T01:37:01.873685+0000","last_clean":"2024-09-17T01:37:01.873685+0000","last_became_active":"2024-09-17T01:36:59.866985+0000","last_became_peered":"2024-09-17T01:36:59.866985+0000","last_unstale":"2024-09-17T01:37:01.873685+0000","last_undegraded":"2024-09-17T01:37:01.873685+0000","last_fullsized":"2024-09-17T01:37:01.873685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:17.223254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874679+0000","last_change":"2024-09-17T01:37:00.883794+0000","last_active":"2024-09-17T01:37:01.874679+0000","last_peered":"2024-09-17T01:37:01.874679+0000","last_clean":"2024-09-17T01:37:01.874679+0000","last_became_active":"2024-09-17T01:37:00.879349+0000","last_became_peered":"2024-09-17T01:37:00.879349+0000","last_unstale":"2024-09-17T01:37:01.874679+0000","last_undegraded":"2024-09-17T01:37:01.874679+0000","last_fullsized":"2024-09-17T01:37:01.874679+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:05.980183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938206+0000","last_change":"2024-09-17T01:36:59.872585+0000","last_active":"2024-09-17T01:37:01.938206+0000","last_peered":"2024-09-17T01:37:01.938206+0000","last_clean":"2024-09-17T01:37:01.938206+0000","last_became_active":"2024-09-17T01:36:59.870276+0000","last_became_peered":"2024-09-17T01:36:59.870276+0000","last_unstale":"2024-09-17T01:37:01.938206+0000","last_undegraded":"2024-09-17T01:37:01.938206+0000","last_fullsized":"2024-09-17T01:37:01.938206+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:51.670979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873386+0000","last_change":"2024-09-17T01:37:00.884276+0000","last_active":"2024-09-17T01:37:01.873386+0000","last_peered":"2024-09-17T01:37:01.873386+0000","last_clean":"2024-09-17T01:37:01.873386+0000","last_became_active":"2024-09-17T01:37:00.883956+0000","last_became_peered":"2024-09-17T01:37:00.883956+0000","last_unstale":"2024-09-17T01:37:01.873386+0000","last_undegraded":"2024-09-17T01:37:01.873386+0000","last_fullsized":"2024-09-17T01:37:01.873386+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:40.973377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937655+0000","last_change":"2024-09-17T01:36:59.883537+0000","last_active":"2024-09-17T01:37:01.937655+0000","last_peered":"2024-09-17T01:37:01.937655+0000","last_clean":"2024-09-17T01:37:01.937655+0000","last_became_active":"2024-09-17T01:36:59.883207+0000","last_became_peered":"2024-09-17T01:36:59.883207+0000","last_unstale":"2024-09-17T01:37:01.937655+0000","last_undegraded":"2024-09-17T01:37:01.937655+0000","last_fullsized":"2024-09-17T01:37:01.937655+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:59.069079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937976+0000","last_change":"2024-09-17T01:37:00.893414+0000","last_active":"2024-09-17T01:37:01.937976+0000","last_peered":"2024-09-17T01:37:01.937976+0000","last_clean":"2024-09-17T01:37:01.937976+0000","last_became_active":"2024-09-17T01:37:00.893040+0000","last_became_peered":"2024-09-17T01:37:00.893040+0000","last_unstale":"2024-09-17T01:37:01.937976+0000","last_undegraded":"2024-09-17T01:37:01.937976+0000","last_fullsized":"2024-09-17T01:37:01.937976+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:51.081350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.936998+0000","last_change":"2024-09-17T01:36:59.881600+0000","last_active":"2024-09-17T01:37:01.936998+0000","last_peered":"2024-09-17T01:37:01.936998+0000","last_clean":"2024-09-17T01:37:01.936998+0000","last_became_active":"2024-09-17T01:36:59.881167+0000","last_became_peered":"2024-09-17T01:36:59.881167+0000","last_unstale":"2024-09-17T01:37:01.936998+0000","last_undegraded":"2024-09-17T01:37:01.936998+0000","last_fullsized":"2024-09-17T01:37:01.936998+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:43.201550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938334+0000","last_change":"2024-09-17T01:37:00.886106+0000","last_active":"2024-09-17T01:37:01.938334+0000","last_peered":"2024-09-17T01:37:01.938334+0000","last_clean":"2024-09-17T01:37:01.938334+0000","last_became_active":"2024-09-17T01:37:00.879587+0000","last_became_peered":"2024-09-17T01:37:00.879587+0000","last_unstale":"2024-09-17T01:37:01.938334+0000","last_undegraded":"2024-09-17T01:37:01.938334+0000","last_fullsized":"2024-09-17T01:37:01.938334+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:02.658087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870731+0000","last_change":"2024-09-17T01:36:59.873087+0000","last_active":"2024-09-17T01:37:01.870731+0000","last_peered":"2024-09-17T01:37:01.870731+0000","last_clean":"2024-09-17T01:37:01.870731+0000","last_became_active":"2024-09-17T01:36:59.872734+0000","last_became_peered":"2024-09-17T01:36:59.872734+0000","last_unstale":"2024-09-17T01:37:01.870731+0000","last_undegraded":"2024-09-17T01:37:01.870731+0000","last_fullsized":"2024-09-17T01:37:01.870731+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:56:01.555936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":217,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870301+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:37:01.870301+0000","last_peered":"2024-09-17T01:37:01.870301+0000","last_clean":"2024-09-17T01:37:01.870301+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:37:01.870301+0000","last_undegraded":"2024-09-17T01:37:01.870301+0000","last_fullsized":"2024-09-17T01:37:01.870301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476802,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":946176,"data_stored":403832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509505,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40444,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331396,"statfs":{"total":96636764160,"available":96595349504,"internally_reserved":0,"allocated":954368,"data_stored":404862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509504,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40448,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331392,"statfs":{"total":96636764160,"available":96595345408,"internally_reserved":0,"allocated":958464,"data_stored":404896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509505,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44604,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327236,"statfs":{"total":96636764160,"available":96591089664,"internally_reserved":0,"allocated":954368,"data_stored":403944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509505,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":954368,"data_stored":403376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509504,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41012,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330828,"statfs":{"total":96636764160,"available":96594767872,"internally_reserved":0,"allocated":1536000,"data_stored":993618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509506,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36280,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335560,"statfs":{"total":96636764160,"available":96599613440,"internally_reserved":0,"allocated":946176,"data_stored":403320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542210,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41020,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330820,"statfs":{"total":96636764160,"available":96594759680,"internally_reserved":0,"allocated":1540096,"data_stored":993708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:37:10.421 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:37:10.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.660+0000 7fbf5da00640 1 -- 172.21.15.42:0/249859975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf580d2810 msgr2=0x7fbf5815e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:10.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.660+0000 7fbf5da00640 1 --2- 172.21.15.42:0/249859975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf580d2810 0x7fbf5815e910 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fbf58073750 tx=0x7fbf4402a4d0 comp rx=0 tx=0).stop 2024-09-17T01:37:10.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.661+0000 7fbf5da00640 1 -- 172.21.15.42:0/249859975 shutdown_connections 2024-09-17T01:37:10.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.661+0000 7fbf5da00640 1 --2- 172.21.15.42:0/249859975 >> v2:172.21.15.43:3300/0 conn(0x7fbf580b6030 0x7fbf580b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:10.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.661+0000 7fbf5da00640 1 --2- 172.21.15.42:0/249859975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf580d2810 0x7fbf5815e910 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:10.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.661+0000 7fbf5da00640 1 -- 172.21.15.42:0/249859975 >> 172.21.15.42:0/249859975 conn(0x7fbf580d1210 msgr2=0x7fbf580d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:10.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.661+0000 7fbf5da00640 1 -- 172.21.15.42:0/249859975 shutdown_connections 2024-09-17T01:37:10.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.661+0000 7fbf5da00640 1 -- 172.21.15.42:0/249859975 wait complete. 2024-09-17T01:37:10.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.663+0000 7fbf5da00640 1 Processor -- start 2024-09-17T01:37:10.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.663+0000 7fbf5da00640 1 -- start start 2024-09-17T01:37:10.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.664+0000 7fbf5da00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf58073340 0x7fbf581567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:10.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.664+0000 7fbf5da00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf580b6030 0x7fbf580ced70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:10.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.664+0000 7fbf5da00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf580d2810 0x7fbf580d3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:10.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.664+0000 7fbf5da00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5815f850 con 0x7fbf580d2810 2024-09-17T01:37:10.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.664+0000 7fbf5da00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5815f6d0 con 0x7fbf580b6030 2024-09-17T01:37:10.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.664+0000 7fbf5da00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbf5815f9d0 con 0x7fbf58073340 2024-09-17T01:37:10.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.665+0000 7fbf5d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf580d2810 0x7fbf580d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:10.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.665+0000 7fbf5d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf580d2810 0x7fbf580d3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53256/0 (socket says 172.21.15.42:53256) 2024-09-17T01:37:10.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.665+0000 7fbf5d000640 1 -- 172.21.15.42:0/719500304 learned_addr learned my addr 172.21.15.42:0/719500304 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:10.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.665+0000 7fbf57e00640 1 --2- 172.21.15.42:0/719500304 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf58073340 0x7fbf581567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:10.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.665+0000 7fbf57400640 1 --2- 172.21.15.42:0/719500304 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf580b6030 0x7fbf580ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:10.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.665+0000 7fbf5d000640 1 -- 172.21.15.42:0/719500304 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf58073340 msgr2=0x7fbf581567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:10.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.665+0000 7fbf5d000640 1 --2- 172.21.15.42:0/719500304 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf58073340 0x7fbf581567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:10.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.665+0000 7fbf5d000640 1 -- 172.21.15.42:0/719500304 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf580b6030 msgr2=0x7fbf580ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:10.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.665+0000 7fbf5d000640 1 --2- 172.21.15.42:0/719500304 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf580b6030 0x7fbf580ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:10.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.665+0000 7fbf5d000640 1 -- 172.21.15.42:0/719500304 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf58156cf0 con 0x7fbf580d2810 2024-09-17T01:37:10.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.666+0000 7fbf5d000640 1 --2- 172.21.15.42:0/719500304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf580d2810 0x7fbf580d3380 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000ea70 tx=0x7fbf5000ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:10.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.666+0000 7fbf4fe00640 1 -- 172.21.15.42:0/719500304 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5000ce40 con 0x7fbf580d2810 2024-09-17T01:37:10.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.666+0000 7fbf4fe00640 1 -- 172.21.15.42:0/719500304 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf50004c10 con 0x7fbf580d2810 2024-09-17T01:37:10.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.666+0000 7fbf4fe00640 1 -- 172.21.15.42:0/719500304 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf50005020 con 0x7fbf580d2810 2024-09-17T01:37:10.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.666+0000 7fbf5da00640 1 -- 172.21.15.42:0/719500304 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf581f96d0 con 0x7fbf580d2810 2024-09-17T01:37:10.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.666+0000 7fbf5da00640 1 -- 172.21.15.42:0/719500304 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf581f9c90 con 0x7fbf580d2810 2024-09-17T01:37:10.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.667+0000 7fbf5da00640 1 -- 172.21.15.42:0/719500304 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf581fa350 con 0x7fbf580d2810 2024-09-17T01:37:10.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.668+0000 7fbf4fe00640 1 -- 172.21.15.42:0/719500304 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbf500051c0 con 0x7fbf580d2810 2024-09-17T01:37:10.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.669+0000 7fbf4fe00640 1 --2- 172.21.15.42:0/719500304 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbf38078b90 0x7fbf3807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:10.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.669+0000 7fbf4fe00640 1 -- 172.21.15.42:0/719500304 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7fbf5009ba30 con 0x7fbf580d2810 2024-09-17T01:37:10.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.670+0000 7fbf57e00640 1 --2- 172.21.15.42:0/719500304 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbf38078b90 0x7fbf3807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:10.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.671+0000 7fbf57e00640 1 --2- 172.21.15.42:0/719500304 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbf38078b90 0x7fbf3807b0a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbf48001720 tx=0x7fbf48009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:10.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.674+0000 7fbf4fe00640 1 -- 172.21.15.42:0/719500304 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbf581fa350 con 0x7fbf580d2810 2024-09-17T01:37:10.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.865+0000 7fbf5da00640 1 -- 172.21.15.42:0/719500304 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbf5815ff20 con 0x7fbf38078b90 2024-09-17T01:37:10.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.870+0000 7fbf4fe00640 1 -- 172.21.15.42:0/719500304 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252049 (secure 0 0 0) 0x7fbf5815ff20 con 0x7fbf38078b90 2024-09-17T01:37:10.871 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:10.872 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:37:10.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.874+0000 7fbf5da00640 1 -- 172.21.15.42:0/719500304 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbf38078b90 msgr2=0x7fbf3807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:10.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.874+0000 7fbf5da00640 1 --2- 172.21.15.42:0/719500304 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbf38078b90 0x7fbf3807b0a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbf48001720 tx=0x7fbf48009040 comp rx=0 tx=0).stop 2024-09-17T01:37:10.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.874+0000 7fbf5da00640 1 -- 172.21.15.42:0/719500304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf580d2810 msgr2=0x7fbf580d3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:10.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.874+0000 7fbf5da00640 1 --2- 172.21.15.42:0/719500304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf580d2810 0x7fbf580d3380 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000ea70 tx=0x7fbf5000ef30 comp rx=0 tx=0).stop 2024-09-17T01:37:10.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.874+0000 7fbf5da00640 1 -- 172.21.15.42:0/719500304 shutdown_connections 2024-09-17T01:37:10.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.874+0000 7fbf5da00640 1 --2- 172.21.15.42:0/719500304 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbf38078b90 0x7fbf3807b0a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:10.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.874+0000 7fbf5da00640 1 --2- 172.21.15.42:0/719500304 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf580b6030 0x7fbf580ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:10.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.874+0000 7fbf5da00640 1 --2- 172.21.15.42:0/719500304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf580d2810 0x7fbf580d3380 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:10.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.874+0000 7fbf5da00640 1 --2- 172.21.15.42:0/719500304 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf58073340 0x7fbf581567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:10.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.874+0000 7fbf5da00640 1 -- 172.21.15.42:0/719500304 >> 172.21.15.42:0/719500304 conn(0x7fbf580d1210 msgr2=0x7fbf580d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:10.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.875+0000 7fbf5da00640 1 -- 172.21.15.42:0/719500304 shutdown_connections 2024-09-17T01:37:10.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:10.875+0000 7fbf5da00640 1 -- 172.21.15.42:0/719500304 wait complete. 2024-09-17T01:37:10.895 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":229,"stamp":"2024-09-17T01:37:09.063421+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":299728,"kb_used_data":8584,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754674992,"statfs":{"total":773094113280,"available":772787191808,"internally_reserved":0,"allocated":8790016,"data_stored":4411556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":297913908},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.210819"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.875283+0000","last_change":"2024-09-17T01:37:00.894727+0000","last_active":"2024-09-17T01:37:01.875283+0000","last_peered":"2024-09-17T01:37:01.875283+0000","last_clean":"2024-09-17T01:37:01.875283+0000","last_became_active":"2024-09-17T01:37:00.894422+0000","last_became_peered":"2024-09-17T01:37:00.894422+0000","last_unstale":"2024-09-17T01:37:01.875283+0000","last_undegraded":"2024-09-17T01:37:01.875283+0000","last_fullsized":"2024-09-17T01:37:01.875283+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:07.471265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938210+0000","last_change":"2024-09-17T01:37:00.883141+0000","last_active":"2024-09-17T01:37:01.938210+0000","last_peered":"2024-09-17T01:37:01.938210+0000","last_clean":"2024-09-17T01:37:01.938210+0000","last_became_active":"2024-09-17T01:37:00.882588+0000","last_became_peered":"2024-09-17T01:37:00.882588+0000","last_unstale":"2024-09-17T01:37:01.938210+0000","last_undegraded":"2024-09-17T01:37:01.938210+0000","last_fullsized":"2024-09-17T01:37:01.938210+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:37:06.008340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938115+0000","last_change":"2024-09-17T01:37:00.886235+0000","last_active":"2024-09-17T01:37:01.938115+0000","last_peered":"2024-09-17T01:37:01.938115+0000","last_clean":"2024-09-17T01:37:01.938115+0000","last_became_active":"2024-09-17T01:37:00.884395+0000","last_became_peered":"2024-09-17T01:37:00.884395+0000","last_unstale":"2024-09-17T01:37:01.938115+0000","last_undegraded":"2024-09-17T01:37:01.938115+0000","last_fullsized":"2024-09-17T01:37:01.938115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:46.190213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938091+0000","last_change":"2024-09-17T01:37:00.882991+0000","last_active":"2024-09-17T01:37:01.938091+0000","last_peered":"2024-09-17T01:37:01.938091+0000","last_clean":"2024-09-17T01:37:01.938091+0000","last_became_active":"2024-09-17T01:37:00.882627+0000","last_became_peered":"2024-09-17T01:37:00.882627+0000","last_unstale":"2024-09-17T01:37:01.938091+0000","last_undegraded":"2024-09-17T01:37:01.938091+0000","last_fullsized":"2024-09-17T01:37:01.938091+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:18.536668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937768+0000","last_change":"2024-09-17T01:37:00.879118+0000","last_active":"2024-09-17T01:37:01.937768+0000","last_peered":"2024-09-17T01:37:01.937768+0000","last_clean":"2024-09-17T01:37:01.937768+0000","last_became_active":"2024-09-17T01:37:00.878074+0000","last_became_peered":"2024-09-17T01:37:00.878074+0000","last_unstale":"2024-09-17T01:37:01.937768+0000","last_undegraded":"2024-09-17T01:37:01.937768+0000","last_fullsized":"2024-09-17T01:37:01.937768+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:11.586434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937221+0000","last_change":"2024-09-17T01:37:00.873819+0000","last_active":"2024-09-17T01:37:01.937221+0000","last_peered":"2024-09-17T01:37:01.937221+0000","last_clean":"2024-09-17T01:37:01.937221+0000","last_became_active":"2024-09-17T01:37:00.873493+0000","last_became_peered":"2024-09-17T01:37:00.873493+0000","last_unstale":"2024-09-17T01:37:01.937221+0000","last_undegraded":"2024-09-17T01:37:01.937221+0000","last_fullsized":"2024-09-17T01:37:01.937221+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:00.534787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870613+0000","last_change":"2024-09-17T01:37:00.885660+0000","last_active":"2024-09-17T01:37:01.870613+0000","last_peered":"2024-09-17T01:37:01.870613+0000","last_clean":"2024-09-17T01:37:01.870613+0000","last_became_active":"2024-09-17T01:37:00.875481+0000","last_became_peered":"2024-09-17T01:37:00.875481+0000","last_unstale":"2024-09-17T01:37:01.870613+0000","last_undegraded":"2024-09-17T01:37:01.870613+0000","last_fullsized":"2024-09-17T01:37:01.870613+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:54.284586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874358+0000","last_change":"2024-09-17T01:37:00.887879+0000","last_active":"2024-09-17T01:37:01.874358+0000","last_peered":"2024-09-17T01:37:01.874358+0000","last_clean":"2024-09-17T01:37:01.874358+0000","last_became_active":"2024-09-17T01:37:00.886811+0000","last_became_peered":"2024-09-17T01:37:00.886811+0000","last_unstale":"2024-09-17T01:37:01.874358+0000","last_undegraded":"2024-09-17T01:37:01.874358+0000","last_fullsized":"2024-09-17T01:37:01.874358+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:07.671917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938274+0000","last_change":"2024-09-17T01:37:00.880205+0000","last_active":"2024-09-17T01:37:01.938274+0000","last_peered":"2024-09-17T01:37:01.938274+0000","last_clean":"2024-09-17T01:37:01.938274+0000","last_became_active":"2024-09-17T01:37:00.879875+0000","last_became_peered":"2024-09-17T01:37:00.879875+0000","last_unstale":"2024-09-17T01:37:01.938274+0000","last_undegraded":"2024-09-17T01:37:01.938274+0000","last_fullsized":"2024-09-17T01:37:01.938274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:26.752484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871291+0000","last_change":"2024-09-17T01:37:00.874744+0000","last_active":"2024-09-17T01:37:01.871291+0000","last_peered":"2024-09-17T01:37:01.871291+0000","last_clean":"2024-09-17T01:37:01.871291+0000","last_became_active":"2024-09-17T01:37:00.872129+0000","last_became_peered":"2024-09-17T01:37:00.872129+0000","last_unstale":"2024-09-17T01:37:01.871291+0000","last_undegraded":"2024-09-17T01:37:01.871291+0000","last_fullsized":"2024-09-17T01:37:01.871291+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:40.026790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.875017+0000","last_change":"2024-09-17T01:37:00.886368+0000","last_active":"2024-09-17T01:37:01.875017+0000","last_peered":"2024-09-17T01:37:01.875017+0000","last_clean":"2024-09-17T01:37:01.875017+0000","last_became_active":"2024-09-17T01:37:00.886042+0000","last_became_peered":"2024-09-17T01:37:00.886042+0000","last_unstale":"2024-09-17T01:37:01.875017+0000","last_undegraded":"2024-09-17T01:37:01.875017+0000","last_fullsized":"2024-09-17T01:37:01.875017+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:51.174176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874503+0000","last_change":"2024-09-17T01:37:00.878779+0000","last_active":"2024-09-17T01:37:01.874503+0000","last_peered":"2024-09-17T01:37:01.874503+0000","last_clean":"2024-09-17T01:37:01.874503+0000","last_became_active":"2024-09-17T01:37:00.878431+0000","last_became_peered":"2024-09-17T01:37:00.878431+0000","last_unstale":"2024-09-17T01:37:01.874503+0000","last_undegraded":"2024-09-17T01:37:01.874503+0000","last_fullsized":"2024-09-17T01:37:01.874503+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:54.289027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937788+0000","last_change":"2024-09-17T01:37:00.883220+0000","last_active":"2024-09-17T01:37:01.937788+0000","last_peered":"2024-09-17T01:37:01.937788+0000","last_clean":"2024-09-17T01:37:01.937788+0000","last_became_active":"2024-09-17T01:37:00.882923+0000","last_became_peered":"2024-09-17T01:37:00.882923+0000","last_unstale":"2024-09-17T01:37:01.937788+0000","last_undegraded":"2024-09-17T01:37:01.937788+0000","last_fullsized":"2024-09-17T01:37:01.937788+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:48.939780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872570+0000","last_change":"2024-09-17T01:37:00.883960+0000","last_active":"2024-09-17T01:37:01.872570+0000","last_peered":"2024-09-17T01:37:01.872570+0000","last_clean":"2024-09-17T01:37:01.872570+0000","last_became_active":"2024-09-17T01:37:00.883650+0000","last_became_peered":"2024-09-17T01:37:00.883650+0000","last_unstale":"2024-09-17T01:37:01.872570+0000","last_undegraded":"2024-09-17T01:37:01.872570+0000","last_fullsized":"2024-09-17T01:37:01.872570+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:50:00.925352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872236+0000","last_change":"2024-09-17T01:37:00.874456+0000","last_active":"2024-09-17T01:37:01.872236+0000","last_peered":"2024-09-17T01:37:01.872236+0000","last_clean":"2024-09-17T01:37:01.872236+0000","last_became_active":"2024-09-17T01:37:00.870867+0000","last_became_peered":"2024-09-17T01:37:00.870867+0000","last_unstale":"2024-09-17T01:37:01.872236+0000","last_undegraded":"2024-09-17T01:37:01.872236+0000","last_fullsized":"2024-09-17T01:37:01.872236+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:15:29.982832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874345+0000","last_change":"2024-09-17T01:37:00.893408+0000","last_active":"2024-09-17T01:37:01.874345+0000","last_peered":"2024-09-17T01:37:01.874345+0000","last_clean":"2024-09-17T01:37:01.874345+0000","last_became_active":"2024-09-17T01:37:00.887416+0000","last_became_peered":"2024-09-17T01:37:00.887416+0000","last_unstale":"2024-09-17T01:37:01.874345+0000","last_undegraded":"2024-09-17T01:37:01.874345+0000","last_fullsized":"2024-09-17T01:37:01.874345+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:22.689477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938992+0000","last_change":"2024-09-17T01:37:00.872192+0000","last_active":"2024-09-17T01:37:01.938992+0000","last_peered":"2024-09-17T01:37:01.938992+0000","last_clean":"2024-09-17T01:37:01.938992+0000","last_became_active":"2024-09-17T01:37:00.871809+0000","last_became_peered":"2024-09-17T01:37:00.871809+0000","last_unstale":"2024-09-17T01:37:01.938992+0000","last_undegraded":"2024-09-17T01:37:01.938992+0000","last_fullsized":"2024-09-17T01:37:01.938992+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:55.876836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938793+0000","last_change":"2024-09-17T01:37:00.866290+0000","last_active":"2024-09-17T01:37:01.938793+0000","last_peered":"2024-09-17T01:37:01.938793+0000","last_clean":"2024-09-17T01:37:01.938793+0000","last_became_active":"2024-09-17T01:37:00.865874+0000","last_became_peered":"2024-09-17T01:37:00.865874+0000","last_unstale":"2024-09-17T01:37:01.938793+0000","last_undegraded":"2024-09-17T01:37:01.938793+0000","last_fullsized":"2024-09-17T01:37:01.938793+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:38.896993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874806+0000","last_change":"2024-09-17T01:37:00.897310+0000","last_active":"2024-09-17T01:37:01.874806+0000","last_peered":"2024-09-17T01:37:01.874806+0000","last_clean":"2024-09-17T01:37:01.874806+0000","last_became_active":"2024-09-17T01:37:00.896955+0000","last_became_peered":"2024-09-17T01:37:00.896955+0000","last_unstale":"2024-09-17T01:37:01.874806+0000","last_undegraded":"2024-09-17T01:37:01.874806+0000","last_fullsized":"2024-09-17T01:37:01.874806+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:04:01.328671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938592+0000","last_change":"2024-09-17T01:37:00.866925+0000","last_active":"2024-09-17T01:37:01.938592+0000","last_peered":"2024-09-17T01:37:01.938592+0000","last_clean":"2024-09-17T01:37:01.938592+0000","last_became_active":"2024-09-17T01:37:00.866542+0000","last_became_peered":"2024-09-17T01:37:00.866542+0000","last_unstale":"2024-09-17T01:37:01.938592+0000","last_undegraded":"2024-09-17T01:37:01.938592+0000","last_fullsized":"2024-09-17T01:37:01.938592+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:36.164907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937799+0000","last_change":"2024-09-17T01:37:00.874085+0000","last_active":"2024-09-17T01:37:01.937799+0000","last_peered":"2024-09-17T01:37:01.937799+0000","last_clean":"2024-09-17T01:37:01.937799+0000","last_became_active":"2024-09-17T01:37:00.873522+0000","last_became_peered":"2024-09-17T01:37:00.873522+0000","last_unstale":"2024-09-17T01:37:01.937799+0000","last_undegraded":"2024-09-17T01:37:01.937799+0000","last_fullsized":"2024-09-17T01:37:01.937799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:16.272810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937282+0000","last_change":"2024-09-17T01:37:00.864433+0000","last_active":"2024-09-17T01:37:01.937282+0000","last_peered":"2024-09-17T01:37:01.937282+0000","last_clean":"2024-09-17T01:37:01.937282+0000","last_became_active":"2024-09-17T01:37:00.864086+0000","last_became_peered":"2024-09-17T01:37:00.864086+0000","last_unstale":"2024-09-17T01:37:01.937282+0000","last_undegraded":"2024-09-17T01:37:01.937282+0000","last_fullsized":"2024-09-17T01:37:01.937282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:23.823387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870493+0000","last_change":"2024-09-17T01:37:00.886408+0000","last_active":"2024-09-17T01:37:01.870493+0000","last_peered":"2024-09-17T01:37:01.870493+0000","last_clean":"2024-09-17T01:37:01.870493+0000","last_became_active":"2024-09-17T01:37:00.886111+0000","last_became_peered":"2024-09-17T01:37:00.886111+0000","last_unstale":"2024-09-17T01:37:01.870493+0000","last_undegraded":"2024-09-17T01:37:01.870493+0000","last_fullsized":"2024-09-17T01:37:01.870493+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:10.335496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874607+0000","last_change":"2024-09-17T01:37:00.874639+0000","last_active":"2024-09-17T01:37:01.874607+0000","last_peered":"2024-09-17T01:37:01.874607+0000","last_clean":"2024-09-17T01:37:01.874607+0000","last_became_active":"2024-09-17T01:37:00.874352+0000","last_became_peered":"2024-09-17T01:37:00.874352+0000","last_unstale":"2024-09-17T01:37:01.874607+0000","last_undegraded":"2024-09-17T01:37:01.874607+0000","last_fullsized":"2024-09-17T01:37:01.874607+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:56.583515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871375+0000","last_change":"2024-09-17T01:37:00.881981+0000","last_active":"2024-09-17T01:37:01.871375+0000","last_peered":"2024-09-17T01:37:01.871375+0000","last_clean":"2024-09-17T01:37:01.871375+0000","last_became_active":"2024-09-17T01:37:00.881639+0000","last_became_peered":"2024-09-17T01:37:00.881639+0000","last_unstale":"2024-09-17T01:37:01.871375+0000","last_undegraded":"2024-09-17T01:37:01.871375+0000","last_fullsized":"2024-09-17T01:37:01.871375+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:58.500831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874725+0000","last_change":"2024-09-17T01:37:00.895616+0000","last_active":"2024-09-17T01:37:01.874725+0000","last_peered":"2024-09-17T01:37:01.874725+0000","last_clean":"2024-09-17T01:37:01.874725+0000","last_became_active":"2024-09-17T01:37:00.895306+0000","last_became_peered":"2024-09-17T01:37:00.895306+0000","last_unstale":"2024-09-17T01:37:01.874725+0000","last_undegraded":"2024-09-17T01:37:01.874725+0000","last_fullsized":"2024-09-17T01:37:01.874725+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:33.147682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938197+0000","last_change":"2024-09-17T01:37:00.883738+0000","last_active":"2024-09-17T01:37:01.938197+0000","last_peered":"2024-09-17T01:37:01.938197+0000","last_clean":"2024-09-17T01:37:01.938197+0000","last_became_active":"2024-09-17T01:37:00.883028+0000","last_became_peered":"2024-09-17T01:37:00.883028+0000","last_unstale":"2024-09-17T01:37:01.938197+0000","last_undegraded":"2024-09-17T01:37:01.938197+0000","last_fullsized":"2024-09-17T01:37:01.938197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:50:15.638098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937702+0000","last_change":"2024-09-17T01:37:00.875084+0000","last_active":"2024-09-17T01:37:01.937702+0000","last_peered":"2024-09-17T01:37:01.937702+0000","last_clean":"2024-09-17T01:37:01.937702+0000","last_became_active":"2024-09-17T01:37:00.873935+0000","last_became_peered":"2024-09-17T01:37:00.873935+0000","last_unstale":"2024-09-17T01:37:01.937702+0000","last_undegraded":"2024-09-17T01:37:01.937702+0000","last_fullsized":"2024-09-17T01:37:01.937702+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:49.735347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937846+0000","last_change":"2024-09-17T01:37:00.881622+0000","last_active":"2024-09-17T01:37:01.937846+0000","last_peered":"2024-09-17T01:37:01.937846+0000","last_clean":"2024-09-17T01:37:01.937846+0000","last_became_active":"2024-09-17T01:37:00.880763+0000","last_became_peered":"2024-09-17T01:37:00.880763+0000","last_unstale":"2024-09-17T01:37:01.937846+0000","last_undegraded":"2024-09-17T01:37:01.937846+0000","last_fullsized":"2024-09-17T01:37:01.937846+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:38.263600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874922+0000","last_change":"2024-09-17T01:37:00.895593+0000","last_active":"2024-09-17T01:37:01.874922+0000","last_peered":"2024-09-17T01:37:01.874922+0000","last_clean":"2024-09-17T01:37:01.874922+0000","last_became_active":"2024-09-17T01:37:00.895223+0000","last_became_peered":"2024-09-17T01:37:00.895223+0000","last_unstale":"2024-09-17T01:37:01.874922+0000","last_undegraded":"2024-09-17T01:37:01.874922+0000","last_fullsized":"2024-09-17T01:37:01.874922+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:27.587846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937475+0000","last_change":"2024-09-17T01:37:00.877026+0000","last_active":"2024-09-17T01:37:01.937475+0000","last_peered":"2024-09-17T01:37:01.937475+0000","last_clean":"2024-09-17T01:37:01.937475+0000","last_became_active":"2024-09-17T01:37:00.876085+0000","last_became_peered":"2024-09-17T01:37:00.876085+0000","last_unstale":"2024-09-17T01:37:01.937475+0000","last_undegraded":"2024-09-17T01:37:01.937475+0000","last_fullsized":"2024-09-17T01:37:01.937475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:30.108084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937154+0000","last_change":"2024-09-17T01:37:00.873456+0000","last_active":"2024-09-17T01:37:01.937154+0000","last_peered":"2024-09-17T01:37:01.937154+0000","last_clean":"2024-09-17T01:37:01.937154+0000","last_became_active":"2024-09-17T01:37:00.873158+0000","last_became_peered":"2024-09-17T01:37:00.873158+0000","last_unstale":"2024-09-17T01:37:01.937154+0000","last_undegraded":"2024-09-17T01:37:01.937154+0000","last_fullsized":"2024-09-17T01:37:01.937154+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:57:26.714304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.875006+0000","last_change":"2024-09-17T01:37:00.881273+0000","last_active":"2024-09-17T01:37:01.875006+0000","last_peered":"2024-09-17T01:37:01.875006+0000","last_clean":"2024-09-17T01:37:01.875006+0000","last_became_active":"2024-09-17T01:37:00.880964+0000","last_became_peered":"2024-09-17T01:37:00.880964+0000","last_unstale":"2024-09-17T01:37:01.875006+0000","last_undegraded":"2024-09-17T01:37:01.875006+0000","last_fullsized":"2024-09-17T01:37:01.875006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:17.293605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"77'4","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938142+0000","last_change":"2024-09-17T01:36:59.865695+0000","last_active":"2024-09-17T01:37:01.938142+0000","last_peered":"2024-09-17T01:37:01.938142+0000","last_clean":"2024-09-17T01:37:01.938142+0000","last_became_active":"2024-09-17T01:36:59.865350+0000","last_became_peered":"2024-09-17T01:36:59.865350+0000","last_unstale":"2024-09-17T01:37:01.938142+0000","last_undegraded":"2024-09-17T01:37:01.938142+0000","last_fullsized":"2024-09-17T01:37:01.938142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:36.202357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938662+0000","last_change":"2024-09-17T01:37:00.877472+0000","last_active":"2024-09-17T01:37:01.938662+0000","last_peered":"2024-09-17T01:37:01.938662+0000","last_clean":"2024-09-17T01:37:01.938662+0000","last_became_active":"2024-09-17T01:37:00.876758+0000","last_became_peered":"2024-09-17T01:37:00.876758+0000","last_unstale":"2024-09-17T01:37:01.938662+0000","last_undegraded":"2024-09-17T01:37:01.938662+0000","last_fullsized":"2024-09-17T01:37:01.938662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:14.801586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.939126+0000","last_change":"2024-09-17T01:36:59.876074+0000","last_active":"2024-09-17T01:37:01.939126+0000","last_peered":"2024-09-17T01:37:01.939126+0000","last_clean":"2024-09-17T01:37:01.939126+0000","last_became_active":"2024-09-17T01:36:59.875702+0000","last_became_peered":"2024-09-17T01:36:59.875702+0000","last_unstale":"2024-09-17T01:37:01.939126+0000","last_undegraded":"2024-09-17T01:37:01.939126+0000","last_fullsized":"2024-09-17T01:37:01.939126+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:54.024362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937628+0000","last_change":"2024-09-17T01:37:00.879904+0000","last_active":"2024-09-17T01:37:01.937628+0000","last_peered":"2024-09-17T01:37:01.937628+0000","last_clean":"2024-09-17T01:37:01.937628+0000","last_became_active":"2024-09-17T01:37:00.879538+0000","last_became_peered":"2024-09-17T01:37:00.879538+0000","last_unstale":"2024-09-17T01:37:01.937628+0000","last_undegraded":"2024-09-17T01:37:01.937628+0000","last_fullsized":"2024-09-17T01:37:01.937628+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:35.812883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874879+0000","last_change":"2024-09-17T01:36:59.867428+0000","last_active":"2024-09-17T01:37:01.874879+0000","last_peered":"2024-09-17T01:37:01.874879+0000","last_clean":"2024-09-17T01:37:01.874879+0000","last_became_active":"2024-09-17T01:36:59.867059+0000","last_became_peered":"2024-09-17T01:36:59.867059+0000","last_unstale":"2024-09-17T01:37:01.874879+0000","last_undegraded":"2024-09-17T01:37:01.874879+0000","last_fullsized":"2024-09-17T01:37:01.874879+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:28.659364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871406+0000","last_change":"2024-09-17T01:37:00.883835+0000","last_active":"2024-09-17T01:37:01.871406+0000","last_peered":"2024-09-17T01:37:01.871406+0000","last_clean":"2024-09-17T01:37:01.871406+0000","last_became_active":"2024-09-17T01:37:00.883481+0000","last_became_peered":"2024-09-17T01:37:00.883481+0000","last_unstale":"2024-09-17T01:37:01.871406+0000","last_undegraded":"2024-09-17T01:37:01.871406+0000","last_fullsized":"2024-09-17T01:37:01.871406+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:31.009628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937820+0000","last_change":"2024-09-17T01:36:59.868151+0000","last_active":"2024-09-17T01:37:01.937820+0000","last_peered":"2024-09-17T01:37:01.937820+0000","last_clean":"2024-09-17T01:37:01.937820+0000","last_became_active":"2024-09-17T01:36:59.867665+0000","last_became_peered":"2024-09-17T01:36:59.867665+0000","last_unstale":"2024-09-17T01:37:01.937820+0000","last_undegraded":"2024-09-17T01:37:01.937820+0000","last_fullsized":"2024-09-17T01:37:01.937820+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:13.304795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874435+0000","last_change":"2024-09-17T01:37:00.885316+0000","last_active":"2024-09-17T01:37:01.874435+0000","last_peered":"2024-09-17T01:37:01.874435+0000","last_clean":"2024-09-17T01:37:01.874435+0000","last_became_active":"2024-09-17T01:37:00.885035+0000","last_became_peered":"2024-09-17T01:37:00.885035+0000","last_unstale":"2024-09-17T01:37:01.874435+0000","last_undegraded":"2024-09-17T01:37:01.874435+0000","last_fullsized":"2024-09-17T01:37:01.874435+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:24.483354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873515+0000","last_change":"2024-09-17T01:36:59.868131+0000","last_active":"2024-09-17T01:37:01.873515+0000","last_peered":"2024-09-17T01:37:01.873515+0000","last_clean":"2024-09-17T01:37:01.873515+0000","last_became_active":"2024-09-17T01:36:59.867405+0000","last_became_peered":"2024-09-17T01:36:59.867405+0000","last_unstale":"2024-09-17T01:37:01.873515+0000","last_undegraded":"2024-09-17T01:37:01.873515+0000","last_fullsized":"2024-09-17T01:37:01.873515+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:49.866246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937741+0000","last_change":"2024-09-17T01:37:00.877071+0000","last_active":"2024-09-17T01:37:01.937741+0000","last_peered":"2024-09-17T01:37:01.937741+0000","last_clean":"2024-09-17T01:37:01.937741+0000","last_became_active":"2024-09-17T01:37:00.876770+0000","last_became_peered":"2024-09-17T01:37:00.876770+0000","last_unstale":"2024-09-17T01:37:01.937741+0000","last_undegraded":"2024-09-17T01:37:01.937741+0000","last_fullsized":"2024-09-17T01:37:01.937741+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:35.937945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870354+0000","last_change":"2024-09-17T01:36:59.879850+0000","last_active":"2024-09-17T01:37:01.870354+0000","last_peered":"2024-09-17T01:37:01.870354+0000","last_clean":"2024-09-17T01:37:01.870354+0000","last_became_active":"2024-09-17T01:36:59.879463+0000","last_became_peered":"2024-09-17T01:36:59.879463+0000","last_unstale":"2024-09-17T01:37:01.870354+0000","last_undegraded":"2024-09-17T01:37:01.870354+0000","last_fullsized":"2024-09-17T01:37:01.870354+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:26:09.389012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872260+0000","last_change":"2024-09-17T01:37:00.868009+0000","last_active":"2024-09-17T01:37:01.872260+0000","last_peered":"2024-09-17T01:37:01.872260+0000","last_clean":"2024-09-17T01:37:01.872260+0000","last_became_active":"2024-09-17T01:37:00.867635+0000","last_became_peered":"2024-09-17T01:37:00.867635+0000","last_unstale":"2024-09-17T01:37:01.872260+0000","last_undegraded":"2024-09-17T01:37:01.872260+0000","last_fullsized":"2024-09-17T01:37:01.872260+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:37.440870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872881+0000","last_change":"2024-09-17T01:36:59.871995+0000","last_active":"2024-09-17T01:37:01.872881+0000","last_peered":"2024-09-17T01:37:01.872881+0000","last_clean":"2024-09-17T01:37:01.872881+0000","last_became_active":"2024-09-17T01:36:59.871288+0000","last_became_peered":"2024-09-17T01:36:59.871288+0000","last_unstale":"2024-09-17T01:37:01.872881+0000","last_undegraded":"2024-09-17T01:37:01.872881+0000","last_fullsized":"2024-09-17T01:37:01.872881+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:22.962787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872280+0000","last_change":"2024-09-17T01:37:00.892376+0000","last_active":"2024-09-17T01:37:01.872280+0000","last_peered":"2024-09-17T01:37:01.872280+0000","last_clean":"2024-09-17T01:37:01.872280+0000","last_became_active":"2024-09-17T01:37:00.891949+0000","last_became_peered":"2024-09-17T01:37:00.891949+0000","last_unstale":"2024-09-17T01:37:01.872280+0000","last_undegraded":"2024-09-17T01:37:01.872280+0000","last_fullsized":"2024-09-17T01:37:01.872280+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:00.313691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871905+0000","last_change":"2024-09-17T01:36:59.866044+0000","last_active":"2024-09-17T01:37:01.871905+0000","last_peered":"2024-09-17T01:37:01.871905+0000","last_clean":"2024-09-17T01:37:01.871905+0000","last_became_active":"2024-09-17T01:36:59.865721+0000","last_became_peered":"2024-09-17T01:36:59.865721+0000","last_unstale":"2024-09-17T01:37:01.871905+0000","last_undegraded":"2024-09-17T01:37:01.871905+0000","last_fullsized":"2024-09-17T01:37:01.871905+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:54.305186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871343+0000","last_change":"2024-09-17T01:37:00.881635+0000","last_active":"2024-09-17T01:37:01.871343+0000","last_peered":"2024-09-17T01:37:01.871343+0000","last_clean":"2024-09-17T01:37:01.871343+0000","last_became_active":"2024-09-17T01:37:00.881315+0000","last_became_peered":"2024-09-17T01:37:00.881315+0000","last_unstale":"2024-09-17T01:37:01.871343+0000","last_undegraded":"2024-09-17T01:37:01.871343+0000","last_fullsized":"2024-09-17T01:37:01.871343+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:44.751005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874740+0000","last_change":"2024-09-17T01:36:59.872074+0000","last_active":"2024-09-17T01:37:01.874740+0000","last_peered":"2024-09-17T01:37:01.874740+0000","last_clean":"2024-09-17T01:37:01.874740+0000","last_became_active":"2024-09-17T01:36:59.871674+0000","last_became_peered":"2024-09-17T01:36:59.871674+0000","last_unstale":"2024-09-17T01:37:01.874740+0000","last_undegraded":"2024-09-17T01:37:01.874740+0000","last_fullsized":"2024-09-17T01:37:01.874740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:05.955545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938478+0000","last_change":"2024-09-17T01:37:00.885008+0000","last_active":"2024-09-17T01:37:01.938478+0000","last_peered":"2024-09-17T01:37:01.938478+0000","last_clean":"2024-09-17T01:37:01.938478+0000","last_became_active":"2024-09-17T01:37:00.884389+0000","last_became_peered":"2024-09-17T01:37:00.884389+0000","last_unstale":"2024-09-17T01:37:01.938478+0000","last_undegraded":"2024-09-17T01:37:01.938478+0000","last_fullsized":"2024-09-17T01:37:01.938478+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:41.769359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938290+0000","last_change":"2024-09-17T01:36:59.878360+0000","last_active":"2024-09-17T01:37:01.938290+0000","last_peered":"2024-09-17T01:37:01.938290+0000","last_clean":"2024-09-17T01:37:01.938290+0000","last_became_active":"2024-09-17T01:36:59.878062+0000","last_became_peered":"2024-09-17T01:36:59.878062+0000","last_unstale":"2024-09-17T01:37:01.938290+0000","last_undegraded":"2024-09-17T01:37:01.938290+0000","last_fullsized":"2024-09-17T01:37:01.938290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:33.686940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874641+0000","last_change":"2024-09-17T01:37:00.894146+0000","last_active":"2024-09-17T01:37:01.874641+0000","last_peered":"2024-09-17T01:37:01.874641+0000","last_clean":"2024-09-17T01:37:01.874641+0000","last_became_active":"2024-09-17T01:37:00.893851+0000","last_became_peered":"2024-09-17T01:37:00.893851+0000","last_unstale":"2024-09-17T01:37:01.874641+0000","last_undegraded":"2024-09-17T01:37:01.874641+0000","last_fullsized":"2024-09-17T01:37:01.874641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:40.958493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"77'3","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874260+0000","last_change":"2024-09-17T01:36:59.870792+0000","last_active":"2024-09-17T01:37:01.874260+0000","last_peered":"2024-09-17T01:37:01.874260+0000","last_clean":"2024-09-17T01:37:01.874260+0000","last_became_active":"2024-09-17T01:36:59.870465+0000","last_became_peered":"2024-09-17T01:36:59.870465+0000","last_unstale":"2024-09-17T01:37:01.874260+0000","last_undegraded":"2024-09-17T01:37:01.874260+0000","last_fullsized":"2024-09-17T01:37:01.874260+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:48.732387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938477+0000","last_change":"2024-09-17T01:37:00.883131+0000","last_active":"2024-09-17T01:37:01.938477+0000","last_peered":"2024-09-17T01:37:01.938477+0000","last_clean":"2024-09-17T01:37:01.938477+0000","last_became_active":"2024-09-17T01:37:00.874476+0000","last_became_peered":"2024-09-17T01:37:00.874476+0000","last_unstale":"2024-09-17T01:37:01.938477+0000","last_undegraded":"2024-09-17T01:37:01.938477+0000","last_fullsized":"2024-09-17T01:37:01.938477+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:55.258607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"77'6","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873687+0000","last_change":"2024-09-17T01:36:59.867187+0000","last_active":"2024-09-17T01:37:01.873687+0000","last_peered":"2024-09-17T01:37:01.873687+0000","last_clean":"2024-09-17T01:37:01.873687+0000","last_became_active":"2024-09-17T01:36:59.866667+0000","last_became_peered":"2024-09-17T01:36:59.866667+0000","last_unstale":"2024-09-17T01:37:01.873687+0000","last_undegraded":"2024-09-17T01:37:01.873687+0000","last_fullsized":"2024-09-17T01:37:01.873687+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:51:46.620956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937486+0000","last_change":"2024-09-17T01:37:00.880197+0000","last_active":"2024-09-17T01:37:01.937486+0000","last_peered":"2024-09-17T01:37:01.937486+0000","last_clean":"2024-09-17T01:37:01.937486+0000","last_became_active":"2024-09-17T01:37:00.879829+0000","last_became_peered":"2024-09-17T01:37:00.879829+0000","last_unstale":"2024-09-17T01:37:01.937486+0000","last_undegraded":"2024-09-17T01:37:01.937486+0000","last_fullsized":"2024-09-17T01:37:01.937486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:52.671561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873248+0000","last_change":"2024-09-17T01:36:59.877119+0000","last_active":"2024-09-17T01:37:01.873248+0000","last_peered":"2024-09-17T01:37:01.873248+0000","last_clean":"2024-09-17T01:37:01.873248+0000","last_became_active":"2024-09-17T01:36:59.876620+0000","last_became_peered":"2024-09-17T01:36:59.876620+0000","last_unstale":"2024-09-17T01:37:01.873248+0000","last_undegraded":"2024-09-17T01:37:01.873248+0000","last_fullsized":"2024-09-17T01:37:01.873248+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:33.686940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870866+0000","last_change":"2024-09-17T01:37:00.878599+0000","last_active":"2024-09-17T01:37:01.870866+0000","last_peered":"2024-09-17T01:37:01.870866+0000","last_clean":"2024-09-17T01:37:01.870866+0000","last_became_active":"2024-09-17T01:37:00.878274+0000","last_became_peered":"2024-09-17T01:37:00.878274+0000","last_unstale":"2024-09-17T01:37:01.870866+0000","last_undegraded":"2024-09-17T01:37:01.870866+0000","last_fullsized":"2024-09-17T01:37:01.870866+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:51.128375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870403+0000","last_change":"2024-09-17T01:36:59.876949+0000","last_active":"2024-09-17T01:37:01.870403+0000","last_peered":"2024-09-17T01:37:01.870403+0000","last_clean":"2024-09-17T01:37:01.870403+0000","last_became_active":"2024-09-17T01:36:59.876378+0000","last_became_peered":"2024-09-17T01:36:59.876378+0000","last_unstale":"2024-09-17T01:37:01.870403+0000","last_undegraded":"2024-09-17T01:37:01.870403+0000","last_fullsized":"2024-09-17T01:37:01.870403+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:49.485267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937617+0000","last_change":"2024-09-17T01:37:00.866971+0000","last_active":"2024-09-17T01:37:01.937617+0000","last_peered":"2024-09-17T01:37:01.937617+0000","last_clean":"2024-09-17T01:37:01.937617+0000","last_became_active":"2024-09-17T01:37:00.866631+0000","last_became_peered":"2024-09-17T01:37:00.866631+0000","last_unstale":"2024-09-17T01:37:01.937617+0000","last_undegraded":"2024-09-17T01:37:01.937617+0000","last_fullsized":"2024-09-17T01:37:01.937617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:41.130454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870561+0000","last_change":"2024-09-17T01:36:59.870560+0000","last_active":"2024-09-17T01:37:01.870561+0000","last_peered":"2024-09-17T01:37:01.870561+0000","last_clean":"2024-09-17T01:37:01.870561+0000","last_became_active":"2024-09-17T01:36:59.870147+0000","last_became_peered":"2024-09-17T01:36:59.870147+0000","last_unstale":"2024-09-17T01:37:01.870561+0000","last_undegraded":"2024-09-17T01:37:01.870561+0000","last_fullsized":"2024-09-17T01:37:01.870561+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:15.252189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937540+0000","last_change":"2024-09-17T01:37:00.879444+0000","last_active":"2024-09-17T01:37:01.937540+0000","last_peered":"2024-09-17T01:37:01.937540+0000","last_clean":"2024-09-17T01:37:01.937540+0000","last_became_active":"2024-09-17T01:37:00.877381+0000","last_became_peered":"2024-09-17T01:37:00.877381+0000","last_unstale":"2024-09-17T01:37:01.937540+0000","last_undegraded":"2024-09-17T01:37:01.937540+0000","last_fullsized":"2024-09-17T01:37:01.937540+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:24.841003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"77'8","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870188+0000","last_change":"2024-09-17T01:36:59.872221+0000","last_active":"2024-09-17T01:37:01.870188+0000","last_peered":"2024-09-17T01:37:01.870188+0000","last_clean":"2024-09-17T01:37:01.870188+0000","last_became_active":"2024-09-17T01:36:59.871924+0000","last_became_peered":"2024-09-17T01:36:59.871924+0000","last_unstale":"2024-09-17T01:37:01.870188+0000","last_undegraded":"2024-09-17T01:37:01.870188+0000","last_fullsized":"2024-09-17T01:37:01.870188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:26.403466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938258+0000","last_change":"2024-09-17T01:37:00.877693+0000","last_active":"2024-09-17T01:37:01.938258+0000","last_peered":"2024-09-17T01:37:01.938258+0000","last_clean":"2024-09-17T01:37:01.938258+0000","last_became_active":"2024-09-17T01:37:00.877386+0000","last_became_peered":"2024-09-17T01:37:00.877386+0000","last_unstale":"2024-09-17T01:37:01.938258+0000","last_undegraded":"2024-09-17T01:37:01.938258+0000","last_fullsized":"2024-09-17T01:37:01.938258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:14.659829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874878+0000","last_change":"2024-09-17T01:36:59.864804+0000","last_active":"2024-09-17T01:37:01.874878+0000","last_peered":"2024-09-17T01:37:01.874878+0000","last_clean":"2024-09-17T01:37:01.874878+0000","last_became_active":"2024-09-17T01:36:59.863708+0000","last_became_peered":"2024-09-17T01:36:59.863708+0000","last_unstale":"2024-09-17T01:37:01.874878+0000","last_undegraded":"2024-09-17T01:37:01.874878+0000","last_fullsized":"2024-09-17T01:37:01.874878+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:50.272122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938528+0000","last_change":"2024-09-17T01:37:00.881962+0000","last_active":"2024-09-17T01:37:01.938528+0000","last_peered":"2024-09-17T01:37:01.938528+0000","last_clean":"2024-09-17T01:37:01.938528+0000","last_became_active":"2024-09-17T01:37:00.881348+0000","last_became_peered":"2024-09-17T01:37:00.881348+0000","last_unstale":"2024-09-17T01:37:01.938528+0000","last_undegraded":"2024-09-17T01:37:01.938528+0000","last_fullsized":"2024-09-17T01:37:01.938528+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:51.607996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938307+0000","last_change":"2024-09-17T01:36:59.882677+0000","last_active":"2024-09-17T01:37:01.938307+0000","last_peered":"2024-09-17T01:37:01.938307+0000","last_clean":"2024-09-17T01:37:01.938307+0000","last_became_active":"2024-09-17T01:36:59.882324+0000","last_became_peered":"2024-09-17T01:36:59.882324+0000","last_unstale":"2024-09-17T01:37:01.938307+0000","last_undegraded":"2024-09-17T01:37:01.938307+0000","last_fullsized":"2024-09-17T01:37:01.938307+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:25.084810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938669+0000","last_change":"2024-09-17T01:37:00.881768+0000","last_active":"2024-09-17T01:37:01.938669+0000","last_peered":"2024-09-17T01:37:01.938669+0000","last_clean":"2024-09-17T01:37:01.938669+0000","last_became_active":"2024-09-17T01:37:00.880039+0000","last_became_peered":"2024-09-17T01:37:00.880039+0000","last_unstale":"2024-09-17T01:37:01.938669+0000","last_undegraded":"2024-09-17T01:37:01.938669+0000","last_fullsized":"2024-09-17T01:37:01.938669+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:19.860512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"77'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937401+0000","last_change":"2024-09-17T01:36:59.880681+0000","last_active":"2024-09-17T01:37:01.937401+0000","last_peered":"2024-09-17T01:37:01.937401+0000","last_clean":"2024-09-17T01:37:01.937401+0000","last_became_active":"2024-09-17T01:36:59.880368+0000","last_became_peered":"2024-09-17T01:36:59.880368+0000","last_unstale":"2024-09-17T01:37:01.937401+0000","last_undegraded":"2024-09-17T01:37:01.937401+0000","last_fullsized":"2024-09-17T01:37:01.937401+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:23.768788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938247+0000","last_change":"2024-09-17T01:37:00.880051+0000","last_active":"2024-09-17T01:37:01.938247+0000","last_peered":"2024-09-17T01:37:01.938247+0000","last_clean":"2024-09-17T01:37:01.938247+0000","last_became_active":"2024-09-17T01:37:00.878651+0000","last_became_peered":"2024-09-17T01:37:00.878651+0000","last_unstale":"2024-09-17T01:37:01.938247+0000","last_undegraded":"2024-09-17T01:37:01.938247+0000","last_fullsized":"2024-09-17T01:37:01.938247+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:50.436558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937897+0000","last_change":"2024-09-17T01:36:59.877280+0000","last_active":"2024-09-17T01:37:01.937897+0000","last_peered":"2024-09-17T01:37:01.937897+0000","last_clean":"2024-09-17T01:37:01.937897+0000","last_became_active":"2024-09-17T01:36:59.876930+0000","last_became_peered":"2024-09-17T01:36:59.876930+0000","last_unstale":"2024-09-17T01:37:01.937897+0000","last_undegraded":"2024-09-17T01:37:01.937897+0000","last_fullsized":"2024-09-17T01:37:01.937897+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:04.522506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873154+0000","last_change":"2024-09-17T01:37:00.878655+0000","last_active":"2024-09-17T01:37:01.873154+0000","last_peered":"2024-09-17T01:37:01.873154+0000","last_clean":"2024-09-17T01:37:01.873154+0000","last_became_active":"2024-09-17T01:37:00.869157+0000","last_became_peered":"2024-09-17T01:37:00.869157+0000","last_unstale":"2024-09-17T01:37:01.873154+0000","last_undegraded":"2024-09-17T01:37:01.873154+0000","last_fullsized":"2024-09-17T01:37:01.873154+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:50.446321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937464+0000","last_change":"2024-09-17T01:36:59.876368+0000","last_active":"2024-09-17T01:37:01.937464+0000","last_peered":"2024-09-17T01:37:01.937464+0000","last_clean":"2024-09-17T01:37:01.937464+0000","last_became_active":"2024-09-17T01:36:59.876090+0000","last_became_peered":"2024-09-17T01:36:59.876090+0000","last_unstale":"2024-09-17T01:37:01.937464+0000","last_undegraded":"2024-09-17T01:37:01.937464+0000","last_fullsized":"2024-09-17T01:37:01.937464+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:39.464623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873160+0000","last_change":"2024-09-17T01:37:00.877548+0000","last_active":"2024-09-17T01:37:01.873160+0000","last_peered":"2024-09-17T01:37:01.873160+0000","last_clean":"2024-09-17T01:37:01.873160+0000","last_became_active":"2024-09-17T01:37:00.876225+0000","last_became_peered":"2024-09-17T01:37:00.876225+0000","last_unstale":"2024-09-17T01:37:01.873160+0000","last_undegraded":"2024-09-17T01:37:01.873160+0000","last_fullsized":"2024-09-17T01:37:01.873160+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:59:05.289863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937544+0000","last_change":"2024-09-17T01:36:59.880051+0000","last_active":"2024-09-17T01:37:01.937544+0000","last_peered":"2024-09-17T01:37:01.937544+0000","last_clean":"2024-09-17T01:37:01.937544+0000","last_became_active":"2024-09-17T01:36:59.879720+0000","last_became_peered":"2024-09-17T01:36:59.879720+0000","last_unstale":"2024-09-17T01:37:01.937544+0000","last_undegraded":"2024-09-17T01:37:01.937544+0000","last_fullsized":"2024-09-17T01:37:01.937544+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:25.120880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.872544+0000","last_change":"2024-09-17T01:37:00.882269+0000","last_active":"2024-09-17T01:37:01.872544+0000","last_peered":"2024-09-17T01:37:01.872544+0000","last_clean":"2024-09-17T01:37:01.872544+0000","last_became_active":"2024-09-17T01:37:00.881259+0000","last_became_peered":"2024-09-17T01:37:00.881259+0000","last_unstale":"2024-09-17T01:37:01.872544+0000","last_undegraded":"2024-09-17T01:37:01.872544+0000","last_fullsized":"2024-09-17T01:37:01.872544+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:54.281546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937348+0000","last_change":"2024-09-17T01:36:59.878130+0000","last_active":"2024-09-17T01:37:01.937348+0000","last_peered":"2024-09-17T01:37:01.937348+0000","last_clean":"2024-09-17T01:37:01.937348+0000","last_became_active":"2024-09-17T01:36:59.877688+0000","last_became_peered":"2024-09-17T01:36:59.877688+0000","last_unstale":"2024-09-17T01:37:01.937348+0000","last_undegraded":"2024-09-17T01:37:01.937348+0000","last_fullsized":"2024-09-17T01:37:01.937348+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:31.964182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.939045+0000","last_change":"2024-09-17T01:37:00.879111+0000","last_active":"2024-09-17T01:37:01.939045+0000","last_peered":"2024-09-17T01:37:01.939045+0000","last_clean":"2024-09-17T01:37:01.939045+0000","last_became_active":"2024-09-17T01:37:00.874367+0000","last_became_peered":"2024-09-17T01:37:00.874367+0000","last_unstale":"2024-09-17T01:37:01.939045+0000","last_undegraded":"2024-09-17T01:37:01.939045+0000","last_fullsized":"2024-09-17T01:37:01.939045+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:41.447731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.875113+0000","last_change":"2024-09-17T01:36:59.865304+0000","last_active":"2024-09-17T01:37:01.875113+0000","last_peered":"2024-09-17T01:37:01.875113+0000","last_clean":"2024-09-17T01:37:01.875113+0000","last_became_active":"2024-09-17T01:36:59.862462+0000","last_became_peered":"2024-09-17T01:36:59.862462+0000","last_unstale":"2024-09-17T01:37:01.875113+0000","last_undegraded":"2024-09-17T01:37:01.875113+0000","last_fullsized":"2024-09-17T01:37:01.875113+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:53.210356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871401+0000","last_change":"2024-09-17T01:37:00.881114+0000","last_active":"2024-09-17T01:37:01.871401+0000","last_peered":"2024-09-17T01:37:01.871401+0000","last_clean":"2024-09-17T01:37:01.871401+0000","last_became_active":"2024-09-17T01:37:00.880775+0000","last_became_peered":"2024-09-17T01:37:00.880775+0000","last_unstale":"2024-09-17T01:37:01.871401+0000","last_undegraded":"2024-09-17T01:37:01.871401+0000","last_fullsized":"2024-09-17T01:37:01.871401+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:15.044192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"78'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874869+0000","last_change":"2024-09-17T01:36:59.880330+0000","last_active":"2024-09-17T01:37:01.874869+0000","last_peered":"2024-09-17T01:37:01.874869+0000","last_clean":"2024-09-17T01:37:01.874869+0000","last_became_active":"2024-09-17T01:36:59.878802+0000","last_became_peered":"2024-09-17T01:36:59.878802+0000","last_unstale":"2024-09-17T01:37:01.874869+0000","last_undegraded":"2024-09-17T01:37:01.874869+0000","last_fullsized":"2024-09-17T01:37:01.874869+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:53.286067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938018+0000","last_change":"2024-09-17T01:37:00.872505+0000","last_active":"2024-09-17T01:37:01.938018+0000","last_peered":"2024-09-17T01:37:01.938018+0000","last_clean":"2024-09-17T01:37:01.938018+0000","last_became_active":"2024-09-17T01:37:00.872169+0000","last_became_peered":"2024-09-17T01:37:00.872169+0000","last_unstale":"2024-09-17T01:37:01.938018+0000","last_undegraded":"2024-09-17T01:37:01.938018+0000","last_fullsized":"2024-09-17T01:37:01.938018+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:40.396787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874370+0000","last_change":"2024-09-17T01:36:59.863867+0000","last_active":"2024-09-17T01:37:01.874370+0000","last_peered":"2024-09-17T01:37:01.874370+0000","last_clean":"2024-09-17T01:37:01.874370+0000","last_became_active":"2024-09-17T01:36:59.863517+0000","last_became_peered":"2024-09-17T01:36:59.863517+0000","last_unstale":"2024-09-17T01:37:01.874370+0000","last_undegraded":"2024-09-17T01:37:01.874370+0000","last_fullsized":"2024-09-17T01:37:01.874370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:15.269849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.871135+0000","last_change":"2024-09-17T01:37:00.882366+0000","last_active":"2024-09-17T01:37:01.871135+0000","last_peered":"2024-09-17T01:37:01.871135+0000","last_clean":"2024-09-17T01:37:01.871135+0000","last_became_active":"2024-09-17T01:37:00.882086+0000","last_became_peered":"2024-09-17T01:37:00.882086+0000","last_unstale":"2024-09-17T01:37:01.871135+0000","last_undegraded":"2024-09-17T01:37:01.871135+0000","last_fullsized":"2024-09-17T01:37:01.871135+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:55:02.373828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873880+0000","last_change":"2024-09-17T01:36:59.869198+0000","last_active":"2024-09-17T01:37:01.873880+0000","last_peered":"2024-09-17T01:37:01.873880+0000","last_clean":"2024-09-17T01:37:01.873880+0000","last_became_active":"2024-09-17T01:36:59.868898+0000","last_became_peered":"2024-09-17T01:36:59.868898+0000","last_unstale":"2024-09-17T01:37:01.873880+0000","last_undegraded":"2024-09-17T01:37:01.873880+0000","last_fullsized":"2024-09-17T01:37:01.873880+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:12:59.919264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938070+0000","last_change":"2024-09-17T01:37:00.873280+0000","last_active":"2024-09-17T01:37:01.938070+0000","last_peered":"2024-09-17T01:37:01.938070+0000","last_clean":"2024-09-17T01:37:01.938070+0000","last_became_active":"2024-09-17T01:37:00.871566+0000","last_became_peered":"2024-09-17T01:37:00.871566+0000","last_unstale":"2024-09-17T01:37:01.938070+0000","last_undegraded":"2024-09-17T01:37:01.938070+0000","last_fullsized":"2024-09-17T01:37:01.938070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:59.796709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873685+0000","last_change":"2024-09-17T01:36:59.867758+0000","last_active":"2024-09-17T01:37:01.873685+0000","last_peered":"2024-09-17T01:37:01.873685+0000","last_clean":"2024-09-17T01:37:01.873685+0000","last_became_active":"2024-09-17T01:36:59.866985+0000","last_became_peered":"2024-09-17T01:36:59.866985+0000","last_unstale":"2024-09-17T01:37:01.873685+0000","last_undegraded":"2024-09-17T01:37:01.873685+0000","last_fullsized":"2024-09-17T01:37:01.873685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:17.223254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.874679+0000","last_change":"2024-09-17T01:37:00.883794+0000","last_active":"2024-09-17T01:37:01.874679+0000","last_peered":"2024-09-17T01:37:01.874679+0000","last_clean":"2024-09-17T01:37:01.874679+0000","last_became_active":"2024-09-17T01:37:00.879349+0000","last_became_peered":"2024-09-17T01:37:00.879349+0000","last_unstale":"2024-09-17T01:37:01.874679+0000","last_undegraded":"2024-09-17T01:37:01.874679+0000","last_fullsized":"2024-09-17T01:37:01.874679+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:05.980183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938206+0000","last_change":"2024-09-17T01:36:59.872585+0000","last_active":"2024-09-17T01:37:01.938206+0000","last_peered":"2024-09-17T01:37:01.938206+0000","last_clean":"2024-09-17T01:37:01.938206+0000","last_became_active":"2024-09-17T01:36:59.870276+0000","last_became_peered":"2024-09-17T01:36:59.870276+0000","last_unstale":"2024-09-17T01:37:01.938206+0000","last_undegraded":"2024-09-17T01:37:01.938206+0000","last_fullsized":"2024-09-17T01:37:01.938206+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:51.670979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.873386+0000","last_change":"2024-09-17T01:37:00.884276+0000","last_active":"2024-09-17T01:37:01.873386+0000","last_peered":"2024-09-17T01:37:01.873386+0000","last_clean":"2024-09-17T01:37:01.873386+0000","last_became_active":"2024-09-17T01:37:00.883956+0000","last_became_peered":"2024-09-17T01:37:00.883956+0000","last_unstale":"2024-09-17T01:37:01.873386+0000","last_undegraded":"2024-09-17T01:37:01.873386+0000","last_fullsized":"2024-09-17T01:37:01.873386+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:40.973377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937655+0000","last_change":"2024-09-17T01:36:59.883537+0000","last_active":"2024-09-17T01:37:01.937655+0000","last_peered":"2024-09-17T01:37:01.937655+0000","last_clean":"2024-09-17T01:37:01.937655+0000","last_became_active":"2024-09-17T01:36:59.883207+0000","last_became_peered":"2024-09-17T01:36:59.883207+0000","last_unstale":"2024-09-17T01:37:01.937655+0000","last_undegraded":"2024-09-17T01:37:01.937655+0000","last_fullsized":"2024-09-17T01:37:01.937655+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:59.069079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.937976+0000","last_change":"2024-09-17T01:37:00.893414+0000","last_active":"2024-09-17T01:37:01.937976+0000","last_peered":"2024-09-17T01:37:01.937976+0000","last_clean":"2024-09-17T01:37:01.937976+0000","last_became_active":"2024-09-17T01:37:00.893040+0000","last_became_peered":"2024-09-17T01:37:00.893040+0000","last_unstale":"2024-09-17T01:37:01.937976+0000","last_undegraded":"2024-09-17T01:37:01.937976+0000","last_fullsized":"2024-09-17T01:37:01.937976+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:51.081350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.936998+0000","last_change":"2024-09-17T01:36:59.881600+0000","last_active":"2024-09-17T01:37:01.936998+0000","last_peered":"2024-09-17T01:37:01.936998+0000","last_clean":"2024-09-17T01:37:01.936998+0000","last_became_active":"2024-09-17T01:36:59.881167+0000","last_became_peered":"2024-09-17T01:36:59.881167+0000","last_unstale":"2024-09-17T01:37:01.936998+0000","last_undegraded":"2024-09-17T01:37:01.936998+0000","last_fullsized":"2024-09-17T01:37:01.936998+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:43.201550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.938334+0000","last_change":"2024-09-17T01:37:00.886106+0000","last_active":"2024-09-17T01:37:01.938334+0000","last_peered":"2024-09-17T01:37:01.938334+0000","last_clean":"2024-09-17T01:37:01.938334+0000","last_became_active":"2024-09-17T01:37:00.879587+0000","last_became_peered":"2024-09-17T01:37:00.879587+0000","last_unstale":"2024-09-17T01:37:01.938334+0000","last_undegraded":"2024-09-17T01:37:01.938334+0000","last_fullsized":"2024-09-17T01:37:01.938334+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:59.841771+0000","last_clean_scrub_stamp":"2024-09-17T01:36:59.841771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:02.658087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"77'2","reported_seq":17,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870731+0000","last_change":"2024-09-17T01:36:59.873087+0000","last_active":"2024-09-17T01:37:01.870731+0000","last_peered":"2024-09-17T01:37:01.870731+0000","last_clean":"2024-09-17T01:37:01.870731+0000","last_became_active":"2024-09-17T01:36:59.872734+0000","last_became_peered":"2024-09-17T01:36:59.872734+0000","last_unstale":"2024-09-17T01:37:01.870731+0000","last_undegraded":"2024-09-17T01:37:01.870731+0000","last_fullsized":"2024-09-17T01:37:01.870731+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:58.838810+0000","last_clean_scrub_stamp":"2024-09-17T01:36:58.838810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:56:01.555936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":217,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-17T01:37:01.870301+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:37:01.870301+0000","last_peered":"2024-09-17T01:37:01.870301+0000","last_clean":"2024-09-17T01:37:01.870301+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:37:01.870301+0000","last_undegraded":"2024-09-17T01:37:01.870301+0000","last_fullsized":"2024-09-17T01:37:01.870301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476802,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":946176,"data_stored":403832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509505,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40444,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331396,"statfs":{"total":96636764160,"available":96595349504,"internally_reserved":0,"allocated":954368,"data_stored":404862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509504,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40448,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331392,"statfs":{"total":96636764160,"available":96595345408,"internally_reserved":0,"allocated":958464,"data_stored":404896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509505,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44604,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327236,"statfs":{"total":96636764160,"available":96591089664,"internally_reserved":0,"allocated":954368,"data_stored":403944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509505,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":954368,"data_stored":403376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509504,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41012,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330828,"statfs":{"total":96636764160,"available":96594767872,"internally_reserved":0,"allocated":1536000,"data_stored":993618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509506,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36280,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335560,"statfs":{"total":96636764160,"available":96599613440,"internally_reserved":0,"allocated":946176,"data_stored":403320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542211,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41020,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330820,"statfs":{"total":96636764160,"available":96594759680,"internally_reserved":0,"allocated":1540096,"data_stored":993708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:37:10.898 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T01:37:10.899 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T01:37:11.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.175+0000 7f85bfe00640 1 -- 172.21.15.42:0/941016214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85a0005250 msgr2=0x7f85a000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:11.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.175+0000 7f85bfe00640 1 --2- 172.21.15.42:0/941016214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85a0005250 0x7f85a000b9c0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f85b80b4a70 tx=0x7f85a0005830 comp rx=0 tx=0).stop 2024-09-17T01:37:11.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.175+0000 7f85bfe00640 1 -- 172.21.15.42:0/941016214 shutdown_connections 2024-09-17T01:37:11.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.175+0000 7f85bfe00640 1 --2- 172.21.15.42:0/941016214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85a0005250 0x7f85a000b9c0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:11.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.175+0000 7f85bfe00640 1 -- 172.21.15.42:0/941016214 >> 172.21.15.42:0/941016214 conn(0x7f85b80746c0 msgr2=0x7f85b806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:11.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.175+0000 7f85bfe00640 1 -- 172.21.15.42:0/941016214 shutdown_connections 2024-09-17T01:37:11.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.175+0000 7f85bfe00640 1 -- 172.21.15.42:0/941016214 wait complete. 2024-09-17T01:37:11.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.177+0000 7f85bfe00640 1 Processor -- start 2024-09-17T01:37:11.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.177+0000 7f85bfe00640 1 -- start start 2024-09-17T01:37:11.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.179+0000 7f85bfe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f85a0005250 0x7f85b8149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.179+0000 7f85bfe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85b8149e50 0x7f85b81e9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.179+0000 7f85bfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85b814a3a0 0x7f85b81e9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.179+0000 7f85bfe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f85b815d0c0 con 0x7f85b814a3a0 2024-09-17T01:37:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.179+0000 7f85bfe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f85b815cf40 con 0x7f85b8149e50 2024-09-17T01:37:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.179+0000 7f85bfe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f85b815d240 con 0x7f85a0005250 2024-09-17T01:37:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.179+0000 7f85bde00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85b814a3a0 0x7f85b81e9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.179+0000 7f85bde00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85b814a3a0 0x7f85b81e9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53276/0 (socket says 172.21.15.42:53276) 2024-09-17T01:37:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.179+0000 7f85bde00640 1 -- 172.21.15.42:0/1646829094 learned_addr learned my addr 172.21.15.42:0/1646829094 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.180+0000 7f85bca00640 1 --2- 172.21.15.42:0/1646829094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85b8149e50 0x7f85b81e9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.180+0000 7f85bd400640 1 --2- 172.21.15.42:0/1646829094 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f85a0005250 0x7f85b8149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.180+0000 7f85bde00640 1 -- 172.21.15.42:0/1646829094 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f85a0005250 msgr2=0x7f85b8149680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.180+0000 7f85bde00640 1 --2- 172.21.15.42:0/1646829094 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f85a0005250 0x7f85b8149680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:11.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.180+0000 7f85bde00640 1 -- 172.21.15.42:0/1646829094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85b8149e50 msgr2=0x7f85b81e9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:11.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.180+0000 7f85bde00640 1 --2- 172.21.15.42:0/1646829094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85b8149e50 0x7f85b81e9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:11.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.180+0000 7f85bde00640 1 -- 172.21.15.42:0/1646829094 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b81f8d90 con 0x7f85b814a3a0 2024-09-17T01:37:11.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.180+0000 7f85bca00640 1 --2- 172.21.15.42:0/1646829094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85b8149e50 0x7f85b81e9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:11.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.180+0000 7f85bde00640 1 --2- 172.21.15.42:0/1646829094 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85b814a3a0 0x7f85b81e9740 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f85b0000f80 tx=0x7f85b0003bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:11.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.180+0000 7f85b5600640 1 -- 172.21.15.42:0/1646829094 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b002b9a0 con 0x7f85b814a3a0 2024-09-17T01:37:11.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.180+0000 7f85b5600640 1 -- 172.21.15.42:0/1646829094 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85b003a070 con 0x7f85b814a3a0 2024-09-17T01:37:11.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.180+0000 7f85bfe00640 1 -- 172.21.15.42:0/1646829094 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85b81f9000 con 0x7f85b814a3a0 2024-09-17T01:37:11.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.180+0000 7f85b5600640 1 -- 172.21.15.42:0/1646829094 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b0006140 con 0x7f85b814a3a0 2024-09-17T01:37:11.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.181+0000 7f85bfe00640 1 -- 172.21.15.42:0/1646829094 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85b8149bc0 con 0x7f85b814a3a0 2024-09-17T01:37:11.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.182+0000 7f85bfe00640 1 -- 172.21.15.42:0/1646829094 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85b814f090 con 0x7f85b814a3a0 2024-09-17T01:37:11.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.183+0000 7f85b5600640 1 -- 172.21.15.42:0/1646829094 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f85b00062e0 con 0x7f85b814a3a0 2024-09-17T01:37:11.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.184+0000 7f85b5600640 1 --2- 172.21.15.42:0/1646829094 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8598078b90 0x7f859807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:11.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.184+0000 7f85b5600640 1 -- 172.21.15.42:0/1646829094 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7f85b00baee0 con 0x7f85b814a3a0 2024-09-17T01:37:11.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.184+0000 7f85bd400640 1 --2- 172.21.15.42:0/1646829094 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8598078b90 0x7f859807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:11.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.185+0000 7f85bd400640 1 --2- 172.21.15.42:0/1646829094 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8598078b90 0x7f859807b0a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f85ac006600 tx=0x7f85ac006b70 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:11.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.188+0000 7f85b5600640 1 -- 172.21.15.42:0/1646829094 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f85b00834b0 con 0x7f85b814a3a0 2024-09-17T01:37:11.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.458+0000 7f85bfe00640 1 -- 172.21.15.42:0/1646829094 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f85b8068f00 con 0x7f85b814a3a0 2024-09-17T01:37:11.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.461+0000 7f85b5600640 1 -- 172.21.15.42:0/1646829094 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v32) ==== 190+0+147 (secure 0 0 0) 0x7f85b0082db0 con 0x7f85b814a3a0 2024-09-17T01:37:11.459 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-09-17T01:37:11.459 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA== 2024-09-17T01:37:11.459 INFO:teuthology.orchestra.run.smithi042.stdout: caps mds = "allow" 2024-09-17T01:37:11.459 INFO:teuthology.orchestra.run.smithi042.stdout: caps mon = "allow r" 2024-09-17T01:37:11.460 INFO:teuthology.orchestra.run.smithi042.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T01:37:11.460 INFO:teuthology.orchestra.run.smithi042.stderr:updated caps for client.0 2024-09-17T01:37:11.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.464+0000 7f85bfe00640 1 -- 172.21.15.42:0/1646829094 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8598078b90 msgr2=0x7f859807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:11.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.464+0000 7f85bfe00640 1 --2- 172.21.15.42:0/1646829094 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8598078b90 0x7f859807b0a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f85ac006600 tx=0x7f85ac006b70 comp rx=0 tx=0).stop 2024-09-17T01:37:11.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.464+0000 7f85bfe00640 1 -- 172.21.15.42:0/1646829094 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85b814a3a0 msgr2=0x7f85b81e9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:11.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.464+0000 7f85bfe00640 1 --2- 172.21.15.42:0/1646829094 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85b814a3a0 0x7f85b81e9740 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f85b0000f80 tx=0x7f85b0003bc0 comp rx=0 tx=0).stop 2024-09-17T01:37:11.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.465+0000 7f85bfe00640 1 -- 172.21.15.42:0/1646829094 shutdown_connections 2024-09-17T01:37:11.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.465+0000 7f85bfe00640 1 --2- 172.21.15.42:0/1646829094 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8598078b90 0x7f859807b0a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:11.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.465+0000 7f85bfe00640 1 --2- 172.21.15.42:0/1646829094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85b8149e50 0x7f85b81e9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:11.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.465+0000 7f85bfe00640 1 --2- 172.21.15.42:0/1646829094 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85b814a3a0 0x7f85b81e9740 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:11.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.465+0000 7f85bfe00640 1 --2- 172.21.15.42:0/1646829094 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f85a0005250 0x7f85b8149680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:11.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.465+0000 7f85bfe00640 1 -- 172.21.15.42:0/1646829094 >> 172.21.15.42:0/1646829094 conn(0x7f85b80746c0 msgr2=0x7f85b815ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:11.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.465+0000 7f85bfe00640 1 -- 172.21.15.42:0/1646829094 shutdown_connections 2024-09-17T01:37:11.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.465+0000 7f85bfe00640 1 -- 172.21.15.42:0/1646829094 wait complete. 2024-09-17T01:37:11.485 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:37:11.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.713+0000 7f132b200640 1 -- 172.21.15.42:0/2902191365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f132c06d640 msgr2=0x7f132c0b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:11.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.713+0000 7f132b200640 1 --2- 172.21.15.42:0/2902191365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f132c06d640 0x7f132c0b14f0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f132c072210 tx=0x7f132402a980 comp rx=0 tx=0).stop 2024-09-17T01:37:11.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.714+0000 7f132b200640 1 -- 172.21.15.42:0/2902191365 shutdown_connections 2024-09-17T01:37:11.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.714+0000 7f132b200640 1 --2- 172.21.15.42:0/2902191365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f132c06d640 0x7f132c0b14f0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:11.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.714+0000 7f132b200640 1 --2- 172.21.15.42:0/2902191365 >> v2:172.21.15.43:3300/0 conn(0x7f132c0cd660 0x7f132c15c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:11.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.714+0000 7f132b200640 1 -- 172.21.15.42:0/2902191365 >> 172.21.15.42:0/2902191365 conn(0x7f132c073510 msgr2=0x7f132c0b6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:11.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.714+0000 7f132b200640 1 -- 172.21.15.42:0/2902191365 shutdown_connections 2024-09-17T01:37:11.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.714+0000 7f132b200640 1 -- 172.21.15.42:0/2902191365 wait complete. 2024-09-17T01:37:11.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.716+0000 7f132b200640 1 Processor -- start 2024-09-17T01:37:11.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.716+0000 7f132b200640 1 -- start start 2024-09-17T01:37:11.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.717+0000 7f132b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f132c0750b0 0x7f132c156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:11.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.718+0000 7f132b200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f132c0cd660 0x7f132c09e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:11.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.718+0000 7f132b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f132c156fb0 0x7f132c09e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:11.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.718+0000 7f132b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f132c0b1ed0 con 0x7f132c156fb0 2024-09-17T01:37:11.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.718+0000 7f132b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f132c0b1d50 con 0x7f132c0750b0 2024-09-17T01:37:11.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.718+0000 7f132b200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f132c0b2050 con 0x7f132c0cd660 2024-09-17T01:37:11.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.718+0000 7f132a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f132c156fb0 0x7f132c09e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:11.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.718+0000 7f132a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f132c156fb0 0x7f132c09e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53292/0 (socket says 172.21.15.42:53292) 2024-09-17T01:37:11.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.718+0000 7f132a800640 1 -- 172.21.15.42:0/2958428667 learned_addr learned my addr 172.21.15.42:0/2958428667 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:11.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.718+0000 7f1329e00640 1 --2- 172.21.15.42:0/2958428667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f132c0750b0 0x7f132c156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:11.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.718+0000 7f1329400640 1 --2- 172.21.15.42:0/2958428667 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f132c0cd660 0x7f132c09e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:11.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.718+0000 7f132a800640 1 -- 172.21.15.42:0/2958428667 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f132c0cd660 msgr2=0x7f132c09e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:11.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.718+0000 7f132a800640 1 --2- 172.21.15.42:0/2958428667 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f132c0cd660 0x7f132c09e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:11.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.718+0000 7f132a800640 1 -- 172.21.15.42:0/2958428667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f132c0750b0 msgr2=0x7f132c156890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:11.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.718+0000 7f132a800640 1 --2- 172.21.15.42:0/2958428667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f132c0750b0 0x7f132c156890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:11.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.718+0000 7f132a800640 1 -- 172.21.15.42:0/2958428667 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132c0cce60 con 0x7f132c156fb0 2024-09-17T01:37:11.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.718+0000 7f1329400640 1 --2- 172.21.15.42:0/2958428667 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f132c0cd660 0x7f132c09e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:11.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.719+0000 7f132a800640 1 --2- 172.21.15.42:0/2958428667 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f132c156fb0 0x7f132c09e690 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f1324033040 tx=0x7f1324003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:11.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.719+0000 7f1322000640 1 -- 172.21.15.42:0/2958428667 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1324034040 con 0x7f132c156fb0 2024-09-17T01:37:11.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.719+0000 7f1322000640 1 -- 172.21.15.42:0/2958428667 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1324004540 con 0x7f132c156fb0 2024-09-17T01:37:11.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.719+0000 7f1322000640 1 -- 172.21.15.42:0/2958428667 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1324045480 con 0x7f132c156fb0 2024-09-17T01:37:11.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.719+0000 7f132b200640 1 -- 172.21.15.42:0/2958428667 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f132c0d1a90 con 0x7f132c156fb0 2024-09-17T01:37:11.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.719+0000 7f132b200640 1 -- 172.21.15.42:0/2958428667 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f132c0d1780 con 0x7f132c156fb0 2024-09-17T01:37:11.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.720+0000 7f132b200640 1 -- 172.21.15.42:0/2958428667 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f132c0ccbd0 con 0x7f132c156fb0 2024-09-17T01:37:11.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.721+0000 7f1322000640 1 -- 172.21.15.42:0/2958428667 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1324037020 con 0x7f132c156fb0 2024-09-17T01:37:11.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.723+0000 7f1322000640 1 --2- 172.21.15.42:0/2958428667 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f130c078b90 0x7f130c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:11.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.723+0000 7f1322000640 1 -- 172.21.15.42:0/2958428667 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7f13240bc510 con 0x7f132c156fb0 2024-09-17T01:37:11.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.724+0000 7f1329e00640 1 --2- 172.21.15.42:0/2958428667 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f130c078b90 0x7f130c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:11.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.724+0000 7f1329e00640 1 --2- 172.21.15.42:0/2958428667 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f130c078b90 0x7f130c07b0a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f131c004630 tx=0x7f131c00b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:11.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.728+0000 7f1322000640 1 -- 172.21.15.42:0/2958428667 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f13240849f0 con 0x7f132c156fb0 2024-09-17T01:37:11.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.959+0000 7f132b200640 1 -- 172.21.15.42:0/2958428667 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f132c0b25b0 con 0x7f132c156fb0 2024-09-17T01:37:11.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.960+0000 7f1322000640 1 -- 172.21.15.42:0/2958428667 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5225 (secure 0 0 0) 0x7f13240842f0 con 0x7f132c156fb0 2024-09-17T01:37:11.958 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:11.958 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":56,"btime":"2024-09-17T01:37:03:878707+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/1714334149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1714334149},{"type":"v1","addr":"172.21.15.43:6835","nonce":1714334149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":5975,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/2362335883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2362335883},{"type":"v1","addr":"172.21.15.42:6834","nonce":2362335883}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6433,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1300976792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1300976792},{"type":"v1","addr":"172.21.15.43:6837","nonce":1300976792}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:37:00.371835+0000","modified":"2024-09-17T01:37:03.387633+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6729":{"gid":6729,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3707410924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3707410924},{"type":"v1","addr":"172.21.15.42:6835","nonce":3707410924}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6729,"qdb_cluster":[6729]},"id":5}]} 2024-09-17T01:37:11.958 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 56 2024-09-17T01:37:11.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.962+0000 7f132b200640 1 -- 172.21.15.42:0/2958428667 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f130c078b90 msgr2=0x7f130c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:11.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.962+0000 7f132b200640 1 --2- 172.21.15.42:0/2958428667 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f130c078b90 0x7f130c07b0a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f131c004630 tx=0x7f131c00b2e0 comp rx=0 tx=0).stop 2024-09-17T01:37:11.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.962+0000 7f132b200640 1 -- 172.21.15.42:0/2958428667 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f132c156fb0 msgr2=0x7f132c09e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:11.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.962+0000 7f132b200640 1 --2- 172.21.15.42:0/2958428667 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f132c156fb0 0x7f132c09e690 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f1324033040 tx=0x7f1324003f10 comp rx=0 tx=0).stop 2024-09-17T01:37:11.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.963+0000 7f132b200640 1 -- 172.21.15.42:0/2958428667 shutdown_connections 2024-09-17T01:37:11.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.963+0000 7f132b200640 1 --2- 172.21.15.42:0/2958428667 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f130c078b90 0x7f130c07b0a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:11.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.963+0000 7f132b200640 1 --2- 172.21.15.42:0/2958428667 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f132c156fb0 0x7f132c09e690 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:11.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.963+0000 7f132b200640 1 --2- 172.21.15.42:0/2958428667 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f132c0cd660 0x7f132c09e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:11.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.963+0000 7f132b200640 1 --2- 172.21.15.42:0/2958428667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f132c0750b0 0x7f132c156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:11.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.963+0000 7f132b200640 1 -- 172.21.15.42:0/2958428667 >> 172.21.15.42:0/2958428667 conn(0x7f132c073510 msgr2=0x7f132c0b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:11.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.963+0000 7f132b200640 1 -- 172.21.15.42:0/2958428667 shutdown_connections 2024-09-17T01:37:11.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:11.963+0000 7f132b200640 1 -- 172.21.15.42:0/2958428667 wait complete. 2024-09-17T01:37:12.388 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:37:00.371835+0000', 'modified': '2024-09-17T01:37:03.387633+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6729}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6729': {'gid': 6729, 'name': 'a', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.42:6835/3707410924', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6833', 'nonce': 3707410924}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 3707410924}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6729, 'qdb_cluster': [6729]} 2024-09-17T01:37:12.388 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T01:37:12.388 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T01:37:12.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.621+0000 7fd220200640 1 -- 172.21.15.42:0/111838086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd218142f40 msgr2=0x7fd218072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:12.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.621+0000 7fd220200640 1 --2- 172.21.15.42:0/111838086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd218142f40 0x7fd218072950 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fd218071ef0 tx=0x7fd20402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.622+0000 7fd220200640 1 -- 172.21.15.42:0/111838086 shutdown_connections 2024-09-17T01:37:12.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.622+0000 7fd220200640 1 --2- 172.21.15.42:0/111838086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd218142f40 0x7fd218072950 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.622+0000 7fd220200640 1 --2- 172.21.15.42:0/111838086 >> v2:172.21.15.43:3300/0 conn(0x7fd2180b3550 0x7fd21815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.622+0000 7fd220200640 1 -- 172.21.15.42:0/111838086 >> 172.21.15.42:0/111838086 conn(0x7fd2180b2930 msgr2=0x7fd21806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:12.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.622+0000 7fd220200640 1 -- 172.21.15.42:0/111838086 shutdown_connections 2024-09-17T01:37:12.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.622+0000 7fd220200640 1 -- 172.21.15.42:0/111838086 wait complete. 2024-09-17T01:37:12.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.624+0000 7fd220200640 1 Processor -- start 2024-09-17T01:37:12.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.624+0000 7fd220200640 1 -- start start 2024-09-17T01:37:12.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.625+0000 7fd220200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd218072e90 0x7fd2180ab140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:12.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.626+0000 7fd220200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd2180b3550 0x7fd21815acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:12.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.626+0000 7fd220200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd218142f40 0x7fd2180af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:12.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.626+0000 7fd220200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd21806d5b0 con 0x7fd218072e90 2024-09-17T01:37:12.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.626+0000 7fd220200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd21806d430 con 0x7fd218142f40 2024-09-17T01:37:12.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.626+0000 7fd220200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd21806d730 con 0x7fd2180b3550 2024-09-17T01:37:12.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.626+0000 7fd21d800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd218072e90 0x7fd2180ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:12.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.626+0000 7fd21d800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd218072e90 0x7fd2180ab140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53308/0 (socket says 172.21.15.42:53308) 2024-09-17T01:37:12.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.626+0000 7fd21d800640 1 -- 172.21.15.42:0/1013770997 learned_addr learned my addr 172.21.15.42:0/1013770997 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:12.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.626+0000 7fd21ce00640 1 --2- 172.21.15.42:0/1013770997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd2180b3550 0x7fd21815acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:12.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.626+0000 7fd21e200640 1 --2- 172.21.15.42:0/1013770997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd218142f40 0x7fd2180af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:12.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.626+0000 7fd21d800640 1 -- 172.21.15.42:0/1013770997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd2180b3550 msgr2=0x7fd21815acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:12.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.626+0000 7fd21d800640 1 --2- 172.21.15.42:0/1013770997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd2180b3550 0x7fd21815acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.626+0000 7fd21d800640 1 -- 172.21.15.42:0/1013770997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd218142f40 msgr2=0x7fd2180af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:12.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.626+0000 7fd21d800640 1 --2- 172.21.15.42:0/1013770997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd218142f40 0x7fd2180af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.626+0000 7fd21d800640 1 -- 172.21.15.42:0/1013770997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2181f3770 con 0x7fd218072e90 2024-09-17T01:37:12.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.626+0000 7fd21d800640 1 --2- 172.21.15.42:0/1013770997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd218072e90 0x7fd2180ab140 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00e790 tx=0x7fd20c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:12.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.627+0000 7fd215600640 1 -- 172.21.15.42:0/1013770997 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20c00eea0 con 0x7fd218072e90 2024-09-17T01:37:12.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.627+0000 7fd215600640 1 -- 172.21.15.42:0/1013770997 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd20c00cdb0 con 0x7fd218072e90 2024-09-17T01:37:12.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.627+0000 7fd215600640 1 -- 172.21.15.42:0/1013770997 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20c010690 con 0x7fd218072e90 2024-09-17T01:37:12.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.627+0000 7fd220200640 1 -- 172.21.15.42:0/1013770997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2181f3a10 con 0x7fd218072e90 2024-09-17T01:37:12.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.627+0000 7fd220200640 1 -- 172.21.15.42:0/1013770997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd218141b70 con 0x7fd218072e90 2024-09-17T01:37:12.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.630+0000 7fd215600640 1 -- 172.21.15.42:0/1013770997 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd20c010830 con 0x7fd218072e90 2024-09-17T01:37:12.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.631+0000 7fd215600640 1 --2- 172.21.15.42:0/1013770997 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd1f8078b90 0x7fd1f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:12.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.631+0000 7fd215600640 1 -- 172.21.15.42:0/1013770997 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7fd20c09b730 con 0x7fd218072e90 2024-09-17T01:37:12.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.632+0000 7fd227257740 1 Processor -- start 2024-09-17T01:37:12.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.632+0000 7fd21ce00640 1 --2- 172.21.15.42:0/1013770997 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd1f8078b90 0x7fd1f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:12.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.632+0000 7fd227257740 1 -- start start 2024-09-17T01:37:12.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.633+0000 7fd21ce00640 1 --2- 172.21.15.42:0/1013770997 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd1f8078b90 0x7fd1f807b0a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd204034000 tx=0x7fd204004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:12.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.633+0000 7fd227257740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563ebfc7e270 0x563ec004e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:12.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.633+0000 7fd227257740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc553b0 0x563ec004eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:12.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.633+0000 7fd227257740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ebfc5d590 0x563ec001ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:12.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.633+0000 7fd227257740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563ebffa8430 con 0x563ebfc553b0 2024-09-17T01:37:12.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.633+0000 7fd227257740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563ebff985d0 con 0x563ebfc5d590 2024-09-17T01:37:12.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.633+0000 7fd227257740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x563ebff87a00 con 0x563ebfc7e270 2024-09-17T01:37:12.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.634+0000 7fd21ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc553b0 0x563ec004eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:12.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.634+0000 7fd21ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc553b0 0x563ec004eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53322/0 (socket says 172.21.15.42:53322) 2024-09-17T01:37:12.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.634+0000 7fd21d800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563ebfc7e270 0x563ec004e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:12.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.634+0000 7fd21ce00640 1 -- 172.21.15.42:0/739464744 learned_addr learned my addr 172.21.15.42:0/739464744 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:12.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.634+0000 7fd21e200640 1 --2- 172.21.15.42:0/739464744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ebfc5d590 0x563ec001ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:12.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.634+0000 7fd21d800640 1 -- 172.21.15.42:0/739464744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ebfc5d590 msgr2=0x563ec001ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:12.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.634+0000 7fd21d800640 1 --2- 172.21.15.42:0/739464744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ebfc5d590 0x563ec001ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.634+0000 7fd21d800640 1 -- 172.21.15.42:0/739464744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc553b0 msgr2=0x563ec004eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:12.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.634+0000 7fd21d800640 1 --2- 172.21.15.42:0/739464744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc553b0 0x563ec004eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.634+0000 7fd21d800640 1 -- 172.21.15.42:0/739464744 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ebff50520 con 0x563ebfc7e270 2024-09-17T01:37:12.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.634+0000 7fd21ce00640 1 --2- 172.21.15.42:0/739464744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc553b0 0x563ec004eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:37:12.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.634+0000 7fd21d800640 1 --2- 172.21.15.42:0/739464744 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563ebfc7e270 0x563ec004e970 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd20c099b90 tx=0x7fd20c062f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f004a8ddc3e0190 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:12.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.635+0000 7fd20a000640 1 -- 172.21.15.42:0/739464744 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20c067eb0 con 0x563ebfc7e270 2024-09-17T01:37:12.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.635+0000 7fd20a000640 1 -- 172.21.15.42:0/739464744 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd20c06cdf0 con 0x563ebfc7e270 2024-09-17T01:37:12.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.635+0000 7fd20a000640 1 -- 172.21.15.42:0/739464744 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20c085df0 con 0x563ebfc7e270 2024-09-17T01:37:12.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.635+0000 7fd227257740 1 -- 172.21.15.42:0/739464744 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563ebfc7e270 msgr2=0x563ec004e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:12.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.635+0000 7fd227257740 1 --2- 172.21.15.42:0/739464744 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563ebfc7e270 0x563ec004e970 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd20c099b90 tx=0x7fd20c062f90 comp rx=0 tx=0).stop 2024-09-17T01:37:12.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.636+0000 7fd227257740 1 -- 172.21.15.42:0/739464744 shutdown_connections 2024-09-17T01:37:12.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.636+0000 7fd227257740 1 --2- 172.21.15.42:0/739464744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ebfc5d590 0x563ec001ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.636+0000 7fd227257740 1 --2- 172.21.15.42:0/739464744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc553b0 0x563ec004eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.636+0000 7fd227257740 1 --2- 172.21.15.42:0/739464744 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563ebfc7e270 0x563ec004e970 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.636+0000 7fd227257740 1 -- 172.21.15.42:0/739464744 >> 172.21.15.42:0/739464744 conn(0x563ebfc723c0 msgr2=0x563ec0024970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:12.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.636+0000 7fd227257740 1 -- 172.21.15.42:0/739464744 shutdown_connections 2024-09-17T01:37:12.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.636+0000 7fd227257740 1 -- 172.21.15.42:0/739464744 wait complete. 2024-09-17T01:37:12.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.637+0000 7fd227257740 1 -- start start 2024-09-17T01:37:12.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.637+0000 7fd227257740 1 Processor -- start 2024-09-17T01:37:12.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.638+0000 7fd227257740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc553b0 0x563ec0045160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:12.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.639+0000 7fd227257740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563ebfc5d590 0x563ec006a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:12.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.639+0000 7fd227257740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ebfc7e270 0x563ec006ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:12.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.639+0000 7fd227257740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563ebff2e330 con 0x563ebfc553b0 2024-09-17T01:37:12.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.639+0000 7fd227257740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563ebff8b810 con 0x563ebfc7e270 2024-09-17T01:37:12.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.639+0000 7fd227257740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x563ebfcf8620 con 0x563ebfc5d590 2024-09-17T01:37:12.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.639+0000 7fd227257740 10 client.0 _ll_register_callbacks cb 0x563ebff33420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:37:12.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.639+0000 7fd21d800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc553b0 0x563ec0045160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:12.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.639+0000 7fd21d800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc553b0 0x563ec0045160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53332/0 (socket says 172.21.15.42:53332) 2024-09-17T01:37:12.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.639+0000 7fd21d800640 1 -- 172.21.15.42:0/3453917859 learned_addr learned my addr 172.21.15.42:0/3453917859 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:12.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.639+0000 7fd21ce00640 1 --2- 172.21.15.42:0/3453917859 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563ebfc5d590 0x563ec006a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:12.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.639+0000 7fd21e200640 1 --2- 172.21.15.42:0/3453917859 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ebfc7e270 0x563ec006ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:12.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.639+0000 7fd21d800640 1 -- 172.21.15.42:0/3453917859 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563ebfc5d590 msgr2=0x563ec006a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:12.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.639+0000 7fd21d800640 1 --2- 172.21.15.42:0/3453917859 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563ebfc5d590 0x563ec006a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.639+0000 7fd21d800640 1 -- 172.21.15.42:0/3453917859 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ebfc7e270 msgr2=0x563ec006ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:12.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.639+0000 7fd21d800640 1 --2- 172.21.15.42:0/3453917859 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ebfc7e270 0x563ec006ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.639+0000 7fd21d800640 1 -- 172.21.15.42:0/3453917859 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ebfce9850 con 0x563ebfc553b0 2024-09-17T01:37:12.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.640+0000 7fd21d800640 1 --2- 172.21.15.42:0/3453917859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc553b0 0x563ec0045160 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0606f0 tx=0x7fd20c062910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0eb2b455b218332 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:12.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.640+0000 7fd1fea00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:37:12.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.640+0000 7fd1fea00640 1 -- 172.21.15.42:0/3453917859 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20c084060 con 0x563ebfc553b0 2024-09-17T01:37:12.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.640+0000 7fd1fea00640 1 -- 172.21.15.42:0/3453917859 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7fd20c0858b0 con 0x563ebfc553b0 2024-09-17T01:37:12.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.640+0000 7fd227257740 1 -- 172.21.15.42:0/3453917859 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd20c06cdf0 con 0x563ebfc553b0 2024-09-17T01:37:12.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.640+0000 7fd1fea00640 1 -- 172.21.15.42:0/3453917859 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fd20c010b20 con 0x563ebfc553b0 2024-09-17T01:37:12.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.640+0000 7fd227257740 10 client.6888 fetch_fsmap learned FSMap version 56 2024-09-17T01:37:12.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.640+0000 7fd227257740 1 -- 172.21.15.42:0/3453917859 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x563ebfd606b0 con 0x563ebfc553b0 2024-09-17T01:37:12.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.640+0000 7fd1fea00640 1 -- 172.21.15.42:0/3453917859 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd20c06cdf0 con 0x563ebfc553b0 2024-09-17T01:37:12.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.641+0000 7fd1fea00640 1 -- 172.21.15.42:0/3453917859 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 56) ==== 3502+0+0 (secure 0 0 0) 0x7fd20c05edd0 con 0x563ebfc553b0 2024-09-17T01:37:12.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.641+0000 7fd227257740 10 client.6888 fetch_fsmap finished waiting for FSMap version 56 2024-09-17T01:37:12.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.641+0000 7fd227257740 10 client.6888 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T01:37:12.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.641+0000 7fd227257740 20 client.6888 populate_metadata read hostname 'smithi042' 2024-09-17T01:37:12.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.641+0000 7fd227257740 1 --2- 172.21.15.42:0/3453917859 >> [v2:172.21.15.42:6833/3707410924,v1:172.21.15.42:6835/3707410924] conn(0x563ebfc3ce40 0x563ec0049c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:12.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.641+0000 7fd227257740 4 client.6888 mds_command: new command op to 6729 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:37:12.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.641+0000 7fd227257740 1 -- 172.21.15.42:0/3453917859 --> [v2:172.21.15.42:6833/3707410924,v1:172.21.15.42:6835/3707410924] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ebff9a520 con 0x563ebfc3ce40 2024-09-17T01:37:12.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.641+0000 7fd21ce00640 1 --2- 172.21.15.42:0/3453917859 >> [v2:172.21.15.42:6833/3707410924,v1:172.21.15.42:6835/3707410924] conn(0x563ebfc3ce40 0x563ec0049c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:12.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.642+0000 7fd21ce00640 1 --2- 172.21.15.42:0/3453917859 >> [v2:172.21.15.42:6833/3707410924,v1:172.21.15.42:6835/3707410924] conn(0x563ebfc3ce40 0x563ec0049c60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b44e86014d484713 server_cookie=ae1df56d2942784c in_seq=0 out_seq=0 2024-09-17T01:37:12.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.642+0000 7fd1fea00640 10 client.6888 ms_handle_connect on v2:172.21.15.42:6833/3707410924 2024-09-17T01:37:12.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.642+0000 7fd1fea00640 1 -- 172.21.15.42:0/3453917859 <== mds.0 v2:172.21.15.42:6833/3707410924 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563ebff9a520 con 0x563ebfc3ce40 2024-09-17T01:37:12.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.642+0000 7fd1fea00640 10 client.6888 handle_command_reply: tid=0 2024-09-17T01:37:12.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.642+0000 7fd227257740 1 client.6888 shutdown 2024-09-17T01:37:12.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.643+0000 7fd227257740 1 -- 172.21.15.42:0/3453917859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc553b0 msgr2=0x563ec0045160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:12.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.643+0000 7fd227257740 1 --2- 172.21.15.42:0/3453917859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc553b0 0x563ec0045160 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0606f0 tx=0x7fd20c062910 comp rx=0 tx=0).stop 2024-09-17T01:37:12.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.643+0000 7fd227257740 1 -- 172.21.15.42:0/3453917859 shutdown_connections 2024-09-17T01:37:12.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.643+0000 7fd227257740 1 --2- 172.21.15.42:0/3453917859 >> [v2:172.21.15.42:6833/3707410924,v1:172.21.15.42:6835/3707410924] conn(0x563ebfc3ce40 0x563ec0049c60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.643+0000 7fd227257740 1 --2- 172.21.15.42:0/3453917859 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ebfc7e270 0x563ec006ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.643+0000 7fd227257740 1 --2- 172.21.15.42:0/3453917859 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563ebfc5d590 0x563ec006a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.643+0000 7fd1fea00640 0 client.6888 ms_handle_reset on v2:172.21.15.42:6833/3707410924 2024-09-17T01:37:12.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.643+0000 7fd227257740 1 --2- 172.21.15.42:0/3453917859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc553b0 0x563ec0045160 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.643+0000 7fd227257740 1 -- 172.21.15.42:0/3453917859 >> 172.21.15.42:0/3453917859 conn(0x563ebfc723c0 msgr2=0x563ec006b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:12.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.643+0000 7fd227257740 1 -- 172.21.15.42:0/3453917859 shutdown_connections 2024-09-17T01:37:12.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.643+0000 7fd227257740 1 -- 172.21.15.42:0/3453917859 wait complete. 2024-09-17T01:37:12.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.643+0000 7fd227257740 20 client.6888 trim_cache size 0 max 16384 2024-09-17T01:37:12.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.663+0000 7fd227257740 1 Processor -- start 2024-09-17T01:37:12.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.663+0000 7fd227257740 1 -- start start 2024-09-17T01:37:12.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.664+0000 7fd227257740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ebfc553b0 0x563ec00247f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:12.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.664+0000 7fd227257740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc5d590 0x563ec0024d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.664+0000 7fd227257740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563ebfc7e270 0x563ec007bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.664+0000 7fd227257740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd21813f470 con 0x563ebfc5d590 2024-09-17T01:37:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.664+0000 7fd227257740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd21813e5e0 con 0x563ebfc553b0 2024-09-17T01:37:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.664+0000 7fd227257740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd21813ec30 con 0x563ebfc7e270 2024-09-17T01:37:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.664+0000 7fd21ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc5d590 0x563ec0024d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.664+0000 7fd21ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc5d590 0x563ec0024d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53336/0 (socket says 172.21.15.42:53336) 2024-09-17T01:37:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.664+0000 7fd21ce00640 1 -- 172.21.15.42:0/753325480 learned_addr learned my addr 172.21.15.42:0/753325480 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.665+0000 7fd21e200640 1 --2- 172.21.15.42:0/753325480 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563ebfc7e270 0x563ec007bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.665+0000 7fd21d800640 1 --2- 172.21.15.42:0/753325480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ebfc553b0 0x563ec00247f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.665+0000 7fd21ce00640 1 -- 172.21.15.42:0/753325480 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563ebfc7e270 msgr2=0x563ec007bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.665+0000 7fd21ce00640 1 --2- 172.21.15.42:0/753325480 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563ebfc7e270 0x563ec007bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.665+0000 7fd21ce00640 1 -- 172.21.15.42:0/753325480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ebfc553b0 msgr2=0x563ec00247f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:12.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.665+0000 7fd21ce00640 1 --2- 172.21.15.42:0/753325480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ebfc553b0 0x563ec00247f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.665+0000 7fd21ce00640 1 -- 172.21.15.42:0/753325480 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ec0025650 con 0x563ebfc5d590 2024-09-17T01:37:12.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.665+0000 7fd21ce00640 1 --2- 172.21.15.42:0/753325480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc5d590 0x563ec0024d30 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fd204005eb0 tx=0x7fd20403e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11538746c09668b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.665+0000 7fd209600640 1 -- 172.21.15.42:0/753325480 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204003cd0 con 0x563ebfc5d590 2024-09-17T01:37:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.665+0000 7fd209600640 1 -- 172.21.15.42:0/753325480 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd204053480 con 0x563ebfc5d590 2024-09-17T01:37:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.665+0000 7fd209600640 1 -- 172.21.15.42:0/753325480 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204053830 con 0x563ebfc5d590 2024-09-17T01:37:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.666+0000 7fd227257740 1 -- 172.21.15.42:0/753325480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc5d590 msgr2=0x563ec0024d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.666+0000 7fd227257740 1 --2- 172.21.15.42:0/753325480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc5d590 0x563ec0024d30 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fd204005eb0 tx=0x7fd20403e040 comp rx=0 tx=0).stop 2024-09-17T01:37:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.666+0000 7fd227257740 1 -- 172.21.15.42:0/753325480 shutdown_connections 2024-09-17T01:37:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.666+0000 7fd227257740 1 --2- 172.21.15.42:0/753325480 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563ebfc7e270 0x563ec007bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.666+0000 7fd227257740 1 --2- 172.21.15.42:0/753325480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc5d590 0x563ec0024d30 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.666+0000 7fd227257740 1 --2- 172.21.15.42:0/753325480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ebfc553b0 0x563ec00247f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.666+0000 7fd227257740 1 -- 172.21.15.42:0/753325480 >> 172.21.15.42:0/753325480 conn(0x563ebfc723c0 msgr2=0x563ec001a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:12.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.666+0000 7fd227257740 1 -- 172.21.15.42:0/753325480 shutdown_connections 2024-09-17T01:37:12.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.666+0000 7fd227257740 1 -- 172.21.15.42:0/753325480 wait complete. 2024-09-17T01:37:12.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.667+0000 7fd227257740 1 -- start start 2024-09-17T01:37:12.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.667+0000 7fd227257740 1 Processor -- start 2024-09-17T01:37:12.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.669+0000 7fd227257740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc553b0 0x563ec00e3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:12.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.669+0000 7fd227257740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ebfc5d590 0x563ec00822f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:12.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.669+0000 7fd227257740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563ebfc7e270 0x563ec00f08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:12.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.669+0000 7fd227257740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563ec00456a0 con 0x563ebfc553b0 2024-09-17T01:37:12.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.669+0000 7fd227257740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563ebff2e330 con 0x563ebfc5d590 2024-09-17T01:37:12.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.669+0000 7fd227257740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x563ec0047d00 con 0x563ebfc7e270 2024-09-17T01:37:12.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.669+0000 7fd227257740 10 client.0 _ll_register_callbacks cb 0x7fd20c062e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:37:12.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.669+0000 7fd21d800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc553b0 0x563ec00e3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:12.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.669+0000 7fd21d800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc553b0 0x563ec00e3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53346/0 (socket says 172.21.15.42:53346) 2024-09-17T01:37:12.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.669+0000 7fd21d800640 1 -- 172.21.15.42:0/3793126347 learned_addr learned my addr 172.21.15.42:0/3793126347 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:12.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.669+0000 7fd21e200640 1 --2- 172.21.15.42:0/3793126347 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563ebfc7e270 0x563ec00f08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:12.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.669+0000 7fd21ce00640 1 --2- 172.21.15.42:0/3793126347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ebfc5d590 0x563ec00822f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:12.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.669+0000 7fd21d800640 1 -- 172.21.15.42:0/3793126347 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563ebfc7e270 msgr2=0x563ec00f08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:12.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.669+0000 7fd21d800640 1 --2- 172.21.15.42:0/3793126347 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563ebfc7e270 0x563ec00f08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.669+0000 7fd21d800640 1 -- 172.21.15.42:0/3793126347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ebfc5d590 msgr2=0x563ec00822f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:12.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.669+0000 7fd21d800640 1 --2- 172.21.15.42:0/3793126347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ebfc5d590 0x563ec00822f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.669+0000 7fd21d800640 1 -- 172.21.15.42:0/3793126347 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ec0023cb0 con 0x563ebfc553b0 2024-09-17T01:37:12.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.669+0000 7fd21ce00640 1 --2- 172.21.15.42:0/3793126347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ebfc5d590 0x563ec00822f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:12.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.670+0000 7fd21d800640 1 --2- 172.21.15.42:0/3793126347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc553b0 0x563ec00e3df0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00c6a0 tx=0x7fd20c099c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d880a8f26bbe285 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:12.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.670+0000 7fd1fea00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:37:12.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.670+0000 7fd1fea00640 1 -- 172.21.15.42:0/3793126347 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20c05fad0 con 0x563ebfc553b0 2024-09-17T01:37:12.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.670+0000 7fd227257740 1 -- 172.21.15.42:0/3793126347 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd204053480 con 0x563ebfc553b0 2024-09-17T01:37:12.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.670+0000 7fd1fea00640 1 -- 172.21.15.42:0/3793126347 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7fd20c062360 con 0x563ebfc553b0 2024-09-17T01:37:12.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.670+0000 7fd1fea00640 1 -- 172.21.15.42:0/3793126347 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fd20c06cdf0 con 0x563ebfc553b0 2024-09-17T01:37:12.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.670+0000 7fd227257740 10 client.6894 fetch_fsmap learned FSMap version 56 2024-09-17T01:37:12.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.670+0000 7fd227257740 1 -- 172.21.15.42:0/3793126347 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x563ec0022e10 con 0x563ebfc553b0 2024-09-17T01:37:12.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.670+0000 7fd1fea00640 1 -- 172.21.15.42:0/3793126347 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd204053480 con 0x563ebfc553b0 2024-09-17T01:37:12.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.670+0000 7fd1fea00640 1 -- 172.21.15.42:0/3793126347 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 56) ==== 3502+0+0 (secure 0 0 0) 0x7fd20c0790f0 con 0x563ebfc553b0 2024-09-17T01:37:12.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.670+0000 7fd227257740 10 client.6894 fetch_fsmap finished waiting for FSMap version 56 2024-09-17T01:37:12.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.670+0000 7fd227257740 10 client.6894 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T01:37:12.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.671+0000 7fd227257740 20 client.6894 populate_metadata read hostname 'smithi042' 2024-09-17T01:37:12.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.671+0000 7fd227257740 1 --2- 172.21.15.42:0/3793126347 >> [v2:172.21.15.42:6833/3707410924,v1:172.21.15.42:6835/3707410924] conn(0x563ec00f0ec0 0x563ec00247f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:12.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.671+0000 7fd227257740 4 client.6894 mds_command: new command op to 6729 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T01:37:12.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.671+0000 7fd227257740 1 -- 172.21.15.42:0/3793126347 --> [v2:172.21.15.42:6833/3707410924,v1:172.21.15.42:6835/3707410924] -- command(tid 0: {"prefix": "status"}) -- 0x563ebff95fd0 con 0x563ec00f0ec0 2024-09-17T01:37:12.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.671+0000 7fd21ce00640 1 --2- 172.21.15.42:0/3793126347 >> [v2:172.21.15.42:6833/3707410924,v1:172.21.15.42:6835/3707410924] conn(0x563ec00f0ec0 0x563ec00247f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:12.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.671+0000 7fd21ce00640 1 --2- 172.21.15.42:0/3793126347 >> [v2:172.21.15.42:6833/3707410924,v1:172.21.15.42:6835/3707410924] conn(0x563ec00f0ec0 0x563ec00247f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5dbe79d79194359 server_cookie=fa44ad297c7aa0b in_seq=0 out_seq=0 2024-09-17T01:37:12.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.671+0000 7fd1fea00640 10 client.6894 ms_handle_connect on v2:172.21.15.42:6833/3707410924 2024-09-17T01:37:12.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.672+0000 7fd1fea00640 1 -- 172.21.15.42:0/3793126347 <== mds.0 v2:172.21.15.42:6833/3707410924 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x563ebff95fd0 con 0x563ec00f0ec0 2024-09-17T01:37:12.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.672+0000 7fd1fea00640 10 client.6894 handle_command_reply: tid=0 2024-09-17T01:37:12.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.672+0000 7fd227257740 1 client.6894 shutdown 2024-09-17T01:37:12.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.672+0000 7fd227257740 1 -- 172.21.15.42:0/3793126347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc553b0 msgr2=0x563ec00e3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:12.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.672+0000 7fd227257740 1 --2- 172.21.15.42:0/3793126347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc553b0 0x563ec00e3df0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00c6a0 tx=0x7fd20c099c40 comp rx=0 tx=0).stop 2024-09-17T01:37:12.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.672+0000 7fd227257740 1 -- 172.21.15.42:0/3793126347 shutdown_connections 2024-09-17T01:37:12.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.672+0000 7fd227257740 1 --2- 172.21.15.42:0/3793126347 >> [v2:172.21.15.42:6833/3707410924,v1:172.21.15.42:6835/3707410924] conn(0x563ec00f0ec0 0x563ec00247f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.672+0000 7fd227257740 1 --2- 172.21.15.42:0/3793126347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563ebfc5d590 0x563ec00822f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.672+0000 7fd227257740 1 --2- 172.21.15.42:0/3793126347 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563ebfc7e270 0x563ec00f08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.672+0000 7fd227257740 1 --2- 172.21.15.42:0/3793126347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563ebfc553b0 0x563ec00e3df0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.672+0000 7fd1fea00640 0 client.6894 ms_handle_reset on v2:172.21.15.42:6833/3707410924 2024-09-17T01:37:12.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.672+0000 7fd227257740 1 -- 172.21.15.42:0/3793126347 >> 172.21.15.42:0/3793126347 conn(0x563ebfc723c0 msgr2=0x563ec00829c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:12.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.672+0000 7fd227257740 1 -- 172.21.15.42:0/3793126347 shutdown_connections 2024-09-17T01:37:12.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.672+0000 7fd227257740 1 -- 172.21.15.42:0/3793126347 wait complete. 2024-09-17T01:37:12.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.672+0000 7fd227257740 20 client.6894 trim_cache size 0 max 16384 2024-09-17T01:37:12.674 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:37:12.674 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "fea1c88c-cb05-432f-a745-f9dcbb5f2503", 2024-09-17T01:37:12.674 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-17T01:37:12.674 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 6729, 2024-09-17T01:37:12.674 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-17T01:37:12.674 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-17T01:37:12.674 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-17T01:37:12.674 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 11.821087429, 2024-09-17T01:37:12.675 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 56, 2024-09-17T01:37:12.675 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 78, 2024-09-17T01:37:12.675 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 78, 2024-09-17T01:37:12.675 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 16.767514231 2024-09-17T01:37:12.675 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:37:12.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.673+0000 7fd220200640 1 -- 172.21.15.42:0/1013770997 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd1f8078b90 msgr2=0x7fd1f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:12.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.673+0000 7fd220200640 1 --2- 172.21.15.42:0/1013770997 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd1f8078b90 0x7fd1f807b0a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd204034000 tx=0x7fd204004730 comp rx=0 tx=0).stop 2024-09-17T01:37:12.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.673+0000 7fd220200640 1 -- 172.21.15.42:0/1013770997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd218072e90 msgr2=0x7fd2180ab140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:12.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.673+0000 7fd220200640 1 --2- 172.21.15.42:0/1013770997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd218072e90 0x7fd2180ab140 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00e790 tx=0x7fd20c00ec50 comp rx=0 tx=0).stop 2024-09-17T01:37:12.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.673+0000 7fd220200640 1 -- 172.21.15.42:0/1013770997 shutdown_connections 2024-09-17T01:37:12.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.673+0000 7fd220200640 1 --2- 172.21.15.42:0/1013770997 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd1f8078b90 0x7fd1f807b0a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.673+0000 7fd220200640 1 --2- 172.21.15.42:0/1013770997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd218142f40 0x7fd2180af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.673+0000 7fd220200640 1 --2- 172.21.15.42:0/1013770997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd2180b3550 0x7fd21815acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.673+0000 7fd220200640 1 --2- 172.21.15.42:0/1013770997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd218072e90 0x7fd2180ab140 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.673+0000 7fd220200640 1 -- 172.21.15.42:0/1013770997 >> 172.21.15.42:0/1013770997 conn(0x7fd2180b2930 msgr2=0x7fd21815a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:12.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.673+0000 7fd220200640 1 -- 172.21.15.42:0/1013770997 shutdown_connections 2024-09-17T01:37:12.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.673+0000 7fd220200640 1 -- 172.21.15.42:0/1013770997 wait complete. 2024-09-17T01:37:12.692 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T01:37:12.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.923+0000 7fda5b200640 1 -- 172.21.15.42:0/1574932177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda5415f740 msgr2=0x7fda5406d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:12.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.923+0000 7fda5b200640 1 --2- 172.21.15.42:0/1574932177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda5415f740 0x7fda5406d430 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fda540b3220 tx=0x7fda4c02aa30 comp rx=0 tx=0).stop 2024-09-17T01:37:12.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.923+0000 7fda5b200640 1 -- 172.21.15.42:0/1574932177 shutdown_connections 2024-09-17T01:37:12.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.923+0000 7fda5b200640 1 --2- 172.21.15.42:0/1574932177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda5415f740 0x7fda5406d430 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.923+0000 7fda5b200640 1 --2- 172.21.15.42:0/1574932177 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fda54074500 0x7fda5406eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.923+0000 7fda5b200640 1 --2- 172.21.15.42:0/1574932177 >> v2:172.21.15.43:3300/0 conn(0x7fda540740f0 0x7fda5415f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.923+0000 7fda5b200640 1 -- 172.21.15.42:0/1574932177 >> 172.21.15.42:0/1574932177 conn(0x7fda540b2930 msgr2=0x7fda5406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:12.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.923+0000 7fda5b200640 1 -- 172.21.15.42:0/1574932177 shutdown_connections 2024-09-17T01:37:12.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.923+0000 7fda5b200640 1 -- 172.21.15.42:0/1574932177 wait complete. 2024-09-17T01:37:12.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.926+0000 7fda5b200640 1 Processor -- start 2024-09-17T01:37:12.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.926+0000 7fda5b200640 1 -- start start 2024-09-17T01:37:12.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.927+0000 7fda5b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda540740f0 0x7fda541e9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:12.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.927+0000 7fda5b200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fda5415f740 0x7fda541f8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:12.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.927+0000 7fda5b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda541f9210 0x7fda5415da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:12.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.927+0000 7fda5b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fda5406dd00 con 0x7fda540740f0 2024-09-17T01:37:12.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.927+0000 7fda5b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fda5406db80 con 0x7fda541f9210 2024-09-17T01:37:12.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.927+0000 7fda5b200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fda540cef40 con 0x7fda5415f740 2024-09-17T01:37:12.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.928+0000 7fda53e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda540740f0 0x7fda541e9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:12.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.928+0000 7fda53e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda540740f0 0x7fda541e9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53362/0 (socket says 172.21.15.42:53362) 2024-09-17T01:37:12.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.928+0000 7fda53e00640 1 -- 172.21.15.42:0/3229339030 learned_addr learned my addr 172.21.15.42:0/3229339030 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:12.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.928+0000 7fda59200640 1 --2- 172.21.15.42:0/3229339030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda541f9210 0x7fda5415da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:12.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.928+0000 7fda4b400640 1 --2- 172.21.15.42:0/3229339030 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fda5415f740 0x7fda541f8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:12.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.928+0000 7fda53e00640 1 -- 172.21.15.42:0/3229339030 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fda5415f740 msgr2=0x7fda541f8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:12.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.928+0000 7fda53e00640 1 --2- 172.21.15.42:0/3229339030 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fda5415f740 0x7fda541f8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.928+0000 7fda53e00640 1 -- 172.21.15.42:0/3229339030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda541f9210 msgr2=0x7fda5415da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:12.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.928+0000 7fda53e00640 1 --2- 172.21.15.42:0/3229339030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda541f9210 0x7fda5415da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:12.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.928+0000 7fda53e00640 1 -- 172.21.15.42:0/3229339030 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda541e9870 con 0x7fda540740f0 2024-09-17T01:37:12.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.928+0000 7fda4b400640 1 --2- 172.21.15.42:0/3229339030 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fda5415f740 0x7fda541f8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:12.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.928+0000 7fda59200640 1 --2- 172.21.15.42:0/3229339030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda541f9210 0x7fda5415da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:12.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.928+0000 7fda53e00640 1 --2- 172.21.15.42:0/3229339030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda540740f0 0x7fda541e9040 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fda4400d750 tx=0x7fda4400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:12.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.929+0000 7fda50c00640 1 -- 172.21.15.42:0/3229339030 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda44017070 con 0x7fda540740f0 2024-09-17T01:37:12.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.929+0000 7fda50c00640 1 -- 172.21.15.42:0/3229339030 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda44009ab0 con 0x7fda540740f0 2024-09-17T01:37:12.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.929+0000 7fda50c00640 1 -- 172.21.15.42:0/3229339030 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda44010460 con 0x7fda540740f0 2024-09-17T01:37:12.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.929+0000 7fda5b200640 1 -- 172.21.15.42:0/3229339030 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda541e9b50 con 0x7fda540740f0 2024-09-17T01:37:12.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.929+0000 7fda5b200640 1 -- 172.21.15.42:0/3229339030 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda541ea110 con 0x7fda540740f0 2024-09-17T01:37:12.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.930+0000 7fda5b200640 1 -- 172.21.15.42:0/3229339030 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda541f6800 con 0x7fda540740f0 2024-09-17T01:37:12.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.931+0000 7fda50c00640 1 -- 172.21.15.42:0/3229339030 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fda4401a070 con 0x7fda540740f0 2024-09-17T01:37:12.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.933+0000 7fda50c00640 1 --2- 172.21.15.42:0/3229339030 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fda30078b90 0x7fda3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:12.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.933+0000 7fda50c00640 1 -- 172.21.15.42:0/3229339030 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7fda4409adc0 con 0x7fda540740f0 2024-09-17T01:37:12.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.934+0000 7fda4b400640 1 --2- 172.21.15.42:0/3229339030 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fda30078b90 0x7fda3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:12.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.934+0000 7fda4b400640 1 --2- 172.21.15.42:0/3229339030 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fda30078b90 0x7fda3007b0a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fda541f6630 tx=0x7fda3c005f10 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:12.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:12.937+0000 7fda50c00640 1 -- 172.21.15.42:0/3229339030 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fda44063200 con 0x7fda540740f0 2024-09-17T01:37:13.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:13.171+0000 7fda5b200640 1 -- 172.21.15.42:0/3229339030 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fda54074500 con 0x7fda540740f0 2024-09-17T01:37:13.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:13.171+0000 7fda50c00640 1 -- 172.21.15.42:0/3229339030 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) ==== 53+0+73 (secure 0 0 0) 0x7fda44062b00 con 0x7fda540740f0 2024-09-17T01:37:13.169 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T01:37:13.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:13.174+0000 7fda5b200640 1 -- 172.21.15.42:0/3229339030 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fda30078b90 msgr2=0x7fda3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:13.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:13.174+0000 7fda5b200640 1 --2- 172.21.15.42:0/3229339030 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fda30078b90 0x7fda3007b0a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fda541f6630 tx=0x7fda3c005f10 comp rx=0 tx=0).stop 2024-09-17T01:37:13.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:13.174+0000 7fda5b200640 1 -- 172.21.15.42:0/3229339030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda540740f0 msgr2=0x7fda541e9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:13.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:13.174+0000 7fda5b200640 1 --2- 172.21.15.42:0/3229339030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda540740f0 0x7fda541e9040 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fda4400d750 tx=0x7fda4400dc10 comp rx=0 tx=0).stop 2024-09-17T01:37:13.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:13.174+0000 7fda5b200640 1 -- 172.21.15.42:0/3229339030 shutdown_connections 2024-09-17T01:37:13.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:13.174+0000 7fda5b200640 1 --2- 172.21.15.42:0/3229339030 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fda30078b90 0x7fda3007b0a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:13.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:13.174+0000 7fda5b200640 1 --2- 172.21.15.42:0/3229339030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda541f9210 0x7fda5415da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:13.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:13.174+0000 7fda5b200640 1 --2- 172.21.15.42:0/3229339030 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fda5415f740 0x7fda541f8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:13.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:13.174+0000 7fda5b200640 1 --2- 172.21.15.42:0/3229339030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fda540740f0 0x7fda541e9040 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:13.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:13.174+0000 7fda5b200640 1 -- 172.21.15.42:0/3229339030 >> 172.21.15.42:0/3229339030 conn(0x7fda540b2930 msgr2=0x7fda541555d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:13.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:13.174+0000 7fda5b200640 1 -- 172.21.15.42:0/3229339030 shutdown_connections 2024-09-17T01:37:13.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:13.174+0000 7fda5b200640 1 -- 172.21.15.42:0/3229339030 wait complete. 2024-09-17T01:37:13.196 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T01:37:13.196 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:37:13.196 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-09-17T01:37:13.196 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T01:37:13.196 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:37:13.197 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T01:37:13.197 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T01:37:13.197 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:37:13.197 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:37:13.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:37:13.197 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-09-17T01:37:13.233 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:37:13.233 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:37:13.233 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:37:13.233 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:37:13.233 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-17T01:37:13.233 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:37:13.234 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:37:13.234 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-09-17T01:37:13.234 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-09-17T01:37:13.234 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:37:13.234 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-09-17T01:37:13.234 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-09-17T01:37:13.234 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:37:13.234 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:37:13.234 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-09-17T01:37:13.234 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-17T01:37:13.234 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42374sec preferred_lft 42374sec 2024-09-17T01:37:13.234 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-17T01:37:13.234 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:37:13.235 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:37:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:37:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-09-17T01:37:13.235 INFO:teuthology.orchestra.run.smithi042.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T01:37:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T01:37:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T01:37:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:37:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::68d2:2bff:fe2f:191a/64 scope link 2024-09-17T01:37:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:37:13.235 INFO:teuthology.orchestra.run.smithi042.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:37:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether e2:73:3e:9b:8a:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:37:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::e073:3eff:fe9b:8a00/64 scope link 2024-09-17T01:37:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:37:13.236 INFO:teuthology.orchestra.run.smithi042.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:37:13.236 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T01:37:13.236 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::240b:bfff:feb7:6e5b/64 scope link 2024-09-17T01:37:13.236 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:37:13.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:37:13.236 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:37:13.327 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-17T01:37:13.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:37:13.330 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-09-17T01:37:13.366 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-09-17T01:37:13.366 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:37:13.366 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-17T01:37:13.366 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-17T01:37:13.366 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:37:13.367 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:37:13.367 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:37:13.367 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T01:37:13.367 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T01:37:13.367 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T01:37:13.367 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:37:13.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:37:13.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:37:13.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:37:13.565 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-17T01:37:13.600 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T01:37:13.600 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T01:37:13.601 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:37:13.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:37:13.601 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-09-17T01:37:13.697 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:37:13.697 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T01:37:13.732 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:37:13.733 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:37:13.733 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:37:13.807 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T01:37:13.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:37:13.807 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:37:14.007 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:37:14.007 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:37:14.007 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:37:14.027 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:37:14.028 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:37:14.028 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:37:14.028 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:37:14.028 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:37:14.058 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:37:14.058 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:37:14.058 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:37:14.059 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:37:14.059 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:37:14.059 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-09-17T01:37:14.059 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-09-17T01:37:14.059 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fea1c88c-cb05-432f-a745-f9dcbb5f2503" will pass to kernel 2024-09-17T01:37:14.060 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T01:37:14.060 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-09-17T01:37:14.060 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T01:37:14.060 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T01:37:14.061 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T01:37:14.063 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T01:37:14.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:37:14.063 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:37:14.120 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:37:14.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:37:14.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:37:14.216 INFO:teuthology.orchestra.run.smithi042.stdout:client6080 2024-09-17T01:37:14.216 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:37:14.216 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:37:14.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:37:14.253 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scrub_repair_path) 2024-09-17T01:37:14.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:37:14.334 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch scrub_repair_path/file) 2024-09-17T01:37:14.412 DEBUG:teuthology.orchestra.run.smithi042:> stdin-killer -- python3 -c ' 2024-09-17T01:37:14.413 DEBUG:teuthology.orchestra.run.smithi042:> import os 2024-09-17T01:37:14.413 DEBUG:teuthology.orchestra.run.smithi042:> import stat 2024-09-17T01:37:14.413 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:37:14.413 DEBUG:teuthology.orchestra.run.smithi042:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_repair_path").st_ino) 2024-09-17T01:37:14.413 DEBUG:teuthology.orchestra.run.smithi042:> ' 2024-09-17T01:37:14.553 INFO:teuthology.orchestra.run.smithi042.stdout:1099511627776 2024-09-17T01:37:14.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:37:14.564 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:37:14.565 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:37:14.641 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:37:14.641 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:37:14.717 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T01:37:14.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.987+0000 7f14eb200640 1 -- 172.21.15.42:0/2117459428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14ec15b680 msgr2=0x7f14ec15fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:14.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.987+0000 7f14eb200640 1 --2- 172.21.15.42:0/2117459428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14ec15b680 0x7f14ec15fcc0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f14ec072190 tx=0x7f14dc02a560 comp rx=0 tx=0).stop 2024-09-17T01:37:14.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.987+0000 7f14eb200640 1 -- 172.21.15.42:0/2117459428 shutdown_connections 2024-09-17T01:37:14.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.987+0000 7f14eb200640 1 --2- 172.21.15.42:0/2117459428 >> v2:172.21.15.43:3300/0 conn(0x7f14ec0cafe0 0x7f14ec15f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:14.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.987+0000 7f14eb200640 1 --2- 172.21.15.42:0/2117459428 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f14ec15f660 0x7f14ec0b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:14.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.987+0000 7f14eb200640 1 --2- 172.21.15.42:0/2117459428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14ec15b680 0x7f14ec15fcc0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:14.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.987+0000 7f14eb200640 1 -- 172.21.15.42:0/2117459428 >> 172.21.15.42:0/2117459428 conn(0x7f14ec0b25f0 msgr2=0x7f14ec0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:14.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.987+0000 7f14eb200640 1 -- 172.21.15.42:0/2117459428 shutdown_connections 2024-09-17T01:37:14.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.987+0000 7f14eb200640 1 -- 172.21.15.42:0/2117459428 wait complete. 2024-09-17T01:37:14.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.989+0000 7f14eb200640 1 Processor -- start 2024-09-17T01:37:14.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.990+0000 7f14eb200640 1 -- start start 2024-09-17T01:37:14.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.991+0000 7f14eb200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14ec0cafe0 0x7f14ec14c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:14.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.991+0000 7f14eb200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f14ec15b680 0x7f14ec09b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:14.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.991+0000 7f14eb200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14ec15f660 0x7f14ec0b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:14.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.991+0000 7f14eb200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec0b3a80 con 0x7f14ec0cafe0 2024-09-17T01:37:14.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.991+0000 7f14eb200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec0b3900 con 0x7f14ec15f660 2024-09-17T01:37:14.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.991+0000 7f14eb200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f14ec0b3c00 con 0x7f14ec15b680 2024-09-17T01:37:14.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.991+0000 7f14e9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14ec0cafe0 0x7f14ec14c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:14.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.991+0000 7f14e9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14ec0cafe0 0x7f14ec14c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53384/0 (socket says 172.21.15.42:53384) 2024-09-17T01:37:14.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.991+0000 7f14e9e00640 1 -- 172.21.15.42:0/2184403663 learned_addr learned my addr 172.21.15.42:0/2184403663 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:14.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.992+0000 7f14ea800640 1 --2- 172.21.15.42:0/2184403663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14ec15f660 0x7f14ec0b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:14.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.992+0000 7f14e9e00640 1 -- 172.21.15.42:0/2184403663 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f14ec15b680 msgr2=0x7f14ec09b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:14.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.992+0000 7f14e9e00640 1 --2- 172.21.15.42:0/2184403663 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f14ec15b680 0x7f14ec09b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:14.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.992+0000 7f14e9e00640 1 -- 172.21.15.42:0/2184403663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14ec15f660 msgr2=0x7f14ec0b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:14.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.992+0000 7f14e9e00640 1 --2- 172.21.15.42:0/2184403663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14ec15f660 0x7f14ec0b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:14.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.992+0000 7f14e9e00640 1 -- 172.21.15.42:0/2184403663 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14ec1f6f40 con 0x7f14ec0cafe0 2024-09-17T01:37:14.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.992+0000 7f14ea800640 1 --2- 172.21.15.42:0/2184403663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14ec15f660 0x7f14ec0b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:37:14.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.992+0000 7f14e9e00640 1 --2- 172.21.15.42:0/2184403663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14ec0cafe0 0x7f14ec14c6c0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f14dc034040 tx=0x7f14dc003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:14.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.992+0000 7f14e2000640 1 -- 172.21.15.42:0/2184403663 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc03e030 con 0x7f14ec0cafe0 2024-09-17T01:37:14.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.993+0000 7f14e2000640 1 -- 172.21.15.42:0/2184403663 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14dc003e00 con 0x7f14ec0cafe0 2024-09-17T01:37:14.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.993+0000 7f14e2000640 1 -- 172.21.15.42:0/2184403663 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc035040 con 0x7f14ec0cafe0 2024-09-17T01:37:14.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.993+0000 7f14eb200640 1 -- 172.21.15.42:0/2184403663 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14ec1f7220 con 0x7f14ec0cafe0 2024-09-17T01:37:14.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.993+0000 7f14eb200640 1 -- 172.21.15.42:0/2184403663 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14ec1f77e0 con 0x7f14ec0cafe0 2024-09-17T01:37:14.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.994+0000 7f14eb200640 1 -- 172.21.15.42:0/2184403663 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14ec1f3700 con 0x7f14ec0cafe0 2024-09-17T01:37:14.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.995+0000 7f14e2000640 1 -- 172.21.15.42:0/2184403663 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f14dc041030 con 0x7f14ec0cafe0 2024-09-17T01:37:14.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.996+0000 7f14e2000640 1 --2- 172.21.15.42:0/2184403663 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f14c8078b90 0x7f14c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:14.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.996+0000 7f14e2000640 1 -- 172.21.15.42:0/2184403663 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7f14dc0bb660 con 0x7f14ec0cafe0 2024-09-17T01:37:14.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.996+0000 7f14e3e00640 1 --2- 172.21.15.42:0/2184403663 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f14c8078b90 0x7f14c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:14.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:14.997+0000 7f14e3e00640 1 --2- 172.21.15.42:0/2184403663 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f14c8078b90 0x7f14c807b0a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f14ec15ec70 tx=0x7f14d4005c90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:14.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.000+0000 7f14e2000640 1 -- 172.21.15.42:0/2184403663 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f14dc083a00 con 0x7f14ec0cafe0 2024-09-17T01:37:15.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.208+0000 7f14eb200640 1 -- 172.21.15.42:0/2184403663 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f14ec15fcc0 con 0x7f14ec0cafe0 2024-09-17T01:37:15.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.208+0000 7f14e2000640 1 -- 172.21.15.42:0/2184403663 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v78) ==== 80+0+0 (secure 0 0 0) 0x7f14dc083300 con 0x7f14ec0cafe0 2024-09-17T01:37:15.206 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-17T01:37:15.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.210+0000 7f14eb200640 1 -- 172.21.15.42:0/2184403663 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f14c8078b90 msgr2=0x7f14c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:15.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.210+0000 7f14eb200640 1 --2- 172.21.15.42:0/2184403663 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f14c8078b90 0x7f14c807b0a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f14ec15ec70 tx=0x7f14d4005c90 comp rx=0 tx=0).stop 2024-09-17T01:37:15.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.210+0000 7f14eb200640 1 -- 172.21.15.42:0/2184403663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14ec0cafe0 msgr2=0x7f14ec14c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:15.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.210+0000 7f14eb200640 1 --2- 172.21.15.42:0/2184403663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14ec0cafe0 0x7f14ec14c6c0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f14dc034040 tx=0x7f14dc003910 comp rx=0 tx=0).stop 2024-09-17T01:37:15.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.210+0000 7f14eb200640 1 -- 172.21.15.42:0/2184403663 shutdown_connections 2024-09-17T01:37:15.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.210+0000 7f14eb200640 1 --2- 172.21.15.42:0/2184403663 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f14c8078b90 0x7f14c807b0a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:15.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.210+0000 7f14eb200640 1 --2- 172.21.15.42:0/2184403663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14ec15f660 0x7f14ec0b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:15.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.210+0000 7f14eb200640 1 --2- 172.21.15.42:0/2184403663 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f14ec15b680 0x7f14ec09b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:15.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.210+0000 7f14eb200640 1 --2- 172.21.15.42:0/2184403663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14ec0cafe0 0x7f14ec14c6c0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:15.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.210+0000 7f14eb200640 1 -- 172.21.15.42:0/2184403663 >> 172.21.15.42:0/2184403663 conn(0x7f14ec0b25f0 msgr2=0x7f14ec0ca520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:15.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.211+0000 7f14eb200640 1 -- 172.21.15.42:0/2184403663 shutdown_connections 2024-09-17T01:37:15.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.211+0000 7f14eb200640 1 -- 172.21.15.42:0/2184403663 wait complete. 2024-09-17T01:37:15.233 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T01:37:15.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:37:15.233 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T01:37:15.327 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:37:15.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:37:15.327 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T01:37:15.381 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:37:15.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.611+0000 7f7286000640 1 -- 172.21.15.42:0/462731962 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7264005350 msgr2=0x7f726400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:15.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.611+0000 7f7286000640 1 --2- 172.21.15.42:0/462731962 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7264005350 0x7f726400b9c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f7278009ed0 tx=0x7f7264005830 comp rx=0 tx=0).stop 2024-09-17T01:37:15.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.611+0000 7f7286000640 1 -- 172.21.15.42:0/462731962 shutdown_connections 2024-09-17T01:37:15.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.611+0000 7f7286000640 1 --2- 172.21.15.42:0/462731962 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7264005350 0x7f726400b9c0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:15.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.611+0000 7f7286000640 1 -- 172.21.15.42:0/462731962 >> 172.21.15.42:0/462731962 conn(0x7f72800b2930 msgr2=0x7f728006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:15.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.611+0000 7f7286000640 1 -- 172.21.15.42:0/462731962 shutdown_connections 2024-09-17T01:37:15.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.611+0000 7f7286000640 1 -- 172.21.15.42:0/462731962 wait complete. 2024-09-17T01:37:15.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.614+0000 7f7286000640 1 Processor -- start 2024-09-17T01:37:15.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.614+0000 7f7286000640 1 -- start start 2024-09-17T01:37:15.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.615+0000 7f7286000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7264005350 0x7f7280141610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:15.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.615+0000 7f7286000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72801f6c80 0x7f72801f7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:15.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.615+0000 7f7286000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72800ab960 0x7f72800abd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:15.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.615+0000 7f7286000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f728015d040 con 0x7f72800ab960 2024-09-17T01:37:15.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.615+0000 7f7286000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f728015cec0 con 0x7f72801f6c80 2024-09-17T01:37:15.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.615+0000 7f7286000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f728015d1c0 con 0x7f7264005350 2024-09-17T01:37:15.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.615+0000 7f727fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72800ab960 0x7f72800abd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:15.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.616+0000 7f727fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72800ab960 0x7f72800abd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53402/0 (socket says 172.21.15.42:53402) 2024-09-17T01:37:15.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.616+0000 7f727fe00640 1 -- 172.21.15.42:0/3657847434 learned_addr learned my addr 172.21.15.42:0/3657847434 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:15.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.616+0000 7f727f400640 1 --2- 172.21.15.42:0/3657847434 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7264005350 0x7f7280141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:15.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.616+0000 7f7277e00640 1 --2- 172.21.15.42:0/3657847434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72801f6c80 0x7f72801f7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:15.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.616+0000 7f727fe00640 1 -- 172.21.15.42:0/3657847434 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7264005350 msgr2=0x7f7280141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:15.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.616+0000 7f727fe00640 1 --2- 172.21.15.42:0/3657847434 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7264005350 0x7f7280141610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:15.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.616+0000 7f727fe00640 1 -- 172.21.15.42:0/3657847434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72801f6c80 msgr2=0x7f72801f7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:15.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.616+0000 7f727fe00640 1 --2- 172.21.15.42:0/3657847434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72801f6c80 0x7f72801f7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:15.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.616+0000 7f727fe00640 1 -- 172.21.15.42:0/3657847434 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7280141e10 con 0x7f72800ab960 2024-09-17T01:37:15.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.616+0000 7f7277e00640 1 --2- 172.21.15.42:0/3657847434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72801f6c80 0x7f72801f7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:15.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.616+0000 7f727fe00640 1 --2- 172.21.15.42:0/3657847434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72800ab960 0x7f72800abd70 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f7278009ed0 tx=0x7f72780042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:15.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.617+0000 7f7277400640 1 -- 172.21.15.42:0/3657847434 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72780046d0 con 0x7f72800ab960 2024-09-17T01:37:15.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.617+0000 7f7277400640 1 -- 172.21.15.42:0/3657847434 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f727803c480 con 0x7f72800ab960 2024-09-17T01:37:15.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.617+0000 7f7277400640 1 -- 172.21.15.42:0/3657847434 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727803c890 con 0x7f72800ab960 2024-09-17T01:37:15.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.617+0000 7f7286000640 1 -- 172.21.15.42:0/3657847434 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72800ae320 con 0x7f72800ab960 2024-09-17T01:37:15.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.617+0000 7f7286000640 1 -- 172.21.15.42:0/3657847434 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72800ae5c0 con 0x7f72800ab960 2024-09-17T01:37:15.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.618+0000 7f7286000640 1 -- 172.21.15.42:0/3657847434 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f728015d550 con 0x7f72800ab960 2024-09-17T01:37:15.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.619+0000 7f7277400640 1 -- 172.21.15.42:0/3657847434 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7278044020 con 0x7f72800ab960 2024-09-17T01:37:15.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.620+0000 7f7277400640 1 --2- 172.21.15.42:0/3657847434 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f725c078b90 0x7f725c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:15.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.620+0000 7f7277400640 1 -- 172.21.15.42:0/3657847434 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7f72780bbd00 con 0x7f72800ab960 2024-09-17T01:37:15.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.621+0000 7f727f400640 1 --2- 172.21.15.42:0/3657847434 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f725c078b90 0x7f725c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:15.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.621+0000 7f727f400640 1 --2- 172.21.15.42:0/3657847434 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f725c078b90 0x7f725c07b0a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f72700066b0 tx=0x7f7270006b70 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:15.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.624+0000 7f7277400640 1 -- 172.21.15.42:0/3657847434 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f727804b020 con 0x7f72800ab960 2024-09-17T01:37:15.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.859+0000 7f7286000640 1 -- 172.21.15.42:0/3657847434 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f728006a170 con 0x7f72800ab960 2024-09-17T01:37:15.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.860+0000 7f7277400640 1 -- 172.21.15.42:0/3657847434 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5225 (secure 0 0 0) 0x7f72800ae320 con 0x7f72800ab960 2024-09-17T01:37:15.858 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:15.858 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":56,"btime":"2024-09-17T01:37:03:878707+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/1714334149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1714334149},{"type":"v1","addr":"172.21.15.43:6835","nonce":1714334149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":5975,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/2362335883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2362335883},{"type":"v1","addr":"172.21.15.42:6834","nonce":2362335883}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6433,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1300976792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1300976792},{"type":"v1","addr":"172.21.15.43:6837","nonce":1300976792}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:37:00.371835+0000","modified":"2024-09-17T01:37:03.387633+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6729":{"gid":6729,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3707410924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3707410924},{"type":"v1","addr":"172.21.15.42:6835","nonce":3707410924}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6729,"qdb_cluster":[6729]},"id":5}]} 2024-09-17T01:37:15.858 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 56 2024-09-17T01:37:15.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.863+0000 7f7286000640 1 -- 172.21.15.42:0/3657847434 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f725c078b90 msgr2=0x7f725c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:15.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.863+0000 7f7286000640 1 --2- 172.21.15.42:0/3657847434 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f725c078b90 0x7f725c07b0a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f72700066b0 tx=0x7f7270006b70 comp rx=0 tx=0).stop 2024-09-17T01:37:15.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.863+0000 7f7286000640 1 -- 172.21.15.42:0/3657847434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72800ab960 msgr2=0x7f72800abd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:15.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.863+0000 7f7286000640 1 --2- 172.21.15.42:0/3657847434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72800ab960 0x7f72800abd70 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f7278009ed0 tx=0x7f72780042d0 comp rx=0 tx=0).stop 2024-09-17T01:37:15.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.863+0000 7f7286000640 1 -- 172.21.15.42:0/3657847434 shutdown_connections 2024-09-17T01:37:15.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.863+0000 7f7286000640 1 --2- 172.21.15.42:0/3657847434 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f725c078b90 0x7f725c07b0a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:15.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.863+0000 7f7286000640 1 --2- 172.21.15.42:0/3657847434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72801f6c80 0x7f72801f7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:15.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.863+0000 7f7286000640 1 --2- 172.21.15.42:0/3657847434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72800ab960 0x7f72800abd70 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:15.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.863+0000 7f7286000640 1 --2- 172.21.15.42:0/3657847434 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7264005350 0x7f7280141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:15.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.863+0000 7f7286000640 1 -- 172.21.15.42:0/3657847434 >> 172.21.15.42:0/3657847434 conn(0x7f72800b2930 msgr2=0x7f72800b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:15.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.863+0000 7f7286000640 1 -- 172.21.15.42:0/3657847434 shutdown_connections 2024-09-17T01:37:15.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:15.863+0000 7f7286000640 1 -- 172.21.15.42:0/3657847434 wait complete. 2024-09-17T01:37:15.888 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-17T01:37:16.143 INFO:teuthology.orchestra.run.smithi042.stdout:{"message":"","return_code":0} 2024-09-17T01:37:16.144 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-17T01:37:16.144 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T01:37:16.144 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:37:16.145 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T01:37:16.145 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:37:16.145 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T01:37:16.145 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:37:16.146 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T01:37:16.146 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:37:16.169 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T01:37:16.170 DEBUG:teuthology.parallel:result is None 2024-09-17T01:37:16.170 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T01:37:16.170 DEBUG:teuthology.parallel:result is None 2024-09-17T01:37:16.171 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T01:37:16.171 DEBUG:teuthology.parallel:result is None 2024-09-17T01:37:16.191 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T01:37:16.191 DEBUG:teuthology.parallel:result is None 2024-09-17T01:37:16.192 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000000.00000000 file_head 2024-09-17T01:37:16.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.355+0000 7ff004c5df40 1 Processor -- start 2024-09-17T01:37:16.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.355+0000 7ff004c5df40 1 -- start start 2024-09-17T01:37:16.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.356+0000 7ff004c5df40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dac8c2fd60 0x55dac8cbcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:16.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.356+0000 7ff004c5df40 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dac8c32220 0x55dac8cb5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:16.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.356+0000 7ff004c5df40 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55dac8be9320 0x55dac8cb6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:16.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.356+0000 7ff004c5df40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55dac8b941d0 con 0x55dac8c2fd60 2024-09-17T01:37:16.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.356+0000 7ff004c5df40 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55dac8ba0f90 con 0x55dac8c32220 2024-09-17T01:37:16.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.356+0000 7ff004c5df40 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55dac8b35c60 con 0x55dac8be9320 2024-09-17T01:37:16.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.356+0000 7feffde00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dac8c2fd60 0x55dac8cbcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:16.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.356+0000 7feffde00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dac8c2fd60 0x55dac8cbcfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53796/0 (socket says 172.21.15.42:53796) 2024-09-17T01:37:16.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.356+0000 7feffde00640 1 -- 172.21.15.42:0/3053351180 learned_addr learned my addr 172.21.15.42:0/3053351180 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:16.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.356+0000 7feffd400640 1 --2- 172.21.15.42:0/3053351180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dac8c32220 0x55dac8cb5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:16.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.357+0000 7feffe800640 1 --2- 172.21.15.42:0/3053351180 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55dac8be9320 0x55dac8cb6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:16.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.357+0000 7feffde00640 1 -- 172.21.15.42:0/3053351180 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55dac8be9320 msgr2=0x55dac8cb6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:16.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.357+0000 7feffde00640 1 --2- 172.21.15.42:0/3053351180 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55dac8be9320 0x55dac8cb6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.357+0000 7feffde00640 1 -- 172.21.15.42:0/3053351180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dac8c32220 msgr2=0x55dac8cb5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:16.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.357+0000 7feffde00640 1 --2- 172.21.15.42:0/3053351180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dac8c32220 0x55dac8cb5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.357+0000 7feffde00640 1 -- 172.21.15.42:0/3053351180 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dac8c15d50 con 0x55dac8c2fd60 2024-09-17T01:37:16.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.357+0000 7feffd400640 1 --2- 172.21.15.42:0/3053351180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dac8c32220 0x55dac8cb5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:16.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.357+0000 7feffde00640 1 --2- 172.21.15.42:0/3053351180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dac8c2fd60 0x55dac8cbcfb0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7feff0001e10 tx=0x7feff000b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505a2b75de4f4b21 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:16.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.357+0000 7feff7e00640 1 -- 172.21.15.42:0/3053351180 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff0016070 con 0x55dac8c2fd60 2024-09-17T01:37:16.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.357+0000 7feff7e00640 1 -- 172.21.15.42:0/3053351180 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feff000d7c0 con 0x55dac8c2fd60 2024-09-17T01:37:16.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.357+0000 7feff7e00640 1 -- 172.21.15.42:0/3053351180 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff000dc10 con 0x55dac8c2fd60 2024-09-17T01:37:16.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.358+0000 7ff004c5df40 1 -- 172.21.15.42:0/3053351180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dac8c2fd60 msgr2=0x55dac8cbcfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:16.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.358+0000 7ff004c5df40 1 --2- 172.21.15.42:0/3053351180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dac8c2fd60 0x55dac8cbcfb0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7feff0001e10 tx=0x7feff000b650 comp rx=0 tx=0).stop 2024-09-17T01:37:16.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.358+0000 7ff004c5df40 1 -- 172.21.15.42:0/3053351180 shutdown_connections 2024-09-17T01:37:16.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.358+0000 7ff004c5df40 1 --2- 172.21.15.42:0/3053351180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dac8c32220 0x55dac8cb5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.358+0000 7ff004c5df40 1 --2- 172.21.15.42:0/3053351180 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55dac8be9320 0x55dac8cb6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.358+0000 7ff004c5df40 1 --2- 172.21.15.42:0/3053351180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dac8c2fd60 0x55dac8cbcfb0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.358+0000 7ff004c5df40 1 -- 172.21.15.42:0/3053351180 >> 172.21.15.42:0/3053351180 conn(0x55dac8b06ac0 msgr2=0x55dac8c2df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:16.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.358+0000 7ff004c5df40 1 -- 172.21.15.42:0/3053351180 shutdown_connections 2024-09-17T01:37:16.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.358+0000 7ff004c5df40 1 -- 172.21.15.42:0/3053351180 wait complete. 2024-09-17T01:37:16.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.359+0000 7ff004c5df40 1 Processor -- start 2024-09-17T01:37:16.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.359+0000 7ff004c5df40 1 -- start start 2024-09-17T01:37:16.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.361+0000 7ff004c5df40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dac8be9320 0x55dac8cb3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:16.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.361+0000 7ff004c5df40 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dac8c2fd60 0x55dac8be5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:16.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.361+0000 7ff004c5df40 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55dac8c32220 0x55dac8d550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:16.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.361+0000 7ff004c5df40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55dac8c16b10 con 0x55dac8be9320 2024-09-17T01:37:16.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.361+0000 7ff004c5df40 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55dac8cbc9a0 con 0x55dac8c2fd60 2024-09-17T01:37:16.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.361+0000 7ff004c5df40 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55dac8cb47b0 con 0x55dac8c32220 2024-09-17T01:37:16.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.361+0000 7feffde00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dac8be9320 0x55dac8cb3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:16.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.361+0000 7feffde00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dac8be9320 0x55dac8cb3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53804/0 (socket says 172.21.15.42:53804) 2024-09-17T01:37:16.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.361+0000 7feffde00640 1 -- 172.21.15.42:0/3923079728 learned_addr learned my addr 172.21.15.42:0/3923079728 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:16.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.361+0000 7feffe800640 1 --2- 172.21.15.42:0/3923079728 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55dac8c32220 0x55dac8d550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:16.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.361+0000 7feffd400640 1 --2- 172.21.15.42:0/3923079728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dac8c2fd60 0x55dac8be5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:16.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.361+0000 7feffde00640 1 -- 172.21.15.42:0/3923079728 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55dac8c32220 msgr2=0x55dac8d550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:16.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.361+0000 7feffde00640 1 --2- 172.21.15.42:0/3923079728 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55dac8c32220 0x55dac8d550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.362+0000 7feffde00640 1 -- 172.21.15.42:0/3923079728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dac8c2fd60 msgr2=0x55dac8be5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:16.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.362+0000 7feffde00640 1 --2- 172.21.15.42:0/3923079728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dac8c2fd60 0x55dac8be5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.362+0000 7feffde00640 1 -- 172.21.15.42:0/3923079728 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dac8cba670 con 0x55dac8be9320 2024-09-17T01:37:16.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.362+0000 7feffde00640 1 --2- 172.21.15.42:0/3923079728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dac8be9320 0x55dac8cb3a20 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7feff0000c00 tx=0x7feff000d4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:16.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.362+0000 7feff6a00640 1 -- 172.21.15.42:0/3923079728 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff0022070 con 0x55dac8be9320 2024-09-17T01:37:16.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.362+0000 7feff6a00640 1 -- 172.21.15.42:0/3923079728 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feff0017040 con 0x55dac8be9320 2024-09-17T01:37:16.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.362+0000 7feff6a00640 1 -- 172.21.15.42:0/3923079728 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff0016070 con 0x55dac8be9320 2024-09-17T01:37:16.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.362+0000 7ff004c5df40 1 -- 172.21.15.42:0/3923079728 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dac8cba390 con 0x55dac8be9320 2024-09-17T01:37:16.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.362+0000 7ff004c5df40 1 -- 172.21.15.42:0/3923079728 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dac8d54b80 con 0x55dac8be9320 2024-09-17T01:37:16.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.365+0000 7feff6a00640 1 -- 172.21.15.42:0/3923079728 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feff0025070 con 0x55dac8be9320 2024-09-17T01:37:16.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.365+0000 7feff6a00640 1 --2- 172.21.15.42:0/3923079728 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fefe00775a0 0x7fefe0079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:16.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.366+0000 7feff6a00640 1 -- 172.21.15.42:0/3923079728 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7feff009a630 con 0x55dac8be9320 2024-09-17T01:37:16.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.366+0000 7ff004c5df40 1 --2- 172.21.15.42:0/3923079728 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x55dac8cb65a0 0x55dac8be6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:16.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.366+0000 7ff004c5df40 1 -- 172.21.15.42:0/3923079728 --> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] -- osd_op(unknown.0.0:1 10.10 10:0cf6ad0f:::10000000000.00000000:head [omap-rm-keys in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) -- 0x55dac8cb49d0 con 0x55dac8cb65a0 2024-09-17T01:37:16.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.366+0000 7feffd400640 1 --2- 172.21.15.42:0/3923079728 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fefe00775a0 0x7fefe0079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:16.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.366+0000 7feffe800640 1 --2- 172.21.15.42:0/3923079728 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x55dac8cb65a0 0x55dac8be6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:16.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.367+0000 7feffe800640 1 --2- 172.21.15.42:0/3923079728 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x55dac8cb65a0 0x55dac8be6d80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:16.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.367+0000 7feffd400640 1 --2- 172.21.15.42:0/3923079728 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fefe00775a0 0x7fefe0079ab0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fefec055000 tx=0x7fefec058040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:16.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.368+0000 7feffe800640 1 -- 172.21.15.42:0/3923079728 <== osd.1 v2:172.21.15.42:6824/4073532812 1 ==== osd_op_reply(1 10000000000.00000000 [omap-rm-keys] v78'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7feff800d730 con 0x55dac8cb65a0 2024-09-17T01:37:16.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.368+0000 7ff004c5df40 1 -- 172.21.15.42:0/3923079728 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x55dac8cb65a0 msgr2=0x55dac8be6d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:16.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.368+0000 7ff004c5df40 1 --2- 172.21.15.42:0/3923079728 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x55dac8cb65a0 0x55dac8be6d80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.369+0000 7ff004c5df40 1 -- 172.21.15.42:0/3923079728 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fefe00775a0 msgr2=0x7fefe0079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:16.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.369+0000 7ff004c5df40 1 --2- 172.21.15.42:0/3923079728 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fefe00775a0 0x7fefe0079ab0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fefec055000 tx=0x7fefec058040 comp rx=0 tx=0).stop 2024-09-17T01:37:16.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.369+0000 7ff004c5df40 1 -- 172.21.15.42:0/3923079728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dac8be9320 msgr2=0x55dac8cb3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:16.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.369+0000 7ff004c5df40 1 --2- 172.21.15.42:0/3923079728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55dac8be9320 0x55dac8cb3a20 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7feff0000c00 tx=0x7feff000d4b0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.369+0000 7feffe800640 1 -- 172.21.15.42:0/3923079728 reap_dead start 2024-09-17T01:37:16.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.369+0000 7ff004c5df40 1 -- 172.21.15.42:0/3923079728 shutdown_connections 2024-09-17T01:37:16.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.369+0000 7ff004c5df40 1 -- 172.21.15.42:0/3923079728 >> 172.21.15.42:0/3923079728 conn(0x55dac8b06ac0 msgr2=0x55dac8c15340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:16.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.369+0000 7ff004c5df40 1 -- 172.21.15.42:0/3923079728 shutdown_connections 2024-09-17T01:37:16.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.369+0000 7ff004c5df40 1 -- 172.21.15.42:0/3923079728 wait complete. 2024-09-17T01:37:16.378 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2024-09-17T01:37:16.379 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-17T01:37:16.379 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2024-09-17T01:37:16.379 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-17T01:37:16.380 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2024-09-17T01:37:16.380 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-17T01:37:16.380 ERROR:tasks.ceph.mds.d:tried to stop a non-running daemon 2024-09-17T01:37:16.380 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-17T01:37:16.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.626+0000 7f889a000640 1 -- 172.21.15.42:0/336775105 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8894073340 msgr2=0x7f88940d2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:16.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.626+0000 7f889a000640 1 --2- 172.21.15.42:0/336775105 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8894073340 0x7f88940d2810 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f8888009830 tx=0x7f888802a4d0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.626+0000 7f889a000640 1 -- 172.21.15.42:0/336775105 shutdown_connections 2024-09-17T01:37:16.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.626+0000 7f889a000640 1 --2- 172.21.15.42:0/336775105 >> v2:172.21.15.43:3300/0 conn(0x7f88940b6030 0x7f88940b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.626+0000 7f889a000640 1 --2- 172.21.15.42:0/336775105 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8894073340 0x7f88940d2810 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.626+0000 7f889a000640 1 -- 172.21.15.42:0/336775105 >> 172.21.15.42:0/336775105 conn(0x7f88940d1210 msgr2=0x7f88940d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:16.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.626+0000 7f889a000640 1 -- 172.21.15.42:0/336775105 shutdown_connections 2024-09-17T01:37:16.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.626+0000 7f889a000640 1 -- 172.21.15.42:0/336775105 wait complete. 2024-09-17T01:37:16.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.641+0000 7fcb81a00640 1 -- 172.21.15.42:0/949024388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb7c0ccfb0 msgr2=0x7fcb7c0cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:16.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.641+0000 7fcb81a00640 1 --2- 172.21.15.42:0/949024388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb7c0ccfb0 0x7fcb7c0cfca0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c071370 tx=0x7fcb6802b620 comp rx=0 tx=0).stop 2024-09-17T01:37:16.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.641+0000 7f889a000640 1 Processor -- start 2024-09-17T01:37:16.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.642+0000 7fcb81a00640 1 -- 172.21.15.42:0/949024388 shutdown_connections 2024-09-17T01:37:16.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.642+0000 7fcb81a00640 1 --2- 172.21.15.42:0/949024388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb7c0ccfb0 0x7fcb7c0cfca0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.642+0000 7fcb81a00640 1 --2- 172.21.15.42:0/949024388 >> v2:172.21.15.43:3300/0 conn(0x7fcb7c16ba70 0x7fcb7c0ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.642+0000 7fcb81a00640 1 -- 172.21.15.42:0/949024388 >> 172.21.15.42:0/949024388 conn(0x7fcb7c0b25b0 msgr2=0x7fcb7c0b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:16.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.642+0000 7f889a000640 1 -- start start 2024-09-17T01:37:16.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.642+0000 7fc953e00640 1 -- 172.21.15.42:0/2966375844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc95406e780 msgr2=0x7fc9540ce9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:16.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.642+0000 7fc953e00640 1 --2- 172.21.15.42:0/2966375844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc95406e780 0x7fc9540ce9a0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fc9540756a0 tx=0x7fc94c02cbf0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.642+0000 7fcb81a00640 1 -- 172.21.15.42:0/949024388 shutdown_connections 2024-09-17T01:37:16.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.642+0000 7fc953e00640 1 -- 172.21.15.42:0/2966375844 shutdown_connections 2024-09-17T01:37:16.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.642+0000 7fc953e00640 1 --2- 172.21.15.42:0/2966375844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc95406e780 0x7fc9540ce9a0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.642+0000 7fc953e00640 1 --2- 172.21.15.42:0/2966375844 >> v2:172.21.15.43:3300/0 conn(0x7fc9540d0c30 0x7fc95406e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.642+0000 7fc953e00640 1 -- 172.21.15.42:0/2966375844 >> 172.21.15.42:0/2966375844 conn(0x7fc9540d0110 msgr2=0x7fc9540d0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:16.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.642+0000 7fc953e00640 1 -- 172.21.15.42:0/2966375844 shutdown_connections 2024-09-17T01:37:16.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.642+0000 7fc953e00640 1 -- 172.21.15.42:0/2966375844 wait complete. 2024-09-17T01:37:16.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.643+0000 7f7a40a00640 1 -- 172.21.15.42:0/3895549696 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7a20005360 msgr2=0x7f7a200079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:16.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.643+0000 7f7a40a00640 1 --2- 172.21.15.42:0/3895549696 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7a20005360 0x7f7a200079c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7a3400c6c0 tx=0x7f7a20005830 comp rx=0 tx=0).stop 2024-09-17T01:37:16.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.643+0000 7f7a3b200640 1 -- 172.21.15.42:0/3895549696 reap_dead start 2024-09-17T01:37:16.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.642+0000 7fcb81a00640 1 -- 172.21.15.42:0/949024388 wait complete. 2024-09-17T01:37:16.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.643+0000 7f7a40a00640 1 -- 172.21.15.42:0/3895549696 shutdown_connections 2024-09-17T01:37:16.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.643+0000 7f7a40a00640 1 -- 172.21.15.42:0/3895549696 >> 172.21.15.42:0/3895549696 conn(0x7f7a3c0d0110 msgr2=0x7f7a3c0d0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:16.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.643+0000 7f7a40a00640 1 -- 172.21.15.42:0/3895549696 shutdown_connections 2024-09-17T01:37:16.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.643+0000 7f7a40a00640 1 -- 172.21.15.42:0/3895549696 wait complete. 2024-09-17T01:37:16.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.644+0000 7f889a000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8894073340 0x7f88941f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:16.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.644+0000 7f889a000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88940b6030 0x7f88941f6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:16.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.644+0000 7f889a000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8894162fa0 0x7f88940b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:16.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.644+0000 7f889a000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f889415f850 con 0x7f8894162fa0 2024-09-17T01:37:16.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.644+0000 7f889a000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f889415f6d0 con 0x7f88940b6030 2024-09-17T01:37:16.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.644+0000 7f889a000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f889415f9d0 con 0x7f8894073340 2024-09-17T01:37:16.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.645+0000 7f8899600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8894162fa0 0x7f88940b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:16.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.645+0000 7f8899600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8894162fa0 0x7f88940b5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53866/0 (socket says 172.21.15.42:53866) 2024-09-17T01:37:16.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.645+0000 7f8899600640 1 -- 172.21.15.42:0/2694037016 learned_addr learned my addr 172.21.15.42:0/2694037016 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:16.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.645+0000 7f8898c00640 1 --2- 172.21.15.42:0/2694037016 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8894073340 0x7f88941f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:16.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.645+0000 7fcb81a00640 1 Processor -- start 2024-09-17T01:37:16.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.645+0000 7f8893e00640 1 --2- 172.21.15.42:0/2694037016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88940b6030 0x7f88941f6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:16.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.645+0000 7fcb81a00640 1 -- start start 2024-09-17T01:37:16.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.645+0000 7f8898c00640 1 -- 172.21.15.42:0/2694037016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88940b6030 msgr2=0x7f88941f6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:16.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.645+0000 7f8898c00640 1 --2- 172.21.15.42:0/2694037016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88940b6030 0x7f88941f6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.646+0000 7f8898c00640 1 -- 172.21.15.42:0/2694037016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8894162fa0 msgr2=0x7f88940b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:16.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.646+0000 7f8898c00640 1 --2- 172.21.15.42:0/2694037016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8894162fa0 0x7f88940b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.646+0000 7f8898c00640 1 -- 172.21.15.42:0/2694037016 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88941f6ec0 con 0x7f8894073340 2024-09-17T01:37:16.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.646+0000 7fc953e00640 1 Processor -- start 2024-09-17T01:37:16.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.646+0000 7f8898c00640 1 --2- 172.21.15.42:0/2694037016 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8894073340 0x7f88941f58a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8888031000 tx=0x7f8888033ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:16.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.646+0000 7fc953e00640 1 -- start start 2024-09-17T01:37:16.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.647+0000 7f7a40a00640 1 Processor -- start 2024-09-17T01:37:16.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.647+0000 7f8890c00640 1 -- 172.21.15.42:0/2694037016 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888031b50 con 0x7f8894073340 2024-09-17T01:37:16.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.647+0000 7f8890c00640 1 -- 172.21.15.42:0/2694037016 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8888031e00 con 0x7f8894073340 2024-09-17T01:37:16.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.647+0000 7f8890c00640 1 -- 172.21.15.42:0/2694037016 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88880332d0 con 0x7f8894073340 2024-09-17T01:37:16.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.647+0000 7f889a000640 1 -- 172.21.15.42:0/2694037016 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88940c8680 con 0x7f8894073340 2024-09-17T01:37:16.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.647+0000 7f7a40a00640 1 -- start start 2024-09-17T01:37:16.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.647+0000 7fcb81a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcb7c06f8f0 0x7fcb7c1faf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:16.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.647+0000 7fcb81a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb7c0ccfb0 0x7fcb7c169830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:16.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.647+0000 7fcb81a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb7c16ba70 0x7fcb7c166040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:16.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.647+0000 7fcb81a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c0b3af0 con 0x7fcb7c0ccfb0 2024-09-17T01:37:16.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.647+0000 7fcb81a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c0b3970 con 0x7fcb7c16ba70 2024-09-17T01:37:16.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.647+0000 7fcb81a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fcb7c0b3c70 con 0x7fcb7c06f8f0 2024-09-17T01:37:16.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.647+0000 7f889a000640 1 -- 172.21.15.42:0/2694037016 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f88940c8c40 con 0x7f8894073340 2024-09-17T01:37:16.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.647+0000 7fcb7aa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcb7c06f8f0 0x7fcb7c1faf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:16.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.648+0000 7fcb7aa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcb7c06f8f0 0x7fcb7c1faf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:56264/0 (socket says 172.21.15.42:56264) 2024-09-17T01:37:16.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.648+0000 7fcb7aa00640 1 -- 172.21.15.42:0/3672366494 learned_addr learned my addr 172.21.15.42:0/3672366494 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:16.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.648+0000 7fcb7a000640 1 --2- 172.21.15.42:0/3672366494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb7c0ccfb0 0x7fcb7c169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:16.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.648+0000 7fcb7b400640 1 --2- 172.21.15.42:0/3672366494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb7c16ba70 0x7fcb7c166040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:16.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.648+0000 7fcb7a000640 1 -- 172.21.15.42:0/3672366494 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcb7c06f8f0 msgr2=0x7fcb7c1faf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:16.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.648+0000 7fcb7a000640 1 --2- 172.21.15.42:0/3672366494 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcb7c06f8f0 0x7fcb7c1faf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.648+0000 7fcb7a000640 1 -- 172.21.15.42:0/3672366494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb7c16ba70 msgr2=0x7fcb7c166040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:16.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.648+0000 7fcb7a000640 1 --2- 172.21.15.42:0/3672366494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb7c16ba70 0x7fcb7c166040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.648+0000 7fcb7a000640 1 -- 172.21.15.42:0/3672366494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7c207790 con 0x7fcb7c0ccfb0 2024-09-17T01:37:16.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.648+0000 7fc953e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc95406e780 0x7fc95409a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:16.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.649+0000 7fc953e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9540997f0 0x7fc95408f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:16.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.649+0000 7fc953e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9540d0c30 0x7fc9540b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:16.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.649+0000 7fc953e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc9540cf270 con 0x7fc95406e780 2024-09-17T01:37:16.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.649+0000 7fc953e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc9540cf0f0 con 0x7fc9540d0c30 2024-09-17T01:37:16.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.649+0000 7fc953e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc9540cf3f0 con 0x7fc9540997f0 2024-09-17T01:37:16.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.649+0000 7f889a000640 1 -- 172.21.15.42:0/2694037016 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f889415fef0 con 0x7f8894073340 2024-09-17T01:37:16.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.649+0000 7fcb7a000640 1 --2- 172.21.15.42:0/3672366494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb7c0ccfb0 0x7fcb7c169830 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c0cdc90 tx=0x7fcb680038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:16.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.649+0000 7fc952a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc95406e780 0x7fc95409a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:16.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.649+0000 7fc952000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9540997f0 0x7fc95408f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:16.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.649+0000 7fc953400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9540d0c30 0x7fc9540b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:16.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.649+0000 7fc952000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9540997f0 0x7fc95408f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:56270/0 (socket says 172.21.15.42:56270) 2024-09-17T01:37:16.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.649+0000 7fc952000640 1 -- 172.21.15.42:0/194063075 learned_addr learned my addr 172.21.15.42:0/194063075 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:16.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.649+0000 7fc953400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9540d0c30 0x7fc9540b50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:52752/0 (socket says 172.21.15.42:52752) 2024-09-17T01:37:16.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.649+0000 7f7a40a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7a20005360 0x7f7a3c16c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:16.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.649+0000 7f7a40a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a3c092f10 0x7f7a3c096150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:16.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.649+0000 7f7a40a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a3c096690 0x7f7a3c16b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:16.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.649+0000 7f7a40a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c0d0fc0 con 0x7f7a3c096690 2024-09-17T01:37:16.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.649+0000 7f7a40a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c0d0e40 con 0x7f7a3c092f10 2024-09-17T01:37:16.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.649+0000 7f7a40a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7a3c0cf0b0 con 0x7f7a20005360 2024-09-17T01:37:16.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.649+0000 7fcb72a00640 1 -- 172.21.15.42:0/3672366494 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6803f020 con 0x7fcb7c0ccfb0 2024-09-17T01:37:16.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.649+0000 7fcb72a00640 1 -- 172.21.15.42:0/3672366494 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb680047a0 con 0x7fcb7c0ccfb0 2024-09-17T01:37:16.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.649+0000 7fcb72a00640 1 -- 172.21.15.42:0/3672366494 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb68036030 con 0x7fcb7c0ccfb0 2024-09-17T01:37:16.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.650+0000 7fcb81a00640 1 -- 172.21.15.42:0/3672366494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7c206ef0 con 0x7fcb7c0ccfb0 2024-09-17T01:37:16.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.650+0000 7fcb81a00640 1 -- 172.21.15.42:0/3672366494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb7c2074b0 con 0x7fcb7c0ccfb0 2024-09-17T01:37:16.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.650+0000 7fc952000640 1 -- 172.21.15.42:0/194063075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9540d0c30 msgr2=0x7fc9540b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:16.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.650+0000 7fc952000640 1 --2- 172.21.15.42:0/194063075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9540d0c30 0x7fc9540b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.650+0000 7f7a3a800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7a20005360 0x7f7a3c16c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:16.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.650+0000 7f7a3a800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7a20005360 0x7f7a3c16c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:56280/0 (socket says 172.21.15.42:56280) 2024-09-17T01:37:16.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.650+0000 7f7a3a800640 1 -- 172.21.15.42:0/2470513418 learned_addr learned my addr 172.21.15.42:0/2470513418 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:16.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.650+0000 7fc952000640 1 -- 172.21.15.42:0/194063075 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc95406e780 msgr2=0x7fc95409a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:16.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.650+0000 7f7a3b200640 1 --2- 172.21.15.42:0/2470513418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a3c096690 0x7f7a3c16b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:16.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.650+0000 7f7a39e00640 1 --2- 172.21.15.42:0/2470513418 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a3c092f10 0x7f7a3c096150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:16.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.650+0000 7fc952000640 1 --2- 172.21.15.42:0/194063075 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc95406e780 0x7fc95409a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.650+0000 7fc952000640 1 -- 172.21.15.42:0/194063075 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95416e7a0 con 0x7fc9540997f0 2024-09-17T01:37:16.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.650+0000 7fc952a00640 1 --2- 172.21.15.42:0/194063075 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc95406e780 0x7fc95409a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:37:16.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.651+0000 7f7a3b200640 1 -- 172.21.15.42:0/2470513418 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7a20005360 msgr2=0x7f7a3c16c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:16.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.651+0000 7f7a3b200640 1 --2- 172.21.15.42:0/2470513418 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7a20005360 0x7f7a3c16c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.651+0000 7f7a3b200640 1 -- 172.21.15.42:0/2470513418 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a3c092f10 msgr2=0x7f7a3c096150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:16.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.651+0000 7f7a3b200640 1 --2- 172.21.15.42:0/2470513418 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a3c092f10 0x7f7a3c096150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:16.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.651+0000 7f7a3b200640 1 -- 172.21.15.42:0/2470513418 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3c090770 con 0x7f7a3c096690 2024-09-17T01:37:16.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.651+0000 7fc952000640 1 --2- 172.21.15.42:0/194063075 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9540997f0 0x7fc95408f940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc94000f900 tx=0x7fc94000fdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:16.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.651+0000 7f8890c00640 1 -- 172.21.15.42:0/2694037016 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8888033470 con 0x7f8894073340 2024-09-17T01:37:16.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.651+0000 7fc94b400640 1 -- 172.21.15.42:0/194063075 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc940009cc0 con 0x7fc9540997f0 2024-09-17T01:37:16.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.651+0000 7fc94b400640 1 -- 172.21.15.42:0/194063075 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc940004020 con 0x7fc9540997f0 2024-09-17T01:37:16.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.651+0000 7fc94b400640 1 -- 172.21.15.42:0/194063075 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc940004430 con 0x7fc9540997f0 2024-09-17T01:37:16.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.651+0000 7f7a3b200640 1 --2- 172.21.15.42:0/2470513418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a3c096690 0x7f7a3c16b140 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f7a34030000 tx=0x7f7a34004f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:16.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.652+0000 7fc953e00640 1 -- 172.21.15.42:0/194063075 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc95416ea80 con 0x7fc9540997f0 2024-09-17T01:37:16.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.652+0000 7fc953e00640 1 -- 172.21.15.42:0/194063075 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc95408fe80 con 0x7fc9540997f0 2024-09-17T01:37:16.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.652+0000 7f7a32a00640 1 -- 172.21.15.42:0/2470513418 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3400c2e0 con 0x7f7a3c096690 2024-09-17T01:37:16.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.652+0000 7f7a32a00640 1 -- 172.21.15.42:0/2470513418 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a3402bba0 con 0x7f7a3c096690 2024-09-17T01:37:16.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.652+0000 7f7a32a00640 1 -- 172.21.15.42:0/2470513418 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a340060e0 con 0x7f7a3c096690 2024-09-17T01:37:16.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.652+0000 7f7a40a00640 1 -- 172.21.15.42:0/2470513418 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a3c090a50 con 0x7f7a3c096690 2024-09-17T01:37:16.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.652+0000 7fcb81a00640 1 -- 172.21.15.42:0/3672366494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb7c206c60 con 0x7fcb7c0ccfb0 2024-09-17T01:37:16.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.653+0000 7f7a40a00640 1 -- 172.21.15.42:0/2470513418 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a3c087740 con 0x7f7a3c096690 2024-09-17T01:37:16.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.653+0000 7f8890c00640 1 --2- 172.21.15.42:0/2694037016 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8874078b90 0x7f887407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:16.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.653+0000 7f8890c00640 1 -- 172.21.15.42:0/2694037016 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7f88880bc000 con 0x7f8894073340 2024-09-17T01:37:16.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.653+0000 7f8893e00640 1 --2- 172.21.15.42:0/2694037016 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8874078b90 0x7f887407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:16.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.653+0000 7fc953e00640 1 -- 172.21.15.42:0/194063075 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9540cf910 con 0x7fc9540997f0 2024-09-17T01:37:16.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.654+0000 7fcb72a00640 1 -- 172.21.15.42:0/3672366494 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcb68042020 con 0x7fcb7c0ccfb0 2024-09-17T01:37:16.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.654+0000 7f7a40a00640 1 -- 172.21.15.42:0/2470513418 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a3c16d090 con 0x7f7a3c096690 2024-09-17T01:37:16.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.654+0000 7f8893e00640 1 --2- 172.21.15.42:0/2694037016 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8874078b90 0x7f887407b0a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8880007d60 tx=0x7f8880007cf0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:16.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.655+0000 7fcb72a00640 1 --2- 172.21.15.42:0/3672366494 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcb5c078b90 0x7fcb5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:16.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.655+0000 7fcb72a00640 1 -- 172.21.15.42:0/3672366494 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7fcb680bb8a0 con 0x7fcb7c0ccfb0 2024-09-17T01:37:16.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.655+0000 7f7a32a00640 1 -- 172.21.15.42:0/2470513418 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7a34006280 con 0x7f7a3c096690 2024-09-17T01:37:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.656+0000 7fcb7aa00640 1 --2- 172.21.15.42:0/3672366494 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcb5c078b90 0x7fcb5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.656+0000 7fcb7aa00640 1 --2- 172.21.15.42:0/3672366494 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcb5c078b90 0x7fcb5c07b0a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c00bbe0 tx=0x7fcb6c00b390 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.657+0000 7f7a32a00640 1 --2- 172.21.15.42:0/2470513418 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7a1c078be0 0x7f7a1c07b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.657+0000 7f7a3a800640 1 --2- 172.21.15.42:0/2470513418 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7a1c078be0 0x7f7a1c07b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.658+0000 7f7a3a800640 1 --2- 172.21.15.42:0/2470513418 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7a1c078be0 0x7f7a1c07b0f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c009df0 tx=0x7f7a2c005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:16.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.658+0000 7f8890c00640 1 -- 172.21.15.42:0/2694037016 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f888803f030 con 0x7f8894073340 2024-09-17T01:37:16.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.660+0000 7fcb72a00640 1 -- 172.21.15.42:0/3672366494 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcb68049030 con 0x7fcb7c0ccfb0 2024-09-17T01:37:16.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.660+0000 7f7a32a00640 1 -- 172.21.15.42:0/2470513418 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7f7a340b8f40 con 0x7f7a3c096690 2024-09-17T01:37:16.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.661+0000 7fc94b400640 1 -- 172.21.15.42:0/194063075 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc9400035f0 con 0x7fc9540997f0 2024-09-17T01:37:16.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.663+0000 7fc94b400640 1 --2- 172.21.15.42:0/194063075 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc934078b90 0x7fc93407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:16.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.663+0000 7fc94b400640 1 -- 172.21.15.42:0/194063075 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(78..78 src has 1..78) ==== 5709+0+0 (secure 0 0 0) 0x7fc94009b4c0 con 0x7fc9540997f0 2024-09-17T01:37:16.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.663+0000 7fc952a00640 1 --2- 172.21.15.42:0/194063075 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc934078b90 0x7fc93407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:16.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.664+0000 7fc94b400640 1 -- 172.21.15.42:0/194063075 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc940063320 con 0x7fc9540997f0 2024-09-17T01:37:16.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.664+0000 7fc952a00640 1 --2- 172.21.15.42:0/194063075 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc934078b90 0x7fc93407b0a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc944000f60 tx=0x7fc944009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:16.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.667+0000 7f7a32a00640 1 -- 172.21.15.42:0/2470513418 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7a3c074600 con 0x7f7a3c096690 2024-09-17T01:37:16.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.938+0000 7f889a000640 1 -- 172.21.15.42:0/2694037016 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f88940b5de0 con 0x7f8894073340 2024-09-17T01:37:16.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:16.942+0000 7fc953e00640 1 -- 172.21.15.42:0/194063075 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7fc9540b1180 con 0x7fc9540997f0 2024-09-17T01:37:17.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.006+0000 7fcb81a00640 1 -- 172.21.15.42:0/3672366494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7fcb7c0b4120 con 0x7fcb7c0ccfb0 2024-09-17T01:37:17.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.011+0000 7f7a40a00640 1 -- 172.21.15.42:0/2470513418 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7f7a3c0740c0 con 0x7f7a3c096690 2024-09-17T01:37:17.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.140+0000 7f8890c00640 1 -- 172.21.15.42:0/2694037016 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 5975 v57) ==== 95+0+0 (secure 0 0 0) 0x7f8888083d50 con 0x7f8894073340 2024-09-17T01:37:17.138 INFO:teuthology.orchestra.run.smithi042.stderr:failed mds gid 5975 2024-09-17T01:37:17.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.142+0000 7f889a000640 1 -- 172.21.15.42:0/2694037016 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8874078b90 msgr2=0x7f887407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:17.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.143+0000 7f889a000640 1 --2- 172.21.15.42:0/2694037016 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8874078b90 0x7f887407b0a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8880007d60 tx=0x7f8880007cf0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.143+0000 7f889a000640 1 -- 172.21.15.42:0/2694037016 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8894073340 msgr2=0x7f88941f58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:17.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.143+0000 7f889a000640 1 --2- 172.21.15.42:0/2694037016 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8894073340 0x7f88941f58a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8888031000 tx=0x7f8888033ba0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.143+0000 7f889a000640 1 -- 172.21.15.42:0/2694037016 shutdown_connections 2024-09-17T01:37:17.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.143+0000 7f889a000640 1 --2- 172.21.15.42:0/2694037016 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8874078b90 0x7f887407b0a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.143+0000 7f889a000640 1 --2- 172.21.15.42:0/2694037016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88940b6030 0x7f88941f6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.143+0000 7f889a000640 1 --2- 172.21.15.42:0/2694037016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8894162fa0 0x7f88940b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.143+0000 7f889a000640 1 --2- 172.21.15.42:0/2694037016 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8894073340 0x7f88941f58a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.143+0000 7f889a000640 1 -- 172.21.15.42:0/2694037016 >> 172.21.15.42:0/2694037016 conn(0x7f88940d1210 msgr2=0x7f88940d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:17.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.143+0000 7f889a000640 1 -- 172.21.15.42:0/2694037016 shutdown_connections 2024-09-17T01:37:17.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.143+0000 7f889a000640 1 -- 172.21.15.42:0/2694037016 wait complete. 2024-09-17T01:37:17.147 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-17T01:37:17.150+0000 7f995ec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:37:17.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.151+0000 7fcb72a00640 1 -- 172.21.15.42:0/3672366494 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6433 v58) ==== 95+0+0 (secure 0 0 0) 0x7fcb68083740 con 0x7fcb7c0ccfb0 2024-09-17T01:37:17.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.151+0000 7f7a32a00640 1 -- 172.21.15.42:0/2470513418 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6729 v58) ==== 95+0+0 (secure 0 0 0) 0x7f7a34082780 con 0x7f7a3c096690 2024-09-17T01:37:17.149 INFO:teuthology.orchestra.run.smithi042.stderr:failed mds gid 6433 2024-09-17T01:37:17.150 INFO:teuthology.orchestra.run.smithi042.stderr:failed mds gid 6729 2024-09-17T01:37:17.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.155+0000 7f7a40a00640 1 -- 172.21.15.42:0/2470513418 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7a1c078be0 msgr2=0x7f7a1c07b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:17.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.155+0000 7f7a40a00640 1 --2- 172.21.15.42:0/2470513418 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7a1c078be0 0x7f7a1c07b0f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c009df0 tx=0x7f7a2c005f90 comp rx=0 tx=0).stop 2024-09-17T01:37:17.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.155+0000 7f7a40a00640 1 -- 172.21.15.42:0/2470513418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a3c096690 msgr2=0x7f7a3c16b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:17.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.155+0000 7f7a40a00640 1 --2- 172.21.15.42:0/2470513418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a3c096690 0x7f7a3c16b140 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f7a34030000 tx=0x7f7a34004f20 comp rx=0 tx=0).stop 2024-09-17T01:37:17.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.155+0000 7fcb81a00640 1 -- 172.21.15.42:0/3672366494 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcb5c078b90 msgr2=0x7fcb5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:17.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.155+0000 7fcb81a00640 1 --2- 172.21.15.42:0/3672366494 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcb5c078b90 0x7fcb5c07b0a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c00bbe0 tx=0x7fcb6c00b390 comp rx=0 tx=0).stop 2024-09-17T01:37:17.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.155+0000 7fcb81a00640 1 -- 172.21.15.42:0/3672366494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb7c0ccfb0 msgr2=0x7fcb7c169830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:17.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.155+0000 7fcb81a00640 1 --2- 172.21.15.42:0/3672366494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb7c0ccfb0 0x7fcb7c169830 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c0cdc90 tx=0x7fcb680038a0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.156+0000 7f7a40a00640 1 -- 172.21.15.42:0/2470513418 shutdown_connections 2024-09-17T01:37:17.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.156+0000 7f7a40a00640 1 --2- 172.21.15.42:0/2470513418 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7a1c078be0 0x7f7a1c07b0f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.156+0000 7f7a40a00640 1 --2- 172.21.15.42:0/2470513418 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a3c092f10 0x7f7a3c096150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.156+0000 7f7a40a00640 1 --2- 172.21.15.42:0/2470513418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a3c096690 0x7f7a3c16b140 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.156+0000 7f7a40a00640 1 --2- 172.21.15.42:0/2470513418 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7a20005360 0x7f7a3c16c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.156+0000 7f7a40a00640 1 -- 172.21.15.42:0/2470513418 >> 172.21.15.42:0/2470513418 conn(0x7f7a3c0d0110 msgr2=0x7f7a3c0d0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:17.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.156+0000 7fcb81a00640 1 -- 172.21.15.42:0/3672366494 shutdown_connections 2024-09-17T01:37:17.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.156+0000 7fcb81a00640 1 --2- 172.21.15.42:0/3672366494 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcb5c078b90 0x7fcb5c07b0a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.156+0000 7fcb81a00640 1 --2- 172.21.15.42:0/3672366494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcb7c16ba70 0x7fcb7c166040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.156+0000 7fcb81a00640 1 --2- 172.21.15.42:0/3672366494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb7c0ccfb0 0x7fcb7c169830 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.156+0000 7fcb81a00640 1 --2- 172.21.15.42:0/3672366494 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcb7c06f8f0 0x7fcb7c1faf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.156+0000 7fcb81a00640 1 -- 172.21.15.42:0/3672366494 >> 172.21.15.42:0/3672366494 conn(0x7fcb7c0b25b0 msgr2=0x7fcb7c1f8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:17.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.156+0000 7f7a40a00640 1 -- 172.21.15.42:0/2470513418 shutdown_connections 2024-09-17T01:37:17.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.156+0000 7f7a40a00640 1 -- 172.21.15.42:0/2470513418 wait complete. 2024-09-17T01:37:17.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.156+0000 7fcb81a00640 1 -- 172.21.15.42:0/3672366494 shutdown_connections 2024-09-17T01:37:17.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.156+0000 7fcb81a00640 1 -- 172.21.15.42:0/3672366494 wait complete. 2024-09-17T01:37:17.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.156+0000 7fc94b400640 1 -- 172.21.15.42:0/194063075 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 5966 v58) ==== 95+0+0 (secure 0 0 0) 0x7fc940067d50 con 0x7fc9540997f0 2024-09-17T01:37:17.157 INFO:teuthology.orchestra.run.smithi042.stderr:failed mds gid 5966 2024-09-17T01:37:17.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.160+0000 7fc953e00640 1 -- 172.21.15.42:0/194063075 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc934078b90 msgr2=0x7fc93407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:17.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.160+0000 7fc953e00640 1 --2- 172.21.15.42:0/194063075 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc934078b90 0x7fc93407b0a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc944000f60 tx=0x7fc944009040 comp rx=0 tx=0).stop 2024-09-17T01:37:17.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.160+0000 7fc953e00640 1 -- 172.21.15.42:0/194063075 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9540997f0 msgr2=0x7fc95408f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:17.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.160+0000 7fc953e00640 1 --2- 172.21.15.42:0/194063075 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9540997f0 0x7fc95408f940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc94000f900 tx=0x7fc94000fdc0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.161+0000 7fc953e00640 1 -- 172.21.15.42:0/194063075 shutdown_connections 2024-09-17T01:37:17.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.161+0000 7fc953e00640 1 --2- 172.21.15.42:0/194063075 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc934078b90 0x7fc93407b0a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.161+0000 7fc953e00640 1 --2- 172.21.15.42:0/194063075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9540d0c30 0x7fc9540b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.161+0000 7fc953e00640 1 --2- 172.21.15.42:0/194063075 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9540997f0 0x7fc95408f940 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.161+0000 7fc953e00640 1 --2- 172.21.15.42:0/194063075 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc95406e780 0x7fc95409a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.161+0000 7fc953e00640 1 -- 172.21.15.42:0/194063075 >> 172.21.15.42:0/194063075 conn(0x7fc9540d0110 msgr2=0x7fc9540d0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:17.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.161+0000 7fc953e00640 1 -- 172.21.15.42:0/194063075 shutdown_connections 2024-09-17T01:37:17.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.161+0000 7fc953e00640 1 -- 172.21.15.42:0/194063075 wait complete. 2024-09-17T01:37:17.168 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T01:37:17.168 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T01:37:17.173 INFO:tasks.ceph.mds.c:Started 2024-09-17T01:37:17.173 DEBUG:teuthology.parallel:result is None 2024-09-17T01:37:17.180 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T01:37:17.180 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T01:37:17.184 INFO:tasks.ceph.mds.b:Started 2024-09-17T01:37:17.184 DEBUG:teuthology.parallel:result is None 2024-09-17T01:37:17.195 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T01:37:17.196 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T01:37:17.196 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T01:37:17.197 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T01:37:17.200 INFO:tasks.ceph.mds.d:Started 2024-09-17T01:37:17.200 DEBUG:teuthology.parallel:result is None 2024-09-17T01:37:17.239 INFO:tasks.ceph.mds.a:Started 2024-09-17T01:37:17.240 DEBUG:teuthology.parallel:result is None 2024-09-17T01:37:17.240 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:37:17.371 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:37:17.387 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-09-17T01:37:17.399 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-09-17T01:37:17.447 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:37:17.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.478+0000 7f2792400640 1 -- 172.21.15.42:0/2936600886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f278c06cd20 msgr2=0x7f278c06d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:17.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.478+0000 7f2792400640 1 --2- 172.21.15.42:0/2936600886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f278c06cd20 0x7f278c06d130 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f277c005fd0 tx=0x7f277c02b230 comp rx=0 tx=0).stop 2024-09-17T01:37:17.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.478+0000 7f2792400640 1 -- 172.21.15.42:0/2936600886 shutdown_connections 2024-09-17T01:37:17.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.478+0000 7f2792400640 1 --2- 172.21.15.42:0/2936600886 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f278c0b30a0 0x7f278c0b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.478+0000 7f2792400640 1 --2- 172.21.15.42:0/2936600886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f278c06cd20 0x7f278c06d130 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.478+0000 7f2792400640 1 -- 172.21.15.42:0/2936600886 >> 172.21.15.42:0/2936600886 conn(0x7f278c0b25f0 msgr2=0x7f278c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:17.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.478+0000 7f2792400640 1 -- 172.21.15.42:0/2936600886 shutdown_connections 2024-09-17T01:37:17.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.478+0000 7f2792400640 1 -- 172.21.15.42:0/2936600886 wait complete. 2024-09-17T01:37:17.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.480+0000 7f2792400640 1 Processor -- start 2024-09-17T01:37:17.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.480+0000 7f2792400640 1 -- start start 2024-09-17T01:37:17.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.482+0000 7f2792400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f278c06cd20 0x7f278c0ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:17.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.482+0000 7f2792400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f278c0b30a0 0x7f278c148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:17.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.482+0000 7f2792400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f278c0cf230 0x7f278c1f5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:17.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.482+0000 7f2792400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f278c070470 con 0x7f278c0b30a0 2024-09-17T01:37:17.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.482+0000 7f2792400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f278c0702f0 con 0x7f278c06cd20 2024-09-17T01:37:17.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.482+0000 7f2792400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f278c0b39f0 con 0x7f278c0cf230 2024-09-17T01:37:17.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.482+0000 7f2783e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f278c0b30a0 0x7f278c148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:17.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.482+0000 7f2791000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f278c06cd20 0x7f278c0ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:17.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.482+0000 7f2791000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f278c06cd20 0x7f278c0ae690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:52812/0 (socket says 172.21.15.42:52812) 2024-09-17T01:37:17.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.482+0000 7f2791000640 1 -- 172.21.15.42:0/2818768786 learned_addr learned my addr 172.21.15.42:0/2818768786 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:17.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.482+0000 7f2791a00640 1 --2- 172.21.15.42:0/2818768786 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f278c0cf230 0x7f278c1f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:17.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.482+0000 7f2791000640 1 -- 172.21.15.42:0/2818768786 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f278c0cf230 msgr2=0x7f278c1f5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:17.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.482+0000 7f2791000640 1 --2- 172.21.15.42:0/2818768786 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f278c0cf230 0x7f278c1f5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.482+0000 7f2791000640 1 -- 172.21.15.42:0/2818768786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f278c0b30a0 msgr2=0x7f278c148370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:17.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.482+0000 7f2791000640 1 --2- 172.21.15.42:0/2818768786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f278c0b30a0 0x7f278c148370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.482+0000 7f2791000640 1 -- 172.21.15.42:0/2818768786 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278c0ad5f0 con 0x7f278c06cd20 2024-09-17T01:37:17.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.483+0000 7f2791000640 1 --2- 172.21.15.42:0/2818768786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f278c06cd20 0x7f278c0ae690 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f277c0075d0 tx=0x7f277c0038a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:17.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.483+0000 7f2789600640 1 -- 172.21.15.42:0/2818768786 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c00a0d0 con 0x7f278c06cd20 2024-09-17T01:37:17.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.483+0000 7f2789600640 1 -- 172.21.15.42:0/2818768786 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f277c00a360 con 0x7f278c06cd20 2024-09-17T01:37:17.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.483+0000 7f2792400640 1 -- 172.21.15.42:0/2818768786 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f278c0ad8d0 con 0x7f278c06cd20 2024-09-17T01:37:17.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.483+0000 7f2789600640 1 -- 172.21.15.42:0/2818768786 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c00a7d0 con 0x7f278c06cd20 2024-09-17T01:37:17.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.483+0000 7f2792400640 1 -- 172.21.15.42:0/2818768786 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f278c0ade90 con 0x7f278c06cd20 2024-09-17T01:37:17.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.484+0000 7f2792400640 1 -- 172.21.15.42:0/2818768786 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f278c0b3f40 con 0x7f278c06cd20 2024-09-17T01:37:17.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.486+0000 7f2789600640 1 -- 172.21.15.42:0/2818768786 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f277c03b400 con 0x7f278c06cd20 2024-09-17T01:37:17.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.487+0000 7f2789600640 1 --2- 172.21.15.42:0/2818768786 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2768078b90 0x7f276807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:17.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.487+0000 7f2789600640 1 -- 172.21.15.42:0/2818768786 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5795+0+0 (secure 0 0 0) 0x7f277c0ba8f0 con 0x7f278c06cd20 2024-09-17T01:37:17.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.487+0000 7f2783e00640 1 --2- 172.21.15.42:0/2818768786 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2768078b90 0x7f276807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:17.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.488+0000 7f2783e00640 1 --2- 172.21.15.42:0/2818768786 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2768078b90 0x7f276807b0a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f278c072270 tx=0x7f2774009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:17.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.492+0000 7f2789600640 1 -- 172.21.15.42:0/2818768786 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f277c0827b0 con 0x7f278c06cd20 2024-09-17T01:37:17.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.720+0000 7f2792400640 1 -- 172.21.15.42:0/2818768786 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f278c0ad080 con 0x7f278c06cd20 2024-09-17T01:37:17.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.721+0000 7f2789600640 1 -- 172.21.15.42:0/2818768786 <== mon.1 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+1911 (secure 0 0 0) 0x7f277c0871e0 con 0x7f278c06cd20 2024-09-17T01:37:17.719 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:17.719 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":58,"btime":"2024-09-17T01:37:17:150846+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:37:00.371835+0000","modified":"2024-09-17T01:37:17.150844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-09-17T01:37:17.719 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 58 2024-09-17T01:37:17.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.723+0000 7f2792400640 1 -- 172.21.15.42:0/2818768786 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2768078b90 msgr2=0x7f276807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:17.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.723+0000 7f2792400640 1 --2- 172.21.15.42:0/2818768786 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2768078b90 0x7f276807b0a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f278c072270 tx=0x7f2774009040 comp rx=0 tx=0).stop 2024-09-17T01:37:17.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.723+0000 7f2792400640 1 -- 172.21.15.42:0/2818768786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f278c06cd20 msgr2=0x7f278c0ae690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:17.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.723+0000 7f2792400640 1 --2- 172.21.15.42:0/2818768786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f278c06cd20 0x7f278c0ae690 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f277c0075d0 tx=0x7f277c0038a0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.723+0000 7f2792400640 1 -- 172.21.15.42:0/2818768786 shutdown_connections 2024-09-17T01:37:17.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.723+0000 7f2792400640 1 --2- 172.21.15.42:0/2818768786 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2768078b90 0x7f276807b0a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.723+0000 7f2792400640 1 --2- 172.21.15.42:0/2818768786 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f278c0cf230 0x7f278c1f5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.723+0000 7f2792400640 1 --2- 172.21.15.42:0/2818768786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f278c0b30a0 0x7f278c148370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.723+0000 7f2792400640 1 --2- 172.21.15.42:0/2818768786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f278c06cd20 0x7f278c0ae690 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:17.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.723+0000 7f2792400640 1 -- 172.21.15.42:0/2818768786 >> 172.21.15.42:0/2818768786 conn(0x7f278c0b25f0 msgr2=0x7f278c0b4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:17.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.724+0000 7f2792400640 1 -- 172.21.15.42:0/2818768786 shutdown_connections 2024-09-17T01:37:17.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:17.724+0000 7f2792400640 1 -- 172.21.15.42:0/2818768786 wait complete. 2024-09-17T01:37:18.149 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:37:00.371835+0000', 'modified': '2024-09-17T01:37:17.150844+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 82, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {}, 'failed': [0], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T01:37:18.149 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2024-09-17T01:37:19.150 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:37:19.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.390+0000 7fab37a00640 1 -- 172.21.15.42:0/136552278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab3015cb80 msgr2=0x7fab30152710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:19.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.390+0000 7fab37a00640 1 --2- 172.21.15.42:0/136552278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab3015cb80 0x7fab30152710 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fab24009830 tx=0x7fab2402a500 comp rx=0 tx=0).stop 2024-09-17T01:37:19.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.390+0000 7fab37a00640 1 -- 172.21.15.42:0/136552278 shutdown_connections 2024-09-17T01:37:19.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.390+0000 7fab37a00640 1 --2- 172.21.15.42:0/136552278 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab3006d430 0x7fab3006d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:19.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.390+0000 7fab37a00640 1 --2- 172.21.15.42:0/136552278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab3015cb80 0x7fab30152710 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:19.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.390+0000 7fab37a00640 1 -- 172.21.15.42:0/136552278 >> 172.21.15.42:0/136552278 conn(0x7fab300b2930 msgr2=0x7fab3006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:19.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.390+0000 7fab37a00640 1 -- 172.21.15.42:0/136552278 shutdown_connections 2024-09-17T01:37:19.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.390+0000 7fab37a00640 1 -- 172.21.15.42:0/136552278 wait complete. 2024-09-17T01:37:19.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.392+0000 7fab37a00640 1 Processor -- start 2024-09-17T01:37:19.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.393+0000 7fab37a00640 1 -- start start 2024-09-17T01:37:19.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.394+0000 7fab37a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab3006d430 0x7fab3014ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:19.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.394+0000 7fab37a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab3015cb80 0x7fab30150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:19.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.394+0000 7fab37a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab3015f480 0x7fab30150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:19.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.394+0000 7fab37a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fab30073820 con 0x7fab3006d430 2024-09-17T01:37:19.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.394+0000 7fab37a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fab300736a0 con 0x7fab3015cb80 2024-09-17T01:37:19.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.394+0000 7fab37a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fab300739a0 con 0x7fab3015f480 2024-09-17T01:37:19.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.394+0000 7fab35000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab3006d430 0x7fab3014ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:19.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.394+0000 7fab35000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab3006d430 0x7fab3014ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53904/0 (socket says 172.21.15.42:53904) 2024-09-17T01:37:19.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.394+0000 7fab35000640 1 -- 172.21.15.42:0/556306559 learned_addr learned my addr 172.21.15.42:0/556306559 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:19.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.395+0000 7fab35a00640 1 --2- 172.21.15.42:0/556306559 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab3015f480 0x7fab30150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:19.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.395+0000 7fab2fe00640 1 --2- 172.21.15.42:0/556306559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab3015cb80 0x7fab30150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:19.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.395+0000 7fab35000640 1 -- 172.21.15.42:0/556306559 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab3015f480 msgr2=0x7fab30150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:19.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.395+0000 7fab35000640 1 --2- 172.21.15.42:0/556306559 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab3015f480 0x7fab30150690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:19.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.395+0000 7fab35000640 1 -- 172.21.15.42:0/556306559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab3015cb80 msgr2=0x7fab30150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:19.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.395+0000 7fab35000640 1 --2- 172.21.15.42:0/556306559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab3015cb80 0x7fab30150150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:19.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.395+0000 7fab35000640 1 -- 172.21.15.42:0/556306559 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab301f6f30 con 0x7fab3006d430 2024-09-17T01:37:19.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.395+0000 7fab2fe00640 1 --2- 172.21.15.42:0/556306559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab3015cb80 0x7fab30150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:37:19.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.395+0000 7fab35000640 1 --2- 172.21.15.42:0/556306559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab3006d430 0x7fab3014ca90 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fab24000c00 tx=0x7fab24033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:19.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.395+0000 7fab2cc00640 1 -- 172.21.15.42:0/556306559 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab24005c90 con 0x7fab3006d430 2024-09-17T01:37:19.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.396+0000 7fab2cc00640 1 -- 172.21.15.42:0/556306559 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab24031e50 con 0x7fab3006d430 2024-09-17T01:37:19.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.396+0000 7fab37a00640 1 -- 172.21.15.42:0/556306559 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab301f7210 con 0x7fab3006d430 2024-09-17T01:37:19.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.396+0000 7fab2cc00640 1 -- 172.21.15.42:0/556306559 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab240332f0 con 0x7fab3006d430 2024-09-17T01:37:19.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.396+0000 7fab37a00640 1 -- 172.21.15.42:0/556306559 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab301f77d0 con 0x7fab3006d430 2024-09-17T01:37:19.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.397+0000 7fab37a00640 1 -- 172.21.15.42:0/556306559 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab30073ec0 con 0x7fab3006d430 2024-09-17T01:37:19.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.398+0000 7fab2cc00640 1 -- 172.21.15.42:0/556306559 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fab24033490 con 0x7fab3006d430 2024-09-17T01:37:19.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.400+0000 7fab2cc00640 1 --2- 172.21.15.42:0/556306559 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fab10078b90 0x7fab1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:19.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.400+0000 7fab2cc00640 1 -- 172.21.15.42:0/556306559 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5795+0+0 (secure 0 0 0) 0x7fab240bc0b0 con 0x7fab3006d430 2024-09-17T01:37:19.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.400+0000 7fab2fe00640 1 --2- 172.21.15.42:0/556306559 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fab10078b90 0x7fab1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:19.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.401+0000 7fab2fe00640 1 --2- 172.21.15.42:0/556306559 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fab10078b90 0x7fab1007b0a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fab3014fc60 tx=0x7fab1c005dd0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:19.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.405+0000 7fab2cc00640 1 -- 172.21.15.42:0/556306559 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fab2404a030 con 0x7fab3006d430 2024-09-17T01:37:19.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.639+0000 7fab37a00640 1 -- 172.21.15.42:0/556306559 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab3006a170 con 0x7fab3006d430 2024-09-17T01:37:19.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.640+0000 7fab2cc00640 1 -- 172.21.15.42:0/556306559 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5219 (secure 0 0 0) 0x7fab2403f030 con 0x7fab3006d430 2024-09-17T01:37:19.638 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:19.638 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":61,"btime":"2024-09-17T01:37:19:159017+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6119,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/1918787537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1918787537},{"type":"v1","addr":"172.21.15.43:6835","nonce":1918787537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6646,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2741360699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2741360699},{"type":"v1","addr":"172.21.15.43:6837","nonce":2741360699}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6957,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/2289144423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2289144423},{"type":"v1","addr":"172.21.15.42:6833","nonce":2289144423}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:37:00.371835+0000","modified":"2024-09-17T01:37:18.170574+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6978},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6978":{"gid":6978,"name":"a","rank":0,"incarnation":60,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.42:6835/457794069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":457794069},{"type":"v1","addr":"172.21.15.42:6835","nonce":457794069}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-09-17T01:37:19.638 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 61 2024-09-17T01:37:19.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.642+0000 7fab37a00640 1 -- 172.21.15.42:0/556306559 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fab10078b90 msgr2=0x7fab1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:19.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.642+0000 7fab37a00640 1 --2- 172.21.15.42:0/556306559 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fab10078b90 0x7fab1007b0a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fab3014fc60 tx=0x7fab1c005dd0 comp rx=0 tx=0).stop 2024-09-17T01:37:19.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.642+0000 7fab37a00640 1 -- 172.21.15.42:0/556306559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab3006d430 msgr2=0x7fab3014ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:19.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.642+0000 7fab37a00640 1 --2- 172.21.15.42:0/556306559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab3006d430 0x7fab3014ca90 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fab24000c00 tx=0x7fab24033c90 comp rx=0 tx=0).stop 2024-09-17T01:37:19.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.643+0000 7fab37a00640 1 -- 172.21.15.42:0/556306559 shutdown_connections 2024-09-17T01:37:19.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.643+0000 7fab37a00640 1 --2- 172.21.15.42:0/556306559 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fab10078b90 0x7fab1007b0a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:19.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.643+0000 7fab37a00640 1 --2- 172.21.15.42:0/556306559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab3015cb80 0x7fab30150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:19.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.643+0000 7fab37a00640 1 --2- 172.21.15.42:0/556306559 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab3015f480 0x7fab30150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:19.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.643+0000 7fab37a00640 1 --2- 172.21.15.42:0/556306559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab3006d430 0x7fab3014ca90 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:19.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.643+0000 7fab37a00640 1 -- 172.21.15.42:0/556306559 >> 172.21.15.42:0/556306559 conn(0x7fab300b2930 msgr2=0x7fab300ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:19.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.643+0000 7fab37a00640 1 -- 172.21.15.42:0/556306559 shutdown_connections 2024-09-17T01:37:19.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:19.643+0000 7fab37a00640 1 -- 172.21.15.42:0/556306559 wait complete. 2024-09-17T01:37:19.974 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:37:19.979 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:37:20.065 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:37:00.371835+0000', 'modified': '2024-09-17T01:37:18.170574+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 82, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6978}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6978': {'gid': 6978, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.42:6835/457794069', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6834', 'nonce': 457794069}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 457794069}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T01:37:20.065 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6978:up:reconnect 2024-09-17T01:37:21.066 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:37:21.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.311+0000 7fca5ca00640 1 -- 172.21.15.42:0/996368842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca580b3550 msgr2=0x7fca5815cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:21.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.311+0000 7fca5ca00640 1 --2- 172.21.15.42:0/996368842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca580b3550 0x7fca5815cec0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fca48005fd0 tx=0x7fca4802a5f0 comp rx=0 tx=0).stop 2024-09-17T01:37:21.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.311+0000 7fca5ca00640 1 -- 172.21.15.42:0/996368842 shutdown_connections 2024-09-17T01:37:21.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.311+0000 7fca5ca00640 1 --2- 172.21.15.42:0/996368842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca580b3550 0x7fca5815cec0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:21.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.311+0000 7fca5ca00640 1 -- 172.21.15.42:0/996368842 >> 172.21.15.42:0/996368842 conn(0x7fca580b2930 msgr2=0x7fca5806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:21.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.311+0000 7fca5ca00640 1 -- 172.21.15.42:0/996368842 shutdown_connections 2024-09-17T01:37:21.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.311+0000 7fca5ca00640 1 -- 172.21.15.42:0/996368842 wait complete. 2024-09-17T01:37:21.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.313+0000 7fca5ca00640 1 Processor -- start 2024-09-17T01:37:21.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.313+0000 7fca5ca00640 1 -- start start 2024-09-17T01:37:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.315+0000 7fca5ca00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca580b3550 0x7fca5813eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.315+0000 7fca5ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca580cec40 0x7fca580aed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.315+0000 7fca5ca00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca58142f40 0x7fca580af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.315+0000 7fca5ca00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fca580cf050 con 0x7fca580cec40 2024-09-17T01:37:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.315+0000 7fca5ca00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fca5806dd50 con 0x7fca580b3550 2024-09-17T01:37:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.315+0000 7fca5ca00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fca580cf1d0 con 0x7fca58142f40 2024-09-17T01:37:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.315+0000 7fca4d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca580cec40 0x7fca580aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.315+0000 7fca4d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca580cec40 0x7fca580aed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53924/0 (socket says 172.21.15.42:53924) 2024-09-17T01:37:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.315+0000 7fca4d400640 1 -- 172.21.15.42:0/2900971714 learned_addr learned my addr 172.21.15.42:0/2900971714 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.315+0000 7fca55e00640 1 --2- 172.21.15.42:0/2900971714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca580b3550 0x7fca5813eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.315+0000 7fca56800640 1 --2- 172.21.15.42:0/2900971714 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca58142f40 0x7fca580af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.316+0000 7fca4d400640 1 -- 172.21.15.42:0/2900971714 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca58142f40 msgr2=0x7fca580af260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.316+0000 7fca4d400640 1 --2- 172.21.15.42:0/2900971714 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca58142f40 0x7fca580af260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:21.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.316+0000 7fca4d400640 1 -- 172.21.15.42:0/2900971714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca580b3550 msgr2=0x7fca5813eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:21.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.316+0000 7fca4d400640 1 --2- 172.21.15.42:0/2900971714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca580b3550 0x7fca5813eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:21.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.316+0000 7fca4d400640 1 -- 172.21.15.42:0/2900971714 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca580adf60 con 0x7fca580cec40 2024-09-17T01:37:21.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.316+0000 7fca4d400640 1 --2- 172.21.15.42:0/2900971714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca580cec40 0x7fca580aed20 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fca40001eb0 tx=0x7fca4000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:21.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.316+0000 7fca4ea00640 1 -- 172.21.15.42:0/2900971714 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca40017070 con 0x7fca580cec40 2024-09-17T01:37:21.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.316+0000 7fca4ea00640 1 -- 172.21.15.42:0/2900971714 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca400053c0 con 0x7fca580cec40 2024-09-17T01:37:21.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.316+0000 7fca4ea00640 1 -- 172.21.15.42:0/2900971714 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca40003830 con 0x7fca580cec40 2024-09-17T01:37:21.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.316+0000 7fca5ca00640 1 -- 172.21.15.42:0/2900971714 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca580ae240 con 0x7fca580cec40 2024-09-17T01:37:21.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.316+0000 7fca5ca00640 1 -- 172.21.15.42:0/2900971714 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca5813f810 con 0x7fca580cec40 2024-09-17T01:37:21.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.317+0000 7fca5ca00640 1 -- 172.21.15.42:0/2900971714 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca5815cec0 con 0x7fca580cec40 2024-09-17T01:37:21.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.319+0000 7fca4ea00640 1 -- 172.21.15.42:0/2900971714 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fca4001a070 con 0x7fca580cec40 2024-09-17T01:37:21.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.320+0000 7fca4ea00640 1 --2- 172.21.15.42:0/2900971714 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fca34078b90 0x7fca3407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:21.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.320+0000 7fca4ea00640 1 -- 172.21.15.42:0/2900971714 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5795+0+0 (secure 0 0 0) 0x7fca4009a060 con 0x7fca580cec40 2024-09-17T01:37:21.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.321+0000 7fca55e00640 1 --2- 172.21.15.42:0/2900971714 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fca34078b90 0x7fca3407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:21.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.322+0000 7fca55e00640 1 --2- 172.21.15.42:0/2900971714 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fca34078b90 0x7fca3407b0a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fca48033000 tx=0x7fca48004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:21.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.325+0000 7fca4ea00640 1 -- 172.21.15.42:0/2900971714 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fca40061e70 con 0x7fca580cec40 2024-09-17T01:37:21.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.559+0000 7fca5ca00640 1 -- 172.21.15.42:0/2900971714 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca5806a170 con 0x7fca580cec40 2024-09-17T01:37:21.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.560+0000 7fca4ea00640 1 -- 172.21.15.42:0/2900971714 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5223 (secure 0 0 0) 0x7fca400668a0 con 0x7fca580cec40 2024-09-17T01:37:21.558 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:21.558 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":63,"btime":"2024-09-17T01:37:21:167278+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6119,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/1918787537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1918787537},{"type":"v1","addr":"172.21.15.43:6835","nonce":1918787537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6646,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2741360699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2741360699},{"type":"v1","addr":"172.21.15.43:6837","nonce":2741360699}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6957,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/2289144423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2289144423},{"type":"v1","addr":"172.21.15.42:6833","nonce":2289144423}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:37:00.371835+0000","modified":"2024-09-17T01:37:21.167272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6978},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6978":{"gid":6978,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6835/457794069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":457794069},{"type":"v1","addr":"172.21.15.42:6835","nonce":457794069}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6978,"qdb_cluster":[6978]},"id":5}]} 2024-09-17T01:37:21.558 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 63 2024-09-17T01:37:21.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.562+0000 7fca5ca00640 1 -- 172.21.15.42:0/2900971714 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fca34078b90 msgr2=0x7fca3407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:21.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.562+0000 7fca5ca00640 1 --2- 172.21.15.42:0/2900971714 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fca34078b90 0x7fca3407b0a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fca48033000 tx=0x7fca48004730 comp rx=0 tx=0).stop 2024-09-17T01:37:21.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.562+0000 7fca5ca00640 1 -- 172.21.15.42:0/2900971714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca580cec40 msgr2=0x7fca580aed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:21.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.562+0000 7fca5ca00640 1 --2- 172.21.15.42:0/2900971714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca580cec40 0x7fca580aed20 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fca40001eb0 tx=0x7fca4000c890 comp rx=0 tx=0).stop 2024-09-17T01:37:21.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.562+0000 7fca5ca00640 1 -- 172.21.15.42:0/2900971714 shutdown_connections 2024-09-17T01:37:21.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.563+0000 7fca5ca00640 1 --2- 172.21.15.42:0/2900971714 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fca34078b90 0x7fca3407b0a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:21.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.563+0000 7fca5ca00640 1 --2- 172.21.15.42:0/2900971714 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca58142f40 0x7fca580af260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:21.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.563+0000 7fca5ca00640 1 --2- 172.21.15.42:0/2900971714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca580cec40 0x7fca580aed20 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:21.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.563+0000 7fca5ca00640 1 --2- 172.21.15.42:0/2900971714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca580b3550 0x7fca5813eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:21.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.563+0000 7fca5ca00640 1 -- 172.21.15.42:0/2900971714 >> 172.21.15.42:0/2900971714 conn(0x7fca580b2930 msgr2=0x7fca5815eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:21.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.563+0000 7fca5ca00640 1 -- 172.21.15.42:0/2900971714 shutdown_connections 2024-09-17T01:37:21.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:21.563+0000 7fca5ca00640 1 -- 172.21.15.42:0/2900971714 wait complete. 2024-09-17T01:37:21.987 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:37:00.371835+0000', 'modified': '2024-09-17T01:37:21.167272+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 82, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6978}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6978': {'gid': 6978, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.42:6835/457794069', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6834', 'nonce': 457794069}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 457794069}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6978, 'qdb_cluster': [6978]} 2024-09-17T01:37:21.987 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T01:37:21.987 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T01:37:22.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.219+0000 7f36b8000640 1 -- 172.21.15.42:0/841335757 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b00b3550 msgr2=0x7f36b015cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:22.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.219+0000 7f36b8000640 1 --2- 172.21.15.42:0/841335757 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b00b3550 0x7f36b015cec0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f36b00704d0 tx=0x7f36a402a560 comp rx=0 tx=0).stop 2024-09-17T01:37:22.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.219+0000 7f36b8000640 1 -- 172.21.15.42:0/841335757 shutdown_connections 2024-09-17T01:37:22.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.219+0000 7f36b8000640 1 --2- 172.21.15.42:0/841335757 >> v2:172.21.15.43:3300/0 conn(0x7f36b0142f40 0x7f36b0072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.219+0000 7f36b8000640 1 --2- 172.21.15.42:0/841335757 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b00b3550 0x7f36b015cec0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.219+0000 7f36b8000640 1 -- 172.21.15.42:0/841335757 >> 172.21.15.42:0/841335757 conn(0x7f36b00b2930 msgr2=0x7f36b006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:22.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.219+0000 7f36b8000640 1 -- 172.21.15.42:0/841335757 shutdown_connections 2024-09-17T01:37:22.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.219+0000 7f36b8000640 1 -- 172.21.15.42:0/841335757 wait complete. 2024-09-17T01:37:22.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.222+0000 7f36b8000640 1 Processor -- start 2024-09-17T01:37:22.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.222+0000 7f36b8000640 1 -- start start 2024-09-17T01:37:22.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.223+0000 7f36b8000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b0072e90 0x7f36b0159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:22.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.223+0000 7f36b8000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36b00b3550 0x7f36b01f5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:22.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.223+0000 7f36b8000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b0142f40 0x7f36b006f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:22.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.223+0000 7f36b8000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f36b006d5b0 con 0x7f36b0072e90 2024-09-17T01:37:22.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.223+0000 7f36b8000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f36b006d430 con 0x7f36b0142f40 2024-09-17T01:37:22.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.223+0000 7f36b8000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f36b006d730 con 0x7f36b00b3550 2024-09-17T01:37:22.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.223+0000 7f36b5600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b0072e90 0x7f36b0159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:22.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.223+0000 7f36b5600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b0072e90 0x7f36b0159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53944/0 (socket says 172.21.15.42:53944) 2024-09-17T01:37:22.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.223+0000 7f36b5600640 1 -- 172.21.15.42:0/2499053937 learned_addr learned my addr 172.21.15.42:0/2499053937 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:22.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.224+0000 7f36b4c00640 1 --2- 172.21.15.42:0/2499053937 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36b00b3550 0x7f36b01f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:22.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.224+0000 7f36b6000640 1 --2- 172.21.15.42:0/2499053937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b0142f40 0x7f36b006f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:22.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.224+0000 7f36b5600640 1 -- 172.21.15.42:0/2499053937 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36b00b3550 msgr2=0x7f36b01f5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:22.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.224+0000 7f36b5600640 1 --2- 172.21.15.42:0/2499053937 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36b00b3550 0x7f36b01f5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.224+0000 7f36b5600640 1 -- 172.21.15.42:0/2499053937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b0142f40 msgr2=0x7f36b006f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:22.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.224+0000 7f36b5600640 1 --2- 172.21.15.42:0/2499053937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b0142f40 0x7f36b006f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.224+0000 7f36b5600640 1 -- 172.21.15.42:0/2499053937 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b01f64c0 con 0x7f36b0072e90 2024-09-17T01:37:22.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.224+0000 7f36b6000640 1 --2- 172.21.15.42:0/2499053937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b0142f40 0x7f36b006f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:22.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.224+0000 7f36b5600640 1 --2- 172.21.15.42:0/2499053937 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b0072e90 0x7f36b0159ad0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f36a4034040 tx=0x7f36a40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:22.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.224+0000 7f36ad600640 1 -- 172.21.15.42:0/2499053937 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a403e030 con 0x7f36b0072e90 2024-09-17T01:37:22.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.225+0000 7f36ad600640 1 -- 172.21.15.42:0/2499053937 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36a4003db0 con 0x7f36b0072e90 2024-09-17T01:37:22.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.225+0000 7f36ad600640 1 -- 172.21.15.42:0/2499053937 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4035040 con 0x7f36b0072e90 2024-09-17T01:37:22.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.225+0000 7f36b8000640 1 -- 172.21.15.42:0/2499053937 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36b01f6f70 con 0x7f36b0072e90 2024-09-17T01:37:22.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.225+0000 7f36b8000640 1 -- 172.21.15.42:0/2499053937 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36b01f6c90 con 0x7f36b0072e90 2024-09-17T01:37:22.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.227+0000 7f36ad600640 1 -- 172.21.15.42:0/2499053937 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f36a4041030 con 0x7f36b0072e90 2024-09-17T01:37:22.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.228+0000 7f36ad600640 1 --2- 172.21.15.42:0/2499053937 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3690078b90 0x7f369007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:22.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.228+0000 7f36ad600640 1 -- 172.21.15.42:0/2499053937 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5795+0+0 (secure 0 0 0) 0x7f36a40bb7c0 con 0x7f36b0072e90 2024-09-17T01:37:22.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.228+0000 7f36bf08e740 1 Processor -- start 2024-09-17T01:37:22.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.229+0000 7f36bf08e740 1 -- start start 2024-09-17T01:37:22.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.229+0000 7f36b4c00640 1 --2- 172.21.15.42:0/2499053937 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3690078b90 0x7f369007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:22.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.229+0000 7f36b4c00640 1 --2- 172.21.15.42:0/2499053937 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3690078b90 0x7f369007b0a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f36b0074760 tx=0x7f369c005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:22.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.230+0000 7f36bf08e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff6d270 0x5602a033d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:22.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.230+0000 7f36bf08e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56029ff443b0 0x5602a033deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:22.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.230+0000 7f36bf08e740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56029ff4c590 0x5602a030df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:22.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.230+0000 7f36bf08e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5602a0297430 con 0x56029ff6d270 2024-09-17T01:37:22.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.230+0000 7f36bf08e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5602a02875d0 con 0x56029ff443b0 2024-09-17T01:37:22.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.230+0000 7f36bf08e740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5602a0276a00 con 0x56029ff4c590 2024-09-17T01:37:22.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.230+0000 7f36b5600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff6d270 0x5602a033d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:22.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.230+0000 7f36b5600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff6d270 0x5602a033d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53952/0 (socket says 172.21.15.42:53952) 2024-09-17T01:37:22.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.230+0000 7f36b5600640 1 -- 172.21.15.42:0/2413415564 learned_addr learned my addr 172.21.15.42:0/2413415564 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:22.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.230+0000 7f36b6000640 1 --2- 172.21.15.42:0/2413415564 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56029ff4c590 0x5602a030df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:22.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.230+0000 7f36b4c00640 1 --2- 172.21.15.42:0/2413415564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56029ff443b0 0x5602a033deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:22.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.231+0000 7f36b5600640 1 -- 172.21.15.42:0/2413415564 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56029ff4c590 msgr2=0x5602a030df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:22.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.231+0000 7f36b5600640 1 --2- 172.21.15.42:0/2413415564 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56029ff4c590 0x5602a030df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.231+0000 7f36b5600640 1 -- 172.21.15.42:0/2413415564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56029ff443b0 msgr2=0x5602a033deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:22.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.231+0000 7f36b5600640 1 --2- 172.21.15.42:0/2413415564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56029ff443b0 0x5602a033deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.231+0000 7f36b5600640 1 -- 172.21.15.42:0/2413415564 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602a023f520 con 0x56029ff6d270 2024-09-17T01:37:22.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.231+0000 7f36b5600640 1 --2- 172.21.15.42:0/2413415564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff6d270 0x5602a033d970 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f36a40099c0 tx=0x7f36a4083460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec99ef9e2a20e280 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:22.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.231+0000 7f36a1c00640 1 -- 172.21.15.42:0/2413415564 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4048070 con 0x56029ff6d270 2024-09-17T01:37:22.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.231+0000 7f36a1c00640 1 -- 172.21.15.42:0/2413415564 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36a40835d0 con 0x56029ff6d270 2024-09-17T01:37:22.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.231+0000 7f36a1c00640 1 -- 172.21.15.42:0/2413415564 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4083a90 con 0x56029ff6d270 2024-09-17T01:37:22.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.232+0000 7f36bf08e740 1 -- 172.21.15.42:0/2413415564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff6d270 msgr2=0x5602a033d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:22.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.232+0000 7f36bf08e740 1 --2- 172.21.15.42:0/2413415564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff6d270 0x5602a033d970 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f36a40099c0 tx=0x7f36a4083460 comp rx=0 tx=0).stop 2024-09-17T01:37:22.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.232+0000 7f36bf08e740 1 -- 172.21.15.42:0/2413415564 shutdown_connections 2024-09-17T01:37:22.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.232+0000 7f36bf08e740 1 --2- 172.21.15.42:0/2413415564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56029ff443b0 0x5602a033deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.232+0000 7f36bf08e740 1 --2- 172.21.15.42:0/2413415564 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56029ff4c590 0x5602a030df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.232+0000 7f36bf08e740 1 --2- 172.21.15.42:0/2413415564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff6d270 0x5602a033d970 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.232+0000 7f36bf08e740 1 -- 172.21.15.42:0/2413415564 >> 172.21.15.42:0/2413415564 conn(0x56029ff613c0 msgr2=0x5602a0313970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:22.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.232+0000 7f36bf08e740 1 -- 172.21.15.42:0/2413415564 shutdown_connections 2024-09-17T01:37:22.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.233+0000 7f36bf08e740 1 -- 172.21.15.42:0/2413415564 wait complete. 2024-09-17T01:37:22.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.234+0000 7f36bf08e740 1 -- start start 2024-09-17T01:37:22.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.234+0000 7f36bf08e740 1 Processor -- start 2024-09-17T01:37:22.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.235+0000 7f36bf08e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56029ff443b0 0x5602a0333d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:22.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.235+0000 7f36bf08e740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56029ff4c590 0x5602a0334260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:22.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.235+0000 7f36bf08e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff6d270 0x5602a0337b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:22.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.235+0000 7f36bf08e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5602a021d330 con 0x56029ff6d270 2024-09-17T01:37:22.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.235+0000 7f36bf08e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5602a027a810 con 0x56029ff443b0 2024-09-17T01:37:22.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.235+0000 7f36bf08e740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56029ffe7620 con 0x56029ff4c590 2024-09-17T01:37:22.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.235+0000 7f36bf08e740 10 client.0 _ll_register_callbacks cb 0x5602a0222420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:37:22.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.235+0000 7f36b6000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff6d270 0x5602a0337b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:22.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.236+0000 7f36b6000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff6d270 0x5602a0337b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53962/0 (socket says 172.21.15.42:53962) 2024-09-17T01:37:22.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.236+0000 7f36b6000640 1 -- 172.21.15.42:0/3301735878 learned_addr learned my addr 172.21.15.42:0/3301735878 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:22.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.236+0000 7f36b4c00640 1 --2- 172.21.15.42:0/3301735878 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56029ff4c590 0x5602a0334260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:22.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.236+0000 7f36b5600640 1 --2- 172.21.15.42:0/3301735878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56029ff443b0 0x5602a0333d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:22.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.236+0000 7f36b6000640 1 -- 172.21.15.42:0/3301735878 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56029ff4c590 msgr2=0x5602a0334260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:22.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.236+0000 7f36b6000640 1 --2- 172.21.15.42:0/3301735878 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56029ff4c590 0x5602a0334260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.236+0000 7f36b6000640 1 -- 172.21.15.42:0/3301735878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56029ff443b0 msgr2=0x5602a0333d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:22.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.236+0000 7f36b6000640 1 --2- 172.21.15.42:0/3301735878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56029ff443b0 0x5602a0333d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.236+0000 7f36b6000640 1 -- 172.21.15.42:0/3301735878 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56029ffd8850 con 0x56029ff6d270 2024-09-17T01:37:22.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.236+0000 7f36b6000640 1 --2- 172.21.15.42:0/3301735878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff6d270 0x5602a0337b30 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f36a80115c0 tx=0x7f36a8011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7032e33a7931203 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:22.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.236+0000 7f3696000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:37:22.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.237+0000 7f3696000640 1 -- 172.21.15.42:0/3301735878 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a8003b80 con 0x56029ff6d270 2024-09-17T01:37:22.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.237+0000 7f3696000640 1 -- 172.21.15.42:0/3301735878 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5795+0+0 (secure 0 0 0) 0x7f36a8003d20 con 0x56029ff6d270 2024-09-17T01:37:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.237+0000 7f36bf08e740 1 -- 172.21.15.42:0/3301735878 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36a40835d0 con 0x56029ff6d270 2024-09-17T01:37:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.237+0000 7f3696000640 1 -- 172.21.15.42:0/3301735878 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f36a8022050 con 0x56029ff6d270 2024-09-17T01:37:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.237+0000 7f36bf08e740 10 client.7011 fetch_fsmap learned FSMap version 63 2024-09-17T01:37:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.237+0000 7f36bf08e740 1 -- 172.21.15.42:0/3301735878 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) -- 0x5602a004f6b0 con 0x56029ff6d270 2024-09-17T01:37:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.237+0000 7f3696000640 1 -- 172.21.15.42:0/3301735878 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36a40835d0 con 0x56029ff6d270 2024-09-17T01:37:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.237+0000 7f3696000640 1 -- 172.21.15.42:0/3301735878 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x7f36a8025020 con 0x56029ff6d270 2024-09-17T01:37:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.237+0000 7f36bf08e740 10 client.7011 fetch_fsmap finished waiting for FSMap version 63 2024-09-17T01:37:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.237+0000 7f36bf08e740 10 client.7011 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T01:37:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.237+0000 7f36bf08e740 20 client.7011 populate_metadata read hostname 'smithi042' 2024-09-17T01:37:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.237+0000 7f36bf08e740 1 --2- 172.21.15.42:0/3301735878 >> [v2:172.21.15.42:6834/457794069,v1:172.21.15.42:6835/457794069] conn(0x56029ff2be40 0x5602a0367f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:22.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.237+0000 7f36bf08e740 4 client.7011 mds_command: new command op to 6978 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:37:22.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.237+0000 7f36bf08e740 1 -- 172.21.15.42:0/3301735878 --> [v2:172.21.15.42:6834/457794069,v1:172.21.15.42:6835/457794069] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602a0289520 con 0x56029ff2be40 2024-09-17T01:37:22.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.238+0000 7f36b5600640 1 --2- 172.21.15.42:0/3301735878 >> [v2:172.21.15.42:6834/457794069,v1:172.21.15.42:6835/457794069] conn(0x56029ff2be40 0x5602a0367f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:22.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.238+0000 7f3696000640 10 client.7011 ms_handle_connect on v2:172.21.15.42:6834/457794069 2024-09-17T01:37:22.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.238+0000 7f36b5600640 1 --2- 172.21.15.42:0/3301735878 >> [v2:172.21.15.42:6834/457794069,v1:172.21.15.42:6835/457794069] conn(0x56029ff2be40 0x5602a0367f60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5508ce9896451f67 server_cookie=67e38fdffa68e98f in_seq=0 out_seq=0 2024-09-17T01:37:22.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.239+0000 7f3696000640 1 -- 172.21.15.42:0/3301735878 <== mds.0 v2:172.21.15.42:6834/457794069 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5602a0289520 con 0x56029ff2be40 2024-09-17T01:37:22.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.239+0000 7f3696000640 10 client.7011 handle_command_reply: tid=0 2024-09-17T01:37:22.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.239+0000 7f36bf08e740 1 client.7011 shutdown 2024-09-17T01:37:22.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.239+0000 7f36bf08e740 1 -- 172.21.15.42:0/3301735878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff6d270 msgr2=0x5602a0337b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:22.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.239+0000 7f36bf08e740 1 --2- 172.21.15.42:0/3301735878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff6d270 0x5602a0337b30 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f36a80115c0 tx=0x7f36a8011a80 comp rx=0 tx=0).stop 2024-09-17T01:37:22.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.240+0000 7f36bf08e740 1 -- 172.21.15.42:0/3301735878 shutdown_connections 2024-09-17T01:37:22.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.240+0000 7f36bf08e740 1 --2- 172.21.15.42:0/3301735878 >> [v2:172.21.15.42:6834/457794069,v1:172.21.15.42:6835/457794069] conn(0x56029ff2be40 0x5602a0367f60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.240+0000 7f36bf08e740 1 --2- 172.21.15.42:0/3301735878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff6d270 0x5602a0337b30 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.240+0000 7f36bf08e740 1 --2- 172.21.15.42:0/3301735878 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56029ff4c590 0x5602a0334260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.240+0000 7f36bf08e740 1 --2- 172.21.15.42:0/3301735878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56029ff443b0 0x5602a0333d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.240+0000 7f3696000640 0 client.7011 ms_handle_reset on v2:172.21.15.42:6834/457794069 2024-09-17T01:37:22.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.240+0000 7f36bf08e740 1 -- 172.21.15.42:0/3301735878 >> 172.21.15.42:0/3301735878 conn(0x56029ff613c0 msgr2=0x5602a035a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:22.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.240+0000 7f36bf08e740 1 -- 172.21.15.42:0/3301735878 shutdown_connections 2024-09-17T01:37:22.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.240+0000 7f36bf08e740 1 -- 172.21.15.42:0/3301735878 wait complete. 2024-09-17T01:37:22.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.240+0000 7f36bf08e740 20 client.7011 trim_cache size 0 max 16384 2024-09-17T01:37:22.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.259+0000 7f36bf08e740 1 Processor -- start 2024-09-17T01:37:22.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.259+0000 7f36bf08e740 1 -- start start 2024-09-17T01:37:22.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.260+0000 7f36bf08e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff443b0 0x5602a03139e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:22.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.260+0000 7f36bf08e740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56029ff4c590 0x5602a03d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:22.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.260+0000 7f36bf08e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56029ff6d270 0x5602a03d30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:22.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.260+0000 7f36bf08e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f36b01424f0 con 0x56029ff443b0 2024-09-17T01:37:22.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.260+0000 7f36bf08e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f36b0141850 con 0x56029ff6d270 2024-09-17T01:37:22.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.260+0000 7f36bf08e740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f36b0141ea0 con 0x56029ff4c590 2024-09-17T01:37:22.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.261+0000 7f36b5600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff443b0 0x5602a03139e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:22.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.261+0000 7f36b5600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff443b0 0x5602a03139e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53968/0 (socket says 172.21.15.42:53968) 2024-09-17T01:37:22.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.261+0000 7f36b5600640 1 -- 172.21.15.42:0/3505283779 learned_addr learned my addr 172.21.15.42:0/3505283779 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:22.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.261+0000 7f36b5600640 1 -- 172.21.15.42:0/3505283779 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56029ff4c590 msgr2=0x5602a03d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:22.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.261+0000 7f36b4c00640 1 --2- 172.21.15.42:0/3505283779 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56029ff4c590 0x5602a03d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:22.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.261+0000 7f36b6000640 1 --2- 172.21.15.42:0/3505283779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56029ff6d270 0x5602a03d30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:22.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.261+0000 7f36b5600640 1 --2- 172.21.15.42:0/3505283779 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56029ff4c590 0x5602a03d2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.261+0000 7f36b5600640 1 -- 172.21.15.42:0/3505283779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56029ff6d270 msgr2=0x5602a03d30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:22.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.261+0000 7f36b5600640 1 --2- 172.21.15.42:0/3505283779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56029ff6d270 0x5602a03d30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.261+0000 7f36b5600640 1 -- 172.21.15.42:0/3505283779 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602a0314650 con 0x56029ff443b0 2024-09-17T01:37:22.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.261+0000 7f36b4c00640 1 --2- 172.21.15.42:0/3505283779 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56029ff4c590 0x5602a03d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:37:22.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.261+0000 7f36b6000640 1 --2- 172.21.15.42:0/3505283779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56029ff6d270 0x5602a03d30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:37:22.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.262+0000 7f36b5600640 1 --2- 172.21.15.42:0/3505283779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff443b0 0x5602a03139e0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f36a4000c00 tx=0x7f36a4009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eeefefd3d92d5c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:22.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.262+0000 7f36a1200640 1 -- 172.21.15.42:0/3505283779 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4048040 con 0x56029ff443b0 2024-09-17T01:37:22.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.262+0000 7f36a1200640 1 -- 172.21.15.42:0/3505283779 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36a40835d0 con 0x56029ff443b0 2024-09-17T01:37:22.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.262+0000 7f36a1200640 1 -- 172.21.15.42:0/3505283779 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4083a70 con 0x56029ff443b0 2024-09-17T01:37:22.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.262+0000 7f36bf08e740 1 -- 172.21.15.42:0/3505283779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff443b0 msgr2=0x5602a03139e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:22.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.262+0000 7f36bf08e740 1 --2- 172.21.15.42:0/3505283779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff443b0 0x5602a03139e0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f36a4000c00 tx=0x7f36a4009230 comp rx=0 tx=0).stop 2024-09-17T01:37:22.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.262+0000 7f36bf08e740 1 -- 172.21.15.42:0/3505283779 shutdown_connections 2024-09-17T01:37:22.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.262+0000 7f36bf08e740 1 --2- 172.21.15.42:0/3505283779 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56029ff6d270 0x5602a03d30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.263+0000 7f36bf08e740 1 --2- 172.21.15.42:0/3505283779 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56029ff4c590 0x5602a03d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.263+0000 7f36bf08e740 1 --2- 172.21.15.42:0/3505283779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff443b0 0x5602a03139e0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.263+0000 7f36bf08e740 1 -- 172.21.15.42:0/3505283779 >> 172.21.15.42:0/3505283779 conn(0x56029ff613c0 msgr2=0x5602a0354690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:22.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.263+0000 7f36bf08e740 1 -- 172.21.15.42:0/3505283779 shutdown_connections 2024-09-17T01:37:22.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.263+0000 7f36bf08e740 1 -- 172.21.15.42:0/3505283779 wait complete. 2024-09-17T01:37:22.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.264+0000 7f36bf08e740 1 -- start start 2024-09-17T01:37:22.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.264+0000 7f36bf08e740 1 Processor -- start 2024-09-17T01:37:22.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.265+0000 7f36bf08e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff443b0 0x5602a030cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:22.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.265+0000 7f36bf08e740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56029ff4c590 0x5602a03be2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:22.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.265+0000 7f36bf08e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56029ff6d270 0x5602a037b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:22.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.265+0000 7f36bf08e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5602a0339430 con 0x56029ff443b0 2024-09-17T01:37:22.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.265+0000 7f36bf08e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5602a0353e20 con 0x56029ff6d270 2024-09-17T01:37:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.265+0000 7f36bf08e740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5602a036b8c0 con 0x56029ff4c590 2024-09-17T01:37:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.265+0000 7f36bf08e740 10 client.0 _ll_register_callbacks cb 0x7f36a8011250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:37:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.265+0000 7f36b5600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff443b0 0x5602a030cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.266+0000 7f36b5600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff443b0 0x5602a030cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53970/0 (socket says 172.21.15.42:53970) 2024-09-17T01:37:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.266+0000 7f36b5600640 1 -- 172.21.15.42:0/2052664374 learned_addr learned my addr 172.21.15.42:0/2052664374 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.266+0000 7f36b6000640 1 --2- 172.21.15.42:0/2052664374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56029ff6d270 0x5602a037b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.266+0000 7f36b4c00640 1 --2- 172.21.15.42:0/2052664374 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56029ff4c590 0x5602a03be2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.266+0000 7f36b5600640 1 -- 172.21.15.42:0/2052664374 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56029ff4c590 msgr2=0x5602a03be2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.266+0000 7f36b5600640 1 --2- 172.21.15.42:0/2052664374 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56029ff4c590 0x5602a03be2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.266+0000 7f36b5600640 1 -- 172.21.15.42:0/2052664374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56029ff6d270 msgr2=0x5602a037b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.266+0000 7f36b5600640 1 --2- 172.21.15.42:0/2052664374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56029ff6d270 0x5602a037b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.266+0000 7f36b5600640 1 -- 172.21.15.42:0/2052664374 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602a03123d0 con 0x56029ff443b0 2024-09-17T01:37:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.266+0000 7f36b4c00640 1 --2- 172.21.15.42:0/2052664374 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56029ff4c590 0x5602a03be2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.266+0000 7f36b6000640 1 --2- 172.21.15.42:0/2052664374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56029ff6d270 0x5602a037b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.266+0000 7f36b5600640 1 --2- 172.21.15.42:0/2052664374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff443b0 0x5602a030cc60 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f36a409c040 tx=0x7f36a40057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a327d40c8ec840 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.266+0000 7f3696000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:37:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.266+0000 7f3696000640 1 -- 172.21.15.42:0/2052664374 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4048070 con 0x56029ff443b0 2024-09-17T01:37:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.266+0000 7f3696000640 1 -- 172.21.15.42:0/2052664374 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5795+0+0 (secure 0 0 0) 0x7f36a4083a30 con 0x56029ff443b0 2024-09-17T01:37:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.266+0000 7f36bf08e740 1 -- 172.21.15.42:0/2052664374 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36a40835d0 con 0x56029ff443b0 2024-09-17T01:37:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.267+0000 7f3696000640 1 -- 172.21.15.42:0/2052664374 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f36a408ca20 con 0x56029ff443b0 2024-09-17T01:37:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.267+0000 7f36bf08e740 10 client.7017 fetch_fsmap learned FSMap version 63 2024-09-17T01:37:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.267+0000 7f36bf08e740 1 -- 172.21.15.42:0/2052664374 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) -- 0x5602a037aba0 con 0x56029ff443b0 2024-09-17T01:37:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.267+0000 7f3696000640 1 -- 172.21.15.42:0/2052664374 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36a40835d0 con 0x56029ff443b0 2024-09-17T01:37:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.267+0000 7f3696000640 1 -- 172.21.15.42:0/2052664374 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x7f36a408c040 con 0x56029ff443b0 2024-09-17T01:37:22.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.267+0000 7f36bf08e740 10 client.7017 fetch_fsmap finished waiting for FSMap version 63 2024-09-17T01:37:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.267+0000 7f36bf08e740 10 client.7017 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T01:37:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.267+0000 7f36bf08e740 20 client.7017 populate_metadata read hostname 'smithi042' 2024-09-17T01:37:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.267+0000 7f36bf08e740 1 --2- 172.21.15.42:0/2052664374 >> [v2:172.21.15.42:6834/457794069,v1:172.21.15.42:6835/457794069] conn(0x5602a0335550 0x5602a0335960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.267+0000 7f36bf08e740 4 client.7017 mds_command: new command op to 6978 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T01:37:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.267+0000 7f36bf08e740 1 -- 172.21.15.42:0/2052664374 --> [v2:172.21.15.42:6834/457794069,v1:172.21.15.42:6835/457794069] -- command(tid 0: {"prefix": "status"}) -- 0x5602a0284fd0 con 0x5602a0335550 2024-09-17T01:37:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.267+0000 7f36b4c00640 1 --2- 172.21.15.42:0/2052664374 >> [v2:172.21.15.42:6834/457794069,v1:172.21.15.42:6835/457794069] conn(0x5602a0335550 0x5602a0335960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.268+0000 7f36b4c00640 1 --2- 172.21.15.42:0/2052664374 >> [v2:172.21.15.42:6834/457794069,v1:172.21.15.42:6835/457794069] conn(0x5602a0335550 0x5602a0335960 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94b5e2c38f9ffb18 server_cookie=4dfa64882bd3fde5 in_seq=0 out_seq=0 2024-09-17T01:37:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.268+0000 7f3696000640 10 client.7017 ms_handle_connect on v2:172.21.15.42:6834/457794069 2024-09-17T01:37:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.268+0000 7f3696000640 1 -- 172.21.15.42:0/2052664374 <== mds.0 v2:172.21.15.42:6834/457794069 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5602a0284fd0 con 0x5602a0335550 2024-09-17T01:37:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.268+0000 7f3696000640 10 client.7017 handle_command_reply: tid=0 2024-09-17T01:37:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.268+0000 7f36bf08e740 1 client.7017 shutdown 2024-09-17T01:37:22.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.268+0000 7f36bf08e740 1 -- 172.21.15.42:0/2052664374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff443b0 msgr2=0x5602a030cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.268+0000 7f36bf08e740 1 --2- 172.21.15.42:0/2052664374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff443b0 0x5602a030cc60 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f36a409c040 tx=0x7f36a40057c0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.268+0000 7f36bf08e740 1 -- 172.21.15.42:0/2052664374 shutdown_connections 2024-09-17T01:37:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.268+0000 7f36bf08e740 1 --2- 172.21.15.42:0/2052664374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56029ff6d270 0x5602a037b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.268+0000 7f36bf08e740 1 --2- 172.21.15.42:0/2052664374 >> [v2:172.21.15.42:6834/457794069,v1:172.21.15.42:6835/457794069] conn(0x5602a0335550 0x5602a0335960 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.268+0000 7f36bf08e740 1 --2- 172.21.15.42:0/2052664374 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56029ff4c590 0x5602a03be2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.269+0000 7f3696000640 0 client.7017 ms_handle_reset on v2:172.21.15.42:6834/457794069 2024-09-17T01:37:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.269+0000 7f36bf08e740 1 --2- 172.21.15.42:0/2052664374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56029ff443b0 0x5602a030cc60 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.269+0000 7f36bf08e740 1 -- 172.21.15.42:0/2052664374 >> 172.21.15.42:0/2052664374 conn(0x56029ff613c0 msgr2=0x5602a0359820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.269+0000 7f36bf08e740 1 -- 172.21.15.42:0/2052664374 shutdown_connections 2024-09-17T01:37:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.269+0000 7f36bf08e740 1 -- 172.21.15.42:0/2052664374 wait complete. 2024-09-17T01:37:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.269+0000 7f36bf08e740 20 client.7017 trim_cache size 0 max 16384 2024-09-17T01:37:22.273 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:37:22.273 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "fea1c88c-cb05-432f-a745-f9dcbb5f2503", 2024-09-17T01:37:22.273 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-17T01:37:22.273 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 6978, 2024-09-17T01:37:22.273 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-17T01:37:22.273 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-17T01:37:22.273 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-17T01:37:22.273 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 4.1079555699999997, 2024-09-17T01:37:22.273 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 63, 2024-09-17T01:37:22.274 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 82, 2024-09-17T01:37:22.274 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 82, 2024-09-17T01:37:22.274 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 4.8165782119999996 2024-09-17T01:37:22.274 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:37:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.269+0000 7f36b8000640 1 -- 172.21.15.42:0/2499053937 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3690078b90 msgr2=0x7f369007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:22.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.269+0000 7f36b8000640 1 --2- 172.21.15.42:0/2499053937 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3690078b90 0x7f369007b0a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f36b0074760 tx=0x7f369c005f90 comp rx=0 tx=0).stop 2024-09-17T01:37:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.269+0000 7f36b8000640 1 -- 172.21.15.42:0/2499053937 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b0072e90 msgr2=0x7f36b0159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.269+0000 7f36b8000640 1 --2- 172.21.15.42:0/2499053937 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b0072e90 0x7f36b0159ad0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f36a4034040 tx=0x7f36a40038a0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.269+0000 7f36b8000640 1 -- 172.21.15.42:0/2499053937 shutdown_connections 2024-09-17T01:37:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.269+0000 7f36b8000640 1 --2- 172.21.15.42:0/2499053937 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3690078b90 0x7f369007b0a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.269+0000 7f36b8000640 1 --2- 172.21.15.42:0/2499053937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b0142f40 0x7f36b006f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.269+0000 7f36b8000640 1 --2- 172.21.15.42:0/2499053937 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36b00b3550 0x7f36b01f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.270+0000 7f36b8000640 1 --2- 172.21.15.42:0/2499053937 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b0072e90 0x7f36b0159ad0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.270+0000 7f36b8000640 1 -- 172.21.15.42:0/2499053937 >> 172.21.15.42:0/2499053937 conn(0x7f36b00b2930 msgr2=0x7f36b015f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.270+0000 7f36b8000640 1 -- 172.21.15.42:0/2499053937 shutdown_connections 2024-09-17T01:37:22.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.270+0000 7f36b8000640 1 -- 172.21.15.42:0/2499053937 wait complete. 2024-09-17T01:37:22.293 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T01:37:22.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.522+0000 7f7be1200640 1 -- 172.21.15.42:0/132574564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bdc0b4be0 msgr2=0x7f7bdc15d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:22.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.522+0000 7f7be1200640 1 --2- 172.21.15.42:0/132574564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bdc0b4be0 0x7f7bdc15d6b0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc005fd0 tx=0x7f7bcc02a670 comp rx=0 tx=0).stop 2024-09-17T01:37:22.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.523+0000 7f7be1200640 1 -- 172.21.15.42:0/132574564 shutdown_connections 2024-09-17T01:37:22.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.523+0000 7f7be1200640 1 --2- 172.21.15.42:0/132574564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bdc0b4be0 0x7f7bdc15d6b0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.523+0000 7f7be1200640 1 -- 172.21.15.42:0/132574564 >> 172.21.15.42:0/132574564 conn(0x7f7bdc0b25f0 msgr2=0x7f7bdc0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:22.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.523+0000 7f7be1200640 1 -- 172.21.15.42:0/132574564 shutdown_connections 2024-09-17T01:37:22.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.523+0000 7f7be1200640 1 -- 172.21.15.42:0/132574564 wait complete. 2024-09-17T01:37:22.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.525+0000 7f7be1200640 1 Processor -- start 2024-09-17T01:37:22.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.525+0000 7f7be1200640 1 -- start start 2024-09-17T01:37:22.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.527+0000 7f7be1200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7bdc0b4be0 0x7f7bdc0747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:22.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.527+0000 7f7be1200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bdc0cf7c0 0x7f7bdc0c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:22.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.527+0000 7f7be1200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bdc0c9b40 0x7f7bdc1500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:22.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.527+0000 7f7be1200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc1535e0 con 0x7f7bdc0cf7c0 2024-09-17T01:37:22.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.527+0000 7f7be1200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc0b4340 con 0x7f7bdc0c9b40 2024-09-17T01:37:22.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.527+0000 7f7be1200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7bdc153760 con 0x7f7bdc0b4be0 2024-09-17T01:37:22.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.527+0000 7f7bdaa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bdc0cf7c0 0x7f7bdc0c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:22.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.527+0000 7f7bdaa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bdc0cf7c0 0x7f7bdc0c9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53980/0 (socket says 172.21.15.42:53980) 2024-09-17T01:37:22.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.527+0000 7f7bdb400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7bdc0b4be0 0x7f7bdc0747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:22.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.527+0000 7f7bdaa00640 1 -- 172.21.15.42:0/838550997 learned_addr learned my addr 172.21.15.42:0/838550997 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:22.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.527+0000 7f7bdbe00640 1 --2- 172.21.15.42:0/838550997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bdc0c9b40 0x7f7bdc1500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:22.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.527+0000 7f7bdaa00640 1 -- 172.21.15.42:0/838550997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7bdc0b4be0 msgr2=0x7f7bdc0747d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:22.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.527+0000 7f7bdaa00640 1 --2- 172.21.15.42:0/838550997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7bdc0b4be0 0x7f7bdc0747d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.527+0000 7f7bdaa00640 1 -- 172.21.15.42:0/838550997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bdc0c9b40 msgr2=0x7f7bdc1500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:22.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.527+0000 7f7bdaa00640 1 --2- 172.21.15.42:0/838550997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bdc0c9b40 0x7f7bdc1500d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.527+0000 7f7bdaa00640 1 -- 172.21.15.42:0/838550997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bdc1f52e0 con 0x7f7bdc0cf7c0 2024-09-17T01:37:22.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.528+0000 7f7bdaa00640 1 --2- 172.21.15.42:0/838550997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bdc0cf7c0 0x7f7bdc0c9600 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800c3d0 tx=0x7f7bc800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:22.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.528+0000 7f7bd3400640 1 -- 172.21.15.42:0/838550997 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8017070 con 0x7f7bdc0cf7c0 2024-09-17T01:37:22.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.528+0000 7f7bd3400640 1 -- 172.21.15.42:0/838550997 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bc80053c0 con 0x7f7bdc0cf7c0 2024-09-17T01:37:22.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.528+0000 7f7bd3400640 1 -- 172.21.15.42:0/838550997 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8003850 con 0x7f7bdc0cf7c0 2024-09-17T01:37:22.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.528+0000 7f7be1200640 1 -- 172.21.15.42:0/838550997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bdc1f55a0 con 0x7f7bdc0cf7c0 2024-09-17T01:37:22.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.528+0000 7f7be1200640 1 -- 172.21.15.42:0/838550997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bdc1f5b60 con 0x7f7bdc0cf7c0 2024-09-17T01:37:22.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.529+0000 7f7be1200640 1 -- 172.21.15.42:0/838550997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bdc15d6b0 con 0x7f7bdc0cf7c0 2024-09-17T01:37:22.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.531+0000 7f7bd3400640 1 -- 172.21.15.42:0/838550997 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7bc801a070 con 0x7f7bdc0cf7c0 2024-09-17T01:37:22.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.531+0000 7f7bd3400640 1 --2- 172.21.15.42:0/838550997 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7bbc078b90 0x7f7bbc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:22.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.532+0000 7f7bd3400640 1 -- 172.21.15.42:0/838550997 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5795+0+0 (secure 0 0 0) 0x7f7bc809a0c0 con 0x7f7bdc0cf7c0 2024-09-17T01:37:22.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.532+0000 7f7bdb400640 1 --2- 172.21.15.42:0/838550997 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7bbc078b90 0x7f7bbc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:22.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.533+0000 7f7bdb400640 1 --2- 172.21.15.42:0/838550997 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7bbc078b90 0x7f7bbc07b0a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc033000 tx=0x7f7bcc004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:22.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.536+0000 7f7bd3400640 1 -- 172.21.15.42:0/838550997 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7bc8061e40 con 0x7f7bdc0cf7c0 2024-09-17T01:37:22.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.766+0000 7f7be1200640 1 -- 172.21.15.42:0/838550997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7bdc0ce200 con 0x7f7bdc0cf7c0 2024-09-17T01:37:22.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.766+0000 7f7bd3400640 1 -- 172.21.15.42:0/838550997 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v63) ==== 53+0+73 (secure 0 0 0) 0x7f7bc8066870 con 0x7f7bdc0cf7c0 2024-09-17T01:37:22.765 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T01:37:22.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.769+0000 7f7be1200640 1 -- 172.21.15.42:0/838550997 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7bbc078b90 msgr2=0x7f7bbc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:22.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.769+0000 7f7be1200640 1 --2- 172.21.15.42:0/838550997 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7bbc078b90 0x7f7bbc07b0a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc033000 tx=0x7f7bcc004730 comp rx=0 tx=0).stop 2024-09-17T01:37:22.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.769+0000 7f7be1200640 1 -- 172.21.15.42:0/838550997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bdc0cf7c0 msgr2=0x7f7bdc0c9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:22.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.769+0000 7f7be1200640 1 --2- 172.21.15.42:0/838550997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bdc0cf7c0 0x7f7bdc0c9600 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800c3d0 tx=0x7f7bc800c890 comp rx=0 tx=0).stop 2024-09-17T01:37:22.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.769+0000 7f7be1200640 1 -- 172.21.15.42:0/838550997 shutdown_connections 2024-09-17T01:37:22.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.769+0000 7f7be1200640 1 --2- 172.21.15.42:0/838550997 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7bbc078b90 0x7f7bbc07b0a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.769+0000 7f7be1200640 1 --2- 172.21.15.42:0/838550997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bdc0c9b40 0x7f7bdc1500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.769+0000 7f7be1200640 1 --2- 172.21.15.42:0/838550997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bdc0cf7c0 0x7f7bdc0c9600 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.769+0000 7f7be1200640 1 --2- 172.21.15.42:0/838550997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7bdc0b4be0 0x7f7bdc0747d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:22.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.769+0000 7f7be1200640 1 -- 172.21.15.42:0/838550997 >> 172.21.15.42:0/838550997 conn(0x7f7bdc0b25f0 msgr2=0x7f7bdc15f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:22.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.769+0000 7f7be1200640 1 -- 172.21.15.42:0/838550997 shutdown_connections 2024-09-17T01:37:22.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:22.769+0000 7f7be1200640 1 -- 172.21.15.42:0/838550997 wait complete. 2024-09-17T01:37:22.793 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T01:37:22.793 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:37:22.793 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-09-17T01:37:22.793 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T01:37:22.793 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:37:22.794 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T01:37:22.794 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T01:37:22.794 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:37:22.794 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:37:22.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:37:22.794 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-09-17T01:37:22.830 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:37:22.830 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:37:22.830 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:37:22.830 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:37:22.830 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-17T01:37:22.831 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:37:22.831 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:37:22.831 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-09-17T01:37:22.831 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-09-17T01:37:22.831 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:37:22.831 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-09-17T01:37:22.831 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-09-17T01:37:22.831 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:37:22.831 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:37:22.831 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-09-17T01:37:22.831 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-17T01:37:22.831 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42365sec preferred_lft 42365sec 2024-09-17T01:37:22.832 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-17T01:37:22.832 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:37:22.832 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:37:22.832 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:37:22.832 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-09-17T01:37:22.832 INFO:teuthology.orchestra.run.smithi042.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T01:37:22.832 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T01:37:22.832 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T01:37:22.832 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:37:22.832 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::68d2:2bff:fe2f:191a/64 scope link 2024-09-17T01:37:22.832 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:37:22.832 INFO:teuthology.orchestra.run.smithi042.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:37:22.833 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether e2:73:3e:9b:8a:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:37:22.833 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::e073:3eff:fe9b:8a00/64 scope link 2024-09-17T01:37:22.833 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:37:22.833 INFO:teuthology.orchestra.run.smithi042.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:37:22.833 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T01:37:22.833 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::240b:bfff:feb7:6e5b/64 scope link 2024-09-17T01:37:22.833 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:37:22.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:37:22.833 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:37:22.925 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-17T01:37:22.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:37:22.928 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-09-17T01:37:22.964 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-09-17T01:37:22.964 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:37:22.964 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-17T01:37:22.964 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-17T01:37:22.965 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:37:22.965 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:37:22.965 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:37:22.965 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T01:37:22.965 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T01:37:22.965 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T01:37:22.965 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:37:23.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:37:23.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:37:23.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:37:23.163 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-17T01:37:23.199 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T01:37:23.199 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T01:37:23.200 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:37:23.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:37:23.200 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-09-17T01:37:23.296 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:37:23.296 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T01:37:23.331 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:37:23.331 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:37:23.332 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:37:23.406 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T01:37:23.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:37:23.406 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:37:23.604 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:37:23.605 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:37:23.605 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:37:23.625 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:37:23.625 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:37:23.625 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:37:23.625 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:37:23.625 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:37:23.656 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:37:23.656 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:37:23.656 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:37:23.656 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:37:23.657 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:37:23.657 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-09-17T01:37:23.657 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-09-17T01:37:23.657 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fea1c88c-cb05-432f-a745-f9dcbb5f2503" will pass to kernel 2024-09-17T01:37:23.658 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T01:37:23.658 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-09-17T01:37:23.658 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T01:37:23.658 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T01:37:23.658 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T01:37:23.661 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T01:37:23.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:37:23.662 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:37:23.717 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:37:23.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:37:23.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:37:23.807 INFO:teuthology.orchestra.run.smithi042.stdout:client6164 2024-09-17T01:37:23.808 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:37:23.808 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:37:23.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:37:23.844 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-09-17T01:37:23.920 INFO:teuthology.orchestra.run.smithi042.stderr:rmdir: failed to remove 'scrub_repair_path': Directory not empty 2024-09-17T01:37:23.921 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:37:23.921 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_repair_path repair' 2024-09-17T01:37:23.922 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub start /scrub_repair_path repair 2024-09-17T01:37:24.160 INFO:tasks.ceph.mds.a.smithi042.stderr:2024-09-17T01:37:24.161+0000 7f7722400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:37:24.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.193+0000 7f6c27e00640 1 -- 172.21.15.42:0/2234403156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c2815f4a0 msgr2=0x7f6c2815f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:24.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.193+0000 7f6c27e00640 1 --2- 172.21.15.42:0/2234403156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c2815f4a0 0x7f6c2815f8b0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f6c280b6b90 tx=0x7f6c1802a540 comp rx=0 tx=0).stop 2024-09-17T01:37:24.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.193+0000 7f6c27e00640 1 -- 172.21.15.42:0/2234403156 shutdown_connections 2024-09-17T01:37:24.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.193+0000 7f6c27e00640 1 --2- 172.21.15.42:0/2234403156 >> v2:172.21.15.43:3300/0 conn(0x7f6c28162490 0x7f6c281628a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.193+0000 7f6c27e00640 1 --2- 172.21.15.42:0/2234403156 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6c280b6090 0x7f6c280b64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.193+0000 7f6c27e00640 1 --2- 172.21.15.42:0/2234403156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c2815f4a0 0x7f6c2815f8b0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.193+0000 7f6c27e00640 1 -- 172.21.15.42:0/2234403156 >> 172.21.15.42:0/2234403156 conn(0x7f6c280d14b0 msgr2=0x7f6c280d18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:24.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.194+0000 7f6c27e00640 1 -- 172.21.15.42:0/2234403156 shutdown_connections 2024-09-17T01:37:24.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.194+0000 7f6c27e00640 1 -- 172.21.15.42:0/2234403156 wait complete. 2024-09-17T01:37:24.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.196+0000 7f6c27e00640 1 Processor -- start 2024-09-17T01:37:24.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.196+0000 7f6c27e00640 1 -- start start 2024-09-17T01:37:24.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.197+0000 7f6c27e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c280b6090 0x7f6c280cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:24.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.198+0000 7f6c27e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6c2815f4a0 0x7f6c2815d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:24.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.198+0000 7f6c27e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c28162490 0x7f6c2814d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:24.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.198+0000 7f6c27e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6c28162f60 con 0x7f6c28162490 2024-09-17T01:37:24.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.198+0000 7f6c27e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6c28162de0 con 0x7f6c280b6090 2024-09-17T01:37:24.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.198+0000 7f6c27e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6c281630e0 con 0x7f6c2815f4a0 2024-09-17T01:37:24.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.198+0000 7f6c27400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c28162490 0x7f6c2814d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:24.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.198+0000 7f6c27400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c28162490 0x7f6c2814d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54004/0 (socket says 172.21.15.42:54004) 2024-09-17T01:37:24.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.198+0000 7f6c27400640 1 -- 172.21.15.42:0/2338288583 learned_addr learned my addr 172.21.15.42:0/2338288583 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:24.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.198+0000 7f6c1fe00640 1 --2- 172.21.15.42:0/2338288583 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6c2815f4a0 0x7f6c2815d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:24.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.198+0000 7f6c26a00640 1 --2- 172.21.15.42:0/2338288583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c280b6090 0x7f6c280cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:24.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.198+0000 7f6c27400640 1 -- 172.21.15.42:0/2338288583 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6c2815f4a0 msgr2=0x7f6c2815d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:24.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.198+0000 7f6c27400640 1 --2- 172.21.15.42:0/2338288583 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6c2815f4a0 0x7f6c2815d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.198+0000 7f6c27400640 1 -- 172.21.15.42:0/2338288583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c280b6090 msgr2=0x7f6c280cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:24.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.198+0000 7f6c27400640 1 --2- 172.21.15.42:0/2338288583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c280b6090 0x7f6c280cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.198+0000 7f6c27400640 1 -- 172.21.15.42:0/2338288583 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c280c8d50 con 0x7f6c28162490 2024-09-17T01:37:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.199+0000 7f6c27400640 1 --2- 172.21.15.42:0/2338288583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c28162490 0x7f6c2814d580 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000e990 tx=0x7f6c2000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.199+0000 7f6c1ea00640 1 -- 172.21.15.42:0/2338288583 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c20004d20 con 0x7f6c28162490 2024-09-17T01:37:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.199+0000 7f6c1ea00640 1 -- 172.21.15.42:0/2338288583 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c2000caa0 con 0x7f6c28162490 2024-09-17T01:37:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.199+0000 7f6c27e00640 1 -- 172.21.15.42:0/2338288583 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c281f53a0 con 0x7f6c28162490 2024-09-17T01:37:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.199+0000 7f6c1ea00640 1 -- 172.21.15.42:0/2338288583 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c20005020 con 0x7f6c28162490 2024-09-17T01:37:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.199+0000 7f6c27e00640 1 -- 172.21.15.42:0/2338288583 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c281f5c30 con 0x7f6c28162490 2024-09-17T01:37:24.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.201+0000 7f6c1ea00640 1 -- 172.21.15.42:0/2338288583 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6c200051c0 con 0x7f6c28162490 2024-09-17T01:37:24.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.202+0000 7f6c1ea00640 1 --2- 172.21.15.42:0/2338288583 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6c04078bc0 0x7f6c0407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:24.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.203+0000 7f6c1ea00640 1 -- 172.21.15.42:0/2338288583 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5795+0+0 (secure 0 0 0) 0x7f6c2009b700 con 0x7f6c28162490 2024-09-17T01:37:24.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.203+0000 7f6c26a00640 1 --2- 172.21.15.42:0/2338288583 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6c04078bc0 0x7f6c0407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:24.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.203+0000 7f6c34de0740 1 Processor -- start 2024-09-17T01:37:24.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.203+0000 7f6c34de0740 1 -- start start 2024-09-17T01:37:24.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.204+0000 7f6c26a00640 1 --2- 172.21.15.42:0/2338288583 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6c04078bc0 0x7f6c0407b0d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6c18033000 tx=0x7f6c18004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:24.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.205+0000 7f6c34de0740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ca5cf60680 0x55ca5d34f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:24.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.205+0000 7f6c34de0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca5cf377c0 0x55ca5d331ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:24.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.205+0000 7f6c34de0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf3f9a0 0x55ca5d3323e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:24.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.205+0000 7f6c34de0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ca5d27a9e0 con 0x55ca5cf3f9a0 2024-09-17T01:37:24.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.205+0000 7f6c34de0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ca5d269e10 con 0x55ca5cf377c0 2024-09-17T01:37:24.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.205+0000 7f6c34de0740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55ca5d26dc20 con 0x55ca5cf60680 2024-09-17T01:37:24.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.205+0000 7f6c27400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf3f9a0 0x55ca5d3323e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:24.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.205+0000 7f6c27400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf3f9a0 0x55ca5d3323e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54006/0 (socket says 172.21.15.42:54006) 2024-09-17T01:37:24.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.205+0000 7f6c27400640 1 -- 172.21.15.42:0/1075991542 learned_addr learned my addr 172.21.15.42:0/1075991542 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:24.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.205+0000 7f6c1fe00640 1 --2- 172.21.15.42:0/1075991542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca5cf377c0 0x55ca5d331ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:24.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.205+0000 7f6c26a00640 1 --2- 172.21.15.42:0/1075991542 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ca5cf60680 0x55ca5d34f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:24.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.205+0000 7f6c27400640 1 -- 172.21.15.42:0/1075991542 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ca5cf60680 msgr2=0x55ca5d34f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:24.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.205+0000 7f6c27400640 1 --2- 172.21.15.42:0/1075991542 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ca5cf60680 0x55ca5d34f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.205+0000 7f6c27400640 1 -- 172.21.15.42:0/1075991542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca5cf377c0 msgr2=0x55ca5d331ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:24.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.205+0000 7f6c27400640 1 --2- 172.21.15.42:0/1075991542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca5cf377c0 0x55ca5d331ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.205+0000 7f6c27400640 1 -- 172.21.15.42:0/1075991542 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca5d044af0 con 0x55ca5cf3f9a0 2024-09-17T01:37:24.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.205+0000 7f6c1fe00640 1 --2- 172.21.15.42:0/1075991542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca5cf377c0 0x55ca5d331ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:24.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.206+0000 7f6c27400640 1 --2- 172.21.15.42:0/1075991542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf3f9a0 0x55ca5d3323e0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f6c200630f0 tx=0x7f6c20062c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64bea6062e12bf51 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:24.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.206+0000 7f6c17400640 1 -- 172.21.15.42:0/1075991542 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2001f030 con 0x55ca5cf3f9a0 2024-09-17T01:37:24.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.206+0000 7f6c17400640 1 -- 172.21.15.42:0/1075991542 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c2006cd60 con 0x55ca5cf3f9a0 2024-09-17T01:37:24.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.206+0000 7f6c17400640 1 -- 172.21.15.42:0/1075991542 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c20085d80 con 0x55ca5cf3f9a0 2024-09-17T01:37:24.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.207+0000 7f6c34de0740 1 -- 172.21.15.42:0/1075991542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf3f9a0 msgr2=0x55ca5d3323e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:24.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.207+0000 7f6c34de0740 1 --2- 172.21.15.42:0/1075991542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf3f9a0 0x55ca5d3323e0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f6c200630f0 tx=0x7f6c20062c20 comp rx=0 tx=0).stop 2024-09-17T01:37:24.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.207+0000 7f6c34de0740 1 -- 172.21.15.42:0/1075991542 shutdown_connections 2024-09-17T01:37:24.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.207+0000 7f6c34de0740 1 --2- 172.21.15.42:0/1075991542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca5cf377c0 0x55ca5d331ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.207+0000 7f6c34de0740 1 --2- 172.21.15.42:0/1075991542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf3f9a0 0x55ca5d3323e0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.207+0000 7f6c34de0740 1 --2- 172.21.15.42:0/1075991542 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ca5cf60680 0x55ca5d34f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.207+0000 7f6c34de0740 1 -- 172.21.15.42:0/1075991542 >> 172.21.15.42:0/1075991542 conn(0x55ca5cf547d0 msgr2=0x55ca5d3080c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:24.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.207+0000 7f6c34de0740 1 -- 172.21.15.42:0/1075991542 shutdown_connections 2024-09-17T01:37:24.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.207+0000 7f6c34de0740 1 -- 172.21.15.42:0/1075991542 wait complete. 2024-09-17T01:37:24.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.208+0000 7f6c34de0740 1 -- start start 2024-09-17T01:37:24.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.208+0000 7f6c34de0740 1 Processor -- start 2024-09-17T01:37:24.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.210+0000 7f6c34de0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf377c0 0x55ca5d3204a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:24.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.210+0000 7f6c34de0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca5cf3f9a0 0x55ca5d32ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:24.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.210+0000 7f6c34de0740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ca5cf60680 0x55ca5d307d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:24.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.210+0000 7f6c34de0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ca5cfdaa30 con 0x55ca5cf377c0 2024-09-17T01:37:24.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.210+0000 7f6c34de0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ca5d20f6c0 con 0x55ca5cf3f9a0 2024-09-17T01:37:24.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.210+0000 7f6c34de0740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55ca5d343940 con 0x55ca5cf60680 2024-09-17T01:37:24.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.210+0000 7f6c34de0740 10 client.0 _ll_register_callbacks cb 0x55ca5d215890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:37:24.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.210+0000 7f6c26a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf377c0 0x55ca5d3204a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:24.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.210+0000 7f6c26a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf377c0 0x55ca5d3204a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54022/0 (socket says 172.21.15.42:54022) 2024-09-17T01:37:24.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.210+0000 7f6c26a00640 1 -- 172.21.15.42:0/988663008 learned_addr learned my addr 172.21.15.42:0/988663008 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:24.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.210+0000 7f6c1fe00640 1 --2- 172.21.15.42:0/988663008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca5cf3f9a0 0x55ca5d32ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:24.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.210+0000 7f6c27400640 1 --2- 172.21.15.42:0/988663008 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ca5cf60680 0x55ca5d307d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:24.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.210+0000 7f6c26a00640 1 -- 172.21.15.42:0/988663008 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ca5cf60680 msgr2=0x55ca5d307d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:24.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.210+0000 7f6c26a00640 1 --2- 172.21.15.42:0/988663008 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ca5cf60680 0x55ca5d307d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.210+0000 7f6c26a00640 1 -- 172.21.15.42:0/988663008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca5cf3f9a0 msgr2=0x55ca5d32ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:24.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.210+0000 7f6c26a00640 1 --2- 172.21.15.42:0/988663008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca5cf3f9a0 0x55ca5d32ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.210+0000 7f6c26a00640 1 -- 172.21.15.42:0/988663008 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca5cfa9990 con 0x55ca5cf377c0 2024-09-17T01:37:24.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.211+0000 7f6c26a00640 1 --2- 172.21.15.42:0/988663008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf377c0 0x55ca5d3204a0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f6c18000c00 tx=0x7f6c18009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134d3dfa1b0b2db7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:24.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.211+0000 7f6c0be00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:37:24.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.211+0000 7f6c0be00640 1 -- 172.21.15.42:0/988663008 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1804e070 con 0x55ca5cf377c0 2024-09-17T01:37:24.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.211+0000 7f6c0be00640 1 -- 172.21.15.42:0/988663008 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5795+0+0 (secure 0 0 0) 0x7f6c18003c00 con 0x55ca5cf377c0 2024-09-17T01:37:24.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.211+0000 7f6c34de0740 1 -- 172.21.15.42:0/988663008 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c2006cd60 con 0x55ca5cf377c0 2024-09-17T01:37:24.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.211+0000 7f6c0be00640 1 -- 172.21.15.42:0/988663008 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f6c18059050 con 0x55ca5cf377c0 2024-09-17T01:37:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.211+0000 7f6c34de0740 10 client.7038 fetch_fsmap learned FSMap version 63 2024-09-17T01:37:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.211+0000 7f6c34de0740 1 -- 172.21.15.42:0/988663008 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) -- 0x55ca5d0a5280 con 0x55ca5cf377c0 2024-09-17T01:37:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.212+0000 7f6c0be00640 1 -- 172.21.15.42:0/988663008 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c2006cd60 con 0x55ca5cf377c0 2024-09-17T01:37:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.212+0000 7f6c0be00640 1 -- 172.21.15.42:0/988663008 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x7f6c1805c020 con 0x55ca5cf377c0 2024-09-17T01:37:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.212+0000 7f6c34de0740 10 client.7038 fetch_fsmap finished waiting for FSMap version 63 2024-09-17T01:37:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.212+0000 7f6c34de0740 10 client.7038 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-09-17T01:37:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.212+0000 7f6c34de0740 20 client.7038 populate_metadata read hostname 'smithi042' 2024-09-17T01:37:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.212+0000 7f6c34de0740 1 --2- 172.21.15.42:0/988663008 >> [v2:172.21.15.42:6834/457794069,v1:172.21.15.42:6835/457794069] conn(0x55ca5cf1f250 0x55ca5d35be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.212+0000 7f6c34de0740 4 client.7038 mds_command: new command op to 6978 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:37:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.212+0000 7f6c34de0740 1 -- 172.21.15.42:0/988663008 --> [v2:172.21.15.42:6834/457794069,v1:172.21.15.42:6835/457794069] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca5d27c930 con 0x55ca5cf1f250 2024-09-17T01:37:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.212+0000 7f6c1fe00640 1 --2- 172.21.15.42:0/988663008 >> [v2:172.21.15.42:6834/457794069,v1:172.21.15.42:6835/457794069] conn(0x55ca5cf1f250 0x55ca5d35be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.213+0000 7f6c1fe00640 1 --2- 172.21.15.42:0/988663008 >> [v2:172.21.15.42:6834/457794069,v1:172.21.15.42:6835/457794069] conn(0x55ca5cf1f250 0x55ca5d35be50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=656f369d3b19d0ac server_cookie=185adb3688709be3 in_seq=0 out_seq=0 2024-09-17T01:37:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.213+0000 7f6c0be00640 10 client.7038 ms_handle_connect on v2:172.21.15.42:6834/457794069 2024-09-17T01:37:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.214+0000 7f6c0be00640 1 -- 172.21.15.42:0/988663008 <== mds.0 v2:172.21.15.42:6834/457794069 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ca5d27c930 con 0x55ca5cf1f250 2024-09-17T01:37:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.214+0000 7f6c0be00640 10 client.7038 handle_command_reply: tid=0 2024-09-17T01:37:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.214+0000 7f6c34de0740 1 client.7038 shutdown 2024-09-17T01:37:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.214+0000 7f6c34de0740 1 -- 172.21.15.42:0/988663008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf377c0 msgr2=0x55ca5d3204a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.214+0000 7f6c34de0740 1 --2- 172.21.15.42:0/988663008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf377c0 0x55ca5d3204a0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f6c18000c00 tx=0x7f6c18009260 comp rx=0 tx=0).stop 2024-09-17T01:37:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.214+0000 7f6c34de0740 1 -- 172.21.15.42:0/988663008 shutdown_connections 2024-09-17T01:37:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.214+0000 7f6c34de0740 1 --2- 172.21.15.42:0/988663008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca5cf3f9a0 0x55ca5d32ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.214+0000 7f6c34de0740 1 --2- 172.21.15.42:0/988663008 >> [v2:172.21.15.42:6834/457794069,v1:172.21.15.42:6835/457794069] conn(0x55ca5cf1f250 0x55ca5d35be50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.214+0000 7f6c34de0740 1 --2- 172.21.15.42:0/988663008 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ca5cf60680 0x55ca5d307d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.214+0000 7f6c34de0740 1 --2- 172.21.15.42:0/988663008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf377c0 0x55ca5d3204a0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.214+0000 7f6c0be00640 0 client.7038 ms_handle_reset on v2:172.21.15.42:6834/457794069 2024-09-17T01:37:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.214+0000 7f6c34de0740 1 -- 172.21.15.42:0/988663008 >> 172.21.15.42:0/988663008 conn(0x55ca5cf547d0 msgr2=0x55ca5d350230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:24.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.214+0000 7f6c34de0740 1 -- 172.21.15.42:0/988663008 shutdown_connections 2024-09-17T01:37:24.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.214+0000 7f6c34de0740 1 -- 172.21.15.42:0/988663008 wait complete. 2024-09-17T01:37:24.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.214+0000 7f6c34de0740 20 client.7038 trim_cache size 0 max 16384 2024-09-17T01:37:24.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.233+0000 7f6c34de0740 1 Processor -- start 2024-09-17T01:37:24.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.233+0000 7f6c34de0740 1 -- start start 2024-09-17T01:37:24.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.234+0000 7f6c34de0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf377c0 0x55ca5d342db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:24.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.234+0000 7f6c34de0740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ca5cf3f9a0 0x55ca5d3432f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:24.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.234+0000 7f6c34de0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca5cf60680 0x55ca5d32e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:24.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.234+0000 7f6c34de0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6c28202270 con 0x55ca5cf377c0 2024-09-17T01:37:24.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.234+0000 7f6c34de0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6c28201270 con 0x55ca5cf60680 2024-09-17T01:37:24.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.234+0000 7f6c34de0740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6c280cae80 con 0x55ca5cf3f9a0 2024-09-17T01:37:24.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.235+0000 7f6c26a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf377c0 0x55ca5d342db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:24.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.235+0000 7f6c26a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf377c0 0x55ca5d342db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54038/0 (socket says 172.21.15.42:54038) 2024-09-17T01:37:24.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.235+0000 7f6c26a00640 1 -- 172.21.15.42:0/2244172037 learned_addr learned my addr 172.21.15.42:0/2244172037 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:24.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.235+0000 7f6c1fe00640 1 --2- 172.21.15.42:0/2244172037 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ca5cf3f9a0 0x55ca5d3432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:24.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.235+0000 7f6c27400640 1 --2- 172.21.15.42:0/2244172037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca5cf60680 0x55ca5d32e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:24.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.235+0000 7f6c26a00640 1 -- 172.21.15.42:0/2244172037 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ca5cf3f9a0 msgr2=0x55ca5d3432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:24.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.235+0000 7f6c26a00640 1 --2- 172.21.15.42:0/2244172037 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ca5cf3f9a0 0x55ca5d3432f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.235+0000 7f6c26a00640 1 -- 172.21.15.42:0/2244172037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca5cf60680 msgr2=0x55ca5d32e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:24.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.235+0000 7f6c26a00640 1 --2- 172.21.15.42:0/2244172037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca5cf60680 0x55ca5d32e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.235+0000 7f6c26a00640 1 -- 172.21.15.42:0/2244172037 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca5d042df0 con 0x55ca5cf377c0 2024-09-17T01:37:24.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.236+0000 7f6c26a00640 1 --2- 172.21.15.42:0/2244172037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf377c0 0x55ca5d342db0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f6c180053a0 tx=0x7f6c18004930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b381993534e9f2e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:24.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.236+0000 7f6c16a00640 1 -- 172.21.15.42:0/2244172037 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c18062070 con 0x55ca5cf377c0 2024-09-17T01:37:24.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.236+0000 7f6c16a00640 1 -- 172.21.15.42:0/2244172037 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c18003cf0 con 0x55ca5cf377c0 2024-09-17T01:37:24.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.236+0000 7f6c16a00640 1 -- 172.21.15.42:0/2244172037 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1804e070 con 0x55ca5cf377c0 2024-09-17T01:37:24.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.237+0000 7f6c34de0740 1 -- 172.21.15.42:0/2244172037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf377c0 msgr2=0x55ca5d342db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:24.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.237+0000 7f6c34de0740 1 --2- 172.21.15.42:0/2244172037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf377c0 0x55ca5d342db0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f6c180053a0 tx=0x7f6c18004930 comp rx=0 tx=0).stop 2024-09-17T01:37:24.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.237+0000 7f6c34de0740 1 -- 172.21.15.42:0/2244172037 shutdown_connections 2024-09-17T01:37:24.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.237+0000 7f6c34de0740 1 --2- 172.21.15.42:0/2244172037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca5cf60680 0x55ca5d32e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.237+0000 7f6c34de0740 1 --2- 172.21.15.42:0/2244172037 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ca5cf3f9a0 0x55ca5d3432f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.237+0000 7f6c34de0740 1 --2- 172.21.15.42:0/2244172037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf377c0 0x55ca5d342db0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.237+0000 7f6c34de0740 1 -- 172.21.15.42:0/2244172037 >> 172.21.15.42:0/2244172037 conn(0x55ca5cf547d0 msgr2=0x55ca5d2fdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:24.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.237+0000 7f6c34de0740 1 -- 172.21.15.42:0/2244172037 shutdown_connections 2024-09-17T01:37:24.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.237+0000 7f6c34de0740 1 -- 172.21.15.42:0/2244172037 wait complete. 2024-09-17T01:37:24.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.238+0000 7f6c34de0740 1 -- start start 2024-09-17T01:37:24.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.238+0000 7f6c34de0740 1 Processor -- start 2024-09-17T01:37:24.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.239+0000 7f6c34de0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca5cf377c0 0x55ca5d36fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:24.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.239+0000 7f6c34de0740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ca5cf3f9a0 0x55ca5d32d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:24.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.239+0000 7f6c34de0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf60680 0x55ca5d32e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.239+0000 7f6c34de0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6c28200d70 con 0x55ca5cf60680 2024-09-17T01:37:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.239+0000 7f6c34de0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ca5d303cf0 con 0x55ca5cf377c0 2024-09-17T01:37:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.239+0000 7f6c34de0740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55ca5d3cd870 con 0x55ca5cf3f9a0 2024-09-17T01:37:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.240+0000 7f6c34de0740 10 client.0 _ll_register_callbacks cb 0x7f6c180056a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:37:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.240+0000 7f6c27400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf60680 0x55ca5d32e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.240+0000 7f6c27400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf60680 0x55ca5d32e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54054/0 (socket says 172.21.15.42:54054) 2024-09-17T01:37:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.240+0000 7f6c27400640 1 -- 172.21.15.42:0/2086042189 learned_addr learned my addr 172.21.15.42:0/2086042189 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.240+0000 7f6c26a00640 1 --2- 172.21.15.42:0/2086042189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca5cf377c0 0x55ca5d36fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.240+0000 7f6c1fe00640 1 --2- 172.21.15.42:0/2086042189 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ca5cf3f9a0 0x55ca5d32d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.240+0000 7f6c27400640 1 -- 172.21.15.42:0/2086042189 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ca5cf3f9a0 msgr2=0x55ca5d32d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.240+0000 7f6c27400640 1 --2- 172.21.15.42:0/2086042189 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ca5cf3f9a0 0x55ca5d32d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.240+0000 7f6c27400640 1 -- 172.21.15.42:0/2086042189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca5cf377c0 msgr2=0x55ca5d36fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:37:24.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.240+0000 7f6c27400640 1 --2- 172.21.15.42:0/2086042189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca5cf377c0 0x55ca5d36fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.240+0000 7f6c27400640 1 -- 172.21.15.42:0/2086042189 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca5d3cd680 con 0x55ca5cf60680 2024-09-17T01:37:24.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.240+0000 7f6c27400640 1 --2- 172.21.15.42:0/2086042189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf60680 0x55ca5d32e630 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f6c200630f0 tx=0x7f6c20099a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a9349904d53e1c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:24.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.240+0000 7f6c0be00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:37:24.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.241+0000 7f6c0be00640 1 -- 172.21.15.42:0/2086042189 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2001f070 con 0x55ca5cf60680 2024-09-17T01:37:24.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.241+0000 7f6c0be00640 1 -- 172.21.15.42:0/2086042189 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5795+0+0 (secure 0 0 0) 0x7f6c2005ef50 con 0x55ca5cf60680 2024-09-17T01:37:24.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.241+0000 7f6c34de0740 1 -- 172.21.15.42:0/2086042189 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c18003cf0 con 0x55ca5cf60680 2024-09-17T01:37:24.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.241+0000 7f6c0be00640 1 -- 172.21.15.42:0/2086042189 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) ==== 24+0+0 (secure 0 0 0) 0x7f6c20062980 con 0x55ca5cf60680 2024-09-17T01:37:24.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.241+0000 7f6c34de0740 10 client.7044 fetch_fsmap learned FSMap version 63 2024-09-17T01:37:24.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.241+0000 7f6c34de0740 1 -- 172.21.15.42:0/2086042189 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) -- 0x55ca5d35b130 con 0x55ca5cf60680 2024-09-17T01:37:24.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.241+0000 7f6c0be00640 1 -- 172.21.15.42:0/2086042189 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c18003cf0 con 0x55ca5cf60680 2024-09-17T01:37:24.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.241+0000 7f6c0be00640 1 -- 172.21.15.42:0/2086042189 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 63) ==== 3502+0+0 (secure 0 0 0) 0x7f6c2000f040 con 0x55ca5cf60680 2024-09-17T01:37:24.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.241+0000 7f6c34de0740 10 client.7044 fetch_fsmap finished waiting for FSMap version 63 2024-09-17T01:37:24.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.241+0000 7f6c34de0740 10 client.7044 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-09-17T01:37:24.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.241+0000 7f6c34de0740 20 client.7044 populate_metadata read hostname 'smithi042' 2024-09-17T01:37:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.241+0000 7f6c34de0740 1 --2- 172.21.15.42:0/2086042189 >> [v2:172.21.15.42:6834/457794069,v1:172.21.15.42:6835/457794069] conn(0x55ca5d3c68a0 0x55ca5d32eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.241+0000 7f6c34de0740 4 client.7044 mds_command: new command op to 6978 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}] 2024-09-17T01:37:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.241+0000 7f6c34de0740 1 -- 172.21.15.42:0/2086042189 --> [v2:172.21.15.42:6834/457794069,v1:172.21.15.42:6835/457794069] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}) -- 0x55ca5d2783e0 con 0x55ca5d3c68a0 2024-09-17T01:37:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.241+0000 7f6c26a00640 1 --2- 172.21.15.42:0/2086042189 >> [v2:172.21.15.42:6834/457794069,v1:172.21.15.42:6835/457794069] conn(0x55ca5d3c68a0 0x55ca5d32eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.242+0000 7f6c26a00640 1 --2- 172.21.15.42:0/2086042189 >> [v2:172.21.15.42:6834/457794069,v1:172.21.15.42:6835/457794069] conn(0x55ca5d3c68a0 0x55ca5d32eb70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae0ee2706e2fc5c0 server_cookie=2f585d14672d194a in_seq=0 out_seq=0 2024-09-17T01:37:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.242+0000 7f6c0be00640 10 client.7044 ms_handle_connect on v2:172.21.15.42:6834/457794069 2024-09-17T01:37:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.243+0000 7f6c0be00640 1 -- 172.21.15.42:0/2086042189 <== mds.0 v2:172.21.15.42:6834/457794069 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ca5d2783e0 con 0x55ca5d3c68a0 2024-09-17T01:37:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.243+0000 7f6c0be00640 10 client.7044 handle_command_reply: tid=0 2024-09-17T01:37:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.243+0000 7f6c34de0740 1 client.7044 shutdown 2024-09-17T01:37:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.243+0000 7f6c34de0740 1 -- 172.21.15.42:0/2086042189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf60680 msgr2=0x55ca5d32e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.243+0000 7f6c34de0740 1 --2- 172.21.15.42:0/2086042189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf60680 0x55ca5d32e630 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f6c200630f0 tx=0x7f6c20099a00 comp rx=0 tx=0).stop 2024-09-17T01:37:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.243+0000 7f6c34de0740 1 -- 172.21.15.42:0/2086042189 shutdown_connections 2024-09-17T01:37:24.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.243+0000 7f6c34de0740 1 --2- 172.21.15.42:0/2086042189 >> [v2:172.21.15.42:6834/457794069,v1:172.21.15.42:6835/457794069] conn(0x55ca5d3c68a0 0x55ca5d32eb70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.243+0000 7f6c34de0740 1 --2- 172.21.15.42:0/2086042189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ca5cf60680 0x55ca5d32e630 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.243+0000 7f6c34de0740 1 --2- 172.21.15.42:0/2086042189 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ca5cf3f9a0 0x55ca5d32d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.243+0000 7f6c34de0740 1 --2- 172.21.15.42:0/2086042189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ca5cf377c0 0x55ca5d36fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.243+0000 7f6c34de0740 1 -- 172.21.15.42:0/2086042189 >> 172.21.15.42:0/2086042189 conn(0x55ca5cf547d0 msgr2=0x55ca5d3020a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:24.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.243+0000 7f6c0be00640 0 client.7044 ms_handle_reset on v2:172.21.15.42:6834/457794069 2024-09-17T01:37:24.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.243+0000 7f6c34de0740 1 -- 172.21.15.42:0/2086042189 shutdown_connections 2024-09-17T01:37:24.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.243+0000 7f6c34de0740 1 -- 172.21.15.42:0/2086042189 wait complete. 2024-09-17T01:37:24.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.243+0000 7f6c34de0740 20 client.7044 trim_cache size 0 max 16384 2024-09-17T01:37:24.245 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:37:24.245 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-17T01:37:24.246 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "7011937b-22c0-4359-853e-0f2ee625b21d", 2024-09-17T01:37:24.246 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-17T01:37:24.246 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:37:24.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.244+0000 7f6c27e00640 1 -- 172.21.15.42:0/2338288583 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6c04078bc0 msgr2=0x7f6c0407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:24.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.244+0000 7f6c27e00640 1 --2- 172.21.15.42:0/2338288583 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6c04078bc0 0x7f6c0407b0d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6c18033000 tx=0x7f6c18004730 comp rx=0 tx=0).stop 2024-09-17T01:37:24.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.244+0000 7f6c27e00640 1 -- 172.21.15.42:0/2338288583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c28162490 msgr2=0x7f6c2814d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:24.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.244+0000 7f6c27e00640 1 --2- 172.21.15.42:0/2338288583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c28162490 0x7f6c2814d580 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000e990 tx=0x7f6c2000ee50 comp rx=0 tx=0).stop 2024-09-17T01:37:24.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.244+0000 7f6c27e00640 1 -- 172.21.15.42:0/2338288583 shutdown_connections 2024-09-17T01:37:24.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.244+0000 7f6c27e00640 1 --2- 172.21.15.42:0/2338288583 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6c04078bc0 0x7f6c0407b0d0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.244+0000 7f6c27e00640 1 --2- 172.21.15.42:0/2338288583 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c28162490 0x7f6c2814d580 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.244+0000 7f6c27e00640 1 --2- 172.21.15.42:0/2338288583 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6c2815f4a0 0x7f6c2815d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.244+0000 7f6c27e00640 1 --2- 172.21.15.42:0/2338288583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c280b6090 0x7f6c280cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:24.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.244+0000 7f6c27e00640 1 -- 172.21.15.42:0/2338288583 >> 172.21.15.42:0/2338288583 conn(0x7f6c280d14b0 msgr2=0x7f6c280d18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:24.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.244+0000 7f6c27e00640 1 -- 172.21.15.42:0/2338288583 shutdown_connections 2024-09-17T01:37:24.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:24.244+0000 7f6c27e00640 1 -- 172.21.15.42:0/2338288583 wait complete. 2024-09-17T01:37:24.266 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_repair_path repair' returned '{'return_code': 0, 'scrub_tag': '7011937b-22c0-4359-853e-0f2ee625b21d', 'mode': 'asynchronous'}' 2024-09-17T01:37:34.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:37:34.268 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-09-17T01:37:34.312 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:37:34.312 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:37:34.437 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:37:34.528 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:37:34.528 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:37:34.528 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:37:34.528 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:37:34.566 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:37:34.566 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:37:34.644 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T01:37:34.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.922+0000 7f0d83200640 1 -- 172.21.15.42:0/2527547997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d68004800 msgr2=0x7f0d68004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:34.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.922+0000 7f0d83200640 1 --2- 172.21.15.42:0/2527547997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d68004800 0x7f0d68004c10 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c001830 tx=0x7f0d68005830 comp rx=0 tx=0).stop 2024-09-17T01:37:34.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.922+0000 7f0d83200640 1 -- 172.21.15.42:0/2527547997 shutdown_connections 2024-09-17T01:37:34.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.922+0000 7f0d83200640 1 --2- 172.21.15.42:0/2527547997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d68004800 0x7f0d68004c10 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:34.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.922+0000 7f0d83200640 1 -- 172.21.15.42:0/2527547997 >> 172.21.15.42:0/2527547997 conn(0x7f0d840b25f0 msgr2=0x7f0d840d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:34.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.922+0000 7f0d83200640 1 -- 172.21.15.42:0/2527547997 shutdown_connections 2024-09-17T01:37:34.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.922+0000 7f0d83200640 1 -- 172.21.15.42:0/2527547997 wait complete. 2024-09-17T01:37:34.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.924+0000 7f0d83200640 1 Processor -- start 2024-09-17T01:37:34.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.925+0000 7f0d83200640 1 -- start start 2024-09-17T01:37:34.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.926+0000 7f0d83200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d68004800 0x7f0d8415ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:34.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.926+0000 7f0d83200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d841e5880 0x7f0d841e5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:34.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.926+0000 7f0d83200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0d841e61d0 0x7f0d841f6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:34.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.926+0000 7f0d83200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8415db80 con 0x7f0d841e5880 2024-09-17T01:37:34.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.926+0000 7f0d83200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8415da00 con 0x7f0d68004800 2024-09-17T01:37:34.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.926+0000 7f0d83200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0d8406cd20 con 0x7f0d841e61d0 2024-09-17T01:37:34.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.926+0000 7f0d7be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d841e5880 0x7f0d841e5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:34.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.926+0000 7f0d7be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d841e5880 0x7f0d841e5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48404/0 (socket says 172.21.15.42:48404) 2024-09-17T01:37:34.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.926+0000 7f0d7be00640 1 -- 172.21.15.42:0/2941579968 learned_addr learned my addr 172.21.15.42:0/2941579968 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:34.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.927+0000 7f0d81e00640 1 --2- 172.21.15.42:0/2941579968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d68004800 0x7f0d8415ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:34.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.927+0000 7f0d82800640 1 --2- 172.21.15.42:0/2941579968 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0d841e61d0 0x7f0d841f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:34.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.927+0000 7f0d7be00640 1 -- 172.21.15.42:0/2941579968 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0d841e61d0 msgr2=0x7f0d841f6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:34.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.927+0000 7f0d7be00640 1 --2- 172.21.15.42:0/2941579968 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0d841e61d0 0x7f0d841f6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:34.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.927+0000 7f0d7be00640 1 -- 172.21.15.42:0/2941579968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d68004800 msgr2=0x7f0d8415ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:34.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.927+0000 7f0d7be00640 1 --2- 172.21.15.42:0/2941579968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d68004800 0x7f0d8415ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:34.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.927+0000 7f0d7be00640 1 -- 172.21.15.42:0/2941579968 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8415bf40 con 0x7f0d841e5880 2024-09-17T01:37:34.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.927+0000 7f0d81e00640 1 --2- 172.21.15.42:0/2941579968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d68004800 0x7f0d8415ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:34.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.927+0000 7f0d7be00640 1 --2- 172.21.15.42:0/2941579968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d841e5880 0x7f0d841e5c90 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c001830 tx=0x7f0d6c006190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:34.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.928+0000 7f0d7a000640 1 -- 172.21.15.42:0/2941579968 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c043070 con 0x7f0d841e5880 2024-09-17T01:37:34.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.928+0000 7f0d7a000640 1 -- 172.21.15.42:0/2941579968 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d6c003af0 con 0x7f0d841e5880 2024-09-17T01:37:34.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.928+0000 7f0d83200640 1 -- 172.21.15.42:0/2941579968 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d840744e0 con 0x7f0d841e5880 2024-09-17T01:37:34.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.928+0000 7f0d7a000640 1 -- 172.21.15.42:0/2941579968 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c033480 con 0x7f0d841e5880 2024-09-17T01:37:34.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.928+0000 7f0d83200640 1 -- 172.21.15.42:0/2941579968 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d84074aa0 con 0x7f0d841e5880 2024-09-17T01:37:34.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.929+0000 7f0d83200640 1 -- 172.21.15.42:0/2941579968 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d8406d280 con 0x7f0d841e5880 2024-09-17T01:37:34.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.931+0000 7f0d7a000640 1 -- 172.21.15.42:0/2941579968 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0d6c046070 con 0x7f0d841e5880 2024-09-17T01:37:34.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.931+0000 7f0d7a000640 1 --2- 172.21.15.42:0/2941579968 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0d60078b90 0x7f0d6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:34.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.932+0000 7f0d7a000640 1 -- 172.21.15.42:0/2941579968 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5795+0+0 (secure 0 0 0) 0x7f0d6c0bb440 con 0x7f0d841e5880 2024-09-17T01:37:34.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.932+0000 7f0d81e00640 1 --2- 172.21.15.42:0/2941579968 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0d60078b90 0x7f0d6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:34.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.933+0000 7f0d81e00640 1 --2- 172.21.15.42:0/2941579968 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0d60078b90 0x7f0d6007b0a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0d74001240 tx=0x7f0d74001190 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:34.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:34.935+0000 7f0d7a000640 1 -- 172.21.15.42:0/2941579968 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0d6c0831c0 con 0x7f0d841e5880 2024-09-17T01:37:35.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.142+0000 7f0d83200640 1 -- 172.21.15.42:0/2941579968 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0d840b3c30 con 0x7f0d841e5880 2024-09-17T01:37:35.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.142+0000 7f0d7a000640 1 -- 172.21.15.42:0/2941579968 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v82) ==== 80+0+122 (secure 0 0 0) 0x7f0d6c087bf0 con 0x7f0d841e5880 2024-09-17T01:37:35.141 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6835/3707410924 2024-09-18T01:37:17.150634+0000 2024-09-17T01:37:35.141 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6833/3707410924 2024-09-18T01:37:17.150634+0000 2024-09-17T01:37:35.142 INFO:teuthology.orchestra.run.smithi042.stderr:listed 2 entries 2024-09-17T01:37:35.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.145+0000 7f0d83200640 1 -- 172.21.15.42:0/2941579968 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0d60078b90 msgr2=0x7f0d6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:35.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.145+0000 7f0d83200640 1 --2- 172.21.15.42:0/2941579968 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0d60078b90 0x7f0d6007b0a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0d74001240 tx=0x7f0d74001190 comp rx=0 tx=0).stop 2024-09-17T01:37:35.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.145+0000 7f0d83200640 1 -- 172.21.15.42:0/2941579968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d841e5880 msgr2=0x7f0d841e5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:35.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.145+0000 7f0d83200640 1 --2- 172.21.15.42:0/2941579968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d841e5880 0x7f0d841e5c90 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c001830 tx=0x7f0d6c006190 comp rx=0 tx=0).stop 2024-09-17T01:37:35.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.145+0000 7f0d83200640 1 -- 172.21.15.42:0/2941579968 shutdown_connections 2024-09-17T01:37:35.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.145+0000 7f0d83200640 1 --2- 172.21.15.42:0/2941579968 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0d60078b90 0x7f0d6007b0a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:35.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.145+0000 7f0d83200640 1 --2- 172.21.15.42:0/2941579968 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0d841e61d0 0x7f0d841f6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:35.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.145+0000 7f0d83200640 1 --2- 172.21.15.42:0/2941579968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d841e5880 0x7f0d841e5c90 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:35.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.145+0000 7f0d83200640 1 --2- 172.21.15.42:0/2941579968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d68004800 0x7f0d8415ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:35.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.145+0000 7f0d83200640 1 -- 172.21.15.42:0/2941579968 >> 172.21.15.42:0/2941579968 conn(0x7f0d840b25f0 msgr2=0x7f0d840b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:35.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.145+0000 7f0d83200640 1 -- 172.21.15.42:0/2941579968 shutdown_connections 2024-09-17T01:37:35.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.145+0000 7f0d83200640 1 -- 172.21.15.42:0/2941579968 wait complete. 2024-09-17T01:37:35.167 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T01:37:35.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:37:35.167 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T01:37:35.233 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:37:35.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:37:35.234 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T01:37:35.270 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:37:35.270 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:37:35.270 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:37:35.310 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:37:35.310 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:37:35.310 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:37:35.311 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:37:35.345 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:37:35.346 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:37:35.346 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:37:35.346 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:37:35.389 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:37:35.389 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:37:35.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.619+0000 7f8453200640 1 -- 172.21.15.42:0/308618561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8438004800 msgr2=0x7f8438004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:35.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.619+0000 7f8453200640 1 --2- 172.21.15.42:0/308618561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8438004800 0x7f8438004c10 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f843c009b50 tx=0x7f8438005830 comp rx=0 tx=0).stop 2024-09-17T01:37:35.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.619+0000 7f8452800640 1 -- 172.21.15.42:0/308618561 reap_dead start 2024-09-17T01:37:35.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.619+0000 7f8453200640 1 -- 172.21.15.42:0/308618561 shutdown_connections 2024-09-17T01:37:35.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.619+0000 7f8453200640 1 -- 172.21.15.42:0/308618561 >> 172.21.15.42:0/308618561 conn(0x7f84540b25f0 msgr2=0x7f84540d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:35.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.620+0000 7f8453200640 1 -- 172.21.15.42:0/308618561 shutdown_connections 2024-09-17T01:37:35.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.620+0000 7f8453200640 1 -- 172.21.15.42:0/308618561 wait complete. 2024-09-17T01:37:35.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.622+0000 7f8453200640 1 Processor -- start 2024-09-17T01:37:35.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.622+0000 7f8453200640 1 -- start start 2024-09-17T01:37:35.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.623+0000 7f8453200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8438004800 0x7f84540cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:35.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.624+0000 7f8453200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84541f9560 0x7f84541f9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:35.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.624+0000 7f8453200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f84540ae8c0 0x7f84540aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:35.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.624+0000 7f8453200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f845406cea0 con 0x7f84541f9560 2024-09-17T01:37:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.624+0000 7f8453200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f845406cd20 con 0x7f8438004800 2024-09-17T01:37:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.624+0000 7f8453200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f845406d020 con 0x7f84540ae8c0 2024-09-17T01:37:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.624+0000 7f844be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84541f9560 0x7f84541f9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.624+0000 7f844be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84541f9560 0x7f84541f9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48416/0 (socket says 172.21.15.42:48416) 2024-09-17T01:37:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.624+0000 7f844be00640 1 -- 172.21.15.42:0/948642122 learned_addr learned my addr 172.21.15.42:0/948642122 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.624+0000 7f8451e00640 1 --2- 172.21.15.42:0/948642122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8438004800 0x7f84540cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.624+0000 7f8452800640 1 --2- 172.21.15.42:0/948642122 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f84540ae8c0 0x7f84540aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.624+0000 7f844be00640 1 -- 172.21.15.42:0/948642122 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f84540ae8c0 msgr2=0x7f84540aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.624+0000 7f844be00640 1 --2- 172.21.15.42:0/948642122 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f84540ae8c0 0x7f84540aecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.624+0000 7f844be00640 1 -- 172.21.15.42:0/948642122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8438004800 msgr2=0x7f84540cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.624+0000 7f844be00640 1 --2- 172.21.15.42:0/948642122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8438004800 0x7f84540cbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.624+0000 7f844be00640 1 -- 172.21.15.42:0/948642122 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84540af210 con 0x7f84541f9560 2024-09-17T01:37:35.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.625+0000 7f844be00640 1 --2- 172.21.15.42:0/948642122 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84541f9560 0x7f84541f9970 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f843c009a70 tx=0x7f843c033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:35.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.625+0000 7f844a000640 1 -- 172.21.15.42:0/948642122 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c043070 con 0x7f84541f9560 2024-09-17T01:37:35.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.625+0000 7f844a000640 1 -- 172.21.15.42:0/948642122 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f843c004320 con 0x7f84541f9560 2024-09-17T01:37:35.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.625+0000 7f844a000640 1 -- 172.21.15.42:0/948642122 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c038040 con 0x7f84541f9560 2024-09-17T01:37:35.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.625+0000 7f8453200640 1 -- 172.21.15.42:0/948642122 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84541f59b0 con 0x7f84541f9560 2024-09-17T01:37:35.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.625+0000 7f8453200640 1 -- 172.21.15.42:0/948642122 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84541f5f70 con 0x7f84541f9560 2024-09-17T01:37:35.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.626+0000 7f8453200640 1 -- 172.21.15.42:0/948642122 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84540cc750 con 0x7f84541f9560 2024-09-17T01:37:35.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.628+0000 7f844a000640 1 -- 172.21.15.42:0/948642122 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f843c02b8a0 con 0x7f84541f9560 2024-09-17T01:37:35.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.629+0000 7f844a000640 1 --2- 172.21.15.42:0/948642122 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8430078b90 0x7f843007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:35.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.629+0000 7f844a000640 1 -- 172.21.15.42:0/948642122 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5795+0+0 (secure 0 0 0) 0x7f843c0bb320 con 0x7f84541f9560 2024-09-17T01:37:35.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.630+0000 7f8451e00640 1 --2- 172.21.15.42:0/948642122 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8430078b90 0x7f843007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:35.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.630+0000 7f8451e00640 1 --2- 172.21.15.42:0/948642122 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8430078b90 0x7f843007b0a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8444006fd0 tx=0x7f8444006b10 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:35.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.634+0000 7f844a000640 1 -- 172.21.15.42:0/948642122 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f84540cc750 con 0x7f84541f9560 2024-09-17T01:37:35.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.864+0000 7f8453200640 1 -- 172.21.15.42:0/948642122 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8454153860 con 0x7f84541f9560 2024-09-17T01:37:35.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.865+0000 7f844a000640 1 -- 172.21.15.42:0/948642122 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5223 (secure 0 0 0) 0x7f84540af210 con 0x7f84541f9560 2024-09-17T01:37:35.864 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:35.864 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":63,"btime":"2024-09-17T01:37:21:167278+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6119,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/1918787537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1918787537},{"type":"v1","addr":"172.21.15.43:6835","nonce":1918787537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6646,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2741360699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2741360699},{"type":"v1","addr":"172.21.15.43:6837","nonce":2741360699}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6957,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/2289144423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2289144423},{"type":"v1","addr":"172.21.15.42:6833","nonce":2289144423}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:37:00.371835+0000","modified":"2024-09-17T01:37:21.167272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6978},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6978":{"gid":6978,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6835/457794069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":457794069},{"type":"v1","addr":"172.21.15.42:6835","nonce":457794069}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6978,"qdb_cluster":[6978]},"id":5}]} 2024-09-17T01:37:35.864 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 63 2024-09-17T01:37:35.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.867+0000 7f8453200640 1 -- 172.21.15.42:0/948642122 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8430078b90 msgr2=0x7f843007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:35.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.867+0000 7f8453200640 1 --2- 172.21.15.42:0/948642122 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8430078b90 0x7f843007b0a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8444006fd0 tx=0x7f8444006b10 comp rx=0 tx=0).stop 2024-09-17T01:37:35.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.867+0000 7f8453200640 1 -- 172.21.15.42:0/948642122 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84541f9560 msgr2=0x7f84541f9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:35.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.867+0000 7f8453200640 1 --2- 172.21.15.42:0/948642122 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84541f9560 0x7f84541f9970 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f843c009a70 tx=0x7f843c033670 comp rx=0 tx=0).stop 2024-09-17T01:37:35.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.867+0000 7f8453200640 1 -- 172.21.15.42:0/948642122 shutdown_connections 2024-09-17T01:37:35.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.867+0000 7f8453200640 1 --2- 172.21.15.42:0/948642122 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8430078b90 0x7f843007b0a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:35.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.867+0000 7f8453200640 1 --2- 172.21.15.42:0/948642122 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f84540ae8c0 0x7f84540aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:35.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.867+0000 7f8453200640 1 --2- 172.21.15.42:0/948642122 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84541f9560 0x7f84541f9970 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:35.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.867+0000 7f8453200640 1 --2- 172.21.15.42:0/948642122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8438004800 0x7f84540cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:35.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.867+0000 7f8453200640 1 -- 172.21.15.42:0/948642122 >> 172.21.15.42:0/948642122 conn(0x7f84540b25f0 msgr2=0x7f84540ad080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:35.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.867+0000 7f8453200640 1 -- 172.21.15.42:0/948642122 shutdown_connections 2024-09-17T01:37:35.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:35.867+0000 7f8453200640 1 -- 172.21.15.42:0/948642122 wait complete. 2024-09-17T01:37:35.889 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:37:36.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.118+0000 7f0ac7200640 1 -- 172.21.15.42:0/424938824 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ac8070730 msgr2=0x7f0ac8070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:36.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.118+0000 7f0ac7200640 1 --2- 172.21.15.42:0/424938824 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ac8070730 0x7f0ac8070b40 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8074510 tx=0x7f0ac002aa30 comp rx=0 tx=0).stop 2024-09-17T01:37:36.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.118+0000 7f0ac7200640 1 -- 172.21.15.42:0/424938824 shutdown_connections 2024-09-17T01:37:36.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.118+0000 7f0ac7200640 1 --2- 172.21.15.42:0/424938824 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ac8070730 0x7f0ac8070b40 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:36.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.118+0000 7f0ac7200640 1 --2- 172.21.15.42:0/424938824 >> v2:172.21.15.43:3300/0 conn(0x7f0ac80d0d30 0x7f0ac80b76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:36.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.118+0000 7f0ac7200640 1 -- 172.21.15.42:0/424938824 >> 172.21.15.42:0/424938824 conn(0x7f0ac80b3ed0 msgr2=0x7f0ac80b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:36.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.118+0000 7f0ac7200640 1 -- 172.21.15.42:0/424938824 shutdown_connections 2024-09-17T01:37:36.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.118+0000 7f0ac7200640 1 -- 172.21.15.42:0/424938824 wait complete. 2024-09-17T01:37:36.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.120+0000 7f0ac7200640 1 Processor -- start 2024-09-17T01:37:36.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.120+0000 7f0ac7200640 1 -- start start 2024-09-17T01:37:36.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.122+0000 7f0ac7200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0ac8070730 0x7f0ac81584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:36.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.122+0000 7f0ac7200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ac80ce930 0x7f0ac806d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:36.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.122+0000 7f0ac7200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ac80d0d30 0x7f0ac806de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:36.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.122+0000 7f0ac7200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac8071200 con 0x7f0ac80d0d30 2024-09-17T01:37:36.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.122+0000 7f0ac7200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac8071080 con 0x7f0ac80ce930 2024-09-17T01:37:36.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.122+0000 7f0ac7200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0ac8071380 con 0x7f0ac8070730 2024-09-17T01:37:36.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.122+0000 7f0ac6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ac80d0d30 0x7f0ac806de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:36.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.122+0000 7f0ac6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ac80d0d30 0x7f0ac806de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50098/0 (socket says 172.21.15.42:50098) 2024-09-17T01:37:36.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.122+0000 7f0ac6800640 1 -- 172.21.15.42:0/523281450 learned_addr learned my addr 172.21.15.42:0/523281450 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:36.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.122+0000 7f0ac5e00640 1 --2- 172.21.15.42:0/523281450 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0ac8070730 0x7f0ac81584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:36.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.122+0000 7f0abfe00640 1 --2- 172.21.15.42:0/523281450 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ac80ce930 0x7f0ac806d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:36.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.122+0000 7f0ac6800640 1 -- 172.21.15.42:0/523281450 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0ac8070730 msgr2=0x7f0ac81584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:36.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.122+0000 7f0ac6800640 1 --2- 172.21.15.42:0/523281450 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0ac8070730 0x7f0ac81584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:36.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.122+0000 7f0ac6800640 1 -- 172.21.15.42:0/523281450 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ac80ce930 msgr2=0x7f0ac806d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:36.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.122+0000 7f0ac6800640 1 --2- 172.21.15.42:0/523281450 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ac80ce930 0x7f0ac806d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:36.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.123+0000 7f0ac6800640 1 -- 172.21.15.42:0/523281450 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac809f9c0 con 0x7f0ac80d0d30 2024-09-17T01:37:36.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.123+0000 7f0ac5e00640 1 --2- 172.21.15.42:0/523281450 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0ac8070730 0x7f0ac81584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:36.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.123+0000 7f0ac6800640 1 --2- 172.21.15.42:0/523281450 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ac80d0d30 0x7f0ac806de10 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0005fd0 tx=0x7f0ac0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:36.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.123+0000 7f0abe000640 1 -- 172.21.15.42:0/523281450 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0033050 con 0x7f0ac80d0d30 2024-09-17T01:37:36.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.123+0000 7f0abe000640 1 -- 172.21.15.42:0/523281450 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ac0004450 con 0x7f0ac80d0d30 2024-09-17T01:37:36.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.123+0000 7f0abe000640 1 -- 172.21.15.42:0/523281450 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0004840 con 0x7f0ac80d0d30 2024-09-17T01:37:36.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.123+0000 7f0ac7200640 1 -- 172.21.15.42:0/523281450 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ac809fca0 con 0x7f0ac80d0d30 2024-09-17T01:37:36.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.123+0000 7f0ac7200640 1 -- 172.21.15.42:0/523281450 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ac80bd030 con 0x7f0ac80d0d30 2024-09-17T01:37:36.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.124+0000 7f0ac7200640 1 -- 172.21.15.42:0/523281450 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ac80b3c60 con 0x7f0ac80d0d30 2024-09-17T01:37:36.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.126+0000 7f0abe000640 1 -- 172.21.15.42:0/523281450 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0ac0036070 con 0x7f0ac80d0d30 2024-09-17T01:37:36.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.127+0000 7f0abe000640 1 --2- 172.21.15.42:0/523281450 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0aa4078b90 0x7f0aa407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:36.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.127+0000 7f0abe000640 1 -- 172.21.15.42:0/523281450 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5795+0+0 (secure 0 0 0) 0x7f0ac00bc270 con 0x7f0ac80d0d30 2024-09-17T01:37:36.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.127+0000 7f0ac5e00640 1 --2- 172.21.15.42:0/523281450 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0aa4078b90 0x7f0aa407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:36.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.128+0000 7f0ac5e00640 1 --2- 172.21.15.42:0/523281450 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0aa4078b90 0x7f0aa407b0a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8005fd0 tx=0x7f0ab800f360 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:36.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.131+0000 7f0abe000640 1 -- 172.21.15.42:0/523281450 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0ac0084640 con 0x7f0ac80d0d30 2024-09-17T01:37:36.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.368+0000 7f0ac7200640 1 -- 172.21.15.42:0/523281450 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ac80bcb00 con 0x7f0ac80d0d30 2024-09-17T01:37:36.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.368+0000 7f0abe000640 1 -- 172.21.15.42:0/523281450 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5223 (secure 0 0 0) 0x7f0ac0083f40 con 0x7f0ac80d0d30 2024-09-17T01:37:36.367 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:36.367 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":63,"btime":"2024-09-17T01:37:21:167278+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6119,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/1918787537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1918787537},{"type":"v1","addr":"172.21.15.43:6835","nonce":1918787537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6646,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2741360699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2741360699},{"type":"v1","addr":"172.21.15.43:6837","nonce":2741360699}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6957,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/2289144423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2289144423},{"type":"v1","addr":"172.21.15.42:6833","nonce":2289144423}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:37:00.371835+0000","modified":"2024-09-17T01:37:21.167272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6978},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6978":{"gid":6978,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6835/457794069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":457794069},{"type":"v1","addr":"172.21.15.42:6835","nonce":457794069}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6978,"qdb_cluster":[6978]},"id":5}]} 2024-09-17T01:37:36.368 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 63 2024-09-17T01:37:36.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.371+0000 7f0ac7200640 1 -- 172.21.15.42:0/523281450 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0aa4078b90 msgr2=0x7f0aa407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:36.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.371+0000 7f0ac7200640 1 --2- 172.21.15.42:0/523281450 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0aa4078b90 0x7f0aa407b0a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8005fd0 tx=0x7f0ab800f360 comp rx=0 tx=0).stop 2024-09-17T01:37:36.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.371+0000 7f0ac7200640 1 -- 172.21.15.42:0/523281450 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ac80d0d30 msgr2=0x7f0ac806de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:36.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.371+0000 7f0ac7200640 1 --2- 172.21.15.42:0/523281450 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ac80d0d30 0x7f0ac806de10 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0005fd0 tx=0x7f0ac0003f10 comp rx=0 tx=0).stop 2024-09-17T01:37:36.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.371+0000 7f0ac7200640 1 -- 172.21.15.42:0/523281450 shutdown_connections 2024-09-17T01:37:36.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.371+0000 7f0ac7200640 1 --2- 172.21.15.42:0/523281450 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0aa4078b90 0x7f0aa407b0a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:36.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.371+0000 7f0ac7200640 1 --2- 172.21.15.42:0/523281450 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ac80ce930 0x7f0ac806d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:36.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.371+0000 7f0ac7200640 1 --2- 172.21.15.42:0/523281450 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ac80d0d30 0x7f0ac806de10 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:36.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.371+0000 7f0ac7200640 1 --2- 172.21.15.42:0/523281450 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0ac8070730 0x7f0ac81584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:36.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.371+0000 7f0ac7200640 1 -- 172.21.15.42:0/523281450 >> 172.21.15.42:0/523281450 conn(0x7f0ac80b3ed0 msgr2=0x7f0ac80b71e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:36.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.371+0000 7f0ac7200640 1 -- 172.21.15.42:0/523281450 shutdown_connections 2024-09-17T01:37:36.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.371+0000 7f0ac7200640 1 -- 172.21.15.42:0/523281450 wait complete. 2024-09-17T01:37:36.397 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:37:36.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.626+0000 7fd773e00640 1 -- 172.21.15.42:0/465809244 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd76c073df0 msgr2=0x7fd76c074200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:36.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.626+0000 7fd773e00640 1 --2- 172.21.15.42:0/465809244 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd76c073df0 0x7fd76c074200 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd764005fd0 tx=0x7fd76402a820 comp rx=0 tx=0).stop 2024-09-17T01:37:36.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.626+0000 7fd773e00640 1 -- 172.21.15.42:0/465809244 shutdown_connections 2024-09-17T01:37:36.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.626+0000 7fd773e00640 1 --2- 172.21.15.42:0/465809244 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd76c073df0 0x7fd76c074200 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:36.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.626+0000 7fd773e00640 1 --2- 172.21.15.42:0/465809244 >> v2:172.21.15.43:3300/0 conn(0x7fd76c06ee90 0x7fd76c15f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:36.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.626+0000 7fd773e00640 1 -- 172.21.15.42:0/465809244 >> 172.21.15.42:0/465809244 conn(0x7fd76c0b2930 msgr2=0x7fd76c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:36.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.626+0000 7fd773e00640 1 -- 172.21.15.42:0/465809244 shutdown_connections 2024-09-17T01:37:36.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.626+0000 7fd773e00640 1 -- 172.21.15.42:0/465809244 wait complete. 2024-09-17T01:37:36.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.628+0000 7fd773e00640 1 Processor -- start 2024-09-17T01:37:36.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.628+0000 7fd773e00640 1 -- start start 2024-09-17T01:37:36.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.630+0000 7fd773e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd76c06ee90 0x7fd76c150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:36.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.630+0000 7fd773e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd76c06f2a0 0x7fd76c14d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:36.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.630+0000 7fd773e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd76c073df0 0x7fd76c1f5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:36.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.630+0000 7fd773e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c0cef40 con 0x7fd76c073df0 2024-09-17T01:37:36.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.630+0000 7fd773e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c162ae0 con 0x7fd76c06ee90 2024-09-17T01:37:36.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.630+0000 7fd773e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd76c0cf0c0 con 0x7fd76c06f2a0 2024-09-17T01:37:36.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.630+0000 7fd771e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd76c073df0 0x7fd76c1f5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:36.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.630+0000 7fd771e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd76c073df0 0x7fd76c1f5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50100/0 (socket says 172.21.15.42:50100) 2024-09-17T01:37:36.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.630+0000 7fd771e00640 1 -- 172.21.15.42:0/200997930 learned_addr learned my addr 172.21.15.42:0/200997930 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:36.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.630+0000 7fd771400640 1 --2- 172.21.15.42:0/200997930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd76c06ee90 0x7fd76c150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:36.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.630+0000 7fd770a00640 1 --2- 172.21.15.42:0/200997930 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd76c06f2a0 0x7fd76c14d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:36.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.631+0000 7fd771e00640 1 -- 172.21.15.42:0/200997930 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd76c06f2a0 msgr2=0x7fd76c14d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:36.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.631+0000 7fd771e00640 1 --2- 172.21.15.42:0/200997930 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd76c06f2a0 0x7fd76c14d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:36.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.631+0000 7fd771e00640 1 -- 172.21.15.42:0/200997930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd76c06ee90 msgr2=0x7fd76c150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:36.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.631+0000 7fd771e00640 1 --2- 172.21.15.42:0/200997930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd76c06ee90 0x7fd76c150110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:36.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.631+0000 7fd771e00640 1 -- 172.21.15.42:0/200997930 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76c150a40 con 0x7fd76c073df0 2024-09-17T01:37:36.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.631+0000 7fd771400640 1 --2- 172.21.15.42:0/200997930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd76c06ee90 0x7fd76c150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:37:36.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.631+0000 7fd771e00640 1 --2- 172.21.15.42:0/200997930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd76c073df0 0x7fd76c1f5c50 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fd764006010 tx=0x7fd764032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:36.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.631+0000 7fd769600640 1 -- 172.21.15.42:0/200997930 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd764037040 con 0x7fd76c073df0 2024-09-17T01:37:36.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.632+0000 7fd769600640 1 -- 172.21.15.42:0/200997930 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd764042070 con 0x7fd76c073df0 2024-09-17T01:37:36.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.632+0000 7fd769600640 1 -- 172.21.15.42:0/200997930 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7640042a0 con 0x7fd76c073df0 2024-09-17T01:37:36.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.632+0000 7fd773e00640 1 -- 172.21.15.42:0/200997930 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd76c150d20 con 0x7fd76c073df0 2024-09-17T01:37:36.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.632+0000 7fd773e00640 1 -- 172.21.15.42:0/200997930 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd76c0c5950 con 0x7fd76c073df0 2024-09-17T01:37:36.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.633+0000 7fd773e00640 1 -- 172.21.15.42:0/200997930 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd76c1507b0 con 0x7fd76c073df0 2024-09-17T01:37:36.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.634+0000 7fd769600640 1 -- 172.21.15.42:0/200997930 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd764004440 con 0x7fd76c073df0 2024-09-17T01:37:36.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.635+0000 7fd769600640 1 --2- 172.21.15.42:0/200997930 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd74c078bc0 0x7fd74c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:36.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.635+0000 7fd769600640 1 -- 172.21.15.42:0/200997930 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5795+0+0 (secure 0 0 0) 0x7fd7640bba30 con 0x7fd76c073df0 2024-09-17T01:37:36.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.635+0000 7fd771400640 1 --2- 172.21.15.42:0/200997930 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd74c078bc0 0x7fd74c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:36.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.636+0000 7fd771400640 1 --2- 172.21.15.42:0/200997930 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd74c078bc0 0x7fd74c07b0d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd7600097a0 tx=0x7fd760009260 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:36.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.639+0000 7fd769600640 1 -- 172.21.15.42:0/200997930 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd7640837b0 con 0x7fd76c073df0 2024-09-17T01:37:36.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.835+0000 7fd773e00640 1 -- 172.21.15.42:0/200997930 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd76c15f200 con 0x7fd76c073df0 2024-09-17T01:37:36.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.837+0000 7fd769600640 1 -- 172.21.15.42:0/200997930 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+16749 (secure 0 0 0) 0x7fd7640881e0 con 0x7fd76c073df0 2024-09-17T01:37:36.836 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:36.836 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":82,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:37:17.150659+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:36:58.306928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T01:36:59.336540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6835/3707410924":"2024-09-18T01:37:17.150634+0000","172.21.15.42:6833/3707410924":"2024-09-18T01:37:17.150634+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:37:36.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.839+0000 7fd773e00640 1 -- 172.21.15.42:0/200997930 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd74c078bc0 msgr2=0x7fd74c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:36.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.839+0000 7fd773e00640 1 --2- 172.21.15.42:0/200997930 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd74c078bc0 0x7fd74c07b0d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd7600097a0 tx=0x7fd760009260 comp rx=0 tx=0).stop 2024-09-17T01:37:36.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.839+0000 7fd773e00640 1 -- 172.21.15.42:0/200997930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd76c073df0 msgr2=0x7fd76c1f5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:36.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.839+0000 7fd773e00640 1 --2- 172.21.15.42:0/200997930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd76c073df0 0x7fd76c1f5c50 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fd764006010 tx=0x7fd764032c90 comp rx=0 tx=0).stop 2024-09-17T01:37:36.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.839+0000 7fd773e00640 1 -- 172.21.15.42:0/200997930 shutdown_connections 2024-09-17T01:37:36.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.839+0000 7fd773e00640 1 --2- 172.21.15.42:0/200997930 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd74c078bc0 0x7fd74c07b0d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:36.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.839+0000 7fd773e00640 1 --2- 172.21.15.42:0/200997930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd76c073df0 0x7fd76c1f5c50 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:36.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.839+0000 7fd773e00640 1 --2- 172.21.15.42:0/200997930 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd76c06f2a0 0x7fd76c14d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:36.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.839+0000 7fd773e00640 1 --2- 172.21.15.42:0/200997930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd76c06ee90 0x7fd76c150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:36.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.839+0000 7fd773e00640 1 -- 172.21.15.42:0/200997930 >> 172.21.15.42:0/200997930 conn(0x7fd76c0b2930 msgr2=0x7fd76c06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:36.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.839+0000 7fd773e00640 1 -- 172.21.15.42:0/200997930 shutdown_connections 2024-09-17T01:37:36.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:36.839+0000 7fd773e00640 1 -- 172.21.15.42:0/200997930 wait complete. 2024-09-17T01:37:36.860 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T01:37:36.861 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:37:37.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.089+0000 7fa437e00640 1 -- 172.21.15.42:0/1872743677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4380cf280 msgr2=0x7fa438070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:37.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.089+0000 7fa437e00640 1 --2- 172.21.15.42:0/1872743677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4380cf280 0x7fa438070730 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fa438072e00 tx=0x7fa43002a820 comp rx=0 tx=0).stop 2024-09-17T01:37:37.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.089+0000 7fa437e00640 1 -- 172.21.15.42:0/1872743677 shutdown_connections 2024-09-17T01:37:37.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.089+0000 7fa437e00640 1 --2- 172.21.15.42:0/1872743677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4380cf280 0x7fa438070730 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:37.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.089+0000 7fa437e00640 1 --2- 172.21.15.42:0/1872743677 >> v2:172.21.15.43:3300/0 conn(0x7fa4380ce930 0x7fa4380ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:37.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.089+0000 7fa437e00640 1 -- 172.21.15.42:0/1872743677 >> 172.21.15.42:0/1872743677 conn(0x7fa4380b3ed0 msgr2=0x7fa4380b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:37.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.089+0000 7fa437e00640 1 -- 172.21.15.42:0/1872743677 shutdown_connections 2024-09-17T01:37:37.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.089+0000 7fa437e00640 1 -- 172.21.15.42:0/1872743677 wait complete. 2024-09-17T01:37:37.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.091+0000 7fa437e00640 1 Processor -- start 2024-09-17T01:37:37.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.091+0000 7fa437e00640 1 -- start start 2024-09-17T01:37:37.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.093+0000 7fa437e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4380ce930 0x7fa4381f5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:37.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.093+0000 7fa437e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4380d0d30 0x7fa4381f6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:37.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.093+0000 7fa437e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa4381f6a60 0x7fa4381585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:37.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.093+0000 7fa437e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa438071200 con 0x7fa4380ce930 2024-09-17T01:37:37.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.093+0000 7fa437e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa438071080 con 0x7fa4380d0d30 2024-09-17T01:37:37.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.093+0000 7fa437e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa438071380 con 0x7fa4381f6a60 2024-09-17T01:37:37.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.093+0000 7fa436a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4380ce930 0x7fa4381f5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:37.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.093+0000 7fa436a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4380ce930 0x7fa4381f5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50118/0 (socket says 172.21.15.42:50118) 2024-09-17T01:37:37.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.093+0000 7fa436a00640 1 -- 172.21.15.42:0/1964226642 learned_addr learned my addr 172.21.15.42:0/1964226642 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:37.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.094+0000 7fa42e000640 1 --2- 172.21.15.42:0/1964226642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4380d0d30 0x7fa4381f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:37.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.094+0000 7fa436a00640 1 -- 172.21.15.42:0/1964226642 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa4381f6a60 msgr2=0x7fa4381585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:37.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.094+0000 7fa436a00640 1 --2- 172.21.15.42:0/1964226642 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa4381f6a60 0x7fa4381585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:37.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.094+0000 7fa436a00640 1 -- 172.21.15.42:0/1964226642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4380d0d30 msgr2=0x7fa4381f6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:37.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.094+0000 7fa436a00640 1 --2- 172.21.15.42:0/1964226642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4380d0d30 0x7fa4381f6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:37.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.094+0000 7fa436a00640 1 -- 172.21.15.42:0/1964226642 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4381f4060 con 0x7fa4380ce930 2024-09-17T01:37:37.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.094+0000 7fa42e000640 1 --2- 172.21.15.42:0/1964226642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4380d0d30 0x7fa4381f6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:37:37.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.094+0000 7fa436a00640 1 --2- 172.21.15.42:0/1964226642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4380ce930 0x7fa4381f5e30 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fa42800c3e0 tx=0x7fa42800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:37.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.094+0000 7fa42fe00640 1 -- 172.21.15.42:0/1964226642 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa428011790 con 0x7fa4380ce930 2024-09-17T01:37:37.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.094+0000 7fa42fe00640 1 -- 172.21.15.42:0/1964226642 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa428017070 con 0x7fa4380ce930 2024-09-17T01:37:37.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.094+0000 7fa42fe00640 1 -- 172.21.15.42:0/1964226642 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa428011ce0 con 0x7fa4380ce930 2024-09-17T01:37:37.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.094+0000 7fa437e00640 1 -- 172.21.15.42:0/1964226642 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4381f7250 con 0x7fa4380ce930 2024-09-17T01:37:37.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.094+0000 7fa437e00640 1 -- 172.21.15.42:0/1964226642 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa43815aa80 con 0x7fa4380ce930 2024-09-17T01:37:37.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.095+0000 7fa437e00640 1 -- 172.21.15.42:0/1964226642 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4380718a0 con 0x7fa4380ce930 2024-09-17T01:37:37.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.097+0000 7fa42fe00640 1 -- 172.21.15.42:0/1964226642 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa42801c460 con 0x7fa4380ce930 2024-09-17T01:37:37.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.098+0000 7fa42fe00640 1 --2- 172.21.15.42:0/1964226642 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa414078b90 0x7fa41407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:37.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.098+0000 7fa42fe00640 1 -- 172.21.15.42:0/1964226642 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5795+0+0 (secure 0 0 0) 0x7fa42809aa80 con 0x7fa4380ce930 2024-09-17T01:37:37.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.098+0000 7fa42e000640 1 --2- 172.21.15.42:0/1964226642 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa414078b90 0x7fa41407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:37.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.099+0000 7fa42e000640 1 --2- 172.21.15.42:0/1964226642 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa414078b90 0x7fa41407b0a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa4380b3760 tx=0x7fa420005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:37.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.102+0000 7fa42fe00640 1 -- 172.21.15.42:0/1964226642 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa428063040 con 0x7fa4380ce930 2024-09-17T01:37:37.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.334+0000 7fa437e00640 1 -- 172.21.15.42:0/1964226642 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4380b31d0 con 0x7fa4380ce930 2024-09-17T01:37:37.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.335+0000 7fa42fe00640 1 -- 172.21.15.42:0/1964226642 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5223 (secure 0 0 0) 0x7fa428062940 con 0x7fa4380ce930 2024-09-17T01:37:37.334 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:37.334 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":63,"btime":"2024-09-17T01:37:21:167278+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6119,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/1918787537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1918787537},{"type":"v1","addr":"172.21.15.43:6835","nonce":1918787537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6646,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2741360699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2741360699},{"type":"v1","addr":"172.21.15.43:6837","nonce":2741360699}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6957,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/2289144423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2289144423},{"type":"v1","addr":"172.21.15.42:6833","nonce":2289144423}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:37:00.371835+0000","modified":"2024-09-17T01:37:21.167272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6978},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6978":{"gid":6978,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6835/457794069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":457794069},{"type":"v1","addr":"172.21.15.42:6835","nonce":457794069}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6978,"qdb_cluster":[6978]},"id":5}]} 2024-09-17T01:37:37.334 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 63 2024-09-17T01:37:37.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.338+0000 7fa437e00640 1 -- 172.21.15.42:0/1964226642 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa414078b90 msgr2=0x7fa41407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:37.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.338+0000 7fa437e00640 1 --2- 172.21.15.42:0/1964226642 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa414078b90 0x7fa41407b0a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa4380b3760 tx=0x7fa420005f90 comp rx=0 tx=0).stop 2024-09-17T01:37:37.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.338+0000 7fa437e00640 1 -- 172.21.15.42:0/1964226642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4380ce930 msgr2=0x7fa4381f5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:37.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.338+0000 7fa437e00640 1 --2- 172.21.15.42:0/1964226642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4380ce930 0x7fa4381f5e30 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fa42800c3e0 tx=0x7fa42800c8a0 comp rx=0 tx=0).stop 2024-09-17T01:37:37.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.338+0000 7fa437e00640 1 -- 172.21.15.42:0/1964226642 shutdown_connections 2024-09-17T01:37:37.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.338+0000 7fa437e00640 1 --2- 172.21.15.42:0/1964226642 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa414078b90 0x7fa41407b0a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:37.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.338+0000 7fa437e00640 1 --2- 172.21.15.42:0/1964226642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4380d0d30 0x7fa4381f6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:37.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.338+0000 7fa437e00640 1 --2- 172.21.15.42:0/1964226642 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa4381f6a60 0x7fa4381585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:37.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.338+0000 7fa437e00640 1 --2- 172.21.15.42:0/1964226642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4380ce930 0x7fa4381f5e30 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:37.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.338+0000 7fa437e00640 1 -- 172.21.15.42:0/1964226642 >> 172.21.15.42:0/1964226642 conn(0x7fa4380b3ed0 msgr2=0x7fa438156580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:37.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.338+0000 7fa437e00640 1 -- 172.21.15.42:0/1964226642 shutdown_connections 2024-09-17T01:37:37.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.338+0000 7fa437e00640 1 -- 172.21.15.42:0/1964226642 wait complete. 2024-09-17T01:37:37.362 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:37:37.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.591+0000 7fd305c00640 1 -- 172.21.15.42:0/2569652268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd30006ee90 msgr2=0x7fd30015f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:37.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.591+0000 7fd305c00640 1 --2- 172.21.15.42:0/2569652268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd30006ee90 0x7fd30015f200 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fd300072240 tx=0x7fd2f002a560 comp rx=0 tx=0).stop 2024-09-17T01:37:37.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.591+0000 7fd305c00640 1 -- 172.21.15.42:0/2569652268 shutdown_connections 2024-09-17T01:37:37.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.591+0000 7fd305c00640 1 --2- 172.21.15.42:0/2569652268 >> v2:172.21.15.43:3300/0 conn(0x7fd30006f2a0 0x7fd30006d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:37.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.591+0000 7fd305c00640 1 --2- 172.21.15.42:0/2569652268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd30006ee90 0x7fd30015f200 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:37.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.591+0000 7fd305c00640 1 -- 172.21.15.42:0/2569652268 >> 172.21.15.42:0/2569652268 conn(0x7fd3000b2930 msgr2=0x7fd30006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:37.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.591+0000 7fd305c00640 1 -- 172.21.15.42:0/2569652268 shutdown_connections 2024-09-17T01:37:37.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.591+0000 7fd305c00640 1 -- 172.21.15.42:0/2569652268 wait complete. 2024-09-17T01:37:37.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.594+0000 7fd305c00640 1 Processor -- start 2024-09-17T01:37:37.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.594+0000 7fd305c00640 1 -- start start 2024-09-17T01:37:37.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.595+0000 7fd305c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd30006db50 0x7fd3001e96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:37.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.595+0000 7fd305c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd30006ee90 0x7fd3001455b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:37.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.595+0000 7fd305c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd30006f2a0 0x7fd3000b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:37.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.595+0000 7fd305c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd3000cef40 con 0x7fd30006ee90 2024-09-17T01:37:37.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.595+0000 7fd305c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd300074750 con 0x7fd30006db50 2024-09-17T01:37:37.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.595+0000 7fd305c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd3000cf0c0 con 0x7fd30006f2a0 2024-09-17T01:37:37.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.595+0000 7fd2f7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd30006ee90 0x7fd3001455b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:37.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.595+0000 7fd2f7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd30006ee90 0x7fd3001455b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50144/0 (socket says 172.21.15.42:50144) 2024-09-17T01:37:37.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.595+0000 7fd2f7e00640 1 -- 172.21.15.42:0/2652685770 learned_addr learned my addr 172.21.15.42:0/2652685770 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:37.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.596+0000 7fd2fea00640 1 --2- 172.21.15.42:0/2652685770 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd30006db50 0x7fd3001e96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:37.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.596+0000 7fd2ff400640 1 --2- 172.21.15.42:0/2652685770 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd30006f2a0 0x7fd3000b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:37.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.596+0000 7fd2f7e00640 1 -- 172.21.15.42:0/2652685770 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd30006f2a0 msgr2=0x7fd3000b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:37.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.596+0000 7fd2f7e00640 1 --2- 172.21.15.42:0/2652685770 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd30006f2a0 0x7fd3000b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:37.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.596+0000 7fd2f7e00640 1 -- 172.21.15.42:0/2652685770 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd30006db50 msgr2=0x7fd3001e96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:37.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.596+0000 7fd2f7e00640 1 --2- 172.21.15.42:0/2652685770 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd30006db50 0x7fd3001e96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:37.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.596+0000 7fd2f7e00640 1 -- 172.21.15.42:0/2652685770 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd300142cb0 con 0x7fd30006ee90 2024-09-17T01:37:37.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.596+0000 7fd2ff400640 1 --2- 172.21.15.42:0/2652685770 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd30006f2a0 0x7fd3000b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:37.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.596+0000 7fd2f7e00640 1 --2- 172.21.15.42:0/2652685770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd30006ee90 0x7fd3001455b0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fd2e800d780 tx=0x7fd2e800dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:37.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.596+0000 7fd2f6a00640 1 -- 172.21.15.42:0/2652685770 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8017070 con 0x7fd30006ee90 2024-09-17T01:37:37.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.596+0000 7fd2f6a00640 1 -- 172.21.15.42:0/2652685770 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2e800de90 con 0x7fd30006ee90 2024-09-17T01:37:37.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.596+0000 7fd2f6a00640 1 -- 172.21.15.42:0/2652685770 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e80099d0 con 0x7fd30006ee90 2024-09-17T01:37:37.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.597+0000 7fd305c00640 1 -- 172.21.15.42:0/2652685770 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd300142f90 con 0x7fd30006ee90 2024-09-17T01:37:37.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.597+0000 7fd305c00640 1 -- 172.21.15.42:0/2652685770 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd300143550 con 0x7fd30006ee90 2024-09-17T01:37:37.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.598+0000 7fd305c00640 1 -- 172.21.15.42:0/2652685770 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd30015f200 con 0x7fd30006ee90 2024-09-17T01:37:37.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.599+0000 7fd2f6a00640 1 -- 172.21.15.42:0/2652685770 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd2e8009b70 con 0x7fd30006ee90 2024-09-17T01:37:37.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.600+0000 7fd2f6a00640 1 --2- 172.21.15.42:0/2652685770 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd2dc078b90 0x7fd2dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:37.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.600+0000 7fd2f6a00640 1 -- 172.21.15.42:0/2652685770 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5795+0+0 (secure 0 0 0) 0x7fd2e809b1d0 con 0x7fd30006ee90 2024-09-17T01:37:37.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.600+0000 7fd2fea00640 1 --2- 172.21.15.42:0/2652685770 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd2dc078b90 0x7fd2dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:37.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.601+0000 7fd2fea00640 1 --2- 172.21.15.42:0/2652685770 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd2dc078b90 0x7fd2dc07b0a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0033000 tx=0x7fd2f0004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:37.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.604+0000 7fd2f6a00640 1 -- 172.21.15.42:0/2652685770 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd2e8020020 con 0x7fd30006ee90 2024-09-17T01:37:37.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.834+0000 7fd305c00640 1 -- 172.21.15.42:0/2652685770 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd30006a170 con 0x7fd30006ee90 2024-09-17T01:37:37.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.835+0000 7fd2f6a00640 1 -- 172.21.15.42:0/2652685770 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5223 (secure 0 0 0) 0x7fd2e8063510 con 0x7fd30006ee90 2024-09-17T01:37:37.834 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:37.834 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":63,"btime":"2024-09-17T01:37:21:167278+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6119,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/1918787537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1918787537},{"type":"v1","addr":"172.21.15.43:6835","nonce":1918787537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6646,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2741360699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2741360699},{"type":"v1","addr":"172.21.15.43:6837","nonce":2741360699}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6957,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/2289144423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2289144423},{"type":"v1","addr":"172.21.15.42:6833","nonce":2289144423}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:37:00.371835+0000","modified":"2024-09-17T01:37:21.167272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6978},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6978":{"gid":6978,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6835/457794069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":457794069},{"type":"v1","addr":"172.21.15.42:6835","nonce":457794069}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6978,"qdb_cluster":[6978]},"id":5}]} 2024-09-17T01:37:37.834 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 63 2024-09-17T01:37:37.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.837+0000 7fd305c00640 1 -- 172.21.15.42:0/2652685770 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd2dc078b90 msgr2=0x7fd2dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:37.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.837+0000 7fd305c00640 1 --2- 172.21.15.42:0/2652685770 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd2dc078b90 0x7fd2dc07b0a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0033000 tx=0x7fd2f0004730 comp rx=0 tx=0).stop 2024-09-17T01:37:37.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.838+0000 7fd305c00640 1 -- 172.21.15.42:0/2652685770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd30006ee90 msgr2=0x7fd3001455b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:37.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.838+0000 7fd305c00640 1 --2- 172.21.15.42:0/2652685770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd30006ee90 0x7fd3001455b0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fd2e800d780 tx=0x7fd2e800dc40 comp rx=0 tx=0).stop 2024-09-17T01:37:37.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.838+0000 7fd305c00640 1 -- 172.21.15.42:0/2652685770 shutdown_connections 2024-09-17T01:37:37.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.838+0000 7fd305c00640 1 --2- 172.21.15.42:0/2652685770 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd2dc078b90 0x7fd2dc07b0a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:37.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.838+0000 7fd305c00640 1 --2- 172.21.15.42:0/2652685770 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd30006f2a0 0x7fd3000b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:37.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.838+0000 7fd305c00640 1 --2- 172.21.15.42:0/2652685770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd30006ee90 0x7fd3001455b0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:37.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.838+0000 7fd305c00640 1 --2- 172.21.15.42:0/2652685770 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd30006db50 0x7fd3001e96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:37.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.838+0000 7fd305c00640 1 -- 172.21.15.42:0/2652685770 >> 172.21.15.42:0/2652685770 conn(0x7fd3000b2930 msgr2=0x7fd3001615d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:37.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.838+0000 7fd305c00640 1 -- 172.21.15.42:0/2652685770 shutdown_connections 2024-09-17T01:37:37.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:37.838+0000 7fd305c00640 1 -- 172.21.15.42:0/2652685770 wait complete. 2024-09-17T01:37:37.859 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:37:38.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.087+0000 7f031f200640 1 -- 172.21.15.42:0/170826592 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0318142f40 msgr2=0x7f0318072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:38.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.087+0000 7f031f200640 1 --2- 172.21.15.42:0/170826592 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0318142f40 0x7f0318072950 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f0300005fd0 tx=0x7f030002a5f0 comp rx=0 tx=0).stop 2024-09-17T01:37:38.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.087+0000 7f031f200640 1 -- 172.21.15.42:0/170826592 shutdown_connections 2024-09-17T01:37:38.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.087+0000 7f031f200640 1 --2- 172.21.15.42:0/170826592 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0318142f40 0x7f0318072950 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:38.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.087+0000 7f031f200640 1 -- 172.21.15.42:0/170826592 >> 172.21.15.42:0/170826592 conn(0x7f03180b2930 msgr2=0x7f031806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:38.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.088+0000 7f031f200640 1 -- 172.21.15.42:0/170826592 shutdown_connections 2024-09-17T01:37:38.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.088+0000 7f031f200640 1 -- 172.21.15.42:0/170826592 wait complete. 2024-09-17T01:37:38.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.090+0000 7f031f200640 1 Processor -- start 2024-09-17T01:37:38.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.090+0000 7f031f200640 1 -- start start 2024-09-17T01:37:38.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.091+0000 7f031f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0318072e90 0x7f031813e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:38.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.091+0000 7f031f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f03180b3550 0x7f031813e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:38.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.091+0000 7f031f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0318142f40 0x7f03181f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:38.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.091+0000 7f031f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f031806d900 con 0x7f0318072e90 2024-09-17T01:37:38.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.091+0000 7f031f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f031806d780 con 0x7f0318142f40 2024-09-17T01:37:38.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.091+0000 7f031f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f031806da80 con 0x7f03180b3550 2024-09-17T01:37:38.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.092+0000 7f0317e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0318072e90 0x7f031813e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:38.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.092+0000 7f0317e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0318072e90 0x7f031813e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50152/0 (socket says 172.21.15.42:50152) 2024-09-17T01:37:38.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.092+0000 7f0317e00640 1 -- 172.21.15.42:0/1189722166 learned_addr learned my addr 172.21.15.42:0/1189722166 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:38.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.092+0000 7f030f400640 1 --2- 172.21.15.42:0/1189722166 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f03180b3550 0x7f031813e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:38.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.092+0000 7f031d200640 1 --2- 172.21.15.42:0/1189722166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0318142f40 0x7f03181f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:38.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.092+0000 7f0317e00640 1 -- 172.21.15.42:0/1189722166 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f03180b3550 msgr2=0x7f031813e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:38.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.092+0000 7f0317e00640 1 --2- 172.21.15.42:0/1189722166 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f03180b3550 0x7f031813e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:38.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.092+0000 7f0317e00640 1 -- 172.21.15.42:0/1189722166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0318142f40 msgr2=0x7f03181f5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:38.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.092+0000 7f0317e00640 1 --2- 172.21.15.42:0/1189722166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0318142f40 0x7f03181f5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:38.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.092+0000 7f0317e00640 1 -- 172.21.15.42:0/1189722166 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031815a480 con 0x7f0318072e90 2024-09-17T01:37:38.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.092+0000 7f030f400640 1 --2- 172.21.15.42:0/1189722166 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f03180b3550 0x7f031813e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:38.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.092+0000 7f031d200640 1 --2- 172.21.15.42:0/1189722166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0318142f40 0x7f03181f5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:38.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.092+0000 7f0317e00640 1 --2- 172.21.15.42:0/1189722166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0318072e90 0x7f031813e3f0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f030800c400 tx=0x7f030800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:38.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.093+0000 7f0314c00640 1 -- 172.21.15.42:0/1189722166 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0308017070 con 0x7f0318072e90 2024-09-17T01:37:38.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.093+0000 7f0314c00640 1 -- 172.21.15.42:0/1189722166 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03080053c0 con 0x7f0318072e90 2024-09-17T01:37:38.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.093+0000 7f031f200640 1 -- 172.21.15.42:0/1189722166 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03180b09d0 con 0x7f0318072e90 2024-09-17T01:37:38.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.093+0000 7f0314c00640 1 -- 172.21.15.42:0/1189722166 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0308003850 con 0x7f0318072e90 2024-09-17T01:37:38.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.093+0000 7f031f200640 1 -- 172.21.15.42:0/1189722166 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03180b0f70 con 0x7f0318072e90 2024-09-17T01:37:38.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.094+0000 7f031f200640 1 -- 172.21.15.42:0/1189722166 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f031806a170 con 0x7f0318072e90 2024-09-17T01:37:38.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.095+0000 7f0314c00640 1 -- 172.21.15.42:0/1189722166 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f030801a070 con 0x7f0318072e90 2024-09-17T01:37:38.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.097+0000 7f0314c00640 1 --2- 172.21.15.42:0/1189722166 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f02f4078b90 0x7f02f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:38.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.097+0000 7f0314c00640 1 -- 172.21.15.42:0/1189722166 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5795+0+0 (secure 0 0 0) 0x7f030809a2a0 con 0x7f0318072e90 2024-09-17T01:37:38.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.097+0000 7f030f400640 1 --2- 172.21.15.42:0/1189722166 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f02f4078b90 0x7f02f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:38.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.098+0000 7f030f400640 1 --2- 172.21.15.42:0/1189722166 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f02f4078b90 0x7f02f407b0a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0300033000 tx=0x7f0300004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:38.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.101+0000 7f0314c00640 1 -- 172.21.15.42:0/1189722166 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f03080625e0 con 0x7f0318072e90 2024-09-17T01:37:38.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.296+0000 7f031f200640 1 -- 172.21.15.42:0/1189722166 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03180cc6b0 con 0x7f0318072e90 2024-09-17T01:37:38.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.298+0000 7f0314c00640 1 -- 172.21.15.42:0/1189722166 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+16749 (secure 0 0 0) 0x7f0308061ee0 con 0x7f0318072e90 2024-09-17T01:37:38.297 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:38.297 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":82,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:37:17.150659+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:36:58.306928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T01:36:59.336540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6835/3707410924":"2024-09-18T01:37:17.150634+0000","172.21.15.42:6833/3707410924":"2024-09-18T01:37:17.150634+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:37:38.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.300+0000 7f031f200640 1 -- 172.21.15.42:0/1189722166 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f02f4078b90 msgr2=0x7f02f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:38.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.300+0000 7f031f200640 1 --2- 172.21.15.42:0/1189722166 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f02f4078b90 0x7f02f407b0a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0300033000 tx=0x7f0300004730 comp rx=0 tx=0).stop 2024-09-17T01:37:38.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.300+0000 7f031f200640 1 -- 172.21.15.42:0/1189722166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0318072e90 msgr2=0x7f031813e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:38.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.300+0000 7f031f200640 1 --2- 172.21.15.42:0/1189722166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0318072e90 0x7f031813e3f0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f030800c400 tx=0x7f030800c8c0 comp rx=0 tx=0).stop 2024-09-17T01:37:38.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.300+0000 7f031f200640 1 -- 172.21.15.42:0/1189722166 shutdown_connections 2024-09-17T01:37:38.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.300+0000 7f031f200640 1 --2- 172.21.15.42:0/1189722166 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f02f4078b90 0x7f02f407b0a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:38.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.300+0000 7f031f200640 1 --2- 172.21.15.42:0/1189722166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0318142f40 0x7f03181f5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:38.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.300+0000 7f031f200640 1 --2- 172.21.15.42:0/1189722166 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f03180b3550 0x7f031813e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:38.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.300+0000 7f031f200640 1 --2- 172.21.15.42:0/1189722166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0318072e90 0x7f031813e3f0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:38.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.300+0000 7f031f200640 1 -- 172.21.15.42:0/1189722166 >> 172.21.15.42:0/1189722166 conn(0x7f03180b2930 msgr2=0x7f0318075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:38.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.300+0000 7f031f200640 1 -- 172.21.15.42:0/1189722166 shutdown_connections 2024-09-17T01:37:38.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.300+0000 7f031f200640 1 -- 172.21.15.42:0/1189722166 wait complete. 2024-09-17T01:37:38.320 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T01:37:38.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.549+0000 7f8c47c00640 1 -- 172.21.15.42:0/2682376589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c4015f480 msgr2=0x7f8c4015f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:38.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.549+0000 7f8c47c00640 1 --2- 172.21.15.42:0/2682376589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c4015f480 0x7f8c4015f890 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f8c38005fd0 tx=0x7f8c3802aa90 comp rx=0 tx=0).stop 2024-09-17T01:37:38.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.549+0000 7f8c47c00640 1 -- 172.21.15.42:0/2682376589 shutdown_connections 2024-09-17T01:37:38.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.549+0000 7f8c47c00640 1 --2- 172.21.15.42:0/2682376589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c4015f480 0x7f8c4015f890 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:38.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.549+0000 7f8c47c00640 1 --2- 172.21.15.42:0/2682376589 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8c4006d430 0x7f8c4006d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:38.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.549+0000 7f8c47c00640 1 -- 172.21.15.42:0/2682376589 >> 172.21.15.42:0/2682376589 conn(0x7f8c400b2930 msgr2=0x7f8c4006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:38.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.549+0000 7f8c47c00640 1 -- 172.21.15.42:0/2682376589 shutdown_connections 2024-09-17T01:37:38.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.549+0000 7f8c47c00640 1 -- 172.21.15.42:0/2682376589 wait complete. 2024-09-17T01:37:38.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.551+0000 7f8c47c00640 1 Processor -- start 2024-09-17T01:37:38.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.551+0000 7f8c47c00640 1 -- start start 2024-09-17T01:37:38.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.553+0000 7f8c47c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8c4006d430 0x7f8c40145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:38.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.553+0000 7f8c47c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c4015cb80 0x7f8c401e7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.553+0000 7f8c47c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c4015f480 0x7f8c401f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.553+0000 7f8c47c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8c400737e0 con 0x7f8c4015f480 2024-09-17T01:37:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.553+0000 7f8c47c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8c40073660 con 0x7f8c4015cb80 2024-09-17T01:37:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.553+0000 7f8c47c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8c40073960 con 0x7f8c4006d430 2024-09-17T01:37:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.553+0000 7f8c45c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c4015f480 0x7f8c401f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.553+0000 7f8c45c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c4015f480 0x7f8c401f5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50160/0 (socket says 172.21.15.42:50160) 2024-09-17T01:37:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.553+0000 7f8c45c00640 1 -- 172.21.15.42:0/2676037975 learned_addr learned my addr 172.21.15.42:0/2676037975 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.553+0000 7f8c3fe00640 1 --2- 172.21.15.42:0/2676037975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c4015cb80 0x7f8c401e7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.553+0000 7f8c45200640 1 --2- 172.21.15.42:0/2676037975 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8c4006d430 0x7f8c40145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.554+0000 7f8c45c00640 1 -- 172.21.15.42:0/2676037975 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8c4006d430 msgr2=0x7f8c40145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.554+0000 7f8c45c00640 1 --2- 172.21.15.42:0/2676037975 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8c4006d430 0x7f8c40145cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.554+0000 7f8c45c00640 1 -- 172.21.15.42:0/2676037975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c4015cb80 msgr2=0x7f8c401e7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:38.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.554+0000 7f8c45c00640 1 --2- 172.21.15.42:0/2676037975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c4015cb80 0x7f8c401e7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:38.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.554+0000 7f8c45c00640 1 -- 172.21.15.42:0/2676037975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c401e7cb0 con 0x7f8c4015f480 2024-09-17T01:37:38.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.554+0000 7f8c45c00640 1 --2- 172.21.15.42:0/2676037975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c4015f480 0x7f8c401f5860 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f8c38009d90 tx=0x7f8c38003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:38.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.554+0000 7f8c3cc00640 1 -- 172.21.15.42:0/2676037975 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c38044070 con 0x7f8c4015f480 2024-09-17T01:37:38.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.554+0000 7f8c3cc00640 1 -- 172.21.15.42:0/2676037975 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c3802e7f0 con 0x7f8c4015f480 2024-09-17T01:37:38.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.554+0000 7f8c47c00640 1 -- 172.21.15.42:0/2676037975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c400b0f60 con 0x7f8c4015f480 2024-09-17T01:37:38.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.554+0000 7f8c3cc00640 1 -- 172.21.15.42:0/2676037975 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c380044b0 con 0x7f8c4015f480 2024-09-17T01:37:38.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.554+0000 7f8c47c00640 1 -- 172.21.15.42:0/2676037975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c401e6c90 con 0x7f8c4015f480 2024-09-17T01:37:38.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.556+0000 7f8c47c00640 1 -- 172.21.15.42:0/2676037975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c400b0cd0 con 0x7f8c4015f480 2024-09-17T01:37:38.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.557+0000 7f8c3cc00640 1 -- 172.21.15.42:0/2676037975 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8c38047070 con 0x7f8c4015f480 2024-09-17T01:37:38.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.558+0000 7f8c3cc00640 1 --2- 172.21.15.42:0/2676037975 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8c20078b90 0x7f8c2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:38.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.558+0000 7f8c3cc00640 1 -- 172.21.15.42:0/2676037975 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5795+0+0 (secure 0 0 0) 0x7f8c380bbd00 con 0x7f8c4015f480 2024-09-17T01:37:38.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.559+0000 7f8c45200640 1 --2- 172.21.15.42:0/2676037975 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8c20078b90 0x7f8c2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:38.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.560+0000 7f8c45200640 1 --2- 172.21.15.42:0/2676037975 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8c20078b90 0x7f8c2007b0a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8c34001720 tx=0x7f8c34009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:38.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.563+0000 7f8c3cc00640 1 -- 172.21.15.42:0/2676037975 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8c38032030 con 0x7f8c4015f480 2024-09-17T01:37:38.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.793+0000 7f8c47c00640 1 -- 172.21.15.42:0/2676037975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8c40073e80 con 0x7f8c4015f480 2024-09-17T01:37:38.792 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-17T01:37:38.794+0000 7f9961e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:37:38.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.796+0000 7f8c3cc00640 1 -- 172.21.15.42:0/2676037975 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v64) ==== 161+0+0 (secure 0 0 0) 0x7f8c380839f0 con 0x7f8c4015f480 2024-09-17T01:37:38.794 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T01:37:38.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.799+0000 7f8c47c00640 1 -- 172.21.15.42:0/2676037975 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8c20078b90 msgr2=0x7f8c2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:38.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.799+0000 7f8c47c00640 1 --2- 172.21.15.42:0/2676037975 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8c20078b90 0x7f8c2007b0a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8c34001720 tx=0x7f8c34009040 comp rx=0 tx=0).stop 2024-09-17T01:37:38.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.799+0000 7f8c47c00640 1 -- 172.21.15.42:0/2676037975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c4015f480 msgr2=0x7f8c401f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:38.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.799+0000 7f8c47c00640 1 --2- 172.21.15.42:0/2676037975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c4015f480 0x7f8c401f5860 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f8c38009d90 tx=0x7f8c38003f10 comp rx=0 tx=0).stop 2024-09-17T01:37:38.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.800+0000 7f8c47c00640 1 -- 172.21.15.42:0/2676037975 shutdown_connections 2024-09-17T01:37:38.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.800+0000 7f8c47c00640 1 --2- 172.21.15.42:0/2676037975 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8c20078b90 0x7f8c2007b0a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:38.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.800+0000 7f8c47c00640 1 --2- 172.21.15.42:0/2676037975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c4015cb80 0x7f8c401e7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:38.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.800+0000 7f8c47c00640 1 --2- 172.21.15.42:0/2676037975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c4015f480 0x7f8c401f5860 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:38.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.800+0000 7f8c47c00640 1 --2- 172.21.15.42:0/2676037975 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8c4006d430 0x7f8c40145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:38.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.800+0000 7f8c47c00640 1 -- 172.21.15.42:0/2676037975 >> 172.21.15.42:0/2676037975 conn(0x7f8c400b2930 msgr2=0x7f8c400cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:38.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.800+0000 7f8c47c00640 1 -- 172.21.15.42:0/2676037975 shutdown_connections 2024-09-17T01:37:38.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:38.800+0000 7f8c47c00640 1 -- 172.21.15.42:0/2676037975 wait complete. 2024-09-17T01:37:38.806 INFO:tasks.ceph.mds.a.smithi042.stderr: -1946> 2024-09-17T01:37:24.161+0000 7f7722400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:37:38.825 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T01:37:38.925 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:37:39.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.063+0000 7f398e000640 1 -- 172.21.15.42:0/137588323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39880ccb90 msgr2=0x7f398815c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:39.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.063+0000 7f398e000640 1 --2- 172.21.15.42:0/137588323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39880ccb90 0x7f398815c6c0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f39880cd510 tx=0x7f397402a4b0 comp rx=0 tx=0).stop 2024-09-17T01:37:39.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.064+0000 7f398e000640 1 -- 172.21.15.42:0/137588323 shutdown_connections 2024-09-17T01:37:39.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.064+0000 7f398e000640 1 --2- 172.21.15.42:0/137588323 >> v2:172.21.15.43:3300/0 conn(0x7f39880b32b0 0x7f39880b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:39.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.064+0000 7f398e000640 1 --2- 172.21.15.42:0/137588323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39880ccb90 0x7f398815c6c0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:39.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.064+0000 7f398e000640 1 -- 172.21.15.42:0/137588323 >> 172.21.15.42:0/137588323 conn(0x7f398806d440 msgr2=0x7f39880b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:39.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.064+0000 7f398e000640 1 -- 172.21.15.42:0/137588323 shutdown_connections 2024-09-17T01:37:39.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.064+0000 7f398e000640 1 -- 172.21.15.42:0/137588323 wait complete. 2024-09-17T01:37:39.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.066+0000 7f398e000640 1 Processor -- start 2024-09-17T01:37:39.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.066+0000 7f398e000640 1 -- start start 2024-09-17T01:37:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.068+0000 7f398e000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f39880af910 0x7f39881f99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.068+0000 7f398e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39880b32b0 0x7f3988151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.068+0000 7f398e000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39880ccb90 0x7f39880b1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.068+0000 7f398e000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f398806e680 con 0x7f39880b32b0 2024-09-17T01:37:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.068+0000 7f398e000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f398806e500 con 0x7f39880ccb90 2024-09-17T01:37:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.068+0000 7f398e000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f398806e800 con 0x7f39880af910 2024-09-17T01:37:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.068+0000 7f3987e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39880b32b0 0x7f3988151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.068+0000 7f3987e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39880b32b0 0x7f3988151550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50184/0 (socket says 172.21.15.42:50184) 2024-09-17T01:37:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.068+0000 7f3987e00640 1 -- 172.21.15.42:0/2904821009 learned_addr learned my addr 172.21.15.42:0/2904821009 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.068+0000 7f398cc00640 1 --2- 172.21.15.42:0/2904821009 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f39880af910 0x7f39881f99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.068+0000 7f398d600640 1 --2- 172.21.15.42:0/2904821009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39880ccb90 0x7f39880b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.068+0000 7f3987e00640 1 -- 172.21.15.42:0/2904821009 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f39880af910 msgr2=0x7f39881f99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.068+0000 7f3987e00640 1 --2- 172.21.15.42:0/2904821009 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f39880af910 0x7f39881f99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.068+0000 7f3987e00640 1 -- 172.21.15.42:0/2904821009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39880ccb90 msgr2=0x7f39880b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.068+0000 7f3987e00640 1 --2- 172.21.15.42:0/2904821009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39880ccb90 0x7f39880b1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.068+0000 7f3987e00640 1 -- 172.21.15.42:0/2904821009 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3988075160 con 0x7f39880b32b0 2024-09-17T01:37:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.068+0000 7f398d600640 1 --2- 172.21.15.42:0/2904821009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39880ccb90 0x7f39880b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:37:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.069+0000 7f3987e00640 1 --2- 172.21.15.42:0/2904821009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39880b32b0 0x7f3988151550 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f3974009780 tx=0x7f3974033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.069+0000 7f3984c00640 1 -- 172.21.15.42:0/2904821009 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3974031d60 con 0x7f39880b32b0 2024-09-17T01:37:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.069+0000 7f3984c00640 1 -- 172.21.15.42:0/2904821009 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3974033e10 con 0x7f39880b32b0 2024-09-17T01:37:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.069+0000 7f398e000640 1 -- 172.21.15.42:0/2904821009 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3988073ba0 con 0x7f39880b32b0 2024-09-17T01:37:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.069+0000 7f3984c00640 1 -- 172.21.15.42:0/2904821009 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3974005260 con 0x7f39880b32b0 2024-09-17T01:37:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.069+0000 7f398e000640 1 -- 172.21.15.42:0/2904821009 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3988074160 con 0x7f39880b32b0 2024-09-17T01:37:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.070+0000 7f398e000640 1 -- 172.21.15.42:0/2904821009 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f398806f500 con 0x7f39880b32b0 2024-09-17T01:37:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.072+0000 7f3984c00640 1 -- 172.21.15.42:0/2904821009 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3974005400 con 0x7f39880b32b0 2024-09-17T01:37:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.073+0000 7f3984c00640 1 --2- 172.21.15.42:0/2904821009 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3968078bc0 0x7f396807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.073+0000 7f3984c00640 1 -- 172.21.15.42:0/2904821009 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5881+0+0 (secure 0 0 0) 0x7f39740bc120 con 0x7f39880b32b0 2024-09-17T01:37:39.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.073+0000 7f398cc00640 1 --2- 172.21.15.42:0/2904821009 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3968078bc0 0x7f396807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:39.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.074+0000 7f398cc00640 1 --2- 172.21.15.42:0/2904821009 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3968078bc0 0x7f396807b0d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f397c0015e0 tx=0x7f397c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:39.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.077+0000 7f3984c00640 1 -- 172.21.15.42:0/2904821009 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f397403f030 con 0x7f39880b32b0 2024-09-17T01:37:39.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.313+0000 7f398e000640 1 -- 172.21.15.42:0/2904821009 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3988075610 con 0x7f39880b32b0 2024-09-17T01:37:39.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.802+0000 7f3984c00640 1 -- 172.21.15.42:0/2904821009 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v65) ==== 104+0+0 (secure 0 0 0) 0x7f39740844a0 con 0x7f39880b32b0 2024-09-17T01:37:39.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.804+0000 7f398e000640 1 -- 172.21.15.42:0/2904821009 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3968078bc0 msgr2=0x7f396807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:39.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.804+0000 7f398e000640 1 --2- 172.21.15.42:0/2904821009 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3968078bc0 0x7f396807b0d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f397c0015e0 tx=0x7f397c009040 comp rx=0 tx=0).stop 2024-09-17T01:37:39.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.805+0000 7f398e000640 1 -- 172.21.15.42:0/2904821009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39880b32b0 msgr2=0x7f3988151550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:39.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.805+0000 7f398e000640 1 --2- 172.21.15.42:0/2904821009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39880b32b0 0x7f3988151550 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f3974009780 tx=0x7f3974033c20 comp rx=0 tx=0).stop 2024-09-17T01:37:39.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.805+0000 7f398e000640 1 -- 172.21.15.42:0/2904821009 shutdown_connections 2024-09-17T01:37:39.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.805+0000 7f398e000640 1 --2- 172.21.15.42:0/2904821009 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3968078bc0 0x7f396807b0d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:39.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.805+0000 7f398e000640 1 --2- 172.21.15.42:0/2904821009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39880ccb90 0x7f39880b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:39.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.805+0000 7f398e000640 1 --2- 172.21.15.42:0/2904821009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39880b32b0 0x7f3988151550 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:39.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.805+0000 7f398e000640 1 --2- 172.21.15.42:0/2904821009 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f39880af910 0x7f39881f99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:39.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.805+0000 7f398e000640 1 -- 172.21.15.42:0/2904821009 >> 172.21.15.42:0/2904821009 conn(0x7f398806d440 msgr2=0x7f398815bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:39.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.805+0000 7f398e000640 1 -- 172.21.15.42:0/2904821009 shutdown_connections 2024-09-17T01:37:39.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:39.805+0000 7f398e000640 1 -- 172.21.15.42:0/2904821009 wait complete. 2024-09-17T01:37:39.834 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T01:37:40.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.069+0000 7f83d3800640 1 -- 172.21.15.42:0/3764844775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83cc0b56d0 msgr2=0x7f83cc0b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:40.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.069+0000 7f83d3800640 1 --2- 172.21.15.42:0/3764844775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83cc0b56d0 0x7f83cc0b46f0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f83c0005fd0 tx=0x7f83c002a5d0 comp rx=0 tx=0).stop 2024-09-17T01:37:40.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.069+0000 7f83d3800640 1 -- 172.21.15.42:0/3764844775 shutdown_connections 2024-09-17T01:37:40.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.069+0000 7f83d3800640 1 --2- 172.21.15.42:0/3764844775 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f83cc0cdb20 0x7f83cc0cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:40.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.069+0000 7f83d3800640 1 --2- 172.21.15.42:0/3764844775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83cc0b56d0 0x7f83cc0b46f0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:40.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.069+0000 7f83d3800640 1 -- 172.21.15.42:0/3764844775 >> 172.21.15.42:0/3764844775 conn(0x7f83cc0b28f0 msgr2=0x7f83cc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:40.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.069+0000 7f83d3800640 1 -- 172.21.15.42:0/3764844775 shutdown_connections 2024-09-17T01:37:40.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.070+0000 7f83d3800640 1 -- 172.21.15.42:0/3764844775 wait complete. 2024-09-17T01:37:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.072+0000 7f83d3800640 1 Processor -- start 2024-09-17T01:37:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.072+0000 7f83d3800640 1 -- start start 2024-09-17T01:37:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.073+0000 7f83d3800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f83cc06d430 0x7f83cc0c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.073+0000 7f83d3800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83cc0b56d0 0x7f83cc15c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.073+0000 7f83d3800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83cc0cdb20 0x7f83cc15c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.073+0000 7f83d3800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc15d560 con 0x7f83cc0b56d0 2024-09-17T01:37:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.073+0000 7f83d3800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc15d3e0 con 0x7f83cc0cdb20 2024-09-17T01:37:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.073+0000 7f83d3800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f83cc15d6e0 con 0x7f83cc06d430 2024-09-17T01:37:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.074+0000 7f83cbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83cc0b56d0 0x7f83cc15c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.074+0000 7f83cbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83cc0b56d0 0x7f83cc15c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50206/0 (socket says 172.21.15.42:50206) 2024-09-17T01:37:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.074+0000 7f83cbe00640 1 -- 172.21.15.42:0/2444861222 learned_addr learned my addr 172.21.15.42:0/2444861222 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.074+0000 7f83d0e00640 1 --2- 172.21.15.42:0/2444861222 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f83cc06d430 0x7f83cc0c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:40.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.074+0000 7f83d1800640 1 --2- 172.21.15.42:0/2444861222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83cc0cdb20 0x7f83cc15c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:40.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.074+0000 7f83cbe00640 1 -- 172.21.15.42:0/2444861222 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f83cc06d430 msgr2=0x7f83cc0c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:40.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.074+0000 7f83cbe00640 1 --2- 172.21.15.42:0/2444861222 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f83cc06d430 0x7f83cc0c6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:40.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.074+0000 7f83cbe00640 1 -- 172.21.15.42:0/2444861222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83cc0cdb20 msgr2=0x7f83cc15c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:40.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.074+0000 7f83cbe00640 1 --2- 172.21.15.42:0/2444861222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83cc0cdb20 0x7f83cc15c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:40.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.074+0000 7f83cbe00640 1 -- 172.21.15.42:0/2444861222 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83cc0c6eb0 con 0x7f83cc0b56d0 2024-09-17T01:37:40.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.074+0000 7f83d1800640 1 --2- 172.21.15.42:0/2444861222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83cc0cdb20 0x7f83cc15c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:40.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.074+0000 7f83cbe00640 1 --2- 172.21.15.42:0/2444861222 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83cc0b56d0 0x7f83cc15c2f0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f83b800d740 tx=0x7f83b800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.075+0000 7f83c8c00640 1 -- 172.21.15.42:0/2444861222 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b8017070 con 0x7f83cc0b56d0 2024-09-17T01:37:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.075+0000 7f83c8c00640 1 -- 172.21.15.42:0/2444861222 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83b8009d20 con 0x7f83cc0b56d0 2024-09-17T01:37:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.075+0000 7f83c8c00640 1 -- 172.21.15.42:0/2444861222 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b80106c0 con 0x7f83cc0b56d0 2024-09-17T01:37:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.075+0000 7f83d3800640 1 -- 172.21.15.42:0/2444861222 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83cc0c7190 con 0x7f83cc0b56d0 2024-09-17T01:37:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.075+0000 7f83d3800640 1 -- 172.21.15.42:0/2444861222 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83cc0c7750 con 0x7f83cc0b56d0 2024-09-17T01:37:40.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.076+0000 7f83d3800640 1 -- 172.21.15.42:0/2444861222 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83cc15dba0 con 0x7f83cc0b56d0 2024-09-17T01:37:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.077+0000 7f83c8c00640 1 -- 172.21.15.42:0/2444861222 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f83b801a070 con 0x7f83cc0b56d0 2024-09-17T01:37:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.078+0000 7f83c8c00640 1 --2- 172.21.15.42:0/2444861222 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f83ac078b90 0x7f83ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:40.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.078+0000 7f83c8c00640 1 -- 172.21.15.42:0/2444861222 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5881+0+0 (secure 0 0 0) 0x7f83b809aff0 con 0x7f83cc0b56d0 2024-09-17T01:37:40.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.078+0000 7f83d0e00640 1 --2- 172.21.15.42:0/2444861222 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f83ac078b90 0x7f83ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:40.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.079+0000 7f83d0e00640 1 --2- 172.21.15.42:0/2444861222 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f83ac078b90 0x7f83ac07b0a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f83c0033000 tx=0x7f83c0004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:40.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.083+0000 7f83c8c00640 1 -- 172.21.15.42:0/2444861222 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f83b8062c90 con 0x7f83cc0b56d0 2024-09-17T01:37:40.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:40.276+0000 7f83d3800640 1 -- 172.21.15.42:0/2444861222 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f83cc0af090 con 0x7f83cc0b56d0 2024-09-17T01:37:41.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.232+0000 7f83c8c00640 1 -- 172.21.15.42:0/2444861222 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v84) ==== 181+0+0 (secure 0 0 0) 0x7f83b80676c0 con 0x7f83cc0b56d0 2024-09-17T01:37:41.232 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-09-17T01:37:41.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.236+0000 7f83d3800640 1 -- 172.21.15.42:0/2444861222 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f83ac078b90 msgr2=0x7f83ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:41.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.236+0000 7f83d3800640 1 --2- 172.21.15.42:0/2444861222 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f83ac078b90 0x7f83ac07b0a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f83c0033000 tx=0x7f83c0004730 comp rx=0 tx=0).stop 2024-09-17T01:37:41.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.237+0000 7f83d3800640 1 -- 172.21.15.42:0/2444861222 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83cc0b56d0 msgr2=0x7f83cc15c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:41.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.237+0000 7f83d3800640 1 --2- 172.21.15.42:0/2444861222 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83cc0b56d0 0x7f83cc15c2f0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f83b800d740 tx=0x7f83b800dc00 comp rx=0 tx=0).stop 2024-09-17T01:37:41.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.237+0000 7f83d3800640 1 -- 172.21.15.42:0/2444861222 shutdown_connections 2024-09-17T01:37:41.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.237+0000 7f83d3800640 1 --2- 172.21.15.42:0/2444861222 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f83ac078b90 0x7f83ac07b0a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:41.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.237+0000 7f83d3800640 1 --2- 172.21.15.42:0/2444861222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83cc0cdb20 0x7f83cc15c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:41.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.237+0000 7f83d3800640 1 --2- 172.21.15.42:0/2444861222 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83cc0b56d0 0x7f83cc15c2f0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:41.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.237+0000 7f83d3800640 1 --2- 172.21.15.42:0/2444861222 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f83cc06d430 0x7f83cc0c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:41.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.237+0000 7f83d3800640 1 -- 172.21.15.42:0/2444861222 >> 172.21.15.42:0/2444861222 conn(0x7f83cc0b28f0 msgr2=0x7f83cc0b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:41.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.237+0000 7f83d3800640 1 -- 172.21.15.42:0/2444861222 shutdown_connections 2024-09-17T01:37:41.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.237+0000 7f83d3800640 1 -- 172.21.15.42:0/2444861222 wait complete. 2024-09-17T01:37:41.267 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T01:37:41.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.510+0000 7f7288a00640 1 -- 172.21.15.42:0/2605779638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72840af4f0 msgr2=0x7f728415d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:41.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.510+0000 7f7288a00640 1 --2- 172.21.15.42:0/2605779638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72840af4f0 0x7f728415d6a0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f72840af900 tx=0x7f727402a560 comp rx=0 tx=0).stop 2024-09-17T01:37:41.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.510+0000 7f7288a00640 1 -- 172.21.15.42:0/2605779638 shutdown_connections 2024-09-17T01:37:41.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.510+0000 7f7288a00640 1 --2- 172.21.15.42:0/2605779638 >> v2:172.21.15.43:3300/0 conn(0x7f72840aebf0 0x7f728406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:41.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.510+0000 7f7288a00640 1 --2- 172.21.15.42:0/2605779638 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f728406d260 0x7f7284160210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:41.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.510+0000 7f7288a00640 1 --2- 172.21.15.42:0/2605779638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72840af4f0 0x7f728415d6a0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:41.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.510+0000 7f7288a00640 1 -- 172.21.15.42:0/2605779638 >> 172.21.15.42:0/2605779638 conn(0x7f72840b25d0 msgr2=0x7f72840d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:41.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.510+0000 7f7288a00640 1 -- 172.21.15.42:0/2605779638 shutdown_connections 2024-09-17T01:37:41.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.510+0000 7f7288a00640 1 -- 172.21.15.42:0/2605779638 wait complete. 2024-09-17T01:37:41.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.512+0000 7f7288a00640 1 Processor -- start 2024-09-17T01:37:41.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.512+0000 7f7288a00640 1 -- start start 2024-09-17T01:37:41.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.514+0000 7f7288a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f728406d260 0x7f728414a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:41.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.514+0000 7f7288a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72840aebf0 0x7f7284073c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:41.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.514+0000 7f7288a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72840af4f0 0x7f7284155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:41.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.514+0000 7f7288a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f72841608d0 con 0x7f72840af4f0 2024-09-17T01:37:41.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.514+0000 7f7288a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7284160750 con 0x7f728406d260 2024-09-17T01:37:41.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.514+0000 7f7288a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7284160a50 con 0x7f72840aebf0 2024-09-17T01:37:41.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.514+0000 7f7283e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72840af4f0 0x7f7284155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:41.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.514+0000 7f7283e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72840af4f0 0x7f7284155990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50228/0 (socket says 172.21.15.42:50228) 2024-09-17T01:37:41.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.514+0000 7f7283e00640 1 -- 172.21.15.42:0/2972533620 learned_addr learned my addr 172.21.15.42:0/2972533620 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:41.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.514+0000 7f7283400640 1 --2- 172.21.15.42:0/2972533620 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f728406d260 0x7f728414a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:41.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.514+0000 7f727be00640 1 --2- 172.21.15.42:0/2972533620 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72840aebf0 0x7f7284073c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:41.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.515+0000 7f7283e00640 1 -- 172.21.15.42:0/2972533620 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72840aebf0 msgr2=0x7f7284073c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:41.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.515+0000 7f7283e00640 1 --2- 172.21.15.42:0/2972533620 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72840aebf0 0x7f7284073c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:41.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.515+0000 7f7283e00640 1 -- 172.21.15.42:0/2972533620 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f728406d260 msgr2=0x7f728414a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:41.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.515+0000 7f7283e00640 1 --2- 172.21.15.42:0/2972533620 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f728406d260 0x7f728414a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:41.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.515+0000 7f7283e00640 1 -- 172.21.15.42:0/2972533620 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72841f6d80 con 0x7f72840af4f0 2024-09-17T01:37:41.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.515+0000 7f7283e00640 1 --2- 172.21.15.42:0/2972533620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72840af4f0 0x7f7284155990 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f727c00e990 tx=0x7f727c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:41.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.515+0000 7f727b400640 1 -- 172.21.15.42:0/2972533620 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c004d20 con 0x7f72840af4f0 2024-09-17T01:37:41.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.515+0000 7f727b400640 1 -- 172.21.15.42:0/2972533620 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f727c00ca40 con 0x7f72840af4f0 2024-09-17T01:37:41.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.515+0000 7f727b400640 1 -- 172.21.15.42:0/2972533620 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c005020 con 0x7f72840af4f0 2024-09-17T01:37:41.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.515+0000 7f7288a00640 1 -- 172.21.15.42:0/2972533620 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72841f7060 con 0x7f72840af4f0 2024-09-17T01:37:41.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.515+0000 7f7288a00640 1 -- 172.21.15.42:0/2972533620 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72841f7620 con 0x7f72840af4f0 2024-09-17T01:37:41.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.516+0000 7f7288a00640 1 -- 172.21.15.42:0/2972533620 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7284160fe0 con 0x7f72840af4f0 2024-09-17T01:37:41.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.518+0000 7f727b400640 1 -- 172.21.15.42:0/2972533620 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f727c0051c0 con 0x7f72840af4f0 2024-09-17T01:37:41.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.518+0000 7f727b400640 1 --2- 172.21.15.42:0/2972533620 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7260078b90 0x7f726007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:41.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.519+0000 7f727b400640 1 -- 172.21.15.42:0/2972533620 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5443+0+0 (secure 0 0 0) 0x7f727c09b380 con 0x7f72840af4f0 2024-09-17T01:37:41.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.519+0000 7f7283400640 1 --2- 172.21.15.42:0/2972533620 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7260078b90 0x7f726007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:41.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.520+0000 7f7283400640 1 --2- 172.21.15.42:0/2972533620 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7260078b90 0x7f726007b0a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7274033000 tx=0x7f7274004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:41.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.523+0000 7f727b400640 1 -- 172.21.15.42:0/2972533620 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f727c016030 con 0x7f72840af4f0 2024-09-17T01:37:41.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:41.721+0000 7f7288a00640 1 -- 172.21.15.42:0/2972533620 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f72840746d0 con 0x7f72840af4f0 2024-09-17T01:37:42.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.234+0000 7f727b400640 1 -- 172.21.15.42:0/2972533620 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v85) ==== 169+0+0 (secure 0 0 0) 0x7f727c068e20 con 0x7f72840af4f0 2024-09-17T01:37:42.233 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-09-17T01:37:42.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.238+0000 7f7288a00640 1 -- 172.21.15.42:0/2972533620 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7260078b90 msgr2=0x7f726007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:42.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.238+0000 7f7288a00640 1 --2- 172.21.15.42:0/2972533620 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7260078b90 0x7f726007b0a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7274033000 tx=0x7f7274004730 comp rx=0 tx=0).stop 2024-09-17T01:37:42.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.238+0000 7f7288a00640 1 -- 172.21.15.42:0/2972533620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72840af4f0 msgr2=0x7f7284155990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:42.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.238+0000 7f7288a00640 1 --2- 172.21.15.42:0/2972533620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72840af4f0 0x7f7284155990 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f727c00e990 tx=0x7f727c00ee50 comp rx=0 tx=0).stop 2024-09-17T01:37:42.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.238+0000 7f7288a00640 1 -- 172.21.15.42:0/2972533620 shutdown_connections 2024-09-17T01:37:42.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.238+0000 7f7288a00640 1 --2- 172.21.15.42:0/2972533620 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7260078b90 0x7f726007b0a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:42.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.238+0000 7f7288a00640 1 --2- 172.21.15.42:0/2972533620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72840af4f0 0x7f7284155990 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:42.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.238+0000 7f7288a00640 1 --2- 172.21.15.42:0/2972533620 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72840aebf0 0x7f7284073c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:42.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.238+0000 7f7288a00640 1 --2- 172.21.15.42:0/2972533620 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f728406d260 0x7f728414a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:42.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.238+0000 7f7288a00640 1 -- 172.21.15.42:0/2972533620 >> 172.21.15.42:0/2972533620 conn(0x7f72840b25d0 msgr2=0x7f72840ccad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:42.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.238+0000 7f7288a00640 1 -- 172.21.15.42:0/2972533620 shutdown_connections 2024-09-17T01:37:42.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.238+0000 7f7288a00640 1 -- 172.21.15.42:0/2972533620 wait complete. 2024-09-17T01:37:42.266 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T01:37:42.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.496+0000 7f97f8200640 1 -- 172.21.15.42:0/3542876127 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97f0142f40 msgr2=0x7f97f0072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:42.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.496+0000 7f97f8200640 1 --2- 172.21.15.42:0/3542876127 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97f0142f40 0x7f97f0072950 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f97dc005fd0 tx=0x7f97dc02a540 comp rx=0 tx=0).stop 2024-09-17T01:37:42.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.496+0000 7f97f8200640 1 -- 172.21.15.42:0/3542876127 shutdown_connections 2024-09-17T01:37:42.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.496+0000 7f97f8200640 1 --2- 172.21.15.42:0/3542876127 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97f0142f40 0x7f97f0072950 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:42.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.496+0000 7f97f8200640 1 --2- 172.21.15.42:0/3542876127 >> v2:172.21.15.43:3300/0 conn(0x7f97f00b3550 0x7f97f015cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:42.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.496+0000 7f97f8200640 1 -- 172.21.15.42:0/3542876127 >> 172.21.15.42:0/3542876127 conn(0x7f97f00b2930 msgr2=0x7f97f006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:42.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.496+0000 7f97f8200640 1 -- 172.21.15.42:0/3542876127 shutdown_connections 2024-09-17T01:37:42.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.496+0000 7f97f8200640 1 -- 172.21.15.42:0/3542876127 wait complete. 2024-09-17T01:37:42.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.498+0000 7f97f8200640 1 Processor -- start 2024-09-17T01:37:42.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.498+0000 7f97f8200640 1 -- start start 2024-09-17T01:37:42.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.500+0000 7f97f8200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97f0072e90 0x7f97f00cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:42.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.500+0000 7f97f8200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97f00b3550 0x7f97f0133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:42.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.500+0000 7f97f8200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97f0142f40 0x7f97f0134100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:42.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.500+0000 7f97f8200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f97f006d7c0 con 0x7f97f0072e90 2024-09-17T01:37:42.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.500+0000 7f97f8200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f97f006d640 con 0x7f97f0142f40 2024-09-17T01:37:42.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.500+0000 7f97f8200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f97f006d940 con 0x7f97f00b3550 2024-09-17T01:37:42.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.500+0000 7f97f5800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97f0072e90 0x7f97f00cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:42.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.500+0000 7f97f5800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97f0072e90 0x7f97f00cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50240/0 (socket says 172.21.15.42:50240) 2024-09-17T01:37:42.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.500+0000 7f97f5800640 1 -- 172.21.15.42:0/273305775 learned_addr learned my addr 172.21.15.42:0/273305775 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:42.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.500+0000 7f97f4e00640 1 --2- 172.21.15.42:0/273305775 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97f00b3550 0x7f97f0133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:42.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.500+0000 7f97f6200640 1 --2- 172.21.15.42:0/273305775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97f0142f40 0x7f97f0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:42.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.501+0000 7f97f5800640 1 -- 172.21.15.42:0/273305775 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97f00b3550 msgr2=0x7f97f0133bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:42.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.501+0000 7f97f5800640 1 --2- 172.21.15.42:0/273305775 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97f00b3550 0x7f97f0133bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:42.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.501+0000 7f97f5800640 1 -- 172.21.15.42:0/273305775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97f0142f40 msgr2=0x7f97f0134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:42.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.501+0000 7f97f5800640 1 --2- 172.21.15.42:0/273305775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97f0142f40 0x7f97f0134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:42.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.501+0000 7f97f5800640 1 -- 172.21.15.42:0/273305775 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f0131bd0 con 0x7f97f0072e90 2024-09-17T01:37:42.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.501+0000 7f97f4e00640 1 --2- 172.21.15.42:0/273305775 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97f00b3550 0x7f97f0133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:42.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.501+0000 7f97f5800640 1 --2- 172.21.15.42:0/273305775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97f0072e90 0x7f97f00cbdd0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f97e400ea20 tx=0x7f97e400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:42.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.501+0000 7f97ed600640 1 -- 172.21.15.42:0/273305775 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e400ce40 con 0x7f97f0072e90 2024-09-17T01:37:42.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.501+0000 7f97ed600640 1 -- 172.21.15.42:0/273305775 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97e4004020 con 0x7f97f0072e90 2024-09-17T01:37:42.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.501+0000 7f97f8200640 1 -- 172.21.15.42:0/273305775 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97f0131eb0 con 0x7f97f0072e90 2024-09-17T01:37:42.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.501+0000 7f97ed600640 1 -- 172.21.15.42:0/273305775 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e4004470 con 0x7f97f0072e90 2024-09-17T01:37:42.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.501+0000 7f97f8200640 1 -- 172.21.15.42:0/273305775 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97f0134a60 con 0x7f97f0072e90 2024-09-17T01:37:42.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.502+0000 7f97f8200640 1 -- 172.21.15.42:0/273305775 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97f00cc310 con 0x7f97f0072e90 2024-09-17T01:37:42.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.504+0000 7f97ed600640 1 -- 172.21.15.42:0/273305775 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f97e40035f0 con 0x7f97f0072e90 2024-09-17T01:37:42.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.505+0000 7f97ed600640 1 --2- 172.21.15.42:0/273305775 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f97d0078b90 0x7f97d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:42.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.505+0000 7f97ed600640 1 -- 172.21.15.42:0/273305775 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5029+0+0 (secure 0 0 0) 0x7f97e409b6e0 con 0x7f97f0072e90 2024-09-17T01:37:42.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.505+0000 7f97f4e00640 1 --2- 172.21.15.42:0/273305775 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f97d0078b90 0x7f97d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:42.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.506+0000 7f97f4e00640 1 --2- 172.21.15.42:0/273305775 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f97d0078b90 0x7f97d007b0a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f97dc033000 tx=0x7f97dc004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:42.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.509+0000 7f97ed600640 1 -- 172.21.15.42:0/273305775 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f97f00cc310 con 0x7f97f0072e90 2024-09-17T01:37:42.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.702+0000 7f97f8200640 1 -- 172.21.15.42:0/273305775 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f97f015cec0 con 0x7f97f0072e90 2024-09-17T01:37:42.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.707+0000 7f97ed600640 1 -- 172.21.15.42:0/273305775 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v44) ==== 71+0+0 (secure 0 0 0) 0x7f97e4063ca0 con 0x7f97f0072e90 2024-09-17T01:37:42.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.709+0000 7f97f8200640 1 -- 172.21.15.42:0/273305775 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f97d0078b90 msgr2=0x7f97d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:42.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.709+0000 7f97f8200640 1 --2- 172.21.15.42:0/273305775 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f97d0078b90 0x7f97d007b0a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f97dc033000 tx=0x7f97dc004730 comp rx=0 tx=0).stop 2024-09-17T01:37:42.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.709+0000 7f97f8200640 1 -- 172.21.15.42:0/273305775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97f0072e90 msgr2=0x7f97f00cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:42.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.709+0000 7f97f8200640 1 --2- 172.21.15.42:0/273305775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97f0072e90 0x7f97f00cbdd0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f97e400ea20 tx=0x7f97e400eee0 comp rx=0 tx=0).stop 2024-09-17T01:37:42.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.709+0000 7f97f8200640 1 -- 172.21.15.42:0/273305775 shutdown_connections 2024-09-17T01:37:42.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.709+0000 7f97f8200640 1 --2- 172.21.15.42:0/273305775 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f97d0078b90 0x7f97d007b0a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:42.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.709+0000 7f97f8200640 1 --2- 172.21.15.42:0/273305775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97f0142f40 0x7f97f0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:42.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.709+0000 7f97f8200640 1 --2- 172.21.15.42:0/273305775 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f97f00b3550 0x7f97f0133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:42.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.709+0000 7f97f8200640 1 --2- 172.21.15.42:0/273305775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97f0072e90 0x7f97f00cbdd0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:42.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.709+0000 7f97f8200640 1 -- 172.21.15.42:0/273305775 >> 172.21.15.42:0/273305775 conn(0x7f97f00b2930 msgr2=0x7f97f015f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:42.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.709+0000 7f97f8200640 1 -- 172.21.15.42:0/273305775 shutdown_connections 2024-09-17T01:37:42.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.709+0000 7f97f8200640 1 -- 172.21.15.42:0/273305775 wait complete. 2024-09-17T01:37:42.734 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-09-17T01:37:42.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.963+0000 7fca62800640 1 -- 172.21.15.42:0/2675231175 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca5c072e00 msgr2=0x7fca5c15bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:42.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.963+0000 7fca62800640 1 --2- 172.21.15.42:0/2675231175 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca5c072e00 0x7fca5c15bc50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fca4c009830 tx=0x7fca4c02a4b0 comp rx=0 tx=0).stop 2024-09-17T01:37:42.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.963+0000 7fca62800640 1 -- 172.21.15.42:0/2675231175 shutdown_connections 2024-09-17T01:37:42.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.963+0000 7fca62800640 1 --2- 172.21.15.42:0/2675231175 >> v2:172.21.15.43:3300/0 conn(0x7fca5c06db40 0x7fca5c06fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:42.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.963+0000 7fca62800640 1 --2- 172.21.15.42:0/2675231175 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca5c072e00 0x7fca5c15bc50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:42.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.963+0000 7fca62800640 1 -- 172.21.15.42:0/2675231175 >> 172.21.15.42:0/2675231175 conn(0x7fca5c0b2930 msgr2=0x7fca5c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:42.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.963+0000 7fca62800640 1 -- 172.21.15.42:0/2675231175 shutdown_connections 2024-09-17T01:37:42.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.963+0000 7fca62800640 1 -- 172.21.15.42:0/2675231175 wait complete. 2024-09-17T01:37:42.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.965+0000 7fca62800640 1 Processor -- start 2024-09-17T01:37:42.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.965+0000 7fca62800640 1 -- start start 2024-09-17T01:37:42.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.966+0000 7fca62800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca5c072e00 0x7fca5c136b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:42.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.967+0000 7fca62800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca5c15f190 0x7fca5c136370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:42.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.967+0000 7fca62800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca5c14fb20 0x7fca5c14ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:42.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.967+0000 7fca62800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fca5c151520 con 0x7fca5c14fb20 2024-09-17T01:37:42.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.967+0000 7fca62800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fca5c070740 con 0x7fca5c072e00 2024-09-17T01:37:42.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.967+0000 7fca62800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fca5c1516a0 con 0x7fca5c15f190 2024-09-17T01:37:42.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.967+0000 7fca5be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca5c14fb20 0x7fca5c14ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:42.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.967+0000 7fca5be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca5c14fb20 0x7fca5c14ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50244/0 (socket says 172.21.15.42:50244) 2024-09-17T01:37:42.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.967+0000 7fca5be00640 1 -- 172.21.15.42:0/855644217 learned_addr learned my addr 172.21.15.42:0/855644217 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:42.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.967+0000 7fca5b400640 1 --2- 172.21.15.42:0/855644217 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca5c072e00 0x7fca5c136b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:42.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.967+0000 7fca5aa00640 1 --2- 172.21.15.42:0/855644217 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca5c15f190 0x7fca5c136370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:42.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.967+0000 7fca5be00640 1 -- 172.21.15.42:0/855644217 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca5c15f190 msgr2=0x7fca5c136370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:42.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.967+0000 7fca5be00640 1 --2- 172.21.15.42:0/855644217 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca5c15f190 0x7fca5c136370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:42.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.967+0000 7fca5be00640 1 -- 172.21.15.42:0/855644217 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca5c072e00 msgr2=0x7fca5c136b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:42.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.967+0000 7fca5be00640 1 --2- 172.21.15.42:0/855644217 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca5c072e00 0x7fca5c136b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:42.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.967+0000 7fca5be00640 1 -- 172.21.15.42:0/855644217 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5c1368b0 con 0x7fca5c14fb20 2024-09-17T01:37:42.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.967+0000 7fca5b400640 1 --2- 172.21.15.42:0/855644217 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca5c072e00 0x7fca5c136b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:42.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.968+0000 7fca5be00640 1 --2- 172.21.15.42:0/855644217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca5c14fb20 0x7fca5c14ff30 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fca5400ebf0 tx=0x7fca5400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:42.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.968+0000 7fca53400640 1 -- 172.21.15.42:0/855644217 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca54003b70 con 0x7fca5c14fb20 2024-09-17T01:37:42.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.968+0000 7fca53400640 1 -- 172.21.15.42:0/855644217 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca54003d10 con 0x7fca5c14fb20 2024-09-17T01:37:42.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.968+0000 7fca62800640 1 -- 172.21.15.42:0/855644217 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca5c14f620 con 0x7fca5c14fb20 2024-09-17T01:37:42.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.968+0000 7fca53400640 1 -- 172.21.15.42:0/855644217 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca54004280 con 0x7fca5c14fb20 2024-09-17T01:37:42.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.968+0000 7fca62800640 1 -- 172.21.15.42:0/855644217 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca5c154930 con 0x7fca5c14fb20 2024-09-17T01:37:42.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.969+0000 7fca62800640 1 -- 172.21.15.42:0/855644217 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca5c158530 con 0x7fca5c14fb20 2024-09-17T01:37:42.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.970+0000 7fca53400640 1 -- 172.21.15.42:0/855644217 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fca54004420 con 0x7fca5c14fb20 2024-09-17T01:37:42.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.971+0000 7fca53400640 1 --2- 172.21.15.42:0/855644217 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fca3c078b90 0x7fca3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:42.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.971+0000 7fca53400640 1 -- 172.21.15.42:0/855644217 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5029+0+0 (secure 0 0 0) 0x7fca5409b830 con 0x7fca5c14fb20 2024-09-17T01:37:42.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.972+0000 7fca5b400640 1 --2- 172.21.15.42:0/855644217 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fca3c078b90 0x7fca3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:42.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.972+0000 7fca5b400640 1 --2- 172.21.15.42:0/855644217 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fca3c078b90 0x7fca3c07b0a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fca4c034000 tx=0x7fca4c033040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:42.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:42.976+0000 7fca53400640 1 -- 172.21.15.42:0/855644217 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fca54063e80 con 0x7fca5c14fb20 2024-09-17T01:37:43.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:43.247+0000 7fca62800640 1 -- 172.21.15.42:0/855644217 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) -- 0x7fca5c06fe40 con 0x7fca5c14fb20 2024-09-17T01:37:44.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.247+0000 7fca53400640 1 -- 172.21.15.42:0/855644217 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v286) ==== 143+0+0 (secure 0 0 0) 0x7fca54063780 con 0x7fca5c14fb20 2024-09-17T01:37:44.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.250+0000 7fca62800640 1 -- 172.21.15.42:0/855644217 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fca3c078b90 msgr2=0x7fca3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:44.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.250+0000 7fca62800640 1 --2- 172.21.15.42:0/855644217 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fca3c078b90 0x7fca3c07b0a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fca4c034000 tx=0x7fca4c033040 comp rx=0 tx=0).stop 2024-09-17T01:37:44.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.250+0000 7fca62800640 1 -- 172.21.15.42:0/855644217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca5c14fb20 msgr2=0x7fca5c14ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:44.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.250+0000 7fca62800640 1 --2- 172.21.15.42:0/855644217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca5c14fb20 0x7fca5c14ff30 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fca5400ebf0 tx=0x7fca5400c6a0 comp rx=0 tx=0).stop 2024-09-17T01:37:44.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.250+0000 7fca62800640 1 -- 172.21.15.42:0/855644217 shutdown_connections 2024-09-17T01:37:44.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.250+0000 7fca62800640 1 --2- 172.21.15.42:0/855644217 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fca3c078b90 0x7fca3c07b0a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:44.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.250+0000 7fca62800640 1 --2- 172.21.15.42:0/855644217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca5c14fb20 0x7fca5c14ff30 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:44.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.250+0000 7fca62800640 1 --2- 172.21.15.42:0/855644217 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca5c15f190 0x7fca5c136370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:44.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.250+0000 7fca62800640 1 --2- 172.21.15.42:0/855644217 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca5c072e00 0x7fca5c136b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:44.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.250+0000 7fca62800640 1 -- 172.21.15.42:0/855644217 >> 172.21.15.42:0/855644217 conn(0x7fca5c0b2930 msgr2=0x7fca5c159370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:44.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.250+0000 7fca62800640 1 -- 172.21.15.42:0/855644217 shutdown_connections 2024-09-17T01:37:44.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.250+0000 7fca62800640 1 -- 172.21.15.42:0/855644217 wait complete. 2024-09-17T01:37:44.275 INFO:tasks.cephfs_test_runner:test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-09-17T01:37:44.276 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_split_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) That a directory is split during scrub. 2024-09-17T01:37:44.276 INFO:tasks.cephfs_test_runner:test_scrub_split_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-17T01:37:44.277 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:37:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.511+0000 7f803ea00640 1 -- 172.21.15.42:0/2512807815 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f803806d430 msgr2=0x7f803806d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:44.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.511+0000 7f803ea00640 1 --2- 172.21.15.42:0/2512807815 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f803806d430 0x7f803806d840 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f803806f5f0 tx=0x7f802402a5f0 comp rx=0 tx=0).stop 2024-09-17T01:37:44.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.511+0000 7f803ea00640 1 -- 172.21.15.42:0/2512807815 shutdown_connections 2024-09-17T01:37:44.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.511+0000 7f803ea00640 1 --2- 172.21.15.42:0/2512807815 >> v2:172.21.15.43:3300/0 conn(0x7f803815f480 0x7f803815f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:44.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.511+0000 7f803ea00640 1 --2- 172.21.15.42:0/2512807815 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f803806d430 0x7f803806d840 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:44.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.511+0000 7f803ea00640 1 -- 172.21.15.42:0/2512807815 >> 172.21.15.42:0/2512807815 conn(0x7f80380b2930 msgr2=0x7f803806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:44.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.511+0000 7f803ea00640 1 -- 172.21.15.42:0/2512807815 shutdown_connections 2024-09-17T01:37:44.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.511+0000 7f803ea00640 1 -- 172.21.15.42:0/2512807815 wait complete. 2024-09-17T01:37:44.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.513+0000 7f803ea00640 1 Processor -- start 2024-09-17T01:37:44.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.514+0000 7f803ea00640 1 -- start start 2024-09-17T01:37:44.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.515+0000 7f803ea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f803806d430 0x7f803815a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:44.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.515+0000 7f803ea00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f803815cb80 0x7f803806e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:44.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.515+0000 7f803ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f803815f480 0x7f803806e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:44.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.515+0000 7f803ea00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8038073820 con 0x7f803815f480 2024-09-17T01:37:44.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.515+0000 7f803ea00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f80380736a0 con 0x7f803806d430 2024-09-17T01:37:44.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.515+0000 7f803ea00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f80380739a0 con 0x7f803815cb80 2024-09-17T01:37:44.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.515+0000 7f803ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f803815f480 0x7f803806e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:44.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.515+0000 7f803ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f803815f480 0x7f803806e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50260/0 (socket says 172.21.15.42:50260) 2024-09-17T01:37:44.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.515+0000 7f803ca00640 1 -- 172.21.15.42:0/2863009350 learned_addr learned my addr 172.21.15.42:0/2863009350 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:44.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.516+0000 7f8037400640 1 --2- 172.21.15.42:0/2863009350 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f803815cb80 0x7f803806e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:44.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.516+0000 7f8037e00640 1 --2- 172.21.15.42:0/2863009350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f803806d430 0x7f803815a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:44.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.516+0000 7f803ca00640 1 -- 172.21.15.42:0/2863009350 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f803815cb80 msgr2=0x7f803806e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:44.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.516+0000 7f803ca00640 1 --2- 172.21.15.42:0/2863009350 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f803815cb80 0x7f803806e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:44.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.516+0000 7f803ca00640 1 -- 172.21.15.42:0/2863009350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f803806d430 msgr2=0x7f803815a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:44.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.516+0000 7f803ca00640 1 --2- 172.21.15.42:0/2863009350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f803806d430 0x7f803815a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:44.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.516+0000 7f803ca00640 1 -- 172.21.15.42:0/2863009350 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80381f9490 con 0x7f803815f480 2024-09-17T01:37:44.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.516+0000 7f8037400640 1 --2- 172.21.15.42:0/2863009350 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f803815cb80 0x7f803806e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:44.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.516+0000 7f8037e00640 1 --2- 172.21.15.42:0/2863009350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f803806d430 0x7f803815a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:44.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.516+0000 7f803ca00640 1 --2- 172.21.15.42:0/2863009350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f803815f480 0x7f803806e700 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f803000ea80 tx=0x7f803000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:44.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.516+0000 7f802fe00640 1 -- 172.21.15.42:0/2863009350 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8030004b20 con 0x7f803815f480 2024-09-17T01:37:44.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.517+0000 7f802fe00640 1 -- 172.21.15.42:0/2863009350 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8030004ce0 con 0x7f803815f480 2024-09-17T01:37:44.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.517+0000 7f802fe00640 1 -- 172.21.15.42:0/2863009350 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8030005280 con 0x7f803815f480 2024-09-17T01:37:44.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.517+0000 7f803ea00640 1 -- 172.21.15.42:0/2863009350 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80381f9770 con 0x7f803815f480 2024-09-17T01:37:44.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.517+0000 7f803ea00640 1 -- 172.21.15.42:0/2863009350 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8038153c10 con 0x7f803815f480 2024-09-17T01:37:44.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.518+0000 7f803ea00640 1 -- 172.21.15.42:0/2863009350 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8038073e90 con 0x7f803815f480 2024-09-17T01:37:44.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.519+0000 7f802fe00640 1 -- 172.21.15.42:0/2863009350 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8030005420 con 0x7f803815f480 2024-09-17T01:37:44.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.521+0000 7f802fe00640 1 --2- 172.21.15.42:0/2863009350 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8018078b90 0x7f801807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:44.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.521+0000 7f802fe00640 1 -- 172.21.15.42:0/2863009350 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5029+0+0 (secure 0 0 0) 0x7f803009b7e0 con 0x7f803815f480 2024-09-17T01:37:44.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.522+0000 7f8037e00640 1 --2- 172.21.15.42:0/2863009350 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8018078b90 0x7f801807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:44.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.522+0000 7f8037e00640 1 --2- 172.21.15.42:0/2863009350 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8018078b90 0x7f801807b0a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8028007fd0 tx=0x7f8028009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:44.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.526+0000 7f802fe00640 1 -- 172.21.15.42:0/2863009350 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8030063eb0 con 0x7f803815f480 2024-09-17T01:37:44.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.724+0000 7f803ea00640 1 -- 172.21.15.42:0/2863009350 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f80381f9220 con 0x7f803815f480 2024-09-17T01:37:44.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.725+0000 7f802fe00640 1 -- 172.21.15.42:0/2863009350 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+13113 (secure 0 0 0) 0x7f80300637b0 con 0x7f803815f480 2024-09-17T01:37:44.723 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:44.723 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":85,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:37:42.234405+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6835/457794069":"2024-09-18T01:37:38.795628+0000","172.21.15.42:6834/457794069":"2024-09-18T01:37:38.795628+0000","172.21.15.42:6835/3707410924":"2024-09-18T01:37:17.150634+0000","172.21.15.42:6833/3707410924":"2024-09-18T01:37:17.150634+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:37:44.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.727+0000 7f803ea00640 1 -- 172.21.15.42:0/2863009350 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8018078b90 msgr2=0x7f801807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:44.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.727+0000 7f803ea00640 1 --2- 172.21.15.42:0/2863009350 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8018078b90 0x7f801807b0a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8028007fd0 tx=0x7f8028009040 comp rx=0 tx=0).stop 2024-09-17T01:37:44.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.727+0000 7f803ea00640 1 -- 172.21.15.42:0/2863009350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f803815f480 msgr2=0x7f803806e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:44.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.727+0000 7f803ea00640 1 --2- 172.21.15.42:0/2863009350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f803815f480 0x7f803806e700 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f803000ea80 tx=0x7f803000ef40 comp rx=0 tx=0).stop 2024-09-17T01:37:44.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.727+0000 7f803ea00640 1 -- 172.21.15.42:0/2863009350 shutdown_connections 2024-09-17T01:37:44.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.727+0000 7f803ea00640 1 --2- 172.21.15.42:0/2863009350 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8018078b90 0x7f801807b0a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:44.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.727+0000 7f803ea00640 1 --2- 172.21.15.42:0/2863009350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f803815f480 0x7f803806e700 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:44.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.727+0000 7f803ea00640 1 --2- 172.21.15.42:0/2863009350 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f803815cb80 0x7f803806e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:44.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.727+0000 7f803ea00640 1 --2- 172.21.15.42:0/2863009350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f803806d430 0x7f803815a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:44.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.727+0000 7f803ea00640 1 -- 172.21.15.42:0/2863009350 >> 172.21.15.42:0/2863009350 conn(0x7f80380b2930 msgr2=0x7f803806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:44.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.727+0000 7f803ea00640 1 -- 172.21.15.42:0/2863009350 shutdown_connections 2024-09-17T01:37:44.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.728+0000 7f803ea00640 1 -- 172.21.15.42:0/2863009350 wait complete. 2024-09-17T01:37:44.748 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T01:31:55.004951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T01:37:44.748 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T01:37:44.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.979+0000 7f4f89200640 1 -- 172.21.15.42:0/2560856213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f840cec40 msgr2=0x7f4f840cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:44.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.979+0000 7f4f89200640 1 --2- 172.21.15.42:0/2560856213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f840cec40 0x7f4f840cf050 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c005fd0 tx=0x7f4f7c02aa10 comp rx=0 tx=0).stop 2024-09-17T01:37:44.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.980+0000 7f4f89200640 1 -- 172.21.15.42:0/2560856213 shutdown_connections 2024-09-17T01:37:44.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.980+0000 7f4f89200640 1 --2- 172.21.15.42:0/2560856213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f840cec40 0x7f4f840cf050 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:44.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.980+0000 7f4f89200640 1 --2- 172.21.15.42:0/2560856213 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f840b3550 0x7f4f8415cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:44.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.980+0000 7f4f89200640 1 -- 172.21.15.42:0/2560856213 >> 172.21.15.42:0/2560856213 conn(0x7f4f840b2930 msgr2=0x7f4f8406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:44.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.980+0000 7f4f89200640 1 -- 172.21.15.42:0/2560856213 shutdown_connections 2024-09-17T01:37:44.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.980+0000 7f4f89200640 1 -- 172.21.15.42:0/2560856213 wait complete. 2024-09-17T01:37:44.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.982+0000 7f4f89200640 1 Processor -- start 2024-09-17T01:37:44.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.982+0000 7f4f89200640 1 -- start start 2024-09-17T01:37:44.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.984+0000 7f4f89200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f840b3550 0x7f4f8415b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:44.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.984+0000 7f4f89200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f840cec40 0x7f4f84135b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:44.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.984+0000 7f4f89200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f84142f40 0x7f4f8413f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:44.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.984+0000 7f4f89200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4f8406d7c0 con 0x7f4f840cec40 2024-09-17T01:37:44.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.984+0000 7f4f89200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4f8406d640 con 0x7f4f84142f40 2024-09-17T01:37:44.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.984+0000 7f4f89200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4f8406d940 con 0x7f4f840b3550 2024-09-17T01:37:44.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.984+0000 7f4f7be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f840cec40 0x7f4f84135b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:44.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.984+0000 7f4f7be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f840cec40 0x7f4f84135b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50284/0 (socket says 172.21.15.42:50284) 2024-09-17T01:37:44.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.984+0000 7f4f7be00640 1 -- 172.21.15.42:0/1352443079 learned_addr learned my addr 172.21.15.42:0/1352443079 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:44.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.984+0000 7f4f81e00640 1 --2- 172.21.15.42:0/1352443079 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f840b3550 0x7f4f8415b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:44.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.984+0000 7f4f82800640 1 --2- 172.21.15.42:0/1352443079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f84142f40 0x7f4f8413f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:44.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.984+0000 7f4f7be00640 1 -- 172.21.15.42:0/1352443079 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f840b3550 msgr2=0x7f4f8415b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:44.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.984+0000 7f4f7be00640 1 --2- 172.21.15.42:0/1352443079 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f840b3550 0x7f4f8415b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:44.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.984+0000 7f4f7be00640 1 -- 172.21.15.42:0/1352443079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f84142f40 msgr2=0x7f4f8413f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:44.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.984+0000 7f4f7be00640 1 --2- 172.21.15.42:0/1352443079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f84142f40 0x7f4f8413f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:44.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.984+0000 7f4f7be00640 1 -- 172.21.15.42:0/1352443079 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f84136070 con 0x7f4f840cec40 2024-09-17T01:37:44.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.985+0000 7f4f7be00640 1 --2- 172.21.15.42:0/1352443079 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f840cec40 0x7f4f84135b30 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00c3d0 tx=0x7f4f6c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:44.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.985+0000 7f4f7a000640 1 -- 172.21.15.42:0/1352443079 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c017070 con 0x7f4f840cec40 2024-09-17T01:37:44.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.985+0000 7f4f7a000640 1 -- 172.21.15.42:0/1352443079 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f6c0053c0 con 0x7f4f840cec40 2024-09-17T01:37:44.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.985+0000 7f4f7a000640 1 -- 172.21.15.42:0/1352443079 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c003850 con 0x7f4f840cec40 2024-09-17T01:37:44.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.985+0000 7f4f89200640 1 -- 172.21.15.42:0/1352443079 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f8415a100 con 0x7f4f840cec40 2024-09-17T01:37:44.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.985+0000 7f4f89200640 1 -- 172.21.15.42:0/1352443079 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f841401f0 con 0x7f4f840cec40 2024-09-17T01:37:44.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.986+0000 7f4f89200640 1 -- 172.21.15.42:0/1352443079 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f84072650 con 0x7f4f840cec40 2024-09-17T01:37:44.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.988+0000 7f4f7a000640 1 -- 172.21.15.42:0/1352443079 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4f6c01a070 con 0x7f4f840cec40 2024-09-17T01:37:44.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.988+0000 7f4f7a000640 1 --2- 172.21.15.42:0/1352443079 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4f60078bc0 0x7f4f6007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:44.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.989+0000 7f4f7a000640 1 -- 172.21.15.42:0/1352443079 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5029+0+0 (secure 0 0 0) 0x7f4f6c099d30 con 0x7f4f840cec40 2024-09-17T01:37:44.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.989+0000 7f4f81e00640 1 --2- 172.21.15.42:0/1352443079 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4f60078bc0 0x7f4f6007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:44.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.990+0000 7f4f81e00640 1 --2- 172.21.15.42:0/1352443079 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4f60078bc0 0x7f4f6007b0d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009b30 tx=0x7f4f74005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:44.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:44.993+0000 7f4f7a000640 1 -- 172.21.15.42:0/1352443079 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4f84072650 con 0x7f4f840cec40 2024-09-17T01:37:45.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.186+0000 7f4f89200640 1 -- 172.21.15.42:0/1352443079 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4f8415cec0 con 0x7f4f840cec40 2024-09-17T01:37:45.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.186+0000 7f4f7a000640 1 -- 172.21.15.42:0/1352443079 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) ==== 93+0+10 (secure 0 0 0) 0x7f4f6c061db0 con 0x7f4f840cec40 2024-09-17T01:37:45.186 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-09-17T01:37:45.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.189+0000 7f4f89200640 1 -- 172.21.15.42:0/1352443079 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4f60078bc0 msgr2=0x7f4f6007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:45.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.189+0000 7f4f89200640 1 --2- 172.21.15.42:0/1352443079 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4f60078bc0 0x7f4f6007b0d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4f74009b30 tx=0x7f4f74005f90 comp rx=0 tx=0).stop 2024-09-17T01:37:45.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.189+0000 7f4f89200640 1 -- 172.21.15.42:0/1352443079 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f840cec40 msgr2=0x7f4f84135b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:45.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.189+0000 7f4f89200640 1 --2- 172.21.15.42:0/1352443079 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f840cec40 0x7f4f84135b30 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00c3d0 tx=0x7f4f6c00c890 comp rx=0 tx=0).stop 2024-09-17T01:37:45.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.189+0000 7f4f89200640 1 -- 172.21.15.42:0/1352443079 shutdown_connections 2024-09-17T01:37:45.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.189+0000 7f4f89200640 1 --2- 172.21.15.42:0/1352443079 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4f60078bc0 0x7f4f6007b0d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:45.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.189+0000 7f4f89200640 1 --2- 172.21.15.42:0/1352443079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f84142f40 0x7f4f8413f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:45.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.189+0000 7f4f89200640 1 --2- 172.21.15.42:0/1352443079 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f840cec40 0x7f4f84135b30 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.189+0000 7f4f89200640 1 --2- 172.21.15.42:0/1352443079 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f840b3550 0x7f4f8415b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.189+0000 7f4f89200640 1 -- 172.21.15.42:0/1352443079 >> 172.21.15.42:0/1352443079 conn(0x7f4f840b2930 msgr2=0x7f4f8415ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.189+0000 7f4f89200640 1 -- 172.21.15.42:0/1352443079 shutdown_connections 2024-09-17T01:37:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.189+0000 7f4f89200640 1 -- 172.21.15.42:0/1352443079 wait complete. 2024-09-17T01:37:45.210 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags' 2024-09-17T01:37:45.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.440+0000 7fde17a00640 1 -- 172.21.15.42:0/268490265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde100cdf30 msgr2=0x7fde100b4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:45.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.440+0000 7fde17a00640 1 --2- 172.21.15.42:0/268490265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde100cdf30 0x7fde100b4f40 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fde10074d90 tx=0x7fde0802aa30 comp rx=0 tx=0).stop 2024-09-17T01:37:45.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.440+0000 7fde17a00640 1 -- 172.21.15.42:0/268490265 shutdown_connections 2024-09-17T01:37:45.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.440+0000 7fde17a00640 1 --2- 172.21.15.42:0/268490265 >> v2:172.21.15.43:3300/0 conn(0x7fde100d00e0 0x7fde100cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:45.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.440+0000 7fde17a00640 1 --2- 172.21.15.42:0/268490265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde100cdf30 0x7fde100b4f40 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:45.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.440+0000 7fde17a00640 1 --2- 172.21.15.42:0/268490265 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde101462b0 0x7fde100cfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:45.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.440+0000 7fde17a00640 1 -- 172.21.15.42:0/268490265 >> 172.21.15.42:0/268490265 conn(0x7fde1006d350 msgr2=0x7fde100b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:45.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.440+0000 7fde17a00640 1 -- 172.21.15.42:0/268490265 shutdown_connections 2024-09-17T01:37:45.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.440+0000 7fde17a00640 1 -- 172.21.15.42:0/268490265 wait complete. 2024-09-17T01:37:45.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.442+0000 7fde17a00640 1 Processor -- start 2024-09-17T01:37:45.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.442+0000 7fde17a00640 1 -- start start 2024-09-17T01:37:45.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.444+0000 7fde17a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde100cdf30 0x7fde101f3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:45.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.444+0000 7fde17a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde100d00e0 0x7fde1013fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:45.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.444+0000 7fde17a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde101462b0 0x7fde100cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:45.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.444+0000 7fde17a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fde100b5600 con 0x7fde100cdf30 2024-09-17T01:37:45.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.444+0000 7fde17a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fde100b5480 con 0x7fde101462b0 2024-09-17T01:37:45.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.444+0000 7fde17a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fde100b5780 con 0x7fde100d00e0 2024-09-17T01:37:45.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.444+0000 7fde15000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde100cdf30 0x7fde101f3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:45.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.444+0000 7fde15000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde100cdf30 0x7fde101f3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50290/0 (socket says 172.21.15.42:50290) 2024-09-17T01:37:45.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.444+0000 7fde15000640 1 -- 172.21.15.42:0/2939230084 learned_addr learned my addr 172.21.15.42:0/2939230084 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:45.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.444+0000 7fde07e00640 1 --2- 172.21.15.42:0/2939230084 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde100d00e0 0x7fde1013fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:45.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.444+0000 7fde15a00640 1 --2- 172.21.15.42:0/2939230084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde101462b0 0x7fde100cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:45.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.445+0000 7fde15000640 1 -- 172.21.15.42:0/2939230084 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde100d00e0 msgr2=0x7fde1013fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:45.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.445+0000 7fde15000640 1 --2- 172.21.15.42:0/2939230084 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde100d00e0 0x7fde1013fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:45.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.445+0000 7fde15000640 1 -- 172.21.15.42:0/2939230084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde101462b0 msgr2=0x7fde100cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:45.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.445+0000 7fde15000640 1 --2- 172.21.15.42:0/2939230084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde101462b0 0x7fde100cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:45.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.445+0000 7fde15000640 1 -- 172.21.15.42:0/2939230084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde10159530 con 0x7fde100cdf30 2024-09-17T01:37:45.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.445+0000 7fde15000640 1 --2- 172.21.15.42:0/2939230084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde100cdf30 0x7fde101f3b10 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fde0000d770 tx=0x7fde0000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:45.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.445+0000 7fde0d600640 1 -- 172.21.15.42:0/2939230084 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde00017070 con 0x7fde100cdf30 2024-09-17T01:37:45.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.445+0000 7fde0d600640 1 -- 172.21.15.42:0/2939230084 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde00009d20 con 0x7fde100cdf30 2024-09-17T01:37:45.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.445+0000 7fde0d600640 1 -- 172.21.15.42:0/2939230084 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde000106c0 con 0x7fde100cdf30 2024-09-17T01:37:45.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.445+0000 7fde17a00640 1 -- 172.21.15.42:0/2939230084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde10159a30 con 0x7fde100cdf30 2024-09-17T01:37:45.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.445+0000 7fde17a00640 1 -- 172.21.15.42:0/2939230084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde10159ff0 con 0x7fde100cdf30 2024-09-17T01:37:45.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.446+0000 7fde17a00640 1 -- 172.21.15.42:0/2939230084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde100b5d10 con 0x7fde100cdf30 2024-09-17T01:37:45.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.448+0000 7fde0d600640 1 -- 172.21.15.42:0/2939230084 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fde0001a070 con 0x7fde100cdf30 2024-09-17T01:37:45.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.448+0000 7fde0d600640 1 --2- 172.21.15.42:0/2939230084 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fddec078b90 0x7fddec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:45.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.449+0000 7fde0d600640 1 -- 172.21.15.42:0/2939230084 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5029+0+0 (secure 0 0 0) 0x7fde0009aad0 con 0x7fde100cdf30 2024-09-17T01:37:45.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.449+0000 7fde07e00640 1 --2- 172.21.15.42:0/2939230084 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fddec078b90 0x7fddec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:45.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.450+0000 7fde07e00640 1 --2- 172.21.15.42:0/2939230084 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fddec078b90 0x7fddec07b0a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fde101f1700 tx=0x7fddf800b260 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:45.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.453+0000 7fde0d600640 1 -- 172.21.15.42:0/2939230084 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fde00062be0 con 0x7fde100cdf30 2024-09-17T01:37:45.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:45.724+0000 7fde17a00640 1 -- 172.21.15.42:0/2939230084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]} v 0) -- 0x7fde100cd0d0 con 0x7fde100cdf30 2024-09-17T01:37:46.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.255+0000 7fde0d600640 1 -- 172.21.15.42:0/2939230084 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]}]=0 v288) ==== 154+0+0 (secure 0 0 0) 0x7fde00067610 con 0x7fde100cdf30 2024-09-17T01:37:46.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.258+0000 7fde17a00640 1 -- 172.21.15.42:0/2939230084 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fddec078b90 msgr2=0x7fddec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:46.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.258+0000 7fde17a00640 1 --2- 172.21.15.42:0/2939230084 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fddec078b90 0x7fddec07b0a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fde101f1700 tx=0x7fddf800b260 comp rx=0 tx=0).stop 2024-09-17T01:37:46.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.258+0000 7fde17a00640 1 -- 172.21.15.42:0/2939230084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde100cdf30 msgr2=0x7fde101f3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:46.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.258+0000 7fde17a00640 1 --2- 172.21.15.42:0/2939230084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde100cdf30 0x7fde101f3b10 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fde0000d770 tx=0x7fde0000dc30 comp rx=0 tx=0).stop 2024-09-17T01:37:46.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.258+0000 7fde17a00640 1 -- 172.21.15.42:0/2939230084 shutdown_connections 2024-09-17T01:37:46.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.258+0000 7fde17a00640 1 --2- 172.21.15.42:0/2939230084 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fddec078b90 0x7fddec07b0a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:46.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.258+0000 7fde17a00640 1 --2- 172.21.15.42:0/2939230084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde101462b0 0x7fde100cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:46.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.258+0000 7fde17a00640 1 --2- 172.21.15.42:0/2939230084 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde100d00e0 0x7fde1013fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:46.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.258+0000 7fde17a00640 1 --2- 172.21.15.42:0/2939230084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde100cdf30 0x7fde101f3b10 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:46.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.258+0000 7fde17a00640 1 -- 172.21.15.42:0/2939230084 >> 172.21.15.42:0/2939230084 conn(0x7fde1006d350 msgr2=0x7fde1006f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:46.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.259+0000 7fde17a00640 1 -- 172.21.15.42:0/2939230084 shutdown_connections 2024-09-17T01:37:46.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.259+0000 7fde17a00640 1 -- 172.21.15.42:0/2939230084 wait complete. 2024-09-17T01:37:46.288 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T01:37:46.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.520+0000 7f2266200640 1 -- 172.21.15.42:0/3887694419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22480051c0 msgr2=0x7f224800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:46.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.520+0000 7f2266200640 1 --2- 172.21.15.42:0/3887694419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22480051c0 0x7f224800b9c0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f2258005fd0 tx=0x7f2248005830 comp rx=0 tx=0).stop 2024-09-17T01:37:46.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.520+0000 7f2265800640 1 -- 172.21.15.42:0/3887694419 reap_dead start 2024-09-17T01:37:46.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.520+0000 7f2266200640 1 -- 172.21.15.42:0/3887694419 shutdown_connections 2024-09-17T01:37:46.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.520+0000 7f2266200640 1 -- 172.21.15.42:0/3887694419 >> 172.21.15.42:0/3887694419 conn(0x7f22600b25f0 msgr2=0x7f22600d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:46.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.520+0000 7f2266200640 1 -- 172.21.15.42:0/3887694419 shutdown_connections 2024-09-17T01:37:46.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.520+0000 7f2266200640 1 -- 172.21.15.42:0/3887694419 wait complete. 2024-09-17T01:37:46.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.522+0000 7f2266200640 1 Processor -- start 2024-09-17T01:37:46.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.522+0000 7f2266200640 1 -- start start 2024-09-17T01:37:46.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.524+0000 7f2266200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22480051c0 0x7f22601f9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:46.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.524+0000 7f2266200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2260148e30 0x7f2260152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:46.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.524+0000 7f2266200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2260152640 0x7f22601e4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:46.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.524+0000 7f2266200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f226006d6a0 con 0x7f2260148e30 2024-09-17T01:37:46.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.524+0000 7f2266200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f22600b42c0 con 0x7f22480051c0 2024-09-17T01:37:46.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.524+0000 7f2266200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2260152ed0 con 0x7f2260152640 2024-09-17T01:37:46.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.524+0000 7f225fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2260148e30 0x7f2260152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:46.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.524+0000 7f225fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2260148e30 0x7f2260152100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42052/0 (socket says 172.21.15.42:42052) 2024-09-17T01:37:46.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.524+0000 7f225fe00640 1 -- 172.21.15.42:0/257980292 learned_addr learned my addr 172.21.15.42:0/257980292 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:46.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.525+0000 7f2264e00640 1 --2- 172.21.15.42:0/257980292 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22480051c0 0x7f22601f9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:46.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.525+0000 7f2265800640 1 --2- 172.21.15.42:0/257980292 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2260152640 0x7f22601e4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:46.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.525+0000 7f225fe00640 1 -- 172.21.15.42:0/257980292 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2260152640 msgr2=0x7f22601e4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:46.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.525+0000 7f225fe00640 1 --2- 172.21.15.42:0/257980292 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2260152640 0x7f22601e4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:46.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.525+0000 7f225fe00640 1 -- 172.21.15.42:0/257980292 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22480051c0 msgr2=0x7f22601f9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:46.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.525+0000 7f225fe00640 1 --2- 172.21.15.42:0/257980292 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22480051c0 0x7f22601f9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:46.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.525+0000 7f225fe00640 1 -- 172.21.15.42:0/257980292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2260152a50 con 0x7f2260148e30 2024-09-17T01:37:46.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.525+0000 7f2265800640 1 --2- 172.21.15.42:0/257980292 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2260152640 0x7f22601e4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:37:46.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.525+0000 7f225fe00640 1 --2- 172.21.15.42:0/257980292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2260148e30 0x7f2260152100 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f224c0064b0 tx=0x7f224c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:46.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.525+0000 7f225cc00640 1 -- 172.21.15.42:0/257980292 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c015070 con 0x7f2260148e30 2024-09-17T01:37:46.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.525+0000 7f225cc00640 1 -- 172.21.15.42:0/257980292 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f224c011900 con 0x7f2260148e30 2024-09-17T01:37:46.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.525+0000 7f2266200640 1 -- 172.21.15.42:0/257980292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22601e7d40 con 0x7f2260148e30 2024-09-17T01:37:46.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.525+0000 7f225cc00640 1 -- 172.21.15.42:0/257980292 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c011d30 con 0x7f2260148e30 2024-09-17T01:37:46.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.525+0000 7f2266200640 1 -- 172.21.15.42:0/257980292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22601e72b0 con 0x7f2260148e30 2024-09-17T01:37:46.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.526+0000 7f2266200640 1 -- 172.21.15.42:0/257980292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22601e6dc0 con 0x7f2260148e30 2024-09-17T01:37:46.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.528+0000 7f225cc00640 1 -- 172.21.15.42:0/257980292 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f224c018070 con 0x7f2260148e30 2024-09-17T01:37:46.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.529+0000 7f225cc00640 1 --2- 172.21.15.42:0/257980292 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2240078b90 0x7f224007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:46.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.529+0000 7f225cc00640 1 -- 172.21.15.42:0/257980292 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5029+0+0 (secure 0 0 0) 0x7f224c09b700 con 0x7f2260148e30 2024-09-17T01:37:46.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.529+0000 7f2264e00640 1 --2- 172.21.15.42:0/257980292 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2240078b90 0x7f224007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:46.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.530+0000 7f2264e00640 1 --2- 172.21.15.42:0/257980292 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2240078b90 0x7f224007b0a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2254006930 tx=0x7f22540068a0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:46.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.533+0000 7f225cc00640 1 -- 172.21.15.42:0/257980292 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2260152a50 con 0x7f2260148e30 2024-09-17T01:37:46.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.729+0000 7f2266200640 1 -- 172.21.15.42:0/257980292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f226006cd20 con 0x7f2260148e30 2024-09-17T01:37:46.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.729+0000 7f225cc00640 1 -- 172.21.15.42:0/257980292 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v44) ==== 59+0+2294 (secure 0 0 0) 0x7f224c063de0 con 0x7f2260148e30 2024-09-17T01:37:46.728 INFO:teuthology.orchestra.run.smithi042.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T01:37:46.728 INFO:teuthology.orchestra.run.smithi042.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T01:37:46.728 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced client_mount_timeout 30 2024-09-17T01:37:46.728 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_client 20/20 2024-09-17T01:37:46.728 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_mgr 20/20 2024-09-17T01:37:46.729 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_ms 1/1 2024-09-17T01:37:46.729 INFO:teuthology.orchestra.run.smithi042.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T01:37:46.729 INFO:teuthology.orchestra.run.smithi042.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T01:37:46.729 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3683.959260 2024-09-17T01:37:46.729 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4350.010833 2024-09-17T01:37:46.729 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4316.776055 2024-09-17T01:37:46.729 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3885.595082 2024-09-17T01:37:46.729 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3602.000737 2024-09-17T01:37:46.729 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4883.364748 2024-09-17T01:37:46.729 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3752.484811 2024-09-17T01:37:46.729 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3775.035963 2024-09-17T01:37:46.729 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds 20/20 2024-09-17T01:37:46.729 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T01:37:46.730 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_ms 2/2 2024-09-17T01:37:46.730 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_frag true 2024-09-17T01:37:46.730 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_scatterstat true 2024-09-17T01:37:46.730 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T01:37:46.730 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_verify_scatter true 2024-09-17T01:37:46.730 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T01:37:46.730 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T01:37:46.730 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T01:37:46.730 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced client_mount_timeout 600 2024-09-17T01:37:46.730 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_client 20/20 2024-09-17T01:37:46.730 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_ms 1/1 2024-09-17T01:37:46.730 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T01:37:46.730 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T01:37:46.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.732+0000 7f2266200640 1 -- 172.21.15.42:0/257980292 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2240078b90 msgr2=0x7f224007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:46.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.732+0000 7f2266200640 1 --2- 172.21.15.42:0/257980292 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2240078b90 0x7f224007b0a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2254006930 tx=0x7f22540068a0 comp rx=0 tx=0).stop 2024-09-17T01:37:46.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.732+0000 7f2266200640 1 -- 172.21.15.42:0/257980292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2260148e30 msgr2=0x7f2260152100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:46.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.732+0000 7f2266200640 1 --2- 172.21.15.42:0/257980292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2260148e30 0x7f2260152100 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f224c0064b0 tx=0x7f224c0039c0 comp rx=0 tx=0).stop 2024-09-17T01:37:46.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.732+0000 7f2266200640 1 -- 172.21.15.42:0/257980292 shutdown_connections 2024-09-17T01:37:46.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.732+0000 7f2266200640 1 --2- 172.21.15.42:0/257980292 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2240078b90 0x7f224007b0a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:46.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.732+0000 7f2266200640 1 --2- 172.21.15.42:0/257980292 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2260152640 0x7f22601e4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:46.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.732+0000 7f2266200640 1 --2- 172.21.15.42:0/257980292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2260148e30 0x7f2260152100 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:46.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.732+0000 7f2266200640 1 --2- 172.21.15.42:0/257980292 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22480051c0 0x7f22601f9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:46.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.732+0000 7f2266200640 1 -- 172.21.15.42:0/257980292 >> 172.21.15.42:0/257980292 conn(0x7f22600b25f0 msgr2=0x7f2260075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:46.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.732+0000 7f2266200640 1 -- 172.21.15.42:0/257980292 shutdown_connections 2024-09-17T01:37:46.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.732+0000 7f2266200640 1 -- 172.21.15.42:0/257980292 wait complete. 2024-09-17T01:37:46.752 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T01:37:46.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.983+0000 7fe33e400640 1 -- 172.21.15.42:0/3817429628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe31c003fd0 msgr2=0x7fe31c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:46.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.983+0000 7fe33e400640 1 --2- 172.21.15.42:0/3817429628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe31c003fd0 0x7fe31c004800 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fe320009b20 tx=0x7fe31c005830 comp rx=0 tx=0).stop 2024-09-17T01:37:46.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.983+0000 7fe337e00640 1 -- 172.21.15.42:0/3817429628 reap_dead start 2024-09-17T01:37:46.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.983+0000 7fe33e400640 1 -- 172.21.15.42:0/3817429628 shutdown_connections 2024-09-17T01:37:46.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.983+0000 7fe33e400640 1 -- 172.21.15.42:0/3817429628 >> 172.21.15.42:0/3817429628 conn(0x7fe3380b2930 msgr2=0x7fe33806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:46.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.983+0000 7fe33e400640 1 -- 172.21.15.42:0/3817429628 shutdown_connections 2024-09-17T01:37:46.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.983+0000 7fe33e400640 1 -- 172.21.15.42:0/3817429628 wait complete. 2024-09-17T01:37:46.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.985+0000 7fe33e400640 1 Processor -- start 2024-09-17T01:37:46.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.986+0000 7fe33e400640 1 -- start start 2024-09-17T01:37:46.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.987+0000 7fe33e400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe31c003fd0 0x7fe33806fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:46.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.987+0000 7fe33e400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe3381597b0 0x7fe338135c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:46.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.987+0000 7fe33e400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe33815bbf0 0x7fe33815c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:46.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.987+0000 7fe33e400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe338072ad0 con 0x7fe31c003fd0 2024-09-17T01:37:46.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.987+0000 7fe33e400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe338072950 con 0x7fe33815bbf0 2024-09-17T01:37:46.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.987+0000 7fe33e400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe338072c50 con 0x7fe3381597b0 2024-09-17T01:37:46.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.987+0000 7fe337400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe31c003fd0 0x7fe33806fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:46.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.987+0000 7fe337400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe31c003fd0 0x7fe33806fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42066/0 (socket says 172.21.15.42:42066) 2024-09-17T01:37:46.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.987+0000 7fe337400640 1 -- 172.21.15.42:0/1573179060 learned_addr learned my addr 172.21.15.42:0/1573179060 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:46.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.988+0000 7fe337e00640 1 --2- 172.21.15.42:0/1573179060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe33815bbf0 0x7fe33815c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:46.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.988+0000 7fe32fe00640 1 --2- 172.21.15.42:0/1573179060 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe3381597b0 0x7fe338135c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:46.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.988+0000 7fe337400640 1 -- 172.21.15.42:0/1573179060 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe3381597b0 msgr2=0x7fe338135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:46.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.988+0000 7fe337400640 1 --2- 172.21.15.42:0/1573179060 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe3381597b0 0x7fe338135c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:46.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.988+0000 7fe337400640 1 -- 172.21.15.42:0/1573179060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe33815bbf0 msgr2=0x7fe33815c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:46.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.988+0000 7fe337400640 1 --2- 172.21.15.42:0/1573179060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe33815bbf0 0x7fe33815c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:46.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.988+0000 7fe337400640 1 -- 172.21.15.42:0/1573179060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33815c540 con 0x7fe31c003fd0 2024-09-17T01:37:46.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.988+0000 7fe337400640 1 --2- 172.21.15.42:0/1573179060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe31c003fd0 0x7fe33806fdd0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fe328011b50 tx=0x7fe32800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:46.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.988+0000 7fe32f400640 1 -- 172.21.15.42:0/1573179060 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32801e070 con 0x7fe31c003fd0 2024-09-17T01:37:46.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.988+0000 7fe32f400640 1 -- 172.21.15.42:0/1573179060 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe32800e7c0 con 0x7fe31c003fd0 2024-09-17T01:37:46.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.988+0000 7fe32f400640 1 -- 172.21.15.42:0/1573179060 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32800ebb0 con 0x7fe31c003fd0 2024-09-17T01:37:46.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.988+0000 7fe33e400640 1 -- 172.21.15.42:0/1573179060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3381f9050 con 0x7fe31c003fd0 2024-09-17T01:37:46.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.989+0000 7fe33e400640 1 -- 172.21.15.42:0/1573179060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3381f9610 con 0x7fe31c003fd0 2024-09-17T01:37:46.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.990+0000 7fe33e400640 1 -- 172.21.15.42:0/1573179060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3380b43a0 con 0x7fe31c003fd0 2024-09-17T01:37:46.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.991+0000 7fe32f400640 1 -- 172.21.15.42:0/1573179060 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe328021070 con 0x7fe31c003fd0 2024-09-17T01:37:46.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.992+0000 7fe32f400640 1 --2- 172.21.15.42:0/1573179060 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe314078b90 0x7fe31407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:46.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.992+0000 7fe32f400640 1 -- 172.21.15.42:0/1573179060 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5029+0+0 (secure 0 0 0) 0x7fe32809baf0 con 0x7fe31c003fd0 2024-09-17T01:37:46.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.992+0000 7fe32fe00640 1 --2- 172.21.15.42:0/1573179060 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe314078b90 0x7fe31407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:46.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.993+0000 7fe32fe00640 1 --2- 172.21.15.42:0/1573179060 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe314078b90 0x7fe31407b0a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe320035000 tx=0x7fe3200046c0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:46.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:46.996+0000 7fe32f400640 1 -- 172.21.15.42:0/1573179060 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe3380b43a0 con 0x7fe31c003fd0 2024-09-17T01:37:47.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.189+0000 7fe33e400640 1 -- 172.21.15.42:0/1573179060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fe33815cec0 con 0x7fe31c003fd0 2024-09-17T01:37:47.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.193+0000 7fe32f400640 1 -- 172.21.15.42:0/1573179060 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v45)=0 v45) ==== 122+0+0 (secure 0 0 0) 0x7fe33815c540 con 0x7fe31c003fd0 2024-09-17T01:37:47.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.195+0000 7fe33e400640 1 -- 172.21.15.42:0/1573179060 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe314078b90 msgr2=0x7fe31407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:47.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.195+0000 7fe33e400640 1 --2- 172.21.15.42:0/1573179060 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe314078b90 0x7fe31407b0a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe320035000 tx=0x7fe3200046c0 comp rx=0 tx=0).stop 2024-09-17T01:37:47.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.195+0000 7fe33e400640 1 -- 172.21.15.42:0/1573179060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe31c003fd0 msgr2=0x7fe33806fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:47.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.195+0000 7fe33e400640 1 --2- 172.21.15.42:0/1573179060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe31c003fd0 0x7fe33806fdd0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fe328011b50 tx=0x7fe32800f790 comp rx=0 tx=0).stop 2024-09-17T01:37:47.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.196+0000 7fe33e400640 1 -- 172.21.15.42:0/1573179060 shutdown_connections 2024-09-17T01:37:47.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.196+0000 7fe33e400640 1 --2- 172.21.15.42:0/1573179060 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe314078b90 0x7fe31407b0a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:47.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.196+0000 7fe33e400640 1 --2- 172.21.15.42:0/1573179060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe33815bbf0 0x7fe33815c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:47.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.196+0000 7fe33e400640 1 --2- 172.21.15.42:0/1573179060 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe3381597b0 0x7fe338135c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:47.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.196+0000 7fe33e400640 1 --2- 172.21.15.42:0/1573179060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe31c003fd0 0x7fe33806fdd0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:47.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.196+0000 7fe33e400640 1 -- 172.21.15.42:0/1573179060 >> 172.21.15.42:0/1573179060 conn(0x7fe3380b2930 msgr2=0x7fe33815f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:47.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.196+0000 7fe33e400640 1 -- 172.21.15.42:0/1573179060 shutdown_connections 2024-09-17T01:37:47.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.196+0000 7fe33e400640 1 -- 172.21.15.42:0/1573179060 wait complete. 2024-09-17T01:37:47.220 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:37:47.220 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:37:47.310 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:37:47.410 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:37:47.410 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:37:47.410 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:37:47.446 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:37:47.446 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:37:47.446 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:37:47.483 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:37:47.484 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:37:47.484 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:37:47.523 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:37:47.524 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:37:47.524 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:37:47.560 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:37:47.560 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T01:37:47.561 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:37:47.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.790+0000 7fb295800640 1 -- 172.21.15.42:0/3541604940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2900cec40 msgr2=0x7fb2900cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:47.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.790+0000 7fb295800640 1 --2- 172.21.15.42:0/3541604940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2900cec40 0x7fb2900cf050 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fb290071ef0 tx=0x7fb28802aa30 comp rx=0 tx=0).stop 2024-09-17T01:37:47.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.791+0000 7fb295800640 1 -- 172.21.15.42:0/3541604940 shutdown_connections 2024-09-17T01:37:47.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.791+0000 7fb295800640 1 --2- 172.21.15.42:0/3541604940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2900cec40 0x7fb2900cf050 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:47.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.791+0000 7fb295800640 1 --2- 172.21.15.42:0/3541604940 >> v2:172.21.15.43:3300/0 conn(0x7fb2900b3550 0x7fb29015cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:47.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.791+0000 7fb295800640 1 -- 172.21.15.42:0/3541604940 >> 172.21.15.42:0/3541604940 conn(0x7fb2900b2930 msgr2=0x7fb29006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:47.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.791+0000 7fb295800640 1 -- 172.21.15.42:0/3541604940 shutdown_connections 2024-09-17T01:37:47.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.791+0000 7fb295800640 1 -- 172.21.15.42:0/3541604940 wait complete. 2024-09-17T01:37:47.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.793+0000 7fb295800640 1 Processor -- start 2024-09-17T01:37:47.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.793+0000 7fb295800640 1 -- start start 2024-09-17T01:37:47.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.795+0000 7fb295800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2900b3550 0x7fb290159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:47.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.795+0000 7fb295800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2900cec40 0x7fb2900ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:47.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.795+0000 7fb295800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb290142f40 0x7fb2900aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:47.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.795+0000 7fb295800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb29006d7c0 con 0x7fb2900b3550 2024-09-17T01:37:47.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.795+0000 7fb295800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb29006d640 con 0x7fb2900cec40 2024-09-17T01:37:47.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.795+0000 7fb295800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb29006d940 con 0x7fb290142f40 2024-09-17T01:37:47.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.795+0000 7fb28ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2900b3550 0x7fb290159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:47.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.795+0000 7fb28ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2900b3550 0x7fb290159560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42076/0 (socket says 172.21.15.42:42076) 2024-09-17T01:37:47.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.795+0000 7fb28ea00640 1 -- 172.21.15.42:0/624465957 learned_addr learned my addr 172.21.15.42:0/624465957 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:47.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.795+0000 7fb28ea00640 1 -- 172.21.15.42:0/624465957 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb290142f40 msgr2=0x7fb2900aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:47.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.795+0000 7fb286000640 1 --2- 172.21.15.42:0/624465957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2900cec40 0x7fb2900ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:47.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.795+0000 7fb28f400640 1 --2- 172.21.15.42:0/624465957 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb290142f40 0x7fb2900aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:47.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.795+0000 7fb28ea00640 1 --2- 172.21.15.42:0/624465957 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb290142f40 0x7fb2900aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:47.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.795+0000 7fb28ea00640 1 -- 172.21.15.42:0/624465957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2900cec40 msgr2=0x7fb2900ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:47.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.795+0000 7fb28ea00640 1 --2- 172.21.15.42:0/624465957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2900cec40 0x7fb2900ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:47.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.795+0000 7fb28ea00640 1 -- 172.21.15.42:0/624465957 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb29006f0b0 con 0x7fb2900b3550 2024-09-17T01:37:47.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.795+0000 7fb286000640 1 --2- 172.21.15.42:0/624465957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2900cec40 0x7fb2900ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:37:47.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.796+0000 7fb28ea00640 1 --2- 172.21.15.42:0/624465957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2900b3550 0x7fb290159560 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fb28000e790 tx=0x7fb28000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:47.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.796+0000 7fb287400640 1 -- 172.21.15.42:0/624465957 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28000eea0 con 0x7fb2900b3550 2024-09-17T01:37:47.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.796+0000 7fb287400640 1 -- 172.21.15.42:0/624465957 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb28000cdb0 con 0x7fb2900b3550 2024-09-17T01:37:47.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.796+0000 7fb287400640 1 -- 172.21.15.42:0/624465957 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb280010690 con 0x7fb2900b3550 2024-09-17T01:37:47.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.796+0000 7fb295800640 1 -- 172.21.15.42:0/624465957 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb29006f5e0 con 0x7fb2900b3550 2024-09-17T01:37:47.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.796+0000 7fb295800640 1 -- 172.21.15.42:0/624465957 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2900c5890 con 0x7fb2900b3550 2024-09-17T01:37:47.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.797+0000 7fb295800640 1 -- 172.21.15.42:0/624465957 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb29015cec0 con 0x7fb2900b3550 2024-09-17T01:37:47.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.798+0000 7fb287400640 1 -- 172.21.15.42:0/624465957 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb280010830 con 0x7fb2900b3550 2024-09-17T01:37:47.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.799+0000 7fb287400640 1 --2- 172.21.15.42:0/624465957 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb26c078b90 0x7fb26c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:47.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.799+0000 7fb287400640 1 -- 172.21.15.42:0/624465957 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5029+0+0 (secure 0 0 0) 0x7fb28009b500 con 0x7fb2900b3550 2024-09-17T01:37:47.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.800+0000 7fb286000640 1 --2- 172.21.15.42:0/624465957 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb26c078b90 0x7fb26c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:47.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.800+0000 7fb286000640 1 --2- 172.21.15.42:0/624465957 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb26c078b90 0x7fb26c07b0a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb2900746f0 tx=0x7fb278009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:47.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:47.804+0000 7fb287400640 1 -- 172.21.15.42:0/624465957 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb280063bd0 con 0x7fb2900b3550 2024-09-17T01:37:48.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.036+0000 7fb295800640 1 -- 172.21.15.42:0/624465957 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb29006a170 con 0x7fb2900b3550 2024-09-17T01:37:48.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.037+0000 7fb287400640 1 -- 172.21.15.42:0/624465957 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+3908 (secure 0 0 0) 0x7fb2800634d0 con 0x7fb2900b3550 2024-09-17T01:37:48.036 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:48.036 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":65,"btime":"2024-09-17T01:37:39:798126+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6119,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/1918787537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1918787537},{"type":"v1","addr":"172.21.15.43:6835","nonce":1918787537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6646,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2741360699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":2741360699},{"type":"v1","addr":"172.21.15.43:6837","nonce":2741360699}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6957,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/2289144423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2289144423},{"type":"v1","addr":"172.21.15.42:6833","nonce":2289144423}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7104,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/607797105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":607797105},{"type":"v1","addr":"172.21.15.42:6835","nonce":607797105}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[]} 2024-09-17T01:37:48.036 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 65 2024-09-17T01:37:48.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.039+0000 7fb295800640 1 -- 172.21.15.42:0/624465957 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb26c078b90 msgr2=0x7fb26c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:48.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.039+0000 7fb295800640 1 --2- 172.21.15.42:0/624465957 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb26c078b90 0x7fb26c07b0a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb2900746f0 tx=0x7fb278009040 comp rx=0 tx=0).stop 2024-09-17T01:37:48.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.039+0000 7fb295800640 1 -- 172.21.15.42:0/624465957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2900b3550 msgr2=0x7fb290159560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:48.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.039+0000 7fb295800640 1 --2- 172.21.15.42:0/624465957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2900b3550 0x7fb290159560 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fb28000e790 tx=0x7fb28000ec50 comp rx=0 tx=0).stop 2024-09-17T01:37:48.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.039+0000 7fb295800640 1 -- 172.21.15.42:0/624465957 shutdown_connections 2024-09-17T01:37:48.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.039+0000 7fb295800640 1 --2- 172.21.15.42:0/624465957 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb26c078b90 0x7fb26c07b0a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:48.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.039+0000 7fb295800640 1 --2- 172.21.15.42:0/624465957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2900cec40 0x7fb2900ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:48.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.039+0000 7fb295800640 1 --2- 172.21.15.42:0/624465957 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb290142f40 0x7fb2900aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:48.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.039+0000 7fb295800640 1 --2- 172.21.15.42:0/624465957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb2900b3550 0x7fb290159560 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:48.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.039+0000 7fb295800640 1 -- 172.21.15.42:0/624465957 >> 172.21.15.42:0/624465957 conn(0x7fb2900b2930 msgr2=0x7fb29015be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:48.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.039+0000 7fb295800640 1 -- 172.21.15.42:0/624465957 shutdown_connections 2024-09-17T01:37:48.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.039+0000 7fb295800640 1 -- 172.21.15.42:0/624465957 wait complete. 2024-09-17T01:37:48.061 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T01:37:48.061 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T01:37:48.061 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T01:37:48.062 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:37:48.062 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T01:37:48.062 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T01:37:48.062 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T01:37:48.062 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:37:48.062 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T01:37:48.062 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T01:37:48.063 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T01:37:48.063 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:37:48.063 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T01:37:48.063 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T01:37:48.063 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T01:37:48.063 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:37:48.089 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T01:37:48.090 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T01:37:48.093 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T01:37:48.094 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T01:37:48.097 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T01:37:48.097 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T01:37:48.099 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T01:37:48.099 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T01:37:48.137 INFO:tasks.ceph.mds.a:Started 2024-09-17T01:37:48.137 DEBUG:teuthology.parallel:result is None 2024-09-17T01:37:48.140 INFO:tasks.ceph.mds.c:Started 2024-09-17T01:37:48.140 DEBUG:teuthology.parallel:result is None 2024-09-17T01:37:48.142 INFO:tasks.ceph.mds.d:Started 2024-09-17T01:37:48.143 DEBUG:teuthology.parallel:result is None 2024-09-17T01:37:48.145 INFO:tasks.ceph.mds.b:Started 2024-09-17T01:37:48.145 DEBUG:teuthology.parallel:result is None 2024-09-17T01:37:48.145 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T01:37:48.338 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:37:48.341 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:37:48.347 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-09-17T01:37:48.347 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-09-17T01:37:48.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.387+0000 7f3ce0c00640 1 -- 172.21.15.42:0/371615631 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cdc06d430 msgr2=0x7f3cdc06d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:48.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.387+0000 7f3ce0c00640 1 --2- 172.21.15.42:0/371615631 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cdc06d430 0x7f3cdc06d840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009be0 tx=0x7f3cd402a8b0 comp rx=0 tx=0).stop 2024-09-17T01:37:48.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.387+0000 7f3ce0c00640 1 -- 172.21.15.42:0/371615631 shutdown_connections 2024-09-17T01:37:48.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.387+0000 7f3ce0c00640 1 --2- 172.21.15.42:0/371615631 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cdc06d430 0x7f3cdc06d840 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:48.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.387+0000 7f3ce0c00640 1 -- 172.21.15.42:0/371615631 >> 172.21.15.42:0/371615631 conn(0x7f3cdc0b2930 msgr2=0x7f3cdc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:48.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.387+0000 7f3ce0c00640 1 -- 172.21.15.42:0/371615631 shutdown_connections 2024-09-17T01:37:48.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.387+0000 7f3ce0c00640 1 -- 172.21.15.42:0/371615631 wait complete. 2024-09-17T01:37:48.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.389+0000 7f3ce0c00640 1 Processor -- start 2024-09-17T01:37:48.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.389+0000 7f3ce0c00640 1 -- start start 2024-09-17T01:37:48.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.390+0000 7f3ce0c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cdc06d430 0x7f3cdc159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:48.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.390+0000 7f3ce0c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cdc0b5100 0x7f3cdc142c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:48.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.390+0000 7f3ce0c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cdc0cef70 0x7f3cdc157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:48.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.390+0000 7f3ce0c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3cdc073b50 con 0x7f3cdc0b5100 2024-09-17T01:37:48.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.390+0000 7f3ce0c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3cdc0739d0 con 0x7f3cdc0cef70 2024-09-17T01:37:48.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.390+0000 7f3ce0c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3cdc073cd0 con 0x7f3cdc06d430 2024-09-17T01:37:48.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.391+0000 7f3cd9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cdc0b5100 0x7f3cdc142c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:48.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.391+0000 7f3cd9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cdc0b5100 0x7f3cdc142c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42110/0 (socket says 172.21.15.42:42110) 2024-09-17T01:37:48.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.391+0000 7f3cd9400640 1 -- 172.21.15.42:0/3539716084 learned_addr learned my addr 172.21.15.42:0/3539716084 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:48.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.391+0000 7f3cd9e00640 1 --2- 172.21.15.42:0/3539716084 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cdc06d430 0x7f3cdc159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:48.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.391+0000 7f3cda800640 1 --2- 172.21.15.42:0/3539716084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cdc0cef70 0x7f3cdc157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:48.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.391+0000 7f3cd9400640 1 -- 172.21.15.42:0/3539716084 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cdc06d430 msgr2=0x7f3cdc159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:48.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.391+0000 7f3cd9400640 1 --2- 172.21.15.42:0/3539716084 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cdc06d430 0x7f3cdc159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:48.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.391+0000 7f3cd9400640 1 -- 172.21.15.42:0/3539716084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cdc0cef70 msgr2=0x7f3cdc157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:48.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.391+0000 7f3cd9400640 1 --2- 172.21.15.42:0/3539716084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cdc0cef70 0x7f3cdc157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:48.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.391+0000 7f3cd9400640 1 -- 172.21.15.42:0/3539716084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cdc15f9e0 con 0x7f3cdc0b5100 2024-09-17T01:37:48.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.391+0000 7f3cda800640 1 --2- 172.21.15.42:0/3539716084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cdc0cef70 0x7f3cdc157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:48.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.392+0000 7f3cd9400640 1 --2- 172.21.15.42:0/3539716084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cdc0b5100 0x7f3cdc142c00 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f3cc800c730 tx=0x7f3cc800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:48.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.392+0000 7f3cd2000640 1 -- 172.21.15.42:0/3539716084 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8016020 con 0x7f3cdc0b5100 2024-09-17T01:37:48.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.392+0000 7f3cd2000640 1 -- 172.21.15.42:0/3539716084 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cc800a930 con 0x7f3cdc0b5100 2024-09-17T01:37:48.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.392+0000 7f3cd2000640 1 -- 172.21.15.42:0/3539716084 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc800ad80 con 0x7f3cdc0b5100 2024-09-17T01:37:48.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.392+0000 7f3ce0c00640 1 -- 172.21.15.42:0/3539716084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cdc1f9500 con 0x7f3cdc0b5100 2024-09-17T01:37:48.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.392+0000 7f3ce0c00640 1 -- 172.21.15.42:0/3539716084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cdc1f9ac0 con 0x7f3cdc0b5100 2024-09-17T01:37:48.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.393+0000 7f3ce0c00640 1 -- 172.21.15.42:0/3539716084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cdc06d840 con 0x7f3cdc0b5100 2024-09-17T01:37:48.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.395+0000 7f3cd2000640 1 -- 172.21.15.42:0/3539716084 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3cc8019020 con 0x7f3cdc0b5100 2024-09-17T01:37:48.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.395+0000 7f3cd2000640 1 --2- 172.21.15.42:0/3539716084 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3cbc078b90 0x7f3cbc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:48.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.396+0000 7f3cd2000640 1 -- 172.21.15.42:0/3539716084 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5029+0+0 (secure 0 0 0) 0x7f3cc809abe0 con 0x7f3cdc0b5100 2024-09-17T01:37:48.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.396+0000 7f3cd9e00640 1 --2- 172.21.15.42:0/3539716084 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3cbc078b90 0x7f3cbc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:48.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.397+0000 7f3cd9e00640 1 --2- 172.21.15.42:0/3539716084 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3cbc078b90 0x7f3cbc07b0a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc001120 tx=0x7f3ccc009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:48.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.400+0000 7f3cd2000640 1 -- 172.21.15.42:0/3539716084 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3cc8020020 con 0x7f3cdc0b5100 2024-09-17T01:37:48.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:48.607+0000 7f3ce0c00640 1 -- 172.21.15.42:0/3539716084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f3cdc15f770 con 0x7f3cdc0b5100 2024-09-17T01:37:49.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.275+0000 7f3cd2000640 1 -- 172.21.15.42:0/3539716084 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v87) ==== 97+0+0 (secure 0 0 0) 0x7f3cdc06dd80 con 0x7f3cdc0b5100 2024-09-17T01:37:49.274 INFO:teuthology.orchestra.run.smithi042.stderr: removed all blocklist entries 2024-09-17T01:37:49.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.278+0000 7f3ce0c00640 1 -- 172.21.15.42:0/3539716084 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3cbc078b90 msgr2=0x7f3cbc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:49.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.278+0000 7f3ce0c00640 1 --2- 172.21.15.42:0/3539716084 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3cbc078b90 0x7f3cbc07b0a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc001120 tx=0x7f3ccc009040 comp rx=0 tx=0).stop 2024-09-17T01:37:49.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.278+0000 7f3ce0c00640 1 -- 172.21.15.42:0/3539716084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cdc0b5100 msgr2=0x7f3cdc142c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:49.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.278+0000 7f3ce0c00640 1 --2- 172.21.15.42:0/3539716084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cdc0b5100 0x7f3cdc142c00 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f3cc800c730 tx=0x7f3cc800cb30 comp rx=0 tx=0).stop 2024-09-17T01:37:49.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.278+0000 7f3ce0c00640 1 -- 172.21.15.42:0/3539716084 shutdown_connections 2024-09-17T01:37:49.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.278+0000 7f3ce0c00640 1 --2- 172.21.15.42:0/3539716084 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3cbc078b90 0x7f3cbc07b0a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:49.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.278+0000 7f3ce0c00640 1 --2- 172.21.15.42:0/3539716084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cdc0cef70 0x7f3cdc157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:49.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.278+0000 7f3ce0c00640 1 --2- 172.21.15.42:0/3539716084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cdc0b5100 0x7f3cdc142c00 secure :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f3cc800c730 tx=0x7f3cc800cb30 comp rx=0 tx=0).stop 2024-09-17T01:37:49.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.278+0000 7f3ce0c00640 1 --2- 172.21.15.42:0/3539716084 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cdc06d430 0x7f3cdc159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:49.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.278+0000 7f3ce0c00640 1 -- 172.21.15.42:0/3539716084 >> 172.21.15.42:0/3539716084 conn(0x7f3cdc0b2930 msgr2=0x7f3cdc156e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:49.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.279+0000 7f3ce0c00640 1 -- 172.21.15.42:0/3539716084 shutdown_connections 2024-09-17T01:37:49.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.279+0000 7f3ce0c00640 1 -- 172.21.15.42:0/3539716084 wait complete. 2024-09-17T01:37:49.304 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T01:37:49.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.536+0000 7ff76be00640 1 -- 172.21.15.42:0/572691479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff76c0b6030 msgr2=0x7ff76c0b6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:49.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.536+0000 7ff76be00640 1 --2- 172.21.15.42:0/572691479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff76c0b6030 0x7ff76c0b6440 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7ff764005fd0 tx=0x7ff76402a820 comp rx=0 tx=0).stop 2024-09-17T01:37:49.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.536+0000 7ff76be00640 1 -- 172.21.15.42:0/572691479 shutdown_connections 2024-09-17T01:37:49.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.536+0000 7ff76be00640 1 --2- 172.21.15.42:0/572691479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff76c0b6030 0x7ff76c0b6440 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:49.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.536+0000 7ff76be00640 1 --2- 172.21.15.42:0/572691479 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff76c073340 0x7ff76c0d2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:49.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.536+0000 7ff76be00640 1 -- 172.21.15.42:0/572691479 >> 172.21.15.42:0/572691479 conn(0x7ff76c0d1210 msgr2=0x7ff76c0d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:49.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.536+0000 7ff76be00640 1 -- 172.21.15.42:0/572691479 shutdown_connections 2024-09-17T01:37:49.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.536+0000 7ff76be00640 1 -- 172.21.15.42:0/572691479 wait complete. 2024-09-17T01:37:49.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.538+0000 7ff76be00640 1 Processor -- start 2024-09-17T01:37:49.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.538+0000 7ff76be00640 1 -- start start 2024-09-17T01:37:49.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.540+0000 7ff76be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff76c073340 0x7ff76c0729c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:49.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.540+0000 7ff76be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff76c0b6030 0x7ff76c15aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:49.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.540+0000 7ff76be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff76c162fa0 0x7ff76c070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:49.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.540+0000 7ff76be00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c15f850 con 0x7ff76c0b6030 2024-09-17T01:37:49.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.540+0000 7ff76be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c15f6d0 con 0x7ff76c073340 2024-09-17T01:37:49.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.540+0000 7ff76be00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff76c15f9d0 con 0x7ff76c162fa0 2024-09-17T01:37:49.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.540+0000 7ff762000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff76c0b6030 0x7ff76c15aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:49.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.540+0000 7ff762000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff76c0b6030 0x7ff76c15aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42124/0 (socket says 172.21.15.42:42124) 2024-09-17T01:37:49.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.540+0000 7ff762000640 1 -- 172.21.15.42:0/2569435334 learned_addr learned my addr 172.21.15.42:0/2569435334 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:49.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.540+0000 7ff76aa00640 1 --2- 172.21.15.42:0/2569435334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff76c073340 0x7ff76c0729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:49.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.540+0000 7ff76b400640 1 --2- 172.21.15.42:0/2569435334 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff76c162fa0 0x7ff76c070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:49.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.541+0000 7ff762000640 1 -- 172.21.15.42:0/2569435334 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff76c162fa0 msgr2=0x7ff76c070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:49.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.541+0000 7ff762000640 1 --2- 172.21.15.42:0/2569435334 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff76c162fa0 0x7ff76c070bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:49.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.541+0000 7ff762000640 1 -- 172.21.15.42:0/2569435334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff76c073340 msgr2=0x7ff76c0729c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:49.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.541+0000 7ff762000640 1 --2- 172.21.15.42:0/2569435334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff76c073340 0x7ff76c0729c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:49.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.541+0000 7ff762000640 1 -- 172.21.15.42:0/2569435334 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76c072f00 con 0x7ff76c0b6030 2024-09-17T01:37:49.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.541+0000 7ff762000640 1 --2- 172.21.15.42:0/2569435334 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff76c0b6030 0x7ff76c15aa90 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7ff75400c3c0 tx=0x7ff75400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:49.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.541+0000 7ff763e00640 1 -- 172.21.15.42:0/2569435334 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754017070 con 0x7ff76c0b6030 2024-09-17T01:37:49.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.541+0000 7ff763e00640 1 -- 172.21.15.42:0/2569435334 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7540035f0 con 0x7ff76c0b6030 2024-09-17T01:37:49.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.541+0000 7ff76be00640 1 -- 172.21.15.42:0/2569435334 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff76c0b8fb0 con 0x7ff76c0b6030 2024-09-17T01:37:49.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.541+0000 7ff763e00640 1 -- 172.21.15.42:0/2569435334 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754003a40 con 0x7ff76c0b6030 2024-09-17T01:37:49.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.541+0000 7ff76be00640 1 -- 172.21.15.42:0/2569435334 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff76c0b9570 con 0x7ff76c0b6030 2024-09-17T01:37:49.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.542+0000 7ff76be00640 1 -- 172.21.15.42:0/2569435334 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff76c0c9190 con 0x7ff76c0b6030 2024-09-17T01:37:49.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.544+0000 7ff763e00640 1 -- 172.21.15.42:0/2569435334 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff75401a070 con 0x7ff76c0b6030 2024-09-17T01:37:49.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.545+0000 7ff763e00640 1 --2- 172.21.15.42:0/2569435334 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff748078b90 0x7ff74807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:49.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.545+0000 7ff763e00640 1 -- 172.21.15.42:0/2569435334 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 4857+0+0 (secure 0 0 0) 0x7ff754099c40 con 0x7ff76c0b6030 2024-09-17T01:37:49.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.545+0000 7ff76aa00640 1 --2- 172.21.15.42:0/2569435334 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff748078b90 0x7ff74807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:49.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.546+0000 7ff76aa00640 1 --2- 172.21.15.42:0/2569435334 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff748078b90 0x7ff74807b0a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff75c005fd0 tx=0x7ff75c005850 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:49.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.549+0000 7ff763e00640 1 -- 172.21.15.42:0/2569435334 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff76c0b6980 con 0x7ff76c0b6030 2024-09-17T01:37:49.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.812+0000 7ff76be00640 1 -- 172.21.15.42:0/2569435334 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ff76c15fef0 con 0x7ff76c0b6030 2024-09-17T01:37:49.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.813+0000 7ff763e00640 1 -- 172.21.15.42:0/2569435334 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v32) ==== 80+0+5304 (secure 0 0 0) 0x7ff754062450 con 0x7ff76c0b6030 2024-09-17T01:37:49.811 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:49.812 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:37:49.812 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_dump": [ 2024-09-17T01:37:49.812 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:37:49.812 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.a", 2024-09-17T01:37:49.812 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmyJK4HRAAIC4E4V7p1fqIEfPIICMxZg==", 2024-09-17T01:37:49.812 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:37:49.812 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:37:49.812 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:37:49.812 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:37:49.812 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:37:49.812 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:37:49.812 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:37:49.813 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:37:49.813 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.b", 2024-09-17T01:37:49.813 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmXv3vORAALPrYIM6Vtz0g1pOxVhrUig==", 2024-09-17T01:37:49.813 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:37:49.813 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:37:49.813 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:37:49.813 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:37:49.813 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:37:49.813 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:37:49.813 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:37:49.813 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:37:49.813 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.c", 2024-09-17T01:37:49.814 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmPE7MKxAA9mGG+EO9C3VGVMerOm92+Q==", 2024-09-17T01:37:49.814 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:37:49.814 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:37:49.814 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:37:49.814 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:37:49.814 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:37:49.814 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:37:49.814 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:37:49.814 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:37:49.814 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.d", 2024-09-17T01:37:49.814 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmaOBSDBAATU4tpjM5IMcuvzZFE7N5bQ==", 2024-09-17T01:37:49.814 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:37:49.814 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:37:49.815 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:37:49.815 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:37:49.815 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:37:49.815 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:37:49.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:37:49.815 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:37:49.815 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.0", 2024-09-17T01:37:49.815 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDP2+hmEJebExAAAdGEoSzM96ybGT9h7t7OkA==", 2024-09-17T01:37:49.815 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:37:49.815 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:37:49.815 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:37:49.815 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:37:49.815 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:37:49.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:37:49.816 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:37:49.816 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.1", 2024-09-17T01:37:49.816 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDS2+hm7dWoMBAAagktrUl0O2/mgKCEfpAstA==", 2024-09-17T01:37:49.816 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:37:49.816 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:37:49.816 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:37:49.816 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:37:49.816 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:37:49.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:37:49.816 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:37:49.816 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.2", 2024-09-17T01:37:49.816 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDW2+hmEfSPBBAAPAa6EZt27yUcJSfZyCKheg==", 2024-09-17T01:37:49.817 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:37:49.817 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:37:49.817 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:37:49.817 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:37:49.817 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:37:49.817 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:37:49.817 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:37:49.817 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.3", 2024-09-17T01:37:49.817 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDZ2+hmHQhXFRAAj84g+IKqH6KMP7LjRtFvLw==", 2024-09-17T01:37:49.817 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:37:49.817 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:37:49.817 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:37:49.817 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:37:49.818 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:37:49.818 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:37:49.818 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:37:49.818 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.4", 2024-09-17T01:37:49.818 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDd2+hmaNcMNBAAx1GV/oFdfssMjFWFN5M0VQ==", 2024-09-17T01:37:49.818 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:37:49.818 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:37:49.818 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:37:49.818 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:37:49.818 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:37:49.818 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:37:49.818 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:37:49.818 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.5", 2024-09-17T01:37:49.819 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDh2+hm301NJhAAnSUH5AAvqhPwM7loH6frww==", 2024-09-17T01:37:49.819 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:37:49.819 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:37:49.819 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:37:49.819 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:37:49.819 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:37:49.819 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:37:49.819 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:37:49.819 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.6", 2024-09-17T01:37:49.819 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDk2+hm61WNNRAAbCvVvsUpB4fgt4ja60DRZA==", 2024-09-17T01:37:49.819 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:37:49.819 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:37:49.819 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:37:49.820 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:37:49.820 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:37:49.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:37:49.820 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:37:49.820 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.7", 2024-09-17T01:37:49.820 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDo2+hmesiLFhAA29n1eageNvP+lkRyh6gGMw==", 2024-09-17T01:37:49.820 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:37:49.820 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:37:49.820 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:37:49.820 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:37:49.820 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:37:49.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:37:49.820 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:37:49.821 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.0", 2024-09-17T01:37:49.821 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA==", 2024-09-17T01:37:49.821 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:37:49.821 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:37:49.821 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow r", 2024-09-17T01:37:49.821 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T01:37:49.821 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:37:49.821 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:37:49.821 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:37:49.821 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.1", 2024-09-17T01:37:49.821 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmZLygLhAABlauZgnidFWvfCCPuBLObg==", 2024-09-17T01:37:49.821 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:37:49.822 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:37:49.822 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:37:49.822 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:37:49.822 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:37:49.822 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:37:49.822 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:37:49.822 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:37:49.822 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.2", 2024-09-17T01:37:49.822 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hm8lnZIxAAN0a2CVMMtu/Nz50OG4a02A==", 2024-09-17T01:37:49.822 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:37:49.822 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:37:49.822 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:37:49.822 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:37:49.822 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:37:49.822 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:37:49.823 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:37:49.823 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:37:49.823 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.3", 2024-09-17T01:37:49.823 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmgXdAORAAM5Uy66I4nnTJ9Vhkn9JoBw==", 2024-09-17T01:37:49.823 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:37:49.823 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:37:49.823 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:37:49.823 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:37:49.823 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:37:49.823 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:37:49.823 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:37:49.823 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:37:49.823 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.admin", 2024-09-17T01:37:49.824 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDL2+hmvCreHBAA4CSAhosssViGqD93U+I7Iw==", 2024-09-17T01:37:49.824 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:37:49.824 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:37:49.824 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:37:49.824 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:37:49.824 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:37:49.824 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:37:49.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:37:49.824 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:37:49.824 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.x", 2024-09-17T01:37:49.824 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmYPnlEhAAIcQ11ktWZyMXYdbAONiLog==", 2024-09-17T01:37:49.824 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:37:49.824 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:37:49.824 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:37:49.825 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:37:49.825 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:37:49.825 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:37:49.825 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:37:49.825 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.y", 2024-09-17T01:37:49.825 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmpCZtBxAAp5tXMc6aEq1aOny2LJZAiA==", 2024-09-17T01:37:49.825 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:37:49.825 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:37:49.825 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:37:49.825 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:37:49.825 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:37:49.825 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:37:49.825 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-17T01:37:49.826 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:37:49.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.815+0000 7ff76be00640 1 -- 172.21.15.42:0/2569435334 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff748078b90 msgr2=0x7ff74807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:49.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.815+0000 7ff76be00640 1 --2- 172.21.15.42:0/2569435334 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff748078b90 0x7ff74807b0a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff75c005fd0 tx=0x7ff75c005850 comp rx=0 tx=0).stop 2024-09-17T01:37:49.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.815+0000 7ff76be00640 1 -- 172.21.15.42:0/2569435334 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff76c0b6030 msgr2=0x7ff76c15aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:49.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.815+0000 7ff76be00640 1 --2- 172.21.15.42:0/2569435334 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff76c0b6030 0x7ff76c15aa90 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7ff75400c3c0 tx=0x7ff75400c880 comp rx=0 tx=0).stop 2024-09-17T01:37:49.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.815+0000 7ff76be00640 1 -- 172.21.15.42:0/2569435334 shutdown_connections 2024-09-17T01:37:49.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.815+0000 7ff76be00640 1 --2- 172.21.15.42:0/2569435334 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff748078b90 0x7ff74807b0a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:49.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.815+0000 7ff76be00640 1 --2- 172.21.15.42:0/2569435334 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff76c162fa0 0x7ff76c070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:49.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.815+0000 7ff76be00640 1 --2- 172.21.15.42:0/2569435334 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff76c0b6030 0x7ff76c15aa90 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:49.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.815+0000 7ff76be00640 1 --2- 172.21.15.42:0/2569435334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff76c073340 0x7ff76c0729c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:49.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.815+0000 7ff76be00640 1 -- 172.21.15.42:0/2569435334 >> 172.21.15.42:0/2569435334 conn(0x7ff76c0d1210 msgr2=0x7ff76c0b4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:49.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.815+0000 7ff76be00640 1 -- 172.21.15.42:0/2569435334 shutdown_connections 2024-09-17T01:37:49.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:49.815+0000 7ff76be00640 1 -- 172.21.15.42:0/2569435334 wait complete. 2024-09-17T01:37:49.838 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T01:37:50.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.067+0000 7fb66e200640 1 -- 172.21.15.42:0/3951087393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb66806d430 msgr2=0x7fb668152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:50.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.067+0000 7fb66e200640 1 --2- 172.21.15.42:0/3951087393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb66806d430 0x7fb668152ed0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fb668071cb0 tx=0x7fb66002aa10 comp rx=0 tx=0).stop 2024-09-17T01:37:50.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.067+0000 7fb66e200640 1 -- 172.21.15.42:0/3951087393 shutdown_connections 2024-09-17T01:37:50.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.067+0000 7fb66e200640 1 --2- 172.21.15.42:0/3951087393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb66806d430 0x7fb668152ed0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:50.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.067+0000 7fb66e200640 1 --2- 172.21.15.42:0/3951087393 >> v2:172.21.15.43:3300/0 conn(0x7fb6680b4be0 0x7fb66815d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:50.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.067+0000 7fb66e200640 1 -- 172.21.15.42:0/3951087393 >> 172.21.15.42:0/3951087393 conn(0x7fb6680b25f0 msgr2=0x7fb6680d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:50.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.067+0000 7fb66e200640 1 -- 172.21.15.42:0/3951087393 shutdown_connections 2024-09-17T01:37:50.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.067+0000 7fb66e200640 1 -- 172.21.15.42:0/3951087393 wait complete. 2024-09-17T01:37:50.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.069+0000 7fb66e200640 1 Processor -- start 2024-09-17T01:37:50.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.069+0000 7fb66e200640 1 -- start start 2024-09-17T01:37:50.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.071+0000 7fb66e200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb6680b4be0 0x7fb6680728d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:50.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.071+0000 7fb66e200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6680cf7c0 0x7fb6681517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:50.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.071+0000 7fb66e200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6680ad4e0 0x7fb6680b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:50.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.071+0000 7fb66e200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb6681537a0 con 0x7fb6680ad4e0 2024-09-17T01:37:50.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.071+0000 7fb66e200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb668153620 con 0x7fb6680cf7c0 2024-09-17T01:37:50.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.071+0000 7fb66e200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb668153920 con 0x7fb6680b4be0 2024-09-17T01:37:50.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.071+0000 7fb66d800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6680ad4e0 0x7fb6680b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:50.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.071+0000 7fb66d800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6680ad4e0 0x7fb6680b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42142/0 (socket says 172.21.15.42:42142) 2024-09-17T01:37:50.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.071+0000 7fb66d800640 1 -- 172.21.15.42:0/637459749 learned_addr learned my addr 172.21.15.42:0/637459749 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:50.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.071+0000 7fb66ce00640 1 --2- 172.21.15.42:0/637459749 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb6680b4be0 0x7fb6680728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:50.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.071+0000 7fb65fe00640 1 --2- 172.21.15.42:0/637459749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6680cf7c0 0x7fb6681517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:50.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.071+0000 7fb66d800640 1 -- 172.21.15.42:0/637459749 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb6680b4be0 msgr2=0x7fb6680728d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:50.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.071+0000 7fb66d800640 1 --2- 172.21.15.42:0/637459749 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb6680b4be0 0x7fb6680728d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:50.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.071+0000 7fb66d800640 1 -- 172.21.15.42:0/637459749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6680cf7c0 msgr2=0x7fb6681517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:50.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.071+0000 7fb66d800640 1 --2- 172.21.15.42:0/637459749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6680cf7c0 0x7fb6681517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:50.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.071+0000 7fb66d800640 1 -- 172.21.15.42:0/637459749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6680ad2a0 con 0x7fb6680ad4e0 2024-09-17T01:37:50.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.072+0000 7fb66d800640 1 --2- 172.21.15.42:0/637459749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6680ad4e0 0x7fb6680b31c0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fb660009d60 tx=0x7fb660003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:50.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.072+0000 7fb665600640 1 -- 172.21.15.42:0/637459749 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb660033050 con 0x7fb6680ad4e0 2024-09-17T01:37:50.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.072+0000 7fb665600640 1 -- 172.21.15.42:0/637459749 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb660004450 con 0x7fb6680ad4e0 2024-09-17T01:37:50.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.072+0000 7fb66e200640 1 -- 172.21.15.42:0/637459749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6681f8e70 con 0x7fb6680ad4e0 2024-09-17T01:37:50.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.072+0000 7fb665600640 1 -- 172.21.15.42:0/637459749 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb660004860 con 0x7fb6680ad4e0 2024-09-17T01:37:50.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.072+0000 7fb66e200640 1 -- 172.21.15.42:0/637459749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6681f9430 con 0x7fb6680ad4e0 2024-09-17T01:37:50.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.073+0000 7fb66e200640 1 -- 172.21.15.42:0/637459749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6681f8be0 con 0x7fb6680ad4e0 2024-09-17T01:37:50.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.074+0000 7fb665600640 1 -- 172.21.15.42:0/637459749 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb660036070 con 0x7fb6680ad4e0 2024-09-17T01:37:50.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.075+0000 7fb665600640 1 --2- 172.21.15.42:0/637459749 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb644078bc0 0x7fb64407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:50.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.075+0000 7fb665600640 1 -- 172.21.15.42:0/637459749 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 4857+0+0 (secure 0 0 0) 0x7fb6600bbce0 con 0x7fb6680ad4e0 2024-09-17T01:37:50.074 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:37:50.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.076+0000 7fb66ce00640 1 --2- 172.21.15.42:0/637459749 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb644078bc0 0x7fb64407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:50.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.077+0000 7fb66ce00640 1 --2- 172.21.15.42:0/637459749 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb644078bc0 0x7fb64407b0d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb65800bb50 tx=0x7fb65800b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:50.078 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:37:50.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.080+0000 7fb665600640 1 -- 172.21.15.42:0/637459749 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb66815dbf0 con 0x7fb6680ad4e0 2024-09-17T01:37:50.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.281+0000 7fb66e200640 1 -- 172.21.15.42:0/637459749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb668152ed0 con 0x7fb6680ad4e0 2024-09-17T01:37:50.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.281+0000 7fb665600640 1 -- 172.21.15.42:0/637459749 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v89) ==== 84+0+65 (secure 0 0 0) 0x7fb660083e10 con 0x7fb6680ad4e0 2024-09-17T01:37:50.280 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:50.280 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-09-17T01:37:50.280 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:37:50.280 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-09-17T01:37:50.280 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-09-17T01:37:50.281 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:37:50.281 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-09-17T01:37:50.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.284+0000 7fb66e200640 1 -- 172.21.15.42:0/637459749 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb644078bc0 msgr2=0x7fb64407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:50.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.284+0000 7fb66e200640 1 --2- 172.21.15.42:0/637459749 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb644078bc0 0x7fb64407b0d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb65800bb50 tx=0x7fb65800b2e0 comp rx=0 tx=0).stop 2024-09-17T01:37:50.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.284+0000 7fb66e200640 1 -- 172.21.15.42:0/637459749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6680ad4e0 msgr2=0x7fb6680b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:50.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.284+0000 7fb66e200640 1 --2- 172.21.15.42:0/637459749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6680ad4e0 0x7fb6680b31c0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fb660009d60 tx=0x7fb660003f10 comp rx=0 tx=0).stop 2024-09-17T01:37:50.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.284+0000 7fb66e200640 1 -- 172.21.15.42:0/637459749 shutdown_connections 2024-09-17T01:37:50.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.284+0000 7fb66e200640 1 --2- 172.21.15.42:0/637459749 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb644078bc0 0x7fb64407b0d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:50.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.284+0000 7fb66e200640 1 --2- 172.21.15.42:0/637459749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6680cf7c0 0x7fb6681517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:50.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.284+0000 7fb66e200640 1 --2- 172.21.15.42:0/637459749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6680ad4e0 0x7fb6680b31c0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:50.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.284+0000 7fb66e200640 1 --2- 172.21.15.42:0/637459749 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb6680b4be0 0x7fb6680728d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:50.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.284+0000 7fb66e200640 1 -- 172.21.15.42:0/637459749 >> 172.21.15.42:0/637459749 conn(0x7fb6680b25f0 msgr2=0x7fb6680b1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:50.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.284+0000 7fb66e200640 1 -- 172.21.15.42:0/637459749 shutdown_connections 2024-09-17T01:37:50.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.284+0000 7fb66e200640 1 -- 172.21.15.42:0/637459749 wait complete. 2024-09-17T01:37:50.307 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T01:37:50.308 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T01:37:50.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.541+0000 7f1c2b200640 1 -- 172.21.15.42:0/430027682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c0c003a50 msgr2=0x7f1c0c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:50.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.541+0000 7f1c2b200640 1 --2- 172.21.15.42:0/430027682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c0c003a50 0x7f1c0c003ec0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800c2e0 tx=0x7f1c0c005830 comp rx=0 tx=0).stop 2024-09-17T01:37:50.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.542+0000 7f1c2b200640 1 -- 172.21.15.42:0/430027682 shutdown_connections 2024-09-17T01:37:50.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.542+0000 7f1c2b200640 1 --2- 172.21.15.42:0/430027682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c0c003a50 0x7f1c0c003ec0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:50.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.542+0000 7f1c2b200640 1 -- 172.21.15.42:0/430027682 >> 172.21.15.42:0/430027682 conn(0x7f1c240b25d0 msgr2=0x7f1c240d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:50.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.542+0000 7f1c2b200640 1 -- 172.21.15.42:0/430027682 shutdown_connections 2024-09-17T01:37:50.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.542+0000 7f1c2b200640 1 -- 172.21.15.42:0/430027682 wait complete. 2024-09-17T01:37:50.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.544+0000 7f1c2b200640 1 Processor -- start 2024-09-17T01:37:50.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.544+0000 7f1c2b200640 1 -- start start 2024-09-17T01:37:50.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.545+0000 7f1c2b200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c0c003a50 0x7f1c241504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:50.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.545+0000 7f1c2b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c241f2bc0 0x7f1c241f5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:50.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.545+0000 7f1c2b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c241f9240 0x7f1c2415b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:50.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.546+0000 7f1c2b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2415da30 con 0x7f1c241f9240 2024-09-17T01:37:50.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.546+0000 7f1c2b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2415d8b0 con 0x7f1c241f2bc0 2024-09-17T01:37:50.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.546+0000 7f1c2b200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1c2415dbb0 con 0x7f1c0c003a50 2024-09-17T01:37:50.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.546+0000 7f1c2a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c241f9240 0x7f1c2415b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:50.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.546+0000 7f1c2a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c241f9240 0x7f1c2415b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42166/0 (socket says 172.21.15.42:42166) 2024-09-17T01:37:50.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.546+0000 7f1c2a800640 1 -- 172.21.15.42:0/928500376 learned_addr learned my addr 172.21.15.42:0/928500376 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:50.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.546+0000 7f1c29400640 1 --2- 172.21.15.42:0/928500376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c241f2bc0 0x7f1c241f5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:50.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.546+0000 7f1c29e00640 1 --2- 172.21.15.42:0/928500376 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c0c003a50 0x7f1c241504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:50.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.546+0000 7f1c2a800640 1 -- 172.21.15.42:0/928500376 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c0c003a50 msgr2=0x7f1c241504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:50.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.546+0000 7f1c2a800640 1 --2- 172.21.15.42:0/928500376 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c0c003a50 0x7f1c241504c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:50.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.546+0000 7f1c2a800640 1 -- 172.21.15.42:0/928500376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c241f2bc0 msgr2=0x7f1c241f5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:50.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.546+0000 7f1c2a800640 1 --2- 172.21.15.42:0/928500376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c241f2bc0 0x7f1c241f5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:50.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.546+0000 7f1c2a800640 1 -- 172.21.15.42:0/928500376 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c2406f930 con 0x7f1c241f9240 2024-09-17T01:37:50.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.547+0000 7f1c2a800640 1 --2- 172.21.15.42:0/928500376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c241f9240 0x7f1c2415b660 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f1c240d09c0 tx=0x7f1c200019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:50.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.547+0000 7f1c1e000640 1 -- 172.21.15.42:0/928500376 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c20011870 con 0x7f1c241f9240 2024-09-17T01:37:50.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.547+0000 7f1c1e000640 1 -- 172.21.15.42:0/928500376 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c20017070 con 0x7f1c241f9240 2024-09-17T01:37:50.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.547+0000 7f1c1e000640 1 -- 172.21.15.42:0/928500376 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c20011dc0 con 0x7f1c241f9240 2024-09-17T01:37:50.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.547+0000 7f1c2b200640 1 -- 172.21.15.42:0/928500376 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c2406fc10 con 0x7f1c241f9240 2024-09-17T01:37:50.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.547+0000 7f1c2b200640 1 -- 172.21.15.42:0/928500376 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c241f5990 con 0x7f1c241f9240 2024-09-17T01:37:50.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.548+0000 7f1c2b200640 1 -- 172.21.15.42:0/928500376 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c2406cfa0 con 0x7f1c241f9240 2024-09-17T01:37:50.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.549+0000 7f1c1e000640 1 -- 172.21.15.42:0/928500376 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1c2001c460 con 0x7f1c241f9240 2024-09-17T01:37:50.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.550+0000 7f1c1e000640 1 --2- 172.21.15.42:0/928500376 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1c08078b90 0x7f1c0807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:50.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.551+0000 7f1c1e000640 1 -- 172.21.15.42:0/928500376 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 4857+0+0 (secure 0 0 0) 0x7f1c2009b1c0 con 0x7f1c241f9240 2024-09-17T01:37:50.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.551+0000 7f1c29e00640 1 --2- 172.21.15.42:0/928500376 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1c08078b90 0x7f1c0807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:50.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.552+0000 7f1c29e00640 1 --2- 172.21.15.42:0/928500376 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1c08078b90 0x7f1c0807b0a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1c18033000 tx=0x7f1c18038040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:50.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.555+0000 7f1c1e000640 1 -- 172.21.15.42:0/928500376 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1c200638b0 con 0x7f1c241f9240 2024-09-17T01:37:50.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:50.751+0000 7f1c2b200640 1 -- 172.21.15.42:0/928500376 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1c240adba0 con 0x7f1c241f9240 2024-09-17T01:37:51.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.284+0000 7f1c1e000640 1 -- 172.21.15.42:0/928500376 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v90) ==== 138+0+0 (secure 0 0 0) 0x7f1c200631b0 con 0x7f1c241f9240 2024-09-17T01:37:51.283 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-09-17T01:37:51.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.287+0000 7f1c2b200640 1 -- 172.21.15.42:0/928500376 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1c08078b90 msgr2=0x7f1c0807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:51.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.287+0000 7f1c2b200640 1 --2- 172.21.15.42:0/928500376 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1c08078b90 0x7f1c0807b0a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1c18033000 tx=0x7f1c18038040 comp rx=0 tx=0).stop 2024-09-17T01:37:51.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.287+0000 7f1c2b200640 1 -- 172.21.15.42:0/928500376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c241f9240 msgr2=0x7f1c2415b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:51.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.287+0000 7f1c2b200640 1 --2- 172.21.15.42:0/928500376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c241f9240 0x7f1c2415b660 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f1c240d09c0 tx=0x7f1c200019b0 comp rx=0 tx=0).stop 2024-09-17T01:37:51.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.287+0000 7f1c2b200640 1 -- 172.21.15.42:0/928500376 shutdown_connections 2024-09-17T01:37:51.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.287+0000 7f1c2b200640 1 --2- 172.21.15.42:0/928500376 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1c08078b90 0x7f1c0807b0a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:51.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.287+0000 7f1c2b200640 1 --2- 172.21.15.42:0/928500376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c241f2bc0 0x7f1c241f5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:51.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.287+0000 7f1c2b200640 1 --2- 172.21.15.42:0/928500376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c241f9240 0x7f1c2415b660 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:51.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.287+0000 7f1c2b200640 1 --2- 172.21.15.42:0/928500376 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c0c003a50 0x7f1c241504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:51.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.287+0000 7f1c2b200640 1 -- 172.21.15.42:0/928500376 >> 172.21.15.42:0/928500376 conn(0x7f1c240b25d0 msgr2=0x7f1c240b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:51.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.287+0000 7f1c2b200640 1 -- 172.21.15.42:0/928500376 shutdown_connections 2024-09-17T01:37:51.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.287+0000 7f1c2b200640 1 -- 172.21.15.42:0/928500376 wait complete. 2024-09-17T01:37:51.316 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T01:37:51.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.555+0000 7fe722e00640 1 -- 172.21.15.42:0/1367112180 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe71c0b4be0 msgr2=0x7fe71c15d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:51.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.555+0000 7fe722e00640 1 --2- 172.21.15.42:0/1367112180 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe71c0b4be0 0x7fe71c15d6b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe710009830 tx=0x7fe71002a520 comp rx=0 tx=0).stop 2024-09-17T01:37:51.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.555+0000 7fe722e00640 1 -- 172.21.15.42:0/1367112180 shutdown_connections 2024-09-17T01:37:51.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.555+0000 7fe722e00640 1 --2- 172.21.15.42:0/1367112180 >> v2:172.21.15.43:3300/0 conn(0x7fe71c0cf7c0 0x7fe71c06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:51.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.555+0000 7fe722e00640 1 --2- 172.21.15.42:0/1367112180 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe71c0b4be0 0x7fe71c15d6b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:51.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.555+0000 7fe722e00640 1 -- 172.21.15.42:0/1367112180 >> 172.21.15.42:0/1367112180 conn(0x7fe71c0b25f0 msgr2=0x7fe71c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:51.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.555+0000 7fe722e00640 1 -- 172.21.15.42:0/1367112180 shutdown_connections 2024-09-17T01:37:51.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.555+0000 7fe722e00640 1 -- 172.21.15.42:0/1367112180 wait complete. 2024-09-17T01:37:51.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.558+0000 7fe722e00640 1 Processor -- start 2024-09-17T01:37:51.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.558+0000 7fe722e00640 1 -- start start 2024-09-17T01:37:51.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.559+0000 7fe722e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe71c06d260 0x7fe71c151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:51.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.559+0000 7fe722e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe71c0b4be0 0x7fe71c1f8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:51.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.559+0000 7fe722e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe71c0cf7c0 0x7fe71c1f92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:51.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.559+0000 7fe722e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c1537f0 con 0x7fe71c0b4be0 2024-09-17T01:37:51.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.559+0000 7fe722e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c0cfdc0 con 0x7fe71c0cf7c0 2024-09-17T01:37:51.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.559+0000 7fe722e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe71c153970 con 0x7fe71c06d260 2024-09-17T01:37:51.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.559+0000 7fe721000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe71c0b4be0 0x7fe71c1f8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:51.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.559+0000 7fe721000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe71c0b4be0 0x7fe71c1f8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42176/0 (socket says 172.21.15.42:42176) 2024-09-17T01:37:51.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.559+0000 7fe721000640 1 -- 172.21.15.42:0/3724689313 learned_addr learned my addr 172.21.15.42:0/3724689313 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:51.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.560+0000 7fe721a00640 1 --2- 172.21.15.42:0/3724689313 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe71c06d260 0x7fe71c151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:51.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.560+0000 7fe722400640 1 --2- 172.21.15.42:0/3724689313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe71c0cf7c0 0x7fe71c1f92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:51.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.560+0000 7fe721000640 1 -- 172.21.15.42:0/3724689313 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe71c06d260 msgr2=0x7fe71c151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:51.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.560+0000 7fe721000640 1 --2- 172.21.15.42:0/3724689313 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe71c06d260 0x7fe71c151c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:51.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.560+0000 7fe721000640 1 -- 172.21.15.42:0/3724689313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe71c0cf7c0 msgr2=0x7fe71c1f92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:51.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.560+0000 7fe721000640 1 --2- 172.21.15.42:0/3724689313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe71c0cf7c0 0x7fe71c1f92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:51.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.560+0000 7fe721000640 1 -- 172.21.15.42:0/3724689313 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71c072b00 con 0x7fe71c0b4be0 2024-09-17T01:37:51.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.560+0000 7fe722400640 1 --2- 172.21.15.42:0/3724689313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe71c0cf7c0 0x7fe71c1f92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:51.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.560+0000 7fe721000640 1 --2- 172.21.15.42:0/3724689313 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe71c0b4be0 0x7fe71c1f8d80 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fe70800e7f0 tx=0x7fe70800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:51.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.560+0000 7fe719600640 1 -- 172.21.15.42:0/3724689313 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70800eea0 con 0x7fe71c0b4be0 2024-09-17T01:37:51.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.561+0000 7fe719600640 1 -- 172.21.15.42:0/3724689313 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe70800cd50 con 0x7fe71c0b4be0 2024-09-17T01:37:51.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.561+0000 7fe719600640 1 -- 172.21.15.42:0/3724689313 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe708010690 con 0x7fe71c0b4be0 2024-09-17T01:37:51.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.561+0000 7fe722e00640 1 -- 172.21.15.42:0/3724689313 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe71c153de0 con 0x7fe71c0b4be0 2024-09-17T01:37:51.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.561+0000 7fe722e00640 1 -- 172.21.15.42:0/3724689313 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe71c15c950 con 0x7fe71c0b4be0 2024-09-17T01:37:51.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.562+0000 7fe722e00640 1 -- 172.21.15.42:0/3724689313 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe71c15d6b0 con 0x7fe71c0b4be0 2024-09-17T01:37:51.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.563+0000 7fe719600640 1 -- 172.21.15.42:0/3724689313 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe708010830 con 0x7fe71c0b4be0 2024-09-17T01:37:51.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.564+0000 7fe719600640 1 --2- 172.21.15.42:0/3724689313 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe6fc078b90 0x7fe6fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:51.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.564+0000 7fe719600640 1 -- 172.21.15.42:0/3724689313 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5227+0+0 (secure 0 0 0) 0x7fe70809b400 con 0x7fe71c0b4be0 2024-09-17T01:37:51.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.565+0000 7fe721a00640 1 --2- 172.21.15.42:0/3724689313 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe6fc078b90 0x7fe6fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:51.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.566+0000 7fe721a00640 1 --2- 172.21.15.42:0/3724689313 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe6fc078b90 0x7fe6fc07b0a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe710034000 tx=0x7fe710004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:51.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.569+0000 7fe719600640 1 -- 172.21.15.42:0/3724689313 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe7080633c0 con 0x7fe71c0b4be0 2024-09-17T01:37:51.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:51.765+0000 7fe722e00640 1 -- 172.21.15.42:0/3724689313 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe71c0b0420 con 0x7fe71c0b4be0 2024-09-17T01:37:52.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.287+0000 7fe719600640 1 -- 172.21.15.42:0/3724689313 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v91) ==== 170+0+0 (secure 0 0 0) 0x7fe708067df0 con 0x7fe71c0b4be0 2024-09-17T01:37:52.286 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-09-17T01:37:52.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.291+0000 7fe722e00640 1 -- 172.21.15.42:0/3724689313 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe6fc078b90 msgr2=0x7fe6fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:52.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.291+0000 7fe722e00640 1 --2- 172.21.15.42:0/3724689313 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe6fc078b90 0x7fe6fc07b0a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe710034000 tx=0x7fe710004730 comp rx=0 tx=0).stop 2024-09-17T01:37:52.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.291+0000 7fe722e00640 1 -- 172.21.15.42:0/3724689313 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe71c0b4be0 msgr2=0x7fe71c1f8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:52.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.291+0000 7fe722e00640 1 --2- 172.21.15.42:0/3724689313 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe71c0b4be0 0x7fe71c1f8d80 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fe70800e7f0 tx=0x7fe70800ecb0 comp rx=0 tx=0).stop 2024-09-17T01:37:52.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.292+0000 7fe722e00640 1 -- 172.21.15.42:0/3724689313 shutdown_connections 2024-09-17T01:37:52.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.292+0000 7fe722e00640 1 --2- 172.21.15.42:0/3724689313 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe6fc078b90 0x7fe6fc07b0a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:52.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.292+0000 7fe722e00640 1 --2- 172.21.15.42:0/3724689313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe71c0cf7c0 0x7fe71c1f92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:52.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.292+0000 7fe722e00640 1 --2- 172.21.15.42:0/3724689313 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe71c0b4be0 0x7fe71c1f8d80 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:52.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.292+0000 7fe722e00640 1 --2- 172.21.15.42:0/3724689313 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe71c06d260 0x7fe71c151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:52.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.292+0000 7fe722e00640 1 -- 172.21.15.42:0/3724689313 >> 172.21.15.42:0/3724689313 conn(0x7fe71c0b25f0 msgr2=0x7fe71c0afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:52.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.292+0000 7fe722e00640 1 -- 172.21.15.42:0/3724689313 shutdown_connections 2024-09-17T01:37:52.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.292+0000 7fe722e00640 1 -- 172.21.15.42:0/3724689313 wait complete. 2024-09-17T01:37:52.331 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T01:37:52.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.566+0000 7fb78f000640 1 -- 172.21.15.42:0/4275205865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7880b4be0 msgr2=0x7fb78815d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:52.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.566+0000 7fb78f000640 1 --2- 172.21.15.42:0/4275205865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7880b4be0 0x7fb78815d6b0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fb77c005fd0 tx=0x7fb77c02a5d0 comp rx=0 tx=0).stop 2024-09-17T01:37:52.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.566+0000 7fb78f000640 1 -- 172.21.15.42:0/4275205865 shutdown_connections 2024-09-17T01:37:52.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.566+0000 7fb78f000640 1 --2- 172.21.15.42:0/4275205865 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb78806d430 0x7fb788152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:52.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.566+0000 7fb78f000640 1 --2- 172.21.15.42:0/4275205865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7880b4be0 0x7fb78815d6b0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:52.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.566+0000 7fb78f000640 1 -- 172.21.15.42:0/4275205865 >> 172.21.15.42:0/4275205865 conn(0x7fb7880b25f0 msgr2=0x7fb7880d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:52.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.566+0000 7fb78f000640 1 -- 172.21.15.42:0/4275205865 shutdown_connections 2024-09-17T01:37:52.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.566+0000 7fb78f000640 1 -- 172.21.15.42:0/4275205865 wait complete. 2024-09-17T01:37:52.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.568+0000 7fb78f000640 1 Processor -- start 2024-09-17T01:37:52.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.569+0000 7fb78f000640 1 -- start start 2024-09-17T01:37:52.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.570+0000 7fb78f000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7880b4be0 0x7fb7880c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:52.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.570+0000 7fb78f000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7880cf7c0 0x7fb788150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:52.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.570+0000 7fb78f000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb788074560 0x7fb788074970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:52.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.570+0000 7fb78f000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb788153850 con 0x7fb7880cf7c0 2024-09-17T01:37:52.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.570+0000 7fb78f000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb7881536d0 con 0x7fb788074560 2024-09-17T01:37:52.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.570+0000 7fb78f000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb7881539d0 con 0x7fb7880b4be0 2024-09-17T01:37:52.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.570+0000 7fb78d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7880cf7c0 0x7fb788150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:52.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.570+0000 7fb78d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7880cf7c0 0x7fb788150800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42194/0 (socket says 172.21.15.42:42194) 2024-09-17T01:37:52.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.570+0000 7fb78d200640 1 -- 172.21.15.42:0/4260039711 learned_addr learned my addr 172.21.15.42:0/4260039711 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:52.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.571+0000 7fb78dc00640 1 --2- 172.21.15.42:0/4260039711 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7880b4be0 0x7fb7880c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:52.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.571+0000 7fb78e600640 1 --2- 172.21.15.42:0/4260039711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb788074560 0x7fb788074970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:52.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.571+0000 7fb78d200640 1 -- 172.21.15.42:0/4260039711 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7880b4be0 msgr2=0x7fb7880c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:52.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.571+0000 7fb78d200640 1 --2- 172.21.15.42:0/4260039711 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7880b4be0 0x7fb7880c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:52.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.571+0000 7fb78d200640 1 -- 172.21.15.42:0/4260039711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb788074560 msgr2=0x7fb788074970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:52.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.571+0000 7fb78d200640 1 --2- 172.21.15.42:0/4260039711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb788074560 0x7fb788074970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:52.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.571+0000 7fb78d200640 1 -- 172.21.15.42:0/4260039711 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb788074eb0 con 0x7fb7880cf7c0 2024-09-17T01:37:52.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.571+0000 7fb78dc00640 1 --2- 172.21.15.42:0/4260039711 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7880b4be0 0x7fb7880c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:52.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.571+0000 7fb78d200640 1 --2- 172.21.15.42:0/4260039711 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7880cf7c0 0x7fb788150800 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fb77400c370 tx=0x7fb77400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:52.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.571+0000 7fb785600640 1 -- 172.21.15.42:0/4260039711 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7740052d0 con 0x7fb7880cf7c0 2024-09-17T01:37:52.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.571+0000 7fb785600640 1 -- 172.21.15.42:0/4260039711 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb774007020 con 0x7fb7880cf7c0 2024-09-17T01:37:52.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.571+0000 7fb785600640 1 -- 172.21.15.42:0/4260039711 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb774007470 con 0x7fb7880cf7c0 2024-09-17T01:37:52.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.571+0000 7fb78f000640 1 -- 172.21.15.42:0/4260039711 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7880c6020 con 0x7fb7880cf7c0 2024-09-17T01:37:52.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.572+0000 7fb78f000640 1 -- 172.21.15.42:0/4260039711 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7880c5540 con 0x7fb7880cf7c0 2024-09-17T01:37:52.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.573+0000 7fb78f000640 1 -- 172.21.15.42:0/4260039711 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7880c7500 con 0x7fb7880cf7c0 2024-09-17T01:37:52.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.574+0000 7fb785600640 1 -- 172.21.15.42:0/4260039711 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb7740067d0 con 0x7fb7880cf7c0 2024-09-17T01:37:52.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.575+0000 7fb785600640 1 --2- 172.21.15.42:0/4260039711 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb768078bc0 0x7fb76807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:52.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.576+0000 7fb785600640 1 -- 172.21.15.42:0/4260039711 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5609+0+0 (secure 0 0 0) 0x7fb77409a720 con 0x7fb7880cf7c0 2024-09-17T01:37:52.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.576+0000 7fb78dc00640 1 --2- 172.21.15.42:0/4260039711 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb768078bc0 0x7fb76807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:52.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.577+0000 7fb78dc00640 1 --2- 172.21.15.42:0/4260039711 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb768078bc0 0x7fb76807b0d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb77c033000 tx=0x7fb77c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:52.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.579+0000 7fb785600640 1 -- 172.21.15.42:0/4260039711 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb788074eb0 con 0x7fb7880cf7c0 2024-09-17T01:37:52.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:52.811+0000 7fb78f000640 1 -- 172.21.15.42:0/4260039711 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb788152ed0 con 0x7fb7880cf7c0 2024-09-17T01:37:53.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.312+0000 7fb785600640 1 -- 172.21.15.42:0/4260039711 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v68) ==== 174+0+0 (secure 0 0 0) 0x7fb78815dbf0 con 0x7fb7880cf7c0 2024-09-17T01:37:53.311 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 12 and data pool 13 2024-09-17T01:37:53.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.322+0000 7fb78f000640 1 -- 172.21.15.42:0/4260039711 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb768078bc0 msgr2=0x7fb76807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:53.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.322+0000 7fb78f000640 1 --2- 172.21.15.42:0/4260039711 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb768078bc0 0x7fb76807b0d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb77c033000 tx=0x7fb77c004730 comp rx=0 tx=0).stop 2024-09-17T01:37:53.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.322+0000 7fb78f000640 1 -- 172.21.15.42:0/4260039711 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7880cf7c0 msgr2=0x7fb788150800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:53.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.322+0000 7fb78f000640 1 --2- 172.21.15.42:0/4260039711 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7880cf7c0 0x7fb788150800 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fb77400c370 tx=0x7fb77400c830 comp rx=0 tx=0).stop 2024-09-17T01:37:53.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.323+0000 7fb78f000640 1 -- 172.21.15.42:0/4260039711 shutdown_connections 2024-09-17T01:37:53.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.323+0000 7fb78f000640 1 --2- 172.21.15.42:0/4260039711 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb768078bc0 0x7fb76807b0d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:53.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.323+0000 7fb78f000640 1 --2- 172.21.15.42:0/4260039711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb788074560 0x7fb788074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:53.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.323+0000 7fb78f000640 1 --2- 172.21.15.42:0/4260039711 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7880cf7c0 0x7fb788150800 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:53.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.323+0000 7fb78f000640 1 --2- 172.21.15.42:0/4260039711 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb7880b4be0 0x7fb7880c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:53.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.323+0000 7fb78f000640 1 -- 172.21.15.42:0/4260039711 >> 172.21.15.42:0/4260039711 conn(0x7fb7880b25f0 msgr2=0x7fb7880b0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:53.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.327+0000 7fb78f000640 1 -- 172.21.15.42:0/4260039711 shutdown_connections 2024-09-17T01:37:53.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.330+0000 7fb78f000640 1 -- 172.21.15.42:0/4260039711 wait complete. 2024-09-17T01:37:53.370 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:37:53.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.601+0000 7fbb6d800640 1 -- 172.21.15.42:0/874911022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb68072e90 msgr2=0x7fbb680cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:53.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.601+0000 7fbb6d800640 1 --2- 172.21.15.42:0/874911022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb68072e90 0x7fbb680cec40 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fbb68070530 tx=0x7fbb6002a980 comp rx=0 tx=0).stop 2024-09-17T01:37:53.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.601+0000 7fbb6d800640 1 -- 172.21.15.42:0/874911022 shutdown_connections 2024-09-17T01:37:53.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.601+0000 7fbb6d800640 1 --2- 172.21.15.42:0/874911022 >> v2:172.21.15.43:3300/0 conn(0x7fbb68142f40 0x7fbb68072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:53.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.601+0000 7fbb6d800640 1 --2- 172.21.15.42:0/874911022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb68072e90 0x7fbb680cec40 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:53.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.601+0000 7fbb6d800640 1 --2- 172.21.15.42:0/874911022 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbb680b3550 0x7fbb6815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:53.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.601+0000 7fbb6d800640 1 -- 172.21.15.42:0/874911022 >> 172.21.15.42:0/874911022 conn(0x7fbb680b2930 msgr2=0x7fbb6806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:53.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.601+0000 7fbb6d800640 1 -- 172.21.15.42:0/874911022 shutdown_connections 2024-09-17T01:37:53.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.601+0000 7fbb6d800640 1 -- 172.21.15.42:0/874911022 wait complete. 2024-09-17T01:37:53.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.604+0000 7fbb6d800640 1 Processor -- start 2024-09-17T01:37:53.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.604+0000 7fbb6d800640 1 -- start start 2024-09-17T01:37:53.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.605+0000 7fbb6d800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb68072e90 0x7fbb68141320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:53.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.605+0000 7fbb6d800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb680b3550 0x7fbb681e8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:53.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.605+0000 7fbb6d800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbb68142f40 0x7fbb681f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:53.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.605+0000 7fbb6d800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6806d430 con 0x7fbb68072e90 2024-09-17T01:37:53.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.605+0000 7fbb6d800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbb680cf4d0 con 0x7fbb680b3550 2024-09-17T01:37:53.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.605+0000 7fbb6d800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbb6806d5b0 con 0x7fbb68142f40 2024-09-17T01:37:53.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.605+0000 7fbb66a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb68072e90 0x7fbb68141320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:53.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.605+0000 7fbb66a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb68072e90 0x7fbb68141320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42216/0 (socket says 172.21.15.42:42216) 2024-09-17T01:37:53.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.605+0000 7fbb66a00640 1 -- 172.21.15.42:0/2489116441 learned_addr learned my addr 172.21.15.42:0/2489116441 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:53.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.606+0000 7fbb5fe00640 1 --2- 172.21.15.42:0/2489116441 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb680b3550 0x7fbb681e8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:53.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.606+0000 7fbb67400640 1 --2- 172.21.15.42:0/2489116441 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbb68142f40 0x7fbb681f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:53.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.606+0000 7fbb66a00640 1 -- 172.21.15.42:0/2489116441 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbb68142f40 msgr2=0x7fbb681f6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:53.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.606+0000 7fbb66a00640 1 --2- 172.21.15.42:0/2489116441 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbb68142f40 0x7fbb681f6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:53.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.606+0000 7fbb66a00640 1 -- 172.21.15.42:0/2489116441 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb680b3550 msgr2=0x7fbb681e8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:53.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.606+0000 7fbb66a00640 1 --2- 172.21.15.42:0/2489116441 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb680b3550 0x7fbb681e8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:53.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.606+0000 7fbb66a00640 1 -- 172.21.15.42:0/2489116441 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb681e8e50 con 0x7fbb68072e90 2024-09-17T01:37:53.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.606+0000 7fbb66a00640 1 --2- 172.21.15.42:0/2489116441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb68072e90 0x7fbb68141320 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800d780 tx=0x7fbb5800dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:53.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.606+0000 7fbb5ea00640 1 -- 172.21.15.42:0/2489116441 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58017070 con 0x7fbb68072e90 2024-09-17T01:37:53.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.607+0000 7fbb5ea00640 1 -- 172.21.15.42:0/2489116441 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb5800de90 con 0x7fbb68072e90 2024-09-17T01:37:53.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.607+0000 7fbb6d800640 1 -- 172.21.15.42:0/2489116441 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb68140560 con 0x7fbb68072e90 2024-09-17T01:37:53.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.607+0000 7fbb5ea00640 1 -- 172.21.15.42:0/2489116441 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb580099d0 con 0x7fbb68072e90 2024-09-17T01:37:53.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.607+0000 7fbb6d800640 1 -- 172.21.15.42:0/2489116441 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb68140b20 con 0x7fbb68072e90 2024-09-17T01:37:53.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.608+0000 7fbb6d800640 1 -- 172.21.15.42:0/2489116441 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb6806da60 con 0x7fbb68072e90 2024-09-17T01:37:53.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.609+0000 7fbb5ea00640 1 -- 172.21.15.42:0/2489116441 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbb58009b70 con 0x7fbb68072e90 2024-09-17T01:37:53.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.610+0000 7fbb5ea00640 1 --2- 172.21.15.42:0/2489116441 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbb44078b90 0x7fbb4407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:53.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.611+0000 7fbb5ea00640 1 -- 172.21.15.42:0/2489116441 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7fbb5809b0c0 con 0x7fbb68072e90 2024-09-17T01:37:53.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.611+0000 7fbb5fe00640 1 --2- 172.21.15.42:0/2489116441 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbb44078b90 0x7fbb4407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:53.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.612+0000 7fbb5fe00640 1 --2- 172.21.15.42:0/2489116441 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbb44078b90 0x7fbb4407b0a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbb68072d10 tx=0x7fbb50005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:53.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.615+0000 7fbb5ea00640 1 -- 172.21.15.42:0/2489116441 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbb58020020 con 0x7fbb68072e90 2024-09-17T01:37:53.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.810+0000 7fbb6d800640 1 -- 172.21.15.42:0/2489116441 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb6806a170 con 0x7fbb68072e90 2024-09-17T01:37:53.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.812+0000 7fbb5ea00640 1 -- 172.21.15.42:0/2489116441 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+16697 (secure 0 0 0) 0x7fbb58062e10 con 0x7fbb68072e90 2024-09-17T01:37:53.810 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:53.810 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":92,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:37:52.812451+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:37:50.765368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T01:37:51.779319+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:37:53.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.814+0000 7fbb6d800640 1 -- 172.21.15.42:0/2489116441 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbb44078b90 msgr2=0x7fbb4407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:53.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.814+0000 7fbb6d800640 1 --2- 172.21.15.42:0/2489116441 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbb44078b90 0x7fbb4407b0a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbb68072d10 tx=0x7fbb50005f90 comp rx=0 tx=0).stop 2024-09-17T01:37:53.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.814+0000 7fbb6d800640 1 -- 172.21.15.42:0/2489116441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb68072e90 msgr2=0x7fbb68141320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:53.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.814+0000 7fbb6d800640 1 --2- 172.21.15.42:0/2489116441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb68072e90 0x7fbb68141320 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800d780 tx=0x7fbb5800dc40 comp rx=0 tx=0).stop 2024-09-17T01:37:53.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.814+0000 7fbb6d800640 1 -- 172.21.15.42:0/2489116441 shutdown_connections 2024-09-17T01:37:53.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.814+0000 7fbb6d800640 1 --2- 172.21.15.42:0/2489116441 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbb44078b90 0x7fbb4407b0a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:53.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.814+0000 7fbb6d800640 1 --2- 172.21.15.42:0/2489116441 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb680b3550 0x7fbb681e8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:53.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.814+0000 7fbb6d800640 1 --2- 172.21.15.42:0/2489116441 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbb68142f40 0x7fbb681f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:53.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.814+0000 7fbb6d800640 1 --2- 172.21.15.42:0/2489116441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb68072e90 0x7fbb68141320 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:53.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.814+0000 7fbb6d800640 1 -- 172.21.15.42:0/2489116441 >> 172.21.15.42:0/2489116441 conn(0x7fbb680b2930 msgr2=0x7fbb68160440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:53.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.814+0000 7fbb6d800640 1 -- 172.21.15.42:0/2489116441 shutdown_connections 2024-09-17T01:37:53.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:53.814+0000 7fbb6d800640 1 -- 172.21.15.42:0/2489116441 wait complete. 2024-09-17T01:37:53.838 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:37:54.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.067+0000 7f3819a00640 1 -- 172.21.15.42:0/2469999801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3814142f40 msgr2=0x7f3814072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:54.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.067+0000 7f3819a00640 1 --2- 172.21.15.42:0/2469999801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3814142f40 0x7f3814072950 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f37fc009830 tx=0x7f37fc02a530 comp rx=0 tx=0).stop 2024-09-17T01:37:54.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.067+0000 7f3819a00640 1 -- 172.21.15.42:0/2469999801 shutdown_connections 2024-09-17T01:37:54.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.068+0000 7f3819a00640 1 --2- 172.21.15.42:0/2469999801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3814142f40 0x7f3814072950 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:54.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.068+0000 7f3819a00640 1 -- 172.21.15.42:0/2469999801 >> 172.21.15.42:0/2469999801 conn(0x7f38140b2930 msgr2=0x7f381406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:54.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.068+0000 7f3819a00640 1 -- 172.21.15.42:0/2469999801 shutdown_connections 2024-09-17T01:37:54.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.068+0000 7f3819a00640 1 -- 172.21.15.42:0/2469999801 wait complete. 2024-09-17T01:37:54.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.070+0000 7f3819a00640 1 Processor -- start 2024-09-17T01:37:54.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.070+0000 7f3819a00640 1 -- start start 2024-09-17T01:37:54.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.071+0000 7f3819a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3814072e90 0x7f38140af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:54.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.072+0000 7f3819a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f38140b3550 0x7f381413e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:54.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.072+0000 7f3819a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3814142f40 0x7f38141677f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:54.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.072+0000 7f3819a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f381406d900 con 0x7f3814072e90 2024-09-17T01:37:54.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.072+0000 7f3819a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f381406d780 con 0x7f3814142f40 2024-09-17T01:37:54.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.072+0000 7f3819a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f381406da80 con 0x7f38140b3550 2024-09-17T01:37:54.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.072+0000 7f3812a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3814072e90 0x7f38140af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:54.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.072+0000 7f3812a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3814072e90 0x7f38140af7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42222/0 (socket says 172.21.15.42:42222) 2024-09-17T01:37:54.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.072+0000 7f3812a00640 1 -- 172.21.15.42:0/3031023657 learned_addr learned my addr 172.21.15.42:0/3031023657 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:54.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.072+0000 7f380a000640 1 --2- 172.21.15.42:0/3031023657 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f38140b3550 0x7f381413e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:54.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.072+0000 7f3813400640 1 --2- 172.21.15.42:0/3031023657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3814142f40 0x7f38141677f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:54.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.072+0000 7f3812a00640 1 -- 172.21.15.42:0/3031023657 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f38140b3550 msgr2=0x7f381413e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:54.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.072+0000 7f3812a00640 1 --2- 172.21.15.42:0/3031023657 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f38140b3550 0x7f381413e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:54.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.072+0000 7f3812a00640 1 -- 172.21.15.42:0/3031023657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3814142f40 msgr2=0x7f38141677f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:54.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.072+0000 7f3812a00640 1 --2- 172.21.15.42:0/3031023657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3814142f40 0x7f38141677f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:54.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.072+0000 7f3812a00640 1 -- 172.21.15.42:0/3031023657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38141f6ae0 con 0x7f3814072e90 2024-09-17T01:37:54.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.072+0000 7f380a000640 1 --2- 172.21.15.42:0/3031023657 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f38140b3550 0x7f381413e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:37:54.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.073+0000 7f3812a00640 1 --2- 172.21.15.42:0/3031023657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3814072e90 0x7f38140af7f0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f380400c400 tx=0x7f380400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:54.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.073+0000 7f380b400640 1 -- 172.21.15.42:0/3031023657 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3804017070 con 0x7f3814072e90 2024-09-17T01:37:54.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.073+0000 7f380b400640 1 -- 172.21.15.42:0/3031023657 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38040053c0 con 0x7f3814072e90 2024-09-17T01:37:54.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.073+0000 7f3819a00640 1 -- 172.21.15.42:0/3031023657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38141f6da0 con 0x7f3814072e90 2024-09-17T01:37:54.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.073+0000 7f380b400640 1 -- 172.21.15.42:0/3031023657 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3804003850 con 0x7f3814072e90 2024-09-17T01:37:54.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.073+0000 7f3819a00640 1 -- 172.21.15.42:0/3031023657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38141f7360 con 0x7f3814072e90 2024-09-17T01:37:54.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.074+0000 7f3819a00640 1 -- 172.21.15.42:0/3031023657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f381406a170 con 0x7f3814072e90 2024-09-17T01:37:54.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.075+0000 7f380b400640 1 -- 172.21.15.42:0/3031023657 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f380401a070 con 0x7f3814072e90 2024-09-17T01:37:54.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.076+0000 7f380b400640 1 --2- 172.21.15.42:0/3031023657 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f37f0078b90 0x7f37f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:54.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.076+0000 7f380b400640 1 -- 172.21.15.42:0/3031023657 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f380409a1e0 con 0x7f3814072e90 2024-09-17T01:37:54.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.077+0000 7f380a000640 1 --2- 172.21.15.42:0/3031023657 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f37f0078b90 0x7f37f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:54.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.078+0000 7f380a000640 1 --2- 172.21.15.42:0/3031023657 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f37f0078b90 0x7f37f007b0a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f37fc034000 tx=0x7f37fc004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:54.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.081+0000 7f380b400640 1 -- 172.21.15.42:0/3031023657 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3804062580 con 0x7f3814072e90 2024-09-17T01:37:54.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.276+0000 7f3819a00640 1 -- 172.21.15.42:0/3031023657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3814073df0 con 0x7f3814072e90 2024-09-17T01:37:54.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.278+0000 7f380b400640 1 -- 172.21.15.42:0/3031023657 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+16697 (secure 0 0 0) 0x7f3804061e80 con 0x7f3814072e90 2024-09-17T01:37:54.276 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:54.276 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":92,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:37:52.812451+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:37:50.765368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T01:37:51.779319+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:37:54.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.280+0000 7f3819a00640 1 -- 172.21.15.42:0/3031023657 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f37f0078b90 msgr2=0x7f37f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:54.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.280+0000 7f3819a00640 1 --2- 172.21.15.42:0/3031023657 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f37f0078b90 0x7f37f007b0a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f37fc034000 tx=0x7f37fc004730 comp rx=0 tx=0).stop 2024-09-17T01:37:54.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.280+0000 7f3819a00640 1 -- 172.21.15.42:0/3031023657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3814072e90 msgr2=0x7f38140af7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:54.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.280+0000 7f3819a00640 1 --2- 172.21.15.42:0/3031023657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3814072e90 0x7f38140af7f0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f380400c400 tx=0x7f380400c8c0 comp rx=0 tx=0).stop 2024-09-17T01:37:54.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.280+0000 7f3819a00640 1 -- 172.21.15.42:0/3031023657 shutdown_connections 2024-09-17T01:37:54.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.280+0000 7f3819a00640 1 --2- 172.21.15.42:0/3031023657 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f37f0078b90 0x7f37f007b0a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:54.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.280+0000 7f3819a00640 1 --2- 172.21.15.42:0/3031023657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3814142f40 0x7f38141677f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:54.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.280+0000 7f3819a00640 1 --2- 172.21.15.42:0/3031023657 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f38140b3550 0x7f381413e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:54.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.280+0000 7f3819a00640 1 --2- 172.21.15.42:0/3031023657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3814072e90 0x7f38140af7f0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:54.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.280+0000 7f3819a00640 1 -- 172.21.15.42:0/3031023657 >> 172.21.15.42:0/3031023657 conn(0x7f38140b2930 msgr2=0x7f381415b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:54.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.280+0000 7f3819a00640 1 -- 172.21.15.42:0/3031023657 shutdown_connections 2024-09-17T01:37:54.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.280+0000 7f3819a00640 1 -- 172.21.15.42:0/3031023657 wait complete. 2024-09-17T01:37:54.304 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T01:37:54.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.539+0000 7f6f57a00640 1 -- 172.21.15.42:0/769877913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f50142f40 msgr2=0x7f6f50072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:54.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.539+0000 7f6f57a00640 1 --2- 172.21.15.42:0/769877913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f50142f40 0x7f6f50072950 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f6f50071ef0 tx=0x7f6f3c02a4b0 comp rx=0 tx=0).stop 2024-09-17T01:37:54.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.539+0000 7f6f57a00640 1 -- 172.21.15.42:0/769877913 shutdown_connections 2024-09-17T01:37:54.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.539+0000 7f6f57a00640 1 --2- 172.21.15.42:0/769877913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f50142f40 0x7f6f50072950 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:54.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.539+0000 7f6f57a00640 1 --2- 172.21.15.42:0/769877913 >> v2:172.21.15.43:3300/0 conn(0x7f6f500b3550 0x7f6f5015cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:54.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.539+0000 7f6f57a00640 1 -- 172.21.15.42:0/769877913 >> 172.21.15.42:0/769877913 conn(0x7f6f500b2930 msgr2=0x7f6f5006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:54.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.539+0000 7f6f57a00640 1 -- 172.21.15.42:0/769877913 shutdown_connections 2024-09-17T01:37:54.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.539+0000 7f6f57a00640 1 -- 172.21.15.42:0/769877913 wait complete. 2024-09-17T01:37:54.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.541+0000 7f6f57a00640 1 Processor -- start 2024-09-17T01:37:54.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.541+0000 7f6f57a00640 1 -- start start 2024-09-17T01:37:54.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.543+0000 7f6f57a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f50072e90 0x7f6f501f9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:54.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.543+0000 7f6f57a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f500b3550 0x7f6f50139c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:54.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.543+0000 7f6f57a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f50142f40 0x7f6f5015bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:54.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.543+0000 7f6f57a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5006d5b0 con 0x7f6f50072e90 2024-09-17T01:37:54.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.543+0000 7f6f57a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5006d430 con 0x7f6f500b3550 2024-09-17T01:37:54.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.543+0000 7f6f57a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6f5006d730 con 0x7f6f50142f40 2024-09-17T01:37:54.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.543+0000 7f6f55000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f50072e90 0x7f6f501f9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:54.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.543+0000 7f6f55000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f50072e90 0x7f6f501f9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42230/0 (socket says 172.21.15.42:42230) 2024-09-17T01:37:54.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.543+0000 7f6f55000640 1 -- 172.21.15.42:0/1985843095 learned_addr learned my addr 172.21.15.42:0/1985843095 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:54.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.543+0000 7f6f4fe00640 1 --2- 172.21.15.42:0/1985843095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f500b3550 0x7f6f50139c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:54.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.543+0000 7f6f55a00640 1 --2- 172.21.15.42:0/1985843095 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f50142f40 0x7f6f5015bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:54.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.543+0000 7f6f55000640 1 -- 172.21.15.42:0/1985843095 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f50142f40 msgr2=0x7f6f5015bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:54.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.543+0000 7f6f55000640 1 --2- 172.21.15.42:0/1985843095 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f50142f40 0x7f6f5015bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:54.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.543+0000 7f6f55000640 1 -- 172.21.15.42:0/1985843095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f500b3550 msgr2=0x7f6f50139c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:54.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.543+0000 7f6f55000640 1 --2- 172.21.15.42:0/1985843095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f500b3550 0x7f6f50139c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:54.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.543+0000 7f6f55000640 1 -- 172.21.15.42:0/1985843095 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f501f9a20 con 0x7f6f50072e90 2024-09-17T01:37:54.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.544+0000 7f6f55000640 1 --2- 172.21.15.42:0/1985843095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f50072e90 0x7f6f501f9190 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400d770 tx=0x7f6f4400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:54.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.544+0000 7f6f4cc00640 1 -- 172.21.15.42:0/1985843095 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44017070 con 0x7f6f50072e90 2024-09-17T01:37:54.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.544+0000 7f6f4cc00640 1 -- 172.21.15.42:0/1985843095 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f44004310 con 0x7f6f50072e90 2024-09-17T01:37:54.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.544+0000 7f6f57a00640 1 -- 172.21.15.42:0/1985843095 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f501f9d00 con 0x7f6f50072e90 2024-09-17T01:37:54.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.544+0000 7f6f4cc00640 1 -- 172.21.15.42:0/1985843095 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44009c30 con 0x7f6f50072e90 2024-09-17T01:37:54.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.544+0000 7f6f57a00640 1 -- 172.21.15.42:0/1985843095 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f500b0ce0 con 0x7f6f50072e90 2024-09-17T01:37:54.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.545+0000 7f6f57a00640 1 -- 172.21.15.42:0/1985843095 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f500b39a0 con 0x7f6f50072e90 2024-09-17T01:37:54.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.546+0000 7f6f4cc00640 1 -- 172.21.15.42:0/1985843095 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6f44005020 con 0x7f6f50072e90 2024-09-17T01:37:54.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.547+0000 7f6f4cc00640 1 --2- 172.21.15.42:0/1985843095 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6f30078b90 0x7f6f3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:54.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.547+0000 7f6f4cc00640 1 -- 172.21.15.42:0/1985843095 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f6f4409b230 con 0x7f6f50072e90 2024-09-17T01:37:54.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.548+0000 7f6f4fe00640 1 --2- 172.21.15.42:0/1985843095 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6f30078b90 0x7f6f3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:54.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.549+0000 7f6f4fe00640 1 --2- 172.21.15.42:0/1985843095 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6f30078b90 0x7f6f3007b0a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c034000 tx=0x7f6f3c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:54.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.552+0000 7f6f4cc00640 1 -- 172.21.15.42:0/1985843095 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6f500b39a0 con 0x7f6f50072e90 2024-09-17T01:37:54.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:54.787+0000 7f6f57a00640 1 -- 172.21.15.42:0/1985843095 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6f5006dbe0 con 0x7f6f50072e90 2024-09-17T01:37:55.280 INFO:tasks.ceph.mds.a.smithi042.stderr:2024-09-17T01:37:55.282+0000 7f287de00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:37:55.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.324+0000 7f6f4cc00640 1 -- 172.21.15.42:0/1985843095 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v71) ==== 118+0+0 (secure 0 0 0) 0x7f6f44020020 con 0x7f6f50072e90 2024-09-17T01:37:55.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.329+0000 7f6f57a00640 1 -- 172.21.15.42:0/1985843095 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6f30078b90 msgr2=0x7f6f3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:55.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.329+0000 7f6f57a00640 1 --2- 172.21.15.42:0/1985843095 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6f30078b90 0x7f6f3007b0a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c034000 tx=0x7f6f3c004730 comp rx=0 tx=0).stop 2024-09-17T01:37:55.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.329+0000 7f6f57a00640 1 -- 172.21.15.42:0/1985843095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f50072e90 msgr2=0x7f6f501f9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:55.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.329+0000 7f6f57a00640 1 --2- 172.21.15.42:0/1985843095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f50072e90 0x7f6f501f9190 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400d770 tx=0x7f6f4400dc30 comp rx=0 tx=0).stop 2024-09-17T01:37:55.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.329+0000 7f6f57a00640 1 -- 172.21.15.42:0/1985843095 shutdown_connections 2024-09-17T01:37:55.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.329+0000 7f6f57a00640 1 --2- 172.21.15.42:0/1985843095 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6f30078b90 0x7f6f3007b0a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:55.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.329+0000 7f6f57a00640 1 --2- 172.21.15.42:0/1985843095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f500b3550 0x7f6f50139c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:55.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.329+0000 7f6f57a00640 1 --2- 172.21.15.42:0/1985843095 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f50142f40 0x7f6f5015bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:55.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.329+0000 7f6f57a00640 1 --2- 172.21.15.42:0/1985843095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f50072e90 0x7f6f501f9190 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:55.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.329+0000 7f6f57a00640 1 -- 172.21.15.42:0/1985843095 >> 172.21.15.42:0/1985843095 conn(0x7f6f500b2930 msgr2=0x7f6f5015f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:55.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.329+0000 7f6f57a00640 1 -- 172.21.15.42:0/1985843095 shutdown_connections 2024-09-17T01:37:55.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.329+0000 7f6f57a00640 1 -- 172.21.15.42:0/1985843095 wait complete. 2024-09-17T01:37:55.351 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T01:37:55.351 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T01:37:55.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.587+0000 7f3b3cc00640 1 -- 172.21.15.42:0/2823893613 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3b3806eb00 msgr2=0x7f3b38074870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:55.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.587+0000 7f3b3cc00640 1 --2- 172.21.15.42:0/2823893613 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3b3806eb00 0x7f3b38074870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3b20005fd0 tx=0x7f3b2002a540 comp rx=0 tx=0).stop 2024-09-17T01:37:55.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.588+0000 7f3b3cc00640 1 -- 172.21.15.42:0/2823893613 shutdown_connections 2024-09-17T01:37:55.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.588+0000 7f3b3cc00640 1 --2- 172.21.15.42:0/2823893613 >> v2:172.21.15.43:3300/0 conn(0x7f3b380cf720 0x7f3b380cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:55.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.588+0000 7f3b3cc00640 1 --2- 172.21.15.42:0/2823893613 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3b3806eb00 0x7f3b38074870 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:55.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.588+0000 7f3b3cc00640 1 -- 172.21.15.42:0/2823893613 >> 172.21.15.42:0/2823893613 conn(0x7f3b380cd4c0 msgr2=0x7f3b380cd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:55.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.588+0000 7f3b3cc00640 1 -- 172.21.15.42:0/2823893613 shutdown_connections 2024-09-17T01:37:55.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.588+0000 7f3b3cc00640 1 -- 172.21.15.42:0/2823893613 wait complete. 2024-09-17T01:37:55.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.590+0000 7f3b3cc00640 1 Processor -- start 2024-09-17T01:37:55.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.590+0000 7f3b3cc00640 1 -- start start 2024-09-17T01:37:55.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.591+0000 7f3b3cc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b3806eb00 0x7f3b3815b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:55.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.591+0000 7f3b3cc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3b380b6680 0x7f3b38158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:55.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.592+0000 7f3b3cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b380cf720 0x7f3b381560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:55.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.592+0000 7f3b3cc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3815bf50 con 0x7f3b380cf720 2024-09-17T01:37:55.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.592+0000 7f3b3cc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3815bdd0 con 0x7f3b3806eb00 2024-09-17T01:37:55.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.592+0000 7f3b3cc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3b3815c0d0 con 0x7f3b380b6680 2024-09-17T01:37:55.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.592+0000 7f3b37e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b380cf720 0x7f3b381560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:55.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.592+0000 7f3b37e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b380cf720 0x7f3b381560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42240/0 (socket says 172.21.15.42:42240) 2024-09-17T01:37:55.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.592+0000 7f3b37e00640 1 -- 172.21.15.42:0/1464028547 learned_addr learned my addr 172.21.15.42:0/1464028547 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:55.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.592+0000 7f3b2ea00640 1 --2- 172.21.15.42:0/1464028547 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3b380b6680 0x7f3b38158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:55.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.592+0000 7f3b37400640 1 --2- 172.21.15.42:0/1464028547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b3806eb00 0x7f3b3815b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:55.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.592+0000 7f3b37e00640 1 -- 172.21.15.42:0/1464028547 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3b380b6680 msgr2=0x7f3b38158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:55.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.592+0000 7f3b37e00640 1 --2- 172.21.15.42:0/1464028547 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3b380b6680 0x7f3b38158170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:55.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.592+0000 7f3b37e00640 1 -- 172.21.15.42:0/1464028547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b3806eb00 msgr2=0x7f3b3815b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:55.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.592+0000 7f3b37e00640 1 --2- 172.21.15.42:0/1464028547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b3806eb00 0x7f3b3815b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:55.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.592+0000 7f3b37e00640 1 -- 172.21.15.42:0/1464028547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3815a2a0 con 0x7f3b380cf720 2024-09-17T01:37:55.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.593+0000 7f3b37e00640 1 --2- 172.21.15.42:0/1464028547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b380cf720 0x7f3b381560e0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000ea40 tx=0x7f3b3000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:55.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.593+0000 7f3b2fe00640 1 -- 172.21.15.42:0/1464028547 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3000ce40 con 0x7f3b380cf720 2024-09-17T01:37:55.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.593+0000 7f3b2fe00640 1 -- 172.21.15.42:0/1464028547 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b30004c10 con 0x7f3b380cf720 2024-09-17T01:37:55.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.593+0000 7f3b3cc00640 1 -- 172.21.15.42:0/1464028547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b3815a580 con 0x7f3b380cf720 2024-09-17T01:37:55.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.593+0000 7f3b2fe00640 1 -- 172.21.15.42:0/1464028547 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b30005020 con 0x7f3b380cf720 2024-09-17T01:37:55.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.593+0000 7f3b3cc00640 1 -- 172.21.15.42:0/1464028547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b38153c20 con 0x7f3b380cf720 2024-09-17T01:37:55.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.594+0000 7f3b3cc00640 1 -- 172.21.15.42:0/1464028547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b3815c660 con 0x7f3b380cf720 2024-09-17T01:37:55.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.595+0000 7f3b2fe00640 1 -- 172.21.15.42:0/1464028547 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3b300051c0 con 0x7f3b380cf720 2024-09-17T01:37:55.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.597+0000 7f3b2fe00640 1 --2- 172.21.15.42:0/1464028547 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3b14078bc0 0x7f3b1407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:55.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.597+0000 7f3b2fe00640 1 -- 172.21.15.42:0/1464028547 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f3b3009b9d0 con 0x7f3b380cf720 2024-09-17T01:37:55.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.597+0000 7f3b37400640 1 --2- 172.21.15.42:0/1464028547 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3b14078bc0 0x7f3b1407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:55.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.598+0000 7f3b37400640 1 --2- 172.21.15.42:0/1464028547 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3b14078bc0 0x7f3b1407b0d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3b28001720 tx=0x7f3b28009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:55.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.601+0000 7f3b2fe00640 1 -- 172.21.15.42:0/1464028547 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3b30063840 con 0x7f3b380cf720 2024-09-17T01:37:55.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:55.833+0000 7f3b3cc00640 1 -- 172.21.15.42:0/1464028547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f3b380b5b80 con 0x7f3b380cf720 2024-09-17T01:37:56.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.326+0000 7f3b2fe00640 1 -- 172.21.15.42:0/1464028547 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v72) ==== 122+0+0 (secure 0 0 0) 0x7f3b30068270 con 0x7f3b380cf720 2024-09-17T01:37:56.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.329+0000 7f3b3cc00640 1 -- 172.21.15.42:0/1464028547 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3b14078bc0 msgr2=0x7f3b1407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:56.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.329+0000 7f3b3cc00640 1 --2- 172.21.15.42:0/1464028547 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3b14078bc0 0x7f3b1407b0d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3b28001720 tx=0x7f3b28009040 comp rx=0 tx=0).stop 2024-09-17T01:37:56.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.329+0000 7f3b3cc00640 1 -- 172.21.15.42:0/1464028547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b380cf720 msgr2=0x7f3b381560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:56.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.329+0000 7f3b3cc00640 1 --2- 172.21.15.42:0/1464028547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b380cf720 0x7f3b381560e0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000ea40 tx=0x7f3b3000ef00 comp rx=0 tx=0).stop 2024-09-17T01:37:56.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.329+0000 7f3b3cc00640 1 -- 172.21.15.42:0/1464028547 shutdown_connections 2024-09-17T01:37:56.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.329+0000 7f3b3cc00640 1 --2- 172.21.15.42:0/1464028547 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3b14078bc0 0x7f3b1407b0d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:56.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.329+0000 7f3b3cc00640 1 --2- 172.21.15.42:0/1464028547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b380cf720 0x7f3b381560e0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:56.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.329+0000 7f3b3cc00640 1 --2- 172.21.15.42:0/1464028547 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3b380b6680 0x7f3b38158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:56.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.329+0000 7f3b3cc00640 1 --2- 172.21.15.42:0/1464028547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b3806eb00 0x7f3b3815b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:56.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.329+0000 7f3b3cc00640 1 -- 172.21.15.42:0/1464028547 >> 172.21.15.42:0/1464028547 conn(0x7f3b380cd4c0 msgr2=0x7f3b380b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:56.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.329+0000 7f3b3cc00640 1 -- 172.21.15.42:0/1464028547 shutdown_connections 2024-09-17T01:37:56.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.329+0000 7f3b3cc00640 1 -- 172.21.15.42:0/1464028547 wait complete. 2024-09-17T01:37:56.351 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T01:37:56.351 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:37:56.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.581+0000 7f0ecfa00640 1 -- 172.21.15.42:0/2482296783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ec815f480 msgr2=0x7f0ec815f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:56.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.581+0000 7f0ecfa00640 1 --2- 172.21.15.42:0/2482296783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ec815f480 0x7f0ec815f890 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0005fd0 tx=0x7f0ec002aa90 comp rx=0 tx=0).stop 2024-09-17T01:37:56.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.581+0000 7f0ecfa00640 1 -- 172.21.15.42:0/2482296783 shutdown_connections 2024-09-17T01:37:56.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.581+0000 7f0ecfa00640 1 --2- 172.21.15.42:0/2482296783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ec815f480 0x7f0ec815f890 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:56.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.581+0000 7f0ecfa00640 1 --2- 172.21.15.42:0/2482296783 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0ec815cb80 0x7f0ec8152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:56.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.581+0000 7f0ecfa00640 1 -- 172.21.15.42:0/2482296783 >> 172.21.15.42:0/2482296783 conn(0x7f0ec80b2930 msgr2=0x7f0ec806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:56.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.581+0000 7f0ecfa00640 1 -- 172.21.15.42:0/2482296783 shutdown_connections 2024-09-17T01:37:56.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.581+0000 7f0ecfa00640 1 -- 172.21.15.42:0/2482296783 wait complete. 2024-09-17T01:37:56.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.583+0000 7f0ecfa00640 1 Processor -- start 2024-09-17T01:37:56.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.583+0000 7f0ecfa00640 1 -- start start 2024-09-17T01:37:56.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.585+0000 7f0ecfa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ec806d430 0x7f0ec813f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:56.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.585+0000 7f0ecfa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ec815cb80 0x7f0ec80aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:56.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.585+0000 7f0ecfa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0ec815f480 0x7f0ec8154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:56.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.585+0000 7f0ecfa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec80737e0 con 0x7f0ec806d430 2024-09-17T01:37:56.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.585+0000 7f0ecfa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec8073660 con 0x7f0ec815cb80 2024-09-17T01:37:56.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.585+0000 7f0ecfa00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0ec8073960 con 0x7f0ec815f480 2024-09-17T01:37:56.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.585+0000 7f0ecd000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ec806d430 0x7f0ec813f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:56.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.585+0000 7f0ecd000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ec806d430 0x7f0ec813f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53696/0 (socket says 172.21.15.42:53696) 2024-09-17T01:37:56.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.585+0000 7f0ecd000640 1 -- 172.21.15.42:0/4179768247 learned_addr learned my addr 172.21.15.42:0/4179768247 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:56.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.586+0000 7f0ec7e00640 1 --2- 172.21.15.42:0/4179768247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ec815cb80 0x7f0ec80aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:56.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.586+0000 7f0ecda00640 1 --2- 172.21.15.42:0/4179768247 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0ec815f480 0x7f0ec8154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:56.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.586+0000 7f0ecd000640 1 -- 172.21.15.42:0/4179768247 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0ec815f480 msgr2=0x7f0ec8154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:56.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.586+0000 7f0ecd000640 1 --2- 172.21.15.42:0/4179768247 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0ec815f480 0x7f0ec8154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:56.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.586+0000 7f0ecd000640 1 -- 172.21.15.42:0/4179768247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ec815cb80 msgr2=0x7f0ec80aa5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:56.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.586+0000 7f0ecd000640 1 --2- 172.21.15.42:0/4179768247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ec815cb80 0x7f0ec80aa5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:56.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.586+0000 7f0ecd000640 1 -- 172.21.15.42:0/4179768247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec80ab350 con 0x7f0ec806d430 2024-09-17T01:37:56.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.586+0000 7f0ecd000640 1 --2- 172.21.15.42:0/4179768247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ec806d430 0x7f0ec813f5e0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00d770 tx=0x7f0ebc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:56.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.586+0000 7f0ec4c00640 1 -- 172.21.15.42:0/4179768247 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc017070 con 0x7f0ec806d430 2024-09-17T01:37:56.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.586+0000 7f0ec4c00640 1 -- 172.21.15.42:0/4179768247 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ebc009d20 con 0x7f0ec806d430 2024-09-17T01:37:56.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.586+0000 7f0ec4c00640 1 -- 172.21.15.42:0/4179768247 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc0106c0 con 0x7f0ec806d430 2024-09-17T01:37:56.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.586+0000 7f0ecfa00640 1 -- 172.21.15.42:0/4179768247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ec813ffb0 con 0x7f0ec806d430 2024-09-17T01:37:56.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.587+0000 7f0ecfa00640 1 -- 172.21.15.42:0/4179768247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ec8140570 con 0x7f0ec806d430 2024-09-17T01:37:56.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.588+0000 7f0ecfa00640 1 -- 172.21.15.42:0/4179768247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ec813fda0 con 0x7f0ec806d430 2024-09-17T01:37:56.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.589+0000 7f0ec4c00640 1 -- 172.21.15.42:0/4179768247 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0ebc01a070 con 0x7f0ec806d430 2024-09-17T01:37:56.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.590+0000 7f0ec4c00640 1 --2- 172.21.15.42:0/4179768247 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0ea8078b90 0x7f0ea807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:56.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.590+0000 7f0ec4c00640 1 -- 172.21.15.42:0/4179768247 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f0ebc09af50 con 0x7f0ec806d430 2024-09-17T01:37:56.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.590+0000 7f0ec7e00640 1 --2- 172.21.15.42:0/4179768247 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0ea8078b90 0x7f0ea807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:56.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.591+0000 7f0ec7e00640 1 --2- 172.21.15.42:0/4179768247 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0ea8078b90 0x7f0ea807b0a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0ec80adf00 tx=0x7f0eb4009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:56.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.594+0000 7f0ec4c00640 1 -- 172.21.15.42:0/4179768247 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0ebc0632f0 con 0x7f0ec806d430 2024-09-17T01:37:56.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.825+0000 7f0ecfa00640 1 -- 172.21.15.42:0/4179768247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ec8073e50 con 0x7f0ec806d430 2024-09-17T01:37:56.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.825+0000 7f0ec4c00640 1 -- 172.21.15.42:0/4179768247 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5213 (secure 0 0 0) 0x7f0ebc062bf0 con 0x7f0ec806d430 2024-09-17T01:37:56.823 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:56.823 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":72,"btime":"2024-09-17T01:37:56:325204+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6853,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/80987986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":80987986},{"type":"v1","addr":"172.21.15.43:6836","nonce":80987986}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":6856,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/540363900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":540363900},{"type":"v1","addr":"172.21.15.43:6837","nonce":540363900}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":7188,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/440158485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":440158485},{"type":"v1","addr":"172.21.15.42:6833","nonce":440158485}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:37:52.812411+0000","modified":"2024-09-17T01:37:55.835132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7191},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7191":{"gid":7191,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3687871500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3687871500},{"type":"v1","addr":"172.21.15.42:6835","nonce":3687871500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7191,"qdb_cluster":[7191]},"id":6}]} 2024-09-17T01:37:56.824 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 72 2024-09-17T01:37:56.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.828+0000 7f0ecfa00640 1 -- 172.21.15.42:0/4179768247 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0ea8078b90 msgr2=0x7f0ea807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:56.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.828+0000 7f0ecfa00640 1 --2- 172.21.15.42:0/4179768247 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0ea8078b90 0x7f0ea807b0a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0ec80adf00 tx=0x7f0eb4009040 comp rx=0 tx=0).stop 2024-09-17T01:37:56.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.828+0000 7f0ecfa00640 1 -- 172.21.15.42:0/4179768247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ec806d430 msgr2=0x7f0ec813f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:56.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.828+0000 7f0ecfa00640 1 --2- 172.21.15.42:0/4179768247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ec806d430 0x7f0ec813f5e0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00d770 tx=0x7f0ebc00dc30 comp rx=0 tx=0).stop 2024-09-17T01:37:56.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.828+0000 7f0ecfa00640 1 -- 172.21.15.42:0/4179768247 shutdown_connections 2024-09-17T01:37:56.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.828+0000 7f0ecfa00640 1 --2- 172.21.15.42:0/4179768247 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0ea8078b90 0x7f0ea807b0a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:56.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.828+0000 7f0ecfa00640 1 --2- 172.21.15.42:0/4179768247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ec815cb80 0x7f0ec80aa5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:56.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.828+0000 7f0ecfa00640 1 --2- 172.21.15.42:0/4179768247 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0ec815f480 0x7f0ec8154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:56.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.828+0000 7f0ecfa00640 1 --2- 172.21.15.42:0/4179768247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ec806d430 0x7f0ec813f5e0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:56.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.828+0000 7f0ecfa00640 1 -- 172.21.15.42:0/4179768247 >> 172.21.15.42:0/4179768247 conn(0x7f0ec80b2930 msgr2=0x7f0ec80cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:56.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.828+0000 7f0ecfa00640 1 -- 172.21.15.42:0/4179768247 shutdown_connections 2024-09-17T01:37:56.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:56.828+0000 7f0ecfa00640 1 -- 172.21.15.42:0/4179768247 wait complete. 2024-09-17T01:37:56.848 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:37:57.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.078+0000 7fa7cb000640 1 -- 172.21.15.42:0/289245022 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa7c406d430 msgr2=0x7fa7c4152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:57.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.078+0000 7fa7cb000640 1 --2- 172.21.15.42:0/289245022 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa7c406d430 0x7fa7c4152ed0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc005fd0 tx=0x7fa7bc02aa90 comp rx=0 tx=0).stop 2024-09-17T01:37:57.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.078+0000 7fa7cb000640 1 -- 172.21.15.42:0/289245022 shutdown_connections 2024-09-17T01:37:57.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.078+0000 7fa7cb000640 1 --2- 172.21.15.42:0/289245022 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa7c406d430 0x7fa7c4152ed0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:57.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.078+0000 7fa7cb000640 1 --2- 172.21.15.42:0/289245022 >> v2:172.21.15.43:3300/0 conn(0x7fa7c40b4be0 0x7fa7c415d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:57.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.078+0000 7fa7cb000640 1 -- 172.21.15.42:0/289245022 >> 172.21.15.42:0/289245022 conn(0x7fa7c40b25f0 msgr2=0x7fa7c40d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:57.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.078+0000 7fa7cb000640 1 -- 172.21.15.42:0/289245022 shutdown_connections 2024-09-17T01:37:57.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.078+0000 7fa7cb000640 1 -- 172.21.15.42:0/289245022 wait complete. 2024-09-17T01:37:57.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.080+0000 7fa7cb000640 1 Processor -- start 2024-09-17T01:37:57.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.081+0000 7fa7cb000640 1 -- start start 2024-09-17T01:37:57.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.082+0000 7fa7cb000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7c40b4be0 0x7fa7c415b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:57.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.082+0000 7fa7cb000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7c40cf7c0 0x7fa7c4154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:57.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.082+0000 7fa7cb000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa7c415e810 0x7fa7c415ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:57.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.082+0000 7fa7cb000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c41537a0 con 0x7fa7c40b4be0 2024-09-17T01:37:57.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.082+0000 7fa7cb000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c4153620 con 0x7fa7c40cf7c0 2024-09-17T01:37:57.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.082+0000 7fa7cb000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa7c4153920 con 0x7fa7c415e810 2024-09-17T01:37:57.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.082+0000 7fa7c9c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7c40b4be0 0x7fa7c415b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:57.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.082+0000 7fa7c9c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7c40b4be0 0x7fa7c415b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53702/0 (socket says 172.21.15.42:53702) 2024-09-17T01:37:57.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.082+0000 7fa7c9c00640 1 -- 172.21.15.42:0/517912021 learned_addr learned my addr 172.21.15.42:0/517912021 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:57.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.082+0000 7fa7ca600640 1 --2- 172.21.15.42:0/517912021 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa7c415e810 0x7fa7c415ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:57.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.082+0000 7fa7c9200640 1 --2- 172.21.15.42:0/517912021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7c40cf7c0 0x7fa7c4154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:57.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.083+0000 7fa7c9c00640 1 -- 172.21.15.42:0/517912021 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa7c415e810 msgr2=0x7fa7c415ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:57.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.083+0000 7fa7c9c00640 1 --2- 172.21.15.42:0/517912021 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa7c415e810 0x7fa7c415ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:57.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.083+0000 7fa7c9c00640 1 -- 172.21.15.42:0/517912021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7c40cf7c0 msgr2=0x7fa7c4154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:57.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.083+0000 7fa7c9c00640 1 --2- 172.21.15.42:0/517912021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7c40cf7c0 0x7fa7c4154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:57.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.083+0000 7fa7c9c00640 1 -- 172.21.15.42:0/517912021 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c415f160 con 0x7fa7c40b4be0 2024-09-17T01:37:57.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.083+0000 7fa7c9c00640 1 --2- 172.21.15.42:0/517912021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7c40b4be0 0x7fa7c415b8f0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fa7b800ea20 tx=0x7fa7b800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:57.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.083+0000 7fa7c1600640 1 -- 172.21.15.42:0/517912021 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b800ce40 con 0x7fa7c40b4be0 2024-09-17T01:37:57.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.083+0000 7fa7c1600640 1 -- 172.21.15.42:0/517912021 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7b8004020 con 0x7fa7c40b4be0 2024-09-17T01:37:57.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.083+0000 7fa7cb000640 1 -- 172.21.15.42:0/517912021 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7c4154c70 con 0x7fa7c40b4be0 2024-09-17T01:37:57.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.084+0000 7fa7c1600640 1 -- 172.21.15.42:0/517912021 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b8004470 con 0x7fa7c40b4be0 2024-09-17T01:37:57.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.084+0000 7fa7cb000640 1 -- 172.21.15.42:0/517912021 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7c41f5e10 con 0x7fa7c40b4be0 2024-09-17T01:37:57.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.085+0000 7fa7cb000640 1 -- 172.21.15.42:0/517912021 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7c40b1070 con 0x7fa7c40b4be0 2024-09-17T01:37:57.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.086+0000 7fa7c1600640 1 -- 172.21.15.42:0/517912021 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa7b80035f0 con 0x7fa7c40b4be0 2024-09-17T01:37:57.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.087+0000 7fa7c1600640 1 --2- 172.21.15.42:0/517912021 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa7a4078bc0 0x7fa7a407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:57.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.088+0000 7fa7c1600640 1 -- 172.21.15.42:0/517912021 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fa7b809b560 con 0x7fa7c40b4be0 2024-09-17T01:37:57.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.088+0000 7fa7c9200640 1 --2- 172.21.15.42:0/517912021 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa7a4078bc0 0x7fa7a407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:57.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.089+0000 7fa7c9200640 1 --2- 172.21.15.42:0/517912021 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa7a4078bc0 0x7fa7a407b0d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40cc580 tx=0x7fa7b0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:57.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.092+0000 7fa7c1600640 1 -- 172.21.15.42:0/517912021 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa7c40b1070 con 0x7fa7c40b4be0 2024-09-17T01:37:57.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.286+0000 7fa7cb000640 1 -- 172.21.15.42:0/517912021 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7c4152ed0 con 0x7fa7c40b4be0 2024-09-17T01:37:57.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.287+0000 7fa7c1600640 1 -- 172.21.15.42:0/517912021 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+16684 (secure 0 0 0) 0x7fa7c415f160 con 0x7fa7c40b4be0 2024-09-17T01:37:57.285 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:57.286 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":93,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:37:54.312918+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:37:50.765368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T01:37:51.779319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:37:57.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.290+0000 7fa7cb000640 1 -- 172.21.15.42:0/517912021 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa7a4078bc0 msgr2=0x7fa7a407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:57.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.290+0000 7fa7cb000640 1 --2- 172.21.15.42:0/517912021 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa7a4078bc0 0x7fa7a407b0d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40cc580 tx=0x7fa7b0009040 comp rx=0 tx=0).stop 2024-09-17T01:37:57.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.290+0000 7fa7cb000640 1 -- 172.21.15.42:0/517912021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7c40b4be0 msgr2=0x7fa7c415b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:57.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.290+0000 7fa7cb000640 1 --2- 172.21.15.42:0/517912021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7c40b4be0 0x7fa7c415b8f0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fa7b800ea20 tx=0x7fa7b800eee0 comp rx=0 tx=0).stop 2024-09-17T01:37:57.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.290+0000 7fa7cb000640 1 -- 172.21.15.42:0/517912021 shutdown_connections 2024-09-17T01:37:57.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.290+0000 7fa7cb000640 1 --2- 172.21.15.42:0/517912021 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa7a4078bc0 0x7fa7a407b0d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:57.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.290+0000 7fa7cb000640 1 --2- 172.21.15.42:0/517912021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7c40cf7c0 0x7fa7c4154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:57.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.290+0000 7fa7cb000640 1 --2- 172.21.15.42:0/517912021 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa7c415e810 0x7fa7c415ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:57.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.290+0000 7fa7cb000640 1 --2- 172.21.15.42:0/517912021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7c40b4be0 0x7fa7c415b8f0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:57.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.290+0000 7fa7cb000640 1 -- 172.21.15.42:0/517912021 >> 172.21.15.42:0/517912021 conn(0x7fa7c40b25f0 msgr2=0x7fa7c40b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:57.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.290+0000 7fa7cb000640 1 -- 172.21.15.42:0/517912021 shutdown_connections 2024-09-17T01:37:57.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.290+0000 7fa7cb000640 1 -- 172.21.15.42:0/517912021 wait complete. 2024-09-17T01:37:57.312 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T01:37:57.312 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:37:57.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.544+0000 7fe6d6600640 1 -- 172.21.15.42:0/3606311057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b40039e0 msgr2=0x7fe6b4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:57.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.544+0000 7fe6d6600640 1 --2- 172.21.15.42:0/3606311057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6b40039e0 0x7fe6b4003e10 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0009b20 tx=0x7fe6b4005830 comp rx=0 tx=0).stop 2024-09-17T01:37:57.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.544+0000 7fe6cfe00640 1 -- 172.21.15.42:0/3606311057 reap_dead start 2024-09-17T01:37:57.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.544+0000 7fe6d6600640 1 -- 172.21.15.42:0/3606311057 shutdown_connections 2024-09-17T01:37:57.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.544+0000 7fe6d6600640 1 -- 172.21.15.42:0/3606311057 >> 172.21.15.42:0/3606311057 conn(0x7fe6d00b2930 msgr2=0x7fe6d006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:57.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.544+0000 7fe6d6600640 1 -- 172.21.15.42:0/3606311057 shutdown_connections 2024-09-17T01:37:57.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.544+0000 7fe6d6600640 1 -- 172.21.15.42:0/3606311057 wait complete. 2024-09-17T01:37:57.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.546+0000 7fe6d6600640 1 Processor -- start 2024-09-17T01:37:57.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.546+0000 7fe6d6600640 1 -- start start 2024-09-17T01:37:57.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.547+0000 7fe6d6600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6b40039e0 0x7fe6d00acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:57.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.547+0000 7fe6d6600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6d01f7080 0x7fe6d0144860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:57.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.547+0000 7fe6d6600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe6d00b0ed0 0x7fe6d00b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:57.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.548+0000 7fe6d6600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d00b37b0 con 0x7fe6d01f7080 2024-09-17T01:37:57.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.548+0000 7fe6d6600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d00741c0 con 0x7fe6b40039e0 2024-09-17T01:37:57.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.548+0000 7fe6d6600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe6d006db40 con 0x7fe6d00b0ed0 2024-09-17T01:37:57.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.548+0000 7fe6cea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6d01f7080 0x7fe6d0144860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:57.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.548+0000 7fe6cea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6d01f7080 0x7fe6d0144860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53706/0 (socket says 172.21.15.42:53706) 2024-09-17T01:37:57.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.548+0000 7fe6cea00640 1 -- 172.21.15.42:0/1345106244 learned_addr learned my addr 172.21.15.42:0/1345106244 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:57.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.548+0000 7fe6cf400640 1 --2- 172.21.15.42:0/1345106244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6b40039e0 0x7fe6d00acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:57.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.548+0000 7fe6cfe00640 1 --2- 172.21.15.42:0/1345106244 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe6d00b0ed0 0x7fe6d00b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:57.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.548+0000 7fe6cea00640 1 -- 172.21.15.42:0/1345106244 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe6d00b0ed0 msgr2=0x7fe6d00b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:57.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.548+0000 7fe6cea00640 1 --2- 172.21.15.42:0/1345106244 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe6d00b0ed0 0x7fe6d00b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:57.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.548+0000 7fe6cea00640 1 -- 172.21.15.42:0/1345106244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6b40039e0 msgr2=0x7fe6d00acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:57.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.548+0000 7fe6cea00640 1 --2- 172.21.15.42:0/1345106244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6b40039e0 0x7fe6d00acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:57.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.548+0000 7fe6cea00640 1 -- 172.21.15.42:0/1345106244 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d00ad060 con 0x7fe6d01f7080 2024-09-17T01:37:57.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.549+0000 7fe6cea00640 1 --2- 172.21.15.42:0/1345106244 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6d01f7080 0x7fe6d0144860 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc006610 tx=0x7fe6bc001730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:57.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.549+0000 7fe6c7400640 1 -- 172.21.15.42:0/1345106244 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc011640 con 0x7fe6d01f7080 2024-09-17T01:37:57.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.549+0000 7fe6c7400640 1 -- 172.21.15.42:0/1345106244 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6bc016020 con 0x7fe6d01f7080 2024-09-17T01:37:57.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.549+0000 7fe6c7400640 1 -- 172.21.15.42:0/1345106244 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc011aa0 con 0x7fe6d01f7080 2024-09-17T01:37:57.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.549+0000 7fe6d6600640 1 -- 172.21.15.42:0/1345106244 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6d00b1820 con 0x7fe6d01f7080 2024-09-17T01:37:57.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.549+0000 7fe6d6600640 1 -- 172.21.15.42:0/1345106244 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6d0147820 con 0x7fe6d01f7080 2024-09-17T01:37:57.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.550+0000 7fe6d6600640 1 -- 172.21.15.42:0/1345106244 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6d00ad2a0 con 0x7fe6d01f7080 2024-09-17T01:37:57.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.551+0000 7fe6c7400640 1 -- 172.21.15.42:0/1345106244 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe6bc011c40 con 0x7fe6d01f7080 2024-09-17T01:37:57.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.552+0000 7fe6c7400640 1 --2- 172.21.15.42:0/1345106244 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe6b0078b90 0x7fe6b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:57.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.552+0000 7fe6c7400640 1 -- 172.21.15.42:0/1345106244 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fe6bc09b910 con 0x7fe6d01f7080 2024-09-17T01:37:57.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.553+0000 7fe6cf400640 1 --2- 172.21.15.42:0/1345106244 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe6b0078b90 0x7fe6b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:57.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.554+0000 7fe6cf400640 1 --2- 172.21.15.42:0/1345106244 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe6b0078b90 0x7fe6b007b0a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0035000 tx=0x7fe6c002d040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:57.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.557+0000 7fe6c7400640 1 -- 172.21.15.42:0/1345106244 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe6bc020020 con 0x7fe6d01f7080 2024-09-17T01:37:57.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.749+0000 7fe6d6600640 1 -- 172.21.15.42:0/1345106244 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe6d01472f0 con 0x7fe6b0078b90 2024-09-17T01:37:57.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.755+0000 7fe6c7400640 1 -- 172.21.15.42:0/1345106244 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252073 (secure 0 0 0) 0x7fe6d01472f0 con 0x7fe6b0078b90 2024-09-17T01:37:57.756 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:57.758 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:37:57.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.759+0000 7fe6d6600640 1 -- 172.21.15.42:0/1345106244 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe6b0078b90 msgr2=0x7fe6b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:57.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.759+0000 7fe6d6600640 1 --2- 172.21.15.42:0/1345106244 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe6b0078b90 0x7fe6b007b0a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0035000 tx=0x7fe6c002d040 comp rx=0 tx=0).stop 2024-09-17T01:37:57.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.759+0000 7fe6d6600640 1 -- 172.21.15.42:0/1345106244 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6d01f7080 msgr2=0x7fe6d0144860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:57.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.759+0000 7fe6d6600640 1 --2- 172.21.15.42:0/1345106244 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6d01f7080 0x7fe6d0144860 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc006610 tx=0x7fe6bc001730 comp rx=0 tx=0).stop 2024-09-17T01:37:57.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.759+0000 7fe6d6600640 1 -- 172.21.15.42:0/1345106244 shutdown_connections 2024-09-17T01:37:57.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.759+0000 7fe6d6600640 1 --2- 172.21.15.42:0/1345106244 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe6b0078b90 0x7fe6b007b0a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:57.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.759+0000 7fe6d6600640 1 --2- 172.21.15.42:0/1345106244 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe6d00b0ed0 0x7fe6d00b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:57.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.759+0000 7fe6d6600640 1 --2- 172.21.15.42:0/1345106244 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6d01f7080 0x7fe6d0144860 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:57.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.759+0000 7fe6d6600640 1 --2- 172.21.15.42:0/1345106244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6b40039e0 0x7fe6d00acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:57.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.759+0000 7fe6d6600640 1 -- 172.21.15.42:0/1345106244 >> 172.21.15.42:0/1345106244 conn(0x7fe6d00b2930 msgr2=0x7fe6d015fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:57.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.759+0000 7fe6d6600640 1 -- 172.21.15.42:0/1345106244 shutdown_connections 2024-09-17T01:37:57.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:57.759+0000 7fe6d6600640 1 -- 172.21.15.42:0/1345106244 wait complete. 2024-09-17T01:37:57.782 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":268,"stamp":"2024-09-17T01:37:57.077387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":160,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":284480,"kb_used_data":9976,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754690240,"statfs":{"total":773094113280,"available":772802805760,"internally_reserved":0,"allocated":10215424,"data_stored":5058411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":280874548},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.789712"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.328338+0000","last_change":"2024-09-17T01:37:53.323434+0000","last_active":"2024-09-17T01:37:53.328338+0000","last_peered":"2024-09-17T01:37:53.328338+0000","last_clean":"2024-09-17T01:37:53.328338+0000","last_became_active":"2024-09-17T01:37:53.323123+0000","last_became_peered":"2024-09-17T01:37:53.323123+0000","last_unstale":"2024-09-17T01:37:53.328338+0000","last_undegraded":"2024-09-17T01:37:53.328338+0000","last_fullsized":"2024-09-17T01:37:53.328338+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:16.267783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.324466+0000","last_change":"2024-09-17T01:37:53.325854+0000","last_active":"2024-09-17T01:37:54.324466+0000","last_peered":"2024-09-17T01:37:54.324466+0000","last_clean":"2024-09-17T01:37:54.324466+0000","last_became_active":"2024-09-17T01:37:53.324696+0000","last_became_peered":"2024-09-17T01:37:53.324696+0000","last_unstale":"2024-09-17T01:37:54.324466+0000","last_undegraded":"2024-09-17T01:37:54.324466+0000","last_fullsized":"2024-09-17T01:37:54.324466+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:04:53.773067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823388+0000","last_change":"2024-09-17T01:37:53.332919+0000","last_active":"2024-09-17T01:37:54.823388+0000","last_peered":"2024-09-17T01:37:54.823388+0000","last_clean":"2024-09-17T01:37:54.823388+0000","last_became_active":"2024-09-17T01:37:53.332563+0000","last_became_peered":"2024-09-17T01:37:53.332563+0000","last_unstale":"2024-09-17T01:37:54.823388+0000","last_undegraded":"2024-09-17T01:37:54.823388+0000","last_fullsized":"2024-09-17T01:37:54.823388+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:33.131903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.343349+0000","last_change":"2024-09-17T01:37:53.340094+0000","last_active":"2024-09-17T01:37:53.343349+0000","last_peered":"2024-09-17T01:37:53.343349+0000","last_clean":"2024-09-17T01:37:53.343349+0000","last_became_active":"2024-09-17T01:37:53.339113+0000","last_became_peered":"2024-09-17T01:37:53.339113+0000","last_unstale":"2024-09-17T01:37:53.343349+0000","last_undegraded":"2024-09-17T01:37:53.343349+0000","last_fullsized":"2024-09-17T01:37:53.343349+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:21.787954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.321625+0000","last_change":"2024-09-17T01:37:53.331195+0000","last_active":"2024-09-17T01:37:54.321625+0000","last_peered":"2024-09-17T01:37:54.321625+0000","last_clean":"2024-09-17T01:37:54.321625+0000","last_became_active":"2024-09-17T01:37:53.329695+0000","last_became_peered":"2024-09-17T01:37:53.329695+0000","last_unstale":"2024-09-17T01:37:54.321625+0000","last_undegraded":"2024-09-17T01:37:54.321625+0000","last_fullsized":"2024-09-17T01:37:54.321625+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:53.983384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823375+0000","last_change":"2024-09-17T01:37:53.338232+0000","last_active":"2024-09-17T01:37:54.823375+0000","last_peered":"2024-09-17T01:37:54.823375+0000","last_clean":"2024-09-17T01:37:54.823375+0000","last_became_active":"2024-09-17T01:37:53.337962+0000","last_became_peered":"2024-09-17T01:37:53.337962+0000","last_unstale":"2024-09-17T01:37:54.823375+0000","last_undegraded":"2024-09-17T01:37:54.823375+0000","last_fullsized":"2024-09-17T01:37:54.823375+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:20.040278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.322704+0000","last_change":"2024-09-17T01:37:53.322117+0000","last_active":"2024-09-17T01:37:54.322704+0000","last_peered":"2024-09-17T01:37:54.322704+0000","last_clean":"2024-09-17T01:37:54.322704+0000","last_became_active":"2024-09-17T01:37:53.321700+0000","last_became_peered":"2024-09-17T01:37:53.321700+0000","last_unstale":"2024-09-17T01:37:54.322704+0000","last_undegraded":"2024-09-17T01:37:54.322704+0000","last_fullsized":"2024-09-17T01:37:54.322704+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:33.402889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.337069+0000","last_change":"2024-09-17T01:37:53.335359+0000","last_active":"2024-09-17T01:37:53.337069+0000","last_peered":"2024-09-17T01:37:53.337069+0000","last_clean":"2024-09-17T01:37:53.337069+0000","last_became_active":"2024-09-17T01:37:53.334951+0000","last_became_peered":"2024-09-17T01:37:53.334951+0000","last_unstale":"2024-09-17T01:37:53.337069+0000","last_undegraded":"2024-09-17T01:37:53.337069+0000","last_fullsized":"2024-09-17T01:37:53.337069+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:41.991925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.345938+0000","last_change":"2024-09-17T01:37:53.338245+0000","last_active":"2024-09-17T01:37:53.345938+0000","last_peered":"2024-09-17T01:37:53.345938+0000","last_clean":"2024-09-17T01:37:53.345938+0000","last_became_active":"2024-09-17T01:37:53.331726+0000","last_became_peered":"2024-09-17T01:37:53.331726+0000","last_unstale":"2024-09-17T01:37:53.345938+0000","last_undegraded":"2024-09-17T01:37:53.345938+0000","last_fullsized":"2024-09-17T01:37:53.345938+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:24.399214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823453+0000","last_change":"2024-09-17T01:37:53.324269+0000","last_active":"2024-09-17T01:37:54.823453+0000","last_peered":"2024-09-17T01:37:54.823453+0000","last_clean":"2024-09-17T01:37:54.823453+0000","last_became_active":"2024-09-17T01:37:53.319025+0000","last_became_peered":"2024-09-17T01:37:53.319025+0000","last_unstale":"2024-09-17T01:37:54.823453+0000","last_undegraded":"2024-09-17T01:37:54.823453+0000","last_fullsized":"2024-09-17T01:37:54.823453+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:06.964744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.329793+0000","last_change":"2024-09-17T01:37:53.321997+0000","last_active":"2024-09-17T01:37:54.329793+0000","last_peered":"2024-09-17T01:37:54.329793+0000","last_clean":"2024-09-17T01:37:54.329793+0000","last_became_active":"2024-09-17T01:37:53.321513+0000","last_became_peered":"2024-09-17T01:37:53.321513+0000","last_unstale":"2024-09-17T01:37:54.329793+0000","last_undegraded":"2024-09-17T01:37:54.329793+0000","last_fullsized":"2024-09-17T01:37:54.329793+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:17.384714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.347137+0000","last_change":"2024-09-17T01:37:53.344906+0000","last_active":"2024-09-17T01:37:53.347137+0000","last_peered":"2024-09-17T01:37:53.347137+0000","last_clean":"2024-09-17T01:37:53.347137+0000","last_became_active":"2024-09-17T01:37:53.344078+0000","last_became_peered":"2024-09-17T01:37:53.344078+0000","last_unstale":"2024-09-17T01:37:53.347137+0000","last_undegraded":"2024-09-17T01:37:53.347137+0000","last_fullsized":"2024-09-17T01:37:53.347137+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:09.553107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.321617+0000","last_change":"2024-09-17T01:37:53.325214+0000","last_active":"2024-09-17T01:37:54.321617+0000","last_peered":"2024-09-17T01:37:54.321617+0000","last_clean":"2024-09-17T01:37:54.321617+0000","last_became_active":"2024-09-17T01:37:53.324917+0000","last_became_peered":"2024-09-17T01:37:53.324917+0000","last_unstale":"2024-09-17T01:37:54.321617+0000","last_undegraded":"2024-09-17T01:37:54.321617+0000","last_fullsized":"2024-09-17T01:37:54.321617+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:04.878843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.323351+0000","last_change":"2024-09-17T01:37:53.330846+0000","last_active":"2024-09-17T01:37:54.323351+0000","last_peered":"2024-09-17T01:37:54.323351+0000","last_clean":"2024-09-17T01:37:54.323351+0000","last_became_active":"2024-09-17T01:37:53.328965+0000","last_became_peered":"2024-09-17T01:37:53.328965+0000","last_unstale":"2024-09-17T01:37:54.323351+0000","last_undegraded":"2024-09-17T01:37:54.323351+0000","last_fullsized":"2024-09-17T01:37:54.323351+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:52.758087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.322942+0000","last_change":"2024-09-17T01:37:53.331255+0000","last_active":"2024-09-17T01:37:54.322942+0000","last_peered":"2024-09-17T01:37:54.322942+0000","last_clean":"2024-09-17T01:37:54.322942+0000","last_became_active":"2024-09-17T01:37:53.330010+0000","last_became_peered":"2024-09-17T01:37:53.330010+0000","last_unstale":"2024-09-17T01:37:54.322942+0000","last_undegraded":"2024-09-17T01:37:54.322942+0000","last_fullsized":"2024-09-17T01:37:54.322942+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:58.424579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823134+0000","last_change":"2024-09-17T01:37:53.331662+0000","last_active":"2024-09-17T01:37:54.823134+0000","last_peered":"2024-09-17T01:37:54.823134+0000","last_clean":"2024-09-17T01:37:54.823134+0000","last_became_active":"2024-09-17T01:37:53.331309+0000","last_became_peered":"2024-09-17T01:37:53.331309+0000","last_unstale":"2024-09-17T01:37:54.823134+0000","last_undegraded":"2024-09-17T01:37:54.823134+0000","last_fullsized":"2024-09-17T01:37:54.823134+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:21:26.377264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.332447+0000","last_change":"2024-09-17T01:37:53.329165+0000","last_active":"2024-09-17T01:37:53.332447+0000","last_peered":"2024-09-17T01:37:53.332447+0000","last_clean":"2024-09-17T01:37:53.332447+0000","last_became_active":"2024-09-17T01:37:53.328855+0000","last_became_peered":"2024-09-17T01:37:53.328855+0000","last_unstale":"2024-09-17T01:37:53.332447+0000","last_undegraded":"2024-09-17T01:37:53.332447+0000","last_fullsized":"2024-09-17T01:37:53.332447+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:22.967442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.329731+0000","last_change":"2024-09-17T01:37:53.332430+0000","last_active":"2024-09-17T01:37:54.329731+0000","last_peered":"2024-09-17T01:37:54.329731+0000","last_clean":"2024-09-17T01:37:54.329731+0000","last_became_active":"2024-09-17T01:37:53.332106+0000","last_became_peered":"2024-09-17T01:37:53.332106+0000","last_unstale":"2024-09-17T01:37:54.329731+0000","last_undegraded":"2024-09-17T01:37:54.329731+0000","last_fullsized":"2024-09-17T01:37:54.329731+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:07.081840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.323032+0000","last_change":"2024-09-17T01:37:53.340440+0000","last_active":"2024-09-17T01:37:54.323032+0000","last_peered":"2024-09-17T01:37:54.323032+0000","last_clean":"2024-09-17T01:37:54.323032+0000","last_became_active":"2024-09-17T01:37:53.338137+0000","last_became_peered":"2024-09-17T01:37:53.338137+0000","last_unstale":"2024-09-17T01:37:54.323032+0000","last_undegraded":"2024-09-17T01:37:54.323032+0000","last_fullsized":"2024-09-17T01:37:54.323032+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:29.176802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.323867+0000","last_change":"2024-09-17T01:37:53.340430+0000","last_active":"2024-09-17T01:37:54.323867+0000","last_peered":"2024-09-17T01:37:54.323867+0000","last_clean":"2024-09-17T01:37:54.323867+0000","last_became_active":"2024-09-17T01:37:53.339134+0000","last_became_peered":"2024-09-17T01:37:53.339134+0000","last_unstale":"2024-09-17T01:37:54.323867+0000","last_undegraded":"2024-09-17T01:37:54.323867+0000","last_fullsized":"2024-09-17T01:37:54.323867+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:50:53.369748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.339205+0000","last_change":"2024-09-17T01:37:53.337128+0000","last_active":"2024-09-17T01:37:53.339205+0000","last_peered":"2024-09-17T01:37:53.339205+0000","last_clean":"2024-09-17T01:37:53.339205+0000","last_became_active":"2024-09-17T01:37:53.336406+0000","last_became_peered":"2024-09-17T01:37:53.336406+0000","last_unstale":"2024-09-17T01:37:53.339205+0000","last_undegraded":"2024-09-17T01:37:53.339205+0000","last_fullsized":"2024-09-17T01:37:53.339205+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:59.818074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.323637+0000","last_change":"2024-09-17T01:37:53.331272+0000","last_active":"2024-09-17T01:37:54.323637+0000","last_peered":"2024-09-17T01:37:54.323637+0000","last_clean":"2024-09-17T01:37:54.323637+0000","last_became_active":"2024-09-17T01:37:53.328858+0000","last_became_peered":"2024-09-17T01:37:53.328858+0000","last_unstale":"2024-09-17T01:37:54.323637+0000","last_undegraded":"2024-09-17T01:37:54.323637+0000","last_fullsized":"2024-09-17T01:37:54.323637+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:46.725942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.333571+0000","last_change":"2024-09-17T01:37:53.329418+0000","last_active":"2024-09-17T01:37:53.333571+0000","last_peered":"2024-09-17T01:37:53.333571+0000","last_clean":"2024-09-17T01:37:53.333571+0000","last_became_active":"2024-09-17T01:37:53.329038+0000","last_became_peered":"2024-09-17T01:37:53.329038+0000","last_unstale":"2024-09-17T01:37:53.333571+0000","last_undegraded":"2024-09-17T01:37:53.333571+0000","last_fullsized":"2024-09-17T01:37:53.333571+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:43.833225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.329218+0000","last_change":"2024-09-17T01:37:53.324479+0000","last_active":"2024-09-17T01:37:54.329218+0000","last_peered":"2024-09-17T01:37:54.329218+0000","last_clean":"2024-09-17T01:37:54.329218+0000","last_became_active":"2024-09-17T01:37:53.324138+0000","last_became_peered":"2024-09-17T01:37:53.324138+0000","last_unstale":"2024-09-17T01:37:54.329218+0000","last_undegraded":"2024-09-17T01:37:54.329218+0000","last_fullsized":"2024-09-17T01:37:54.329218+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:04.462038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.329965+0000","last_change":"2024-09-17T01:37:53.330434+0000","last_active":"2024-09-17T01:37:54.329965+0000","last_peered":"2024-09-17T01:37:54.329965+0000","last_clean":"2024-09-17T01:37:54.329965+0000","last_became_active":"2024-09-17T01:37:53.329488+0000","last_became_peered":"2024-09-17T01:37:53.329488+0000","last_unstale":"2024-09-17T01:37:54.329965+0000","last_undegraded":"2024-09-17T01:37:54.329965+0000","last_fullsized":"2024-09-17T01:37:54.329965+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:10.636688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.321977+0000","last_change":"2024-09-17T01:37:53.335408+0000","last_active":"2024-09-17T01:37:54.321977+0000","last_peered":"2024-09-17T01:37:54.321977+0000","last_clean":"2024-09-17T01:37:54.321977+0000","last_became_active":"2024-09-17T01:37:53.335114+0000","last_became_peered":"2024-09-17T01:37:53.335114+0000","last_unstale":"2024-09-17T01:37:54.321977+0000","last_undegraded":"2024-09-17T01:37:54.321977+0000","last_fullsized":"2024-09-17T01:37:54.321977+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:41.496681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.322043+0000","last_change":"2024-09-17T01:37:53.340084+0000","last_active":"2024-09-17T01:37:54.322043+0000","last_peered":"2024-09-17T01:37:54.322043+0000","last_clean":"2024-09-17T01:37:54.322043+0000","last_became_active":"2024-09-17T01:37:53.339437+0000","last_became_peered":"2024-09-17T01:37:53.339437+0000","last_unstale":"2024-09-17T01:37:54.322043+0000","last_undegraded":"2024-09-17T01:37:54.322043+0000","last_fullsized":"2024-09-17T01:37:54.322043+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:33.933151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.343993+0000","last_change":"2024-09-17T01:37:53.339183+0000","last_active":"2024-09-17T01:37:53.343993+0000","last_peered":"2024-09-17T01:37:53.343993+0000","last_clean":"2024-09-17T01:37:53.343993+0000","last_became_active":"2024-09-17T01:37:53.338649+0000","last_became_peered":"2024-09-17T01:37:53.338649+0000","last_unstale":"2024-09-17T01:37:53.343993+0000","last_undegraded":"2024-09-17T01:37:53.343993+0000","last_fullsized":"2024-09-17T01:37:53.343993+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:28.204388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.339149+0000","last_change":"2024-09-17T01:37:53.334492+0000","last_active":"2024-09-17T01:37:53.339149+0000","last_peered":"2024-09-17T01:37:53.339149+0000","last_clean":"2024-09-17T01:37:53.339149+0000","last_became_active":"2024-09-17T01:37:53.332837+0000","last_became_peered":"2024-09-17T01:37:53.332837+0000","last_unstale":"2024-09-17T01:37:53.339149+0000","last_undegraded":"2024-09-17T01:37:53.339149+0000","last_fullsized":"2024-09-17T01:37:53.339149+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:11.933133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.323933+0000","last_change":"2024-09-17T01:37:53.332125+0000","last_active":"2024-09-17T01:37:54.323933+0000","last_peered":"2024-09-17T01:37:54.323933+0000","last_clean":"2024-09-17T01:37:54.323933+0000","last_became_active":"2024-09-17T01:37:53.331768+0000","last_became_peered":"2024-09-17T01:37:53.331768+0000","last_unstale":"2024-09-17T01:37:54.323933+0000","last_undegraded":"2024-09-17T01:37:54.323933+0000","last_fullsized":"2024-09-17T01:37:54.323933+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:22.106720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823143+0000","last_change":"2024-09-17T01:37:53.341948+0000","last_active":"2024-09-17T01:37:54.823143+0000","last_peered":"2024-09-17T01:37:54.823143+0000","last_clean":"2024-09-17T01:37:54.823143+0000","last_became_active":"2024-09-17T01:37:53.340935+0000","last_became_peered":"2024-09-17T01:37:53.340935+0000","last_unstale":"2024-09-17T01:37:54.823143+0000","last_undegraded":"2024-09-17T01:37:54.823143+0000","last_fullsized":"2024-09-17T01:37:54.823143+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:06.537114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823366+0000","last_change":"2024-09-17T01:37:53.324800+0000","last_active":"2024-09-17T01:37:54.823366+0000","last_peered":"2024-09-17T01:37:54.823366+0000","last_clean":"2024-09-17T01:37:54.823366+0000","last_became_active":"2024-09-17T01:37:53.324333+0000","last_became_peered":"2024-09-17T01:37:53.324333+0000","last_unstale":"2024-09-17T01:37:54.823366+0000","last_undegraded":"2024-09-17T01:37:54.823366+0000","last_fullsized":"2024-09-17T01:37:54.823366+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:30.633726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.349423+0000","last_change":"2024-09-17T01:37:53.348604+0000","last_active":"2024-09-17T01:37:53.349423+0000","last_peered":"2024-09-17T01:37:53.349423+0000","last_clean":"2024-09-17T01:37:53.349423+0000","last_became_active":"2024-09-17T01:37:53.348273+0000","last_became_peered":"2024-09-17T01:37:53.348273+0000","last_unstale":"2024-09-17T01:37:53.349423+0000","last_undegraded":"2024-09-17T01:37:53.349423+0000","last_fullsized":"2024-09-17T01:37:53.349423+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:42.090803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"92'4","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.322176+0000","last_change":"2024-09-17T01:37:52.308589+0000","last_active":"2024-09-17T01:37:54.322176+0000","last_peered":"2024-09-17T01:37:54.322176+0000","last_clean":"2024-09-17T01:37:54.322176+0000","last_became_active":"2024-09-17T01:37:52.308252+0000","last_became_peered":"2024-09-17T01:37:52.308252+0000","last_unstale":"2024-09-17T01:37:54.322176+0000","last_undegraded":"2024-09-17T01:37:54.322176+0000","last_fullsized":"2024-09-17T01:37:54.322176+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:20.580926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.328363+0000","last_change":"2024-09-17T01:37:53.324644+0000","last_active":"2024-09-17T01:37:53.328363+0000","last_peered":"2024-09-17T01:37:53.328363+0000","last_clean":"2024-09-17T01:37:53.328363+0000","last_became_active":"2024-09-17T01:37:53.323769+0000","last_became_peered":"2024-09-17T01:37:53.323769+0000","last_unstale":"2024-09-17T01:37:53.328363+0000","last_undegraded":"2024-09-17T01:37:53.328363+0000","last_fullsized":"2024-09-17T01:37:53.328363+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:45.115957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"92'1","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823607+0000","last_change":"2024-09-17T01:37:52.320023+0000","last_active":"2024-09-17T01:37:54.823607+0000","last_peered":"2024-09-17T01:37:54.823607+0000","last_clean":"2024-09-17T01:37:54.823607+0000","last_became_active":"2024-09-17T01:37:52.319679+0000","last_became_peered":"2024-09-17T01:37:52.319679+0000","last_unstale":"2024-09-17T01:37:54.823607+0000","last_undegraded":"2024-09-17T01:37:54.823607+0000","last_fullsized":"2024-09-17T01:37:54.823607+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:28:04.371324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.347165+0000","last_change":"2024-09-17T01:37:53.345235+0000","last_active":"2024-09-17T01:37:53.347165+0000","last_peered":"2024-09-17T01:37:53.347165+0000","last_clean":"2024-09-17T01:37:53.347165+0000","last_became_active":"2024-09-17T01:37:53.344567+0000","last_became_peered":"2024-09-17T01:37:53.344567+0000","last_unstale":"2024-09-17T01:37:53.347165+0000","last_undegraded":"2024-09-17T01:37:53.347165+0000","last_fullsized":"2024-09-17T01:37:53.347165+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:29:09.808301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"92'2","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.329691+0000","last_change":"2024-09-17T01:37:52.317191+0000","last_active":"2024-09-17T01:37:54.329691+0000","last_peered":"2024-09-17T01:37:54.329691+0000","last_clean":"2024-09-17T01:37:54.329691+0000","last_became_active":"2024-09-17T01:37:52.315987+0000","last_became_peered":"2024-09-17T01:37:52.315987+0000","last_unstale":"2024-09-17T01:37:54.329691+0000","last_undegraded":"2024-09-17T01:37:54.329691+0000","last_fullsized":"2024-09-17T01:37:54.329691+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:46.245368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.346476+0000","last_change":"2024-09-17T01:37:53.338971+0000","last_active":"2024-09-17T01:37:53.346476+0000","last_peered":"2024-09-17T01:37:53.346476+0000","last_clean":"2024-09-17T01:37:53.346476+0000","last_became_active":"2024-09-17T01:37:53.338604+0000","last_became_peered":"2024-09-17T01:37:53.338604+0000","last_unstale":"2024-09-17T01:37:53.346476+0000","last_undegraded":"2024-09-17T01:37:53.346476+0000","last_fullsized":"2024-09-17T01:37:53.346476+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:34.440955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"92'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.346388+0000","last_change":"2024-09-17T01:37:52.316249+0000","last_active":"2024-09-17T01:37:53.346388+0000","last_peered":"2024-09-17T01:37:53.346388+0000","last_clean":"2024-09-17T01:37:53.346388+0000","last_became_active":"2024-09-17T01:37:52.315929+0000","last_became_peered":"2024-09-17T01:37:52.315929+0000","last_unstale":"2024-09-17T01:37:53.346388+0000","last_undegraded":"2024-09-17T01:37:53.346388+0000","last_fullsized":"2024-09-17T01:37:53.346388+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:32.378997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.337475+0000","last_change":"2024-09-17T01:37:53.329521+0000","last_active":"2024-09-17T01:37:53.337475+0000","last_peered":"2024-09-17T01:37:53.337475+0000","last_clean":"2024-09-17T01:37:53.337475+0000","last_became_active":"2024-09-17T01:37:53.329194+0000","last_became_peered":"2024-09-17T01:37:53.329194+0000","last_unstale":"2024-09-17T01:37:53.337475+0000","last_undegraded":"2024-09-17T01:37:53.337475+0000","last_fullsized":"2024-09-17T01:37:53.337475+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:04.863416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"92'1","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.353432+0000","last_change":"2024-09-17T01:37:52.312522+0000","last_active":"2024-09-17T01:37:53.353432+0000","last_peered":"2024-09-17T01:37:53.353432+0000","last_clean":"2024-09-17T01:37:53.353432+0000","last_became_active":"2024-09-17T01:37:52.312160+0000","last_became_peered":"2024-09-17T01:37:52.312160+0000","last_unstale":"2024-09-17T01:37:53.353432+0000","last_undegraded":"2024-09-17T01:37:53.353432+0000","last_fullsized":"2024-09-17T01:37:53.353432+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:42.713011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823576+0000","last_change":"2024-09-17T01:37:53.334677+0000","last_active":"2024-09-17T01:37:54.823576+0000","last_peered":"2024-09-17T01:37:54.823576+0000","last_clean":"2024-09-17T01:37:54.823576+0000","last_became_active":"2024-09-17T01:37:53.334324+0000","last_became_peered":"2024-09-17T01:37:53.334324+0000","last_unstale":"2024-09-17T01:37:54.823576+0000","last_undegraded":"2024-09-17T01:37:54.823576+0000","last_fullsized":"2024-09-17T01:37:54.823576+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:41.206244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"92'1","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823550+0000","last_change":"2024-09-17T01:37:52.317384+0000","last_active":"2024-09-17T01:37:54.823550+0000","last_peered":"2024-09-17T01:37:54.823550+0000","last_clean":"2024-09-17T01:37:54.823550+0000","last_became_active":"2024-09-17T01:37:52.316739+0000","last_became_peered":"2024-09-17T01:37:52.316739+0000","last_unstale":"2024-09-17T01:37:54.823550+0000","last_undegraded":"2024-09-17T01:37:54.823550+0000","last_fullsized":"2024-09-17T01:37:54.823550+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:55.989271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.345661+0000","last_change":"2024-09-17T01:37:53.343017+0000","last_active":"2024-09-17T01:37:53.345661+0000","last_peered":"2024-09-17T01:37:53.345661+0000","last_clean":"2024-09-17T01:37:53.345661+0000","last_became_active":"2024-09-17T01:37:53.342508+0000","last_became_peered":"2024-09-17T01:37:53.342508+0000","last_unstale":"2024-09-17T01:37:53.345661+0000","last_undegraded":"2024-09-17T01:37:53.345661+0000","last_fullsized":"2024-09-17T01:37:53.345661+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:41.149904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.323440+0000","last_change":"2024-09-17T01:37:52.319128+0000","last_active":"2024-09-17T01:37:54.323440+0000","last_peered":"2024-09-17T01:37:54.323440+0000","last_clean":"2024-09-17T01:37:54.323440+0000","last_became_active":"2024-09-17T01:37:52.318427+0000","last_became_peered":"2024-09-17T01:37:52.318427+0000","last_unstale":"2024-09-17T01:37:54.323440+0000","last_undegraded":"2024-09-17T01:37:54.323440+0000","last_fullsized":"2024-09-17T01:37:54.323440+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:59:56.727792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.323300+0000","last_change":"2024-09-17T01:37:53.324412+0000","last_active":"2024-09-17T01:37:54.323300+0000","last_peered":"2024-09-17T01:37:54.323300+0000","last_clean":"2024-09-17T01:37:54.323300+0000","last_became_active":"2024-09-17T01:37:53.324040+0000","last_became_peered":"2024-09-17T01:37:53.324040+0000","last_unstale":"2024-09-17T01:37:54.323300+0000","last_undegraded":"2024-09-17T01:37:54.323300+0000","last_fullsized":"2024-09-17T01:37:54.323300+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:16:22.427228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.322792+0000","last_change":"2024-09-17T01:37:52.323662+0000","last_active":"2024-09-17T01:37:54.322792+0000","last_peered":"2024-09-17T01:37:54.322792+0000","last_clean":"2024-09-17T01:37:54.322792+0000","last_became_active":"2024-09-17T01:37:52.323243+0000","last_became_peered":"2024-09-17T01:37:52.323243+0000","last_unstale":"2024-09-17T01:37:54.322792+0000","last_undegraded":"2024-09-17T01:37:54.322792+0000","last_fullsized":"2024-09-17T01:37:54.322792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:49.778248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.323900+0000","last_change":"2024-09-17T01:37:53.336867+0000","last_active":"2024-09-17T01:37:54.323900+0000","last_peered":"2024-09-17T01:37:54.323900+0000","last_clean":"2024-09-17T01:37:54.323900+0000","last_became_active":"2024-09-17T01:37:53.336476+0000","last_became_peered":"2024-09-17T01:37:53.336476+0000","last_unstale":"2024-09-17T01:37:54.323900+0000","last_undegraded":"2024-09-17T01:37:54.323900+0000","last_fullsized":"2024-09-17T01:37:54.323900+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:46.733423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.314456+0000","last_change":"2024-09-17T01:37:52.316943+0000","last_active":"2024-09-17T01:37:53.314456+0000","last_peered":"2024-09-17T01:37:53.314456+0000","last_clean":"2024-09-17T01:37:53.314456+0000","last_became_active":"2024-09-17T01:37:52.314892+0000","last_became_peered":"2024-09-17T01:37:52.314892+0000","last_unstale":"2024-09-17T01:37:53.314456+0000","last_undegraded":"2024-09-17T01:37:53.314456+0000","last_fullsized":"2024-09-17T01:37:53.314456+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:44.877693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.335931+0000","last_change":"2024-09-17T01:37:53.333732+0000","last_active":"2024-09-17T01:37:53.335931+0000","last_peered":"2024-09-17T01:37:53.335931+0000","last_clean":"2024-09-17T01:37:53.335931+0000","last_became_active":"2024-09-17T01:37:53.332164+0000","last_became_peered":"2024-09-17T01:37:53.332164+0000","last_unstale":"2024-09-17T01:37:53.335931+0000","last_undegraded":"2024-09-17T01:37:53.335931+0000","last_fullsized":"2024-09-17T01:37:53.335931+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:28.382341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823626+0000","last_change":"2024-09-17T01:37:52.322725+0000","last_active":"2024-09-17T01:37:54.823626+0000","last_peered":"2024-09-17T01:37:54.823626+0000","last_clean":"2024-09-17T01:37:54.823626+0000","last_became_active":"2024-09-17T01:37:52.322040+0000","last_became_peered":"2024-09-17T01:37:52.322040+0000","last_unstale":"2024-09-17T01:37:54.823626+0000","last_undegraded":"2024-09-17T01:37:54.823626+0000","last_fullsized":"2024-09-17T01:37:54.823626+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:25.365551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.329760+0000","last_change":"2024-09-17T01:37:53.330736+0000","last_active":"2024-09-17T01:37:54.329760+0000","last_peered":"2024-09-17T01:37:54.329760+0000","last_clean":"2024-09-17T01:37:54.329760+0000","last_became_active":"2024-09-17T01:37:53.330198+0000","last_became_peered":"2024-09-17T01:37:53.330198+0000","last_unstale":"2024-09-17T01:37:54.329760+0000","last_undegraded":"2024-09-17T01:37:54.329760+0000","last_fullsized":"2024-09-17T01:37:54.329760+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:42.463846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"92'3","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.351012+0000","last_change":"2024-09-17T01:37:52.317858+0000","last_active":"2024-09-17T01:37:53.351012+0000","last_peered":"2024-09-17T01:37:53.351012+0000","last_clean":"2024-09-17T01:37:53.351012+0000","last_became_active":"2024-09-17T01:37:52.316127+0000","last_became_peered":"2024-09-17T01:37:52.316127+0000","last_unstale":"2024-09-17T01:37:53.351012+0000","last_undegraded":"2024-09-17T01:37:53.351012+0000","last_fullsized":"2024-09-17T01:37:53.351012+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:59.006855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.321792+0000","last_change":"2024-09-17T01:37:53.339737+0000","last_active":"2024-09-17T01:37:54.321792+0000","last_peered":"2024-09-17T01:37:54.321792+0000","last_clean":"2024-09-17T01:37:54.321792+0000","last_became_active":"2024-09-17T01:37:53.332630+0000","last_became_peered":"2024-09-17T01:37:53.332630+0000","last_unstale":"2024-09-17T01:37:54.321792+0000","last_undegraded":"2024-09-17T01:37:54.321792+0000","last_fullsized":"2024-09-17T01:37:54.321792+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:53.449392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"92'6","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.356975+0000","last_change":"2024-09-17T01:37:52.321121+0000","last_active":"2024-09-17T01:37:53.356975+0000","last_peered":"2024-09-17T01:37:53.356975+0000","last_clean":"2024-09-17T01:37:53.356975+0000","last_became_active":"2024-09-17T01:37:52.320820+0000","last_became_peered":"2024-09-17T01:37:52.320820+0000","last_unstale":"2024-09-17T01:37:53.356975+0000","last_undegraded":"2024-09-17T01:37:53.356975+0000","last_fullsized":"2024-09-17T01:37:53.356975+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:15:15.668015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.329370+0000","last_change":"2024-09-17T01:37:53.334868+0000","last_active":"2024-09-17T01:37:54.329370+0000","last_peered":"2024-09-17T01:37:54.329370+0000","last_clean":"2024-09-17T01:37:54.329370+0000","last_became_active":"2024-09-17T01:37:53.334499+0000","last_became_peered":"2024-09-17T01:37:53.334499+0000","last_unstale":"2024-09-17T01:37:54.329370+0000","last_undegraded":"2024-09-17T01:37:54.329370+0000","last_fullsized":"2024-09-17T01:37:54.329370+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:41.975111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"92'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.346107+0000","last_change":"2024-09-17T01:37:52.311124+0000","last_active":"2024-09-17T01:37:53.346107+0000","last_peered":"2024-09-17T01:37:53.346107+0000","last_clean":"2024-09-17T01:37:53.346107+0000","last_became_active":"2024-09-17T01:37:52.310802+0000","last_became_peered":"2024-09-17T01:37:52.310802+0000","last_unstale":"2024-09-17T01:37:53.346107+0000","last_undegraded":"2024-09-17T01:37:53.346107+0000","last_fullsized":"2024-09-17T01:37:53.346107+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:27.217774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.327484+0000","last_change":"2024-09-17T01:37:53.321353+0000","last_active":"2024-09-17T01:37:53.327484+0000","last_peered":"2024-09-17T01:37:53.327484+0000","last_clean":"2024-09-17T01:37:53.327484+0000","last_became_active":"2024-09-17T01:37:53.321017+0000","last_became_peered":"2024-09-17T01:37:53.321017+0000","last_unstale":"2024-09-17T01:37:53.327484+0000","last_undegraded":"2024-09-17T01:37:53.327484+0000","last_fullsized":"2024-09-17T01:37:53.327484+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:41.554927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.323362+0000","last_change":"2024-09-17T01:37:52.307370+0000","last_active":"2024-09-17T01:37:54.323362+0000","last_peered":"2024-09-17T01:37:54.323362+0000","last_clean":"2024-09-17T01:37:54.323362+0000","last_became_active":"2024-09-17T01:37:52.306991+0000","last_became_peered":"2024-09-17T01:37:52.306991+0000","last_unstale":"2024-09-17T01:37:54.323362+0000","last_undegraded":"2024-09-17T01:37:54.323362+0000","last_fullsized":"2024-09-17T01:37:54.323362+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:29:08.801834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.322976+0000","last_change":"2024-09-17T01:37:53.332850+0000","last_active":"2024-09-17T01:37:54.322976+0000","last_peered":"2024-09-17T01:37:54.322976+0000","last_clean":"2024-09-17T01:37:54.322976+0000","last_became_active":"2024-09-17T01:37:53.332211+0000","last_became_peered":"2024-09-17T01:37:53.332211+0000","last_unstale":"2024-09-17T01:37:54.322976+0000","last_undegraded":"2024-09-17T01:37:54.322976+0000","last_fullsized":"2024-09-17T01:37:54.322976+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:30.799734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.822959+0000","last_change":"2024-09-17T01:37:52.315800+0000","last_active":"2024-09-17T01:37:54.822959+0000","last_peered":"2024-09-17T01:37:54.822959+0000","last_clean":"2024-09-17T01:37:54.822959+0000","last_became_active":"2024-09-17T01:37:52.315470+0000","last_became_peered":"2024-09-17T01:37:52.315470+0000","last_unstale":"2024-09-17T01:37:54.822959+0000","last_undegraded":"2024-09-17T01:37:54.822959+0000","last_fullsized":"2024-09-17T01:37:54.822959+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:09.559219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.329165+0000","last_change":"2024-09-17T01:37:53.322392+0000","last_active":"2024-09-17T01:37:54.329165+0000","last_peered":"2024-09-17T01:37:54.329165+0000","last_clean":"2024-09-17T01:37:54.329165+0000","last_became_active":"2024-09-17T01:37:53.319553+0000","last_became_peered":"2024-09-17T01:37:53.319553+0000","last_unstale":"2024-09-17T01:37:54.329165+0000","last_undegraded":"2024-09-17T01:37:54.329165+0000","last_fullsized":"2024-09-17T01:37:54.329165+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:10.767769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"92'8","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.329126+0000","last_change":"2024-09-17T01:37:52.312136+0000","last_active":"2024-09-17T01:37:54.329126+0000","last_peered":"2024-09-17T01:37:54.329126+0000","last_clean":"2024-09-17T01:37:54.329126+0000","last_became_active":"2024-09-17T01:37:52.311801+0000","last_became_peered":"2024-09-17T01:37:52.311801+0000","last_unstale":"2024-09-17T01:37:54.329126+0000","last_undegraded":"2024-09-17T01:37:54.329126+0000","last_fullsized":"2024-09-17T01:37:54.329126+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:54.479916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.337438+0000","last_change":"2024-09-17T01:37:53.334229+0000","last_active":"2024-09-17T01:37:53.337438+0000","last_peered":"2024-09-17T01:37:53.337438+0000","last_clean":"2024-09-17T01:37:53.337438+0000","last_became_active":"2024-09-17T01:37:53.333187+0000","last_became_peered":"2024-09-17T01:37:53.333187+0000","last_unstale":"2024-09-17T01:37:53.337438+0000","last_undegraded":"2024-09-17T01:37:53.337438+0000","last_fullsized":"2024-09-17T01:37:53.337438+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:36.940779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"92'1","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.322374+0000","last_change":"2024-09-17T01:37:52.311462+0000","last_active":"2024-09-17T01:37:54.322374+0000","last_peered":"2024-09-17T01:37:54.322374+0000","last_clean":"2024-09-17T01:37:54.322374+0000","last_became_active":"2024-09-17T01:37:52.311120+0000","last_became_peered":"2024-09-17T01:37:52.311120+0000","last_unstale":"2024-09-17T01:37:54.322374+0000","last_undegraded":"2024-09-17T01:37:54.322374+0000","last_fullsized":"2024-09-17T01:37:54.322374+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:38.374121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823697+0000","last_change":"2024-09-17T01:37:53.332966+0000","last_active":"2024-09-17T01:37:54.823697+0000","last_peered":"2024-09-17T01:37:54.823697+0000","last_clean":"2024-09-17T01:37:54.823697+0000","last_became_active":"2024-09-17T01:37:53.332617+0000","last_became_peered":"2024-09-17T01:37:53.332617+0000","last_unstale":"2024-09-17T01:37:54.823697+0000","last_undegraded":"2024-09-17T01:37:54.823697+0000","last_fullsized":"2024-09-17T01:37:54.823697+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:12.476744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"92'2","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.324064+0000","last_change":"2024-09-17T01:37:52.318930+0000","last_active":"2024-09-17T01:37:54.324064+0000","last_peered":"2024-09-17T01:37:54.324064+0000","last_clean":"2024-09-17T01:37:54.324064+0000","last_became_active":"2024-09-17T01:37:52.318448+0000","last_became_peered":"2024-09-17T01:37:52.318448+0000","last_unstale":"2024-09-17T01:37:54.324064+0000","last_undegraded":"2024-09-17T01:37:54.324064+0000","last_fullsized":"2024-09-17T01:37:54.324064+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:37:18.382481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.336221+0000","last_change":"2024-09-17T01:37:53.333972+0000","last_active":"2024-09-17T01:37:53.336221+0000","last_peered":"2024-09-17T01:37:53.336221+0000","last_clean":"2024-09-17T01:37:53.336221+0000","last_became_active":"2024-09-17T01:37:53.333604+0000","last_became_peered":"2024-09-17T01:37:53.333604+0000","last_unstale":"2024-09-17T01:37:53.336221+0000","last_undegraded":"2024-09-17T01:37:53.336221+0000","last_fullsized":"2024-09-17T01:37:53.336221+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:42.854106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.324100+0000","last_change":"2024-09-17T01:37:52.320882+0000","last_active":"2024-09-17T01:37:54.324100+0000","last_peered":"2024-09-17T01:37:54.324100+0000","last_clean":"2024-09-17T01:37:54.324100+0000","last_became_active":"2024-09-17T01:37:52.320232+0000","last_became_peered":"2024-09-17T01:37:52.320232+0000","last_unstale":"2024-09-17T01:37:54.324100+0000","last_undegraded":"2024-09-17T01:37:54.324100+0000","last_fullsized":"2024-09-17T01:37:54.324100+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:49.891994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.323234+0000","last_change":"2024-09-17T01:37:53.315107+0000","last_active":"2024-09-17T01:37:54.323234+0000","last_peered":"2024-09-17T01:37:54.323234+0000","last_clean":"2024-09-17T01:37:54.323234+0000","last_became_active":"2024-09-17T01:37:53.314709+0000","last_became_peered":"2024-09-17T01:37:53.314709+0000","last_unstale":"2024-09-17T01:37:54.323234+0000","last_undegraded":"2024-09-17T01:37:54.323234+0000","last_fullsized":"2024-09-17T01:37:54.323234+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:25.592078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"92'2","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.324340+0000","last_change":"2024-09-17T01:37:52.316520+0000","last_active":"2024-09-17T01:37:54.324340+0000","last_peered":"2024-09-17T01:37:54.324340+0000","last_clean":"2024-09-17T01:37:54.324340+0000","last_became_active":"2024-09-17T01:37:52.316152+0000","last_became_peered":"2024-09-17T01:37:52.316152+0000","last_unstale":"2024-09-17T01:37:54.324340+0000","last_undegraded":"2024-09-17T01:37:54.324340+0000","last_fullsized":"2024-09-17T01:37:54.324340+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:32.106487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.321885+0000","last_change":"2024-09-17T01:37:53.331431+0000","last_active":"2024-09-17T01:37:54.321885+0000","last_peered":"2024-09-17T01:37:54.321885+0000","last_clean":"2024-09-17T01:37:54.321885+0000","last_became_active":"2024-09-17T01:37:53.330635+0000","last_became_peered":"2024-09-17T01:37:53.330635+0000","last_unstale":"2024-09-17T01:37:54.321885+0000","last_undegraded":"2024-09-17T01:37:54.321885+0000","last_fullsized":"2024-09-17T01:37:54.321885+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:37.895214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.323464+0000","last_change":"2024-09-17T01:37:52.312578+0000","last_active":"2024-09-17T01:37:54.323464+0000","last_peered":"2024-09-17T01:37:54.323464+0000","last_clean":"2024-09-17T01:37:54.323464+0000","last_became_active":"2024-09-17T01:37:52.310281+0000","last_became_peered":"2024-09-17T01:37:52.310281+0000","last_unstale":"2024-09-17T01:37:54.323464+0000","last_undegraded":"2024-09-17T01:37:54.323464+0000","last_fullsized":"2024-09-17T01:37:54.323464+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:41.084336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.338632+0000","last_change":"2024-09-17T01:37:53.334701+0000","last_active":"2024-09-17T01:37:53.338632+0000","last_peered":"2024-09-17T01:37:53.338632+0000","last_clean":"2024-09-17T01:37:53.338632+0000","last_became_active":"2024-09-17T01:37:53.334319+0000","last_became_peered":"2024-09-17T01:37:53.334319+0000","last_unstale":"2024-09-17T01:37:53.338632+0000","last_undegraded":"2024-09-17T01:37:53.338632+0000","last_fullsized":"2024-09-17T01:37:53.338632+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:07.755718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.329051+0000","last_change":"2024-09-17T01:37:52.316708+0000","last_active":"2024-09-17T01:37:54.329051+0000","last_peered":"2024-09-17T01:37:54.329051+0000","last_clean":"2024-09-17T01:37:54.329051+0000","last_became_active":"2024-09-17T01:37:52.316309+0000","last_became_peered":"2024-09-17T01:37:52.316309+0000","last_unstale":"2024-09-17T01:37:54.329051+0000","last_undegraded":"2024-09-17T01:37:54.329051+0000","last_fullsized":"2024-09-17T01:37:54.329051+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:10.924853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.347391+0000","last_change":"2024-09-17T01:37:53.337979+0000","last_active":"2024-09-17T01:37:53.347391+0000","last_peered":"2024-09-17T01:37:53.347391+0000","last_clean":"2024-09-17T01:37:53.347391+0000","last_became_active":"2024-09-17T01:37:53.337611+0000","last_became_peered":"2024-09-17T01:37:53.337611+0000","last_unstale":"2024-09-17T01:37:53.347391+0000","last_undegraded":"2024-09-17T01:37:53.347391+0000","last_fullsized":"2024-09-17T01:37:53.347391+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:22.944938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.322945+0000","last_change":"2024-09-17T01:37:52.321155+0000","last_active":"2024-09-17T01:37:54.322945+0000","last_peered":"2024-09-17T01:37:54.322945+0000","last_clean":"2024-09-17T01:37:54.322945+0000","last_became_active":"2024-09-17T01:37:52.320778+0000","last_became_peered":"2024-09-17T01:37:52.320778+0000","last_unstale":"2024-09-17T01:37:54.322945+0000","last_undegraded":"2024-09-17T01:37:54.322945+0000","last_fullsized":"2024-09-17T01:37:54.322945+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:26.455113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.322121+0000","last_change":"2024-09-17T01:37:53.326631+0000","last_active":"2024-09-17T01:37:54.322121+0000","last_peered":"2024-09-17T01:37:54.322121+0000","last_clean":"2024-09-17T01:37:54.322121+0000","last_became_active":"2024-09-17T01:37:53.326293+0000","last_became_peered":"2024-09-17T01:37:53.326293+0000","last_unstale":"2024-09-17T01:37:54.322121+0000","last_undegraded":"2024-09-17T01:37:54.322121+0000","last_fullsized":"2024-09-17T01:37:54.322121+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:41.153572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"92'2","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.324500+0000","last_change":"2024-09-17T01:37:52.324667+0000","last_active":"2024-09-17T01:37:54.324500+0000","last_peered":"2024-09-17T01:37:54.324500+0000","last_clean":"2024-09-17T01:37:54.324500+0000","last_became_active":"2024-09-17T01:37:52.324388+0000","last_became_peered":"2024-09-17T01:37:52.324388+0000","last_unstale":"2024-09-17T01:37:54.324500+0000","last_undegraded":"2024-09-17T01:37:54.324500+0000","last_fullsized":"2024-09-17T01:37:54.324500+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:42.519279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.322302+0000","last_change":"2024-09-17T01:37:53.337887+0000","last_active":"2024-09-17T01:37:54.322302+0000","last_peered":"2024-09-17T01:37:54.322302+0000","last_clean":"2024-09-17T01:37:54.322302+0000","last_became_active":"2024-09-17T01:37:53.337532+0000","last_became_peered":"2024-09-17T01:37:53.337532+0000","last_unstale":"2024-09-17T01:37:54.322302+0000","last_undegraded":"2024-09-17T01:37:54.322302+0000","last_fullsized":"2024-09-17T01:37:54.322302+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:35.763924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"93'1","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.331210+0000","last_change":"2024-09-17T01:37:52.301917+0000","last_active":"2024-09-17T01:37:54.331210+0000","last_peered":"2024-09-17T01:37:54.331210+0000","last_clean":"2024-09-17T01:37:54.331210+0000","last_became_active":"2024-09-17T01:37:52.301539+0000","last_became_peered":"2024-09-17T01:37:52.301539+0000","last_unstale":"2024-09-17T01:37:54.331210+0000","last_undegraded":"2024-09-17T01:37:54.331210+0000","last_fullsized":"2024-09-17T01:37:54.331210+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:29.671787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.321842+0000","last_change":"2024-09-17T01:37:53.341187+0000","last_active":"2024-09-17T01:37:54.321842+0000","last_peered":"2024-09-17T01:37:54.321842+0000","last_clean":"2024-09-17T01:37:54.321842+0000","last_became_active":"2024-09-17T01:37:53.337747+0000","last_became_peered":"2024-09-17T01:37:53.337747+0000","last_unstale":"2024-09-17T01:37:54.321842+0000","last_undegraded":"2024-09-17T01:37:54.321842+0000","last_fullsized":"2024-09-17T01:37:54.321842+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:44.091289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.326101+0000","last_change":"2024-09-17T01:37:52.314307+0000","last_active":"2024-09-17T01:37:53.326101+0000","last_peered":"2024-09-17T01:37:53.326101+0000","last_clean":"2024-09-17T01:37:53.326101+0000","last_became_active":"2024-09-17T01:37:52.313981+0000","last_became_peered":"2024-09-17T01:37:52.313981+0000","last_unstale":"2024-09-17T01:37:53.326101+0000","last_undegraded":"2024-09-17T01:37:53.326101+0000","last_fullsized":"2024-09-17T01:37:53.326101+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:51:14.294926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823446+0000","last_change":"2024-09-17T01:37:53.335736+0000","last_active":"2024-09-17T01:37:54.823446+0000","last_peered":"2024-09-17T01:37:54.823446+0000","last_clean":"2024-09-17T01:37:54.823446+0000","last_became_active":"2024-09-17T01:37:53.335274+0000","last_became_peered":"2024-09-17T01:37:53.335274+0000","last_unstale":"2024-09-17T01:37:54.823446+0000","last_undegraded":"2024-09-17T01:37:54.823446+0000","last_fullsized":"2024-09-17T01:37:54.823446+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:06.199680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823284+0000","last_change":"2024-09-17T01:37:52.322838+0000","last_active":"2024-09-17T01:37:54.823284+0000","last_peered":"2024-09-17T01:37:54.823284+0000","last_clean":"2024-09-17T01:37:54.823284+0000","last_became_active":"2024-09-17T01:37:52.320441+0000","last_became_peered":"2024-09-17T01:37:52.320441+0000","last_unstale":"2024-09-17T01:37:54.823284+0000","last_undegraded":"2024-09-17T01:37:54.823284+0000","last_fullsized":"2024-09-17T01:37:54.823284+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:32.056453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.343926+0000","last_change":"2024-09-17T01:37:53.339083+0000","last_active":"2024-09-17T01:37:53.343926+0000","last_peered":"2024-09-17T01:37:53.343926+0000","last_clean":"2024-09-17T01:37:53.343926+0000","last_became_active":"2024-09-17T01:37:53.338684+0000","last_became_peered":"2024-09-17T01:37:53.338684+0000","last_unstale":"2024-09-17T01:37:53.343926+0000","last_undegraded":"2024-09-17T01:37:53.343926+0000","last_fullsized":"2024-09-17T01:37:53.343926+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:01:23.985962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.323937+0000","last_change":"2024-09-17T01:37:52.314278+0000","last_active":"2024-09-17T01:37:54.323937+0000","last_peered":"2024-09-17T01:37:54.323937+0000","last_clean":"2024-09-17T01:37:54.323937+0000","last_became_active":"2024-09-17T01:37:52.313731+0000","last_became_peered":"2024-09-17T01:37:52.313731+0000","last_unstale":"2024-09-17T01:37:54.323937+0000","last_undegraded":"2024-09-17T01:37:54.323937+0000","last_fullsized":"2024-09-17T01:37:54.323937+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:08.546640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.329474+0000","last_change":"2024-09-17T01:37:53.322035+0000","last_active":"2024-09-17T01:37:54.329474+0000","last_peered":"2024-09-17T01:37:54.329474+0000","last_clean":"2024-09-17T01:37:54.329474+0000","last_became_active":"2024-09-17T01:37:53.320930+0000","last_became_peered":"2024-09-17T01:37:53.320930+0000","last_unstale":"2024-09-17T01:37:54.329474+0000","last_undegraded":"2024-09-17T01:37:54.329474+0000","last_fullsized":"2024-09-17T01:37:54.329474+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:22.346772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823520+0000","last_change":"2024-09-17T01:37:52.317695+0000","last_active":"2024-09-17T01:37:54.823520+0000","last_peered":"2024-09-17T01:37:54.823520+0000","last_clean":"2024-09-17T01:37:54.823520+0000","last_became_active":"2024-09-17T01:37:52.317108+0000","last_became_peered":"2024-09-17T01:37:52.317108+0000","last_unstale":"2024-09-17T01:37:54.823520+0000","last_undegraded":"2024-09-17T01:37:54.823520+0000","last_fullsized":"2024-09-17T01:37:54.823520+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:15.376311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.328284+0000","last_change":"2024-09-17T01:37:53.322915+0000","last_active":"2024-09-17T01:37:53.328284+0000","last_peered":"2024-09-17T01:37:53.328284+0000","last_clean":"2024-09-17T01:37:53.328284+0000","last_became_active":"2024-09-17T01:37:53.322541+0000","last_became_peered":"2024-09-17T01:37:53.322541+0000","last_unstale":"2024-09-17T01:37:53.328284+0000","last_undegraded":"2024-09-17T01:37:53.328284+0000","last_fullsized":"2024-09-17T01:37:53.328284+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:52.979183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.311817+0000","last_change":"2024-09-17T01:37:52.317684+0000","last_active":"2024-09-17T01:37:53.311817+0000","last_peered":"2024-09-17T01:37:53.311817+0000","last_clean":"2024-09-17T01:37:53.311817+0000","last_became_active":"2024-09-17T01:37:52.317382+0000","last_became_peered":"2024-09-17T01:37:52.317382+0000","last_unstale":"2024-09-17T01:37:53.311817+0000","last_undegraded":"2024-09-17T01:37:53.311817+0000","last_fullsized":"2024-09-17T01:37:53.311817+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:26.686978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.332742+0000","last_change":"2024-09-17T01:37:53.330894+0000","last_active":"2024-09-17T01:37:53.332742+0000","last_peered":"2024-09-17T01:37:53.332742+0000","last_clean":"2024-09-17T01:37:53.332742+0000","last_became_active":"2024-09-17T01:37:53.330528+0000","last_became_peered":"2024-09-17T01:37:53.330528+0000","last_unstale":"2024-09-17T01:37:53.332742+0000","last_undegraded":"2024-09-17T01:37:53.332742+0000","last_fullsized":"2024-09-17T01:37:53.332742+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:28.257279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.324671+0000","last_change":"2024-09-17T01:37:52.316880+0000","last_active":"2024-09-17T01:37:53.324671+0000","last_peered":"2024-09-17T01:37:53.324671+0000","last_clean":"2024-09-17T01:37:53.324671+0000","last_became_active":"2024-09-17T01:37:52.316551+0000","last_became_peered":"2024-09-17T01:37:52.316551+0000","last_unstale":"2024-09-17T01:37:53.324671+0000","last_undegraded":"2024-09-17T01:37:53.324671+0000","last_fullsized":"2024-09-17T01:37:53.324671+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:45.651246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.329640+0000","last_change":"2024-09-17T01:37:53.330097+0000","last_active":"2024-09-17T01:37:54.329640+0000","last_peered":"2024-09-17T01:37:54.329640+0000","last_clean":"2024-09-17T01:37:54.329640+0000","last_became_active":"2024-09-17T01:37:53.329677+0000","last_became_peered":"2024-09-17T01:37:53.329677+0000","last_unstale":"2024-09-17T01:37:54.329640+0000","last_undegraded":"2024-09-17T01:37:54.329640+0000","last_fullsized":"2024-09-17T01:37:54.329640+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:19.744741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"92'1","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.322013+0000","last_change":"2024-09-17T01:37:52.316419+0000","last_active":"2024-09-17T01:37:54.322013+0000","last_peered":"2024-09-17T01:37:54.322013+0000","last_clean":"2024-09-17T01:37:54.322013+0000","last_became_active":"2024-09-17T01:37:52.316064+0000","last_became_peered":"2024-09-17T01:37:52.316064+0000","last_unstale":"2024-09-17T01:37:54.322013+0000","last_undegraded":"2024-09-17T01:37:54.322013+0000","last_fullsized":"2024-09-17T01:37:54.322013+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:09.728658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":242,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.316138+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:37:53.316138+0000","last_peered":"2024-09-17T01:37:53.316138+0000","last_clean":"2024-09-17T01:37:53.316138+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:37:53.316138+0000","last_undegraded":"2024-09-17T01:37:53.316138+0000","last_fullsized":"2024-09-17T01:37:53.316138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476812,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1134592,"data_stored":490672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509515,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40612,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331228,"statfs":{"total":96636764160,"available":96595177472,"internally_reserved":0,"allocated":1126400,"data_stored":484442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509514,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40616,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331224,"statfs":{"total":96636764160,"available":96595173376,"internally_reserved":0,"allocated":1130496,"data_stored":485044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509515,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1126400,"data_stored":484406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509515,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1134592,"data_stored":485046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509514,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41192,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330648,"statfs":{"total":96636764160,"available":96594583552,"internally_reserved":0,"allocated":1720320,"data_stored":1074830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509516,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36468,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335372,"statfs":{"total":96636764160,"available":96599420928,"internally_reserved":0,"allocated":1138688,"data_stored":486006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542220,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41176,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330664,"statfs":{"total":96636764160,"available":96594599936,"internally_reserved":0,"allocated":1703936,"data_stored":1067965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:37:57.787 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:37:58.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.054+0000 7f7269200640 1 -- 172.21.15.42:0/4158775170 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7248004d40 msgr2=0x7f72480051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:58.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.054+0000 7f7269200640 1 --2- 172.21.15.42:0/4158775170 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7248004d40 0x7f72480051f0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f725c001d90 tx=0x7f7248005830 comp rx=0 tx=0).stop 2024-09-17T01:37:58.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.054+0000 7f7263e00640 1 -- 172.21.15.42:0/4158775170 reap_dead start 2024-09-17T01:37:58.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.054+0000 7f7269200640 1 -- 172.21.15.42:0/4158775170 shutdown_connections 2024-09-17T01:37:58.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.054+0000 7f7269200640 1 -- 172.21.15.42:0/4158775170 >> 172.21.15.42:0/4158775170 conn(0x7f72640cd4c0 msgr2=0x7f72640cd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:58.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.054+0000 7f7269200640 1 -- 172.21.15.42:0/4158775170 shutdown_connections 2024-09-17T01:37:58.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.054+0000 7f7269200640 1 -- 172.21.15.42:0/4158775170 wait complete. 2024-09-17T01:37:58.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.056+0000 7f7269200640 1 Processor -- start 2024-09-17T01:37:58.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.056+0000 7f7269200640 1 -- start start 2024-09-17T01:37:58.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.058+0000 7f7269200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7248004d40 0x7f72641541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:58.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.058+0000 7f7269200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f726415e770 0x7f72640b4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:58.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.058+0000 7f7269200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72640b49a0 0x7f72641f5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:58.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.058+0000 7f7269200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f726415bc30 con 0x7f72640b49a0 2024-09-17T01:37:58.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.058+0000 7f7269200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f726415bab0 con 0x7f726415e770 2024-09-17T01:37:58.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.058+0000 7f7269200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f726415bdb0 con 0x7f7248004d40 2024-09-17T01:37:58.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.058+0000 7f7263e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72640b49a0 0x7f72641f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:58.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.058+0000 7f7263e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72640b49a0 0x7f72641f5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53732/0 (socket says 172.21.15.42:53732) 2024-09-17T01:37:58.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.058+0000 7f7263e00640 1 -- 172.21.15.42:0/2523011812 learned_addr learned my addr 172.21.15.42:0/2523011812 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:58.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.058+0000 7f7263400640 1 --2- 172.21.15.42:0/2523011812 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7248004d40 0x7f72641541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:58.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.058+0000 7f7262a00640 1 --2- 172.21.15.42:0/2523011812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f726415e770 0x7f72640b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:58.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.059+0000 7f7263e00640 1 -- 172.21.15.42:0/2523011812 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7248004d40 msgr2=0x7f72641541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:58.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.059+0000 7f7263e00640 1 --2- 172.21.15.42:0/2523011812 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7248004d40 0x7f72641541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:58.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.059+0000 7f7263e00640 1 -- 172.21.15.42:0/2523011812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f726415e770 msgr2=0x7f72640b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:58.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.059+0000 7f7263e00640 1 --2- 172.21.15.42:0/2523011812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f726415e770 0x7f72640b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:58.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.059+0000 7f7263e00640 1 -- 172.21.15.42:0/2523011812 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72640b4db0 con 0x7f72640b49a0 2024-09-17T01:37:58.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.059+0000 7f7263e00640 1 --2- 172.21.15.42:0/2523011812 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72640b49a0 0x7f72641f5910 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f725c02ac80 tx=0x7f725c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:58.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.059+0000 7f725b400640 1 -- 172.21.15.42:0/2523011812 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c0060b0 con 0x7f72640b49a0 2024-09-17T01:37:58.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.059+0000 7f725b400640 1 -- 172.21.15.42:0/2523011812 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f725c006250 con 0x7f72640b49a0 2024-09-17T01:37:58.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.059+0000 7f725b400640 1 -- 172.21.15.42:0/2523011812 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c0066a0 con 0x7f72640b49a0 2024-09-17T01:37:58.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.059+0000 7f7269200640 1 -- 172.21.15.42:0/2523011812 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f726415e440 con 0x7f72640b49a0 2024-09-17T01:37:58.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.059+0000 7f7269200640 1 -- 172.21.15.42:0/2523011812 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72641f91e0 con 0x7f72640b49a0 2024-09-17T01:37:58.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.060+0000 7f7269200640 1 -- 172.21.15.42:0/2523011812 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72640690b0 con 0x7f72640b49a0 2024-09-17T01:37:58.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.062+0000 7f725b400640 1 -- 172.21.15.42:0/2523011812 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f725c033480 con 0x7f72640b49a0 2024-09-17T01:37:58.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.063+0000 7f725b400640 1 --2- 172.21.15.42:0/2523011812 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7244078b90 0x7f724407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:58.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.063+0000 7f725b400640 1 -- 172.21.15.42:0/2523011812 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f725c0ba910 con 0x7f72640b49a0 2024-09-17T01:37:58.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.064+0000 7f7263400640 1 --2- 172.21.15.42:0/2523011812 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7244078b90 0x7f724407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:58.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.064+0000 7f7263400640 1 --2- 172.21.15.42:0/2523011812 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7244078b90 0x7f724407b0a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7254009c50 tx=0x7f7254005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:58.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.068+0000 7f725b400640 1 -- 172.21.15.42:0/2523011812 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f72640690b0 con 0x7f72640b49a0 2024-09-17T01:37:58.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.258+0000 7f7269200640 1 -- 172.21.15.42:0/2523011812 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f726415e1d0 con 0x7f7244078b90 2024-09-17T01:37:58.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.264+0000 7f725b400640 1 -- 172.21.15.42:0/2523011812 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252073 (secure 0 0 0) 0x7f725405e8c0 con 0x7f7244078b90 2024-09-17T01:37:58.264 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:58.265 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:37:58.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.267+0000 7f7269200640 1 -- 172.21.15.42:0/2523011812 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7244078b90 msgr2=0x7f724407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:58.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.267+0000 7f7269200640 1 --2- 172.21.15.42:0/2523011812 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7244078b90 0x7f724407b0a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7254009c50 tx=0x7f7254005f90 comp rx=0 tx=0).stop 2024-09-17T01:37:58.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.267+0000 7f7269200640 1 -- 172.21.15.42:0/2523011812 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72640b49a0 msgr2=0x7f72641f5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:58.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.267+0000 7f7269200640 1 --2- 172.21.15.42:0/2523011812 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72640b49a0 0x7f72641f5910 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f725c02ac80 tx=0x7f725c001b10 comp rx=0 tx=0).stop 2024-09-17T01:37:58.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.268+0000 7f7269200640 1 -- 172.21.15.42:0/2523011812 shutdown_connections 2024-09-17T01:37:58.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.268+0000 7f7269200640 1 --2- 172.21.15.42:0/2523011812 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7244078b90 0x7f724407b0a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:58.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.268+0000 7f7269200640 1 --2- 172.21.15.42:0/2523011812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f726415e770 0x7f72640b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:58.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.268+0000 7f7269200640 1 --2- 172.21.15.42:0/2523011812 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72640b49a0 0x7f72641f5910 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:58.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.268+0000 7f7269200640 1 --2- 172.21.15.42:0/2523011812 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7248004d40 0x7f72641541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:58.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.268+0000 7f7269200640 1 -- 172.21.15.42:0/2523011812 >> 172.21.15.42:0/2523011812 conn(0x7f72640cd4c0 msgr2=0x7f72640b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:58.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.268+0000 7f7269200640 1 -- 172.21.15.42:0/2523011812 shutdown_connections 2024-09-17T01:37:58.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.268+0000 7f7269200640 1 -- 172.21.15.42:0/2523011812 wait complete. 2024-09-17T01:37:58.291 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":268,"stamp":"2024-09-17T01:37:57.077387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":160,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":284480,"kb_used_data":9976,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754690240,"statfs":{"total":773094113280,"available":772802805760,"internally_reserved":0,"allocated":10215424,"data_stored":5058411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":280874548},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.789712"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.328338+0000","last_change":"2024-09-17T01:37:53.323434+0000","last_active":"2024-09-17T01:37:53.328338+0000","last_peered":"2024-09-17T01:37:53.328338+0000","last_clean":"2024-09-17T01:37:53.328338+0000","last_became_active":"2024-09-17T01:37:53.323123+0000","last_became_peered":"2024-09-17T01:37:53.323123+0000","last_unstale":"2024-09-17T01:37:53.328338+0000","last_undegraded":"2024-09-17T01:37:53.328338+0000","last_fullsized":"2024-09-17T01:37:53.328338+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:16.267783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.324466+0000","last_change":"2024-09-17T01:37:53.325854+0000","last_active":"2024-09-17T01:37:54.324466+0000","last_peered":"2024-09-17T01:37:54.324466+0000","last_clean":"2024-09-17T01:37:54.324466+0000","last_became_active":"2024-09-17T01:37:53.324696+0000","last_became_peered":"2024-09-17T01:37:53.324696+0000","last_unstale":"2024-09-17T01:37:54.324466+0000","last_undegraded":"2024-09-17T01:37:54.324466+0000","last_fullsized":"2024-09-17T01:37:54.324466+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:04:53.773067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823388+0000","last_change":"2024-09-17T01:37:53.332919+0000","last_active":"2024-09-17T01:37:54.823388+0000","last_peered":"2024-09-17T01:37:54.823388+0000","last_clean":"2024-09-17T01:37:54.823388+0000","last_became_active":"2024-09-17T01:37:53.332563+0000","last_became_peered":"2024-09-17T01:37:53.332563+0000","last_unstale":"2024-09-17T01:37:54.823388+0000","last_undegraded":"2024-09-17T01:37:54.823388+0000","last_fullsized":"2024-09-17T01:37:54.823388+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:33.131903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.343349+0000","last_change":"2024-09-17T01:37:53.340094+0000","last_active":"2024-09-17T01:37:53.343349+0000","last_peered":"2024-09-17T01:37:53.343349+0000","last_clean":"2024-09-17T01:37:53.343349+0000","last_became_active":"2024-09-17T01:37:53.339113+0000","last_became_peered":"2024-09-17T01:37:53.339113+0000","last_unstale":"2024-09-17T01:37:53.343349+0000","last_undegraded":"2024-09-17T01:37:53.343349+0000","last_fullsized":"2024-09-17T01:37:53.343349+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:21.787954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.321625+0000","last_change":"2024-09-17T01:37:53.331195+0000","last_active":"2024-09-17T01:37:54.321625+0000","last_peered":"2024-09-17T01:37:54.321625+0000","last_clean":"2024-09-17T01:37:54.321625+0000","last_became_active":"2024-09-17T01:37:53.329695+0000","last_became_peered":"2024-09-17T01:37:53.329695+0000","last_unstale":"2024-09-17T01:37:54.321625+0000","last_undegraded":"2024-09-17T01:37:54.321625+0000","last_fullsized":"2024-09-17T01:37:54.321625+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:53.983384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823375+0000","last_change":"2024-09-17T01:37:53.338232+0000","last_active":"2024-09-17T01:37:54.823375+0000","last_peered":"2024-09-17T01:37:54.823375+0000","last_clean":"2024-09-17T01:37:54.823375+0000","last_became_active":"2024-09-17T01:37:53.337962+0000","last_became_peered":"2024-09-17T01:37:53.337962+0000","last_unstale":"2024-09-17T01:37:54.823375+0000","last_undegraded":"2024-09-17T01:37:54.823375+0000","last_fullsized":"2024-09-17T01:37:54.823375+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:20.040278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.322704+0000","last_change":"2024-09-17T01:37:53.322117+0000","last_active":"2024-09-17T01:37:54.322704+0000","last_peered":"2024-09-17T01:37:54.322704+0000","last_clean":"2024-09-17T01:37:54.322704+0000","last_became_active":"2024-09-17T01:37:53.321700+0000","last_became_peered":"2024-09-17T01:37:53.321700+0000","last_unstale":"2024-09-17T01:37:54.322704+0000","last_undegraded":"2024-09-17T01:37:54.322704+0000","last_fullsized":"2024-09-17T01:37:54.322704+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:33.402889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.337069+0000","last_change":"2024-09-17T01:37:53.335359+0000","last_active":"2024-09-17T01:37:53.337069+0000","last_peered":"2024-09-17T01:37:53.337069+0000","last_clean":"2024-09-17T01:37:53.337069+0000","last_became_active":"2024-09-17T01:37:53.334951+0000","last_became_peered":"2024-09-17T01:37:53.334951+0000","last_unstale":"2024-09-17T01:37:53.337069+0000","last_undegraded":"2024-09-17T01:37:53.337069+0000","last_fullsized":"2024-09-17T01:37:53.337069+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:41.991925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.345938+0000","last_change":"2024-09-17T01:37:53.338245+0000","last_active":"2024-09-17T01:37:53.345938+0000","last_peered":"2024-09-17T01:37:53.345938+0000","last_clean":"2024-09-17T01:37:53.345938+0000","last_became_active":"2024-09-17T01:37:53.331726+0000","last_became_peered":"2024-09-17T01:37:53.331726+0000","last_unstale":"2024-09-17T01:37:53.345938+0000","last_undegraded":"2024-09-17T01:37:53.345938+0000","last_fullsized":"2024-09-17T01:37:53.345938+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:24.399214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823453+0000","last_change":"2024-09-17T01:37:53.324269+0000","last_active":"2024-09-17T01:37:54.823453+0000","last_peered":"2024-09-17T01:37:54.823453+0000","last_clean":"2024-09-17T01:37:54.823453+0000","last_became_active":"2024-09-17T01:37:53.319025+0000","last_became_peered":"2024-09-17T01:37:53.319025+0000","last_unstale":"2024-09-17T01:37:54.823453+0000","last_undegraded":"2024-09-17T01:37:54.823453+0000","last_fullsized":"2024-09-17T01:37:54.823453+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:06.964744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.329793+0000","last_change":"2024-09-17T01:37:53.321997+0000","last_active":"2024-09-17T01:37:54.329793+0000","last_peered":"2024-09-17T01:37:54.329793+0000","last_clean":"2024-09-17T01:37:54.329793+0000","last_became_active":"2024-09-17T01:37:53.321513+0000","last_became_peered":"2024-09-17T01:37:53.321513+0000","last_unstale":"2024-09-17T01:37:54.329793+0000","last_undegraded":"2024-09-17T01:37:54.329793+0000","last_fullsized":"2024-09-17T01:37:54.329793+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:17.384714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.347137+0000","last_change":"2024-09-17T01:37:53.344906+0000","last_active":"2024-09-17T01:37:53.347137+0000","last_peered":"2024-09-17T01:37:53.347137+0000","last_clean":"2024-09-17T01:37:53.347137+0000","last_became_active":"2024-09-17T01:37:53.344078+0000","last_became_peered":"2024-09-17T01:37:53.344078+0000","last_unstale":"2024-09-17T01:37:53.347137+0000","last_undegraded":"2024-09-17T01:37:53.347137+0000","last_fullsized":"2024-09-17T01:37:53.347137+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:09.553107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.321617+0000","last_change":"2024-09-17T01:37:53.325214+0000","last_active":"2024-09-17T01:37:54.321617+0000","last_peered":"2024-09-17T01:37:54.321617+0000","last_clean":"2024-09-17T01:37:54.321617+0000","last_became_active":"2024-09-17T01:37:53.324917+0000","last_became_peered":"2024-09-17T01:37:53.324917+0000","last_unstale":"2024-09-17T01:37:54.321617+0000","last_undegraded":"2024-09-17T01:37:54.321617+0000","last_fullsized":"2024-09-17T01:37:54.321617+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:04.878843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.323351+0000","last_change":"2024-09-17T01:37:53.330846+0000","last_active":"2024-09-17T01:37:54.323351+0000","last_peered":"2024-09-17T01:37:54.323351+0000","last_clean":"2024-09-17T01:37:54.323351+0000","last_became_active":"2024-09-17T01:37:53.328965+0000","last_became_peered":"2024-09-17T01:37:53.328965+0000","last_unstale":"2024-09-17T01:37:54.323351+0000","last_undegraded":"2024-09-17T01:37:54.323351+0000","last_fullsized":"2024-09-17T01:37:54.323351+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:52.758087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.322942+0000","last_change":"2024-09-17T01:37:53.331255+0000","last_active":"2024-09-17T01:37:54.322942+0000","last_peered":"2024-09-17T01:37:54.322942+0000","last_clean":"2024-09-17T01:37:54.322942+0000","last_became_active":"2024-09-17T01:37:53.330010+0000","last_became_peered":"2024-09-17T01:37:53.330010+0000","last_unstale":"2024-09-17T01:37:54.322942+0000","last_undegraded":"2024-09-17T01:37:54.322942+0000","last_fullsized":"2024-09-17T01:37:54.322942+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:58.424579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823134+0000","last_change":"2024-09-17T01:37:53.331662+0000","last_active":"2024-09-17T01:37:54.823134+0000","last_peered":"2024-09-17T01:37:54.823134+0000","last_clean":"2024-09-17T01:37:54.823134+0000","last_became_active":"2024-09-17T01:37:53.331309+0000","last_became_peered":"2024-09-17T01:37:53.331309+0000","last_unstale":"2024-09-17T01:37:54.823134+0000","last_undegraded":"2024-09-17T01:37:54.823134+0000","last_fullsized":"2024-09-17T01:37:54.823134+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:21:26.377264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.332447+0000","last_change":"2024-09-17T01:37:53.329165+0000","last_active":"2024-09-17T01:37:53.332447+0000","last_peered":"2024-09-17T01:37:53.332447+0000","last_clean":"2024-09-17T01:37:53.332447+0000","last_became_active":"2024-09-17T01:37:53.328855+0000","last_became_peered":"2024-09-17T01:37:53.328855+0000","last_unstale":"2024-09-17T01:37:53.332447+0000","last_undegraded":"2024-09-17T01:37:53.332447+0000","last_fullsized":"2024-09-17T01:37:53.332447+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:22.967442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.329731+0000","last_change":"2024-09-17T01:37:53.332430+0000","last_active":"2024-09-17T01:37:54.329731+0000","last_peered":"2024-09-17T01:37:54.329731+0000","last_clean":"2024-09-17T01:37:54.329731+0000","last_became_active":"2024-09-17T01:37:53.332106+0000","last_became_peered":"2024-09-17T01:37:53.332106+0000","last_unstale":"2024-09-17T01:37:54.329731+0000","last_undegraded":"2024-09-17T01:37:54.329731+0000","last_fullsized":"2024-09-17T01:37:54.329731+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:07.081840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.323032+0000","last_change":"2024-09-17T01:37:53.340440+0000","last_active":"2024-09-17T01:37:54.323032+0000","last_peered":"2024-09-17T01:37:54.323032+0000","last_clean":"2024-09-17T01:37:54.323032+0000","last_became_active":"2024-09-17T01:37:53.338137+0000","last_became_peered":"2024-09-17T01:37:53.338137+0000","last_unstale":"2024-09-17T01:37:54.323032+0000","last_undegraded":"2024-09-17T01:37:54.323032+0000","last_fullsized":"2024-09-17T01:37:54.323032+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:29.176802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.323867+0000","last_change":"2024-09-17T01:37:53.340430+0000","last_active":"2024-09-17T01:37:54.323867+0000","last_peered":"2024-09-17T01:37:54.323867+0000","last_clean":"2024-09-17T01:37:54.323867+0000","last_became_active":"2024-09-17T01:37:53.339134+0000","last_became_peered":"2024-09-17T01:37:53.339134+0000","last_unstale":"2024-09-17T01:37:54.323867+0000","last_undegraded":"2024-09-17T01:37:54.323867+0000","last_fullsized":"2024-09-17T01:37:54.323867+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:50:53.369748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.339205+0000","last_change":"2024-09-17T01:37:53.337128+0000","last_active":"2024-09-17T01:37:53.339205+0000","last_peered":"2024-09-17T01:37:53.339205+0000","last_clean":"2024-09-17T01:37:53.339205+0000","last_became_active":"2024-09-17T01:37:53.336406+0000","last_became_peered":"2024-09-17T01:37:53.336406+0000","last_unstale":"2024-09-17T01:37:53.339205+0000","last_undegraded":"2024-09-17T01:37:53.339205+0000","last_fullsized":"2024-09-17T01:37:53.339205+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:59.818074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.323637+0000","last_change":"2024-09-17T01:37:53.331272+0000","last_active":"2024-09-17T01:37:54.323637+0000","last_peered":"2024-09-17T01:37:54.323637+0000","last_clean":"2024-09-17T01:37:54.323637+0000","last_became_active":"2024-09-17T01:37:53.328858+0000","last_became_peered":"2024-09-17T01:37:53.328858+0000","last_unstale":"2024-09-17T01:37:54.323637+0000","last_undegraded":"2024-09-17T01:37:54.323637+0000","last_fullsized":"2024-09-17T01:37:54.323637+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:46.725942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.333571+0000","last_change":"2024-09-17T01:37:53.329418+0000","last_active":"2024-09-17T01:37:53.333571+0000","last_peered":"2024-09-17T01:37:53.333571+0000","last_clean":"2024-09-17T01:37:53.333571+0000","last_became_active":"2024-09-17T01:37:53.329038+0000","last_became_peered":"2024-09-17T01:37:53.329038+0000","last_unstale":"2024-09-17T01:37:53.333571+0000","last_undegraded":"2024-09-17T01:37:53.333571+0000","last_fullsized":"2024-09-17T01:37:53.333571+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:43.833225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.329218+0000","last_change":"2024-09-17T01:37:53.324479+0000","last_active":"2024-09-17T01:37:54.329218+0000","last_peered":"2024-09-17T01:37:54.329218+0000","last_clean":"2024-09-17T01:37:54.329218+0000","last_became_active":"2024-09-17T01:37:53.324138+0000","last_became_peered":"2024-09-17T01:37:53.324138+0000","last_unstale":"2024-09-17T01:37:54.329218+0000","last_undegraded":"2024-09-17T01:37:54.329218+0000","last_fullsized":"2024-09-17T01:37:54.329218+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:04.462038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.329965+0000","last_change":"2024-09-17T01:37:53.330434+0000","last_active":"2024-09-17T01:37:54.329965+0000","last_peered":"2024-09-17T01:37:54.329965+0000","last_clean":"2024-09-17T01:37:54.329965+0000","last_became_active":"2024-09-17T01:37:53.329488+0000","last_became_peered":"2024-09-17T01:37:53.329488+0000","last_unstale":"2024-09-17T01:37:54.329965+0000","last_undegraded":"2024-09-17T01:37:54.329965+0000","last_fullsized":"2024-09-17T01:37:54.329965+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:10.636688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.321977+0000","last_change":"2024-09-17T01:37:53.335408+0000","last_active":"2024-09-17T01:37:54.321977+0000","last_peered":"2024-09-17T01:37:54.321977+0000","last_clean":"2024-09-17T01:37:54.321977+0000","last_became_active":"2024-09-17T01:37:53.335114+0000","last_became_peered":"2024-09-17T01:37:53.335114+0000","last_unstale":"2024-09-17T01:37:54.321977+0000","last_undegraded":"2024-09-17T01:37:54.321977+0000","last_fullsized":"2024-09-17T01:37:54.321977+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:41.496681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.322043+0000","last_change":"2024-09-17T01:37:53.340084+0000","last_active":"2024-09-17T01:37:54.322043+0000","last_peered":"2024-09-17T01:37:54.322043+0000","last_clean":"2024-09-17T01:37:54.322043+0000","last_became_active":"2024-09-17T01:37:53.339437+0000","last_became_peered":"2024-09-17T01:37:53.339437+0000","last_unstale":"2024-09-17T01:37:54.322043+0000","last_undegraded":"2024-09-17T01:37:54.322043+0000","last_fullsized":"2024-09-17T01:37:54.322043+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:33.933151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.343993+0000","last_change":"2024-09-17T01:37:53.339183+0000","last_active":"2024-09-17T01:37:53.343993+0000","last_peered":"2024-09-17T01:37:53.343993+0000","last_clean":"2024-09-17T01:37:53.343993+0000","last_became_active":"2024-09-17T01:37:53.338649+0000","last_became_peered":"2024-09-17T01:37:53.338649+0000","last_unstale":"2024-09-17T01:37:53.343993+0000","last_undegraded":"2024-09-17T01:37:53.343993+0000","last_fullsized":"2024-09-17T01:37:53.343993+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:28.204388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.339149+0000","last_change":"2024-09-17T01:37:53.334492+0000","last_active":"2024-09-17T01:37:53.339149+0000","last_peered":"2024-09-17T01:37:53.339149+0000","last_clean":"2024-09-17T01:37:53.339149+0000","last_became_active":"2024-09-17T01:37:53.332837+0000","last_became_peered":"2024-09-17T01:37:53.332837+0000","last_unstale":"2024-09-17T01:37:53.339149+0000","last_undegraded":"2024-09-17T01:37:53.339149+0000","last_fullsized":"2024-09-17T01:37:53.339149+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:11.933133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.323933+0000","last_change":"2024-09-17T01:37:53.332125+0000","last_active":"2024-09-17T01:37:54.323933+0000","last_peered":"2024-09-17T01:37:54.323933+0000","last_clean":"2024-09-17T01:37:54.323933+0000","last_became_active":"2024-09-17T01:37:53.331768+0000","last_became_peered":"2024-09-17T01:37:53.331768+0000","last_unstale":"2024-09-17T01:37:54.323933+0000","last_undegraded":"2024-09-17T01:37:54.323933+0000","last_fullsized":"2024-09-17T01:37:54.323933+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:22.106720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823143+0000","last_change":"2024-09-17T01:37:53.341948+0000","last_active":"2024-09-17T01:37:54.823143+0000","last_peered":"2024-09-17T01:37:54.823143+0000","last_clean":"2024-09-17T01:37:54.823143+0000","last_became_active":"2024-09-17T01:37:53.340935+0000","last_became_peered":"2024-09-17T01:37:53.340935+0000","last_unstale":"2024-09-17T01:37:54.823143+0000","last_undegraded":"2024-09-17T01:37:54.823143+0000","last_fullsized":"2024-09-17T01:37:54.823143+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:06.537114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823366+0000","last_change":"2024-09-17T01:37:53.324800+0000","last_active":"2024-09-17T01:37:54.823366+0000","last_peered":"2024-09-17T01:37:54.823366+0000","last_clean":"2024-09-17T01:37:54.823366+0000","last_became_active":"2024-09-17T01:37:53.324333+0000","last_became_peered":"2024-09-17T01:37:53.324333+0000","last_unstale":"2024-09-17T01:37:54.823366+0000","last_undegraded":"2024-09-17T01:37:54.823366+0000","last_fullsized":"2024-09-17T01:37:54.823366+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:30.633726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.349423+0000","last_change":"2024-09-17T01:37:53.348604+0000","last_active":"2024-09-17T01:37:53.349423+0000","last_peered":"2024-09-17T01:37:53.349423+0000","last_clean":"2024-09-17T01:37:53.349423+0000","last_became_active":"2024-09-17T01:37:53.348273+0000","last_became_peered":"2024-09-17T01:37:53.348273+0000","last_unstale":"2024-09-17T01:37:53.349423+0000","last_undegraded":"2024-09-17T01:37:53.349423+0000","last_fullsized":"2024-09-17T01:37:53.349423+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:42.090803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"92'4","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.322176+0000","last_change":"2024-09-17T01:37:52.308589+0000","last_active":"2024-09-17T01:37:54.322176+0000","last_peered":"2024-09-17T01:37:54.322176+0000","last_clean":"2024-09-17T01:37:54.322176+0000","last_became_active":"2024-09-17T01:37:52.308252+0000","last_became_peered":"2024-09-17T01:37:52.308252+0000","last_unstale":"2024-09-17T01:37:54.322176+0000","last_undegraded":"2024-09-17T01:37:54.322176+0000","last_fullsized":"2024-09-17T01:37:54.322176+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:20.580926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.328363+0000","last_change":"2024-09-17T01:37:53.324644+0000","last_active":"2024-09-17T01:37:53.328363+0000","last_peered":"2024-09-17T01:37:53.328363+0000","last_clean":"2024-09-17T01:37:53.328363+0000","last_became_active":"2024-09-17T01:37:53.323769+0000","last_became_peered":"2024-09-17T01:37:53.323769+0000","last_unstale":"2024-09-17T01:37:53.328363+0000","last_undegraded":"2024-09-17T01:37:53.328363+0000","last_fullsized":"2024-09-17T01:37:53.328363+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:45.115957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"92'1","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823607+0000","last_change":"2024-09-17T01:37:52.320023+0000","last_active":"2024-09-17T01:37:54.823607+0000","last_peered":"2024-09-17T01:37:54.823607+0000","last_clean":"2024-09-17T01:37:54.823607+0000","last_became_active":"2024-09-17T01:37:52.319679+0000","last_became_peered":"2024-09-17T01:37:52.319679+0000","last_unstale":"2024-09-17T01:37:54.823607+0000","last_undegraded":"2024-09-17T01:37:54.823607+0000","last_fullsized":"2024-09-17T01:37:54.823607+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:28:04.371324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.347165+0000","last_change":"2024-09-17T01:37:53.345235+0000","last_active":"2024-09-17T01:37:53.347165+0000","last_peered":"2024-09-17T01:37:53.347165+0000","last_clean":"2024-09-17T01:37:53.347165+0000","last_became_active":"2024-09-17T01:37:53.344567+0000","last_became_peered":"2024-09-17T01:37:53.344567+0000","last_unstale":"2024-09-17T01:37:53.347165+0000","last_undegraded":"2024-09-17T01:37:53.347165+0000","last_fullsized":"2024-09-17T01:37:53.347165+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:29:09.808301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"92'2","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.329691+0000","last_change":"2024-09-17T01:37:52.317191+0000","last_active":"2024-09-17T01:37:54.329691+0000","last_peered":"2024-09-17T01:37:54.329691+0000","last_clean":"2024-09-17T01:37:54.329691+0000","last_became_active":"2024-09-17T01:37:52.315987+0000","last_became_peered":"2024-09-17T01:37:52.315987+0000","last_unstale":"2024-09-17T01:37:54.329691+0000","last_undegraded":"2024-09-17T01:37:54.329691+0000","last_fullsized":"2024-09-17T01:37:54.329691+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:46.245368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.346476+0000","last_change":"2024-09-17T01:37:53.338971+0000","last_active":"2024-09-17T01:37:53.346476+0000","last_peered":"2024-09-17T01:37:53.346476+0000","last_clean":"2024-09-17T01:37:53.346476+0000","last_became_active":"2024-09-17T01:37:53.338604+0000","last_became_peered":"2024-09-17T01:37:53.338604+0000","last_unstale":"2024-09-17T01:37:53.346476+0000","last_undegraded":"2024-09-17T01:37:53.346476+0000","last_fullsized":"2024-09-17T01:37:53.346476+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:34.440955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"92'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.346388+0000","last_change":"2024-09-17T01:37:52.316249+0000","last_active":"2024-09-17T01:37:53.346388+0000","last_peered":"2024-09-17T01:37:53.346388+0000","last_clean":"2024-09-17T01:37:53.346388+0000","last_became_active":"2024-09-17T01:37:52.315929+0000","last_became_peered":"2024-09-17T01:37:52.315929+0000","last_unstale":"2024-09-17T01:37:53.346388+0000","last_undegraded":"2024-09-17T01:37:53.346388+0000","last_fullsized":"2024-09-17T01:37:53.346388+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:32.378997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.337475+0000","last_change":"2024-09-17T01:37:53.329521+0000","last_active":"2024-09-17T01:37:53.337475+0000","last_peered":"2024-09-17T01:37:53.337475+0000","last_clean":"2024-09-17T01:37:53.337475+0000","last_became_active":"2024-09-17T01:37:53.329194+0000","last_became_peered":"2024-09-17T01:37:53.329194+0000","last_unstale":"2024-09-17T01:37:53.337475+0000","last_undegraded":"2024-09-17T01:37:53.337475+0000","last_fullsized":"2024-09-17T01:37:53.337475+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:04.863416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"92'1","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.353432+0000","last_change":"2024-09-17T01:37:52.312522+0000","last_active":"2024-09-17T01:37:53.353432+0000","last_peered":"2024-09-17T01:37:53.353432+0000","last_clean":"2024-09-17T01:37:53.353432+0000","last_became_active":"2024-09-17T01:37:52.312160+0000","last_became_peered":"2024-09-17T01:37:52.312160+0000","last_unstale":"2024-09-17T01:37:53.353432+0000","last_undegraded":"2024-09-17T01:37:53.353432+0000","last_fullsized":"2024-09-17T01:37:53.353432+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:42.713011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823576+0000","last_change":"2024-09-17T01:37:53.334677+0000","last_active":"2024-09-17T01:37:54.823576+0000","last_peered":"2024-09-17T01:37:54.823576+0000","last_clean":"2024-09-17T01:37:54.823576+0000","last_became_active":"2024-09-17T01:37:53.334324+0000","last_became_peered":"2024-09-17T01:37:53.334324+0000","last_unstale":"2024-09-17T01:37:54.823576+0000","last_undegraded":"2024-09-17T01:37:54.823576+0000","last_fullsized":"2024-09-17T01:37:54.823576+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:41.206244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"92'1","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823550+0000","last_change":"2024-09-17T01:37:52.317384+0000","last_active":"2024-09-17T01:37:54.823550+0000","last_peered":"2024-09-17T01:37:54.823550+0000","last_clean":"2024-09-17T01:37:54.823550+0000","last_became_active":"2024-09-17T01:37:52.316739+0000","last_became_peered":"2024-09-17T01:37:52.316739+0000","last_unstale":"2024-09-17T01:37:54.823550+0000","last_undegraded":"2024-09-17T01:37:54.823550+0000","last_fullsized":"2024-09-17T01:37:54.823550+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:55.989271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.345661+0000","last_change":"2024-09-17T01:37:53.343017+0000","last_active":"2024-09-17T01:37:53.345661+0000","last_peered":"2024-09-17T01:37:53.345661+0000","last_clean":"2024-09-17T01:37:53.345661+0000","last_became_active":"2024-09-17T01:37:53.342508+0000","last_became_peered":"2024-09-17T01:37:53.342508+0000","last_unstale":"2024-09-17T01:37:53.345661+0000","last_undegraded":"2024-09-17T01:37:53.345661+0000","last_fullsized":"2024-09-17T01:37:53.345661+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:41.149904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.323440+0000","last_change":"2024-09-17T01:37:52.319128+0000","last_active":"2024-09-17T01:37:54.323440+0000","last_peered":"2024-09-17T01:37:54.323440+0000","last_clean":"2024-09-17T01:37:54.323440+0000","last_became_active":"2024-09-17T01:37:52.318427+0000","last_became_peered":"2024-09-17T01:37:52.318427+0000","last_unstale":"2024-09-17T01:37:54.323440+0000","last_undegraded":"2024-09-17T01:37:54.323440+0000","last_fullsized":"2024-09-17T01:37:54.323440+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:59:56.727792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.323300+0000","last_change":"2024-09-17T01:37:53.324412+0000","last_active":"2024-09-17T01:37:54.323300+0000","last_peered":"2024-09-17T01:37:54.323300+0000","last_clean":"2024-09-17T01:37:54.323300+0000","last_became_active":"2024-09-17T01:37:53.324040+0000","last_became_peered":"2024-09-17T01:37:53.324040+0000","last_unstale":"2024-09-17T01:37:54.323300+0000","last_undegraded":"2024-09-17T01:37:54.323300+0000","last_fullsized":"2024-09-17T01:37:54.323300+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:16:22.427228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.322792+0000","last_change":"2024-09-17T01:37:52.323662+0000","last_active":"2024-09-17T01:37:54.322792+0000","last_peered":"2024-09-17T01:37:54.322792+0000","last_clean":"2024-09-17T01:37:54.322792+0000","last_became_active":"2024-09-17T01:37:52.323243+0000","last_became_peered":"2024-09-17T01:37:52.323243+0000","last_unstale":"2024-09-17T01:37:54.322792+0000","last_undegraded":"2024-09-17T01:37:54.322792+0000","last_fullsized":"2024-09-17T01:37:54.322792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:49.778248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.323900+0000","last_change":"2024-09-17T01:37:53.336867+0000","last_active":"2024-09-17T01:37:54.323900+0000","last_peered":"2024-09-17T01:37:54.323900+0000","last_clean":"2024-09-17T01:37:54.323900+0000","last_became_active":"2024-09-17T01:37:53.336476+0000","last_became_peered":"2024-09-17T01:37:53.336476+0000","last_unstale":"2024-09-17T01:37:54.323900+0000","last_undegraded":"2024-09-17T01:37:54.323900+0000","last_fullsized":"2024-09-17T01:37:54.323900+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:46.733423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.314456+0000","last_change":"2024-09-17T01:37:52.316943+0000","last_active":"2024-09-17T01:37:53.314456+0000","last_peered":"2024-09-17T01:37:53.314456+0000","last_clean":"2024-09-17T01:37:53.314456+0000","last_became_active":"2024-09-17T01:37:52.314892+0000","last_became_peered":"2024-09-17T01:37:52.314892+0000","last_unstale":"2024-09-17T01:37:53.314456+0000","last_undegraded":"2024-09-17T01:37:53.314456+0000","last_fullsized":"2024-09-17T01:37:53.314456+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:44.877693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.335931+0000","last_change":"2024-09-17T01:37:53.333732+0000","last_active":"2024-09-17T01:37:53.335931+0000","last_peered":"2024-09-17T01:37:53.335931+0000","last_clean":"2024-09-17T01:37:53.335931+0000","last_became_active":"2024-09-17T01:37:53.332164+0000","last_became_peered":"2024-09-17T01:37:53.332164+0000","last_unstale":"2024-09-17T01:37:53.335931+0000","last_undegraded":"2024-09-17T01:37:53.335931+0000","last_fullsized":"2024-09-17T01:37:53.335931+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:28.382341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823626+0000","last_change":"2024-09-17T01:37:52.322725+0000","last_active":"2024-09-17T01:37:54.823626+0000","last_peered":"2024-09-17T01:37:54.823626+0000","last_clean":"2024-09-17T01:37:54.823626+0000","last_became_active":"2024-09-17T01:37:52.322040+0000","last_became_peered":"2024-09-17T01:37:52.322040+0000","last_unstale":"2024-09-17T01:37:54.823626+0000","last_undegraded":"2024-09-17T01:37:54.823626+0000","last_fullsized":"2024-09-17T01:37:54.823626+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:25.365551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.329760+0000","last_change":"2024-09-17T01:37:53.330736+0000","last_active":"2024-09-17T01:37:54.329760+0000","last_peered":"2024-09-17T01:37:54.329760+0000","last_clean":"2024-09-17T01:37:54.329760+0000","last_became_active":"2024-09-17T01:37:53.330198+0000","last_became_peered":"2024-09-17T01:37:53.330198+0000","last_unstale":"2024-09-17T01:37:54.329760+0000","last_undegraded":"2024-09-17T01:37:54.329760+0000","last_fullsized":"2024-09-17T01:37:54.329760+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:42.463846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"92'3","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.351012+0000","last_change":"2024-09-17T01:37:52.317858+0000","last_active":"2024-09-17T01:37:53.351012+0000","last_peered":"2024-09-17T01:37:53.351012+0000","last_clean":"2024-09-17T01:37:53.351012+0000","last_became_active":"2024-09-17T01:37:52.316127+0000","last_became_peered":"2024-09-17T01:37:52.316127+0000","last_unstale":"2024-09-17T01:37:53.351012+0000","last_undegraded":"2024-09-17T01:37:53.351012+0000","last_fullsized":"2024-09-17T01:37:53.351012+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:59.006855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.321792+0000","last_change":"2024-09-17T01:37:53.339737+0000","last_active":"2024-09-17T01:37:54.321792+0000","last_peered":"2024-09-17T01:37:54.321792+0000","last_clean":"2024-09-17T01:37:54.321792+0000","last_became_active":"2024-09-17T01:37:53.332630+0000","last_became_peered":"2024-09-17T01:37:53.332630+0000","last_unstale":"2024-09-17T01:37:54.321792+0000","last_undegraded":"2024-09-17T01:37:54.321792+0000","last_fullsized":"2024-09-17T01:37:54.321792+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:53.449392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"92'6","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.356975+0000","last_change":"2024-09-17T01:37:52.321121+0000","last_active":"2024-09-17T01:37:53.356975+0000","last_peered":"2024-09-17T01:37:53.356975+0000","last_clean":"2024-09-17T01:37:53.356975+0000","last_became_active":"2024-09-17T01:37:52.320820+0000","last_became_peered":"2024-09-17T01:37:52.320820+0000","last_unstale":"2024-09-17T01:37:53.356975+0000","last_undegraded":"2024-09-17T01:37:53.356975+0000","last_fullsized":"2024-09-17T01:37:53.356975+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:15:15.668015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.329370+0000","last_change":"2024-09-17T01:37:53.334868+0000","last_active":"2024-09-17T01:37:54.329370+0000","last_peered":"2024-09-17T01:37:54.329370+0000","last_clean":"2024-09-17T01:37:54.329370+0000","last_became_active":"2024-09-17T01:37:53.334499+0000","last_became_peered":"2024-09-17T01:37:53.334499+0000","last_unstale":"2024-09-17T01:37:54.329370+0000","last_undegraded":"2024-09-17T01:37:54.329370+0000","last_fullsized":"2024-09-17T01:37:54.329370+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:41.975111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"92'2","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.346107+0000","last_change":"2024-09-17T01:37:52.311124+0000","last_active":"2024-09-17T01:37:53.346107+0000","last_peered":"2024-09-17T01:37:53.346107+0000","last_clean":"2024-09-17T01:37:53.346107+0000","last_became_active":"2024-09-17T01:37:52.310802+0000","last_became_peered":"2024-09-17T01:37:52.310802+0000","last_unstale":"2024-09-17T01:37:53.346107+0000","last_undegraded":"2024-09-17T01:37:53.346107+0000","last_fullsized":"2024-09-17T01:37:53.346107+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:27.217774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.327484+0000","last_change":"2024-09-17T01:37:53.321353+0000","last_active":"2024-09-17T01:37:53.327484+0000","last_peered":"2024-09-17T01:37:53.327484+0000","last_clean":"2024-09-17T01:37:53.327484+0000","last_became_active":"2024-09-17T01:37:53.321017+0000","last_became_peered":"2024-09-17T01:37:53.321017+0000","last_unstale":"2024-09-17T01:37:53.327484+0000","last_undegraded":"2024-09-17T01:37:53.327484+0000","last_fullsized":"2024-09-17T01:37:53.327484+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:41.554927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.323362+0000","last_change":"2024-09-17T01:37:52.307370+0000","last_active":"2024-09-17T01:37:54.323362+0000","last_peered":"2024-09-17T01:37:54.323362+0000","last_clean":"2024-09-17T01:37:54.323362+0000","last_became_active":"2024-09-17T01:37:52.306991+0000","last_became_peered":"2024-09-17T01:37:52.306991+0000","last_unstale":"2024-09-17T01:37:54.323362+0000","last_undegraded":"2024-09-17T01:37:54.323362+0000","last_fullsized":"2024-09-17T01:37:54.323362+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:29:08.801834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.322976+0000","last_change":"2024-09-17T01:37:53.332850+0000","last_active":"2024-09-17T01:37:54.322976+0000","last_peered":"2024-09-17T01:37:54.322976+0000","last_clean":"2024-09-17T01:37:54.322976+0000","last_became_active":"2024-09-17T01:37:53.332211+0000","last_became_peered":"2024-09-17T01:37:53.332211+0000","last_unstale":"2024-09-17T01:37:54.322976+0000","last_undegraded":"2024-09-17T01:37:54.322976+0000","last_fullsized":"2024-09-17T01:37:54.322976+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:30.799734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.822959+0000","last_change":"2024-09-17T01:37:52.315800+0000","last_active":"2024-09-17T01:37:54.822959+0000","last_peered":"2024-09-17T01:37:54.822959+0000","last_clean":"2024-09-17T01:37:54.822959+0000","last_became_active":"2024-09-17T01:37:52.315470+0000","last_became_peered":"2024-09-17T01:37:52.315470+0000","last_unstale":"2024-09-17T01:37:54.822959+0000","last_undegraded":"2024-09-17T01:37:54.822959+0000","last_fullsized":"2024-09-17T01:37:54.822959+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:09.559219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.329165+0000","last_change":"2024-09-17T01:37:53.322392+0000","last_active":"2024-09-17T01:37:54.329165+0000","last_peered":"2024-09-17T01:37:54.329165+0000","last_clean":"2024-09-17T01:37:54.329165+0000","last_became_active":"2024-09-17T01:37:53.319553+0000","last_became_peered":"2024-09-17T01:37:53.319553+0000","last_unstale":"2024-09-17T01:37:54.329165+0000","last_undegraded":"2024-09-17T01:37:54.329165+0000","last_fullsized":"2024-09-17T01:37:54.329165+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:10.767769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"92'8","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.329126+0000","last_change":"2024-09-17T01:37:52.312136+0000","last_active":"2024-09-17T01:37:54.329126+0000","last_peered":"2024-09-17T01:37:54.329126+0000","last_clean":"2024-09-17T01:37:54.329126+0000","last_became_active":"2024-09-17T01:37:52.311801+0000","last_became_peered":"2024-09-17T01:37:52.311801+0000","last_unstale":"2024-09-17T01:37:54.329126+0000","last_undegraded":"2024-09-17T01:37:54.329126+0000","last_fullsized":"2024-09-17T01:37:54.329126+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:54.479916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.337438+0000","last_change":"2024-09-17T01:37:53.334229+0000","last_active":"2024-09-17T01:37:53.337438+0000","last_peered":"2024-09-17T01:37:53.337438+0000","last_clean":"2024-09-17T01:37:53.337438+0000","last_became_active":"2024-09-17T01:37:53.333187+0000","last_became_peered":"2024-09-17T01:37:53.333187+0000","last_unstale":"2024-09-17T01:37:53.337438+0000","last_undegraded":"2024-09-17T01:37:53.337438+0000","last_fullsized":"2024-09-17T01:37:53.337438+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:36.940779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"92'1","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.322374+0000","last_change":"2024-09-17T01:37:52.311462+0000","last_active":"2024-09-17T01:37:54.322374+0000","last_peered":"2024-09-17T01:37:54.322374+0000","last_clean":"2024-09-17T01:37:54.322374+0000","last_became_active":"2024-09-17T01:37:52.311120+0000","last_became_peered":"2024-09-17T01:37:52.311120+0000","last_unstale":"2024-09-17T01:37:54.322374+0000","last_undegraded":"2024-09-17T01:37:54.322374+0000","last_fullsized":"2024-09-17T01:37:54.322374+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:38.374121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823697+0000","last_change":"2024-09-17T01:37:53.332966+0000","last_active":"2024-09-17T01:37:54.823697+0000","last_peered":"2024-09-17T01:37:54.823697+0000","last_clean":"2024-09-17T01:37:54.823697+0000","last_became_active":"2024-09-17T01:37:53.332617+0000","last_became_peered":"2024-09-17T01:37:53.332617+0000","last_unstale":"2024-09-17T01:37:54.823697+0000","last_undegraded":"2024-09-17T01:37:54.823697+0000","last_fullsized":"2024-09-17T01:37:54.823697+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:12.476744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"92'2","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.324064+0000","last_change":"2024-09-17T01:37:52.318930+0000","last_active":"2024-09-17T01:37:54.324064+0000","last_peered":"2024-09-17T01:37:54.324064+0000","last_clean":"2024-09-17T01:37:54.324064+0000","last_became_active":"2024-09-17T01:37:52.318448+0000","last_became_peered":"2024-09-17T01:37:52.318448+0000","last_unstale":"2024-09-17T01:37:54.324064+0000","last_undegraded":"2024-09-17T01:37:54.324064+0000","last_fullsized":"2024-09-17T01:37:54.324064+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:37:18.382481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.336221+0000","last_change":"2024-09-17T01:37:53.333972+0000","last_active":"2024-09-17T01:37:53.336221+0000","last_peered":"2024-09-17T01:37:53.336221+0000","last_clean":"2024-09-17T01:37:53.336221+0000","last_became_active":"2024-09-17T01:37:53.333604+0000","last_became_peered":"2024-09-17T01:37:53.333604+0000","last_unstale":"2024-09-17T01:37:53.336221+0000","last_undegraded":"2024-09-17T01:37:53.336221+0000","last_fullsized":"2024-09-17T01:37:53.336221+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:42.854106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.324100+0000","last_change":"2024-09-17T01:37:52.320882+0000","last_active":"2024-09-17T01:37:54.324100+0000","last_peered":"2024-09-17T01:37:54.324100+0000","last_clean":"2024-09-17T01:37:54.324100+0000","last_became_active":"2024-09-17T01:37:52.320232+0000","last_became_peered":"2024-09-17T01:37:52.320232+0000","last_unstale":"2024-09-17T01:37:54.324100+0000","last_undegraded":"2024-09-17T01:37:54.324100+0000","last_fullsized":"2024-09-17T01:37:54.324100+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:49.891994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.323234+0000","last_change":"2024-09-17T01:37:53.315107+0000","last_active":"2024-09-17T01:37:54.323234+0000","last_peered":"2024-09-17T01:37:54.323234+0000","last_clean":"2024-09-17T01:37:54.323234+0000","last_became_active":"2024-09-17T01:37:53.314709+0000","last_became_peered":"2024-09-17T01:37:53.314709+0000","last_unstale":"2024-09-17T01:37:54.323234+0000","last_undegraded":"2024-09-17T01:37:54.323234+0000","last_fullsized":"2024-09-17T01:37:54.323234+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:25.592078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"92'2","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.324340+0000","last_change":"2024-09-17T01:37:52.316520+0000","last_active":"2024-09-17T01:37:54.324340+0000","last_peered":"2024-09-17T01:37:54.324340+0000","last_clean":"2024-09-17T01:37:54.324340+0000","last_became_active":"2024-09-17T01:37:52.316152+0000","last_became_peered":"2024-09-17T01:37:52.316152+0000","last_unstale":"2024-09-17T01:37:54.324340+0000","last_undegraded":"2024-09-17T01:37:54.324340+0000","last_fullsized":"2024-09-17T01:37:54.324340+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:32.106487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.321885+0000","last_change":"2024-09-17T01:37:53.331431+0000","last_active":"2024-09-17T01:37:54.321885+0000","last_peered":"2024-09-17T01:37:54.321885+0000","last_clean":"2024-09-17T01:37:54.321885+0000","last_became_active":"2024-09-17T01:37:53.330635+0000","last_became_peered":"2024-09-17T01:37:53.330635+0000","last_unstale":"2024-09-17T01:37:54.321885+0000","last_undegraded":"2024-09-17T01:37:54.321885+0000","last_fullsized":"2024-09-17T01:37:54.321885+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:37.895214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.323464+0000","last_change":"2024-09-17T01:37:52.312578+0000","last_active":"2024-09-17T01:37:54.323464+0000","last_peered":"2024-09-17T01:37:54.323464+0000","last_clean":"2024-09-17T01:37:54.323464+0000","last_became_active":"2024-09-17T01:37:52.310281+0000","last_became_peered":"2024-09-17T01:37:52.310281+0000","last_unstale":"2024-09-17T01:37:54.323464+0000","last_undegraded":"2024-09-17T01:37:54.323464+0000","last_fullsized":"2024-09-17T01:37:54.323464+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:41.084336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.338632+0000","last_change":"2024-09-17T01:37:53.334701+0000","last_active":"2024-09-17T01:37:53.338632+0000","last_peered":"2024-09-17T01:37:53.338632+0000","last_clean":"2024-09-17T01:37:53.338632+0000","last_became_active":"2024-09-17T01:37:53.334319+0000","last_became_peered":"2024-09-17T01:37:53.334319+0000","last_unstale":"2024-09-17T01:37:53.338632+0000","last_undegraded":"2024-09-17T01:37:53.338632+0000","last_fullsized":"2024-09-17T01:37:53.338632+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:07.755718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.329051+0000","last_change":"2024-09-17T01:37:52.316708+0000","last_active":"2024-09-17T01:37:54.329051+0000","last_peered":"2024-09-17T01:37:54.329051+0000","last_clean":"2024-09-17T01:37:54.329051+0000","last_became_active":"2024-09-17T01:37:52.316309+0000","last_became_peered":"2024-09-17T01:37:52.316309+0000","last_unstale":"2024-09-17T01:37:54.329051+0000","last_undegraded":"2024-09-17T01:37:54.329051+0000","last_fullsized":"2024-09-17T01:37:54.329051+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:10.924853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.347391+0000","last_change":"2024-09-17T01:37:53.337979+0000","last_active":"2024-09-17T01:37:53.347391+0000","last_peered":"2024-09-17T01:37:53.347391+0000","last_clean":"2024-09-17T01:37:53.347391+0000","last_became_active":"2024-09-17T01:37:53.337611+0000","last_became_peered":"2024-09-17T01:37:53.337611+0000","last_unstale":"2024-09-17T01:37:53.347391+0000","last_undegraded":"2024-09-17T01:37:53.347391+0000","last_fullsized":"2024-09-17T01:37:53.347391+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:22.944938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.322945+0000","last_change":"2024-09-17T01:37:52.321155+0000","last_active":"2024-09-17T01:37:54.322945+0000","last_peered":"2024-09-17T01:37:54.322945+0000","last_clean":"2024-09-17T01:37:54.322945+0000","last_became_active":"2024-09-17T01:37:52.320778+0000","last_became_peered":"2024-09-17T01:37:52.320778+0000","last_unstale":"2024-09-17T01:37:54.322945+0000","last_undegraded":"2024-09-17T01:37:54.322945+0000","last_fullsized":"2024-09-17T01:37:54.322945+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:26.455113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.322121+0000","last_change":"2024-09-17T01:37:53.326631+0000","last_active":"2024-09-17T01:37:54.322121+0000","last_peered":"2024-09-17T01:37:54.322121+0000","last_clean":"2024-09-17T01:37:54.322121+0000","last_became_active":"2024-09-17T01:37:53.326293+0000","last_became_peered":"2024-09-17T01:37:53.326293+0000","last_unstale":"2024-09-17T01:37:54.322121+0000","last_undegraded":"2024-09-17T01:37:54.322121+0000","last_fullsized":"2024-09-17T01:37:54.322121+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:41.153572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"92'2","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.324500+0000","last_change":"2024-09-17T01:37:52.324667+0000","last_active":"2024-09-17T01:37:54.324500+0000","last_peered":"2024-09-17T01:37:54.324500+0000","last_clean":"2024-09-17T01:37:54.324500+0000","last_became_active":"2024-09-17T01:37:52.324388+0000","last_became_peered":"2024-09-17T01:37:52.324388+0000","last_unstale":"2024-09-17T01:37:54.324500+0000","last_undegraded":"2024-09-17T01:37:54.324500+0000","last_fullsized":"2024-09-17T01:37:54.324500+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:42.519279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.322302+0000","last_change":"2024-09-17T01:37:53.337887+0000","last_active":"2024-09-17T01:37:54.322302+0000","last_peered":"2024-09-17T01:37:54.322302+0000","last_clean":"2024-09-17T01:37:54.322302+0000","last_became_active":"2024-09-17T01:37:53.337532+0000","last_became_peered":"2024-09-17T01:37:53.337532+0000","last_unstale":"2024-09-17T01:37:54.322302+0000","last_undegraded":"2024-09-17T01:37:54.322302+0000","last_fullsized":"2024-09-17T01:37:54.322302+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:35.763924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"93'1","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.331210+0000","last_change":"2024-09-17T01:37:52.301917+0000","last_active":"2024-09-17T01:37:54.331210+0000","last_peered":"2024-09-17T01:37:54.331210+0000","last_clean":"2024-09-17T01:37:54.331210+0000","last_became_active":"2024-09-17T01:37:52.301539+0000","last_became_peered":"2024-09-17T01:37:52.301539+0000","last_unstale":"2024-09-17T01:37:54.331210+0000","last_undegraded":"2024-09-17T01:37:54.331210+0000","last_fullsized":"2024-09-17T01:37:54.331210+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:29.671787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.321842+0000","last_change":"2024-09-17T01:37:53.341187+0000","last_active":"2024-09-17T01:37:54.321842+0000","last_peered":"2024-09-17T01:37:54.321842+0000","last_clean":"2024-09-17T01:37:54.321842+0000","last_became_active":"2024-09-17T01:37:53.337747+0000","last_became_peered":"2024-09-17T01:37:53.337747+0000","last_unstale":"2024-09-17T01:37:54.321842+0000","last_undegraded":"2024-09-17T01:37:54.321842+0000","last_fullsized":"2024-09-17T01:37:54.321842+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:44.091289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.326101+0000","last_change":"2024-09-17T01:37:52.314307+0000","last_active":"2024-09-17T01:37:53.326101+0000","last_peered":"2024-09-17T01:37:53.326101+0000","last_clean":"2024-09-17T01:37:53.326101+0000","last_became_active":"2024-09-17T01:37:52.313981+0000","last_became_peered":"2024-09-17T01:37:52.313981+0000","last_unstale":"2024-09-17T01:37:53.326101+0000","last_undegraded":"2024-09-17T01:37:53.326101+0000","last_fullsized":"2024-09-17T01:37:53.326101+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:51:14.294926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823446+0000","last_change":"2024-09-17T01:37:53.335736+0000","last_active":"2024-09-17T01:37:54.823446+0000","last_peered":"2024-09-17T01:37:54.823446+0000","last_clean":"2024-09-17T01:37:54.823446+0000","last_became_active":"2024-09-17T01:37:53.335274+0000","last_became_peered":"2024-09-17T01:37:53.335274+0000","last_unstale":"2024-09-17T01:37:54.823446+0000","last_undegraded":"2024-09-17T01:37:54.823446+0000","last_fullsized":"2024-09-17T01:37:54.823446+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:06.199680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823284+0000","last_change":"2024-09-17T01:37:52.322838+0000","last_active":"2024-09-17T01:37:54.823284+0000","last_peered":"2024-09-17T01:37:54.823284+0000","last_clean":"2024-09-17T01:37:54.823284+0000","last_became_active":"2024-09-17T01:37:52.320441+0000","last_became_peered":"2024-09-17T01:37:52.320441+0000","last_unstale":"2024-09-17T01:37:54.823284+0000","last_undegraded":"2024-09-17T01:37:54.823284+0000","last_fullsized":"2024-09-17T01:37:54.823284+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:32.056453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.343926+0000","last_change":"2024-09-17T01:37:53.339083+0000","last_active":"2024-09-17T01:37:53.343926+0000","last_peered":"2024-09-17T01:37:53.343926+0000","last_clean":"2024-09-17T01:37:53.343926+0000","last_became_active":"2024-09-17T01:37:53.338684+0000","last_became_peered":"2024-09-17T01:37:53.338684+0000","last_unstale":"2024-09-17T01:37:53.343926+0000","last_undegraded":"2024-09-17T01:37:53.343926+0000","last_fullsized":"2024-09-17T01:37:53.343926+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:01:23.985962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.323937+0000","last_change":"2024-09-17T01:37:52.314278+0000","last_active":"2024-09-17T01:37:54.323937+0000","last_peered":"2024-09-17T01:37:54.323937+0000","last_clean":"2024-09-17T01:37:54.323937+0000","last_became_active":"2024-09-17T01:37:52.313731+0000","last_became_peered":"2024-09-17T01:37:52.313731+0000","last_unstale":"2024-09-17T01:37:54.323937+0000","last_undegraded":"2024-09-17T01:37:54.323937+0000","last_fullsized":"2024-09-17T01:37:54.323937+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:08.546640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.329474+0000","last_change":"2024-09-17T01:37:53.322035+0000","last_active":"2024-09-17T01:37:54.329474+0000","last_peered":"2024-09-17T01:37:54.329474+0000","last_clean":"2024-09-17T01:37:54.329474+0000","last_became_active":"2024-09-17T01:37:53.320930+0000","last_became_peered":"2024-09-17T01:37:53.320930+0000","last_unstale":"2024-09-17T01:37:54.329474+0000","last_undegraded":"2024-09-17T01:37:54.329474+0000","last_fullsized":"2024-09-17T01:37:54.329474+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:22.346772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.823520+0000","last_change":"2024-09-17T01:37:52.317695+0000","last_active":"2024-09-17T01:37:54.823520+0000","last_peered":"2024-09-17T01:37:54.823520+0000","last_clean":"2024-09-17T01:37:54.823520+0000","last_became_active":"2024-09-17T01:37:52.317108+0000","last_became_peered":"2024-09-17T01:37:52.317108+0000","last_unstale":"2024-09-17T01:37:54.823520+0000","last_undegraded":"2024-09-17T01:37:54.823520+0000","last_fullsized":"2024-09-17T01:37:54.823520+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:15.376311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.328284+0000","last_change":"2024-09-17T01:37:53.322915+0000","last_active":"2024-09-17T01:37:53.328284+0000","last_peered":"2024-09-17T01:37:53.328284+0000","last_clean":"2024-09-17T01:37:53.328284+0000","last_became_active":"2024-09-17T01:37:53.322541+0000","last_became_peered":"2024-09-17T01:37:53.322541+0000","last_unstale":"2024-09-17T01:37:53.328284+0000","last_undegraded":"2024-09-17T01:37:53.328284+0000","last_fullsized":"2024-09-17T01:37:53.328284+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:52.979183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.311817+0000","last_change":"2024-09-17T01:37:52.317684+0000","last_active":"2024-09-17T01:37:53.311817+0000","last_peered":"2024-09-17T01:37:53.311817+0000","last_clean":"2024-09-17T01:37:53.311817+0000","last_became_active":"2024-09-17T01:37:52.317382+0000","last_became_peered":"2024-09-17T01:37:52.317382+0000","last_unstale":"2024-09-17T01:37:53.311817+0000","last_undegraded":"2024-09-17T01:37:53.311817+0000","last_fullsized":"2024-09-17T01:37:53.311817+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:26.686978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.332742+0000","last_change":"2024-09-17T01:37:53.330894+0000","last_active":"2024-09-17T01:37:53.332742+0000","last_peered":"2024-09-17T01:37:53.332742+0000","last_clean":"2024-09-17T01:37:53.332742+0000","last_became_active":"2024-09-17T01:37:53.330528+0000","last_became_peered":"2024-09-17T01:37:53.330528+0000","last_unstale":"2024-09-17T01:37:53.332742+0000","last_undegraded":"2024-09-17T01:37:53.332742+0000","last_fullsized":"2024-09-17T01:37:53.332742+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:28.257279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.324671+0000","last_change":"2024-09-17T01:37:52.316880+0000","last_active":"2024-09-17T01:37:53.324671+0000","last_peered":"2024-09-17T01:37:53.324671+0000","last_clean":"2024-09-17T01:37:53.324671+0000","last_became_active":"2024-09-17T01:37:52.316551+0000","last_became_peered":"2024-09-17T01:37:52.316551+0000","last_unstale":"2024-09-17T01:37:53.324671+0000","last_undegraded":"2024-09-17T01:37:53.324671+0000","last_fullsized":"2024-09-17T01:37:53.324671+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:45.651246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.329640+0000","last_change":"2024-09-17T01:37:53.330097+0000","last_active":"2024-09-17T01:37:54.329640+0000","last_peered":"2024-09-17T01:37:54.329640+0000","last_clean":"2024-09-17T01:37:54.329640+0000","last_became_active":"2024-09-17T01:37:53.329677+0000","last_became_peered":"2024-09-17T01:37:53.329677+0000","last_unstale":"2024-09-17T01:37:54.329640+0000","last_undegraded":"2024-09-17T01:37:54.329640+0000","last_fullsized":"2024-09-17T01:37:54.329640+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:52.286167+0000","last_clean_scrub_stamp":"2024-09-17T01:37:52.286167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:19.744741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"92'1","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-17T01:37:54.322013+0000","last_change":"2024-09-17T01:37:52.316419+0000","last_active":"2024-09-17T01:37:54.322013+0000","last_peered":"2024-09-17T01:37:54.322013+0000","last_clean":"2024-09-17T01:37:54.322013+0000","last_became_active":"2024-09-17T01:37:52.316064+0000","last_became_peered":"2024-09-17T01:37:52.316064+0000","last_unstale":"2024-09-17T01:37:54.322013+0000","last_undegraded":"2024-09-17T01:37:54.322013+0000","last_fullsized":"2024-09-17T01:37:54.322013+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:37:51.279700+0000","last_clean_scrub_stamp":"2024-09-17T01:37:51.279700+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:09.728658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":242,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-17T01:37:53.316138+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:37:53.316138+0000","last_peered":"2024-09-17T01:37:53.316138+0000","last_clean":"2024-09-17T01:37:53.316138+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:37:53.316138+0000","last_undegraded":"2024-09-17T01:37:53.316138+0000","last_fullsized":"2024-09-17T01:37:53.316138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476812,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1134592,"data_stored":490672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509515,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40612,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331228,"statfs":{"total":96636764160,"available":96595177472,"internally_reserved":0,"allocated":1126400,"data_stored":484442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509514,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40616,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331224,"statfs":{"total":96636764160,"available":96595173376,"internally_reserved":0,"allocated":1130496,"data_stored":485044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509515,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1126400,"data_stored":484406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509515,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1134592,"data_stored":485046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509514,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41192,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330648,"statfs":{"total":96636764160,"available":96594583552,"internally_reserved":0,"allocated":1720320,"data_stored":1074830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509516,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36468,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335372,"statfs":{"total":96636764160,"available":96599420928,"internally_reserved":0,"allocated":1138688,"data_stored":486006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542220,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41176,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330664,"statfs":{"total":96636764160,"available":96594599936,"internally_reserved":0,"allocated":1703936,"data_stored":1067965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:37:58.295 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T01:37:58.295 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T01:37:58.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.570+0000 7f0f5cc00640 1 -- 172.21.15.42:0/3640417922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f3c004800 msgr2=0x7f0f3c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:58.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.570+0000 7f0f5cc00640 1 --2- 172.21.15.42:0/3640417922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f3c004800 0x7f0f3c004c10 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f0f40009b50 tx=0x7f0f3c005830 comp rx=0 tx=0).stop 2024-09-17T01:37:58.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.570+0000 7f0f5cc00640 1 -- 172.21.15.42:0/3640417922 shutdown_connections 2024-09-17T01:37:58.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.570+0000 7f0f5cc00640 1 --2- 172.21.15.42:0/3640417922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f3c004800 0x7f0f3c004c10 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:58.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.570+0000 7f0f5cc00640 1 -- 172.21.15.42:0/3640417922 >> 172.21.15.42:0/3640417922 conn(0x7f0f580b2930 msgr2=0x7f0f5806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:58.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.570+0000 7f0f5cc00640 1 -- 172.21.15.42:0/3640417922 shutdown_connections 2024-09-17T01:37:58.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.570+0000 7f0f5cc00640 1 -- 172.21.15.42:0/3640417922 wait complete. 2024-09-17T01:37:58.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.573+0000 7f0f5cc00640 1 Processor -- start 2024-09-17T01:37:58.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.573+0000 7f0f5cc00640 1 -- start start 2024-09-17T01:37:58.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.574+0000 7f0f5cc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f3c004800 0x7f0f581e8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:58.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.574+0000 7f0f5cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f5813e9b0 0x7f0f5813edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:58.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.574+0000 7f0f5cc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f580cd390 0x7f0f580cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:58.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.574+0000 7f0f5cc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0f58152890 con 0x7f0f5813e9b0 2024-09-17T01:37:58.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.574+0000 7f0f5cc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0f58152710 con 0x7f0f580cd390 2024-09-17T01:37:58.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.574+0000 7f0f5cc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0f58152a10 con 0x7f0f3c004800 2024-09-17T01:37:58.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.574+0000 7f0f4fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f5813e9b0 0x7f0f5813edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:58.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.574+0000 7f0f4fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f5813e9b0 0x7f0f5813edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53754/0 (socket says 172.21.15.42:53754) 2024-09-17T01:37:58.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.574+0000 7f0f4fe00640 1 -- 172.21.15.42:0/3458667104 learned_addr learned my addr 172.21.15.42:0/3458667104 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:58.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.575+0000 7f0f55e00640 1 --2- 172.21.15.42:0/3458667104 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f3c004800 0x7f0f581e8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:58.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.575+0000 7f0f56800640 1 --2- 172.21.15.42:0/3458667104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f580cd390 0x7f0f580cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:58.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.575+0000 7f0f4fe00640 1 -- 172.21.15.42:0/3458667104 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f3c004800 msgr2=0x7f0f581e8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:58.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.575+0000 7f0f4fe00640 1 --2- 172.21.15.42:0/3458667104 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f3c004800 0x7f0f581e8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:58.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.575+0000 7f0f4fe00640 1 -- 172.21.15.42:0/3458667104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f580cd390 msgr2=0x7f0f580cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:58.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.575+0000 7f0f4fe00640 1 --2- 172.21.15.42:0/3458667104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f580cd390 0x7f0f580cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:58.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.575+0000 7f0f4fe00640 1 -- 172.21.15.42:0/3458667104 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f580cdce0 con 0x7f0f5813e9b0 2024-09-17T01:37:58.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.575+0000 7f0f56800640 1 --2- 172.21.15.42:0/3458667104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f580cd390 0x7f0f580cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:37:58.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.575+0000 7f0f4fe00640 1 --2- 172.21.15.42:0/3458667104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f5813e9b0 0x7f0f5813edc0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f0f40009a70 tx=0x7f0f400336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:58.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.575+0000 7f0f4e000640 1 -- 172.21.15.42:0/3458667104 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40040020 con 0x7f0f5813e9b0 2024-09-17T01:37:58.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.576+0000 7f0f4e000640 1 -- 172.21.15.42:0/3458667104 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f40004310 con 0x7f0f5813e9b0 2024-09-17T01:37:58.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.576+0000 7f0f4e000640 1 -- 172.21.15.42:0/3458667104 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40038040 con 0x7f0f5813e9b0 2024-09-17T01:37:58.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.576+0000 7f0f5cc00640 1 -- 172.21.15.42:0/3458667104 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f5813f670 con 0x7f0f5813e9b0 2024-09-17T01:37:58.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.576+0000 7f0f5cc00640 1 -- 172.21.15.42:0/3458667104 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f5813cda0 con 0x7f0f5813e9b0 2024-09-17T01:37:58.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.577+0000 7f0f5cc00640 1 -- 172.21.15.42:0/3458667104 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f5813f3e0 con 0x7f0f5813e9b0 2024-09-17T01:37:58.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.578+0000 7f0f4e000640 1 -- 172.21.15.42:0/3458667104 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0f4002b8a0 con 0x7f0f5813e9b0 2024-09-17T01:37:58.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.579+0000 7f0f4e000640 1 --2- 172.21.15.42:0/3458667104 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0f34078bc0 0x7f0f3407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:58.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.579+0000 7f0f4e000640 1 -- 172.21.15.42:0/3458667104 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f0f400bb370 con 0x7f0f5813e9b0 2024-09-17T01:37:58.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.580+0000 7f0f55e00640 1 --2- 172.21.15.42:0/3458667104 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0f34078bc0 0x7f0f3407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:58.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.580+0000 7f0f55e00640 1 --2- 172.21.15.42:0/3458667104 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0f34078bc0 0x7f0f3407b0d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0f58077840 tx=0x7f0f480068d0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:58.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.583+0000 7f0f4e000640 1 -- 172.21.15.42:0/3458667104 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0f4004a020 con 0x7f0f5813e9b0 2024-09-17T01:37:58.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.850+0000 7f0f5cc00640 1 -- 172.21.15.42:0/3458667104 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f0f5815f890 con 0x7f0f5813e9b0 2024-09-17T01:37:58.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.854+0000 7f0f4e000640 1 -- 172.21.15.42:0/3458667104 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v33) ==== 190+0+147 (secure 0 0 0) 0x7f0f580cdce0 con 0x7f0f5813e9b0 2024-09-17T01:37:58.852 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-09-17T01:37:58.852 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA== 2024-09-17T01:37:58.852 INFO:teuthology.orchestra.run.smithi042.stdout: caps mds = "allow" 2024-09-17T01:37:58.852 INFO:teuthology.orchestra.run.smithi042.stdout: caps mon = "allow r" 2024-09-17T01:37:58.852 INFO:teuthology.orchestra.run.smithi042.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T01:37:58.853 INFO:teuthology.orchestra.run.smithi042.stderr:updated caps for client.0 2024-09-17T01:37:58.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.856+0000 7f0f5cc00640 1 -- 172.21.15.42:0/3458667104 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0f34078bc0 msgr2=0x7f0f3407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:58.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.856+0000 7f0f5cc00640 1 --2- 172.21.15.42:0/3458667104 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0f34078bc0 0x7f0f3407b0d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0f58077840 tx=0x7f0f480068d0 comp rx=0 tx=0).stop 2024-09-17T01:37:58.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.856+0000 7f0f5cc00640 1 -- 172.21.15.42:0/3458667104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f5813e9b0 msgr2=0x7f0f5813edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:58.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.856+0000 7f0f5cc00640 1 --2- 172.21.15.42:0/3458667104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f5813e9b0 0x7f0f5813edc0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f0f40009a70 tx=0x7f0f400336f0 comp rx=0 tx=0).stop 2024-09-17T01:37:58.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.856+0000 7f0f5cc00640 1 -- 172.21.15.42:0/3458667104 shutdown_connections 2024-09-17T01:37:58.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.856+0000 7f0f5cc00640 1 --2- 172.21.15.42:0/3458667104 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0f34078bc0 0x7f0f3407b0d0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:58.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.856+0000 7f0f5cc00640 1 --2- 172.21.15.42:0/3458667104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f580cd390 0x7f0f580cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:58.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.856+0000 7f0f5cc00640 1 --2- 172.21.15.42:0/3458667104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f5813e9b0 0x7f0f5813edc0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:58.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.856+0000 7f0f5cc00640 1 --2- 172.21.15.42:0/3458667104 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0f3c004800 0x7f0f581e8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:58.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.856+0000 7f0f5cc00640 1 -- 172.21.15.42:0/3458667104 >> 172.21.15.42:0/3458667104 conn(0x7f0f580b2930 msgr2=0x7f0f58072340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:58.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.856+0000 7f0f5cc00640 1 -- 172.21.15.42:0/3458667104 shutdown_connections 2024-09-17T01:37:58.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:58.856+0000 7f0f5cc00640 1 -- 172.21.15.42:0/3458667104 wait complete. 2024-09-17T01:37:58.876 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:37:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.106+0000 7fc18d800640 1 -- 172.21.15.42:0/2134663822 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc1880cf7c0 msgr2=0x7fc18806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.106+0000 7fc18d800640 1 --2- 172.21.15.42:0/2134663822 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc1880cf7c0 0x7fc18806cd20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc174009830 tx=0x7fc17402a490 comp rx=0 tx=0).stop 2024-09-17T01:37:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.106+0000 7fc18d800640 1 -- 172.21.15.42:0/2134663822 shutdown_connections 2024-09-17T01:37:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.106+0000 7fc18d800640 1 --2- 172.21.15.42:0/2134663822 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc1880cf7c0 0x7fc18806cd20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.106+0000 7fc18d800640 1 --2- 172.21.15.42:0/2134663822 >> v2:172.21.15.43:3300/0 conn(0x7fc1880b4be0 0x7fc18815d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.106+0000 7fc18d800640 1 -- 172.21.15.42:0/2134663822 >> 172.21.15.42:0/2134663822 conn(0x7fc1880b25f0 msgr2=0x7fc1880d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.106+0000 7fc18d800640 1 -- 172.21.15.42:0/2134663822 shutdown_connections 2024-09-17T01:37:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.106+0000 7fc18d800640 1 -- 172.21.15.42:0/2134663822 wait complete. 2024-09-17T01:37:59.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.108+0000 7fc18d800640 1 Processor -- start 2024-09-17T01:37:59.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.108+0000 7fc18d800640 1 -- start start 2024-09-17T01:37:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.110+0000 7fc18d800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc18806d260 0x7fc18814ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.110+0000 7fc18d800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1880b4be0 0x7fc1881f9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.110+0000 7fc18d800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1880cf7c0 0x7fc1880ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.110+0000 7fc18d800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc1881537f0 con 0x7fc1880b4be0 2024-09-17T01:37:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.110+0000 7fc18d800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc1880cfdc0 con 0x7fc1880cf7c0 2024-09-17T01:37:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.110+0000 7fc18d800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc188153970 con 0x7fc18806d260 2024-09-17T01:37:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.110+0000 7fc187400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1880b4be0 0x7fc1881f9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.110+0000 7fc187400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1880b4be0 0x7fc1881f9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53756/0 (socket says 172.21.15.42:53756) 2024-09-17T01:37:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.110+0000 7fc187400640 1 -- 172.21.15.42:0/3626525474 learned_addr learned my addr 172.21.15.42:0/3626525474 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:37:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.110+0000 7fc187e00640 1 --2- 172.21.15.42:0/3626525474 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc18806d260 0x7fc18814ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.110+0000 7fc18ce00640 1 --2- 172.21.15.42:0/3626525474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1880cf7c0 0x7fc1880ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.111+0000 7fc187400640 1 -- 172.21.15.42:0/3626525474 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc18806d260 msgr2=0x7fc18814ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.111+0000 7fc187400640 1 --2- 172.21.15.42:0/3626525474 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc18806d260 0x7fc18814ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.111+0000 7fc187400640 1 -- 172.21.15.42:0/3626525474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1880cf7c0 msgr2=0x7fc1880ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.111+0000 7fc187400640 1 --2- 172.21.15.42:0/3626525474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1880cf7c0 0x7fc1880ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:59.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.111+0000 7fc187400640 1 -- 172.21.15.42:0/3626525474 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1881f9d90 con 0x7fc1880b4be0 2024-09-17T01:37:59.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.111+0000 7fc187400640 1 --2- 172.21.15.42:0/3626525474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1880b4be0 0x7fc1881f9850 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fc174009950 tx=0x7fc174003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:59.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.111+0000 7fc17fe00640 1 -- 172.21.15.42:0/3626525474 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc174005c90 con 0x7fc1880b4be0 2024-09-17T01:37:59.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.111+0000 7fc17fe00640 1 -- 172.21.15.42:0/3626525474 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc174005020 con 0x7fc1880b4be0 2024-09-17T01:37:59.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.111+0000 7fc17fe00640 1 -- 172.21.15.42:0/3626525474 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc174005450 con 0x7fc1880b4be0 2024-09-17T01:37:59.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.111+0000 7fc18d800640 1 -- 172.21.15.42:0/3626525474 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc188151e80 con 0x7fc1880b4be0 2024-09-17T01:37:59.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.112+0000 7fc18d800640 1 -- 172.21.15.42:0/3626525474 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1881f9050 con 0x7fc1880b4be0 2024-09-17T01:37:59.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.113+0000 7fc18d800640 1 -- 172.21.15.42:0/3626525474 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1881523a0 con 0x7fc1880b4be0 2024-09-17T01:37:59.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.114+0000 7fc17fe00640 1 -- 172.21.15.42:0/3626525474 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc1740317c0 con 0x7fc1880b4be0 2024-09-17T01:37:59.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.115+0000 7fc17fe00640 1 --2- 172.21.15.42:0/3626525474 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc168078b90 0x7fc16807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:59.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.115+0000 7fc17fe00640 1 -- 172.21.15.42:0/3626525474 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fc1740bbcf0 con 0x7fc1880b4be0 2024-09-17T01:37:59.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.115+0000 7fc187e00640 1 --2- 172.21.15.42:0/3626525474 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc168078b90 0x7fc16807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:59.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.116+0000 7fc187e00640 1 --2- 172.21.15.42:0/3626525474 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc168078b90 0x7fc16807b0a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc178009b30 tx=0x7fc178005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:59.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.119+0000 7fc17fe00640 1 -- 172.21.15.42:0/3626525474 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc1881523a0 con 0x7fc1880b4be0 2024-09-17T01:37:59.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.353+0000 7fc18d800640 1 -- 172.21.15.42:0/3626525474 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc18815d6b0 con 0x7fc1880b4be0 2024-09-17T01:37:59.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.353+0000 7fc17fe00640 1 -- 172.21.15.42:0/3626525474 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5213 (secure 0 0 0) 0x7fc17403f030 con 0x7fc1880b4be0 2024-09-17T01:37:59.351 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:37:59.352 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":72,"btime":"2024-09-17T01:37:56:325204+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6853,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/80987986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":80987986},{"type":"v1","addr":"172.21.15.43:6836","nonce":80987986}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":6856,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/540363900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":540363900},{"type":"v1","addr":"172.21.15.43:6837","nonce":540363900}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":7188,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/440158485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":440158485},{"type":"v1","addr":"172.21.15.42:6833","nonce":440158485}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:37:52.812411+0000","modified":"2024-09-17T01:37:55.835132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7191},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7191":{"gid":7191,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3687871500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3687871500},{"type":"v1","addr":"172.21.15.42:6835","nonce":3687871500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7191,"qdb_cluster":[7191]},"id":6}]} 2024-09-17T01:37:59.352 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 72 2024-09-17T01:37:59.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.356+0000 7fc18d800640 1 -- 172.21.15.42:0/3626525474 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc168078b90 msgr2=0x7fc16807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:59.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.356+0000 7fc18d800640 1 --2- 172.21.15.42:0/3626525474 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc168078b90 0x7fc16807b0a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc178009b30 tx=0x7fc178005f90 comp rx=0 tx=0).stop 2024-09-17T01:37:59.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.356+0000 7fc18d800640 1 -- 172.21.15.42:0/3626525474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1880b4be0 msgr2=0x7fc1881f9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:59.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.356+0000 7fc18d800640 1 --2- 172.21.15.42:0/3626525474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1880b4be0 0x7fc1881f9850 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fc174009950 tx=0x7fc174003c10 comp rx=0 tx=0).stop 2024-09-17T01:37:59.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.356+0000 7fc18d800640 1 -- 172.21.15.42:0/3626525474 shutdown_connections 2024-09-17T01:37:59.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.356+0000 7fc18d800640 1 --2- 172.21.15.42:0/3626525474 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc168078b90 0x7fc16807b0a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:59.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.356+0000 7fc18d800640 1 --2- 172.21.15.42:0/3626525474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1880cf7c0 0x7fc1880ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:59.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.356+0000 7fc18d800640 1 --2- 172.21.15.42:0/3626525474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1880b4be0 0x7fc1881f9850 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:59.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.356+0000 7fc18d800640 1 --2- 172.21.15.42:0/3626525474 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc18806d260 0x7fc18814ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:59.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.356+0000 7fc18d800640 1 -- 172.21.15.42:0/3626525474 >> 172.21.15.42:0/3626525474 conn(0x7fc1880b25f0 msgr2=0x7fc1880d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:59.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.356+0000 7fc18d800640 1 -- 172.21.15.42:0/3626525474 shutdown_connections 2024-09-17T01:37:59.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:37:59.356+0000 7fc18d800640 1 -- 172.21.15.42:0/3626525474 wait complete. 2024-09-17T01:37:59.777 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:37:52.812411+0000', 'modified': '2024-09-17T01:37:55.835132+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7191}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7191': {'gid': 7191, 'name': 'a', 'rank': 0, 'incarnation': 68, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.42:6835/3687871500', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6834', 'nonce': 3687871500}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 3687871500}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7191, 'qdb_cluster': [7191]} 2024-09-17T01:37:59.777 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T01:37:59.777 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T01:38:00.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.009+0000 7fcdd9600640 1 -- 172.21.15.42:0/969357890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcdd415f480 msgr2=0x7fcdd415f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:00.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.009+0000 7fcdd9600640 1 --2- 172.21.15.42:0/969357890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcdd415f480 0x7fcdd415f890 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc005fd0 tx=0x7fcdcc02aa80 comp rx=0 tx=0).stop 2024-09-17T01:38:00.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.009+0000 7fcdd9600640 1 -- 172.21.15.42:0/969357890 shutdown_connections 2024-09-17T01:38:00.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.009+0000 7fcdd9600640 1 --2- 172.21.15.42:0/969357890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcdd415f480 0x7fcdd415f890 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.009+0000 7fcdd9600640 1 --2- 172.21.15.42:0/969357890 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcdd406d430 0x7fcdd406d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.009+0000 7fcdd9600640 1 -- 172.21.15.42:0/969357890 >> 172.21.15.42:0/969357890 conn(0x7fcdd40b2930 msgr2=0x7fcdd406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:00.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.009+0000 7fcdd9600640 1 -- 172.21.15.42:0/969357890 shutdown_connections 2024-09-17T01:38:00.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.009+0000 7fcdd9600640 1 -- 172.21.15.42:0/969357890 wait complete. 2024-09-17T01:38:00.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.011+0000 7fcdd9600640 1 Processor -- start 2024-09-17T01:38:00.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.011+0000 7fcdd9600640 1 -- start start 2024-09-17T01:38:00.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.013+0000 7fcdd9600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdd406d430 0x7fcdd40ab010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:00.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.013+0000 7fcdd9600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcdd415cb80 0x7fcdd41f7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:00.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.013+0000 7fcdd9600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcdd415f480 0x7fcdd40ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:00.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.013+0000 7fcdd9600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd40737e0 con 0x7fcdd415cb80 2024-09-17T01:38:00.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.013+0000 7fcdd9600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd4073660 con 0x7fcdd406d430 2024-09-17T01:38:00.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.013+0000 7fcdd9600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fcdd4073960 con 0x7fcdd415f480 2024-09-17T01:38:00.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.013+0000 7fcdcbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcdd415cb80 0x7fcdd41f7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:00.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.013+0000 7fcdcbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcdd415cb80 0x7fcdd41f7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53768/0 (socket says 172.21.15.42:53768) 2024-09-17T01:38:00.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.013+0000 7fcdcbe00640 1 -- 172.21.15.42:0/2421246705 learned_addr learned my addr 172.21.15.42:0/2421246705 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:00.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.013+0000 7fcdd2a00640 1 --2- 172.21.15.42:0/2421246705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdd406d430 0x7fcdd40ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:00.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.013+0000 7fcdd3400640 1 --2- 172.21.15.42:0/2421246705 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcdd415f480 0x7fcdd40ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:00.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.014+0000 7fcdcbe00640 1 -- 172.21.15.42:0/2421246705 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcdd415f480 msgr2=0x7fcdd40ae340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:00.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.014+0000 7fcdcbe00640 1 --2- 172.21.15.42:0/2421246705 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcdd415f480 0x7fcdd40ae340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.014+0000 7fcdcbe00640 1 -- 172.21.15.42:0/2421246705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdd406d430 msgr2=0x7fcdd40ab010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:00.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.014+0000 7fcdcbe00640 1 --2- 172.21.15.42:0/2421246705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdd406d430 0x7fcdd40ab010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.014+0000 7fcdcbe00640 1 -- 172.21.15.42:0/2421246705 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd4150120 con 0x7fcdd415cb80 2024-09-17T01:38:00.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.014+0000 7fcdd3400640 1 --2- 172.21.15.42:0/2421246705 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcdd415f480 0x7fcdd40ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:00.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.014+0000 7fcdd2a00640 1 --2- 172.21.15.42:0/2421246705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdd406d430 0x7fcdd40ab010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:00.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.014+0000 7fcdcbe00640 1 --2- 172.21.15.42:0/2421246705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcdd415cb80 0x7fcdd41f7220 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00d680 tx=0x7fcdbc00db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:00.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.014+0000 7fcdcaa00640 1 -- 172.21.15.42:0/2421246705 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc017070 con 0x7fcdd415cb80 2024-09-17T01:38:00.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.014+0000 7fcdcaa00640 1 -- 172.21.15.42:0/2421246705 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcdbc009ab0 con 0x7fcdd415cb80 2024-09-17T01:38:00.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.014+0000 7fcdcaa00640 1 -- 172.21.15.42:0/2421246705 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc010460 con 0x7fcdd415cb80 2024-09-17T01:38:00.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.014+0000 7fcdd9600640 1 -- 172.21.15.42:0/2421246705 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdd41f7de0 con 0x7fcdd415cb80 2024-09-17T01:38:00.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.014+0000 7fcdd9600640 1 -- 172.21.15.42:0/2421246705 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdd40aa530 con 0x7fcdd415cb80 2024-09-17T01:38:00.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.017+0000 7fcdcaa00640 1 -- 172.21.15.42:0/2421246705 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcdbc01a070 con 0x7fcdd415cb80 2024-09-17T01:38:00.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.018+0000 7fcdcaa00640 1 --2- 172.21.15.42:0/2421246705 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcdb0078b90 0x7fcdb007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:00.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.018+0000 7fcdcaa00640 1 -- 172.21.15.42:0/2421246705 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fcdbc09aea0 con 0x7fcdd415cb80 2024-09-17T01:38:00.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.018+0000 7fcdd2a00640 1 --2- 172.21.15.42:0/2421246705 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcdb0078b90 0x7fcdb007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:00.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.018+0000 7fcde066d740 1 Processor -- start 2024-09-17T01:38:00.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.018+0000 7fcde066d740 1 -- start start 2024-09-17T01:38:00.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.019+0000 7fcdd2a00640 1 --2- 172.21.15.42:0/2421246705 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcdb0078b90 0x7fcdb007b0a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4007fd0 tx=0x7fcdc4009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:00.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.020+0000 7fcde066d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd6a06270 0x558fd6dd6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:00.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.020+0000 7fcde066d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fd69dd3b0 0x558fd6dd6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:00.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.020+0000 7fcde066d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558fd69e5590 0x558fd6da6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:00.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.020+0000 7fcde066d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558fd6d30430 con 0x558fd6a06270 2024-09-17T01:38:00.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.020+0000 7fcde066d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558fd6d205d0 con 0x558fd69dd3b0 2024-09-17T01:38:00.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.020+0000 7fcde066d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558fd6d0fa00 con 0x558fd69e5590 2024-09-17T01:38:00.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.020+0000 7fcdd2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd6a06270 0x558fd6dd6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:00.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.020+0000 7fcdd2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd6a06270 0x558fd6dd6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53772/0 (socket says 172.21.15.42:53772) 2024-09-17T01:38:00.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.020+0000 7fcdd2a00640 1 -- 172.21.15.42:0/843930857 learned_addr learned my addr 172.21.15.42:0/843930857 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:00.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.020+0000 7fcdcbe00640 1 --2- 172.21.15.42:0/843930857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fd69dd3b0 0x558fd6dd6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:00.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.020+0000 7fcdd3400640 1 --2- 172.21.15.42:0/843930857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558fd69e5590 0x558fd6da6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:00.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.021+0000 7fcdd2a00640 1 -- 172.21.15.42:0/843930857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558fd69e5590 msgr2=0x558fd6da6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:00.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.021+0000 7fcdd2a00640 1 --2- 172.21.15.42:0/843930857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558fd69e5590 0x558fd6da6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.021+0000 7fcdd2a00640 1 -- 172.21.15.42:0/843930857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fd69dd3b0 msgr2=0x558fd6dd6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:00.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.021+0000 7fcdd2a00640 1 --2- 172.21.15.42:0/843930857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fd69dd3b0 0x558fd6dd6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.021+0000 7fcdd2a00640 1 -- 172.21.15.42:0/843930857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fd6cd8520 con 0x558fd6a06270 2024-09-17T01:38:00.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.021+0000 7fcdd3400640 1 --2- 172.21.15.42:0/843930857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558fd69e5590 0x558fd6da6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:38:00.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.021+0000 7fcdd2a00640 1 --2- 172.21.15.42:0/843930857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd6a06270 0x558fd6dd6970 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4001e90 tx=0x7fcdc4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7488f10142eb2eb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:00.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.021+0000 7fcdc3000640 1 -- 172.21.15.42:0/843930857 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc40035f0 con 0x558fd6a06270 2024-09-17T01:38:00.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.021+0000 7fcdc3000640 1 -- 172.21.15.42:0/843930857 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcdc4003880 con 0x558fd6a06270 2024-09-17T01:38:00.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.021+0000 7fcdc3000640 1 -- 172.21.15.42:0/843930857 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4003c70 con 0x558fd6a06270 2024-09-17T01:38:00.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.022+0000 7fcde066d740 1 -- 172.21.15.42:0/843930857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd6a06270 msgr2=0x558fd6dd6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:00.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.022+0000 7fcde066d740 1 --2- 172.21.15.42:0/843930857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd6a06270 0x558fd6dd6970 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4001e90 tx=0x7fcdc4011000 comp rx=0 tx=0).stop 2024-09-17T01:38:00.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.022+0000 7fcde066d740 1 -- 172.21.15.42:0/843930857 shutdown_connections 2024-09-17T01:38:00.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.022+0000 7fcde066d740 1 --2- 172.21.15.42:0/843930857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fd69dd3b0 0x558fd6dd6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.022+0000 7fcde066d740 1 --2- 172.21.15.42:0/843930857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558fd69e5590 0x558fd6da6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.022+0000 7fcde066d740 1 --2- 172.21.15.42:0/843930857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd6a06270 0x558fd6dd6970 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.022+0000 7fcde066d740 1 -- 172.21.15.42:0/843930857 >> 172.21.15.42:0/843930857 conn(0x558fd69fa3c0 msgr2=0x558fd6dac970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:00.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.022+0000 7fcde066d740 1 -- 172.21.15.42:0/843930857 shutdown_connections 2024-09-17T01:38:00.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.022+0000 7fcde066d740 1 -- 172.21.15.42:0/843930857 wait complete. 2024-09-17T01:38:00.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.023+0000 7fcde066d740 1 -- start start 2024-09-17T01:38:00.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.023+0000 7fcde066d740 1 Processor -- start 2024-09-17T01:38:00.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.025+0000 7fcde066d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd69dd3b0 0x558fd6de9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:00.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.025+0000 7fcde066d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fd69e5590 0x558fd6dea290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:00.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.025+0000 7fcde066d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558fd6a06270 0x558fd6dbde40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:00.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.025+0000 7fcde066d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558fd6cb6330 con 0x558fd69dd3b0 2024-09-17T01:38:00.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.025+0000 7fcde066d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558fd6d13810 con 0x558fd69e5590 2024-09-17T01:38:00.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.025+0000 7fcde066d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558fd6a80620 con 0x558fd6a06270 2024-09-17T01:38:00.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.025+0000 7fcde066d740 10 client.0 _ll_register_callbacks cb 0x558fd6cbb420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:38:00.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.025+0000 7fcdd2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd69dd3b0 0x558fd6de9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:00.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.025+0000 7fcdd2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd69dd3b0 0x558fd6de9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53778/0 (socket says 172.21.15.42:53778) 2024-09-17T01:38:00.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.025+0000 7fcdd2a00640 1 -- 172.21.15.42:0/1197785404 learned_addr learned my addr 172.21.15.42:0/1197785404 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:00.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.025+0000 7fcdcbe00640 1 --2- 172.21.15.42:0/1197785404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fd69e5590 0x558fd6dea290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:00.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.026+0000 7fcdd3400640 1 --2- 172.21.15.42:0/1197785404 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558fd6a06270 0x558fd6dbde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:00.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.026+0000 7fcdd2a00640 1 -- 172.21.15.42:0/1197785404 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558fd6a06270 msgr2=0x558fd6dbde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:00.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.026+0000 7fcdd2a00640 1 --2- 172.21.15.42:0/1197785404 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558fd6a06270 0x558fd6dbde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.026+0000 7fcdd2a00640 1 -- 172.21.15.42:0/1197785404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fd69e5590 msgr2=0x558fd6dea290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:00.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.026+0000 7fcdd2a00640 1 --2- 172.21.15.42:0/1197785404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fd69e5590 0x558fd6dea290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.026+0000 7fcdd2a00640 1 -- 172.21.15.42:0/1197785404 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fd6a71850 con 0x558fd69dd3b0 2024-09-17T01:38:00.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.026+0000 7fcdd2a00640 1 --2- 172.21.15.42:0/1197785404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd69dd3b0 0x558fd6de9d50 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fcdc400e530 tx=0x7fcdc4003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d5e572d83e8658 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:00.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.026+0000 7fcdb7400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:38:00.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.026+0000 7fcdb7400640 1 -- 172.21.15.42:0/1197785404 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4021860 con 0x558fd69dd3b0 2024-09-17T01:38:00.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.026+0000 7fcdb7400640 1 -- 172.21.15.42:0/1197785404 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fcdc4021a00 con 0x558fd69dd3b0 2024-09-17T01:38:00.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.026+0000 7fcde066d740 1 -- 172.21.15.42:0/1197785404 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdc4003880 con 0x558fd69dd3b0 2024-09-17T01:38:00.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.027+0000 7fcdb7400640 1 -- 172.21.15.42:0/1197785404 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7fcdc4032050 con 0x558fd69dd3b0 2024-09-17T01:38:00.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.027+0000 7fcde066d740 10 client.7308 fetch_fsmap learned FSMap version 72 2024-09-17T01:38:00.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.027+0000 7fcde066d740 1 -- 172.21.15.42:0/1197785404 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) -- 0x558fd6ae86b0 con 0x558fd69dd3b0 2024-09-17T01:38:00.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.027+0000 7fcdb7400640 1 -- 172.21.15.42:0/1197785404 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcdc4003880 con 0x558fd69dd3b0 2024-09-17T01:38:00.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.027+0000 7fcdb7400640 1 -- 172.21.15.42:0/1197785404 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 72) ==== 3502+0+0 (secure 0 0 0) 0x7fcdc4035020 con 0x558fd69dd3b0 2024-09-17T01:38:00.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.027+0000 7fcde066d740 10 client.7308 fetch_fsmap finished waiting for FSMap version 72 2024-09-17T01:38:00.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.027+0000 7fcde066d740 10 client.7308 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T01:38:00.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.027+0000 7fcde066d740 20 client.7308 populate_metadata read hostname 'smithi042' 2024-09-17T01:38:00.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.027+0000 7fcde066d740 1 --2- 172.21.15.42:0/1197785404 >> [v2:172.21.15.42:6834/3687871500,v1:172.21.15.42:6835/3687871500] conn(0x558fd69c4e40 0x558fd6dbe780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:00.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.027+0000 7fcde066d740 4 client.7308 mds_command: new command op to 7191 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:38:00.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.027+0000 7fcde066d740 1 -- 172.21.15.42:0/1197785404 --> [v2:172.21.15.42:6834/3687871500,v1:172.21.15.42:6835/3687871500] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558fd6d22520 con 0x558fd69c4e40 2024-09-17T01:38:00.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.027+0000 7fcdcbe00640 1 --2- 172.21.15.42:0/1197785404 >> [v2:172.21.15.42:6834/3687871500,v1:172.21.15.42:6835/3687871500] conn(0x558fd69c4e40 0x558fd6dbe780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:00.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.028+0000 7fcdcbe00640 1 --2- 172.21.15.42:0/1197785404 >> [v2:172.21.15.42:6834/3687871500,v1:172.21.15.42:6835/3687871500] conn(0x558fd69c4e40 0x558fd6dbe780 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea9b8aa268eafd42 server_cookie=b73f3922d2863646 in_seq=0 out_seq=0 2024-09-17T01:38:00.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.028+0000 7fcdb7400640 10 client.7308 ms_handle_connect on v2:172.21.15.42:6834/3687871500 2024-09-17T01:38:00.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.029+0000 7fcdb7400640 1 -- 172.21.15.42:0/1197785404 <== mds.0 v2:172.21.15.42:6834/3687871500 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558fd6d22520 con 0x558fd69c4e40 2024-09-17T01:38:00.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.029+0000 7fcdb7400640 10 client.7308 handle_command_reply: tid=0 2024-09-17T01:38:00.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.029+0000 7fcde066d740 1 client.7308 shutdown 2024-09-17T01:38:00.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.029+0000 7fcde066d740 1 -- 172.21.15.42:0/1197785404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd69dd3b0 msgr2=0x558fd6de9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:00.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.029+0000 7fcde066d740 1 --2- 172.21.15.42:0/1197785404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd69dd3b0 0x558fd6de9d50 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fcdc400e530 tx=0x7fcdc4003c60 comp rx=0 tx=0).stop 2024-09-17T01:38:00.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.029+0000 7fcde066d740 1 -- 172.21.15.42:0/1197785404 shutdown_connections 2024-09-17T01:38:00.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.029+0000 7fcde066d740 1 --2- 172.21.15.42:0/1197785404 >> [v2:172.21.15.42:6834/3687871500,v1:172.21.15.42:6835/3687871500] conn(0x558fd69c4e40 0x558fd6dbe780 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.029+0000 7fcde066d740 1 --2- 172.21.15.42:0/1197785404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fd69e5590 0x558fd6dea290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.029+0000 7fcde066d740 1 --2- 172.21.15.42:0/1197785404 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558fd6a06270 0x558fd6dbde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.029+0000 7fcde066d740 1 --2- 172.21.15.42:0/1197785404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd69dd3b0 0x558fd6de9d50 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.029+0000 7fcde066d740 1 -- 172.21.15.42:0/1197785404 >> 172.21.15.42:0/1197785404 conn(0x558fd69fa3c0 msgr2=0x558fd6de7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:00.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.029+0000 7fcdb7400640 0 client.7308 ms_handle_reset on v2:172.21.15.42:6834/3687871500 2024-09-17T01:38:00.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.029+0000 7fcde066d740 1 -- 172.21.15.42:0/1197785404 shutdown_connections 2024-09-17T01:38:00.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.029+0000 7fcde066d740 1 -- 172.21.15.42:0/1197785404 wait complete. 2024-09-17T01:38:00.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.030+0000 7fcde066d740 20 client.7308 trim_cache size 0 max 16384 2024-09-17T01:38:00.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.049+0000 7fcde066d740 1 Processor -- start 2024-09-17T01:38:00.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.049+0000 7fcde066d740 1 -- start start 2024-09-17T01:38:00.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.050+0000 7fcde066d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558fd69dd3b0 0x558fd6de9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:00.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.050+0000 7fcde066d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fd69e5590 0x558fd6dbd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:00.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.050+0000 7fcde066d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd6a06270 0x558fd6dbdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:00.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.050+0000 7fcde066d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd4143dd0 con 0x558fd6a06270 2024-09-17T01:38:00.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.050+0000 7fcde066d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd41425b0 con 0x558fd69e5590 2024-09-17T01:38:00.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.050+0000 7fcde066d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fcdd4154c10 con 0x558fd69dd3b0 2024-09-17T01:38:00.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.051+0000 7fcdd3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd6a06270 0x558fd6dbdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:00.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.051+0000 7fcdd3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd6a06270 0x558fd6dbdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53784/0 (socket says 172.21.15.42:53784) 2024-09-17T01:38:00.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.051+0000 7fcdd3400640 1 -- 172.21.15.42:0/3385070129 learned_addr learned my addr 172.21.15.42:0/3385070129 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:00.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.051+0000 7fcdd2a00640 1 --2- 172.21.15.42:0/3385070129 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558fd69dd3b0 0x558fd6de9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:00.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.051+0000 7fcdcbe00640 1 --2- 172.21.15.42:0/3385070129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fd69e5590 0x558fd6dbd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:00.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.051+0000 7fcdd3400640 1 -- 172.21.15.42:0/3385070129 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558fd69dd3b0 msgr2=0x558fd6de9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:00.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.051+0000 7fcdd3400640 1 --2- 172.21.15.42:0/3385070129 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558fd69dd3b0 0x558fd6de9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.051+0000 7fcdd3400640 1 -- 172.21.15.42:0/3385070129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fd69e5590 msgr2=0x558fd6dbd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:00.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.051+0000 7fcdd3400640 1 --2- 172.21.15.42:0/3385070129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fd69e5590 0x558fd6dbd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.051+0000 7fcdd3400640 1 -- 172.21.15.42:0/3385070129 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fd6dd2770 con 0x558fd6a06270 2024-09-17T01:38:00.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.051+0000 7fcdcbe00640 1 --2- 172.21.15.42:0/3385070129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fd69e5590 0x558fd6dbd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:38:00.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.052+0000 7fcdd3400640 1 --2- 172.21.15.42:0/3385070129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd6a06270 0x558fd6dbdbd0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc02b070 tx=0x7fcdcc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea67d761e53f2ae8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:00.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.052+0000 7fcdc2600640 1 -- 172.21.15.42:0/3385070129 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc047070 con 0x558fd6a06270 2024-09-17T01:38:00.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.052+0000 7fcdc2600640 1 -- 172.21.15.42:0/3385070129 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcdcc02edc0 con 0x558fd6a06270 2024-09-17T01:38:00.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.052+0000 7fcdc2600640 1 -- 172.21.15.42:0/3385070129 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc003bb0 con 0x558fd6a06270 2024-09-17T01:38:00.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.053+0000 7fcde066d740 1 -- 172.21.15.42:0/3385070129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd6a06270 msgr2=0x558fd6dbdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:00.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.053+0000 7fcde066d740 1 --2- 172.21.15.42:0/3385070129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd6a06270 0x558fd6dbdbd0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc02b070 tx=0x7fcdcc004ab0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.053+0000 7fcde066d740 1 -- 172.21.15.42:0/3385070129 shutdown_connections 2024-09-17T01:38:00.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.053+0000 7fcde066d740 1 --2- 172.21.15.42:0/3385070129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fd69e5590 0x558fd6dbd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.053+0000 7fcde066d740 1 --2- 172.21.15.42:0/3385070129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd6a06270 0x558fd6dbdbd0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.053+0000 7fcde066d740 1 --2- 172.21.15.42:0/3385070129 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558fd69dd3b0 0x558fd6de9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.053+0000 7fcde066d740 1 -- 172.21.15.42:0/3385070129 >> 172.21.15.42:0/3385070129 conn(0x558fd69fa3c0 msgr2=0x558fd6df4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:00.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.053+0000 7fcde066d740 1 -- 172.21.15.42:0/3385070129 shutdown_connections 2024-09-17T01:38:00.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.053+0000 7fcde066d740 1 -- 172.21.15.42:0/3385070129 wait complete. 2024-09-17T01:38:00.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.054+0000 7fcde066d740 1 -- start start 2024-09-17T01:38:00.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.054+0000 7fcde066d740 1 Processor -- start 2024-09-17T01:38:00.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.055+0000 7fcde066d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd69dd3b0 0x558fd6dcc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:00.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.055+0000 7fcde066d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fd69e5590 0x558fd6dcc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:00.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.055+0000 7fcde066d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558fd6a06270 0x558fd6e6e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:00.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.055+0000 7fcde066d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558fd6dbe600 con 0x558fd69dd3b0 2024-09-17T01:38:00.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.055+0000 7fcde066d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558fd6cb6330 con 0x558fd69e5590 2024-09-17T01:38:00.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.055+0000 7fcde066d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558fd6dffed0 con 0x558fd6a06270 2024-09-17T01:38:00.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.056+0000 7fcde066d740 10 client.0 _ll_register_callbacks cb 0x7fcdc40036c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:38:00.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.056+0000 7fcdd2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd69dd3b0 0x558fd6dcc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:00.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.056+0000 7fcdd2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd69dd3b0 0x558fd6dcc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53794/0 (socket says 172.21.15.42:53794) 2024-09-17T01:38:00.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.056+0000 7fcdd2a00640 1 -- 172.21.15.42:0/304401214 learned_addr learned my addr 172.21.15.42:0/304401214 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:00.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.056+0000 7fcdcbe00640 1 --2- 172.21.15.42:0/304401214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fd69e5590 0x558fd6dcc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:00.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.056+0000 7fcdd3400640 1 --2- 172.21.15.42:0/304401214 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558fd6a06270 0x558fd6e6e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:00.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.056+0000 7fcdd2a00640 1 -- 172.21.15.42:0/304401214 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558fd6a06270 msgr2=0x558fd6e6e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:00.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.056+0000 7fcdd2a00640 1 --2- 172.21.15.42:0/304401214 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558fd6a06270 0x558fd6e6e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.056+0000 7fcdd2a00640 1 -- 172.21.15.42:0/304401214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fd69e5590 msgr2=0x558fd6dcc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:00.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.056+0000 7fcdd2a00640 1 --2- 172.21.15.42:0/304401214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fd69e5590 0x558fd6dcc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.056+0000 7fcdd2a00640 1 -- 172.21.15.42:0/304401214 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fd6dcccb0 con 0x558fd69dd3b0 2024-09-17T01:38:00.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.056+0000 7fcdd3400640 1 --2- 172.21.15.42:0/304401214 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558fd6a06270 0x558fd6e6e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:00.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.056+0000 7fcdcbe00640 1 --2- 172.21.15.42:0/304401214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fd69e5590 0x558fd6dcc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:00.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.056+0000 7fcdd2a00640 1 --2- 172.21.15.42:0/304401214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd69dd3b0 0x558fd6dcc0b0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009010 tx=0x7fcdc4003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6cae2b348dbb9b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:00.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.056+0000 7fcdb7400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:38:00.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.057+0000 7fcdb7400640 1 -- 172.21.15.42:0/304401214 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc403b060 con 0x558fd69dd3b0 2024-09-17T01:38:00.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.057+0000 7fcdb7400640 1 -- 172.21.15.42:0/304401214 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fcdc4013630 con 0x558fd69dd3b0 2024-09-17T01:38:00.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.057+0000 7fcde066d740 1 -- 172.21.15.42:0/304401214 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdcc02edc0 con 0x558fd69dd3b0 2024-09-17T01:38:00.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.057+0000 7fcdb7400640 1 -- 172.21.15.42:0/304401214 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7fcdc4041050 con 0x558fd69dd3b0 2024-09-17T01:38:00.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.057+0000 7fcde066d740 10 client.7314 fetch_fsmap learned FSMap version 72 2024-09-17T01:38:00.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.057+0000 7fcde066d740 1 -- 172.21.15.42:0/304401214 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) -- 0x558fd6dea060 con 0x558fd69dd3b0 2024-09-17T01:38:00.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.057+0000 7fcdb7400640 1 -- 172.21.15.42:0/304401214 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcdcc02edc0 con 0x558fd69dd3b0 2024-09-17T01:38:00.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.057+0000 7fcdb7400640 1 -- 172.21.15.42:0/304401214 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 72) ==== 3502+0+0 (secure 0 0 0) 0x7fcdc4044020 con 0x558fd69dd3b0 2024-09-17T01:38:00.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.057+0000 7fcde066d740 10 client.7314 fetch_fsmap finished waiting for FSMap version 72 2024-09-17T01:38:00.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.057+0000 7fcde066d740 10 client.7314 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T01:38:00.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.057+0000 7fcde066d740 20 client.7314 populate_metadata read hostname 'smithi042' 2024-09-17T01:38:00.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.057+0000 7fcde066d740 1 --2- 172.21.15.42:0/304401214 >> [v2:172.21.15.42:6834/3687871500,v1:172.21.15.42:6835/3687871500] conn(0x558fd6dd6eb0 0x558fd6e713c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:00.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.057+0000 7fcde066d740 4 client.7314 mds_command: new command op to 7191 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T01:38:00.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.057+0000 7fcde066d740 1 -- 172.21.15.42:0/304401214 --> [v2:172.21.15.42:6834/3687871500,v1:172.21.15.42:6835/3687871500] -- command(tid 0: {"prefix": "status"}) -- 0x558fd6d1dfd0 con 0x558fd6dd6eb0 2024-09-17T01:38:00.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.058+0000 7fcdcbe00640 1 --2- 172.21.15.42:0/304401214 >> [v2:172.21.15.42:6834/3687871500,v1:172.21.15.42:6835/3687871500] conn(0x558fd6dd6eb0 0x558fd6e713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:00.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.058+0000 7fcdcbe00640 1 --2- 172.21.15.42:0/304401214 >> [v2:172.21.15.42:6834/3687871500,v1:172.21.15.42:6835/3687871500] conn(0x558fd6dd6eb0 0x558fd6e713c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae5eb790df5302f7 server_cookie=945504bfe2040332 in_seq=0 out_seq=0 2024-09-17T01:38:00.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.058+0000 7fcdb7400640 10 client.7314 ms_handle_connect on v2:172.21.15.42:6834/3687871500 2024-09-17T01:38:00.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.058+0000 7fcdb7400640 1 -- 172.21.15.42:0/304401214 <== mds.0 v2:172.21.15.42:6834/3687871500 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x558fd6d1dfd0 con 0x558fd6dd6eb0 2024-09-17T01:38:00.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.058+0000 7fcdb7400640 10 client.7314 handle_command_reply: tid=0 2024-09-17T01:38:00.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.058+0000 7fcde066d740 1 client.7314 shutdown 2024-09-17T01:38:00.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.059+0000 7fcde066d740 1 -- 172.21.15.42:0/304401214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd69dd3b0 msgr2=0x558fd6dcc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:00.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.059+0000 7fcde066d740 1 --2- 172.21.15.42:0/304401214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd69dd3b0 0x558fd6dcc0b0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009010 tx=0x7fcdc4003cd0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.059+0000 7fcde066d740 1 -- 172.21.15.42:0/304401214 shutdown_connections 2024-09-17T01:38:00.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.059+0000 7fcde066d740 1 --2- 172.21.15.42:0/304401214 >> [v2:172.21.15.42:6834/3687871500,v1:172.21.15.42:6835/3687871500] conn(0x558fd6dd6eb0 0x558fd6e713c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.059+0000 7fcde066d740 1 --2- 172.21.15.42:0/304401214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558fd69e5590 0x558fd6dcc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.059+0000 7fcde066d740 1 --2- 172.21.15.42:0/304401214 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558fd6a06270 0x558fd6e6e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.059+0000 7fcde066d740 1 --2- 172.21.15.42:0/304401214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558fd69dd3b0 0x558fd6dcc0b0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.059+0000 7fcde066d740 1 -- 172.21.15.42:0/304401214 >> 172.21.15.42:0/304401214 conn(0x558fd69fa3c0 msgr2=0x558fd6df4910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:00.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.059+0000 7fcdb7400640 0 client.7314 ms_handle_reset on v2:172.21.15.42:6834/3687871500 2024-09-17T01:38:00.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.059+0000 7fcde066d740 1 -- 172.21.15.42:0/304401214 shutdown_connections 2024-09-17T01:38:00.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.059+0000 7fcde066d740 1 -- 172.21.15.42:0/304401214 wait complete. 2024-09-17T01:38:00.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.059+0000 7fcde066d740 20 client.7314 trim_cache size 0 max 16384 2024-09-17T01:38:00.061 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:38:00.061 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "fea1c88c-cb05-432f-a745-f9dcbb5f2503", 2024-09-17T01:38:00.062 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-17T01:38:00.062 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 7191, 2024-09-17T01:38:00.062 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-17T01:38:00.062 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-17T01:38:00.062 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-17T01:38:00.062 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 6.7450418880000003, 2024-09-17T01:38:00.062 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 72, 2024-09-17T01:38:00.062 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 93, 2024-09-17T01:38:00.062 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 93, 2024-09-17T01:38:00.062 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 11.708233095000001 2024-09-17T01:38:00.062 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:38:00.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.060+0000 7fcdd9600640 1 -- 172.21.15.42:0/2421246705 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcdb0078b90 msgr2=0x7fcdb007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:00.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.060+0000 7fcdd9600640 1 --2- 172.21.15.42:0/2421246705 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcdb0078b90 0x7fcdb007b0a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4007fd0 tx=0x7fcdc4009040 comp rx=0 tx=0).stop 2024-09-17T01:38:00.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.060+0000 7fcdd9600640 1 -- 172.21.15.42:0/2421246705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcdd415cb80 msgr2=0x7fcdd41f7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:00.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.060+0000 7fcdd9600640 1 --2- 172.21.15.42:0/2421246705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcdd415cb80 0x7fcdd41f7220 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00d680 tx=0x7fcdbc00db40 comp rx=0 tx=0).stop 2024-09-17T01:38:00.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.060+0000 7fcdd9600640 1 -- 172.21.15.42:0/2421246705 shutdown_connections 2024-09-17T01:38:00.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.060+0000 7fcdd9600640 1 --2- 172.21.15.42:0/2421246705 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcdb0078b90 0x7fcdb007b0a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.060+0000 7fcdd9600640 1 --2- 172.21.15.42:0/2421246705 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcdd415f480 0x7fcdd40ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.060+0000 7fcdd9600640 1 --2- 172.21.15.42:0/2421246705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcdd415cb80 0x7fcdd41f7220 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.060+0000 7fcdd9600640 1 --2- 172.21.15.42:0/2421246705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdd406d430 0x7fcdd40ab010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.060+0000 7fcdd9600640 1 -- 172.21.15.42:0/2421246705 >> 172.21.15.42:0/2421246705 conn(0x7fcdd40b2930 msgr2=0x7fcdd4072900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:00.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.060+0000 7fcdd9600640 1 -- 172.21.15.42:0/2421246705 shutdown_connections 2024-09-17T01:38:00.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.060+0000 7fcdd9600640 1 -- 172.21.15.42:0/2421246705 wait complete. 2024-09-17T01:38:00.079 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T01:38:00.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.309+0000 7f5a1a800640 1 -- 172.21.15.42:0/1737915977 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59f8004800 msgr2=0x7f59f8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:00.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.309+0000 7f5a1a800640 1 --2- 172.21.15.42:0/1737915977 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59f8004800 0x7f59f8004c10 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f5a140cfa70 tx=0x7f59f8005830 comp rx=0 tx=0).stop 2024-09-17T01:38:00.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.309+0000 7f5a13e00640 1 -- 172.21.15.42:0/1737915977 reap_dead start 2024-09-17T01:38:00.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.310+0000 7f5a1a800640 1 -- 172.21.15.42:0/1737915977 shutdown_connections 2024-09-17T01:38:00.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.310+0000 7f5a1a800640 1 -- 172.21.15.42:0/1737915977 >> 172.21.15.42:0/1737915977 conn(0x7f5a140b2930 msgr2=0x7f5a1406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:00.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.310+0000 7f5a1a800640 1 -- 172.21.15.42:0/1737915977 shutdown_connections 2024-09-17T01:38:00.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.310+0000 7f5a1a800640 1 -- 172.21.15.42:0/1737915977 wait complete. 2024-09-17T01:38:00.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.312+0000 7f5a1a800640 1 Processor -- start 2024-09-17T01:38:00.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.312+0000 7f5a1a800640 1 -- start start 2024-09-17T01:38:00.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.314+0000 7f5a1a800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f59f8004800 0x7f5a1406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:00.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.314+0000 7f5a1a800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a140cbc40 0x7f5a141f5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:00.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.314+0000 7f5a1a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a140c9840 0x7f5a140c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:00.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.314+0000 7f5a1a800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1406d430 con 0x7f5a140c9840 2024-09-17T01:38:00.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.314+0000 7f5a1a800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5a140cf310 con 0x7f5a140cbc40 2024-09-17T01:38:00.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.314+0000 7f5a1a800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5a1406d5b0 con 0x7f59f8004800 2024-09-17T01:38:00.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.314+0000 7f5a13e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a140c9840 0x7f5a140c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:00.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.314+0000 7f5a13e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a140c9840 0x7f5a140c9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53806/0 (socket says 172.21.15.42:53806) 2024-09-17T01:38:00.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.314+0000 7f5a13400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f59f8004800 0x7f5a1406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:00.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.314+0000 7f5a13e00640 1 -- 172.21.15.42:0/4184442881 learned_addr learned my addr 172.21.15.42:0/4184442881 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:00.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.314+0000 7f5a0be00640 1 --2- 172.21.15.42:0/4184442881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a140cbc40 0x7f5a141f5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:00.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.315+0000 7f5a13e00640 1 -- 172.21.15.42:0/4184442881 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f59f8004800 msgr2=0x7f5a1406ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:00.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.315+0000 7f5a13e00640 1 --2- 172.21.15.42:0/4184442881 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f59f8004800 0x7f5a1406ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.315+0000 7f5a13e00640 1 -- 172.21.15.42:0/4184442881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a140cbc40 msgr2=0x7f5a141f5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:00.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.315+0000 7f5a13e00640 1 --2- 172.21.15.42:0/4184442881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a140cbc40 0x7f5a141f5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.315+0000 7f5a13e00640 1 -- 172.21.15.42:0/4184442881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a1406e1c0 con 0x7f5a140c9840 2024-09-17T01:38:00.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.315+0000 7f5a0be00640 1 --2- 172.21.15.42:0/4184442881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a140cbc40 0x7f5a141f5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:38:00.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.315+0000 7f5a13e00640 1 --2- 172.21.15.42:0/4184442881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a140c9840 0x7f5a140c9c50 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f5a140ce760 tx=0x7f5a0c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:00.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.316+0000 7f5a0b400640 1 -- 172.21.15.42:0/4184442881 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c017070 con 0x7f5a140c9840 2024-09-17T01:38:00.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.316+0000 7f5a0b400640 1 -- 172.21.15.42:0/4184442881 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a0c015070 con 0x7f5a140c9840 2024-09-17T01:38:00.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.316+0000 7f5a0b400640 1 -- 172.21.15.42:0/4184442881 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c004d80 con 0x7f5a140c9840 2024-09-17T01:38:00.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.316+0000 7f5a1a800640 1 -- 172.21.15.42:0/4184442881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a141f5fc0 con 0x7f5a140c9840 2024-09-17T01:38:00.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.316+0000 7f5a1a800640 1 -- 172.21.15.42:0/4184442881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a1406e480 con 0x7f5a140c9840 2024-09-17T01:38:00.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.317+0000 7f5a1a800640 1 -- 172.21.15.42:0/4184442881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a1406dae0 con 0x7f5a140c9840 2024-09-17T01:38:00.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.318+0000 7f5a0b400640 1 -- 172.21.15.42:0/4184442881 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5a0c011440 con 0x7f5a140c9840 2024-09-17T01:38:00.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.319+0000 7f5a0b400640 1 --2- 172.21.15.42:0/4184442881 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f59f0078be0 0x7f59f007b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:00.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.319+0000 7f5a0b400640 1 -- 172.21.15.42:0/4184442881 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f5a0c09b5c0 con 0x7f5a140c9840 2024-09-17T01:38:00.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.320+0000 7f5a13400640 1 --2- 172.21.15.42:0/4184442881 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f59f0078be0 0x7f59f007b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:00.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.321+0000 7f5a13400640 1 --2- 172.21.15.42:0/4184442881 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f59f0078be0 0x7f59f007b0f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5a04000c00 tx=0x7f5a04006b10 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:00.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.324+0000 7f5a0b400640 1 -- 172.21.15.42:0/4184442881 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5a0c0639e0 con 0x7f5a140c9840 2024-09-17T01:38:00.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.556+0000 7f5a1a800640 1 -- 172.21.15.42:0/4184442881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5a1406a170 con 0x7f5a140c9840 2024-09-17T01:38:00.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.556+0000 7f5a0b400640 1 -- 172.21.15.42:0/4184442881 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v72) ==== 53+0+73 (secure 0 0 0) 0x7f5a0c0632e0 con 0x7f5a140c9840 2024-09-17T01:38:00.554 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T01:38:00.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.558+0000 7f5a1a800640 1 -- 172.21.15.42:0/4184442881 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f59f0078be0 msgr2=0x7f59f007b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:00.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.558+0000 7f5a1a800640 1 --2- 172.21.15.42:0/4184442881 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f59f0078be0 0x7f59f007b0f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5a04000c00 tx=0x7f5a04006b10 comp rx=0 tx=0).stop 2024-09-17T01:38:00.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.558+0000 7f5a1a800640 1 -- 172.21.15.42:0/4184442881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a140c9840 msgr2=0x7f5a140c9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:00.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.558+0000 7f5a1a800640 1 --2- 172.21.15.42:0/4184442881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a140c9840 0x7f5a140c9c50 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f5a140ce760 tx=0x7f5a0c00e720 comp rx=0 tx=0).stop 2024-09-17T01:38:00.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.559+0000 7f5a1a800640 1 -- 172.21.15.42:0/4184442881 shutdown_connections 2024-09-17T01:38:00.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.559+0000 7f5a1a800640 1 --2- 172.21.15.42:0/4184442881 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f59f0078be0 0x7f59f007b0f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.559+0000 7f5a1a800640 1 --2- 172.21.15.42:0/4184442881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a140cbc40 0x7f5a141f5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.559+0000 7f5a1a800640 1 --2- 172.21.15.42:0/4184442881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a140c9840 0x7f5a140c9c50 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.559+0000 7f5a1a800640 1 --2- 172.21.15.42:0/4184442881 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f59f8004800 0x7f5a1406ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.559+0000 7f5a1a800640 1 -- 172.21.15.42:0/4184442881 >> 172.21.15.42:0/4184442881 conn(0x7f5a140b2930 msgr2=0x7f5a14073bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.559+0000 7f5a1a800640 1 -- 172.21.15.42:0/4184442881 shutdown_connections 2024-09-17T01:38:00.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00.559+0000 7f5a1a800640 1 -- 172.21.15.42:0/4184442881 wait complete. 2024-09-17T01:38:00.578 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T01:38:00.578 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:38:00.578 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-09-17T01:38:00.578 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T01:38:00.578 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:38:00.578 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T01:38:00.578 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T01:38:00.578 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:38:00.579 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:38:00.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:38:00.579 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-09-17T01:38:00.614 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:38:00.614 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:38:00.614 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:38:00.614 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:38:00.614 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-17T01:38:00.614 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:38:00.615 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:38:00.615 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-09-17T01:38:00.615 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-09-17T01:38:00.615 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:38:00.615 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-09-17T01:38:00.615 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-09-17T01:38:00.615 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:38:00.615 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:38:00.615 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-09-17T01:38:00.615 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-17T01:38:00.615 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42327sec preferred_lft 42327sec 2024-09-17T01:38:00.615 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-17T01:38:00.615 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:38:00.616 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:38:00.616 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:38:00.616 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-09-17T01:38:00.616 INFO:teuthology.orchestra.run.smithi042.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T01:38:00.616 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T01:38:00.616 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T01:38:00.616 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:38:00.616 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::68d2:2bff:fe2f:191a/64 scope link 2024-09-17T01:38:00.616 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:38:00.616 INFO:teuthology.orchestra.run.smithi042.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:38:00.616 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether e2:73:3e:9b:8a:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:38:00.616 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::e073:3eff:fe9b:8a00/64 scope link 2024-09-17T01:38:00.616 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:38:00.617 INFO:teuthology.orchestra.run.smithi042.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:38:00.617 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T01:38:00.617 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::240b:bfff:feb7:6e5b/64 scope link 2024-09-17T01:38:00.617 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:38:00.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:38:00.618 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:38:00.712 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-17T01:38:00.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:38:00.715 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-09-17T01:38:00.752 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-09-17T01:38:00.752 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:38:00.752 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-17T01:38:00.752 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-17T01:38:00.752 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:38:00.753 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:38:00.753 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:38:00.753 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T01:38:00.753 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T01:38:00.753 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T01:38:00.753 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:38:00.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:38:00.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:38:00.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:38:00.950 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-17T01:38:00.985 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T01:38:00.985 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T01:38:00.986 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:38:00.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:38:00.986 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-09-17T01:38:01.083 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:38:01.083 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T01:38:01.118 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:38:01.118 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:38:01.118 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:38:01.193 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T01:38:01.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:38:01.194 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:38:01.395 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:38:01.395 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:38:01.395 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:38:01.415 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:38:01.415 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:38:01.415 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:38:01.415 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:38:01.415 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:38:01.448 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:38:01.448 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:38:01.448 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:38:01.448 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:38:01.448 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:38:01.448 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-09-17T01:38:01.449 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-09-17T01:38:01.449 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fea1c88c-cb05-432f-a745-f9dcbb5f2503" will pass to kernel 2024-09-17T01:38:01.449 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T01:38:01.449 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-09-17T01:38:01.449 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T01:38:01.449 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T01:38:01.450 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T01:38:01.452 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T01:38:01.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:38:01.453 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:38:01.510 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:38:01.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:38:01.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:38:01.606 INFO:teuthology.orchestra.run.smithi042.stdout:client7323 2024-09-17T01:38:01.606 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:38:01.607 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:38:01.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:38:01.642 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-09-17T01:38:01.725 DEBUG:teuthology.orchestra.run.smithi042:> stdin-killer -- python3 -c ' 2024-09-17T01:38:01.725 DEBUG:teuthology.orchestra.run.smithi042:> import os 2024-09-17T01:38:01.725 DEBUG:teuthology.orchestra.run.smithi042:> import stat 2024-09-17T01:38:01.725 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:38:01.725 DEBUG:teuthology.orchestra.run.smithi042:> print(os.stat("/home/ubuntu/cephtest/mnt.0/testdir").st_ino) 2024-09-17T01:38:01.726 DEBUG:teuthology.orchestra.run.smithi042:> ' 2024-09-17T01:38:01.866 INFO:teuthology.orchestra.run.smithi042.stdout:1099511627776 2024-09-17T01:38:01.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:38:01.878 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:38:02.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.150+0000 7ff601600640 1 -- 172.21.15.42:0/3017212954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5fc15b680 msgr2=0x7ff5fc15fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:02.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.150+0000 7ff601600640 1 --2- 172.21.15.42:0/3017212954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5fc15b680 0x7ff5fc15fcc0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec005fd0 tx=0x7ff5ec02a5d0 comp rx=0 tx=0).stop 2024-09-17T01:38:02.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.150+0000 7ff601600640 1 -- 172.21.15.42:0/3017212954 shutdown_connections 2024-09-17T01:38:02.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.150+0000 7ff601600640 1 --2- 172.21.15.42:0/3017212954 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5fc15f830 0x7ff5fc06e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:02.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.150+0000 7ff601600640 1 --2- 172.21.15.42:0/3017212954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5fc15b680 0x7ff5fc15fcc0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:02.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.150+0000 7ff601600640 1 -- 172.21.15.42:0/3017212954 >> 172.21.15.42:0/3017212954 conn(0x7ff5fc0b25f0 msgr2=0x7ff5fc0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:02.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.150+0000 7ff601600640 1 -- 172.21.15.42:0/3017212954 shutdown_connections 2024-09-17T01:38:02.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.150+0000 7ff601600640 1 -- 172.21.15.42:0/3017212954 wait complete. 2024-09-17T01:38:02.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.152+0000 7ff601600640 1 Processor -- start 2024-09-17T01:38:02.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.152+0000 7ff601600640 1 -- start start 2024-09-17T01:38:02.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.154+0000 7ff601600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5fc0cafe0 0x7ff5fc15e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:02.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.154+0000 7ff601600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5fc15b680 0x7ff5fc0ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:02.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.154+0000 7ff601600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5fc150440 0x7ff5fc0721c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:02.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.154+0000 7ff601600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc06f530 con 0x7ff5fc0cafe0 2024-09-17T01:38:02.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.154+0000 7ff601600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc06f3b0 con 0x7ff5fc150440 2024-09-17T01:38:02.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.154+0000 7ff601600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff5fc06f6b0 con 0x7ff5fc15b680 2024-09-17T01:38:02.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.154+0000 7ff5fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5fc0cafe0 0x7ff5fc15e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:02.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.154+0000 7ff5fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5fc0cafe0 0x7ff5fc15e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53826/0 (socket says 172.21.15.42:53826) 2024-09-17T01:38:02.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.154+0000 7ff5fbe00640 1 -- 172.21.15.42:0/4137211922 learned_addr learned my addr 172.21.15.42:0/4137211922 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:02.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.154+0000 7ff5fb400640 1 --2- 172.21.15.42:0/4137211922 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5fc15b680 0x7ff5fc0ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:02.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.154+0000 7ff600c00640 1 --2- 172.21.15.42:0/4137211922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5fc150440 0x7ff5fc0721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:02.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.155+0000 7ff5fbe00640 1 -- 172.21.15.42:0/4137211922 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5fc15b680 msgr2=0x7ff5fc0ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:02.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.155+0000 7ff5fbe00640 1 --2- 172.21.15.42:0/4137211922 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5fc15b680 0x7ff5fc0ae9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:02.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.155+0000 7ff5fbe00640 1 -- 172.21.15.42:0/4137211922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5fc150440 msgr2=0x7ff5fc0721c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:02.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.155+0000 7ff5fbe00640 1 --2- 172.21.15.42:0/4137211922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5fc150440 0x7ff5fc0721c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:02.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.155+0000 7ff5fbe00640 1 -- 172.21.15.42:0/4137211922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5fc15ea00 con 0x7ff5fc0cafe0 2024-09-17T01:38:02.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.155+0000 7ff600c00640 1 --2- 172.21.15.42:0/4137211922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5fc150440 0x7ff5fc0721c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:02.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.155+0000 7ff5fbe00640 1 --2- 172.21.15.42:0/4137211922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5fc0cafe0 0x7ff5fc15e3b0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec034040 tx=0x7ff5ec0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:02.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.155+0000 7ff5f3e00640 1 -- 172.21.15.42:0/4137211922 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec03e030 con 0x7ff5fc0cafe0 2024-09-17T01:38:02.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.155+0000 7ff5f3e00640 1 -- 172.21.15.42:0/4137211922 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5ec003ca0 con 0x7ff5fc0cafe0 2024-09-17T01:38:02.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.155+0000 7ff601600640 1 -- 172.21.15.42:0/4137211922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5fc074290 con 0x7ff5fc0cafe0 2024-09-17T01:38:02.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.155+0000 7ff5f3e00640 1 -- 172.21.15.42:0/4137211922 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec035040 con 0x7ff5fc0cafe0 2024-09-17T01:38:02.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.155+0000 7ff601600640 1 -- 172.21.15.42:0/4137211922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5fc074850 con 0x7ff5fc0cafe0 2024-09-17T01:38:02.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.156+0000 7ff601600640 1 -- 172.21.15.42:0/4137211922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5fc06fbd0 con 0x7ff5fc0cafe0 2024-09-17T01:38:02.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.158+0000 7ff5f3e00640 1 -- 172.21.15.42:0/4137211922 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff5ec041030 con 0x7ff5fc0cafe0 2024-09-17T01:38:02.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.159+0000 7ff5f3e00640 1 --2- 172.21.15.42:0/4137211922 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff5dc078b90 0x7ff5dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:02.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.159+0000 7ff5f3e00640 1 -- 172.21.15.42:0/4137211922 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7ff5ec0bb3f0 con 0x7ff5fc0cafe0 2024-09-17T01:38:02.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.159+0000 7ff5fb400640 1 --2- 172.21.15.42:0/4137211922 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff5dc078b90 0x7ff5dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:02.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.160+0000 7ff5fb400640 1 --2- 172.21.15.42:0/4137211922 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff5dc078b90 0x7ff5dc07b0a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc09e5e0 tx=0x7ff5e8009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:02.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.163+0000 7ff5f3e00640 1 -- 172.21.15.42:0/4137211922 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff5ec083790 con 0x7ff5fc0cafe0 2024-09-17T01:38:02.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.399+0000 7ff601600640 1 -- 172.21.15.42:0/4137211922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5fc15aab0 con 0x7ff5fc0cafe0 2024-09-17T01:38:02.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.399+0000 7ff5f3e00640 1 -- 172.21.15.42:0/4137211922 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5213 (secure 0 0 0) 0x7ff5ec083090 con 0x7ff5fc0cafe0 2024-09-17T01:38:02.397 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:38:02.397 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":72,"btime":"2024-09-17T01:37:56:325204+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6853,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/80987986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":80987986},{"type":"v1","addr":"172.21.15.43:6836","nonce":80987986}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":6856,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/540363900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":540363900},{"type":"v1","addr":"172.21.15.43:6837","nonce":540363900}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67},{"gid":7188,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/440158485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":440158485},{"type":"v1","addr":"172.21.15.42:6833","nonce":440158485}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:37:52.812411+0000","modified":"2024-09-17T01:37:55.835132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7191},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7191":{"gid":7191,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3687871500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3687871500},{"type":"v1","addr":"172.21.15.42:6835","nonce":3687871500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7191,"qdb_cluster":[7191]},"id":6}]} 2024-09-17T01:38:02.398 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 72 2024-09-17T01:38:02.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.402+0000 7ff601600640 1 -- 172.21.15.42:0/4137211922 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff5dc078b90 msgr2=0x7ff5dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:02.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.402+0000 7ff601600640 1 --2- 172.21.15.42:0/4137211922 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff5dc078b90 0x7ff5dc07b0a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc09e5e0 tx=0x7ff5e8009040 comp rx=0 tx=0).stop 2024-09-17T01:38:02.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.402+0000 7ff601600640 1 -- 172.21.15.42:0/4137211922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5fc0cafe0 msgr2=0x7ff5fc15e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:02.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.402+0000 7ff601600640 1 --2- 172.21.15.42:0/4137211922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5fc0cafe0 0x7ff5fc15e3b0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec034040 tx=0x7ff5ec0038a0 comp rx=0 tx=0).stop 2024-09-17T01:38:02.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.402+0000 7ff601600640 1 -- 172.21.15.42:0/4137211922 shutdown_connections 2024-09-17T01:38:02.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.402+0000 7ff601600640 1 --2- 172.21.15.42:0/4137211922 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff5dc078b90 0x7ff5dc07b0a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:02.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.402+0000 7ff601600640 1 --2- 172.21.15.42:0/4137211922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5fc150440 0x7ff5fc0721c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:02.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.402+0000 7ff601600640 1 --2- 172.21.15.42:0/4137211922 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5fc15b680 0x7ff5fc0ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:02.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.402+0000 7ff601600640 1 --2- 172.21.15.42:0/4137211922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5fc0cafe0 0x7ff5fc15e3b0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:02.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.402+0000 7ff601600640 1 -- 172.21.15.42:0/4137211922 >> 172.21.15.42:0/4137211922 conn(0x7ff5fc0b25f0 msgr2=0x7ff5fc0b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:02.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.402+0000 7ff601600640 1 -- 172.21.15.42:0/4137211922 shutdown_connections 2024-09-17T01:38:02.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02.402+0000 7ff601600640 1 -- 172.21.15.42:0/4137211922 wait complete. 2024-09-17T01:38:02.422 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-17T01:38:02.666 INFO:teuthology.orchestra.run.smithi042.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-17T01:38:01.722675+0000","btime":"2024-09-17T01:38:01.722675+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-17T01:38:01.722675+0000","atime":"2024-09-17T01:38:01.722675+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","type":"iauth","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","type":"ixattr","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":7323,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":7323,"want_loner":7323,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-17T01:38:02.666 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-17T01:38:01.722675+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "iauth", "xlock_by": {} }, "backtrace_version": 2, "btime": "2024-09-17T01:38:01.722675+0000", "change_attr": 0, "client_caps": [ { "client_id": 7323, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-09-17T01:38:01.722675+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1333, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 7323, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-17T01:38:01.722675+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 7323, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ixattr", "xlock_by": {} }, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-17T01:38:02.667 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:38:02.667 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:38:02.703 DEBUG:teuthology.orchestra.run.smithi042:> stdin-killer -- python3 -c ' 2024-09-17T01:38:02.703 DEBUG:teuthology.orchestra.run.smithi042:> import os 2024-09-17T01:38:02.703 DEBUG:teuthology.orchestra.run.smithi042:> import uuid 2024-09-17T01:38:02.703 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:38:02.703 DEBUG:teuthology.orchestra.run.smithi042:> n = 21 2024-09-17T01:38:02.703 DEBUG:teuthology.orchestra.run.smithi042:> create_hard_links = False 2024-09-17T01:38:02.703 DEBUG:teuthology.orchestra.run.smithi042:> if 0 > 0: 2024-09-17T01:38:02.703 DEBUG:teuthology.orchestra.run.smithi042:> create_hard_links = True 2024-09-17T01:38:02.703 DEBUG:teuthology.orchestra.run.smithi042:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file" 2024-09-17T01:38:02.703 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:38:02.703 DEBUG:teuthology.orchestra.run.smithi042:> dpath = os.path.dirname(path) 2024-09-17T01:38:02.703 DEBUG:teuthology.orchestra.run.smithi042:> fnameprefix = os.path.basename(path) 2024-09-17T01:38:02.704 DEBUG:teuthology.orchestra.run.smithi042:> os.makedirs(dpath, exist_ok=True) 2024-09-17T01:38:02.704 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:38:02.704 DEBUG:teuthology.orchestra.run.smithi042:> try: 2024-09-17T01:38:02.704 DEBUG:teuthology.orchestra.run.smithi042:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-17T01:38:02.704 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:38:02.704 DEBUG:teuthology.orchestra.run.smithi042:> for i in range(n): 2024-09-17T01:38:02.704 DEBUG:teuthology.orchestra.run.smithi042:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-17T01:38:02.704 DEBUG:teuthology.orchestra.run.smithi042:> with open(fpath, '"'"'w'"'"') as f: 2024-09-17T01:38:02.704 DEBUG:teuthology.orchestra.run.smithi042:> f.write(f"{i}") 2024-09-17T01:38:02.704 DEBUG:teuthology.orchestra.run.smithi042:> if False: 2024-09-17T01:38:02.704 DEBUG:teuthology.orchestra.run.smithi042:> f.flush() 2024-09-17T01:38:02.704 DEBUG:teuthology.orchestra.run.smithi042:> os.fsync(f.fileno()) 2024-09-17T01:38:02.704 DEBUG:teuthology.orchestra.run.smithi042:> if False: 2024-09-17T01:38:02.704 DEBUG:teuthology.orchestra.run.smithi042:> os.unlink(fpath) 2024-09-17T01:38:02.705 DEBUG:teuthology.orchestra.run.smithi042:> if False: 2024-09-17T01:38:02.705 DEBUG:teuthology.orchestra.run.smithi042:> os.fsync(dirfd) 2024-09-17T01:38:02.705 DEBUG:teuthology.orchestra.run.smithi042:> if create_hard_links: 2024-09-17T01:38:02.705 DEBUG:teuthology.orchestra.run.smithi042:> for j in range(0): 2024-09-17T01:38:02.705 DEBUG:teuthology.orchestra.run.smithi042:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-17T01:38:02.705 DEBUG:teuthology.orchestra.run.smithi042:> if False: 2024-09-17T01:38:02.705 DEBUG:teuthology.orchestra.run.smithi042:> os.fsync(dirfd) 2024-09-17T01:38:02.705 DEBUG:teuthology.orchestra.run.smithi042:> finally: 2024-09-17T01:38:02.705 DEBUG:teuthology.orchestra.run.smithi042:> os.close(dirfd) 2024-09-17T01:38:02.705 DEBUG:teuthology.orchestra.run.smithi042:> ' 2024-09-17T01:38:02.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:38:02.886 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:38:02.886 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:38:02.963 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:38:02.963 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:38:03.038 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T01:38:03.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.316+0000 7fb163200640 1 -- 172.21.15.42:0/3737024168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb16415b680 msgr2=0x7fb16415fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:03.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.316+0000 7fb163200640 1 --2- 172.21.15.42:0/3737024168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb16415b680 0x7fb16415fcc0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fb154005fd0 tx=0x7fb15402a5d0 comp rx=0 tx=0).stop 2024-09-17T01:38:03.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.316+0000 7fb163200640 1 -- 172.21.15.42:0/3737024168 shutdown_connections 2024-09-17T01:38:03.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.316+0000 7fb163200640 1 --2- 172.21.15.42:0/3737024168 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb16415f830 0x7fb16406e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:03.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.316+0000 7fb163200640 1 --2- 172.21.15.42:0/3737024168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb16415b680 0x7fb16415fcc0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:03.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.316+0000 7fb163200640 1 -- 172.21.15.42:0/3737024168 >> 172.21.15.42:0/3737024168 conn(0x7fb1640b25f0 msgr2=0x7fb1640d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:03.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.316+0000 7fb163200640 1 -- 172.21.15.42:0/3737024168 shutdown_connections 2024-09-17T01:38:03.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.316+0000 7fb163200640 1 -- 172.21.15.42:0/3737024168 wait complete. 2024-09-17T01:38:03.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.318+0000 7fb163200640 1 Processor -- start 2024-09-17T01:38:03.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.319+0000 7fb163200640 1 -- start start 2024-09-17T01:38:03.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.320+0000 7fb163200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1640cafe0 0x7fb16414ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:03.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.320+0000 7fb163200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb16415b680 0x7fb16415d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:03.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.320+0000 7fb163200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb164073670 0x7fb164150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:03.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.320+0000 7fb163200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb16406f530 con 0x7fb16415b680 2024-09-17T01:38:03.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.320+0000 7fb163200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb16406f3b0 con 0x7fb164073670 2024-09-17T01:38:03.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.320+0000 7fb163200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb16406f6b0 con 0x7fb1640cafe0 2024-09-17T01:38:03.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.320+0000 7fb15be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb16415b680 0x7fb16415d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:03.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.320+0000 7fb15be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb16415b680 0x7fb16415d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53856/0 (socket says 172.21.15.42:53856) 2024-09-17T01:38:03.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.320+0000 7fb15be00640 1 -- 172.21.15.42:0/3284723225 learned_addr learned my addr 172.21.15.42:0/3284723225 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:03.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.321+0000 7fb161e00640 1 --2- 172.21.15.42:0/3284723225 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1640cafe0 0x7fb16414ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:03.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.321+0000 7fb162800640 1 --2- 172.21.15.42:0/3284723225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb164073670 0x7fb164150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:03.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.321+0000 7fb15be00640 1 -- 172.21.15.42:0/3284723225 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1640cafe0 msgr2=0x7fb16414ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:03.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.321+0000 7fb15be00640 1 --2- 172.21.15.42:0/3284723225 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1640cafe0 0x7fb16414ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:03.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.321+0000 7fb15be00640 1 -- 172.21.15.42:0/3284723225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb164073670 msgr2=0x7fb164150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:03.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.321+0000 7fb15be00640 1 --2- 172.21.15.42:0/3284723225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb164073670 0x7fb164150040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:03.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.321+0000 7fb15be00640 1 -- 172.21.15.42:0/3284723225 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1641f6990 con 0x7fb16415b680 2024-09-17T01:38:03.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.321+0000 7fb161e00640 1 --2- 172.21.15.42:0/3284723225 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1640cafe0 0x7fb16414ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:03.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.321+0000 7fb15be00640 1 --2- 172.21.15.42:0/3284723225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb16415b680 0x7fb16415d100 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00c3d0 tx=0x7fb14c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:03.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.322+0000 7fb15a000640 1 -- 172.21.15.42:0/3284723225 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14c017070 con 0x7fb16415b680 2024-09-17T01:38:03.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.322+0000 7fb15a000640 1 -- 172.21.15.42:0/3284723225 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb14c0053c0 con 0x7fb16415b680 2024-09-17T01:38:03.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.322+0000 7fb15a000640 1 -- 172.21.15.42:0/3284723225 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14c003850 con 0x7fb16415b680 2024-09-17T01:38:03.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.322+0000 7fb163200640 1 -- 172.21.15.42:0/3284723225 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1641f6c70 con 0x7fb16415b680 2024-09-17T01:38:03.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.322+0000 7fb163200640 1 -- 172.21.15.42:0/3284723225 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1641f7230 con 0x7fb16415b680 2024-09-17T01:38:03.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.323+0000 7fb163200640 1 -- 172.21.15.42:0/3284723225 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb16406fbd0 con 0x7fb16415b680 2024-09-17T01:38:03.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.324+0000 7fb15a000640 1 -- 172.21.15.42:0/3284723225 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb14c01a070 con 0x7fb16415b680 2024-09-17T01:38:03.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.325+0000 7fb15a000640 1 --2- 172.21.15.42:0/3284723225 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb140078bc0 0x7fb14007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:03.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.325+0000 7fb15a000640 1 -- 172.21.15.42:0/3284723225 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fb14c09a0e0 con 0x7fb16415b680 2024-09-17T01:38:03.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.326+0000 7fb161e00640 1 --2- 172.21.15.42:0/3284723225 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb140078bc0 0x7fb14007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:03.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.327+0000 7fb161e00640 1 --2- 172.21.15.42:0/3284723225 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb140078bc0 0x7fb14007b0d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb154033000 tx=0x7fb154004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:03.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.330+0000 7fb15a000640 1 -- 172.21.15.42:0/3284723225 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb14c062510 con 0x7fb16415b680 2024-09-17T01:38:03.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.539+0000 7fb163200640 1 -- 172.21.15.42:0/3284723225 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb16409e3f0 con 0x7fb16415b680 2024-09-17T01:38:03.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.539+0000 7fb15a000640 1 -- 172.21.15.42:0/3284723225 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v93) ==== 80+0+0 (secure 0 0 0) 0x7fb14c061e10 con 0x7fb16415b680 2024-09-17T01:38:03.537 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-17T01:38:03.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.541+0000 7fb163200640 1 -- 172.21.15.42:0/3284723225 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb140078bc0 msgr2=0x7fb14007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:03.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.541+0000 7fb163200640 1 --2- 172.21.15.42:0/3284723225 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb140078bc0 0x7fb14007b0d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb154033000 tx=0x7fb154004730 comp rx=0 tx=0).stop 2024-09-17T01:38:03.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.541+0000 7fb163200640 1 -- 172.21.15.42:0/3284723225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb16415b680 msgr2=0x7fb16415d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:03.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.541+0000 7fb163200640 1 --2- 172.21.15.42:0/3284723225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb16415b680 0x7fb16415d100 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00c3d0 tx=0x7fb14c00c890 comp rx=0 tx=0).stop 2024-09-17T01:38:03.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.541+0000 7fb163200640 1 -- 172.21.15.42:0/3284723225 shutdown_connections 2024-09-17T01:38:03.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.541+0000 7fb163200640 1 --2- 172.21.15.42:0/3284723225 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb140078bc0 0x7fb14007b0d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:03.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.541+0000 7fb163200640 1 --2- 172.21.15.42:0/3284723225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb164073670 0x7fb164150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:03.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.541+0000 7fb163200640 1 --2- 172.21.15.42:0/3284723225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb16415b680 0x7fb16415d100 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:03.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.541+0000 7fb163200640 1 --2- 172.21.15.42:0/3284723225 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1640cafe0 0x7fb16414ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:03.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.541+0000 7fb163200640 1 -- 172.21.15.42:0/3284723225 >> 172.21.15.42:0/3284723225 conn(0x7fb1640b25f0 msgr2=0x7fb1640b0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:03.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.542+0000 7fb163200640 1 -- 172.21.15.42:0/3284723225 shutdown_connections 2024-09-17T01:38:03.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:03.542+0000 7fb163200640 1 -- 172.21.15.42:0/3284723225 wait complete. 2024-09-17T01:38:03.562 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T01:38:03.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:38:03.563 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T01:38:03.686 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:38:03.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:38:03.686 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T01:38:03.729 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2024-09-17T01:38:03.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.000+0000 7fe775a00640 1 -- 172.21.15.42:0/460159014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe77006d430 msgr2=0x7fe77006d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:03.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.000+0000 7fe775a00640 1 --2- 172.21.15.42:0/460159014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe77006d430 0x7fe77006d840 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fe7700b3100 tx=0x7fe76802aa50 comp rx=0 tx=0).stop 2024-09-17T01:38:03.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.000+0000 7fe775a00640 1 -- 172.21.15.42:0/460159014 shutdown_connections 2024-09-17T01:38:03.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.000+0000 7fe775a00640 1 --2- 172.21.15.42:0/460159014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe77006d430 0x7fe77006d840 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:03.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.000+0000 7fe775a00640 1 --2- 172.21.15.42:0/460159014 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe77015cfc0 0x7fe7700ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:03.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.000+0000 7fe775a00640 1 --2- 172.21.15.42:0/460159014 >> v2:172.21.15.43:3300/0 conn(0x7fe7700b3880 0x7fe7700af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:03.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.000+0000 7fe775a00640 1 -- 172.21.15.42:0/460159014 >> 172.21.15.42:0/460159014 conn(0x7fe7700b2930 msgr2=0x7fe77006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:03.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.000+0000 7fe775a00640 1 -- 172.21.15.42:0/460159014 shutdown_connections 2024-09-17T01:38:03.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.000+0000 7fe775a00640 1 -- 172.21.15.42:0/460159014 wait complete. 2024-09-17T01:38:04.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.003+0000 7fe775a00640 1 Processor -- start 2024-09-17T01:38:04.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.003+0000 7fe775a00640 1 -- start start 2024-09-17T01:38:04.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.004+0000 7fe775a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe77006d430 0x7fe770141bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.004+0000 7fe775a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7700b3880 0x7fe770150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.004+0000 7fe775a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe77015cfc0 0x7fe770150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.004+0000 7fe775a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe77015d5e0 con 0x7fe77006d430 2024-09-17T01:38:04.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.004+0000 7fe775a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe7701605b0 con 0x7fe7700b3880 2024-09-17T01:38:04.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.004+0000 7fe775a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe770151a60 con 0x7fe77015cfc0 2024-09-17T01:38:04.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.004+0000 7fe76ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe77006d430 0x7fe770141bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.004+0000 7fe76ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe77006d430 0x7fe770141bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53866/0 (socket says 172.21.15.42:53866) 2024-09-17T01:38:04.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.004+0000 7fe76ea00640 1 -- 172.21.15.42:0/979132931 learned_addr learned my addr 172.21.15.42:0/979132931 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:04.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.005+0000 7fe766000640 1 --2- 172.21.15.42:0/979132931 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7700b3880 0x7fe770150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.005+0000 7fe76f400640 1 --2- 172.21.15.42:0/979132931 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe77015cfc0 0x7fe770150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.005+0000 7fe76ea00640 1 -- 172.21.15.42:0/979132931 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe77015cfc0 msgr2=0x7fe770150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:04.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.005+0000 7fe76ea00640 1 --2- 172.21.15.42:0/979132931 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe77015cfc0 0x7fe770150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.005+0000 7fe76ea00640 1 -- 172.21.15.42:0/979132931 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7700b3880 msgr2=0x7fe770150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:04.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.005+0000 7fe76ea00640 1 --2- 172.21.15.42:0/979132931 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7700b3880 0x7fe770150720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.005+0000 7fe76ea00640 1 -- 172.21.15.42:0/979132931 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7701567b0 con 0x7fe77006d430 2024-09-17T01:38:04.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.005+0000 7fe76ea00640 1 --2- 172.21.15.42:0/979132931 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe77006d430 0x7fe770141bf0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fe76000e7c0 tx=0x7fe76000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:04.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.005+0000 7fe767400640 1 -- 172.21.15.42:0/979132931 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76000ccc0 con 0x7fe77006d430 2024-09-17T01:38:04.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.005+0000 7fe767400640 1 -- 172.21.15.42:0/979132931 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe760010430 con 0x7fe77006d430 2024-09-17T01:38:04.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.005+0000 7fe775a00640 1 -- 172.21.15.42:0/979132931 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe77014fc40 con 0x7fe77006d430 2024-09-17T01:38:04.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.005+0000 7fe767400640 1 -- 172.21.15.42:0/979132931 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe760010860 con 0x7fe77006d430 2024-09-17T01:38:04.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.006+0000 7fe775a00640 1 -- 172.21.15.42:0/979132931 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe770150200 con 0x7fe77006d430 2024-09-17T01:38:04.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.008+0000 7fe767400640 1 -- 172.21.15.42:0/979132931 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe760010a00 con 0x7fe77006d430 2024-09-17T01:38:04.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.009+0000 7fe767400640 1 --2- 172.21.15.42:0/979132931 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe74c078b90 0x7fe74c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.009+0000 7fe767400640 1 -- 172.21.15.42:0/979132931 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fe76009b760 con 0x7fe77006d430 2024-09-17T01:38:04.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.009+0000 7fe77ca45740 1 Processor -- start 2024-09-17T01:38:04.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.010+0000 7fe77ca45740 1 -- start start 2024-09-17T01:38:04.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.010+0000 7fe766000640 1 --2- 172.21.15.42:0/979132931 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe74c078b90 0x7fe74c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.010+0000 7fe766000640 1 --2- 172.21.15.42:0/979132931 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe74c078b90 0x7fe74c07b0a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe77014e2e0 tx=0x7fe758005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:04.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.011+0000 7fe77ca45740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55de2ec25390 0x55de2efe6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.011+0000 7fe77ca45740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ebfc4d0 0x55de2f0120f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.011+0000 7fe77ca45740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de2ec046b0 0x55de2eff3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.011+0000 7fe77ca45740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55de2ef2c1c0 con 0x55de2ebfc4d0 2024-09-17T01:38:04.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.011+0000 7fe77ca45740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55de2ef3f870 con 0x55de2ec046b0 2024-09-17T01:38:04.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.011+0000 7fe77ca45740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55de2ef2eca0 con 0x55de2ec25390 2024-09-17T01:38:04.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.011+0000 7fe766000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ebfc4d0 0x55de2f0120f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.011+0000 7fe766000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ebfc4d0 0x55de2f0120f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53876/0 (socket says 172.21.15.42:53876) 2024-09-17T01:38:04.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.011+0000 7fe766000640 1 -- 172.21.15.42:0/1887224111 learned_addr learned my addr 172.21.15.42:0/1887224111 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:04.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.011+0000 7fe76ea00640 1 --2- 172.21.15.42:0/1887224111 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55de2ec25390 0x55de2efe6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.011+0000 7fe76f400640 1 --2- 172.21.15.42:0/1887224111 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de2ec046b0 0x55de2eff3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.012+0000 7fe766000640 1 -- 172.21.15.42:0/1887224111 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55de2ec25390 msgr2=0x55de2efe6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:04.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.012+0000 7fe766000640 1 --2- 172.21.15.42:0/1887224111 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55de2ec25390 0x55de2efe6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.012+0000 7fe766000640 1 -- 172.21.15.42:0/1887224111 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de2ec046b0 msgr2=0x55de2eff3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:04.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.012+0000 7fe766000640 1 --2- 172.21.15.42:0/1887224111 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de2ec046b0 0x55de2eff3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.012+0000 7fe766000640 1 -- 172.21.15.42:0/1887224111 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de2ed077d0 con 0x55de2ebfc4d0 2024-09-17T01:38:04.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.012+0000 7fe76ea00640 1 --2- 172.21.15.42:0/1887224111 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55de2ec25390 0x55de2efe6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:38:04.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.012+0000 7fe766000640 1 --2- 172.21.15.42:0/1887224111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ebfc4d0 0x55de2f0120f0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fe758011ec0 tx=0x7fe758014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ebb2399a55079b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:04.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.012+0000 7fe75f400640 1 -- 172.21.15.42:0/1887224111 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe758012e60 con 0x55de2ebfc4d0 2024-09-17T01:38:04.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.013+0000 7fe75f400640 1 -- 172.21.15.42:0/1887224111 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe758004310 con 0x55de2ebfc4d0 2024-09-17T01:38:04.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.013+0000 7fe75f400640 1 -- 172.21.15.42:0/1887224111 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe758003850 con 0x55de2ebfc4d0 2024-09-17T01:38:04.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.013+0000 7fe77ca45740 1 -- 172.21.15.42:0/1887224111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ebfc4d0 msgr2=0x55de2f0120f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:04.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.013+0000 7fe77ca45740 1 --2- 172.21.15.42:0/1887224111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ebfc4d0 0x55de2f0120f0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fe758011ec0 tx=0x7fe758014000 comp rx=0 tx=0).stop 2024-09-17T01:38:04.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.013+0000 7fe77ca45740 1 -- 172.21.15.42:0/1887224111 shutdown_connections 2024-09-17T01:38:04.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.013+0000 7fe77ca45740 1 --2- 172.21.15.42:0/1887224111 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de2ec046b0 0x55de2eff3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.013+0000 7fe77ca45740 1 --2- 172.21.15.42:0/1887224111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ebfc4d0 0x55de2f0120f0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.013+0000 7fe77ca45740 1 --2- 172.21.15.42:0/1887224111 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55de2ec25390 0x55de2efe6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.013+0000 7fe77ca45740 1 -- 172.21.15.42:0/1887224111 >> 172.21.15.42:0/1887224111 conn(0x55de2ec194e0 msgr2=0x55de2efcc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:04.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.014+0000 7fe77ca45740 1 -- 172.21.15.42:0/1887224111 shutdown_connections 2024-09-17T01:38:04.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.014+0000 7fe77ca45740 1 -- 172.21.15.42:0/1887224111 wait complete. 2024-09-17T01:38:04.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.015+0000 7fe77ca45740 1 -- start start 2024-09-17T01:38:04.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.015+0000 7fe77ca45740 1 Processor -- start 2024-09-17T01:38:04.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.016+0000 7fe77ca45740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de2ebfc4d0 0x55de2efe4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.016+0000 7fe77ca45740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55de2ec046b0 0x55de2f027d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.016+0000 7fe77ca45740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ec25390 0x55de2f009620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.016+0000 7fe77ca45740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55de2eed5410 con 0x55de2ec25390 2024-09-17T01:38:04.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.016+0000 7fe77ca45740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55de2ef32ab0 con 0x55de2ebfc4d0 2024-09-17T01:38:04.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.016+0000 7fe77ca45740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55de2ec9f740 con 0x55de2ec046b0 2024-09-17T01:38:04.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.016+0000 7fe77ca45740 10 client.0 _ll_register_callbacks cb 0x55de2eeb2360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:38:04.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.017+0000 7fe76f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ec25390 0x55de2f009620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.017+0000 7fe76f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ec25390 0x55de2f009620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53878/0 (socket says 172.21.15.42:53878) 2024-09-17T01:38:04.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.017+0000 7fe76f400640 1 -- 172.21.15.42:0/2436817572 learned_addr learned my addr 172.21.15.42:0/2436817572 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:04.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.017+0000 7fe76ea00640 1 --2- 172.21.15.42:0/2436817572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de2ebfc4d0 0x55de2efe4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.017+0000 7fe766000640 1 --2- 172.21.15.42:0/2436817572 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55de2ec046b0 0x55de2f027d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.017+0000 7fe76f400640 1 -- 172.21.15.42:0/2436817572 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55de2ec046b0 msgr2=0x55de2f027d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:04.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.017+0000 7fe76f400640 1 --2- 172.21.15.42:0/2436817572 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55de2ec046b0 0x55de2f027d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.017+0000 7fe76f400640 1 -- 172.21.15.42:0/2436817572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de2ebfc4d0 msgr2=0x55de2efe4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:04.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.017+0000 7fe76f400640 1 --2- 172.21.15.42:0/2436817572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de2ebfc4d0 0x55de2efe4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.017+0000 7fe76f400640 1 -- 172.21.15.42:0/2436817572 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de2ec90970 con 0x55de2ec25390 2024-09-17T01:38:04.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.018+0000 7fe76f400640 1 --2- 172.21.15.42:0/2436817572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ec25390 0x55de2f009620 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fe7680094e0 tx=0x7fe768003e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6af78bb198424a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:04.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.018+0000 7fe753e00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:38:04.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.018+0000 7fe753e00640 1 -- 172.21.15.42:0/2436817572 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768048060 con 0x55de2ec25390 2024-09-17T01:38:04.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.018+0000 7fe77ca45740 1 -- 172.21.15.42:0/2436817572 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe758004310 con 0x55de2ec25390 2024-09-17T01:38:04.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.018+0000 7fe753e00640 1 -- 172.21.15.42:0/2436817572 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fe76802fd70 con 0x55de2ec25390 2024-09-17T01:38:04.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.018+0000 7fe753e00640 1 -- 172.21.15.42:0/2436817572 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7fe76804e050 con 0x55de2ec25390 2024-09-17T01:38:04.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.018+0000 7fe77ca45740 10 client.7350 fetch_fsmap learned FSMap version 72 2024-09-17T01:38:04.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.018+0000 7fe77ca45740 1 -- 172.21.15.42:0/2436817572 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) -- 0x55de2ec6e6a0 con 0x55de2ec25390 2024-09-17T01:38:04.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.018+0000 7fe753e00640 1 -- 172.21.15.42:0/2436817572 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe758004310 con 0x55de2ec25390 2024-09-17T01:38:04.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.019+0000 7fe753e00640 1 -- 172.21.15.42:0/2436817572 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 72) ==== 3502+0+0 (secure 0 0 0) 0x7fe768051020 con 0x55de2ec25390 2024-09-17T01:38:04.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.019+0000 7fe77ca45740 10 client.7350 fetch_fsmap finished waiting for FSMap version 72 2024-09-17T01:38:04.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.019+0000 7fe77ca45740 10 client.7350 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T01:38:04.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.019+0000 7fe77ca45740 20 client.7350 populate_metadata read hostname 'smithi042' 2024-09-17T01:38:04.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.019+0000 7fe77ca45740 1 --2- 172.21.15.42:0/2436817572 >> [v2:172.21.15.42:6834/3687871500,v1:172.21.15.42:6835/3687871500] conn(0x55de2ebe3f60 0x55de2f008050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.019+0000 7fe77ca45740 4 client.7350 mds_command: new command op to 7191 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:38:04.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.019+0000 7fe77ca45740 1 -- 172.21.15.42:0/2436817572 --> [v2:172.21.15.42:6834/3687871500,v1:172.21.15.42:6835/3687871500] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de2ef417c0 con 0x55de2ebe3f60 2024-09-17T01:38:04.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.019+0000 7fe76ea00640 1 --2- 172.21.15.42:0/2436817572 >> [v2:172.21.15.42:6834/3687871500,v1:172.21.15.42:6835/3687871500] conn(0x55de2ebe3f60 0x55de2f008050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.019+0000 7fe76ea00640 1 --2- 172.21.15.42:0/2436817572 >> [v2:172.21.15.42:6834/3687871500,v1:172.21.15.42:6835/3687871500] conn(0x55de2ebe3f60 0x55de2f008050 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b1d28b542440906 server_cookie=c319811f72758892 in_seq=0 out_seq=0 2024-09-17T01:38:04.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.019+0000 7fe753e00640 10 client.7350 ms_handle_connect on v2:172.21.15.42:6834/3687871500 2024-09-17T01:38:04.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.020+0000 7fe753e00640 1 -- 172.21.15.42:0/2436817572 <== mds.0 v2:172.21.15.42:6834/3687871500 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55de2ef417c0 con 0x55de2ebe3f60 2024-09-17T01:38:04.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.020+0000 7fe753e00640 10 client.7350 handle_command_reply: tid=0 2024-09-17T01:38:04.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.020+0000 7fe77ca45740 1 client.7350 shutdown 2024-09-17T01:38:04.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.020+0000 7fe77ca45740 1 -- 172.21.15.42:0/2436817572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ec25390 msgr2=0x55de2f009620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:04.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.020+0000 7fe77ca45740 1 --2- 172.21.15.42:0/2436817572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ec25390 0x55de2f009620 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fe7680094e0 tx=0x7fe768003e70 comp rx=0 tx=0).stop 2024-09-17T01:38:04.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.021+0000 7fe77ca45740 1 -- 172.21.15.42:0/2436817572 shutdown_connections 2024-09-17T01:38:04.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.021+0000 7fe77ca45740 1 --2- 172.21.15.42:0/2436817572 >> [v2:172.21.15.42:6834/3687871500,v1:172.21.15.42:6835/3687871500] conn(0x55de2ebe3f60 0x55de2f008050 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.021+0000 7fe77ca45740 1 --2- 172.21.15.42:0/2436817572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ec25390 0x55de2f009620 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.021+0000 7fe77ca45740 1 --2- 172.21.15.42:0/2436817572 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55de2ec046b0 0x55de2f027d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.021+0000 7fe77ca45740 1 --2- 172.21.15.42:0/2436817572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de2ebfc4d0 0x55de2efe4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.021+0000 7fe753e00640 0 client.7350 ms_handle_reset on v2:172.21.15.42:6834/3687871500 2024-09-17T01:38:04.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.021+0000 7fe77ca45740 1 -- 172.21.15.42:0/2436817572 >> 172.21.15.42:0/2436817572 conn(0x55de2ec194e0 msgr2=0x55de2eff3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:04.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.021+0000 7fe77ca45740 1 -- 172.21.15.42:0/2436817572 shutdown_connections 2024-09-17T01:38:04.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.021+0000 7fe77ca45740 1 -- 172.21.15.42:0/2436817572 wait complete. 2024-09-17T01:38:04.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.021+0000 7fe77ca45740 20 client.7350 trim_cache size 0 max 16384 2024-09-17T01:38:04.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.036+0000 7fe77ca45740 1 Processor -- start 2024-09-17T01:38:04.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.037+0000 7fe77ca45740 1 -- start start 2024-09-17T01:38:04.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.038+0000 7fe77ca45740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55de2ec194e0 0x55de2f007340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.038+0000 7fe77ca45740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de2ebfc4d0 0x55de2f012f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.038+0000 7fe77ca45740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ec046b0 0x55de2f0384a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.038+0000 7fe77ca45740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe77006fe00 con 0x55de2ec046b0 2024-09-17T01:38:04.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.038+0000 7fe77ca45740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe77006ee60 con 0x55de2ebfc4d0 2024-09-17T01:38:04.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.038+0000 7fe77ca45740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe77006e1c0 con 0x55de2ec194e0 2024-09-17T01:38:04.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.038+0000 7fe76f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ec046b0 0x55de2f0384a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.038+0000 7fe76f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ec046b0 0x55de2f0384a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53882/0 (socket says 172.21.15.42:53882) 2024-09-17T01:38:04.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.038+0000 7fe76f400640 1 -- 172.21.15.42:0/761846915 learned_addr learned my addr 172.21.15.42:0/761846915 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:04.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.039+0000 7fe76f400640 1 -- 172.21.15.42:0/761846915 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55de2ec194e0 msgr2=0x55de2f007340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:04.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.039+0000 7fe76f400640 1 --2- 172.21.15.42:0/761846915 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55de2ec194e0 0x55de2f007340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.039+0000 7fe76f400640 1 -- 172.21.15.42:0/761846915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de2ebfc4d0 msgr2=0x55de2f012f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:04.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.039+0000 7fe766000640 1 --2- 172.21.15.42:0/761846915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de2ebfc4d0 0x55de2f012f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.039+0000 7fe76f400640 1 --2- 172.21.15.42:0/761846915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de2ebfc4d0 0x55de2f012f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.039+0000 7fe76f400640 1 -- 172.21.15.42:0/761846915 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de2ef3ebc0 con 0x55de2ec046b0 2024-09-17T01:38:04.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.039+0000 7fe76f400640 1 --2- 172.21.15.42:0/761846915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ec046b0 0x55de2f0384a0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fe7680040f0 tx=0x7fe76802aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8306d6e05ff10eb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:04.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.039+0000 7fe75ea00640 1 -- 172.21.15.42:0/761846915 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768048070 con 0x55de2ec046b0 2024-09-17T01:38:04.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.039+0000 7fe75ea00640 1 -- 172.21.15.42:0/761846915 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe76803d020 con 0x55de2ec046b0 2024-09-17T01:38:04.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.039+0000 7fe75ea00640 1 -- 172.21.15.42:0/761846915 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768033050 con 0x55de2ec046b0 2024-09-17T01:38:04.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.040+0000 7fe77ca45740 1 -- 172.21.15.42:0/761846915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ec046b0 msgr2=0x55de2f0384a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:04.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.040+0000 7fe77ca45740 1 --2- 172.21.15.42:0/761846915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ec046b0 0x55de2f0384a0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fe7680040f0 tx=0x7fe76802aa50 comp rx=0 tx=0).stop 2024-09-17T01:38:04.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.040+0000 7fe77ca45740 1 -- 172.21.15.42:0/761846915 shutdown_connections 2024-09-17T01:38:04.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.040+0000 7fe77ca45740 1 --2- 172.21.15.42:0/761846915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de2ebfc4d0 0x55de2f012f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.040+0000 7fe77ca45740 1 --2- 172.21.15.42:0/761846915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ec046b0 0x55de2f0384a0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.040+0000 7fe77ca45740 1 --2- 172.21.15.42:0/761846915 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55de2ec194e0 0x55de2f007340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.040+0000 7fe77ca45740 1 -- 172.21.15.42:0/761846915 >> 172.21.15.42:0/761846915 conn(0x55de2efcd500 msgr2=0x55de2eff33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:04.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.040+0000 7fe77ca45740 1 -- 172.21.15.42:0/761846915 shutdown_connections 2024-09-17T01:38:04.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.040+0000 7fe77ca45740 1 -- 172.21.15.42:0/761846915 wait complete. 2024-09-17T01:38:04.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.041+0000 7fe77ca45740 1 -- start start 2024-09-17T01:38:04.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.041+0000 7fe77ca45740 1 Processor -- start 2024-09-17T01:38:04.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.043+0000 7fe77ca45740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de2ebfc4d0 0x55de2f0992c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.043+0000 7fe77ca45740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55de2ec046b0 0x55de2f08bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.043+0000 7fe77ca45740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ec194e0 0x55de2f038960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.043+0000 7fe77ca45740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55de2efc7f10 con 0x55de2ec194e0 2024-09-17T01:38:04.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.043+0000 7fe77ca45740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe77006e810 con 0x55de2ebfc4d0 2024-09-17T01:38:04.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.043+0000 7fe77ca45740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55de2f095ef0 con 0x55de2ec046b0 2024-09-17T01:38:04.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.043+0000 7fe77ca45740 10 client.0 _ll_register_callbacks cb 0x7fe758005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:38:04.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.043+0000 7fe76f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ec194e0 0x55de2f038960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.043+0000 7fe76f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ec194e0 0x55de2f038960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53886/0 (socket says 172.21.15.42:53886) 2024-09-17T01:38:04.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.043+0000 7fe76f400640 1 -- 172.21.15.42:0/296857753 learned_addr learned my addr 172.21.15.42:0/296857753 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:04.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.043+0000 7fe76ea00640 1 --2- 172.21.15.42:0/296857753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de2ebfc4d0 0x55de2f0992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.043+0000 7fe766000640 1 --2- 172.21.15.42:0/296857753 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55de2ec046b0 0x55de2f08bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.044+0000 7fe76f400640 1 -- 172.21.15.42:0/296857753 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55de2ec046b0 msgr2=0x55de2f08bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:04.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.044+0000 7fe76f400640 1 --2- 172.21.15.42:0/296857753 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55de2ec046b0 0x55de2f08bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.044+0000 7fe76f400640 1 -- 172.21.15.42:0/296857753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de2ebfc4d0 msgr2=0x55de2f0992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:04.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.044+0000 7fe76f400640 1 --2- 172.21.15.42:0/296857753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de2ebfc4d0 0x55de2f0992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.044+0000 7fe76f400640 1 -- 172.21.15.42:0/296857753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de2efcc6f0 con 0x55de2ec194e0 2024-09-17T01:38:04.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.044+0000 7fe76f400640 1 --2- 172.21.15.42:0/296857753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ec194e0 0x55de2f038960 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fe76802f840 tx=0x7fe768004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385b2002ebb986f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:04.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.044+0000 7fe753e00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:38:04.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.044+0000 7fe753e00640 1 -- 172.21.15.42:0/296857753 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768033070 con 0x55de2ec194e0 2024-09-17T01:38:04.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.044+0000 7fe753e00640 1 -- 172.21.15.42:0/296857753 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fe768038660 con 0x55de2ec194e0 2024-09-17T01:38:04.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.044+0000 7fe77ca45740 1 -- 172.21.15.42:0/296857753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe76803d020 con 0x55de2ec194e0 2024-09-17T01:38:04.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.044+0000 7fe753e00640 1 -- 172.21.15.42:0/296857753 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7fe768062050 con 0x55de2ec194e0 2024-09-17T01:38:04.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.044+0000 7fe77ca45740 10 client.7356 fetch_fsmap learned FSMap version 72 2024-09-17T01:38:04.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.044+0000 7fe77ca45740 1 -- 172.21.15.42:0/296857753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) -- 0x55de2f095c30 con 0x55de2ec194e0 2024-09-17T01:38:04.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.045+0000 7fe753e00640 1 -- 172.21.15.42:0/296857753 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe76803d020 con 0x55de2ec194e0 2024-09-17T01:38:04.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.045+0000 7fe753e00640 1 -- 172.21.15.42:0/296857753 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 72) ==== 3502+0+0 (secure 0 0 0) 0x7fe768065020 con 0x55de2ec194e0 2024-09-17T01:38:04.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.045+0000 7fe77ca45740 10 client.7356 fetch_fsmap finished waiting for FSMap version 72 2024-09-17T01:38:04.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.045+0000 7fe77ca45740 10 client.7356 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T01:38:04.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.045+0000 7fe77ca45740 20 client.7356 populate_metadata read hostname 'smithi042' 2024-09-17T01:38:04.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.045+0000 7fe77ca45740 1 --2- 172.21.15.42:0/296857753 >> [v2:172.21.15.42:6834/3687871500,v1:172.21.15.42:6835/3687871500] conn(0x55de2ebb93a0 0x55de2f095320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.045+0000 7fe77ca45740 4 client.7356 mds_command: new command op to 7191 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-17T01:38:04.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.045+0000 7fe77ca45740 1 -- 172.21.15.42:0/296857753 --> [v2:172.21.15.42:6834/3687871500,v1:172.21.15.42:6835/3687871500] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55de2f00a4c0 con 0x55de2ebb93a0 2024-09-17T01:38:04.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.045+0000 7fe76ea00640 1 --2- 172.21.15.42:0/296857753 >> [v2:172.21.15.42:6834/3687871500,v1:172.21.15.42:6835/3687871500] conn(0x55de2ebb93a0 0x55de2f095320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.046+0000 7fe753e00640 10 client.7356 ms_handle_connect on v2:172.21.15.42:6834/3687871500 2024-09-17T01:38:04.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.046+0000 7fe76ea00640 1 --2- 172.21.15.42:0/296857753 >> [v2:172.21.15.42:6834/3687871500,v1:172.21.15.42:6835/3687871500] conn(0x55de2ebb93a0 0x55de2f095320 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5db4545b5d4c9baa server_cookie=2789be4a6a31cce4 in_seq=0 out_seq=0 2024-09-17T01:38:04.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.059+0000 7fe753e00640 1 -- 172.21.15.42:0/296857753 <== mds.0 v2:172.21.15.42:6834/3687871500 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55de2f00a4c0 con 0x55de2ebb93a0 2024-09-17T01:38:04.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.059+0000 7fe753e00640 10 client.7356 handle_command_reply: tid=0 2024-09-17T01:38:04.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.059+0000 7fe77ca45740 1 client.7356 shutdown 2024-09-17T01:38:04.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.059+0000 7fe77ca45740 1 -- 172.21.15.42:0/296857753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ec194e0 msgr2=0x55de2f038960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:04.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.059+0000 7fe77ca45740 1 --2- 172.21.15.42:0/296857753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ec194e0 0x55de2f038960 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fe76802f840 tx=0x7fe768004860 comp rx=0 tx=0).stop 2024-09-17T01:38:04.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.059+0000 7fe77ca45740 1 -- 172.21.15.42:0/296857753 shutdown_connections 2024-09-17T01:38:04.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.059+0000 7fe77ca45740 1 --2- 172.21.15.42:0/296857753 >> [v2:172.21.15.42:6834/3687871500,v1:172.21.15.42:6835/3687871500] conn(0x55de2ebb93a0 0x55de2f095320 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.059+0000 7fe77ca45740 1 --2- 172.21.15.42:0/296857753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55de2ec194e0 0x55de2f038960 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.059+0000 7fe77ca45740 1 --2- 172.21.15.42:0/296857753 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55de2ec046b0 0x55de2f08bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.059+0000 7fe77ca45740 1 --2- 172.21.15.42:0/296857753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de2ebfc4d0 0x55de2f0992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.059+0000 7fe753e00640 0 client.7356 ms_handle_reset on v2:172.21.15.42:6834/3687871500 2024-09-17T01:38:04.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.059+0000 7fe77ca45740 1 -- 172.21.15.42:0/296857753 >> 172.21.15.42:0/296857753 conn(0x55de2efcd500 msgr2=0x55de2eff6640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:04.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.060+0000 7fe77ca45740 1 -- 172.21.15.42:0/296857753 shutdown_connections 2024-09-17T01:38:04.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.060+0000 7fe77ca45740 1 -- 172.21.15.42:0/296857753 wait complete. 2024-09-17T01:38:04.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.060+0000 7fe77ca45740 20 client.7356 trim_cache size 0 max 16384 2024-09-17T01:38:04.059 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:38:04.059 INFO:teuthology.orchestra.run.smithi042.stdout: "message": "", 2024-09-17T01:38:04.059 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0 2024-09-17T01:38:04.059 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:38:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.061+0000 7fe775a00640 1 -- 172.21.15.42:0/979132931 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe74c078b90 msgr2=0x7fe74c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.061+0000 7fe775a00640 1 --2- 172.21.15.42:0/979132931 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe74c078b90 0x7fe74c07b0a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe77014e2e0 tx=0x7fe758005f90 comp rx=0 tx=0).stop 2024-09-17T01:38:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.061+0000 7fe775a00640 1 -- 172.21.15.42:0/979132931 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe77006d430 msgr2=0x7fe770141bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.061+0000 7fe775a00640 1 --2- 172.21.15.42:0/979132931 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe77006d430 0x7fe770141bf0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fe76000e7c0 tx=0x7fe76000ec80 comp rx=0 tx=0).stop 2024-09-17T01:38:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.061+0000 7fe775a00640 1 -- 172.21.15.42:0/979132931 shutdown_connections 2024-09-17T01:38:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.061+0000 7fe775a00640 1 --2- 172.21.15.42:0/979132931 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe74c078b90 0x7fe74c07b0a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.061+0000 7fe775a00640 1 --2- 172.21.15.42:0/979132931 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7700b3880 0x7fe770150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.061+0000 7fe775a00640 1 --2- 172.21.15.42:0/979132931 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe77015cfc0 0x7fe770150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.061+0000 7fe775a00640 1 --2- 172.21.15.42:0/979132931 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe77006d430 0x7fe770141bf0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.061+0000 7fe775a00640 1 -- 172.21.15.42:0/979132931 >> 172.21.15.42:0/979132931 conn(0x7fe7700b2930 msgr2=0x7fe77006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:04.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.061+0000 7fe775a00640 1 -- 172.21.15.42:0/979132931 shutdown_connections 2024-09-17T01:38:04.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.061+0000 7fe775a00640 1 -- 172.21.15.42:0/979132931 wait complete. 2024-09-17T01:38:04.084 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T01:38:04.084 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:38:04.084 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T01:38:04.084 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:38:04.085 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T01:38:04.085 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:38:04.085 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T01:38:04.085 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:38:04.109 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T01:38:04.109 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-17T01:38:04.110 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T01:38:04.110 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-17T01:38:04.122 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T01:38:04.122 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-17T01:38:04.125 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T01:38:04.125 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-17T01:38:04.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.354+0000 7ff91ae00640 1 -- 172.21.15.42:0/746843404 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9141624f0 msgr2=0x7ff914162900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:04.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.354+0000 7ff91ae00640 1 --2- 172.21.15.42:0/746843404 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9141624f0 0x7ff914162900 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff90c009830 tx=0x7ff90c02a480 comp rx=0 tx=0).stop 2024-09-17T01:38:04.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.354+0000 7f52d3200640 1 -- 172.21.15.42:0/3407340852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52cc0b3880 msgr2=0x7f52cc0af980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:04.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.354+0000 7f52d3200640 1 --2- 172.21.15.42:0/3407340852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52cc0b3880 0x7f52cc0af980 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0b3100 tx=0x7f52bc02a580 comp rx=0 tx=0).stop 2024-09-17T01:38:04.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.354+0000 7f52d3200640 1 -- 172.21.15.42:0/3407340852 shutdown_connections 2024-09-17T01:38:04.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.354+0000 7f52d3200640 1 --2- 172.21.15.42:0/3407340852 >> v2:172.21.15.42:3300/0 conn(0x7f52cc06d430 0x7f52cc06d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.354+0000 7f52d3200640 1 --2- 172.21.15.42:0/3407340852 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52cc15cfc0 0x7f52cc0ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.354+0000 7f52d3200640 1 --2- 172.21.15.42:0/3407340852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52cc0b3880 0x7f52cc0af980 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.354+0000 7ff91ae00640 1 -- 172.21.15.42:0/746843404 shutdown_connections 2024-09-17T01:38:04.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.354+0000 7ff91ae00640 1 --2- 172.21.15.42:0/746843404 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9141624f0 0x7ff914162900 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.354+0000 7ff91ae00640 1 --2- 172.21.15.42:0/746843404 >> v2:172.21.15.43:3300/0 conn(0x7ff9140b5320 0x7ff914155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.354+0000 7ff91ae00640 1 -- 172.21.15.42:0/746843404 >> 172.21.15.42:0/746843404 conn(0x7ff914070360 msgr2=0x7ff914070770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:04.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.354+0000 7f52d3200640 1 -- 172.21.15.42:0/3407340852 >> 172.21.15.42:0/3407340852 conn(0x7f52cc0b2930 msgr2=0x7f52cc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:04.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.354+0000 7f52d3200640 1 -- 172.21.15.42:0/3407340852 shutdown_connections 2024-09-17T01:38:04.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.354+0000 7ff91ae00640 1 -- 172.21.15.42:0/746843404 shutdown_connections 2024-09-17T01:38:04.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.354+0000 7f52d3200640 1 -- 172.21.15.42:0/3407340852 wait complete. 2024-09-17T01:38:04.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.354+0000 7ff91ae00640 1 -- 172.21.15.42:0/746843404 wait complete. 2024-09-17T01:38:04.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.357+0000 7f52d3200640 1 Processor -- start 2024-09-17T01:38:04.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.357+0000 7f52d3200640 1 -- start start 2024-09-17T01:38:04.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.358+0000 7ff91ae00640 1 Processor -- start 2024-09-17T01:38:04.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.358+0000 7ff91ae00640 1 -- start start 2024-09-17T01:38:04.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.359+0000 7f52d3200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52cc06d430 0x7f52cc1527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.359+0000 7f52d3200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52cc0b3880 0x7f52cc154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.359+0000 7f52d3200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52cc15cfc0 0x7f52cc15ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.359+0000 7f52d3200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f52cc15d5e0 con 0x7f52cc15cfc0 2024-09-17T01:38:04.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.359+0000 7f52d3200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f52cc1605b0 con 0x7f52cc06d430 2024-09-17T01:38:04.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.359+0000 7f52d3200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f52cc1549c0 con 0x7f52cc0b3880 2024-09-17T01:38:04.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.359+0000 7f52cbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52cc06d430 0x7f52cc1527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.359+0000 7f52cb400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52cc0b3880 0x7f52cc154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.359+0000 7f52cbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52cc06d430 0x7f52cc1527a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:54890/0 (socket says 172.21.15.42:54890) 2024-09-17T01:38:04.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.359+0000 7f52cbe00640 1 -- 172.21.15.42:0/533564001 learned_addr learned my addr 172.21.15.42:0/533564001 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:04.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.359+0000 7f52d1200640 1 --2- 172.21.15.42:0/533564001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52cc15cfc0 0x7f52cc15ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.360+0000 7f52cb400640 1 -- 172.21.15.42:0/533564001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52cc06d430 msgr2=0x7f52cc1527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:04.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.360+0000 7f52cb400640 1 --2- 172.21.15.42:0/533564001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52cc06d430 0x7f52cc1527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.360+0000 7f52cb400640 1 -- 172.21.15.42:0/533564001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52cc15cfc0 msgr2=0x7f52cc15ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:04.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.360+0000 7f52cb400640 1 --2- 172.21.15.42:0/533564001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52cc15cfc0 0x7f52cc15ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.360+0000 7f52cb400640 1 -- 172.21.15.42:0/533564001 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52cc1f5bb0 con 0x7f52cc0b3880 2024-09-17T01:38:04.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.360+0000 7f52d1200640 1 --2- 172.21.15.42:0/533564001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52cc15cfc0 0x7f52cc15ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:38:04.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.361+0000 7f52cb400640 1 --2- 172.21.15.42:0/533564001 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52cc0b3880 0x7f52cc154050 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f52b800d650 tx=0x7f52b800db10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:04.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.361+0000 7ff91ae00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff91406df40 0x7ff91414e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.361+0000 7ff91ae00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9140b5320 0x7ff914151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.361+0000 7ff91ae00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9141624f0 0x7ff91413b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.361+0000 7ff91ae00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff9140b6ea0 con 0x7ff9140b5320 2024-09-17T01:38:04.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.361+0000 7ff91ae00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff9140b6d20 con 0x7ff91406df40 2024-09-17T01:38:04.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.361+0000 7ff91ae00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff9140b7020 con 0x7ff9141624f0 2024-09-17T01:38:04.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.361+0000 7ff919000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9140b5320 0x7ff914151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.361+0000 7ff919a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff91406df40 0x7ff91414e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.361+0000 7f52c3e00640 1 -- 172.21.15.42:0/533564001 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b8017070 con 0x7f52cc0b3880 2024-09-17T01:38:04.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.361+0000 7f52c3e00640 1 -- 172.21.15.42:0/533564001 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52b8005310 con 0x7f52cc0b3880 2024-09-17T01:38:04.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.361+0000 7f52c3e00640 1 -- 172.21.15.42:0/533564001 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b8009820 con 0x7f52cc0b3880 2024-09-17T01:38:04.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.361+0000 7ff919a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff91406df40 0x7ff91414e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:54896/0 (socket says 172.21.15.42:54896) 2024-09-17T01:38:04.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.361+0000 7ff919a00640 1 -- 172.21.15.42:0/1719937350 learned_addr learned my addr 172.21.15.42:0/1719937350 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:04.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.361+0000 7ff91a400640 1 --2- 172.21.15.42:0/1719937350 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9141624f0 0x7ff91413b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.361+0000 7f52d3200640 1 -- 172.21.15.42:0/533564001 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52cc1f9980 con 0x7f52cc0b3880 2024-09-17T01:38:04.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.361+0000 7f52d3200640 1 -- 172.21.15.42:0/533564001 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f52cc1f9f40 con 0x7f52cc0b3880 2024-09-17T01:38:04.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.362+0000 7ff919a00640 1 -- 172.21.15.42:0/1719937350 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9141624f0 msgr2=0x7ff91413b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:04.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.362+0000 7ff919a00640 1 --2- 172.21.15.42:0/1719937350 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9141624f0 0x7ff91413b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.362+0000 7ff919a00640 1 -- 172.21.15.42:0/1719937350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9140b5320 msgr2=0x7ff914151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:04.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.362+0000 7ff919a00640 1 --2- 172.21.15.42:0/1719937350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9140b5320 0x7ff914151c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.362+0000 7ff919a00640 1 -- 172.21.15.42:0/1719937350 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff914159a10 con 0x7ff91406df40 2024-09-17T01:38:04.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.362+0000 7ff919000640 1 --2- 172.21.15.42:0/1719937350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9140b5320 0x7ff914151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:38:04.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.362+0000 7ff919a00640 1 --2- 172.21.15.42:0/1719937350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff91406df40 0x7ff91414e470 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff90800eb30 tx=0x7ff90800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:04.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.363+0000 7ff911600640 1 -- 172.21.15.42:0/1719937350 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff908010430 con 0x7ff91406df40 2024-09-17T01:38:04.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.363+0000 7ff911600640 1 -- 172.21.15.42:0/1719937350 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9080105d0 con 0x7ff91406df40 2024-09-17T01:38:04.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.363+0000 7ff911600640 1 -- 172.21.15.42:0/1719937350 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff908010a20 con 0x7ff91406df40 2024-09-17T01:38:04.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.363+0000 7ff91ae00640 1 -- 172.21.15.42:0/1719937350 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff91414d990 con 0x7ff91406df40 2024-09-17T01:38:04.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.363+0000 7ff91ae00640 1 -- 172.21.15.42:0/1719937350 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff914159cf0 con 0x7ff91406df40 2024-09-17T01:38:04.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.363+0000 7f52d3200640 1 -- 172.21.15.42:0/533564001 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52cc0af980 con 0x7f52cc0b3880 2024-09-17T01:38:04.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.364+0000 7ff91ae00640 1 -- 172.21.15.42:0/1719937350 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9140b7510 con 0x7ff91406df40 2024-09-17T01:38:04.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.365+0000 7ff911600640 1 -- 172.21.15.42:0/1719937350 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff908010bc0 con 0x7ff91406df40 2024-09-17T01:38:04.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.365+0000 7f52c3e00640 1 -- 172.21.15.42:0/533564001 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f52b80099c0 con 0x7f52cc0b3880 2024-09-17T01:38:04.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.366+0000 7f52c3e00640 1 --2- 172.21.15.42:0/533564001 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f52ac078be0 0x7f52ac07b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.366+0000 7f52c3e00640 1 -- 172.21.15.42:0/533564001 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f52b809ab60 con 0x7f52cc0b3880 2024-09-17T01:38:04.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.367+0000 7f52cbe00640 1 --2- 172.21.15.42:0/533564001 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f52ac078be0 0x7f52ac07b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.367+0000 7ff911600640 1 --2- 172.21.15.42:0/1719937350 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff8f4078b90 0x7ff8f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.367+0000 7ff911600640 1 -- 172.21.15.42:0/1719937350 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7ff90809baa0 con 0x7ff91406df40 2024-09-17T01:38:04.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.367+0000 7ff919000640 1 --2- 172.21.15.42:0/1719937350 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff8f4078b90 0x7ff8f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.368+0000 7f52cbe00640 1 --2- 172.21.15.42:0/533564001 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f52ac078be0 0x7f52ac07b0f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f52bc009230 tx=0x7f52bc004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:04.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.368+0000 7ff919000640 1 --2- 172.21.15.42:0/1719937350 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff8f4078b90 0x7ff8f407b0a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff914141f30 tx=0x7ff900009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:04.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.372+0000 7ff911600640 1 -- 172.21.15.42:0/1719937350 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff908063890 con 0x7ff91406df40 2024-09-17T01:38:04.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.373+0000 7f52c3e00640 1 -- 172.21.15.42:0/533564001 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f52cc1f5bb0 con 0x7f52cc0b3880 2024-09-17T01:38:04.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.415+0000 7f0fbb000640 1 -- 172.21.15.42:0/1130218616 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0fb4162930 msgr2=0x7f0fb40d2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:04.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.415+0000 7f0fbb000640 1 --2- 172.21.15.42:0/1130218616 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0fb4162930 0x7f0fb40d2fc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0fac009be0 tx=0x7f0fac02a920 comp rx=0 tx=0).stop 2024-09-17T01:38:04.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.416+0000 7f0fbb000640 1 -- 172.21.15.42:0/1130218616 shutdown_connections 2024-09-17T01:38:04.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.416+0000 7f0fbb000640 1 --2- 172.21.15.42:0/1130218616 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0fb4162930 0x7f0fb40d2fc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.416+0000 7f0fbb000640 1 -- 172.21.15.42:0/1130218616 >> 172.21.15.42:0/1130218616 conn(0x7f0fb4073f20 msgr2=0x7f0fb406cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:04.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.416+0000 7f0fbb000640 1 -- 172.21.15.42:0/1130218616 shutdown_connections 2024-09-17T01:38:04.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.416+0000 7f0fbb000640 1 -- 172.21.15.42:0/1130218616 wait complete. 2024-09-17T01:38:04.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.418+0000 7f0fbb000640 1 Processor -- start 2024-09-17T01:38:04.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.418+0000 7f0fbb000640 1 -- start start 2024-09-17T01:38:04.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.419+0000 7f087b200640 1 -- 172.21.15.42:0/3262275597 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f08740b6030 msgr2=0x7f08740b6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:04.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.419+0000 7f087b200640 1 --2- 172.21.15.42:0/3262275597 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f08740b6030 0x7f08740b6440 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0870009be0 tx=0x7f087002a840 comp rx=0 tx=0).stop 2024-09-17T01:38:04.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.419+0000 7f087b200640 1 -- 172.21.15.42:0/3262275597 shutdown_connections 2024-09-17T01:38:04.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.419+0000 7f087b200640 1 --2- 172.21.15.42:0/3262275597 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f08740b6030 0x7f08740b6440 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.419+0000 7f087b200640 1 --2- 172.21.15.42:0/3262275597 >> v2:172.21.15.43:3300/0 conn(0x7f0874073340 0x7f08740d2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.419+0000 7f087b200640 1 -- 172.21.15.42:0/3262275597 >> 172.21.15.42:0/3262275597 conn(0x7f08740d1210 msgr2=0x7f08740d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:04.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.419+0000 7f087b200640 1 -- 172.21.15.42:0/3262275597 shutdown_connections 2024-09-17T01:38:04.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.419+0000 7f087b200640 1 -- 172.21.15.42:0/3262275597 wait complete. 2024-09-17T01:38:04.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.420+0000 7f0fbb000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fb415fbe0 0x7f0fb414c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.420+0000 7f0fbb000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0fb4162520 0x7f0fb4149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.420+0000 7f0fbb000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fb4162930 0x7f0fb41f8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.420+0000 7f0fbb000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb40d0e80 con 0x7f0fb415fbe0 2024-09-17T01:38:04.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.420+0000 7f0fbb000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb40d0d00 con 0x7f0fb4162930 2024-09-17T01:38:04.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.420+0000 7f0fbb000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0fb40d1000 con 0x7f0fb4162520 2024-09-17T01:38:04.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.420+0000 7f0fb9c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fb415fbe0 0x7f0fb414c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.420+0000 7f0fb9c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fb415fbe0 0x7f0fb414c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53922/0 (socket says 172.21.15.42:53922) 2024-09-17T01:38:04.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.420+0000 7f0fb9c00640 1 -- 172.21.15.42:0/1965012026 learned_addr learned my addr 172.21.15.42:0/1965012026 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:04.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.420+0000 7f0fb9200640 1 --2- 172.21.15.42:0/1965012026 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0fb4162520 0x7f0fb4149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.420+0000 7f0fba600640 1 --2- 172.21.15.42:0/1965012026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fb4162930 0x7f0fb41f8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.421+0000 7f0fb9c00640 1 -- 172.21.15.42:0/1965012026 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0fb4162520 msgr2=0x7f0fb4149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:04.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.421+0000 7f0fb9c00640 1 --2- 172.21.15.42:0/1965012026 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0fb4162520 0x7f0fb4149550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.421+0000 7f0fb9c00640 1 -- 172.21.15.42:0/1965012026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fb4162930 msgr2=0x7f0fb41f8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:04.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.421+0000 7f0fb9c00640 1 --2- 172.21.15.42:0/1965012026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fb4162930 0x7f0fb41f8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.421+0000 7f0fb9c00640 1 -- 172.21.15.42:0/1965012026 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb414cd70 con 0x7f0fb415fbe0 2024-09-17T01:38:04.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.421+0000 7f0fb9c00640 1 --2- 172.21.15.42:0/1965012026 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fb415fbe0 0x7f0fb414c830 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800c400 tx=0x7f0fa800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:04.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.422+0000 7f0fb1600640 1 -- 172.21.15.42:0/1965012026 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8017070 con 0x7f0fb415fbe0 2024-09-17T01:38:04.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.422+0000 7f0fbb000640 1 -- 172.21.15.42:0/1965012026 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb40b6dc0 con 0x7f0fb415fbe0 2024-09-17T01:38:04.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.422+0000 7f0fbb000640 1 -- 172.21.15.42:0/1965012026 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb40b42f0 con 0x7f0fb415fbe0 2024-09-17T01:38:04.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.422+0000 7f087b200640 1 Processor -- start 2024-09-17T01:38:04.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.422+0000 7f0fb1600640 1 -- 172.21.15.42:0/1965012026 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fa80053c0 con 0x7f0fb415fbe0 2024-09-17T01:38:04.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.422+0000 7f0fb1600640 1 -- 172.21.15.42:0/1965012026 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8003850 con 0x7f0fb415fbe0 2024-09-17T01:38:04.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.422+0000 7f087b200640 1 -- start start 2024-09-17T01:38:04.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.424+0000 7f087b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0874073340 0x7f08740cf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.424+0000 7f087b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08740b6030 0x7f08740c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.424+0000 7f0fbb000640 1 -- 172.21.15.42:0/1965012026 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f90005290 con 0x7f0fb415fbe0 2024-09-17T01:38:04.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.424+0000 7f087b200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0874162fa0 0x7f08740c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.424+0000 7f087b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f087415f8b0 con 0x7f0874073340 2024-09-17T01:38:04.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.424+0000 7f087b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f087415f730 con 0x7f08740b6030 2024-09-17T01:38:04.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.424+0000 7f087b200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f087415fa30 con 0x7f0874162fa0 2024-09-17T01:38:04.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.424+0000 7f0879e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0874073340 0x7f08740cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.425+0000 7f0879e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0874073340 0x7f08740cf080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53930/0 (socket says 172.21.15.42:53930) 2024-09-17T01:38:04.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.425+0000 7f0879e00640 1 -- 172.21.15.42:0/2633028724 learned_addr learned my addr 172.21.15.42:0/2633028724 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:04.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.425+0000 7f0879400640 1 --2- 172.21.15.42:0/2633028724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08740b6030 0x7f08740c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.425+0000 7f087a800640 1 --2- 172.21.15.42:0/2633028724 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0874162fa0 0x7f08740c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.425+0000 7f0fb1600640 1 -- 172.21.15.42:0/1965012026 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0fa801a070 con 0x7f0fb415fbe0 2024-09-17T01:38:04.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.425+0000 7f0879e00640 1 -- 172.21.15.42:0/2633028724 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0874162fa0 msgr2=0x7f08740c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:04.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.425+0000 7f0879e00640 1 --2- 172.21.15.42:0/2633028724 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0874162fa0 0x7f08740c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.425+0000 7f0879e00640 1 -- 172.21.15.42:0/2633028724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08740b6030 msgr2=0x7f08740c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:04.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.425+0000 7f0879e00640 1 --2- 172.21.15.42:0/2633028724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08740b6030 0x7f08740c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.425+0000 7f0879e00640 1 -- 172.21.15.42:0/2633028724 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08741f5f40 con 0x7f0874073340 2024-09-17T01:38:04.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.425+0000 7f0879400640 1 --2- 172.21.15.42:0/2633028724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08740b6030 0x7f08740c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:04.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.425+0000 7f0879e00640 1 --2- 172.21.15.42:0/2633028724 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0874073340 0x7f08740cf080 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f086800e7c0 tx=0x7f086800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:04.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.426+0000 7f0fb1600640 1 --2- 172.21.15.42:0/1965012026 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0f94078b90 0x7f0f9407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.426+0000 7f0fb1600640 1 -- 172.21.15.42:0/1965012026 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f0fa8099f30 con 0x7f0fb415fbe0 2024-09-17T01:38:04.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.426+0000 7f086e000640 1 -- 172.21.15.42:0/2633028724 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086800ccc0 con 0x7f0874073340 2024-09-17T01:38:04.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.427+0000 7f086e000640 1 -- 172.21.15.42:0/2633028724 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0868010430 con 0x7f0874073340 2024-09-17T01:38:04.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.427+0000 7f086e000640 1 -- 172.21.15.42:0/2633028724 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0868010860 con 0x7f0874073340 2024-09-17T01:38:04.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.427+0000 7f087b200640 1 -- 172.21.15.42:0/2633028724 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08741f6220 con 0x7f0874073340 2024-09-17T01:38:04.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.427+0000 7f0fb9200640 1 --2- 172.21.15.42:0/1965012026 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0f94078b90 0x7f0f9407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.427+0000 7f087b200640 1 -- 172.21.15.42:0/2633028724 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08741f67e0 con 0x7f0874073340 2024-09-17T01:38:04.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.428+0000 7f087b200640 1 -- 172.21.15.42:0/2633028724 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08741f6bc0 con 0x7f0874073340 2024-09-17T01:38:04.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.428+0000 7f0fb9200640 1 --2- 172.21.15.42:0/1965012026 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0f94078b90 0x7f0f9407b0a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0fb40b35d0 tx=0x7f0fa0007cc0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:04.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.436+0000 7f0fb1600640 1 -- 172.21.15.42:0/1965012026 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0fa8061db0 con 0x7f0fb415fbe0 2024-09-17T01:38:04.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.440+0000 7f086e000640 1 -- 172.21.15.42:0/2633028724 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0868010a00 con 0x7f0874073340 2024-09-17T01:38:04.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.440+0000 7f086e000640 1 --2- 172.21.15.42:0/2633028724 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0858078bc0 0x7f085807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.441+0000 7f086e000640 1 -- 172.21.15.42:0/2633028724 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f086809bf40 con 0x7f0874073340 2024-09-17T01:38:04.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.441+0000 7f0879400640 1 --2- 172.21.15.42:0/2633028724 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0858078bc0 0x7f085807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.442+0000 7f0879400640 1 --2- 172.21.15.42:0/2633028724 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0858078bc0 0x7f085807b0d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f087415de70 tx=0x7f0864009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:04.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.447+0000 7f086e000640 1 -- 172.21.15.42:0/2633028724 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f08741f6bc0 con 0x7f0874073340 2024-09-17T01:38:04.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.653+0000 7ff91ae00640 1 -- 172.21.15.42:0/1719937350 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7ff914159280 con 0x7ff91406df40 2024-09-17T01:38:04.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.660+0000 7f52d3200640 1 -- 172.21.15.42:0/533564001 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7f52cc1f9710 con 0x7f52cc0b3880 2024-09-17T01:38:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.708+0000 7f0fbb000640 1 -- 172.21.15.42:0/1965012026 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f0f90005850 con 0x7f0fb415fbe0 2024-09-17T01:38:04.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:04.715+0000 7f087b200640 1 -- 172.21.15.42:0/2633028724 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7f087415ff50 con 0x7f0874073340 2024-09-17T01:38:05.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.370+0000 7ff911600640 1 -- 172.21.15.42:0/1719937350 <== mon.1 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 6853 v73) ==== 95+0+0 (secure 0 0 0) 0x7ff9080682c0 con 0x7ff91406df40 2024-09-17T01:38:05.368 INFO:teuthology.orchestra.run.smithi042.stderr:failed mds gid 6853 2024-09-17T01:38:05.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.373+0000 7ff91ae00640 1 -- 172.21.15.42:0/1719937350 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff8f4078b90 msgr2=0x7ff8f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:05.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.373+0000 7ff91ae00640 1 --2- 172.21.15.42:0/1719937350 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff8f4078b90 0x7ff8f407b0a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff914141f30 tx=0x7ff900009040 comp rx=0 tx=0).stop 2024-09-17T01:38:05.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.373+0000 7ff91ae00640 1 -- 172.21.15.42:0/1719937350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff91406df40 msgr2=0x7ff91414e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:05.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.373+0000 7ff91ae00640 1 --2- 172.21.15.42:0/1719937350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff91406df40 0x7ff91414e470 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff90800eb30 tx=0x7ff90800c2d0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.373+0000 7ff91ae00640 1 -- 172.21.15.42:0/1719937350 shutdown_connections 2024-09-17T01:38:05.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.373+0000 7ff91ae00640 1 --2- 172.21.15.42:0/1719937350 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff8f4078b90 0x7ff8f407b0a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.373+0000 7ff91ae00640 1 --2- 172.21.15.42:0/1719937350 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9141624f0 0x7ff91413b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.373+0000 7ff91ae00640 1 --2- 172.21.15.42:0/1719937350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9140b5320 0x7ff914151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.373+0000 7ff91ae00640 1 --2- 172.21.15.42:0/1719937350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff91406df40 0x7ff91414e470 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.373+0000 7ff91ae00640 1 -- 172.21.15.42:0/1719937350 >> 172.21.15.42:0/1719937350 conn(0x7ff914070360 msgr2=0x7ff91406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:05.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.373+0000 7ff91ae00640 1 -- 172.21.15.42:0/1719937350 shutdown_connections 2024-09-17T01:38:05.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.373+0000 7ff91ae00640 1 -- 172.21.15.42:0/1719937350 wait complete. 2024-09-17T01:38:05.378 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-17T01:38:05.380+0000 7f995ec00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:38:05.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.384+0000 7f086e000640 1 -- 172.21.15.42:0/2633028724 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7191 v74) ==== 95+0+0 (secure 0 0 0) 0x7f08680643f0 con 0x7f0874073340 2024-09-17T01:38:05.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.384+0000 7f0fb1600640 1 -- 172.21.15.42:0/1965012026 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 7188 v74) ==== 95+0+0 (secure 0 0 0) 0x7f0fa80667e0 con 0x7f0fb415fbe0 2024-09-17T01:38:05.382 INFO:teuthology.orchestra.run.smithi042.stderr:failed mds gid 7188 2024-09-17T01:38:05.382 INFO:teuthology.orchestra.run.smithi042.stderr:failed mds gid 7191 2024-09-17T01:38:05.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.387+0000 7f0fbb000640 1 -- 172.21.15.42:0/1965012026 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0f94078b90 msgr2=0x7f0f9407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:05.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.387+0000 7f0fbb000640 1 --2- 172.21.15.42:0/1965012026 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0f94078b90 0x7f0f9407b0a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0fb40b35d0 tx=0x7f0fa0007cc0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.387+0000 7f0fbb000640 1 -- 172.21.15.42:0/1965012026 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fb415fbe0 msgr2=0x7f0fb414c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:05.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.387+0000 7f0fbb000640 1 --2- 172.21.15.42:0/1965012026 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fb415fbe0 0x7f0fb414c830 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800c400 tx=0x7f0fa800c8c0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.388+0000 7f0fbb000640 1 -- 172.21.15.42:0/1965012026 shutdown_connections 2024-09-17T01:38:05.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.388+0000 7f0fbb000640 1 --2- 172.21.15.42:0/1965012026 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0f94078b90 0x7f0f9407b0a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.388+0000 7f0fbb000640 1 --2- 172.21.15.42:0/1965012026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fb4162930 0x7f0fb41f8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.388+0000 7f0fbb000640 1 --2- 172.21.15.42:0/1965012026 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0fb4162520 0x7f0fb4149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.388+0000 7f0fbb000640 1 --2- 172.21.15.42:0/1965012026 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fb415fbe0 0x7f0fb414c830 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.388+0000 7f0fbb000640 1 -- 172.21.15.42:0/1965012026 >> 172.21.15.42:0/1965012026 conn(0x7f0fb4073f20 msgr2=0x7f0fb406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:05.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.388+0000 7f0fbb000640 1 -- 172.21.15.42:0/1965012026 shutdown_connections 2024-09-17T01:38:05.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.388+0000 7f0fbb000640 1 -- 172.21.15.42:0/1965012026 wait complete. 2024-09-17T01:38:05.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.389+0000 7f52c3e00640 1 -- 172.21.15.42:0/533564001 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6856 v74) ==== 95+0+0 (secure 0 0 0) 0x7f52b8062a30 con 0x7f52cc0b3880 2024-09-17T01:38:05.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.389+0000 7f087b200640 1 -- 172.21.15.42:0/2633028724 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0858078bc0 msgr2=0x7f085807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:05.387 INFO:teuthology.orchestra.run.smithi042.stderr:failed mds gid 6856 2024-09-17T01:38:05.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.389+0000 7f087b200640 1 --2- 172.21.15.42:0/2633028724 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0858078bc0 0x7f085807b0d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f087415de70 tx=0x7f0864009040 comp rx=0 tx=0).stop 2024-09-17T01:38:05.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.389+0000 7f087b200640 1 -- 172.21.15.42:0/2633028724 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0874073340 msgr2=0x7f08740cf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:05.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.389+0000 7f087b200640 1 --2- 172.21.15.42:0/2633028724 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0874073340 0x7f08740cf080 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f086800e7c0 tx=0x7f086800ec80 comp rx=0 tx=0).stop 2024-09-17T01:38:05.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.389+0000 7f087b200640 1 -- 172.21.15.42:0/2633028724 shutdown_connections 2024-09-17T01:38:05.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.389+0000 7f087b200640 1 --2- 172.21.15.42:0/2633028724 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0858078bc0 0x7f085807b0d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.389+0000 7f087b200640 1 --2- 172.21.15.42:0/2633028724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08740b6030 0x7f08740c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.390+0000 7f087b200640 1 --2- 172.21.15.42:0/2633028724 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0874162fa0 0x7f08740c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.390+0000 7f087b200640 1 --2- 172.21.15.42:0/2633028724 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0874073340 0x7f08740cf080 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.390+0000 7f087b200640 1 -- 172.21.15.42:0/2633028724 >> 172.21.15.42:0/2633028724 conn(0x7f08740d1210 msgr2=0x7f08740d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:05.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.390+0000 7f087b200640 1 -- 172.21.15.42:0/2633028724 shutdown_connections 2024-09-17T01:38:05.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.390+0000 7f087b200640 1 -- 172.21.15.42:0/2633028724 wait complete. 2024-09-17T01:38:05.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.392+0000 7f52d3200640 1 -- 172.21.15.42:0/533564001 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f52ac078be0 msgr2=0x7f52ac07b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:05.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.392+0000 7f52d3200640 1 --2- 172.21.15.42:0/533564001 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f52ac078be0 0x7f52ac07b0f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f52bc009230 tx=0x7f52bc004730 comp rx=0 tx=0).stop 2024-09-17T01:38:05.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.392+0000 7f52d3200640 1 -- 172.21.15.42:0/533564001 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52cc0b3880 msgr2=0x7f52cc154050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:05.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.392+0000 7f52d3200640 1 --2- 172.21.15.42:0/533564001 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52cc0b3880 0x7f52cc154050 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f52b800d650 tx=0x7f52b800db10 comp rx=0 tx=0).stop 2024-09-17T01:38:05.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.393+0000 7f52d3200640 1 -- 172.21.15.42:0/533564001 shutdown_connections 2024-09-17T01:38:05.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.393+0000 7f52d3200640 1 --2- 172.21.15.42:0/533564001 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f52ac078be0 0x7f52ac07b0f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.393+0000 7f52d3200640 1 --2- 172.21.15.42:0/533564001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52cc15cfc0 0x7f52cc15ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.393+0000 7f52d3200640 1 --2- 172.21.15.42:0/533564001 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52cc0b3880 0x7f52cc154050 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.393+0000 7f52d3200640 1 --2- 172.21.15.42:0/533564001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52cc06d430 0x7f52cc1527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.393+0000 7f52d3200640 1 -- 172.21.15.42:0/533564001 >> 172.21.15.42:0/533564001 conn(0x7f52cc0b2930 msgr2=0x7f52cc0b0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:05.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.393+0000 7f52d3200640 1 -- 172.21.15.42:0/533564001 shutdown_connections 2024-09-17T01:38:05.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.393+0000 7f52d3200640 1 -- 172.21.15.42:0/533564001 wait complete. 2024-09-17T01:38:05.411 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T01:38:05.411 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T01:38:05.415 INFO:tasks.ceph.mds.d:Started 2024-09-17T01:38:05.416 DEBUG:teuthology.parallel:result is None 2024-09-17T01:38:05.423 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T01:38:05.423 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T01:38:05.424 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T01:38:05.424 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T01:38:05.427 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T01:38:05.427 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T01:38:05.428 INFO:tasks.ceph.mds.b:Started 2024-09-17T01:38:05.428 DEBUG:teuthology.parallel:result is None 2024-09-17T01:38:05.471 INFO:tasks.ceph.mds.c:Started 2024-09-17T01:38:05.472 DEBUG:teuthology.parallel:result is None 2024-09-17T01:38:05.474 INFO:tasks.ceph.mds.a:Started 2024-09-17T01:38:05.475 DEBUG:teuthology.parallel:result is None 2024-09-17T01:38:05.475 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:38:05.618 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-09-17T01:38:05.626 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-09-17T01:38:05.672 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:38:05.672 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:38:05.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.710+0000 7f1734c00640 1 -- 172.21.15.42:0/3093510787 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f173006d430 msgr2=0x7f173006d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:05.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.710+0000 7f1734c00640 1 --2- 172.21.15.42:0/3093510787 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f173006d430 0x7f173006d840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f17300d02f0 tx=0x7f172802aa10 comp rx=0 tx=0).stop 2024-09-17T01:38:05.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.710+0000 7f1734c00640 1 -- 172.21.15.42:0/3093510787 shutdown_connections 2024-09-17T01:38:05.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.710+0000 7f1734c00640 1 --2- 172.21.15.42:0/3093510787 >> v2:172.21.15.43:3300/0 conn(0x7f173015cfc0 0x7f17300ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.710+0000 7f1734c00640 1 --2- 172.21.15.42:0/3093510787 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f173006d430 0x7f173006d840 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.710+0000 7f1734c00640 1 --2- 172.21.15.42:0/3093510787 >> v2:172.21.15.42:3300/0 conn(0x7f17300b3880 0x7f17300af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.710+0000 7f1734c00640 1 -- 172.21.15.42:0/3093510787 >> 172.21.15.42:0/3093510787 conn(0x7f17300b2930 msgr2=0x7f173006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:05.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.710+0000 7f1734c00640 1 -- 172.21.15.42:0/3093510787 shutdown_connections 2024-09-17T01:38:05.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.710+0000 7f1734c00640 1 -- 172.21.15.42:0/3093510787 wait complete. 2024-09-17T01:38:05.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.712+0000 7f1734c00640 1 Processor -- start 2024-09-17T01:38:05.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.712+0000 7f1734c00640 1 -- start start 2024-09-17T01:38:05.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.714+0000 7f1734c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f173006d430 0x7f1730151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:05.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.714+0000 7f1734c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17300b3880 0x7f17301f0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:05.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.714+0000 7f1734c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f173015cfc0 0x7f173015e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:05.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.714+0000 7f1734c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f173015d550 con 0x7f173015cfc0 2024-09-17T01:38:05.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.714+0000 7f1734c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f173015d3d0 con 0x7f17300b3880 2024-09-17T01:38:05.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.714+0000 7f1734c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f17301605b0 con 0x7f173006d430 2024-09-17T01:38:05.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.714+0000 7f172e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f173015cfc0 0x7f173015e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:05.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.714+0000 7f172e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f173015cfc0 0x7f173015e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53982/0 (socket says 172.21.15.42:53982) 2024-09-17T01:38:05.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.714+0000 7f172e800640 1 -- 172.21.15.42:0/1890007306 learned_addr learned my addr 172.21.15.42:0/1890007306 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:05.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.714+0000 7f172d400640 1 --2- 172.21.15.42:0/1890007306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17300b3880 0x7f17301f0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:05.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.714+0000 7f172de00640 1 --2- 172.21.15.42:0/1890007306 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f173006d430 0x7f1730151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:05.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.715+0000 7f172e800640 1 -- 172.21.15.42:0/1890007306 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f173006d430 msgr2=0x7f1730151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:05.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.715+0000 7f172e800640 1 --2- 172.21.15.42:0/1890007306 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f173006d430 0x7f1730151130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.715+0000 7f172e800640 1 -- 172.21.15.42:0/1890007306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17300b3880 msgr2=0x7f17301f0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:05.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.715+0000 7f172e800640 1 --2- 172.21.15.42:0/1890007306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17300b3880 0x7f17301f0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.715+0000 7f172e800640 1 -- 172.21.15.42:0/1890007306 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17301519c0 con 0x7f173015cfc0 2024-09-17T01:38:05.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.715+0000 7f172de00640 1 --2- 172.21.15.42:0/1890007306 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f173006d430 0x7f1730151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:05.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.715+0000 7f172d400640 1 --2- 172.21.15.42:0/1890007306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17300b3880 0x7f17301f0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:05.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.715+0000 7f172e800640 1 --2- 172.21.15.42:0/1890007306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f173015cfc0 0x7f173015e8f0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f1728009d60 tx=0x7f1728003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:05.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.715+0000 7f1726000640 1 -- 172.21.15.42:0/1890007306 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1728033050 con 0x7f173015cfc0 2024-09-17T01:38:05.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.715+0000 7f1726000640 1 -- 172.21.15.42:0/1890007306 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1728004450 con 0x7f173015cfc0 2024-09-17T01:38:05.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.715+0000 7f1726000640 1 -- 172.21.15.42:0/1890007306 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1728038450 con 0x7f173015cfc0 2024-09-17T01:38:05.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.715+0000 7f1734c00640 1 -- 172.21.15.42:0/1890007306 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17301f39f0 con 0x7f173015cfc0 2024-09-17T01:38:05.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.716+0000 7f1734c00640 1 -- 172.21.15.42:0/1890007306 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17301f3fb0 con 0x7f173015cfc0 2024-09-17T01:38:05.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.717+0000 7f1734c00640 1 -- 172.21.15.42:0/1890007306 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1730151730 con 0x7f173015cfc0 2024-09-17T01:38:05.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.718+0000 7f1726000640 1 -- 172.21.15.42:0/1890007306 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1728036070 con 0x7f173015cfc0 2024-09-17T01:38:05.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.719+0000 7f1726000640 1 --2- 172.21.15.42:0/1890007306 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1710078b90 0x7f171007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:05.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.720+0000 7f1726000640 1 -- 172.21.15.42:0/1890007306 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5795+0+0 (secure 0 0 0) 0x7f17280bc160 con 0x7f173015cfc0 2024-09-17T01:38:05.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.720+0000 7f172de00640 1 --2- 172.21.15.42:0/1890007306 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1710078b90 0x7f171007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:05.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.721+0000 7f172de00640 1 --2- 172.21.15.42:0/1890007306 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1710078b90 0x7f171007b0a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1720009b80 tx=0x7f1720005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:05.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.725+0000 7f1726000640 1 -- 172.21.15.42:0/1890007306 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f173006dd80 con 0x7f173015cfc0 2024-09-17T01:38:05.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.957+0000 7f1734c00640 1 -- 172.21.15.42:0/1890007306 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17301f37e0 con 0x7f173015cfc0 2024-09-17T01:38:05.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.957+0000 7f1726000640 1 -- 172.21.15.42:0/1890007306 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+1911 (secure 0 0 0) 0x7f1728084540 con 0x7f173015cfc0 2024-09-17T01:38:05.955 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:38:05.955 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":74,"btime":"2024-09-17T01:38:05:381136+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:37:52.812411+0000","modified":"2024-09-17T01:38:05.381131+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-17T01:38:05.955 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 74 2024-09-17T01:38:05.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.960+0000 7f1734c00640 1 -- 172.21.15.42:0/1890007306 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1710078b90 msgr2=0x7f171007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:05.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.960+0000 7f1734c00640 1 --2- 172.21.15.42:0/1890007306 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1710078b90 0x7f171007b0a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1720009b80 tx=0x7f1720005f90 comp rx=0 tx=0).stop 2024-09-17T01:38:05.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.960+0000 7f1734c00640 1 -- 172.21.15.42:0/1890007306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f173015cfc0 msgr2=0x7f173015e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:05.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.960+0000 7f1734c00640 1 --2- 172.21.15.42:0/1890007306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f173015cfc0 0x7f173015e8f0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f1728009d60 tx=0x7f1728003f10 comp rx=0 tx=0).stop 2024-09-17T01:38:05.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.960+0000 7f1734c00640 1 -- 172.21.15.42:0/1890007306 shutdown_connections 2024-09-17T01:38:05.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.960+0000 7f1734c00640 1 --2- 172.21.15.42:0/1890007306 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1710078b90 0x7f171007b0a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.960+0000 7f1734c00640 1 --2- 172.21.15.42:0/1890007306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17300b3880 0x7f17301f0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.960+0000 7f1734c00640 1 --2- 172.21.15.42:0/1890007306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f173015cfc0 0x7f173015e8f0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.960+0000 7f1734c00640 1 --2- 172.21.15.42:0/1890007306 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f173006d430 0x7f1730151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:05.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.960+0000 7f1734c00640 1 -- 172.21.15.42:0/1890007306 >> 172.21.15.42:0/1890007306 conn(0x7f17300b2930 msgr2=0x7f173006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:05.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.960+0000 7f1734c00640 1 -- 172.21.15.42:0/1890007306 shutdown_connections 2024-09-17T01:38:05.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:05.960+0000 7f1734c00640 1 -- 172.21.15.42:0/1890007306 wait complete. 2024-09-17T01:38:06.383 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:37:52.812411+0000', 'modified': '2024-09-17T01:38:05.381131+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 97, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {}, 'failed': [0], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T01:38:06.384 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2024-09-17T01:38:07.385 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:38:07.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.626+0000 7f5f46400640 1 -- 172.21.15.42:0/3063960585 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f400b4be0 msgr2=0x7f5f4015d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:07.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.626+0000 7f5f46400640 1 --2- 172.21.15.42:0/3063960585 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f400b4be0 0x7f5f4015d6b0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f5f400b4870 tx=0x7f5f3402a560 comp rx=0 tx=0).stop 2024-09-17T01:38:07.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.626+0000 7f5f46400640 1 -- 172.21.15.42:0/3063960585 shutdown_connections 2024-09-17T01:38:07.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.626+0000 7f5f46400640 1 --2- 172.21.15.42:0/3063960585 >> v2:172.21.15.43:3300/0 conn(0x7f5f400cf7c0 0x7f5f4006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:07.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.626+0000 7f5f46400640 1 --2- 172.21.15.42:0/3063960585 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5f4006d260 0x7f5f40152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:07.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.626+0000 7f5f46400640 1 --2- 172.21.15.42:0/3063960585 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f400b4be0 0x7f5f4015d6b0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:07.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.626+0000 7f5f46400640 1 -- 172.21.15.42:0/3063960585 >> 172.21.15.42:0/3063960585 conn(0x7f5f400b25f0 msgr2=0x7f5f400d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:07.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.626+0000 7f5f46400640 1 -- 172.21.15.42:0/3063960585 shutdown_connections 2024-09-17T01:38:07.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.626+0000 7f5f46400640 1 -- 172.21.15.42:0/3063960585 wait complete. 2024-09-17T01:38:07.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.629+0000 7f5f46400640 1 Processor -- start 2024-09-17T01:38:07.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.629+0000 7f5f46400640 1 -- start start 2024-09-17T01:38:07.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.630+0000 7f5f46400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f4006d260 0x7f5f4014e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:07.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.630+0000 7f5f46400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f400b4be0 0x7f5f400748c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:07.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.630+0000 7f5f46400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5f400cf7c0 0x7f5f401f6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:07.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.630+0000 7f5f46400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5f401537a0 con 0x7f5f4006d260 2024-09-17T01:38:07.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.630+0000 7f5f46400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5f40153620 con 0x7f5f400b4be0 2024-09-17T01:38:07.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.630+0000 7f5f46400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5f40153920 con 0x7f5f400cf7c0 2024-09-17T01:38:07.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.630+0000 7f5f45000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f4006d260 0x7f5f4014e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:07.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.630+0000 7f5f45000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f4006d260 0x7f5f4014e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41956/0 (socket says 172.21.15.42:41956) 2024-09-17T01:38:07.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.630+0000 7f5f45000640 1 -- 172.21.15.42:0/1476883914 learned_addr learned my addr 172.21.15.42:0/1476883914 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:07.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.631+0000 7f5f3fe00640 1 --2- 172.21.15.42:0/1476883914 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f400b4be0 0x7f5f400748c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:07.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.631+0000 7f5f45a00640 1 --2- 172.21.15.42:0/1476883914 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5f400cf7c0 0x7f5f401f6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:07.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.631+0000 7f5f45000640 1 -- 172.21.15.42:0/1476883914 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5f400cf7c0 msgr2=0x7f5f401f6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:07.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.631+0000 7f5f45000640 1 --2- 172.21.15.42:0/1476883914 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5f400cf7c0 0x7f5f401f6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:07.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.631+0000 7f5f45000640 1 -- 172.21.15.42:0/1476883914 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f400b4be0 msgr2=0x7f5f400748c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:07.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.631+0000 7f5f45000640 1 --2- 172.21.15.42:0/1476883914 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f400b4be0 0x7f5f400748c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:07.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.631+0000 7f5f45000640 1 -- 172.21.15.42:0/1476883914 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4014e570 con 0x7f5f4006d260 2024-09-17T01:38:07.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.631+0000 7f5f3fe00640 1 --2- 172.21.15.42:0/1476883914 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f400b4be0 0x7f5f400748c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:07.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.631+0000 7f5f45a00640 1 --2- 172.21.15.42:0/1476883914 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5f400cf7c0 0x7f5f401f6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:07.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.631+0000 7f5f45000640 1 --2- 172.21.15.42:0/1476883914 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f4006d260 0x7f5f4014e030 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f5f34034040 tx=0x7f5f34003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:07.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.631+0000 7f5f3cc00640 1 -- 172.21.15.42:0/1476883914 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3403e030 con 0x7f5f4006d260 2024-09-17T01:38:07.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.631+0000 7f5f3cc00640 1 -- 172.21.15.42:0/1476883914 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f34003e00 con 0x7f5f4006d260 2024-09-17T01:38:07.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.631+0000 7f5f3cc00640 1 -- 172.21.15.42:0/1476883914 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f34035040 con 0x7f5f4006d260 2024-09-17T01:38:07.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.632+0000 7f5f46400640 1 -- 172.21.15.42:0/1476883914 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f4014e9f0 con 0x7f5f4006d260 2024-09-17T01:38:07.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.632+0000 7f5f46400640 1 -- 172.21.15.42:0/1476883914 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f4014efb0 con 0x7f5f4006d260 2024-09-17T01:38:07.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.633+0000 7f5f46400640 1 -- 172.21.15.42:0/1476883914 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f4015d690 con 0x7f5f4006d260 2024-09-17T01:38:07.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.634+0000 7f5f3cc00640 1 -- 172.21.15.42:0/1476883914 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5f34041030 con 0x7f5f4006d260 2024-09-17T01:38:07.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.635+0000 7f5f3cc00640 1 --2- 172.21.15.42:0/1476883914 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5f20078b90 0x7f5f2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:07.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.635+0000 7f5f3cc00640 1 -- 172.21.15.42:0/1476883914 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5795+0+0 (secure 0 0 0) 0x7f5f340bb750 con 0x7f5f4006d260 2024-09-17T01:38:07.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.635+0000 7f5f3fe00640 1 --2- 172.21.15.42:0/1476883914 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5f20078b90 0x7f5f2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:07.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.636+0000 7f5f3fe00640 1 --2- 172.21.15.42:0/1476883914 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5f20078b90 0x7f5f2007b0a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5f400b4730 tx=0x7f5f2c005f10 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:07.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.640+0000 7f5f3cc00640 1 -- 172.21.15.42:0/1476883914 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5f34083a10 con 0x7f5f4006d260 2024-09-17T01:38:07.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.873+0000 7f5f46400640 1 -- 172.21.15.42:0/1476883914 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f401523d0 con 0x7f5f4006d260 2024-09-17T01:38:07.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.873+0000 7f5f3cc00640 1 -- 172.21.15.42:0/1476883914 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5219 (secure 0 0 0) 0x7f5f34083310 con 0x7f5f4006d260 2024-09-17T01:38:07.871 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:38:07.871 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":77,"btime":"2024-09-17T01:38:07:390922+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3191013971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":3191013971},{"type":"v1","addr":"172.21.15.43:6837","nonce":3191013971}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7042,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2889481399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2889481399},{"type":"v1","addr":"172.21.15.43:6835","nonce":2889481399}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1913337319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1913337319},{"type":"v1","addr":"172.21.15.42:6835","nonce":1913337319}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:37:52.812411+0000","modified":"2024-09-17T01:38:06.403419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7404},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7404":{"gid":7404,"name":"a","rank":0,"incarnation":76,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.42:6834/487915371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":487915371},{"type":"v1","addr":"172.21.15.42:6834","nonce":487915371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-17T01:38:07.872 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 77 2024-09-17T01:38:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.876+0000 7f5f46400640 1 -- 172.21.15.42:0/1476883914 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5f20078b90 msgr2=0x7f5f2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.876+0000 7f5f46400640 1 --2- 172.21.15.42:0/1476883914 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5f20078b90 0x7f5f2007b0a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5f400b4730 tx=0x7f5f2c005f10 comp rx=0 tx=0).stop 2024-09-17T01:38:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.876+0000 7f5f46400640 1 -- 172.21.15.42:0/1476883914 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f4006d260 msgr2=0x7f5f4014e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.876+0000 7f5f46400640 1 --2- 172.21.15.42:0/1476883914 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f4006d260 0x7f5f4014e030 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f5f34034040 tx=0x7f5f34003910 comp rx=0 tx=0).stop 2024-09-17T01:38:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.876+0000 7f5f46400640 1 -- 172.21.15.42:0/1476883914 shutdown_connections 2024-09-17T01:38:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.876+0000 7f5f46400640 1 --2- 172.21.15.42:0/1476883914 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5f20078b90 0x7f5f2007b0a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.876+0000 7f5f46400640 1 --2- 172.21.15.42:0/1476883914 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f400b4be0 0x7f5f400748c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.876+0000 7f5f46400640 1 --2- 172.21.15.42:0/1476883914 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5f400cf7c0 0x7f5f401f6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.876+0000 7f5f46400640 1 --2- 172.21.15.42:0/1476883914 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f4006d260 0x7f5f4014e030 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:07.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.876+0000 7f5f46400640 1 -- 172.21.15.42:0/1476883914 >> 172.21.15.42:0/1476883914 conn(0x7f5f400b25f0 msgr2=0x7f5f400cca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:07.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.876+0000 7f5f46400640 1 -- 172.21.15.42:0/1476883914 shutdown_connections 2024-09-17T01:38:07.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:07.876+0000 7f5f46400640 1 -- 172.21.15.42:0/1476883914 wait complete. 2024-09-17T01:38:08.299 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 77, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:37:52.812411+0000', 'modified': '2024-09-17T01:38:06.403419+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 97, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7404}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7404': {'gid': 7404, 'name': 'a', 'rank': 0, 'incarnation': 76, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.42:6834/487915371', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6832', 'nonce': 487915371}, {'type': 'v1', 'addr': '172.21.15.42:6834', 'nonce': 487915371}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T01:38:08.300 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7404:up:reconnect 2024-09-17T01:38:09.300 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:38:09.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.547+0000 7faae4e00640 1 -- 172.21.15.42:0/1356463023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faac4003a30 msgr2=0x7faac4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:09.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.547+0000 7faae4e00640 1 --2- 172.21.15.42:0/1356463023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faac4003a30 0x7faac4003ea0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7faad00016f0 tx=0x7faac4005830 comp rx=0 tx=0).stop 2024-09-17T01:38:09.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.547+0000 7faade800640 1 -- 172.21.15.42:0/1356463023 reap_dead start 2024-09-17T01:38:09.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.547+0000 7faae4e00640 1 -- 172.21.15.42:0/1356463023 shutdown_connections 2024-09-17T01:38:09.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.547+0000 7faae4e00640 1 -- 172.21.15.42:0/1356463023 >> 172.21.15.42:0/1356463023 conn(0x7faae00b2930 msgr2=0x7faae006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:09.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.547+0000 7faae4e00640 1 -- 172.21.15.42:0/1356463023 shutdown_connections 2024-09-17T01:38:09.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.547+0000 7faae4e00640 1 -- 172.21.15.42:0/1356463023 wait complete. 2024-09-17T01:38:09.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.550+0000 7faae4e00640 1 Processor -- start 2024-09-17T01:38:09.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.550+0000 7faae4e00640 1 -- start start 2024-09-17T01:38:09.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.551+0000 7faae4e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faac4003a30 0x7faae0156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:09.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.551+0000 7faae4e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faae0156f40 0x7faae0151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:09.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.551+0000 7faae4e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faae0152850 0x7faae0152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:09.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.551+0000 7faae4e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faae00cf1d0 con 0x7faae0152850 2024-09-17T01:38:09.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.551+0000 7faae4e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faae00cf050 con 0x7faae0156f40 2024-09-17T01:38:09.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.551+0000 7faae4e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7faae0073960 con 0x7faac4003a30 2024-09-17T01:38:09.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.552+0000 7faade800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faae0152850 0x7faae0152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:09.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.552+0000 7faade800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faae0152850 0x7faae0152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41972/0 (socket says 172.21.15.42:41972) 2024-09-17T01:38:09.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.552+0000 7faade800640 1 -- 172.21.15.42:0/537572095 learned_addr learned my addr 172.21.15.42:0/537572095 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:09.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.552+0000 7faadde00640 1 --2- 172.21.15.42:0/537572095 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faac4003a30 0x7faae0156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:09.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.552+0000 7faad7e00640 1 --2- 172.21.15.42:0/537572095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faae0156f40 0x7faae0151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:09.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.552+0000 7faade800640 1 -- 172.21.15.42:0/537572095 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faac4003a30 msgr2=0x7faae0156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:09.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.552+0000 7faade800640 1 --2- 172.21.15.42:0/537572095 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faac4003a30 0x7faae0156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:09.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.552+0000 7faade800640 1 -- 172.21.15.42:0/537572095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faae0156f40 msgr2=0x7faae0151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:09.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.552+0000 7faade800640 1 --2- 172.21.15.42:0/537572095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faae0156f40 0x7faae0151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:09.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.552+0000 7faade800640 1 -- 172.21.15.42:0/537572095 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae0152f60 con 0x7faae0152850 2024-09-17T01:38:09.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.552+0000 7faad7e00640 1 --2- 172.21.15.42:0/537572095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faae0156f40 0x7faae0151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:09.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.552+0000 7faade800640 1 --2- 172.21.15.42:0/537572095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faae0152850 0x7faae0152230 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7faad8001330 tx=0x7faad8006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:09.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.553+0000 7faad6000640 1 -- 172.21.15.42:0/537572095 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad800fc90 con 0x7faae0152850 2024-09-17T01:38:09.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.553+0000 7faad6000640 1 -- 172.21.15.42:0/537572095 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faad8018070 con 0x7faae0152850 2024-09-17T01:38:09.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.553+0000 7faad6000640 1 -- 172.21.15.42:0/537572095 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad8011690 con 0x7faae0152850 2024-09-17T01:38:09.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.553+0000 7faae4e00640 1 -- 172.21.15.42:0/537572095 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faae015c1b0 con 0x7faae0152850 2024-09-17T01:38:09.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.553+0000 7faae4e00640 1 -- 172.21.15.42:0/537572095 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faae00ac440 con 0x7faae0152850 2024-09-17T01:38:09.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.554+0000 7faae4e00640 1 -- 172.21.15.42:0/537572095 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faae00ac230 con 0x7faae0152850 2024-09-17T01:38:09.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.555+0000 7faad6000640 1 -- 172.21.15.42:0/537572095 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faad8011830 con 0x7faae0152850 2024-09-17T01:38:09.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.556+0000 7faad6000640 1 --2- 172.21.15.42:0/537572095 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faabc078b90 0x7faabc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:09.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.556+0000 7faad6000640 1 -- 172.21.15.42:0/537572095 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5795+0+0 (secure 0 0 0) 0x7faad809b800 con 0x7faae0152850 2024-09-17T01:38:09.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.557+0000 7faadde00640 1 --2- 172.21.15.42:0/537572095 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faabc078b90 0x7faabc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:09.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.558+0000 7faadde00640 1 --2- 172.21.15.42:0/537572095 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faabc078b90 0x7faabc07b0a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7faad0032000 tx=0x7faad0001190 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:09.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.561+0000 7faad6000640 1 -- 172.21.15.42:0/537572095 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faad8063bd0 con 0x7faae0152850 2024-09-17T01:38:09.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.792+0000 7faae4e00640 1 -- 172.21.15.42:0/537572095 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faae0073ef0 con 0x7faae0152850 2024-09-17T01:38:09.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.793+0000 7faad6000640 1 -- 172.21.15.42:0/537572095 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) ==== 94+0+5223 (secure 0 0 0) 0x7faad80634d0 con 0x7faae0152850 2024-09-17T01:38:09.791 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:38:09.791 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":79,"btime":"2024-09-17T01:38:09:405324+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3191013971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":3191013971},{"type":"v1","addr":"172.21.15.43:6837","nonce":3191013971}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7042,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2889481399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2889481399},{"type":"v1","addr":"172.21.15.43:6835","nonce":2889481399}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1913337319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1913337319},{"type":"v1","addr":"172.21.15.42:6835","nonce":1913337319}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:37:52.812411+0000","modified":"2024-09-17T01:38:09.405313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7404},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7404":{"gid":7404,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6834/487915371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":487915371},{"type":"v1","addr":"172.21.15.42:6834","nonce":487915371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7404,"qdb_cluster":[7404]},"id":6}]} 2024-09-17T01:38:09.791 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 79 2024-09-17T01:38:09.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.795+0000 7faae4e00640 1 -- 172.21.15.42:0/537572095 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faabc078b90 msgr2=0x7faabc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:09.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.795+0000 7faae4e00640 1 --2- 172.21.15.42:0/537572095 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faabc078b90 0x7faabc07b0a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7faad0032000 tx=0x7faad0001190 comp rx=0 tx=0).stop 2024-09-17T01:38:09.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.795+0000 7faae4e00640 1 -- 172.21.15.42:0/537572095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faae0152850 msgr2=0x7faae0152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:09.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.795+0000 7faae4e00640 1 --2- 172.21.15.42:0/537572095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faae0152850 0x7faae0152230 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7faad8001330 tx=0x7faad8006720 comp rx=0 tx=0).stop 2024-09-17T01:38:09.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.795+0000 7faae4e00640 1 -- 172.21.15.42:0/537572095 shutdown_connections 2024-09-17T01:38:09.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.795+0000 7faae4e00640 1 --2- 172.21.15.42:0/537572095 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faabc078b90 0x7faabc07b0a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:09.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.795+0000 7faae4e00640 1 --2- 172.21.15.42:0/537572095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faae0156f40 0x7faae0151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:09.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.795+0000 7faae4e00640 1 --2- 172.21.15.42:0/537572095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faae0152850 0x7faae0152230 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:09.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.795+0000 7faae4e00640 1 --2- 172.21.15.42:0/537572095 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faac4003a30 0x7faae0156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:09.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.795+0000 7faae4e00640 1 -- 172.21.15.42:0/537572095 >> 172.21.15.42:0/537572095 conn(0x7faae00b2930 msgr2=0x7faae006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:09.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.795+0000 7faae4e00640 1 -- 172.21.15.42:0/537572095 shutdown_connections 2024-09-17T01:38:09.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:09.795+0000 7faae4e00640 1 -- 172.21.15.42:0/537572095 wait complete. 2024-09-17T01:38:10.219 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 79, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:37:52.812411+0000', 'modified': '2024-09-17T01:38:09.405313+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 97, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7404}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7404': {'gid': 7404, 'name': 'a', 'rank': 0, 'incarnation': 76, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.42:6834/487915371', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6832', 'nonce': 487915371}, {'type': 'v1', 'addr': '172.21.15.42:6834', 'nonce': 487915371}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7404, 'qdb_cluster': [7404]} 2024-09-17T01:38:10.219 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T01:38:10.220 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T01:38:10.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.452+0000 7f948d400640 1 -- 172.21.15.42:0/769858916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9488142f40 msgr2=0x7f9488072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:10.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.452+0000 7f948d400640 1 --2- 172.21.15.42:0/769858916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9488142f40 0x7f9488072950 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f9470009830 tx=0x7f947002a480 comp rx=0 tx=0).stop 2024-09-17T01:38:10.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.452+0000 7f948d400640 1 -- 172.21.15.42:0/769858916 shutdown_connections 2024-09-17T01:38:10.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.452+0000 7f948d400640 1 --2- 172.21.15.42:0/769858916 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9488072e90 0x7f94880cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.452+0000 7f948d400640 1 --2- 172.21.15.42:0/769858916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9488142f40 0x7f9488072950 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.452+0000 7f948d400640 1 -- 172.21.15.42:0/769858916 >> 172.21.15.42:0/769858916 conn(0x7f94880b2930 msgr2=0x7f948806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:10.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.452+0000 7f948d400640 1 -- 172.21.15.42:0/769858916 shutdown_connections 2024-09-17T01:38:10.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.452+0000 7f948d400640 1 -- 172.21.15.42:0/769858916 wait complete. 2024-09-17T01:38:10.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.455+0000 7f948d400640 1 Processor -- start 2024-09-17T01:38:10.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.455+0000 7f948d400640 1 -- start start 2024-09-17T01:38:10.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.456+0000 7f948d400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9488072e90 0x7f9488131e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:10.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.456+0000 7f948d400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94880b3550 0x7f9488137740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:10.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.456+0000 7f948d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9488142f40 0x7f94881f99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:10.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.456+0000 7f948d400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f948806d640 con 0x7f9488142f40 2024-09-17T01:38:10.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.456+0000 7f948d400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f94880cf590 con 0x7f94880b3550 2024-09-17T01:38:10.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.456+0000 7f948d400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f948806d7c0 con 0x7f9488072e90 2024-09-17T01:38:10.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.456+0000 7f9487200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9488142f40 0x7f94881f99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:10.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.457+0000 7f9487200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9488142f40 0x7f94881f99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42000/0 (socket says 172.21.15.42:42000) 2024-09-17T01:38:10.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.457+0000 7f9487200640 1 -- 172.21.15.42:0/3726457709 learned_addr learned my addr 172.21.15.42:0/3726457709 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:10.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.457+0000 7f9486800640 1 --2- 172.21.15.42:0/3726457709 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9488072e90 0x7f9488131e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:10.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.457+0000 7f947de00640 1 --2- 172.21.15.42:0/3726457709 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94880b3550 0x7f9488137740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:10.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.457+0000 7f9487200640 1 -- 172.21.15.42:0/3726457709 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9488072e90 msgr2=0x7f9488131e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:10.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.457+0000 7f9487200640 1 --2- 172.21.15.42:0/3726457709 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9488072e90 0x7f9488131e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.457+0000 7f9487200640 1 -- 172.21.15.42:0/3726457709 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94880b3550 msgr2=0x7f9488137740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:10.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.457+0000 7f9487200640 1 --2- 172.21.15.42:0/3726457709 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94880b3550 0x7f9488137740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.457+0000 7f9487200640 1 -- 172.21.15.42:0/3726457709 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9488142050 con 0x7f9488142f40 2024-09-17T01:38:10.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.457+0000 7f9487200640 1 --2- 172.21.15.42:0/3726457709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9488142f40 0x7f94881f99b0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f948000e960 tx=0x7f948000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:10.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.457+0000 7f947f400640 1 -- 172.21.15.42:0/3726457709 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9480004d20 con 0x7f9488142f40 2024-09-17T01:38:10.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.457+0000 7f948d400640 1 -- 172.21.15.42:0/3726457709 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9488142300 con 0x7f9488142f40 2024-09-17T01:38:10.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.458+0000 7f947f400640 1 -- 172.21.15.42:0/3726457709 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f948000cac0 con 0x7f9488142f40 2024-09-17T01:38:10.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.458+0000 7f947f400640 1 -- 172.21.15.42:0/3726457709 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9480005020 con 0x7f9488142f40 2024-09-17T01:38:10.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.458+0000 7f948d400640 1 -- 172.21.15.42:0/3726457709 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f948813f1a0 con 0x7f9488142f40 2024-09-17T01:38:10.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.460+0000 7f947f400640 1 -- 172.21.15.42:0/3726457709 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f94800051c0 con 0x7f9488142f40 2024-09-17T01:38:10.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.461+0000 7f947f400640 1 --2- 172.21.15.42:0/3726457709 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9464078b90 0x7f946407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:10.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.461+0000 7f947f400640 1 -- 172.21.15.42:0/3726457709 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5795+0+0 (secure 0 0 0) 0x7f948009b650 con 0x7f9488142f40 2024-09-17T01:38:10.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.461+0000 7f9494401740 1 Processor -- start 2024-09-17T01:38:10.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.461+0000 7f9494401740 1 -- start start 2024-09-17T01:38:10.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.462+0000 7f9486800640 1 --2- 172.21.15.42:0/3726457709 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9464078b90 0x7f946407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:10.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.462+0000 7f9486800640 1 --2- 172.21.15.42:0/3726457709 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9464078b90 0x7f946407b0a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9478007fd0 tx=0x7f9478009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:10.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.463+0000 7f9494401740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f8e5151270 0x55f8e5521970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:10.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.463+0000 7f9494401740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 0x55f8e5521eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:10.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.463+0000 7f9494401740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8e5130590 0x55f8e54f1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:10.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.463+0000 7f9494401740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f8e547b430 con 0x55f8e51283b0 2024-09-17T01:38:10.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.463+0000 7f9494401740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f8e546b5d0 con 0x55f8e5130590 2024-09-17T01:38:10.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.463+0000 7f9494401740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55f8e545aa00 con 0x55f8e5151270 2024-09-17T01:38:10.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.463+0000 7f947de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 0x55f8e5521eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:10.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.463+0000 7f9486800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f8e5151270 0x55f8e5521970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:10.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.463+0000 7f947de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 0x55f8e5521eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42006/0 (socket says 172.21.15.42:42006) 2024-09-17T01:38:10.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.463+0000 7f947de00640 1 -- 172.21.15.42:0/3673764701 learned_addr learned my addr 172.21.15.42:0/3673764701 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:10.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.463+0000 7f9487200640 1 --2- 172.21.15.42:0/3673764701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8e5130590 0x55f8e54f1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:10.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.464+0000 7f947de00640 1 -- 172.21.15.42:0/3673764701 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f8e5151270 msgr2=0x55f8e5521970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:10.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.464+0000 7f947de00640 1 --2- 172.21.15.42:0/3673764701 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f8e5151270 0x55f8e5521970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.464+0000 7f947de00640 1 -- 172.21.15.42:0/3673764701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8e5130590 msgr2=0x55f8e54f1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:10.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.464+0000 7f947de00640 1 --2- 172.21.15.42:0/3673764701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8e5130590 0x55f8e54f1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.464+0000 7f947de00640 1 -- 172.21.15.42:0/3673764701 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8e5423520 con 0x55f8e51283b0 2024-09-17T01:38:10.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.464+0000 7f947de00640 1 --2- 172.21.15.42:0/3673764701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 0x55f8e5521eb0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f9470009830 tx=0x7f94700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3599e62942e48d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:10.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.464+0000 7f9477000640 1 -- 172.21.15.42:0/3673764701 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9470005020 con 0x55f8e51283b0 2024-09-17T01:38:10.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.464+0000 7f9477000640 1 -- 172.21.15.42:0/3673764701 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9470040070 con 0x55f8e51283b0 2024-09-17T01:38:10.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.464+0000 7f9477000640 1 -- 172.21.15.42:0/3673764701 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9470005530 con 0x55f8e51283b0 2024-09-17T01:38:10.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.465+0000 7f9494401740 1 -- 172.21.15.42:0/3673764701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 msgr2=0x55f8e5521eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:10.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.465+0000 7f9494401740 1 --2- 172.21.15.42:0/3673764701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 0x55f8e5521eb0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f9470009830 tx=0x7f94700046c0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.465+0000 7f9494401740 1 -- 172.21.15.42:0/3673764701 shutdown_connections 2024-09-17T01:38:10.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.465+0000 7f9494401740 1 --2- 172.21.15.42:0/3673764701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8e5130590 0x55f8e54f1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.465+0000 7f9494401740 1 --2- 172.21.15.42:0/3673764701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 0x55f8e5521eb0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.465+0000 7f9494401740 1 --2- 172.21.15.42:0/3673764701 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f8e5151270 0x55f8e5521970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.465+0000 7f9494401740 1 -- 172.21.15.42:0/3673764701 >> 172.21.15.42:0/3673764701 conn(0x55f8e51453c0 msgr2=0x55f8e54f7970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:10.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.465+0000 7f9494401740 1 -- 172.21.15.42:0/3673764701 shutdown_connections 2024-09-17T01:38:10.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.465+0000 7f9494401740 1 -- 172.21.15.42:0/3673764701 wait complete. 2024-09-17T01:38:10.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.466+0000 7f9494401740 1 -- start start 2024-09-17T01:38:10.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.466+0000 7f9494401740 1 Processor -- start 2024-09-17T01:38:10.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.468+0000 7f9494401740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 0x55f8e554bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:10.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.468+0000 7f9494401740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8e5130590 0x55f8e554fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:10.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.468+0000 7f9494401740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f8e5151270 0x55f8e551d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:10.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.468+0000 7f9494401740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f8e5401330 con 0x55f8e51283b0 2024-09-17T01:38:10.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.468+0000 7f9494401740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f8e545e810 con 0x55f8e5130590 2024-09-17T01:38:10.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.468+0000 7f9494401740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55f8e51cb620 con 0x55f8e5151270 2024-09-17T01:38:10.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.468+0000 7f9494401740 10 client.0 _ll_register_callbacks cb 0x55f8e5406420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:38:10.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.468+0000 7f9486800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 0x55f8e554bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:10.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.468+0000 7f9486800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 0x55f8e554bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42008/0 (socket says 172.21.15.42:42008) 2024-09-17T01:38:10.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.468+0000 7f9486800640 1 -- 172.21.15.42:0/598305383 learned_addr learned my addr 172.21.15.42:0/598305383 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:10.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.468+0000 7f947de00640 1 --2- 172.21.15.42:0/598305383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8e5130590 0x55f8e554fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:10.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.468+0000 7f9487200640 1 --2- 172.21.15.42:0/598305383 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f8e5151270 0x55f8e551d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:10.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.468+0000 7f9486800640 1 -- 172.21.15.42:0/598305383 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f8e5151270 msgr2=0x55f8e551d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:10.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.468+0000 7f9486800640 1 --2- 172.21.15.42:0/598305383 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f8e5151270 0x55f8e551d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.468+0000 7f9486800640 1 -- 172.21.15.42:0/598305383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8e5130590 msgr2=0x55f8e554fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:10.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.468+0000 7f9486800640 1 --2- 172.21.15.42:0/598305383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8e5130590 0x55f8e554fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.468+0000 7f9486800640 1 -- 172.21.15.42:0/598305383 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8e51bc850 con 0x55f8e51283b0 2024-09-17T01:38:10.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.468+0000 7f947de00640 1 --2- 172.21.15.42:0/598305383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8e5130590 0x55f8e554fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:38:10.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.469+0000 7f9487200640 1 --2- 172.21.15.42:0/598305383 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f8e5151270 0x55f8e551d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:38:10.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.469+0000 7f9486800640 1 --2- 172.21.15.42:0/598305383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 0x55f8e554bc20 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f94780039a0 tx=0x7f9478001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5600741d182f55 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:10.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.469+0000 7f946b400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:38:10.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.469+0000 7f946b400640 1 -- 172.21.15.42:0/598305383 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9478027060 con 0x55f8e51283b0 2024-09-17T01:38:10.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.469+0000 7f946b400640 1 -- 172.21.15.42:0/598305383 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 5795+0+0 (secure 0 0 0) 0x7f9478010040 con 0x55f8e51283b0 2024-09-17T01:38:10.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.469+0000 7f9494401740 1 -- 172.21.15.42:0/598305383 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9470040070 con 0x55f8e51283b0 2024-09-17T01:38:10.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.469+0000 7f946b400640 1 -- 172.21.15.42:0/598305383 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f947800ec90 con 0x55f8e51283b0 2024-09-17T01:38:10.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.469+0000 7f9494401740 10 client.7440 fetch_fsmap learned FSMap version 79 2024-09-17T01:38:10.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.469+0000 7f9494401740 1 -- 172.21.15.42:0/598305383 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) -- 0x55f8e52336b0 con 0x55f8e51283b0 2024-09-17T01:38:10.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.470+0000 7f946b400640 1 -- 172.21.15.42:0/598305383 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9470040070 con 0x55f8e51283b0 2024-09-17T01:38:10.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.470+0000 7f946b400640 1 -- 172.21.15.42:0/598305383 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 79) ==== 3502+0+0 (secure 0 0 0) 0x7f9478013420 con 0x55f8e51283b0 2024-09-17T01:38:10.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.470+0000 7f9494401740 10 client.7440 fetch_fsmap finished waiting for FSMap version 79 2024-09-17T01:38:10.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.470+0000 7f9494401740 10 client.7440 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T01:38:10.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.470+0000 7f9494401740 20 client.7440 populate_metadata read hostname 'smithi042' 2024-09-17T01:38:10.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.470+0000 7f9494401740 1 --2- 172.21.15.42:0/598305383 >> [v2:172.21.15.42:6832/487915371,v1:172.21.15.42:6834/487915371] conn(0x55f8e510fe40 0x55f8e5535cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:10.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.470+0000 7f9494401740 4 client.7440 mds_command: new command op to 7404 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:38:10.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.470+0000 7f9494401740 1 -- 172.21.15.42:0/598305383 --> [v2:172.21.15.42:6832/487915371,v1:172.21.15.42:6834/487915371] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8e546d520 con 0x55f8e510fe40 2024-09-17T01:38:10.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.470+0000 7f947de00640 1 --2- 172.21.15.42:0/598305383 >> [v2:172.21.15.42:6832/487915371,v1:172.21.15.42:6834/487915371] conn(0x55f8e510fe40 0x55f8e5535cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:10.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.471+0000 7f947de00640 1 --2- 172.21.15.42:0/598305383 >> [v2:172.21.15.42:6832/487915371,v1:172.21.15.42:6834/487915371] conn(0x55f8e510fe40 0x55f8e5535cf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e1942c12077b78e server_cookie=a3b191732ec49957 in_seq=0 out_seq=0 2024-09-17T01:38:10.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.471+0000 7f946b400640 10 client.7440 ms_handle_connect on v2:172.21.15.42:6832/487915371 2024-09-17T01:38:10.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.472+0000 7f946b400640 1 -- 172.21.15.42:0/598305383 <== mds.0 v2:172.21.15.42:6832/487915371 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f8e546d520 con 0x55f8e510fe40 2024-09-17T01:38:10.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.472+0000 7f946b400640 10 client.7440 handle_command_reply: tid=0 2024-09-17T01:38:10.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.472+0000 7f9494401740 1 client.7440 shutdown 2024-09-17T01:38:10.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.472+0000 7f9494401740 1 -- 172.21.15.42:0/598305383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 msgr2=0x55f8e554bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:10.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.472+0000 7f9494401740 1 --2- 172.21.15.42:0/598305383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 0x55f8e554bc20 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f94780039a0 tx=0x7f9478001080 comp rx=0 tx=0).stop 2024-09-17T01:38:10.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.472+0000 7f9494401740 1 -- 172.21.15.42:0/598305383 shutdown_connections 2024-09-17T01:38:10.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.472+0000 7f9494401740 1 --2- 172.21.15.42:0/598305383 >> [v2:172.21.15.42:6832/487915371,v1:172.21.15.42:6834/487915371] conn(0x55f8e510fe40 0x55f8e5535cf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.472+0000 7f9494401740 1 --2- 172.21.15.42:0/598305383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8e5130590 0x55f8e554fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.472+0000 7f9494401740 1 --2- 172.21.15.42:0/598305383 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f8e5151270 0x55f8e551d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.472+0000 7f9494401740 1 --2- 172.21.15.42:0/598305383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 0x55f8e554bc20 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.472+0000 7f946b400640 0 client.7440 ms_handle_reset on v2:172.21.15.42:6832/487915371 2024-09-17T01:38:10.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.472+0000 7f9494401740 1 -- 172.21.15.42:0/598305383 >> 172.21.15.42:0/598305383 conn(0x55f8e51453c0 msgr2=0x55f8e5532f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:10.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.472+0000 7f9494401740 1 -- 172.21.15.42:0/598305383 shutdown_connections 2024-09-17T01:38:10.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.472+0000 7f9494401740 1 -- 172.21.15.42:0/598305383 wait complete. 2024-09-17T01:38:10.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.472+0000 7f9494401740 20 client.7440 trim_cache size 0 max 16384 2024-09-17T01:38:10.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.492+0000 7f9494401740 1 Processor -- start 2024-09-17T01:38:10.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.492+0000 7f9494401740 1 -- start start 2024-09-17T01:38:10.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.493+0000 7f9494401740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 0x55f8e551ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:10.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.493+0000 7f9494401740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8e5130590 0x55f8e5518dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:10.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.493+0000 7f9494401740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f8e5151270 0x55f8e555f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:10.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.493+0000 7f9494401740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f94882014a0 con 0x55f8e51283b0 2024-09-17T01:38:10.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.493+0000 7f9494401740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f948806e4a0 con 0x55f8e5130590 2024-09-17T01:38:10.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.493+0000 7f9494401740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f948806eaf0 con 0x55f8e5151270 2024-09-17T01:38:10.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.494+0000 7f9486800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 0x55f8e551ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:10.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.494+0000 7f9486800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 0x55f8e551ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42012/0 (socket says 172.21.15.42:42012) 2024-09-17T01:38:10.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.494+0000 7f9486800640 1 -- 172.21.15.42:0/2489160806 learned_addr learned my addr 172.21.15.42:0/2489160806 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:10.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.494+0000 7f9487200640 1 --2- 172.21.15.42:0/2489160806 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f8e5151270 0x55f8e555f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:10.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.494+0000 7f947de00640 1 --2- 172.21.15.42:0/2489160806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8e5130590 0x55f8e5518dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:10.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.494+0000 7f9486800640 1 -- 172.21.15.42:0/2489160806 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f8e5151270 msgr2=0x55f8e555f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:10.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.494+0000 7f9486800640 1 --2- 172.21.15.42:0/2489160806 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f8e5151270 0x55f8e555f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.494+0000 7f9486800640 1 -- 172.21.15.42:0/2489160806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8e5130590 msgr2=0x55f8e5518dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:10.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.494+0000 7f9486800640 1 --2- 172.21.15.42:0/2489160806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8e5130590 0x55f8e5518dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.494+0000 7f9486800640 1 -- 172.21.15.42:0/2489160806 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8e551b430 con 0x55f8e51283b0 2024-09-17T01:38:10.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.494+0000 7f9486800640 1 --2- 172.21.15.42:0/2489160806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 0x55f8e551ca30 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f94780051e0 tx=0x7f9478005210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3b06ed7ba548 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:10.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.494+0000 7f9476600640 1 -- 172.21.15.42:0/2489160806 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9478013420 con 0x55f8e51283b0 2024-09-17T01:38:10.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.495+0000 7f9476600640 1 -- 172.21.15.42:0/2489160806 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9478013970 con 0x55f8e51283b0 2024-09-17T01:38:10.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.495+0000 7f9476600640 1 -- 172.21.15.42:0/2489160806 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947802d430 con 0x55f8e51283b0 2024-09-17T01:38:10.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.495+0000 7f9494401740 1 -- 172.21.15.42:0/2489160806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 msgr2=0x55f8e551ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:10.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.495+0000 7f9494401740 1 --2- 172.21.15.42:0/2489160806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 0x55f8e551ca30 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f94780051e0 tx=0x7f9478005210 comp rx=0 tx=0).stop 2024-09-17T01:38:10.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.495+0000 7f9494401740 1 -- 172.21.15.42:0/2489160806 shutdown_connections 2024-09-17T01:38:10.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.495+0000 7f9494401740 1 --2- 172.21.15.42:0/2489160806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8e5130590 0x55f8e5518dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.495+0000 7f9494401740 1 --2- 172.21.15.42:0/2489160806 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f8e5151270 0x55f8e555f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.495+0000 7f9494401740 1 --2- 172.21.15.42:0/2489160806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 0x55f8e551ca30 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.495+0000 7f9494401740 1 -- 172.21.15.42:0/2489160806 >> 172.21.15.42:0/2489160806 conn(0x55f8e51453c0 msgr2=0x55f8e54f7940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:10.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.495+0000 7f9494401740 1 -- 172.21.15.42:0/2489160806 shutdown_connections 2024-09-17T01:38:10.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.495+0000 7f9494401740 1 -- 172.21.15.42:0/2489160806 wait complete. 2024-09-17T01:38:10.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.496+0000 7f9494401740 1 -- start start 2024-09-17T01:38:10.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.497+0000 7f9494401740 1 Processor -- start 2024-09-17T01:38:10.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.498+0000 7f9494401740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 0x55f8e551dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:10.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.498+0000 7f9494401740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8e5130590 0x55f8e551e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:10.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.498+0000 7f9494401740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f8e5151270 0x55f8e5534920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:10.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.498+0000 7f9494401740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f8e551a6e0 con 0x55f8e51283b0 2024-09-17T01:38:10.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.498+0000 7f9494401740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f8e554c9d0 con 0x55f8e5130590 2024-09-17T01:38:10.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.498+0000 7f9494401740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55f8e551b210 con 0x55f8e5151270 2024-09-17T01:38:10.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.498+0000 7f9494401740 10 client.0 _ll_register_callbacks cb 0x7f94780035f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:38:10.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.498+0000 7f9486800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 0x55f8e551dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:10.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.498+0000 7f9486800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 0x55f8e551dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42020/0 (socket says 172.21.15.42:42020) 2024-09-17T01:38:10.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.498+0000 7f9486800640 1 -- 172.21.15.42:0/3271994872 learned_addr learned my addr 172.21.15.42:0/3271994872 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:10.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.498+0000 7f947de00640 1 --2- 172.21.15.42:0/3271994872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8e5130590 0x55f8e551e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:10.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.498+0000 7f9487200640 1 --2- 172.21.15.42:0/3271994872 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f8e5151270 0x55f8e5534920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:10.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.499+0000 7f9486800640 1 -- 172.21.15.42:0/3271994872 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f8e5151270 msgr2=0x55f8e5534920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:10.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.499+0000 7f9486800640 1 --2- 172.21.15.42:0/3271994872 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f8e5151270 0x55f8e5534920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.499+0000 7f9486800640 1 -- 172.21.15.42:0/3271994872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8e5130590 msgr2=0x55f8e551e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:10.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.499+0000 7f9486800640 1 --2- 172.21.15.42:0/3271994872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8e5130590 0x55f8e551e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.499+0000 7f9486800640 1 -- 172.21.15.42:0/3271994872 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8e5519640 con 0x55f8e51283b0 2024-09-17T01:38:10.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.499+0000 7f9487200640 1 --2- 172.21.15.42:0/3271994872 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f8e5151270 0x55f8e5534920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:10.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.499+0000 7f9486800640 1 --2- 172.21.15.42:0/3271994872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 0x55f8e551dbc0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f9478005600 tx=0x7f947802d660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3dbcbc1f6e6c48 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:10.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.499+0000 7f946b400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:38:10.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.499+0000 7f946b400640 1 -- 172.21.15.42:0/3271994872 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9478039030 con 0x55f8e51283b0 2024-09-17T01:38:10.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.499+0000 7f946b400640 1 -- 172.21.15.42:0/3271994872 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 5795+0+0 (secure 0 0 0) 0x7f9478032050 con 0x55f8e51283b0 2024-09-17T01:38:10.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.499+0000 7f9494401740 1 -- 172.21.15.42:0/3271994872 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9478013970 con 0x55f8e51283b0 2024-09-17T01:38:10.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.500+0000 7f946b400640 1 -- 172.21.15.42:0/3271994872 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f9478044050 con 0x55f8e51283b0 2024-09-17T01:38:10.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.500+0000 7f9494401740 10 client.7446 fetch_fsmap learned FSMap version 79 2024-09-17T01:38:10.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.500+0000 7f9494401740 1 -- 172.21.15.42:0/3271994872 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) -- 0x55f8e554ba90 con 0x55f8e51283b0 2024-09-17T01:38:10.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.500+0000 7f946b400640 1 -- 172.21.15.42:0/3271994872 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9478013970 con 0x55f8e51283b0 2024-09-17T01:38:10.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.500+0000 7f946b400640 1 -- 172.21.15.42:0/3271994872 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 79) ==== 3502+0+0 (secure 0 0 0) 0x7f9478047020 con 0x55f8e51283b0 2024-09-17T01:38:10.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.500+0000 7f9494401740 10 client.7446 fetch_fsmap finished waiting for FSMap version 79 2024-09-17T01:38:10.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.500+0000 7f9494401740 10 client.7446 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T01:38:10.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.500+0000 7f9494401740 20 client.7446 populate_metadata read hostname 'smithi042' 2024-09-17T01:38:10.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.500+0000 7f9494401740 1 --2- 172.21.15.42:0/3271994872 >> [v2:172.21.15.42:6832/487915371,v1:172.21.15.42:6834/487915371] conn(0x55f8e55bbc50 0x55f8e55bc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:10.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.500+0000 7f9494401740 4 client.7446 mds_command: new command op to 7404 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T01:38:10.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.500+0000 7f9494401740 1 -- 172.21.15.42:0/3271994872 --> [v2:172.21.15.42:6832/487915371,v1:172.21.15.42:6834/487915371] -- command(tid 0: {"prefix": "status"}) -- 0x55f8e5468fd0 con 0x55f8e55bbc50 2024-09-17T01:38:10.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.500+0000 7f947de00640 1 --2- 172.21.15.42:0/3271994872 >> [v2:172.21.15.42:6832/487915371,v1:172.21.15.42:6834/487915371] conn(0x55f8e55bbc50 0x55f8e55bc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:10.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.501+0000 7f947de00640 1 --2- 172.21.15.42:0/3271994872 >> [v2:172.21.15.42:6832/487915371,v1:172.21.15.42:6834/487915371] conn(0x55f8e55bbc50 0x55f8e55bc060 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb070021051aafc1 server_cookie=1a24d95ce9e1c85a in_seq=0 out_seq=0 2024-09-17T01:38:10.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.501+0000 7f946b400640 10 client.7446 ms_handle_connect on v2:172.21.15.42:6832/487915371 2024-09-17T01:38:10.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.501+0000 7f946b400640 1 -- 172.21.15.42:0/3271994872 <== mds.0 v2:172.21.15.42:6832/487915371 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55f8e5468fd0 con 0x55f8e55bbc50 2024-09-17T01:38:10.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.501+0000 7f946b400640 10 client.7446 handle_command_reply: tid=0 2024-09-17T01:38:10.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.501+0000 7f9494401740 1 client.7446 shutdown 2024-09-17T01:38:10.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.501+0000 7f9494401740 1 -- 172.21.15.42:0/3271994872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 msgr2=0x55f8e551dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:10.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.501+0000 7f9494401740 1 --2- 172.21.15.42:0/3271994872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 0x55f8e551dbc0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f9478005600 tx=0x7f947802d660 comp rx=0 tx=0).stop 2024-09-17T01:38:10.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.501+0000 7f9494401740 1 -- 172.21.15.42:0/3271994872 shutdown_connections 2024-09-17T01:38:10.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.501+0000 7f9494401740 1 --2- 172.21.15.42:0/3271994872 >> [v2:172.21.15.42:6832/487915371,v1:172.21.15.42:6834/487915371] conn(0x55f8e55bbc50 0x55f8e55bc060 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.501+0000 7f9494401740 1 --2- 172.21.15.42:0/3271994872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f8e5130590 0x55f8e551e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.501+0000 7f9494401740 1 --2- 172.21.15.42:0/3271994872 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f8e5151270 0x55f8e5534920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.501+0000 7f946b400640 0 client.7446 ms_handle_reset on v2:172.21.15.42:6832/487915371 2024-09-17T01:38:10.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.501+0000 7f9494401740 1 --2- 172.21.15.42:0/3271994872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8e51283b0 0x55f8e551dbc0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.501+0000 7f9494401740 1 -- 172.21.15.42:0/3271994872 >> 172.21.15.42:0/3271994872 conn(0x55f8e51453c0 msgr2=0x55f8e54ed350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:10.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.502+0000 7f9494401740 1 -- 172.21.15.42:0/3271994872 shutdown_connections 2024-09-17T01:38:10.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.502+0000 7f9494401740 1 -- 172.21.15.42:0/3271994872 wait complete. 2024-09-17T01:38:10.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.502+0000 7f9494401740 20 client.7446 trim_cache size 0 max 16384 2024-09-17T01:38:10.506 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:38:10.506 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "fea1c88c-cb05-432f-a745-f9dcbb5f2503", 2024-09-17T01:38:10.506 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-17T01:38:10.506 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 7404, 2024-09-17T01:38:10.506 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-17T01:38:10.506 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-17T01:38:10.506 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-17T01:38:10.506 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 4.1071128889999997, 2024-09-17T01:38:10.506 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 79, 2024-09-17T01:38:10.506 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 97, 2024-09-17T01:38:10.506 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 97, 2024-09-17T01:38:10.506 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 4.8237427139999998 2024-09-17T01:38:10.506 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:38:10.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.502+0000 7f948d400640 1 -- 172.21.15.42:0/3726457709 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9464078b90 msgr2=0x7f946407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:10.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.502+0000 7f948d400640 1 --2- 172.21.15.42:0/3726457709 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9464078b90 0x7f946407b0a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9478007fd0 tx=0x7f9478009040 comp rx=0 tx=0).stop 2024-09-17T01:38:10.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.502+0000 7f948d400640 1 -- 172.21.15.42:0/3726457709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9488142f40 msgr2=0x7f94881f99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:10.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.502+0000 7f948d400640 1 --2- 172.21.15.42:0/3726457709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9488142f40 0x7f94881f99b0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f948000e960 tx=0x7f948000ee20 comp rx=0 tx=0).stop 2024-09-17T01:38:10.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.502+0000 7f948d400640 1 -- 172.21.15.42:0/3726457709 shutdown_connections 2024-09-17T01:38:10.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.502+0000 7f948d400640 1 --2- 172.21.15.42:0/3726457709 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9464078b90 0x7f946407b0a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.502+0000 7f948d400640 1 --2- 172.21.15.42:0/3726457709 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94880b3550 0x7f9488137740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.502+0000 7f948d400640 1 --2- 172.21.15.42:0/3726457709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9488142f40 0x7f94881f99b0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.502+0000 7f948d400640 1 --2- 172.21.15.42:0/3726457709 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9488072e90 0x7f9488131e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.502+0000 7f948d400640 1 -- 172.21.15.42:0/3726457709 >> 172.21.15.42:0/3726457709 conn(0x7f94880b2930 msgr2=0x7f948815b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:10.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.502+0000 7f948d400640 1 -- 172.21.15.42:0/3726457709 shutdown_connections 2024-09-17T01:38:10.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.503+0000 7f948d400640 1 -- 172.21.15.42:0/3726457709 wait complete. 2024-09-17T01:38:10.522 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 20 2024-09-17T01:38:10.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.755+0000 7f9afbe00640 1 -- 172.21.15.42:0/3193866960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9afc0b4be0 msgr2=0x7f9afc15d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:10.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.755+0000 7f9afbe00640 1 --2- 172.21.15.42:0/3193866960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9afc0b4be0 0x7f9afc15d6b0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f9afc06deb0 tx=0x7f9aec02a540 comp rx=0 tx=0).stop 2024-09-17T01:38:10.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.755+0000 7f9afbe00640 1 -- 172.21.15.42:0/3193866960 shutdown_connections 2024-09-17T01:38:10.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.755+0000 7f9afbe00640 1 --2- 172.21.15.42:0/3193866960 >> v2:172.21.15.43:3300/0 conn(0x7f9afc06d430 0x7f9afc152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.755+0000 7f9afbe00640 1 --2- 172.21.15.42:0/3193866960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9afc0b4be0 0x7f9afc15d6b0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.755+0000 7f9afbe00640 1 -- 172.21.15.42:0/3193866960 >> 172.21.15.42:0/3193866960 conn(0x7f9afc0b25f0 msgr2=0x7f9afc0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:10.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.755+0000 7f9afbe00640 1 -- 172.21.15.42:0/3193866960 shutdown_connections 2024-09-17T01:38:10.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.755+0000 7f9afbe00640 1 -- 172.21.15.42:0/3193866960 wait complete. 2024-09-17T01:38:10.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.757+0000 7f9afbe00640 1 Processor -- start 2024-09-17T01:38:10.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.758+0000 7f9afbe00640 1 -- start start 2024-09-17T01:38:10.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.759+0000 7f9afbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9afc0b4be0 0x7f9afc1f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:10.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.759+0000 7f9afbe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9afc0cf7c0 0x7f9afc15c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:10.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.759+0000 7f9afbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9afc0ca760 0x7f9afc15e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:10.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.759+0000 7f9afbe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9afc1537a0 con 0x7f9afc0b4be0 2024-09-17T01:38:10.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.759+0000 7f9afbe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9afc153620 con 0x7f9afc0ca760 2024-09-17T01:38:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.759+0000 7f9afbe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9afc153920 con 0x7f9afc0cf7c0 2024-09-17T01:38:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.759+0000 7f9afaa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9afc0b4be0 0x7f9afc1f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.759+0000 7f9afaa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9afc0b4be0 0x7f9afc1f61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42028/0 (socket says 172.21.15.42:42028) 2024-09-17T01:38:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.759+0000 7f9afaa00640 1 -- 172.21.15.42:0/173438447 learned_addr learned my addr 172.21.15.42:0/173438447 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.760+0000 7f9afaa00640 1 -- 172.21.15.42:0/173438447 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9afc0cf7c0 msgr2=0x7f9afc15c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.760+0000 7f9afaa00640 1 --2- 172.21.15.42:0/173438447 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9afc0cf7c0 0x7f9afc15c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.760+0000 7f9afaa00640 1 -- 172.21.15.42:0/173438447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9afc0ca760 msgr2=0x7f9afc15e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.760+0000 7f9afaa00640 1 --2- 172.21.15.42:0/173438447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9afc0ca760 0x7f9afc15e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.760+0000 7f9afaa00640 1 -- 172.21.15.42:0/173438447 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9afc0ad510 con 0x7f9afc0b4be0 2024-09-17T01:38:10.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.760+0000 7f9afaa00640 1 --2- 172.21.15.42:0/173438447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9afc0b4be0 0x7f9afc1f61f0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009780 tx=0x7f9aec033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:10.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.760+0000 7f9af2a00640 1 -- 172.21.15.42:0/173438447 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aec031d60 con 0x7f9afc0b4be0 2024-09-17T01:38:10.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.760+0000 7f9af2a00640 1 -- 172.21.15.42:0/173438447 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9aec033e10 con 0x7f9afc0b4be0 2024-09-17T01:38:10.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.760+0000 7f9af2a00640 1 -- 172.21.15.42:0/173438447 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aec005260 con 0x7f9afc0b4be0 2024-09-17T01:38:10.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.760+0000 7f9afbe00640 1 -- 172.21.15.42:0/173438447 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9afc0ad7f0 con 0x7f9afc0b4be0 2024-09-17T01:38:10.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.760+0000 7f9afbe00640 1 -- 172.21.15.42:0/173438447 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9afc15e090 con 0x7f9afc0b4be0 2024-09-17T01:38:10.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.761+0000 7f9afbe00640 1 -- 172.21.15.42:0/173438447 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9afc152ed0 con 0x7f9afc0b4be0 2024-09-17T01:38:10.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.763+0000 7f9af2a00640 1 -- 172.21.15.42:0/173438447 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9aec005400 con 0x7f9afc0b4be0 2024-09-17T01:38:10.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.764+0000 7f9af2a00640 1 --2- 172.21.15.42:0/173438447 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9ad8078bc0 0x7f9ad807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:10.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.764+0000 7f9af2a00640 1 -- 172.21.15.42:0/173438447 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5795+0+0 (secure 0 0 0) 0x7f9aec0bbfb0 con 0x7f9afc0b4be0 2024-09-17T01:38:10.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.764+0000 7f9af3e00640 1 --2- 172.21.15.42:0/173438447 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9ad8078bc0 0x7f9ad807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:10.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.765+0000 7f9af3e00640 1 --2- 172.21.15.42:0/173438447 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9ad8078bc0 0x7f9ad807b0d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9afc075200 tx=0x7f9ae40079f0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:10.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.768+0000 7f9af2a00640 1 -- 172.21.15.42:0/173438447 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9aec03f030 con 0x7f9afc0b4be0 2024-09-17T01:38:10.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.961+0000 7f9afbe00640 1 -- 172.21.15.42:0/173438447 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f9afc0b1180 con 0x7f9afc0b4be0 2024-09-17T01:38:10.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.965+0000 7f9af2a00640 1 -- 172.21.15.42:0/173438447 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v46)=0 v46) ==== 117+0+0 (secure 0 0 0) 0x7f9aec0842f0 con 0x7f9afc0b4be0 2024-09-17T01:38:10.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.968+0000 7f9afbe00640 1 -- 172.21.15.42:0/173438447 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9ad8078bc0 msgr2=0x7f9ad807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:10.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.968+0000 7f9afbe00640 1 --2- 172.21.15.42:0/173438447 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9ad8078bc0 0x7f9ad807b0d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9afc075200 tx=0x7f9ae40079f0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.968+0000 7f9afbe00640 1 -- 172.21.15.42:0/173438447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9afc0b4be0 msgr2=0x7f9afc1f61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:10.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.968+0000 7f9afbe00640 1 --2- 172.21.15.42:0/173438447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9afc0b4be0 0x7f9afc1f61f0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009780 tx=0x7f9aec033c20 comp rx=0 tx=0).stop 2024-09-17T01:38:10.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.968+0000 7f9afbe00640 1 -- 172.21.15.42:0/173438447 shutdown_connections 2024-09-17T01:38:10.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.968+0000 7f9afbe00640 1 --2- 172.21.15.42:0/173438447 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9ad8078bc0 0x7f9ad807b0d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.968+0000 7f9afbe00640 1 --2- 172.21.15.42:0/173438447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9afc0ca760 0x7f9afc15e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.968+0000 7f9afbe00640 1 --2- 172.21.15.42:0/173438447 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9afc0cf7c0 0x7f9afc15c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.968+0000 7f9afbe00640 1 --2- 172.21.15.42:0/173438447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9afc0b4be0 0x7f9afc1f61f0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:10.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.968+0000 7f9afbe00640 1 -- 172.21.15.42:0/173438447 >> 172.21.15.42:0/173438447 conn(0x7f9afc0b25f0 msgr2=0x7f9afc0b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:10.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.968+0000 7f9afbe00640 1 -- 172.21.15.42:0/173438447 shutdown_connections 2024-09-17T01:38:10.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:10.968+0000 7f9afbe00640 1 -- 172.21.15.42:0/173438447 wait complete. 2024-09-17T01:38:10.989 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-09-17T01:38:11.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.223+0000 7fef2f000640 1 -- 172.21.15.42:0/2633406269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef280cfba0 msgr2=0x7fef280b9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:11.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.223+0000 7fef2f000640 1 --2- 172.21.15.42:0/2633406269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef280cfba0 0x7fef280b9fb0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009830 tx=0x7fef1c02a510 comp rx=0 tx=0).stop 2024-09-17T01:38:11.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.223+0000 7fef2f000640 1 -- 172.21.15.42:0/2633406269 shutdown_connections 2024-09-17T01:38:11.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.223+0000 7fef2f000640 1 --2- 172.21.15.42:0/2633406269 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef280cfba0 0x7fef280b9fb0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:11.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.223+0000 7fef2f000640 1 -- 172.21.15.42:0/2633406269 >> 172.21.15.42:0/2633406269 conn(0x7fef280b6140 msgr2=0x7fef280b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:11.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.223+0000 7fef2f000640 1 -- 172.21.15.42:0/2633406269 shutdown_connections 2024-09-17T01:38:11.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.223+0000 7fef2f000640 1 -- 172.21.15.42:0/2633406269 wait complete. 2024-09-17T01:38:11.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.225+0000 7fef2f000640 1 Processor -- start 2024-09-17T01:38:11.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.225+0000 7fef2f000640 1 -- start start 2024-09-17T01:38:11.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.227+0000 7fef2f000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fef280cfba0 0x7fef280ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:11.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.227+0000 7fef2f000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fef280d0e10 0x7fef280d45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:11.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.227+0000 7fef2f000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef28162500 0x7fef280d4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:11.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.227+0000 7fef2f000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fef280b33f0 con 0x7fef28162500 2024-09-17T01:38:11.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.227+0000 7fef2f000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fef280b3270 con 0x7fef280d0e10 2024-09-17T01:38:11.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.227+0000 7fef2f000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fef280b3570 con 0x7fef280cfba0 2024-09-17T01:38:11.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.227+0000 7fef2e600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef28162500 0x7fef280d4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:11.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.227+0000 7fef2e600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef28162500 0x7fef280d4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42048/0 (socket says 172.21.15.42:42048) 2024-09-17T01:38:11.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.227+0000 7fef2e600640 1 -- 172.21.15.42:0/721004864 learned_addr learned my addr 172.21.15.42:0/721004864 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:11.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.228+0000 7fef2dc00640 1 --2- 172.21.15.42:0/721004864 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fef280cfba0 0x7fef280ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:11.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.228+0000 7fef2d200640 1 --2- 172.21.15.42:0/721004864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fef280d0e10 0x7fef280d45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:11.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.228+0000 7fef2e600640 1 -- 172.21.15.42:0/721004864 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fef280cfba0 msgr2=0x7fef280ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:11.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.228+0000 7fef2e600640 1 --2- 172.21.15.42:0/721004864 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fef280cfba0 0x7fef280ca9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:11.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.228+0000 7fef2e600640 1 -- 172.21.15.42:0/721004864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fef280d0e10 msgr2=0x7fef280d45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:11.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.228+0000 7fef2e600640 1 --2- 172.21.15.42:0/721004864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fef280d0e10 0x7fef280d45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:11.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.228+0000 7fef2e600640 1 -- 172.21.15.42:0/721004864 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef281578d0 con 0x7fef28162500 2024-09-17T01:38:11.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.228+0000 7fef2dc00640 1 --2- 172.21.15.42:0/721004864 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fef280cfba0 0x7fef280ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:11.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.228+0000 7fef2d200640 1 --2- 172.21.15.42:0/721004864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fef280d0e10 0x7fef280d45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:11.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.228+0000 7fef2e600640 1 --2- 172.21.15.42:0/721004864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef28162500 0x7fef280d4b20 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fef2000c6c0 tx=0x7fef2000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:11.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.228+0000 7fef25600640 1 -- 172.21.15.42:0/721004864 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef20017070 con 0x7fef28162500 2024-09-17T01:38:11.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.228+0000 7fef25600640 1 -- 172.21.15.42:0/721004864 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef20003c60 con 0x7fef28162500 2024-09-17T01:38:11.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.228+0000 7fef2f000640 1 -- 172.21.15.42:0/721004864 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef280b5ed0 con 0x7fef28162500 2024-09-17T01:38:11.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.229+0000 7fef25600640 1 -- 172.21.15.42:0/721004864 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef200052d0 con 0x7fef28162500 2024-09-17T01:38:11.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.229+0000 7fef2f000640 1 -- 172.21.15.42:0/721004864 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef281f5cd0 con 0x7fef28162500 2024-09-17T01:38:11.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.230+0000 7fef2f000640 1 -- 172.21.15.42:0/721004864 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef280b3aa0 con 0x7fef28162500 2024-09-17T01:38:11.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.231+0000 7fef25600640 1 -- 172.21.15.42:0/721004864 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fef2001a070 con 0x7fef28162500 2024-09-17T01:38:11.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.232+0000 7fef25600640 1 --2- 172.21.15.42:0/721004864 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fef08078b90 0x7fef0807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:11.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.232+0000 7fef25600640 1 -- 172.21.15.42:0/721004864 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5795+0+0 (secure 0 0 0) 0x7fef2009a440 con 0x7fef28162500 2024-09-17T01:38:11.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.232+0000 7fef2dc00640 1 --2- 172.21.15.42:0/721004864 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fef08078b90 0x7fef0807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:11.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.233+0000 7fef2dc00640 1 --2- 172.21.15.42:0/721004864 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fef08078b90 0x7fef0807b0a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fef1c034000 tx=0x7fef1c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:11.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.236+0000 7fef25600640 1 -- 172.21.15.42:0/721004864 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fef20062780 con 0x7fef28162500 2024-09-17T01:38:11.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.428+0000 7fef2f000640 1 -- 172.21.15.42:0/721004864 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fef281f5780 con 0x7fef28162500 2024-09-17T01:38:11.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.432+0000 7fef25600640 1 -- 172.21.15.42:0/721004864 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v47)=0 v47) ==== 116+0+0 (secure 0 0 0) 0x7fef20062080 con 0x7fef28162500 2024-09-17T01:38:11.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.435+0000 7fef2f000640 1 -- 172.21.15.42:0/721004864 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fef08078b90 msgr2=0x7fef0807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:11.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.435+0000 7fef2f000640 1 --2- 172.21.15.42:0/721004864 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fef08078b90 0x7fef0807b0a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fef1c034000 tx=0x7fef1c004730 comp rx=0 tx=0).stop 2024-09-17T01:38:11.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.435+0000 7fef2f000640 1 -- 172.21.15.42:0/721004864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef28162500 msgr2=0x7fef280d4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:11.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.435+0000 7fef2f000640 1 --2- 172.21.15.42:0/721004864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef28162500 0x7fef280d4b20 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fef2000c6c0 tx=0x7fef2000cb80 comp rx=0 tx=0).stop 2024-09-17T01:38:11.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.435+0000 7fef2f000640 1 -- 172.21.15.42:0/721004864 shutdown_connections 2024-09-17T01:38:11.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.435+0000 7fef2f000640 1 --2- 172.21.15.42:0/721004864 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fef08078b90 0x7fef0807b0a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:11.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.435+0000 7fef2f000640 1 --2- 172.21.15.42:0/721004864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fef280d0e10 0x7fef280d45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:11.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.435+0000 7fef2f000640 1 --2- 172.21.15.42:0/721004864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef28162500 0x7fef280d4b20 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:11.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.435+0000 7fef2f000640 1 --2- 172.21.15.42:0/721004864 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fef280cfba0 0x7fef280ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:11.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.435+0000 7fef2f000640 1 -- 172.21.15.42:0/721004864 >> 172.21.15.42:0/721004864 conn(0x7fef280b6140 msgr2=0x7fef28162910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:11.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.435+0000 7fef2f000640 1 -- 172.21.15.42:0/721004864 shutdown_connections 2024-09-17T01:38:11.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.435+0000 7fef2f000640 1 -- 172.21.15.42:0/721004864 wait complete. 2024-09-17T01:38:11.457 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_bits 1 2024-09-17T01:38:11.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.690+0000 7f765be00640 1 -- 172.21.15.42:0/2199582662 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f765c0cf7c0 msgr2=0x7f765c06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:11.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.690+0000 7f765be00640 1 --2- 172.21.15.42:0/2199582662 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f765c0cf7c0 0x7f765c06cd20 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f7644009830 tx=0x7f764402a520 comp rx=0 tx=0).stop 2024-09-17T01:38:11.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.690+0000 7f765be00640 1 -- 172.21.15.42:0/2199582662 shutdown_connections 2024-09-17T01:38:11.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.690+0000 7f765be00640 1 --2- 172.21.15.42:0/2199582662 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f765c0cf7c0 0x7f765c06cd20 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:11.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.690+0000 7f765be00640 1 --2- 172.21.15.42:0/2199582662 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f765c0b4be0 0x7f765c15d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:11.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.690+0000 7f765be00640 1 -- 172.21.15.42:0/2199582662 >> 172.21.15.42:0/2199582662 conn(0x7f765c0b25f0 msgr2=0x7f765c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:11.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.690+0000 7f765be00640 1 -- 172.21.15.42:0/2199582662 shutdown_connections 2024-09-17T01:38:11.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.690+0000 7f765be00640 1 -- 172.21.15.42:0/2199582662 wait complete. 2024-09-17T01:38:11.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.692+0000 7f765be00640 1 Processor -- start 2024-09-17T01:38:11.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.693+0000 7f765be00640 1 -- start start 2024-09-17T01:38:11.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.694+0000 7f765be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f765c06d260 0x7f765c152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:11.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.694+0000 7f765be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f765c0b4be0 0x7f765c0730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:11.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.694+0000 7f765be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f765c0cf7c0 0x7f765c1f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:11.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.694+0000 7f765be00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f765c153970 con 0x7f765c0cf7c0 2024-09-17T01:38:11.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.694+0000 7f765be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f765c1537f0 con 0x7f765c0b4be0 2024-09-17T01:38:11.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.694+0000 7f765be00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f765c153af0 con 0x7f765c06d260 2024-09-17T01:38:11.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.694+0000 7f765b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f765c0cf7c0 0x7f765c1f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:11.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.694+0000 7f765b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f765c0cf7c0 0x7f765c1f5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42062/0 (socket says 172.21.15.42:42062) 2024-09-17T01:38:11.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.694+0000 7f765b400640 1 -- 172.21.15.42:0/1510669550 learned_addr learned my addr 172.21.15.42:0/1510669550 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:11.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.695+0000 7f765aa00640 1 --2- 172.21.15.42:0/1510669550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f765c06d260 0x7f765c152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:11.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.695+0000 7f7653e00640 1 --2- 172.21.15.42:0/1510669550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f765c0b4be0 0x7f765c0730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:11.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.695+0000 7f765b400640 1 -- 172.21.15.42:0/1510669550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f765c06d260 msgr2=0x7f765c152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:11.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.695+0000 7f765b400640 1 --2- 172.21.15.42:0/1510669550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f765c06d260 0x7f765c152440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:11.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.695+0000 7f765b400640 1 -- 172.21.15.42:0/1510669550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f765c0b4be0 msgr2=0x7f765c0730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:11.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.695+0000 7f765b400640 1 --2- 172.21.15.42:0/1510669550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f765c0b4be0 0x7f765c0730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:11.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.695+0000 7f765b400640 1 -- 172.21.15.42:0/1510669550 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f765c1f92e0 con 0x7f765c0cf7c0 2024-09-17T01:38:11.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.695+0000 7f765b400640 1 --2- 172.21.15.42:0/1510669550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f765c0cf7c0 0x7f765c1f5d00 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f765400ca20 tx=0x7f765400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:11.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.695+0000 7f7652a00640 1 -- 172.21.15.42:0/1510669550 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7654016020 con 0x7f765c0cf7c0 2024-09-17T01:38:11.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.695+0000 7f7652a00640 1 -- 172.21.15.42:0/1510669550 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f765400acc0 con 0x7f765c0cf7c0 2024-09-17T01:38:11.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.695+0000 7f7652a00640 1 -- 172.21.15.42:0/1510669550 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7654012680 con 0x7f765c0cf7c0 2024-09-17T01:38:11.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.696+0000 7f765be00640 1 -- 172.21.15.42:0/1510669550 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f765c1f95c0 con 0x7f765c0cf7c0 2024-09-17T01:38:11.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.696+0000 7f765be00640 1 -- 172.21.15.42:0/1510669550 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f765c1f57e0 con 0x7f765c0cf7c0 2024-09-17T01:38:11.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.697+0000 7f765be00640 1 -- 172.21.15.42:0/1510669550 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f765c1f9050 con 0x7f765c0cf7c0 2024-09-17T01:38:11.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.698+0000 7f7652a00640 1 -- 172.21.15.42:0/1510669550 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7654019020 con 0x7f765c0cf7c0 2024-09-17T01:38:11.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.699+0000 7f7652a00640 1 --2- 172.21.15.42:0/1510669550 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7638078b90 0x7f763807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:11.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.699+0000 7f7652a00640 1 -- 172.21.15.42:0/1510669550 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5795+0+0 (secure 0 0 0) 0x7f765409b230 con 0x7f765c0cf7c0 2024-09-17T01:38:11.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.700+0000 7f765aa00640 1 --2- 172.21.15.42:0/1510669550 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7638078b90 0x7f763807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:11.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.700+0000 7f765aa00640 1 --2- 172.21.15.42:0/1510669550 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7638078b90 0x7f763807b0a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f764c009b30 tx=0x7f764c005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:11.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.703+0000 7f7652a00640 1 -- 172.21.15.42:0/1510669550 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7654020020 con 0x7f765c0cf7c0 2024-09-17T01:38:11.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.897+0000 7f765be00640 1 -- 172.21.15.42:0/1510669550 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f765c1f55f0 con 0x7f765c0cf7c0 2024-09-17T01:38:11.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.901+0000 7f7652a00640 1 -- 172.21.15.42:0/1510669550 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v48)=0 v48) ==== 116+0+0 (secure 0 0 0) 0x7f765c15dbf0 con 0x7f765c0cf7c0 2024-09-17T01:38:11.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.903+0000 7f765be00640 1 -- 172.21.15.42:0/1510669550 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7638078b90 msgr2=0x7f763807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:11.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.903+0000 7f765be00640 1 --2- 172.21.15.42:0/1510669550 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7638078b90 0x7f763807b0a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f764c009b30 tx=0x7f764c005f90 comp rx=0 tx=0).stop 2024-09-17T01:38:11.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.903+0000 7f765be00640 1 -- 172.21.15.42:0/1510669550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f765c0cf7c0 msgr2=0x7f765c1f5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:11.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.903+0000 7f765be00640 1 --2- 172.21.15.42:0/1510669550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f765c0cf7c0 0x7f765c1f5d00 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f765400ca20 tx=0x7f765400cee0 comp rx=0 tx=0).stop 2024-09-17T01:38:11.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.903+0000 7f765be00640 1 -- 172.21.15.42:0/1510669550 shutdown_connections 2024-09-17T01:38:11.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.903+0000 7f765be00640 1 --2- 172.21.15.42:0/1510669550 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7638078b90 0x7f763807b0a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:11.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.903+0000 7f765be00640 1 --2- 172.21.15.42:0/1510669550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f765c0b4be0 0x7f765c0730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:11.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.903+0000 7f765be00640 1 --2- 172.21.15.42:0/1510669550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f765c0cf7c0 0x7f765c1f5d00 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:11.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.903+0000 7f765be00640 1 --2- 172.21.15.42:0/1510669550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f765c06d260 0x7f765c152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:11.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.903+0000 7f765be00640 1 -- 172.21.15.42:0/1510669550 >> 172.21.15.42:0/1510669550 conn(0x7f765c0b25f0 msgr2=0x7f765c15c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:11.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.904+0000 7f765be00640 1 -- 172.21.15.42:0/1510669550 shutdown_connections 2024-09-17T01:38:11.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:11.904+0000 7f765be00640 1 -- 172.21.15.42:0/1510669550 wait complete. 2024-09-17T01:38:11.928 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:38:12.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.159+0000 7f93c0c00640 1 -- 172.21.15.42:0/3849782659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93a0003c80 msgr2=0x7f93a00040d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:12.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.159+0000 7f93c0c00640 1 --2- 172.21.15.42:0/3849782659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93a0003c80 0x7f93a00040d0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f93ac006ef0 tx=0x7f93a0005830 comp rx=0 tx=0).stop 2024-09-17T01:38:12.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.159+0000 7f93c0c00640 1 -- 172.21.15.42:0/3849782659 shutdown_connections 2024-09-17T01:38:12.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.159+0000 7f93c0c00640 1 --2- 172.21.15.42:0/3849782659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93a0003c80 0x7f93a00040d0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.159+0000 7f93c0c00640 1 -- 172.21.15.42:0/3849782659 >> 172.21.15.42:0/3849782659 conn(0x7f93bc0b25f0 msgr2=0x7f93bc0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:12.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.159+0000 7f93c0c00640 1 -- 172.21.15.42:0/3849782659 shutdown_connections 2024-09-17T01:38:12.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.159+0000 7f93c0c00640 1 -- 172.21.15.42:0/3849782659 wait complete. 2024-09-17T01:38:12.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.161+0000 7f93c0c00640 1 Processor -- start 2024-09-17T01:38:12.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.161+0000 7f93c0c00640 1 -- start start 2024-09-17T01:38:12.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.163+0000 7f93c0c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93a0003c80 0x7f93bc154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.163+0000 7f93c0c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93bc0cc440 0x7f93bc14daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.163+0000 7f93c0c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f93bc1f9600 0x7f93bc0ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.163+0000 7f93c0c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc15dbd0 con 0x7f93a0003c80 2024-09-17T01:38:12.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.163+0000 7f93c0c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc15da50 con 0x7f93bc0cc440 2024-09-17T01:38:12.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.163+0000 7f93c0c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f93bc06cd20 con 0x7f93bc1f9600 2024-09-17T01:38:12.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.163+0000 7f93bb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93a0003c80 0x7f93bc154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:12.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.163+0000 7f93bb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93a0003c80 0x7f93bc154100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42080/0 (socket says 172.21.15.42:42080) 2024-09-17T01:38:12.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.163+0000 7f93bb400640 1 -- 172.21.15.42:0/885032656 learned_addr learned my addr 172.21.15.42:0/885032656 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:12.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.163+0000 7f93b3e00640 1 --2- 172.21.15.42:0/885032656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93bc0cc440 0x7f93bc14daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:12.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.163+0000 7f93bbe00640 1 --2- 172.21.15.42:0/885032656 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f93bc1f9600 0x7f93bc0ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:12.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.163+0000 7f93bb400640 1 -- 172.21.15.42:0/885032656 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f93bc1f9600 msgr2=0x7f93bc0ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:12.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.163+0000 7f93bb400640 1 --2- 172.21.15.42:0/885032656 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f93bc1f9600 0x7f93bc0ae330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.163+0000 7f93bb400640 1 -- 172.21.15.42:0/885032656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93bc0cc440 msgr2=0x7f93bc14daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:12.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.163+0000 7f93bb400640 1 --2- 172.21.15.42:0/885032656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93bc0cc440 0x7f93bc14daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.163+0000 7f93bb400640 1 -- 172.21.15.42:0/885032656 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93bc14e030 con 0x7f93a0003c80 2024-09-17T01:38:12.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.163+0000 7f93b3e00640 1 --2- 172.21.15.42:0/885032656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93bc0cc440 0x7f93bc14daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:12.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.163+0000 7f93bbe00640 1 --2- 172.21.15.42:0/885032656 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f93bc1f9600 0x7f93bc0ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:12.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.164+0000 7f93bb400640 1 --2- 172.21.15.42:0/885032656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93a0003c80 0x7f93bc154100 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f93ac006ef0 tx=0x7f93ac0017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:12.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.164+0000 7f93b3400640 1 -- 172.21.15.42:0/885032656 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ac001bb0 con 0x7f93a0003c80 2024-09-17T01:38:12.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.164+0000 7f93b3400640 1 -- 172.21.15.42:0/885032656 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93ac03f070 con 0x7f93a0003c80 2024-09-17T01:38:12.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.164+0000 7f93b3400640 1 -- 172.21.15.42:0/885032656 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ac003d70 con 0x7f93a0003c80 2024-09-17T01:38:12.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.164+0000 7f93c0c00640 1 -- 172.21.15.42:0/885032656 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93bc154a00 con 0x7f93a0003c80 2024-09-17T01:38:12.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.164+0000 7f93c0c00640 1 -- 172.21.15.42:0/885032656 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93bc1f8e00 con 0x7f93a0003c80 2024-09-17T01:38:12.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.165+0000 7f93c0c00640 1 -- 172.21.15.42:0/885032656 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93bc06d280 con 0x7f93a0003c80 2024-09-17T01:38:12.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.166+0000 7f93b3400640 1 -- 172.21.15.42:0/885032656 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f93ac02f460 con 0x7f93a0003c80 2024-09-17T01:38:12.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.167+0000 7f93b3400640 1 --2- 172.21.15.42:0/885032656 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9398078b90 0x7f939807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.167+0000 7f93b3400640 1 -- 172.21.15.42:0/885032656 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5795+0+0 (secure 0 0 0) 0x7f93ac0bbc70 con 0x7f93a0003c80 2024-09-17T01:38:12.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.168+0000 7f93b3e00640 1 --2- 172.21.15.42:0/885032656 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9398078b90 0x7f939807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:12.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.169+0000 7f93b3e00640 1 --2- 172.21.15.42:0/885032656 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9398078b90 0x7f939807b0a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f93bc073e30 tx=0x7f93a4006ac0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:12.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.172+0000 7f93b3400640 1 -- 172.21.15.42:0/885032656 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f93ac084040 con 0x7f93a0003c80 2024-09-17T01:38:12.392 INFO:tasks.ceph.mds.a.smithi042.stderr:2024-09-17T01:38:12.395+0000 7f1d02c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:38:12.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.405+0000 7f93c0c00640 1 -- 172.21.15.42:0/885032656 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93bc0b4100 con 0x7f93a0003c80 2024-09-17T01:38:12.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.405+0000 7f93b3400640 1 -- 172.21.15.42:0/885032656 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) ==== 94+0+5223 (secure 0 0 0) 0x7f93ac083940 con 0x7f93a0003c80 2024-09-17T01:38:12.403 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:38:12.403 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":79,"btime":"2024-09-17T01:38:09:405324+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3191013971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":3191013971},{"type":"v1","addr":"172.21.15.43:6837","nonce":3191013971}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7042,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2889481399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2889481399},{"type":"v1","addr":"172.21.15.43:6835","nonce":2889481399}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1913337319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1913337319},{"type":"v1","addr":"172.21.15.42:6835","nonce":1913337319}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:37:52.812411+0000","modified":"2024-09-17T01:38:09.405313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7404},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7404":{"gid":7404,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6834/487915371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":487915371},{"type":"v1","addr":"172.21.15.42:6834","nonce":487915371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7404,"qdb_cluster":[7404]},"id":6}]} 2024-09-17T01:38:12.404 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 79 2024-09-17T01:38:12.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.407+0000 7f93c0c00640 1 -- 172.21.15.42:0/885032656 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9398078b90 msgr2=0x7f939807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:12.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.407+0000 7f93c0c00640 1 --2- 172.21.15.42:0/885032656 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9398078b90 0x7f939807b0a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f93bc073e30 tx=0x7f93a4006ac0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.407+0000 7f93c0c00640 1 -- 172.21.15.42:0/885032656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93a0003c80 msgr2=0x7f93bc154100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:12.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.407+0000 7f93c0c00640 1 --2- 172.21.15.42:0/885032656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93a0003c80 0x7f93bc154100 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f93ac006ef0 tx=0x7f93ac0017a0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.408+0000 7f93c0c00640 1 -- 172.21.15.42:0/885032656 shutdown_connections 2024-09-17T01:38:12.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.408+0000 7f93c0c00640 1 --2- 172.21.15.42:0/885032656 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9398078b90 0x7f939807b0a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.408+0000 7f93c0c00640 1 --2- 172.21.15.42:0/885032656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93bc0cc440 0x7f93bc14daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.408+0000 7f93c0c00640 1 --2- 172.21.15.42:0/885032656 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f93bc1f9600 0x7f93bc0ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.408+0000 7f93c0c00640 1 --2- 172.21.15.42:0/885032656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93a0003c80 0x7f93bc154100 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.408+0000 7f93c0c00640 1 -- 172.21.15.42:0/885032656 >> 172.21.15.42:0/885032656 conn(0x7f93bc0b25f0 msgr2=0x7f93bc0cdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:12.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.408+0000 7f93c0c00640 1 -- 172.21.15.42:0/885032656 shutdown_connections 2024-09-17T01:38:12.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.408+0000 7f93c0c00640 1 -- 172.21.15.42:0/885032656 wait complete. 2024-09-17T01:38:12.428 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-17T01:38:12.672 INFO:teuthology.orchestra.run.smithi042.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-17T01:38:02.874665+0000","btime":"2024-09-17T01:38:01.722675+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-17T01:38:02.874665+0000","atime":"2024-09-17T01:38:01.722675+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-17T01:38:02.874665+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-17T01:38:02.875665+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-17T01:38:02.875665+0000"},"version":128,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{},"nref":0,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-17T01:38:12.673 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-17T01:38:02.875665+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-17T01:38:01.722675+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-17T01:38:01.722675+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-17T01:38:02.874665+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-17T01:38:02.874665+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-17T01:38:02.874665+0000", "nestlock": {}, "nlink": 1, "nref": 0, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": {}, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-17T01:38:02.875665+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 128, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-17T01:38:12.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:38:12.674 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /testdir recursive 2024-09-17T01:38:12.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.908+0000 7f5553200640 1 -- 172.21.15.42:0/2392089853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f554c0d3160 msgr2=0x7f554c0d3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:12.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.908+0000 7f5553200640 1 --2- 172.21.15.42:0/2392089853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f554c0d3160 0x7f554c0d3570 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f5544005fd0 tx=0x7f554402aa80 comp rx=0 tx=0).stop 2024-09-17T01:38:12.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.908+0000 7f5553200640 1 -- 172.21.15.42:0/2392089853 shutdown_connections 2024-09-17T01:38:12.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.908+0000 7f5553200640 1 --2- 172.21.15.42:0/2392089853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f554c0d3160 0x7f554c0d3570 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.908+0000 7f5553200640 1 --2- 172.21.15.42:0/2392089853 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f554c15c7b0 0x7f554c15f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.908+0000 7f5553200640 1 -- 172.21.15.42:0/2392089853 >> 172.21.15.42:0/2392089853 conn(0x7f554c073ab0 msgr2=0x7f554c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:12.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.908+0000 7f5553200640 1 -- 172.21.15.42:0/2392089853 shutdown_connections 2024-09-17T01:38:12.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.908+0000 7f5553200640 1 -- 172.21.15.42:0/2392089853 wait complete. 2024-09-17T01:38:12.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.910+0000 7f5553200640 1 Processor -- start 2024-09-17T01:38:12.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.910+0000 7f5553200640 1 -- start start 2024-09-17T01:38:12.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.912+0000 7f5553200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f554c0d3160 0x7f554c155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.912+0000 7f5553200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f554c15c7b0 0x7f554c142d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.912+0000 7f5553200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f554c15f6a0 0x7f554c142200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.912+0000 7f5553200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f554c0d1040 con 0x7f554c15f6a0 2024-09-17T01:38:12.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.912+0000 7f5553200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f554c0d0ec0 con 0x7f554c0d3160 2024-09-17T01:38:12.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.912+0000 7f5553200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f554c0d11c0 con 0x7f554c15c7b0 2024-09-17T01:38:12.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.912+0000 7f5551200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f554c15f6a0 0x7f554c142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:12.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.912+0000 7f5551200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f554c15f6a0 0x7f554c142200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42086/0 (socket says 172.21.15.42:42086) 2024-09-17T01:38:12.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.912+0000 7f5551200640 1 -- 172.21.15.42:0/3878994175 learned_addr learned my addr 172.21.15.42:0/3878994175 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:12.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.912+0000 7f554be00640 1 --2- 172.21.15.42:0/3878994175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f554c0d3160 0x7f554c155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:12.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.912+0000 7f554b400640 1 --2- 172.21.15.42:0/3878994175 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f554c15c7b0 0x7f554c142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:12.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.913+0000 7f5551200640 1 -- 172.21.15.42:0/3878994175 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f554c15c7b0 msgr2=0x7f554c142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:12.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.913+0000 7f5551200640 1 --2- 172.21.15.42:0/3878994175 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f554c15c7b0 0x7f554c142d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.913+0000 7f5551200640 1 -- 172.21.15.42:0/3878994175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f554c0d3160 msgr2=0x7f554c155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:12.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.913+0000 7f5551200640 1 --2- 172.21.15.42:0/3878994175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f554c0d3160 0x7f554c155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.913+0000 7f5551200640 1 -- 172.21.15.42:0/3878994175 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f554c159040 con 0x7f554c15f6a0 2024-09-17T01:38:12.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.913+0000 7f554b400640 1 --2- 172.21.15.42:0/3878994175 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f554c15c7b0 0x7f554c142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:12.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.913+0000 7f5551200640 1 --2- 172.21.15.42:0/3878994175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f554c15f6a0 0x7f554c142200 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f5544009d90 tx=0x7f5544003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:12.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.913+0000 7f5543e00640 1 -- 172.21.15.42:0/3878994175 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5544044070 con 0x7f554c15f6a0 2024-09-17T01:38:12.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.913+0000 7f5543e00640 1 -- 172.21.15.42:0/3878994175 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5544004250 con 0x7f554c15f6a0 2024-09-17T01:38:12.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.913+0000 7f5543e00640 1 -- 172.21.15.42:0/3878994175 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5544004660 con 0x7f554c15f6a0 2024-09-17T01:38:12.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.913+0000 7f5553200640 1 -- 172.21.15.42:0/3878994175 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f554c1545b0 con 0x7f554c15f6a0 2024-09-17T01:38:12.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.913+0000 7f5553200640 1 -- 172.21.15.42:0/3878994175 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f554c158b00 con 0x7f554c15f6a0 2024-09-17T01:38:12.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.916+0000 7f5543e00640 1 -- 172.21.15.42:0/3878994175 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5544047070 con 0x7f554c15f6a0 2024-09-17T01:38:12.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.917+0000 7f5543e00640 1 --2- 172.21.15.42:0/3878994175 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f552c078b90 0x7f552c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.917+0000 7f5543e00640 1 -- 172.21.15.42:0/3878994175 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5795+0+0 (secure 0 0 0) 0x7f55440bbc70 con 0x7f554c15f6a0 2024-09-17T01:38:12.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.917+0000 7f554be00640 1 --2- 172.21.15.42:0/3878994175 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f552c078b90 0x7f552c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:12.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.917+0000 7f555a215740 1 Processor -- start 2024-09-17T01:38:12.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.918+0000 7f555a215740 1 -- start start 2024-09-17T01:38:12.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.918+0000 7f554be00640 1 --2- 172.21.15.42:0/3878994175 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f552c078b90 0x7f552c07b0a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f553c004590 tx=0x7f553c00b390 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:12.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.919+0000 7f555a215740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7052c85b0 0x55d7056b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.919+0000 7f555a215740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d70529f6f0 0x55d7056897f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.919+0000 7f555a215740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7052a78d0 0x55d705689d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.919+0000 7f555a215740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d7055e2970 con 0x55d7052a78d0 2024-09-17T01:38:12.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.919+0000 7f555a215740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d7055d1da0 con 0x55d70529f6f0 2024-09-17T01:38:12.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.919+0000 7f555a215740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55d7055d5bb0 con 0x55d7052c85b0 2024-09-17T01:38:12.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.919+0000 7f5551200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7052a78d0 0x55d705689d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:12.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.919+0000 7f5551200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7052a78d0 0x55d705689d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42094/0 (socket says 172.21.15.42:42094) 2024-09-17T01:38:12.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.919+0000 7f5551200640 1 -- 172.21.15.42:0/2328135528 learned_addr learned my addr 172.21.15.42:0/2328135528 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:12.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.920+0000 7f554be00640 1 --2- 172.21.15.42:0/2328135528 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7052c85b0 0x55d7056b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:12.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.920+0000 7f554b400640 1 --2- 172.21.15.42:0/2328135528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d70529f6f0 0x55d7056897f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:12.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.920+0000 7f5551200640 1 -- 172.21.15.42:0/2328135528 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7052c85b0 msgr2=0x55d7056b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:12.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.920+0000 7f5551200640 1 --2- 172.21.15.42:0/2328135528 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7052c85b0 0x55d7056b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.920+0000 7f5551200640 1 -- 172.21.15.42:0/2328135528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d70529f6f0 msgr2=0x55d7056897f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:12.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.920+0000 7f5551200640 1 --2- 172.21.15.42:0/2328135528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d70529f6f0 0x55d7056897f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.920+0000 7f5551200640 1 -- 172.21.15.42:0/2328135528 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7053aca20 con 0x55d7052a78d0 2024-09-17T01:38:12.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.920+0000 7f5551200640 1 --2- 172.21.15.42:0/2328135528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7052a78d0 0x55d705689d30 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f5544083980 tx=0x7f55440838c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0d8afa0809d46c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:12.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.920+0000 7f5540c00640 1 -- 172.21.15.42:0/2328135528 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55440839f0 con 0x55d7052a78d0 2024-09-17T01:38:12.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.921+0000 7f5540c00640 1 -- 172.21.15.42:0/2328135528 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f554408d2d0 con 0x55d7052a78d0 2024-09-17T01:38:12.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.921+0000 7f5540c00640 1 -- 172.21.15.42:0/2328135528 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554407fc60 con 0x55d7052a78d0 2024-09-17T01:38:12.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.921+0000 7f555a215740 1 -- 172.21.15.42:0/2328135528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7052a78d0 msgr2=0x55d705689d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:12.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.921+0000 7f555a215740 1 --2- 172.21.15.42:0/2328135528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7052a78d0 0x55d705689d30 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f5544083980 tx=0x7f55440838c0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.921+0000 7f555a215740 1 -- 172.21.15.42:0/2328135528 shutdown_connections 2024-09-17T01:38:12.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.921+0000 7f555a215740 1 --2- 172.21.15.42:0/2328135528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d70529f6f0 0x55d7056897f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.921+0000 7f555a215740 1 --2- 172.21.15.42:0/2328135528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d7052a78d0 0x55d705689d30 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.921+0000 7f555a215740 1 --2- 172.21.15.42:0/2328135528 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7052c85b0 0x55d7056b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.921+0000 7f555a215740 1 -- 172.21.15.42:0/2328135528 >> 172.21.15.42:0/2328135528 conn(0x55d7052bc700 msgr2=0x55d70566fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:12.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.922+0000 7f555a215740 1 -- 172.21.15.42:0/2328135528 shutdown_connections 2024-09-17T01:38:12.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.922+0000 7f555a215740 1 -- 172.21.15.42:0/2328135528 wait complete. 2024-09-17T01:38:12.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.923+0000 7f555a215740 1 -- start start 2024-09-17T01:38:12.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.923+0000 7f555a215740 1 Processor -- start 2024-09-17T01:38:12.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.924+0000 7f555a215740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d70529f6f0 0x55d7056b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.924+0000 7f555a215740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7052a78d0 0x55d7056719d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.924+0000 7f555a215740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d7052c85b0 0x55d705671f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.924+0000 7f555a215740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d705342960 con 0x55d70529f6f0 2024-09-17T01:38:12.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.924+0000 7f555a215740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d705577780 con 0x55d7052c85b0 2024-09-17T01:38:12.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.924+0000 7f555a215740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55d7055e2970 con 0x55d7052a78d0 2024-09-17T01:38:12.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.925+0000 7f555a215740 10 client.0 _ll_register_callbacks cb 0x55d7055ce4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:38:12.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.925+0000 7f554be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d70529f6f0 0x55d7056b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:12.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.925+0000 7f554be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d70529f6f0 0x55d7056b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42104/0 (socket says 172.21.15.42:42104) 2024-09-17T01:38:12.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.925+0000 7f554be00640 1 -- 172.21.15.42:0/460660743 learned_addr learned my addr 172.21.15.42:0/460660743 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:12.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.925+0000 7f554b400640 1 --2- 172.21.15.42:0/460660743 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7052a78d0 0x55d7056719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:12.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.925+0000 7f5551200640 1 --2- 172.21.15.42:0/460660743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d7052c85b0 0x55d705671f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:12.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.925+0000 7f554be00640 1 -- 172.21.15.42:0/460660743 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7052a78d0 msgr2=0x55d7056719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:12.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.925+0000 7f554be00640 1 --2- 172.21.15.42:0/460660743 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7052a78d0 0x55d7056719d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.925+0000 7f554be00640 1 -- 172.21.15.42:0/460660743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d7052c85b0 msgr2=0x55d705671f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:12.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.925+0000 7f554be00640 1 --2- 172.21.15.42:0/460660743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d7052c85b0 0x55d705671f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.925+0000 7f554be00640 1 -- 172.21.15.42:0/460660743 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7053118c0 con 0x55d70529f6f0 2024-09-17T01:38:12.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.925+0000 7f554be00640 1 --2- 172.21.15.42:0/460660743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d70529f6f0 0x55d7056b14f0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f553c003fe0 tx=0x7f553c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c1f3752fa57d244 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:12.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.925+0000 7f5535600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:38:12.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.926+0000 7f5535600640 1 -- 172.21.15.42:0/460660743 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c01e830 con 0x55d70529f6f0 2024-09-17T01:38:12.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.926+0000 7f5535600640 1 -- 172.21.15.42:0/460660743 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 5795+0+0 (secure 0 0 0) 0x7f553c01e9d0 con 0x55d70529f6f0 2024-09-17T01:38:12.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.926+0000 7f555a215740 1 -- 172.21.15.42:0/460660743 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f554408d2d0 con 0x55d70529f6f0 2024-09-17T01:38:12.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.926+0000 7f5535600640 1 -- 172.21.15.42:0/460660743 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f553c030050 con 0x55d70529f6f0 2024-09-17T01:38:12.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.926+0000 7f555a215740 10 client.7491 fetch_fsmap learned FSMap version 79 2024-09-17T01:38:12.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.926+0000 7f555a215740 1 -- 172.21.15.42:0/460660743 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) -- 0x55d70540d1b0 con 0x55d70529f6f0 2024-09-17T01:38:12.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.926+0000 7f5535600640 1 -- 172.21.15.42:0/460660743 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f554408d2d0 con 0x55d70529f6f0 2024-09-17T01:38:12.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.926+0000 7f5535600640 1 -- 172.21.15.42:0/460660743 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 79) ==== 3502+0+0 (secure 0 0 0) 0x7f553c026020 con 0x55d70529f6f0 2024-09-17T01:38:12.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.926+0000 7f555a215740 10 client.7491 fetch_fsmap finished waiting for FSMap version 79 2024-09-17T01:38:12.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.926+0000 7f555a215740 10 client.7491 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T01:38:12.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.926+0000 7f555a215740 20 client.7491 populate_metadata read hostname 'smithi042' 2024-09-17T01:38:12.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.926+0000 7f555a215740 1 --2- 172.21.15.42:0/460660743 >> [v2:172.21.15.42:6832/487915371,v1:172.21.15.42:6834/487915371] conn(0x55d705287180 0x55d705674da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.927+0000 7f555a215740 4 client.7491 mds_command: new command op to 7404 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:38:12.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.927+0000 7f555a215740 1 -- 172.21.15.42:0/460660743 --> [v2:172.21.15.42:6832/487915371,v1:172.21.15.42:6834/487915371] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7055e48c0 con 0x55d705287180 2024-09-17T01:38:12.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.927+0000 7f554b400640 1 --2- 172.21.15.42:0/460660743 >> [v2:172.21.15.42:6832/487915371,v1:172.21.15.42:6834/487915371] conn(0x55d705287180 0x55d705674da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:12.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.927+0000 7f554b400640 1 --2- 172.21.15.42:0/460660743 >> [v2:172.21.15.42:6832/487915371,v1:172.21.15.42:6834/487915371] conn(0x55d705287180 0x55d705674da0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a732683b1feb0abf server_cookie=30deb943192f8bcb in_seq=0 out_seq=0 2024-09-17T01:38:12.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.927+0000 7f5535600640 10 client.7491 ms_handle_connect on v2:172.21.15.42:6832/487915371 2024-09-17T01:38:12.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.928+0000 7f5535600640 1 -- 172.21.15.42:0/460660743 <== mds.0 v2:172.21.15.42:6832/487915371 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d7055e48c0 con 0x55d705287180 2024-09-17T01:38:12.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.928+0000 7f5535600640 10 client.7491 handle_command_reply: tid=0 2024-09-17T01:38:12.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.928+0000 7f555a215740 1 client.7491 shutdown 2024-09-17T01:38:12.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.928+0000 7f555a215740 1 -- 172.21.15.42:0/460660743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d70529f6f0 msgr2=0x55d7056b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:12.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.928+0000 7f555a215740 1 --2- 172.21.15.42:0/460660743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d70529f6f0 0x55d7056b14f0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f553c003fe0 tx=0x7f553c004730 comp rx=0 tx=0).stop 2024-09-17T01:38:12.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.928+0000 7f555a215740 1 -- 172.21.15.42:0/460660743 shutdown_connections 2024-09-17T01:38:12.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.928+0000 7f555a215740 1 --2- 172.21.15.42:0/460660743 >> [v2:172.21.15.42:6832/487915371,v1:172.21.15.42:6834/487915371] conn(0x55d705287180 0x55d705674da0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.928+0000 7f555a215740 1 --2- 172.21.15.42:0/460660743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d7052c85b0 0x55d705671f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.928+0000 7f555a215740 1 --2- 172.21.15.42:0/460660743 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7052a78d0 0x55d7056719d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.928+0000 7f555a215740 1 --2- 172.21.15.42:0/460660743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d70529f6f0 0x55d7056b14f0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.928+0000 7f5535600640 0 client.7491 ms_handle_reset on v2:172.21.15.42:6832/487915371 2024-09-17T01:38:12.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.929+0000 7f555a215740 1 -- 172.21.15.42:0/460660743 >> 172.21.15.42:0/460660743 conn(0x55d7052bc700 msgr2=0x55d7056b5480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:12.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.929+0000 7f555a215740 1 -- 172.21.15.42:0/460660743 shutdown_connections 2024-09-17T01:38:12.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.929+0000 7f555a215740 1 -- 172.21.15.42:0/460660743 wait complete. 2024-09-17T01:38:12.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.929+0000 7f555a215740 20 client.7491 trim_cache size 0 max 16384 2024-09-17T01:38:12.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.949+0000 7f555a215740 1 Processor -- start 2024-09-17T01:38:12.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.950+0000 7f555a215740 1 -- start start 2024-09-17T01:38:12.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.951+0000 7f555a215740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d70529f6f0 0x55d7056aad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.951+0000 7f555a215740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7052a78d0 0x55d7056ab290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.951+0000 7f555a215740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d7052c85b0 0x55d7056d62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.951+0000 7f555a215740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f554c145ac0 con 0x55d70529f6f0 2024-09-17T01:38:12.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.951+0000 7f555a215740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f554c1fa1d0 con 0x55d7052c85b0 2024-09-17T01:38:12.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.951+0000 7f555a215740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f554c1f9530 con 0x55d7052a78d0 2024-09-17T01:38:12.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.951+0000 7f554be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d70529f6f0 0x55d7056aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:12.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.951+0000 7f554be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d70529f6f0 0x55d7056aad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42108/0 (socket says 172.21.15.42:42108) 2024-09-17T01:38:12.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.951+0000 7f554be00640 1 -- 172.21.15.42:0/3347162266 learned_addr learned my addr 172.21.15.42:0/3347162266 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:12.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.951+0000 7f554be00640 1 -- 172.21.15.42:0/3347162266 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7052a78d0 msgr2=0x55d7056ab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:12.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.951+0000 7f554be00640 1 --2- 172.21.15.42:0/3347162266 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7052a78d0 0x55d7056ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.951+0000 7f554be00640 1 -- 172.21.15.42:0/3347162266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d7052c85b0 msgr2=0x55d7056d62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:12.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.951+0000 7f554be00640 1 --2- 172.21.15.42:0/3347162266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d7052c85b0 0x55d7056d62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.951+0000 7f554be00640 1 -- 172.21.15.42:0/3347162266 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7053aad20 con 0x55d70529f6f0 2024-09-17T01:38:12.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.952+0000 7f554be00640 1 --2- 172.21.15.42:0/3347162266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d70529f6f0 0x55d7056aad50 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f553c000c00 tx=0x7f553c01ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6b26447f918186 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:12.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.952+0000 7f5537e00640 1 -- 172.21.15.42:0/3347162266 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c038070 con 0x55d70529f6f0 2024-09-17T01:38:12.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.952+0000 7f5537e00640 1 -- 172.21.15.42:0/3347162266 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f553c011ca0 con 0x55d70529f6f0 2024-09-17T01:38:12.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.952+0000 7f5537e00640 1 -- 172.21.15.42:0/3347162266 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c028440 con 0x55d70529f6f0 2024-09-17T01:38:12.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.953+0000 7f555a215740 1 -- 172.21.15.42:0/3347162266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d70529f6f0 msgr2=0x55d7056aad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:12.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.953+0000 7f555a215740 1 --2- 172.21.15.42:0/3347162266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d70529f6f0 0x55d7056aad50 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f553c000c00 tx=0x7f553c01ed80 comp rx=0 tx=0).stop 2024-09-17T01:38:12.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.953+0000 7f555a215740 1 -- 172.21.15.42:0/3347162266 shutdown_connections 2024-09-17T01:38:12.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.953+0000 7f555a215740 1 --2- 172.21.15.42:0/3347162266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d7052c85b0 0x55d7056d62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.953+0000 7f555a215740 1 --2- 172.21.15.42:0/3347162266 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7052a78d0 0x55d7056ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.953+0000 7f555a215740 1 --2- 172.21.15.42:0/3347162266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d70529f6f0 0x55d7056aad50 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.953+0000 7f555a215740 1 -- 172.21.15.42:0/3347162266 >> 172.21.15.42:0/3347162266 conn(0x55d7052bc700 msgr2=0x55d7056657e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:12.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.953+0000 7f555a215740 1 -- 172.21.15.42:0/3347162266 shutdown_connections 2024-09-17T01:38:12.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.953+0000 7f555a215740 1 -- 172.21.15.42:0/3347162266 wait complete. 2024-09-17T01:38:12.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.954+0000 7f555a215740 1 -- start start 2024-09-17T01:38:12.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.954+0000 7f555a215740 1 Processor -- start 2024-09-17T01:38:12.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.956+0000 7f555a215740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d70529f6f0 0x55d705669b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.956+0000 7f555a215740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d7052a78d0 0x55d7056b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.956+0000 7f555a215740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7052c85b0 0x55d7056b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.956+0000 7f555a215740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f554c1f9b80 con 0x55d70529f6f0 2024-09-17T01:38:12.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.956+0000 7f555a215740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d7056965e0 con 0x55d7052a78d0 2024-09-17T01:38:12.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.956+0000 7f555a215740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55d7056690c0 con 0x55d7052c85b0 2024-09-17T01:38:12.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.956+0000 7f555a215740 10 client.0 _ll_register_callbacks cb 0x7f553c0038d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:38:12.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.956+0000 7f554be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d70529f6f0 0x55d705669b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.956+0000 7f554be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d70529f6f0 0x55d705669b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42114/0 (socket says 172.21.15.42:42114) 2024-09-17T01:38:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.956+0000 7f554be00640 1 -- 172.21.15.42:0/3941110949 learned_addr learned my addr 172.21.15.42:0/3941110949 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.956+0000 7f554be00640 1 -- 172.21.15.42:0/3941110949 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7052c85b0 msgr2=0x55d7056b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.956+0000 7f554be00640 1 --2- 172.21.15.42:0/3941110949 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7052c85b0 0x55d7056b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.956+0000 7f554be00640 1 -- 172.21.15.42:0/3941110949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d7052a78d0 msgr2=0x55d7056b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.956+0000 7f554be00640 1 --2- 172.21.15.42:0/3941110949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d7052a78d0 0x55d7056b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.956+0000 7f554be00640 1 -- 172.21.15.42:0/3941110949 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d705669310 con 0x55d70529f6f0 2024-09-17T01:38:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.957+0000 7f554be00640 1 --2- 172.21.15.42:0/3941110949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d70529f6f0 0x55d705669b10 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f553c004370 tx=0x7f553c01ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3bfe9c3aa52436 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.957+0000 7f5535600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:38:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.957+0000 7f5535600640 1 -- 172.21.15.42:0/3941110949 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c041070 con 0x55d70529f6f0 2024-09-17T01:38:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.957+0000 7f5535600640 1 -- 172.21.15.42:0/3941110949 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 5795+0+0 (secure 0 0 0) 0x7f553c03d660 con 0x55d70529f6f0 2024-09-17T01:38:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.957+0000 7f555a215740 1 -- 172.21.15.42:0/3941110949 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f553c011ca0 con 0x55d70529f6f0 2024-09-17T01:38:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.957+0000 7f5535600640 1 -- 172.21.15.42:0/3941110949 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f553c04c050 con 0x55d70529f6f0 2024-09-17T01:38:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.957+0000 7f555a215740 10 client.7497 fetch_fsmap learned FSMap version 79 2024-09-17T01:38:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.957+0000 7f555a215740 1 -- 172.21.15.42:0/3941110949 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) -- 0x55d70566a050 con 0x55d70529f6f0 2024-09-17T01:38:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.958+0000 7f5535600640 1 -- 172.21.15.42:0/3941110949 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f553c011ca0 con 0x55d70529f6f0 2024-09-17T01:38:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.958+0000 7f5535600640 1 -- 172.21.15.42:0/3941110949 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 79) ==== 3502+0+0 (secure 0 0 0) 0x7f553c04f020 con 0x55d70529f6f0 2024-09-17T01:38:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.958+0000 7f555a215740 10 client.7497 fetch_fsmap finished waiting for FSMap version 79 2024-09-17T01:38:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.958+0000 7f555a215740 10 client.7497 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T01:38:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.958+0000 7f555a215740 20 client.7497 populate_metadata read hostname 'smithi042' 2024-09-17T01:38:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.958+0000 7f555a215740 1 --2- 172.21.15.42:0/3941110949 >> [v2:172.21.15.42:6832/487915371,v1:172.21.15.42:6834/487915371] conn(0x55d705734080 0x55d705734490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.958+0000 7f555a215740 4 client.7497 mds_command: new command op to 7404 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}] 2024-09-17T01:38:12.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.958+0000 7f555a215740 1 -- 172.21.15.42:0/3941110949 --> [v2:172.21.15.42:6832/487915371,v1:172.21.15.42:6834/487915371] -- command(tid 0: {"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}) -- 0x55d7055e0370 con 0x55d705734080 2024-09-17T01:38:12.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.958+0000 7f554b400640 1 --2- 172.21.15.42:0/3941110949 >> [v2:172.21.15.42:6832/487915371,v1:172.21.15.42:6834/487915371] conn(0x55d705734080 0x55d705734490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:12.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.959+0000 7f5535600640 10 client.7497 ms_handle_connect on v2:172.21.15.42:6832/487915371 2024-09-17T01:38:12.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.959+0000 7f554b400640 1 --2- 172.21.15.42:0/3941110949 >> [v2:172.21.15.42:6832/487915371,v1:172.21.15.42:6834/487915371] conn(0x55d705734080 0x55d705734490 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7940b15c27775edc server_cookie=a5cde5fd4a37a965 in_seq=0 out_seq=0 2024-09-17T01:38:12.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.959+0000 7f5535600640 1 -- 172.21.15.42:0/3941110949 <== mds.0 v2:172.21.15.42:6832/487915371 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d7055e0370 con 0x55d705734080 2024-09-17T01:38:12.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.959+0000 7f5535600640 10 client.7497 handle_command_reply: tid=0 2024-09-17T01:38:12.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.959+0000 7f555a215740 1 client.7497 shutdown 2024-09-17T01:38:12.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.959+0000 7f555a215740 1 -- 172.21.15.42:0/3941110949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d70529f6f0 msgr2=0x55d705669b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:12.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.959+0000 7f555a215740 1 --2- 172.21.15.42:0/3941110949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d70529f6f0 0x55d705669b10 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f553c004370 tx=0x7f553c01ec20 comp rx=0 tx=0).stop 2024-09-17T01:38:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.960+0000 7f555a215740 1 -- 172.21.15.42:0/3941110949 shutdown_connections 2024-09-17T01:38:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.960+0000 7f555a215740 1 --2- 172.21.15.42:0/3941110949 >> [v2:172.21.15.42:6832/487915371,v1:172.21.15.42:6834/487915371] conn(0x55d705734080 0x55d705734490 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.960+0000 7f555a215740 1 --2- 172.21.15.42:0/3941110949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d7052a78d0 0x55d7056b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.960+0000 7f555a215740 1 --2- 172.21.15.42:0/3941110949 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7052c85b0 0x55d7056b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.960+0000 7f555a215740 1 --2- 172.21.15.42:0/3941110949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d70529f6f0 0x55d705669b10 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.960+0000 7f555a215740 1 -- 172.21.15.42:0/3941110949 >> 172.21.15.42:0/3941110949 conn(0x55d7052bc700 msgr2=0x55d7056b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.960+0000 7f5535600640 0 client.7497 ms_handle_reset on v2:172.21.15.42:6832/487915371 2024-09-17T01:38:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.960+0000 7f555a215740 1 -- 172.21.15.42:0/3941110949 shutdown_connections 2024-09-17T01:38:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.960+0000 7f555a215740 1 -- 172.21.15.42:0/3941110949 wait complete. 2024-09-17T01:38:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.960+0000 7f555a215740 20 client.7497 trim_cache size 0 max 16384 2024-09-17T01:38:12.962 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:38:12.962 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-17T01:38:12.962 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "3c93111c-c335-4f1d-a50e-0a9f11699ef1", 2024-09-17T01:38:12.962 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-17T01:38:12.962 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:38:12.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.961+0000 7f5553200640 1 -- 172.21.15.42:0/3878994175 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f552c078b90 msgr2=0x7f552c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:12.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.961+0000 7f5553200640 1 --2- 172.21.15.42:0/3878994175 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f552c078b90 0x7f552c07b0a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f553c004590 tx=0x7f553c00b390 comp rx=0 tx=0).stop 2024-09-17T01:38:12.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.961+0000 7f5553200640 1 -- 172.21.15.42:0/3878994175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f554c15f6a0 msgr2=0x7f554c142200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:12.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.961+0000 7f5553200640 1 --2- 172.21.15.42:0/3878994175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f554c15f6a0 0x7f554c142200 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f5544009d90 tx=0x7f5544003ce0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.961+0000 7f5553200640 1 -- 172.21.15.42:0/3878994175 shutdown_connections 2024-09-17T01:38:12.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.961+0000 7f5553200640 1 --2- 172.21.15.42:0/3878994175 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f552c078b90 0x7f552c07b0a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.961+0000 7f5553200640 1 --2- 172.21.15.42:0/3878994175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f554c15f6a0 0x7f554c142200 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.961+0000 7f5553200640 1 --2- 172.21.15.42:0/3878994175 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f554c15c7b0 0x7f554c142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.961+0000 7f5553200640 1 --2- 172.21.15.42:0/3878994175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f554c0d3160 0x7f554c155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.961+0000 7f5553200640 1 -- 172.21.15.42:0/3878994175 >> 172.21.15.42:0/3878994175 conn(0x7f554c073ab0 msgr2=0x7f554c06cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:12.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.961+0000 7f5553200640 1 -- 172.21.15.42:0/3878994175 shutdown_connections 2024-09-17T01:38:12.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:12.961+0000 7f5553200640 1 -- 172.21.15.42:0/3878994175 wait complete. 2024-09-17T01:38:12.988 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:38:13.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.217+0000 7f3e7fe00640 1 -- 172.21.15.42:0/224841182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e8006d430 msgr2=0x7f3e80152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:13.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.217+0000 7f3e7fe00640 1 --2- 172.21.15.42:0/224841182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e8006d430 0x7f3e80152ed0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f3e80071cb0 tx=0x7f3e7802a8b0 comp rx=0 tx=0).stop 2024-09-17T01:38:13.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.218+0000 7f3e7fe00640 1 -- 172.21.15.42:0/224841182 shutdown_connections 2024-09-17T01:38:13.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.218+0000 7f3e7fe00640 1 --2- 172.21.15.42:0/224841182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e8006d430 0x7f3e80152ed0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:13.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.218+0000 7f3e7fe00640 1 --2- 172.21.15.42:0/224841182 >> v2:172.21.15.43:3300/0 conn(0x7f3e800b4be0 0x7f3e8015d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:13.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.218+0000 7f3e7fe00640 1 -- 172.21.15.42:0/224841182 >> 172.21.15.42:0/224841182 conn(0x7f3e800b25f0 msgr2=0x7f3e800d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:13.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.218+0000 7f3e7fe00640 1 -- 172.21.15.42:0/224841182 shutdown_connections 2024-09-17T01:38:13.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.218+0000 7f3e7fe00640 1 -- 172.21.15.42:0/224841182 wait complete. 2024-09-17T01:38:13.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.220+0000 7f3e7fe00640 1 Processor -- start 2024-09-17T01:38:13.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.220+0000 7f3e7fe00640 1 -- start start 2024-09-17T01:38:13.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.222+0000 7f3e7fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e800b4be0 0x7f3e800cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:13.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.222+0000 7f3e7fe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3e800cf7c0 0x7f3e8009d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:13.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.222+0000 7f3e7fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e80150a30 0x7f3e800c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:13.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.222+0000 7f3e7fe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3e801537a0 con 0x7f3e80150a30 2024-09-17T01:38:13.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.222+0000 7f3e7fe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3e80153620 con 0x7f3e800b4be0 2024-09-17T01:38:13.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.222+0000 7f3e7fe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3e80153920 con 0x7f3e800cf7c0 2024-09-17T01:38:13.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.222+0000 7f3e7f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e80150a30 0x7f3e800c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:13.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.222+0000 7f3e7f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e80150a30 0x7f3e800c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42144/0 (socket says 172.21.15.42:42144) 2024-09-17T01:38:13.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.222+0000 7f3e7f400640 1 -- 172.21.15.42:0/2602253876 learned_addr learned my addr 172.21.15.42:0/2602253876 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:13.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.222+0000 7f3e7ea00640 1 --2- 172.21.15.42:0/2602253876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e800b4be0 0x7f3e800cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:13.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.222+0000 7f3e77e00640 1 --2- 172.21.15.42:0/2602253876 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3e800cf7c0 0x7f3e8009d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:13.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.223+0000 7f3e7f400640 1 -- 172.21.15.42:0/2602253876 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3e800cf7c0 msgr2=0x7f3e8009d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:13.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.223+0000 7f3e7f400640 1 --2- 172.21.15.42:0/2602253876 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3e800cf7c0 0x7f3e8009d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:13.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.223+0000 7f3e7f400640 1 -- 172.21.15.42:0/2602253876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e800b4be0 msgr2=0x7f3e800cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:13.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.223+0000 7f3e7f400640 1 --2- 172.21.15.42:0/2602253876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e800b4be0 0x7f3e800cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:13.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.223+0000 7f3e7f400640 1 -- 172.21.15.42:0/2602253876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e800ca900 con 0x7f3e80150a30 2024-09-17T01:38:13.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.223+0000 7f3e7f400640 1 --2- 172.21.15.42:0/2602253876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e80150a30 0x7f3e800c9420 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f3e7802aea0 tx=0x7f3e78033f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:13.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.223+0000 7f3e76a00640 1 -- 172.21.15.42:0/2602253876 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e78031990 con 0x7f3e80150a30 2024-09-17T01:38:13.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.223+0000 7f3e76a00640 1 -- 172.21.15.42:0/2602253876 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e78031c20 con 0x7f3e80150a30 2024-09-17T01:38:13.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.223+0000 7f3e76a00640 1 -- 172.21.15.42:0/2602253876 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e780330d0 con 0x7f3e80150a30 2024-09-17T01:38:13.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.223+0000 7f3e7fe00640 1 -- 172.21.15.42:0/2602253876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e800cabe0 con 0x7f3e80150a30 2024-09-17T01:38:13.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.223+0000 7f3e7fe00640 1 -- 172.21.15.42:0/2602253876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e80072df0 con 0x7f3e80150a30 2024-09-17T01:38:13.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.224+0000 7f3e7fe00640 1 -- 172.21.15.42:0/2602253876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e800cc170 con 0x7f3e80150a30 2024-09-17T01:38:13.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.226+0000 7f3e76a00640 1 -- 172.21.15.42:0/2602253876 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3e78033270 con 0x7f3e80150a30 2024-09-17T01:38:13.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.227+0000 7f3e76a00640 1 --2- 172.21.15.42:0/2602253876 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3e5c078b90 0x7f3e5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:13.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.227+0000 7f3e76a00640 1 -- 172.21.15.42:0/2602253876 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5795+0+0 (secure 0 0 0) 0x7f3e780bc0f0 con 0x7f3e80150a30 2024-09-17T01:38:13.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.227+0000 7f3e7ea00640 1 --2- 172.21.15.42:0/2602253876 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3e5c078b90 0x7f3e5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:13.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.228+0000 7f3e7ea00640 1 --2- 172.21.15.42:0/2602253876 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3e5c078b90 0x7f3e5c07b0a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3e7000bb50 tx=0x7f3e7000b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:13.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.232+0000 7f3e76a00640 1 -- 172.21.15.42:0/2602253876 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3e7803f030 con 0x7f3e80150a30 2024-09-17T01:38:13.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.462+0000 7f3e7fe00640 1 -- 172.21.15.42:0/2602253876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e80073050 con 0x7f3e80150a30 2024-09-17T01:38:13.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.463+0000 7f3e76a00640 1 -- 172.21.15.42:0/2602253876 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) ==== 94+0+5223 (secure 0 0 0) 0x7f3e78083e80 con 0x7f3e80150a30 2024-09-17T01:38:13.461 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:38:13.461 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":79,"btime":"2024-09-17T01:38:09:405324+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3191013971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":3191013971},{"type":"v1","addr":"172.21.15.43:6837","nonce":3191013971}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7042,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2889481399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2889481399},{"type":"v1","addr":"172.21.15.43:6835","nonce":2889481399}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1913337319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1913337319},{"type":"v1","addr":"172.21.15.42:6835","nonce":1913337319}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:37:52.812411+0000","modified":"2024-09-17T01:38:09.405313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7404},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7404":{"gid":7404,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6834/487915371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":487915371},{"type":"v1","addr":"172.21.15.42:6834","nonce":487915371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7404,"qdb_cluster":[7404]},"id":6}]} 2024-09-17T01:38:13.461 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 79 2024-09-17T01:38:13.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.466+0000 7f3e7fe00640 1 -- 172.21.15.42:0/2602253876 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3e5c078b90 msgr2=0x7f3e5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:13.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.466+0000 7f3e7fe00640 1 --2- 172.21.15.42:0/2602253876 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3e5c078b90 0x7f3e5c07b0a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3e7000bb50 tx=0x7f3e7000b2e0 comp rx=0 tx=0).stop 2024-09-17T01:38:13.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.466+0000 7f3e7fe00640 1 -- 172.21.15.42:0/2602253876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e80150a30 msgr2=0x7f3e800c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:13.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.466+0000 7f3e7fe00640 1 --2- 172.21.15.42:0/2602253876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e80150a30 0x7f3e800c9420 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f3e7802aea0 tx=0x7f3e78033f70 comp rx=0 tx=0).stop 2024-09-17T01:38:13.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.466+0000 7f3e7fe00640 1 -- 172.21.15.42:0/2602253876 shutdown_connections 2024-09-17T01:38:13.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.466+0000 7f3e7fe00640 1 --2- 172.21.15.42:0/2602253876 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3e5c078b90 0x7f3e5c07b0a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:13.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.466+0000 7f3e7fe00640 1 --2- 172.21.15.42:0/2602253876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e80150a30 0x7f3e800c9420 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:13.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.466+0000 7f3e7fe00640 1 --2- 172.21.15.42:0/2602253876 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3e800cf7c0 0x7f3e8009d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:13.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.466+0000 7f3e7fe00640 1 --2- 172.21.15.42:0/2602253876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e800b4be0 0x7f3e800cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:13.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.466+0000 7f3e7fe00640 1 -- 172.21.15.42:0/2602253876 >> 172.21.15.42:0/2602253876 conn(0x7f3e800b25f0 msgr2=0x7f3e800cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:13.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.466+0000 7f3e7fe00640 1 -- 172.21.15.42:0/2602253876 shutdown_connections 2024-09-17T01:38:13.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:13.466+0000 7f3e7fe00640 1 -- 172.21.15.42:0/2602253876 wait complete. 2024-09-17T01:38:13.490 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-17T01:38:13.734 INFO:teuthology.orchestra.run.smithi042.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-17T01:38:02.874665+0000","btime":"2024-09-17T01:38:01.722675+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-17T01:38:02.874665+0000","atime":"2024-09-17T01:38:01.722675+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-17T01:38:02.874665+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-17T01:38:02.875665+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-17T01:38:02.875665+0000"},"version":128,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":1,"authpin":0,"scrubqueue":0},"nref":1,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-17T01:38:13.735 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-17T01:38:02.875665+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-17T01:38:01.722675+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-17T01:38:01.722675+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-17T01:38:02.874665+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-17T01:38:02.874665+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-17T01:38:02.874665+0000", "nestlock": {}, "nlink": 1, "nref": 1, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 1, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-17T01:38:02.875665+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 128, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-17T01:38:13.735 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-17T01:38:18.736 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:38:18.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.977+0000 7fbf94600640 1 -- 172.21.15.42:0/1453205762 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf8c0cec40 msgr2=0x7fbf8c0cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:18.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.977+0000 7fbf94600640 1 --2- 172.21.15.42:0/1453205762 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf8c0cec40 0x7fbf8c0cf050 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fbf84005fd0 tx=0x7fbf8402a970 comp rx=0 tx=0).stop 2024-09-17T01:38:18.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.977+0000 7fbf94600640 1 -- 172.21.15.42:0/1453205762 shutdown_connections 2024-09-17T01:38:18.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.977+0000 7fbf94600640 1 --2- 172.21.15.42:0/1453205762 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf8c0cec40 0x7fbf8c0cf050 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:18.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.977+0000 7fbf94600640 1 --2- 172.21.15.42:0/1453205762 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf8c0b3550 0x7fbf8c15cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:18.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.977+0000 7fbf94600640 1 -- 172.21.15.42:0/1453205762 >> 172.21.15.42:0/1453205762 conn(0x7fbf8c0b2930 msgr2=0x7fbf8c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:18.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.977+0000 7fbf94600640 1 -- 172.21.15.42:0/1453205762 shutdown_connections 2024-09-17T01:38:18.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.977+0000 7fbf94600640 1 -- 172.21.15.42:0/1453205762 wait complete. 2024-09-17T01:38:18.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.980+0000 7fbf94600640 1 Processor -- start 2024-09-17T01:38:18.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.980+0000 7fbf94600640 1 -- start start 2024-09-17T01:38:18.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.981+0000 7fbf94600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf8c0b3550 0x7fbf8c15ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:18.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.981+0000 7fbf94600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf8c0cec40 0x7fbf8c1f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:18.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.981+0000 7fbf94600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf8c142f40 0x7fbf8c1f7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:18.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.981+0000 7fbf94600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8c06d7c0 con 0x7fbf8c0cec40 2024-09-17T01:38:18.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.981+0000 7fbf94600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8c06d640 con 0x7fbf8c0b3550 2024-09-17T01:38:18.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.981+0000 7fbf94600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbf8c06d940 con 0x7fbf8c142f40 2024-09-17T01:38:18.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.982+0000 7fbf91200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf8c0cec40 0x7fbf8c1f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:18.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.982+0000 7fbf91200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf8c0cec40 0x7fbf8c1f6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58778/0 (socket says 172.21.15.42:58778) 2024-09-17T01:38:18.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.982+0000 7fbf91200640 1 -- 172.21.15.42:0/1074768608 learned_addr learned my addr 172.21.15.42:0/1074768608 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:18.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.982+0000 7fbf91c00640 1 --2- 172.21.15.42:0/1074768608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf8c0b3550 0x7fbf8c15ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:18.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.982+0000 7fbf92600640 1 --2- 172.21.15.42:0/1074768608 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf8c142f40 0x7fbf8c1f7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:18.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.982+0000 7fbf91200640 1 -- 172.21.15.42:0/1074768608 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf8c142f40 msgr2=0x7fbf8c1f7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:18.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.982+0000 7fbf91200640 1 --2- 172.21.15.42:0/1074768608 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf8c142f40 0x7fbf8c1f7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:18.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.982+0000 7fbf91200640 1 -- 172.21.15.42:0/1074768608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf8c0b3550 msgr2=0x7fbf8c15ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:18.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.982+0000 7fbf91200640 1 --2- 172.21.15.42:0/1074768608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf8c0b3550 0x7fbf8c15ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:18.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.982+0000 7fbf91200640 1 -- 172.21.15.42:0/1074768608 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf8c1e8f70 con 0x7fbf8c0cec40 2024-09-17T01:38:18.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.982+0000 7fbf91c00640 1 --2- 172.21.15.42:0/1074768608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf8c0b3550 0x7fbf8c15ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:18.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.982+0000 7fbf92600640 1 --2- 172.21.15.42:0/1074768608 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf8c142f40 0x7fbf8c1f7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:18.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.982+0000 7fbf91200640 1 --2- 172.21.15.42:0/1074768608 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf8c0cec40 0x7fbf8c1f6cc0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800b420 tx=0x7fbf7800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:18.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.983+0000 7fbf89600640 1 -- 172.21.15.42:0/1074768608 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf78011830 con 0x7fbf8c0cec40 2024-09-17T01:38:18.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.983+0000 7fbf89600640 1 -- 172.21.15.42:0/1074768608 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf78016070 con 0x7fbf8c0cec40 2024-09-17T01:38:18.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.983+0000 7fbf89600640 1 -- 172.21.15.42:0/1074768608 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf78011d60 con 0x7fbf8c0cec40 2024-09-17T01:38:18.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.983+0000 7fbf94600640 1 -- 172.21.15.42:0/1074768608 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf8c1f7ad0 con 0x7fbf8c0cec40 2024-09-17T01:38:18.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.983+0000 7fbf94600640 1 -- 172.21.15.42:0/1074768608 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf8c1ea2c0 con 0x7fbf8c0cec40 2024-09-17T01:38:18.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.984+0000 7fbf94600640 1 -- 172.21.15.42:0/1074768608 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf8c15cec0 con 0x7fbf8c0cec40 2024-09-17T01:38:18.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.985+0000 7fbf89600640 1 -- 172.21.15.42:0/1074768608 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbf7801b460 con 0x7fbf8c0cec40 2024-09-17T01:38:18.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.986+0000 7fbf89600640 1 --2- 172.21.15.42:0/1074768608 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbf6c078bc0 0x7fbf6c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:18.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.986+0000 7fbf89600640 1 -- 172.21.15.42:0/1074768608 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5795+0+0 (secure 0 0 0) 0x7fbf7809a810 con 0x7fbf8c0cec40 2024-09-17T01:38:18.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.987+0000 7fbf91c00640 1 --2- 172.21.15.42:0/1074768608 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbf6c078bc0 0x7fbf6c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:18.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.987+0000 7fbf91c00640 1 --2- 172.21.15.42:0/1074768608 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbf6c078bc0 0x7fbf6c07b0d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbf80005fd0 tx=0x7fbf8000f360 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:18.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:18.991+0000 7fbf89600640 1 -- 172.21.15.42:0/1074768608 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbf78020020 con 0x7fbf8c0cec40 2024-09-17T01:38:19.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:19.223+0000 7fbf94600640 1 -- 172.21.15.42:0/1074768608 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf8c06a170 con 0x7fbf8c0cec40 2024-09-17T01:38:19.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:19.224+0000 7fbf89600640 1 -- 172.21.15.42:0/1074768608 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) ==== 94+0+5223 (secure 0 0 0) 0x7fbf8c1e8f70 con 0x7fbf8c0cec40 2024-09-17T01:38:19.222 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:38:19.222 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":79,"btime":"2024-09-17T01:38:09:405324+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3191013971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":3191013971},{"type":"v1","addr":"172.21.15.43:6837","nonce":3191013971}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7042,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2889481399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2889481399},{"type":"v1","addr":"172.21.15.43:6835","nonce":2889481399}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1913337319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1913337319},{"type":"v1","addr":"172.21.15.42:6835","nonce":1913337319}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:37:52.812411+0000","modified":"2024-09-17T01:38:09.405313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7404},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7404":{"gid":7404,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6834/487915371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":487915371},{"type":"v1","addr":"172.21.15.42:6834","nonce":487915371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7404,"qdb_cluster":[7404]},"id":6}]} 2024-09-17T01:38:19.222 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 79 2024-09-17T01:38:19.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:19.227+0000 7fbf94600640 1 -- 172.21.15.42:0/1074768608 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbf6c078bc0 msgr2=0x7fbf6c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:19.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:19.227+0000 7fbf94600640 1 --2- 172.21.15.42:0/1074768608 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbf6c078bc0 0x7fbf6c07b0d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbf80005fd0 tx=0x7fbf8000f360 comp rx=0 tx=0).stop 2024-09-17T01:38:19.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:19.227+0000 7fbf94600640 1 -- 172.21.15.42:0/1074768608 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf8c0cec40 msgr2=0x7fbf8c1f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:19.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:19.227+0000 7fbf94600640 1 --2- 172.21.15.42:0/1074768608 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf8c0cec40 0x7fbf8c1f6cc0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800b420 tx=0x7fbf7800b8e0 comp rx=0 tx=0).stop 2024-09-17T01:38:19.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:19.227+0000 7fbf94600640 1 -- 172.21.15.42:0/1074768608 shutdown_connections 2024-09-17T01:38:19.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:19.227+0000 7fbf94600640 1 --2- 172.21.15.42:0/1074768608 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbf6c078bc0 0x7fbf6c07b0d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:19.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:19.227+0000 7fbf94600640 1 --2- 172.21.15.42:0/1074768608 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbf8c142f40 0x7fbf8c1f7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:19.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:19.227+0000 7fbf94600640 1 --2- 172.21.15.42:0/1074768608 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbf8c0cec40 0x7fbf8c1f6cc0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:19.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:19.227+0000 7fbf94600640 1 --2- 172.21.15.42:0/1074768608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf8c0b3550 0x7fbf8c15ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:19.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:19.227+0000 7fbf94600640 1 -- 172.21.15.42:0/1074768608 >> 172.21.15.42:0/1074768608 conn(0x7fbf8c0b2930 msgr2=0x7fbf8c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:19.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:19.227+0000 7fbf94600640 1 -- 172.21.15.42:0/1074768608 shutdown_connections 2024-09-17T01:38:19.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:19.227+0000 7fbf94600640 1 -- 172.21.15.42:0/1074768608 wait complete. 2024-09-17T01:38:19.247 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-17T01:38:19.491 INFO:teuthology.orchestra.run.smithi042.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-17T01:38:02.874665+0000","btime":"2024-09-17T01:38:01.722675+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-17T01:38:02.874665+0000","atime":"2024-09-17T01:38:01.722675+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-17T01:38:02.874665+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-17T01:38:02.875665+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-17T01:38:02.875665+0000"},"version":131,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"inline_data_version":18446744073709551615,"inline_data_length":0,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"2024-09-17T01:38:12.961996+0000","last_scrub_version":128,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":2,"dirtyrstat":1,"dirty":1,"authpin":0,"scrubqueue":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyrstat"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-17T01:38:19.492 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-17T01:38:02.875665+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-17T01:38:01.722675+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-17T01:38:01.722675+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-17T01:38:02.874665+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-17T01:38:02.874665+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "inline_data_length": 0, "inline_data_version": 18446744073709551615, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "2024-09-17T01:38:12.961996+0000", "last_scrub_version": 128, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-17T01:38:02.874665+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 2, "dirty": 1, "dirtyrstat": 1, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-17T01:38:02.875665+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyrstat" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 131, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-17T01:38:19.492 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-17T01:38:19.493 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:38:19.493 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:38:19.586 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:38:19.687 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:38:19.687 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:38:19.687 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:38:19.688 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:38:19.723 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:38:19.723 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:38:19.724 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:38:19.724 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:38:19.762 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:38:19.763 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:38:19.763 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:38:19.763 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:38:19.799 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:38:19.799 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:38:19.800 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:38:19.800 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:38:19.839 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:38:19.839 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:38:20.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.067+0000 7fc788200640 1 -- 172.21.15.42:0/1711676343 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc78015f190 msgr2=0x7fc78006fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:20.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.067+0000 7fc788200640 1 --2- 172.21.15.42:0/1711676343 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc78015f190 0x7fc78006fe40 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fc7800b3110 tx=0x7fc76c02a5f0 comp rx=0 tx=0).stop 2024-09-17T01:38:20.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.067+0000 7fc788200640 1 -- 172.21.15.42:0/1711676343 shutdown_connections 2024-09-17T01:38:20.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.067+0000 7fc788200640 1 --2- 172.21.15.42:0/1711676343 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc78015f190 0x7fc78006fe40 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:20.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.067+0000 7fc788200640 1 --2- 172.21.15.42:0/1711676343 >> v2:172.21.15.43:3300/0 conn(0x7fc780072e00 0x7fc78015bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:20.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.067+0000 7fc788200640 1 -- 172.21.15.42:0/1711676343 >> 172.21.15.42:0/1711676343 conn(0x7fc7800b2930 msgr2=0x7fc78006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:20.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.068+0000 7fc788200640 1 -- 172.21.15.42:0/1711676343 shutdown_connections 2024-09-17T01:38:20.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.068+0000 7fc788200640 1 -- 172.21.15.42:0/1711676343 wait complete. 2024-09-17T01:38:20.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.070+0000 7fc788200640 1 Processor -- start 2024-09-17T01:38:20.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.070+0000 7fc788200640 1 -- start start 2024-09-17T01:38:20.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.071+0000 7fc788200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc78006d430 0x7fc780148000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:20.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.071+0000 7fc788200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc780072e00 0x7fc780150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:20.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.071+0000 7fc788200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc78015f190 0x7fc78014af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:20.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.071+0000 7fc788200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc78015f650 con 0x7fc780072e00 2024-09-17T01:38:20.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.071+0000 7fc788200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc780070740 con 0x7fc78015f190 2024-09-17T01:38:20.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.071+0000 7fc788200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc780151520 con 0x7fc78006d430 2024-09-17T01:38:20.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.072+0000 7fc784e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc780072e00 0x7fc780150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:20.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.072+0000 7fc784e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc780072e00 0x7fc780150e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58784/0 (socket says 172.21.15.42:58784) 2024-09-17T01:38:20.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.072+0000 7fc784e00640 1 -- 172.21.15.42:0/2292775306 learned_addr learned my addr 172.21.15.42:0/2292775306 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:20.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.072+0000 7fc785800640 1 --2- 172.21.15.42:0/2292775306 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc78006d430 0x7fc780148000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:20.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.072+0000 7fc786200640 1 --2- 172.21.15.42:0/2292775306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc78015f190 0x7fc78014af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:20.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.072+0000 7fc784e00640 1 -- 172.21.15.42:0/2292775306 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc78006d430 msgr2=0x7fc780148000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:20.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.072+0000 7fc784e00640 1 --2- 172.21.15.42:0/2292775306 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc78006d430 0x7fc780148000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.072+0000 7fc784e00640 1 -- 172.21.15.42:0/2292775306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc78015f190 msgr2=0x7fc78014af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.072+0000 7fc784e00640 1 --2- 172.21.15.42:0/2292775306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc78015f190 0x7fc78014af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.072+0000 7fc784e00640 1 -- 172.21.15.42:0/2292775306 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc78014b4c0 con 0x7fc780072e00 2024-09-17T01:38:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.072+0000 7fc784e00640 1 --2- 172.21.15.42:0/2292775306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc780072e00 0x7fc780150e40 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fc76c000c00 tx=0x7fc76c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.073+0000 7fc77d600640 1 -- 172.21.15.42:0/2292775306 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c03e030 con 0x7fc780072e00 2024-09-17T01:38:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.073+0000 7fc77d600640 1 -- 172.21.15.42:0/2292775306 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc76c003d10 con 0x7fc780072e00 2024-09-17T01:38:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.073+0000 7fc77d600640 1 -- 172.21.15.42:0/2292775306 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c035040 con 0x7fc780072e00 2024-09-17T01:38:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.073+0000 7fc788200640 1 -- 172.21.15.42:0/2292775306 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc780150080 con 0x7fc780072e00 2024-09-17T01:38:20.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.073+0000 7fc788200640 1 -- 172.21.15.42:0/2292775306 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc780150640 con 0x7fc780072e00 2024-09-17T01:38:20.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.074+0000 7fc788200640 1 -- 172.21.15.42:0/2292775306 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc78014b700 con 0x7fc780072e00 2024-09-17T01:38:20.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.075+0000 7fc77d600640 1 -- 172.21.15.42:0/2292775306 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc76c041030 con 0x7fc780072e00 2024-09-17T01:38:20.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.076+0000 7fc77d600640 1 --2- 172.21.15.42:0/2292775306 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc760078b90 0x7fc76007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:20.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.076+0000 7fc77d600640 1 -- 172.21.15.42:0/2292775306 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5795+0+0 (secure 0 0 0) 0x7fc76c0bb450 con 0x7fc780072e00 2024-09-17T01:38:20.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.077+0000 7fc785800640 1 --2- 172.21.15.42:0/2292775306 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc760078b90 0x7fc76007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:20.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.078+0000 7fc785800640 1 --2- 172.21.15.42:0/2292775306 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc760078b90 0x7fc76007b0a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc774009b30 tx=0x7fc774005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:20.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.081+0000 7fc77d600640 1 -- 172.21.15.42:0/2292775306 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc76c0831d0 con 0x7fc780072e00 2024-09-17T01:38:20.163 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:38:20.168 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:38:20.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.311+0000 7fc788200640 1 -- 172.21.15.42:0/2292775306 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc78015bc50 con 0x7fc780072e00 2024-09-17T01:38:20.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.312+0000 7fc77d600640 1 -- 172.21.15.42:0/2292775306 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) ==== 94+0+5223 (secure 0 0 0) 0x7fc76c087c00 con 0x7fc780072e00 2024-09-17T01:38:20.310 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:38:20.310 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":79,"btime":"2024-09-17T01:38:09:405324+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3191013971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":3191013971},{"type":"v1","addr":"172.21.15.43:6837","nonce":3191013971}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7042,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2889481399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2889481399},{"type":"v1","addr":"172.21.15.43:6835","nonce":2889481399}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1913337319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1913337319},{"type":"v1","addr":"172.21.15.42:6835","nonce":1913337319}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:37:52.812411+0000","modified":"2024-09-17T01:38:09.405313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7404},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7404":{"gid":7404,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6834/487915371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":487915371},{"type":"v1","addr":"172.21.15.42:6834","nonce":487915371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7404,"qdb_cluster":[7404]},"id":6}]} 2024-09-17T01:38:20.310 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 79 2024-09-17T01:38:20.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.314+0000 7fc788200640 1 -- 172.21.15.42:0/2292775306 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc760078b90 msgr2=0x7fc76007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:20.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.314+0000 7fc788200640 1 --2- 172.21.15.42:0/2292775306 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc760078b90 0x7fc76007b0a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc774009b30 tx=0x7fc774005f90 comp rx=0 tx=0).stop 2024-09-17T01:38:20.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.314+0000 7fc788200640 1 -- 172.21.15.42:0/2292775306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc780072e00 msgr2=0x7fc780150e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:20.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.314+0000 7fc788200640 1 --2- 172.21.15.42:0/2292775306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc780072e00 0x7fc780150e40 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fc76c000c00 tx=0x7fc76c003820 comp rx=0 tx=0).stop 2024-09-17T01:38:20.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.314+0000 7fc788200640 1 -- 172.21.15.42:0/2292775306 shutdown_connections 2024-09-17T01:38:20.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.314+0000 7fc788200640 1 --2- 172.21.15.42:0/2292775306 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc760078b90 0x7fc76007b0a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:20.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.314+0000 7fc788200640 1 --2- 172.21.15.42:0/2292775306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc78015f190 0x7fc78014af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:20.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.314+0000 7fc788200640 1 --2- 172.21.15.42:0/2292775306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc780072e00 0x7fc780150e40 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:20.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.314+0000 7fc788200640 1 --2- 172.21.15.42:0/2292775306 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc78006d430 0x7fc780148000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:20.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.314+0000 7fc788200640 1 -- 172.21.15.42:0/2292775306 >> 172.21.15.42:0/2292775306 conn(0x7fc7800b2930 msgr2=0x7fc7800b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:20.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.314+0000 7fc788200640 1 -- 172.21.15.42:0/2292775306 shutdown_connections 2024-09-17T01:38:20.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.314+0000 7fc788200640 1 -- 172.21.15.42:0/2292775306 wait complete. 2024-09-17T01:38:20.336 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:38:20.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.565+0000 7f89f4a00640 1 -- 172.21.15.42:0/3275451710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89f00cf7c0 msgr2=0x7f89f006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:20.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.565+0000 7f89f4a00640 1 --2- 172.21.15.42:0/3275451710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89f00cf7c0 0x7f89f006cd20 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f89f0071cb0 tx=0x7f89d802a560 comp rx=0 tx=0).stop 2024-09-17T01:38:20.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.565+0000 7f89f4a00640 1 -- 172.21.15.42:0/3275451710 shutdown_connections 2024-09-17T01:38:20.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.565+0000 7f89f4a00640 1 --2- 172.21.15.42:0/3275451710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89f00cf7c0 0x7f89f006cd20 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:20.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.565+0000 7f89f4a00640 1 --2- 172.21.15.42:0/3275451710 >> v2:172.21.15.43:3300/0 conn(0x7f89f00b4be0 0x7f89f015d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:20.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.565+0000 7f89f4a00640 1 -- 172.21.15.42:0/3275451710 >> 172.21.15.42:0/3275451710 conn(0x7f89f00b25f0 msgr2=0x7f89f00d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:20.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.565+0000 7f89f4a00640 1 -- 172.21.15.42:0/3275451710 shutdown_connections 2024-09-17T01:38:20.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.565+0000 7f89f4a00640 1 -- 172.21.15.42:0/3275451710 wait complete. 2024-09-17T01:38:20.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.567+0000 7f89f4a00640 1 Processor -- start 2024-09-17T01:38:20.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.567+0000 7f89f4a00640 1 -- start start 2024-09-17T01:38:20.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.569+0000 7f89f4a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89f006d260 0x7f89f01f9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:20.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.569+0000 7f89f4a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89f00b4be0 0x7f89f009db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:20.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.569+0000 7f89f4a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f89f00cf7c0 0x7f89f00afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:20.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.569+0000 7f89f4a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f89f0153970 con 0x7f89f006d260 2024-09-17T01:38:20.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.569+0000 7f89f4a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f89f01537f0 con 0x7f89f00b4be0 2024-09-17T01:38:20.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.569+0000 7f89f4a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f89f0153af0 con 0x7f89f00cf7c0 2024-09-17T01:38:20.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.569+0000 7f89ee800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89f006d260 0x7f89f01f9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:20.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.569+0000 7f89ee800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89f006d260 0x7f89f01f9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58804/0 (socket says 172.21.15.42:58804) 2024-09-17T01:38:20.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.569+0000 7f89ee800640 1 -- 172.21.15.42:0/2609974181 learned_addr learned my addr 172.21.15.42:0/2609974181 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:20.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.569+0000 7f89e7e00640 1 --2- 172.21.15.42:0/2609974181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89f00b4be0 0x7f89f009db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:20.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.569+0000 7f89ef200640 1 --2- 172.21.15.42:0/2609974181 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f89f00cf7c0 0x7f89f00afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:20.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.570+0000 7f89ee800640 1 -- 172.21.15.42:0/2609974181 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f89f00cf7c0 msgr2=0x7f89f00afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:20.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.570+0000 7f89ee800640 1 --2- 172.21.15.42:0/2609974181 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f89f00cf7c0 0x7f89f00afd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:20.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.570+0000 7f89ee800640 1 -- 172.21.15.42:0/2609974181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89f00b4be0 msgr2=0x7f89f009db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:20.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.570+0000 7f89ee800640 1 --2- 172.21.15.42:0/2609974181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89f00b4be0 0x7f89f009db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:20.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.570+0000 7f89ee800640 1 -- 172.21.15.42:0/2609974181 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f01e4ec0 con 0x7f89f006d260 2024-09-17T01:38:20.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.570+0000 7f89ee800640 1 --2- 172.21.15.42:0/2609974181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89f006d260 0x7f89f01f9340 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f89e000d6d0 tx=0x7f89e000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:20.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.570+0000 7f89e6a00640 1 -- 172.21.15.42:0/2609974181 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e0017070 con 0x7f89f006d260 2024-09-17T01:38:20.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.570+0000 7f89e6a00640 1 -- 172.21.15.42:0/2609974181 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89e0005330 con 0x7f89f006d260 2024-09-17T01:38:20.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.570+0000 7f89e6a00640 1 -- 172.21.15.42:0/2609974181 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e0009820 con 0x7f89f006d260 2024-09-17T01:38:20.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.570+0000 7f89f4a00640 1 -- 172.21.15.42:0/2609974181 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f0152a30 con 0x7f89f006d260 2024-09-17T01:38:20.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.570+0000 7f89f4a00640 1 -- 172.21.15.42:0/2609974181 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f01f5b70 con 0x7f89f006d260 2024-09-17T01:38:20.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.571+0000 7f89f4a00640 1 -- 172.21.15.42:0/2609974181 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89f015d6b0 con 0x7f89f006d260 2024-09-17T01:38:20.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.573+0000 7f89e6a00640 1 -- 172.21.15.42:0/2609974181 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f89e0009bd0 con 0x7f89f006d260 2024-09-17T01:38:20.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.574+0000 7f89e6a00640 1 --2- 172.21.15.42:0/2609974181 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f89cc078b90 0x7f89cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:20.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.574+0000 7f89e6a00640 1 -- 172.21.15.42:0/2609974181 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5795+0+0 (secure 0 0 0) 0x7f89e009b210 con 0x7f89f006d260 2024-09-17T01:38:20.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.574+0000 7f89e7e00640 1 --2- 172.21.15.42:0/2609974181 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f89cc078b90 0x7f89cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:20.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.575+0000 7f89e7e00640 1 --2- 172.21.15.42:0/2609974181 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f89cc078b90 0x7f89cc07b0a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f89d8033000 tx=0x7f89d8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:20.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.578+0000 7f89e6a00640 1 -- 172.21.15.42:0/2609974181 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f89e0063550 con 0x7f89f006d260 2024-09-17T01:38:20.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.815+0000 7f89f4a00640 1 -- 172.21.15.42:0/2609974181 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89f0069870 con 0x7f89f006d260 2024-09-17T01:38:20.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.815+0000 7f89e6a00640 1 -- 172.21.15.42:0/2609974181 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) ==== 94+0+5223 (secure 0 0 0) 0x7f89e0062e50 con 0x7f89f006d260 2024-09-17T01:38:20.813 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:38:20.813 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":79,"btime":"2024-09-17T01:38:09:405324+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3191013971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":3191013971},{"type":"v1","addr":"172.21.15.43:6837","nonce":3191013971}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7042,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2889481399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2889481399},{"type":"v1","addr":"172.21.15.43:6835","nonce":2889481399}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1913337319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1913337319},{"type":"v1","addr":"172.21.15.42:6835","nonce":1913337319}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:37:52.812411+0000","modified":"2024-09-17T01:38:09.405313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7404},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7404":{"gid":7404,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6834/487915371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":487915371},{"type":"v1","addr":"172.21.15.42:6834","nonce":487915371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7404,"qdb_cluster":[7404]},"id":6}]} 2024-09-17T01:38:20.814 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 79 2024-09-17T01:38:20.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.818+0000 7f89f4a00640 1 -- 172.21.15.42:0/2609974181 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f89cc078b90 msgr2=0x7f89cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:20.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.818+0000 7f89f4a00640 1 --2- 172.21.15.42:0/2609974181 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f89cc078b90 0x7f89cc07b0a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f89d8033000 tx=0x7f89d8004730 comp rx=0 tx=0).stop 2024-09-17T01:38:20.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.818+0000 7f89f4a00640 1 -- 172.21.15.42:0/2609974181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89f006d260 msgr2=0x7f89f01f9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:20.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.818+0000 7f89f4a00640 1 --2- 172.21.15.42:0/2609974181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89f006d260 0x7f89f01f9340 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f89e000d6d0 tx=0x7f89e000db90 comp rx=0 tx=0).stop 2024-09-17T01:38:20.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.818+0000 7f89f4a00640 1 -- 172.21.15.42:0/2609974181 shutdown_connections 2024-09-17T01:38:20.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.818+0000 7f89f4a00640 1 --2- 172.21.15.42:0/2609974181 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f89cc078b90 0x7f89cc07b0a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:20.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.818+0000 7f89f4a00640 1 --2- 172.21.15.42:0/2609974181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89f00b4be0 0x7f89f009db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:20.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.818+0000 7f89f4a00640 1 --2- 172.21.15.42:0/2609974181 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f89f00cf7c0 0x7f89f00afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:20.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.818+0000 7f89f4a00640 1 --2- 172.21.15.42:0/2609974181 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89f006d260 0x7f89f01f9340 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:20.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.818+0000 7f89f4a00640 1 -- 172.21.15.42:0/2609974181 >> 172.21.15.42:0/2609974181 conn(0x7f89f00b25f0 msgr2=0x7f89f00b4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:20.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.818+0000 7f89f4a00640 1 -- 172.21.15.42:0/2609974181 shutdown_connections 2024-09-17T01:38:20.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:20.818+0000 7f89f4a00640 1 -- 172.21.15.42:0/2609974181 wait complete. 2024-09-17T01:38:20.840 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:38:21.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.069+0000 7f22e2200640 1 -- 172.21.15.42:0/2366165886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22dc15f740 msgr2=0x7f22dc06d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:21.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.069+0000 7f22e2200640 1 --2- 172.21.15.42:0/2366165886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22dc15f740 0x7f22dc06d430 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f22dc15fed0 tx=0x7f22d402aa00 comp rx=0 tx=0).stop 2024-09-17T01:38:21.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.069+0000 7f22e2200640 1 -- 172.21.15.42:0/2366165886 shutdown_connections 2024-09-17T01:38:21.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.069+0000 7f22e2200640 1 --2- 172.21.15.42:0/2366165886 >> v2:172.21.15.43:3300/0 conn(0x7f22dc074500 0x7f22dc06eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.069+0000 7f22e2200640 1 --2- 172.21.15.42:0/2366165886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22dc15f740 0x7f22dc06d430 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.069+0000 7f22e2200640 1 --2- 172.21.15.42:0/2366165886 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f22dc0740f0 0x7f22dc15f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.069+0000 7f22e2200640 1 -- 172.21.15.42:0/2366165886 >> 172.21.15.42:0/2366165886 conn(0x7f22dc0b2930 msgr2=0x7f22dc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:21.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.069+0000 7f22e2200640 1 -- 172.21.15.42:0/2366165886 shutdown_connections 2024-09-17T01:38:21.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.069+0000 7f22e2200640 1 -- 172.21.15.42:0/2366165886 wait complete. 2024-09-17T01:38:21.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.071+0000 7f22e2200640 1 Processor -- start 2024-09-17T01:38:21.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.071+0000 7f22e2200640 1 -- start start 2024-09-17T01:38:21.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.073+0000 7f22e2200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22dc0740f0 0x7f22dc1e9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:21.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.073+0000 7f22e2200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f22dc15f740 0x7f22dc14c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:21.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.073+0000 7f22e2200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22dc14d030 0x7f22dc0b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:21.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.073+0000 7f22e2200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc06dd00 con 0x7f22dc14d030 2024-09-17T01:38:21.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.073+0000 7f22e2200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc06db80 con 0x7f22dc0740f0 2024-09-17T01:38:21.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.073+0000 7f22e2200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f22dc0cef40 con 0x7f22dc15f740 2024-09-17T01:38:21.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.073+0000 7f22dbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22dc14d030 0x7f22dc0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:21.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.073+0000 7f22dbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22dc14d030 0x7f22dc0b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58824/0 (socket says 172.21.15.42:58824) 2024-09-17T01:38:21.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.073+0000 7f22dbe00640 1 -- 172.21.15.42:0/1599523185 learned_addr learned my addr 172.21.15.42:0/1599523185 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:21.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.073+0000 7f22db400640 1 --2- 172.21.15.42:0/1599523185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22dc0740f0 0x7f22dc1e9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:21.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.073+0000 7f22d3e00640 1 --2- 172.21.15.42:0/1599523185 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f22dc15f740 0x7f22dc14c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:21.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.074+0000 7f22dbe00640 1 -- 172.21.15.42:0/1599523185 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f22dc15f740 msgr2=0x7f22dc14c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:21.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.074+0000 7f22dbe00640 1 --2- 172.21.15.42:0/1599523185 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f22dc15f740 0x7f22dc14c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.074+0000 7f22dbe00640 1 -- 172.21.15.42:0/1599523185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22dc0740f0 msgr2=0x7f22dc1e9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:21.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.074+0000 7f22dbe00640 1 --2- 172.21.15.42:0/1599523185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22dc0740f0 0x7f22dc1e9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.074+0000 7f22dbe00640 1 -- 172.21.15.42:0/1599523185 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22dc14cd90 con 0x7f22dc14d030 2024-09-17T01:38:21.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.074+0000 7f22dbe00640 1 --2- 172.21.15.42:0/1599523185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22dc14d030 0x7f22dc0b0a70 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f22d402aff0 tx=0x7f22d4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:21.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.074+0000 7f22d3400640 1 -- 172.21.15.42:0/1599523185 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4033050 con 0x7f22dc14d030 2024-09-17T01:38:21.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.074+0000 7f22d3400640 1 -- 172.21.15.42:0/1599523185 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22d4004450 con 0x7f22dc14d030 2024-09-17T01:38:21.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.074+0000 7f22d3400640 1 -- 172.21.15.42:0/1599523185 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4038450 con 0x7f22dc14d030 2024-09-17T01:38:21.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.074+0000 7f22e2200640 1 -- 172.21.15.42:0/1599523185 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22dc0b50a0 con 0x7f22dc14d030 2024-09-17T01:38:21.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.074+0000 7f22e2200640 1 -- 172.21.15.42:0/1599523185 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22dc1e9c20 con 0x7f22dc14d030 2024-09-17T01:38:21.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.075+0000 7f22e2200640 1 -- 172.21.15.42:0/1599523185 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22dc0b2f50 con 0x7f22dc14d030 2024-09-17T01:38:21.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.077+0000 7f22d3400640 1 -- 172.21.15.42:0/1599523185 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f22d4036070 con 0x7f22dc14d030 2024-09-17T01:38:21.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.078+0000 7f22d3400640 1 --2- 172.21.15.42:0/1599523185 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f22b8078b90 0x7f22b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:21.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.078+0000 7f22d3400640 1 -- 172.21.15.42:0/1599523185 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5795+0+0 (secure 0 0 0) 0x7f22d40bc1f0 con 0x7f22dc14d030 2024-09-17T01:38:21.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.078+0000 7f22db400640 1 --2- 172.21.15.42:0/1599523185 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f22b8078b90 0x7f22b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:21.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.079+0000 7f22db400640 1 --2- 172.21.15.42:0/1599523185 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f22b8078b90 0x7f22b807b0a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00daa0 tx=0x7f22cc005d70 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:21.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.082+0000 7f22d3400640 1 -- 172.21.15.42:0/1599523185 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f22dc0b2f50 con 0x7f22dc14d030 2024-09-17T01:38:21.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.277+0000 7f22e2200640 1 -- 172.21.15.42:0/1599523185 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22dc074500 con 0x7f22dc14d030 2024-09-17T01:38:21.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.278+0000 7f22d3400640 1 -- 172.21.15.42:0/1599523185 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+16813 (secure 0 0 0) 0x7f22d4084660 con 0x7f22dc14d030 2024-09-17T01:38:21.277 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:38:21.277 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":97,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:38:05.380942+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:37:50.765368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T01:37:51.779319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6835/3687871500":"2024-09-18T01:38:05.380911+0000","172.21.15.42:6834/3687871500":"2024-09-18T01:38:05.380911+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:38:21.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.281+0000 7f22e2200640 1 -- 172.21.15.42:0/1599523185 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f22b8078b90 msgr2=0x7f22b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:21.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.281+0000 7f22e2200640 1 --2- 172.21.15.42:0/1599523185 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f22b8078b90 0x7f22b807b0a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00daa0 tx=0x7f22cc005d70 comp rx=0 tx=0).stop 2024-09-17T01:38:21.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.281+0000 7f22e2200640 1 -- 172.21.15.42:0/1599523185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22dc14d030 msgr2=0x7f22dc0b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:21.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.281+0000 7f22e2200640 1 --2- 172.21.15.42:0/1599523185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22dc14d030 0x7f22dc0b0a70 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f22d402aff0 tx=0x7f22d4003f10 comp rx=0 tx=0).stop 2024-09-17T01:38:21.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.281+0000 7f22e2200640 1 -- 172.21.15.42:0/1599523185 shutdown_connections 2024-09-17T01:38:21.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.281+0000 7f22e2200640 1 --2- 172.21.15.42:0/1599523185 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f22b8078b90 0x7f22b807b0a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.281+0000 7f22e2200640 1 --2- 172.21.15.42:0/1599523185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22dc14d030 0x7f22dc0b0a70 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.281+0000 7f22e2200640 1 --2- 172.21.15.42:0/1599523185 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f22dc15f740 0x7f22dc14c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.281+0000 7f22e2200640 1 --2- 172.21.15.42:0/1599523185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22dc0740f0 0x7f22dc1e9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.281+0000 7f22e2200640 1 -- 172.21.15.42:0/1599523185 >> 172.21.15.42:0/1599523185 conn(0x7f22dc0b2930 msgr2=0x7f22dc0cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:21.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.281+0000 7f22e2200640 1 -- 172.21.15.42:0/1599523185 shutdown_connections 2024-09-17T01:38:21.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.281+0000 7f22e2200640 1 -- 172.21.15.42:0/1599523185 wait complete. 2024-09-17T01:38:21.304 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T01:38:21.304 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:38:21.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.534+0000 7fde83200640 1 -- 172.21.15.42:0/1660612167 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde84162a90 msgr2=0x7fde8415ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:21.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.534+0000 7fde83200640 1 --2- 172.21.15.42:0/1660612167 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde84162a90 0x7fde8415ef60 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fde84072570 tx=0x7fde7c02a980 comp rx=0 tx=0).stop 2024-09-17T01:38:21.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.534+0000 7fde83200640 1 -- 172.21.15.42:0/1660612167 shutdown_connections 2024-09-17T01:38:21.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.534+0000 7fde83200640 1 --2- 172.21.15.42:0/1660612167 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde84162a90 0x7fde8415ef60 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.534+0000 7fde83200640 1 --2- 172.21.15.42:0/1660612167 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde840af260 0x7fde84162550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.534+0000 7fde83200640 1 --2- 172.21.15.42:0/1660612167 >> v2:172.21.15.43:3300/0 conn(0x7fde84071260 0x7fde840734d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.534+0000 7fde83200640 1 -- 172.21.15.42:0/1660612167 >> 172.21.15.42:0/1660612167 conn(0x7fde840cd4c0 msgr2=0x7fde840cd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:21.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.534+0000 7fde83200640 1 -- 172.21.15.42:0/1660612167 shutdown_connections 2024-09-17T01:38:21.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.534+0000 7fde83200640 1 -- 172.21.15.42:0/1660612167 wait complete. 2024-09-17T01:38:21.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.536+0000 7fde83200640 1 Processor -- start 2024-09-17T01:38:21.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.536+0000 7fde83200640 1 -- start start 2024-09-17T01:38:21.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.538+0000 7fde83200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde84071260 0x7fde84147540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:21.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.538+0000 7fde83200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde840af260 0x7fde840cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:21.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.538+0000 7fde83200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde84162a90 0x7fde840b5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:21.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.538+0000 7fde83200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fde8415f830 con 0x7fde840af260 2024-09-17T01:38:21.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.538+0000 7fde83200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fde8415f6b0 con 0x7fde84071260 2024-09-17T01:38:21.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.538+0000 7fde83200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fde8415f9b0 con 0x7fde84162a90 2024-09-17T01:38:21.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.538+0000 7fde7be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde840af260 0x7fde840cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:21.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.538+0000 7fde7be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde840af260 0x7fde840cb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58852/0 (socket says 172.21.15.42:58852) 2024-09-17T01:38:21.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.538+0000 7fde7be00640 1 -- 172.21.15.42:0/1570716798 learned_addr learned my addr 172.21.15.42:0/1570716798 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:21.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.538+0000 7fde81e00640 1 --2- 172.21.15.42:0/1570716798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde84071260 0x7fde84147540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:21.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.538+0000 7fde82800640 1 --2- 172.21.15.42:0/1570716798 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde84162a90 0x7fde840b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:21.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.539+0000 7fde7be00640 1 -- 172.21.15.42:0/1570716798 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde84162a90 msgr2=0x7fde840b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:21.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.539+0000 7fde7be00640 1 --2- 172.21.15.42:0/1570716798 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde84162a90 0x7fde840b5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.539+0000 7fde7be00640 1 -- 172.21.15.42:0/1570716798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde84071260 msgr2=0x7fde84147540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:21.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.539+0000 7fde7be00640 1 --2- 172.21.15.42:0/1570716798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde84071260 0x7fde84147540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.539+0000 7fde7be00640 1 -- 172.21.15.42:0/1570716798 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde840cc0c0 con 0x7fde840af260 2024-09-17T01:38:21.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.539+0000 7fde7be00640 1 --2- 172.21.15.42:0/1570716798 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde840af260 0x7fde840cb600 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00d680 tx=0x7fde6c00db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:21.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.539+0000 7fde7a000640 1 -- 172.21.15.42:0/1570716798 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6c017070 con 0x7fde840af260 2024-09-17T01:38:21.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.539+0000 7fde7a000640 1 -- 172.21.15.42:0/1570716798 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde6c009b10 con 0x7fde840af260 2024-09-17T01:38:21.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.539+0000 7fde7a000640 1 -- 172.21.15.42:0/1570716798 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6c010460 con 0x7fde840af260 2024-09-17T01:38:21.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.539+0000 7fde83200640 1 -- 172.21.15.42:0/1570716798 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde840cc3a0 con 0x7fde840af260 2024-09-17T01:38:21.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.539+0000 7fde83200640 1 -- 172.21.15.42:0/1570716798 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde840cc960 con 0x7fde840af260 2024-09-17T01:38:21.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.540+0000 7fde83200640 1 -- 172.21.15.42:0/1570716798 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde840cbe30 con 0x7fde840af260 2024-09-17T01:38:21.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.541+0000 7fde7a000640 1 -- 172.21.15.42:0/1570716798 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fde6c01a070 con 0x7fde840af260 2024-09-17T01:38:21.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.542+0000 7fde7a000640 1 --2- 172.21.15.42:0/1570716798 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde60078bc0 0x7fde6007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:21.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.543+0000 7fde7a000640 1 -- 172.21.15.42:0/1570716798 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5795+0+0 (secure 0 0 0) 0x7fde6c09ad80 con 0x7fde840af260 2024-09-17T01:38:21.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.543+0000 7fde81e00640 1 --2- 172.21.15.42:0/1570716798 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde60078bc0 0x7fde6007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:21.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.544+0000 7fde81e00640 1 --2- 172.21.15.42:0/1570716798 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde60078bc0 0x7fde6007b0d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fde74005fd0 tx=0x7fde7400b260 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:21.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.547+0000 7fde7a000640 1 -- 172.21.15.42:0/1570716798 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fde6c062b00 con 0x7fde840af260 2024-09-17T01:38:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.781+0000 7fde83200640 1 -- 172.21.15.42:0/1570716798 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde84162550 con 0x7fde840af260 2024-09-17T01:38:21.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.781+0000 7fde7a000640 1 -- 172.21.15.42:0/1570716798 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) ==== 94+0+5223 (secure 0 0 0) 0x7fde6c067530 con 0x7fde840af260 2024-09-17T01:38:21.779 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:38:21.779 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":79,"btime":"2024-09-17T01:38:09:405324+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3191013971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":3191013971},{"type":"v1","addr":"172.21.15.43:6837","nonce":3191013971}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7042,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2889481399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2889481399},{"type":"v1","addr":"172.21.15.43:6835","nonce":2889481399}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1913337319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1913337319},{"type":"v1","addr":"172.21.15.42:6835","nonce":1913337319}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:37:52.812411+0000","modified":"2024-09-17T01:38:09.405313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7404},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7404":{"gid":7404,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6834/487915371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":487915371},{"type":"v1","addr":"172.21.15.42:6834","nonce":487915371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7404,"qdb_cluster":[7404]},"id":6}]} 2024-09-17T01:38:21.780 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 79 2024-09-17T01:38:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.784+0000 7fde83200640 1 -- 172.21.15.42:0/1570716798 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde60078bc0 msgr2=0x7fde6007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.784+0000 7fde83200640 1 --2- 172.21.15.42:0/1570716798 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde60078bc0 0x7fde6007b0d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fde74005fd0 tx=0x7fde7400b260 comp rx=0 tx=0).stop 2024-09-17T01:38:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.784+0000 7fde83200640 1 -- 172.21.15.42:0/1570716798 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde840af260 msgr2=0x7fde840cb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.784+0000 7fde83200640 1 --2- 172.21.15.42:0/1570716798 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde840af260 0x7fde840cb600 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00d680 tx=0x7fde6c00db40 comp rx=0 tx=0).stop 2024-09-17T01:38:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.784+0000 7fde83200640 1 -- 172.21.15.42:0/1570716798 shutdown_connections 2024-09-17T01:38:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.784+0000 7fde83200640 1 --2- 172.21.15.42:0/1570716798 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde60078bc0 0x7fde6007b0d0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.784+0000 7fde83200640 1 --2- 172.21.15.42:0/1570716798 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde84162a90 0x7fde840b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.784+0000 7fde83200640 1 --2- 172.21.15.42:0/1570716798 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde840af260 0x7fde840cb600 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.784+0000 7fde83200640 1 --2- 172.21.15.42:0/1570716798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde84071260 0x7fde84147540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.784+0000 7fde83200640 1 -- 172.21.15.42:0/1570716798 >> 172.21.15.42:0/1570716798 conn(0x7fde840cd4c0 msgr2=0x7fde84155530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.784+0000 7fde83200640 1 -- 172.21.15.42:0/1570716798 shutdown_connections 2024-09-17T01:38:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:21.784+0000 7fde83200640 1 -- 172.21.15.42:0/1570716798 wait complete. 2024-09-17T01:38:21.804 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:38:22.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.033+0000 7f6912000640 1 -- 172.21.15.42:0/918038934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f690c142f40 msgr2=0x7f690c072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:22.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.033+0000 7f6912000640 1 --2- 172.21.15.42:0/918038934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f690c142f40 0x7f690c072950 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f68f4005fd0 tx=0x7f68f402a540 comp rx=0 tx=0).stop 2024-09-17T01:38:22.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.033+0000 7f6912000640 1 -- 172.21.15.42:0/918038934 shutdown_connections 2024-09-17T01:38:22.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.033+0000 7f6912000640 1 --2- 172.21.15.42:0/918038934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f690c142f40 0x7f690c072950 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:22.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.033+0000 7f6912000640 1 --2- 172.21.15.42:0/918038934 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f690c0b3550 0x7f690c15cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:22.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.033+0000 7f6912000640 1 -- 172.21.15.42:0/918038934 >> 172.21.15.42:0/918038934 conn(0x7f690c0b2930 msgr2=0x7f690c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:22.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.033+0000 7f6912000640 1 -- 172.21.15.42:0/918038934 shutdown_connections 2024-09-17T01:38:22.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.033+0000 7f6912000640 1 -- 172.21.15.42:0/918038934 wait complete. 2024-09-17T01:38:22.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.035+0000 7f6912000640 1 Processor -- start 2024-09-17T01:38:22.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.036+0000 7f6912000640 1 -- start start 2024-09-17T01:38:22.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.037+0000 7f6912000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f690c072e90 0x7f690c158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:22.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.037+0000 7f6912000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f690c0b3550 0x7f690c13e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:22.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.037+0000 7f6912000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f690c142f40 0x7f690c159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:22.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.037+0000 7f6912000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f690c06d7c0 con 0x7f690c0b3550 2024-09-17T01:38:22.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.037+0000 7f6912000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f690c06d640 con 0x7f690c142f40 2024-09-17T01:38:22.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.037+0000 7f6912000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f690c06d940 con 0x7f690c072e90 2024-09-17T01:38:22.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.037+0000 7f6903e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f690c0b3550 0x7f690c13e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:22.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.037+0000 7f6903e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f690c0b3550 0x7f690c13e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58866/0 (socket says 172.21.15.42:58866) 2024-09-17T01:38:22.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.037+0000 7f6903e00640 1 -- 172.21.15.42:0/3101397 learned_addr learned my addr 172.21.15.42:0/3101397 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:22.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.038+0000 7f690b400640 1 --2- 172.21.15.42:0/3101397 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f690c072e90 0x7f690c158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:22.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.038+0000 7f690be00640 1 --2- 172.21.15.42:0/3101397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f690c142f40 0x7f690c159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:22.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.038+0000 7f6903e00640 1 -- 172.21.15.42:0/3101397 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f690c072e90 msgr2=0x7f690c158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:22.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.038+0000 7f6903e00640 1 --2- 172.21.15.42:0/3101397 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f690c072e90 0x7f690c158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:22.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.038+0000 7f6903e00640 1 -- 172.21.15.42:0/3101397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f690c142f40 msgr2=0x7f690c159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:22.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.038+0000 7f6903e00640 1 --2- 172.21.15.42:0/3101397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f690c142f40 0x7f690c159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:22.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.038+0000 7f6903e00640 1 -- 172.21.15.42:0/3101397 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f690c13fac0 con 0x7f690c0b3550 2024-09-17T01:38:22.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.038+0000 7f690be00640 1 --2- 172.21.15.42:0/3101397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f690c142f40 0x7f690c159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:38:22.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.038+0000 7f690b400640 1 --2- 172.21.15.42:0/3101397 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f690c072e90 0x7f690c158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:38:22.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.038+0000 7f6903e00640 1 --2- 172.21.15.42:0/3101397 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f690c0b3550 0x7f690c13e5d0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f68f4034040 tx=0x7f68f40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:22.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.038+0000 7f6903400640 1 -- 172.21.15.42:0/3101397 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f403e030 con 0x7f690c0b3550 2024-09-17T01:38:22.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.038+0000 7f6903400640 1 -- 172.21.15.42:0/3101397 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68f4003db0 con 0x7f690c0b3550 2024-09-17T01:38:22.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.038+0000 7f6903400640 1 -- 172.21.15.42:0/3101397 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f4035040 con 0x7f690c0b3550 2024-09-17T01:38:22.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.038+0000 7f6912000640 1 -- 172.21.15.42:0/3101397 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f690c13fda0 con 0x7f690c0b3550 2024-09-17T01:38:22.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.038+0000 7f6912000640 1 -- 172.21.15.42:0/3101397 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f690c140360 con 0x7f690c0b3550 2024-09-17T01:38:22.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.039+0000 7f6912000640 1 -- 172.21.15.42:0/3101397 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f690c13f830 con 0x7f690c0b3550 2024-09-17T01:38:22.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.041+0000 7f6903400640 1 -- 172.21.15.42:0/3101397 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f68f4041030 con 0x7f690c0b3550 2024-09-17T01:38:22.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.042+0000 7f6903400640 1 --2- 172.21.15.42:0/3101397 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f68e8078b90 0x7f68e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:22.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.042+0000 7f6903400640 1 -- 172.21.15.42:0/3101397 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5795+0+0 (secure 0 0 0) 0x7f68f40bb5b0 con 0x7f690c0b3550 2024-09-17T01:38:22.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.042+0000 7f690b400640 1 --2- 172.21.15.42:0/3101397 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f68e8078b90 0x7f68e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:22.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.043+0000 7f690b400640 1 --2- 172.21.15.42:0/3101397 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f68e8078b90 0x7f68e807b0a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f68fc009ab0 tx=0x7f68fc005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:22.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.046+0000 7f6903400640 1 -- 172.21.15.42:0/3101397 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f68f40838f0 con 0x7f690c0b3550 2024-09-17T01:38:22.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.279+0000 7f6912000640 1 -- 172.21.15.42:0/3101397 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f690c15cec0 con 0x7f690c0b3550 2024-09-17T01:38:22.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.280+0000 7f6903400640 1 -- 172.21.15.42:0/3101397 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) ==== 94+0+5223 (secure 0 0 0) 0x7f68f40831f0 con 0x7f690c0b3550 2024-09-17T01:38:22.278 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:38:22.278 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":79,"btime":"2024-09-17T01:38:09:405324+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3191013971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":3191013971},{"type":"v1","addr":"172.21.15.43:6837","nonce":3191013971}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7042,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2889481399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2889481399},{"type":"v1","addr":"172.21.15.43:6835","nonce":2889481399}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1913337319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1913337319},{"type":"v1","addr":"172.21.15.42:6835","nonce":1913337319}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:37:52.812411+0000","modified":"2024-09-17T01:38:09.405313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7404},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7404":{"gid":7404,"name":"a","rank":0,"incarnation":76,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6834/487915371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":487915371},{"type":"v1","addr":"172.21.15.42:6834","nonce":487915371}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7404,"qdb_cluster":[7404]},"id":6}]} 2024-09-17T01:38:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 79 2024-09-17T01:38:22.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.282+0000 7f6912000640 1 -- 172.21.15.42:0/3101397 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f68e8078b90 msgr2=0x7f68e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:22.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.282+0000 7f6912000640 1 --2- 172.21.15.42:0/3101397 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f68e8078b90 0x7f68e807b0a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f68fc009ab0 tx=0x7f68fc005f90 comp rx=0 tx=0).stop 2024-09-17T01:38:22.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.282+0000 7f6912000640 1 -- 172.21.15.42:0/3101397 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f690c0b3550 msgr2=0x7f690c13e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:22.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.282+0000 7f6912000640 1 --2- 172.21.15.42:0/3101397 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f690c0b3550 0x7f690c13e5d0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f68f4034040 tx=0x7f68f40038a0 comp rx=0 tx=0).stop 2024-09-17T01:38:22.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.282+0000 7f6912000640 1 -- 172.21.15.42:0/3101397 shutdown_connections 2024-09-17T01:38:22.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.282+0000 7f6912000640 1 --2- 172.21.15.42:0/3101397 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f68e8078b90 0x7f68e807b0a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:22.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.282+0000 7f6912000640 1 --2- 172.21.15.42:0/3101397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f690c142f40 0x7f690c159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:22.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.282+0000 7f6912000640 1 --2- 172.21.15.42:0/3101397 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f690c0b3550 0x7f690c13e5d0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:22.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.282+0000 7f6912000640 1 --2- 172.21.15.42:0/3101397 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f690c072e90 0x7f690c158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:22.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.282+0000 7f6912000640 1 -- 172.21.15.42:0/3101397 >> 172.21.15.42:0/3101397 conn(0x7f690c0b2930 msgr2=0x7f690c075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:22.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.282+0000 7f6912000640 1 -- 172.21.15.42:0/3101397 shutdown_connections 2024-09-17T01:38:22.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.283+0000 7f6912000640 1 -- 172.21.15.42:0/3101397 wait complete. 2024-09-17T01:38:22.306 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:38:22.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.537+0000 7fb517e00640 1 -- 172.21.15.42:0/2237586766 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb504009720 con 0x7fb500004800 2024-09-17T01:38:22.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.537+0000 7fb51e800640 1 -- 172.21.15.42:0/2237586766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb500004800 msgr2=0x7fb500004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:22.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.537+0000 7fb51e800640 1 --2- 172.21.15.42:0/2237586766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb500004800 0x7fb500004c10 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fb504009b50 tx=0x7fb500005830 comp rx=0 tx=0).stop 2024-09-17T01:38:22.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.537+0000 7fb51e800640 1 -- 172.21.15.42:0/2237586766 shutdown_connections 2024-09-17T01:38:22.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.537+0000 7fb51e800640 1 --2- 172.21.15.42:0/2237586766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb500004800 0x7fb500004c10 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:22.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.537+0000 7fb51e800640 1 -- 172.21.15.42:0/2237586766 >> 172.21.15.42:0/2237586766 conn(0x7fb5180cd4c0 msgr2=0x7fb5180cd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:22.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.537+0000 7fb51e800640 1 -- 172.21.15.42:0/2237586766 shutdown_connections 2024-09-17T01:38:22.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.537+0000 7fb51e800640 1 -- 172.21.15.42:0/2237586766 wait complete. 2024-09-17T01:38:22.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.540+0000 7fb51e800640 1 Processor -- start 2024-09-17T01:38:22.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.540+0000 7fb51e800640 1 -- start start 2024-09-17T01:38:22.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.541+0000 7fb51e800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb500004800 0x7fb5181f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:22.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.541+0000 7fb51e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb51814fd80 0x7fb51814c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:22.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.541+0000 7fb51e800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5180cb200 0x7fb5180cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:22.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.541+0000 7fb51e800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb518070530 con 0x7fb51814fd80 2024-09-17T01:38:22.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.541+0000 7fb51e800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb51815cdf0 con 0x7fb500004800 2024-09-17T01:38:22.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.541+0000 7fb51e800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb5180706b0 con 0x7fb5180cb200 2024-09-17T01:38:22.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.541+0000 7fb51ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb51814fd80 0x7fb51814c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:22.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.541+0000 7fb51ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb51814fd80 0x7fb51814c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58882/0 (socket says 172.21.15.42:58882) 2024-09-17T01:38:22.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.541+0000 7fb51ca00640 1 -- 172.21.15.42:0/1994352151 learned_addr learned my addr 172.21.15.42:0/1994352151 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:22.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.542+0000 7fb51de00640 1 --2- 172.21.15.42:0/1994352151 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5180cb200 0x7fb5180cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:22.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.542+0000 7fb51d400640 1 --2- 172.21.15.42:0/1994352151 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb500004800 0x7fb5181f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:22.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.542+0000 7fb51ca00640 1 -- 172.21.15.42:0/1994352151 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5180cb200 msgr2=0x7fb5180cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:22.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.542+0000 7fb51ca00640 1 --2- 172.21.15.42:0/1994352151 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5180cb200 0x7fb5180cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:22.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.542+0000 7fb51ca00640 1 -- 172.21.15.42:0/1994352151 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb500004800 msgr2=0x7fb5181f4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:22.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.542+0000 7fb51ca00640 1 --2- 172.21.15.42:0/1994352151 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb500004800 0x7fb5181f4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:22.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.542+0000 7fb51ca00640 1 -- 172.21.15.42:0/1994352151 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5181f53e0 con 0x7fb51814fd80 2024-09-17T01:38:22.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.542+0000 7fb51ca00640 1 --2- 172.21.15.42:0/1994352151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb51814fd80 0x7fb51814c950 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fb504009a70 tx=0x7fb5040336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:22.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.542+0000 7fb515600640 1 -- 172.21.15.42:0/1994352151 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb504038040 con 0x7fb51814fd80 2024-09-17T01:38:22.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.542+0000 7fb515600640 1 -- 172.21.15.42:0/1994352151 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5040339d0 con 0x7fb51814fd80 2024-09-17T01:38:22.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.543+0000 7fb51e800640 1 -- 172.21.15.42:0/1994352151 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5181f58f0 con 0x7fb51814fd80 2024-09-17T01:38:22.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.543+0000 7fb515600640 1 -- 172.21.15.42:0/1994352151 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb504033e20 con 0x7fb51814fd80 2024-09-17T01:38:22.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.543+0000 7fb51e800640 1 -- 172.21.15.42:0/1994352151 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb51814f580 con 0x7fb51814fd80 2024-09-17T01:38:22.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.544+0000 7fb51e800640 1 -- 172.21.15.42:0/1994352151 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5181f5660 con 0x7fb51814fd80 2024-09-17T01:38:22.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.545+0000 7fb515600640 1 -- 172.21.15.42:0/1994352151 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb504043020 con 0x7fb51814fd80 2024-09-17T01:38:22.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.546+0000 7fb515600640 1 --2- 172.21.15.42:0/1994352151 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb4f8078b90 0x7fb4f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:22.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.546+0000 7fb515600640 1 -- 172.21.15.42:0/1994352151 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5795+0+0 (secure 0 0 0) 0x7fb5040bafe0 con 0x7fb51814fd80 2024-09-17T01:38:22.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.546+0000 7fb51d400640 1 --2- 172.21.15.42:0/1994352151 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb4f8078b90 0x7fb4f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:22.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.547+0000 7fb51d400640 1 --2- 172.21.15.42:0/1994352151 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb4f8078b90 0x7fb4f807b0a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb50c006680 tx=0x7fb50c006b70 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:22.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.550+0000 7fb515600640 1 -- 172.21.15.42:0/1994352151 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb50404a020 con 0x7fb51814fd80 2024-09-17T01:38:22.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.747+0000 7fb51e800640 1 -- 172.21.15.42:0/1994352151 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb518070bc0 con 0x7fb51814fd80 2024-09-17T01:38:22.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.748+0000 7fb515600640 1 -- 172.21.15.42:0/1994352151 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+16813 (secure 0 0 0) 0x7fb5040a21c0 con 0x7fb51814fd80 2024-09-17T01:38:22.747 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:38:22.747 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":97,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:38:05.380942+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:37:50.765368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T01:37:51.779319+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6835/3687871500":"2024-09-18T01:38:05.380911+0000","172.21.15.42:6834/3687871500":"2024-09-18T01:38:05.380911+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:38:22.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.751+0000 7fb51e800640 1 -- 172.21.15.42:0/1994352151 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb4f8078b90 msgr2=0x7fb4f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:22.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.751+0000 7fb51e800640 1 --2- 172.21.15.42:0/1994352151 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb4f8078b90 0x7fb4f807b0a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb50c006680 tx=0x7fb50c006b70 comp rx=0 tx=0).stop 2024-09-17T01:38:22.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.751+0000 7fb51e800640 1 -- 172.21.15.42:0/1994352151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb51814fd80 msgr2=0x7fb51814c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:22.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.751+0000 7fb51e800640 1 --2- 172.21.15.42:0/1994352151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb51814fd80 0x7fb51814c950 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fb504009a70 tx=0x7fb5040336f0 comp rx=0 tx=0).stop 2024-09-17T01:38:22.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.751+0000 7fb51e800640 1 -- 172.21.15.42:0/1994352151 shutdown_connections 2024-09-17T01:38:22.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.751+0000 7fb51e800640 1 --2- 172.21.15.42:0/1994352151 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb4f8078b90 0x7fb4f807b0a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:22.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.751+0000 7fb51e800640 1 --2- 172.21.15.42:0/1994352151 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5180cb200 0x7fb5180cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:22.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.751+0000 7fb51e800640 1 --2- 172.21.15.42:0/1994352151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb51814fd80 0x7fb51814c950 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:22.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.751+0000 7fb51e800640 1 --2- 172.21.15.42:0/1994352151 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb500004800 0x7fb5181f4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:22.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.751+0000 7fb51e800640 1 -- 172.21.15.42:0/1994352151 >> 172.21.15.42:0/1994352151 conn(0x7fb5180cd4c0 msgr2=0x7fb5180ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:22.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.751+0000 7fb51e800640 1 -- 172.21.15.42:0/1994352151 shutdown_connections 2024-09-17T01:38:22.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:22.752+0000 7fb51e800640 1 -- 172.21.15.42:0/1994352151 wait complete. 2024-09-17T01:38:22.774 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T01:38:23.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.006+0000 7f3109400640 1 -- 172.21.15.42:0/3819954215 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f310406d430 msgr2=0x7f31040ad080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:23.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.006+0000 7f3109400640 1 --2- 172.21.15.42:0/3819954215 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f310406d430 0x7f31040ad080 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009830 tx=0x7f30f002a510 comp rx=0 tx=0).stop 2024-09-17T01:38:23.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.006+0000 7f3109400640 1 -- 172.21.15.42:0/3819954215 shutdown_connections 2024-09-17T01:38:23.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.006+0000 7f3109400640 1 --2- 172.21.15.42:0/3819954215 >> v2:172.21.15.43:3300/0 conn(0x7f31040af460 0x7f31040ad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:23.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.006+0000 7f3109400640 1 --2- 172.21.15.42:0/3819954215 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f310406d430 0x7f31040ad080 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:23.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.006+0000 7f3109400640 1 -- 172.21.15.42:0/3819954215 >> 172.21.15.42:0/3819954215 conn(0x7f31040b25f0 msgr2=0x7f31040d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:23.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.006+0000 7f3109400640 1 -- 172.21.15.42:0/3819954215 shutdown_connections 2024-09-17T01:38:23.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.006+0000 7f3109400640 1 -- 172.21.15.42:0/3819954215 wait complete. 2024-09-17T01:38:23.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.008+0000 7f3109400640 1 Processor -- start 2024-09-17T01:38:23.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.009+0000 7f3109400640 1 -- start start 2024-09-17T01:38:23.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.010+0000 7f3109400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31040af460 0x7f3104156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:23.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.010+0000 7f3109400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31040d0d80 0x7f31040cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:23.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.010+0000 7f3109400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f310406fb00 0x7f31040cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:23.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.010+0000 7f3109400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f31040adb00 con 0x7f31040d0d80 2024-09-17T01:38:23.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.010+0000 7f3109400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f310415ec10 con 0x7f310406fb00 2024-09-17T01:38:23.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.010+0000 7f3109400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f31040adc80 con 0x7f31040af460 2024-09-17T01:38:23.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.010+0000 7f3103400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31040d0d80 0x7f31040cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:23.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.010+0000 7f3103400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31040d0d80 0x7f31040cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58898/0 (socket says 172.21.15.42:58898) 2024-09-17T01:38:23.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.010+0000 7f3103400640 1 -- 172.21.15.42:0/3526695805 learned_addr learned my addr 172.21.15.42:0/3526695805 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:23.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.011+0000 7f3108a00640 1 --2- 172.21.15.42:0/3526695805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f310406fb00 0x7f31040cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:23.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.011+0000 7f3103e00640 1 --2- 172.21.15.42:0/3526695805 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31040af460 0x7f3104156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:23.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.011+0000 7f3103400640 1 -- 172.21.15.42:0/3526695805 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31040af460 msgr2=0x7f3104156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:23.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.011+0000 7f3103400640 1 --2- 172.21.15.42:0/3526695805 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31040af460 0x7f3104156c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:23.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.011+0000 7f3103400640 1 -- 172.21.15.42:0/3526695805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f310406fb00 msgr2=0x7f31040cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:23.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.011+0000 7f3103400640 1 --2- 172.21.15.42:0/3526695805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f310406fb00 0x7f31040cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:23.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.011+0000 7f3103400640 1 -- 172.21.15.42:0/3526695805 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3104157650 con 0x7f31040d0d80 2024-09-17T01:38:23.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.011+0000 7f3103e00640 1 --2- 172.21.15.42:0/3526695805 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31040af460 0x7f3104156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:23.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.011+0000 7f3103400640 1 --2- 172.21.15.42:0/3526695805 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31040d0d80 0x7f31040cac10 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f30f0000c00 tx=0x7f30f0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:23.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.012+0000 7f30fbe00640 1 -- 172.21.15.42:0/3526695805 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0005c90 con 0x7f31040d0d80 2024-09-17T01:38:23.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.012+0000 7f30fbe00640 1 -- 172.21.15.42:0/3526695805 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30f0031e50 con 0x7f31040d0d80 2024-09-17T01:38:23.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.012+0000 7f30fbe00640 1 -- 172.21.15.42:0/3526695805 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f00332f0 con 0x7f31040d0d80 2024-09-17T01:38:23.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.012+0000 7f3109400640 1 -- 172.21.15.42:0/3526695805 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31041619a0 con 0x7f31040d0d80 2024-09-17T01:38:23.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.012+0000 7f3109400640 1 -- 172.21.15.42:0/3526695805 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3104161f60 con 0x7f31040d0d80 2024-09-17T01:38:23.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.013+0000 7f3109400640 1 -- 172.21.15.42:0/3526695805 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31040ad080 con 0x7f31040d0d80 2024-09-17T01:38:23.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.014+0000 7f30fbe00640 1 -- 172.21.15.42:0/3526695805 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f30f0033490 con 0x7f31040d0d80 2024-09-17T01:38:23.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.015+0000 7f30fbe00640 1 --2- 172.21.15.42:0/3526695805 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f30e4078bc0 0x7f30e407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:23.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.016+0000 7f30fbe00640 1 -- 172.21.15.42:0/3526695805 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5795+0+0 (secure 0 0 0) 0x7f30f00bc080 con 0x7f31040d0d80 2024-09-17T01:38:23.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.016+0000 7f3103e00640 1 --2- 172.21.15.42:0/3526695805 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f30e4078bc0 0x7f30e407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:23.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.017+0000 7f3103e00640 1 --2- 172.21.15.42:0/3526695805 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f30e4078bc0 0x7f30e407b0d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f30f4007a50 tx=0x7f30f4009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:23.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.020+0000 7f30fbe00640 1 -- 172.21.15.42:0/3526695805 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f30f003f030 con 0x7f31040d0d80 2024-09-17T01:38:23.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.251+0000 7f3109400640 1 -- 172.21.15.42:0/3526695805 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f31040affd0 con 0x7f31040d0d80 2024-09-17T01:38:23.249 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-17T01:38:23.252+0000 7f9961e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:38:23.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.254+0000 7f30fbe00640 1 -- 172.21.15.42:0/3526695805 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v80) ==== 161+0+0 (secure 0 0 0) 0x7f30f0084450 con 0x7f31040d0d80 2024-09-17T01:38:23.251 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T01:38:23.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.257+0000 7f3109400640 1 -- 172.21.15.42:0/3526695805 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f30e4078bc0 msgr2=0x7f30e407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:23.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.257+0000 7f3109400640 1 --2- 172.21.15.42:0/3526695805 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f30e4078bc0 0x7f30e407b0d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f30f4007a50 tx=0x7f30f4009040 comp rx=0 tx=0).stop 2024-09-17T01:38:23.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.257+0000 7f3109400640 1 -- 172.21.15.42:0/3526695805 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31040d0d80 msgr2=0x7f31040cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:23.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.257+0000 7f3109400640 1 --2- 172.21.15.42:0/3526695805 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31040d0d80 0x7f31040cac10 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f30f0000c00 tx=0x7f30f0033c20 comp rx=0 tx=0).stop 2024-09-17T01:38:23.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.257+0000 7f3109400640 1 -- 172.21.15.42:0/3526695805 shutdown_connections 2024-09-17T01:38:23.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.257+0000 7f3109400640 1 --2- 172.21.15.42:0/3526695805 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f30e4078bc0 0x7f30e407b0d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:23.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.257+0000 7f3109400640 1 --2- 172.21.15.42:0/3526695805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f310406fb00 0x7f31040cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:23.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.257+0000 7f3109400640 1 --2- 172.21.15.42:0/3526695805 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31040d0d80 0x7f31040cac10 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:23.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.257+0000 7f3109400640 1 --2- 172.21.15.42:0/3526695805 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31040af460 0x7f3104156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:23.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.257+0000 7f3109400640 1 -- 172.21.15.42:0/3526695805 >> 172.21.15.42:0/3526695805 conn(0x7f31040b25f0 msgr2=0x7f3104075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:23.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.258+0000 7f3109400640 1 -- 172.21.15.42:0/3526695805 shutdown_connections 2024-09-17T01:38:23.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.258+0000 7f3109400640 1 -- 172.21.15.42:0/3526695805 wait complete. 2024-09-17T01:38:23.263 INFO:tasks.ceph.mds.a.smithi042.stderr: -3148> 2024-09-17T01:38:12.395+0000 7f1d02c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:38:23.278 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T01:38:23.390 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:38:23.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.513+0000 7fa325200640 1 -- 172.21.15.42:0/2599045786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3200af910 msgr2=0x7fa3200ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:23.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.513+0000 7fa325200640 1 --2- 172.21.15.42:0/2599045786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3200af910 0x7fa3200ccb90 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fa310009830 tx=0x7fa31002a470 comp rx=0 tx=0).stop 2024-09-17T01:38:23.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.513+0000 7fa325200640 1 -- 172.21.15.42:0/2599045786 shutdown_connections 2024-09-17T01:38:23.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.513+0000 7fa325200640 1 --2- 172.21.15.42:0/2599045786 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa3200b32b0 0x7fa3200b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:23.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.513+0000 7fa325200640 1 --2- 172.21.15.42:0/2599045786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3200af910 0x7fa3200ccb90 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:23.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.513+0000 7fa325200640 1 -- 172.21.15.42:0/2599045786 >> 172.21.15.42:0/2599045786 conn(0x7fa32006d440 msgr2=0x7fa3200b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:23.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.513+0000 7fa325200640 1 -- 172.21.15.42:0/2599045786 shutdown_connections 2024-09-17T01:38:23.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.513+0000 7fa325200640 1 -- 172.21.15.42:0/2599045786 wait complete. 2024-09-17T01:38:23.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.516+0000 7fa325200640 1 Processor -- start 2024-09-17T01:38:23.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.516+0000 7fa325200640 1 -- start start 2024-09-17T01:38:23.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.517+0000 7fa325200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3200af910 0x7fa3201f9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:23.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.517+0000 7fa325200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3200b32b0 0x7fa3201f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:23.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.517+0000 7fa325200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa32015c6c0 0x7fa3201f9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:23.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.517+0000 7fa325200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa32006e680 con 0x7fa3200b32b0 2024-09-17T01:38:23.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.517+0000 7fa325200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa32006e500 con 0x7fa3200af910 2024-09-17T01:38:23.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.517+0000 7fa325200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa32006e800 con 0x7fa32015c6c0 2024-09-17T01:38:23.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.518+0000 7fa317e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3200b32b0 0x7fa3201f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:23.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.518+0000 7fa317e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3200b32b0 0x7fa3201f9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58934/0 (socket says 172.21.15.42:58934) 2024-09-17T01:38:23.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.518+0000 7fa317e00640 1 -- 172.21.15.42:0/3599182314 learned_addr learned my addr 172.21.15.42:0/3599182314 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:23.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.518+0000 7fa31f400640 1 --2- 172.21.15.42:0/3599182314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3200af910 0x7fa3201f9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:23.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.518+0000 7fa31fe00640 1 --2- 172.21.15.42:0/3599182314 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa32015c6c0 0x7fa3201f9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:23.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.518+0000 7fa317e00640 1 -- 172.21.15.42:0/3599182314 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa32015c6c0 msgr2=0x7fa3201f9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:23.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.518+0000 7fa317e00640 1 --2- 172.21.15.42:0/3599182314 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa32015c6c0 0x7fa3201f9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:23.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.518+0000 7fa317e00640 1 -- 172.21.15.42:0/3599182314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3200af910 msgr2=0x7fa3201f9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:23.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.518+0000 7fa317e00640 1 --2- 172.21.15.42:0/3599182314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3200af910 0x7fa3201f9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:23.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.518+0000 7fa317e00640 1 -- 172.21.15.42:0/3599182314 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3200aea90 con 0x7fa3200b32b0 2024-09-17T01:38:23.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.519+0000 7fa317e00640 1 --2- 172.21.15.42:0/3599182314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3200b32b0 0x7fa3201f9590 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fa30800c730 tx=0x7fa30800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:23.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.519+0000 7fa317400640 1 -- 172.21.15.42:0/3599182314 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa308006890 con 0x7fa3200b32b0 2024-09-17T01:38:23.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.519+0000 7fa317400640 1 -- 172.21.15.42:0/3599182314 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa308006a30 con 0x7fa3200b32b0 2024-09-17T01:38:23.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.519+0000 7fa317400640 1 -- 172.21.15.42:0/3599182314 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa308007030 con 0x7fa3200b32b0 2024-09-17T01:38:23.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.519+0000 7fa325200640 1 -- 172.21.15.42:0/3599182314 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3200aed70 con 0x7fa3200b32b0 2024-09-17T01:38:23.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.519+0000 7fa325200640 1 -- 172.21.15.42:0/3599182314 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa320073520 con 0x7fa3200b32b0 2024-09-17T01:38:23.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.520+0000 7fa325200640 1 -- 172.21.15.42:0/3599182314 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa320073340 con 0x7fa3200b32b0 2024-09-17T01:38:23.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.521+0000 7fa317400640 1 -- 172.21.15.42:0/3599182314 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa3080073e0 con 0x7fa3200b32b0 2024-09-17T01:38:23.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.522+0000 7fa317400640 1 --2- 172.21.15.42:0/3599182314 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa2fc078b90 0x7fa2fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:23.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.522+0000 7fa317400640 1 -- 172.21.15.42:0/3599182314 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5881+0+0 (secure 0 0 0) 0x7fa30809aa60 con 0x7fa3200b32b0 2024-09-17T01:38:23.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.523+0000 7fa31f400640 1 --2- 172.21.15.42:0/3599182314 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa2fc078b90 0x7fa2fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:23.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.523+0000 7fa31f400640 1 --2- 172.21.15.42:0/3599182314 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa2fc078b90 0x7fa2fc07b0a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa310034000 tx=0x7fa310004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:23.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.527+0000 7fa317400640 1 -- 172.21.15.42:0/3599182314 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa320073340 con 0x7fa3200b32b0 2024-09-17T01:38:23.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:23.763+0000 7fa325200640 1 -- 172.21.15.42:0/3599182314 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa3200ae820 con 0x7fa3200b32b0 2024-09-17T01:38:24.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.255+0000 7fa317400640 1 -- 172.21.15.42:0/3599182314 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v81) ==== 104+0+0 (secure 0 0 0) 0x7fa3200b3c00 con 0x7fa3200b32b0 2024-09-17T01:38:24.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.259+0000 7fa325200640 1 -- 172.21.15.42:0/3599182314 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa2fc078b90 msgr2=0x7fa2fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:24.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.259+0000 7fa325200640 1 --2- 172.21.15.42:0/3599182314 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa2fc078b90 0x7fa2fc07b0a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa310034000 tx=0x7fa310004730 comp rx=0 tx=0).stop 2024-09-17T01:38:24.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.259+0000 7fa325200640 1 -- 172.21.15.42:0/3599182314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3200b32b0 msgr2=0x7fa3201f9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:24.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.259+0000 7fa325200640 1 --2- 172.21.15.42:0/3599182314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3200b32b0 0x7fa3201f9590 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fa30800c730 tx=0x7fa30800cbf0 comp rx=0 tx=0).stop 2024-09-17T01:38:24.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.259+0000 7fa325200640 1 -- 172.21.15.42:0/3599182314 shutdown_connections 2024-09-17T01:38:24.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.259+0000 7fa325200640 1 --2- 172.21.15.42:0/3599182314 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa2fc078b90 0x7fa2fc07b0a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:24.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.259+0000 7fa325200640 1 --2- 172.21.15.42:0/3599182314 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa32015c6c0 0x7fa3201f9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:24.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.259+0000 7fa325200640 1 --2- 172.21.15.42:0/3599182314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa3200b32b0 0x7fa3201f9590 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:24.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.259+0000 7fa325200640 1 --2- 172.21.15.42:0/3599182314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3200af910 0x7fa3201f9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:24.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.259+0000 7fa325200640 1 -- 172.21.15.42:0/3599182314 >> 172.21.15.42:0/3599182314 conn(0x7fa32006d440 msgr2=0x7fa3200b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:24.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.259+0000 7fa325200640 1 -- 172.21.15.42:0/3599182314 shutdown_connections 2024-09-17T01:38:24.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.259+0000 7fa325200640 1 -- 172.21.15.42:0/3599182314 wait complete. 2024-09-17T01:38:24.280 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T01:38:24.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.517+0000 7f249d600640 1 -- 172.21.15.42:0/3386816434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24980af4f0 msgr2=0x7f249815d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:24.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.517+0000 7f249d600640 1 --2- 172.21.15.42:0/3386816434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24980af4f0 0x7f249815d6a0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f2488009830 tx=0x7f248802a510 comp rx=0 tx=0).stop 2024-09-17T01:38:24.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.517+0000 7f249d600640 1 -- 172.21.15.42:0/3386816434 shutdown_connections 2024-09-17T01:38:24.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.517+0000 7f249d600640 1 --2- 172.21.15.42:0/3386816434 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24980aebf0 0x7f249806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:24.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.517+0000 7f249d600640 1 --2- 172.21.15.42:0/3386816434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24980af4f0 0x7f249815d6a0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:24.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.517+0000 7f249d600640 1 -- 172.21.15.42:0/3386816434 >> 172.21.15.42:0/3386816434 conn(0x7f24980b25d0 msgr2=0x7f24980d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:24.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.517+0000 7f249d600640 1 -- 172.21.15.42:0/3386816434 shutdown_connections 2024-09-17T01:38:24.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.517+0000 7f249d600640 1 -- 172.21.15.42:0/3386816434 wait complete. 2024-09-17T01:38:24.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.519+0000 7f249d600640 1 Processor -- start 2024-09-17T01:38:24.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.519+0000 7f249d600640 1 -- start start 2024-09-17T01:38:24.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.521+0000 7f249d600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f249806d260 0x7f249814bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.521+0000 7f249d600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24980aebf0 0x7f24981f3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.521+0000 7f249d600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24980af4f0 0x7f249806f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.521+0000 7f249d600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2498160aa0 con 0x7f249806d260 2024-09-17T01:38:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.521+0000 7f249d600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2498160920 con 0x7f24980aebf0 2024-09-17T01:38:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.521+0000 7f249d600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2498160c20 con 0x7f24980af4f0 2024-09-17T01:38:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.521+0000 7f2497e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f249806d260 0x7f249814bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.521+0000 7f2497e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f249806d260 0x7f249814bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58952/0 (socket says 172.21.15.42:58952) 2024-09-17T01:38:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.521+0000 7f2497e00640 1 -- 172.21.15.42:0/1060692973 learned_addr learned my addr 172.21.15.42:0/1060692973 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.521+0000 7f248fe00640 1 --2- 172.21.15.42:0/1060692973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24980aebf0 0x7f24981f3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.521+0000 7f249cc00640 1 --2- 172.21.15.42:0/1060692973 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24980af4f0 0x7f249806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.522+0000 7f2497e00640 1 -- 172.21.15.42:0/1060692973 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24980af4f0 msgr2=0x7f249806f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.522+0000 7f2497e00640 1 --2- 172.21.15.42:0/1060692973 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24980af4f0 0x7f249806f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.522+0000 7f2497e00640 1 -- 172.21.15.42:0/1060692973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24980aebf0 msgr2=0x7f24981f3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.522+0000 7f2497e00640 1 --2- 172.21.15.42:0/1060692973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24980aebf0 0x7f24981f3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.522+0000 7f2497e00640 1 -- 172.21.15.42:0/1060692973 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24981f6e40 con 0x7f249806d260 2024-09-17T01:38:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.522+0000 7f2497e00640 1 --2- 172.21.15.42:0/1060692973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f249806d260 0x7f249814bb30 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f2488000c00 tx=0x7f2488033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.522+0000 7f2494c00640 1 -- 172.21.15.42:0/1060692973 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488005c90 con 0x7f249806d260 2024-09-17T01:38:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.522+0000 7f2494c00640 1 -- 172.21.15.42:0/1060692973 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2488031e50 con 0x7f249806d260 2024-09-17T01:38:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.522+0000 7f2494c00640 1 -- 172.21.15.42:0/1060692973 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24880332f0 con 0x7f249806d260 2024-09-17T01:38:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.522+0000 7f249d600640 1 -- 172.21.15.42:0/1060692973 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24981f7120 con 0x7f249806d260 2024-09-17T01:38:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.523+0000 7f249d600640 1 -- 172.21.15.42:0/1060692973 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2498072e10 con 0x7f249806d260 2024-09-17T01:38:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.524+0000 7f249d600640 1 -- 172.21.15.42:0/1060692973 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f249806cd20 con 0x7f249806d260 2024-09-17T01:38:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.525+0000 7f2494c00640 1 -- 172.21.15.42:0/1060692973 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2488033490 con 0x7f249806d260 2024-09-17T01:38:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.526+0000 7f2494c00640 1 --2- 172.21.15.42:0/1060692973 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2474078b90 0x7f247407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.526+0000 7f2494c00640 1 -- 172.21.15.42:0/1060692973 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5881+0+0 (secure 0 0 0) 0x7f24880bc2d0 con 0x7f249806d260 2024-09-17T01:38:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.526+0000 7f248fe00640 1 --2- 172.21.15.42:0/1060692973 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2474078b90 0x7f247407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.527+0000 7f248fe00640 1 --2- 172.21.15.42:0/1060692973 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2474078b90 0x7f247407b0a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2480005fd0 tx=0x7f2480005850 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:24.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.530+0000 7f2494c00640 1 -- 172.21.15.42:0/1060692973 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f248803f030 con 0x7f249806d260 2024-09-17T01:38:24.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:24.726+0000 7f249d600640 1 -- 172.21.15.42:0/1060692973 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f24980ae700 con 0x7f249806d260 2024-09-17T01:38:25.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.262+0000 7f2494c00640 1 -- 172.21.15.42:0/1060692973 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v99) ==== 181+0+0 (secure 0 0 0) 0x7f2488084650 con 0x7f249806d260 2024-09-17T01:38:25.260 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-09-17T01:38:25.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.265+0000 7f249d600640 1 -- 172.21.15.42:0/1060692973 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2474078b90 msgr2=0x7f247407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:25.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.265+0000 7f249d600640 1 --2- 172.21.15.42:0/1060692973 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2474078b90 0x7f247407b0a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2480005fd0 tx=0x7f2480005850 comp rx=0 tx=0).stop 2024-09-17T01:38:25.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.265+0000 7f249d600640 1 -- 172.21.15.42:0/1060692973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f249806d260 msgr2=0x7f249814bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:25.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.265+0000 7f249d600640 1 --2- 172.21.15.42:0/1060692973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f249806d260 0x7f249814bb30 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f2488000c00 tx=0x7f2488033c90 comp rx=0 tx=0).stop 2024-09-17T01:38:25.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.265+0000 7f249d600640 1 -- 172.21.15.42:0/1060692973 shutdown_connections 2024-09-17T01:38:25.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.265+0000 7f249d600640 1 --2- 172.21.15.42:0/1060692973 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2474078b90 0x7f247407b0a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.265+0000 7f249d600640 1 --2- 172.21.15.42:0/1060692973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f24980aebf0 0x7f24981f3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.265+0000 7f249d600640 1 --2- 172.21.15.42:0/1060692973 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f24980af4f0 0x7f249806f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.265+0000 7f249d600640 1 --2- 172.21.15.42:0/1060692973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f249806d260 0x7f249814bb30 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.265+0000 7f249d600640 1 -- 172.21.15.42:0/1060692973 >> 172.21.15.42:0/1060692973 conn(0x7f24980b25d0 msgr2=0x7f24980cdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:25.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.266+0000 7f249d600640 1 -- 172.21.15.42:0/1060692973 shutdown_connections 2024-09-17T01:38:25.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.266+0000 7f249d600640 1 -- 172.21.15.42:0/1060692973 wait complete. 2024-09-17T01:38:25.287 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T01:38:25.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.524+0000 7f827da00640 1 -- 172.21.15.42:0/1690451504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8278072a50 msgr2=0x7f82780ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:25.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.524+0000 7f827da00640 1 --2- 172.21.15.42:0/1690451504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8278072a50 0x7f82780ccff0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f8278074ed0 tx=0x7f826802a560 comp rx=0 tx=0).stop 2024-09-17T01:38:25.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.524+0000 7f827da00640 1 -- 172.21.15.42:0/1690451504 shutdown_connections 2024-09-17T01:38:25.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.524+0000 7f827da00640 1 --2- 172.21.15.42:0/1690451504 >> v2:172.21.15.43:3300/0 conn(0x7f827806f8e0 0x7f827806fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.524+0000 7f827da00640 1 --2- 172.21.15.42:0/1690451504 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f827815f1e0 0x7f827815f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.524+0000 7f827da00640 1 --2- 172.21.15.42:0/1690451504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8278072a50 0x7f82780ccff0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.524+0000 7f827da00640 1 -- 172.21.15.42:0/1690451504 >> 172.21.15.42:0/1690451504 conn(0x7f82780b2770 msgr2=0x7f82780b2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:25.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.524+0000 7f827da00640 1 -- 172.21.15.42:0/1690451504 shutdown_connections 2024-09-17T01:38:25.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.524+0000 7f827da00640 1 -- 172.21.15.42:0/1690451504 wait complete. 2024-09-17T01:38:25.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.527+0000 7f827da00640 1 Processor -- start 2024-09-17T01:38:25.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.527+0000 7f827da00640 1 -- start start 2024-09-17T01:38:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.528+0000 7f827da00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f827806f8e0 0x7f82780c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.528+0000 7f827da00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8278072a50 0x7f8278144f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.528+0000 7f827da00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f827815f1e0 0x7f82781f8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.528+0000 7f827da00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f827815be00 con 0x7f827815f1e0 2024-09-17T01:38:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.528+0000 7f827da00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f82780d0740 con 0x7f827806f8e0 2024-09-17T01:38:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.528+0000 7f827da00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f827815fb30 con 0x7f8278072a50 2024-09-17T01:38:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.529+0000 7f827d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f827815f1e0 0x7f82781f8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.529+0000 7f827d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f827815f1e0 0x7f82781f8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58974/0 (socket says 172.21.15.42:58974) 2024-09-17T01:38:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.529+0000 7f827d000640 1 -- 172.21.15.42:0/358683064 learned_addr learned my addr 172.21.15.42:0/358683064 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.529+0000 7f8277e00640 1 --2- 172.21.15.42:0/358683064 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f827806f8e0 0x7f82780c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.529+0000 7f826fe00640 1 --2- 172.21.15.42:0/358683064 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8278072a50 0x7f8278144f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:25.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.529+0000 7f827d000640 1 -- 172.21.15.42:0/358683064 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8278072a50 msgr2=0x7f8278144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:25.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.529+0000 7f827d000640 1 --2- 172.21.15.42:0/358683064 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8278072a50 0x7f8278144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.529+0000 7f827d000640 1 -- 172.21.15.42:0/358683064 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f827806f8e0 msgr2=0x7f82780c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:25.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.529+0000 7f827d000640 1 --2- 172.21.15.42:0/358683064 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f827806f8e0 0x7f82780c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.529+0000 7f827d000640 1 -- 172.21.15.42:0/358683064 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82781f5660 con 0x7f827815f1e0 2024-09-17T01:38:25.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.529+0000 7f827d000640 1 --2- 172.21.15.42:0/358683064 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f827815f1e0 0x7f82781f8c50 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f827000e960 tx=0x7f827000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:25.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.530+0000 7f8274c00640 1 -- 172.21.15.42:0/358683064 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8270004d20 con 0x7f827815f1e0 2024-09-17T01:38:25.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.530+0000 7f8274c00640 1 -- 172.21.15.42:0/358683064 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f827000cb20 con 0x7f827815f1e0 2024-09-17T01:38:25.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.530+0000 7f8274c00640 1 -- 172.21.15.42:0/358683064 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8270005020 con 0x7f827815f1e0 2024-09-17T01:38:25.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.530+0000 7f827da00640 1 -- 172.21.15.42:0/358683064 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82781f5920 con 0x7f827815f1e0 2024-09-17T01:38:25.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.530+0000 7f827da00640 1 -- 172.21.15.42:0/358683064 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82781f5ee0 con 0x7f827815f1e0 2024-09-17T01:38:25.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.531+0000 7f827da00640 1 -- 172.21.15.42:0/358683064 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82780ccff0 con 0x7f827815f1e0 2024-09-17T01:38:25.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.532+0000 7f8274c00640 1 -- 172.21.15.42:0/358683064 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f82700051c0 con 0x7f827815f1e0 2024-09-17T01:38:25.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.533+0000 7f8274c00640 1 --2- 172.21.15.42:0/358683064 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8254078b90 0x7f825407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:25.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.533+0000 7f8274c00640 1 -- 172.21.15.42:0/358683064 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5443+0+0 (secure 0 0 0) 0x7f827009b570 con 0x7f827815f1e0 2024-09-17T01:38:25.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.534+0000 7f8277e00640 1 --2- 172.21.15.42:0/358683064 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8254078b90 0x7f825407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:25.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.534+0000 7f8277e00640 1 --2- 172.21.15.42:0/358683064 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8254078b90 0x7f825407b0a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8268033000 tx=0x7f8268004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:25.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.538+0000 7f8274c00640 1 -- 172.21.15.42:0/358683064 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8270016030 con 0x7f827815f1e0 2024-09-17T01:38:25.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:25.742+0000 7f827da00640 1 -- 172.21.15.42:0/358683064 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f827806ae20 con 0x7f827815f1e0 2024-09-17T01:38:26.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.264+0000 7f8274c00640 1 -- 172.21.15.42:0/358683064 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v100) ==== 169+0+0 (secure 0 0 0) 0x7f8270063450 con 0x7f827815f1e0 2024-09-17T01:38:26.263 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-09-17T01:38:26.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.269+0000 7f827da00640 1 -- 172.21.15.42:0/358683064 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8254078b90 msgr2=0x7f825407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:26.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.269+0000 7f827da00640 1 --2- 172.21.15.42:0/358683064 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8254078b90 0x7f825407b0a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8268033000 tx=0x7f8268004730 comp rx=0 tx=0).stop 2024-09-17T01:38:26.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.269+0000 7f827da00640 1 -- 172.21.15.42:0/358683064 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f827815f1e0 msgr2=0x7f82781f8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:26.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.269+0000 7f827da00640 1 --2- 172.21.15.42:0/358683064 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f827815f1e0 0x7f82781f8c50 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f827000e960 tx=0x7f827000ee20 comp rx=0 tx=0).stop 2024-09-17T01:38:26.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.270+0000 7f827da00640 1 -- 172.21.15.42:0/358683064 shutdown_connections 2024-09-17T01:38:26.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.270+0000 7f827da00640 1 --2- 172.21.15.42:0/358683064 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8254078b90 0x7f825407b0a0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:26.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.270+0000 7f827da00640 1 --2- 172.21.15.42:0/358683064 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f827815f1e0 0x7f82781f8c50 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.270+0000 7f827da00640 1 --2- 172.21.15.42:0/358683064 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8278072a50 0x7f8278144f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.270+0000 7f827da00640 1 --2- 172.21.15.42:0/358683064 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f827806f8e0 0x7f82780c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.270+0000 7f827da00640 1 -- 172.21.15.42:0/358683064 >> 172.21.15.42:0/358683064 conn(0x7f82780b2770 msgr2=0x7f82780cd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.270+0000 7f827da00640 1 -- 172.21.15.42:0/358683064 shutdown_connections 2024-09-17T01:38:26.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.270+0000 7f827da00640 1 -- 172.21.15.42:0/358683064 wait complete. 2024-09-17T01:38:26.294 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T01:38:26.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.534+0000 7f29fe200640 1 -- 172.21.15.42:0/2865304627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f8155dc0 msgr2=0x7f29f80d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:26.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.534+0000 7f29fe200640 1 --2- 172.21.15.42:0/2865304627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f8155dc0 0x7f29f80d0f60 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f29f80d4540 tx=0x7f29e802a560 comp rx=0 tx=0).stop 2024-09-17T01:38:26.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.534+0000 7f29fe200640 1 -- 172.21.15.42:0/2865304627 shutdown_connections 2024-09-17T01:38:26.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.534+0000 7f29fe200640 1 --2- 172.21.15.42:0/2865304627 >> v2:172.21.15.43:3300/0 conn(0x7f29f80d14a0 0x7f29f8162bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:26.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.534+0000 7f29fe200640 1 --2- 172.21.15.42:0/2865304627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f8155dc0 0x7f29f80d0f60 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:26.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.534+0000 7f29fe200640 1 -- 172.21.15.42:0/2865304627 >> 172.21.15.42:0/2865304627 conn(0x7f29f806cd20 msgr2=0x7f29f806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:26.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.534+0000 7f29fe200640 1 -- 172.21.15.42:0/2865304627 shutdown_connections 2024-09-17T01:38:26.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.534+0000 7f29fe200640 1 -- 172.21.15.42:0/2865304627 wait complete. 2024-09-17T01:38:26.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.536+0000 7f29fe200640 1 Processor -- start 2024-09-17T01:38:26.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.537+0000 7f29fe200640 1 -- start start 2024-09-17T01:38:26.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.538+0000 7f29fe200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f29f80d14a0 0x7f29f80cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:26.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.538+0000 7f29fe200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29f8155dc0 0x7f29f80cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:26.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.538+0000 7f29fe200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f81630f0 0x7f29f81f6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:26.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.538+0000 7f29fe200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f29f8163680 con 0x7f29f81630f0 2024-09-17T01:38:26.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.538+0000 7f29fe200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f29f8163500 con 0x7f29f8155dc0 2024-09-17T01:38:26.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.538+0000 7f29fe200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f29f80b6a30 con 0x7f29f80d14a0 2024-09-17T01:38:26.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.538+0000 7f29f7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f81630f0 0x7f29f81f6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:26.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.539+0000 7f29f7400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f29f80d14a0 0x7f29f80cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:26.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.539+0000 7f29f7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f81630f0 0x7f29f81f6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57876/0 (socket says 172.21.15.42:57876) 2024-09-17T01:38:26.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.539+0000 7f29f6a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29f8155dc0 0x7f29f80cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:26.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.539+0000 7f29f7e00640 1 -- 172.21.15.42:0/2920671956 learned_addr learned my addr 172.21.15.42:0/2920671956 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:26.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.539+0000 7f29f7e00640 1 -- 172.21.15.42:0/2920671956 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f29f80d14a0 msgr2=0x7f29f80cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:26.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.539+0000 7f29f7e00640 1 --2- 172.21.15.42:0/2920671956 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f29f80d14a0 0x7f29f80cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:26.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.539+0000 7f29f7e00640 1 -- 172.21.15.42:0/2920671956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29f8155dc0 msgr2=0x7f29f80cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:26.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.539+0000 7f29f7e00640 1 --2- 172.21.15.42:0/2920671956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29f8155dc0 0x7f29f80cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:26.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.539+0000 7f29f7e00640 1 -- 172.21.15.42:0/2920671956 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f80cdc20 con 0x7f29f81630f0 2024-09-17T01:38:26.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.539+0000 7f29f7e00640 1 --2- 172.21.15.42:0/2920671956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f81630f0 0x7f29f81f6030 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f29f000b9a0 tx=0x7f29f000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:26.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.540+0000 7f29ef400640 1 -- 172.21.15.42:0/2920671956 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0019070 con 0x7f29f81630f0 2024-09-17T01:38:26.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.540+0000 7f29ef400640 1 -- 172.21.15.42:0/2920671956 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29f000cc30 con 0x7f29f81630f0 2024-09-17T01:38:26.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.540+0000 7f29ef400640 1 -- 172.21.15.42:0/2920671956 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f00146a0 con 0x7f29f81630f0 2024-09-17T01:38:26.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.540+0000 7f29fe200640 1 -- 172.21.15.42:0/2920671956 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f80cdf00 con 0x7f29f81630f0 2024-09-17T01:38:26.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.540+0000 7f29fe200640 1 -- 172.21.15.42:0/2920671956 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f80cd930 con 0x7f29f81630f0 2024-09-17T01:38:26.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.541+0000 7f29fe200640 1 -- 172.21.15.42:0/2920671956 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f80b6f30 con 0x7f29f81630f0 2024-09-17T01:38:26.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.542+0000 7f29ef400640 1 -- 172.21.15.42:0/2920671956 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f29f001c070 con 0x7f29f81630f0 2024-09-17T01:38:26.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.544+0000 7f29ef400640 1 --2- 172.21.15.42:0/2920671956 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f29d8078b90 0x7f29d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:26.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.544+0000 7f29ef400640 1 -- 172.21.15.42:0/2920671956 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5029+0+0 (secure 0 0 0) 0x7f29f009a6a0 con 0x7f29f81630f0 2024-09-17T01:38:26.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.544+0000 7f29f7400640 1 --2- 172.21.15.42:0/2920671956 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f29d8078b90 0x7f29d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:26.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.545+0000 7f29f7400640 1 --2- 172.21.15.42:0/2920671956 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f29d8078b90 0x7f29d807b0a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f29e8033000 tx=0x7f29e8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:26.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.548+0000 7f29ef400640 1 -- 172.21.15.42:0/2920671956 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f29f000ce20 con 0x7f29f81630f0 2024-09-17T01:38:26.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.740+0000 7f29fe200640 1 -- 172.21.15.42:0/2920671956 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f29f8161050 con 0x7f29f81630f0 2024-09-17T01:38:26.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.745+0000 7f29ef400640 1 -- 172.21.15.42:0/2920671956 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v49) ==== 71+0+0 (secure 0 0 0) 0x7f29f0062690 con 0x7f29f81630f0 2024-09-17T01:38:26.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.747+0000 7f29fe200640 1 -- 172.21.15.42:0/2920671956 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f29d8078b90 msgr2=0x7f29d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:26.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.747+0000 7f29fe200640 1 --2- 172.21.15.42:0/2920671956 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f29d8078b90 0x7f29d807b0a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f29e8033000 tx=0x7f29e8004730 comp rx=0 tx=0).stop 2024-09-17T01:38:26.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.747+0000 7f29fe200640 1 -- 172.21.15.42:0/2920671956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f81630f0 msgr2=0x7f29f81f6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:26.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.747+0000 7f29fe200640 1 --2- 172.21.15.42:0/2920671956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f81630f0 0x7f29f81f6030 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f29f000b9a0 tx=0x7f29f000be60 comp rx=0 tx=0).stop 2024-09-17T01:38:26.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.748+0000 7f29fe200640 1 -- 172.21.15.42:0/2920671956 shutdown_connections 2024-09-17T01:38:26.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.748+0000 7f29fe200640 1 --2- 172.21.15.42:0/2920671956 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f29d8078b90 0x7f29d807b0a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:26.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.748+0000 7f29fe200640 1 --2- 172.21.15.42:0/2920671956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29f8155dc0 0x7f29f80cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:26.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.748+0000 7f29fe200640 1 --2- 172.21.15.42:0/2920671956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f81630f0 0x7f29f81f6030 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:26.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.748+0000 7f29fe200640 1 --2- 172.21.15.42:0/2920671956 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f29f80d14a0 0x7f29f80cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:26.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.748+0000 7f29fe200640 1 -- 172.21.15.42:0/2920671956 >> 172.21.15.42:0/2920671956 conn(0x7f29f806cd20 msgr2=0x7f29f80ba030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:26.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.748+0000 7f29fe200640 1 -- 172.21.15.42:0/2920671956 shutdown_connections 2024-09-17T01:38:26.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.748+0000 7f29fe200640 1 -- 172.21.15.42:0/2920671956 wait complete. 2024-09-17T01:38:26.767 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags' 2024-09-17T01:38:26.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.995+0000 7f188e600640 1 -- 172.21.15.42:0/4210897623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18880b3550 msgr2=0x7f188815cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:26.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.995+0000 7f188e600640 1 --2- 172.21.15.42:0/4210897623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18880b3550 0x7f188815cec0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f1878005fd0 tx=0x7f187802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:26.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.995+0000 7f188e600640 1 -- 172.21.15.42:0/4210897623 shutdown_connections 2024-09-17T01:38:26.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.995+0000 7f188e600640 1 --2- 172.21.15.42:0/4210897623 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1888142f40 0x7f1888072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:26.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.995+0000 7f188e600640 1 --2- 172.21.15.42:0/4210897623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18880b3550 0x7f188815cec0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:26.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.995+0000 7f188e600640 1 -- 172.21.15.42:0/4210897623 >> 172.21.15.42:0/4210897623 conn(0x7f18880b2930 msgr2=0x7f188806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:26.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.995+0000 7f188e600640 1 -- 172.21.15.42:0/4210897623 shutdown_connections 2024-09-17T01:38:26.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.996+0000 7f188e600640 1 -- 172.21.15.42:0/4210897623 wait complete. 2024-09-17T01:38:26.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.998+0000 7f188e600640 1 Processor -- start 2024-09-17T01:38:26.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.998+0000 7f188e600640 1 -- start start 2024-09-17T01:38:26.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.999+0000 7f188e600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1888072e90 0x7f18881f39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:26.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.999+0000 7f188e600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18880b3550 0x7f188813ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:26.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.999+0000 7f188e600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1888142f40 0x7f18880ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:26.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.999+0000 7f188e600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f188806d7c0 con 0x7f18880b3550 2024-09-17T01:38:26.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.999+0000 7f188e600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f188806d640 con 0x7f1888142f40 2024-09-17T01:38:26.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:26.999+0000 7f188e600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f188806d940 con 0x7f1888072e90 2024-09-17T01:38:26.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:27.000+0000 7f1886a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18880b3550 0x7f188813ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:26.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:27.000+0000 7f1887400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1888072e90 0x7f18881f39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:27.000+0000 7f1886a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18880b3550 0x7f188813ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57890/0 (socket says 172.21.15.42:57890) 2024-09-17T01:38:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:27.000+0000 7f1886a00640 1 -- 172.21.15.42:0/241317006 learned_addr learned my addr 172.21.15.42:0/241317006 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:27.000+0000 7f1887e00640 1 --2- 172.21.15.42:0/241317006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1888142f40 0x7f18880ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:27.000+0000 7f1886a00640 1 -- 172.21.15.42:0/241317006 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1888072e90 msgr2=0x7f18881f39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:27.000+0000 7f1886a00640 1 --2- 172.21.15.42:0/241317006 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1888072e90 0x7f18881f39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:27.000+0000 7f1886a00640 1 -- 172.21.15.42:0/241317006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1888142f40 msgr2=0x7f18880ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:27.000+0000 7f1886a00640 1 --2- 172.21.15.42:0/241317006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1888142f40 0x7f18880ae220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:27.000+0000 7f1886a00640 1 -- 172.21.15.42:0/241317006 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188813f220 con 0x7f18880b3550 2024-09-17T01:38:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:27.001+0000 7f1886a00640 1 --2- 172.21.15.42:0/241317006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18880b3550 0x7f188813ece0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f187400c970 tx=0x7f187400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:27.001+0000 7f187f400640 1 -- 172.21.15.42:0/241317006 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1874007b50 con 0x7f18880b3550 2024-09-17T01:38:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:27.001+0000 7f187f400640 1 -- 172.21.15.42:0/241317006 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1874007e00 con 0x7f18880b3550 2024-09-17T01:38:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:27.001+0000 7f188e600640 1 -- 172.21.15.42:0/241317006 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18880aa5c0 con 0x7f18880b3550 2024-09-17T01:38:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:27.001+0000 7f187f400640 1 -- 172.21.15.42:0/241317006 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1874005280 con 0x7f18880b3550 2024-09-17T01:38:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:27.001+0000 7f188e600640 1 -- 172.21.15.42:0/241317006 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18880add00 con 0x7f18880b3550 2024-09-17T01:38:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:27.002+0000 7f188e600640 1 -- 172.21.15.42:0/241317006 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18880aaae0 con 0x7f18880b3550 2024-09-17T01:38:27.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:27.003+0000 7f187f400640 1 -- 172.21.15.42:0/241317006 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1874005420 con 0x7f18880b3550 2024-09-17T01:38:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:27.004+0000 7f187f400640 1 --2- 172.21.15.42:0/241317006 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1868078b90 0x7f186807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:27.004+0000 7f187f400640 1 -- 172.21.15.42:0/241317006 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5029+0+0 (secure 0 0 0) 0x7f187409ae60 con 0x7f18880b3550 2024-09-17T01:38:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:27.005+0000 7f1887400640 1 --2- 172.21.15.42:0/241317006 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1868078b90 0x7f186807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:27.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:27.006+0000 7f1887400640 1 --2- 172.21.15.42:0/241317006 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1868078b90 0x7f186807b0a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1878033000 tx=0x7f1878004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:27.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:27.009+0000 7f187f400640 1 -- 172.21.15.42:0/241317006 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f18880aaae0 con 0x7f18880b3550 2024-09-17T01:38:27.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:27.273+0000 7f188e600640 1 -- 172.21.15.42:0/241317006 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]} v 0) -- 0x7f188815cec0 con 0x7f18880b3550 2024-09-17T01:38:28.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.276+0000 7f187f400640 1 -- 172.21.15.42:0/241317006 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]}]=0 v327) ==== 151+0+0 (secure 0 0 0) 0x7f188813f220 con 0x7f18880b3550 2024-09-17T01:38:28.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.279+0000 7f188e600640 1 -- 172.21.15.42:0/241317006 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1868078b90 msgr2=0x7f186807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:28.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.279+0000 7f188e600640 1 --2- 172.21.15.42:0/241317006 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1868078b90 0x7f186807b0a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1878033000 tx=0x7f1878004730 comp rx=0 tx=0).stop 2024-09-17T01:38:28.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.279+0000 7f188e600640 1 -- 172.21.15.42:0/241317006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18880b3550 msgr2=0x7f188813ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:28.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.279+0000 7f188e600640 1 --2- 172.21.15.42:0/241317006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18880b3550 0x7f188813ece0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f187400c970 tx=0x7f187400ce30 comp rx=0 tx=0).stop 2024-09-17T01:38:28.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.279+0000 7f188e600640 1 -- 172.21.15.42:0/241317006 shutdown_connections 2024-09-17T01:38:28.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.279+0000 7f188e600640 1 --2- 172.21.15.42:0/241317006 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1868078b90 0x7f186807b0a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:28.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.279+0000 7f188e600640 1 --2- 172.21.15.42:0/241317006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1888142f40 0x7f18880ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.279+0000 7f188e600640 1 --2- 172.21.15.42:0/241317006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f18880b3550 0x7f188813ece0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.279+0000 7f188e600640 1 --2- 172.21.15.42:0/241317006 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1888072e90 0x7f18881f39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.279+0000 7f188e600640 1 -- 172.21.15.42:0/241317006 >> 172.21.15.42:0/241317006 conn(0x7f18880b2930 msgr2=0x7f1888073be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.279+0000 7f188e600640 1 -- 172.21.15.42:0/241317006 shutdown_connections 2024-09-17T01:38:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.279+0000 7f188e600640 1 -- 172.21.15.42:0/241317006 wait complete. 2024-09-17T01:38:28.302 INFO:tasks.cephfs_test_runner:That a directory is split during scrub. ... ok 2024-09-17T01:38:28.303 INFO:tasks.cephfs_test_runner:Starting test: test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) test that scrub can iterate over ~mdsdir and evaluate strays 2024-09-17T01:38:28.303 INFO:tasks.cephfs_test_runner:test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-17T01:38:28.303 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:38:28.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.536+0000 7f3461a00640 1 -- 172.21.15.42:0/3360921199 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f345c15cb80 msgr2=0x7f345c152710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:28.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.536+0000 7f3461a00640 1 --2- 172.21.15.42:0/3360921199 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f345c15cb80 0x7f345c152710 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f344c005fd0 tx=0x7f344c02a5d0 comp rx=0 tx=0).stop 2024-09-17T01:38:28.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.536+0000 7f3461a00640 1 -- 172.21.15.42:0/3360921199 shutdown_connections 2024-09-17T01:38:28.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.536+0000 7f3461a00640 1 --2- 172.21.15.42:0/3360921199 >> v2:172.21.15.43:3300/0 conn(0x7f345c06d430 0x7f345c06d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:28.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.536+0000 7f3461a00640 1 --2- 172.21.15.42:0/3360921199 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f345c15cb80 0x7f345c152710 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:28.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.536+0000 7f3461a00640 1 -- 172.21.15.42:0/3360921199 >> 172.21.15.42:0/3360921199 conn(0x7f345c0b2930 msgr2=0x7f345c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:28.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.536+0000 7f3461a00640 1 -- 172.21.15.42:0/3360921199 shutdown_connections 2024-09-17T01:38:28.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.536+0000 7f3461a00640 1 -- 172.21.15.42:0/3360921199 wait complete. 2024-09-17T01:38:28.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.538+0000 7f3461a00640 1 Processor -- start 2024-09-17T01:38:28.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.538+0000 7f3461a00640 1 -- start start 2024-09-17T01:38:28.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.540+0000 7f3461a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f345c06d430 0x7f345c0abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:28.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.540+0000 7f3461a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f345c15cb80 0x7f345c14faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:28.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.540+0000 7f3461a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f345c15f480 0x7f345c1e9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:28.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.540+0000 7f3461a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f345c073820 con 0x7f345c06d430 2024-09-17T01:38:28.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.540+0000 7f3461a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f345c0736a0 con 0x7f345c15f480 2024-09-17T01:38:28.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.540+0000 7f3461a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f345c0739a0 con 0x7f345c15cb80 2024-09-17T01:38:28.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.540+0000 7f345aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f345c06d430 0x7f345c0abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:28.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.540+0000 7f345aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f345c06d430 0x7f345c0abbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57892/0 (socket says 172.21.15.42:57892) 2024-09-17T01:38:28.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.540+0000 7f345aa00640 1 -- 172.21.15.42:0/2057329247 learned_addr learned my addr 172.21.15.42:0/2057329247 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:28.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.540+0000 7f3453e00640 1 --2- 172.21.15.42:0/2057329247 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f345c15cb80 0x7f345c14faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:28.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.540+0000 7f345b400640 1 --2- 172.21.15.42:0/2057329247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f345c15f480 0x7f345c1e9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:28.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.541+0000 7f345aa00640 1 -- 172.21.15.42:0/2057329247 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f345c15cb80 msgr2=0x7f345c14faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:28.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.541+0000 7f345aa00640 1 --2- 172.21.15.42:0/2057329247 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f345c15cb80 0x7f345c14faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:28.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.541+0000 7f345aa00640 1 -- 172.21.15.42:0/2057329247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f345c15f480 msgr2=0x7f345c1e9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:28.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.541+0000 7f345aa00640 1 --2- 172.21.15.42:0/2057329247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f345c15f480 0x7f345c1e9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:28.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.541+0000 7f345aa00640 1 -- 172.21.15.42:0/2057329247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345c1f6000 con 0x7f345c06d430 2024-09-17T01:38:28.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.541+0000 7f345b400640 1 --2- 172.21.15.42:0/2057329247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f345c15f480 0x7f345c1e9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:28.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.541+0000 7f345aa00640 1 --2- 172.21.15.42:0/2057329247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f345c06d430 0x7f345c0abbc0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f344c034040 tx=0x7f344c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:28.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.541+0000 7f3452a00640 1 -- 172.21.15.42:0/2057329247 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c03e030 con 0x7f345c06d430 2024-09-17T01:38:28.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.541+0000 7f3452a00640 1 -- 172.21.15.42:0/2057329247 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f344c003ca0 con 0x7f345c06d430 2024-09-17T01:38:28.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.541+0000 7f3461a00640 1 -- 172.21.15.42:0/2057329247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f345c1f62e0 con 0x7f345c06d430 2024-09-17T01:38:28.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.541+0000 7f3452a00640 1 -- 172.21.15.42:0/2057329247 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c035040 con 0x7f345c06d430 2024-09-17T01:38:28.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.541+0000 7f3461a00640 1 -- 172.21.15.42:0/2057329247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f345c1f68a0 con 0x7f345c06d430 2024-09-17T01:38:28.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.543+0000 7f3461a00640 1 -- 172.21.15.42:0/2057329247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f345c073e70 con 0x7f345c06d430 2024-09-17T01:38:28.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.544+0000 7f3452a00640 1 -- 172.21.15.42:0/2057329247 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f344c041030 con 0x7f345c06d430 2024-09-17T01:38:28.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.545+0000 7f3452a00640 1 --2- 172.21.15.42:0/2057329247 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3438078b90 0x7f343807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:28.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.545+0000 7f3452a00640 1 -- 172.21.15.42:0/2057329247 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5029+0+0 (secure 0 0 0) 0x7f344c0baf50 con 0x7f345c06d430 2024-09-17T01:38:28.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.545+0000 7f3453e00640 1 --2- 172.21.15.42:0/2057329247 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3438078b90 0x7f343807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:28.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.546+0000 7f3453e00640 1 --2- 172.21.15.42:0/2057329247 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3438078b90 0x7f343807b0a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f34440095f0 tx=0x7f3444005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:28.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.549+0000 7f3452a00640 1 -- 172.21.15.42:0/2057329247 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f344c082fe0 con 0x7f345c06d430 2024-09-17T01:38:28.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.743+0000 7f3461a00640 1 -- 172.21.15.42:0/2057329247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f345c06a170 con 0x7f345c06d430 2024-09-17T01:38:28.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.744+0000 7f3452a00640 1 -- 172.21.15.42:0/2057329247 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+13114 (secure 0 0 0) 0x7f344c087a10 con 0x7f345c06d430 2024-09-17T01:38:28.742 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:38:28.742 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":100,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:38:26.263405+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6834/487915371":"2024-09-18T01:38:23.252549+0000","172.21.15.42:6832/487915371":"2024-09-18T01:38:23.252549+0000","172.21.15.42:6835/3687871500":"2024-09-18T01:38:05.380911+0000","172.21.15.42:6834/3687871500":"2024-09-18T01:38:05.380911+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:38:28.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.746+0000 7f3461a00640 1 -- 172.21.15.42:0/2057329247 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3438078b90 msgr2=0x7f343807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:28.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.746+0000 7f3461a00640 1 --2- 172.21.15.42:0/2057329247 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3438078b90 0x7f343807b0a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f34440095f0 tx=0x7f3444005f90 comp rx=0 tx=0).stop 2024-09-17T01:38:28.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.746+0000 7f3461a00640 1 -- 172.21.15.42:0/2057329247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f345c06d430 msgr2=0x7f345c0abbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:28.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.746+0000 7f3461a00640 1 --2- 172.21.15.42:0/2057329247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f345c06d430 0x7f345c0abbc0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f344c034040 tx=0x7f344c0038a0 comp rx=0 tx=0).stop 2024-09-17T01:38:28.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.746+0000 7f3461a00640 1 -- 172.21.15.42:0/2057329247 shutdown_connections 2024-09-17T01:38:28.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.746+0000 7f3461a00640 1 --2- 172.21.15.42:0/2057329247 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3438078b90 0x7f343807b0a0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:28.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.746+0000 7f3461a00640 1 --2- 172.21.15.42:0/2057329247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f345c15f480 0x7f345c1e9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:28.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.746+0000 7f3461a00640 1 --2- 172.21.15.42:0/2057329247 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f345c15cb80 0x7f345c14faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:28.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.746+0000 7f3461a00640 1 --2- 172.21.15.42:0/2057329247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f345c06d430 0x7f345c0abbc0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:28.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.746+0000 7f3461a00640 1 -- 172.21.15.42:0/2057329247 >> 172.21.15.42:0/2057329247 conn(0x7f345c0b2930 msgr2=0x7f345c0ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:28.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.746+0000 7f3461a00640 1 -- 172.21.15.42:0/2057329247 shutdown_connections 2024-09-17T01:38:28.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:28.746+0000 7f3461a00640 1 -- 172.21.15.42:0/2057329247 wait complete. 2024-09-17T01:38:28.770 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T01:31:55.004951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T01:38:28.771 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T01:38:29.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.003+0000 7fb453200640 1 -- 172.21.15.42:0/1099266020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb454160800 msgr2=0x7fb4540b3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:29.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.003+0000 7fb453200640 1 --2- 172.21.15.42:0/1099266020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb454160800 0x7fb4540b3b80 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fb454070590 tx=0x7fb44c02aa30 comp rx=0 tx=0).stop 2024-09-17T01:38:29.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.003+0000 7fb453200640 1 -- 172.21.15.42:0/1099266020 shutdown_connections 2024-09-17T01:38:29.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.003+0000 7fb453200640 1 --2- 172.21.15.42:0/1099266020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb454160800 0x7fb4540b3b80 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:29.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.003+0000 7fb453200640 1 --2- 172.21.15.42:0/1099266020 >> v2:172.21.15.43:3300/0 conn(0x7fb454156ba0 0x7fb4540745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:29.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.003+0000 7fb453200640 1 -- 172.21.15.42:0/1099266020 >> 172.21.15.42:0/1099266020 conn(0x7fb4540b27a0 msgr2=0x7fb4540d0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:29.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.003+0000 7fb453200640 1 -- 172.21.15.42:0/1099266020 shutdown_connections 2024-09-17T01:38:29.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.003+0000 7fb453200640 1 -- 172.21.15.42:0/1099266020 wait complete. 2024-09-17T01:38:29.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.006+0000 7fb453200640 1 Processor -- start 2024-09-17T01:38:29.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.006+0000 7fb453200640 1 -- start start 2024-09-17T01:38:29.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.007+0000 7fb453200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb454074b20 0x7fb4540c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:29.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.007+0000 7fb453200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb454156ba0 0x7fb4541f6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:29.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.007+0000 7fb453200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4541f6d40 0x7fb4541effb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:29.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.007+0000 7fb453200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb4540b4450 con 0x7fb454156ba0 2024-09-17T01:38:29.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.007+0000 7fb453200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb4540b42d0 con 0x7fb4541f6d40 2024-09-17T01:38:29.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.007+0000 7fb453200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb4540b45d0 con 0x7fb454074b20 2024-09-17T01:38:29.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.008+0000 7fb44be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb454156ba0 0x7fb4541f6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:29.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.008+0000 7fb44be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb454156ba0 0x7fb4541f6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57904/0 (socket says 172.21.15.42:57904) 2024-09-17T01:38:29.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.008+0000 7fb44be00640 1 -- 172.21.15.42:0/1426140924 learned_addr learned my addr 172.21.15.42:0/1426140924 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:29.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.008+0000 7fb451e00640 1 --2- 172.21.15.42:0/1426140924 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb454074b20 0x7fb4540c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:29.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.008+0000 7fb452800640 1 --2- 172.21.15.42:0/1426140924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4541f6d40 0x7fb4541effb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:29.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.008+0000 7fb44be00640 1 -- 172.21.15.42:0/1426140924 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb454074b20 msgr2=0x7fb4540c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:29.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.008+0000 7fb44be00640 1 --2- 172.21.15.42:0/1426140924 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb454074b20 0x7fb4540c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:29.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.008+0000 7fb44be00640 1 -- 172.21.15.42:0/1426140924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4541f6d40 msgr2=0x7fb4541effb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:29.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.008+0000 7fb44be00640 1 --2- 172.21.15.42:0/1426140924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4541f6d40 0x7fb4541effb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:29.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.008+0000 7fb44be00640 1 -- 172.21.15.42:0/1426140924 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4540ce620 con 0x7fb454156ba0 2024-09-17T01:38:29.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.008+0000 7fb44be00640 1 --2- 172.21.15.42:0/1426140924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb454156ba0 0x7fb4541f6800 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00c3a0 tx=0x7fb43c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:29.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.009+0000 7fb44a000640 1 -- 172.21.15.42:0/1426140924 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43c017070 con 0x7fb454156ba0 2024-09-17T01:38:29.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.009+0000 7fb44a000640 1 -- 172.21.15.42:0/1426140924 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb43c0053c0 con 0x7fb454156ba0 2024-09-17T01:38:29.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.009+0000 7fb44a000640 1 -- 172.21.15.42:0/1426140924 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43c003850 con 0x7fb454156ba0 2024-09-17T01:38:29.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.009+0000 7fb453200640 1 -- 172.21.15.42:0/1426140924 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4540ce900 con 0x7fb454156ba0 2024-09-17T01:38:29.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.009+0000 7fb453200640 1 -- 172.21.15.42:0/1426140924 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4540ceec0 con 0x7fb454156ba0 2024-09-17T01:38:29.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.010+0000 7fb453200640 1 -- 172.21.15.42:0/1426140924 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4540b4a80 con 0x7fb454156ba0 2024-09-17T01:38:29.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.011+0000 7fb44a000640 1 -- 172.21.15.42:0/1426140924 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb43c01a070 con 0x7fb454156ba0 2024-09-17T01:38:29.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.012+0000 7fb44a000640 1 --2- 172.21.15.42:0/1426140924 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb430078b90 0x7fb43007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:29.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.012+0000 7fb44a000640 1 -- 172.21.15.42:0/1426140924 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5029+0+0 (secure 0 0 0) 0x7fb43c099d80 con 0x7fb454156ba0 2024-09-17T01:38:29.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.013+0000 7fb451e00640 1 --2- 172.21.15.42:0/1426140924 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb430078b90 0x7fb43007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:29.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.014+0000 7fb451e00640 1 --2- 172.21.15.42:0/1426140924 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb430078b90 0x7fb43007b0a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb444009b30 tx=0x7fb444005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:29.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.017+0000 7fb44a000640 1 -- 172.21.15.42:0/1426140924 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb43c061e00 con 0x7fb454156ba0 2024-09-17T01:38:29.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.210+0000 7fb453200640 1 -- 172.21.15.42:0/1426140924 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb45415cf40 con 0x7fb454156ba0 2024-09-17T01:38:29.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.210+0000 7fb44a000640 1 -- 172.21.15.42:0/1426140924 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v100) ==== 93+0+10 (secure 0 0 0) 0x7fb43c066830 con 0x7fb454156ba0 2024-09-17T01:38:29.208 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-09-17T01:38:29.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.213+0000 7fb453200640 1 -- 172.21.15.42:0/1426140924 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb430078b90 msgr2=0x7fb43007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:29.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.213+0000 7fb453200640 1 --2- 172.21.15.42:0/1426140924 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb430078b90 0x7fb43007b0a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb444009b30 tx=0x7fb444005f90 comp rx=0 tx=0).stop 2024-09-17T01:38:29.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.213+0000 7fb453200640 1 -- 172.21.15.42:0/1426140924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb454156ba0 msgr2=0x7fb4541f6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:29.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.213+0000 7fb453200640 1 --2- 172.21.15.42:0/1426140924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb454156ba0 0x7fb4541f6800 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00c3a0 tx=0x7fb43c00c860 comp rx=0 tx=0).stop 2024-09-17T01:38:29.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.213+0000 7fb453200640 1 -- 172.21.15.42:0/1426140924 shutdown_connections 2024-09-17T01:38:29.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.213+0000 7fb453200640 1 --2- 172.21.15.42:0/1426140924 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb430078b90 0x7fb43007b0a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:29.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.213+0000 7fb453200640 1 --2- 172.21.15.42:0/1426140924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4541f6d40 0x7fb4541effb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:29.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.213+0000 7fb453200640 1 --2- 172.21.15.42:0/1426140924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb454156ba0 0x7fb4541f6800 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:29.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.213+0000 7fb453200640 1 --2- 172.21.15.42:0/1426140924 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb454074b20 0x7fb4540c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:29.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.213+0000 7fb453200640 1 -- 172.21.15.42:0/1426140924 >> 172.21.15.42:0/1426140924 conn(0x7fb4540b27a0 msgr2=0x7fb45415bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:29.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.213+0000 7fb453200640 1 -- 172.21.15.42:0/1426140924 shutdown_connections 2024-09-17T01:38:29.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.213+0000 7fb453200640 1 -- 172.21.15.42:0/1426140924 wait complete. 2024-09-17T01:38:29.235 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-09-17T01:38:29.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.465+0000 7fb73d400640 1 -- 172.21.15.42:0/4135159747 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb71c004d40 msgr2=0x7fb71c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:29.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.465+0000 7fb73d400640 1 --2- 172.21.15.42:0/4135159747 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb71c004d40 0x7fb71c005150 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fb730005fd0 tx=0x7fb71c005830 comp rx=0 tx=0).stop 2024-09-17T01:38:29.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.465+0000 7fb737200640 1 -- 172.21.15.42:0/4135159747 reap_dead start 2024-09-17T01:38:29.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.466+0000 7fb73d400640 1 -- 172.21.15.42:0/4135159747 shutdown_connections 2024-09-17T01:38:29.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.466+0000 7fb73d400640 1 -- 172.21.15.42:0/4135159747 >> 172.21.15.42:0/4135159747 conn(0x7fb7380b2930 msgr2=0x7fb73806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:29.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.466+0000 7fb73d400640 1 -- 172.21.15.42:0/4135159747 shutdown_connections 2024-09-17T01:38:29.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.466+0000 7fb73d400640 1 -- 172.21.15.42:0/4135159747 wait complete. 2024-09-17T01:38:29.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.468+0000 7fb73d400640 1 Processor -- start 2024-09-17T01:38:29.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.468+0000 7fb73d400640 1 -- start start 2024-09-17T01:38:29.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.469+0000 7fb73d400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb71c004d40 0x7fb73813ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:29.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.469+0000 7fb73d400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb73815af40 0x7fb7381f9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:29.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.469+0000 7fb73d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb73815b490 0x7fb7381f9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:29.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.469+0000 7fb73d400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb73815d3b0 con 0x7fb73815b490 2024-09-17T01:38:29.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.469+0000 7fb73d400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb73815d230 con 0x7fb73815af40 2024-09-17T01:38:29.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.469+0000 7fb73d400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb73815d530 con 0x7fb71c004d40 2024-09-17T01:38:29.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.470+0000 7fb737200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb73815b490 0x7fb7381f9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:29.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.470+0000 7fb736800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb71c004d40 0x7fb73813ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:29.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.470+0000 7fb737200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb73815b490 0x7fb7381f9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57920/0 (socket says 172.21.15.42:57920) 2024-09-17T01:38:29.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.470+0000 7fb737200640 1 -- 172.21.15.42:0/1965000179 learned_addr learned my addr 172.21.15.42:0/1965000179 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:29.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.470+0000 7fb735e00640 1 --2- 172.21.15.42:0/1965000179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb73815af40 0x7fb7381f9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:29.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.470+0000 7fb737200640 1 -- 172.21.15.42:0/1965000179 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb71c004d40 msgr2=0x7fb73813ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:29.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.470+0000 7fb737200640 1 --2- 172.21.15.42:0/1965000179 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb71c004d40 0x7fb73813ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:29.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.470+0000 7fb737200640 1 -- 172.21.15.42:0/1965000179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb73815af40 msgr2=0x7fb7381f9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:29.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.470+0000 7fb737200640 1 --2- 172.21.15.42:0/1965000179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb73815af40 0x7fb7381f9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:29.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.470+0000 7fb737200640 1 -- 172.21.15.42:0/1965000179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7381e7c40 con 0x7fb73815b490 2024-09-17T01:38:29.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.471+0000 7fb737200640 1 --2- 172.21.15.42:0/1965000179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb73815b490 0x7fb7381f9760 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fb73002b860 tx=0x7fb730033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:29.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.471+0000 7fb72ea00640 1 -- 172.21.15.42:0/1965000179 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb730042070 con 0x7fb73815b490 2024-09-17T01:38:29.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.471+0000 7fb72ea00640 1 -- 172.21.15.42:0/1965000179 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb730003970 con 0x7fb73815b490 2024-09-17T01:38:29.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.471+0000 7fb72ea00640 1 -- 172.21.15.42:0/1965000179 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb730038040 con 0x7fb73815b490 2024-09-17T01:38:29.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.471+0000 7fb73d400640 1 -- 172.21.15.42:0/1965000179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7381fa0c0 con 0x7fb73815b490 2024-09-17T01:38:29.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.471+0000 7fb73d400640 1 -- 172.21.15.42:0/1965000179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7381e7680 con 0x7fb73815b490 2024-09-17T01:38:29.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.472+0000 7fb73d400640 1 -- 172.21.15.42:0/1965000179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7380cf050 con 0x7fb73815b490 2024-09-17T01:38:29.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.473+0000 7fb72ea00640 1 -- 172.21.15.42:0/1965000179 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb730033d10 con 0x7fb73815b490 2024-09-17T01:38:29.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.474+0000 7fb72ea00640 1 --2- 172.21.15.42:0/1965000179 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb718078bc0 0x7fb71807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:29.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.474+0000 7fb72ea00640 1 -- 172.21.15.42:0/1965000179 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5029+0+0 (secure 0 0 0) 0x7fb7300baa30 con 0x7fb73815b490 2024-09-17T01:38:29.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.475+0000 7fb736800640 1 --2- 172.21.15.42:0/1965000179 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb718078bc0 0x7fb71807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:29.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.475+0000 7fb736800640 1 --2- 172.21.15.42:0/1965000179 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb718078bc0 0x7fb71807b0d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb728009c50 tx=0x7fb728005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:29.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.479+0000 7fb72ea00640 1 -- 172.21.15.42:0/1965000179 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb730082ac0 con 0x7fb73815b490 2024-09-17T01:38:29.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:29.746+0000 7fb73d400640 1 -- 172.21.15.42:0/1965000179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) -- 0x7fb7381f9e50 con 0x7fb73815b490 2024-09-17T01:38:30.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.283+0000 7fb72ea00640 1 -- 172.21.15.42:0/1965000179 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v329) ==== 161+0+0 (secure 0 0 0) 0x7fb7300874f0 con 0x7fb73815b490 2024-09-17T01:38:30.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.286+0000 7fb73d400640 1 -- 172.21.15.42:0/1965000179 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb718078bc0 msgr2=0x7fb71807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:30.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.286+0000 7fb73d400640 1 --2- 172.21.15.42:0/1965000179 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb718078bc0 0x7fb71807b0d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb728009c50 tx=0x7fb728005f90 comp rx=0 tx=0).stop 2024-09-17T01:38:30.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.286+0000 7fb73d400640 1 -- 172.21.15.42:0/1965000179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb73815b490 msgr2=0x7fb7381f9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:30.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.286+0000 7fb73d400640 1 --2- 172.21.15.42:0/1965000179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb73815b490 0x7fb7381f9760 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fb73002b860 tx=0x7fb730033ba0 comp rx=0 tx=0).stop 2024-09-17T01:38:30.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.286+0000 7fb73d400640 1 -- 172.21.15.42:0/1965000179 shutdown_connections 2024-09-17T01:38:30.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.286+0000 7fb73d400640 1 --2- 172.21.15.42:0/1965000179 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb718078bc0 0x7fb71807b0d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:30.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.286+0000 7fb73d400640 1 --2- 172.21.15.42:0/1965000179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb73815af40 0x7fb7381f9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:30.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.286+0000 7fb73d400640 1 --2- 172.21.15.42:0/1965000179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb73815b490 0x7fb7381f9760 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:30.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.286+0000 7fb73d400640 1 --2- 172.21.15.42:0/1965000179 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb71c004d40 0x7fb73813ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:30.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.286+0000 7fb73d400640 1 -- 172.21.15.42:0/1965000179 >> 172.21.15.42:0/1965000179 conn(0x7fb7380b2930 msgr2=0x7fb73806cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:30.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.286+0000 7fb73d400640 1 -- 172.21.15.42:0/1965000179 shutdown_connections 2024-09-17T01:38:30.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.286+0000 7fb73d400640 1 -- 172.21.15.42:0/1965000179 wait complete. 2024-09-17T01:38:30.312 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T01:38:30.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.542+0000 7f7ddce00640 1 -- 172.21.15.42:0/3535507772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7dd80cec40 msgr2=0x7f7dd80cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:30.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.542+0000 7f7ddce00640 1 --2- 172.21.15.42:0/3535507772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7dd80cec40 0x7f7dd80cf050 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8071ef0 tx=0x7f7dd002a820 comp rx=0 tx=0).stop 2024-09-17T01:38:30.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.542+0000 7f7ddce00640 1 -- 172.21.15.42:0/3535507772 shutdown_connections 2024-09-17T01:38:30.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.542+0000 7f7ddce00640 1 --2- 172.21.15.42:0/3535507772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7dd80cec40 0x7f7dd80cf050 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:30.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.542+0000 7f7ddce00640 1 --2- 172.21.15.42:0/3535507772 >> v2:172.21.15.43:3300/0 conn(0x7f7dd80b3550 0x7f7dd815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:30.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.542+0000 7f7ddce00640 1 -- 172.21.15.42:0/3535507772 >> 172.21.15.42:0/3535507772 conn(0x7f7dd80b2930 msgr2=0x7f7dd806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:30.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.542+0000 7f7ddce00640 1 -- 172.21.15.42:0/3535507772 shutdown_connections 2024-09-17T01:38:30.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.543+0000 7f7ddce00640 1 -- 172.21.15.42:0/3535507772 wait complete. 2024-09-17T01:38:30.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.545+0000 7f7ddce00640 1 Processor -- start 2024-09-17T01:38:30.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.545+0000 7f7ddce00640 1 -- start start 2024-09-17T01:38:30.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.546+0000 7f7ddce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7dd80b3550 0x7f7dd81f63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:30.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.546+0000 7f7ddce00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7dd80cec40 0x7f7dd815f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:30.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.546+0000 7f7ddce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7dd8142f40 0x7f7dd806e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:30.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.546+0000 7f7ddce00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd806d7c0 con 0x7f7dd80b3550 2024-09-17T01:38:30.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.546+0000 7f7ddce00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd806d640 con 0x7f7dd8142f40 2024-09-17T01:38:30.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.546+0000 7f7ddce00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7dd806d940 con 0x7f7dd80cec40 2024-09-17T01:38:30.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.547+0000 7f7dd5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7dd80b3550 0x7f7dd81f63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:30.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.547+0000 7f7dd5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7dd80b3550 0x7f7dd81f63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57942/0 (socket says 172.21.15.42:57942) 2024-09-17T01:38:30.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.547+0000 7f7dd5e00640 1 -- 172.21.15.42:0/310282615 learned_addr learned my addr 172.21.15.42:0/310282615 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:30.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.547+0000 7f7dcfe00640 1 --2- 172.21.15.42:0/310282615 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7dd80cec40 0x7f7dd815f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:30.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.547+0000 7f7dd6800640 1 --2- 172.21.15.42:0/310282615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7dd8142f40 0x7f7dd806e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:30.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.547+0000 7f7dd5e00640 1 -- 172.21.15.42:0/310282615 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7dd80cec40 msgr2=0x7f7dd815f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:30.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.547+0000 7f7dd5e00640 1 --2- 172.21.15.42:0/310282615 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7dd80cec40 0x7f7dd815f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:30.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.547+0000 7f7dd5e00640 1 -- 172.21.15.42:0/310282615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7dd8142f40 msgr2=0x7f7dd806e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:30.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.547+0000 7f7dd5e00640 1 --2- 172.21.15.42:0/310282615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7dd8142f40 0x7f7dd806e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:30.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.547+0000 7f7dd5e00640 1 -- 172.21.15.42:0/310282615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd815f620 con 0x7f7dd80b3550 2024-09-17T01:38:30.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.547+0000 7f7dd6800640 1 --2- 172.21.15.42:0/310282615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7dd8142f40 0x7f7dd806e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:38:30.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.547+0000 7f7dd5e00640 1 --2- 172.21.15.42:0/310282615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7dd80b3550 0x7f7dd81f63c0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f7dc800d740 tx=0x7f7dc800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:30.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.548+0000 7f7dce000640 1 -- 172.21.15.42:0/310282615 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8017070 con 0x7f7dd80b3550 2024-09-17T01:38:30.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.548+0000 7f7dce000640 1 -- 172.21.15.42:0/310282615 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7dc8009d20 con 0x7f7dd80b3550 2024-09-17T01:38:30.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.548+0000 7f7ddce00640 1 -- 172.21.15.42:0/310282615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dd80c5780 con 0x7f7dd80b3550 2024-09-17T01:38:30.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.548+0000 7f7dce000640 1 -- 172.21.15.42:0/310282615 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc80106c0 con 0x7f7dd80b3550 2024-09-17T01:38:30.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.548+0000 7f7ddce00640 1 -- 172.21.15.42:0/310282615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dd815e8e0 con 0x7f7dd80b3550 2024-09-17T01:38:30.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.549+0000 7f7ddce00640 1 -- 172.21.15.42:0/310282615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dd815cec0 con 0x7f7dd80b3550 2024-09-17T01:38:30.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.550+0000 7f7dce000640 1 -- 172.21.15.42:0/310282615 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7dc801a070 con 0x7f7dd80b3550 2024-09-17T01:38:30.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.551+0000 7f7dce000640 1 --2- 172.21.15.42:0/310282615 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7db4078b90 0x7f7db407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:30.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.551+0000 7f7dce000640 1 -- 172.21.15.42:0/310282615 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5029+0+0 (secure 0 0 0) 0x7f7dc809ac80 con 0x7f7dd80b3550 2024-09-17T01:38:30.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.552+0000 7f7dcfe00640 1 --2- 172.21.15.42:0/310282615 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7db4078b90 0x7f7db407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:30.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.552+0000 7f7dcfe00640 1 --2- 172.21.15.42:0/310282615 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7db4078b90 0x7f7db407b0a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0007fd0 tx=0x7f7dc0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:30.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.556+0000 7f7dce000640 1 -- 172.21.15.42:0/310282615 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7dc8063350 con 0x7f7dd80b3550 2024-09-17T01:38:30.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.753+0000 7f7ddce00640 1 -- 172.21.15.42:0/310282615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f7dd806a170 con 0x7f7dd80b3550 2024-09-17T01:38:30.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.754+0000 7f7dce000640 1 -- 172.21.15.42:0/310282615 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v49) ==== 59+0+2294 (secure 0 0 0) 0x7f7dc8062c50 con 0x7f7dd80b3550 2024-09-17T01:38:30.751 INFO:teuthology.orchestra.run.smithi042.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T01:38:30.752 INFO:teuthology.orchestra.run.smithi042.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T01:38:30.752 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced client_mount_timeout 30 2024-09-17T01:38:30.752 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_client 20/20 2024-09-17T01:38:30.752 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_mgr 20/20 2024-09-17T01:38:30.752 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_ms 1/1 2024-09-17T01:38:30.752 INFO:teuthology.orchestra.run.smithi042.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T01:38:30.752 INFO:teuthology.orchestra.run.smithi042.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T01:38:30.752 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3683.959260 2024-09-17T01:38:30.752 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4350.010833 2024-09-17T01:38:30.752 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4316.776055 2024-09-17T01:38:30.752 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3885.595082 2024-09-17T01:38:30.752 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3602.000737 2024-09-17T01:38:30.753 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4883.364748 2024-09-17T01:38:30.753 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3752.484811 2024-09-17T01:38:30.753 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3775.035963 2024-09-17T01:38:30.753 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds 20/20 2024-09-17T01:38:30.753 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T01:38:30.753 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_ms 2/2 2024-09-17T01:38:30.753 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_frag true 2024-09-17T01:38:30.753 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_scatterstat true 2024-09-17T01:38:30.753 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T01:38:30.753 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_verify_scatter true 2024-09-17T01:38:30.753 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T01:38:30.753 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T01:38:30.754 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T01:38:30.754 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced client_mount_timeout 600 2024-09-17T01:38:30.754 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_client 20/20 2024-09-17T01:38:30.754 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_ms 1/1 2024-09-17T01:38:30.754 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T01:38:30.754 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T01:38:30.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.756+0000 7f7ddce00640 1 -- 172.21.15.42:0/310282615 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7db4078b90 msgr2=0x7f7db407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:30.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.756+0000 7f7ddce00640 1 --2- 172.21.15.42:0/310282615 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7db4078b90 0x7f7db407b0a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0007fd0 tx=0x7f7dc0009040 comp rx=0 tx=0).stop 2024-09-17T01:38:30.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.756+0000 7f7ddce00640 1 -- 172.21.15.42:0/310282615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7dd80b3550 msgr2=0x7f7dd81f63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:30.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.756+0000 7f7ddce00640 1 --2- 172.21.15.42:0/310282615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7dd80b3550 0x7f7dd81f63c0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f7dc800d740 tx=0x7f7dc800dc00 comp rx=0 tx=0).stop 2024-09-17T01:38:30.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.756+0000 7f7ddce00640 1 -- 172.21.15.42:0/310282615 shutdown_connections 2024-09-17T01:38:30.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.756+0000 7f7ddce00640 1 --2- 172.21.15.42:0/310282615 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7db4078b90 0x7f7db407b0a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:30.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.756+0000 7f7ddce00640 1 --2- 172.21.15.42:0/310282615 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7dd8142f40 0x7f7dd806e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:30.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.756+0000 7f7ddce00640 1 --2- 172.21.15.42:0/310282615 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7dd80cec40 0x7f7dd815f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:30.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.756+0000 7f7ddce00640 1 --2- 172.21.15.42:0/310282615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7dd80b3550 0x7f7dd81f63c0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:30.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.756+0000 7f7ddce00640 1 -- 172.21.15.42:0/310282615 >> 172.21.15.42:0/310282615 conn(0x7f7dd80b2930 msgr2=0x7f7dd80b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:30.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.756+0000 7f7ddce00640 1 -- 172.21.15.42:0/310282615 shutdown_connections 2024-09-17T01:38:30.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:30.756+0000 7f7ddce00640 1 -- 172.21.15.42:0/310282615 wait complete. 2024-09-17T01:38:30.781 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T01:38:31.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.013+0000 7fe194c00640 1 -- 172.21.15.42:0/1448749462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1900cf0c0 msgr2=0x7fe19006d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:31.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.013+0000 7fe194c00640 1 --2- 172.21.15.42:0/1448749462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1900cf0c0 0x7fe19006d430 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe188005fd0 tx=0x7fe18802a8b0 comp rx=0 tx=0).stop 2024-09-17T01:38:31.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.013+0000 7fe194c00640 1 -- 172.21.15.42:0/1448749462 shutdown_connections 2024-09-17T01:38:31.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.013+0000 7fe194c00640 1 --2- 172.21.15.42:0/1448749462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1900cf0c0 0x7fe19006d430 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:31.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.013+0000 7fe194c00640 1 --2- 172.21.15.42:0/1448749462 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe19015cec0 0x7fe19015d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:31.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.013+0000 7fe194c00640 1 -- 172.21.15.42:0/1448749462 >> 172.21.15.42:0/1448749462 conn(0x7fe1900b2930 msgr2=0x7fe19006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:31.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.013+0000 7fe194c00640 1 -- 172.21.15.42:0/1448749462 shutdown_connections 2024-09-17T01:38:31.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.013+0000 7fe194c00640 1 -- 172.21.15.42:0/1448749462 wait complete. 2024-09-17T01:38:31.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.015+0000 7fe194c00640 1 Processor -- start 2024-09-17T01:38:31.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.015+0000 7fe194c00640 1 -- start start 2024-09-17T01:38:31.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.017+0000 7fe194c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1900cecb0 0x7fe1900aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:31.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.017+0000 7fe194c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1900cf0c0 0x7fe190157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:31.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.017+0000 7fe194c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe19015cec0 0x7fe1900ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:31.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.017+0000 7fe194c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe190074130 con 0x7fe1900cf0c0 2024-09-17T01:38:31.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.017+0000 7fe194c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe190073fb0 con 0x7fe19015cec0 2024-09-17T01:38:31.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.017+0000 7fe194c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe19006d970 con 0x7fe1900cecb0 2024-09-17T01:38:31.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.017+0000 7fe185400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1900cf0c0 0x7fe190157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:31.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.017+0000 7fe185400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1900cf0c0 0x7fe190157480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57954/0 (socket says 172.21.15.42:57954) 2024-09-17T01:38:31.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.017+0000 7fe185400640 1 -- 172.21.15.42:0/1080571693 learned_addr learned my addr 172.21.15.42:0/1080571693 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:31.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.017+0000 7fe18e800640 1 --2- 172.21.15.42:0/1080571693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe19015cec0 0x7fe1900ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:31.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.017+0000 7fe18de00640 1 --2- 172.21.15.42:0/1080571693 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1900cecb0 0x7fe1900aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:31.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.017+0000 7fe185400640 1 -- 172.21.15.42:0/1080571693 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1900cecb0 msgr2=0x7fe1900aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:31.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.017+0000 7fe185400640 1 --2- 172.21.15.42:0/1080571693 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1900cecb0 0x7fe1900aa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:31.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.017+0000 7fe185400640 1 -- 172.21.15.42:0/1080571693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe19015cec0 msgr2=0x7fe1900ac590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:31.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.017+0000 7fe185400640 1 --2- 172.21.15.42:0/1080571693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe19015cec0 0x7fe1900ac590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:31.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.017+0000 7fe185400640 1 -- 172.21.15.42:0/1080571693 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1901f7980 con 0x7fe1900cf0c0 2024-09-17T01:38:31.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.018+0000 7fe185400640 1 --2- 172.21.15.42:0/1080571693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1900cf0c0 0x7fe190157480 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fe17800c430 tx=0x7fe17800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:31.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.018+0000 7fe186a00640 1 -- 172.21.15.42:0/1080571693 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178011790 con 0x7fe1900cf0c0 2024-09-17T01:38:31.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.018+0000 7fe186a00640 1 -- 172.21.15.42:0/1080571693 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe178017070 con 0x7fe1900cf0c0 2024-09-17T01:38:31.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.018+0000 7fe194c00640 1 -- 172.21.15.42:0/1080571693 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1901f70e0 con 0x7fe1900cf0c0 2024-09-17T01:38:31.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.018+0000 7fe186a00640 1 -- 172.21.15.42:0/1080571693 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178011cc0 con 0x7fe1900cf0c0 2024-09-17T01:38:31.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.018+0000 7fe194c00640 1 -- 172.21.15.42:0/1080571693 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1901f76a0 con 0x7fe1900cf0c0 2024-09-17T01:38:31.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.019+0000 7fe194c00640 1 -- 172.21.15.42:0/1080571693 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1901f6e50 con 0x7fe1900cf0c0 2024-09-17T01:38:31.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.021+0000 7fe186a00640 1 -- 172.21.15.42:0/1080571693 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe17801c460 con 0x7fe1900cf0c0 2024-09-17T01:38:31.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.022+0000 7fe186a00640 1 --2- 172.21.15.42:0/1080571693 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe16c078bc0 0x7fe16c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:31.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.022+0000 7fe186a00640 1 -- 172.21.15.42:0/1080571693 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5029+0+0 (secure 0 0 0) 0x7fe17809a590 con 0x7fe1900cf0c0 2024-09-17T01:38:31.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.022+0000 7fe18de00640 1 --2- 172.21.15.42:0/1080571693 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe16c078bc0 0x7fe16c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:31.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.023+0000 7fe18de00640 1 --2- 172.21.15.42:0/1080571693 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe16c078bc0 0x7fe16c07b0d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe1800095f0 tx=0x7fe180005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:31.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.026+0000 7fe186a00640 1 -- 172.21.15.42:0/1080571693 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe178021020 con 0x7fe1900cf0c0 2024-09-17T01:38:31.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.223+0000 7fe194c00640 1 -- 172.21.15.42:0/1080571693 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fe1900b49a0 con 0x7fe1900cf0c0 2024-09-17T01:38:31.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.228+0000 7fe186a00640 1 -- 172.21.15.42:0/1080571693 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v50)=0 v50) ==== 122+0+0 (secure 0 0 0) 0x7fe1900b49a0 con 0x7fe1900cf0c0 2024-09-17T01:38:31.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.230+0000 7fe194c00640 1 -- 172.21.15.42:0/1080571693 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe16c078bc0 msgr2=0x7fe16c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:31.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.230+0000 7fe194c00640 1 --2- 172.21.15.42:0/1080571693 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe16c078bc0 0x7fe16c07b0d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe1800095f0 tx=0x7fe180005f90 comp rx=0 tx=0).stop 2024-09-17T01:38:31.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.230+0000 7fe194c00640 1 -- 172.21.15.42:0/1080571693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1900cf0c0 msgr2=0x7fe190157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:31.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.230+0000 7fe194c00640 1 --2- 172.21.15.42:0/1080571693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1900cf0c0 0x7fe190157480 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fe17800c430 tx=0x7fe17800c8f0 comp rx=0 tx=0).stop 2024-09-17T01:38:31.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.230+0000 7fe194c00640 1 -- 172.21.15.42:0/1080571693 shutdown_connections 2024-09-17T01:38:31.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.230+0000 7fe194c00640 1 --2- 172.21.15.42:0/1080571693 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe16c078bc0 0x7fe16c07b0d0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:31.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.230+0000 7fe194c00640 1 --2- 172.21.15.42:0/1080571693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe19015cec0 0x7fe1900ac590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:31.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.230+0000 7fe194c00640 1 --2- 172.21.15.42:0/1080571693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1900cf0c0 0x7fe190157480 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:31.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.230+0000 7fe194c00640 1 --2- 172.21.15.42:0/1080571693 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1900cecb0 0x7fe1900aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:31.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.230+0000 7fe194c00640 1 -- 172.21.15.42:0/1080571693 >> 172.21.15.42:0/1080571693 conn(0x7fe1900b2930 msgr2=0x7fe19015c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:31.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.230+0000 7fe194c00640 1 -- 172.21.15.42:0/1080571693 shutdown_connections 2024-09-17T01:38:31.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.230+0000 7fe194c00640 1 -- 172.21.15.42:0/1080571693 wait complete. 2024-09-17T01:38:31.250 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:38:31.251 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:38:31.338 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:38:31.429 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:38:31.429 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:38:31.429 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:38:31.465 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:38:31.465 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:38:31.465 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:38:31.505 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:38:31.505 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:38:31.505 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:38:31.542 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:38:31.542 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:38:31.542 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:38:31.581 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:38:31.582 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T01:38:31.582 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:38:31.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.812+0000 7f1b93c00640 1 -- 172.21.15.42:0/2680759188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b74004800 msgr2=0x7f1b74004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:31.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.812+0000 7f1b93c00640 1 --2- 172.21.15.42:0/2680759188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b74004800 0x7f1b74004c10 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800c310 tx=0x7f1b74005830 comp rx=0 tx=0).stop 2024-09-17T01:38:31.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.812+0000 7f1b93c00640 1 -- 172.21.15.42:0/2680759188 shutdown_connections 2024-09-17T01:38:31.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.812+0000 7f1b93c00640 1 --2- 172.21.15.42:0/2680759188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b74004800 0x7f1b74004c10 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:31.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.812+0000 7f1b93c00640 1 -- 172.21.15.42:0/2680759188 >> 172.21.15.42:0/2680759188 conn(0x7f1b8c0b2930 msgr2=0x7f1b8c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:31.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.813+0000 7f1b93c00640 1 -- 172.21.15.42:0/2680759188 shutdown_connections 2024-09-17T01:38:31.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.813+0000 7f1b93c00640 1 -- 172.21.15.42:0/2680759188 wait complete. 2024-09-17T01:38:31.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.815+0000 7f1b93c00640 1 Processor -- start 2024-09-17T01:38:31.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.815+0000 7f1b93c00640 1 -- start start 2024-09-17T01:38:31.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.816+0000 7f1b93c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b74004800 0x7f1b8c146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:31.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.817+0000 7f1b93c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b8c1f9340 0x7f1b8c1f9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:31.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.817+0000 7f1b93c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b8c15ac00 0x7f1b8c15b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:31.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.817+0000 7f1b93c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c15f200 con 0x7f1b8c1f9340 2024-09-17T01:38:31.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.817+0000 7f1b93c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c074680 con 0x7f1b74004800 2024-09-17T01:38:31.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.817+0000 7f1b93c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1b8c15f380 con 0x7f1b8c15ac00 2024-09-17T01:38:31.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.817+0000 7f1b8be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b8c1f9340 0x7f1b8c1f9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:31.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.817+0000 7f1b8be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b8c1f9340 0x7f1b8c1f9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57964/0 (socket says 172.21.15.42:57964) 2024-09-17T01:38:31.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.817+0000 7f1b8be00640 1 -- 172.21.15.42:0/3049389058 learned_addr learned my addr 172.21.15.42:0/3049389058 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:31.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.817+0000 7f1b91200640 1 --2- 172.21.15.42:0/3049389058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b74004800 0x7f1b8c146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:31.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.817+0000 7f1b91c00640 1 --2- 172.21.15.42:0/3049389058 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b8c15ac00 0x7f1b8c15b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:31.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.817+0000 7f1b8be00640 1 -- 172.21.15.42:0/3049389058 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b8c15ac00 msgr2=0x7f1b8c15b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:31.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.817+0000 7f1b8be00640 1 --2- 172.21.15.42:0/3049389058 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b8c15ac00 0x7f1b8c15b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:31.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.817+0000 7f1b8be00640 1 -- 172.21.15.42:0/3049389058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b74004800 msgr2=0x7f1b8c146d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:31.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.817+0000 7f1b8be00640 1 --2- 172.21.15.42:0/3049389058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b74004800 0x7f1b8c146d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:31.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.817+0000 7f1b8be00640 1 -- 172.21.15.42:0/3049389058 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b8c147280 con 0x7f1b8c1f9340 2024-09-17T01:38:31.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.817+0000 7f1b91c00640 1 --2- 172.21.15.42:0/3049389058 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b8c15ac00 0x7f1b8c15b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:31.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.818+0000 7f1b8be00640 1 --2- 172.21.15.42:0/3049389058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b8c1f9340 0x7f1b8c1f9750 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800c430 tx=0x7f1b78001d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:31.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.818+0000 7f1b88c00640 1 -- 172.21.15.42:0/3049389058 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78031040 con 0x7f1b8c1f9340 2024-09-17T01:38:31.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.818+0000 7f1b88c00640 1 -- 172.21.15.42:0/3049389058 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b780035f0 con 0x7f1b8c1f9340 2024-09-17T01:38:31.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.818+0000 7f1b88c00640 1 -- 172.21.15.42:0/3049389058 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78003a20 con 0x7f1b8c1f9340 2024-09-17T01:38:31.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.818+0000 7f1b93c00640 1 -- 172.21.15.42:0/3049389058 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b8c1589c0 con 0x7f1b8c1f9340 2024-09-17T01:38:31.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.818+0000 7f1b93c00640 1 -- 172.21.15.42:0/3049389058 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b8c158c80 con 0x7f1b8c1f9340 2024-09-17T01:38:31.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.819+0000 7f1b93c00640 1 -- 172.21.15.42:0/3049389058 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b8c15e330 con 0x7f1b8c1f9340 2024-09-17T01:38:31.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.820+0000 7f1b88c00640 1 -- 172.21.15.42:0/3049389058 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1b78034070 con 0x7f1b8c1f9340 2024-09-17T01:38:31.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.821+0000 7f1b88c00640 1 --2- 172.21.15.42:0/3049389058 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b6c078b90 0x7f1b6c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:31.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.821+0000 7f1b88c00640 1 -- 172.21.15.42:0/3049389058 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5029+0+0 (secure 0 0 0) 0x7f1b780ba4a0 con 0x7f1b8c1f9340 2024-09-17T01:38:31.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.822+0000 7f1b91200640 1 --2- 172.21.15.42:0/3049389058 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b6c078b90 0x7f1b6c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:31.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.823+0000 7f1b91200640 1 --2- 172.21.15.42:0/3049389058 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b6c078b90 0x7f1b6c07b0a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c077840 tx=0x7f1b80005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:31.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:31.826+0000 7f1b88c00640 1 -- 172.21.15.42:0/3049389058 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1b8c15e330 con 0x7f1b8c1f9340 2024-09-17T01:38:32.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.055+0000 7f1b93c00640 1 -- 172.21.15.42:0/3049389058 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b8c0b5a00 con 0x7f1b8c1f9340 2024-09-17T01:38:32.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.056+0000 7f1b88c00640 1 -- 172.21.15.42:0/3049389058 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+3911 (secure 0 0 0) 0x7f1b8c0b5a00 con 0x7f1b8c1f9340 2024-09-17T01:38:32.054 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:38:32.054 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":81,"btime":"2024-09-17T01:38:24:254837+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3191013971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":3191013971},{"type":"v1","addr":"172.21.15.43:6837","nonce":3191013971}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7042,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2889481399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2889481399},{"type":"v1","addr":"172.21.15.43:6835","nonce":2889481399}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7051,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1913337319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1913337319},{"type":"v1","addr":"172.21.15.42:6835","nonce":1913337319}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7560,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/2898705797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2898705797},{"type":"v1","addr":"172.21.15.42:6834","nonce":2898705797}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[]} 2024-09-17T01:38:32.054 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 81 2024-09-17T01:38:32.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.058+0000 7f1b93c00640 1 -- 172.21.15.42:0/3049389058 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b6c078b90 msgr2=0x7f1b6c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:32.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.058+0000 7f1b93c00640 1 --2- 172.21.15.42:0/3049389058 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b6c078b90 0x7f1b6c07b0a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c077840 tx=0x7f1b80005f90 comp rx=0 tx=0).stop 2024-09-17T01:38:32.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.058+0000 7f1b93c00640 1 -- 172.21.15.42:0/3049389058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b8c1f9340 msgr2=0x7f1b8c1f9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:32.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.058+0000 7f1b93c00640 1 --2- 172.21.15.42:0/3049389058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b8c1f9340 0x7f1b8c1f9750 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800c430 tx=0x7f1b78001d60 comp rx=0 tx=0).stop 2024-09-17T01:38:32.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.058+0000 7f1b93c00640 1 -- 172.21.15.42:0/3049389058 shutdown_connections 2024-09-17T01:38:32.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.059+0000 7f1b93c00640 1 --2- 172.21.15.42:0/3049389058 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b6c078b90 0x7f1b6c07b0a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:32.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.059+0000 7f1b93c00640 1 --2- 172.21.15.42:0/3049389058 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b8c15ac00 0x7f1b8c15b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:32.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.059+0000 7f1b93c00640 1 --2- 172.21.15.42:0/3049389058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b8c1f9340 0x7f1b8c1f9750 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:32.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.059+0000 7f1b93c00640 1 --2- 172.21.15.42:0/3049389058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b74004800 0x7f1b8c146d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:32.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.059+0000 7f1b93c00640 1 -- 172.21.15.42:0/3049389058 >> 172.21.15.42:0/3049389058 conn(0x7f1b8c0b2930 msgr2=0x7f1b8c0cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:32.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.059+0000 7f1b93c00640 1 -- 172.21.15.42:0/3049389058 shutdown_connections 2024-09-17T01:38:32.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.059+0000 7f1b93c00640 1 -- 172.21.15.42:0/3049389058 wait complete. 2024-09-17T01:38:32.080 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T01:38:32.080 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T01:38:32.080 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T01:38:32.080 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:38:32.080 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T01:38:32.081 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T01:38:32.081 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T01:38:32.081 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:38:32.081 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T01:38:32.081 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T01:38:32.081 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T01:38:32.081 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:38:32.082 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T01:38:32.082 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T01:38:32.082 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T01:38:32.082 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:38:32.106 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T01:38:32.107 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T01:38:32.108 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T01:38:32.108 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T01:38:32.109 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T01:38:32.109 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T01:38:32.110 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T01:38:32.110 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T01:38:32.152 INFO:tasks.ceph.mds.a:Started 2024-09-17T01:38:32.152 DEBUG:teuthology.parallel:result is None 2024-09-17T01:38:32.153 INFO:tasks.ceph.mds.b:Started 2024-09-17T01:38:32.153 DEBUG:teuthology.parallel:result is None 2024-09-17T01:38:32.154 INFO:tasks.ceph.mds.c:Started 2024-09-17T01:38:32.154 DEBUG:teuthology.parallel:result is None 2024-09-17T01:38:32.156 INFO:tasks.ceph.mds.d:Started 2024-09-17T01:38:32.156 DEBUG:teuthology.parallel:result is None 2024-09-17T01:38:32.156 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T01:38:32.352 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:38:32.352 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:38:32.359 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-09-17T01:38:32.360 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-09-17T01:38:32.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.396+0000 7f6dcd200640 1 -- 172.21.15.42:0/1733209105 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dc815eb60 msgr2=0x7f6dc80d11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:32.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.396+0000 7f6dcd200640 1 --2- 172.21.15.42:0/1733209105 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dc815eb60 0x7f6dc80d11f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80b3690 tx=0x7f6db402a4b0 comp rx=0 tx=0).stop 2024-09-17T01:38:32.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.396+0000 7f6dcd200640 1 -- 172.21.15.42:0/1733209105 shutdown_connections 2024-09-17T01:38:32.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.396+0000 7f6dcd200640 1 --2- 172.21.15.42:0/1733209105 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dc815eb60 0x7f6dc80d11f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:32.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.396+0000 7f6dcd200640 1 --2- 172.21.15.42:0/1733209105 >> v2:172.21.15.42:3300/0 conn(0x7f6dc80cf360 0x7f6dc80b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:32.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.396+0000 7f6dcd200640 1 -- 172.21.15.42:0/1733209105 >> 172.21.15.42:0/1733209105 conn(0x7f6dc806cd20 msgr2=0x7f6dc806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:32.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.396+0000 7f6dcd200640 1 -- 172.21.15.42:0/1733209105 shutdown_connections 2024-09-17T01:38:32.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.396+0000 7f6dcd200640 1 -- 172.21.15.42:0/1733209105 wait complete. 2024-09-17T01:38:32.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.398+0000 7f6dcd200640 1 Processor -- start 2024-09-17T01:38:32.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.399+0000 7f6dcd200640 1 -- start start 2024-09-17T01:38:32.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.400+0000 7f6dcd200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6dc80cf360 0x7f6dc8158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:32.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.400+0000 7f6dcd200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dc80d1730 0x7f6dc81f9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:32.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.400+0000 7f6dcd200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6dc815eb60 0x7f6dc81616a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:32.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.400+0000 7f6dcd200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc815f0f0 con 0x7f6dc80cf360 2024-09-17T01:38:32.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.400+0000 7f6dcd200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc815ef70 con 0x7f6dc80d1730 2024-09-17T01:38:32.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.400+0000 7f6dcd200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc80b6970 con 0x7f6dc815eb60 2024-09-17T01:38:32.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.400+0000 7f6dc5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6dc80cf360 0x7f6dc8158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:32.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.400+0000 7f6dc5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6dc80cf360 0x7f6dc8158f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57982/0 (socket says 172.21.15.42:57982) 2024-09-17T01:38:32.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.400+0000 7f6dc5e00640 1 -- 172.21.15.42:0/3132123690 learned_addr learned my addr 172.21.15.42:0/3132123690 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:32.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.401+0000 7f6dc5400640 1 --2- 172.21.15.42:0/3132123690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dc80d1730 0x7f6dc81f9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:32.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.401+0000 7f6dc5e00640 1 -- 172.21.15.42:0/3132123690 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6dc815eb60 msgr2=0x7f6dc81616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:32.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.401+0000 7f6dc6800640 1 --2- 172.21.15.42:0/3132123690 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6dc815eb60 0x7f6dc81616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:32.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.401+0000 7f6dc5e00640 1 --2- 172.21.15.42:0/3132123690 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6dc815eb60 0x7f6dc81616a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:32.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.401+0000 7f6dc5e00640 1 -- 172.21.15.42:0/3132123690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dc80d1730 msgr2=0x7f6dc81f9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:32.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.401+0000 7f6dc5e00640 1 --2- 172.21.15.42:0/3132123690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dc80d1730 0x7f6dc81f9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:32.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.401+0000 7f6dc5e00640 1 -- 172.21.15.42:0/3132123690 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc81f5c30 con 0x7f6dc80cf360 2024-09-17T01:38:32.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.401+0000 7f6dc5400640 1 --2- 172.21.15.42:0/3132123690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dc80d1730 0x7f6dc81f9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:38:32.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.401+0000 7f6dc6800640 1 --2- 172.21.15.42:0/3132123690 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6dc815eb60 0x7f6dc81616a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:38:32.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.401+0000 7f6dc5e00640 1 --2- 172.21.15.42:0/3132123690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6dc80cf360 0x7f6dc8158f10 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f6db800e9f0 tx=0x7f6db800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:32.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.401+0000 7f6dbe000640 1 -- 172.21.15.42:0/3132123690 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db800cd80 con 0x7f6dc80cf360 2024-09-17T01:38:32.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.401+0000 7f6dbe000640 1 -- 172.21.15.42:0/3132123690 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6db8004020 con 0x7f6dc80cf360 2024-09-17T01:38:32.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.401+0000 7f6dbe000640 1 -- 172.21.15.42:0/3132123690 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db8004470 con 0x7f6dc80cf360 2024-09-17T01:38:32.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.402+0000 7f6dcd200640 1 -- 172.21.15.42:0/3132123690 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc81f5f10 con 0x7f6dc80cf360 2024-09-17T01:38:32.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.402+0000 7f6dcd200640 1 -- 172.21.15.42:0/3132123690 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc81f64d0 con 0x7f6dc80cf360 2024-09-17T01:38:32.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.403+0000 7f6dcd200640 1 -- 172.21.15.42:0/3132123690 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dc80b6e20 con 0x7f6dc80cf360 2024-09-17T01:38:32.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.404+0000 7f6dbe000640 1 -- 172.21.15.42:0/3132123690 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6db80035f0 con 0x7f6dc80cf360 2024-09-17T01:38:32.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.405+0000 7f6dbe000640 1 --2- 172.21.15.42:0/3132123690 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6da8078b90 0x7f6da807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:32.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.405+0000 7f6dbe000640 1 -- 172.21.15.42:0/3132123690 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5029+0+0 (secure 0 0 0) 0x7f6db809b690 con 0x7f6dc80cf360 2024-09-17T01:38:32.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.406+0000 7f6dc5400640 1 --2- 172.21.15.42:0/3132123690 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6da8078b90 0x7f6da807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:32.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.406+0000 7f6dc5400640 1 --2- 172.21.15.42:0/3132123690 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6da8078b90 0x7f6da807b0a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6db4034000 tx=0x7f6db4004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:32.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.409+0000 7f6dbe000640 1 -- 172.21.15.42:0/3132123690 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6db8063cd0 con 0x7f6dc80cf360 2024-09-17T01:38:32.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:32.615+0000 7f6dcd200640 1 -- 172.21.15.42:0/3132123690 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f6dc815cd30 con 0x7f6dc80cf360 2024-09-17T01:38:33.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.304+0000 7f6dbe000640 1 -- 172.21.15.42:0/3132123690 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v102) ==== 97+0+0 (secure 0 0 0) 0x7f6db80635d0 con 0x7f6dc80cf360 2024-09-17T01:38:33.303 INFO:teuthology.orchestra.run.smithi042.stderr: removed all blocklist entries 2024-09-17T01:38:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.308+0000 7f6dcd200640 1 -- 172.21.15.42:0/3132123690 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6da8078b90 msgr2=0x7f6da807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.308+0000 7f6dcd200640 1 --2- 172.21.15.42:0/3132123690 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6da8078b90 0x7f6da807b0a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6db4034000 tx=0x7f6db4004730 comp rx=0 tx=0).stop 2024-09-17T01:38:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.308+0000 7f6dcd200640 1 -- 172.21.15.42:0/3132123690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6dc80cf360 msgr2=0x7f6dc8158f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.308+0000 7f6dcd200640 1 --2- 172.21.15.42:0/3132123690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6dc80cf360 0x7f6dc8158f10 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f6db800e9f0 tx=0x7f6db800eeb0 comp rx=0 tx=0).stop 2024-09-17T01:38:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.309+0000 7f6dcd200640 1 -- 172.21.15.42:0/3132123690 shutdown_connections 2024-09-17T01:38:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.309+0000 7f6dcd200640 1 --2- 172.21.15.42:0/3132123690 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6da8078b90 0x7f6da807b0a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.309+0000 7f6dcd200640 1 --2- 172.21.15.42:0/3132123690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6dc80d1730 0x7f6dc81f9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.309+0000 7f6dcd200640 1 --2- 172.21.15.42:0/3132123690 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6dc815eb60 0x7f6dc81616a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.309+0000 7f6dcd200640 1 --2- 172.21.15.42:0/3132123690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6dc80cf360 0x7f6dc8158f10 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.309+0000 7f6dcd200640 1 -- 172.21.15.42:0/3132123690 >> 172.21.15.42:0/3132123690 conn(0x7f6dc806cd20 msgr2=0x7f6dc80d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.309+0000 7f6dcd200640 1 -- 172.21.15.42:0/3132123690 shutdown_connections 2024-09-17T01:38:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.309+0000 7f6dcd200640 1 -- 172.21.15.42:0/3132123690 wait complete. 2024-09-17T01:38:33.338 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T01:38:33.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.573+0000 7f004fe00640 1 -- 172.21.15.42:0/716854070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0034004d40 msgr2=0x7f00340051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:33.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.573+0000 7f004fe00640 1 --2- 172.21.15.42:0/716854070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0034004d40 0x7f00340051f0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f0048009ed0 tx=0x7f0034005830 comp rx=0 tx=0).stop 2024-09-17T01:38:33.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.573+0000 7f004f400640 1 -- 172.21.15.42:0/716854070 reap_dead start 2024-09-17T01:38:33.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.573+0000 7f004fe00640 1 -- 172.21.15.42:0/716854070 shutdown_connections 2024-09-17T01:38:33.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.573+0000 7f004fe00640 1 -- 172.21.15.42:0/716854070 >> 172.21.15.42:0/716854070 conn(0x7f00500d1210 msgr2=0x7f00500d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:33.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.573+0000 7f004fe00640 1 -- 172.21.15.42:0/716854070 shutdown_connections 2024-09-17T01:38:33.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.573+0000 7f004fe00640 1 -- 172.21.15.42:0/716854070 wait complete. 2024-09-17T01:38:33.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.575+0000 7f004fe00640 1 Processor -- start 2024-09-17T01:38:33.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.575+0000 7f004fe00640 1 -- start start 2024-09-17T01:38:33.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.577+0000 7f004fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0034004d40 0x7f005014a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:33.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.577+0000 7f004fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00501575c0 0x7f00500c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:33.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.577+0000 7f004fe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f00500b8ba0 0x7f00500b8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:33.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.577+0000 7f004fe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f005015f4c0 con 0x7f00501575c0 2024-09-17T01:38:33.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.577+0000 7f004fe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f00500b6760 con 0x7f0034004d40 2024-09-17T01:38:33.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.577+0000 7f004fe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f005015f640 con 0x7f00500b8ba0 2024-09-17T01:38:33.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.577+0000 7f004e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00501575c0 0x7f00500c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:33.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.577+0000 7f004e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00501575c0 0x7f00500c9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58010/0 (socket says 172.21.15.42:58010) 2024-09-17T01:38:33.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.577+0000 7f004e000640 1 -- 172.21.15.42:0/1661219444 learned_addr learned my addr 172.21.15.42:0/1661219444 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:33.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.577+0000 7f004ea00640 1 --2- 172.21.15.42:0/1661219444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0034004d40 0x7f005014a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:33.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.577+0000 7f004f400640 1 --2- 172.21.15.42:0/1661219444 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f00500b8ba0 0x7f00500b8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:33.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.578+0000 7f004e000640 1 -- 172.21.15.42:0/1661219444 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f00500b8ba0 msgr2=0x7f00500b8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:33.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.578+0000 7f004e000640 1 --2- 172.21.15.42:0/1661219444 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f00500b8ba0 0x7f00500b8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:33.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.578+0000 7f004e000640 1 -- 172.21.15.42:0/1661219444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0034004d40 msgr2=0x7f005014a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:33.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.578+0000 7f004e000640 1 --2- 172.21.15.42:0/1661219444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0034004d40 0x7f005014a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:33.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.578+0000 7f004e000640 1 -- 172.21.15.42:0/1661219444 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00500b94f0 con 0x7f00501575c0 2024-09-17T01:38:33.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.578+0000 7f004e000640 1 --2- 172.21.15.42:0/1661219444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00501575c0 0x7f00500c9ae0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f003c003f50 tx=0x7f003c0016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:33.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.578+0000 7f0046a00640 1 -- 172.21.15.42:0/1661219444 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003c011640 con 0x7f00501575c0 2024-09-17T01:38:33.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.578+0000 7f0046a00640 1 -- 172.21.15.42:0/1661219444 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f003c016020 con 0x7f00501575c0 2024-09-17T01:38:33.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.578+0000 7f0046a00640 1 -- 172.21.15.42:0/1661219444 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003c011a60 con 0x7f00501575c0 2024-09-17T01:38:33.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.578+0000 7f004fe00640 1 -- 172.21.15.42:0/1661219444 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00501f5770 con 0x7f00501575c0 2024-09-17T01:38:33.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.578+0000 7f004fe00640 1 -- 172.21.15.42:0/1661219444 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00501f94d0 con 0x7f00501575c0 2024-09-17T01:38:33.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.579+0000 7f004fe00640 1 -- 172.21.15.42:0/1661219444 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00501f8f60 con 0x7f00501575c0 2024-09-17T01:38:33.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.581+0000 7f0046a00640 1 -- 172.21.15.42:0/1661219444 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f003c011c00 con 0x7f00501575c0 2024-09-17T01:38:33.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.582+0000 7f0046a00640 1 --2- 172.21.15.42:0/1661219444 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0030078bc0 0x7f003007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:33.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.582+0000 7f0046a00640 1 -- 172.21.15.42:0/1661219444 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 4857+0+0 (secure 0 0 0) 0x7f003c09b570 con 0x7f00501575c0 2024-09-17T01:38:33.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.583+0000 7f004ea00640 1 --2- 172.21.15.42:0/1661219444 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0030078bc0 0x7f003007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:33.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.584+0000 7f004ea00640 1 --2- 172.21.15.42:0/1661219444 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0030078bc0 0x7f003007b0d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0040000fb0 tx=0x7f0040006970 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:33.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.587+0000 7f0046a00640 1 -- 172.21.15.42:0/1661219444 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f003c020020 con 0x7f00501575c0 2024-09-17T01:38:33.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.855+0000 7f004fe00640 1 -- 172.21.15.42:0/1661219444 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f0050162fa0 con 0x7f00501575c0 2024-09-17T01:38:33.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.856+0000 7f0046a00640 1 -- 172.21.15.42:0/1661219444 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v33) ==== 80+0+5304 (secure 0 0 0) 0x7f00500b94f0 con 0x7f00501575c0 2024-09-17T01:38:33.854 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:38:33.854 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:38:33.854 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_dump": [ 2024-09-17T01:38:33.854 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:38:33.854 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.a", 2024-09-17T01:38:33.854 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmyJK4HRAAIC4E4V7p1fqIEfPIICMxZg==", 2024-09-17T01:38:33.854 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:38:33.855 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:38:33.855 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:38:33.855 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:38:33.855 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:38:33.855 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:38:33.855 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:38:33.855 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:38:33.855 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.b", 2024-09-17T01:38:33.855 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmXv3vORAALPrYIM6Vtz0g1pOxVhrUig==", 2024-09-17T01:38:33.855 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:38:33.855 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:38:33.855 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:38:33.855 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:38:33.856 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:38:33.856 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:38:33.856 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:38:33.856 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:38:33.856 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.c", 2024-09-17T01:38:33.856 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmPE7MKxAA9mGG+EO9C3VGVMerOm92+Q==", 2024-09-17T01:38:33.856 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:38:33.856 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:38:33.856 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:38:33.856 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:38:33.856 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:38:33.857 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:38:33.857 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:38:33.857 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:38:33.857 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.d", 2024-09-17T01:38:33.857 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmaOBSDBAATU4tpjM5IMcuvzZFE7N5bQ==", 2024-09-17T01:38:33.857 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:38:33.857 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:38:33.857 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:38:33.857 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:38:33.857 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:38:33.857 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:38:33.857 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:38:33.857 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:38:33.858 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.0", 2024-09-17T01:38:33.858 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDP2+hmEJebExAAAdGEoSzM96ybGT9h7t7OkA==", 2024-09-17T01:38:33.858 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:38:33.858 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:38:33.858 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:38:33.858 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:38:33.858 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:38:33.858 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:38:33.858 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:38:33.858 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.1", 2024-09-17T01:38:33.858 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDS2+hm7dWoMBAAagktrUl0O2/mgKCEfpAstA==", 2024-09-17T01:38:33.858 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:38:33.858 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:38:33.859 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:38:33.859 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:38:33.859 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:38:33.859 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:38:33.859 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:38:33.859 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.2", 2024-09-17T01:38:33.859 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDW2+hmEfSPBBAAPAa6EZt27yUcJSfZyCKheg==", 2024-09-17T01:38:33.859 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:38:33.859 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:38:33.859 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:38:33.860 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:38:33.860 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:38:33.860 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:38:33.860 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:38:33.860 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.3", 2024-09-17T01:38:33.860 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDZ2+hmHQhXFRAAj84g+IKqH6KMP7LjRtFvLw==", 2024-09-17T01:38:33.860 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:38:33.860 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:38:33.860 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:38:33.860 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:38:33.860 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:38:33.860 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:38:33.861 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:38:33.861 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.4", 2024-09-17T01:38:33.861 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDd2+hmaNcMNBAAx1GV/oFdfssMjFWFN5M0VQ==", 2024-09-17T01:38:33.861 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:38:33.861 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:38:33.861 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:38:33.861 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:38:33.861 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:38:33.861 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:38:33.861 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:38:33.861 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.5", 2024-09-17T01:38:33.861 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDh2+hm301NJhAAnSUH5AAvqhPwM7loH6frww==", 2024-09-17T01:38:33.861 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:38:33.861 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:38:33.862 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:38:33.862 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:38:33.862 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:38:33.862 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:38:33.862 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:38:33.862 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.6", 2024-09-17T01:38:33.862 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDk2+hm61WNNRAAbCvVvsUpB4fgt4ja60DRZA==", 2024-09-17T01:38:33.862 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:38:33.862 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:38:33.862 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:38:33.862 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:38:33.862 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:38:33.862 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:38:33.863 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:38:33.863 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.7", 2024-09-17T01:38:33.864 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDo2+hmesiLFhAA29n1eageNvP+lkRyh6gGMw==", 2024-09-17T01:38:33.864 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:38:33.864 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:38:33.864 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:38:33.864 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:38:33.864 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:38:33.864 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:38:33.864 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:38:33.865 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.0", 2024-09-17T01:38:33.865 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA==", 2024-09-17T01:38:33.865 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:38:33.865 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:38:33.865 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow r", 2024-09-17T01:38:33.865 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T01:38:33.865 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:38:33.865 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:38:33.865 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:38:33.865 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.1", 2024-09-17T01:38:33.865 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmZLygLhAABlauZgnidFWvfCCPuBLObg==", 2024-09-17T01:38:33.865 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:38:33.865 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:38:33.866 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:38:33.866 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:38:33.866 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:38:33.866 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:38:33.866 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:38:33.866 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:38:33.866 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.2", 2024-09-17T01:38:33.866 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hm8lnZIxAAN0a2CVMMtu/Nz50OG4a02A==", 2024-09-17T01:38:33.866 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:38:33.866 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:38:33.866 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:38:33.866 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:38:33.866 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:38:33.867 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:38:33.867 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:38:33.867 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:38:33.867 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.3", 2024-09-17T01:38:33.867 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmgXdAORAAM5Uy66I4nnTJ9Vhkn9JoBw==", 2024-09-17T01:38:33.867 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:38:33.867 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:38:33.867 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:38:33.867 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:38:33.867 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:38:33.867 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:38:33.867 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:38:33.867 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:38:33.867 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.admin", 2024-09-17T01:38:33.868 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDL2+hmvCreHBAA4CSAhosssViGqD93U+I7Iw==", 2024-09-17T01:38:33.868 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:38:33.868 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:38:33.868 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:38:33.868 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:38:33.868 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:38:33.868 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:38:33.868 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:38:33.868 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:38:33.868 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.x", 2024-09-17T01:38:33.868 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmYPnlEhAAIcQ11ktWZyMXYdbAONiLog==", 2024-09-17T01:38:33.868 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:38:33.868 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:38:33.869 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:38:33.869 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:38:33.869 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:38:33.869 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:38:33.869 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:38:33.869 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.y", 2024-09-17T01:38:33.869 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmpCZtBxAAp5tXMc6aEq1aOny2LJZAiA==", 2024-09-17T01:38:33.869 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:38:33.869 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:38:33.869 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:38:33.869 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:38:33.869 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:38:33.869 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:38:33.869 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-17T01:38:33.870 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:38:33.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.858+0000 7f004fe00640 1 -- 172.21.15.42:0/1661219444 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0030078bc0 msgr2=0x7f003007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.858+0000 7f004fe00640 1 --2- 172.21.15.42:0/1661219444 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0030078bc0 0x7f003007b0d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0040000fb0 tx=0x7f0040006970 comp rx=0 tx=0).stop 2024-09-17T01:38:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.858+0000 7f004fe00640 1 -- 172.21.15.42:0/1661219444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00501575c0 msgr2=0x7f00500c9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.858+0000 7f004fe00640 1 --2- 172.21.15.42:0/1661219444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00501575c0 0x7f00500c9ae0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f003c003f50 tx=0x7f003c0016f0 comp rx=0 tx=0).stop 2024-09-17T01:38:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.859+0000 7f004fe00640 1 -- 172.21.15.42:0/1661219444 shutdown_connections 2024-09-17T01:38:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.859+0000 7f004fe00640 1 --2- 172.21.15.42:0/1661219444 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0030078bc0 0x7f003007b0d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.859+0000 7f004fe00640 1 --2- 172.21.15.42:0/1661219444 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f00500b8ba0 0x7f00500b8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.859+0000 7f004fe00640 1 --2- 172.21.15.42:0/1661219444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00501575c0 0x7f00500c9ae0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.859+0000 7f004fe00640 1 --2- 172.21.15.42:0/1661219444 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0034004d40 0x7f005014a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.859+0000 7f004fe00640 1 -- 172.21.15.42:0/1661219444 >> 172.21.15.42:0/1661219444 conn(0x7f00500d1210 msgr2=0x7f00501624f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.859+0000 7f004fe00640 1 -- 172.21.15.42:0/1661219444 shutdown_connections 2024-09-17T01:38:33.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:33.859+0000 7f004fe00640 1 -- 172.21.15.42:0/1661219444 wait complete. 2024-09-17T01:38:33.880 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T01:38:34.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.112+0000 7f127e800640 1 -- 172.21.15.42:0/3574583505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f127806ee90 msgr2=0x7f127815f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:34.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.112+0000 7f127e800640 1 --2- 172.21.15.42:0/3574583505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f127806ee90 0x7f127815f200 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1268005fd0 tx=0x7f126802a540 comp rx=0 tx=0).stop 2024-09-17T01:38:34.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.113+0000 7f127e800640 1 -- 172.21.15.42:0/3574583505 shutdown_connections 2024-09-17T01:38:34.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.113+0000 7f127e800640 1 --2- 172.21.15.42:0/3574583505 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1278073df0 0x7f1278074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:34.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.113+0000 7f127e800640 1 --2- 172.21.15.42:0/3574583505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f127806ee90 0x7f127815f200 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:34.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.113+0000 7f127e800640 1 -- 172.21.15.42:0/3574583505 >> 172.21.15.42:0/3574583505 conn(0x7f12780b2930 msgr2=0x7f127806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:34.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.113+0000 7f127e800640 1 -- 172.21.15.42:0/3574583505 shutdown_connections 2024-09-17T01:38:34.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.113+0000 7f127e800640 1 -- 172.21.15.42:0/3574583505 wait complete. 2024-09-17T01:38:34.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.115+0000 7f127e800640 1 Processor -- start 2024-09-17T01:38:34.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.115+0000 7f127e800640 1 -- start start 2024-09-17T01:38:34.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.116+0000 7f127e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f127806ee90 0x7f1278144f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:34.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.116+0000 7f127e800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f127806f2a0 0x7f1278159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:34.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.116+0000 7f127e800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1278073df0 0x7f1278144630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:34.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.116+0000 7f127e800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f12780cef40 con 0x7f127806ee90 2024-09-17T01:38:34.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.116+0000 7f127e800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1278162ae0 con 0x7f1278073df0 2024-09-17T01:38:34.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.116+0000 7f127e800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f12780cf0c0 con 0x7f127806f2a0 2024-09-17T01:38:34.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.117+0000 7f1277400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f127806ee90 0x7f1278144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:34.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.117+0000 7f1277400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f127806ee90 0x7f1278144f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58022/0 (socket says 172.21.15.42:58022) 2024-09-17T01:38:34.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.117+0000 7f1277400640 1 -- 172.21.15.42:0/4265235132 learned_addr learned my addr 172.21.15.42:0/4265235132 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:34.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.117+0000 7f126fe00640 1 --2- 172.21.15.42:0/4265235132 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f127806f2a0 0x7f1278159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:34.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.117+0000 7f1277e00640 1 --2- 172.21.15.42:0/4265235132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1278073df0 0x7f1278144630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:34.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.117+0000 7f1277400640 1 -- 172.21.15.42:0/4265235132 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f127806f2a0 msgr2=0x7f1278159b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:34.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.117+0000 7f1277400640 1 --2- 172.21.15.42:0/4265235132 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f127806f2a0 0x7f1278159b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:34.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.117+0000 7f1277400640 1 -- 172.21.15.42:0/4265235132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1278073df0 msgr2=0x7f1278144630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:34.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.117+0000 7f1277400640 1 --2- 172.21.15.42:0/4265235132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1278073df0 0x7f1278144630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:34.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.117+0000 7f1277400640 1 -- 172.21.15.42:0/4265235132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127815a0c0 con 0x7f127806ee90 2024-09-17T01:38:34.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.118+0000 7f1277400640 1 --2- 172.21.15.42:0/4265235132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f127806ee90 0x7f1278144f60 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f1268034040 tx=0x7f12680038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:34.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.118+0000 7f126f400640 1 -- 172.21.15.42:0/4265235132 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126803e030 con 0x7f127806ee90 2024-09-17T01:38:34.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.118+0000 7f126f400640 1 -- 172.21.15.42:0/4265235132 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1268003ca0 con 0x7f127806ee90 2024-09-17T01:38:34.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.118+0000 7f126f400640 1 -- 172.21.15.42:0/4265235132 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1268035040 con 0x7f127806ee90 2024-09-17T01:38:34.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.118+0000 7f127e800640 1 -- 172.21.15.42:0/4265235132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12781f9770 con 0x7f127806ee90 2024-09-17T01:38:34.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.118+0000 7f127e800640 1 -- 172.21.15.42:0/4265235132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12781f9d30 con 0x7f127806ee90 2024-09-17T01:38:34.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.119+0000 7f127e800640 1 -- 172.21.15.42:0/4265235132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f127815f200 con 0x7f127806ee90 2024-09-17T01:38:34.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.120+0000 7f126f400640 1 -- 172.21.15.42:0/4265235132 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1268041030 con 0x7f127806ee90 2024-09-17T01:38:34.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.121+0000 7f126f400640 1 --2- 172.21.15.42:0/4265235132 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1254078b90 0x7f125407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:34.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.121+0000 7f126f400640 1 -- 172.21.15.42:0/4265235132 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 4857+0+0 (secure 0 0 0) 0x7f12680bb030 con 0x7f127806ee90 2024-09-17T01:38:34.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.122+0000 7f126fe00640 1 --2- 172.21.15.42:0/4265235132 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1254078b90 0x7f125407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:34.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.122+0000 7f126fe00640 1 --2- 172.21.15.42:0/4265235132 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1254078b90 0x7f125407b0a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1260001720 tx=0x7f1260009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:34.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.126+0000 7f126f400640 1 -- 172.21.15.42:0/4265235132 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f12680830d0 con 0x7f127806ee90 2024-09-17T01:38:34.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.323+0000 7f127e800640 1 -- 172.21.15.42:0/4265235132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f127806a170 con 0x7f127806ee90 2024-09-17T01:38:34.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.323+0000 7f126f400640 1 -- 172.21.15.42:0/4265235132 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v104) ==== 84+0+65 (secure 0 0 0) 0x7f1268087b00 con 0x7f127806ee90 2024-09-17T01:38:34.321 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:38:34.321 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-09-17T01:38:34.322 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:38:34.322 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-09-17T01:38:34.322 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-09-17T01:38:34.322 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:38:34.322 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-09-17T01:38:34.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.326+0000 7f127e800640 1 -- 172.21.15.42:0/4265235132 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1254078b90 msgr2=0x7f125407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:34.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.326+0000 7f127e800640 1 --2- 172.21.15.42:0/4265235132 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1254078b90 0x7f125407b0a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1260001720 tx=0x7f1260009040 comp rx=0 tx=0).stop 2024-09-17T01:38:34.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.326+0000 7f127e800640 1 -- 172.21.15.42:0/4265235132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f127806ee90 msgr2=0x7f1278144f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:34.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.326+0000 7f127e800640 1 --2- 172.21.15.42:0/4265235132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f127806ee90 0x7f1278144f60 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f1268034040 tx=0x7f12680038a0 comp rx=0 tx=0).stop 2024-09-17T01:38:34.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.326+0000 7f127e800640 1 -- 172.21.15.42:0/4265235132 shutdown_connections 2024-09-17T01:38:34.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.326+0000 7f127e800640 1 --2- 172.21.15.42:0/4265235132 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1254078b90 0x7f125407b0a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:34.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.326+0000 7f127e800640 1 --2- 172.21.15.42:0/4265235132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1278073df0 0x7f1278144630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:34.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.326+0000 7f127e800640 1 --2- 172.21.15.42:0/4265235132 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f127806f2a0 0x7f1278159b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:34.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.326+0000 7f127e800640 1 --2- 172.21.15.42:0/4265235132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f127806ee90 0x7f1278144f60 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:34.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.326+0000 7f127e800640 1 -- 172.21.15.42:0/4265235132 >> 172.21.15.42:0/4265235132 conn(0x7f12780b2930 msgr2=0x7f12780b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:34.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.326+0000 7f127e800640 1 -- 172.21.15.42:0/4265235132 shutdown_connections 2024-09-17T01:38:34.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.326+0000 7f127e800640 1 -- 172.21.15.42:0/4265235132 wait complete. 2024-09-17T01:38:34.345 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T01:38:34.345 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T01:38:34.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.581+0000 7f9812000640 1 -- 172.21.15.42:0/795172302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f980c0b56d0 msgr2=0x7f980c0b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:34.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.581+0000 7f9812000640 1 --2- 172.21.15.42:0/795172302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f980c0b56d0 0x7f980c0b46f0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f97fc009830 tx=0x7f97fc02a5c0 comp rx=0 tx=0).stop 2024-09-17T01:38:34.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.581+0000 7f9812000640 1 -- 172.21.15.42:0/795172302 shutdown_connections 2024-09-17T01:38:34.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.581+0000 7f9812000640 1 --2- 172.21.15.42:0/795172302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f980c0b56d0 0x7f980c0b46f0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:34.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.581+0000 7f9812000640 1 -- 172.21.15.42:0/795172302 >> 172.21.15.42:0/795172302 conn(0x7f980c0b28f0 msgr2=0x7f980c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:34.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.581+0000 7f9812000640 1 -- 172.21.15.42:0/795172302 shutdown_connections 2024-09-17T01:38:34.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.581+0000 7f9812000640 1 -- 172.21.15.42:0/795172302 wait complete. 2024-09-17T01:38:34.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.583+0000 7f9812000640 1 Processor -- start 2024-09-17T01:38:34.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.583+0000 7f9812000640 1 -- start start 2024-09-17T01:38:34.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.585+0000 7f9812000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f980c0b56d0 0x7f980c15ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:34.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.585+0000 7f9812000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f980c0cdb20 0x7f980c15bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:34.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.585+0000 7f9812000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f980c144740 0x7f980c144b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:34.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.585+0000 7f9812000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f980c15dcf0 con 0x7f980c0cdb20 2024-09-17T01:38:34.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.585+0000 7f9812000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f980c15db70 con 0x7f980c0b56d0 2024-09-17T01:38:34.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.585+0000 7f9812000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f980c0cdf30 con 0x7f980c144740 2024-09-17T01:38:34.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.585+0000 7f980aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f980c0cdb20 0x7f980c15bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:34.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.585+0000 7f980aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f980c0cdb20 0x7f980c15bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58034/0 (socket says 172.21.15.42:58034) 2024-09-17T01:38:34.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.585+0000 7f980aa00640 1 -- 172.21.15.42:0/1735832489 learned_addr learned my addr 172.21.15.42:0/1735832489 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:34.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.585+0000 7f980b400640 1 --2- 172.21.15.42:0/1735832489 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f980c0b56d0 0x7f980c15ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:34.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.585+0000 7f980be00640 1 --2- 172.21.15.42:0/1735832489 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f980c144740 0x7f980c144b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:34.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.586+0000 7f980aa00640 1 -- 172.21.15.42:0/1735832489 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f980c144740 msgr2=0x7f980c144b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:34.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.586+0000 7f980aa00640 1 --2- 172.21.15.42:0/1735832489 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f980c144740 0x7f980c144b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:34.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.586+0000 7f980aa00640 1 -- 172.21.15.42:0/1735832489 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f980c0b56d0 msgr2=0x7f980c15ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:34.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.586+0000 7f980aa00640 1 --2- 172.21.15.42:0/1735832489 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f980c0b56d0 0x7f980c15ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:34.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.586+0000 7f980aa00640 1 -- 172.21.15.42:0/1735832489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f980c15f6a0 con 0x7f980c0cdb20 2024-09-17T01:38:34.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.586+0000 7f980aa00640 1 --2- 172.21.15.42:0/1735832489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f980c0cdb20 0x7f980c15bf40 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f97f800c370 tx=0x7f97f800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:34.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.586+0000 7f9803400640 1 -- 172.21.15.42:0/1735832489 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f8017070 con 0x7f980c0cdb20 2024-09-17T01:38:34.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.586+0000 7f9803400640 1 -- 172.21.15.42:0/1735832489 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97f80035f0 con 0x7f980c0cdb20 2024-09-17T01:38:34.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.586+0000 7f9812000640 1 -- 172.21.15.42:0/1735832489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f980c145090 con 0x7f980c0cdb20 2024-09-17T01:38:34.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.586+0000 7f9803400640 1 -- 172.21.15.42:0/1735832489 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f8003a40 con 0x7f980c0cdb20 2024-09-17T01:38:34.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.586+0000 7f9812000640 1 -- 172.21.15.42:0/1735832489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f980c15f190 con 0x7f980c0cdb20 2024-09-17T01:38:34.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.588+0000 7f9812000640 1 -- 172.21.15.42:0/1735832489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f980c0ccb30 con 0x7f980c0cdb20 2024-09-17T01:38:34.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.589+0000 7f9803400640 1 -- 172.21.15.42:0/1735832489 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f97f801a070 con 0x7f980c0cdb20 2024-09-17T01:38:34.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.590+0000 7f9803400640 1 --2- 172.21.15.42:0/1735832489 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f97ec078bc0 0x7f97ec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:34.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.590+0000 7f9803400640 1 -- 172.21.15.42:0/1735832489 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 4857+0+0 (secure 0 0 0) 0x7f97f8099cf0 con 0x7f980c0cdb20 2024-09-17T01:38:34.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.590+0000 7f980b400640 1 --2- 172.21.15.42:0/1735832489 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f97ec078bc0 0x7f97ec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:34.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.591+0000 7f980b400640 1 --2- 172.21.15.42:0/1735832489 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f97ec078bc0 0x7f97ec07b0d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f97fc034000 tx=0x7f97fc004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:34.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.594+0000 7f9803400640 1 -- 172.21.15.42:0/1735832489 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f980c145090 con 0x7f980c0cdb20 2024-09-17T01:38:34.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:34.789+0000 7f9812000640 1 -- 172.21.15.42:0/1735832489 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f980c15f430 con 0x7f980c0cdb20 2024-09-17T01:38:35.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.313+0000 7f9803400640 1 -- 172.21.15.42:0/1735832489 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v105) ==== 138+0+0 (secure 0 0 0) 0x7f97f8061d90 con 0x7f980c0cdb20 2024-09-17T01:38:35.311 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-09-17T01:38:35.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.316+0000 7f9812000640 1 -- 172.21.15.42:0/1735832489 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f97ec078bc0 msgr2=0x7f97ec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:35.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.316+0000 7f9812000640 1 --2- 172.21.15.42:0/1735832489 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f97ec078bc0 0x7f97ec07b0d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f97fc034000 tx=0x7f97fc004730 comp rx=0 tx=0).stop 2024-09-17T01:38:35.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.316+0000 7f9812000640 1 -- 172.21.15.42:0/1735832489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f980c0cdb20 msgr2=0x7f980c15bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:35.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.316+0000 7f9812000640 1 --2- 172.21.15.42:0/1735832489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f980c0cdb20 0x7f980c15bf40 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f97f800c370 tx=0x7f97f800c830 comp rx=0 tx=0).stop 2024-09-17T01:38:35.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.316+0000 7f9812000640 1 -- 172.21.15.42:0/1735832489 shutdown_connections 2024-09-17T01:38:35.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.316+0000 7f9812000640 1 --2- 172.21.15.42:0/1735832489 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f97ec078bc0 0x7f97ec07b0d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:35.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.316+0000 7f9812000640 1 --2- 172.21.15.42:0/1735832489 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f980c144740 0x7f980c144b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:35.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.316+0000 7f9812000640 1 --2- 172.21.15.42:0/1735832489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f980c0cdb20 0x7f980c15bf40 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:35.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.316+0000 7f9812000640 1 --2- 172.21.15.42:0/1735832489 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f980c0b56d0 0x7f980c15ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:35.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.316+0000 7f9812000640 1 -- 172.21.15.42:0/1735832489 >> 172.21.15.42:0/1735832489 conn(0x7f980c0b28f0 msgr2=0x7f980c13f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:35.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.317+0000 7f9812000640 1 -- 172.21.15.42:0/1735832489 shutdown_connections 2024-09-17T01:38:35.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.317+0000 7f9812000640 1 -- 172.21.15.42:0/1735832489 wait complete. 2024-09-17T01:38:35.346 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T01:38:35.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.583+0000 7fe93c800640 1 -- 172.21.15.42:0/3454361876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe934142f40 msgr2=0x7fe934072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:35.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.583+0000 7fe93c800640 1 --2- 172.21.15.42:0/3454361876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe934142f40 0x7fe934072950 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fe924009830 tx=0x7fe92402a480 comp rx=0 tx=0).stop 2024-09-17T01:38:35.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.583+0000 7fe93c800640 1 -- 172.21.15.42:0/3454361876 shutdown_connections 2024-09-17T01:38:35.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.583+0000 7fe93c800640 1 --2- 172.21.15.42:0/3454361876 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe934072e90 0x7fe9340cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:35.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.583+0000 7fe93c800640 1 --2- 172.21.15.42:0/3454361876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe934142f40 0x7fe934072950 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:35.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.583+0000 7fe93c800640 1 -- 172.21.15.42:0/3454361876 >> 172.21.15.42:0/3454361876 conn(0x7fe9340b2930 msgr2=0x7fe93406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:35.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.583+0000 7fe93c800640 1 -- 172.21.15.42:0/3454361876 shutdown_connections 2024-09-17T01:38:35.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.583+0000 7fe93c800640 1 -- 172.21.15.42:0/3454361876 wait complete. 2024-09-17T01:38:35.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.585+0000 7fe93c800640 1 Processor -- start 2024-09-17T01:38:35.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.585+0000 7fe93c800640 1 -- start start 2024-09-17T01:38:35.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.587+0000 7fe93c800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe934072e90 0x7fe93413ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:35.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.587+0000 7fe93c800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9340b3550 0x7fe9341f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:35.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.587+0000 7fe93c800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe934142f40 0x7fe934141480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:35.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.587+0000 7fe93c800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe93406d640 con 0x7fe934072e90 2024-09-17T01:38:35.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.587+0000 7fe93c800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe9340cf590 con 0x7fe9340b3550 2024-09-17T01:38:35.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.587+0000 7fe93c800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe93406d7c0 con 0x7fe934142f40 2024-09-17T01:38:35.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.587+0000 7fe939e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe934072e90 0x7fe93413ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:35.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.587+0000 7fe939e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe934072e90 0x7fe93413ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58048/0 (socket says 172.21.15.42:58048) 2024-09-17T01:38:35.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.587+0000 7fe939e00640 1 -- 172.21.15.42:0/2081056821 learned_addr learned my addr 172.21.15.42:0/2081056821 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:35.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.587+0000 7fe93a800640 1 --2- 172.21.15.42:0/2081056821 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe934142f40 0x7fe934141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:35.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.587+0000 7fe939400640 1 --2- 172.21.15.42:0/2081056821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9340b3550 0x7fe9341f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:35.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.587+0000 7fe939e00640 1 -- 172.21.15.42:0/2081056821 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe934142f40 msgr2=0x7fe934141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:35.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.587+0000 7fe939e00640 1 --2- 172.21.15.42:0/2081056821 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe934142f40 0x7fe934141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:35.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.587+0000 7fe939e00640 1 -- 172.21.15.42:0/2081056821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9340b3550 msgr2=0x7fe9341f6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:35.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.587+0000 7fe939e00640 1 --2- 172.21.15.42:0/2081056821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9340b3550 0x7fe9341f6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:35.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.587+0000 7fe939e00640 1 -- 172.21.15.42:0/2081056821 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe93413f220 con 0x7fe934072e90 2024-09-17T01:38:35.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.587+0000 7fe939400640 1 --2- 172.21.15.42:0/2081056821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9340b3550 0x7fe9341f6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:35.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.588+0000 7fe939e00640 1 --2- 172.21.15.42:0/2081056821 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe934072e90 0x7fe93413ece0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fe92800c430 tx=0x7fe92800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:35.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.588+0000 7fe92e000640 1 -- 172.21.15.42:0/2081056821 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe928011790 con 0x7fe934072e90 2024-09-17T01:38:35.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.588+0000 7fe92e000640 1 -- 172.21.15.42:0/2081056821 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe928017070 con 0x7fe934072e90 2024-09-17T01:38:35.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.588+0000 7fe93c800640 1 -- 172.21.15.42:0/2081056821 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9341f7780 con 0x7fe934072e90 2024-09-17T01:38:35.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.588+0000 7fe92e000640 1 -- 172.21.15.42:0/2081056821 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe928011ce0 con 0x7fe934072e90 2024-09-17T01:38:35.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.588+0000 7fe93c800640 1 -- 172.21.15.42:0/2081056821 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9341f3950 con 0x7fe934072e90 2024-09-17T01:38:35.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.589+0000 7fe93c800640 1 -- 172.21.15.42:0/2081056821 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe93406dce0 con 0x7fe934072e90 2024-09-17T01:38:35.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.590+0000 7fe92e000640 1 -- 172.21.15.42:0/2081056821 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe92801c460 con 0x7fe934072e90 2024-09-17T01:38:35.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.591+0000 7fe92e000640 1 --2- 172.21.15.42:0/2081056821 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe918078bc0 0x7fe91807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:35.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.592+0000 7fe92e000640 1 -- 172.21.15.42:0/2081056821 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5227+0+0 (secure 0 0 0) 0x7fe92809a960 con 0x7fe934072e90 2024-09-17T01:38:35.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.592+0000 7fe939400640 1 --2- 172.21.15.42:0/2081056821 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe918078bc0 0x7fe91807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:35.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.593+0000 7fe939400640 1 --2- 172.21.15.42:0/2081056821 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe918078bc0 0x7fe91807b0d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe924034000 tx=0x7fe924004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:35.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.597+0000 7fe92e000640 1 -- 172.21.15.42:0/2081056821 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe93413f220 con 0x7fe934072e90 2024-09-17T01:38:35.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:35.792+0000 7fe93c800640 1 -- 172.21.15.42:0/2081056821 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe93406a170 con 0x7fe934072e90 2024-09-17T01:38:36.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.317+0000 7fe92e000640 1 -- 172.21.15.42:0/2081056821 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v106) ==== 170+0+0 (secure 0 0 0) 0x7fe928062f70 con 0x7fe934072e90 2024-09-17T01:38:36.315 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-09-17T01:38:36.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.321+0000 7fe93c800640 1 -- 172.21.15.42:0/2081056821 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe918078bc0 msgr2=0x7fe91807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:36.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.321+0000 7fe93c800640 1 --2- 172.21.15.42:0/2081056821 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe918078bc0 0x7fe91807b0d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe924034000 tx=0x7fe924004730 comp rx=0 tx=0).stop 2024-09-17T01:38:36.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.321+0000 7fe93c800640 1 -- 172.21.15.42:0/2081056821 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe934072e90 msgr2=0x7fe93413ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:36.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.321+0000 7fe93c800640 1 --2- 172.21.15.42:0/2081056821 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe934072e90 0x7fe93413ece0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fe92800c430 tx=0x7fe92800c8f0 comp rx=0 tx=0).stop 2024-09-17T01:38:36.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.321+0000 7fe93c800640 1 -- 172.21.15.42:0/2081056821 shutdown_connections 2024-09-17T01:38:36.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.321+0000 7fe93c800640 1 --2- 172.21.15.42:0/2081056821 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe918078bc0 0x7fe91807b0d0 secure :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe924034000 tx=0x7fe924004730 comp rx=0 tx=0).stop 2024-09-17T01:38:36.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.321+0000 7fe93c800640 1 --2- 172.21.15.42:0/2081056821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9340b3550 0x7fe9341f6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:36.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.321+0000 7fe93c800640 1 --2- 172.21.15.42:0/2081056821 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe934142f40 0x7fe934141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:36.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.321+0000 7fe93c800640 1 --2- 172.21.15.42:0/2081056821 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe934072e90 0x7fe93413ece0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:36.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.321+0000 7fe93c800640 1 -- 172.21.15.42:0/2081056821 >> 172.21.15.42:0/2081056821 conn(0x7fe9340b2930 msgr2=0x7fe934073990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:36.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.322+0000 7fe93c800640 1 -- 172.21.15.42:0/2081056821 shutdown_connections 2024-09-17T01:38:36.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.322+0000 7fe93c800640 1 -- 172.21.15.42:0/2081056821 wait complete. 2024-09-17T01:38:36.361 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T01:38:36.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.597+0000 7febd0000640 1 -- 172.21.15.42:0/1804078758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febb0004800 msgr2=0x7febb0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:36.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.597+0000 7febd0000640 1 --2- 172.21.15.42:0/1804078758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febb0004800 0x7febb0004c10 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7febc8161580 tx=0x7febb0005830 comp rx=0 tx=0).stop 2024-09-17T01:38:36.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.597+0000 7febd0000640 1 -- 172.21.15.42:0/1804078758 shutdown_connections 2024-09-17T01:38:36.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.597+0000 7febd0000640 1 --2- 172.21.15.42:0/1804078758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febb0004800 0x7febb0004c10 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:36.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.597+0000 7febd0000640 1 -- 172.21.15.42:0/1804078758 >> 172.21.15.42:0/1804078758 conn(0x7febc80b2930 msgr2=0x7febc806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:36.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.598+0000 7febd0000640 1 -- 172.21.15.42:0/1804078758 shutdown_connections 2024-09-17T01:38:36.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.598+0000 7febd0000640 1 -- 172.21.15.42:0/1804078758 wait complete. 2024-09-17T01:38:36.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.600+0000 7febd0000640 1 Processor -- start 2024-09-17T01:38:36.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.600+0000 7febd0000640 1 -- start start 2024-09-17T01:38:36.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.601+0000 7febd0000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febb0004800 0x7febc8157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:36.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.601+0000 7febd0000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc81f6210 0x7febc814ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:36.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.601+0000 7febd0000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7febc81580f0 0x7febc8158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:36.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.601+0000 7febd0000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7febc8156fd0 con 0x7febc81f6210 2024-09-17T01:38:36.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.601+0000 7febd0000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7febc8156e50 con 0x7febb0004800 2024-09-17T01:38:36.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.601+0000 7febd0000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7febc8157150 con 0x7febc81580f0 2024-09-17T01:38:36.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.602+0000 7febccc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc81f6210 0x7febc814ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:36.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.602+0000 7febccc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc81f6210 0x7febc814ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42616/0 (socket says 172.21.15.42:42616) 2024-09-17T01:38:36.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.602+0000 7febccc00640 1 -- 172.21.15.42:0/4015205044 learned_addr learned my addr 172.21.15.42:0/4015205044 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:36.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.602+0000 7febccc00640 1 -- 172.21.15.42:0/4015205044 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7febc81580f0 msgr2=0x7febc8158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:36.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.602+0000 7febce000640 1 --2- 172.21.15.42:0/4015205044 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7febc81580f0 0x7febc8158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:36.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.602+0000 7febcd600640 1 --2- 172.21.15.42:0/4015205044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febb0004800 0x7febc8157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:36.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.602+0000 7febccc00640 1 --2- 172.21.15.42:0/4015205044 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7febc81580f0 0x7febc8158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:36.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.602+0000 7febccc00640 1 -- 172.21.15.42:0/4015205044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febb0004800 msgr2=0x7febc8157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:36.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.602+0000 7febccc00640 1 --2- 172.21.15.42:0/4015205044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febb0004800 0x7febc8157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:36.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.602+0000 7febccc00640 1 -- 172.21.15.42:0/4015205044 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc815a700 con 0x7febc81f6210 2024-09-17T01:38:36.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.602+0000 7febce000640 1 --2- 172.21.15.42:0/4015205044 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7febc81580f0 0x7febc8158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:38:36.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.602+0000 7febcd600640 1 --2- 172.21.15.42:0/4015205044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febb0004800 0x7febc8157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:38:36.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.602+0000 7febccc00640 1 --2- 172.21.15.42:0/4015205044 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc81f6210 0x7febc814ad10 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7febb400c530 tx=0x7febb40013b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:36.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.603+0000 7febc5600640 1 -- 172.21.15.42:0/4015205044 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb4042070 con 0x7febc81f6210 2024-09-17T01:38:36.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.603+0000 7febc5600640 1 -- 172.21.15.42:0/4015205044 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febb4006430 con 0x7febc81f6210 2024-09-17T01:38:36.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.603+0000 7febc5600640 1 -- 172.21.15.42:0/4015205044 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb40035f0 con 0x7febc81f6210 2024-09-17T01:38:36.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.603+0000 7febd0000640 1 -- 172.21.15.42:0/4015205044 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc8158a40 con 0x7febc81f6210 2024-09-17T01:38:36.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.603+0000 7febd0000640 1 -- 172.21.15.42:0/4015205044 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc815a420 con 0x7febc81f6210 2024-09-17T01:38:36.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.604+0000 7febd0000640 1 -- 172.21.15.42:0/4015205044 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febc806d9b0 con 0x7febc81f6210 2024-09-17T01:38:36.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.605+0000 7febc5600640 1 -- 172.21.15.42:0/4015205044 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7febb4045070 con 0x7febc81f6210 2024-09-17T01:38:36.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.606+0000 7febc5600640 1 --2- 172.21.15.42:0/4015205044 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feba8078b90 0x7feba807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:36.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.606+0000 7febc5600640 1 -- 172.21.15.42:0/4015205044 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5609+0+0 (secure 0 0 0) 0x7febb40ba760 con 0x7febc81f6210 2024-09-17T01:38:36.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.607+0000 7febcd600640 1 --2- 172.21.15.42:0/4015205044 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feba8078b90 0x7feba807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:36.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.608+0000 7febcd600640 1 --2- 172.21.15.42:0/4015205044 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feba8078b90 0x7feba807b0a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7febc8077840 tx=0x7febbc005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:36.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.611+0000 7febc5600640 1 -- 172.21.15.42:0/4015205044 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7febc8158a40 con 0x7febc81f6210 2024-09-17T01:38:36.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:36.842+0000 7febd0000640 1 -- 172.21.15.42:0/4015205044 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7febc81f66d0 con 0x7febc81f6210 2024-09-17T01:38:37.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.334+0000 7febc5600640 1 -- 172.21.15.42:0/4015205044 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v84) ==== 174+0+0 (secure 0 0 0) 0x7febc815de90 con 0x7febc81f6210 2024-09-17T01:38:37.332 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 14 and data pool 15 2024-09-17T01:38:37.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.338+0000 7febd0000640 1 -- 172.21.15.42:0/4015205044 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feba8078b90 msgr2=0x7feba807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:37.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.338+0000 7febd0000640 1 --2- 172.21.15.42:0/4015205044 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feba8078b90 0x7feba807b0a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7febc8077840 tx=0x7febbc005f90 comp rx=0 tx=0).stop 2024-09-17T01:38:37.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.338+0000 7febd0000640 1 -- 172.21.15.42:0/4015205044 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc81f6210 msgr2=0x7febc814ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:37.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.338+0000 7febd0000640 1 --2- 172.21.15.42:0/4015205044 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc81f6210 0x7febc814ad10 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7febb400c530 tx=0x7febb40013b0 comp rx=0 tx=0).stop 2024-09-17T01:38:37.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.339+0000 7febd0000640 1 -- 172.21.15.42:0/4015205044 shutdown_connections 2024-09-17T01:38:37.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.339+0000 7febd0000640 1 --2- 172.21.15.42:0/4015205044 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feba8078b90 0x7feba807b0a0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:37.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.339+0000 7febd0000640 1 --2- 172.21.15.42:0/4015205044 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7febc81580f0 0x7febc8158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:37.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.339+0000 7febd0000640 1 --2- 172.21.15.42:0/4015205044 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc81f6210 0x7febc814ad10 secure :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7febb400c530 tx=0x7febb40013b0 comp rx=0 tx=0).stop 2024-09-17T01:38:37.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.339+0000 7febd0000640 1 --2- 172.21.15.42:0/4015205044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febb0004800 0x7febc8157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:37.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.339+0000 7febd0000640 1 -- 172.21.15.42:0/4015205044 >> 172.21.15.42:0/4015205044 conn(0x7febc80b2930 msgr2=0x7febc80b0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:37.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.339+0000 7febd0000640 1 -- 172.21.15.42:0/4015205044 shutdown_connections 2024-09-17T01:38:37.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.339+0000 7febd0000640 1 -- 172.21.15.42:0/4015205044 wait complete. 2024-09-17T01:38:37.392 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:38:37.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.622+0000 7efc34a00640 1 -- 172.21.15.42:0/347393817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc300cec40 msgr2=0x7efc300cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:37.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.622+0000 7efc34a00640 1 --2- 172.21.15.42:0/347393817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc300cec40 0x7efc300cf050 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7efc28005fd0 tx=0x7efc2802a820 comp rx=0 tx=0).stop 2024-09-17T01:38:37.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.622+0000 7efc34a00640 1 -- 172.21.15.42:0/347393817 shutdown_connections 2024-09-17T01:38:37.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.622+0000 7efc34a00640 1 --2- 172.21.15.42:0/347393817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc300cec40 0x7efc300cf050 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:37.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.622+0000 7efc34a00640 1 --2- 172.21.15.42:0/347393817 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc300b3550 0x7efc3015cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:37.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.622+0000 7efc34a00640 1 -- 172.21.15.42:0/347393817 >> 172.21.15.42:0/347393817 conn(0x7efc300b2930 msgr2=0x7efc3006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:37.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.623+0000 7efc34a00640 1 -- 172.21.15.42:0/347393817 shutdown_connections 2024-09-17T01:38:37.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.623+0000 7efc34a00640 1 -- 172.21.15.42:0/347393817 wait complete. 2024-09-17T01:38:37.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.625+0000 7efc34a00640 1 Processor -- start 2024-09-17T01:38:37.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.625+0000 7efc34a00640 1 -- start start 2024-09-17T01:38:37.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.626+0000 7efc34a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc300b3550 0x7efc301407f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:37.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.626+0000 7efc34a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc300cec40 0x7efc3015a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:37.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.626+0000 7efc34a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc30142f40 0x7efc3013e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:37.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.626+0000 7efc34a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efc3006d7c0 con 0x7efc300cec40 2024-09-17T01:38:37.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.626+0000 7efc34a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efc3006d640 con 0x7efc30142f40 2024-09-17T01:38:37.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.626+0000 7efc34a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7efc3006d940 con 0x7efc300b3550 2024-09-17T01:38:37.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.627+0000 7efc27e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc300cec40 0x7efc3015a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:37.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.627+0000 7efc27e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc300cec40 0x7efc3015a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42634/0 (socket says 172.21.15.42:42634) 2024-09-17T01:38:37.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.627+0000 7efc27e00640 1 -- 172.21.15.42:0/3101767200 learned_addr learned my addr 172.21.15.42:0/3101767200 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:37.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.627+0000 7efc2de00640 1 --2- 172.21.15.42:0/3101767200 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc300b3550 0x7efc301407f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:37.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.627+0000 7efc2e800640 1 --2- 172.21.15.42:0/3101767200 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc30142f40 0x7efc3013e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:37.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.627+0000 7efc27e00640 1 -- 172.21.15.42:0/3101767200 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc300b3550 msgr2=0x7efc301407f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:37.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.627+0000 7efc27e00640 1 --2- 172.21.15.42:0/3101767200 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc300b3550 0x7efc301407f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:37.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.627+0000 7efc27e00640 1 -- 172.21.15.42:0/3101767200 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc30142f40 msgr2=0x7efc3013e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:37.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.627+0000 7efc27e00640 1 --2- 172.21.15.42:0/3101767200 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc30142f40 0x7efc3013e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:37.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.627+0000 7efc27e00640 1 -- 172.21.15.42:0/3101767200 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3013f750 con 0x7efc300cec40 2024-09-17T01:38:37.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.627+0000 7efc27e00640 1 --2- 172.21.15.42:0/3101767200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc300cec40 0x7efc3015a910 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7efc1800c3c0 tx=0x7efc1800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:37.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.628+0000 7efc26000640 1 -- 172.21.15.42:0/3101767200 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc18017070 con 0x7efc300cec40 2024-09-17T01:38:37.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.628+0000 7efc26000640 1 -- 172.21.15.42:0/3101767200 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc180035f0 con 0x7efc300cec40 2024-09-17T01:38:37.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.628+0000 7efc34a00640 1 -- 172.21.15.42:0/3101767200 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc3013fa30 con 0x7efc300cec40 2024-09-17T01:38:37.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.628+0000 7efc26000640 1 -- 172.21.15.42:0/3101767200 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc18003a40 con 0x7efc300cec40 2024-09-17T01:38:37.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.628+0000 7efc34a00640 1 -- 172.21.15.42:0/3101767200 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc3013fff0 con 0x7efc300cec40 2024-09-17T01:38:37.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.629+0000 7efc34a00640 1 -- 172.21.15.42:0/3101767200 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc3015cec0 con 0x7efc300cec40 2024-09-17T01:38:37.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.630+0000 7efc26000640 1 -- 172.21.15.42:0/3101767200 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efc1801a070 con 0x7efc300cec40 2024-09-17T01:38:37.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.631+0000 7efc26000640 1 --2- 172.21.15.42:0/3101767200 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efc0c078b90 0x7efc0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:37.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.631+0000 7efc26000640 1 -- 172.21.15.42:0/3101767200 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7efc1809a4c0 con 0x7efc300cec40 2024-09-17T01:38:37.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.632+0000 7efc2de00640 1 --2- 172.21.15.42:0/3101767200 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efc0c078b90 0x7efc0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:37.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.633+0000 7efc2de00640 1 --2- 172.21.15.42:0/3101767200 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efc0c078b90 0x7efc0c07b0a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efc20009ac0 tx=0x7efc20005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:37.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.635+0000 7efc26000640 1 -- 172.21.15.42:0/3101767200 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efc18021020 con 0x7efc300cec40 2024-09-17T01:38:37.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.828+0000 7efc34a00640 1 -- 172.21.15.42:0/3101767200 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc3013f4e0 con 0x7efc300cec40 2024-09-17T01:38:37.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.830+0000 7efc26000640 1 -- 172.21.15.42:0/3101767200 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) ==== 74+0+16644 (secure 0 0 0) 0x7efc18062970 con 0x7efc300cec40 2024-09-17T01:38:37.828 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:38:37.828 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":107,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:38:36.843320+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:38:34.801865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T01:38:35.805587+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:38:37.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.832+0000 7efc34a00640 1 -- 172.21.15.42:0/3101767200 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efc0c078b90 msgr2=0x7efc0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:37.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.832+0000 7efc34a00640 1 --2- 172.21.15.42:0/3101767200 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efc0c078b90 0x7efc0c07b0a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efc20009ac0 tx=0x7efc20005f90 comp rx=0 tx=0).stop 2024-09-17T01:38:37.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.832+0000 7efc34a00640 1 -- 172.21.15.42:0/3101767200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc300cec40 msgr2=0x7efc3015a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:37.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.832+0000 7efc34a00640 1 --2- 172.21.15.42:0/3101767200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc300cec40 0x7efc3015a910 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7efc1800c3c0 tx=0x7efc1800c880 comp rx=0 tx=0).stop 2024-09-17T01:38:37.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.832+0000 7efc34a00640 1 -- 172.21.15.42:0/3101767200 shutdown_connections 2024-09-17T01:38:37.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.832+0000 7efc34a00640 1 --2- 172.21.15.42:0/3101767200 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efc0c078b90 0x7efc0c07b0a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:37.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.832+0000 7efc34a00640 1 --2- 172.21.15.42:0/3101767200 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc30142f40 0x7efc3013e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:37.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.832+0000 7efc34a00640 1 --2- 172.21.15.42:0/3101767200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc300cec40 0x7efc3015a910 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:37.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.832+0000 7efc34a00640 1 --2- 172.21.15.42:0/3101767200 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc300b3550 0x7efc301407f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:37.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.832+0000 7efc34a00640 1 -- 172.21.15.42:0/3101767200 >> 172.21.15.42:0/3101767200 conn(0x7efc300b2930 msgr2=0x7efc3006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:37.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.832+0000 7efc34a00640 1 -- 172.21.15.42:0/3101767200 shutdown_connections 2024-09-17T01:38:37.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:37.832+0000 7efc34a00640 1 -- 172.21.15.42:0/3101767200 wait complete. 2024-09-17T01:38:37.854 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:38:38.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.084+0000 7fc652800640 1 -- 172.21.15.42:0/3343892149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc64c0b2960 msgr2=0x7fc64c0b0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:38.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.084+0000 7fc652800640 1 --2- 172.21.15.42:0/3343892149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc64c0b2960 0x7fc64c0b0990 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fc64c1624b0 tx=0x7fc64002a560 comp rx=0 tx=0).stop 2024-09-17T01:38:38.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.084+0000 7fc652800640 1 -- 172.21.15.42:0/3343892149 shutdown_connections 2024-09-17T01:38:38.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.084+0000 7fc652800640 1 --2- 172.21.15.42:0/3343892149 >> v2:172.21.15.43:3300/0 conn(0x7fc64c15fa70 0x7fc64c06d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:38.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.084+0000 7fc652800640 1 --2- 172.21.15.42:0/3343892149 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc64c068d40 0x7fc64c069150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:38.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.084+0000 7fc652800640 1 --2- 172.21.15.42:0/3343892149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc64c0b2960 0x7fc64c0b0990 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:38.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.084+0000 7fc652800640 1 -- 172.21.15.42:0/3343892149 >> 172.21.15.42:0/3343892149 conn(0x7fc64c0734a0 msgr2=0x7fc64c0b61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:38.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.084+0000 7fc652800640 1 -- 172.21.15.42:0/3343892149 shutdown_connections 2024-09-17T01:38:38.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.084+0000 7fc652800640 1 -- 172.21.15.42:0/3343892149 wait complete. 2024-09-17T01:38:38.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.087+0000 7fc652800640 1 Processor -- start 2024-09-17T01:38:38.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.087+0000 7fc652800640 1 -- start start 2024-09-17T01:38:38.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.088+0000 7fc652800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc64c068d40 0x7fc64c154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:38.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.088+0000 7fc652800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc64c0b2960 0x7fc64c0ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:38.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.088+0000 7fc652800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc64c15fa70 0x7fc64c0ce700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:38.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.088+0000 7fc652800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc64c0749f0 con 0x7fc64c15fa70 2024-09-17T01:38:38.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.088+0000 7fc652800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc64c074870 con 0x7fc64c068d40 2024-09-17T01:38:38.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.088+0000 7fc652800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc64c074b70 con 0x7fc64c0b2960 2024-09-17T01:38:38.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.088+0000 7fc651e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc64c15fa70 0x7fc64c0ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:38.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.088+0000 7fc651e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc64c15fa70 0x7fc64c0ce700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42654/0 (socket says 172.21.15.42:42654) 2024-09-17T01:38:38.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.088+0000 7fc651e00640 1 -- 172.21.15.42:0/1209727351 learned_addr learned my addr 172.21.15.42:0/1209727351 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:38.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.089+0000 7fc651e00640 1 -- 172.21.15.42:0/1209727351 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc64c0b2960 msgr2=0x7fc64c0ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:38.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.089+0000 7fc651400640 1 --2- 172.21.15.42:0/1209727351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc64c068d40 0x7fc64c154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:38.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.089+0000 7fc650a00640 1 --2- 172.21.15.42:0/1209727351 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc64c0b2960 0x7fc64c0ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:38.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.089+0000 7fc651e00640 1 --2- 172.21.15.42:0/1209727351 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc64c0b2960 0x7fc64c0ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:38.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.089+0000 7fc651e00640 1 -- 172.21.15.42:0/1209727351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc64c068d40 msgr2=0x7fc64c154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:38.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.089+0000 7fc651e00640 1 --2- 172.21.15.42:0/1209727351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc64c068d40 0x7fc64c154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:38.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.089+0000 7fc651e00640 1 -- 172.21.15.42:0/1209727351 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64c0d1a00 con 0x7fc64c15fa70 2024-09-17T01:38:38.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.089+0000 7fc651400640 1 --2- 172.21.15.42:0/1209727351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc64c068d40 0x7fc64c154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:38:38.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.089+0000 7fc650a00640 1 --2- 172.21.15.42:0/1209727351 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc64c0b2960 0x7fc64c0ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:38:38.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.089+0000 7fc651e00640 1 --2- 172.21.15.42:0/1209727351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc64c15fa70 0x7fc64c0ce700 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fc64400e990 tx=0x7fc64400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:38.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.089+0000 7fc649600640 1 -- 172.21.15.42:0/1209727351 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc644004d20 con 0x7fc64c15fa70 2024-09-17T01:38:38.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.089+0000 7fc649600640 1 -- 172.21.15.42:0/1209727351 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc64400caa0 con 0x7fc64c15fa70 2024-09-17T01:38:38.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.089+0000 7fc652800640 1 -- 172.21.15.42:0/1209727351 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc64c09b500 con 0x7fc64c15fa70 2024-09-17T01:38:38.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.090+0000 7fc649600640 1 -- 172.21.15.42:0/1209727351 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc644005020 con 0x7fc64c15fa70 2024-09-17T01:38:38.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.090+0000 7fc652800640 1 -- 172.21.15.42:0/1209727351 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc64c09d6e0 con 0x7fc64c15fa70 2024-09-17T01:38:38.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.091+0000 7fc652800640 1 -- 172.21.15.42:0/1209727351 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc64c075090 con 0x7fc64c15fa70 2024-09-17T01:38:38.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.092+0000 7fc649600640 1 -- 172.21.15.42:0/1209727351 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc6440051c0 con 0x7fc64c15fa70 2024-09-17T01:38:38.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.093+0000 7fc649600640 1 --2- 172.21.15.42:0/1209727351 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc62c078b90 0x7fc62c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:38.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.094+0000 7fc649600640 1 -- 172.21.15.42:0/1209727351 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7fc64409b830 con 0x7fc64c15fa70 2024-09-17T01:38:38.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.094+0000 7fc651400640 1 --2- 172.21.15.42:0/1209727351 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc62c078b90 0x7fc62c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:38.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.095+0000 7fc651400640 1 --2- 172.21.15.42:0/1209727351 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc62c078b90 0x7fc62c07b0a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc640033000 tx=0x7fc640004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:38.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.098+0000 7fc649600640 1 -- 172.21.15.42:0/1209727351 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc644016030 con 0x7fc64c15fa70 2024-09-17T01:38:38.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.294+0000 7fc652800640 1 -- 172.21.15.42:0/1209727351 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc64c0aeb60 con 0x7fc64c15fa70 2024-09-17T01:38:38.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.296+0000 7fc649600640 1 -- 172.21.15.42:0/1209727351 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) ==== 74+0+16644 (secure 0 0 0) 0x7fc644063d70 con 0x7fc64c15fa70 2024-09-17T01:38:38.294 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:38:38.294 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":107,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:38:36.843320+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:38:34.801865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T01:38:35.805587+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:38:38.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.298+0000 7fc652800640 1 -- 172.21.15.42:0/1209727351 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc62c078b90 msgr2=0x7fc62c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:38.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.298+0000 7fc652800640 1 --2- 172.21.15.42:0/1209727351 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc62c078b90 0x7fc62c07b0a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc640033000 tx=0x7fc640004730 comp rx=0 tx=0).stop 2024-09-17T01:38:38.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.298+0000 7fc652800640 1 -- 172.21.15.42:0/1209727351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc64c15fa70 msgr2=0x7fc64c0ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:38.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.298+0000 7fc652800640 1 --2- 172.21.15.42:0/1209727351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc64c15fa70 0x7fc64c0ce700 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fc64400e990 tx=0x7fc64400ee50 comp rx=0 tx=0).stop 2024-09-17T01:38:38.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.298+0000 7fc652800640 1 -- 172.21.15.42:0/1209727351 shutdown_connections 2024-09-17T01:38:38.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.298+0000 7fc652800640 1 --2- 172.21.15.42:0/1209727351 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc62c078b90 0x7fc62c07b0a0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:38.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.298+0000 7fc652800640 1 --2- 172.21.15.42:0/1209727351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc64c15fa70 0x7fc64c0ce700 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:38.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.298+0000 7fc652800640 1 --2- 172.21.15.42:0/1209727351 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc64c0b2960 0x7fc64c0ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:38.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.298+0000 7fc652800640 1 --2- 172.21.15.42:0/1209727351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc64c068d40 0x7fc64c154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:38.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.298+0000 7fc652800640 1 -- 172.21.15.42:0/1209727351 >> 172.21.15.42:0/1209727351 conn(0x7fc64c0734a0 msgr2=0x7fc64c06ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:38.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.299+0000 7fc652800640 1 -- 172.21.15.42:0/1209727351 shutdown_connections 2024-09-17T01:38:38.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.299+0000 7fc652800640 1 -- 172.21.15.42:0/1209727351 wait complete. 2024-09-17T01:38:38.318 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T01:38:38.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.556+0000 7ff480c00640 1 -- 172.21.15.42:0/941289889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff460005250 msgr2=0x7ff46000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:38.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.556+0000 7ff480c00640 1 --2- 172.21.15.42:0/941289889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff460005250 0x7ff46000b9c0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7ff474001dc0 tx=0x7ff460005830 comp rx=0 tx=0).stop 2024-09-17T01:38:38.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.556+0000 7ff480c00640 1 -- 172.21.15.42:0/941289889 shutdown_connections 2024-09-17T01:38:38.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.556+0000 7ff480c00640 1 --2- 172.21.15.42:0/941289889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff460005250 0x7ff46000b9c0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:38.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.556+0000 7ff480c00640 1 -- 172.21.15.42:0/941289889 >> 172.21.15.42:0/941289889 conn(0x7ff47c0b6140 msgr2=0x7ff47c0b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:38.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.556+0000 7ff480c00640 1 -- 172.21.15.42:0/941289889 shutdown_connections 2024-09-17T01:38:38.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.556+0000 7ff480c00640 1 -- 172.21.15.42:0/941289889 wait complete. 2024-09-17T01:38:38.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.558+0000 7ff480c00640 1 Processor -- start 2024-09-17T01:38:38.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.558+0000 7ff480c00640 1 -- start start 2024-09-17T01:38:38.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.560+0000 7ff480c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff460005250 0x7ff47c0cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:38.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.560+0000 7ff480c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff47c1f8a80 0x7ff47c0cd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:38.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.560+0000 7ff480c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff47c15e3a0 0x7ff47c1f5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:38.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.560+0000 7ff480c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff47c0b9fb0 con 0x7ff47c15e3a0 2024-09-17T01:38:38.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.560+0000 7ff480c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff47c0d1760 con 0x7ff47c1f8a80 2024-09-17T01:38:38.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.560+0000 7ff480c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff47c0ba130 con 0x7ff460005250 2024-09-17T01:38:38.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.560+0000 7ff47be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff47c15e3a0 0x7ff47c1f5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:38.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.560+0000 7ff47be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff47c15e3a0 0x7ff47c1f5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42678/0 (socket says 172.21.15.42:42678) 2024-09-17T01:38:38.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.560+0000 7ff47be00640 1 -- 172.21.15.42:0/2793272443 learned_addr learned my addr 172.21.15.42:0/2793272443 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:38.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.560+0000 7ff472a00640 1 --2- 172.21.15.42:0/2793272443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff47c1f8a80 0x7ff47c0cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:38.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.560+0000 7ff47b400640 1 --2- 172.21.15.42:0/2793272443 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff460005250 0x7ff47c0cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:38.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.561+0000 7ff47be00640 1 -- 172.21.15.42:0/2793272443 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff460005250 msgr2=0x7ff47c0cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:38.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.561+0000 7ff47be00640 1 --2- 172.21.15.42:0/2793272443 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff460005250 0x7ff47c0cc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:38.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.561+0000 7ff47be00640 1 -- 172.21.15.42:0/2793272443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff47c1f8a80 msgr2=0x7ff47c0cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:38.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.561+0000 7ff47be00640 1 --2- 172.21.15.42:0/2793272443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff47c1f8a80 0x7ff47c0cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:38.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.561+0000 7ff47be00640 1 -- 172.21.15.42:0/2793272443 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff47c0ccc70 con 0x7ff47c15e3a0 2024-09-17T01:38:38.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.561+0000 7ff47be00640 1 --2- 172.21.15.42:0/2793272443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff47c15e3a0 0x7ff47c1f5c70 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7ff474001eb0 tx=0x7ff474006ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:38.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.561+0000 7ff473e00640 1 -- 172.21.15.42:0/2793272443 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff474003d80 con 0x7ff47c15e3a0 2024-09-17T01:38:38.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.561+0000 7ff473e00640 1 -- 172.21.15.42:0/2793272443 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff474005b00 con 0x7ff47c15e3a0 2024-09-17T01:38:38.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.561+0000 7ff480c00640 1 -- 172.21.15.42:0/2793272443 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff47c1f5490 con 0x7ff47c15e3a0 2024-09-17T01:38:38.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.561+0000 7ff473e00640 1 -- 172.21.15.42:0/2793272443 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff474005f30 con 0x7ff47c15e3a0 2024-09-17T01:38:38.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.562+0000 7ff480c00640 1 -- 172.21.15.42:0/2793272443 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff47c1f94d0 con 0x7ff47c15e3a0 2024-09-17T01:38:38.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.563+0000 7ff480c00640 1 -- 172.21.15.42:0/2793272443 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff47c162910 con 0x7ff47c15e3a0 2024-09-17T01:38:38.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.564+0000 7ff473e00640 1 -- 172.21.15.42:0/2793272443 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff4740060d0 con 0x7ff47c15e3a0 2024-09-17T01:38:38.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.565+0000 7ff473e00640 1 --2- 172.21.15.42:0/2793272443 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff458078b90 0x7ff45807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:38.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.565+0000 7ff473e00640 1 -- 172.21.15.42:0/2793272443 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5709+0+0 (secure 0 0 0) 0x7ff4740bab40 con 0x7ff47c15e3a0 2024-09-17T01:38:38.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.565+0000 7ff47b400640 1 --2- 172.21.15.42:0/2793272443 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff458078b90 0x7ff45807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:38.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.566+0000 7ff47b400640 1 --2- 172.21.15.42:0/2793272443 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff458078b90 0x7ff45807b0a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff46c003a30 tx=0x7ff46c001e70 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:38.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.569+0000 7ff473e00640 1 -- 172.21.15.42:0/2793272443 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff474043060 con 0x7ff47c15e3a0 2024-09-17T01:38:38.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:38.800+0000 7ff480c00640 1 -- 172.21.15.42:0/2793272443 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff47c0b5f00 con 0x7ff47c15e3a0 2024-09-17T01:38:39.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.359+0000 7ff473e00640 1 -- 172.21.15.42:0/2793272443 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v87) ==== 118+0+0 (secure 0 0 0) 0x7ff4740830d0 con 0x7ff47c15e3a0 2024-09-17T01:38:39.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.363+0000 7ff480c00640 1 -- 172.21.15.42:0/2793272443 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff458078b90 msgr2=0x7ff45807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:39.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.363+0000 7ff480c00640 1 --2- 172.21.15.42:0/2793272443 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff458078b90 0x7ff45807b0a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff46c003a30 tx=0x7ff46c001e70 comp rx=0 tx=0).stop 2024-09-17T01:38:39.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.363+0000 7ff480c00640 1 -- 172.21.15.42:0/2793272443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff47c15e3a0 msgr2=0x7ff47c1f5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:39.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.363+0000 7ff480c00640 1 --2- 172.21.15.42:0/2793272443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff47c15e3a0 0x7ff47c1f5c70 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7ff474001eb0 tx=0x7ff474006ca0 comp rx=0 tx=0).stop 2024-09-17T01:38:39.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.363+0000 7ff480c00640 1 -- 172.21.15.42:0/2793272443 shutdown_connections 2024-09-17T01:38:39.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.363+0000 7ff480c00640 1 --2- 172.21.15.42:0/2793272443 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff458078b90 0x7ff45807b0a0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:39.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.363+0000 7ff480c00640 1 --2- 172.21.15.42:0/2793272443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff47c1f8a80 0x7ff47c0cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:39.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.363+0000 7ff480c00640 1 --2- 172.21.15.42:0/2793272443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff47c15e3a0 0x7ff47c1f5c70 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:39.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.363+0000 7ff480c00640 1 --2- 172.21.15.42:0/2793272443 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff460005250 0x7ff47c0cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:39.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.363+0000 7ff480c00640 1 -- 172.21.15.42:0/2793272443 >> 172.21.15.42:0/2793272443 conn(0x7ff47c0b6140 msgr2=0x7ff47c0b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:39.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.363+0000 7ff480c00640 1 -- 172.21.15.42:0/2793272443 shutdown_connections 2024-09-17T01:38:39.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.363+0000 7ff480c00640 1 -- 172.21.15.42:0/2793272443 wait complete. 2024-09-17T01:38:39.389 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T01:38:39.389 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T01:38:39.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.623+0000 7faecd600640 1 -- 172.21.15.42:0/3793306379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faec80b4be0 msgr2=0x7faec815d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:39.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.623+0000 7faecd600640 1 --2- 172.21.15.42:0/3793306379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faec80b4be0 0x7faec815d6b0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7faec80d0be0 tx=0x7faeb802a580 comp rx=0 tx=0).stop 2024-09-17T01:38:39.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.623+0000 7faecd600640 1 -- 172.21.15.42:0/3793306379 shutdown_connections 2024-09-17T01:38:39.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.623+0000 7faecd600640 1 --2- 172.21.15.42:0/3793306379 >> v2:172.21.15.43:3300/0 conn(0x7faec806d260 0x7faec8152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:39.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.623+0000 7faecd600640 1 --2- 172.21.15.42:0/3793306379 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faec80cf7c0 0x7faec806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:39.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.623+0000 7faecd600640 1 --2- 172.21.15.42:0/3793306379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faec80b4be0 0x7faec815d6b0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:39.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.623+0000 7faecd600640 1 -- 172.21.15.42:0/3793306379 >> 172.21.15.42:0/3793306379 conn(0x7faec80b25f0 msgr2=0x7faec80d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:39.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.623+0000 7faecd600640 1 -- 172.21.15.42:0/3793306379 shutdown_connections 2024-09-17T01:38:39.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.623+0000 7faecd600640 1 -- 172.21.15.42:0/3793306379 wait complete. 2024-09-17T01:38:39.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.626+0000 7faecd600640 1 Processor -- start 2024-09-17T01:38:39.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.626+0000 7faecd600640 1 -- start start 2024-09-17T01:38:39.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.627+0000 7faecd600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faec806d260 0x7faec814e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:39.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.627+0000 7faecd600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faec80b4be0 0x7faec814f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:39.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.627+0000 7faecd600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faec80cf7c0 0x7faec81e9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:39.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.627+0000 7faecd600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faec8153590 con 0x7faec806d260 2024-09-17T01:38:39.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.627+0000 7faecd600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faec8153410 con 0x7faec80b4be0 2024-09-17T01:38:39.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.627+0000 7faecd600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7faec8153710 con 0x7faec80cf7c0 2024-09-17T01:38:39.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.628+0000 7faec7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faec806d260 0x7faec814e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:39.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.628+0000 7faec7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faec806d260 0x7faec814e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42682/0 (socket says 172.21.15.42:42682) 2024-09-17T01:38:39.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.628+0000 7faec7e00640 1 -- 172.21.15.42:0/1005920631 learned_addr learned my addr 172.21.15.42:0/1005920631 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:39.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.628+0000 7faec7400640 1 --2- 172.21.15.42:0/1005920631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faec80b4be0 0x7faec814f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:39.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.628+0000 7faeccc00640 1 --2- 172.21.15.42:0/1005920631 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faec80cf7c0 0x7faec81e9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:39.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.628+0000 7faec7e00640 1 -- 172.21.15.42:0/1005920631 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faec80cf7c0 msgr2=0x7faec81e9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:39.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.628+0000 7faec7e00640 1 --2- 172.21.15.42:0/1005920631 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faec80cf7c0 0x7faec81e9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:39.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.628+0000 7faec7e00640 1 -- 172.21.15.42:0/1005920631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faec80b4be0 msgr2=0x7faec814f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:39.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.628+0000 7faec7e00640 1 --2- 172.21.15.42:0/1005920631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faec80b4be0 0x7faec814f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:39.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.628+0000 7faec7e00640 1 -- 172.21.15.42:0/1005920631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec8151e10 con 0x7faec806d260 2024-09-17T01:38:39.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.628+0000 7faeccc00640 1 --2- 172.21.15.42:0/1005920631 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faec80cf7c0 0x7faec81e9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:38:39.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.628+0000 7faec7e00640 1 --2- 172.21.15.42:0/1005920631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faec806d260 0x7faec814e5b0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7faeb8009850 tx=0x7faeb80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:39.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.629+0000 7faebfe00640 1 -- 172.21.15.42:0/1005920631 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb803e030 con 0x7faec806d260 2024-09-17T01:38:39.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.629+0000 7faebfe00640 1 -- 172.21.15.42:0/1005920631 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faeb80047a0 con 0x7faec806d260 2024-09-17T01:38:39.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.629+0000 7faebfe00640 1 -- 172.21.15.42:0/1005920631 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb8035040 con 0x7faec806d260 2024-09-17T01:38:39.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.629+0000 7faecd600640 1 -- 172.21.15.42:0/1005920631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec81520f0 con 0x7faec806d260 2024-09-17T01:38:39.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.629+0000 7faecd600640 1 -- 172.21.15.42:0/1005920631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec80cad40 con 0x7faec806d260 2024-09-17T01:38:39.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.630+0000 7faecd600640 1 -- 172.21.15.42:0/1005920631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec815d6b0 con 0x7faec806d260 2024-09-17T01:38:39.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.631+0000 7faebfe00640 1 -- 172.21.15.42:0/1005920631 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faeb8041030 con 0x7faec806d260 2024-09-17T01:38:39.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.632+0000 7faebfe00640 1 --2- 172.21.15.42:0/1005920631 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faea8078bc0 0x7faea807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:39.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.632+0000 7faebfe00640 1 -- 172.21.15.42:0/1005920631 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5709+0+0 (secure 0 0 0) 0x7faeb80bb580 con 0x7faec806d260 2024-09-17T01:38:39.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.633+0000 7faec7400640 1 --2- 172.21.15.42:0/1005920631 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faea8078bc0 0x7faea807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:39.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.633+0000 7faec7400640 1 --2- 172.21.15.42:0/1005920631 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faea8078bc0 0x7faea807b0d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7faec806ce40 tx=0x7faeb4008040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:39.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.637+0000 7faebfe00640 1 -- 172.21.15.42:0/1005920631 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faeb80839b0 con 0x7faec806d260 2024-09-17T01:38:39.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:39.865+0000 7faecd600640 1 -- 172.21.15.42:0/1005920631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7faec80d0360 con 0x7faec806d260 2024-09-17T01:38:40.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.367+0000 7faebfe00640 1 -- 172.21.15.42:0/1005920631 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v88) ==== 122+0+0 (secure 0 0 0) 0x7faeb80832b0 con 0x7faec806d260 2024-09-17T01:38:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.369+0000 7faecd600640 1 -- 172.21.15.42:0/1005920631 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faea8078bc0 msgr2=0x7faea807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.369+0000 7faecd600640 1 --2- 172.21.15.42:0/1005920631 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faea8078bc0 0x7faea807b0d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7faec806ce40 tx=0x7faeb4008040 comp rx=0 tx=0).stop 2024-09-17T01:38:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.369+0000 7faecd600640 1 -- 172.21.15.42:0/1005920631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faec806d260 msgr2=0x7faec814e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.369+0000 7faecd600640 1 --2- 172.21.15.42:0/1005920631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faec806d260 0x7faec814e5b0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7faeb8009850 tx=0x7faeb80039e0 comp rx=0 tx=0).stop 2024-09-17T01:38:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.370+0000 7faecd600640 1 -- 172.21.15.42:0/1005920631 shutdown_connections 2024-09-17T01:38:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.370+0000 7faecd600640 1 --2- 172.21.15.42:0/1005920631 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faea8078bc0 0x7faea807b0d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.370+0000 7faecd600640 1 --2- 172.21.15.42:0/1005920631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faec80b4be0 0x7faec814f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.370+0000 7faecd600640 1 --2- 172.21.15.42:0/1005920631 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faec80cf7c0 0x7faec81e9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.370+0000 7faecd600640 1 --2- 172.21.15.42:0/1005920631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faec806d260 0x7faec814e5b0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.370+0000 7faecd600640 1 -- 172.21.15.42:0/1005920631 >> 172.21.15.42:0/1005920631 conn(0x7faec80b25f0 msgr2=0x7faec80afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.370+0000 7faecd600640 1 -- 172.21.15.42:0/1005920631 shutdown_connections 2024-09-17T01:38:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.370+0000 7faecd600640 1 -- 172.21.15.42:0/1005920631 wait complete. 2024-09-17T01:38:40.391 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T01:38:40.391 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:38:40.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.621+0000 7fede5400640 1 -- 172.21.15.42:0/3603689558 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fede00d0e10 msgr2=0x7fede00d1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:40.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.621+0000 7fede5400640 1 --2- 172.21.15.42:0/3603689558 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fede00d0e10 0x7fede00d1220 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fede00b3f80 tx=0x7fedc802a540 comp rx=0 tx=0).stop 2024-09-17T01:38:40.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.621+0000 7fede5400640 1 -- 172.21.15.42:0/3603689558 shutdown_connections 2024-09-17T01:38:40.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.621+0000 7fede5400640 1 --2- 172.21.15.42:0/3603689558 >> v2:172.21.15.43:3300/0 conn(0x7fede0162500 0x7fede0162910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:40.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.621+0000 7fede5400640 1 --2- 172.21.15.42:0/3603689558 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fede00d0e10 0x7fede00d1220 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:40.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.621+0000 7fede5400640 1 -- 172.21.15.42:0/3603689558 >> 172.21.15.42:0/3603689558 conn(0x7fede00b6140 msgr2=0x7fede00b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:40.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.621+0000 7fede5400640 1 -- 172.21.15.42:0/3603689558 shutdown_connections 2024-09-17T01:38:40.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.621+0000 7fede5400640 1 -- 172.21.15.42:0/3603689558 wait complete. 2024-09-17T01:38:40.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.623+0000 7fede5400640 1 Processor -- start 2024-09-17T01:38:40.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.623+0000 7fede5400640 1 -- start start 2024-09-17T01:38:40.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.625+0000 7fede5400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fede00cfba0 0x7fede00cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:40.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.625+0000 7fede5400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fede00d0e10 0x7fede00cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:40.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.625+0000 7fede5400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fede0162500 0x7fede014d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:40.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.625+0000 7fede5400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fede00b31e0 con 0x7fede00d0e10 2024-09-17T01:38:40.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.625+0000 7fede5400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fede00b3060 con 0x7fede00cfba0 2024-09-17T01:38:40.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.625+0000 7fede5400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fede00b3360 con 0x7fede0162500 2024-09-17T01:38:40.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.625+0000 7fedd7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fede00d0e10 0x7fede00cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:40.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.625+0000 7fedd7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fede00d0e10 0x7fede00cb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42700/0 (socket says 172.21.15.42:42700) 2024-09-17T01:38:40.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.625+0000 7fedd7e00640 1 -- 172.21.15.42:0/637052988 learned_addr learned my addr 172.21.15.42:0/637052988 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:40.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.625+0000 7fede4a00640 1 --2- 172.21.15.42:0/637052988 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fede0162500 0x7fede014d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:40.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.625+0000 7feddfe00640 1 --2- 172.21.15.42:0/637052988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fede00cfba0 0x7fede00cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:40.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.625+0000 7fedd7e00640 1 -- 172.21.15.42:0/637052988 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fede0162500 msgr2=0x7fede014d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:40.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.625+0000 7fedd7e00640 1 --2- 172.21.15.42:0/637052988 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fede0162500 0x7fede014d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.625+0000 7fedd7e00640 1 -- 172.21.15.42:0/637052988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fede00cfba0 msgr2=0x7fede00cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.625+0000 7fedd7e00640 1 --2- 172.21.15.42:0/637052988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fede00cfba0 0x7fede00cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.625+0000 7fedd7e00640 1 -- 172.21.15.42:0/637052988 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede00cb220 con 0x7fede00d0e10 2024-09-17T01:38:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.626+0000 7fedd7e00640 1 --2- 172.21.15.42:0/637052988 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fede00d0e10 0x7fede00cb700 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fedc80099d0 tx=0x7fedc80052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.626+0000 7feddcc00640 1 -- 172.21.15.42:0/637052988 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc8005cf0 con 0x7fede00d0e10 2024-09-17T01:38:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.626+0000 7feddcc00640 1 -- 172.21.15.42:0/637052988 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fedc8031c40 con 0x7fede00d0e10 2024-09-17T01:38:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.626+0000 7fede5400640 1 -- 172.21.15.42:0/637052988 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fede00ce350 con 0x7fede00d0e10 2024-09-17T01:38:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.626+0000 7feddcc00640 1 -- 172.21.15.42:0/637052988 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc8033330 con 0x7fede00d0e10 2024-09-17T01:38:40.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.626+0000 7fede5400640 1 -- 172.21.15.42:0/637052988 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fede00ce910 con 0x7fede00d0e10 2024-09-17T01:38:40.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.627+0000 7fede5400640 1 -- 172.21.15.42:0/637052988 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fede00d1220 con 0x7fede00d0e10 2024-09-17T01:38:40.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.629+0000 7feddcc00640 1 -- 172.21.15.42:0/637052988 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fedc80334d0 con 0x7fede00d0e10 2024-09-17T01:38:40.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.630+0000 7feddcc00640 1 --2- 172.21.15.42:0/637052988 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fedbc078b90 0x7fedbc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.630+0000 7feddcc00640 1 -- 172.21.15.42:0/637052988 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5709+0+0 (secure 0 0 0) 0x7fedc80bc0a0 con 0x7fede00d0e10 2024-09-17T01:38:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.630+0000 7feddfe00640 1 --2- 172.21.15.42:0/637052988 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fedbc078b90 0x7fedbc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:40.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.631+0000 7feddfe00640 1 --2- 172.21.15.42:0/637052988 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fedbc078b90 0x7fedbc07b0a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fedd0006fd0 tx=0x7fedd0009060 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:40.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.635+0000 7feddcc00640 1 -- 172.21.15.42:0/637052988 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fedc803f030 con 0x7fede00d0e10 2024-09-17T01:38:40.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.865+0000 7fede5400640 1 -- 172.21.15.42:0/637052988 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fede015bd40 con 0x7fede00d0e10 2024-09-17T01:38:40.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.865+0000 7feddcc00640 1 -- 172.21.15.42:0/637052988 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+5225 (secure 0 0 0) 0x7fedc8031770 con 0x7fede00d0e10 2024-09-17T01:38:40.863 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:38:40.863 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":88,"btime":"2024-09-17T01:38:40:360685+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6620,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3878726745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3878726745},{"type":"v1","addr":"172.21.15.43:6836","nonce":3878726745}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":7255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2458291962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":2458291962},{"type":"v1","addr":"172.21.15.42:6835","nonce":2458291962}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":7261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2788778312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2788778312},{"type":"v1","addr":"172.21.15.43:6837","nonce":2788778312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:38:36.843275+0000","modified":"2024-09-17T01:38:39.867027+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7644},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7644":{"gid":7644,"name":"c","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6834/1078007521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1078007521},{"type":"v1","addr":"172.21.15.42:6834","nonce":1078007521}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7644,"qdb_cluster":[7644]},"id":7}]} 2024-09-17T01:38:40.863 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 88 2024-09-17T01:38:40.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.868+0000 7fede5400640 1 -- 172.21.15.42:0/637052988 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fedbc078b90 msgr2=0x7fedbc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.868+0000 7fede5400640 1 --2- 172.21.15.42:0/637052988 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fedbc078b90 0x7fedbc07b0a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fedd0006fd0 tx=0x7fedd0009060 comp rx=0 tx=0).stop 2024-09-17T01:38:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.868+0000 7fede5400640 1 -- 172.21.15.42:0/637052988 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fede00d0e10 msgr2=0x7fede00cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.868+0000 7fede5400640 1 --2- 172.21.15.42:0/637052988 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fede00d0e10 0x7fede00cb700 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fedc80099d0 tx=0x7fedc80052f0 comp rx=0 tx=0).stop 2024-09-17T01:38:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.868+0000 7fede5400640 1 -- 172.21.15.42:0/637052988 shutdown_connections 2024-09-17T01:38:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.868+0000 7fede5400640 1 --2- 172.21.15.42:0/637052988 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fedbc078b90 0x7fedbc07b0a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.868+0000 7fede5400640 1 --2- 172.21.15.42:0/637052988 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fede0162500 0x7fede014d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.868+0000 7fede5400640 1 --2- 172.21.15.42:0/637052988 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fede00d0e10 0x7fede00cb700 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.868+0000 7fede5400640 1 --2- 172.21.15.42:0/637052988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fede00cfba0 0x7fede00cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.868+0000 7fede5400640 1 -- 172.21.15.42:0/637052988 >> 172.21.15.42:0/637052988 conn(0x7fede00b6140 msgr2=0x7fede0160cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.868+0000 7fede5400640 1 -- 172.21.15.42:0/637052988 shutdown_connections 2024-09-17T01:38:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:40.868+0000 7fede5400640 1 -- 172.21.15.42:0/637052988 wait complete. 2024-09-17T01:38:40.892 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:38:41.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.121+0000 7f04afc00640 1 -- 172.21.15.42:0/900275121 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a815cb80 msgr2=0x7f04a8152530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:41.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.121+0000 7f04afc00640 1 --2- 172.21.15.42:0/900275121 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a815cb80 0x7f04a8152530 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f0498009830 tx=0x7f049802a480 comp rx=0 tx=0).stop 2024-09-17T01:38:41.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.121+0000 7f04afc00640 1 -- 172.21.15.42:0/900275121 shutdown_connections 2024-09-17T01:38:41.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.121+0000 7f04afc00640 1 --2- 172.21.15.42:0/900275121 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a815cb80 0x7f04a8152530 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:41.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.121+0000 7f04afc00640 1 -- 172.21.15.42:0/900275121 >> 172.21.15.42:0/900275121 conn(0x7f04a80b2930 msgr2=0x7f04a806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:41.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.122+0000 7f04afc00640 1 -- 172.21.15.42:0/900275121 shutdown_connections 2024-09-17T01:38:41.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.122+0000 7f04afc00640 1 -- 172.21.15.42:0/900275121 wait complete. 2024-09-17T01:38:41.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.124+0000 7f04afc00640 1 Processor -- start 2024-09-17T01:38:41.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.124+0000 7f04afc00640 1 -- start start 2024-09-17T01:38:41.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.126+0000 7f04afc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f04a8152a70 0x7f04a81f5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:41.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.126+0000 7f04afc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a815cb80 0x7f04a814d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:41.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.126+0000 7f04afc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04a81556e0 0x7f04a8155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:41.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.126+0000 7f04afc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f04a80738a0 con 0x7f04a815cb80 2024-09-17T01:38:41.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.126+0000 7f04afc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f04a8073720 con 0x7f04a81556e0 2024-09-17T01:38:41.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.126+0000 7f04afc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f04a8073a20 con 0x7f04a8152a70 2024-09-17T01:38:41.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.126+0000 7f049fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a815cb80 0x7f04a814d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:41.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.126+0000 7f049fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a815cb80 0x7f04a814d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42722/0 (socket says 172.21.15.42:42722) 2024-09-17T01:38:41.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.126+0000 7f049fe00640 1 -- 172.21.15.42:0/4143511613 learned_addr learned my addr 172.21.15.42:0/4143511613 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:41.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.126+0000 7f04ad200640 1 --2- 172.21.15.42:0/4143511613 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f04a8152a70 0x7f04a81f5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:41.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.126+0000 7f04adc00640 1 --2- 172.21.15.42:0/4143511613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04a81556e0 0x7f04a8155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:41.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.126+0000 7f049fe00640 1 -- 172.21.15.42:0/4143511613 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f04a8152a70 msgr2=0x7f04a81f5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:41.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.126+0000 7f049fe00640 1 --2- 172.21.15.42:0/4143511613 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f04a8152a70 0x7f04a81f5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:41.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.126+0000 7f049fe00640 1 -- 172.21.15.42:0/4143511613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04a81556e0 msgr2=0x7f04a8155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:41.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.126+0000 7f049fe00640 1 --2- 172.21.15.42:0/4143511613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04a81556e0 0x7f04a8155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:41.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.126+0000 7f049fe00640 1 -- 172.21.15.42:0/4143511613 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a81f5fc0 con 0x7f04a815cb80 2024-09-17T01:38:41.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.127+0000 7f049fe00640 1 --2- 172.21.15.42:0/4143511613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a815cb80 0x7f04a814d450 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f049000c3e0 tx=0x7f049000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:41.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.127+0000 7f04a5600640 1 -- 172.21.15.42:0/4143511613 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0490011790 con 0x7f04a815cb80 2024-09-17T01:38:41.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.127+0000 7f04a5600640 1 -- 172.21.15.42:0/4143511613 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0490017070 con 0x7f04a815cb80 2024-09-17T01:38:41.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.127+0000 7f04afc00640 1 -- 172.21.15.42:0/4143511613 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a814f620 con 0x7f04a815cb80 2024-09-17T01:38:41.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.127+0000 7f04a5600640 1 -- 172.21.15.42:0/4143511613 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0490011ce0 con 0x7f04a815cb80 2024-09-17T01:38:41.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.127+0000 7f04afc00640 1 -- 172.21.15.42:0/4143511613 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a814fbe0 con 0x7f04a815cb80 2024-09-17T01:38:41.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.128+0000 7f04afc00640 1 -- 172.21.15.42:0/4143511613 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a814f390 con 0x7f04a815cb80 2024-09-17T01:38:41.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.130+0000 7f04a5600640 1 -- 172.21.15.42:0/4143511613 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f049001c460 con 0x7f04a815cb80 2024-09-17T01:38:41.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.131+0000 7f04a5600640 1 --2- 172.21.15.42:0/4143511613 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0484078bc0 0x7f048407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:41.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.131+0000 7f04a5600640 1 -- 172.21.15.42:0/4143511613 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5709+0+0 (secure 0 0 0) 0x7f049009a9d0 con 0x7f04a815cb80 2024-09-17T01:38:41.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.131+0000 7f04ad200640 1 --2- 172.21.15.42:0/4143511613 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0484078bc0 0x7f048407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:41.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.132+0000 7f04ad200640 1 --2- 172.21.15.42:0/4143511613 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0484078bc0 0x7f048407b0d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0498034000 tx=0x7f0498004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:41.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.135+0000 7f04a5600640 1 -- 172.21.15.42:0/4143511613 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0490062880 con 0x7f04a815cb80 2024-09-17T01:38:41.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.333+0000 7f04afc00640 1 -- 172.21.15.42:0/4143511613 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f04a81f90a0 con 0x7f04a815cb80 2024-09-17T01:38:41.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.335+0000 7f04a5600640 1 -- 172.21.15.42:0/4143511613 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) ==== 74+0+16631 (secure 0 0 0) 0x7f04900672b0 con 0x7f04a815cb80 2024-09-17T01:38:41.333 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:38:41.333 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":108,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:38:38.347388+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:38:34.801865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T01:38:35.805587+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:38:41.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.337+0000 7f04afc00640 1 -- 172.21.15.42:0/4143511613 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0484078bc0 msgr2=0x7f048407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:41.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.337+0000 7f04afc00640 1 --2- 172.21.15.42:0/4143511613 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0484078bc0 0x7f048407b0d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0498034000 tx=0x7f0498004730 comp rx=0 tx=0).stop 2024-09-17T01:38:41.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.337+0000 7f04afc00640 1 -- 172.21.15.42:0/4143511613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a815cb80 msgr2=0x7f04a814d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:41.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.337+0000 7f04afc00640 1 --2- 172.21.15.42:0/4143511613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a815cb80 0x7f04a814d450 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f049000c3e0 tx=0x7f049000c8a0 comp rx=0 tx=0).stop 2024-09-17T01:38:41.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.337+0000 7f04afc00640 1 -- 172.21.15.42:0/4143511613 shutdown_connections 2024-09-17T01:38:41.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.337+0000 7f04afc00640 1 --2- 172.21.15.42:0/4143511613 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0484078bc0 0x7f048407b0d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:41.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.337+0000 7f04afc00640 1 --2- 172.21.15.42:0/4143511613 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04a81556e0 0x7f04a8155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:41.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.337+0000 7f04afc00640 1 --2- 172.21.15.42:0/4143511613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a815cb80 0x7f04a814d450 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:41.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.337+0000 7f04afc00640 1 --2- 172.21.15.42:0/4143511613 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f04a8152a70 0x7f04a81f5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:41.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.337+0000 7f04afc00640 1 -- 172.21.15.42:0/4143511613 >> 172.21.15.42:0/4143511613 conn(0x7f04a80b2930 msgr2=0x7f04a806d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:41.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.337+0000 7f04afc00640 1 -- 172.21.15.42:0/4143511613 shutdown_connections 2024-09-17T01:38:41.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.337+0000 7f04afc00640 1 -- 172.21.15.42:0/4143511613 wait complete. 2024-09-17T01:38:41.362 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T01:38:41.362 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:38:41.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.591+0000 7f3785800640 1 -- 172.21.15.42:0/2782787178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37800cf7c0 msgr2=0x7f378006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:41.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.592+0000 7f3785800640 1 --2- 172.21.15.42:0/2782787178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37800cf7c0 0x7f378006cd20 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f376c009830 tx=0x7f376c02a510 comp rx=0 tx=0).stop 2024-09-17T01:38:41.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.592+0000 7f3785800640 1 -- 172.21.15.42:0/2782787178 shutdown_connections 2024-09-17T01:38:41.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.592+0000 7f3785800640 1 --2- 172.21.15.42:0/2782787178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37800cf7c0 0x7f378006cd20 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:41.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.592+0000 7f3785800640 1 --2- 172.21.15.42:0/2782787178 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f37800b4be0 0x7f378015d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:41.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.592+0000 7f3785800640 1 -- 172.21.15.42:0/2782787178 >> 172.21.15.42:0/2782787178 conn(0x7f37800b25f0 msgr2=0x7f37800d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:41.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.592+0000 7f3785800640 1 -- 172.21.15.42:0/2782787178 shutdown_connections 2024-09-17T01:38:41.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.592+0000 7f3785800640 1 -- 172.21.15.42:0/2782787178 wait complete. 2024-09-17T01:38:41.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.594+0000 7f3785800640 1 Processor -- start 2024-09-17T01:38:41.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.594+0000 7f3785800640 1 -- start start 2024-09-17T01:38:41.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.595+0000 7f3785800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f378006d260 0x7f37801522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:41.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.595+0000 7f3785800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37800b4be0 0x7f37801f92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:41.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.595+0000 7f3785800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37800cf7c0 0x7f37801f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:41.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.596+0000 7f3785800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f37801537f0 con 0x7f37800b4be0 2024-09-17T01:38:41.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.596+0000 7f3785800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f37800cfdc0 con 0x7f37800cf7c0 2024-09-17T01:38:41.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.596+0000 7f3785800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3780153970 con 0x7f378006d260 2024-09-17T01:38:41.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.596+0000 7f377f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37800b4be0 0x7f37801f92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:41.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.596+0000 7f377f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37800b4be0 0x7f37801f92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42734/0 (socket says 172.21.15.42:42734) 2024-09-17T01:38:41.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.596+0000 7f377f400640 1 -- 172.21.15.42:0/3697293897 learned_addr learned my addr 172.21.15.42:0/3697293897 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:41.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.596+0000 7f377fe00640 1 --2- 172.21.15.42:0/3697293897 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f378006d260 0x7f37801522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:41.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.596+0000 7f3784e00640 1 --2- 172.21.15.42:0/3697293897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37800cf7c0 0x7f37801f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:41.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.596+0000 7f377f400640 1 -- 172.21.15.42:0/3697293897 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f378006d260 msgr2=0x7f37801522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:41.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.596+0000 7f377f400640 1 --2- 172.21.15.42:0/3697293897 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f378006d260 0x7f37801522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:41.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.596+0000 7f377f400640 1 -- 172.21.15.42:0/3697293897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37800cf7c0 msgr2=0x7f37801f5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:41.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.596+0000 7f377f400640 1 --2- 172.21.15.42:0/3697293897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37800cf7c0 0x7f37801f5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:41.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.596+0000 7f377f400640 1 -- 172.21.15.42:0/3697293897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3780154d20 con 0x7f37800b4be0 2024-09-17T01:38:41.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.596+0000 7f3784e00640 1 --2- 172.21.15.42:0/3697293897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37800cf7c0 0x7f37801f5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:41.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.597+0000 7f377f400640 1 --2- 172.21.15.42:0/3697293897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37800b4be0 0x7f37801f92d0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f376c009950 tx=0x7f376c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:41.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.597+0000 7f3777e00640 1 -- 172.21.15.42:0/3697293897 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c005220 con 0x7f37800b4be0 2024-09-17T01:38:41.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.597+0000 7f3777e00640 1 -- 172.21.15.42:0/3697293897 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f376c0054b0 con 0x7f37800b4be0 2024-09-17T01:38:41.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.597+0000 7f3777e00640 1 -- 172.21.15.42:0/3697293897 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c004a00 con 0x7f37800b4be0 2024-09-17T01:38:41.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.597+0000 7f3785800640 1 -- 172.21.15.42:0/3697293897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3780154780 con 0x7f37800b4be0 2024-09-17T01:38:41.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.597+0000 7f3785800640 1 -- 172.21.15.42:0/3697293897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37801f5680 con 0x7f37800b4be0 2024-09-17T01:38:41.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.598+0000 7f3785800640 1 -- 172.21.15.42:0/3697293897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37801f63c0 con 0x7f37800b4be0 2024-09-17T01:38:41.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.599+0000 7f3777e00640 1 -- 172.21.15.42:0/3697293897 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f376c004ba0 con 0x7f37800b4be0 2024-09-17T01:38:41.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.601+0000 7f3777e00640 1 --2- 172.21.15.42:0/3697293897 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3760078b90 0x7f376007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:41.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.601+0000 7f3777e00640 1 -- 172.21.15.42:0/3697293897 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5709+0+0 (secure 0 0 0) 0x7f376c0bc0a0 con 0x7f37800b4be0 2024-09-17T01:38:41.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.602+0000 7f377fe00640 1 --2- 172.21.15.42:0/3697293897 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3760078b90 0x7f376007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:41.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.602+0000 7f377fe00640 1 --2- 172.21.15.42:0/3697293897 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3760078b90 0x7f376007b0a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3770009b30 tx=0x7f3770005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:41.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.606+0000 7f3777e00640 1 -- 172.21.15.42:0/3697293897 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f37801f63c0 con 0x7f37800b4be0 2024-09-17T01:38:41.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.794+0000 7f3785800640 1 -- 172.21.15.42:0/3697293897 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f37801f9810 con 0x7f3760078b90 2024-09-17T01:38:41.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.799+0000 7f3777e00640 1 -- 172.21.15.42:0/3697293897 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252469 (secure 0 0 0) 0x7f37801f9810 con 0x7f3760078b90 2024-09-17T01:38:41.800 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:38:41.802 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:38:41.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.804+0000 7f3785800640 1 -- 172.21.15.42:0/3697293897 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3760078b90 msgr2=0x7f376007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:41.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.804+0000 7f3785800640 1 --2- 172.21.15.42:0/3697293897 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3760078b90 0x7f376007b0a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3770009b30 tx=0x7f3770005f90 comp rx=0 tx=0).stop 2024-09-17T01:38:41.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.804+0000 7f3785800640 1 -- 172.21.15.42:0/3697293897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37800b4be0 msgr2=0x7f37801f92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:41.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.804+0000 7f3785800640 1 --2- 172.21.15.42:0/3697293897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37800b4be0 0x7f37801f92d0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f376c009950 tx=0x7f376c0040c0 comp rx=0 tx=0).stop 2024-09-17T01:38:41.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.804+0000 7f3785800640 1 -- 172.21.15.42:0/3697293897 shutdown_connections 2024-09-17T01:38:41.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.804+0000 7f3785800640 1 --2- 172.21.15.42:0/3697293897 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3760078b90 0x7f376007b0a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:41.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.804+0000 7f3785800640 1 --2- 172.21.15.42:0/3697293897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37800cf7c0 0x7f37801f5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:41.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.804+0000 7f3785800640 1 --2- 172.21.15.42:0/3697293897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37800b4be0 0x7f37801f92d0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:41.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.804+0000 7f3785800640 1 --2- 172.21.15.42:0/3697293897 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f378006d260 0x7f37801522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:41.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.804+0000 7f3785800640 1 -- 172.21.15.42:0/3697293897 >> 172.21.15.42:0/3697293897 conn(0x7f37800b25f0 msgr2=0x7f37800d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:41.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.804+0000 7f3785800640 1 -- 172.21.15.42:0/3697293897 shutdown_connections 2024-09-17T01:38:41.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:41.804+0000 7f3785800640 1 -- 172.21.15.42:0/3697293897 wait complete. 2024-09-17T01:38:41.823 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2024-09-17T01:38:41.090299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":298544,"kb_used_data":11568,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754676176,"statfs":{"total":773094113280,"available":772788404224,"internally_reserved":0,"allocated":11845632,"data_stored":5797708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":293654068},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.774287"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.360221+0000","last_change":"2024-09-17T01:38:37.353122+0000","last_active":"2024-09-17T01:38:38.360221+0000","last_peered":"2024-09-17T01:38:38.360221+0000","last_clean":"2024-09-17T01:38:38.360221+0000","last_became_active":"2024-09-17T01:38:37.352724+0000","last_became_peered":"2024-09-17T01:38:37.352724+0000","last_unstale":"2024-09-17T01:38:38.360221+0000","last_undegraded":"2024-09-17T01:38:38.360221+0000","last_fullsized":"2024-09-17T01:38:38.360221+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:21.923447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.360207+0000","last_change":"2024-09-17T01:38:37.363976+0000","last_active":"2024-09-17T01:38:38.360207+0000","last_peered":"2024-09-17T01:38:38.360207+0000","last_clean":"2024-09-17T01:38:38.360207+0000","last_became_active":"2024-09-17T01:38:37.363645+0000","last_became_peered":"2024-09-17T01:38:37.363645+0000","last_unstale":"2024-09-17T01:38:38.360207+0000","last_undegraded":"2024-09-17T01:38:38.360207+0000","last_fullsized":"2024-09-17T01:38:38.360207+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:25.524914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.358460+0000","last_change":"2024-09-17T01:38:37.366826+0000","last_active":"2024-09-17T01:38:38.358460+0000","last_peered":"2024-09-17T01:38:38.358460+0000","last_clean":"2024-09-17T01:38:38.358460+0000","last_became_active":"2024-09-17T01:38:37.361891+0000","last_became_peered":"2024-09-17T01:38:37.361891+0000","last_unstale":"2024-09-17T01:38:38.358460+0000","last_undegraded":"2024-09-17T01:38:38.358460+0000","last_fullsized":"2024-09-17T01:38:38.358460+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:25.181805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.360210+0000","last_change":"2024-09-17T01:38:37.371776+0000","last_active":"2024-09-17T01:38:38.360210+0000","last_peered":"2024-09-17T01:38:38.360210+0000","last_clean":"2024-09-17T01:38:38.360210+0000","last_became_active":"2024-09-17T01:38:37.371144+0000","last_became_peered":"2024-09-17T01:38:37.371144+0000","last_unstale":"2024-09-17T01:38:38.360210+0000","last_undegraded":"2024-09-17T01:38:38.360210+0000","last_fullsized":"2024-09-17T01:38:38.360210+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:38.430513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.306096+0000","last_change":"2024-09-17T01:38:37.355042+0000","last_active":"2024-09-17T01:38:39.306096+0000","last_peered":"2024-09-17T01:38:39.306096+0000","last_clean":"2024-09-17T01:38:39.306096+0000","last_became_active":"2024-09-17T01:38:37.354662+0000","last_became_peered":"2024-09-17T01:38:37.354662+0000","last_unstale":"2024-09-17T01:38:39.306096+0000","last_undegraded":"2024-09-17T01:38:39.306096+0000","last_fullsized":"2024-09-17T01:38:39.306096+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:58.881566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.306059+0000","last_change":"2024-09-17T01:38:37.364278+0000","last_active":"2024-09-17T01:38:39.306059+0000","last_peered":"2024-09-17T01:38:39.306059+0000","last_clean":"2024-09-17T01:38:39.306059+0000","last_became_active":"2024-09-17T01:38:37.363978+0000","last_became_peered":"2024-09-17T01:38:37.363978+0000","last_unstale":"2024-09-17T01:38:39.306059+0000","last_undegraded":"2024-09-17T01:38:39.306059+0000","last_fullsized":"2024-09-17T01:38:39.306059+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:41.092147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.305918+0000","last_change":"2024-09-17T01:38:37.363644+0000","last_active":"2024-09-17T01:38:39.305918+0000","last_peered":"2024-09-17T01:38:39.305918+0000","last_clean":"2024-09-17T01:38:39.305918+0000","last_became_active":"2024-09-17T01:38:37.354988+0000","last_became_peered":"2024-09-17T01:38:37.354988+0000","last_unstale":"2024-09-17T01:38:39.305918+0000","last_undegraded":"2024-09-17T01:38:39.305918+0000","last_fullsized":"2024-09-17T01:38:39.305918+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:40.121825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.357464+0000","last_change":"2024-09-17T01:38:37.354990+0000","last_active":"2024-09-17T01:38:38.357464+0000","last_peered":"2024-09-17T01:38:38.357464+0000","last_clean":"2024-09-17T01:38:38.357464+0000","last_became_active":"2024-09-17T01:38:37.354623+0000","last_became_peered":"2024-09-17T01:38:37.354623+0000","last_unstale":"2024-09-17T01:38:38.357464+0000","last_undegraded":"2024-09-17T01:38:38.357464+0000","last_fullsized":"2024-09-17T01:38:38.357464+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:28.119522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.306797+0000","last_change":"2024-09-17T01:38:37.353836+0000","last_active":"2024-09-17T01:38:39.306797+0000","last_peered":"2024-09-17T01:38:39.306797+0000","last_clean":"2024-09-17T01:38:39.306797+0000","last_became_active":"2024-09-17T01:38:37.353471+0000","last_became_peered":"2024-09-17T01:38:37.353471+0000","last_unstale":"2024-09-17T01:38:39.306797+0000","last_undegraded":"2024-09-17T01:38:39.306797+0000","last_fullsized":"2024-09-17T01:38:39.306797+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:44.622888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.511315+0000","last_change":"2024-09-17T01:38:37.363971+0000","last_active":"2024-09-17T01:38:38.511315+0000","last_peered":"2024-09-17T01:38:38.511315+0000","last_clean":"2024-09-17T01:38:38.511315+0000","last_became_active":"2024-09-17T01:38:37.363635+0000","last_became_peered":"2024-09-17T01:38:37.363635+0000","last_unstale":"2024-09-17T01:38:38.511315+0000","last_undegraded":"2024-09-17T01:38:38.511315+0000","last_fullsized":"2024-09-17T01:38:38.511315+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:23.408821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.306619+0000","last_change":"2024-09-17T01:38:37.365485+0000","last_active":"2024-09-17T01:38:39.306619+0000","last_peered":"2024-09-17T01:38:39.306619+0000","last_clean":"2024-09-17T01:38:39.306619+0000","last_became_active":"2024-09-17T01:38:37.365172+0000","last_became_peered":"2024-09-17T01:38:37.365172+0000","last_unstale":"2024-09-17T01:38:39.306619+0000","last_undegraded":"2024-09-17T01:38:39.306619+0000","last_fullsized":"2024-09-17T01:38:39.306619+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:31:28.292606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.355883+0000","last_change":"2024-09-17T01:38:37.382634+0000","last_active":"2024-09-17T01:38:38.355883+0000","last_peered":"2024-09-17T01:38:38.355883+0000","last_clean":"2024-09-17T01:38:38.355883+0000","last_became_active":"2024-09-17T01:38:37.381478+0000","last_became_peered":"2024-09-17T01:38:37.381478+0000","last_unstale":"2024-09-17T01:38:38.355883+0000","last_undegraded":"2024-09-17T01:38:38.355883+0000","last_fullsized":"2024-09-17T01:38:38.355883+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:53.482607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.153173+0000","last_change":"2024-09-17T01:38:37.374833+0000","last_active":"2024-09-17T01:38:39.153173+0000","last_peered":"2024-09-17T01:38:39.153173+0000","last_clean":"2024-09-17T01:38:39.153173+0000","last_became_active":"2024-09-17T01:38:37.374449+0000","last_became_peered":"2024-09-17T01:38:37.374449+0000","last_unstale":"2024-09-17T01:38:39.153173+0000","last_undegraded":"2024-09-17T01:38:39.153173+0000","last_fullsized":"2024-09-17T01:38:39.153173+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:48.112376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.358792+0000","last_change":"2024-09-17T01:38:37.362260+0000","last_active":"2024-09-17T01:38:38.358792+0000","last_peered":"2024-09-17T01:38:38.358792+0000","last_clean":"2024-09-17T01:38:38.358792+0000","last_became_active":"2024-09-17T01:38:37.361062+0000","last_became_peered":"2024-09-17T01:38:37.361062+0000","last_unstale":"2024-09-17T01:38:38.358792+0000","last_undegraded":"2024-09-17T01:38:38.358792+0000","last_fullsized":"2024-09-17T01:38:38.358792+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:33:38.011617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.358229+0000","last_change":"2024-09-17T01:38:37.363200+0000","last_active":"2024-09-17T01:38:38.358229+0000","last_peered":"2024-09-17T01:38:38.358229+0000","last_clean":"2024-09-17T01:38:38.358229+0000","last_became_active":"2024-09-17T01:38:37.362852+0000","last_became_peered":"2024-09-17T01:38:37.362852+0000","last_unstale":"2024-09-17T01:38:38.358229+0000","last_undegraded":"2024-09-17T01:38:38.358229+0000","last_fullsized":"2024-09-17T01:38:38.358229+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:15.073340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.305926+0000","last_change":"2024-09-17T01:38:37.369906+0000","last_active":"2024-09-17T01:38:39.305926+0000","last_peered":"2024-09-17T01:38:39.305926+0000","last_clean":"2024-09-17T01:38:39.305926+0000","last_became_active":"2024-09-17T01:38:37.369527+0000","last_became_peered":"2024-09-17T01:38:37.369527+0000","last_unstale":"2024-09-17T01:38:39.305926+0000","last_undegraded":"2024-09-17T01:38:39.305926+0000","last_fullsized":"2024-09-17T01:38:39.305926+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:03:03.892841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.377664+0000","last_change":"2024-09-17T01:38:37.370510+0000","last_active":"2024-09-17T01:38:37.377664+0000","last_peered":"2024-09-17T01:38:37.377664+0000","last_clean":"2024-09-17T01:38:37.377664+0000","last_became_active":"2024-09-17T01:38:37.370181+0000","last_became_peered":"2024-09-17T01:38:37.370181+0000","last_unstale":"2024-09-17T01:38:37.377664+0000","last_undegraded":"2024-09-17T01:38:37.377664+0000","last_fullsized":"2024-09-17T01:38:37.377664+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:00.124842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.360219+0000","last_change":"2024-09-17T01:38:37.362506+0000","last_active":"2024-09-17T01:38:38.360219+0000","last_peered":"2024-09-17T01:38:38.360219+0000","last_clean":"2024-09-17T01:38:38.360219+0000","last_became_active":"2024-09-17T01:38:37.361904+0000","last_became_peered":"2024-09-17T01:38:37.361904+0000","last_unstale":"2024-09-17T01:38:38.360219+0000","last_undegraded":"2024-09-17T01:38:38.360219+0000","last_fullsized":"2024-09-17T01:38:38.360219+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:22:42.557038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.376600+0000","last_change":"2024-09-17T01:38:37.369268+0000","last_active":"2024-09-17T01:38:37.376600+0000","last_peered":"2024-09-17T01:38:37.376600+0000","last_clean":"2024-09-17T01:38:37.376600+0000","last_became_active":"2024-09-17T01:38:37.368948+0000","last_became_peered":"2024-09-17T01:38:37.368948+0000","last_unstale":"2024-09-17T01:38:37.376600+0000","last_undegraded":"2024-09-17T01:38:37.376600+0000","last_fullsized":"2024-09-17T01:38:37.376600+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:49.602598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.356136+0000","last_change":"2024-09-17T01:38:37.360566+0000","last_active":"2024-09-17T01:38:38.356136+0000","last_peered":"2024-09-17T01:38:38.356136+0000","last_clean":"2024-09-17T01:38:38.356136+0000","last_became_active":"2024-09-17T01:38:37.360205+0000","last_became_peered":"2024-09-17T01:38:37.360205+0000","last_unstale":"2024-09-17T01:38:38.356136+0000","last_undegraded":"2024-09-17T01:38:38.356136+0000","last_fullsized":"2024-09-17T01:38:38.356136+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:37.847199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.359453+0000","last_change":"2024-09-17T01:38:37.351350+0000","last_active":"2024-09-17T01:38:38.359453+0000","last_peered":"2024-09-17T01:38:38.359453+0000","last_clean":"2024-09-17T01:38:38.359453+0000","last_became_active":"2024-09-17T01:38:37.351023+0000","last_became_peered":"2024-09-17T01:38:37.351023+0000","last_unstale":"2024-09-17T01:38:38.359453+0000","last_undegraded":"2024-09-17T01:38:38.359453+0000","last_fullsized":"2024-09-17T01:38:38.359453+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:01.505068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.358126+0000","last_change":"2024-09-17T01:38:37.352636+0000","last_active":"2024-09-17T01:38:38.358126+0000","last_peered":"2024-09-17T01:38:38.358126+0000","last_clean":"2024-09-17T01:38:38.358126+0000","last_became_active":"2024-09-17T01:38:37.352311+0000","last_became_peered":"2024-09-17T01:38:37.352311+0000","last_unstale":"2024-09-17T01:38:38.358126+0000","last_undegraded":"2024-09-17T01:38:38.358126+0000","last_fullsized":"2024-09-17T01:38:38.358126+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:57:17.961384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.359076+0000","last_change":"2024-09-17T01:38:37.361349+0000","last_active":"2024-09-17T01:38:38.359076+0000","last_peered":"2024-09-17T01:38:38.359076+0000","last_clean":"2024-09-17T01:38:38.359076+0000","last_became_active":"2024-09-17T01:38:37.360977+0000","last_became_peered":"2024-09-17T01:38:37.360977+0000","last_unstale":"2024-09-17T01:38:38.359076+0000","last_undegraded":"2024-09-17T01:38:38.359076+0000","last_fullsized":"2024-09-17T01:38:38.359076+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:09.670564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.430403+0000","last_change":"2024-09-17T01:38:37.372102+0000","last_active":"2024-09-17T01:38:38.430403+0000","last_peered":"2024-09-17T01:38:38.430403+0000","last_clean":"2024-09-17T01:38:38.430403+0000","last_became_active":"2024-09-17T01:38:37.371822+0000","last_became_peered":"2024-09-17T01:38:37.371822+0000","last_unstale":"2024-09-17T01:38:38.430403+0000","last_undegraded":"2024-09-17T01:38:38.430403+0000","last_fullsized":"2024-09-17T01:38:38.430403+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:58.123427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.511284+0000","last_change":"2024-09-17T01:38:37.376402+0000","last_active":"2024-09-17T01:38:38.511284+0000","last_peered":"2024-09-17T01:38:38.511284+0000","last_clean":"2024-09-17T01:38:38.511284+0000","last_became_active":"2024-09-17T01:38:37.376080+0000","last_became_peered":"2024-09-17T01:38:37.376080+0000","last_unstale":"2024-09-17T01:38:38.511284+0000","last_undegraded":"2024-09-17T01:38:38.511284+0000","last_fullsized":"2024-09-17T01:38:38.511284+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:05.615626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.153338+0000","last_change":"2024-09-17T01:38:37.374450+0000","last_active":"2024-09-17T01:38:39.153338+0000","last_peered":"2024-09-17T01:38:39.153338+0000","last_clean":"2024-09-17T01:38:39.153338+0000","last_became_active":"2024-09-17T01:38:37.374077+0000","last_became_peered":"2024-09-17T01:38:37.374077+0000","last_unstale":"2024-09-17T01:38:39.153338+0000","last_undegraded":"2024-09-17T01:38:39.153338+0000","last_fullsized":"2024-09-17T01:38:39.153338+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:44:00.188229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.431067+0000","last_change":"2024-09-17T01:38:37.369745+0000","last_active":"2024-09-17T01:38:38.431067+0000","last_peered":"2024-09-17T01:38:38.431067+0000","last_clean":"2024-09-17T01:38:38.431067+0000","last_became_active":"2024-09-17T01:38:37.367679+0000","last_became_peered":"2024-09-17T01:38:37.367679+0000","last_unstale":"2024-09-17T01:38:38.431067+0000","last_undegraded":"2024-09-17T01:38:38.431067+0000","last_fullsized":"2024-09-17T01:38:38.431067+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:57.501151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.430610+0000","last_change":"2024-09-17T01:38:37.361326+0000","last_active":"2024-09-17T01:38:38.430610+0000","last_peered":"2024-09-17T01:38:38.430610+0000","last_clean":"2024-09-17T01:38:38.430610+0000","last_became_active":"2024-09-17T01:38:37.361027+0000","last_became_peered":"2024-09-17T01:38:37.361027+0000","last_unstale":"2024-09-17T01:38:38.430610+0000","last_undegraded":"2024-09-17T01:38:38.430610+0000","last_fullsized":"2024-09-17T01:38:38.430610+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:16.410314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.153310+0000","last_change":"2024-09-17T01:38:37.365885+0000","last_active":"2024-09-17T01:38:39.153310+0000","last_peered":"2024-09-17T01:38:39.153310+0000","last_clean":"2024-09-17T01:38:39.153310+0000","last_became_active":"2024-09-17T01:38:37.365556+0000","last_became_peered":"2024-09-17T01:38:37.365556+0000","last_unstale":"2024-09-17T01:38:39.153310+0000","last_undegraded":"2024-09-17T01:38:39.153310+0000","last_fullsized":"2024-09-17T01:38:39.153310+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:33.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.153090+0000","last_change":"2024-09-17T01:38:37.375664+0000","last_active":"2024-09-17T01:38:39.153090+0000","last_peered":"2024-09-17T01:38:39.153090+0000","last_clean":"2024-09-17T01:38:39.153090+0000","last_became_active":"2024-09-17T01:38:37.375339+0000","last_became_peered":"2024-09-17T01:38:37.375339+0000","last_unstale":"2024-09-17T01:38:39.153090+0000","last_undegraded":"2024-09-17T01:38:39.153090+0000","last_fullsized":"2024-09-17T01:38:39.153090+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:09:57.444439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.357965+0000","last_change":"2024-09-17T01:38:37.362911+0000","last_active":"2024-09-17T01:38:38.357965+0000","last_peered":"2024-09-17T01:38:38.357965+0000","last_clean":"2024-09-17T01:38:38.357965+0000","last_became_active":"2024-09-17T01:38:37.362505+0000","last_became_peered":"2024-09-17T01:38:37.362505+0000","last_unstale":"2024-09-17T01:38:38.357965+0000","last_undegraded":"2024-09-17T01:38:38.357965+0000","last_fullsized":"2024-09-17T01:38:38.357965+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:21.923447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.357469+0000","last_change":"2024-09-17T01:38:37.375116+0000","last_active":"2024-09-17T01:38:38.357469+0000","last_peered":"2024-09-17T01:38:38.357469+0000","last_clean":"2024-09-17T01:38:38.357469+0000","last_became_active":"2024-09-17T01:38:37.373568+0000","last_became_peered":"2024-09-17T01:38:37.373568+0000","last_unstale":"2024-09-17T01:38:38.357469+0000","last_undegraded":"2024-09-17T01:38:38.357469+0000","last_fullsized":"2024-09-17T01:38:38.357469+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:50:43.792297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.378145+0000","last_change":"2024-09-17T01:38:37.370628+0000","last_active":"2024-09-17T01:38:37.378145+0000","last_peered":"2024-09-17T01:38:37.378145+0000","last_clean":"2024-09-17T01:38:37.378145+0000","last_became_active":"2024-09-17T01:38:37.370250+0000","last_became_peered":"2024-09-17T01:38:37.370250+0000","last_unstale":"2024-09-17T01:38:37.378145+0000","last_undegraded":"2024-09-17T01:38:37.378145+0000","last_fullsized":"2024-09-17T01:38:37.378145+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:12.503612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"107'4","reported_seq":19,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.153290+0000","last_change":"2024-09-17T01:38:36.349648+0000","last_active":"2024-09-17T01:38:39.153290+0000","last_peered":"2024-09-17T01:38:39.153290+0000","last_clean":"2024-09-17T01:38:39.153290+0000","last_became_active":"2024-09-17T01:38:36.349201+0000","last_became_peered":"2024-09-17T01:38:36.349201+0000","last_unstale":"2024-09-17T01:38:39.153290+0000","last_undegraded":"2024-09-17T01:38:39.153290+0000","last_fullsized":"2024-09-17T01:38:39.153290+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:52.574809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.153348+0000","last_change":"2024-09-17T01:38:37.360965+0000","last_active":"2024-09-17T01:38:39.153348+0000","last_peered":"2024-09-17T01:38:39.153348+0000","last_clean":"2024-09-17T01:38:39.153348+0000","last_became_active":"2024-09-17T01:38:37.360425+0000","last_became_peered":"2024-09-17T01:38:37.360425+0000","last_unstale":"2024-09-17T01:38:39.153348+0000","last_undegraded":"2024-09-17T01:38:39.153348+0000","last_fullsized":"2024-09-17T01:38:39.153348+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:22.455912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"107'1","reported_seq":16,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.306542+0000","last_change":"2024-09-17T01:38:36.354763+0000","last_active":"2024-09-17T01:38:39.306542+0000","last_peered":"2024-09-17T01:38:39.306542+0000","last_clean":"2024-09-17T01:38:39.306542+0000","last_became_active":"2024-09-17T01:38:36.354411+0000","last_became_peered":"2024-09-17T01:38:36.354411+0000","last_unstale":"2024-09-17T01:38:39.306542+0000","last_undegraded":"2024-09-17T01:38:39.306542+0000","last_fullsized":"2024-09-17T01:38:39.306542+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:14.969537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.360255+0000","last_change":"2024-09-17T01:38:37.356965+0000","last_active":"2024-09-17T01:38:38.360255+0000","last_peered":"2024-09-17T01:38:38.360255+0000","last_clean":"2024-09-17T01:38:38.360255+0000","last_became_active":"2024-09-17T01:38:37.356614+0000","last_became_peered":"2024-09-17T01:38:37.356614+0000","last_unstale":"2024-09-17T01:38:38.360255+0000","last_undegraded":"2024-09-17T01:38:38.360255+0000","last_fullsized":"2024-09-17T01:38:38.360255+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:13:29.237726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"107'2","reported_seq":17,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.358624+0000","last_change":"2024-09-17T01:38:36.342616+0000","last_active":"2024-09-17T01:38:38.358624+0000","last_peered":"2024-09-17T01:38:38.358624+0000","last_clean":"2024-09-17T01:38:38.358624+0000","last_became_active":"2024-09-17T01:38:36.341826+0000","last_became_peered":"2024-09-17T01:38:36.341826+0000","last_unstale":"2024-09-17T01:38:38.358624+0000","last_undegraded":"2024-09-17T01:38:38.358624+0000","last_fullsized":"2024-09-17T01:38:38.358624+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:17.932636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.511235+0000","last_change":"2024-09-17T01:38:37.370778+0000","last_active":"2024-09-17T01:38:38.511235+0000","last_peered":"2024-09-17T01:38:38.511235+0000","last_clean":"2024-09-17T01:38:38.511235+0000","last_became_active":"2024-09-17T01:38:37.370406+0000","last_became_peered":"2024-09-17T01:38:37.370406+0000","last_unstale":"2024-09-17T01:38:38.511235+0000","last_undegraded":"2024-09-17T01:38:38.511235+0000","last_fullsized":"2024-09-17T01:38:38.511235+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:54.763357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"107'2","reported_seq":17,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.360353+0000","last_change":"2024-09-17T01:38:36.342409+0000","last_active":"2024-09-17T01:38:38.360353+0000","last_peered":"2024-09-17T01:38:38.360353+0000","last_clean":"2024-09-17T01:38:38.360353+0000","last_became_active":"2024-09-17T01:38:36.341352+0000","last_became_peered":"2024-09-17T01:38:36.341352+0000","last_unstale":"2024-09-17T01:38:38.360353+0000","last_undegraded":"2024-09-17T01:38:38.360353+0000","last_fullsized":"2024-09-17T01:38:38.360353+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:02.276154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.355908+0000","last_change":"2024-09-17T01:38:37.380182+0000","last_active":"2024-09-17T01:38:38.355908+0000","last_peered":"2024-09-17T01:38:38.355908+0000","last_clean":"2024-09-17T01:38:38.355908+0000","last_became_active":"2024-09-17T01:38:37.379344+0000","last_became_peered":"2024-09-17T01:38:37.379344+0000","last_unstale":"2024-09-17T01:38:38.355908+0000","last_undegraded":"2024-09-17T01:38:38.355908+0000","last_fullsized":"2024-09-17T01:38:38.355908+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:52.031269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"107'1","reported_seq":16,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.359475+0000","last_change":"2024-09-17T01:38:36.336713+0000","last_active":"2024-09-17T01:38:38.359475+0000","last_peered":"2024-09-17T01:38:38.359475+0000","last_clean":"2024-09-17T01:38:38.359475+0000","last_became_active":"2024-09-17T01:38:36.335945+0000","last_became_peered":"2024-09-17T01:38:36.335945+0000","last_unstale":"2024-09-17T01:38:38.359475+0000","last_undegraded":"2024-09-17T01:38:38.359475+0000","last_fullsized":"2024-09-17T01:38:38.359475+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:21.190177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.306260+0000","last_change":"2024-09-17T01:38:37.366496+0000","last_active":"2024-09-17T01:38:39.306260+0000","last_peered":"2024-09-17T01:38:39.306260+0000","last_clean":"2024-09-17T01:38:39.306260+0000","last_became_active":"2024-09-17T01:38:37.355532+0000","last_became_peered":"2024-09-17T01:38:37.355532+0000","last_unstale":"2024-09-17T01:38:39.306260+0000","last_undegraded":"2024-09-17T01:38:39.306260+0000","last_fullsized":"2024-09-17T01:38:39.306260+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:16:13.894056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"107'1","reported_seq":16,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.358219+0000","last_change":"2024-09-17T01:38:36.347470+0000","last_active":"2024-09-17T01:38:38.358219+0000","last_peered":"2024-09-17T01:38:38.358219+0000","last_clean":"2024-09-17T01:38:38.358219+0000","last_became_active":"2024-09-17T01:38:36.346819+0000","last_became_peered":"2024-09-17T01:38:36.346819+0000","last_unstale":"2024-09-17T01:38:38.358219+0000","last_undegraded":"2024-09-17T01:38:38.358219+0000","last_fullsized":"2024-09-17T01:38:38.358219+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:04.609095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.152801+0000","last_change":"2024-09-17T01:38:37.368957+0000","last_active":"2024-09-17T01:38:39.152801+0000","last_peered":"2024-09-17T01:38:39.152801+0000","last_clean":"2024-09-17T01:38:39.152801+0000","last_became_active":"2024-09-17T01:38:37.368404+0000","last_became_peered":"2024-09-17T01:38:37.368404+0000","last_unstale":"2024-09-17T01:38:39.152801+0000","last_undegraded":"2024-09-17T01:38:39.152801+0000","last_fullsized":"2024-09-17T01:38:39.152801+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:23.971209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.305851+0000","last_change":"2024-09-17T01:38:36.343251+0000","last_active":"2024-09-17T01:38:39.305851+0000","last_peered":"2024-09-17T01:38:39.305851+0000","last_clean":"2024-09-17T01:38:39.305851+0000","last_became_active":"2024-09-17T01:38:36.342851+0000","last_became_peered":"2024-09-17T01:38:36.342851+0000","last_unstale":"2024-09-17T01:38:39.305851+0000","last_undegraded":"2024-09-17T01:38:39.305851+0000","last_fullsized":"2024-09-17T01:38:39.305851+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:30.110438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.355697+0000","last_change":"2024-09-17T01:38:37.379724+0000","last_active":"2024-09-17T01:38:38.355697+0000","last_peered":"2024-09-17T01:38:38.355697+0000","last_clean":"2024-09-17T01:38:38.355697+0000","last_became_active":"2024-09-17T01:38:37.374705+0000","last_became_peered":"2024-09-17T01:38:37.374705+0000","last_unstale":"2024-09-17T01:38:38.355697+0000","last_undegraded":"2024-09-17T01:38:38.355697+0000","last_fullsized":"2024-09-17T01:38:38.355697+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:53.816045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.351147+0000","last_change":"2024-09-17T01:38:36.354040+0000","last_active":"2024-09-17T01:38:37.351147+0000","last_peered":"2024-09-17T01:38:37.351147+0000","last_clean":"2024-09-17T01:38:37.351147+0000","last_became_active":"2024-09-17T01:38:36.353456+0000","last_became_peered":"2024-09-17T01:38:36.353456+0000","last_unstale":"2024-09-17T01:38:37.351147+0000","last_undegraded":"2024-09-17T01:38:37.351147+0000","last_fullsized":"2024-09-17T01:38:37.351147+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:50.020999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.360398+0000","last_change":"2024-09-17T01:38:37.372715+0000","last_active":"2024-09-17T01:38:38.360398+0000","last_peered":"2024-09-17T01:38:38.360398+0000","last_clean":"2024-09-17T01:38:38.360398+0000","last_became_active":"2024-09-17T01:38:37.372327+0000","last_became_peered":"2024-09-17T01:38:37.372327+0000","last_unstale":"2024-09-17T01:38:38.360398+0000","last_undegraded":"2024-09-17T01:38:38.360398+0000","last_fullsized":"2024-09-17T01:38:38.360398+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:54.896276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.359141+0000","last_change":"2024-09-17T01:38:36.337004+0000","last_active":"2024-09-17T01:38:38.359141+0000","last_peered":"2024-09-17T01:38:38.359141+0000","last_clean":"2024-09-17T01:38:38.359141+0000","last_became_active":"2024-09-17T01:38:36.335710+0000","last_became_peered":"2024-09-17T01:38:36.335710+0000","last_unstale":"2024-09-17T01:38:38.359141+0000","last_undegraded":"2024-09-17T01:38:38.359141+0000","last_fullsized":"2024-09-17T01:38:38.359141+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:46.584211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.430846+0000","last_change":"2024-09-17T01:38:37.360816+0000","last_active":"2024-09-17T01:38:38.430846+0000","last_peered":"2024-09-17T01:38:38.430846+0000","last_clean":"2024-09-17T01:38:38.430846+0000","last_became_active":"2024-09-17T01:38:37.360494+0000","last_became_peered":"2024-09-17T01:38:37.360494+0000","last_unstale":"2024-09-17T01:38:38.430846+0000","last_undegraded":"2024-09-17T01:38:38.430846+0000","last_fullsized":"2024-09-17T01:38:38.430846+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:59:59.119753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.360347+0000","last_change":"2024-09-17T01:38:36.342382+0000","last_active":"2024-09-17T01:38:38.360347+0000","last_peered":"2024-09-17T01:38:38.360347+0000","last_clean":"2024-09-17T01:38:38.360347+0000","last_became_active":"2024-09-17T01:38:36.341488+0000","last_became_peered":"2024-09-17T01:38:36.341488+0000","last_unstale":"2024-09-17T01:38:38.360347+0000","last_undegraded":"2024-09-17T01:38:38.360347+0000","last_fullsized":"2024-09-17T01:38:38.360347+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:46.299334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.306528+0000","last_change":"2024-09-17T01:38:37.365203+0000","last_active":"2024-09-17T01:38:39.306528+0000","last_peered":"2024-09-17T01:38:39.306528+0000","last_clean":"2024-09-17T01:38:39.306528+0000","last_became_active":"2024-09-17T01:38:37.364838+0000","last_became_peered":"2024-09-17T01:38:37.364838+0000","last_unstale":"2024-09-17T01:38:39.306528+0000","last_undegraded":"2024-09-17T01:38:39.306528+0000","last_fullsized":"2024-09-17T01:38:39.306528+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:22.939530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"107'3","reported_seq":18,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.306674+0000","last_change":"2024-09-17T01:38:36.334222+0000","last_active":"2024-09-17T01:38:39.306674+0000","last_peered":"2024-09-17T01:38:39.306674+0000","last_clean":"2024-09-17T01:38:39.306674+0000","last_became_active":"2024-09-17T01:38:36.333898+0000","last_became_peered":"2024-09-17T01:38:36.333898+0000","last_unstale":"2024-09-17T01:38:39.306674+0000","last_undegraded":"2024-09-17T01:38:39.306674+0000","last_fullsized":"2024-09-17T01:38:39.306674+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:57.292254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.430834+0000","last_change":"2024-09-17T01:38:37.375368+0000","last_active":"2024-09-17T01:38:38.430834+0000","last_peered":"2024-09-17T01:38:38.430834+0000","last_clean":"2024-09-17T01:38:38.430834+0000","last_became_active":"2024-09-17T01:38:37.374971+0000","last_became_peered":"2024-09-17T01:38:37.374971+0000","last_unstale":"2024-09-17T01:38:38.430834+0000","last_undegraded":"2024-09-17T01:38:38.430834+0000","last_fullsized":"2024-09-17T01:38:38.430834+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:49.454084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"107'6","reported_seq":21,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.356236+0000","last_change":"2024-09-17T01:38:36.341187+0000","last_active":"2024-09-17T01:38:38.356236+0000","last_peered":"2024-09-17T01:38:38.356236+0000","last_clean":"2024-09-17T01:38:38.356236+0000","last_became_active":"2024-09-17T01:38:36.340826+0000","last_became_peered":"2024-09-17T01:38:36.340826+0000","last_unstale":"2024-09-17T01:38:38.356236+0000","last_undegraded":"2024-09-17T01:38:38.356236+0000","last_fullsized":"2024-09-17T01:38:38.356236+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:57.161979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.359117+0000","last_change":"2024-09-17T01:38:37.352539+0000","last_active":"2024-09-17T01:38:38.359117+0000","last_peered":"2024-09-17T01:38:38.359117+0000","last_clean":"2024-09-17T01:38:38.359117+0000","last_became_active":"2024-09-17T01:38:37.352224+0000","last_became_peered":"2024-09-17T01:38:37.352224+0000","last_unstale":"2024-09-17T01:38:38.359117+0000","last_undegraded":"2024-09-17T01:38:38.359117+0000","last_fullsized":"2024-09-17T01:38:38.359117+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:10:52.622221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"107'2","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.377971+0000","last_change":"2024-09-17T01:38:36.352167+0000","last_active":"2024-09-17T01:38:37.377971+0000","last_peered":"2024-09-17T01:38:37.377971+0000","last_clean":"2024-09-17T01:38:37.377971+0000","last_became_active":"2024-09-17T01:38:36.351770+0000","last_became_peered":"2024-09-17T01:38:36.351770+0000","last_unstale":"2024-09-17T01:38:37.377971+0000","last_undegraded":"2024-09-17T01:38:37.377971+0000","last_fullsized":"2024-09-17T01:38:37.377971+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:14:09.375240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.359455+0000","last_change":"2024-09-17T01:38:37.375686+0000","last_active":"2024-09-17T01:38:38.359455+0000","last_peered":"2024-09-17T01:38:38.359455+0000","last_clean":"2024-09-17T01:38:38.359455+0000","last_became_active":"2024-09-17T01:38:37.375339+0000","last_became_peered":"2024-09-17T01:38:37.375339+0000","last_unstale":"2024-09-17T01:38:38.359455+0000","last_undegraded":"2024-09-17T01:38:38.359455+0000","last_fullsized":"2024-09-17T01:38:38.359455+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:19.214725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.359811+0000","last_change":"2024-09-17T01:38:36.346714+0000","last_active":"2024-09-17T01:38:38.359811+0000","last_peered":"2024-09-17T01:38:38.359811+0000","last_clean":"2024-09-17T01:38:38.359811+0000","last_became_active":"2024-09-17T01:38:36.345622+0000","last_became_peered":"2024-09-17T01:38:36.345622+0000","last_unstale":"2024-09-17T01:38:38.359811+0000","last_undegraded":"2024-09-17T01:38:38.359811+0000","last_fullsized":"2024-09-17T01:38:38.359811+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:12.202189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.305948+0000","last_change":"2024-09-17T01:38:37.359174+0000","last_active":"2024-09-17T01:38:39.305948+0000","last_peered":"2024-09-17T01:38:39.305948+0000","last_clean":"2024-09-17T01:38:39.305948+0000","last_became_active":"2024-09-17T01:38:37.355490+0000","last_became_peered":"2024-09-17T01:38:37.355490+0000","last_unstale":"2024-09-17T01:38:39.305948+0000","last_undegraded":"2024-09-17T01:38:39.305948+0000","last_fullsized":"2024-09-17T01:38:39.305948+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:47.905945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.355932+0000","last_change":"2024-09-17T01:38:36.338705+0000","last_active":"2024-09-17T01:38:38.355932+0000","last_peered":"2024-09-17T01:38:38.355932+0000","last_clean":"2024-09-17T01:38:38.355932+0000","last_became_active":"2024-09-17T01:38:36.337349+0000","last_became_peered":"2024-09-17T01:38:36.337349+0000","last_unstale":"2024-09-17T01:38:38.355932+0000","last_undegraded":"2024-09-17T01:38:38.355932+0000","last_fullsized":"2024-09-17T01:38:38.355932+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:29.382310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.358006+0000","last_change":"2024-09-17T01:38:37.362254+0000","last_active":"2024-09-17T01:38:38.358006+0000","last_peered":"2024-09-17T01:38:38.358006+0000","last_clean":"2024-09-17T01:38:38.358006+0000","last_became_active":"2024-09-17T01:38:37.356377+0000","last_became_peered":"2024-09-17T01:38:37.356377+0000","last_unstale":"2024-09-17T01:38:38.358006+0000","last_undegraded":"2024-09-17T01:38:38.358006+0000","last_fullsized":"2024-09-17T01:38:38.358006+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:25.524914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"107'8","reported_seq":23,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.357600+0000","last_change":"2024-09-17T01:38:36.341865+0000","last_active":"2024-09-17T01:38:38.357600+0000","last_peered":"2024-09-17T01:38:38.357600+0000","last_clean":"2024-09-17T01:38:38.357600+0000","last_became_active":"2024-09-17T01:38:36.341503+0000","last_became_peered":"2024-09-17T01:38:36.341503+0000","last_unstale":"2024-09-17T01:38:38.357600+0000","last_undegraded":"2024-09-17T01:38:38.357600+0000","last_fullsized":"2024-09-17T01:38:38.357600+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:39.657485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.430921+0000","last_change":"2024-09-17T01:38:37.370969+0000","last_active":"2024-09-17T01:38:38.430921+0000","last_peered":"2024-09-17T01:38:38.430921+0000","last_clean":"2024-09-17T01:38:38.430921+0000","last_became_active":"2024-09-17T01:38:37.370083+0000","last_became_peered":"2024-09-17T01:38:37.370083+0000","last_unstale":"2024-09-17T01:38:38.430921+0000","last_undegraded":"2024-09-17T01:38:38.430921+0000","last_fullsized":"2024-09-17T01:38:38.430921+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:52.472439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"107'2","reported_seq":17,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.356042+0000","last_change":"2024-09-17T01:38:36.353737+0000","last_active":"2024-09-17T01:38:38.356042+0000","last_peered":"2024-09-17T01:38:38.356042+0000","last_clean":"2024-09-17T01:38:38.356042+0000","last_became_active":"2024-09-17T01:38:36.353370+0000","last_became_peered":"2024-09-17T01:38:36.353370+0000","last_unstale":"2024-09-17T01:38:38.356042+0000","last_undegraded":"2024-09-17T01:38:38.356042+0000","last_fullsized":"2024-09-17T01:38:38.356042+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:22:09.398966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.430653+0000","last_change":"2024-09-17T01:38:37.382234+0000","last_active":"2024-09-17T01:38:38.430653+0000","last_peered":"2024-09-17T01:38:38.430653+0000","last_clean":"2024-09-17T01:38:38.430653+0000","last_became_active":"2024-09-17T01:38:37.381876+0000","last_became_peered":"2024-09-17T01:38:37.381876+0000","last_unstale":"2024-09-17T01:38:38.430653+0000","last_undegraded":"2024-09-17T01:38:38.430653+0000","last_fullsized":"2024-09-17T01:38:38.430653+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:49.339735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"107'1","reported_seq":16,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.306704+0000","last_change":"2024-09-17T01:38:36.342628+0000","last_active":"2024-09-17T01:38:39.306704+0000","last_peered":"2024-09-17T01:38:39.306704+0000","last_clean":"2024-09-17T01:38:39.306704+0000","last_became_active":"2024-09-17T01:38:36.342239+0000","last_became_peered":"2024-09-17T01:38:36.342239+0000","last_unstale":"2024-09-17T01:38:39.306704+0000","last_undegraded":"2024-09-17T01:38:39.306704+0000","last_fullsized":"2024-09-17T01:38:39.306704+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:56.563055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.356029+0000","last_change":"2024-09-17T01:38:37.370411+0000","last_active":"2024-09-17T01:38:38.356029+0000","last_peered":"2024-09-17T01:38:38.356029+0000","last_clean":"2024-09-17T01:38:38.356029+0000","last_became_active":"2024-09-17T01:38:37.370105+0000","last_became_peered":"2024-09-17T01:38:37.370105+0000","last_unstale":"2024-09-17T01:38:38.356029+0000","last_undegraded":"2024-09-17T01:38:38.356029+0000","last_fullsized":"2024-09-17T01:38:38.356029+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:31.895378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.353253+0000","last_change":"2024-09-17T01:38:36.351103+0000","last_active":"2024-09-17T01:38:37.353253+0000","last_peered":"2024-09-17T01:38:37.353253+0000","last_clean":"2024-09-17T01:38:37.353253+0000","last_became_active":"2024-09-17T01:38:36.350245+0000","last_became_peered":"2024-09-17T01:38:36.350245+0000","last_unstale":"2024-09-17T01:38:37.353253+0000","last_undegraded":"2024-09-17T01:38:37.353253+0000","last_fullsized":"2024-09-17T01:38:37.353253+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:07.390928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.376525+0000","last_change":"2024-09-17T01:38:37.367877+0000","last_active":"2024-09-17T01:38:37.376525+0000","last_peered":"2024-09-17T01:38:37.376525+0000","last_clean":"2024-09-17T01:38:37.376525+0000","last_became_active":"2024-09-17T01:38:37.367558+0000","last_became_peered":"2024-09-17T01:38:37.367558+0000","last_unstale":"2024-09-17T01:38:37.376525+0000","last_undegraded":"2024-09-17T01:38:37.376525+0000","last_fullsized":"2024-09-17T01:38:37.376525+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:49.911531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"107'2","reported_seq":17,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.359568+0000","last_change":"2024-09-17T01:38:36.343276+0000","last_active":"2024-09-17T01:38:38.359568+0000","last_peered":"2024-09-17T01:38:38.359568+0000","last_clean":"2024-09-17T01:38:38.359568+0000","last_became_active":"2024-09-17T01:38:36.342052+0000","last_became_peered":"2024-09-17T01:38:36.342052+0000","last_unstale":"2024-09-17T01:38:38.359568+0000","last_undegraded":"2024-09-17T01:38:38.359568+0000","last_fullsized":"2024-09-17T01:38:38.359568+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:35.276613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.378232+0000","last_change":"2024-09-17T01:38:37.372984+0000","last_active":"2024-09-17T01:38:37.378232+0000","last_peered":"2024-09-17T01:38:37.378232+0000","last_clean":"2024-09-17T01:38:37.378232+0000","last_became_active":"2024-09-17T01:38:37.372024+0000","last_became_peered":"2024-09-17T01:38:37.372024+0000","last_unstale":"2024-09-17T01:38:37.378232+0000","last_undegraded":"2024-09-17T01:38:37.378232+0000","last_fullsized":"2024-09-17T01:38:37.378232+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:13:31.562388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.430237+0000","last_change":"2024-09-17T01:38:36.347864+0000","last_active":"2024-09-17T01:38:38.430237+0000","last_peered":"2024-09-17T01:38:38.430237+0000","last_clean":"2024-09-17T01:38:38.430237+0000","last_became_active":"2024-09-17T01:38:36.347504+0000","last_became_peered":"2024-09-17T01:38:36.347504+0000","last_unstale":"2024-09-17T01:38:38.430237+0000","last_undegraded":"2024-09-17T01:38:38.430237+0000","last_fullsized":"2024-09-17T01:38:38.430237+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:06:47.085456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.357464+0000","last_change":"2024-09-17T01:38:37.354296+0000","last_active":"2024-09-17T01:38:38.357464+0000","last_peered":"2024-09-17T01:38:38.357464+0000","last_clean":"2024-09-17T01:38:38.357464+0000","last_became_active":"2024-09-17T01:38:37.349917+0000","last_became_peered":"2024-09-17T01:38:37.349917+0000","last_unstale":"2024-09-17T01:38:38.357464+0000","last_undegraded":"2024-09-17T01:38:38.357464+0000","last_fullsized":"2024-09-17T01:38:38.357464+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:04.081894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.511025+0000","last_change":"2024-09-17T01:38:36.342424+0000","last_active":"2024-09-17T01:38:38.511025+0000","last_peered":"2024-09-17T01:38:38.511025+0000","last_clean":"2024-09-17T01:38:38.511025+0000","last_became_active":"2024-09-17T01:38:36.342122+0000","last_became_peered":"2024-09-17T01:38:36.342122+0000","last_unstale":"2024-09-17T01:38:38.511025+0000","last_undegraded":"2024-09-17T01:38:38.511025+0000","last_fullsized":"2024-09-17T01:38:38.511025+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:02.276154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.430438+0000","last_change":"2024-09-17T01:38:37.368695+0000","last_active":"2024-09-17T01:38:38.430438+0000","last_peered":"2024-09-17T01:38:38.430438+0000","last_clean":"2024-09-17T01:38:38.430438+0000","last_became_active":"2024-09-17T01:38:37.368327+0000","last_became_peered":"2024-09-17T01:38:37.368327+0000","last_unstale":"2024-09-17T01:38:38.430438+0000","last_undegraded":"2024-09-17T01:38:38.430438+0000","last_fullsized":"2024-09-17T01:38:38.430438+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:28.957571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.357368+0000","last_change":"2024-09-17T01:38:36.352289+0000","last_active":"2024-09-17T01:38:38.357368+0000","last_peered":"2024-09-17T01:38:38.357368+0000","last_clean":"2024-09-17T01:38:38.357368+0000","last_became_active":"2024-09-17T01:38:36.351640+0000","last_became_peered":"2024-09-17T01:38:36.351640+0000","last_unstale":"2024-09-17T01:38:38.357368+0000","last_undegraded":"2024-09-17T01:38:38.357368+0000","last_fullsized":"2024-09-17T01:38:38.357368+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:22.402290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.375026+0000","last_change":"2024-09-17T01:38:37.366327+0000","last_active":"2024-09-17T01:38:37.375026+0000","last_peered":"2024-09-17T01:38:37.375026+0000","last_clean":"2024-09-17T01:38:37.375026+0000","last_became_active":"2024-09-17T01:38:37.365925+0000","last_became_peered":"2024-09-17T01:38:37.365925+0000","last_unstale":"2024-09-17T01:38:37.375026+0000","last_undegraded":"2024-09-17T01:38:37.375026+0000","last_fullsized":"2024-09-17T01:38:37.375026+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:07.314877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"107'2","reported_seq":17,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.356119+0000","last_change":"2024-09-17T01:38:36.338625+0000","last_active":"2024-09-17T01:38:38.356119+0000","last_peered":"2024-09-17T01:38:38.356119+0000","last_clean":"2024-09-17T01:38:38.356119+0000","last_became_active":"2024-09-17T01:38:36.337977+0000","last_became_peered":"2024-09-17T01:38:36.337977+0000","last_unstale":"2024-09-17T01:38:38.356119+0000","last_undegraded":"2024-09-17T01:38:38.356119+0000","last_fullsized":"2024-09-17T01:38:38.356119+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:11.569738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.377692+0000","last_change":"2024-09-17T01:38:37.372638+0000","last_active":"2024-09-17T01:38:37.377692+0000","last_peered":"2024-09-17T01:38:37.377692+0000","last_clean":"2024-09-17T01:38:37.377692+0000","last_became_active":"2024-09-17T01:38:37.369862+0000","last_became_peered":"2024-09-17T01:38:37.369862+0000","last_unstale":"2024-09-17T01:38:37.377692+0000","last_undegraded":"2024-09-17T01:38:37.377692+0000","last_fullsized":"2024-09-17T01:38:37.377692+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:35.006712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.354379+0000","last_change":"2024-09-17T01:38:36.349455+0000","last_active":"2024-09-17T01:38:37.354379+0000","last_peered":"2024-09-17T01:38:37.354379+0000","last_clean":"2024-09-17T01:38:37.354379+0000","last_became_active":"2024-09-17T01:38:36.343322+0000","last_became_peered":"2024-09-17T01:38:36.343322+0000","last_unstale":"2024-09-17T01:38:37.354379+0000","last_undegraded":"2024-09-17T01:38:37.354379+0000","last_fullsized":"2024-09-17T01:38:37.354379+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:36.569059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.358639+0000","last_change":"2024-09-17T01:38:37.362983+0000","last_active":"2024-09-17T01:38:38.358639+0000","last_peered":"2024-09-17T01:38:38.358639+0000","last_clean":"2024-09-17T01:38:38.358639+0000","last_became_active":"2024-09-17T01:38:37.362640+0000","last_became_peered":"2024-09-17T01:38:37.362640+0000","last_unstale":"2024-09-17T01:38:38.358639+0000","last_undegraded":"2024-09-17T01:38:38.358639+0000","last_fullsized":"2024-09-17T01:38:38.358639+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:32:19.792157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.353789+0000","last_change":"2024-09-17T01:38:36.350141+0000","last_active":"2024-09-17T01:38:37.353789+0000","last_peered":"2024-09-17T01:38:37.353789+0000","last_clean":"2024-09-17T01:38:37.353789+0000","last_became_active":"2024-09-17T01:38:36.348311+0000","last_became_peered":"2024-09-17T01:38:36.348311+0000","last_unstale":"2024-09-17T01:38:37.353789+0000","last_undegraded":"2024-09-17T01:38:37.353789+0000","last_fullsized":"2024-09-17T01:38:37.353789+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:13.657882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.306589+0000","last_change":"2024-09-17T01:38:37.359846+0000","last_active":"2024-09-17T01:38:39.306589+0000","last_peered":"2024-09-17T01:38:39.306589+0000","last_clean":"2024-09-17T01:38:39.306589+0000","last_became_active":"2024-09-17T01:38:37.357795+0000","last_became_peered":"2024-09-17T01:38:37.357795+0000","last_unstale":"2024-09-17T01:38:39.306589+0000","last_undegraded":"2024-09-17T01:38:39.306589+0000","last_fullsized":"2024-09-17T01:38:39.306589+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:38:10.836763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.430683+0000","last_change":"2024-09-17T01:38:36.338438+0000","last_active":"2024-09-17T01:38:38.430683+0000","last_peered":"2024-09-17T01:38:38.430683+0000","last_clean":"2024-09-17T01:38:38.430683+0000","last_became_active":"2024-09-17T01:38:36.336932+0000","last_became_peered":"2024-09-17T01:38:36.336932+0000","last_unstale":"2024-09-17T01:38:38.430683+0000","last_undegraded":"2024-09-17T01:38:38.430683+0000","last_fullsized":"2024-09-17T01:38:38.430683+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:25.419336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.378443+0000","last_change":"2024-09-17T01:38:37.372643+0000","last_active":"2024-09-17T01:38:37.378443+0000","last_peered":"2024-09-17T01:38:37.378443+0000","last_clean":"2024-09-17T01:38:37.378443+0000","last_became_active":"2024-09-17T01:38:37.369945+0000","last_became_peered":"2024-09-17T01:38:37.369945+0000","last_unstale":"2024-09-17T01:38:37.378443+0000","last_undegraded":"2024-09-17T01:38:37.378443+0000","last_fullsized":"2024-09-17T01:38:37.378443+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:01.272409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.359625+0000","last_change":"2024-09-17T01:38:36.347302+0000","last_active":"2024-09-17T01:38:38.359625+0000","last_peered":"2024-09-17T01:38:38.359625+0000","last_clean":"2024-09-17T01:38:38.359625+0000","last_became_active":"2024-09-17T01:38:36.344001+0000","last_became_peered":"2024-09-17T01:38:36.344001+0000","last_unstale":"2024-09-17T01:38:38.359625+0000","last_undegraded":"2024-09-17T01:38:38.359625+0000","last_fullsized":"2024-09-17T01:38:38.359625+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:53.756827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.306335+0000","last_change":"2024-09-17T01:38:37.354891+0000","last_active":"2024-09-17T01:38:39.306335+0000","last_peered":"2024-09-17T01:38:39.306335+0000","last_clean":"2024-09-17T01:38:39.306335+0000","last_became_active":"2024-09-17T01:38:37.354493+0000","last_became_peered":"2024-09-17T01:38:37.354493+0000","last_unstale":"2024-09-17T01:38:39.306335+0000","last_undegraded":"2024-09-17T01:38:39.306335+0000","last_fullsized":"2024-09-17T01:38:39.306335+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:26:38.907384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.430339+0000","last_change":"2024-09-17T01:38:36.347248+0000","last_active":"2024-09-17T01:38:38.430339+0000","last_peered":"2024-09-17T01:38:38.430339+0000","last_clean":"2024-09-17T01:38:38.430339+0000","last_became_active":"2024-09-17T01:38:36.346875+0000","last_became_peered":"2024-09-17T01:38:36.346875+0000","last_unstale":"2024-09-17T01:38:38.430339+0000","last_undegraded":"2024-09-17T01:38:38.430339+0000","last_fullsized":"2024-09-17T01:38:38.430339+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:42.466486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.376584+0000","last_change":"2024-09-17T01:38:37.366977+0000","last_active":"2024-09-17T01:38:37.376584+0000","last_peered":"2024-09-17T01:38:37.376584+0000","last_clean":"2024-09-17T01:38:37.376584+0000","last_became_active":"2024-09-17T01:38:37.366518+0000","last_became_peered":"2024-09-17T01:38:37.366518+0000","last_unstale":"2024-09-17T01:38:37.376584+0000","last_undegraded":"2024-09-17T01:38:37.376584+0000","last_fullsized":"2024-09-17T01:38:37.376584+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:33.346279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.152811+0000","last_change":"2024-09-17T01:38:36.352556+0000","last_active":"2024-09-17T01:38:39.152811+0000","last_peered":"2024-09-17T01:38:39.152811+0000","last_clean":"2024-09-17T01:38:39.152811+0000","last_became_active":"2024-09-17T01:38:36.351764+0000","last_became_peered":"2024-09-17T01:38:36.351764+0000","last_unstale":"2024-09-17T01:38:39.152811+0000","last_undegraded":"2024-09-17T01:38:39.152811+0000","last_fullsized":"2024-09-17T01:38:39.152811+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:05.966640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.356119+0000","last_change":"2024-09-17T01:38:37.364328+0000","last_active":"2024-09-17T01:38:38.356119+0000","last_peered":"2024-09-17T01:38:38.356119+0000","last_clean":"2024-09-17T01:38:38.356119+0000","last_became_active":"2024-09-17T01:38:37.363982+0000","last_became_peered":"2024-09-17T01:38:37.363982+0000","last_unstale":"2024-09-17T01:38:38.356119+0000","last_undegraded":"2024-09-17T01:38:38.356119+0000","last_fullsized":"2024-09-17T01:38:38.356119+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:41:16.727527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.357484+0000","last_change":"2024-09-17T01:38:36.345874+0000","last_active":"2024-09-17T01:38:38.357484+0000","last_peered":"2024-09-17T01:38:38.357484+0000","last_clean":"2024-09-17T01:38:38.357484+0000","last_became_active":"2024-09-17T01:38:36.345486+0000","last_became_peered":"2024-09-17T01:38:36.345486+0000","last_unstale":"2024-09-17T01:38:38.357484+0000","last_undegraded":"2024-09-17T01:38:38.357484+0000","last_fullsized":"2024-09-17T01:38:38.357484+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:38.954717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.358978+0000","last_change":"2024-09-17T01:38:37.364039+0000","last_active":"2024-09-17T01:38:38.358978+0000","last_peered":"2024-09-17T01:38:38.358978+0000","last_clean":"2024-09-17T01:38:38.358978+0000","last_became_active":"2024-09-17T01:38:37.363734+0000","last_became_peered":"2024-09-17T01:38:37.363734+0000","last_unstale":"2024-09-17T01:38:38.358978+0000","last_undegraded":"2024-09-17T01:38:38.358978+0000","last_fullsized":"2024-09-17T01:38:38.358978+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:05.665716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"107'1","reported_seq":16,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.356048+0000","last_change":"2024-09-17T01:38:36.353991+0000","last_active":"2024-09-17T01:38:38.356048+0000","last_peered":"2024-09-17T01:38:38.356048+0000","last_clean":"2024-09-17T01:38:38.356048+0000","last_became_active":"2024-09-17T01:38:36.353640+0000","last_became_peered":"2024-09-17T01:38:36.353640+0000","last_unstale":"2024-09-17T01:38:38.356048+0000","last_undegraded":"2024-09-17T01:38:38.356048+0000","last_fullsized":"2024-09-17T01:38:38.356048+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:04.952975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":272,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.355533+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:38:38.355533+0000","last_peered":"2024-09-17T01:38:38.355533+0000","last_clean":"2024-09-17T01:38:38.355533+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:38:38.355533+0000","last_undegraded":"2024-09-17T01:38:38.355533+0000","last_fullsized":"2024-09-17T01:38:38.355533+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476821,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28332,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343508,"statfs":{"total":96636764160,"available":96607752192,"internally_reserved":0,"allocated":1331200,"data_stored":578164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509524,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40812,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331028,"statfs":{"total":96636764160,"available":96594972672,"internally_reserved":0,"allocated":1331200,"data_stored":578676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509523,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44968,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326872,"statfs":{"total":96636764160,"available":96590716928,"internally_reserved":0,"allocated":1327104,"data_stored":578094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509524,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28332,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343508,"statfs":{"total":96636764160,"available":96607752192,"internally_reserved":0,"allocated":1331200,"data_stored":578676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509524,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28324,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343516,"statfs":{"total":96636764160,"available":96607760384,"internally_reserved":0,"allocated":1327104,"data_stored":571988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509523,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45568,"kb_used_data":1896,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326272,"statfs":{"total":96636764160,"available":96590102528,"internally_reserved":0,"allocated":1941504,"data_stored":1170186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509525,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40812,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331028,"statfs":{"total":96636764160,"available":96594972672,"internally_reserved":0,"allocated":1327104,"data_stored":578094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542229,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41396,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330444,"statfs":{"total":96636764160,"available":96594374656,"internally_reserved":0,"allocated":1929216,"data_stored":1163830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:38:41.828 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:38:42.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.095+0000 7fb6f9200640 1 -- 172.21.15.42:0/404743660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6d8004000 msgr2=0x7fb6d8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:42.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.095+0000 7fb6f9200640 1 --2- 172.21.15.42:0/404743660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6d8004000 0x7fb6d8004800 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc001690 tx=0x7fb6d8005830 comp rx=0 tx=0).stop 2024-09-17T01:38:42.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.095+0000 7fb6f2800640 1 -- 172.21.15.42:0/404743660 reap_dead start 2024-09-17T01:38:42.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.095+0000 7fb6f9200640 1 -- 172.21.15.42:0/404743660 shutdown_connections 2024-09-17T01:38:42.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.095+0000 7fb6f9200640 1 -- 172.21.15.42:0/404743660 >> 172.21.15.42:0/404743660 conn(0x7fb6f40b2930 msgr2=0x7fb6f406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:42.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.095+0000 7fb6f9200640 1 -- 172.21.15.42:0/404743660 shutdown_connections 2024-09-17T01:38:42.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.095+0000 7fb6f9200640 1 -- 172.21.15.42:0/404743660 wait complete. 2024-09-17T01:38:42.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.098+0000 7fb6f9200640 1 Processor -- start 2024-09-17T01:38:42.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.098+0000 7fb6f9200640 1 -- start start 2024-09-17T01:38:42.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.099+0000 7fb6f9200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb6d8004000 0x7fb6f41f6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:42.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.099+0000 7fb6f9200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6f40cb4e0 0x7fb6f413e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:42.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.099+0000 7fb6f9200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6f40cb8f0 0x7fb6f413ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:42.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.099+0000 7fb6f9200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f406d430 con 0x7fb6f40cb4e0 2024-09-17T01:38:42.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.099+0000 7fb6f9200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f40cf2b0 con 0x7fb6f40cb8f0 2024-09-17T01:38:42.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.099+0000 7fb6f9200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb6f406d5b0 con 0x7fb6d8004000 2024-09-17T01:38:42.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.099+0000 7fb6ebe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6f40cb4e0 0x7fb6f413e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:42.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.100+0000 7fb6ebe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6f40cb4e0 0x7fb6f413e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42748/0 (socket says 172.21.15.42:42748) 2024-09-17T01:38:42.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.100+0000 7fb6ebe00640 1 -- 172.21.15.42:0/2334454430 learned_addr learned my addr 172.21.15.42:0/2334454430 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:42.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.100+0000 7fb6f1e00640 1 --2- 172.21.15.42:0/2334454430 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb6d8004000 0x7fb6f41f6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:42.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.100+0000 7fb6f2800640 1 --2- 172.21.15.42:0/2334454430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6f40cb8f0 0x7fb6f413ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:42.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.100+0000 7fb6ebe00640 1 -- 172.21.15.42:0/2334454430 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb6d8004000 msgr2=0x7fb6f41f6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:42.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.100+0000 7fb6ebe00640 1 --2- 172.21.15.42:0/2334454430 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb6d8004000 0x7fb6f41f6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:42.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.100+0000 7fb6ebe00640 1 -- 172.21.15.42:0/2334454430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6f40cb8f0 msgr2=0x7fb6f413ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:42.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.100+0000 7fb6ebe00640 1 --2- 172.21.15.42:0/2334454430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6f40cb8f0 0x7fb6f413ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:42.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.100+0000 7fb6ebe00640 1 -- 172.21.15.42:0/2334454430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6f41f6580 con 0x7fb6f40cb4e0 2024-09-17T01:38:42.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.100+0000 7fb6f1e00640 1 --2- 172.21.15.42:0/2334454430 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb6d8004000 0x7fb6f41f6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:42.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.100+0000 7fb6ebe00640 1 --2- 172.21.15.42:0/2334454430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6f40cb4e0 0x7fb6f413e840 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc0017b0 tx=0x7fb6dc006360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:42.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.101+0000 7fb6ea000640 1 -- 172.21.15.42:0/2334454430 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc041070 con 0x7fb6f40cb4e0 2024-09-17T01:38:42.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.101+0000 7fb6ea000640 1 -- 172.21.15.42:0/2334454430 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6dc003af0 con 0x7fb6f40cb4e0 2024-09-17T01:38:42.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.101+0000 7fb6f9200640 1 -- 172.21.15.42:0/2334454430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6f41e6c20 con 0x7fb6f40cb4e0 2024-09-17T01:38:42.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.101+0000 7fb6ea000640 1 -- 172.21.15.42:0/2334454430 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc038070 con 0x7fb6f40cb4e0 2024-09-17T01:38:42.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.101+0000 7fb6f9200640 1 -- 172.21.15.42:0/2334454430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6f41f8df0 con 0x7fb6f40cb4e0 2024-09-17T01:38:42.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.102+0000 7fb6f9200640 1 -- 172.21.15.42:0/2334454430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6f41e6e90 con 0x7fb6f40cb4e0 2024-09-17T01:38:42.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.103+0000 7fb6ea000640 1 -- 172.21.15.42:0/2334454430 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb6dc030070 con 0x7fb6f40cb4e0 2024-09-17T01:38:42.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.104+0000 7fb6ea000640 1 --2- 172.21.15.42:0/2334454430 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb6d0078b90 0x7fb6d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:42.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.104+0000 7fb6ea000640 1 -- 172.21.15.42:0/2334454430 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5709+0+0 (secure 0 0 0) 0x7fb6dc0ba2b0 con 0x7fb6f40cb4e0 2024-09-17T01:38:42.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.104+0000 7fb6f1e00640 1 --2- 172.21.15.42:0/2334454430 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb6d0078b90 0x7fb6d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:42.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.105+0000 7fb6f1e00640 1 --2- 172.21.15.42:0/2334454430 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb6d0078b90 0x7fb6d007b0a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4000fb0 tx=0x7fb6e40067a0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:42.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.108+0000 7fb6ea000640 1 -- 172.21.15.42:0/2334454430 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb6dc082650 con 0x7fb6f40cb4e0 2024-09-17T01:38:42.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.301+0000 7fb6f9200640 1 -- 172.21.15.42:0/2334454430 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb6f406dae0 con 0x7fb6d0078b90 2024-09-17T01:38:42.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.306+0000 7fb6ea000640 1 -- 172.21.15.42:0/2334454430 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252469 (secure 0 0 0) 0x7fb6f406dae0 con 0x7fb6d0078b90 2024-09-17T01:38:42.307 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:38:42.308 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:38:42.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.310+0000 7fb6f9200640 1 -- 172.21.15.42:0/2334454430 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb6d0078b90 msgr2=0x7fb6d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:42.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.310+0000 7fb6f9200640 1 --2- 172.21.15.42:0/2334454430 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb6d0078b90 0x7fb6d007b0a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4000fb0 tx=0x7fb6e40067a0 comp rx=0 tx=0).stop 2024-09-17T01:38:42.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.310+0000 7fb6f9200640 1 -- 172.21.15.42:0/2334454430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6f40cb4e0 msgr2=0x7fb6f413e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:42.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.310+0000 7fb6f9200640 1 --2- 172.21.15.42:0/2334454430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6f40cb4e0 0x7fb6f413e840 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc0017b0 tx=0x7fb6dc006360 comp rx=0 tx=0).stop 2024-09-17T01:38:42.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.310+0000 7fb6f9200640 1 -- 172.21.15.42:0/2334454430 shutdown_connections 2024-09-17T01:38:42.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.310+0000 7fb6f9200640 1 --2- 172.21.15.42:0/2334454430 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb6d0078b90 0x7fb6d007b0a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:42.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.310+0000 7fb6f9200640 1 --2- 172.21.15.42:0/2334454430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6f40cb8f0 0x7fb6f413ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:42.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.310+0000 7fb6f9200640 1 --2- 172.21.15.42:0/2334454430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6f40cb4e0 0x7fb6f413e840 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:42.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.310+0000 7fb6f9200640 1 --2- 172.21.15.42:0/2334454430 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb6d8004000 0x7fb6f41f6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:42.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.310+0000 7fb6f9200640 1 -- 172.21.15.42:0/2334454430 >> 172.21.15.42:0/2334454430 conn(0x7fb6f40b2930 msgr2=0x7fb6f415f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:42.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.311+0000 7fb6f9200640 1 -- 172.21.15.42:0/2334454430 shutdown_connections 2024-09-17T01:38:42.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.311+0000 7fb6f9200640 1 -- 172.21.15.42:0/2334454430 wait complete. 2024-09-17T01:38:42.331 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2024-09-17T01:38:41.090299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":298544,"kb_used_data":11568,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754676176,"statfs":{"total":773094113280,"available":772788404224,"internally_reserved":0,"allocated":11845632,"data_stored":5797708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":293654068},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.774287"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.360221+0000","last_change":"2024-09-17T01:38:37.353122+0000","last_active":"2024-09-17T01:38:38.360221+0000","last_peered":"2024-09-17T01:38:38.360221+0000","last_clean":"2024-09-17T01:38:38.360221+0000","last_became_active":"2024-09-17T01:38:37.352724+0000","last_became_peered":"2024-09-17T01:38:37.352724+0000","last_unstale":"2024-09-17T01:38:38.360221+0000","last_undegraded":"2024-09-17T01:38:38.360221+0000","last_fullsized":"2024-09-17T01:38:38.360221+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:21.923447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.360207+0000","last_change":"2024-09-17T01:38:37.363976+0000","last_active":"2024-09-17T01:38:38.360207+0000","last_peered":"2024-09-17T01:38:38.360207+0000","last_clean":"2024-09-17T01:38:38.360207+0000","last_became_active":"2024-09-17T01:38:37.363645+0000","last_became_peered":"2024-09-17T01:38:37.363645+0000","last_unstale":"2024-09-17T01:38:38.360207+0000","last_undegraded":"2024-09-17T01:38:38.360207+0000","last_fullsized":"2024-09-17T01:38:38.360207+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:25.524914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.358460+0000","last_change":"2024-09-17T01:38:37.366826+0000","last_active":"2024-09-17T01:38:38.358460+0000","last_peered":"2024-09-17T01:38:38.358460+0000","last_clean":"2024-09-17T01:38:38.358460+0000","last_became_active":"2024-09-17T01:38:37.361891+0000","last_became_peered":"2024-09-17T01:38:37.361891+0000","last_unstale":"2024-09-17T01:38:38.358460+0000","last_undegraded":"2024-09-17T01:38:38.358460+0000","last_fullsized":"2024-09-17T01:38:38.358460+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:25.181805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.360210+0000","last_change":"2024-09-17T01:38:37.371776+0000","last_active":"2024-09-17T01:38:38.360210+0000","last_peered":"2024-09-17T01:38:38.360210+0000","last_clean":"2024-09-17T01:38:38.360210+0000","last_became_active":"2024-09-17T01:38:37.371144+0000","last_became_peered":"2024-09-17T01:38:37.371144+0000","last_unstale":"2024-09-17T01:38:38.360210+0000","last_undegraded":"2024-09-17T01:38:38.360210+0000","last_fullsized":"2024-09-17T01:38:38.360210+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:38.430513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.306096+0000","last_change":"2024-09-17T01:38:37.355042+0000","last_active":"2024-09-17T01:38:39.306096+0000","last_peered":"2024-09-17T01:38:39.306096+0000","last_clean":"2024-09-17T01:38:39.306096+0000","last_became_active":"2024-09-17T01:38:37.354662+0000","last_became_peered":"2024-09-17T01:38:37.354662+0000","last_unstale":"2024-09-17T01:38:39.306096+0000","last_undegraded":"2024-09-17T01:38:39.306096+0000","last_fullsized":"2024-09-17T01:38:39.306096+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:58.881566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.306059+0000","last_change":"2024-09-17T01:38:37.364278+0000","last_active":"2024-09-17T01:38:39.306059+0000","last_peered":"2024-09-17T01:38:39.306059+0000","last_clean":"2024-09-17T01:38:39.306059+0000","last_became_active":"2024-09-17T01:38:37.363978+0000","last_became_peered":"2024-09-17T01:38:37.363978+0000","last_unstale":"2024-09-17T01:38:39.306059+0000","last_undegraded":"2024-09-17T01:38:39.306059+0000","last_fullsized":"2024-09-17T01:38:39.306059+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:41.092147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.305918+0000","last_change":"2024-09-17T01:38:37.363644+0000","last_active":"2024-09-17T01:38:39.305918+0000","last_peered":"2024-09-17T01:38:39.305918+0000","last_clean":"2024-09-17T01:38:39.305918+0000","last_became_active":"2024-09-17T01:38:37.354988+0000","last_became_peered":"2024-09-17T01:38:37.354988+0000","last_unstale":"2024-09-17T01:38:39.305918+0000","last_undegraded":"2024-09-17T01:38:39.305918+0000","last_fullsized":"2024-09-17T01:38:39.305918+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:40.121825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.357464+0000","last_change":"2024-09-17T01:38:37.354990+0000","last_active":"2024-09-17T01:38:38.357464+0000","last_peered":"2024-09-17T01:38:38.357464+0000","last_clean":"2024-09-17T01:38:38.357464+0000","last_became_active":"2024-09-17T01:38:37.354623+0000","last_became_peered":"2024-09-17T01:38:37.354623+0000","last_unstale":"2024-09-17T01:38:38.357464+0000","last_undegraded":"2024-09-17T01:38:38.357464+0000","last_fullsized":"2024-09-17T01:38:38.357464+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:28.119522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.306797+0000","last_change":"2024-09-17T01:38:37.353836+0000","last_active":"2024-09-17T01:38:39.306797+0000","last_peered":"2024-09-17T01:38:39.306797+0000","last_clean":"2024-09-17T01:38:39.306797+0000","last_became_active":"2024-09-17T01:38:37.353471+0000","last_became_peered":"2024-09-17T01:38:37.353471+0000","last_unstale":"2024-09-17T01:38:39.306797+0000","last_undegraded":"2024-09-17T01:38:39.306797+0000","last_fullsized":"2024-09-17T01:38:39.306797+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:44.622888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.511315+0000","last_change":"2024-09-17T01:38:37.363971+0000","last_active":"2024-09-17T01:38:38.511315+0000","last_peered":"2024-09-17T01:38:38.511315+0000","last_clean":"2024-09-17T01:38:38.511315+0000","last_became_active":"2024-09-17T01:38:37.363635+0000","last_became_peered":"2024-09-17T01:38:37.363635+0000","last_unstale":"2024-09-17T01:38:38.511315+0000","last_undegraded":"2024-09-17T01:38:38.511315+0000","last_fullsized":"2024-09-17T01:38:38.511315+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:23.408821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.306619+0000","last_change":"2024-09-17T01:38:37.365485+0000","last_active":"2024-09-17T01:38:39.306619+0000","last_peered":"2024-09-17T01:38:39.306619+0000","last_clean":"2024-09-17T01:38:39.306619+0000","last_became_active":"2024-09-17T01:38:37.365172+0000","last_became_peered":"2024-09-17T01:38:37.365172+0000","last_unstale":"2024-09-17T01:38:39.306619+0000","last_undegraded":"2024-09-17T01:38:39.306619+0000","last_fullsized":"2024-09-17T01:38:39.306619+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:31:28.292606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.355883+0000","last_change":"2024-09-17T01:38:37.382634+0000","last_active":"2024-09-17T01:38:38.355883+0000","last_peered":"2024-09-17T01:38:38.355883+0000","last_clean":"2024-09-17T01:38:38.355883+0000","last_became_active":"2024-09-17T01:38:37.381478+0000","last_became_peered":"2024-09-17T01:38:37.381478+0000","last_unstale":"2024-09-17T01:38:38.355883+0000","last_undegraded":"2024-09-17T01:38:38.355883+0000","last_fullsized":"2024-09-17T01:38:38.355883+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:53.482607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.153173+0000","last_change":"2024-09-17T01:38:37.374833+0000","last_active":"2024-09-17T01:38:39.153173+0000","last_peered":"2024-09-17T01:38:39.153173+0000","last_clean":"2024-09-17T01:38:39.153173+0000","last_became_active":"2024-09-17T01:38:37.374449+0000","last_became_peered":"2024-09-17T01:38:37.374449+0000","last_unstale":"2024-09-17T01:38:39.153173+0000","last_undegraded":"2024-09-17T01:38:39.153173+0000","last_fullsized":"2024-09-17T01:38:39.153173+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:48.112376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.358792+0000","last_change":"2024-09-17T01:38:37.362260+0000","last_active":"2024-09-17T01:38:38.358792+0000","last_peered":"2024-09-17T01:38:38.358792+0000","last_clean":"2024-09-17T01:38:38.358792+0000","last_became_active":"2024-09-17T01:38:37.361062+0000","last_became_peered":"2024-09-17T01:38:37.361062+0000","last_unstale":"2024-09-17T01:38:38.358792+0000","last_undegraded":"2024-09-17T01:38:38.358792+0000","last_fullsized":"2024-09-17T01:38:38.358792+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:33:38.011617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.358229+0000","last_change":"2024-09-17T01:38:37.363200+0000","last_active":"2024-09-17T01:38:38.358229+0000","last_peered":"2024-09-17T01:38:38.358229+0000","last_clean":"2024-09-17T01:38:38.358229+0000","last_became_active":"2024-09-17T01:38:37.362852+0000","last_became_peered":"2024-09-17T01:38:37.362852+0000","last_unstale":"2024-09-17T01:38:38.358229+0000","last_undegraded":"2024-09-17T01:38:38.358229+0000","last_fullsized":"2024-09-17T01:38:38.358229+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:15.073340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.305926+0000","last_change":"2024-09-17T01:38:37.369906+0000","last_active":"2024-09-17T01:38:39.305926+0000","last_peered":"2024-09-17T01:38:39.305926+0000","last_clean":"2024-09-17T01:38:39.305926+0000","last_became_active":"2024-09-17T01:38:37.369527+0000","last_became_peered":"2024-09-17T01:38:37.369527+0000","last_unstale":"2024-09-17T01:38:39.305926+0000","last_undegraded":"2024-09-17T01:38:39.305926+0000","last_fullsized":"2024-09-17T01:38:39.305926+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:03:03.892841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.377664+0000","last_change":"2024-09-17T01:38:37.370510+0000","last_active":"2024-09-17T01:38:37.377664+0000","last_peered":"2024-09-17T01:38:37.377664+0000","last_clean":"2024-09-17T01:38:37.377664+0000","last_became_active":"2024-09-17T01:38:37.370181+0000","last_became_peered":"2024-09-17T01:38:37.370181+0000","last_unstale":"2024-09-17T01:38:37.377664+0000","last_undegraded":"2024-09-17T01:38:37.377664+0000","last_fullsized":"2024-09-17T01:38:37.377664+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:00.124842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.360219+0000","last_change":"2024-09-17T01:38:37.362506+0000","last_active":"2024-09-17T01:38:38.360219+0000","last_peered":"2024-09-17T01:38:38.360219+0000","last_clean":"2024-09-17T01:38:38.360219+0000","last_became_active":"2024-09-17T01:38:37.361904+0000","last_became_peered":"2024-09-17T01:38:37.361904+0000","last_unstale":"2024-09-17T01:38:38.360219+0000","last_undegraded":"2024-09-17T01:38:38.360219+0000","last_fullsized":"2024-09-17T01:38:38.360219+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:22:42.557038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.376600+0000","last_change":"2024-09-17T01:38:37.369268+0000","last_active":"2024-09-17T01:38:37.376600+0000","last_peered":"2024-09-17T01:38:37.376600+0000","last_clean":"2024-09-17T01:38:37.376600+0000","last_became_active":"2024-09-17T01:38:37.368948+0000","last_became_peered":"2024-09-17T01:38:37.368948+0000","last_unstale":"2024-09-17T01:38:37.376600+0000","last_undegraded":"2024-09-17T01:38:37.376600+0000","last_fullsized":"2024-09-17T01:38:37.376600+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:49.602598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.356136+0000","last_change":"2024-09-17T01:38:37.360566+0000","last_active":"2024-09-17T01:38:38.356136+0000","last_peered":"2024-09-17T01:38:38.356136+0000","last_clean":"2024-09-17T01:38:38.356136+0000","last_became_active":"2024-09-17T01:38:37.360205+0000","last_became_peered":"2024-09-17T01:38:37.360205+0000","last_unstale":"2024-09-17T01:38:38.356136+0000","last_undegraded":"2024-09-17T01:38:38.356136+0000","last_fullsized":"2024-09-17T01:38:38.356136+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:37.847199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.359453+0000","last_change":"2024-09-17T01:38:37.351350+0000","last_active":"2024-09-17T01:38:38.359453+0000","last_peered":"2024-09-17T01:38:38.359453+0000","last_clean":"2024-09-17T01:38:38.359453+0000","last_became_active":"2024-09-17T01:38:37.351023+0000","last_became_peered":"2024-09-17T01:38:37.351023+0000","last_unstale":"2024-09-17T01:38:38.359453+0000","last_undegraded":"2024-09-17T01:38:38.359453+0000","last_fullsized":"2024-09-17T01:38:38.359453+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:01.505068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.358126+0000","last_change":"2024-09-17T01:38:37.352636+0000","last_active":"2024-09-17T01:38:38.358126+0000","last_peered":"2024-09-17T01:38:38.358126+0000","last_clean":"2024-09-17T01:38:38.358126+0000","last_became_active":"2024-09-17T01:38:37.352311+0000","last_became_peered":"2024-09-17T01:38:37.352311+0000","last_unstale":"2024-09-17T01:38:38.358126+0000","last_undegraded":"2024-09-17T01:38:38.358126+0000","last_fullsized":"2024-09-17T01:38:38.358126+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:57:17.961384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.359076+0000","last_change":"2024-09-17T01:38:37.361349+0000","last_active":"2024-09-17T01:38:38.359076+0000","last_peered":"2024-09-17T01:38:38.359076+0000","last_clean":"2024-09-17T01:38:38.359076+0000","last_became_active":"2024-09-17T01:38:37.360977+0000","last_became_peered":"2024-09-17T01:38:37.360977+0000","last_unstale":"2024-09-17T01:38:38.359076+0000","last_undegraded":"2024-09-17T01:38:38.359076+0000","last_fullsized":"2024-09-17T01:38:38.359076+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:09.670564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.430403+0000","last_change":"2024-09-17T01:38:37.372102+0000","last_active":"2024-09-17T01:38:38.430403+0000","last_peered":"2024-09-17T01:38:38.430403+0000","last_clean":"2024-09-17T01:38:38.430403+0000","last_became_active":"2024-09-17T01:38:37.371822+0000","last_became_peered":"2024-09-17T01:38:37.371822+0000","last_unstale":"2024-09-17T01:38:38.430403+0000","last_undegraded":"2024-09-17T01:38:38.430403+0000","last_fullsized":"2024-09-17T01:38:38.430403+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:58.123427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.511284+0000","last_change":"2024-09-17T01:38:37.376402+0000","last_active":"2024-09-17T01:38:38.511284+0000","last_peered":"2024-09-17T01:38:38.511284+0000","last_clean":"2024-09-17T01:38:38.511284+0000","last_became_active":"2024-09-17T01:38:37.376080+0000","last_became_peered":"2024-09-17T01:38:37.376080+0000","last_unstale":"2024-09-17T01:38:38.511284+0000","last_undegraded":"2024-09-17T01:38:38.511284+0000","last_fullsized":"2024-09-17T01:38:38.511284+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:05.615626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.153338+0000","last_change":"2024-09-17T01:38:37.374450+0000","last_active":"2024-09-17T01:38:39.153338+0000","last_peered":"2024-09-17T01:38:39.153338+0000","last_clean":"2024-09-17T01:38:39.153338+0000","last_became_active":"2024-09-17T01:38:37.374077+0000","last_became_peered":"2024-09-17T01:38:37.374077+0000","last_unstale":"2024-09-17T01:38:39.153338+0000","last_undegraded":"2024-09-17T01:38:39.153338+0000","last_fullsized":"2024-09-17T01:38:39.153338+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:44:00.188229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.431067+0000","last_change":"2024-09-17T01:38:37.369745+0000","last_active":"2024-09-17T01:38:38.431067+0000","last_peered":"2024-09-17T01:38:38.431067+0000","last_clean":"2024-09-17T01:38:38.431067+0000","last_became_active":"2024-09-17T01:38:37.367679+0000","last_became_peered":"2024-09-17T01:38:37.367679+0000","last_unstale":"2024-09-17T01:38:38.431067+0000","last_undegraded":"2024-09-17T01:38:38.431067+0000","last_fullsized":"2024-09-17T01:38:38.431067+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:57.501151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.430610+0000","last_change":"2024-09-17T01:38:37.361326+0000","last_active":"2024-09-17T01:38:38.430610+0000","last_peered":"2024-09-17T01:38:38.430610+0000","last_clean":"2024-09-17T01:38:38.430610+0000","last_became_active":"2024-09-17T01:38:37.361027+0000","last_became_peered":"2024-09-17T01:38:37.361027+0000","last_unstale":"2024-09-17T01:38:38.430610+0000","last_undegraded":"2024-09-17T01:38:38.430610+0000","last_fullsized":"2024-09-17T01:38:38.430610+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:16.410314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.153310+0000","last_change":"2024-09-17T01:38:37.365885+0000","last_active":"2024-09-17T01:38:39.153310+0000","last_peered":"2024-09-17T01:38:39.153310+0000","last_clean":"2024-09-17T01:38:39.153310+0000","last_became_active":"2024-09-17T01:38:37.365556+0000","last_became_peered":"2024-09-17T01:38:37.365556+0000","last_unstale":"2024-09-17T01:38:39.153310+0000","last_undegraded":"2024-09-17T01:38:39.153310+0000","last_fullsized":"2024-09-17T01:38:39.153310+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:33.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.153090+0000","last_change":"2024-09-17T01:38:37.375664+0000","last_active":"2024-09-17T01:38:39.153090+0000","last_peered":"2024-09-17T01:38:39.153090+0000","last_clean":"2024-09-17T01:38:39.153090+0000","last_became_active":"2024-09-17T01:38:37.375339+0000","last_became_peered":"2024-09-17T01:38:37.375339+0000","last_unstale":"2024-09-17T01:38:39.153090+0000","last_undegraded":"2024-09-17T01:38:39.153090+0000","last_fullsized":"2024-09-17T01:38:39.153090+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:09:57.444439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.357965+0000","last_change":"2024-09-17T01:38:37.362911+0000","last_active":"2024-09-17T01:38:38.357965+0000","last_peered":"2024-09-17T01:38:38.357965+0000","last_clean":"2024-09-17T01:38:38.357965+0000","last_became_active":"2024-09-17T01:38:37.362505+0000","last_became_peered":"2024-09-17T01:38:37.362505+0000","last_unstale":"2024-09-17T01:38:38.357965+0000","last_undegraded":"2024-09-17T01:38:38.357965+0000","last_fullsized":"2024-09-17T01:38:38.357965+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:21.923447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.357469+0000","last_change":"2024-09-17T01:38:37.375116+0000","last_active":"2024-09-17T01:38:38.357469+0000","last_peered":"2024-09-17T01:38:38.357469+0000","last_clean":"2024-09-17T01:38:38.357469+0000","last_became_active":"2024-09-17T01:38:37.373568+0000","last_became_peered":"2024-09-17T01:38:37.373568+0000","last_unstale":"2024-09-17T01:38:38.357469+0000","last_undegraded":"2024-09-17T01:38:38.357469+0000","last_fullsized":"2024-09-17T01:38:38.357469+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:50:43.792297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.378145+0000","last_change":"2024-09-17T01:38:37.370628+0000","last_active":"2024-09-17T01:38:37.378145+0000","last_peered":"2024-09-17T01:38:37.378145+0000","last_clean":"2024-09-17T01:38:37.378145+0000","last_became_active":"2024-09-17T01:38:37.370250+0000","last_became_peered":"2024-09-17T01:38:37.370250+0000","last_unstale":"2024-09-17T01:38:37.378145+0000","last_undegraded":"2024-09-17T01:38:37.378145+0000","last_fullsized":"2024-09-17T01:38:37.378145+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:12.503612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"107'4","reported_seq":19,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.153290+0000","last_change":"2024-09-17T01:38:36.349648+0000","last_active":"2024-09-17T01:38:39.153290+0000","last_peered":"2024-09-17T01:38:39.153290+0000","last_clean":"2024-09-17T01:38:39.153290+0000","last_became_active":"2024-09-17T01:38:36.349201+0000","last_became_peered":"2024-09-17T01:38:36.349201+0000","last_unstale":"2024-09-17T01:38:39.153290+0000","last_undegraded":"2024-09-17T01:38:39.153290+0000","last_fullsized":"2024-09-17T01:38:39.153290+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:52.574809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.153348+0000","last_change":"2024-09-17T01:38:37.360965+0000","last_active":"2024-09-17T01:38:39.153348+0000","last_peered":"2024-09-17T01:38:39.153348+0000","last_clean":"2024-09-17T01:38:39.153348+0000","last_became_active":"2024-09-17T01:38:37.360425+0000","last_became_peered":"2024-09-17T01:38:37.360425+0000","last_unstale":"2024-09-17T01:38:39.153348+0000","last_undegraded":"2024-09-17T01:38:39.153348+0000","last_fullsized":"2024-09-17T01:38:39.153348+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:22.455912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"107'1","reported_seq":16,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.306542+0000","last_change":"2024-09-17T01:38:36.354763+0000","last_active":"2024-09-17T01:38:39.306542+0000","last_peered":"2024-09-17T01:38:39.306542+0000","last_clean":"2024-09-17T01:38:39.306542+0000","last_became_active":"2024-09-17T01:38:36.354411+0000","last_became_peered":"2024-09-17T01:38:36.354411+0000","last_unstale":"2024-09-17T01:38:39.306542+0000","last_undegraded":"2024-09-17T01:38:39.306542+0000","last_fullsized":"2024-09-17T01:38:39.306542+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:14.969537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.360255+0000","last_change":"2024-09-17T01:38:37.356965+0000","last_active":"2024-09-17T01:38:38.360255+0000","last_peered":"2024-09-17T01:38:38.360255+0000","last_clean":"2024-09-17T01:38:38.360255+0000","last_became_active":"2024-09-17T01:38:37.356614+0000","last_became_peered":"2024-09-17T01:38:37.356614+0000","last_unstale":"2024-09-17T01:38:38.360255+0000","last_undegraded":"2024-09-17T01:38:38.360255+0000","last_fullsized":"2024-09-17T01:38:38.360255+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:13:29.237726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"107'2","reported_seq":17,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.358624+0000","last_change":"2024-09-17T01:38:36.342616+0000","last_active":"2024-09-17T01:38:38.358624+0000","last_peered":"2024-09-17T01:38:38.358624+0000","last_clean":"2024-09-17T01:38:38.358624+0000","last_became_active":"2024-09-17T01:38:36.341826+0000","last_became_peered":"2024-09-17T01:38:36.341826+0000","last_unstale":"2024-09-17T01:38:38.358624+0000","last_undegraded":"2024-09-17T01:38:38.358624+0000","last_fullsized":"2024-09-17T01:38:38.358624+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:17.932636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.511235+0000","last_change":"2024-09-17T01:38:37.370778+0000","last_active":"2024-09-17T01:38:38.511235+0000","last_peered":"2024-09-17T01:38:38.511235+0000","last_clean":"2024-09-17T01:38:38.511235+0000","last_became_active":"2024-09-17T01:38:37.370406+0000","last_became_peered":"2024-09-17T01:38:37.370406+0000","last_unstale":"2024-09-17T01:38:38.511235+0000","last_undegraded":"2024-09-17T01:38:38.511235+0000","last_fullsized":"2024-09-17T01:38:38.511235+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:54.763357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"107'2","reported_seq":17,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.360353+0000","last_change":"2024-09-17T01:38:36.342409+0000","last_active":"2024-09-17T01:38:38.360353+0000","last_peered":"2024-09-17T01:38:38.360353+0000","last_clean":"2024-09-17T01:38:38.360353+0000","last_became_active":"2024-09-17T01:38:36.341352+0000","last_became_peered":"2024-09-17T01:38:36.341352+0000","last_unstale":"2024-09-17T01:38:38.360353+0000","last_undegraded":"2024-09-17T01:38:38.360353+0000","last_fullsized":"2024-09-17T01:38:38.360353+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:02.276154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.355908+0000","last_change":"2024-09-17T01:38:37.380182+0000","last_active":"2024-09-17T01:38:38.355908+0000","last_peered":"2024-09-17T01:38:38.355908+0000","last_clean":"2024-09-17T01:38:38.355908+0000","last_became_active":"2024-09-17T01:38:37.379344+0000","last_became_peered":"2024-09-17T01:38:37.379344+0000","last_unstale":"2024-09-17T01:38:38.355908+0000","last_undegraded":"2024-09-17T01:38:38.355908+0000","last_fullsized":"2024-09-17T01:38:38.355908+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:52.031269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"107'1","reported_seq":16,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.359475+0000","last_change":"2024-09-17T01:38:36.336713+0000","last_active":"2024-09-17T01:38:38.359475+0000","last_peered":"2024-09-17T01:38:38.359475+0000","last_clean":"2024-09-17T01:38:38.359475+0000","last_became_active":"2024-09-17T01:38:36.335945+0000","last_became_peered":"2024-09-17T01:38:36.335945+0000","last_unstale":"2024-09-17T01:38:38.359475+0000","last_undegraded":"2024-09-17T01:38:38.359475+0000","last_fullsized":"2024-09-17T01:38:38.359475+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:21.190177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.306260+0000","last_change":"2024-09-17T01:38:37.366496+0000","last_active":"2024-09-17T01:38:39.306260+0000","last_peered":"2024-09-17T01:38:39.306260+0000","last_clean":"2024-09-17T01:38:39.306260+0000","last_became_active":"2024-09-17T01:38:37.355532+0000","last_became_peered":"2024-09-17T01:38:37.355532+0000","last_unstale":"2024-09-17T01:38:39.306260+0000","last_undegraded":"2024-09-17T01:38:39.306260+0000","last_fullsized":"2024-09-17T01:38:39.306260+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:16:13.894056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"107'1","reported_seq":16,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.358219+0000","last_change":"2024-09-17T01:38:36.347470+0000","last_active":"2024-09-17T01:38:38.358219+0000","last_peered":"2024-09-17T01:38:38.358219+0000","last_clean":"2024-09-17T01:38:38.358219+0000","last_became_active":"2024-09-17T01:38:36.346819+0000","last_became_peered":"2024-09-17T01:38:36.346819+0000","last_unstale":"2024-09-17T01:38:38.358219+0000","last_undegraded":"2024-09-17T01:38:38.358219+0000","last_fullsized":"2024-09-17T01:38:38.358219+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:04.609095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.152801+0000","last_change":"2024-09-17T01:38:37.368957+0000","last_active":"2024-09-17T01:38:39.152801+0000","last_peered":"2024-09-17T01:38:39.152801+0000","last_clean":"2024-09-17T01:38:39.152801+0000","last_became_active":"2024-09-17T01:38:37.368404+0000","last_became_peered":"2024-09-17T01:38:37.368404+0000","last_unstale":"2024-09-17T01:38:39.152801+0000","last_undegraded":"2024-09-17T01:38:39.152801+0000","last_fullsized":"2024-09-17T01:38:39.152801+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:23.971209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.305851+0000","last_change":"2024-09-17T01:38:36.343251+0000","last_active":"2024-09-17T01:38:39.305851+0000","last_peered":"2024-09-17T01:38:39.305851+0000","last_clean":"2024-09-17T01:38:39.305851+0000","last_became_active":"2024-09-17T01:38:36.342851+0000","last_became_peered":"2024-09-17T01:38:36.342851+0000","last_unstale":"2024-09-17T01:38:39.305851+0000","last_undegraded":"2024-09-17T01:38:39.305851+0000","last_fullsized":"2024-09-17T01:38:39.305851+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:30.110438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.355697+0000","last_change":"2024-09-17T01:38:37.379724+0000","last_active":"2024-09-17T01:38:38.355697+0000","last_peered":"2024-09-17T01:38:38.355697+0000","last_clean":"2024-09-17T01:38:38.355697+0000","last_became_active":"2024-09-17T01:38:37.374705+0000","last_became_peered":"2024-09-17T01:38:37.374705+0000","last_unstale":"2024-09-17T01:38:38.355697+0000","last_undegraded":"2024-09-17T01:38:38.355697+0000","last_fullsized":"2024-09-17T01:38:38.355697+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:53.816045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.351147+0000","last_change":"2024-09-17T01:38:36.354040+0000","last_active":"2024-09-17T01:38:37.351147+0000","last_peered":"2024-09-17T01:38:37.351147+0000","last_clean":"2024-09-17T01:38:37.351147+0000","last_became_active":"2024-09-17T01:38:36.353456+0000","last_became_peered":"2024-09-17T01:38:36.353456+0000","last_unstale":"2024-09-17T01:38:37.351147+0000","last_undegraded":"2024-09-17T01:38:37.351147+0000","last_fullsized":"2024-09-17T01:38:37.351147+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:50.020999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.360398+0000","last_change":"2024-09-17T01:38:37.372715+0000","last_active":"2024-09-17T01:38:38.360398+0000","last_peered":"2024-09-17T01:38:38.360398+0000","last_clean":"2024-09-17T01:38:38.360398+0000","last_became_active":"2024-09-17T01:38:37.372327+0000","last_became_peered":"2024-09-17T01:38:37.372327+0000","last_unstale":"2024-09-17T01:38:38.360398+0000","last_undegraded":"2024-09-17T01:38:38.360398+0000","last_fullsized":"2024-09-17T01:38:38.360398+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:54.896276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.359141+0000","last_change":"2024-09-17T01:38:36.337004+0000","last_active":"2024-09-17T01:38:38.359141+0000","last_peered":"2024-09-17T01:38:38.359141+0000","last_clean":"2024-09-17T01:38:38.359141+0000","last_became_active":"2024-09-17T01:38:36.335710+0000","last_became_peered":"2024-09-17T01:38:36.335710+0000","last_unstale":"2024-09-17T01:38:38.359141+0000","last_undegraded":"2024-09-17T01:38:38.359141+0000","last_fullsized":"2024-09-17T01:38:38.359141+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:46.584211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.430846+0000","last_change":"2024-09-17T01:38:37.360816+0000","last_active":"2024-09-17T01:38:38.430846+0000","last_peered":"2024-09-17T01:38:38.430846+0000","last_clean":"2024-09-17T01:38:38.430846+0000","last_became_active":"2024-09-17T01:38:37.360494+0000","last_became_peered":"2024-09-17T01:38:37.360494+0000","last_unstale":"2024-09-17T01:38:38.430846+0000","last_undegraded":"2024-09-17T01:38:38.430846+0000","last_fullsized":"2024-09-17T01:38:38.430846+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:59:59.119753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.360347+0000","last_change":"2024-09-17T01:38:36.342382+0000","last_active":"2024-09-17T01:38:38.360347+0000","last_peered":"2024-09-17T01:38:38.360347+0000","last_clean":"2024-09-17T01:38:38.360347+0000","last_became_active":"2024-09-17T01:38:36.341488+0000","last_became_peered":"2024-09-17T01:38:36.341488+0000","last_unstale":"2024-09-17T01:38:38.360347+0000","last_undegraded":"2024-09-17T01:38:38.360347+0000","last_fullsized":"2024-09-17T01:38:38.360347+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:46.299334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.306528+0000","last_change":"2024-09-17T01:38:37.365203+0000","last_active":"2024-09-17T01:38:39.306528+0000","last_peered":"2024-09-17T01:38:39.306528+0000","last_clean":"2024-09-17T01:38:39.306528+0000","last_became_active":"2024-09-17T01:38:37.364838+0000","last_became_peered":"2024-09-17T01:38:37.364838+0000","last_unstale":"2024-09-17T01:38:39.306528+0000","last_undegraded":"2024-09-17T01:38:39.306528+0000","last_fullsized":"2024-09-17T01:38:39.306528+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:22.939530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"107'3","reported_seq":18,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.306674+0000","last_change":"2024-09-17T01:38:36.334222+0000","last_active":"2024-09-17T01:38:39.306674+0000","last_peered":"2024-09-17T01:38:39.306674+0000","last_clean":"2024-09-17T01:38:39.306674+0000","last_became_active":"2024-09-17T01:38:36.333898+0000","last_became_peered":"2024-09-17T01:38:36.333898+0000","last_unstale":"2024-09-17T01:38:39.306674+0000","last_undegraded":"2024-09-17T01:38:39.306674+0000","last_fullsized":"2024-09-17T01:38:39.306674+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:57.292254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.430834+0000","last_change":"2024-09-17T01:38:37.375368+0000","last_active":"2024-09-17T01:38:38.430834+0000","last_peered":"2024-09-17T01:38:38.430834+0000","last_clean":"2024-09-17T01:38:38.430834+0000","last_became_active":"2024-09-17T01:38:37.374971+0000","last_became_peered":"2024-09-17T01:38:37.374971+0000","last_unstale":"2024-09-17T01:38:38.430834+0000","last_undegraded":"2024-09-17T01:38:38.430834+0000","last_fullsized":"2024-09-17T01:38:38.430834+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:49.454084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"107'6","reported_seq":21,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.356236+0000","last_change":"2024-09-17T01:38:36.341187+0000","last_active":"2024-09-17T01:38:38.356236+0000","last_peered":"2024-09-17T01:38:38.356236+0000","last_clean":"2024-09-17T01:38:38.356236+0000","last_became_active":"2024-09-17T01:38:36.340826+0000","last_became_peered":"2024-09-17T01:38:36.340826+0000","last_unstale":"2024-09-17T01:38:38.356236+0000","last_undegraded":"2024-09-17T01:38:38.356236+0000","last_fullsized":"2024-09-17T01:38:38.356236+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:57.161979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.359117+0000","last_change":"2024-09-17T01:38:37.352539+0000","last_active":"2024-09-17T01:38:38.359117+0000","last_peered":"2024-09-17T01:38:38.359117+0000","last_clean":"2024-09-17T01:38:38.359117+0000","last_became_active":"2024-09-17T01:38:37.352224+0000","last_became_peered":"2024-09-17T01:38:37.352224+0000","last_unstale":"2024-09-17T01:38:38.359117+0000","last_undegraded":"2024-09-17T01:38:38.359117+0000","last_fullsized":"2024-09-17T01:38:38.359117+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:10:52.622221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"107'2","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.377971+0000","last_change":"2024-09-17T01:38:36.352167+0000","last_active":"2024-09-17T01:38:37.377971+0000","last_peered":"2024-09-17T01:38:37.377971+0000","last_clean":"2024-09-17T01:38:37.377971+0000","last_became_active":"2024-09-17T01:38:36.351770+0000","last_became_peered":"2024-09-17T01:38:36.351770+0000","last_unstale":"2024-09-17T01:38:37.377971+0000","last_undegraded":"2024-09-17T01:38:37.377971+0000","last_fullsized":"2024-09-17T01:38:37.377971+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:14:09.375240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.359455+0000","last_change":"2024-09-17T01:38:37.375686+0000","last_active":"2024-09-17T01:38:38.359455+0000","last_peered":"2024-09-17T01:38:38.359455+0000","last_clean":"2024-09-17T01:38:38.359455+0000","last_became_active":"2024-09-17T01:38:37.375339+0000","last_became_peered":"2024-09-17T01:38:37.375339+0000","last_unstale":"2024-09-17T01:38:38.359455+0000","last_undegraded":"2024-09-17T01:38:38.359455+0000","last_fullsized":"2024-09-17T01:38:38.359455+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:19.214725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.359811+0000","last_change":"2024-09-17T01:38:36.346714+0000","last_active":"2024-09-17T01:38:38.359811+0000","last_peered":"2024-09-17T01:38:38.359811+0000","last_clean":"2024-09-17T01:38:38.359811+0000","last_became_active":"2024-09-17T01:38:36.345622+0000","last_became_peered":"2024-09-17T01:38:36.345622+0000","last_unstale":"2024-09-17T01:38:38.359811+0000","last_undegraded":"2024-09-17T01:38:38.359811+0000","last_fullsized":"2024-09-17T01:38:38.359811+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:12.202189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.305948+0000","last_change":"2024-09-17T01:38:37.359174+0000","last_active":"2024-09-17T01:38:39.305948+0000","last_peered":"2024-09-17T01:38:39.305948+0000","last_clean":"2024-09-17T01:38:39.305948+0000","last_became_active":"2024-09-17T01:38:37.355490+0000","last_became_peered":"2024-09-17T01:38:37.355490+0000","last_unstale":"2024-09-17T01:38:39.305948+0000","last_undegraded":"2024-09-17T01:38:39.305948+0000","last_fullsized":"2024-09-17T01:38:39.305948+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:47.905945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.355932+0000","last_change":"2024-09-17T01:38:36.338705+0000","last_active":"2024-09-17T01:38:38.355932+0000","last_peered":"2024-09-17T01:38:38.355932+0000","last_clean":"2024-09-17T01:38:38.355932+0000","last_became_active":"2024-09-17T01:38:36.337349+0000","last_became_peered":"2024-09-17T01:38:36.337349+0000","last_unstale":"2024-09-17T01:38:38.355932+0000","last_undegraded":"2024-09-17T01:38:38.355932+0000","last_fullsized":"2024-09-17T01:38:38.355932+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:29.382310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.358006+0000","last_change":"2024-09-17T01:38:37.362254+0000","last_active":"2024-09-17T01:38:38.358006+0000","last_peered":"2024-09-17T01:38:38.358006+0000","last_clean":"2024-09-17T01:38:38.358006+0000","last_became_active":"2024-09-17T01:38:37.356377+0000","last_became_peered":"2024-09-17T01:38:37.356377+0000","last_unstale":"2024-09-17T01:38:38.358006+0000","last_undegraded":"2024-09-17T01:38:38.358006+0000","last_fullsized":"2024-09-17T01:38:38.358006+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:25.524914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"107'8","reported_seq":23,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.357600+0000","last_change":"2024-09-17T01:38:36.341865+0000","last_active":"2024-09-17T01:38:38.357600+0000","last_peered":"2024-09-17T01:38:38.357600+0000","last_clean":"2024-09-17T01:38:38.357600+0000","last_became_active":"2024-09-17T01:38:36.341503+0000","last_became_peered":"2024-09-17T01:38:36.341503+0000","last_unstale":"2024-09-17T01:38:38.357600+0000","last_undegraded":"2024-09-17T01:38:38.357600+0000","last_fullsized":"2024-09-17T01:38:38.357600+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:39.657485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.430921+0000","last_change":"2024-09-17T01:38:37.370969+0000","last_active":"2024-09-17T01:38:38.430921+0000","last_peered":"2024-09-17T01:38:38.430921+0000","last_clean":"2024-09-17T01:38:38.430921+0000","last_became_active":"2024-09-17T01:38:37.370083+0000","last_became_peered":"2024-09-17T01:38:37.370083+0000","last_unstale":"2024-09-17T01:38:38.430921+0000","last_undegraded":"2024-09-17T01:38:38.430921+0000","last_fullsized":"2024-09-17T01:38:38.430921+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:52.472439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"107'2","reported_seq":17,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.356042+0000","last_change":"2024-09-17T01:38:36.353737+0000","last_active":"2024-09-17T01:38:38.356042+0000","last_peered":"2024-09-17T01:38:38.356042+0000","last_clean":"2024-09-17T01:38:38.356042+0000","last_became_active":"2024-09-17T01:38:36.353370+0000","last_became_peered":"2024-09-17T01:38:36.353370+0000","last_unstale":"2024-09-17T01:38:38.356042+0000","last_undegraded":"2024-09-17T01:38:38.356042+0000","last_fullsized":"2024-09-17T01:38:38.356042+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:22:09.398966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.430653+0000","last_change":"2024-09-17T01:38:37.382234+0000","last_active":"2024-09-17T01:38:38.430653+0000","last_peered":"2024-09-17T01:38:38.430653+0000","last_clean":"2024-09-17T01:38:38.430653+0000","last_became_active":"2024-09-17T01:38:37.381876+0000","last_became_peered":"2024-09-17T01:38:37.381876+0000","last_unstale":"2024-09-17T01:38:38.430653+0000","last_undegraded":"2024-09-17T01:38:38.430653+0000","last_fullsized":"2024-09-17T01:38:38.430653+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:49.339735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"107'1","reported_seq":16,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.306704+0000","last_change":"2024-09-17T01:38:36.342628+0000","last_active":"2024-09-17T01:38:39.306704+0000","last_peered":"2024-09-17T01:38:39.306704+0000","last_clean":"2024-09-17T01:38:39.306704+0000","last_became_active":"2024-09-17T01:38:36.342239+0000","last_became_peered":"2024-09-17T01:38:36.342239+0000","last_unstale":"2024-09-17T01:38:39.306704+0000","last_undegraded":"2024-09-17T01:38:39.306704+0000","last_fullsized":"2024-09-17T01:38:39.306704+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:56.563055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.356029+0000","last_change":"2024-09-17T01:38:37.370411+0000","last_active":"2024-09-17T01:38:38.356029+0000","last_peered":"2024-09-17T01:38:38.356029+0000","last_clean":"2024-09-17T01:38:38.356029+0000","last_became_active":"2024-09-17T01:38:37.370105+0000","last_became_peered":"2024-09-17T01:38:37.370105+0000","last_unstale":"2024-09-17T01:38:38.356029+0000","last_undegraded":"2024-09-17T01:38:38.356029+0000","last_fullsized":"2024-09-17T01:38:38.356029+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:31.895378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.353253+0000","last_change":"2024-09-17T01:38:36.351103+0000","last_active":"2024-09-17T01:38:37.353253+0000","last_peered":"2024-09-17T01:38:37.353253+0000","last_clean":"2024-09-17T01:38:37.353253+0000","last_became_active":"2024-09-17T01:38:36.350245+0000","last_became_peered":"2024-09-17T01:38:36.350245+0000","last_unstale":"2024-09-17T01:38:37.353253+0000","last_undegraded":"2024-09-17T01:38:37.353253+0000","last_fullsized":"2024-09-17T01:38:37.353253+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:07.390928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.376525+0000","last_change":"2024-09-17T01:38:37.367877+0000","last_active":"2024-09-17T01:38:37.376525+0000","last_peered":"2024-09-17T01:38:37.376525+0000","last_clean":"2024-09-17T01:38:37.376525+0000","last_became_active":"2024-09-17T01:38:37.367558+0000","last_became_peered":"2024-09-17T01:38:37.367558+0000","last_unstale":"2024-09-17T01:38:37.376525+0000","last_undegraded":"2024-09-17T01:38:37.376525+0000","last_fullsized":"2024-09-17T01:38:37.376525+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:49.911531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"107'2","reported_seq":17,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.359568+0000","last_change":"2024-09-17T01:38:36.343276+0000","last_active":"2024-09-17T01:38:38.359568+0000","last_peered":"2024-09-17T01:38:38.359568+0000","last_clean":"2024-09-17T01:38:38.359568+0000","last_became_active":"2024-09-17T01:38:36.342052+0000","last_became_peered":"2024-09-17T01:38:36.342052+0000","last_unstale":"2024-09-17T01:38:38.359568+0000","last_undegraded":"2024-09-17T01:38:38.359568+0000","last_fullsized":"2024-09-17T01:38:38.359568+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:35.276613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.378232+0000","last_change":"2024-09-17T01:38:37.372984+0000","last_active":"2024-09-17T01:38:37.378232+0000","last_peered":"2024-09-17T01:38:37.378232+0000","last_clean":"2024-09-17T01:38:37.378232+0000","last_became_active":"2024-09-17T01:38:37.372024+0000","last_became_peered":"2024-09-17T01:38:37.372024+0000","last_unstale":"2024-09-17T01:38:37.378232+0000","last_undegraded":"2024-09-17T01:38:37.378232+0000","last_fullsized":"2024-09-17T01:38:37.378232+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:13:31.562388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.430237+0000","last_change":"2024-09-17T01:38:36.347864+0000","last_active":"2024-09-17T01:38:38.430237+0000","last_peered":"2024-09-17T01:38:38.430237+0000","last_clean":"2024-09-17T01:38:38.430237+0000","last_became_active":"2024-09-17T01:38:36.347504+0000","last_became_peered":"2024-09-17T01:38:36.347504+0000","last_unstale":"2024-09-17T01:38:38.430237+0000","last_undegraded":"2024-09-17T01:38:38.430237+0000","last_fullsized":"2024-09-17T01:38:38.430237+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:06:47.085456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.357464+0000","last_change":"2024-09-17T01:38:37.354296+0000","last_active":"2024-09-17T01:38:38.357464+0000","last_peered":"2024-09-17T01:38:38.357464+0000","last_clean":"2024-09-17T01:38:38.357464+0000","last_became_active":"2024-09-17T01:38:37.349917+0000","last_became_peered":"2024-09-17T01:38:37.349917+0000","last_unstale":"2024-09-17T01:38:38.357464+0000","last_undegraded":"2024-09-17T01:38:38.357464+0000","last_fullsized":"2024-09-17T01:38:38.357464+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:04.081894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.511025+0000","last_change":"2024-09-17T01:38:36.342424+0000","last_active":"2024-09-17T01:38:38.511025+0000","last_peered":"2024-09-17T01:38:38.511025+0000","last_clean":"2024-09-17T01:38:38.511025+0000","last_became_active":"2024-09-17T01:38:36.342122+0000","last_became_peered":"2024-09-17T01:38:36.342122+0000","last_unstale":"2024-09-17T01:38:38.511025+0000","last_undegraded":"2024-09-17T01:38:38.511025+0000","last_fullsized":"2024-09-17T01:38:38.511025+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:02.276154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.430438+0000","last_change":"2024-09-17T01:38:37.368695+0000","last_active":"2024-09-17T01:38:38.430438+0000","last_peered":"2024-09-17T01:38:38.430438+0000","last_clean":"2024-09-17T01:38:38.430438+0000","last_became_active":"2024-09-17T01:38:37.368327+0000","last_became_peered":"2024-09-17T01:38:37.368327+0000","last_unstale":"2024-09-17T01:38:38.430438+0000","last_undegraded":"2024-09-17T01:38:38.430438+0000","last_fullsized":"2024-09-17T01:38:38.430438+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:28.957571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.357368+0000","last_change":"2024-09-17T01:38:36.352289+0000","last_active":"2024-09-17T01:38:38.357368+0000","last_peered":"2024-09-17T01:38:38.357368+0000","last_clean":"2024-09-17T01:38:38.357368+0000","last_became_active":"2024-09-17T01:38:36.351640+0000","last_became_peered":"2024-09-17T01:38:36.351640+0000","last_unstale":"2024-09-17T01:38:38.357368+0000","last_undegraded":"2024-09-17T01:38:38.357368+0000","last_fullsized":"2024-09-17T01:38:38.357368+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:22.402290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.375026+0000","last_change":"2024-09-17T01:38:37.366327+0000","last_active":"2024-09-17T01:38:37.375026+0000","last_peered":"2024-09-17T01:38:37.375026+0000","last_clean":"2024-09-17T01:38:37.375026+0000","last_became_active":"2024-09-17T01:38:37.365925+0000","last_became_peered":"2024-09-17T01:38:37.365925+0000","last_unstale":"2024-09-17T01:38:37.375026+0000","last_undegraded":"2024-09-17T01:38:37.375026+0000","last_fullsized":"2024-09-17T01:38:37.375026+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:07.314877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"107'2","reported_seq":17,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.356119+0000","last_change":"2024-09-17T01:38:36.338625+0000","last_active":"2024-09-17T01:38:38.356119+0000","last_peered":"2024-09-17T01:38:38.356119+0000","last_clean":"2024-09-17T01:38:38.356119+0000","last_became_active":"2024-09-17T01:38:36.337977+0000","last_became_peered":"2024-09-17T01:38:36.337977+0000","last_unstale":"2024-09-17T01:38:38.356119+0000","last_undegraded":"2024-09-17T01:38:38.356119+0000","last_fullsized":"2024-09-17T01:38:38.356119+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:11.569738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.377692+0000","last_change":"2024-09-17T01:38:37.372638+0000","last_active":"2024-09-17T01:38:37.377692+0000","last_peered":"2024-09-17T01:38:37.377692+0000","last_clean":"2024-09-17T01:38:37.377692+0000","last_became_active":"2024-09-17T01:38:37.369862+0000","last_became_peered":"2024-09-17T01:38:37.369862+0000","last_unstale":"2024-09-17T01:38:37.377692+0000","last_undegraded":"2024-09-17T01:38:37.377692+0000","last_fullsized":"2024-09-17T01:38:37.377692+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:35.006712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.354379+0000","last_change":"2024-09-17T01:38:36.349455+0000","last_active":"2024-09-17T01:38:37.354379+0000","last_peered":"2024-09-17T01:38:37.354379+0000","last_clean":"2024-09-17T01:38:37.354379+0000","last_became_active":"2024-09-17T01:38:36.343322+0000","last_became_peered":"2024-09-17T01:38:36.343322+0000","last_unstale":"2024-09-17T01:38:37.354379+0000","last_undegraded":"2024-09-17T01:38:37.354379+0000","last_fullsized":"2024-09-17T01:38:37.354379+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:36.569059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.358639+0000","last_change":"2024-09-17T01:38:37.362983+0000","last_active":"2024-09-17T01:38:38.358639+0000","last_peered":"2024-09-17T01:38:38.358639+0000","last_clean":"2024-09-17T01:38:38.358639+0000","last_became_active":"2024-09-17T01:38:37.362640+0000","last_became_peered":"2024-09-17T01:38:37.362640+0000","last_unstale":"2024-09-17T01:38:38.358639+0000","last_undegraded":"2024-09-17T01:38:38.358639+0000","last_fullsized":"2024-09-17T01:38:38.358639+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:32:19.792157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.353789+0000","last_change":"2024-09-17T01:38:36.350141+0000","last_active":"2024-09-17T01:38:37.353789+0000","last_peered":"2024-09-17T01:38:37.353789+0000","last_clean":"2024-09-17T01:38:37.353789+0000","last_became_active":"2024-09-17T01:38:36.348311+0000","last_became_peered":"2024-09-17T01:38:36.348311+0000","last_unstale":"2024-09-17T01:38:37.353789+0000","last_undegraded":"2024-09-17T01:38:37.353789+0000","last_fullsized":"2024-09-17T01:38:37.353789+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:13.657882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.306589+0000","last_change":"2024-09-17T01:38:37.359846+0000","last_active":"2024-09-17T01:38:39.306589+0000","last_peered":"2024-09-17T01:38:39.306589+0000","last_clean":"2024-09-17T01:38:39.306589+0000","last_became_active":"2024-09-17T01:38:37.357795+0000","last_became_peered":"2024-09-17T01:38:37.357795+0000","last_unstale":"2024-09-17T01:38:39.306589+0000","last_undegraded":"2024-09-17T01:38:39.306589+0000","last_fullsized":"2024-09-17T01:38:39.306589+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:38:10.836763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.430683+0000","last_change":"2024-09-17T01:38:36.338438+0000","last_active":"2024-09-17T01:38:38.430683+0000","last_peered":"2024-09-17T01:38:38.430683+0000","last_clean":"2024-09-17T01:38:38.430683+0000","last_became_active":"2024-09-17T01:38:36.336932+0000","last_became_peered":"2024-09-17T01:38:36.336932+0000","last_unstale":"2024-09-17T01:38:38.430683+0000","last_undegraded":"2024-09-17T01:38:38.430683+0000","last_fullsized":"2024-09-17T01:38:38.430683+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:25.419336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.378443+0000","last_change":"2024-09-17T01:38:37.372643+0000","last_active":"2024-09-17T01:38:37.378443+0000","last_peered":"2024-09-17T01:38:37.378443+0000","last_clean":"2024-09-17T01:38:37.378443+0000","last_became_active":"2024-09-17T01:38:37.369945+0000","last_became_peered":"2024-09-17T01:38:37.369945+0000","last_unstale":"2024-09-17T01:38:37.378443+0000","last_undegraded":"2024-09-17T01:38:37.378443+0000","last_fullsized":"2024-09-17T01:38:37.378443+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:01.272409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.359625+0000","last_change":"2024-09-17T01:38:36.347302+0000","last_active":"2024-09-17T01:38:38.359625+0000","last_peered":"2024-09-17T01:38:38.359625+0000","last_clean":"2024-09-17T01:38:38.359625+0000","last_became_active":"2024-09-17T01:38:36.344001+0000","last_became_peered":"2024-09-17T01:38:36.344001+0000","last_unstale":"2024-09-17T01:38:38.359625+0000","last_undegraded":"2024-09-17T01:38:38.359625+0000","last_fullsized":"2024-09-17T01:38:38.359625+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:53.756827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.306335+0000","last_change":"2024-09-17T01:38:37.354891+0000","last_active":"2024-09-17T01:38:39.306335+0000","last_peered":"2024-09-17T01:38:39.306335+0000","last_clean":"2024-09-17T01:38:39.306335+0000","last_became_active":"2024-09-17T01:38:37.354493+0000","last_became_peered":"2024-09-17T01:38:37.354493+0000","last_unstale":"2024-09-17T01:38:39.306335+0000","last_undegraded":"2024-09-17T01:38:39.306335+0000","last_fullsized":"2024-09-17T01:38:39.306335+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:26:38.907384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.430339+0000","last_change":"2024-09-17T01:38:36.347248+0000","last_active":"2024-09-17T01:38:38.430339+0000","last_peered":"2024-09-17T01:38:38.430339+0000","last_clean":"2024-09-17T01:38:38.430339+0000","last_became_active":"2024-09-17T01:38:36.346875+0000","last_became_peered":"2024-09-17T01:38:36.346875+0000","last_unstale":"2024-09-17T01:38:38.430339+0000","last_undegraded":"2024-09-17T01:38:38.430339+0000","last_fullsized":"2024-09-17T01:38:38.430339+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:42.466486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-17T01:38:37.376584+0000","last_change":"2024-09-17T01:38:37.366977+0000","last_active":"2024-09-17T01:38:37.376584+0000","last_peered":"2024-09-17T01:38:37.376584+0000","last_clean":"2024-09-17T01:38:37.376584+0000","last_became_active":"2024-09-17T01:38:37.366518+0000","last_became_peered":"2024-09-17T01:38:37.366518+0000","last_unstale":"2024-09-17T01:38:37.376584+0000","last_undegraded":"2024-09-17T01:38:37.376584+0000","last_fullsized":"2024-09-17T01:38:37.376584+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:33.346279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:39.152811+0000","last_change":"2024-09-17T01:38:36.352556+0000","last_active":"2024-09-17T01:38:39.152811+0000","last_peered":"2024-09-17T01:38:39.152811+0000","last_clean":"2024-09-17T01:38:39.152811+0000","last_became_active":"2024-09-17T01:38:36.351764+0000","last_became_peered":"2024-09-17T01:38:36.351764+0000","last_unstale":"2024-09-17T01:38:39.152811+0000","last_undegraded":"2024-09-17T01:38:39.152811+0000","last_fullsized":"2024-09-17T01:38:39.152811+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:05.966640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.356119+0000","last_change":"2024-09-17T01:38:37.364328+0000","last_active":"2024-09-17T01:38:38.356119+0000","last_peered":"2024-09-17T01:38:38.356119+0000","last_clean":"2024-09-17T01:38:38.356119+0000","last_became_active":"2024-09-17T01:38:37.363982+0000","last_became_peered":"2024-09-17T01:38:37.363982+0000","last_unstale":"2024-09-17T01:38:38.356119+0000","last_undegraded":"2024-09-17T01:38:38.356119+0000","last_fullsized":"2024-09-17T01:38:38.356119+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:41:16.727527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.357484+0000","last_change":"2024-09-17T01:38:36.345874+0000","last_active":"2024-09-17T01:38:38.357484+0000","last_peered":"2024-09-17T01:38:38.357484+0000","last_clean":"2024-09-17T01:38:38.357484+0000","last_became_active":"2024-09-17T01:38:36.345486+0000","last_became_peered":"2024-09-17T01:38:36.345486+0000","last_unstale":"2024-09-17T01:38:38.357484+0000","last_undegraded":"2024-09-17T01:38:38.357484+0000","last_fullsized":"2024-09-17T01:38:38.357484+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:38.954717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":13,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.358978+0000","last_change":"2024-09-17T01:38:37.364039+0000","last_active":"2024-09-17T01:38:38.358978+0000","last_peered":"2024-09-17T01:38:38.358978+0000","last_clean":"2024-09-17T01:38:38.358978+0000","last_became_active":"2024-09-17T01:38:37.363734+0000","last_became_peered":"2024-09-17T01:38:37.363734+0000","last_unstale":"2024-09-17T01:38:38.358978+0000","last_undegraded":"2024-09-17T01:38:38.358978+0000","last_fullsized":"2024-09-17T01:38:38.358978+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:36.314399+0000","last_clean_scrub_stamp":"2024-09-17T01:38:36.314399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:05.665716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"107'1","reported_seq":16,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.356048+0000","last_change":"2024-09-17T01:38:36.353991+0000","last_active":"2024-09-17T01:38:38.356048+0000","last_peered":"2024-09-17T01:38:38.356048+0000","last_clean":"2024-09-17T01:38:38.356048+0000","last_became_active":"2024-09-17T01:38:36.353640+0000","last_became_peered":"2024-09-17T01:38:36.353640+0000","last_unstale":"2024-09-17T01:38:38.356048+0000","last_undegraded":"2024-09-17T01:38:38.356048+0000","last_fullsized":"2024-09-17T01:38:38.356048+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:38:35.307868+0000","last_clean_scrub_stamp":"2024-09-17T01:38:35.307868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:04.952975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":272,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-17T01:38:38.355533+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:38:38.355533+0000","last_peered":"2024-09-17T01:38:38.355533+0000","last_clean":"2024-09-17T01:38:38.355533+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:38:38.355533+0000","last_undegraded":"2024-09-17T01:38:38.355533+0000","last_fullsized":"2024-09-17T01:38:38.355533+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476821,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28332,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343508,"statfs":{"total":96636764160,"available":96607752192,"internally_reserved":0,"allocated":1331200,"data_stored":578164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509524,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40812,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331028,"statfs":{"total":96636764160,"available":96594972672,"internally_reserved":0,"allocated":1331200,"data_stored":578676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509523,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44968,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326872,"statfs":{"total":96636764160,"available":96590716928,"internally_reserved":0,"allocated":1327104,"data_stored":578094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509524,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28332,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343508,"statfs":{"total":96636764160,"available":96607752192,"internally_reserved":0,"allocated":1331200,"data_stored":578676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509524,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28324,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343516,"statfs":{"total":96636764160,"available":96607760384,"internally_reserved":0,"allocated":1327104,"data_stored":571988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509523,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45568,"kb_used_data":1896,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326272,"statfs":{"total":96636764160,"available":96590102528,"internally_reserved":0,"allocated":1941504,"data_stored":1170186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509525,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40812,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331028,"statfs":{"total":96636764160,"available":96594972672,"internally_reserved":0,"allocated":1327104,"data_stored":578094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542229,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41396,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330444,"statfs":{"total":96636764160,"available":96594374656,"internally_reserved":0,"allocated":1929216,"data_stored":1163830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:38:42.335 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T01:38:42.335 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T01:38:42.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.609+0000 7fd651200640 1 -- 172.21.15.42:0/1456299544 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd64c06d430 msgr2=0x7fd64c06d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:42.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.609+0000 7fd651200640 1 --2- 172.21.15.42:0/1456299544 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd64c06d430 0x7fd64c06d840 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fd644005fd0 tx=0x7fd64402a9c0 comp rx=0 tx=0).stop 2024-09-17T01:38:42.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.609+0000 7fd651200640 1 -- 172.21.15.42:0/1456299544 shutdown_connections 2024-09-17T01:38:42.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.609+0000 7fd651200640 1 --2- 172.21.15.42:0/1456299544 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd64c06d430 0x7fd64c06d840 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:42.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.609+0000 7fd651200640 1 --2- 172.21.15.42:0/1456299544 >> v2:172.21.15.43:3300/0 conn(0x7fd64c0cef70 0x7fd64c156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:42.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.609+0000 7fd651200640 1 -- 172.21.15.42:0/1456299544 >> 172.21.15.42:0/1456299544 conn(0x7fd64c0b2930 msgr2=0x7fd64c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:42.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.609+0000 7fd651200640 1 -- 172.21.15.42:0/1456299544 shutdown_connections 2024-09-17T01:38:42.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.609+0000 7fd651200640 1 -- 172.21.15.42:0/1456299544 wait complete. 2024-09-17T01:38:42.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.611+0000 7fd651200640 1 Processor -- start 2024-09-17T01:38:42.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.611+0000 7fd651200640 1 -- start start 2024-09-17T01:38:42.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.613+0000 7fd651200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd64c06d430 0x7fd64c15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:42.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.613+0000 7fd651200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd64c0b5100 0x7fd64c154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:42.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.613+0000 7fd651200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd64c0cef70 0x7fd64c0ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:42.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.613+0000 7fd651200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd64c0729c0 con 0x7fd64c06d430 2024-09-17T01:38:42.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.613+0000 7fd651200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd64c072840 con 0x7fd64c0b5100 2024-09-17T01:38:42.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.613+0000 7fd651200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd64c072b40 con 0x7fd64c0cef70 2024-09-17T01:38:42.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.613+0000 7fd649e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd64c06d430 0x7fd64c15fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:42.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.613+0000 7fd649e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd64c06d430 0x7fd64c15fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42754/0 (socket says 172.21.15.42:42754) 2024-09-17T01:38:42.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.613+0000 7fd649e00640 1 -- 172.21.15.42:0/369605808 learned_addr learned my addr 172.21.15.42:0/369605808 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:42.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.613+0000 7fd649400640 1 --2- 172.21.15.42:0/369605808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd64c0b5100 0x7fd64c154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:42.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.613+0000 7fd64a800640 1 --2- 172.21.15.42:0/369605808 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd64c0cef70 0x7fd64c0ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:42.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.613+0000 7fd649e00640 1 -- 172.21.15.42:0/369605808 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd64c0cef70 msgr2=0x7fd64c0ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:42.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.613+0000 7fd649e00640 1 --2- 172.21.15.42:0/369605808 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd64c0cef70 0x7fd64c0ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:42.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.613+0000 7fd649e00640 1 -- 172.21.15.42:0/369605808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd64c0b5100 msgr2=0x7fd64c154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:42.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.613+0000 7fd649e00640 1 --2- 172.21.15.42:0/369605808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd64c0b5100 0x7fd64c154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:42.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.613+0000 7fd649e00640 1 -- 172.21.15.42:0/369605808 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd64c15ea00 con 0x7fd64c06d430 2024-09-17T01:38:42.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.613+0000 7fd649400640 1 --2- 172.21.15.42:0/369605808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd64c0b5100 0x7fd64c154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:42.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.614+0000 7fd649e00640 1 --2- 172.21.15.42:0/369605808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd64c06d430 0x7fd64c15fab0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00b420 tx=0x7fd63c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:42.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.614+0000 7fd642000640 1 -- 172.21.15.42:0/369605808 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63c011830 con 0x7fd64c06d430 2024-09-17T01:38:42.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.614+0000 7fd642000640 1 -- 172.21.15.42:0/369605808 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd63c016070 con 0x7fd64c06d430 2024-09-17T01:38:42.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.614+0000 7fd651200640 1 -- 172.21.15.42:0/369605808 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd64c15ece0 con 0x7fd64c06d430 2024-09-17T01:38:42.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.614+0000 7fd642000640 1 -- 172.21.15.42:0/369605808 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63c011d60 con 0x7fd64c06d430 2024-09-17T01:38:42.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.614+0000 7fd651200640 1 -- 172.21.15.42:0/369605808 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd64c15f590 con 0x7fd64c06d430 2024-09-17T01:38:42.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.615+0000 7fd651200640 1 -- 172.21.15.42:0/369605808 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd64c15ef20 con 0x7fd64c06d430 2024-09-17T01:38:42.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.617+0000 7fd642000640 1 -- 172.21.15.42:0/369605808 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd63c01b460 con 0x7fd64c06d430 2024-09-17T01:38:42.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.617+0000 7fd642000640 1 --2- 172.21.15.42:0/369605808 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd62c078b90 0x7fd62c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:42.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.618+0000 7fd642000640 1 -- 172.21.15.42:0/369605808 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5709+0+0 (secure 0 0 0) 0x7fd63c09a810 con 0x7fd64c06d430 2024-09-17T01:38:42.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.618+0000 7fd649400640 1 --2- 172.21.15.42:0/369605808 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd62c078b90 0x7fd62c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:42.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.619+0000 7fd649400640 1 --2- 172.21.15.42:0/369605808 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd62c078b90 0x7fd62c07b0a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd638005fd0 tx=0x7fd638005ea0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:42.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.622+0000 7fd642000640 1 -- 172.21.15.42:0/369605808 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd63c020020 con 0x7fd64c06d430 2024-09-17T01:38:42.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.886+0000 7fd651200640 1 -- 172.21.15.42:0/369605808 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fd64c06d840 con 0x7fd64c06d430 2024-09-17T01:38:42.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.890+0000 7fd642000640 1 -- 172.21.15.42:0/369605808 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v34) ==== 190+0+147 (secure 0 0 0) 0x7fd63c0690e0 con 0x7fd64c06d430 2024-09-17T01:38:42.888 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-09-17T01:38:42.888 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA== 2024-09-17T01:38:42.888 INFO:teuthology.orchestra.run.smithi042.stdout: caps mds = "allow" 2024-09-17T01:38:42.888 INFO:teuthology.orchestra.run.smithi042.stdout: caps mon = "allow r" 2024-09-17T01:38:42.888 INFO:teuthology.orchestra.run.smithi042.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T01:38:42.888 INFO:teuthology.orchestra.run.smithi042.stderr:updated caps for client.0 2024-09-17T01:38:42.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.892+0000 7fd651200640 1 -- 172.21.15.42:0/369605808 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd62c078b90 msgr2=0x7fd62c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:42.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.892+0000 7fd651200640 1 --2- 172.21.15.42:0/369605808 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd62c078b90 0x7fd62c07b0a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd638005fd0 tx=0x7fd638005ea0 comp rx=0 tx=0).stop 2024-09-17T01:38:42.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.892+0000 7fd651200640 1 -- 172.21.15.42:0/369605808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd64c06d430 msgr2=0x7fd64c15fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:42.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.892+0000 7fd651200640 1 --2- 172.21.15.42:0/369605808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd64c06d430 0x7fd64c15fab0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00b420 tx=0x7fd63c00b8e0 comp rx=0 tx=0).stop 2024-09-17T01:38:42.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.892+0000 7fd651200640 1 -- 172.21.15.42:0/369605808 shutdown_connections 2024-09-17T01:38:42.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.892+0000 7fd651200640 1 --2- 172.21.15.42:0/369605808 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd62c078b90 0x7fd62c07b0a0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:42.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.892+0000 7fd651200640 1 --2- 172.21.15.42:0/369605808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd64c0b5100 0x7fd64c154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:42.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.892+0000 7fd651200640 1 --2- 172.21.15.42:0/369605808 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd64c0cef70 0x7fd64c0ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:42.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.892+0000 7fd651200640 1 --2- 172.21.15.42:0/369605808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd64c06d430 0x7fd64c15fab0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:42.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.892+0000 7fd651200640 1 -- 172.21.15.42:0/369605808 >> 172.21.15.42:0/369605808 conn(0x7fd64c0b2930 msgr2=0x7fd64c15aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:42.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.892+0000 7fd651200640 1 -- 172.21.15.42:0/369605808 shutdown_connections 2024-09-17T01:38:42.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:42.893+0000 7fd651200640 1 -- 172.21.15.42:0/369605808 wait complete. 2024-09-17T01:38:42.917 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:38:43.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.146+0000 7f65a4c00640 1 -- 172.21.15.42:0/1178464100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65a006d430 msgr2=0x7f65a006d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:43.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.146+0000 7f65a4c00640 1 --2- 172.21.15.42:0/1178464100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65a006d430 0x7f65a006d840 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f65a0071ef0 tx=0x7f658c02a560 comp rx=0 tx=0).stop 2024-09-17T01:38:43.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.146+0000 7f65a4c00640 1 -- 172.21.15.42:0/1178464100 shutdown_connections 2024-09-17T01:38:43.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.146+0000 7f65a4c00640 1 --2- 172.21.15.42:0/1178464100 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65a015f480 0x7f65a015f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:43.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.146+0000 7f65a4c00640 1 --2- 172.21.15.42:0/1178464100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65a006d430 0x7f65a006d840 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:43.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.146+0000 7f65a4c00640 1 --2- 172.21.15.42:0/1178464100 >> v2:172.21.15.43:3300/0 conn(0x7f65a015cb80 0x7f65a0152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:43.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.146+0000 7f65a4c00640 1 -- 172.21.15.42:0/1178464100 >> 172.21.15.42:0/1178464100 conn(0x7f65a00b2930 msgr2=0x7f65a006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:43.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.147+0000 7f65a4c00640 1 -- 172.21.15.42:0/1178464100 shutdown_connections 2024-09-17T01:38:43.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.147+0000 7f65a4c00640 1 -- 172.21.15.42:0/1178464100 wait complete. 2024-09-17T01:38:43.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.149+0000 7f65a4c00640 1 Processor -- start 2024-09-17T01:38:43.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.149+0000 7f65a4c00640 1 -- start start 2024-09-17T01:38:43.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.150+0000 7f65a4c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65a006d430 0x7f65a01f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:43.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.150+0000 7f65a4c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65a015cb80 0x7f65a0150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:43.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.150+0000 7f65a4c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65a015f480 0x7f65a0156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:43.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.150+0000 7f65a4c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f65a0073820 con 0x7f65a015f480 2024-09-17T01:38:43.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.150+0000 7f65a4c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f65a00736a0 con 0x7f65a006d430 2024-09-17T01:38:43.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.150+0000 7f65a4c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f65a00739a0 con 0x7f65a015cb80 2024-09-17T01:38:43.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.151+0000 7f659e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65a015f480 0x7f65a0156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:43.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.151+0000 7f659e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65a015f480 0x7f65a0156ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42762/0 (socket says 172.21.15.42:42762) 2024-09-17T01:38:43.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.151+0000 7f659e800640 1 -- 172.21.15.42:0/3096989097 learned_addr learned my addr 172.21.15.42:0/3096989097 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:43.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.151+0000 7f659d400640 1 --2- 172.21.15.42:0/3096989097 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65a015cb80 0x7f65a0150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:43.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.151+0000 7f659de00640 1 --2- 172.21.15.42:0/3096989097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65a006d430 0x7f65a01f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:43.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.151+0000 7f659e800640 1 -- 172.21.15.42:0/3096989097 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65a015cb80 msgr2=0x7f65a0150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:43.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.151+0000 7f659e800640 1 --2- 172.21.15.42:0/3096989097 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65a015cb80 0x7f65a0150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:43.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.151+0000 7f659e800640 1 -- 172.21.15.42:0/3096989097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65a006d430 msgr2=0x7f65a01f9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:43.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.151+0000 7f659e800640 1 --2- 172.21.15.42:0/3096989097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65a006d430 0x7f65a01f9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:43.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.151+0000 7f659e800640 1 -- 172.21.15.42:0/3096989097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a0156910 con 0x7f65a015f480 2024-09-17T01:38:43.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.151+0000 7f659e800640 1 --2- 172.21.15.42:0/3096989097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65a015f480 0x7f65a0156ed0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f659800cb00 tx=0x7f659800a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:43.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.152+0000 7f6596000640 1 -- 172.21.15.42:0/3096989097 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659800f450 con 0x7f65a015f480 2024-09-17T01:38:43.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.152+0000 7f6596000640 1 -- 172.21.15.42:0/3096989097 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f659800f700 con 0x7f65a015f480 2024-09-17T01:38:43.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.152+0000 7f6596000640 1 -- 172.21.15.42:0/3096989097 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659800fb50 con 0x7f65a015f480 2024-09-17T01:38:43.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.152+0000 7f65a4c00640 1 -- 172.21.15.42:0/3096989097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a01f9460 con 0x7f65a015f480 2024-09-17T01:38:43.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.152+0000 7f65a4c00640 1 -- 172.21.15.42:0/3096989097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a01f9a20 con 0x7f65a015f480 2024-09-17T01:38:43.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.153+0000 7f65a4c00640 1 -- 172.21.15.42:0/3096989097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a0073ec0 con 0x7f65a015f480 2024-09-17T01:38:43.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.154+0000 7f6596000640 1 -- 172.21.15.42:0/3096989097 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f659800fcf0 con 0x7f65a015f480 2024-09-17T01:38:43.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.155+0000 7f6596000640 1 --2- 172.21.15.42:0/3096989097 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6580078bc0 0x7f658007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:43.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.155+0000 7f6596000640 1 -- 172.21.15.42:0/3096989097 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5709+0+0 (secure 0 0 0) 0x7f659809ba20 con 0x7f65a015f480 2024-09-17T01:38:43.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.156+0000 7f659de00640 1 --2- 172.21.15.42:0/3096989097 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6580078bc0 0x7f658007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:43.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.156+0000 7f659de00640 1 --2- 172.21.15.42:0/3096989097 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6580078bc0 0x7f658007b0d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6590005fd0 tx=0x7f659000c460 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:43.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.160+0000 7f6596000640 1 -- 172.21.15.42:0/3096989097 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6598014030 con 0x7f65a015f480 2024-09-17T01:38:43.307 INFO:tasks.ceph.mds.c.smithi042.stderr:2024-09-17T01:38:43.310+0000 7f418c000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:38:43.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.392+0000 7f65a4c00640 1 -- 172.21.15.42:0/3096989097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65a006a170 con 0x7f65a015f480 2024-09-17T01:38:43.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.393+0000 7f6596000640 1 -- 172.21.15.42:0/3096989097 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+5225 (secure 0 0 0) 0x7f6598063770 con 0x7f65a015f480 2024-09-17T01:38:43.393 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:38:43.393 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":88,"btime":"2024-09-17T01:38:40:360685+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6620,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3878726745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3878726745},{"type":"v1","addr":"172.21.15.43:6836","nonce":3878726745}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":7255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2458291962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":2458291962},{"type":"v1","addr":"172.21.15.42:6835","nonce":2458291962}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":7261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2788778312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2788778312},{"type":"v1","addr":"172.21.15.43:6837","nonce":2788778312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:38:36.843275+0000","modified":"2024-09-17T01:38:39.867027+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7644},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7644":{"gid":7644,"name":"c","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6834/1078007521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1078007521},{"type":"v1","addr":"172.21.15.42:6834","nonce":1078007521}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7644,"qdb_cluster":[7644]},"id":7}]} 2024-09-17T01:38:43.394 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 88 2024-09-17T01:38:43.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.396+0000 7f65a4c00640 1 -- 172.21.15.42:0/3096989097 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6580078bc0 msgr2=0x7f658007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:43.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.396+0000 7f65a4c00640 1 --2- 172.21.15.42:0/3096989097 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6580078bc0 0x7f658007b0d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6590005fd0 tx=0x7f659000c460 comp rx=0 tx=0).stop 2024-09-17T01:38:43.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.396+0000 7f65a4c00640 1 -- 172.21.15.42:0/3096989097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65a015f480 msgr2=0x7f65a0156ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:43.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.396+0000 7f65a4c00640 1 --2- 172.21.15.42:0/3096989097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65a015f480 0x7f65a0156ed0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f659800cb00 tx=0x7f659800a250 comp rx=0 tx=0).stop 2024-09-17T01:38:43.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.396+0000 7f65a4c00640 1 -- 172.21.15.42:0/3096989097 shutdown_connections 2024-09-17T01:38:43.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.396+0000 7f65a4c00640 1 --2- 172.21.15.42:0/3096989097 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6580078bc0 0x7f658007b0d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:43.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.396+0000 7f65a4c00640 1 --2- 172.21.15.42:0/3096989097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65a015f480 0x7f65a0156ed0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:43.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.396+0000 7f65a4c00640 1 --2- 172.21.15.42:0/3096989097 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65a015cb80 0x7f65a0150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:43.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.396+0000 7f65a4c00640 1 --2- 172.21.15.42:0/3096989097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65a006d430 0x7f65a01f9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:43.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.396+0000 7f65a4c00640 1 -- 172.21.15.42:0/3096989097 >> 172.21.15.42:0/3096989097 conn(0x7f65a00b2930 msgr2=0x7f65a0166e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:43.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.396+0000 7f65a4c00640 1 -- 172.21.15.42:0/3096989097 shutdown_connections 2024-09-17T01:38:43.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:43.396+0000 7f65a4c00640 1 -- 172.21.15.42:0/3096989097 wait complete. 2024-09-17T01:38:43.821 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 88, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:38:36.843275+0000', 'modified': '2024-09-17T01:38:39.867027+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7644}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7644': {'gid': 7644, 'name': 'c', 'rank': 0, 'incarnation': 84, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.42:6834/1078007521', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6832', 'nonce': 1078007521}, {'type': 'v1', 'addr': '172.21.15.42:6834', 'nonce': 1078007521}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7644, 'qdb_cluster': [7644]} 2024-09-17T01:38:43.821 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T01:38:43.821 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T01:38:44.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.055+0000 7f1dce600640 1 -- 172.21.15.42:0/455075971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dc806d430 msgr2=0x7f1dc806d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:44.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.055+0000 7f1dce600640 1 --2- 172.21.15.42:0/455075971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dc806d430 0x7f1dc806d840 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0005fd0 tx=0x7f1dc002a8b0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.055+0000 7f1dce600640 1 -- 172.21.15.42:0/455075971 shutdown_connections 2024-09-17T01:38:44.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.055+0000 7f1dce600640 1 --2- 172.21.15.42:0/455075971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dc806d430 0x7f1dc806d840 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.055+0000 7f1dce600640 1 --2- 172.21.15.42:0/455075971 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1dc80af980 0x7f1dc80ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.055+0000 7f1dce600640 1 -- 172.21.15.42:0/455075971 >> 172.21.15.42:0/455075971 conn(0x7f1dc80b2930 msgr2=0x7f1dc806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:44.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.056+0000 7f1dce600640 1 -- 172.21.15.42:0/455075971 shutdown_connections 2024-09-17T01:38:44.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.056+0000 7f1dce600640 1 -- 172.21.15.42:0/455075971 wait complete. 2024-09-17T01:38:44.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.058+0000 7f1dce600640 1 Processor -- start 2024-09-17T01:38:44.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.058+0000 7f1dce600640 1 -- start start 2024-09-17T01:38:44.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.059+0000 7f1dce600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dc806d430 0x7f1dc81467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:44.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.059+0000 7f1dce600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1dc80af980 0x7f1dc8145d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:44.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.059+0000 7f1dce600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dc80b3880 0x7f1dc8152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:44.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.059+0000 7f1dce600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc8072ad0 con 0x7f1dc806d430 2024-09-17T01:38:44.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.059+0000 7f1dce600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc8072950 con 0x7f1dc80b3880 2024-09-17T01:38:44.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.059+0000 7f1dce600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc8072c50 con 0x7f1dc80af980 2024-09-17T01:38:44.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.060+0000 7f1dc7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dc806d430 0x7f1dc81467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:44.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.060+0000 7f1dc7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dc806d430 0x7f1dc81467a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42788/0 (socket says 172.21.15.42:42788) 2024-09-17T01:38:44.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.060+0000 7f1dc7400640 1 -- 172.21.15.42:0/1863593643 learned_addr learned my addr 172.21.15.42:0/1863593643 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:44.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.060+0000 7f1dbfe00640 1 --2- 172.21.15.42:0/1863593643 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1dc80af980 0x7f1dc8145d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:44.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.060+0000 7f1dc7e00640 1 --2- 172.21.15.42:0/1863593643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dc80b3880 0x7f1dc8152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:44.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.060+0000 7f1dc7400640 1 -- 172.21.15.42:0/1863593643 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1dc80af980 msgr2=0x7f1dc8145d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:44.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.060+0000 7f1dc7400640 1 --2- 172.21.15.42:0/1863593643 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1dc80af980 0x7f1dc8145d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.060+0000 7f1dc7400640 1 -- 172.21.15.42:0/1863593643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dc80b3880 msgr2=0x7f1dc8152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:44.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.060+0000 7f1dc7400640 1 --2- 172.21.15.42:0/1863593643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dc80b3880 0x7f1dc8152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.060+0000 7f1dc7400640 1 -- 172.21.15.42:0/1863593643 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc8146290 con 0x7f1dc806d430 2024-09-17T01:38:44.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.061+0000 7f1dc7400640 1 --2- 172.21.15.42:0/1863593643 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dc806d430 0x7f1dc81467a0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f1db800c430 tx=0x7f1db800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:44.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.061+0000 7f1dbf400640 1 -- 172.21.15.42:0/1863593643 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db8011790 con 0x7f1dc806d430 2024-09-17T01:38:44.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.061+0000 7f1dbf400640 1 -- 172.21.15.42:0/1863593643 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1db8017070 con 0x7f1dc806d430 2024-09-17T01:38:44.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.061+0000 7f1dbf400640 1 -- 172.21.15.42:0/1863593643 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db8011ce0 con 0x7f1dc806d430 2024-09-17T01:38:44.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.061+0000 7f1dce600640 1 -- 172.21.15.42:0/1863593643 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dc81510d0 con 0x7f1dc806d430 2024-09-17T01:38:44.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.061+0000 7f1dce600640 1 -- 172.21.15.42:0/1863593643 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dc8151690 con 0x7f1dc806d430 2024-09-17T01:38:44.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.063+0000 7f1dbf400640 1 -- 172.21.15.42:0/1863593643 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1db801c460 con 0x7f1dc806d430 2024-09-17T01:38:44.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.064+0000 7f1dbf400640 1 --2- 172.21.15.42:0/1863593643 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1da4078bc0 0x7f1da407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:44.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.065+0000 7f1dbf400640 1 -- 172.21.15.42:0/1863593643 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5709+0+0 (secure 0 0 0) 0x7f1db809ab40 con 0x7f1dc806d430 2024-09-17T01:38:44.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.065+0000 7f1dd56bf740 1 Processor -- start 2024-09-17T01:38:44.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.065+0000 7f1dbfe00640 1 --2- 172.21.15.42:0/1863593643 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1da4078bc0 0x7f1da407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:44.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.065+0000 7f1dd56bf740 1 -- start start 2024-09-17T01:38:44.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.066+0000 7f1dbfe00640 1 --2- 172.21.15.42:0/1863593643 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1da4078bc0 0x7f1da407b0d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1dc815e6f0 tx=0x7f1db0005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:44.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.066+0000 7f1dd56bf740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa00071270 0x55aa00441970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:44.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.066+0000 7f1dd56bf740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa000483b0 0x55aa00441eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:44.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.066+0000 7f1dd56bf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00050590 0x55aa00411f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:44.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.066+0000 7f1dd56bf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55aa0039b430 con 0x55aa00050590 2024-09-17T01:38:44.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.066+0000 7f1dd56bf740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55aa0038b5d0 con 0x55aa00071270 2024-09-17T01:38:44.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.066+0000 7f1dd56bf740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55aa0037aa00 con 0x55aa000483b0 2024-09-17T01:38:44.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.067+0000 7f1dc7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00050590 0x55aa00411f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:44.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.067+0000 7f1dc7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00050590 0x55aa00411f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42796/0 (socket says 172.21.15.42:42796) 2024-09-17T01:38:44.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.067+0000 7f1dc7e00640 1 -- 172.21.15.42:0/2202591589 learned_addr learned my addr 172.21.15.42:0/2202591589 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:44.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.067+0000 7f1dc7400640 1 --2- 172.21.15.42:0/2202591589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa00071270 0x55aa00441970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:44.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.067+0000 7f1dbfe00640 1 --2- 172.21.15.42:0/2202591589 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa000483b0 0x55aa00441eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:44.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.067+0000 7f1dc7e00640 1 -- 172.21.15.42:0/2202591589 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa000483b0 msgr2=0x55aa00441eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.067+0000 7f1dc7e00640 1 --2- 172.21.15.42:0/2202591589 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa000483b0 0x55aa00441eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.067+0000 7f1dc7e00640 1 -- 172.21.15.42:0/2202591589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa00071270 msgr2=0x55aa00441970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.067+0000 7f1dc7e00640 1 --2- 172.21.15.42:0/2202591589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa00071270 0x55aa00441970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.067+0000 7f1dc7e00640 1 -- 172.21.15.42:0/2202591589 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa00343520 con 0x55aa00050590 2024-09-17T01:38:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.067+0000 7f1dc7e00640 1 --2- 172.21.15.42:0/2202591589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00050590 0x55aa00411f60 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0009cd0 tx=0x7f1dc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28f4634ce59dc9c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.068+0000 7f1db7e00640 1 -- 172.21.15.42:0/2202591589 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0003b70 con 0x55aa00050590 2024-09-17T01:38:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.068+0000 7f1db7e00640 1 -- 172.21.15.42:0/2202591589 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1dc0040070 con 0x55aa00050590 2024-09-17T01:38:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.068+0000 7f1db7e00640 1 -- 172.21.15.42:0/2202591589 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc00042a0 con 0x55aa00050590 2024-09-17T01:38:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.068+0000 7f1dd56bf740 1 -- 172.21.15.42:0/2202591589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00050590 msgr2=0x55aa00411f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.068+0000 7f1dd56bf740 1 --2- 172.21.15.42:0/2202591589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00050590 0x55aa00411f60 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0009cd0 tx=0x7f1dc0004a40 comp rx=0 tx=0).stop 2024-09-17T01:38:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.069+0000 7f1dd56bf740 1 -- 172.21.15.42:0/2202591589 shutdown_connections 2024-09-17T01:38:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.069+0000 7f1dd56bf740 1 --2- 172.21.15.42:0/2202591589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00050590 0x55aa00411f60 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.069+0000 7f1dd56bf740 1 --2- 172.21.15.42:0/2202591589 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa000483b0 0x55aa00441eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.069+0000 7f1dd56bf740 1 --2- 172.21.15.42:0/2202591589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa00071270 0x55aa00441970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.069+0000 7f1dd56bf740 1 -- 172.21.15.42:0/2202591589 >> 172.21.15.42:0/2202591589 conn(0x55aa000653c0 msgr2=0x55aa00417970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.069+0000 7f1dd56bf740 1 -- 172.21.15.42:0/2202591589 shutdown_connections 2024-09-17T01:38:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.069+0000 7f1dd56bf740 1 -- 172.21.15.42:0/2202591589 wait complete. 2024-09-17T01:38:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.070+0000 7f1dd56bf740 1 -- start start 2024-09-17T01:38:44.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.070+0000 7f1dd56bf740 1 Processor -- start 2024-09-17T01:38:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.071+0000 7f1dd56bf740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa000483b0 0x55aa0042c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.071+0000 7f1dd56bf740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa00050590 0x55aa0043ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.071+0000 7f1dd56bf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00071270 0x55aa004256d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.071+0000 7f1dd56bf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55aa00321330 con 0x55aa00071270 2024-09-17T01:38:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.071+0000 7f1dd56bf740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55aa0037e810 con 0x55aa00050590 2024-09-17T01:38:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.071+0000 7f1dd56bf740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55aa000eb620 con 0x55aa000483b0 2024-09-17T01:38:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.072+0000 7f1dd56bf740 10 client.0 _ll_register_callbacks cb 0x55aa00326420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:38:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.072+0000 7f1dc7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00071270 0x55aa004256d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.072+0000 7f1dc7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00071270 0x55aa004256d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42806/0 (socket says 172.21.15.42:42806) 2024-09-17T01:38:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.072+0000 7f1dc7e00640 1 -- 172.21.15.42:0/4194627371 learned_addr learned my addr 172.21.15.42:0/4194627371 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.072+0000 7f1dc7400640 1 --2- 172.21.15.42:0/4194627371 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa000483b0 0x55aa0042c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.072+0000 7f1dbfe00640 1 --2- 172.21.15.42:0/4194627371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa00050590 0x55aa0043ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.072+0000 7f1dc7e00640 1 -- 172.21.15.42:0/4194627371 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa000483b0 msgr2=0x55aa0042c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.072+0000 7f1dc7e00640 1 --2- 172.21.15.42:0/4194627371 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa000483b0 0x55aa0042c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.072+0000 7f1dc7e00640 1 -- 172.21.15.42:0/4194627371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa00050590 msgr2=0x55aa0043ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.072+0000 7f1dc7e00640 1 --2- 172.21.15.42:0/4194627371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa00050590 0x55aa0043ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.072+0000 7f1dc7e00640 1 -- 172.21.15.42:0/4194627371 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa000dc850 con 0x55aa00071270 2024-09-17T01:38:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.073+0000 7f1dc7e00640 1 --2- 172.21.15.42:0/4194627371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00071270 0x55aa004256d0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0041000 tx=0x7f1dc0045470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a605105495a5ad server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.073+0000 7f1db4c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:38:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.073+0000 7f1db4c00640 1 -- 172.21.15.42:0/4194627371 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0054060 con 0x55aa00071270 2024-09-17T01:38:44.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.073+0000 7f1dd56bf740 1 -- 172.21.15.42:0/4194627371 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dc0040070 con 0x55aa00071270 2024-09-17T01:38:44.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.073+0000 7f1db4c00640 1 -- 172.21.15.42:0/4194627371 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 5709+0+0 (secure 0 0 0) 0x7f1dc0045a70 con 0x55aa00071270 2024-09-17T01:38:44.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.073+0000 7f1db4c00640 1 -- 172.21.15.42:0/4194627371 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f1dc005a050 con 0x55aa00071270 2024-09-17T01:38:44.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.073+0000 7f1dd56bf740 10 client.7788 fetch_fsmap learned FSMap version 88 2024-09-17T01:38:44.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.073+0000 7f1dd56bf740 1 -- 172.21.15.42:0/4194627371 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) -- 0x55aa001536b0 con 0x55aa00071270 2024-09-17T01:38:44.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.073+0000 7f1db4c00640 1 -- 172.21.15.42:0/4194627371 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1dc0040070 con 0x55aa00071270 2024-09-17T01:38:44.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.073+0000 7f1db4c00640 1 -- 172.21.15.42:0/4194627371 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 88) ==== 3502+0+0 (secure 0 0 0) 0x7f1dc004f460 con 0x55aa00071270 2024-09-17T01:38:44.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.074+0000 7f1dd56bf740 10 client.7788 fetch_fsmap finished waiting for FSMap version 88 2024-09-17T01:38:44.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.074+0000 7f1dd56bf740 10 client.7788 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:38:44.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.074+0000 7f1dd56bf740 20 client.7788 populate_metadata read hostname 'smithi042' 2024-09-17T01:38:44.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.074+0000 7f1dd56bf740 1 --2- 172.21.15.42:0/4194627371 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x55aa0002fe40 0x55aa0046efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:44.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.074+0000 7f1dd56bf740 4 client.7788 mds_command: new command op to 7644 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:38:44.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.074+0000 7f1dd56bf740 1 -- 172.21.15.42:0/4194627371 --> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa0038d520 con 0x55aa0002fe40 2024-09-17T01:38:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.074+0000 7f1dc7400640 1 --2- 172.21.15.42:0/4194627371 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x55aa0002fe40 0x55aa0046efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.074+0000 7f1dc7400640 1 --2- 172.21.15.42:0/4194627371 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x55aa0002fe40 0x55aa0046efa0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=845ff2c9dcfb9e12 server_cookie=c514a25d070fe087 in_seq=0 out_seq=0 2024-09-17T01:38:44.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.074+0000 7f1db4c00640 10 client.7788 ms_handle_connect on v2:172.21.15.42:6832/1078007521 2024-09-17T01:38:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.075+0000 7f1db4c00640 1 -- 172.21.15.42:0/4194627371 <== mds.0 v2:172.21.15.42:6832/1078007521 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aa0038d520 con 0x55aa0002fe40 2024-09-17T01:38:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.075+0000 7f1db4c00640 10 client.7788 handle_command_reply: tid=0 2024-09-17T01:38:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.075+0000 7f1dd56bf740 1 client.7788 shutdown 2024-09-17T01:38:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.076+0000 7f1dd56bf740 1 -- 172.21.15.42:0/4194627371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00071270 msgr2=0x55aa004256d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.076+0000 7f1dd56bf740 1 --2- 172.21.15.42:0/4194627371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00071270 0x55aa004256d0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0041000 tx=0x7f1dc0045470 comp rx=0 tx=0).stop 2024-09-17T01:38:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.076+0000 7f1dd56bf740 1 -- 172.21.15.42:0/4194627371 shutdown_connections 2024-09-17T01:38:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.076+0000 7f1dd56bf740 1 --2- 172.21.15.42:0/4194627371 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x55aa0002fe40 0x55aa0046efa0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.076+0000 7f1dd56bf740 1 --2- 172.21.15.42:0/4194627371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa00050590 0x55aa0043ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.076+0000 7f1dd56bf740 1 --2- 172.21.15.42:0/4194627371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00071270 0x55aa004256d0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.076+0000 7f1dd56bf740 1 --2- 172.21.15.42:0/4194627371 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa000483b0 0x55aa0042c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.076+0000 7f1dd56bf740 1 -- 172.21.15.42:0/4194627371 >> 172.21.15.42:0/4194627371 conn(0x55aa000653c0 msgr2=0x55aa0045fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:44.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.076+0000 7f1db4c00640 0 client.7788 ms_handle_reset on v2:172.21.15.42:6832/1078007521 2024-09-17T01:38:44.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.076+0000 7f1dd56bf740 1 -- 172.21.15.42:0/4194627371 shutdown_connections 2024-09-17T01:38:44.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.076+0000 7f1dd56bf740 1 -- 172.21.15.42:0/4194627371 wait complete. 2024-09-17T01:38:44.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.076+0000 7f1dd56bf740 20 client.7788 trim_cache size 0 max 16384 2024-09-17T01:38:44.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.095+0000 7f1dd56bf740 1 Processor -- start 2024-09-17T01:38:44.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.095+0000 7f1dd56bf740 1 -- start start 2024-09-17T01:38:44.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.097+0000 7f1dd56bf740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa000483b0 0x55aa0045ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:44.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.097+0000 7f1dd56bf740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa00050590 0x55aa004387b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:44.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.097+0000 7f1dd56bf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00071270 0x55aa00438cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:44.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.097+0000 7f1dd56bf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc81583b0 con 0x55aa00071270 2024-09-17T01:38:44.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.097+0000 7f1dd56bf740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc8157710 con 0x55aa000483b0 2024-09-17T01:38:44.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.097+0000 7f1dd56bf740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc8157d60 con 0x55aa00050590 2024-09-17T01:38:44.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.097+0000 7f1dc7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00071270 0x55aa00438cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:44.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.097+0000 7f1dc7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00071270 0x55aa00438cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42812/0 (socket says 172.21.15.42:42812) 2024-09-17T01:38:44.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.097+0000 7f1dc7e00640 1 -- 172.21.15.42:0/2207470117 learned_addr learned my addr 172.21.15.42:0/2207470117 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:44.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.097+0000 7f1dc7400640 1 --2- 172.21.15.42:0/2207470117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa000483b0 0x55aa0045ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:44.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.097+0000 7f1dbfe00640 1 --2- 172.21.15.42:0/2207470117 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa00050590 0x55aa004387b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:44.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.098+0000 7f1dc7e00640 1 -- 172.21.15.42:0/2207470117 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa00050590 msgr2=0x55aa004387b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:44.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.098+0000 7f1dc7e00640 1 --2- 172.21.15.42:0/2207470117 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa00050590 0x55aa004387b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.098+0000 7f1dc7e00640 1 -- 172.21.15.42:0/2207470117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa000483b0 msgr2=0x55aa0045ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:44.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.098+0000 7f1dc7e00640 1 --2- 172.21.15.42:0/2207470117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa000483b0 0x55aa0045ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.098+0000 7f1dc7e00640 1 -- 172.21.15.42:0/2207470117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa00418650 con 0x55aa00071270 2024-09-17T01:38:44.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.098+0000 7f1dbfe00640 1 --2- 172.21.15.42:0/2207470117 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa00050590 0x55aa004387b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:44.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.098+0000 7f1dc7e00640 1 --2- 172.21.15.42:0/2207470117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00071270 0x55aa00438cf0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0009b30 tx=0x7f1dc002adb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d5365bf47699eb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:44.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.098+0000 7f1db7400640 1 -- 172.21.15.42:0/2207470117 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc004f460 con 0x55aa00071270 2024-09-17T01:38:44.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.098+0000 7f1db7400640 1 -- 172.21.15.42:0/2207470117 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1dc0040070 con 0x55aa00071270 2024-09-17T01:38:44.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.098+0000 7f1db7400640 1 -- 172.21.15.42:0/2207470117 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0045ad0 con 0x55aa00071270 2024-09-17T01:38:44.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.099+0000 7f1dd56bf740 1 -- 172.21.15.42:0/2207470117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00071270 msgr2=0x55aa00438cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:44.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.099+0000 7f1dd56bf740 1 --2- 172.21.15.42:0/2207470117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00071270 0x55aa00438cf0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0009b30 tx=0x7f1dc002adb0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.099+0000 7f1dd56bf740 1 -- 172.21.15.42:0/2207470117 shutdown_connections 2024-09-17T01:38:44.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.099+0000 7f1dd56bf740 1 --2- 172.21.15.42:0/2207470117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00071270 0x55aa00438cf0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.099+0000 7f1dd56bf740 1 --2- 172.21.15.42:0/2207470117 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa00050590 0x55aa004387b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.099+0000 7f1dd56bf740 1 --2- 172.21.15.42:0/2207470117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa000483b0 0x55aa0045ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.099+0000 7f1dd56bf740 1 -- 172.21.15.42:0/2207470117 >> 172.21.15.42:0/2207470117 conn(0x55aa000653c0 msgr2=0x55aa0043e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:44.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.099+0000 7f1dd56bf740 1 -- 172.21.15.42:0/2207470117 shutdown_connections 2024-09-17T01:38:44.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.099+0000 7f1dd56bf740 1 -- 172.21.15.42:0/2207470117 wait complete. 2024-09-17T01:38:44.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.100+0000 7f1dd56bf740 1 -- start start 2024-09-17T01:38:44.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.100+0000 7f1dd56bf740 1 Processor -- start 2024-09-17T01:38:44.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.102+0000 7f1dd56bf740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa000483b0 0x55aa004d9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:44.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.102+0000 7f1dd56bf740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00050590 0x55aa00457210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:44.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.102+0000 7f1dd56bf740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa00071270 0x55aa00457750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:44.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.102+0000 7f1dd56bf740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55aa0043b870 con 0x55aa00050590 2024-09-17T01:38:44.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.102+0000 7f1dd56bf740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55aa00456d40 con 0x55aa00071270 2024-09-17T01:38:44.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.102+0000 7f1dd56bf740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55aa004288e0 con 0x55aa000483b0 2024-09-17T01:38:44.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.102+0000 7f1dd56bf740 10 client.0 _ll_register_callbacks cb 0x7f1db0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:38:44.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.102+0000 7f1dbfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00050590 0x55aa00457210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:44.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.102+0000 7f1dbfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00050590 0x55aa00457210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42822/0 (socket says 172.21.15.42:42822) 2024-09-17T01:38:44.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.102+0000 7f1dbfe00640 1 -- 172.21.15.42:0/935528653 learned_addr learned my addr 172.21.15.42:0/935528653 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:44.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.102+0000 7f1dc7e00640 1 --2- 172.21.15.42:0/935528653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa00071270 0x55aa00457750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:44.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.102+0000 7f1dc7400640 1 --2- 172.21.15.42:0/935528653 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa000483b0 0x55aa004d9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:44.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.102+0000 7f1dbfe00640 1 -- 172.21.15.42:0/935528653 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa000483b0 msgr2=0x55aa004d9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:44.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.102+0000 7f1dbfe00640 1 --2- 172.21.15.42:0/935528653 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa000483b0 0x55aa004d9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.103+0000 7f1dbfe00640 1 -- 172.21.15.42:0/935528653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa00071270 msgr2=0x55aa00457750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:38:44.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.103+0000 7f1dbfe00640 1 --2- 172.21.15.42:0/935528653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa00071270 0x55aa00457750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.103+0000 7f1dbfe00640 1 -- 172.21.15.42:0/935528653 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa00438a00 con 0x55aa00050590 2024-09-17T01:38:44.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.103+0000 7f1dbfe00640 1 --2- 172.21.15.42:0/935528653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00050590 0x55aa00457210 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8071ef0 tx=0x7f1db0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfef7a5846d81d46 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:44.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.103+0000 7f1db4c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:38:44.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.103+0000 7f1db4c00640 1 -- 172.21.15.42:0/935528653 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db002f060 con 0x55aa00050590 2024-09-17T01:38:44.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.103+0000 7f1db4c00640 1 -- 172.21.15.42:0/935528653 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 5709+0+0 (secure 0 0 0) 0x7f1db001fd30 con 0x55aa00050590 2024-09-17T01:38:44.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.103+0000 7f1dd56bf740 1 -- 172.21.15.42:0/935528653 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dc0040070 con 0x55aa00050590 2024-09-17T01:38:44.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.103+0000 7f1db4c00640 1 -- 172.21.15.42:0/935528653 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f1db0035050 con 0x55aa00050590 2024-09-17T01:38:44.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.103+0000 7f1dd56bf740 10 client.7794 fetch_fsmap learned FSMap version 88 2024-09-17T01:38:44.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.103+0000 7f1dd56bf740 1 -- 172.21.15.42:0/935528653 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) -- 0x55aa004dc060 con 0x55aa00050590 2024-09-17T01:38:44.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.104+0000 7f1db4c00640 1 -- 172.21.15.42:0/935528653 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1dc0040070 con 0x55aa00050590 2024-09-17T01:38:44.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.104+0000 7f1db4c00640 1 -- 172.21.15.42:0/935528653 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 88) ==== 3502+0+0 (secure 0 0 0) 0x7f1db0038020 con 0x55aa00050590 2024-09-17T01:38:44.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.104+0000 7f1dd56bf740 10 client.7794 fetch_fsmap finished waiting for FSMap version 88 2024-09-17T01:38:44.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.104+0000 7f1dd56bf740 10 client.7794 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:38:44.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.104+0000 7f1dd56bf740 20 client.7794 populate_metadata read hostname 'smithi042' 2024-09-17T01:38:44.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.104+0000 7f1dd56bf740 1 --2- 172.21.15.42:0/935528653 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x55aa004dfe70 0x55aa00436e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:44.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.104+0000 7f1dd56bf740 4 client.7794 mds_command: new command op to 7644 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T01:38:44.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.104+0000 7f1dd56bf740 1 -- 172.21.15.42:0/935528653 --> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] -- command(tid 0: {"prefix": "status"}) -- 0x55aa00388fd0 con 0x55aa004dfe70 2024-09-17T01:38:44.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.104+0000 7f1dc7400640 1 --2- 172.21.15.42:0/935528653 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x55aa004dfe70 0x55aa00436e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:44.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.105+0000 7f1db4c00640 10 client.7794 ms_handle_connect on v2:172.21.15.42:6832/1078007521 2024-09-17T01:38:44.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.105+0000 7f1dc7400640 1 --2- 172.21.15.42:0/935528653 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x55aa004dfe70 0x55aa00436e40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e803e80c10e2f798 server_cookie=d48fc478031b9d36 in_seq=0 out_seq=0 2024-09-17T01:38:44.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.105+0000 7f1db4c00640 1 -- 172.21.15.42:0/935528653 <== mds.0 v2:172.21.15.42:6832/1078007521 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55aa00388fd0 con 0x55aa004dfe70 2024-09-17T01:38:44.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.105+0000 7f1db4c00640 10 client.7794 handle_command_reply: tid=0 2024-09-17T01:38:44.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.105+0000 7f1dd56bf740 1 client.7794 shutdown 2024-09-17T01:38:44.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.105+0000 7f1dd56bf740 1 -- 172.21.15.42:0/935528653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00050590 msgr2=0x55aa00457210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:44.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.105+0000 7f1dd56bf740 1 --2- 172.21.15.42:0/935528653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00050590 0x55aa00457210 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8071ef0 tx=0x7f1db0004730 comp rx=0 tx=0).stop 2024-09-17T01:38:44.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.105+0000 7f1dd56bf740 1 -- 172.21.15.42:0/935528653 shutdown_connections 2024-09-17T01:38:44.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.105+0000 7f1dd56bf740 1 --2- 172.21.15.42:0/935528653 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x55aa004dfe70 0x55aa00436e40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.105+0000 7f1dd56bf740 1 --2- 172.21.15.42:0/935528653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa00071270 0x55aa00457750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.105+0000 7f1dd56bf740 1 --2- 172.21.15.42:0/935528653 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa00050590 0x55aa00457210 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.105+0000 7f1dd56bf740 1 --2- 172.21.15.42:0/935528653 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa000483b0 0x55aa004d9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.105+0000 7f1db4c00640 0 client.7794 ms_handle_reset on v2:172.21.15.42:6832/1078007521 2024-09-17T01:38:44.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.105+0000 7f1dd56bf740 1 -- 172.21.15.42:0/935528653 >> 172.21.15.42:0/935528653 conn(0x55aa000653c0 msgr2=0x55aa0043e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:44.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.105+0000 7f1dd56bf740 1 -- 172.21.15.42:0/935528653 shutdown_connections 2024-09-17T01:38:44.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.105+0000 7f1dd56bf740 1 -- 172.21.15.42:0/935528653 wait complete. 2024-09-17T01:38:44.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.106+0000 7f1dd56bf740 20 client.7794 trim_cache size 0 max 16384 2024-09-17T01:38:44.107 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:38:44.107 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "fea1c88c-cb05-432f-a745-f9dcbb5f2503", 2024-09-17T01:38:44.107 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-17T01:38:44.107 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 7644, 2024-09-17T01:38:44.107 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-17T01:38:44.107 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-17T01:38:44.107 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-17T01:38:44.107 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 6.7700619470000003, 2024-09-17T01:38:44.107 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 88, 2024-09-17T01:38:44.107 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 108, 2024-09-17T01:38:44.108 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 108, 2024-09-17T01:38:44.108 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 11.749676565 2024-09-17T01:38:44.108 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:38:44.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.106+0000 7f1dce600640 1 -- 172.21.15.42:0/1863593643 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1da4078bc0 msgr2=0x7f1da407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:44.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.106+0000 7f1dce600640 1 --2- 172.21.15.42:0/1863593643 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1da4078bc0 0x7f1da407b0d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1dc815e6f0 tx=0x7f1db0005f90 comp rx=0 tx=0).stop 2024-09-17T01:38:44.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.106+0000 7f1dce600640 1 -- 172.21.15.42:0/1863593643 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dc806d430 msgr2=0x7f1dc81467a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:44.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.106+0000 7f1dce600640 1 --2- 172.21.15.42:0/1863593643 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dc806d430 0x7f1dc81467a0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f1db800c430 tx=0x7f1db800c8f0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.106+0000 7f1dce600640 1 -- 172.21.15.42:0/1863593643 shutdown_connections 2024-09-17T01:38:44.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.106+0000 7f1dce600640 1 --2- 172.21.15.42:0/1863593643 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1da4078bc0 0x7f1da407b0d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.106+0000 7f1dce600640 1 --2- 172.21.15.42:0/1863593643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dc80b3880 0x7f1dc8152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.106+0000 7f1dce600640 1 --2- 172.21.15.42:0/1863593643 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1dc80af980 0x7f1dc8145d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.106+0000 7f1dce600640 1 --2- 172.21.15.42:0/1863593643 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dc806d430 0x7f1dc81467a0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.106+0000 7f1dce600640 1 -- 172.21.15.42:0/1863593643 >> 172.21.15.42:0/1863593643 conn(0x7f1dc80b2930 msgr2=0x7f1dc8073190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:44.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.106+0000 7f1dce600640 1 -- 172.21.15.42:0/1863593643 shutdown_connections 2024-09-17T01:38:44.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.106+0000 7f1dce600640 1 -- 172.21.15.42:0/1863593643 wait complete. 2024-09-17T01:38:44.125 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T01:38:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.355+0000 7f21e1400640 1 -- 172.21.15.42:0/1581341291 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21dc0d0d80 msgr2=0x7f21dc06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.355+0000 7f21e1400640 1 --2- 172.21.15.42:0/1581341291 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21dc0d0d80 0x7f21dc06cd20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f21cc009830 tx=0x7f21cc02a530 comp rx=0 tx=0).stop 2024-09-17T01:38:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.355+0000 7f21e1400640 1 -- 172.21.15.42:0/1581341291 shutdown_connections 2024-09-17T01:38:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.355+0000 7f21e1400640 1 --2- 172.21.15.42:0/1581341291 >> v2:172.21.15.42:3300/0 conn(0x7f21dc06d260 0x7f21dc0c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.355+0000 7f21e1400640 1 --2- 172.21.15.42:0/1581341291 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21dc0d0d80 0x7f21dc06cd20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.355+0000 7f21e1400640 1 -- 172.21.15.42:0/1581341291 >> 172.21.15.42:0/1581341291 conn(0x7f21dc0b25f0 msgr2=0x7f21dc0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.355+0000 7f21e1400640 1 -- 172.21.15.42:0/1581341291 shutdown_connections 2024-09-17T01:38:44.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.355+0000 7f21e1400640 1 -- 172.21.15.42:0/1581341291 wait complete. 2024-09-17T01:38:44.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.357+0000 7f21e1400640 1 Processor -- start 2024-09-17T01:38:44.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.357+0000 7f21e1400640 1 -- start start 2024-09-17T01:38:44.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.359+0000 7f21e1400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21dc06d260 0x7f21dc0b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:44.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.359+0000 7f21e1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21dc0af460 0x7f21dc1f6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:44.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.359+0000 7f21e1400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21dc0d0d80 0x7f21dc074ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:44.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.359+0000 7f21e1400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f21dc0ca070 con 0x7f21dc0af460 2024-09-17T01:38:44.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.359+0000 7f21e1400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f21dc15f910 con 0x7f21dc0d0d80 2024-09-17T01:38:44.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.359+0000 7f21e1400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f21dc0ca1f0 con 0x7f21dc06d260 2024-09-17T01:38:44.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.359+0000 7f21db400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21dc0af460 0x7f21dc1f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:44.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.359+0000 7f21dbe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21dc06d260 0x7f21dc0b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:44.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.359+0000 7f21db400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21dc0af460 0x7f21dc1f6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42834/0 (socket says 172.21.15.42:42834) 2024-09-17T01:38:44.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.359+0000 7f21db400640 1 -- 172.21.15.42:0/2952159206 learned_addr learned my addr 172.21.15.42:0/2952159206 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:44.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.359+0000 7f21e0a00640 1 --2- 172.21.15.42:0/2952159206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21dc0d0d80 0x7f21dc074ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:44.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.359+0000 7f21db400640 1 -- 172.21.15.42:0/2952159206 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21dc06d260 msgr2=0x7f21dc0b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:44.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.359+0000 7f21db400640 1 --2- 172.21.15.42:0/2952159206 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21dc06d260 0x7f21dc0b3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.359+0000 7f21db400640 1 -- 172.21.15.42:0/2952159206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21dc0d0d80 msgr2=0x7f21dc074ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:44.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.359+0000 7f21db400640 1 --2- 172.21.15.42:0/2952159206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21dc0d0d80 0x7f21dc074ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.359+0000 7f21db400640 1 -- 172.21.15.42:0/2952159206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21dc1f6880 con 0x7f21dc0af460 2024-09-17T01:38:44.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.360+0000 7f21db400640 1 --2- 172.21.15.42:0/2952159206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21dc0af460 0x7f21dc1f6340 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f21c800c730 tx=0x7f21c800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:44.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.360+0000 7f21d3e00640 1 -- 172.21.15.42:0/2952159206 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c8006890 con 0x7f21dc0af460 2024-09-17T01:38:44.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.360+0000 7f21d3e00640 1 -- 172.21.15.42:0/2952159206 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21c8006a30 con 0x7f21dc0af460 2024-09-17T01:38:44.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.360+0000 7f21e1400640 1 -- 172.21.15.42:0/2952159206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21dc1f9060 con 0x7f21dc0af460 2024-09-17T01:38:44.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.360+0000 7f21d3e00640 1 -- 172.21.15.42:0/2952159206 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c8007030 con 0x7f21dc0af460 2024-09-17T01:38:44.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.360+0000 7f21e1400640 1 -- 172.21.15.42:0/2952159206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21dc1f9620 con 0x7f21dc0af460 2024-09-17T01:38:44.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.361+0000 7f21e1400640 1 -- 172.21.15.42:0/2952159206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21dc0cb520 con 0x7f21dc0af460 2024-09-17T01:38:44.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.362+0000 7f21d3e00640 1 -- 172.21.15.42:0/2952159206 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f21c80071d0 con 0x7f21dc0af460 2024-09-17T01:38:44.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.363+0000 7f21d3e00640 1 --2- 172.21.15.42:0/2952159206 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f21bc078b90 0x7f21bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:44.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.364+0000 7f21d3e00640 1 -- 172.21.15.42:0/2952159206 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5709+0+0 (secure 0 0 0) 0x7f21c809a6d0 con 0x7f21dc0af460 2024-09-17T01:38:44.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.364+0000 7f21dbe00640 1 --2- 172.21.15.42:0/2952159206 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f21bc078b90 0x7f21bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:44.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.365+0000 7f21dbe00640 1 --2- 172.21.15.42:0/2952159206 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f21bc078b90 0x7f21bc07b0a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f21cc034000 tx=0x7f21cc004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:44.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.368+0000 7f21d3e00640 1 -- 172.21.15.42:0/2952159206 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f21dc06d670 con 0x7f21dc0af460 2024-09-17T01:38:44.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.604+0000 7f21e1400640 1 -- 172.21.15.42:0/2952159206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f21dc15bb70 con 0x7f21dc0af460 2024-09-17T01:38:44.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.604+0000 7f21d3e00640 1 -- 172.21.15.42:0/2952159206 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v88) ==== 53+0+73 (secure 0 0 0) 0x7f21c8062420 con 0x7f21dc0af460 2024-09-17T01:38:44.602 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T01:38:44.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.607+0000 7f21e1400640 1 -- 172.21.15.42:0/2952159206 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f21bc078b90 msgr2=0x7f21bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:44.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.607+0000 7f21e1400640 1 --2- 172.21.15.42:0/2952159206 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f21bc078b90 0x7f21bc07b0a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f21cc034000 tx=0x7f21cc004730 comp rx=0 tx=0).stop 2024-09-17T01:38:44.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.607+0000 7f21e1400640 1 -- 172.21.15.42:0/2952159206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21dc0af460 msgr2=0x7f21dc1f6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:44.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.607+0000 7f21e1400640 1 --2- 172.21.15.42:0/2952159206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21dc0af460 0x7f21dc1f6340 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f21c800c730 tx=0x7f21c800cbf0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.607+0000 7f21e1400640 1 -- 172.21.15.42:0/2952159206 shutdown_connections 2024-09-17T01:38:44.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.607+0000 7f21e1400640 1 --2- 172.21.15.42:0/2952159206 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f21bc078b90 0x7f21bc07b0a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.607+0000 7f21e1400640 1 --2- 172.21.15.42:0/2952159206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21dc0d0d80 0x7f21dc074ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.607+0000 7f21e1400640 1 --2- 172.21.15.42:0/2952159206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21dc0af460 0x7f21dc1f6340 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.607+0000 7f21e1400640 1 --2- 172.21.15.42:0/2952159206 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21dc06d260 0x7f21dc0b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:44.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.607+0000 7f21e1400640 1 -- 172.21.15.42:0/2952159206 >> 172.21.15.42:0/2952159206 conn(0x7f21dc0b25f0 msgr2=0x7f21dc15ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:44.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.607+0000 7f21e1400640 1 -- 172.21.15.42:0/2952159206 shutdown_connections 2024-09-17T01:38:44.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44.607+0000 7f21e1400640 1 -- 172.21.15.42:0/2952159206 wait complete. 2024-09-17T01:38:44.626 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T01:38:44.626 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:38:44.626 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-09-17T01:38:44.626 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T01:38:44.626 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:38:44.626 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T01:38:44.626 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T01:38:44.626 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:38:44.626 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:38:44.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:38:44.627 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-09-17T01:38:44.663 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:38:44.663 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:38:44.663 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:38:44.663 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:38:44.663 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-17T01:38:44.663 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:38:44.663 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:38:44.663 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-09-17T01:38:44.664 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-09-17T01:38:44.664 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:38:44.664 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-09-17T01:38:44.664 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-09-17T01:38:44.664 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:38:44.664 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:38:44.664 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-09-17T01:38:44.664 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-17T01:38:44.664 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42283sec preferred_lft 42283sec 2024-09-17T01:38:44.664 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-17T01:38:44.664 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:38:44.665 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:38:44.665 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:38:44.665 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-09-17T01:38:44.665 INFO:teuthology.orchestra.run.smithi042.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T01:38:44.665 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T01:38:44.665 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T01:38:44.665 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:38:44.665 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::68d2:2bff:fe2f:191a/64 scope link 2024-09-17T01:38:44.665 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:38:44.665 INFO:teuthology.orchestra.run.smithi042.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:38:44.665 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether e2:73:3e:9b:8a:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:38:44.665 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::e073:3eff:fe9b:8a00/64 scope link 2024-09-17T01:38:44.665 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:38:44.666 INFO:teuthology.orchestra.run.smithi042.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:38:44.666 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T01:38:44.666 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::240b:bfff:feb7:6e5b/64 scope link 2024-09-17T01:38:44.666 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:38:44.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:38:44.666 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:38:44.757 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-17T01:38:44.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:38:44.760 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-09-17T01:38:44.796 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-09-17T01:38:44.796 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:38:44.796 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-17T01:38:44.796 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-17T01:38:44.796 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:38:44.797 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:38:44.797 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:38:44.797 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T01:38:44.797 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T01:38:44.797 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T01:38:44.797 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:38:44.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:38:44.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:38:44.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:38:44.996 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-17T01:38:45.032 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T01:38:45.032 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T01:38:45.033 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:38:45.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:38:45.033 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-09-17T01:38:45.129 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:38:45.129 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T01:38:45.165 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:38:45.165 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:38:45.165 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:38:45.239 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T01:38:45.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:38:45.239 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:38:45.441 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:38:45.442 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:38:45.442 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:38:45.462 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:38:45.462 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:38:45.462 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:38:45.462 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:38:45.462 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:38:45.494 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:38:45.494 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:38:45.494 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:38:45.495 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:38:45.495 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:38:45.495 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-09-17T01:38:45.495 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-09-17T01:38:45.495 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fea1c88c-cb05-432f-a745-f9dcbb5f2503" will pass to kernel 2024-09-17T01:38:45.495 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T01:38:45.495 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-09-17T01:38:45.496 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T01:38:45.496 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T01:38:45.496 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T01:38:45.499 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T01:38:45.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:38:45.499 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:38:45.556 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:38:45.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:38:45.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:38:45.653 INFO:teuthology.orchestra.run.smithi042.stdout:client7357 2024-09-17T01:38:45.653 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:38:45.653 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:38:45.689 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-09-17T01:38:45.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.961+0000 7f78e1400640 1 -- 172.21.15.42:0/642766831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78dc0cdb20 msgr2=0x7f78dc0cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:45.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.961+0000 7f78e1400640 1 --2- 172.21.15.42:0/642766831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78dc0cdb20 0x7f78dc0cdf30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f78c4009830 tx=0x7f78c402a520 comp rx=0 tx=0).stop 2024-09-17T01:38:45.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.961+0000 7f78e1400640 1 -- 172.21.15.42:0/642766831 shutdown_connections 2024-09-17T01:38:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.961+0000 7f78e1400640 1 --2- 172.21.15.42:0/642766831 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f78dc06d430 0x7f78dc06d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.961+0000 7f78e1400640 1 --2- 172.21.15.42:0/642766831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78dc0cdb20 0x7f78dc0cdf30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.961+0000 7f78e1400640 1 -- 172.21.15.42:0/642766831 >> 172.21.15.42:0/642766831 conn(0x7f78dc0b28f0 msgr2=0x7f78dc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.961+0000 7f78e1400640 1 -- 172.21.15.42:0/642766831 shutdown_connections 2024-09-17T01:38:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.961+0000 7f78e1400640 1 -- 172.21.15.42:0/642766831 wait complete. 2024-09-17T01:38:45.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.963+0000 7f78e1400640 1 Processor -- start 2024-09-17T01:38:45.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.964+0000 7f78e1400640 1 -- start start 2024-09-17T01:38:45.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.965+0000 7f78e1400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78dc06d430 0x7f78dc132640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:45.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.965+0000 7f78e1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78dc0b56d0 0x7f78dc1f37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:45.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.965+0000 7f78e1400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f78dc0cdb20 0x7f78dc1f3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:45.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.965+0000 7f78e1400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f78dc15d560 con 0x7f78dc0b56d0 2024-09-17T01:38:45.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.965+0000 7f78e1400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f78dc15d3e0 con 0x7f78dc06d430 2024-09-17T01:38:45.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.965+0000 7f78e1400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f78dc15d6e0 con 0x7f78dc0cdb20 2024-09-17T01:38:45.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.965+0000 7f78d1e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78dc0b56d0 0x7f78dc1f37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:45.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.965+0000 7f78d1e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78dc0b56d0 0x7f78dc1f37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:60592/0 (socket says 172.21.15.42:60592) 2024-09-17T01:38:45.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.965+0000 7f78db200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f78dc0cdb20 0x7f78dc1f3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:45.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.965+0000 7f78d1e00640 1 -- 172.21.15.42:0/3604401301 learned_addr learned my addr 172.21.15.42:0/3604401301 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:38:45.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.965+0000 7f78da800640 1 --2- 172.21.15.42:0/3604401301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78dc06d430 0x7f78dc132640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:45.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.966+0000 7f78d1e00640 1 -- 172.21.15.42:0/3604401301 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f78dc0cdb20 msgr2=0x7f78dc1f3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:45.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.966+0000 7f78d1e00640 1 --2- 172.21.15.42:0/3604401301 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f78dc0cdb20 0x7f78dc1f3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:45.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.966+0000 7f78d1e00640 1 -- 172.21.15.42:0/3604401301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78dc06d430 msgr2=0x7f78dc132640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:45.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.966+0000 7f78d1e00640 1 --2- 172.21.15.42:0/3604401301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78dc06d430 0x7f78dc132640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:45.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.966+0000 7f78d1e00640 1 -- 172.21.15.42:0/3604401301 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78dc132f80 con 0x7f78dc0b56d0 2024-09-17T01:38:45.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.966+0000 7f78d1e00640 1 --2- 172.21.15.42:0/3604401301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78dc0b56d0 0x7f78dc1f37e0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f78c4009950 tx=0x7f78c4033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:45.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.967+0000 7f78d3400640 1 -- 172.21.15.42:0/3604401301 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c4031d60 con 0x7f78dc0b56d0 2024-09-17T01:38:45.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.967+0000 7f78e1400640 1 -- 172.21.15.42:0/3604401301 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78dc133260 con 0x7f78dc0b56d0 2024-09-17T01:38:45.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.967+0000 7f78d3400640 1 -- 172.21.15.42:0/3604401301 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78c4033e10 con 0x7f78dc0b56d0 2024-09-17T01:38:45.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.967+0000 7f78d3400640 1 -- 172.21.15.42:0/3604401301 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c4033310 con 0x7f78dc0b56d0 2024-09-17T01:38:45.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.967+0000 7f78e1400640 1 -- 172.21.15.42:0/3604401301 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78dc131c50 con 0x7f78dc0b56d0 2024-09-17T01:38:45.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.968+0000 7f78e1400640 1 -- 172.21.15.42:0/3604401301 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78dc0cf140 con 0x7f78dc0b56d0 2024-09-17T01:38:45.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.969+0000 7f78d3400640 1 -- 172.21.15.42:0/3604401301 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f78c40334b0 con 0x7f78dc0b56d0 2024-09-17T01:38:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.970+0000 7f78d3400640 1 --2- 172.21.15.42:0/3604401301 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f78b8078b90 0x7f78b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.970+0000 7f78d3400640 1 -- 172.21.15.42:0/3604401301 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5709+0+0 (secure 0 0 0) 0x7f78c40bbfc0 con 0x7f78dc0b56d0 2024-09-17T01:38:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.971+0000 7f78da800640 1 --2- 172.21.15.42:0/3604401301 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f78b8078b90 0x7f78b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:45.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.972+0000 7f78da800640 1 --2- 172.21.15.42:0/3604401301 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f78b8078b90 0x7f78b807b0a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f78cc001720 tx=0x7f78cc009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:45.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:45.975+0000 7f78d3400640 1 -- 172.21.15.42:0/3604401301 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f78dc0cf140 con 0x7f78dc0b56d0 2024-09-17T01:38:46.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:46.209+0000 7f78e1400640 1 -- 172.21.15.42:0/3604401301 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f78dc1f42f0 con 0x7f78dc0b56d0 2024-09-17T01:38:46.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:46.391+0000 7f78d3400640 1 -- 172.21.15.42:0/3604401301 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v89) ==== 167+0+0 (secure 0 0 0) 0x7f78c403f030 con 0x7f78dc0b56d0 2024-09-17T01:38:46.389 INFO:teuthology.orchestra.run.smithi042.stderr:enabled new snapshots 2024-09-17T01:38:46.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:46.393+0000 7f78e1400640 1 -- 172.21.15.42:0/3604401301 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f78b8078b90 msgr2=0x7f78b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:46.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:46.393+0000 7f78e1400640 1 --2- 172.21.15.42:0/3604401301 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f78b8078b90 0x7f78b807b0a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f78cc001720 tx=0x7f78cc009040 comp rx=0 tx=0).stop 2024-09-17T01:38:46.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:46.393+0000 7f78e1400640 1 -- 172.21.15.42:0/3604401301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78dc0b56d0 msgr2=0x7f78dc1f37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:46.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:46.393+0000 7f78e1400640 1 --2- 172.21.15.42:0/3604401301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78dc0b56d0 0x7f78dc1f37e0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f78c4009950 tx=0x7f78c4033c20 comp rx=0 tx=0).stop 2024-09-17T01:38:46.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:46.394+0000 7f78e1400640 1 -- 172.21.15.42:0/3604401301 shutdown_connections 2024-09-17T01:38:46.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:46.394+0000 7f78e1400640 1 --2- 172.21.15.42:0/3604401301 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f78b8078b90 0x7f78b807b0a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:46.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:46.394+0000 7f78e1400640 1 --2- 172.21.15.42:0/3604401301 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f78dc0cdb20 0x7f78dc1f3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:46.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:46.394+0000 7f78e1400640 1 --2- 172.21.15.42:0/3604401301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78dc0b56d0 0x7f78dc1f37e0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:46.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:46.394+0000 7f78e1400640 1 --2- 172.21.15.42:0/3604401301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78dc06d430 0x7f78dc132640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:46.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:46.394+0000 7f78e1400640 1 -- 172.21.15.42:0/3604401301 >> 172.21.15.42:0/3604401301 conn(0x7f78dc0b28f0 msgr2=0x7f78dc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:46.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:46.394+0000 7f78e1400640 1 -- 172.21.15.42:0/3604401301 shutdown_connections 2024-09-17T01:38:46.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:38:46.394+0000 7f78e1400640 1 -- 172.21.15.42:0/3604401301 wait complete. 2024-09-17T01:38:46.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:38:46.416 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-09-17T01:38:46.458 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:38:46.458 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:38:46.534 DEBUG:teuthology.orchestra.run.smithi042:> stdin-killer -- python3 -c ' 2024-09-17T01:38:46.535 DEBUG:teuthology.orchestra.run.smithi042:> import os 2024-09-17T01:38:46.535 DEBUG:teuthology.orchestra.run.smithi042:> import uuid 2024-09-17T01:38:46.535 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:38:46.535 DEBUG:teuthology.orchestra.run.smithi042:> n = 2000 2024-09-17T01:38:46.535 DEBUG:teuthology.orchestra.run.smithi042:> create_hard_links = False 2024-09-17T01:38:46.535 DEBUG:teuthology.orchestra.run.smithi042:> if 3 > 0: 2024-09-17T01:38:46.535 DEBUG:teuthology.orchestra.run.smithi042:> create_hard_links = True 2024-09-17T01:38:46.535 DEBUG:teuthology.orchestra.run.smithi042:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-09-17T01:38:46.535 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:38:46.535 DEBUG:teuthology.orchestra.run.smithi042:> dpath = os.path.dirname(path) 2024-09-17T01:38:46.535 DEBUG:teuthology.orchestra.run.smithi042:> fnameprefix = os.path.basename(path) 2024-09-17T01:38:46.535 DEBUG:teuthology.orchestra.run.smithi042:> os.makedirs(dpath, exist_ok=True) 2024-09-17T01:38:46.536 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:38:46.536 DEBUG:teuthology.orchestra.run.smithi042:> try: 2024-09-17T01:38:46.536 DEBUG:teuthology.orchestra.run.smithi042:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-17T01:38:46.536 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:38:46.536 DEBUG:teuthology.orchestra.run.smithi042:> for i in range(n): 2024-09-17T01:38:46.536 DEBUG:teuthology.orchestra.run.smithi042:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-17T01:38:46.536 DEBUG:teuthology.orchestra.run.smithi042:> with open(fpath, '"'"'w'"'"') as f: 2024-09-17T01:38:46.536 DEBUG:teuthology.orchestra.run.smithi042:> f.write(f"{i}") 2024-09-17T01:38:46.536 DEBUG:teuthology.orchestra.run.smithi042:> if False: 2024-09-17T01:38:46.536 DEBUG:teuthology.orchestra.run.smithi042:> f.flush() 2024-09-17T01:38:46.536 DEBUG:teuthology.orchestra.run.smithi042:> os.fsync(f.fileno()) 2024-09-17T01:38:46.536 DEBUG:teuthology.orchestra.run.smithi042:> if False: 2024-09-17T01:38:46.536 DEBUG:teuthology.orchestra.run.smithi042:> os.unlink(fpath) 2024-09-17T01:38:46.536 DEBUG:teuthology.orchestra.run.smithi042:> if False: 2024-09-17T01:38:46.536 DEBUG:teuthology.orchestra.run.smithi042:> os.fsync(dirfd) 2024-09-17T01:38:46.537 DEBUG:teuthology.orchestra.run.smithi042:> if create_hard_links: 2024-09-17T01:38:46.537 DEBUG:teuthology.orchestra.run.smithi042:> for j in range(3): 2024-09-17T01:38:46.537 DEBUG:teuthology.orchestra.run.smithi042:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-17T01:38:46.537 DEBUG:teuthology.orchestra.run.smithi042:> if False: 2024-09-17T01:38:46.537 DEBUG:teuthology.orchestra.run.smithi042:> os.fsync(dirfd) 2024-09-17T01:38:46.537 DEBUG:teuthology.orchestra.run.smithi042:> finally: 2024-09-17T01:38:46.537 DEBUG:teuthology.orchestra.run.smithi042:> os.close(dirfd) 2024-09-17T01:38:46.537 DEBUG:teuthology.orchestra.run.smithi042:> ' 2024-09-17T01:38:50.261 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:38:50.265 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:39:20.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:39:20.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:20.267 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-17T01:39:20.349 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:39:20.353 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:39:20.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:20.558 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-09-17T01:39:50.446 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:39:50.452 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:39:52.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:52.030 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-17T01:39:52.124 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 perf dump 2024-09-17T01:39:52.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.356+0000 7f55fda00640 1 -- 172.21.15.42:0/2183740726 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55dc004800 msgr2=0x7f55dc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:52.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.356+0000 7f55fda00640 1 --2- 172.21.15.42:0/2183740726 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55dc004800 0x7f55dc004c10 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f55f80ba1a0 tx=0x7f55dc005830 comp rx=0 tx=0).stop 2024-09-17T01:39:52.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.356+0000 7f55fda00640 1 -- 172.21.15.42:0/2183740726 shutdown_connections 2024-09-17T01:39:52.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.356+0000 7f55fda00640 1 --2- 172.21.15.42:0/2183740726 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55dc004800 0x7f55dc004c10 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.356+0000 7f55fda00640 1 -- 172.21.15.42:0/2183740726 >> 172.21.15.42:0/2183740726 conn(0x7f55f806cf00 msgr2=0x7f55f806d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:52.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.356+0000 7f55fda00640 1 -- 172.21.15.42:0/2183740726 shutdown_connections 2024-09-17T01:39:52.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.356+0000 7f55fda00640 1 -- 172.21.15.42:0/2183740726 wait complete. 2024-09-17T01:39:52.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.358+0000 7f55fda00640 1 Processor -- start 2024-09-17T01:39:52.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.359+0000 7f55fda00640 1 -- start start 2024-09-17T01:39:52.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.360+0000 7f55fda00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55dc004800 0x7f55f81619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.360+0000 7f55fda00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55f80cbff0 0x7f55f81ea400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.360+0000 7f55fda00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55f80c82e0 0x7f55f81ea940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.360+0000 7f55fda00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f55f8163280 con 0x7f55dc004800 2024-09-17T01:39:52.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.360+0000 7f55fda00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f55f8163100 con 0x7f55f80cbff0 2024-09-17T01:39:52.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.360+0000 7f55fda00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f55f808d7b0 con 0x7f55f80c82e0 2024-09-17T01:39:52.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.360+0000 7f55f7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55dc004800 0x7f55f81619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.360+0000 7f55f7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55dc004800 0x7f55f81619a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45742/0 (socket says 172.21.15.42:45742) 2024-09-17T01:39:52.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.360+0000 7f55f7e00640 1 -- 172.21.15.42:0/1128644268 learned_addr learned my addr 172.21.15.42:0/1128644268 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:39:52.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.361+0000 7f55fd000640 1 --2- 172.21.15.42:0/1128644268 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55f80c82e0 0x7f55f81ea940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.361+0000 7f55ef400640 1 --2- 172.21.15.42:0/1128644268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55f80cbff0 0x7f55f81ea400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.361+0000 7f55f7e00640 1 -- 172.21.15.42:0/1128644268 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55f80c82e0 msgr2=0x7f55f81ea940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:52.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.361+0000 7f55f7e00640 1 --2- 172.21.15.42:0/1128644268 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55f80c82e0 0x7f55f81ea940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.361+0000 7f55f7e00640 1 -- 172.21.15.42:0/1128644268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55f80cbff0 msgr2=0x7f55f81ea400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:52.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.361+0000 7f55f7e00640 1 --2- 172.21.15.42:0/1128644268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55f80cbff0 0x7f55f81ea400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.361+0000 7f55f7e00640 1 -- 172.21.15.42:0/1128644268 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f8156520 con 0x7f55dc004800 2024-09-17T01:39:52.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.361+0000 7f55ef400640 1 --2- 172.21.15.42:0/1128644268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55f80cbff0 0x7f55f81ea400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:39:52.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.361+0000 7f55f7e00640 1 --2- 172.21.15.42:0/1128644268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55dc004800 0x7f55f81619a0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f55e800e950 tx=0x7f55e800ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:52.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.361+0000 7f55f4c00640 1 -- 172.21.15.42:0/1128644268 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e8015070 con 0x7f55dc004800 2024-09-17T01:39:52.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.361+0000 7f55f4c00640 1 -- 172.21.15.42:0/1128644268 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55e800cd40 con 0x7f55dc004800 2024-09-17T01:39:52.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.361+0000 7f55f4c00640 1 -- 172.21.15.42:0/1128644268 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e80116a0 con 0x7f55dc004800 2024-09-17T01:39:52.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.361+0000 7f55fda00640 1 -- 172.21.15.42:0/1128644268 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f81567e0 con 0x7f55dc004800 2024-09-17T01:39:52.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.362+0000 7f55fda00640 1 -- 172.21.15.42:0/1128644268 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f80ce3b0 con 0x7f55dc004800 2024-09-17T01:39:52.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.364+0000 7f55f4c00640 1 -- 172.21.15.42:0/1128644268 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f55e8018070 con 0x7f55dc004800 2024-09-17T01:39:52.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.365+0000 7f55f4c00640 1 --2- 172.21.15.42:0/1128644268 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f55d4078bc0 0x7f55d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.365+0000 7f55f4c00640 1 -- 172.21.15.42:0/1128644268 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5825+0+0 (secure 0 0 0) 0x7f55e809b4d0 con 0x7f55dc004800 2024-09-17T01:39:52.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.365+0000 7f5606091740 1 Processor -- start 2024-09-17T01:39:52.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.366+0000 7f5606091740 1 -- start start 2024-09-17T01:39:52.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.366+0000 7f55ef400640 1 --2- 172.21.15.42:0/1128644268 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f55d4078bc0 0x7f55d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.366+0000 7f55ef400640 1 --2- 172.21.15.42:0/1128644268 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f55d4078bc0 0x7f55d407b0d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f55e0035000 tx=0x7f55e00046c0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:52.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.367+0000 7f5606091740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557842952390 0x557842d41860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.367+0000 7f5606091740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578429294d0 0x557842d24530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.367+0000 7f5606091740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578429316b0 0x557842d24a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.367+0000 7f5606091740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557842c0dc10 con 0x5578429316b0 2024-09-17T01:39:52.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.367+0000 7f5606091740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557842c6c9f0 con 0x557842952390 2024-09-17T01:39:52.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.367+0000 7f5606091740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x557842c5be20 con 0x5578429294d0 2024-09-17T01:39:52.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.367+0000 7f55fd000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578429316b0 0x557842d24a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.367+0000 7f55fd000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578429316b0 0x557842d24a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45746/0 (socket says 172.21.15.42:45746) 2024-09-17T01:39:52.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.367+0000 7f55fd000640 1 -- 172.21.15.42:0/96618811 learned_addr learned my addr 172.21.15.42:0/96618811 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:39:52.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.367+0000 7f55f7e00640 1 --2- 172.21.15.42:0/96618811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557842952390 0x557842d41860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.367+0000 7f55ef400640 1 --2- 172.21.15.42:0/96618811 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578429294d0 0x557842d24530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.368+0000 7f55fd000640 1 -- 172.21.15.42:0/96618811 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578429294d0 msgr2=0x557842d24530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:39:52.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.368+0000 7f55fd000640 1 --2- 172.21.15.42:0/96618811 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578429294d0 0x557842d24530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.368+0000 7f55fd000640 1 -- 172.21.15.42:0/96618811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557842952390 msgr2=0x557842d41860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:39:52.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.368+0000 7f55fd000640 1 --2- 172.21.15.42:0/96618811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557842952390 0x557842d41860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.368+0000 7f55fd000640 1 -- 172.21.15.42:0/96618811 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557842a347d0 con 0x5578429316b0 2024-09-17T01:39:52.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.368+0000 7f55fd000640 1 --2- 172.21.15.42:0/96618811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578429316b0 0x557842d24a70 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0057e0 tx=0x7f55f00049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da91f8d5608a9ee7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:52.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.368+0000 7f55ecc00640 1 -- 172.21.15.42:0/96618811 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f0001560 con 0x5578429316b0 2024-09-17T01:39:52.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.368+0000 7f55ecc00640 1 -- 172.21.15.42:0/96618811 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55f0019070 con 0x5578429316b0 2024-09-17T01:39:52.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.368+0000 7f55ecc00640 1 -- 172.21.15.42:0/96618811 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f00019f0 con 0x5578429316b0 2024-09-17T01:39:52.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.369+0000 7f5606091740 1 -- 172.21.15.42:0/96618811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578429316b0 msgr2=0x557842d24a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:52.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.369+0000 7f5606091740 1 --2- 172.21.15.42:0/96618811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578429316b0 0x557842d24a70 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0057e0 tx=0x7f55f00049d0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.369+0000 7f5606091740 1 -- 172.21.15.42:0/96618811 shutdown_connections 2024-09-17T01:39:52.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.369+0000 7f5606091740 1 --2- 172.21.15.42:0/96618811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578429316b0 0x557842d24a70 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.369+0000 7f5606091740 1 --2- 172.21.15.42:0/96618811 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578429294d0 0x557842d24530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.369+0000 7f5606091740 1 --2- 172.21.15.42:0/96618811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557842952390 0x557842d41860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.369+0000 7f5606091740 1 -- 172.21.15.42:0/96618811 >> 172.21.15.42:0/96618811 conn(0x5578429464e0 msgr2=0x557842cfa750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:52.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.369+0000 7f5606091740 1 -- 172.21.15.42:0/96618811 shutdown_connections 2024-09-17T01:39:52.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.369+0000 7f5606091740 1 -- 172.21.15.42:0/96618811 wait complete. 2024-09-17T01:39:52.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.371+0000 7f5606091740 1 -- start start 2024-09-17T01:39:52.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.371+0000 7f5606091740 1 Processor -- start 2024-09-17T01:39:52.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.373+0000 7f5606091740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578429294d0 0x557842d4e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.373+0000 7f5606091740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578429316b0 0x557842d13080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.373+0000 7f5606091740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557842952390 0x557842d3ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.373+0000 7f5606091740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557842c01790 con 0x557842952390 2024-09-17T01:39:52.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.373+0000 7f5606091740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557842c5fc30 con 0x5578429316b0 2024-09-17T01:39:52.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.373+0000 7f5606091740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5578429cc740 con 0x5578429294d0 2024-09-17T01:39:52.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.373+0000 7f5606091740 10 client.0 _ll_register_callbacks cb 0x557842c11260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:39:52.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.373+0000 7f55fd000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557842952390 0x557842d3ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.373+0000 7f55f7e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578429294d0 0x557842d4e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.373+0000 7f55fd000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557842952390 0x557842d3ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45748/0 (socket says 172.21.15.42:45748) 2024-09-17T01:39:52.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.373+0000 7f55fd000640 1 -- 172.21.15.42:0/557707515 learned_addr learned my addr 172.21.15.42:0/557707515 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:39:52.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.373+0000 7f55ef400640 1 --2- 172.21.15.42:0/557707515 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578429316b0 0x557842d13080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.374+0000 7f55fd000640 1 -- 172.21.15.42:0/557707515 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578429294d0 msgr2=0x557842d4e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:39:52.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.374+0000 7f55fd000640 1 --2- 172.21.15.42:0/557707515 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578429294d0 0x557842d4e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.374+0000 7f55fd000640 1 -- 172.21.15.42:0/557707515 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578429316b0 msgr2=0x557842d13080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:39:52.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.374+0000 7f55fd000640 1 --2- 172.21.15.42:0/557707515 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578429316b0 0x557842d13080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.374+0000 7f55fd000640 1 -- 172.21.15.42:0/557707515 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55784299b6a0 con 0x557842952390 2024-09-17T01:39:52.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.374+0000 7f55fd000640 1 --2- 172.21.15.42:0/557707515 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557842952390 0x557842d3ce10 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f55f0015000 tx=0x7f55f0001610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d56a44af91e114a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:52.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.374+0000 7f55e5600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:39:52.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.374+0000 7f55e5600640 1 -- 172.21.15.42:0/557707515 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f0001c00 con 0x557842952390 2024-09-17T01:39:52.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.375+0000 7f5606091740 1 -- 172.21.15.42:0/557707515 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55f0019070 con 0x557842952390 2024-09-17T01:39:52.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.375+0000 7f55e5600640 1 -- 172.21.15.42:0/557707515 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 5825+0+0 (secure 0 0 0) 0x7f55f0012440 con 0x557842952390 2024-09-17T01:39:52.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.375+0000 7f55e5600640 1 -- 172.21.15.42:0/557707515 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f55f002f050 con 0x557842952390 2024-09-17T01:39:52.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.375+0000 7f5606091740 10 client.7818 fetch_fsmap learned FSMap version 89 2024-09-17T01:39:52.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.375+0000 7f5606091740 1 -- 172.21.15.42:0/557707515 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x557842a94f60 con 0x557842952390 2024-09-17T01:39:52.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.375+0000 7f55e5600640 1 -- 172.21.15.42:0/557707515 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55f0019070 con 0x557842952390 2024-09-17T01:39:52.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.375+0000 7f55e5600640 1 -- 172.21.15.42:0/557707515 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 89) ==== 3502+0+0 (secure 0 0 0) 0x7f55f0032020 con 0x557842952390 2024-09-17T01:39:52.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.375+0000 7f5606091740 10 client.7818 fetch_fsmap finished waiting for FSMap version 89 2024-09-17T01:39:52.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.375+0000 7f5606091740 10 client.7818 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T01:39:52.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.375+0000 7f5606091740 20 client.7818 populate_metadata read hostname 'smithi042' 2024-09-17T01:39:52.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.375+0000 7f5606091740 1 --2- 172.21.15.42:0/557707515 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x557842910f60 0x557842d3bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.375+0000 7f5606091740 4 client.7818 mds_command: new command op to 7644 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:39:52.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.375+0000 7f5606091740 1 -- 172.21.15.42:0/557707515 --> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557842c6e940 con 0x557842910f60 2024-09-17T01:39:52.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.376+0000 7f55f7e00640 1 --2- 172.21.15.42:0/557707515 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x557842910f60 0x557842d3bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.376+0000 7f55f7e00640 1 --2- 172.21.15.42:0/557707515 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x557842910f60 0x557842d3bfa0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=925d3c4884cee822 server_cookie=bbd961e309f0427e in_seq=0 out_seq=0 2024-09-17T01:39:52.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.376+0000 7f55e5600640 10 client.7818 ms_handle_connect on v2:172.21.15.42:6832/1078007521 2024-09-17T01:39:52.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.377+0000 7f55e5600640 1 -- 172.21.15.42:0/557707515 <== mds.0 v2:172.21.15.42:6832/1078007521 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557842c6e940 con 0x557842910f60 2024-09-17T01:39:52.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.377+0000 7f55e5600640 10 client.7818 handle_command_reply: tid=0 2024-09-17T01:39:52.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.377+0000 7f5606091740 1 client.7818 shutdown 2024-09-17T01:39:52.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.377+0000 7f5606091740 1 -- 172.21.15.42:0/557707515 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557842952390 msgr2=0x557842d3ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:52.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.377+0000 7f5606091740 1 --2- 172.21.15.42:0/557707515 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557842952390 0x557842d3ce10 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f55f0015000 tx=0x7f55f0001610 comp rx=0 tx=0).stop 2024-09-17T01:39:52.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.377+0000 7f5606091740 1 -- 172.21.15.42:0/557707515 shutdown_connections 2024-09-17T01:39:52.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.377+0000 7f5606091740 1 --2- 172.21.15.42:0/557707515 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x557842910f60 0x557842d3bfa0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.377+0000 7f5606091740 1 --2- 172.21.15.42:0/557707515 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578429316b0 0x557842d13080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.377+0000 7f5606091740 1 --2- 172.21.15.42:0/557707515 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557842952390 0x557842d3ce10 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.377+0000 7f5606091740 1 --2- 172.21.15.42:0/557707515 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578429294d0 0x557842d4e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.377+0000 7f55e5600640 0 client.7818 ms_handle_reset on v2:172.21.15.42:6832/1078007521 2024-09-17T01:39:52.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.377+0000 7f5606091740 1 -- 172.21.15.42:0/557707515 >> 172.21.15.42:0/557707515 conn(0x5578429464e0 msgr2=0x557842d21420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:52.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.377+0000 7f5606091740 1 -- 172.21.15.42:0/557707515 shutdown_connections 2024-09-17T01:39:52.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.377+0000 7f5606091740 1 -- 172.21.15.42:0/557707515 wait complete. 2024-09-17T01:39:52.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.378+0000 7f5606091740 20 client.7818 trim_cache size 0 max 16384 2024-09-17T01:39:52.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.395+0000 7f5606091740 1 Processor -- start 2024-09-17T01:39:52.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.395+0000 7f5606091740 1 -- start start 2024-09-17T01:39:52.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.396+0000 7f5606091740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578429294d0 0x557842d40fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.396+0000 7f5606091740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578429316b0 0x557842d41510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.396+0000 7f5606091740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557842952390 0x557842d3da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.396+0000 7f5606091740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f55f8202040 con 0x557842952390 2024-09-17T01:39:52.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.396+0000 7f5606091740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f55f80caa20 con 0x5578429294d0 2024-09-17T01:39:52.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.396+0000 7f5606091740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f55f80c9d80 con 0x5578429316b0 2024-09-17T01:39:52.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.397+0000 7f55fd000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557842952390 0x557842d3da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.397+0000 7f55fd000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557842952390 0x557842d3da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45750/0 (socket says 172.21.15.42:45750) 2024-09-17T01:39:52.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.397+0000 7f55fd000640 1 -- 172.21.15.42:0/4262801114 learned_addr learned my addr 172.21.15.42:0/4262801114 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:39:52.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.397+0000 7f55f7e00640 1 --2- 172.21.15.42:0/4262801114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578429294d0 0x557842d40fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.397+0000 7f55ef400640 1 --2- 172.21.15.42:0/4262801114 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578429316b0 0x557842d41510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.397+0000 7f55fd000640 1 -- 172.21.15.42:0/4262801114 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578429316b0 msgr2=0x557842d41510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:39:52.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.397+0000 7f55fd000640 1 --2- 172.21.15.42:0/4262801114 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578429316b0 0x557842d41510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.397+0000 7f55fd000640 1 -- 172.21.15.42:0/4262801114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578429294d0 msgr2=0x557842d40fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:39:52.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.397+0000 7f55fd000640 1 --2- 172.21.15.42:0/4262801114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578429294d0 0x557842d40fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.397+0000 7f55fd000640 1 -- 172.21.15.42:0/4262801114 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557842a32ad0 con 0x557842952390 2024-09-17T01:39:52.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.397+0000 7f55ef400640 1 --2- 172.21.15.42:0/4262801114 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578429316b0 0x557842d41510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:39:52.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.397+0000 7f55fd000640 1 --2- 172.21.15.42:0/4262801114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557842952390 0x557842d3da90 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f55f0006850 tx=0x7f55f00049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827d0ec936b9727e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:52.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.397+0000 7f55e7e00640 1 -- 172.21.15.42:0/4262801114 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f0038070 con 0x557842952390 2024-09-17T01:39:52.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.398+0000 7f55e7e00640 1 -- 172.21.15.42:0/4262801114 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55f0019040 con 0x557842952390 2024-09-17T01:39:52.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.398+0000 7f55e7e00640 1 -- 172.21.15.42:0/4262801114 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f0012ab0 con 0x557842952390 2024-09-17T01:39:52.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.398+0000 7f5606091740 1 -- 172.21.15.42:0/4262801114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557842952390 msgr2=0x557842d3da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:52.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.398+0000 7f5606091740 1 --2- 172.21.15.42:0/4262801114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557842952390 0x557842d3da90 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f55f0006850 tx=0x7f55f00049d0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.398+0000 7f5606091740 1 -- 172.21.15.42:0/4262801114 shutdown_connections 2024-09-17T01:39:52.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.398+0000 7f5606091740 1 --2- 172.21.15.42:0/4262801114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557842952390 0x557842d3da90 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.398+0000 7f5606091740 1 --2- 172.21.15.42:0/4262801114 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578429316b0 0x557842d41510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.398+0000 7f5606091740 1 --2- 172.21.15.42:0/4262801114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578429294d0 0x557842d40fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.398+0000 7f5606091740 1 -- 172.21.15.42:0/4262801114 >> 172.21.15.42:0/4262801114 conn(0x5578429464e0 msgr2=0x557842d3b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:52.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.398+0000 7f5606091740 1 -- 172.21.15.42:0/4262801114 shutdown_connections 2024-09-17T01:39:52.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.398+0000 7f5606091740 1 -- 172.21.15.42:0/4262801114 wait complete. 2024-09-17T01:39:52.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.399+0000 7f5606091740 1 -- start start 2024-09-17T01:39:52.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.400+0000 7f5606091740 1 Processor -- start 2024-09-17T01:39:52.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.401+0000 7f5606091740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578429294d0 0x557842dbe3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.401+0000 7f5606091740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578429316b0 0x557842d3c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.401+0000 7f5606091740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557842952390 0x557842d40fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.401+0000 7f5606091740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f55f80ca3d0 con 0x5578429294d0 2024-09-17T01:39:52.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.401+0000 7f5606091740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557842d217a0 con 0x5578429316b0 2024-09-17T01:39:52.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.401+0000 7f5606091740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x557842d3c900 con 0x557842952390 2024-09-17T01:39:52.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.401+0000 7f5606091740 10 client.0 _ll_register_callbacks cb 0x7f55e806af50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:39:52.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.401+0000 7f55f7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578429294d0 0x557842dbe3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.401+0000 7f55f7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578429294d0 0x557842dbe3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45764/0 (socket says 172.21.15.42:45764) 2024-09-17T01:39:52.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.401+0000 7f55f7e00640 1 -- 172.21.15.42:0/4097569132 learned_addr learned my addr 172.21.15.42:0/4097569132 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:39:52.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.402+0000 7f55fd000640 1 --2- 172.21.15.42:0/4097569132 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557842952390 0x557842d40fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.402+0000 7f55ef400640 1 --2- 172.21.15.42:0/4097569132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578429316b0 0x557842d3c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.402+0000 7f55f7e00640 1 -- 172.21.15.42:0/4097569132 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557842952390 msgr2=0x557842d40fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:39:52.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.402+0000 7f55f7e00640 1 --2- 172.21.15.42:0/4097569132 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557842952390 0x557842d40fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.402+0000 7f55f7e00640 1 -- 172.21.15.42:0/4097569132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578429316b0 msgr2=0x557842d3c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:39:52.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.402+0000 7f55f7e00640 1 --2- 172.21.15.42:0/4097569132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578429316b0 0x557842d3c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.402+0000 7f55f7e00640 1 -- 172.21.15.42:0/4097569132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557842d61b60 con 0x5578429294d0 2024-09-17T01:39:52.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.402+0000 7f55ef400640 1 --2- 172.21.15.42:0/4097569132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578429316b0 0x557842d3c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:39:52.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.402+0000 7f55f7e00640 1 --2- 172.21.15.42:0/4097569132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578429294d0 0x557842dbe3c0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f55e8099850 tx=0x7f55e806a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9409736ea0cf4cd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:52.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.402+0000 7f55e5600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:39:52.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.402+0000 7f55e5600640 1 -- 172.21.15.42:0/4097569132 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e801f040 con 0x5578429294d0 2024-09-17T01:39:52.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.402+0000 7f55e5600640 1 -- 172.21.15.42:0/4097569132 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 5825+0+0 (secure 0 0 0) 0x7f55e805f3f0 con 0x5578429294d0 2024-09-17T01:39:52.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.402+0000 7f5606091740 1 -- 172.21.15.42:0/4097569132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55f0019040 con 0x5578429294d0 2024-09-17T01:39:52.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.402+0000 7f55e5600640 1 -- 172.21.15.42:0/4097569132 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f55e8067c60 con 0x5578429294d0 2024-09-17T01:39:52.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.402+0000 7f5606091740 10 client.7824 fetch_fsmap learned FSMap version 89 2024-09-17T01:39:52.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.402+0000 7f5606091740 1 -- 172.21.15.42:0/4097569132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x557842d394f0 con 0x5578429294d0 2024-09-17T01:39:52.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.403+0000 7f55e5600640 1 -- 172.21.15.42:0/4097569132 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55f0019040 con 0x5578429294d0 2024-09-17T01:39:52.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.403+0000 7f55e5600640 1 -- 172.21.15.42:0/4097569132 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 89) ==== 3502+0+0 (secure 0 0 0) 0x7f55e809b0b0 con 0x5578429294d0 2024-09-17T01:39:52.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.403+0000 7f5606091740 10 client.7824 fetch_fsmap finished waiting for FSMap version 89 2024-09-17T01:39:52.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.403+0000 7f5606091740 10 client.7824 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T01:39:52.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.403+0000 7f5606091740 20 client.7824 populate_metadata read hostname 'smithi042' 2024-09-17T01:39:52.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.403+0000 7f5606091740 1 --2- 172.21.15.42:0/4097569132 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x557842d41510 0x557842dc1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.403+0000 7f5606091740 4 client.7824 mds_command: new command op to 7644 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-17T01:39:52.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.403+0000 7f5606091740 1 -- 172.21.15.42:0/4097569132 --> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] -- command(tid 0: {"prefix": "perf dump"}) -- 0x557842cf4e60 con 0x557842d41510 2024-09-17T01:39:52.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.403+0000 7f55ef400640 1 --2- 172.21.15.42:0/4097569132 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x557842d41510 0x557842dc1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.404+0000 7f55e5600640 10 client.7824 ms_handle_connect on v2:172.21.15.42:6832/1078007521 2024-09-17T01:39:52.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.404+0000 7f55ef400640 1 --2- 172.21.15.42:0/4097569132 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x557842d41510 0x557842dc1d50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b96fca93cf12a0b server_cookie=c6ab4ad214d072fa in_seq=0 out_seq=0 2024-09-17T01:39:52.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.404+0000 7f55e5600640 1 -- 172.21.15.42:0/4097569132 <== mds.0 v2:172.21.15.42:6832/1078007521 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18090 (crc 0 0 0) 0x557842cf4e60 con 0x557842d41510 2024-09-17T01:39:52.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.404+0000 7f55e5600640 10 client.7824 handle_command_reply: tid=0 2024-09-17T01:39:52.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.404+0000 7f5606091740 1 client.7824 shutdown 2024-09-17T01:39:52.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.404+0000 7f5606091740 1 -- 172.21.15.42:0/4097569132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578429294d0 msgr2=0x557842dbe3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:52.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.404+0000 7f5606091740 1 --2- 172.21.15.42:0/4097569132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578429294d0 0x557842dbe3c0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f55e8099850 tx=0x7f55e806a040 comp rx=0 tx=0).stop 2024-09-17T01:39:52.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.405+0000 7f5606091740 1 -- 172.21.15.42:0/4097569132 shutdown_connections 2024-09-17T01:39:52.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.405+0000 7f5606091740 1 --2- 172.21.15.42:0/4097569132 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x557842d41510 0x557842dc1d50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.405+0000 7f5606091740 1 --2- 172.21.15.42:0/4097569132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578429316b0 0x557842d3c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.405+0000 7f5606091740 1 --2- 172.21.15.42:0/4097569132 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557842952390 0x557842d40fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.405+0000 7f5606091740 1 --2- 172.21.15.42:0/4097569132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578429294d0 0x557842dbe3c0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.405+0000 7f55e5600640 0 client.7824 ms_handle_reset on v2:172.21.15.42:6832/1078007521 2024-09-17T01:39:52.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.405+0000 7f5606091740 1 -- 172.21.15.42:0/4097569132 >> 172.21.15.42:0/4097569132 conn(0x5578429464e0 msgr2=0x557842d62920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:52.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.405+0000 7f5606091740 1 -- 172.21.15.42:0/4097569132 shutdown_connections 2024-09-17T01:39:52.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.405+0000 7f5606091740 1 -- 172.21.15.42:0/4097569132 wait complete. 2024-09-17T01:39:52.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.405+0000 7f5606091740 20 client.7824 trim_cache size 0 max 16384 2024-09-17T01:39:52.409 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:39:52.409 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-0": { 2024-09-17T01:39:52.409 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 27781, 2024-09-17T01:39:52.409 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 49978, 2024-09-17T01:39:52.409 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 9640483, 2024-09-17T01:39:52.409 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 47364064, 2024-09-17T01:39:52.409 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 11, 2024-09-17T01:39:52.409 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 3, 2024-09-17T01:39:52.409 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 4.679480020, 2024-09-17T01:39:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 3.390219918, 2024-09-17T01:39:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 2.103676784, 2024-09-17T01:39:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.254421191, 2024-09-17T01:39:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T01:39:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 49977, 2024-09-17T01:39:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 1.786518390, 2024-09-17T01:39:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000035746 2024-09-17T01:39:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-17T01:39:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 46968, 2024-09-17T01:39:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.011359007, 2024-09-17T01:39:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000241 2024-09-17T01:39:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-09-17T01:39:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 448 2024-09-17T01:39:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-1": { 2024-09-17T01:39:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 1453, 2024-09-17T01:39:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 1471, 2024-09-17T01:39:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 549082, 2024-09-17T01:39:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 33119970, 2024-09-17T01:39:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 6, 2024-09-17T01:39:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 4, 2024-09-17T01:39:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.479917513, 2024-09-17T01:39:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.165122009, 2024-09-17T01:39:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.038908615, 2024-09-17T01:39:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.262798460, 2024-09-17T01:39:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T01:39:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1469, 2024-09-17T01:39:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.347966551, 2024-09-17T01:39:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000236873 2024-09-17T01:39:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-17T01:39:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:39:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:39:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:39:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-17T01:39:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 117872 2024-09-17T01:39:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-2": { 2024-09-17T01:39:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 2291, 2024-09-17T01:39:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 2286, 2024-09-17T01:39:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 686673, 2024-09-17T01:39:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 31036167, 2024-09-17T01:39:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 5, 2024-09-17T01:39:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 4, 2024-09-17T01:39:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.342798659, 2024-09-17T01:39:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.190076193, 2024-09-17T01:39:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.073000026, 2024-09-17T01:39:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.073871279, 2024-09-17T01:39:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T01:39:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2286, 2024-09-17T01:39:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.553937285, 2024-09-17T01:39:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000242317 2024-09-17T01:39:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-17T01:39:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:39:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:39:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:39:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 130928, 2024-09-17T01:39:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 21680 2024-09-17T01:39:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: "cct": { 2024-09-17T01:39:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: "total_workers": 1, 2024-09-17T01:39:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: "unhealthy_workers": 0 2024-09-17T01:39:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-MDSRank": { 2024-09-17T01:39:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2024-09-17T01:39:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2024-09-17T01:39:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1398, 2024-09-17T01:39:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 17.674405171, 2024-09-17T01:39:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.012642636 2024-09-17T01:39:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:39:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-PurgeQueue": { 2024-09-17T01:39:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2024-09-17T01:39:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2024-09-17T01:39:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1713, 2024-09-17T01:39:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 1.225140707, 2024-09-17T01:39:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000715201 2024-09-17T01:39:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:39:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": { 2024-09-17T01:39:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: "request": 25584, 2024-09-17T01:39:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: "reply": 25584, 2024-09-17T01:39:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: "reply_latency": { 2024-09-17T01:39:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 25584, 2024-09-17T01:39:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 381.369942511, 2024-09-17T01:39:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.014906579 2024-09-17T01:39:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: "slow_reply": 0, 2024-09-17T01:39:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: "forward": 0, 2024-09-17T01:39:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch_complete": 0, 2024-09-17T01:39:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch_keys": 0, 2024-09-17T01:39:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_commit": 12, 2024-09-17T01:39:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_split": 0, 2024-09-17T01:39:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_merge": 0, 2024-09-17T01:39:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes": 19886, 2024-09-17T01:39:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_top": 0, 2024-09-17T01:39:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_bottom": 19886, 2024-09-17T01:39:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pin_tail": 0, 2024-09-17T01:39:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pinned": 19885, 2024-09-17T01:39:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_expired": 0, 2024-09-17T01:39:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_with_caps": 2, 2024-09-17T01:39:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": 2, 2024-09-17T01:39:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: "subtrees": 2, 2024-09-17T01:39:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse": 46497, 2024-09-17T01:39:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_hit": 45928, 2024-09-17T01:39:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_forward": 0, 2024-09-17T01:39:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_discover": 0, 2024-09-17T01:39:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_dir_fetch": 0, 2024-09-17T01:39:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_remote_ino": 0, 2024-09-17T01:39:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_lock": 110, 2024-09-17T01:39:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: "load_cent": 0, 2024-09-17T01:39:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: "q": 0, 2024-09-17T01:39:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: "exported": 0, 2024-09-17T01:39:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: "exported_inodes": 0, 2024-09-17T01:39:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: "imported": 0, 2024-09-17T01:39:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: "imported_inodes": 0, 2024-09-17T01:39:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_dir_fetch": 0, 2024-09-17T01:39:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_backtrace_fetch": 0, 2024-09-17T01:39:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_peer_discover": 0, 2024-09-17T01:39:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rfiles": 0, 2024-09-17T01:39:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rbytes": 0, 2024-09-17T01:39:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rsnaps": 0, 2024-09-17T01:39:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_backtrace_fetch": 0, 2024-09-17T01:39:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_set_tag": 0, 2024-09-17T01:39:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_backtrace_repaired": 0, 2024-09-17T01:39:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_inotable_repaired": 0, 2024-09-17T01:39:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dir_inodes": 0, 2024-09-17T01:39:52.420 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dir_base_inodes": 0, 2024-09-17T01:39:52.420 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dirfrag_rstats": 0, 2024-09-17T01:39:52.420 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_file_inodes": 0, 2024-09-17T01:39:52.420 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_inode_file_caps": 0, 2024-09-17T01:39:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_revoke": 1153, 2024-09-17T01:39:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_grant": 4043, 2024-09-17T01:39:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_trunc": 0, 2024-09-17T01:39:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-17T01:39:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-17T01:39:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_caps": 3312, 2024-09-17T01:39:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_caps_dirty": 2424, 2024-09-17T01:39:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_cap_release": 49, 2024-09-17T01:39:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: "process_request_cap_release": 14074 2024-09-17T01:39:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache": { 2024-09-17T01:39:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_update": 0, 2024-09-17T01:39:52.422 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_update_receipt": 0, 2024-09-17T01:39:52.422 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_try_discover": 0, 2024-09-17T01:39:52.422 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_send_discover": 0, 2024-09-17T01:39:52.422 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_handle_discover": 0, 2024-09-17T01:39:52.422 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays": 2000, 2024-09-17T01:39:52.422 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_delayed": 280, 2024-09-17T01:39:52.422 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_enqueuing": 0, 2024-09-17T01:39:52.422 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_created": 4147, 2024-09-17T01:39:52.422 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_enqueued": 1720, 2024-09-17T01:39:52.422 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_reintegrated": 2205, 2024-09-17T01:39:52.423 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_migrated": 0, 2024-09-17T01:39:52.423 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_processing": 0, 2024-09-17T01:39:52.423 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_enqueued": 0, 2024-09-17T01:39:52.423 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_prioritized": 0, 2024-09-17T01:39:52.423 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_started": 0, 2024-09-17T01:39:52.423 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_completed": 0, 2024-09-17T01:39:52.423 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_quiesce_path": 0, 2024-09-17T01:39:52.423 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_quiesce_inode": 0, 2024-09-17T01:39:52.423 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_enqueue_scrub": 0, 2024-09-17T01:39:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_exportdir": 0, 2024-09-17T01:39:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_flush": 0, 2024-09-17T01:39:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragmentdir": 0, 2024-09-17T01:39:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragstats": 0, 2024-09-17T01:39:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_inodestats": 0, 2024-09-17T01:39:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:39:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_succeeded": 0, 2024-09-17T01:39:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_write_failed": 0 2024-09-17T01:39:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log": { 2024-09-17T01:39:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: "evlrg": 0, 2024-09-17T01:39:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: "evadd": 24784, 2024-09-17T01:39:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: "evex": 0, 2024-09-17T01:39:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: "evtrm": 0, 2024-09-17T01:39:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: "ev": 24784, 2024-09-17T01:39:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: "evexg": 0, 2024-09-17T01:39:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: "evexd": 0, 2024-09-17T01:39:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: "segadd": 36, 2024-09-17T01:39:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: "segex": 0, 2024-09-17T01:39:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: "segtrm": 0, 2024-09-17T01:39:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: "seg": 36, 2024-09-17T01:39:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: "segmjr": 4, 2024-09-17T01:39:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: "segexg": 0, 2024-09-17T01:39:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: "segexd": 0, 2024-09-17T01:39:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: "expos": 4194304, 2024-09-17T01:39:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: "wrpos": 94910286, 2024-09-17T01:39:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: "rdpos": 0, 2024-09-17T01:39:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: "jlat": { 2024-09-17T01:39:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2652, 2024-09-17T01:39:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 110.216466599, 2024-09-17T01:39:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.041559753 2024-09-17T01:39:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: "replayed": 0 2024-09-17T01:39:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_mem": { 2024-09-17T01:39:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 2014, 2024-09-17T01:39:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: "ino+": 2014, 2024-09-17T01:39:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: "ino-": 0, 2024-09-17T01:39:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: "dir": 13, 2024-09-17T01:39:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: "dir+": 13, 2024-09-17T01:39:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: "dir-": 0, 2024-09-17T01:39:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: "dn": 19886, 2024-09-17T01:39:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: "dn+": 19887, 2024-09-17T01:39:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: "dn-": 1, 2024-09-17T01:39:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: "cap": 2, 2024-09-17T01:39:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: "cap+": 7031, 2024-09-17T01:39:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: "cap-": 7029, 2024-09-17T01:39:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: "rss": 177824, 2024-09-17T01:39:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: "heap": 407851008 2024-09-17T01:39:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_server": { 2024-09-17T01:39:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_client_request": 28535, 2024-09-17T01:39:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_server_request": 0, 2024-09-17T01:39:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_request": 25584, 2024-09-17T01:39:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_session": 5, 2024-09-17T01:39:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_peer_request": 0, 2024-09-17T01:39:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: "req_create_latency": { 2024-09-17T01:39:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2000, 2024-09-17T01:39:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 1.955997421, 2024-09-17T01:39:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000977998 2024-09-17T01:39:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getattr_latency": { 2024-09-17T01:39:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 30, 2024-09-17T01:39:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.005245051, 2024-09-17T01:39:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000174835 2024-09-17T01:39:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getfilelock_latency": { 2024-09-17T01:39:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:39:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:39:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:39:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: "req_link_latency": { 2024-09-17T01:39:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 6000, 2024-09-17T01:39:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 8.218123807, 2024-09-17T01:39:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.001369687 2024-09-17T01:39:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookup_latency": { 2024-09-17T01:39:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 7335, 2024-09-17T01:39:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 5.919161002, 2024-09-17T01:39:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000806974 2024-09-17T01:39:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookuphash_latency": { 2024-09-17T01:39:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:39:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:39:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:39:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupino_latency": { 2024-09-17T01:39:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:39:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:39:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:39:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupname_latency": { 2024-09-17T01:39:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:39:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:39:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:39:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupparent_latency": { 2024-09-17T01:39:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:39:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:39:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:39:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupsnap_latency": { 2024-09-17T01:39:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-17T01:39:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000050099, 2024-09-17T01:39:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000050099 2024-09-17T01:39:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lssnap_latency": { 2024-09-17T01:39:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:39:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:39:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:39:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mkdir_latency": { 2024-09-17T01:39:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-17T01:39:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.003399381, 2024-09-17T01:39:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.003399381 2024-09-17T01:39:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mknod_latency": { 2024-09-17T01:39:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:39:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:39:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:39:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mksnap_latency": { 2024-09-17T01:39:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-17T01:39:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.218478474, 2024-09-17T01:39:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.218478474 2024-09-17T01:39:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: "req_open_latency": { 2024-09-17T01:39:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-17T01:39:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000110167, 2024-09-17T01:39:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000110167 2024-09-17T01:39:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: "req_readdir_latency": { 2024-09-17T01:39:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 8, 2024-09-17T01:39:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.456993125, 2024-09-17T01:39:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.057124140 2024-09-17T01:39:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rename_latency": { 2024-09-17T01:39:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2205, 2024-09-17T01:39:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 343.767319216, 2024-09-17T01:39:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.155903546 2024-09-17T01:39:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: "req_renamesnap_latency": { 2024-09-17T01:39:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:39:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:39:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:39:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: "req_snapdiff_latency": { 2024-09-17T01:39:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:39:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:39:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:39:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmdir_latency": { 2024-09-17T01:39:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:39:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:39:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:39:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmsnap_latency": { 2024-09-17T01:39:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-17T01:39:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.053934040, 2024-09-17T01:39:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.053934040 2024-09-17T01:39:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmxattr_latency": { 2024-09-17T01:39:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:39:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:39:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:39:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setattr_latency": { 2024-09-17T01:39:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-17T01:39:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000318566, 2024-09-17T01:39:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000318566 2024-09-17T01:39:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setdirlayout_latency": { 2024-09-17T01:39:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:39:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:39:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:39:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setfilelock_latency": { 2024-09-17T01:39:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:39:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:39:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:39:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setlayout_latency": { 2024-09-17T01:39:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:39:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:39:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:39:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setxattr_latency": { 2024-09-17T01:39:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:39:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:39:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:39:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: "req_symlink_latency": { 2024-09-17T01:39:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:39:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:39:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:39:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: "req_unlink_latency": { 2024-09-17T01:39:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 8000, 2024-09-17T01:39:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 20.770812162, 2024-09-17T01:39:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.002596351 2024-09-17T01:39:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_revoke_eviction": 0, 2024-09-17T01:39:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_acquisition_throttle": 0, 2024-09-17T01:39:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getvxattr_latency": { 2024-09-17T01:39:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:39:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:39:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:39:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:39:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_sessions": { 2024-09-17T01:39:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: "session_count": 1, 2024-09-17T01:39:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: "session_add": 1, 2024-09-17T01:39:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: "session_remove": 0, 2024-09-17T01:39:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_open": 1, 2024-09-17T01:39:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_stale": 0, 2024-09-17T01:39:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: "total_load": 17546, 2024-09-17T01:39:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: "average_load": 17546, 2024-09-17T01:39:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: "avg_session_uptime": 66, 2024-09-17T01:39:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: "mdthresh_evicted": 0 2024-09-17T01:39:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: "mempool": { 2024-09-17T01:39:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_bytes": 0, 2024-09-17T01:39:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_items": 0, 2024-09-17T01:39:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_bytes": 0, 2024-09-17T01:39:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_items": 0, 2024-09-17T01:39:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_bytes": 0, 2024-09-17T01:39:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_items": 0, 2024-09-17T01:39:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-17T01:39:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_items": 0, 2024-09-17T01:39:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-17T01:39:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_items": 0, 2024-09-17T01:39:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_bytes": 0, 2024-09-17T01:39:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_items": 0, 2024-09-17T01:39:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-17T01:39:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_items": 0, 2024-09-17T01:39:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_bytes": 0, 2024-09-17T01:39:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_items": 0, 2024-09-17T01:39:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_bytes": 0, 2024-09-17T01:39:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_items": 0, 2024-09-17T01:39:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-17T01:39:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_items": 0, 2024-09-17T01:39:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-17T01:39:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_items": 0, 2024-09-17T01:39:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_bytes": 0, 2024-09-17T01:39:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_items": 0, 2024-09-17T01:39:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_bytes": 0, 2024-09-17T01:39:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_items": 0, 2024-09-17T01:39:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-17T01:39:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_items": 0, 2024-09-17T01:39:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_bytes": 0, 2024-09-17T01:39:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_items": 0, 2024-09-17T01:39:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_bytes": 0, 2024-09-17T01:39:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_items": 0, 2024-09-17T01:39:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_bytes": 0, 2024-09-17T01:39:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_items": 0, 2024-09-17T01:39:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_bytes": 0, 2024-09-17T01:39:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_items": 0, 2024-09-17T01:39:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_bytes": 16378222, 2024-09-17T01:39:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_items": 6105, 2024-09-17T01:39:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_bytes": 528, 2024-09-17T01:39:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_items": 6, 2024-09-17T01:39:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bytes": 0, 2024-09-17T01:39:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_items": 0, 2024-09-17T01:39:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_bytes": 0, 2024-09-17T01:39:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_items": 0, 2024-09-17T01:39:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_bytes": 0, 2024-09-17T01:39:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_items": 0, 2024-09-17T01:39:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_bytes": 5696, 2024-09-17T01:39:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_items": 83, 2024-09-17T01:39:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_bytes": 0, 2024-09-17T01:39:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_items": 0, 2024-09-17T01:39:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_bytes": 0, 2024-09-17T01:39:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_items": 0, 2024-09-17T01:39:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_bytes": 21429970, 2024-09-17T01:39:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_items": 919623, 2024-09-17T01:39:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_bytes": 0, 2024-09-17T01:39:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_items": 0, 2024-09-17T01:39:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_bytes": 0, 2024-09-17T01:39:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_items": 0 2024-09-17T01:39:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: "objecter": { 2024-09-17T01:39:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: "op_active": 0, 2024-09-17T01:39:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: "op_laggy": 0, 2024-09-17T01:39:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send": 4628, 2024-09-17T01:39:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send_bytes": 91176647, 2024-09-17T01:39:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: "op_resend": 37, 2024-09-17T01:39:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: "op_reply": 4628, 2024-09-17T01:39:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: "op_latency": { 2024-09-17T01:39:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 4628, 2024-09-17T01:39:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 22.028820958, 2024-09-17T01:39:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.004759900 2024-09-17T01:39:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: "op_inflight": 0, 2024-09-17T01:39:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: "oplen_avg": { 2024-09-17T01:39:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 4628, 2024-09-17T01:39:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 4739 2024-09-17T01:39:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: "op": 4628, 2024-09-17T01:39:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: "op_r": 50, 2024-09-17T01:39:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: "op_w": 4578, 2024-09-17T01:39:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: "op_rmw": 0, 2024-09-17T01:39:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: "op_pg": 0, 2024-09-17T01:39:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_stat": 0, 2024-09-17T01:39:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_create": 11, 2024-09-17T01:39:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_read": 50, 2024-09-17T01:39:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_write": 2702, 2024-09-17T01:39:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writefull": 34, 2024-09-17T01:39:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writesame": 0, 2024-09-17T01:39:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_append": 0, 2024-09-17T01:39:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_zero": 1720, 2024-09-17T01:39:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_truncate": 0, 2024-09-17T01:39:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_delete": 33, 2024-09-17T01:39:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_mapext": 0, 2024-09-17T01:39:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_sparse_read": 0, 2024-09-17T01:39:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_clonerange": 0, 2024-09-17T01:39:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_getxattr": 0, 2024-09-17T01:39:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_setxattr": 22, 2024-09-17T01:39:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_cmpxattr": 0, 2024-09-17T01:39:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_rmxattr": 0, 2024-09-17T01:39:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_resetxattrs": 0, 2024-09-17T01:39:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_call": 0, 2024-09-17T01:39:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_watch": 0, 2024-09-17T01:39:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_notify": 0, 2024-09-17T01:39:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_src_cmpxattr": 0, 2024-09-17T01:39:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls": 0, 2024-09-17T01:39:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls_filter": 0, 2024-09-17T01:39:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_other": 0, 2024-09-17T01:39:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_active": 0, 2024-09-17T01:39:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_send": 0, 2024-09-17T01:39:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_resend": 0, 2024-09-17T01:39:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_ping": 0, 2024-09-17T01:39:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_active": 0, 2024-09-17T01:39:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_send": 0, 2024-09-17T01:39:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_resend": 0, 2024-09-17T01:39:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_active": 0, 2024-09-17T01:39:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_send": 0, 2024-09-17T01:39:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_resend": 0, 2024-09-17T01:39:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_active": 0, 2024-09-17T01:39:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_send": 0, 2024-09-17T01:39:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_resend": 0, 2024-09-17T01:39:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: "command_active": 0, 2024-09-17T01:39:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: "command_send": 0, 2024-09-17T01:39:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: "command_resend": 0, 2024-09-17T01:39:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: "map_epoch": 110, 2024-09-17T01:39:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: "map_full": 0, 2024-09-17T01:39:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: "map_inc": 3, 2024-09-17T01:39:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_sessions": 8, 2024-09-17T01:39:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_open": 8, 2024-09-17T01:39:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_close": 0, 2024-09-17T01:39:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_laggy": 0, 2024-09-17T01:39:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_wr": 132, 2024-09-17T01:39:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_rd": 0, 2024-09-17T01:39:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_del": 35 2024-09-17T01:39:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: "oft": { 2024-09-17T01:39:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_objs": 1, 2024-09-17T01:39:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_kv_pairs": 0, 2024-09-17T01:39:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_updates": 0, 2024-09-17T01:39:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_removes": 0 2024-09-17T01:39:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: "purge_queue": { 2024-09-17T01:39:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops": 0, 2024-09-17T01:39:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops_high_water": 32, 2024-09-17T01:39:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing": 0, 2024-09-17T01:39:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_high_water": 32, 2024-09-17T01:39:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed_ops": 1720, 2024-09-17T01:39:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed": 1720, 2024-09-17T01:39:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_item_in_journal": 0 2024-09-17T01:39:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-17T01:39:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-17T01:39:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-09-17T01:39:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-17T01:39:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 31520, 2024-09-17T01:39:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 8462895, 2024-09-17T01:39:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-17T01:39:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 31520, 2024-09-17T01:39:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-17T01:39:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-17T01:39:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 31520, 2024-09-17T01:39:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 8462895, 2024-09-17T01:39:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-17T01:39:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:39:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:39:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:39:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:39:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_bytes": { 2024-09-17T01:39:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-17T01:39:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-09-17T01:39:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-17T01:39:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-17T01:39:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-17T01:39:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-17T01:39:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-17T01:39:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 4628, 2024-09-17T01:39:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 91364127, 2024-09-17T01:39:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 4628, 2024-09-17T01:39:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 91364127, 2024-09-17T01:39:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-17T01:39:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:39:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:39:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:39:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:39:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_ops": { 2024-09-17T01:39:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-17T01:39:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 1024, 2024-09-17T01:39:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-17T01:39:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-17T01:39:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-17T01:39:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-17T01:39:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-17T01:39:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 4628, 2024-09-17T01:39:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 4628, 2024-09-17T01:39:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 4628, 2024-09-17T01:39:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 4628, 2024-09-17T01:39:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-17T01:39:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:39:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:39:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:39:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:39:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle": { 2024-09-17T01:39:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-17T01:39:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2024-09-17T01:39:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-17T01:39:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 1720, 2024-09-17T01:39:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 187480, 2024-09-17T01:39:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-17T01:39:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 1720, 2024-09-17T01:39:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-17T01:39:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-17T01:39:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 50, 2024-09-17T01:39:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 187480, 2024-09-17T01:39:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-17T01:39:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:39:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:39:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:39:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:39:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle-0x564f1984d380": { 2024-09-17T01:39:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 60, 2024-09-17T01:39:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2024-09-17T01:39:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-17T01:39:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 24784, 2024-09-17T01:39:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 90715982, 2024-09-17T01:39:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-17T01:39:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 24784, 2024-09-17T01:39:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-17T01:39:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-17T01:39:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 2652, 2024-09-17T01:39:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 90715922, 2024-09-17T01:39:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-17T01:39:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:39:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:39:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:39:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:39:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: "trackedop": { 2024-09-17T01:39:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: "slow_ops_count": 0 2024-09-17T01:39:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:39:52.460 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:39:52.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.405+0000 7f55fda00640 1 -- 172.21.15.42:0/1128644268 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f55d4078bc0 msgr2=0x7f55d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:52.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.405+0000 7f55fda00640 1 --2- 172.21.15.42:0/1128644268 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f55d4078bc0 0x7f55d407b0d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f55e0035000 tx=0x7f55e00046c0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.406+0000 7f55fda00640 1 -- 172.21.15.42:0/1128644268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55dc004800 msgr2=0x7f55f81619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:52.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.406+0000 7f55fda00640 1 --2- 172.21.15.42:0/1128644268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55dc004800 0x7f55f81619a0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f55e800e950 tx=0x7f55e800ee10 comp rx=0 tx=0).stop 2024-09-17T01:39:52.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.406+0000 7f55fda00640 1 -- 172.21.15.42:0/1128644268 shutdown_connections 2024-09-17T01:39:52.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.406+0000 7f55fda00640 1 --2- 172.21.15.42:0/1128644268 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f55d4078bc0 0x7f55d407b0d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.406+0000 7f55fda00640 1 --2- 172.21.15.42:0/1128644268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55f80cbff0 0x7f55f81ea400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.406+0000 7f55fda00640 1 --2- 172.21.15.42:0/1128644268 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55f80c82e0 0x7f55f81ea940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.406+0000 7f55fda00640 1 --2- 172.21.15.42:0/1128644268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55dc004800 0x7f55f81619a0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.406+0000 7f55fda00640 1 -- 172.21.15.42:0/1128644268 >> 172.21.15.42:0/1128644268 conn(0x7f55f806cf00 msgr2=0x7f55f80d42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:52.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.406+0000 7f55fda00640 1 -- 172.21.15.42:0/1128644268 shutdown_connections 2024-09-17T01:39:52.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.406+0000 7f55fda00640 1 -- 172.21.15.42:0/1128644268 wait complete. 2024-09-17T01:39:52.463 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2024-09-17T01:39:52.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:52.463 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start '~mdsdir' recursive 2024-09-17T01:39:52.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.724+0000 7f8ae8200640 1 -- 172.21.15.42:0/1182757947 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ae00b56d0 msgr2=0x7f8ae00b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:52.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.724+0000 7f8ae8200640 1 --2- 172.21.15.42:0/1182757947 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ae00b56d0 0x7f8ae00b46f0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4005fd0 tx=0x7f8ad402a5d0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.724+0000 7f8ae8200640 1 -- 172.21.15.42:0/1182757947 shutdown_connections 2024-09-17T01:39:52.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.724+0000 7f8ae8200640 1 --2- 172.21.15.42:0/1182757947 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8ae006db40 0x7f8ae00cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.724+0000 7f8ae8200640 1 --2- 172.21.15.42:0/1182757947 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ae00b56d0 0x7f8ae00b46f0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.724+0000 7f8ae8200640 1 -- 172.21.15.42:0/1182757947 >> 172.21.15.42:0/1182757947 conn(0x7f8ae00b28f0 msgr2=0x7f8ae006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:52.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.724+0000 7f8ae8200640 1 -- 172.21.15.42:0/1182757947 shutdown_connections 2024-09-17T01:39:52.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.724+0000 7f8ae8200640 1 -- 172.21.15.42:0/1182757947 wait complete. 2024-09-17T01:39:52.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.727+0000 7f8ae8200640 1 Processor -- start 2024-09-17T01:39:52.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.727+0000 7f8ae8200640 1 -- start start 2024-09-17T01:39:52.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.728+0000 7f8ae8200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8ae00b56d0 0x7f8ae013c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.728+0000 7f8ae8200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ae00cdb20 0x7f8ae00aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.728+0000 7f8ae8200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ae00aefc0 0x7f8ae015ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.728+0000 7f8ae8200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae015d560 con 0x7f8ae00aefc0 2024-09-17T01:39:52.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.728+0000 7f8ae8200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae015d3e0 con 0x7f8ae00cdb20 2024-09-17T01:39:52.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.728+0000 7f8ae8200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8ae015d6e0 con 0x7f8ae00b56d0 2024-09-17T01:39:52.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.728+0000 7f8ae6200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ae00aefc0 0x7f8ae015ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.728+0000 7f8ae6200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ae00aefc0 0x7f8ae015ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45778/0 (socket says 172.21.15.42:45778) 2024-09-17T01:39:52.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.728+0000 7f8ae6200640 1 -- 172.21.15.42:0/897028888 learned_addr learned my addr 172.21.15.42:0/897028888 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:39:52.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.729+0000 7f8ae5800640 1 --2- 172.21.15.42:0/897028888 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8ae00b56d0 0x7f8ae013c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.729+0000 7f8ae4e00640 1 --2- 172.21.15.42:0/897028888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ae00cdb20 0x7f8ae00aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.729+0000 7f8ae6200640 1 -- 172.21.15.42:0/897028888 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8ae00b56d0 msgr2=0x7f8ae013c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:52.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.729+0000 7f8ae6200640 1 --2- 172.21.15.42:0/897028888 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8ae00b56d0 0x7f8ae013c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.729+0000 7f8ae6200640 1 -- 172.21.15.42:0/897028888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ae00cdb20 msgr2=0x7f8ae00aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:52.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.729+0000 7f8ae6200640 1 --2- 172.21.15.42:0/897028888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ae00cdb20 0x7f8ae00aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.729+0000 7f8ae6200640 1 -- 172.21.15.42:0/897028888 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae013d2d0 con 0x7f8ae00aefc0 2024-09-17T01:39:52.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.729+0000 7f8ae6200640 1 --2- 172.21.15.42:0/897028888 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ae00aefc0 0x7f8ae015ee60 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f8ad800e960 tx=0x7f8ad800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:52.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.730+0000 7f8add600640 1 -- 172.21.15.42:0/897028888 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8004d20 con 0x7f8ae00aefc0 2024-09-17T01:39:52.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.730+0000 7f8add600640 1 -- 172.21.15.42:0/897028888 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ad800cac0 con 0x7f8ae00aefc0 2024-09-17T01:39:52.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.730+0000 7f8add600640 1 -- 172.21.15.42:0/897028888 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8005020 con 0x7f8ae00aefc0 2024-09-17T01:39:52.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.730+0000 7f8ae8200640 1 -- 172.21.15.42:0/897028888 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ae013d5b0 con 0x7f8ae00aefc0 2024-09-17T01:39:52.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.730+0000 7f8ae8200640 1 -- 172.21.15.42:0/897028888 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ae013db70 con 0x7f8ae00aefc0 2024-09-17T01:39:52.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.732+0000 7f8add600640 1 -- 172.21.15.42:0/897028888 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8ad80051c0 con 0x7f8ae00aefc0 2024-09-17T01:39:52.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.733+0000 7f8add600640 1 --2- 172.21.15.42:0/897028888 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ac0078b90 0x7f8ac007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.733+0000 7f8add600640 1 -- 172.21.15.42:0/897028888 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5825+0+0 (secure 0 0 0) 0x7f8ad809b6b0 con 0x7f8ae00aefc0 2024-09-17T01:39:52.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.734+0000 7f8ae5800640 1 --2- 172.21.15.42:0/897028888 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ac0078b90 0x7f8ac007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.734+0000 7f8aef286740 1 Processor -- start 2024-09-17T01:39:52.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.734+0000 7f8aef286740 1 -- start start 2024-09-17T01:39:52.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.735+0000 7f8ae5800640 1 --2- 172.21.15.42:0/897028888 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ac0078b90 0x7f8ac007b0a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4033000 tx=0x7f8ad4004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:52.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.736+0000 7f8aef286740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b2bb0a55b0 0x55b2bb4919a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.736+0000 7f8aef286740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb07c6f0 0x55b2bb4667f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.736+0000 7f8aef286740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2bb0848d0 0x55b2bb466d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.736+0000 7f8aef286740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b2bb3bf970 con 0x55b2bb07c6f0 2024-09-17T01:39:52.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.736+0000 7f8aef286740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b2bb3aeda0 con 0x55b2bb0848d0 2024-09-17T01:39:52.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.736+0000 7f8aef286740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55b2bb3b2bb0 con 0x55b2bb0a55b0 2024-09-17T01:39:52.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.736+0000 7f8ae4e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb07c6f0 0x55b2bb4667f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.736+0000 7f8ae4e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb07c6f0 0x55b2bb4667f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45794/0 (socket says 172.21.15.42:45794) 2024-09-17T01:39:52.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.736+0000 7f8ae4e00640 1 -- 172.21.15.42:0/2381817522 learned_addr learned my addr 172.21.15.42:0/2381817522 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:39:52.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.736+0000 7f8ae5800640 1 --2- 172.21.15.42:0/2381817522 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b2bb0a55b0 0x55b2bb4919a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.736+0000 7f8ae6200640 1 --2- 172.21.15.42:0/2381817522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2bb0848d0 0x55b2bb466d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.736+0000 7f8ae4e00640 1 -- 172.21.15.42:0/2381817522 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b2bb0a55b0 msgr2=0x55b2bb4919a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:39:52.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.736+0000 7f8ae4e00640 1 --2- 172.21.15.42:0/2381817522 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b2bb0a55b0 0x55b2bb4919a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.736+0000 7f8ae4e00640 1 -- 172.21.15.42:0/2381817522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2bb0848d0 msgr2=0x55b2bb466d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:39:52.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.736+0000 7f8ae4e00640 1 --2- 172.21.15.42:0/2381817522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2bb0848d0 0x55b2bb466d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.736+0000 7f8ae4e00640 1 -- 172.21.15.42:0/2381817522 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2bb189a20 con 0x55b2bb07c6f0 2024-09-17T01:39:52.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.737+0000 7f8ae4e00640 1 --2- 172.21.15.42:0/2381817522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb07c6f0 0x55b2bb4667f0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f8acc0017f0 tx=0x7f8acc007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0690a355e99682c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:52.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.737+0000 7f8ad2000640 1 -- 172.21.15.42:0/2381817522 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc0052e0 con 0x55b2bb07c6f0 2024-09-17T01:39:52.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.737+0000 7f8ad2000640 1 -- 172.21.15.42:0/2381817522 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8acc018070 con 0x55b2bb07c6f0 2024-09-17T01:39:52.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.737+0000 7f8ad2000640 1 -- 172.21.15.42:0/2381817522 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc00f9b0 con 0x55b2bb07c6f0 2024-09-17T01:39:52.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.738+0000 7f8aef286740 1 -- 172.21.15.42:0/2381817522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb07c6f0 msgr2=0x55b2bb4667f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:52.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.738+0000 7f8aef286740 1 --2- 172.21.15.42:0/2381817522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb07c6f0 0x55b2bb4667f0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f8acc0017f0 tx=0x7f8acc007e30 comp rx=0 tx=0).stop 2024-09-17T01:39:52.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.738+0000 7f8aef286740 1 -- 172.21.15.42:0/2381817522 shutdown_connections 2024-09-17T01:39:52.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.738+0000 7f8aef286740 1 --2- 172.21.15.42:0/2381817522 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2bb0848d0 0x55b2bb466d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.738+0000 7f8aef286740 1 --2- 172.21.15.42:0/2381817522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb07c6f0 0x55b2bb4667f0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.738+0000 7f8aef286740 1 --2- 172.21.15.42:0/2381817522 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b2bb0a55b0 0x55b2bb4919a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.738+0000 7f8aef286740 1 -- 172.21.15.42:0/2381817522 >> 172.21.15.42:0/2381817522 conn(0x55b2bb099700 msgr2=0x55b2bb44cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:52.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.738+0000 7f8aef286740 1 -- 172.21.15.42:0/2381817522 shutdown_connections 2024-09-17T01:39:52.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.738+0000 7f8aef286740 1 -- 172.21.15.42:0/2381817522 wait complete. 2024-09-17T01:39:52.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.739+0000 7f8aef286740 1 -- start start 2024-09-17T01:39:52.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.739+0000 7f8aef286740 1 Processor -- start 2024-09-17T01:39:52.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.741+0000 7f8aef286740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2bb07c6f0 0x55b2bb487dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.741+0000 7f8aef286740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb0848d0 0x55b2bb48a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.741+0000 7f8aef286740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b2bb0a55b0 0x55b2bb4a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.741+0000 7f8aef286740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b2bb11f960 con 0x55b2bb0848d0 2024-09-17T01:39:52.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.741+0000 7f8aef286740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b2bb354780 con 0x55b2bb07c6f0 2024-09-17T01:39:52.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.741+0000 7f8aef286740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55b2bb4a5140 con 0x55b2bb0a55b0 2024-09-17T01:39:52.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.741+0000 7f8aef286740 10 client.0 _ll_register_callbacks cb 0x55b2bb3ab4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:39:52.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.741+0000 7f8ae4e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb0848d0 0x55b2bb48a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.741+0000 7f8ae4e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb0848d0 0x55b2bb48a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45804/0 (socket says 172.21.15.42:45804) 2024-09-17T01:39:52.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.741+0000 7f8ae4e00640 1 -- 172.21.15.42:0/1260473494 learned_addr learned my addr 172.21.15.42:0/1260473494 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:39:52.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.741+0000 7f8ae6200640 1 --2- 172.21.15.42:0/1260473494 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b2bb0a55b0 0x55b2bb4a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.741+0000 7f8ae5800640 1 --2- 172.21.15.42:0/1260473494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2bb07c6f0 0x55b2bb487dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.742+0000 7f8ae4e00640 1 -- 172.21.15.42:0/1260473494 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b2bb0a55b0 msgr2=0x55b2bb4a42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:39:52.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.742+0000 7f8ae4e00640 1 --2- 172.21.15.42:0/1260473494 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b2bb0a55b0 0x55b2bb4a42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.742+0000 7f8ae4e00640 1 -- 172.21.15.42:0/1260473494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2bb07c6f0 msgr2=0x55b2bb487dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:39:52.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.742+0000 7f8ae4e00640 1 --2- 172.21.15.42:0/1260473494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2bb07c6f0 0x55b2bb487dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.742+0000 7f8ae4e00640 1 -- 172.21.15.42:0/1260473494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2bb0ee8c0 con 0x55b2bb0848d0 2024-09-17T01:39:52.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.742+0000 7f8ae4e00640 1 --2- 172.21.15.42:0/1260473494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb0848d0 0x55b2bb48a7b0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f8acc000fb0 tx=0x7f8acc0076d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac12ffdd7689f95 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:52.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.742+0000 7f8ac6a00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:39:52.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.742+0000 7f8ac6a00640 1 -- 172.21.15.42:0/1260473494 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc0052e0 con 0x55b2bb0848d0 2024-09-17T01:39:52.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.742+0000 7f8aef286740 1 -- 172.21.15.42:0/1260473494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8acc018070 con 0x55b2bb0848d0 2024-09-17T01:39:52.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.742+0000 7f8ac6a00640 1 -- 172.21.15.42:0/1260473494 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 5825+0+0 (secure 0 0 0) 0x7f8acc0069d0 con 0x55b2bb0848d0 2024-09-17T01:39:52.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.743+0000 7f8ac6a00640 1 -- 172.21.15.42:0/1260473494 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f8acc006bd0 con 0x55b2bb0848d0 2024-09-17T01:39:52.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.743+0000 7f8aef286740 10 client.7836 fetch_fsmap learned FSMap version 89 2024-09-17T01:39:52.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.743+0000 7f8aef286740 1 -- 172.21.15.42:0/1260473494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x55b2bb1ea1b0 con 0x55b2bb0848d0 2024-09-17T01:39:52.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.743+0000 7f8ac6a00640 1 -- 172.21.15.42:0/1260473494 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8acc018070 con 0x55b2bb0848d0 2024-09-17T01:39:52.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.743+0000 7f8ac6a00640 1 -- 172.21.15.42:0/1260473494 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 89) ==== 3502+0+0 (secure 0 0 0) 0x7f8acc00f7b0 con 0x55b2bb0848d0 2024-09-17T01:39:52.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.743+0000 7f8aef286740 10 client.7836 fetch_fsmap finished waiting for FSMap version 89 2024-09-17T01:39:52.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.743+0000 7f8aef286740 10 client.7836 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T01:39:52.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.743+0000 7f8aef286740 20 client.7836 populate_metadata read hostname 'smithi042' 2024-09-17T01:39:52.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.743+0000 7f8aef286740 1 --2- 172.21.15.42:0/1260473494 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x55b2bb064180 0x55b2bb48d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.743+0000 7f8aef286740 4 client.7836 mds_command: new command op to 7644 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:39:52.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.743+0000 7f8aef286740 1 -- 172.21.15.42:0/1260473494 --> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2bb3c18c0 con 0x55b2bb064180 2024-09-17T01:39:52.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.743+0000 7f8ae5800640 1 --2- 172.21.15.42:0/1260473494 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x55b2bb064180 0x55b2bb48d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.744+0000 7f8ae5800640 1 --2- 172.21.15.42:0/1260473494 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x55b2bb064180 0x55b2bb48d150 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7f1b91a9d9b7f27 server_cookie=f3497185e8562e6c in_seq=0 out_seq=0 2024-09-17T01:39:52.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.744+0000 7f8ac6a00640 10 client.7836 ms_handle_connect on v2:172.21.15.42:6832/1078007521 2024-09-17T01:39:52.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.745+0000 7f8ac6a00640 1 -- 172.21.15.42:0/1260473494 <== mds.0 v2:172.21.15.42:6832/1078007521 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b2bb3c18c0 con 0x55b2bb064180 2024-09-17T01:39:52.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.745+0000 7f8ac6a00640 10 client.7836 handle_command_reply: tid=0 2024-09-17T01:39:52.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.745+0000 7f8aef286740 1 client.7836 shutdown 2024-09-17T01:39:52.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.745+0000 7f8aef286740 1 -- 172.21.15.42:0/1260473494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb0848d0 msgr2=0x55b2bb48a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:52.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.745+0000 7f8aef286740 1 --2- 172.21.15.42:0/1260473494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb0848d0 0x55b2bb48a7b0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f8acc000fb0 tx=0x7f8acc0076d0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.745+0000 7f8aef286740 1 -- 172.21.15.42:0/1260473494 shutdown_connections 2024-09-17T01:39:52.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.745+0000 7f8aef286740 1 --2- 172.21.15.42:0/1260473494 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x55b2bb064180 0x55b2bb48d150 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.745+0000 7f8aef286740 1 --2- 172.21.15.42:0/1260473494 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b2bb0a55b0 0x55b2bb4a42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.745+0000 7f8aef286740 1 --2- 172.21.15.42:0/1260473494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb0848d0 0x55b2bb48a7b0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.745+0000 7f8ac6a00640 0 client.7836 ms_handle_reset on v2:172.21.15.42:6832/1078007521 2024-09-17T01:39:52.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.745+0000 7f8aef286740 1 --2- 172.21.15.42:0/1260473494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2bb07c6f0 0x55b2bb487dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.745+0000 7f8aef286740 1 -- 172.21.15.42:0/1260473494 >> 172.21.15.42:0/1260473494 conn(0x55b2bb099700 msgr2=0x55b2bb4479b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:52.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.745+0000 7f8aef286740 1 -- 172.21.15.42:0/1260473494 shutdown_connections 2024-09-17T01:39:52.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.745+0000 7f8aef286740 1 -- 172.21.15.42:0/1260473494 wait complete. 2024-09-17T01:39:52.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.745+0000 7f8aef286740 20 client.7836 trim_cache size 0 max 16384 2024-09-17T01:39:52.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.764+0000 7f8aef286740 1 Processor -- start 2024-09-17T01:39:52.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.764+0000 7f8aef286740 1 -- start start 2024-09-17T01:39:52.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.766+0000 7f8aef286740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2bb07c6f0 0x55b2bb487640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.766+0000 7f8aef286740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb0848d0 0x55b2bb487b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.766+0000 7f8aef286740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b2bb0a55b0 0x55b2bb4a0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.766+0000 7f8aef286740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae0202580 con 0x55b2bb0848d0 2024-09-17T01:39:52.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.766+0000 7f8aef286740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae02015a0 con 0x55b2bb07c6f0 2024-09-17T01:39:52.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.766+0000 7f8aef286740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8ae01407e0 con 0x55b2bb0a55b0 2024-09-17T01:39:52.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.766+0000 7f8ae4e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb0848d0 0x55b2bb487b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.766+0000 7f8ae4e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb0848d0 0x55b2bb487b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45810/0 (socket says 172.21.15.42:45810) 2024-09-17T01:39:52.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.766+0000 7f8ae4e00640 1 -- 172.21.15.42:0/2760275239 learned_addr learned my addr 172.21.15.42:0/2760275239 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:39:52.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.766+0000 7f8ae5800640 1 --2- 172.21.15.42:0/2760275239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2bb07c6f0 0x55b2bb487640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.766+0000 7f8ae6200640 1 --2- 172.21.15.42:0/2760275239 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b2bb0a55b0 0x55b2bb4a0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.766+0000 7f8ae4e00640 1 -- 172.21.15.42:0/2760275239 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b2bb0a55b0 msgr2=0x55b2bb4a0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:39:52.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.766+0000 7f8ae4e00640 1 --2- 172.21.15.42:0/2760275239 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b2bb0a55b0 0x55b2bb4a0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.766+0000 7f8ae4e00640 1 -- 172.21.15.42:0/2760275239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2bb07c6f0 msgr2=0x55b2bb487640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:39:52.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.766+0000 7f8ae4e00640 1 --2- 172.21.15.42:0/2760275239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2bb07c6f0 0x55b2bb487640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.766+0000 7f8ae4e00640 1 -- 172.21.15.42:0/2760275239 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2bb187d20 con 0x55b2bb0848d0 2024-09-17T01:39:52.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.766+0000 7f8ae4e00640 1 --2- 172.21.15.42:0/2760275239 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb0848d0 0x55b2bb487b80 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f8acc007c70 tx=0x7f8acc000e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b1c2c21e0c4960 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:52.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.767+0000 7f8ad1600640 1 -- 172.21.15.42:0/2760275239 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc0052e0 con 0x55b2bb0848d0 2024-09-17T01:39:52.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.767+0000 7f8ad1600640 1 -- 172.21.15.42:0/2760275239 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8acc018040 con 0x55b2bb0848d0 2024-09-17T01:39:52.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.767+0000 7f8ad1600640 1 -- 172.21.15.42:0/2760275239 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc0067d0 con 0x55b2bb0848d0 2024-09-17T01:39:52.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.768+0000 7f8aef286740 1 -- 172.21.15.42:0/2760275239 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb0848d0 msgr2=0x55b2bb487b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:52.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.768+0000 7f8aef286740 1 --2- 172.21.15.42:0/2760275239 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb0848d0 0x55b2bb487b80 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f8acc007c70 tx=0x7f8acc000e40 comp rx=0 tx=0).stop 2024-09-17T01:39:52.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.768+0000 7f8aef286740 1 -- 172.21.15.42:0/2760275239 shutdown_connections 2024-09-17T01:39:52.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.768+0000 7f8aef286740 1 --2- 172.21.15.42:0/2760275239 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b2bb0a55b0 0x55b2bb4a0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.768+0000 7f8aef286740 1 --2- 172.21.15.42:0/2760275239 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb0848d0 0x55b2bb487b80 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.768+0000 7f8aef286740 1 --2- 172.21.15.42:0/2760275239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2bb07c6f0 0x55b2bb487640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.768+0000 7f8aef286740 1 -- 172.21.15.42:0/2760275239 >> 172.21.15.42:0/2760275239 conn(0x55b2bb099700 msgr2=0x55b2bb488440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:52.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.768+0000 7f8aef286740 1 -- 172.21.15.42:0/2760275239 shutdown_connections 2024-09-17T01:39:52.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.768+0000 7f8aef286740 1 -- 172.21.15.42:0/2760275239 wait complete. 2024-09-17T01:39:52.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.769+0000 7f8aef286740 1 -- start start 2024-09-17T01:39:52.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.769+0000 7f8aef286740 1 Processor -- start 2024-09-17T01:39:52.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.770+0000 7f8aef286740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2bb07c6f0 0x55b2bb5072e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.770+0000 7f8aef286740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb0848d0 0x55b2bb510800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.770+0000 7f8aef286740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b2bb0a55b0 0x55b2bb514520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.770+0000 7f8aef286740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae0140e30 con 0x55b2bb0848d0 2024-09-17T01:39:52.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.770+0000 7f8aef286740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b2bb4660e0 con 0x55b2bb07c6f0 2024-09-17T01:39:52.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.770+0000 7f8aef286740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55b2bb511240 con 0x55b2bb0a55b0 2024-09-17T01:39:52.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.771+0000 7f8aef286740 10 client.0 _ll_register_callbacks cb 0x7f8ad4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:39:52.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.771+0000 7f8ae4e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb0848d0 0x55b2bb510800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.771+0000 7f8ae4e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb0848d0 0x55b2bb510800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45812/0 (socket says 172.21.15.42:45812) 2024-09-17T01:39:52.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.771+0000 7f8ae4e00640 1 -- 172.21.15.42:0/2099138455 learned_addr learned my addr 172.21.15.42:0/2099138455 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:39:52.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.771+0000 7f8ae5800640 1 --2- 172.21.15.42:0/2099138455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2bb07c6f0 0x55b2bb5072e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.771+0000 7f8ae6200640 1 --2- 172.21.15.42:0/2099138455 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b2bb0a55b0 0x55b2bb514520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.771+0000 7f8ae4e00640 1 -- 172.21.15.42:0/2099138455 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b2bb0a55b0 msgr2=0x55b2bb514520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:39:52.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.771+0000 7f8ae4e00640 1 --2- 172.21.15.42:0/2099138455 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b2bb0a55b0 0x55b2bb514520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.771+0000 7f8ae4e00640 1 -- 172.21.15.42:0/2099138455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2bb07c6f0 msgr2=0x55b2bb5072e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:39:52.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.771+0000 7f8ae4e00640 1 --2- 172.21.15.42:0/2099138455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2bb07c6f0 0x55b2bb5072e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.771+0000 7f8ae4e00640 1 -- 172.21.15.42:0/2099138455 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2bb448f40 con 0x55b2bb0848d0 2024-09-17T01:39:52.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.771+0000 7f8ae6200640 1 --2- 172.21.15.42:0/2099138455 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b2bb0a55b0 0x55b2bb514520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:39:52.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.771+0000 7f8ae4e00640 1 --2- 172.21.15.42:0/2099138455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb0848d0 0x55b2bb510800 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f8acc001eb0 tx=0x7f8acc000f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29113d4fb15c14e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:52.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.771+0000 7f8ac6a00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:39:52.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.772+0000 7f8ac6a00640 1 -- 172.21.15.42:0/2099138455 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc0052e0 con 0x55b2bb0848d0 2024-09-17T01:39:52.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.772+0000 7f8ac6a00640 1 -- 172.21.15.42:0/2099138455 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 5825+0+0 (secure 0 0 0) 0x7f8acc0069d0 con 0x55b2bb0848d0 2024-09-17T01:39:52.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.772+0000 7f8aef286740 1 -- 172.21.15.42:0/2099138455 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8acc018040 con 0x55b2bb0848d0 2024-09-17T01:39:52.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.772+0000 7f8ac6a00640 1 -- 172.21.15.42:0/2099138455 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f8acc040050 con 0x55b2bb0848d0 2024-09-17T01:39:52.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.772+0000 7f8aef286740 10 client.7842 fetch_fsmap learned FSMap version 89 2024-09-17T01:39:52.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.772+0000 7f8aef286740 1 -- 172.21.15.42:0/2099138455 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x55b2bb510f80 con 0x55b2bb0848d0 2024-09-17T01:39:52.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.772+0000 7f8ac6a00640 1 -- 172.21.15.42:0/2099138455 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8acc018040 con 0x55b2bb0848d0 2024-09-17T01:39:52.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.772+0000 7f8ac6a00640 1 -- 172.21.15.42:0/2099138455 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 89) ==== 3502+0+0 (secure 0 0 0) 0x7f8acc043020 con 0x55b2bb0848d0 2024-09-17T01:39:52.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.772+0000 7f8aef286740 10 client.7842 fetch_fsmap finished waiting for FSMap version 89 2024-09-17T01:39:52.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.772+0000 7f8aef286740 10 client.7842 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T01:39:52.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.772+0000 7f8aef286740 20 client.7842 populate_metadata read hostname 'smithi042' 2024-09-17T01:39:52.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.772+0000 7f8aef286740 1 --2- 172.21.15.42:0/2099138455 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x55b2bb514a60 0x55b2bb487640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:52.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.772+0000 7f8aef286740 4 client.7842 mds_command: new command op to 7644 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-09-17T01:39:52.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.772+0000 7f8aef286740 1 -- 172.21.15.42:0/2099138455 --> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) -- 0x55b2bb3bd370 con 0x55b2bb514a60 2024-09-17T01:39:52.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.773+0000 7f8ae5800640 1 --2- 172.21.15.42:0/2099138455 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x55b2bb514a60 0x55b2bb487640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:52.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.773+0000 7f8ae5800640 1 --2- 172.21.15.42:0/2099138455 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x55b2bb514a60 0x55b2bb487640 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76468da84b0f87 server_cookie=c417a9eacacd76ea in_seq=0 out_seq=0 2024-09-17T01:39:52.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.773+0000 7f8ac6a00640 10 client.7842 ms_handle_connect on v2:172.21.15.42:6832/1078007521 2024-09-17T01:39:52.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.780+0000 7f8ac6a00640 1 -- 172.21.15.42:0/2099138455 <== mds.0 v2:172.21.15.42:6832/1078007521 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b2bb3bd370 con 0x55b2bb514a60 2024-09-17T01:39:52.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.780+0000 7f8ac6a00640 10 client.7842 handle_command_reply: tid=0 2024-09-17T01:39:52.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.781+0000 7f8aef286740 1 client.7842 shutdown 2024-09-17T01:39:52.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.781+0000 7f8aef286740 1 -- 172.21.15.42:0/2099138455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb0848d0 msgr2=0x55b2bb510800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:52.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.781+0000 7f8aef286740 1 --2- 172.21.15.42:0/2099138455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb0848d0 0x55b2bb510800 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f8acc001eb0 tx=0x7f8acc000f70 comp rx=0 tx=0).stop 2024-09-17T01:39:52.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.781+0000 7f8aef286740 1 -- 172.21.15.42:0/2099138455 shutdown_connections 2024-09-17T01:39:52.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.781+0000 7f8aef286740 1 --2- 172.21.15.42:0/2099138455 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x55b2bb514a60 0x55b2bb487640 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.781+0000 7f8aef286740 1 --2- 172.21.15.42:0/2099138455 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b2bb0a55b0 0x55b2bb514520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.781+0000 7f8aef286740 1 --2- 172.21.15.42:0/2099138455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b2bb0848d0 0x55b2bb510800 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.781+0000 7f8aef286740 1 --2- 172.21.15.42:0/2099138455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2bb07c6f0 0x55b2bb5072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.781+0000 7f8aef286740 1 -- 172.21.15.42:0/2099138455 >> 172.21.15.42:0/2099138455 conn(0x55b2bb099700 msgr2=0x55b2bb491b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:52.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.781+0000 7f8ac6a00640 0 client.7842 ms_handle_reset on v2:172.21.15.42:6832/1078007521 2024-09-17T01:39:52.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.781+0000 7f8aef286740 1 -- 172.21.15.42:0/2099138455 shutdown_connections 2024-09-17T01:39:52.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.781+0000 7f8aef286740 1 -- 172.21.15.42:0/2099138455 wait complete. 2024-09-17T01:39:52.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.781+0000 7f8aef286740 20 client.7842 trim_cache size 0 max 16384 2024-09-17T01:39:52.781 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:39:52.782 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-17T01:39:52.782 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "909da9e5-b19e-4bd9-95a8-b659b6cca8bb", 2024-09-17T01:39:52.782 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-17T01:39:52.782 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:39:52.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.782+0000 7f8ae8200640 1 -- 172.21.15.42:0/897028888 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ac0078b90 msgr2=0x7f8ac007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:52.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.782+0000 7f8ae8200640 1 --2- 172.21.15.42:0/897028888 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ac0078b90 0x7f8ac007b0a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4033000 tx=0x7f8ad4004730 comp rx=0 tx=0).stop 2024-09-17T01:39:52.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.782+0000 7f8ae8200640 1 -- 172.21.15.42:0/897028888 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ae00aefc0 msgr2=0x7f8ae015ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:52.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.782+0000 7f8ae8200640 1 --2- 172.21.15.42:0/897028888 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ae00aefc0 0x7f8ae015ee60 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f8ad800e960 tx=0x7f8ad800ee20 comp rx=0 tx=0).stop 2024-09-17T01:39:52.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.782+0000 7f8ae8200640 1 -- 172.21.15.42:0/897028888 shutdown_connections 2024-09-17T01:39:52.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.782+0000 7f8ae8200640 1 --2- 172.21.15.42:0/897028888 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ac0078b90 0x7f8ac007b0a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.782+0000 7f8ae8200640 1 --2- 172.21.15.42:0/897028888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ae00cdb20 0x7f8ae00aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.782+0000 7f8ae8200640 1 --2- 172.21.15.42:0/897028888 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ae00aefc0 0x7f8ae015ee60 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.782+0000 7f8ae8200640 1 --2- 172.21.15.42:0/897028888 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8ae00b56d0 0x7f8ae013c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:52.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.782+0000 7f8ae8200640 1 -- 172.21.15.42:0/897028888 >> 172.21.15.42:0/897028888 conn(0x7f8ae00b28f0 msgr2=0x7f8ae015c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:52.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.782+0000 7f8ae8200640 1 -- 172.21.15.42:0/897028888 shutdown_connections 2024-09-17T01:39:52.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:52.782+0000 7f8ae8200640 1 -- 172.21.15.42:0/897028888 wait complete. 2024-09-17T01:39:52.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:52.805 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-17T01:39:53.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.061+0000 7fb26e200640 1 -- 172.21.15.42:0/968344380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2680701c0 msgr2=0x7fb26815c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:53.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.061+0000 7fb26e200640 1 --2- 172.21.15.42:0/968344380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2680701c0 0x7fb26815c7c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb268072840 tx=0x7fb25802a540 comp rx=0 tx=0).stop 2024-09-17T01:39:53.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.061+0000 7fb26e200640 1 -- 172.21.15.42:0/968344380 shutdown_connections 2024-09-17T01:39:53.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.061+0000 7fb26e200640 1 --2- 172.21.15.42:0/968344380 >> v2:172.21.15.42:3300/0 conn(0x7fb26806edf0 0x7fb268160af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.061+0000 7fb26e200640 1 --2- 172.21.15.42:0/968344380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2680701c0 0x7fb26815c7c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.061+0000 7fb26e200640 1 -- 172.21.15.42:0/968344380 >> 172.21.15.42:0/968344380 conn(0x7fb26806cf00 msgr2=0x7fb26806d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:53.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.061+0000 7fb26e200640 1 -- 172.21.15.42:0/968344380 shutdown_connections 2024-09-17T01:39:53.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.061+0000 7fb26e200640 1 -- 172.21.15.42:0/968344380 wait complete. 2024-09-17T01:39:53.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.063+0000 7fb26e200640 1 Processor -- start 2024-09-17T01:39:53.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.063+0000 7fb26e200640 1 -- start start 2024-09-17T01:39:53.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.065+0000 7fb26e200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb26806edf0 0x7fb26809e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:53.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.065+0000 7fb26e200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb2680701c0 0x7fb26814d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:53.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.065+0000 7fb26e200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb268161030 0x7fb2680b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:53.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.065+0000 7fb26e200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb2680af420 con 0x7fb26806edf0 2024-09-17T01:39:53.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.065+0000 7fb26e200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb2680af2a0 con 0x7fb268161030 2024-09-17T01:39:53.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.065+0000 7fb26e200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb2680af5a0 con 0x7fb2680701c0 2024-09-17T01:39:53.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.066+0000 7fb267400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb26806edf0 0x7fb26809e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:53.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.066+0000 7fb266a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb2680701c0 0x7fb26814d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:53.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.066+0000 7fb266a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb2680701c0 0x7fb26814d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:59564/0 (socket says 172.21.15.42:59564) 2024-09-17T01:39:53.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.066+0000 7fb266a00640 1 -- 172.21.15.42:0/3724679498 learned_addr learned my addr 172.21.15.42:0/3724679498 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:39:53.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.066+0000 7fb267e00640 1 --2- 172.21.15.42:0/3724679498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb268161030 0x7fb2680b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:53.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.066+0000 7fb267400640 1 -- 172.21.15.42:0/3724679498 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb2680701c0 msgr2=0x7fb26814d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:53.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.066+0000 7fb267400640 1 --2- 172.21.15.42:0/3724679498 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb2680701c0 0x7fb26814d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.066+0000 7fb267400640 1 -- 172.21.15.42:0/3724679498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb268161030 msgr2=0x7fb2680b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:53.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.066+0000 7fb267400640 1 --2- 172.21.15.42:0/3724679498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb268161030 0x7fb2680b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.066+0000 7fb267400640 1 -- 172.21.15.42:0/3724679498 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb268155d20 con 0x7fb26806edf0 2024-09-17T01:39:53.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.066+0000 7fb266a00640 1 --2- 172.21.15.42:0/3724679498 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb2680701c0 0x7fb26814d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:39:53.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.067+0000 7fb267400640 1 --2- 172.21.15.42:0/3724679498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb26806edf0 0x7fb26809e010 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fb258031000 tx=0x7fb258033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:53.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.067+0000 7fb25f400640 1 -- 172.21.15.42:0/3724679498 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb258031d60 con 0x7fb26806edf0 2024-09-17T01:39:53.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.067+0000 7fb25f400640 1 -- 172.21.15.42:0/3724679498 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb258033e10 con 0x7fb26806edf0 2024-09-17T01:39:53.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.067+0000 7fb25f400640 1 -- 172.21.15.42:0/3724679498 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb258005280 con 0x7fb26806edf0 2024-09-17T01:39:53.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.067+0000 7fb26e200640 1 -- 172.21.15.42:0/3724679498 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb26809d530 con 0x7fb26806edf0 2024-09-17T01:39:53.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.068+0000 7fb26e200640 1 -- 172.21.15.42:0/3724679498 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2680b1f50 con 0x7fb26806edf0 2024-09-17T01:39:53.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.071+0000 7fb25f400640 1 -- 172.21.15.42:0/3724679498 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb258005420 con 0x7fb26806edf0 2024-09-17T01:39:53.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.073+0000 7fb275268740 1 Processor -- start 2024-09-17T01:39:53.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.073+0000 7fb275268740 1 -- start start 2024-09-17T01:39:53.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.073+0000 7fb25f400640 1 --2- 172.21.15.42:0/3724679498 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb248078b90 0x7fb24807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:53.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.073+0000 7fb25f400640 1 -- 172.21.15.42:0/3724679498 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5825+0+0 (secure 0 0 0) 0x7fb2580bbdb0 con 0x7fb26806edf0 2024-09-17T01:39:53.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.074+0000 7fb267e00640 1 --2- 172.21.15.42:0/3724679498 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb248078b90 0x7fb24807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:53.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.075+0000 7fb267e00640 1 --2- 172.21.15.42:0/3724679498 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb248078b90 0x7fb24807b0a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb260004a30 tx=0x7fb2600019d0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:53.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.075+0000 7fb275268740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e29fac1390 0x55e29feaf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:53.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.075+0000 7fb275268740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29fa984d0 0x55e29fe92220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:53.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.075+0000 7fb275268740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e29faa06b0 0x55e29fe92760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:53.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.075+0000 7fb275268740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e29fdc81c0 con 0x55e29fa984d0 2024-09-17T01:39:53.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.075+0000 7fb275268740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e29fddb870 con 0x55e29fac1390 2024-09-17T01:39:53.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.075+0000 7fb275268740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55e29fdcaca0 con 0x55e29faa06b0 2024-09-17T01:39:53.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.075+0000 7fb266a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29fa984d0 0x55e29fe92220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:53.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.075+0000 7fb266a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29fa984d0 0x55e29fe92220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45846/0 (socket says 172.21.15.42:45846) 2024-09-17T01:39:53.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.075+0000 7fb266a00640 1 -- 172.21.15.42:0/24744023 learned_addr learned my addr 172.21.15.42:0/24744023 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:39:53.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.075+0000 7fb267400640 1 --2- 172.21.15.42:0/24744023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e29fac1390 0x55e29feaf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:53.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.075+0000 7fb267e00640 1 --2- 172.21.15.42:0/24744023 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e29faa06b0 0x55e29fe92760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:53.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.076+0000 7fb267400640 1 -- 172.21.15.42:0/24744023 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e29faa06b0 msgr2=0x55e29fe92760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:39:53.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.076+0000 7fb267400640 1 --2- 172.21.15.42:0/24744023 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e29faa06b0 0x55e29fe92760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.076+0000 7fb267400640 1 -- 172.21.15.42:0/24744023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29fa984d0 msgr2=0x55e29fe92220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:39:53.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.076+0000 7fb267400640 1 --2- 172.21.15.42:0/24744023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29fa984d0 0x55e29fe92220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.076+0000 7fb267400640 1 -- 172.21.15.42:0/24744023 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e29fba37d0 con 0x55e29fac1390 2024-09-17T01:39:53.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.076+0000 7fb267400640 1 --2- 172.21.15.42:0/24744023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e29fac1390 0x55e29feaf550 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb2580ba1f0 tx=0x7fb258005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=419b147ed251f1f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:53.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.076+0000 7fb253400640 1 -- 172.21.15.42:0/24744023 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb258048030 con 0x55e29fac1390 2024-09-17T01:39:53.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.077+0000 7fb253400640 1 -- 172.21.15.42:0/24744023 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb258083720 con 0x55e29fac1390 2024-09-17T01:39:53.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.077+0000 7fb253400640 1 -- 172.21.15.42:0/24744023 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25808d1f0 con 0x55e29fac1390 2024-09-17T01:39:53.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.078+0000 7fb275268740 1 -- 172.21.15.42:0/24744023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e29fac1390 msgr2=0x55e29feaf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:53.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.078+0000 7fb275268740 1 --2- 172.21.15.42:0/24744023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e29fac1390 0x55e29feaf550 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb2580ba1f0 tx=0x7fb258005f90 comp rx=0 tx=0).stop 2024-09-17T01:39:53.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.078+0000 7fb275268740 1 -- 172.21.15.42:0/24744023 shutdown_connections 2024-09-17T01:39:53.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.078+0000 7fb275268740 1 --2- 172.21.15.42:0/24744023 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e29faa06b0 0x55e29fe92760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.078+0000 7fb275268740 1 --2- 172.21.15.42:0/24744023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29fa984d0 0x55e29fe92220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.078+0000 7fb275268740 1 --2- 172.21.15.42:0/24744023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e29fac1390 0x55e29feaf550 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.078+0000 7fb275268740 1 -- 172.21.15.42:0/24744023 >> 172.21.15.42:0/24744023 conn(0x55e29fab54e0 msgr2=0x55e29fe68440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:53.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.078+0000 7fb275268740 1 -- 172.21.15.42:0/24744023 shutdown_connections 2024-09-17T01:39:53.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.078+0000 7fb275268740 1 -- 172.21.15.42:0/24744023 wait complete. 2024-09-17T01:39:53.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.080+0000 7fb275268740 1 -- start start 2024-09-17T01:39:53.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.080+0000 7fb275268740 1 Processor -- start 2024-09-17T01:39:53.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.083+0000 7fb275268740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29fa984d0 0x55e29fe80940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:53.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.083+0000 7fb275268740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e29faa06b0 0x55e29fea94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:53.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.083+0000 7fb275268740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e29fac1390 0x55e29fe68110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:53.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.083+0000 7fb275268740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e29fd71410 con 0x55e29fa984d0 2024-09-17T01:39:53.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.083+0000 7fb275268740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e29fdceab0 con 0x55e29faa06b0 2024-09-17T01:39:53.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.083+0000 7fb275268740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55e29fb3b740 con 0x55e29fac1390 2024-09-17T01:39:53.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.083+0000 7fb275268740 10 client.0 _ll_register_callbacks cb 0x55e29fd4e360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:39:53.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.083+0000 7fb267400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29fa984d0 0x55e29fe80940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:53.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.083+0000 7fb267400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29fa984d0 0x55e29fe80940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45858/0 (socket says 172.21.15.42:45858) 2024-09-17T01:39:53.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.083+0000 7fb267400640 1 -- 172.21.15.42:0/241241860 learned_addr learned my addr 172.21.15.42:0/241241860 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:39:53.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.083+0000 7fb266a00640 1 --2- 172.21.15.42:0/241241860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e29faa06b0 0x55e29fea94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:53.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.084+0000 7fb267e00640 1 --2- 172.21.15.42:0/241241860 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e29fac1390 0x55e29fe68110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:53.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.084+0000 7fb267400640 1 -- 172.21.15.42:0/241241860 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e29fac1390 msgr2=0x55e29fe68110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:39:53.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.084+0000 7fb267400640 1 --2- 172.21.15.42:0/241241860 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e29fac1390 0x55e29fe68110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.084+0000 7fb267400640 1 -- 172.21.15.42:0/241241860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e29faa06b0 msgr2=0x55e29fea94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:39:53.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.084+0000 7fb267400640 1 --2- 172.21.15.42:0/241241860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e29faa06b0 0x55e29fea94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.084+0000 7fb267400640 1 -- 172.21.15.42:0/241241860 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e29fb2c970 con 0x55e29fa984d0 2024-09-17T01:39:53.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.084+0000 7fb266a00640 1 --2- 172.21.15.42:0/241241860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e29faa06b0 0x55e29fea94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:39:53.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.084+0000 7fb267400640 1 --2- 172.21.15.42:0/241241860 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29fa984d0 0x55e29fe80940 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fb258080190 tx=0x7fb258083120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7fde14279aade3b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:53.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.084+0000 7fb247e00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:39:53.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.084+0000 7fb247e00640 1 -- 172.21.15.42:0/241241860 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2580a2060 con 0x55e29fa984d0 2024-09-17T01:39:53.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.084+0000 7fb247e00640 1 -- 172.21.15.42:0/241241860 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 5825+0+0 (secure 0 0 0) 0x7fb258088260 con 0x55e29fa984d0 2024-09-17T01:39:53.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.084+0000 7fb275268740 1 -- 172.21.15.42:0/241241860 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb258083720 con 0x55e29fa984d0 2024-09-17T01:39:53.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.085+0000 7fb247e00640 1 -- 172.21.15.42:0/241241860 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fb25806f170 con 0x55e29fa984d0 2024-09-17T01:39:53.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.085+0000 7fb275268740 10 client.7854 fetch_fsmap learned FSMap version 89 2024-09-17T01:39:53.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.085+0000 7fb275268740 1 -- 172.21.15.42:0/241241860 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x55e29fb0a6a0 con 0x55e29fa984d0 2024-09-17T01:39:53.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.085+0000 7fb247e00640 1 -- 172.21.15.42:0/241241860 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb258083720 con 0x55e29fa984d0 2024-09-17T01:39:53.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.085+0000 7fb247e00640 1 -- 172.21.15.42:0/241241860 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 89) ==== 3502+0+0 (secure 0 0 0) 0x7fb25807f560 con 0x55e29fa984d0 2024-09-17T01:39:53.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.085+0000 7fb275268740 10 client.7854 fetch_fsmap finished waiting for FSMap version 89 2024-09-17T01:39:53.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.085+0000 7fb275268740 10 client.7854 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T01:39:53.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.085+0000 7fb275268740 20 client.7854 populate_metadata read hostname 'smithi042' 2024-09-17T01:39:53.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.085+0000 7fb275268740 1 --2- 172.21.15.42:0/241241860 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x55e29fa7ff60 0x55e29fea75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:53.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.085+0000 7fb275268740 4 client.7854 mds_command: new command op to 7644 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:39:53.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.085+0000 7fb275268740 1 -- 172.21.15.42:0/241241860 --> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e29fddd7c0 con 0x55e29fa7ff60 2024-09-17T01:39:53.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.086+0000 7fb266a00640 1 --2- 172.21.15.42:0/241241860 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x55e29fa7ff60 0x55e29fea75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:53.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.087+0000 7fb266a00640 1 --2- 172.21.15.42:0/241241860 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x55e29fa7ff60 0x55e29fea75f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6aa5d185ae5efad server_cookie=7c9b9815a3cf006c in_seq=0 out_seq=0 2024-09-17T01:39:53.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.087+0000 7fb247e00640 10 client.7854 ms_handle_connect on v2:172.21.15.42:6832/1078007521 2024-09-17T01:39:53.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.088+0000 7fb247e00640 1 -- 172.21.15.42:0/241241860 <== mds.0 v2:172.21.15.42:6832/1078007521 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e29fddd7c0 con 0x55e29fa7ff60 2024-09-17T01:39:53.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.088+0000 7fb247e00640 10 client.7854 handle_command_reply: tid=0 2024-09-17T01:39:53.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.089+0000 7fb275268740 1 client.7854 shutdown 2024-09-17T01:39:53.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.089+0000 7fb275268740 1 -- 172.21.15.42:0/241241860 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29fa984d0 msgr2=0x55e29fe80940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:53.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.089+0000 7fb275268740 1 --2- 172.21.15.42:0/241241860 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29fa984d0 0x55e29fe80940 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fb258080190 tx=0x7fb258083120 comp rx=0 tx=0).stop 2024-09-17T01:39:53.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.089+0000 7fb275268740 1 -- 172.21.15.42:0/241241860 shutdown_connections 2024-09-17T01:39:53.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.089+0000 7fb275268740 1 --2- 172.21.15.42:0/241241860 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x55e29fa7ff60 0x55e29fea75f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.089+0000 7fb275268740 1 --2- 172.21.15.42:0/241241860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e29faa06b0 0x55e29fea94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.089+0000 7fb275268740 1 --2- 172.21.15.42:0/241241860 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e29fac1390 0x55e29fe68110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.089+0000 7fb275268740 1 --2- 172.21.15.42:0/241241860 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29fa984d0 0x55e29fe80940 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.089+0000 7fb275268740 1 -- 172.21.15.42:0/241241860 >> 172.21.15.42:0/241241860 conn(0x55e29fab54e0 msgr2=0x55e29fe823f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:53.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.089+0000 7fb247e00640 0 client.7854 ms_handle_reset on v2:172.21.15.42:6832/1078007521 2024-09-17T01:39:53.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.089+0000 7fb275268740 1 -- 172.21.15.42:0/241241860 shutdown_connections 2024-09-17T01:39:53.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.089+0000 7fb275268740 1 -- 172.21.15.42:0/241241860 wait complete. 2024-09-17T01:39:53.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.090+0000 7fb275268740 20 client.7854 trim_cache size 0 max 16384 2024-09-17T01:39:53.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.113+0000 7fb275268740 1 Processor -- start 2024-09-17T01:39:53.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.113+0000 7fb275268740 1 -- start start 2024-09-17T01:39:53.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.114+0000 7fb275268740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e29fa984d0 0x55e29feb0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:53.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.114+0000 7fb275268740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29faa06b0 0x55e29fe61830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:53.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.115+0000 7fb275268740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e29fac1390 0x55e29fe61d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:53.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.115+0000 7fb275268740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e29fea66d0 con 0x55e29faa06b0 2024-09-17T01:39:53.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.115+0000 7fb275268740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb2682023a0 con 0x55e29fac1390 2024-09-17T01:39:53.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.115+0000 7fb275268740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb2682013e0 con 0x55e29fa984d0 2024-09-17T01:39:53.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.115+0000 7fb266a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29faa06b0 0x55e29fe61830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:53.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.115+0000 7fb266a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29faa06b0 0x55e29fe61830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45870/0 (socket says 172.21.15.42:45870) 2024-09-17T01:39:53.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.115+0000 7fb266a00640 1 -- 172.21.15.42:0/1661625338 learned_addr learned my addr 172.21.15.42:0/1661625338 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:39:53.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.115+0000 7fb267400640 1 --2- 172.21.15.42:0/1661625338 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e29fa984d0 0x55e29feb0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:53.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.115+0000 7fb267e00640 1 --2- 172.21.15.42:0/1661625338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e29fac1390 0x55e29fe61d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:53.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.115+0000 7fb266a00640 1 -- 172.21.15.42:0/1661625338 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e29fa984d0 msgr2=0x55e29feb0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:39:53.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.115+0000 7fb266a00640 1 --2- 172.21.15.42:0/1661625338 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e29fa984d0 0x55e29feb0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.115+0000 7fb266a00640 1 -- 172.21.15.42:0/1661625338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e29fac1390 msgr2=0x55e29fe61d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:39:53.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.115+0000 7fb266a00640 1 --2- 172.21.15.42:0/1661625338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e29fac1390 0x55e29fe61d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.115+0000 7fb266a00640 1 -- 172.21.15.42:0/1661625338 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e29fe64fa0 con 0x55e29faa06b0 2024-09-17T01:39:53.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.115+0000 7fb267400640 1 --2- 172.21.15.42:0/1661625338 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e29fa984d0 0x55e29feb0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:39:53.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.116+0000 7fb266a00640 1 --2- 172.21.15.42:0/1661625338 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29faa06b0 0x55e29fe61830 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x55e29fea8d60 tx=0x7fb254005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63967ca6cb4aea06 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:53.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.116+0000 7fb252a00640 1 -- 172.21.15.42:0/1661625338 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb254004220 con 0x55e29faa06b0 2024-09-17T01:39:53.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.116+0000 7fb252a00640 1 -- 172.21.15.42:0/1661625338 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2540043c0 con 0x55e29faa06b0 2024-09-17T01:39:53.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.116+0000 7fb252a00640 1 -- 172.21.15.42:0/1661625338 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25400fb90 con 0x55e29faa06b0 2024-09-17T01:39:53.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.117+0000 7fb275268740 1 -- 172.21.15.42:0/1661625338 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29faa06b0 msgr2=0x55e29fe61830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:53.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.117+0000 7fb275268740 1 --2- 172.21.15.42:0/1661625338 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29faa06b0 0x55e29fe61830 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x55e29fea8d60 tx=0x7fb254005f90 comp rx=0 tx=0).stop 2024-09-17T01:39:53.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.117+0000 7fb275268740 1 -- 172.21.15.42:0/1661625338 shutdown_connections 2024-09-17T01:39:53.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.117+0000 7fb275268740 1 --2- 172.21.15.42:0/1661625338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e29fac1390 0x55e29fe61d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.117+0000 7fb275268740 1 --2- 172.21.15.42:0/1661625338 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29faa06b0 0x55e29fe61830 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.117+0000 7fb275268740 1 --2- 172.21.15.42:0/1661625338 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e29fa984d0 0x55e29feb0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.117+0000 7fb275268740 1 -- 172.21.15.42:0/1661625338 >> 172.21.15.42:0/1661625338 conn(0x55e29fab54e0 msgr2=0x55e29fe92430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:53.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.117+0000 7fb275268740 1 -- 172.21.15.42:0/1661625338 shutdown_connections 2024-09-17T01:39:53.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.117+0000 7fb275268740 1 -- 172.21.15.42:0/1661625338 wait complete. 2024-09-17T01:39:53.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.119+0000 7fb275268740 1 -- start start 2024-09-17T01:39:53.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.119+0000 7fb275268740 1 Processor -- start 2024-09-17T01:39:53.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.120+0000 7fb275268740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e29fa984d0 0x55e29ff14b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:53.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.120+0000 7fb275268740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29faa06b0 0x55e29fe69120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:53.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.120+0000 7fb275268740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e29fac1390 0x55e29fe69660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:53.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.120+0000 7fb275268740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb268158120 con 0x55e29faa06b0 2024-09-17T01:39:53.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.120+0000 7fb275268740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb2681f9b90 con 0x55e29fac1390 2024-09-17T01:39:53.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.121+0000 7fb275268740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55e29fe801a0 con 0x55e29fa984d0 2024-09-17T01:39:53.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.121+0000 7fb275268740 10 client.0 _ll_register_callbacks cb 0x7fb25806e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:39:53.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.121+0000 7fb266a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29faa06b0 0x55e29fe69120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:53.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.121+0000 7fb266a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29faa06b0 0x55e29fe69120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45880/0 (socket says 172.21.15.42:45880) 2024-09-17T01:39:53.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.121+0000 7fb266a00640 1 -- 172.21.15.42:0/2809867415 learned_addr learned my addr 172.21.15.42:0/2809867415 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:39:53.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.121+0000 7fb267400640 1 --2- 172.21.15.42:0/2809867415 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e29fa984d0 0x55e29ff14b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:53.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.121+0000 7fb267e00640 1 --2- 172.21.15.42:0/2809867415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e29fac1390 0x55e29fe69660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:53.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.121+0000 7fb266a00640 1 -- 172.21.15.42:0/2809867415 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e29fa984d0 msgr2=0x55e29ff14b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:39:53.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.121+0000 7fb266a00640 1 --2- 172.21.15.42:0/2809867415 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e29fa984d0 0x55e29ff14b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.122+0000 7fb266a00640 1 -- 172.21.15.42:0/2809867415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e29fac1390 msgr2=0x55e29fe69660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:39:53.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.122+0000 7fb266a00640 1 --2- 172.21.15.42:0/2809867415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e29fac1390 0x55e29fe69660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.122+0000 7fb266a00640 1 -- 172.21.15.42:0/2809867415 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e29fea8b90 con 0x55e29faa06b0 2024-09-17T01:39:53.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.122+0000 7fb267400640 1 --2- 172.21.15.42:0/2809867415 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e29fa984d0 0x55e29ff14b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:39:53.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.122+0000 7fb267e00640 1 --2- 172.21.15.42:0/2809867415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e29fac1390 0x55e29fe69660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:39:53.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.122+0000 7fb266a00640 1 --2- 172.21.15.42:0/2809867415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29faa06b0 0x55e29fe69120 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x55e29fe633d0 tx=0x7fb254009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17d8e8d8e4060a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:53.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.122+0000 7fb247e00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:39:53.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.122+0000 7fb247e00640 1 -- 172.21.15.42:0/2809867415 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25400fb60 con 0x55e29faa06b0 2024-09-17T01:39:53.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.122+0000 7fb247e00640 1 -- 172.21.15.42:0/2809867415 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 5825+0+0 (secure 0 0 0) 0x7fb25400fd00 con 0x55e29faa06b0 2024-09-17T01:39:53.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.123+0000 7fb275268740 1 -- 172.21.15.42:0/2809867415 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2540043c0 con 0x55e29faa06b0 2024-09-17T01:39:53.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.123+0000 7fb247e00640 1 -- 172.21.15.42:0/2809867415 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fb2540047a0 con 0x55e29faa06b0 2024-09-17T01:39:53.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.123+0000 7fb275268740 10 client.7860 fetch_fsmap learned FSMap version 89 2024-09-17T01:39:53.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.123+0000 7fb275268740 1 -- 172.21.15.42:0/2809867415 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x55e29ff15b20 con 0x55e29faa06b0 2024-09-17T01:39:53.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.124+0000 7fb247e00640 1 -- 172.21.15.42:0/2809867415 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2540043c0 con 0x55e29faa06b0 2024-09-17T01:39:53.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.124+0000 7fb247e00640 1 -- 172.21.15.42:0/2809867415 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 89) ==== 3502+0+0 (secure 0 0 0) 0x7fb254004940 con 0x55e29faa06b0 2024-09-17T01:39:53.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.124+0000 7fb275268740 10 client.7860 fetch_fsmap finished waiting for FSMap version 89 2024-09-17T01:39:53.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.124+0000 7fb275268740 10 client.7860 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T01:39:53.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.124+0000 7fb275268740 20 client.7860 populate_metadata read hostname 'smithi042' 2024-09-17T01:39:53.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.124+0000 7fb275268740 1 --2- 172.21.15.42:0/2809867415 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x55e29ff15340 0x55e29ff2fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:53.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.124+0000 7fb275268740 4 client.7860 mds_command: new command op to 7644 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:39:53.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.124+0000 7fb275268740 1 -- 172.21.15.42:0/2809867415 --> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e29fdd9270 con 0x55e29ff15340 2024-09-17T01:39:53.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.124+0000 7fb267400640 1 --2- 172.21.15.42:0/2809867415 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x55e29ff15340 0x55e29ff2fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:53.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.125+0000 7fb267400640 1 --2- 172.21.15.42:0/2809867415 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x55e29ff15340 0x55e29ff2fcb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d77b75fa7712b76e server_cookie=31bf638dd1452760 in_seq=0 out_seq=0 2024-09-17T01:39:53.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.125+0000 7fb247e00640 10 client.7860 ms_handle_connect on v2:172.21.15.42:6832/1078007521 2024-09-17T01:39:53.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.126+0000 7fb247e00640 1 -- 172.21.15.42:0/2809867415 <== mds.0 v2:172.21.15.42:6832/1078007521 1 ==== command_reply(tid 0: 0 ) ==== 8+0+582 (crc 0 0 0) 0x55e29fdd9270 con 0x55e29ff15340 2024-09-17T01:39:53.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.126+0000 7fb247e00640 10 client.7860 handle_command_reply: tid=0 2024-09-17T01:39:53.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.126+0000 7fb275268740 1 client.7860 shutdown 2024-09-17T01:39:53.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.126+0000 7fb275268740 1 -- 172.21.15.42:0/2809867415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29faa06b0 msgr2=0x55e29fe69120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:53.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.126+0000 7fb275268740 1 --2- 172.21.15.42:0/2809867415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29faa06b0 0x55e29fe69120 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x55e29fe633d0 tx=0x7fb254009c60 comp rx=0 tx=0).stop 2024-09-17T01:39:53.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.127+0000 7fb275268740 1 -- 172.21.15.42:0/2809867415 shutdown_connections 2024-09-17T01:39:53.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.127+0000 7fb275268740 1 --2- 172.21.15.42:0/2809867415 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x55e29ff15340 0x55e29ff2fcb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.127+0000 7fb275268740 1 --2- 172.21.15.42:0/2809867415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e29fac1390 0x55e29fe69660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.127+0000 7fb275268740 1 --2- 172.21.15.42:0/2809867415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e29faa06b0 0x55e29fe69120 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.127+0000 7fb275268740 1 --2- 172.21.15.42:0/2809867415 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e29fa984d0 0x55e29ff14b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.127+0000 7fb275268740 1 -- 172.21.15.42:0/2809867415 >> 172.21.15.42:0/2809867415 conn(0x55e29fab54e0 msgr2=0x55e29fea7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:53.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.127+0000 7fb247e00640 0 client.7860 ms_handle_reset on v2:172.21.15.42:6832/1078007521 2024-09-17T01:39:53.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.127+0000 7fb275268740 1 -- 172.21.15.42:0/2809867415 shutdown_connections 2024-09-17T01:39:53.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.127+0000 7fb275268740 1 -- 172.21.15.42:0/2809867415 wait complete. 2024-09-17T01:39:53.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.127+0000 7fb275268740 20 client.7860 trim_cache size 0 max 16384 2024-09-17T01:39:53.127 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:39:53.127 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "scrub active (953 inodes in the stack)", 2024-09-17T01:39:53.127 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-09-17T01:39:53.127 INFO:teuthology.orchestra.run.smithi042.stdout: "909da9e5-b19e-4bd9-95a8-b659b6cca8bb": { 2024-09-17T01:39:53.127 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "~mds0", 2024-09-17T01:39:53.128 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "909da9e5-b19e-4bd9-95a8-b659b6cca8bb", 2024-09-17T01:39:53.128 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive" 2024-09-17T01:39:53.128 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:39:53.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:39:53.128 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_stats": { 2024-09-17T01:39:53.128 INFO:teuthology.orchestra.run.smithi042.stdout: "909da9e5-b19e-4bd9-95a8-b659b6cca8bb": { 2024-09-17T01:39:53.128 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:39:52.774771+0000", 2024-09-17T01:39:53.128 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "~mdsdir", 2024-09-17T01:39:53.128 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:39:53.128 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:39:53.128 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:39:53.128 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:39:53.129 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:39:53.129 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:39:53.129 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:39:53.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.128+0000 7fb26e200640 1 -- 172.21.15.42:0/3724679498 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb248078b90 msgr2=0x7fb24807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:53.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.128+0000 7fb26e200640 1 --2- 172.21.15.42:0/3724679498 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb248078b90 0x7fb24807b0a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb260004a30 tx=0x7fb2600019d0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.128+0000 7fb26e200640 1 -- 172.21.15.42:0/3724679498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb26806edf0 msgr2=0x7fb26809e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:53.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.128+0000 7fb26e200640 1 --2- 172.21.15.42:0/3724679498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb26806edf0 0x7fb26809e010 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fb258031000 tx=0x7fb258033c20 comp rx=0 tx=0).stop 2024-09-17T01:39:53.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.128+0000 7fb26e200640 1 -- 172.21.15.42:0/3724679498 shutdown_connections 2024-09-17T01:39:53.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.128+0000 7fb26e200640 1 --2- 172.21.15.42:0/3724679498 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb248078b90 0x7fb24807b0a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.128+0000 7fb26e200640 1 --2- 172.21.15.42:0/3724679498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb268161030 0x7fb2680b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.128+0000 7fb26e200640 1 --2- 172.21.15.42:0/3724679498 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb2680701c0 0x7fb26814d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.128+0000 7fb26e200640 1 --2- 172.21.15.42:0/3724679498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb26806edf0 0x7fb26809e010 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.128+0000 7fb26e200640 1 -- 172.21.15.42:0/3724679498 >> 172.21.15.42:0/3724679498 conn(0x7fb26806cf00 msgr2=0x7fb2680b5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:53.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.128+0000 7fb26e200640 1 -- 172.21.15.42:0/3724679498 shutdown_connections 2024-09-17T01:39:53.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:39:53.128+0000 7fb26e200640 1 -- 172.21.15.42:0/3724679498 wait complete. 2024-09-17T01:39:53.153 INFO:tasks.cephfs.filesystem:scrub status for tag:909da9e5-b19e-4bd9-95a8-b659b6cca8bb - {'path': '~mds0', 'tag': '909da9e5-b19e-4bd9-95a8-b659b6cca8bb', 'options': 'recursive'} 2024-09-17T01:40:20.577 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:40:20.583 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:40:23.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:40:23.154 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-17T01:40:23.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.398+0000 7f74eca00640 1 -- 172.21.15.42:0/588299047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74cc0053a0 msgr2=0x7f74cc00ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:23.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.398+0000 7f74eca00640 1 --2- 172.21.15.42:0/588299047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74cc0053a0 0x7f74cc00ba50 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f74e0001690 tx=0x7f74cc005830 comp rx=0 tx=0).stop 2024-09-17T01:40:23.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.398+0000 7f74eca00640 1 -- 172.21.15.42:0/588299047 shutdown_connections 2024-09-17T01:40:23.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.398+0000 7f74eca00640 1 --2- 172.21.15.42:0/588299047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74cc0053a0 0x7f74cc00ba50 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.398+0000 7f74eca00640 1 -- 172.21.15.42:0/588299047 >> 172.21.15.42:0/588299047 conn(0x7f74e806d440 msgr2=0x7f74e80b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:23.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.399+0000 7f74eca00640 1 -- 172.21.15.42:0/588299047 shutdown_connections 2024-09-17T01:40:23.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.399+0000 7f74eca00640 1 -- 172.21.15.42:0/588299047 wait complete. 2024-09-17T01:40:23.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.401+0000 7f74eca00640 1 Processor -- start 2024-09-17T01:40:23.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.401+0000 7f74eca00640 1 -- start start 2024-09-17T01:40:23.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.402+0000 7f74eca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74cc0053a0 0x7f74e809d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.402+0000 7f74eca00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74e81566b0 0x7f74e81553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.402+0000 7f74eca00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74e8156ac0 0x7f74e81f8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.403+0000 7f74eca00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f74e80b36c0 con 0x7f74cc0053a0 2024-09-17T01:40:23.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.403+0000 7f74eca00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f74e80b53a0 con 0x7f74e8156ac0 2024-09-17T01:40:23.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.403+0000 7f74eca00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f74e80b3840 con 0x7f74e81566b0 2024-09-17T01:40:23.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.403+0000 7f74e6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74cc0053a0 0x7f74e809d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.403+0000 7f74e6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74cc0053a0 0x7f74e809d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36774/0 (socket says 172.21.15.42:36774) 2024-09-17T01:40:23.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.403+0000 7f74e6800640 1 -- 172.21.15.42:0/4245290472 learned_addr learned my addr 172.21.15.42:0/4245290472 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:23.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.403+0000 7f74e7200640 1 --2- 172.21.15.42:0/4245290472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74e8156ac0 0x7f74e81f8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.403+0000 7f74dde00640 1 --2- 172.21.15.42:0/4245290472 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74e81566b0 0x7f74e81553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.403+0000 7f74e6800640 1 -- 172.21.15.42:0/4245290472 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74e81566b0 msgr2=0x7f74e81553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:23.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.403+0000 7f74e6800640 1 --2- 172.21.15.42:0/4245290472 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74e81566b0 0x7f74e81553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.403+0000 7f74e6800640 1 -- 172.21.15.42:0/4245290472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74e8156ac0 msgr2=0x7f74e81f8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:23.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.403+0000 7f74e6800640 1 --2- 172.21.15.42:0/4245290472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74e8156ac0 0x7f74e81f8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.403+0000 7f74e6800640 1 -- 172.21.15.42:0/4245290472 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e809c6a0 con 0x7f74cc0053a0 2024-09-17T01:40:23.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.404+0000 7f74e6800640 1 --2- 172.21.15.42:0/4245290472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74cc0053a0 0x7f74e809d740 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f74d8010bc0 tx=0x7f74d800e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:23.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.404+0000 7f74df400640 1 -- 172.21.15.42:0/4245290472 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d8016070 con 0x7f74cc0053a0 2024-09-17T01:40:23.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.404+0000 7f74df400640 1 -- 172.21.15.42:0/4245290472 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74d8003b70 con 0x7f74cc0053a0 2024-09-17T01:40:23.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.404+0000 7f74df400640 1 -- 172.21.15.42:0/4245290472 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d8004050 con 0x7f74cc0053a0 2024-09-17T01:40:23.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.404+0000 7f74eca00640 1 -- 172.21.15.42:0/4245290472 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e809c980 con 0x7f74cc0053a0 2024-09-17T01:40:23.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.404+0000 7f74eca00640 1 -- 172.21.15.42:0/4245290472 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e809cf40 con 0x7f74cc0053a0 2024-09-17T01:40:23.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.406+0000 7f74df400640 1 -- 172.21.15.42:0/4245290472 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f74d80041f0 con 0x7f74cc0053a0 2024-09-17T01:40:23.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.408+0000 7f74df400640 1 --2- 172.21.15.42:0/4245290472 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74c4078b90 0x7f74c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.408+0000 7f74df400640 1 -- 172.21.15.42:0/4245290472 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5853+0+0 (secure 0 0 0) 0x7f74d809bf50 con 0x7f74cc0053a0 2024-09-17T01:40:23.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.409+0000 7f74dde00640 1 --2- 172.21.15.42:0/4245290472 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74c4078b90 0x7f74c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.409+0000 7f74f4616740 1 Processor -- start 2024-09-17T01:40:23.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.409+0000 7f74f4616740 1 -- start start 2024-09-17T01:40:23.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.409+0000 7f74dde00640 1 --2- 172.21.15.42:0/4245290472 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74c4078b90 0x7f74c407b0a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f74e8157640 tx=0x7f74d00067a0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:23.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.410+0000 7f74f4616740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559644029390 0x559644417730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.410+0000 7f74f4616740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596440004d0 0x5596443fa400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.410+0000 7f74f4616740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596440086b0 0x5596443fa940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.410+0000 7f74f4616740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5596443301c0 con 0x5596440086b0 2024-09-17T01:40:23.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.410+0000 7f74f4616740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559644343870 con 0x559644029390 2024-09-17T01:40:23.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.410+0000 7f74f4616740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x559644332ca0 con 0x5596440004d0 2024-09-17T01:40:23.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.410+0000 7f74e7200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596440086b0 0x5596443fa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.410+0000 7f74e7200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596440086b0 0x5596443fa940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36778/0 (socket says 172.21.15.42:36778) 2024-09-17T01:40:23.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.410+0000 7f74e7200640 1 -- 172.21.15.42:0/382404520 learned_addr learned my addr 172.21.15.42:0/382404520 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:23.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.411+0000 7f74dde00640 1 --2- 172.21.15.42:0/382404520 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596440004d0 0x5596443fa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.411+0000 7f74e6800640 1 --2- 172.21.15.42:0/382404520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559644029390 0x559644417730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.411+0000 7f74e7200640 1 -- 172.21.15.42:0/382404520 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596440004d0 msgr2=0x5596443fa400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:40:23.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.411+0000 7f74e7200640 1 --2- 172.21.15.42:0/382404520 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596440004d0 0x5596443fa400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.411+0000 7f74e7200640 1 -- 172.21.15.42:0/382404520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559644029390 msgr2=0x559644417730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:40:23.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.411+0000 7f74e7200640 1 --2- 172.21.15.42:0/382404520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559644029390 0x559644417730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.411+0000 7f74e7200640 1 -- 172.21.15.42:0/382404520 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55964410b7d0 con 0x5596440086b0 2024-09-17T01:40:23.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.411+0000 7f74e7200640 1 --2- 172.21.15.42:0/382404520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596440086b0 0x5596443fa940 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f74e00017b0 tx=0x7f74e0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d61e0d8147491b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:23.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.411+0000 7f74d7000640 1 -- 172.21.15.42:0/382404520 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e0037070 con 0x5596440086b0 2024-09-17T01:40:23.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.412+0000 7f74d7000640 1 -- 172.21.15.42:0/382404520 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74e002e070 con 0x5596440086b0 2024-09-17T01:40:23.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.412+0000 7f74d7000640 1 -- 172.21.15.42:0/382404520 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e00037f0 con 0x5596440086b0 2024-09-17T01:40:23.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.412+0000 7f74f4616740 1 -- 172.21.15.42:0/382404520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596440086b0 msgr2=0x5596443fa940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:23.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.412+0000 7f74f4616740 1 --2- 172.21.15.42:0/382404520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596440086b0 0x5596443fa940 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f74e00017b0 tx=0x7f74e0001120 comp rx=0 tx=0).stop 2024-09-17T01:40:23.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.412+0000 7f74f4616740 1 -- 172.21.15.42:0/382404520 shutdown_connections 2024-09-17T01:40:23.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.412+0000 7f74f4616740 1 --2- 172.21.15.42:0/382404520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596440086b0 0x5596443fa940 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.412+0000 7f74f4616740 1 --2- 172.21.15.42:0/382404520 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596440004d0 0x5596443fa400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.412+0000 7f74f4616740 1 --2- 172.21.15.42:0/382404520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559644029390 0x559644417730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.412+0000 7f74f4616740 1 -- 172.21.15.42:0/382404520 >> 172.21.15.42:0/382404520 conn(0x55964401d4e0 msgr2=0x5596443d0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:23.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.413+0000 7f74f4616740 1 -- 172.21.15.42:0/382404520 shutdown_connections 2024-09-17T01:40:23.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.413+0000 7f74f4616740 1 -- 172.21.15.42:0/382404520 wait complete. 2024-09-17T01:40:23.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.414+0000 7f74f4616740 1 -- start start 2024-09-17T01:40:23.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.414+0000 7f74f4616740 1 Processor -- start 2024-09-17T01:40:23.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.415+0000 7f74f4616740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596440004d0 0x5596443e8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.415+0000 7f74f4616740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596440086b0 0x559644412240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.415+0000 7f74f4616740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559644029390 0x55964440ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.415+0000 7f74f4616740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5596442d9410 con 0x5596440004d0 2024-09-17T01:40:23.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.415+0000 7f74f4616740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559644336ab0 con 0x5596440086b0 2024-09-17T01:40:23.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.415+0000 7f74f4616740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5596440a3740 con 0x559644029390 2024-09-17T01:40:23.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.415+0000 7f74f4616740 10 client.0 _ll_register_callbacks cb 0x5596442b6360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:40:23.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.415+0000 7f74e6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596440004d0 0x5596443e8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.416+0000 7f74e6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596440004d0 0x5596443e8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36788/0 (socket says 172.21.15.42:36788) 2024-09-17T01:40:23.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.416+0000 7f74e6800640 1 -- 172.21.15.42:0/2072241235 learned_addr learned my addr 172.21.15.42:0/2072241235 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:23.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.416+0000 7f74dde00640 1 --2- 172.21.15.42:0/2072241235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596440086b0 0x559644412240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.416+0000 7f74e7200640 1 --2- 172.21.15.42:0/2072241235 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559644029390 0x55964440ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.416+0000 7f74e6800640 1 -- 172.21.15.42:0/2072241235 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559644029390 msgr2=0x55964440ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:40:23.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.416+0000 7f74e6800640 1 --2- 172.21.15.42:0/2072241235 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559644029390 0x55964440ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.416+0000 7f74e6800640 1 -- 172.21.15.42:0/2072241235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596440086b0 msgr2=0x559644412240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:40:23.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.416+0000 7f74e6800640 1 --2- 172.21.15.42:0/2072241235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596440086b0 0x559644412240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.416+0000 7f74e6800640 1 -- 172.21.15.42:0/2072241235 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559644094970 con 0x5596440004d0 2024-09-17T01:40:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.416+0000 7f74e6800640 1 --2- 172.21.15.42:0/2072241235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596440004d0 0x5596443e8410 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f74d800ebc0 tx=0x7f74d8064130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a35a1c8254aca68 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.416+0000 7f74cb400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:40:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.416+0000 7f74cb400640 1 -- 172.21.15.42:0/2072241235 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d804f020 con 0x5596440004d0 2024-09-17T01:40:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.416+0000 7f74cb400640 1 -- 172.21.15.42:0/2072241235 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 5853+0+0 (secure 0 0 0) 0x7f74d8063110 con 0x5596440004d0 2024-09-17T01:40:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.416+0000 7f74f4616740 1 -- 172.21.15.42:0/2072241235 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74e002e070 con 0x5596440004d0 2024-09-17T01:40:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.417+0000 7f74cb400640 1 -- 172.21.15.42:0/2072241235 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f74d8020070 con 0x5596440004d0 2024-09-17T01:40:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.417+0000 7f74f4616740 10 client.7872 fetch_fsmap learned FSMap version 89 2024-09-17T01:40:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.417+0000 7f74f4616740 1 -- 172.21.15.42:0/2072241235 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x5596440726a0 con 0x5596440004d0 2024-09-17T01:40:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.417+0000 7f74cb400640 1 -- 172.21.15.42:0/2072241235 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74e002e070 con 0x5596440004d0 2024-09-17T01:40:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.417+0000 7f74cb400640 1 -- 172.21.15.42:0/2072241235 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 89) ==== 3502+0+0 (secure 0 0 0) 0x7f74d800f040 con 0x5596440004d0 2024-09-17T01:40:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.417+0000 7f74f4616740 10 client.7872 fetch_fsmap finished waiting for FSMap version 89 2024-09-17T01:40:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.417+0000 7f74f4616740 10 client.7872 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T01:40:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.417+0000 7f74f4616740 20 client.7872 populate_metadata read hostname 'smithi042' 2024-09-17T01:40:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.417+0000 7f74f4616740 1 --2- 172.21.15.42:0/2072241235 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x559643fe7f60 0x55964440c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.417+0000 7f74f4616740 4 client.7872 mds_command: new command op to 7644 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:40:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.417+0000 7f74f4616740 1 -- 172.21.15.42:0/2072241235 --> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596443457c0 con 0x559643fe7f60 2024-09-17T01:40:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.417+0000 7f74dde00640 1 --2- 172.21.15.42:0/2072241235 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x559643fe7f60 0x55964440c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.418+0000 7f74dde00640 1 --2- 172.21.15.42:0/2072241235 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x559643fe7f60 0x55964440c3d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79ac6020e1067197 server_cookie=b2ef65aaba3ca92a in_seq=0 out_seq=0 2024-09-17T01:40:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.418+0000 7f74cb400640 10 client.7872 ms_handle_connect on v2:172.21.15.42:6832/1078007521 2024-09-17T01:40:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.419+0000 7f74cb400640 1 -- 172.21.15.42:0/2072241235 <== mds.0 v2:172.21.15.42:6832/1078007521 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5596443457c0 con 0x559643fe7f60 2024-09-17T01:40:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.419+0000 7f74cb400640 10 client.7872 handle_command_reply: tid=0 2024-09-17T01:40:23.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.419+0000 7f74f4616740 1 client.7872 shutdown 2024-09-17T01:40:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.419+0000 7f74f4616740 1 -- 172.21.15.42:0/2072241235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596440004d0 msgr2=0x5596443e8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.419+0000 7f74f4616740 1 --2- 172.21.15.42:0/2072241235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596440004d0 0x5596443e8410 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f74d800ebc0 tx=0x7f74d8064130 comp rx=0 tx=0).stop 2024-09-17T01:40:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.419+0000 7f74f4616740 1 -- 172.21.15.42:0/2072241235 shutdown_connections 2024-09-17T01:40:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.419+0000 7f74f4616740 1 --2- 172.21.15.42:0/2072241235 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x559643fe7f60 0x55964440c3d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.419+0000 7f74f4616740 1 --2- 172.21.15.42:0/2072241235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596440086b0 0x559644412240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.419+0000 7f74f4616740 1 --2- 172.21.15.42:0/2072241235 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559644029390 0x55964440ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.419+0000 7f74cb400640 0 client.7872 ms_handle_reset on v2:172.21.15.42:6832/1078007521 2024-09-17T01:40:23.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.419+0000 7f74f4616740 1 --2- 172.21.15.42:0/2072241235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596440004d0 0x5596443e8410 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.419+0000 7f74f4616740 1 -- 172.21.15.42:0/2072241235 >> 172.21.15.42:0/2072241235 conn(0x55964401d4e0 msgr2=0x5596443f70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:23.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.419+0000 7f74f4616740 1 -- 172.21.15.42:0/2072241235 shutdown_connections 2024-09-17T01:40:23.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.419+0000 7f74f4616740 1 -- 172.21.15.42:0/2072241235 wait complete. 2024-09-17T01:40:23.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.419+0000 7f74f4616740 20 client.7872 trim_cache size 0 max 16384 2024-09-17T01:40:23.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.438+0000 7f74f4616740 1 Processor -- start 2024-09-17T01:40:23.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.438+0000 7f74f4616740 1 -- start start 2024-09-17T01:40:23.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.440+0000 7f74f4616740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596440004d0 0x5596443f7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.440+0000 7f74f4616740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596440086b0 0x5596443d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.440+0000 7f74f4616740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559644029390 0x5596443d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.440+0000 7f74f4616740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f74e82028b0 con 0x5596440004d0 2024-09-17T01:40:23.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.440+0000 7f74f4616740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f74e8201890 con 0x559644029390 2024-09-17T01:40:23.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.440+0000 7f74f4616740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f74e81f6280 con 0x5596440086b0 2024-09-17T01:40:23.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.440+0000 7f74e6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596440004d0 0x5596443f7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.440+0000 7f74e6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596440004d0 0x5596443f7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36794/0 (socket says 172.21.15.42:36794) 2024-09-17T01:40:23.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.440+0000 7f74e6800640 1 -- 172.21.15.42:0/3182474874 learned_addr learned my addr 172.21.15.42:0/3182474874 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:23.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.440+0000 7f74e6800640 1 -- 172.21.15.42:0/3182474874 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596440086b0 msgr2=0x5596443d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:40:23.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.440+0000 7f74e6800640 1 --2- 172.21.15.42:0/3182474874 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596440086b0 0x5596443d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.440+0000 7f74e6800640 1 -- 172.21.15.42:0/3182474874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559644029390 msgr2=0x5596443d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:40:23.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.440+0000 7f74e6800640 1 --2- 172.21.15.42:0/3182474874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559644029390 0x5596443d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.440+0000 7f74e6800640 1 -- 172.21.15.42:0/3182474874 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596443cb5e0 con 0x5596440004d0 2024-09-17T01:40:23.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.440+0000 7f74e6800640 1 --2- 172.21.15.42:0/3182474874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596440004d0 0x5596443f7050 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f74d8004020 tx=0x7f74d8060310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e0bffe2137c5a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:23.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.441+0000 7f74d6600640 1 -- 172.21.15.42:0/3182474874 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d804f040 con 0x5596440004d0 2024-09-17T01:40:23.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.441+0000 7f74d6600640 1 -- 172.21.15.42:0/3182474874 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74d804f1e0 con 0x5596440004d0 2024-09-17T01:40:23.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.441+0000 7f74d6600640 1 -- 172.21.15.42:0/3182474874 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d80044e0 con 0x5596440004d0 2024-09-17T01:40:23.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.441+0000 7f74f4616740 1 -- 172.21.15.42:0/3182474874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596440004d0 msgr2=0x5596443f7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:23.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.441+0000 7f74f4616740 1 --2- 172.21.15.42:0/3182474874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596440004d0 0x5596443f7050 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f74d8004020 tx=0x7f74d8060310 comp rx=0 tx=0).stop 2024-09-17T01:40:23.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.441+0000 7f74f4616740 1 -- 172.21.15.42:0/3182474874 shutdown_connections 2024-09-17T01:40:23.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.441+0000 7f74f4616740 1 --2- 172.21.15.42:0/3182474874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559644029390 0x5596443d1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.441+0000 7f74f4616740 1 --2- 172.21.15.42:0/3182474874 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596440086b0 0x5596443d1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.441+0000 7f74f4616740 1 --2- 172.21.15.42:0/3182474874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5596440004d0 0x5596443f7050 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.441+0000 7f74f4616740 1 -- 172.21.15.42:0/3182474874 >> 172.21.15.42:0/3182474874 conn(0x55964401d4e0 msgr2=0x559644417ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.441+0000 7f74f4616740 1 -- 172.21.15.42:0/3182474874 shutdown_connections 2024-09-17T01:40:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.442+0000 7f74f4616740 1 -- 172.21.15.42:0/3182474874 wait complete. 2024-09-17T01:40:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.442+0000 7f74f4616740 1 -- start start 2024-09-17T01:40:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.443+0000 7f74f4616740 1 Processor -- start 2024-09-17T01:40:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.444+0000 7f74f4616740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596440004d0 0x559644417980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.444+0000 7f74f4616740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596440086b0 0x5596443d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.444+0000 7f74f4616740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559644029390 0x5596443d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.444+0000 7f74f4616740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5596443cf900 con 0x559644029390 2024-09-17T01:40:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.444+0000 7f74f4616740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f74e82011e0 con 0x5596440004d0 2024-09-17T01:40:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.444+0000 7f74f4616740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5596443e8bd0 con 0x5596440086b0 2024-09-17T01:40:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.444+0000 7f74f4616740 10 client.0 _ll_register_callbacks cb 0x7f74d8010b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:40:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.444+0000 7f74e7200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559644029390 0x5596443d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.444+0000 7f74e7200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559644029390 0x5596443d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36796/0 (socket says 172.21.15.42:36796) 2024-09-17T01:40:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.444+0000 7f74e7200640 1 -- 172.21.15.42:0/1057600120 learned_addr learned my addr 172.21.15.42:0/1057600120 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.445+0000 7f74e6800640 1 --2- 172.21.15.42:0/1057600120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596440004d0 0x559644417980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.445+0000 7f74dde00640 1 --2- 172.21.15.42:0/1057600120 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596440086b0 0x5596443d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.445+0000 7f74e7200640 1 -- 172.21.15.42:0/1057600120 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596440086b0 msgr2=0x5596443d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:40:23.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.445+0000 7f74e7200640 1 --2- 172.21.15.42:0/1057600120 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596440086b0 0x5596443d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.445+0000 7f74e7200640 1 -- 172.21.15.42:0/1057600120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596440004d0 msgr2=0x559644417980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:40:23.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.445+0000 7f74e7200640 1 --2- 172.21.15.42:0/1057600120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596440004d0 0x559644417980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.445+0000 7f74e7200640 1 -- 172.21.15.42:0/1057600120 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596443ca950 con 0x559644029390 2024-09-17T01:40:23.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.445+0000 7f74dde00640 1 --2- 172.21.15.42:0/1057600120 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596440086b0 0x5596443d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:40:23.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.445+0000 7f74e7200640 1 --2- 172.21.15.42:0/1057600120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559644029390 0x5596443d1a10 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f74e0005040 tx=0x7f74e00039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf279115e0e64a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:23.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.445+0000 7f74cb400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:40:23.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.445+0000 7f74cb400640 1 -- 172.21.15.42:0/1057600120 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e0037040 con 0x559644029390 2024-09-17T01:40:23.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.445+0000 7f74cb400640 1 -- 172.21.15.42:0/1057600120 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 5853+0+0 (secure 0 0 0) 0x7f74e0003c40 con 0x559644029390 2024-09-17T01:40:23.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.445+0000 7f74f4616740 1 -- 172.21.15.42:0/1057600120 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74d804f1e0 con 0x559644029390 2024-09-17T01:40:23.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.446+0000 7f74cb400640 1 -- 172.21.15.42:0/1057600120 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f74e0003e40 con 0x559644029390 2024-09-17T01:40:23.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.446+0000 7f74f4616740 10 client.7878 fetch_fsmap learned FSMap version 89 2024-09-17T01:40:23.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.446+0000 7f74f4616740 1 -- 172.21.15.42:0/1057600120 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x5596443d1300 con 0x559644029390 2024-09-17T01:40:23.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.446+0000 7f74cb400640 1 -- 172.21.15.42:0/1057600120 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74d804f1e0 con 0x559644029390 2024-09-17T01:40:23.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.446+0000 7f74cb400640 1 -- 172.21.15.42:0/1057600120 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 89) ==== 3502+0+0 (secure 0 0 0) 0x7f74e003c450 con 0x559644029390 2024-09-17T01:40:23.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.446+0000 7f74f4616740 10 client.7878 fetch_fsmap finished waiting for FSMap version 89 2024-09-17T01:40:23.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.446+0000 7f74f4616740 10 client.7878 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T01:40:23.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.446+0000 7f74f4616740 20 client.7878 populate_metadata read hostname 'smithi042' 2024-09-17T01:40:23.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.446+0000 7f74f4616740 1 --2- 172.21.15.42:0/1057600120 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x559644494070 0x559644494480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.446+0000 7f74f4616740 4 client.7878 mds_command: new command op to 7644 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:40:23.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.446+0000 7f74f4616740 1 -- 172.21.15.42:0/1057600120 --> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559644341270 con 0x559644494070 2024-09-17T01:40:23.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.446+0000 7f74e6800640 1 --2- 172.21.15.42:0/1057600120 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x559644494070 0x559644494480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.447+0000 7f74e6800640 1 --2- 172.21.15.42:0/1057600120 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x559644494070 0x559644494480 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdccb6f61ecfd6a2 server_cookie=d1156a09e5772bd9 in_seq=0 out_seq=0 2024-09-17T01:40:23.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.447+0000 7f74cb400640 10 client.7878 ms_handle_connect on v2:172.21.15.42:6832/1078007521 2024-09-17T01:40:23.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.447+0000 7f74cb400640 1 -- 172.21.15.42:0/1057600120 <== mds.0 v2:172.21.15.42:6832/1078007521 1 ==== command_reply(tid 0: 0 ) ==== 8+0+380 (crc 0 0 0) 0x559644341270 con 0x559644494070 2024-09-17T01:40:23.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.447+0000 7f74cb400640 10 client.7878 handle_command_reply: tid=0 2024-09-17T01:40:23.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.447+0000 7f74f4616740 1 client.7878 shutdown 2024-09-17T01:40:23.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.447+0000 7f74f4616740 1 -- 172.21.15.42:0/1057600120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559644029390 msgr2=0x5596443d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:23.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.447+0000 7f74f4616740 1 --2- 172.21.15.42:0/1057600120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559644029390 0x5596443d1a10 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f74e0005040 tx=0x7f74e00039d0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.447+0000 7f74f4616740 1 -- 172.21.15.42:0/1057600120 shutdown_connections 2024-09-17T01:40:23.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.447+0000 7f74f4616740 1 --2- 172.21.15.42:0/1057600120 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x559644494070 0x559644494480 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.447+0000 7f74f4616740 1 --2- 172.21.15.42:0/1057600120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559644029390 0x5596443d1a10 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.447+0000 7f74f4616740 1 --2- 172.21.15.42:0/1057600120 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5596440086b0 0x5596443d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.447+0000 7f74f4616740 1 --2- 172.21.15.42:0/1057600120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5596440004d0 0x559644417980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.447+0000 7f74f4616740 1 -- 172.21.15.42:0/1057600120 >> 172.21.15.42:0/1057600120 conn(0x55964401d4e0 msgr2=0x55964440b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:23.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.447+0000 7f74cb400640 0 client.7878 ms_handle_reset on v2:172.21.15.42:6832/1078007521 2024-09-17T01:40:23.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.448+0000 7f74f4616740 1 -- 172.21.15.42:0/1057600120 shutdown_connections 2024-09-17T01:40:23.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.448+0000 7f74f4616740 1 -- 172.21.15.42:0/1057600120 wait complete. 2024-09-17T01:40:23.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.448+0000 7f74f4616740 20 client.7878 trim_cache size 0 max 16384 2024-09-17T01:40:23.453 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:40:23.453 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-09-17T01:40:23.454 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {}, 2024-09-17T01:40:23.454 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_stats": { 2024-09-17T01:40:23.454 INFO:teuthology.orchestra.run.smithi042.stdout: "909da9e5-b19e-4bd9-95a8-b659b6cca8bb": { 2024-09-17T01:40:23.454 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:39:52.774771+0000", 2024-09-17T01:40:23.454 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "~mdsdir", 2024-09-17T01:40:23.454 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:40:23.454 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:40:23.454 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:40:23.455 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:40:23.455 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:23.455 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:23.455 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:40:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.448+0000 7f74eca00640 1 -- 172.21.15.42:0/4245290472 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74c4078b90 msgr2=0x7f74c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.448+0000 7f74eca00640 1 --2- 172.21.15.42:0/4245290472 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74c4078b90 0x7f74c407b0a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f74e8157640 tx=0x7f74d00067a0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.448+0000 7f74eca00640 1 -- 172.21.15.42:0/4245290472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74cc0053a0 msgr2=0x7f74e809d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.448+0000 7f74eca00640 1 --2- 172.21.15.42:0/4245290472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74cc0053a0 0x7f74e809d740 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f74d8010bc0 tx=0x7f74d800e6c0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.448+0000 7f74eca00640 1 -- 172.21.15.42:0/4245290472 shutdown_connections 2024-09-17T01:40:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.448+0000 7f74eca00640 1 --2- 172.21.15.42:0/4245290472 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74c4078b90 0x7f74c407b0a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.448+0000 7f74eca00640 1 --2- 172.21.15.42:0/4245290472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f74e8156ac0 0x7f74e81f8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.448+0000 7f74eca00640 1 --2- 172.21.15.42:0/4245290472 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74e81566b0 0x7f74e81553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.448+0000 7f74eca00640 1 --2- 172.21.15.42:0/4245290472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74cc0053a0 0x7f74e809d740 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.448+0000 7f74eca00640 1 -- 172.21.15.42:0/4245290472 >> 172.21.15.42:0/4245290472 conn(0x7f74e806d440 msgr2=0x7f74e80b0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.449+0000 7f74eca00640 1 -- 172.21.15.42:0/4245290472 shutdown_connections 2024-09-17T01:40:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.449+0000 7f74eca00640 1 -- 172.21.15.42:0/4245290472 wait complete. 2024-09-17T01:40:23.471 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T01:40:23.471 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 perf dump 2024-09-17T01:40:23.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.704+0000 7ff998000640 1 -- 172.21.15.42:0/4099111452 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff990142f40 msgr2=0x7ff990072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:23.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.704+0000 7ff998000640 1 --2- 172.21.15.42:0/4099111452 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff990142f40 0x7ff990072950 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7ff97c005fd0 tx=0x7ff97c02a540 comp rx=0 tx=0).stop 2024-09-17T01:40:23.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.705+0000 7ff998000640 1 -- 172.21.15.42:0/4099111452 shutdown_connections 2024-09-17T01:40:23.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.705+0000 7ff998000640 1 --2- 172.21.15.42:0/4099111452 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff990142f40 0x7ff990072950 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.705+0000 7ff998000640 1 --2- 172.21.15.42:0/4099111452 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9900b3550 0x7ff99015cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.705+0000 7ff998000640 1 -- 172.21.15.42:0/4099111452 >> 172.21.15.42:0/4099111452 conn(0x7ff9900b2930 msgr2=0x7ff99006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:23.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.705+0000 7ff998000640 1 -- 172.21.15.42:0/4099111452 shutdown_connections 2024-09-17T01:40:23.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.705+0000 7ff998000640 1 -- 172.21.15.42:0/4099111452 wait complete. 2024-09-17T01:40:23.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.707+0000 7ff998000640 1 Processor -- start 2024-09-17T01:40:23.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.707+0000 7ff998000640 1 -- start start 2024-09-17T01:40:23.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.708+0000 7ff998000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff990072e90 0x7ff990142430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.708+0000 7ff998000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9900b3550 0x7ff99013ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.708+0000 7ff998000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff990142f40 0x7ff99006f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.708+0000 7ff998000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff99006d7c0 con 0x7ff990072e90 2024-09-17T01:40:23.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.708+0000 7ff998000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff99006d640 con 0x7ff990142f40 2024-09-17T01:40:23.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.708+0000 7ff998000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff99006d940 con 0x7ff9900b3550 2024-09-17T01:40:23.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.709+0000 7ff995600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff990072e90 0x7ff990142430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.709+0000 7ff995600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff990072e90 0x7ff990142430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36806/0 (socket says 172.21.15.42:36806) 2024-09-17T01:40:23.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.709+0000 7ff995600640 1 -- 172.21.15.42:0/193599807 learned_addr learned my addr 172.21.15.42:0/193599807 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:23.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.709+0000 7ff994c00640 1 --2- 172.21.15.42:0/193599807 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9900b3550 0x7ff99013ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.709+0000 7ff995600640 1 -- 172.21.15.42:0/193599807 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9900b3550 msgr2=0x7ff99013ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:23.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.709+0000 7ff996000640 1 --2- 172.21.15.42:0/193599807 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff990142f40 0x7ff99006f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.709+0000 7ff995600640 1 --2- 172.21.15.42:0/193599807 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9900b3550 0x7ff99013ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.709+0000 7ff995600640 1 -- 172.21.15.42:0/193599807 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff990142f40 msgr2=0x7ff99006f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:23.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.709+0000 7ff995600640 1 --2- 172.21.15.42:0/193599807 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff990142f40 0x7ff99006f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.709+0000 7ff995600640 1 -- 172.21.15.42:0/193599807 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99013f220 con 0x7ff990072e90 2024-09-17T01:40:23.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.709+0000 7ff994c00640 1 --2- 172.21.15.42:0/193599807 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9900b3550 0x7ff99013ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:40:23.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.709+0000 7ff996000640 1 --2- 172.21.15.42:0/193599807 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff990142f40 0x7ff99006f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:40:23.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.709+0000 7ff995600640 1 --2- 172.21.15.42:0/193599807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff990072e90 0x7ff990142430 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7ff98400e790 tx=0x7ff98400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:23.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.710+0000 7ff98d600640 1 -- 172.21.15.42:0/193599807 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98400eea0 con 0x7ff990072e90 2024-09-17T01:40:23.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.710+0000 7ff98d600640 1 -- 172.21.15.42:0/193599807 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff98400cd50 con 0x7ff990072e90 2024-09-17T01:40:23.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.710+0000 7ff98d600640 1 -- 172.21.15.42:0/193599807 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff984010690 con 0x7ff990072e90 2024-09-17T01:40:23.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.710+0000 7ff998000640 1 -- 172.21.15.42:0/193599807 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff990073710 con 0x7ff990072e90 2024-09-17T01:40:23.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.710+0000 7ff998000640 1 -- 172.21.15.42:0/193599807 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff99013f9a0 con 0x7ff990072e90 2024-09-17T01:40:23.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.712+0000 7ff98d600640 1 -- 172.21.15.42:0/193599807 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff984010830 con 0x7ff990072e90 2024-09-17T01:40:23.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.713+0000 7ff98d600640 1 --2- 172.21.15.42:0/193599807 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff970078bc0 0x7ff97007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.713+0000 7ff98d600640 1 -- 172.21.15.42:0/193599807 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5853+0+0 (secure 0 0 0) 0x7ff98409b790 con 0x7ff990072e90 2024-09-17T01:40:23.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.714+0000 7ff994c00640 1 --2- 172.21.15.42:0/193599807 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff970078bc0 0x7ff97007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.714+0000 7ff99f1c2740 1 Processor -- start 2024-09-17T01:40:23.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.714+0000 7ff99f1c2740 1 -- start start 2024-09-17T01:40:23.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.714+0000 7ff994c00640 1 --2- 172.21.15.42:0/193599807 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff970078bc0 0x7ff97007b0d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff97c033000 tx=0x7ff97c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:23.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.715+0000 7ff99f1c2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0db390 0x559f7a4ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.715+0000 7ff99f1c2740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559f7a0b24d0 0x559f7a4ad370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.715+0000 7ff99f1c2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f7a0ba6b0 0x559f7a4ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.715+0000 7ff99f1c2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559f7a396c10 con 0x559f7a0db390 2024-09-17T01:40:23.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.715+0000 7ff99f1c2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559f7a3f59f0 con 0x559f7a0ba6b0 2024-09-17T01:40:23.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.715+0000 7ff99f1c2740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x559f7a3e4e20 con 0x559f7a0b24d0 2024-09-17T01:40:23.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.716+0000 7ff995600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0db390 0x559f7a4ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.716+0000 7ff995600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0db390 0x559f7a4ca6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36822/0 (socket says 172.21.15.42:36822) 2024-09-17T01:40:23.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.716+0000 7ff995600640 1 -- 172.21.15.42:0/2289515470 learned_addr learned my addr 172.21.15.42:0/2289515470 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:23.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.716+0000 7ff994c00640 1 --2- 172.21.15.42:0/2289515470 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559f7a0b24d0 0x559f7a4ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.716+0000 7ff996000640 1 --2- 172.21.15.42:0/2289515470 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f7a0ba6b0 0x559f7a4ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.716+0000 7ff995600640 1 -- 172.21.15.42:0/2289515470 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559f7a0b24d0 msgr2=0x559f7a4ad370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:40:23.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.716+0000 7ff995600640 1 --2- 172.21.15.42:0/2289515470 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559f7a0b24d0 0x559f7a4ad370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.716+0000 7ff995600640 1 -- 172.21.15.42:0/2289515470 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f7a0ba6b0 msgr2=0x559f7a4ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:40:23.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.716+0000 7ff995600640 1 --2- 172.21.15.42:0/2289515470 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f7a0ba6b0 0x559f7a4ad8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.716+0000 7ff995600640 1 -- 172.21.15.42:0/2289515470 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f7a1bd7d0 con 0x559f7a0db390 2024-09-17T01:40:23.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.716+0000 7ff995600640 1 --2- 172.21.15.42:0/2289515470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0db390 0x559f7a4ca6a0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7ff9840633c0 tx=0x7ff984062ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687edba59f12e1c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:23.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.716+0000 7ff981c00640 1 -- 172.21.15.42:0/2289515470 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff984089020 con 0x559f7a0db390 2024-09-17T01:40:23.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.717+0000 7ff981c00640 1 -- 172.21.15.42:0/2289515470 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff984067f10 con 0x559f7a0db390 2024-09-17T01:40:23.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.717+0000 7ff981c00640 1 -- 172.21.15.42:0/2289515470 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff984085da0 con 0x559f7a0db390 2024-09-17T01:40:23.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.717+0000 7ff99f1c2740 1 -- 172.21.15.42:0/2289515470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0db390 msgr2=0x559f7a4ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:23.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.717+0000 7ff99f1c2740 1 --2- 172.21.15.42:0/2289515470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0db390 0x559f7a4ca6a0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7ff9840633c0 tx=0x7ff984062ca0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.717+0000 7ff99f1c2740 1 -- 172.21.15.42:0/2289515470 shutdown_connections 2024-09-17T01:40:23.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.717+0000 7ff99f1c2740 1 --2- 172.21.15.42:0/2289515470 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f7a0ba6b0 0x559f7a4ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.717+0000 7ff99f1c2740 1 --2- 172.21.15.42:0/2289515470 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559f7a0b24d0 0x559f7a4ad370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.717+0000 7ff99f1c2740 1 --2- 172.21.15.42:0/2289515470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0db390 0x559f7a4ca6a0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.717+0000 7ff99f1c2740 1 -- 172.21.15.42:0/2289515470 >> 172.21.15.42:0/2289515470 conn(0x559f7a0cf4e0 msgr2=0x559f7a483590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:23.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.717+0000 7ff99f1c2740 1 -- 172.21.15.42:0/2289515470 shutdown_connections 2024-09-17T01:40:23.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.718+0000 7ff99f1c2740 1 -- 172.21.15.42:0/2289515470 wait complete. 2024-09-17T01:40:23.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.719+0000 7ff99f1c2740 1 -- start start 2024-09-17T01:40:23.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.719+0000 7ff99f1c2740 1 Processor -- start 2024-09-17T01:40:23.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.720+0000 7ff99f1c2740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559f7a0b24d0 0x559f7a4c5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.720+0000 7ff99f1c2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f7a0ba6b0 0x559f7a49ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.720+0000 7ff99f1c2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0db390 0x559f7a4c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.720+0000 7ff99f1c2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559f7a38a790 con 0x559f7a0db390 2024-09-17T01:40:23.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.720+0000 7ff99f1c2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559f7a3e8c30 con 0x559f7a0ba6b0 2024-09-17T01:40:23.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.720+0000 7ff99f1c2740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x559f7a155740 con 0x559f7a0b24d0 2024-09-17T01:40:23.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.720+0000 7ff99f1c2740 10 client.0 _ll_register_callbacks cb 0x559f7a39a260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:40:23.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.721+0000 7ff996000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0db390 0x559f7a4c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.721+0000 7ff995600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559f7a0b24d0 0x559f7a4c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.721+0000 7ff996000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0db390 0x559f7a4c46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36836/0 (socket says 172.21.15.42:36836) 2024-09-17T01:40:23.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.721+0000 7ff994c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f7a0ba6b0 0x559f7a49ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.721+0000 7ff996000640 1 -- 172.21.15.42:0/3796151457 learned_addr learned my addr 172.21.15.42:0/3796151457 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:23.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.721+0000 7ff996000640 1 -- 172.21.15.42:0/3796151457 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559f7a0b24d0 msgr2=0x559f7a4c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:40:23.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.721+0000 7ff996000640 1 --2- 172.21.15.42:0/3796151457 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559f7a0b24d0 0x559f7a4c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.721+0000 7ff996000640 1 -- 172.21.15.42:0/3796151457 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f7a0ba6b0 msgr2=0x559f7a49ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:40:23.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.721+0000 7ff996000640 1 --2- 172.21.15.42:0/3796151457 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f7a0ba6b0 0x559f7a49ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.721+0000 7ff996000640 1 -- 172.21.15.42:0/3796151457 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f7a1246a0 con 0x559f7a0db390 2024-09-17T01:40:23.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.721+0000 7ff996000640 1 --2- 172.21.15.42:0/3796151457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0db390 0x559f7a4c46a0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7ff98800f4b0 tx=0x7ff98800f970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e67580f8c15e91 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:23.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.721+0000 7ff976000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:40:23.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.722+0000 7ff976000640 1 -- 172.21.15.42:0/3796151457 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff988003b80 con 0x559f7a0db390 2024-09-17T01:40:23.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.722+0000 7ff976000640 1 -- 172.21.15.42:0/3796151457 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 5853+0+0 (secure 0 0 0) 0x7ff988003d20 con 0x559f7a0db390 2024-09-17T01:40:23.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.722+0000 7ff99f1c2740 1 -- 172.21.15.42:0/3796151457 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff984067f10 con 0x559f7a0db390 2024-09-17T01:40:23.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.722+0000 7ff976000640 1 -- 172.21.15.42:0/3796151457 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7ff988020050 con 0x559f7a0db390 2024-09-17T01:40:23.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.722+0000 7ff99f1c2740 10 client.7890 fetch_fsmap learned FSMap version 89 2024-09-17T01:40:23.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.722+0000 7ff99f1c2740 1 -- 172.21.15.42:0/3796151457 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x559f7a21df60 con 0x559f7a0db390 2024-09-17T01:40:23.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.722+0000 7ff976000640 1 -- 172.21.15.42:0/3796151457 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff984067f10 con 0x559f7a0db390 2024-09-17T01:40:23.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.722+0000 7ff976000640 1 -- 172.21.15.42:0/3796151457 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 89) ==== 3502+0+0 (secure 0 0 0) 0x7ff988023020 con 0x559f7a0db390 2024-09-17T01:40:23.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.723+0000 7ff99f1c2740 10 client.7890 fetch_fsmap finished waiting for FSMap version 89 2024-09-17T01:40:23.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.723+0000 7ff99f1c2740 10 client.7890 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T01:40:23.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.723+0000 7ff99f1c2740 20 client.7890 populate_metadata read hostname 'smithi042' 2024-09-17T01:40:23.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.723+0000 7ff99f1c2740 1 --2- 172.21.15.42:0/3796151457 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x559f7a099f60 0x559f7a4bf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.723+0000 7ff99f1c2740 4 client.7890 mds_command: new command op to 7644 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:40:23.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.723+0000 7ff99f1c2740 1 -- 172.21.15.42:0/3796151457 --> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f7a3f7940 con 0x559f7a099f60 2024-09-17T01:40:23.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.723+0000 7ff995600640 1 --2- 172.21.15.42:0/3796151457 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x559f7a099f60 0x559f7a4bf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.723+0000 7ff995600640 1 --2- 172.21.15.42:0/3796151457 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x559f7a099f60 0x559f7a4bf6b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86fa03d5f43df3db server_cookie=ad1e1132ed80d082 in_seq=0 out_seq=0 2024-09-17T01:40:23.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.723+0000 7ff976000640 10 client.7890 ms_handle_connect on v2:172.21.15.42:6832/1078007521 2024-09-17T01:40:23.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.724+0000 7ff976000640 1 -- 172.21.15.42:0/3796151457 <== mds.0 v2:172.21.15.42:6832/1078007521 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559f7a3f7940 con 0x559f7a099f60 2024-09-17T01:40:23.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.724+0000 7ff976000640 10 client.7890 handle_command_reply: tid=0 2024-09-17T01:40:23.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.724+0000 7ff99f1c2740 1 client.7890 shutdown 2024-09-17T01:40:23.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.724+0000 7ff99f1c2740 1 -- 172.21.15.42:0/3796151457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0db390 msgr2=0x559f7a4c46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:23.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.724+0000 7ff99f1c2740 1 --2- 172.21.15.42:0/3796151457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0db390 0x559f7a4c46a0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7ff98800f4b0 tx=0x7ff98800f970 comp rx=0 tx=0).stop 2024-09-17T01:40:23.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.725+0000 7ff99f1c2740 1 -- 172.21.15.42:0/3796151457 shutdown_connections 2024-09-17T01:40:23.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.725+0000 7ff99f1c2740 1 --2- 172.21.15.42:0/3796151457 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x559f7a099f60 0x559f7a4bf6b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.725+0000 7ff99f1c2740 1 --2- 172.21.15.42:0/3796151457 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f7a0ba6b0 0x559f7a49ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.725+0000 7ff99f1c2740 1 --2- 172.21.15.42:0/3796151457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0db390 0x559f7a4c46a0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.725+0000 7ff99f1c2740 1 --2- 172.21.15.42:0/3796151457 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559f7a0b24d0 0x559f7a4c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.725+0000 7ff976000640 0 client.7890 ms_handle_reset on v2:172.21.15.42:6832/1078007521 2024-09-17T01:40:23.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.725+0000 7ff99f1c2740 1 -- 172.21.15.42:0/3796151457 >> 172.21.15.42:0/3796151457 conn(0x559f7a0cf4e0 msgr2=0x559f7a4cb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:23.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.725+0000 7ff99f1c2740 1 -- 172.21.15.42:0/3796151457 shutdown_connections 2024-09-17T01:40:23.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.725+0000 7ff99f1c2740 1 -- 172.21.15.42:0/3796151457 wait complete. 2024-09-17T01:40:23.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.725+0000 7ff99f1c2740 20 client.7890 trim_cache size 0 max 16384 2024-09-17T01:40:23.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.743+0000 7ff99f1c2740 1 Processor -- start 2024-09-17T01:40:23.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.743+0000 7ff99f1c2740 1 -- start start 2024-09-17T01:40:23.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.744+0000 7ff99f1c2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0b24d0 0x559f7a4da5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.744+0000 7ff99f1c2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f7a0ba6b0 0x559f7a4c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.744+0000 7ff99f1c2740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559f7a0db390 0x559f7a484270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.744+0000 7ff99f1c2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff990202620 con 0x559f7a0b24d0 2024-09-17T01:40:23.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.744+0000 7ff99f1c2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff990201600 con 0x559f7a0ba6b0 2024-09-17T01:40:23.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.744+0000 7ff99f1c2740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff9901f6130 con 0x559f7a0db390 2024-09-17T01:40:23.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.744+0000 7ff995600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0b24d0 0x559f7a4da5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.745+0000 7ff995600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0b24d0 0x559f7a4da5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36848/0 (socket says 172.21.15.42:36848) 2024-09-17T01:40:23.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.745+0000 7ff995600640 1 -- 172.21.15.42:0/502506658 learned_addr learned my addr 172.21.15.42:0/502506658 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:23.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.745+0000 7ff994c00640 1 --2- 172.21.15.42:0/502506658 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f7a0ba6b0 0x559f7a4c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.745+0000 7ff996000640 1 --2- 172.21.15.42:0/502506658 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559f7a0db390 0x559f7a484270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.745+0000 7ff995600640 1 -- 172.21.15.42:0/502506658 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559f7a0db390 msgr2=0x559f7a484270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:40:23.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.745+0000 7ff995600640 1 --2- 172.21.15.42:0/502506658 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559f7a0db390 0x559f7a484270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.745+0000 7ff995600640 1 -- 172.21.15.42:0/502506658 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f7a0ba6b0 msgr2=0x559f7a4c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:40:23.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.745+0000 7ff995600640 1 --2- 172.21.15.42:0/502506658 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f7a0ba6b0 0x559f7a4c8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.745+0000 7ff995600640 1 -- 172.21.15.42:0/502506658 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f7a1bbad0 con 0x559f7a0b24d0 2024-09-17T01:40:23.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.745+0000 7ff996000640 1 --2- 172.21.15.42:0/502506658 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559f7a0db390 0x559f7a484270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:40:23.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.745+0000 7ff994c00640 1 --2- 172.21.15.42:0/502506658 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f7a0ba6b0 0x559f7a4c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:40:23.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.745+0000 7ff995600640 1 --2- 172.21.15.42:0/502506658 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0b24d0 0x559f7a4da5b0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7ff984062d10 tx=0x7ff984062ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5941242da2596173 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:23.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.745+0000 7ff981200640 1 -- 172.21.15.42:0/502506658 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff984089040 con 0x559f7a0b24d0 2024-09-17T01:40:23.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.745+0000 7ff981200640 1 -- 172.21.15.42:0/502506658 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff984062690 con 0x559f7a0b24d0 2024-09-17T01:40:23.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.745+0000 7ff981200640 1 -- 172.21.15.42:0/502506658 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff984010b20 con 0x559f7a0b24d0 2024-09-17T01:40:23.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.746+0000 7ff99f1c2740 1 -- 172.21.15.42:0/502506658 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0b24d0 msgr2=0x559f7a4da5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:23.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.746+0000 7ff99f1c2740 1 --2- 172.21.15.42:0/502506658 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0b24d0 0x559f7a4da5b0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7ff984062d10 tx=0x7ff984062ca0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.746+0000 7ff99f1c2740 1 -- 172.21.15.42:0/502506658 shutdown_connections 2024-09-17T01:40:23.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.746+0000 7ff99f1c2740 1 --2- 172.21.15.42:0/502506658 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f7a0ba6b0 0x559f7a4c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.746+0000 7ff99f1c2740 1 --2- 172.21.15.42:0/502506658 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559f7a0db390 0x559f7a484270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.746+0000 7ff99f1c2740 1 --2- 172.21.15.42:0/502506658 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0b24d0 0x559f7a4da5b0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.746+0000 7ff99f1c2740 1 -- 172.21.15.42:0/502506658 >> 172.21.15.42:0/502506658 conn(0x559f7a0cf4e0 msgr2=0x559f7a4c08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:23.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.746+0000 7ff99f1c2740 1 -- 172.21.15.42:0/502506658 shutdown_connections 2024-09-17T01:40:23.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.746+0000 7ff99f1c2740 1 -- 172.21.15.42:0/502506658 wait complete. 2024-09-17T01:40:23.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.747+0000 7ff99f1c2740 1 -- start start 2024-09-17T01:40:23.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.748+0000 7ff99f1c2740 1 Processor -- start 2024-09-17T01:40:23.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.749+0000 7ff99f1c2740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559f7a0b24d0 0x559f7a53e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.749+0000 7ff99f1c2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0ba6b0 0x559f7a484270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.749+0000 7ff99f1c2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f7a0db390 0x559f7a4847b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.749+0000 7ff99f1c2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559f7a4a9ae0 con 0x559f7a0ba6b0 2024-09-17T01:40:23.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.749+0000 7ff99f1c2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff990200fc0 con 0x559f7a0db390 2024-09-17T01:40:23.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.749+0000 7ff99f1c2740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x559f7a4c06a0 con 0x559f7a0b24d0 2024-09-17T01:40:23.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.749+0000 7ff99f1c2740 10 client.0 _ll_register_callbacks cb 0x7ff988001520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:40:23.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.749+0000 7ff994c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0ba6b0 0x559f7a484270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.749+0000 7ff994c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0ba6b0 0x559f7a484270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36864/0 (socket says 172.21.15.42:36864) 2024-09-17T01:40:23.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.749+0000 7ff994c00640 1 -- 172.21.15.42:0/354688698 learned_addr learned my addr 172.21.15.42:0/354688698 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:23.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.750+0000 7ff995600640 1 --2- 172.21.15.42:0/354688698 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559f7a0b24d0 0x559f7a53e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.750+0000 7ff996000640 1 --2- 172.21.15.42:0/354688698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f7a0db390 0x559f7a4847b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.750+0000 7ff994c00640 1 -- 172.21.15.42:0/354688698 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559f7a0b24d0 msgr2=0x559f7a53e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:40:23.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.750+0000 7ff994c00640 1 --2- 172.21.15.42:0/354688698 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559f7a0b24d0 0x559f7a53e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.750+0000 7ff994c00640 1 -- 172.21.15.42:0/354688698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f7a0db390 msgr2=0x559f7a4847b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:40:23.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.750+0000 7ff994c00640 1 --2- 172.21.15.42:0/354688698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f7a0db390 0x559f7a4847b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.750+0000 7ff994c00640 1 -- 172.21.15.42:0/354688698 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f7a4aa740 con 0x559f7a0ba6b0 2024-09-17T01:40:23.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.750+0000 7ff995600640 1 --2- 172.21.15.42:0/354688698 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559f7a0b24d0 0x559f7a53e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:40:23.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.750+0000 7ff994c00640 1 --2- 172.21.15.42:0/354688698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0ba6b0 0x559f7a484270 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7ff97c0099c0 tx=0x7ff97c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a33066e2f32838 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:23.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.750+0000 7ff976000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:40:23.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.750+0000 7ff976000640 1 -- 172.21.15.42:0/354688698 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c035050 con 0x559f7a0ba6b0 2024-09-17T01:40:23.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.750+0000 7ff976000640 1 -- 172.21.15.42:0/354688698 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 5853+0+0 (secure 0 0 0) 0x7ff97c0047a0 con 0x559f7a0ba6b0 2024-09-17T01:40:23.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.750+0000 7ff99f1c2740 1 -- 172.21.15.42:0/354688698 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff984062690 con 0x559f7a0ba6b0 2024-09-17T01:40:23.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.751+0000 7ff976000640 1 -- 172.21.15.42:0/354688698 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7ff97c057050 con 0x559f7a0ba6b0 2024-09-17T01:40:23.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.751+0000 7ff99f1c2740 10 client.7896 fetch_fsmap learned FSMap version 89 2024-09-17T01:40:23.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.751+0000 7ff99f1c2740 1 -- 172.21.15.42:0/354688698 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x559f7a4aa1d0 con 0x559f7a0ba6b0 2024-09-17T01:40:23.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.751+0000 7ff976000640 1 -- 172.21.15.42:0/354688698 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff984062690 con 0x559f7a0ba6b0 2024-09-17T01:40:23.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.751+0000 7ff976000640 1 -- 172.21.15.42:0/354688698 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 89) ==== 3502+0+0 (secure 0 0 0) 0x7ff97c05a020 con 0x559f7a0ba6b0 2024-09-17T01:40:23.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.751+0000 7ff99f1c2740 10 client.7896 fetch_fsmap finished waiting for FSMap version 89 2024-09-17T01:40:23.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.751+0000 7ff99f1c2740 10 client.7896 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T01:40:23.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.751+0000 7ff99f1c2740 20 client.7896 populate_metadata read hostname 'smithi042' 2024-09-17T01:40:23.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.751+0000 7ff99f1c2740 1 --2- 172.21.15.42:0/354688698 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x559f7a4eb780 0x559f7a49bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:23.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.751+0000 7ff99f1c2740 4 client.7896 mds_command: new command op to 7644 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-17T01:40:23.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.751+0000 7ff99f1c2740 1 -- 172.21.15.42:0/354688698 --> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] -- command(tid 0: {"prefix": "perf dump"}) -- 0x559f7a3f33f0 con 0x559f7a4eb780 2024-09-17T01:40:23.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.751+0000 7ff995600640 1 --2- 172.21.15.42:0/354688698 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x559f7a4eb780 0x559f7a49bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:23.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.752+0000 7ff995600640 1 --2- 172.21.15.42:0/354688698 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x559f7a4eb780 0x559f7a49bea0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e48db7a696077cf server_cookie=2b5545c6295b2cfb in_seq=0 out_seq=0 2024-09-17T01:40:23.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.752+0000 7ff976000640 10 client.7896 ms_handle_connect on v2:172.21.15.42:6832/1078007521 2024-09-17T01:40:23.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.752+0000 7ff976000640 1 -- 172.21.15.42:0/354688698 <== mds.0 v2:172.21.15.42:6832/1078007521 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18104 (crc 0 0 0) 0x559f7a3f33f0 con 0x559f7a4eb780 2024-09-17T01:40:23.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.752+0000 7ff976000640 10 client.7896 handle_command_reply: tid=0 2024-09-17T01:40:23.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.753+0000 7ff99f1c2740 1 client.7896 shutdown 2024-09-17T01:40:23.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.753+0000 7ff99f1c2740 1 -- 172.21.15.42:0/354688698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0ba6b0 msgr2=0x559f7a484270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:23.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.753+0000 7ff99f1c2740 1 --2- 172.21.15.42:0/354688698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0ba6b0 0x559f7a484270 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7ff97c0099c0 tx=0x7ff97c009260 comp rx=0 tx=0).stop 2024-09-17T01:40:23.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.753+0000 7ff99f1c2740 1 -- 172.21.15.42:0/354688698 shutdown_connections 2024-09-17T01:40:23.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.753+0000 7ff99f1c2740 1 --2- 172.21.15.42:0/354688698 >> [v2:172.21.15.42:6832/1078007521,v1:172.21.15.42:6834/1078007521] conn(0x559f7a4eb780 0x559f7a49bea0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.753+0000 7ff99f1c2740 1 --2- 172.21.15.42:0/354688698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f7a0db390 0x559f7a4847b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.753+0000 7ff99f1c2740 1 --2- 172.21.15.42:0/354688698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559f7a0ba6b0 0x559f7a484270 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.753+0000 7ff99f1c2740 1 --2- 172.21.15.42:0/354688698 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x559f7a0b24d0 0x559f7a53e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.753+0000 7ff99f1c2740 1 -- 172.21.15.42:0/354688698 >> 172.21.15.42:0/354688698 conn(0x559f7a0cf4e0 msgr2=0x559f7a4c0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:23.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.753+0000 7ff976000640 0 client.7896 ms_handle_reset on v2:172.21.15.42:6832/1078007521 2024-09-17T01:40:23.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.753+0000 7ff99f1c2740 1 -- 172.21.15.42:0/354688698 shutdown_connections 2024-09-17T01:40:23.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.753+0000 7ff99f1c2740 1 -- 172.21.15.42:0/354688698 wait complete. 2024-09-17T01:40:23.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.753+0000 7ff99f1c2740 20 client.7896 trim_cache size 0 max 16384 2024-09-17T01:40:23.764 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:40:23.764 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-0": { 2024-09-17T01:40:23.765 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 28790, 2024-09-17T01:40:23.765 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 50956, 2024-09-17T01:40:23.765 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 9900703, 2024-09-17T01:40:23.765 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 49009121, 2024-09-17T01:40:23.765 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 19, 2024-09-17T01:40:23.766 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 6, 2024-09-17T01:40:23.766 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 4.824720051, 2024-09-17T01:40:23.766 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 3.465595808, 2024-09-17T01:40:23.766 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 2.131732895, 2024-09-17T01:40:23.766 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.286082503, 2024-09-17T01:40:23.766 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T01:40:23.766 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 50955, 2024-09-17T01:40:23.767 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 1.942331477, 2024-09-17T01:40:23.767 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000038118 2024-09-17T01:40:23.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.767 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-17T01:40:23.767 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 46978, 2024-09-17T01:40:23.767 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.011362649, 2024-09-17T01:40:23.768 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000241 2024-09-17T01:40:23.768 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.768 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 1872, 2024-09-17T01:40:23.769 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 448 2024-09-17T01:40:23.769 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.769 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-1": { 2024-09-17T01:40:23.771 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 2567, 2024-09-17T01:40:23.771 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 2592, 2024-09-17T01:40:23.771 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 1034576, 2024-09-17T01:40:23.771 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 33700974, 2024-09-17T01:40:23.771 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 6, 2024-09-17T01:40:23.771 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 4, 2024-09-17T01:40:23.772 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.603842735, 2024-09-17T01:40:23.772 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.219935406, 2024-09-17T01:40:23.772 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.064281683, 2024-09-17T01:40:23.772 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.296708817, 2024-09-17T01:40:23.772 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T01:40:23.772 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2590, 2024-09-17T01:40:23.772 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.503471813, 2024-09-17T01:40:23.772 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000194390 2024-09-17T01:40:23.772 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.772 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-17T01:40:23.772 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:40:23.772 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:40:23.772 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:40:23.773 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.773 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-17T01:40:23.773 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 130752 2024-09-17T01:40:23.773 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.773 INFO:teuthology.orchestra.run.smithi042.stdout: "AsyncMessenger::Worker-2": { 2024-09-17T01:40:23.773 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_messages": 3977, 2024-09-17T01:40:23.773 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages": 3972, 2024-09-17T01:40:23.773 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_bytes": 1115823, 2024-09-17T01:40:23.773 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_bytes": 31592702, 2024-09-17T01:40:23.773 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_created_connections": 5, 2024-09-17T01:40:23.773 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_active_connections": 4, 2024-09-17T01:40:23.773 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_total_time": 0.520949381, 2024-09-17T01:40:23.773 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_send_time": 0.274046506, 2024-09-17T01:40:23.774 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_recv_time": 0.109746453, 2024-09-17T01:40:23.774 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_running_fast_dispatch_time": 0.118557371, 2024-09-17T01:40:23.774 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_messages_queue_lat": { 2024-09-17T01:40:23.774 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 3972, 2024-09-17T01:40:23.774 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.828435841, 2024-09-17T01:40:23.774 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000208568 2024-09-17T01:40:23.774 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.774 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_handle_ack_lat": { 2024-09-17T01:40:23.774 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:40:23.774 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:40:23.774 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:40:23.774 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.775 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_recv_encrypted_bytes": 135568, 2024-09-17T01:40:23.775 INFO:teuthology.orchestra.run.smithi042.stdout: "msgr_send_encrypted_bytes": 29008 2024-09-17T01:40:23.775 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.775 INFO:teuthology.orchestra.run.smithi042.stdout: "cct": { 2024-09-17T01:40:23.775 INFO:teuthology.orchestra.run.smithi042.stdout: "total_workers": 1, 2024-09-17T01:40:23.775 INFO:teuthology.orchestra.run.smithi042.stdout: "unhealthy_workers": 0 2024-09-17T01:40:23.775 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.775 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-MDSRank": { 2024-09-17T01:40:23.775 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2024-09-17T01:40:23.775 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2024-09-17T01:40:23.775 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1914, 2024-09-17T01:40:23.776 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 18.508727988, 2024-09-17T01:40:23.776 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.009670181 2024-09-17T01:40:23.776 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:23.776 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.776 INFO:teuthology.orchestra.run.smithi042.stdout: "finisher-PurgeQueue": { 2024-09-17T01:40:23.776 INFO:teuthology.orchestra.run.smithi042.stdout: "queue_len": 0, 2024-09-17T01:40:23.776 INFO:teuthology.orchestra.run.smithi042.stdout: "complete_latency": { 2024-09-17T01:40:23.776 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 3584, 2024-09-17T01:40:23.776 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 1.465979509, 2024-09-17T01:40:23.776 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000409034 2024-09-17T01:40:23.776 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:23.777 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.777 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": { 2024-09-17T01:40:23.777 INFO:teuthology.orchestra.run.smithi042.stdout: "request": 25584, 2024-09-17T01:40:23.777 INFO:teuthology.orchestra.run.smithi042.stdout: "reply": 25584, 2024-09-17T01:40:23.777 INFO:teuthology.orchestra.run.smithi042.stdout: "reply_latency": { 2024-09-17T01:40:23.777 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 25584, 2024-09-17T01:40:23.777 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 381.369942511, 2024-09-17T01:40:23.777 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.014906579 2024-09-17T01:40:23.777 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.777 INFO:teuthology.orchestra.run.smithi042.stdout: "slow_reply": 0, 2024-09-17T01:40:23.777 INFO:teuthology.orchestra.run.smithi042.stdout: "forward": 0, 2024-09-17T01:40:23.777 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch_complete": 0, 2024-09-17T01:40:23.778 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_fetch_keys": 0, 2024-09-17T01:40:23.778 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_commit": 12, 2024-09-17T01:40:23.778 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_split": 0, 2024-09-17T01:40:23.778 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_merge": 0, 2024-09-17T01:40:23.778 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes": 17886, 2024-09-17T01:40:23.778 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_top": 0, 2024-09-17T01:40:23.778 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_bottom": 17886, 2024-09-17T01:40:23.778 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pin_tail": 0, 2024-09-17T01:40:23.778 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_pinned": 17885, 2024-09-17T01:40:23.778 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_expired": 0, 2024-09-17T01:40:23.778 INFO:teuthology.orchestra.run.smithi042.stdout: "inodes_with_caps": 2, 2024-09-17T01:40:23.779 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": 2, 2024-09-17T01:40:23.779 INFO:teuthology.orchestra.run.smithi042.stdout: "subtrees": 2, 2024-09-17T01:40:23.780 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse": 48218, 2024-09-17T01:40:23.780 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_hit": 47649, 2024-09-17T01:40:23.780 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_forward": 0, 2024-09-17T01:40:23.780 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_discover": 0, 2024-09-17T01:40:23.780 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_dir_fetch": 0, 2024-09-17T01:40:23.780 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_remote_ino": 0, 2024-09-17T01:40:23.780 INFO:teuthology.orchestra.run.smithi042.stdout: "traverse_lock": 110, 2024-09-17T01:40:23.780 INFO:teuthology.orchestra.run.smithi042.stdout: "load_cent": 0, 2024-09-17T01:40:23.780 INFO:teuthology.orchestra.run.smithi042.stdout: "q": 0, 2024-09-17T01:40:23.780 INFO:teuthology.orchestra.run.smithi042.stdout: "exported": 0, 2024-09-17T01:40:23.780 INFO:teuthology.orchestra.run.smithi042.stdout: "exported_inodes": 0, 2024-09-17T01:40:23.780 INFO:teuthology.orchestra.run.smithi042.stdout: "imported": 0, 2024-09-17T01:40:23.781 INFO:teuthology.orchestra.run.smithi042.stdout: "imported_inodes": 0, 2024-09-17T01:40:23.781 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_dir_fetch": 0, 2024-09-17T01:40:23.781 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_backtrace_fetch": 1731, 2024-09-17T01:40:23.781 INFO:teuthology.orchestra.run.smithi042.stdout: "openino_peer_discover": 0, 2024-09-17T01:40:23.781 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rfiles": 0, 2024-09-17T01:40:23.781 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rbytes": 0, 2024-09-17T01:40:23.781 INFO:teuthology.orchestra.run.smithi042.stdout: "root_rsnaps": 0, 2024-09-17T01:40:23.781 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_backtrace_fetch": 1731, 2024-09-17T01:40:23.781 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_set_tag": 0, 2024-09-17T01:40:23.781 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_backtrace_repaired": 0, 2024-09-17T01:40:23.781 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_inotable_repaired": 0, 2024-09-17T01:40:23.781 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dir_inodes": 11, 2024-09-17T01:40:23.781 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dir_base_inodes": 1, 2024-09-17T01:40:23.781 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_dirfrag_rstats": 10, 2024-09-17T01:40:23.782 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_file_inodes": 1720, 2024-09-17T01:40:23.782 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_inode_file_caps": 0, 2024-09-17T01:40:23.782 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_revoke": 1153, 2024-09-17T01:40:23.782 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_grant": 4043, 2024-09-17T01:40:23.782 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_trunc": 0, 2024-09-17T01:40:23.782 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-17T01:40:23.782 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-17T01:40:23.782 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_caps": 3312, 2024-09-17T01:40:23.782 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_caps_dirty": 2424, 2024-09-17T01:40:23.782 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_cap_release": 49, 2024-09-17T01:40:23.782 INFO:teuthology.orchestra.run.smithi042.stdout: "process_request_cap_release": 14074 2024-09-17T01:40:23.782 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.782 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache": { 2024-09-17T01:40:23.783 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_update": 0, 2024-09-17T01:40:23.783 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_update_receipt": 0, 2024-09-17T01:40:23.783 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_try_discover": 0, 2024-09-17T01:40:23.783 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_send_discover": 0, 2024-09-17T01:40:23.783 INFO:teuthology.orchestra.run.smithi042.stdout: "dir_handle_discover": 0, 2024-09-17T01:40:23.783 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays": 0, 2024-09-17T01:40:23.783 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_delayed": 0, 2024-09-17T01:40:23.783 INFO:teuthology.orchestra.run.smithi042.stdout: "num_strays_enqueuing": 0, 2024-09-17T01:40:23.783 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_created": 4147, 2024-09-17T01:40:23.783 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_enqueued": 3720, 2024-09-17T01:40:23.783 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_reintegrated": 2205, 2024-09-17T01:40:23.783 INFO:teuthology.orchestra.run.smithi042.stdout: "strays_migrated": 0, 2024-09-17T01:40:23.783 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_processing": 0, 2024-09-17T01:40:23.784 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_enqueued": 0, 2024-09-17T01:40:23.784 INFO:teuthology.orchestra.run.smithi042.stdout: "num_recovering_prioritized": 0, 2024-09-17T01:40:23.784 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_started": 0, 2024-09-17T01:40:23.784 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_completed": 0, 2024-09-17T01:40:23.784 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_quiesce_path": 0, 2024-09-17T01:40:23.784 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_quiesce_inode": 0, 2024-09-17T01:40:23.784 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_enqueue_scrub": 1, 2024-09-17T01:40:23.784 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_exportdir": 0, 2024-09-17T01:40:23.784 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_flush": 0, 2024-09-17T01:40:23.784 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragmentdir": 0, 2024-09-17T01:40:23.784 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_fragstats": 0, 2024-09-17T01:40:23.784 INFO:teuthology.orchestra.run.smithi042.stdout: "ireq_inodestats": 0, 2024-09-17T01:40:23.785 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:40:23.785 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_succeeded": 0, 2024-09-17T01:40:23.785 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_write_failed": 0 2024-09-17T01:40:23.785 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.785 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log": { 2024-09-17T01:40:23.785 INFO:teuthology.orchestra.run.smithi042.stdout: "evlrg": 0, 2024-09-17T01:40:23.785 INFO:teuthology.orchestra.run.smithi042.stdout: "evadd": 26789, 2024-09-17T01:40:23.785 INFO:teuthology.orchestra.run.smithi042.stdout: "evex": 0, 2024-09-17T01:40:23.785 INFO:teuthology.orchestra.run.smithi042.stdout: "evtrm": 0, 2024-09-17T01:40:23.785 INFO:teuthology.orchestra.run.smithi042.stdout: "ev": 26789, 2024-09-17T01:40:23.785 INFO:teuthology.orchestra.run.smithi042.stdout: "evexg": 0, 2024-09-17T01:40:23.785 INFO:teuthology.orchestra.run.smithi042.stdout: "evexd": 0, 2024-09-17T01:40:23.785 INFO:teuthology.orchestra.run.smithi042.stdout: "segadd": 38, 2024-09-17T01:40:23.786 INFO:teuthology.orchestra.run.smithi042.stdout: "segex": 0, 2024-09-17T01:40:23.786 INFO:teuthology.orchestra.run.smithi042.stdout: "segtrm": 0, 2024-09-17T01:40:23.786 INFO:teuthology.orchestra.run.smithi042.stdout: "seg": 38, 2024-09-17T01:40:23.786 INFO:teuthology.orchestra.run.smithi042.stdout: "segmjr": 4, 2024-09-17T01:40:23.786 INFO:teuthology.orchestra.run.smithi042.stdout: "segexg": 0, 2024-09-17T01:40:23.786 INFO:teuthology.orchestra.run.smithi042.stdout: "segexd": 0, 2024-09-17T01:40:23.786 INFO:teuthology.orchestra.run.smithi042.stdout: "expos": 4194304, 2024-09-17T01:40:23.786 INFO:teuthology.orchestra.run.smithi042.stdout: "wrpos": 96118650, 2024-09-17T01:40:23.786 INFO:teuthology.orchestra.run.smithi042.stdout: "rdpos": 0, 2024-09-17T01:40:23.786 INFO:teuthology.orchestra.run.smithi042.stdout: "jlat": { 2024-09-17T01:40:23.786 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2655, 2024-09-17T01:40:23.786 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 110.241578213, 2024-09-17T01:40:23.786 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.041522251 2024-09-17T01:40:23.786 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.787 INFO:teuthology.orchestra.run.smithi042.stdout: "replayed": 0 2024-09-17T01:40:23.787 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.787 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_mem": { 2024-09-17T01:40:23.787 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 14, 2024-09-17T01:40:23.787 INFO:teuthology.orchestra.run.smithi042.stdout: "ino+": 2015, 2024-09-17T01:40:23.787 INFO:teuthology.orchestra.run.smithi042.stdout: "ino-": 2001, 2024-09-17T01:40:23.787 INFO:teuthology.orchestra.run.smithi042.stdout: "dir": 13, 2024-09-17T01:40:23.787 INFO:teuthology.orchestra.run.smithi042.stdout: "dir+": 13, 2024-09-17T01:40:23.787 INFO:teuthology.orchestra.run.smithi042.stdout: "dir-": 0, 2024-09-17T01:40:23.787 INFO:teuthology.orchestra.run.smithi042.stdout: "dn": 17886, 2024-09-17T01:40:23.787 INFO:teuthology.orchestra.run.smithi042.stdout: "dn+": 19887, 2024-09-17T01:40:23.787 INFO:teuthology.orchestra.run.smithi042.stdout: "dn-": 2001, 2024-09-17T01:40:23.787 INFO:teuthology.orchestra.run.smithi042.stdout: "cap": 2, 2024-09-17T01:40:23.788 INFO:teuthology.orchestra.run.smithi042.stdout: "cap+": 7031, 2024-09-17T01:40:23.788 INFO:teuthology.orchestra.run.smithi042.stdout: "cap-": 7029, 2024-09-17T01:40:23.788 INFO:teuthology.orchestra.run.smithi042.stdout: "rss": 164872, 2024-09-17T01:40:23.788 INFO:teuthology.orchestra.run.smithi042.stdout: "heap": 407851008 2024-09-17T01:40:23.788 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.788 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_server": { 2024-09-17T01:40:23.788 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_client_request": 28535, 2024-09-17T01:40:23.788 INFO:teuthology.orchestra.run.smithi042.stdout: "dispatch_server_request": 0, 2024-09-17T01:40:23.788 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_request": 25584, 2024-09-17T01:40:23.788 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_client_session": 6, 2024-09-17T01:40:23.788 INFO:teuthology.orchestra.run.smithi042.stdout: "handle_peer_request": 0, 2024-09-17T01:40:23.788 INFO:teuthology.orchestra.run.smithi042.stdout: "req_create_latency": { 2024-09-17T01:40:23.788 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2000, 2024-09-17T01:40:23.788 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 1.955997421, 2024-09-17T01:40:23.789 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000977998 2024-09-17T01:40:23.789 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.789 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getattr_latency": { 2024-09-17T01:40:23.789 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 30, 2024-09-17T01:40:23.789 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.005245051, 2024-09-17T01:40:23.789 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000174835 2024-09-17T01:40:23.789 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.789 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getfilelock_latency": { 2024-09-17T01:40:23.789 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:40:23.789 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:40:23.789 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:40:23.789 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.789 INFO:teuthology.orchestra.run.smithi042.stdout: "req_link_latency": { 2024-09-17T01:40:23.790 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 6000, 2024-09-17T01:40:23.790 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 8.218123807, 2024-09-17T01:40:23.790 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.001369687 2024-09-17T01:40:23.790 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.790 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookup_latency": { 2024-09-17T01:40:23.790 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 7335, 2024-09-17T01:40:23.790 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 5.919161002, 2024-09-17T01:40:23.790 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000806974 2024-09-17T01:40:23.790 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.790 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookuphash_latency": { 2024-09-17T01:40:23.790 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:40:23.790 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:40:23.790 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:40:23.791 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.791 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupino_latency": { 2024-09-17T01:40:23.791 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:40:23.791 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:40:23.791 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:40:23.791 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.792 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupname_latency": { 2024-09-17T01:40:23.792 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:40:23.792 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:40:23.792 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:40:23.792 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.792 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupparent_latency": { 2024-09-17T01:40:23.792 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:40:23.792 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:40:23.792 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:40:23.792 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.792 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lookupsnap_latency": { 2024-09-17T01:40:23.792 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-17T01:40:23.792 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000050099, 2024-09-17T01:40:23.793 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000050099 2024-09-17T01:40:23.793 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.793 INFO:teuthology.orchestra.run.smithi042.stdout: "req_lssnap_latency": { 2024-09-17T01:40:23.793 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:40:23.793 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:40:23.793 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:40:23.793 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.793 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mkdir_latency": { 2024-09-17T01:40:23.793 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-17T01:40:23.793 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.003399381, 2024-09-17T01:40:23.793 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.003399381 2024-09-17T01:40:23.793 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.793 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mknod_latency": { 2024-09-17T01:40:23.794 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:40:23.794 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:40:23.794 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:40:23.794 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.794 INFO:teuthology.orchestra.run.smithi042.stdout: "req_mksnap_latency": { 2024-09-17T01:40:23.794 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-17T01:40:23.794 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.218478474, 2024-09-17T01:40:23.794 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.218478474 2024-09-17T01:40:23.794 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.794 INFO:teuthology.orchestra.run.smithi042.stdout: "req_open_latency": { 2024-09-17T01:40:23.794 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-17T01:40:23.794 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000110167, 2024-09-17T01:40:23.794 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000110167 2024-09-17T01:40:23.795 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.795 INFO:teuthology.orchestra.run.smithi042.stdout: "req_readdir_latency": { 2024-09-17T01:40:23.795 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 8, 2024-09-17T01:40:23.795 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.456993125, 2024-09-17T01:40:23.795 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.057124140 2024-09-17T01:40:23.795 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.795 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rename_latency": { 2024-09-17T01:40:23.795 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 2205, 2024-09-17T01:40:23.795 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 343.767319216, 2024-09-17T01:40:23.795 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.155903546 2024-09-17T01:40:23.795 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.795 INFO:teuthology.orchestra.run.smithi042.stdout: "req_renamesnap_latency": { 2024-09-17T01:40:23.796 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:40:23.796 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:40:23.796 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:40:23.796 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.796 INFO:teuthology.orchestra.run.smithi042.stdout: "req_snapdiff_latency": { 2024-09-17T01:40:23.796 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:40:23.796 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:40:23.796 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:40:23.796 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.796 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmdir_latency": { 2024-09-17T01:40:23.796 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:40:23.796 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:40:23.796 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:40:23.797 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.797 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmsnap_latency": { 2024-09-17T01:40:23.797 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-17T01:40:23.797 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.053934040, 2024-09-17T01:40:23.797 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.053934040 2024-09-17T01:40:23.797 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.797 INFO:teuthology.orchestra.run.smithi042.stdout: "req_rmxattr_latency": { 2024-09-17T01:40:23.797 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:40:23.797 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:40:23.797 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:40:23.797 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.797 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setattr_latency": { 2024-09-17T01:40:23.797 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 1, 2024-09-17T01:40:23.798 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000318566, 2024-09-17T01:40:23.798 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000318566 2024-09-17T01:40:23.798 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.798 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setdirlayout_latency": { 2024-09-17T01:40:23.798 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:40:23.798 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:40:23.798 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:40:23.798 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.798 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setfilelock_latency": { 2024-09-17T01:40:23.798 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:40:23.798 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:40:23.798 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:40:23.798 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.799 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setlayout_latency": { 2024-09-17T01:40:23.799 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:40:23.799 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:40:23.799 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:40:23.799 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.799 INFO:teuthology.orchestra.run.smithi042.stdout: "req_setxattr_latency": { 2024-09-17T01:40:23.799 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:40:23.799 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:40:23.799 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:40:23.799 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.799 INFO:teuthology.orchestra.run.smithi042.stdout: "req_symlink_latency": { 2024-09-17T01:40:23.799 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:40:23.799 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:40:23.800 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:40:23.800 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.800 INFO:teuthology.orchestra.run.smithi042.stdout: "req_unlink_latency": { 2024-09-17T01:40:23.800 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 8000, 2024-09-17T01:40:23.800 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 20.770812162, 2024-09-17T01:40:23.800 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.002596351 2024-09-17T01:40:23.801 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.801 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_revoke_eviction": 0, 2024-09-17T01:40:23.801 INFO:teuthology.orchestra.run.smithi042.stdout: "cap_acquisition_throttle": 0, 2024-09-17T01:40:23.801 INFO:teuthology.orchestra.run.smithi042.stdout: "req_getvxattr_latency": { 2024-09-17T01:40:23.801 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:40:23.801 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:40:23.801 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:40:23.801 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:23.801 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.802 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_sessions": { 2024-09-17T01:40:23.802 INFO:teuthology.orchestra.run.smithi042.stdout: "session_count": 1, 2024-09-17T01:40:23.802 INFO:teuthology.orchestra.run.smithi042.stdout: "session_add": 1, 2024-09-17T01:40:23.802 INFO:teuthology.orchestra.run.smithi042.stdout: "session_remove": 0, 2024-09-17T01:40:23.802 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_open": 1, 2024-09-17T01:40:23.802 INFO:teuthology.orchestra.run.smithi042.stdout: "sessions_stale": 0, 2024-09-17T01:40:23.802 INFO:teuthology.orchestra.run.smithi042.stdout: "total_load": 17546, 2024-09-17T01:40:23.802 INFO:teuthology.orchestra.run.smithi042.stdout: "average_load": 17546, 2024-09-17T01:40:23.802 INFO:teuthology.orchestra.run.smithi042.stdout: "avg_session_uptime": 96, 2024-09-17T01:40:23.803 INFO:teuthology.orchestra.run.smithi042.stdout: "mdthresh_evicted": 0 2024-09-17T01:40:23.803 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.803 INFO:teuthology.orchestra.run.smithi042.stdout: "mempool": { 2024-09-17T01:40:23.803 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_bytes": 0, 2024-09-17T01:40:23.803 INFO:teuthology.orchestra.run.smithi042.stdout: "bloom_filter_items": 0, 2024-09-17T01:40:23.803 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_bytes": 0, 2024-09-17T01:40:23.803 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_items": 0, 2024-09-17T01:40:23.803 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_bytes": 0, 2024-09-17T01:40:23.803 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_data_items": 0, 2024-09-17T01:40:23.803 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-17T01:40:23.803 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_onode_items": 0, 2024-09-17T01:40:23.803 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-17T01:40:23.803 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_items": 0, 2024-09-17T01:40:23.804 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_bytes": 0, 2024-09-17T01:40:23.804 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_other_items": 0, 2024-09-17T01:40:23.804 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-17T01:40:23.804 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_buffer_items": 0, 2024-09-17T01:40:23.804 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_bytes": 0, 2024-09-17T01:40:23.804 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_items": 0, 2024-09-17T01:40:23.804 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_bytes": 0, 2024-09-17T01:40:23.804 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blob_items": 0, 2024-09-17T01:40:23.804 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-17T01:40:23.804 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_shared_blob_items": 0, 2024-09-17T01:40:23.804 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-17T01:40:23.804 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_inline_bl_items": 0, 2024-09-17T01:40:23.804 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_bytes": 0, 2024-09-17T01:40:23.804 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_items": 0, 2024-09-17T01:40:23.805 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_bytes": 0, 2024-09-17T01:40:23.805 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_txc_items": 0, 2024-09-17T01:40:23.805 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-17T01:40:23.805 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_deferred_items": 0, 2024-09-17T01:40:23.805 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_bytes": 0, 2024-09-17T01:40:23.805 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_writing_items": 0, 2024-09-17T01:40:23.805 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_bytes": 0, 2024-09-17T01:40:23.805 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_items": 0, 2024-09-17T01:40:23.805 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_bytes": 0, 2024-09-17T01:40:23.805 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_reader_items": 0, 2024-09-17T01:40:23.805 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_bytes": 0, 2024-09-17T01:40:23.805 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_file_writer_items": 0, 2024-09-17T01:40:23.805 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_bytes": 250799, 2024-09-17T01:40:23.806 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_anon_items": 93, 2024-09-17T01:40:23.806 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_bytes": 528, 2024-09-17T01:40:23.806 INFO:teuthology.orchestra.run.smithi042.stdout: "buffer_meta_items": 6, 2024-09-17T01:40:23.806 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bytes": 0, 2024-09-17T01:40:23.806 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_items": 0, 2024-09-17T01:40:23.806 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_bytes": 0, 2024-09-17T01:40:23.806 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mapbl_items": 0, 2024-09-17T01:40:23.806 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_bytes": 0, 2024-09-17T01:40:23.806 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pglog_items": 0, 2024-09-17T01:40:23.806 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_bytes": 5800, 2024-09-17T01:40:23.806 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_items": 85, 2024-09-17T01:40:23.806 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_bytes": 0, 2024-09-17T01:40:23.806 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_mapping_items": 0, 2024-09-17T01:40:23.806 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_bytes": 0, 2024-09-17T01:40:23.807 INFO:teuthology.orchestra.run.smithi042.stdout: "pgmap_items": 0, 2024-09-17T01:40:23.807 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_bytes": 13042029, 2024-09-17T01:40:23.807 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_co_items": 661576, 2024-09-17T01:40:23.807 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_bytes": 0, 2024-09-17T01:40:23.807 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_1_items": 0, 2024-09-17T01:40:23.807 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_bytes": 0, 2024-09-17T01:40:23.807 INFO:teuthology.orchestra.run.smithi042.stdout: "unittest_2_items": 0 2024-09-17T01:40:23.807 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.807 INFO:teuthology.orchestra.run.smithi042.stdout: "objecter": { 2024-09-17T01:40:23.807 INFO:teuthology.orchestra.run.smithi042.stdout: "op_active": 0, 2024-09-17T01:40:23.807 INFO:teuthology.orchestra.run.smithi042.stdout: "op_laggy": 0, 2024-09-17T01:40:23.807 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send": 8381, 2024-09-17T01:40:23.807 INFO:teuthology.orchestra.run.smithi042.stdout: "op_send_bytes": 92597906, 2024-09-17T01:40:23.808 INFO:teuthology.orchestra.run.smithi042.stdout: "op_resend": 37, 2024-09-17T01:40:23.808 INFO:teuthology.orchestra.run.smithi042.stdout: "op_reply": 8381, 2024-09-17T01:40:23.808 INFO:teuthology.orchestra.run.smithi042.stdout: "op_latency": { 2024-09-17T01:40:23.808 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 8381, 2024-09-17T01:40:23.808 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 35.457711938, 2024-09-17T01:40:23.808 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.004230725 2024-09-17T01:40:23.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.808 INFO:teuthology.orchestra.run.smithi042.stdout: "op_inflight": 0, 2024-09-17T01:40:23.808 INFO:teuthology.orchestra.run.smithi042.stdout: "oplen_avg": { 2024-09-17T01:40:23.808 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 8381, 2024-09-17T01:40:23.808 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 8494 2024-09-17T01:40:23.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.808 INFO:teuthology.orchestra.run.smithi042.stdout: "op": 8381, 2024-09-17T01:40:23.808 INFO:teuthology.orchestra.run.smithi042.stdout: "op_r": 1789, 2024-09-17T01:40:23.809 INFO:teuthology.orchestra.run.smithi042.stdout: "op_w": 6592, 2024-09-17T01:40:23.809 INFO:teuthology.orchestra.run.smithi042.stdout: "op_rmw": 0, 2024-09-17T01:40:23.809 INFO:teuthology.orchestra.run.smithi042.stdout: "op_pg": 0, 2024-09-17T01:40:23.809 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_stat": 0, 2024-09-17T01:40:23.809 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_create": 11, 2024-09-17T01:40:23.809 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_read": 57, 2024-09-17T01:40:23.809 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_write": 2711, 2024-09-17T01:40:23.809 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writefull": 37, 2024-09-17T01:40:23.809 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_writesame": 0, 2024-09-17T01:40:23.809 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_append": 0, 2024-09-17T01:40:23.809 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_zero": 1720, 2024-09-17T01:40:23.809 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_truncate": 0, 2024-09-17T01:40:23.809 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_delete": 2033, 2024-09-17T01:40:23.809 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_mapext": 0, 2024-09-17T01:40:23.810 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_sparse_read": 0, 2024-09-17T01:40:23.810 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_clonerange": 0, 2024-09-17T01:40:23.810 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_getxattr": 1732, 2024-09-17T01:40:23.810 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_setxattr": 22, 2024-09-17T01:40:23.810 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_cmpxattr": 0, 2024-09-17T01:40:23.810 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_rmxattr": 0, 2024-09-17T01:40:23.810 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_resetxattrs": 0, 2024-09-17T01:40:23.810 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_call": 0, 2024-09-17T01:40:23.810 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_watch": 0, 2024-09-17T01:40:23.810 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_notify": 0, 2024-09-17T01:40:23.810 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_src_cmpxattr": 0, 2024-09-17T01:40:23.810 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls": 0, 2024-09-17T01:40:23.810 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_pgls_filter": 0, 2024-09-17T01:40:23.811 INFO:teuthology.orchestra.run.smithi042.stdout: "osdop_other": 0, 2024-09-17T01:40:23.811 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_active": 0, 2024-09-17T01:40:23.811 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_send": 0, 2024-09-17T01:40:23.811 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_resend": 0, 2024-09-17T01:40:23.811 INFO:teuthology.orchestra.run.smithi042.stdout: "linger_ping": 0, 2024-09-17T01:40:23.811 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_active": 0, 2024-09-17T01:40:23.811 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_send": 0, 2024-09-17T01:40:23.811 INFO:teuthology.orchestra.run.smithi042.stdout: "poolop_resend": 0, 2024-09-17T01:40:23.811 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_active": 0, 2024-09-17T01:40:23.811 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_send": 0, 2024-09-17T01:40:23.811 INFO:teuthology.orchestra.run.smithi042.stdout: "poolstat_resend": 0, 2024-09-17T01:40:23.811 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_active": 0, 2024-09-17T01:40:23.811 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_send": 0, 2024-09-17T01:40:23.811 INFO:teuthology.orchestra.run.smithi042.stdout: "statfs_resend": 0, 2024-09-17T01:40:23.812 INFO:teuthology.orchestra.run.smithi042.stdout: "command_active": 0, 2024-09-17T01:40:23.812 INFO:teuthology.orchestra.run.smithi042.stdout: "command_send": 0, 2024-09-17T01:40:23.812 INFO:teuthology.orchestra.run.smithi042.stdout: "command_resend": 0, 2024-09-17T01:40:23.812 INFO:teuthology.orchestra.run.smithi042.stdout: "map_epoch": 112, 2024-09-17T01:40:23.812 INFO:teuthology.orchestra.run.smithi042.stdout: "map_full": 0, 2024-09-17T01:40:23.812 INFO:teuthology.orchestra.run.smithi042.stdout: "map_inc": 5, 2024-09-17T01:40:23.812 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_sessions": 8, 2024-09-17T01:40:23.812 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_open": 8, 2024-09-17T01:40:23.812 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_session_close": 0, 2024-09-17T01:40:23.812 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_laggy": 0, 2024-09-17T01:40:23.812 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_wr": 135, 2024-09-17T01:40:23.812 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_rd": 0, 2024-09-17T01:40:23.812 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_del": 36 2024-09-17T01:40:23.813 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.813 INFO:teuthology.orchestra.run.smithi042.stdout: "oft": { 2024-09-17T01:40:23.813 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_objs": 1, 2024-09-17T01:40:23.813 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_kv_pairs": 0, 2024-09-17T01:40:23.813 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_updates": 0, 2024-09-17T01:40:23.813 INFO:teuthology.orchestra.run.smithi042.stdout: "omap_total_removes": 0 2024-09-17T01:40:23.813 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.813 INFO:teuthology.orchestra.run.smithi042.stdout: "purge_queue": { 2024-09-17T01:40:23.813 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops": 0, 2024-09-17T01:40:23.813 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_ops_high_water": 32, 2024-09-17T01:40:23.813 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing": 0, 2024-09-17T01:40:23.813 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executing_high_water": 32, 2024-09-17T01:40:23.813 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed_ops": 3720, 2024-09-17T01:40:23.813 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_executed": 3720, 2024-09-17T01:40:23.814 INFO:teuthology.orchestra.run.smithi042.stdout: "pq_item_in_journal": 0 2024-09-17T01:40:23.814 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.814 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-17T01:40:23.814 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-17T01:40:23.814 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-09-17T01:40:23.814 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-17T01:40:23.814 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 35329, 2024-09-17T01:40:23.814 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 9294694, 2024-09-17T01:40:23.814 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-17T01:40:23.814 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 35329, 2024-09-17T01:40:23.814 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-17T01:40:23.814 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-17T01:40:23.814 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 35329, 2024-09-17T01:40:23.814 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 9294694, 2024-09-17T01:40:23.815 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-17T01:40:23.815 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:40:23.815 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:40:23.815 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:40:23.815 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:23.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.815 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_bytes": { 2024-09-17T01:40:23.815 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-17T01:40:23.815 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 104857600, 2024-09-17T01:40:23.815 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-17T01:40:23.815 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-17T01:40:23.815 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-17T01:40:23.815 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-17T01:40:23.815 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-17T01:40:23.816 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 8381, 2024-09-17T01:40:23.816 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 92987386, 2024-09-17T01:40:23.816 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 8381, 2024-09-17T01:40:23.816 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 92987386, 2024-09-17T01:40:23.816 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-17T01:40:23.816 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:40:23.816 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:40:23.816 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:40:23.816 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:23.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.816 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-objecter_ops": { 2024-09-17T01:40:23.816 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-17T01:40:23.816 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 1024, 2024-09-17T01:40:23.817 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-17T01:40:23.817 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 0, 2024-09-17T01:40:23.817 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 0, 2024-09-17T01:40:23.817 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-17T01:40:23.817 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 0, 2024-09-17T01:40:23.817 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 8381, 2024-09-17T01:40:23.817 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 8381, 2024-09-17T01:40:23.817 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 8381, 2024-09-17T01:40:23.817 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 8381, 2024-09-17T01:40:23.817 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-17T01:40:23.817 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:40:23.817 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:40:23.817 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:40:23.817 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:23.818 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.818 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle": { 2024-09-17T01:40:23.818 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-17T01:40:23.818 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2024-09-17T01:40:23.818 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-17T01:40:23.818 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 3720, 2024-09-17T01:40:23.818 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 389480, 2024-09-17T01:40:23.818 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-17T01:40:23.818 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 3720, 2024-09-17T01:40:23.818 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-17T01:40:23.818 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-17T01:40:23.818 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 56, 2024-09-17T01:40:23.818 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 389480, 2024-09-17T01:40:23.818 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-17T01:40:23.819 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:40:23.819 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:40:23.819 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:40:23.819 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:23.819 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.819 INFO:teuthology.orchestra.run.smithi042.stdout: "throttle-write_buf_throttle-0x564f1984d380": { 2024-09-17T01:40:23.819 INFO:teuthology.orchestra.run.smithi042.stdout: "val": 0, 2024-09-17T01:40:23.819 INFO:teuthology.orchestra.run.smithi042.stdout: "max": 3758096384, 2024-09-17T01:40:23.819 INFO:teuthology.orchestra.run.smithi042.stdout: "get_started": 0, 2024-09-17T01:40:23.819 INFO:teuthology.orchestra.run.smithi042.stdout: "get": 26789, 2024-09-17T01:40:23.819 INFO:teuthology.orchestra.run.smithi042.stdout: "get_sum": 91924346, 2024-09-17T01:40:23.819 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_fail": 0, 2024-09-17T01:40:23.819 INFO:teuthology.orchestra.run.smithi042.stdout: "get_or_fail_success": 26789, 2024-09-17T01:40:23.819 INFO:teuthology.orchestra.run.smithi042.stdout: "take": 0, 2024-09-17T01:40:23.820 INFO:teuthology.orchestra.run.smithi042.stdout: "take_sum": 0, 2024-09-17T01:40:23.820 INFO:teuthology.orchestra.run.smithi042.stdout: "put": 2655, 2024-09-17T01:40:23.820 INFO:teuthology.orchestra.run.smithi042.stdout: "put_sum": 91924346, 2024-09-17T01:40:23.820 INFO:teuthology.orchestra.run.smithi042.stdout: "wait": { 2024-09-17T01:40:23.820 INFO:teuthology.orchestra.run.smithi042.stdout: "avgcount": 0, 2024-09-17T01:40:23.820 INFO:teuthology.orchestra.run.smithi042.stdout: "sum": 0.000000000, 2024-09-17T01:40:23.820 INFO:teuthology.orchestra.run.smithi042.stdout: "avgtime": 0.000000000 2024-09-17T01:40:23.820 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:23.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:23.820 INFO:teuthology.orchestra.run.smithi042.stdout: "trackedop": { 2024-09-17T01:40:23.820 INFO:teuthology.orchestra.run.smithi042.stdout: "slow_ops_count": 0 2024-09-17T01:40:23.820 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:23.821 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:40:23.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.754+0000 7ff998000640 1 -- 172.21.15.42:0/193599807 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff970078bc0 msgr2=0x7ff97007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:23.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.754+0000 7ff998000640 1 --2- 172.21.15.42:0/193599807 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff970078bc0 0x7ff97007b0d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff97c033000 tx=0x7ff97c004730 comp rx=0 tx=0).stop 2024-09-17T01:40:23.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.754+0000 7ff998000640 1 -- 172.21.15.42:0/193599807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff990072e90 msgr2=0x7ff990142430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:23.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.754+0000 7ff998000640 1 --2- 172.21.15.42:0/193599807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff990072e90 0x7ff990142430 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7ff98400e790 tx=0x7ff98400ec50 comp rx=0 tx=0).stop 2024-09-17T01:40:23.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.754+0000 7ff998000640 1 -- 172.21.15.42:0/193599807 shutdown_connections 2024-09-17T01:40:23.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.754+0000 7ff998000640 1 --2- 172.21.15.42:0/193599807 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff970078bc0 0x7ff97007b0d0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.754+0000 7ff998000640 1 --2- 172.21.15.42:0/193599807 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff990142f40 0x7ff99006f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.754+0000 7ff998000640 1 --2- 172.21.15.42:0/193599807 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9900b3550 0x7ff99013ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.754+0000 7ff998000640 1 --2- 172.21.15.42:0/193599807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff990072e90 0x7ff990142430 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:23.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.754+0000 7ff998000640 1 -- 172.21.15.42:0/193599807 >> 172.21.15.42:0/193599807 conn(0x7ff9900b2930 msgr2=0x7ff990075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:23.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.754+0000 7ff998000640 1 -- 172.21.15.42:0/193599807 shutdown_connections 2024-09-17T01:40:23.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:23.754+0000 7ff998000640 1 -- 172.21.15.42:0/193599807 wait complete. 2024-09-17T01:40:23.825 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:40:23.825 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:40:23.905 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:40:24.001 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:40:24.001 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:40:24.001 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:40:24.001 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:40:24.037 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:40:24.037 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:40:24.113 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T01:40:24.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.384+0000 7f5284a00640 1 -- 172.21.15.42:0/3731730813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52800cf7c0 msgr2=0x7f528006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:24.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.384+0000 7f5284a00640 1 --2- 172.21.15.42:0/3731730813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52800cf7c0 0x7f528006cd20 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f5268009830 tx=0x7f526802a510 comp rx=0 tx=0).stop 2024-09-17T01:40:24.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.384+0000 7f5284a00640 1 -- 172.21.15.42:0/3731730813 shutdown_connections 2024-09-17T01:40:24.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.384+0000 7f5284a00640 1 --2- 172.21.15.42:0/3731730813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52800cf7c0 0x7f528006cd20 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:24.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.384+0000 7f5284a00640 1 -- 172.21.15.42:0/3731730813 >> 172.21.15.42:0/3731730813 conn(0x7f52800b25f0 msgr2=0x7f52800d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:24.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.384+0000 7f5284a00640 1 -- 172.21.15.42:0/3731730813 shutdown_connections 2024-09-17T01:40:24.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.384+0000 7f5284a00640 1 -- 172.21.15.42:0/3731730813 wait complete. 2024-09-17T01:40:24.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.386+0000 7f5284a00640 1 Processor -- start 2024-09-17T01:40:24.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.386+0000 7f5284a00640 1 -- start start 2024-09-17T01:40:24.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.388+0000 7f5284a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f528006d260 0x7f52800749c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:24.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.388+0000 7f5284a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52800b4be0 0x7f52800b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:24.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.388+0000 7f5284a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52800cf7c0 0x7f5280072280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:24.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.388+0000 7f5284a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f52801535e0 con 0x7f52800cf7c0 2024-09-17T01:40:24.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.388+0000 7f5284a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f52800b4340 con 0x7f52800b4be0 2024-09-17T01:40:24.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.388+0000 7f5284a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5280153760 con 0x7f528006d260 2024-09-17T01:40:24.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.388+0000 7f527f400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f528006d260 0x7f52800749c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:24.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.388+0000 7f5277e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52800b4be0 0x7f52800b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:24.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.388+0000 7f527fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52800cf7c0 0x7f5280072280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:24.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.388+0000 7f527f400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f528006d260 0x7f52800749c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:45882/0 (socket says 172.21.15.42:45882) 2024-09-17T01:40:24.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.388+0000 7f527f400640 1 -- 172.21.15.42:0/2174887761 learned_addr learned my addr 172.21.15.42:0/2174887761 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:24.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.389+0000 7f527fe00640 1 -- 172.21.15.42:0/2174887761 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f528006d260 msgr2=0x7f52800749c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:24.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.389+0000 7f527fe00640 1 --2- 172.21.15.42:0/2174887761 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f528006d260 0x7f52800749c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:24.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.389+0000 7f527fe00640 1 -- 172.21.15.42:0/2174887761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52800b4be0 msgr2=0x7f52800b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:24.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.389+0000 7f527fe00640 1 --2- 172.21.15.42:0/2174887761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52800b4be0 0x7f52800b0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:24.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.389+0000 7f527fe00640 1 -- 172.21.15.42:0/2174887761 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5280072ff0 con 0x7f52800cf7c0 2024-09-17T01:40:24.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.389+0000 7f527fe00640 1 --2- 172.21.15.42:0/2174887761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52800cf7c0 0x7f5280072280 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f527800c700 tx=0x7f527800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:24.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.389+0000 7f5277400640 1 -- 172.21.15.42:0/2174887761 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5278017070 con 0x7f52800cf7c0 2024-09-17T01:40:24.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.390+0000 7f5284a00640 1 -- 172.21.15.42:0/2174887761 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5280073c20 con 0x7f52800cf7c0 2024-09-17T01:40:24.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.390+0000 7f5277400640 1 -- 172.21.15.42:0/2174887761 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5278003c60 con 0x7f52800cf7c0 2024-09-17T01:40:24.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.390+0000 7f5277400640 1 -- 172.21.15.42:0/2174887761 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52780052d0 con 0x7f52800cf7c0 2024-09-17T01:40:24.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.390+0000 7f5284a00640 1 -- 172.21.15.42:0/2174887761 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52800741e0 con 0x7f52800cf7c0 2024-09-17T01:40:24.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.391+0000 7f5284a00640 1 -- 172.21.15.42:0/2174887761 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f528006cd20 con 0x7f52800cf7c0 2024-09-17T01:40:24.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.392+0000 7f5277400640 1 -- 172.21.15.42:0/2174887761 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f527801a070 con 0x7f52800cf7c0 2024-09-17T01:40:24.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.394+0000 7f5277400640 1 --2- 172.21.15.42:0/2174887761 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f525c078bc0 0x7f525c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:24.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.394+0000 7f5277400640 1 -- 172.21.15.42:0/2174887761 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5853+0+0 (secure 0 0 0) 0x7f527809a420 con 0x7f52800cf7c0 2024-09-17T01:40:24.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.394+0000 7f527f400640 1 --2- 172.21.15.42:0/2174887761 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f525c078bc0 0x7f525c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:24.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.395+0000 7f527f400640 1 --2- 172.21.15.42:0/2174887761 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f525c078bc0 0x7f525c07b0d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5270009990 tx=0x7f5270009110 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:24.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.399+0000 7f5277400640 1 -- 172.21.15.42:0/2174887761 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f528006d670 con 0x7f52800cf7c0 2024-09-17T01:40:24.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.609+0000 7f5284a00640 1 -- 172.21.15.42:0/2174887761 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f52800b3db0 con 0x7f52800cf7c0 2024-09-17T01:40:24.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.609+0000 7f5277400640 1 -- 172.21.15.42:0/2174887761 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v112) ==== 80+0+0 (secure 0 0 0) 0x7f5278062060 con 0x7f52800cf7c0 2024-09-17T01:40:24.607 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-17T01:40:24.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.612+0000 7f5284a00640 1 -- 172.21.15.42:0/2174887761 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f525c078bc0 msgr2=0x7f525c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:24.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.612+0000 7f5284a00640 1 --2- 172.21.15.42:0/2174887761 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f525c078bc0 0x7f525c07b0d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5270009990 tx=0x7f5270009110 comp rx=0 tx=0).stop 2024-09-17T01:40:24.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.612+0000 7f5284a00640 1 -- 172.21.15.42:0/2174887761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52800cf7c0 msgr2=0x7f5280072280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:24.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.612+0000 7f5284a00640 1 --2- 172.21.15.42:0/2174887761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52800cf7c0 0x7f5280072280 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f527800c700 tx=0x7f527800cbc0 comp rx=0 tx=0).stop 2024-09-17T01:40:24.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.612+0000 7f5284a00640 1 -- 172.21.15.42:0/2174887761 shutdown_connections 2024-09-17T01:40:24.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.612+0000 7f5284a00640 1 --2- 172.21.15.42:0/2174887761 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f525c078bc0 0x7f525c07b0d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:24.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.612+0000 7f5284a00640 1 --2- 172.21.15.42:0/2174887761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52800b4be0 0x7f52800b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:24.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.612+0000 7f5284a00640 1 --2- 172.21.15.42:0/2174887761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52800cf7c0 0x7f5280072280 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:24.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.612+0000 7f5284a00640 1 --2- 172.21.15.42:0/2174887761 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f528006d260 0x7f52800749c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:24.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.612+0000 7f5284a00640 1 -- 172.21.15.42:0/2174887761 >> 172.21.15.42:0/2174887761 conn(0x7f52800b25f0 msgr2=0x7f528015f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:24.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.612+0000 7f5284a00640 1 -- 172.21.15.42:0/2174887761 shutdown_connections 2024-09-17T01:40:24.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:24.612+0000 7f5284a00640 1 -- 172.21.15.42:0/2174887761 wait complete. 2024-09-17T01:40:24.630 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T01:40:24.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:40:24.631 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T01:40:24.722 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:40:24.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:40:24.723 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T01:40:24.777 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:40:24.778 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:40:24.778 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:40:24.816 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:40:24.816 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:40:24.816 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:40:24.816 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:40:24.851 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:40:24.851 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:40:24.851 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:40:24.851 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:40:24.892 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:40:24.892 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:40:25.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.122+0000 7f16b2200640 1 -- 172.21.15.42:0/1335447964 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16ac162520 msgr2=0x7f16ac0cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:25.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.122+0000 7f16b2200640 1 --2- 172.21.15.42:0/1335447964 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16ac162520 0x7f16ac0cf840 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f16ac0ceb00 tx=0x7f169802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:40:25.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.122+0000 7f16b2200640 1 -- 172.21.15.42:0/1335447964 shutdown_connections 2024-09-17T01:40:25.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.122+0000 7f16b2200640 1 --2- 172.21.15.42:0/1335447964 >> v2:172.21.15.43:3300/0 conn(0x7f16ac0cfd80 0x7f16ac0d2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:25.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.122+0000 7f16b2200640 1 --2- 172.21.15.42:0/1335447964 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16ac162520 0x7f16ac0cf840 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:25.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.122+0000 7f16b2200640 1 -- 172.21.15.42:0/1335447964 >> 172.21.15.42:0/1335447964 conn(0x7f16ac073f20 msgr2=0x7f16ac06cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:25.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.122+0000 7f16b2200640 1 -- 172.21.15.42:0/1335447964 shutdown_connections 2024-09-17T01:40:25.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.122+0000 7f16b2200640 1 -- 172.21.15.42:0/1335447964 wait complete. 2024-09-17T01:40:25.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.125+0000 7f16b2200640 1 Processor -- start 2024-09-17T01:40:25.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.125+0000 7f16b2200640 1 -- start start 2024-09-17T01:40:25.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.126+0000 7f16b2200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16ac0cfd80 0x7f16ac0b68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:25.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.126+0000 7f16b2200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16ac15fbe0 0x7f16ac0b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:25.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.126+0000 7f16b2200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16ac162520 0x7f16ac0b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:25.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.126+0000 7f16b2200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f16ac0d39a0 con 0x7f16ac15fbe0 2024-09-17T01:40:25.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.126+0000 7f16b2200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f16ac0d3820 con 0x7f16ac0cfd80 2024-09-17T01:40:25.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.126+0000 7f16b2200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f16ac0d0d00 con 0x7f16ac162520 2024-09-17T01:40:25.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.126+0000 7f16abe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16ac15fbe0 0x7f16ac0b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:25.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.126+0000 7f16abe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16ac15fbe0 0x7f16ac0b5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36896/0 (socket says 172.21.15.42:36896) 2024-09-17T01:40:25.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.126+0000 7f16abe00640 1 -- 172.21.15.42:0/344270923 learned_addr learned my addr 172.21.15.42:0/344270923 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:25.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.127+0000 7f16b0e00640 1 --2- 172.21.15.42:0/344270923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16ac0cfd80 0x7f16ac0b68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:25.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.127+0000 7f16b1800640 1 --2- 172.21.15.42:0/344270923 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16ac162520 0x7f16ac0b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:25.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.127+0000 7f16abe00640 1 -- 172.21.15.42:0/344270923 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16ac162520 msgr2=0x7f16ac0b55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:25.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.127+0000 7f16abe00640 1 --2- 172.21.15.42:0/344270923 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16ac162520 0x7f16ac0b55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:25.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.127+0000 7f16abe00640 1 -- 172.21.15.42:0/344270923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16ac0cfd80 msgr2=0x7f16ac0b68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:25.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.127+0000 7f16abe00640 1 --2- 172.21.15.42:0/344270923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16ac0cfd80 0x7f16ac0b68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:25.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.127+0000 7f16abe00640 1 -- 172.21.15.42:0/344270923 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16ac0ca0d0 con 0x7f16ac15fbe0 2024-09-17T01:40:25.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.127+0000 7f16b0e00640 1 --2- 172.21.15.42:0/344270923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16ac0cfd80 0x7f16ac0b68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:40:25.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.127+0000 7f16abe00640 1 --2- 172.21.15.42:0/344270923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16ac15fbe0 0x7f16ac0b5060 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f1698009780 tx=0x7f1698033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:25.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.127+0000 7f16a8c00640 1 -- 172.21.15.42:0/344270923 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1698031d60 con 0x7f16ac15fbe0 2024-09-17T01:40:25.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.128+0000 7f16a8c00640 1 -- 172.21.15.42:0/344270923 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1698033e10 con 0x7f16ac15fbe0 2024-09-17T01:40:25.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.128+0000 7f16b2200640 1 -- 172.21.15.42:0/344270923 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16ac0ce420 con 0x7f16ac15fbe0 2024-09-17T01:40:25.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.128+0000 7f16a8c00640 1 -- 172.21.15.42:0/344270923 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1698005260 con 0x7f16ac15fbe0 2024-09-17T01:40:25.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.128+0000 7f16b2200640 1 -- 172.21.15.42:0/344270923 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16ac0ca650 con 0x7f16ac15fbe0 2024-09-17T01:40:25.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.129+0000 7f16b2200640 1 -- 172.21.15.42:0/344270923 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16ac0ce190 con 0x7f16ac15fbe0 2024-09-17T01:40:25.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.130+0000 7f16a8c00640 1 -- 172.21.15.42:0/344270923 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1698005400 con 0x7f16ac15fbe0 2024-09-17T01:40:25.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.131+0000 7f16a8c00640 1 --2- 172.21.15.42:0/344270923 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f168c078b90 0x7f168c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:25.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.131+0000 7f16a8c00640 1 -- 172.21.15.42:0/344270923 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5853+0+0 (secure 0 0 0) 0x7f16980bc110 con 0x7f16ac15fbe0 2024-09-17T01:40:25.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.131+0000 7f16b0e00640 1 --2- 172.21.15.42:0/344270923 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f168c078b90 0x7f168c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:25.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.132+0000 7f16b0e00640 1 --2- 172.21.15.42:0/344270923 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f168c078b90 0x7f168c07b0a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f16a0000f60 tx=0x7f16a0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:25.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.136+0000 7f16a8c00640 1 -- 172.21.15.42:0/344270923 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f169803f030 con 0x7f16ac15fbe0 2024-09-17T01:40:25.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.368+0000 7f16b2200640 1 -- 172.21.15.42:0/344270923 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16ac0b34b0 con 0x7f16ac15fbe0 2024-09-17T01:40:25.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.368+0000 7f16a8c00640 1 -- 172.21.15.42:0/344270923 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5225 (secure 0 0 0) 0x7f1698084420 con 0x7f16ac15fbe0 2024-09-17T01:40:25.366 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:40:25.366 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":89,"btime":"2024-09-17T01:38:46:390366+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6620,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3878726745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3878726745},{"type":"v1","addr":"172.21.15.43:6836","nonce":3878726745}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":7255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2458291962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":2458291962},{"type":"v1","addr":"172.21.15.42:6835","nonce":2458291962}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":7261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2788778312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2788778312},{"type":"v1","addr":"172.21.15.43:6837","nonce":2788778312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-17T01:38:36.843275+0000","modified":"2024-09-17T01:38:46.210966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7644},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7644":{"gid":7644,"name":"c","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6834/1078007521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1078007521},{"type":"v1","addr":"172.21.15.42:6834","nonce":1078007521}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7644,"qdb_cluster":[7644]},"id":7}]} 2024-09-17T01:40:25.366 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 89 2024-09-17T01:40:25.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.370+0000 7f16b2200640 1 -- 172.21.15.42:0/344270923 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f168c078b90 msgr2=0x7f168c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:25.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.370+0000 7f16b2200640 1 --2- 172.21.15.42:0/344270923 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f168c078b90 0x7f168c07b0a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f16a0000f60 tx=0x7f16a0009040 comp rx=0 tx=0).stop 2024-09-17T01:40:25.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.370+0000 7f16b2200640 1 -- 172.21.15.42:0/344270923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16ac15fbe0 msgr2=0x7f16ac0b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:25.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.370+0000 7f16b2200640 1 --2- 172.21.15.42:0/344270923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16ac15fbe0 0x7f16ac0b5060 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f1698009780 tx=0x7f1698033c20 comp rx=0 tx=0).stop 2024-09-17T01:40:25.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.370+0000 7f16b2200640 1 -- 172.21.15.42:0/344270923 shutdown_connections 2024-09-17T01:40:25.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.370+0000 7f16b2200640 1 --2- 172.21.15.42:0/344270923 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f168c078b90 0x7f168c07b0a0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:25.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.370+0000 7f16b2200640 1 --2- 172.21.15.42:0/344270923 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16ac162520 0x7f16ac0b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:25.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.370+0000 7f16b2200640 1 --2- 172.21.15.42:0/344270923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16ac15fbe0 0x7f16ac0b5060 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:25.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.370+0000 7f16b2200640 1 --2- 172.21.15.42:0/344270923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16ac0cfd80 0x7f16ac0b68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:25.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.370+0000 7f16b2200640 1 -- 172.21.15.42:0/344270923 >> 172.21.15.42:0/344270923 conn(0x7f16ac073f20 msgr2=0x7f16ac15ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:25.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.371+0000 7f16b2200640 1 -- 172.21.15.42:0/344270923 shutdown_connections 2024-09-17T01:40:25.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.371+0000 7f16b2200640 1 -- 172.21.15.42:0/344270923 wait complete. 2024-09-17T01:40:25.389 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:40:25.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.620+0000 7fd7de200640 1 -- 172.21.15.42:0/783366917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7d80d12a0 msgr2=0x7fd7d80cf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:25.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.620+0000 7fd7de200640 1 --2- 172.21.15.42:0/783366917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7d80d12a0 0x7fd7d80cf250 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fd7d815a8c0 tx=0x7fd7c802a560 comp rx=0 tx=0).stop 2024-09-17T01:40:25.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.620+0000 7fd7de200640 1 -- 172.21.15.42:0/783366917 shutdown_connections 2024-09-17T01:40:25.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.620+0000 7fd7de200640 1 --2- 172.21.15.42:0/783366917 >> v2:172.21.15.43:3300/0 conn(0x7fd7d80b55a0 0x7fd7d8068d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:25.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.620+0000 7fd7de200640 1 --2- 172.21.15.42:0/783366917 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7d815cd30 0x7fd7d80b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:25.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.620+0000 7fd7de200640 1 --2- 172.21.15.42:0/783366917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7d80d12a0 0x7fd7d80cf250 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:25.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.620+0000 7fd7de200640 1 -- 172.21.15.42:0/783366917 >> 172.21.15.42:0/783366917 conn(0x7fd7d80746c0 msgr2=0x7fd7d806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:25.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.620+0000 7fd7de200640 1 -- 172.21.15.42:0/783366917 shutdown_connections 2024-09-17T01:40:25.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.620+0000 7fd7de200640 1 -- 172.21.15.42:0/783366917 wait complete. 2024-09-17T01:40:25.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.622+0000 7fd7de200640 1 Processor -- start 2024-09-17T01:40:25.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.623+0000 7fd7de200640 1 -- start start 2024-09-17T01:40:25.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.624+0000 7fd7de200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7d80b55a0 0x7fd7d814ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:25.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.624+0000 7fd7de200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7d80d12a0 0x7fd7d81f7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:25.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.624+0000 7fd7de200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7d815cd30 0x7fd7d8151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:25.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.624+0000 7fd7de200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d80b5be0 con 0x7fd7d80b55a0 2024-09-17T01:40:25.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.624+0000 7fd7de200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d8069630 con 0x7fd7d815cd30 2024-09-17T01:40:25.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.624+0000 7fd7de200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd7d80b5d60 con 0x7fd7d80d12a0 2024-09-17T01:40:25.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.624+0000 7fd7d7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7d80b55a0 0x7fd7d814ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:25.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.624+0000 7fd7d7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7d80b55a0 0x7fd7d814ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36912/0 (socket says 172.21.15.42:36912) 2024-09-17T01:40:25.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.624+0000 7fd7d7400640 1 -- 172.21.15.42:0/4067002607 learned_addr learned my addr 172.21.15.42:0/4067002607 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:25.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.625+0000 7fd7d7e00640 1 --2- 172.21.15.42:0/4067002607 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7d815cd30 0x7fd7d8151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:25.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.625+0000 7fd7cfe00640 1 --2- 172.21.15.42:0/4067002607 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7d80d12a0 0x7fd7d81f7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:25.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.625+0000 7fd7d7400640 1 -- 172.21.15.42:0/4067002607 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7d80d12a0 msgr2=0x7fd7d81f7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:25.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.625+0000 7fd7d7400640 1 --2- 172.21.15.42:0/4067002607 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7d80d12a0 0x7fd7d81f7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:25.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.625+0000 7fd7d7400640 1 -- 172.21.15.42:0/4067002607 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7d815cd30 msgr2=0x7fd7d8151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:25.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.625+0000 7fd7d7400640 1 --2- 172.21.15.42:0/4067002607 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7d815cd30 0x7fd7d8151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:25.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.625+0000 7fd7d7400640 1 -- 172.21.15.42:0/4067002607 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d81e9890 con 0x7fd7d80b55a0 2024-09-17T01:40:25.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.625+0000 7fd7d7400640 1 --2- 172.21.15.42:0/4067002607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7d80b55a0 0x7fd7d814ecd0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8034040 tx=0x7fd7c80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:25.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.625+0000 7fd7cf400640 1 -- 172.21.15.42:0/4067002607 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c803e030 con 0x7fd7d80b55a0 2024-09-17T01:40:25.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.625+0000 7fd7cf400640 1 -- 172.21.15.42:0/4067002607 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7c8003ca0 con 0x7fd7d80b55a0 2024-09-17T01:40:25.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.625+0000 7fd7cf400640 1 -- 172.21.15.42:0/4067002607 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8035040 con 0x7fd7d80b55a0 2024-09-17T01:40:25.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.625+0000 7fd7de200640 1 -- 172.21.15.42:0/4067002607 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d81f3c60 con 0x7fd7d80b55a0 2024-09-17T01:40:25.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.626+0000 7fd7de200640 1 -- 172.21.15.42:0/4067002607 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d81f4220 con 0x7fd7d80b55a0 2024-09-17T01:40:25.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.627+0000 7fd7de200640 1 -- 172.21.15.42:0/4067002607 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7d80b6280 con 0x7fd7d80b55a0 2024-09-17T01:40:25.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.628+0000 7fd7cf400640 1 -- 172.21.15.42:0/4067002607 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd7c8041030 con 0x7fd7d80b55a0 2024-09-17T01:40:25.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.629+0000 7fd7cf400640 1 --2- 172.21.15.42:0/4067002607 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd7b4078bc0 0x7fd7b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:25.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.629+0000 7fd7cf400640 1 -- 172.21.15.42:0/4067002607 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5853+0+0 (secure 0 0 0) 0x7fd7c80bb510 con 0x7fd7d80b55a0 2024-09-17T01:40:25.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.629+0000 7fd7cfe00640 1 --2- 172.21.15.42:0/4067002607 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd7b4078bc0 0x7fd7b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:25.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.630+0000 7fd7cfe00640 1 --2- 172.21.15.42:0/4067002607 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd7b4078bc0 0x7fd7b407b0d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd7d806dfc0 tx=0x7fd7c0005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:25.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.633+0000 7fd7cf400640 1 -- 172.21.15.42:0/4067002607 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd7c80838c0 con 0x7fd7d80b55a0 2024-09-17T01:40:25.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.863+0000 7fd7de200640 1 -- 172.21.15.42:0/4067002607 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7d80d0d00 con 0x7fd7d80b55a0 2024-09-17T01:40:25.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.864+0000 7fd7cf400640 1 -- 172.21.15.42:0/4067002607 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5225 (secure 0 0 0) 0x7fd7c80831c0 con 0x7fd7d80b55a0 2024-09-17T01:40:25.862 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:40:25.862 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":89,"btime":"2024-09-17T01:38:46:390366+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6620,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3878726745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3878726745},{"type":"v1","addr":"172.21.15.43:6836","nonce":3878726745}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":7255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2458291962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":2458291962},{"type":"v1","addr":"172.21.15.42:6835","nonce":2458291962}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":7261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2788778312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2788778312},{"type":"v1","addr":"172.21.15.43:6837","nonce":2788778312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-17T01:38:36.843275+0000","modified":"2024-09-17T01:38:46.210966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7644},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7644":{"gid":7644,"name":"c","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6834/1078007521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1078007521},{"type":"v1","addr":"172.21.15.42:6834","nonce":1078007521}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7644,"qdb_cluster":[7644]},"id":7}]} 2024-09-17T01:40:25.862 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 89 2024-09-17T01:40:25.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.866+0000 7fd7de200640 1 -- 172.21.15.42:0/4067002607 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd7b4078bc0 msgr2=0x7fd7b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:25.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.866+0000 7fd7de200640 1 --2- 172.21.15.42:0/4067002607 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd7b4078bc0 0x7fd7b407b0d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd7d806dfc0 tx=0x7fd7c0005f90 comp rx=0 tx=0).stop 2024-09-17T01:40:25.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.866+0000 7fd7de200640 1 -- 172.21.15.42:0/4067002607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7d80b55a0 msgr2=0x7fd7d814ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.866+0000 7fd7de200640 1 --2- 172.21.15.42:0/4067002607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7d80b55a0 0x7fd7d814ecd0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8034040 tx=0x7fd7c80038a0 comp rx=0 tx=0).stop 2024-09-17T01:40:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.866+0000 7fd7de200640 1 -- 172.21.15.42:0/4067002607 shutdown_connections 2024-09-17T01:40:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.866+0000 7fd7de200640 1 --2- 172.21.15.42:0/4067002607 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd7b4078bc0 0x7fd7b407b0d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.866+0000 7fd7de200640 1 --2- 172.21.15.42:0/4067002607 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7d815cd30 0x7fd7d8151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.866+0000 7fd7de200640 1 --2- 172.21.15.42:0/4067002607 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7d80d12a0 0x7fd7d81f7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.866+0000 7fd7de200640 1 --2- 172.21.15.42:0/4067002607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7d80b55a0 0x7fd7d814ecd0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.866+0000 7fd7de200640 1 -- 172.21.15.42:0/4067002607 >> 172.21.15.42:0/4067002607 conn(0x7fd7d80746c0 msgr2=0x7fd7d80b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.866+0000 7fd7de200640 1 -- 172.21.15.42:0/4067002607 shutdown_connections 2024-09-17T01:40:25.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:25.867+0000 7fd7de200640 1 -- 172.21.15.42:0/4067002607 wait complete. 2024-09-17T01:40:25.887 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:40:26.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.116+0000 7f7c25e00640 1 -- 172.21.15.42:0/2072416577 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c20072520 msgr2=0x7f7c20072930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:26.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.116+0000 7f7c25e00640 1 --2- 172.21.15.42:0/2072416577 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c20072520 0x7f7c20072930 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7c18005fd0 tx=0x7f7c1802aaa0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.116+0000 7f7c25e00640 1 -- 172.21.15.42:0/2072416577 shutdown_connections 2024-09-17T01:40:26.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.117+0000 7f7c25e00640 1 --2- 172.21.15.42:0/2072416577 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c20072520 0x7f7c20072930 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.117+0000 7f7c25e00640 1 --2- 172.21.15.42:0/2072416577 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c2006d430 0x7f7c2006d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.117+0000 7f7c25e00640 1 -- 172.21.15.42:0/2072416577 >> 172.21.15.42:0/2072416577 conn(0x7f7c200b2930 msgr2=0x7f7c2006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:26.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.117+0000 7f7c25e00640 1 -- 172.21.15.42:0/2072416577 shutdown_connections 2024-09-17T01:40:26.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.117+0000 7f7c25e00640 1 -- 172.21.15.42:0/2072416577 wait complete. 2024-09-17T01:40:26.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.119+0000 7f7c25e00640 1 Processor -- start 2024-09-17T01:40:26.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.119+0000 7f7c25e00640 1 -- start start 2024-09-17T01:40:26.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.120+0000 7f7c25e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c2006d430 0x7f7c201329b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:26.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.120+0000 7f7c25e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c20072520 0x7f7c201f7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:26.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.120+0000 7f7c25e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c200afb80 0x7f7c200aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:26.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.120+0000 7f7c25e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7c20073080 con 0x7f7c2006d430 2024-09-17T01:40:26.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.120+0000 7f7c25e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7c201463a0 con 0x7f7c20072520 2024-09-17T01:40:26.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.120+0000 7f7c25e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7c20073200 con 0x7f7c200afb80 2024-09-17T01:40:26.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.121+0000 7f7c1ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c2006d430 0x7f7c201329b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:26.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.121+0000 7f7c1ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c2006d430 0x7f7c201329b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53382/0 (socket says 172.21.15.42:53382) 2024-09-17T01:40:26.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.121+0000 7f7c1ea00640 1 -- 172.21.15.42:0/2259868039 learned_addr learned my addr 172.21.15.42:0/2259868039 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:26.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.121+0000 7f7c17e00640 1 --2- 172.21.15.42:0/2259868039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c20072520 0x7f7c201f7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:26.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.121+0000 7f7c1f400640 1 --2- 172.21.15.42:0/2259868039 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c200afb80 0x7f7c200aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:26.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.121+0000 7f7c1ea00640 1 -- 172.21.15.42:0/2259868039 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c200afb80 msgr2=0x7f7c200aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:26.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.121+0000 7f7c1ea00640 1 --2- 172.21.15.42:0/2259868039 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c200afb80 0x7f7c200aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.121+0000 7f7c1ea00640 1 -- 172.21.15.42:0/2259868039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c20072520 msgr2=0x7f7c201f7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:26.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.121+0000 7f7c1ea00640 1 --2- 172.21.15.42:0/2259868039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c20072520 0x7f7c201f7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.121+0000 7f7c1ea00640 1 -- 172.21.15.42:0/2259868039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c201f8380 con 0x7f7c2006d430 2024-09-17T01:40:26.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.121+0000 7f7c1ea00640 1 --2- 172.21.15.42:0/2259868039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c2006d430 0x7f7c201329b0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000c3a0 tx=0x7f7c1000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:26.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.122+0000 7f7c17400640 1 -- 172.21.15.42:0/2259868039 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c10017070 con 0x7f7c2006d430 2024-09-17T01:40:26.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.122+0000 7f7c25e00640 1 -- 172.21.15.42:0/2259868039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c201f7dc0 con 0x7f7c2006d430 2024-09-17T01:40:26.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.122+0000 7f7c17400640 1 -- 172.21.15.42:0/2259868039 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c100053c0 con 0x7f7c2006d430 2024-09-17T01:40:26.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.122+0000 7f7c17400640 1 -- 172.21.15.42:0/2259868039 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c10003850 con 0x7f7c2006d430 2024-09-17T01:40:26.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.122+0000 7f7c25e00640 1 -- 172.21.15.42:0/2259868039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c201e6360 con 0x7f7c2006d430 2024-09-17T01:40:26.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.123+0000 7f7c25e00640 1 -- 172.21.15.42:0/2259868039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c20073790 con 0x7f7c2006d430 2024-09-17T01:40:26.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.124+0000 7f7c17400640 1 -- 172.21.15.42:0/2259868039 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7c1001a070 con 0x7f7c2006d430 2024-09-17T01:40:26.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.125+0000 7f7c17400640 1 --2- 172.21.15.42:0/2259868039 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7bfc078b90 0x7f7bfc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:26.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.125+0000 7f7c17400640 1 -- 172.21.15.42:0/2259868039 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5853+0+0 (secure 0 0 0) 0x7f7c1009a210 con 0x7f7c2006d430 2024-09-17T01:40:26.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.126+0000 7f7c17e00640 1 --2- 172.21.15.42:0/2259868039 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7bfc078b90 0x7f7bfc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:26.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.126+0000 7f7c17e00640 1 --2- 172.21.15.42:0/2259868039 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7bfc078b90 0x7f7bfc07b0a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7c20160230 tx=0x7f7c08005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:26.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.130+0000 7f7c17400640 1 -- 172.21.15.42:0/2259868039 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7c2006dd80 con 0x7f7c2006d430 2024-09-17T01:40:26.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.325+0000 7f7c25e00640 1 -- 172.21.15.42:0/2259868039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c2006a170 con 0x7f7c2006d430 2024-09-17T01:40:26.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.326+0000 7f7c17400640 1 -- 172.21.15.42:0/2259868039 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) ==== 74+0+16889 (secure 0 0 0) 0x7f7c10061e50 con 0x7f7c2006d430 2024-09-17T01:40:26.324 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:40:26.324 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":112,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:40:04.484278+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:38:34.801865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T01:38:35.805587+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":111,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.8","mappings":[{"from":5,"to":3}]},{"pgid":"14.b","mappings":[{"from":4,"to":3}]},{"pgid":"14.c","mappings":[{"from":5,"to":0}]},{"pgid":"14.1b","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:40:26.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.328+0000 7f7c25e00640 1 -- 172.21.15.42:0/2259868039 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7bfc078b90 msgr2=0x7f7bfc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:26.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.328+0000 7f7c25e00640 1 --2- 172.21.15.42:0/2259868039 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7bfc078b90 0x7f7bfc07b0a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7c20160230 tx=0x7f7c08005f90 comp rx=0 tx=0).stop 2024-09-17T01:40:26.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.328+0000 7f7c25e00640 1 -- 172.21.15.42:0/2259868039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c2006d430 msgr2=0x7f7c201329b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:26.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.328+0000 7f7c25e00640 1 --2- 172.21.15.42:0/2259868039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c2006d430 0x7f7c201329b0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000c3a0 tx=0x7f7c1000c860 comp rx=0 tx=0).stop 2024-09-17T01:40:26.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.328+0000 7f7c25e00640 1 -- 172.21.15.42:0/2259868039 shutdown_connections 2024-09-17T01:40:26.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.328+0000 7f7c25e00640 1 --2- 172.21.15.42:0/2259868039 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7bfc078b90 0x7f7bfc07b0a0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.328+0000 7f7c25e00640 1 --2- 172.21.15.42:0/2259868039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c20072520 0x7f7c201f7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.328+0000 7f7c25e00640 1 --2- 172.21.15.42:0/2259868039 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c200afb80 0x7f7c200aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.328+0000 7f7c25e00640 1 --2- 172.21.15.42:0/2259868039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c2006d430 0x7f7c201329b0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.328+0000 7f7c25e00640 1 -- 172.21.15.42:0/2259868039 >> 172.21.15.42:0/2259868039 conn(0x7f7c200b2930 msgr2=0x7f7c200b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:26.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.328+0000 7f7c25e00640 1 -- 172.21.15.42:0/2259868039 shutdown_connections 2024-09-17T01:40:26.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.329+0000 7f7c25e00640 1 -- 172.21.15.42:0/2259868039 wait complete. 2024-09-17T01:40:26.352 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T01:40:26.352 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:40:26.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.580+0000 7fa6e0000640 1 -- 172.21.15.42:0/1197639385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6d806d430 msgr2=0x7fa6d806d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.580+0000 7fa6e0000640 1 --2- 172.21.15.42:0/1197639385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6d806d430 0x7fa6d806d840 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0005fd0 tx=0x7fa6d002a8b0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.580+0000 7fa6e0000640 1 -- 172.21.15.42:0/1197639385 shutdown_connections 2024-09-17T01:40:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.580+0000 7fa6e0000640 1 --2- 172.21.15.42:0/1197639385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6d806d430 0x7fa6d806d840 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.580+0000 7fa6e0000640 1 --2- 172.21.15.42:0/1197639385 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa6d80cef70 0x7fa6d8156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.580+0000 7fa6e0000640 1 -- 172.21.15.42:0/1197639385 >> 172.21.15.42:0/1197639385 conn(0x7fa6d80b2930 msgr2=0x7fa6d806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.580+0000 7fa6e0000640 1 -- 172.21.15.42:0/1197639385 shutdown_connections 2024-09-17T01:40:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.580+0000 7fa6e0000640 1 -- 172.21.15.42:0/1197639385 wait complete. 2024-09-17T01:40:26.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.583+0000 7fa6e0000640 1 Processor -- start 2024-09-17T01:40:26.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.583+0000 7fa6e0000640 1 -- start start 2024-09-17T01:40:26.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.584+0000 7fa6e0000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6d806d430 0x7fa6d8158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.584+0000 7fa6e0000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa6d80b5100 0x7fa6d8147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.584+0000 7fa6e0000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6d80cef70 0x7fa6d8147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.584+0000 7fa6e0000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d8072970 con 0x7fa6d806d430 2024-09-17T01:40:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.584+0000 7fa6e0000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d80727f0 con 0x7fa6d80cef70 2024-09-17T01:40:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.584+0000 7fa6e0000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa6d8072af0 con 0x7fa6d80b5100 2024-09-17T01:40:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.584+0000 7fa6dd600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6d806d430 0x7fa6d8158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.584+0000 7fa6dd600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6d806d430 0x7fa6d8158d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53404/0 (socket says 172.21.15.42:53404) 2024-09-17T01:40:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.584+0000 7fa6dd600640 1 -- 172.21.15.42:0/3860986480 learned_addr learned my addr 172.21.15.42:0/3860986480 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.585+0000 7fa6dcc00640 1 --2- 172.21.15.42:0/3860986480 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa6d80b5100 0x7fa6d8147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.585+0000 7fa6de000640 1 --2- 172.21.15.42:0/3860986480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6d80cef70 0x7fa6d8147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.585+0000 7fa6dd600640 1 -- 172.21.15.42:0/3860986480 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa6d80b5100 msgr2=0x7fa6d8147480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.585+0000 7fa6dd600640 1 --2- 172.21.15.42:0/3860986480 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa6d80b5100 0x7fa6d8147480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.585+0000 7fa6dd600640 1 -- 172.21.15.42:0/3860986480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6d80cef70 msgr2=0x7fa6d8147c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:26.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.585+0000 7fa6dd600640 1 --2- 172.21.15.42:0/3860986480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6d80cef70 0x7fa6d8147c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.585+0000 7fa6dd600640 1 -- 172.21.15.42:0/3860986480 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d81479c0 con 0x7fa6d806d430 2024-09-17T01:40:26.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.585+0000 7fa6dd600640 1 --2- 172.21.15.42:0/3860986480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6d806d430 0x7fa6d8158d80 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc00c3d0 tx=0x7fa6cc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:26.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.585+0000 7fa6d5600640 1 -- 172.21.15.42:0/3860986480 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc011790 con 0x7fa6d806d430 2024-09-17T01:40:26.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.585+0000 7fa6d5600640 1 -- 172.21.15.42:0/3860986480 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6cc017070 con 0x7fa6d806d430 2024-09-17T01:40:26.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.586+0000 7fa6e0000640 1 -- 172.21.15.42:0/3860986480 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d8157ce0 con 0x7fa6d806d430 2024-09-17T01:40:26.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.586+0000 7fa6d5600640 1 -- 172.21.15.42:0/3860986480 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc011cc0 con 0x7fa6d806d430 2024-09-17T01:40:26.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.586+0000 7fa6e0000640 1 -- 172.21.15.42:0/3860986480 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d81582a0 con 0x7fa6d806d430 2024-09-17T01:40:26.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.587+0000 7fa6e0000640 1 -- 172.21.15.42:0/3860986480 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6d806d840 con 0x7fa6d806d430 2024-09-17T01:40:26.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.588+0000 7fa6d5600640 1 -- 172.21.15.42:0/3860986480 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa6cc01c460 con 0x7fa6d806d430 2024-09-17T01:40:26.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.589+0000 7fa6d5600640 1 --2- 172.21.15.42:0/3860986480 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa6b8078b90 0x7fa6b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:26.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.589+0000 7fa6d5600640 1 -- 172.21.15.42:0/3860986480 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5853+0+0 (secure 0 0 0) 0x7fa6cc09ab20 con 0x7fa6d806d430 2024-09-17T01:40:26.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.589+0000 7fa6dcc00640 1 --2- 172.21.15.42:0/3860986480 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa6b8078b90 0x7fa6b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:26.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.590+0000 7fa6dcc00640 1 --2- 172.21.15.42:0/3860986480 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa6b8078b90 0x7fa6b807b0a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8159500 tx=0x7fa6c4005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:26.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.596+0000 7fa6d5600640 1 -- 172.21.15.42:0/3860986480 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa6d806dd80 con 0x7fa6d806d430 2024-09-17T01:40:26.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.829+0000 7fa6e0000640 1 -- 172.21.15.42:0/3860986480 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6d806a170 con 0x7fa6d806d430 2024-09-17T01:40:26.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.829+0000 7fa6d5600640 1 -- 172.21.15.42:0/3860986480 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5225 (secure 0 0 0) 0x7fa6cc062f50 con 0x7fa6d806d430 2024-09-17T01:40:26.827 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:40:26.827 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":89,"btime":"2024-09-17T01:38:46:390366+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6620,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3878726745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3878726745},{"type":"v1","addr":"172.21.15.43:6836","nonce":3878726745}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":7255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2458291962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":2458291962},{"type":"v1","addr":"172.21.15.42:6835","nonce":2458291962}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":7261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2788778312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2788778312},{"type":"v1","addr":"172.21.15.43:6837","nonce":2788778312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-17T01:38:36.843275+0000","modified":"2024-09-17T01:38:46.210966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7644},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7644":{"gid":7644,"name":"c","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6834/1078007521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1078007521},{"type":"v1","addr":"172.21.15.42:6834","nonce":1078007521}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7644,"qdb_cluster":[7644]},"id":7}]} 2024-09-17T01:40:26.828 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 89 2024-09-17T01:40:26.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.832+0000 7fa6e0000640 1 -- 172.21.15.42:0/3860986480 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa6b8078b90 msgr2=0x7fa6b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:26.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.832+0000 7fa6e0000640 1 --2- 172.21.15.42:0/3860986480 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa6b8078b90 0x7fa6b807b0a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8159500 tx=0x7fa6c4005f90 comp rx=0 tx=0).stop 2024-09-17T01:40:26.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.832+0000 7fa6e0000640 1 -- 172.21.15.42:0/3860986480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6d806d430 msgr2=0x7fa6d8158d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:26.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.832+0000 7fa6e0000640 1 --2- 172.21.15.42:0/3860986480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6d806d430 0x7fa6d8158d80 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc00c3d0 tx=0x7fa6cc00c890 comp rx=0 tx=0).stop 2024-09-17T01:40:26.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.832+0000 7fa6e0000640 1 -- 172.21.15.42:0/3860986480 shutdown_connections 2024-09-17T01:40:26.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.832+0000 7fa6e0000640 1 --2- 172.21.15.42:0/3860986480 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa6b8078b90 0x7fa6b807b0a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.832+0000 7fa6e0000640 1 --2- 172.21.15.42:0/3860986480 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6d80cef70 0x7fa6d8147c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.832+0000 7fa6e0000640 1 --2- 172.21.15.42:0/3860986480 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa6d80b5100 0x7fa6d8147480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.832+0000 7fa6e0000640 1 --2- 172.21.15.42:0/3860986480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6d806d430 0x7fa6d8158d80 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.832+0000 7fa6e0000640 1 -- 172.21.15.42:0/3860986480 >> 172.21.15.42:0/3860986480 conn(0x7fa6d80b2930 msgr2=0x7fa6d8160d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:26.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.832+0000 7fa6e0000640 1 -- 172.21.15.42:0/3860986480 shutdown_connections 2024-09-17T01:40:26.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:26.832+0000 7fa6e0000640 1 -- 172.21.15.42:0/3860986480 wait complete. 2024-09-17T01:40:26.851 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:40:27.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.082+0000 7f7c07e00640 1 -- 172.21.15.42:0/27873030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bec004d40 msgr2=0x7f7bec005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:27.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.082+0000 7f7c07e00640 1 --2- 172.21.15.42:0/27873030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bec004d40 0x7f7bec005150 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f7c080d0e20 tx=0x7f7bec005830 comp rx=0 tx=0).stop 2024-09-17T01:40:27.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.082+0000 7f7c07400640 1 -- 172.21.15.42:0/27873030 reap_dead start 2024-09-17T01:40:27.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.082+0000 7f7c07e00640 1 -- 172.21.15.42:0/27873030 shutdown_connections 2024-09-17T01:40:27.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.082+0000 7f7c07e00640 1 -- 172.21.15.42:0/27873030 >> 172.21.15.42:0/27873030 conn(0x7f7c080b25f0 msgr2=0x7f7c080d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:27.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.082+0000 7f7c07e00640 1 -- 172.21.15.42:0/27873030 shutdown_connections 2024-09-17T01:40:27.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.082+0000 7f7c07e00640 1 -- 172.21.15.42:0/27873030 wait complete. 2024-09-17T01:40:27.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.084+0000 7f7c07e00640 1 Processor -- start 2024-09-17T01:40:27.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.084+0000 7f7c07e00640 1 -- start start 2024-09-17T01:40:27.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.086+0000 7f7c07e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bec004d40 0x7f7c080730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:27.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.086+0000 7f7c07e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c081435f0 0x7f7c0813fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:27.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.086+0000 7f7c07e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c081402e0 0x7f7c08145e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:27.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.086+0000 7f7c07e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0815d830 con 0x7f7c081402e0 2024-09-17T01:40:27.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.086+0000 7f7c07e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0815d6b0 con 0x7f7bec004d40 2024-09-17T01:40:27.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.086+0000 7f7c07e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7c0815d9b0 con 0x7f7c081435f0 2024-09-17T01:40:27.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.086+0000 7f7c07400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c081402e0 0x7f7c08145e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:27.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.086+0000 7f7c07400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c081402e0 0x7f7c08145e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53428/0 (socket says 172.21.15.42:53428) 2024-09-17T01:40:27.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.086+0000 7f7c07400640 1 -- 172.21.15.42:0/28462601 learned_addr learned my addr 172.21.15.42:0/28462601 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:27.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.086+0000 7f7c06a00640 1 --2- 172.21.15.42:0/28462601 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bec004d40 0x7f7c080730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:27.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.086+0000 7f7bffe00640 1 --2- 172.21.15.42:0/28462601 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c081435f0 0x7f7c0813fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:27.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.087+0000 7f7c07400640 1 -- 172.21.15.42:0/28462601 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c081435f0 msgr2=0x7f7c0813fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:27.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.087+0000 7f7c07400640 1 --2- 172.21.15.42:0/28462601 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c081435f0 0x7f7c0813fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.087+0000 7f7c07400640 1 -- 172.21.15.42:0/28462601 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bec004d40 msgr2=0x7f7c080730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:27.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.087+0000 7f7c07400640 1 --2- 172.21.15.42:0/28462601 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bec004d40 0x7f7c080730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.087+0000 7f7c07400640 1 -- 172.21.15.42:0/28462601 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0814fad0 con 0x7f7c081402e0 2024-09-17T01:40:27.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.087+0000 7f7c07400640 1 --2- 172.21.15.42:0/28462601 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c081402e0 0x7f7c08145e90 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f7c0002b5d0 tx=0x7f7c00004a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:27.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.087+0000 7f7bfea00640 1 -- 172.21.15.42:0/28462601 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0000c380 con 0x7f7c081402e0 2024-09-17T01:40:27.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.087+0000 7f7bfea00640 1 -- 172.21.15.42:0/28462601 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c00001a40 con 0x7f7c081402e0 2024-09-17T01:40:27.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.087+0000 7f7bfea00640 1 -- 172.21.15.42:0/28462601 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0002bb80 con 0x7f7c081402e0 2024-09-17T01:40:27.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.087+0000 7f7c07e00640 1 -- 172.21.15.42:0/28462601 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c08073a10 con 0x7f7c081402e0 2024-09-17T01:40:27.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.088+0000 7f7c07e00640 1 -- 172.21.15.42:0/28462601 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c08073fd0 con 0x7f7c081402e0 2024-09-17T01:40:27.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.089+0000 7f7c07e00640 1 -- 172.21.15.42:0/28462601 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c081538f0 con 0x7f7c081402e0 2024-09-17T01:40:27.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.090+0000 7f7bfea00640 1 -- 172.21.15.42:0/28462601 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7c00006030 con 0x7f7c081402e0 2024-09-17T01:40:27.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.091+0000 7f7bfea00640 1 --2- 172.21.15.42:0/28462601 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7be4078b90 0x7f7be407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:27.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.091+0000 7f7bfea00640 1 -- 172.21.15.42:0/28462601 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5853+0+0 (secure 0 0 0) 0x7f7c000ba420 con 0x7f7c081402e0 2024-09-17T01:40:27.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.091+0000 7f7c06a00640 1 --2- 172.21.15.42:0/28462601 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7be4078b90 0x7f7be407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:27.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.092+0000 7f7c06a00640 1 --2- 172.21.15.42:0/28462601 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7be4078b90 0x7f7be407b0a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009c50 tx=0x7f7bf8005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:27.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.095+0000 7f7bfea00640 1 -- 172.21.15.42:0/28462601 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7c00046070 con 0x7f7c081402e0 2024-09-17T01:40:27.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.332+0000 7f7c07e00640 1 -- 172.21.15.42:0/28462601 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c0815eda0 con 0x7f7c081402e0 2024-09-17T01:40:27.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.332+0000 7f7bfea00640 1 -- 172.21.15.42:0/28462601 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5225 (secure 0 0 0) 0x7f7c0815dbf0 con 0x7f7c081402e0 2024-09-17T01:40:27.330 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:40:27.330 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":89,"btime":"2024-09-17T01:38:46:390366+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6620,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3878726745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3878726745},{"type":"v1","addr":"172.21.15.43:6836","nonce":3878726745}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":7255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2458291962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":2458291962},{"type":"v1","addr":"172.21.15.42:6835","nonce":2458291962}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":7261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2788778312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2788778312},{"type":"v1","addr":"172.21.15.43:6837","nonce":2788778312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-17T01:38:36.843275+0000","modified":"2024-09-17T01:38:46.210966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7644},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7644":{"gid":7644,"name":"c","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6834/1078007521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1078007521},{"type":"v1","addr":"172.21.15.42:6834","nonce":1078007521}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7644,"qdb_cluster":[7644]},"id":7}]} 2024-09-17T01:40:27.331 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 89 2024-09-17T01:40:27.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.335+0000 7f7c07e00640 1 -- 172.21.15.42:0/28462601 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7be4078b90 msgr2=0x7f7be407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:27.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.335+0000 7f7c07e00640 1 --2- 172.21.15.42:0/28462601 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7be4078b90 0x7f7be407b0a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009c50 tx=0x7f7bf8005f90 comp rx=0 tx=0).stop 2024-09-17T01:40:27.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.335+0000 7f7c07e00640 1 -- 172.21.15.42:0/28462601 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c081402e0 msgr2=0x7f7c08145e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:27.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.335+0000 7f7c07e00640 1 --2- 172.21.15.42:0/28462601 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c081402e0 0x7f7c08145e90 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f7c0002b5d0 tx=0x7f7c00004a10 comp rx=0 tx=0).stop 2024-09-17T01:40:27.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.335+0000 7f7c07e00640 1 -- 172.21.15.42:0/28462601 shutdown_connections 2024-09-17T01:40:27.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.335+0000 7f7c07e00640 1 --2- 172.21.15.42:0/28462601 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7be4078b90 0x7f7be407b0a0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.335+0000 7f7c07e00640 1 --2- 172.21.15.42:0/28462601 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c081402e0 0x7f7c08145e90 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.335+0000 7f7c07e00640 1 --2- 172.21.15.42:0/28462601 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7c081435f0 0x7f7c0813fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.335+0000 7f7c07e00640 1 --2- 172.21.15.42:0/28462601 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bec004d40 0x7f7c080730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.335+0000 7f7c07e00640 1 -- 172.21.15.42:0/28462601 >> 172.21.15.42:0/28462601 conn(0x7f7c080b25f0 msgr2=0x7f7c080cdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:27.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.335+0000 7f7c07e00640 1 -- 172.21.15.42:0/28462601 shutdown_connections 2024-09-17T01:40:27.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.335+0000 7f7c07e00640 1 -- 172.21.15.42:0/28462601 wait complete. 2024-09-17T01:40:27.354 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:40:27.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.584+0000 7f1bbf200640 1 -- 172.21.15.42:0/3483331689 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ba4003a00 msgr2=0x7f1ba4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:27.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.584+0000 7f1bbf200640 1 --2- 172.21.15.42:0/3483331689 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ba4003a00 0x7f1ba4003e70 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009b50 tx=0x7f1ba4005830 comp rx=0 tx=0).stop 2024-09-17T01:40:27.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.584+0000 7f1bbe800640 1 -- 172.21.15.42:0/3483331689 reap_dead start 2024-09-17T01:40:27.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.584+0000 7f1bbf200640 1 -- 172.21.15.42:0/3483331689 shutdown_connections 2024-09-17T01:40:27.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.584+0000 7f1bbf200640 1 -- 172.21.15.42:0/3483331689 >> 172.21.15.42:0/3483331689 conn(0x7f1bc0073f20 msgr2=0x7f1bc006cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:27.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.584+0000 7f1bbf200640 1 -- 172.21.15.42:0/3483331689 shutdown_connections 2024-09-17T01:40:27.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.584+0000 7f1bbf200640 1 -- 172.21.15.42:0/3483331689 wait complete. 2024-09-17T01:40:27.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.586+0000 7f1bbf200640 1 Processor -- start 2024-09-17T01:40:27.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.587+0000 7f1bbf200640 1 -- start start 2024-09-17T01:40:27.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.588+0000 7f1bbf200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ba4003a00 0x7f1bc015a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:27.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.588+0000 7f1bbf200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bc00cbc10 0x7f1bc01613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:27.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.588+0000 7f1bbf200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bc015fff0 0x7f1bc0160400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.588+0000 7f1bbf200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc015c750 con 0x7f1ba4003a00 2024-09-17T01:40:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.588+0000 7f1bbf200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc015c5d0 con 0x7f1bc00cbc10 2024-09-17T01:40:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.588+0000 7f1bbf200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc015c8d0 con 0x7f1bc015fff0 2024-09-17T01:40:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.588+0000 7f1bbde00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ba4003a00 0x7f1bc015a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.588+0000 7f1bbde00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ba4003a00 0x7f1bc015a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53452/0 (socket says 172.21.15.42:53452) 2024-09-17T01:40:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.588+0000 7f1bbde00640 1 -- 172.21.15.42:0/3533431688 learned_addr learned my addr 172.21.15.42:0/3533431688 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.588+0000 7f1bb7e00640 1 --2- 172.21.15.42:0/3533431688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bc00cbc10 0x7f1bc01613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.588+0000 7f1bbe800640 1 --2- 172.21.15.42:0/3533431688 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bc015fff0 0x7f1bc0160400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.589+0000 7f1bbde00640 1 -- 172.21.15.42:0/3533431688 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bc015fff0 msgr2=0x7f1bc0160400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.589+0000 7f1bbde00640 1 --2- 172.21.15.42:0/3533431688 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bc015fff0 0x7f1bc0160400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.589+0000 7f1bbde00640 1 -- 172.21.15.42:0/3533431688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bc00cbc10 msgr2=0x7f1bc01613c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.589+0000 7f1bbde00640 1 --2- 172.21.15.42:0/3533431688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bc00cbc10 0x7f1bc01613c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.589+0000 7f1bbde00640 1 -- 172.21.15.42:0/3533431688 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc0161900 con 0x7f1ba4003a00 2024-09-17T01:40:27.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.589+0000 7f1bbe800640 1 --2- 172.21.15.42:0/3533431688 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bc015fff0 0x7f1bc0160400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:40:27.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.589+0000 7f1bbde00640 1 --2- 172.21.15.42:0/3533431688 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ba4003a00 0x7f1bc015a1c0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0036040 tx=0x7f1bb0033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:27.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.592+0000 7f1bb6000640 1 -- 172.21.15.42:0/3533431688 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0038050 con 0x7f1ba4003a00 2024-09-17T01:40:27.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.592+0000 7f1bb6000640 1 -- 172.21.15.42:0/3533431688 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bb0039040 con 0x7f1ba4003a00 2024-09-17T01:40:27.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.592+0000 7f1bb6000640 1 -- 172.21.15.42:0/3533431688 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb00339f0 con 0x7f1ba4003a00 2024-09-17T01:40:27.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.592+0000 7f1bbf200640 1 -- 172.21.15.42:0/3533431688 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc0157570 con 0x7f1ba4003a00 2024-09-17T01:40:27.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.592+0000 7f1bbf200640 1 -- 172.21.15.42:0/3533431688 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc01609b0 con 0x7f1ba4003a00 2024-09-17T01:40:27.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.593+0000 7f1bbf200640 1 -- 172.21.15.42:0/3533431688 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc00cf840 con 0x7f1ba4003a00 2024-09-17T01:40:27.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.594+0000 7f1bb6000640 1 -- 172.21.15.42:0/3533431688 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1bb0046020 con 0x7f1ba4003a00 2024-09-17T01:40:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.595+0000 7f1bb6000640 1 --2- 172.21.15.42:0/3533431688 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b9c078b90 0x7f1b9c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.595+0000 7f1bb6000640 1 -- 172.21.15.42:0/3533431688 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5853+0+0 (secure 0 0 0) 0x7f1bb00bb9b0 con 0x7f1ba4003a00 2024-09-17T01:40:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.596+0000 7f1bb7e00640 1 --2- 172.21.15.42:0/3533431688 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b9c078b90 0x7f1b9c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:27.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.597+0000 7f1bb7e00640 1 --2- 172.21.15.42:0/3533431688 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b9c078b90 0x7f1b9c07b0a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f1bc015edf0 tx=0x7f1ba8005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:27.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.601+0000 7f1bb6000640 1 -- 172.21.15.42:0/3533431688 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1bb0083de0 con 0x7f1ba4003a00 2024-09-17T01:40:27.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.796+0000 7f1bbf200640 1 -- 172.21.15.42:0/3533431688 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1bc006d240 con 0x7f1ba4003a00 2024-09-17T01:40:27.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.797+0000 7f1bb6000640 1 -- 172.21.15.42:0/3533431688 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) ==== 74+0+16889 (secure 0 0 0) 0x7f1bb00836e0 con 0x7f1ba4003a00 2024-09-17T01:40:27.795 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:40:27.796 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":112,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:40:04.484278+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:38:34.801865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T01:38:35.805587+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":111,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.8","mappings":[{"from":5,"to":3}]},{"pgid":"14.b","mappings":[{"from":4,"to":3}]},{"pgid":"14.c","mappings":[{"from":5,"to":0}]},{"pgid":"14.1b","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:40:27.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.800+0000 7f1bbf200640 1 -- 172.21.15.42:0/3533431688 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b9c078b90 msgr2=0x7f1b9c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:27.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.800+0000 7f1bbf200640 1 --2- 172.21.15.42:0/3533431688 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b9c078b90 0x7f1b9c07b0a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f1bc015edf0 tx=0x7f1ba8005f90 comp rx=0 tx=0).stop 2024-09-17T01:40:27.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.800+0000 7f1bbf200640 1 -- 172.21.15.42:0/3533431688 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ba4003a00 msgr2=0x7f1bc015a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:27.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.800+0000 7f1bbf200640 1 --2- 172.21.15.42:0/3533431688 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ba4003a00 0x7f1bc015a1c0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0036040 tx=0x7f1bb0033670 comp rx=0 tx=0).stop 2024-09-17T01:40:27.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.800+0000 7f1bbf200640 1 -- 172.21.15.42:0/3533431688 shutdown_connections 2024-09-17T01:40:27.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.800+0000 7f1bbf200640 1 --2- 172.21.15.42:0/3533431688 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b9c078b90 0x7f1b9c07b0a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.800+0000 7f1bbf200640 1 --2- 172.21.15.42:0/3533431688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bc00cbc10 0x7f1bc01613c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.800+0000 7f1bbf200640 1 --2- 172.21.15.42:0/3533431688 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bc015fff0 0x7f1bc0160400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.800+0000 7f1bbf200640 1 --2- 172.21.15.42:0/3533431688 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1ba4003a00 0x7f1bc015a1c0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.800+0000 7f1bbf200640 1 -- 172.21.15.42:0/3533431688 >> 172.21.15.42:0/3533431688 conn(0x7f1bc0073f20 msgr2=0x7f1bc00b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:27.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.800+0000 7f1bbf200640 1 -- 172.21.15.42:0/3533431688 shutdown_connections 2024-09-17T01:40:27.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:27.800+0000 7f1bbf200640 1 -- 172.21.15.42:0/3533431688 wait complete. 2024-09-17T01:40:27.819 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T01:40:28.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.051+0000 7fd387c00640 1 -- 172.21.15.42:0/2736618751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd38015f480 msgr2=0x7fd38015f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:28.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.051+0000 7fd387c00640 1 --2- 172.21.15.42:0/2736618751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd38015f480 0x7fd38015f890 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fd378005fd0 tx=0x7fd37802a8b0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.051+0000 7fd387c00640 1 -- 172.21.15.42:0/2736618751 shutdown_connections 2024-09-17T01:40:28.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.051+0000 7fd387c00640 1 --2- 172.21.15.42:0/2736618751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd38015f480 0x7fd38015f890 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.051+0000 7fd387c00640 1 -- 172.21.15.42:0/2736618751 >> 172.21.15.42:0/2736618751 conn(0x7fd3800b2930 msgr2=0x7fd38006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:28.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.051+0000 7fd387c00640 1 -- 172.21.15.42:0/2736618751 shutdown_connections 2024-09-17T01:40:28.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.051+0000 7fd387c00640 1 -- 172.21.15.42:0/2736618751 wait complete. 2024-09-17T01:40:28.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.054+0000 7fd387c00640 1 Processor -- start 2024-09-17T01:40:28.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.054+0000 7fd387c00640 1 -- start start 2024-09-17T01:40:28.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.055+0000 7fd387c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd38006d430 0x7fd3800ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:28.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.055+0000 7fd387c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd38015cb80 0x7fd380154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:28.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.055+0000 7fd387c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd38015f480 0x7fd380154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:28.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.055+0000 7fd387c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd380073960 con 0x7fd38015cb80 2024-09-17T01:40:28.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.055+0000 7fd387c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd3800737e0 con 0x7fd38015f480 2024-09-17T01:40:28.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.055+0000 7fd387c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd380073ae0 con 0x7fd38006d430 2024-09-17T01:40:28.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.056+0000 7fd37fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd38015cb80 0x7fd380154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:28.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.056+0000 7fd37fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd38015cb80 0x7fd380154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53474/0 (socket says 172.21.15.42:53474) 2024-09-17T01:40:28.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.056+0000 7fd37fe00640 1 -- 172.21.15.42:0/3785296134 learned_addr learned my addr 172.21.15.42:0/3785296134 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:28.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.056+0000 7fd385c00640 1 --2- 172.21.15.42:0/3785296134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd38015f480 0x7fd380154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:28.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.056+0000 7fd385200640 1 --2- 172.21.15.42:0/3785296134 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd38006d430 0x7fd3800ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:28.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.056+0000 7fd37fe00640 1 -- 172.21.15.42:0/3785296134 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd38006d430 msgr2=0x7fd3800ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:28.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.056+0000 7fd37fe00640 1 --2- 172.21.15.42:0/3785296134 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd38006d430 0x7fd3800ae100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.056+0000 7fd37fe00640 1 -- 172.21.15.42:0/3785296134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd38015f480 msgr2=0x7fd380154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:28.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.056+0000 7fd37fe00640 1 --2- 172.21.15.42:0/3785296134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd38015f480 0x7fd380154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.056+0000 7fd37fe00640 1 -- 172.21.15.42:0/3785296134 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38013fe60 con 0x7fd38015cb80 2024-09-17T01:40:28.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.056+0000 7fd385200640 1 --2- 172.21.15.42:0/3785296134 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd38006d430 0x7fd3800ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:40:28.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.057+0000 7fd37fe00640 1 --2- 172.21.15.42:0/3785296134 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd38015cb80 0x7fd380154590 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00b420 tx=0x7fd36c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:28.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.057+0000 7fd37cc00640 1 -- 172.21.15.42:0/3785296134 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c011830 con 0x7fd38015cb80 2024-09-17T01:40:28.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.057+0000 7fd387c00640 1 -- 172.21.15.42:0/3785296134 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd380140140 con 0x7fd38015cb80 2024-09-17T01:40:28.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.057+0000 7fd37cc00640 1 -- 172.21.15.42:0/3785296134 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd36c016070 con 0x7fd38015cb80 2024-09-17T01:40:28.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.057+0000 7fd37cc00640 1 -- 172.21.15.42:0/3785296134 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c011d60 con 0x7fd38015cb80 2024-09-17T01:40:28.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.057+0000 7fd387c00640 1 -- 172.21.15.42:0/3785296134 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd380140700 con 0x7fd38015cb80 2024-09-17T01:40:28.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.058+0000 7fd387c00640 1 -- 172.21.15.42:0/3785296134 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3800ae7a0 con 0x7fd38015cb80 2024-09-17T01:40:28.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.060+0000 7fd37cc00640 1 -- 172.21.15.42:0/3785296134 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd36c01b460 con 0x7fd38015cb80 2024-09-17T01:40:28.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.061+0000 7fd37cc00640 1 --2- 172.21.15.42:0/3785296134 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd360078b90 0x7fd36007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:28.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.061+0000 7fd37cc00640 1 -- 172.21.15.42:0/3785296134 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5853+0+0 (secure 0 0 0) 0x7fd36c09a8b0 con 0x7fd38015cb80 2024-09-17T01:40:28.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.061+0000 7fd385200640 1 --2- 172.21.15.42:0/3785296134 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd360078b90 0x7fd36007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:28.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.062+0000 7fd385200640 1 --2- 172.21.15.42:0/3785296134 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd360078b90 0x7fd36007b0a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd374000f60 tx=0x7fd374009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:28.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.065+0000 7fd37cc00640 1 -- 172.21.15.42:0/3785296134 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd36c020020 con 0x7fd38015cb80 2024-09-17T01:40:28.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.301+0000 7fd387c00640 1 -- 172.21.15.42:0/3785296134 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd38015f890 con 0x7fd38015cb80 2024-09-17T01:40:28.299 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-17T01:40:28.302+0000 7f9961e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:40:28.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.304+0000 7fd37cc00640 1 -- 172.21.15.42:0/3785296134 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v90) ==== 161+0+0 (secure 0 0 0) 0x7fd36c062be0 con 0x7fd38015cb80 2024-09-17T01:40:28.302 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T01:40:28.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.307+0000 7fd387c00640 1 -- 172.21.15.42:0/3785296134 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd360078b90 msgr2=0x7fd36007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:28.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.307+0000 7fd387c00640 1 --2- 172.21.15.42:0/3785296134 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd360078b90 0x7fd36007b0a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd374000f60 tx=0x7fd374009040 comp rx=0 tx=0).stop 2024-09-17T01:40:28.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.307+0000 7fd387c00640 1 -- 172.21.15.42:0/3785296134 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd38015cb80 msgr2=0x7fd380154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:28.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.307+0000 7fd387c00640 1 --2- 172.21.15.42:0/3785296134 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd38015cb80 0x7fd380154590 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00b420 tx=0x7fd36c00b8e0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.309+0000 7fd387c00640 1 -- 172.21.15.42:0/3785296134 shutdown_connections 2024-09-17T01:40:28.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.309+0000 7fd387c00640 1 --2- 172.21.15.42:0/3785296134 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd360078b90 0x7fd36007b0a0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.309+0000 7fd387c00640 1 --2- 172.21.15.42:0/3785296134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd38015f480 0x7fd380154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.309+0000 7fd387c00640 1 --2- 172.21.15.42:0/3785296134 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd38015cb80 0x7fd380154590 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.309+0000 7fd387c00640 1 --2- 172.21.15.42:0/3785296134 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd38006d430 0x7fd3800ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.309+0000 7fd387c00640 1 -- 172.21.15.42:0/3785296134 >> 172.21.15.42:0/3785296134 conn(0x7fd3800b2930 msgr2=0x7fd3800cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:28.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.309+0000 7fd387c00640 1 -- 172.21.15.42:0/3785296134 shutdown_connections 2024-09-17T01:40:28.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.309+0000 7fd387c00640 1 -- 172.21.15.42:0/3785296134 wait complete. 2024-09-17T01:40:28.328 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T01:40:28.456 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:40:28.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.563+0000 7f7e63400640 1 -- 172.21.15.42:0/3213761523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e5c0b3880 msgr2=0x7f7e5c0af980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:28.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.563+0000 7f7e63400640 1 --2- 172.21.15.42:0/3213761523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e5c0b3880 0x7f7e5c0af980 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c005fd0 tx=0x7f7e4c02a5d0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.563+0000 7f7e63400640 1 -- 172.21.15.42:0/3213761523 shutdown_connections 2024-09-17T01:40:28.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.563+0000 7f7e63400640 1 --2- 172.21.15.42:0/3213761523 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e5c15cfc0 0x7f7e5c0ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.563+0000 7f7e63400640 1 --2- 172.21.15.42:0/3213761523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e5c0b3880 0x7f7e5c0af980 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.563+0000 7f7e63400640 1 -- 172.21.15.42:0/3213761523 >> 172.21.15.42:0/3213761523 conn(0x7f7e5c0b2930 msgr2=0x7f7e5c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:28.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.563+0000 7f7e63400640 1 -- 172.21.15.42:0/3213761523 shutdown_connections 2024-09-17T01:40:28.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.563+0000 7f7e63400640 1 -- 172.21.15.42:0/3213761523 wait complete. 2024-09-17T01:40:28.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.565+0000 7f7e63400640 1 Processor -- start 2024-09-17T01:40:28.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.565+0000 7f7e63400640 1 -- start start 2024-09-17T01:40:28.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.567+0000 7f7e63400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e5c06d430 0x7f7e5c152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:28.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.567+0000 7f7e63400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e5c0b3880 0x7f7e5c1f3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:28.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.567+0000 7f7e63400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e5c15cfc0 0x7f7e5c1f3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:28.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.567+0000 7f7e63400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c072ad0 con 0x7f7e5c15cfc0 2024-09-17T01:40:28.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.567+0000 7f7e63400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c072950 con 0x7f7e5c06d430 2024-09-17T01:40:28.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.567+0000 7f7e63400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7e5c072c50 con 0x7f7e5c0b3880 2024-09-17T01:40:28.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.567+0000 7f7e61400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e5c15cfc0 0x7f7e5c1f3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:28.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.567+0000 7f7e61400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e5c15cfc0 0x7f7e5c1f3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53508/0 (socket says 172.21.15.42:53508) 2024-09-17T01:40:28.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.567+0000 7f7e61400640 1 -- 172.21.15.42:0/2194716272 learned_addr learned my addr 172.21.15.42:0/2194716272 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:28.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.567+0000 7f7e60a00640 1 --2- 172.21.15.42:0/2194716272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e5c06d430 0x7f7e5c152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:28.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.567+0000 7f7e5be00640 1 --2- 172.21.15.42:0/2194716272 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e5c0b3880 0x7f7e5c1f3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:28.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.568+0000 7f7e61400640 1 -- 172.21.15.42:0/2194716272 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e5c0b3880 msgr2=0x7f7e5c1f3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:28.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.568+0000 7f7e61400640 1 --2- 172.21.15.42:0/2194716272 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e5c0b3880 0x7f7e5c1f3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.568+0000 7f7e61400640 1 -- 172.21.15.42:0/2194716272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e5c06d430 msgr2=0x7f7e5c152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:28.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.568+0000 7f7e61400640 1 --2- 172.21.15.42:0/2194716272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e5c06d430 0x7f7e5c152760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.568+0000 7f7e61400640 1 -- 172.21.15.42:0/2194716272 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e5c155ef0 con 0x7f7e5c15cfc0 2024-09-17T01:40:28.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.568+0000 7f7e60a00640 1 --2- 172.21.15.42:0/2194716272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e5c06d430 0x7f7e5c152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:40:28.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.568+0000 7f7e61400640 1 --2- 172.21.15.42:0/2194716272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e5c15cfc0 0x7f7e5c1f3d50 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400c730 tx=0x7f7e5400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:28.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.568+0000 7f7e58c00640 1 -- 172.21.15.42:0/2194716272 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e54003b70 con 0x7f7e5c15cfc0 2024-09-17T01:40:28.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.569+0000 7f7e58c00640 1 -- 172.21.15.42:0/2194716272 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e54003d10 con 0x7f7e5c15cfc0 2024-09-17T01:40:28.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.569+0000 7f7e58c00640 1 -- 172.21.15.42:0/2194716272 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e54005330 con 0x7f7e5c15cfc0 2024-09-17T01:40:28.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.569+0000 7f7e63400640 1 -- 172.21.15.42:0/2194716272 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e5c0ab160 con 0x7f7e5c15cfc0 2024-09-17T01:40:28.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.569+0000 7f7e63400640 1 -- 172.21.15.42:0/2194716272 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e5c156170 con 0x7f7e5c15cfc0 2024-09-17T01:40:28.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.570+0000 7f7e63400640 1 -- 172.21.15.42:0/2194716272 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e5c0af420 con 0x7f7e5c15cfc0 2024-09-17T01:40:28.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.571+0000 7f7e58c00640 1 -- 172.21.15.42:0/2194716272 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7e540056e0 con 0x7f7e5c15cfc0 2024-09-17T01:40:28.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.572+0000 7f7e58c00640 1 --2- 172.21.15.42:0/2194716272 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7e3c078bc0 0x7f7e3c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:28.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.572+0000 7f7e58c00640 1 -- 172.21.15.42:0/2194716272 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5911+0+0 (secure 0 0 0) 0x7f7e5409abf0 con 0x7f7e5c15cfc0 2024-09-17T01:40:28.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.573+0000 7f7e60a00640 1 --2- 172.21.15.42:0/2194716272 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7e3c078bc0 0x7f7e3c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:28.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.573+0000 7f7e60a00640 1 --2- 172.21.15.42:0/2194716272 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7e3c078bc0 0x7f7e3c07b0d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c033000 tx=0x7f7e4c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:28.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.576+0000 7f7e58c00640 1 -- 172.21.15.42:0/2194716272 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7e5c0ab160 con 0x7f7e5c15cfc0 2024-09-17T01:40:28.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:28.812+0000 7f7e63400640 1 -- 172.21.15.42:0/2194716272 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f7e5c0af980 con 0x7f7e5c15cfc0 2024-09-17T01:40:29.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.306+0000 7f7e58c00640 1 -- 172.21.15.42:0/2194716272 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v91) ==== 104+0+0 (secure 0 0 0) 0x7f7e5c155ef0 con 0x7f7e5c15cfc0 2024-09-17T01:40:29.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.309+0000 7f7e63400640 1 -- 172.21.15.42:0/2194716272 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7e3c078bc0 msgr2=0x7f7e3c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:29.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.309+0000 7f7e63400640 1 --2- 172.21.15.42:0/2194716272 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7e3c078bc0 0x7f7e3c07b0d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c033000 tx=0x7f7e4c004730 comp rx=0 tx=0).stop 2024-09-17T01:40:29.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.309+0000 7f7e63400640 1 -- 172.21.15.42:0/2194716272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e5c15cfc0 msgr2=0x7f7e5c1f3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:29.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.309+0000 7f7e63400640 1 --2- 172.21.15.42:0/2194716272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e5c15cfc0 0x7f7e5c1f3d50 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400c730 tx=0x7f7e5400cbf0 comp rx=0 tx=0).stop 2024-09-17T01:40:29.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.309+0000 7f7e63400640 1 -- 172.21.15.42:0/2194716272 shutdown_connections 2024-09-17T01:40:29.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.309+0000 7f7e63400640 1 --2- 172.21.15.42:0/2194716272 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7e3c078bc0 0x7f7e3c07b0d0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:29.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.309+0000 7f7e63400640 1 --2- 172.21.15.42:0/2194716272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e5c15cfc0 0x7f7e5c1f3d50 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:29.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.309+0000 7f7e63400640 1 --2- 172.21.15.42:0/2194716272 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e5c0b3880 0x7f7e5c1f3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:29.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.309+0000 7f7e63400640 1 --2- 172.21.15.42:0/2194716272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e5c06d430 0x7f7e5c152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:29.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.309+0000 7f7e63400640 1 -- 172.21.15.42:0/2194716272 >> 172.21.15.42:0/2194716272 conn(0x7f7e5c0b2930 msgr2=0x7f7e5c160110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:29.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.309+0000 7f7e63400640 1 -- 172.21.15.42:0/2194716272 shutdown_connections 2024-09-17T01:40:29.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.309+0000 7f7e63400640 1 -- 172.21.15.42:0/2194716272 wait complete. 2024-09-17T01:40:29.333 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T01:40:29.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.572+0000 7f3156e00640 1 -- 172.21.15.42:0/2219292807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3150162420 msgr2=0x7f31500d0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:29.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.572+0000 7f3156e00640 1 --2- 172.21.15.42:0/2219292807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3150162420 0x7f31500d0530 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f31500d1d20 tx=0x7f314802aa30 comp rx=0 tx=0).stop 2024-09-17T01:40:29.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.572+0000 7f3156e00640 1 -- 172.21.15.42:0/2219292807 shutdown_connections 2024-09-17T01:40:29.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.572+0000 7f3156e00640 1 --2- 172.21.15.42:0/2219292807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3150162420 0x7f31500d0530 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:29.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.572+0000 7f3156e00640 1 --2- 172.21.15.42:0/2219292807 >> v2:172.21.15.43:3300/0 conn(0x7f315006cf30 0x7f31500b7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:29.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.572+0000 7f3156e00640 1 -- 172.21.15.42:0/2219292807 >> 172.21.15.42:0/2219292807 conn(0x7f31500b4130 msgr2=0x7f31500b4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:29.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.572+0000 7f3156e00640 1 -- 172.21.15.42:0/2219292807 shutdown_connections 2024-09-17T01:40:29.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.572+0000 7f3156e00640 1 -- 172.21.15.42:0/2219292807 wait complete. 2024-09-17T01:40:29.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.574+0000 7f3156e00640 1 Processor -- start 2024-09-17T01:40:29.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.574+0000 7f3156e00640 1 -- start start 2024-09-17T01:40:29.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.575+0000 7f3156e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f315006cf30 0x7f31500b2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:29.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.575+0000 7f3156e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31500b7dc0 0x7f31500b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:29.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.575+0000 7f3156e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3150162420 0x7f31501f8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:29.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.576+0000 7f3156e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f31500d0e00 con 0x7f315006cf30 2024-09-17T01:40:29.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.576+0000 7f3156e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f31500d0c80 con 0x7f3150162420 2024-09-17T01:40:29.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.576+0000 7f3156e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f31500d0f80 con 0x7f31500b7dc0 2024-09-17T01:40:29.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.576+0000 7f314fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f315006cf30 0x7f31500b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:29.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.576+0000 7f314fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f315006cf30 0x7f31500b2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53520/0 (socket says 172.21.15.42:53520) 2024-09-17T01:40:29.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.576+0000 7f314fe00640 1 -- 172.21.15.42:0/406126612 learned_addr learned my addr 172.21.15.42:0/406126612 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:29.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.576+0000 7f3147400640 1 --2- 172.21.15.42:0/406126612 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31500b7dc0 0x7f31500b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:29.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.576+0000 7f3154e00640 1 --2- 172.21.15.42:0/406126612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3150162420 0x7f31501f8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:29.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.576+0000 7f314fe00640 1 -- 172.21.15.42:0/406126612 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31500b7dc0 msgr2=0x7f31500b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:29.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.576+0000 7f314fe00640 1 --2- 172.21.15.42:0/406126612 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31500b7dc0 0x7f31500b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:29.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.576+0000 7f314fe00640 1 -- 172.21.15.42:0/406126612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3150162420 msgr2=0x7f31501f8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:29.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.576+0000 7f314fe00640 1 --2- 172.21.15.42:0/406126612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3150162420 0x7f31501f8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:29.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.576+0000 7f314fe00640 1 -- 172.21.15.42:0/406126612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31500b2b60 con 0x7f315006cf30 2024-09-17T01:40:29.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.577+0000 7f314fe00640 1 --2- 172.21.15.42:0/406126612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f315006cf30 0x7f31500b2310 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f314000c3a0 tx=0x7f314000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:29.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.577+0000 7f314cc00640 1 -- 172.21.15.42:0/406126612 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31400052d0 con 0x7f315006cf30 2024-09-17T01:40:29.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.577+0000 7f314cc00640 1 -- 172.21.15.42:0/406126612 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3140007020 con 0x7f315006cf30 2024-09-17T01:40:29.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.577+0000 7f314cc00640 1 -- 172.21.15.42:0/406126612 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3140007470 con 0x7f315006cf30 2024-09-17T01:40:29.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.577+0000 7f3156e00640 1 -- 172.21.15.42:0/406126612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31500b2e40 con 0x7f315006cf30 2024-09-17T01:40:29.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.577+0000 7f3156e00640 1 -- 172.21.15.42:0/406126612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31500b3400 con 0x7f315006cf30 2024-09-17T01:40:29.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.578+0000 7f3156e00640 1 -- 172.21.15.42:0/406126612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31500d0530 con 0x7f315006cf30 2024-09-17T01:40:29.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.579+0000 7f314cc00640 1 -- 172.21.15.42:0/406126612 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f31400067d0 con 0x7f315006cf30 2024-09-17T01:40:29.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.581+0000 7f314cc00640 1 --2- 172.21.15.42:0/406126612 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f312c078b90 0x7f312c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:29.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.581+0000 7f314cc00640 1 -- 172.21.15.42:0/406126612 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5911+0+0 (secure 0 0 0) 0x7f314009a240 con 0x7f315006cf30 2024-09-17T01:40:29.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.581+0000 7f3147400640 1 --2- 172.21.15.42:0/406126612 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f312c078b90 0x7f312c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:29.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.582+0000 7f3147400640 1 --2- 172.21.15.42:0/406126612 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f312c078b90 0x7f312c07b0a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f31500cfb10 tx=0x7f3138005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:29.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.586+0000 7f314cc00640 1 -- 172.21.15.42:0/406126612 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3140061f50 con 0x7f315006cf30 2024-09-17T01:40:29.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:29.780+0000 7f3156e00640 1 -- 172.21.15.42:0/406126612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f31500b3b20 con 0x7f315006cf30 2024-09-17T01:40:30.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.608+0000 7f314cc00640 1 -- 172.21.15.42:0/406126612 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v114) ==== 181+0+0 (secure 0 0 0) 0x7f3140066980 con 0x7f315006cf30 2024-09-17T01:40:30.606 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-09-17T01:40:30.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.613+0000 7f3156e00640 1 -- 172.21.15.42:0/406126612 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f312c078b90 msgr2=0x7f312c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:30.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.613+0000 7f3156e00640 1 --2- 172.21.15.42:0/406126612 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f312c078b90 0x7f312c07b0a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f31500cfb10 tx=0x7f3138005f90 comp rx=0 tx=0).stop 2024-09-17T01:40:30.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.613+0000 7f3156e00640 1 -- 172.21.15.42:0/406126612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f315006cf30 msgr2=0x7f31500b2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:30.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.613+0000 7f3156e00640 1 --2- 172.21.15.42:0/406126612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f315006cf30 0x7f31500b2310 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f314000c3a0 tx=0x7f314000c860 comp rx=0 tx=0).stop 2024-09-17T01:40:30.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.614+0000 7f3156e00640 1 -- 172.21.15.42:0/406126612 shutdown_connections 2024-09-17T01:40:30.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.614+0000 7f3156e00640 1 --2- 172.21.15.42:0/406126612 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f312c078b90 0x7f312c07b0a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:30.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.614+0000 7f3156e00640 1 --2- 172.21.15.42:0/406126612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3150162420 0x7f31501f8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:30.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.614+0000 7f3156e00640 1 --2- 172.21.15.42:0/406126612 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31500b7dc0 0x7f31500b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:30.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.614+0000 7f3156e00640 1 --2- 172.21.15.42:0/406126612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f315006cf30 0x7f31500b2310 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:30.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.614+0000 7f3156e00640 1 -- 172.21.15.42:0/406126612 >> 172.21.15.42:0/406126612 conn(0x7f31500b4130 msgr2=0x7f315015ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:30.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.614+0000 7f3156e00640 1 -- 172.21.15.42:0/406126612 shutdown_connections 2024-09-17T01:40:30.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.614+0000 7f3156e00640 1 -- 172.21.15.42:0/406126612 wait complete. 2024-09-17T01:40:30.641 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T01:40:30.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.887+0000 7f5ceca00640 1 -- 172.21.15.42:0/272311728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ccc003ac0 msgr2=0x7f5ccc003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:30.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.887+0000 7f5ceca00640 1 --2- 172.21.15.42:0/272311728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ccc003ac0 0x7f5ccc003f50 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80016c0 tx=0x7f5ccc005830 comp rx=0 tx=0).stop 2024-09-17T01:40:30.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.887+0000 7f5ceca00640 1 -- 172.21.15.42:0/272311728 shutdown_connections 2024-09-17T01:40:30.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.887+0000 7f5ceca00640 1 --2- 172.21.15.42:0/272311728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ccc003ac0 0x7f5ccc003f50 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:30.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.887+0000 7f5ceca00640 1 -- 172.21.15.42:0/272311728 >> 172.21.15.42:0/272311728 conn(0x7f5ce80b4130 msgr2=0x7f5ce80b4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:30.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.887+0000 7f5ceca00640 1 -- 172.21.15.42:0/272311728 shutdown_connections 2024-09-17T01:40:30.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.887+0000 7f5ceca00640 1 -- 172.21.15.42:0/272311728 wait complete. 2024-09-17T01:40:30.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.889+0000 7f5ceca00640 1 Processor -- start 2024-09-17T01:40:30.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.889+0000 7f5ceca00640 1 -- start start 2024-09-17T01:40:30.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.891+0000 7f5ceca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ccc003ac0 0x7f5ce81f3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:30.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.891+0000 7f5ceca00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ce8148460 0x7f5ce814ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:30.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.891+0000 7f5ceca00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ce814b170 0x7f5ce814b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:30.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.891+0000 7f5ceca00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce80b7b00 con 0x7f5ccc003ac0 2024-09-17T01:40:30.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.891+0000 7f5ceca00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce80b7980 con 0x7f5ce814b170 2024-09-17T01:40:30.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.891+0000 7f5ceca00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5ce80b7c80 con 0x7f5ce8148460 2024-09-17T01:40:30.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.891+0000 7f5ce5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ccc003ac0 0x7f5ce81f3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:30.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.891+0000 7f5ce5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ccc003ac0 0x7f5ce81f3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53546/0 (socket says 172.21.15.42:53546) 2024-09-17T01:40:30.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.891+0000 7f5ce5e00640 1 -- 172.21.15.42:0/3139010374 learned_addr learned my addr 172.21.15.42:0/3139010374 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:30.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.891+0000 7f5cdfe00640 1 --2- 172.21.15.42:0/3139010374 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ce8148460 0x7f5ce814ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:30.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.891+0000 7f5ce6800640 1 --2- 172.21.15.42:0/3139010374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ce814b170 0x7f5ce814b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:30.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.891+0000 7f5ce5e00640 1 -- 172.21.15.42:0/3139010374 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ce8148460 msgr2=0x7f5ce814ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:30.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.891+0000 7f5ce5e00640 1 --2- 172.21.15.42:0/3139010374 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ce8148460 0x7f5ce814ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:30.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.891+0000 7f5ce5e00640 1 -- 172.21.15.42:0/3139010374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ce814b170 msgr2=0x7f5ce814b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:30.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.891+0000 7f5ce5e00640 1 --2- 172.21.15.42:0/3139010374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ce814b170 0x7f5ce814b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:30.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.892+0000 7f5ce5e00640 1 -- 172.21.15.42:0/3139010374 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce80ca5e0 con 0x7f5ccc003ac0 2024-09-17T01:40:30.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.892+0000 7f5ce5e00640 1 --2- 172.21.15.42:0/3139010374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ccc003ac0 0x7f5ce81f3c90 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80017e0 tx=0x7f5cd80063a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:30.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.892+0000 7f5cde000640 1 -- 172.21.15.42:0/3139010374 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd8042070 con 0x7f5ccc003ac0 2024-09-17T01:40:30.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.892+0000 7f5cde000640 1 -- 172.21.15.42:0/3139010374 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5cd8039070 con 0x7f5ccc003ac0 2024-09-17T01:40:30.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.892+0000 7f5cde000640 1 -- 172.21.15.42:0/3139010374 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd8003d90 con 0x7f5ccc003ac0 2024-09-17T01:40:30.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.892+0000 7f5ceca00640 1 -- 172.21.15.42:0/3139010374 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce8148870 con 0x7f5ccc003ac0 2024-09-17T01:40:30.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.892+0000 7f5ceca00640 1 -- 172.21.15.42:0/3139010374 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce81e59c0 con 0x7f5ccc003ac0 2024-09-17T01:40:30.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.893+0000 7f5ceca00640 1 -- 172.21.15.42:0/3139010374 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ce80ca7b0 con 0x7f5ccc003ac0 2024-09-17T01:40:30.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.894+0000 7f5cde000640 1 -- 172.21.15.42:0/3139010374 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5cd803b070 con 0x7f5ccc003ac0 2024-09-17T01:40:30.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.895+0000 7f5cde000640 1 --2- 172.21.15.42:0/3139010374 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5cc4078b90 0x7f5cc407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:30.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.896+0000 7f5cde000640 1 -- 172.21.15.42:0/3139010374 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5357+0+0 (secure 0 0 0) 0x7f5cd80ba310 con 0x7f5ccc003ac0 2024-09-17T01:40:30.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.896+0000 7f5cdfe00640 1 --2- 172.21.15.42:0/3139010374 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5cc4078b90 0x7f5cc407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:30.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.897+0000 7f5cdfe00640 1 --2- 172.21.15.42:0/3139010374 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5cc4078b90 0x7f5cc407b0a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0001240 tx=0x7f5cd0001150 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:30.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:30.900+0000 7f5cde000640 1 -- 172.21.15.42:0/3139010374 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5cd80828a0 con 0x7f5ccc003ac0 2024-09-17T01:40:31.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.093+0000 7f5ceca00640 1 -- 172.21.15.42:0/3139010374 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5ce815eb20 con 0x7f5ccc003ac0 2024-09-17T01:40:31.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.614+0000 7f5cde000640 1 -- 172.21.15.42:0/3139010374 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v115) ==== 169+0+0 (secure 0 0 0) 0x7f5ce815eb20 con 0x7f5ccc003ac0 2024-09-17T01:40:31.612 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-09-17T01:40:31.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.618+0000 7f5ceca00640 1 -- 172.21.15.42:0/3139010374 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5cc4078b90 msgr2=0x7f5cc407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:31.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.618+0000 7f5ceca00640 1 --2- 172.21.15.42:0/3139010374 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5cc4078b90 0x7f5cc407b0a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0001240 tx=0x7f5cd0001150 comp rx=0 tx=0).stop 2024-09-17T01:40:31.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.618+0000 7f5ceca00640 1 -- 172.21.15.42:0/3139010374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ccc003ac0 msgr2=0x7f5ce81f3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:31.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.618+0000 7f5ceca00640 1 --2- 172.21.15.42:0/3139010374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ccc003ac0 0x7f5ce81f3c90 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80017e0 tx=0x7f5cd80063a0 comp rx=0 tx=0).stop 2024-09-17T01:40:31.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.619+0000 7f5ceca00640 1 -- 172.21.15.42:0/3139010374 shutdown_connections 2024-09-17T01:40:31.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.619+0000 7f5ceca00640 1 --2- 172.21.15.42:0/3139010374 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5cc4078b90 0x7f5cc407b0a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:31.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.619+0000 7f5ceca00640 1 --2- 172.21.15.42:0/3139010374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ce814b170 0x7f5ce814b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:31.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.619+0000 7f5ceca00640 1 --2- 172.21.15.42:0/3139010374 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ce8148460 0x7f5ce814ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:31.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.619+0000 7f5ceca00640 1 --2- 172.21.15.42:0/3139010374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ccc003ac0 0x7f5ce81f3c90 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:31.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.619+0000 7f5ceca00640 1 -- 172.21.15.42:0/3139010374 >> 172.21.15.42:0/3139010374 conn(0x7f5ce80b4130 msgr2=0x7f5ce80706f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:31.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.619+0000 7f5ceca00640 1 -- 172.21.15.42:0/3139010374 shutdown_connections 2024-09-17T01:40:31.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.619+0000 7f5ceca00640 1 -- 172.21.15.42:0/3139010374 wait complete. 2024-09-17T01:40:31.642 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T01:40:31.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.888+0000 7fab0f000640 1 -- 172.21.15.42:0/586900647 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faaec003a00 msgr2=0x7faaec003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:31.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.888+0000 7fab0f000640 1 --2- 172.21.15.42:0/586900647 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faaec003a00 0x7faaec003e70 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009b50 tx=0x7faaec005830 comp rx=0 tx=0).stop 2024-09-17T01:40:31.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.888+0000 7fab0d000640 1 -- 172.21.15.42:0/586900647 reap_dead start 2024-09-17T01:40:31.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.888+0000 7fab0f000640 1 -- 172.21.15.42:0/586900647 shutdown_connections 2024-09-17T01:40:31.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.888+0000 7fab0f000640 1 -- 172.21.15.42:0/586900647 >> 172.21.15.42:0/586900647 conn(0x7fab080b2930 msgr2=0x7fab0806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:31.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.888+0000 7fab0f000640 1 -- 172.21.15.42:0/586900647 shutdown_connections 2024-09-17T01:40:31.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.888+0000 7fab0f000640 1 -- 172.21.15.42:0/586900647 wait complete. 2024-09-17T01:40:31.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.890+0000 7fab0f000640 1 Processor -- start 2024-09-17T01:40:31.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.890+0000 7fab0f000640 1 -- start start 2024-09-17T01:40:31.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.892+0000 7fab0f000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faaec003a00 0x7fab080b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:31.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.892+0000 7fab0f000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab081f53d0 0x7fab0814f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:31.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.892+0000 7fab0f000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab081f57e0 0x7fab0814fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:31.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.892+0000 7fab0f000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fab0806fe40 con 0x7faaec003a00 2024-09-17T01:40:31.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.892+0000 7fab0f000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fab08070740 con 0x7fab081f53d0 2024-09-17T01:40:31.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.892+0000 7fab0f000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fab0806ffc0 con 0x7fab081f57e0 2024-09-17T01:40:31.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.892+0000 7fab07e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faaec003a00 0x7fab080b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:31.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.892+0000 7fab07e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faaec003a00 0x7fab080b4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53556/0 (socket says 172.21.15.42:53556) 2024-09-17T01:40:31.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.892+0000 7fab07e00640 1 -- 172.21.15.42:0/1492247412 learned_addr learned my addr 172.21.15.42:0/1492247412 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:31.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.892+0000 7faaffe00640 1 --2- 172.21.15.42:0/1492247412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab081f53d0 0x7fab0814f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:31.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.892+0000 7fab0d000640 1 --2- 172.21.15.42:0/1492247412 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab081f57e0 0x7fab0814fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:31.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.893+0000 7fab07e00640 1 -- 172.21.15.42:0/1492247412 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab081f57e0 msgr2=0x7fab0814fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:31.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.893+0000 7fab07e00640 1 --2- 172.21.15.42:0/1492247412 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab081f57e0 0x7fab0814fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:31.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.893+0000 7fab07e00640 1 -- 172.21.15.42:0/1492247412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab081f53d0 msgr2=0x7fab0814f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:31.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.893+0000 7fab07e00640 1 --2- 172.21.15.42:0/1492247412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab081f53d0 0x7fab0814f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:31.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.893+0000 7fab07e00640 1 -- 172.21.15.42:0/1492247412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab08159250 con 0x7faaec003a00 2024-09-17T01:40:31.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.893+0000 7fab07e00640 1 --2- 172.21.15.42:0/1492247412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faaec003a00 0x7fab080b4fe0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009a70 tx=0x7faaf80336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:31.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.893+0000 7fab04c00640 1 -- 172.21.15.42:0/1492247412 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf8038040 con 0x7faaec003a00 2024-09-17T01:40:31.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.893+0000 7fab04c00640 1 -- 172.21.15.42:0/1492247412 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faaf8004020 con 0x7faaec003a00 2024-09-17T01:40:31.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.893+0000 7fab04c00640 1 -- 172.21.15.42:0/1492247412 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf8004470 con 0x7faaec003a00 2024-09-17T01:40:31.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.893+0000 7fab0f000640 1 -- 172.21.15.42:0/1492247412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab08159530 con 0x7faaec003a00 2024-09-17T01:40:31.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.893+0000 7fab0f000640 1 -- 172.21.15.42:0/1492247412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab08159af0 con 0x7faaec003a00 2024-09-17T01:40:31.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.894+0000 7fab0f000640 1 -- 172.21.15.42:0/1492247412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab0815bc50 con 0x7faaec003a00 2024-09-17T01:40:31.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.896+0000 7fab04c00640 1 -- 172.21.15.42:0/1492247412 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faaf8045020 con 0x7faaec003a00 2024-09-17T01:40:31.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.896+0000 7fab04c00640 1 --2- 172.21.15.42:0/1492247412 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faae4078bc0 0x7faae407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:31.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.897+0000 7fab04c00640 1 -- 172.21.15.42:0/1492247412 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 4943+0+0 (secure 0 0 0) 0x7faaf80bb430 con 0x7faaec003a00 2024-09-17T01:40:31.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.897+0000 7faaffe00640 1 --2- 172.21.15.42:0/1492247412 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faae4078bc0 0x7faae407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:31.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.898+0000 7faaffe00640 1 --2- 172.21.15.42:0/1492247412 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faae4078bc0 0x7faae407b0d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fab081e7d90 tx=0x7faaf0005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:31.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:31.901+0000 7fab04c00640 1 -- 172.21.15.42:0/1492247412 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faaf8083ad0 con 0x7faaec003a00 2024-09-17T01:40:32.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.094+0000 7fab0f000640 1 -- 172.21.15.42:0/1492247412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fab0806a170 con 0x7faaec003a00 2024-09-17T01:40:32.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.099+0000 7fab04c00640 1 -- 172.21.15.42:0/1492247412 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v51) ==== 71+0+0 (secure 0 0 0) 0x7faaf80833d0 con 0x7faaec003a00 2024-09-17T01:40:32.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.101+0000 7fab0f000640 1 -- 172.21.15.42:0/1492247412 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faae4078bc0 msgr2=0x7faae407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:32.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.101+0000 7fab0f000640 1 --2- 172.21.15.42:0/1492247412 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faae4078bc0 0x7faae407b0d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fab081e7d90 tx=0x7faaf0005f90 comp rx=0 tx=0).stop 2024-09-17T01:40:32.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.101+0000 7fab0f000640 1 -- 172.21.15.42:0/1492247412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faaec003a00 msgr2=0x7fab080b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:32.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.101+0000 7fab0f000640 1 --2- 172.21.15.42:0/1492247412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faaec003a00 0x7fab080b4fe0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009a70 tx=0x7faaf80336f0 comp rx=0 tx=0).stop 2024-09-17T01:40:32.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.102+0000 7fab0f000640 1 -- 172.21.15.42:0/1492247412 shutdown_connections 2024-09-17T01:40:32.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.102+0000 7fab0f000640 1 --2- 172.21.15.42:0/1492247412 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faae4078bc0 0x7faae407b0d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:32.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.102+0000 7fab0f000640 1 --2- 172.21.15.42:0/1492247412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab081f53d0 0x7fab0814f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:32.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.102+0000 7fab0f000640 1 --2- 172.21.15.42:0/1492247412 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab081f57e0 0x7fab0814fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:32.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.102+0000 7fab0f000640 1 --2- 172.21.15.42:0/1492247412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faaec003a00 0x7fab080b4fe0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:32.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.102+0000 7fab0f000640 1 -- 172.21.15.42:0/1492247412 >> 172.21.15.42:0/1492247412 conn(0x7fab080b2930 msgr2=0x7fab081e8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:32.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.102+0000 7fab0f000640 1 -- 172.21.15.42:0/1492247412 shutdown_connections 2024-09-17T01:40:32.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.102+0000 7fab0f000640 1 -- 172.21.15.42:0/1492247412 wait complete. 2024-09-17T01:40:32.123 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-09-17T01:40:32.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.351+0000 7f259c000640 1 -- 172.21.15.42:0/1596076646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f259406f2a0 msgr2=0x7f259406d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:32.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.351+0000 7f259c000640 1 --2- 172.21.15.42:0/1596076646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f259406f2a0 0x7f259406d610 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f2580005fd0 tx=0x7f258002a540 comp rx=0 tx=0).stop 2024-09-17T01:40:32.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.351+0000 7f259c000640 1 -- 172.21.15.42:0/1596076646 shutdown_connections 2024-09-17T01:40:32.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.351+0000 7f259c000640 1 --2- 172.21.15.42:0/1596076646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f259406f2a0 0x7f259406d610 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:32.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.351+0000 7f259c000640 1 --2- 172.21.15.42:0/1596076646 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f259406ee90 0x7f259415f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:32.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.351+0000 7f259c000640 1 -- 172.21.15.42:0/1596076646 >> 172.21.15.42:0/1596076646 conn(0x7f25940b2930 msgr2=0x7f259406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:32.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.351+0000 7f259c000640 1 -- 172.21.15.42:0/1596076646 shutdown_connections 2024-09-17T01:40:32.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.351+0000 7f259c000640 1 -- 172.21.15.42:0/1596076646 wait complete. 2024-09-17T01:40:32.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.353+0000 7f259c000640 1 Processor -- start 2024-09-17T01:40:32.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.353+0000 7f259c000640 1 -- start start 2024-09-17T01:40:32.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.355+0000 7f259c000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f259406db50 0x7f25941f66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:32.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.355+0000 7f259c000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f259406ee90 0x7f2594146d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:32.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.355+0000 7f259c000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f259406f2a0 0x7f25940b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:32.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.355+0000 7f259c000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f25940cef40 con 0x7f259406db50 2024-09-17T01:40:32.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.355+0000 7f259c000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2594074750 con 0x7f259406f2a0 2024-09-17T01:40:32.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.355+0000 7f259c000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f25940cf0c0 con 0x7f259406ee90 2024-09-17T01:40:32.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.355+0000 7f2599600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f259406db50 0x7f25941f66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:32.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.355+0000 7f2599600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f259406db50 0x7f25941f66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53580/0 (socket says 172.21.15.42:53580) 2024-09-17T01:40:32.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.355+0000 7f2599600640 1 -- 172.21.15.42:0/1798705140 learned_addr learned my addr 172.21.15.42:0/1798705140 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:32.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.355+0000 7f2599600640 1 -- 172.21.15.42:0/1798705140 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f259406ee90 msgr2=0x7f2594146d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:32.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.355+0000 7f2599600640 1 --2- 172.21.15.42:0/1798705140 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f259406ee90 0x7f2594146d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:32.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.355+0000 7f2599600640 1 -- 172.21.15.42:0/1798705140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f259406f2a0 msgr2=0x7f25940b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:32.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.355+0000 7f259a000640 1 --2- 172.21.15.42:0/1798705140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f259406f2a0 0x7f25940b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:32.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.355+0000 7f2599600640 1 --2- 172.21.15.42:0/1798705140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f259406f2a0 0x7f25940b46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:32.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.355+0000 7f2599600640 1 -- 172.21.15.42:0/1798705140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25941e87d0 con 0x7f259406db50 2024-09-17T01:40:32.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.355+0000 7f259a000640 1 --2- 172.21.15.42:0/1798705140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f259406f2a0 0x7f25940b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:40:32.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.356+0000 7f2599600640 1 --2- 172.21.15.42:0/1798705140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f259406db50 0x7f25941f66b0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f258800d700 tx=0x7f258800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:32.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.356+0000 7f2591600640 1 -- 172.21.15.42:0/1798705140 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2588017070 con 0x7f259406db50 2024-09-17T01:40:32.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.356+0000 7f2591600640 1 -- 172.21.15.42:0/1798705140 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2588005310 con 0x7f259406db50 2024-09-17T01:40:32.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.356+0000 7f259c000640 1 -- 172.21.15.42:0/1798705140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25941e8ab0 con 0x7f259406db50 2024-09-17T01:40:32.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.356+0000 7f2591600640 1 -- 172.21.15.42:0/1798705140 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2588009820 con 0x7f259406db50 2024-09-17T01:40:32.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.356+0000 7f259c000640 1 -- 172.21.15.42:0/1798705140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25941e9070 con 0x7f259406db50 2024-09-17T01:40:32.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.357+0000 7f259c000640 1 -- 172.21.15.42:0/1798705140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f259415f200 con 0x7f259406db50 2024-09-17T01:40:32.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.359+0000 7f2591600640 1 -- 172.21.15.42:0/1798705140 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f25880099c0 con 0x7f259406db50 2024-09-17T01:40:32.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.360+0000 7f2591600640 1 --2- 172.21.15.42:0/1798705140 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2574078b90 0x7f257407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:32.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.360+0000 7f2591600640 1 -- 172.21.15.42:0/1798705140 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 4943+0+0 (secure 0 0 0) 0x7f258809ab90 con 0x7f259406db50 2024-09-17T01:40:32.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.361+0000 7f2598c00640 1 --2- 172.21.15.42:0/1798705140 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2574078b90 0x7f257407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:32.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.361+0000 7f2598c00640 1 --2- 172.21.15.42:0/1798705140 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2574078b90 0x7f257407b0a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2580033000 tx=0x7f25800046c0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:32.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.365+0000 7f2591600640 1 -- 172.21.15.42:0/1798705140 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f25880632c0 con 0x7f259406db50 2024-09-17T01:40:32.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:32.631+0000 7f259c000640 1 -- 172.21.15.42:0/1798705140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) -- 0x7f259406a170 con 0x7f259406db50 2024-09-17T01:40:33.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.622+0000 7f2591600640 1 -- 172.21.15.42:0/1798705140 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v407) ==== 158+0+0 (secure 0 0 0) 0x7f2588062bc0 con 0x7f259406db50 2024-09-17T01:40:33.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.626+0000 7f259c000640 1 -- 172.21.15.42:0/1798705140 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2574078b90 msgr2=0x7f257407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:33.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.626+0000 7f259c000640 1 --2- 172.21.15.42:0/1798705140 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2574078b90 0x7f257407b0a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2580033000 tx=0x7f25800046c0 comp rx=0 tx=0).stop 2024-09-17T01:40:33.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.626+0000 7f259c000640 1 -- 172.21.15.42:0/1798705140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f259406db50 msgr2=0x7f25941f66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:33.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.626+0000 7f259c000640 1 --2- 172.21.15.42:0/1798705140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f259406db50 0x7f25941f66b0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f258800d700 tx=0x7f258800dbc0 comp rx=0 tx=0).stop 2024-09-17T01:40:33.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.627+0000 7f259c000640 1 -- 172.21.15.42:0/1798705140 shutdown_connections 2024-09-17T01:40:33.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.627+0000 7f259c000640 1 --2- 172.21.15.42:0/1798705140 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2574078b90 0x7f257407b0a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:33.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.627+0000 7f259c000640 1 --2- 172.21.15.42:0/1798705140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f259406f2a0 0x7f25940b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:33.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.627+0000 7f259c000640 1 --2- 172.21.15.42:0/1798705140 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f259406ee90 0x7f2594146d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:33.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.627+0000 7f259c000640 1 --2- 172.21.15.42:0/1798705140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f259406db50 0x7f25941f66b0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:33.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.627+0000 7f259c000640 1 -- 172.21.15.42:0/1798705140 >> 172.21.15.42:0/1798705140 conn(0x7f25940b2930 msgr2=0x7f259406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:33.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.627+0000 7f259c000640 1 -- 172.21.15.42:0/1798705140 shutdown_connections 2024-09-17T01:40:33.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.627+0000 7f259c000640 1 -- 172.21.15.42:0/1798705140 wait complete. 2024-09-17T01:40:33.652 INFO:tasks.cephfs_test_runner:test that scrub can iterate over ~mdsdir and evaluate strays ... ok 2024-09-17T01:40:33.653 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-17T01:40:33.653 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:40:33.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.888+0000 7f34dcc00640 1 -- 172.21.15.42:0/730720266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34d8162520 msgr2=0x7f34d80cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.888+0000 7f34dcc00640 1 --2- 172.21.15.42:0/730720266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34d8162520 0x7f34d80cf840 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f34c0005fd0 tx=0x7f34c002a5f0 comp rx=0 tx=0).stop 2024-09-17T01:40:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.888+0000 7f34dcc00640 1 -- 172.21.15.42:0/730720266 shutdown_connections 2024-09-17T01:40:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.888+0000 7f34dcc00640 1 --2- 172.21.15.42:0/730720266 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34d8162520 0x7f34d80cf840 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.888+0000 7f34dcc00640 1 -- 172.21.15.42:0/730720266 >> 172.21.15.42:0/730720266 conn(0x7f34d8073f20 msgr2=0x7f34d806cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.888+0000 7f34dcc00640 1 -- 172.21.15.42:0/730720266 shutdown_connections 2024-09-17T01:40:33.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.888+0000 7f34dcc00640 1 -- 172.21.15.42:0/730720266 wait complete. 2024-09-17T01:40:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.891+0000 7f34dcc00640 1 Processor -- start 2024-09-17T01:40:33.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.891+0000 7f34dcc00640 1 -- start start 2024-09-17T01:40:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.892+0000 7f34dcc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34d80cfd80 0x7f34d815e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.892+0000 7f34dcc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34d815fbe0 0x7f34d81f28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.892+0000 7f34dcc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f34d8162520 0x7f34d81f8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.892+0000 7f34dcc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f34d80d0e80 con 0x7f34d80cfd80 2024-09-17T01:40:33.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.892+0000 7f34dcc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f34d80d0d00 con 0x7f34d815fbe0 2024-09-17T01:40:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.892+0000 7f34dcc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f34d80d1000 con 0x7f34d8162520 2024-09-17T01:40:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.892+0000 7f34d7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34d80cfd80 0x7f34d815e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.892+0000 7f34d7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34d80cfd80 0x7f34d815e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53588/0 (socket says 172.21.15.42:53588) 2024-09-17T01:40:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.892+0000 7f34d7400640 1 -- 172.21.15.42:0/4250222592 learned_addr learned my addr 172.21.15.42:0/4250222592 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.893+0000 7f34cea00640 1 --2- 172.21.15.42:0/4250222592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34d815fbe0 0x7f34d81f28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:33.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.893+0000 7f34d7e00640 1 --2- 172.21.15.42:0/4250222592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f34d8162520 0x7f34d81f8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.893+0000 7f34d7400640 1 -- 172.21.15.42:0/4250222592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f34d8162520 msgr2=0x7f34d81f8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.893+0000 7f34d7400640 1 --2- 172.21.15.42:0/4250222592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f34d8162520 0x7f34d81f8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.893+0000 7f34d7400640 1 -- 172.21.15.42:0/4250222592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34d815fbe0 msgr2=0x7f34d81f28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:33.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.893+0000 7f34d7400640 1 --2- 172.21.15.42:0/4250222592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34d815fbe0 0x7f34d81f28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.893+0000 7f34d7400640 1 -- 172.21.15.42:0/4250222592 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d80b5210 con 0x7f34d80cfd80 2024-09-17T01:40:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.893+0000 7f34d7400640 1 --2- 172.21.15.42:0/4250222592 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34d80cfd80 0x7f34d815e770 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f34c800c400 tx=0x7f34c800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.893+0000 7f34cfe00640 1 -- 172.21.15.42:0/4250222592 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c8017070 con 0x7f34d80cfd80 2024-09-17T01:40:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.893+0000 7f34cfe00640 1 -- 172.21.15.42:0/4250222592 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34c80053c0 con 0x7f34d80cfd80 2024-09-17T01:40:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.894+0000 7f34cfe00640 1 -- 172.21.15.42:0/4250222592 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c8003850 con 0x7f34d80cfd80 2024-09-17T01:40:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.894+0000 7f34dcc00640 1 -- 172.21.15.42:0/4250222592 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d80b6290 con 0x7f34d80cfd80 2024-09-17T01:40:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.894+0000 7f34dcc00640 1 -- 172.21.15.42:0/4250222592 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d80b57d0 con 0x7f34d80cfd80 2024-09-17T01:40:33.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.895+0000 7f34dcc00640 1 -- 172.21.15.42:0/4250222592 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34d8050f60 con 0x7f34d80cfd80 2024-09-17T01:40:33.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.896+0000 7f34cfe00640 1 -- 172.21.15.42:0/4250222592 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f34c801a070 con 0x7f34d80cfd80 2024-09-17T01:40:33.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.897+0000 7f34cfe00640 1 --2- 172.21.15.42:0/4250222592 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f34b4078b90 0x7f34b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:33.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.897+0000 7f34cfe00640 1 -- 172.21.15.42:0/4250222592 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 4943+0+0 (secure 0 0 0) 0x7f34c8099ed0 con 0x7f34d80cfd80 2024-09-17T01:40:33.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.897+0000 7f34cea00640 1 --2- 172.21.15.42:0/4250222592 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f34b4078b90 0x7f34b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:33.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.898+0000 7f34cea00640 1 --2- 172.21.15.42:0/4250222592 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f34b4078b90 0x7f34b407b0a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f34c0033000 tx=0x7f34c0004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:33.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:33.901+0000 7f34cfe00640 1 -- 172.21.15.42:0/4250222592 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f34d8050f60 con 0x7f34d80cfd80 2024-09-17T01:40:34.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.094+0000 7f34dcc00640 1 -- 172.21.15.42:0/4250222592 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f34d80d1420 con 0x7f34d80cfd80 2024-09-17T01:40:34.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.095+0000 7f34cfe00640 1 -- 172.21.15.42:0/4250222592 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+12994 (secure 0 0 0) 0x7f34c8062600 con 0x7f34d80cfd80 2024-09-17T01:40:34.093 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:40:34.094 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":115,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:40:31.609703+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6834/1078007521":"2024-09-18T01:40:28.302707+0000","172.21.15.42:6832/1078007521":"2024-09-18T01:40:28.302707+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:40:34.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.097+0000 7f34dcc00640 1 -- 172.21.15.42:0/4250222592 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f34b4078b90 msgr2=0x7f34b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:34.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.098+0000 7f34dcc00640 1 --2- 172.21.15.42:0/4250222592 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f34b4078b90 0x7f34b407b0a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f34c0033000 tx=0x7f34c0004730 comp rx=0 tx=0).stop 2024-09-17T01:40:34.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.098+0000 7f34dcc00640 1 -- 172.21.15.42:0/4250222592 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34d80cfd80 msgr2=0x7f34d815e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:34.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.098+0000 7f34dcc00640 1 --2- 172.21.15.42:0/4250222592 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34d80cfd80 0x7f34d815e770 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f34c800c400 tx=0x7f34c800c8c0 comp rx=0 tx=0).stop 2024-09-17T01:40:34.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.098+0000 7f34dcc00640 1 -- 172.21.15.42:0/4250222592 shutdown_connections 2024-09-17T01:40:34.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.098+0000 7f34dcc00640 1 --2- 172.21.15.42:0/4250222592 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f34b4078b90 0x7f34b407b0a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:34.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.098+0000 7f34dcc00640 1 --2- 172.21.15.42:0/4250222592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34d815fbe0 0x7f34d81f28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:34.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.098+0000 7f34dcc00640 1 --2- 172.21.15.42:0/4250222592 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f34d8162520 0x7f34d81f8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:34.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.098+0000 7f34dcc00640 1 --2- 172.21.15.42:0/4250222592 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34d80cfd80 0x7f34d815e770 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:34.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.098+0000 7f34dcc00640 1 -- 172.21.15.42:0/4250222592 >> 172.21.15.42:0/4250222592 conn(0x7f34d8073f20 msgr2=0x7f34d80d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:34.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.098+0000 7f34dcc00640 1 -- 172.21.15.42:0/4250222592 shutdown_connections 2024-09-17T01:40:34.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.098+0000 7f34dcc00640 1 -- 172.21.15.42:0/4250222592 wait complete. 2024-09-17T01:40:34.118 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T01:31:55.004951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T01:40:34.118 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T01:40:34.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.352+0000 7fa9c6200640 1 -- 172.21.15.42:0/2042319775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9a40041e0 msgr2=0x7fa9a4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:34.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.352+0000 7fa9c6200640 1 --2- 172.21.15.42:0/2042319775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9a40041e0 0x7fa9a4004800 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8009b20 tx=0x7fa9a4005830 comp rx=0 tx=0).stop 2024-09-17T01:40:34.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.352+0000 7fa9c5800640 1 -- 172.21.15.42:0/2042319775 reap_dead start 2024-09-17T01:40:34.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.352+0000 7fa9c6200640 1 -- 172.21.15.42:0/2042319775 shutdown_connections 2024-09-17T01:40:34.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.352+0000 7fa9c6200640 1 -- 172.21.15.42:0/2042319775 >> 172.21.15.42:0/2042319775 conn(0x7fa9c00b27a0 msgr2=0x7fa9c00d0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:34.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.352+0000 7fa9c6200640 1 -- 172.21.15.42:0/2042319775 shutdown_connections 2024-09-17T01:40:34.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.352+0000 7fa9c6200640 1 -- 172.21.15.42:0/2042319775 wait complete. 2024-09-17T01:40:34.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.354+0000 7fa9c6200640 1 Processor -- start 2024-09-17T01:40:34.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.354+0000 7fa9c6200640 1 -- start start 2024-09-17T01:40:34.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.356+0000 7fa9c6200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa9a40041e0 0x7fa9c009a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:34.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.356+0000 7fa9c6200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9c006f9c0 0x7fa9c006fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:34.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.356+0000 7fa9c6200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9c015eb60 0x7fa9c015ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:34.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.356+0000 7fa9c6200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c015de20 con 0x7fa9c015eb60 2024-09-17T01:40:34.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.356+0000 7fa9c6200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c0074eb0 con 0x7fa9c006f9c0 2024-09-17T01:40:34.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.356+0000 7fa9c6200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa9c0160500 con 0x7fa9a40041e0 2024-09-17T01:40:34.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.356+0000 7fa9c5800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9c015eb60 0x7fa9c015ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:34.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.356+0000 7fa9c5800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9c015eb60 0x7fa9c015ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53610/0 (socket says 172.21.15.42:53610) 2024-09-17T01:40:34.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.356+0000 7fa9c5800640 1 -- 172.21.15.42:0/2797106529 learned_addr learned my addr 172.21.15.42:0/2797106529 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:34.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.356+0000 7fa9c4e00640 1 --2- 172.21.15.42:0/2797106529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa9a40041e0 0x7fa9c009a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:34.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.356+0000 7fa9b7e00640 1 --2- 172.21.15.42:0/2797106529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9c006f9c0 0x7fa9c006fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:34.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.357+0000 7fa9c5800640 1 -- 172.21.15.42:0/2797106529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa9a40041e0 msgr2=0x7fa9c009a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:34.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.357+0000 7fa9c5800640 1 --2- 172.21.15.42:0/2797106529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa9a40041e0 0x7fa9c009a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:34.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.357+0000 7fa9c5800640 1 -- 172.21.15.42:0/2797106529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9c006f9c0 msgr2=0x7fa9c006fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:34.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.357+0000 7fa9c5800640 1 --2- 172.21.15.42:0/2797106529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9c006f9c0 0x7fa9c006fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:34.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.357+0000 7fa9c5800640 1 -- 172.21.15.42:0/2797106529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c015f4b0 con 0x7fa9c015eb60 2024-09-17T01:40:34.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.357+0000 7fa9c4e00640 1 --2- 172.21.15.42:0/2797106529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa9a40041e0 0x7fa9c009a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:40:34.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.357+0000 7fa9b7e00640 1 --2- 172.21.15.42:0/2797106529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9c006f9c0 0x7fa9c006fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:40:34.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.357+0000 7fa9c5800640 1 --2- 172.21.15.42:0/2797106529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9c015eb60 0x7fa9c015ef70 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fa9c015db50 tx=0x7fa9b8006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:34.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.357+0000 7fa9bd600640 1 -- 172.21.15.42:0/2797106529 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b8011900 con 0x7fa9c015eb60 2024-09-17T01:40:34.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.357+0000 7fa9bd600640 1 -- 172.21.15.42:0/2797106529 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9b8011aa0 con 0x7fa9c015eb60 2024-09-17T01:40:34.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.357+0000 7fa9bd600640 1 -- 172.21.15.42:0/2797106529 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b8010420 con 0x7fa9c015eb60 2024-09-17T01:40:34.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.357+0000 7fa9c6200640 1 -- 172.21.15.42:0/2797106529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9c006f560 con 0x7fa9c015eb60 2024-09-17T01:40:34.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.357+0000 7fa9c6200640 1 -- 172.21.15.42:0/2797106529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9c01f9120 con 0x7fa9c015eb60 2024-09-17T01:40:34.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.358+0000 7fa9c6200640 1 -- 172.21.15.42:0/2797106529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9c00b46f0 con 0x7fa9c015eb60 2024-09-17T01:40:34.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.360+0000 7fa9bd600640 1 -- 172.21.15.42:0/2797106529 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa9b80105c0 con 0x7fa9c015eb60 2024-09-17T01:40:34.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.360+0000 7fa9bd600640 1 --2- 172.21.15.42:0/2797106529 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa99c078b90 0x7fa99c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:34.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.361+0000 7fa9bd600640 1 -- 172.21.15.42:0/2797106529 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 4943+0+0 (secure 0 0 0) 0x7fa9b809b2b0 con 0x7fa9c015eb60 2024-09-17T01:40:34.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.361+0000 7fa9c4e00640 1 --2- 172.21.15.42:0/2797106529 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa99c078b90 0x7fa99c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:34.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.362+0000 7fa9c4e00640 1 --2- 172.21.15.42:0/2797106529 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa99c078b90 0x7fa99c07b0a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0001eb0 tx=0x7fa9b0001de0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:34.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.365+0000 7fa9bd600640 1 -- 172.21.15.42:0/2797106529 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa9c015f4b0 con 0x7fa9c015eb60 2024-09-17T01:40:34.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.558+0000 7fa9c6200640 1 -- 172.21.15.42:0/2797106529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa9c00af090 con 0x7fa9c015eb60 2024-09-17T01:40:34.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.559+0000 7fa9bd600640 1 -- 172.21.15.42:0/2797106529 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v115) ==== 93+0+10 (secure 0 0 0) 0x7fa9b80639f0 con 0x7fa9c015eb60 2024-09-17T01:40:34.557 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-09-17T01:40:34.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.561+0000 7fa9c6200640 1 -- 172.21.15.42:0/2797106529 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa99c078b90 msgr2=0x7fa99c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:34.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.561+0000 7fa9c6200640 1 --2- 172.21.15.42:0/2797106529 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa99c078b90 0x7fa99c07b0a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0001eb0 tx=0x7fa9b0001de0 comp rx=0 tx=0).stop 2024-09-17T01:40:34.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.561+0000 7fa9c6200640 1 -- 172.21.15.42:0/2797106529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9c015eb60 msgr2=0x7fa9c015ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:34.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.561+0000 7fa9c6200640 1 --2- 172.21.15.42:0/2797106529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9c015eb60 0x7fa9c015ef70 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fa9c015db50 tx=0x7fa9b8006430 comp rx=0 tx=0).stop 2024-09-17T01:40:34.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.561+0000 7fa9c6200640 1 -- 172.21.15.42:0/2797106529 shutdown_connections 2024-09-17T01:40:34.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.561+0000 7fa9c6200640 1 --2- 172.21.15.42:0/2797106529 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa99c078b90 0x7fa99c07b0a0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:34.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.561+0000 7fa9c6200640 1 --2- 172.21.15.42:0/2797106529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9c006f9c0 0x7fa9c006fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:34.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.561+0000 7fa9c6200640 1 --2- 172.21.15.42:0/2797106529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9c015eb60 0x7fa9c015ef70 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:34.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.561+0000 7fa9c6200640 1 --2- 172.21.15.42:0/2797106529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa9a40041e0 0x7fa9c009a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:34.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.561+0000 7fa9c6200640 1 -- 172.21.15.42:0/2797106529 >> 172.21.15.42:0/2797106529 conn(0x7fa9c00b27a0 msgr2=0x7fa9c00b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:34.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.561+0000 7fa9c6200640 1 -- 172.21.15.42:0/2797106529 shutdown_connections 2024-09-17T01:40:34.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.561+0000 7fa9c6200640 1 -- 172.21.15.42:0/2797106529 wait complete. 2024-09-17T01:40:34.581 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-09-17T01:40:34.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.809+0000 7fb81e800640 1 -- 172.21.15.42:0/1391455194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8180cef70 msgr2=0x7fb818156e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:34.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.809+0000 7fb81e800640 1 --2- 172.21.15.42:0/1391455194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8180cef70 0x7fb818156e50 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fb800005fd0 tx=0x7fb80002a5a0 comp rx=0 tx=0).stop 2024-09-17T01:40:34.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.809+0000 7fb81e800640 1 -- 172.21.15.42:0/1391455194 shutdown_connections 2024-09-17T01:40:34.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.809+0000 7fb81e800640 1 --2- 172.21.15.42:0/1391455194 >> v2:172.21.15.43:3300/0 conn(0x7fb81806d430 0x7fb81806d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:34.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.809+0000 7fb81e800640 1 --2- 172.21.15.42:0/1391455194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8180cef70 0x7fb818156e50 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:34.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.809+0000 7fb81e800640 1 -- 172.21.15.42:0/1391455194 >> 172.21.15.42:0/1391455194 conn(0x7fb8180b2930 msgr2=0x7fb81806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:34.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.809+0000 7fb81e800640 1 -- 172.21.15.42:0/1391455194 shutdown_connections 2024-09-17T01:40:34.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.809+0000 7fb81e800640 1 -- 172.21.15.42:0/1391455194 wait complete. 2024-09-17T01:40:34.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.811+0000 7fb81e800640 1 Processor -- start 2024-09-17T01:40:34.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.811+0000 7fb81e800640 1 -- start start 2024-09-17T01:40:34.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.813+0000 7fb81e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb81806d430 0x7fb8181f6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:34.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.813+0000 7fb81e800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8180b5100 0x7fb818144630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:34.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.813+0000 7fb81e800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8180cef70 0x7fb8181f91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:34.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.813+0000 7fb81e800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb8180729c0 con 0x7fb81806d430 2024-09-17T01:40:34.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.813+0000 7fb81e800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb818072840 con 0x7fb8180b5100 2024-09-17T01:40:34.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.813+0000 7fb81e800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb818072b40 con 0x7fb8180cef70 2024-09-17T01:40:34.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.813+0000 7fb817400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb81806d430 0x7fb8181f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:34.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.813+0000 7fb817400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb81806d430 0x7fb8181f6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53622/0 (socket says 172.21.15.42:53622) 2024-09-17T01:40:34.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.813+0000 7fb817400640 1 -- 172.21.15.42:0/1441201662 learned_addr learned my addr 172.21.15.42:0/1441201662 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:34.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.813+0000 7fb80ea00640 1 --2- 172.21.15.42:0/1441201662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8180b5100 0x7fb818144630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:34.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.813+0000 7fb817e00640 1 --2- 172.21.15.42:0/1441201662 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8180cef70 0x7fb8181f91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:34.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.814+0000 7fb817400640 1 -- 172.21.15.42:0/1441201662 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8180cef70 msgr2=0x7fb8181f91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:34.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.814+0000 7fb817400640 1 --2- 172.21.15.42:0/1441201662 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8180cef70 0x7fb8181f91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:34.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.814+0000 7fb817400640 1 -- 172.21.15.42:0/1441201662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8180b5100 msgr2=0x7fb818144630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:34.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.814+0000 7fb817400640 1 --2- 172.21.15.42:0/1441201662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8180b5100 0x7fb818144630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:34.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.814+0000 7fb817400640 1 -- 172.21.15.42:0/1441201662 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb818152c00 con 0x7fb81806d430 2024-09-17T01:40:34.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.814+0000 7fb80ea00640 1 --2- 172.21.15.42:0/1441201662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8180b5100 0x7fb818144630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:40:34.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.814+0000 7fb817400640 1 --2- 172.21.15.42:0/1441201662 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb81806d430 0x7fb8181f6670 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fb80800c3a0 tx=0x7fb80800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:34.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.814+0000 7fb80fe00640 1 -- 172.21.15.42:0/1441201662 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb808017070 con 0x7fb81806d430 2024-09-17T01:40:34.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.814+0000 7fb80fe00640 1 -- 172.21.15.42:0/1441201662 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8080053c0 con 0x7fb81806d430 2024-09-17T01:40:34.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.814+0000 7fb81e800640 1 -- 172.21.15.42:0/1441201662 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb818152ee0 con 0x7fb81806d430 2024-09-17T01:40:34.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.814+0000 7fb80fe00640 1 -- 172.21.15.42:0/1441201662 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb808003850 con 0x7fb81806d430 2024-09-17T01:40:34.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.814+0000 7fb81e800640 1 -- 172.21.15.42:0/1441201662 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb818154bb0 con 0x7fb81806d430 2024-09-17T01:40:34.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.815+0000 7fb81e800640 1 -- 172.21.15.42:0/1441201662 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb81806d840 con 0x7fb81806d430 2024-09-17T01:40:34.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.817+0000 7fb80fe00640 1 -- 172.21.15.42:0/1441201662 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb80801a070 con 0x7fb81806d430 2024-09-17T01:40:34.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.818+0000 7fb80fe00640 1 --2- 172.21.15.42:0/1441201662 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb7f4078b90 0x7fb7f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:34.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.818+0000 7fb80fe00640 1 -- 172.21.15.42:0/1441201662 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 4943+0+0 (secure 0 0 0) 0x7fb808099e90 con 0x7fb81806d430 2024-09-17T01:40:34.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.819+0000 7fb80ea00640 1 --2- 172.21.15.42:0/1441201662 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb7f4078b90 0x7fb7f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:34.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.819+0000 7fb80ea00640 1 --2- 172.21.15.42:0/1441201662 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb7f4078b90 0x7fb7f407b0a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb800033000 tx=0x7fb800004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:34.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:34.823+0000 7fb80fe00640 1 -- 172.21.15.42:0/1441201662 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb81806dd80 con 0x7fb81806d430 2024-09-17T01:40:35.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.095+0000 7fb81e800640 1 -- 172.21.15.42:0/1441201662 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) -- 0x7fb81806a170 con 0x7fb81806d430 2024-09-17T01:40:35.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.630+0000 7fb80fe00640 1 -- 172.21.15.42:0/1441201662 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v409) ==== 147+0+0 (secure 0 0 0) 0x7fb80809b0d0 con 0x7fb81806d430 2024-09-17T01:40:35.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.633+0000 7fb81e800640 1 -- 172.21.15.42:0/1441201662 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb7f4078b90 msgr2=0x7fb7f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:35.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.633+0000 7fb81e800640 1 --2- 172.21.15.42:0/1441201662 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb7f4078b90 0x7fb7f407b0a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb800033000 tx=0x7fb800004730 comp rx=0 tx=0).stop 2024-09-17T01:40:35.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.633+0000 7fb81e800640 1 -- 172.21.15.42:0/1441201662 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb81806d430 msgr2=0x7fb8181f6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:35.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.633+0000 7fb81e800640 1 --2- 172.21.15.42:0/1441201662 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb81806d430 0x7fb8181f6670 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fb80800c3a0 tx=0x7fb80800c860 comp rx=0 tx=0).stop 2024-09-17T01:40:35.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.633+0000 7fb81e800640 1 -- 172.21.15.42:0/1441201662 shutdown_connections 2024-09-17T01:40:35.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.633+0000 7fb81e800640 1 --2- 172.21.15.42:0/1441201662 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb7f4078b90 0x7fb7f407b0a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:35.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.633+0000 7fb81e800640 1 --2- 172.21.15.42:0/1441201662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8180b5100 0x7fb818144630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:35.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.633+0000 7fb81e800640 1 --2- 172.21.15.42:0/1441201662 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8180cef70 0x7fb8181f91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:35.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.633+0000 7fb81e800640 1 --2- 172.21.15.42:0/1441201662 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb81806d430 0x7fb8181f6670 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:35.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.633+0000 7fb81e800640 1 -- 172.21.15.42:0/1441201662 >> 172.21.15.42:0/1441201662 conn(0x7fb8180b2930 msgr2=0x7fb818073010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:35.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.633+0000 7fb81e800640 1 -- 172.21.15.42:0/1441201662 shutdown_connections 2024-09-17T01:40:35.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.633+0000 7fb81e800640 1 -- 172.21.15.42:0/1441201662 wait complete. 2024-09-17T01:40:35.655 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T01:40:35.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.885+0000 7ff095800640 1 -- 172.21.15.42:0/1554033353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0900d18b0 msgr2=0x7ff0900d2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:35.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.885+0000 7ff095800640 1 --2- 172.21.15.42:0/1554033353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0900d18b0 0x7ff0900d2840 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7ff078005fd0 tx=0x7ff07802a5c0 comp rx=0 tx=0).stop 2024-09-17T01:40:35.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.885+0000 7ff095800640 1 -- 172.21.15.42:0/1554033353 shutdown_connections 2024-09-17T01:40:35.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.885+0000 7ff095800640 1 --2- 172.21.15.42:0/1554033353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0900d18b0 0x7ff0900d2840 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:35.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.885+0000 7ff095800640 1 --2- 172.21.15.42:0/1554033353 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff09015ea80 0x7ff0900d1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:35.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.885+0000 7ff095800640 1 -- 172.21.15.42:0/1554033353 >> 172.21.15.42:0/1554033353 conn(0x7ff09006cf00 msgr2=0x7ff09006d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:35.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.885+0000 7ff095800640 1 -- 172.21.15.42:0/1554033353 shutdown_connections 2024-09-17T01:40:35.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.885+0000 7ff095800640 1 -- 172.21.15.42:0/1554033353 wait complete. 2024-09-17T01:40:35.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.887+0000 7ff095800640 1 Processor -- start 2024-09-17T01:40:35.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.887+0000 7ff095800640 1 -- start start 2024-09-17T01:40:35.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.889+0000 7ff095800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0900d18b0 0x7ff0900aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:35.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.889+0000 7ff095800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0900d2d80 0x7ff09015b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:35.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.889+0000 7ff095800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff09015ea80 0x7ff0900acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:35.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.889+0000 7ff095800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff0900b6760 con 0x7ff0900d2d80 2024-09-17T01:40:35.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.889+0000 7ff095800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff0900b9550 con 0x7ff0900d18b0 2024-09-17T01:40:35.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.889+0000 7ff095800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff0900b68e0 con 0x7ff09015ea80 2024-09-17T01:40:35.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.889+0000 7ff087400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0900d2d80 0x7ff09015b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:35.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.889+0000 7ff087400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0900d2d80 0x7ff09015b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55926/0 (socket says 172.21.15.42:55926) 2024-09-17T01:40:35.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.889+0000 7ff087400640 1 -- 172.21.15.42:0/179817960 learned_addr learned my addr 172.21.15.42:0/179817960 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:35.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.889+0000 7ff08fe00640 1 --2- 172.21.15.42:0/179817960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0900d18b0 0x7ff0900aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:35.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.889+0000 7ff094e00640 1 --2- 172.21.15.42:0/179817960 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff09015ea80 0x7ff0900acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:35.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.889+0000 7ff087400640 1 -- 172.21.15.42:0/179817960 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff09015ea80 msgr2=0x7ff0900acbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:35.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.889+0000 7ff087400640 1 --2- 172.21.15.42:0/179817960 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff09015ea80 0x7ff0900acbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:35.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.890+0000 7ff087400640 1 -- 172.21.15.42:0/179817960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0900d18b0 msgr2=0x7ff0900aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:35.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.890+0000 7ff087400640 1 --2- 172.21.15.42:0/179817960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0900d18b0 0x7ff0900aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:35.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.890+0000 7ff087400640 1 -- 172.21.15.42:0/179817960 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0900ac0b0 con 0x7ff0900d2d80 2024-09-17T01:40:35.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.890+0000 7ff087400640 1 --2- 172.21.15.42:0/179817960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0900d2d80 0x7ff09015b380 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7ff078034040 tx=0x7ff0780038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:35.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.890+0000 7ff08cc00640 1 -- 172.21.15.42:0/179817960 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07803e030 con 0x7ff0900d2d80 2024-09-17T01:40:35.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.890+0000 7ff08cc00640 1 -- 172.21.15.42:0/179817960 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff078003d90 con 0x7ff0900d2d80 2024-09-17T01:40:35.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.890+0000 7ff08cc00640 1 -- 172.21.15.42:0/179817960 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff078035040 con 0x7ff0900d2d80 2024-09-17T01:40:35.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.890+0000 7ff095800640 1 -- 172.21.15.42:0/179817960 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0901588b0 con 0x7ff0900d2d80 2024-09-17T01:40:35.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.890+0000 7ff095800640 1 -- 172.21.15.42:0/179817960 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff090158e70 con 0x7ff0900d2d80 2024-09-17T01:40:35.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.891+0000 7ff095800640 1 -- 172.21.15.42:0/179817960 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0900abe00 con 0x7ff0900d2d80 2024-09-17T01:40:35.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.893+0000 7ff08cc00640 1 -- 172.21.15.42:0/179817960 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff078041030 con 0x7ff0900d2d80 2024-09-17T01:40:35.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.893+0000 7ff08cc00640 1 --2- 172.21.15.42:0/179817960 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff06c078b90 0x7ff06c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:35.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.894+0000 7ff08cc00640 1 -- 172.21.15.42:0/179817960 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 4943+0+0 (secure 0 0 0) 0x7ff0780bb600 con 0x7ff0900d2d80 2024-09-17T01:40:35.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.894+0000 7ff08fe00640 1 --2- 172.21.15.42:0/179817960 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff06c078b90 0x7ff06c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:35.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.895+0000 7ff08fe00640 1 --2- 172.21.15.42:0/179817960 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff06c078b90 0x7ff06c07b0a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff08000bb00 tx=0x7ff080005e30 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:35.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:35.898+0000 7ff08cc00640 1 -- 172.21.15.42:0/179817960 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff078083d40 con 0x7ff0900d2d80 2024-09-17T01:40:36.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.091+0000 7ff095800640 1 -- 172.21.15.42:0/179817960 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7ff0901586a0 con 0x7ff0900d2d80 2024-09-17T01:40:36.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.092+0000 7ff08cc00640 1 -- 172.21.15.42:0/179817960 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v51) ==== 59+0+2294 (secure 0 0 0) 0x7ff078083640 con 0x7ff0900d2d80 2024-09-17T01:40:36.090 INFO:teuthology.orchestra.run.smithi042.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T01:40:36.090 INFO:teuthology.orchestra.run.smithi042.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T01:40:36.090 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced client_mount_timeout 30 2024-09-17T01:40:36.090 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_client 20/20 2024-09-17T01:40:36.090 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_mgr 20/20 2024-09-17T01:40:36.090 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_ms 1/1 2024-09-17T01:40:36.090 INFO:teuthology.orchestra.run.smithi042.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T01:40:36.090 INFO:teuthology.orchestra.run.smithi042.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T01:40:36.090 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3683.959260 2024-09-17T01:40:36.090 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4350.010833 2024-09-17T01:40:36.090 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4316.776055 2024-09-17T01:40:36.091 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3885.595082 2024-09-17T01:40:36.091 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3602.000737 2024-09-17T01:40:36.091 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4883.364748 2024-09-17T01:40:36.091 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3752.484811 2024-09-17T01:40:36.091 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3775.035963 2024-09-17T01:40:36.091 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds 20/20 2024-09-17T01:40:36.091 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T01:40:36.091 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_ms 2/2 2024-09-17T01:40:36.091 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_frag true 2024-09-17T01:40:36.091 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_scatterstat true 2024-09-17T01:40:36.091 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T01:40:36.091 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_verify_scatter true 2024-09-17T01:40:36.091 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T01:40:36.092 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T01:40:36.092 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T01:40:36.092 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced client_mount_timeout 600 2024-09-17T01:40:36.092 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_client 20/20 2024-09-17T01:40:36.092 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_ms 1/1 2024-09-17T01:40:36.092 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T01:40:36.092 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T01:40:36.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.094+0000 7ff095800640 1 -- 172.21.15.42:0/179817960 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff06c078b90 msgr2=0x7ff06c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:36.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.094+0000 7ff095800640 1 --2- 172.21.15.42:0/179817960 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff06c078b90 0x7ff06c07b0a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff08000bb00 tx=0x7ff080005e30 comp rx=0 tx=0).stop 2024-09-17T01:40:36.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.094+0000 7ff095800640 1 -- 172.21.15.42:0/179817960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0900d2d80 msgr2=0x7ff09015b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:36.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.094+0000 7ff095800640 1 --2- 172.21.15.42:0/179817960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0900d2d80 0x7ff09015b380 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7ff078034040 tx=0x7ff0780038a0 comp rx=0 tx=0).stop 2024-09-17T01:40:36.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.094+0000 7ff095800640 1 -- 172.21.15.42:0/179817960 shutdown_connections 2024-09-17T01:40:36.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.094+0000 7ff095800640 1 --2- 172.21.15.42:0/179817960 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff06c078b90 0x7ff06c07b0a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:36.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.094+0000 7ff095800640 1 --2- 172.21.15.42:0/179817960 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff09015ea80 0x7ff0900acbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:36.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.094+0000 7ff095800640 1 --2- 172.21.15.42:0/179817960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0900d2d80 0x7ff09015b380 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:36.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.094+0000 7ff095800640 1 --2- 172.21.15.42:0/179817960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0900d18b0 0x7ff0900aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:36.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.094+0000 7ff095800640 1 -- 172.21.15.42:0/179817960 >> 172.21.15.42:0/179817960 conn(0x7ff09006cf00 msgr2=0x7ff09015f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:36.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.094+0000 7ff095800640 1 -- 172.21.15.42:0/179817960 shutdown_connections 2024-09-17T01:40:36.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.094+0000 7ff095800640 1 -- 172.21.15.42:0/179817960 wait complete. 2024-09-17T01:40:36.114 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T01:40:36.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.346+0000 7ff65e000640 1 -- 172.21.15.42:0/1876084836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff65806d260 msgr2=0x7ff658152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:36.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.346+0000 7ff65e000640 1 --2- 172.21.15.42:0/1876084836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff65806d260 0x7ff658152ed0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff650005fd0 tx=0x7ff65002a8b0 comp rx=0 tx=0).stop 2024-09-17T01:40:36.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.346+0000 7ff65e000640 1 -- 172.21.15.42:0/1876084836 shutdown_connections 2024-09-17T01:40:36.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.346+0000 7ff65e000640 1 --2- 172.21.15.42:0/1876084836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff65806d260 0x7ff658152ed0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:36.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.346+0000 7ff65e000640 1 --2- 172.21.15.42:0/1876084836 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff6580cf7c0 0x7ff65806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:36.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.346+0000 7ff65e000640 1 -- 172.21.15.42:0/1876084836 >> 172.21.15.42:0/1876084836 conn(0x7ff6580b25f0 msgr2=0x7ff6580d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:36.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.346+0000 7ff65e000640 1 -- 172.21.15.42:0/1876084836 shutdown_connections 2024-09-17T01:40:36.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.346+0000 7ff65e000640 1 -- 172.21.15.42:0/1876084836 wait complete. 2024-09-17T01:40:36.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.348+0000 7ff65e000640 1 Processor -- start 2024-09-17T01:40:36.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.349+0000 7ff65e000640 1 -- start start 2024-09-17T01:40:36.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.350+0000 7ff65e000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff65806d260 0x7ff658074c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:36.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.350+0000 7ff65e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6580b4be0 0x7ff6581520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:36.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.350+0000 7ff65e000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6580cf7c0 0x7ff6580c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:36.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.350+0000 7ff65e000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff658153850 con 0x7ff6580b4be0 2024-09-17T01:40:36.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.350+0000 7ff65e000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff6581536d0 con 0x7ff6580cf7c0 2024-09-17T01:40:36.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.350+0000 7ff65e000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff6581539d0 con 0x7ff65806d260 2024-09-17T01:40:36.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.350+0000 7ff657e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6580b4be0 0x7ff6581520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:36.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.350+0000 7ff657e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6580b4be0 0x7ff6581520f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55928/0 (socket says 172.21.15.42:55928) 2024-09-17T01:40:36.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.350+0000 7ff657e00640 1 -- 172.21.15.42:0/3215238071 learned_addr learned my addr 172.21.15.42:0/3215238071 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:36.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.351+0000 7ff65cc00640 1 --2- 172.21.15.42:0/3215238071 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff65806d260 0x7ff658074c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:36.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.351+0000 7ff65d600640 1 --2- 172.21.15.42:0/3215238071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6580cf7c0 0x7ff6580c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:36.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.351+0000 7ff657e00640 1 -- 172.21.15.42:0/3215238071 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff65806d260 msgr2=0x7ff658074c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:36.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.351+0000 7ff657e00640 1 --2- 172.21.15.42:0/3215238071 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff65806d260 0x7ff658074c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:36.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.351+0000 7ff657e00640 1 -- 172.21.15.42:0/3215238071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6580cf7c0 msgr2=0x7ff6580c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:36.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.351+0000 7ff657e00640 1 --2- 172.21.15.42:0/3215238071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6580cf7c0 0x7ff6580c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:36.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.351+0000 7ff657e00640 1 -- 172.21.15.42:0/3215238071 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6581f6390 con 0x7ff6580b4be0 2024-09-17T01:40:36.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.351+0000 7ff657e00640 1 --2- 172.21.15.42:0/3215238071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6580b4be0 0x7ff6581520f0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7ff64400ea20 tx=0x7ff64400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:36.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.351+0000 7ff654c00640 1 -- 172.21.15.42:0/3215238071 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64400ce40 con 0x7ff6580b4be0 2024-09-17T01:40:36.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.352+0000 7ff654c00640 1 -- 172.21.15.42:0/3215238071 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff644004020 con 0x7ff6580b4be0 2024-09-17T01:40:36.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.352+0000 7ff65e000640 1 -- 172.21.15.42:0/3215238071 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6581f5af0 con 0x7ff6580b4be0 2024-09-17T01:40:36.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.352+0000 7ff654c00640 1 -- 172.21.15.42:0/3215238071 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff644004470 con 0x7ff6580b4be0 2024-09-17T01:40:36.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.352+0000 7ff65e000640 1 -- 172.21.15.42:0/3215238071 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6581f60b0 con 0x7ff6580b4be0 2024-09-17T01:40:36.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.353+0000 7ff65e000640 1 -- 172.21.15.42:0/3215238071 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff658152ed0 con 0x7ff6580b4be0 2024-09-17T01:40:36.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.354+0000 7ff654c00640 1 -- 172.21.15.42:0/3215238071 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff6440035f0 con 0x7ff6580b4be0 2024-09-17T01:40:36.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.355+0000 7ff654c00640 1 --2- 172.21.15.42:0/3215238071 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff638078b90 0x7ff63807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:36.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.355+0000 7ff654c00640 1 -- 172.21.15.42:0/3215238071 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 4943+0+0 (secure 0 0 0) 0x7ff64409b300 con 0x7ff6580b4be0 2024-09-17T01:40:36.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.355+0000 7ff65cc00640 1 --2- 172.21.15.42:0/3215238071 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff638078b90 0x7ff63807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:36.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.356+0000 7ff65cc00640 1 --2- 172.21.15.42:0/3215238071 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff638078b90 0x7ff63807b0a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff64c007d60 tx=0x7ff64c007cf0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:36.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.359+0000 7ff654c00640 1 -- 172.21.15.42:0/3215238071 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff644063350 con 0x7ff6580b4be0 2024-09-17T01:40:36.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.552+0000 7ff65e000640 1 -- 172.21.15.42:0/3215238071 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ff6580b4250 con 0x7ff6580b4be0 2024-09-17T01:40:36.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.556+0000 7ff654c00640 1 -- 172.21.15.42:0/3215238071 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v52)=0 v52) ==== 122+0+0 (secure 0 0 0) 0x7ff644067d80 con 0x7ff6580b4be0 2024-09-17T01:40:36.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.559+0000 7ff65e000640 1 -- 172.21.15.42:0/3215238071 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff638078b90 msgr2=0x7ff63807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:36.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.559+0000 7ff65e000640 1 --2- 172.21.15.42:0/3215238071 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff638078b90 0x7ff63807b0a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff64c007d60 tx=0x7ff64c007cf0 comp rx=0 tx=0).stop 2024-09-17T01:40:36.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.559+0000 7ff65e000640 1 -- 172.21.15.42:0/3215238071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6580b4be0 msgr2=0x7ff6581520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:36.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.559+0000 7ff65e000640 1 --2- 172.21.15.42:0/3215238071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6580b4be0 0x7ff6581520f0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7ff64400ea20 tx=0x7ff64400eee0 comp rx=0 tx=0).stop 2024-09-17T01:40:36.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.559+0000 7ff65e000640 1 -- 172.21.15.42:0/3215238071 shutdown_connections 2024-09-17T01:40:36.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.559+0000 7ff65e000640 1 --2- 172.21.15.42:0/3215238071 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff638078b90 0x7ff63807b0a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:36.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.559+0000 7ff65e000640 1 --2- 172.21.15.42:0/3215238071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6580cf7c0 0x7ff6580c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:36.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.559+0000 7ff65e000640 1 --2- 172.21.15.42:0/3215238071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6580b4be0 0x7ff6581520f0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:36.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.559+0000 7ff65e000640 1 --2- 172.21.15.42:0/3215238071 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff65806d260 0x7ff658074c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:36.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.559+0000 7ff65e000640 1 -- 172.21.15.42:0/3215238071 >> 172.21.15.42:0/3215238071 conn(0x7ff6580b25f0 msgr2=0x7ff6580b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:36.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.559+0000 7ff65e000640 1 -- 172.21.15.42:0/3215238071 shutdown_connections 2024-09-17T01:40:36.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:36.559+0000 7ff65e000640 1 -- 172.21.15.42:0/3215238071 wait complete. 2024-09-17T01:40:36.581 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:40:36.581 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:40:36.672 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:40:36.774 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:40:36.774 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:40:36.774 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:40:36.810 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:40:36.810 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:40:36.810 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:40:36.848 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:40:36.849 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:40:36.849 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:40:36.885 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:40:36.885 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:40:36.885 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:40:36.925 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:40:36.925 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T01:40:36.925 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:40:37.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.154+0000 7f46c8800640 1 -- 172.21.15.42:0/1703857855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46c0142f40 msgr2=0x7f46c0072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:37.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.154+0000 7f46c8800640 1 --2- 172.21.15.42:0/1703857855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46c0142f40 0x7f46c0072950 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009830 tx=0x7f46b002a480 comp rx=0 tx=0).stop 2024-09-17T01:40:37.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.155+0000 7f46c8800640 1 -- 172.21.15.42:0/1703857855 shutdown_connections 2024-09-17T01:40:37.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.155+0000 7f46c8800640 1 --2- 172.21.15.42:0/1703857855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46c0142f40 0x7f46c0072950 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:37.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.155+0000 7f46c8800640 1 --2- 172.21.15.42:0/1703857855 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46c00b3550 0x7f46c015cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:37.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.155+0000 7f46c8800640 1 -- 172.21.15.42:0/1703857855 >> 172.21.15.42:0/1703857855 conn(0x7f46c00b2930 msgr2=0x7f46c006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:37.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.155+0000 7f46c8800640 1 -- 172.21.15.42:0/1703857855 shutdown_connections 2024-09-17T01:40:37.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.155+0000 7f46c8800640 1 -- 172.21.15.42:0/1703857855 wait complete. 2024-09-17T01:40:37.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.157+0000 7f46c8800640 1 Processor -- start 2024-09-17T01:40:37.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.157+0000 7f46c8800640 1 -- start start 2024-09-17T01:40:37.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.159+0000 7f46c8800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46c0072e90 0x7f46c006f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:37.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.159+0000 7f46c8800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46c00b3550 0x7f46c01535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:37.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.159+0000 7f46c8800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46c0142f40 0x7f46c01f90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:37.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.159+0000 7f46c8800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f46c006d7c0 con 0x7f46c0142f40 2024-09-17T01:40:37.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.159+0000 7f46c8800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f46c006d640 con 0x7f46c0072e90 2024-09-17T01:40:37.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.159+0000 7f46c8800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f46c006d940 con 0x7f46c00b3550 2024-09-17T01:40:37.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.159+0000 7f46c6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46c0142f40 0x7f46c01f90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:37.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.159+0000 7f46c5e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46c0072e90 0x7f46c006f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:37.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.159+0000 7f46c6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46c0142f40 0x7f46c01f90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55934/0 (socket says 172.21.15.42:55934) 2024-09-17T01:40:37.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.159+0000 7f46c6800640 1 -- 172.21.15.42:0/2031004103 learned_addr learned my addr 172.21.15.42:0/2031004103 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:37.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.159+0000 7f46c5e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46c0072e90 0x7f46c006f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:34120/0 (socket says 172.21.15.42:34120) 2024-09-17T01:40:37.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.159+0000 7f46c5400640 1 --2- 172.21.15.42:0/2031004103 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46c00b3550 0x7f46c01535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:37.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.159+0000 7f46c6800640 1 -- 172.21.15.42:0/2031004103 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46c00b3550 msgr2=0x7f46c01535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:37.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.160+0000 7f46c6800640 1 --2- 172.21.15.42:0/2031004103 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46c00b3550 0x7f46c01535a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:37.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.160+0000 7f46c6800640 1 -- 172.21.15.42:0/2031004103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46c0072e90 msgr2=0x7f46c006f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:37.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.160+0000 7f46c6800640 1 --2- 172.21.15.42:0/2031004103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46c0072e90 0x7f46c006f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:37.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.160+0000 7f46c6800640 1 -- 172.21.15.42:0/2031004103 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c006fab0 con 0x7f46c0142f40 2024-09-17T01:40:37.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.160+0000 7f46c6800640 1 --2- 172.21.15.42:0/2031004103 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46c0142f40 0x7f46c01f90a0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00cb10 tx=0x7f46bc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:37.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.160+0000 7f46ba000640 1 -- 172.21.15.42:0/2031004103 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46bc016020 con 0x7f46c0142f40 2024-09-17T01:40:37.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.160+0000 7f46ba000640 1 -- 172.21.15.42:0/2031004103 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46bc00ad80 con 0x7f46c0142f40 2024-09-17T01:40:37.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.160+0000 7f46c8800640 1 -- 172.21.15.42:0/2031004103 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46c01568a0 con 0x7f46c0142f40 2024-09-17T01:40:37.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.160+0000 7f46ba000640 1 -- 172.21.15.42:0/2031004103 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46bc012680 con 0x7f46c0142f40 2024-09-17T01:40:37.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.160+0000 7f46c8800640 1 -- 172.21.15.42:0/2031004103 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46c006ed70 con 0x7f46c0142f40 2024-09-17T01:40:37.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.161+0000 7f46c8800640 1 -- 172.21.15.42:0/2031004103 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46c006eb90 con 0x7f46c0142f40 2024-09-17T01:40:37.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.163+0000 7f46ba000640 1 -- 172.21.15.42:0/2031004103 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f46bc019020 con 0x7f46c0142f40 2024-09-17T01:40:37.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.164+0000 7f46ba000640 1 --2- 172.21.15.42:0/2031004103 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f46a4078bc0 0x7f46a407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:37.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.164+0000 7f46ba000640 1 -- 172.21.15.42:0/2031004103 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 4943+0+0 (secure 0 0 0) 0x7f46bc09b070 con 0x7f46c0142f40 2024-09-17T01:40:37.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.165+0000 7f46c5e00640 1 --2- 172.21.15.42:0/2031004103 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f46a4078bc0 0x7f46a407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:37.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.165+0000 7f46c5e00640 1 --2- 172.21.15.42:0/2031004103 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f46a4078bc0 0x7f46a407b0d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f46b40095f0 tx=0x7f46b4005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:37.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.169+0000 7f46ba000640 1 -- 172.21.15.42:0/2031004103 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f46c006eb90 con 0x7f46c0142f40 2024-09-17T01:40:37.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.399+0000 7f46c8800640 1 -- 172.21.15.42:0/2031004103 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46c015cec0 con 0x7f46c0142f40 2024-09-17T01:40:37.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.400+0000 7f46ba000640 1 -- 172.21.15.42:0/2031004103 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+3911 (secure 0 0 0) 0x7f46bc020020 con 0x7f46c0142f40 2024-09-17T01:40:37.398 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:40:37.398 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":91,"btime":"2024-09-17T01:40:29:305461+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6620,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3878726745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3878726745},{"type":"v1","addr":"172.21.15.43:6836","nonce":3878726745}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":7255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2458291962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":2458291962},{"type":"v1","addr":"172.21.15.42:6835","nonce":2458291962}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":7261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2788778312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2788778312},{"type":"v1","addr":"172.21.15.43:6837","nonce":2788778312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":7501,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/4069938905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":4069938905},{"type":"v1","addr":"172.21.15.42:6834","nonce":4069938905}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":91}],"filesystems":[]} 2024-09-17T01:40:37.398 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 91 2024-09-17T01:40:37.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.403+0000 7f46c8800640 1 -- 172.21.15.42:0/2031004103 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f46a4078bc0 msgr2=0x7f46a407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:37.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.403+0000 7f46c8800640 1 --2- 172.21.15.42:0/2031004103 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f46a4078bc0 0x7f46a407b0d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f46b40095f0 tx=0x7f46b4005f90 comp rx=0 tx=0).stop 2024-09-17T01:40:37.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.403+0000 7f46c8800640 1 -- 172.21.15.42:0/2031004103 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46c0142f40 msgr2=0x7f46c01f90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:37.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.403+0000 7f46c8800640 1 --2- 172.21.15.42:0/2031004103 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46c0142f40 0x7f46c01f90a0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00cb10 tx=0x7f46bc00a060 comp rx=0 tx=0).stop 2024-09-17T01:40:37.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.403+0000 7f46c8800640 1 -- 172.21.15.42:0/2031004103 shutdown_connections 2024-09-17T01:40:37.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.403+0000 7f46c8800640 1 --2- 172.21.15.42:0/2031004103 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f46a4078bc0 0x7f46a407b0d0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:37.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.403+0000 7f46c8800640 1 --2- 172.21.15.42:0/2031004103 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46c0142f40 0x7f46c01f90a0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:37.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.403+0000 7f46c8800640 1 --2- 172.21.15.42:0/2031004103 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46c00b3550 0x7f46c01535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:37.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.403+0000 7f46c8800640 1 --2- 172.21.15.42:0/2031004103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46c0072e90 0x7f46c006f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:37.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.403+0000 7f46c8800640 1 -- 172.21.15.42:0/2031004103 >> 172.21.15.42:0/2031004103 conn(0x7f46c00b2930 msgr2=0x7f46c0160440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:37.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.403+0000 7f46c8800640 1 -- 172.21.15.42:0/2031004103 shutdown_connections 2024-09-17T01:40:37.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.403+0000 7f46c8800640 1 -- 172.21.15.42:0/2031004103 wait complete. 2024-09-17T01:40:37.423 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T01:40:37.423 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T01:40:37.423 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T01:40:37.423 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:40:37.423 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T01:40:37.423 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T01:40:37.424 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T01:40:37.424 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:40:37.424 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T01:40:37.424 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T01:40:37.424 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T01:40:37.424 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:40:37.425 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T01:40:37.425 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T01:40:37.425 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T01:40:37.425 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:40:37.450 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T01:40:37.450 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T01:40:37.451 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T01:40:37.451 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T01:40:37.457 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T01:40:37.457 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T01:40:37.458 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T01:40:37.458 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T01:40:37.495 INFO:tasks.ceph.mds.d:Started 2024-09-17T01:40:37.495 DEBUG:teuthology.parallel:result is None 2024-09-17T01:40:37.497 INFO:tasks.ceph.mds.b:Started 2024-09-17T01:40:37.497 DEBUG:teuthology.parallel:result is None 2024-09-17T01:40:37.501 INFO:tasks.ceph.mds.a:Started 2024-09-17T01:40:37.501 DEBUG:teuthology.parallel:result is None 2024-09-17T01:40:37.503 INFO:tasks.ceph.mds.c:Started 2024-09-17T01:40:37.504 DEBUG:teuthology.parallel:result is None 2024-09-17T01:40:37.504 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T01:40:37.696 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-09-17T01:40:37.698 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-09-17T01:40:37.700 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:40:37.703 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:40:37.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.744+0000 7fc9dc200640 1 -- 172.21.15.42:0/1518147197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9bc003c60 msgr2=0x7fc9bc0040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:37.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.744+0000 7fc9dc200640 1 --2- 172.21.15.42:0/1518147197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9bc003c60 0x7fc9bc0040b0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800c390 tx=0x7fc9bc005830 comp rx=0 tx=0).stop 2024-09-17T01:40:37.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.744+0000 7fc9da200640 1 -- 172.21.15.42:0/1518147197 reap_dead start 2024-09-17T01:40:37.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.744+0000 7fc9dc200640 1 -- 172.21.15.42:0/1518147197 shutdown_connections 2024-09-17T01:40:37.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.744+0000 7fc9dc200640 1 -- 172.21.15.42:0/1518147197 >> 172.21.15.42:0/1518147197 conn(0x7fc9d40b7990 msgr2=0x7fc9d40b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:37.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.744+0000 7fc9dc200640 1 -- 172.21.15.42:0/1518147197 shutdown_connections 2024-09-17T01:40:37.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.744+0000 7fc9dc200640 1 -- 172.21.15.42:0/1518147197 wait complete. 2024-09-17T01:40:37.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.746+0000 7fc9dc200640 1 Processor -- start 2024-09-17T01:40:37.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.746+0000 7fc9dc200640 1 -- start start 2024-09-17T01:40:37.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.747+0000 7fc9dc200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9bc003c60 0x7fc9d4162780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:37.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.747+0000 7fc9dc200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9d41f6350 0x7fc9d41f6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:37.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.748+0000 7fc9dc200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9d415bb30 0x7fc9d415bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:37.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.748+0000 7fc9dc200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d4167b60 con 0x7fc9d41f6350 2024-09-17T01:40:37.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.748+0000 7fc9dc200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d41679e0 con 0x7fc9bc003c60 2024-09-17T01:40:37.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.748+0000 7fc9dc200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc9d4167ce0 con 0x7fc9d415bb30 2024-09-17T01:40:37.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.748+0000 7fc9d8e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9d41f6350 0x7fc9d41f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:37.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.748+0000 7fc9d9800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9bc003c60 0x7fc9d4162780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:37.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.748+0000 7fc9d8e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9d41f6350 0x7fc9d41f6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56000/0 (socket says 172.21.15.42:56000) 2024-09-17T01:40:37.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.748+0000 7fc9d8e00640 1 -- 172.21.15.42:0/2446434154 learned_addr learned my addr 172.21.15.42:0/2446434154 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:37.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.748+0000 7fc9da200640 1 --2- 172.21.15.42:0/2446434154 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9d415bb30 0x7fc9d415bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:37.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.748+0000 7fc9d8e00640 1 -- 172.21.15.42:0/2446434154 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9d415bb30 msgr2=0x7fc9d415bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:37.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.748+0000 7fc9d8e00640 1 --2- 172.21.15.42:0/2446434154 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9d415bb30 0x7fc9d415bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:37.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.748+0000 7fc9d8e00640 1 -- 172.21.15.42:0/2446434154 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9bc003c60 msgr2=0x7fc9d4162780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:37.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.748+0000 7fc9d8e00640 1 --2- 172.21.15.42:0/2446434154 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9bc003c60 0x7fc9d4162780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:37.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.748+0000 7fc9d8e00640 1 -- 172.21.15.42:0/2446434154 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d415c480 con 0x7fc9d41f6350 2024-09-17T01:40:37.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.748+0000 7fc9da200640 1 --2- 172.21.15.42:0/2446434154 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9d415bb30 0x7fc9d415bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:40:37.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.748+0000 7fc9d9800640 1 --2- 172.21.15.42:0/2446434154 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9bc003c60 0x7fc9d4162780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:40:37.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.749+0000 7fc9d8e00640 1 --2- 172.21.15.42:0/2446434154 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9d41f6350 0x7fc9d41f6760 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0003e10 tx=0x7fc9c0001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:37.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.749+0000 7fc9d1600640 1 -- 172.21.15.42:0/2446434154 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0015070 con 0x7fc9d41f6350 2024-09-17T01:40:37.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.749+0000 7fc9d1600640 1 -- 172.21.15.42:0/2446434154 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9c0011900 con 0x7fc9d41f6350 2024-09-17T01:40:37.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.749+0000 7fc9dc200640 1 -- 172.21.15.42:0/2446434154 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9d415df70 con 0x7fc9d41f6350 2024-09-17T01:40:37.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.749+0000 7fc9d1600640 1 -- 172.21.15.42:0/2446434154 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0011d50 con 0x7fc9d41f6350 2024-09-17T01:40:37.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.749+0000 7fc9dc200640 1 -- 172.21.15.42:0/2446434154 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9d415e530 con 0x7fc9d41f6350 2024-09-17T01:40:37.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.750+0000 7fc9dc200640 1 -- 172.21.15.42:0/2446434154 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9d40b70f0 con 0x7fc9d41f6350 2024-09-17T01:40:37.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.752+0000 7fc9d1600640 1 -- 172.21.15.42:0/2446434154 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc9c0018070 con 0x7fc9d41f6350 2024-09-17T01:40:37.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.752+0000 7fc9d1600640 1 --2- 172.21.15.42:0/2446434154 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc9b4078b90 0x7fc9b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:37.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.753+0000 7fc9d1600640 1 -- 172.21.15.42:0/2446434154 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 4943+0+0 (secure 0 0 0) 0x7fc9c009b770 con 0x7fc9d41f6350 2024-09-17T01:40:37.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.753+0000 7fc9d9800640 1 --2- 172.21.15.42:0/2446434154 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc9b4078b90 0x7fc9b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:37.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.754+0000 7fc9d9800640 1 --2- 172.21.15.42:0/2446434154 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc9b4078b90 0x7fc9b407b0a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8033000 tx=0x7fc9c802d070 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:37.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.757+0000 7fc9d1600640 1 -- 172.21.15.42:0/2446434154 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc9d415c480 con 0x7fc9d41f6350 2024-09-17T01:40:37.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:37.964+0000 7fc9dc200640 1 -- 172.21.15.42:0/2446434154 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fc9d4163090 con 0x7fc9d41f6350 2024-09-17T01:40:38.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.651+0000 7fc9d1600640 1 -- 172.21.15.42:0/2446434154 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v117) ==== 97+0+0 (secure 0 0 0) 0x7fc9c0063850 con 0x7fc9d41f6350 2024-09-17T01:40:38.649 INFO:teuthology.orchestra.run.smithi042.stderr: removed all blocklist entries 2024-09-17T01:40:38.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.654+0000 7fc9dc200640 1 -- 172.21.15.42:0/2446434154 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc9b4078b90 msgr2=0x7fc9b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:38.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.654+0000 7fc9dc200640 1 --2- 172.21.15.42:0/2446434154 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc9b4078b90 0x7fc9b407b0a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8033000 tx=0x7fc9c802d070 comp rx=0 tx=0).stop 2024-09-17T01:40:38.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.654+0000 7fc9dc200640 1 -- 172.21.15.42:0/2446434154 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9d41f6350 msgr2=0x7fc9d41f6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:38.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.654+0000 7fc9dc200640 1 --2- 172.21.15.42:0/2446434154 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9d41f6350 0x7fc9d41f6760 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0003e10 tx=0x7fc9c0001800 comp rx=0 tx=0).stop 2024-09-17T01:40:38.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.655+0000 7fc9dc200640 1 -- 172.21.15.42:0/2446434154 shutdown_connections 2024-09-17T01:40:38.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.655+0000 7fc9dc200640 1 --2- 172.21.15.42:0/2446434154 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc9b4078b90 0x7fc9b407b0a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:38.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.655+0000 7fc9dc200640 1 --2- 172.21.15.42:0/2446434154 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9d415bb30 0x7fc9d415bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:38.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.655+0000 7fc9dc200640 1 --2- 172.21.15.42:0/2446434154 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9d41f6350 0x7fc9d41f6760 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:38.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.655+0000 7fc9dc200640 1 --2- 172.21.15.42:0/2446434154 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9bc003c60 0x7fc9d4162780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:38.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.655+0000 7fc9dc200640 1 -- 172.21.15.42:0/2446434154 >> 172.21.15.42:0/2446434154 conn(0x7fc9d40b7990 msgr2=0x7fc9d40706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:38.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.655+0000 7fc9dc200640 1 -- 172.21.15.42:0/2446434154 shutdown_connections 2024-09-17T01:40:38.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.655+0000 7fc9dc200640 1 -- 172.21.15.42:0/2446434154 wait complete. 2024-09-17T01:40:38.681 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T01:40:38.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.916+0000 7f17a5600640 1 -- 172.21.15.42:0/2894066773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17a015cb80 msgr2=0x7f17a0152710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:38.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.916+0000 7f17a5600640 1 --2- 172.21.15.42:0/2894066773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17a015cb80 0x7f17a0152710 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f17a006f5f0 tx=0x7f179002a5f0 comp rx=0 tx=0).stop 2024-09-17T01:40:38.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.916+0000 7f17a5600640 1 -- 172.21.15.42:0/2894066773 shutdown_connections 2024-09-17T01:40:38.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.916+0000 7f17a5600640 1 --2- 172.21.15.42:0/2894066773 >> v2:172.21.15.43:3300/0 conn(0x7f17a015f480 0x7f17a015f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:38.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.916+0000 7f17a5600640 1 --2- 172.21.15.42:0/2894066773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17a015cb80 0x7f17a0152710 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:38.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.916+0000 7f17a5600640 1 -- 172.21.15.42:0/2894066773 >> 172.21.15.42:0/2894066773 conn(0x7f17a00b2930 msgr2=0x7f17a006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:38.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.916+0000 7f17a5600640 1 -- 172.21.15.42:0/2894066773 shutdown_connections 2024-09-17T01:40:38.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.916+0000 7f17a5600640 1 -- 172.21.15.42:0/2894066773 wait complete. 2024-09-17T01:40:38.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.919+0000 7f17a5600640 1 Processor -- start 2024-09-17T01:40:38.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.919+0000 7f17a5600640 1 -- start start 2024-09-17T01:40:38.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.920+0000 7f17a5600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17a006d430 0x7f17a0147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:38.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.920+0000 7f17a5600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17a015cb80 0x7f17a0144450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:38.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.920+0000 7f17a5600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17a015f480 0x7f17a01f8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:38.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.920+0000 7f17a5600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f17a00737e0 con 0x7f17a015f480 2024-09-17T01:40:38.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.920+0000 7f17a5600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f17a0073660 con 0x7f17a015cb80 2024-09-17T01:40:38.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.920+0000 7f17a5600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f17a0073960 con 0x7f17a006d430 2024-09-17T01:40:38.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.920+0000 7f179f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17a015f480 0x7f17a01f8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:38.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.920+0000 7f179f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17a015f480 0x7f17a01f8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56018/0 (socket says 172.21.15.42:56018) 2024-09-17T01:40:38.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.920+0000 7f179f400640 1 -- 172.21.15.42:0/332745175 learned_addr learned my addr 172.21.15.42:0/332745175 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:38.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.921+0000 7f1797e00640 1 --2- 172.21.15.42:0/332745175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17a015cb80 0x7f17a0144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:38.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.921+0000 7f179ea00640 1 --2- 172.21.15.42:0/332745175 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17a006d430 0x7f17a0147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:38.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.921+0000 7f179f400640 1 -- 172.21.15.42:0/332745175 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17a006d430 msgr2=0x7f17a0147990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:38.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.921+0000 7f179f400640 1 --2- 172.21.15.42:0/332745175 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17a006d430 0x7f17a0147990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:38.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.921+0000 7f179f400640 1 -- 172.21.15.42:0/332745175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17a015cb80 msgr2=0x7f17a0144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:38.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.921+0000 7f179f400640 1 --2- 172.21.15.42:0/332745175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17a015cb80 0x7f17a0144450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:38.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.921+0000 7f179f400640 1 -- 172.21.15.42:0/332745175 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a0155c10 con 0x7f17a015f480 2024-09-17T01:40:38.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.921+0000 7f179ea00640 1 --2- 172.21.15.42:0/332745175 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17a006d430 0x7f17a0147990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:40:38.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.921+0000 7f179f400640 1 --2- 172.21.15.42:0/332745175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17a015f480 0x7f17a01f8e20 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f179800d9e0 tx=0x7f179800dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:38.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.921+0000 7f1796a00640 1 -- 172.21.15.42:0/332745175 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1798017070 con 0x7f17a015f480 2024-09-17T01:40:38.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.921+0000 7f1796a00640 1 -- 172.21.15.42:0/332745175 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f179800be30 con 0x7f17a015f480 2024-09-17T01:40:38.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.921+0000 7f1796a00640 1 -- 172.21.15.42:0/332745175 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1798003bb0 con 0x7f17a015f480 2024-09-17T01:40:38.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.922+0000 7f17a5600640 1 -- 172.21.15.42:0/332745175 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17a0158f60 con 0x7f17a015f480 2024-09-17T01:40:38.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.922+0000 7f17a5600640 1 -- 172.21.15.42:0/332745175 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17a0156190 con 0x7f17a015f480 2024-09-17T01:40:38.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.923+0000 7f17a5600640 1 -- 172.21.15.42:0/332745175 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17a0073e80 con 0x7f17a015f480 2024-09-17T01:40:38.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.924+0000 7f1796a00640 1 -- 172.21.15.42:0/332745175 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1798010460 con 0x7f17a015f480 2024-09-17T01:40:38.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.925+0000 7f1796a00640 1 --2- 172.21.15.42:0/332745175 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f177c078bc0 0x7f177c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:38.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.925+0000 7f1796a00640 1 -- 172.21.15.42:0/332745175 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 4857+0+0 (secure 0 0 0) 0x7f179809ad90 con 0x7f17a015f480 2024-09-17T01:40:38.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.925+0000 7f179ea00640 1 --2- 172.21.15.42:0/332745175 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f177c078bc0 0x7f177c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:38.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.926+0000 7f179ea00640 1 --2- 172.21.15.42:0/332745175 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f177c078bc0 0x7f177c07b0d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1790033000 tx=0x7f1790004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:38.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:38.929+0000 7f1796a00640 1 -- 172.21.15.42:0/332745175 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1798063640 con 0x7f17a015f480 2024-09-17T01:40:39.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.195+0000 7f17a5600640 1 -- 172.21.15.42:0/332745175 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f17a015b470 con 0x7f17a015f480 2024-09-17T01:40:39.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.196+0000 7f1796a00640 1 -- 172.21.15.42:0/332745175 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v35) ==== 80+0+5304 (secure 0 0 0) 0x7f1798062f40 con 0x7f17a015f480 2024-09-17T01:40:39.194 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:40:39.194 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:40:39.194 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_dump": [ 2024-09-17T01:40:39.194 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:40:39.194 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.a", 2024-09-17T01:40:39.194 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmyJK4HRAAIC4E4V7p1fqIEfPIICMxZg==", 2024-09-17T01:40:39.194 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:40:39.194 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:40:39.194 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:40:39.194 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:40:39.194 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:40:39.194 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:39.195 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:39.195 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:40:39.195 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.b", 2024-09-17T01:40:39.195 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmXv3vORAALPrYIM6Vtz0g1pOxVhrUig==", 2024-09-17T01:40:39.195 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:40:39.195 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:40:39.195 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:40:39.195 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:40:39.195 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:40:39.195 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:39.195 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:39.195 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:40:39.195 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.c", 2024-09-17T01:40:39.195 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmPE7MKxAA9mGG+EO9C3VGVMerOm92+Q==", 2024-09-17T01:40:39.196 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:40:39.196 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:40:39.196 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:40:39.196 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:40:39.196 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:40:39.196 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:39.196 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:39.196 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:40:39.196 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.d", 2024-09-17T01:40:39.196 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmaOBSDBAATU4tpjM5IMcuvzZFE7N5bQ==", 2024-09-17T01:40:39.196 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:40:39.196 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:40:39.197 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:40:39.197 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:40:39.197 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:40:39.197 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:39.197 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:39.197 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:40:39.197 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.0", 2024-09-17T01:40:39.197 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDP2+hmEJebExAAAdGEoSzM96ybGT9h7t7OkA==", 2024-09-17T01:40:39.197 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:40:39.197 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:40:39.197 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:40:39.197 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:40:39.197 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:39.197 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:39.198 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:40:39.198 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.1", 2024-09-17T01:40:39.198 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDS2+hm7dWoMBAAagktrUl0O2/mgKCEfpAstA==", 2024-09-17T01:40:39.198 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:40:39.198 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:40:39.198 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:40:39.198 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:40:39.198 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:39.198 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:39.198 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:40:39.198 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.2", 2024-09-17T01:40:39.198 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDW2+hmEfSPBBAAPAa6EZt27yUcJSfZyCKheg==", 2024-09-17T01:40:39.198 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:40:39.198 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:40:39.199 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:40:39.199 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:40:39.199 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:39.199 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:39.199 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:40:39.199 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.3", 2024-09-17T01:40:39.199 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDZ2+hmHQhXFRAAj84g+IKqH6KMP7LjRtFvLw==", 2024-09-17T01:40:39.199 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:40:39.199 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:40:39.199 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:40:39.200 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:40:39.200 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:39.200 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:39.200 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:40:39.200 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.4", 2024-09-17T01:40:39.200 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDd2+hmaNcMNBAAx1GV/oFdfssMjFWFN5M0VQ==", 2024-09-17T01:40:39.200 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:40:39.200 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:40:39.200 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:40:39.200 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:40:39.200 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:39.200 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:39.200 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:40:39.201 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.5", 2024-09-17T01:40:39.201 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDh2+hm301NJhAAnSUH5AAvqhPwM7loH6frww==", 2024-09-17T01:40:39.201 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:40:39.201 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:40:39.201 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:40:39.201 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:40:39.201 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:39.201 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:39.201 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:40:39.201 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.6", 2024-09-17T01:40:39.201 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDk2+hm61WNNRAAbCvVvsUpB4fgt4ja60DRZA==", 2024-09-17T01:40:39.201 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:40:39.201 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:40:39.201 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:40:39.202 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:40:39.202 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:39.202 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:39.202 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:40:39.202 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.7", 2024-09-17T01:40:39.202 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDo2+hmesiLFhAA29n1eageNvP+lkRyh6gGMw==", 2024-09-17T01:40:39.202 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:40:39.202 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:40:39.202 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:40:39.202 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:40:39.202 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:39.202 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:39.202 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:40:39.202 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.0", 2024-09-17T01:40:39.203 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA==", 2024-09-17T01:40:39.203 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:40:39.203 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:40:39.203 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow r", 2024-09-17T01:40:39.203 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T01:40:39.203 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:39.203 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:39.203 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:40:39.203 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.1", 2024-09-17T01:40:39.203 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmZLygLhAABlauZgnidFWvfCCPuBLObg==", 2024-09-17T01:40:39.203 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:40:39.203 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:40:39.203 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:40:39.203 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:40:39.204 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:40:39.204 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:39.204 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:39.204 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:40:39.204 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.2", 2024-09-17T01:40:39.204 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hm8lnZIxAAN0a2CVMMtu/Nz50OG4a02A==", 2024-09-17T01:40:39.204 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:40:39.204 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:40:39.204 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:40:39.204 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:40:39.204 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:40:39.204 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:39.204 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:39.205 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:40:39.205 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.3", 2024-09-17T01:40:39.205 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmgXdAORAAM5Uy66I4nnTJ9Vhkn9JoBw==", 2024-09-17T01:40:39.205 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:40:39.205 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:40:39.205 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:40:39.205 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:40:39.205 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:40:39.205 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:39.205 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:39.205 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:40:39.205 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.admin", 2024-09-17T01:40:39.205 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDL2+hmvCreHBAA4CSAhosssViGqD93U+I7Iw==", 2024-09-17T01:40:39.206 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:40:39.206 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:40:39.206 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:40:39.206 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:40:39.206 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:40:39.206 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:39.206 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:39.206 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:40:39.206 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.x", 2024-09-17T01:40:39.206 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmYPnlEhAAIcQ11ktWZyMXYdbAONiLog==", 2024-09-17T01:40:39.207 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:40:39.207 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:40:39.207 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:40:39.207 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:40:39.207 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:39.207 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:40:39.207 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:40:39.207 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.y", 2024-09-17T01:40:39.207 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmpCZtBxAAp5tXMc6aEq1aOny2LJZAiA==", 2024-09-17T01:40:39.207 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:40:39.207 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:40:39.207 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:40:39.207 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:40:39.207 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:39.208 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:39.208 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-17T01:40:39.208 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:40:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.198+0000 7f17a5600640 1 -- 172.21.15.42:0/332745175 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f177c078bc0 msgr2=0x7f177c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.198+0000 7f17a5600640 1 --2- 172.21.15.42:0/332745175 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f177c078bc0 0x7f177c07b0d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1790033000 tx=0x7f1790004730 comp rx=0 tx=0).stop 2024-09-17T01:40:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.198+0000 7f17a5600640 1 -- 172.21.15.42:0/332745175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17a015f480 msgr2=0x7f17a01f8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.198+0000 7f17a5600640 1 --2- 172.21.15.42:0/332745175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17a015f480 0x7f17a01f8e20 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f179800d9e0 tx=0x7f179800dea0 comp rx=0 tx=0).stop 2024-09-17T01:40:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.198+0000 7f17a5600640 1 -- 172.21.15.42:0/332745175 shutdown_connections 2024-09-17T01:40:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.198+0000 7f17a5600640 1 --2- 172.21.15.42:0/332745175 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f177c078bc0 0x7f177c07b0d0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.198+0000 7f17a5600640 1 --2- 172.21.15.42:0/332745175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17a015cb80 0x7f17a0144450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.198+0000 7f17a5600640 1 --2- 172.21.15.42:0/332745175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17a015f480 0x7f17a01f8e20 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.198+0000 7f17a5600640 1 --2- 172.21.15.42:0/332745175 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17a006d430 0x7f17a0147990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:39.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.198+0000 7f17a5600640 1 -- 172.21.15.42:0/332745175 >> 172.21.15.42:0/332745175 conn(0x7f17a00b2930 msgr2=0x7f17a00724a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:39.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.198+0000 7f17a5600640 1 -- 172.21.15.42:0/332745175 shutdown_connections 2024-09-17T01:40:39.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.198+0000 7f17a5600640 1 -- 172.21.15.42:0/332745175 wait complete. 2024-09-17T01:40:39.218 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T01:40:39.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.449+0000 7fbaa2400640 1 -- 172.21.15.42:0/2514945273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba9c06d430 msgr2=0x7fba9c152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:39.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.449+0000 7fbaa2400640 1 --2- 172.21.15.42:0/2514945273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba9c06d430 0x7fba9c152ed0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fba94005fd0 tx=0x7fba9402a8b0 comp rx=0 tx=0).stop 2024-09-17T01:40:39.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.449+0000 7fbaa2400640 1 -- 172.21.15.42:0/2514945273 shutdown_connections 2024-09-17T01:40:39.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.449+0000 7fbaa2400640 1 --2- 172.21.15.42:0/2514945273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba9c06d430 0x7fba9c152ed0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:39.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.449+0000 7fbaa2400640 1 --2- 172.21.15.42:0/2514945273 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba9c0b4be0 0x7fba9c15d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:39.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.449+0000 7fbaa2400640 1 -- 172.21.15.42:0/2514945273 >> 172.21.15.42:0/2514945273 conn(0x7fba9c0b25f0 msgr2=0x7fba9c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:39.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.449+0000 7fbaa2400640 1 -- 172.21.15.42:0/2514945273 shutdown_connections 2024-09-17T01:40:39.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.449+0000 7fbaa2400640 1 -- 172.21.15.42:0/2514945273 wait complete. 2024-09-17T01:40:39.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.451+0000 7fbaa2400640 1 Processor -- start 2024-09-17T01:40:39.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.452+0000 7fbaa2400640 1 -- start start 2024-09-17T01:40:39.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.453+0000 7fbaa2400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba9c0b4be0 0x7fba9c1f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:39.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.453+0000 7fbaa2400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba9c0cf7c0 0x7fba9c15bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:39.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.453+0000 7fbaa2400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba9c0cbff0 0x7fba9c0cc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:39.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.453+0000 7fbaa2400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c153850 con 0x7fba9c0b4be0 2024-09-17T01:40:39.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.453+0000 7fbaa2400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c1536d0 con 0x7fba9c0cbff0 2024-09-17T01:40:39.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.453+0000 7fbaa2400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fba9c1539d0 con 0x7fba9c0cf7c0 2024-09-17T01:40:39.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.453+0000 7fbaa1000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba9c0b4be0 0x7fba9c1f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:39.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.453+0000 7fbaa1000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba9c0b4be0 0x7fba9c1f4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56032/0 (socket says 172.21.15.42:56032) 2024-09-17T01:40:39.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.453+0000 7fbaa1000640 1 -- 172.21.15.42:0/2236013302 learned_addr learned my addr 172.21.15.42:0/2236013302 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:39.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.454+0000 7fbaa1a00640 1 --2- 172.21.15.42:0/2236013302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba9c0cbff0 0x7fba9c0cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:39.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.454+0000 7fbaa1000640 1 -- 172.21.15.42:0/2236013302 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba9c0cf7c0 msgr2=0x7fba9c15bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:39.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.454+0000 7fba9be00640 1 --2- 172.21.15.42:0/2236013302 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba9c0cf7c0 0x7fba9c15bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:39.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.454+0000 7fbaa1000640 1 --2- 172.21.15.42:0/2236013302 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba9c0cf7c0 0x7fba9c15bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:39.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.454+0000 7fbaa1000640 1 -- 172.21.15.42:0/2236013302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba9c0cbff0 msgr2=0x7fba9c0cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:39.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.454+0000 7fbaa1000640 1 --2- 172.21.15.42:0/2236013302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba9c0cbff0 0x7fba9c0cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:39.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.454+0000 7fbaa1000640 1 -- 172.21.15.42:0/2236013302 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba9c1f8880 con 0x7fba9c0b4be0 2024-09-17T01:40:39.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.454+0000 7fbaa1a00640 1 --2- 172.21.15.42:0/2236013302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba9c0cbff0 0x7fba9c0cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:40:39.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.454+0000 7fba9be00640 1 --2- 172.21.15.42:0/2236013302 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba9c0cf7c0 0x7fba9c15bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:40:39.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.454+0000 7fbaa1000640 1 --2- 172.21.15.42:0/2236013302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba9c0b4be0 0x7fba9c1f4f50 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fba9000e9f0 tx=0x7fba9000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:39.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.454+0000 7fba98c00640 1 -- 172.21.15.42:0/2236013302 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9000cd80 con 0x7fba9c0b4be0 2024-09-17T01:40:39.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.455+0000 7fbaa2400640 1 -- 172.21.15.42:0/2236013302 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba9c1f8b60 con 0x7fba9c0b4be0 2024-09-17T01:40:39.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.454+0000 7fba98c00640 1 -- 172.21.15.42:0/2236013302 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba90004020 con 0x7fba9c0b4be0 2024-09-17T01:40:39.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.455+0000 7fba98c00640 1 -- 172.21.15.42:0/2236013302 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba90004470 con 0x7fba9c0b4be0 2024-09-17T01:40:39.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.455+0000 7fbaa2400640 1 -- 172.21.15.42:0/2236013302 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba9c1f9120 con 0x7fba9c0b4be0 2024-09-17T01:40:39.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.456+0000 7fbaa2400640 1 -- 172.21.15.42:0/2236013302 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba9c1f5490 con 0x7fba9c0b4be0 2024-09-17T01:40:39.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.457+0000 7fba98c00640 1 -- 172.21.15.42:0/2236013302 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fba900035f0 con 0x7fba9c0b4be0 2024-09-17T01:40:39.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.458+0000 7fba98c00640 1 --2- 172.21.15.42:0/2236013302 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fba7c078bc0 0x7fba7c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:39.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.458+0000 7fba98c00640 1 -- 172.21.15.42:0/2236013302 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 4857+0+0 (secure 0 0 0) 0x7fba9009b2c0 con 0x7fba9c0b4be0 2024-09-17T01:40:39.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.459+0000 7fba9be00640 1 --2- 172.21.15.42:0/2236013302 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fba7c078bc0 0x7fba7c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:39.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.459+0000 7fba9be00640 1 --2- 172.21.15.42:0/2236013302 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fba7c078bc0 0x7fba7c07b0d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fba880013f0 tx=0x7fba88009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:39.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.462+0000 7fba98c00640 1 -- 172.21.15.42:0/2236013302 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fba90063ad0 con 0x7fba9c0b4be0 2024-09-17T01:40:39.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.667+0000 7fbaa2400640 1 -- 172.21.15.42:0/2236013302 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fba9c152ed0 con 0x7fba9c0b4be0 2024-09-17T01:40:39.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.668+0000 7fba98c00640 1 -- 172.21.15.42:0/2236013302 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v119) ==== 84+0+65 (secure 0 0 0) 0x7fba9009b0c0 con 0x7fba9c0b4be0 2024-09-17T01:40:39.668 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:40:39.668 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-09-17T01:40:39.668 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:40:39.669 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-09-17T01:40:39.669 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-09-17T01:40:39.669 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:40:39.669 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-09-17T01:40:39.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.670+0000 7fbaa2400640 1 -- 172.21.15.42:0/2236013302 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fba7c078bc0 msgr2=0x7fba7c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:39.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.670+0000 7fbaa2400640 1 --2- 172.21.15.42:0/2236013302 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fba7c078bc0 0x7fba7c07b0d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fba880013f0 tx=0x7fba88009040 comp rx=0 tx=0).stop 2024-09-17T01:40:39.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.670+0000 7fbaa2400640 1 -- 172.21.15.42:0/2236013302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba9c0b4be0 msgr2=0x7fba9c1f4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:39.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.670+0000 7fbaa2400640 1 --2- 172.21.15.42:0/2236013302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba9c0b4be0 0x7fba9c1f4f50 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fba9000e9f0 tx=0x7fba9000eeb0 comp rx=0 tx=0).stop 2024-09-17T01:40:39.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.670+0000 7fbaa2400640 1 -- 172.21.15.42:0/2236013302 shutdown_connections 2024-09-17T01:40:39.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.670+0000 7fbaa2400640 1 --2- 172.21.15.42:0/2236013302 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fba7c078bc0 0x7fba7c07b0d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:39.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.670+0000 7fbaa2400640 1 --2- 172.21.15.42:0/2236013302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba9c0cbff0 0x7fba9c0cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:39.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.670+0000 7fbaa2400640 1 --2- 172.21.15.42:0/2236013302 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba9c0cf7c0 0x7fba9c15bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:39.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.670+0000 7fbaa2400640 1 --2- 172.21.15.42:0/2236013302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba9c0b4be0 0x7fba9c1f4f50 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:39.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.670+0000 7fbaa2400640 1 -- 172.21.15.42:0/2236013302 >> 172.21.15.42:0/2236013302 conn(0x7fba9c0b25f0 msgr2=0x7fba9c0b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:39.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.670+0000 7fbaa2400640 1 -- 172.21.15.42:0/2236013302 shutdown_connections 2024-09-17T01:40:39.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.670+0000 7fbaa2400640 1 -- 172.21.15.42:0/2236013302 wait complete. 2024-09-17T01:40:39.693 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T01:40:39.693 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T01:40:39.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.925+0000 7f3857200640 1 -- 172.21.15.42:0/3125008420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38580af4f0 msgr2=0x7f385815d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:39.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.925+0000 7f3857200640 1 --2- 172.21.15.42:0/3125008420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38580af4f0 0x7f385815d6a0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f38580af900 tx=0x7f384802a560 comp rx=0 tx=0).stop 2024-09-17T01:40:39.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.925+0000 7f3857200640 1 -- 172.21.15.42:0/3125008420 shutdown_connections 2024-09-17T01:40:39.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.925+0000 7f3857200640 1 --2- 172.21.15.42:0/3125008420 >> v2:172.21.15.43:3300/0 conn(0x7f38580aebf0 0x7f385806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:39.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.925+0000 7f3857200640 1 --2- 172.21.15.42:0/3125008420 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f385806d260 0x7f3858160210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:39.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.925+0000 7f3857200640 1 --2- 172.21.15.42:0/3125008420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38580af4f0 0x7f385815d6a0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:39.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.925+0000 7f3857200640 1 -- 172.21.15.42:0/3125008420 >> 172.21.15.42:0/3125008420 conn(0x7f38580b25d0 msgr2=0x7f38580d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:39.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.925+0000 7f3857200640 1 -- 172.21.15.42:0/3125008420 shutdown_connections 2024-09-17T01:40:39.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.925+0000 7f3857200640 1 -- 172.21.15.42:0/3125008420 wait complete. 2024-09-17T01:40:39.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.927+0000 7f3857200640 1 Processor -- start 2024-09-17T01:40:39.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.927+0000 7f3857200640 1 -- start start 2024-09-17T01:40:39.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.929+0000 7f3857200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f385806d260 0x7f38580735a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:39.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.929+0000 7f3857200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f38580aebf0 0x7f385815f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:39.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.929+0000 7f3857200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38580af4f0 0x7f3858158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:39.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.929+0000 7f3857200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f38581608d0 con 0x7f38580af4f0 2024-09-17T01:40:39.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.929+0000 7f3857200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3858160750 con 0x7f385806d260 2024-09-17T01:40:39.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.929+0000 7f3857200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3858160a50 con 0x7f38580aebf0 2024-09-17T01:40:39.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.929+0000 7f3856800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38580af4f0 0x7f3858158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:39.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.929+0000 7f3856800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38580af4f0 0x7f3858158330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56046/0 (socket says 172.21.15.42:56046) 2024-09-17T01:40:39.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.929+0000 7f3856800640 1 -- 172.21.15.42:0/1647236916 learned_addr learned my addr 172.21.15.42:0/1647236916 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:39.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.929+0000 7f3855e00640 1 --2- 172.21.15.42:0/1647236916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f385806d260 0x7f38580735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:39.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.929+0000 7f384fe00640 1 --2- 172.21.15.42:0/1647236916 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f38580aebf0 0x7f385815f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:39.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.930+0000 7f3856800640 1 -- 172.21.15.42:0/1647236916 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f38580aebf0 msgr2=0x7f385815f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:39.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.930+0000 7f3856800640 1 --2- 172.21.15.42:0/1647236916 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f38580aebf0 0x7f385815f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:39.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.930+0000 7f3856800640 1 -- 172.21.15.42:0/1647236916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f385806d260 msgr2=0x7f38580735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:39.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.930+0000 7f3856800640 1 --2- 172.21.15.42:0/1647236916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f385806d260 0x7f38580735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:39.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.930+0000 7f3856800640 1 -- 172.21.15.42:0/1647236916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3858157870 con 0x7f38580af4f0 2024-09-17T01:40:39.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.930+0000 7f3856800640 1 --2- 172.21.15.42:0/1647236916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38580af4f0 0x7f3858158330 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f385000e960 tx=0x7f385000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:39.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.930+0000 7f384e000640 1 -- 172.21.15.42:0/1647236916 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3850004d20 con 0x7f38580af4f0 2024-09-17T01:40:39.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.930+0000 7f384e000640 1 -- 172.21.15.42:0/1647236916 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f385000ca60 con 0x7f38580af4f0 2024-09-17T01:40:39.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.930+0000 7f384e000640 1 -- 172.21.15.42:0/1647236916 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3850005020 con 0x7f38580af4f0 2024-09-17T01:40:39.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.930+0000 7f3857200640 1 -- 172.21.15.42:0/1647236916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3858073ae0 con 0x7f38580af4f0 2024-09-17T01:40:39.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.931+0000 7f3857200640 1 -- 172.21.15.42:0/1647236916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3858157b30 con 0x7f38580af4f0 2024-09-17T01:40:39.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.931+0000 7f3857200640 1 -- 172.21.15.42:0/1647236916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3858160fe0 con 0x7f38580af4f0 2024-09-17T01:40:39.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.933+0000 7f384e000640 1 -- 172.21.15.42:0/1647236916 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f38500051c0 con 0x7f38580af4f0 2024-09-17T01:40:39.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.934+0000 7f384e000640 1 --2- 172.21.15.42:0/1647236916 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3834078b90 0x7f383407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:39.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.934+0000 7f384e000640 1 -- 172.21.15.42:0/1647236916 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 4857+0+0 (secure 0 0 0) 0x7f385009b530 con 0x7f38580af4f0 2024-09-17T01:40:39.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.934+0000 7f3855e00640 1 --2- 172.21.15.42:0/1647236916 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3834078b90 0x7f383407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:39.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.935+0000 7f3855e00640 1 --2- 172.21.15.42:0/1647236916 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3834078b90 0x7f383407b0a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3848033000 tx=0x7f3848004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:39.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:39.938+0000 7f384e000640 1 -- 172.21.15.42:0/1647236916 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3850016030 con 0x7f38580af4f0 2024-09-17T01:40:40.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.131+0000 7f3857200640 1 -- 172.21.15.42:0/1647236916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f38581f6140 con 0x7f38580af4f0 2024-09-17T01:40:40.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.666+0000 7f384e000640 1 -- 172.21.15.42:0/1647236916 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v120) ==== 138+0+0 (secure 0 0 0) 0x7f3850063660 con 0x7f38580af4f0 2024-09-17T01:40:40.664 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-09-17T01:40:40.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.669+0000 7f3857200640 1 -- 172.21.15.42:0/1647236916 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3834078b90 msgr2=0x7f383407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:40.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.669+0000 7f3857200640 1 --2- 172.21.15.42:0/1647236916 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3834078b90 0x7f383407b0a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3848033000 tx=0x7f3848004730 comp rx=0 tx=0).stop 2024-09-17T01:40:40.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.669+0000 7f3857200640 1 -- 172.21.15.42:0/1647236916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38580af4f0 msgr2=0x7f3858158330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:40.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.669+0000 7f3857200640 1 --2- 172.21.15.42:0/1647236916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38580af4f0 0x7f3858158330 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f385000e960 tx=0x7f385000ee20 comp rx=0 tx=0).stop 2024-09-17T01:40:40.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.670+0000 7f3857200640 1 -- 172.21.15.42:0/1647236916 shutdown_connections 2024-09-17T01:40:40.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.670+0000 7f3857200640 1 --2- 172.21.15.42:0/1647236916 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3834078b90 0x7f383407b0a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:40.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.670+0000 7f3857200640 1 --2- 172.21.15.42:0/1647236916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38580af4f0 0x7f3858158330 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:40.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.670+0000 7f3857200640 1 --2- 172.21.15.42:0/1647236916 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f38580aebf0 0x7f385815f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:40.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.670+0000 7f3857200640 1 --2- 172.21.15.42:0/1647236916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f385806d260 0x7f38580735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:40.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.670+0000 7f3857200640 1 -- 172.21.15.42:0/1647236916 >> 172.21.15.42:0/1647236916 conn(0x7f38580b25d0 msgr2=0x7f38580ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:40.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.670+0000 7f3857200640 1 -- 172.21.15.42:0/1647236916 shutdown_connections 2024-09-17T01:40:40.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.670+0000 7f3857200640 1 -- 172.21.15.42:0/1647236916 wait complete. 2024-09-17T01:40:40.696 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T01:40:40.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.935+0000 7f62fd800640 1 -- 172.21.15.42:0/4020600792 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62f80af460 msgr2=0x7f62f80ad5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:40.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.935+0000 7f62fd800640 1 --2- 172.21.15.42:0/4020600792 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62f80af460 0x7f62f80ad5c0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f62f806def0 tx=0x7f62f002aac0 comp rx=0 tx=0).stop 2024-09-17T01:40:40.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.935+0000 7f62fd800640 1 -- 172.21.15.42:0/4020600792 shutdown_connections 2024-09-17T01:40:40.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.935+0000 7f62fd800640 1 --2- 172.21.15.42:0/4020600792 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62f80af460 0x7f62f80ad5c0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:40.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.935+0000 7f62fd800640 1 --2- 172.21.15.42:0/4020600792 >> v2:172.21.15.43:3300/0 conn(0x7f62f806d430 0x7f62f80ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:40.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.935+0000 7f62fd800640 1 -- 172.21.15.42:0/4020600792 >> 172.21.15.42:0/4020600792 conn(0x7f62f80b25f0 msgr2=0x7f62f80d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:40.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.935+0000 7f62fd800640 1 -- 172.21.15.42:0/4020600792 shutdown_connections 2024-09-17T01:40:40.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.936+0000 7f62fd800640 1 -- 172.21.15.42:0/4020600792 wait complete. 2024-09-17T01:40:40.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.938+0000 7f62fd800640 1 Processor -- start 2024-09-17T01:40:40.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.938+0000 7f62fd800640 1 -- start start 2024-09-17T01:40:40.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.939+0000 7f62fd800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62f80af460 0x7f62f806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:40.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.939+0000 7f62fd800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62f80d0d80 0x7f62f8159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:40.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.939+0000 7f62fd800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f62f8161080 0x7f62f815be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:40.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.939+0000 7f62fd800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f62f80adb00 con 0x7f62f80d0d80 2024-09-17T01:40:40.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.939+0000 7f62fd800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f62f815ec10 con 0x7f62f80af460 2024-09-17T01:40:40.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.939+0000 7f62fd800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f62f80adc80 con 0x7f62f8161080 2024-09-17T01:40:40.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.939+0000 7f62efe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62f80d0d80 0x7f62f8159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:40.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.940+0000 7f62efe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62f80d0d80 0x7f62f8159410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56056/0 (socket says 172.21.15.42:56056) 2024-09-17T01:40:40.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.940+0000 7f62efe00640 1 -- 172.21.15.42:0/3794776730 learned_addr learned my addr 172.21.15.42:0/3794776730 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:40.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.940+0000 7f62fce00640 1 --2- 172.21.15.42:0/3794776730 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f62f8161080 0x7f62f815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:40.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.940+0000 7f62f7e00640 1 --2- 172.21.15.42:0/3794776730 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62f80af460 0x7f62f806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:40.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.940+0000 7f62efe00640 1 -- 172.21.15.42:0/3794776730 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f62f8161080 msgr2=0x7f62f815be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:40.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.940+0000 7f62efe00640 1 --2- 172.21.15.42:0/3794776730 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f62f8161080 0x7f62f815be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:40.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.940+0000 7f62efe00640 1 -- 172.21.15.42:0/3794776730 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62f80af460 msgr2=0x7f62f806ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:40.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.940+0000 7f62efe00640 1 --2- 172.21.15.42:0/3794776730 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62f80af460 0x7f62f806ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:40.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.940+0000 7f62efe00640 1 -- 172.21.15.42:0/3794776730 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f806f260 con 0x7f62f80d0d80 2024-09-17T01:40:40.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.940+0000 7f62f7e00640 1 --2- 172.21.15.42:0/3794776730 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62f80af460 0x7f62f806ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:40:40.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.940+0000 7f62efe00640 1 --2- 172.21.15.42:0/3794776730 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62f80d0d80 0x7f62f8159410 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f62e000d7a0 tx=0x7f62e000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:40.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.941+0000 7f62f4c00640 1 -- 172.21.15.42:0/3794776730 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e0017070 con 0x7f62f80d0d80 2024-09-17T01:40:40.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.941+0000 7f62f4c00640 1 -- 172.21.15.42:0/3794776730 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62e0009d20 con 0x7f62f80d0d80 2024-09-17T01:40:40.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.941+0000 7f62fd800640 1 -- 172.21.15.42:0/3794776730 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f8159950 con 0x7f62f80d0d80 2024-09-17T01:40:40.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.941+0000 7f62f4c00640 1 -- 172.21.15.42:0/3794776730 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e0004280 con 0x7f62f80d0d80 2024-09-17T01:40:40.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.941+0000 7f62fd800640 1 -- 172.21.15.42:0/3794776730 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f815a140 con 0x7f62f80d0d80 2024-09-17T01:40:40.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.942+0000 7f62fd800640 1 -- 172.21.15.42:0/3794776730 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62f80ad080 con 0x7f62f80d0d80 2024-09-17T01:40:40.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.943+0000 7f62f4c00640 1 -- 172.21.15.42:0/3794776730 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f62e0005020 con 0x7f62f80d0d80 2024-09-17T01:40:40.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.944+0000 7f62f4c00640 1 --2- 172.21.15.42:0/3794776730 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f62d4078b90 0x7f62d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:40.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.944+0000 7f62f4c00640 1 -- 172.21.15.42:0/3794776730 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5227+0+0 (secure 0 0 0) 0x7f62e009b5f0 con 0x7f62f80d0d80 2024-09-17T01:40:40.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.945+0000 7f62f7e00640 1 --2- 172.21.15.42:0/3794776730 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f62d4078b90 0x7f62d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:40.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.946+0000 7f62f7e00640 1 --2- 172.21.15.42:0/3794776730 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f62d4078b90 0x7f62d407b0a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f62e8001660 tx=0x7f62e8009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:40.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:40.948+0000 7f62f4c00640 1 -- 172.21.15.42:0/3794776730 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f62e0020020 con 0x7f62f80d0d80 2024-09-17T01:40:41.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.148+0000 7f62fd800640 1 -- 172.21.15.42:0/3794776730 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f62f8159bf0 con 0x7f62f80d0d80 2024-09-17T01:40:41.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.672+0000 7f62f4c00640 1 -- 172.21.15.42:0/3794776730 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v121) ==== 170+0+0 (secure 0 0 0) 0x7f62e0063bf0 con 0x7f62f80d0d80 2024-09-17T01:40:41.670 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-09-17T01:40:41.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.676+0000 7f62fd800640 1 -- 172.21.15.42:0/3794776730 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f62d4078b90 msgr2=0x7f62d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:41.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.676+0000 7f62fd800640 1 --2- 172.21.15.42:0/3794776730 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f62d4078b90 0x7f62d407b0a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f62e8001660 tx=0x7f62e8009040 comp rx=0 tx=0).stop 2024-09-17T01:40:41.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.676+0000 7f62fd800640 1 -- 172.21.15.42:0/3794776730 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62f80d0d80 msgr2=0x7f62f8159410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:41.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.676+0000 7f62fd800640 1 --2- 172.21.15.42:0/3794776730 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62f80d0d80 0x7f62f8159410 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f62e000d7a0 tx=0x7f62e000dc60 comp rx=0 tx=0).stop 2024-09-17T01:40:41.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.676+0000 7f62fd800640 1 -- 172.21.15.42:0/3794776730 shutdown_connections 2024-09-17T01:40:41.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.676+0000 7f62fd800640 1 --2- 172.21.15.42:0/3794776730 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f62d4078b90 0x7f62d407b0a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:41.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.676+0000 7f62fd800640 1 --2- 172.21.15.42:0/3794776730 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f62f8161080 0x7f62f815be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:41.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.676+0000 7f62fd800640 1 --2- 172.21.15.42:0/3794776730 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62f80d0d80 0x7f62f8159410 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:41.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.676+0000 7f62fd800640 1 --2- 172.21.15.42:0/3794776730 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62f80af460 0x7f62f806ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:41.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.676+0000 7f62fd800640 1 -- 172.21.15.42:0/3794776730 >> 172.21.15.42:0/3794776730 conn(0x7f62f80b25f0 msgr2=0x7f62f815daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:41.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.676+0000 7f62fd800640 1 -- 172.21.15.42:0/3794776730 shutdown_connections 2024-09-17T01:40:41.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.676+0000 7f62fd800640 1 -- 172.21.15.42:0/3794776730 wait complete. 2024-09-17T01:40:41.711 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T01:40:41.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.943+0000 7f286cc00640 1 -- 172.21.15.42:0/2284551768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28680b2260 msgr2=0x7f28681605b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:41.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.943+0000 7f286cc00640 1 --2- 172.21.15.42:0/2284551768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28680b2260 0x7f28681605b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2860005fd0 tx=0x7f286002a840 comp rx=0 tx=0).stop 2024-09-17T01:40:41.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.943+0000 7f286cc00640 1 -- 172.21.15.42:0/2284551768 shutdown_connections 2024-09-17T01:40:41.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.943+0000 7f286cc00640 1 --2- 172.21.15.42:0/2284551768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28680b2260 0x7f28681605b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:41.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.943+0000 7f286cc00640 1 --2- 172.21.15.42:0/2284551768 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28680b0e80 0x7f28680b4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:41.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.944+0000 7f286cc00640 1 -- 172.21.15.42:0/2284551768 >> 172.21.15.42:0/2284551768 conn(0x7f28680b7990 msgr2=0x7f28680b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:41.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.944+0000 7f286cc00640 1 -- 172.21.15.42:0/2284551768 shutdown_connections 2024-09-17T01:40:41.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.944+0000 7f286cc00640 1 -- 172.21.15.42:0/2284551768 wait complete. 2024-09-17T01:40:41.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.946+0000 7f286cc00640 1 Processor -- start 2024-09-17T01:40:41.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.946+0000 7f286cc00640 1 -- start start 2024-09-17T01:40:41.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.948+0000 7f286cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28680b0e80 0x7f286814beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:41.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.948+0000 7f286cc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28680b2260 0x7f286815b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:41.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.948+0000 7f286cc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f286815cb80 0x7f2868154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:41.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.948+0000 7f286cc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2868160c70 con 0x7f28680b0e80 2024-09-17T01:40:41.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.948+0000 7f286cc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2868160af0 con 0x7f28680b2260 2024-09-17T01:40:41.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.948+0000 7f286cc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2868160df0 con 0x7f286815cb80 2024-09-17T01:40:41.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.948+0000 7f2865e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28680b0e80 0x7f286814beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:41.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.948+0000 7f2865e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28680b0e80 0x7f286814beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56062/0 (socket says 172.21.15.42:56062) 2024-09-17T01:40:41.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.948+0000 7f2865e00640 1 -- 172.21.15.42:0/471720896 learned_addr learned my addr 172.21.15.42:0/471720896 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:41.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.948+0000 7f2866800640 1 --2- 172.21.15.42:0/471720896 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f286815cb80 0x7f2868154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:41.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.948+0000 7f285d400640 1 --2- 172.21.15.42:0/471720896 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28680b2260 0x7f286815b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:41.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.949+0000 7f2865e00640 1 -- 172.21.15.42:0/471720896 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f286815cb80 msgr2=0x7f2868154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:41.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.949+0000 7f2865e00640 1 --2- 172.21.15.42:0/471720896 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f286815cb80 0x7f2868154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:41.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.949+0000 7f2865e00640 1 -- 172.21.15.42:0/471720896 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28680b2260 msgr2=0x7f286815b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:41.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.949+0000 7f2865e00640 1 --2- 172.21.15.42:0/471720896 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28680b2260 0x7f286815b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:41.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.949+0000 7f2865e00640 1 -- 172.21.15.42:0/471720896 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286815c2f0 con 0x7f28680b0e80 2024-09-17T01:40:41.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.949+0000 7f2865e00640 1 --2- 172.21.15.42:0/471720896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28680b0e80 0x7f286814beb0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f285800c530 tx=0x7f285800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:41.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.949+0000 7f285ea00640 1 -- 172.21.15.42:0/471720896 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2858016020 con 0x7f28680b0e80 2024-09-17T01:40:41.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.949+0000 7f285ea00640 1 -- 172.21.15.42:0/471720896 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2858012940 con 0x7f28680b0e80 2024-09-17T01:40:41.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.949+0000 7f285ea00640 1 -- 172.21.15.42:0/471720896 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2858012d90 con 0x7f28680b0e80 2024-09-17T01:40:41.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.949+0000 7f286cc00640 1 -- 172.21.15.42:0/471720896 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f286815a200 con 0x7f28680b0e80 2024-09-17T01:40:41.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.950+0000 7f286cc00640 1 -- 172.21.15.42:0/471720896 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f286815a7c0 con 0x7f28680b0e80 2024-09-17T01:40:41.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.951+0000 7f286cc00640 1 -- 172.21.15.42:0/471720896 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2868161380 con 0x7f28680b0e80 2024-09-17T01:40:41.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.952+0000 7f285ea00640 1 -- 172.21.15.42:0/471720896 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2858019020 con 0x7f28680b0e80 2024-09-17T01:40:41.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.953+0000 7f285ea00640 1 --2- 172.21.15.42:0/471720896 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2844078b90 0x7f284407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:41.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.954+0000 7f285ea00640 1 -- 172.21.15.42:0/471720896 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5609+0+0 (secure 0 0 0) 0x7f285809ac80 con 0x7f28680b0e80 2024-09-17T01:40:41.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.954+0000 7f285d400640 1 --2- 172.21.15.42:0/471720896 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2844078b90 0x7f284407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:41.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.955+0000 7f285d400640 1 --2- 172.21.15.42:0/471720896 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2844078b90 0x7f284407b0a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f286815e6c0 tx=0x7f2850005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:41.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:41.959+0000 7f285ea00640 1 -- 172.21.15.42:0/471720896 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2858020020 con 0x7f28680b0e80 2024-09-17T01:40:42.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.190+0000 7f286cc00640 1 -- 172.21.15.42:0/471720896 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2868076550 con 0x7f28680b0e80 2024-09-17T01:40:42.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.674+0000 7f285ea00640 1 -- 172.21.15.42:0/471720896 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v94) ==== 174+0+0 (secure 0 0 0) 0x7f2858062a30 con 0x7f28680b0e80 2024-09-17T01:40:42.673 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 16 and data pool 17 2024-09-17T01:40:42.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.679+0000 7f286cc00640 1 -- 172.21.15.42:0/471720896 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2844078b90 msgr2=0x7f284407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:42.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.679+0000 7f286cc00640 1 --2- 172.21.15.42:0/471720896 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2844078b90 0x7f284407b0a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f286815e6c0 tx=0x7f2850005f90 comp rx=0 tx=0).stop 2024-09-17T01:40:42.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.679+0000 7f286cc00640 1 -- 172.21.15.42:0/471720896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28680b0e80 msgr2=0x7f286814beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:42.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.679+0000 7f286cc00640 1 --2- 172.21.15.42:0/471720896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28680b0e80 0x7f286814beb0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f285800c530 tx=0x7f285800c9f0 comp rx=0 tx=0).stop 2024-09-17T01:40:42.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.680+0000 7f286cc00640 1 -- 172.21.15.42:0/471720896 shutdown_connections 2024-09-17T01:40:42.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.680+0000 7f286cc00640 1 --2- 172.21.15.42:0/471720896 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2844078b90 0x7f284407b0a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:42.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.680+0000 7f286cc00640 1 --2- 172.21.15.42:0/471720896 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28680b2260 0x7f286815b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:42.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.680+0000 7f286cc00640 1 --2- 172.21.15.42:0/471720896 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f286815cb80 0x7f2868154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:42.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.680+0000 7f286cc00640 1 --2- 172.21.15.42:0/471720896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28680b0e80 0x7f286814beb0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:42.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.680+0000 7f286cc00640 1 -- 172.21.15.42:0/471720896 >> 172.21.15.42:0/471720896 conn(0x7f28680b7990 msgr2=0x7f28680b1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:42.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.681+0000 7f286cc00640 1 -- 172.21.15.42:0/471720896 shutdown_connections 2024-09-17T01:40:42.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.681+0000 7f286cc00640 1 -- 172.21.15.42:0/471720896 wait complete. 2024-09-17T01:40:42.728 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:40:42.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.959+0000 7fc4b6e00640 1 -- 172.21.15.42:0/2695719770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4b00b4be0 msgr2=0x7fc4b015d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:42.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.959+0000 7fc4b6e00640 1 --2- 172.21.15.42:0/2695719770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4b00b4be0 0x7fc4b015d6b0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fc4b006deb0 tx=0x7fc4a402a5f0 comp rx=0 tx=0).stop 2024-09-17T01:40:42.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.959+0000 7fc4b6e00640 1 -- 172.21.15.42:0/2695719770 shutdown_connections 2024-09-17T01:40:42.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.959+0000 7fc4b6e00640 1 --2- 172.21.15.42:0/2695719770 >> v2:172.21.15.43:3300/0 conn(0x7fc4b006d430 0x7fc4b0152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:42.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.959+0000 7fc4b6e00640 1 --2- 172.21.15.42:0/2695719770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4b00b4be0 0x7fc4b015d6b0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:42.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.959+0000 7fc4b6e00640 1 -- 172.21.15.42:0/2695719770 >> 172.21.15.42:0/2695719770 conn(0x7fc4b00b25f0 msgr2=0x7fc4b00d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:42.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.959+0000 7fc4b6e00640 1 -- 172.21.15.42:0/2695719770 shutdown_connections 2024-09-17T01:40:42.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.959+0000 7fc4b6e00640 1 -- 172.21.15.42:0/2695719770 wait complete. 2024-09-17T01:40:42.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.961+0000 7fc4b6e00640 1 Processor -- start 2024-09-17T01:40:42.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.961+0000 7fc4b6e00640 1 -- start start 2024-09-17T01:40:42.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.963+0000 7fc4b6e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4b00b4be0 0x7fc4b01f9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:42.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.963+0000 7fc4b6e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc4b00cf7c0 0x7fc4b0147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:42.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.963+0000 7fc4b6e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4b0153cd0 0x7fc4b01458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:42.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.963+0000 7fc4b6e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b01537a0 con 0x7fc4b00b4be0 2024-09-17T01:40:42.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.963+0000 7fc4b6e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b0153620 con 0x7fc4b0153cd0 2024-09-17T01:40:42.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.963+0000 7fc4b6e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b0153920 con 0x7fc4b00cf7c0 2024-09-17T01:40:42.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.963+0000 7fc4b5a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4b00b4be0 0x7fc4b01f9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:42.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.963+0000 7fc4b5a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4b00b4be0 0x7fc4b01f9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56084/0 (socket says 172.21.15.42:56084) 2024-09-17T01:40:42.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.963+0000 7fc4b5a00640 1 -- 172.21.15.42:0/1722964022 learned_addr learned my addr 172.21.15.42:0/1722964022 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:42.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.963+0000 7fc4b5000640 1 --2- 172.21.15.42:0/1722964022 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc4b00cf7c0 0x7fc4b0147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:42.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.964+0000 7fc4b6400640 1 --2- 172.21.15.42:0/1722964022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4b0153cd0 0x7fc4b01458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:42.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.964+0000 7fc4b5a00640 1 -- 172.21.15.42:0/1722964022 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc4b00cf7c0 msgr2=0x7fc4b0147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:42.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.964+0000 7fc4b5a00640 1 --2- 172.21.15.42:0/1722964022 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc4b00cf7c0 0x7fc4b0147cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:42.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.964+0000 7fc4b5a00640 1 -- 172.21.15.42:0/1722964022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4b0153cd0 msgr2=0x7fc4b01458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:42.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.964+0000 7fc4b5a00640 1 --2- 172.21.15.42:0/1722964022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4b0153cd0 0x7fc4b01458b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:42.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.964+0000 7fc4b5a00640 1 -- 172.21.15.42:0/1722964022 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b0148230 con 0x7fc4b00b4be0 2024-09-17T01:40:42.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.964+0000 7fc4b5a00640 1 --2- 172.21.15.42:0/1722964022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4b00b4be0 0x7fc4b01f9940 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40099c0 tx=0x7fc4a40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:42.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.964+0000 7fc4ad600640 1 -- 172.21.15.42:0/1722964022 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a403e030 con 0x7fc4b00b4be0 2024-09-17T01:40:42.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.964+0000 7fc4ad600640 1 -- 172.21.15.42:0/1722964022 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4a40047a0 con 0x7fc4b00b4be0 2024-09-17T01:40:42.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.964+0000 7fc4b6e00640 1 -- 172.21.15.42:0/1722964022 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b01484f0 con 0x7fc4b00b4be0 2024-09-17T01:40:42.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.964+0000 7fc4ad600640 1 -- 172.21.15.42:0/1722964022 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4035040 con 0x7fc4b00b4be0 2024-09-17T01:40:42.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.965+0000 7fc4b6e00640 1 -- 172.21.15.42:0/1722964022 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b01f9140 con 0x7fc4b00b4be0 2024-09-17T01:40:42.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.966+0000 7fc4b6e00640 1 -- 172.21.15.42:0/1722964022 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4b0152ed0 con 0x7fc4b00b4be0 2024-09-17T01:40:42.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.967+0000 7fc4ad600640 1 -- 172.21.15.42:0/1722964022 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc4a4041030 con 0x7fc4b00b4be0 2024-09-17T01:40:42.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.968+0000 7fc4ad600640 1 --2- 172.21.15.42:0/1722964022 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc490078b90 0x7fc49007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:42.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.969+0000 7fc4ad600640 1 -- 172.21.15.42:0/1722964022 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5709+0+0 (secure 0 0 0) 0x7fc4a40bb5d0 con 0x7fc4b00b4be0 2024-09-17T01:40:42.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.969+0000 7fc4b5000640 1 --2- 172.21.15.42:0/1722964022 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc490078b90 0x7fc49007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:42.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.970+0000 7fc4b5000640 1 --2- 172.21.15.42:0/1722964022 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc490078b90 0x7fc49007b0a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc4b00cc470 tx=0x7fc49c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:42.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:42.973+0000 7fc4ad600640 1 -- 172.21.15.42:0/1722964022 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc4a4083970 con 0x7fc4b00b4be0 2024-09-17T01:40:43.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.170+0000 7fc4b6e00640 1 -- 172.21.15.42:0/1722964022 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4b00b4170 con 0x7fc4b00b4be0 2024-09-17T01:40:43.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.171+0000 7fc4ad600640 1 -- 172.21.15.42:0/1722964022 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) ==== 74+0+16708 (secure 0 0 0) 0x7fc4a4083270 con 0x7fc4b00b4be0 2024-09-17T01:40:43.170 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:40:43.170 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":122,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:40:42.191961+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:40:40.145220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T01:40:41.161552+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:40:43.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.174+0000 7fc4b6e00640 1 -- 172.21.15.42:0/1722964022 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc490078b90 msgr2=0x7fc49007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:43.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.174+0000 7fc4b6e00640 1 --2- 172.21.15.42:0/1722964022 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc490078b90 0x7fc49007b0a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc4b00cc470 tx=0x7fc49c009040 comp rx=0 tx=0).stop 2024-09-17T01:40:43.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.174+0000 7fc4b6e00640 1 -- 172.21.15.42:0/1722964022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4b00b4be0 msgr2=0x7fc4b01f9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:43.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.174+0000 7fc4b6e00640 1 --2- 172.21.15.42:0/1722964022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4b00b4be0 0x7fc4b01f9940 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40099c0 tx=0x7fc4a40039e0 comp rx=0 tx=0).stop 2024-09-17T01:40:43.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.174+0000 7fc4b6e00640 1 -- 172.21.15.42:0/1722964022 shutdown_connections 2024-09-17T01:40:43.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.174+0000 7fc4b6e00640 1 --2- 172.21.15.42:0/1722964022 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc490078b90 0x7fc49007b0a0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:43.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.174+0000 7fc4b6e00640 1 --2- 172.21.15.42:0/1722964022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4b0153cd0 0x7fc4b01458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:43.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.174+0000 7fc4b6e00640 1 --2- 172.21.15.42:0/1722964022 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc4b00cf7c0 0x7fc4b0147cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:43.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.174+0000 7fc4b6e00640 1 --2- 172.21.15.42:0/1722964022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4b00b4be0 0x7fc4b01f9940 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:43.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.174+0000 7fc4b6e00640 1 -- 172.21.15.42:0/1722964022 >> 172.21.15.42:0/1722964022 conn(0x7fc4b00b25f0 msgr2=0x7fc4b00d00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:43.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.174+0000 7fc4b6e00640 1 -- 172.21.15.42:0/1722964022 shutdown_connections 2024-09-17T01:40:43.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.174+0000 7fc4b6e00640 1 -- 172.21.15.42:0/1722964022 wait complete. 2024-09-17T01:40:43.194 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:40:43.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.424+0000 7fca25800640 1 -- 172.21.15.42:0/3956206191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca2015d2d0 msgr2=0x7fca20072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:43.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.424+0000 7fca25800640 1 --2- 172.21.15.42:0/3956206191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca2015d2d0 0x7fca20072950 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fca200cce40 tx=0x7fca0802a560 comp rx=0 tx=0).stop 2024-09-17T01:40:43.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.424+0000 7fca25800640 1 -- 172.21.15.42:0/3956206191 shutdown_connections 2024-09-17T01:40:43.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.424+0000 7fca25800640 1 --2- 172.21.15.42:0/3956206191 >> v2:172.21.15.43:3300/0 conn(0x7fca20072e90 0x7fca2006d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:43.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.424+0000 7fca25800640 1 --2- 172.21.15.42:0/3956206191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca2015d2d0 0x7fca20072950 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:43.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.424+0000 7fca25800640 1 -- 172.21.15.42:0/3956206191 >> 172.21.15.42:0/3956206191 conn(0x7fca200b2930 msgr2=0x7fca2006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:43.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.424+0000 7fca25800640 1 -- 172.21.15.42:0/3956206191 shutdown_connections 2024-09-17T01:40:43.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.424+0000 7fca25800640 1 -- 172.21.15.42:0/3956206191 wait complete. 2024-09-17T01:40:43.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.426+0000 7fca25800640 1 Processor -- start 2024-09-17T01:40:43.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.427+0000 7fca25800640 1 -- start start 2024-09-17T01:40:43.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.428+0000 7fca25800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca20072e90 0x7fca2014ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:43.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.428+0000 7fca25800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca2015cec0 0x7fca2015bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:43.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.428+0000 7fca25800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca2015d2d0 0x7fca2015c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:43.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.428+0000 7fca25800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fca20074130 con 0x7fca2015cec0 2024-09-17T01:40:43.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.428+0000 7fca25800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fca20073fb0 con 0x7fca20072e90 2024-09-17T01:40:43.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.428+0000 7fca25800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fca2006d970 con 0x7fca2015d2d0 2024-09-17T01:40:43.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.428+0000 7fca17e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca2015cec0 0x7fca2015bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:43.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.428+0000 7fca17e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca2015cec0 0x7fca2015bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56114/0 (socket says 172.21.15.42:56114) 2024-09-17T01:40:43.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.428+0000 7fca17e00640 1 -- 172.21.15.42:0/2907100590 learned_addr learned my addr 172.21.15.42:0/2907100590 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:43.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.428+0000 7fca1f400640 1 --2- 172.21.15.42:0/2907100590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca2015d2d0 0x7fca2015c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:43.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.428+0000 7fca1ea00640 1 --2- 172.21.15.42:0/2907100590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca20072e90 0x7fca2014ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:43.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.429+0000 7fca17e00640 1 -- 172.21.15.42:0/2907100590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca2015d2d0 msgr2=0x7fca2015c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:43.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.429+0000 7fca17e00640 1 --2- 172.21.15.42:0/2907100590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca2015d2d0 0x7fca2015c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:43.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.429+0000 7fca17e00640 1 -- 172.21.15.42:0/2907100590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca20072e90 msgr2=0x7fca2014ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:43.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.429+0000 7fca17e00640 1 --2- 172.21.15.42:0/2907100590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca20072e90 0x7fca2014ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:43.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.429+0000 7fca17e00640 1 -- 172.21.15.42:0/2907100590 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca20159030 con 0x7fca2015cec0 2024-09-17T01:40:43.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.429+0000 7fca17e00640 1 --2- 172.21.15.42:0/2907100590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca2015cec0 0x7fca2015bbc0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fca08000c00 tx=0x7fca08003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:43.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.429+0000 7fca16a00640 1 -- 172.21.15.42:0/2907100590 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0803e030 con 0x7fca2015cec0 2024-09-17T01:40:43.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.429+0000 7fca16a00640 1 -- 172.21.15.42:0/2907100590 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca08003e00 con 0x7fca2015cec0 2024-09-17T01:40:43.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.429+0000 7fca16a00640 1 -- 172.21.15.42:0/2907100590 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08035040 con 0x7fca2015cec0 2024-09-17T01:40:43.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.430+0000 7fca25800640 1 -- 172.21.15.42:0/2907100590 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca200c8ef0 con 0x7fca2015cec0 2024-09-17T01:40:43.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.430+0000 7fca25800640 1 -- 172.21.15.42:0/2907100590 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca201580c0 con 0x7fca2015cec0 2024-09-17T01:40:43.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.431+0000 7fca25800640 1 -- 172.21.15.42:0/2907100590 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca2006d430 con 0x7fca2015cec0 2024-09-17T01:40:43.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.432+0000 7fca16a00640 1 -- 172.21.15.42:0/2907100590 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fca08041030 con 0x7fca2015cec0 2024-09-17T01:40:43.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.434+0000 7fca16a00640 1 --2- 172.21.15.42:0/2907100590 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc9fc078bc0 0x7fc9fc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:43.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.434+0000 7fca16a00640 1 -- 172.21.15.42:0/2907100590 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5709+0+0 (secure 0 0 0) 0x7fca080bb590 con 0x7fca2015cec0 2024-09-17T01:40:43.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.434+0000 7fca1ea00640 1 --2- 172.21.15.42:0/2907100590 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc9fc078bc0 0x7fc9fc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:43.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.435+0000 7fca1ea00640 1 --2- 172.21.15.42:0/2907100590 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc9fc078bc0 0x7fc9fc07b0d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fca200708a0 tx=0x7fca10009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:43.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.438+0000 7fca16a00640 1 -- 172.21.15.42:0/2907100590 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fca20159030 con 0x7fca2015cec0 2024-09-17T01:40:43.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.634+0000 7fca25800640 1 -- 172.21.15.42:0/2907100590 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca2006a170 con 0x7fca2015cec0 2024-09-17T01:40:43.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.635+0000 7fca16a00640 1 -- 172.21.15.42:0/2907100590 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) ==== 74+0+16708 (secure 0 0 0) 0x7fca08083370 con 0x7fca2015cec0 2024-09-17T01:40:43.633 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:40:43.633 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":122,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:40:42.191961+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:40:40.145220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T01:40:41.161552+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:40:43.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.637+0000 7fca25800640 1 -- 172.21.15.42:0/2907100590 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc9fc078bc0 msgr2=0x7fc9fc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:43.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.637+0000 7fca25800640 1 --2- 172.21.15.42:0/2907100590 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc9fc078bc0 0x7fc9fc07b0d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fca200708a0 tx=0x7fca10009040 comp rx=0 tx=0).stop 2024-09-17T01:40:43.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.637+0000 7fca25800640 1 -- 172.21.15.42:0/2907100590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca2015cec0 msgr2=0x7fca2015bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:43.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.637+0000 7fca25800640 1 --2- 172.21.15.42:0/2907100590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca2015cec0 0x7fca2015bbc0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fca08000c00 tx=0x7fca08003910 comp rx=0 tx=0).stop 2024-09-17T01:40:43.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.637+0000 7fca25800640 1 -- 172.21.15.42:0/2907100590 shutdown_connections 2024-09-17T01:40:43.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.637+0000 7fca25800640 1 --2- 172.21.15.42:0/2907100590 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc9fc078bc0 0x7fc9fc07b0d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:43.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.637+0000 7fca25800640 1 --2- 172.21.15.42:0/2907100590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca2015d2d0 0x7fca2015c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:43.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.637+0000 7fca25800640 1 --2- 172.21.15.42:0/2907100590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca2015cec0 0x7fca2015bbc0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:43.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.637+0000 7fca25800640 1 --2- 172.21.15.42:0/2907100590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca20072e90 0x7fca2014ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:43.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.637+0000 7fca25800640 1 -- 172.21.15.42:0/2907100590 >> 172.21.15.42:0/2907100590 conn(0x7fca200b2930 msgr2=0x7fca2015e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:43.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.637+0000 7fca25800640 1 -- 172.21.15.42:0/2907100590 shutdown_connections 2024-09-17T01:40:43.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.638+0000 7fca25800640 1 -- 172.21.15.42:0/2907100590 wait complete. 2024-09-17T01:40:43.659 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T01:40:43.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.895+0000 7ffbc6800640 1 -- 172.21.15.42:0/2745170184 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffba8004800 msgr2=0x7ffba8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:43.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.895+0000 7ffbc6800640 1 --2- 172.21.15.42:0/2745170184 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffba8004800 0x7ffba8004c10 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7ffbac009b50 tx=0x7ffba8005830 comp rx=0 tx=0).stop 2024-09-17T01:40:43.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.895+0000 7ffbc6800640 1 -- 172.21.15.42:0/2745170184 shutdown_connections 2024-09-17T01:40:43.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.895+0000 7ffbc6800640 1 --2- 172.21.15.42:0/2745170184 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffba8004800 0x7ffba8004c10 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:43.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.895+0000 7ffbc6800640 1 -- 172.21.15.42:0/2745170184 >> 172.21.15.42:0/2745170184 conn(0x7ffbc00b25f0 msgr2=0x7ffbc00d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:43.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.896+0000 7ffbc6800640 1 -- 172.21.15.42:0/2745170184 shutdown_connections 2024-09-17T01:40:43.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.896+0000 7ffbc6800640 1 -- 172.21.15.42:0/2745170184 wait complete. 2024-09-17T01:40:43.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.898+0000 7ffbc6800640 1 Processor -- start 2024-09-17T01:40:43.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.898+0000 7ffbc6800640 1 -- start start 2024-09-17T01:40:43.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.899+0000 7ffbc6800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffba8004800 0x7ffbc01f89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:43.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.899+0000 7ffbc6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbc006f970 0x7ffbc0161540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:43.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.899+0000 7ffbc6800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbc0161a80 0x7ffbc00b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:43.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.899+0000 7ffbc6800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc0163240 con 0x7ffbc006f970 2024-09-17T01:40:43.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.899+0000 7ffbc6800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc015ec10 con 0x7ffba8004800 2024-09-17T01:40:43.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.899+0000 7ffbc6800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ffbc006cd20 con 0x7ffbc0161a80 2024-09-17T01:40:43.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.900+0000 7ffbc4a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbc006f970 0x7ffbc0161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:43.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.900+0000 7ffbc4a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbc006f970 0x7ffbc0161540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56134/0 (socket says 172.21.15.42:56134) 2024-09-17T01:40:43.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.900+0000 7ffbc4a00640 1 -- 172.21.15.42:0/94620326 learned_addr learned my addr 172.21.15.42:0/94620326 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:43.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.900+0000 7ffbc5400640 1 --2- 172.21.15.42:0/94620326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffba8004800 0x7ffbc01f89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:43.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.900+0000 7ffbc5e00640 1 --2- 172.21.15.42:0/94620326 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbc0161a80 0x7ffbc00b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:43.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.900+0000 7ffbc4a00640 1 -- 172.21.15.42:0/94620326 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbc0161a80 msgr2=0x7ffbc00b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:43.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.900+0000 7ffbc4a00640 1 --2- 172.21.15.42:0/94620326 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbc0161a80 0x7ffbc00b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:43.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.900+0000 7ffbc4a00640 1 -- 172.21.15.42:0/94620326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffba8004800 msgr2=0x7ffbc01f89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:43.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.900+0000 7ffbc4a00640 1 --2- 172.21.15.42:0/94620326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffba8004800 0x7ffbc01f89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:43.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.900+0000 7ffbc4a00640 1 -- 172.21.15.42:0/94620326 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc00b11b0 con 0x7ffbc006f970 2024-09-17T01:40:43.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.900+0000 7ffbc5e00640 1 --2- 172.21.15.42:0/94620326 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbc0161a80 0x7ffbc00b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:40:43.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.900+0000 7ffbc4a00640 1 --2- 172.21.15.42:0/94620326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbc006f970 0x7ffbc0161540 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7ffbac009a70 tx=0x7ffbac0336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:43.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.901+0000 7ffbbd600640 1 -- 172.21.15.42:0/94620326 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac038040 con 0x7ffbc006f970 2024-09-17T01:40:43.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.901+0000 7ffbbd600640 1 -- 172.21.15.42:0/94620326 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffbac041070 con 0x7ffbc006f970 2024-09-17T01:40:43.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.901+0000 7ffbc6800640 1 -- 172.21.15.42:0/94620326 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc00b1490 con 0x7ffbc006f970 2024-09-17T01:40:43.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.901+0000 7ffbbd600640 1 -- 172.21.15.42:0/94620326 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac03c430 con 0x7ffbc006f970 2024-09-17T01:40:43.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.901+0000 7ffbc6800640 1 -- 172.21.15.42:0/94620326 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc00b1a50 con 0x7ffbc006f970 2024-09-17T01:40:43.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.902+0000 7ffbc6800640 1 -- 172.21.15.42:0/94620326 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbc006d1b0 con 0x7ffbc006f970 2024-09-17T01:40:43.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.903+0000 7ffbbd600640 1 -- 172.21.15.42:0/94620326 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffbac03c5d0 con 0x7ffbc006f970 2024-09-17T01:40:43.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.904+0000 7ffbbd600640 1 --2- 172.21.15.42:0/94620326 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ffba0078b90 0x7ffba007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:43.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.904+0000 7ffbbd600640 1 -- 172.21.15.42:0/94620326 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7ffbac0bb8d0 con 0x7ffbc006f970 2024-09-17T01:40:43.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.905+0000 7ffbc5400640 1 --2- 172.21.15.42:0/94620326 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ffba0078b90 0x7ffba007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:43.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.905+0000 7ffbc5400640 1 --2- 172.21.15.42:0/94620326 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ffba0078b90 0x7ffba007b0a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4000c00 tx=0x7ffbb4006b10 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:43.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:43.909+0000 7ffbbd600640 1 -- 172.21.15.42:0/94620326 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffbac083c70 con 0x7ffbc006f970 2024-09-17T01:40:44.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.142+0000 7ffbc6800640 1 -- 172.21.15.42:0/94620326 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ffbc00afdd0 con 0x7ffbc006f970 2024-09-17T01:40:44.658 INFO:tasks.ceph.mds.c.smithi042.stderr:2024-09-17T01:40:44.660+0000 7f26fe600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:40:44.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.700+0000 7ffbbd600640 1 -- 172.21.15.42:0/94620326 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v97) ==== 118+0+0 (secure 0 0 0) 0x7ffbac083570 con 0x7ffbc006f970 2024-09-17T01:40:44.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.703+0000 7ffbc6800640 1 -- 172.21.15.42:0/94620326 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ffba0078b90 msgr2=0x7ffba007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:44.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.703+0000 7ffbc6800640 1 --2- 172.21.15.42:0/94620326 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ffba0078b90 0x7ffba007b0a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4000c00 tx=0x7ffbb4006b10 comp rx=0 tx=0).stop 2024-09-17T01:40:44.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.703+0000 7ffbc6800640 1 -- 172.21.15.42:0/94620326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbc006f970 msgr2=0x7ffbc0161540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:44.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.703+0000 7ffbc6800640 1 --2- 172.21.15.42:0/94620326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbc006f970 0x7ffbc0161540 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7ffbac009a70 tx=0x7ffbac0336f0 comp rx=0 tx=0).stop 2024-09-17T01:40:44.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.703+0000 7ffbc6800640 1 -- 172.21.15.42:0/94620326 shutdown_connections 2024-09-17T01:40:44.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.703+0000 7ffbc6800640 1 --2- 172.21.15.42:0/94620326 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ffba0078b90 0x7ffba007b0a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:44.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.703+0000 7ffbc6800640 1 --2- 172.21.15.42:0/94620326 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbc0161a80 0x7ffbc00b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:44.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.703+0000 7ffbc6800640 1 --2- 172.21.15.42:0/94620326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbc006f970 0x7ffbc0161540 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:44.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.703+0000 7ffbc6800640 1 --2- 172.21.15.42:0/94620326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffba8004800 0x7ffbc01f89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:44.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.703+0000 7ffbc6800640 1 -- 172.21.15.42:0/94620326 >> 172.21.15.42:0/94620326 conn(0x7ffbc00b25f0 msgr2=0x7ffbc0153b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:44.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.703+0000 7ffbc6800640 1 -- 172.21.15.42:0/94620326 shutdown_connections 2024-09-17T01:40:44.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.703+0000 7ffbc6800640 1 -- 172.21.15.42:0/94620326 wait complete. 2024-09-17T01:40:44.725 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T01:40:44.725 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T01:40:44.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.958+0000 7f1554000640 1 -- 172.21.15.42:0/3155938701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f154c06f400 msgr2=0x7f154c06d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:44.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.958+0000 7f1554000640 1 --2- 172.21.15.42:0/3155938701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f154c06f400 0x7f154c06d430 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f154c0afba0 tx=0x7f154402aa30 comp rx=0 tx=0).stop 2024-09-17T01:40:44.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.958+0000 7f1554000640 1 -- 172.21.15.42:0/3155938701 shutdown_connections 2024-09-17T01:40:44.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.958+0000 7f1554000640 1 --2- 172.21.15.42:0/3155938701 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f154c06f400 0x7f154c06d430 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:44.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.958+0000 7f1554000640 1 --2- 172.21.15.42:0/3155938701 >> v2:172.21.15.43:3300/0 conn(0x7f154c074500 0x7f154c06eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:44.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.958+0000 7f1554000640 1 -- 172.21.15.42:0/3155938701 >> 172.21.15.42:0/3155938701 conn(0x7f154c0b2930 msgr2=0x7f154c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:44.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.958+0000 7f1554000640 1 -- 172.21.15.42:0/3155938701 shutdown_connections 2024-09-17T01:40:44.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.958+0000 7f1554000640 1 -- 172.21.15.42:0/3155938701 wait complete. 2024-09-17T01:40:44.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.961+0000 7f1554000640 1 Processor -- start 2024-09-17T01:40:44.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.961+0000 7f1554000640 1 -- start start 2024-09-17T01:40:44.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.962+0000 7f1554000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f154c06f400 0x7f154c0b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:44.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.962+0000 7f1554000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f154c0740f0 0x7f154c0b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:44.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.962+0000 7f1554000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f154c0b1830 0x7f154c0b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:44.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.962+0000 7f1554000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f154c0cef40 con 0x7f154c0740f0 2024-09-17T01:40:44.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.962+0000 7f1554000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f154c06dd20 con 0x7f154c06f400 2024-09-17T01:40:44.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.962+0000 7f1554000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f154c0cf0c0 con 0x7f154c0b1830 2024-09-17T01:40:44.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.962+0000 7f1550c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f154c0740f0 0x7f154c0b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:44.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.962+0000 7f1550c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f154c0740f0 0x7f154c0b0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56152/0 (socket says 172.21.15.42:56152) 2024-09-17T01:40:44.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.962+0000 7f1550c00640 1 -- 172.21.15.42:0/3618984741 learned_addr learned my addr 172.21.15.42:0/3618984741 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:44.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.963+0000 7f1550c00640 1 -- 172.21.15.42:0/3618984741 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f154c0b1830 msgr2=0x7f154c0b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:44.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.963+0000 7f1550c00640 1 --2- 172.21.15.42:0/3618984741 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f154c0b1830 0x7f154c0b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:44.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.963+0000 7f1550c00640 1 -- 172.21.15.42:0/3618984741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f154c06f400 msgr2=0x7f154c0b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:44.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.963+0000 7f1551600640 1 --2- 172.21.15.42:0/3618984741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f154c06f400 0x7f154c0b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:44.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.963+0000 7f1550c00640 1 --2- 172.21.15.42:0/3618984741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f154c06f400 0x7f154c0b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:44.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.963+0000 7f1550c00640 1 -- 172.21.15.42:0/3618984741 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f154c1f9190 con 0x7f154c0740f0 2024-09-17T01:40:44.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.963+0000 7f1551600640 1 --2- 172.21.15.42:0/3618984741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f154c06f400 0x7f154c0b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:40:44.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.963+0000 7f1550c00640 1 --2- 172.21.15.42:0/3618984741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f154c0740f0 0x7f154c0b0030 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f153800d780 tx=0x7f153800dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:44.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.963+0000 7f1549600640 1 -- 172.21.15.42:0/3618984741 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1538017070 con 0x7f154c0740f0 2024-09-17T01:40:44.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.964+0000 7f1549600640 1 -- 172.21.15.42:0/3618984741 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f153800de90 con 0x7f154c0740f0 2024-09-17T01:40:44.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.964+0000 7f1554000640 1 -- 172.21.15.42:0/3618984741 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f154c1f9470 con 0x7f154c0740f0 2024-09-17T01:40:44.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.964+0000 7f1549600640 1 -- 172.21.15.42:0/3618984741 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15380099d0 con 0x7f154c0740f0 2024-09-17T01:40:44.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.964+0000 7f1554000640 1 -- 172.21.15.42:0/3618984741 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f154c1f9a30 con 0x7f154c0740f0 2024-09-17T01:40:44.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.965+0000 7f1554000640 1 -- 172.21.15.42:0/3618984741 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f154c074500 con 0x7f154c0740f0 2024-09-17T01:40:44.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.966+0000 7f1549600640 1 -- 172.21.15.42:0/3618984741 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1538009b70 con 0x7f154c0740f0 2024-09-17T01:40:44.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.967+0000 7f1549600640 1 --2- 172.21.15.42:0/3618984741 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f152c078b90 0x7f152c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:44.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.967+0000 7f1549600640 1 -- 172.21.15.42:0/3618984741 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f153809b1b0 con 0x7f154c0740f0 2024-09-17T01:40:44.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.967+0000 7f1551600640 1 --2- 172.21.15.42:0/3618984741 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f152c078b90 0x7f152c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:44.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.968+0000 7f1551600640 1 --2- 172.21.15.42:0/3618984741 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f152c078b90 0x7f152c07b0a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1540000f60 tx=0x7f1540009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:44.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:44.971+0000 7f1549600640 1 -- 172.21.15.42:0/3618984741 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1538020020 con 0x7f154c0740f0 2024-09-17T01:40:45.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.202+0000 7f1554000640 1 -- 172.21.15.42:0/3618984741 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f154c06a170 con 0x7f154c0740f0 2024-09-17T01:40:45.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.706+0000 7f1549600640 1 -- 172.21.15.42:0/3618984741 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v98) ==== 122+0+0 (secure 0 0 0) 0x7f15380635e0 con 0x7f154c0740f0 2024-09-17T01:40:45.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.709+0000 7f1554000640 1 -- 172.21.15.42:0/3618984741 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f152c078b90 msgr2=0x7f152c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:45.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.709+0000 7f1554000640 1 --2- 172.21.15.42:0/3618984741 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f152c078b90 0x7f152c07b0a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1540000f60 tx=0x7f1540009040 comp rx=0 tx=0).stop 2024-09-17T01:40:45.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.709+0000 7f1554000640 1 -- 172.21.15.42:0/3618984741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f154c0740f0 msgr2=0x7f154c0b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:45.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.709+0000 7f1554000640 1 --2- 172.21.15.42:0/3618984741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f154c0740f0 0x7f154c0b0030 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f153800d780 tx=0x7f153800dc40 comp rx=0 tx=0).stop 2024-09-17T01:40:45.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.709+0000 7f1554000640 1 -- 172.21.15.42:0/3618984741 shutdown_connections 2024-09-17T01:40:45.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.709+0000 7f1554000640 1 --2- 172.21.15.42:0/3618984741 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f152c078b90 0x7f152c07b0a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:45.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.709+0000 7f1554000640 1 --2- 172.21.15.42:0/3618984741 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f154c0b1830 0x7f154c0b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:45.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.709+0000 7f1554000640 1 --2- 172.21.15.42:0/3618984741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f154c0740f0 0x7f154c0b0030 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:45.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.709+0000 7f1554000640 1 --2- 172.21.15.42:0/3618984741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f154c06f400 0x7f154c0b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:45.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.709+0000 7f1554000640 1 -- 172.21.15.42:0/3618984741 >> 172.21.15.42:0/3618984741 conn(0x7f154c0b2930 msgr2=0x7f154c14ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:45.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.709+0000 7f1554000640 1 -- 172.21.15.42:0/3618984741 shutdown_connections 2024-09-17T01:40:45.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.709+0000 7f1554000640 1 -- 172.21.15.42:0/3618984741 wait complete. 2024-09-17T01:40:45.731 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T01:40:45.732 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:40:45.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.963+0000 7f5e73600640 1 -- 172.21.15.42:0/2652154818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e54005280 msgr2=0x7f5e5400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:45.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.963+0000 7f5e73600640 1 --2- 172.21.15.42:0/2652154818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e54005280 0x7f5e5400b9c0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f5e64009ed0 tx=0x7f5e54005830 comp rx=0 tx=0).stop 2024-09-17T01:40:45.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.963+0000 7f5e73600640 1 -- 172.21.15.42:0/2652154818 shutdown_connections 2024-09-17T01:40:45.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.963+0000 7f5e73600640 1 --2- 172.21.15.42:0/2652154818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e54005280 0x7f5e5400b9c0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:45.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.963+0000 7f5e73600640 1 -- 172.21.15.42:0/2652154818 >> 172.21.15.42:0/2652154818 conn(0x7f5e6c0b2930 msgr2=0x7f5e6c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:45.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.963+0000 7f5e73600640 1 -- 172.21.15.42:0/2652154818 shutdown_connections 2024-09-17T01:40:45.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.963+0000 7f5e73600640 1 -- 172.21.15.42:0/2652154818 wait complete. 2024-09-17T01:40:45.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.965+0000 7f5e73600640 1 Processor -- start 2024-09-17T01:40:45.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.966+0000 7f5e73600640 1 -- start start 2024-09-17T01:40:45.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.967+0000 7f5e73600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e54005280 0x7f5e6c1f2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:45.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.967+0000 7f5e73600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e6c0aa490 0x7f5e6c1f58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:45.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.967+0000 7f5e73600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5e6c150b50 0x7f5e6c1f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:45.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.967+0000 7f5e73600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6c152890 con 0x7f5e54005280 2024-09-17T01:40:45.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.967+0000 7f5e73600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6c152710 con 0x7f5e6c0aa490 2024-09-17T01:40:45.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.967+0000 7f5e73600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5e6c152a10 con 0x7f5e6c150b50 2024-09-17T01:40:45.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.967+0000 7f5e70c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e54005280 0x7f5e6c1f2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:45.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.967+0000 7f5e70c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e54005280 0x7f5e6c1f2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59786/0 (socket says 172.21.15.42:59786) 2024-09-17T01:40:45.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.967+0000 7f5e70c00640 1 -- 172.21.15.42:0/2550190955 learned_addr learned my addr 172.21.15.42:0/2550190955 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:45.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.968+0000 7f5e6be00640 1 --2- 172.21.15.42:0/2550190955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e6c0aa490 0x7f5e6c1f58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:45.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.968+0000 7f5e71600640 1 --2- 172.21.15.42:0/2550190955 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5e6c150b50 0x7f5e6c1f29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.968+0000 7f5e70c00640 1 -- 172.21.15.42:0/2550190955 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5e6c150b50 msgr2=0x7f5e6c1f29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.968+0000 7f5e70c00640 1 --2- 172.21.15.42:0/2550190955 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5e6c150b50 0x7f5e6c1f29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.968+0000 7f5e70c00640 1 -- 172.21.15.42:0/2550190955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e6c0aa490 msgr2=0x7f5e6c1f58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.968+0000 7f5e70c00640 1 --2- 172.21.15.42:0/2550190955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e6c0aa490 0x7f5e6c1f58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.968+0000 7f5e70c00640 1 -- 172.21.15.42:0/2550190955 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e6c0aaca0 con 0x7f5e54005280 2024-09-17T01:40:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.968+0000 7f5e70c00640 1 --2- 172.21.15.42:0/2550190955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e54005280 0x7f5e6c1f2400 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f5e6000e630 tx=0x7f5e6000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.968+0000 7f5e68c00640 1 -- 172.21.15.42:0/2550190955 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e60015070 con 0x7f5e54005280 2024-09-17T01:40:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.969+0000 7f5e68c00640 1 -- 172.21.15.42:0/2550190955 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e60004310 con 0x7f5e54005280 2024-09-17T01:40:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.969+0000 7f5e73600640 1 -- 172.21.15.42:0/2550190955 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e6c1f1940 con 0x7f5e54005280 2024-09-17T01:40:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.969+0000 7f5e68c00640 1 -- 172.21.15.42:0/2550190955 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6000ca00 con 0x7f5e54005280 2024-09-17T01:40:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.969+0000 7f5e73600640 1 -- 172.21.15.42:0/2550190955 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e6c1f1f00 con 0x7f5e54005280 2024-09-17T01:40:45.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.970+0000 7f5e73600640 1 -- 172.21.15.42:0/2550190955 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e6c15f890 con 0x7f5e54005280 2024-09-17T01:40:45.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.971+0000 7f5e68c00640 1 -- 172.21.15.42:0/2550190955 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5e6000cba0 con 0x7f5e54005280 2024-09-17T01:40:45.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.972+0000 7f5e68c00640 1 --2- 172.21.15.42:0/2550190955 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5e4c078bc0 0x7f5e4c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:45.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.973+0000 7f5e68c00640 1 -- 172.21.15.42:0/2550190955 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f5e6009b100 con 0x7f5e54005280 2024-09-17T01:40:45.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.973+0000 7f5e6be00640 1 --2- 172.21.15.42:0/2550190955 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5e4c078bc0 0x7f5e4c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:45.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.974+0000 7f5e6be00640 1 --2- 172.21.15.42:0/2550190955 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5e4c078bc0 0x7f5e4c07b0d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5e58006da0 tx=0x7f5e58006230 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:45.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:45.977+0000 7f5e68c00640 1 -- 172.21.15.42:0/2550190955 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5e6c15be20 con 0x7f5e54005280 2024-09-17T01:40:46.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.207+0000 7f5e73600640 1 -- 172.21.15.42:0/2550190955 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e6c06a170 con 0x7f5e54005280 2024-09-17T01:40:46.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.208+0000 7f5e68c00640 1 -- 172.21.15.42:0/2550190955 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5222 (secure 0 0 0) 0x7f5e60063030 con 0x7f5e54005280 2024-09-17T01:40:46.208 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:40:46.208 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":98,"btime":"2024-09-17T01:40:45:701152+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6884,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2926480981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2926480981},{"type":"v1","addr":"172.21.15.43:6837","nonce":2926480981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7576,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1365229483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1365229483},{"type":"v1","addr":"172.21.15.43:6836","nonce":1365229483}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92},{"gid":8058,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1442154751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1442154751},{"type":"v1","addr":"172.21.15.42:6833","nonce":1442154751}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:40:42.191921+0000","modified":"2024-09-17T01:40:45.203701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8061},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8061":{"gid":8061,"name":"c","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/970028636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":970028636},{"type":"v1","addr":"172.21.15.42:6835","nonce":970028636}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8061,"qdb_cluster":[8061]},"id":8}]} 2024-09-17T01:40:46.209 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 98 2024-09-17T01:40:46.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.210+0000 7f5e73600640 1 -- 172.21.15.42:0/2550190955 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5e4c078bc0 msgr2=0x7f5e4c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:46.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.210+0000 7f5e73600640 1 --2- 172.21.15.42:0/2550190955 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5e4c078bc0 0x7f5e4c07b0d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5e58006da0 tx=0x7f5e58006230 comp rx=0 tx=0).stop 2024-09-17T01:40:46.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.210+0000 7f5e73600640 1 -- 172.21.15.42:0/2550190955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e54005280 msgr2=0x7f5e6c1f2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:46.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.210+0000 7f5e73600640 1 --2- 172.21.15.42:0/2550190955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e54005280 0x7f5e6c1f2400 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f5e6000e630 tx=0x7f5e6000eaf0 comp rx=0 tx=0).stop 2024-09-17T01:40:46.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.210+0000 7f5e73600640 1 -- 172.21.15.42:0/2550190955 shutdown_connections 2024-09-17T01:40:46.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.210+0000 7f5e73600640 1 --2- 172.21.15.42:0/2550190955 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5e4c078bc0 0x7f5e4c07b0d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:46.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.210+0000 7f5e73600640 1 --2- 172.21.15.42:0/2550190955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e6c0aa490 0x7f5e6c1f58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:46.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.210+0000 7f5e73600640 1 --2- 172.21.15.42:0/2550190955 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5e6c150b50 0x7f5e6c1f29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:46.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.210+0000 7f5e73600640 1 --2- 172.21.15.42:0/2550190955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e54005280 0x7f5e6c1f2400 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:46.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.210+0000 7f5e73600640 1 -- 172.21.15.42:0/2550190955 >> 172.21.15.42:0/2550190955 conn(0x7f5e6c0b2930 msgr2=0x7f5e6c072be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:46.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.210+0000 7f5e73600640 1 -- 172.21.15.42:0/2550190955 shutdown_connections 2024-09-17T01:40:46.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.210+0000 7f5e73600640 1 -- 172.21.15.42:0/2550190955 wait complete. 2024-09-17T01:40:46.230 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:40:46.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.460+0000 7f78b7200640 1 -- 172.21.15.42:0/444068244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78b00af980 msgr2=0x7f78b00ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:46.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.460+0000 7f78b7200640 1 --2- 172.21.15.42:0/444068244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78b00af980 0x7f78b00ceb40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7898009830 tx=0x7f789802a510 comp rx=0 tx=0).stop 2024-09-17T01:40:46.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.461+0000 7f78b7200640 1 -- 172.21.15.42:0/444068244 shutdown_connections 2024-09-17T01:40:46.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.461+0000 7f78b7200640 1 --2- 172.21.15.42:0/444068244 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f78b006d430 0x7f78b006d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:46.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.461+0000 7f78b7200640 1 --2- 172.21.15.42:0/444068244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78b00af980 0x7f78b00ceb40 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:46.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.461+0000 7f78b7200640 1 -- 172.21.15.42:0/444068244 >> 172.21.15.42:0/444068244 conn(0x7f78b00b2930 msgr2=0x7f78b006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:46.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.461+0000 7f78b7200640 1 -- 172.21.15.42:0/444068244 shutdown_connections 2024-09-17T01:40:46.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.461+0000 7f78b7200640 1 -- 172.21.15.42:0/444068244 wait complete. 2024-09-17T01:40:46.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.463+0000 7f78b7200640 1 Processor -- start 2024-09-17T01:40:46.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.463+0000 7f78b7200640 1 -- start start 2024-09-17T01:40:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.465+0000 7f78b7200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78b006d430 0x7f78b014fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.465+0000 7f78b7200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f78b00af980 0x7f78b0151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.465+0000 7f78b7200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78b00b3880 0x7f78b006f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.465+0000 7f78b7200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f78b0072ad0 con 0x7f78b00b3880 2024-09-17T01:40:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.465+0000 7f78b7200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f78b0072950 con 0x7f78b006d430 2024-09-17T01:40:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.465+0000 7f78b7200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f78b0072c50 con 0x7f78b00af980 2024-09-17T01:40:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.465+0000 7f78b5200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78b00b3880 0x7f78b006f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.465+0000 7f78b5200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78b00b3880 0x7f78b006f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59794/0 (socket says 172.21.15.42:59794) 2024-09-17T01:40:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.465+0000 7f78b5200640 1 -- 172.21.15.42:0/1779399177 learned_addr learned my addr 172.21.15.42:0/1779399177 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:46.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.465+0000 7f78afe00640 1 --2- 172.21.15.42:0/1779399177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78b006d430 0x7f78b014fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:46.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.465+0000 7f78a7400640 1 --2- 172.21.15.42:0/1779399177 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f78b00af980 0x7f78b0151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:46.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.465+0000 7f78b5200640 1 -- 172.21.15.42:0/1779399177 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f78b00af980 msgr2=0x7f78b0151df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:46.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.465+0000 7f78b5200640 1 --2- 172.21.15.42:0/1779399177 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f78b00af980 0x7f78b0151df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:46.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.465+0000 7f78b5200640 1 -- 172.21.15.42:0/1779399177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78b006d430 msgr2=0x7f78b014fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:46.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.465+0000 7f78b5200640 1 --2- 172.21.15.42:0/1779399177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78b006d430 0x7f78b014fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:46.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.465+0000 7f78b5200640 1 -- 172.21.15.42:0/1779399177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b0157300 con 0x7f78b00b3880 2024-09-17T01:40:46.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.466+0000 7f78b5200640 1 --2- 172.21.15.42:0/1779399177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78b00b3880 0x7f78b006f210 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f78a800ea40 tx=0x7f78a800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:46.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.466+0000 7f78acc00640 1 -- 172.21.15.42:0/1779399177 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a800ce40 con 0x7f78b00b3880 2024-09-17T01:40:46.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.466+0000 7f78acc00640 1 -- 172.21.15.42:0/1779399177 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78a8004c10 con 0x7f78b00b3880 2024-09-17T01:40:46.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.466+0000 7f78b7200640 1 -- 172.21.15.42:0/1779399177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b0152960 con 0x7f78b00b3880 2024-09-17T01:40:46.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.466+0000 7f78acc00640 1 -- 172.21.15.42:0/1779399177 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a8005020 con 0x7f78b00b3880 2024-09-17T01:40:46.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.466+0000 7f78b7200640 1 -- 172.21.15.42:0/1779399177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b01f9af0 con 0x7f78b00b3880 2024-09-17T01:40:46.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.467+0000 7f78b7200640 1 -- 172.21.15.42:0/1779399177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78b01526d0 con 0x7f78b00b3880 2024-09-17T01:40:46.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.468+0000 7f78acc00640 1 -- 172.21.15.42:0/1779399177 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f78a80051c0 con 0x7f78b00b3880 2024-09-17T01:40:46.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.469+0000 7f78acc00640 1 --2- 172.21.15.42:0/1779399177 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f788c078bc0 0x7f788c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:46.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.470+0000 7f78acc00640 1 -- 172.21.15.42:0/1779399177 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f78a809bc20 con 0x7f78b00b3880 2024-09-17T01:40:46.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.470+0000 7f78afe00640 1 --2- 172.21.15.42:0/1779399177 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f788c078bc0 0x7f788c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:46.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.471+0000 7f78afe00640 1 --2- 172.21.15.42:0/1779399177 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f788c078bc0 0x7f788c07b0d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f78b00cfb10 tx=0x7f78a0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:46.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.474+0000 7f78acc00640 1 -- 172.21.15.42:0/1779399177 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f78a8063fc0 con 0x7f78b00b3880 2024-09-17T01:40:46.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.667+0000 7f78b7200640 1 -- 172.21.15.42:0/1779399177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78b006d840 con 0x7f78b00b3880 2024-09-17T01:40:46.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.668+0000 7f78acc00640 1 -- 172.21.15.42:0/1779399177 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) ==== 74+0+16695 (secure 0 0 0) 0x7f78a80638c0 con 0x7f78b00b3880 2024-09-17T01:40:46.666 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:40:46.667 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":123,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:40:43.686140+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:40:40.145220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T01:40:41.161552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:40:46.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.670+0000 7f78b7200640 1 -- 172.21.15.42:0/1779399177 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f788c078bc0 msgr2=0x7f788c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:46.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.670+0000 7f78b7200640 1 --2- 172.21.15.42:0/1779399177 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f788c078bc0 0x7f788c07b0d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f78b00cfb10 tx=0x7f78a0009040 comp rx=0 tx=0).stop 2024-09-17T01:40:46.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.670+0000 7f78b7200640 1 -- 172.21.15.42:0/1779399177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78b00b3880 msgr2=0x7f78b006f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:46.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.671+0000 7f78b7200640 1 --2- 172.21.15.42:0/1779399177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78b00b3880 0x7f78b006f210 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f78a800ea40 tx=0x7f78a800ef00 comp rx=0 tx=0).stop 2024-09-17T01:40:46.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.671+0000 7f78b7200640 1 -- 172.21.15.42:0/1779399177 shutdown_connections 2024-09-17T01:40:46.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.671+0000 7f78b7200640 1 --2- 172.21.15.42:0/1779399177 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f788c078bc0 0x7f788c07b0d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:46.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.671+0000 7f78b7200640 1 --2- 172.21.15.42:0/1779399177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78b00b3880 0x7f78b006f210 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:46.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.671+0000 7f78b7200640 1 --2- 172.21.15.42:0/1779399177 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f78b00af980 0x7f78b0151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:46.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.671+0000 7f78b7200640 1 --2- 172.21.15.42:0/1779399177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78b006d430 0x7f78b014fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:46.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.671+0000 7f78b7200640 1 -- 172.21.15.42:0/1779399177 >> 172.21.15.42:0/1779399177 conn(0x7f78b00b2930 msgr2=0x7f78b015cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:46.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.671+0000 7f78b7200640 1 -- 172.21.15.42:0/1779399177 shutdown_connections 2024-09-17T01:40:46.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.671+0000 7f78b7200640 1 -- 172.21.15.42:0/1779399177 wait complete. 2024-09-17T01:40:46.690 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T01:40:46.690 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:40:46.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.922+0000 7f2020800640 1 -- 172.21.15.42:0/1707057650 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2000005270 msgr2=0x7f200000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:46.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.922+0000 7f2020800640 1 --2- 172.21.15.42:0/1707057650 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2000005270 0x7f200000b9c0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f20180b4900 tx=0x7f2000005830 comp rx=0 tx=0).stop 2024-09-17T01:40:46.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.922+0000 7f201e800640 1 -- 172.21.15.42:0/1707057650 reap_dead start 2024-09-17T01:40:46.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.922+0000 7f2020800640 1 -- 172.21.15.42:0/1707057650 shutdown_connections 2024-09-17T01:40:46.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.922+0000 7f2020800640 1 -- 172.21.15.42:0/1707057650 >> 172.21.15.42:0/1707057650 conn(0x7f20180b2930 msgr2=0x7f201806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:46.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.922+0000 7f2020800640 1 -- 172.21.15.42:0/1707057650 shutdown_connections 2024-09-17T01:40:46.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.922+0000 7f2020800640 1 -- 172.21.15.42:0/1707057650 wait complete. 2024-09-17T01:40:46.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.924+0000 7f2020800640 1 Processor -- start 2024-09-17T01:40:46.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.924+0000 7f2020800640 1 -- start start 2024-09-17T01:40:46.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.925+0000 7f2020800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2000005270 0x7f20181f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:46.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.926+0000 7f2020800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2018154160 0x7f20180ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:46.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.926+0000 7f2020800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f20180aea80 0x7f201814a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:46.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.926+0000 7f2020800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f20180b3760 con 0x7f2000005270 2024-09-17T01:40:46.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.926+0000 7f2020800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f20180b35e0 con 0x7f2018154160 2024-09-17T01:40:46.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.926+0000 7f2020800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2018073fb0 con 0x7f20180aea80 2024-09-17T01:40:46.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.926+0000 7f201de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2000005270 0x7f20181f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:46.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.926+0000 7f201de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2000005270 0x7f20181f7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59798/0 (socket says 172.21.15.42:59798) 2024-09-17T01:40:46.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.926+0000 7f201de00640 1 -- 172.21.15.42:0/2410626890 learned_addr learned my addr 172.21.15.42:0/2410626890 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:46.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.926+0000 7f201e800640 1 --2- 172.21.15.42:0/2410626890 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f20180aea80 0x7f201814a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:46.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.926+0000 7f201d400640 1 --2- 172.21.15.42:0/2410626890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2018154160 0x7f20180ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:46.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.926+0000 7f201de00640 1 -- 172.21.15.42:0/2410626890 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f20180aea80 msgr2=0x7f201814a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:46.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.926+0000 7f201de00640 1 --2- 172.21.15.42:0/2410626890 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f20180aea80 0x7f201814a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:46.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.926+0000 7f201de00640 1 -- 172.21.15.42:0/2410626890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2018154160 msgr2=0x7f20180ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:46.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.926+0000 7f201de00640 1 --2- 172.21.15.42:0/2410626890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2018154160 0x7f20180ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:46.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.926+0000 7f201de00640 1 -- 172.21.15.42:0/2410626890 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20180aee90 con 0x7f2000005270 2024-09-17T01:40:46.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.927+0000 7f201de00640 1 --2- 172.21.15.42:0/2410626890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2000005270 0x7f20181f7ca0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f200c001e30 tx=0x7f200c003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:46.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.927+0000 7f2012000640 1 -- 172.21.15.42:0/2410626890 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c015070 con 0x7f2000005270 2024-09-17T01:40:46.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.927+0000 7f2012000640 1 -- 172.21.15.42:0/2410626890 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f200c00f960 con 0x7f2000005270 2024-09-17T01:40:46.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.927+0000 7f2012000640 1 -- 172.21.15.42:0/2410626890 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c00fd70 con 0x7f2000005270 2024-09-17T01:40:46.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.927+0000 7f2020800640 1 -- 172.21.15.42:0/2410626890 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2018157500 con 0x7f2000005270 2024-09-17T01:40:46.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.927+0000 7f2020800640 1 -- 172.21.15.42:0/2410626890 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20181f74a0 con 0x7f2000005270 2024-09-17T01:40:46.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.928+0000 7f2020800640 1 -- 172.21.15.42:0/2410626890 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20180b49a0 con 0x7f2000005270 2024-09-17T01:40:46.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.929+0000 7f2012000640 1 -- 172.21.15.42:0/2410626890 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f200c011430 con 0x7f2000005270 2024-09-17T01:40:46.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.930+0000 7f2012000640 1 --2- 172.21.15.42:0/2410626890 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1ffc078bc0 0x7f1ffc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:46.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.930+0000 7f2012000640 1 -- 172.21.15.42:0/2410626890 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f200c09ba90 con 0x7f2000005270 2024-09-17T01:40:46.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.931+0000 7f201d400640 1 --2- 172.21.15.42:0/2410626890 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1ffc078bc0 0x7f1ffc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:46.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.932+0000 7f201d400640 1 --2- 172.21.15.42:0/2410626890 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1ffc078bc0 0x7f1ffc07b0d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2018156d80 tx=0x7f2008006950 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:46.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:46.935+0000 7f2012000640 1 -- 172.21.15.42:0/2410626890 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f20180b49a0 con 0x7f2000005270 2024-09-17T01:40:47.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.125+0000 7f2020800640 1 -- 172.21.15.42:0/2410626890 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f201806d8d0 con 0x7f1ffc078bc0 2024-09-17T01:40:47.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.131+0000 7f2012000640 1 -- 172.21.15.42:0/2410626890 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251284 (secure 0 0 0) 0x7f201806d8d0 con 0x7f1ffc078bc0 2024-09-17T01:40:47.133 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:40:47.134 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:40:47.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.135+0000 7f2020800640 1 -- 172.21.15.42:0/2410626890 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1ffc078bc0 msgr2=0x7f1ffc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:47.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.135+0000 7f2020800640 1 --2- 172.21.15.42:0/2410626890 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1ffc078bc0 0x7f1ffc07b0d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2018156d80 tx=0x7f2008006950 comp rx=0 tx=0).stop 2024-09-17T01:40:47.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.135+0000 7f2020800640 1 -- 172.21.15.42:0/2410626890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2000005270 msgr2=0x7f20181f7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:47.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.135+0000 7f2020800640 1 --2- 172.21.15.42:0/2410626890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2000005270 0x7f20181f7ca0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f200c001e30 tx=0x7f200c003a80 comp rx=0 tx=0).stop 2024-09-17T01:40:47.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.135+0000 7f2020800640 1 -- 172.21.15.42:0/2410626890 shutdown_connections 2024-09-17T01:40:47.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.135+0000 7f2020800640 1 --2- 172.21.15.42:0/2410626890 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1ffc078bc0 0x7f1ffc07b0d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:47.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.135+0000 7f2020800640 1 --2- 172.21.15.42:0/2410626890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2018154160 0x7f20180ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:47.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.135+0000 7f2020800640 1 --2- 172.21.15.42:0/2410626890 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f20180aea80 0x7f201814a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:47.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.135+0000 7f2020800640 1 --2- 172.21.15.42:0/2410626890 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2000005270 0x7f20181f7ca0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:47.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.135+0000 7f2020800640 1 -- 172.21.15.42:0/2410626890 >> 172.21.15.42:0/2410626890 conn(0x7f20180b2930 msgr2=0x7f2018072950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:47.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.135+0000 7f2020800640 1 -- 172.21.15.42:0/2410626890 shutdown_connections 2024-09-17T01:40:47.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.135+0000 7f2020800640 1 -- 172.21.15.42:0/2410626890 wait complete. 2024-09-17T01:40:47.156 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":382,"stamp":"2024-09-17T01:40:45.126893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":381896,"kb_used_data":13000,"kb_used_omap":12,"kb_used_meta":368691,"kb_avail":754592824,"statfs":{"total":773094113280,"available":772703051776,"internally_reserved":0,"allocated":13312000,"data_stored":6470843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":377540148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.458328"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.699679+0000","last_change":"2024-09-17T01:40:42.707541+0000","last_active":"2024-09-17T01:40:43.699679+0000","last_peered":"2024-09-17T01:40:43.699679+0000","last_clean":"2024-09-17T01:40:43.699679+0000","last_became_active":"2024-09-17T01:40:42.704587+0000","last_became_peered":"2024-09-17T01:40:42.704587+0000","last_unstale":"2024-09-17T01:40:43.699679+0000","last_undegraded":"2024-09-17T01:40:43.699679+0000","last_fullsized":"2024-09-17T01:40:43.699679+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:42.964928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:40:41.667128+0000","last_change":"2024-09-17T01:40:41.667128+0000","last_active":"2024-09-17T01:40:41.667128+0000","last_peered":"2024-09-17T01:40:41.667128+0000","last_clean":"2024-09-17T01:40:41.667128+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:40:41.667128+0000","last_undegraded":"2024-09-17T01:40:41.667128+0000","last_fullsized":"2024-09-17T01:40:41.667128+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.695644+0000","last_change":"2024-09-17T01:40:42.689832+0000","last_active":"2024-09-17T01:40:43.695644+0000","last_peered":"2024-09-17T01:40:43.695644+0000","last_clean":"2024-09-17T01:40:43.695644+0000","last_became_active":"2024-09-17T01:40:42.689345+0000","last_became_peered":"2024-09-17T01:40:42.689345+0000","last_unstale":"2024-09-17T01:40:43.695644+0000","last_undegraded":"2024-09-17T01:40:43.695644+0000","last_fullsized":"2024-09-17T01:40:43.695644+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:54.040602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698475+0000","last_change":"2024-09-17T01:40:42.694412+0000","last_active":"2024-09-17T01:40:43.698475+0000","last_peered":"2024-09-17T01:40:43.698475+0000","last_clean":"2024-09-17T01:40:43.698475+0000","last_became_active":"2024-09-17T01:40:42.694064+0000","last_became_peered":"2024-09-17T01:40:42.694064+0000","last_unstale":"2024-09-17T01:40:43.698475+0000","last_undegraded":"2024-09-17T01:40:43.698475+0000","last_fullsized":"2024-09-17T01:40:43.698475+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:40.025832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972510+0000","last_change":"2024-09-17T01:40:42.715187+0000","last_active":"2024-09-17T01:40:43.972510+0000","last_peered":"2024-09-17T01:40:43.972510+0000","last_clean":"2024-09-17T01:40:43.972510+0000","last_became_active":"2024-09-17T01:40:42.714842+0000","last_became_peered":"2024-09-17T01:40:42.714842+0000","last_unstale":"2024-09-17T01:40:43.972510+0000","last_undegraded":"2024-09-17T01:40:43.972510+0000","last_fullsized":"2024-09-17T01:40:43.972510+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:11.100796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-17T01:40:42.713558+0000","last_change":"2024-09-17T01:40:42.705979+0000","last_active":"2024-09-17T01:40:42.713558+0000","last_peered":"2024-09-17T01:40:42.713558+0000","last_clean":"2024-09-17T01:40:42.713558+0000","last_became_active":"2024-09-17T01:40:42.705585+0000","last_became_peered":"2024-09-17T01:40:42.705585+0000","last_unstale":"2024-09-17T01:40:42.713558+0000","last_undegraded":"2024-09-17T01:40:42.713558+0000","last_fullsized":"2024-09-17T01:40:42.713558+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:48.224881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.645104+0000","last_change":"2024-09-17T01:40:42.705047+0000","last_active":"2024-09-17T01:40:44.645104+0000","last_peered":"2024-09-17T01:40:44.645104+0000","last_clean":"2024-09-17T01:40:44.645104+0000","last_became_active":"2024-09-17T01:40:42.704326+0000","last_became_peered":"2024-09-17T01:40:42.704326+0000","last_unstale":"2024-09-17T01:40:44.645104+0000","last_undegraded":"2024-09-17T01:40:44.645104+0000","last_fullsized":"2024-09-17T01:40:44.645104+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:48.819025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.645139+0000","last_change":"2024-09-17T01:40:42.704390+0000","last_active":"2024-09-17T01:40:44.645139+0000","last_peered":"2024-09-17T01:40:44.645139+0000","last_clean":"2024-09-17T01:40:44.645139+0000","last_became_active":"2024-09-17T01:40:42.704091+0000","last_became_peered":"2024-09-17T01:40:42.704091+0000","last_unstale":"2024-09-17T01:40:44.645139+0000","last_undegraded":"2024-09-17T01:40:44.645139+0000","last_fullsized":"2024-09-17T01:40:44.645139+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:42.581542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.699636+0000","last_change":"2024-09-17T01:40:42.694111+0000","last_active":"2024-09-17T01:40:43.699636+0000","last_peered":"2024-09-17T01:40:43.699636+0000","last_clean":"2024-09-17T01:40:43.699636+0000","last_became_active":"2024-09-17T01:40:42.692022+0000","last_became_peered":"2024-09-17T01:40:42.692022+0000","last_unstale":"2024-09-17T01:40:43.699636+0000","last_undegraded":"2024-09-17T01:40:43.699636+0000","last_fullsized":"2024-09-17T01:40:43.699636+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:01.170035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972671+0000","last_change":"2024-09-17T01:40:42.720181+0000","last_active":"2024-09-17T01:40:43.972671+0000","last_peered":"2024-09-17T01:40:43.972671+0000","last_clean":"2024-09-17T01:40:43.972671+0000","last_became_active":"2024-09-17T01:40:42.719827+0000","last_became_peered":"2024-09-17T01:40:42.719827+0000","last_unstale":"2024-09-17T01:40:43.972671+0000","last_undegraded":"2024-09-17T01:40:43.972671+0000","last_fullsized":"2024-09-17T01:40:43.972671+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:41:08.150710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.645972+0000","last_change":"2024-09-17T01:40:42.706434+0000","last_active":"2024-09-17T01:40:44.645972+0000","last_peered":"2024-09-17T01:40:44.645972+0000","last_clean":"2024-09-17T01:40:44.645972+0000","last_became_active":"2024-09-17T01:40:42.706126+0000","last_became_peered":"2024-09-17T01:40:42.706126+0000","last_unstale":"2024-09-17T01:40:44.645972+0000","last_undegraded":"2024-09-17T01:40:44.645972+0000","last_fullsized":"2024-09-17T01:40:44.645972+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:58.039332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972521+0000","last_change":"2024-09-17T01:40:42.712020+0000","last_active":"2024-09-17T01:40:43.972521+0000","last_peered":"2024-09-17T01:40:43.972521+0000","last_clean":"2024-09-17T01:40:43.972521+0000","last_became_active":"2024-09-17T01:40:42.711526+0000","last_became_peered":"2024-09-17T01:40:42.711526+0000","last_unstale":"2024-09-17T01:40:43.972521+0000","last_undegraded":"2024-09-17T01:40:43.972521+0000","last_fullsized":"2024-09-17T01:40:43.972521+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:25.250404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:40:41.667128+0000","last_change":"2024-09-17T01:40:41.667128+0000","last_active":"2024-09-17T01:40:41.667128+0000","last_peered":"2024-09-17T01:40:41.667128+0000","last_clean":"2024-09-17T01:40:41.667128+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:40:41.667128+0000","last_undegraded":"2024-09-17T01:40:41.667128+0000","last_fullsized":"2024-09-17T01:40:41.667128+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.646593+0000","last_change":"2024-09-17T01:40:42.719386+0000","last_active":"2024-09-17T01:40:44.646593+0000","last_peered":"2024-09-17T01:40:44.646593+0000","last_clean":"2024-09-17T01:40:44.646593+0000","last_became_active":"2024-09-17T01:40:42.716839+0000","last_became_peered":"2024-09-17T01:40:42.716839+0000","last_unstale":"2024-09-17T01:40:44.646593+0000","last_undegraded":"2024-09-17T01:40:44.646593+0000","last_fullsized":"2024-09-17T01:40:44.646593+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:15.656391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.697347+0000","last_change":"2024-09-17T01:40:42.699268+0000","last_active":"2024-09-17T01:40:43.697347+0000","last_peered":"2024-09-17T01:40:43.697347+0000","last_clean":"2024-09-17T01:40:43.697347+0000","last_became_active":"2024-09-17T01:40:42.696926+0000","last_became_peered":"2024-09-17T01:40:42.696926+0000","last_unstale":"2024-09-17T01:40:43.697347+0000","last_undegraded":"2024-09-17T01:40:43.697347+0000","last_fullsized":"2024-09-17T01:40:43.697347+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:24.106436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972109+0000","last_change":"2024-09-17T01:40:42.719010+0000","last_active":"2024-09-17T01:40:43.972109+0000","last_peered":"2024-09-17T01:40:43.972109+0000","last_clean":"2024-09-17T01:40:43.972109+0000","last_became_active":"2024-09-17T01:40:42.711723+0000","last_became_peered":"2024-09-17T01:40:42.711723+0000","last_unstale":"2024-09-17T01:40:43.972109+0000","last_undegraded":"2024-09-17T01:40:43.972109+0000","last_fullsized":"2024-09-17T01:40:43.972109+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:33:21.328797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.696009+0000","last_change":"2024-09-17T01:40:42.706576+0000","last_active":"2024-09-17T01:40:43.696009+0000","last_peered":"2024-09-17T01:40:43.696009+0000","last_clean":"2024-09-17T01:40:43.696009+0000","last_became_active":"2024-09-17T01:40:42.706274+0000","last_became_peered":"2024-09-17T01:40:42.706274+0000","last_unstale":"2024-09-17T01:40:43.696009+0000","last_undegraded":"2024-09-17T01:40:43.696009+0000","last_fullsized":"2024-09-17T01:40:43.696009+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:25.007459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.646036+0000","last_change":"2024-09-17T01:40:42.702175+0000","last_active":"2024-09-17T01:40:44.646036+0000","last_peered":"2024-09-17T01:40:44.646036+0000","last_clean":"2024-09-17T01:40:44.646036+0000","last_became_active":"2024-09-17T01:40:42.701895+0000","last_became_peered":"2024-09-17T01:40:42.701895+0000","last_unstale":"2024-09-17T01:40:44.646036+0000","last_undegraded":"2024-09-17T01:40:44.646036+0000","last_fullsized":"2024-09-17T01:40:44.646036+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:32.119945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.695904+0000","last_change":"2024-09-17T01:40:42.697493+0000","last_active":"2024-09-17T01:40:43.695904+0000","last_peered":"2024-09-17T01:40:43.695904+0000","last_clean":"2024-09-17T01:40:43.695904+0000","last_became_active":"2024-09-17T01:40:42.696669+0000","last_became_peered":"2024-09-17T01:40:42.696669+0000","last_unstale":"2024-09-17T01:40:43.695904+0000","last_undegraded":"2024-09-17T01:40:43.695904+0000","last_fullsized":"2024-09-17T01:40:43.695904+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:45:47.825308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.695653+0000","last_change":"2024-09-17T01:40:42.692941+0000","last_active":"2024-09-17T01:40:43.695653+0000","last_peered":"2024-09-17T01:40:43.695653+0000","last_clean":"2024-09-17T01:40:43.695653+0000","last_became_active":"2024-09-17T01:40:42.692579+0000","last_became_peered":"2024-09-17T01:40:42.692579+0000","last_unstale":"2024-09-17T01:40:43.695653+0000","last_undegraded":"2024-09-17T01:40:43.695653+0000","last_fullsized":"2024-09-17T01:40:43.695653+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:03.524959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.645870+0000","last_change":"2024-09-17T01:40:42.691862+0000","last_active":"2024-09-17T01:40:44.645870+0000","last_peered":"2024-09-17T01:40:44.645870+0000","last_clean":"2024-09-17T01:40:44.645870+0000","last_became_active":"2024-09-17T01:40:42.691549+0000","last_became_peered":"2024-09-17T01:40:42.691549+0000","last_unstale":"2024-09-17T01:40:44.645870+0000","last_undegraded":"2024-09-17T01:40:44.645870+0000","last_fullsized":"2024-09-17T01:40:44.645870+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:46.274606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-17T01:40:42.713530+0000","last_change":"2024-09-17T01:40:42.704308+0000","last_active":"2024-09-17T01:40:42.713530+0000","last_peered":"2024-09-17T01:40:42.713530+0000","last_clean":"2024-09-17T01:40:42.713530+0000","last_became_active":"2024-09-17T01:40:42.703882+0000","last_became_peered":"2024-09-17T01:40:42.703882+0000","last_unstale":"2024-09-17T01:40:42.713530+0000","last_undegraded":"2024-09-17T01:40:42.713530+0000","last_fullsized":"2024-09-17T01:40:42.713530+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:07.965288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.646577+0000","last_change":"2024-09-17T01:40:42.709177+0000","last_active":"2024-09-17T01:40:44.646577+0000","last_peered":"2024-09-17T01:40:44.646577+0000","last_clean":"2024-09-17T01:40:44.646577+0000","last_became_active":"2024-09-17T01:40:42.708880+0000","last_became_peered":"2024-09-17T01:40:42.708880+0000","last_unstale":"2024-09-17T01:40:44.646577+0000","last_undegraded":"2024-09-17T01:40:44.646577+0000","last_fullsized":"2024-09-17T01:40:44.646577+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:43.813042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.697016+0000","last_change":"2024-09-17T01:40:42.699236+0000","last_active":"2024-09-17T01:40:43.697016+0000","last_peered":"2024-09-17T01:40:43.697016+0000","last_clean":"2024-09-17T01:40:43.697016+0000","last_became_active":"2024-09-17T01:40:42.697521+0000","last_became_peered":"2024-09-17T01:40:42.697521+0000","last_unstale":"2024-09-17T01:40:43.697016+0000","last_undegraded":"2024-09-17T01:40:43.697016+0000","last_fullsized":"2024-09-17T01:40:43.697016+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:24.251436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.646191+0000","last_change":"2024-09-17T01:40:42.700538+0000","last_active":"2024-09-17T01:40:44.646191+0000","last_peered":"2024-09-17T01:40:44.646191+0000","last_clean":"2024-09-17T01:40:44.646191+0000","last_became_active":"2024-09-17T01:40:42.700224+0000","last_became_peered":"2024-09-17T01:40:42.700224+0000","last_unstale":"2024-09-17T01:40:44.646191+0000","last_undegraded":"2024-09-17T01:40:44.646191+0000","last_fullsized":"2024-09-17T01:40:44.646191+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:03.835717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-17T01:40:42.709692+0000","last_change":"2024-09-17T01:40:42.706260+0000","last_active":"2024-09-17T01:40:42.709692+0000","last_peered":"2024-09-17T01:40:42.709692+0000","last_clean":"2024-09-17T01:40:42.709692+0000","last_became_active":"2024-09-17T01:40:42.705934+0000","last_became_peered":"2024-09-17T01:40:42.705934+0000","last_unstale":"2024-09-17T01:40:42.709692+0000","last_undegraded":"2024-09-17T01:40:42.709692+0000","last_fullsized":"2024-09-17T01:40:42.709692+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:01.469650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698805+0000","last_change":"2024-09-17T01:40:42.703690+0000","last_active":"2024-09-17T01:40:43.698805+0000","last_peered":"2024-09-17T01:40:43.698805+0000","last_clean":"2024-09-17T01:40:43.698805+0000","last_became_active":"2024-09-17T01:40:42.703377+0000","last_became_peered":"2024-09-17T01:40:42.703377+0000","last_unstale":"2024-09-17T01:40:43.698805+0000","last_undegraded":"2024-09-17T01:40:43.698805+0000","last_fullsized":"2024-09-17T01:40:43.698805+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:54.818117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-17T01:40:42.719547+0000","last_change":"2024-09-17T01:40:42.717849+0000","last_active":"2024-09-17T01:40:42.719547+0000","last_peered":"2024-09-17T01:40:42.719547+0000","last_clean":"2024-09-17T01:40:42.719547+0000","last_became_active":"2024-09-17T01:40:42.717444+0000","last_became_peered":"2024-09-17T01:40:42.717444+0000","last_unstale":"2024-09-17T01:40:42.719547+0000","last_undegraded":"2024-09-17T01:40:42.719547+0000","last_fullsized":"2024-09-17T01:40:42.719547+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:23.772170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.646689+0000","last_change":"2024-09-17T01:40:42.715806+0000","last_active":"2024-09-17T01:40:44.646689+0000","last_peered":"2024-09-17T01:40:44.646689+0000","last_clean":"2024-09-17T01:40:44.646689+0000","last_became_active":"2024-09-17T01:40:42.715487+0000","last_became_peered":"2024-09-17T01:40:42.715487+0000","last_unstale":"2024-09-17T01:40:44.646689+0000","last_undegraded":"2024-09-17T01:40:44.646689+0000","last_fullsized":"2024-09-17T01:40:44.646689+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:05:09.245569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.645588+0000","last_change":"2024-09-17T01:40:42.716420+0000","last_active":"2024-09-17T01:40:44.645588+0000","last_peered":"2024-09-17T01:40:44.645588+0000","last_clean":"2024-09-17T01:40:44.645588+0000","last_became_active":"2024-09-17T01:40:42.714208+0000","last_became_peered":"2024-09-17T01:40:42.714208+0000","last_unstale":"2024-09-17T01:40:44.645588+0000","last_undegraded":"2024-09-17T01:40:44.645588+0000","last_fullsized":"2024-09-17T01:40:44.645588+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:28.800536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.697515+0000","last_change":"2024-09-17T01:40:42.705506+0000","last_active":"2024-09-17T01:40:43.697515+0000","last_peered":"2024-09-17T01:40:43.697515+0000","last_clean":"2024-09-17T01:40:43.697515+0000","last_became_active":"2024-09-17T01:40:42.702174+0000","last_became_peered":"2024-09-17T01:40:42.702174+0000","last_unstale":"2024-09-17T01:40:43.697515+0000","last_undegraded":"2024-09-17T01:40:43.697515+0000","last_fullsized":"2024-09-17T01:40:43.697515+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:53.007630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972224+0000","last_change":"2024-09-17T01:40:42.715974+0000","last_active":"2024-09-17T01:40:43.972224+0000","last_peered":"2024-09-17T01:40:43.972224+0000","last_clean":"2024-09-17T01:40:43.972224+0000","last_became_active":"2024-09-17T01:40:42.715636+0000","last_became_peered":"2024-09-17T01:40:42.715636+0000","last_unstale":"2024-09-17T01:40:43.972224+0000","last_undegraded":"2024-09-17T01:40:43.972224+0000","last_fullsized":"2024-09-17T01:40:43.972224+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:02.975781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.699725+0000","last_change":"2024-09-17T01:40:42.700156+0000","last_active":"2024-09-17T01:40:43.699725+0000","last_peered":"2024-09-17T01:40:43.699725+0000","last_clean":"2024-09-17T01:40:43.699725+0000","last_became_active":"2024-09-17T01:40:42.696645+0000","last_became_peered":"2024-09-17T01:40:42.696645+0000","last_unstale":"2024-09-17T01:40:43.699725+0000","last_undegraded":"2024-09-17T01:40:43.699725+0000","last_fullsized":"2024-09-17T01:40:43.699725+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:43.815301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"122'4","reported_seq":19,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.647426+0000","last_change":"2024-09-17T01:40:41.694059+0000","last_active":"2024-09-17T01:40:44.647426+0000","last_peered":"2024-09-17T01:40:44.647426+0000","last_clean":"2024-09-17T01:40:44.647426+0000","last_became_active":"2024-09-17T01:40:41.693174+0000","last_became_peered":"2024-09-17T01:40:41.693174+0000","last_unstale":"2024-09-17T01:40:44.647426+0000","last_undegraded":"2024-09-17T01:40:44.647426+0000","last_fullsized":"2024-09-17T01:40:44.647426+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:42.325749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.647345+0000","last_change":"2024-09-17T01:40:42.713941+0000","last_active":"2024-09-17T01:40:44.647345+0000","last_peered":"2024-09-17T01:40:44.647345+0000","last_clean":"2024-09-17T01:40:44.647345+0000","last_became_active":"2024-09-17T01:40:42.712810+0000","last_became_peered":"2024-09-17T01:40:42.712810+0000","last_unstale":"2024-09-17T01:40:44.647345+0000","last_undegraded":"2024-09-17T01:40:44.647345+0000","last_fullsized":"2024-09-17T01:40:44.647345+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:00.676856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:40:40.664217+0000","last_change":"2024-09-17T01:40:40.664217+0000","last_active":"2024-09-17T01:40:40.664217+0000","last_peered":"2024-09-17T01:40:40.664217+0000","last_clean":"2024-09-17T01:40:40.664217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:40:40.664217+0000","last_undegraded":"2024-09-17T01:40:40.664217+0000","last_fullsized":"2024-09-17T01:40:40.664217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-17T01:40:42.718091+0000","last_change":"2024-09-17T01:40:42.712533+0000","last_active":"2024-09-17T01:40:42.718091+0000","last_peered":"2024-09-17T01:40:42.718091+0000","last_clean":"2024-09-17T01:40:42.718091+0000","last_became_active":"2024-09-17T01:40:42.709095+0000","last_became_peered":"2024-09-17T01:40:42.709095+0000","last_unstale":"2024-09-17T01:40:42.718091+0000","last_undegraded":"2024-09-17T01:40:42.718091+0000","last_fullsized":"2024-09-17T01:40:42.718091+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:50:08.598915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"122'2","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698575+0000","last_change":"2024-09-17T01:40:41.697633+0000","last_active":"2024-09-17T01:40:43.698575+0000","last_peered":"2024-09-17T01:40:43.698575+0000","last_clean":"2024-09-17T01:40:43.698575+0000","last_became_active":"2024-09-17T01:40:41.697313+0000","last_became_peered":"2024-09-17T01:40:41.697313+0000","last_unstale":"2024-09-17T01:40:43.698575+0000","last_undegraded":"2024-09-17T01:40:43.698575+0000","last_fullsized":"2024-09-17T01:40:43.698575+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:49.053395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.695898+0000","last_change":"2024-09-17T01:40:42.696980+0000","last_active":"2024-09-17T01:40:43.695898+0000","last_peered":"2024-09-17T01:40:43.695898+0000","last_clean":"2024-09-17T01:40:43.695898+0000","last_became_active":"2024-09-17T01:40:42.696227+0000","last_became_peered":"2024-09-17T01:40:42.696227+0000","last_unstale":"2024-09-17T01:40:43.695898+0000","last_undegraded":"2024-09-17T01:40:43.695898+0000","last_fullsized":"2024-09-17T01:40:43.695898+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:22:54.218478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"122'2","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698248+0000","last_change":"2024-09-17T01:40:41.697793+0000","last_active":"2024-09-17T01:40:43.698248+0000","last_peered":"2024-09-17T01:40:43.698248+0000","last_clean":"2024-09-17T01:40:43.698248+0000","last_became_active":"2024-09-17T01:40:41.697299+0000","last_became_peered":"2024-09-17T01:40:41.697299+0000","last_unstale":"2024-09-17T01:40:43.698248+0000","last_undegraded":"2024-09-17T01:40:43.698248+0000","last_fullsized":"2024-09-17T01:40:43.698248+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:03.621376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698336+0000","last_change":"2024-09-17T01:40:42.704223+0000","last_active":"2024-09-17T01:40:43.698336+0000","last_peered":"2024-09-17T01:40:43.698336+0000","last_clean":"2024-09-17T01:40:43.698336+0000","last_became_active":"2024-09-17T01:40:42.701012+0000","last_became_peered":"2024-09-17T01:40:42.701012+0000","last_unstale":"2024-09-17T01:40:43.698336+0000","last_undegraded":"2024-09-17T01:40:43.698336+0000","last_fullsized":"2024-09-17T01:40:43.698336+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:17.085705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1b","version":"122'1","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.695525+0000","last_change":"2024-09-17T01:40:41.696033+0000","last_active":"2024-09-17T01:40:43.695525+0000","last_peered":"2024-09-17T01:40:43.695525+0000","last_clean":"2024-09-17T01:40:43.695525+0000","last_became_active":"2024-09-17T01:40:41.695706+0000","last_became_peered":"2024-09-17T01:40:41.695706+0000","last_unstale":"2024-09-17T01:40:43.695525+0000","last_undegraded":"2024-09-17T01:40:43.695525+0000","last_fullsized":"2024-09-17T01:40:43.695525+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:49:36.729485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.645596+0000","last_change":"2024-09-17T01:40:42.702262+0000","last_active":"2024-09-17T01:40:44.645596+0000","last_peered":"2024-09-17T01:40:44.645596+0000","last_clean":"2024-09-17T01:40:44.645596+0000","last_became_active":"2024-09-17T01:40:42.701951+0000","last_became_peered":"2024-09-17T01:40:42.701951+0000","last_unstale":"2024-09-17T01:40:44.645596+0000","last_undegraded":"2024-09-17T01:40:44.645596+0000","last_fullsized":"2024-09-17T01:40:44.645596+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:47.427751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1a","version":"122'1","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698704+0000","last_change":"2024-09-17T01:40:41.693661+0000","last_active":"2024-09-17T01:40:43.698704+0000","last_peered":"2024-09-17T01:40:43.698704+0000","last_clean":"2024-09-17T01:40:43.698704+0000","last_became_active":"2024-09-17T01:40:41.693329+0000","last_became_peered":"2024-09-17T01:40:41.693329+0000","last_unstale":"2024-09-17T01:40:43.698704+0000","last_undegraded":"2024-09-17T01:40:43.698704+0000","last_fullsized":"2024-09-17T01:40:43.698704+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:19.729596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972485+0000","last_change":"2024-09-17T01:40:42.715102+0000","last_active":"2024-09-17T01:40:43.972485+0000","last_peered":"2024-09-17T01:40:43.972485+0000","last_clean":"2024-09-17T01:40:43.972485+0000","last_became_active":"2024-09-17T01:40:42.712177+0000","last_became_peered":"2024-09-17T01:40:42.712177+0000","last_unstale":"2024-09-17T01:40:43.972485+0000","last_undegraded":"2024-09-17T01:40:43.972485+0000","last_fullsized":"2024-09-17T01:40:43.972485+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:55.899108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.645241+0000","last_change":"2024-09-17T01:40:41.695517+0000","last_active":"2024-09-17T01:40:44.645241+0000","last_peered":"2024-09-17T01:40:44.645241+0000","last_clean":"2024-09-17T01:40:44.645241+0000","last_became_active":"2024-09-17T01:40:41.695207+0000","last_became_peered":"2024-09-17T01:40:41.695207+0000","last_unstale":"2024-09-17T01:40:44.645241+0000","last_undegraded":"2024-09-17T01:40:44.645241+0000","last_fullsized":"2024-09-17T01:40:44.645241+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:59.565790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.645128+0000","last_change":"2024-09-17T01:40:42.704687+0000","last_active":"2024-09-17T01:40:44.645128+0000","last_peered":"2024-09-17T01:40:44.645128+0000","last_clean":"2024-09-17T01:40:44.645128+0000","last_became_active":"2024-09-17T01:40:42.702637+0000","last_became_peered":"2024-09-17T01:40:42.702637+0000","last_unstale":"2024-09-17T01:40:44.645128+0000","last_undegraded":"2024-09-17T01:40:44.645128+0000","last_fullsized":"2024-09-17T01:40:44.645128+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:50.151027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972589+0000","last_change":"2024-09-17T01:40:41.705210+0000","last_active":"2024-09-17T01:40:43.972589+0000","last_peered":"2024-09-17T01:40:43.972589+0000","last_clean":"2024-09-17T01:40:43.972589+0000","last_became_active":"2024-09-17T01:40:41.704220+0000","last_became_peered":"2024-09-17T01:40:41.704220+0000","last_unstale":"2024-09-17T01:40:43.972589+0000","last_undegraded":"2024-09-17T01:40:43.972589+0000","last_fullsized":"2024-09-17T01:40:43.972589+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:06.932278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:40:41.667128+0000","last_change":"2024-09-17T01:40:41.667128+0000","last_active":"2024-09-17T01:40:41.667128+0000","last_peered":"2024-09-17T01:40:41.667128+0000","last_clean":"2024-09-17T01:40:41.667128+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:40:41.667128+0000","last_undegraded":"2024-09-17T01:40:41.667128+0000","last_fullsized":"2024-09-17T01:40:41.667128+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698822+0000","last_change":"2024-09-17T01:40:41.698677+0000","last_active":"2024-09-17T01:40:43.698822+0000","last_peered":"2024-09-17T01:40:43.698822+0000","last_clean":"2024-09-17T01:40:43.698822+0000","last_became_active":"2024-09-17T01:40:41.698349+0000","last_became_peered":"2024-09-17T01:40:41.698349+0000","last_unstale":"2024-09-17T01:40:43.698822+0000","last_undegraded":"2024-09-17T01:40:43.698822+0000","last_fullsized":"2024-09-17T01:40:43.698822+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:47.607030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:40:41.667128+0000","last_change":"2024-09-17T01:40:41.667128+0000","last_active":"2024-09-17T01:40:41.667128+0000","last_peered":"2024-09-17T01:40:41.667128+0000","last_clean":"2024-09-17T01:40:41.667128+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:40:41.667128+0000","last_undegraded":"2024-09-17T01:40:41.667128+0000","last_fullsized":"2024-09-17T01:40:41.667128+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972756+0000","last_change":"2024-09-17T01:40:41.706511+0000","last_active":"2024-09-17T01:40:43.972756+0000","last_peered":"2024-09-17T01:40:43.972756+0000","last_clean":"2024-09-17T01:40:43.972756+0000","last_became_active":"2024-09-17T01:40:41.706037+0000","last_became_peered":"2024-09-17T01:40:41.706037+0000","last_unstale":"2024-09-17T01:40:43.972756+0000","last_undegraded":"2024-09-17T01:40:43.972756+0000","last_fullsized":"2024-09-17T01:40:43.972756+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:33.587543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-17T01:40:42.716413+0000","last_change":"2024-09-17T01:40:42.709616+0000","last_active":"2024-09-17T01:40:42.716413+0000","last_peered":"2024-09-17T01:40:42.716413+0000","last_clean":"2024-09-17T01:40:42.716413+0000","last_became_active":"2024-09-17T01:40:42.709040+0000","last_became_peered":"2024-09-17T01:40:42.709040+0000","last_unstale":"2024-09-17T01:40:42.716413+0000","last_undegraded":"2024-09-17T01:40:42.716413+0000","last_fullsized":"2024-09-17T01:40:42.716413+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:31.768713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"122'3","reported_seq":18,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972523+0000","last_change":"2024-09-17T01:40:41.707409+0000","last_active":"2024-09-17T01:40:43.972523+0000","last_peered":"2024-09-17T01:40:43.972523+0000","last_clean":"2024-09-17T01:40:43.972523+0000","last_became_active":"2024-09-17T01:40:41.707050+0000","last_became_peered":"2024-09-17T01:40:41.707050+0000","last_unstale":"2024-09-17T01:40:43.972523+0000","last_undegraded":"2024-09-17T01:40:43.972523+0000","last_fullsized":"2024-09-17T01:40:43.972523+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:17.906320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.646226+0000","last_change":"2024-09-17T01:40:42.697021+0000","last_active":"2024-09-17T01:40:44.646226+0000","last_peered":"2024-09-17T01:40:44.646226+0000","last_clean":"2024-09-17T01:40:44.646226+0000","last_became_active":"2024-09-17T01:40:42.695234+0000","last_became_peered":"2024-09-17T01:40:42.695234+0000","last_unstale":"2024-09-17T01:40:44.646226+0000","last_undegraded":"2024-09-17T01:40:44.646226+0000","last_fullsized":"2024-09-17T01:40:44.646226+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:48.160716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"122'6","reported_seq":21,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698477+0000","last_change":"2024-09-17T01:40:41.698568+0000","last_active":"2024-09-17T01:40:43.698477+0000","last_peered":"2024-09-17T01:40:43.698477+0000","last_clean":"2024-09-17T01:40:43.698477+0000","last_became_active":"2024-09-17T01:40:41.698215+0000","last_became_peered":"2024-09-17T01:40:41.698215+0000","last_unstale":"2024-09-17T01:40:43.698477+0000","last_undegraded":"2024-09-17T01:40:43.698477+0000","last_fullsized":"2024-09-17T01:40:43.698477+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:48.581141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972227+0000","last_change":"2024-09-17T01:40:42.712673+0000","last_active":"2024-09-17T01:40:43.972227+0000","last_peered":"2024-09-17T01:40:43.972227+0000","last_clean":"2024-09-17T01:40:43.972227+0000","last_became_active":"2024-09-17T01:40:42.711340+0000","last_became_peered":"2024-09-17T01:40:42.711340+0000","last_unstale":"2024-09-17T01:40:43.972227+0000","last_undegraded":"2024-09-17T01:40:43.972227+0000","last_fullsized":"2024-09-17T01:40:43.972227+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:03.651513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"122'2","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972215+0000","last_change":"2024-09-17T01:40:41.705213+0000","last_active":"2024-09-17T01:40:43.972215+0000","last_peered":"2024-09-17T01:40:43.972215+0000","last_clean":"2024-09-17T01:40:43.972215+0000","last_became_active":"2024-09-17T01:40:41.704824+0000","last_became_peered":"2024-09-17T01:40:41.704824+0000","last_unstale":"2024-09-17T01:40:43.972215+0000","last_undegraded":"2024-09-17T01:40:43.972215+0000","last_fullsized":"2024-09-17T01:40:43.972215+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:05:18.664353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698083+0000","last_change":"2024-09-17T01:40:42.713081+0000","last_active":"2024-09-17T01:40:43.698083+0000","last_peered":"2024-09-17T01:40:43.698083+0000","last_clean":"2024-09-17T01:40:43.698083+0000","last_became_active":"2024-09-17T01:40:42.712732+0000","last_became_peered":"2024-09-17T01:40:42.712732+0000","last_unstale":"2024-09-17T01:40:43.698083+0000","last_undegraded":"2024-09-17T01:40:43.698083+0000","last_fullsized":"2024-09-17T01:40:43.698083+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:18.932988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.695813+0000","last_change":"2024-09-17T01:40:41.690396+0000","last_active":"2024-09-17T01:40:43.695813+0000","last_peered":"2024-09-17T01:40:43.695813+0000","last_clean":"2024-09-17T01:40:43.695813+0000","last_became_active":"2024-09-17T01:40:41.687942+0000","last_became_peered":"2024-09-17T01:40:41.687942+0000","last_unstale":"2024-09-17T01:40:43.695813+0000","last_undegraded":"2024-09-17T01:40:43.695813+0000","last_fullsized":"2024-09-17T01:40:43.695813+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:18.857259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698223+0000","last_change":"2024-09-17T01:40:42.705265+0000","last_active":"2024-09-17T01:40:43.698223+0000","last_peered":"2024-09-17T01:40:43.698223+0000","last_clean":"2024-09-17T01:40:43.698223+0000","last_became_active":"2024-09-17T01:40:42.704953+0000","last_became_peered":"2024-09-17T01:40:42.704953+0000","last_unstale":"2024-09-17T01:40:43.698223+0000","last_undegraded":"2024-09-17T01:40:43.698223+0000","last_fullsized":"2024-09-17T01:40:43.698223+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:16.839703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"122'8","reported_seq":23,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.697136+0000","last_change":"2024-09-17T01:40:41.685804+0000","last_active":"2024-09-17T01:40:43.697136+0000","last_peered":"2024-09-17T01:40:43.697136+0000","last_clean":"2024-09-17T01:40:43.697136+0000","last_became_active":"2024-09-17T01:40:41.685290+0000","last_became_peered":"2024-09-17T01:40:41.685290+0000","last_unstale":"2024-09-17T01:40:43.697136+0000","last_undegraded":"2024-09-17T01:40:43.697136+0000","last_fullsized":"2024-09-17T01:40:43.697136+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:13.617766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.699825+0000","last_change":"2024-09-17T01:40:42.707423+0000","last_active":"2024-09-17T01:40:43.699825+0000","last_peered":"2024-09-17T01:40:43.699825+0000","last_clean":"2024-09-17T01:40:43.699825+0000","last_became_active":"2024-09-17T01:40:42.706873+0000","last_became_peered":"2024-09-17T01:40:42.706873+0000","last_unstale":"2024-09-17T01:40:43.699825+0000","last_undegraded":"2024-09-17T01:40:43.699825+0000","last_fullsized":"2024-09-17T01:40:43.699825+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:41.066398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.f","version":"122'1","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-17T01:40:42.719519+0000","last_change":"2024-09-17T01:40:41.700037+0000","last_active":"2024-09-17T01:40:42.719519+0000","last_peered":"2024-09-17T01:40:42.719519+0000","last_clean":"2024-09-17T01:40:42.719519+0000","last_became_active":"2024-09-17T01:40:41.699658+0000","last_became_peered":"2024-09-17T01:40:41.699658+0000","last_unstale":"2024-09-17T01:40:42.719519+0000","last_undegraded":"2024-09-17T01:40:42.719519+0000","last_fullsized":"2024-09-17T01:40:42.719519+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:01.815446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.699939+0000","last_change":"2024-09-17T01:40:42.690810+0000","last_active":"2024-09-17T01:40:43.699939+0000","last_peered":"2024-09-17T01:40:43.699939+0000","last_clean":"2024-09-17T01:40:43.699939+0000","last_became_active":"2024-09-17T01:40:42.690435+0000","last_became_peered":"2024-09-17T01:40:42.690435+0000","last_unstale":"2024-09-17T01:40:43.699939+0000","last_undegraded":"2024-09-17T01:40:43.699939+0000","last_fullsized":"2024-09-17T01:40:43.699939+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:30.023137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"122'2","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972793+0000","last_change":"2024-09-17T01:40:41.706556+0000","last_active":"2024-09-17T01:40:43.972793+0000","last_peered":"2024-09-17T01:40:43.972793+0000","last_clean":"2024-09-17T01:40:43.972793+0000","last_became_active":"2024-09-17T01:40:41.706058+0000","last_became_peered":"2024-09-17T01:40:41.706058+0000","last_unstale":"2024-09-17T01:40:43.972793+0000","last_undegraded":"2024-09-17T01:40:43.972793+0000","last_fullsized":"2024-09-17T01:40:43.972793+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:59.246094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.645898+0000","last_change":"2024-09-17T01:40:42.696435+0000","last_active":"2024-09-17T01:40:44.645898+0000","last_peered":"2024-09-17T01:40:44.645898+0000","last_clean":"2024-09-17T01:40:44.645898+0000","last_became_active":"2024-09-17T01:40:42.695650+0000","last_became_peered":"2024-09-17T01:40:42.695650+0000","last_unstale":"2024-09-17T01:40:44.645898+0000","last_undegraded":"2024-09-17T01:40:44.645898+0000","last_fullsized":"2024-09-17T01:40:44.645898+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:57:56.110079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.d","version":"122'1","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.647349+0000","last_change":"2024-09-17T01:40:41.701173+0000","last_active":"2024-09-17T01:40:44.647349+0000","last_peered":"2024-09-17T01:40:44.647349+0000","last_clean":"2024-09-17T01:40:44.647349+0000","last_became_active":"2024-09-17T01:40:41.700834+0000","last_became_peered":"2024-09-17T01:40:41.700834+0000","last_unstale":"2024-09-17T01:40:44.647349+0000","last_undegraded":"2024-09-17T01:40:44.647349+0000","last_fullsized":"2024-09-17T01:40:44.647349+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:00:56.405963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.647206+0000","last_change":"2024-09-17T01:40:42.707255+0000","last_active":"2024-09-17T01:40:44.647206+0000","last_peered":"2024-09-17T01:40:44.647206+0000","last_clean":"2024-09-17T01:40:44.647206+0000","last_became_active":"2024-09-17T01:40:42.706848+0000","last_became_peered":"2024-09-17T01:40:42.706848+0000","last_unstale":"2024-09-17T01:40:44.647206+0000","last_undegraded":"2024-09-17T01:40:44.647206+0000","last_fullsized":"2024-09-17T01:40:44.647206+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:14.513860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.646959+0000","last_change":"2024-09-17T01:40:41.703695+0000","last_active":"2024-09-17T01:40:44.646959+0000","last_peered":"2024-09-17T01:40:44.646959+0000","last_clean":"2024-09-17T01:40:44.646959+0000","last_became_active":"2024-09-17T01:40:41.703357+0000","last_became_peered":"2024-09-17T01:40:41.703357+0000","last_unstale":"2024-09-17T01:40:44.646959+0000","last_undegraded":"2024-09-17T01:40:44.646959+0000","last_fullsized":"2024-09-17T01:40:44.646959+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:23:54.489115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.695632+0000","last_change":"2024-09-17T01:40:42.704712+0000","last_active":"2024-09-17T01:40:43.695632+0000","last_peered":"2024-09-17T01:40:43.695632+0000","last_clean":"2024-09-17T01:40:43.695632+0000","last_became_active":"2024-09-17T01:40:42.703540+0000","last_became_peered":"2024-09-17T01:40:42.703540+0000","last_unstale":"2024-09-17T01:40:43.695632+0000","last_undegraded":"2024-09-17T01:40:43.695632+0000","last_fullsized":"2024-09-17T01:40:43.695632+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:47.366939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"122'2","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972394+0000","last_change":"2024-09-17T01:40:41.706619+0000","last_active":"2024-09-17T01:40:43.972394+0000","last_peered":"2024-09-17T01:40:43.972394+0000","last_clean":"2024-09-17T01:40:43.972394+0000","last_became_active":"2024-09-17T01:40:41.706129+0000","last_became_peered":"2024-09-17T01:40:41.706129+0000","last_unstale":"2024-09-17T01:40:43.972394+0000","last_undegraded":"2024-09-17T01:40:43.972394+0000","last_fullsized":"2024-09-17T01:40:43.972394+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:24:46.906855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.699255+0000","last_change":"2024-09-17T01:40:42.702378+0000","last_active":"2024-09-17T01:40:43.699255+0000","last_peered":"2024-09-17T01:40:43.699255+0000","last_clean":"2024-09-17T01:40:43.699255+0000","last_became_active":"2024-09-17T01:40:42.701908+0000","last_became_peered":"2024-09-17T01:40:42.701908+0000","last_unstale":"2024-09-17T01:40:43.699255+0000","last_undegraded":"2024-09-17T01:40:43.699255+0000","last_fullsized":"2024-09-17T01:40:43.699255+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:09.126262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698848+0000","last_change":"2024-09-17T01:40:41.696146+0000","last_active":"2024-09-17T01:40:43.698848+0000","last_peered":"2024-09-17T01:40:43.698848+0000","last_clean":"2024-09-17T01:40:43.698848+0000","last_became_active":"2024-09-17T01:40:41.695820+0000","last_became_peered":"2024-09-17T01:40:41.695820+0000","last_unstale":"2024-09-17T01:40:43.698848+0000","last_undegraded":"2024-09-17T01:40:43.698848+0000","last_fullsized":"2024-09-17T01:40:43.698848+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:37.538831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.646044+0000","last_change":"2024-09-17T01:40:42.708939+0000","last_active":"2024-09-17T01:40:44.646044+0000","last_peered":"2024-09-17T01:40:44.646044+0000","last_clean":"2024-09-17T01:40:44.646044+0000","last_became_active":"2024-09-17T01:40:42.708614+0000","last_became_peered":"2024-09-17T01:40:42.708614+0000","last_unstale":"2024-09-17T01:40:44.646044+0000","last_undegraded":"2024-09-17T01:40:44.646044+0000","last_fullsized":"2024-09-17T01:40:44.646044+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:31.698774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698365+0000","last_change":"2024-09-17T01:40:41.690934+0000","last_active":"2024-09-17T01:40:43.698365+0000","last_peered":"2024-09-17T01:40:43.698365+0000","last_clean":"2024-09-17T01:40:43.698365+0000","last_became_active":"2024-09-17T01:40:41.690541+0000","last_became_peered":"2024-09-17T01:40:41.690541+0000","last_unstale":"2024-09-17T01:40:43.698365+0000","last_undegraded":"2024-09-17T01:40:43.698365+0000","last_fullsized":"2024-09-17T01:40:43.698365+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:04.569466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972054+0000","last_change":"2024-09-17T01:40:42.714135+0000","last_active":"2024-09-17T01:40:43.972054+0000","last_peered":"2024-09-17T01:40:43.972054+0000","last_clean":"2024-09-17T01:40:43.972054+0000","last_became_active":"2024-09-17T01:40:42.699799+0000","last_became_peered":"2024-09-17T01:40:42.699799+0000","last_unstale":"2024-09-17T01:40:43.972054+0000","last_undegraded":"2024-09-17T01:40:43.972054+0000","last_fullsized":"2024-09-17T01:40:43.972054+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:36.469697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.697425+0000","last_change":"2024-09-17T01:40:41.686422+0000","last_active":"2024-09-17T01:40:43.697425+0000","last_peered":"2024-09-17T01:40:43.697425+0000","last_clean":"2024-09-17T01:40:43.697425+0000","last_became_active":"2024-09-17T01:40:41.685486+0000","last_became_peered":"2024-09-17T01:40:41.685486+0000","last_unstale":"2024-09-17T01:40:43.697425+0000","last_undegraded":"2024-09-17T01:40:43.697425+0000","last_fullsized":"2024-09-17T01:40:43.697425+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:28.356942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.647176+0000","last_change":"2024-09-17T01:40:42.714271+0000","last_active":"2024-09-17T01:40:44.647176+0000","last_peered":"2024-09-17T01:40:44.647176+0000","last_clean":"2024-09-17T01:40:44.647176+0000","last_became_active":"2024-09-17T01:40:42.713978+0000","last_became_peered":"2024-09-17T01:40:42.713978+0000","last_unstale":"2024-09-17T01:40:44.647176+0000","last_undegraded":"2024-09-17T01:40:44.647176+0000","last_fullsized":"2024-09-17T01:40:44.647176+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:53.382523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"122'2","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698883+0000","last_change":"2024-09-17T01:40:41.699499+0000","last_active":"2024-09-17T01:40:43.698883+0000","last_peered":"2024-09-17T01:40:43.698883+0000","last_clean":"2024-09-17T01:40:43.698883+0000","last_became_active":"2024-09-17T01:40:41.698934+0000","last_became_peered":"2024-09-17T01:40:41.698934+0000","last_unstale":"2024-09-17T01:40:43.698883+0000","last_undegraded":"2024-09-17T01:40:43.698883+0000","last_fullsized":"2024-09-17T01:40:43.698883+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:17.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-17T01:40:42.718730+0000","last_change":"2024-09-17T01:40:42.714262+0000","last_active":"2024-09-17T01:40:42.718730+0000","last_peered":"2024-09-17T01:40:42.718730+0000","last_clean":"2024-09-17T01:40:42.718730+0000","last_became_active":"2024-09-17T01:40:42.713542+0000","last_became_peered":"2024-09-17T01:40:42.713542+0000","last_unstale":"2024-09-17T01:40:42.718730+0000","last_undegraded":"2024-09-17T01:40:42.718730+0000","last_fullsized":"2024-09-17T01:40:42.718730+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:02:44.152722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.645942+0000","last_change":"2024-09-17T01:40:41.693992+0000","last_active":"2024-09-17T01:40:44.645942+0000","last_peered":"2024-09-17T01:40:44.645942+0000","last_clean":"2024-09-17T01:40:44.645942+0000","last_became_active":"2024-09-17T01:40:41.693122+0000","last_became_peered":"2024-09-17T01:40:41.693122+0000","last_unstale":"2024-09-17T01:40:44.645942+0000","last_undegraded":"2024-09-17T01:40:44.645942+0000","last_fullsized":"2024-09-17T01:40:44.645942+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:26.883211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.699507+0000","last_change":"2024-09-17T01:40:42.698929+0000","last_active":"2024-09-17T01:40:43.699507+0000","last_peered":"2024-09-17T01:40:43.699507+0000","last_clean":"2024-09-17T01:40:43.699507+0000","last_became_active":"2024-09-17T01:40:42.698610+0000","last_became_peered":"2024-09-17T01:40:42.698610+0000","last_unstale":"2024-09-17T01:40:43.699507+0000","last_undegraded":"2024-09-17T01:40:43.699507+0000","last_fullsized":"2024-09-17T01:40:43.699507+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:32.703779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698738+0000","last_change":"2024-09-17T01:40:41.685604+0000","last_active":"2024-09-17T01:40:43.698738+0000","last_peered":"2024-09-17T01:40:43.698738+0000","last_clean":"2024-09-17T01:40:43.698738+0000","last_became_active":"2024-09-17T01:40:41.685235+0000","last_became_peered":"2024-09-17T01:40:41.685235+0000","last_unstale":"2024-09-17T01:40:43.698738+0000","last_undegraded":"2024-09-17T01:40:43.698738+0000","last_fullsized":"2024-09-17T01:40:43.698738+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:02.420800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.647373+0000","last_change":"2024-09-17T01:40:42.715820+0000","last_active":"2024-09-17T01:40:44.647373+0000","last_peered":"2024-09-17T01:40:44.647373+0000","last_clean":"2024-09-17T01:40:44.647373+0000","last_became_active":"2024-09-17T01:40:42.714975+0000","last_became_peered":"2024-09-17T01:40:42.714975+0000","last_unstale":"2024-09-17T01:40:44.647373+0000","last_undegraded":"2024-09-17T01:40:44.647373+0000","last_fullsized":"2024-09-17T01:40:44.647373+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:33.667942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698705+0000","last_change":"2024-09-17T01:40:41.702589+0000","last_active":"2024-09-17T01:40:43.698705+0000","last_peered":"2024-09-17T01:40:43.698705+0000","last_clean":"2024-09-17T01:40:43.698705+0000","last_became_active":"2024-09-17T01:40:41.700738+0000","last_became_peered":"2024-09-17T01:40:41.700738+0000","last_unstale":"2024-09-17T01:40:43.698705+0000","last_undegraded":"2024-09-17T01:40:43.698705+0000","last_fullsized":"2024-09-17T01:40:43.698705+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:00.026492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.696032+0000","last_change":"2024-09-17T01:40:42.691235+0000","last_active":"2024-09-17T01:40:43.696032+0000","last_peered":"2024-09-17T01:40:43.696032+0000","last_clean":"2024-09-17T01:40:43.696032+0000","last_became_active":"2024-09-17T01:40:42.690876+0000","last_became_peered":"2024-09-17T01:40:42.690876+0000","last_unstale":"2024-09-17T01:40:43.696032+0000","last_undegraded":"2024-09-17T01:40:43.696032+0000","last_fullsized":"2024-09-17T01:40:43.696032+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:35.500477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.645735+0000","last_change":"2024-09-17T01:40:41.696154+0000","last_active":"2024-09-17T01:40:44.645735+0000","last_peered":"2024-09-17T01:40:44.645735+0000","last_clean":"2024-09-17T01:40:44.645735+0000","last_became_active":"2024-09-17T01:40:41.695805+0000","last_became_peered":"2024-09-17T01:40:41.695805+0000","last_unstale":"2024-09-17T01:40:44.645735+0000","last_undegraded":"2024-09-17T01:40:44.645735+0000","last_fullsized":"2024-09-17T01:40:44.645735+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:54.778570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.647053+0000","last_change":"2024-09-17T01:40:42.718019+0000","last_active":"2024-09-17T01:40:44.647053+0000","last_peered":"2024-09-17T01:40:44.647053+0000","last_clean":"2024-09-17T01:40:44.647053+0000","last_became_active":"2024-09-17T01:40:42.717464+0000","last_became_peered":"2024-09-17T01:40:42.717464+0000","last_unstale":"2024-09-17T01:40:44.647053+0000","last_undegraded":"2024-09-17T01:40:44.647053+0000","last_fullsized":"2024-09-17T01:40:44.647053+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:25.136223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.646721+0000","last_change":"2024-09-17T01:40:41.699047+0000","last_active":"2024-09-17T01:40:44.646721+0000","last_peered":"2024-09-17T01:40:44.646721+0000","last_clean":"2024-09-17T01:40:44.646721+0000","last_became_active":"2024-09-17T01:40:41.698628+0000","last_became_peered":"2024-09-17T01:40:41.698628+0000","last_unstale":"2024-09-17T01:40:44.646721+0000","last_undegraded":"2024-09-17T01:40:44.646721+0000","last_fullsized":"2024-09-17T01:40:44.646721+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:33.350692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.646363+0000","last_change":"2024-09-17T01:40:42.708158+0000","last_active":"2024-09-17T01:40:44.646363+0000","last_peered":"2024-09-17T01:40:44.646363+0000","last_clean":"2024-09-17T01:40:44.646363+0000","last_became_active":"2024-09-17T01:40:42.707852+0000","last_became_peered":"2024-09-17T01:40:42.707852+0000","last_unstale":"2024-09-17T01:40:44.646363+0000","last_undegraded":"2024-09-17T01:40:44.646363+0000","last_fullsized":"2024-09-17T01:40:44.646363+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:21.756525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.697486+0000","last_change":"2024-09-17T01:40:41.684531+0000","last_active":"2024-09-17T01:40:43.697486+0000","last_peered":"2024-09-17T01:40:43.697486+0000","last_clean":"2024-09-17T01:40:43.697486+0000","last_became_active":"2024-09-17T01:40:41.684098+0000","last_became_peered":"2024-09-17T01:40:41.684098+0000","last_unstale":"2024-09-17T01:40:43.697486+0000","last_undegraded":"2024-09-17T01:40:43.697486+0000","last_fullsized":"2024-09-17T01:40:43.697486+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:15.147011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-17T01:40:42.708998+0000","last_change":"2024-09-17T01:40:42.705317+0000","last_active":"2024-09-17T01:40:42.708998+0000","last_peered":"2024-09-17T01:40:42.708998+0000","last_clean":"2024-09-17T01:40:42.708998+0000","last_became_active":"2024-09-17T01:40:42.704608+0000","last_became_peered":"2024-09-17T01:40:42.704608+0000","last_unstale":"2024-09-17T01:40:42.708998+0000","last_undegraded":"2024-09-17T01:40:42.708998+0000","last_fullsized":"2024-09-17T01:40:42.708998+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:38:56.068272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-17T01:40:42.702001+0000","last_change":"2024-09-17T01:40:41.701829+0000","last_active":"2024-09-17T01:40:42.702001+0000","last_peered":"2024-09-17T01:40:42.702001+0000","last_clean":"2024-09-17T01:40:42.702001+0000","last_became_active":"2024-09-17T01:40:41.699430+0000","last_became_peered":"2024-09-17T01:40:41.699430+0000","last_unstale":"2024-09-17T01:40:42.702001+0000","last_undegraded":"2024-09-17T01:40:42.702001+0000","last_fullsized":"2024-09-17T01:40:42.702001+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:53.430429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.697522+0000","last_change":"2024-09-17T01:40:42.695054+0000","last_active":"2024-09-17T01:40:43.697522+0000","last_peered":"2024-09-17T01:40:43.697522+0000","last_clean":"2024-09-17T01:40:43.697522+0000","last_became_active":"2024-09-17T01:40:42.693693+0000","last_became_peered":"2024-09-17T01:40:42.693693+0000","last_unstale":"2024-09-17T01:40:43.697522+0000","last_undegraded":"2024-09-17T01:40:43.697522+0000","last_fullsized":"2024-09-17T01:40:43.697522+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:37.740182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:40:40.664217+0000","last_change":"2024-09-17T01:40:40.664217+0000","last_active":"2024-09-17T01:40:40.664217+0000","last_peered":"2024-09-17T01:40:40.664217+0000","last_clean":"2024-09-17T01:40:40.664217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:40:40.664217+0000","last_undegraded":"2024-09-17T01:40:40.664217+0000","last_fullsized":"2024-09-17T01:40:40.664217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":301,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.695977+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:40:43.695977+0000","last_peered":"2024-09-17T01:40:43.695977+0000","last_clean":"2024-09-17T01:40:43.695977+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:40:43.695977+0000","last_undegraded":"2024-09-17T01:40:43.695977+0000","last_fullsized":"2024-09-17T01:40:43.695977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":120,"acting":120,"num_store_stats":7},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":60,"acting":60,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476845,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54840,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317000,"statfs":{"total":96636764160,"available":96580608000,"internally_reserved":0,"allocated":1470464,"data_stored":641082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509549,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28532,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343308,"statfs":{"total":96636764160,"available":96607547392,"internally_reserved":0,"allocated":1540096,"data_stored":667985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509548,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54880,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316960,"statfs":{"total":96636764160,"available":96580567040,"internally_reserved":0,"allocated":1519616,"data_stored":666249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509549,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54900,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316940,"statfs":{"total":96636764160,"available":96580546560,"internally_reserved":0,"allocated":1536000,"data_stored":667951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509549,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54876,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316964,"statfs":{"total":96636764160,"available":96580571136,"internally_reserved":0,"allocated":1507328,"data_stored":659949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509548,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33256,"kb_used_data":2064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338584,"statfs":{"total":96636764160,"available":96602710016,"internally_reserved":0,"allocated":2113536,"data_stored":1256617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509550,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45148,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326692,"statfs":{"total":96636764160,"available":96590532608,"internally_reserved":0,"allocated":1515520,"data_stored":660601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":44693961},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542254,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55464,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316376,"statfs":{"total":96636764160,"available":96579969024,"internally_reserved":0,"allocated":2109440,"data_stored":1250409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:40:47.160 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:40:47.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.425+0000 7f260f800640 1 -- 172.21.15.42:0/908729086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f260806d430 msgr2=0x7f260806d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:47.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.425+0000 7f260f800640 1 --2- 172.21.15.42:0/908729086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f260806d430 0x7f260806d840 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f25f0005fd0 tx=0x7f25f002a5c0 comp rx=0 tx=0).stop 2024-09-17T01:40:47.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.425+0000 7f260f800640 1 -- 172.21.15.42:0/908729086 shutdown_connections 2024-09-17T01:40:47.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.425+0000 7f260f800640 1 --2- 172.21.15.42:0/908729086 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f260815f480 0x7f260815f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:47.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.425+0000 7f260f800640 1 --2- 172.21.15.42:0/908729086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f260806d430 0x7f260806d840 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:47.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.426+0000 7f260f800640 1 -- 172.21.15.42:0/908729086 >> 172.21.15.42:0/908729086 conn(0x7f26080b2930 msgr2=0x7f260806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:47.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.426+0000 7f260f800640 1 -- 172.21.15.42:0/908729086 shutdown_connections 2024-09-17T01:40:47.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.426+0000 7f260f800640 1 -- 172.21.15.42:0/908729086 wait complete. 2024-09-17T01:40:47.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.428+0000 7f260f800640 1 Processor -- start 2024-09-17T01:40:47.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.428+0000 7f260f800640 1 -- start start 2024-09-17T01:40:47.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.429+0000 7f260f800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f260806d430 0x7f26081f6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:47.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.429+0000 7f260f800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f260815cb80 0x7f26081556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:47.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.429+0000 7f260f800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f260815f480 0x7f260815e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:47.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.429+0000 7f260f800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2608073820 con 0x7f260815f480 2024-09-17T01:40:47.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.429+0000 7f260f800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f26080736a0 con 0x7f260806d430 2024-09-17T01:40:47.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.429+0000 7f260f800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f26080739a0 con 0x7f260815cb80 2024-09-17T01:40:47.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.430+0000 7f260d800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f260815f480 0x7f260815e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:47.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.430+0000 7f260d800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f260815f480 0x7f260815e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59818/0 (socket says 172.21.15.42:59818) 2024-09-17T01:40:47.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.430+0000 7f260d800640 1 -- 172.21.15.42:0/79460008 learned_addr learned my addr 172.21.15.42:0/79460008 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:47.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.430+0000 7f25ffe00640 1 --2- 172.21.15.42:0/79460008 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f260815cb80 0x7f26081556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:47.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.430+0000 7f260ce00640 1 --2- 172.21.15.42:0/79460008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f260806d430 0x7f26081f6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:47.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.430+0000 7f260d800640 1 -- 172.21.15.42:0/79460008 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f260815cb80 msgr2=0x7f26081556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:47.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.430+0000 7f260d800640 1 --2- 172.21.15.42:0/79460008 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f260815cb80 0x7f26081556c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:47.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.430+0000 7f260d800640 1 -- 172.21.15.42:0/79460008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f260806d430 msgr2=0x7f26081f6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:47.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.430+0000 7f260d800640 1 --2- 172.21.15.42:0/79460008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f260806d430 0x7f26081f6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:47.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.430+0000 7f260d800640 1 -- 172.21.15.42:0/79460008 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f260814e5e0 con 0x7f260815f480 2024-09-17T01:40:47.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.430+0000 7f260ce00640 1 --2- 172.21.15.42:0/79460008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f260806d430 0x7f26081f6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:40:47.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.431+0000 7f260d800640 1 --2- 172.21.15.42:0/79460008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f260815f480 0x7f260815e110 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f260000d660 tx=0x7f260000db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:47.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.431+0000 7f2605600640 1 -- 172.21.15.42:0/79460008 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2600017070 con 0x7f260815f480 2024-09-17T01:40:47.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.431+0000 7f2605600640 1 -- 172.21.15.42:0/79460008 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2600005310 con 0x7f260815f480 2024-09-17T01:40:47.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.431+0000 7f260f800640 1 -- 172.21.15.42:0/79460008 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f260814d060 con 0x7f260815f480 2024-09-17T01:40:47.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.431+0000 7f2605600640 1 -- 172.21.15.42:0/79460008 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2600009820 con 0x7f260815f480 2024-09-17T01:40:47.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.431+0000 7f260f800640 1 -- 172.21.15.42:0/79460008 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2608150c70 con 0x7f260815f480 2024-09-17T01:40:47.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.432+0000 7f260f800640 1 -- 172.21.15.42:0/79460008 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26081506e0 con 0x7f260815f480 2024-09-17T01:40:47.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.433+0000 7f2605600640 1 -- 172.21.15.42:0/79460008 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f26000099c0 con 0x7f260815f480 2024-09-17T01:40:47.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.435+0000 7f2605600640 1 --2- 172.21.15.42:0/79460008 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f25e4078bc0 0x7f25e407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:47.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.435+0000 7f2605600640 1 -- 172.21.15.42:0/79460008 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f260009ae40 con 0x7f260815f480 2024-09-17T01:40:47.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.435+0000 7f260ce00640 1 --2- 172.21.15.42:0/79460008 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f25e4078bc0 0x7f25e407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:47.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.436+0000 7f260ce00640 1 --2- 172.21.15.42:0/79460008 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f25e4078bc0 0x7f25e407b0d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f25f8001da0 tx=0x7f25f8009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:47.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.440+0000 7f2605600640 1 -- 172.21.15.42:0/79460008 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2600062b90 con 0x7f260815f480 2024-09-17T01:40:47.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.632+0000 7f260f800640 1 -- 172.21.15.42:0/79460008 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2608073ec0 con 0x7f25e4078bc0 2024-09-17T01:40:47.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.638+0000 7f2605600640 1 -- 172.21.15.42:0/79460008 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252465 (secure 0 0 0) 0x7f2608073ec0 con 0x7f25e4078bc0 2024-09-17T01:40:47.638 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:40:47.640 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:40:47.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.642+0000 7f260f800640 1 -- 172.21.15.42:0/79460008 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f25e4078bc0 msgr2=0x7f25e407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:47.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.642+0000 7f260f800640 1 --2- 172.21.15.42:0/79460008 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f25e4078bc0 0x7f25e407b0d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f25f8001da0 tx=0x7f25f8009040 comp rx=0 tx=0).stop 2024-09-17T01:40:47.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.642+0000 7f260f800640 1 -- 172.21.15.42:0/79460008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f260815f480 msgr2=0x7f260815e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:47.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.642+0000 7f260f800640 1 --2- 172.21.15.42:0/79460008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f260815f480 0x7f260815e110 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f260000d660 tx=0x7f260000db20 comp rx=0 tx=0).stop 2024-09-17T01:40:47.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.642+0000 7f260f800640 1 -- 172.21.15.42:0/79460008 shutdown_connections 2024-09-17T01:40:47.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.642+0000 7f260f800640 1 --2- 172.21.15.42:0/79460008 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f25e4078bc0 0x7f25e407b0d0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:47.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.642+0000 7f260f800640 1 --2- 172.21.15.42:0/79460008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f260815f480 0x7f260815e110 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:47.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.642+0000 7f260f800640 1 --2- 172.21.15.42:0/79460008 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f260815cb80 0x7f26081556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:47.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.642+0000 7f260f800640 1 --2- 172.21.15.42:0/79460008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f260806d430 0x7f26081f6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:47.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.642+0000 7f260f800640 1 -- 172.21.15.42:0/79460008 >> 172.21.15.42:0/79460008 conn(0x7f26080b2930 msgr2=0x7f260806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:47.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.642+0000 7f260f800640 1 -- 172.21.15.42:0/79460008 shutdown_connections 2024-09-17T01:40:47.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.642+0000 7f260f800640 1 -- 172.21.15.42:0/79460008 wait complete. 2024-09-17T01:40:47.661 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":383,"stamp":"2024-09-17T01:40:47.131462+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":381952,"kb_used_data":13060,"kb_used_omap":12,"kb_used_meta":368691,"kb_avail":754592768,"statfs":{"total":773094113280,"available":772702994432,"internally_reserved":0,"allocated":13373440,"data_stored":6496648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":377540148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.005569"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.699679+0000","last_change":"2024-09-17T01:40:42.707541+0000","last_active":"2024-09-17T01:40:43.699679+0000","last_peered":"2024-09-17T01:40:43.699679+0000","last_clean":"2024-09-17T01:40:43.699679+0000","last_became_active":"2024-09-17T01:40:42.704587+0000","last_became_peered":"2024-09-17T01:40:42.704587+0000","last_unstale":"2024-09-17T01:40:43.699679+0000","last_undegraded":"2024-09-17T01:40:43.699679+0000","last_fullsized":"2024-09-17T01:40:43.699679+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:42.964928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.647447+0000","last_change":"2024-09-17T01:40:42.703848+0000","last_active":"2024-09-17T01:40:44.647447+0000","last_peered":"2024-09-17T01:40:44.647447+0000","last_clean":"2024-09-17T01:40:44.647447+0000","last_became_active":"2024-09-17T01:40:42.703353+0000","last_became_peered":"2024-09-17T01:40:42.703353+0000","last_unstale":"2024-09-17T01:40:44.647447+0000","last_undegraded":"2024-09-17T01:40:44.647447+0000","last_fullsized":"2024-09-17T01:40:44.647447+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:47:47.588857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.695644+0000","last_change":"2024-09-17T01:40:42.689832+0000","last_active":"2024-09-17T01:40:43.695644+0000","last_peered":"2024-09-17T01:40:43.695644+0000","last_clean":"2024-09-17T01:40:43.695644+0000","last_became_active":"2024-09-17T01:40:42.689345+0000","last_became_peered":"2024-09-17T01:40:42.689345+0000","last_unstale":"2024-09-17T01:40:43.695644+0000","last_undegraded":"2024-09-17T01:40:43.695644+0000","last_fullsized":"2024-09-17T01:40:43.695644+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:54.040602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698475+0000","last_change":"2024-09-17T01:40:42.694412+0000","last_active":"2024-09-17T01:40:43.698475+0000","last_peered":"2024-09-17T01:40:43.698475+0000","last_clean":"2024-09-17T01:40:43.698475+0000","last_became_active":"2024-09-17T01:40:42.694064+0000","last_became_peered":"2024-09-17T01:40:42.694064+0000","last_unstale":"2024-09-17T01:40:43.698475+0000","last_undegraded":"2024-09-17T01:40:43.698475+0000","last_fullsized":"2024-09-17T01:40:43.698475+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:40.025832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972510+0000","last_change":"2024-09-17T01:40:42.715187+0000","last_active":"2024-09-17T01:40:43.972510+0000","last_peered":"2024-09-17T01:40:43.972510+0000","last_clean":"2024-09-17T01:40:43.972510+0000","last_became_active":"2024-09-17T01:40:42.714842+0000","last_became_peered":"2024-09-17T01:40:42.714842+0000","last_unstale":"2024-09-17T01:40:43.972510+0000","last_undegraded":"2024-09-17T01:40:43.972510+0000","last_fullsized":"2024-09-17T01:40:43.972510+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:11.100796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-17T01:40:42.713558+0000","last_change":"2024-09-17T01:40:42.705979+0000","last_active":"2024-09-17T01:40:42.713558+0000","last_peered":"2024-09-17T01:40:42.713558+0000","last_clean":"2024-09-17T01:40:42.713558+0000","last_became_active":"2024-09-17T01:40:42.705585+0000","last_became_peered":"2024-09-17T01:40:42.705585+0000","last_unstale":"2024-09-17T01:40:42.713558+0000","last_undegraded":"2024-09-17T01:40:42.713558+0000","last_fullsized":"2024-09-17T01:40:42.713558+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:48.224881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.645104+0000","last_change":"2024-09-17T01:40:42.705047+0000","last_active":"2024-09-17T01:40:44.645104+0000","last_peered":"2024-09-17T01:40:44.645104+0000","last_clean":"2024-09-17T01:40:44.645104+0000","last_became_active":"2024-09-17T01:40:42.704326+0000","last_became_peered":"2024-09-17T01:40:42.704326+0000","last_unstale":"2024-09-17T01:40:44.645104+0000","last_undegraded":"2024-09-17T01:40:44.645104+0000","last_fullsized":"2024-09-17T01:40:44.645104+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:48.819025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.645139+0000","last_change":"2024-09-17T01:40:42.704390+0000","last_active":"2024-09-17T01:40:44.645139+0000","last_peered":"2024-09-17T01:40:44.645139+0000","last_clean":"2024-09-17T01:40:44.645139+0000","last_became_active":"2024-09-17T01:40:42.704091+0000","last_became_peered":"2024-09-17T01:40:42.704091+0000","last_unstale":"2024-09-17T01:40:44.645139+0000","last_undegraded":"2024-09-17T01:40:44.645139+0000","last_fullsized":"2024-09-17T01:40:44.645139+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:42.581542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.699636+0000","last_change":"2024-09-17T01:40:42.694111+0000","last_active":"2024-09-17T01:40:43.699636+0000","last_peered":"2024-09-17T01:40:43.699636+0000","last_clean":"2024-09-17T01:40:43.699636+0000","last_became_active":"2024-09-17T01:40:42.692022+0000","last_became_peered":"2024-09-17T01:40:42.692022+0000","last_unstale":"2024-09-17T01:40:43.699636+0000","last_undegraded":"2024-09-17T01:40:43.699636+0000","last_fullsized":"2024-09-17T01:40:43.699636+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:01.170035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972671+0000","last_change":"2024-09-17T01:40:42.720181+0000","last_active":"2024-09-17T01:40:43.972671+0000","last_peered":"2024-09-17T01:40:43.972671+0000","last_clean":"2024-09-17T01:40:43.972671+0000","last_became_active":"2024-09-17T01:40:42.719827+0000","last_became_peered":"2024-09-17T01:40:42.719827+0000","last_unstale":"2024-09-17T01:40:43.972671+0000","last_undegraded":"2024-09-17T01:40:43.972671+0000","last_fullsized":"2024-09-17T01:40:43.972671+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:41:08.150710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.645972+0000","last_change":"2024-09-17T01:40:42.706434+0000","last_active":"2024-09-17T01:40:44.645972+0000","last_peered":"2024-09-17T01:40:44.645972+0000","last_clean":"2024-09-17T01:40:44.645972+0000","last_became_active":"2024-09-17T01:40:42.706126+0000","last_became_peered":"2024-09-17T01:40:42.706126+0000","last_unstale":"2024-09-17T01:40:44.645972+0000","last_undegraded":"2024-09-17T01:40:44.645972+0000","last_fullsized":"2024-09-17T01:40:44.645972+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:58.039332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972521+0000","last_change":"2024-09-17T01:40:42.712020+0000","last_active":"2024-09-17T01:40:43.972521+0000","last_peered":"2024-09-17T01:40:43.972521+0000","last_clean":"2024-09-17T01:40:43.972521+0000","last_became_active":"2024-09-17T01:40:42.711526+0000","last_became_peered":"2024-09-17T01:40:42.711526+0000","last_unstale":"2024-09-17T01:40:43.972521+0000","last_undegraded":"2024-09-17T01:40:43.972521+0000","last_fullsized":"2024-09-17T01:40:43.972521+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:25.250404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.647055+0000","last_change":"2024-09-17T01:40:42.696061+0000","last_active":"2024-09-17T01:40:44.647055+0000","last_peered":"2024-09-17T01:40:44.647055+0000","last_clean":"2024-09-17T01:40:44.647055+0000","last_became_active":"2024-09-17T01:40:42.694232+0000","last_became_peered":"2024-09-17T01:40:42.694232+0000","last_unstale":"2024-09-17T01:40:44.647055+0000","last_undegraded":"2024-09-17T01:40:44.647055+0000","last_fullsized":"2024-09-17T01:40:44.647055+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:10.699266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.646593+0000","last_change":"2024-09-17T01:40:42.719386+0000","last_active":"2024-09-17T01:40:44.646593+0000","last_peered":"2024-09-17T01:40:44.646593+0000","last_clean":"2024-09-17T01:40:44.646593+0000","last_became_active":"2024-09-17T01:40:42.716839+0000","last_became_peered":"2024-09-17T01:40:42.716839+0000","last_unstale":"2024-09-17T01:40:44.646593+0000","last_undegraded":"2024-09-17T01:40:44.646593+0000","last_fullsized":"2024-09-17T01:40:44.646593+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:15.656391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.697347+0000","last_change":"2024-09-17T01:40:42.699268+0000","last_active":"2024-09-17T01:40:43.697347+0000","last_peered":"2024-09-17T01:40:43.697347+0000","last_clean":"2024-09-17T01:40:43.697347+0000","last_became_active":"2024-09-17T01:40:42.696926+0000","last_became_peered":"2024-09-17T01:40:42.696926+0000","last_unstale":"2024-09-17T01:40:43.697347+0000","last_undegraded":"2024-09-17T01:40:43.697347+0000","last_fullsized":"2024-09-17T01:40:43.697347+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:24.106436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972109+0000","last_change":"2024-09-17T01:40:42.719010+0000","last_active":"2024-09-17T01:40:43.972109+0000","last_peered":"2024-09-17T01:40:43.972109+0000","last_clean":"2024-09-17T01:40:43.972109+0000","last_became_active":"2024-09-17T01:40:42.711723+0000","last_became_peered":"2024-09-17T01:40:42.711723+0000","last_unstale":"2024-09-17T01:40:43.972109+0000","last_undegraded":"2024-09-17T01:40:43.972109+0000","last_fullsized":"2024-09-17T01:40:43.972109+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:33:21.328797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.696009+0000","last_change":"2024-09-17T01:40:42.706576+0000","last_active":"2024-09-17T01:40:43.696009+0000","last_peered":"2024-09-17T01:40:43.696009+0000","last_clean":"2024-09-17T01:40:43.696009+0000","last_became_active":"2024-09-17T01:40:42.706274+0000","last_became_peered":"2024-09-17T01:40:42.706274+0000","last_unstale":"2024-09-17T01:40:43.696009+0000","last_undegraded":"2024-09-17T01:40:43.696009+0000","last_fullsized":"2024-09-17T01:40:43.696009+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:25.007459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.646036+0000","last_change":"2024-09-17T01:40:42.702175+0000","last_active":"2024-09-17T01:40:44.646036+0000","last_peered":"2024-09-17T01:40:44.646036+0000","last_clean":"2024-09-17T01:40:44.646036+0000","last_became_active":"2024-09-17T01:40:42.701895+0000","last_became_peered":"2024-09-17T01:40:42.701895+0000","last_unstale":"2024-09-17T01:40:44.646036+0000","last_undegraded":"2024-09-17T01:40:44.646036+0000","last_fullsized":"2024-09-17T01:40:44.646036+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:32.119945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.695904+0000","last_change":"2024-09-17T01:40:42.697493+0000","last_active":"2024-09-17T01:40:43.695904+0000","last_peered":"2024-09-17T01:40:43.695904+0000","last_clean":"2024-09-17T01:40:43.695904+0000","last_became_active":"2024-09-17T01:40:42.696669+0000","last_became_peered":"2024-09-17T01:40:42.696669+0000","last_unstale":"2024-09-17T01:40:43.695904+0000","last_undegraded":"2024-09-17T01:40:43.695904+0000","last_fullsized":"2024-09-17T01:40:43.695904+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:45:47.825308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.695653+0000","last_change":"2024-09-17T01:40:42.692941+0000","last_active":"2024-09-17T01:40:43.695653+0000","last_peered":"2024-09-17T01:40:43.695653+0000","last_clean":"2024-09-17T01:40:43.695653+0000","last_became_active":"2024-09-17T01:40:42.692579+0000","last_became_peered":"2024-09-17T01:40:42.692579+0000","last_unstale":"2024-09-17T01:40:43.695653+0000","last_undegraded":"2024-09-17T01:40:43.695653+0000","last_fullsized":"2024-09-17T01:40:43.695653+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:03.524959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.645870+0000","last_change":"2024-09-17T01:40:42.691862+0000","last_active":"2024-09-17T01:40:44.645870+0000","last_peered":"2024-09-17T01:40:44.645870+0000","last_clean":"2024-09-17T01:40:44.645870+0000","last_became_active":"2024-09-17T01:40:42.691549+0000","last_became_peered":"2024-09-17T01:40:42.691549+0000","last_unstale":"2024-09-17T01:40:44.645870+0000","last_undegraded":"2024-09-17T01:40:44.645870+0000","last_fullsized":"2024-09-17T01:40:44.645870+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:46.274606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-17T01:40:42.713530+0000","last_change":"2024-09-17T01:40:42.704308+0000","last_active":"2024-09-17T01:40:42.713530+0000","last_peered":"2024-09-17T01:40:42.713530+0000","last_clean":"2024-09-17T01:40:42.713530+0000","last_became_active":"2024-09-17T01:40:42.703882+0000","last_became_peered":"2024-09-17T01:40:42.703882+0000","last_unstale":"2024-09-17T01:40:42.713530+0000","last_undegraded":"2024-09-17T01:40:42.713530+0000","last_fullsized":"2024-09-17T01:40:42.713530+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:07.965288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.646577+0000","last_change":"2024-09-17T01:40:42.709177+0000","last_active":"2024-09-17T01:40:44.646577+0000","last_peered":"2024-09-17T01:40:44.646577+0000","last_clean":"2024-09-17T01:40:44.646577+0000","last_became_active":"2024-09-17T01:40:42.708880+0000","last_became_peered":"2024-09-17T01:40:42.708880+0000","last_unstale":"2024-09-17T01:40:44.646577+0000","last_undegraded":"2024-09-17T01:40:44.646577+0000","last_fullsized":"2024-09-17T01:40:44.646577+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:43.813042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.697016+0000","last_change":"2024-09-17T01:40:42.699236+0000","last_active":"2024-09-17T01:40:43.697016+0000","last_peered":"2024-09-17T01:40:43.697016+0000","last_clean":"2024-09-17T01:40:43.697016+0000","last_became_active":"2024-09-17T01:40:42.697521+0000","last_became_peered":"2024-09-17T01:40:42.697521+0000","last_unstale":"2024-09-17T01:40:43.697016+0000","last_undegraded":"2024-09-17T01:40:43.697016+0000","last_fullsized":"2024-09-17T01:40:43.697016+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:24.251436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.646191+0000","last_change":"2024-09-17T01:40:42.700538+0000","last_active":"2024-09-17T01:40:44.646191+0000","last_peered":"2024-09-17T01:40:44.646191+0000","last_clean":"2024-09-17T01:40:44.646191+0000","last_became_active":"2024-09-17T01:40:42.700224+0000","last_became_peered":"2024-09-17T01:40:42.700224+0000","last_unstale":"2024-09-17T01:40:44.646191+0000","last_undegraded":"2024-09-17T01:40:44.646191+0000","last_fullsized":"2024-09-17T01:40:44.646191+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:03.835717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-17T01:40:42.709692+0000","last_change":"2024-09-17T01:40:42.706260+0000","last_active":"2024-09-17T01:40:42.709692+0000","last_peered":"2024-09-17T01:40:42.709692+0000","last_clean":"2024-09-17T01:40:42.709692+0000","last_became_active":"2024-09-17T01:40:42.705934+0000","last_became_peered":"2024-09-17T01:40:42.705934+0000","last_unstale":"2024-09-17T01:40:42.709692+0000","last_undegraded":"2024-09-17T01:40:42.709692+0000","last_fullsized":"2024-09-17T01:40:42.709692+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:01.469650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698805+0000","last_change":"2024-09-17T01:40:42.703690+0000","last_active":"2024-09-17T01:40:43.698805+0000","last_peered":"2024-09-17T01:40:43.698805+0000","last_clean":"2024-09-17T01:40:43.698805+0000","last_became_active":"2024-09-17T01:40:42.703377+0000","last_became_peered":"2024-09-17T01:40:42.703377+0000","last_unstale":"2024-09-17T01:40:43.698805+0000","last_undegraded":"2024-09-17T01:40:43.698805+0000","last_fullsized":"2024-09-17T01:40:43.698805+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:54.818117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-17T01:40:42.719547+0000","last_change":"2024-09-17T01:40:42.717849+0000","last_active":"2024-09-17T01:40:42.719547+0000","last_peered":"2024-09-17T01:40:42.719547+0000","last_clean":"2024-09-17T01:40:42.719547+0000","last_became_active":"2024-09-17T01:40:42.717444+0000","last_became_peered":"2024-09-17T01:40:42.717444+0000","last_unstale":"2024-09-17T01:40:42.719547+0000","last_undegraded":"2024-09-17T01:40:42.719547+0000","last_fullsized":"2024-09-17T01:40:42.719547+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:23.772170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.646689+0000","last_change":"2024-09-17T01:40:42.715806+0000","last_active":"2024-09-17T01:40:44.646689+0000","last_peered":"2024-09-17T01:40:44.646689+0000","last_clean":"2024-09-17T01:40:44.646689+0000","last_became_active":"2024-09-17T01:40:42.715487+0000","last_became_peered":"2024-09-17T01:40:42.715487+0000","last_unstale":"2024-09-17T01:40:44.646689+0000","last_undegraded":"2024-09-17T01:40:44.646689+0000","last_fullsized":"2024-09-17T01:40:44.646689+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:05:09.245569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.645588+0000","last_change":"2024-09-17T01:40:42.716420+0000","last_active":"2024-09-17T01:40:44.645588+0000","last_peered":"2024-09-17T01:40:44.645588+0000","last_clean":"2024-09-17T01:40:44.645588+0000","last_became_active":"2024-09-17T01:40:42.714208+0000","last_became_peered":"2024-09-17T01:40:42.714208+0000","last_unstale":"2024-09-17T01:40:44.645588+0000","last_undegraded":"2024-09-17T01:40:44.645588+0000","last_fullsized":"2024-09-17T01:40:44.645588+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:28.800536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.697515+0000","last_change":"2024-09-17T01:40:42.705506+0000","last_active":"2024-09-17T01:40:43.697515+0000","last_peered":"2024-09-17T01:40:43.697515+0000","last_clean":"2024-09-17T01:40:43.697515+0000","last_became_active":"2024-09-17T01:40:42.702174+0000","last_became_peered":"2024-09-17T01:40:42.702174+0000","last_unstale":"2024-09-17T01:40:43.697515+0000","last_undegraded":"2024-09-17T01:40:43.697515+0000","last_fullsized":"2024-09-17T01:40:43.697515+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:53.007630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972224+0000","last_change":"2024-09-17T01:40:42.715974+0000","last_active":"2024-09-17T01:40:43.972224+0000","last_peered":"2024-09-17T01:40:43.972224+0000","last_clean":"2024-09-17T01:40:43.972224+0000","last_became_active":"2024-09-17T01:40:42.715636+0000","last_became_peered":"2024-09-17T01:40:42.715636+0000","last_unstale":"2024-09-17T01:40:43.972224+0000","last_undegraded":"2024-09-17T01:40:43.972224+0000","last_fullsized":"2024-09-17T01:40:43.972224+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:02.975781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.699725+0000","last_change":"2024-09-17T01:40:42.700156+0000","last_active":"2024-09-17T01:40:43.699725+0000","last_peered":"2024-09-17T01:40:43.699725+0000","last_clean":"2024-09-17T01:40:43.699725+0000","last_became_active":"2024-09-17T01:40:42.696645+0000","last_became_peered":"2024-09-17T01:40:42.696645+0000","last_unstale":"2024-09-17T01:40:43.699725+0000","last_undegraded":"2024-09-17T01:40:43.699725+0000","last_fullsized":"2024-09-17T01:40:43.699725+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:43.815301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"122'4","reported_seq":19,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.647426+0000","last_change":"2024-09-17T01:40:41.694059+0000","last_active":"2024-09-17T01:40:44.647426+0000","last_peered":"2024-09-17T01:40:44.647426+0000","last_clean":"2024-09-17T01:40:44.647426+0000","last_became_active":"2024-09-17T01:40:41.693174+0000","last_became_peered":"2024-09-17T01:40:41.693174+0000","last_unstale":"2024-09-17T01:40:44.647426+0000","last_undegraded":"2024-09-17T01:40:44.647426+0000","last_fullsized":"2024-09-17T01:40:44.647426+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:42.325749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.647345+0000","last_change":"2024-09-17T01:40:42.713941+0000","last_active":"2024-09-17T01:40:44.647345+0000","last_peered":"2024-09-17T01:40:44.647345+0000","last_clean":"2024-09-17T01:40:44.647345+0000","last_became_active":"2024-09-17T01:40:42.712810+0000","last_became_peered":"2024-09-17T01:40:42.712810+0000","last_unstale":"2024-09-17T01:40:44.647345+0000","last_undegraded":"2024-09-17T01:40:44.647345+0000","last_fullsized":"2024-09-17T01:40:44.647345+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:00.676856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"122'1","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.647584+0000","last_change":"2024-09-17T01:40:41.693363+0000","last_active":"2024-09-17T01:40:44.647584+0000","last_peered":"2024-09-17T01:40:44.647584+0000","last_clean":"2024-09-17T01:40:44.647584+0000","last_became_active":"2024-09-17T01:40:41.692471+0000","last_became_peered":"2024-09-17T01:40:41.692471+0000","last_unstale":"2024-09-17T01:40:44.647584+0000","last_undegraded":"2024-09-17T01:40:44.647584+0000","last_fullsized":"2024-09-17T01:40:44.647584+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:42.914723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-17T01:40:42.718091+0000","last_change":"2024-09-17T01:40:42.712533+0000","last_active":"2024-09-17T01:40:42.718091+0000","last_peered":"2024-09-17T01:40:42.718091+0000","last_clean":"2024-09-17T01:40:42.718091+0000","last_became_active":"2024-09-17T01:40:42.709095+0000","last_became_peered":"2024-09-17T01:40:42.709095+0000","last_unstale":"2024-09-17T01:40:42.718091+0000","last_undegraded":"2024-09-17T01:40:42.718091+0000","last_fullsized":"2024-09-17T01:40:42.718091+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:50:08.598915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"122'2","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698575+0000","last_change":"2024-09-17T01:40:41.697633+0000","last_active":"2024-09-17T01:40:43.698575+0000","last_peered":"2024-09-17T01:40:43.698575+0000","last_clean":"2024-09-17T01:40:43.698575+0000","last_became_active":"2024-09-17T01:40:41.697313+0000","last_became_peered":"2024-09-17T01:40:41.697313+0000","last_unstale":"2024-09-17T01:40:43.698575+0000","last_undegraded":"2024-09-17T01:40:43.698575+0000","last_fullsized":"2024-09-17T01:40:43.698575+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:49.053395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.695898+0000","last_change":"2024-09-17T01:40:42.696980+0000","last_active":"2024-09-17T01:40:43.695898+0000","last_peered":"2024-09-17T01:40:43.695898+0000","last_clean":"2024-09-17T01:40:43.695898+0000","last_became_active":"2024-09-17T01:40:42.696227+0000","last_became_peered":"2024-09-17T01:40:42.696227+0000","last_unstale":"2024-09-17T01:40:43.695898+0000","last_undegraded":"2024-09-17T01:40:43.695898+0000","last_fullsized":"2024-09-17T01:40:43.695898+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:22:54.218478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"122'2","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698248+0000","last_change":"2024-09-17T01:40:41.697793+0000","last_active":"2024-09-17T01:40:43.698248+0000","last_peered":"2024-09-17T01:40:43.698248+0000","last_clean":"2024-09-17T01:40:43.698248+0000","last_became_active":"2024-09-17T01:40:41.697299+0000","last_became_peered":"2024-09-17T01:40:41.697299+0000","last_unstale":"2024-09-17T01:40:43.698248+0000","last_undegraded":"2024-09-17T01:40:43.698248+0000","last_fullsized":"2024-09-17T01:40:43.698248+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:03.621376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698336+0000","last_change":"2024-09-17T01:40:42.704223+0000","last_active":"2024-09-17T01:40:43.698336+0000","last_peered":"2024-09-17T01:40:43.698336+0000","last_clean":"2024-09-17T01:40:43.698336+0000","last_became_active":"2024-09-17T01:40:42.701012+0000","last_became_peered":"2024-09-17T01:40:42.701012+0000","last_unstale":"2024-09-17T01:40:43.698336+0000","last_undegraded":"2024-09-17T01:40:43.698336+0000","last_fullsized":"2024-09-17T01:40:43.698336+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:17.085705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1b","version":"122'1","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.695525+0000","last_change":"2024-09-17T01:40:41.696033+0000","last_active":"2024-09-17T01:40:43.695525+0000","last_peered":"2024-09-17T01:40:43.695525+0000","last_clean":"2024-09-17T01:40:43.695525+0000","last_became_active":"2024-09-17T01:40:41.695706+0000","last_became_peered":"2024-09-17T01:40:41.695706+0000","last_unstale":"2024-09-17T01:40:43.695525+0000","last_undegraded":"2024-09-17T01:40:43.695525+0000","last_fullsized":"2024-09-17T01:40:43.695525+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:49:36.729485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.645596+0000","last_change":"2024-09-17T01:40:42.702262+0000","last_active":"2024-09-17T01:40:44.645596+0000","last_peered":"2024-09-17T01:40:44.645596+0000","last_clean":"2024-09-17T01:40:44.645596+0000","last_became_active":"2024-09-17T01:40:42.701951+0000","last_became_peered":"2024-09-17T01:40:42.701951+0000","last_unstale":"2024-09-17T01:40:44.645596+0000","last_undegraded":"2024-09-17T01:40:44.645596+0000","last_fullsized":"2024-09-17T01:40:44.645596+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:47.427751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1a","version":"122'1","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698704+0000","last_change":"2024-09-17T01:40:41.693661+0000","last_active":"2024-09-17T01:40:43.698704+0000","last_peered":"2024-09-17T01:40:43.698704+0000","last_clean":"2024-09-17T01:40:43.698704+0000","last_became_active":"2024-09-17T01:40:41.693329+0000","last_became_peered":"2024-09-17T01:40:41.693329+0000","last_unstale":"2024-09-17T01:40:43.698704+0000","last_undegraded":"2024-09-17T01:40:43.698704+0000","last_fullsized":"2024-09-17T01:40:43.698704+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:19.729596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972485+0000","last_change":"2024-09-17T01:40:42.715102+0000","last_active":"2024-09-17T01:40:43.972485+0000","last_peered":"2024-09-17T01:40:43.972485+0000","last_clean":"2024-09-17T01:40:43.972485+0000","last_became_active":"2024-09-17T01:40:42.712177+0000","last_became_peered":"2024-09-17T01:40:42.712177+0000","last_unstale":"2024-09-17T01:40:43.972485+0000","last_undegraded":"2024-09-17T01:40:43.972485+0000","last_fullsized":"2024-09-17T01:40:43.972485+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:55.899108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.645241+0000","last_change":"2024-09-17T01:40:41.695517+0000","last_active":"2024-09-17T01:40:44.645241+0000","last_peered":"2024-09-17T01:40:44.645241+0000","last_clean":"2024-09-17T01:40:44.645241+0000","last_became_active":"2024-09-17T01:40:41.695207+0000","last_became_peered":"2024-09-17T01:40:41.695207+0000","last_unstale":"2024-09-17T01:40:44.645241+0000","last_undegraded":"2024-09-17T01:40:44.645241+0000","last_fullsized":"2024-09-17T01:40:44.645241+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:59.565790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.645128+0000","last_change":"2024-09-17T01:40:42.704687+0000","last_active":"2024-09-17T01:40:44.645128+0000","last_peered":"2024-09-17T01:40:44.645128+0000","last_clean":"2024-09-17T01:40:44.645128+0000","last_became_active":"2024-09-17T01:40:42.702637+0000","last_became_peered":"2024-09-17T01:40:42.702637+0000","last_unstale":"2024-09-17T01:40:44.645128+0000","last_undegraded":"2024-09-17T01:40:44.645128+0000","last_fullsized":"2024-09-17T01:40:44.645128+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:50.151027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972589+0000","last_change":"2024-09-17T01:40:41.705210+0000","last_active":"2024-09-17T01:40:43.972589+0000","last_peered":"2024-09-17T01:40:43.972589+0000","last_clean":"2024-09-17T01:40:43.972589+0000","last_became_active":"2024-09-17T01:40:41.704220+0000","last_became_peered":"2024-09-17T01:40:41.704220+0000","last_unstale":"2024-09-17T01:40:43.972589+0000","last_undegraded":"2024-09-17T01:40:43.972589+0000","last_fullsized":"2024-09-17T01:40:43.972589+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:06.932278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.647636+0000","last_change":"2024-09-17T01:40:42.710068+0000","last_active":"2024-09-17T01:40:44.647636+0000","last_peered":"2024-09-17T01:40:44.647636+0000","last_clean":"2024-09-17T01:40:44.647636+0000","last_became_active":"2024-09-17T01:40:42.709744+0000","last_became_peered":"2024-09-17T01:40:42.709744+0000","last_unstale":"2024-09-17T01:40:44.647636+0000","last_undegraded":"2024-09-17T01:40:44.647636+0000","last_fullsized":"2024-09-17T01:40:44.647636+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:09.344273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698822+0000","last_change":"2024-09-17T01:40:41.698677+0000","last_active":"2024-09-17T01:40:43.698822+0000","last_peered":"2024-09-17T01:40:43.698822+0000","last_clean":"2024-09-17T01:40:43.698822+0000","last_became_active":"2024-09-17T01:40:41.698349+0000","last_became_peered":"2024-09-17T01:40:41.698349+0000","last_unstale":"2024-09-17T01:40:43.698822+0000","last_undegraded":"2024-09-17T01:40:43.698822+0000","last_fullsized":"2024-09-17T01:40:43.698822+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:47.607030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.647923+0000","last_change":"2024-09-17T01:40:42.720059+0000","last_active":"2024-09-17T01:40:44.647923+0000","last_peered":"2024-09-17T01:40:44.647923+0000","last_clean":"2024-09-17T01:40:44.647923+0000","last_became_active":"2024-09-17T01:40:42.719235+0000","last_became_peered":"2024-09-17T01:40:42.719235+0000","last_unstale":"2024-09-17T01:40:44.647923+0000","last_undegraded":"2024-09-17T01:40:44.647923+0000","last_fullsized":"2024-09-17T01:40:44.647923+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:33.811176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972756+0000","last_change":"2024-09-17T01:40:41.706511+0000","last_active":"2024-09-17T01:40:43.972756+0000","last_peered":"2024-09-17T01:40:43.972756+0000","last_clean":"2024-09-17T01:40:43.972756+0000","last_became_active":"2024-09-17T01:40:41.706037+0000","last_became_peered":"2024-09-17T01:40:41.706037+0000","last_unstale":"2024-09-17T01:40:43.972756+0000","last_undegraded":"2024-09-17T01:40:43.972756+0000","last_fullsized":"2024-09-17T01:40:43.972756+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:33.587543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-17T01:40:42.716413+0000","last_change":"2024-09-17T01:40:42.709616+0000","last_active":"2024-09-17T01:40:42.716413+0000","last_peered":"2024-09-17T01:40:42.716413+0000","last_clean":"2024-09-17T01:40:42.716413+0000","last_became_active":"2024-09-17T01:40:42.709040+0000","last_became_peered":"2024-09-17T01:40:42.709040+0000","last_unstale":"2024-09-17T01:40:42.716413+0000","last_undegraded":"2024-09-17T01:40:42.716413+0000","last_fullsized":"2024-09-17T01:40:42.716413+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:31.768713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"122'3","reported_seq":18,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972523+0000","last_change":"2024-09-17T01:40:41.707409+0000","last_active":"2024-09-17T01:40:43.972523+0000","last_peered":"2024-09-17T01:40:43.972523+0000","last_clean":"2024-09-17T01:40:43.972523+0000","last_became_active":"2024-09-17T01:40:41.707050+0000","last_became_peered":"2024-09-17T01:40:41.707050+0000","last_unstale":"2024-09-17T01:40:43.972523+0000","last_undegraded":"2024-09-17T01:40:43.972523+0000","last_fullsized":"2024-09-17T01:40:43.972523+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:17.906320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.646226+0000","last_change":"2024-09-17T01:40:42.697021+0000","last_active":"2024-09-17T01:40:44.646226+0000","last_peered":"2024-09-17T01:40:44.646226+0000","last_clean":"2024-09-17T01:40:44.646226+0000","last_became_active":"2024-09-17T01:40:42.695234+0000","last_became_peered":"2024-09-17T01:40:42.695234+0000","last_unstale":"2024-09-17T01:40:44.646226+0000","last_undegraded":"2024-09-17T01:40:44.646226+0000","last_fullsized":"2024-09-17T01:40:44.646226+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:48.160716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"122'6","reported_seq":21,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698477+0000","last_change":"2024-09-17T01:40:41.698568+0000","last_active":"2024-09-17T01:40:43.698477+0000","last_peered":"2024-09-17T01:40:43.698477+0000","last_clean":"2024-09-17T01:40:43.698477+0000","last_became_active":"2024-09-17T01:40:41.698215+0000","last_became_peered":"2024-09-17T01:40:41.698215+0000","last_unstale":"2024-09-17T01:40:43.698477+0000","last_undegraded":"2024-09-17T01:40:43.698477+0000","last_fullsized":"2024-09-17T01:40:43.698477+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:48.581141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972227+0000","last_change":"2024-09-17T01:40:42.712673+0000","last_active":"2024-09-17T01:40:43.972227+0000","last_peered":"2024-09-17T01:40:43.972227+0000","last_clean":"2024-09-17T01:40:43.972227+0000","last_became_active":"2024-09-17T01:40:42.711340+0000","last_became_peered":"2024-09-17T01:40:42.711340+0000","last_unstale":"2024-09-17T01:40:43.972227+0000","last_undegraded":"2024-09-17T01:40:43.972227+0000","last_fullsized":"2024-09-17T01:40:43.972227+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:03.651513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"122'2","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972215+0000","last_change":"2024-09-17T01:40:41.705213+0000","last_active":"2024-09-17T01:40:43.972215+0000","last_peered":"2024-09-17T01:40:43.972215+0000","last_clean":"2024-09-17T01:40:43.972215+0000","last_became_active":"2024-09-17T01:40:41.704824+0000","last_became_peered":"2024-09-17T01:40:41.704824+0000","last_unstale":"2024-09-17T01:40:43.972215+0000","last_undegraded":"2024-09-17T01:40:43.972215+0000","last_fullsized":"2024-09-17T01:40:43.972215+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:05:18.664353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698083+0000","last_change":"2024-09-17T01:40:42.713081+0000","last_active":"2024-09-17T01:40:43.698083+0000","last_peered":"2024-09-17T01:40:43.698083+0000","last_clean":"2024-09-17T01:40:43.698083+0000","last_became_active":"2024-09-17T01:40:42.712732+0000","last_became_peered":"2024-09-17T01:40:42.712732+0000","last_unstale":"2024-09-17T01:40:43.698083+0000","last_undegraded":"2024-09-17T01:40:43.698083+0000","last_fullsized":"2024-09-17T01:40:43.698083+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:18.932988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.695813+0000","last_change":"2024-09-17T01:40:41.690396+0000","last_active":"2024-09-17T01:40:43.695813+0000","last_peered":"2024-09-17T01:40:43.695813+0000","last_clean":"2024-09-17T01:40:43.695813+0000","last_became_active":"2024-09-17T01:40:41.687942+0000","last_became_peered":"2024-09-17T01:40:41.687942+0000","last_unstale":"2024-09-17T01:40:43.695813+0000","last_undegraded":"2024-09-17T01:40:43.695813+0000","last_fullsized":"2024-09-17T01:40:43.695813+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:18.857259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698223+0000","last_change":"2024-09-17T01:40:42.705265+0000","last_active":"2024-09-17T01:40:43.698223+0000","last_peered":"2024-09-17T01:40:43.698223+0000","last_clean":"2024-09-17T01:40:43.698223+0000","last_became_active":"2024-09-17T01:40:42.704953+0000","last_became_peered":"2024-09-17T01:40:42.704953+0000","last_unstale":"2024-09-17T01:40:43.698223+0000","last_undegraded":"2024-09-17T01:40:43.698223+0000","last_fullsized":"2024-09-17T01:40:43.698223+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:16.839703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"122'8","reported_seq":23,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.697136+0000","last_change":"2024-09-17T01:40:41.685804+0000","last_active":"2024-09-17T01:40:43.697136+0000","last_peered":"2024-09-17T01:40:43.697136+0000","last_clean":"2024-09-17T01:40:43.697136+0000","last_became_active":"2024-09-17T01:40:41.685290+0000","last_became_peered":"2024-09-17T01:40:41.685290+0000","last_unstale":"2024-09-17T01:40:43.697136+0000","last_undegraded":"2024-09-17T01:40:43.697136+0000","last_fullsized":"2024-09-17T01:40:43.697136+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:13.617766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.699825+0000","last_change":"2024-09-17T01:40:42.707423+0000","last_active":"2024-09-17T01:40:43.699825+0000","last_peered":"2024-09-17T01:40:43.699825+0000","last_clean":"2024-09-17T01:40:43.699825+0000","last_became_active":"2024-09-17T01:40:42.706873+0000","last_became_peered":"2024-09-17T01:40:42.706873+0000","last_unstale":"2024-09-17T01:40:43.699825+0000","last_undegraded":"2024-09-17T01:40:43.699825+0000","last_fullsized":"2024-09-17T01:40:43.699825+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:41.066398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.f","version":"122'1","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-17T01:40:42.719519+0000","last_change":"2024-09-17T01:40:41.700037+0000","last_active":"2024-09-17T01:40:42.719519+0000","last_peered":"2024-09-17T01:40:42.719519+0000","last_clean":"2024-09-17T01:40:42.719519+0000","last_became_active":"2024-09-17T01:40:41.699658+0000","last_became_peered":"2024-09-17T01:40:41.699658+0000","last_unstale":"2024-09-17T01:40:42.719519+0000","last_undegraded":"2024-09-17T01:40:42.719519+0000","last_fullsized":"2024-09-17T01:40:42.719519+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:01.815446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.699939+0000","last_change":"2024-09-17T01:40:42.690810+0000","last_active":"2024-09-17T01:40:43.699939+0000","last_peered":"2024-09-17T01:40:43.699939+0000","last_clean":"2024-09-17T01:40:43.699939+0000","last_became_active":"2024-09-17T01:40:42.690435+0000","last_became_peered":"2024-09-17T01:40:42.690435+0000","last_unstale":"2024-09-17T01:40:43.699939+0000","last_undegraded":"2024-09-17T01:40:43.699939+0000","last_fullsized":"2024-09-17T01:40:43.699939+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:30.023137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"122'2","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972793+0000","last_change":"2024-09-17T01:40:41.706556+0000","last_active":"2024-09-17T01:40:43.972793+0000","last_peered":"2024-09-17T01:40:43.972793+0000","last_clean":"2024-09-17T01:40:43.972793+0000","last_became_active":"2024-09-17T01:40:41.706058+0000","last_became_peered":"2024-09-17T01:40:41.706058+0000","last_unstale":"2024-09-17T01:40:43.972793+0000","last_undegraded":"2024-09-17T01:40:43.972793+0000","last_fullsized":"2024-09-17T01:40:43.972793+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:59.246094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.645898+0000","last_change":"2024-09-17T01:40:42.696435+0000","last_active":"2024-09-17T01:40:44.645898+0000","last_peered":"2024-09-17T01:40:44.645898+0000","last_clean":"2024-09-17T01:40:44.645898+0000","last_became_active":"2024-09-17T01:40:42.695650+0000","last_became_peered":"2024-09-17T01:40:42.695650+0000","last_unstale":"2024-09-17T01:40:44.645898+0000","last_undegraded":"2024-09-17T01:40:44.645898+0000","last_fullsized":"2024-09-17T01:40:44.645898+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:57:56.110079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.d","version":"122'1","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.647349+0000","last_change":"2024-09-17T01:40:41.701173+0000","last_active":"2024-09-17T01:40:44.647349+0000","last_peered":"2024-09-17T01:40:44.647349+0000","last_clean":"2024-09-17T01:40:44.647349+0000","last_became_active":"2024-09-17T01:40:41.700834+0000","last_became_peered":"2024-09-17T01:40:41.700834+0000","last_unstale":"2024-09-17T01:40:44.647349+0000","last_undegraded":"2024-09-17T01:40:44.647349+0000","last_fullsized":"2024-09-17T01:40:44.647349+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:00:56.405963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.647206+0000","last_change":"2024-09-17T01:40:42.707255+0000","last_active":"2024-09-17T01:40:44.647206+0000","last_peered":"2024-09-17T01:40:44.647206+0000","last_clean":"2024-09-17T01:40:44.647206+0000","last_became_active":"2024-09-17T01:40:42.706848+0000","last_became_peered":"2024-09-17T01:40:42.706848+0000","last_unstale":"2024-09-17T01:40:44.647206+0000","last_undegraded":"2024-09-17T01:40:44.647206+0000","last_fullsized":"2024-09-17T01:40:44.647206+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:14.513860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.646959+0000","last_change":"2024-09-17T01:40:41.703695+0000","last_active":"2024-09-17T01:40:44.646959+0000","last_peered":"2024-09-17T01:40:44.646959+0000","last_clean":"2024-09-17T01:40:44.646959+0000","last_became_active":"2024-09-17T01:40:41.703357+0000","last_became_peered":"2024-09-17T01:40:41.703357+0000","last_unstale":"2024-09-17T01:40:44.646959+0000","last_undegraded":"2024-09-17T01:40:44.646959+0000","last_fullsized":"2024-09-17T01:40:44.646959+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:23:54.489115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.695632+0000","last_change":"2024-09-17T01:40:42.704712+0000","last_active":"2024-09-17T01:40:43.695632+0000","last_peered":"2024-09-17T01:40:43.695632+0000","last_clean":"2024-09-17T01:40:43.695632+0000","last_became_active":"2024-09-17T01:40:42.703540+0000","last_became_peered":"2024-09-17T01:40:42.703540+0000","last_unstale":"2024-09-17T01:40:43.695632+0000","last_undegraded":"2024-09-17T01:40:43.695632+0000","last_fullsized":"2024-09-17T01:40:43.695632+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:47.366939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"122'2","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972394+0000","last_change":"2024-09-17T01:40:41.706619+0000","last_active":"2024-09-17T01:40:43.972394+0000","last_peered":"2024-09-17T01:40:43.972394+0000","last_clean":"2024-09-17T01:40:43.972394+0000","last_became_active":"2024-09-17T01:40:41.706129+0000","last_became_peered":"2024-09-17T01:40:41.706129+0000","last_unstale":"2024-09-17T01:40:43.972394+0000","last_undegraded":"2024-09-17T01:40:43.972394+0000","last_fullsized":"2024-09-17T01:40:43.972394+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:24:46.906855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.699255+0000","last_change":"2024-09-17T01:40:42.702378+0000","last_active":"2024-09-17T01:40:43.699255+0000","last_peered":"2024-09-17T01:40:43.699255+0000","last_clean":"2024-09-17T01:40:43.699255+0000","last_became_active":"2024-09-17T01:40:42.701908+0000","last_became_peered":"2024-09-17T01:40:42.701908+0000","last_unstale":"2024-09-17T01:40:43.699255+0000","last_undegraded":"2024-09-17T01:40:43.699255+0000","last_fullsized":"2024-09-17T01:40:43.699255+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:09.126262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698848+0000","last_change":"2024-09-17T01:40:41.696146+0000","last_active":"2024-09-17T01:40:43.698848+0000","last_peered":"2024-09-17T01:40:43.698848+0000","last_clean":"2024-09-17T01:40:43.698848+0000","last_became_active":"2024-09-17T01:40:41.695820+0000","last_became_peered":"2024-09-17T01:40:41.695820+0000","last_unstale":"2024-09-17T01:40:43.698848+0000","last_undegraded":"2024-09-17T01:40:43.698848+0000","last_fullsized":"2024-09-17T01:40:43.698848+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:37.538831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.646044+0000","last_change":"2024-09-17T01:40:42.708939+0000","last_active":"2024-09-17T01:40:44.646044+0000","last_peered":"2024-09-17T01:40:44.646044+0000","last_clean":"2024-09-17T01:40:44.646044+0000","last_became_active":"2024-09-17T01:40:42.708614+0000","last_became_peered":"2024-09-17T01:40:42.708614+0000","last_unstale":"2024-09-17T01:40:44.646044+0000","last_undegraded":"2024-09-17T01:40:44.646044+0000","last_fullsized":"2024-09-17T01:40:44.646044+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:31.698774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698365+0000","last_change":"2024-09-17T01:40:41.690934+0000","last_active":"2024-09-17T01:40:43.698365+0000","last_peered":"2024-09-17T01:40:43.698365+0000","last_clean":"2024-09-17T01:40:43.698365+0000","last_became_active":"2024-09-17T01:40:41.690541+0000","last_became_peered":"2024-09-17T01:40:41.690541+0000","last_unstale":"2024-09-17T01:40:43.698365+0000","last_undegraded":"2024-09-17T01:40:43.698365+0000","last_fullsized":"2024-09-17T01:40:43.698365+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:04.569466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.972054+0000","last_change":"2024-09-17T01:40:42.714135+0000","last_active":"2024-09-17T01:40:43.972054+0000","last_peered":"2024-09-17T01:40:43.972054+0000","last_clean":"2024-09-17T01:40:43.972054+0000","last_became_active":"2024-09-17T01:40:42.699799+0000","last_became_peered":"2024-09-17T01:40:42.699799+0000","last_unstale":"2024-09-17T01:40:43.972054+0000","last_undegraded":"2024-09-17T01:40:43.972054+0000","last_fullsized":"2024-09-17T01:40:43.972054+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:36.469697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.697425+0000","last_change":"2024-09-17T01:40:41.686422+0000","last_active":"2024-09-17T01:40:43.697425+0000","last_peered":"2024-09-17T01:40:43.697425+0000","last_clean":"2024-09-17T01:40:43.697425+0000","last_became_active":"2024-09-17T01:40:41.685486+0000","last_became_peered":"2024-09-17T01:40:41.685486+0000","last_unstale":"2024-09-17T01:40:43.697425+0000","last_undegraded":"2024-09-17T01:40:43.697425+0000","last_fullsized":"2024-09-17T01:40:43.697425+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:28.356942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.647176+0000","last_change":"2024-09-17T01:40:42.714271+0000","last_active":"2024-09-17T01:40:44.647176+0000","last_peered":"2024-09-17T01:40:44.647176+0000","last_clean":"2024-09-17T01:40:44.647176+0000","last_became_active":"2024-09-17T01:40:42.713978+0000","last_became_peered":"2024-09-17T01:40:42.713978+0000","last_unstale":"2024-09-17T01:40:44.647176+0000","last_undegraded":"2024-09-17T01:40:44.647176+0000","last_fullsized":"2024-09-17T01:40:44.647176+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:53.382523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"122'2","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698883+0000","last_change":"2024-09-17T01:40:41.699499+0000","last_active":"2024-09-17T01:40:43.698883+0000","last_peered":"2024-09-17T01:40:43.698883+0000","last_clean":"2024-09-17T01:40:43.698883+0000","last_became_active":"2024-09-17T01:40:41.698934+0000","last_became_peered":"2024-09-17T01:40:41.698934+0000","last_unstale":"2024-09-17T01:40:43.698883+0000","last_undegraded":"2024-09-17T01:40:43.698883+0000","last_fullsized":"2024-09-17T01:40:43.698883+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:17.982542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-17T01:40:42.718730+0000","last_change":"2024-09-17T01:40:42.714262+0000","last_active":"2024-09-17T01:40:42.718730+0000","last_peered":"2024-09-17T01:40:42.718730+0000","last_clean":"2024-09-17T01:40:42.718730+0000","last_became_active":"2024-09-17T01:40:42.713542+0000","last_became_peered":"2024-09-17T01:40:42.713542+0000","last_unstale":"2024-09-17T01:40:42.718730+0000","last_undegraded":"2024-09-17T01:40:42.718730+0000","last_fullsized":"2024-09-17T01:40:42.718730+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:02:44.152722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.645942+0000","last_change":"2024-09-17T01:40:41.693992+0000","last_active":"2024-09-17T01:40:44.645942+0000","last_peered":"2024-09-17T01:40:44.645942+0000","last_clean":"2024-09-17T01:40:44.645942+0000","last_became_active":"2024-09-17T01:40:41.693122+0000","last_became_peered":"2024-09-17T01:40:41.693122+0000","last_unstale":"2024-09-17T01:40:44.645942+0000","last_undegraded":"2024-09-17T01:40:44.645942+0000","last_fullsized":"2024-09-17T01:40:44.645942+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:26.883211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.699507+0000","last_change":"2024-09-17T01:40:42.698929+0000","last_active":"2024-09-17T01:40:43.699507+0000","last_peered":"2024-09-17T01:40:43.699507+0000","last_clean":"2024-09-17T01:40:43.699507+0000","last_became_active":"2024-09-17T01:40:42.698610+0000","last_became_peered":"2024-09-17T01:40:42.698610+0000","last_unstale":"2024-09-17T01:40:43.699507+0000","last_undegraded":"2024-09-17T01:40:43.699507+0000","last_fullsized":"2024-09-17T01:40:43.699507+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:32.703779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698738+0000","last_change":"2024-09-17T01:40:41.685604+0000","last_active":"2024-09-17T01:40:43.698738+0000","last_peered":"2024-09-17T01:40:43.698738+0000","last_clean":"2024-09-17T01:40:43.698738+0000","last_became_active":"2024-09-17T01:40:41.685235+0000","last_became_peered":"2024-09-17T01:40:41.685235+0000","last_unstale":"2024-09-17T01:40:43.698738+0000","last_undegraded":"2024-09-17T01:40:43.698738+0000","last_fullsized":"2024-09-17T01:40:43.698738+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:02.420800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.647373+0000","last_change":"2024-09-17T01:40:42.715820+0000","last_active":"2024-09-17T01:40:44.647373+0000","last_peered":"2024-09-17T01:40:44.647373+0000","last_clean":"2024-09-17T01:40:44.647373+0000","last_became_active":"2024-09-17T01:40:42.714975+0000","last_became_peered":"2024-09-17T01:40:42.714975+0000","last_unstale":"2024-09-17T01:40:44.647373+0000","last_undegraded":"2024-09-17T01:40:44.647373+0000","last_fullsized":"2024-09-17T01:40:44.647373+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:33.667942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.698705+0000","last_change":"2024-09-17T01:40:41.702589+0000","last_active":"2024-09-17T01:40:43.698705+0000","last_peered":"2024-09-17T01:40:43.698705+0000","last_clean":"2024-09-17T01:40:43.698705+0000","last_became_active":"2024-09-17T01:40:41.700738+0000","last_became_peered":"2024-09-17T01:40:41.700738+0000","last_unstale":"2024-09-17T01:40:43.698705+0000","last_undegraded":"2024-09-17T01:40:43.698705+0000","last_fullsized":"2024-09-17T01:40:43.698705+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:00.026492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.696032+0000","last_change":"2024-09-17T01:40:42.691235+0000","last_active":"2024-09-17T01:40:43.696032+0000","last_peered":"2024-09-17T01:40:43.696032+0000","last_clean":"2024-09-17T01:40:43.696032+0000","last_became_active":"2024-09-17T01:40:42.690876+0000","last_became_peered":"2024-09-17T01:40:42.690876+0000","last_unstale":"2024-09-17T01:40:43.696032+0000","last_undegraded":"2024-09-17T01:40:43.696032+0000","last_fullsized":"2024-09-17T01:40:43.696032+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:35.500477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.645735+0000","last_change":"2024-09-17T01:40:41.696154+0000","last_active":"2024-09-17T01:40:44.645735+0000","last_peered":"2024-09-17T01:40:44.645735+0000","last_clean":"2024-09-17T01:40:44.645735+0000","last_became_active":"2024-09-17T01:40:41.695805+0000","last_became_peered":"2024-09-17T01:40:41.695805+0000","last_unstale":"2024-09-17T01:40:44.645735+0000","last_undegraded":"2024-09-17T01:40:44.645735+0000","last_fullsized":"2024-09-17T01:40:44.645735+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:54.778570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.647053+0000","last_change":"2024-09-17T01:40:42.718019+0000","last_active":"2024-09-17T01:40:44.647053+0000","last_peered":"2024-09-17T01:40:44.647053+0000","last_clean":"2024-09-17T01:40:44.647053+0000","last_became_active":"2024-09-17T01:40:42.717464+0000","last_became_peered":"2024-09-17T01:40:42.717464+0000","last_unstale":"2024-09-17T01:40:44.647053+0000","last_undegraded":"2024-09-17T01:40:44.647053+0000","last_fullsized":"2024-09-17T01:40:44.647053+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:25.136223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.646721+0000","last_change":"2024-09-17T01:40:41.699047+0000","last_active":"2024-09-17T01:40:44.646721+0000","last_peered":"2024-09-17T01:40:44.646721+0000","last_clean":"2024-09-17T01:40:44.646721+0000","last_became_active":"2024-09-17T01:40:41.698628+0000","last_became_peered":"2024-09-17T01:40:41.698628+0000","last_unstale":"2024-09-17T01:40:44.646721+0000","last_undegraded":"2024-09-17T01:40:44.646721+0000","last_fullsized":"2024-09-17T01:40:44.646721+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:33.350692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.646363+0000","last_change":"2024-09-17T01:40:42.708158+0000","last_active":"2024-09-17T01:40:44.646363+0000","last_peered":"2024-09-17T01:40:44.646363+0000","last_clean":"2024-09-17T01:40:44.646363+0000","last_became_active":"2024-09-17T01:40:42.707852+0000","last_became_peered":"2024-09-17T01:40:42.707852+0000","last_unstale":"2024-09-17T01:40:44.646363+0000","last_undegraded":"2024-09-17T01:40:44.646363+0000","last_fullsized":"2024-09-17T01:40:44.646363+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:21.756525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.697486+0000","last_change":"2024-09-17T01:40:41.684531+0000","last_active":"2024-09-17T01:40:43.697486+0000","last_peered":"2024-09-17T01:40:43.697486+0000","last_clean":"2024-09-17T01:40:43.697486+0000","last_became_active":"2024-09-17T01:40:41.684098+0000","last_became_peered":"2024-09-17T01:40:41.684098+0000","last_unstale":"2024-09-17T01:40:43.697486+0000","last_undegraded":"2024-09-17T01:40:43.697486+0000","last_fullsized":"2024-09-17T01:40:43.697486+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:15.147011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-17T01:40:42.708998+0000","last_change":"2024-09-17T01:40:42.705317+0000","last_active":"2024-09-17T01:40:42.708998+0000","last_peered":"2024-09-17T01:40:42.708998+0000","last_clean":"2024-09-17T01:40:42.708998+0000","last_became_active":"2024-09-17T01:40:42.704608+0000","last_became_peered":"2024-09-17T01:40:42.704608+0000","last_unstale":"2024-09-17T01:40:42.708998+0000","last_undegraded":"2024-09-17T01:40:42.708998+0000","last_fullsized":"2024-09-17T01:40:42.708998+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:38:56.068272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-17T01:40:42.702001+0000","last_change":"2024-09-17T01:40:41.701829+0000","last_active":"2024-09-17T01:40:42.702001+0000","last_peered":"2024-09-17T01:40:42.702001+0000","last_clean":"2024-09-17T01:40:42.702001+0000","last_became_active":"2024-09-17T01:40:41.699430+0000","last_became_peered":"2024-09-17T01:40:41.699430+0000","last_unstale":"2024-09-17T01:40:42.702001+0000","last_undegraded":"2024-09-17T01:40:42.702001+0000","last_fullsized":"2024-09-17T01:40:42.702001+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:53.430429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.697522+0000","last_change":"2024-09-17T01:40:42.695054+0000","last_active":"2024-09-17T01:40:43.697522+0000","last_peered":"2024-09-17T01:40:43.697522+0000","last_clean":"2024-09-17T01:40:43.697522+0000","last_became_active":"2024-09-17T01:40:42.693693+0000","last_became_peered":"2024-09-17T01:40:42.693693+0000","last_unstale":"2024-09-17T01:40:43.697522+0000","last_undegraded":"2024-09-17T01:40:43.697522+0000","last_fullsized":"2024-09-17T01:40:43.697522+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:41.667128+0000","last_clean_scrub_stamp":"2024-09-17T01:40:41.667128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:37.740182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:44.645456+0000","last_change":"2024-09-17T01:40:41.691274+0000","last_active":"2024-09-17T01:40:44.645456+0000","last_peered":"2024-09-17T01:40:44.645456+0000","last_clean":"2024-09-17T01:40:44.645456+0000","last_became_active":"2024-09-17T01:40:41.690969+0000","last_became_peered":"2024-09-17T01:40:41.690969+0000","last_unstale":"2024-09-17T01:40:44.645456+0000","last_undegraded":"2024-09-17T01:40:44.645456+0000","last_fullsized":"2024-09-17T01:40:44.645456+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:40:40.664217+0000","last_clean_scrub_stamp":"2024-09-17T01:40:40.664217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:57.302493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":301,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T01:40:43.695977+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:40:43.695977+0000","last_peered":"2024-09-17T01:40:43.695977+0000","last_clean":"2024-09-17T01:40:43.695977+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:40:43.695977+0000","last_undegraded":"2024-09-17T01:40:43.695977+0000","last_fullsized":"2024-09-17T01:40:43.695977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476846,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54896,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316944,"statfs":{"total":96636764160,"available":96580550656,"internally_reserved":0,"allocated":1531904,"data_stored":666887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509549,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28532,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343308,"statfs":{"total":96636764160,"available":96607547392,"internally_reserved":0,"allocated":1540096,"data_stored":667985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509548,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54880,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316960,"statfs":{"total":96636764160,"available":96580567040,"internally_reserved":0,"allocated":1519616,"data_stored":666249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509549,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54900,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316940,"statfs":{"total":96636764160,"available":96580546560,"internally_reserved":0,"allocated":1536000,"data_stored":667951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509549,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54876,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316964,"statfs":{"total":96636764160,"available":96580571136,"internally_reserved":0,"allocated":1507328,"data_stored":659949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509548,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33256,"kb_used_data":2064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338584,"statfs":{"total":96636764160,"available":96602710016,"internally_reserved":0,"allocated":2113536,"data_stored":1256617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509550,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45148,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326692,"statfs":{"total":96636764160,"available":96590532608,"internally_reserved":0,"allocated":1515520,"data_stored":660601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":44693961},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542254,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55464,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316376,"statfs":{"total":96636764160,"available":96579969024,"internally_reserved":0,"allocated":2109440,"data_stored":1250409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:40:47.665 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T01:40:47.665 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T01:40:47.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.937+0000 7f8629c00640 1 -- 172.21.15.42:0/1656268053 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8624142f40 msgr2=0x7f8624072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:47.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.937+0000 7f8629c00640 1 --2- 172.21.15.42:0/1656268053 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8624142f40 0x7f8624072950 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f862415aab0 tx=0x7f860c02a560 comp rx=0 tx=0).stop 2024-09-17T01:40:47.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.937+0000 7f8629c00640 1 -- 172.21.15.42:0/1656268053 shutdown_connections 2024-09-17T01:40:47.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.937+0000 7f8629c00640 1 --2- 172.21.15.42:0/1656268053 >> v2:172.21.15.43:3300/0 conn(0x7f8624072e90 0x7f86240cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:47.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.937+0000 7f8629c00640 1 --2- 172.21.15.42:0/1656268053 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8624142f40 0x7f8624072950 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:47.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.937+0000 7f8629c00640 1 -- 172.21.15.42:0/1656268053 >> 172.21.15.42:0/1656268053 conn(0x7f86240b2930 msgr2=0x7f862406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:47.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.937+0000 7f8629c00640 1 -- 172.21.15.42:0/1656268053 shutdown_connections 2024-09-17T01:40:47.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.937+0000 7f8629c00640 1 -- 172.21.15.42:0/1656268053 wait complete. 2024-09-17T01:40:47.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.939+0000 7f8629c00640 1 Processor -- start 2024-09-17T01:40:47.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.939+0000 7f8629c00640 1 -- start start 2024-09-17T01:40:47.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.941+0000 7f8629c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8624072e90 0x7f862406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:47.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.941+0000 7f8629c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f86240b3550 0x7f862413ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:47.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.941+0000 7f8629c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8624142f40 0x7f86240ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:47.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.941+0000 7f8629c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f862406d5b0 con 0x7f8624142f40 2024-09-17T01:40:47.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.941+0000 7f8629c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f862406d430 con 0x7f8624072e90 2024-09-17T01:40:47.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.941+0000 7f8629c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f862406d730 con 0x7f86240b3550 2024-09-17T01:40:47.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.941+0000 7f8623400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8624142f40 0x7f86240ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:47.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.941+0000 7f8623400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8624142f40 0x7f86240ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59842/0 (socket says 172.21.15.42:59842) 2024-09-17T01:40:47.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.941+0000 7f8623400640 1 -- 172.21.15.42:0/2684206082 learned_addr learned my addr 172.21.15.42:0/2684206082 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:47.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.941+0000 7f861be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f86240b3550 0x7f862413ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:47.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.941+0000 7f8622a00640 1 --2- 172.21.15.42:0/2684206082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8624072e90 0x7f862406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:47.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.942+0000 7f8623400640 1 -- 172.21.15.42:0/2684206082 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f86240b3550 msgr2=0x7f862413ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:47.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.942+0000 7f8623400640 1 --2- 172.21.15.42:0/2684206082 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f86240b3550 0x7f862413ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:47.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.942+0000 7f8623400640 1 -- 172.21.15.42:0/2684206082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8624072e90 msgr2=0x7f862406fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:47.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.942+0000 7f8623400640 1 --2- 172.21.15.42:0/2684206082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8624072e90 0x7f862406fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:47.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.942+0000 7f8623400640 1 -- 172.21.15.42:0/2684206082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f862406e910 con 0x7f8624142f40 2024-09-17T01:40:47.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.942+0000 7f8623400640 1 --2- 172.21.15.42:0/2684206082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8624142f40 0x7f86240ae8a0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f861c00e990 tx=0x7f861c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:47.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.942+0000 7f861aa00640 1 -- 172.21.15.42:0/2684206082 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f861c004d20 con 0x7f8624142f40 2024-09-17T01:40:47.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.942+0000 7f861aa00640 1 -- 172.21.15.42:0/2684206082 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f861c00cb00 con 0x7f8624142f40 2024-09-17T01:40:47.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.942+0000 7f861aa00640 1 -- 172.21.15.42:0/2684206082 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f861c005020 con 0x7f8624142f40 2024-09-17T01:40:47.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.942+0000 7f8629c00640 1 -- 172.21.15.42:0/2684206082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f862406ebf0 con 0x7f8624142f40 2024-09-17T01:40:47.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.942+0000 7f8629c00640 1 -- 172.21.15.42:0/2684206082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f862406f1b0 con 0x7f8624142f40 2024-09-17T01:40:47.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.943+0000 7f8629c00640 1 -- 172.21.15.42:0/2684206082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f862406dc50 con 0x7f8624142f40 2024-09-17T01:40:47.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.945+0000 7f861aa00640 1 -- 172.21.15.42:0/2684206082 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f861c0051c0 con 0x7f8624142f40 2024-09-17T01:40:47.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.946+0000 7f861aa00640 1 --2- 172.21.15.42:0/2684206082 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8600078b90 0x7f860007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:47.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.946+0000 7f861aa00640 1 -- 172.21.15.42:0/2684206082 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f861c09b700 con 0x7f8624142f40 2024-09-17T01:40:47.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.947+0000 7f8622a00640 1 --2- 172.21.15.42:0/2684206082 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8600078b90 0x7f860007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:47.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.947+0000 7f8622a00640 1 --2- 172.21.15.42:0/2684206082 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8600078b90 0x7f860007b0a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8614001720 tx=0x7f8614009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:47.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:47.951+0000 7f861aa00640 1 -- 172.21.15.42:0/2684206082 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f861c016030 con 0x7f8624142f40 2024-09-17T01:40:48.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.218+0000 7f8629c00640 1 -- 172.21.15.42:0/2684206082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f862406a170 con 0x7f8624142f40 2024-09-17T01:40:48.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.222+0000 7f861aa00640 1 -- 172.21.15.42:0/2684206082 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v36) ==== 190+0+147 (secure 0 0 0) 0x7f861c063450 con 0x7f8624142f40 2024-09-17T01:40:48.220 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-09-17T01:40:48.220 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA== 2024-09-17T01:40:48.220 INFO:teuthology.orchestra.run.smithi042.stdout: caps mds = "allow" 2024-09-17T01:40:48.220 INFO:teuthology.orchestra.run.smithi042.stdout: caps mon = "allow r" 2024-09-17T01:40:48.220 INFO:teuthology.orchestra.run.smithi042.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T01:40:48.220 INFO:teuthology.orchestra.run.smithi042.stderr:updated caps for client.0 2024-09-17T01:40:48.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.224+0000 7f8629c00640 1 -- 172.21.15.42:0/2684206082 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8600078b90 msgr2=0x7f860007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:48.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.224+0000 7f8629c00640 1 --2- 172.21.15.42:0/2684206082 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8600078b90 0x7f860007b0a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8614001720 tx=0x7f8614009040 comp rx=0 tx=0).stop 2024-09-17T01:40:48.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.224+0000 7f8629c00640 1 -- 172.21.15.42:0/2684206082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8624142f40 msgr2=0x7f86240ae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:48.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.224+0000 7f8629c00640 1 --2- 172.21.15.42:0/2684206082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8624142f40 0x7f86240ae8a0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f861c00e990 tx=0x7f861c00ee50 comp rx=0 tx=0).stop 2024-09-17T01:40:48.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.224+0000 7f8629c00640 1 -- 172.21.15.42:0/2684206082 shutdown_connections 2024-09-17T01:40:48.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.224+0000 7f8629c00640 1 --2- 172.21.15.42:0/2684206082 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8600078b90 0x7f860007b0a0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:48.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.224+0000 7f8629c00640 1 --2- 172.21.15.42:0/2684206082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8624142f40 0x7f86240ae8a0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:48.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.224+0000 7f8629c00640 1 --2- 172.21.15.42:0/2684206082 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f86240b3550 0x7f862413ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:48.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.224+0000 7f8629c00640 1 --2- 172.21.15.42:0/2684206082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8624072e90 0x7f862406fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:48.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.224+0000 7f8629c00640 1 -- 172.21.15.42:0/2684206082 >> 172.21.15.42:0/2684206082 conn(0x7f86240b2930 msgr2=0x7f862415f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:48.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.225+0000 7f8629c00640 1 -- 172.21.15.42:0/2684206082 shutdown_connections 2024-09-17T01:40:48.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.225+0000 7f8629c00640 1 -- 172.21.15.42:0/2684206082 wait complete. 2024-09-17T01:40:48.244 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:40:48.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.471+0000 7f259fe00640 1 -- 172.21.15.42:0/2273807073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25a0162500 msgr2=0x7f25a0162910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:48.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.471+0000 7f259fe00640 1 --2- 172.21.15.42:0/2273807073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25a0162500 0x7f25a0162910 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f25a00d3d90 tx=0x7f259802aac0 comp rx=0 tx=0).stop 2024-09-17T01:40:48.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.471+0000 7f259fe00640 1 -- 172.21.15.42:0/2273807073 shutdown_connections 2024-09-17T01:40:48.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.471+0000 7f259fe00640 1 --2- 172.21.15.42:0/2273807073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25a0162500 0x7f25a0162910 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:48.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.471+0000 7f259fe00640 1 --2- 172.21.15.42:0/2273807073 >> v2:172.21.15.43:3300/0 conn(0x7f25a00d0e10 0x7f25a00d1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:48.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.471+0000 7f259fe00640 1 -- 172.21.15.42:0/2273807073 >> 172.21.15.42:0/2273807073 conn(0x7f25a00b6140 msgr2=0x7f25a00b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:48.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.471+0000 7f259fe00640 1 -- 172.21.15.42:0/2273807073 shutdown_connections 2024-09-17T01:40:48.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.471+0000 7f259fe00640 1 -- 172.21.15.42:0/2273807073 wait complete. 2024-09-17T01:40:48.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.473+0000 7f259fe00640 1 Processor -- start 2024-09-17T01:40:48.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.473+0000 7f259fe00640 1 -- start start 2024-09-17T01:40:48.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.475+0000 7f259fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25a00cfba0 0x7f25a01f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:48.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.475+0000 7f259fe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f25a00d0e10 0x7f25a0157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:48.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.475+0000 7f259fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25a0162500 0x7f25a00b8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:48.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.475+0000 7f259fe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f25a00b31e0 con 0x7f25a00cfba0 2024-09-17T01:40:48.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.475+0000 7f259fe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f25a00b3060 con 0x7f25a0162500 2024-09-17T01:40:48.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.475+0000 7f259fe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f25a00b3360 con 0x7f25a00d0e10 2024-09-17T01:40:48.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.475+0000 7f259ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25a00cfba0 0x7f25a01f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:48.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.475+0000 7f259ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25a00cfba0 0x7f25a01f5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59862/0 (socket says 172.21.15.42:59862) 2024-09-17T01:40:48.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.475+0000 7f259ea00640 1 -- 172.21.15.42:0/1500988059 learned_addr learned my addr 172.21.15.42:0/1500988059 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:48.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.475+0000 7f2596000640 1 --2- 172.21.15.42:0/1500988059 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f25a00d0e10 0x7f25a0157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:48.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.475+0000 7f259f400640 1 --2- 172.21.15.42:0/1500988059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25a0162500 0x7f25a00b8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:48.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.476+0000 7f259ea00640 1 -- 172.21.15.42:0/1500988059 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f25a00d0e10 msgr2=0x7f25a0157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:48.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.476+0000 7f259ea00640 1 --2- 172.21.15.42:0/1500988059 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f25a00d0e10 0x7f25a0157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:48.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.476+0000 7f259ea00640 1 -- 172.21.15.42:0/1500988059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25a0162500 msgr2=0x7f25a00b8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:48.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.476+0000 7f259ea00640 1 --2- 172.21.15.42:0/1500988059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25a0162500 0x7f25a00b8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:48.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.476+0000 7f259ea00640 1 -- 172.21.15.42:0/1500988059 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a00caff0 con 0x7f25a00cfba0 2024-09-17T01:40:48.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.476+0000 7f259ea00640 1 --2- 172.21.15.42:0/1500988059 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25a00cfba0 0x7f25a01f5cc0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f259000c3a0 tx=0x7f259000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:48.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.476+0000 7f2597400640 1 -- 172.21.15.42:0/1500988059 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2590017070 con 0x7f25a00cfba0 2024-09-17T01:40:48.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.476+0000 7f2597400640 1 -- 172.21.15.42:0/1500988059 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f25900053c0 con 0x7f25a00cfba0 2024-09-17T01:40:48.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.476+0000 7f259fe00640 1 -- 172.21.15.42:0/1500988059 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a01f5230 con 0x7f25a00cfba0 2024-09-17T01:40:48.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.476+0000 7f2597400640 1 -- 172.21.15.42:0/1500988059 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2590003850 con 0x7f25a00cfba0 2024-09-17T01:40:48.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.476+0000 7f259fe00640 1 -- 172.21.15.42:0/1500988059 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a00cad10 con 0x7f25a00cfba0 2024-09-17T01:40:48.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.477+0000 7f259fe00640 1 -- 172.21.15.42:0/1500988059 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25a01f5980 con 0x7f25a00cfba0 2024-09-17T01:40:48.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.479+0000 7f2597400640 1 -- 172.21.15.42:0/1500988059 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f259001a070 con 0x7f25a00cfba0 2024-09-17T01:40:48.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.480+0000 7f2597400640 1 --2- 172.21.15.42:0/1500988059 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f257c078b90 0x7f257c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:48.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.480+0000 7f2597400640 1 -- 172.21.15.42:0/1500988059 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f259009a170 con 0x7f25a00cfba0 2024-09-17T01:40:48.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.480+0000 7f2596000640 1 --2- 172.21.15.42:0/1500988059 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f257c078b90 0x7f257c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:48.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.481+0000 7f2596000640 1 --2- 172.21.15.42:0/1500988059 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f257c078b90 0x7f257c07b0a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f25a0156320 tx=0x7f2588005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:48.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.484+0000 7f2597400640 1 -- 172.21.15.42:0/1500988059 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f25a00caff0 con 0x7f25a00cfba0 2024-09-17T01:40:48.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.717+0000 7f259fe00640 1 -- 172.21.15.42:0/1500988059 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25a00b3810 con 0x7f25a00cfba0 2024-09-17T01:40:48.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.718+0000 7f2597400640 1 -- 172.21.15.42:0/1500988059 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5222 (secure 0 0 0) 0x7f2590061ec0 con 0x7f25a00cfba0 2024-09-17T01:40:48.716 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:40:48.716 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":98,"btime":"2024-09-17T01:40:45:701152+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6884,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2926480981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2926480981},{"type":"v1","addr":"172.21.15.43:6837","nonce":2926480981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7576,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1365229483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1365229483},{"type":"v1","addr":"172.21.15.43:6836","nonce":1365229483}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92},{"gid":8058,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1442154751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1442154751},{"type":"v1","addr":"172.21.15.42:6833","nonce":1442154751}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:40:42.191921+0000","modified":"2024-09-17T01:40:45.203701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8061},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8061":{"gid":8061,"name":"c","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/970028636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":970028636},{"type":"v1","addr":"172.21.15.42:6835","nonce":970028636}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8061,"qdb_cluster":[8061]},"id":8}]} 2024-09-17T01:40:48.716 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 98 2024-09-17T01:40:48.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.721+0000 7f259fe00640 1 -- 172.21.15.42:0/1500988059 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f257c078b90 msgr2=0x7f257c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:48.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.721+0000 7f259fe00640 1 --2- 172.21.15.42:0/1500988059 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f257c078b90 0x7f257c07b0a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f25a0156320 tx=0x7f2588005f90 comp rx=0 tx=0).stop 2024-09-17T01:40:48.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.721+0000 7f259fe00640 1 -- 172.21.15.42:0/1500988059 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25a00cfba0 msgr2=0x7f25a01f5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:48.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.721+0000 7f259fe00640 1 --2- 172.21.15.42:0/1500988059 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25a00cfba0 0x7f25a01f5cc0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f259000c3a0 tx=0x7f259000c860 comp rx=0 tx=0).stop 2024-09-17T01:40:48.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.721+0000 7f259fe00640 1 -- 172.21.15.42:0/1500988059 shutdown_connections 2024-09-17T01:40:48.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.721+0000 7f259fe00640 1 --2- 172.21.15.42:0/1500988059 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f257c078b90 0x7f257c07b0a0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:48.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.721+0000 7f259fe00640 1 --2- 172.21.15.42:0/1500988059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25a0162500 0x7f25a00b8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:48.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.721+0000 7f259fe00640 1 --2- 172.21.15.42:0/1500988059 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f25a00d0e10 0x7f25a0157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:48.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.721+0000 7f259fe00640 1 --2- 172.21.15.42:0/1500988059 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25a00cfba0 0x7f25a01f5cc0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:48.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.721+0000 7f259fe00640 1 -- 172.21.15.42:0/1500988059 >> 172.21.15.42:0/1500988059 conn(0x7f25a00b6140 msgr2=0x7f25a0160560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:48.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.721+0000 7f259fe00640 1 -- 172.21.15.42:0/1500988059 shutdown_connections 2024-09-17T01:40:48.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:48.721+0000 7f259fe00640 1 -- 172.21.15.42:0/1500988059 wait complete. 2024-09-17T01:40:49.143 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 98, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:40:42.191921+0000', 'modified': '2024-09-17T01:40:45.203701+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8061}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8061': {'gid': 8061, 'name': 'c', 'rank': 0, 'incarnation': 94, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.42:6835/970028636', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6834', 'nonce': 970028636}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 970028636}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8061, 'qdb_cluster': [8061]} 2024-09-17T01:40:49.143 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T01:40:49.143 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T01:40:49.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.381+0000 7f9ed7c00640 1 -- 172.21.15.42:0/3755068357 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ed0142f40 msgr2=0x7f9ed0072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:49.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.381+0000 7f9ed7c00640 1 --2- 172.21.15.42:0/3755068357 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ed0142f40 0x7f9ed0072950 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc005fd0 tx=0x7f9ebc02a540 comp rx=0 tx=0).stop 2024-09-17T01:40:49.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.381+0000 7f9ed7c00640 1 -- 172.21.15.42:0/3755068357 shutdown_connections 2024-09-17T01:40:49.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.381+0000 7f9ed7c00640 1 --2- 172.21.15.42:0/3755068357 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ed0072e90 0x7f9ed00cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.381+0000 7f9ed7c00640 1 --2- 172.21.15.42:0/3755068357 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ed0142f40 0x7f9ed0072950 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.381+0000 7f9ed7c00640 1 -- 172.21.15.42:0/3755068357 >> 172.21.15.42:0/3755068357 conn(0x7f9ed00b2930 msgr2=0x7f9ed006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:49.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.381+0000 7f9ed7c00640 1 -- 172.21.15.42:0/3755068357 shutdown_connections 2024-09-17T01:40:49.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.381+0000 7f9ed7c00640 1 -- 172.21.15.42:0/3755068357 wait complete. 2024-09-17T01:40:49.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.383+0000 7f9ed7c00640 1 Processor -- start 2024-09-17T01:40:49.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.384+0000 7f9ed7c00640 1 -- start start 2024-09-17T01:40:49.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.385+0000 7f9ed7c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ed0072e90 0x7f9ed01e62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:49.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.385+0000 7f9ed7c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ed00b3550 0x7f9ed01f6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:49.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.385+0000 7f9ed7c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ed0142f40 0x7f9ed015e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:49.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.385+0000 7f9ed7c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed006d7c0 con 0x7f9ed0142f40 2024-09-17T01:40:49.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.385+0000 7f9ed7c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed006d640 con 0x7f9ed0072e90 2024-09-17T01:40:49.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.385+0000 7f9ed7c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9ed006d940 con 0x7f9ed00b3550 2024-09-17T01:40:49.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.385+0000 7f9ed5c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ed0142f40 0x7f9ed015e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:49.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.385+0000 7f9ed5c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ed0142f40 0x7f9ed015e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59892/0 (socket says 172.21.15.42:59892) 2024-09-17T01:40:49.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.385+0000 7f9ed5c00640 1 -- 172.21.15.42:0/3100323250 learned_addr learned my addr 172.21.15.42:0/3100323250 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:49.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.386+0000 7f9ecfe00640 1 --2- 172.21.15.42:0/3100323250 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ed00b3550 0x7f9ed01f6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:49.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.386+0000 7f9ed5200640 1 --2- 172.21.15.42:0/3100323250 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ed0072e90 0x7f9ed01e62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:49.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.386+0000 7f9ed5c00640 1 -- 172.21.15.42:0/3100323250 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ed00b3550 msgr2=0x7f9ed01f6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:49.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.386+0000 7f9ed5c00640 1 --2- 172.21.15.42:0/3100323250 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ed00b3550 0x7f9ed01f6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.386+0000 7f9ed5c00640 1 -- 172.21.15.42:0/3100323250 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ed0072e90 msgr2=0x7f9ed01e62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:49.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.386+0000 7f9ed5c00640 1 --2- 172.21.15.42:0/3100323250 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ed0072e90 0x7f9ed01e62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.386+0000 7f9ed5c00640 1 -- 172.21.15.42:0/3100323250 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed01e6b40 con 0x7f9ed0142f40 2024-09-17T01:40:49.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.386+0000 7f9ed5c00640 1 --2- 172.21.15.42:0/3100323250 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ed0142f40 0x7f9ed015e300 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800e990 tx=0x7f9ec800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:49.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.386+0000 7f9eccc00640 1 -- 172.21.15.42:0/3100323250 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8004d20 con 0x7f9ed0142f40 2024-09-17T01:40:49.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.386+0000 7f9eccc00640 1 -- 172.21.15.42:0/3100323250 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ec800caa0 con 0x7f9ed0142f40 2024-09-17T01:40:49.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.386+0000 7f9eccc00640 1 -- 172.21.15.42:0/3100323250 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8005020 con 0x7f9ed0142f40 2024-09-17T01:40:49.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.386+0000 7f9ed7c00640 1 -- 172.21.15.42:0/3100323250 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ed01e6e20 con 0x7f9ed0142f40 2024-09-17T01:40:49.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.387+0000 7f9ed7c00640 1 -- 172.21.15.42:0/3100323250 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ed01f5c70 con 0x7f9ed0142f40 2024-09-17T01:40:49.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.390+0000 7f9eccc00640 1 -- 172.21.15.42:0/3100323250 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9ec80051c0 con 0x7f9ed0142f40 2024-09-17T01:40:49.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.391+0000 7f9eccc00640 1 --2- 172.21.15.42:0/3100323250 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9eb0078b90 0x7f9eb007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:49.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.391+0000 7f9eccc00640 1 -- 172.21.15.42:0/3100323250 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5767+0+0 (secure 0 0 0) 0x7f9ec809b790 con 0x7f9ed0142f40 2024-09-17T01:40:49.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.391+0000 7f9ededfc740 1 Processor -- start 2024-09-17T01:40:49.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.392+0000 7f9ededfc740 1 -- start start 2024-09-17T01:40:49.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.392+0000 7f9ed5200640 1 --2- 172.21.15.42:0/3100323250 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9eb0078b90 0x7f9eb007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:49.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.392+0000 7f9ed5200640 1 --2- 172.21.15.42:0/3100323250 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9eb0078b90 0x7f9eb007b0a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40015e0 tx=0x7f9ec4009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:49.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.393+0000 7f9ededfc740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555d8cf27270 0x555d8d2f7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:49.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.393+0000 7f9ededfc740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555d8cefe3b0 0x555d8d2f7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:49.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.393+0000 7f9ededfc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8cf06590 0x555d8d2c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:49.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.393+0000 7f9ededfc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555d8d251430 con 0x555d8cf06590 2024-09-17T01:40:49.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.393+0000 7f9ededfc740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555d8d2415d0 con 0x555d8cf27270 2024-09-17T01:40:49.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.393+0000 7f9ededfc740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x555d8d230a00 con 0x555d8cefe3b0 2024-09-17T01:40:49.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.393+0000 7f9ed5c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8cf06590 0x555d8d2c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:49.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.393+0000 7f9ed5c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8cf06590 0x555d8d2c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59906/0 (socket says 172.21.15.42:59906) 2024-09-17T01:40:49.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.393+0000 7f9ed5c00640 1 -- 172.21.15.42:0/3102157799 learned_addr learned my addr 172.21.15.42:0/3102157799 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:49.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.394+0000 7f9ed5200640 1 --2- 172.21.15.42:0/3102157799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555d8cf27270 0x555d8d2f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:49.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.394+0000 7f9ecfe00640 1 --2- 172.21.15.42:0/3102157799 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555d8cefe3b0 0x555d8d2f7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:49.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.394+0000 7f9ed5c00640 1 -- 172.21.15.42:0/3102157799 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555d8cefe3b0 msgr2=0x555d8d2f7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:40:49.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.394+0000 7f9ed5c00640 1 --2- 172.21.15.42:0/3102157799 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555d8cefe3b0 0x555d8d2f7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.394+0000 7f9ed5c00640 1 -- 172.21.15.42:0/3102157799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555d8cf27270 msgr2=0x555d8d2f7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:40:49.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.394+0000 7f9ed5c00640 1 --2- 172.21.15.42:0/3102157799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555d8cf27270 0x555d8d2f7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.394+0000 7f9ed5c00640 1 -- 172.21.15.42:0/3102157799 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d8d1f9520 con 0x555d8cf06590 2024-09-17T01:40:49.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.394+0000 7f9ed5c00640 1 --2- 172.21.15.42:0/3102157799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8cf06590 0x555d8d2c7f60 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800c640 tx=0x7f9ec8062f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f137a2613247b2a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:49.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.394+0000 7f9ec1600640 1 -- 172.21.15.42:0/3102157799 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec801f070 con 0x555d8cf06590 2024-09-17T01:40:49.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.394+0000 7f9ec1600640 1 -- 172.21.15.42:0/3102157799 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ec8067ed0 con 0x555d8cf06590 2024-09-17T01:40:49.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.394+0000 7f9ec1600640 1 -- 172.21.15.42:0/3102157799 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8062890 con 0x555d8cf06590 2024-09-17T01:40:49.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.395+0000 7f9ededfc740 1 -- 172.21.15.42:0/3102157799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8cf06590 msgr2=0x555d8d2c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:49.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.395+0000 7f9ededfc740 1 --2- 172.21.15.42:0/3102157799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8cf06590 0x555d8d2c7f60 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800c640 tx=0x7f9ec8062f00 comp rx=0 tx=0).stop 2024-09-17T01:40:49.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.395+0000 7f9ededfc740 1 -- 172.21.15.42:0/3102157799 shutdown_connections 2024-09-17T01:40:49.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.395+0000 7f9ededfc740 1 --2- 172.21.15.42:0/3102157799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8cf06590 0x555d8d2c7f60 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.395+0000 7f9ededfc740 1 --2- 172.21.15.42:0/3102157799 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555d8cefe3b0 0x555d8d2f7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.395+0000 7f9ededfc740 1 --2- 172.21.15.42:0/3102157799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555d8cf27270 0x555d8d2f7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.395+0000 7f9ededfc740 1 -- 172.21.15.42:0/3102157799 >> 172.21.15.42:0/3102157799 conn(0x555d8cf1b3c0 msgr2=0x555d8d2cd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:49.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.395+0000 7f9ededfc740 1 -- 172.21.15.42:0/3102157799 shutdown_connections 2024-09-17T01:40:49.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.395+0000 7f9ededfc740 1 -- 172.21.15.42:0/3102157799 wait complete. 2024-09-17T01:40:49.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.396+0000 7f9ededfc740 1 -- start start 2024-09-17T01:40:49.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.396+0000 7f9ededfc740 1 Processor -- start 2024-09-17T01:40:49.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.398+0000 7f9ededfc740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555d8cefe3b0 0x555d8d2edd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:49.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.398+0000 7f9ededfc740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555d8cf06590 0x555d8d2ee240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:49.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.398+0000 7f9ededfc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8cf27270 0x555d8d3257b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:49.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.398+0000 7f9ededfc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555d8d1d7330 con 0x555d8cf27270 2024-09-17T01:40:49.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.398+0000 7f9ededfc740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555d8d234810 con 0x555d8cefe3b0 2024-09-17T01:40:49.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.398+0000 7f9ededfc740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x555d8cfa1620 con 0x555d8cf06590 2024-09-17T01:40:49.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.398+0000 7f9ededfc740 10 client.0 _ll_register_callbacks cb 0x555d8d1dc420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:40:49.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.398+0000 7f9ed5c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8cf27270 0x555d8d3257b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:49.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.398+0000 7f9ed5c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8cf27270 0x555d8d3257b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59912/0 (socket says 172.21.15.42:59912) 2024-09-17T01:40:49.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.398+0000 7f9ed5c00640 1 -- 172.21.15.42:0/3558760309 learned_addr learned my addr 172.21.15.42:0/3558760309 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:49.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.399+0000 7f9ed5200640 1 --2- 172.21.15.42:0/3558760309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555d8cefe3b0 0x555d8d2edd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:49.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.399+0000 7f9ecfe00640 1 --2- 172.21.15.42:0/3558760309 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555d8cf06590 0x555d8d2ee240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:49.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.399+0000 7f9ed5c00640 1 -- 172.21.15.42:0/3558760309 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555d8cf06590 msgr2=0x555d8d2ee240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:40:49.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.399+0000 7f9ed5c00640 1 --2- 172.21.15.42:0/3558760309 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555d8cf06590 0x555d8d2ee240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.399+0000 7f9ed5c00640 1 -- 172.21.15.42:0/3558760309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555d8cefe3b0 msgr2=0x555d8d2edd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:40:49.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.399+0000 7f9ed5c00640 1 --2- 172.21.15.42:0/3558760309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555d8cefe3b0 0x555d8d2edd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.399+0000 7f9ed5c00640 1 -- 172.21.15.42:0/3558760309 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d8cf92850 con 0x555d8cf27270 2024-09-17T01:40:49.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.399+0000 7f9ed5200640 1 --2- 172.21.15.42:0/3558760309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555d8cefe3b0 0x555d8d2edd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:40:49.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.399+0000 7f9ed5c00640 1 --2- 172.21.15.42:0/3558760309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8cf27270 0x555d8d3257b0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800c640 tx=0x7f9ec805ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c083221b405f02c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:49.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.399+0000 7f9eb6000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:40:49.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.399+0000 7f9eb6000640 1 -- 172.21.15.42:0/3558760309 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec801f030 con 0x555d8cf27270 2024-09-17T01:40:49.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.399+0000 7f9ededfc740 1 -- 172.21.15.42:0/3558760309 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ec8067ed0 con 0x555d8cf27270 2024-09-17T01:40:49.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.399+0000 7f9eb6000640 1 -- 172.21.15.42:0/3558760309 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(124..124 src has 1..124) ==== 5767+0+0 (secure 0 0 0) 0x7f9ec80622d0 con 0x555d8cf27270 2024-09-17T01:40:49.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.399+0000 7f9eb6000640 1 -- 172.21.15.42:0/3558760309 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f9ec806ce10 con 0x555d8cf27270 2024-09-17T01:40:49.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.399+0000 7f9ededfc740 10 client.8184 fetch_fsmap learned FSMap version 98 2024-09-17T01:40:49.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.399+0000 7f9ededfc740 1 -- 172.21.15.42:0/3558760309 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x555d8d0096b0 con 0x555d8cf27270 2024-09-17T01:40:49.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.400+0000 7f9eb6000640 1 -- 172.21.15.42:0/3558760309 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ec8067ed0 con 0x555d8cf27270 2024-09-17T01:40:49.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.400+0000 7f9eb6000640 1 -- 172.21.15.42:0/3558760309 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7f9ec800f040 con 0x555d8cf27270 2024-09-17T01:40:49.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.400+0000 7f9ededfc740 10 client.8184 fetch_fsmap finished waiting for FSMap version 98 2024-09-17T01:40:49.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.400+0000 7f9ededfc740 10 client.8184 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:40:49.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.400+0000 7f9ededfc740 20 client.8184 populate_metadata read hostname 'smithi042' 2024-09-17T01:40:49.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.400+0000 7f9ededfc740 1 --2- 172.21.15.42:0/3558760309 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x555d8cee5e40 0x555d8d2f3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:49.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.400+0000 7f9ededfc740 4 client.8184 mds_command: new command op to 8061 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:40:49.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.400+0000 7f9ededfc740 1 -- 172.21.15.42:0/3558760309 --> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d8d243520 con 0x555d8cee5e40 2024-09-17T01:40:49.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.400+0000 7f9ed5200640 1 --2- 172.21.15.42:0/3558760309 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x555d8cee5e40 0x555d8d2f3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:49.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.401+0000 7f9ed5200640 1 --2- 172.21.15.42:0/3558760309 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x555d8cee5e40 0x555d8d2f3840 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84cbe033b6ab7d25 server_cookie=1f42f581ccfcdf4c in_seq=0 out_seq=0 2024-09-17T01:40:49.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.401+0000 7f9eb6000640 10 client.8184 ms_handle_connect on v2:172.21.15.42:6834/970028636 2024-09-17T01:40:49.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.402+0000 7f9eb6000640 1 -- 172.21.15.42:0/3558760309 <== mds.0 v2:172.21.15.42:6834/970028636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555d8d243520 con 0x555d8cee5e40 2024-09-17T01:40:49.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.402+0000 7f9eb6000640 10 client.8184 handle_command_reply: tid=0 2024-09-17T01:40:49.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.402+0000 7f9ededfc740 1 client.8184 shutdown 2024-09-17T01:40:49.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.402+0000 7f9ededfc740 1 -- 172.21.15.42:0/3558760309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8cf27270 msgr2=0x555d8d3257b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:49.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.402+0000 7f9ededfc740 1 --2- 172.21.15.42:0/3558760309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8cf27270 0x555d8d3257b0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800c640 tx=0x7f9ec805ef70 comp rx=0 tx=0).stop 2024-09-17T01:40:49.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.402+0000 7f9ededfc740 1 -- 172.21.15.42:0/3558760309 shutdown_connections 2024-09-17T01:40:49.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.402+0000 7f9ededfc740 1 --2- 172.21.15.42:0/3558760309 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x555d8cee5e40 0x555d8d2f3840 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.402+0000 7f9ededfc740 1 --2- 172.21.15.42:0/3558760309 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8cf27270 0x555d8d3257b0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.402+0000 7f9ededfc740 1 --2- 172.21.15.42:0/3558760309 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555d8cf06590 0x555d8d2ee240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.402+0000 7f9ededfc740 1 --2- 172.21.15.42:0/3558760309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555d8cefe3b0 0x555d8d2edd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.402+0000 7f9ededfc740 1 -- 172.21.15.42:0/3558760309 >> 172.21.15.42:0/3558760309 conn(0x555d8cf1b3c0 msgr2=0x555d8d2c93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:49.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.402+0000 7f9eb6000640 0 client.8184 ms_handle_reset on v2:172.21.15.42:6834/970028636 2024-09-17T01:40:49.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.402+0000 7f9ededfc740 1 -- 172.21.15.42:0/3558760309 shutdown_connections 2024-09-17T01:40:49.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.402+0000 7f9ededfc740 1 -- 172.21.15.42:0/3558760309 wait complete. 2024-09-17T01:40:49.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.402+0000 7f9ededfc740 20 client.8184 trim_cache size 0 max 16384 2024-09-17T01:40:49.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.422+0000 7f9ededfc740 1 Processor -- start 2024-09-17T01:40:49.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.422+0000 7f9ededfc740 1 -- start start 2024-09-17T01:40:49.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.423+0000 7f9ededfc740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555d8cefe3b0 0x555d8d315cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:49.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.423+0000 7f9ededfc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8cf06590 0x555d8d316200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:49.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.423+0000 7f9ededfc740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555d8cf27270 0x555d8d30d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:49.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.423+0000 7f9ededfc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed0201510 con 0x555d8cf06590 2024-09-17T01:40:49.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.423+0000 7f9ededfc740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed01f96c0 con 0x555d8cf27270 2024-09-17T01:40:49.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.423+0000 7f9ededfc740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9ed01f9d10 con 0x555d8cefe3b0 2024-09-17T01:40:49.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.423+0000 7f9ecfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8cf06590 0x555d8d316200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:49.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.423+0000 7f9ecfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8cf06590 0x555d8d316200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59918/0 (socket says 172.21.15.42:59918) 2024-09-17T01:40:49.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.423+0000 7f9ecfe00640 1 -- 172.21.15.42:0/731836194 learned_addr learned my addr 172.21.15.42:0/731836194 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:49.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.424+0000 7f9ed5200640 1 --2- 172.21.15.42:0/731836194 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555d8cefe3b0 0x555d8d315cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:49.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.424+0000 7f9ed5c00640 1 --2- 172.21.15.42:0/731836194 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555d8cf27270 0x555d8d30d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:49.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.424+0000 7f9ecfe00640 1 -- 172.21.15.42:0/731836194 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555d8cefe3b0 msgr2=0x555d8d315cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:40:49.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.424+0000 7f9ecfe00640 1 --2- 172.21.15.42:0/731836194 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555d8cefe3b0 0x555d8d315cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.424+0000 7f9ecfe00640 1 -- 172.21.15.42:0/731836194 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555d8cf27270 msgr2=0x555d8d30d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:40:49.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.424+0000 7f9ecfe00640 1 --2- 172.21.15.42:0/731836194 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555d8cf27270 0x555d8d30d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.424+0000 7f9ecfe00640 1 -- 172.21.15.42:0/731836194 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d8d2ce650 con 0x555d8cf06590 2024-09-17T01:40:49.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.424+0000 7f9ed5200640 1 --2- 172.21.15.42:0/731836194 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555d8cefe3b0 0x555d8d315cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:40:49.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.424+0000 7f9ecfe00640 1 --2- 172.21.15.42:0/731836194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8cf06590 0x555d8d316200 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc02ab30 tx=0x7f9ebc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa5b295f04bd741 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:49.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.424+0000 7f9ec0c00640 1 -- 172.21.15.42:0/731836194 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc035040 con 0x555d8cf06590 2024-09-17T01:40:49.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.424+0000 7f9ec0c00640 1 -- 172.21.15.42:0/731836194 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ebc004320 con 0x555d8cf06590 2024-09-17T01:40:49.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.424+0000 7f9ec0c00640 1 -- 172.21.15.42:0/731836194 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc003850 con 0x555d8cf06590 2024-09-17T01:40:49.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.425+0000 7f9ededfc740 1 -- 172.21.15.42:0/731836194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8cf06590 msgr2=0x555d8d316200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:49.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.425+0000 7f9ededfc740 1 --2- 172.21.15.42:0/731836194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8cf06590 0x555d8d316200 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc02ab30 tx=0x7f9ebc0046c0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.425+0000 7f9ededfc740 1 -- 172.21.15.42:0/731836194 shutdown_connections 2024-09-17T01:40:49.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.425+0000 7f9ededfc740 1 --2- 172.21.15.42:0/731836194 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555d8cf27270 0x555d8d30d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.425+0000 7f9ededfc740 1 --2- 172.21.15.42:0/731836194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8cf06590 0x555d8d316200 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.425+0000 7f9ededfc740 1 --2- 172.21.15.42:0/731836194 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555d8cefe3b0 0x555d8d315cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.425+0000 7f9ededfc740 1 -- 172.21.15.42:0/731836194 >> 172.21.15.42:0/731836194 conn(0x555d8cf1b3c0 msgr2=0x555d8d2e76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:49.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.425+0000 7f9ededfc740 1 -- 172.21.15.42:0/731836194 shutdown_connections 2024-09-17T01:40:49.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.425+0000 7f9ededfc740 1 -- 172.21.15.42:0/731836194 wait complete. 2024-09-17T01:40:49.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.426+0000 7f9ededfc740 1 -- start start 2024-09-17T01:40:49.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.426+0000 7f9ededfc740 1 Processor -- start 2024-09-17T01:40:49.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.428+0000 7f9ededfc740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555d8cefe3b0 0x555d8d378400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:49.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.428+0000 7f9ededfc740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555d8cf27270 0x555d8d315e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:49.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.428+0000 7f9ededfc740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8d315710 0x555d8d316390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:49.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.428+0000 7f9ededfc740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555d8d3261c0 con 0x555d8d315710 2024-09-17T01:40:49.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.428+0000 7f9ededfc740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555d8d1d7330 con 0x555d8cf27270 2024-09-17T01:40:49.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.428+0000 7f9ededfc740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x555d8d2f1090 con 0x555d8cefe3b0 2024-09-17T01:40:49.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.428+0000 7f9ededfc740 10 client.0 _ll_register_callbacks cb 0x7f9ec80629a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:40:49.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.428+0000 7f9ed5c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8d315710 0x555d8d316390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:49.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.428+0000 7f9ed5c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8d315710 0x555d8d316390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59934/0 (socket says 172.21.15.42:59934) 2024-09-17T01:40:49.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.428+0000 7f9ed5c00640 1 -- 172.21.15.42:0/3018828412 learned_addr learned my addr 172.21.15.42:0/3018828412 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:49.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.428+0000 7f9ed5200640 1 --2- 172.21.15.42:0/3018828412 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555d8cefe3b0 0x555d8d378400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:49.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.428+0000 7f9ecfe00640 1 --2- 172.21.15.42:0/3018828412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555d8cf27270 0x555d8d315e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:49.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.429+0000 7f9ed5c00640 1 -- 172.21.15.42:0/3018828412 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555d8cefe3b0 msgr2=0x555d8d378400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:40:49.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.429+0000 7f9ed5c00640 1 --2- 172.21.15.42:0/3018828412 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555d8cefe3b0 0x555d8d378400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.429+0000 7f9ed5c00640 1 -- 172.21.15.42:0/3018828412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555d8cf27270 msgr2=0x555d8d315e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:40:49.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.429+0000 7f9ed5c00640 1 --2- 172.21.15.42:0/3018828412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555d8cf27270 0x555d8d315e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.429+0000 7f9ed5c00640 1 -- 172.21.15.42:0/3018828412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d8d266a90 con 0x555d8d315710 2024-09-17T01:40:49.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.429+0000 7f9ed5c00640 1 --2- 172.21.15.42:0/3018828412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8d315710 0x555d8d316390 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80630f0 tx=0x7f9ec8062a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c868e7a29cde7a88 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:49.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.429+0000 7f9eb6000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:40:49.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.429+0000 7f9eb6000640 1 -- 172.21.15.42:0/3018828412 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec801f040 con 0x555d8d315710 2024-09-17T01:40:49.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.429+0000 7f9eb6000640 1 -- 172.21.15.42:0/3018828412 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(124..124 src has 1..124) ==== 5767+0+0 (secure 0 0 0) 0x7f9ec805efe0 con 0x555d8d315710 2024-09-17T01:40:49.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.429+0000 7f9ededfc740 1 -- 172.21.15.42:0/3018828412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ebc004320 con 0x555d8d315710 2024-09-17T01:40:49.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.429+0000 7f9eb6000640 1 -- 172.21.15.42:0/3018828412 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f9ec8062d40 con 0x555d8d315710 2024-09-17T01:40:49.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.429+0000 7f9ededfc740 10 client.8190 fetch_fsmap learned FSMap version 98 2024-09-17T01:40:49.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.429+0000 7f9ededfc740 1 -- 172.21.15.42:0/3018828412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x555d8d2caef0 con 0x555d8d315710 2024-09-17T01:40:49.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.430+0000 7f9eb6000640 1 -- 172.21.15.42:0/3018828412 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ebc004320 con 0x555d8d315710 2024-09-17T01:40:49.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.430+0000 7f9eb6000640 1 -- 172.21.15.42:0/3018828412 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7f9ec8069270 con 0x555d8d315710 2024-09-17T01:40:49.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.430+0000 7f9ededfc740 10 client.8190 fetch_fsmap finished waiting for FSMap version 98 2024-09-17T01:40:49.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.430+0000 7f9ededfc740 10 client.8190 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:40:49.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.430+0000 7f9ededfc740 20 client.8190 populate_metadata read hostname 'smithi042' 2024-09-17T01:40:49.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.430+0000 7f9ededfc740 1 --2- 172.21.15.42:0/3018828412 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x555d8d2f3e10 0x555d8d3926a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:49.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.430+0000 7f9ededfc740 4 client.8190 mds_command: new command op to 8061 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T01:40:49.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.430+0000 7f9ededfc740 1 -- 172.21.15.42:0/3018828412 --> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] -- command(tid 0: {"prefix": "status"}) -- 0x555d8d23efd0 con 0x555d8d2f3e10 2024-09-17T01:40:49.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.430+0000 7f9ed5200640 1 --2- 172.21.15.42:0/3018828412 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x555d8d2f3e10 0x555d8d3926a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:49.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.431+0000 7f9eb6000640 10 client.8190 ms_handle_connect on v2:172.21.15.42:6834/970028636 2024-09-17T01:40:49.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.431+0000 7f9ed5200640 1 --2- 172.21.15.42:0/3018828412 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x555d8d2f3e10 0x555d8d3926a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5283ff51e5d01ef1 server_cookie=49e5db25fb971d7 in_seq=0 out_seq=0 2024-09-17T01:40:49.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.431+0000 7f9eb6000640 1 -- 172.21.15.42:0/3018828412 <== mds.0 v2:172.21.15.42:6834/970028636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x555d8d23efd0 con 0x555d8d2f3e10 2024-09-17T01:40:49.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.431+0000 7f9eb6000640 10 client.8190 handle_command_reply: tid=0 2024-09-17T01:40:49.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.431+0000 7f9ededfc740 1 client.8190 shutdown 2024-09-17T01:40:49.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.431+0000 7f9ededfc740 1 -- 172.21.15.42:0/3018828412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8d315710 msgr2=0x555d8d316390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:49.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.431+0000 7f9ededfc740 1 --2- 172.21.15.42:0/3018828412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8d315710 0x555d8d316390 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80630f0 tx=0x7f9ec8062a70 comp rx=0 tx=0).stop 2024-09-17T01:40:49.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.431+0000 7f9ededfc740 1 -- 172.21.15.42:0/3018828412 shutdown_connections 2024-09-17T01:40:49.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.431+0000 7f9ededfc740 1 --2- 172.21.15.42:0/3018828412 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x555d8d2f3e10 0x555d8d3926a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.431+0000 7f9ededfc740 1 --2- 172.21.15.42:0/3018828412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555d8cf27270 0x555d8d315e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.431+0000 7f9ededfc740 1 --2- 172.21.15.42:0/3018828412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555d8d315710 0x555d8d316390 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.431+0000 7f9ededfc740 1 --2- 172.21.15.42:0/3018828412 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555d8cefe3b0 0x555d8d378400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.431+0000 7f9eb6000640 0 client.8190 ms_handle_reset on v2:172.21.15.42:6834/970028636 2024-09-17T01:40:49.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.431+0000 7f9ededfc740 1 -- 172.21.15.42:0/3018828412 >> 172.21.15.42:0/3018828412 conn(0x555d8cf1b3c0 msgr2=0x555d8d2e76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:49.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.431+0000 7f9ededfc740 1 -- 172.21.15.42:0/3018828412 shutdown_connections 2024-09-17T01:40:49.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.431+0000 7f9ededfc740 1 -- 172.21.15.42:0/3018828412 wait complete. 2024-09-17T01:40:49.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.432+0000 7f9ededfc740 20 client.8190 trim_cache size 0 max 16384 2024-09-17T01:40:49.433 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:40:49.433 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "fea1c88c-cb05-432f-a745-f9dcbb5f2503", 2024-09-17T01:40:49.433 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-17T01:40:49.433 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 8061, 2024-09-17T01:40:49.433 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-17T01:40:49.433 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-17T01:40:49.433 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-17T01:40:49.433 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 6.7553476080000001, 2024-09-17T01:40:49.434 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 98, 2024-09-17T01:40:49.434 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 124, 2024-09-17T01:40:49.434 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 123, 2024-09-17T01:40:49.434 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 11.720318693999999 2024-09-17T01:40:49.434 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:40:49.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.432+0000 7f9ed7c00640 1 -- 172.21.15.42:0/3100323250 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9eb0078b90 msgr2=0x7f9eb007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:49.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.432+0000 7f9ed7c00640 1 --2- 172.21.15.42:0/3100323250 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9eb0078b90 0x7f9eb007b0a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40015e0 tx=0x7f9ec4009040 comp rx=0 tx=0).stop 2024-09-17T01:40:49.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.432+0000 7f9ed7c00640 1 -- 172.21.15.42:0/3100323250 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ed0142f40 msgr2=0x7f9ed015e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:49.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.432+0000 7f9ed7c00640 1 --2- 172.21.15.42:0/3100323250 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ed0142f40 0x7f9ed015e300 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800e990 tx=0x7f9ec800ee50 comp rx=0 tx=0).stop 2024-09-17T01:40:49.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.432+0000 7f9ed7c00640 1 -- 172.21.15.42:0/3100323250 shutdown_connections 2024-09-17T01:40:49.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.432+0000 7f9ed7c00640 1 --2- 172.21.15.42:0/3100323250 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9eb0078b90 0x7f9eb007b0a0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.432+0000 7f9ed7c00640 1 --2- 172.21.15.42:0/3100323250 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ed0142f40 0x7f9ed015e300 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.432+0000 7f9ed7c00640 1 --2- 172.21.15.42:0/3100323250 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ed00b3550 0x7f9ed01f6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.432+0000 7f9ed7c00640 1 --2- 172.21.15.42:0/3100323250 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ed0072e90 0x7f9ed01e62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.432+0000 7f9ed7c00640 1 -- 172.21.15.42:0/3100323250 >> 172.21.15.42:0/3100323250 conn(0x7f9ed00b2930 msgr2=0x7f9ed015f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:49.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.432+0000 7f9ed7c00640 1 -- 172.21.15.42:0/3100323250 shutdown_connections 2024-09-17T01:40:49.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.432+0000 7f9ed7c00640 1 -- 172.21.15.42:0/3100323250 wait complete. 2024-09-17T01:40:49.453 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T01:40:49.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.684+0000 7f25b1e00640 1 -- 172.21.15.42:0/3068782733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2590003c10 msgr2=0x7f2590004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:49.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.684+0000 7f25b1e00640 1 --2- 172.21.15.42:0/3068782733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2590003c10 0x7f2590004060 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f259c006f60 tx=0x7f2590005830 comp rx=0 tx=0).stop 2024-09-17T01:40:49.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.684+0000 7f25ab400640 1 -- 172.21.15.42:0/3068782733 reap_dead start 2024-09-17T01:40:49.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.684+0000 7f25b1e00640 1 -- 172.21.15.42:0/3068782733 shutdown_connections 2024-09-17T01:40:49.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.684+0000 7f25b1e00640 1 -- 172.21.15.42:0/3068782733 >> 172.21.15.42:0/3068782733 conn(0x7f25ac0b2930 msgr2=0x7f25ac06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:49.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.684+0000 7f25b1e00640 1 -- 172.21.15.42:0/3068782733 shutdown_connections 2024-09-17T01:40:49.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.684+0000 7f25b1e00640 1 -- 172.21.15.42:0/3068782733 wait complete. 2024-09-17T01:40:49.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.687+0000 7f25b1e00640 1 Processor -- start 2024-09-17T01:40:49.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.687+0000 7f25b1e00640 1 -- start start 2024-09-17T01:40:49.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.688+0000 7f25b1e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2590003c10 0x7f25ac156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:49.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.688+0000 7f25b1e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25ac1595c0 0x7f25ac14abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:49.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.688+0000 7f25b1e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f25ac1f5620 0x7f25ac1f5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:49.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.688+0000 7f25b1e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac074130 con 0x7f25ac1595c0 2024-09-17T01:40:49.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.688+0000 7f25b1e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac073fb0 con 0x7f2590003c10 2024-09-17T01:40:49.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.688+0000 7f25b1e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f25ac06db40 con 0x7f25ac1f5620 2024-09-17T01:40:49.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.689+0000 7f25a3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25ac1595c0 0x7f25ac14abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:49.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.689+0000 7f25a3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25ac1595c0 0x7f25ac14abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59956/0 (socket says 172.21.15.42:59956) 2024-09-17T01:40:49.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.689+0000 7f25a3e00640 1 -- 172.21.15.42:0/3061844327 learned_addr learned my addr 172.21.15.42:0/3061844327 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:40:49.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.689+0000 7f25ab400640 1 --2- 172.21.15.42:0/3061844327 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f25ac1f5620 0x7f25ac1f5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:49.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.689+0000 7f25aaa00640 1 --2- 172.21.15.42:0/3061844327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2590003c10 0x7f25ac156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:49.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.689+0000 7f25a3e00640 1 -- 172.21.15.42:0/3061844327 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f25ac1f5620 msgr2=0x7f25ac1f5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:49.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.689+0000 7f25a3e00640 1 --2- 172.21.15.42:0/3061844327 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f25ac1f5620 0x7f25ac1f5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.689+0000 7f25a3e00640 1 -- 172.21.15.42:0/3061844327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2590003c10 msgr2=0x7f25ac156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:49.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.689+0000 7f25a3e00640 1 --2- 172.21.15.42:0/3061844327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2590003c10 0x7f25ac156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.689+0000 7f25a3e00640 1 -- 172.21.15.42:0/3061844327 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25ac158520 con 0x7f25ac1595c0 2024-09-17T01:40:49.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.689+0000 7f25a3e00640 1 --2- 172.21.15.42:0/3061844327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25ac1595c0 0x7f25ac14abe0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f25940119a0 tx=0x7f2594011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:49.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.690+0000 7f25a3400640 1 -- 172.21.15.42:0/3061844327 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259401e070 con 0x7f25ac1595c0 2024-09-17T01:40:49.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.690+0000 7f25a3400640 1 -- 172.21.15.42:0/3061844327 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f259400fa00 con 0x7f25ac1595c0 2024-09-17T01:40:49.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.690+0000 7f25b1e00640 1 -- 172.21.15.42:0/3061844327 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25ac158800 con 0x7f25ac1595c0 2024-09-17T01:40:49.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.690+0000 7f25a3400640 1 -- 172.21.15.42:0/3061844327 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259400fe10 con 0x7f25ac1595c0 2024-09-17T01:40:49.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.690+0000 7f25b1e00640 1 -- 172.21.15.42:0/3061844327 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25ac158dc0 con 0x7f25ac1595c0 2024-09-17T01:40:49.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.691+0000 7f25b1e00640 1 -- 172.21.15.42:0/3061844327 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25ac06a170 con 0x7f25ac1595c0 2024-09-17T01:40:49.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.693+0000 7f25a3400640 1 -- 172.21.15.42:0/3061844327 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2594021070 con 0x7f25ac1595c0 2024-09-17T01:40:49.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.694+0000 7f25a3400640 1 --2- 172.21.15.42:0/3061844327 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2588078b90 0x7f258807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:49.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.694+0000 7f25a3400640 1 -- 172.21.15.42:0/3061844327 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5767+0+0 (secure 0 0 0) 0x7f259409b9e0 con 0x7f25ac1595c0 2024-09-17T01:40:49.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.694+0000 7f25aaa00640 1 --2- 172.21.15.42:0/3061844327 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2588078b90 0x7f258807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:49.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.695+0000 7f25aaa00640 1 --2- 172.21.15.42:0/3061844327 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2588078b90 0x7f258807b0a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f259c033000 tx=0x7f259c02d000 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:49.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.699+0000 7f25a3400640 1 -- 172.21.15.42:0/3061844327 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2594063790 con 0x7f25ac1595c0 2024-09-17T01:40:49.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.931+0000 7f25b1e00640 1 -- 172.21.15.42:0/3061844327 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f25ac073a40 con 0x7f25ac1595c0 2024-09-17T01:40:49.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.932+0000 7f25a3400640 1 -- 172.21.15.42:0/3061844327 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v98) ==== 53+0+73 (secure 0 0 0) 0x7f25940681c0 con 0x7f25ac1595c0 2024-09-17T01:40:49.930 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T01:40:49.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.934+0000 7f25b1e00640 1 -- 172.21.15.42:0/3061844327 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2588078b90 msgr2=0x7f258807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:49.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.934+0000 7f25b1e00640 1 --2- 172.21.15.42:0/3061844327 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2588078b90 0x7f258807b0a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f259c033000 tx=0x7f259c02d000 comp rx=0 tx=0).stop 2024-09-17T01:40:49.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.934+0000 7f25b1e00640 1 -- 172.21.15.42:0/3061844327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25ac1595c0 msgr2=0x7f25ac14abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:49.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.934+0000 7f25b1e00640 1 --2- 172.21.15.42:0/3061844327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25ac1595c0 0x7f25ac14abe0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f25940119a0 tx=0x7f2594011e60 comp rx=0 tx=0).stop 2024-09-17T01:40:49.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.934+0000 7f25b1e00640 1 -- 172.21.15.42:0/3061844327 shutdown_connections 2024-09-17T01:40:49.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.934+0000 7f25b1e00640 1 --2- 172.21.15.42:0/3061844327 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2588078b90 0x7f258807b0a0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.934+0000 7f25b1e00640 1 --2- 172.21.15.42:0/3061844327 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f25ac1f5620 0x7f25ac1f5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.934+0000 7f25b1e00640 1 --2- 172.21.15.42:0/3061844327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25ac1595c0 0x7f25ac14abe0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.934+0000 7f25b1e00640 1 --2- 172.21.15.42:0/3061844327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2590003c10 0x7f25ac156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:49.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.934+0000 7f25b1e00640 1 -- 172.21.15.42:0/3061844327 >> 172.21.15.42:0/3061844327 conn(0x7f25ac0b2930 msgr2=0x7f25ac0af080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:49.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.934+0000 7f25b1e00640 1 -- 172.21.15.42:0/3061844327 shutdown_connections 2024-09-17T01:40:49.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:49.934+0000 7f25b1e00640 1 -- 172.21.15.42:0/3061844327 wait complete. 2024-09-17T01:40:49.957 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T01:40:49.957 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:40:49.957 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-09-17T01:40:49.957 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T01:40:49.957 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:40:49.957 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T01:40:49.958 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T01:40:49.958 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:40:49.958 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:40:49.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:40:49.958 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-09-17T01:40:49.996 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:40:49.996 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:40:49.996 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:40:49.997 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:40:49.997 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-17T01:40:49.997 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:40:49.997 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:40:49.997 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-09-17T01:40:49.997 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-09-17T01:40:49.998 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:40:49.998 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-09-17T01:40:49.998 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-09-17T01:40:49.998 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:40:49.998 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:40:49.999 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-09-17T01:40:49.999 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-17T01:40:49.999 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42158sec preferred_lft 42158sec 2024-09-17T01:40:49.999 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-17T01:40:49.999 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:40:50.000 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:40:50.000 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:40:50.000 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-09-17T01:40:50.000 INFO:teuthology.orchestra.run.smithi042.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T01:40:50.000 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T01:40:50.000 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T01:40:50.001 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:40:50.001 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::68d2:2bff:fe2f:191a/64 scope link 2024-09-17T01:40:50.001 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:40:50.001 INFO:teuthology.orchestra.run.smithi042.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:40:50.001 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether e2:73:3e:9b:8a:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:40:50.001 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::e073:3eff:fe9b:8a00/64 scope link 2024-09-17T01:40:50.002 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:40:50.002 INFO:teuthology.orchestra.run.smithi042.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:40:50.002 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T01:40:50.002 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::240b:bfff:feb7:6e5b/64 scope link 2024-09-17T01:40:50.002 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:40:50.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:40:50.003 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:40:50.090 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-17T01:40:50.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:40:50.093 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-09-17T01:40:50.130 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-09-17T01:40:50.130 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:40:50.130 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-17T01:40:50.130 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-17T01:40:50.130 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:40:50.130 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:40:50.130 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:40:50.131 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T01:40:50.131 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T01:40:50.131 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T01:40:50.131 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:40:50.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:40:50.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:40:50.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:40:50.331 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-17T01:40:50.368 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T01:40:50.369 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T01:40:50.369 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:40:50.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:40:50.369 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-09-17T01:40:50.467 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:40:50.467 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T01:40:50.506 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:40:50.506 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:40:50.506 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:40:50.583 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T01:40:50.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:40:50.583 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:40:50.681 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:40:50.686 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:40:50.791 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:40:50.792 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:40:50.792 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:40:50.815 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:40:50.815 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:40:50.815 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:40:50.815 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:40:50.815 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:40:50.851 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:40:50.851 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:40:50.852 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:40:50.852 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:40:50.852 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:40:50.852 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-09-17T01:40:50.852 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-09-17T01:40:50.852 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fea1c88c-cb05-432f-a745-f9dcbb5f2503" will pass to kernel 2024-09-17T01:40:50.855 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T01:40:50.855 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-09-17T01:40:50.855 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T01:40:50.855 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T01:40:50.855 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T01:40:50.859 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T01:40:50.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:40:50.859 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:40:50.970 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:40:51.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:40:51.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:40:51.069 INFO:teuthology.orchestra.run.smithi042.stdout:client8199 2024-09-17T01:40:51.070 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:40:51.070 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:40:51.106 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:40:51.106 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:40:51.106 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.0 2024-09-17T01:40:51.106 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:40:51.107 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:40:51.107 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:40:51.107 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:40:51.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:40:51.264 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.264 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.264 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200105 s, 52.4 MB/s 2024-09-17T01:40:51.283 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.283 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.283 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016504 s, 63.5 MB/s 2024-09-17T01:40:51.308 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.308 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.308 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214889 s, 48.8 MB/s 2024-09-17T01:40:51.330 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.330 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.331 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191803 s, 54.7 MB/s 2024-09-17T01:40:51.352 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.352 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.352 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179644 s, 58.4 MB/s 2024-09-17T01:40:51.370 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.370 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.371 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149903 s, 70.0 MB/s 2024-09-17T01:40:51.392 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.393 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.393 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180982 s, 57.9 MB/s 2024-09-17T01:40:51.411 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.411 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.411 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152807 s, 68.6 MB/s 2024-09-17T01:40:51.433 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.434 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.434 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186971 s, 56.1 MB/s 2024-09-17T01:40:51.455 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.455 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.456 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183821 s, 57.0 MB/s 2024-09-17T01:40:51.474 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.474 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.474 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152 s, 69.0 MB/s 2024-09-17T01:40:51.490 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.490 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.490 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124458 s, 84.3 MB/s 2024-09-17T01:40:51.508 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.508 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.509 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144237 s, 72.7 MB/s 2024-09-17T01:40:51.527 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.528 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.528 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157324 s, 66.7 MB/s 2024-09-17T01:40:51.552 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.552 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.553 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205114 s, 51.1 MB/s 2024-09-17T01:40:51.575 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.576 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.576 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202132 s, 51.9 MB/s 2024-09-17T01:40:51.598 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.598 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.598 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178424 s, 58.8 MB/s 2024-09-17T01:40:51.614 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.614 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.614 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131299 s, 79.9 MB/s 2024-09-17T01:40:51.631 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.632 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.632 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140757 s, 74.5 MB/s 2024-09-17T01:40:51.650 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.650 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.651 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151216 s, 69.3 MB/s 2024-09-17T01:40:51.668 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.668 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.668 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135133 s, 77.6 MB/s 2024-09-17T01:40:51.691 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.691 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.691 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019968 s, 52.5 MB/s 2024-09-17T01:40:51.711 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.711 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.711 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016123 s, 65.0 MB/s 2024-09-17T01:40:51.728 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.728 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.728 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144344 s, 72.6 MB/s 2024-09-17T01:40:51.747 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.747 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.747 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159116 s, 65.9 MB/s 2024-09-17T01:40:51.766 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.766 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.766 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158919 s, 66.0 MB/s 2024-09-17T01:40:51.783 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.783 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.783 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013994 s, 74.9 MB/s 2024-09-17T01:40:51.802 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.802 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.802 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158446 s, 66.2 MB/s 2024-09-17T01:40:51.821 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.822 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.822 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158507 s, 66.2 MB/s 2024-09-17T01:40:51.838 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.838 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.838 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130432 s, 80.4 MB/s 2024-09-17T01:40:51.862 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.862 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.862 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021023 s, 49.9 MB/s 2024-09-17T01:40:51.884 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.884 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.884 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186006 s, 56.4 MB/s 2024-09-17T01:40:51.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:40:51.894 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:40:51.895 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:40:51.895 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.1 2024-09-17T01:40:51.895 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:40:51.895 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:40:51.895 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:40:51.895 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:40:51.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:40:51.998 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:51.998 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:51.998 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161947 s, 64.7 MB/s 2024-09-17T01:40:52.021 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.021 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.021 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200058 s, 52.4 MB/s 2024-09-17T01:40:52.042 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.042 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.042 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176805 s, 59.3 MB/s 2024-09-17T01:40:52.061 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.061 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.061 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162281 s, 64.6 MB/s 2024-09-17T01:40:52.078 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.078 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.079 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139595 s, 75.1 MB/s 2024-09-17T01:40:52.098 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.098 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.099 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016621 s, 63.1 MB/s 2024-09-17T01:40:52.118 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.118 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.118 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161711 s, 64.8 MB/s 2024-09-17T01:40:52.136 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.136 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.136 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147292 s, 71.2 MB/s 2024-09-17T01:40:52.155 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.155 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.155 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158496 s, 66.2 MB/s 2024-09-17T01:40:52.174 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.174 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.174 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161883 s, 64.8 MB/s 2024-09-17T01:40:52.189 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.189 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.189 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119337 s, 87.9 MB/s 2024-09-17T01:40:52.210 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.210 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.210 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176949 s, 59.3 MB/s 2024-09-17T01:40:52.232 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.232 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.232 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188262 s, 55.7 MB/s 2024-09-17T01:40:52.248 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.248 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.248 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126156 s, 83.1 MB/s 2024-09-17T01:40:52.266 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.267 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.267 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154419 s, 67.9 MB/s 2024-09-17T01:40:52.284 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.285 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.285 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148026 s, 70.8 MB/s 2024-09-17T01:40:52.305 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.305 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.305 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178806 s, 58.6 MB/s 2024-09-17T01:40:52.328 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.328 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.329 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197776 s, 53.0 MB/s 2024-09-17T01:40:52.348 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.348 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.348 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162571 s, 64.5 MB/s 2024-09-17T01:40:52.364 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.364 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.364 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129461 s, 81.0 MB/s 2024-09-17T01:40:52.381 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.381 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.382 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142196 s, 73.7 MB/s 2024-09-17T01:40:52.399 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.399 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.399 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149463 s, 70.2 MB/s 2024-09-17T01:40:52.417 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.417 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.417 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014446 s, 72.6 MB/s 2024-09-17T01:40:52.434 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.434 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.434 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138828 s, 75.5 MB/s 2024-09-17T01:40:52.452 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.452 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.452 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149193 s, 70.3 MB/s 2024-09-17T01:40:52.467 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.467 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.467 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116015 s, 90.4 MB/s 2024-09-17T01:40:52.481 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.482 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.482 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117745 s, 89.1 MB/s 2024-09-17T01:40:52.500 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.500 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.500 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154615 s, 67.8 MB/s 2024-09-17T01:40:52.522 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.522 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.522 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188483 s, 55.6 MB/s 2024-09-17T01:40:52.540 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.540 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.541 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153345 s, 68.4 MB/s 2024-09-17T01:40:52.558 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.559 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.559 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152415 s, 68.8 MB/s 2024-09-17T01:40:52.577 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.577 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.577 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153394 s, 68.4 MB/s 2024-09-17T01:40:52.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:40:52.586 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:40:52.586 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:40:52.586 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.2 2024-09-17T01:40:52.586 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:40:52.586 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:40:52.586 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:40:52.586 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:40:52.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:40:52.689 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.689 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.689 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165073 s, 63.5 MB/s 2024-09-17T01:40:52.708 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.708 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.708 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157142 s, 66.7 MB/s 2024-09-17T01:40:52.728 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.728 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.728 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166486 s, 63.0 MB/s 2024-09-17T01:40:52.747 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.747 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.747 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156602 s, 67.0 MB/s 2024-09-17T01:40:52.765 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.765 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.765 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145624 s, 72.0 MB/s 2024-09-17T01:40:52.783 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.783 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.783 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144454 s, 72.6 MB/s 2024-09-17T01:40:52.804 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.804 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.804 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184123 s, 56.9 MB/s 2024-09-17T01:40:52.821 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.822 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.822 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141178 s, 74.3 MB/s 2024-09-17T01:40:52.845 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.845 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.845 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204779 s, 51.2 MB/s 2024-09-17T01:40:52.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.866 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175876 s, 59.6 MB/s 2024-09-17T01:40:52.888 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.888 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.888 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186852 s, 56.1 MB/s 2024-09-17T01:40:52.903 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.903 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.903 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118297 s, 88.6 MB/s 2024-09-17T01:40:52.920 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.920 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.920 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145604 s, 72.0 MB/s 2024-09-17T01:40:52.935 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.935 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.936 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120613 s, 86.9 MB/s 2024-09-17T01:40:52.953 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.953 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.953 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145547 s, 72.0 MB/s 2024-09-17T01:40:52.972 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.972 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.972 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158365 s, 66.2 MB/s 2024-09-17T01:40:52.996 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:52.996 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:52.996 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205032 s, 51.1 MB/s 2024-09-17T01:40:53.016 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.016 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.017 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171352 s, 61.2 MB/s 2024-09-17T01:40:53.033 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.033 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.033 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136849 s, 76.6 MB/s 2024-09-17T01:40:53.050 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.050 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.050 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135492 s, 77.4 MB/s 2024-09-17T01:40:53.067 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.067 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.068 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146553 s, 71.5 MB/s 2024-09-17T01:40:53.086 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.086 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.087 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157592 s, 66.5 MB/s 2024-09-17T01:40:53.105 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.105 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.105 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160007 s, 65.5 MB/s 2024-09-17T01:40:53.122 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.122 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.122 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135488 s, 77.4 MB/s 2024-09-17T01:40:53.141 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.141 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.141 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016185 s, 64.8 MB/s 2024-09-17T01:40:53.159 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.160 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.160 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149091 s, 70.3 MB/s 2024-09-17T01:40:53.177 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.177 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.177 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145002 s, 72.3 MB/s 2024-09-17T01:40:53.205 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.205 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.205 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247693 s, 42.3 MB/s 2024-09-17T01:40:53.223 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.223 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.223 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143571 s, 73.0 MB/s 2024-09-17T01:40:53.240 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.240 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.240 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143782 s, 72.9 MB/s 2024-09-17T01:40:53.261 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.261 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.261 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176876 s, 59.3 MB/s 2024-09-17T01:40:53.280 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.281 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.281 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162065 s, 64.7 MB/s 2024-09-17T01:40:53.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:40:53.290 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:40:53.290 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:40:53.290 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.3 2024-09-17T01:40:53.290 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:40:53.290 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:40:53.290 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:40:53.290 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:40:53.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:40:53.391 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.391 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.391 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155806 s, 67.3 MB/s 2024-09-17T01:40:53.409 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.409 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.409 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014564 s, 72.0 MB/s 2024-09-17T01:40:53.430 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.430 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.430 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179831 s, 58.3 MB/s 2024-09-17T01:40:53.449 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.449 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.449 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155664 s, 67.4 MB/s 2024-09-17T01:40:53.466 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.466 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.466 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136605 s, 76.8 MB/s 2024-09-17T01:40:53.489 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.489 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.489 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201182 s, 52.1 MB/s 2024-09-17T01:40:53.508 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.508 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.508 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015459 s, 67.8 MB/s 2024-09-17T01:40:53.525 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.525 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.526 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148075 s, 70.8 MB/s 2024-09-17T01:40:53.543 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.543 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.543 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143821 s, 72.9 MB/s 2024-09-17T01:40:53.561 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.561 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.562 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155123 s, 67.6 MB/s 2024-09-17T01:40:53.579 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.579 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.579 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148186 s, 70.8 MB/s 2024-09-17T01:40:53.598 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.598 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.598 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159081 s, 65.9 MB/s 2024-09-17T01:40:53.616 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.616 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.616 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144474 s, 72.6 MB/s 2024-09-17T01:40:53.635 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.635 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.635 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160624 s, 65.3 MB/s 2024-09-17T01:40:53.652 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.652 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.652 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140919 s, 74.4 MB/s 2024-09-17T01:40:53.673 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.673 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.673 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175339 s, 59.8 MB/s 2024-09-17T01:40:53.688 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.688 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.689 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125336 s, 83.7 MB/s 2024-09-17T01:40:53.711 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.711 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.711 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019301 s, 54.3 MB/s 2024-09-17T01:40:53.735 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.735 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.735 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209702 s, 50.0 MB/s 2024-09-17T01:40:53.752 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.752 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.752 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139122 s, 75.4 MB/s 2024-09-17T01:40:53.769 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.770 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.770 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142232 s, 73.7 MB/s 2024-09-17T01:40:53.789 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.789 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.789 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016093 s, 65.2 MB/s 2024-09-17T01:40:53.806 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.806 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.806 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143658 s, 73.0 MB/s 2024-09-17T01:40:53.826 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.826 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.826 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167702 s, 62.5 MB/s 2024-09-17T01:40:53.845 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.845 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.845 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159287 s, 65.8 MB/s 2024-09-17T01:40:53.863 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.863 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.863 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014542 s, 72.1 MB/s 2024-09-17T01:40:53.884 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.884 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.884 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178121 s, 58.9 MB/s 2024-09-17T01:40:53.901 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.902 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.902 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151039 s, 69.4 MB/s 2024-09-17T01:40:53.923 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.923 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.923 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180521 s, 58.1 MB/s 2024-09-17T01:40:53.940 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.940 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.940 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142278 s, 73.7 MB/s 2024-09-17T01:40:53.960 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.960 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.960 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167062 s, 62.8 MB/s 2024-09-17T01:40:53.977 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:53.977 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:53.978 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141232 s, 74.2 MB/s 2024-09-17T01:40:53.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:40:53.986 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:40:53.987 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:40:53.987 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.4 2024-09-17T01:40:53.987 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:40:53.987 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:40:53.987 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:40:53.987 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:40:54.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:40:54.088 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.088 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.088 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151228 s, 69.3 MB/s 2024-09-17T01:40:54.112 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.113 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.113 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210318 s, 49.9 MB/s 2024-09-17T01:40:54.135 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.135 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.135 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193243 s, 54.3 MB/s 2024-09-17T01:40:54.154 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.154 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.154 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157778 s, 66.5 MB/s 2024-09-17T01:40:54.169 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.170 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.170 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125721 s, 83.4 MB/s 2024-09-17T01:40:54.188 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.188 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.188 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148517 s, 70.6 MB/s 2024-09-17T01:40:54.204 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.205 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.205 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139137 s, 75.4 MB/s 2024-09-17T01:40:54.222 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.222 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.222 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014286 s, 73.4 MB/s 2024-09-17T01:40:54.240 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.241 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.241 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154705 s, 67.8 MB/s 2024-09-17T01:40:54.259 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.259 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.259 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015436 s, 67.9 MB/s 2024-09-17T01:40:54.276 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.276 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.277 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141675 s, 74.0 MB/s 2024-09-17T01:40:54.296 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.296 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.296 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162472 s, 64.5 MB/s 2024-09-17T01:40:54.313 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.313 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.313 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137447 s, 76.3 MB/s 2024-09-17T01:40:54.333 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.333 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.333 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169913 s, 61.7 MB/s 2024-09-17T01:40:54.351 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.351 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.351 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148624 s, 70.6 MB/s 2024-09-17T01:40:54.369 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.370 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.370 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153907 s, 68.1 MB/s 2024-09-17T01:40:54.389 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.389 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.389 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159805 s, 65.6 MB/s 2024-09-17T01:40:54.406 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.406 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.407 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145507 s, 72.1 MB/s 2024-09-17T01:40:54.424 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.424 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.424 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143728 s, 73.0 MB/s 2024-09-17T01:40:54.441 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.441 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.441 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013717 s, 76.4 MB/s 2024-09-17T01:40:54.459 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.459 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.459 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144711 s, 72.5 MB/s 2024-09-17T01:40:54.476 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.476 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.477 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145808 s, 71.9 MB/s 2024-09-17T01:40:54.492 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.492 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.492 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120073 s, 87.3 MB/s 2024-09-17T01:40:54.508 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.509 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.509 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136546 s, 76.8 MB/s 2024-09-17T01:40:54.530 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.530 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.530 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018641 s, 56.3 MB/s 2024-09-17T01:40:54.546 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.546 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.546 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123465 s, 84.9 MB/s 2024-09-17T01:40:54.566 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.567 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.567 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176181 s, 59.5 MB/s 2024-09-17T01:40:54.585 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.585 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.585 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152605 s, 68.7 MB/s 2024-09-17T01:40:54.604 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.605 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.605 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167812 s, 62.5 MB/s 2024-09-17T01:40:54.625 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.625 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.625 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017586 s, 59.6 MB/s 2024-09-17T01:40:54.643 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.643 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.643 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145284 s, 72.2 MB/s 2024-09-17T01:40:54.660 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.660 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.661 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143215 s, 73.2 MB/s 2024-09-17T01:40:54.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:40:54.669 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:40:54.670 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:40:54.670 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.5 2024-09-17T01:40:54.670 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:40:54.670 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:40:54.670 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:40:54.670 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:40:54.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:40:54.773 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.773 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.773 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153155 s, 68.5 MB/s 2024-09-17T01:40:54.792 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.792 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.792 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159348 s, 65.8 MB/s 2024-09-17T01:40:54.814 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.814 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.814 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018478 s, 56.7 MB/s 2024-09-17T01:40:54.831 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.831 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.831 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136747 s, 76.7 MB/s 2024-09-17T01:40:54.849 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.849 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.849 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148993 s, 70.4 MB/s 2024-09-17T01:40:54.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.866 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142207 s, 73.7 MB/s 2024-09-17T01:40:54.885 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.885 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.885 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151035 s, 69.4 MB/s 2024-09-17T01:40:54.903 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.904 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.904 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154431 s, 67.9 MB/s 2024-09-17T01:40:54.923 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.923 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.923 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016236 s, 64.6 MB/s 2024-09-17T01:40:54.941 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.941 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.941 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149585 s, 70.1 MB/s 2024-09-17T01:40:54.958 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.958 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.958 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145161 s, 72.2 MB/s 2024-09-17T01:40:54.977 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.977 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.977 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152835 s, 68.6 MB/s 2024-09-17T01:40:54.997 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:54.998 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:54.998 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178241 s, 58.8 MB/s 2024-09-17T01:40:55.015 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.015 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.015 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140884 s, 74.4 MB/s 2024-09-17T01:40:55.040 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.040 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.040 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218337 s, 48.0 MB/s 2024-09-17T01:40:55.057 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.057 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.057 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144563 s, 72.5 MB/s 2024-09-17T01:40:55.078 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.078 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.079 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182477 s, 57.5 MB/s 2024-09-17T01:40:55.096 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.096 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.096 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140826 s, 74.5 MB/s 2024-09-17T01:40:55.114 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.114 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.115 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153518 s, 68.3 MB/s 2024-09-17T01:40:55.133 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.133 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.133 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149525 s, 70.1 MB/s 2024-09-17T01:40:55.150 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.150 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.150 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138915 s, 75.5 MB/s 2024-09-17T01:40:55.168 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.169 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.169 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015714 s, 66.7 MB/s 2024-09-17T01:40:55.187 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.187 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.188 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155683 s, 67.4 MB/s 2024-09-17T01:40:55.206 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.206 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.206 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147018 s, 71.3 MB/s 2024-09-17T01:40:55.223 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.223 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.223 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143797 s, 72.9 MB/s 2024-09-17T01:40:55.241 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.241 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.241 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015059 s, 69.6 MB/s 2024-09-17T01:40:55.258 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.258 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.258 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013641 s, 76.9 MB/s 2024-09-17T01:40:55.276 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.276 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.276 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148637 s, 70.5 MB/s 2024-09-17T01:40:55.291 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.291 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.291 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121223 s, 86.5 MB/s 2024-09-17T01:40:55.313 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.313 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.313 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187364 s, 56.0 MB/s 2024-09-17T01:40:55.331 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.331 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.331 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147636 s, 71.0 MB/s 2024-09-17T01:40:55.350 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.350 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.350 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154157 s, 68.0 MB/s 2024-09-17T01:40:55.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:40:55.359 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:40:55.359 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:40:55.359 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.6 2024-09-17T01:40:55.359 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:40:55.359 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:40:55.359 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:40:55.359 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:40:55.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:40:55.463 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.463 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.463 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179091 s, 58.5 MB/s 2024-09-17T01:40:55.481 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.482 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.482 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156804 s, 66.9 MB/s 2024-09-17T01:40:55.498 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.498 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.498 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136836 s, 76.6 MB/s 2024-09-17T01:40:55.517 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.518 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.518 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163271 s, 64.2 MB/s 2024-09-17T01:40:55.535 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.536 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.536 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147885 s, 70.9 MB/s 2024-09-17T01:40:55.553 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.553 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.553 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139815 s, 75.0 MB/s 2024-09-17T01:40:55.570 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.570 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.571 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148017 s, 70.8 MB/s 2024-09-17T01:40:55.587 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.588 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.588 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139207 s, 75.3 MB/s 2024-09-17T01:40:55.605 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.605 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.605 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144228 s, 72.7 MB/s 2024-09-17T01:40:55.625 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.625 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.625 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165564 s, 63.3 MB/s 2024-09-17T01:40:55.639 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.639 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.639 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108729 s, 96.4 MB/s 2024-09-17T01:40:55.655 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.655 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.655 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013653 s, 76.8 MB/s 2024-09-17T01:40:55.673 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.673 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.673 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139908 s, 74.9 MB/s 2024-09-17T01:40:55.689 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.689 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.689 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134887 s, 77.7 MB/s 2024-09-17T01:40:55.710 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.710 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.710 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172351 s, 60.8 MB/s 2024-09-17T01:40:55.727 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.728 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.728 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149157 s, 70.3 MB/s 2024-09-17T01:40:55.745 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.745 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.745 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013513 s, 77.6 MB/s 2024-09-17T01:40:55.763 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.763 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.763 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143406 s, 73.1 MB/s 2024-09-17T01:40:55.781 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.781 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.781 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139197 s, 75.3 MB/s 2024-09-17T01:40:55.803 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.804 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.804 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193759 s, 54.1 MB/s 2024-09-17T01:40:55.822 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.822 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.822 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015133 s, 69.3 MB/s 2024-09-17T01:40:55.839 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.839 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.839 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014403 s, 72.8 MB/s 2024-09-17T01:40:55.856 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.857 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.857 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142786 s, 73.4 MB/s 2024-09-17T01:40:55.874 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.874 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.874 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147143 s, 71.3 MB/s 2024-09-17T01:40:55.892 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.892 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.892 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144753 s, 72.4 MB/s 2024-09-17T01:40:55.907 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.908 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.908 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127405 s, 82.3 MB/s 2024-09-17T01:40:55.925 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.925 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.925 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144811 s, 72.4 MB/s 2024-09-17T01:40:55.942 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.943 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.943 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143256 s, 73.2 MB/s 2024-09-17T01:40:55.961 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.961 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.961 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152701 s, 68.7 MB/s 2024-09-17T01:40:55.978 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.978 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.978 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135301 s, 77.5 MB/s 2024-09-17T01:40:55.997 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:55.997 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:55.997 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157004 s, 66.8 MB/s 2024-09-17T01:40:56.014 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.014 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.014 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138926 s, 75.5 MB/s 2024-09-17T01:40:56.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:40:56.023 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:40:56.023 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:40:56.023 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.7 2024-09-17T01:40:56.023 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:40:56.023 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:40:56.023 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:40:56.023 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:40:56.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:40:56.127 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.128 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.128 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182636 s, 57.4 MB/s 2024-09-17T01:40:56.145 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.145 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.145 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142479 s, 73.6 MB/s 2024-09-17T01:40:56.168 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.168 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.168 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193862 s, 54.1 MB/s 2024-09-17T01:40:56.185 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.186 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.186 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147557 s, 71.1 MB/s 2024-09-17T01:40:56.203 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.203 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.203 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146127 s, 71.8 MB/s 2024-09-17T01:40:56.221 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.222 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.222 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150246 s, 69.8 MB/s 2024-09-17T01:40:56.239 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.239 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.239 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140157 s, 74.8 MB/s 2024-09-17T01:40:56.257 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.257 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.257 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146852 s, 71.4 MB/s 2024-09-17T01:40:56.278 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.278 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.278 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177942 s, 58.9 MB/s 2024-09-17T01:40:56.295 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.295 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.295 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143301 s, 73.2 MB/s 2024-09-17T01:40:56.313 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.313 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.314 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151482 s, 69.2 MB/s 2024-09-17T01:40:56.330 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.330 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.330 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140594 s, 74.6 MB/s 2024-09-17T01:40:56.348 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.349 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.349 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147169 s, 71.2 MB/s 2024-09-17T01:40:56.366 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.366 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.367 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148485 s, 70.6 MB/s 2024-09-17T01:40:56.384 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.384 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.384 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138846 s, 75.5 MB/s 2024-09-17T01:40:56.406 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.406 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.406 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193079 s, 54.3 MB/s 2024-09-17T01:40:56.428 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.428 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.428 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187819 s, 55.8 MB/s 2024-09-17T01:40:56.445 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.445 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.445 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139543 s, 75.1 MB/s 2024-09-17T01:40:56.463 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.463 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.463 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145648 s, 72.0 MB/s 2024-09-17T01:40:56.481 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.481 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.481 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152594 s, 68.7 MB/s 2024-09-17T01:40:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.498 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144191 s, 72.7 MB/s 2024-09-17T01:40:56.516 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.516 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.516 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144527 s, 72.6 MB/s 2024-09-17T01:40:56.537 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.537 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.537 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187064 s, 56.1 MB/s 2024-09-17T01:40:56.561 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.561 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.561 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202683 s, 51.7 MB/s 2024-09-17T01:40:56.579 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.579 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.579 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147395 s, 71.1 MB/s 2024-09-17T01:40:56.594 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.594 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.594 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012041 s, 87.1 MB/s 2024-09-17T01:40:56.614 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.614 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.614 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169279 s, 61.9 MB/s 2024-09-17T01:40:56.631 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.631 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.631 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140405 s, 74.7 MB/s 2024-09-17T01:40:56.650 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.650 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.650 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159086 s, 65.9 MB/s 2024-09-17T01:40:56.668 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.668 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.668 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143606 s, 73.0 MB/s 2024-09-17T01:40:56.684 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.684 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.685 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013708 s, 76.5 MB/s 2024-09-17T01:40:56.703 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.704 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.704 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157602 s, 66.5 MB/s 2024-09-17T01:40:56.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:40:56.713 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:40:56.713 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:40:56.713 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.8 2024-09-17T01:40:56.713 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:40:56.713 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:40:56.713 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:40:56.713 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:40:56.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:40:56.817 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.818 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.818 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177115 s, 59.2 MB/s 2024-09-17T01:40:56.835 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.835 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.835 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143435 s, 73.1 MB/s 2024-09-17T01:40:56.853 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.853 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.853 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146006 s, 71.8 MB/s 2024-09-17T01:40:56.870 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.870 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.870 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142906 s, 73.4 MB/s 2024-09-17T01:40:56.888 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.888 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.888 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146816 s, 71.4 MB/s 2024-09-17T01:40:56.904 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.904 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.904 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129102 s, 81.2 MB/s 2024-09-17T01:40:56.924 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.924 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.924 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156095 s, 67.2 MB/s 2024-09-17T01:40:56.939 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.939 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.940 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130594 s, 80.3 MB/s 2024-09-17T01:40:56.958 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.958 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.958 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149119 s, 70.3 MB/s 2024-09-17T01:40:56.978 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.978 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.978 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161253 s, 65.0 MB/s 2024-09-17T01:40:56.998 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:56.998 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:56.999 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179225 s, 58.5 MB/s 2024-09-17T01:40:57.017 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.017 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.017 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014987 s, 70.0 MB/s 2024-09-17T01:40:57.034 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.034 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.034 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142851 s, 73.4 MB/s 2024-09-17T01:40:57.054 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.054 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.054 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162848 s, 64.4 MB/s 2024-09-17T01:40:57.071 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.071 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.071 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141795 s, 74.0 MB/s 2024-09-17T01:40:57.089 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.089 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.089 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147776 s, 71.0 MB/s 2024-09-17T01:40:57.107 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.107 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.107 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149242 s, 70.3 MB/s 2024-09-17T01:40:57.129 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.129 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.129 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187945 s, 55.8 MB/s 2024-09-17T01:40:57.147 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.147 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.147 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141522 s, 74.1 MB/s 2024-09-17T01:40:57.164 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.164 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.164 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143111 s, 73.3 MB/s 2024-09-17T01:40:57.182 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.182 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.182 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148559 s, 70.6 MB/s 2024-09-17T01:40:57.198 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.198 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.198 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121972 s, 86.0 MB/s 2024-09-17T01:40:57.216 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.216 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.216 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148035 s, 70.8 MB/s 2024-09-17T01:40:57.233 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.234 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.234 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141612 s, 74.0 MB/s 2024-09-17T01:40:57.250 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.250 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.250 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137221 s, 76.4 MB/s 2024-09-17T01:40:57.268 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.269 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.269 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153115 s, 68.5 MB/s 2024-09-17T01:40:57.286 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.286 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.286 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147569 s, 71.1 MB/s 2024-09-17T01:40:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.303 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.304 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140541 s, 74.6 MB/s 2024-09-17T01:40:57.321 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.321 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.321 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142664 s, 73.5 MB/s 2024-09-17T01:40:57.339 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.339 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.339 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150793 s, 69.5 MB/s 2024-09-17T01:40:57.356 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.357 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.357 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143521 s, 73.1 MB/s 2024-09-17T01:40:57.374 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.374 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.374 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142699 s, 73.5 MB/s 2024-09-17T01:40:57.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:40:57.383 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:40:57.383 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:40:57.384 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.9 2024-09-17T01:40:57.384 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:40:57.384 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:40:57.384 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:40:57.384 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:40:57.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:40:57.484 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.484 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.484 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141362 s, 74.2 MB/s 2024-09-17T01:40:57.501 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.501 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.501 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143883 s, 72.9 MB/s 2024-09-17T01:40:57.519 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.519 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.520 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148174 s, 70.8 MB/s 2024-09-17T01:40:57.538 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.538 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.538 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153551 s, 68.3 MB/s 2024-09-17T01:40:57.559 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.559 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.559 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174706 s, 60.0 MB/s 2024-09-17T01:40:57.576 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.576 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.576 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138933 s, 75.5 MB/s 2024-09-17T01:40:57.593 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.593 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.593 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013981 s, 75.0 MB/s 2024-09-17T01:40:57.610 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.610 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.610 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138378 s, 75.8 MB/s 2024-09-17T01:40:57.628 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.628 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.628 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148655 s, 70.5 MB/s 2024-09-17T01:40:57.647 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.647 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.647 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158018 s, 66.4 MB/s 2024-09-17T01:40:57.666 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.666 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.666 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015496 s, 67.7 MB/s 2024-09-17T01:40:57.683 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.683 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.683 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136151 s, 77.0 MB/s 2024-09-17T01:40:57.701 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.701 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.701 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014223 s, 73.7 MB/s 2024-09-17T01:40:57.719 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.720 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.720 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160507 s, 65.3 MB/s 2024-09-17T01:40:57.738 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.739 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.739 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152299 s, 68.8 MB/s 2024-09-17T01:40:57.760 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.760 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.760 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171243 s, 61.2 MB/s 2024-09-17T01:40:57.778 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.778 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.778 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014787 s, 70.9 MB/s 2024-09-17T01:40:57.796 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.796 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.796 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144138 s, 72.7 MB/s 2024-09-17T01:40:57.815 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.816 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.816 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156095 s, 67.2 MB/s 2024-09-17T01:40:57.833 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.833 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.833 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142165 s, 73.8 MB/s 2024-09-17T01:40:57.858 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.858 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.858 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213729 s, 49.1 MB/s 2024-09-17T01:40:57.876 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.876 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.876 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148495 s, 70.6 MB/s 2024-09-17T01:40:57.893 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.894 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.894 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143118 s, 73.3 MB/s 2024-09-17T01:40:57.910 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.911 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.911 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140781 s, 74.5 MB/s 2024-09-17T01:40:57.928 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.928 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.928 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014721 s, 71.2 MB/s 2024-09-17T01:40:57.946 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.946 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.946 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145162 s, 72.2 MB/s 2024-09-17T01:40:57.963 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.963 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.963 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139087 s, 75.4 MB/s 2024-09-17T01:40:57.981 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.981 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.981 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144178 s, 72.7 MB/s 2024-09-17T01:40:57.997 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:57.997 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:57.997 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129183 s, 81.2 MB/s 2024-09-17T01:40:58.014 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.014 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.014 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139299 s, 75.3 MB/s 2024-09-17T01:40:58.032 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.032 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.032 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145989 s, 71.8 MB/s 2024-09-17T01:40:58.049 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.049 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.049 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139329 s, 75.3 MB/s 2024-09-17T01:40:58.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:40:58.059 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:40:58.059 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:40:58.059 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.10 2024-09-17T01:40:58.059 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:40:58.059 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:40:58.060 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:40:58.060 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:40:58.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:40:58.160 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.160 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.160 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138926 s, 75.5 MB/s 2024-09-17T01:40:58.178 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.178 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.178 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154534 s, 67.9 MB/s 2024-09-17T01:40:58.196 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.196 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.196 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014919 s, 70.3 MB/s 2024-09-17T01:40:58.214 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.215 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.215 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151886 s, 69.0 MB/s 2024-09-17T01:40:58.233 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.233 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.233 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148654 s, 70.5 MB/s 2024-09-17T01:40:58.250 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.251 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.251 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146353 s, 71.6 MB/s 2024-09-17T01:40:58.268 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.268 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.268 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145897 s, 71.9 MB/s 2024-09-17T01:40:58.287 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.288 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.288 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161502 s, 64.9 MB/s 2024-09-17T01:40:58.309 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.310 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.310 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184804 s, 56.7 MB/s 2024-09-17T01:40:58.327 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.327 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.327 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145539 s, 72.0 MB/s 2024-09-17T01:40:58.344 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.345 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.345 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141922 s, 73.9 MB/s 2024-09-17T01:40:58.361 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.361 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.361 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139454 s, 75.2 MB/s 2024-09-17T01:40:58.380 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.381 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.381 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160384 s, 65.4 MB/s 2024-09-17T01:40:58.398 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.398 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.399 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146785 s, 71.4 MB/s 2024-09-17T01:40:58.416 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.416 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.416 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146128 s, 71.8 MB/s 2024-09-17T01:40:58.435 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.435 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.435 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155682 s, 67.4 MB/s 2024-09-17T01:40:58.452 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.452 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.452 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014703 s, 71.3 MB/s 2024-09-17T01:40:58.471 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.471 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.471 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015561 s, 67.4 MB/s 2024-09-17T01:40:58.492 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.493 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.493 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178293 s, 58.8 MB/s 2024-09-17T01:40:58.510 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.510 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.510 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148229 s, 70.7 MB/s 2024-09-17T01:40:58.528 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.528 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.528 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151003 s, 69.4 MB/s 2024-09-17T01:40:58.546 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.546 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.546 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146013 s, 71.8 MB/s 2024-09-17T01:40:58.564 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.564 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.565 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154303 s, 68.0 MB/s 2024-09-17T01:40:58.582 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.582 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.582 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143423 s, 73.1 MB/s 2024-09-17T01:40:58.598 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.599 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.599 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137409 s, 76.3 MB/s 2024-09-17T01:40:58.621 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.621 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.621 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190529 s, 55.0 MB/s 2024-09-17T01:40:58.642 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.642 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.643 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184499 s, 56.8 MB/s 2024-09-17T01:40:58.660 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.660 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.660 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141992 s, 73.8 MB/s 2024-09-17T01:40:58.678 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.678 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.678 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015476 s, 67.8 MB/s 2024-09-17T01:40:58.697 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.697 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.698 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160208 s, 65.5 MB/s 2024-09-17T01:40:58.721 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.721 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.721 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192356 s, 54.5 MB/s 2024-09-17T01:40:58.739 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.739 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.739 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149911 s, 69.9 MB/s 2024-09-17T01:40:58.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:40:58.748 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:40:58.748 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:40:58.748 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.11 2024-09-17T01:40:58.748 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:40:58.748 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:40:58.748 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:40:58.748 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:40:58.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:40:58.853 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.853 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.853 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181733 s, 57.7 MB/s 2024-09-17T01:40:58.878 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.878 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.878 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219436 s, 47.8 MB/s 2024-09-17T01:40:58.895 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.895 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.895 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139516 s, 75.2 MB/s 2024-09-17T01:40:58.917 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.917 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.917 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186822 s, 56.1 MB/s 2024-09-17T01:40:58.935 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.935 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.935 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136712 s, 76.7 MB/s 2024-09-17T01:40:58.951 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.952 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.952 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014918 s, 70.3 MB/s 2024-09-17T01:40:58.976 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.976 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.976 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202204 s, 51.9 MB/s 2024-09-17T01:40:58.992 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:58.992 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:58.992 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139136 s, 75.4 MB/s 2024-09-17T01:40:59.009 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.009 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.009 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013932 s, 75.3 MB/s 2024-09-17T01:40:59.026 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.026 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.026 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140782 s, 74.5 MB/s 2024-09-17T01:40:59.044 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.044 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.044 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144712 s, 72.5 MB/s 2024-09-17T01:40:59.062 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.062 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.062 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151441 s, 69.2 MB/s 2024-09-17T01:40:59.081 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.082 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.082 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164485 s, 63.7 MB/s 2024-09-17T01:40:59.100 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.101 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.101 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160769 s, 65.2 MB/s 2024-09-17T01:40:59.117 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.117 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.117 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138406 s, 75.8 MB/s 2024-09-17T01:40:59.135 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.135 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.135 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144395 s, 72.6 MB/s 2024-09-17T01:40:59.152 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.152 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.153 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139857 s, 75.0 MB/s 2024-09-17T01:40:59.169 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.170 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.170 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141263 s, 74.2 MB/s 2024-09-17T01:40:59.194 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.194 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.194 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211909 s, 49.5 MB/s 2024-09-17T01:40:59.211 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.211 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.211 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142205 s, 73.7 MB/s 2024-09-17T01:40:59.232 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.232 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.232 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177116 s, 59.2 MB/s 2024-09-17T01:40:59.249 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.249 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.249 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013839 s, 75.8 MB/s 2024-09-17T01:40:59.267 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.267 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.267 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148715 s, 70.5 MB/s 2024-09-17T01:40:59.286 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.287 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.287 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160837 s, 65.2 MB/s 2024-09-17T01:40:59.308 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.309 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.309 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187229 s, 56.0 MB/s 2024-09-17T01:40:59.330 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.330 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.330 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186522 s, 56.2 MB/s 2024-09-17T01:40:59.347 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.347 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.347 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139204 s, 75.3 MB/s 2024-09-17T01:40:59.364 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.364 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.364 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013585 s, 77.2 MB/s 2024-09-17T01:40:59.381 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.381 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.381 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142089 s, 73.8 MB/s 2024-09-17T01:40:59.400 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.400 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.400 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150652 s, 69.6 MB/s 2024-09-17T01:40:59.419 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.419 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.420 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166106 s, 63.1 MB/s 2024-09-17T01:40:59.438 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.438 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.438 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156167 s, 67.1 MB/s 2024-09-17T01:40:59.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:40:59.447 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:40:59.447 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:40:59.447 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.12 2024-09-17T01:40:59.448 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:40:59.448 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:40:59.448 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:40:59.448 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:40:59.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:40:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:40:59.549 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.549 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.549 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149873 s, 70.0 MB/s 2024-09-17T01:40:59.566 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.566 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.567 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144441 s, 72.6 MB/s 2024-09-17T01:40:59.584 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.585 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.585 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148316 s, 70.7 MB/s 2024-09-17T01:40:59.602 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.602 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.602 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144834 s, 72.4 MB/s 2024-09-17T01:40:59.620 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.620 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.620 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148462 s, 70.6 MB/s 2024-09-17T01:40:59.637 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.637 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.638 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142817 s, 73.4 MB/s 2024-09-17T01:40:59.657 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.657 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.657 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164649 s, 63.7 MB/s 2024-09-17T01:40:59.682 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.682 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.682 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220264 s, 47.6 MB/s 2024-09-17T01:40:59.699 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.699 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.699 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135495 s, 77.4 MB/s 2024-09-17T01:40:59.718 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.718 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.718 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156339 s, 67.1 MB/s 2024-09-17T01:40:59.736 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.736 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.736 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015302 s, 68.5 MB/s 2024-09-17T01:40:59.759 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.759 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.759 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189576 s, 55.3 MB/s 2024-09-17T01:40:59.780 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.780 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.780 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186517 s, 56.2 MB/s 2024-09-17T01:40:59.797 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.798 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.798 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143006 s, 73.3 MB/s 2024-09-17T01:40:59.817 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.817 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.817 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163684 s, 64.1 MB/s 2024-09-17T01:40:59.838 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.838 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.838 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177635 s, 59.0 MB/s 2024-09-17T01:40:59.859 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.860 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.860 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185177 s, 56.6 MB/s 2024-09-17T01:40:59.876 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.877 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.877 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139622 s, 75.1 MB/s 2024-09-17T01:40:59.901 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.901 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.901 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209248 s, 50.1 MB/s 2024-09-17T01:40:59.922 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.923 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.923 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187257 s, 56.0 MB/s 2024-09-17T01:40:59.941 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.941 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.942 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157591 s, 66.5 MB/s 2024-09-17T01:40:59.960 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.960 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.960 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152996 s, 68.5 MB/s 2024-09-17T01:40:59.977 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.977 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.977 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144254 s, 72.7 MB/s 2024-09-17T01:40:59.994 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:40:59.994 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:40:59.995 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138994 s, 75.4 MB/s 2024-09-17T01:41:00.012 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.012 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.012 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142271 s, 73.7 MB/s 2024-09-17T01:41:00.030 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.030 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.030 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145611 s, 72.0 MB/s 2024-09-17T01:41:00.047 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.047 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.047 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141098 s, 74.3 MB/s 2024-09-17T01:41:00.067 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.067 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.067 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167807 s, 62.5 MB/s 2024-09-17T01:41:00.090 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.090 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.090 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193457 s, 54.2 MB/s 2024-09-17T01:41:00.108 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.108 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.109 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153781 s, 68.2 MB/s 2024-09-17T01:41:00.127 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.127 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.127 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151089 s, 69.4 MB/s 2024-09-17T01:41:00.148 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.148 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.148 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182023 s, 57.6 MB/s 2024-09-17T01:41:00.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:00.157 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:00.157 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:00.157 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.13 2024-09-17T01:41:00.157 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:00.157 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:00.158 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:00.158 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:00.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:00.264 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.265 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.265 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212288 s, 49.4 MB/s 2024-09-17T01:41:00.281 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.282 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.282 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142703 s, 73.5 MB/s 2024-09-17T01:41:00.303 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.303 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.303 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181909 s, 57.6 MB/s 2024-09-17T01:41:00.320 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.320 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.320 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142745 s, 73.5 MB/s 2024-09-17T01:41:00.338 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.338 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.338 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143989 s, 72.8 MB/s 2024-09-17T01:41:00.360 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.360 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.360 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186818 s, 56.1 MB/s 2024-09-17T01:41:00.379 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.380 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.380 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166632 s, 62.9 MB/s 2024-09-17T01:41:00.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.396 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131779 s, 79.6 MB/s 2024-09-17T01:41:00.414 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.414 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.414 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147782 s, 71.0 MB/s 2024-09-17T01:41:00.432 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.432 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.432 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149232 s, 70.3 MB/s 2024-09-17T01:41:00.452 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.453 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.453 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179952 s, 58.3 MB/s 2024-09-17T01:41:00.470 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.470 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.470 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142966 s, 73.3 MB/s 2024-09-17T01:41:00.491 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.491 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.491 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179214 s, 58.5 MB/s 2024-09-17T01:41:00.508 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.508 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.508 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139778 s, 75.0 MB/s 2024-09-17T01:41:00.525 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.525 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.525 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013826 s, 75.8 MB/s 2024-09-17T01:41:00.542 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.542 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.542 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144533 s, 72.5 MB/s 2024-09-17T01:41:00.561 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.561 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.561 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154376 s, 67.9 MB/s 2024-09-17T01:41:00.578 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.578 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.578 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142061 s, 73.8 MB/s 2024-09-17T01:41:00.600 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.600 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.600 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187987 s, 55.8 MB/s 2024-09-17T01:41:00.619 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.619 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.619 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152249 s, 68.9 MB/s 2024-09-17T01:41:00.636 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.636 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.636 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144061 s, 72.8 MB/s 2024-09-17T01:41:00.658 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.658 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.658 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183467 s, 57.2 MB/s 2024-09-17T01:41:00.675 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.676 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.676 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145049 s, 72.3 MB/s 2024-09-17T01:41:00.693 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.693 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.693 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142185 s, 73.7 MB/s 2024-09-17T01:41:00.710 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.710 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.710 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137097 s, 76.5 MB/s 2024-09-17T01:41:00.729 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.729 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.729 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150955 s, 69.5 MB/s 2024-09-17T01:41:00.751 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.751 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.751 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185989 s, 56.4 MB/s 2024-09-17T01:41:00.768 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.768 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.768 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135541 s, 77.4 MB/s 2024-09-17T01:41:00.784 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.785 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.785 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136979 s, 76.6 MB/s 2024-09-17T01:41:00.802 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.802 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.802 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146655 s, 71.5 MB/s 2024-09-17T01:41:00.820 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.820 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.820 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140702 s, 74.5 MB/s 2024-09-17T01:41:00.836 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.836 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.836 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135674 s, 77.3 MB/s 2024-09-17T01:41:00.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:00.845 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:00.845 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:00.845 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.14 2024-09-17T01:41:00.845 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:00.845 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:00.846 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:00.846 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:00.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:00.949 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.949 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.949 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170415 s, 61.5 MB/s 2024-09-17T01:41:00.972 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.972 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.972 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202584 s, 51.8 MB/s 2024-09-17T01:41:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:00.989 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:00.990 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143793 s, 72.9 MB/s 2024-09-17T01:41:01.006 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.007 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.007 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013895 s, 75.5 MB/s 2024-09-17T01:41:01.024 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.024 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.025 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014614 s, 71.8 MB/s 2024-09-17T01:41:01.043 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.043 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.043 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152197 s, 68.9 MB/s 2024-09-17T01:41:01.060 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.060 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.060 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140263 s, 74.8 MB/s 2024-09-17T01:41:01.079 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.079 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.079 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156982 s, 66.8 MB/s 2024-09-17T01:41:01.098 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.098 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.098 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161805 s, 64.8 MB/s 2024-09-17T01:41:01.115 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.115 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.115 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141128 s, 74.3 MB/s 2024-09-17T01:41:01.134 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.134 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.134 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158062 s, 66.3 MB/s 2024-09-17T01:41:01.152 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.152 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.152 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146162 s, 71.7 MB/s 2024-09-17T01:41:01.169 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.169 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.169 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139939 s, 74.9 MB/s 2024-09-17T01:41:01.187 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.187 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.187 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144777 s, 72.4 MB/s 2024-09-17T01:41:01.205 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.205 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.205 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148738 s, 70.5 MB/s 2024-09-17T01:41:01.227 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.227 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.227 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192348 s, 54.5 MB/s 2024-09-17T01:41:01.244 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.244 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.244 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138377 s, 75.8 MB/s 2024-09-17T01:41:01.264 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.265 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.265 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170792 s, 61.4 MB/s 2024-09-17T01:41:01.283 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.283 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.283 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148891 s, 70.4 MB/s 2024-09-17T01:41:01.301 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.301 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.301 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014211 s, 73.8 MB/s 2024-09-17T01:41:01.318 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.318 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.319 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148314 s, 70.7 MB/s 2024-09-17T01:41:01.335 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.335 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.335 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135368 s, 77.5 MB/s 2024-09-17T01:41:01.353 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.353 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.353 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145723 s, 72.0 MB/s 2024-09-17T01:41:01.374 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.374 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.375 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01806 s, 58.1 MB/s 2024-09-17T01:41:01.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.396 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184347 s, 56.9 MB/s 2024-09-17T01:41:01.413 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.413 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.413 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136973 s, 76.6 MB/s 2024-09-17T01:41:01.432 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.432 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.432 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156936 s, 66.8 MB/s 2024-09-17T01:41:01.450 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.450 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.450 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149377 s, 70.2 MB/s 2024-09-17T01:41:01.468 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.468 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.468 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149522 s, 70.1 MB/s 2024-09-17T01:41:01.485 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.485 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.485 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140054 s, 74.9 MB/s 2024-09-17T01:41:01.501 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.501 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.501 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122876 s, 85.3 MB/s 2024-09-17T01:41:01.518 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.518 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.518 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145431 s, 72.1 MB/s 2024-09-17T01:41:01.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:01.528 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:01.528 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:01.528 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.15 2024-09-17T01:41:01.528 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:01.529 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:01.529 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:01.529 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:01.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:01.629 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.629 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.629 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140156 s, 74.8 MB/s 2024-09-17T01:41:01.647 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.647 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.647 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147305 s, 71.2 MB/s 2024-09-17T01:41:01.668 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.668 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.669 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018344 s, 57.2 MB/s 2024-09-17T01:41:01.690 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.690 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.690 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185783 s, 56.4 MB/s 2024-09-17T01:41:01.710 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.710 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.711 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016869 s, 62.2 MB/s 2024-09-17T01:41:01.729 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.729 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.729 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156501 s, 67.0 MB/s 2024-09-17T01:41:01.748 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.748 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.749 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163997 s, 63.9 MB/s 2024-09-17T01:41:01.767 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.767 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.767 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156945 s, 66.8 MB/s 2024-09-17T01:41:01.786 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.786 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.786 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150822 s, 69.5 MB/s 2024-09-17T01:41:01.803 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.803 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.803 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145385 s, 72.1 MB/s 2024-09-17T01:41:01.822 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.822 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.822 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154114 s, 68.0 MB/s 2024-09-17T01:41:01.841 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.841 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.841 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156199 s, 67.1 MB/s 2024-09-17T01:41:01.858 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.858 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.858 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143124 s, 73.3 MB/s 2024-09-17T01:41:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145618 s, 72.0 MB/s 2024-09-17T01:41:01.891 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.891 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.892 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122166 s, 85.8 MB/s 2024-09-17T01:41:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.910 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156036 s, 67.2 MB/s 2024-09-17T01:41:01.932 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.932 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.932 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188168 s, 55.7 MB/s 2024-09-17T01:41:01.950 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.950 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.950 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147223 s, 71.2 MB/s 2024-09-17T01:41:01.968 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.968 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.968 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014453 s, 72.6 MB/s 2024-09-17T01:41:01.986 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:01.986 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:01.986 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144157 s, 72.7 MB/s 2024-09-17T01:41:02.006 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.006 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.007 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173979 s, 60.3 MB/s 2024-09-17T01:41:02.025 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.025 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.025 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151294 s, 69.3 MB/s 2024-09-17T01:41:02.043 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.043 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.044 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156966 s, 66.8 MB/s 2024-09-17T01:41:02.062 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.063 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.063 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159788 s, 65.6 MB/s 2024-09-17T01:41:02.080 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.080 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.081 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014822 s, 70.7 MB/s 2024-09-17T01:41:02.102 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.102 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.102 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187153 s, 56.0 MB/s 2024-09-17T01:41:02.121 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.121 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.121 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157608 s, 66.5 MB/s 2024-09-17T01:41:02.138 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.138 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.138 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140305 s, 74.7 MB/s 2024-09-17T01:41:02.155 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.155 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.156 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139268 s, 75.3 MB/s 2024-09-17T01:41:02.171 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.172 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.172 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130349 s, 80.4 MB/s 2024-09-17T01:41:02.193 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.193 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.193 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179499 s, 58.4 MB/s 2024-09-17T01:41:02.209 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.209 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.209 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136411 s, 76.9 MB/s 2024-09-17T01:41:02.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:02.219 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:02.219 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:02.219 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.16 2024-09-17T01:41:02.219 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:02.219 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:02.219 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:02.219 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:02.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:02.320 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.320 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.320 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149302 s, 70.2 MB/s 2024-09-17T01:41:02.341 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.341 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.342 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182137 s, 57.6 MB/s 2024-09-17T01:41:02.359 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.359 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.359 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142989 s, 73.3 MB/s 2024-09-17T01:41:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018102 s, 57.9 MB/s 2024-09-17T01:41:02.397 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.397 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.397 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140878 s, 74.4 MB/s 2024-09-17T01:41:02.415 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.415 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.415 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148575 s, 70.6 MB/s 2024-09-17T01:41:02.437 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.437 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.437 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181586 s, 57.7 MB/s 2024-09-17T01:41:02.454 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.454 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.454 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142817 s, 73.4 MB/s 2024-09-17T01:41:02.473 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.473 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.473 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155452 s, 67.5 MB/s 2024-09-17T01:41:02.488 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.489 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.489 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125252 s, 83.7 MB/s 2024-09-17T01:41:02.507 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.507 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.507 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149951 s, 69.9 MB/s 2024-09-17T01:41:02.524 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.525 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.525 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148711 s, 70.5 MB/s 2024-09-17T01:41:02.545 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.545 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.546 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178108 s, 58.9 MB/s 2024-09-17T01:41:02.562 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.563 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.563 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142102 s, 73.8 MB/s 2024-09-17T01:41:02.580 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.580 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.580 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014272 s, 73.5 MB/s 2024-09-17T01:41:02.601 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.602 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.602 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181242 s, 57.9 MB/s 2024-09-17T01:41:02.619 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.620 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.620 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147969 s, 70.9 MB/s 2024-09-17T01:41:02.637 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.637 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.637 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138926 s, 75.5 MB/s 2024-09-17T01:41:02.655 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.655 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.655 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148941 s, 70.4 MB/s 2024-09-17T01:41:02.670 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.670 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.670 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120905 s, 86.7 MB/s 2024-09-17T01:41:02.692 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.692 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.692 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018666 s, 56.2 MB/s 2024-09-17T01:41:02.713 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.713 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.713 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178878 s, 58.6 MB/s 2024-09-17T01:41:02.735 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.735 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.735 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188867 s, 55.5 MB/s 2024-09-17T01:41:02.765 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.765 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.765 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252715 s, 41.5 MB/s 2024-09-17T01:41:02.789 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.789 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.790 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203441 s, 51.5 MB/s 2024-09-17T01:41:02.810 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.811 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.811 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172439 s, 60.8 MB/s 2024-09-17T01:41:02.829 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.829 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.829 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149454 s, 70.2 MB/s 2024-09-17T01:41:02.850 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.850 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.850 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180085 s, 58.2 MB/s 2024-09-17T01:41:02.871 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.871 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.871 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181193 s, 57.9 MB/s 2024-09-17T01:41:02.891 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.891 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.892 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171935 s, 61.0 MB/s 2024-09-17T01:41:02.911 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.911 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.911 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168299 s, 62.3 MB/s 2024-09-17T01:41:02.929 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:02.929 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:02.929 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144672 s, 72.5 MB/s 2024-09-17T01:41:02.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:02.938 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:02.938 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:02.938 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.17 2024-09-17T01:41:02.938 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:02.938 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:02.938 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:02.939 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:03.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:03.042 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.042 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.042 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171885 s, 61.0 MB/s 2024-09-17T01:41:03.060 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.060 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.060 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157689 s, 66.5 MB/s 2024-09-17T01:41:03.078 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.078 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.078 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014273 s, 73.5 MB/s 2024-09-17T01:41:03.094 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.095 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.095 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141557 s, 74.1 MB/s 2024-09-17T01:41:03.112 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.112 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.113 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145905 s, 71.9 MB/s 2024-09-17T01:41:03.131 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.131 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.131 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156357 s, 67.1 MB/s 2024-09-17T01:41:03.150 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.150 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.150 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157491 s, 66.6 MB/s 2024-09-17T01:41:03.173 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.173 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.173 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197388 s, 53.1 MB/s 2024-09-17T01:41:03.189 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.189 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.190 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131328 s, 79.8 MB/s 2024-09-17T01:41:03.208 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.208 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.208 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152984 s, 68.5 MB/s 2024-09-17T01:41:03.225 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.225 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.225 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142536 s, 73.6 MB/s 2024-09-17T01:41:03.244 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.244 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.245 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159472 s, 65.8 MB/s 2024-09-17T01:41:03.263 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.263 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.263 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015022 s, 69.8 MB/s 2024-09-17T01:41:03.280 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.280 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.280 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139307 s, 75.3 MB/s 2024-09-17T01:41:03.298 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.298 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.298 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150027 s, 69.9 MB/s 2024-09-17T01:41:03.315 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.315 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.315 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014124 s, 74.2 MB/s 2024-09-17T01:41:03.336 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.336 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.336 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173414 s, 60.5 MB/s 2024-09-17T01:41:03.354 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.355 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.355 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159825 s, 65.6 MB/s 2024-09-17T01:41:03.375 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.375 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.375 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170912 s, 61.4 MB/s 2024-09-17T01:41:03.389 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.389 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.389 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117641 s, 89.1 MB/s 2024-09-17T01:41:03.411 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.411 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.411 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186134 s, 56.3 MB/s 2024-09-17T01:41:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.429 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.429 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143426 s, 73.1 MB/s 2024-09-17T01:41:03.448 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.448 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.448 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158489 s, 66.2 MB/s 2024-09-17T01:41:03.465 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.465 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.466 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147688 s, 71.0 MB/s 2024-09-17T01:41:03.486 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.486 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.486 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017426 s, 60.2 MB/s 2024-09-17T01:41:03.501 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.501 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.501 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011325 s, 92.6 MB/s 2024-09-17T01:41:03.518 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.518 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.518 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140016 s, 74.9 MB/s 2024-09-17T01:41:03.535 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.535 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.535 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142509 s, 73.6 MB/s 2024-09-17T01:41:03.553 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.553 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.553 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150093 s, 69.9 MB/s 2024-09-17T01:41:03.570 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.570 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.570 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137074 s, 76.5 MB/s 2024-09-17T01:41:03.590 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.590 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.590 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169286 s, 61.9 MB/s 2024-09-17T01:41:03.608 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.608 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.608 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152887 s, 68.6 MB/s 2024-09-17T01:41:03.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:03.618 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:03.618 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:03.618 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.18 2024-09-17T01:41:03.618 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:03.618 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:03.618 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:03.618 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:03.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:03.718 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.718 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.718 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121803 s, 86.1 MB/s 2024-09-17T01:41:03.740 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.740 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.740 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185664 s, 56.5 MB/s 2024-09-17T01:41:03.761 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.761 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.761 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179051 s, 58.6 MB/s 2024-09-17T01:41:03.779 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.779 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.779 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152014 s, 69.0 MB/s 2024-09-17T01:41:03.797 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.797 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.797 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145755 s, 71.9 MB/s 2024-09-17T01:41:03.818 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.818 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.818 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181703 s, 57.7 MB/s 2024-09-17T01:41:03.840 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.841 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.841 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173534 s, 60.4 MB/s 2024-09-17T01:41:03.855 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.855 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.856 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136552 s, 76.8 MB/s 2024-09-17T01:41:03.873 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.873 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.873 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148889 s, 70.4 MB/s 2024-09-17T01:41:03.897 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.897 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.897 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213211 s, 49.2 MB/s 2024-09-17T01:41:03.914 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.915 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.915 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140818 s, 74.5 MB/s 2024-09-17T01:41:03.933 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.933 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.934 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154325 s, 67.9 MB/s 2024-09-17T01:41:03.950 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.950 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.950 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013719 s, 76.4 MB/s 2024-09-17T01:41:03.969 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.969 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.969 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155764 s, 67.3 MB/s 2024-09-17T01:41:03.986 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:03.986 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:03.986 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013664 s, 76.7 MB/s 2024-09-17T01:41:04.002 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.002 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.003 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137398 s, 76.3 MB/s 2024-09-17T01:41:04.020 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.020 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.020 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142893 s, 73.4 MB/s 2024-09-17T01:41:04.036 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.037 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.037 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134803 s, 77.8 MB/s 2024-09-17T01:41:04.055 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.055 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.055 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150695 s, 69.6 MB/s 2024-09-17T01:41:04.079 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.079 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.079 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211141 s, 49.7 MB/s 2024-09-17T01:41:04.100 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.100 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.100 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018527 s, 56.6 MB/s 2024-09-17T01:41:04.118 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.119 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.119 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014562 s, 72.0 MB/s 2024-09-17T01:41:04.137 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.137 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.137 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015828 s, 66.2 MB/s 2024-09-17T01:41:04.155 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.155 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.155 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143095 s, 73.3 MB/s 2024-09-17T01:41:04.171 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.172 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.172 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138347 s, 75.8 MB/s 2024-09-17T01:41:04.188 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.188 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.188 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135245 s, 77.5 MB/s 2024-09-17T01:41:04.208 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.208 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.208 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160333 s, 65.4 MB/s 2024-09-17T01:41:04.222 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.222 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.222 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114039 s, 91.9 MB/s 2024-09-17T01:41:04.239 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.239 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.239 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014373 s, 73.0 MB/s 2024-09-17T01:41:04.254 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.254 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.254 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117301 s, 89.4 MB/s 2024-09-17T01:41:04.273 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.274 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.274 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163112 s, 64.3 MB/s 2024-09-17T01:41:04.289 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.289 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.289 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126374 s, 83.0 MB/s 2024-09-17T01:41:04.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:04.299 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:04.299 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:04.299 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.19 2024-09-17T01:41:04.299 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:04.299 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:04.299 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:04.299 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:04.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:04.401 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.401 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.401 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01572 s, 66.7 MB/s 2024-09-17T01:41:04.418 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.418 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.418 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136741 s, 76.7 MB/s 2024-09-17T01:41:04.440 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.441 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.441 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195607 s, 53.6 MB/s 2024-09-17T01:41:04.461 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.461 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.461 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177184 s, 59.2 MB/s 2024-09-17T01:41:04.479 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.479 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.479 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147825 s, 70.9 MB/s 2024-09-17T01:41:04.497 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.497 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.497 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143618 s, 73.0 MB/s 2024-09-17T01:41:04.514 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.514 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.514 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014525 s, 72.2 MB/s 2024-09-17T01:41:04.533 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.533 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.533 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160075 s, 65.5 MB/s 2024-09-17T01:41:04.550 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.551 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.551 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140865 s, 74.4 MB/s 2024-09-17T01:41:04.567 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.568 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.568 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140072 s, 74.9 MB/s 2024-09-17T01:41:04.585 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.585 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.585 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137077 s, 76.5 MB/s 2024-09-17T01:41:04.608 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.609 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.609 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209237 s, 50.1 MB/s 2024-09-17T01:41:04.629 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.629 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.629 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169316 s, 61.9 MB/s 2024-09-17T01:41:04.645 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.645 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.645 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134466 s, 78.0 MB/s 2024-09-17T01:41:04.663 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.664 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.664 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155921 s, 67.3 MB/s 2024-09-17T01:41:04.681 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.682 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.682 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149095 s, 70.3 MB/s 2024-09-17T01:41:04.701 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.701 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.701 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161589 s, 64.9 MB/s 2024-09-17T01:41:04.722 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.722 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.722 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180527 s, 58.1 MB/s 2024-09-17T01:41:04.740 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.740 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.740 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153067 s, 68.5 MB/s 2024-09-17T01:41:04.757 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.757 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.757 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138489 s, 75.7 MB/s 2024-09-17T01:41:04.777 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.777 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.777 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01602 s, 65.5 MB/s 2024-09-17T01:41:04.792 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.792 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.792 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121978 s, 86.0 MB/s 2024-09-17T01:41:04.812 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.812 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.812 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167964 s, 62.4 MB/s 2024-09-17T01:41:04.830 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.830 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.830 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148423 s, 70.6 MB/s 2024-09-17T01:41:04.847 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.847 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.848 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142031 s, 73.8 MB/s 2024-09-17T01:41:04.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.866 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154583 s, 67.8 MB/s 2024-09-17T01:41:04.884 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.884 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.884 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151601 s, 69.2 MB/s 2024-09-17T01:41:04.898 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.898 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.899 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111226 s, 94.3 MB/s 2024-09-17T01:41:04.915 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.915 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.916 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013712 s, 76.5 MB/s 2024-09-17T01:41:04.930 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.930 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.931 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120597 s, 86.9 MB/s 2024-09-17T01:41:04.951 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.951 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.951 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178828 s, 58.6 MB/s 2024-09-17T01:41:04.969 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:04.969 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:04.969 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142623 s, 73.5 MB/s 2024-09-17T01:41:04.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:04.978 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:04.978 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:04.978 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.20 2024-09-17T01:41:04.978 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:04.978 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:04.978 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:04.978 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:05.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:05.078 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.078 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.078 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144677 s, 72.5 MB/s 2024-09-17T01:41:05.095 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.095 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.095 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137931 s, 76.0 MB/s 2024-09-17T01:41:05.114 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.114 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.114 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156948 s, 66.8 MB/s 2024-09-17T01:41:05.130 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.130 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.130 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126502 s, 82.9 MB/s 2024-09-17T01:41:05.147 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.147 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.147 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140516 s, 74.6 MB/s 2024-09-17T01:41:05.165 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.165 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.165 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014727 s, 71.2 MB/s 2024-09-17T01:41:05.183 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.183 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.183 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147597 s, 71.0 MB/s 2024-09-17T01:41:05.200 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.200 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.200 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141948 s, 73.9 MB/s 2024-09-17T01:41:05.217 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.218 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.218 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142803 s, 73.4 MB/s 2024-09-17T01:41:05.235 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.236 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.236 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148553 s, 70.6 MB/s 2024-09-17T01:41:05.256 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.256 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.257 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176115 s, 59.5 MB/s 2024-09-17T01:41:05.274 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.274 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.274 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144409 s, 72.6 MB/s 2024-09-17T01:41:05.291 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.291 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.291 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140618 s, 74.6 MB/s 2024-09-17T01:41:05.310 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.311 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.311 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164662 s, 63.7 MB/s 2024-09-17T01:41:05.328 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.328 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.328 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142859 s, 73.4 MB/s 2024-09-17T01:41:05.343 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.344 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.344 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122321 s, 85.7 MB/s 2024-09-17T01:41:05.361 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.361 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.361 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140474 s, 74.6 MB/s 2024-09-17T01:41:05.381 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.381 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.381 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171189 s, 61.3 MB/s 2024-09-17T01:41:05.398 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.398 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.398 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140966 s, 74.4 MB/s 2024-09-17T01:41:05.415 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.415 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.415 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143775 s, 72.9 MB/s 2024-09-17T01:41:05.435 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.436 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.436 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017455 s, 60.1 MB/s 2024-09-17T01:41:05.450 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.450 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.450 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114244 s, 91.8 MB/s 2024-09-17T01:41:05.466 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.466 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.466 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133339 s, 78.6 MB/s 2024-09-17T01:41:05.485 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.485 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.485 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015508 s, 67.6 MB/s 2024-09-17T01:41:05.506 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.506 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.506 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180812 s, 58.0 MB/s 2024-09-17T01:41:05.524 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.524 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.524 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150002 s, 69.9 MB/s 2024-09-17T01:41:05.541 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.541 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.541 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136688 s, 76.7 MB/s 2024-09-17T01:41:05.559 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.560 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.560 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155151 s, 67.6 MB/s 2024-09-17T01:41:05.576 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.577 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.577 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138537 s, 75.7 MB/s 2024-09-17T01:41:05.596 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.596 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.596 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160305 s, 65.4 MB/s 2024-09-17T01:41:05.614 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.614 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.614 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150292 s, 69.8 MB/s 2024-09-17T01:41:05.635 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.635 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.635 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181173 s, 57.9 MB/s 2024-09-17T01:41:05.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:05.644 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:05.644 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:05.644 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.21 2024-09-17T01:41:05.644 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:05.644 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:05.644 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:05.644 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:05.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:05.748 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.748 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.748 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153312 s, 68.4 MB/s 2024-09-17T01:41:05.765 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.765 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.765 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141993 s, 73.8 MB/s 2024-09-17T01:41:05.783 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.783 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.783 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147141 s, 71.3 MB/s 2024-09-17T01:41:05.801 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.801 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.801 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015293 s, 68.6 MB/s 2024-09-17T01:41:05.821 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.821 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.821 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159836 s, 65.6 MB/s 2024-09-17T01:41:05.844 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.844 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.845 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204028 s, 51.4 MB/s 2024-09-17T01:41:05.861 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.862 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.862 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141818 s, 73.9 MB/s 2024-09-17T01:41:05.878 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.878 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.879 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136982 s, 76.5 MB/s 2024-09-17T01:41:05.896 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.896 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.896 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140411 s, 74.7 MB/s 2024-09-17T01:41:05.913 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.914 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.914 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014538 s, 72.1 MB/s 2024-09-17T01:41:05.933 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.933 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.933 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164701 s, 63.7 MB/s 2024-09-17T01:41:05.950 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.950 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.951 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143783 s, 72.9 MB/s 2024-09-17T01:41:05.968 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.968 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.968 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142502 s, 73.6 MB/s 2024-09-17T01:41:05.985 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:05.985 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:05.985 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139691 s, 75.1 MB/s 2024-09-17T01:41:06.002 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.002 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.002 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138174 s, 75.9 MB/s 2024-09-17T01:41:06.019 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.020 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.020 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139829 s, 75.0 MB/s 2024-09-17T01:41:06.037 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.037 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.037 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141451 s, 74.1 MB/s 2024-09-17T01:41:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.054 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.055 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142141 s, 73.8 MB/s 2024-09-17T01:41:06.072 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.072 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.072 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014322 s, 73.2 MB/s 2024-09-17T01:41:06.089 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.090 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.090 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144265 s, 72.7 MB/s 2024-09-17T01:41:06.107 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.107 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.107 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140924 s, 74.4 MB/s 2024-09-17T01:41:06.124 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.124 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.125 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146303 s, 71.7 MB/s 2024-09-17T01:41:06.142 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.142 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.142 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141967 s, 73.9 MB/s 2024-09-17T01:41:06.163 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.163 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.163 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179225 s, 58.5 MB/s 2024-09-17T01:41:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146481 s, 71.6 MB/s 2024-09-17T01:41:06.198 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.198 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.198 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137997 s, 76.0 MB/s 2024-09-17T01:41:06.215 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.215 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.215 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135184 s, 77.6 MB/s 2024-09-17T01:41:06.232 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.232 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.232 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140124 s, 74.8 MB/s 2024-09-17T01:41:06.254 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.254 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.254 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185535 s, 56.5 MB/s 2024-09-17T01:41:06.272 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.272 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.272 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147895 s, 70.9 MB/s 2024-09-17T01:41:06.295 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.296 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.296 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208386 s, 50.3 MB/s 2024-09-17T01:41:06.317 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.317 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.317 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188436 s, 55.6 MB/s 2024-09-17T01:41:06.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:06.326 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:06.327 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:06.327 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.22 2024-09-17T01:41:06.327 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:06.327 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:06.327 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:06.327 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:06.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:06.426 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.427 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.427 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139483 s, 75.2 MB/s 2024-09-17T01:41:06.444 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.444 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.445 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145575 s, 72.0 MB/s 2024-09-17T01:41:06.462 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.462 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.462 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014449 s, 72.6 MB/s 2024-09-17T01:41:06.479 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.480 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.480 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145731 s, 72.0 MB/s 2024-09-17T01:41:06.501 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.502 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.502 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187592 s, 55.9 MB/s 2024-09-17T01:41:06.519 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.520 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.520 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146872 s, 71.4 MB/s 2024-09-17T01:41:06.537 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.537 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.537 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144486 s, 72.6 MB/s 2024-09-17T01:41:06.559 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.559 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.559 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192653 s, 54.4 MB/s 2024-09-17T01:41:06.576 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.577 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.577 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138633 s, 75.6 MB/s 2024-09-17T01:41:06.594 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.595 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.595 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148507 s, 70.6 MB/s 2024-09-17T01:41:06.611 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.612 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.612 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139245 s, 75.3 MB/s 2024-09-17T01:41:06.630 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.630 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.630 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149559 s, 70.1 MB/s 2024-09-17T01:41:06.648 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.648 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.649 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153484 s, 68.3 MB/s 2024-09-17T01:41:06.666 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.666 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.666 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145679 s, 72.0 MB/s 2024-09-17T01:41:06.684 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.684 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.684 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145418 s, 72.1 MB/s 2024-09-17T01:41:06.706 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.707 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.707 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187625 s, 55.9 MB/s 2024-09-17T01:41:06.724 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.725 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.725 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150042 s, 69.9 MB/s 2024-09-17T01:41:06.742 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.742 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.742 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146809 s, 71.4 MB/s 2024-09-17T01:41:06.759 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.759 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.759 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138538 s, 75.7 MB/s 2024-09-17T01:41:06.777 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.778 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.778 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149933 s, 69.9 MB/s 2024-09-17T01:41:06.801 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.802 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.802 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207754 s, 50.5 MB/s 2024-09-17T01:41:06.819 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.819 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.819 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014201 s, 73.8 MB/s 2024-09-17T01:41:06.836 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.837 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.837 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140696 s, 74.5 MB/s 2024-09-17T01:41:06.852 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.853 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.853 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129288 s, 81.1 MB/s 2024-09-17T01:41:06.873 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.873 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.874 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175939 s, 59.6 MB/s 2024-09-17T01:41:06.890 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.891 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.891 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141169 s, 74.3 MB/s 2024-09-17T01:41:06.908 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.908 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.908 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014386 s, 72.9 MB/s 2024-09-17T01:41:06.930 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.930 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.930 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185188 s, 56.6 MB/s 2024-09-17T01:41:06.946 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.946 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.947 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01404 s, 74.7 MB/s 2024-09-17T01:41:06.967 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.967 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.968 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178785 s, 58.6 MB/s 2024-09-17T01:41:06.987 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:06.987 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:06.987 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159271 s, 65.8 MB/s 2024-09-17T01:41:07.004 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.004 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.004 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144918 s, 72.4 MB/s 2024-09-17T01:41:07.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:07.013 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:07.013 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:07.013 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.23 2024-09-17T01:41:07.013 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:07.013 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:07.014 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:07.014 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:07.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:07.115 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.115 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.115 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014903 s, 70.4 MB/s 2024-09-17T01:41:07.132 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.132 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.132 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142569 s, 73.5 MB/s 2024-09-17T01:41:07.149 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.149 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.149 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013853 s, 75.7 MB/s 2024-09-17T01:41:07.167 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.168 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.168 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148791 s, 70.5 MB/s 2024-09-17T01:41:07.185 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.185 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.185 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139855 s, 75.0 MB/s 2024-09-17T01:41:07.202 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.202 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.202 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014398 s, 72.8 MB/s 2024-09-17T01:41:07.224 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.224 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.224 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018135 s, 57.8 MB/s 2024-09-17T01:41:07.247 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.247 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.247 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020325 s, 51.6 MB/s 2024-09-17T01:41:07.263 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.263 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.263 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123318 s, 85.0 MB/s 2024-09-17T01:41:07.280 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.280 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.280 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138332 s, 75.8 MB/s 2024-09-17T01:41:07.297 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.297 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.297 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142309 s, 73.7 MB/s 2024-09-17T01:41:07.316 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.316 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.316 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015097 s, 69.5 MB/s 2024-09-17T01:41:07.333 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.334 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.334 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145357 s, 72.1 MB/s 2024-09-17T01:41:07.350 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.351 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.351 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137423 s, 76.3 MB/s 2024-09-17T01:41:07.369 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.369 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.369 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152097 s, 68.9 MB/s 2024-09-17T01:41:07.386 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.386 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.386 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138313 s, 75.8 MB/s 2024-09-17T01:41:07.403 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.404 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.404 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141808 s, 73.9 MB/s 2024-09-17T01:41:07.421 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.422 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.422 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148329 s, 70.7 MB/s 2024-09-17T01:41:07.441 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.441 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.441 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164421 s, 63.8 MB/s 2024-09-17T01:41:07.459 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.460 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.460 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145951 s, 71.8 MB/s 2024-09-17T01:41:07.478 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.478 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.478 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155053 s, 67.6 MB/s 2024-09-17T01:41:07.496 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.497 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.497 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155075 s, 67.6 MB/s 2024-09-17T01:41:07.515 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.515 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.515 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149762 s, 70.0 MB/s 2024-09-17T01:41:07.531 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.531 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.532 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135566 s, 77.3 MB/s 2024-09-17T01:41:07.553 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.553 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.553 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018041 s, 58.1 MB/s 2024-09-17T01:41:07.570 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.570 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.570 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141025 s, 74.4 MB/s 2024-09-17T01:41:07.587 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.588 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.588 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144046 s, 72.8 MB/s 2024-09-17T01:41:07.605 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.605 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.605 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143281 s, 73.2 MB/s 2024-09-17T01:41:07.622 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.622 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.622 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135739 s, 77.2 MB/s 2024-09-17T01:41:07.640 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.640 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.640 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152557 s, 68.7 MB/s 2024-09-17T01:41:07.657 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.658 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.658 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143982 s, 72.8 MB/s 2024-09-17T01:41:07.678 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.678 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.678 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171215 s, 61.2 MB/s 2024-09-17T01:41:07.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:07.687 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:07.687 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:07.687 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.24 2024-09-17T01:41:07.687 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:07.687 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:07.687 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:07.687 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:07.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:07.816 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.816 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.816 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142933 s, 73.4 MB/s 2024-09-17T01:41:07.831 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.831 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.831 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118181 s, 88.7 MB/s 2024-09-17T01:41:07.849 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.849 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.849 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152318 s, 68.8 MB/s 2024-09-17T01:41:07.868 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.868 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.868 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015515 s, 67.6 MB/s 2024-09-17T01:41:07.886 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.886 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.886 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151497 s, 69.2 MB/s 2024-09-17T01:41:07.904 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.904 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.904 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144093 s, 72.8 MB/s 2024-09-17T01:41:07.923 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.923 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.923 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155954 s, 67.2 MB/s 2024-09-17T01:41:07.940 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.940 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.940 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138426 s, 75.8 MB/s 2024-09-17T01:41:07.957 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.957 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.957 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141143 s, 74.3 MB/s 2024-09-17T01:41:07.973 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.973 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.973 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134625 s, 77.9 MB/s 2024-09-17T01:41:07.991 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:07.991 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:07.991 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143475 s, 73.1 MB/s 2024-09-17T01:41:08.009 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.009 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.010 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155669 s, 67.4 MB/s 2024-09-17T01:41:08.031 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.031 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.031 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184092 s, 57.0 MB/s 2024-09-17T01:41:08.049 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.049 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.049 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149987 s, 69.9 MB/s 2024-09-17T01:41:08.066 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.066 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.067 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143919 s, 72.9 MB/s 2024-09-17T01:41:08.081 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.081 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.081 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118042 s, 88.8 MB/s 2024-09-17T01:41:08.098 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.099 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.099 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143806 s, 72.9 MB/s 2024-09-17T01:41:08.116 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.116 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.116 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139764 s, 75.0 MB/s 2024-09-17T01:41:08.134 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.135 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.135 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157047 s, 66.8 MB/s 2024-09-17T01:41:08.152 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.152 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.152 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145657 s, 72.0 MB/s 2024-09-17T01:41:08.176 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.176 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.176 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206886 s, 50.7 MB/s 2024-09-17T01:41:08.195 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.195 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.195 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156207 s, 67.1 MB/s 2024-09-17T01:41:08.212 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.212 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.212 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013913 s, 75.4 MB/s 2024-09-17T01:41:08.229 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.229 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.229 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142589 s, 73.5 MB/s 2024-09-17T01:41:08.248 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.248 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.248 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155674 s, 67.4 MB/s 2024-09-17T01:41:08.266 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.266 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.266 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154543 s, 67.9 MB/s 2024-09-17T01:41:08.281 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.281 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.281 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01156 s, 90.7 MB/s 2024-09-17T01:41:08.298 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.298 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.298 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143386 s, 73.1 MB/s 2024-09-17T01:41:08.315 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.315 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.316 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013884 s, 75.5 MB/s 2024-09-17T01:41:08.337 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.337 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.337 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181259 s, 57.8 MB/s 2024-09-17T01:41:08.354 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.354 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.354 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141472 s, 74.1 MB/s 2024-09-17T01:41:08.371 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.371 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.371 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138273 s, 75.8 MB/s 2024-09-17T01:41:08.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:08.381 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:08.381 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:08.381 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.25 2024-09-17T01:41:08.381 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:08.381 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:08.381 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:08.381 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:08.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:08.482 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.482 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.482 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144138 s, 72.7 MB/s 2024-09-17T01:41:08.500 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.500 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.500 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155832 s, 67.3 MB/s 2024-09-17T01:41:08.517 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.518 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.518 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014186 s, 73.9 MB/s 2024-09-17T01:41:08.539 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.540 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.540 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185968 s, 56.4 MB/s 2024-09-17T01:41:08.561 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.561 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.561 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018083 s, 58.0 MB/s 2024-09-17T01:41:08.578 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.578 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.578 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138579 s, 75.7 MB/s 2024-09-17T01:41:08.596 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.596 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.597 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015425 s, 68.0 MB/s 2024-09-17T01:41:08.614 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.614 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.614 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143996 s, 72.8 MB/s 2024-09-17T01:41:08.631 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.631 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.631 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136568 s, 76.8 MB/s 2024-09-17T01:41:08.649 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.649 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.649 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153637 s, 68.3 MB/s 2024-09-17T01:41:08.671 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.671 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.671 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187978 s, 55.8 MB/s 2024-09-17T01:41:08.689 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.689 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.689 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146629 s, 71.5 MB/s 2024-09-17T01:41:08.708 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.708 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.708 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144765 s, 72.4 MB/s 2024-09-17T01:41:08.725 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.725 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.725 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138471 s, 75.7 MB/s 2024-09-17T01:41:08.744 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.744 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.744 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148648 s, 70.5 MB/s 2024-09-17T01:41:08.763 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.763 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.763 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159929 s, 65.6 MB/s 2024-09-17T01:41:08.784 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.784 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.784 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176534 s, 59.4 MB/s 2024-09-17T01:41:08.801 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.801 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.802 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144261 s, 72.7 MB/s 2024-09-17T01:41:08.826 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.826 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.826 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207201 s, 50.6 MB/s 2024-09-17T01:41:08.843 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.843 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.843 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146788 s, 71.4 MB/s 2024-09-17T01:41:08.862 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.862 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.862 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154283 s, 68.0 MB/s 2024-09-17T01:41:08.880 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.881 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.881 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156023 s, 67.2 MB/s 2024-09-17T01:41:08.905 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.906 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.906 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219542 s, 47.8 MB/s 2024-09-17T01:41:08.923 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.923 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.923 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144855 s, 72.4 MB/s 2024-09-17T01:41:08.940 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.940 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.940 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136265 s, 77.0 MB/s 2024-09-17T01:41:08.957 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.957 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.957 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144277 s, 72.7 MB/s 2024-09-17T01:41:08.975 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.975 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.976 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147125 s, 71.3 MB/s 2024-09-17T01:41:08.997 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:08.997 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:08.997 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186058 s, 56.4 MB/s 2024-09-17T01:41:09.014 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.014 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.014 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136941 s, 76.6 MB/s 2024-09-17T01:41:09.031 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.031 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.031 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135235 s, 77.5 MB/s 2024-09-17T01:41:09.049 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.049 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.049 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015513 s, 67.6 MB/s 2024-09-17T01:41:09.067 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.067 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.067 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146965 s, 71.3 MB/s 2024-09-17T01:41:09.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:09.077 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:09.077 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:09.077 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.26 2024-09-17T01:41:09.077 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:09.077 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:09.077 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:09.077 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:09.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:09.177 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.177 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.177 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137075 s, 76.5 MB/s 2024-09-17T01:41:09.194 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.195 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.195 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144486 s, 72.6 MB/s 2024-09-17T01:41:09.215 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.215 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.215 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175179 s, 59.9 MB/s 2024-09-17T01:41:09.237 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.238 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.238 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194017 s, 54.0 MB/s 2024-09-17T01:41:09.255 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.255 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.255 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146751 s, 71.5 MB/s 2024-09-17T01:41:09.272 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.272 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.273 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140767 s, 74.5 MB/s 2024-09-17T01:41:09.289 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.289 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.289 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137055 s, 76.5 MB/s 2024-09-17T01:41:09.312 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.312 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.312 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193428 s, 54.2 MB/s 2024-09-17T01:41:09.327 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.327 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.327 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012213 s, 85.9 MB/s 2024-09-17T01:41:09.345 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.345 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.345 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144704 s, 72.5 MB/s 2024-09-17T01:41:09.368 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.368 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.368 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194501 s, 53.9 MB/s 2024-09-17T01:41:09.384 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.384 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.384 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121875 s, 86.0 MB/s 2024-09-17T01:41:09.401 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.401 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.401 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133962 s, 78.3 MB/s 2024-09-17T01:41:09.421 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.421 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.421 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163071 s, 64.3 MB/s 2024-09-17T01:41:09.440 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.440 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.440 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153692 s, 68.2 MB/s 2024-09-17T01:41:09.458 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.458 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.458 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141427 s, 74.1 MB/s 2024-09-17T01:41:09.477 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.477 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.477 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155952 s, 67.2 MB/s 2024-09-17T01:41:09.494 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.494 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.494 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137863 s, 76.1 MB/s 2024-09-17T01:41:09.517 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.517 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.517 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187738 s, 55.9 MB/s 2024-09-17T01:41:09.533 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.533 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.533 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122226 s, 85.8 MB/s 2024-09-17T01:41:09.551 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.551 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.551 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144468 s, 72.6 MB/s 2024-09-17T01:41:09.572 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.572 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.572 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01711 s, 61.3 MB/s 2024-09-17T01:41:09.586 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.586 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.586 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114615 s, 91.5 MB/s 2024-09-17T01:41:09.604 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.604 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.604 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141045 s, 74.3 MB/s 2024-09-17T01:41:09.622 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.622 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.622 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148968 s, 70.4 MB/s 2024-09-17T01:41:09.644 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.644 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.644 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175989 s, 59.6 MB/s 2024-09-17T01:41:09.662 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.662 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.663 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152819 s, 68.6 MB/s 2024-09-17T01:41:09.680 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.680 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.680 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137224 s, 76.4 MB/s 2024-09-17T01:41:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.699 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153727 s, 68.2 MB/s 2024-09-17T01:41:09.718 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.718 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.718 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150093 s, 69.9 MB/s 2024-09-17T01:41:09.735 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.736 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.736 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144435 s, 72.6 MB/s 2024-09-17T01:41:09.757 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.758 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.758 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185599 s, 56.5 MB/s 2024-09-17T01:41:09.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:09.767 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:09.767 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:09.767 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.27 2024-09-17T01:41:09.767 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:09.767 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:09.767 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:09.767 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:09.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:09.868 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.868 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.868 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137168 s, 76.4 MB/s 2024-09-17T01:41:09.887 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.887 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.887 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151438 s, 69.2 MB/s 2024-09-17T01:41:09.906 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.906 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.906 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159521 s, 65.7 MB/s 2024-09-17T01:41:09.925 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.925 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.925 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149057 s, 70.3 MB/s 2024-09-17T01:41:09.942 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.942 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.942 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137008 s, 76.5 MB/s 2024-09-17T01:41:09.958 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.958 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.958 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121732 s, 86.1 MB/s 2024-09-17T01:41:09.976 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.976 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.976 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147606 s, 71.0 MB/s 2024-09-17T01:41:09.993 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:09.993 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:09.993 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135763 s, 77.2 MB/s 2024-09-17T01:41:10.016 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.017 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.017 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209818 s, 50.0 MB/s 2024-09-17T01:41:10.035 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.035 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.036 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015811 s, 66.3 MB/s 2024-09-17T01:41:10.050 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.050 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.050 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118082 s, 88.8 MB/s 2024-09-17T01:41:10.067 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.067 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.067 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140335 s, 74.7 MB/s 2024-09-17T01:41:10.085 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.085 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.086 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150842 s, 69.5 MB/s 2024-09-17T01:41:10.107 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.107 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.107 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184863 s, 56.7 MB/s 2024-09-17T01:41:10.126 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.127 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.127 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161785 s, 64.8 MB/s 2024-09-17T01:41:10.148 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.148 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.148 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183136 s, 57.3 MB/s 2024-09-17T01:41:10.167 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.167 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.167 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150767 s, 69.5 MB/s 2024-09-17T01:41:10.186 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.186 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.186 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160217 s, 65.4 MB/s 2024-09-17T01:41:10.205 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.205 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.205 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146042 s, 71.8 MB/s 2024-09-17T01:41:10.223 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.223 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.223 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146873 s, 71.4 MB/s 2024-09-17T01:41:10.241 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.241 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.241 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141162 s, 74.3 MB/s 2024-09-17T01:41:10.259 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.259 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.259 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150182 s, 69.8 MB/s 2024-09-17T01:41:10.279 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.279 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.279 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159629 s, 65.7 MB/s 2024-09-17T01:41:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.297 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141363 s, 74.2 MB/s 2024-09-17T01:41:10.314 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.315 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.315 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138975 s, 75.5 MB/s 2024-09-17T01:41:10.334 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.334 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.334 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155596 s, 67.4 MB/s 2024-09-17T01:41:10.355 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.355 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.355 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177236 s, 59.2 MB/s 2024-09-17T01:41:10.373 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.374 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.374 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153261 s, 68.4 MB/s 2024-09-17T01:41:10.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.396 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193301 s, 54.2 MB/s 2024-09-17T01:41:10.414 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.414 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.414 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150228 s, 69.8 MB/s 2024-09-17T01:41:10.431 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.431 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.431 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135544 s, 77.4 MB/s 2024-09-17T01:41:10.448 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.448 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.448 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140546 s, 74.6 MB/s 2024-09-17T01:41:10.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:10.458 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:10.458 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:10.458 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.28 2024-09-17T01:41:10.458 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:10.458 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:10.458 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:10.458 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:10.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:10.559 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.559 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.559 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151878 s, 69.0 MB/s 2024-09-17T01:41:10.578 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.578 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.578 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015468 s, 67.8 MB/s 2024-09-17T01:41:10.595 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.595 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.596 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143455 s, 73.1 MB/s 2024-09-17T01:41:10.612 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.612 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.612 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139024 s, 75.4 MB/s 2024-09-17T01:41:10.629 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.629 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.630 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138961 s, 75.5 MB/s 2024-09-17T01:41:10.646 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.646 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.646 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138105 s, 75.9 MB/s 2024-09-17T01:41:10.664 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.664 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.664 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144354 s, 72.6 MB/s 2024-09-17T01:41:10.689 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.689 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.689 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215677 s, 48.6 MB/s 2024-09-17T01:41:10.707 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.707 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.707 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141697 s, 74.0 MB/s 2024-09-17T01:41:10.723 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.724 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.724 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140423 s, 74.7 MB/s 2024-09-17T01:41:10.747 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.747 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.747 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206187 s, 50.9 MB/s 2024-09-17T01:41:10.765 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.765 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.765 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145375 s, 72.1 MB/s 2024-09-17T01:41:10.783 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.783 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.783 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146755 s, 71.5 MB/s 2024-09-17T01:41:10.801 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.801 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.801 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149086 s, 70.3 MB/s 2024-09-17T01:41:10.823 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.823 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.823 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185641 s, 56.5 MB/s 2024-09-17T01:41:10.844 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.844 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.844 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178128 s, 58.9 MB/s 2024-09-17T01:41:10.861 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.861 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.861 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142781 s, 73.4 MB/s 2024-09-17T01:41:10.879 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.879 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.880 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153582 s, 68.3 MB/s 2024-09-17T01:41:10.897 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.897 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.897 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014532 s, 72.2 MB/s 2024-09-17T01:41:10.919 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.920 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.920 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194137 s, 54.0 MB/s 2024-09-17T01:41:10.937 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.937 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.937 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143318 s, 73.2 MB/s 2024-09-17T01:41:10.959 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.959 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.959 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186312 s, 56.3 MB/s 2024-09-17T01:41:10.982 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:10.982 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:10.982 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204013 s, 51.4 MB/s 2024-09-17T01:41:11.001 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.002 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.002 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161371 s, 65.0 MB/s 2024-09-17T01:41:11.020 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.020 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.020 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150584 s, 69.6 MB/s 2024-09-17T01:41:11.037 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.037 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.037 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143437 s, 73.1 MB/s 2024-09-17T01:41:11.055 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.055 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.055 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145203 s, 72.2 MB/s 2024-09-17T01:41:11.073 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.073 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.073 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147298 s, 71.2 MB/s 2024-09-17T01:41:11.095 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.095 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.095 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187299 s, 56.0 MB/s 2024-09-17T01:41:11.113 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.113 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.113 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143583 s, 73.0 MB/s 2024-09-17T01:41:11.138 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.138 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.138 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220699 s, 47.5 MB/s 2024-09-17T01:41:11.155 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.155 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.155 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139558 s, 75.1 MB/s 2024-09-17T01:41:11.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:11.164 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:11.165 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:11.165 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.29 2024-09-17T01:41:11.165 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:11.165 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:11.165 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:11.165 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:11.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:11.274 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.274 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.274 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225375 s, 46.5 MB/s 2024-09-17T01:41:11.294 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.294 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.294 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161939 s, 64.8 MB/s 2024-09-17T01:41:11.312 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.313 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.313 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015906 s, 65.9 MB/s 2024-09-17T01:41:11.330 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.330 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.330 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144227 s, 72.7 MB/s 2024-09-17T01:41:11.353 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.353 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.353 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019598 s, 53.5 MB/s 2024-09-17T01:41:11.370 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.370 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.371 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141917 s, 73.9 MB/s 2024-09-17T01:41:11.388 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.388 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.388 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139811 s, 75.0 MB/s 2024-09-17T01:41:11.408 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.409 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.409 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147505 s, 71.1 MB/s 2024-09-17T01:41:11.422 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.422 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.422 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128514 s, 81.6 MB/s 2024-09-17T01:41:11.443 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.443 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.443 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177789 s, 59.0 MB/s 2024-09-17T01:41:11.459 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.459 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.459 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129805 s, 80.8 MB/s 2024-09-17T01:41:11.477 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.477 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.477 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149444 s, 70.2 MB/s 2024-09-17T01:41:11.493 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.493 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.493 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126357 s, 83.0 MB/s 2024-09-17T01:41:11.511 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.511 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.511 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145677 s, 72.0 MB/s 2024-09-17T01:41:11.533 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.533 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.533 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191732 s, 54.7 MB/s 2024-09-17T01:41:11.552 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.552 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.552 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156097 s, 67.2 MB/s 2024-09-17T01:41:11.573 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.574 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.574 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184926 s, 56.7 MB/s 2024-09-17T01:41:11.593 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.593 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.593 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164313 s, 63.8 MB/s 2024-09-17T01:41:11.610 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.610 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.610 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137214 s, 76.4 MB/s 2024-09-17T01:41:11.627 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.627 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.627 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013697 s, 76.6 MB/s 2024-09-17T01:41:11.645 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.645 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.646 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153954 s, 68.1 MB/s 2024-09-17T01:41:11.663 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.663 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.663 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145173 s, 72.2 MB/s 2024-09-17T01:41:11.681 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.681 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.681 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148019 s, 70.8 MB/s 2024-09-17T01:41:11.698 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.698 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.698 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138533 s, 75.7 MB/s 2024-09-17T01:41:11.722 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.722 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.722 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210881 s, 49.7 MB/s 2024-09-17T01:41:11.743 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.743 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.743 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180817 s, 58.0 MB/s 2024-09-17T01:41:11.762 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.762 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.762 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153693 s, 68.2 MB/s 2024-09-17T01:41:11.783 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.783 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.783 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185831 s, 56.4 MB/s 2024-09-17T01:41:11.799 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.799 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.799 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124579 s, 84.2 MB/s 2024-09-17T01:41:11.821 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.821 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.821 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190332 s, 55.1 MB/s 2024-09-17T01:41:11.843 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.843 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.843 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185211 s, 56.6 MB/s 2024-09-17T01:41:11.860 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.861 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.861 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147041 s, 71.3 MB/s 2024-09-17T01:41:11.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:11.870 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:11.870 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:11.870 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.30 2024-09-17T01:41:11.870 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:11.870 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:11.870 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:11.870 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:11.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:11.971 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.971 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.971 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148797 s, 70.5 MB/s 2024-09-17T01:41:11.988 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:11.988 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:11.988 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141181 s, 74.3 MB/s 2024-09-17T01:41:12.013 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.013 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.014 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221439 s, 47.4 MB/s 2024-09-17T01:41:12.031 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.031 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.031 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147111 s, 71.3 MB/s 2024-09-17T01:41:12.048 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.049 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.049 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141243 s, 74.2 MB/s 2024-09-17T01:41:12.070 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.070 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.070 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183316 s, 57.2 MB/s 2024-09-17T01:41:12.089 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.089 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.089 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156151 s, 67.2 MB/s 2024-09-17T01:41:12.106 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.106 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.106 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013807 s, 75.9 MB/s 2024-09-17T01:41:12.123 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.123 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.123 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138725 s, 75.6 MB/s 2024-09-17T01:41:12.140 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.140 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.140 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141238 s, 74.2 MB/s 2024-09-17T01:41:12.157 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.157 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.157 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139955 s, 74.9 MB/s 2024-09-17T01:41:12.176 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.177 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.177 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160258 s, 65.4 MB/s 2024-09-17T01:41:12.194 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.194 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.195 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147751 s, 71.0 MB/s 2024-09-17T01:41:12.211 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.211 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.212 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139533 s, 75.1 MB/s 2024-09-17T01:41:12.229 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.230 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.230 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148723 s, 70.5 MB/s 2024-09-17T01:41:12.247 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.248 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.248 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144722 s, 72.5 MB/s 2024-09-17T01:41:12.270 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.270 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.270 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01955 s, 53.6 MB/s 2024-09-17T01:41:12.287 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.288 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.288 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144507 s, 72.6 MB/s 2024-09-17T01:41:12.305 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.305 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.305 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143477 s, 73.1 MB/s 2024-09-17T01:41:12.320 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.320 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.321 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119898 s, 87.5 MB/s 2024-09-17T01:41:12.337 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.337 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.337 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139185 s, 75.3 MB/s 2024-09-17T01:41:12.355 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.355 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.355 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139155 s, 75.4 MB/s 2024-09-17T01:41:12.374 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.375 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.375 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158697 s, 66.1 MB/s 2024-09-17T01:41:12.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.396 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175632 s, 59.7 MB/s 2024-09-17T01:41:12.416 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.416 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.417 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140869 s, 74.4 MB/s 2024-09-17T01:41:12.431 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.431 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.431 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144878 s, 72.4 MB/s 2024-09-17T01:41:12.449 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.449 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.449 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014579 s, 71.9 MB/s 2024-09-17T01:41:12.466 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.466 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.466 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128271 s, 81.7 MB/s 2024-09-17T01:41:12.488 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.489 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.489 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190853 s, 54.9 MB/s 2024-09-17T01:41:12.503 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.503 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.503 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011372 s, 92.2 MB/s 2024-09-17T01:41:12.525 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.525 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.525 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178699 s, 58.7 MB/s 2024-09-17T01:41:12.543 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.543 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.543 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147649 s, 71.0 MB/s 2024-09-17T01:41:12.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:12.552 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:12.552 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:12.553 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.31 2024-09-17T01:41:12.553 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:12.553 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:12.553 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:12.553 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:12.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:12.661 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.662 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.662 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215781 s, 48.6 MB/s 2024-09-17T01:41:12.679 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.679 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.679 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135828 s, 77.2 MB/s 2024-09-17T01:41:12.696 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.696 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.696 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014191 s, 73.9 MB/s 2024-09-17T01:41:12.715 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.715 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.715 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157169 s, 66.7 MB/s 2024-09-17T01:41:12.734 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.734 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.735 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159506 s, 65.7 MB/s 2024-09-17T01:41:12.770 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.770 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.770 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316088 s, 33.2 MB/s 2024-09-17T01:41:12.788 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.788 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.788 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149221 s, 70.3 MB/s 2024-09-17T01:41:12.807 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.807 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.807 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153198 s, 68.4 MB/s 2024-09-17T01:41:12.825 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.825 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.825 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145265 s, 72.2 MB/s 2024-09-17T01:41:12.842 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.842 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.842 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134707 s, 77.8 MB/s 2024-09-17T01:41:12.860 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.860 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.860 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149127 s, 70.3 MB/s 2024-09-17T01:41:12.882 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.882 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.883 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195753 s, 53.6 MB/s 2024-09-17T01:41:12.900 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.901 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.901 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152785 s, 68.6 MB/s 2024-09-17T01:41:12.919 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.919 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.919 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146709 s, 71.5 MB/s 2024-09-17T01:41:12.939 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.939 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.939 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173814 s, 60.3 MB/s 2024-09-17T01:41:12.956 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.956 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140624 s, 74.6 MB/s 2024-09-17T01:41:12.974 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.974 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.974 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141079 s, 74.3 MB/s 2024-09-17T01:41:12.994 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:12.994 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:12.995 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175799 s, 59.6 MB/s 2024-09-17T01:41:13.011 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:13.011 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:13.012 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139281 s, 75.3 MB/s 2024-09-17T01:41:13.029 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:13.029 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:13.029 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014435 s, 72.6 MB/s 2024-09-17T01:41:13.047 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:13.047 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:13.048 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148882 s, 70.4 MB/s 2024-09-17T01:41:13.066 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:13.066 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:13.066 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158067 s, 66.3 MB/s 2024-09-17T01:41:13.083 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:13.083 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:13.083 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138959 s, 75.5 MB/s 2024-09-17T01:41:13.108 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:13.108 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:13.108 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212095 s, 49.4 MB/s 2024-09-17T01:41:13.125 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:13.125 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:13.125 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142326 s, 73.7 MB/s 2024-09-17T01:41:13.140 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:13.140 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:13.140 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115999 s, 90.4 MB/s 2024-09-17T01:41:13.162 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:13.162 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:13.162 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019363 s, 54.2 MB/s 2024-09-17T01:41:13.184 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:13.184 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:13.184 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183582 s, 57.1 MB/s 2024-09-17T01:41:13.201 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:13.202 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:13.202 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146418 s, 71.6 MB/s 2024-09-17T01:41:13.217 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:13.217 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:13.217 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121175 s, 86.5 MB/s 2024-09-17T01:41:13.235 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:13.235 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:13.235 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148544 s, 70.6 MB/s 2024-09-17T01:41:13.251 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:13.251 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:13.251 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127128 s, 82.5 MB/s 2024-09-17T01:41:13.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:13.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:41:13.261 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub start /scrub_control_test_path recursive 2024-09-17T01:41:13.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.497+0000 7f3f03a00640 1 -- 172.21.15.42:0/2473576758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ee4003ca0 msgr2=0x7f3ee40040f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:13.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.497+0000 7f3f03a00640 1 --2- 172.21.15.42:0/2473576758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ee4003ca0 0x7f3ee40040f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0009b50 tx=0x7f3ee4005830 comp rx=0 tx=0).stop 2024-09-17T01:41:13.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.497+0000 7f3f03a00640 1 -- 172.21.15.42:0/2473576758 shutdown_connections 2024-09-17T01:41:13.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.497+0000 7f3f03a00640 1 --2- 172.21.15.42:0/2473576758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ee4003ca0 0x7f3ee40040f0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.497+0000 7f3f03a00640 1 -- 172.21.15.42:0/2473576758 >> 172.21.15.42:0/2473576758 conn(0x7f3efc0b28f0 msgr2=0x7f3efc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:13.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.497+0000 7f3f03a00640 1 -- 172.21.15.42:0/2473576758 shutdown_connections 2024-09-17T01:41:13.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.497+0000 7f3f03a00640 1 -- 172.21.15.42:0/2473576758 wait complete. 2024-09-17T01:41:13.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.499+0000 7f3f03a00640 1 Processor -- start 2024-09-17T01:41:13.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.499+0000 7f3f03a00640 1 -- start start 2024-09-17T01:41:13.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.501+0000 7f3f03a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3ee4003ca0 0x7f3efc143ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.501+0000 7f3f03a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3efc1f8f60 0x7f3efc155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.501+0000 7f3f03a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3efc151df0 0x7f3efc155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.501+0000 7f3f03a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3efc074210 con 0x7f3efc1f8f60 2024-09-17T01:41:13.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.501+0000 7f3f03a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3efc15cce0 con 0x7f3efc151df0 2024-09-17T01:41:13.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.501+0000 7f3f03a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3efc152a40 con 0x7f3ee4003ca0 2024-09-17T01:41:13.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.501+0000 7f3efbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3efc1f8f60 0x7f3efc155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.501+0000 7f3efbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3efc1f8f60 0x7f3efc155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58386/0 (socket says 172.21.15.42:58386) 2024-09-17T01:41:13.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.501+0000 7f3efbe00640 1 -- 172.21.15.42:0/3632522471 learned_addr learned my addr 172.21.15.42:0/3632522471 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:13.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.501+0000 7f3f01a00640 1 --2- 172.21.15.42:0/3632522471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3efc151df0 0x7f3efc155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.501+0000 7f3f01000640 1 --2- 172.21.15.42:0/3632522471 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3ee4003ca0 0x7f3efc143ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.502+0000 7f3efbe00640 1 -- 172.21.15.42:0/3632522471 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3ee4003ca0 msgr2=0x7f3efc143ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:13.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.502+0000 7f3efbe00640 1 --2- 172.21.15.42:0/3632522471 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3ee4003ca0 0x7f3efc143ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.502+0000 7f3efbe00640 1 -- 172.21.15.42:0/3632522471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3efc151df0 msgr2=0x7f3efc155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:13.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.502+0000 7f3efbe00640 1 --2- 172.21.15.42:0/3632522471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3efc151df0 0x7f3efc155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.502+0000 7f3efbe00640 1 -- 172.21.15.42:0/3632522471 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3efc1563e0 con 0x7f3efc1f8f60 2024-09-17T01:41:13.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.502+0000 7f3f01a00640 1 --2- 172.21.15.42:0/3632522471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3efc151df0 0x7f3efc155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:41:13.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.502+0000 7f3efbe00640 1 --2- 172.21.15.42:0/3632522471 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3efc1f8f60 0x7f3efc155400 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8006600 tx=0x7f3ee80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:13.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.502+0000 7f3ef8c00640 1 -- 172.21.15.42:0/3632522471 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8015070 con 0x7f3efc1f8f60 2024-09-17T01:41:13.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.502+0000 7f3ef8c00640 1 -- 172.21.15.42:0/3632522471 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ee8011900 con 0x7f3efc1f8f60 2024-09-17T01:41:13.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.502+0000 7f3f03a00640 1 -- 172.21.15.42:0/3632522471 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3efc1f9740 con 0x7f3efc1f8f60 2024-09-17T01:41:13.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.502+0000 7f3ef8c00640 1 -- 172.21.15.42:0/3632522471 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8006b90 con 0x7f3efc1f8f60 2024-09-17T01:41:13.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.502+0000 7f3f03a00640 1 -- 172.21.15.42:0/3632522471 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3efc1f9d00 con 0x7f3efc1f8f60 2024-09-17T01:41:13.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.505+0000 7f3ef8c00640 1 -- 172.21.15.42:0/3632522471 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3ee8018070 con 0x7f3efc1f8f60 2024-09-17T01:41:13.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.506+0000 7f3ef8c00640 1 --2- 172.21.15.42:0/3632522471 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3edc078b90 0x7f3edc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.506+0000 7f3ef8c00640 1 -- 172.21.15.42:0/3632522471 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5767+0+0 (secure 0 0 0) 0x7f3ee809b880 con 0x7f3efc1f8f60 2024-09-17T01:41:13.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.506+0000 7f3f01000640 1 --2- 172.21.15.42:0/3632522471 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3edc078b90 0x7f3edc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.506+0000 7f3f0abdb740 1 Processor -- start 2024-09-17T01:41:13.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.506+0000 7f3f0abdb740 1 -- start start 2024-09-17T01:41:13.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.507+0000 7f3f01000640 1 --2- 172.21.15.42:0/3632522471 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3edc078b90 0x7f3edc07b0a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0035000 tx=0x7f3ef00046c0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:13.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.508+0000 7f3f0abdb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564232b62730 0x564232f4f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.508+0000 7f3f0abdb740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564232b39870 0x564232f23e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.508+0000 7f3f0abdb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b41a50 0x564232f243d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.508+0000 7f3f0abdb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564232e7ca70 con 0x564232b41a50 2024-09-17T01:41:13.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.508+0000 7f3f0abdb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564232e6bea0 con 0x564232b62730 2024-09-17T01:41:13.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.508+0000 7f3f0abdb740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x564232e6fcb0 con 0x564232b39870 2024-09-17T01:41:13.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.508+0000 7f3f01000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564232b62730 0x564232f4f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.508+0000 7f3efbe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564232b39870 0x564232f23e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.508+0000 7f3efbe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564232b39870 0x564232f23e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:35286/0 (socket says 172.21.15.42:35286) 2024-09-17T01:41:13.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.508+0000 7f3f01000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564232b62730 0x564232f4f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45722/0 (socket says 172.21.15.42:45722) 2024-09-17T01:41:13.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.508+0000 7f3efbe00640 1 -- 172.21.15.42:0/854696014 learned_addr learned my addr 172.21.15.42:0/854696014 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:13.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.508+0000 7f3f01a00640 1 --2- 172.21.15.42:0/854696014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b41a50 0x564232f243d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.509+0000 7f3efbe00640 1 -- 172.21.15.42:0/854696014 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564232b62730 msgr2=0x564232f4f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:13.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.509+0000 7f3efbe00640 1 --2- 172.21.15.42:0/854696014 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564232b62730 0x564232f4f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.509+0000 7f3efbe00640 1 -- 172.21.15.42:0/854696014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b41a50 msgr2=0x564232f243d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:13.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.509+0000 7f3efbe00640 1 --2- 172.21.15.42:0/854696014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b41a50 0x564232f243d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.509+0000 7f3efbe00640 1 -- 172.21.15.42:0/854696014 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564232c46ba0 con 0x564232b39870 2024-09-17T01:41:13.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.509+0000 7f3efbe00640 1 --2- 172.21.15.42:0/854696014 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564232b39870 0x564232f23e90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8063590 tx=0x7f3ee8062e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62588de7be3b3c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:13.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.509+0000 7f3eed600640 1 -- 172.21.15.42:0/854696014 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee801f070 con 0x564232b39870 2024-09-17T01:41:13.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.509+0000 7f3eed600640 1 -- 172.21.15.42:0/854696014 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ee8089070 con 0x564232b39870 2024-09-17T01:41:13.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.509+0000 7f3eed600640 1 -- 172.21.15.42:0/854696014 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8062860 con 0x564232b39870 2024-09-17T01:41:13.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.510+0000 7f3f0abdb740 1 -- 172.21.15.42:0/854696014 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564232b39870 msgr2=0x564232f23e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:13.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.510+0000 7f3f0abdb740 1 --2- 172.21.15.42:0/854696014 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564232b39870 0x564232f23e90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8063590 tx=0x7f3ee8062e80 comp rx=0 tx=0).stop 2024-09-17T01:41:13.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.510+0000 7f3f0abdb740 1 -- 172.21.15.42:0/854696014 shutdown_connections 2024-09-17T01:41:13.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.510+0000 7f3f0abdb740 1 --2- 172.21.15.42:0/854696014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b41a50 0x564232f243d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.510+0000 7f3f0abdb740 1 --2- 172.21.15.42:0/854696014 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564232b39870 0x564232f23e90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.510+0000 7f3f0abdb740 1 --2- 172.21.15.42:0/854696014 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564232b62730 0x564232f4f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.510+0000 7f3f0abdb740 1 -- 172.21.15.42:0/854696014 >> 172.21.15.42:0/854696014 conn(0x564232b56880 msgr2=0x564232f0a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:13.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.510+0000 7f3f0abdb740 1 -- 172.21.15.42:0/854696014 shutdown_connections 2024-09-17T01:41:13.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.510+0000 7f3f0abdb740 1 -- 172.21.15.42:0/854696014 wait complete. 2024-09-17T01:41:13.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.511+0000 7f3f0abdb740 1 -- start start 2024-09-17T01:41:13.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.512+0000 7f3f0abdb740 1 Processor -- start 2024-09-17T01:41:13.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.513+0000 7f3f0abdb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b39870 0x564232f34490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.513+0000 7f3f0abdb740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564232b41a50 0x564232f61990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.513+0000 7f3f0abdb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564232b62730 0x564232f61ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.513+0000 7f3f0abdb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564232bdcae0 con 0x564232b39870 2024-09-17T01:41:13.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.513+0000 7f3f0abdb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564232e117b0 con 0x564232b62730 2024-09-17T01:41:13.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.513+0000 7f3f0abdb740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x564232f5f0c0 con 0x564232b41a50 2024-09-17T01:41:13.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.513+0000 7f3f0abdb740 10 client.0 _ll_register_callbacks cb 0x564232e17890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:41:13.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.513+0000 7f3f01000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b39870 0x564232f34490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.514+0000 7f3f01000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b39870 0x564232f34490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58396/0 (socket says 172.21.15.42:58396) 2024-09-17T01:41:13.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.514+0000 7f3f01000640 1 -- 172.21.15.42:0/3753894567 learned_addr learned my addr 172.21.15.42:0/3753894567 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:13.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.514+0000 7f3f01a00640 1 --2- 172.21.15.42:0/3753894567 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564232b62730 0x564232f61ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.514+0000 7f3efbe00640 1 --2- 172.21.15.42:0/3753894567 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564232b41a50 0x564232f61990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.514+0000 7f3f01000640 1 -- 172.21.15.42:0/3753894567 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564232b41a50 msgr2=0x564232f61990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:13.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.514+0000 7f3f01000640 1 --2- 172.21.15.42:0/3753894567 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564232b41a50 0x564232f61990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.514+0000 7f3f01000640 1 -- 172.21.15.42:0/3753894567 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564232b62730 msgr2=0x564232f61ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:13.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.514+0000 7f3f01000640 1 --2- 172.21.15.42:0/3753894567 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564232b62730 0x564232f61ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.514+0000 7f3f01000640 1 -- 172.21.15.42:0/3753894567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564232baba40 con 0x564232b39870 2024-09-17T01:41:13.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.514+0000 7f3f01000640 1 --2- 172.21.15.42:0/3753894567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b39870 0x564232f34490 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0036040 tx=0x7f3ef0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ac119f48c52e94 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:13.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.514+0000 7f3ee2000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:41:13.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.515+0000 7f3ee2000640 1 -- 172.21.15.42:0/3753894567 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef004d030 con 0x564232b39870 2024-09-17T01:41:13.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.515+0000 7f3f0abdb740 1 -- 172.21.15.42:0/3753894567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ee8089070 con 0x564232b39870 2024-09-17T01:41:13.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.515+0000 7f3ee2000640 1 -- 172.21.15.42:0/3753894567 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(125..125 src has 1..125) ==== 5767+0+0 (secure 0 0 0) 0x7f3ef003db70 con 0x564232b39870 2024-09-17T01:41:13.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.515+0000 7f3ee2000640 1 -- 172.21.15.42:0/3753894567 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f3ef0059050 con 0x564232b39870 2024-09-17T01:41:13.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.515+0000 7f3f0abdb740 10 client.8211 fetch_fsmap learned FSMap version 98 2024-09-17T01:41:13.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.515+0000 7f3f0abdb740 1 -- 172.21.15.42:0/3753894567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x564232ca7330 con 0x564232b39870 2024-09-17T01:41:13.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.515+0000 7f3ee2000640 1 -- 172.21.15.42:0/3753894567 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ee8089070 con 0x564232b39870 2024-09-17T01:41:13.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.515+0000 7f3ee2000640 1 -- 172.21.15.42:0/3753894567 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7f3ef005c020 con 0x564232b39870 2024-09-17T01:41:13.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.515+0000 7f3f0abdb740 10 client.8211 fetch_fsmap finished waiting for FSMap version 98 2024-09-17T01:41:13.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.515+0000 7f3f0abdb740 10 client.8211 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-17T01:41:13.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.515+0000 7f3f0abdb740 20 client.8211 populate_metadata read hostname 'smithi042' 2024-09-17T01:41:13.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.515+0000 7f3f0abdb740 1 --2- 172.21.15.42:0/3753894567 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x564232b21300 0x564232f099b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.515+0000 7f3f0abdb740 4 client.8211 mds_command: new command op to 8061 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:41:13.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.515+0000 7f3f0abdb740 1 -- 172.21.15.42:0/3753894567 --> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564232e7e9c0 con 0x564232b21300 2024-09-17T01:41:13.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.516+0000 7f3efbe00640 1 --2- 172.21.15.42:0/3753894567 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x564232b21300 0x564232f099b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.516+0000 7f3efbe00640 1 --2- 172.21.15.42:0/3753894567 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x564232b21300 0x564232f099b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9d4d19f7ecbf200 server_cookie=e5350e3ce7a2d03b in_seq=0 out_seq=0 2024-09-17T01:41:13.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.516+0000 7f3ee2000640 10 client.8211 ms_handle_connect on v2:172.21.15.42:6834/970028636 2024-09-17T01:41:13.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.517+0000 7f3ee2000640 1 -- 172.21.15.42:0/3753894567 <== mds.0 v2:172.21.15.42:6834/970028636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564232e7e9c0 con 0x564232b21300 2024-09-17T01:41:13.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.517+0000 7f3ee2000640 10 client.8211 handle_command_reply: tid=0 2024-09-17T01:41:13.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.517+0000 7f3f0abdb740 1 client.8211 shutdown 2024-09-17T01:41:13.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.517+0000 7f3f0abdb740 1 -- 172.21.15.42:0/3753894567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b39870 msgr2=0x564232f34490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:13.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.517+0000 7f3f0abdb740 1 --2- 172.21.15.42:0/3753894567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b39870 0x564232f34490 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0036040 tx=0x7f3ef0005f90 comp rx=0 tx=0).stop 2024-09-17T01:41:13.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.517+0000 7f3f0abdb740 1 -- 172.21.15.42:0/3753894567 shutdown_connections 2024-09-17T01:41:13.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.517+0000 7f3f0abdb740 1 --2- 172.21.15.42:0/3753894567 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x564232b21300 0x564232f099b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.517+0000 7f3f0abdb740 1 --2- 172.21.15.42:0/3753894567 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564232b62730 0x564232f61ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.517+0000 7f3f0abdb740 1 --2- 172.21.15.42:0/3753894567 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564232b41a50 0x564232f61990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.517+0000 7f3ee2000640 0 client.8211 ms_handle_reset on v2:172.21.15.42:6834/970028636 2024-09-17T01:41:13.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.517+0000 7f3f0abdb740 1 --2- 172.21.15.42:0/3753894567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b39870 0x564232f34490 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.517+0000 7f3f0abdb740 1 -- 172.21.15.42:0/3753894567 >> 172.21.15.42:0/3753894567 conn(0x564232b56880 msgr2=0x564232f4f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:13.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.517+0000 7f3f0abdb740 1 -- 172.21.15.42:0/3753894567 shutdown_connections 2024-09-17T01:41:13.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.517+0000 7f3f0abdb740 1 -- 172.21.15.42:0/3753894567 wait complete. 2024-09-17T01:41:13.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.518+0000 7f3f0abdb740 20 client.8211 trim_cache size 0 max 16384 2024-09-17T01:41:13.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.536+0000 7f3f0abdb740 1 Processor -- start 2024-09-17T01:41:13.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.537+0000 7f3f0abdb740 1 -- start start 2024-09-17T01:41:13.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.538+0000 7f3f0abdb740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564232b39870 0x564232f14260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.538+0000 7f3f0abdb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564232b41a50 0x564232f51aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.538+0000 7f3f0abdb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b62730 0x564232f45090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.538+0000 7f3f0abdb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3efc2028e0 con 0x564232b62730 2024-09-17T01:41:13.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.538+0000 7f3f0abdb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3efc201920 con 0x564232b41a50 2024-09-17T01:41:13.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.538+0000 7f3f0abdb740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3efc1f6490 con 0x564232b39870 2024-09-17T01:41:13.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.538+0000 7f3f01a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b62730 0x564232f45090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.538+0000 7f3f01a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b62730 0x564232f45090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58402/0 (socket says 172.21.15.42:58402) 2024-09-17T01:41:13.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.538+0000 7f3f01a00640 1 -- 172.21.15.42:0/538133232 learned_addr learned my addr 172.21.15.42:0/538133232 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:13.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.538+0000 7f3efbe00640 1 --2- 172.21.15.42:0/538133232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564232b41a50 0x564232f51aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.538+0000 7f3f01000640 1 --2- 172.21.15.42:0/538133232 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564232b39870 0x564232f14260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.539+0000 7f3f01a00640 1 -- 172.21.15.42:0/538133232 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564232b39870 msgr2=0x564232f14260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:13.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.539+0000 7f3f01a00640 1 --2- 172.21.15.42:0/538133232 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564232b39870 0x564232f14260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.539+0000 7f3f01a00640 1 -- 172.21.15.42:0/538133232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564232b41a50 msgr2=0x564232f51aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:13.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.539+0000 7f3f01a00640 1 --2- 172.21.15.42:0/538133232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564232b41a50 0x564232f51aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.539+0000 7f3f01a00640 1 -- 172.21.15.42:0/538133232 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564232c44ea0 con 0x564232b62730 2024-09-17T01:41:13.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.539+0000 7f3f01a00640 1 --2- 172.21.15.42:0/538133232 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b62730 0x564232f45090 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f3efc15c1e0 tx=0x7f3ef4006e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffef07d3cc1d97f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:13.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.539+0000 7f3eecc00640 1 -- 172.21.15.42:0/538133232 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef40067c0 con 0x564232b62730 2024-09-17T01:41:13.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.539+0000 7f3eecc00640 1 -- 172.21.15.42:0/538133232 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ef4012440 con 0x564232b62730 2024-09-17T01:41:13.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.539+0000 7f3eecc00640 1 -- 172.21.15.42:0/538133232 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4012870 con 0x564232b62730 2024-09-17T01:41:13.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.540+0000 7f3f0abdb740 1 -- 172.21.15.42:0/538133232 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b62730 msgr2=0x564232f45090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:13.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.540+0000 7f3f0abdb740 1 --2- 172.21.15.42:0/538133232 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b62730 0x564232f45090 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f3efc15c1e0 tx=0x7f3ef4006e90 comp rx=0 tx=0).stop 2024-09-17T01:41:13.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.540+0000 7f3f0abdb740 1 -- 172.21.15.42:0/538133232 shutdown_connections 2024-09-17T01:41:13.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.540+0000 7f3f0abdb740 1 --2- 172.21.15.42:0/538133232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564232b41a50 0x564232f51aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.540+0000 7f3f0abdb740 1 --2- 172.21.15.42:0/538133232 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b62730 0x564232f45090 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.540+0000 7f3f0abdb740 1 --2- 172.21.15.42:0/538133232 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564232b39870 0x564232f14260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.540+0000 7f3f0abdb740 1 -- 172.21.15.42:0/538133232 >> 172.21.15.42:0/538133232 conn(0x564232b56880 msgr2=0x564232f0a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:13.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.540+0000 7f3f0abdb740 1 -- 172.21.15.42:0/538133232 shutdown_connections 2024-09-17T01:41:13.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.540+0000 7f3f0abdb740 1 -- 172.21.15.42:0/538133232 wait complete. 2024-09-17T01:41:13.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.541+0000 7f3f0abdb740 1 -- start start 2024-09-17T01:41:13.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.541+0000 7f3f0abdb740 1 Processor -- start 2024-09-17T01:41:13.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.543+0000 7f3f0abdb740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564232b39870 0x564232fd1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.543+0000 7f3f0abdb740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564232b41a50 0x564232f22ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.543+0000 7f3f0abdb740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b62730 0x564232fd2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.543+0000 7f3f0abdb740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3efc201390 con 0x564232b62730 2024-09-17T01:41:13.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.543+0000 7f3f0abdb740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564232f51fe0 con 0x564232b41a50 2024-09-17T01:41:13.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.543+0000 7f3f0abdb740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x564232fd2de0 con 0x564232b39870 2024-09-17T01:41:13.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.543+0000 7f3f0abdb740 10 client.0 _ll_register_callbacks cb 0x7f3ef00099a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:41:13.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.543+0000 7f3f01a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b62730 0x564232fd2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.543+0000 7f3f01a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b62730 0x564232fd2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58416/0 (socket says 172.21.15.42:58416) 2024-09-17T01:41:13.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.543+0000 7f3f01a00640 1 -- 172.21.15.42:0/1370102997 learned_addr learned my addr 172.21.15.42:0/1370102997 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:13.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.543+0000 7f3efbe00640 1 --2- 172.21.15.42:0/1370102997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564232b41a50 0x564232f22ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.543+0000 7f3f01000640 1 --2- 172.21.15.42:0/1370102997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564232b39870 0x564232fd1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.543+0000 7f3f01a00640 1 -- 172.21.15.42:0/1370102997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564232b39870 msgr2=0x564232fd1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:13.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.543+0000 7f3f01a00640 1 --2- 172.21.15.42:0/1370102997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564232b39870 0x564232fd1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.543+0000 7f3f01a00640 1 -- 172.21.15.42:0/1370102997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564232b41a50 msgr2=0x564232f22ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:13.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.543+0000 7f3f01a00640 1 --2- 172.21.15.42:0/1370102997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564232b41a50 0x564232f22ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.543+0000 7f3f01a00640 1 -- 172.21.15.42:0/1370102997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564232f0a4f0 con 0x564232b62730 2024-09-17T01:41:13.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.544+0000 7f3f01a00640 1 --2- 172.21.15.42:0/1370102997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b62730 0x564232fd2310 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x564232f4fa40 tx=0x7f3ef4003e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0905745e664ce89 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:13.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.544+0000 7f3ee2000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:41:13.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.544+0000 7f3ee2000640 1 -- 172.21.15.42:0/1370102997 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4022040 con 0x564232b62730 2024-09-17T01:41:13.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.544+0000 7f3ee2000640 1 -- 172.21.15.42:0/1370102997 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(125..125 src has 1..125) ==== 5767+0+0 (secure 0 0 0) 0x7f3ef4029b10 con 0x564232b62730 2024-09-17T01:41:13.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.544+0000 7f3f0abdb740 1 -- 172.21.15.42:0/1370102997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ef4012440 con 0x564232b62730 2024-09-17T01:41:13.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.544+0000 7f3ee2000640 1 -- 172.21.15.42:0/1370102997 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f3ef4029d10 con 0x564232b62730 2024-09-17T01:41:13.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.544+0000 7f3f0abdb740 10 client.8217 fetch_fsmap learned FSMap version 98 2024-09-17T01:41:13.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.544+0000 7f3f0abdb740 1 -- 172.21.15.42:0/1370102997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x564232f23020 con 0x564232b62730 2024-09-17T01:41:13.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.545+0000 7f3ee2000640 1 -- 172.21.15.42:0/1370102997 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ef4012440 con 0x564232b62730 2024-09-17T01:41:13.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.545+0000 7f3ee2000640 1 -- 172.21.15.42:0/1370102997 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7f3ef40128f0 con 0x564232b62730 2024-09-17T01:41:13.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.545+0000 7f3f0abdb740 10 client.8217 fetch_fsmap finished waiting for FSMap version 98 2024-09-17T01:41:13.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.545+0000 7f3f0abdb740 10 client.8217 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-17T01:41:13.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.545+0000 7f3f0abdb740 20 client.8217 populate_metadata read hostname 'smithi042' 2024-09-17T01:41:13.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.545+0000 7f3f0abdb740 1 --2- 172.21.15.42:0/1370102997 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x564232f11b20 0x564232fd2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.545+0000 7f3f0abdb740 4 client.8217 mds_command: new command op to 8061 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-17T01:41:13.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.545+0000 7f3f0abdb740 1 -- 172.21.15.42:0/1370102997 --> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x564232e7a470 con 0x564232f11b20 2024-09-17T01:41:13.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.545+0000 7f3f01000640 1 --2- 172.21.15.42:0/1370102997 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x564232f11b20 0x564232fd2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.546+0000 7f3f01000640 1 --2- 172.21.15.42:0/1370102997 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x564232f11b20 0x564232fd2850 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82b7ad61c6d3544f server_cookie=ee1a201c31fe9d9 in_seq=0 out_seq=0 2024-09-17T01:41:13.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.546+0000 7f3ee2000640 10 client.8217 ms_handle_connect on v2:172.21.15.42:6834/970028636 2024-09-17T01:41:13.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.548+0000 7f3ee2000640 1 -- 172.21.15.42:0/1370102997 <== mds.0 v2:172.21.15.42:6834/970028636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564232e7a470 con 0x564232f11b20 2024-09-17T01:41:13.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.548+0000 7f3ee2000640 10 client.8217 handle_command_reply: tid=0 2024-09-17T01:41:13.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.548+0000 7f3f0abdb740 1 client.8217 shutdown 2024-09-17T01:41:13.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.548+0000 7f3f0abdb740 1 -- 172.21.15.42:0/1370102997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b62730 msgr2=0x564232fd2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:13.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.548+0000 7f3f0abdb740 1 --2- 172.21.15.42:0/1370102997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b62730 0x564232fd2310 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x564232f4fa40 tx=0x7f3ef4003e10 comp rx=0 tx=0).stop 2024-09-17T01:41:13.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.548+0000 7f3f0abdb740 1 -- 172.21.15.42:0/1370102997 shutdown_connections 2024-09-17T01:41:13.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.548+0000 7f3f0abdb740 1 --2- 172.21.15.42:0/1370102997 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x564232f11b20 0x564232fd2850 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.548+0000 7f3f0abdb740 1 --2- 172.21.15.42:0/1370102997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564232b41a50 0x564232f22ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.548+0000 7f3f0abdb740 1 --2- 172.21.15.42:0/1370102997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564232b62730 0x564232fd2310 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.548+0000 7f3f0abdb740 1 --2- 172.21.15.42:0/1370102997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564232b39870 0x564232fd1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.548+0000 7f3f0abdb740 1 -- 172.21.15.42:0/1370102997 >> 172.21.15.42:0/1370102997 conn(0x564232b56880 msgr2=0x564232f46410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:13.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.549+0000 7f3ee2000640 0 client.8217 ms_handle_reset on v2:172.21.15.42:6834/970028636 2024-09-17T01:41:13.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.549+0000 7f3f0abdb740 1 -- 172.21.15.42:0/1370102997 shutdown_connections 2024-09-17T01:41:13.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.549+0000 7f3f0abdb740 1 -- 172.21.15.42:0/1370102997 wait complete. 2024-09-17T01:41:13.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.549+0000 7f3f0abdb740 20 client.8217 trim_cache size 0 max 16384 2024-09-17T01:41:13.548 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:41:13.549 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-17T01:41:13.549 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "2990a5ea-b753-4d6e-b549-d67d493d6db9", 2024-09-17T01:41:13.549 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-17T01:41:13.549 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:41:13.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.549+0000 7f3f03a00640 1 -- 172.21.15.42:0/3632522471 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3edc078b90 msgr2=0x7f3edc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:13.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.549+0000 7f3f03a00640 1 --2- 172.21.15.42:0/3632522471 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3edc078b90 0x7f3edc07b0a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0035000 tx=0x7f3ef00046c0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.549+0000 7f3f03a00640 1 -- 172.21.15.42:0/3632522471 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3efc1f8f60 msgr2=0x7f3efc155400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:13.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.549+0000 7f3f03a00640 1 --2- 172.21.15.42:0/3632522471 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3efc1f8f60 0x7f3efc155400 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8006600 tx=0x7f3ee80039c0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.550+0000 7f3f03a00640 1 -- 172.21.15.42:0/3632522471 shutdown_connections 2024-09-17T01:41:13.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.550+0000 7f3f03a00640 1 --2- 172.21.15.42:0/3632522471 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3edc078b90 0x7f3edc07b0a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.550+0000 7f3f03a00640 1 --2- 172.21.15.42:0/3632522471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3efc151df0 0x7f3efc155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.550+0000 7f3f03a00640 1 --2- 172.21.15.42:0/3632522471 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3efc1f8f60 0x7f3efc155400 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.550+0000 7f3f03a00640 1 --2- 172.21.15.42:0/3632522471 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3ee4003ca0 0x7f3efc143ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.550+0000 7f3f03a00640 1 -- 172.21.15.42:0/3632522471 >> 172.21.15.42:0/3632522471 conn(0x7f3efc0b28f0 msgr2=0x7f3efc0b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:13.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.550+0000 7f3f03a00640 1 -- 172.21.15.42:0/3632522471 shutdown_connections 2024-09-17T01:41:13.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.550+0000 7f3f03a00640 1 -- 172.21.15.42:0/3632522471 wait complete. 2024-09-17T01:41:13.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:41:13.571 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub abort 2024-09-17T01:41:13.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.901+0000 7fd80be00640 1 -- 172.21.15.42:0/3995737467 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd80c1624b0 msgr2=0x7fd80c0d26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:13.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.901+0000 7fd80be00640 1 --2- 172.21.15.42:0/3995737467 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd80c1624b0 0x7fd80c0d26d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc005fd0 tx=0x7fd7fc02a4b0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.902+0000 7fd80be00640 1 -- 172.21.15.42:0/3995737467 shutdown_connections 2024-09-17T01:41:13.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.902+0000 7fd80be00640 1 --2- 172.21.15.42:0/3995737467 >> v2:172.21.15.43:3300/0 conn(0x7fd80c0cf630 0x7fd80c0cfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.902+0000 7fd80be00640 1 --2- 172.21.15.42:0/3995737467 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd80c1624b0 0x7fd80c0d26d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.902+0000 7fd80be00640 1 -- 172.21.15.42:0/3995737467 >> 172.21.15.42:0/3995737467 conn(0x7fd80c06cf00 msgr2=0x7fd80c06d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:13.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.902+0000 7fd80be00640 1 -- 172.21.15.42:0/3995737467 shutdown_connections 2024-09-17T01:41:13.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.902+0000 7fd80be00640 1 -- 172.21.15.42:0/3995737467 wait complete. 2024-09-17T01:41:13.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.904+0000 7fd80be00640 1 Processor -- start 2024-09-17T01:41:13.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.904+0000 7fd80be00640 1 -- start start 2024-09-17T01:41:13.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.906+0000 7fd80be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd80c0cf630 0x7fd80c0b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.906+0000 7fd80be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd80c0d1420 0x7fd80c0b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.906+0000 7fd80be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd80c1624b0 0x7fd80c0b4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.906+0000 7fd80be00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd80c15f630 con 0x7fd80c0cf630 2024-09-17T01:41:13.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.906+0000 7fd80be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd80c15f4b0 con 0x7fd80c0d1420 2024-09-17T01:41:13.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.906+0000 7fd80be00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd80c15f7b0 con 0x7fd80c1624b0 2024-09-17T01:41:13.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.906+0000 7fd80aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd80c0cf630 0x7fd80c0b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.906+0000 7fd80aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd80c0cf630 0x7fd80c0b4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58418/0 (socket says 172.21.15.42:58418) 2024-09-17T01:41:13.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.906+0000 7fd80aa00640 1 -- 172.21.15.42:0/197648139 learned_addr learned my addr 172.21.15.42:0/197648139 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:13.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.906+0000 7fd80a000640 1 --2- 172.21.15.42:0/197648139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd80c0d1420 0x7fd80c0b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.906+0000 7fd80b400640 1 --2- 172.21.15.42:0/197648139 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd80c1624b0 0x7fd80c0b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.907+0000 7fd80aa00640 1 -- 172.21.15.42:0/197648139 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd80c1624b0 msgr2=0x7fd80c0b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:13.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.907+0000 7fd80aa00640 1 --2- 172.21.15.42:0/197648139 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd80c1624b0 0x7fd80c0b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.907+0000 7fd80aa00640 1 -- 172.21.15.42:0/197648139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd80c0d1420 msgr2=0x7fd80c0b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:13.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.907+0000 7fd80aa00640 1 --2- 172.21.15.42:0/197648139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd80c0d1420 0x7fd80c0b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.907+0000 7fd80aa00640 1 -- 172.21.15.42:0/197648139 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd80c14b8b0 con 0x7fd80c0cf630 2024-09-17T01:41:13.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.907+0000 7fd80aa00640 1 --2- 172.21.15.42:0/197648139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd80c0cf630 0x7fd80c0b4fb0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc034040 tx=0x7fd7fc0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:13.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.907+0000 7fd803400640 1 -- 172.21.15.42:0/197648139 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc03e030 con 0x7fd80c0cf630 2024-09-17T01:41:13.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.908+0000 7fd803400640 1 -- 172.21.15.42:0/197648139 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7fc003ca0 con 0x7fd80c0cf630 2024-09-17T01:41:13.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.908+0000 7fd803400640 1 -- 172.21.15.42:0/197648139 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc035040 con 0x7fd80c0cf630 2024-09-17T01:41:13.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.908+0000 7fd80be00640 1 -- 172.21.15.42:0/197648139 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd80c0b4650 con 0x7fd80c0cf630 2024-09-17T01:41:13.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.908+0000 7fd80be00640 1 -- 172.21.15.42:0/197648139 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd80c14bb50 con 0x7fd80c0cf630 2024-09-17T01:41:13.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.910+0000 7fd803400640 1 -- 172.21.15.42:0/197648139 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd7fc041030 con 0x7fd80c0cf630 2024-09-17T01:41:13.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.911+0000 7fd803400640 1 --2- 172.21.15.42:0/197648139 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd7ec078b90 0x7fd7ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.912+0000 7fd803400640 1 -- 172.21.15.42:0/197648139 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5767+0+0 (secure 0 0 0) 0x7fd7fc0bb390 con 0x7fd80c0cf630 2024-09-17T01:41:13.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.912+0000 7fd80a000640 1 --2- 172.21.15.42:0/197648139 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd7ec078b90 0x7fd7ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.912+0000 7fd818e8a740 1 Processor -- start 2024-09-17T01:41:13.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.913+0000 7fd80a000640 1 --2- 172.21.15.42:0/197648139 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd7ec078b90 0x7fd7ec07b0a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0ca140 tx=0x7fd7f8009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:13.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.913+0000 7fd818e8a740 1 -- start start 2024-09-17T01:41:13.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.914+0000 7fd818e8a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd08593390 0x55cd08982860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.914+0000 7fd818e8a740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55cd0856a4d0 0x55cd08965530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.914+0000 7fd818e8a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd085726b0 0x55cd08965a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.914+0000 7fd818e8a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cd0884ec10 con 0x55cd08593390 2024-09-17T01:41:13.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.914+0000 7fd818e8a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55cd088ad9f0 con 0x55cd085726b0 2024-09-17T01:41:13.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.914+0000 7fd818e8a740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55cd0889ce20 con 0x55cd0856a4d0 2024-09-17T01:41:13.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.915+0000 7fd80a000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55cd0856a4d0 0x55cd08965530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.915+0000 7fd80a000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55cd0856a4d0 0x55cd08965530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:35326/0 (socket says 172.21.15.42:35326) 2024-09-17T01:41:13.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.915+0000 7fd80a000640 1 -- 172.21.15.42:0/1103251098 learned_addr learned my addr 172.21.15.42:0/1103251098 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:13.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.915+0000 7fd80b400640 1 --2- 172.21.15.42:0/1103251098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd085726b0 0x55cd08965a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.915+0000 7fd80aa00640 1 --2- 172.21.15.42:0/1103251098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd08593390 0x55cd08982860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.915+0000 7fd80a000640 1 -- 172.21.15.42:0/1103251098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd085726b0 msgr2=0x55cd08965a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:13.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.915+0000 7fd80a000640 1 --2- 172.21.15.42:0/1103251098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd085726b0 0x55cd08965a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.915+0000 7fd80a000640 1 -- 172.21.15.42:0/1103251098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd08593390 msgr2=0x55cd08982860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:13.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.915+0000 7fd80a000640 1 --2- 172.21.15.42:0/1103251098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd08593390 0x55cd08982860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.915+0000 7fd80a000640 1 -- 172.21.15.42:0/1103251098 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd086757d0 con 0x55cd0856a4d0 2024-09-17T01:41:13.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.916+0000 7fd80a000640 1 --2- 172.21.15.42:0/1103251098 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55cd0856a4d0 0x55cd08965530 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800f9f0 tx=0x7fd7f8012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ff1815991023d80 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:13.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.916+0000 7fd7f7400640 1 -- 172.21.15.42:0/1103251098 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8025070 con 0x55cd0856a4d0 2024-09-17T01:41:13.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.916+0000 7fd7f7400640 1 -- 172.21.15.42:0/1103251098 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7f801b050 con 0x55cd0856a4d0 2024-09-17T01:41:13.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.916+0000 7fd7f7400640 1 -- 172.21.15.42:0/1103251098 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8014d60 con 0x55cd0856a4d0 2024-09-17T01:41:13.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.917+0000 7fd818e8a740 1 -- 172.21.15.42:0/1103251098 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55cd0856a4d0 msgr2=0x55cd08965530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:13.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.917+0000 7fd818e8a740 1 --2- 172.21.15.42:0/1103251098 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55cd0856a4d0 0x55cd08965530 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800f9f0 tx=0x7fd7f8012000 comp rx=0 tx=0).stop 2024-09-17T01:41:13.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.917+0000 7fd818e8a740 1 -- 172.21.15.42:0/1103251098 shutdown_connections 2024-09-17T01:41:13.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.917+0000 7fd818e8a740 1 --2- 172.21.15.42:0/1103251098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd085726b0 0x55cd08965a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.917+0000 7fd818e8a740 1 --2- 172.21.15.42:0/1103251098 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55cd0856a4d0 0x55cd08965530 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.917+0000 7fd818e8a740 1 --2- 172.21.15.42:0/1103251098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd08593390 0x55cd08982860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.917+0000 7fd818e8a740 1 -- 172.21.15.42:0/1103251098 >> 172.21.15.42:0/1103251098 conn(0x55cd085874e0 msgr2=0x55cd0893b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:13.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.918+0000 7fd818e8a740 1 -- 172.21.15.42:0/1103251098 shutdown_connections 2024-09-17T01:41:13.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.918+0000 7fd818e8a740 1 -- 172.21.15.42:0/1103251098 wait complete. 2024-09-17T01:41:13.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.919+0000 7fd818e8a740 1 -- start start 2024-09-17T01:41:13.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.919+0000 7fd818e8a740 1 Processor -- start 2024-09-17T01:41:13.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.921+0000 7fd818e8a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd0856a4d0 0x55cd0897d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.921+0000 7fd818e8a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd085726b0 0x55cd08953c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.921+0000 7fd818e8a740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55cd08593390 0x55cd08977620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.921+0000 7fd818e8a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cd08842790 con 0x55cd085726b0 2024-09-17T01:41:13.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.921+0000 7fd818e8a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55cd088a0c30 con 0x55cd0856a4d0 2024-09-17T01:41:13.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.921+0000 7fd818e8a740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55cd0860d740 con 0x55cd08593390 2024-09-17T01:41:13.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.921+0000 7fd818e8a740 10 client.0 _ll_register_callbacks cb 0x55cd08852260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:41:13.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.921+0000 7fd80b400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55cd08593390 0x55cd08977620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.921+0000 7fd80aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd0856a4d0 0x55cd0897d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.921+0000 7fd80b400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55cd08593390 0x55cd08977620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:35334/0 (socket says 172.21.15.42:35334) 2024-09-17T01:41:13.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.921+0000 7fd80b400640 1 -- 172.21.15.42:0/3935655162 learned_addr learned my addr 172.21.15.42:0/3935655162 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:13.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.921+0000 7fd80a000640 1 --2- 172.21.15.42:0/3935655162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd085726b0 0x55cd08953c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.922+0000 7fd80aa00640 1 -- 172.21.15.42:0/3935655162 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55cd08593390 msgr2=0x55cd08977620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:13.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.922+0000 7fd80aa00640 1 --2- 172.21.15.42:0/3935655162 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55cd08593390 0x55cd08977620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.922+0000 7fd80aa00640 1 -- 172.21.15.42:0/3935655162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd085726b0 msgr2=0x55cd08953c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:13.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.922+0000 7fd80aa00640 1 --2- 172.21.15.42:0/3935655162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd085726b0 0x55cd08953c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.922+0000 7fd80aa00640 1 -- 172.21.15.42:0/3935655162 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd085dc6a0 con 0x55cd0856a4d0 2024-09-17T01:41:13.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.922+0000 7fd80aa00640 1 --2- 172.21.15.42:0/3935655162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd0856a4d0 0x55cd0897d770 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0b9870 tx=0x7fd7fc0829f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1dc0538e04925a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:13.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.922+0000 7fd7ebe00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-17T01:41:13.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.922+0000 7fd7ebe00640 1 -- 172.21.15.42:0/3935655162 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc048040 con 0x55cd0856a4d0 2024-09-17T01:41:13.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.922+0000 7fd7ebe00640 1 -- 172.21.15.42:0/3935655162 <== mon.1 v2:172.21.15.43:3300/0 2 ==== osd_map(125..125 src has 1..125) ==== 5767+0+0 (secure 0 0 0) 0x7fd7fc08c610 con 0x55cd0856a4d0 2024-09-17T01:41:13.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.922+0000 7fd818e8a740 1 -- 172.21.15.42:0/3935655162 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7f801b050 con 0x55cd0856a4d0 2024-09-17T01:41:13.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.923+0000 7fd7ebe00640 1 -- 172.21.15.42:0/3935655162 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7fd7fc0831c0 con 0x55cd0856a4d0 2024-09-17T01:41:13.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.923+0000 7fd818e8a740 10 client.7741 fetch_fsmap learned FSMap version 98 2024-09-17T01:41:13.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.923+0000 7fd818e8a740 1 -- 172.21.15.42:0/3935655162 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x55cd086d5f60 con 0x55cd0856a4d0 2024-09-17T01:41:13.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.923+0000 7fd7ebe00640 1 -- 172.21.15.42:0/3935655162 <== mon.1 v2:172.21.15.43:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7f801b050 con 0x55cd0856a4d0 2024-09-17T01:41:13.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.923+0000 7fd7ebe00640 1 -- 172.21.15.42:0/3935655162 <== mon.1 v2:172.21.15.43:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7fd7fc082420 con 0x55cd0856a4d0 2024-09-17T01:41:13.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.923+0000 7fd818e8a740 10 client.7741 fetch_fsmap finished waiting for FSMap version 98 2024-09-17T01:41:13.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.923+0000 7fd818e8a740 10 client.7741 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-17T01:41:13.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.923+0000 7fd818e8a740 20 client.7741 populate_metadata read hostname 'smithi042' 2024-09-17T01:41:13.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.923+0000 7fd818e8a740 1 --2- 172.21.15.42:0/3935655162 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x55cd08551f60 0x55cd08977b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.923+0000 7fd818e8a740 4 client.7741 mds_command: new command op to 8061 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:41:13.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.923+0000 7fd818e8a740 1 -- 172.21.15.42:0/3935655162 --> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd088af940 con 0x55cd08551f60 2024-09-17T01:41:13.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.923+0000 7fd80a000640 1 --2- 172.21.15.42:0/3935655162 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x55cd08551f60 0x55cd08977b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.924+0000 7fd80a000640 1 --2- 172.21.15.42:0/3935655162 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x55cd08551f60 0x55cd08977b60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90c44d3b4c4625bd server_cookie=d0c83fdad292ecf4 in_seq=0 out_seq=0 2024-09-17T01:41:13.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.924+0000 7fd7ebe00640 10 client.7741 ms_handle_connect on v2:172.21.15.42:6834/970028636 2024-09-17T01:41:13.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.927+0000 7fd7ebe00640 1 -- 172.21.15.42:0/3935655162 <== mds.0 v2:172.21.15.42:6834/970028636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cd088af940 con 0x55cd08551f60 2024-09-17T01:41:13.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.927+0000 7fd7ebe00640 10 client.7741 handle_command_reply: tid=0 2024-09-17T01:41:13.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.927+0000 7fd818e8a740 1 client.7741 shutdown 2024-09-17T01:41:13.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.928+0000 7fd818e8a740 1 -- 172.21.15.42:0/3935655162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd0856a4d0 msgr2=0x55cd0897d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:13.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.928+0000 7fd818e8a740 1 --2- 172.21.15.42:0/3935655162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd0856a4d0 0x55cd0897d770 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0b9870 tx=0x7fd7fc0829f0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.928+0000 7fd818e8a740 1 -- 172.21.15.42:0/3935655162 shutdown_connections 2024-09-17T01:41:13.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.928+0000 7fd818e8a740 1 --2- 172.21.15.42:0/3935655162 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x55cd08551f60 0x55cd08977b60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.928+0000 7fd818e8a740 1 --2- 172.21.15.42:0/3935655162 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55cd08593390 0x55cd08977620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.928+0000 7fd818e8a740 1 --2- 172.21.15.42:0/3935655162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd085726b0 0x55cd08953c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.928+0000 7fd7ebe00640 0 client.7741 ms_handle_reset on v2:172.21.15.42:6834/970028636 2024-09-17T01:41:13.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.928+0000 7fd818e8a740 1 --2- 172.21.15.42:0/3935655162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd0856a4d0 0x55cd0897d770 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.928+0000 7fd818e8a740 1 -- 172.21.15.42:0/3935655162 >> 172.21.15.42:0/3935655162 conn(0x55cd085874e0 msgr2=0x55cd08954cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:13.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.928+0000 7fd818e8a740 1 -- 172.21.15.42:0/3935655162 shutdown_connections 2024-09-17T01:41:13.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.928+0000 7fd818e8a740 1 -- 172.21.15.42:0/3935655162 wait complete. 2024-09-17T01:41:13.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.928+0000 7fd818e8a740 20 client.7741 trim_cache size 0 max 16384 2024-09-17T01:41:13.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.958+0000 7fd818e8a740 1 Processor -- start 2024-09-17T01:41:13.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.958+0000 7fd818e8a740 1 -- start start 2024-09-17T01:41:13.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.960+0000 7fd818e8a740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55cd0856a4d0 0x55cd0897c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.960+0000 7fd818e8a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd085726b0 0x55cd0897abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.960+0000 7fd818e8a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd08593390 0x55cd0897b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.960+0000 7fd818e8a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd80c202180 con 0x55cd08593390 2024-09-17T01:41:13.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.960+0000 7fd818e8a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd80c201240 con 0x55cd085726b0 2024-09-17T01:41:13.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.960+0000 7fd818e8a740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd80c1f6610 con 0x55cd0856a4d0 2024-09-17T01:41:13.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.960+0000 7fd80b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd08593390 0x55cd0897b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.960+0000 7fd80a000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd085726b0 0x55cd0897abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.960+0000 7fd80aa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55cd0856a4d0 0x55cd0897c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.960+0000 7fd80b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd08593390 0x55cd0897b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58454/0 (socket says 172.21.15.42:58454) 2024-09-17T01:41:13.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.960+0000 7fd80a000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd085726b0 0x55cd0897abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45792/0 (socket says 172.21.15.42:45792) 2024-09-17T01:41:13.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.960+0000 7fd80b400640 1 -- 172.21.15.42:0/901722262 learned_addr learned my addr 172.21.15.42:0/901722262 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:13.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.961+0000 7fd80a000640 1 -- 172.21.15.42:0/901722262 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55cd0856a4d0 msgr2=0x55cd0897c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:13.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.961+0000 7fd80a000640 1 --2- 172.21.15.42:0/901722262 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55cd0856a4d0 0x55cd0897c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.961+0000 7fd80a000640 1 -- 172.21.15.42:0/901722262 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd08593390 msgr2=0x55cd0897b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:13.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.961+0000 7fd80a000640 1 --2- 172.21.15.42:0/901722262 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd08593390 0x55cd0897b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.961+0000 7fd80a000640 1 -- 172.21.15.42:0/901722262 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd08673ad0 con 0x55cd085726b0 2024-09-17T01:41:13.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.961+0000 7fd80b400640 1 --2- 172.21.15.42:0/901722262 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd08593390 0x55cd0897b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:41:13.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.961+0000 7fd80a000640 1 --2- 172.21.15.42:0/901722262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd085726b0 0x55cd0897abc0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x55cd089366e0 tx=0x7fd7f8007e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d650b0bb3dc67506 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:13.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.961+0000 7fd7f6a00640 1 -- 172.21.15.42:0/901722262 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8025040 con 0x55cd085726b0 2024-09-17T01:41:13.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.961+0000 7fd7f6a00640 1 -- 172.21.15.42:0/901722262 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7f8038070 con 0x55cd085726b0 2024-09-17T01:41:13.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.961+0000 7fd7f6a00640 1 -- 172.21.15.42:0/901722262 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f802ca60 con 0x55cd085726b0 2024-09-17T01:41:13.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.962+0000 7fd818e8a740 1 -- 172.21.15.42:0/901722262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd085726b0 msgr2=0x55cd0897abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:13.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.962+0000 7fd818e8a740 1 --2- 172.21.15.42:0/901722262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd085726b0 0x55cd0897abc0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x55cd089366e0 tx=0x7fd7f8007e30 comp rx=0 tx=0).stop 2024-09-17T01:41:13.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.962+0000 7fd818e8a740 1 -- 172.21.15.42:0/901722262 shutdown_connections 2024-09-17T01:41:13.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.962+0000 7fd818e8a740 1 --2- 172.21.15.42:0/901722262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd085726b0 0x55cd0897abc0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.962+0000 7fd818e8a740 1 --2- 172.21.15.42:0/901722262 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd08593390 0x55cd0897b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.962+0000 7fd818e8a740 1 --2- 172.21.15.42:0/901722262 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55cd0856a4d0 0x55cd0897c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.963+0000 7fd818e8a740 1 -- 172.21.15.42:0/901722262 >> 172.21.15.42:0/901722262 conn(0x55cd085874e0 msgr2=0x55cd08961f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:13.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.963+0000 7fd818e8a740 1 -- 172.21.15.42:0/901722262 shutdown_connections 2024-09-17T01:41:13.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.963+0000 7fd818e8a740 1 -- 172.21.15.42:0/901722262 wait complete. 2024-09-17T01:41:13.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.964+0000 7fd818e8a740 1 -- start start 2024-09-17T01:41:13.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.964+0000 7fd818e8a740 1 Processor -- start 2024-09-17T01:41:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.966+0000 7fd818e8a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd0856a4d0 0x55cd08955440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.966+0000 7fd818e8a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd085726b0 0x55cd089828e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.966+0000 7fd818e8a740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55cd08593390 0x55cd08a030d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.966+0000 7fd818e8a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cd08937d30 con 0x55cd085726b0 2024-09-17T01:41:13.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.967+0000 7fd818e8a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd80c1f9880 con 0x55cd0856a4d0 2024-09-17T01:41:13.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.967+0000 7fd818e8a740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55cd08935a70 con 0x55cd08593390 2024-09-17T01:41:13.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.967+0000 7fd818e8a740 10 client.0 _ll_register_callbacks cb 0x7fd7fc07f060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:41:13.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.967+0000 7fd80a000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd085726b0 0x55cd089828e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.967+0000 7fd80aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd0856a4d0 0x55cd08955440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.967+0000 7fd80aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd0856a4d0 0x55cd08955440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45808/0 (socket says 172.21.15.42:45808) 2024-09-17T01:41:13.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.967+0000 7fd80b400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55cd08593390 0x55cd08a030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.967+0000 7fd80a000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd085726b0 0x55cd089828e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58462/0 (socket says 172.21.15.42:58462) 2024-09-17T01:41:13.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.967+0000 7fd80aa00640 1 -- 172.21.15.42:0/1140136778 learned_addr learned my addr 172.21.15.42:0/1140136778 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:13.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.967+0000 7fd80aa00640 1 -- 172.21.15.42:0/1140136778 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55cd08593390 msgr2=0x55cd08a030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:13.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.967+0000 7fd80aa00640 1 --2- 172.21.15.42:0/1140136778 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55cd08593390 0x55cd08a030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.967+0000 7fd80aa00640 1 -- 172.21.15.42:0/1140136778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd085726b0 msgr2=0x55cd089828e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:13.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.967+0000 7fd80aa00640 1 --2- 172.21.15.42:0/1140136778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd085726b0 0x55cd089828e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.967+0000 7fd80aa00640 1 -- 172.21.15.42:0/1140136778 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd08962020 con 0x55cd0856a4d0 2024-09-17T01:41:13.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.967+0000 7fd80a000640 1 --2- 172.21.15.42:0/1140136778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd085726b0 0x55cd089828e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:41:13.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.968+0000 7fd80aa00640 1 --2- 172.21.15.42:0/1140136778 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd0856a4d0 0x55cd08955440 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009850 tx=0x7fd7fc07f640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8d2afd09ce244b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:13.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.968+0000 7fd7ebe00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-17T01:41:13.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.968+0000 7fd7ebe00640 1 -- 172.21.15.42:0/1140136778 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc048040 con 0x55cd0856a4d0 2024-09-17T01:41:13.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.968+0000 7fd7ebe00640 1 -- 172.21.15.42:0/1140136778 <== mon.1 v2:172.21.15.43:3300/0 2 ==== osd_map(125..125 src has 1..125) ==== 5767+0+0 (secure 0 0 0) 0x7fd7fc08c820 con 0x55cd0856a4d0 2024-09-17T01:41:13.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.968+0000 7fd818e8a740 1 -- 172.21.15.42:0/1140136778 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7f8038070 con 0x55cd0856a4d0 2024-09-17T01:41:13.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.968+0000 7fd7ebe00640 1 -- 172.21.15.42:0/1140136778 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7fd7fc094050 con 0x55cd0856a4d0 2024-09-17T01:41:13.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.968+0000 7fd818e8a740 10 client.7747 fetch_fsmap learned FSMap version 98 2024-09-17T01:41:13.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.968+0000 7fd818e8a740 1 -- 172.21.15.42:0/1140136778 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x55cd0897fdf0 con 0x55cd0856a4d0 2024-09-17T01:41:13.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.969+0000 7fd7ebe00640 1 -- 172.21.15.42:0/1140136778 <== mon.1 v2:172.21.15.43:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7f8038070 con 0x55cd0856a4d0 2024-09-17T01:41:13.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.969+0000 7fd7ebe00640 1 -- 172.21.15.42:0/1140136778 <== mon.1 v2:172.21.15.43:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7fd7fc097020 con 0x55cd0856a4d0 2024-09-17T01:41:13.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.969+0000 7fd818e8a740 10 client.7747 fetch_fsmap finished waiting for FSMap version 98 2024-09-17T01:41:13.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.969+0000 7fd818e8a740 10 client.7747 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-17T01:41:13.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.969+0000 7fd818e8a740 20 client.7747 populate_metadata read hostname 'smithi042' 2024-09-17T01:41:13.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.969+0000 7fd818e8a740 1 --2- 172.21.15.42:0/1140136778 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x55cd0897c520 0x55cd08a03610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:13.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.969+0000 7fd818e8a740 4 client.7747 mds_command: new command op to 8061 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-17T01:41:13.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.969+0000 7fd818e8a740 1 -- 172.21.15.42:0/1140136778 --> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x55cd08978e60 con 0x55cd0897c520 2024-09-17T01:41:13.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.969+0000 7fd80a000640 1 --2- 172.21.15.42:0/1140136778 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x55cd0897c520 0x55cd08a03610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:13.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.970+0000 7fd7ebe00640 10 client.7747 ms_handle_connect on v2:172.21.15.42:6834/970028636 2024-09-17T01:41:13.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.970+0000 7fd80a000640 1 --2- 172.21.15.42:0/1140136778 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x55cd0897c520 0x55cd08a03610 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6fe242091f66f80 server_cookie=cb8a6cfd2bcc5967 in_seq=0 out_seq=0 2024-09-17T01:41:13.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.984+0000 7fd7ebe00640 1 -- 172.21.15.42:0/1140136778 <== mds.0 v2:172.21.15.42:6834/970028636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cd08978e60 con 0x55cd0897c520 2024-09-17T01:41:13.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.984+0000 7fd7ebe00640 10 client.7747 handle_command_reply: tid=0 2024-09-17T01:41:13.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.984+0000 7fd818e8a740 1 client.7747 shutdown 2024-09-17T01:41:13.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.985+0000 7fd818e8a740 1 -- 172.21.15.42:0/1140136778 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd0856a4d0 msgr2=0x55cd08955440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:13.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.985+0000 7fd818e8a740 1 --2- 172.21.15.42:0/1140136778 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd0856a4d0 0x55cd08955440 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009850 tx=0x7fd7fc07f640 comp rx=0 tx=0).stop 2024-09-17T01:41:13.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.985+0000 7fd818e8a740 1 -- 172.21.15.42:0/1140136778 shutdown_connections 2024-09-17T01:41:13.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.985+0000 7fd818e8a740 1 --2- 172.21.15.42:0/1140136778 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x55cd0897c520 0x55cd08a03610 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.985+0000 7fd818e8a740 1 --2- 172.21.15.42:0/1140136778 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55cd08593390 0x55cd08a030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.985+0000 7fd818e8a740 1 --2- 172.21.15.42:0/1140136778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cd085726b0 0x55cd089828e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.985+0000 7fd818e8a740 1 --2- 172.21.15.42:0/1140136778 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55cd0856a4d0 0x55cd08955440 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.985+0000 7fd7ebe00640 0 client.7747 ms_handle_reset on v2:172.21.15.42:6834/970028636 2024-09-17T01:41:13.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.985+0000 7fd818e8a740 1 -- 172.21.15.42:0/1140136778 >> 172.21.15.42:0/1140136778 conn(0x55cd085874e0 msgr2=0x55cd0893c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:13.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.985+0000 7fd818e8a740 1 -- 172.21.15.42:0/1140136778 shutdown_connections 2024-09-17T01:41:13.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.985+0000 7fd818e8a740 1 -- 172.21.15.42:0/1140136778 wait complete. 2024-09-17T01:41:13.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.985+0000 7fd818e8a740 20 client.7747 trim_cache size 0 max 16384 2024-09-17T01:41:13.984 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:41:13.985 INFO:teuthology.orchestra.run.smithi042.stdout: "message": "", 2024-09-17T01:41:13.985 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0 2024-09-17T01:41:13.985 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:41:13.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.986+0000 7fd80be00640 1 -- 172.21.15.42:0/197648139 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd7ec078b90 msgr2=0x7fd7ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:13.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.986+0000 7fd80be00640 1 --2- 172.21.15.42:0/197648139 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd7ec078b90 0x7fd7ec07b0a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0ca140 tx=0x7fd7f8009040 comp rx=0 tx=0).stop 2024-09-17T01:41:13.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.986+0000 7fd80be00640 1 -- 172.21.15.42:0/197648139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd80c0cf630 msgr2=0x7fd80c0b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:13.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.986+0000 7fd80be00640 1 --2- 172.21.15.42:0/197648139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd80c0cf630 0x7fd80c0b4fb0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc034040 tx=0x7fd7fc0038a0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.986+0000 7fd80be00640 1 -- 172.21.15.42:0/197648139 shutdown_connections 2024-09-17T01:41:13.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.986+0000 7fd80be00640 1 --2- 172.21.15.42:0/197648139 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd7ec078b90 0x7fd7ec07b0a0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.986+0000 7fd80be00640 1 --2- 172.21.15.42:0/197648139 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd80c0d1420 0x7fd80c0b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.986+0000 7fd80be00640 1 --2- 172.21.15.42:0/197648139 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd80c1624b0 0x7fd80c0b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.986+0000 7fd80be00640 1 --2- 172.21.15.42:0/197648139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd80c0cf630 0x7fd80c0b4fb0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:13.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.986+0000 7fd80be00640 1 -- 172.21.15.42:0/197648139 >> 172.21.15.42:0/197648139 conn(0x7fd80c06cf00 msgr2=0x7fd80c161470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:13.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.986+0000 7fd80be00640 1 -- 172.21.15.42:0/197648139 shutdown_connections 2024-09-17T01:41:13.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:13.987+0000 7fd80be00640 1 -- 172.21.15.42:0/197648139 wait complete. 2024-09-17T01:41:14.008 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T01:41:14.009 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.8:0 scrub status 2024-09-17T01:41:14.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.240+0000 7f8e62800640 1 -- 172.21.15.42:0/3842108999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e5c15c7c0 msgr2=0x7f8e5c06edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:14.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.240+0000 7f8e62800640 1 --2- 172.21.15.42:0/3842108999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e5c15c7c0 0x7f8e5c06edf0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8e48009830 tx=0x7f8e4802a5c0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.240+0000 7f8e62800640 1 -- 172.21.15.42:0/3842108999 shutdown_connections 2024-09-17T01:41:14.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.240+0000 7f8e62800640 1 --2- 172.21.15.42:0/3842108999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e5c15c7c0 0x7f8e5c06edf0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.240+0000 7f8e62800640 1 -- 172.21.15.42:0/3842108999 >> 172.21.15.42:0/3842108999 conn(0x7f8e5c06cf00 msgr2=0x7f8e5c06d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:14.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.240+0000 7f8e62800640 1 -- 172.21.15.42:0/3842108999 shutdown_connections 2024-09-17T01:41:14.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.240+0000 7f8e62800640 1 -- 172.21.15.42:0/3842108999 wait complete. 2024-09-17T01:41:14.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.242+0000 7f8e62800640 1 Processor -- start 2024-09-17T01:41:14.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.243+0000 7f8e62800640 1 -- start start 2024-09-17T01:41:14.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.244+0000 7f8e62800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8e5c0701c0 0x7f8e5c147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:14.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.244+0000 7f8e62800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e5c0d0e90 0x7f8e5c1f9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:14.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.244+0000 7f8e62800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e5c15c7c0 0x7f8e5c0b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:14.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.244+0000 7f8e62800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5c0af6a0 con 0x7f8e5c15c7c0 2024-09-17T01:41:14.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.244+0000 7f8e62800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5c0af520 con 0x7f8e5c0d0e90 2024-09-17T01:41:14.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.244+0000 7f8e62800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8e5c0af820 con 0x7f8e5c0701c0 2024-09-17T01:41:14.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.244+0000 7f8e5be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e5c15c7c0 0x7f8e5c0b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:14.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.244+0000 7f8e5be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e5c15c7c0 0x7f8e5c0b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58468/0 (socket says 172.21.15.42:58468) 2024-09-17T01:41:14.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.244+0000 7f8e5be00640 1 -- 172.21.15.42:0/1640144430 learned_addr learned my addr 172.21.15.42:0/1640144430 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:14.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.245+0000 7f8e5b400640 1 --2- 172.21.15.42:0/1640144430 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8e5c0701c0 0x7f8e5c147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:14.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.245+0000 7f8e5aa00640 1 --2- 172.21.15.42:0/1640144430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e5c0d0e90 0x7f8e5c1f9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:14.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.245+0000 7f8e5be00640 1 -- 172.21.15.42:0/1640144430 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8e5c0701c0 msgr2=0x7f8e5c147770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:14.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.245+0000 7f8e5be00640 1 --2- 172.21.15.42:0/1640144430 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8e5c0701c0 0x7f8e5c147770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.245+0000 7f8e5be00640 1 -- 172.21.15.42:0/1640144430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e5c0d0e90 msgr2=0x7f8e5c1f9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:14.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.245+0000 7f8e5be00640 1 --2- 172.21.15.42:0/1640144430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e5c0d0e90 0x7f8e5c1f9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.245+0000 7f8e5be00640 1 -- 172.21.15.42:0/1640144430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e5c155d90 con 0x7f8e5c15c7c0 2024-09-17T01:41:14.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.245+0000 7f8e5be00640 1 --2- 172.21.15.42:0/1640144430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e5c15c7c0 0x7f8e5c0b1470 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400c6b0 tx=0x7f8e5400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:14.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.245+0000 7f8e53400640 1 -- 172.21.15.42:0/1640144430 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e54003b70 con 0x7f8e5c15c7c0 2024-09-17T01:41:14.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.245+0000 7f8e53400640 1 -- 172.21.15.42:0/1640144430 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e54003d10 con 0x7f8e5c15c7c0 2024-09-17T01:41:14.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.245+0000 7f8e53400640 1 -- 172.21.15.42:0/1640144430 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e54005330 con 0x7f8e5c15c7c0 2024-09-17T01:41:14.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.246+0000 7f8e62800640 1 -- 172.21.15.42:0/1640144430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e5c156070 con 0x7f8e5c15c7c0 2024-09-17T01:41:14.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.246+0000 7f8e62800640 1 -- 172.21.15.42:0/1640144430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e5c156630 con 0x7f8e5c15c7c0 2024-09-17T01:41:14.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.248+0000 7f8e53400640 1 -- 172.21.15.42:0/1640144430 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8e540054d0 con 0x7f8e5c15c7c0 2024-09-17T01:41:14.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.249+0000 7f8e53400640 1 --2- 172.21.15.42:0/1640144430 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8e3c078b90 0x7f8e3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:14.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.249+0000 7f8e53400640 1 -- 172.21.15.42:0/1640144430 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5767+0+0 (secure 0 0 0) 0x7f8e5409aad0 con 0x7f8e5c15c7c0 2024-09-17T01:41:14.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.249+0000 7f8e5b400640 1 --2- 172.21.15.42:0/1640144430 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8e3c078b90 0x7f8e3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:14.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.249+0000 7f8e697e9740 1 Processor -- start 2024-09-17T01:41:14.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.250+0000 7f8e697e9740 1 -- start start 2024-09-17T01:41:14.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.250+0000 7f8e5b400640 1 --2- 172.21.15.42:0/1640144430 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8e3c078b90 0x7f8e3c07b0a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c007fd0 tx=0x7f8e4c007b00 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:14.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.251+0000 7f8e697e9740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c370f24390 0x55c371312550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:14.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.251+0000 7f8e697e9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c370efb4d0 0x55c3712f5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:14.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.251+0000 7f8e697e9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370f036b0 0x55c3712f5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:14.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.251+0000 7f8e697e9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c37122b1c0 con 0x55c370f036b0 2024-09-17T01:41:14.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.251+0000 7f8e697e9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c37123e870 con 0x55c370efb4d0 2024-09-17T01:41:14.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.251+0000 7f8e697e9740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55c37122dca0 con 0x55c370f24390 2024-09-17T01:41:14.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.251+0000 7f8e5be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370f036b0 0x55c3712f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:14.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.251+0000 7f8e5b400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c370f24390 0x55c371312550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:14.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.251+0000 7f8e5aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c370efb4d0 0x55c3712f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:14.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.251+0000 7f8e5be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370f036b0 0x55c3712f5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58474/0 (socket says 172.21.15.42:58474) 2024-09-17T01:41:14.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.251+0000 7f8e5be00640 1 -- 172.21.15.42:0/584436549 learned_addr learned my addr 172.21.15.42:0/584436549 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:14.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.252+0000 7f8e5aa00640 1 -- 172.21.15.42:0/584436549 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c370f24390 msgr2=0x55c371312550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:14.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.252+0000 7f8e5aa00640 1 --2- 172.21.15.42:0/584436549 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c370f24390 0x55c371312550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.252+0000 7f8e5aa00640 1 -- 172.21.15.42:0/584436549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370f036b0 msgr2=0x55c3712f5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:14.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.252+0000 7f8e5aa00640 1 --2- 172.21.15.42:0/584436549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370f036b0 0x55c3712f5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.252+0000 7f8e5aa00640 1 -- 172.21.15.42:0/584436549 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3710067d0 con 0x55c370efb4d0 2024-09-17T01:41:14.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.252+0000 7f8e5be00640 1 --2- 172.21.15.42:0/584436549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370f036b0 0x55c3712f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:41:14.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.252+0000 7f8e5b400640 1 --2- 172.21.15.42:0/584436549 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c370f24390 0x55c371312550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:41:14.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.252+0000 7f8e5aa00640 1 --2- 172.21.15.42:0/584436549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c370efb4d0 0x55c3712f5220 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c06ae10 tx=0x7f8e480046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aed1ebe2f4661921 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:14.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.252+0000 7f8e47e00640 1 -- 172.21.15.42:0/584436549 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e480035f0 con 0x55c370efb4d0 2024-09-17T01:41:14.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.252+0000 7f8e47e00640 1 -- 172.21.15.42:0/584436549 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e48003880 con 0x55c370efb4d0 2024-09-17T01:41:14.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.252+0000 7f8e47e00640 1 -- 172.21.15.42:0/584436549 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e48003cb0 con 0x55c370efb4d0 2024-09-17T01:41:14.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.253+0000 7f8e697e9740 1 -- 172.21.15.42:0/584436549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c370efb4d0 msgr2=0x55c3712f5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:14.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.253+0000 7f8e697e9740 1 --2- 172.21.15.42:0/584436549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c370efb4d0 0x55c3712f5220 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c06ae10 tx=0x7f8e480046c0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.253+0000 7f8e697e9740 1 -- 172.21.15.42:0/584436549 shutdown_connections 2024-09-17T01:41:14.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.253+0000 7f8e697e9740 1 --2- 172.21.15.42:0/584436549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c370efb4d0 0x55c3712f5220 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.253+0000 7f8e697e9740 1 --2- 172.21.15.42:0/584436549 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370f036b0 0x55c3712f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.253+0000 7f8e697e9740 1 --2- 172.21.15.42:0/584436549 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c370f24390 0x55c371312550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.253+0000 7f8e697e9740 1 -- 172.21.15.42:0/584436549 >> 172.21.15.42:0/584436549 conn(0x55c370f184e0 msgr2=0x55c3712cb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:14.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.253+0000 7f8e697e9740 1 -- 172.21.15.42:0/584436549 shutdown_connections 2024-09-17T01:41:14.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.253+0000 7f8e697e9740 1 -- 172.21.15.42:0/584436549 wait complete. 2024-09-17T01:41:14.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.254+0000 7f8e697e9740 1 -- start start 2024-09-17T01:41:14.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.254+0000 7f8e697e9740 1 Processor -- start 2024-09-17T01:41:14.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.256+0000 7f8e697e9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370efb4d0 0x55c3712e3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:14.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.256+0000 7f8e697e9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c370f036b0 0x55c3712ed690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:14.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.256+0000 7f8e697e9740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c370f24390 0x55c3712edbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:14.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.256+0000 7f8e697e9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c3711d4410 con 0x55c370efb4d0 2024-09-17T01:41:14.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.256+0000 7f8e697e9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c371231ab0 con 0x55c370f036b0 2024-09-17T01:41:14.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.256+0000 7f8e697e9740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55c370f9e740 con 0x55c370f24390 2024-09-17T01:41:14.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.256+0000 7f8e697e9740 10 client.0 _ll_register_callbacks cb 0x55c3711b1360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:41:14.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.256+0000 7f8e5b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370efb4d0 0x55c3712e3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:14.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.256+0000 7f8e5b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370efb4d0 0x55c3712e3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58482/0 (socket says 172.21.15.42:58482) 2024-09-17T01:41:14.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.256+0000 7f8e5b400640 1 -- 172.21.15.42:0/3528063001 learned_addr learned my addr 172.21.15.42:0/3528063001 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:14.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.256+0000 7f8e5be00640 1 --2- 172.21.15.42:0/3528063001 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c370f24390 0x55c3712edbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:14.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.256+0000 7f8e5aa00640 1 --2- 172.21.15.42:0/3528063001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c370f036b0 0x55c3712ed690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:14.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.256+0000 7f8e5b400640 1 -- 172.21.15.42:0/3528063001 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c370f24390 msgr2=0x55c3712edbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:14.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.256+0000 7f8e5b400640 1 --2- 172.21.15.42:0/3528063001 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c370f24390 0x55c3712edbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.256+0000 7f8e5b400640 1 -- 172.21.15.42:0/3528063001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c370f036b0 msgr2=0x55c3712ed690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:14.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.257+0000 7f8e5b400640 1 --2- 172.21.15.42:0/3528063001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c370f036b0 0x55c3712ed690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.257+0000 7f8e5b400640 1 -- 172.21.15.42:0/3528063001 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c370f8f970 con 0x55c370efb4d0 2024-09-17T01:41:14.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.257+0000 7f8e5aa00640 1 --2- 172.21.15.42:0/3528063001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c370f036b0 0x55c3712ed690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:41:14.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.257+0000 7f8e5b400640 1 --2- 172.21.15.42:0/3528063001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370efb4d0 0x55c3712e3460 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c014780 tx=0x7f8e4c004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b69b8b7de15a94ec server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:14.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.257+0000 7f8e44c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:41:14.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.257+0000 7f8e44c00640 1 -- 172.21.15.42:0/3528063001 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c025070 con 0x55c370efb4d0 2024-09-17T01:41:14.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.257+0000 7f8e44c00640 1 -- 172.21.15.42:0/3528063001 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(125..125 src has 1..125) ==== 5767+0+0 (secure 0 0 0) 0x7f8e4c015980 con 0x55c370efb4d0 2024-09-17T01:41:14.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.257+0000 7f8e697e9740 1 -- 172.21.15.42:0/3528063001 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e48003880 con 0x55c370efb4d0 2024-09-17T01:41:14.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.257+0000 7f8e44c00640 1 -- 172.21.15.42:0/3528063001 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f8e4c01b040 con 0x55c370efb4d0 2024-09-17T01:41:14.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.257+0000 7f8e697e9740 10 client.8244 fetch_fsmap learned FSMap version 98 2024-09-17T01:41:14.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.257+0000 7f8e697e9740 1 -- 172.21.15.42:0/3528063001 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x55c370f6d6a0 con 0x55c370efb4d0 2024-09-17T01:41:14.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.258+0000 7f8e44c00640 1 -- 172.21.15.42:0/3528063001 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e48003880 con 0x55c370efb4d0 2024-09-17T01:41:14.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.258+0000 7f8e44c00640 1 -- 172.21.15.42:0/3528063001 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7f8e4c033080 con 0x55c370efb4d0 2024-09-17T01:41:14.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.258+0000 7f8e697e9740 10 client.8244 fetch_fsmap finished waiting for FSMap version 98 2024-09-17T01:41:14.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.258+0000 7f8e697e9740 10 client.8244 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-17T01:41:14.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.258+0000 7f8e697e9740 20 client.8244 populate_metadata read hostname 'smithi042' 2024-09-17T01:41:14.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.258+0000 7f8e697e9740 1 --2- 172.21.15.42:0/3528063001 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x55c370ee2f60 0x55c3712f0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:14.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.258+0000 7f8e697e9740 4 client.8244 mds_command: new command op to 8061 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:41:14.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.258+0000 7f8e697e9740 1 -- 172.21.15.42:0/3528063001 --> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3712407c0 con 0x55c370ee2f60 2024-09-17T01:41:14.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.258+0000 7f8e5aa00640 1 --2- 172.21.15.42:0/3528063001 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x55c370ee2f60 0x55c3712f0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:14.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.259+0000 7f8e5aa00640 1 --2- 172.21.15.42:0/3528063001 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x55c370ee2f60 0x55c3712f0ff0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80a977eae95bf8cd server_cookie=4fcda334cbf6a4c7 in_seq=0 out_seq=0 2024-09-17T01:41:14.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.259+0000 7f8e44c00640 10 client.8244 ms_handle_connect on v2:172.21.15.42:6834/970028636 2024-09-17T01:41:14.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.259+0000 7f8e44c00640 1 -- 172.21.15.42:0/3528063001 <== mds.0 v2:172.21.15.42:6834/970028636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c3712407c0 con 0x55c370ee2f60 2024-09-17T01:41:14.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.259+0000 7f8e44c00640 10 client.8244 handle_command_reply: tid=0 2024-09-17T01:41:14.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.260+0000 7f8e697e9740 1 client.8244 shutdown 2024-09-17T01:41:14.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.260+0000 7f8e697e9740 1 -- 172.21.15.42:0/3528063001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370efb4d0 msgr2=0x55c3712e3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:14.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.260+0000 7f8e697e9740 1 --2- 172.21.15.42:0/3528063001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370efb4d0 0x55c3712e3460 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c014780 tx=0x7f8e4c004620 comp rx=0 tx=0).stop 2024-09-17T01:41:14.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.260+0000 7f8e697e9740 1 -- 172.21.15.42:0/3528063001 shutdown_connections 2024-09-17T01:41:14.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.260+0000 7f8e697e9740 1 --2- 172.21.15.42:0/3528063001 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x55c370ee2f60 0x55c3712f0ff0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.260+0000 7f8e697e9740 1 --2- 172.21.15.42:0/3528063001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c370f036b0 0x55c3712ed690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.260+0000 7f8e697e9740 1 --2- 172.21.15.42:0/3528063001 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c370f24390 0x55c3712edbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.260+0000 7f8e697e9740 1 --2- 172.21.15.42:0/3528063001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370efb4d0 0x55c3712e3460 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.260+0000 7f8e697e9740 1 -- 172.21.15.42:0/3528063001 >> 172.21.15.42:0/3528063001 conn(0x55c370f184e0 msgr2=0x55c3712f5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:14.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.260+0000 7f8e44c00640 0 client.8244 ms_handle_reset on v2:172.21.15.42:6834/970028636 2024-09-17T01:41:14.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.260+0000 7f8e697e9740 1 -- 172.21.15.42:0/3528063001 shutdown_connections 2024-09-17T01:41:14.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.260+0000 7f8e697e9740 1 -- 172.21.15.42:0/3528063001 wait complete. 2024-09-17T01:41:14.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.260+0000 7f8e697e9740 20 client.8244 trim_cache size 0 max 16384 2024-09-17T01:41:14.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.279+0000 7f8e697e9740 1 Processor -- start 2024-09-17T01:41:14.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.279+0000 7f8e697e9740 1 -- start start 2024-09-17T01:41:14.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.280+0000 7f8e697e9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c370efb4d0 0x55c3712eef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:14.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.280+0000 7f8e697e9740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c370f036b0 0x55c371333b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:14.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.280+0000 7f8e697e9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370f24390 0x55c371334080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:14.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.280+0000 7f8e697e9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5c2022e0 con 0x55c370f24390 2024-09-17T01:41:14.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.280+0000 7f8e697e9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5c09ea10 con 0x55c370efb4d0 2024-09-17T01:41:14.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.280+0000 7f8e697e9740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8e5c09dd70 con 0x55c370f036b0 2024-09-17T01:41:14.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.281+0000 7f8e5be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370f24390 0x55c371334080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:14.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.281+0000 7f8e5be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370f24390 0x55c371334080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58490/0 (socket says 172.21.15.42:58490) 2024-09-17T01:41:14.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.281+0000 7f8e5be00640 1 -- 172.21.15.42:0/3377045924 learned_addr learned my addr 172.21.15.42:0/3377045924 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:14.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.281+0000 7f8e5b400640 1 --2- 172.21.15.42:0/3377045924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c370efb4d0 0x55c3712eef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:14.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.281+0000 7f8e5aa00640 1 --2- 172.21.15.42:0/3377045924 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c370f036b0 0x55c371333b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:14.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.281+0000 7f8e5be00640 1 -- 172.21.15.42:0/3377045924 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c370f036b0 msgr2=0x55c371333b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:14.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.281+0000 7f8e5be00640 1 --2- 172.21.15.42:0/3377045924 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c370f036b0 0x55c371333b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.281+0000 7f8e5be00640 1 -- 172.21.15.42:0/3377045924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c370efb4d0 msgr2=0x55c3712eef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:14.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.281+0000 7f8e5be00640 1 --2- 172.21.15.42:0/3377045924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c370efb4d0 0x55c3712eef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.281+0000 7f8e5be00640 1 -- 172.21.15.42:0/3377045924 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c371309730 con 0x55c370f24390 2024-09-17T01:41:14.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.281+0000 7f8e5be00640 1 --2- 172.21.15.42:0/3377045924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370f24390 0x55c371334080 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f8e5405fa60 tx=0x7f8e54061f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e9ac1e609fc0c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:14.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.282+0000 7f8e47400640 1 -- 172.21.15.42:0/3377045924 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e54067220 con 0x55c370f24390 2024-09-17T01:41:14.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.282+0000 7f8e47400640 1 -- 172.21.15.42:0/3377045924 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e5406c0d0 con 0x55c370f24390 2024-09-17T01:41:14.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.282+0000 7f8e47400640 1 -- 172.21.15.42:0/3377045924 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e54061c90 con 0x55c370f24390 2024-09-17T01:41:14.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.282+0000 7f8e697e9740 1 -- 172.21.15.42:0/3377045924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370f24390 msgr2=0x55c371334080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:14.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.282+0000 7f8e697e9740 1 --2- 172.21.15.42:0/3377045924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370f24390 0x55c371334080 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f8e5405fa60 tx=0x7f8e54061f60 comp rx=0 tx=0).stop 2024-09-17T01:41:14.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.282+0000 7f8e697e9740 1 -- 172.21.15.42:0/3377045924 shutdown_connections 2024-09-17T01:41:14.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.282+0000 7f8e697e9740 1 --2- 172.21.15.42:0/3377045924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370f24390 0x55c371334080 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.282+0000 7f8e697e9740 1 --2- 172.21.15.42:0/3377045924 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c370f036b0 0x55c371333b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.282+0000 7f8e697e9740 1 --2- 172.21.15.42:0/3377045924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c370efb4d0 0x55c3712eef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.282+0000 7f8e697e9740 1 -- 172.21.15.42:0/3377045924 >> 172.21.15.42:0/3377045924 conn(0x55c370f184e0 msgr2=0x55c3712f5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:14.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.282+0000 7f8e697e9740 1 -- 172.21.15.42:0/3377045924 shutdown_connections 2024-09-17T01:41:14.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.282+0000 7f8e697e9740 1 -- 172.21.15.42:0/3377045924 wait complete. 2024-09-17T01:41:14.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.283+0000 7f8e697e9740 1 -- start start 2024-09-17T01:41:14.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.284+0000 7f8e697e9740 1 Processor -- start 2024-09-17T01:41:14.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.285+0000 7f8e697e9740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c370efb4d0 0x55c371308140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:14.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.285+0000 7f8e697e9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c370f036b0 0x55c371328d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:14.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.285+0000 7f8e697e9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370f24390 0x55c3712f5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:14.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.285+0000 7f8e697e9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c3712c6500 con 0x55c370f24390 2024-09-17T01:41:14.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.285+0000 7f8e697e9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5c09e3c0 con 0x55c370f036b0 2024-09-17T01:41:14.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.285+0000 7f8e697e9740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55c3712c1550 con 0x55c370efb4d0 2024-09-17T01:41:14.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.285+0000 7f8e697e9740 10 client.0 _ll_register_callbacks cb 0x7f8e4c00f860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:41:14.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.285+0000 7f8e5be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370f24390 0x55c3712f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:14.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.285+0000 7f8e5aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c370f036b0 0x55c371328d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:14.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.285+0000 7f8e5be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370f24390 0x55c3712f5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58506/0 (socket says 172.21.15.42:58506) 2024-09-17T01:41:14.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.285+0000 7f8e5aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c370f036b0 0x55c371328d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:45862/0 (socket says 172.21.15.42:45862) 2024-09-17T01:41:14.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.285+0000 7f8e5b400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c370efb4d0 0x55c371308140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:14.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.285+0000 7f8e5be00640 1 -- 172.21.15.42:0/294986649 learned_addr learned my addr 172.21.15.42:0/294986649 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:14.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.286+0000 7f8e5aa00640 1 -- 172.21.15.42:0/294986649 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c370efb4d0 msgr2=0x55c371308140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:14.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.286+0000 7f8e5aa00640 1 --2- 172.21.15.42:0/294986649 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c370efb4d0 0x55c371308140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.286+0000 7f8e5aa00640 1 -- 172.21.15.42:0/294986649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370f24390 msgr2=0x55c3712f5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:14.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.286+0000 7f8e5aa00640 1 --2- 172.21.15.42:0/294986649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370f24390 0x55c3712f5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.286+0000 7f8e5aa00640 1 -- 172.21.15.42:0/294986649 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c37130b730 con 0x55c370f036b0 2024-09-17T01:41:14.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.286+0000 7f8e5be00640 1 --2- 172.21.15.42:0/294986649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370f24390 0x55c3712f5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:41:14.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.286+0000 7f8e5aa00640 1 --2- 172.21.15.42:0/294986649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c370f036b0 0x55c371328d40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8e48009780 tx=0x7f8e48005cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf7c37390a2d86cb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:14.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.286+0000 7f8e44c00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-17T01:41:14.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.286+0000 7f8e44c00640 1 -- 172.21.15.42:0/294986649 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e480043c0 con 0x55c370f036b0 2024-09-17T01:41:14.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.286+0000 7f8e44c00640 1 -- 172.21.15.42:0/294986649 <== mon.1 v2:172.21.15.43:3300/0 2 ==== osd_map(125..125 src has 1..125) ==== 5767+0+0 (secure 0 0 0) 0x7f8e48003880 con 0x55c370f036b0 2024-09-17T01:41:14.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.286+0000 7f8e697e9740 1 -- 172.21.15.42:0/294986649 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e5406c0d0 con 0x55c370f036b0 2024-09-17T01:41:14.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.287+0000 7f8e44c00640 1 -- 172.21.15.42:0/294986649 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f8e4805c050 con 0x55c370f036b0 2024-09-17T01:41:14.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.287+0000 7f8e697e9740 10 client.7765 fetch_fsmap learned FSMap version 98 2024-09-17T01:41:14.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.287+0000 7f8e697e9740 1 -- 172.21.15.42:0/294986649 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x55c371329280 con 0x55c370f036b0 2024-09-17T01:41:14.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.287+0000 7f8e44c00640 1 -- 172.21.15.42:0/294986649 <== mon.1 v2:172.21.15.43:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e5406c0d0 con 0x55c370f036b0 2024-09-17T01:41:14.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.287+0000 7f8e44c00640 1 -- 172.21.15.42:0/294986649 <== mon.1 v2:172.21.15.43:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7f8e4805f020 con 0x55c370f036b0 2024-09-17T01:41:14.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.287+0000 7f8e697e9740 10 client.7765 fetch_fsmap finished waiting for FSMap version 98 2024-09-17T01:41:14.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.287+0000 7f8e697e9740 10 client.7765 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-17T01:41:14.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.287+0000 7f8e697e9740 20 client.7765 populate_metadata read hostname 'smithi042' 2024-09-17T01:41:14.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.287+0000 7f8e697e9740 1 --2- 172.21.15.42:0/294986649 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x55c3712f5760 0x55c371392f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:14.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.287+0000 7f8e697e9740 4 client.7765 mds_command: new command op to 8061 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:41:14.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.287+0000 7f8e697e9740 1 -- 172.21.15.42:0/294986649 --> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c37123c270 con 0x55c3712f5760 2024-09-17T01:41:14.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.287+0000 7f8e5b400640 1 --2- 172.21.15.42:0/294986649 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x55c3712f5760 0x55c371392f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:14.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.288+0000 7f8e5b400640 1 --2- 172.21.15.42:0/294986649 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x55c3712f5760 0x55c371392f30 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c63cd0266c341a6 server_cookie=97960bc71968a38e in_seq=0 out_seq=0 2024-09-17T01:41:14.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.288+0000 7f8e44c00640 10 client.7765 ms_handle_connect on v2:172.21.15.42:6834/970028636 2024-09-17T01:41:14.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.288+0000 7f8e44c00640 1 -- 172.21.15.42:0/294986649 <== mds.0 v2:172.21.15.42:6834/970028636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+610 (crc 0 0 0) 0x55c37123c270 con 0x55c3712f5760 2024-09-17T01:41:14.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.288+0000 7f8e44c00640 10 client.7765 handle_command_reply: tid=0 2024-09-17T01:41:14.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.288+0000 7f8e697e9740 1 client.7765 shutdown 2024-09-17T01:41:14.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.288+0000 7f8e697e9740 1 -- 172.21.15.42:0/294986649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c370f036b0 msgr2=0x55c371328d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:14.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.288+0000 7f8e697e9740 1 --2- 172.21.15.42:0/294986649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c370f036b0 0x55c371328d40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8e48009780 tx=0x7f8e48005cb0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.288+0000 7f8e697e9740 1 -- 172.21.15.42:0/294986649 shutdown_connections 2024-09-17T01:41:14.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.288+0000 7f8e697e9740 1 --2- 172.21.15.42:0/294986649 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x55c3712f5760 0x55c371392f30 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.289+0000 7f8e697e9740 1 --2- 172.21.15.42:0/294986649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c370f036b0 0x55c371328d40 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.289+0000 7f8e697e9740 1 --2- 172.21.15.42:0/294986649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c370f24390 0x55c3712f5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.289+0000 7f8e44c00640 0 client.7765 ms_handle_reset on v2:172.21.15.42:6834/970028636 2024-09-17T01:41:14.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.289+0000 7f8e697e9740 1 --2- 172.21.15.42:0/294986649 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55c370efb4d0 0x55c371308140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.289+0000 7f8e697e9740 1 -- 172.21.15.42:0/294986649 >> 172.21.15.42:0/294986649 conn(0x55c370f184e0 msgr2=0x55c3712ee6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:14.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.289+0000 7f8e697e9740 1 -- 172.21.15.42:0/294986649 shutdown_connections 2024-09-17T01:41:14.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.289+0000 7f8e697e9740 1 -- 172.21.15.42:0/294986649 wait complete. 2024-09-17T01:41:14.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.289+0000 7f8e697e9740 20 client.7765 trim_cache size 0 max 16384 2024-09-17T01:41:14.290 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:41:14.290 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T01:41:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-09-17T01:41:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: "2990a5ea-b753-4d6e-b549-d67d493d6db9": { 2024-09-17T01:41:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_control_test_path", 2024-09-17T01:41:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "2990a5ea-b753-4d6e-b549-d67d493d6db9", 2024-09-17T01:41:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive" 2024-09-17T01:41:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:41:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_stats": { 2024-09-17T01:41:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: "2990a5ea-b753-4d6e-b549-d67d493d6db9": { 2024-09-17T01:41:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:41:13.546116+0000", 2024-09-17T01:41:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_control_test_path", 2024-09-17T01:41:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:41:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:41:14.292 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:41:14.292 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:41:14.292 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:14.292 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:14.292 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:41:14.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.289+0000 7f8e62800640 1 -- 172.21.15.42:0/1640144430 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8e3c078b90 msgr2=0x7f8e3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:14.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.289+0000 7f8e62800640 1 --2- 172.21.15.42:0/1640144430 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8e3c078b90 0x7f8e3c07b0a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c007fd0 tx=0x7f8e4c007b00 comp rx=0 tx=0).stop 2024-09-17T01:41:14.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.289+0000 7f8e62800640 1 -- 172.21.15.42:0/1640144430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e5c15c7c0 msgr2=0x7f8e5c0b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:14.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.289+0000 7f8e62800640 1 --2- 172.21.15.42:0/1640144430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e5c15c7c0 0x7f8e5c0b1470 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400c6b0 tx=0x7f8e5400cb70 comp rx=0 tx=0).stop 2024-09-17T01:41:14.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.290+0000 7f8e62800640 1 -- 172.21.15.42:0/1640144430 shutdown_connections 2024-09-17T01:41:14.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.290+0000 7f8e62800640 1 --2- 172.21.15.42:0/1640144430 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8e3c078b90 0x7f8e3c07b0a0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.290+0000 7f8e62800640 1 --2- 172.21.15.42:0/1640144430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e5c0d0e90 0x7f8e5c1f9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.290+0000 7f8e62800640 1 --2- 172.21.15.42:0/1640144430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e5c15c7c0 0x7f8e5c0b1470 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.290+0000 7f8e62800640 1 --2- 172.21.15.42:0/1640144430 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8e5c0701c0 0x7f8e5c147770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:14.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.290+0000 7f8e62800640 1 -- 172.21.15.42:0/1640144430 >> 172.21.15.42:0/1640144430 conn(0x7f8e5c06cf00 msgr2=0x7f8e5c073c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:14.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.290+0000 7f8e62800640 1 -- 172.21.15.42:0/1640144430 shutdown_connections 2024-09-17T01:41:14.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:14.290+0000 7f8e62800640 1 -- 172.21.15.42:0/1640144430 wait complete. 2024-09-17T01:41:19.310 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T01:41:19.311 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.8:0 scrub status 2024-09-17T01:41:19.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.554+0000 7f5093200640 1 -- 172.21.15.42:0/3057612551 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50940af910 msgr2=0x7f50940ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:19.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.554+0000 7f5093200640 1 --2- 172.21.15.42:0/3057612551 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50940af910 0x7f50940ccb90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5084009830 tx=0x7f508402a470 comp rx=0 tx=0).stop 2024-09-17T01:41:19.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.554+0000 7f5093200640 1 -- 172.21.15.42:0/3057612551 shutdown_connections 2024-09-17T01:41:19.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.554+0000 7f5093200640 1 --2- 172.21.15.42:0/3057612551 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50940b32b0 0x7f50940b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.554+0000 7f5093200640 1 --2- 172.21.15.42:0/3057612551 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50940af910 0x7f50940ccb90 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.554+0000 7f5093200640 1 -- 172.21.15.42:0/3057612551 >> 172.21.15.42:0/3057612551 conn(0x7f509406d440 msgr2=0x7f50940b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:19.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.555+0000 7f5093200640 1 -- 172.21.15.42:0/3057612551 shutdown_connections 2024-09-17T01:41:19.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.555+0000 7f5093200640 1 -- 172.21.15.42:0/3057612551 wait complete. 2024-09-17T01:41:19.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.557+0000 7f5093200640 1 Processor -- start 2024-09-17T01:41:19.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.557+0000 7f5093200640 1 -- start start 2024-09-17T01:41:19.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.558+0000 7f5093200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50940af910 0x7f50940aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:19.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.558+0000 7f5093200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50940b32b0 0x7f5094074520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:19.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.558+0000 7f5093200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f509415c6c0 0x7f50941fd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:19.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.559+0000 7f5093200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f509406e680 con 0x7f509415c6c0 2024-09-17T01:41:19.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.559+0000 7f5093200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f509406e500 con 0x7f50940af910 2024-09-17T01:41:19.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.559+0000 7f5093200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f509406e800 con 0x7f50940b32b0 2024-09-17T01:41:19.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.559+0000 7f5092800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f509415c6c0 0x7f50941fd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:19.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.559+0000 7f5092800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f509415c6c0 0x7f50941fd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42800/0 (socket says 172.21.15.42:42800) 2024-09-17T01:41:19.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.559+0000 7f5092800640 1 -- 172.21.15.42:0/1245841604 learned_addr learned my addr 172.21.15.42:0/1245841604 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:19.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.559+0000 7f5091e00640 1 --2- 172.21.15.42:0/1245841604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50940af910 0x7f50940aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:19.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.559+0000 7f508be00640 1 --2- 172.21.15.42:0/1245841604 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50940b32b0 0x7f5094074520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:19.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.559+0000 7f5092800640 1 -- 172.21.15.42:0/1245841604 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50940b32b0 msgr2=0x7f5094074520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:19.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.559+0000 7f5092800640 1 --2- 172.21.15.42:0/1245841604 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50940b32b0 0x7f5094074520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.559+0000 7f5092800640 1 -- 172.21.15.42:0/1245841604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50940af910 msgr2=0x7f50940aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:19.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.559+0000 7f5092800640 1 --2- 172.21.15.42:0/1245841604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50940af910 0x7f50940aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.559+0000 7f5092800640 1 -- 172.21.15.42:0/1245841604 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50941fe310 con 0x7f509415c6c0 2024-09-17T01:41:19.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.560+0000 7f5092800640 1 --2- 172.21.15.42:0/1245841604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f509415c6c0 0x7f50941fd450 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f508c00ec50 tx=0x7f508c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:19.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.560+0000 7f508a000640 1 -- 172.21.15.42:0/1245841604 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c003b70 con 0x7f509415c6c0 2024-09-17T01:41:19.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.560+0000 7f508a000640 1 -- 172.21.15.42:0/1245841604 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f508c003d10 con 0x7f509415c6c0 2024-09-17T01:41:19.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.560+0000 7f5093200640 1 -- 172.21.15.42:0/1245841604 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50940ad7d0 con 0x7f509415c6c0 2024-09-17T01:41:19.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.560+0000 7f508a000640 1 -- 172.21.15.42:0/1245841604 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c004280 con 0x7f509415c6c0 2024-09-17T01:41:19.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.560+0000 7f5093200640 1 -- 172.21.15.42:0/1245841604 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50940add90 con 0x7f509415c6c0 2024-09-17T01:41:19.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.562+0000 7f508a000640 1 -- 172.21.15.42:0/1245841604 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f508c004420 con 0x7f509415c6c0 2024-09-17T01:41:19.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.563+0000 7f508a000640 1 --2- 172.21.15.42:0/1245841604 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5070078bf0 0x7f507007b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:19.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.563+0000 7f508a000640 1 -- 172.21.15.42:0/1245841604 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5767+0+0 (secure 0 0 0) 0x7f508c09bad0 con 0x7f509415c6c0 2024-09-17T01:41:19.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.564+0000 7f5091e00640 1 --2- 172.21.15.42:0/1245841604 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5070078bf0 0x7f507007b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:19.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.564+0000 7f50a028a740 1 Processor -- start 2024-09-17T01:41:19.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.564+0000 7f50a028a740 1 -- start start 2024-09-17T01:41:19.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.565+0000 7f5091e00640 1 --2- 172.21.15.42:0/1245841604 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5070078bf0 0x7f507007b100 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5084034000 tx=0x7f5084004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:19.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.566+0000 7f50a028a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556240043390 0x556240431730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:19.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.566+0000 7f50a028a740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55624001a4d0 0x556240414400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:19.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.566+0000 7f50a028a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5562400226b0 0x556240414940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:19.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.566+0000 7f50a028a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55624034a1c0 con 0x556240043390 2024-09-17T01:41:19.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.566+0000 7f50a028a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55624035d870 con 0x5562400226b0 2024-09-17T01:41:19.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.566+0000 7f50a028a740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55624034cca0 con 0x55624001a4d0 2024-09-17T01:41:19.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.566+0000 7f5091e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556240043390 0x556240431730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:19.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.566+0000 7f5091e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556240043390 0x556240431730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42814/0 (socket says 172.21.15.42:42814) 2024-09-17T01:41:19.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.566+0000 7f5091e00640 1 -- 172.21.15.42:0/3783640971 learned_addr learned my addr 172.21.15.42:0/3783640971 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:19.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.566+0000 7f508be00640 1 --2- 172.21.15.42:0/3783640971 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55624001a4d0 0x556240414400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:19.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.566+0000 7f5092800640 1 --2- 172.21.15.42:0/3783640971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5562400226b0 0x556240414940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:19.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.566+0000 7f5091e00640 1 -- 172.21.15.42:0/3783640971 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55624001a4d0 msgr2=0x556240414400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:19.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.566+0000 7f5091e00640 1 --2- 172.21.15.42:0/3783640971 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55624001a4d0 0x556240414400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.566+0000 7f5091e00640 1 -- 172.21.15.42:0/3783640971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5562400226b0 msgr2=0x556240414940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:19.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.566+0000 7f5091e00640 1 --2- 172.21.15.42:0/3783640971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5562400226b0 0x556240414940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.566+0000 7f5091e00640 1 -- 172.21.15.42:0/3783640971 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562401257d0 con 0x556240043390 2024-09-17T01:41:19.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.567+0000 7f5091e00640 1 --2- 172.21.15.42:0/3783640971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556240043390 0x556240431730 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f5084004480 tx=0x7f508403e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee219d7a8950fb4f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:19.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.567+0000 7f5082a00640 1 -- 172.21.15.42:0/3783640971 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5084005220 con 0x556240043390 2024-09-17T01:41:19.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.567+0000 7f5082a00640 1 -- 172.21.15.42:0/3783640971 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50840054b0 con 0x556240043390 2024-09-17T01:41:19.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.567+0000 7f5082a00640 1 -- 172.21.15.42:0/3783640971 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5084004a00 con 0x556240043390 2024-09-17T01:41:19.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.568+0000 7f50a028a740 1 -- 172.21.15.42:0/3783640971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556240043390 msgr2=0x556240431730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:19.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.568+0000 7f50a028a740 1 --2- 172.21.15.42:0/3783640971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556240043390 0x556240431730 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f5084004480 tx=0x7f508403e040 comp rx=0 tx=0).stop 2024-09-17T01:41:19.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.568+0000 7f50a028a740 1 -- 172.21.15.42:0/3783640971 shutdown_connections 2024-09-17T01:41:19.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.568+0000 7f50a028a740 1 --2- 172.21.15.42:0/3783640971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5562400226b0 0x556240414940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.568+0000 7f50a028a740 1 --2- 172.21.15.42:0/3783640971 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55624001a4d0 0x556240414400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.568+0000 7f50a028a740 1 --2- 172.21.15.42:0/3783640971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556240043390 0x556240431730 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.568+0000 7f50a028a740 1 -- 172.21.15.42:0/3783640971 >> 172.21.15.42:0/3783640971 conn(0x5562400374e0 msgr2=0x5562403ea620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:19.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.568+0000 7f50a028a740 1 -- 172.21.15.42:0/3783640971 shutdown_connections 2024-09-17T01:41:19.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.568+0000 7f50a028a740 1 -- 172.21.15.42:0/3783640971 wait complete. 2024-09-17T01:41:19.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.569+0000 7f50a028a740 1 -- start start 2024-09-17T01:41:19.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.569+0000 7f50a028a740 1 Processor -- start 2024-09-17T01:41:19.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.571+0000 7f50a028a740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55624001a4d0 0x5562404286f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:19.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.571+0000 7f50a028a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5562400226b0 0x55624040e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:19.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.571+0000 7f50a028a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556240043390 0x556240441950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:19.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.571+0000 7f50a028a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5562402f3410 con 0x556240043390 2024-09-17T01:41:19.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.571+0000 7f50a028a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556240350ab0 con 0x5562400226b0 2024-09-17T01:41:19.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.571+0000 7f50a028a740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5562400bd740 con 0x55624001a4d0 2024-09-17T01:41:19.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.571+0000 7f50a028a740 10 client.0 _ll_register_callbacks cb 0x5562402d0360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:41:19.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.571+0000 7f5092800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556240043390 0x556240441950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:19.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.571+0000 7f5092800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556240043390 0x556240441950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42826/0 (socket says 172.21.15.42:42826) 2024-09-17T01:41:19.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.571+0000 7f5092800640 1 -- 172.21.15.42:0/4118746497 learned_addr learned my addr 172.21.15.42:0/4118746497 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:19.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.571+0000 7f5091e00640 1 --2- 172.21.15.42:0/4118746497 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55624001a4d0 0x5562404286f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:19.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.571+0000 7f508be00640 1 --2- 172.21.15.42:0/4118746497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5562400226b0 0x55624040e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:19.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.571+0000 7f5092800640 1 -- 172.21.15.42:0/4118746497 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55624001a4d0 msgr2=0x5562404286f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:19.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.571+0000 7f5092800640 1 --2- 172.21.15.42:0/4118746497 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55624001a4d0 0x5562404286f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.571+0000 7f5092800640 1 -- 172.21.15.42:0/4118746497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5562400226b0 msgr2=0x55624040e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:19.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.571+0000 7f5092800640 1 --2- 172.21.15.42:0/4118746497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5562400226b0 0x55624040e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.571+0000 7f5092800640 1 -- 172.21.15.42:0/4118746497 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562400ae970 con 0x556240043390 2024-09-17T01:41:19.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.571+0000 7f508be00640 1 --2- 172.21.15.42:0/4118746497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5562400226b0 0x55624040e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:41:19.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.572+0000 7f5092800640 1 --2- 172.21.15.42:0/4118746497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556240043390 0x556240441950 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f508c099f20 tx=0x7f508c063770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f46a989d3305a47 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:19.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.572+0000 7f5077400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:41:19.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.572+0000 7f5077400640 1 -- 172.21.15.42:0/4118746497 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c07d020 con 0x556240043390 2024-09-17T01:41:19.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.572+0000 7f5077400640 1 -- 172.21.15.42:0/4118746497 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(125..125 src has 1..125) ==== 5767+0+0 (secure 0 0 0) 0x7f508c062ad0 con 0x556240043390 2024-09-17T01:41:19.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.572+0000 7f50a028a740 1 -- 172.21.15.42:0/4118746497 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50840054b0 con 0x556240043390 2024-09-17T01:41:19.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.572+0000 7f5077400640 1 -- 172.21.15.42:0/4118746497 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f508c063870 con 0x556240043390 2024-09-17T01:41:19.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.572+0000 7f50a028a740 10 client.8262 fetch_fsmap learned FSMap version 98 2024-09-17T01:41:19.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.572+0000 7f50a028a740 1 -- 172.21.15.42:0/4118746497 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x55624008c6a0 con 0x556240043390 2024-09-17T01:41:19.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.572+0000 7f5077400640 1 -- 172.21.15.42:0/4118746497 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50840054b0 con 0x556240043390 2024-09-17T01:41:19.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.573+0000 7f5077400640 1 -- 172.21.15.42:0/4118746497 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7f508c020030 con 0x556240043390 2024-09-17T01:41:19.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.573+0000 7f50a028a740 10 client.8262 fetch_fsmap finished waiting for FSMap version 98 2024-09-17T01:41:19.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.573+0000 7f50a028a740 10 client.8262 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-17T01:41:19.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.573+0000 7f50a028a740 20 client.8262 populate_metadata read hostname 'smithi042' 2024-09-17T01:41:19.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.573+0000 7f50a028a740 1 --2- 172.21.15.42:0/4118746497 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x556240001f60 0x55624040c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:19.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.573+0000 7f50a028a740 4 client.8262 mds_command: new command op to 8061 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:41:19.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.573+0000 7f50a028a740 1 -- 172.21.15.42:0/4118746497 --> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55624035f7c0 con 0x556240001f60 2024-09-17T01:41:19.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.573+0000 7f5091e00640 1 --2- 172.21.15.42:0/4118746497 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x556240001f60 0x55624040c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:19.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.574+0000 7f5077400640 10 client.8262 ms_handle_connect on v2:172.21.15.42:6834/970028636 2024-09-17T01:41:19.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.574+0000 7f5091e00640 1 --2- 172.21.15.42:0/4118746497 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x556240001f60 0x55624040c6e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7abf6d3df03e1413 server_cookie=1e679ab5ce1e3b73 in_seq=0 out_seq=0 2024-09-17T01:41:19.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.574+0000 7f5077400640 1 -- 172.21.15.42:0/4118746497 <== mds.0 v2:172.21.15.42:6834/970028636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55624035f7c0 con 0x556240001f60 2024-09-17T01:41:19.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.574+0000 7f5077400640 10 client.8262 handle_command_reply: tid=0 2024-09-17T01:41:19.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.574+0000 7f50a028a740 1 client.8262 shutdown 2024-09-17T01:41:19.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.575+0000 7f50a028a740 1 -- 172.21.15.42:0/4118746497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556240043390 msgr2=0x556240441950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:19.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.575+0000 7f50a028a740 1 --2- 172.21.15.42:0/4118746497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556240043390 0x556240441950 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f508c099f20 tx=0x7f508c063770 comp rx=0 tx=0).stop 2024-09-17T01:41:19.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.575+0000 7f50a028a740 1 -- 172.21.15.42:0/4118746497 shutdown_connections 2024-09-17T01:41:19.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.575+0000 7f50a028a740 1 --2- 172.21.15.42:0/4118746497 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x556240001f60 0x55624040c6e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.575+0000 7f50a028a740 1 --2- 172.21.15.42:0/4118746497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5562400226b0 0x55624040e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.575+0000 7f50a028a740 1 --2- 172.21.15.42:0/4118746497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556240043390 0x556240441950 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.575+0000 7f5077400640 0 client.8262 ms_handle_reset on v2:172.21.15.42:6834/970028636 2024-09-17T01:41:19.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.575+0000 7f50a028a740 1 --2- 172.21.15.42:0/4118746497 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55624001a4d0 0x5562404286f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.575+0000 7f50a028a740 1 -- 172.21.15.42:0/4118746497 >> 172.21.15.42:0/4118746497 conn(0x5562400374e0 msgr2=0x5562403e3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:19.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.575+0000 7f50a028a740 1 -- 172.21.15.42:0/4118746497 shutdown_connections 2024-09-17T01:41:19.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.575+0000 7f50a028a740 1 -- 172.21.15.42:0/4118746497 wait complete. 2024-09-17T01:41:19.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.575+0000 7f50a028a740 20 client.8262 trim_cache size 0 max 16384 2024-09-17T01:41:19.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.594+0000 7f50a028a740 1 Processor -- start 2024-09-17T01:41:19.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.594+0000 7f50a028a740 1 -- start start 2024-09-17T01:41:19.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.595+0000 7f50a028a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55624001a4d0 0x556240429ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:19.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.595+0000 7f50a028a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5562400226b0 0x5562404a4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:19.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.595+0000 7f50a028a740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556240043390 0x55624042eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:19.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.595+0000 7f50a028a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f50942066c0 con 0x55624001a4d0 2024-09-17T01:41:19.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.595+0000 7f50a028a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5094205710 con 0x5562400226b0 2024-09-17T01:41:19.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.595+0000 7f50a028a740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f50941f0b50 con 0x556240043390 2024-09-17T01:41:19.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.595+0000 7f5091e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55624001a4d0 0x556240429ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:19.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.595+0000 7f5091e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55624001a4d0 0x556240429ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42832/0 (socket says 172.21.15.42:42832) 2024-09-17T01:41:19.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.595+0000 7f5091e00640 1 -- 172.21.15.42:0/3470574524 learned_addr learned my addr 172.21.15.42:0/3470574524 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:19.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.596+0000 7f5091e00640 1 -- 172.21.15.42:0/3470574524 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556240043390 msgr2=0x55624042eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:19.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.596+0000 7f5091e00640 1 --2- 172.21.15.42:0/3470574524 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556240043390 0x55624042eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.596+0000 7f5091e00640 1 -- 172.21.15.42:0/3470574524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5562400226b0 msgr2=0x5562404a4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:19.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.596+0000 7f5091e00640 1 --2- 172.21.15.42:0/3470574524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5562400226b0 0x5562404a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.596+0000 7f5091e00640 1 -- 172.21.15.42:0/3470574524 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556240440fc0 con 0x55624001a4d0 2024-09-17T01:41:19.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.596+0000 7f5091e00640 1 --2- 172.21.15.42:0/3470574524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55624001a4d0 0x556240429ea0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f508404c000 tx=0x7f50840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdcc6bedf855d344 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:19.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.596+0000 7f5082000640 1 -- 172.21.15.42:0/3470574524 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5084003930 con 0x55624001a4d0 2024-09-17T01:41:19.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.596+0000 7f5082000640 1 -- 172.21.15.42:0/3470574524 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5084005640 con 0x55624001a4d0 2024-09-17T01:41:19.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.596+0000 7f5082000640 1 -- 172.21.15.42:0/3470574524 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5084003e20 con 0x55624001a4d0 2024-09-17T01:41:19.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.597+0000 7f50a028a740 1 -- 172.21.15.42:0/3470574524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55624001a4d0 msgr2=0x556240429ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:19.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.597+0000 7f50a028a740 1 --2- 172.21.15.42:0/3470574524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55624001a4d0 0x556240429ea0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f508404c000 tx=0x7f50840046c0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.597+0000 7f50a028a740 1 -- 172.21.15.42:0/3470574524 shutdown_connections 2024-09-17T01:41:19.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.597+0000 7f50a028a740 1 --2- 172.21.15.42:0/3470574524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5562400226b0 0x5562404a4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.597+0000 7f50a028a740 1 --2- 172.21.15.42:0/3470574524 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556240043390 0x55624042eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.597+0000 7f50a028a740 1 --2- 172.21.15.42:0/3470574524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55624001a4d0 0x556240429ea0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.597+0000 7f50a028a740 1 -- 172.21.15.42:0/3470574524 >> 172.21.15.42:0/3470574524 conn(0x5562400374e0 msgr2=0x556240429790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:19.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.597+0000 7f50a028a740 1 -- 172.21.15.42:0/3470574524 shutdown_connections 2024-09-17T01:41:19.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.597+0000 7f50a028a740 1 -- 172.21.15.42:0/3470574524 wait complete. 2024-09-17T01:41:19.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.598+0000 7f50a028a740 1 -- start start 2024-09-17T01:41:19.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.598+0000 7f50a028a740 1 Processor -- start 2024-09-17T01:41:19.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.600+0000 7f50a028a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55624001a4d0 0x5562404a0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:19.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.600+0000 7f50a028a740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5562400226b0 0x55624042eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:19.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.600+0000 7f50a028a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556240043390 0x55624042f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:19.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.600+0000 7f50a028a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f50941fa9c0 con 0x556240043390 2024-09-17T01:41:19.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.600+0000 7f50a028a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5562403ebd60 con 0x55624001a4d0 2024-09-17T01:41:19.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.600+0000 7f50a028a740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5562404a79c0 con 0x5562400226b0 2024-09-17T01:41:19.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.600+0000 7f50a028a740 10 client.0 _ll_register_callbacks cb 0x7f508c05ff40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:41:19.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.600+0000 7f5092800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556240043390 0x55624042f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:19.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.600+0000 7f5092800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556240043390 0x55624042f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42840/0 (socket says 172.21.15.42:42840) 2024-09-17T01:41:19.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.600+0000 7f5092800640 1 -- 172.21.15.42:0/305110421 learned_addr learned my addr 172.21.15.42:0/305110421 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:19.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.600+0000 7f5091e00640 1 --2- 172.21.15.42:0/305110421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55624001a4d0 0x5562404a0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:19.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.600+0000 7f508be00640 1 --2- 172.21.15.42:0/305110421 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5562400226b0 0x55624042eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:19.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.601+0000 7f5092800640 1 -- 172.21.15.42:0/305110421 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5562400226b0 msgr2=0x55624042eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:19.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.601+0000 7f5092800640 1 --2- 172.21.15.42:0/305110421 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5562400226b0 0x55624042eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.601+0000 7f5092800640 1 -- 172.21.15.42:0/305110421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55624001a4d0 msgr2=0x5562404a0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:19.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.601+0000 7f5092800640 1 --2- 172.21.15.42:0/305110421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55624001a4d0 0x5562404a0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.601+0000 7f5092800640 1 -- 172.21.15.42:0/305110421 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556240410c90 con 0x556240043390 2024-09-17T01:41:19.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.601+0000 7f5092800640 1 --2- 172.21.15.42:0/305110421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556240043390 0x55624042f400 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f508c00cba0 tx=0x7f508c064d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e855cbe512f6c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:19.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.601+0000 7f5077400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:41:19.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.601+0000 7f5077400640 1 -- 172.21.15.42:0/305110421 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c07d070 con 0x556240043390 2024-09-17T01:41:19.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.601+0000 7f5077400640 1 -- 172.21.15.42:0/305110421 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(125..125 src has 1..125) ==== 5767+0+0 (secure 0 0 0) 0x7f508c062540 con 0x556240043390 2024-09-17T01:41:19.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.601+0000 7f50a028a740 1 -- 172.21.15.42:0/305110421 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5084005640 con 0x556240043390 2024-09-17T01:41:19.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.602+0000 7f5077400640 1 -- 172.21.15.42:0/305110421 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f508c062fe0 con 0x556240043390 2024-09-17T01:41:19.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.602+0000 7f50a028a740 10 client.8268 fetch_fsmap learned FSMap version 98 2024-09-17T01:41:19.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.602+0000 7f50a028a740 1 -- 172.21.15.42:0/305110421 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x5562404027a0 con 0x556240043390 2024-09-17T01:41:19.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.602+0000 7f5077400640 1 -- 172.21.15.42:0/305110421 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5084005640 con 0x556240043390 2024-09-17T01:41:19.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.602+0000 7f5077400640 1 -- 172.21.15.42:0/305110421 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 98) ==== 3502+0+0 (secure 0 0 0) 0x7f508c020070 con 0x556240043390 2024-09-17T01:41:19.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.602+0000 7f50a028a740 10 client.8268 fetch_fsmap finished waiting for FSMap version 98 2024-09-17T01:41:19.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.602+0000 7f50a028a740 10 client.8268 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-17T01:41:19.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.602+0000 7f50a028a740 20 client.8268 populate_metadata read hostname 'smithi042' 2024-09-17T01:41:19.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.602+0000 7f50a028a740 1 --2- 172.21.15.42:0/305110421 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x5562404a3710 0x556240401810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:19.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.602+0000 7f50a028a740 4 client.8268 mds_command: new command op to 8061 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:41:19.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.602+0000 7f50a028a740 1 -- 172.21.15.42:0/305110421 --> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55624035b270 con 0x5562404a3710 2024-09-17T01:41:19.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.602+0000 7f5091e00640 1 --2- 172.21.15.42:0/305110421 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x5562404a3710 0x556240401810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:19.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.603+0000 7f5077400640 10 client.8268 ms_handle_connect on v2:172.21.15.42:6834/970028636 2024-09-17T01:41:19.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.603+0000 7f5091e00640 1 --2- 172.21.15.42:0/305110421 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x5562404a3710 0x556240401810 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bce90035d6788093 server_cookie=413397e73fa66740 in_seq=0 out_seq=0 2024-09-17T01:41:19.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.603+0000 7f5077400640 1 -- 172.21.15.42:0/305110421 <== mds.0 v2:172.21.15.42:6834/970028636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+397 (crc 0 0 0) 0x55624035b270 con 0x5562404a3710 2024-09-17T01:41:19.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.603+0000 7f5077400640 10 client.8268 handle_command_reply: tid=0 2024-09-17T01:41:19.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.603+0000 7f50a028a740 1 client.8268 shutdown 2024-09-17T01:41:19.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.603+0000 7f50a028a740 1 -- 172.21.15.42:0/305110421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556240043390 msgr2=0x55624042f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:19.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.603+0000 7f50a028a740 1 --2- 172.21.15.42:0/305110421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556240043390 0x55624042f400 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f508c00cba0 tx=0x7f508c064d20 comp rx=0 tx=0).stop 2024-09-17T01:41:19.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.603+0000 7f50a028a740 1 -- 172.21.15.42:0/305110421 shutdown_connections 2024-09-17T01:41:19.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.603+0000 7f50a028a740 1 --2- 172.21.15.42:0/305110421 >> [v2:172.21.15.42:6834/970028636,v1:172.21.15.42:6835/970028636] conn(0x5562404a3710 0x556240401810 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.603+0000 7f50a028a740 1 --2- 172.21.15.42:0/305110421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556240043390 0x55624042f400 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.603+0000 7f50a028a740 1 --2- 172.21.15.42:0/305110421 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5562400226b0 0x55624042eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.603+0000 7f50a028a740 1 --2- 172.21.15.42:0/305110421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55624001a4d0 0x5562404a0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.603+0000 7f5077400640 0 client.8268 ms_handle_reset on v2:172.21.15.42:6834/970028636 2024-09-17T01:41:19.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.603+0000 7f50a028a740 1 -- 172.21.15.42:0/305110421 >> 172.21.15.42:0/305110421 conn(0x5562400374e0 msgr2=0x556240452440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:19.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.604+0000 7f50a028a740 1 -- 172.21.15.42:0/305110421 shutdown_connections 2024-09-17T01:41:19.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.604+0000 7f50a028a740 1 -- 172.21.15.42:0/305110421 wait complete. 2024-09-17T01:41:19.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.604+0000 7f50a028a740 20 client.8268 trim_cache size 0 max 16384 2024-09-17T01:41:19.606 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:41:19.606 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-09-17T01:41:19.606 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {}, 2024-09-17T01:41:19.606 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_stats": { 2024-09-17T01:41:19.606 INFO:teuthology.orchestra.run.smithi042.stdout: "2990a5ea-b753-4d6e-b549-d67d493d6db9": { 2024-09-17T01:41:19.606 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:41:13.546116+0000", 2024-09-17T01:41:19.606 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_control_test_path", 2024-09-17T01:41:19.606 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:41:19.606 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:41:19.607 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:41:19.607 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:41:19.607 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:19.607 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:19.607 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:41:19.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.604+0000 7f5093200640 1 -- 172.21.15.42:0/1245841604 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5070078bf0 msgr2=0x7f507007b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:19.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.604+0000 7f5093200640 1 --2- 172.21.15.42:0/1245841604 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5070078bf0 0x7f507007b100 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5084034000 tx=0x7f5084004730 comp rx=0 tx=0).stop 2024-09-17T01:41:19.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.604+0000 7f5093200640 1 -- 172.21.15.42:0/1245841604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f509415c6c0 msgr2=0x7f50941fd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:19.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.604+0000 7f5093200640 1 --2- 172.21.15.42:0/1245841604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f509415c6c0 0x7f50941fd450 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f508c00ec50 tx=0x7f508c00c6a0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.604+0000 7f5093200640 1 -- 172.21.15.42:0/1245841604 shutdown_connections 2024-09-17T01:41:19.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.604+0000 7f5093200640 1 --2- 172.21.15.42:0/1245841604 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5070078bf0 0x7f507007b100 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.604+0000 7f5093200640 1 --2- 172.21.15.42:0/1245841604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f509415c6c0 0x7f50941fd450 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.604+0000 7f5093200640 1 --2- 172.21.15.42:0/1245841604 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50940b32b0 0x7f5094074520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.604+0000 7f5093200640 1 --2- 172.21.15.42:0/1245841604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50940af910 0x7f50940aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.604+0000 7f5093200640 1 -- 172.21.15.42:0/1245841604 >> 172.21.15.42:0/1245841604 conn(0x7f509406d440 msgr2=0x7f509415a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:19.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.604+0000 7f5093200640 1 -- 172.21.15.42:0/1245841604 shutdown_connections 2024-09-17T01:41:19.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.605+0000 7f5093200640 1 -- 172.21.15.42:0/1245841604 wait complete. 2024-09-17T01:41:19.625 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T01:41:19.625 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:41:19.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.856+0000 7fab19000640 1 -- 172.21.15.42:0/1313008377 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab1406db40 msgr2=0x7fab1406fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:19.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.856+0000 7fab19000640 1 --2- 172.21.15.42:0/1313008377 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab1406db40 0x7fab1406fe40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fab0c005fd0 tx=0x7fab0c02a8a0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.856+0000 7fab19000640 1 -- 172.21.15.42:0/1313008377 shutdown_connections 2024-09-17T01:41:19.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.856+0000 7fab19000640 1 --2- 172.21.15.42:0/1313008377 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab1406db40 0x7fab1406fe40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.856+0000 7fab19000640 1 --2- 172.21.15.42:0/1313008377 >> v2:172.21.15.43:3300/0 conn(0x7fab14072e00 0x7fab1415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.856+0000 7fab19000640 1 -- 172.21.15.42:0/1313008377 >> 172.21.15.42:0/1313008377 conn(0x7fab140b2930 msgr2=0x7fab1406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:19.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.856+0000 7fab19000640 1 -- 172.21.15.42:0/1313008377 shutdown_connections 2024-09-17T01:41:19.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.856+0000 7fab19000640 1 -- 172.21.15.42:0/1313008377 wait complete. 2024-09-17T01:41:19.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.858+0000 7fab19000640 1 Processor -- start 2024-09-17T01:41:19.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.858+0000 7fab19000640 1 -- start start 2024-09-17T01:41:19.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.860+0000 7fab19000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab14072e00 0x7fab141f8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:19.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.860+0000 7fab19000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab1415f190 0x7fab140ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:19.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.860+0000 7fab19000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab140aede0 0x7fab141393a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:19.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.860+0000 7fab19000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fab14151520 con 0x7fab140aede0 2024-09-17T01:41:19.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.860+0000 7fab19000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fab14070740 con 0x7fab14072e00 2024-09-17T01:41:19.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.860+0000 7fab19000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fab141516a0 con 0x7fab1415f190 2024-09-17T01:41:19.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.860+0000 7fab12800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab140aede0 0x7fab141393a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:19.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.860+0000 7fab12800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab140aede0 0x7fab141393a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42844/0 (socket says 172.21.15.42:42844) 2024-09-17T01:41:19.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.860+0000 7fab12800640 1 -- 172.21.15.42:0/460056978 learned_addr learned my addr 172.21.15.42:0/460056978 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:19.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.860+0000 7fab11e00640 1 --2- 172.21.15.42:0/460056978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab14072e00 0x7fab141f8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:19.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.860+0000 7fab11400640 1 --2- 172.21.15.42:0/460056978 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab1415f190 0x7fab140ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:19.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.861+0000 7fab12800640 1 -- 172.21.15.42:0/460056978 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab1415f190 msgr2=0x7fab140ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:19.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.861+0000 7fab12800640 1 --2- 172.21.15.42:0/460056978 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab1415f190 0x7fab140ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.861+0000 7fab12800640 1 -- 172.21.15.42:0/460056978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab14072e00 msgr2=0x7fab141f8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:19.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.861+0000 7fab12800640 1 --2- 172.21.15.42:0/460056978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab14072e00 0x7fab141f8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:19.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.861+0000 7fab12800640 1 -- 172.21.15.42:0/460056978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab140af1f0 con 0x7fab140aede0 2024-09-17T01:41:19.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.861+0000 7fab12800640 1 --2- 172.21.15.42:0/460056978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab140aede0 0x7fab141393a0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fab0c009b30 tx=0x7fab0c032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:19.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.861+0000 7fab0a000640 1 -- 172.21.15.42:0/460056978 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0c041070 con 0x7fab140aede0 2024-09-17T01:41:19.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.861+0000 7fab19000640 1 -- 172.21.15.42:0/460056978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab1415c880 con 0x7fab140aede0 2024-09-17T01:41:19.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.861+0000 7fab0a000640 1 -- 172.21.15.42:0/460056978 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab0c004450 con 0x7fab140aede0 2024-09-17T01:41:19.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.861+0000 7fab0a000640 1 -- 172.21.15.42:0/460056978 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0c031430 con 0x7fab140aede0 2024-09-17T01:41:19.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.861+0000 7fab19000640 1 -- 172.21.15.42:0/460056978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab1415ce40 con 0x7fab140aede0 2024-09-17T01:41:19.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.862+0000 7fab19000640 1 -- 172.21.15.42:0/460056978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab1415c5f0 con 0x7fab140aede0 2024-09-17T01:41:19.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.864+0000 7fab0a000640 1 -- 172.21.15.42:0/460056978 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fab0c044070 con 0x7fab140aede0 2024-09-17T01:41:19.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.865+0000 7fab0a000640 1 --2- 172.21.15.42:0/460056978 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faaf4078b90 0x7faaf407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:19.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.865+0000 7fab0a000640 1 -- 172.21.15.42:0/460056978 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5767+0+0 (secure 0 0 0) 0x7fab0c02e020 con 0x7fab140aede0 2024-09-17T01:41:19.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.865+0000 7fab11e00640 1 --2- 172.21.15.42:0/460056978 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faaf4078b90 0x7faaf407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:19.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.866+0000 7fab11e00640 1 --2- 172.21.15.42:0/460056978 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faaf4078b90 0x7faaf407b0a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fab040095f0 tx=0x7fab04005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:19.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:19.869+0000 7fab0a000640 1 -- 172.21.15.42:0/460056978 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fab0c04b020 con 0x7fab140aede0 2024-09-17T01:41:20.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.103+0000 7fab19000640 1 -- 172.21.15.42:0/460056978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab1406fe40 con 0x7fab140aede0 2024-09-17T01:41:20.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.104+0000 7fab0a000640 1 -- 172.21.15.42:0/460056978 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5222 (secure 0 0 0) 0x7fab140af1f0 con 0x7fab140aede0 2024-09-17T01:41:20.102 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:41:20.102 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":98,"btime":"2024-09-17T01:40:45:701152+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6884,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2926480981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2926480981},{"type":"v1","addr":"172.21.15.43:6837","nonce":2926480981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7576,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1365229483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1365229483},{"type":"v1","addr":"172.21.15.43:6836","nonce":1365229483}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92},{"gid":8058,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1442154751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1442154751},{"type":"v1","addr":"172.21.15.42:6833","nonce":1442154751}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:40:42.191921+0000","modified":"2024-09-17T01:40:45.203701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8061},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8061":{"gid":8061,"name":"c","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/970028636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":970028636},{"type":"v1","addr":"172.21.15.42:6835","nonce":970028636}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8061,"qdb_cluster":[8061]},"id":8}]} 2024-09-17T01:41:20.102 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 98 2024-09-17T01:41:20.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.106+0000 7fab19000640 1 -- 172.21.15.42:0/460056978 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faaf4078b90 msgr2=0x7faaf407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:20.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.106+0000 7fab19000640 1 --2- 172.21.15.42:0/460056978 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faaf4078b90 0x7faaf407b0a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fab040095f0 tx=0x7fab04005f90 comp rx=0 tx=0).stop 2024-09-17T01:41:20.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.106+0000 7fab19000640 1 -- 172.21.15.42:0/460056978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab140aede0 msgr2=0x7fab141393a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:20.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.106+0000 7fab19000640 1 --2- 172.21.15.42:0/460056978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab140aede0 0x7fab141393a0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fab0c009b30 tx=0x7fab0c032d30 comp rx=0 tx=0).stop 2024-09-17T01:41:20.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.107+0000 7fab19000640 1 -- 172.21.15.42:0/460056978 shutdown_connections 2024-09-17T01:41:20.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.107+0000 7fab19000640 1 --2- 172.21.15.42:0/460056978 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faaf4078b90 0x7faaf407b0a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:20.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.107+0000 7fab19000640 1 --2- 172.21.15.42:0/460056978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab140aede0 0x7fab141393a0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:20.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.107+0000 7fab19000640 1 --2- 172.21.15.42:0/460056978 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fab1415f190 0x7fab140ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:20.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.107+0000 7fab19000640 1 --2- 172.21.15.42:0/460056978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fab14072e00 0x7fab141f8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:20.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.107+0000 7fab19000640 1 -- 172.21.15.42:0/460056978 >> 172.21.15.42:0/460056978 conn(0x7fab140b2930 msgr2=0x7fab1415db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:20.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.107+0000 7fab19000640 1 -- 172.21.15.42:0/460056978 shutdown_connections 2024-09-17T01:41:20.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.107+0000 7fab19000640 1 -- 172.21.15.42:0/460056978 wait complete. 2024-09-17T01:41:20.126 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T01:41:20.126 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:41:20.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.355+0000 7fce24e00640 1 -- 172.21.15.42:0/2592915704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce2015f190 msgr2=0x7fce2006fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:20.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.355+0000 7fce24e00640 1 --2- 172.21.15.42:0/2592915704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce2015f190 0x7fce2006fe40 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fce18005fd0 tx=0x7fce1802a8b0 comp rx=0 tx=0).stop 2024-09-17T01:41:20.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.355+0000 7fce24e00640 1 -- 172.21.15.42:0/2592915704 shutdown_connections 2024-09-17T01:41:20.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.355+0000 7fce24e00640 1 --2- 172.21.15.42:0/2592915704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce2015f190 0x7fce2006fe40 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:20.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.356+0000 7fce24e00640 1 --2- 172.21.15.42:0/2592915704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce2006db40 0x7fce2015bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:20.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.356+0000 7fce24e00640 1 -- 172.21.15.42:0/2592915704 >> 172.21.15.42:0/2592915704 conn(0x7fce200b2930 msgr2=0x7fce2006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:20.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.356+0000 7fce24e00640 1 -- 172.21.15.42:0/2592915704 shutdown_connections 2024-09-17T01:41:20.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.356+0000 7fce24e00640 1 -- 172.21.15.42:0/2592915704 wait complete. 2024-09-17T01:41:20.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.358+0000 7fce24e00640 1 Processor -- start 2024-09-17T01:41:20.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.358+0000 7fce24e00640 1 -- start start 2024-09-17T01:41:20.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.359+0000 7fce24e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce20072e00 0x7fce20149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:20.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.359+0000 7fce24e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce2015f190 0x7fce2013bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:20.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.359+0000 7fce24e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce200b56c0 0x7fce2014fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:20.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.359+0000 7fce24e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fce20151520 con 0x7fce2015f190 2024-09-17T01:41:20.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.359+0000 7fce24e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fce20070740 con 0x7fce20072e00 2024-09-17T01:41:20.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.359+0000 7fce24e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fce201516a0 con 0x7fce200b56c0 2024-09-17T01:41:20.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.359+0000 7fce1d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce2015f190 0x7fce2013bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:20.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.360+0000 7fce1d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce2015f190 0x7fce2013bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42862/0 (socket says 172.21.15.42:42862) 2024-09-17T01:41:20.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.360+0000 7fce1d400640 1 -- 172.21.15.42:0/3985292108 learned_addr learned my addr 172.21.15.42:0/3985292108 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:20.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.360+0000 7fce1e800640 1 --2- 172.21.15.42:0/3985292108 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce200b56c0 0x7fce2014fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:20.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.360+0000 7fce1de00640 1 --2- 172.21.15.42:0/3985292108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce20072e00 0x7fce20149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:20.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.360+0000 7fce1d400640 1 -- 172.21.15.42:0/3985292108 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce200b56c0 msgr2=0x7fce2014fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:20.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.360+0000 7fce1d400640 1 --2- 172.21.15.42:0/3985292108 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce200b56c0 0x7fce2014fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:20.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.360+0000 7fce1d400640 1 -- 172.21.15.42:0/3985292108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce20072e00 msgr2=0x7fce20149e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:20.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.360+0000 7fce1d400640 1 --2- 172.21.15.42:0/3985292108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce20072e00 0x7fce20149e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:20.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.360+0000 7fce1d400640 1 -- 172.21.15.42:0/3985292108 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce20155980 con 0x7fce2015f190 2024-09-17T01:41:20.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.360+0000 7fce1e800640 1 --2- 172.21.15.42:0/3985292108 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce200b56c0 0x7fce2014fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:41:20.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.360+0000 7fce1de00640 1 --2- 172.21.15.42:0/3985292108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce20072e00 0x7fce20149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:41:20.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.360+0000 7fce1d400640 1 --2- 172.21.15.42:0/3985292108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce2015f190 0x7fce2013bd00 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fce0c00e6d0 tx=0x7fce0c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:20.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.361+0000 7fce16000640 1 -- 172.21.15.42:0/3985292108 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c00cab0 con 0x7fce2015f190 2024-09-17T01:41:20.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.361+0000 7fce16000640 1 -- 172.21.15.42:0/3985292108 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce0c00cd40 con 0x7fce2015f190 2024-09-17T01:41:20.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.361+0000 7fce16000640 1 -- 172.21.15.42:0/3985292108 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c010690 con 0x7fce2015f190 2024-09-17T01:41:20.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.361+0000 7fce24e00640 1 -- 172.21.15.42:0/3985292108 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce2013c240 con 0x7fce2015f190 2024-09-17T01:41:20.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.361+0000 7fce24e00640 1 -- 172.21.15.42:0/3985292108 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce2014f3a0 con 0x7fce2015f190 2024-09-17T01:41:20.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.362+0000 7fce24e00640 1 -- 172.21.15.42:0/3985292108 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce2015bc50 con 0x7fce2015f190 2024-09-17T01:41:20.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.363+0000 7fce16000640 1 -- 172.21.15.42:0/3985292108 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fce0c010830 con 0x7fce2015f190 2024-09-17T01:41:20.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.364+0000 7fce16000640 1 --2- 172.21.15.42:0/3985292108 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fce00078b90 0x7fce0007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:20.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.364+0000 7fce16000640 1 -- 172.21.15.42:0/3985292108 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5767+0+0 (secure 0 0 0) 0x7fce0c09bf60 con 0x7fce2015f190 2024-09-17T01:41:20.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.365+0000 7fce1de00640 1 --2- 172.21.15.42:0/3985292108 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fce00078b90 0x7fce0007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:20.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.366+0000 7fce1de00640 1 --2- 172.21.15.42:0/3985292108 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fce00078b90 0x7fce0007b0a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fce10000f60 tx=0x7fce10009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:20.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.367+0000 7fce16000640 1 -- 172.21.15.42:0/3985292108 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fce20155980 con 0x7fce2015f190 2024-09-17T01:41:20.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.632+0000 7fce24e00640 1 -- 172.21.15.42:0/3985292108 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fce2006a170 con 0x7fce2015f190 2024-09-17T01:41:20.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.633+0000 7fce16000640 1 -- 172.21.15.42:0/3985292108 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1069 (secure 0 0 0) 0x7fce0c0643d0 con 0x7fce2015f190 2024-09-17T01:41:20.631 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:41:20.631 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":581,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":125,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1077068282,"bytes_used":2562719744,"bytes_avail":770531393536,"bytes_total":773094113280,"write_bytes_sec":35533355,"read_op_per_sec":0,"write_op_per_sec":55},"fsmap":{"epoch":98,"btime":"2024-09-17T01:40:45:701152+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8061}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-17T01:40:29.123222+0000","services":{}},"progress_events":{}} 2024-09-17T01:41:20.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.635+0000 7fce24e00640 1 -- 172.21.15.42:0/3985292108 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fce00078b90 msgr2=0x7fce0007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:20.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.635+0000 7fce24e00640 1 --2- 172.21.15.42:0/3985292108 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fce00078b90 0x7fce0007b0a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fce10000f60 tx=0x7fce10009040 comp rx=0 tx=0).stop 2024-09-17T01:41:20.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.635+0000 7fce24e00640 1 -- 172.21.15.42:0/3985292108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce2015f190 msgr2=0x7fce2013bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:20.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.635+0000 7fce24e00640 1 --2- 172.21.15.42:0/3985292108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce2015f190 0x7fce2013bd00 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fce0c00e6d0 tx=0x7fce0c00eb90 comp rx=0 tx=0).stop 2024-09-17T01:41:20.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.635+0000 7fce24e00640 1 -- 172.21.15.42:0/3985292108 shutdown_connections 2024-09-17T01:41:20.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.635+0000 7fce24e00640 1 --2- 172.21.15.42:0/3985292108 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fce00078b90 0x7fce0007b0a0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:20.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.635+0000 7fce24e00640 1 --2- 172.21.15.42:0/3985292108 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce200b56c0 0x7fce2014fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:20.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.635+0000 7fce24e00640 1 --2- 172.21.15.42:0/3985292108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce2015f190 0x7fce2013bd00 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:20.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.635+0000 7fce24e00640 1 --2- 172.21.15.42:0/3985292108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce20072e00 0x7fce20149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:20.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.635+0000 7fce24e00640 1 -- 172.21.15.42:0/3985292108 >> 172.21.15.42:0/3985292108 conn(0x7fce200b2930 msgr2=0x7fce200cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:20.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.635+0000 7fce24e00640 1 -- 172.21.15.42:0/3985292108 shutdown_connections 2024-09-17T01:41:20.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:20.635+0000 7fce24e00640 1 -- 172.21.15.42:0/3985292108 wait complete. 2024-09-17T01:41:20.657 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:41:20.657 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:41:20.737 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:41:20.793 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:41:20.798 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:41:20.830 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:41:20.830 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:41:20.830 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:41:20.830 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:41:20.874 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:41:20.874 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:41:20.958 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T01:41:21.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.228+0000 7f5a40600640 1 -- 172.21.15.42:0/2388304319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a38142f40 msgr2=0x7f5a38072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:21.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.228+0000 7f5a40600640 1 --2- 172.21.15.42:0/2388304319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a38142f40 0x7f5a38072950 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f5a24005fd0 tx=0x7f5a2402a540 comp rx=0 tx=0).stop 2024-09-17T01:41:21.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.229+0000 7f5a40600640 1 -- 172.21.15.42:0/2388304319 shutdown_connections 2024-09-17T01:41:21.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.229+0000 7f5a40600640 1 --2- 172.21.15.42:0/2388304319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a38142f40 0x7f5a38072950 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:21.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.229+0000 7f5a40600640 1 --2- 172.21.15.42:0/2388304319 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a380b3550 0x7f5a3815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:21.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.229+0000 7f5a40600640 1 -- 172.21.15.42:0/2388304319 >> 172.21.15.42:0/2388304319 conn(0x7f5a380b2930 msgr2=0x7f5a3806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:21.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.229+0000 7f5a40600640 1 -- 172.21.15.42:0/2388304319 shutdown_connections 2024-09-17T01:41:21.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.229+0000 7f5a40600640 1 -- 172.21.15.42:0/2388304319 wait complete. 2024-09-17T01:41:21.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.231+0000 7f5a40600640 1 Processor -- start 2024-09-17T01:41:21.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.231+0000 7f5a40600640 1 -- start start 2024-09-17T01:41:21.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.232+0000 7f5a40600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a38072e90 0x7f5a38158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:21.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.232+0000 7f5a40600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a380b3550 0x7f5a3813e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:21.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.232+0000 7f5a40600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a38142f40 0x7f5a38159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:21.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.232+0000 7f5a40600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3806d7c0 con 0x7f5a38072e90 2024-09-17T01:41:21.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.233+0000 7f5a40600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3806d640 con 0x7f5a380b3550 2024-09-17T01:41:21.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.233+0000 7f5a40600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5a3806d940 con 0x7f5a38142f40 2024-09-17T01:41:21.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.233+0000 7f5a3dc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a38072e90 0x7f5a38158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:21.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.233+0000 7f5a3dc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a38072e90 0x7f5a38158530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42884/0 (socket says 172.21.15.42:42884) 2024-09-17T01:41:21.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.233+0000 7f5a3dc00640 1 -- 172.21.15.42:0/3296130606 learned_addr learned my addr 172.21.15.42:0/3296130606 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:21.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.233+0000 7f5a3d200640 1 --2- 172.21.15.42:0/3296130606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a380b3550 0x7f5a3813e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:21.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.233+0000 7f5a3e600640 1 --2- 172.21.15.42:0/3296130606 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a38142f40 0x7f5a38159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:21.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.233+0000 7f5a3dc00640 1 -- 172.21.15.42:0/3296130606 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a38142f40 msgr2=0x7f5a38159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:21.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.233+0000 7f5a3dc00640 1 --2- 172.21.15.42:0/3296130606 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a38142f40 0x7f5a38159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:21.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.233+0000 7f5a3dc00640 1 -- 172.21.15.42:0/3296130606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a380b3550 msgr2=0x7f5a3813e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:21.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.233+0000 7f5a3dc00640 1 --2- 172.21.15.42:0/3296130606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a380b3550 0x7f5a3813e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:21.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.233+0000 7f5a3dc00640 1 -- 172.21.15.42:0/3296130606 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3813fac0 con 0x7f5a38072e90 2024-09-17T01:41:21.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.234+0000 7f5a3dc00640 1 --2- 172.21.15.42:0/3296130606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a38072e90 0x7f5a38158530 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00e790 tx=0x7f5a2c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:21.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.234+0000 7f5a35600640 1 -- 172.21.15.42:0/3296130606 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c00eea0 con 0x7f5a38072e90 2024-09-17T01:41:21.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.234+0000 7f5a35600640 1 -- 172.21.15.42:0/3296130606 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a2c00cdb0 con 0x7f5a38072e90 2024-09-17T01:41:21.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.234+0000 7f5a35600640 1 -- 172.21.15.42:0/3296130606 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c010690 con 0x7f5a38072e90 2024-09-17T01:41:21.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.234+0000 7f5a40600640 1 -- 172.21.15.42:0/3296130606 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a3813fda0 con 0x7f5a38072e90 2024-09-17T01:41:21.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.234+0000 7f5a40600640 1 -- 172.21.15.42:0/3296130606 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a38140360 con 0x7f5a38072e90 2024-09-17T01:41:21.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.235+0000 7f5a40600640 1 -- 172.21.15.42:0/3296130606 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a3815cec0 con 0x7f5a38072e90 2024-09-17T01:41:21.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.236+0000 7f5a35600640 1 -- 172.21.15.42:0/3296130606 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5a2c010830 con 0x7f5a38072e90 2024-09-17T01:41:21.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.237+0000 7f5a35600640 1 --2- 172.21.15.42:0/3296130606 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5a18078b90 0x7f5a1807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:21.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.237+0000 7f5a35600640 1 -- 172.21.15.42:0/3296130606 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5767+0+0 (secure 0 0 0) 0x7f5a2c09b7b0 con 0x7f5a38072e90 2024-09-17T01:41:21.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.238+0000 7f5a3d200640 1 --2- 172.21.15.42:0/3296130606 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5a18078b90 0x7f5a1807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:21.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.238+0000 7f5a3d200640 1 --2- 172.21.15.42:0/3296130606 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5a18078b90 0x7f5a1807b0a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5a24033000 tx=0x7f5a24004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:21.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.242+0000 7f5a35600640 1 -- 172.21.15.42:0/3296130606 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5a2c0634c0 con 0x7f5a38072e90 2024-09-17T01:41:21.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.448+0000 7f5a40600640 1 -- 172.21.15.42:0/3296130606 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5a3806a170 con 0x7f5a38072e90 2024-09-17T01:41:21.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.449+0000 7f5a35600640 1 -- 172.21.15.42:0/3296130606 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v125) ==== 80+0+0 (secure 0 0 0) 0x7f5a2c067ef0 con 0x7f5a38072e90 2024-09-17T01:41:21.447 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-17T01:41:21.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.451+0000 7f5a40600640 1 -- 172.21.15.42:0/3296130606 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5a18078b90 msgr2=0x7f5a1807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:21.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.451+0000 7f5a40600640 1 --2- 172.21.15.42:0/3296130606 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5a18078b90 0x7f5a1807b0a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5a24033000 tx=0x7f5a24004730 comp rx=0 tx=0).stop 2024-09-17T01:41:21.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.451+0000 7f5a40600640 1 -- 172.21.15.42:0/3296130606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a38072e90 msgr2=0x7f5a38158530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:21.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.451+0000 7f5a40600640 1 --2- 172.21.15.42:0/3296130606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a38072e90 0x7f5a38158530 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00e790 tx=0x7f5a2c00ec50 comp rx=0 tx=0).stop 2024-09-17T01:41:21.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.451+0000 7f5a40600640 1 -- 172.21.15.42:0/3296130606 shutdown_connections 2024-09-17T01:41:21.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.452+0000 7f5a40600640 1 --2- 172.21.15.42:0/3296130606 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5a18078b90 0x7f5a1807b0a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:21.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.452+0000 7f5a40600640 1 --2- 172.21.15.42:0/3296130606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5a380b3550 0x7f5a3813e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:21.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.452+0000 7f5a40600640 1 --2- 172.21.15.42:0/3296130606 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5a38142f40 0x7f5a38159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:21.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.452+0000 7f5a40600640 1 --2- 172.21.15.42:0/3296130606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5a38072e90 0x7f5a38158530 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:21.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.452+0000 7f5a40600640 1 -- 172.21.15.42:0/3296130606 >> 172.21.15.42:0/3296130606 conn(0x7f5a380b2930 msgr2=0x7f5a38075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:21.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.452+0000 7f5a40600640 1 -- 172.21.15.42:0/3296130606 shutdown_connections 2024-09-17T01:41:21.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:21.452+0000 7f5a40600640 1 -- 172.21.15.42:0/3296130606 wait complete. 2024-09-17T01:41:21.472 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T01:41:21.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:41:21.473 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T01:41:22.230 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:41:22.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:41:22.231 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T01:41:22.267 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:41:22.267 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:41:22.267 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:41:22.304 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:41:22.304 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:41:22.304 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:41:22.304 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:41:22.342 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:41:22.342 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:41:22.342 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:41:22.342 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:41:22.381 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:41:22.381 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:41:22.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.610+0000 7f1b0d800640 1 -- 172.21.15.42:0/677882093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b080b4be0 msgr2=0x7f1b0815d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:22.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.610+0000 7f1b0d800640 1 --2- 172.21.15.42:0/677882093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b080b4be0 0x7f1b0815d6b0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f1b080b4870 tx=0x7f1af802a5f0 comp rx=0 tx=0).stop 2024-09-17T01:41:22.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.610+0000 7f1b0d800640 1 -- 172.21.15.42:0/677882093 shutdown_connections 2024-09-17T01:41:22.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.610+0000 7f1b0d800640 1 --2- 172.21.15.42:0/677882093 >> v2:172.21.15.43:3300/0 conn(0x7f1b080cf7c0 0x7f1b0806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:22.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.610+0000 7f1b0d800640 1 --2- 172.21.15.42:0/677882093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b080b4be0 0x7f1b0815d6b0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:22.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.610+0000 7f1b0d800640 1 -- 172.21.15.42:0/677882093 >> 172.21.15.42:0/677882093 conn(0x7f1b080b25f0 msgr2=0x7f1b080d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:22.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.610+0000 7f1b0d800640 1 -- 172.21.15.42:0/677882093 shutdown_connections 2024-09-17T01:41:22.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.611+0000 7f1b0d800640 1 -- 172.21.15.42:0/677882093 wait complete. 2024-09-17T01:41:22.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.613+0000 7f1b0d800640 1 Processor -- start 2024-09-17T01:41:22.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.613+0000 7f1b0d800640 1 -- start start 2024-09-17T01:41:22.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.614+0000 7f1b0d800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b0806d260 0x7f1b081522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:22.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.614+0000 7f1b0d800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b080b4be0 0x7f1b08074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:22.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.614+0000 7f1b0d800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b080cf7c0 0x7f1b080c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:22.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.614+0000 7f1b0d800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1b08153970 con 0x7f1b080cf7c0 2024-09-17T01:41:22.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.614+0000 7f1b0d800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1b081537f0 con 0x7f1b0806d260 2024-09-17T01:41:22.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.614+0000 7f1b0d800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1b08153af0 con 0x7f1b080b4be0 2024-09-17T01:41:22.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.614+0000 7f1b0ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b080cf7c0 0x7f1b080c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:22.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.615+0000 7f1b0ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b080cf7c0 0x7f1b080c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42900/0 (socket says 172.21.15.42:42900) 2024-09-17T01:41:22.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.615+0000 7f1b0ce00640 1 -- 172.21.15.42:0/4108683188 learned_addr learned my addr 172.21.15.42:0/4108683188 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:22.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.615+0000 7f1b07e00640 1 --2- 172.21.15.42:0/4108683188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b0806d260 0x7f1b081522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:22.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.615+0000 7f1aff400640 1 --2- 172.21.15.42:0/4108683188 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b080b4be0 0x7f1b08074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:22.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.615+0000 7f1b0ce00640 1 -- 172.21.15.42:0/4108683188 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b080b4be0 msgr2=0x7f1b08074a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:22.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.615+0000 7f1b0ce00640 1 --2- 172.21.15.42:0/4108683188 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b080b4be0 0x7f1b08074a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:22.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.615+0000 7f1b0ce00640 1 -- 172.21.15.42:0/4108683188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b0806d260 msgr2=0x7f1b081522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:22.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.615+0000 7f1b0ce00640 1 --2- 172.21.15.42:0/4108683188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b0806d260 0x7f1b081522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:22.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.615+0000 7f1b0ce00640 1 -- 172.21.15.42:0/4108683188 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b081f58c0 con 0x7f1b080cf7c0 2024-09-17T01:41:22.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.615+0000 7f1b0ce00640 1 --2- 172.21.15.42:0/4108683188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b080cf7c0 0x7f1b080c9420 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000c760 tx=0x7f1b0000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:22.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.616+0000 7f1b04c00640 1 -- 172.21.15.42:0/4108683188 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b00003b70 con 0x7f1b080cf7c0 2024-09-17T01:41:22.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.616+0000 7f1b04c00640 1 -- 172.21.15.42:0/4108683188 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b00003d10 con 0x7f1b080cf7c0 2024-09-17T01:41:22.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.616+0000 7f1b0d800640 1 -- 172.21.15.42:0/4108683188 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b081f5ba0 con 0x7f1b080cf7c0 2024-09-17T01:41:22.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.616+0000 7f1b04c00640 1 -- 172.21.15.42:0/4108683188 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b00005330 con 0x7f1b080cf7c0 2024-09-17T01:41:22.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.616+0000 7f1b0d800640 1 -- 172.21.15.42:0/4108683188 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b081f6160 con 0x7f1b080cf7c0 2024-09-17T01:41:22.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.617+0000 7f1b0d800640 1 -- 172.21.15.42:0/4108683188 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b0815d6b0 con 0x7f1b080cf7c0 2024-09-17T01:41:22.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.618+0000 7f1b04c00640 1 -- 172.21.15.42:0/4108683188 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1b000054d0 con 0x7f1b080cf7c0 2024-09-17T01:41:22.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.619+0000 7f1b04c00640 1 --2- 172.21.15.42:0/4108683188 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1ae4078bc0 0x7f1ae407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:22.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.619+0000 7f1b04c00640 1 -- 172.21.15.42:0/4108683188 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5767+0+0 (secure 0 0 0) 0x7f1b0009aa60 con 0x7f1b080cf7c0 2024-09-17T01:41:22.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.620+0000 7f1b07e00640 1 --2- 172.21.15.42:0/4108683188 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1ae4078bc0 0x7f1ae407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:22.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.620+0000 7f1b07e00640 1 --2- 172.21.15.42:0/4108683188 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1ae4078bc0 0x7f1ae407b0d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1af8033000 tx=0x7f1af8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.623+0000 7f1b04c00640 1 -- 172.21.15.42:0/4108683188 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1b0815dbf0 con 0x7f1b080cf7c0 2024-09-17T01:41:22.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.860+0000 7f1b0d800640 1 -- 172.21.15.42:0/4108683188 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b081f55e0 con 0x7f1b080cf7c0 2024-09-17T01:41:22.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.860+0000 7f1b04c00640 1 -- 172.21.15.42:0/4108683188 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5222 (secure 0 0 0) 0x7f1b000626f0 con 0x7f1b080cf7c0 2024-09-17T01:41:22.858 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:41:22.858 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":98,"btime":"2024-09-17T01:40:45:701152+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6884,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2926480981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2926480981},{"type":"v1","addr":"172.21.15.43:6837","nonce":2926480981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7576,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1365229483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1365229483},{"type":"v1","addr":"172.21.15.43:6836","nonce":1365229483}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92},{"gid":8058,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1442154751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1442154751},{"type":"v1","addr":"172.21.15.42:6833","nonce":1442154751}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:40:42.191921+0000","modified":"2024-09-17T01:40:45.203701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8061},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8061":{"gid":8061,"name":"c","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/970028636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":970028636},{"type":"v1","addr":"172.21.15.42:6835","nonce":970028636}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8061,"qdb_cluster":[8061]},"id":8}]} 2024-09-17T01:41:22.859 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 98 2024-09-17T01:41:22.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.862+0000 7f1b0d800640 1 -- 172.21.15.42:0/4108683188 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1ae4078bc0 msgr2=0x7f1ae407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:22.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.862+0000 7f1b0d800640 1 --2- 172.21.15.42:0/4108683188 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1ae4078bc0 0x7f1ae407b0d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1af8033000 tx=0x7f1af8004730 comp rx=0 tx=0).stop 2024-09-17T01:41:22.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.862+0000 7f1b0d800640 1 -- 172.21.15.42:0/4108683188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b080cf7c0 msgr2=0x7f1b080c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:22.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.862+0000 7f1b0d800640 1 --2- 172.21.15.42:0/4108683188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b080cf7c0 0x7f1b080c9420 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000c760 tx=0x7f1b0000cb60 comp rx=0 tx=0).stop 2024-09-17T01:41:22.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.863+0000 7f1b0d800640 1 -- 172.21.15.42:0/4108683188 shutdown_connections 2024-09-17T01:41:22.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.863+0000 7f1b0d800640 1 --2- 172.21.15.42:0/4108683188 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1ae4078bc0 0x7f1ae407b0d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:22.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.863+0000 7f1b0d800640 1 --2- 172.21.15.42:0/4108683188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b080cf7c0 0x7f1b080c9420 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:22.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.863+0000 7f1b0d800640 1 --2- 172.21.15.42:0/4108683188 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1b080b4be0 0x7f1b08074a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:22.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.863+0000 7f1b0d800640 1 --2- 172.21.15.42:0/4108683188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b0806d260 0x7f1b081522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:22.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.863+0000 7f1b0d800640 1 -- 172.21.15.42:0/4108683188 >> 172.21.15.42:0/4108683188 conn(0x7f1b080b25f0 msgr2=0x7f1b080d00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:22.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.863+0000 7f1b0d800640 1 -- 172.21.15.42:0/4108683188 shutdown_connections 2024-09-17T01:41:22.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:22.863+0000 7f1b0d800640 1 -- 172.21.15.42:0/4108683188 wait complete. 2024-09-17T01:41:22.885 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:41:23.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.114+0000 7fec2d600640 1 -- 172.21.15.42:0/1976208274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec280b4be0 msgr2=0x7fec2815d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:23.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.114+0000 7fec2d600640 1 --2- 172.21.15.42:0/1976208274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec280b4be0 0x7fec2815d6b0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fec18009830 tx=0x7fec1802a510 comp rx=0 tx=0).stop 2024-09-17T01:41:23.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.114+0000 7fec2d600640 1 -- 172.21.15.42:0/1976208274 shutdown_connections 2024-09-17T01:41:23.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.114+0000 7fec2d600640 1 --2- 172.21.15.42:0/1976208274 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fec2806d430 0x7fec28152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:23.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.114+0000 7fec2d600640 1 --2- 172.21.15.42:0/1976208274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec280b4be0 0x7fec2815d6b0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:23.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.114+0000 7fec2d600640 1 -- 172.21.15.42:0/1976208274 >> 172.21.15.42:0/1976208274 conn(0x7fec280b25f0 msgr2=0x7fec280d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:23.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.114+0000 7fec2d600640 1 -- 172.21.15.42:0/1976208274 shutdown_connections 2024-09-17T01:41:23.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.114+0000 7fec2d600640 1 -- 172.21.15.42:0/1976208274 wait complete. 2024-09-17T01:41:23.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.116+0000 7fec2d600640 1 Processor -- start 2024-09-17T01:41:23.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.117+0000 7fec2d600640 1 -- start start 2024-09-17T01:41:23.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.118+0000 7fec2d600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec280b4be0 0x7fec280c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:23.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.118+0000 7fec2d600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fec280cf7c0 0x7fec28150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:23.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.118+0000 7fec2d600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec28074560 0x7fec28074970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:23.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.118+0000 7fec2d600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fec28153850 con 0x7fec280b4be0 2024-09-17T01:41:23.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.118+0000 7fec2d600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fec281536d0 con 0x7fec28074560 2024-09-17T01:41:23.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.118+0000 7fec2d600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fec281539d0 con 0x7fec280cf7c0 2024-09-17T01:41:23.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.118+0000 7fec27e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec280b4be0 0x7fec280c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:23.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.118+0000 7fec27e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec280b4be0 0x7fec280c6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42916/0 (socket says 172.21.15.42:42916) 2024-09-17T01:41:23.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.118+0000 7fec27e00640 1 -- 172.21.15.42:0/94934424 learned_addr learned my addr 172.21.15.42:0/94934424 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:23.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.119+0000 7fec2cc00640 1 --2- 172.21.15.42:0/94934424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec28074560 0x7fec28074970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:23.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.119+0000 7fec1fe00640 1 --2- 172.21.15.42:0/94934424 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fec280cf7c0 0x7fec28150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:23.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.119+0000 7fec27e00640 1 -- 172.21.15.42:0/94934424 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fec280cf7c0 msgr2=0x7fec28150800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:23.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.119+0000 7fec27e00640 1 --2- 172.21.15.42:0/94934424 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fec280cf7c0 0x7fec28150800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:23.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.119+0000 7fec27e00640 1 -- 172.21.15.42:0/94934424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec28074560 msgr2=0x7fec28074970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:23.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.119+0000 7fec27e00640 1 --2- 172.21.15.42:0/94934424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec28074560 0x7fec28074970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:23.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.119+0000 7fec27e00640 1 -- 172.21.15.42:0/94934424 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec28074eb0 con 0x7fec280b4be0 2024-09-17T01:41:23.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.119+0000 7fec27e00640 1 --2- 172.21.15.42:0/94934424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec280b4be0 0x7fec280c6db0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fec18000c00 tx=0x7fec18033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:23.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.119+0000 7fec24c00640 1 -- 172.21.15.42:0/94934424 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec18005c90 con 0x7fec280b4be0 2024-09-17T01:41:23.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.120+0000 7fec24c00640 1 -- 172.21.15.42:0/94934424 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec18031e50 con 0x7fec280b4be0 2024-09-17T01:41:23.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.120+0000 7fec2d600640 1 -- 172.21.15.42:0/94934424 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec280c6020 con 0x7fec280b4be0 2024-09-17T01:41:23.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.120+0000 7fec24c00640 1 -- 172.21.15.42:0/94934424 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec180332f0 con 0x7fec280b4be0 2024-09-17T01:41:23.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.120+0000 7fec2d600640 1 -- 172.21.15.42:0/94934424 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec280c5540 con 0x7fec280b4be0 2024-09-17T01:41:23.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.121+0000 7fec2d600640 1 -- 172.21.15.42:0/94934424 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec28152ed0 con 0x7fec280b4be0 2024-09-17T01:41:23.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.122+0000 7fec24c00640 1 -- 172.21.15.42:0/94934424 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fec18033490 con 0x7fec280b4be0 2024-09-17T01:41:23.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.123+0000 7fec24c00640 1 --2- 172.21.15.42:0/94934424 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fec04078bc0 0x7fec0407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:23.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.123+0000 7fec24c00640 1 -- 172.21.15.42:0/94934424 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5767+0+0 (secure 0 0 0) 0x7fec180bc070 con 0x7fec280b4be0 2024-09-17T01:41:23.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.123+0000 7fec1fe00640 1 --2- 172.21.15.42:0/94934424 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fec04078bc0 0x7fec0407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:23.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.124+0000 7fec1fe00640 1 --2- 172.21.15.42:0/94934424 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fec04078bc0 0x7fec0407b0d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fec280740b0 tx=0x7fec10009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:23.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.127+0000 7fec24c00640 1 -- 172.21.15.42:0/94934424 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fec1804a030 con 0x7fec280b4be0 2024-09-17T01:41:23.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.364+0000 7fec2d600640 1 -- 172.21.15.42:0/94934424 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec280b35d0 con 0x7fec280b4be0 2024-09-17T01:41:23.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.365+0000 7fec24c00640 1 -- 172.21.15.42:0/94934424 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5222 (secure 0 0 0) 0x7fec28074eb0 con 0x7fec280b4be0 2024-09-17T01:41:23.363 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:41:23.363 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":98,"btime":"2024-09-17T01:40:45:701152+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6884,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2926480981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2926480981},{"type":"v1","addr":"172.21.15.43:6837","nonce":2926480981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7576,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1365229483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1365229483},{"type":"v1","addr":"172.21.15.43:6836","nonce":1365229483}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92},{"gid":8058,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1442154751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1442154751},{"type":"v1","addr":"172.21.15.42:6833","nonce":1442154751}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:40:42.191921+0000","modified":"2024-09-17T01:40:45.203701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8061},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8061":{"gid":8061,"name":"c","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/970028636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":970028636},{"type":"v1","addr":"172.21.15.42:6835","nonce":970028636}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8061,"qdb_cluster":[8061]},"id":8}]} 2024-09-17T01:41:23.363 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 98 2024-09-17T01:41:23.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.367+0000 7fec2d600640 1 -- 172.21.15.42:0/94934424 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fec04078bc0 msgr2=0x7fec0407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:23.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.367+0000 7fec2d600640 1 --2- 172.21.15.42:0/94934424 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fec04078bc0 0x7fec0407b0d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fec280740b0 tx=0x7fec10009040 comp rx=0 tx=0).stop 2024-09-17T01:41:23.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.367+0000 7fec2d600640 1 -- 172.21.15.42:0/94934424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec280b4be0 msgr2=0x7fec280c6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:23.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.367+0000 7fec2d600640 1 --2- 172.21.15.42:0/94934424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec280b4be0 0x7fec280c6db0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fec18000c00 tx=0x7fec18033c90 comp rx=0 tx=0).stop 2024-09-17T01:41:23.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.368+0000 7fec2d600640 1 -- 172.21.15.42:0/94934424 shutdown_connections 2024-09-17T01:41:23.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.368+0000 7fec2d600640 1 --2- 172.21.15.42:0/94934424 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fec04078bc0 0x7fec0407b0d0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:23.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.368+0000 7fec2d600640 1 --2- 172.21.15.42:0/94934424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec28074560 0x7fec28074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:23.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.368+0000 7fec2d600640 1 --2- 172.21.15.42:0/94934424 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fec280cf7c0 0x7fec28150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:23.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.368+0000 7fec2d600640 1 --2- 172.21.15.42:0/94934424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec280b4be0 0x7fec280c6db0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:23.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.368+0000 7fec2d600640 1 -- 172.21.15.42:0/94934424 >> 172.21.15.42:0/94934424 conn(0x7fec280b25f0 msgr2=0x7fec280b0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:23.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.368+0000 7fec2d600640 1 -- 172.21.15.42:0/94934424 shutdown_connections 2024-09-17T01:41:23.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.368+0000 7fec2d600640 1 -- 172.21.15.42:0/94934424 wait complete. 2024-09-17T01:41:23.387 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:41:23.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.618+0000 7fad22800640 1 -- 172.21.15.42:0/3190297722 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad00004800 msgr2=0x7fad00004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:23.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.618+0000 7fad22800640 1 --2- 172.21.15.42:0/3190297722 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad00004800 0x7fad00004c10 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fad0800c610 tx=0x7fad00005830 comp rx=0 tx=0).stop 2024-09-17T01:41:23.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.619+0000 7fad1be00640 1 -- 172.21.15.42:0/3190297722 reap_dead start 2024-09-17T01:41:23.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.619+0000 7fad22800640 1 -- 172.21.15.42:0/3190297722 shutdown_connections 2024-09-17T01:41:23.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.619+0000 7fad22800640 1 -- 172.21.15.42:0/3190297722 >> 172.21.15.42:0/3190297722 conn(0x7fad1c0b2930 msgr2=0x7fad1c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:23.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.619+0000 7fad22800640 1 -- 172.21.15.42:0/3190297722 shutdown_connections 2024-09-17T01:41:23.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.619+0000 7fad22800640 1 -- 172.21.15.42:0/3190297722 wait complete. 2024-09-17T01:41:23.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.621+0000 7fad22800640 1 Processor -- start 2024-09-17T01:41:23.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.621+0000 7fad22800640 1 -- start start 2024-09-17T01:41:23.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.623+0000 7fad22800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad00004800 0x7fad1c143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:23.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.623+0000 7fad22800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad1c144ca0 0x7fad1c1450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:23.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.623+0000 7fad22800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad1c1455f0 0x7fad1c1460e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:23.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.623+0000 7fad22800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c073450 con 0x7fad1c1455f0 2024-09-17T01:41:23.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.623+0000 7fad22800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c15fef0 con 0x7fad00004800 2024-09-17T01:41:23.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.623+0000 7fad22800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fad1c0735d0 con 0x7fad1c144ca0 2024-09-17T01:41:23.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.623+0000 7fad1be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad1c1455f0 0x7fad1c1460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:23.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.623+0000 7fad1be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad1c1455f0 0x7fad1c1460e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42938/0 (socket says 172.21.15.42:42938) 2024-09-17T01:41:23.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.623+0000 7fad1be00640 1 -- 172.21.15.42:0/2172903473 learned_addr learned my addr 172.21.15.42:0/2172903473 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:23.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.623+0000 7fad1aa00640 1 --2- 172.21.15.42:0/2172903473 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad1c144ca0 0x7fad1c1450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:23.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.623+0000 7fad1b400640 1 --2- 172.21.15.42:0/2172903473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad00004800 0x7fad1c143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:23.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.623+0000 7fad1be00640 1 -- 172.21.15.42:0/2172903473 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad1c144ca0 msgr2=0x7fad1c1450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:23.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.623+0000 7fad1be00640 1 --2- 172.21.15.42:0/2172903473 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad1c144ca0 0x7fad1c1450b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:23.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.623+0000 7fad1be00640 1 -- 172.21.15.42:0/2172903473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad00004800 msgr2=0x7fad1c143850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:23.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.623+0000 7fad1be00640 1 --2- 172.21.15.42:0/2172903473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad00004800 0x7fad1c143850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:23.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.623+0000 7fad1be00640 1 -- 172.21.15.42:0/2172903473 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1c143d90 con 0x7fad1c1455f0 2024-09-17T01:41:23.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.623+0000 7fad1b400640 1 --2- 172.21.15.42:0/2172903473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad00004800 0x7fad1c143850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:41:23.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.624+0000 7fad1be00640 1 --2- 172.21.15.42:0/2172903473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad1c1455f0 0x7fad1c1460e0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fad14005fd0 tx=0x7fad14010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:23.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.624+0000 7fad13400640 1 -- 172.21.15.42:0/2172903473 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad14003970 con 0x7fad1c1455f0 2024-09-17T01:41:23.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.624+0000 7fad13400640 1 -- 172.21.15.42:0/2172903473 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad14015070 con 0x7fad1c1455f0 2024-09-17T01:41:23.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.624+0000 7fad13400640 1 -- 172.21.15.42:0/2172903473 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad14004030 con 0x7fad1c1455f0 2024-09-17T01:41:23.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.624+0000 7fad22800640 1 -- 172.21.15.42:0/2172903473 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad1c0cbef0 con 0x7fad1c1455f0 2024-09-17T01:41:23.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.624+0000 7fad22800640 1 -- 172.21.15.42:0/2172903473 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad1c1444a0 con 0x7fad1c1455f0 2024-09-17T01:41:23.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.625+0000 7fad22800640 1 -- 172.21.15.42:0/2172903473 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad1c073b30 con 0x7fad1c1455f0 2024-09-17T01:41:23.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.626+0000 7fad13400640 1 -- 172.21.15.42:0/2172903473 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fad140041d0 con 0x7fad1c1455f0 2024-09-17T01:41:23.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.627+0000 7fad13400640 1 --2- 172.21.15.42:0/2172903473 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7facfc078bc0 0x7facfc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:23.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.627+0000 7fad13400640 1 -- 172.21.15.42:0/2172903473 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5767+0+0 (secure 0 0 0) 0x7fad1409b860 con 0x7fad1c1455f0 2024-09-17T01:41:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.628+0000 7fad1b400640 1 --2- 172.21.15.42:0/2172903473 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7facfc078bc0 0x7facfc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:23.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.629+0000 7fad1b400640 1 --2- 172.21.15.42:0/2172903473 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7facfc078bc0 0x7facfc07b0d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fad0c000c00 tx=0x7fad0c006b70 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:23.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.632+0000 7fad13400640 1 -- 172.21.15.42:0/2172903473 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fad14063ce0 con 0x7fad1c1455f0 2024-09-17T01:41:23.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.829+0000 7fad22800640 1 -- 172.21.15.42:0/2172903473 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fad1c0cbc80 con 0x7fad1c1455f0 2024-09-17T01:41:23.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.831+0000 7fad13400640 1 -- 172.21.15.42:0/2172903473 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) ==== 74+0+16780 (secure 0 0 0) 0x7fad140635e0 con 0x7fad1c1455f0 2024-09-17T01:41:23.829 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:41:23.829 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":125,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:40:50.224555+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:40:40.145220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T01:40:41.161552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.1d","mappings":[{"from":4,"to":3}]},{"pgid":"17.e","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:41:23.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.833+0000 7fad22800640 1 -- 172.21.15.42:0/2172903473 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7facfc078bc0 msgr2=0x7facfc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:23.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.833+0000 7fad22800640 1 --2- 172.21.15.42:0/2172903473 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7facfc078bc0 0x7facfc07b0d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fad0c000c00 tx=0x7fad0c006b70 comp rx=0 tx=0).stop 2024-09-17T01:41:23.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.833+0000 7fad22800640 1 -- 172.21.15.42:0/2172903473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad1c1455f0 msgr2=0x7fad1c1460e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:23.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.833+0000 7fad22800640 1 --2- 172.21.15.42:0/2172903473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad1c1455f0 0x7fad1c1460e0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fad14005fd0 tx=0x7fad14010f40 comp rx=0 tx=0).stop 2024-09-17T01:41:23.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.833+0000 7fad22800640 1 -- 172.21.15.42:0/2172903473 shutdown_connections 2024-09-17T01:41:23.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.833+0000 7fad22800640 1 --2- 172.21.15.42:0/2172903473 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7facfc078bc0 0x7facfc07b0d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:23.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.833+0000 7fad22800640 1 --2- 172.21.15.42:0/2172903473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad1c1455f0 0x7fad1c1460e0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:23.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.833+0000 7fad22800640 1 --2- 172.21.15.42:0/2172903473 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad1c144ca0 0x7fad1c1450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:23.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.833+0000 7fad22800640 1 --2- 172.21.15.42:0/2172903473 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad00004800 0x7fad1c143850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:23.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.833+0000 7fad22800640 1 -- 172.21.15.42:0/2172903473 >> 172.21.15.42:0/2172903473 conn(0x7fad1c0b2930 msgr2=0x7fad1c0ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:23.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.833+0000 7fad22800640 1 -- 172.21.15.42:0/2172903473 shutdown_connections 2024-09-17T01:41:23.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:23.833+0000 7fad22800640 1 -- 172.21.15.42:0/2172903473 wait complete. 2024-09-17T01:41:23.856 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T01:41:23.856 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:41:24.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.085+0000 7f70b1c00640 1 -- 172.21.15.42:0/1957699482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70ac15cec0 msgr2=0x7f70ac15d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:24.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.085+0000 7f70b1c00640 1 --2- 172.21.15.42:0/1957699482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70ac15cec0 0x7f70ac15d2d0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f70ac0cce40 tx=0x7f709c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:41:24.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.086+0000 7f70b1c00640 1 -- 172.21.15.42:0/1957699482 shutdown_connections 2024-09-17T01:41:24.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.086+0000 7f70b1c00640 1 --2- 172.21.15.42:0/1957699482 >> v2:172.21.15.43:3300/0 conn(0x7f70ac0cf0c0 0x7f70ac06d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:24.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.086+0000 7f70b1c00640 1 --2- 172.21.15.42:0/1957699482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70ac15cec0 0x7f70ac15d2d0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:24.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.086+0000 7f70b1c00640 1 -- 172.21.15.42:0/1957699482 >> 172.21.15.42:0/1957699482 conn(0x7f70ac0b2930 msgr2=0x7f70ac06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:24.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.086+0000 7f70b1c00640 1 -- 172.21.15.42:0/1957699482 shutdown_connections 2024-09-17T01:41:24.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.086+0000 7f70b1c00640 1 -- 172.21.15.42:0/1957699482 wait complete. 2024-09-17T01:41:24.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.088+0000 7f70b1c00640 1 Processor -- start 2024-09-17T01:41:24.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.088+0000 7f70b1c00640 1 -- start start 2024-09-17T01:41:24.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.089+0000 7f70b1c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f70ac0cecb0 0x7f70ac15bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:24.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.089+0000 7f70b1c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70ac0cf0c0 0x7f70ac0ae710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:24.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.089+0000 7f70b1c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70ac15cec0 0x7f70ac14a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:24.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.089+0000 7f70b1c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac074130 con 0x7f70ac15cec0 2024-09-17T01:41:24.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.089+0000 7f70b1c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac073fb0 con 0x7f70ac0cf0c0 2024-09-17T01:41:24.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.089+0000 7f70b1c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f70ac06d970 con 0x7f70ac0cecb0 2024-09-17T01:41:24.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.090+0000 7f70ab400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70ac15cec0 0x7f70ac14a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:24.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.090+0000 7f70ab400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70ac15cec0 0x7f70ac14a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42954/0 (socket says 172.21.15.42:42954) 2024-09-17T01:41:24.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.090+0000 7f70ab400640 1 -- 172.21.15.42:0/2795178538 learned_addr learned my addr 172.21.15.42:0/2795178538 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:24.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.090+0000 7f70ab400640 1 -- 172.21.15.42:0/2795178538 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f70ac0cecb0 msgr2=0x7f70ac15bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:24.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.090+0000 7f70ab400640 1 --2- 172.21.15.42:0/2795178538 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f70ac0cecb0 0x7f70ac15bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:24.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.090+0000 7f70ab400640 1 -- 172.21.15.42:0/2795178538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70ac0cf0c0 msgr2=0x7f70ac0ae710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:24.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.090+0000 7f70a2000640 1 --2- 172.21.15.42:0/2795178538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70ac0cf0c0 0x7f70ac0ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:24.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.090+0000 7f70ab400640 1 --2- 172.21.15.42:0/2795178538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70ac0cf0c0 0x7f70ac0ae710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:24.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.090+0000 7f70ab400640 1 -- 172.21.15.42:0/2795178538 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ac1f7900 con 0x7f70ac15cec0 2024-09-17T01:41:24.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.090+0000 7f70a2000640 1 --2- 172.21.15.42:0/2795178538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70ac0cf0c0 0x7f70ac0ae710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:41:24.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.090+0000 7f70ab400640 1 --2- 172.21.15.42:0/2795178538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70ac15cec0 0x7f70ac14a320 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f70a400caa0 tx=0x7f70a400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:24.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.091+0000 7f70a3400640 1 -- 172.21.15.42:0/2795178538 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a400adf0 con 0x7f70ac15cec0 2024-09-17T01:41:24.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.091+0000 7f70a3400640 1 -- 172.21.15.42:0/2795178538 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70a400f540 con 0x7f70ac15cec0 2024-09-17T01:41:24.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.091+0000 7f70a3400640 1 -- 172.21.15.42:0/2795178538 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a400f990 con 0x7f70ac15cec0 2024-09-17T01:41:24.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.091+0000 7f70b1c00640 1 -- 172.21.15.42:0/2795178538 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70ac1f3620 con 0x7f70ac15cec0 2024-09-17T01:41:24.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.091+0000 7f70b1c00640 1 -- 172.21.15.42:0/2795178538 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70ac1f3be0 con 0x7f70ac15cec0 2024-09-17T01:41:24.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.092+0000 7f70b1c00640 1 -- 172.21.15.42:0/2795178538 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70ac0aa4e0 con 0x7f70ac15cec0 2024-09-17T01:41:24.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.093+0000 7f70a3400640 1 -- 172.21.15.42:0/2795178538 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f70a400fb30 con 0x7f70ac15cec0 2024-09-17T01:41:24.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.094+0000 7f70a3400640 1 --2- 172.21.15.42:0/2795178538 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7088078b90 0x7f708807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:24.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.094+0000 7f70a3400640 1 -- 172.21.15.42:0/2795178538 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5767+0+0 (secure 0 0 0) 0x7f70a409b8e0 con 0x7f70ac15cec0 2024-09-17T01:41:24.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.095+0000 7f70aaa00640 1 --2- 172.21.15.42:0/2795178538 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7088078b90 0x7f708807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:24.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.096+0000 7f70aaa00640 1 --2- 172.21.15.42:0/2795178538 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7088078b90 0x7f708807b0a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f709c034000 tx=0x7f709c0046c0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:24.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.099+0000 7f70a3400640 1 -- 172.21.15.42:0/2795178538 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f70a4014030 con 0x7f70ac15cec0 2024-09-17T01:41:24.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.330+0000 7f70b1c00640 1 -- 172.21.15.42:0/2795178538 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70ac0af1d0 con 0x7f70ac15cec0 2024-09-17T01:41:24.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.331+0000 7f70a3400640 1 -- 172.21.15.42:0/2795178538 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5222 (secure 0 0 0) 0x7f70a400fe20 con 0x7f70ac15cec0 2024-09-17T01:41:24.329 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:41:24.329 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":98,"btime":"2024-09-17T01:40:45:701152+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6884,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2926480981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2926480981},{"type":"v1","addr":"172.21.15.43:6837","nonce":2926480981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7576,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1365229483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1365229483},{"type":"v1","addr":"172.21.15.43:6836","nonce":1365229483}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92},{"gid":8058,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1442154751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1442154751},{"type":"v1","addr":"172.21.15.42:6833","nonce":1442154751}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:40:42.191921+0000","modified":"2024-09-17T01:40:45.203701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8061},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8061":{"gid":8061,"name":"c","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/970028636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":970028636},{"type":"v1","addr":"172.21.15.42:6835","nonce":970028636}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8061,"qdb_cluster":[8061]},"id":8}]} 2024-09-17T01:41:24.329 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 98 2024-09-17T01:41:24.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.333+0000 7f70b1c00640 1 -- 172.21.15.42:0/2795178538 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7088078b90 msgr2=0x7f708807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:24.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.333+0000 7f70b1c00640 1 --2- 172.21.15.42:0/2795178538 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7088078b90 0x7f708807b0a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f709c034000 tx=0x7f709c0046c0 comp rx=0 tx=0).stop 2024-09-17T01:41:24.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.333+0000 7f70b1c00640 1 -- 172.21.15.42:0/2795178538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70ac15cec0 msgr2=0x7f70ac14a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:24.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.333+0000 7f70b1c00640 1 --2- 172.21.15.42:0/2795178538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70ac15cec0 0x7f70ac14a320 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f70a400caa0 tx=0x7f70a400cf60 comp rx=0 tx=0).stop 2024-09-17T01:41:24.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.333+0000 7f70b1c00640 1 -- 172.21.15.42:0/2795178538 shutdown_connections 2024-09-17T01:41:24.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.333+0000 7f70b1c00640 1 --2- 172.21.15.42:0/2795178538 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7088078b90 0x7f708807b0a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:24.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.333+0000 7f70b1c00640 1 --2- 172.21.15.42:0/2795178538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70ac0cf0c0 0x7f70ac0ae710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:24.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.333+0000 7f70b1c00640 1 --2- 172.21.15.42:0/2795178538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70ac15cec0 0x7f70ac14a320 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:24.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.333+0000 7f70b1c00640 1 --2- 172.21.15.42:0/2795178538 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f70ac0cecb0 0x7f70ac15bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:24.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.333+0000 7f70b1c00640 1 -- 172.21.15.42:0/2795178538 >> 172.21.15.42:0/2795178538 conn(0x7f70ac0b2930 msgr2=0x7f70ac072950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:24.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.333+0000 7f70b1c00640 1 -- 172.21.15.42:0/2795178538 shutdown_connections 2024-09-17T01:41:24.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.333+0000 7f70b1c00640 1 -- 172.21.15.42:0/2795178538 wait complete. 2024-09-17T01:41:24.356 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:41:24.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.585+0000 7f2252e00640 1 -- 172.21.15.42:0/672426218 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f224c0ce930 msgr2=0x7f224c0ced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:24.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.585+0000 7f2252e00640 1 --2- 172.21.15.42:0/672426218 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f224c0ce930 0x7f224c0ced40 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f2238005fd0 tx=0x7f223802a540 comp rx=0 tx=0).stop 2024-09-17T01:41:24.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.585+0000 7f2252e00640 1 -- 172.21.15.42:0/672426218 shutdown_connections 2024-09-17T01:41:24.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.585+0000 7f2252e00640 1 --2- 172.21.15.42:0/672426218 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f224c0ce930 0x7f224c0ced40 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:24.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.585+0000 7f2252e00640 1 -- 172.21.15.42:0/672426218 >> 172.21.15.42:0/672426218 conn(0x7f224c0b3ed0 msgr2=0x7f224c0b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:24.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.585+0000 7f2252e00640 1 -- 172.21.15.42:0/672426218 shutdown_connections 2024-09-17T01:41:24.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.585+0000 7f2252e00640 1 -- 172.21.15.42:0/672426218 wait complete. 2024-09-17T01:41:24.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.587+0000 7f2252e00640 1 Processor -- start 2024-09-17T01:41:24.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.587+0000 7f2252e00640 1 -- start start 2024-09-17T01:41:24.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.589+0000 7f2252e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f224c0ce930 0x7f224c1f6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:24.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.589+0000 7f2252e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f224c0d0d30 0x7f224c09f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:24.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.589+0000 7f2252e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f224c09fac0 0x7f224c1f8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:24.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.589+0000 7f2252e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f224c0713d0 con 0x7f224c0ce930 2024-09-17T01:41:24.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.589+0000 7f2252e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f224c071250 con 0x7f224c0d0d30 2024-09-17T01:41:24.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.589+0000 7f2252e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f224c071550 con 0x7f224c09fac0 2024-09-17T01:41:24.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.589+0000 7f2251a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f224c0ce930 0x7f224c1f6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:24.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.589+0000 7f2251a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f224c0ce930 0x7f224c1f6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42966/0 (socket says 172.21.15.42:42966) 2024-09-17T01:41:24.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.589+0000 7f2251a00640 1 -- 172.21.15.42:0/652469437 learned_addr learned my addr 172.21.15.42:0/652469437 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:24.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.589+0000 7f2251000640 1 --2- 172.21.15.42:0/652469437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f224c0d0d30 0x7f224c09f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:24.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.589+0000 7f2252400640 1 --2- 172.21.15.42:0/652469437 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f224c09fac0 0x7f224c1f8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:24.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.590+0000 7f2251a00640 1 -- 172.21.15.42:0/652469437 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f224c09fac0 msgr2=0x7f224c1f8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:24.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.590+0000 7f2251a00640 1 --2- 172.21.15.42:0/652469437 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f224c09fac0 0x7f224c1f8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:24.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.590+0000 7f2251a00640 1 -- 172.21.15.42:0/652469437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f224c0d0d30 msgr2=0x7f224c09f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:24.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.590+0000 7f2251a00640 1 --2- 172.21.15.42:0/652469437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f224c0d0d30 0x7f224c09f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:24.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.590+0000 7f2251a00640 1 -- 172.21.15.42:0/652469437 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f224c0a0340 con 0x7f224c0ce930 2024-09-17T01:41:24.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.590+0000 7f2251a00640 1 --2- 172.21.15.42:0/652469437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f224c0ce930 0x7f224c1f6320 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f224000c370 tx=0x7f224000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:24.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.590+0000 7f2249600640 1 -- 172.21.15.42:0/652469437 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22400052d0 con 0x7f224c0ce930 2024-09-17T01:41:24.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.590+0000 7f2249600640 1 -- 172.21.15.42:0/652469437 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2240007020 con 0x7f224c0ce930 2024-09-17T01:41:24.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.590+0000 7f2252e00640 1 -- 172.21.15.42:0/652469437 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f224c06cf70 con 0x7f224c0ce930 2024-09-17T01:41:24.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.590+0000 7f2249600640 1 -- 172.21.15.42:0/652469437 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2240007470 con 0x7f224c0ce930 2024-09-17T01:41:24.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.590+0000 7f2252e00640 1 -- 172.21.15.42:0/652469437 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f224c06d530 con 0x7f224c0ce930 2024-09-17T01:41:24.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.591+0000 7f2252e00640 1 -- 172.21.15.42:0/652469437 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f224c070730 con 0x7f224c0ce930 2024-09-17T01:41:24.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.593+0000 7f2249600640 1 -- 172.21.15.42:0/652469437 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f22400067d0 con 0x7f224c0ce930 2024-09-17T01:41:24.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.593+0000 7f2249600640 1 --2- 172.21.15.42:0/652469437 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f222c078b90 0x7f222c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:24.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.594+0000 7f2249600640 1 -- 172.21.15.42:0/652469437 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5767+0+0 (secure 0 0 0) 0x7f224009a270 con 0x7f224c0ce930 2024-09-17T01:41:24.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.594+0000 7f2251000640 1 --2- 172.21.15.42:0/652469437 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f222c078b90 0x7f222c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:24.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.595+0000 7f2251000640 1 --2- 172.21.15.42:0/652469437 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f222c078b90 0x7f222c07b0a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2238033000 tx=0x7f2238004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:24.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.598+0000 7f2249600640 1 -- 172.21.15.42:0/652469437 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2240062660 con 0x7f224c0ce930 2024-09-17T01:41:24.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.831+0000 7f2252e00640 1 -- 172.21.15.42:0/652469437 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f224c0d08b0 con 0x7f224c0ce930 2024-09-17T01:41:24.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.832+0000 7f2249600640 1 -- 172.21.15.42:0/652469437 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5222 (secure 0 0 0) 0x7f2240061f60 con 0x7f224c0ce930 2024-09-17T01:41:24.830 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:41:24.830 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":98,"btime":"2024-09-17T01:40:45:701152+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6884,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2926480981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2926480981},{"type":"v1","addr":"172.21.15.43:6837","nonce":2926480981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7576,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1365229483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1365229483},{"type":"v1","addr":"172.21.15.43:6836","nonce":1365229483}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92},{"gid":8058,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1442154751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1442154751},{"type":"v1","addr":"172.21.15.42:6833","nonce":1442154751}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:40:42.191921+0000","modified":"2024-09-17T01:40:45.203701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8061},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8061":{"gid":8061,"name":"c","rank":0,"incarnation":94,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/970028636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":970028636},{"type":"v1","addr":"172.21.15.42:6835","nonce":970028636}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8061,"qdb_cluster":[8061]},"id":8}]} 2024-09-17T01:41:24.830 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 98 2024-09-17T01:41:24.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.834+0000 7f2252e00640 1 -- 172.21.15.42:0/652469437 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f222c078b90 msgr2=0x7f222c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:24.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.834+0000 7f2252e00640 1 --2- 172.21.15.42:0/652469437 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f222c078b90 0x7f222c07b0a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2238033000 tx=0x7f2238004730 comp rx=0 tx=0).stop 2024-09-17T01:41:24.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.834+0000 7f2252e00640 1 -- 172.21.15.42:0/652469437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f224c0ce930 msgr2=0x7f224c1f6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:24.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.834+0000 7f2252e00640 1 --2- 172.21.15.42:0/652469437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f224c0ce930 0x7f224c1f6320 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f224000c370 tx=0x7f224000c830 comp rx=0 tx=0).stop 2024-09-17T01:41:24.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.834+0000 7f2252e00640 1 -- 172.21.15.42:0/652469437 shutdown_connections 2024-09-17T01:41:24.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.834+0000 7f2252e00640 1 --2- 172.21.15.42:0/652469437 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f222c078b90 0x7f222c07b0a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:24.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.834+0000 7f2252e00640 1 --2- 172.21.15.42:0/652469437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f224c0d0d30 0x7f224c09f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:24.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.834+0000 7f2252e00640 1 --2- 172.21.15.42:0/652469437 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f224c09fac0 0x7f224c1f8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:24.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.834+0000 7f2252e00640 1 --2- 172.21.15.42:0/652469437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f224c0ce930 0x7f224c1f6320 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:24.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.834+0000 7f2252e00640 1 -- 172.21.15.42:0/652469437 >> 172.21.15.42:0/652469437 conn(0x7f224c0b3ed0 msgr2=0x7f224c15f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:24.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.835+0000 7f2252e00640 1 -- 172.21.15.42:0/652469437 shutdown_connections 2024-09-17T01:41:24.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:24.835+0000 7f2252e00640 1 -- 172.21.15.42:0/652469437 wait complete. 2024-09-17T01:41:24.855 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:41:25.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.086+0000 7fafd7200640 1 -- 172.21.15.42:0/421199469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafd80cf7c0 msgr2=0x7fafd806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:25.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.086+0000 7fafd7200640 1 --2- 172.21.15.42:0/421199469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafd80cf7c0 0x7fafd806cd20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009830 tx=0x7fafc002a510 comp rx=0 tx=0).stop 2024-09-17T01:41:25.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.086+0000 7fafd7200640 1 -- 172.21.15.42:0/421199469 shutdown_connections 2024-09-17T01:41:25.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.086+0000 7fafd7200640 1 --2- 172.21.15.42:0/421199469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafd80cf7c0 0x7fafd806cd20 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:25.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.086+0000 7fafd7200640 1 --2- 172.21.15.42:0/421199469 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fafd80b4be0 0x7fafd815d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:25.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.086+0000 7fafd7200640 1 -- 172.21.15.42:0/421199469 >> 172.21.15.42:0/421199469 conn(0x7fafd80b25f0 msgr2=0x7fafd80d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:25.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.086+0000 7fafd7200640 1 -- 172.21.15.42:0/421199469 shutdown_connections 2024-09-17T01:41:25.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.086+0000 7fafd7200640 1 -- 172.21.15.42:0/421199469 wait complete. 2024-09-17T01:41:25.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.088+0000 7fafd7200640 1 Processor -- start 2024-09-17T01:41:25.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.088+0000 7fafd7200640 1 -- start start 2024-09-17T01:41:25.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.090+0000 7fafd7200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fafd806d260 0x7fafd809d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:25.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.090+0000 7fafd7200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafd80b4be0 0x7fafd81e4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:25.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.090+0000 7fafd7200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafd80cf7c0 0x7fafd80ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:25.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.090+0000 7fafd7200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fafd8153970 con 0x7fafd80b4be0 2024-09-17T01:41:25.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.090+0000 7fafd7200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fafd81537f0 con 0x7fafd80cf7c0 2024-09-17T01:41:25.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.090+0000 7fafd7200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fafd8153af0 con 0x7fafd806d260 2024-09-17T01:41:25.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.090+0000 7fafcfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafd80b4be0 0x7fafd81e4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:25.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.090+0000 7fafcfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafd80b4be0 0x7fafd81e4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42972/0 (socket says 172.21.15.42:42972) 2024-09-17T01:41:25.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.090+0000 7fafcfe00640 1 -- 172.21.15.42:0/3563218092 learned_addr learned my addr 172.21.15.42:0/3563218092 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:25.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.090+0000 7fafd5e00640 1 --2- 172.21.15.42:0/3563218092 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fafd806d260 0x7fafd809d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:25.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.090+0000 7fafd6800640 1 --2- 172.21.15.42:0/3563218092 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafd80cf7c0 0x7fafd80ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:25.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.090+0000 7fafcfe00640 1 -- 172.21.15.42:0/3563218092 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fafd806d260 msgr2=0x7fafd809d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:25.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.090+0000 7fafcfe00640 1 --2- 172.21.15.42:0/3563218092 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fafd806d260 0x7fafd809d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:25.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.090+0000 7fafcfe00640 1 -- 172.21.15.42:0/3563218092 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafd80cf7c0 msgr2=0x7fafd80ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:25.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.091+0000 7fafcfe00640 1 --2- 172.21.15.42:0/3563218092 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafd80cf7c0 0x7fafd80ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:25.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.091+0000 7fafcfe00640 1 -- 172.21.15.42:0/3563218092 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd81e5c30 con 0x7fafd80b4be0 2024-09-17T01:41:25.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.091+0000 7fafd5e00640 1 --2- 172.21.15.42:0/3563218092 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fafd806d260 0x7fafd809d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:41:25.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.091+0000 7fafd6800640 1 --2- 172.21.15.42:0/3563218092 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafd80cf7c0 0x7fafd80ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:41:25.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.091+0000 7fafcfe00640 1 --2- 172.21.15.42:0/3563218092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafd80b4be0 0x7fafd81e4ec0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009950 tx=0x7fafc0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:25.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.091+0000 7fafce000640 1 -- 172.21.15.42:0/3563218092 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0031d60 con 0x7fafd80b4be0 2024-09-17T01:41:25.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.091+0000 7fafce000640 1 -- 172.21.15.42:0/3563218092 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafc0033e10 con 0x7fafd80b4be0 2024-09-17T01:41:25.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.091+0000 7fafd7200640 1 -- 172.21.15.42:0/3563218092 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd81e5f10 con 0x7fafd80b4be0 2024-09-17T01:41:25.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.091+0000 7fafce000640 1 -- 172.21.15.42:0/3563218092 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0005260 con 0x7fafd80b4be0 2024-09-17T01:41:25.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.091+0000 7fafd7200640 1 -- 172.21.15.42:0/3563218092 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd80736b0 con 0x7fafd80b4be0 2024-09-17T01:41:25.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.092+0000 7fafd7200640 1 -- 172.21.15.42:0/3563218092 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd815d6b0 con 0x7fafd80b4be0 2024-09-17T01:41:25.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.094+0000 7fafce000640 1 -- 172.21.15.42:0/3563218092 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fafc0005400 con 0x7fafd80b4be0 2024-09-17T01:41:25.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.095+0000 7fafce000640 1 --2- 172.21.15.42:0/3563218092 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fafb4078b90 0x7fafb407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:25.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.095+0000 7fafce000640 1 -- 172.21.15.42:0/3563218092 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5767+0+0 (secure 0 0 0) 0x7fafc00bbe60 con 0x7fafd80b4be0 2024-09-17T01:41:25.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.096+0000 7fafd5e00640 1 --2- 172.21.15.42:0/3563218092 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fafb4078b90 0x7fafb407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:25.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.097+0000 7fafd5e00640 1 --2- 172.21.15.42:0/3563218092 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fafb4078b90 0x7fafb407b0a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fafc8005fd0 tx=0x7fafc8009260 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:25.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.100+0000 7fafce000640 1 -- 172.21.15.42:0/3563218092 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fafc003f030 con 0x7fafd80b4be0 2024-09-17T01:41:25.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.295+0000 7fafd7200640 1 -- 172.21.15.42:0/3563218092 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fafd81e59a0 con 0x7fafd80b4be0 2024-09-17T01:41:25.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.296+0000 7fafce000640 1 -- 172.21.15.42:0/3563218092 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) ==== 74+0+16780 (secure 0 0 0) 0x7fafc0084250 con 0x7fafd80b4be0 2024-09-17T01:41:25.294 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:41:25.294 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":125,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:40:50.224555+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:40:40.145220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T01:40:41.161552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.1d","mappings":[{"from":4,"to":3}]},{"pgid":"17.e","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:41:25.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.298+0000 7fafd7200640 1 -- 172.21.15.42:0/3563218092 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fafb4078b90 msgr2=0x7fafb407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:25.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.298+0000 7fafd7200640 1 --2- 172.21.15.42:0/3563218092 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fafb4078b90 0x7fafb407b0a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fafc8005fd0 tx=0x7fafc8009260 comp rx=0 tx=0).stop 2024-09-17T01:41:25.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.298+0000 7fafd7200640 1 -- 172.21.15.42:0/3563218092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafd80b4be0 msgr2=0x7fafd81e4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:25.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.298+0000 7fafd7200640 1 --2- 172.21.15.42:0/3563218092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafd80b4be0 0x7fafd81e4ec0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009950 tx=0x7fafc0033c20 comp rx=0 tx=0).stop 2024-09-17T01:41:25.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.299+0000 7fafd7200640 1 -- 172.21.15.42:0/3563218092 shutdown_connections 2024-09-17T01:41:25.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.299+0000 7fafd7200640 1 --2- 172.21.15.42:0/3563218092 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fafb4078b90 0x7fafb407b0a0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:25.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.299+0000 7fafd7200640 1 --2- 172.21.15.42:0/3563218092 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafd80cf7c0 0x7fafd80ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:25.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.299+0000 7fafd7200640 1 --2- 172.21.15.42:0/3563218092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafd80b4be0 0x7fafd81e4ec0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:25.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.299+0000 7fafd7200640 1 --2- 172.21.15.42:0/3563218092 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fafd806d260 0x7fafd809d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:25.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.299+0000 7fafd7200640 1 -- 172.21.15.42:0/3563218092 >> 172.21.15.42:0/3563218092 conn(0x7fafd80b25f0 msgr2=0x7fafd815bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:25.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.299+0000 7fafd7200640 1 -- 172.21.15.42:0/3563218092 shutdown_connections 2024-09-17T01:41:25.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.299+0000 7fafd7200640 1 -- 172.21.15.42:0/3563218092 wait complete. 2024-09-17T01:41:25.320 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T01:41:25.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.551+0000 7ff6ee000640 1 -- 172.21.15.42:0/3262416326 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff6e80cf7c0 msgr2=0x7ff6e806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:25.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.551+0000 7ff6ee000640 1 --2- 172.21.15.42:0/3262416326 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff6e80cf7c0 0x7ff6e806cd20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0005fd0 tx=0x7ff6d002a5d0 comp rx=0 tx=0).stop 2024-09-17T01:41:25.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.551+0000 7ff6ee000640 1 -- 172.21.15.42:0/3262416326 shutdown_connections 2024-09-17T01:41:25.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.551+0000 7ff6ee000640 1 --2- 172.21.15.42:0/3262416326 >> v2:172.21.15.43:3300/0 conn(0x7ff6e806d260 0x7ff6e8152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:25.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.551+0000 7ff6ee000640 1 --2- 172.21.15.42:0/3262416326 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff6e80cf7c0 0x7ff6e806cd20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:25.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.551+0000 7ff6ee000640 1 -- 172.21.15.42:0/3262416326 >> 172.21.15.42:0/3262416326 conn(0x7ff6e80b25f0 msgr2=0x7ff6e80d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:25.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.551+0000 7ff6ee000640 1 -- 172.21.15.42:0/3262416326 shutdown_connections 2024-09-17T01:41:25.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.551+0000 7ff6ee000640 1 -- 172.21.15.42:0/3262416326 wait complete. 2024-09-17T01:41:25.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.553+0000 7ff6ee000640 1 Processor -- start 2024-09-17T01:41:25.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.553+0000 7ff6ee000640 1 -- start start 2024-09-17T01:41:25.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.555+0000 7ff6ee000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6e806d260 0x7ff6e8146410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:25.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.555+0000 7ff6ee000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6e80b4be0 0x7ff6e80c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.555+0000 7ff6ee000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff6e80cf7c0 0x7ff6e80c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.555+0000 7ff6ee000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e8153850 con 0x7ff6e80b4be0 2024-09-17T01:41:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.555+0000 7ff6ee000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e81536d0 con 0x7ff6e806d260 2024-09-17T01:41:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.555+0000 7ff6ee000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e81539d0 con 0x7ff6e80cf7c0 2024-09-17T01:41:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.555+0000 7ff6dfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6e80b4be0 0x7ff6e80c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.555+0000 7ff6dfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6e80b4be0 0x7ff6e80c8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42976/0 (socket says 172.21.15.42:42976) 2024-09-17T01:41:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.555+0000 7ff6dfe00640 1 -- 172.21.15.42:0/3356714619 learned_addr learned my addr 172.21.15.42:0/3356714619 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.555+0000 7ff6ecc00640 1 --2- 172.21.15.42:0/3356714619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6e806d260 0x7ff6e8146410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.555+0000 7ff6ed600640 1 --2- 172.21.15.42:0/3356714619 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff6e80cf7c0 0x7ff6e80c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.556+0000 7ff6dfe00640 1 -- 172.21.15.42:0/3356714619 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff6e80cf7c0 msgr2=0x7ff6e80c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.556+0000 7ff6dfe00640 1 --2- 172.21.15.42:0/3356714619 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff6e80cf7c0 0x7ff6e80c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:25.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.556+0000 7ff6dfe00640 1 -- 172.21.15.42:0/3356714619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6e806d260 msgr2=0x7ff6e8146410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.556+0000 7ff6dfe00640 1 --2- 172.21.15.42:0/3356714619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6e806d260 0x7ff6e8146410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.556+0000 7ff6dfe00640 1 -- 172.21.15.42:0/3356714619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e814ff40 con 0x7ff6e80b4be0 2024-09-17T01:41:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.556+0000 7ff6ecc00640 1 --2- 172.21.15.42:0/3356714619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6e806d260 0x7ff6e8146410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:41:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.556+0000 7ff6dfe00640 1 --2- 172.21.15.42:0/3356714619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6e80b4be0 0x7ff6e80c8f50 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0034040 tx=0x7ff6d00035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:25.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.556+0000 7ff6e5600640 1 -- 172.21.15.42:0/3356714619 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d003e030 con 0x7ff6e80b4be0 2024-09-17T01:41:25.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.556+0000 7ff6e5600640 1 -- 172.21.15.42:0/3356714619 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6d0003ae0 con 0x7ff6e80b4be0 2024-09-17T01:41:25.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.556+0000 7ff6ee000640 1 -- 172.21.15.42:0/3356714619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e80746f0 con 0x7ff6e80b4be0 2024-09-17T01:41:25.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.556+0000 7ff6e5600640 1 -- 172.21.15.42:0/3356714619 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0035040 con 0x7ff6e80b4be0 2024-09-17T01:41:25.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.556+0000 7ff6ee000640 1 -- 172.21.15.42:0/3356714619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e81501e0 con 0x7ff6e80b4be0 2024-09-17T01:41:25.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.558+0000 7ff6ee000640 1 -- 172.21.15.42:0/3356714619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6e8074460 con 0x7ff6e80b4be0 2024-09-17T01:41:25.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.559+0000 7ff6e5600640 1 -- 172.21.15.42:0/3356714619 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff6d0041030 con 0x7ff6e80b4be0 2024-09-17T01:41:25.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.559+0000 7ff6e5600640 1 --2- 172.21.15.42:0/3356714619 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff6c4078bc0 0x7ff6c407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:25.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.560+0000 7ff6e5600640 1 -- 172.21.15.42:0/3356714619 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5767+0+0 (secure 0 0 0) 0x7ff6d00bb7a0 con 0x7ff6e80b4be0 2024-09-17T01:41:25.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.560+0000 7ff6ecc00640 1 --2- 172.21.15.42:0/3356714619 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff6c4078bc0 0x7ff6c407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:25.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.561+0000 7ff6ecc00640 1 --2- 172.21.15.42:0/3356714619 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff6c4078bc0 0x7ff6c407b0d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8001720 tx=0x7ff6d8009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:25.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.564+0000 7ff6e5600640 1 -- 172.21.15.42:0/3356714619 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff6d0083a80 con 0x7ff6e80b4be0 2024-09-17T01:41:25.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.796+0000 7ff6ee000640 1 -- 172.21.15.42:0/3356714619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff6e8152ed0 con 0x7ff6e80b4be0 2024-09-17T01:41:25.794 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-17T01:41:25.796+0000 7f9961e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:41:25.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.798+0000 7ff6e5600640 1 -- 172.21.15.42:0/3356714619 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v99) ==== 161+0+0 (secure 0 0 0) 0x7ff6d0083380 con 0x7ff6e80b4be0 2024-09-17T01:41:25.796 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T01:41:25.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.802+0000 7ff6ee000640 1 -- 172.21.15.42:0/3356714619 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff6c4078bc0 msgr2=0x7ff6c407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:25.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.802+0000 7ff6ee000640 1 --2- 172.21.15.42:0/3356714619 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff6c4078bc0 0x7ff6c407b0d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8001720 tx=0x7ff6d8009040 comp rx=0 tx=0).stop 2024-09-17T01:41:25.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.802+0000 7ff6ee000640 1 -- 172.21.15.42:0/3356714619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6e80b4be0 msgr2=0x7ff6e80c8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:25.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.802+0000 7ff6ee000640 1 --2- 172.21.15.42:0/3356714619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6e80b4be0 0x7ff6e80c8f50 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0034040 tx=0x7ff6d00035f0 comp rx=0 tx=0).stop 2024-09-17T01:41:25.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.802+0000 7ff6ee000640 1 -- 172.21.15.42:0/3356714619 shutdown_connections 2024-09-17T01:41:25.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.802+0000 7ff6ee000640 1 --2- 172.21.15.42:0/3356714619 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff6c4078bc0 0x7ff6c407b0d0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:25.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.802+0000 7ff6ee000640 1 --2- 172.21.15.42:0/3356714619 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff6e80cf7c0 0x7ff6e80c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:25.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.802+0000 7ff6ee000640 1 --2- 172.21.15.42:0/3356714619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6e80b4be0 0x7ff6e80c8f50 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:25.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.802+0000 7ff6ee000640 1 --2- 172.21.15.42:0/3356714619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6e806d260 0x7ff6e8146410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:25.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.802+0000 7ff6ee000640 1 -- 172.21.15.42:0/3356714619 >> 172.21.15.42:0/3356714619 conn(0x7ff6e80b25f0 msgr2=0x7ff6e815f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:25.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.802+0000 7ff6ee000640 1 -- 172.21.15.42:0/3356714619 shutdown_connections 2024-09-17T01:41:25.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:25.802+0000 7ff6ee000640 1 -- 172.21.15.42:0/3356714619 wait complete. 2024-09-17T01:41:25.844 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T01:41:25.968 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:41:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.083+0000 7fc336000640 1 -- 172.21.15.42:0/3334435037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3300b3550 msgr2=0x7fc33015cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.083+0000 7fc336000640 1 --2- 172.21.15.42:0/3334435037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3300b3550 0x7fc33015cec0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fc320009830 tx=0x7fc32002a480 comp rx=0 tx=0).stop 2024-09-17T01:41:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.084+0000 7fc336000640 1 -- 172.21.15.42:0/3334435037 shutdown_connections 2024-09-17T01:41:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.084+0000 7fc336000640 1 --2- 172.21.15.42:0/3334435037 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc330142f40 0x7fc330072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.084+0000 7fc336000640 1 --2- 172.21.15.42:0/3334435037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3300b3550 0x7fc33015cec0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.084+0000 7fc336000640 1 -- 172.21.15.42:0/3334435037 >> 172.21.15.42:0/3334435037 conn(0x7fc3300b2930 msgr2=0x7fc33006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.084+0000 7fc336000640 1 -- 172.21.15.42:0/3334435037 shutdown_connections 2024-09-17T01:41:26.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.084+0000 7fc336000640 1 -- 172.21.15.42:0/3334435037 wait complete. 2024-09-17T01:41:26.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.086+0000 7fc336000640 1 Processor -- start 2024-09-17T01:41:26.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.086+0000 7fc336000640 1 -- start start 2024-09-17T01:41:26.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.087+0000 7fc336000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc330072e90 0x7fc3300ab310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:26.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.087+0000 7fc336000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3300b3550 0x7fc3301f0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:26.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.087+0000 7fc336000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc330142f40 0x7fc330141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:26.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.087+0000 7fc336000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc33006d7c0 con 0x7fc330072e90 2024-09-17T01:41:26.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.087+0000 7fc336000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc33006d640 con 0x7fc3300b3550 2024-09-17T01:41:26.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.088+0000 7fc336000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc33006d940 con 0x7fc330142f40 2024-09-17T01:41:26.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.088+0000 7fc32f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc330072e90 0x7fc3300ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:26.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.088+0000 7fc32f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc330072e90 0x7fc3300ab310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54718/0 (socket says 172.21.15.42:54718) 2024-09-17T01:41:26.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.088+0000 7fc32f400640 1 -- 172.21.15.42:0/293588313 learned_addr learned my addr 172.21.15.42:0/293588313 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:26.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.088+0000 7fc327e00640 1 --2- 172.21.15.42:0/293588313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3300b3550 0x7fc3301f0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:26.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.088+0000 7fc32fe00640 1 --2- 172.21.15.42:0/293588313 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc330142f40 0x7fc330141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:26.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.088+0000 7fc32f400640 1 -- 172.21.15.42:0/293588313 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc330142f40 msgr2=0x7fc330141990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:26.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.088+0000 7fc32f400640 1 --2- 172.21.15.42:0/293588313 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc330142f40 0x7fc330141990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:26.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.088+0000 7fc32f400640 1 -- 172.21.15.42:0/293588313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3300b3550 msgr2=0x7fc3301f0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:26.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.088+0000 7fc32f400640 1 --2- 172.21.15.42:0/293588313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3300b3550 0x7fc3301f0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:26.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.088+0000 7fc32f400640 1 -- 172.21.15.42:0/293588313 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3301f45a0 con 0x7fc330072e90 2024-09-17T01:41:26.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.088+0000 7fc327e00640 1 --2- 172.21.15.42:0/293588313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3300b3550 0x7fc3301f0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:41:26.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.089+0000 7fc32f400640 1 --2- 172.21.15.42:0/293588313 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc330072e90 0x7fc3300ab310 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fc320009950 tx=0x7fc320033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:26.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.089+0000 7fc327400640 1 -- 172.21.15.42:0/293588313 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc320005c90 con 0x7fc330072e90 2024-09-17T01:41:26.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.089+0000 7fc336000640 1 -- 172.21.15.42:0/293588313 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3301f37e0 con 0x7fc330072e90 2024-09-17T01:41:26.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.089+0000 7fc327400640 1 -- 172.21.15.42:0/293588313 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc320031e50 con 0x7fc330072e90 2024-09-17T01:41:26.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.089+0000 7fc327400640 1 -- 172.21.15.42:0/293588313 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc320005260 con 0x7fc330072e90 2024-09-17T01:41:26.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.089+0000 7fc336000640 1 -- 172.21.15.42:0/293588313 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3301f3da0 con 0x7fc330072e90 2024-09-17T01:41:26.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.090+0000 7fc336000640 1 -- 172.21.15.42:0/293588313 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc33015cec0 con 0x7fc330072e90 2024-09-17T01:41:26.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.091+0000 7fc327400640 1 -- 172.21.15.42:0/293588313 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc320005400 con 0x7fc330072e90 2024-09-17T01:41:26.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.092+0000 7fc327400640 1 --2- 172.21.15.42:0/293588313 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc30c078bc0 0x7fc30c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:26.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.093+0000 7fc327400640 1 -- 172.21.15.42:0/293588313 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5853+0+0 (secure 0 0 0) 0x7fc3200bbf80 con 0x7fc330072e90 2024-09-17T01:41:26.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.093+0000 7fc327e00640 1 --2- 172.21.15.42:0/293588313 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc30c078bc0 0x7fc30c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:26.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.094+0000 7fc327e00640 1 --2- 172.21.15.42:0/293588313 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc30c078bc0 0x7fc30c07b0d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc3300aa970 tx=0x7fc318005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:26.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.097+0000 7fc327400640 1 -- 172.21.15.42:0/293588313 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc32003f030 con 0x7fc330072e90 2024-09-17T01:41:26.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.328+0000 7fc336000640 1 -- 172.21.15.42:0/293588313 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc33006a170 con 0x7fc330072e90 2024-09-17T01:41:26.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.801+0000 7fc327400640 1 -- 172.21.15.42:0/293588313 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v100) ==== 104+0+0 (secure 0 0 0) 0x7fc320084210 con 0x7fc330072e90 2024-09-17T01:41:26.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.804+0000 7fc336000640 1 -- 172.21.15.42:0/293588313 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc30c078bc0 msgr2=0x7fc30c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:26.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.804+0000 7fc336000640 1 --2- 172.21.15.42:0/293588313 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc30c078bc0 0x7fc30c07b0d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc3300aa970 tx=0x7fc318005f90 comp rx=0 tx=0).stop 2024-09-17T01:41:26.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.804+0000 7fc336000640 1 -- 172.21.15.42:0/293588313 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc330072e90 msgr2=0x7fc3300ab310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:26.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.804+0000 7fc336000640 1 --2- 172.21.15.42:0/293588313 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc330072e90 0x7fc3300ab310 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fc320009950 tx=0x7fc320033c20 comp rx=0 tx=0).stop 2024-09-17T01:41:26.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.805+0000 7fc336000640 1 -- 172.21.15.42:0/293588313 shutdown_connections 2024-09-17T01:41:26.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.805+0000 7fc336000640 1 --2- 172.21.15.42:0/293588313 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc30c078bc0 0x7fc30c07b0d0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:26.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.805+0000 7fc336000640 1 --2- 172.21.15.42:0/293588313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3300b3550 0x7fc3301f0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:26.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.805+0000 7fc336000640 1 --2- 172.21.15.42:0/293588313 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc330142f40 0x7fc330141990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:26.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.805+0000 7fc336000640 1 --2- 172.21.15.42:0/293588313 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc330072e90 0x7fc3300ab310 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:26.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.805+0000 7fc336000640 1 -- 172.21.15.42:0/293588313 >> 172.21.15.42:0/293588313 conn(0x7fc3300b2930 msgr2=0x7fc33015f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:26.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.805+0000 7fc336000640 1 -- 172.21.15.42:0/293588313 shutdown_connections 2024-09-17T01:41:26.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:26.805+0000 7fc336000640 1 -- 172.21.15.42:0/293588313 wait complete. 2024-09-17T01:41:26.828 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T01:41:27.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.065+0000 7f82d2c00640 1 -- 172.21.15.42:0/2895079184 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82cc0cdb20 msgr2=0x7f82cc0cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:27.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.065+0000 7f82d2c00640 1 --2- 172.21.15.42:0/2895079184 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82cc0cdb20 0x7f82cc0cdf30 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f82b8005fd0 tx=0x7f82b802a520 comp rx=0 tx=0).stop 2024-09-17T01:41:27.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.065+0000 7f82d2c00640 1 -- 172.21.15.42:0/2895079184 shutdown_connections 2024-09-17T01:41:27.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.065+0000 7f82d2c00640 1 --2- 172.21.15.42:0/2895079184 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82cc06d430 0x7f82cc06d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:27.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.065+0000 7f82d2c00640 1 --2- 172.21.15.42:0/2895079184 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82cc0cdb20 0x7f82cc0cdf30 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:27.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.065+0000 7f82d2c00640 1 -- 172.21.15.42:0/2895079184 >> 172.21.15.42:0/2895079184 conn(0x7f82cc0b28f0 msgr2=0x7f82cc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:27.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.065+0000 7f82d2c00640 1 -- 172.21.15.42:0/2895079184 shutdown_connections 2024-09-17T01:41:27.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.065+0000 7f82d2c00640 1 -- 172.21.15.42:0/2895079184 wait complete. 2024-09-17T01:41:27.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.067+0000 7f82d2c00640 1 Processor -- start 2024-09-17T01:41:27.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.067+0000 7f82d2c00640 1 -- start start 2024-09-17T01:41:27.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.069+0000 7f82d2c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82cc06d430 0x7f82cc139d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:27.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.069+0000 7f82d2c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82cc0b56d0 0x7f82cc073b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:27.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.069+0000 7f82d2c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82cc0cdb20 0x7f82cc1e9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:27.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.069+0000 7f82d2c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f82cc15d560 con 0x7f82cc06d430 2024-09-17T01:41:27.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.069+0000 7f82d2c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f82cc15d3e0 con 0x7f82cc0cdb20 2024-09-17T01:41:27.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.069+0000 7f82d2c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f82cc15d6e0 con 0x7f82cc0b56d0 2024-09-17T01:41:27.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.069+0000 7f82cbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82cc06d430 0x7f82cc139d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:27.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.069+0000 7f82cbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82cc06d430 0x7f82cc139d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54742/0 (socket says 172.21.15.42:54742) 2024-09-17T01:41:27.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.069+0000 7f82cbe00640 1 -- 172.21.15.42:0/1109752404 learned_addr learned my addr 172.21.15.42:0/1109752404 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:27.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.069+0000 7f82cb400640 1 --2- 172.21.15.42:0/1109752404 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82cc0b56d0 0x7f82cc073b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:27.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.069+0000 7f82d0c00640 1 --2- 172.21.15.42:0/1109752404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82cc0cdb20 0x7f82cc1e9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:27.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.069+0000 7f82cbe00640 1 -- 172.21.15.42:0/1109752404 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82cc0b56d0 msgr2=0x7f82cc073b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:27.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.069+0000 7f82cbe00640 1 --2- 172.21.15.42:0/1109752404 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82cc0b56d0 0x7f82cc073b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:27.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.069+0000 7f82cbe00640 1 -- 172.21.15.42:0/1109752404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82cc0cdb20 msgr2=0x7f82cc1e9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:27.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.069+0000 7f82cbe00640 1 --2- 172.21.15.42:0/1109752404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82cc0cdb20 0x7f82cc1e9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:27.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.069+0000 7f82cbe00640 1 -- 172.21.15.42:0/1109752404 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82cc1f5ab0 con 0x7f82cc06d430 2024-09-17T01:41:27.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.070+0000 7f82cbe00640 1 --2- 172.21.15.42:0/1109752404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82cc06d430 0x7f82cc139d00 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00b3f0 tx=0x7f82bc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:27.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.070+0000 7f82c3e00640 1 -- 172.21.15.42:0/1109752404 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc015020 con 0x7f82cc06d430 2024-09-17T01:41:27.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.070+0000 7f82c3e00640 1 -- 172.21.15.42:0/1109752404 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82bc011920 con 0x7f82cc06d430 2024-09-17T01:41:27.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.070+0000 7f82d2c00640 1 -- 172.21.15.42:0/1109752404 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82cc13a240 con 0x7f82cc06d430 2024-09-17T01:41:27.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.070+0000 7f82c3e00640 1 -- 172.21.15.42:0/1109752404 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc011d70 con 0x7f82cc06d430 2024-09-17T01:41:27.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.070+0000 7f82d2c00640 1 -- 172.21.15.42:0/1109752404 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82cc1f94c0 con 0x7f82cc06d430 2024-09-17T01:41:27.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.071+0000 7f82d2c00640 1 -- 172.21.15.42:0/1109752404 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82cc15dc60 con 0x7f82cc06d430 2024-09-17T01:41:27.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.073+0000 7f82c3e00640 1 -- 172.21.15.42:0/1109752404 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f82bc018020 con 0x7f82cc06d430 2024-09-17T01:41:27.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.074+0000 7f82c3e00640 1 --2- 172.21.15.42:0/1109752404 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f82ac078b90 0x7f82ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:27.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.074+0000 7f82c3e00640 1 -- 172.21.15.42:0/1109752404 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5853+0+0 (secure 0 0 0) 0x7f82bc09ab30 con 0x7f82cc06d430 2024-09-17T01:41:27.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.074+0000 7f82cb400640 1 --2- 172.21.15.42:0/1109752404 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f82ac078b90 0x7f82ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:27.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.075+0000 7f82cb400640 1 --2- 172.21.15.42:0/1109752404 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f82ac078b90 0x7f82ac07b0a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f82b8033000 tx=0x7f82b8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:27.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.078+0000 7f82c3e00640 1 -- 172.21.15.42:0/1109752404 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f82bc01f030 con 0x7f82cc06d430 2024-09-17T01:41:27.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.272+0000 7f82d2c00640 1 -- 172.21.15.42:0/1109752404 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f82cc0cdfd0 con 0x7f82cc06d430 2024-09-17T01:41:27.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.807+0000 7f82c3e00640 1 -- 172.21.15.42:0/1109752404 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v127) ==== 181+0+0 (secure 0 0 0) 0x7f82bc062e40 con 0x7f82cc06d430 2024-09-17T01:41:27.805 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-09-17T01:41:27.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.811+0000 7f82d2c00640 1 -- 172.21.15.42:0/1109752404 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f82ac078b90 msgr2=0x7f82ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:27.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.811+0000 7f82d2c00640 1 --2- 172.21.15.42:0/1109752404 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f82ac078b90 0x7f82ac07b0a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f82b8033000 tx=0x7f82b8004730 comp rx=0 tx=0).stop 2024-09-17T01:41:27.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.812+0000 7f82d2c00640 1 -- 172.21.15.42:0/1109752404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82cc06d430 msgr2=0x7f82cc139d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:27.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.812+0000 7f82d2c00640 1 --2- 172.21.15.42:0/1109752404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82cc06d430 0x7f82cc139d00 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00b3f0 tx=0x7f82bc00b8b0 comp rx=0 tx=0).stop 2024-09-17T01:41:27.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.812+0000 7f82d2c00640 1 -- 172.21.15.42:0/1109752404 shutdown_connections 2024-09-17T01:41:27.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.812+0000 7f82d2c00640 1 --2- 172.21.15.42:0/1109752404 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f82ac078b90 0x7f82ac07b0a0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:27.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.812+0000 7f82d2c00640 1 --2- 172.21.15.42:0/1109752404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82cc0cdb20 0x7f82cc1e9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:27.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.812+0000 7f82d2c00640 1 --2- 172.21.15.42:0/1109752404 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82cc0b56d0 0x7f82cc073b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:27.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.812+0000 7f82d2c00640 1 --2- 172.21.15.42:0/1109752404 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82cc06d430 0x7f82cc139d00 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:27.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.812+0000 7f82d2c00640 1 -- 172.21.15.42:0/1109752404 >> 172.21.15.42:0/1109752404 conn(0x7f82cc0b28f0 msgr2=0x7f82cc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:27.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.812+0000 7f82d2c00640 1 -- 172.21.15.42:0/1109752404 shutdown_connections 2024-09-17T01:41:27.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:27.813+0000 7f82d2c00640 1 -- 172.21.15.42:0/1109752404 wait complete. 2024-09-17T01:41:27.835 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T01:41:28.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.069+0000 7f72a4400640 1 -- 172.21.15.42:0/3293952274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f729c0b56d0 msgr2=0x7f729c0b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:28.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.069+0000 7f72a4400640 1 --2- 172.21.15.42:0/3293952274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f729c0b56d0 0x7f729c0b46f0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f729c071930 tx=0x7f729002a530 comp rx=0 tx=0).stop 2024-09-17T01:41:28.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.069+0000 7f72a4400640 1 -- 172.21.15.42:0/3293952274 shutdown_connections 2024-09-17T01:41:28.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.069+0000 7f72a4400640 1 --2- 172.21.15.42:0/3293952274 >> v2:172.21.15.43:3300/0 conn(0x7f729c0cdb20 0x7f729c0cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:28.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.069+0000 7f72a4400640 1 --2- 172.21.15.42:0/3293952274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f729c0b56d0 0x7f729c0b46f0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:28.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.069+0000 7f72a4400640 1 -- 172.21.15.42:0/3293952274 >> 172.21.15.42:0/3293952274 conn(0x7f729c0b28f0 msgr2=0x7f729c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:28.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.069+0000 7f72a4400640 1 -- 172.21.15.42:0/3293952274 shutdown_connections 2024-09-17T01:41:28.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.069+0000 7f72a4400640 1 -- 172.21.15.42:0/3293952274 wait complete. 2024-09-17T01:41:28.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.072+0000 7f72a4400640 1 Processor -- start 2024-09-17T01:41:28.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.072+0000 7f72a4400640 1 -- start start 2024-09-17T01:41:28.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.073+0000 7f72a4400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f729c06d430 0x7f729c1f70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:28.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.073+0000 7f72a4400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f729c0b56d0 0x7f729c1f7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:28.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.073+0000 7f72a4400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f729c0cdb20 0x7f729c1f96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:28.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.073+0000 7f72a4400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f729c15d560 con 0x7f729c06d430 2024-09-17T01:41:28.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.073+0000 7f72a4400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f729c15d3e0 con 0x7f729c0cdb20 2024-09-17T01:41:28.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.073+0000 7f72a4400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f729c15d6e0 con 0x7f729c0b56d0 2024-09-17T01:41:28.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.074+0000 7f72a1a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f729c06d430 0x7f729c1f70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:28.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.074+0000 7f72a1a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f729c06d430 0x7f729c1f70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54756/0 (socket says 172.21.15.42:54756) 2024-09-17T01:41:28.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.074+0000 7f72a1a00640 1 -- 172.21.15.42:0/3425485 learned_addr learned my addr 172.21.15.42:0/3425485 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:28.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.074+0000 7f72a1000640 1 --2- 172.21.15.42:0/3425485 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f729c0b56d0 0x7f729c1f7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:28.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.074+0000 7f72a2400640 1 --2- 172.21.15.42:0/3425485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f729c0cdb20 0x7f729c1f96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:28.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.074+0000 7f72a1a00640 1 -- 172.21.15.42:0/3425485 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f729c0b56d0 msgr2=0x7f729c1f7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:28.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.074+0000 7f72a1a00640 1 --2- 172.21.15.42:0/3425485 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f729c0b56d0 0x7f729c1f7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:28.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.074+0000 7f72a1a00640 1 -- 172.21.15.42:0/3425485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f729c0cdb20 msgr2=0x7f729c1f96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:28.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.074+0000 7f72a1a00640 1 --2- 172.21.15.42:0/3425485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f729c0cdb20 0x7f729c1f96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:28.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.074+0000 7f72a1a00640 1 -- 172.21.15.42:0/3425485 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729c0c7e00 con 0x7f729c06d430 2024-09-17T01:41:28.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.074+0000 7f72a2400640 1 --2- 172.21.15.42:0/3425485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f729c0cdb20 0x7f729c1f96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:41:28.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.074+0000 7f72a1a00640 1 --2- 172.21.15.42:0/3425485 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f729c06d430 0x7f729c1f70c0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f729002ab20 tx=0x7f7290033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:28.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.075+0000 7f7299600640 1 -- 172.21.15.42:0/3425485 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7290031d60 con 0x7f729c06d430 2024-09-17T01:41:28.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.075+0000 7f7299600640 1 -- 172.21.15.42:0/3425485 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7290033e10 con 0x7f729c06d430 2024-09-17T01:41:28.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.075+0000 7f7299600640 1 -- 172.21.15.42:0/3425485 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7290005260 con 0x7f729c06d430 2024-09-17T01:41:28.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.075+0000 7f72a4400640 1 -- 172.21.15.42:0/3425485 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f729c0c80e0 con 0x7f729c06d430 2024-09-17T01:41:28.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.075+0000 7f72a4400640 1 -- 172.21.15.42:0/3425485 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f729c0c86a0 con 0x7f729c06d430 2024-09-17T01:41:28.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.076+0000 7f72a4400640 1 -- 172.21.15.42:0/3425485 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f729c15dc00 con 0x7f729c06d430 2024-09-17T01:41:28.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.077+0000 7f7299600640 1 -- 172.21.15.42:0/3425485 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7290005400 con 0x7f729c06d430 2024-09-17T01:41:28.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.078+0000 7f7299600640 1 --2- 172.21.15.42:0/3425485 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f727c078bc0 0x7f727c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:28.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.078+0000 7f7299600640 1 -- 172.21.15.42:0/3425485 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5386+0+0 (secure 0 0 0) 0x7f72900bbd70 con 0x7f729c06d430 2024-09-17T01:41:28.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.079+0000 7f72a1000640 1 --2- 172.21.15.42:0/3425485 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f727c078bc0 0x7f727c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:28.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.079+0000 7f72a1000640 1 --2- 172.21.15.42:0/3425485 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f727c078bc0 0x7f727c07b0d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f729c138690 tx=0x7f728800b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:28.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.083+0000 7f7299600640 1 -- 172.21.15.42:0/3425485 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f729003f030 con 0x7f729c06d430 2024-09-17T01:41:28.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.277+0000 7f72a4400640 1 -- 172.21.15.42:0/3425485 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f729c0b1270 con 0x7f729c06d430 2024-09-17T01:41:28.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.813+0000 7f7299600640 1 -- 172.21.15.42:0/3425485 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v128) ==== 169+0+0 (secure 0 0 0) 0x7f7290005d00 con 0x7f729c06d430 2024-09-17T01:41:28.812 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-09-17T01:41:28.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.817+0000 7f72a4400640 1 -- 172.21.15.42:0/3425485 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f727c078bc0 msgr2=0x7f727c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:28.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.817+0000 7f72a4400640 1 --2- 172.21.15.42:0/3425485 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f727c078bc0 0x7f727c07b0d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f729c138690 tx=0x7f728800b2e0 comp rx=0 tx=0).stop 2024-09-17T01:41:28.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.817+0000 7f72a4400640 1 -- 172.21.15.42:0/3425485 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f729c06d430 msgr2=0x7f729c1f70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:28.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.817+0000 7f72a4400640 1 --2- 172.21.15.42:0/3425485 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f729c06d430 0x7f729c1f70c0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f729002ab20 tx=0x7f7290033c20 comp rx=0 tx=0).stop 2024-09-17T01:41:28.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.817+0000 7f72a4400640 1 -- 172.21.15.42:0/3425485 shutdown_connections 2024-09-17T01:41:28.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.817+0000 7f72a4400640 1 --2- 172.21.15.42:0/3425485 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f727c078bc0 0x7f727c07b0d0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:28.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.817+0000 7f72a4400640 1 --2- 172.21.15.42:0/3425485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f729c0cdb20 0x7f729c1f96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:28.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.817+0000 7f72a4400640 1 --2- 172.21.15.42:0/3425485 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f729c0b56d0 0x7f729c1f7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:28.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.817+0000 7f72a4400640 1 --2- 172.21.15.42:0/3425485 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f729c06d430 0x7f729c1f70c0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:28.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.817+0000 7f72a4400640 1 -- 172.21.15.42:0/3425485 >> 172.21.15.42:0/3425485 conn(0x7f729c0b28f0 msgr2=0x7f729c0763d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:28.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.818+0000 7f72a4400640 1 -- 172.21.15.42:0/3425485 shutdown_connections 2024-09-17T01:41:28.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:28.818+0000 7f72a4400640 1 -- 172.21.15.42:0/3425485 wait complete. 2024-09-17T01:41:28.863 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T01:41:29.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.092+0000 7fd022400640 1 -- 172.21.15.42:0/405737706 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd01c0b5100 msgr2=0x7fd01c15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:29.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.092+0000 7fd022400640 1 --2- 172.21.15.42:0/405737706 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd01c0b5100 0x7fd01c15d950 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fd00c009830 tx=0x7fd00c02a540 comp rx=0 tx=0).stop 2024-09-17T01:41:29.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.093+0000 7fd022400640 1 -- 172.21.15.42:0/405737706 shutdown_connections 2024-09-17T01:41:29.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.093+0000 7fd022400640 1 --2- 172.21.15.42:0/405737706 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd01c0b5100 0x7fd01c15d950 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:29.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.093+0000 7fd022400640 1 -- 172.21.15.42:0/405737706 >> 172.21.15.42:0/405737706 conn(0x7fd01c0b2930 msgr2=0x7fd01c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:29.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.093+0000 7fd022400640 1 -- 172.21.15.42:0/405737706 shutdown_connections 2024-09-17T01:41:29.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.093+0000 7fd022400640 1 -- 172.21.15.42:0/405737706 wait complete. 2024-09-17T01:41:29.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.095+0000 7fd022400640 1 Processor -- start 2024-09-17T01:41:29.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.095+0000 7fd022400640 1 -- start start 2024-09-17T01:41:29.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.096+0000 7fd022400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd01c06d430 0x7fd01c153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:29.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.096+0000 7fd022400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd01c0b5100 0x7fd01c1553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:29.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.096+0000 7fd022400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd01c0cef70 0x7fd01c06f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:29.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.096+0000 7fd022400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c073bd0 con 0x7fd01c0cef70 2024-09-17T01:41:29.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.096+0000 7fd022400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c073a50 con 0x7fd01c06d430 2024-09-17T01:41:29.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.096+0000 7fd022400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd01c073d50 con 0x7fd01c0b5100 2024-09-17T01:41:29.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.097+0000 7fd01be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd01c0cef70 0x7fd01c06f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:29.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.097+0000 7fd01be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd01c0cef70 0x7fd01c06f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54774/0 (socket says 172.21.15.42:54774) 2024-09-17T01:41:29.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.097+0000 7fd01be00640 1 -- 172.21.15.42:0/2771922632 learned_addr learned my addr 172.21.15.42:0/2771922632 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:29.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.097+0000 7fd01b400640 1 --2- 172.21.15.42:0/2771922632 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd01c06d430 0x7fd01c153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:29.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.097+0000 7fd01aa00640 1 --2- 172.21.15.42:0/2771922632 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd01c0b5100 0x7fd01c1553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:29.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.097+0000 7fd01be00640 1 -- 172.21.15.42:0/2771922632 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd01c0b5100 msgr2=0x7fd01c1553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:29.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.097+0000 7fd01be00640 1 --2- 172.21.15.42:0/2771922632 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd01c0b5100 0x7fd01c1553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:29.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.097+0000 7fd01be00640 1 -- 172.21.15.42:0/2771922632 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd01c06d430 msgr2=0x7fd01c153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:29.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.097+0000 7fd01be00640 1 --2- 172.21.15.42:0/2771922632 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd01c06d430 0x7fd01c153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:29.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.097+0000 7fd01be00640 1 -- 172.21.15.42:0/2771922632 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd01c153e00 con 0x7fd01c0cef70 2024-09-17T01:41:29.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.097+0000 7fd01be00640 1 --2- 172.21.15.42:0/2771922632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd01c0cef70 0x7fd01c06f210 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fd014002230 tx=0x7fd01400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:29.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.098+0000 7fd013400640 1 -- 172.21.15.42:0/2771922632 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd014003b70 con 0x7fd01c0cef70 2024-09-17T01:41:29.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.098+0000 7fd013400640 1 -- 172.21.15.42:0/2771922632 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd014003d10 con 0x7fd01c0cef70 2024-09-17T01:41:29.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.098+0000 7fd022400640 1 -- 172.21.15.42:0/2771922632 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd01c1540e0 con 0x7fd01c0cef70 2024-09-17T01:41:29.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.098+0000 7fd013400640 1 -- 172.21.15.42:0/2771922632 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd014005330 con 0x7fd01c0cef70 2024-09-17T01:41:29.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.098+0000 7fd022400640 1 -- 172.21.15.42:0/2771922632 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd01c158290 con 0x7fd01c0cef70 2024-09-17T01:41:29.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.099+0000 7fd022400640 1 -- 172.21.15.42:0/2771922632 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd01c155d40 con 0x7fd01c0cef70 2024-09-17T01:41:29.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.100+0000 7fd013400640 1 -- 172.21.15.42:0/2771922632 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd0140056e0 con 0x7fd01c0cef70 2024-09-17T01:41:29.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.101+0000 7fd013400640 1 --2- 172.21.15.42:0/2771922632 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcffc078bc0 0x7fcffc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:29.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.101+0000 7fd013400640 1 -- 172.21.15.42:0/2771922632 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 4943+0+0 (secure 0 0 0) 0x7fd01409aad0 con 0x7fd01c0cef70 2024-09-17T01:41:29.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.102+0000 7fd01b400640 1 --2- 172.21.15.42:0/2771922632 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcffc078bc0 0x7fcffc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:29.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.102+0000 7fd01b400640 1 --2- 172.21.15.42:0/2771922632 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcffc078bc0 0x7fcffc07b0d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd00c034000 tx=0x7fd00c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:29.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.106+0000 7fd013400640 1 -- 172.21.15.42:0/2771922632 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd014063170 con 0x7fd01c0cef70 2024-09-17T01:41:29.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.299+0000 7fd022400640 1 -- 172.21.15.42:0/2771922632 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fd01c15d730 con 0x7fd01c0cef70 2024-09-17T01:41:29.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.304+0000 7fd013400640 1 -- 172.21.15.42:0/2771922632 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v53) ==== 71+0+0 (secure 0 0 0) 0x7fd01c15d730 con 0x7fd01c0cef70 2024-09-17T01:41:29.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.306+0000 7fd022400640 1 -- 172.21.15.42:0/2771922632 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcffc078bc0 msgr2=0x7fcffc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:29.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.306+0000 7fd022400640 1 --2- 172.21.15.42:0/2771922632 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcffc078bc0 0x7fcffc07b0d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd00c034000 tx=0x7fd00c004730 comp rx=0 tx=0).stop 2024-09-17T01:41:29.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.306+0000 7fd022400640 1 -- 172.21.15.42:0/2771922632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd01c0cef70 msgr2=0x7fd01c06f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:29.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.306+0000 7fd022400640 1 --2- 172.21.15.42:0/2771922632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd01c0cef70 0x7fd01c06f210 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fd014002230 tx=0x7fd01400cb90 comp rx=0 tx=0).stop 2024-09-17T01:41:29.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.306+0000 7fd022400640 1 -- 172.21.15.42:0/2771922632 shutdown_connections 2024-09-17T01:41:29.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.306+0000 7fd022400640 1 --2- 172.21.15.42:0/2771922632 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcffc078bc0 0x7fcffc07b0d0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:29.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.306+0000 7fd022400640 1 --2- 172.21.15.42:0/2771922632 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd01c0cef70 0x7fd01c06f210 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:29.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.306+0000 7fd022400640 1 --2- 172.21.15.42:0/2771922632 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd01c0b5100 0x7fd01c1553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:29.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.306+0000 7fd022400640 1 --2- 172.21.15.42:0/2771922632 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd01c06d430 0x7fd01c153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:29.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.306+0000 7fd022400640 1 -- 172.21.15.42:0/2771922632 >> 172.21.15.42:0/2771922632 conn(0x7fd01c0b2930 msgr2=0x7fd01c160350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:29.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.306+0000 7fd022400640 1 -- 172.21.15.42:0/2771922632 shutdown_connections 2024-09-17T01:41:29.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.306+0000 7fd022400640 1 -- 172.21.15.42:0/2771922632 wait complete. 2024-09-17T01:41:29.327 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-09-17T01:41:29.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.576+0000 7f2298200640 1 -- 172.21.15.42:0/3906129441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2278003a30 msgr2=0x7f2278003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:29.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.576+0000 7f2298200640 1 --2- 172.21.15.42:0/3906129441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2278003a30 0x7f2278003ea0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f2284009b50 tx=0x7f2278005830 comp rx=0 tx=0).stop 2024-09-17T01:41:29.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.576+0000 7f2296200640 1 -- 172.21.15.42:0/3906129441 reap_dead start 2024-09-17T01:41:29.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.576+0000 7f2298200640 1 -- 172.21.15.42:0/3906129441 shutdown_connections 2024-09-17T01:41:29.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.576+0000 7f2298200640 1 -- 172.21.15.42:0/3906129441 >> 172.21.15.42:0/3906129441 conn(0x7f22900746c0 msgr2=0x7f229006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:29.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.576+0000 7f2298200640 1 -- 172.21.15.42:0/3906129441 shutdown_connections 2024-09-17T01:41:29.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.576+0000 7f2298200640 1 -- 172.21.15.42:0/3906129441 wait complete. 2024-09-17T01:41:29.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.578+0000 7f2298200640 1 Processor -- start 2024-09-17T01:41:29.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.578+0000 7f2298200640 1 -- start start 2024-09-17T01:41:29.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.580+0000 7f2298200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2278003a30 0x7f22901f5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:29.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.580+0000 7f2298200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2290138f70 0x7f22900cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:29.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.580+0000 7f2298200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f229015b2e0 0x7f229006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:29.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.580+0000 7f2298200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f229015feb0 con 0x7f2278003a30 2024-09-17T01:41:29.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.580+0000 7f2298200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f22900d0d50 con 0x7f2290138f70 2024-09-17T01:41:29.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.580+0000 7f2298200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2290160030 con 0x7f229015b2e0 2024-09-17T01:41:29.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.580+0000 7f2295800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2278003a30 0x7f22901f5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:29.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.580+0000 7f2295800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2278003a30 0x7f22901f5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54796/0 (socket says 172.21.15.42:54796) 2024-09-17T01:41:29.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.580+0000 7f2295800640 1 -- 172.21.15.42:0/1149964752 learned_addr learned my addr 172.21.15.42:0/1149964752 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:29.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.580+0000 7f2294e00640 1 --2- 172.21.15.42:0/1149964752 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2290138f70 0x7f22900cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:29.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.580+0000 7f2296200640 1 --2- 172.21.15.42:0/1149964752 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f229015b2e0 0x7f229006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:29.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.580+0000 7f2295800640 1 -- 172.21.15.42:0/1149964752 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f229015b2e0 msgr2=0x7f229006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:29.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.580+0000 7f2295800640 1 --2- 172.21.15.42:0/1149964752 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f229015b2e0 0x7f229006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:29.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.580+0000 7f2295800640 1 -- 172.21.15.42:0/1149964752 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2290138f70 msgr2=0x7f22900cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:29.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.580+0000 7f2295800640 1 --2- 172.21.15.42:0/1149964752 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2290138f70 0x7f22900cc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:29.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.580+0000 7f2295800640 1 -- 172.21.15.42:0/1149964752 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2290139650 con 0x7f2278003a30 2024-09-17T01:41:29.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.581+0000 7f2295800640 1 --2- 172.21.15.42:0/1149964752 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2278003a30 0x7f22901f5dc0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f2284009c70 tx=0x7f2284033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:29.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.581+0000 7f228d600640 1 -- 172.21.15.42:0/1149964752 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2284038040 con 0x7f2278003a30 2024-09-17T01:41:29.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.581+0000 7f228d600640 1 -- 172.21.15.42:0/1149964752 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2284004020 con 0x7f2278003a30 2024-09-17T01:41:29.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.581+0000 7f228d600640 1 -- 172.21.15.42:0/1149964752 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2284004450 con 0x7f2278003a30 2024-09-17T01:41:29.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.581+0000 7f2298200640 1 -- 172.21.15.42:0/1149964752 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2290139930 con 0x7f2278003a30 2024-09-17T01:41:29.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.581+0000 7f2298200640 1 -- 172.21.15.42:0/1149964752 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22900c6940 con 0x7f2278003a30 2024-09-17T01:41:29.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.582+0000 7f2298200640 1 -- 172.21.15.42:0/1149964752 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2290070bc0 con 0x7f2278003a30 2024-09-17T01:41:29.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.584+0000 7f228d600640 1 -- 172.21.15.42:0/1149964752 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2284045020 con 0x7f2278003a30 2024-09-17T01:41:29.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.585+0000 7f228d600640 1 --2- 172.21.15.42:0/1149964752 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2270078b90 0x7f227007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:29.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.585+0000 7f228d600640 1 -- 172.21.15.42:0/1149964752 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 4943+0+0 (secure 0 0 0) 0x7f22840bb3b0 con 0x7f2278003a30 2024-09-17T01:41:29.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.585+0000 7f2294e00640 1 --2- 172.21.15.42:0/1149964752 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2270078b90 0x7f227007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:29.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.586+0000 7f2294e00640 1 --2- 172.21.15.42:0/1149964752 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2270078b90 0x7f227007b0a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2290136db0 tx=0x7f227c005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:29.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.589+0000 7f228d600640 1 -- 172.21.15.42:0/1149964752 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2284083b80 con 0x7f2278003a30 2024-09-17T01:41:29.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:29.860+0000 7f2298200640 1 -- 172.21.15.42:0/1149964752 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) -- 0x7f22900b1030 con 0x7f2278003a30 2024-09-17T01:41:30.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:30.821+0000 7f228d600640 1 -- 172.21.15.42:0/1149964752 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v449) ==== 144+0+0 (secure 0 0 0) 0x7f2284083480 con 0x7f2278003a30 2024-09-17T01:41:30.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:30.824+0000 7f2298200640 1 -- 172.21.15.42:0/1149964752 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2270078b90 msgr2=0x7f227007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:30.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:30.824+0000 7f2298200640 1 --2- 172.21.15.42:0/1149964752 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2270078b90 0x7f227007b0a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2290136db0 tx=0x7f227c005f90 comp rx=0 tx=0).stop 2024-09-17T01:41:30.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:30.824+0000 7f2298200640 1 -- 172.21.15.42:0/1149964752 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2278003a30 msgr2=0x7f22901f5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:30.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:30.824+0000 7f2298200640 1 --2- 172.21.15.42:0/1149964752 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2278003a30 0x7f22901f5dc0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f2284009c70 tx=0x7f2284033670 comp rx=0 tx=0).stop 2024-09-17T01:41:30.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:30.824+0000 7f2298200640 1 -- 172.21.15.42:0/1149964752 shutdown_connections 2024-09-17T01:41:30.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:30.824+0000 7f2298200640 1 --2- 172.21.15.42:0/1149964752 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2270078b90 0x7f227007b0a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:30.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:30.824+0000 7f2298200640 1 --2- 172.21.15.42:0/1149964752 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2290138f70 0x7f22900cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:30.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:30.824+0000 7f2298200640 1 --2- 172.21.15.42:0/1149964752 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f229015b2e0 0x7f229006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:30.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:30.824+0000 7f2298200640 1 --2- 172.21.15.42:0/1149964752 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2278003a30 0x7f22901f5dc0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:30.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:30.824+0000 7f2298200640 1 -- 172.21.15.42:0/1149964752 >> 172.21.15.42:0/1149964752 conn(0x7f22900746c0 msgr2=0x7f22900b14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:30.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:30.824+0000 7f2298200640 1 -- 172.21.15.42:0/1149964752 shutdown_connections 2024-09-17T01:41:30.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:30.824+0000 7f2298200640 1 -- 172.21.15.42:0/1149964752 wait complete. 2024-09-17T01:41:30.850 INFO:tasks.cephfs_test_runner:test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-17T01:41:30.850 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-17T01:41:30.850 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:41:31.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.082+0000 7ff2be400640 1 -- 172.21.15.42:0/2569980774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b80cec40 msgr2=0x7ff2b80cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:31.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.082+0000 7ff2be400640 1 --2- 172.21.15.42:0/2569980774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b80cec40 0x7ff2b80cf050 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8071ef0 tx=0x7ff2b002aa30 comp rx=0 tx=0).stop 2024-09-17T01:41:31.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.082+0000 7ff2be400640 1 -- 172.21.15.42:0/2569980774 shutdown_connections 2024-09-17T01:41:31.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.082+0000 7ff2be400640 1 --2- 172.21.15.42:0/2569980774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b80cec40 0x7ff2b80cf050 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:31.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.082+0000 7ff2be400640 1 --2- 172.21.15.42:0/2569980774 >> v2:172.21.15.43:3300/0 conn(0x7ff2b80b3550 0x7ff2b815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:31.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.082+0000 7ff2be400640 1 -- 172.21.15.42:0/2569980774 >> 172.21.15.42:0/2569980774 conn(0x7ff2b80b2930 msgr2=0x7ff2b806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:31.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.082+0000 7ff2be400640 1 -- 172.21.15.42:0/2569980774 shutdown_connections 2024-09-17T01:41:31.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.082+0000 7ff2be400640 1 -- 172.21.15.42:0/2569980774 wait complete. 2024-09-17T01:41:31.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.085+0000 7ff2be400640 1 Processor -- start 2024-09-17T01:41:31.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.085+0000 7ff2be400640 1 -- start start 2024-09-17T01:41:31.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.086+0000 7ff2be400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2b80b3550 0x7ff2b8158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:31.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.086+0000 7ff2be400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2b80cec40 0x7ff2b8156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:31.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.086+0000 7ff2be400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b8142f40 0x7ff2b806f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:31.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.086+0000 7ff2be400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b806d7c0 con 0x7ff2b8142f40 2024-09-17T01:41:31.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.086+0000 7ff2be400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b806d640 con 0x7ff2b80b3550 2024-09-17T01:41:31.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.086+0000 7ff2be400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff2b806d940 con 0x7ff2b80cec40 2024-09-17T01:41:31.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.087+0000 7ff2b7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b8142f40 0x7ff2b806f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:31.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.087+0000 7ff2b7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b8142f40 0x7ff2b806f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54808/0 (socket says 172.21.15.42:54808) 2024-09-17T01:41:31.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.087+0000 7ff2b7e00640 1 -- 172.21.15.42:0/1801086038 learned_addr learned my addr 172.21.15.42:0/1801086038 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:31.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.087+0000 7ff2b7400640 1 --2- 172.21.15.42:0/1801086038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2b80b3550 0x7ff2b8158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:31.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.087+0000 7ff2b6a00640 1 --2- 172.21.15.42:0/1801086038 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2b80cec40 0x7ff2b8156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:31.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.087+0000 7ff2b7e00640 1 -- 172.21.15.42:0/1801086038 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2b80cec40 msgr2=0x7ff2b8156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:31.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.087+0000 7ff2b7e00640 1 --2- 172.21.15.42:0/1801086038 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2b80cec40 0x7ff2b8156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:31.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.087+0000 7ff2b7e00640 1 -- 172.21.15.42:0/1801086038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2b80b3550 msgr2=0x7ff2b8158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:31.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.087+0000 7ff2b7e00640 1 --2- 172.21.15.42:0/1801086038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2b80b3550 0x7ff2b8158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:31.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.087+0000 7ff2b7e00640 1 -- 172.21.15.42:0/1801086038 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b81593a0 con 0x7ff2b8142f40 2024-09-17T01:41:31.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.088+0000 7ff2b7e00640 1 --2- 172.21.15.42:0/1801086038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b8142f40 0x7ff2b806f720 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7ff2b002b020 tx=0x7ff2b0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:31.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.088+0000 7ff2af400640 1 -- 172.21.15.42:0/1801086038 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0033050 con 0x7ff2b8142f40 2024-09-17T01:41:31.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.088+0000 7ff2af400640 1 -- 172.21.15.42:0/1801086038 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2b0004450 con 0x7ff2b8142f40 2024-09-17T01:41:31.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.088+0000 7ff2af400640 1 -- 172.21.15.42:0/1801086038 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0038450 con 0x7ff2b8142f40 2024-09-17T01:41:31.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.088+0000 7ff2be400640 1 -- 172.21.15.42:0/1801086038 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2b8159680 con 0x7ff2b8142f40 2024-09-17T01:41:31.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.088+0000 7ff2be400640 1 -- 172.21.15.42:0/1801086038 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2b813f510 con 0x7ff2b8142f40 2024-09-17T01:41:31.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.089+0000 7ff2be400640 1 -- 172.21.15.42:0/1801086038 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2b815cec0 con 0x7ff2b8142f40 2024-09-17T01:41:31.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.091+0000 7ff2af400640 1 -- 172.21.15.42:0/1801086038 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff2b0036070 con 0x7ff2b8142f40 2024-09-17T01:41:31.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.091+0000 7ff2af400640 1 --2- 172.21.15.42:0/1801086038 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff298078b90 0x7ff29807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:31.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.092+0000 7ff2af400640 1 -- 172.21.15.42:0/1801086038 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 4943+0+0 (secure 0 0 0) 0x7ff2b00bbec0 con 0x7ff2b8142f40 2024-09-17T01:41:31.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.092+0000 7ff2b7400640 1 --2- 172.21.15.42:0/1801086038 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff298078b90 0x7ff29807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:31.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.093+0000 7ff2b7400640 1 --2- 172.21.15.42:0/1801086038 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff298078b90 0x7ff29807b0a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8004630 tx=0x7ff2a800b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:31.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.096+0000 7ff2af400640 1 -- 172.21.15.42:0/1801086038 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff2b0083fa0 con 0x7ff2b8142f40 2024-09-17T01:41:31.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.293+0000 7ff2be400640 1 -- 172.21.15.42:0/1801086038 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2b806a170 con 0x7ff2b8142f40 2024-09-17T01:41:31.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.294+0000 7ff2af400640 1 -- 172.21.15.42:0/1801086038 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) ==== 74+0+12992 (secure 0 0 0) 0x7ff2b00889d0 con 0x7ff2b8142f40 2024-09-17T01:41:31.293 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:41:31.293 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":128,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:41:28.808795+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6835/970028636":"2024-09-18T01:41:25.797289+0000","172.21.15.42:6834/970028636":"2024-09-18T01:41:25.797289+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:41:31.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.296+0000 7ff2be400640 1 -- 172.21.15.42:0/1801086038 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff298078b90 msgr2=0x7ff29807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:31.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.296+0000 7ff2be400640 1 --2- 172.21.15.42:0/1801086038 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff298078b90 0x7ff29807b0a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8004630 tx=0x7ff2a800b2e0 comp rx=0 tx=0).stop 2024-09-17T01:41:31.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.296+0000 7ff2be400640 1 -- 172.21.15.42:0/1801086038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b8142f40 msgr2=0x7ff2b806f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:31.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.296+0000 7ff2be400640 1 --2- 172.21.15.42:0/1801086038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b8142f40 0x7ff2b806f720 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7ff2b002b020 tx=0x7ff2b0003f10 comp rx=0 tx=0).stop 2024-09-17T01:41:31.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.296+0000 7ff2be400640 1 -- 172.21.15.42:0/1801086038 shutdown_connections 2024-09-17T01:41:31.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.296+0000 7ff2be400640 1 --2- 172.21.15.42:0/1801086038 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff298078b90 0x7ff29807b0a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:31.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.296+0000 7ff2be400640 1 --2- 172.21.15.42:0/1801086038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2b8142f40 0x7ff2b806f720 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:31.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.296+0000 7ff2be400640 1 --2- 172.21.15.42:0/1801086038 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2b80cec40 0x7ff2b8156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:31.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.296+0000 7ff2be400640 1 --2- 172.21.15.42:0/1801086038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2b80b3550 0x7ff2b8158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:31.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.296+0000 7ff2be400640 1 -- 172.21.15.42:0/1801086038 >> 172.21.15.42:0/1801086038 conn(0x7ff2b80b2930 msgr2=0x7ff2b8072950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:31.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.297+0000 7ff2be400640 1 -- 172.21.15.42:0/1801086038 shutdown_connections 2024-09-17T01:41:31.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.297+0000 7ff2be400640 1 -- 172.21.15.42:0/1801086038 wait complete. 2024-09-17T01:41:31.318 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T01:31:55.004951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T01:41:31.319 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T01:41:31.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.554+0000 7f6e65a00640 1 -- 172.21.15.42:0/3975718381 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e44003a30 msgr2=0x7f6e44003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:31.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.554+0000 7f6e65a00640 1 --2- 172.21.15.42:0/3975718381 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e44003a30 0x7f6e44003ea0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f6e500016c0 tx=0x7f6e44005830 comp rx=0 tx=0).stop 2024-09-17T01:41:31.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.554+0000 7f6e5f400640 1 -- 172.21.15.42:0/3975718381 reap_dead start 2024-09-17T01:41:31.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.554+0000 7f6e65a00640 1 -- 172.21.15.42:0/3975718381 shutdown_connections 2024-09-17T01:41:31.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.554+0000 7f6e65a00640 1 -- 172.21.15.42:0/3975718381 >> 172.21.15.42:0/3975718381 conn(0x7f6e600b2930 msgr2=0x7f6e6006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:31.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.554+0000 7f6e65a00640 1 -- 172.21.15.42:0/3975718381 shutdown_connections 2024-09-17T01:41:31.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.554+0000 7f6e65a00640 1 -- 172.21.15.42:0/3975718381 wait complete. 2024-09-17T01:41:31.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.556+0000 7f6e65a00640 1 Processor -- start 2024-09-17T01:41:31.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.556+0000 7f6e65a00640 1 -- start start 2024-09-17T01:41:31.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.558+0000 7f6e65a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e44003a30 0x7f6e60150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:31.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.558+0000 7f6e65a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e600aaf70 0x7f6e600ab380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:31.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.558+0000 7f6e65a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6e6015b9e0 0x7f6e6015bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:31.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.558+0000 7f6e65a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6e600741b0 con 0x7f6e600aaf70 2024-09-17T01:41:31.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.558+0000 7f6e65a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6e60074030 con 0x7f6e44003a30 2024-09-17T01:41:31.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.558+0000 7f6e65a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6e6006d430 con 0x7f6e6015b9e0 2024-09-17T01:41:31.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.558+0000 7f6e5e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e600aaf70 0x7f6e600ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:31.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.558+0000 7f6e5e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e600aaf70 0x7f6e600ab380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54822/0 (socket says 172.21.15.42:54822) 2024-09-17T01:41:31.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.558+0000 7f6e5e000640 1 -- 172.21.15.42:0/4172525538 learned_addr learned my addr 172.21.15.42:0/4172525538 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:31.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.558+0000 7f6e5f400640 1 --2- 172.21.15.42:0/4172525538 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6e6015b9e0 0x7f6e6015bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:31.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.558+0000 7f6e5ea00640 1 --2- 172.21.15.42:0/4172525538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e44003a30 0x7f6e60150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:31.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.558+0000 7f6e5e000640 1 -- 172.21.15.42:0/4172525538 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6e6015b9e0 msgr2=0x7f6e6015bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:31.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.558+0000 7f6e5e000640 1 --2- 172.21.15.42:0/4172525538 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6e6015b9e0 0x7f6e6015bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:31.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.558+0000 7f6e5e000640 1 -- 172.21.15.42:0/4172525538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e44003a30 msgr2=0x7f6e60150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:31.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.558+0000 7f6e5e000640 1 --2- 172.21.15.42:0/4172525538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e44003a30 0x7f6e60150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:31.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.558+0000 7f6e5e000640 1 -- 172.21.15.42:0/4172525538 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e6015c330 con 0x7f6e600aaf70 2024-09-17T01:41:31.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.559+0000 7f6e5e000640 1 --2- 172.21.15.42:0/4172525538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e600aaf70 0x7f6e600ab380 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c0066b0 tx=0x7f6e4c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:31.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.559+0000 7f6e56a00640 1 -- 172.21.15.42:0/4172525538 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c011700 con 0x7f6e600aaf70 2024-09-17T01:41:31.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.559+0000 7f6e56a00640 1 -- 172.21.15.42:0/4172525538 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e4c016020 con 0x7f6e600aaf70 2024-09-17T01:41:31.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.559+0000 7f6e65a00640 1 -- 172.21.15.42:0/4172525538 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e600b0730 con 0x7f6e600aaf70 2024-09-17T01:41:31.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.559+0000 7f6e56a00640 1 -- 172.21.15.42:0/4172525538 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c011b20 con 0x7f6e600aaf70 2024-09-17T01:41:31.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.559+0000 7f6e65a00640 1 -- 172.21.15.42:0/4172525538 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e600b0cf0 con 0x7f6e600aaf70 2024-09-17T01:41:31.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.560+0000 7f6e65a00640 1 -- 172.21.15.42:0/4172525538 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e6006d930 con 0x7f6e600aaf70 2024-09-17T01:41:31.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.561+0000 7f6e56a00640 1 -- 172.21.15.42:0/4172525538 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6e4c011cc0 con 0x7f6e600aaf70 2024-09-17T01:41:31.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.562+0000 7f6e56a00640 1 --2- 172.21.15.42:0/4172525538 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6e40078bc0 0x7f6e4007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:31.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.563+0000 7f6e56a00640 1 -- 172.21.15.42:0/4172525538 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 4943+0+0 (secure 0 0 0) 0x7f6e4c09b3c0 con 0x7f6e600aaf70 2024-09-17T01:41:31.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.563+0000 7f6e5ea00640 1 --2- 172.21.15.42:0/4172525538 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6e40078bc0 0x7f6e4007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:31.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.564+0000 7f6e5ea00640 1 --2- 172.21.15.42:0/4172525538 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6e40078bc0 0x7f6e4007b0d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6e50032000 tx=0x7f6e50001190 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:31.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.567+0000 7f6e56a00640 1 -- 172.21.15.42:0/4172525538 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6e4c020020 con 0x7f6e600aaf70 2024-09-17T01:41:31.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.760+0000 7f6e65a00640 1 -- 172.21.15.42:0/4172525538 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6e6006a170 con 0x7f6e600aaf70 2024-09-17T01:41:31.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.760+0000 7f6e56a00640 1 -- 172.21.15.42:0/4172525538 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v128) ==== 93+0+10 (secure 0 0 0) 0x7f6e6015c330 con 0x7f6e600aaf70 2024-09-17T01:41:31.759 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-09-17T01:41:31.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.763+0000 7f6e65a00640 1 -- 172.21.15.42:0/4172525538 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6e40078bc0 msgr2=0x7f6e4007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:31.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.763+0000 7f6e65a00640 1 --2- 172.21.15.42:0/4172525538 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6e40078bc0 0x7f6e4007b0d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6e50032000 tx=0x7f6e50001190 comp rx=0 tx=0).stop 2024-09-17T01:41:31.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.763+0000 7f6e65a00640 1 -- 172.21.15.42:0/4172525538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e600aaf70 msgr2=0x7f6e600ab380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:31.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.763+0000 7f6e65a00640 1 --2- 172.21.15.42:0/4172525538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e600aaf70 0x7f6e600ab380 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c0066b0 tx=0x7f6e4c0039c0 comp rx=0 tx=0).stop 2024-09-17T01:41:31.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.763+0000 7f6e65a00640 1 -- 172.21.15.42:0/4172525538 shutdown_connections 2024-09-17T01:41:31.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.763+0000 7f6e65a00640 1 --2- 172.21.15.42:0/4172525538 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6e40078bc0 0x7f6e4007b0d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:31.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.763+0000 7f6e65a00640 1 --2- 172.21.15.42:0/4172525538 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6e6015b9e0 0x7f6e6015bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:31.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.763+0000 7f6e65a00640 1 --2- 172.21.15.42:0/4172525538 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e600aaf70 0x7f6e600ab380 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:31.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.763+0000 7f6e65a00640 1 --2- 172.21.15.42:0/4172525538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6e44003a30 0x7f6e60150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:31.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.763+0000 7f6e65a00640 1 -- 172.21.15.42:0/4172525538 >> 172.21.15.42:0/4172525538 conn(0x7f6e600b2930 msgr2=0x7f6e6006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:31.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.763+0000 7f6e65a00640 1 -- 172.21.15.42:0/4172525538 shutdown_connections 2024-09-17T01:41:31.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:31.763+0000 7f6e65a00640 1 -- 172.21.15.42:0/4172525538 wait complete. 2024-09-17T01:41:31.787 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-09-17T01:41:32.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.016+0000 7f6a3ca00640 1 -- 172.21.15.42:0/347678362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a380cf7c0 msgr2=0x7f6a3806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.016+0000 7f6a3ca00640 1 --2- 172.21.15.42:0/347678362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a380cf7c0 0x7f6a3806cd20 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f6a20009830 tx=0x7f6a2002a510 comp rx=0 tx=0).stop 2024-09-17T01:41:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.016+0000 7f6a3ca00640 1 -- 172.21.15.42:0/347678362 shutdown_connections 2024-09-17T01:41:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.016+0000 7f6a3ca00640 1 --2- 172.21.15.42:0/347678362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a380cf7c0 0x7f6a3806cd20 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.016+0000 7f6a3ca00640 1 --2- 172.21.15.42:0/347678362 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6a380b4be0 0x7f6a3815d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.016+0000 7f6a3ca00640 1 -- 172.21.15.42:0/347678362 >> 172.21.15.42:0/347678362 conn(0x7f6a380b25f0 msgr2=0x7f6a380d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.016+0000 7f6a3ca00640 1 -- 172.21.15.42:0/347678362 shutdown_connections 2024-09-17T01:41:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.017+0000 7f6a3ca00640 1 -- 172.21.15.42:0/347678362 wait complete. 2024-09-17T01:41:32.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.019+0000 7f6a3ca00640 1 Processor -- start 2024-09-17T01:41:32.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.019+0000 7f6a3ca00640 1 -- start start 2024-09-17T01:41:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.020+0000 7f6a3ca00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a3806d260 0x7f6a38152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.020+0000 7f6a3ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a380b4be0 0x7f6a380730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.020+0000 7f6a3ca00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6a380cf7c0 0x7f6a381f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.020+0000 7f6a3ca00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6a38153970 con 0x7f6a380b4be0 2024-09-17T01:41:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.020+0000 7f6a3ca00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6a381537f0 con 0x7f6a3806d260 2024-09-17T01:41:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.020+0000 7f6a3ca00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6a38153af0 con 0x7f6a380cf7c0 2024-09-17T01:41:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.021+0000 7f6a2fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a380b4be0 0x7f6a380730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:32.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.021+0000 7f6a2fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a380b4be0 0x7f6a380730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54828/0 (socket says 172.21.15.42:54828) 2024-09-17T01:41:32.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.021+0000 7f6a2fe00640 1 -- 172.21.15.42:0/502778954 learned_addr learned my addr 172.21.15.42:0/502778954 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:32.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.021+0000 7f6a37400640 1 --2- 172.21.15.42:0/502778954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a3806d260 0x7f6a38152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:32.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.021+0000 7f6a37e00640 1 --2- 172.21.15.42:0/502778954 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6a380cf7c0 0x7f6a381f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:32.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.021+0000 7f6a2fe00640 1 -- 172.21.15.42:0/502778954 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6a380cf7c0 msgr2=0x7f6a381f5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:32.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.021+0000 7f6a2fe00640 1 --2- 172.21.15.42:0/502778954 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6a380cf7c0 0x7f6a381f5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:32.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.021+0000 7f6a2fe00640 1 -- 172.21.15.42:0/502778954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a3806d260 msgr2=0x7f6a38152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:32.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.021+0000 7f6a2fe00640 1 --2- 172.21.15.42:0/502778954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a3806d260 0x7f6a38152440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:32.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.021+0000 7f6a2fe00640 1 -- 172.21.15.42:0/502778954 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a381f92e0 con 0x7f6a380b4be0 2024-09-17T01:41:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.021+0000 7f6a2fe00640 1 --2- 172.21.15.42:0/502778954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a380b4be0 0x7f6a380730a0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f6a20009950 tx=0x7f6a20033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.022+0000 7f6a2f400640 1 -- 172.21.15.42:0/502778954 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a20031d60 con 0x7f6a380b4be0 2024-09-17T01:41:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.022+0000 7f6a2f400640 1 -- 172.21.15.42:0/502778954 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a20033e10 con 0x7f6a380b4be0 2024-09-17T01:41:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.022+0000 7f6a2f400640 1 -- 172.21.15.42:0/502778954 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a20005260 con 0x7f6a380b4be0 2024-09-17T01:41:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.022+0000 7f6a3ca00640 1 -- 172.21.15.42:0/502778954 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a381f95c0 con 0x7f6a380b4be0 2024-09-17T01:41:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.022+0000 7f6a3ca00640 1 -- 172.21.15.42:0/502778954 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a381f57e0 con 0x7f6a380b4be0 2024-09-17T01:41:32.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.023+0000 7f6a3ca00640 1 -- 172.21.15.42:0/502778954 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a381f9050 con 0x7f6a380b4be0 2024-09-17T01:41:32.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.024+0000 7f6a2f400640 1 -- 172.21.15.42:0/502778954 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6a20005400 con 0x7f6a380b4be0 2024-09-17T01:41:32.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.025+0000 7f6a2f400640 1 --2- 172.21.15.42:0/502778954 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6a14078b90 0x7f6a1407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:32.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.025+0000 7f6a2f400640 1 -- 172.21.15.42:0/502778954 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 4943+0+0 (secure 0 0 0) 0x7f6a200bbea0 con 0x7f6a380b4be0 2024-09-17T01:41:32.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.026+0000 7f6a37400640 1 --2- 172.21.15.42:0/502778954 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6a14078b90 0x7f6a1407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:32.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.026+0000 7f6a37400640 1 --2- 172.21.15.42:0/502778954 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6a14078b90 0x7f6a1407b0a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009b30 tx=0x7f6a28005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:32.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.028+0000 7f6a2f400640 1 -- 172.21.15.42:0/502778954 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6a2003f030 con 0x7f6a380b4be0 2024-09-17T01:41:32.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.295+0000 7f6a3ca00640 1 -- 172.21.15.42:0/502778954 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) -- 0x7f6a381f55f0 con 0x7f6a380b4be0 2024-09-17T01:41:32.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.828+0000 7f6a2f400640 1 -- 172.21.15.42:0/502778954 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v451) ==== 158+0+0 (secure 0 0 0) 0x7f6a20031770 con 0x7f6a380b4be0 2024-09-17T01:41:32.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.832+0000 7f6a3ca00640 1 -- 172.21.15.42:0/502778954 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6a14078b90 msgr2=0x7f6a1407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:32.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.832+0000 7f6a3ca00640 1 --2- 172.21.15.42:0/502778954 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6a14078b90 0x7f6a1407b0a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009b30 tx=0x7f6a28005f90 comp rx=0 tx=0).stop 2024-09-17T01:41:32.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.832+0000 7f6a3ca00640 1 -- 172.21.15.42:0/502778954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a380b4be0 msgr2=0x7f6a380730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:32.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.832+0000 7f6a3ca00640 1 --2- 172.21.15.42:0/502778954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a380b4be0 0x7f6a380730a0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f6a20009950 tx=0x7f6a20033c20 comp rx=0 tx=0).stop 2024-09-17T01:41:32.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.832+0000 7f6a3ca00640 1 -- 172.21.15.42:0/502778954 shutdown_connections 2024-09-17T01:41:32.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.832+0000 7f6a3ca00640 1 --2- 172.21.15.42:0/502778954 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6a14078b90 0x7f6a1407b0a0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:32.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.832+0000 7f6a3ca00640 1 --2- 172.21.15.42:0/502778954 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6a380cf7c0 0x7f6a381f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:32.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.832+0000 7f6a3ca00640 1 --2- 172.21.15.42:0/502778954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a380b4be0 0x7f6a380730a0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:32.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.832+0000 7f6a3ca00640 1 --2- 172.21.15.42:0/502778954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a3806d260 0x7f6a38152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:32.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.832+0000 7f6a3ca00640 1 -- 172.21.15.42:0/502778954 >> 172.21.15.42:0/502778954 conn(0x7f6a380b25f0 msgr2=0x7f6a3815c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:32.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.833+0000 7f6a3ca00640 1 -- 172.21.15.42:0/502778954 shutdown_connections 2024-09-17T01:41:32.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:32.833+0000 7f6a3ca00640 1 -- 172.21.15.42:0/502778954 wait complete. 2024-09-17T01:41:32.857 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T01:41:33.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.088+0000 7f6600c00640 1 -- 172.21.15.42:0/2768371145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65fc15b680 msgr2=0x7f65fc15fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:33.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.088+0000 7f6600c00640 1 --2- 172.21.15.42:0/2768371145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65fc15b680 0x7f65fc15fcc0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f65fc072190 tx=0x7f65ec02a560 comp rx=0 tx=0).stop 2024-09-17T01:41:33.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.089+0000 7f6600c00640 1 -- 172.21.15.42:0/2768371145 shutdown_connections 2024-09-17T01:41:33.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.089+0000 7f6600c00640 1 --2- 172.21.15.42:0/2768371145 >> v2:172.21.15.43:3300/0 conn(0x7f65fc0cafe0 0x7f65fc15f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.089+0000 7f6600c00640 1 --2- 172.21.15.42:0/2768371145 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65fc15f660 0x7f65fc0b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.089+0000 7f6600c00640 1 --2- 172.21.15.42:0/2768371145 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65fc15b680 0x7f65fc15fcc0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.089+0000 7f6600c00640 1 -- 172.21.15.42:0/2768371145 >> 172.21.15.42:0/2768371145 conn(0x7f65fc0b25f0 msgr2=0x7f65fc0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:33.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.089+0000 7f6600c00640 1 -- 172.21.15.42:0/2768371145 shutdown_connections 2024-09-17T01:41:33.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.089+0000 7f6600c00640 1 -- 172.21.15.42:0/2768371145 wait complete. 2024-09-17T01:41:33.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.091+0000 7f6600c00640 1 Processor -- start 2024-09-17T01:41:33.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.091+0000 7f6600c00640 1 -- start start 2024-09-17T01:41:33.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.093+0000 7f6600c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65fc0cafe0 0x7f65fc153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:33.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.093+0000 7f6600c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65fc15b680 0x7f65fc153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:33.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.093+0000 7f6600c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65fc15f660 0x7f65fc1544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:33.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.093+0000 7f6600c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc0b3a80 con 0x7f65fc15f660 2024-09-17T01:41:33.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.093+0000 7f6600c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc0b3900 con 0x7f65fc0cafe0 2024-09-17T01:41:33.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.093+0000 7f6600c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f65fc0b3c00 con 0x7f65fc15b680 2024-09-17T01:41:33.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.093+0000 7f65fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65fc15f660 0x7f65fc1544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:33.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.093+0000 7f65fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65fc15f660 0x7f65fc1544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54840/0 (socket says 172.21.15.42:54840) 2024-09-17T01:41:33.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.093+0000 7f65fbe00640 1 -- 172.21.15.42:0/895725795 learned_addr learned my addr 172.21.15.42:0/895725795 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:33.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.093+0000 7f65fb400640 1 --2- 172.21.15.42:0/895725795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65fc0cafe0 0x7f65fc153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:33.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.093+0000 7f65faa00640 1 --2- 172.21.15.42:0/895725795 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65fc15b680 0x7f65fc153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:33.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.093+0000 7f65fbe00640 1 -- 172.21.15.42:0/895725795 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65fc15b680 msgr2=0x7f65fc153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:33.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.093+0000 7f65fbe00640 1 --2- 172.21.15.42:0/895725795 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65fc15b680 0x7f65fc153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.093+0000 7f65fbe00640 1 -- 172.21.15.42:0/895725795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65fc0cafe0 msgr2=0x7f65fc153a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:33.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.093+0000 7f65fbe00640 1 --2- 172.21.15.42:0/895725795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65fc0cafe0 0x7f65fc153a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.093+0000 7f65fbe00640 1 -- 172.21.15.42:0/895725795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65fc074990 con 0x7f65fc15f660 2024-09-17T01:41:33.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.094+0000 7f65fbe00640 1 --2- 172.21.15.42:0/895725795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65fc15f660 0x7f65fc1544b0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f65f400e9c0 tx=0x7f65f400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:33.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.094+0000 7f65f3400640 1 -- 172.21.15.42:0/895725795 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f4004d20 con 0x7f65fc15f660 2024-09-17T01:41:33.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.094+0000 7f65f3400640 1 -- 172.21.15.42:0/895725795 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65f400cb20 con 0x7f65fc15f660 2024-09-17T01:41:33.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.094+0000 7f6600c00640 1 -- 172.21.15.42:0/895725795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65fc074c60 con 0x7f65fc15f660 2024-09-17T01:41:33.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.094+0000 7f65f3400640 1 -- 172.21.15.42:0/895725795 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f4005020 con 0x7f65fc15f660 2024-09-17T01:41:33.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.094+0000 7f6600c00640 1 -- 172.21.15.42:0/895725795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65fc15ccd0 con 0x7f65fc15f660 2024-09-17T01:41:33.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.095+0000 7f6600c00640 1 -- 172.21.15.42:0/895725795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65fc15fcc0 con 0x7f65fc15f660 2024-09-17T01:41:33.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.097+0000 7f65f3400640 1 -- 172.21.15.42:0/895725795 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f65f40051c0 con 0x7f65fc15f660 2024-09-17T01:41:33.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.098+0000 7f65f3400640 1 --2- 172.21.15.42:0/895725795 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f65dc078b90 0x7f65dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:33.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.098+0000 7f65f3400640 1 -- 172.21.15.42:0/895725795 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 4943+0+0 (secure 0 0 0) 0x7f65f409b350 con 0x7f65fc15f660 2024-09-17T01:41:33.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.099+0000 7f65fb400640 1 --2- 172.21.15.42:0/895725795 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f65dc078b90 0x7f65dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:33.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.100+0000 7f65fb400640 1 --2- 172.21.15.42:0/895725795 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f65dc078b90 0x7f65dc07b0a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f65ec033000 tx=0x7f65ec004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:33.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.103+0000 7f65f3400640 1 -- 172.21.15.42:0/895725795 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f65f4016030 con 0x7f65fc15f660 2024-09-17T01:41:33.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.299+0000 7f6600c00640 1 -- 172.21.15.42:0/895725795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f65fc0ce650 con 0x7f65fc15f660 2024-09-17T01:41:33.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.300+0000 7f65f3400640 1 -- 172.21.15.42:0/895725795 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v53) ==== 59+0+2294 (secure 0 0 0) 0x7f65f40633a0 con 0x7f65fc15f660 2024-09-17T01:41:33.299 INFO:teuthology.orchestra.run.smithi042.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T01:41:33.299 INFO:teuthology.orchestra.run.smithi042.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T01:41:33.300 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced client_mount_timeout 30 2024-09-17T01:41:33.300 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_client 20/20 2024-09-17T01:41:33.300 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_mgr 20/20 2024-09-17T01:41:33.300 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_ms 1/1 2024-09-17T01:41:33.300 INFO:teuthology.orchestra.run.smithi042.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T01:41:33.301 INFO:teuthology.orchestra.run.smithi042.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T01:41:33.301 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3683.959260 2024-09-17T01:41:33.301 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4350.010833 2024-09-17T01:41:33.301 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4316.776055 2024-09-17T01:41:33.301 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3885.595082 2024-09-17T01:41:33.301 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3602.000737 2024-09-17T01:41:33.302 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4883.364748 2024-09-17T01:41:33.302 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3752.484811 2024-09-17T01:41:33.302 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3775.035963 2024-09-17T01:41:33.302 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds 20/20 2024-09-17T01:41:33.302 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T01:41:33.302 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_ms 2/2 2024-09-17T01:41:33.303 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_frag true 2024-09-17T01:41:33.303 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_scatterstat true 2024-09-17T01:41:33.303 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T01:41:33.303 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_verify_scatter true 2024-09-17T01:41:33.303 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T01:41:33.304 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T01:41:33.304 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T01:41:33.304 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced client_mount_timeout 600 2024-09-17T01:41:33.304 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_client 20/20 2024-09-17T01:41:33.304 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_ms 1/1 2024-09-17T01:41:33.304 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T01:41:33.305 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T01:41:33.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.302+0000 7f6600c00640 1 -- 172.21.15.42:0/895725795 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f65dc078b90 msgr2=0x7f65dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.302+0000 7f6600c00640 1 --2- 172.21.15.42:0/895725795 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f65dc078b90 0x7f65dc07b0a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f65ec033000 tx=0x7f65ec004730 comp rx=0 tx=0).stop 2024-09-17T01:41:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.302+0000 7f6600c00640 1 -- 172.21.15.42:0/895725795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65fc15f660 msgr2=0x7f65fc1544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.302+0000 7f6600c00640 1 --2- 172.21.15.42:0/895725795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65fc15f660 0x7f65fc1544b0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f65f400e9c0 tx=0x7f65f400ee80 comp rx=0 tx=0).stop 2024-09-17T01:41:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.302+0000 7f6600c00640 1 -- 172.21.15.42:0/895725795 shutdown_connections 2024-09-17T01:41:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.302+0000 7f6600c00640 1 --2- 172.21.15.42:0/895725795 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f65dc078b90 0x7f65dc07b0a0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.302+0000 7f6600c00640 1 --2- 172.21.15.42:0/895725795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65fc15f660 0x7f65fc1544b0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.302+0000 7f6600c00640 1 --2- 172.21.15.42:0/895725795 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65fc15b680 0x7f65fc153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.302+0000 7f6600c00640 1 --2- 172.21.15.42:0/895725795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65fc0cafe0 0x7f65fc153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.302+0000 7f6600c00640 1 -- 172.21.15.42:0/895725795 >> 172.21.15.42:0/895725795 conn(0x7f65fc0b25f0 msgr2=0x7f65fc0ca520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:33.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.302+0000 7f6600c00640 1 -- 172.21.15.42:0/895725795 shutdown_connections 2024-09-17T01:41:33.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.302+0000 7f6600c00640 1 -- 172.21.15.42:0/895725795 wait complete. 2024-09-17T01:41:33.324 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T01:41:33.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.556+0000 7f6f65800640 1 -- 172.21.15.42:0/3463824426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f44005320 msgr2=0x7f6f4400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:33.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.556+0000 7f6f65800640 1 --2- 172.21.15.42:0/3463824426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f44005320 0x7f6f4400b9c0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f6f58001f00 tx=0x7f6f44005830 comp rx=0 tx=0).stop 2024-09-17T01:41:33.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.556+0000 7f6f5f400640 1 -- 172.21.15.42:0/3463824426 reap_dead start 2024-09-17T01:41:33.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.557+0000 7f6f65800640 1 -- 172.21.15.42:0/3463824426 shutdown_connections 2024-09-17T01:41:33.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.557+0000 7f6f65800640 1 -- 172.21.15.42:0/3463824426 >> 172.21.15.42:0/3463824426 conn(0x7f6f600b2930 msgr2=0x7f6f6006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:33.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.557+0000 7f6f65800640 1 -- 172.21.15.42:0/3463824426 shutdown_connections 2024-09-17T01:41:33.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.557+0000 7f6f65800640 1 -- 172.21.15.42:0/3463824426 wait complete. 2024-09-17T01:41:33.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.559+0000 7f6f65800640 1 Processor -- start 2024-09-17T01:41:33.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.559+0000 7f6f65800640 1 -- start start 2024-09-17T01:41:33.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.560+0000 7f6f65800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f44005320 0x7f6f6013ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:33.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.560+0000 7f6f65800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f60159d80 0x7f6f601f6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:33.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.561+0000 7f6f65800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f6006e1c0 0x7f6f6006e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:33.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.561+0000 7f6f65800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6f600cf3e0 con 0x7f6f44005320 2024-09-17T01:41:33.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.561+0000 7f6f65800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6f600cf260 con 0x7f6f60159d80 2024-09-17T01:41:33.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.561+0000 7f6f65800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6f600cf560 con 0x7f6f6006e1c0 2024-09-17T01:41:33.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.561+0000 7f6f5ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f44005320 0x7f6f6013ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:33.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.561+0000 7f6f5ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f44005320 0x7f6f6013ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54864/0 (socket says 172.21.15.42:54864) 2024-09-17T01:41:33.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.561+0000 7f6f5ea00640 1 -- 172.21.15.42:0/2508132195 learned_addr learned my addr 172.21.15.42:0/2508132195 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:33.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.561+0000 7f6f57e00640 1 --2- 172.21.15.42:0/2508132195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f60159d80 0x7f6f601f6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:33.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.561+0000 7f6f5f400640 1 --2- 172.21.15.42:0/2508132195 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f6006e1c0 0x7f6f6006e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:33.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.561+0000 7f6f5ea00640 1 -- 172.21.15.42:0/2508132195 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f6006e1c0 msgr2=0x7f6f6006e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:33.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.561+0000 7f6f5ea00640 1 --2- 172.21.15.42:0/2508132195 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f6006e1c0 0x7f6f6006e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.561+0000 7f6f5ea00640 1 -- 172.21.15.42:0/2508132195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f60159d80 msgr2=0x7f6f601f6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:33.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.561+0000 7f6f5ea00640 1 --2- 172.21.15.42:0/2508132195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f60159d80 0x7f6f601f6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.561+0000 7f6f5ea00640 1 -- 172.21.15.42:0/2508132195 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f6015e9b0 con 0x7f6f44005320 2024-09-17T01:41:33.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.561+0000 7f6f5f400640 1 --2- 172.21.15.42:0/2508132195 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f6006e1c0 0x7f6f6006e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:41:33.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.561+0000 7f6f5ea00640 1 --2- 172.21.15.42:0/2508132195 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f44005320 0x7f6f6013ed50 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f6f50011a30 tx=0x7f6f50011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:33.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.562+0000 7f6f56a00640 1 -- 172.21.15.42:0/2508132195 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5000fdb0 con 0x7f6f44005320 2024-09-17T01:41:33.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.562+0000 7f6f56a00640 1 -- 172.21.15.42:0/2508132195 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f50005020 con 0x7f6f44005320 2024-09-17T01:41:33.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.562+0000 7f6f56a00640 1 -- 172.21.15.42:0/2508132195 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f50005470 con 0x7f6f44005320 2024-09-17T01:41:33.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.562+0000 7f6f65800640 1 -- 172.21.15.42:0/2508132195 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f6015ec90 con 0x7f6f44005320 2024-09-17T01:41:33.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.562+0000 7f6f65800640 1 -- 172.21.15.42:0/2508132195 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f6006eb40 con 0x7f6f44005320 2024-09-17T01:41:33.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.563+0000 7f6f65800640 1 -- 172.21.15.42:0/2508132195 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f6006eda0 con 0x7f6f44005320 2024-09-17T01:41:33.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.564+0000 7f6f56a00640 1 -- 172.21.15.42:0/2508132195 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6f500047a0 con 0x7f6f44005320 2024-09-17T01:41:33.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.565+0000 7f6f56a00640 1 --2- 172.21.15.42:0/2508132195 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6f3c078b90 0x7f6f3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:33.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.565+0000 7f6f56a00640 1 -- 172.21.15.42:0/2508132195 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 4943+0+0 (secure 0 0 0) 0x7f6f5009b820 con 0x7f6f44005320 2024-09-17T01:41:33.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.566+0000 7f6f57e00640 1 --2- 172.21.15.42:0/2508132195 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6f3c078b90 0x7f6f3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:33.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.566+0000 7f6f57e00640 1 --2- 172.21.15.42:0/2508132195 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6f3c078b90 0x7f6f3c07b0a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6f6015f090 tx=0x7f6f48000f80 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:33.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.569+0000 7f6f56a00640 1 -- 172.21.15.42:0/2508132195 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6f50063870 con 0x7f6f44005320 2024-09-17T01:41:33.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.763+0000 7f6f65800640 1 -- 172.21.15.42:0/2508132195 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f6f6015d1d0 con 0x7f6f44005320 2024-09-17T01:41:33.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.767+0000 7f6f56a00640 1 -- 172.21.15.42:0/2508132195 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v54)=0 v54) ==== 122+0+0 (secure 0 0 0) 0x7f6f500682a0 con 0x7f6f44005320 2024-09-17T01:41:33.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.770+0000 7f6f65800640 1 -- 172.21.15.42:0/2508132195 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6f3c078b90 msgr2=0x7f6f3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:33.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.770+0000 7f6f65800640 1 --2- 172.21.15.42:0/2508132195 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6f3c078b90 0x7f6f3c07b0a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6f6015f090 tx=0x7f6f48000f80 comp rx=0 tx=0).stop 2024-09-17T01:41:33.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.770+0000 7f6f65800640 1 -- 172.21.15.42:0/2508132195 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f44005320 msgr2=0x7f6f6013ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:33.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.770+0000 7f6f65800640 1 --2- 172.21.15.42:0/2508132195 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f44005320 0x7f6f6013ed50 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f6f50011a30 tx=0x7f6f50011ef0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.770+0000 7f6f65800640 1 -- 172.21.15.42:0/2508132195 shutdown_connections 2024-09-17T01:41:33.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.770+0000 7f6f65800640 1 --2- 172.21.15.42:0/2508132195 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6f3c078b90 0x7f6f3c07b0a0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.770+0000 7f6f65800640 1 --2- 172.21.15.42:0/2508132195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f60159d80 0x7f6f601f6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.770+0000 7f6f65800640 1 --2- 172.21.15.42:0/2508132195 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f6006e1c0 0x7f6f6006e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.770+0000 7f6f65800640 1 --2- 172.21.15.42:0/2508132195 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f44005320 0x7f6f6013ed50 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.770+0000 7f6f65800640 1 -- 172.21.15.42:0/2508132195 >> 172.21.15.42:0/2508132195 conn(0x7f6f600b2930 msgr2=0x7f6f6006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:33.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.770+0000 7f6f65800640 1 -- 172.21.15.42:0/2508132195 shutdown_connections 2024-09-17T01:41:33.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:33.770+0000 7f6f65800640 1 -- 172.21.15.42:0/2508132195 wait complete. 2024-09-17T01:41:33.792 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:41:33.792 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:41:33.881 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:41:33.973 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:41:33.973 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:41:33.973 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:41:34.010 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:41:34.010 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:41:34.010 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:41:34.047 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:41:34.048 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:41:34.048 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:41:34.086 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:41:34.086 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:41:34.086 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:41:34.124 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:41:34.124 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T01:41:34.124 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:41:34.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.354+0000 7f15c5c00640 1 -- 172.21.15.42:0/2422179570 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f15c00cf7c0 msgr2=0x7f15c006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:34.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.354+0000 7f15c5c00640 1 --2- 172.21.15.42:0/2422179570 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f15c00cf7c0 0x7f15c006cd20 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f15ac009830 tx=0x7f15ac02a5c0 comp rx=0 tx=0).stop 2024-09-17T01:41:34.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.354+0000 7f15c5c00640 1 -- 172.21.15.42:0/2422179570 shutdown_connections 2024-09-17T01:41:34.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.354+0000 7f15c5c00640 1 --2- 172.21.15.42:0/2422179570 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f15c00cf7c0 0x7f15c006cd20 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:34.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.354+0000 7f15c5c00640 1 -- 172.21.15.42:0/2422179570 >> 172.21.15.42:0/2422179570 conn(0x7f15c00b25f0 msgr2=0x7f15c00d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:34.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.354+0000 7f15c5c00640 1 -- 172.21.15.42:0/2422179570 shutdown_connections 2024-09-17T01:41:34.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.354+0000 7f15c5c00640 1 -- 172.21.15.42:0/2422179570 wait complete. 2024-09-17T01:41:34.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.356+0000 7f15c5c00640 1 Processor -- start 2024-09-17T01:41:34.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.356+0000 7f15c5c00640 1 -- start start 2024-09-17T01:41:34.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.358+0000 7f15c5c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f15c006d260 0x7f15c01e4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:34.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.358+0000 7f15c5c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c00b4be0 0x7f15c01e5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:34.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.358+0000 7f15c5c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15c00cf7c0 0x7f15c01f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:34.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.358+0000 7f15c5c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f15c01535e0 con 0x7f15c006d260 2024-09-17T01:41:34.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.358+0000 7f15c5c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f15c00b4340 con 0x7f15c00b4be0 2024-09-17T01:41:34.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.358+0000 7f15c5c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f15c0153760 con 0x7f15c00cf7c0 2024-09-17T01:41:34.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.358+0000 7f15bfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f15c006d260 0x7f15c01e4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:34.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.358+0000 7f15bfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f15c006d260 0x7f15c01e4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54892/0 (socket says 172.21.15.42:54892) 2024-09-17T01:41:34.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.358+0000 7f15bf400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c00b4be0 0x7f15c01e5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:34.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.358+0000 7f15bfe00640 1 -- 172.21.15.42:0/4064899634 learned_addr learned my addr 172.21.15.42:0/4064899634 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:34.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.358+0000 7f15c5200640 1 --2- 172.21.15.42:0/4064899634 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15c00cf7c0 0x7f15c01f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:34.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.358+0000 7f15bfe00640 1 -- 172.21.15.42:0/4064899634 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15c00cf7c0 msgr2=0x7f15c01f3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:34.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.358+0000 7f15bfe00640 1 --2- 172.21.15.42:0/4064899634 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15c00cf7c0 0x7f15c01f3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:34.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.359+0000 7f15bfe00640 1 -- 172.21.15.42:0/4064899634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c00b4be0 msgr2=0x7f15c01e5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:34.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.359+0000 7f15bfe00640 1 --2- 172.21.15.42:0/4064899634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c00b4be0 0x7f15c01e5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:34.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.359+0000 7f15bfe00640 1 -- 172.21.15.42:0/4064899634 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c013d0c0 con 0x7f15c006d260 2024-09-17T01:41:34.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.359+0000 7f15bfe00640 1 --2- 172.21.15.42:0/4064899634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f15c006d260 0x7f15c01e4ec0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f15b000c400 tx=0x7f15b000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:34.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.359+0000 7f15b7e00640 1 -- 172.21.15.42:0/4064899634 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b0017070 con 0x7f15c006d260 2024-09-17T01:41:34.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.359+0000 7f15b7e00640 1 -- 172.21.15.42:0/4064899634 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15b00053c0 con 0x7f15c006d260 2024-09-17T01:41:34.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.359+0000 7f15c5c00640 1 -- 172.21.15.42:0/4064899634 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15c0073500 con 0x7f15c006d260 2024-09-17T01:41:34.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.359+0000 7f15b7e00640 1 -- 172.21.15.42:0/4064899634 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b0003850 con 0x7f15c006d260 2024-09-17T01:41:34.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.359+0000 7f15c5c00640 1 -- 172.21.15.42:0/4064899634 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15c00737d0 con 0x7f15c006d260 2024-09-17T01:41:34.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.360+0000 7f15c5c00640 1 -- 172.21.15.42:0/4064899634 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15c006cd20 con 0x7f15c006d260 2024-09-17T01:41:34.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.362+0000 7f15b7e00640 1 -- 172.21.15.42:0/4064899634 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f15b001a070 con 0x7f15c006d260 2024-09-17T01:41:34.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.362+0000 7f15b7e00640 1 --2- 172.21.15.42:0/4064899634 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f15a0078bc0 0x7f15a007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:34.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.363+0000 7f15b7e00640 1 -- 172.21.15.42:0/4064899634 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 4943+0+0 (secure 0 0 0) 0x7f15b0099d80 con 0x7f15c006d260 2024-09-17T01:41:34.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.363+0000 7f15bf400640 1 --2- 172.21.15.42:0/4064899634 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f15a0078bc0 0x7f15a007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:34.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.364+0000 7f15bf400640 1 --2- 172.21.15.42:0/4064899634 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f15a0078bc0 0x7f15a007b0d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f15ac034000 tx=0x7f15ac004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:34.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.367+0000 7f15b7e00640 1 -- 172.21.15.42:0/4064899634 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f15b0061ef0 con 0x7f15c006d260 2024-09-17T01:41:34.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.600+0000 7f15c5c00640 1 -- 172.21.15.42:0/4064899634 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15c0073e90 con 0x7f15c006d260 2024-09-17T01:41:34.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.601+0000 7f15b7e00640 1 -- 172.21.15.42:0/4064899634 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+3913 (secure 0 0 0) 0x7f15b0066920 con 0x7f15c006d260 2024-09-17T01:41:34.600 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:41:34.600 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":100,"btime":"2024-09-17T01:41:26:800508+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6884,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2926480981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2926480981},{"type":"v1","addr":"172.21.15.43:6837","nonce":2926480981}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7576,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1365229483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1365229483},{"type":"v1","addr":"172.21.15.43:6836","nonce":1365229483}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92},{"gid":7831,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2813882493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":2813882493},{"type":"v1","addr":"172.21.15.42:6835","nonce":2813882493}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":100},{"gid":8058,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1442154751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1442154751},{"type":"v1","addr":"172.21.15.42:6833","nonce":1442154751}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93}],"filesystems":[]} 2024-09-17T01:41:34.600 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 100 2024-09-17T01:41:34.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.604+0000 7f15c5c00640 1 -- 172.21.15.42:0/4064899634 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f15a0078bc0 msgr2=0x7f15a007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:34.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.604+0000 7f15c5c00640 1 --2- 172.21.15.42:0/4064899634 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f15a0078bc0 0x7f15a007b0d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f15ac034000 tx=0x7f15ac004730 comp rx=0 tx=0).stop 2024-09-17T01:41:34.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.604+0000 7f15c5c00640 1 -- 172.21.15.42:0/4064899634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f15c006d260 msgr2=0x7f15c01e4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:34.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.604+0000 7f15c5c00640 1 --2- 172.21.15.42:0/4064899634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f15c006d260 0x7f15c01e4ec0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f15b000c400 tx=0x7f15b000c8c0 comp rx=0 tx=0).stop 2024-09-17T01:41:34.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.604+0000 7f15c5c00640 1 -- 172.21.15.42:0/4064899634 shutdown_connections 2024-09-17T01:41:34.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.604+0000 7f15c5c00640 1 --2- 172.21.15.42:0/4064899634 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f15a0078bc0 0x7f15a007b0d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:34.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.604+0000 7f15c5c00640 1 --2- 172.21.15.42:0/4064899634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c00b4be0 0x7f15c01e5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:34.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.604+0000 7f15c5c00640 1 --2- 172.21.15.42:0/4064899634 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f15c00cf7c0 0x7f15c01f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:34.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.604+0000 7f15c5c00640 1 --2- 172.21.15.42:0/4064899634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f15c006d260 0x7f15c01e4ec0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:34.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.604+0000 7f15c5c00640 1 -- 172.21.15.42:0/4064899634 >> 172.21.15.42:0/4064899634 conn(0x7f15c00b25f0 msgr2=0x7f15c00b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:34.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.604+0000 7f15c5c00640 1 -- 172.21.15.42:0/4064899634 shutdown_connections 2024-09-17T01:41:34.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.604+0000 7f15c5c00640 1 -- 172.21.15.42:0/4064899634 wait complete. 2024-09-17T01:41:34.629 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T01:41:34.629 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T01:41:34.630 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T01:41:34.630 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:41:34.630 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T01:41:34.630 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T01:41:34.630 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T01:41:34.630 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:41:34.631 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T01:41:34.631 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T01:41:34.631 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T01:41:34.631 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:41:34.631 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T01:41:34.631 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T01:41:34.631 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T01:41:34.631 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:41:34.651 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T01:41:34.651 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T01:41:34.652 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T01:41:34.652 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T01:41:34.656 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T01:41:34.656 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T01:41:34.657 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T01:41:34.657 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T01:41:34.695 INFO:tasks.ceph.mds.c:Started 2024-09-17T01:41:34.695 DEBUG:teuthology.parallel:result is None 2024-09-17T01:41:34.697 INFO:tasks.ceph.mds.a:Started 2024-09-17T01:41:34.697 DEBUG:teuthology.parallel:result is None 2024-09-17T01:41:34.699 INFO:tasks.ceph.mds.b:Started 2024-09-17T01:41:34.700 DEBUG:teuthology.parallel:result is None 2024-09-17T01:41:34.702 INFO:tasks.ceph.mds.d:Started 2024-09-17T01:41:34.702 DEBUG:teuthology.parallel:result is None 2024-09-17T01:41:34.702 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T01:41:34.895 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:41:34.896 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:41:34.903 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-09-17T01:41:34.905 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-09-17T01:41:34.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.940+0000 7f7a6e200640 1 -- 172.21.15.42:0/2544211647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a6815fbe0 msgr2=0x7f7a6815c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:34.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.940+0000 7f7a6e200640 1 --2- 172.21.15.42:0/2544211647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a6815fbe0 0x7f7a6815c3c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009830 tx=0x7f7a5c02a520 comp rx=0 tx=0).stop 2024-09-17T01:41:34.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.940+0000 7f7a6e200640 1 -- 172.21.15.42:0/2544211647 shutdown_connections 2024-09-17T01:41:34.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.940+0000 7f7a6e200640 1 --2- 172.21.15.42:0/2544211647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a6815fbe0 0x7f7a6815c3c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:34.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.940+0000 7f7a6e200640 1 -- 172.21.15.42:0/2544211647 >> 172.21.15.42:0/2544211647 conn(0x7f7a68073f20 msgr2=0x7f7a6806cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:34.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.940+0000 7f7a6e200640 1 -- 172.21.15.42:0/2544211647 shutdown_connections 2024-09-17T01:41:34.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.940+0000 7f7a6e200640 1 -- 172.21.15.42:0/2544211647 wait complete. 2024-09-17T01:41:34.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.942+0000 7f7a6e200640 1 Processor -- start 2024-09-17T01:41:34.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.943+0000 7f7a6e200640 1 -- start start 2024-09-17T01:41:34.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.944+0000 7f7a6e200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7a6815fbe0 0x7f7a680b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:34.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.944+0000 7f7a6e200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a68162520 0x7f7a680b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:34.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.944+0000 7f7a6e200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a68162930 0x7f7a681f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:34.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.944+0000 7f7a6e200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7a680d0e80 con 0x7f7a68162520 2024-09-17T01:41:34.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.944+0000 7f7a6e200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7a680d0d00 con 0x7f7a68162930 2024-09-17T01:41:34.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.944+0000 7f7a6e200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7a680d1000 con 0x7f7a6815fbe0 2024-09-17T01:41:34.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.944+0000 7f7a67e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a68162520 0x7f7a680b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:34.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.944+0000 7f7a67e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a68162520 0x7f7a680b2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54928/0 (socket says 172.21.15.42:54928) 2024-09-17T01:41:34.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.944+0000 7f7a67e00640 1 -- 172.21.15.42:0/2921451379 learned_addr learned my addr 172.21.15.42:0/2921451379 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:34.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.945+0000 7f7a6ce00640 1 --2- 172.21.15.42:0/2921451379 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7a6815fbe0 0x7f7a680b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:34.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.945+0000 7f7a6d800640 1 --2- 172.21.15.42:0/2921451379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a68162930 0x7f7a681f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:34.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.945+0000 7f7a67e00640 1 -- 172.21.15.42:0/2921451379 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7a6815fbe0 msgr2=0x7f7a680b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:34.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.945+0000 7f7a67e00640 1 --2- 172.21.15.42:0/2921451379 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7a6815fbe0 0x7f7a680b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:34.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.945+0000 7f7a67e00640 1 -- 172.21.15.42:0/2921451379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a68162930 msgr2=0x7f7a681f5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:34.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.945+0000 7f7a67e00640 1 --2- 172.21.15.42:0/2921451379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a68162930 0x7f7a681f5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:34.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.945+0000 7f7a67e00640 1 -- 172.21.15.42:0/2921451379 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a680ca6f0 con 0x7f7a68162520 2024-09-17T01:41:34.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.945+0000 7f7a67e00640 1 --2- 172.21.15.42:0/2921451379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a68162520 0x7f7a680b2a40 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f7a54001220 tx=0x7f7a5400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:34.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.945+0000 7f7a64c00640 1 -- 172.21.15.42:0/2921451379 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a54011790 con 0x7f7a68162520 2024-09-17T01:41:34.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.946+0000 7f7a64c00640 1 -- 172.21.15.42:0/2921451379 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a54017070 con 0x7f7a68162520 2024-09-17T01:41:34.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.946+0000 7f7a6e200640 1 -- 172.21.15.42:0/2921451379 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a680ca9d0 con 0x7f7a68162520 2024-09-17T01:41:34.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.946+0000 7f7a64c00640 1 -- 172.21.15.42:0/2921451379 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a54011cc0 con 0x7f7a68162520 2024-09-17T01:41:34.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.946+0000 7f7a6e200640 1 -- 172.21.15.42:0/2921451379 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a680caf90 con 0x7f7a68162520 2024-09-17T01:41:34.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.947+0000 7f7a6e200640 1 -- 172.21.15.42:0/2921451379 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a680d1420 con 0x7f7a68162520 2024-09-17T01:41:34.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.948+0000 7f7a64c00640 1 -- 172.21.15.42:0/2921451379 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7a5401c460 con 0x7f7a68162520 2024-09-17T01:41:34.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.949+0000 7f7a64c00640 1 --2- 172.21.15.42:0/2921451379 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7a48078c10 0x7f7a4807b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:34.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.949+0000 7f7a64c00640 1 -- 172.21.15.42:0/2921451379 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 4943+0+0 (secure 0 0 0) 0x7f7a5409a830 con 0x7f7a68162520 2024-09-17T01:41:34.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.949+0000 7f7a6ce00640 1 --2- 172.21.15.42:0/2921451379 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7a48078c10 0x7f7a4807b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:34.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.950+0000 7f7a6ce00640 1 --2- 172.21.15.42:0/2921451379 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7a48078c10 0x7f7a4807b120 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c034000 tx=0x7f7a5c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:34.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:34.954+0000 7f7a64c00640 1 -- 172.21.15.42:0/2921451379 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7a54062f50 con 0x7f7a68162520 2024-09-17T01:41:35.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:35.159+0000 7f7a6e200640 1 -- 172.21.15.42:0/2921451379 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7a680ca480 con 0x7f7a68162520 2024-09-17T01:41:35.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:35.848+0000 7f7a64c00640 1 -- 172.21.15.42:0/2921451379 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v130) ==== 97+0+0 (secure 0 0 0) 0x7f7a54062850 con 0x7f7a68162520 2024-09-17T01:41:35.848 INFO:teuthology.orchestra.run.smithi042.stderr: removed all blocklist entries 2024-09-17T01:41:35.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:35.852+0000 7f7a6e200640 1 -- 172.21.15.42:0/2921451379 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7a48078c10 msgr2=0x7f7a4807b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:35.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:35.852+0000 7f7a6e200640 1 --2- 172.21.15.42:0/2921451379 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7a48078c10 0x7f7a4807b120 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c034000 tx=0x7f7a5c004730 comp rx=0 tx=0).stop 2024-09-17T01:41:35.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:35.852+0000 7f7a6e200640 1 -- 172.21.15.42:0/2921451379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a68162520 msgr2=0x7f7a680b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:35.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:35.852+0000 7f7a6e200640 1 --2- 172.21.15.42:0/2921451379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a68162520 0x7f7a680b2a40 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f7a54001220 tx=0x7f7a5400c890 comp rx=0 tx=0).stop 2024-09-17T01:41:35.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:35.852+0000 7f7a6e200640 1 -- 172.21.15.42:0/2921451379 shutdown_connections 2024-09-17T01:41:35.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:35.852+0000 7f7a6e200640 1 --2- 172.21.15.42:0/2921451379 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7a48078c10 0x7f7a4807b120 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:35.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:35.852+0000 7f7a6e200640 1 --2- 172.21.15.42:0/2921451379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a68162930 0x7f7a681f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:35.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:35.852+0000 7f7a6e200640 1 --2- 172.21.15.42:0/2921451379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a68162520 0x7f7a680b2a40 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:35.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:35.852+0000 7f7a6e200640 1 --2- 172.21.15.42:0/2921451379 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7a6815fbe0 0x7f7a680b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:35.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:35.852+0000 7f7a6e200640 1 -- 172.21.15.42:0/2921451379 >> 172.21.15.42:0/2921451379 conn(0x7f7a68073f20 msgr2=0x7f7a6815d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:35.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:35.853+0000 7f7a6e200640 1 -- 172.21.15.42:0/2921451379 shutdown_connections 2024-09-17T01:41:35.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:35.853+0000 7f7a6e200640 1 -- 172.21.15.42:0/2921451379 wait complete. 2024-09-17T01:41:35.881 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T01:41:36.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.112+0000 7f3691e00640 1 -- 172.21.15.42:0/2909628159 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f368c142f40 msgr2=0x7f368c072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:36.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.112+0000 7f3691e00640 1 --2- 172.21.15.42:0/2909628159 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f368c142f40 0x7f368c072950 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f3674005fd0 tx=0x7f367402a5f0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.112+0000 7f3691e00640 1 -- 172.21.15.42:0/2909628159 shutdown_connections 2024-09-17T01:41:36.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.112+0000 7f3691e00640 1 --2- 172.21.15.42:0/2909628159 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f368c142f40 0x7f368c072950 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.112+0000 7f3691e00640 1 -- 172.21.15.42:0/2909628159 >> 172.21.15.42:0/2909628159 conn(0x7f368c0b2930 msgr2=0x7f368c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:36.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.112+0000 7f3691e00640 1 -- 172.21.15.42:0/2909628159 shutdown_connections 2024-09-17T01:41:36.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.113+0000 7f3691e00640 1 -- 172.21.15.42:0/2909628159 wait complete. 2024-09-17T01:41:36.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.115+0000 7f3691e00640 1 Processor -- start 2024-09-17T01:41:36.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.115+0000 7f3691e00640 1 -- start start 2024-09-17T01:41:36.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.116+0000 7f3691e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f368c072e90 0x7f368c0aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:36.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.116+0000 7f3691e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f368c0b3550 0x7f368c167e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:36.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.116+0000 7f3691e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f368c142f40 0x7f368c141a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:36.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.116+0000 7f3691e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f368c06d900 con 0x7f368c142f40 2024-09-17T01:41:36.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.116+0000 7f3691e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f368c06d780 con 0x7f368c0b3550 2024-09-17T01:41:36.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.116+0000 7f3691e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f368c06da80 con 0x7f368c072e90 2024-09-17T01:41:36.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.116+0000 7f368b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f368c142f40 0x7f368c141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:36.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.117+0000 7f368b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f368c142f40 0x7f368c141a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34016/0 (socket says 172.21.15.42:34016) 2024-09-17T01:41:36.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.117+0000 7f368b400640 1 -- 172.21.15.42:0/2228499031 learned_addr learned my addr 172.21.15.42:0/2228499031 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:36.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.117+0000 7f3683e00640 1 --2- 172.21.15.42:0/2228499031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f368c0b3550 0x7f368c167e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:36.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.117+0000 7f368aa00640 1 --2- 172.21.15.42:0/2228499031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f368c072e90 0x7f368c0aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:36.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.117+0000 7f368b400640 1 -- 172.21.15.42:0/2228499031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f368c072e90 msgr2=0x7f368c0aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:36.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.117+0000 7f368b400640 1 --2- 172.21.15.42:0/2228499031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f368c072e90 0x7f368c0aa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.117+0000 7f368b400640 1 -- 172.21.15.42:0/2228499031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f368c0b3550 msgr2=0x7f368c167e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:36.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.117+0000 7f368b400640 1 --2- 172.21.15.42:0/2228499031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f368c0b3550 0x7f368c167e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.117+0000 7f368b400640 1 -- 172.21.15.42:0/2228499031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f368c1683b0 con 0x7f368c142f40 2024-09-17T01:41:36.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.117+0000 7f368aa00640 1 --2- 172.21.15.42:0/2228499031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f368c072e90 0x7f368c0aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:41:36.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.117+0000 7f368b400640 1 --2- 172.21.15.42:0/2228499031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f368c142f40 0x7f368c141a20 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f368400c730 tx=0x7f368400cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:36.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.118+0000 7f3683400640 1 -- 172.21.15.42:0/2228499031 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3684003b70 con 0x7f368c142f40 2024-09-17T01:41:36.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.118+0000 7f3683400640 1 -- 172.21.15.42:0/2228499031 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3684003d10 con 0x7f368c142f40 2024-09-17T01:41:36.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.118+0000 7f3683400640 1 -- 172.21.15.42:0/2228499031 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36840052d0 con 0x7f368c142f40 2024-09-17T01:41:36.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.118+0000 7f3691e00640 1 -- 172.21.15.42:0/2228499031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f368c0aade0 con 0x7f368c142f40 2024-09-17T01:41:36.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.118+0000 7f3691e00640 1 -- 172.21.15.42:0/2228499031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f368c157e60 con 0x7f368c142f40 2024-09-17T01:41:36.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.119+0000 7f3691e00640 1 -- 172.21.15.42:0/2228499031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f368c06a170 con 0x7f368c142f40 2024-09-17T01:41:36.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.120+0000 7f3683400640 1 -- 172.21.15.42:0/2228499031 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3684005470 con 0x7f368c142f40 2024-09-17T01:41:36.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.121+0000 7f3683400640 1 --2- 172.21.15.42:0/2228499031 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3668078bc0 0x7f366807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:36.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.121+0000 7f3683400640 1 -- 172.21.15.42:0/2228499031 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 4857+0+0 (secure 0 0 0) 0x7f368409a610 con 0x7f368c142f40 2024-09-17T01:41:36.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.122+0000 7f368aa00640 1 --2- 172.21.15.42:0/2228499031 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3668078bc0 0x7f366807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:36.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.122+0000 7f368aa00640 1 --2- 172.21.15.42:0/2228499031 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3668078bc0 0x7f366807b0d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f367c007fd0 tx=0x7f367c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:36.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.126+0000 7f3683400640 1 -- 172.21.15.42:0/2228499031 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3684062e20 con 0x7f368c142f40 2024-09-17T01:41:36.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.393+0000 7f3691e00640 1 -- 172.21.15.42:0/2228499031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f368c15af70 con 0x7f368c142f40 2024-09-17T01:41:36.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.394+0000 7f3683400640 1 -- 172.21.15.42:0/2228499031 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v36) ==== 80+0+5304 (secure 0 0 0) 0x7f3684062720 con 0x7f368c142f40 2024-09-17T01:41:36.393 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:41:36.393 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:41:36.393 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_dump": [ 2024-09-17T01:41:36.393 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:41:36.394 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.a", 2024-09-17T01:41:36.394 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmyJK4HRAAIC4E4V7p1fqIEfPIICMxZg==", 2024-09-17T01:41:36.394 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:41:36.394 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:41:36.394 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:41:36.394 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:41:36.394 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:41:36.394 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:36.394 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:41:36.394 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:41:36.394 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.b", 2024-09-17T01:41:36.394 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmXv3vORAALPrYIM6Vtz0g1pOxVhrUig==", 2024-09-17T01:41:36.394 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:41:36.394 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:41:36.395 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:41:36.395 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:41:36.395 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:41:36.395 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:36.395 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:41:36.395 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:41:36.395 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.c", 2024-09-17T01:41:36.395 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmPE7MKxAA9mGG+EO9C3VGVMerOm92+Q==", 2024-09-17T01:41:36.395 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:41:36.395 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:41:36.395 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:41:36.395 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:41:36.396 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:41:36.396 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:36.396 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:41:36.396 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:41:36.396 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.d", 2024-09-17T01:41:36.396 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmaOBSDBAATU4tpjM5IMcuvzZFE7N5bQ==", 2024-09-17T01:41:36.396 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:41:36.396 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:41:36.396 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:41:36.396 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:41:36.396 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:41:36.396 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:36.396 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:41:36.396 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:41:36.397 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.0", 2024-09-17T01:41:36.397 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDP2+hmEJebExAAAdGEoSzM96ybGT9h7t7OkA==", 2024-09-17T01:41:36.397 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:41:36.397 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:41:36.397 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:41:36.397 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:41:36.397 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:36.397 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:41:36.397 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:41:36.397 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.1", 2024-09-17T01:41:36.397 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDS2+hm7dWoMBAAagktrUl0O2/mgKCEfpAstA==", 2024-09-17T01:41:36.397 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:41:36.397 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:41:36.398 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:41:36.398 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:41:36.398 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:36.398 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:41:36.398 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:41:36.398 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.2", 2024-09-17T01:41:36.398 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDW2+hmEfSPBBAAPAa6EZt27yUcJSfZyCKheg==", 2024-09-17T01:41:36.398 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:41:36.398 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:41:36.398 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:41:36.398 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:41:36.398 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:36.398 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:41:36.398 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:41:36.399 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.3", 2024-09-17T01:41:36.399 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDZ2+hmHQhXFRAAj84g+IKqH6KMP7LjRtFvLw==", 2024-09-17T01:41:36.399 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:41:36.399 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:41:36.399 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:41:36.399 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:41:36.399 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:36.399 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:41:36.399 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:41:36.399 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.4", 2024-09-17T01:41:36.399 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDd2+hmaNcMNBAAx1GV/oFdfssMjFWFN5M0VQ==", 2024-09-17T01:41:36.399 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:41:36.399 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:41:36.400 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:41:36.400 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:41:36.400 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:36.400 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:41:36.400 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:41:36.400 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.5", 2024-09-17T01:41:36.400 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDh2+hm301NJhAAnSUH5AAvqhPwM7loH6frww==", 2024-09-17T01:41:36.400 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:41:36.400 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:41:36.400 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:41:36.400 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:41:36.400 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:36.400 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:41:36.400 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:41:36.401 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.6", 2024-09-17T01:41:36.401 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDk2+hm61WNNRAAbCvVvsUpB4fgt4ja60DRZA==", 2024-09-17T01:41:36.401 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:41:36.401 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:41:36.401 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:41:36.401 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:41:36.401 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:36.401 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:41:36.401 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:41:36.401 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.7", 2024-09-17T01:41:36.401 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDo2+hmesiLFhAA29n1eageNvP+lkRyh6gGMw==", 2024-09-17T01:41:36.401 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:41:36.401 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:41:36.402 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:41:36.402 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:41:36.402 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:36.402 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:41:36.402 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:41:36.402 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.0", 2024-09-17T01:41:36.402 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA==", 2024-09-17T01:41:36.402 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:41:36.402 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:41:36.402 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow r", 2024-09-17T01:41:36.402 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T01:41:36.402 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:36.402 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:41:36.402 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:41:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.1", 2024-09-17T01:41:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmZLygLhAABlauZgnidFWvfCCPuBLObg==", 2024-09-17T01:41:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:41:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:41:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:41:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:41:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:41:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:41:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:41:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.2", 2024-09-17T01:41:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hm8lnZIxAAN0a2CVMMtu/Nz50OG4a02A==", 2024-09-17T01:41:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:41:36.403 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:41:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:41:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:41:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:41:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:41:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:41:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.3", 2024-09-17T01:41:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmgXdAORAAM5Uy66I4nnTJ9Vhkn9JoBw==", 2024-09-17T01:41:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:41:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:41:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:41:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:41:36.404 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:41:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:41:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:41:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.admin", 2024-09-17T01:41:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDL2+hmvCreHBAA4CSAhosssViGqD93U+I7Iw==", 2024-09-17T01:41:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:41:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:41:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:41:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:41:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:41:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:41:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:41:36.405 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.x", 2024-09-17T01:41:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmYPnlEhAAIcQ11ktWZyMXYdbAONiLog==", 2024-09-17T01:41:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:41:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:41:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:41:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:41:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:41:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:41:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.y", 2024-09-17T01:41:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmpCZtBxAAp5tXMc6aEq1aOny2LJZAiA==", 2024-09-17T01:41:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:41:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:41:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:41:36.406 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:41:36.407 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:36.407 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:36.407 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-17T01:41:36.407 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:41:36.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.396+0000 7f3691e00640 1 -- 172.21.15.42:0/2228499031 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3668078bc0 msgr2=0x7f366807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:36.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.396+0000 7f3691e00640 1 --2- 172.21.15.42:0/2228499031 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3668078bc0 0x7f366807b0d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f367c007fd0 tx=0x7f367c009040 comp rx=0 tx=0).stop 2024-09-17T01:41:36.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.396+0000 7f3691e00640 1 -- 172.21.15.42:0/2228499031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f368c142f40 msgr2=0x7f368c141a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:36.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.396+0000 7f3691e00640 1 --2- 172.21.15.42:0/2228499031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f368c142f40 0x7f368c141a20 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f368400c730 tx=0x7f368400cb30 comp rx=0 tx=0).stop 2024-09-17T01:41:36.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.396+0000 7f3691e00640 1 -- 172.21.15.42:0/2228499031 shutdown_connections 2024-09-17T01:41:36.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.396+0000 7f3691e00640 1 --2- 172.21.15.42:0/2228499031 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3668078bc0 0x7f366807b0d0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.396+0000 7f3691e00640 1 --2- 172.21.15.42:0/2228499031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f368c0b3550 0x7f368c167e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.396+0000 7f3691e00640 1 --2- 172.21.15.42:0/2228499031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f368c142f40 0x7f368c141a20 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.396+0000 7f3691e00640 1 --2- 172.21.15.42:0/2228499031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f368c072e90 0x7f368c0aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.396+0000 7f3691e00640 1 -- 172.21.15.42:0/2228499031 >> 172.21.15.42:0/2228499031 conn(0x7f368c0b2930 msgr2=0x7f368c15efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:36.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.397+0000 7f3691e00640 1 -- 172.21.15.42:0/2228499031 shutdown_connections 2024-09-17T01:41:36.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.397+0000 7f3691e00640 1 -- 172.21.15.42:0/2228499031 wait complete. 2024-09-17T01:41:36.418 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T01:41:36.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.645+0000 7fb772800640 1 -- 172.21.15.42:0/763348594 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb76c162500 msgr2=0x7fb76c162910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:36.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.645+0000 7fb772800640 1 --2- 172.21.15.42:0/763348594 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb76c162500 0x7fb76c162910 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fb76c06dd30 tx=0x7fb76402aa10 comp rx=0 tx=0).stop 2024-09-17T01:41:36.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.645+0000 7fb772800640 1 -- 172.21.15.42:0/763348594 shutdown_connections 2024-09-17T01:41:36.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.645+0000 7fb772800640 1 --2- 172.21.15.42:0/763348594 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb76c162500 0x7fb76c162910 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.645+0000 7fb772800640 1 --2- 172.21.15.42:0/763348594 >> v2:172.21.15.43:3300/0 conn(0x7fb76c0cfba0 0x7fb76c0b9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.645+0000 7fb772800640 1 -- 172.21.15.42:0/763348594 >> 172.21.15.42:0/763348594 conn(0x7fb76c0b6140 msgr2=0x7fb76c0b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:36.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.645+0000 7fb772800640 1 -- 172.21.15.42:0/763348594 shutdown_connections 2024-09-17T01:41:36.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.645+0000 7fb772800640 1 -- 172.21.15.42:0/763348594 wait complete. 2024-09-17T01:41:36.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.647+0000 7fb772800640 1 Processor -- start 2024-09-17T01:41:36.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.647+0000 7fb772800640 1 -- start start 2024-09-17T01:41:36.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.649+0000 7fb772800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb76c0cfba0 0x7fb76c158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:36.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.649+0000 7fb772800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb76c0d0e10 0x7fb76c1f8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:36.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.649+0000 7fb772800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb76c162500 0x7fb76c1f9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:36.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.649+0000 7fb772800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c0b31e0 con 0x7fb76c0d0e10 2024-09-17T01:41:36.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.649+0000 7fb772800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c0b3060 con 0x7fb76c162500 2024-09-17T01:41:36.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.649+0000 7fb772800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb76c0b3360 con 0x7fb76c0cfba0 2024-09-17T01:41:36.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.649+0000 7fb770a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb76c0d0e10 0x7fb76c1f8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:36.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.649+0000 7fb770a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb76c0d0e10 0x7fb76c1f8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34026/0 (socket says 172.21.15.42:34026) 2024-09-17T01:41:36.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.649+0000 7fb770a00640 1 -- 172.21.15.42:0/3426423919 learned_addr learned my addr 172.21.15.42:0/3426423919 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:36.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.649+0000 7fb771400640 1 --2- 172.21.15.42:0/3426423919 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb76c0cfba0 0x7fb76c158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:36.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.649+0000 7fb771e00640 1 --2- 172.21.15.42:0/3426423919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb76c162500 0x7fb76c1f9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:36.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.649+0000 7fb770a00640 1 -- 172.21.15.42:0/3426423919 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb76c0cfba0 msgr2=0x7fb76c158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:36.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.649+0000 7fb770a00640 1 --2- 172.21.15.42:0/3426423919 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb76c0cfba0 0x7fb76c158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.649+0000 7fb770a00640 1 -- 172.21.15.42:0/3426423919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb76c162500 msgr2=0x7fb76c1f9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:36.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.649+0000 7fb770a00640 1 --2- 172.21.15.42:0/3426423919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb76c162500 0x7fb76c1f9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.649+0000 7fb770a00640 1 -- 172.21.15.42:0/3426423919 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb76c1f6660 con 0x7fb76c0d0e10 2024-09-17T01:41:36.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.650+0000 7fb770a00640 1 --2- 172.21.15.42:0/3426423919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb76c0d0e10 0x7fb76c1f8e10 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fb758009fd0 tx=0x7fb75800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:36.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.650+0000 7fb769600640 1 -- 172.21.15.42:0/3426423919 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb758015030 con 0x7fb76c0d0e10 2024-09-17T01:41:36.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.650+0000 7fb769600640 1 -- 172.21.15.42:0/3426423919 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb758004020 con 0x7fb76c0d0e10 2024-09-17T01:41:36.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.650+0000 7fb772800640 1 -- 172.21.15.42:0/3426423919 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb76c1f9bd0 con 0x7fb76c0d0e10 2024-09-17T01:41:36.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.650+0000 7fb769600640 1 -- 172.21.15.42:0/3426423919 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb758004470 con 0x7fb76c0d0e10 2024-09-17T01:41:36.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.650+0000 7fb772800640 1 -- 172.21.15.42:0/3426423919 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb76c1f5b80 con 0x7fb76c0d0e10 2024-09-17T01:41:36.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.651+0000 7fb772800640 1 -- 172.21.15.42:0/3426423919 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb76c0d1c70 con 0x7fb76c0d0e10 2024-09-17T01:41:36.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.652+0000 7fb769600640 1 -- 172.21.15.42:0/3426423919 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb758018070 con 0x7fb76c0d0e10 2024-09-17T01:41:36.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.653+0000 7fb769600640 1 --2- 172.21.15.42:0/3426423919 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb74c078b90 0x7fb74c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:36.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.654+0000 7fb769600640 1 -- 172.21.15.42:0/3426423919 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 4857+0+0 (secure 0 0 0) 0x7fb758099fe0 con 0x7fb76c0d0e10 2024-09-17T01:41:36.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.654+0000 7fb771400640 1 --2- 172.21.15.42:0/3426423919 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb74c078b90 0x7fb74c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:36.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.655+0000 7fb771400640 1 --2- 172.21.15.42:0/3426423919 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb74c078b90 0x7fb74c07b0a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb76000bb50 tx=0x7fb76000b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:36.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.658+0000 7fb769600640 1 -- 172.21.15.42:0/3426423919 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb76c0d1c70 con 0x7fb76c0d0e10 2024-09-17T01:41:36.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.855+0000 7fb772800640 1 -- 172.21.15.42:0/3426423919 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb76c0b3830 con 0x7fb76c0d0e10 2024-09-17T01:41:36.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.856+0000 7fb769600640 1 -- 172.21.15.42:0/3426423919 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v132) ==== 84+0+65 (secure 0 0 0) 0x7fb7580621a0 con 0x7fb76c0d0e10 2024-09-17T01:41:36.855 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:41:36.855 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-09-17T01:41:36.855 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:41:36.855 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-09-17T01:41:36.855 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-09-17T01:41:36.855 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:41:36.855 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-09-17T01:41:36.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.858+0000 7fb772800640 1 -- 172.21.15.42:0/3426423919 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb74c078b90 msgr2=0x7fb74c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:36.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.858+0000 7fb772800640 1 --2- 172.21.15.42:0/3426423919 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb74c078b90 0x7fb74c07b0a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb76000bb50 tx=0x7fb76000b2e0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.858+0000 7fb772800640 1 -- 172.21.15.42:0/3426423919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb76c0d0e10 msgr2=0x7fb76c1f8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:36.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.858+0000 7fb772800640 1 --2- 172.21.15.42:0/3426423919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb76c0d0e10 0x7fb76c1f8e10 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fb758009fd0 tx=0x7fb75800b870 comp rx=0 tx=0).stop 2024-09-17T01:41:36.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.858+0000 7fb772800640 1 -- 172.21.15.42:0/3426423919 shutdown_connections 2024-09-17T01:41:36.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.858+0000 7fb772800640 1 --2- 172.21.15.42:0/3426423919 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb74c078b90 0x7fb74c07b0a0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.858+0000 7fb772800640 1 --2- 172.21.15.42:0/3426423919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb76c162500 0x7fb76c1f9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.858+0000 7fb772800640 1 --2- 172.21.15.42:0/3426423919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb76c0d0e10 0x7fb76c1f8e10 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.858+0000 7fb772800640 1 --2- 172.21.15.42:0/3426423919 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb76c0cfba0 0x7fb76c158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.858+0000 7fb772800640 1 -- 172.21.15.42:0/3426423919 >> 172.21.15.42:0/3426423919 conn(0x7fb76c0b6140 msgr2=0x7fb76c0d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:36.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.858+0000 7fb772800640 1 -- 172.21.15.42:0/3426423919 shutdown_connections 2024-09-17T01:41:36.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:36.858+0000 7fb772800640 1 -- 172.21.15.42:0/3426423919 wait complete. 2024-09-17T01:41:36.879 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T01:41:36.879 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T01:41:37.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.113+0000 7f7517000640 1 -- 172.21.15.42:0/2685865733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74f8005210 msgr2=0x7f74f800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:37.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.113+0000 7f7517000640 1 --2- 172.21.15.42:0/2685865733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74f8005210 0x7f74f800b9c0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f7508006f70 tx=0x7f74f8005830 comp rx=0 tx=0).stop 2024-09-17T01:41:37.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.113+0000 7f7516600640 1 -- 172.21.15.42:0/2685865733 reap_dead start 2024-09-17T01:41:37.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.113+0000 7f7517000640 1 -- 172.21.15.42:0/2685865733 shutdown_connections 2024-09-17T01:41:37.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.113+0000 7f7517000640 1 -- 172.21.15.42:0/2685865733 >> 172.21.15.42:0/2685865733 conn(0x7f75100b25d0 msgr2=0x7f75100d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:37.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.113+0000 7f7517000640 1 -- 172.21.15.42:0/2685865733 shutdown_connections 2024-09-17T01:41:37.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.113+0000 7f7517000640 1 -- 172.21.15.42:0/2685865733 wait complete. 2024-09-17T01:41:37.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.116+0000 7f7517000640 1 Processor -- start 2024-09-17T01:41:37.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.116+0000 7f7517000640 1 -- start start 2024-09-17T01:41:37.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.117+0000 7f7517000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74f8005210 0x7f751015f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:37.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.117+0000 7f7517000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75101555d0 0x7f75101f5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:37.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.117+0000 7f7517000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75100c9180 0x7f75100c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:37.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.117+0000 7f7517000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f75100afb30 con 0x7f75100c9180 2024-09-17T01:41:37.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.117+0000 7f7517000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f751006d680 con 0x7f75101555d0 2024-09-17T01:41:37.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.117+0000 7f7517000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f75100cf120 con 0x7f74f8005210 2024-09-17T01:41:37.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.117+0000 7f7516600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75100c9180 0x7f75100c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:37.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.117+0000 7f7516600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75100c9180 0x7f75100c9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34052/0 (socket says 172.21.15.42:34052) 2024-09-17T01:41:37.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.117+0000 7f7516600640 1 -- 172.21.15.42:0/524856923 learned_addr learned my addr 172.21.15.42:0/524856923 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:37.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.118+0000 7f7515c00640 1 --2- 172.21.15.42:0/524856923 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74f8005210 0x7f751015f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:37.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.118+0000 7f7515200640 1 --2- 172.21.15.42:0/524856923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75101555d0 0x7f75101f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:37.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.118+0000 7f7516600640 1 -- 172.21.15.42:0/524856923 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74f8005210 msgr2=0x7f751015f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:37.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.118+0000 7f7516600640 1 --2- 172.21.15.42:0/524856923 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74f8005210 0x7f751015f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:37.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.118+0000 7f7516600640 1 -- 172.21.15.42:0/524856923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75101555d0 msgr2=0x7f75101f5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:37.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.118+0000 7f7516600640 1 --2- 172.21.15.42:0/524856923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75101555d0 0x7f75101f5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:37.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.118+0000 7f7516600640 1 -- 172.21.15.42:0/524856923 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751015f570 con 0x7f75100c9180 2024-09-17T01:41:37.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.118+0000 7f7516600640 1 --2- 172.21.15.42:0/524856923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75100c9180 0x7f75100c9590 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f750800c350 tx=0x7f7508006bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:37.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.118+0000 7f750d600640 1 -- 172.21.15.42:0/524856923 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7508032030 con 0x7f75100c9180 2024-09-17T01:41:37.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.118+0000 7f750d600640 1 -- 172.21.15.42:0/524856923 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7508003900 con 0x7f75100c9180 2024-09-17T01:41:37.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.118+0000 7f750d600640 1 -- 172.21.15.42:0/524856923 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7508003d50 con 0x7f75100c9180 2024-09-17T01:41:37.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.119+0000 7f7517000640 1 -- 172.21.15.42:0/524856923 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75101f6370 con 0x7f75100c9180 2024-09-17T01:41:37.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.119+0000 7f7517000640 1 -- 172.21.15.42:0/524856923 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75100c8980 con 0x7f75100c9180 2024-09-17T01:41:37.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.120+0000 7f7517000640 1 -- 172.21.15.42:0/524856923 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75100c8770 con 0x7f75100c9180 2024-09-17T01:41:37.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.121+0000 7f750d600640 1 -- 172.21.15.42:0/524856923 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7508035020 con 0x7f75100c9180 2024-09-17T01:41:37.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.122+0000 7f750d600640 1 --2- 172.21.15.42:0/524856923 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74f0078b90 0x7f74f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:37.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.122+0000 7f750d600640 1 -- 172.21.15.42:0/524856923 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 4857+0+0 (secure 0 0 0) 0x7f75080ba120 con 0x7f75100c9180 2024-09-17T01:41:37.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.122+0000 7f7515c00640 1 --2- 172.21.15.42:0/524856923 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74f0078b90 0x7f74f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:37.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.123+0000 7f7515c00640 1 --2- 172.21.15.42:0/524856923 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74f0078b90 0x7f74f007b0a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7504000f80 tx=0x7f7504006e90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:37.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.127+0000 7f750d600640 1 -- 172.21.15.42:0/524856923 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7508047020 con 0x7f75100c9180 2024-09-17T01:41:37.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.320+0000 7f7517000640 1 -- 172.21.15.42:0/524856923 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f75101f6100 con 0x7f75100c9180 2024-09-17T01:41:37.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.854+0000 7f750d600640 1 -- 172.21.15.42:0/524856923 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v133) ==== 138+0+0 (secure 0 0 0) 0x7f750803d070 con 0x7f75100c9180 2024-09-17T01:41:37.853 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-09-17T01:41:37.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.859+0000 7f7517000640 1 -- 172.21.15.42:0/524856923 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74f0078b90 msgr2=0x7f74f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:37.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.859+0000 7f7517000640 1 --2- 172.21.15.42:0/524856923 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74f0078b90 0x7f74f007b0a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7504000f80 tx=0x7f7504006e90 comp rx=0 tx=0).stop 2024-09-17T01:41:37.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.859+0000 7f7517000640 1 -- 172.21.15.42:0/524856923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75100c9180 msgr2=0x7f75100c9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:37.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.859+0000 7f7517000640 1 --2- 172.21.15.42:0/524856923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75100c9180 0x7f75100c9590 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f750800c350 tx=0x7f7508006bc0 comp rx=0 tx=0).stop 2024-09-17T01:41:37.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.859+0000 7f7517000640 1 -- 172.21.15.42:0/524856923 shutdown_connections 2024-09-17T01:41:37.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.859+0000 7f7517000640 1 --2- 172.21.15.42:0/524856923 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f74f0078b90 0x7f74f007b0a0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:37.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.859+0000 7f7517000640 1 --2- 172.21.15.42:0/524856923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75101555d0 0x7f75101f5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:37.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.859+0000 7f7517000640 1 --2- 172.21.15.42:0/524856923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75100c9180 0x7f75100c9590 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:37.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.859+0000 7f7517000640 1 --2- 172.21.15.42:0/524856923 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f74f8005210 0x7f751015f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:37.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.859+0000 7f7517000640 1 -- 172.21.15.42:0/524856923 >> 172.21.15.42:0/524856923 conn(0x7f75100b25d0 msgr2=0x7f75100ccbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:37.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.859+0000 7f7517000640 1 -- 172.21.15.42:0/524856923 shutdown_connections 2024-09-17T01:41:37.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:37.859+0000 7f7517000640 1 -- 172.21.15.42:0/524856923 wait complete. 2024-09-17T01:41:37.891 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T01:41:38.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.131+0000 7f72ebe00640 1 -- 172.21.15.42:0/3806664370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72ec0cf230 msgr2=0x7f72ec0cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:38.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.131+0000 7f72ebe00640 1 --2- 172.21.15.42:0/3806664370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72ec0cf230 0x7f72ec0cf640 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0afcc0 tx=0x7f72d802a5f0 comp rx=0 tx=0).stop 2024-09-17T01:41:38.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.131+0000 7f72ebe00640 1 -- 172.21.15.42:0/3806664370 shutdown_connections 2024-09-17T01:41:38.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.131+0000 7f72ebe00640 1 --2- 172.21.15.42:0/3806664370 >> v2:172.21.15.43:3300/0 conn(0x7f72ec0b30a0 0x7f72ec0b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:38.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.131+0000 7f72ebe00640 1 --2- 172.21.15.42:0/3806664370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72ec0cf230 0x7f72ec0cf640 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:38.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.131+0000 7f72ebe00640 1 -- 172.21.15.42:0/3806664370 >> 172.21.15.42:0/3806664370 conn(0x7f72ec0b25f0 msgr2=0x7f72ec0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:38.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.131+0000 7f72ebe00640 1 -- 172.21.15.42:0/3806664370 shutdown_connections 2024-09-17T01:41:38.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.131+0000 7f72ebe00640 1 -- 172.21.15.42:0/3806664370 wait complete. 2024-09-17T01:41:38.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.133+0000 7f72ebe00640 1 Processor -- start 2024-09-17T01:41:38.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.134+0000 7f72ebe00640 1 -- start start 2024-09-17T01:41:38.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.135+0000 7f72ebe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72ec06cd20 0x7f72ec153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:38.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.135+0000 7f72ebe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72ec0b30a0 0x7f72ec09da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:38.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.135+0000 7f72ebe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72ec0cf230 0x7f72ec073750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:38.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.135+0000 7f72ebe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f72ec070470 con 0x7f72ec0cf230 2024-09-17T01:41:38.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.135+0000 7f72ebe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f72ec0702f0 con 0x7f72ec06cd20 2024-09-17T01:41:38.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.135+0000 7f72ebe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f72ec0b39f0 con 0x7f72ec0b30a0 2024-09-17T01:41:38.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.135+0000 7f72eb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72ec0cf230 0x7f72ec073750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:38.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.135+0000 7f72eb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72ec0cf230 0x7f72ec073750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34078/0 (socket says 172.21.15.42:34078) 2024-09-17T01:41:38.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.135+0000 7f72eb400640 1 -- 172.21.15.42:0/3206119918 learned_addr learned my addr 172.21.15.42:0/3206119918 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:38.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.136+0000 7f72eaa00640 1 --2- 172.21.15.42:0/3206119918 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72ec06cd20 0x7f72ec153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:38.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.136+0000 7f72ea000640 1 --2- 172.21.15.42:0/3206119918 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72ec0b30a0 0x7f72ec09da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:38.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.136+0000 7f72eb400640 1 -- 172.21.15.42:0/3206119918 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72ec0b30a0 msgr2=0x7f72ec09da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:38.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.136+0000 7f72eb400640 1 --2- 172.21.15.42:0/3206119918 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72ec0b30a0 0x7f72ec09da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:38.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.136+0000 7f72eb400640 1 -- 172.21.15.42:0/3206119918 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72ec06cd20 msgr2=0x7f72ec153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:38.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.136+0000 7f72eb400640 1 --2- 172.21.15.42:0/3206119918 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72ec06cd20 0x7f72ec153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:38.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.136+0000 7f72eb400640 1 -- 172.21.15.42:0/3206119918 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72ec1539c0 con 0x7f72ec0cf230 2024-09-17T01:41:38.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.136+0000 7f72eb400640 1 --2- 172.21.15.42:0/3206119918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72ec0cf230 0x7f72ec073750 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f72e400ea80 tx=0x7f72e400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:38.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.136+0000 7f72e2a00640 1 -- 172.21.15.42:0/3206119918 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e4004b20 con 0x7f72ec0cf230 2024-09-17T01:41:38.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.137+0000 7f72e2a00640 1 -- 172.21.15.42:0/3206119918 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72e4004ce0 con 0x7f72ec0cf230 2024-09-17T01:41:38.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.137+0000 7f72e2a00640 1 -- 172.21.15.42:0/3206119918 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e4005280 con 0x7f72ec0cf230 2024-09-17T01:41:38.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.137+0000 7f72ebe00640 1 -- 172.21.15.42:0/3206119918 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72ec153ca0 con 0x7f72ec0cf230 2024-09-17T01:41:38.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.137+0000 7f72ebe00640 1 -- 172.21.15.42:0/3206119918 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72ec09d230 con 0x7f72ec0cf230 2024-09-17T01:41:38.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.138+0000 7f72ebe00640 1 -- 172.21.15.42:0/3206119918 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72ec070b10 con 0x7f72ec0cf230 2024-09-17T01:41:38.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.139+0000 7f72e2a00640 1 -- 172.21.15.42:0/3206119918 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f72e4005420 con 0x7f72ec0cf230 2024-09-17T01:41:38.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.140+0000 7f72e2a00640 1 --2- 172.21.15.42:0/3206119918 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f72cc078bc0 0x7f72cc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:38.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.141+0000 7f72e2a00640 1 -- 172.21.15.42:0/3206119918 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5227+0+0 (secure 0 0 0) 0x7f72e409b730 con 0x7f72ec0cf230 2024-09-17T01:41:38.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.141+0000 7f72eaa00640 1 --2- 172.21.15.42:0/3206119918 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f72cc078bc0 0x7f72cc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:38.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.142+0000 7f72eaa00640 1 --2- 172.21.15.42:0/3206119918 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f72cc078bc0 0x7f72cc07b0d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f72dc001720 tx=0x7f72dc009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:38.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.146+0000 7f72e2a00640 1 -- 172.21.15.42:0/3206119918 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f72ec070b10 con 0x7f72ec0cf230 2024-09-17T01:41:38.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.339+0000 7f72ebe00640 1 -- 172.21.15.42:0/3206119918 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f72ec153750 con 0x7f72ec0cf230 2024-09-17T01:41:38.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.857+0000 7f72e2a00640 1 -- 172.21.15.42:0/3206119918 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v134) ==== 170+0+0 (secure 0 0 0) 0x7f72e40636f0 con 0x7f72ec0cf230 2024-09-17T01:41:38.856 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-09-17T01:41:38.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.861+0000 7f72ebe00640 1 -- 172.21.15.42:0/3206119918 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f72cc078bc0 msgr2=0x7f72cc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:38.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.861+0000 7f72ebe00640 1 --2- 172.21.15.42:0/3206119918 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f72cc078bc0 0x7f72cc07b0d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f72dc001720 tx=0x7f72dc009040 comp rx=0 tx=0).stop 2024-09-17T01:41:38.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.861+0000 7f72ebe00640 1 -- 172.21.15.42:0/3206119918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72ec0cf230 msgr2=0x7f72ec073750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:38.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.861+0000 7f72ebe00640 1 --2- 172.21.15.42:0/3206119918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72ec0cf230 0x7f72ec073750 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f72e400ea80 tx=0x7f72e400ef40 comp rx=0 tx=0).stop 2024-09-17T01:41:38.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.861+0000 7f72ebe00640 1 -- 172.21.15.42:0/3206119918 shutdown_connections 2024-09-17T01:41:38.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.861+0000 7f72ebe00640 1 --2- 172.21.15.42:0/3206119918 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f72cc078bc0 0x7f72cc07b0d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:38.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.861+0000 7f72ebe00640 1 --2- 172.21.15.42:0/3206119918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72ec0cf230 0x7f72ec073750 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:38.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.861+0000 7f72ebe00640 1 --2- 172.21.15.42:0/3206119918 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72ec0b30a0 0x7f72ec09da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:38.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.861+0000 7f72ebe00640 1 --2- 172.21.15.42:0/3206119918 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72ec06cd20 0x7f72ec153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:38.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.861+0000 7f72ebe00640 1 -- 172.21.15.42:0/3206119918 >> 172.21.15.42:0/3206119918 conn(0x7f72ec0b25f0 msgr2=0x7f72ec0ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:38.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.861+0000 7f72ebe00640 1 -- 172.21.15.42:0/3206119918 shutdown_connections 2024-09-17T01:41:38.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:38.861+0000 7f72ebe00640 1 -- 172.21.15.42:0/3206119918 wait complete. 2024-09-17T01:41:38.901 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T01:41:39.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.134+0000 7f7d84c00640 1 -- 172.21.15.42:0/338710457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d64004800 msgr2=0x7f7d64004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:39.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.134+0000 7f7d84c00640 1 --2- 172.21.15.42:0/338710457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d64004800 0x7f7d64004c10 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f7d680016c0 tx=0x7f7d64005830 comp rx=0 tx=0).stop 2024-09-17T01:41:39.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.134+0000 7f7d84c00640 1 -- 172.21.15.42:0/338710457 shutdown_connections 2024-09-17T01:41:39.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.134+0000 7f7d84c00640 1 --2- 172.21.15.42:0/338710457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d64004800 0x7f7d64004c10 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:39.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.134+0000 7f7d84c00640 1 -- 172.21.15.42:0/338710457 >> 172.21.15.42:0/338710457 conn(0x7f7d8006d890 msgr2=0x7f7d800b2330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:39.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.134+0000 7f7d84c00640 1 -- 172.21.15.42:0/338710457 shutdown_connections 2024-09-17T01:41:39.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.134+0000 7f7d84c00640 1 -- 172.21.15.42:0/338710457 wait complete. 2024-09-17T01:41:39.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.136+0000 7f7d84c00640 1 Processor -- start 2024-09-17T01:41:39.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.137+0000 7f7d84c00640 1 -- start start 2024-09-17T01:41:39.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.138+0000 7f7d84c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d64004800 0x7f7d801e9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:39.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.138+0000 7f7d84c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d801542b0 0x7f7d80153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:39.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.138+0000 7f7d84c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d800aee30 0x7f7d800af240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:39.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.138+0000 7f7d84c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7d80073dc0 con 0x7f7d801542b0 2024-09-17T01:41:39.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.138+0000 7f7d84c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7d80073c40 con 0x7f7d800aee30 2024-09-17T01:41:39.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.138+0000 7f7d84c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7d80073f40 con 0x7f7d64004800 2024-09-17T01:41:39.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.138+0000 7f7d76a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d801542b0 0x7f7d80153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:39.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.138+0000 7f7d76a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d801542b0 0x7f7d80153c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34096/0 (socket says 172.21.15.42:34096) 2024-09-17T01:41:39.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.138+0000 7f7d76a00640 1 -- 172.21.15.42:0/1413542704 learned_addr learned my addr 172.21.15.42:0/1413542704 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:39.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.139+0000 7f7d76a00640 1 -- 172.21.15.42:0/1413542704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d64004800 msgr2=0x7f7d801e9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:39.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.139+0000 7f7d7fe00640 1 --2- 172.21.15.42:0/1413542704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d800aee30 0x7f7d800af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:39.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.139+0000 7f7d7f400640 1 --2- 172.21.15.42:0/1413542704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d64004800 0x7f7d801e9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:39.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.139+0000 7f7d76a00640 1 --2- 172.21.15.42:0/1413542704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d64004800 0x7f7d801e9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:39.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.139+0000 7f7d76a00640 1 -- 172.21.15.42:0/1413542704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d800aee30 msgr2=0x7f7d800af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:39.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.139+0000 7f7d76a00640 1 --2- 172.21.15.42:0/1413542704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d800aee30 0x7f7d800af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:39.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.139+0000 7f7d76a00640 1 -- 172.21.15.42:0/1413542704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d800af780 con 0x7f7d801542b0 2024-09-17T01:41:39.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.139+0000 7f7d7fe00640 1 --2- 172.21.15.42:0/1413542704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d800aee30 0x7f7d800af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:41:39.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.139+0000 7f7d7f400640 1 --2- 172.21.15.42:0/1413542704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d64004800 0x7f7d801e9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:41:39.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.139+0000 7f7d76a00640 1 --2- 172.21.15.42:0/1413542704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d801542b0 0x7f7d80153c00 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f7d6802a8e0 tx=0x7f7d680063a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:39.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.139+0000 7f7d77e00640 1 -- 172.21.15.42:0/1413542704 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d68003a00 con 0x7f7d801542b0 2024-09-17T01:41:39.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.139+0000 7f7d77e00640 1 -- 172.21.15.42:0/1413542704 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d68039070 con 0x7f7d801542b0 2024-09-17T01:41:39.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.139+0000 7f7d84c00640 1 -- 172.21.15.42:0/1413542704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d800b5530 con 0x7f7d801542b0 2024-09-17T01:41:39.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.140+0000 7f7d77e00640 1 -- 172.21.15.42:0/1413542704 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d68033420 con 0x7f7d801542b0 2024-09-17T01:41:39.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.140+0000 7f7d84c00640 1 -- 172.21.15.42:0/1413542704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d8015f020 con 0x7f7d801542b0 2024-09-17T01:41:39.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.141+0000 7f7d84c00640 1 -- 172.21.15.42:0/1413542704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d80160480 con 0x7f7d801542b0 2024-09-17T01:41:39.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.143+0000 7f7d77e00640 1 -- 172.21.15.42:0/1413542704 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7d68044020 con 0x7f7d801542b0 2024-09-17T01:41:39.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.144+0000 7f7d77e00640 1 --2- 172.21.15.42:0/1413542704 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7d5c078b90 0x7f7d5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:39.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.144+0000 7f7d77e00640 1 -- 172.21.15.42:0/1413542704 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5609+0+0 (secure 0 0 0) 0x7f7d680baee0 con 0x7f7d801542b0 2024-09-17T01:41:39.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.145+0000 7f7d7f400640 1 --2- 172.21.15.42:0/1413542704 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7d5c078b90 0x7f7d5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:39.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.146+0000 7f7d7f400640 1 --2- 172.21.15.42:0/1413542704 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7d5c078b90 0x7f7d5c07b0a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7d8006c1a0 tx=0x7f7d70005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:39.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.148+0000 7f7d77e00640 1 -- 172.21.15.42:0/1413542704 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7d68083360 con 0x7f7d801542b0 2024-09-17T01:41:39.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.380+0000 7f7d84c00640 1 -- 172.21.15.42:0/1413542704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7d801f8690 con 0x7f7d801542b0 2024-09-17T01:41:39.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.871+0000 7f7d77e00640 1 -- 172.21.15.42:0/1413542704 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v103) ==== 174+0+0 (secure 0 0 0) 0x7f7d68082c60 con 0x7f7d801542b0 2024-09-17T01:41:39.870 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 18 and data pool 19 2024-09-17T01:41:39.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.875+0000 7f7d84c00640 1 -- 172.21.15.42:0/1413542704 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7d5c078b90 msgr2=0x7f7d5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:39.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.875+0000 7f7d84c00640 1 --2- 172.21.15.42:0/1413542704 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7d5c078b90 0x7f7d5c07b0a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7d8006c1a0 tx=0x7f7d70005f90 comp rx=0 tx=0).stop 2024-09-17T01:41:39.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.875+0000 7f7d84c00640 1 -- 172.21.15.42:0/1413542704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d801542b0 msgr2=0x7f7d80153c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:39.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.875+0000 7f7d84c00640 1 --2- 172.21.15.42:0/1413542704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d801542b0 0x7f7d80153c00 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f7d6802a8e0 tx=0x7f7d680063a0 comp rx=0 tx=0).stop 2024-09-17T01:41:39.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.875+0000 7f7d84c00640 1 -- 172.21.15.42:0/1413542704 shutdown_connections 2024-09-17T01:41:39.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.875+0000 7f7d84c00640 1 --2- 172.21.15.42:0/1413542704 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7d5c078b90 0x7f7d5c07b0a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:39.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.875+0000 7f7d84c00640 1 --2- 172.21.15.42:0/1413542704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d800aee30 0x7f7d800af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:39.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.875+0000 7f7d84c00640 1 --2- 172.21.15.42:0/1413542704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d801542b0 0x7f7d80153c00 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:39.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.875+0000 7f7d84c00640 1 --2- 172.21.15.42:0/1413542704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d64004800 0x7f7d801e9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:39.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.875+0000 7f7d84c00640 1 -- 172.21.15.42:0/1413542704 >> 172.21.15.42:0/1413542704 conn(0x7f7d8006d890 msgr2=0x7f7d8015bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:39.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.876+0000 7f7d84c00640 1 -- 172.21.15.42:0/1413542704 shutdown_connections 2024-09-17T01:41:39.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:39.877+0000 7f7d84c00640 1 -- 172.21.15.42:0/1413542704 wait complete. 2024-09-17T01:41:39.932 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:41:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.161+0000 7f75c2000640 1 -- 172.21.15.42:0/2865596934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75bc06d430 msgr2=0x7f75bc06d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.161+0000 7f75c2000640 1 --2- 172.21.15.42:0/2865596934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75bc06d430 0x7f75bc06d840 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f75b4005fd0 tx=0x7f75b402aa90 comp rx=0 tx=0).stop 2024-09-17T01:41:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.161+0000 7f75c2000640 1 -- 172.21.15.42:0/2865596934 shutdown_connections 2024-09-17T01:41:40.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.161+0000 7f75c2000640 1 --2- 172.21.15.42:0/2865596934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75bc06d430 0x7f75bc06d840 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:40.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.161+0000 7f75c2000640 1 --2- 172.21.15.42:0/2865596934 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f75bc0af980 0x7f75bc0ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:40.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.161+0000 7f75c2000640 1 -- 172.21.15.42:0/2865596934 >> 172.21.15.42:0/2865596934 conn(0x7f75bc0b2930 msgr2=0x7f75bc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:40.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.161+0000 7f75c2000640 1 -- 172.21.15.42:0/2865596934 shutdown_connections 2024-09-17T01:41:40.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.161+0000 7f75c2000640 1 -- 172.21.15.42:0/2865596934 wait complete. 2024-09-17T01:41:40.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.163+0000 7f75c2000640 1 Processor -- start 2024-09-17T01:41:40.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.164+0000 7f75c2000640 1 -- start start 2024-09-17T01:41:40.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.165+0000 7f75c2000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75bc06d430 0x7f75bc1efca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:40.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.165+0000 7f75c2000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f75bc0af980 0x7f75bc1575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:40.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.165+0000 7f75c2000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75bc0b3880 0x7f75bc06f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:40.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.165+0000 7f75c2000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc072ad0 con 0x7f75bc0b3880 2024-09-17T01:41:40.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.165+0000 7f75c2000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc072950 con 0x7f75bc06d430 2024-09-17T01:41:40.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.165+0000 7f75c2000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f75bc072c50 con 0x7f75bc0af980 2024-09-17T01:41:40.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.165+0000 7f75bbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75bc0b3880 0x7f75bc06f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:40.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.165+0000 7f75bbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75bc0b3880 0x7f75bc06f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34118/0 (socket says 172.21.15.42:34118) 2024-09-17T01:41:40.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.165+0000 7f75bbe00640 1 -- 172.21.15.42:0/707281050 learned_addr learned my addr 172.21.15.42:0/707281050 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:40.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.166+0000 7f75b2a00640 1 --2- 172.21.15.42:0/707281050 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f75bc0af980 0x7f75bc1575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:40.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.166+0000 7f75bb400640 1 --2- 172.21.15.42:0/707281050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75bc06d430 0x7f75bc1efca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:40.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.166+0000 7f75bbe00640 1 -- 172.21.15.42:0/707281050 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f75bc0af980 msgr2=0x7f75bc1575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:40.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.166+0000 7f75bbe00640 1 --2- 172.21.15.42:0/707281050 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f75bc0af980 0x7f75bc1575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:40.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.166+0000 7f75bbe00640 1 -- 172.21.15.42:0/707281050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75bc06d430 msgr2=0x7f75bc1efca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:40.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.166+0000 7f75bbe00640 1 --2- 172.21.15.42:0/707281050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75bc06d430 0x7f75bc1efca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:40.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.166+0000 7f75bbe00640 1 -- 172.21.15.42:0/707281050 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75bc1f01e0 con 0x7f75bc0b3880 2024-09-17T01:41:40.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.166+0000 7f75bbe00640 1 --2- 172.21.15.42:0/707281050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75bc0b3880 0x7f75bc06f210 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009d90 tx=0x7f75b4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:40.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.166+0000 7f75b3e00640 1 -- 172.21.15.42:0/707281050 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b4044070 con 0x7f75bc0b3880 2024-09-17T01:41:40.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.166+0000 7f75b3e00640 1 -- 172.21.15.42:0/707281050 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75b4003e00 con 0x7f75bc0b3880 2024-09-17T01:41:40.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.166+0000 7f75b3e00640 1 -- 172.21.15.42:0/707281050 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b40044b0 con 0x7f75bc0b3880 2024-09-17T01:41:40.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.166+0000 7f75c2000640 1 -- 172.21.15.42:0/707281050 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75bc1fa200 con 0x7f75bc0b3880 2024-09-17T01:41:40.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.167+0000 7f75c2000640 1 -- 172.21.15.42:0/707281050 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75bc1f9720 con 0x7f75bc0b3880 2024-09-17T01:41:40.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.168+0000 7f75c2000640 1 -- 172.21.15.42:0/707281050 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75bc06d840 con 0x7f75bc0b3880 2024-09-17T01:41:40.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.169+0000 7f75b3e00640 1 -- 172.21.15.42:0/707281050 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f75b4047070 con 0x7f75bc0b3880 2024-09-17T01:41:40.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.170+0000 7f75b3e00640 1 --2- 172.21.15.42:0/707281050 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7598078b90 0x7f759807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:40.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.170+0000 7f75b3e00640 1 -- 172.21.15.42:0/707281050 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f75b40bbcd0 con 0x7f75bc0b3880 2024-09-17T01:41:40.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.171+0000 7f75bb400640 1 --2- 172.21.15.42:0/707281050 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7598078b90 0x7f759807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:40.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.171+0000 7f75bb400640 1 --2- 172.21.15.42:0/707281050 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7598078b90 0x7f759807b0a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0015e0 tx=0x7f75ac009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:40.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.175+0000 7f75b3e00640 1 -- 172.21.15.42:0/707281050 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f75bc1f01e0 con 0x7f75bc0b3880 2024-09-17T01:41:40.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.370+0000 7f75c2000640 1 -- 172.21.15.42:0/707281050 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f75bc06a170 con 0x7f75bc0b3880 2024-09-17T01:41:40.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.372+0000 7f75b3e00640 1 -- 172.21.15.42:0/707281050 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) ==== 74+0+16652 (secure 0 0 0) 0x7f75bc06dd80 con 0x7f75bc0b3880 2024-09-17T01:41:40.371 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:41:40.371 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":135,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:41:39.382346+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:41:37.333863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T01:41:38.352978+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:41:40.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.374+0000 7f75c2000640 1 -- 172.21.15.42:0/707281050 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7598078b90 msgr2=0x7f759807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:40.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.374+0000 7f75c2000640 1 --2- 172.21.15.42:0/707281050 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7598078b90 0x7f759807b0a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0015e0 tx=0x7f75ac009040 comp rx=0 tx=0).stop 2024-09-17T01:41:40.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.374+0000 7f75c2000640 1 -- 172.21.15.42:0/707281050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75bc0b3880 msgr2=0x7f75bc06f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:40.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.374+0000 7f75c2000640 1 --2- 172.21.15.42:0/707281050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75bc0b3880 0x7f75bc06f210 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009d90 tx=0x7f75b4003c10 comp rx=0 tx=0).stop 2024-09-17T01:41:40.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.374+0000 7f75c2000640 1 -- 172.21.15.42:0/707281050 shutdown_connections 2024-09-17T01:41:40.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.374+0000 7f75c2000640 1 --2- 172.21.15.42:0/707281050 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7598078b90 0x7f759807b0a0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:40.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.374+0000 7f75c2000640 1 --2- 172.21.15.42:0/707281050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75bc0b3880 0x7f75bc06f210 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:40.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.374+0000 7f75c2000640 1 --2- 172.21.15.42:0/707281050 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f75bc0af980 0x7f75bc1575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:40.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.374+0000 7f75c2000640 1 --2- 172.21.15.42:0/707281050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75bc06d430 0x7f75bc1efca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:40.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.374+0000 7f75c2000640 1 -- 172.21.15.42:0/707281050 >> 172.21.15.42:0/707281050 conn(0x7f75bc0b2930 msgr2=0x7f75bc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:40.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.374+0000 7f75c2000640 1 -- 172.21.15.42:0/707281050 shutdown_connections 2024-09-17T01:41:40.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.374+0000 7f75c2000640 1 -- 172.21.15.42:0/707281050 wait complete. 2024-09-17T01:41:40.399 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:41:40.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.626+0000 7f4ef1000640 1 -- 172.21.15.42:0/896074659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4eec0cafe0 msgr2=0x7f4eec06e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:40.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.626+0000 7f4ef1000640 1 --2- 172.21.15.42:0/896074659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4eec0cafe0 0x7f4eec06e950 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f4eec072190 tx=0x7f4ee402aac0 comp rx=0 tx=0).stop 2024-09-17T01:41:40.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.626+0000 7f4ef1000640 1 -- 172.21.15.42:0/896074659 shutdown_connections 2024-09-17T01:41:40.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.626+0000 7f4ef1000640 1 --2- 172.21.15.42:0/896074659 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4eec0cafe0 0x7f4eec06e950 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:40.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.626+0000 7f4ef1000640 1 --2- 172.21.15.42:0/896074659 >> v2:172.21.15.43:3300/0 conn(0x7f4eec15f830 0x7f4eec15fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:40.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.626+0000 7f4ef1000640 1 -- 172.21.15.42:0/896074659 >> 172.21.15.42:0/896074659 conn(0x7f4eec0b25f0 msgr2=0x7f4eec0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:40.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.627+0000 7f4ef1000640 1 -- 172.21.15.42:0/896074659 shutdown_connections 2024-09-17T01:41:40.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.627+0000 7f4ef1000640 1 -- 172.21.15.42:0/896074659 wait complete. 2024-09-17T01:41:40.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.629+0000 7f4ef1000640 1 Processor -- start 2024-09-17T01:41:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.629+0000 7f4ef1000640 1 -- start start 2024-09-17T01:41:40.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.630+0000 7f4ef1000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4eec0cafe0 0x7f4eec146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:40.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.631+0000 7f4ef1000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4eec15b680 0x7f4eec157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:40.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.631+0000 7f4ef1000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eec155da0 0x7f4eec1581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:40.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.631+0000 7f4ef1000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4eec06f520 con 0x7f4eec15b680 2024-09-17T01:41:40.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.631+0000 7f4ef1000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4eec06f3a0 con 0x7f4eec155da0 2024-09-17T01:41:40.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.631+0000 7f4ef1000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4eec06f6a0 con 0x7f4eec0cafe0 2024-09-17T01:41:40.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.631+0000 7f4eeaa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4eec15b680 0x7f4eec157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:40.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.631+0000 7f4eeaa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4eec15b680 0x7f4eec157c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34142/0 (socket says 172.21.15.42:34142) 2024-09-17T01:41:40.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.631+0000 7f4eeaa00640 1 -- 172.21.15.42:0/4060607247 learned_addr learned my addr 172.21.15.42:0/4060607247 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:40.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.631+0000 7f4eeb400640 1 --2- 172.21.15.42:0/4060607247 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4eec0cafe0 0x7f4eec146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:40.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.631+0000 7f4eebe00640 1 --2- 172.21.15.42:0/4060607247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eec155da0 0x7f4eec1581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:40.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.631+0000 7f4eeaa00640 1 -- 172.21.15.42:0/4060607247 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4eec0cafe0 msgr2=0x7f4eec146760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:40.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.631+0000 7f4eeaa00640 1 --2- 172.21.15.42:0/4060607247 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4eec0cafe0 0x7f4eec146760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:40.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.631+0000 7f4eeaa00640 1 -- 172.21.15.42:0/4060607247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eec155da0 msgr2=0x7f4eec1581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:40.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.631+0000 7f4eeaa00640 1 --2- 172.21.15.42:0/4060607247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eec155da0 0x7f4eec1581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:40.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.631+0000 7f4eeaa00640 1 -- 172.21.15.42:0/4060607247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eec073220 con 0x7f4eec15b680 2024-09-17T01:41:40.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.632+0000 7f4eeaa00640 1 --2- 172.21.15.42:0/4060607247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4eec15b680 0x7f4eec157c90 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f4ed800e7c0 tx=0x7f4ed800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:40.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.632+0000 7f4ee3400640 1 -- 172.21.15.42:0/4060607247 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed800ccc0 con 0x7f4eec15b680 2024-09-17T01:41:40.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.632+0000 7f4ee3400640 1 -- 172.21.15.42:0/4060607247 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ed8010430 con 0x7f4eec15b680 2024-09-17T01:41:40.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.632+0000 7f4ee3400640 1 -- 172.21.15.42:0/4060607247 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8010860 con 0x7f4eec15b680 2024-09-17T01:41:40.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.632+0000 7f4ef1000640 1 -- 172.21.15.42:0/4060607247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eec0734e0 con 0x7f4eec15b680 2024-09-17T01:41:40.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.632+0000 7f4ef1000640 1 -- 172.21.15.42:0/4060607247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eec1533e0 con 0x7f4eec15b680 2024-09-17T01:41:40.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.633+0000 7f4ef1000640 1 -- 172.21.15.42:0/4060607247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eec156230 con 0x7f4eec15b680 2024-09-17T01:41:40.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.634+0000 7f4ee3400640 1 -- 172.21.15.42:0/4060607247 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4ed8010a00 con 0x7f4eec15b680 2024-09-17T01:41:40.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.635+0000 7f4ee3400640 1 --2- 172.21.15.42:0/4060607247 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4ecc078bf0 0x7f4ecc07b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:40.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.635+0000 7f4ee3400640 1 -- 172.21.15.42:0/4060607247 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5709+0+0 (secure 0 0 0) 0x7f4ed809b7a0 con 0x7f4eec15b680 2024-09-17T01:41:40.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.636+0000 7f4eeb400640 1 --2- 172.21.15.42:0/4060607247 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4ecc078bf0 0x7f4ecc07b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:40.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.636+0000 7f4eeb400640 1 --2- 172.21.15.42:0/4060607247 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4ecc078bf0 0x7f4ecc07b100 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0015e0 tx=0x7f4edc009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:40.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.640+0000 7f4ee3400640 1 -- 172.21.15.42:0/4060607247 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4ed8063b40 con 0x7f4eec15b680 2024-09-17T01:41:40.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.835+0000 7f4ef1000640 1 -- 172.21.15.42:0/4060607247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4eec06fb50 con 0x7f4eec15b680 2024-09-17T01:41:40.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.837+0000 7f4ee3400640 1 -- 172.21.15.42:0/4060607247 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) ==== 74+0+16652 (secure 0 0 0) 0x7f4ed8063440 con 0x7f4eec15b680 2024-09-17T01:41:40.836 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:41:40.836 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":135,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:41:39.382346+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:41:37.333863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T01:41:38.352978+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:41:40.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.839+0000 7f4ef1000640 1 -- 172.21.15.42:0/4060607247 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4ecc078bf0 msgr2=0x7f4ecc07b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:40.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.839+0000 7f4ef1000640 1 --2- 172.21.15.42:0/4060607247 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4ecc078bf0 0x7f4ecc07b100 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0015e0 tx=0x7f4edc009040 comp rx=0 tx=0).stop 2024-09-17T01:41:40.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.839+0000 7f4ef1000640 1 -- 172.21.15.42:0/4060607247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4eec15b680 msgr2=0x7f4eec157c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:40.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.839+0000 7f4ef1000640 1 --2- 172.21.15.42:0/4060607247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4eec15b680 0x7f4eec157c90 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f4ed800e7c0 tx=0x7f4ed800ec80 comp rx=0 tx=0).stop 2024-09-17T01:41:40.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.839+0000 7f4ef1000640 1 -- 172.21.15.42:0/4060607247 shutdown_connections 2024-09-17T01:41:40.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.839+0000 7f4ef1000640 1 --2- 172.21.15.42:0/4060607247 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4ecc078bf0 0x7f4ecc07b100 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:40.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.839+0000 7f4ef1000640 1 --2- 172.21.15.42:0/4060607247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4eec155da0 0x7f4eec1581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:40.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.840+0000 7f4ef1000640 1 --2- 172.21.15.42:0/4060607247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4eec15b680 0x7f4eec157c90 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:40.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.840+0000 7f4ef1000640 1 --2- 172.21.15.42:0/4060607247 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4eec0cafe0 0x7f4eec146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:40.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.840+0000 7f4ef1000640 1 -- 172.21.15.42:0/4060607247 >> 172.21.15.42:0/4060607247 conn(0x7f4eec0b25f0 msgr2=0x7f4eec0ca5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:40.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.840+0000 7f4ef1000640 1 -- 172.21.15.42:0/4060607247 shutdown_connections 2024-09-17T01:41:40.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:40.840+0000 7f4ef1000640 1 -- 172.21.15.42:0/4060607247 wait complete. 2024-09-17T01:41:40.861 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T01:41:41.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.097+0000 7fb56e800640 1 -- 172.21.15.42:0/3621454745 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5680cec40 msgr2=0x7fb5680cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:41.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.097+0000 7fb56e800640 1 --2- 172.21.15.42:0/3621454745 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5680cec40 0x7fb5680cf050 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb560005fd0 tx=0x7fb56002a810 comp rx=0 tx=0).stop 2024-09-17T01:41:41.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.097+0000 7fb56e800640 1 -- 172.21.15.42:0/3621454745 shutdown_connections 2024-09-17T01:41:41.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.097+0000 7fb56e800640 1 --2- 172.21.15.42:0/3621454745 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5680cec40 0x7fb5680cf050 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:41.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.097+0000 7fb56e800640 1 --2- 172.21.15.42:0/3621454745 >> v2:172.21.15.43:3300/0 conn(0x7fb5680b3550 0x7fb56815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:41.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.097+0000 7fb56e800640 1 -- 172.21.15.42:0/3621454745 >> 172.21.15.42:0/3621454745 conn(0x7fb5680b2930 msgr2=0x7fb56806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:41.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.097+0000 7fb56e800640 1 -- 172.21.15.42:0/3621454745 shutdown_connections 2024-09-17T01:41:41.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.097+0000 7fb56e800640 1 -- 172.21.15.42:0/3621454745 wait complete. 2024-09-17T01:41:41.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.099+0000 7fb56e800640 1 Processor -- start 2024-09-17T01:41:41.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.099+0000 7fb56e800640 1 -- start start 2024-09-17T01:41:41.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.101+0000 7fb56e800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5680b3550 0x7fb56813dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:41.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.101+0000 7fb56e800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5680cec40 0x7fb56813e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:41.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.101+0000 7fb56e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb568142f40 0x7fb5680b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:41.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.101+0000 7fb56e800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb56806d7c0 con 0x7fb568142f40 2024-09-17T01:41:41.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.101+0000 7fb56e800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb56806d640 con 0x7fb5680b3550 2024-09-17T01:41:41.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.101+0000 7fb56e800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb56806d940 con 0x7fb5680cec40 2024-09-17T01:41:41.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.101+0000 7fb567e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb568142f40 0x7fb5680b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:41.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.101+0000 7fb567e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb568142f40 0x7fb5680b0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34148/0 (socket says 172.21.15.42:34148) 2024-09-17T01:41:41.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.101+0000 7fb567e00640 1 -- 172.21.15.42:0/2455950205 learned_addr learned my addr 172.21.15.42:0/2455950205 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:41.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.102+0000 7fb567400640 1 --2- 172.21.15.42:0/2455950205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5680b3550 0x7fb56813dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:41.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.102+0000 7fb55fe00640 1 --2- 172.21.15.42:0/2455950205 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5680cec40 0x7fb56813e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:41.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.102+0000 7fb567e00640 1 -- 172.21.15.42:0/2455950205 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5680cec40 msgr2=0x7fb56813e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:41.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.102+0000 7fb567e00640 1 --2- 172.21.15.42:0/2455950205 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5680cec40 0x7fb56813e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:41.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.102+0000 7fb567e00640 1 -- 172.21.15.42:0/2455950205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5680b3550 msgr2=0x7fb56813dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:41.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.102+0000 7fb567e00640 1 --2- 172.21.15.42:0/2455950205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5680b3550 0x7fb56813dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:41.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.102+0000 7fb567e00640 1 -- 172.21.15.42:0/2455950205 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5680ae8a0 con 0x7fb568142f40 2024-09-17T01:41:41.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.102+0000 7fb567400640 1 --2- 172.21.15.42:0/2455950205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5680b3550 0x7fb56813dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:41:41.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.102+0000 7fb55fe00640 1 --2- 172.21.15.42:0/2455950205 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5680cec40 0x7fb56813e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:41:41.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.102+0000 7fb567e00640 1 --2- 172.21.15.42:0/2455950205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb568142f40 0x7fb5680b0430 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fb560006010 tx=0x7fb5600315d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:41.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.102+0000 7fb55f400640 1 -- 172.21.15.42:0/2455950205 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb560041020 con 0x7fb568142f40 2024-09-17T01:41:41.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.102+0000 7fb55f400640 1 -- 172.21.15.42:0/2455950205 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb560031ac0 con 0x7fb568142f40 2024-09-17T01:41:41.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.102+0000 7fb56e800640 1 -- 172.21.15.42:0/2455950205 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5680aeb90 con 0x7fb568142f40 2024-09-17T01:41:41.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.102+0000 7fb55f400640 1 -- 172.21.15.42:0/2455950205 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb560037040 con 0x7fb568142f40 2024-09-17T01:41:41.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.103+0000 7fb56e800640 1 -- 172.21.15.42:0/2455950205 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5681f93a0 con 0x7fb568142f40 2024-09-17T01:41:41.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.104+0000 7fb56e800640 1 -- 172.21.15.42:0/2455950205 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5680b43a0 con 0x7fb568142f40 2024-09-17T01:41:41.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.105+0000 7fb55f400640 1 -- 172.21.15.42:0/2455950205 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb560044020 con 0x7fb568142f40 2024-09-17T01:41:41.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.106+0000 7fb55f400640 1 --2- 172.21.15.42:0/2455950205 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb544078b90 0x7fb54407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:41.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.106+0000 7fb55f400640 1 -- 172.21.15.42:0/2455950205 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7fb5600bba90 con 0x7fb568142f40 2024-09-17T01:41:41.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.106+0000 7fb567400640 1 --2- 172.21.15.42:0/2455950205 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb544078b90 0x7fb54407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:41.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.107+0000 7fb567400640 1 --2- 172.21.15.42:0/2455950205 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb544078b90 0x7fb54407b0a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb558005fd0 tx=0x7fb558009260 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:41.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.111+0000 7fb55f400640 1 -- 172.21.15.42:0/2455950205 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb5680b43a0 con 0x7fb568142f40 2024-09-17T01:41:41.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.341+0000 7fb56e800640 1 -- 172.21.15.42:0/2455950205 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb56815cec0 con 0x7fb568142f40 2024-09-17T01:41:41.851 INFO:tasks.ceph.mds.a.smithi042.stderr:2024-09-17T01:41:41.852+0000 7fbbfb000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:41:41.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.902+0000 7fb55f400640 1 -- 172.21.15.42:0/2455950205 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v106) ==== 118+0+0 (secure 0 0 0) 0x7fb56004b070 con 0x7fb568142f40 2024-09-17T01:41:41.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.904+0000 7fb56e800640 1 -- 172.21.15.42:0/2455950205 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb544078b90 msgr2=0x7fb54407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:41.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.904+0000 7fb56e800640 1 --2- 172.21.15.42:0/2455950205 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb544078b90 0x7fb54407b0a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb558005fd0 tx=0x7fb558009260 comp rx=0 tx=0).stop 2024-09-17T01:41:41.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.905+0000 7fb56e800640 1 -- 172.21.15.42:0/2455950205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb568142f40 msgr2=0x7fb5680b0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:41.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.905+0000 7fb56e800640 1 --2- 172.21.15.42:0/2455950205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb568142f40 0x7fb5680b0430 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fb560006010 tx=0x7fb5600315d0 comp rx=0 tx=0).stop 2024-09-17T01:41:41.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.905+0000 7fb56e800640 1 -- 172.21.15.42:0/2455950205 shutdown_connections 2024-09-17T01:41:41.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.905+0000 7fb56e800640 1 --2- 172.21.15.42:0/2455950205 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb544078b90 0x7fb54407b0a0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:41.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.905+0000 7fb56e800640 1 --2- 172.21.15.42:0/2455950205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb568142f40 0x7fb5680b0430 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:41.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.905+0000 7fb56e800640 1 --2- 172.21.15.42:0/2455950205 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5680cec40 0x7fb56813e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:41.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.905+0000 7fb56e800640 1 --2- 172.21.15.42:0/2455950205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5680b3550 0x7fb56813dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:41.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.905+0000 7fb56e800640 1 -- 172.21.15.42:0/2455950205 >> 172.21.15.42:0/2455950205 conn(0x7fb5680b2930 msgr2=0x7fb56806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:41.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.905+0000 7fb56e800640 1 -- 172.21.15.42:0/2455950205 shutdown_connections 2024-09-17T01:41:41.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:41.905+0000 7fb56e800640 1 -- 172.21.15.42:0/2455950205 wait complete. 2024-09-17T01:41:41.930 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T01:41:41.931 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T01:41:42.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.165+0000 7f64a2200640 1 -- 172.21.15.42:0/212225423 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6480004d40 msgr2=0x7f6480005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:42.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.165+0000 7f64a2200640 1 --2- 172.21.15.42:0/212225423 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6480004d40 0x7f6480005150 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f6494005fd0 tx=0x7f6480005830 comp rx=0 tx=0).stop 2024-09-17T01:41:42.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.165+0000 7f649be00640 1 -- 172.21.15.42:0/212225423 reap_dead start 2024-09-17T01:41:42.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.165+0000 7f64a2200640 1 -- 172.21.15.42:0/212225423 shutdown_connections 2024-09-17T01:41:42.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.165+0000 7f64a2200640 1 -- 172.21.15.42:0/212225423 >> 172.21.15.42:0/212225423 conn(0x7f649c06cf00 msgr2=0x7f649c06d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:42.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.165+0000 7f64a2200640 1 -- 172.21.15.42:0/212225423 shutdown_connections 2024-09-17T01:41:42.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.165+0000 7f64a2200640 1 -- 172.21.15.42:0/212225423 wait complete. 2024-09-17T01:41:42.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.167+0000 7f64a2200640 1 Processor -- start 2024-09-17T01:41:42.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.167+0000 7f64a2200640 1 -- start start 2024-09-17T01:41:42.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.169+0000 7f64a2200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6480004d40 0x7f649c141f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:42.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.169+0000 7f64a2200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f649c154470 0x7f649c142880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:42.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.169+0000 7f64a2200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f649c142dc0 0x7f649c1f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:42.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.169+0000 7f64a2200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f649c0d1420 con 0x7f6480004d40 2024-09-17T01:41:42.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.169+0000 7f64a2200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f649c0d12a0 con 0x7f649c154470 2024-09-17T01:41:42.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.169+0000 7f64a2200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f649c0d15a0 con 0x7f649c142dc0 2024-09-17T01:41:42.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.169+0000 7f649b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6480004d40 0x7f649c141f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:42.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.169+0000 7f649b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6480004d40 0x7f649c141f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34170/0 (socket says 172.21.15.42:34170) 2024-09-17T01:41:42.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.169+0000 7f649b400640 1 -- 172.21.15.42:0/2890224391 learned_addr learned my addr 172.21.15.42:0/2890224391 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:42.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.169+0000 7f649be00640 1 --2- 172.21.15.42:0/2890224391 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f649c142dc0 0x7f649c1f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:42.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.169+0000 7f6493e00640 1 --2- 172.21.15.42:0/2890224391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f649c154470 0x7f649c142880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:42.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.169+0000 7f649b400640 1 -- 172.21.15.42:0/2890224391 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f649c142dc0 msgr2=0x7f649c1f6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:42.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.169+0000 7f649b400640 1 --2- 172.21.15.42:0/2890224391 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f649c142dc0 0x7f649c1f6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:42.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.169+0000 7f649b400640 1 -- 172.21.15.42:0/2890224391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f649c154470 msgr2=0x7f649c142880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:42.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.169+0000 7f649b400640 1 --2- 172.21.15.42:0/2890224391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f649c154470 0x7f649c142880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:42.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.169+0000 7f649b400640 1 -- 172.21.15.42:0/2890224391 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649c1533d0 con 0x7f6480004d40 2024-09-17T01:41:42.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.169+0000 7f6493e00640 1 --2- 172.21.15.42:0/2890224391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f649c154470 0x7f649c142880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:41:42.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.170+0000 7f649b400640 1 --2- 172.21.15.42:0/2890224391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6480004d40 0x7f649c141f60 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f648c011ae0 tx=0x7f648c009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:42.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.170+0000 7f6493400640 1 -- 172.21.15.42:0/2890224391 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c00fcb0 con 0x7f6480004d40 2024-09-17T01:41:42.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.170+0000 7f6493400640 1 -- 172.21.15.42:0/2890224391 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f648c00fe50 con 0x7f6480004d40 2024-09-17T01:41:42.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.170+0000 7f6493400640 1 -- 172.21.15.42:0/2890224391 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c004280 con 0x7f6480004d40 2024-09-17T01:41:42.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.170+0000 7f64a2200640 1 -- 172.21.15.42:0/2890224391 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f649c1536b0 con 0x7f6480004d40 2024-09-17T01:41:42.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.170+0000 7f64a2200640 1 -- 172.21.15.42:0/2890224391 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f649c153c70 con 0x7f6480004d40 2024-09-17T01:41:42.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.171+0000 7f64a2200640 1 -- 172.21.15.42:0/2890224391 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f649c15c7c0 con 0x7f6480004d40 2024-09-17T01:41:42.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.172+0000 7f6493400640 1 -- 172.21.15.42:0/2890224391 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f648c0035f0 con 0x7f6480004d40 2024-09-17T01:41:42.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.173+0000 7f6493400640 1 --2- 172.21.15.42:0/2890224391 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6478078b90 0x7f647807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:42.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.173+0000 7f6493400640 1 -- 172.21.15.42:0/2890224391 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f648c09b880 con 0x7f6480004d40 2024-09-17T01:41:42.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.174+0000 7f6493e00640 1 --2- 172.21.15.42:0/2890224391 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6478078b90 0x7f647807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:42.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.175+0000 7f6493e00640 1 --2- 172.21.15.42:0/2890224391 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6478078b90 0x7f647807b0a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f6484001330 tx=0x7f64840011a0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:42.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.178+0000 7f6493400640 1 -- 172.21.15.42:0/2890224391 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f648c0635d0 con 0x7f6480004d40 2024-09-17T01:41:42.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.410+0000 7f64a2200640 1 -- 172.21.15.42:0/2890224391 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f649c0add60 con 0x7f6480004d40 2024-09-17T01:41:42.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.904+0000 7f6493400640 1 -- 172.21.15.42:0/2890224391 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v107) ==== 122+0+0 (secure 0 0 0) 0x7f648c068000 con 0x7f6480004d40 2024-09-17T01:41:42.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.907+0000 7f64a2200640 1 -- 172.21.15.42:0/2890224391 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6478078b90 msgr2=0x7f647807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:42.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.907+0000 7f64a2200640 1 --2- 172.21.15.42:0/2890224391 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6478078b90 0x7f647807b0a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f6484001330 tx=0x7f64840011a0 comp rx=0 tx=0).stop 2024-09-17T01:41:42.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.907+0000 7f64a2200640 1 -- 172.21.15.42:0/2890224391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6480004d40 msgr2=0x7f649c141f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:42.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.907+0000 7f64a2200640 1 --2- 172.21.15.42:0/2890224391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6480004d40 0x7f649c141f60 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f648c011ae0 tx=0x7f648c009f10 comp rx=0 tx=0).stop 2024-09-17T01:41:42.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.907+0000 7f64a2200640 1 -- 172.21.15.42:0/2890224391 shutdown_connections 2024-09-17T01:41:42.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.907+0000 7f64a2200640 1 --2- 172.21.15.42:0/2890224391 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6478078b90 0x7f647807b0a0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:42.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.907+0000 7f64a2200640 1 --2- 172.21.15.42:0/2890224391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f649c154470 0x7f649c142880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:42.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.907+0000 7f64a2200640 1 --2- 172.21.15.42:0/2890224391 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f649c142dc0 0x7f649c1f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:42.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.907+0000 7f64a2200640 1 --2- 172.21.15.42:0/2890224391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6480004d40 0x7f649c141f60 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:42.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.907+0000 7f64a2200640 1 -- 172.21.15.42:0/2890224391 >> 172.21.15.42:0/2890224391 conn(0x7f649c06cf00 msgr2=0x7f649c15ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:42.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.908+0000 7f64a2200640 1 -- 172.21.15.42:0/2890224391 shutdown_connections 2024-09-17T01:41:42.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:42.908+0000 7f64a2200640 1 -- 172.21.15.42:0/2890224391 wait complete. 2024-09-17T01:41:42.934 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T01:41:42.934 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:41:43.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.167+0000 7f4ff5000640 1 -- 172.21.15.42:0/902203516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fd4004800 msgr2=0x7f4fd4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:43.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.167+0000 7f4ff5000640 1 --2- 172.21.15.42:0/902203516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fd4004800 0x7f4fd4004c10 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009b20 tx=0x7f4fd4005830 comp rx=0 tx=0).stop 2024-09-17T01:41:43.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.167+0000 7f4fee800640 1 -- 172.21.15.42:0/902203516 reap_dead start 2024-09-17T01:41:43.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.167+0000 7f4ff5000640 1 -- 172.21.15.42:0/902203516 shutdown_connections 2024-09-17T01:41:43.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.167+0000 7f4ff5000640 1 -- 172.21.15.42:0/902203516 >> 172.21.15.42:0/902203516 conn(0x7f4ff00b2930 msgr2=0x7f4ff006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:43.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.167+0000 7f4ff5000640 1 -- 172.21.15.42:0/902203516 shutdown_connections 2024-09-17T01:41:43.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.167+0000 7f4ff5000640 1 -- 172.21.15.42:0/902203516 wait complete. 2024-09-17T01:41:43.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.170+0000 7f4ff5000640 1 Processor -- start 2024-09-17T01:41:43.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.170+0000 7f4ff5000640 1 -- start start 2024-09-17T01:41:43.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.171+0000 7f4ff5000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fd4004800 0x7f4ff006f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:43.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.171+0000 7f4ff5000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4ff00cbf20 0x7f4ff00ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:43.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.171+0000 7f4ff5000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ff00cc330 0x7f4ff00aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:43.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.171+0000 7f4ff5000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff0074130 con 0x7f4ff00cc330 2024-09-17T01:41:43.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.171+0000 7f4ff5000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff0073fb0 con 0x7f4fd4004800 2024-09-17T01:41:43.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.171+0000 7f4ff5000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff006db40 con 0x7f4ff00cbf20 2024-09-17T01:41:43.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.172+0000 7f4fee800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ff00cc330 0x7f4ff00aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:43.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.172+0000 7f4fee800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ff00cc330 0x7f4ff00aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34192/0 (socket says 172.21.15.42:34192) 2024-09-17T01:41:43.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.172+0000 7f4fee800640 1 -- 172.21.15.42:0/4128230036 learned_addr learned my addr 172.21.15.42:0/4128230036 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:43.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.172+0000 7f4fede00640 1 --2- 172.21.15.42:0/4128230036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fd4004800 0x7f4ff006f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:43.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.172+0000 7f4fed400640 1 --2- 172.21.15.42:0/4128230036 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4ff00cbf20 0x7f4ff00ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:43.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.172+0000 7f4fee800640 1 -- 172.21.15.42:0/4128230036 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4ff00cbf20 msgr2=0x7f4ff00ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:43.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.172+0000 7f4fee800640 1 --2- 172.21.15.42:0/4128230036 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4ff00cbf20 0x7f4ff00ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:43.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.172+0000 7f4fee800640 1 -- 172.21.15.42:0/4128230036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fd4004800 msgr2=0x7f4ff006f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:43.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.172+0000 7f4fee800640 1 --2- 172.21.15.42:0/4128230036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fd4004800 0x7f4ff006f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:43.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.172+0000 7f4fee800640 1 -- 172.21.15.42:0/4128230036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff00c5880 con 0x7f4ff00cc330 2024-09-17T01:41:43.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.172+0000 7f4fee800640 1 --2- 172.21.15.42:0/4128230036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ff00cc330 0x7f4ff00aede0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00b5bb0 tx=0x7f4fe8006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:43.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.173+0000 7f4fe6000640 1 -- 172.21.15.42:0/4128230036 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe800fa80 con 0x7f4ff00cc330 2024-09-17T01:41:43.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.173+0000 7f4fe6000640 1 -- 172.21.15.42:0/4128230036 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fe8018070 con 0x7f4ff00cc330 2024-09-17T01:41:43.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.173+0000 7f4fe6000640 1 -- 172.21.15.42:0/4128230036 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe800fea0 con 0x7f4ff00cc330 2024-09-17T01:41:43.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.173+0000 7f4ff5000640 1 -- 172.21.15.42:0/4128230036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff00c5b60 con 0x7f4ff00cc330 2024-09-17T01:41:43.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.173+0000 7f4ff5000640 1 -- 172.21.15.42:0/4128230036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff00c6120 con 0x7f4ff00cc330 2024-09-17T01:41:43.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.174+0000 7f4ff5000640 1 -- 172.21.15.42:0/4128230036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff0072a30 con 0x7f4ff00cc330 2024-09-17T01:41:43.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.175+0000 7f4fe6000640 1 -- 172.21.15.42:0/4128230036 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4fe801d460 con 0x7f4ff00cc330 2024-09-17T01:41:43.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.176+0000 7f4fe6000640 1 --2- 172.21.15.42:0/4128230036 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4fd0078b90 0x7f4fd007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:43.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.176+0000 7f4fe6000640 1 -- 172.21.15.42:0/4128230036 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f4fe809b4a0 con 0x7f4ff00cc330 2024-09-17T01:41:43.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.177+0000 7f4fede00640 1 --2- 172.21.15.42:0/4128230036 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4fd0078b90 0x7f4fd007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:43.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.177+0000 7f4fede00640 1 --2- 172.21.15.42:0/4128230036 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4fd0078b90 0x7f4fd007b0a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0000c00 tx=0x7f4fe0006d60 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:43.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.181+0000 7f4fe6000640 1 -- 172.21.15.42:0/4128230036 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4fe8063280 con 0x7f4ff00cc330 2024-09-17T01:41:43.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.411+0000 7f4ff5000640 1 -- 172.21.15.42:0/4128230036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ff00c5610 con 0x7f4ff00cc330 2024-09-17T01:41:43.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.411+0000 7f4fe6000640 1 -- 172.21.15.42:0/4128230036 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5231 (secure 0 0 0) 0x7f4fe8067cb0 con 0x7f4ff00cc330 2024-09-17T01:41:43.410 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:41:43.410 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2491855232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2491855232},{"type":"v1","addr":"172.21.15.43:6835","nonce":2491855232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4136787983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4136787983},{"type":"v1","addr":"172.21.15.43:6837","nonce":4136787983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/3441664627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3441664627},{"type":"v1","addr":"172.21.15.42:6834","nonce":3441664627}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:41:39.382305+0000","modified":"2024-09-17T01:41:42.412964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8442":{"gid":8442,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3060441721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3060441721},{"type":"v1","addr":"172.21.15.42:6835","nonce":3060441721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8442,"qdb_cluster":[8442]},"id":9}]} 2024-09-17T01:41:43.411 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 107 2024-09-17T01:41:43.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.413+0000 7f4ff5000640 1 -- 172.21.15.42:0/4128230036 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4fd0078b90 msgr2=0x7f4fd007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:43.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.413+0000 7f4ff5000640 1 --2- 172.21.15.42:0/4128230036 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4fd0078b90 0x7f4fd007b0a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0000c00 tx=0x7f4fe0006d60 comp rx=0 tx=0).stop 2024-09-17T01:41:43.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.413+0000 7f4ff5000640 1 -- 172.21.15.42:0/4128230036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ff00cc330 msgr2=0x7f4ff00aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:43.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.413+0000 7f4ff5000640 1 --2- 172.21.15.42:0/4128230036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ff00cc330 0x7f4ff00aede0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00b5bb0 tx=0x7f4fe8006720 comp rx=0 tx=0).stop 2024-09-17T01:41:43.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.414+0000 7f4ff5000640 1 -- 172.21.15.42:0/4128230036 shutdown_connections 2024-09-17T01:41:43.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.414+0000 7f4ff5000640 1 --2- 172.21.15.42:0/4128230036 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4fd0078b90 0x7f4fd007b0a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:43.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.414+0000 7f4ff5000640 1 --2- 172.21.15.42:0/4128230036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ff00cc330 0x7f4ff00aede0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:43.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.414+0000 7f4ff5000640 1 --2- 172.21.15.42:0/4128230036 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4ff00cbf20 0x7f4ff00ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:43.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.414+0000 7f4ff5000640 1 --2- 172.21.15.42:0/4128230036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fd4004800 0x7f4ff006f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:43.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.414+0000 7f4ff5000640 1 -- 172.21.15.42:0/4128230036 >> 172.21.15.42:0/4128230036 conn(0x7f4ff00b2930 msgr2=0x7f4ff015f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:43.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.414+0000 7f4ff5000640 1 -- 172.21.15.42:0/4128230036 shutdown_connections 2024-09-17T01:41:43.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.414+0000 7f4ff5000640 1 -- 172.21.15.42:0/4128230036 wait complete. 2024-09-17T01:41:43.435 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:41:43.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.663+0000 7fd9a2000640 1 -- 172.21.15.42:0/3363891960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd99c06d430 msgr2=0x7fd99c06d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:43.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.663+0000 7fd9a2000640 1 --2- 172.21.15.42:0/3363891960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd99c06d430 0x7fd99c06d840 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fd988005fd0 tx=0x7fd98802a5c0 comp rx=0 tx=0).stop 2024-09-17T01:41:43.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.664+0000 7fd9a2000640 1 -- 172.21.15.42:0/3363891960 shutdown_connections 2024-09-17T01:41:43.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.664+0000 7fd9a2000640 1 --2- 172.21.15.42:0/3363891960 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd99c15f480 0x7fd99c15f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:43.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.664+0000 7fd9a2000640 1 --2- 172.21.15.42:0/3363891960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd99c06d430 0x7fd99c06d840 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:43.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.664+0000 7fd9a2000640 1 -- 172.21.15.42:0/3363891960 >> 172.21.15.42:0/3363891960 conn(0x7fd99c0b2930 msgr2=0x7fd99c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:43.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.664+0000 7fd9a2000640 1 -- 172.21.15.42:0/3363891960 shutdown_connections 2024-09-17T01:41:43.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.664+0000 7fd9a2000640 1 -- 172.21.15.42:0/3363891960 wait complete. 2024-09-17T01:41:43.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.666+0000 7fd9a2000640 1 Processor -- start 2024-09-17T01:41:43.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.666+0000 7fd9a2000640 1 -- start start 2024-09-17T01:41:43.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.667+0000 7fd9a2000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd99c06d430 0x7fd99c15a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:43.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.667+0000 7fd9a2000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd99c15cb80 0x7fd99c15ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:43.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.667+0000 7fd9a2000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd99c15f480 0x7fd99c14ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:43.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.667+0000 7fd9a2000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c073820 con 0x7fd99c15f480 2024-09-17T01:41:43.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.667+0000 7fd9a2000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c0736a0 con 0x7fd99c15cb80 2024-09-17T01:41:43.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.667+0000 7fd9a2000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd99c0739a0 con 0x7fd99c06d430 2024-09-17T01:41:43.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.668+0000 7fd99be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd99c15f480 0x7fd99c14ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:43.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.668+0000 7fd99be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd99c15f480 0x7fd99c14ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34208/0 (socket says 172.21.15.42:34208) 2024-09-17T01:41:43.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.668+0000 7fd99be00640 1 -- 172.21.15.42:0/4243093910 learned_addr learned my addr 172.21.15.42:0/4243093910 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:43.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.668+0000 7fd99b400640 1 --2- 172.21.15.42:0/4243093910 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd99c06d430 0x7fd99c15a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:43.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.668+0000 7fd99aa00640 1 --2- 172.21.15.42:0/4243093910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd99c15cb80 0x7fd99c15ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:43.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.668+0000 7fd99be00640 1 -- 172.21.15.42:0/4243093910 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd99c06d430 msgr2=0x7fd99c15a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:43.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.668+0000 7fd99be00640 1 --2- 172.21.15.42:0/4243093910 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd99c06d430 0x7fd99c15a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:43.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.668+0000 7fd99be00640 1 -- 172.21.15.42:0/4243093910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd99c15cb80 msgr2=0x7fd99c15ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:43.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.668+0000 7fd99be00640 1 --2- 172.21.15.42:0/4243093910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd99c15cb80 0x7fd99c15ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:43.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.668+0000 7fd99be00640 1 -- 172.21.15.42:0/4243093910 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd99c1f5ae0 con 0x7fd99c15f480 2024-09-17T01:41:43.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.668+0000 7fd99be00640 1 --2- 172.21.15.42:0/4243093910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd99c15f480 0x7fd99c14ec70 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fd99400ea80 tx=0x7fd99400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:43.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.669+0000 7fd993400640 1 -- 172.21.15.42:0/4243093910 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd994004b20 con 0x7fd99c15f480 2024-09-17T01:41:43.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.669+0000 7fd993400640 1 -- 172.21.15.42:0/4243093910 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd994004ce0 con 0x7fd99c15f480 2024-09-17T01:41:43.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.669+0000 7fd9a2000640 1 -- 172.21.15.42:0/4243093910 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd99c1f5dc0 con 0x7fd99c15f480 2024-09-17T01:41:43.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.669+0000 7fd993400640 1 -- 172.21.15.42:0/4243093910 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd994005280 con 0x7fd99c15f480 2024-09-17T01:41:43.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.669+0000 7fd9a2000640 1 -- 172.21.15.42:0/4243093910 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd99c1530e0 con 0x7fd99c15f480 2024-09-17T01:41:43.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.670+0000 7fd9a2000640 1 -- 172.21.15.42:0/4243093910 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd99c073ec0 con 0x7fd99c15f480 2024-09-17T01:41:43.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.671+0000 7fd993400640 1 -- 172.21.15.42:0/4243093910 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd994005420 con 0x7fd99c15f480 2024-09-17T01:41:43.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.673+0000 7fd993400640 1 --2- 172.21.15.42:0/4243093910 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd97c078bc0 0x7fd97c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:43.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.673+0000 7fd993400640 1 -- 172.21.15.42:0/4243093910 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7fd99409b8c0 con 0x7fd99c15f480 2024-09-17T01:41:43.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.673+0000 7fd99b400640 1 --2- 172.21.15.42:0/4243093910 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd97c078bc0 0x7fd97c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:43.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.674+0000 7fd99b400640 1 --2- 172.21.15.42:0/4243093910 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd97c078bc0 0x7fd97c07b0d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd98c001720 tx=0x7fd98c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:43.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.677+0000 7fd993400640 1 -- 172.21.15.42:0/4243093910 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd9940636a0 con 0x7fd99c15f480 2024-09-17T01:41:43.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.871+0000 7fd9a2000640 1 -- 172.21.15.42:0/4243093910 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd99c152f10 con 0x7fd99c15f480 2024-09-17T01:41:43.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.873+0000 7fd993400640 1 -- 172.21.15.42:0/4243093910 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) ==== 74+0+16639 (secure 0 0 0) 0x7fd9940680d0 con 0x7fd99c15f480 2024-09-17T01:41:43.872 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:41:43.873 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":136,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:41:40.882912+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:41:37.333863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T01:41:38.352978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:41:43.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.875+0000 7fd9a2000640 1 -- 172.21.15.42:0/4243093910 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd97c078bc0 msgr2=0x7fd97c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:43.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.875+0000 7fd9a2000640 1 --2- 172.21.15.42:0/4243093910 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd97c078bc0 0x7fd97c07b0d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd98c001720 tx=0x7fd98c009040 comp rx=0 tx=0).stop 2024-09-17T01:41:43.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.875+0000 7fd9a2000640 1 -- 172.21.15.42:0/4243093910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd99c15f480 msgr2=0x7fd99c14ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:43.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.875+0000 7fd9a2000640 1 --2- 172.21.15.42:0/4243093910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd99c15f480 0x7fd99c14ec70 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fd99400ea80 tx=0x7fd99400ef40 comp rx=0 tx=0).stop 2024-09-17T01:41:43.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.875+0000 7fd9a2000640 1 -- 172.21.15.42:0/4243093910 shutdown_connections 2024-09-17T01:41:43.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.875+0000 7fd9a2000640 1 --2- 172.21.15.42:0/4243093910 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd97c078bc0 0x7fd97c07b0d0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:43.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.875+0000 7fd9a2000640 1 --2- 172.21.15.42:0/4243093910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd99c15cb80 0x7fd99c15ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:43.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.875+0000 7fd9a2000640 1 --2- 172.21.15.42:0/4243093910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd99c15f480 0x7fd99c14ec70 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:43.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.875+0000 7fd9a2000640 1 --2- 172.21.15.42:0/4243093910 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd99c06d430 0x7fd99c15a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:43.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.875+0000 7fd9a2000640 1 -- 172.21.15.42:0/4243093910 >> 172.21.15.42:0/4243093910 conn(0x7fd99c0b2930 msgr2=0x7fd99c072be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:43.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.876+0000 7fd9a2000640 1 -- 172.21.15.42:0/4243093910 shutdown_connections 2024-09-17T01:41:43.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:43.876+0000 7fd9a2000640 1 -- 172.21.15.42:0/4243093910 wait complete. 2024-09-17T01:41:43.897 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T01:41:43.898 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:41:44.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.129+0000 7fc3d7a00640 1 -- 172.21.15.42:0/1609158449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3d00b3550 msgr2=0x7fc3d015cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:44.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.129+0000 7fc3d7a00640 1 --2- 172.21.15.42:0/1609158449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3d00b3550 0x7fc3d015cec0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fc3d00b3110 tx=0x7fc3c402a4d0 comp rx=0 tx=0).stop 2024-09-17T01:41:44.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.129+0000 7fc3d7a00640 1 -- 172.21.15.42:0/1609158449 shutdown_connections 2024-09-17T01:41:44.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.129+0000 7fc3d7a00640 1 --2- 172.21.15.42:0/1609158449 >> v2:172.21.15.43:3300/0 conn(0x7fc3d0072e90 0x7fc3d00cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:44.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.129+0000 7fc3d7a00640 1 --2- 172.21.15.42:0/1609158449 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3d0142f40 0x7fc3d0072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:44.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.129+0000 7fc3d7a00640 1 --2- 172.21.15.42:0/1609158449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3d00b3550 0x7fc3d015cec0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:44.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.129+0000 7fc3d7a00640 1 -- 172.21.15.42:0/1609158449 >> 172.21.15.42:0/1609158449 conn(0x7fc3d00b2930 msgr2=0x7fc3d006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:44.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.129+0000 7fc3d7a00640 1 -- 172.21.15.42:0/1609158449 shutdown_connections 2024-09-17T01:41:44.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.129+0000 7fc3d7a00640 1 -- 172.21.15.42:0/1609158449 wait complete. 2024-09-17T01:41:44.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.131+0000 7fc3d7a00640 1 Processor -- start 2024-09-17T01:41:44.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.131+0000 7fc3d7a00640 1 -- start start 2024-09-17T01:41:44.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.133+0000 7fc3d7a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3d0072e90 0x7fc3d01f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:44.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.133+0000 7fc3d7a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3d00b3550 0x7fc3d01575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:44.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.133+0000 7fc3d7a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3d0142f40 0x7fc3d006ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:44.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.133+0000 7fc3d7a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d006d430 con 0x7fc3d0072e90 2024-09-17T01:41:44.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.133+0000 7fc3d7a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d00cf4d0 con 0x7fc3d0142f40 2024-09-17T01:41:44.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.133+0000 7fc3d7a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc3d006d5b0 con 0x7fc3d00b3550 2024-09-17T01:41:44.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.133+0000 7fc3d5000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3d0072e90 0x7fc3d01f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:44.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.133+0000 7fc3d5000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3d0072e90 0x7fc3d01f5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34218/0 (socket says 172.21.15.42:34218) 2024-09-17T01:41:44.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.133+0000 7fc3d5000640 1 -- 172.21.15.42:0/1591350738 learned_addr learned my addr 172.21.15.42:0/1591350738 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:44.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.133+0000 7fc3cfe00640 1 --2- 172.21.15.42:0/1591350738 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3d00b3550 0x7fc3d01575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:44.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.133+0000 7fc3d5a00640 1 --2- 172.21.15.42:0/1591350738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3d0142f40 0x7fc3d006ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:44.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.134+0000 7fc3d5000640 1 -- 172.21.15.42:0/1591350738 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3d00b3550 msgr2=0x7fc3d01575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:44.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.134+0000 7fc3d5000640 1 --2- 172.21.15.42:0/1591350738 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3d00b3550 0x7fc3d01575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:44.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.134+0000 7fc3d5000640 1 -- 172.21.15.42:0/1591350738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3d0142f40 msgr2=0x7fc3d006ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:44.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.134+0000 7fc3d5000640 1 --2- 172.21.15.42:0/1591350738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3d0142f40 0x7fc3d006ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:44.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.134+0000 7fc3d5000640 1 -- 172.21.15.42:0/1591350738 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d006f110 con 0x7fc3d0072e90 2024-09-17T01:41:44.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.134+0000 7fc3d5000640 1 --2- 172.21.15.42:0/1591350738 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3d0072e90 0x7fc3d01f5f30 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4034040 tx=0x7fc3c4003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:44.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.134+0000 7fc3ccc00640 1 -- 172.21.15.42:0/1591350738 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c403e030 con 0x7fc3d0072e90 2024-09-17T01:41:44.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.134+0000 7fc3ccc00640 1 -- 172.21.15.42:0/1591350738 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3c4003e00 con 0x7fc3d0072e90 2024-09-17T01:41:44.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.134+0000 7fc3ccc00640 1 -- 172.21.15.42:0/1591350738 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4035040 con 0x7fc3d0072e90 2024-09-17T01:41:44.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.134+0000 7fc3d7a00640 1 -- 172.21.15.42:0/1591350738 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d0157cd0 con 0x7fc3d0072e90 2024-09-17T01:41:44.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.134+0000 7fc3d7a00640 1 -- 172.21.15.42:0/1591350738 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d006e3d0 con 0x7fc3d0072e90 2024-09-17T01:41:44.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.135+0000 7fc3d7a00640 1 -- 172.21.15.42:0/1591350738 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3d01581f0 con 0x7fc3d0072e90 2024-09-17T01:41:44.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.137+0000 7fc3ccc00640 1 -- 172.21.15.42:0/1591350738 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc3c4041030 con 0x7fc3d0072e90 2024-09-17T01:41:44.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.138+0000 7fc3ccc00640 1 --2- 172.21.15.42:0/1591350738 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc3b0078bc0 0x7fc3b007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:44.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.138+0000 7fc3ccc00640 1 -- 172.21.15.42:0/1591350738 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7fc3c40bb450 con 0x7fc3d0072e90 2024-09-17T01:41:44.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.139+0000 7fc3cfe00640 1 --2- 172.21.15.42:0/1591350738 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc3b0078bc0 0x7fc3b007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:44.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.139+0000 7fc3cfe00640 1 --2- 172.21.15.42:0/1591350738 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc3b0078bc0 0x7fc3b007b0d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc3d013f520 tx=0x7fc3bc00b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:44.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.143+0000 7fc3ccc00640 1 -- 172.21.15.42:0/1591350738 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc3c4083240 con 0x7fc3d0072e90 2024-09-17T01:41:44.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.334+0000 7fc3d7a00640 1 -- 172.21.15.42:0/1591350738 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc3d006e1c0 con 0x7fc3b0078bc0 2024-09-17T01:41:44.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.340+0000 7fc3ccc00640 1 -- 172.21.15.42:0/1591350738 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246831 (secure 0 0 0) 0x7fc3d006e1c0 con 0x7fc3b0078bc0 2024-09-17T01:41:44.342 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:41:44.343 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:41:44.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.343+0000 7fc3d7a00640 1 -- 172.21.15.42:0/1591350738 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc3b0078bc0 msgr2=0x7fc3b007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:44.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.343+0000 7fc3d7a00640 1 --2- 172.21.15.42:0/1591350738 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc3b0078bc0 0x7fc3b007b0d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc3d013f520 tx=0x7fc3bc00b2e0 comp rx=0 tx=0).stop 2024-09-17T01:41:44.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.343+0000 7fc3d7a00640 1 -- 172.21.15.42:0/1591350738 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3d0072e90 msgr2=0x7fc3d01f5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:44.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.343+0000 7fc3d7a00640 1 --2- 172.21.15.42:0/1591350738 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3d0072e90 0x7fc3d01f5f30 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4034040 tx=0x7fc3c4003910 comp rx=0 tx=0).stop 2024-09-17T01:41:44.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.343+0000 7fc3d7a00640 1 -- 172.21.15.42:0/1591350738 shutdown_connections 2024-09-17T01:41:44.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.343+0000 7fc3d7a00640 1 --2- 172.21.15.42:0/1591350738 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc3b0078bc0 0x7fc3b007b0d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:44.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.343+0000 7fc3d7a00640 1 --2- 172.21.15.42:0/1591350738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3d0142f40 0x7fc3d006ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:44.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.343+0000 7fc3d7a00640 1 --2- 172.21.15.42:0/1591350738 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3d00b3550 0x7fc3d01575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:44.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.343+0000 7fc3d7a00640 1 --2- 172.21.15.42:0/1591350738 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3d0072e90 0x7fc3d01f5f30 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:44.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.343+0000 7fc3d7a00640 1 -- 172.21.15.42:0/1591350738 >> 172.21.15.42:0/1591350738 conn(0x7fc3d00b2930 msgr2=0x7fc3d006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:44.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.343+0000 7fc3d7a00640 1 -- 172.21.15.42:0/1591350738 shutdown_connections 2024-09-17T01:41:44.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.343+0000 7fc3d7a00640 1 -- 172.21.15.42:0/1591350738 wait complete. 2024-09-17T01:41:44.364 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":424,"stamp":"2024-09-17T01:41:43.147828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591040,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":109,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":186,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":401096,"kb_used_data":14160,"kb_used_omap":12,"kb_used_meta":386739,"kb_avail":754573624,"statfs":{"total":773094113280,"available":772683390976,"internally_reserved":0,"allocated":14499840,"data_stored":7009932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":396021300},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.290543"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.868734+0000","last_change":"2024-09-17T01:41:38.868734+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.868734+0000","last_undegraded":"2024-09-17T01:41:38.868734+0000","last_fullsized":"2024-09-17T01:41:38.868734+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.866981+0000","last_change":"2024-09-17T01:41:38.866981+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.866981+0000","last_undegraded":"2024-09-17T01:41:38.866981+0000","last_fullsized":"2024-09-17T01:41:38.866981+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.875019+0000","last_change":"2024-09-17T01:41:38.875019+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.875019+0000","last_undegraded":"2024-09-17T01:41:38.875019+0000","last_fullsized":"2024-09-17T01:41:38.875019+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:41:38.855854+0000","last_change":"2024-09-17T01:41:38.855854+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.855854+0000","last_undegraded":"2024-09-17T01:41:38.855854+0000","last_fullsized":"2024-09-17T01:41:38.855854+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.910148+0000","last_change":"2024-09-17T01:41:39.908288+0000","last_active":"2024-09-17T01:41:39.910148+0000","last_peered":"2024-09-17T01:41:39.910148+0000","last_clean":"2024-09-17T01:41:39.910148+0000","last_became_active":"2024-09-17T01:41:39.906273+0000","last_became_peered":"2024-09-17T01:41:39.906273+0000","last_unstale":"2024-09-17T01:41:39.910148+0000","last_undegraded":"2024-09-17T01:41:39.910148+0000","last_fullsized":"2024-09-17T01:41:39.910148+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:51.859583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.876422+0000","last_change":"2024-09-17T01:41:38.876422+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.876422+0000","last_undegraded":"2024-09-17T01:41:38.876422+0000","last_fullsized":"2024-09-17T01:41:38.876422+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.919586+0000","last_change":"2024-09-17T01:41:39.918635+0000","last_active":"2024-09-17T01:41:39.919586+0000","last_peered":"2024-09-17T01:41:39.919586+0000","last_clean":"2024-09-17T01:41:39.919586+0000","last_became_active":"2024-09-17T01:41:39.918295+0000","last_became_peered":"2024-09-17T01:41:39.918295+0000","last_unstale":"2024-09-17T01:41:39.919586+0000","last_undegraded":"2024-09-17T01:41:39.919586+0000","last_fullsized":"2024-09-17T01:41:39.919586+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:08:55.104996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.908066+0000","last_change":"2024-09-17T01:41:39.903573+0000","last_active":"2024-09-17T01:41:39.908066+0000","last_peered":"2024-09-17T01:41:39.908066+0000","last_clean":"2024-09-17T01:41:39.908066+0000","last_became_active":"2024-09-17T01:41:39.903235+0000","last_became_peered":"2024-09-17T01:41:39.903235+0000","last_unstale":"2024-09-17T01:41:39.908066+0000","last_undegraded":"2024-09-17T01:41:39.908066+0000","last_fullsized":"2024-09-17T01:41:39.908066+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:29.001520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.878071+0000","last_change":"2024-09-17T01:41:38.878071+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.878071+0000","last_undegraded":"2024-09-17T01:41:38.878071+0000","last_fullsized":"2024-09-17T01:41:38.878071+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.866384+0000","last_change":"2024-09-17T01:41:38.866384+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.866384+0000","last_undegraded":"2024-09-17T01:41:38.866384+0000","last_fullsized":"2024-09-17T01:41:38.866384+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:41:38.855854+0000","last_change":"2024-09-17T01:41:38.855854+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.855854+0000","last_undegraded":"2024-09-17T01:41:38.855854+0000","last_fullsized":"2024-09-17T01:41:38.855854+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.880998+0000","last_change":"2024-09-17T01:41:38.880998+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.880998+0000","last_undegraded":"2024-09-17T01:41:38.880998+0000","last_fullsized":"2024-09-17T01:41:38.880998+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:41:38.855854+0000","last_change":"2024-09-17T01:41:38.855854+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.855854+0000","last_undegraded":"2024-09-17T01:41:38.855854+0000","last_fullsized":"2024-09-17T01:41:38.855854+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.869227+0000","last_change":"2024-09-17T01:41:38.869227+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.869227+0000","last_undegraded":"2024-09-17T01:41:38.869227+0000","last_fullsized":"2024-09-17T01:41:38.869227+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.876300+0000","last_change":"2024-09-17T01:41:38.876300+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.876300+0000","last_undegraded":"2024-09-17T01:41:38.876300+0000","last_fullsized":"2024-09-17T01:41:38.876300+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.871560+0000","last_change":"2024-09-17T01:41:38.871560+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.871560+0000","last_undegraded":"2024-09-17T01:41:38.871560+0000","last_fullsized":"2024-09-17T01:41:38.871560+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.877613+0000","last_change":"2024-09-17T01:41:38.877613+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.877613+0000","last_undegraded":"2024-09-17T01:41:38.877613+0000","last_fullsized":"2024-09-17T01:41:38.877613+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.878965+0000","last_change":"2024-09-17T01:41:38.878965+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.878965+0000","last_undegraded":"2024-09-17T01:41:38.878965+0000","last_fullsized":"2024-09-17T01:41:38.878965+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.867677+0000","last_change":"2024-09-17T01:41:38.867677+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.867677+0000","last_undegraded":"2024-09-17T01:41:38.867677+0000","last_fullsized":"2024-09-17T01:41:38.867677+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.881132+0000","last_change":"2024-09-17T01:41:38.881132+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.881132+0000","last_undegraded":"2024-09-17T01:41:38.881132+0000","last_fullsized":"2024-09-17T01:41:38.881132+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.885429+0000","last_change":"2024-09-17T01:41:38.885429+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.885429+0000","last_undegraded":"2024-09-17T01:41:38.885429+0000","last_fullsized":"2024-09-17T01:41:38.885429+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.865921+0000","last_change":"2024-09-17T01:41:38.865921+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.865921+0000","last_undegraded":"2024-09-17T01:41:38.865921+0000","last_fullsized":"2024-09-17T01:41:38.865921+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.867809+0000","last_change":"2024-09-17T01:41:38.867809+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.867809+0000","last_undegraded":"2024-09-17T01:41:38.867809+0000","last_fullsized":"2024-09-17T01:41:38.867809+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.877377+0000","last_change":"2024-09-17T01:41:38.877377+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.877377+0000","last_undegraded":"2024-09-17T01:41:38.877377+0000","last_fullsized":"2024-09-17T01:41:38.877377+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:41:38.855854+0000","last_change":"2024-09-17T01:41:38.855854+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.855854+0000","last_undegraded":"2024-09-17T01:41:38.855854+0000","last_fullsized":"2024-09-17T01:41:38.855854+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.865814+0000","last_change":"2024-09-17T01:41:38.865814+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.865814+0000","last_undegraded":"2024-09-17T01:41:38.865814+0000","last_fullsized":"2024-09-17T01:41:38.865814+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.866964+0000","last_change":"2024-09-17T01:41:38.866964+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.866964+0000","last_undegraded":"2024-09-17T01:41:38.866964+0000","last_fullsized":"2024-09-17T01:41:38.866964+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.867340+0000","last_change":"2024-09-17T01:41:38.867340+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.867340+0000","last_undegraded":"2024-09-17T01:41:38.867340+0000","last_fullsized":"2024-09-17T01:41:38.867340+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.863824+0000","last_change":"2024-09-17T01:41:38.863824+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.863824+0000","last_undegraded":"2024-09-17T01:41:38.863824+0000","last_fullsized":"2024-09-17T01:41:38.863824+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.865047+0000","last_change":"2024-09-17T01:41:38.865047+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.865047+0000","last_undegraded":"2024-09-17T01:41:38.865047+0000","last_fullsized":"2024-09-17T01:41:38.865047+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.867234+0000","last_change":"2024-09-17T01:41:38.867234+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.867234+0000","last_undegraded":"2024-09-17T01:41:38.867234+0000","last_fullsized":"2024-09-17T01:41:38.867234+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.874407+0000","last_change":"2024-09-17T01:41:38.874407+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.874407+0000","last_undegraded":"2024-09-17T01:41:38.874407+0000","last_fullsized":"2024-09-17T01:41:38.874407+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.868366+0000","last_change":"2024-09-17T01:41:38.868366+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.868366+0000","last_undegraded":"2024-09-17T01:41:38.868366+0000","last_fullsized":"2024-09-17T01:41:38.868366+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"135'4","reported_seq":17,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.912694+0000","last_change":"2024-09-17T01:41:38.882554+0000","last_active":"2024-09-17T01:41:39.912694+0000","last_peered":"2024-09-17T01:41:39.912694+0000","last_clean":"2024-09-17T01:41:39.912694+0000","last_became_active":"2024-09-17T01:41:38.882209+0000","last_became_peered":"2024-09-17T01:41:38.882209+0000","last_unstale":"2024-09-17T01:41:39.912694+0000","last_undegraded":"2024-09-17T01:41:39.912694+0000","last_fullsized":"2024-09-17T01:41:39.912694+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:26.546849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.877163+0000","last_change":"2024-09-17T01:41:38.877163+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.877163+0000","last_undegraded":"2024-09-17T01:41:38.877163+0000","last_fullsized":"2024-09-17T01:41:38.877163+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.893618+0000","last_change":"2024-09-17T01:41:38.892289+0000","last_active":"2024-09-17T01:41:38.893618+0000","last_peered":"2024-09-17T01:41:38.893618+0000","last_clean":"2024-09-17T01:41:38.893618+0000","last_became_active":"2024-09-17T01:41:38.891979+0000","last_became_peered":"2024-09-17T01:41:38.891979+0000","last_unstale":"2024-09-17T01:41:38.893618+0000","last_undegraded":"2024-09-17T01:41:38.893618+0000","last_fullsized":"2024-09-17T01:41:38.893618+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:57.693879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.870183+0000","last_change":"2024-09-17T01:41:38.870183+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.870183+0000","last_undegraded":"2024-09-17T01:41:38.870183+0000","last_fullsized":"2024-09-17T01:41:38.870183+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-17T01:41:37.863079+0000","last_change":"2024-09-17T01:41:37.863079+0000","last_active":"2024-09-17T01:41:37.848311+0000","last_peered":"2024-09-17T01:41:37.848311+0000","last_clean":"2024-09-17T01:41:37.848311+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:37.863079+0000","last_undegraded":"2024-09-17T01:41:37.863079+0000","last_fullsized":"2024-09-17T01:41:37.863079+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.872585+0000","last_change":"2024-09-17T01:41:38.872585+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.872585+0000","last_undegraded":"2024-09-17T01:41:38.872585+0000","last_fullsized":"2024-09-17T01:41:38.872585+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.886629+0000","last_change":"2024-09-17T01:41:38.885583+0000","last_active":"2024-09-17T01:41:38.886629+0000","last_peered":"2024-09-17T01:41:38.886629+0000","last_clean":"2024-09-17T01:41:38.886629+0000","last_became_active":"2024-09-17T01:41:38.884223+0000","last_became_peered":"2024-09-17T01:41:38.884223+0000","last_unstale":"2024-09-17T01:41:38.886629+0000","last_undegraded":"2024-09-17T01:41:38.886629+0000","last_fullsized":"2024-09-17T01:41:38.886629+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:50:34.707198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.880491+0000","last_change":"2024-09-17T01:41:38.880491+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.880491+0000","last_undegraded":"2024-09-17T01:41:38.880491+0000","last_fullsized":"2024-09-17T01:41:38.880491+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.879995+0000","last_change":"2024-09-17T01:41:38.873721+0000","last_active":"2024-09-17T01:41:38.879995+0000","last_peered":"2024-09-17T01:41:38.879995+0000","last_clean":"2024-09-17T01:41:38.879995+0000","last_became_active":"2024-09-17T01:41:38.873362+0000","last_became_peered":"2024-09-17T01:41:38.873362+0000","last_unstale":"2024-09-17T01:41:38.879995+0000","last_undegraded":"2024-09-17T01:41:38.879995+0000","last_fullsized":"2024-09-17T01:41:38.879995+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:09.085348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.874545+0000","last_change":"2024-09-17T01:41:38.874545+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.874545+0000","last_undegraded":"2024-09-17T01:41:38.874545+0000","last_fullsized":"2024-09-17T01:41:38.874545+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.891048+0000","last_change":"2024-09-17T01:41:38.889732+0000","last_active":"2024-09-17T01:41:38.891048+0000","last_peered":"2024-09-17T01:41:38.891048+0000","last_clean":"2024-09-17T01:41:38.891048+0000","last_became_active":"2024-09-17T01:41:38.888209+0000","last_became_peered":"2024-09-17T01:41:38.888209+0000","last_unstale":"2024-09-17T01:41:38.891048+0000","last_undegraded":"2024-09-17T01:41:38.891048+0000","last_fullsized":"2024-09-17T01:41:38.891048+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:00.415477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.876149+0000","last_change":"2024-09-17T01:41:38.876149+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.876149+0000","last_undegraded":"2024-09-17T01:41:38.876149+0000","last_fullsized":"2024-09-17T01:41:38.876149+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.890343+0000","last_change":"2024-09-17T01:41:38.885067+0000","last_active":"2024-09-17T01:41:38.890343+0000","last_peered":"2024-09-17T01:41:38.890343+0000","last_clean":"2024-09-17T01:41:38.890343+0000","last_became_active":"2024-09-17T01:41:38.884745+0000","last_became_peered":"2024-09-17T01:41:38.884745+0000","last_unstale":"2024-09-17T01:41:38.890343+0000","last_undegraded":"2024-09-17T01:41:38.890343+0000","last_fullsized":"2024-09-17T01:41:38.890343+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:53.122084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.863383+0000","last_change":"2024-09-17T01:41:38.863383+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.863383+0000","last_undegraded":"2024-09-17T01:41:38.863383+0000","last_fullsized":"2024-09-17T01:41:38.863383+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.887039+0000","last_change":"2024-09-17T01:41:38.881509+0000","last_active":"2024-09-17T01:41:38.887039+0000","last_peered":"2024-09-17T01:41:38.887039+0000","last_clean":"2024-09-17T01:41:38.887039+0000","last_became_active":"2024-09-17T01:41:38.881199+0000","last_became_peered":"2024-09-17T01:41:38.881199+0000","last_unstale":"2024-09-17T01:41:38.887039+0000","last_undegraded":"2024-09-17T01:41:38.887039+0000","last_fullsized":"2024-09-17T01:41:38.887039+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:36.695146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.865232+0000","last_change":"2024-09-17T01:41:38.865232+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.865232+0000","last_undegraded":"2024-09-17T01:41:38.865232+0000","last_fullsized":"2024-09-17T01:41:38.865232+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.889604+0000","last_change":"2024-09-17T01:41:38.887052+0000","last_active":"2024-09-17T01:41:38.889604+0000","last_peered":"2024-09-17T01:41:38.889604+0000","last_clean":"2024-09-17T01:41:38.889604+0000","last_became_active":"2024-09-17T01:41:38.886738+0000","last_became_peered":"2024-09-17T01:41:38.886738+0000","last_unstale":"2024-09-17T01:41:38.889604+0000","last_undegraded":"2024-09-17T01:41:38.889604+0000","last_fullsized":"2024-09-17T01:41:38.889604+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:14.477019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.911538+0000","last_change":"2024-09-17T01:41:39.909805+0000","last_active":"2024-09-17T01:41:39.911538+0000","last_peered":"2024-09-17T01:41:39.911538+0000","last_clean":"2024-09-17T01:41:39.911538+0000","last_became_active":"2024-09-17T01:41:39.909106+0000","last_became_peered":"2024-09-17T01:41:39.909106+0000","last_unstale":"2024-09-17T01:41:39.911538+0000","last_undegraded":"2024-09-17T01:41:39.911538+0000","last_fullsized":"2024-09-17T01:41:39.911538+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:33.309654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.887030+0000","last_change":"2024-09-17T01:41:38.885697+0000","last_active":"2024-09-17T01:41:38.887030+0000","last_peered":"2024-09-17T01:41:38.887030+0000","last_clean":"2024-09-17T01:41:38.887030+0000","last_became_active":"2024-09-17T01:41:38.885354+0000","last_became_peered":"2024-09-17T01:41:38.885354+0000","last_unstale":"2024-09-17T01:41:38.887030+0000","last_undegraded":"2024-09-17T01:41:38.887030+0000","last_fullsized":"2024-09-17T01:41:38.887030+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:49.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.873192+0000","last_change":"2024-09-17T01:41:38.873192+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.873192+0000","last_undegraded":"2024-09-17T01:41:38.873192+0000","last_fullsized":"2024-09-17T01:41:38.873192+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"135'3","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.917421+0000","last_change":"2024-09-17T01:41:38.884961+0000","last_active":"2024-09-17T01:41:39.917421+0000","last_peered":"2024-09-17T01:41:39.917421+0000","last_clean":"2024-09-17T01:41:39.917421+0000","last_became_active":"2024-09-17T01:41:38.884641+0000","last_became_peered":"2024-09-17T01:41:38.884641+0000","last_unstale":"2024-09-17T01:41:39.917421+0000","last_undegraded":"2024-09-17T01:41:39.917421+0000","last_fullsized":"2024-09-17T01:41:39.917421+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:39.247990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.867092+0000","last_change":"2024-09-17T01:41:38.867092+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.867092+0000","last_undegraded":"2024-09-17T01:41:38.867092+0000","last_fullsized":"2024-09-17T01:41:38.867092+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.891766+0000","last_change":"2024-09-17T01:41:38.889323+0000","last_active":"2024-09-17T01:41:38.891766+0000","last_peered":"2024-09-17T01:41:38.891766+0000","last_clean":"2024-09-17T01:41:38.891766+0000","last_became_active":"2024-09-17T01:41:38.889016+0000","last_became_peered":"2024-09-17T01:41:38.889016+0000","last_unstale":"2024-09-17T01:41:38.891766+0000","last_undegraded":"2024-09-17T01:41:38.891766+0000","last_fullsized":"2024-09-17T01:41:38.891766+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:38.578359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.863871+0000","last_change":"2024-09-17T01:41:38.863871+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.863871+0000","last_undegraded":"2024-09-17T01:41:38.863871+0000","last_fullsized":"2024-09-17T01:41:38.863871+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.883252+0000","last_change":"2024-09-17T01:41:38.879765+0000","last_active":"2024-09-17T01:41:38.883252+0000","last_peered":"2024-09-17T01:41:38.883252+0000","last_clean":"2024-09-17T01:41:38.883252+0000","last_became_active":"2024-09-17T01:41:38.878997+0000","last_became_peered":"2024-09-17T01:41:38.878997+0000","last_unstale":"2024-09-17T01:41:38.883252+0000","last_undegraded":"2024-09-17T01:41:38.883252+0000","last_fullsized":"2024-09-17T01:41:38.883252+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:35.406588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.870158+0000","last_change":"2024-09-17T01:41:38.870158+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.870158+0000","last_undegraded":"2024-09-17T01:41:38.870158+0000","last_fullsized":"2024-09-17T01:41:38.870158+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-17T01:41:37.864403+0000","last_change":"2024-09-17T01:41:37.864403+0000","last_active":"2024-09-17T01:41:37.848311+0000","last_peered":"2024-09-17T01:41:37.848311+0000","last_clean":"2024-09-17T01:41:37.848311+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:37.864403+0000","last_undegraded":"2024-09-17T01:41:37.864403+0000","last_fullsized":"2024-09-17T01:41:37.864403+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.883020+0000","last_change":"2024-09-17T01:41:38.883020+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.883020+0000","last_undegraded":"2024-09-17T01:41:38.883020+0000","last_fullsized":"2024-09-17T01:41:38.883020+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.891415+0000","last_change":"2024-09-17T01:41:38.890585+0000","last_active":"2024-09-17T01:41:38.891415+0000","last_peered":"2024-09-17T01:41:38.891415+0000","last_clean":"2024-09-17T01:41:38.891415+0000","last_became_active":"2024-09-17T01:41:38.890139+0000","last_became_peered":"2024-09-17T01:41:38.890139+0000","last_unstale":"2024-09-17T01:41:38.891415+0000","last_undegraded":"2024-09-17T01:41:38.891415+0000","last_fullsized":"2024-09-17T01:41:38.891415+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:15.166636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.905548+0000","last_change":"2024-09-17T01:41:39.897936+0000","last_active":"2024-09-17T01:41:39.905548+0000","last_peered":"2024-09-17T01:41:39.905548+0000","last_clean":"2024-09-17T01:41:39.905548+0000","last_became_active":"2024-09-17T01:41:39.896967+0000","last_became_peered":"2024-09-17T01:41:39.896967+0000","last_unstale":"2024-09-17T01:41:39.905548+0000","last_undegraded":"2024-09-17T01:41:39.905548+0000","last_fullsized":"2024-09-17T01:41:39.905548+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:39.882004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.889631+0000","last_change":"2024-09-17T01:41:38.888104+0000","last_active":"2024-09-17T01:41:38.889631+0000","last_peered":"2024-09-17T01:41:38.889631+0000","last_clean":"2024-09-17T01:41:38.889631+0000","last_became_active":"2024-09-17T01:41:38.887512+0000","last_became_peered":"2024-09-17T01:41:38.887512+0000","last_unstale":"2024-09-17T01:41:38.889631+0000","last_undegraded":"2024-09-17T01:41:38.889631+0000","last_fullsized":"2024-09-17T01:41:38.889631+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:44.791124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.908176+0000","last_change":"2024-09-17T01:41:39.899540+0000","last_active":"2024-09-17T01:41:39.908176+0000","last_peered":"2024-09-17T01:41:39.908176+0000","last_clean":"2024-09-17T01:41:39.908176+0000","last_became_active":"2024-09-17T01:41:39.899234+0000","last_became_peered":"2024-09-17T01:41:39.899234+0000","last_unstale":"2024-09-17T01:41:39.908176+0000","last_undegraded":"2024-09-17T01:41:39.908176+0000","last_fullsized":"2024-09-17T01:41:39.908176+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:11.013229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-17T01:41:37.862935+0000","last_change":"2024-09-17T01:41:37.862935+0000","last_active":"2024-09-17T01:41:37.848311+0000","last_peered":"2024-09-17T01:41:37.848311+0000","last_clean":"2024-09-17T01:41:37.848311+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:37.862935+0000","last_undegraded":"2024-09-17T01:41:37.862935+0000","last_fullsized":"2024-09-17T01:41:37.862935+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.865135+0000","last_change":"2024-09-17T01:41:38.865135+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.865135+0000","last_undegraded":"2024-09-17T01:41:38.865135+0000","last_fullsized":"2024-09-17T01:41:38.865135+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.884553+0000","last_change":"2024-09-17T01:41:38.882538+0000","last_active":"2024-09-17T01:41:38.884553+0000","last_peered":"2024-09-17T01:41:38.884553+0000","last_clean":"2024-09-17T01:41:38.884553+0000","last_became_active":"2024-09-17T01:41:38.882135+0000","last_became_peered":"2024-09-17T01:41:38.882135+0000","last_unstale":"2024-09-17T01:41:38.884553+0000","last_undegraded":"2024-09-17T01:41:38.884553+0000","last_fullsized":"2024-09-17T01:41:38.884553+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:04:29.068100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.863961+0000","last_change":"2024-09-17T01:41:38.863961+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.863961+0000","last_undegraded":"2024-09-17T01:41:38.863961+0000","last_fullsized":"2024-09-17T01:41:38.863961+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.885618+0000","last_change":"2024-09-17T01:41:38.888723+0000","last_active":"2024-09-17T01:41:39.885618+0000","last_peered":"2024-09-17T01:41:39.885618+0000","last_clean":"2024-09-17T01:41:39.885618+0000","last_became_active":"2024-09-17T01:41:38.888363+0000","last_became_peered":"2024-09-17T01:41:38.888363+0000","last_unstale":"2024-09-17T01:41:39.885618+0000","last_undegraded":"2024-09-17T01:41:39.885618+0000","last_fullsized":"2024-09-17T01:41:39.885618+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:33.994701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.863344+0000","last_change":"2024-09-17T01:41:38.863344+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.863344+0000","last_undegraded":"2024-09-17T01:41:38.863344+0000","last_fullsized":"2024-09-17T01:41:38.863344+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.884938+0000","last_change":"2024-09-17T01:41:38.882994+0000","last_active":"2024-09-17T01:41:38.884938+0000","last_peered":"2024-09-17T01:41:38.884938+0000","last_clean":"2024-09-17T01:41:38.884938+0000","last_became_active":"2024-09-17T01:41:38.882780+0000","last_became_peered":"2024-09-17T01:41:38.882780+0000","last_unstale":"2024-09-17T01:41:38.884938+0000","last_undegraded":"2024-09-17T01:41:38.884938+0000","last_fullsized":"2024-09-17T01:41:38.884938+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:06.070748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.866887+0000","last_change":"2024-09-17T01:41:38.866887+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.866887+0000","last_undegraded":"2024-09-17T01:41:38.866887+0000","last_fullsized":"2024-09-17T01:41:38.866887+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.891870+0000","last_change":"2024-09-17T01:41:38.890582+0000","last_active":"2024-09-17T01:41:38.891870+0000","last_peered":"2024-09-17T01:41:38.891870+0000","last_clean":"2024-09-17T01:41:38.891870+0000","last_became_active":"2024-09-17T01:41:38.890231+0000","last_became_peered":"2024-09-17T01:41:38.890231+0000","last_unstale":"2024-09-17T01:41:38.891870+0000","last_undegraded":"2024-09-17T01:41:38.891870+0000","last_fullsized":"2024-09-17T01:41:38.891870+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:19:15.427968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.868098+0000","last_change":"2024-09-17T01:41:38.868098+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.868098+0000","last_undegraded":"2024-09-17T01:41:38.868098+0000","last_fullsized":"2024-09-17T01:41:38.868098+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.890523+0000","last_change":"2024-09-17T01:41:38.889563+0000","last_active":"2024-09-17T01:41:38.890523+0000","last_peered":"2024-09-17T01:41:38.890523+0000","last_clean":"2024-09-17T01:41:38.890523+0000","last_became_active":"2024-09-17T01:41:38.888781+0000","last_became_peered":"2024-09-17T01:41:38.888781+0000","last_unstale":"2024-09-17T01:41:38.890523+0000","last_undegraded":"2024-09-17T01:41:38.890523+0000","last_fullsized":"2024-09-17T01:41:38.890523+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:56.749885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.881119+0000","last_change":"2024-09-17T01:41:38.881119+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.881119+0000","last_undegraded":"2024-09-17T01:41:38.881119+0000","last_fullsized":"2024-09-17T01:41:38.881119+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-17T01:41:37.862881+0000","last_change":"2024-09-17T01:41:37.862881+0000","last_active":"2024-09-17T01:41:37.848311+0000","last_peered":"2024-09-17T01:41:37.848311+0000","last_clean":"2024-09-17T01:41:37.848311+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:37.862881+0000","last_undegraded":"2024-09-17T01:41:37.862881+0000","last_fullsized":"2024-09-17T01:41:37.862881+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.867786+0000","last_change":"2024-09-17T01:41:38.867786+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.867786+0000","last_undegraded":"2024-09-17T01:41:38.867786+0000","last_fullsized":"2024-09-17T01:41:38.867786+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.888367+0000","last_change":"2024-09-17T01:41:38.886108+0000","last_active":"2024-09-17T01:41:38.888367+0000","last_peered":"2024-09-17T01:41:38.888367+0000","last_clean":"2024-09-17T01:41:38.888367+0000","last_became_active":"2024-09-17T01:41:38.885735+0000","last_became_peered":"2024-09-17T01:41:38.885735+0000","last_unstale":"2024-09-17T01:41:38.888367+0000","last_undegraded":"2024-09-17T01:41:38.888367+0000","last_fullsized":"2024-09-17T01:41:38.888367+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:42.626059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.868215+0000","last_change":"2024-09-17T01:41:38.868215+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.868215+0000","last_undegraded":"2024-09-17T01:41:38.868215+0000","last_fullsized":"2024-09-17T01:41:38.868215+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.885906+0000","last_change":"2024-09-17T01:41:38.888956+0000","last_active":"2024-09-17T01:41:39.885906+0000","last_peered":"2024-09-17T01:41:39.885906+0000","last_clean":"2024-09-17T01:41:39.885906+0000","last_became_active":"2024-09-17T01:41:38.888591+0000","last_became_peered":"2024-09-17T01:41:38.888591+0000","last_unstale":"2024-09-17T01:41:39.885906+0000","last_undegraded":"2024-09-17T01:41:39.885906+0000","last_fullsized":"2024-09-17T01:41:39.885906+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:23.963194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.869002+0000","last_change":"2024-09-17T01:41:38.869002+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.869002+0000","last_undegraded":"2024-09-17T01:41:38.869002+0000","last_fullsized":"2024-09-17T01:41:38.869002+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.894246+0000","last_change":"2024-09-17T01:41:38.893661+0000","last_active":"2024-09-17T01:41:38.894246+0000","last_peered":"2024-09-17T01:41:38.894246+0000","last_clean":"2024-09-17T01:41:38.894246+0000","last_became_active":"2024-09-17T01:41:38.893356+0000","last_became_peered":"2024-09-17T01:41:38.893356+0000","last_unstale":"2024-09-17T01:41:38.894246+0000","last_undegraded":"2024-09-17T01:41:38.894246+0000","last_fullsized":"2024-09-17T01:41:38.894246+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:40.441295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.871122+0000","last_change":"2024-09-17T01:41:38.871122+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.871122+0000","last_undegraded":"2024-09-17T01:41:38.871122+0000","last_fullsized":"2024-09-17T01:41:38.871122+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.886856+0000","last_change":"2024-09-17T01:41:38.882409+0000","last_active":"2024-09-17T01:41:38.886856+0000","last_peered":"2024-09-17T01:41:38.886856+0000","last_clean":"2024-09-17T01:41:38.886856+0000","last_became_active":"2024-09-17T01:41:38.882062+0000","last_became_peered":"2024-09-17T01:41:38.882062+0000","last_unstale":"2024-09-17T01:41:38.886856+0000","last_undegraded":"2024-09-17T01:41:38.886856+0000","last_fullsized":"2024-09-17T01:41:38.886856+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:51:12.107940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.875875+0000","last_change":"2024-09-17T01:41:38.875875+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.875875+0000","last_undegraded":"2024-09-17T01:41:38.875875+0000","last_fullsized":"2024-09-17T01:41:38.875875+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.886711+0000","last_change":"2024-09-17T01:41:38.885009+0000","last_active":"2024-09-17T01:41:38.886711+0000","last_peered":"2024-09-17T01:41:38.886711+0000","last_clean":"2024-09-17T01:41:38.886711+0000","last_became_active":"2024-09-17T01:41:38.884672+0000","last_became_peered":"2024-09-17T01:41:38.884672+0000","last_unstale":"2024-09-17T01:41:38.886711+0000","last_undegraded":"2024-09-17T01:41:38.886711+0000","last_fullsized":"2024-09-17T01:41:38.886711+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:19.539609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.873964+0000","last_change":"2024-09-17T01:41:38.873964+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.873964+0000","last_undegraded":"2024-09-17T01:41:38.873964+0000","last_fullsized":"2024-09-17T01:41:38.873964+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.895078+0000","last_change":"2024-09-17T01:41:38.894301+0000","last_active":"2024-09-17T01:41:38.895078+0000","last_peered":"2024-09-17T01:41:38.895078+0000","last_clean":"2024-09-17T01:41:38.895078+0000","last_became_active":"2024-09-17T01:41:38.893976+0000","last_became_peered":"2024-09-17T01:41:38.893976+0000","last_unstale":"2024-09-17T01:41:38.895078+0000","last_undegraded":"2024-09-17T01:41:38.895078+0000","last_fullsized":"2024-09-17T01:41:38.895078+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:46.237489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.876056+0000","last_change":"2024-09-17T01:41:38.876056+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.876056+0000","last_undegraded":"2024-09-17T01:41:38.876056+0000","last_fullsized":"2024-09-17T01:41:38.876056+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-17T01:41:37.863671+0000","last_change":"2024-09-17T01:41:37.863671+0000","last_active":"2024-09-17T01:41:37.848311+0000","last_peered":"2024-09-17T01:41:37.848311+0000","last_clean":"2024-09-17T01:41:37.848311+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:37.863671+0000","last_undegraded":"2024-09-17T01:41:37.863671+0000","last_fullsized":"2024-09-17T01:41:37.863671+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.870158+0000","last_change":"2024-09-17T01:41:38.870158+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.870158+0000","last_undegraded":"2024-09-17T01:41:38.870158+0000","last_fullsized":"2024-09-17T01:41:38.870158+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.882511+0000","last_change":"2024-09-17T01:41:38.879650+0000","last_active":"2024-09-17T01:41:38.882511+0000","last_peered":"2024-09-17T01:41:38.882511+0000","last_clean":"2024-09-17T01:41:38.882511+0000","last_became_active":"2024-09-17T01:41:38.879319+0000","last_became_peered":"2024-09-17T01:41:38.879319+0000","last_unstale":"2024-09-17T01:41:38.882511+0000","last_undegraded":"2024-09-17T01:41:38.882511+0000","last_fullsized":"2024-09-17T01:41:38.882511+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:04.957002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.869085+0000","last_change":"2024-09-17T01:41:38.869085+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.869085+0000","last_undegraded":"2024-09-17T01:41:38.869085+0000","last_fullsized":"2024-09-17T01:41:38.869085+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.895050+0000","last_change":"2024-09-17T01:41:38.894268+0000","last_active":"2024-09-17T01:41:38.895050+0000","last_peered":"2024-09-17T01:41:38.895050+0000","last_clean":"2024-09-17T01:41:38.895050+0000","last_became_active":"2024-09-17T01:41:38.893934+0000","last_became_peered":"2024-09-17T01:41:38.893934+0000","last_unstale":"2024-09-17T01:41:38.895050+0000","last_undegraded":"2024-09-17T01:41:38.895050+0000","last_fullsized":"2024-09-17T01:41:38.895050+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:01.753560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":323,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.861571+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:41:38.861571+0000","last_peered":"2024-09-17T01:41:38.861571+0000","last_clean":"2024-09-17T01:41:38.861571+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:41:38.861571+0000","last_undegraded":"2024-09-17T01:41:38.861571+0000","last_fullsized":"2024-09-17T01:41:38.861571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":120,"acting":120,"num_store_stats":7},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476857,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55040,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316800,"statfs":{"total":96636764160,"available":96580403200,"internally_reserved":0,"allocated":1683456,"data_stored":735950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509560,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32812,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339028,"statfs":{"total":96636764160,"available":96603164672,"internally_reserved":0,"allocated":1662976,"data_stored":728503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509559,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55024,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316816,"statfs":{"total":96636764160,"available":96580419584,"internally_reserved":0,"allocated":1662976,"data_stored":728503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509560,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59180,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312660,"statfs":{"total":96636764160,"available":96576163840,"internally_reserved":0,"allocated":1662976,"data_stored":728503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509560,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59184,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312656,"statfs":{"total":96636764160,"available":96576159744,"internally_reserved":0,"allocated":1662976,"data_stored":728503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509559,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51448,"kb_used_data":2204,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320392,"statfs":{"total":96636764160,"available":96584081408,"internally_reserved":0,"allocated":2256896,"data_stored":1318871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509561,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28656,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343184,"statfs":{"total":96636764160,"available":96607420416,"internally_reserved":0,"allocated":1662976,"data_stored":728503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542265,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59752,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312088,"statfs":{"total":96636764160,"available":96575578112,"internally_reserved":0,"allocated":2244608,"data_stored":1312596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:41:44.369 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:41:44.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.633+0000 7facf0a00640 1 -- 172.21.15.42:0/391896350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facec06d430 msgr2=0x7facec0ad080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:44.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.633+0000 7facf0a00640 1 --2- 172.21.15.42:0/391896350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facec06d430 0x7facec0ad080 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7facd4005fd0 tx=0x7facd402a670 comp rx=0 tx=0).stop 2024-09-17T01:41:44.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.633+0000 7facf0a00640 1 -- 172.21.15.42:0/391896350 shutdown_connections 2024-09-17T01:41:44.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.633+0000 7facf0a00640 1 --2- 172.21.15.42:0/391896350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facec06d430 0x7facec0ad080 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:44.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.633+0000 7facf0a00640 1 -- 172.21.15.42:0/391896350 >> 172.21.15.42:0/391896350 conn(0x7facec0b25f0 msgr2=0x7facec0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:44.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.633+0000 7facf0a00640 1 -- 172.21.15.42:0/391896350 shutdown_connections 2024-09-17T01:41:44.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.633+0000 7facf0a00640 1 -- 172.21.15.42:0/391896350 wait complete. 2024-09-17T01:41:44.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.635+0000 7facf0a00640 1 Processor -- start 2024-09-17T01:41:44.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.635+0000 7facf0a00640 1 -- start start 2024-09-17T01:41:44.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.637+0000 7facf0a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7facec0af460 0x7facec1f93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:44.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.637+0000 7facf0a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7facec0d0d80 0x7facec0b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:44.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.637+0000 7facf0a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facec157a90 0x7facec159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:44.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.637+0000 7facf0a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7facec0adcd0 con 0x7facec157a90 2024-09-17T01:41:44.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.637+0000 7facf0a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7facec15ec10 con 0x7facec0d0d80 2024-09-17T01:41:44.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.637+0000 7facf0a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7facec0ade50 con 0x7facec0af460 2024-09-17T01:41:44.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.637+0000 7faceb200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facec157a90 0x7facec159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:44.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.637+0000 7faceb200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facec157a90 0x7facec159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34230/0 (socket says 172.21.15.42:34230) 2024-09-17T01:41:44.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.637+0000 7faceb200640 1 -- 172.21.15.42:0/3311401629 learned_addr learned my addr 172.21.15.42:0/3311401629 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:44.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.638+0000 7face1e00640 1 --2- 172.21.15.42:0/3311401629 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7facec0d0d80 0x7facec0b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:44.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.638+0000 7facea800640 1 --2- 172.21.15.42:0/3311401629 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7facec0af460 0x7facec1f93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:44.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.638+0000 7faceb200640 1 -- 172.21.15.42:0/3311401629 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7facec0af460 msgr2=0x7facec1f93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:44.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.638+0000 7faceb200640 1 --2- 172.21.15.42:0/3311401629 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7facec0af460 0x7facec1f93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:44.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.638+0000 7faceb200640 1 -- 172.21.15.42:0/3311401629 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7facec0d0d80 msgr2=0x7facec0b3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:44.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.638+0000 7faceb200640 1 --2- 172.21.15.42:0/3311401629 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7facec0d0d80 0x7facec0b3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:44.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.638+0000 7faceb200640 1 -- 172.21.15.42:0/3311401629 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facec1f9900 con 0x7facec157a90 2024-09-17T01:41:44.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.638+0000 7facea800640 1 --2- 172.21.15.42:0/3311401629 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7facec0af460 0x7facec1f93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:41:44.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.638+0000 7faceb200640 1 --2- 172.21.15.42:0/3311401629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facec157a90 0x7facec159380 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7face400c730 tx=0x7face400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:44.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.638+0000 7face3400640 1 -- 172.21.15.42:0/3311401629 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4003b70 con 0x7facec157a90 2024-09-17T01:41:44.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.638+0000 7face3400640 1 -- 172.21.15.42:0/3311401629 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7face4003d10 con 0x7facec157a90 2024-09-17T01:41:44.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.638+0000 7face3400640 1 -- 172.21.15.42:0/3311401629 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face400aab0 con 0x7facec157a90 2024-09-17T01:41:44.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.638+0000 7facf0a00640 1 -- 172.21.15.42:0/3311401629 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facec0b4940 con 0x7facec157a90 2024-09-17T01:41:44.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.639+0000 7facf0a00640 1 -- 172.21.15.42:0/3311401629 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facec0b30a0 con 0x7facec157a90 2024-09-17T01:41:44.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.640+0000 7facf0a00640 1 -- 172.21.15.42:0/3311401629 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facec06cd20 con 0x7facec157a90 2024-09-17T01:41:44.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.641+0000 7face3400640 1 -- 172.21.15.42:0/3311401629 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7face400ac50 con 0x7facec157a90 2024-09-17T01:41:44.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.642+0000 7face3400640 1 --2- 172.21.15.42:0/3311401629 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7facc8078bc0 0x7facc807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:44.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.642+0000 7face3400640 1 -- 172.21.15.42:0/3311401629 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7face409abd0 con 0x7facec157a90 2024-09-17T01:41:44.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.643+0000 7facea800640 1 --2- 172.21.15.42:0/3311401629 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7facc8078bc0 0x7facc807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:44.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.644+0000 7facea800640 1 --2- 172.21.15.42:0/3311401629 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7facc8078bc0 0x7facc807b0d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7facdc007fd0 tx=0x7facdc009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:44.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.647+0000 7face3400640 1 -- 172.21.15.42:0/3311401629 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7facec1f9900 con 0x7facec157a90 2024-09-17T01:41:44.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.840+0000 7facf0a00640 1 -- 172.21.15.42:0/3311401629 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7facec15ef20 con 0x7facc8078bc0 2024-09-17T01:41:44.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.845+0000 7face3400640 1 -- 172.21.15.42:0/3311401629 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246831 (secure 0 0 0) 0x7facec15ef20 con 0x7facc8078bc0 2024-09-17T01:41:44.847 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:41:44.848 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:41:44.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.849+0000 7facf0a00640 1 -- 172.21.15.42:0/3311401629 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7facc8078bc0 msgr2=0x7facc807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:44.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.849+0000 7facf0a00640 1 --2- 172.21.15.42:0/3311401629 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7facc8078bc0 0x7facc807b0d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7facdc007fd0 tx=0x7facdc009040 comp rx=0 tx=0).stop 2024-09-17T01:41:44.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.849+0000 7facf0a00640 1 -- 172.21.15.42:0/3311401629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facec157a90 msgr2=0x7facec159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:44.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.849+0000 7facf0a00640 1 --2- 172.21.15.42:0/3311401629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facec157a90 0x7facec159380 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7face400c730 tx=0x7face400cbf0 comp rx=0 tx=0).stop 2024-09-17T01:41:44.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.849+0000 7facf0a00640 1 -- 172.21.15.42:0/3311401629 shutdown_connections 2024-09-17T01:41:44.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.849+0000 7facf0a00640 1 --2- 172.21.15.42:0/3311401629 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7facc8078bc0 0x7facc807b0d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:44.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.849+0000 7facf0a00640 1 --2- 172.21.15.42:0/3311401629 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7facec0d0d80 0x7facec0b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:44.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.849+0000 7facf0a00640 1 --2- 172.21.15.42:0/3311401629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facec157a90 0x7facec159380 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:44.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.849+0000 7facf0a00640 1 --2- 172.21.15.42:0/3311401629 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7facec0af460 0x7facec1f93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:44.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.849+0000 7facf0a00640 1 -- 172.21.15.42:0/3311401629 >> 172.21.15.42:0/3311401629 conn(0x7facec0b25f0 msgr2=0x7facec0b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:44.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.849+0000 7facf0a00640 1 -- 172.21.15.42:0/3311401629 shutdown_connections 2024-09-17T01:41:44.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:44.849+0000 7facf0a00640 1 -- 172.21.15.42:0/3311401629 wait complete. 2024-09-17T01:41:44.869 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":424,"stamp":"2024-09-17T01:41:43.147828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591040,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":109,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":186,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":401096,"kb_used_data":14160,"kb_used_omap":12,"kb_used_meta":386739,"kb_avail":754573624,"statfs":{"total":773094113280,"available":772683390976,"internally_reserved":0,"allocated":14499840,"data_stored":7009932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":396021300},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.290543"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.868734+0000","last_change":"2024-09-17T01:41:38.868734+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.868734+0000","last_undegraded":"2024-09-17T01:41:38.868734+0000","last_fullsized":"2024-09-17T01:41:38.868734+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.866981+0000","last_change":"2024-09-17T01:41:38.866981+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.866981+0000","last_undegraded":"2024-09-17T01:41:38.866981+0000","last_fullsized":"2024-09-17T01:41:38.866981+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.875019+0000","last_change":"2024-09-17T01:41:38.875019+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.875019+0000","last_undegraded":"2024-09-17T01:41:38.875019+0000","last_fullsized":"2024-09-17T01:41:38.875019+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:41:38.855854+0000","last_change":"2024-09-17T01:41:38.855854+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.855854+0000","last_undegraded":"2024-09-17T01:41:38.855854+0000","last_fullsized":"2024-09-17T01:41:38.855854+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.910148+0000","last_change":"2024-09-17T01:41:39.908288+0000","last_active":"2024-09-17T01:41:39.910148+0000","last_peered":"2024-09-17T01:41:39.910148+0000","last_clean":"2024-09-17T01:41:39.910148+0000","last_became_active":"2024-09-17T01:41:39.906273+0000","last_became_peered":"2024-09-17T01:41:39.906273+0000","last_unstale":"2024-09-17T01:41:39.910148+0000","last_undegraded":"2024-09-17T01:41:39.910148+0000","last_fullsized":"2024-09-17T01:41:39.910148+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:51.859583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.876422+0000","last_change":"2024-09-17T01:41:38.876422+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.876422+0000","last_undegraded":"2024-09-17T01:41:38.876422+0000","last_fullsized":"2024-09-17T01:41:38.876422+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.919586+0000","last_change":"2024-09-17T01:41:39.918635+0000","last_active":"2024-09-17T01:41:39.919586+0000","last_peered":"2024-09-17T01:41:39.919586+0000","last_clean":"2024-09-17T01:41:39.919586+0000","last_became_active":"2024-09-17T01:41:39.918295+0000","last_became_peered":"2024-09-17T01:41:39.918295+0000","last_unstale":"2024-09-17T01:41:39.919586+0000","last_undegraded":"2024-09-17T01:41:39.919586+0000","last_fullsized":"2024-09-17T01:41:39.919586+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:08:55.104996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.908066+0000","last_change":"2024-09-17T01:41:39.903573+0000","last_active":"2024-09-17T01:41:39.908066+0000","last_peered":"2024-09-17T01:41:39.908066+0000","last_clean":"2024-09-17T01:41:39.908066+0000","last_became_active":"2024-09-17T01:41:39.903235+0000","last_became_peered":"2024-09-17T01:41:39.903235+0000","last_unstale":"2024-09-17T01:41:39.908066+0000","last_undegraded":"2024-09-17T01:41:39.908066+0000","last_fullsized":"2024-09-17T01:41:39.908066+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:29.001520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.878071+0000","last_change":"2024-09-17T01:41:38.878071+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.878071+0000","last_undegraded":"2024-09-17T01:41:38.878071+0000","last_fullsized":"2024-09-17T01:41:38.878071+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.866384+0000","last_change":"2024-09-17T01:41:38.866384+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.866384+0000","last_undegraded":"2024-09-17T01:41:38.866384+0000","last_fullsized":"2024-09-17T01:41:38.866384+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:41:38.855854+0000","last_change":"2024-09-17T01:41:38.855854+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.855854+0000","last_undegraded":"2024-09-17T01:41:38.855854+0000","last_fullsized":"2024-09-17T01:41:38.855854+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.880998+0000","last_change":"2024-09-17T01:41:38.880998+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.880998+0000","last_undegraded":"2024-09-17T01:41:38.880998+0000","last_fullsized":"2024-09-17T01:41:38.880998+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:41:38.855854+0000","last_change":"2024-09-17T01:41:38.855854+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.855854+0000","last_undegraded":"2024-09-17T01:41:38.855854+0000","last_fullsized":"2024-09-17T01:41:38.855854+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.869227+0000","last_change":"2024-09-17T01:41:38.869227+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.869227+0000","last_undegraded":"2024-09-17T01:41:38.869227+0000","last_fullsized":"2024-09-17T01:41:38.869227+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.876300+0000","last_change":"2024-09-17T01:41:38.876300+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.876300+0000","last_undegraded":"2024-09-17T01:41:38.876300+0000","last_fullsized":"2024-09-17T01:41:38.876300+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.871560+0000","last_change":"2024-09-17T01:41:38.871560+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.871560+0000","last_undegraded":"2024-09-17T01:41:38.871560+0000","last_fullsized":"2024-09-17T01:41:38.871560+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.877613+0000","last_change":"2024-09-17T01:41:38.877613+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.877613+0000","last_undegraded":"2024-09-17T01:41:38.877613+0000","last_fullsized":"2024-09-17T01:41:38.877613+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.878965+0000","last_change":"2024-09-17T01:41:38.878965+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.878965+0000","last_undegraded":"2024-09-17T01:41:38.878965+0000","last_fullsized":"2024-09-17T01:41:38.878965+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.867677+0000","last_change":"2024-09-17T01:41:38.867677+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.867677+0000","last_undegraded":"2024-09-17T01:41:38.867677+0000","last_fullsized":"2024-09-17T01:41:38.867677+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.881132+0000","last_change":"2024-09-17T01:41:38.881132+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.881132+0000","last_undegraded":"2024-09-17T01:41:38.881132+0000","last_fullsized":"2024-09-17T01:41:38.881132+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.885429+0000","last_change":"2024-09-17T01:41:38.885429+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.885429+0000","last_undegraded":"2024-09-17T01:41:38.885429+0000","last_fullsized":"2024-09-17T01:41:38.885429+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.865921+0000","last_change":"2024-09-17T01:41:38.865921+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.865921+0000","last_undegraded":"2024-09-17T01:41:38.865921+0000","last_fullsized":"2024-09-17T01:41:38.865921+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.867809+0000","last_change":"2024-09-17T01:41:38.867809+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.867809+0000","last_undegraded":"2024-09-17T01:41:38.867809+0000","last_fullsized":"2024-09-17T01:41:38.867809+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.877377+0000","last_change":"2024-09-17T01:41:38.877377+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.877377+0000","last_undegraded":"2024-09-17T01:41:38.877377+0000","last_fullsized":"2024-09-17T01:41:38.877377+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:41:38.855854+0000","last_change":"2024-09-17T01:41:38.855854+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.855854+0000","last_undegraded":"2024-09-17T01:41:38.855854+0000","last_fullsized":"2024-09-17T01:41:38.855854+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.865814+0000","last_change":"2024-09-17T01:41:38.865814+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.865814+0000","last_undegraded":"2024-09-17T01:41:38.865814+0000","last_fullsized":"2024-09-17T01:41:38.865814+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.866964+0000","last_change":"2024-09-17T01:41:38.866964+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.866964+0000","last_undegraded":"2024-09-17T01:41:38.866964+0000","last_fullsized":"2024-09-17T01:41:38.866964+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.867340+0000","last_change":"2024-09-17T01:41:38.867340+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.867340+0000","last_undegraded":"2024-09-17T01:41:38.867340+0000","last_fullsized":"2024-09-17T01:41:38.867340+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.863824+0000","last_change":"2024-09-17T01:41:38.863824+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.863824+0000","last_undegraded":"2024-09-17T01:41:38.863824+0000","last_fullsized":"2024-09-17T01:41:38.863824+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.865047+0000","last_change":"2024-09-17T01:41:38.865047+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.865047+0000","last_undegraded":"2024-09-17T01:41:38.865047+0000","last_fullsized":"2024-09-17T01:41:38.865047+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.867234+0000","last_change":"2024-09-17T01:41:38.867234+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.867234+0000","last_undegraded":"2024-09-17T01:41:38.867234+0000","last_fullsized":"2024-09-17T01:41:38.867234+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.874407+0000","last_change":"2024-09-17T01:41:38.874407+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.874407+0000","last_undegraded":"2024-09-17T01:41:38.874407+0000","last_fullsized":"2024-09-17T01:41:38.874407+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.868366+0000","last_change":"2024-09-17T01:41:38.868366+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.868366+0000","last_undegraded":"2024-09-17T01:41:38.868366+0000","last_fullsized":"2024-09-17T01:41:38.868366+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"135'4","reported_seq":17,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.912694+0000","last_change":"2024-09-17T01:41:38.882554+0000","last_active":"2024-09-17T01:41:39.912694+0000","last_peered":"2024-09-17T01:41:39.912694+0000","last_clean":"2024-09-17T01:41:39.912694+0000","last_became_active":"2024-09-17T01:41:38.882209+0000","last_became_peered":"2024-09-17T01:41:38.882209+0000","last_unstale":"2024-09-17T01:41:39.912694+0000","last_undegraded":"2024-09-17T01:41:39.912694+0000","last_fullsized":"2024-09-17T01:41:39.912694+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:26.546849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.877163+0000","last_change":"2024-09-17T01:41:38.877163+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.877163+0000","last_undegraded":"2024-09-17T01:41:38.877163+0000","last_fullsized":"2024-09-17T01:41:38.877163+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.893618+0000","last_change":"2024-09-17T01:41:38.892289+0000","last_active":"2024-09-17T01:41:38.893618+0000","last_peered":"2024-09-17T01:41:38.893618+0000","last_clean":"2024-09-17T01:41:38.893618+0000","last_became_active":"2024-09-17T01:41:38.891979+0000","last_became_peered":"2024-09-17T01:41:38.891979+0000","last_unstale":"2024-09-17T01:41:38.893618+0000","last_undegraded":"2024-09-17T01:41:38.893618+0000","last_fullsized":"2024-09-17T01:41:38.893618+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:57.693879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.870183+0000","last_change":"2024-09-17T01:41:38.870183+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.870183+0000","last_undegraded":"2024-09-17T01:41:38.870183+0000","last_fullsized":"2024-09-17T01:41:38.870183+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-17T01:41:37.863079+0000","last_change":"2024-09-17T01:41:37.863079+0000","last_active":"2024-09-17T01:41:37.848311+0000","last_peered":"2024-09-17T01:41:37.848311+0000","last_clean":"2024-09-17T01:41:37.848311+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:37.863079+0000","last_undegraded":"2024-09-17T01:41:37.863079+0000","last_fullsized":"2024-09-17T01:41:37.863079+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.872585+0000","last_change":"2024-09-17T01:41:38.872585+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.872585+0000","last_undegraded":"2024-09-17T01:41:38.872585+0000","last_fullsized":"2024-09-17T01:41:38.872585+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.886629+0000","last_change":"2024-09-17T01:41:38.885583+0000","last_active":"2024-09-17T01:41:38.886629+0000","last_peered":"2024-09-17T01:41:38.886629+0000","last_clean":"2024-09-17T01:41:38.886629+0000","last_became_active":"2024-09-17T01:41:38.884223+0000","last_became_peered":"2024-09-17T01:41:38.884223+0000","last_unstale":"2024-09-17T01:41:38.886629+0000","last_undegraded":"2024-09-17T01:41:38.886629+0000","last_fullsized":"2024-09-17T01:41:38.886629+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:50:34.707198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.880491+0000","last_change":"2024-09-17T01:41:38.880491+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.880491+0000","last_undegraded":"2024-09-17T01:41:38.880491+0000","last_fullsized":"2024-09-17T01:41:38.880491+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.879995+0000","last_change":"2024-09-17T01:41:38.873721+0000","last_active":"2024-09-17T01:41:38.879995+0000","last_peered":"2024-09-17T01:41:38.879995+0000","last_clean":"2024-09-17T01:41:38.879995+0000","last_became_active":"2024-09-17T01:41:38.873362+0000","last_became_peered":"2024-09-17T01:41:38.873362+0000","last_unstale":"2024-09-17T01:41:38.879995+0000","last_undegraded":"2024-09-17T01:41:38.879995+0000","last_fullsized":"2024-09-17T01:41:38.879995+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:09.085348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.874545+0000","last_change":"2024-09-17T01:41:38.874545+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.874545+0000","last_undegraded":"2024-09-17T01:41:38.874545+0000","last_fullsized":"2024-09-17T01:41:38.874545+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.891048+0000","last_change":"2024-09-17T01:41:38.889732+0000","last_active":"2024-09-17T01:41:38.891048+0000","last_peered":"2024-09-17T01:41:38.891048+0000","last_clean":"2024-09-17T01:41:38.891048+0000","last_became_active":"2024-09-17T01:41:38.888209+0000","last_became_peered":"2024-09-17T01:41:38.888209+0000","last_unstale":"2024-09-17T01:41:38.891048+0000","last_undegraded":"2024-09-17T01:41:38.891048+0000","last_fullsized":"2024-09-17T01:41:38.891048+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:00.415477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.876149+0000","last_change":"2024-09-17T01:41:38.876149+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.876149+0000","last_undegraded":"2024-09-17T01:41:38.876149+0000","last_fullsized":"2024-09-17T01:41:38.876149+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.890343+0000","last_change":"2024-09-17T01:41:38.885067+0000","last_active":"2024-09-17T01:41:38.890343+0000","last_peered":"2024-09-17T01:41:38.890343+0000","last_clean":"2024-09-17T01:41:38.890343+0000","last_became_active":"2024-09-17T01:41:38.884745+0000","last_became_peered":"2024-09-17T01:41:38.884745+0000","last_unstale":"2024-09-17T01:41:38.890343+0000","last_undegraded":"2024-09-17T01:41:38.890343+0000","last_fullsized":"2024-09-17T01:41:38.890343+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:53.122084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.863383+0000","last_change":"2024-09-17T01:41:38.863383+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.863383+0000","last_undegraded":"2024-09-17T01:41:38.863383+0000","last_fullsized":"2024-09-17T01:41:38.863383+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.887039+0000","last_change":"2024-09-17T01:41:38.881509+0000","last_active":"2024-09-17T01:41:38.887039+0000","last_peered":"2024-09-17T01:41:38.887039+0000","last_clean":"2024-09-17T01:41:38.887039+0000","last_became_active":"2024-09-17T01:41:38.881199+0000","last_became_peered":"2024-09-17T01:41:38.881199+0000","last_unstale":"2024-09-17T01:41:38.887039+0000","last_undegraded":"2024-09-17T01:41:38.887039+0000","last_fullsized":"2024-09-17T01:41:38.887039+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:36.695146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.865232+0000","last_change":"2024-09-17T01:41:38.865232+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.865232+0000","last_undegraded":"2024-09-17T01:41:38.865232+0000","last_fullsized":"2024-09-17T01:41:38.865232+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.889604+0000","last_change":"2024-09-17T01:41:38.887052+0000","last_active":"2024-09-17T01:41:38.889604+0000","last_peered":"2024-09-17T01:41:38.889604+0000","last_clean":"2024-09-17T01:41:38.889604+0000","last_became_active":"2024-09-17T01:41:38.886738+0000","last_became_peered":"2024-09-17T01:41:38.886738+0000","last_unstale":"2024-09-17T01:41:38.889604+0000","last_undegraded":"2024-09-17T01:41:38.889604+0000","last_fullsized":"2024-09-17T01:41:38.889604+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:14.477019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.911538+0000","last_change":"2024-09-17T01:41:39.909805+0000","last_active":"2024-09-17T01:41:39.911538+0000","last_peered":"2024-09-17T01:41:39.911538+0000","last_clean":"2024-09-17T01:41:39.911538+0000","last_became_active":"2024-09-17T01:41:39.909106+0000","last_became_peered":"2024-09-17T01:41:39.909106+0000","last_unstale":"2024-09-17T01:41:39.911538+0000","last_undegraded":"2024-09-17T01:41:39.911538+0000","last_fullsized":"2024-09-17T01:41:39.911538+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:33.309654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.887030+0000","last_change":"2024-09-17T01:41:38.885697+0000","last_active":"2024-09-17T01:41:38.887030+0000","last_peered":"2024-09-17T01:41:38.887030+0000","last_clean":"2024-09-17T01:41:38.887030+0000","last_became_active":"2024-09-17T01:41:38.885354+0000","last_became_peered":"2024-09-17T01:41:38.885354+0000","last_unstale":"2024-09-17T01:41:38.887030+0000","last_undegraded":"2024-09-17T01:41:38.887030+0000","last_fullsized":"2024-09-17T01:41:38.887030+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:49.439856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.873192+0000","last_change":"2024-09-17T01:41:38.873192+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.873192+0000","last_undegraded":"2024-09-17T01:41:38.873192+0000","last_fullsized":"2024-09-17T01:41:38.873192+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"135'3","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.917421+0000","last_change":"2024-09-17T01:41:38.884961+0000","last_active":"2024-09-17T01:41:39.917421+0000","last_peered":"2024-09-17T01:41:39.917421+0000","last_clean":"2024-09-17T01:41:39.917421+0000","last_became_active":"2024-09-17T01:41:38.884641+0000","last_became_peered":"2024-09-17T01:41:38.884641+0000","last_unstale":"2024-09-17T01:41:39.917421+0000","last_undegraded":"2024-09-17T01:41:39.917421+0000","last_fullsized":"2024-09-17T01:41:39.917421+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:39.247990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.867092+0000","last_change":"2024-09-17T01:41:38.867092+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.867092+0000","last_undegraded":"2024-09-17T01:41:38.867092+0000","last_fullsized":"2024-09-17T01:41:38.867092+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.891766+0000","last_change":"2024-09-17T01:41:38.889323+0000","last_active":"2024-09-17T01:41:38.891766+0000","last_peered":"2024-09-17T01:41:38.891766+0000","last_clean":"2024-09-17T01:41:38.891766+0000","last_became_active":"2024-09-17T01:41:38.889016+0000","last_became_peered":"2024-09-17T01:41:38.889016+0000","last_unstale":"2024-09-17T01:41:38.891766+0000","last_undegraded":"2024-09-17T01:41:38.891766+0000","last_fullsized":"2024-09-17T01:41:38.891766+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:38.578359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.863871+0000","last_change":"2024-09-17T01:41:38.863871+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.863871+0000","last_undegraded":"2024-09-17T01:41:38.863871+0000","last_fullsized":"2024-09-17T01:41:38.863871+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.883252+0000","last_change":"2024-09-17T01:41:38.879765+0000","last_active":"2024-09-17T01:41:38.883252+0000","last_peered":"2024-09-17T01:41:38.883252+0000","last_clean":"2024-09-17T01:41:38.883252+0000","last_became_active":"2024-09-17T01:41:38.878997+0000","last_became_peered":"2024-09-17T01:41:38.878997+0000","last_unstale":"2024-09-17T01:41:38.883252+0000","last_undegraded":"2024-09-17T01:41:38.883252+0000","last_fullsized":"2024-09-17T01:41:38.883252+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:35.406588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.870158+0000","last_change":"2024-09-17T01:41:38.870158+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.870158+0000","last_undegraded":"2024-09-17T01:41:38.870158+0000","last_fullsized":"2024-09-17T01:41:38.870158+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-17T01:41:37.864403+0000","last_change":"2024-09-17T01:41:37.864403+0000","last_active":"2024-09-17T01:41:37.848311+0000","last_peered":"2024-09-17T01:41:37.848311+0000","last_clean":"2024-09-17T01:41:37.848311+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:37.864403+0000","last_undegraded":"2024-09-17T01:41:37.864403+0000","last_fullsized":"2024-09-17T01:41:37.864403+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.883020+0000","last_change":"2024-09-17T01:41:38.883020+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.883020+0000","last_undegraded":"2024-09-17T01:41:38.883020+0000","last_fullsized":"2024-09-17T01:41:38.883020+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.891415+0000","last_change":"2024-09-17T01:41:38.890585+0000","last_active":"2024-09-17T01:41:38.891415+0000","last_peered":"2024-09-17T01:41:38.891415+0000","last_clean":"2024-09-17T01:41:38.891415+0000","last_became_active":"2024-09-17T01:41:38.890139+0000","last_became_peered":"2024-09-17T01:41:38.890139+0000","last_unstale":"2024-09-17T01:41:38.891415+0000","last_undegraded":"2024-09-17T01:41:38.891415+0000","last_fullsized":"2024-09-17T01:41:38.891415+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:15.166636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.905548+0000","last_change":"2024-09-17T01:41:39.897936+0000","last_active":"2024-09-17T01:41:39.905548+0000","last_peered":"2024-09-17T01:41:39.905548+0000","last_clean":"2024-09-17T01:41:39.905548+0000","last_became_active":"2024-09-17T01:41:39.896967+0000","last_became_peered":"2024-09-17T01:41:39.896967+0000","last_unstale":"2024-09-17T01:41:39.905548+0000","last_undegraded":"2024-09-17T01:41:39.905548+0000","last_fullsized":"2024-09-17T01:41:39.905548+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:39.882004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.889631+0000","last_change":"2024-09-17T01:41:38.888104+0000","last_active":"2024-09-17T01:41:38.889631+0000","last_peered":"2024-09-17T01:41:38.889631+0000","last_clean":"2024-09-17T01:41:38.889631+0000","last_became_active":"2024-09-17T01:41:38.887512+0000","last_became_peered":"2024-09-17T01:41:38.887512+0000","last_unstale":"2024-09-17T01:41:38.889631+0000","last_undegraded":"2024-09-17T01:41:38.889631+0000","last_fullsized":"2024-09-17T01:41:38.889631+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:44.791124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.908176+0000","last_change":"2024-09-17T01:41:39.899540+0000","last_active":"2024-09-17T01:41:39.908176+0000","last_peered":"2024-09-17T01:41:39.908176+0000","last_clean":"2024-09-17T01:41:39.908176+0000","last_became_active":"2024-09-17T01:41:39.899234+0000","last_became_peered":"2024-09-17T01:41:39.899234+0000","last_unstale":"2024-09-17T01:41:39.908176+0000","last_undegraded":"2024-09-17T01:41:39.908176+0000","last_fullsized":"2024-09-17T01:41:39.908176+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:11.013229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-17T01:41:37.862935+0000","last_change":"2024-09-17T01:41:37.862935+0000","last_active":"2024-09-17T01:41:37.848311+0000","last_peered":"2024-09-17T01:41:37.848311+0000","last_clean":"2024-09-17T01:41:37.848311+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:37.862935+0000","last_undegraded":"2024-09-17T01:41:37.862935+0000","last_fullsized":"2024-09-17T01:41:37.862935+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.865135+0000","last_change":"2024-09-17T01:41:38.865135+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.865135+0000","last_undegraded":"2024-09-17T01:41:38.865135+0000","last_fullsized":"2024-09-17T01:41:38.865135+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.884553+0000","last_change":"2024-09-17T01:41:38.882538+0000","last_active":"2024-09-17T01:41:38.884553+0000","last_peered":"2024-09-17T01:41:38.884553+0000","last_clean":"2024-09-17T01:41:38.884553+0000","last_became_active":"2024-09-17T01:41:38.882135+0000","last_became_peered":"2024-09-17T01:41:38.882135+0000","last_unstale":"2024-09-17T01:41:38.884553+0000","last_undegraded":"2024-09-17T01:41:38.884553+0000","last_fullsized":"2024-09-17T01:41:38.884553+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:04:29.068100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.863961+0000","last_change":"2024-09-17T01:41:38.863961+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.863961+0000","last_undegraded":"2024-09-17T01:41:38.863961+0000","last_fullsized":"2024-09-17T01:41:38.863961+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.885618+0000","last_change":"2024-09-17T01:41:38.888723+0000","last_active":"2024-09-17T01:41:39.885618+0000","last_peered":"2024-09-17T01:41:39.885618+0000","last_clean":"2024-09-17T01:41:39.885618+0000","last_became_active":"2024-09-17T01:41:38.888363+0000","last_became_peered":"2024-09-17T01:41:38.888363+0000","last_unstale":"2024-09-17T01:41:39.885618+0000","last_undegraded":"2024-09-17T01:41:39.885618+0000","last_fullsized":"2024-09-17T01:41:39.885618+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:33.994701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.863344+0000","last_change":"2024-09-17T01:41:38.863344+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.863344+0000","last_undegraded":"2024-09-17T01:41:38.863344+0000","last_fullsized":"2024-09-17T01:41:38.863344+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.884938+0000","last_change":"2024-09-17T01:41:38.882994+0000","last_active":"2024-09-17T01:41:38.884938+0000","last_peered":"2024-09-17T01:41:38.884938+0000","last_clean":"2024-09-17T01:41:38.884938+0000","last_became_active":"2024-09-17T01:41:38.882780+0000","last_became_peered":"2024-09-17T01:41:38.882780+0000","last_unstale":"2024-09-17T01:41:38.884938+0000","last_undegraded":"2024-09-17T01:41:38.884938+0000","last_fullsized":"2024-09-17T01:41:38.884938+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:06.070748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.866887+0000","last_change":"2024-09-17T01:41:38.866887+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.866887+0000","last_undegraded":"2024-09-17T01:41:38.866887+0000","last_fullsized":"2024-09-17T01:41:38.866887+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.891870+0000","last_change":"2024-09-17T01:41:38.890582+0000","last_active":"2024-09-17T01:41:38.891870+0000","last_peered":"2024-09-17T01:41:38.891870+0000","last_clean":"2024-09-17T01:41:38.891870+0000","last_became_active":"2024-09-17T01:41:38.890231+0000","last_became_peered":"2024-09-17T01:41:38.890231+0000","last_unstale":"2024-09-17T01:41:38.891870+0000","last_undegraded":"2024-09-17T01:41:38.891870+0000","last_fullsized":"2024-09-17T01:41:38.891870+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:19:15.427968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.868098+0000","last_change":"2024-09-17T01:41:38.868098+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.868098+0000","last_undegraded":"2024-09-17T01:41:38.868098+0000","last_fullsized":"2024-09-17T01:41:38.868098+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.890523+0000","last_change":"2024-09-17T01:41:38.889563+0000","last_active":"2024-09-17T01:41:38.890523+0000","last_peered":"2024-09-17T01:41:38.890523+0000","last_clean":"2024-09-17T01:41:38.890523+0000","last_became_active":"2024-09-17T01:41:38.888781+0000","last_became_peered":"2024-09-17T01:41:38.888781+0000","last_unstale":"2024-09-17T01:41:38.890523+0000","last_undegraded":"2024-09-17T01:41:38.890523+0000","last_fullsized":"2024-09-17T01:41:38.890523+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:56.749885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.881119+0000","last_change":"2024-09-17T01:41:38.881119+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.881119+0000","last_undegraded":"2024-09-17T01:41:38.881119+0000","last_fullsized":"2024-09-17T01:41:38.881119+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-17T01:41:37.862881+0000","last_change":"2024-09-17T01:41:37.862881+0000","last_active":"2024-09-17T01:41:37.848311+0000","last_peered":"2024-09-17T01:41:37.848311+0000","last_clean":"2024-09-17T01:41:37.848311+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:37.862881+0000","last_undegraded":"2024-09-17T01:41:37.862881+0000","last_fullsized":"2024-09-17T01:41:37.862881+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.867786+0000","last_change":"2024-09-17T01:41:38.867786+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.867786+0000","last_undegraded":"2024-09-17T01:41:38.867786+0000","last_fullsized":"2024-09-17T01:41:38.867786+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.888367+0000","last_change":"2024-09-17T01:41:38.886108+0000","last_active":"2024-09-17T01:41:38.888367+0000","last_peered":"2024-09-17T01:41:38.888367+0000","last_clean":"2024-09-17T01:41:38.888367+0000","last_became_active":"2024-09-17T01:41:38.885735+0000","last_became_peered":"2024-09-17T01:41:38.885735+0000","last_unstale":"2024-09-17T01:41:38.888367+0000","last_undegraded":"2024-09-17T01:41:38.888367+0000","last_fullsized":"2024-09-17T01:41:38.888367+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:42.626059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.868215+0000","last_change":"2024-09-17T01:41:38.868215+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.868215+0000","last_undegraded":"2024-09-17T01:41:38.868215+0000","last_fullsized":"2024-09-17T01:41:38.868215+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.885906+0000","last_change":"2024-09-17T01:41:38.888956+0000","last_active":"2024-09-17T01:41:39.885906+0000","last_peered":"2024-09-17T01:41:39.885906+0000","last_clean":"2024-09-17T01:41:39.885906+0000","last_became_active":"2024-09-17T01:41:38.888591+0000","last_became_peered":"2024-09-17T01:41:38.888591+0000","last_unstale":"2024-09-17T01:41:39.885906+0000","last_undegraded":"2024-09-17T01:41:39.885906+0000","last_fullsized":"2024-09-17T01:41:39.885906+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:23.963194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.869002+0000","last_change":"2024-09-17T01:41:38.869002+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.869002+0000","last_undegraded":"2024-09-17T01:41:38.869002+0000","last_fullsized":"2024-09-17T01:41:38.869002+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.894246+0000","last_change":"2024-09-17T01:41:38.893661+0000","last_active":"2024-09-17T01:41:38.894246+0000","last_peered":"2024-09-17T01:41:38.894246+0000","last_clean":"2024-09-17T01:41:38.894246+0000","last_became_active":"2024-09-17T01:41:38.893356+0000","last_became_peered":"2024-09-17T01:41:38.893356+0000","last_unstale":"2024-09-17T01:41:38.894246+0000","last_undegraded":"2024-09-17T01:41:38.894246+0000","last_fullsized":"2024-09-17T01:41:38.894246+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:40.441295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.871122+0000","last_change":"2024-09-17T01:41:38.871122+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.871122+0000","last_undegraded":"2024-09-17T01:41:38.871122+0000","last_fullsized":"2024-09-17T01:41:38.871122+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.886856+0000","last_change":"2024-09-17T01:41:38.882409+0000","last_active":"2024-09-17T01:41:38.886856+0000","last_peered":"2024-09-17T01:41:38.886856+0000","last_clean":"2024-09-17T01:41:38.886856+0000","last_became_active":"2024-09-17T01:41:38.882062+0000","last_became_peered":"2024-09-17T01:41:38.882062+0000","last_unstale":"2024-09-17T01:41:38.886856+0000","last_undegraded":"2024-09-17T01:41:38.886856+0000","last_fullsized":"2024-09-17T01:41:38.886856+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:51:12.107940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.875875+0000","last_change":"2024-09-17T01:41:38.875875+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.875875+0000","last_undegraded":"2024-09-17T01:41:38.875875+0000","last_fullsized":"2024-09-17T01:41:38.875875+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.886711+0000","last_change":"2024-09-17T01:41:38.885009+0000","last_active":"2024-09-17T01:41:38.886711+0000","last_peered":"2024-09-17T01:41:38.886711+0000","last_clean":"2024-09-17T01:41:38.886711+0000","last_became_active":"2024-09-17T01:41:38.884672+0000","last_became_peered":"2024-09-17T01:41:38.884672+0000","last_unstale":"2024-09-17T01:41:38.886711+0000","last_undegraded":"2024-09-17T01:41:38.886711+0000","last_fullsized":"2024-09-17T01:41:38.886711+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:19.539609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.873964+0000","last_change":"2024-09-17T01:41:38.873964+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.873964+0000","last_undegraded":"2024-09-17T01:41:38.873964+0000","last_fullsized":"2024-09-17T01:41:38.873964+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.895078+0000","last_change":"2024-09-17T01:41:38.894301+0000","last_active":"2024-09-17T01:41:38.895078+0000","last_peered":"2024-09-17T01:41:38.895078+0000","last_clean":"2024-09-17T01:41:38.895078+0000","last_became_active":"2024-09-17T01:41:38.893976+0000","last_became_peered":"2024-09-17T01:41:38.893976+0000","last_unstale":"2024-09-17T01:41:38.895078+0000","last_undegraded":"2024-09-17T01:41:38.895078+0000","last_fullsized":"2024-09-17T01:41:38.895078+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:46.237489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.876056+0000","last_change":"2024-09-17T01:41:38.876056+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.876056+0000","last_undegraded":"2024-09-17T01:41:38.876056+0000","last_fullsized":"2024-09-17T01:41:38.876056+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2024-09-17T01:41:37.863671+0000","last_change":"2024-09-17T01:41:37.863671+0000","last_active":"2024-09-17T01:41:37.848311+0000","last_peered":"2024-09-17T01:41:37.848311+0000","last_clean":"2024-09-17T01:41:37.848311+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:37.863671+0000","last_undegraded":"2024-09-17T01:41:37.863671+0000","last_fullsized":"2024-09-17T01:41:37.863671+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.870158+0000","last_change":"2024-09-17T01:41:38.870158+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.870158+0000","last_undegraded":"2024-09-17T01:41:38.870158+0000","last_fullsized":"2024-09-17T01:41:38.870158+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.882511+0000","last_change":"2024-09-17T01:41:38.879650+0000","last_active":"2024-09-17T01:41:38.882511+0000","last_peered":"2024-09-17T01:41:38.882511+0000","last_clean":"2024-09-17T01:41:38.882511+0000","last_became_active":"2024-09-17T01:41:38.879319+0000","last_became_peered":"2024-09-17T01:41:38.879319+0000","last_unstale":"2024-09-17T01:41:38.882511+0000","last_undegraded":"2024-09-17T01:41:38.882511+0000","last_fullsized":"2024-09-17T01:41:38.882511+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:04.957002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-17T01:41:38.869085+0000","last_change":"2024-09-17T01:41:38.869085+0000","last_active":"2024-09-17T01:41:38.855854+0000","last_peered":"2024-09-17T01:41:38.855854+0000","last_clean":"2024-09-17T01:41:38.855854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:41:38.869085+0000","last_undegraded":"2024-09-17T01:41:38.869085+0000","last_fullsized":"2024-09-17T01:41:38.869085+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.895050+0000","last_change":"2024-09-17T01:41:38.894268+0000","last_active":"2024-09-17T01:41:38.895050+0000","last_peered":"2024-09-17T01:41:38.895050+0000","last_clean":"2024-09-17T01:41:38.895050+0000","last_became_active":"2024-09-17T01:41:38.893934+0000","last_became_peered":"2024-09-17T01:41:38.893934+0000","last_unstale":"2024-09-17T01:41:38.895050+0000","last_undegraded":"2024-09-17T01:41:38.895050+0000","last_fullsized":"2024-09-17T01:41:38.895050+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:01.753560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":323,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-17T01:41:38.861571+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:41:38.861571+0000","last_peered":"2024-09-17T01:41:38.861571+0000","last_clean":"2024-09-17T01:41:38.861571+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:41:38.861571+0000","last_undegraded":"2024-09-17T01:41:38.861571+0000","last_fullsized":"2024-09-17T01:41:38.861571+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":120,"acting":120,"num_store_stats":7},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476857,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55040,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316800,"statfs":{"total":96636764160,"available":96580403200,"internally_reserved":0,"allocated":1683456,"data_stored":735950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509560,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32812,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339028,"statfs":{"total":96636764160,"available":96603164672,"internally_reserved":0,"allocated":1662976,"data_stored":728503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509559,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55024,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316816,"statfs":{"total":96636764160,"available":96580419584,"internally_reserved":0,"allocated":1662976,"data_stored":728503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509560,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59180,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312660,"statfs":{"total":96636764160,"available":96576163840,"internally_reserved":0,"allocated":1662976,"data_stored":728503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509560,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59184,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312656,"statfs":{"total":96636764160,"available":96576159744,"internally_reserved":0,"allocated":1662976,"data_stored":728503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509559,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51448,"kb_used_data":2204,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320392,"statfs":{"total":96636764160,"available":96584081408,"internally_reserved":0,"allocated":2256896,"data_stored":1318871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509561,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28656,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343184,"statfs":{"total":96636764160,"available":96607420416,"internally_reserved":0,"allocated":1662976,"data_stored":728503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542265,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59752,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312088,"statfs":{"total":96636764160,"available":96575578112,"internally_reserved":0,"allocated":2244608,"data_stored":1312596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:41:44.873 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:41:45.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.138+0000 7fc455a00640 1 -- 172.21.15.42:0/2431759618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc434004d40 msgr2=0x7fc434005170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:45.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.138+0000 7fc455a00640 1 --2- 172.21.15.42:0/2431759618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc434004d40 0x7fc434005170 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fc4500ce760 tx=0x7fc434005830 comp rx=0 tx=0).stop 2024-09-17T01:41:45.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.138+0000 7fc44f400640 1 -- 172.21.15.42:0/2431759618 reap_dead start 2024-09-17T01:41:45.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.138+0000 7fc455a00640 1 -- 172.21.15.42:0/2431759618 shutdown_connections 2024-09-17T01:41:45.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.138+0000 7fc455a00640 1 -- 172.21.15.42:0/2431759618 >> 172.21.15.42:0/2431759618 conn(0x7fc4500b2930 msgr2=0x7fc45006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:45.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.138+0000 7fc455a00640 1 -- 172.21.15.42:0/2431759618 shutdown_connections 2024-09-17T01:41:45.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.138+0000 7fc455a00640 1 -- 172.21.15.42:0/2431759618 wait complete. 2024-09-17T01:41:45.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.141+0000 7fc455a00640 1 Processor -- start 2024-09-17T01:41:45.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.141+0000 7fc455a00640 1 -- start start 2024-09-17T01:41:45.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.142+0000 7fc455a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc434004d40 0x7fc4500aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:45.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.142+0000 7fc455a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4500cbe80 0x7fc4500cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:45.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.142+0000 7fc455a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc4500cc7d0 0x7fc4501f8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:45.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.142+0000 7fc455a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc4500cf3e0 con 0x7fc434004d40 2024-09-17T01:41:45.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.142+0000 7fc455a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc4500cf260 con 0x7fc4500cbe80 2024-09-17T01:41:45.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.142+0000 7fc455a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc45006d430 con 0x7fc4500cc7d0 2024-09-17T01:41:45.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.142+0000 7fc44ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc434004d40 0x7fc4500aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:45.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.142+0000 7fc44ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc434004d40 0x7fc4500aa490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34244/0 (socket says 172.21.15.42:34244) 2024-09-17T01:41:45.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.142+0000 7fc44ea00640 1 -- 172.21.15.42:0/2943177168 learned_addr learned my addr 172.21.15.42:0/2943177168 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:45.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.143+0000 7fc447e00640 1 --2- 172.21.15.42:0/2943177168 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4500cbe80 0x7fc4500cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:45.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.143+0000 7fc44f400640 1 --2- 172.21.15.42:0/2943177168 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc4500cc7d0 0x7fc4501f8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:45.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.143+0000 7fc44ea00640 1 -- 172.21.15.42:0/2943177168 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc4500cc7d0 msgr2=0x7fc4501f8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:45.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.143+0000 7fc44ea00640 1 --2- 172.21.15.42:0/2943177168 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc4500cc7d0 0x7fc4501f8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:45.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.143+0000 7fc44ea00640 1 -- 172.21.15.42:0/2943177168 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4500cbe80 msgr2=0x7fc4500cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:45.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.143+0000 7fc44ea00640 1 --2- 172.21.15.42:0/2943177168 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4500cbe80 0x7fc4500cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:45.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.143+0000 7fc44ea00640 1 -- 172.21.15.42:0/2943177168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc450141e10 con 0x7fc434004d40 2024-09-17T01:41:45.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.143+0000 7fc44ea00640 1 --2- 172.21.15.42:0/2943177168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc434004d40 0x7fc4500aa490 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fc4400064b0 tx=0x7fc4400039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:45.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.143+0000 7fc446a00640 1 -- 172.21.15.42:0/2943177168 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440015070 con 0x7fc434004d40 2024-09-17T01:41:45.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.143+0000 7fc446a00640 1 -- 172.21.15.42:0/2943177168 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc440011860 con 0x7fc434004d40 2024-09-17T01:41:45.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.143+0000 7fc446a00640 1 -- 172.21.15.42:0/2943177168 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440011cb0 con 0x7fc434004d40 2024-09-17T01:41:45.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.143+0000 7fc455a00640 1 -- 172.21.15.42:0/2943177168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc450141050 con 0x7fc434004d40 2024-09-17T01:41:45.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.144+0000 7fc455a00640 1 -- 172.21.15.42:0/2943177168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc450141610 con 0x7fc434004d40 2024-09-17T01:41:45.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.145+0000 7fc455a00640 1 -- 172.21.15.42:0/2943177168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc45006d9c0 con 0x7fc434004d40 2024-09-17T01:41:45.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.146+0000 7fc446a00640 1 -- 172.21.15.42:0/2943177168 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc440018070 con 0x7fc434004d40 2024-09-17T01:41:45.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.147+0000 7fc446a00640 1 --2- 172.21.15.42:0/2943177168 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc42c078bc0 0x7fc42c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:45.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.147+0000 7fc446a00640 1 -- 172.21.15.42:0/2943177168 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7fc44009b9f0 con 0x7fc434004d40 2024-09-17T01:41:45.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.147+0000 7fc447e00640 1 --2- 172.21.15.42:0/2943177168 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc42c078bc0 0x7fc42c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:45.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.148+0000 7fc447e00640 1 --2- 172.21.15.42:0/2943177168 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc42c078bc0 0x7fc42c07b0d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc438006fd0 tx=0x7fc438006f20 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:45.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.151+0000 7fc446a00640 1 -- 172.21.15.42:0/2943177168 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc440063e40 con 0x7fc434004d40 2024-09-17T01:41:45.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.341+0000 7fc455a00640 1 -- 172.21.15.42:0/2943177168 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc45006a170 con 0x7fc42c078bc0 2024-09-17T01:41:45.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.347+0000 7fc446a00640 1 -- 172.21.15.42:0/2943177168 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252469 (secure 0 0 0) 0x7fc45006a170 con 0x7fc42c078bc0 2024-09-17T01:41:45.349 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:41:45.350 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:41:45.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.351+0000 7fc455a00640 1 -- 172.21.15.42:0/2943177168 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc42c078bc0 msgr2=0x7fc42c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:45.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.351+0000 7fc455a00640 1 --2- 172.21.15.42:0/2943177168 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc42c078bc0 0x7fc42c07b0d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc438006fd0 tx=0x7fc438006f20 comp rx=0 tx=0).stop 2024-09-17T01:41:45.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.351+0000 7fc455a00640 1 -- 172.21.15.42:0/2943177168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc434004d40 msgr2=0x7fc4500aa490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:45.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.351+0000 7fc455a00640 1 --2- 172.21.15.42:0/2943177168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc434004d40 0x7fc4500aa490 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fc4400064b0 tx=0x7fc4400039c0 comp rx=0 tx=0).stop 2024-09-17T01:41:45.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.351+0000 7fc455a00640 1 -- 172.21.15.42:0/2943177168 shutdown_connections 2024-09-17T01:41:45.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.351+0000 7fc455a00640 1 --2- 172.21.15.42:0/2943177168 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc42c078bc0 0x7fc42c07b0d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:45.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.351+0000 7fc455a00640 1 --2- 172.21.15.42:0/2943177168 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4500cbe80 0x7fc4500cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:45.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.351+0000 7fc455a00640 1 --2- 172.21.15.42:0/2943177168 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc4500cc7d0 0x7fc4501f8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:45.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.351+0000 7fc455a00640 1 --2- 172.21.15.42:0/2943177168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc434004d40 0x7fc4500aa490 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:45.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.351+0000 7fc455a00640 1 -- 172.21.15.42:0/2943177168 >> 172.21.15.42:0/2943177168 conn(0x7fc4500b2930 msgr2=0x7fc45006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:45.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.351+0000 7fc455a00640 1 -- 172.21.15.42:0/2943177168 shutdown_connections 2024-09-17T01:41:45.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.351+0000 7fc455a00640 1 -- 172.21.15.42:0/2943177168 wait complete. 2024-09-17T01:41:45.372 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":425,"stamp":"2024-09-17T01:41:45.148270+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":401324,"kb_used_data":14396,"kb_used_omap":12,"kb_used_meta":386739,"kb_avail":754573396,"statfs":{"total":773094113280,"available":772683157504,"internally_reserved":0,"allocated":14741504,"data_stored":7111880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":396021300},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.287560"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889403+0000","last_change":"2024-09-17T01:41:39.913354+0000","last_active":"2024-09-17T01:41:40.889403+0000","last_peered":"2024-09-17T01:41:40.889403+0000","last_clean":"2024-09-17T01:41:40.889403+0000","last_became_active":"2024-09-17T01:41:39.913007+0000","last_became_peered":"2024-09-17T01:41:39.913007+0000","last_unstale":"2024-09-17T01:41:40.889403+0000","last_undegraded":"2024-09-17T01:41:40.889403+0000","last_fullsized":"2024-09-17T01:41:40.889403+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:47:19.205133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890027+0000","last_change":"2024-09-17T01:41:39.898479+0000","last_active":"2024-09-17T01:41:40.890027+0000","last_peered":"2024-09-17T01:41:40.890027+0000","last_clean":"2024-09-17T01:41:40.890027+0000","last_became_active":"2024-09-17T01:41:39.898142+0000","last_became_peered":"2024-09-17T01:41:39.898142+0000","last_unstale":"2024-09-17T01:41:40.890027+0000","last_undegraded":"2024-09-17T01:41:40.890027+0000","last_fullsized":"2024-09-17T01:41:40.890027+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:04:30.075643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354355+0000","last_change":"2024-09-17T01:41:39.891779+0000","last_active":"2024-09-17T01:41:41.354355+0000","last_peered":"2024-09-17T01:41:41.354355+0000","last_clean":"2024-09-17T01:41:41.354355+0000","last_became_active":"2024-09-17T01:41:39.888460+0000","last_became_peered":"2024-09-17T01:41:39.888460+0000","last_unstale":"2024-09-17T01:41:41.354355+0000","last_undegraded":"2024-09-17T01:41:41.354355+0000","last_fullsized":"2024-09-17T01:41:41.354355+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:13.500130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.935705+0000","last_change":"2024-09-17T01:41:39.914186+0000","last_active":"2024-09-17T01:41:40.935705+0000","last_peered":"2024-09-17T01:41:40.935705+0000","last_clean":"2024-09-17T01:41:40.935705+0000","last_became_active":"2024-09-17T01:41:39.913857+0000","last_became_peered":"2024-09-17T01:41:39.913857+0000","last_unstale":"2024-09-17T01:41:40.935705+0000","last_undegraded":"2024-09-17T01:41:40.935705+0000","last_fullsized":"2024-09-17T01:41:40.935705+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:50:50.092216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.910148+0000","last_change":"2024-09-17T01:41:39.908288+0000","last_active":"2024-09-17T01:41:39.910148+0000","last_peered":"2024-09-17T01:41:39.910148+0000","last_clean":"2024-09-17T01:41:39.910148+0000","last_became_active":"2024-09-17T01:41:39.906273+0000","last_became_peered":"2024-09-17T01:41:39.906273+0000","last_unstale":"2024-09-17T01:41:39.910148+0000","last_undegraded":"2024-09-17T01:41:39.910148+0000","last_fullsized":"2024-09-17T01:41:39.910148+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:51.859583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355866+0000","last_change":"2024-09-17T01:41:39.917260+0000","last_active":"2024-09-17T01:41:41.355866+0000","last_peered":"2024-09-17T01:41:41.355866+0000","last_clean":"2024-09-17T01:41:41.355866+0000","last_became_active":"2024-09-17T01:41:39.916904+0000","last_became_peered":"2024-09-17T01:41:39.916904+0000","last_unstale":"2024-09-17T01:41:41.355866+0000","last_undegraded":"2024-09-17T01:41:41.355866+0000","last_fullsized":"2024-09-17T01:41:41.355866+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:52.970207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.919586+0000","last_change":"2024-09-17T01:41:39.918635+0000","last_active":"2024-09-17T01:41:39.919586+0000","last_peered":"2024-09-17T01:41:39.919586+0000","last_clean":"2024-09-17T01:41:39.919586+0000","last_became_active":"2024-09-17T01:41:39.918295+0000","last_became_peered":"2024-09-17T01:41:39.918295+0000","last_unstale":"2024-09-17T01:41:39.919586+0000","last_undegraded":"2024-09-17T01:41:39.919586+0000","last_fullsized":"2024-09-17T01:41:39.919586+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:08:55.104996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.908066+0000","last_change":"2024-09-17T01:41:39.903573+0000","last_active":"2024-09-17T01:41:39.908066+0000","last_peered":"2024-09-17T01:41:39.908066+0000","last_clean":"2024-09-17T01:41:39.908066+0000","last_became_active":"2024-09-17T01:41:39.903235+0000","last_became_peered":"2024-09-17T01:41:39.903235+0000","last_unstale":"2024-09-17T01:41:39.908066+0000","last_undegraded":"2024-09-17T01:41:39.908066+0000","last_fullsized":"2024-09-17T01:41:39.908066+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:29.001520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356289+0000","last_change":"2024-09-17T01:41:39.905348+0000","last_active":"2024-09-17T01:41:41.356289+0000","last_peered":"2024-09-17T01:41:41.356289+0000","last_clean":"2024-09-17T01:41:41.356289+0000","last_became_active":"2024-09-17T01:41:39.900434+0000","last_became_peered":"2024-09-17T01:41:39.900434+0000","last_unstale":"2024-09-17T01:41:41.356289+0000","last_undegraded":"2024-09-17T01:41:41.356289+0000","last_fullsized":"2024-09-17T01:41:41.356289+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:33.033181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890293+0000","last_change":"2024-09-17T01:41:39.914311+0000","last_active":"2024-09-17T01:41:40.890293+0000","last_peered":"2024-09-17T01:41:40.890293+0000","last_clean":"2024-09-17T01:41:40.890293+0000","last_became_active":"2024-09-17T01:41:39.913985+0000","last_became_peered":"2024-09-17T01:41:39.913985+0000","last_unstale":"2024-09-17T01:41:40.890293+0000","last_undegraded":"2024-09-17T01:41:40.890293+0000","last_fullsized":"2024-09-17T01:41:40.890293+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:07.078291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.935875+0000","last_change":"2024-09-17T01:41:39.896447+0000","last_active":"2024-09-17T01:41:40.935875+0000","last_peered":"2024-09-17T01:41:40.935875+0000","last_clean":"2024-09-17T01:41:40.935875+0000","last_became_active":"2024-09-17T01:41:39.896096+0000","last_became_peered":"2024-09-17T01:41:39.896096+0000","last_unstale":"2024-09-17T01:41:40.935875+0000","last_undegraded":"2024-09-17T01:41:40.935875+0000","last_fullsized":"2024-09-17T01:41:40.935875+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:54.345098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355079+0000","last_change":"2024-09-17T01:41:39.913333+0000","last_active":"2024-09-17T01:41:41.355079+0000","last_peered":"2024-09-17T01:41:41.355079+0000","last_clean":"2024-09-17T01:41:41.355079+0000","last_became_active":"2024-09-17T01:41:39.907889+0000","last_became_peered":"2024-09-17T01:41:39.907889+0000","last_unstale":"2024-09-17T01:41:41.355079+0000","last_undegraded":"2024-09-17T01:41:41.355079+0000","last_fullsized":"2024-09-17T01:41:41.355079+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:37.231590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.935672+0000","last_change":"2024-09-17T01:41:39.895367+0000","last_active":"2024-09-17T01:41:40.935672+0000","last_peered":"2024-09-17T01:41:40.935672+0000","last_clean":"2024-09-17T01:41:40.935672+0000","last_became_active":"2024-09-17T01:41:39.893777+0000","last_became_peered":"2024-09-17T01:41:39.893777+0000","last_unstale":"2024-09-17T01:41:40.935672+0000","last_undegraded":"2024-09-17T01:41:40.935672+0000","last_fullsized":"2024-09-17T01:41:40.935672+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:09.465366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.888803+0000","last_change":"2024-09-17T01:41:39.901406+0000","last_active":"2024-09-17T01:41:40.888803+0000","last_peered":"2024-09-17T01:41:40.888803+0000","last_clean":"2024-09-17T01:41:40.888803+0000","last_became_active":"2024-09-17T01:41:39.897993+0000","last_became_peered":"2024-09-17T01:41:39.897993+0000","last_unstale":"2024-09-17T01:41:40.888803+0000","last_undegraded":"2024-09-17T01:41:40.888803+0000","last_fullsized":"2024-09-17T01:41:40.888803+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:46.007752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355340+0000","last_change":"2024-09-17T01:41:39.912799+0000","last_active":"2024-09-17T01:41:41.355340+0000","last_peered":"2024-09-17T01:41:41.355340+0000","last_clean":"2024-09-17T01:41:41.355340+0000","last_became_active":"2024-09-17T01:41:39.911355+0000","last_became_peered":"2024-09-17T01:41:39.911355+0000","last_unstale":"2024-09-17T01:41:41.355340+0000","last_undegraded":"2024-09-17T01:41:41.355340+0000","last_fullsized":"2024-09-17T01:41:41.355340+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:48.438144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889263+0000","last_change":"2024-09-17T01:41:39.912148+0000","last_active":"2024-09-17T01:41:40.889263+0000","last_peered":"2024-09-17T01:41:40.889263+0000","last_clean":"2024-09-17T01:41:40.889263+0000","last_became_active":"2024-09-17T01:41:39.911648+0000","last_became_peered":"2024-09-17T01:41:39.911648+0000","last_unstale":"2024-09-17T01:41:40.889263+0000","last_undegraded":"2024-09-17T01:41:40.889263+0000","last_fullsized":"2024-09-17T01:41:40.889263+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:28.353951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356472+0000","last_change":"2024-09-17T01:41:39.906031+0000","last_active":"2024-09-17T01:41:41.356472+0000","last_peered":"2024-09-17T01:41:41.356472+0000","last_clean":"2024-09-17T01:41:41.356472+0000","last_became_active":"2024-09-17T01:41:39.899628+0000","last_became_peered":"2024-09-17T01:41:39.899628+0000","last_unstale":"2024-09-17T01:41:41.356472+0000","last_undegraded":"2024-09-17T01:41:41.356472+0000","last_fullsized":"2024-09-17T01:41:41.356472+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:52.036134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355595+0000","last_change":"2024-09-17T01:41:39.893407+0000","last_active":"2024-09-17T01:41:41.355595+0000","last_peered":"2024-09-17T01:41:41.355595+0000","last_clean":"2024-09-17T01:41:41.355595+0000","last_became_active":"2024-09-17T01:41:39.892194+0000","last_became_peered":"2024-09-17T01:41:39.892194+0000","last_unstale":"2024-09-17T01:41:41.355595+0000","last_undegraded":"2024-09-17T01:41:41.355595+0000","last_fullsized":"2024-09-17T01:41:41.355595+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:21.295162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.888633+0000","last_change":"2024-09-17T01:41:39.894550+0000","last_active":"2024-09-17T01:41:40.888633+0000","last_peered":"2024-09-17T01:41:40.888633+0000","last_clean":"2024-09-17T01:41:40.888633+0000","last_became_active":"2024-09-17T01:41:39.893953+0000","last_became_peered":"2024-09-17T01:41:39.893953+0000","last_unstale":"2024-09-17T01:41:40.888633+0000","last_undegraded":"2024-09-17T01:41:40.888633+0000","last_fullsized":"2024-09-17T01:41:40.888633+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:48.878097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355155+0000","last_change":"2024-09-17T01:41:39.896804+0000","last_active":"2024-09-17T01:41:41.355155+0000","last_peered":"2024-09-17T01:41:41.355155+0000","last_clean":"2024-09-17T01:41:41.355155+0000","last_became_active":"2024-09-17T01:41:39.896444+0000","last_became_peered":"2024-09-17T01:41:39.896444+0000","last_unstale":"2024-09-17T01:41:41.355155+0000","last_undegraded":"2024-09-17T01:41:41.355155+0000","last_fullsized":"2024-09-17T01:41:41.355155+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:38.192115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355540+0000","last_change":"2024-09-17T01:41:39.914678+0000","last_active":"2024-09-17T01:41:41.355540+0000","last_peered":"2024-09-17T01:41:41.355540+0000","last_clean":"2024-09-17T01:41:41.355540+0000","last_became_active":"2024-09-17T01:41:39.910960+0000","last_became_peered":"2024-09-17T01:41:39.910960+0000","last_unstale":"2024-09-17T01:41:41.355540+0000","last_undegraded":"2024-09-17T01:41:41.355540+0000","last_fullsized":"2024-09-17T01:41:41.355540+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:05.964545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.888892+0000","last_change":"2024-09-17T01:41:39.892112+0000","last_active":"2024-09-17T01:41:40.888892+0000","last_peered":"2024-09-17T01:41:40.888892+0000","last_clean":"2024-09-17T01:41:40.888892+0000","last_became_active":"2024-09-17T01:41:39.891206+0000","last_became_peered":"2024-09-17T01:41:39.891206+0000","last_unstale":"2024-09-17T01:41:40.888892+0000","last_undegraded":"2024-09-17T01:41:40.888892+0000","last_fullsized":"2024-09-17T01:41:40.888892+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:59:11.138821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.887069+0000","last_change":"2024-09-17T01:41:39.918528+0000","last_active":"2024-09-17T01:41:40.887069+0000","last_peered":"2024-09-17T01:41:40.887069+0000","last_clean":"2024-09-17T01:41:40.887069+0000","last_became_active":"2024-09-17T01:41:39.915444+0000","last_became_peered":"2024-09-17T01:41:39.915444+0000","last_unstale":"2024-09-17T01:41:40.887069+0000","last_undegraded":"2024-09-17T01:41:40.887069+0000","last_fullsized":"2024-09-17T01:41:40.887069+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:06.532999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354875+0000","last_change":"2024-09-17T01:41:39.909626+0000","last_active":"2024-09-17T01:41:41.354875+0000","last_peered":"2024-09-17T01:41:41.354875+0000","last_clean":"2024-09-17T01:41:41.354875+0000","last_became_active":"2024-09-17T01:41:39.909214+0000","last_became_peered":"2024-09-17T01:41:39.909214+0000","last_unstale":"2024-09-17T01:41:41.354875+0000","last_undegraded":"2024-09-17T01:41:41.354875+0000","last_fullsized":"2024-09-17T01:41:41.354875+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:07.538851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.936068+0000","last_change":"2024-09-17T01:41:39.906230+0000","last_active":"2024-09-17T01:41:40.936068+0000","last_peered":"2024-09-17T01:41:40.936068+0000","last_clean":"2024-09-17T01:41:40.936068+0000","last_became_active":"2024-09-17T01:41:39.905323+0000","last_became_peered":"2024-09-17T01:41:39.905323+0000","last_unstale":"2024-09-17T01:41:40.936068+0000","last_undegraded":"2024-09-17T01:41:40.936068+0000","last_fullsized":"2024-09-17T01:41:40.936068+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:59.969882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890617+0000","last_change":"2024-09-17T01:41:39.892358+0000","last_active":"2024-09-17T01:41:40.890617+0000","last_peered":"2024-09-17T01:41:40.890617+0000","last_clean":"2024-09-17T01:41:40.890617+0000","last_became_active":"2024-09-17T01:41:39.892007+0000","last_became_peered":"2024-09-17T01:41:39.892007+0000","last_unstale":"2024-09-17T01:41:40.890617+0000","last_undegraded":"2024-09-17T01:41:40.890617+0000","last_fullsized":"2024-09-17T01:41:40.890617+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:54.129628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890388+0000","last_change":"2024-09-17T01:41:39.915488+0000","last_active":"2024-09-17T01:41:40.890388+0000","last_peered":"2024-09-17T01:41:40.890388+0000","last_clean":"2024-09-17T01:41:40.890388+0000","last_became_active":"2024-09-17T01:41:39.914235+0000","last_became_peered":"2024-09-17T01:41:39.914235+0000","last_unstale":"2024-09-17T01:41:40.890388+0000","last_undegraded":"2024-09-17T01:41:40.890388+0000","last_fullsized":"2024-09-17T01:41:40.890388+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:53.298805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.887348+0000","last_change":"2024-09-17T01:41:39.905009+0000","last_active":"2024-09-17T01:41:40.887348+0000","last_peered":"2024-09-17T01:41:40.887348+0000","last_clean":"2024-09-17T01:41:40.887348+0000","last_became_active":"2024-09-17T01:41:39.904661+0000","last_became_peered":"2024-09-17T01:41:39.904661+0000","last_unstale":"2024-09-17T01:41:40.887348+0000","last_undegraded":"2024-09-17T01:41:40.887348+0000","last_fullsized":"2024-09-17T01:41:40.887348+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:57.134013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.888801+0000","last_change":"2024-09-17T01:41:39.903040+0000","last_active":"2024-09-17T01:41:40.888801+0000","last_peered":"2024-09-17T01:41:40.888801+0000","last_clean":"2024-09-17T01:41:40.888801+0000","last_became_active":"2024-09-17T01:41:39.901317+0000","last_became_peered":"2024-09-17T01:41:39.901317+0000","last_unstale":"2024-09-17T01:41:40.888801+0000","last_undegraded":"2024-09-17T01:41:40.888801+0000","last_fullsized":"2024-09-17T01:41:40.888801+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:35.095684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889193+0000","last_change":"2024-09-17T01:41:39.885605+0000","last_active":"2024-09-17T01:41:40.889193+0000","last_peered":"2024-09-17T01:41:40.889193+0000","last_clean":"2024-09-17T01:41:40.889193+0000","last_became_active":"2024-09-17T01:41:39.885269+0000","last_became_peered":"2024-09-17T01:41:39.885269+0000","last_unstale":"2024-09-17T01:41:40.889193+0000","last_undegraded":"2024-09-17T01:41:40.889193+0000","last_fullsized":"2024-09-17T01:41:40.889193+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:57.268242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.887121+0000","last_change":"2024-09-17T01:41:39.900579+0000","last_active":"2024-09-17T01:41:40.887121+0000","last_peered":"2024-09-17T01:41:40.887121+0000","last_clean":"2024-09-17T01:41:40.887121+0000","last_became_active":"2024-09-17T01:41:39.900217+0000","last_became_peered":"2024-09-17T01:41:39.900217+0000","last_unstale":"2024-09-17T01:41:40.887121+0000","last_undegraded":"2024-09-17T01:41:40.887121+0000","last_fullsized":"2024-09-17T01:41:40.887121+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:30.999902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354468+0000","last_change":"2024-09-17T01:41:39.897367+0000","last_active":"2024-09-17T01:41:41.354468+0000","last_peered":"2024-09-17T01:41:41.354468+0000","last_clean":"2024-09-17T01:41:41.354468+0000","last_became_active":"2024-09-17T01:41:39.896177+0000","last_became_peered":"2024-09-17T01:41:39.896177+0000","last_unstale":"2024-09-17T01:41:41.354468+0000","last_undegraded":"2024-09-17T01:41:41.354468+0000","last_fullsized":"2024-09-17T01:41:41.354468+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:43:28.278656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890807+0000","last_change":"2024-09-17T01:41:39.911629+0000","last_active":"2024-09-17T01:41:40.890807+0000","last_peered":"2024-09-17T01:41:40.890807+0000","last_clean":"2024-09-17T01:41:40.890807+0000","last_became_active":"2024-09-17T01:41:39.909976+0000","last_became_peered":"2024-09-17T01:41:39.909976+0000","last_unstale":"2024-09-17T01:41:40.890807+0000","last_undegraded":"2024-09-17T01:41:40.890807+0000","last_fullsized":"2024-09-17T01:41:40.890807+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:29.308671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"135'4","reported_seq":17,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.912694+0000","last_change":"2024-09-17T01:41:38.882554+0000","last_active":"2024-09-17T01:41:39.912694+0000","last_peered":"2024-09-17T01:41:39.912694+0000","last_clean":"2024-09-17T01:41:39.912694+0000","last_became_active":"2024-09-17T01:41:38.882209+0000","last_became_peered":"2024-09-17T01:41:38.882209+0000","last_unstale":"2024-09-17T01:41:39.912694+0000","last_undegraded":"2024-09-17T01:41:39.912694+0000","last_fullsized":"2024-09-17T01:41:39.912694+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:26.546849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356469+0000","last_change":"2024-09-17T01:41:39.905010+0000","last_active":"2024-09-17T01:41:41.356469+0000","last_peered":"2024-09-17T01:41:41.356469+0000","last_clean":"2024-09-17T01:41:41.356469+0000","last_became_active":"2024-09-17T01:41:39.900043+0000","last_became_peered":"2024-09-17T01:41:39.900043+0000","last_unstale":"2024-09-17T01:41:41.356469+0000","last_undegraded":"2024-09-17T01:41:41.356469+0000","last_fullsized":"2024-09-17T01:41:41.356469+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:34.245025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"135'1","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355359+0000","last_change":"2024-09-17T01:41:38.892289+0000","last_active":"2024-09-17T01:41:41.355359+0000","last_peered":"2024-09-17T01:41:41.355359+0000","last_clean":"2024-09-17T01:41:41.355359+0000","last_became_active":"2024-09-17T01:41:38.891979+0000","last_became_peered":"2024-09-17T01:41:38.891979+0000","last_unstale":"2024-09-17T01:41:41.355359+0000","last_undegraded":"2024-09-17T01:41:41.355359+0000","last_fullsized":"2024-09-17T01:41:41.355359+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:00:07.436508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354336+0000","last_change":"2024-09-17T01:41:39.897361+0000","last_active":"2024-09-17T01:41:41.354336+0000","last_peered":"2024-09-17T01:41:41.354336+0000","last_clean":"2024-09-17T01:41:41.354336+0000","last_became_active":"2024-09-17T01:41:39.896982+0000","last_became_peered":"2024-09-17T01:41:39.896982+0000","last_unstale":"2024-09-17T01:41:41.354336+0000","last_undegraded":"2024-09-17T01:41:41.354336+0000","last_fullsized":"2024-09-17T01:41:41.354336+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:17.967702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"135'2","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.935846+0000","last_change":"2024-09-17T01:41:38.882622+0000","last_active":"2024-09-17T01:41:40.935846+0000","last_peered":"2024-09-17T01:41:40.935846+0000","last_clean":"2024-09-17T01:41:40.935846+0000","last_became_active":"2024-09-17T01:41:38.882281+0000","last_became_peered":"2024-09-17T01:41:38.882281+0000","last_unstale":"2024-09-17T01:41:40.935846+0000","last_undegraded":"2024-09-17T01:41:40.935846+0000","last_fullsized":"2024-09-17T01:41:40.935846+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:07.447798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355516+0000","last_change":"2024-09-17T01:41:39.908031+0000","last_active":"2024-09-17T01:41:41.355516+0000","last_peered":"2024-09-17T01:41:41.355516+0000","last_clean":"2024-09-17T01:41:41.355516+0000","last_became_active":"2024-09-17T01:41:39.907678+0000","last_became_peered":"2024-09-17T01:41:39.907678+0000","last_unstale":"2024-09-17T01:41:41.355516+0000","last_undegraded":"2024-09-17T01:41:41.355516+0000","last_fullsized":"2024-09-17T01:41:41.355516+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:11.369139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"135'2","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889421+0000","last_change":"2024-09-17T01:41:38.885583+0000","last_active":"2024-09-17T01:41:40.889421+0000","last_peered":"2024-09-17T01:41:40.889421+0000","last_clean":"2024-09-17T01:41:40.889421+0000","last_became_active":"2024-09-17T01:41:38.884223+0000","last_became_peered":"2024-09-17T01:41:38.884223+0000","last_unstale":"2024-09-17T01:41:40.889421+0000","last_undegraded":"2024-09-17T01:41:40.889421+0000","last_fullsized":"2024-09-17T01:41:40.889421+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:57.796155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355245+0000","last_change":"2024-09-17T01:41:39.902427+0000","last_active":"2024-09-17T01:41:41.355245+0000","last_peered":"2024-09-17T01:41:41.355245+0000","last_clean":"2024-09-17T01:41:41.355245+0000","last_became_active":"2024-09-17T01:41:39.902006+0000","last_became_peered":"2024-09-17T01:41:39.902006+0000","last_unstale":"2024-09-17T01:41:41.355245+0000","last_undegraded":"2024-09-17T01:41:41.355245+0000","last_fullsized":"2024-09-17T01:41:41.355245+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:29.141584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"135'1","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889036+0000","last_change":"2024-09-17T01:41:38.873721+0000","last_active":"2024-09-17T01:41:40.889036+0000","last_peered":"2024-09-17T01:41:40.889036+0000","last_clean":"2024-09-17T01:41:40.889036+0000","last_became_active":"2024-09-17T01:41:38.873362+0000","last_became_peered":"2024-09-17T01:41:38.873362+0000","last_unstale":"2024-09-17T01:41:40.889036+0000","last_undegraded":"2024-09-17T01:41:40.889036+0000","last_fullsized":"2024-09-17T01:41:40.889036+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:33.729661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355819+0000","last_change":"2024-09-17T01:41:39.911915+0000","last_active":"2024-09-17T01:41:41.355819+0000","last_peered":"2024-09-17T01:41:41.355819+0000","last_clean":"2024-09-17T01:41:41.355819+0000","last_became_active":"2024-09-17T01:41:39.907894+0000","last_became_peered":"2024-09-17T01:41:39.907894+0000","last_unstale":"2024-09-17T01:41:41.355819+0000","last_undegraded":"2024-09-17T01:41:41.355819+0000","last_fullsized":"2024-09-17T01:41:41.355819+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:51:13.115483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"135'1","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355048+0000","last_change":"2024-09-17T01:41:38.889732+0000","last_active":"2024-09-17T01:41:41.355048+0000","last_peered":"2024-09-17T01:41:41.355048+0000","last_clean":"2024-09-17T01:41:41.355048+0000","last_became_active":"2024-09-17T01:41:38.888209+0000","last_became_peered":"2024-09-17T01:41:38.888209+0000","last_unstale":"2024-09-17T01:41:41.355048+0000","last_undegraded":"2024-09-17T01:41:41.355048+0000","last_fullsized":"2024-09-17T01:41:41.355048+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:30:06.924877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354994+0000","last_change":"2024-09-17T01:41:39.906748+0000","last_active":"2024-09-17T01:41:41.354994+0000","last_peered":"2024-09-17T01:41:41.354994+0000","last_clean":"2024-09-17T01:41:41.354994+0000","last_became_active":"2024-09-17T01:41:39.906359+0000","last_became_peered":"2024-09-17T01:41:39.906359+0000","last_unstale":"2024-09-17T01:41:41.354994+0000","last_undegraded":"2024-09-17T01:41:41.354994+0000","last_fullsized":"2024-09-17T01:41:41.354994+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:01.721134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355200+0000","last_change":"2024-09-17T01:41:38.885067+0000","last_active":"2024-09-17T01:41:41.355200+0000","last_peered":"2024-09-17T01:41:41.355200+0000","last_clean":"2024-09-17T01:41:41.355200+0000","last_became_active":"2024-09-17T01:41:38.884745+0000","last_became_peered":"2024-09-17T01:41:38.884745+0000","last_unstale":"2024-09-17T01:41:41.355200+0000","last_undegraded":"2024-09-17T01:41:41.355200+0000","last_fullsized":"2024-09-17T01:41:41.355200+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:04.187447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.888462+0000","last_change":"2024-09-17T01:41:39.889546+0000","last_active":"2024-09-17T01:41:40.888462+0000","last_peered":"2024-09-17T01:41:40.888462+0000","last_clean":"2024-09-17T01:41:40.888462+0000","last_became_active":"2024-09-17T01:41:39.889222+0000","last_became_peered":"2024-09-17T01:41:39.889222+0000","last_unstale":"2024-09-17T01:41:40.888462+0000","last_undegraded":"2024-09-17T01:41:40.888462+0000","last_fullsized":"2024-09-17T01:41:40.888462+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:49.208113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.888524+0000","last_change":"2024-09-17T01:41:38.881509+0000","last_active":"2024-09-17T01:41:40.888524+0000","last_peered":"2024-09-17T01:41:40.888524+0000","last_clean":"2024-09-17T01:41:40.888524+0000","last_became_active":"2024-09-17T01:41:38.881199+0000","last_became_peered":"2024-09-17T01:41:38.881199+0000","last_unstale":"2024-09-17T01:41:40.888524+0000","last_undegraded":"2024-09-17T01:41:40.888524+0000","last_fullsized":"2024-09-17T01:41:40.888524+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:41.222557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890838+0000","last_change":"2024-09-17T01:41:39.897599+0000","last_active":"2024-09-17T01:41:40.890838+0000","last_peered":"2024-09-17T01:41:40.890838+0000","last_clean":"2024-09-17T01:41:40.890838+0000","last_became_active":"2024-09-17T01:41:39.897287+0000","last_became_peered":"2024-09-17T01:41:39.897287+0000","last_unstale":"2024-09-17T01:41:40.890838+0000","last_undegraded":"2024-09-17T01:41:40.890838+0000","last_fullsized":"2024-09-17T01:41:40.890838+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:58.701422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355055+0000","last_change":"2024-09-17T01:41:38.887052+0000","last_active":"2024-09-17T01:41:41.355055+0000","last_peered":"2024-09-17T01:41:41.355055+0000","last_clean":"2024-09-17T01:41:41.355055+0000","last_became_active":"2024-09-17T01:41:38.886738+0000","last_became_peered":"2024-09-17T01:41:38.886738+0000","last_unstale":"2024-09-17T01:41:41.355055+0000","last_undegraded":"2024-09-17T01:41:41.355055+0000","last_fullsized":"2024-09-17T01:41:41.355055+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:25.541036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.911538+0000","last_change":"2024-09-17T01:41:39.909805+0000","last_active":"2024-09-17T01:41:39.911538+0000","last_peered":"2024-09-17T01:41:39.911538+0000","last_clean":"2024-09-17T01:41:39.911538+0000","last_became_active":"2024-09-17T01:41:39.909106+0000","last_became_peered":"2024-09-17T01:41:39.909106+0000","last_unstale":"2024-09-17T01:41:39.911538+0000","last_undegraded":"2024-09-17T01:41:39.911538+0000","last_fullsized":"2024-09-17T01:41:39.911538+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:33.309654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355407+0000","last_change":"2024-09-17T01:41:38.885697+0000","last_active":"2024-09-17T01:41:41.355407+0000","last_peered":"2024-09-17T01:41:41.355407+0000","last_clean":"2024-09-17T01:41:41.355407+0000","last_became_active":"2024-09-17T01:41:38.885354+0000","last_became_peered":"2024-09-17T01:41:38.885354+0000","last_unstale":"2024-09-17T01:41:41.355407+0000","last_undegraded":"2024-09-17T01:41:41.355407+0000","last_fullsized":"2024-09-17T01:41:41.355407+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:04.252363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355161+0000","last_change":"2024-09-17T01:41:39.916513+0000","last_active":"2024-09-17T01:41:41.355161+0000","last_peered":"2024-09-17T01:41:41.355161+0000","last_clean":"2024-09-17T01:41:41.355161+0000","last_became_active":"2024-09-17T01:41:39.916156+0000","last_became_peered":"2024-09-17T01:41:39.916156+0000","last_unstale":"2024-09-17T01:41:41.355161+0000","last_undegraded":"2024-09-17T01:41:41.355161+0000","last_fullsized":"2024-09-17T01:41:41.355161+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:45.131482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"135'3","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.917421+0000","last_change":"2024-09-17T01:41:38.884961+0000","last_active":"2024-09-17T01:41:39.917421+0000","last_peered":"2024-09-17T01:41:39.917421+0000","last_clean":"2024-09-17T01:41:39.917421+0000","last_became_active":"2024-09-17T01:41:38.884641+0000","last_became_peered":"2024-09-17T01:41:38.884641+0000","last_unstale":"2024-09-17T01:41:39.917421+0000","last_undegraded":"2024-09-17T01:41:39.917421+0000","last_fullsized":"2024-09-17T01:41:39.917421+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:39.247990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.887591+0000","last_change":"2024-09-17T01:41:39.909629+0000","last_active":"2024-09-17T01:41:40.887591+0000","last_peered":"2024-09-17T01:41:40.887591+0000","last_clean":"2024-09-17T01:41:40.887591+0000","last_became_active":"2024-09-17T01:41:39.909313+0000","last_became_peered":"2024-09-17T01:41:39.909313+0000","last_unstale":"2024-09-17T01:41:40.887591+0000","last_undegraded":"2024-09-17T01:41:40.887591+0000","last_fullsized":"2024-09-17T01:41:40.887591+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:00:02.326795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"135'6","reported_seq":21,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.887362+0000","last_change":"2024-09-17T01:41:38.889323+0000","last_active":"2024-09-17T01:41:40.887362+0000","last_peered":"2024-09-17T01:41:40.887362+0000","last_clean":"2024-09-17T01:41:40.887362+0000","last_became_active":"2024-09-17T01:41:38.889016+0000","last_became_peered":"2024-09-17T01:41:38.889016+0000","last_unstale":"2024-09-17T01:41:40.887362+0000","last_undegraded":"2024-09-17T01:41:40.887362+0000","last_fullsized":"2024-09-17T01:41:40.887362+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:35.060703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889731+0000","last_change":"2024-09-17T01:41:39.903239+0000","last_active":"2024-09-17T01:41:40.889731+0000","last_peered":"2024-09-17T01:41:40.889731+0000","last_clean":"2024-09-17T01:41:40.889731+0000","last_became_active":"2024-09-17T01:41:39.899556+0000","last_became_peered":"2024-09-17T01:41:39.899556+0000","last_unstale":"2024-09-17T01:41:40.889731+0000","last_undegraded":"2024-09-17T01:41:40.889731+0000","last_fullsized":"2024-09-17T01:41:40.889731+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:38.776145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889015+0000","last_change":"2024-09-17T01:41:38.879765+0000","last_active":"2024-09-17T01:41:40.889015+0000","last_peered":"2024-09-17T01:41:40.889015+0000","last_clean":"2024-09-17T01:41:40.889015+0000","last_became_active":"2024-09-17T01:41:38.878997+0000","last_became_peered":"2024-09-17T01:41:38.878997+0000","last_unstale":"2024-09-17T01:41:40.889015+0000","last_undegraded":"2024-09-17T01:41:40.889015+0000","last_fullsized":"2024-09-17T01:41:40.889015+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:14:54.110838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890764+0000","last_change":"2024-09-17T01:41:39.911049+0000","last_active":"2024-09-17T01:41:40.890764+0000","last_peered":"2024-09-17T01:41:40.890764+0000","last_clean":"2024-09-17T01:41:40.890764+0000","last_became_active":"2024-09-17T01:41:39.910371+0000","last_became_peered":"2024-09-17T01:41:39.910371+0000","last_unstale":"2024-09-17T01:41:40.890764+0000","last_undegraded":"2024-09-17T01:41:40.890764+0000","last_fullsized":"2024-09-17T01:41:40.890764+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:55.228058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.935184+0000","last_change":"2024-09-17T01:41:38.887910+0000","last_active":"2024-09-17T01:41:40.935184+0000","last_peered":"2024-09-17T01:41:40.935184+0000","last_clean":"2024-09-17T01:41:40.935184+0000","last_became_active":"2024-09-17T01:41:38.887445+0000","last_became_peered":"2024-09-17T01:41:38.887445+0000","last_unstale":"2024-09-17T01:41:40.935184+0000","last_undegraded":"2024-09-17T01:41:40.935184+0000","last_fullsized":"2024-09-17T01:41:40.935184+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:58:30.941321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355807+0000","last_change":"2024-09-17T01:41:39.907773+0000","last_active":"2024-09-17T01:41:41.355807+0000","last_peered":"2024-09-17T01:41:41.355807+0000","last_clean":"2024-09-17T01:41:41.355807+0000","last_became_active":"2024-09-17T01:41:39.907425+0000","last_became_peered":"2024-09-17T01:41:39.907425+0000","last_unstale":"2024-09-17T01:41:41.355807+0000","last_undegraded":"2024-09-17T01:41:41.355807+0000","last_fullsized":"2024-09-17T01:41:41.355807+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:36.414131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"135'8","reported_seq":23,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355901+0000","last_change":"2024-09-17T01:41:38.890585+0000","last_active":"2024-09-17T01:41:41.355901+0000","last_peered":"2024-09-17T01:41:41.355901+0000","last_clean":"2024-09-17T01:41:41.355901+0000","last_became_active":"2024-09-17T01:41:38.890139+0000","last_became_peered":"2024-09-17T01:41:38.890139+0000","last_unstale":"2024-09-17T01:41:41.355901+0000","last_undegraded":"2024-09-17T01:41:41.355901+0000","last_fullsized":"2024-09-17T01:41:41.355901+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:57.210587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.905548+0000","last_change":"2024-09-17T01:41:39.897936+0000","last_active":"2024-09-17T01:41:39.905548+0000","last_peered":"2024-09-17T01:41:39.905548+0000","last_clean":"2024-09-17T01:41:39.905548+0000","last_became_active":"2024-09-17T01:41:39.896967+0000","last_became_peered":"2024-09-17T01:41:39.896967+0000","last_unstale":"2024-09-17T01:41:39.905548+0000","last_undegraded":"2024-09-17T01:41:39.905548+0000","last_fullsized":"2024-09-17T01:41:39.905548+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:39.882004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"135'1","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355493+0000","last_change":"2024-09-17T01:41:38.888104+0000","last_active":"2024-09-17T01:41:41.355493+0000","last_peered":"2024-09-17T01:41:41.355493+0000","last_clean":"2024-09-17T01:41:41.355493+0000","last_became_active":"2024-09-17T01:41:38.887512+0000","last_became_peered":"2024-09-17T01:41:38.887512+0000","last_unstale":"2024-09-17T01:41:41.355493+0000","last_undegraded":"2024-09-17T01:41:41.355493+0000","last_fullsized":"2024-09-17T01:41:41.355493+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:00.805470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.908176+0000","last_change":"2024-09-17T01:41:39.899540+0000","last_active":"2024-09-17T01:41:39.908176+0000","last_peered":"2024-09-17T01:41:39.908176+0000","last_clean":"2024-09-17T01:41:39.908176+0000","last_became_active":"2024-09-17T01:41:39.899234+0000","last_became_peered":"2024-09-17T01:41:39.899234+0000","last_unstale":"2024-09-17T01:41:39.908176+0000","last_undegraded":"2024-09-17T01:41:39.908176+0000","last_fullsized":"2024-09-17T01:41:39.908176+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:11.013229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"135'2","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.935638+0000","last_change":"2024-09-17T01:41:38.876615+0000","last_active":"2024-09-17T01:41:40.935638+0000","last_peered":"2024-09-17T01:41:40.935638+0000","last_clean":"2024-09-17T01:41:40.935638+0000","last_became_active":"2024-09-17T01:41:38.876250+0000","last_became_peered":"2024-09-17T01:41:38.876250+0000","last_unstale":"2024-09-17T01:41:40.935638+0000","last_undegraded":"2024-09-17T01:41:40.935638+0000","last_fullsized":"2024-09-17T01:41:40.935638+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:13:56.598505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889626+0000","last_change":"2024-09-17T01:41:39.900185+0000","last_active":"2024-09-17T01:41:40.889626+0000","last_peered":"2024-09-17T01:41:40.889626+0000","last_clean":"2024-09-17T01:41:40.889626+0000","last_became_active":"2024-09-17T01:41:39.895207+0000","last_became_peered":"2024-09-17T01:41:39.895207+0000","last_unstale":"2024-09-17T01:41:40.889626+0000","last_undegraded":"2024-09-17T01:41:40.889626+0000","last_fullsized":"2024-09-17T01:41:40.889626+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:52.526963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"135'1","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354567+0000","last_change":"2024-09-17T01:41:38.882538+0000","last_active":"2024-09-17T01:41:41.354567+0000","last_peered":"2024-09-17T01:41:41.354567+0000","last_clean":"2024-09-17T01:41:41.354567+0000","last_became_active":"2024-09-17T01:41:38.882135+0000","last_became_peered":"2024-09-17T01:41:38.882135+0000","last_unstale":"2024-09-17T01:41:41.354567+0000","last_undegraded":"2024-09-17T01:41:41.354567+0000","last_fullsized":"2024-09-17T01:41:41.354567+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:07.429310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.888966+0000","last_change":"2024-09-17T01:41:39.900025+0000","last_active":"2024-09-17T01:41:40.888966+0000","last_peered":"2024-09-17T01:41:40.888966+0000","last_clean":"2024-09-17T01:41:40.888966+0000","last_became_active":"2024-09-17T01:41:39.894040+0000","last_became_peered":"2024-09-17T01:41:39.894040+0000","last_unstale":"2024-09-17T01:41:40.888966+0000","last_undegraded":"2024-09-17T01:41:40.888966+0000","last_fullsized":"2024-09-17T01:41:40.888966+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:33.474943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.885618+0000","last_change":"2024-09-17T01:41:38.888723+0000","last_active":"2024-09-17T01:41:39.885618+0000","last_peered":"2024-09-17T01:41:39.885618+0000","last_clean":"2024-09-17T01:41:39.885618+0000","last_became_active":"2024-09-17T01:41:38.888363+0000","last_became_peered":"2024-09-17T01:41:38.888363+0000","last_unstale":"2024-09-17T01:41:39.885618+0000","last_undegraded":"2024-09-17T01:41:39.885618+0000","last_fullsized":"2024-09-17T01:41:39.885618+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:33.994701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889476+0000","last_change":"2024-09-17T01:41:39.897025+0000","last_active":"2024-09-17T01:41:40.889476+0000","last_peered":"2024-09-17T01:41:40.889476+0000","last_clean":"2024-09-17T01:41:40.889476+0000","last_became_active":"2024-09-17T01:41:39.896625+0000","last_became_peered":"2024-09-17T01:41:39.896625+0000","last_unstale":"2024-09-17T01:41:40.889476+0000","last_undegraded":"2024-09-17T01:41:40.889476+0000","last_fullsized":"2024-09-17T01:41:40.889476+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:10.642076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"135'2","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354691+0000","last_change":"2024-09-17T01:41:38.882994+0000","last_active":"2024-09-17T01:41:41.354691+0000","last_peered":"2024-09-17T01:41:41.354691+0000","last_clean":"2024-09-17T01:41:41.354691+0000","last_became_active":"2024-09-17T01:41:38.882780+0000","last_became_peered":"2024-09-17T01:41:38.882780+0000","last_unstale":"2024-09-17T01:41:41.354691+0000","last_undegraded":"2024-09-17T01:41:41.354691+0000","last_fullsized":"2024-09-17T01:41:41.354691+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:00.702847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.887303+0000","last_change":"2024-09-17T01:41:39.898253+0000","last_active":"2024-09-17T01:41:40.887303+0000","last_peered":"2024-09-17T01:41:40.887303+0000","last_clean":"2024-09-17T01:41:40.887303+0000","last_became_active":"2024-09-17T01:41:39.897745+0000","last_became_peered":"2024-09-17T01:41:39.897745+0000","last_unstale":"2024-09-17T01:41:40.887303+0000","last_undegraded":"2024-09-17T01:41:40.887303+0000","last_fullsized":"2024-09-17T01:41:40.887303+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:31.082175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355346+0000","last_change":"2024-09-17T01:41:38.890582+0000","last_active":"2024-09-17T01:41:41.355346+0000","last_peered":"2024-09-17T01:41:41.355346+0000","last_clean":"2024-09-17T01:41:41.355346+0000","last_became_active":"2024-09-17T01:41:38.890231+0000","last_became_peered":"2024-09-17T01:41:38.890231+0000","last_unstale":"2024-09-17T01:41:41.355346+0000","last_undegraded":"2024-09-17T01:41:41.355346+0000","last_fullsized":"2024-09-17T01:41:41.355346+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:47.416687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889522+0000","last_change":"2024-09-17T01:41:39.893202+0000","last_active":"2024-09-17T01:41:40.889522+0000","last_peered":"2024-09-17T01:41:40.889522+0000","last_clean":"2024-09-17T01:41:40.889522+0000","last_became_active":"2024-09-17T01:41:39.892896+0000","last_became_peered":"2024-09-17T01:41:39.892896+0000","last_unstale":"2024-09-17T01:41:40.889522+0000","last_undegraded":"2024-09-17T01:41:40.889522+0000","last_fullsized":"2024-09-17T01:41:40.889522+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:25.989263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889077+0000","last_change":"2024-09-17T01:41:38.889563+0000","last_active":"2024-09-17T01:41:40.889077+0000","last_peered":"2024-09-17T01:41:40.889077+0000","last_clean":"2024-09-17T01:41:40.889077+0000","last_became_active":"2024-09-17T01:41:38.888781+0000","last_became_peered":"2024-09-17T01:41:38.888781+0000","last_unstale":"2024-09-17T01:41:40.889077+0000","last_undegraded":"2024-09-17T01:41:40.889077+0000","last_fullsized":"2024-09-17T01:41:40.889077+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:58.047664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355838+0000","last_change":"2024-09-17T01:41:39.907743+0000","last_active":"2024-09-17T01:41:41.355838+0000","last_peered":"2024-09-17T01:41:41.355838+0000","last_clean":"2024-09-17T01:41:41.355838+0000","last_became_active":"2024-09-17T01:41:39.907076+0000","last_became_peered":"2024-09-17T01:41:39.907076+0000","last_unstale":"2024-09-17T01:41:41.355838+0000","last_undegraded":"2024-09-17T01:41:41.355838+0000","last_fullsized":"2024-09-17T01:41:41.355838+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:27.450762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.935158+0000","last_change":"2024-09-17T01:41:38.885458+0000","last_active":"2024-09-17T01:41:40.935158+0000","last_peered":"2024-09-17T01:41:40.935158+0000","last_clean":"2024-09-17T01:41:40.935158+0000","last_became_active":"2024-09-17T01:41:38.884884+0000","last_became_peered":"2024-09-17T01:41:38.884884+0000","last_unstale":"2024-09-17T01:41:40.935158+0000","last_undegraded":"2024-09-17T01:41:40.935158+0000","last_fullsized":"2024-09-17T01:41:40.935158+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:41:30.108510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.887585+0000","last_change":"2024-09-17T01:41:39.908682+0000","last_active":"2024-09-17T01:41:40.887585+0000","last_peered":"2024-09-17T01:41:40.887585+0000","last_clean":"2024-09-17T01:41:40.887585+0000","last_became_active":"2024-09-17T01:41:39.908140+0000","last_became_peered":"2024-09-17T01:41:39.908140+0000","last_unstale":"2024-09-17T01:41:40.887585+0000","last_undegraded":"2024-09-17T01:41:40.887585+0000","last_fullsized":"2024-09-17T01:41:40.887585+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:26:50.609089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"135'2","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355567+0000","last_change":"2024-09-17T01:41:38.886108+0000","last_active":"2024-09-17T01:41:41.355567+0000","last_peered":"2024-09-17T01:41:41.355567+0000","last_clean":"2024-09-17T01:41:41.355567+0000","last_became_active":"2024-09-17T01:41:38.885735+0000","last_became_peered":"2024-09-17T01:41:38.885735+0000","last_unstale":"2024-09-17T01:41:41.355567+0000","last_undegraded":"2024-09-17T01:41:41.355567+0000","last_fullsized":"2024-09-17T01:41:41.355567+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:16.913690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889696+0000","last_change":"2024-09-17T01:41:39.910647+0000","last_active":"2024-09-17T01:41:40.889696+0000","last_peered":"2024-09-17T01:41:40.889696+0000","last_clean":"2024-09-17T01:41:40.889696+0000","last_became_active":"2024-09-17T01:41:39.910049+0000","last_became_peered":"2024-09-17T01:41:39.910049+0000","last_unstale":"2024-09-17T01:41:40.889696+0000","last_undegraded":"2024-09-17T01:41:40.889696+0000","last_fullsized":"2024-09-17T01:41:40.889696+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:39.090195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.885906+0000","last_change":"2024-09-17T01:41:38.888956+0000","last_active":"2024-09-17T01:41:39.885906+0000","last_peered":"2024-09-17T01:41:39.885906+0000","last_clean":"2024-09-17T01:41:39.885906+0000","last_became_active":"2024-09-17T01:41:38.888591+0000","last_became_peered":"2024-09-17T01:41:38.888591+0000","last_unstale":"2024-09-17T01:41:39.885906+0000","last_undegraded":"2024-09-17T01:41:39.885906+0000","last_fullsized":"2024-09-17T01:41:39.885906+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:23.963194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890111+0000","last_change":"2024-09-17T01:41:39.908977+0000","last_active":"2024-09-17T01:41:40.890111+0000","last_peered":"2024-09-17T01:41:40.890111+0000","last_clean":"2024-09-17T01:41:40.890111+0000","last_became_active":"2024-09-17T01:41:39.905784+0000","last_became_peered":"2024-09-17T01:41:39.905784+0000","last_unstale":"2024-09-17T01:41:40.890111+0000","last_undegraded":"2024-09-17T01:41:40.890111+0000","last_fullsized":"2024-09-17T01:41:40.890111+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:43.463332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355347+0000","last_change":"2024-09-17T01:41:38.893661+0000","last_active":"2024-09-17T01:41:41.355347+0000","last_peered":"2024-09-17T01:41:41.355347+0000","last_clean":"2024-09-17T01:41:41.355347+0000","last_became_active":"2024-09-17T01:41:38.893356+0000","last_became_peered":"2024-09-17T01:41:38.893356+0000","last_unstale":"2024-09-17T01:41:41.355347+0000","last_undegraded":"2024-09-17T01:41:41.355347+0000","last_fullsized":"2024-09-17T01:41:41.355347+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:07:34.722925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354379+0000","last_change":"2024-09-17T01:41:39.889003+0000","last_active":"2024-09-17T01:41:41.354379+0000","last_peered":"2024-09-17T01:41:41.354379+0000","last_clean":"2024-09-17T01:41:41.354379+0000","last_became_active":"2024-09-17T01:41:39.887179+0000","last_became_peered":"2024-09-17T01:41:39.887179+0000","last_unstale":"2024-09-17T01:41:41.354379+0000","last_undegraded":"2024-09-17T01:41:41.354379+0000","last_fullsized":"2024-09-17T01:41:41.354379+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:50.836313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890153+0000","last_change":"2024-09-17T01:41:38.882409+0000","last_active":"2024-09-17T01:41:40.890153+0000","last_peered":"2024-09-17T01:41:40.890153+0000","last_clean":"2024-09-17T01:41:40.890153+0000","last_became_active":"2024-09-17T01:41:38.882062+0000","last_became_peered":"2024-09-17T01:41:38.882062+0000","last_unstale":"2024-09-17T01:41:40.890153+0000","last_undegraded":"2024-09-17T01:41:40.890153+0000","last_fullsized":"2024-09-17T01:41:40.890153+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:57.441358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356115+0000","last_change":"2024-09-17T01:41:39.910991+0000","last_active":"2024-09-17T01:41:41.356115+0000","last_peered":"2024-09-17T01:41:41.356115+0000","last_clean":"2024-09-17T01:41:41.356115+0000","last_became_active":"2024-09-17T01:41:39.910569+0000","last_became_peered":"2024-09-17T01:41:39.910569+0000","last_unstale":"2024-09-17T01:41:41.356115+0000","last_undegraded":"2024-09-17T01:41:41.356115+0000","last_fullsized":"2024-09-17T01:41:41.356115+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:10.092892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889178+0000","last_change":"2024-09-17T01:41:38.885009+0000","last_active":"2024-09-17T01:41:40.889178+0000","last_peered":"2024-09-17T01:41:40.889178+0000","last_clean":"2024-09-17T01:41:40.889178+0000","last_became_active":"2024-09-17T01:41:38.884672+0000","last_became_peered":"2024-09-17T01:41:38.884672+0000","last_unstale":"2024-09-17T01:41:40.889178+0000","last_undegraded":"2024-09-17T01:41:40.889178+0000","last_fullsized":"2024-09-17T01:41:40.889178+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:38.363973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356082+0000","last_change":"2024-09-17T01:41:39.921777+0000","last_active":"2024-09-17T01:41:41.356082+0000","last_peered":"2024-09-17T01:41:41.356082+0000","last_clean":"2024-09-17T01:41:41.356082+0000","last_became_active":"2024-09-17T01:41:39.921185+0000","last_became_peered":"2024-09-17T01:41:39.921185+0000","last_unstale":"2024-09-17T01:41:41.356082+0000","last_undegraded":"2024-09-17T01:41:41.356082+0000","last_fullsized":"2024-09-17T01:41:41.356082+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:25.074848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356079+0000","last_change":"2024-09-17T01:41:38.894301+0000","last_active":"2024-09-17T01:41:41.356079+0000","last_peered":"2024-09-17T01:41:41.356079+0000","last_clean":"2024-09-17T01:41:41.356079+0000","last_became_active":"2024-09-17T01:41:38.893976+0000","last_became_peered":"2024-09-17T01:41:38.893976+0000","last_unstale":"2024-09-17T01:41:41.356079+0000","last_undegraded":"2024-09-17T01:41:41.356079+0000","last_fullsized":"2024-09-17T01:41:41.356079+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:59.604894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355042+0000","last_change":"2024-09-17T01:41:39.909414+0000","last_active":"2024-09-17T01:41:41.355042+0000","last_peered":"2024-09-17T01:41:41.355042+0000","last_clean":"2024-09-17T01:41:41.355042+0000","last_became_active":"2024-09-17T01:41:39.909077+0000","last_became_peered":"2024-09-17T01:41:39.909077+0000","last_unstale":"2024-09-17T01:41:41.355042+0000","last_undegraded":"2024-09-17T01:41:41.355042+0000","last_fullsized":"2024-09-17T01:41:41.355042+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:09.812199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.935294+0000","last_change":"2024-09-17T01:41:38.887884+0000","last_active":"2024-09-17T01:41:40.935294+0000","last_peered":"2024-09-17T01:41:40.935294+0000","last_clean":"2024-09-17T01:41:40.935294+0000","last_became_active":"2024-09-17T01:41:38.887525+0000","last_became_peered":"2024-09-17T01:41:38.887525+0000","last_unstale":"2024-09-17T01:41:40.935294+0000","last_undegraded":"2024-09-17T01:41:40.935294+0000","last_fullsized":"2024-09-17T01:41:40.935294+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:07.622231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.888864+0000","last_change":"2024-09-17T01:41:39.904820+0000","last_active":"2024-09-17T01:41:40.888864+0000","last_peered":"2024-09-17T01:41:40.888864+0000","last_clean":"2024-09-17T01:41:40.888864+0000","last_became_active":"2024-09-17T01:41:39.904501+0000","last_became_peered":"2024-09-17T01:41:39.904501+0000","last_unstale":"2024-09-17T01:41:40.888864+0000","last_undegraded":"2024-09-17T01:41:40.888864+0000","last_fullsized":"2024-09-17T01:41:40.888864+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:47.339753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889706+0000","last_change":"2024-09-17T01:41:38.879650+0000","last_active":"2024-09-17T01:41:40.889706+0000","last_peered":"2024-09-17T01:41:40.889706+0000","last_clean":"2024-09-17T01:41:40.889706+0000","last_became_active":"2024-09-17T01:41:38.879319+0000","last_became_peered":"2024-09-17T01:41:38.879319+0000","last_unstale":"2024-09-17T01:41:40.889706+0000","last_undegraded":"2024-09-17T01:41:40.889706+0000","last_fullsized":"2024-09-17T01:41:40.889706+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:23.466575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355002+0000","last_change":"2024-09-17T01:41:39.888819+0000","last_active":"2024-09-17T01:41:41.355002+0000","last_peered":"2024-09-17T01:41:41.355002+0000","last_clean":"2024-09-17T01:41:41.355002+0000","last_became_active":"2024-09-17T01:41:39.888416+0000","last_became_peered":"2024-09-17T01:41:39.888416+0000","last_unstale":"2024-09-17T01:41:41.355002+0000","last_undegraded":"2024-09-17T01:41:41.355002+0000","last_fullsized":"2024-09-17T01:41:41.355002+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:47.837413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"135'2","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356283+0000","last_change":"2024-09-17T01:41:38.894268+0000","last_active":"2024-09-17T01:41:41.356283+0000","last_peered":"2024-09-17T01:41:41.356283+0000","last_clean":"2024-09-17T01:41:41.356283+0000","last_became_active":"2024-09-17T01:41:38.893934+0000","last_became_peered":"2024-09-17T01:41:38.893934+0000","last_unstale":"2024-09-17T01:41:41.356283+0000","last_undegraded":"2024-09-17T01:41:41.356283+0000","last_fullsized":"2024-09-17T01:41:41.356283+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:45.765235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":327,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.886919+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:41:40.886919+0000","last_peered":"2024-09-17T01:41:40.886919+0000","last_clean":"2024-09-17T01:41:40.886919+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:41:40.886919+0000","last_undegraded":"2024-09-17T01:41:40.886919+0000","last_fullsized":"2024-09-17T01:41:40.886919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476857,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55040,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316800,"statfs":{"total":96636764160,"available":96580403200,"internally_reserved":0,"allocated":1683456,"data_stored":735950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509561,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32840,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339000,"statfs":{"total":96636764160,"available":96603136000,"internally_reserved":0,"allocated":1691648,"data_stored":741612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509560,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55044,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316796,"statfs":{"total":96636764160,"available":96580399104,"internally_reserved":0,"allocated":1687552,"data_stored":741578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509561,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59212,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312628,"statfs":{"total":96636764160,"available":96576131072,"internally_reserved":0,"allocated":1687552,"data_stored":741578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509561,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59208,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312632,"statfs":{"total":96636764160,"available":96576135168,"internally_reserved":0,"allocated":1691648,"data_stored":741648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509560,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51484,"kb_used_data":2244,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320356,"statfs":{"total":96636764160,"available":96584044544,"internally_reserved":0,"allocated":2297856,"data_stored":1333580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509562,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28700,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343140,"statfs":{"total":96636764160,"available":96607375360,"internally_reserved":0,"allocated":1708032,"data_stored":743246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542266,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59796,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312044,"statfs":{"total":96636764160,"available":96575533056,"internally_reserved":0,"allocated":2293760,"data_stored":1332688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:41:45.380 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:41:45.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.638+0000 7ff6e9000640 1 -- 172.21.15.42:0/1898149731 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6e415cb80 msgr2=0x7ff6e4152710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:45.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.638+0000 7ff6e9000640 1 --2- 172.21.15.42:0/1898149731 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6e415cb80 0x7ff6e4152710 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7ff6e40d0360 tx=0x7ff6d402a560 comp rx=0 tx=0).stop 2024-09-17T01:41:45.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.638+0000 7ff6e9000640 1 -- 172.21.15.42:0/1898149731 shutdown_connections 2024-09-17T01:41:45.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.638+0000 7ff6e9000640 1 --2- 172.21.15.42:0/1898149731 >> v2:172.21.15.43:3300/0 conn(0x7ff6e406d430 0x7ff6e406d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:45.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.638+0000 7ff6e9000640 1 --2- 172.21.15.42:0/1898149731 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6e415cb80 0x7ff6e4152710 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:45.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.638+0000 7ff6e9000640 1 -- 172.21.15.42:0/1898149731 >> 172.21.15.42:0/1898149731 conn(0x7ff6e40b2930 msgr2=0x7ff6e406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:45.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.638+0000 7ff6e9000640 1 -- 172.21.15.42:0/1898149731 shutdown_connections 2024-09-17T01:41:45.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.638+0000 7ff6e9000640 1 -- 172.21.15.42:0/1898149731 wait complete. 2024-09-17T01:41:45.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.640+0000 7ff6e9000640 1 Processor -- start 2024-09-17T01:41:45.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.641+0000 7ff6e9000640 1 -- start start 2024-09-17T01:41:45.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.642+0000 7ff6e9000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6e406d430 0x7ff6e41f3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:45.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.642+0000 7ff6e9000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6e415cb80 0x7ff6e40b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:45.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.642+0000 7ff6e9000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff6e415f480 0x7ff6e414c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:45.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.642+0000 7ff6e9000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e4073820 con 0x7ff6e406d430 2024-09-17T01:41:45.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.642+0000 7ff6e9000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e40736a0 con 0x7ff6e415cb80 2024-09-17T01:41:45.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.642+0000 7ff6e9000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e40739a0 con 0x7ff6e415f480 2024-09-17T01:41:45.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.642+0000 7ff6e1e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6e406d430 0x7ff6e41f3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:45.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.642+0000 7ff6e1e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6e406d430 0x7ff6e41f3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34260/0 (socket says 172.21.15.42:34260) 2024-09-17T01:41:45.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.642+0000 7ff6e1e00640 1 -- 172.21.15.42:0/1717674863 learned_addr learned my addr 172.21.15.42:0/1717674863 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:45.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.643+0000 7ff6dbe00640 1 --2- 172.21.15.42:0/1717674863 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6e415cb80 0x7ff6e40b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:45.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.643+0000 7ff6e2800640 1 --2- 172.21.15.42:0/1717674863 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff6e415f480 0x7ff6e414c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:45.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.643+0000 7ff6e1e00640 1 -- 172.21.15.42:0/1717674863 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff6e415f480 msgr2=0x7ff6e414c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:45.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.643+0000 7ff6e1e00640 1 --2- 172.21.15.42:0/1717674863 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff6e415f480 0x7ff6e414c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:45.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.643+0000 7ff6e1e00640 1 -- 172.21.15.42:0/1717674863 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6e415cb80 msgr2=0x7ff6e40b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:45.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.643+0000 7ff6e1e00640 1 --2- 172.21.15.42:0/1717674863 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6e415cb80 0x7ff6e40b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:45.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.643+0000 7ff6e1e00640 1 -- 172.21.15.42:0/1717674863 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e414dd90 con 0x7ff6e406d430 2024-09-17T01:41:45.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.643+0000 7ff6dbe00640 1 --2- 172.21.15.42:0/1717674863 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6e415cb80 0x7ff6e40b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:41:45.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.643+0000 7ff6e2800640 1 --2- 172.21.15.42:0/1717674863 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff6e415f480 0x7ff6e414c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:41:45.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.643+0000 7ff6e1e00640 1 --2- 172.21.15.42:0/1717674863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6e406d430 0x7ff6e41f3d20 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40099c0 tx=0x7ff6d40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:45.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.643+0000 7ff6da000640 1 -- 172.21.15.42:0/1717674863 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d403e030 con 0x7ff6e406d430 2024-09-17T01:41:45.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.644+0000 7ff6da000640 1 -- 172.21.15.42:0/1717674863 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6d40047a0 con 0x7ff6e406d430 2024-09-17T01:41:45.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.644+0000 7ff6da000640 1 -- 172.21.15.42:0/1717674863 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4035040 con 0x7ff6e406d430 2024-09-17T01:41:45.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.644+0000 7ff6e9000640 1 -- 172.21.15.42:0/1717674863 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e414b590 con 0x7ff6e406d430 2024-09-17T01:41:45.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.644+0000 7ff6e9000640 1 -- 172.21.15.42:0/1717674863 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e4150100 con 0x7ff6e406d430 2024-09-17T01:41:45.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.645+0000 7ff6e9000640 1 -- 172.21.15.42:0/1717674863 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6e406f620 con 0x7ff6e406d430 2024-09-17T01:41:45.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.646+0000 7ff6da000640 1 -- 172.21.15.42:0/1717674863 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff6d4041030 con 0x7ff6e406d430 2024-09-17T01:41:45.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.647+0000 7ff6da000640 1 --2- 172.21.15.42:0/1717674863 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff6c0078bc0 0x7ff6c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:45.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.647+0000 7ff6da000640 1 -- 172.21.15.42:0/1717674863 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7ff6d40bb660 con 0x7ff6e406d430 2024-09-17T01:41:45.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.647+0000 7ff6dbe00640 1 --2- 172.21.15.42:0/1717674863 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff6c0078bc0 0x7ff6c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:45.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.648+0000 7ff6dbe00640 1 --2- 172.21.15.42:0/1717674863 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff6c0078bc0 0x7ff6c007b0d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff6e40b2190 tx=0x7ff6cc005cb0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:45.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.651+0000 7ff6da000640 1 -- 172.21.15.42:0/1717674863 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff6e415be20 con 0x7ff6e406d430 2024-09-17T01:41:45.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.919+0000 7ff6e9000640 1 -- 172.21.15.42:0/1717674863 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff6e4073e90 con 0x7ff6e406d430 2024-09-17T01:41:45.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.919+0000 7ff6da000640 1 -- 172.21.15.42:0/1717674863 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1218 (secure 0 0 0) 0x7ff6d4083a90 con 0x7ff6e406d430 2024-09-17T01:41:45.918 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:41:45.918 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":606,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":136,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":59},{"state_name":"active+clean","count":34},{"state_name":"unknown","count":4}],"num_pgs":97,"num_pools":3,"num_objects":6,"data_bytes":591040,"bytes_used":410722304,"bytes_avail":772683390976,"bytes_total":773094113280,"unknown_pgs_ratio":0.041237112134695053,"inactive_pgs_ratio":0.60824739933013916,"write_bytes_sec":387,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8442}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-17T01:40:29.123222+0000","services":{}},"progress_events":{}} 2024-09-17T01:41:45.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.922+0000 7ff6e9000640 1 -- 172.21.15.42:0/1717674863 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff6c0078bc0 msgr2=0x7ff6c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:45.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.922+0000 7ff6e9000640 1 --2- 172.21.15.42:0/1717674863 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff6c0078bc0 0x7ff6c007b0d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff6e40b2190 tx=0x7ff6cc005cb0 comp rx=0 tx=0).stop 2024-09-17T01:41:45.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.922+0000 7ff6e9000640 1 -- 172.21.15.42:0/1717674863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6e406d430 msgr2=0x7ff6e41f3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:45.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.922+0000 7ff6e9000640 1 --2- 172.21.15.42:0/1717674863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6e406d430 0x7ff6e41f3d20 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40099c0 tx=0x7ff6d40039e0 comp rx=0 tx=0).stop 2024-09-17T01:41:45.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.922+0000 7ff6e9000640 1 -- 172.21.15.42:0/1717674863 shutdown_connections 2024-09-17T01:41:45.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.922+0000 7ff6e9000640 1 --2- 172.21.15.42:0/1717674863 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff6c0078bc0 0x7ff6c007b0d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:45.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.922+0000 7ff6e9000640 1 --2- 172.21.15.42:0/1717674863 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6e415cb80 0x7ff6e40b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:45.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.922+0000 7ff6e9000640 1 --2- 172.21.15.42:0/1717674863 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff6e415f480 0x7ff6e414c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:45.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.922+0000 7ff6e9000640 1 --2- 172.21.15.42:0/1717674863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6e406d430 0x7ff6e41f3d20 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:45.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.922+0000 7ff6e9000640 1 -- 172.21.15.42:0/1717674863 >> 172.21.15.42:0/1717674863 conn(0x7ff6e40b2930 msgr2=0x7ff6e40cd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:45.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.922+0000 7ff6e9000640 1 -- 172.21.15.42:0/1717674863 shutdown_connections 2024-09-17T01:41:45.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:45.922+0000 7ff6e9000640 1 -- 172.21.15.42:0/1717674863 wait complete. 2024-09-17T01:41:45.945 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T01:41:45.945 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:41:46.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.175+0000 7f5396c00640 1 -- 172.21.15.42:0/890667061 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53900cf280 msgr2=0x7f5390070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:46.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.175+0000 7f5396c00640 1 --2- 172.21.15.42:0/890667061 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53900cf280 0x7f5390070730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5388005fd0 tx=0x7f538802aa00 comp rx=0 tx=0).stop 2024-09-17T01:41:46.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.175+0000 7f5396c00640 1 -- 172.21.15.42:0/890667061 shutdown_connections 2024-09-17T01:41:46.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.175+0000 7f5396c00640 1 --2- 172.21.15.42:0/890667061 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53900cf280 0x7f5390070730 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:46.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.175+0000 7f5396c00640 1 --2- 172.21.15.42:0/890667061 >> v2:172.21.15.43:3300/0 conn(0x7f53900ce930 0x7f53900ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:46.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.175+0000 7f5396c00640 1 -- 172.21.15.42:0/890667061 >> 172.21.15.42:0/890667061 conn(0x7f53900b3ed0 msgr2=0x7f53900b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:46.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.176+0000 7f5396c00640 1 -- 172.21.15.42:0/890667061 shutdown_connections 2024-09-17T01:41:46.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.176+0000 7f5396c00640 1 -- 172.21.15.42:0/890667061 wait complete. 2024-09-17T01:41:46.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.178+0000 7f5396c00640 1 Processor -- start 2024-09-17T01:41:46.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.178+0000 7f5396c00640 1 -- start start 2024-09-17T01:41:46.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.179+0000 7f5396c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53900ce930 0x7f5390156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:46.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.179+0000 7f5396c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53900d0d30 0x7f5390155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:46.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.179+0000 7f5396c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5390155c90 0x7f5390152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:46.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.179+0000 7f5396c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5390071200 con 0x7f53900d0d30 2024-09-17T01:41:46.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.179+0000 7f5396c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5390071080 con 0x7f53900ce930 2024-09-17T01:41:46.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.179+0000 7f5396c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5390071380 con 0x7f5390155c90 2024-09-17T01:41:46.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.180+0000 7f5394e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53900d0d30 0x7f5390155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:46.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.180+0000 7f5394e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53900d0d30 0x7f5390155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41980/0 (socket says 172.21.15.42:41980) 2024-09-17T01:41:46.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.180+0000 7f5394e00640 1 -- 172.21.15.42:0/132663780 learned_addr learned my addr 172.21.15.42:0/132663780 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:46.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.180+0000 7f5395800640 1 --2- 172.21.15.42:0/132663780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53900ce930 0x7f5390156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:46.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.180+0000 7f5396200640 1 --2- 172.21.15.42:0/132663780 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5390155c90 0x7f5390152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:46.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.180+0000 7f5394e00640 1 -- 172.21.15.42:0/132663780 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5390155c90 msgr2=0x7f5390152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:46.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.180+0000 7f5394e00640 1 --2- 172.21.15.42:0/132663780 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5390155c90 0x7f5390152850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:46.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.180+0000 7f5394e00640 1 -- 172.21.15.42:0/132663780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53900ce930 msgr2=0x7f5390156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:46.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.180+0000 7f5394e00640 1 --2- 172.21.15.42:0/132663780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53900ce930 0x7f5390156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:46.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.180+0000 7f5394e00640 1 -- 172.21.15.42:0/132663780 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5390153680 con 0x7f53900d0d30 2024-09-17T01:41:46.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.181+0000 7f5394e00640 1 --2- 172.21.15.42:0/132663780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53900d0d30 0x7f5390155750 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f537c00e9f0 tx=0x7f537c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:46.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.181+0000 7f538d600640 1 -- 172.21.15.42:0/132663780 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c00cd80 con 0x7f53900d0d30 2024-09-17T01:41:46.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.181+0000 7f538d600640 1 -- 172.21.15.42:0/132663780 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f537c004020 con 0x7f53900d0d30 2024-09-17T01:41:46.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.181+0000 7f5396c00640 1 -- 172.21.15.42:0/132663780 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53900c75e0 con 0x7f53900d0d30 2024-09-17T01:41:46.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.181+0000 7f538d600640 1 -- 172.21.15.42:0/132663780 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c004470 con 0x7f53900d0d30 2024-09-17T01:41:46.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.181+0000 7f5396c00640 1 -- 172.21.15.42:0/132663780 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53901551a0 con 0x7f53900d0d30 2024-09-17T01:41:46.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.182+0000 7f5396c00640 1 -- 172.21.15.42:0/132663780 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53900769a0 con 0x7f53900d0d30 2024-09-17T01:41:46.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.183+0000 7f538d600640 1 -- 172.21.15.42:0/132663780 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f537c0035f0 con 0x7f53900d0d30 2024-09-17T01:41:46.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.185+0000 7f538d600640 1 --2- 172.21.15.42:0/132663780 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5370078b90 0x7f537007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:46.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.185+0000 7f538d600640 1 -- 172.21.15.42:0/132663780 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f537c09b750 con 0x7f53900d0d30 2024-09-17T01:41:46.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.185+0000 7f5395800640 1 --2- 172.21.15.42:0/132663780 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5370078b90 0x7f537007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:46.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.186+0000 7f5395800640 1 --2- 172.21.15.42:0/132663780 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5370078b90 0x7f537007b0a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f53900b7f90 tx=0x7f5384009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:46.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.190+0000 7f538d600640 1 -- 172.21.15.42:0/132663780 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f53900769a0 con 0x7f53900d0d30 2024-09-17T01:41:46.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.383+0000 7f5396c00640 1 -- 172.21.15.42:0/132663780 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f53900c78c0 con 0x7f5370078b90 2024-09-17T01:41:46.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.388+0000 7f538d600640 1 -- 172.21.15.42:0/132663780 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252469 (secure 0 0 0) 0x7f53900c78c0 con 0x7f5370078b90 2024-09-17T01:41:46.390 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:41:46.391 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:41:46.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.392+0000 7f5396c00640 1 -- 172.21.15.42:0/132663780 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5370078b90 msgr2=0x7f537007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:46.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.392+0000 7f5396c00640 1 --2- 172.21.15.42:0/132663780 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5370078b90 0x7f537007b0a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f53900b7f90 tx=0x7f5384009040 comp rx=0 tx=0).stop 2024-09-17T01:41:46.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.392+0000 7f5396c00640 1 -- 172.21.15.42:0/132663780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53900d0d30 msgr2=0x7f5390155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:46.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.392+0000 7f5396c00640 1 --2- 172.21.15.42:0/132663780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53900d0d30 0x7f5390155750 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f537c00e9f0 tx=0x7f537c00eeb0 comp rx=0 tx=0).stop 2024-09-17T01:41:46.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.392+0000 7f5396c00640 1 -- 172.21.15.42:0/132663780 shutdown_connections 2024-09-17T01:41:46.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.392+0000 7f5396c00640 1 --2- 172.21.15.42:0/132663780 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5370078b90 0x7f537007b0a0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:46.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.392+0000 7f5396c00640 1 --2- 172.21.15.42:0/132663780 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5390155c90 0x7f5390152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:46.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.392+0000 7f5396c00640 1 --2- 172.21.15.42:0/132663780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53900d0d30 0x7f5390155750 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:46.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.392+0000 7f5396c00640 1 --2- 172.21.15.42:0/132663780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53900ce930 0x7f5390156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:46.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.392+0000 7f5396c00640 1 -- 172.21.15.42:0/132663780 >> 172.21.15.42:0/132663780 conn(0x7f53900b3ed0 msgr2=0x7f539006e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:46.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.392+0000 7f5396c00640 1 -- 172.21.15.42:0/132663780 shutdown_connections 2024-09-17T01:41:46.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:46.392+0000 7f5396c00640 1 -- 172.21.15.42:0/132663780 wait complete. 2024-09-17T01:41:46.417 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":425,"stamp":"2024-09-17T01:41:45.148270+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":401324,"kb_used_data":14396,"kb_used_omap":12,"kb_used_meta":386739,"kb_avail":754573396,"statfs":{"total":773094113280,"available":772683157504,"internally_reserved":0,"allocated":14741504,"data_stored":7111880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":396021300},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.287560"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889403+0000","last_change":"2024-09-17T01:41:39.913354+0000","last_active":"2024-09-17T01:41:40.889403+0000","last_peered":"2024-09-17T01:41:40.889403+0000","last_clean":"2024-09-17T01:41:40.889403+0000","last_became_active":"2024-09-17T01:41:39.913007+0000","last_became_peered":"2024-09-17T01:41:39.913007+0000","last_unstale":"2024-09-17T01:41:40.889403+0000","last_undegraded":"2024-09-17T01:41:40.889403+0000","last_fullsized":"2024-09-17T01:41:40.889403+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:47:19.205133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890027+0000","last_change":"2024-09-17T01:41:39.898479+0000","last_active":"2024-09-17T01:41:40.890027+0000","last_peered":"2024-09-17T01:41:40.890027+0000","last_clean":"2024-09-17T01:41:40.890027+0000","last_became_active":"2024-09-17T01:41:39.898142+0000","last_became_peered":"2024-09-17T01:41:39.898142+0000","last_unstale":"2024-09-17T01:41:40.890027+0000","last_undegraded":"2024-09-17T01:41:40.890027+0000","last_fullsized":"2024-09-17T01:41:40.890027+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:04:30.075643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354355+0000","last_change":"2024-09-17T01:41:39.891779+0000","last_active":"2024-09-17T01:41:41.354355+0000","last_peered":"2024-09-17T01:41:41.354355+0000","last_clean":"2024-09-17T01:41:41.354355+0000","last_became_active":"2024-09-17T01:41:39.888460+0000","last_became_peered":"2024-09-17T01:41:39.888460+0000","last_unstale":"2024-09-17T01:41:41.354355+0000","last_undegraded":"2024-09-17T01:41:41.354355+0000","last_fullsized":"2024-09-17T01:41:41.354355+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:13.500130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.935705+0000","last_change":"2024-09-17T01:41:39.914186+0000","last_active":"2024-09-17T01:41:40.935705+0000","last_peered":"2024-09-17T01:41:40.935705+0000","last_clean":"2024-09-17T01:41:40.935705+0000","last_became_active":"2024-09-17T01:41:39.913857+0000","last_became_peered":"2024-09-17T01:41:39.913857+0000","last_unstale":"2024-09-17T01:41:40.935705+0000","last_undegraded":"2024-09-17T01:41:40.935705+0000","last_fullsized":"2024-09-17T01:41:40.935705+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:50:50.092216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.910148+0000","last_change":"2024-09-17T01:41:39.908288+0000","last_active":"2024-09-17T01:41:39.910148+0000","last_peered":"2024-09-17T01:41:39.910148+0000","last_clean":"2024-09-17T01:41:39.910148+0000","last_became_active":"2024-09-17T01:41:39.906273+0000","last_became_peered":"2024-09-17T01:41:39.906273+0000","last_unstale":"2024-09-17T01:41:39.910148+0000","last_undegraded":"2024-09-17T01:41:39.910148+0000","last_fullsized":"2024-09-17T01:41:39.910148+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:51.859583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355866+0000","last_change":"2024-09-17T01:41:39.917260+0000","last_active":"2024-09-17T01:41:41.355866+0000","last_peered":"2024-09-17T01:41:41.355866+0000","last_clean":"2024-09-17T01:41:41.355866+0000","last_became_active":"2024-09-17T01:41:39.916904+0000","last_became_peered":"2024-09-17T01:41:39.916904+0000","last_unstale":"2024-09-17T01:41:41.355866+0000","last_undegraded":"2024-09-17T01:41:41.355866+0000","last_fullsized":"2024-09-17T01:41:41.355866+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:52.970207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.919586+0000","last_change":"2024-09-17T01:41:39.918635+0000","last_active":"2024-09-17T01:41:39.919586+0000","last_peered":"2024-09-17T01:41:39.919586+0000","last_clean":"2024-09-17T01:41:39.919586+0000","last_became_active":"2024-09-17T01:41:39.918295+0000","last_became_peered":"2024-09-17T01:41:39.918295+0000","last_unstale":"2024-09-17T01:41:39.919586+0000","last_undegraded":"2024-09-17T01:41:39.919586+0000","last_fullsized":"2024-09-17T01:41:39.919586+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:08:55.104996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.908066+0000","last_change":"2024-09-17T01:41:39.903573+0000","last_active":"2024-09-17T01:41:39.908066+0000","last_peered":"2024-09-17T01:41:39.908066+0000","last_clean":"2024-09-17T01:41:39.908066+0000","last_became_active":"2024-09-17T01:41:39.903235+0000","last_became_peered":"2024-09-17T01:41:39.903235+0000","last_unstale":"2024-09-17T01:41:39.908066+0000","last_undegraded":"2024-09-17T01:41:39.908066+0000","last_fullsized":"2024-09-17T01:41:39.908066+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:29.001520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356289+0000","last_change":"2024-09-17T01:41:39.905348+0000","last_active":"2024-09-17T01:41:41.356289+0000","last_peered":"2024-09-17T01:41:41.356289+0000","last_clean":"2024-09-17T01:41:41.356289+0000","last_became_active":"2024-09-17T01:41:39.900434+0000","last_became_peered":"2024-09-17T01:41:39.900434+0000","last_unstale":"2024-09-17T01:41:41.356289+0000","last_undegraded":"2024-09-17T01:41:41.356289+0000","last_fullsized":"2024-09-17T01:41:41.356289+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:33.033181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890293+0000","last_change":"2024-09-17T01:41:39.914311+0000","last_active":"2024-09-17T01:41:40.890293+0000","last_peered":"2024-09-17T01:41:40.890293+0000","last_clean":"2024-09-17T01:41:40.890293+0000","last_became_active":"2024-09-17T01:41:39.913985+0000","last_became_peered":"2024-09-17T01:41:39.913985+0000","last_unstale":"2024-09-17T01:41:40.890293+0000","last_undegraded":"2024-09-17T01:41:40.890293+0000","last_fullsized":"2024-09-17T01:41:40.890293+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:07.078291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.935875+0000","last_change":"2024-09-17T01:41:39.896447+0000","last_active":"2024-09-17T01:41:40.935875+0000","last_peered":"2024-09-17T01:41:40.935875+0000","last_clean":"2024-09-17T01:41:40.935875+0000","last_became_active":"2024-09-17T01:41:39.896096+0000","last_became_peered":"2024-09-17T01:41:39.896096+0000","last_unstale":"2024-09-17T01:41:40.935875+0000","last_undegraded":"2024-09-17T01:41:40.935875+0000","last_fullsized":"2024-09-17T01:41:40.935875+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:54.345098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355079+0000","last_change":"2024-09-17T01:41:39.913333+0000","last_active":"2024-09-17T01:41:41.355079+0000","last_peered":"2024-09-17T01:41:41.355079+0000","last_clean":"2024-09-17T01:41:41.355079+0000","last_became_active":"2024-09-17T01:41:39.907889+0000","last_became_peered":"2024-09-17T01:41:39.907889+0000","last_unstale":"2024-09-17T01:41:41.355079+0000","last_undegraded":"2024-09-17T01:41:41.355079+0000","last_fullsized":"2024-09-17T01:41:41.355079+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:37.231590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.935672+0000","last_change":"2024-09-17T01:41:39.895367+0000","last_active":"2024-09-17T01:41:40.935672+0000","last_peered":"2024-09-17T01:41:40.935672+0000","last_clean":"2024-09-17T01:41:40.935672+0000","last_became_active":"2024-09-17T01:41:39.893777+0000","last_became_peered":"2024-09-17T01:41:39.893777+0000","last_unstale":"2024-09-17T01:41:40.935672+0000","last_undegraded":"2024-09-17T01:41:40.935672+0000","last_fullsized":"2024-09-17T01:41:40.935672+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:09.465366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.888803+0000","last_change":"2024-09-17T01:41:39.901406+0000","last_active":"2024-09-17T01:41:40.888803+0000","last_peered":"2024-09-17T01:41:40.888803+0000","last_clean":"2024-09-17T01:41:40.888803+0000","last_became_active":"2024-09-17T01:41:39.897993+0000","last_became_peered":"2024-09-17T01:41:39.897993+0000","last_unstale":"2024-09-17T01:41:40.888803+0000","last_undegraded":"2024-09-17T01:41:40.888803+0000","last_fullsized":"2024-09-17T01:41:40.888803+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:46.007752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355340+0000","last_change":"2024-09-17T01:41:39.912799+0000","last_active":"2024-09-17T01:41:41.355340+0000","last_peered":"2024-09-17T01:41:41.355340+0000","last_clean":"2024-09-17T01:41:41.355340+0000","last_became_active":"2024-09-17T01:41:39.911355+0000","last_became_peered":"2024-09-17T01:41:39.911355+0000","last_unstale":"2024-09-17T01:41:41.355340+0000","last_undegraded":"2024-09-17T01:41:41.355340+0000","last_fullsized":"2024-09-17T01:41:41.355340+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:48.438144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889263+0000","last_change":"2024-09-17T01:41:39.912148+0000","last_active":"2024-09-17T01:41:40.889263+0000","last_peered":"2024-09-17T01:41:40.889263+0000","last_clean":"2024-09-17T01:41:40.889263+0000","last_became_active":"2024-09-17T01:41:39.911648+0000","last_became_peered":"2024-09-17T01:41:39.911648+0000","last_unstale":"2024-09-17T01:41:40.889263+0000","last_undegraded":"2024-09-17T01:41:40.889263+0000","last_fullsized":"2024-09-17T01:41:40.889263+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:28.353951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356472+0000","last_change":"2024-09-17T01:41:39.906031+0000","last_active":"2024-09-17T01:41:41.356472+0000","last_peered":"2024-09-17T01:41:41.356472+0000","last_clean":"2024-09-17T01:41:41.356472+0000","last_became_active":"2024-09-17T01:41:39.899628+0000","last_became_peered":"2024-09-17T01:41:39.899628+0000","last_unstale":"2024-09-17T01:41:41.356472+0000","last_undegraded":"2024-09-17T01:41:41.356472+0000","last_fullsized":"2024-09-17T01:41:41.356472+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:52.036134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355595+0000","last_change":"2024-09-17T01:41:39.893407+0000","last_active":"2024-09-17T01:41:41.355595+0000","last_peered":"2024-09-17T01:41:41.355595+0000","last_clean":"2024-09-17T01:41:41.355595+0000","last_became_active":"2024-09-17T01:41:39.892194+0000","last_became_peered":"2024-09-17T01:41:39.892194+0000","last_unstale":"2024-09-17T01:41:41.355595+0000","last_undegraded":"2024-09-17T01:41:41.355595+0000","last_fullsized":"2024-09-17T01:41:41.355595+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:21.295162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.888633+0000","last_change":"2024-09-17T01:41:39.894550+0000","last_active":"2024-09-17T01:41:40.888633+0000","last_peered":"2024-09-17T01:41:40.888633+0000","last_clean":"2024-09-17T01:41:40.888633+0000","last_became_active":"2024-09-17T01:41:39.893953+0000","last_became_peered":"2024-09-17T01:41:39.893953+0000","last_unstale":"2024-09-17T01:41:40.888633+0000","last_undegraded":"2024-09-17T01:41:40.888633+0000","last_fullsized":"2024-09-17T01:41:40.888633+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:48.878097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355155+0000","last_change":"2024-09-17T01:41:39.896804+0000","last_active":"2024-09-17T01:41:41.355155+0000","last_peered":"2024-09-17T01:41:41.355155+0000","last_clean":"2024-09-17T01:41:41.355155+0000","last_became_active":"2024-09-17T01:41:39.896444+0000","last_became_peered":"2024-09-17T01:41:39.896444+0000","last_unstale":"2024-09-17T01:41:41.355155+0000","last_undegraded":"2024-09-17T01:41:41.355155+0000","last_fullsized":"2024-09-17T01:41:41.355155+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:38.192115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355540+0000","last_change":"2024-09-17T01:41:39.914678+0000","last_active":"2024-09-17T01:41:41.355540+0000","last_peered":"2024-09-17T01:41:41.355540+0000","last_clean":"2024-09-17T01:41:41.355540+0000","last_became_active":"2024-09-17T01:41:39.910960+0000","last_became_peered":"2024-09-17T01:41:39.910960+0000","last_unstale":"2024-09-17T01:41:41.355540+0000","last_undegraded":"2024-09-17T01:41:41.355540+0000","last_fullsized":"2024-09-17T01:41:41.355540+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:05.964545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.888892+0000","last_change":"2024-09-17T01:41:39.892112+0000","last_active":"2024-09-17T01:41:40.888892+0000","last_peered":"2024-09-17T01:41:40.888892+0000","last_clean":"2024-09-17T01:41:40.888892+0000","last_became_active":"2024-09-17T01:41:39.891206+0000","last_became_peered":"2024-09-17T01:41:39.891206+0000","last_unstale":"2024-09-17T01:41:40.888892+0000","last_undegraded":"2024-09-17T01:41:40.888892+0000","last_fullsized":"2024-09-17T01:41:40.888892+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:59:11.138821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.887069+0000","last_change":"2024-09-17T01:41:39.918528+0000","last_active":"2024-09-17T01:41:40.887069+0000","last_peered":"2024-09-17T01:41:40.887069+0000","last_clean":"2024-09-17T01:41:40.887069+0000","last_became_active":"2024-09-17T01:41:39.915444+0000","last_became_peered":"2024-09-17T01:41:39.915444+0000","last_unstale":"2024-09-17T01:41:40.887069+0000","last_undegraded":"2024-09-17T01:41:40.887069+0000","last_fullsized":"2024-09-17T01:41:40.887069+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:06.532999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354875+0000","last_change":"2024-09-17T01:41:39.909626+0000","last_active":"2024-09-17T01:41:41.354875+0000","last_peered":"2024-09-17T01:41:41.354875+0000","last_clean":"2024-09-17T01:41:41.354875+0000","last_became_active":"2024-09-17T01:41:39.909214+0000","last_became_peered":"2024-09-17T01:41:39.909214+0000","last_unstale":"2024-09-17T01:41:41.354875+0000","last_undegraded":"2024-09-17T01:41:41.354875+0000","last_fullsized":"2024-09-17T01:41:41.354875+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:07.538851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.936068+0000","last_change":"2024-09-17T01:41:39.906230+0000","last_active":"2024-09-17T01:41:40.936068+0000","last_peered":"2024-09-17T01:41:40.936068+0000","last_clean":"2024-09-17T01:41:40.936068+0000","last_became_active":"2024-09-17T01:41:39.905323+0000","last_became_peered":"2024-09-17T01:41:39.905323+0000","last_unstale":"2024-09-17T01:41:40.936068+0000","last_undegraded":"2024-09-17T01:41:40.936068+0000","last_fullsized":"2024-09-17T01:41:40.936068+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:59.969882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890617+0000","last_change":"2024-09-17T01:41:39.892358+0000","last_active":"2024-09-17T01:41:40.890617+0000","last_peered":"2024-09-17T01:41:40.890617+0000","last_clean":"2024-09-17T01:41:40.890617+0000","last_became_active":"2024-09-17T01:41:39.892007+0000","last_became_peered":"2024-09-17T01:41:39.892007+0000","last_unstale":"2024-09-17T01:41:40.890617+0000","last_undegraded":"2024-09-17T01:41:40.890617+0000","last_fullsized":"2024-09-17T01:41:40.890617+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:54.129628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890388+0000","last_change":"2024-09-17T01:41:39.915488+0000","last_active":"2024-09-17T01:41:40.890388+0000","last_peered":"2024-09-17T01:41:40.890388+0000","last_clean":"2024-09-17T01:41:40.890388+0000","last_became_active":"2024-09-17T01:41:39.914235+0000","last_became_peered":"2024-09-17T01:41:39.914235+0000","last_unstale":"2024-09-17T01:41:40.890388+0000","last_undegraded":"2024-09-17T01:41:40.890388+0000","last_fullsized":"2024-09-17T01:41:40.890388+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:53.298805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.887348+0000","last_change":"2024-09-17T01:41:39.905009+0000","last_active":"2024-09-17T01:41:40.887348+0000","last_peered":"2024-09-17T01:41:40.887348+0000","last_clean":"2024-09-17T01:41:40.887348+0000","last_became_active":"2024-09-17T01:41:39.904661+0000","last_became_peered":"2024-09-17T01:41:39.904661+0000","last_unstale":"2024-09-17T01:41:40.887348+0000","last_undegraded":"2024-09-17T01:41:40.887348+0000","last_fullsized":"2024-09-17T01:41:40.887348+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:57.134013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.888801+0000","last_change":"2024-09-17T01:41:39.903040+0000","last_active":"2024-09-17T01:41:40.888801+0000","last_peered":"2024-09-17T01:41:40.888801+0000","last_clean":"2024-09-17T01:41:40.888801+0000","last_became_active":"2024-09-17T01:41:39.901317+0000","last_became_peered":"2024-09-17T01:41:39.901317+0000","last_unstale":"2024-09-17T01:41:40.888801+0000","last_undegraded":"2024-09-17T01:41:40.888801+0000","last_fullsized":"2024-09-17T01:41:40.888801+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:35.095684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889193+0000","last_change":"2024-09-17T01:41:39.885605+0000","last_active":"2024-09-17T01:41:40.889193+0000","last_peered":"2024-09-17T01:41:40.889193+0000","last_clean":"2024-09-17T01:41:40.889193+0000","last_became_active":"2024-09-17T01:41:39.885269+0000","last_became_peered":"2024-09-17T01:41:39.885269+0000","last_unstale":"2024-09-17T01:41:40.889193+0000","last_undegraded":"2024-09-17T01:41:40.889193+0000","last_fullsized":"2024-09-17T01:41:40.889193+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:57.268242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.887121+0000","last_change":"2024-09-17T01:41:39.900579+0000","last_active":"2024-09-17T01:41:40.887121+0000","last_peered":"2024-09-17T01:41:40.887121+0000","last_clean":"2024-09-17T01:41:40.887121+0000","last_became_active":"2024-09-17T01:41:39.900217+0000","last_became_peered":"2024-09-17T01:41:39.900217+0000","last_unstale":"2024-09-17T01:41:40.887121+0000","last_undegraded":"2024-09-17T01:41:40.887121+0000","last_fullsized":"2024-09-17T01:41:40.887121+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:30.999902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354468+0000","last_change":"2024-09-17T01:41:39.897367+0000","last_active":"2024-09-17T01:41:41.354468+0000","last_peered":"2024-09-17T01:41:41.354468+0000","last_clean":"2024-09-17T01:41:41.354468+0000","last_became_active":"2024-09-17T01:41:39.896177+0000","last_became_peered":"2024-09-17T01:41:39.896177+0000","last_unstale":"2024-09-17T01:41:41.354468+0000","last_undegraded":"2024-09-17T01:41:41.354468+0000","last_fullsized":"2024-09-17T01:41:41.354468+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:43:28.278656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890807+0000","last_change":"2024-09-17T01:41:39.911629+0000","last_active":"2024-09-17T01:41:40.890807+0000","last_peered":"2024-09-17T01:41:40.890807+0000","last_clean":"2024-09-17T01:41:40.890807+0000","last_became_active":"2024-09-17T01:41:39.909976+0000","last_became_peered":"2024-09-17T01:41:39.909976+0000","last_unstale":"2024-09-17T01:41:40.890807+0000","last_undegraded":"2024-09-17T01:41:40.890807+0000","last_fullsized":"2024-09-17T01:41:40.890807+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:29.308671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"135'4","reported_seq":17,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.912694+0000","last_change":"2024-09-17T01:41:38.882554+0000","last_active":"2024-09-17T01:41:39.912694+0000","last_peered":"2024-09-17T01:41:39.912694+0000","last_clean":"2024-09-17T01:41:39.912694+0000","last_became_active":"2024-09-17T01:41:38.882209+0000","last_became_peered":"2024-09-17T01:41:38.882209+0000","last_unstale":"2024-09-17T01:41:39.912694+0000","last_undegraded":"2024-09-17T01:41:39.912694+0000","last_fullsized":"2024-09-17T01:41:39.912694+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:26.546849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356469+0000","last_change":"2024-09-17T01:41:39.905010+0000","last_active":"2024-09-17T01:41:41.356469+0000","last_peered":"2024-09-17T01:41:41.356469+0000","last_clean":"2024-09-17T01:41:41.356469+0000","last_became_active":"2024-09-17T01:41:39.900043+0000","last_became_peered":"2024-09-17T01:41:39.900043+0000","last_unstale":"2024-09-17T01:41:41.356469+0000","last_undegraded":"2024-09-17T01:41:41.356469+0000","last_fullsized":"2024-09-17T01:41:41.356469+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:34.245025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"135'1","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355359+0000","last_change":"2024-09-17T01:41:38.892289+0000","last_active":"2024-09-17T01:41:41.355359+0000","last_peered":"2024-09-17T01:41:41.355359+0000","last_clean":"2024-09-17T01:41:41.355359+0000","last_became_active":"2024-09-17T01:41:38.891979+0000","last_became_peered":"2024-09-17T01:41:38.891979+0000","last_unstale":"2024-09-17T01:41:41.355359+0000","last_undegraded":"2024-09-17T01:41:41.355359+0000","last_fullsized":"2024-09-17T01:41:41.355359+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:00:07.436508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354336+0000","last_change":"2024-09-17T01:41:39.897361+0000","last_active":"2024-09-17T01:41:41.354336+0000","last_peered":"2024-09-17T01:41:41.354336+0000","last_clean":"2024-09-17T01:41:41.354336+0000","last_became_active":"2024-09-17T01:41:39.896982+0000","last_became_peered":"2024-09-17T01:41:39.896982+0000","last_unstale":"2024-09-17T01:41:41.354336+0000","last_undegraded":"2024-09-17T01:41:41.354336+0000","last_fullsized":"2024-09-17T01:41:41.354336+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:17.967702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"135'2","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.935846+0000","last_change":"2024-09-17T01:41:38.882622+0000","last_active":"2024-09-17T01:41:40.935846+0000","last_peered":"2024-09-17T01:41:40.935846+0000","last_clean":"2024-09-17T01:41:40.935846+0000","last_became_active":"2024-09-17T01:41:38.882281+0000","last_became_peered":"2024-09-17T01:41:38.882281+0000","last_unstale":"2024-09-17T01:41:40.935846+0000","last_undegraded":"2024-09-17T01:41:40.935846+0000","last_fullsized":"2024-09-17T01:41:40.935846+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:07.447798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355516+0000","last_change":"2024-09-17T01:41:39.908031+0000","last_active":"2024-09-17T01:41:41.355516+0000","last_peered":"2024-09-17T01:41:41.355516+0000","last_clean":"2024-09-17T01:41:41.355516+0000","last_became_active":"2024-09-17T01:41:39.907678+0000","last_became_peered":"2024-09-17T01:41:39.907678+0000","last_unstale":"2024-09-17T01:41:41.355516+0000","last_undegraded":"2024-09-17T01:41:41.355516+0000","last_fullsized":"2024-09-17T01:41:41.355516+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:11.369139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"135'2","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889421+0000","last_change":"2024-09-17T01:41:38.885583+0000","last_active":"2024-09-17T01:41:40.889421+0000","last_peered":"2024-09-17T01:41:40.889421+0000","last_clean":"2024-09-17T01:41:40.889421+0000","last_became_active":"2024-09-17T01:41:38.884223+0000","last_became_peered":"2024-09-17T01:41:38.884223+0000","last_unstale":"2024-09-17T01:41:40.889421+0000","last_undegraded":"2024-09-17T01:41:40.889421+0000","last_fullsized":"2024-09-17T01:41:40.889421+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:57.796155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355245+0000","last_change":"2024-09-17T01:41:39.902427+0000","last_active":"2024-09-17T01:41:41.355245+0000","last_peered":"2024-09-17T01:41:41.355245+0000","last_clean":"2024-09-17T01:41:41.355245+0000","last_became_active":"2024-09-17T01:41:39.902006+0000","last_became_peered":"2024-09-17T01:41:39.902006+0000","last_unstale":"2024-09-17T01:41:41.355245+0000","last_undegraded":"2024-09-17T01:41:41.355245+0000","last_fullsized":"2024-09-17T01:41:41.355245+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:29.141584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"135'1","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889036+0000","last_change":"2024-09-17T01:41:38.873721+0000","last_active":"2024-09-17T01:41:40.889036+0000","last_peered":"2024-09-17T01:41:40.889036+0000","last_clean":"2024-09-17T01:41:40.889036+0000","last_became_active":"2024-09-17T01:41:38.873362+0000","last_became_peered":"2024-09-17T01:41:38.873362+0000","last_unstale":"2024-09-17T01:41:40.889036+0000","last_undegraded":"2024-09-17T01:41:40.889036+0000","last_fullsized":"2024-09-17T01:41:40.889036+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:33.729661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355819+0000","last_change":"2024-09-17T01:41:39.911915+0000","last_active":"2024-09-17T01:41:41.355819+0000","last_peered":"2024-09-17T01:41:41.355819+0000","last_clean":"2024-09-17T01:41:41.355819+0000","last_became_active":"2024-09-17T01:41:39.907894+0000","last_became_peered":"2024-09-17T01:41:39.907894+0000","last_unstale":"2024-09-17T01:41:41.355819+0000","last_undegraded":"2024-09-17T01:41:41.355819+0000","last_fullsized":"2024-09-17T01:41:41.355819+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:51:13.115483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"135'1","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355048+0000","last_change":"2024-09-17T01:41:38.889732+0000","last_active":"2024-09-17T01:41:41.355048+0000","last_peered":"2024-09-17T01:41:41.355048+0000","last_clean":"2024-09-17T01:41:41.355048+0000","last_became_active":"2024-09-17T01:41:38.888209+0000","last_became_peered":"2024-09-17T01:41:38.888209+0000","last_unstale":"2024-09-17T01:41:41.355048+0000","last_undegraded":"2024-09-17T01:41:41.355048+0000","last_fullsized":"2024-09-17T01:41:41.355048+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:30:06.924877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354994+0000","last_change":"2024-09-17T01:41:39.906748+0000","last_active":"2024-09-17T01:41:41.354994+0000","last_peered":"2024-09-17T01:41:41.354994+0000","last_clean":"2024-09-17T01:41:41.354994+0000","last_became_active":"2024-09-17T01:41:39.906359+0000","last_became_peered":"2024-09-17T01:41:39.906359+0000","last_unstale":"2024-09-17T01:41:41.354994+0000","last_undegraded":"2024-09-17T01:41:41.354994+0000","last_fullsized":"2024-09-17T01:41:41.354994+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:01.721134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355200+0000","last_change":"2024-09-17T01:41:38.885067+0000","last_active":"2024-09-17T01:41:41.355200+0000","last_peered":"2024-09-17T01:41:41.355200+0000","last_clean":"2024-09-17T01:41:41.355200+0000","last_became_active":"2024-09-17T01:41:38.884745+0000","last_became_peered":"2024-09-17T01:41:38.884745+0000","last_unstale":"2024-09-17T01:41:41.355200+0000","last_undegraded":"2024-09-17T01:41:41.355200+0000","last_fullsized":"2024-09-17T01:41:41.355200+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:04.187447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.888462+0000","last_change":"2024-09-17T01:41:39.889546+0000","last_active":"2024-09-17T01:41:40.888462+0000","last_peered":"2024-09-17T01:41:40.888462+0000","last_clean":"2024-09-17T01:41:40.888462+0000","last_became_active":"2024-09-17T01:41:39.889222+0000","last_became_peered":"2024-09-17T01:41:39.889222+0000","last_unstale":"2024-09-17T01:41:40.888462+0000","last_undegraded":"2024-09-17T01:41:40.888462+0000","last_fullsized":"2024-09-17T01:41:40.888462+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:49.208113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.888524+0000","last_change":"2024-09-17T01:41:38.881509+0000","last_active":"2024-09-17T01:41:40.888524+0000","last_peered":"2024-09-17T01:41:40.888524+0000","last_clean":"2024-09-17T01:41:40.888524+0000","last_became_active":"2024-09-17T01:41:38.881199+0000","last_became_peered":"2024-09-17T01:41:38.881199+0000","last_unstale":"2024-09-17T01:41:40.888524+0000","last_undegraded":"2024-09-17T01:41:40.888524+0000","last_fullsized":"2024-09-17T01:41:40.888524+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:41.222557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890838+0000","last_change":"2024-09-17T01:41:39.897599+0000","last_active":"2024-09-17T01:41:40.890838+0000","last_peered":"2024-09-17T01:41:40.890838+0000","last_clean":"2024-09-17T01:41:40.890838+0000","last_became_active":"2024-09-17T01:41:39.897287+0000","last_became_peered":"2024-09-17T01:41:39.897287+0000","last_unstale":"2024-09-17T01:41:40.890838+0000","last_undegraded":"2024-09-17T01:41:40.890838+0000","last_fullsized":"2024-09-17T01:41:40.890838+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:58.701422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355055+0000","last_change":"2024-09-17T01:41:38.887052+0000","last_active":"2024-09-17T01:41:41.355055+0000","last_peered":"2024-09-17T01:41:41.355055+0000","last_clean":"2024-09-17T01:41:41.355055+0000","last_became_active":"2024-09-17T01:41:38.886738+0000","last_became_peered":"2024-09-17T01:41:38.886738+0000","last_unstale":"2024-09-17T01:41:41.355055+0000","last_undegraded":"2024-09-17T01:41:41.355055+0000","last_fullsized":"2024-09-17T01:41:41.355055+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:25.541036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.911538+0000","last_change":"2024-09-17T01:41:39.909805+0000","last_active":"2024-09-17T01:41:39.911538+0000","last_peered":"2024-09-17T01:41:39.911538+0000","last_clean":"2024-09-17T01:41:39.911538+0000","last_became_active":"2024-09-17T01:41:39.909106+0000","last_became_peered":"2024-09-17T01:41:39.909106+0000","last_unstale":"2024-09-17T01:41:39.911538+0000","last_undegraded":"2024-09-17T01:41:39.911538+0000","last_fullsized":"2024-09-17T01:41:39.911538+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:33.309654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355407+0000","last_change":"2024-09-17T01:41:38.885697+0000","last_active":"2024-09-17T01:41:41.355407+0000","last_peered":"2024-09-17T01:41:41.355407+0000","last_clean":"2024-09-17T01:41:41.355407+0000","last_became_active":"2024-09-17T01:41:38.885354+0000","last_became_peered":"2024-09-17T01:41:38.885354+0000","last_unstale":"2024-09-17T01:41:41.355407+0000","last_undegraded":"2024-09-17T01:41:41.355407+0000","last_fullsized":"2024-09-17T01:41:41.355407+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:04.252363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355161+0000","last_change":"2024-09-17T01:41:39.916513+0000","last_active":"2024-09-17T01:41:41.355161+0000","last_peered":"2024-09-17T01:41:41.355161+0000","last_clean":"2024-09-17T01:41:41.355161+0000","last_became_active":"2024-09-17T01:41:39.916156+0000","last_became_peered":"2024-09-17T01:41:39.916156+0000","last_unstale":"2024-09-17T01:41:41.355161+0000","last_undegraded":"2024-09-17T01:41:41.355161+0000","last_fullsized":"2024-09-17T01:41:41.355161+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:45.131482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"135'3","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.917421+0000","last_change":"2024-09-17T01:41:38.884961+0000","last_active":"2024-09-17T01:41:39.917421+0000","last_peered":"2024-09-17T01:41:39.917421+0000","last_clean":"2024-09-17T01:41:39.917421+0000","last_became_active":"2024-09-17T01:41:38.884641+0000","last_became_peered":"2024-09-17T01:41:38.884641+0000","last_unstale":"2024-09-17T01:41:39.917421+0000","last_undegraded":"2024-09-17T01:41:39.917421+0000","last_fullsized":"2024-09-17T01:41:39.917421+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:39.247990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.887591+0000","last_change":"2024-09-17T01:41:39.909629+0000","last_active":"2024-09-17T01:41:40.887591+0000","last_peered":"2024-09-17T01:41:40.887591+0000","last_clean":"2024-09-17T01:41:40.887591+0000","last_became_active":"2024-09-17T01:41:39.909313+0000","last_became_peered":"2024-09-17T01:41:39.909313+0000","last_unstale":"2024-09-17T01:41:40.887591+0000","last_undegraded":"2024-09-17T01:41:40.887591+0000","last_fullsized":"2024-09-17T01:41:40.887591+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:00:02.326795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"135'6","reported_seq":21,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.887362+0000","last_change":"2024-09-17T01:41:38.889323+0000","last_active":"2024-09-17T01:41:40.887362+0000","last_peered":"2024-09-17T01:41:40.887362+0000","last_clean":"2024-09-17T01:41:40.887362+0000","last_became_active":"2024-09-17T01:41:38.889016+0000","last_became_peered":"2024-09-17T01:41:38.889016+0000","last_unstale":"2024-09-17T01:41:40.887362+0000","last_undegraded":"2024-09-17T01:41:40.887362+0000","last_fullsized":"2024-09-17T01:41:40.887362+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:35.060703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889731+0000","last_change":"2024-09-17T01:41:39.903239+0000","last_active":"2024-09-17T01:41:40.889731+0000","last_peered":"2024-09-17T01:41:40.889731+0000","last_clean":"2024-09-17T01:41:40.889731+0000","last_became_active":"2024-09-17T01:41:39.899556+0000","last_became_peered":"2024-09-17T01:41:39.899556+0000","last_unstale":"2024-09-17T01:41:40.889731+0000","last_undegraded":"2024-09-17T01:41:40.889731+0000","last_fullsized":"2024-09-17T01:41:40.889731+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:38.776145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889015+0000","last_change":"2024-09-17T01:41:38.879765+0000","last_active":"2024-09-17T01:41:40.889015+0000","last_peered":"2024-09-17T01:41:40.889015+0000","last_clean":"2024-09-17T01:41:40.889015+0000","last_became_active":"2024-09-17T01:41:38.878997+0000","last_became_peered":"2024-09-17T01:41:38.878997+0000","last_unstale":"2024-09-17T01:41:40.889015+0000","last_undegraded":"2024-09-17T01:41:40.889015+0000","last_fullsized":"2024-09-17T01:41:40.889015+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:14:54.110838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890764+0000","last_change":"2024-09-17T01:41:39.911049+0000","last_active":"2024-09-17T01:41:40.890764+0000","last_peered":"2024-09-17T01:41:40.890764+0000","last_clean":"2024-09-17T01:41:40.890764+0000","last_became_active":"2024-09-17T01:41:39.910371+0000","last_became_peered":"2024-09-17T01:41:39.910371+0000","last_unstale":"2024-09-17T01:41:40.890764+0000","last_undegraded":"2024-09-17T01:41:40.890764+0000","last_fullsized":"2024-09-17T01:41:40.890764+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:55.228058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.935184+0000","last_change":"2024-09-17T01:41:38.887910+0000","last_active":"2024-09-17T01:41:40.935184+0000","last_peered":"2024-09-17T01:41:40.935184+0000","last_clean":"2024-09-17T01:41:40.935184+0000","last_became_active":"2024-09-17T01:41:38.887445+0000","last_became_peered":"2024-09-17T01:41:38.887445+0000","last_unstale":"2024-09-17T01:41:40.935184+0000","last_undegraded":"2024-09-17T01:41:40.935184+0000","last_fullsized":"2024-09-17T01:41:40.935184+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:58:30.941321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355807+0000","last_change":"2024-09-17T01:41:39.907773+0000","last_active":"2024-09-17T01:41:41.355807+0000","last_peered":"2024-09-17T01:41:41.355807+0000","last_clean":"2024-09-17T01:41:41.355807+0000","last_became_active":"2024-09-17T01:41:39.907425+0000","last_became_peered":"2024-09-17T01:41:39.907425+0000","last_unstale":"2024-09-17T01:41:41.355807+0000","last_undegraded":"2024-09-17T01:41:41.355807+0000","last_fullsized":"2024-09-17T01:41:41.355807+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:36.414131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"135'8","reported_seq":23,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355901+0000","last_change":"2024-09-17T01:41:38.890585+0000","last_active":"2024-09-17T01:41:41.355901+0000","last_peered":"2024-09-17T01:41:41.355901+0000","last_clean":"2024-09-17T01:41:41.355901+0000","last_became_active":"2024-09-17T01:41:38.890139+0000","last_became_peered":"2024-09-17T01:41:38.890139+0000","last_unstale":"2024-09-17T01:41:41.355901+0000","last_undegraded":"2024-09-17T01:41:41.355901+0000","last_fullsized":"2024-09-17T01:41:41.355901+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:57.210587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.905548+0000","last_change":"2024-09-17T01:41:39.897936+0000","last_active":"2024-09-17T01:41:39.905548+0000","last_peered":"2024-09-17T01:41:39.905548+0000","last_clean":"2024-09-17T01:41:39.905548+0000","last_became_active":"2024-09-17T01:41:39.896967+0000","last_became_peered":"2024-09-17T01:41:39.896967+0000","last_unstale":"2024-09-17T01:41:39.905548+0000","last_undegraded":"2024-09-17T01:41:39.905548+0000","last_fullsized":"2024-09-17T01:41:39.905548+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:39.882004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"135'1","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355493+0000","last_change":"2024-09-17T01:41:38.888104+0000","last_active":"2024-09-17T01:41:41.355493+0000","last_peered":"2024-09-17T01:41:41.355493+0000","last_clean":"2024-09-17T01:41:41.355493+0000","last_became_active":"2024-09-17T01:41:38.887512+0000","last_became_peered":"2024-09-17T01:41:38.887512+0000","last_unstale":"2024-09-17T01:41:41.355493+0000","last_undegraded":"2024-09-17T01:41:41.355493+0000","last_fullsized":"2024-09-17T01:41:41.355493+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:00.805470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.908176+0000","last_change":"2024-09-17T01:41:39.899540+0000","last_active":"2024-09-17T01:41:39.908176+0000","last_peered":"2024-09-17T01:41:39.908176+0000","last_clean":"2024-09-17T01:41:39.908176+0000","last_became_active":"2024-09-17T01:41:39.899234+0000","last_became_peered":"2024-09-17T01:41:39.899234+0000","last_unstale":"2024-09-17T01:41:39.908176+0000","last_undegraded":"2024-09-17T01:41:39.908176+0000","last_fullsized":"2024-09-17T01:41:39.908176+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:11.013229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"135'2","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.935638+0000","last_change":"2024-09-17T01:41:38.876615+0000","last_active":"2024-09-17T01:41:40.935638+0000","last_peered":"2024-09-17T01:41:40.935638+0000","last_clean":"2024-09-17T01:41:40.935638+0000","last_became_active":"2024-09-17T01:41:38.876250+0000","last_became_peered":"2024-09-17T01:41:38.876250+0000","last_unstale":"2024-09-17T01:41:40.935638+0000","last_undegraded":"2024-09-17T01:41:40.935638+0000","last_fullsized":"2024-09-17T01:41:40.935638+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:13:56.598505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889626+0000","last_change":"2024-09-17T01:41:39.900185+0000","last_active":"2024-09-17T01:41:40.889626+0000","last_peered":"2024-09-17T01:41:40.889626+0000","last_clean":"2024-09-17T01:41:40.889626+0000","last_became_active":"2024-09-17T01:41:39.895207+0000","last_became_peered":"2024-09-17T01:41:39.895207+0000","last_unstale":"2024-09-17T01:41:40.889626+0000","last_undegraded":"2024-09-17T01:41:40.889626+0000","last_fullsized":"2024-09-17T01:41:40.889626+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:52.526963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"135'1","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354567+0000","last_change":"2024-09-17T01:41:38.882538+0000","last_active":"2024-09-17T01:41:41.354567+0000","last_peered":"2024-09-17T01:41:41.354567+0000","last_clean":"2024-09-17T01:41:41.354567+0000","last_became_active":"2024-09-17T01:41:38.882135+0000","last_became_peered":"2024-09-17T01:41:38.882135+0000","last_unstale":"2024-09-17T01:41:41.354567+0000","last_undegraded":"2024-09-17T01:41:41.354567+0000","last_fullsized":"2024-09-17T01:41:41.354567+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:07.429310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.888966+0000","last_change":"2024-09-17T01:41:39.900025+0000","last_active":"2024-09-17T01:41:40.888966+0000","last_peered":"2024-09-17T01:41:40.888966+0000","last_clean":"2024-09-17T01:41:40.888966+0000","last_became_active":"2024-09-17T01:41:39.894040+0000","last_became_peered":"2024-09-17T01:41:39.894040+0000","last_unstale":"2024-09-17T01:41:40.888966+0000","last_undegraded":"2024-09-17T01:41:40.888966+0000","last_fullsized":"2024-09-17T01:41:40.888966+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:33.474943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.885618+0000","last_change":"2024-09-17T01:41:38.888723+0000","last_active":"2024-09-17T01:41:39.885618+0000","last_peered":"2024-09-17T01:41:39.885618+0000","last_clean":"2024-09-17T01:41:39.885618+0000","last_became_active":"2024-09-17T01:41:38.888363+0000","last_became_peered":"2024-09-17T01:41:38.888363+0000","last_unstale":"2024-09-17T01:41:39.885618+0000","last_undegraded":"2024-09-17T01:41:39.885618+0000","last_fullsized":"2024-09-17T01:41:39.885618+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:33.994701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889476+0000","last_change":"2024-09-17T01:41:39.897025+0000","last_active":"2024-09-17T01:41:40.889476+0000","last_peered":"2024-09-17T01:41:40.889476+0000","last_clean":"2024-09-17T01:41:40.889476+0000","last_became_active":"2024-09-17T01:41:39.896625+0000","last_became_peered":"2024-09-17T01:41:39.896625+0000","last_unstale":"2024-09-17T01:41:40.889476+0000","last_undegraded":"2024-09-17T01:41:40.889476+0000","last_fullsized":"2024-09-17T01:41:40.889476+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:10.642076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"135'2","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354691+0000","last_change":"2024-09-17T01:41:38.882994+0000","last_active":"2024-09-17T01:41:41.354691+0000","last_peered":"2024-09-17T01:41:41.354691+0000","last_clean":"2024-09-17T01:41:41.354691+0000","last_became_active":"2024-09-17T01:41:38.882780+0000","last_became_peered":"2024-09-17T01:41:38.882780+0000","last_unstale":"2024-09-17T01:41:41.354691+0000","last_undegraded":"2024-09-17T01:41:41.354691+0000","last_fullsized":"2024-09-17T01:41:41.354691+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:00.702847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.887303+0000","last_change":"2024-09-17T01:41:39.898253+0000","last_active":"2024-09-17T01:41:40.887303+0000","last_peered":"2024-09-17T01:41:40.887303+0000","last_clean":"2024-09-17T01:41:40.887303+0000","last_became_active":"2024-09-17T01:41:39.897745+0000","last_became_peered":"2024-09-17T01:41:39.897745+0000","last_unstale":"2024-09-17T01:41:40.887303+0000","last_undegraded":"2024-09-17T01:41:40.887303+0000","last_fullsized":"2024-09-17T01:41:40.887303+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:31.082175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355346+0000","last_change":"2024-09-17T01:41:38.890582+0000","last_active":"2024-09-17T01:41:41.355346+0000","last_peered":"2024-09-17T01:41:41.355346+0000","last_clean":"2024-09-17T01:41:41.355346+0000","last_became_active":"2024-09-17T01:41:38.890231+0000","last_became_peered":"2024-09-17T01:41:38.890231+0000","last_unstale":"2024-09-17T01:41:41.355346+0000","last_undegraded":"2024-09-17T01:41:41.355346+0000","last_fullsized":"2024-09-17T01:41:41.355346+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:47.416687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889522+0000","last_change":"2024-09-17T01:41:39.893202+0000","last_active":"2024-09-17T01:41:40.889522+0000","last_peered":"2024-09-17T01:41:40.889522+0000","last_clean":"2024-09-17T01:41:40.889522+0000","last_became_active":"2024-09-17T01:41:39.892896+0000","last_became_peered":"2024-09-17T01:41:39.892896+0000","last_unstale":"2024-09-17T01:41:40.889522+0000","last_undegraded":"2024-09-17T01:41:40.889522+0000","last_fullsized":"2024-09-17T01:41:40.889522+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:25.989263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889077+0000","last_change":"2024-09-17T01:41:38.889563+0000","last_active":"2024-09-17T01:41:40.889077+0000","last_peered":"2024-09-17T01:41:40.889077+0000","last_clean":"2024-09-17T01:41:40.889077+0000","last_became_active":"2024-09-17T01:41:38.888781+0000","last_became_peered":"2024-09-17T01:41:38.888781+0000","last_unstale":"2024-09-17T01:41:40.889077+0000","last_undegraded":"2024-09-17T01:41:40.889077+0000","last_fullsized":"2024-09-17T01:41:40.889077+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:58.047664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355838+0000","last_change":"2024-09-17T01:41:39.907743+0000","last_active":"2024-09-17T01:41:41.355838+0000","last_peered":"2024-09-17T01:41:41.355838+0000","last_clean":"2024-09-17T01:41:41.355838+0000","last_became_active":"2024-09-17T01:41:39.907076+0000","last_became_peered":"2024-09-17T01:41:39.907076+0000","last_unstale":"2024-09-17T01:41:41.355838+0000","last_undegraded":"2024-09-17T01:41:41.355838+0000","last_fullsized":"2024-09-17T01:41:41.355838+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:27.450762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.935158+0000","last_change":"2024-09-17T01:41:38.885458+0000","last_active":"2024-09-17T01:41:40.935158+0000","last_peered":"2024-09-17T01:41:40.935158+0000","last_clean":"2024-09-17T01:41:40.935158+0000","last_became_active":"2024-09-17T01:41:38.884884+0000","last_became_peered":"2024-09-17T01:41:38.884884+0000","last_unstale":"2024-09-17T01:41:40.935158+0000","last_undegraded":"2024-09-17T01:41:40.935158+0000","last_fullsized":"2024-09-17T01:41:40.935158+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:41:30.108510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.887585+0000","last_change":"2024-09-17T01:41:39.908682+0000","last_active":"2024-09-17T01:41:40.887585+0000","last_peered":"2024-09-17T01:41:40.887585+0000","last_clean":"2024-09-17T01:41:40.887585+0000","last_became_active":"2024-09-17T01:41:39.908140+0000","last_became_peered":"2024-09-17T01:41:39.908140+0000","last_unstale":"2024-09-17T01:41:40.887585+0000","last_undegraded":"2024-09-17T01:41:40.887585+0000","last_fullsized":"2024-09-17T01:41:40.887585+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:26:50.609089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"135'2","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355567+0000","last_change":"2024-09-17T01:41:38.886108+0000","last_active":"2024-09-17T01:41:41.355567+0000","last_peered":"2024-09-17T01:41:41.355567+0000","last_clean":"2024-09-17T01:41:41.355567+0000","last_became_active":"2024-09-17T01:41:38.885735+0000","last_became_peered":"2024-09-17T01:41:38.885735+0000","last_unstale":"2024-09-17T01:41:41.355567+0000","last_undegraded":"2024-09-17T01:41:41.355567+0000","last_fullsized":"2024-09-17T01:41:41.355567+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:16.913690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889696+0000","last_change":"2024-09-17T01:41:39.910647+0000","last_active":"2024-09-17T01:41:40.889696+0000","last_peered":"2024-09-17T01:41:40.889696+0000","last_clean":"2024-09-17T01:41:40.889696+0000","last_became_active":"2024-09-17T01:41:39.910049+0000","last_became_peered":"2024-09-17T01:41:39.910049+0000","last_unstale":"2024-09-17T01:41:40.889696+0000","last_undegraded":"2024-09-17T01:41:40.889696+0000","last_fullsized":"2024-09-17T01:41:40.889696+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:39.090195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-09-17T01:41:39.885906+0000","last_change":"2024-09-17T01:41:38.888956+0000","last_active":"2024-09-17T01:41:39.885906+0000","last_peered":"2024-09-17T01:41:39.885906+0000","last_clean":"2024-09-17T01:41:39.885906+0000","last_became_active":"2024-09-17T01:41:38.888591+0000","last_became_peered":"2024-09-17T01:41:38.888591+0000","last_unstale":"2024-09-17T01:41:39.885906+0000","last_undegraded":"2024-09-17T01:41:39.885906+0000","last_fullsized":"2024-09-17T01:41:39.885906+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:23.963194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890111+0000","last_change":"2024-09-17T01:41:39.908977+0000","last_active":"2024-09-17T01:41:40.890111+0000","last_peered":"2024-09-17T01:41:40.890111+0000","last_clean":"2024-09-17T01:41:40.890111+0000","last_became_active":"2024-09-17T01:41:39.905784+0000","last_became_peered":"2024-09-17T01:41:39.905784+0000","last_unstale":"2024-09-17T01:41:40.890111+0000","last_undegraded":"2024-09-17T01:41:40.890111+0000","last_fullsized":"2024-09-17T01:41:40.890111+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:43.463332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355347+0000","last_change":"2024-09-17T01:41:38.893661+0000","last_active":"2024-09-17T01:41:41.355347+0000","last_peered":"2024-09-17T01:41:41.355347+0000","last_clean":"2024-09-17T01:41:41.355347+0000","last_became_active":"2024-09-17T01:41:38.893356+0000","last_became_peered":"2024-09-17T01:41:38.893356+0000","last_unstale":"2024-09-17T01:41:41.355347+0000","last_undegraded":"2024-09-17T01:41:41.355347+0000","last_fullsized":"2024-09-17T01:41:41.355347+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:07:34.722925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354379+0000","last_change":"2024-09-17T01:41:39.889003+0000","last_active":"2024-09-17T01:41:41.354379+0000","last_peered":"2024-09-17T01:41:41.354379+0000","last_clean":"2024-09-17T01:41:41.354379+0000","last_became_active":"2024-09-17T01:41:39.887179+0000","last_became_peered":"2024-09-17T01:41:39.887179+0000","last_unstale":"2024-09-17T01:41:41.354379+0000","last_undegraded":"2024-09-17T01:41:41.354379+0000","last_fullsized":"2024-09-17T01:41:41.354379+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:50.836313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890153+0000","last_change":"2024-09-17T01:41:38.882409+0000","last_active":"2024-09-17T01:41:40.890153+0000","last_peered":"2024-09-17T01:41:40.890153+0000","last_clean":"2024-09-17T01:41:40.890153+0000","last_became_active":"2024-09-17T01:41:38.882062+0000","last_became_peered":"2024-09-17T01:41:38.882062+0000","last_unstale":"2024-09-17T01:41:40.890153+0000","last_undegraded":"2024-09-17T01:41:40.890153+0000","last_fullsized":"2024-09-17T01:41:40.890153+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:57.441358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356115+0000","last_change":"2024-09-17T01:41:39.910991+0000","last_active":"2024-09-17T01:41:41.356115+0000","last_peered":"2024-09-17T01:41:41.356115+0000","last_clean":"2024-09-17T01:41:41.356115+0000","last_became_active":"2024-09-17T01:41:39.910569+0000","last_became_peered":"2024-09-17T01:41:39.910569+0000","last_unstale":"2024-09-17T01:41:41.356115+0000","last_undegraded":"2024-09-17T01:41:41.356115+0000","last_fullsized":"2024-09-17T01:41:41.356115+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:10.092892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889178+0000","last_change":"2024-09-17T01:41:38.885009+0000","last_active":"2024-09-17T01:41:40.889178+0000","last_peered":"2024-09-17T01:41:40.889178+0000","last_clean":"2024-09-17T01:41:40.889178+0000","last_became_active":"2024-09-17T01:41:38.884672+0000","last_became_peered":"2024-09-17T01:41:38.884672+0000","last_unstale":"2024-09-17T01:41:40.889178+0000","last_undegraded":"2024-09-17T01:41:40.889178+0000","last_fullsized":"2024-09-17T01:41:40.889178+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:38.363973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356082+0000","last_change":"2024-09-17T01:41:39.921777+0000","last_active":"2024-09-17T01:41:41.356082+0000","last_peered":"2024-09-17T01:41:41.356082+0000","last_clean":"2024-09-17T01:41:41.356082+0000","last_became_active":"2024-09-17T01:41:39.921185+0000","last_became_peered":"2024-09-17T01:41:39.921185+0000","last_unstale":"2024-09-17T01:41:41.356082+0000","last_undegraded":"2024-09-17T01:41:41.356082+0000","last_fullsized":"2024-09-17T01:41:41.356082+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:25.074848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356079+0000","last_change":"2024-09-17T01:41:38.894301+0000","last_active":"2024-09-17T01:41:41.356079+0000","last_peered":"2024-09-17T01:41:41.356079+0000","last_clean":"2024-09-17T01:41:41.356079+0000","last_became_active":"2024-09-17T01:41:38.893976+0000","last_became_peered":"2024-09-17T01:41:38.893976+0000","last_unstale":"2024-09-17T01:41:41.356079+0000","last_undegraded":"2024-09-17T01:41:41.356079+0000","last_fullsized":"2024-09-17T01:41:41.356079+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:59.604894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355042+0000","last_change":"2024-09-17T01:41:39.909414+0000","last_active":"2024-09-17T01:41:41.355042+0000","last_peered":"2024-09-17T01:41:41.355042+0000","last_clean":"2024-09-17T01:41:41.355042+0000","last_became_active":"2024-09-17T01:41:39.909077+0000","last_became_peered":"2024-09-17T01:41:39.909077+0000","last_unstale":"2024-09-17T01:41:41.355042+0000","last_undegraded":"2024-09-17T01:41:41.355042+0000","last_fullsized":"2024-09-17T01:41:41.355042+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:09.812199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.935294+0000","last_change":"2024-09-17T01:41:38.887884+0000","last_active":"2024-09-17T01:41:40.935294+0000","last_peered":"2024-09-17T01:41:40.935294+0000","last_clean":"2024-09-17T01:41:40.935294+0000","last_became_active":"2024-09-17T01:41:38.887525+0000","last_became_peered":"2024-09-17T01:41:38.887525+0000","last_unstale":"2024-09-17T01:41:40.935294+0000","last_undegraded":"2024-09-17T01:41:40.935294+0000","last_fullsized":"2024-09-17T01:41:40.935294+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:07.622231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.888864+0000","last_change":"2024-09-17T01:41:39.904820+0000","last_active":"2024-09-17T01:41:40.888864+0000","last_peered":"2024-09-17T01:41:40.888864+0000","last_clean":"2024-09-17T01:41:40.888864+0000","last_became_active":"2024-09-17T01:41:39.904501+0000","last_became_peered":"2024-09-17T01:41:39.904501+0000","last_unstale":"2024-09-17T01:41:40.888864+0000","last_undegraded":"2024-09-17T01:41:40.888864+0000","last_fullsized":"2024-09-17T01:41:40.888864+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:47.339753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889706+0000","last_change":"2024-09-17T01:41:38.879650+0000","last_active":"2024-09-17T01:41:40.889706+0000","last_peered":"2024-09-17T01:41:40.889706+0000","last_clean":"2024-09-17T01:41:40.889706+0000","last_became_active":"2024-09-17T01:41:38.879319+0000","last_became_peered":"2024-09-17T01:41:38.879319+0000","last_unstale":"2024-09-17T01:41:40.889706+0000","last_undegraded":"2024-09-17T01:41:40.889706+0000","last_fullsized":"2024-09-17T01:41:40.889706+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:23.466575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355002+0000","last_change":"2024-09-17T01:41:39.888819+0000","last_active":"2024-09-17T01:41:41.355002+0000","last_peered":"2024-09-17T01:41:41.355002+0000","last_clean":"2024-09-17T01:41:41.355002+0000","last_became_active":"2024-09-17T01:41:39.888416+0000","last_became_peered":"2024-09-17T01:41:39.888416+0000","last_unstale":"2024-09-17T01:41:41.355002+0000","last_undegraded":"2024-09-17T01:41:41.355002+0000","last_fullsized":"2024-09-17T01:41:41.355002+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:47.837413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"135'2","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356283+0000","last_change":"2024-09-17T01:41:38.894268+0000","last_active":"2024-09-17T01:41:41.356283+0000","last_peered":"2024-09-17T01:41:41.356283+0000","last_clean":"2024-09-17T01:41:41.356283+0000","last_became_active":"2024-09-17T01:41:38.893934+0000","last_became_peered":"2024-09-17T01:41:38.893934+0000","last_unstale":"2024-09-17T01:41:41.356283+0000","last_undegraded":"2024-09-17T01:41:41.356283+0000","last_fullsized":"2024-09-17T01:41:41.356283+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:45.765235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":327,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.886919+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:41:40.886919+0000","last_peered":"2024-09-17T01:41:40.886919+0000","last_clean":"2024-09-17T01:41:40.886919+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:41:40.886919+0000","last_undegraded":"2024-09-17T01:41:40.886919+0000","last_fullsized":"2024-09-17T01:41:40.886919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476857,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55040,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316800,"statfs":{"total":96636764160,"available":96580403200,"internally_reserved":0,"allocated":1683456,"data_stored":735950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509561,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32840,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339000,"statfs":{"total":96636764160,"available":96603136000,"internally_reserved":0,"allocated":1691648,"data_stored":741612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509560,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55044,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316796,"statfs":{"total":96636764160,"available":96580399104,"internally_reserved":0,"allocated":1687552,"data_stored":741578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509561,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59212,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312628,"statfs":{"total":96636764160,"available":96576131072,"internally_reserved":0,"allocated":1687552,"data_stored":741578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509561,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59208,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312632,"statfs":{"total":96636764160,"available":96576135168,"internally_reserved":0,"allocated":1691648,"data_stored":741648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509560,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51484,"kb_used_data":2244,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320356,"statfs":{"total":96636764160,"available":96584044544,"internally_reserved":0,"allocated":2297856,"data_stored":1333580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509562,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28700,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343140,"statfs":{"total":96636764160,"available":96607375360,"internally_reserved":0,"allocated":1708032,"data_stored":743246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542266,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59796,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312044,"statfs":{"total":96636764160,"available":96575533056,"internally_reserved":0,"allocated":2293760,"data_stored":1332688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:41:49.422 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:41:49.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.662+0000 7f16ea000640 1 -- 172.21.15.42:0/2444186074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16c8004d90 msgr2=0x7f16c8005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:49.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.662+0000 7f16ea000640 1 --2- 172.21.15.42:0/2444186074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16c8004d90 0x7f16c8005220 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f16dc001f30 tx=0x7f16c8005830 comp rx=0 tx=0).stop 2024-09-17T01:41:49.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.662+0000 7f16e3e00640 1 -- 172.21.15.42:0/2444186074 reap_dead start 2024-09-17T01:41:49.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.662+0000 7f16ea000640 1 -- 172.21.15.42:0/2444186074 shutdown_connections 2024-09-17T01:41:49.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.662+0000 7f16ea000640 1 -- 172.21.15.42:0/2444186074 >> 172.21.15.42:0/2444186074 conn(0x7f16e40b2930 msgr2=0x7f16e406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:49.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.662+0000 7f16ea000640 1 -- 172.21.15.42:0/2444186074 shutdown_connections 2024-09-17T01:41:49.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.662+0000 7f16ea000640 1 -- 172.21.15.42:0/2444186074 wait complete. 2024-09-17T01:41:49.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.664+0000 7f16ea000640 1 Processor -- start 2024-09-17T01:41:49.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.664+0000 7f16ea000640 1 -- start start 2024-09-17T01:41:49.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.666+0000 7f16ea000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16c8004d90 0x7f16e41f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:49.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.666+0000 7f16ea000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16e41f2be0 0x7f16e40ae110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:49.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.666+0000 7f16ea000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16e40ae650 0x7f16e41f6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:49.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.666+0000 7f16ea000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f16e406d430 con 0x7f16c8004d90 2024-09-17T01:41:49.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.666+0000 7f16ea000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f16e4072be0 con 0x7f16e40ae650 2024-09-17T01:41:49.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.666+0000 7f16ea000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f16e406d5b0 con 0x7f16e41f2be0 2024-09-17T01:41:49.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.666+0000 7f16e3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16c8004d90 0x7f16e41f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:49.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.666+0000 7f16e3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16c8004d90 0x7f16e41f3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41996/0 (socket says 172.21.15.42:41996) 2024-09-17T01:41:49.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.666+0000 7f16e3400640 1 -- 172.21.15.42:0/1369503546 learned_addr learned my addr 172.21.15.42:0/1369503546 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:49.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.666+0000 7f16e2a00640 1 --2- 172.21.15.42:0/1369503546 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16e41f2be0 0x7f16e40ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:49.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.666+0000 7f16e3e00640 1 --2- 172.21.15.42:0/1369503546 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16e40ae650 0x7f16e41f6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:49.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.667+0000 7f16e3400640 1 -- 172.21.15.42:0/1369503546 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16e41f2be0 msgr2=0x7f16e40ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:49.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.667+0000 7f16e3400640 1 --2- 172.21.15.42:0/1369503546 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16e41f2be0 0x7f16e40ae110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:49.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.667+0000 7f16e3400640 1 -- 172.21.15.42:0/1369503546 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16e40ae650 msgr2=0x7f16e41f6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:49.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.667+0000 7f16e3400640 1 --2- 172.21.15.42:0/1369503546 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16e40ae650 0x7f16e41f6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:49.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.667+0000 7f16e3400640 1 -- 172.21.15.42:0/1369503546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e41f42e0 con 0x7f16c8004d90 2024-09-17T01:41:49.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.667+0000 7f16e3400640 1 --2- 172.21.15.42:0/1369503546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16c8004d90 0x7f16e41f3da0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f16d4006600 tx=0x7f16d40039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:49.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.667+0000 7f16db400640 1 -- 172.21.15.42:0/1369503546 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d4015070 con 0x7f16c8004d90 2024-09-17T01:41:49.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.667+0000 7f16db400640 1 -- 172.21.15.42:0/1369503546 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16d4011860 con 0x7f16c8004d90 2024-09-17T01:41:49.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.667+0000 7f16db400640 1 -- 172.21.15.42:0/1369503546 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d4011cb0 con 0x7f16c8004d90 2024-09-17T01:41:49.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.667+0000 7f16ea000640 1 -- 172.21.15.42:0/1369503546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e40aea60 con 0x7f16c8004d90 2024-09-17T01:41:49.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.667+0000 7f16ea000640 1 -- 172.21.15.42:0/1369503546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e41f4a60 con 0x7f16c8004d90 2024-09-17T01:41:49.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.668+0000 7f16ea000640 1 -- 172.21.15.42:0/1369503546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16e406db10 con 0x7f16c8004d90 2024-09-17T01:41:49.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.670+0000 7f16db400640 1 -- 172.21.15.42:0/1369503546 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f16d4018070 con 0x7f16c8004d90 2024-09-17T01:41:49.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.671+0000 7f16db400640 1 --2- 172.21.15.42:0/1369503546 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f16c4078bc0 0x7f16c407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:49.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.671+0000 7f16db400640 1 -- 172.21.15.42:0/1369503546 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f16d409bab0 con 0x7f16c8004d90 2024-09-17T01:41:49.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.671+0000 7f16e2a00640 1 --2- 172.21.15.42:0/1369503546 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f16c4078bc0 0x7f16c407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:49.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.672+0000 7f16e2a00640 1 --2- 172.21.15.42:0/1369503546 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f16c4078bc0 0x7f16c407b0d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f16e406d210 tx=0x7f16d0005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:49.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.675+0000 7f16db400640 1 -- 172.21.15.42:0/1369503546 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f16e40aea60 con 0x7f16c8004d90 2024-09-17T01:41:49.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.867+0000 7f16ea000640 1 -- 172.21.15.42:0/1369503546 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f16e406a170 con 0x7f16c4078bc0 2024-09-17T01:41:49.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.872+0000 7f16db400640 1 -- 172.21.15.42:0/1369503546 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252448 (secure 0 0 0) 0x7f16e406a170 con 0x7f16c4078bc0 2024-09-17T01:41:49.873 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:41:49.875 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:41:49.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.876+0000 7f16ea000640 1 -- 172.21.15.42:0/1369503546 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f16c4078bc0 msgr2=0x7f16c407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:49.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.876+0000 7f16ea000640 1 --2- 172.21.15.42:0/1369503546 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f16c4078bc0 0x7f16c407b0d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f16e406d210 tx=0x7f16d0005f90 comp rx=0 tx=0).stop 2024-09-17T01:41:49.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.876+0000 7f16ea000640 1 -- 172.21.15.42:0/1369503546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16c8004d90 msgr2=0x7f16e41f3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:49.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.876+0000 7f16ea000640 1 --2- 172.21.15.42:0/1369503546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16c8004d90 0x7f16e41f3da0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f16d4006600 tx=0x7f16d40039c0 comp rx=0 tx=0).stop 2024-09-17T01:41:49.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.876+0000 7f16ea000640 1 -- 172.21.15.42:0/1369503546 shutdown_connections 2024-09-17T01:41:49.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.876+0000 7f16ea000640 1 --2- 172.21.15.42:0/1369503546 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f16c4078bc0 0x7f16c407b0d0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:49.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.876+0000 7f16ea000640 1 --2- 172.21.15.42:0/1369503546 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16e40ae650 0x7f16e41f6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:49.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.876+0000 7f16ea000640 1 --2- 172.21.15.42:0/1369503546 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16e41f2be0 0x7f16e40ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:49.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.876+0000 7f16ea000640 1 --2- 172.21.15.42:0/1369503546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16c8004d90 0x7f16e41f3da0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:49.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.876+0000 7f16ea000640 1 -- 172.21.15.42:0/1369503546 >> 172.21.15.42:0/1369503546 conn(0x7f16e40b2930 msgr2=0x7f16e415f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:49.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.876+0000 7f16ea000640 1 -- 172.21.15.42:0/1369503546 shutdown_connections 2024-09-17T01:41:49.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:49.876+0000 7f16ea000640 1 -- 172.21.15.42:0/1369503546 wait complete. 2024-09-17T01:41:49.901 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":427,"stamp":"2024-09-17T01:41:49.149551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":401340,"kb_used_data":14408,"kb_used_omap":12,"kb_used_meta":386739,"kb_avail":754573380,"statfs":{"total":773094113280,"available":772683141120,"internally_reserved":0,"allocated":14753792,"data_stored":7118180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":396021300},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.274331"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889403+0000","last_change":"2024-09-17T01:41:39.913354+0000","last_active":"2024-09-17T01:41:40.889403+0000","last_peered":"2024-09-17T01:41:40.889403+0000","last_clean":"2024-09-17T01:41:40.889403+0000","last_became_active":"2024-09-17T01:41:39.913007+0000","last_became_peered":"2024-09-17T01:41:39.913007+0000","last_unstale":"2024-09-17T01:41:40.889403+0000","last_undegraded":"2024-09-17T01:41:40.889403+0000","last_fullsized":"2024-09-17T01:41:40.889403+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:47:19.205133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890027+0000","last_change":"2024-09-17T01:41:39.898479+0000","last_active":"2024-09-17T01:41:40.890027+0000","last_peered":"2024-09-17T01:41:40.890027+0000","last_clean":"2024-09-17T01:41:40.890027+0000","last_became_active":"2024-09-17T01:41:39.898142+0000","last_became_peered":"2024-09-17T01:41:39.898142+0000","last_unstale":"2024-09-17T01:41:40.890027+0000","last_undegraded":"2024-09-17T01:41:40.890027+0000","last_fullsized":"2024-09-17T01:41:40.890027+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:04:30.075643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354355+0000","last_change":"2024-09-17T01:41:39.891779+0000","last_active":"2024-09-17T01:41:41.354355+0000","last_peered":"2024-09-17T01:41:41.354355+0000","last_clean":"2024-09-17T01:41:41.354355+0000","last_became_active":"2024-09-17T01:41:39.888460+0000","last_became_peered":"2024-09-17T01:41:39.888460+0000","last_unstale":"2024-09-17T01:41:41.354355+0000","last_undegraded":"2024-09-17T01:41:41.354355+0000","last_fullsized":"2024-09-17T01:41:41.354355+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:13.500130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.935705+0000","last_change":"2024-09-17T01:41:39.914186+0000","last_active":"2024-09-17T01:41:40.935705+0000","last_peered":"2024-09-17T01:41:40.935705+0000","last_clean":"2024-09-17T01:41:40.935705+0000","last_became_active":"2024-09-17T01:41:39.913857+0000","last_became_peered":"2024-09-17T01:41:39.913857+0000","last_unstale":"2024-09-17T01:41:40.935705+0000","last_undegraded":"2024-09-17T01:41:40.935705+0000","last_fullsized":"2024-09-17T01:41:40.935705+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:50:50.092216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356039+0000","last_change":"2024-09-17T01:41:39.908288+0000","last_active":"2024-09-17T01:41:41.356039+0000","last_peered":"2024-09-17T01:41:41.356039+0000","last_clean":"2024-09-17T01:41:41.356039+0000","last_became_active":"2024-09-17T01:41:39.906273+0000","last_became_peered":"2024-09-17T01:41:39.906273+0000","last_unstale":"2024-09-17T01:41:41.356039+0000","last_undegraded":"2024-09-17T01:41:41.356039+0000","last_fullsized":"2024-09-17T01:41:41.356039+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:21.579209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355866+0000","last_change":"2024-09-17T01:41:39.917260+0000","last_active":"2024-09-17T01:41:41.355866+0000","last_peered":"2024-09-17T01:41:41.355866+0000","last_clean":"2024-09-17T01:41:41.355866+0000","last_became_active":"2024-09-17T01:41:39.916904+0000","last_became_peered":"2024-09-17T01:41:39.916904+0000","last_unstale":"2024-09-17T01:41:41.355866+0000","last_undegraded":"2024-09-17T01:41:41.355866+0000","last_fullsized":"2024-09-17T01:41:41.355866+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:52.970207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355330+0000","last_change":"2024-09-17T01:41:39.918635+0000","last_active":"2024-09-17T01:41:41.355330+0000","last_peered":"2024-09-17T01:41:41.355330+0000","last_clean":"2024-09-17T01:41:41.355330+0000","last_became_active":"2024-09-17T01:41:39.918295+0000","last_became_peered":"2024-09-17T01:41:39.918295+0000","last_unstale":"2024-09-17T01:41:41.355330+0000","last_undegraded":"2024-09-17T01:41:41.355330+0000","last_fullsized":"2024-09-17T01:41:41.355330+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:35.149107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354648+0000","last_change":"2024-09-17T01:41:39.903573+0000","last_active":"2024-09-17T01:41:41.354648+0000","last_peered":"2024-09-17T01:41:41.354648+0000","last_clean":"2024-09-17T01:41:41.354648+0000","last_became_active":"2024-09-17T01:41:39.903235+0000","last_became_peered":"2024-09-17T01:41:39.903235+0000","last_unstale":"2024-09-17T01:41:41.354648+0000","last_undegraded":"2024-09-17T01:41:41.354648+0000","last_fullsized":"2024-09-17T01:41:41.354648+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:56.018832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356289+0000","last_change":"2024-09-17T01:41:39.905348+0000","last_active":"2024-09-17T01:41:41.356289+0000","last_peered":"2024-09-17T01:41:41.356289+0000","last_clean":"2024-09-17T01:41:41.356289+0000","last_became_active":"2024-09-17T01:41:39.900434+0000","last_became_peered":"2024-09-17T01:41:39.900434+0000","last_unstale":"2024-09-17T01:41:41.356289+0000","last_undegraded":"2024-09-17T01:41:41.356289+0000","last_fullsized":"2024-09-17T01:41:41.356289+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:33.033181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890293+0000","last_change":"2024-09-17T01:41:39.914311+0000","last_active":"2024-09-17T01:41:40.890293+0000","last_peered":"2024-09-17T01:41:40.890293+0000","last_clean":"2024-09-17T01:41:40.890293+0000","last_became_active":"2024-09-17T01:41:39.913985+0000","last_became_peered":"2024-09-17T01:41:39.913985+0000","last_unstale":"2024-09-17T01:41:40.890293+0000","last_undegraded":"2024-09-17T01:41:40.890293+0000","last_fullsized":"2024-09-17T01:41:40.890293+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:07.078291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.935875+0000","last_change":"2024-09-17T01:41:39.896447+0000","last_active":"2024-09-17T01:41:40.935875+0000","last_peered":"2024-09-17T01:41:40.935875+0000","last_clean":"2024-09-17T01:41:40.935875+0000","last_became_active":"2024-09-17T01:41:39.896096+0000","last_became_peered":"2024-09-17T01:41:39.896096+0000","last_unstale":"2024-09-17T01:41:40.935875+0000","last_undegraded":"2024-09-17T01:41:40.935875+0000","last_fullsized":"2024-09-17T01:41:40.935875+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:54.345098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355079+0000","last_change":"2024-09-17T01:41:39.913333+0000","last_active":"2024-09-17T01:41:41.355079+0000","last_peered":"2024-09-17T01:41:41.355079+0000","last_clean":"2024-09-17T01:41:41.355079+0000","last_became_active":"2024-09-17T01:41:39.907889+0000","last_became_peered":"2024-09-17T01:41:39.907889+0000","last_unstale":"2024-09-17T01:41:41.355079+0000","last_undegraded":"2024-09-17T01:41:41.355079+0000","last_fullsized":"2024-09-17T01:41:41.355079+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:37.231590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.935672+0000","last_change":"2024-09-17T01:41:39.895367+0000","last_active":"2024-09-17T01:41:40.935672+0000","last_peered":"2024-09-17T01:41:40.935672+0000","last_clean":"2024-09-17T01:41:40.935672+0000","last_became_active":"2024-09-17T01:41:39.893777+0000","last_became_peered":"2024-09-17T01:41:39.893777+0000","last_unstale":"2024-09-17T01:41:40.935672+0000","last_undegraded":"2024-09-17T01:41:40.935672+0000","last_fullsized":"2024-09-17T01:41:40.935672+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:09.465366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.888803+0000","last_change":"2024-09-17T01:41:39.901406+0000","last_active":"2024-09-17T01:41:40.888803+0000","last_peered":"2024-09-17T01:41:40.888803+0000","last_clean":"2024-09-17T01:41:40.888803+0000","last_became_active":"2024-09-17T01:41:39.897993+0000","last_became_peered":"2024-09-17T01:41:39.897993+0000","last_unstale":"2024-09-17T01:41:40.888803+0000","last_undegraded":"2024-09-17T01:41:40.888803+0000","last_fullsized":"2024-09-17T01:41:40.888803+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:46.007752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355340+0000","last_change":"2024-09-17T01:41:39.912799+0000","last_active":"2024-09-17T01:41:41.355340+0000","last_peered":"2024-09-17T01:41:41.355340+0000","last_clean":"2024-09-17T01:41:41.355340+0000","last_became_active":"2024-09-17T01:41:39.911355+0000","last_became_peered":"2024-09-17T01:41:39.911355+0000","last_unstale":"2024-09-17T01:41:41.355340+0000","last_undegraded":"2024-09-17T01:41:41.355340+0000","last_fullsized":"2024-09-17T01:41:41.355340+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:48.438144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889263+0000","last_change":"2024-09-17T01:41:39.912148+0000","last_active":"2024-09-17T01:41:40.889263+0000","last_peered":"2024-09-17T01:41:40.889263+0000","last_clean":"2024-09-17T01:41:40.889263+0000","last_became_active":"2024-09-17T01:41:39.911648+0000","last_became_peered":"2024-09-17T01:41:39.911648+0000","last_unstale":"2024-09-17T01:41:40.889263+0000","last_undegraded":"2024-09-17T01:41:40.889263+0000","last_fullsized":"2024-09-17T01:41:40.889263+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:28.353951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356472+0000","last_change":"2024-09-17T01:41:39.906031+0000","last_active":"2024-09-17T01:41:41.356472+0000","last_peered":"2024-09-17T01:41:41.356472+0000","last_clean":"2024-09-17T01:41:41.356472+0000","last_became_active":"2024-09-17T01:41:39.899628+0000","last_became_peered":"2024-09-17T01:41:39.899628+0000","last_unstale":"2024-09-17T01:41:41.356472+0000","last_undegraded":"2024-09-17T01:41:41.356472+0000","last_fullsized":"2024-09-17T01:41:41.356472+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:52.036134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355595+0000","last_change":"2024-09-17T01:41:39.893407+0000","last_active":"2024-09-17T01:41:41.355595+0000","last_peered":"2024-09-17T01:41:41.355595+0000","last_clean":"2024-09-17T01:41:41.355595+0000","last_became_active":"2024-09-17T01:41:39.892194+0000","last_became_peered":"2024-09-17T01:41:39.892194+0000","last_unstale":"2024-09-17T01:41:41.355595+0000","last_undegraded":"2024-09-17T01:41:41.355595+0000","last_fullsized":"2024-09-17T01:41:41.355595+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:21.295162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.888633+0000","last_change":"2024-09-17T01:41:39.894550+0000","last_active":"2024-09-17T01:41:40.888633+0000","last_peered":"2024-09-17T01:41:40.888633+0000","last_clean":"2024-09-17T01:41:40.888633+0000","last_became_active":"2024-09-17T01:41:39.893953+0000","last_became_peered":"2024-09-17T01:41:39.893953+0000","last_unstale":"2024-09-17T01:41:40.888633+0000","last_undegraded":"2024-09-17T01:41:40.888633+0000","last_fullsized":"2024-09-17T01:41:40.888633+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:48.878097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355155+0000","last_change":"2024-09-17T01:41:39.896804+0000","last_active":"2024-09-17T01:41:41.355155+0000","last_peered":"2024-09-17T01:41:41.355155+0000","last_clean":"2024-09-17T01:41:41.355155+0000","last_became_active":"2024-09-17T01:41:39.896444+0000","last_became_peered":"2024-09-17T01:41:39.896444+0000","last_unstale":"2024-09-17T01:41:41.355155+0000","last_undegraded":"2024-09-17T01:41:41.355155+0000","last_fullsized":"2024-09-17T01:41:41.355155+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:38.192115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355540+0000","last_change":"2024-09-17T01:41:39.914678+0000","last_active":"2024-09-17T01:41:41.355540+0000","last_peered":"2024-09-17T01:41:41.355540+0000","last_clean":"2024-09-17T01:41:41.355540+0000","last_became_active":"2024-09-17T01:41:39.910960+0000","last_became_peered":"2024-09-17T01:41:39.910960+0000","last_unstale":"2024-09-17T01:41:41.355540+0000","last_undegraded":"2024-09-17T01:41:41.355540+0000","last_fullsized":"2024-09-17T01:41:41.355540+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:05.964545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.888892+0000","last_change":"2024-09-17T01:41:39.892112+0000","last_active":"2024-09-17T01:41:40.888892+0000","last_peered":"2024-09-17T01:41:40.888892+0000","last_clean":"2024-09-17T01:41:40.888892+0000","last_became_active":"2024-09-17T01:41:39.891206+0000","last_became_peered":"2024-09-17T01:41:39.891206+0000","last_unstale":"2024-09-17T01:41:40.888892+0000","last_undegraded":"2024-09-17T01:41:40.888892+0000","last_fullsized":"2024-09-17T01:41:40.888892+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:59:11.138821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.887069+0000","last_change":"2024-09-17T01:41:39.918528+0000","last_active":"2024-09-17T01:41:40.887069+0000","last_peered":"2024-09-17T01:41:40.887069+0000","last_clean":"2024-09-17T01:41:40.887069+0000","last_became_active":"2024-09-17T01:41:39.915444+0000","last_became_peered":"2024-09-17T01:41:39.915444+0000","last_unstale":"2024-09-17T01:41:40.887069+0000","last_undegraded":"2024-09-17T01:41:40.887069+0000","last_fullsized":"2024-09-17T01:41:40.887069+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:06.532999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354875+0000","last_change":"2024-09-17T01:41:39.909626+0000","last_active":"2024-09-17T01:41:41.354875+0000","last_peered":"2024-09-17T01:41:41.354875+0000","last_clean":"2024-09-17T01:41:41.354875+0000","last_became_active":"2024-09-17T01:41:39.909214+0000","last_became_peered":"2024-09-17T01:41:39.909214+0000","last_unstale":"2024-09-17T01:41:41.354875+0000","last_undegraded":"2024-09-17T01:41:41.354875+0000","last_fullsized":"2024-09-17T01:41:41.354875+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:07.538851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.936068+0000","last_change":"2024-09-17T01:41:39.906230+0000","last_active":"2024-09-17T01:41:40.936068+0000","last_peered":"2024-09-17T01:41:40.936068+0000","last_clean":"2024-09-17T01:41:40.936068+0000","last_became_active":"2024-09-17T01:41:39.905323+0000","last_became_peered":"2024-09-17T01:41:39.905323+0000","last_unstale":"2024-09-17T01:41:40.936068+0000","last_undegraded":"2024-09-17T01:41:40.936068+0000","last_fullsized":"2024-09-17T01:41:40.936068+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:59.969882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890617+0000","last_change":"2024-09-17T01:41:39.892358+0000","last_active":"2024-09-17T01:41:40.890617+0000","last_peered":"2024-09-17T01:41:40.890617+0000","last_clean":"2024-09-17T01:41:40.890617+0000","last_became_active":"2024-09-17T01:41:39.892007+0000","last_became_peered":"2024-09-17T01:41:39.892007+0000","last_unstale":"2024-09-17T01:41:40.890617+0000","last_undegraded":"2024-09-17T01:41:40.890617+0000","last_fullsized":"2024-09-17T01:41:40.890617+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:54.129628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890388+0000","last_change":"2024-09-17T01:41:39.915488+0000","last_active":"2024-09-17T01:41:40.890388+0000","last_peered":"2024-09-17T01:41:40.890388+0000","last_clean":"2024-09-17T01:41:40.890388+0000","last_became_active":"2024-09-17T01:41:39.914235+0000","last_became_peered":"2024-09-17T01:41:39.914235+0000","last_unstale":"2024-09-17T01:41:40.890388+0000","last_undegraded":"2024-09-17T01:41:40.890388+0000","last_fullsized":"2024-09-17T01:41:40.890388+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:53.298805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.887348+0000","last_change":"2024-09-17T01:41:39.905009+0000","last_active":"2024-09-17T01:41:40.887348+0000","last_peered":"2024-09-17T01:41:40.887348+0000","last_clean":"2024-09-17T01:41:40.887348+0000","last_became_active":"2024-09-17T01:41:39.904661+0000","last_became_peered":"2024-09-17T01:41:39.904661+0000","last_unstale":"2024-09-17T01:41:40.887348+0000","last_undegraded":"2024-09-17T01:41:40.887348+0000","last_fullsized":"2024-09-17T01:41:40.887348+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:57.134013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.888801+0000","last_change":"2024-09-17T01:41:39.903040+0000","last_active":"2024-09-17T01:41:40.888801+0000","last_peered":"2024-09-17T01:41:40.888801+0000","last_clean":"2024-09-17T01:41:40.888801+0000","last_became_active":"2024-09-17T01:41:39.901317+0000","last_became_peered":"2024-09-17T01:41:39.901317+0000","last_unstale":"2024-09-17T01:41:40.888801+0000","last_undegraded":"2024-09-17T01:41:40.888801+0000","last_fullsized":"2024-09-17T01:41:40.888801+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:35.095684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889193+0000","last_change":"2024-09-17T01:41:39.885605+0000","last_active":"2024-09-17T01:41:40.889193+0000","last_peered":"2024-09-17T01:41:40.889193+0000","last_clean":"2024-09-17T01:41:40.889193+0000","last_became_active":"2024-09-17T01:41:39.885269+0000","last_became_peered":"2024-09-17T01:41:39.885269+0000","last_unstale":"2024-09-17T01:41:40.889193+0000","last_undegraded":"2024-09-17T01:41:40.889193+0000","last_fullsized":"2024-09-17T01:41:40.889193+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:57.268242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.887121+0000","last_change":"2024-09-17T01:41:39.900579+0000","last_active":"2024-09-17T01:41:40.887121+0000","last_peered":"2024-09-17T01:41:40.887121+0000","last_clean":"2024-09-17T01:41:40.887121+0000","last_became_active":"2024-09-17T01:41:39.900217+0000","last_became_peered":"2024-09-17T01:41:39.900217+0000","last_unstale":"2024-09-17T01:41:40.887121+0000","last_undegraded":"2024-09-17T01:41:40.887121+0000","last_fullsized":"2024-09-17T01:41:40.887121+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:30.999902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354468+0000","last_change":"2024-09-17T01:41:39.897367+0000","last_active":"2024-09-17T01:41:41.354468+0000","last_peered":"2024-09-17T01:41:41.354468+0000","last_clean":"2024-09-17T01:41:41.354468+0000","last_became_active":"2024-09-17T01:41:39.896177+0000","last_became_peered":"2024-09-17T01:41:39.896177+0000","last_unstale":"2024-09-17T01:41:41.354468+0000","last_undegraded":"2024-09-17T01:41:41.354468+0000","last_fullsized":"2024-09-17T01:41:41.354468+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:43:28.278656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890807+0000","last_change":"2024-09-17T01:41:39.911629+0000","last_active":"2024-09-17T01:41:40.890807+0000","last_peered":"2024-09-17T01:41:40.890807+0000","last_clean":"2024-09-17T01:41:40.890807+0000","last_became_active":"2024-09-17T01:41:39.909976+0000","last_became_peered":"2024-09-17T01:41:39.909976+0000","last_unstale":"2024-09-17T01:41:40.890807+0000","last_undegraded":"2024-09-17T01:41:40.890807+0000","last_fullsized":"2024-09-17T01:41:40.890807+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:29.308671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"135'4","reported_seq":19,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.357241+0000","last_change":"2024-09-17T01:41:38.882554+0000","last_active":"2024-09-17T01:41:41.357241+0000","last_peered":"2024-09-17T01:41:41.357241+0000","last_clean":"2024-09-17T01:41:41.357241+0000","last_became_active":"2024-09-17T01:41:38.882209+0000","last_became_peered":"2024-09-17T01:41:38.882209+0000","last_unstale":"2024-09-17T01:41:41.357241+0000","last_undegraded":"2024-09-17T01:41:41.357241+0000","last_fullsized":"2024-09-17T01:41:41.357241+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:26.546849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356469+0000","last_change":"2024-09-17T01:41:39.905010+0000","last_active":"2024-09-17T01:41:41.356469+0000","last_peered":"2024-09-17T01:41:41.356469+0000","last_clean":"2024-09-17T01:41:41.356469+0000","last_became_active":"2024-09-17T01:41:39.900043+0000","last_became_peered":"2024-09-17T01:41:39.900043+0000","last_unstale":"2024-09-17T01:41:41.356469+0000","last_undegraded":"2024-09-17T01:41:41.356469+0000","last_fullsized":"2024-09-17T01:41:41.356469+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:34.245025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"135'1","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355359+0000","last_change":"2024-09-17T01:41:38.892289+0000","last_active":"2024-09-17T01:41:41.355359+0000","last_peered":"2024-09-17T01:41:41.355359+0000","last_clean":"2024-09-17T01:41:41.355359+0000","last_became_active":"2024-09-17T01:41:38.891979+0000","last_became_peered":"2024-09-17T01:41:38.891979+0000","last_unstale":"2024-09-17T01:41:41.355359+0000","last_undegraded":"2024-09-17T01:41:41.355359+0000","last_fullsized":"2024-09-17T01:41:41.355359+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:00:07.436508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354336+0000","last_change":"2024-09-17T01:41:39.897361+0000","last_active":"2024-09-17T01:41:41.354336+0000","last_peered":"2024-09-17T01:41:41.354336+0000","last_clean":"2024-09-17T01:41:41.354336+0000","last_became_active":"2024-09-17T01:41:39.896982+0000","last_became_peered":"2024-09-17T01:41:39.896982+0000","last_unstale":"2024-09-17T01:41:41.354336+0000","last_undegraded":"2024-09-17T01:41:41.354336+0000","last_fullsized":"2024-09-17T01:41:41.354336+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:17.967702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"135'2","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.935846+0000","last_change":"2024-09-17T01:41:38.882622+0000","last_active":"2024-09-17T01:41:40.935846+0000","last_peered":"2024-09-17T01:41:40.935846+0000","last_clean":"2024-09-17T01:41:40.935846+0000","last_became_active":"2024-09-17T01:41:38.882281+0000","last_became_peered":"2024-09-17T01:41:38.882281+0000","last_unstale":"2024-09-17T01:41:40.935846+0000","last_undegraded":"2024-09-17T01:41:40.935846+0000","last_fullsized":"2024-09-17T01:41:40.935846+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:07.447798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355516+0000","last_change":"2024-09-17T01:41:39.908031+0000","last_active":"2024-09-17T01:41:41.355516+0000","last_peered":"2024-09-17T01:41:41.355516+0000","last_clean":"2024-09-17T01:41:41.355516+0000","last_became_active":"2024-09-17T01:41:39.907678+0000","last_became_peered":"2024-09-17T01:41:39.907678+0000","last_unstale":"2024-09-17T01:41:41.355516+0000","last_undegraded":"2024-09-17T01:41:41.355516+0000","last_fullsized":"2024-09-17T01:41:41.355516+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:11.369139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"135'2","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889421+0000","last_change":"2024-09-17T01:41:38.885583+0000","last_active":"2024-09-17T01:41:40.889421+0000","last_peered":"2024-09-17T01:41:40.889421+0000","last_clean":"2024-09-17T01:41:40.889421+0000","last_became_active":"2024-09-17T01:41:38.884223+0000","last_became_peered":"2024-09-17T01:41:38.884223+0000","last_unstale":"2024-09-17T01:41:40.889421+0000","last_undegraded":"2024-09-17T01:41:40.889421+0000","last_fullsized":"2024-09-17T01:41:40.889421+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:57.796155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355245+0000","last_change":"2024-09-17T01:41:39.902427+0000","last_active":"2024-09-17T01:41:41.355245+0000","last_peered":"2024-09-17T01:41:41.355245+0000","last_clean":"2024-09-17T01:41:41.355245+0000","last_became_active":"2024-09-17T01:41:39.902006+0000","last_became_peered":"2024-09-17T01:41:39.902006+0000","last_unstale":"2024-09-17T01:41:41.355245+0000","last_undegraded":"2024-09-17T01:41:41.355245+0000","last_fullsized":"2024-09-17T01:41:41.355245+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:29.141584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"135'1","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889036+0000","last_change":"2024-09-17T01:41:38.873721+0000","last_active":"2024-09-17T01:41:40.889036+0000","last_peered":"2024-09-17T01:41:40.889036+0000","last_clean":"2024-09-17T01:41:40.889036+0000","last_became_active":"2024-09-17T01:41:38.873362+0000","last_became_peered":"2024-09-17T01:41:38.873362+0000","last_unstale":"2024-09-17T01:41:40.889036+0000","last_undegraded":"2024-09-17T01:41:40.889036+0000","last_fullsized":"2024-09-17T01:41:40.889036+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:33.729661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355819+0000","last_change":"2024-09-17T01:41:39.911915+0000","last_active":"2024-09-17T01:41:41.355819+0000","last_peered":"2024-09-17T01:41:41.355819+0000","last_clean":"2024-09-17T01:41:41.355819+0000","last_became_active":"2024-09-17T01:41:39.907894+0000","last_became_peered":"2024-09-17T01:41:39.907894+0000","last_unstale":"2024-09-17T01:41:41.355819+0000","last_undegraded":"2024-09-17T01:41:41.355819+0000","last_fullsized":"2024-09-17T01:41:41.355819+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:51:13.115483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"135'1","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355048+0000","last_change":"2024-09-17T01:41:38.889732+0000","last_active":"2024-09-17T01:41:41.355048+0000","last_peered":"2024-09-17T01:41:41.355048+0000","last_clean":"2024-09-17T01:41:41.355048+0000","last_became_active":"2024-09-17T01:41:38.888209+0000","last_became_peered":"2024-09-17T01:41:38.888209+0000","last_unstale":"2024-09-17T01:41:41.355048+0000","last_undegraded":"2024-09-17T01:41:41.355048+0000","last_fullsized":"2024-09-17T01:41:41.355048+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:30:06.924877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354994+0000","last_change":"2024-09-17T01:41:39.906748+0000","last_active":"2024-09-17T01:41:41.354994+0000","last_peered":"2024-09-17T01:41:41.354994+0000","last_clean":"2024-09-17T01:41:41.354994+0000","last_became_active":"2024-09-17T01:41:39.906359+0000","last_became_peered":"2024-09-17T01:41:39.906359+0000","last_unstale":"2024-09-17T01:41:41.354994+0000","last_undegraded":"2024-09-17T01:41:41.354994+0000","last_fullsized":"2024-09-17T01:41:41.354994+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:01.721134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355200+0000","last_change":"2024-09-17T01:41:38.885067+0000","last_active":"2024-09-17T01:41:41.355200+0000","last_peered":"2024-09-17T01:41:41.355200+0000","last_clean":"2024-09-17T01:41:41.355200+0000","last_became_active":"2024-09-17T01:41:38.884745+0000","last_became_peered":"2024-09-17T01:41:38.884745+0000","last_unstale":"2024-09-17T01:41:41.355200+0000","last_undegraded":"2024-09-17T01:41:41.355200+0000","last_fullsized":"2024-09-17T01:41:41.355200+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:04.187447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.888462+0000","last_change":"2024-09-17T01:41:39.889546+0000","last_active":"2024-09-17T01:41:40.888462+0000","last_peered":"2024-09-17T01:41:40.888462+0000","last_clean":"2024-09-17T01:41:40.888462+0000","last_became_active":"2024-09-17T01:41:39.889222+0000","last_became_peered":"2024-09-17T01:41:39.889222+0000","last_unstale":"2024-09-17T01:41:40.888462+0000","last_undegraded":"2024-09-17T01:41:40.888462+0000","last_fullsized":"2024-09-17T01:41:40.888462+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:49.208113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.888524+0000","last_change":"2024-09-17T01:41:38.881509+0000","last_active":"2024-09-17T01:41:40.888524+0000","last_peered":"2024-09-17T01:41:40.888524+0000","last_clean":"2024-09-17T01:41:40.888524+0000","last_became_active":"2024-09-17T01:41:38.881199+0000","last_became_peered":"2024-09-17T01:41:38.881199+0000","last_unstale":"2024-09-17T01:41:40.888524+0000","last_undegraded":"2024-09-17T01:41:40.888524+0000","last_fullsized":"2024-09-17T01:41:40.888524+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:41.222557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890838+0000","last_change":"2024-09-17T01:41:39.897599+0000","last_active":"2024-09-17T01:41:40.890838+0000","last_peered":"2024-09-17T01:41:40.890838+0000","last_clean":"2024-09-17T01:41:40.890838+0000","last_became_active":"2024-09-17T01:41:39.897287+0000","last_became_peered":"2024-09-17T01:41:39.897287+0000","last_unstale":"2024-09-17T01:41:40.890838+0000","last_undegraded":"2024-09-17T01:41:40.890838+0000","last_fullsized":"2024-09-17T01:41:40.890838+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:58.701422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355055+0000","last_change":"2024-09-17T01:41:38.887052+0000","last_active":"2024-09-17T01:41:41.355055+0000","last_peered":"2024-09-17T01:41:41.355055+0000","last_clean":"2024-09-17T01:41:41.355055+0000","last_became_active":"2024-09-17T01:41:38.886738+0000","last_became_peered":"2024-09-17T01:41:38.886738+0000","last_unstale":"2024-09-17T01:41:41.355055+0000","last_undegraded":"2024-09-17T01:41:41.355055+0000","last_fullsized":"2024-09-17T01:41:41.355055+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:25.541036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.357057+0000","last_change":"2024-09-17T01:41:39.909805+0000","last_active":"2024-09-17T01:41:41.357057+0000","last_peered":"2024-09-17T01:41:41.357057+0000","last_clean":"2024-09-17T01:41:41.357057+0000","last_became_active":"2024-09-17T01:41:39.909106+0000","last_became_peered":"2024-09-17T01:41:39.909106+0000","last_unstale":"2024-09-17T01:41:41.357057+0000","last_undegraded":"2024-09-17T01:41:41.357057+0000","last_fullsized":"2024-09-17T01:41:41.357057+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:03.789501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355407+0000","last_change":"2024-09-17T01:41:38.885697+0000","last_active":"2024-09-17T01:41:41.355407+0000","last_peered":"2024-09-17T01:41:41.355407+0000","last_clean":"2024-09-17T01:41:41.355407+0000","last_became_active":"2024-09-17T01:41:38.885354+0000","last_became_peered":"2024-09-17T01:41:38.885354+0000","last_unstale":"2024-09-17T01:41:41.355407+0000","last_undegraded":"2024-09-17T01:41:41.355407+0000","last_fullsized":"2024-09-17T01:41:41.355407+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:04.252363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355161+0000","last_change":"2024-09-17T01:41:39.916513+0000","last_active":"2024-09-17T01:41:41.355161+0000","last_peered":"2024-09-17T01:41:41.355161+0000","last_clean":"2024-09-17T01:41:41.355161+0000","last_became_active":"2024-09-17T01:41:39.916156+0000","last_became_peered":"2024-09-17T01:41:39.916156+0000","last_unstale":"2024-09-17T01:41:41.355161+0000","last_undegraded":"2024-09-17T01:41:41.355161+0000","last_fullsized":"2024-09-17T01:41:41.355161+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:45.131482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"135'3","reported_seq":18,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356826+0000","last_change":"2024-09-17T01:41:38.884961+0000","last_active":"2024-09-17T01:41:41.356826+0000","last_peered":"2024-09-17T01:41:41.356826+0000","last_clean":"2024-09-17T01:41:41.356826+0000","last_became_active":"2024-09-17T01:41:38.884641+0000","last_became_peered":"2024-09-17T01:41:38.884641+0000","last_unstale":"2024-09-17T01:41:41.356826+0000","last_undegraded":"2024-09-17T01:41:41.356826+0000","last_fullsized":"2024-09-17T01:41:41.356826+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:39.247990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.887591+0000","last_change":"2024-09-17T01:41:39.909629+0000","last_active":"2024-09-17T01:41:40.887591+0000","last_peered":"2024-09-17T01:41:40.887591+0000","last_clean":"2024-09-17T01:41:40.887591+0000","last_became_active":"2024-09-17T01:41:39.909313+0000","last_became_peered":"2024-09-17T01:41:39.909313+0000","last_unstale":"2024-09-17T01:41:40.887591+0000","last_undegraded":"2024-09-17T01:41:40.887591+0000","last_fullsized":"2024-09-17T01:41:40.887591+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:00:02.326795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"135'6","reported_seq":21,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.887362+0000","last_change":"2024-09-17T01:41:38.889323+0000","last_active":"2024-09-17T01:41:40.887362+0000","last_peered":"2024-09-17T01:41:40.887362+0000","last_clean":"2024-09-17T01:41:40.887362+0000","last_became_active":"2024-09-17T01:41:38.889016+0000","last_became_peered":"2024-09-17T01:41:38.889016+0000","last_unstale":"2024-09-17T01:41:40.887362+0000","last_undegraded":"2024-09-17T01:41:40.887362+0000","last_fullsized":"2024-09-17T01:41:40.887362+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:35.060703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889731+0000","last_change":"2024-09-17T01:41:39.903239+0000","last_active":"2024-09-17T01:41:40.889731+0000","last_peered":"2024-09-17T01:41:40.889731+0000","last_clean":"2024-09-17T01:41:40.889731+0000","last_became_active":"2024-09-17T01:41:39.899556+0000","last_became_peered":"2024-09-17T01:41:39.899556+0000","last_unstale":"2024-09-17T01:41:40.889731+0000","last_undegraded":"2024-09-17T01:41:40.889731+0000","last_fullsized":"2024-09-17T01:41:40.889731+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:38.776145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889015+0000","last_change":"2024-09-17T01:41:38.879765+0000","last_active":"2024-09-17T01:41:40.889015+0000","last_peered":"2024-09-17T01:41:40.889015+0000","last_clean":"2024-09-17T01:41:40.889015+0000","last_became_active":"2024-09-17T01:41:38.878997+0000","last_became_peered":"2024-09-17T01:41:38.878997+0000","last_unstale":"2024-09-17T01:41:40.889015+0000","last_undegraded":"2024-09-17T01:41:40.889015+0000","last_fullsized":"2024-09-17T01:41:40.889015+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:14:54.110838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890764+0000","last_change":"2024-09-17T01:41:39.911049+0000","last_active":"2024-09-17T01:41:40.890764+0000","last_peered":"2024-09-17T01:41:40.890764+0000","last_clean":"2024-09-17T01:41:40.890764+0000","last_became_active":"2024-09-17T01:41:39.910371+0000","last_became_peered":"2024-09-17T01:41:39.910371+0000","last_unstale":"2024-09-17T01:41:40.890764+0000","last_undegraded":"2024-09-17T01:41:40.890764+0000","last_fullsized":"2024-09-17T01:41:40.890764+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:55.228058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.935184+0000","last_change":"2024-09-17T01:41:38.887910+0000","last_active":"2024-09-17T01:41:40.935184+0000","last_peered":"2024-09-17T01:41:40.935184+0000","last_clean":"2024-09-17T01:41:40.935184+0000","last_became_active":"2024-09-17T01:41:38.887445+0000","last_became_peered":"2024-09-17T01:41:38.887445+0000","last_unstale":"2024-09-17T01:41:40.935184+0000","last_undegraded":"2024-09-17T01:41:40.935184+0000","last_fullsized":"2024-09-17T01:41:40.935184+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:58:30.941321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355807+0000","last_change":"2024-09-17T01:41:39.907773+0000","last_active":"2024-09-17T01:41:41.355807+0000","last_peered":"2024-09-17T01:41:41.355807+0000","last_clean":"2024-09-17T01:41:41.355807+0000","last_became_active":"2024-09-17T01:41:39.907425+0000","last_became_peered":"2024-09-17T01:41:39.907425+0000","last_unstale":"2024-09-17T01:41:41.355807+0000","last_undegraded":"2024-09-17T01:41:41.355807+0000","last_fullsized":"2024-09-17T01:41:41.355807+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:36.414131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"135'8","reported_seq":23,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355901+0000","last_change":"2024-09-17T01:41:38.890585+0000","last_active":"2024-09-17T01:41:41.355901+0000","last_peered":"2024-09-17T01:41:41.355901+0000","last_clean":"2024-09-17T01:41:41.355901+0000","last_became_active":"2024-09-17T01:41:38.890139+0000","last_became_peered":"2024-09-17T01:41:38.890139+0000","last_unstale":"2024-09-17T01:41:41.355901+0000","last_undegraded":"2024-09-17T01:41:41.355901+0000","last_fullsized":"2024-09-17T01:41:41.355901+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:57.210587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356996+0000","last_change":"2024-09-17T01:41:39.897936+0000","last_active":"2024-09-17T01:41:41.356996+0000","last_peered":"2024-09-17T01:41:41.356996+0000","last_clean":"2024-09-17T01:41:41.356996+0000","last_became_active":"2024-09-17T01:41:39.896967+0000","last_became_peered":"2024-09-17T01:41:39.896967+0000","last_unstale":"2024-09-17T01:41:41.356996+0000","last_undegraded":"2024-09-17T01:41:41.356996+0000","last_fullsized":"2024-09-17T01:41:41.356996+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:10.994958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"135'1","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355493+0000","last_change":"2024-09-17T01:41:38.888104+0000","last_active":"2024-09-17T01:41:41.355493+0000","last_peered":"2024-09-17T01:41:41.355493+0000","last_clean":"2024-09-17T01:41:41.355493+0000","last_became_active":"2024-09-17T01:41:38.887512+0000","last_became_peered":"2024-09-17T01:41:38.887512+0000","last_unstale":"2024-09-17T01:41:41.355493+0000","last_undegraded":"2024-09-17T01:41:41.355493+0000","last_fullsized":"2024-09-17T01:41:41.355493+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:00.805470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.357088+0000","last_change":"2024-09-17T01:41:39.899540+0000","last_active":"2024-09-17T01:41:41.357088+0000","last_peered":"2024-09-17T01:41:41.357088+0000","last_clean":"2024-09-17T01:41:41.357088+0000","last_became_active":"2024-09-17T01:41:39.899234+0000","last_became_peered":"2024-09-17T01:41:39.899234+0000","last_unstale":"2024-09-17T01:41:41.357088+0000","last_undegraded":"2024-09-17T01:41:41.357088+0000","last_fullsized":"2024-09-17T01:41:41.357088+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:34:45.075355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"135'2","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.935638+0000","last_change":"2024-09-17T01:41:38.876615+0000","last_active":"2024-09-17T01:41:40.935638+0000","last_peered":"2024-09-17T01:41:40.935638+0000","last_clean":"2024-09-17T01:41:40.935638+0000","last_became_active":"2024-09-17T01:41:38.876250+0000","last_became_peered":"2024-09-17T01:41:38.876250+0000","last_unstale":"2024-09-17T01:41:40.935638+0000","last_undegraded":"2024-09-17T01:41:40.935638+0000","last_fullsized":"2024-09-17T01:41:40.935638+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:13:56.598505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889626+0000","last_change":"2024-09-17T01:41:39.900185+0000","last_active":"2024-09-17T01:41:40.889626+0000","last_peered":"2024-09-17T01:41:40.889626+0000","last_clean":"2024-09-17T01:41:40.889626+0000","last_became_active":"2024-09-17T01:41:39.895207+0000","last_became_peered":"2024-09-17T01:41:39.895207+0000","last_unstale":"2024-09-17T01:41:40.889626+0000","last_undegraded":"2024-09-17T01:41:40.889626+0000","last_fullsized":"2024-09-17T01:41:40.889626+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:52.526963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"135'1","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354567+0000","last_change":"2024-09-17T01:41:38.882538+0000","last_active":"2024-09-17T01:41:41.354567+0000","last_peered":"2024-09-17T01:41:41.354567+0000","last_clean":"2024-09-17T01:41:41.354567+0000","last_became_active":"2024-09-17T01:41:38.882135+0000","last_became_peered":"2024-09-17T01:41:38.882135+0000","last_unstale":"2024-09-17T01:41:41.354567+0000","last_undegraded":"2024-09-17T01:41:41.354567+0000","last_fullsized":"2024-09-17T01:41:41.354567+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:07.429310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.888966+0000","last_change":"2024-09-17T01:41:39.900025+0000","last_active":"2024-09-17T01:41:40.888966+0000","last_peered":"2024-09-17T01:41:40.888966+0000","last_clean":"2024-09-17T01:41:40.888966+0000","last_became_active":"2024-09-17T01:41:39.894040+0000","last_became_peered":"2024-09-17T01:41:39.894040+0000","last_unstale":"2024-09-17T01:41:40.888966+0000","last_undegraded":"2024-09-17T01:41:40.888966+0000","last_fullsized":"2024-09-17T01:41:40.888966+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:33.474943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356829+0000","last_change":"2024-09-17T01:41:38.888723+0000","last_active":"2024-09-17T01:41:41.356829+0000","last_peered":"2024-09-17T01:41:41.356829+0000","last_clean":"2024-09-17T01:41:41.356829+0000","last_became_active":"2024-09-17T01:41:38.888363+0000","last_became_peered":"2024-09-17T01:41:38.888363+0000","last_unstale":"2024-09-17T01:41:41.356829+0000","last_undegraded":"2024-09-17T01:41:41.356829+0000","last_fullsized":"2024-09-17T01:41:41.356829+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:33.994701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889476+0000","last_change":"2024-09-17T01:41:39.897025+0000","last_active":"2024-09-17T01:41:40.889476+0000","last_peered":"2024-09-17T01:41:40.889476+0000","last_clean":"2024-09-17T01:41:40.889476+0000","last_became_active":"2024-09-17T01:41:39.896625+0000","last_became_peered":"2024-09-17T01:41:39.896625+0000","last_unstale":"2024-09-17T01:41:40.889476+0000","last_undegraded":"2024-09-17T01:41:40.889476+0000","last_fullsized":"2024-09-17T01:41:40.889476+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:10.642076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"135'2","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354691+0000","last_change":"2024-09-17T01:41:38.882994+0000","last_active":"2024-09-17T01:41:41.354691+0000","last_peered":"2024-09-17T01:41:41.354691+0000","last_clean":"2024-09-17T01:41:41.354691+0000","last_became_active":"2024-09-17T01:41:38.882780+0000","last_became_peered":"2024-09-17T01:41:38.882780+0000","last_unstale":"2024-09-17T01:41:41.354691+0000","last_undegraded":"2024-09-17T01:41:41.354691+0000","last_fullsized":"2024-09-17T01:41:41.354691+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:00.702847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.887303+0000","last_change":"2024-09-17T01:41:39.898253+0000","last_active":"2024-09-17T01:41:40.887303+0000","last_peered":"2024-09-17T01:41:40.887303+0000","last_clean":"2024-09-17T01:41:40.887303+0000","last_became_active":"2024-09-17T01:41:39.897745+0000","last_became_peered":"2024-09-17T01:41:39.897745+0000","last_unstale":"2024-09-17T01:41:40.887303+0000","last_undegraded":"2024-09-17T01:41:40.887303+0000","last_fullsized":"2024-09-17T01:41:40.887303+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:31.082175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355346+0000","last_change":"2024-09-17T01:41:38.890582+0000","last_active":"2024-09-17T01:41:41.355346+0000","last_peered":"2024-09-17T01:41:41.355346+0000","last_clean":"2024-09-17T01:41:41.355346+0000","last_became_active":"2024-09-17T01:41:38.890231+0000","last_became_peered":"2024-09-17T01:41:38.890231+0000","last_unstale":"2024-09-17T01:41:41.355346+0000","last_undegraded":"2024-09-17T01:41:41.355346+0000","last_fullsized":"2024-09-17T01:41:41.355346+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:47.416687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889522+0000","last_change":"2024-09-17T01:41:39.893202+0000","last_active":"2024-09-17T01:41:40.889522+0000","last_peered":"2024-09-17T01:41:40.889522+0000","last_clean":"2024-09-17T01:41:40.889522+0000","last_became_active":"2024-09-17T01:41:39.892896+0000","last_became_peered":"2024-09-17T01:41:39.892896+0000","last_unstale":"2024-09-17T01:41:40.889522+0000","last_undegraded":"2024-09-17T01:41:40.889522+0000","last_fullsized":"2024-09-17T01:41:40.889522+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:25.989263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889077+0000","last_change":"2024-09-17T01:41:38.889563+0000","last_active":"2024-09-17T01:41:40.889077+0000","last_peered":"2024-09-17T01:41:40.889077+0000","last_clean":"2024-09-17T01:41:40.889077+0000","last_became_active":"2024-09-17T01:41:38.888781+0000","last_became_peered":"2024-09-17T01:41:38.888781+0000","last_unstale":"2024-09-17T01:41:40.889077+0000","last_undegraded":"2024-09-17T01:41:40.889077+0000","last_fullsized":"2024-09-17T01:41:40.889077+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:58.047664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355838+0000","last_change":"2024-09-17T01:41:39.907743+0000","last_active":"2024-09-17T01:41:41.355838+0000","last_peered":"2024-09-17T01:41:41.355838+0000","last_clean":"2024-09-17T01:41:41.355838+0000","last_became_active":"2024-09-17T01:41:39.907076+0000","last_became_peered":"2024-09-17T01:41:39.907076+0000","last_unstale":"2024-09-17T01:41:41.355838+0000","last_undegraded":"2024-09-17T01:41:41.355838+0000","last_fullsized":"2024-09-17T01:41:41.355838+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:27.450762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.935158+0000","last_change":"2024-09-17T01:41:38.885458+0000","last_active":"2024-09-17T01:41:40.935158+0000","last_peered":"2024-09-17T01:41:40.935158+0000","last_clean":"2024-09-17T01:41:40.935158+0000","last_became_active":"2024-09-17T01:41:38.884884+0000","last_became_peered":"2024-09-17T01:41:38.884884+0000","last_unstale":"2024-09-17T01:41:40.935158+0000","last_undegraded":"2024-09-17T01:41:40.935158+0000","last_fullsized":"2024-09-17T01:41:40.935158+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:41:30.108510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.887585+0000","last_change":"2024-09-17T01:41:39.908682+0000","last_active":"2024-09-17T01:41:40.887585+0000","last_peered":"2024-09-17T01:41:40.887585+0000","last_clean":"2024-09-17T01:41:40.887585+0000","last_became_active":"2024-09-17T01:41:39.908140+0000","last_became_peered":"2024-09-17T01:41:39.908140+0000","last_unstale":"2024-09-17T01:41:40.887585+0000","last_undegraded":"2024-09-17T01:41:40.887585+0000","last_fullsized":"2024-09-17T01:41:40.887585+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:26:50.609089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"135'2","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355567+0000","last_change":"2024-09-17T01:41:38.886108+0000","last_active":"2024-09-17T01:41:41.355567+0000","last_peered":"2024-09-17T01:41:41.355567+0000","last_clean":"2024-09-17T01:41:41.355567+0000","last_became_active":"2024-09-17T01:41:38.885735+0000","last_became_peered":"2024-09-17T01:41:38.885735+0000","last_unstale":"2024-09-17T01:41:41.355567+0000","last_undegraded":"2024-09-17T01:41:41.355567+0000","last_fullsized":"2024-09-17T01:41:41.355567+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:16.913690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889696+0000","last_change":"2024-09-17T01:41:39.910647+0000","last_active":"2024-09-17T01:41:40.889696+0000","last_peered":"2024-09-17T01:41:40.889696+0000","last_clean":"2024-09-17T01:41:40.889696+0000","last_became_active":"2024-09-17T01:41:39.910049+0000","last_became_peered":"2024-09-17T01:41:39.910049+0000","last_unstale":"2024-09-17T01:41:40.889696+0000","last_undegraded":"2024-09-17T01:41:40.889696+0000","last_fullsized":"2024-09-17T01:41:40.889696+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:39.090195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"136'1","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356986+0000","last_change":"2024-09-17T01:41:38.888956+0000","last_active":"2024-09-17T01:41:41.356986+0000","last_peered":"2024-09-17T01:41:41.356986+0000","last_clean":"2024-09-17T01:41:41.356986+0000","last_became_active":"2024-09-17T01:41:38.888591+0000","last_became_peered":"2024-09-17T01:41:38.888591+0000","last_unstale":"2024-09-17T01:41:41.356986+0000","last_undegraded":"2024-09-17T01:41:41.356986+0000","last_fullsized":"2024-09-17T01:41:41.356986+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:23.963194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890111+0000","last_change":"2024-09-17T01:41:39.908977+0000","last_active":"2024-09-17T01:41:40.890111+0000","last_peered":"2024-09-17T01:41:40.890111+0000","last_clean":"2024-09-17T01:41:40.890111+0000","last_became_active":"2024-09-17T01:41:39.905784+0000","last_became_peered":"2024-09-17T01:41:39.905784+0000","last_unstale":"2024-09-17T01:41:40.890111+0000","last_undegraded":"2024-09-17T01:41:40.890111+0000","last_fullsized":"2024-09-17T01:41:40.890111+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:43.463332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355347+0000","last_change":"2024-09-17T01:41:38.893661+0000","last_active":"2024-09-17T01:41:41.355347+0000","last_peered":"2024-09-17T01:41:41.355347+0000","last_clean":"2024-09-17T01:41:41.355347+0000","last_became_active":"2024-09-17T01:41:38.893356+0000","last_became_peered":"2024-09-17T01:41:38.893356+0000","last_unstale":"2024-09-17T01:41:41.355347+0000","last_undegraded":"2024-09-17T01:41:41.355347+0000","last_fullsized":"2024-09-17T01:41:41.355347+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:07:34.722925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.354379+0000","last_change":"2024-09-17T01:41:39.889003+0000","last_active":"2024-09-17T01:41:41.354379+0000","last_peered":"2024-09-17T01:41:41.354379+0000","last_clean":"2024-09-17T01:41:41.354379+0000","last_became_active":"2024-09-17T01:41:39.887179+0000","last_became_peered":"2024-09-17T01:41:39.887179+0000","last_unstale":"2024-09-17T01:41:41.354379+0000","last_undegraded":"2024-09-17T01:41:41.354379+0000","last_fullsized":"2024-09-17T01:41:41.354379+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:50.836313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.890153+0000","last_change":"2024-09-17T01:41:38.882409+0000","last_active":"2024-09-17T01:41:40.890153+0000","last_peered":"2024-09-17T01:41:40.890153+0000","last_clean":"2024-09-17T01:41:40.890153+0000","last_became_active":"2024-09-17T01:41:38.882062+0000","last_became_peered":"2024-09-17T01:41:38.882062+0000","last_unstale":"2024-09-17T01:41:40.890153+0000","last_undegraded":"2024-09-17T01:41:40.890153+0000","last_fullsized":"2024-09-17T01:41:40.890153+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:57.441358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356115+0000","last_change":"2024-09-17T01:41:39.910991+0000","last_active":"2024-09-17T01:41:41.356115+0000","last_peered":"2024-09-17T01:41:41.356115+0000","last_clean":"2024-09-17T01:41:41.356115+0000","last_became_active":"2024-09-17T01:41:39.910569+0000","last_became_peered":"2024-09-17T01:41:39.910569+0000","last_unstale":"2024-09-17T01:41:41.356115+0000","last_undegraded":"2024-09-17T01:41:41.356115+0000","last_fullsized":"2024-09-17T01:41:41.356115+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:10.092892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889178+0000","last_change":"2024-09-17T01:41:38.885009+0000","last_active":"2024-09-17T01:41:40.889178+0000","last_peered":"2024-09-17T01:41:40.889178+0000","last_clean":"2024-09-17T01:41:40.889178+0000","last_became_active":"2024-09-17T01:41:38.884672+0000","last_became_peered":"2024-09-17T01:41:38.884672+0000","last_unstale":"2024-09-17T01:41:40.889178+0000","last_undegraded":"2024-09-17T01:41:40.889178+0000","last_fullsized":"2024-09-17T01:41:40.889178+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:44:38.363973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356082+0000","last_change":"2024-09-17T01:41:39.921777+0000","last_active":"2024-09-17T01:41:41.356082+0000","last_peered":"2024-09-17T01:41:41.356082+0000","last_clean":"2024-09-17T01:41:41.356082+0000","last_became_active":"2024-09-17T01:41:39.921185+0000","last_became_peered":"2024-09-17T01:41:39.921185+0000","last_unstale":"2024-09-17T01:41:41.356082+0000","last_undegraded":"2024-09-17T01:41:41.356082+0000","last_fullsized":"2024-09-17T01:41:41.356082+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:25.074848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356079+0000","last_change":"2024-09-17T01:41:38.894301+0000","last_active":"2024-09-17T01:41:41.356079+0000","last_peered":"2024-09-17T01:41:41.356079+0000","last_clean":"2024-09-17T01:41:41.356079+0000","last_became_active":"2024-09-17T01:41:38.893976+0000","last_became_peered":"2024-09-17T01:41:38.893976+0000","last_unstale":"2024-09-17T01:41:41.356079+0000","last_undegraded":"2024-09-17T01:41:41.356079+0000","last_fullsized":"2024-09-17T01:41:41.356079+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:59.604894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355042+0000","last_change":"2024-09-17T01:41:39.909414+0000","last_active":"2024-09-17T01:41:41.355042+0000","last_peered":"2024-09-17T01:41:41.355042+0000","last_clean":"2024-09-17T01:41:41.355042+0000","last_became_active":"2024-09-17T01:41:39.909077+0000","last_became_peered":"2024-09-17T01:41:39.909077+0000","last_unstale":"2024-09-17T01:41:41.355042+0000","last_undegraded":"2024-09-17T01:41:41.355042+0000","last_fullsized":"2024-09-17T01:41:41.355042+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:09.812199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.935294+0000","last_change":"2024-09-17T01:41:38.887884+0000","last_active":"2024-09-17T01:41:40.935294+0000","last_peered":"2024-09-17T01:41:40.935294+0000","last_clean":"2024-09-17T01:41:40.935294+0000","last_became_active":"2024-09-17T01:41:38.887525+0000","last_became_peered":"2024-09-17T01:41:38.887525+0000","last_unstale":"2024-09-17T01:41:40.935294+0000","last_undegraded":"2024-09-17T01:41:40.935294+0000","last_fullsized":"2024-09-17T01:41:40.935294+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:07.622231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.888864+0000","last_change":"2024-09-17T01:41:39.904820+0000","last_active":"2024-09-17T01:41:40.888864+0000","last_peered":"2024-09-17T01:41:40.888864+0000","last_clean":"2024-09-17T01:41:40.888864+0000","last_became_active":"2024-09-17T01:41:39.904501+0000","last_became_peered":"2024-09-17T01:41:39.904501+0000","last_unstale":"2024-09-17T01:41:40.888864+0000","last_undegraded":"2024-09-17T01:41:40.888864+0000","last_fullsized":"2024-09-17T01:41:40.888864+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:47.339753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.889706+0000","last_change":"2024-09-17T01:41:38.879650+0000","last_active":"2024-09-17T01:41:40.889706+0000","last_peered":"2024-09-17T01:41:40.889706+0000","last_clean":"2024-09-17T01:41:40.889706+0000","last_became_active":"2024-09-17T01:41:38.879319+0000","last_became_peered":"2024-09-17T01:41:38.879319+0000","last_unstale":"2024-09-17T01:41:40.889706+0000","last_undegraded":"2024-09-17T01:41:40.889706+0000","last_fullsized":"2024-09-17T01:41:40.889706+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:23.466575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.355002+0000","last_change":"2024-09-17T01:41:39.888819+0000","last_active":"2024-09-17T01:41:41.355002+0000","last_peered":"2024-09-17T01:41:41.355002+0000","last_clean":"2024-09-17T01:41:41.355002+0000","last_became_active":"2024-09-17T01:41:39.888416+0000","last_became_peered":"2024-09-17T01:41:39.888416+0000","last_unstale":"2024-09-17T01:41:41.355002+0000","last_undegraded":"2024-09-17T01:41:41.355002+0000","last_fullsized":"2024-09-17T01:41:41.355002+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:38.855854+0000","last_clean_scrub_stamp":"2024-09-17T01:41:38.855854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:47.837413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"135'2","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:41.356283+0000","last_change":"2024-09-17T01:41:38.894268+0000","last_active":"2024-09-17T01:41:41.356283+0000","last_peered":"2024-09-17T01:41:41.356283+0000","last_clean":"2024-09-17T01:41:41.356283+0000","last_became_active":"2024-09-17T01:41:38.893934+0000","last_became_peered":"2024-09-17T01:41:38.893934+0000","last_unstale":"2024-09-17T01:41:41.356283+0000","last_undegraded":"2024-09-17T01:41:41.356283+0000","last_fullsized":"2024-09-17T01:41:41.356283+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:41:37.848311+0000","last_clean_scrub_stamp":"2024-09-17T01:41:37.848311+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:45.765235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":327,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T01:41:40.886919+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:41:40.886919+0000","last_peered":"2024-09-17T01:41:40.886919+0000","last_clean":"2024-09-17T01:41:40.886919+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:41:40.886919+0000","last_undegraded":"2024-09-17T01:41:40.886919+0000","last_fullsized":"2024-09-17T01:41:40.886919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476858,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55056,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316784,"statfs":{"total":96636764160,"available":96580386816,"internally_reserved":0,"allocated":1695744,"data_stored":742250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509561,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32840,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339000,"statfs":{"total":96636764160,"available":96603136000,"internally_reserved":0,"allocated":1691648,"data_stored":741612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509560,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55044,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316796,"statfs":{"total":96636764160,"available":96580399104,"internally_reserved":0,"allocated":1687552,"data_stored":741578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509561,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59212,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312628,"statfs":{"total":96636764160,"available":96576131072,"internally_reserved":0,"allocated":1687552,"data_stored":741578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509561,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59208,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312632,"statfs":{"total":96636764160,"available":96576135168,"internally_reserved":0,"allocated":1691648,"data_stored":741648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509560,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51484,"kb_used_data":2244,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320356,"statfs":{"total":96636764160,"available":96584044544,"internally_reserved":0,"allocated":2297856,"data_stored":1333580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509562,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28700,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343140,"statfs":{"total":96636764160,"available":96607375360,"internally_reserved":0,"allocated":1708032,"data_stored":743246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542267,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59796,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312044,"statfs":{"total":96636764160,"available":96575533056,"internally_reserved":0,"allocated":2293760,"data_stored":1332688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:41:49.905 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T01:41:49.905 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T01:41:50.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.176+0000 7f765c800640 1 -- 172.21.15.42:0/729512437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76540b3550 msgr2=0x7f765415cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:50.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.176+0000 7f765c800640 1 --2- 172.21.15.42:0/729512437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76540b3550 0x7f765415cec0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f76540704d0 tx=0x7f764802a4d0 comp rx=0 tx=0).stop 2024-09-17T01:41:50.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.176+0000 7f765c800640 1 -- 172.21.15.42:0/729512437 shutdown_connections 2024-09-17T01:41:50.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.176+0000 7f765c800640 1 --2- 172.21.15.42:0/729512437 >> v2:172.21.15.43:3300/0 conn(0x7f7654142f40 0x7f7654072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:50.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.176+0000 7f765c800640 1 --2- 172.21.15.42:0/729512437 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7654072e90 0x7f76540cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:50.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.176+0000 7f765c800640 1 --2- 172.21.15.42:0/729512437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76540b3550 0x7f765415cec0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:50.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.176+0000 7f765c800640 1 -- 172.21.15.42:0/729512437 >> 172.21.15.42:0/729512437 conn(0x7f76540b2930 msgr2=0x7f765406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:50.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.177+0000 7f765c800640 1 -- 172.21.15.42:0/729512437 shutdown_connections 2024-09-17T01:41:50.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.177+0000 7f765c800640 1 -- 172.21.15.42:0/729512437 wait complete. 2024-09-17T01:41:50.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.179+0000 7f765c800640 1 Processor -- start 2024-09-17T01:41:50.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.179+0000 7f765c800640 1 -- start start 2024-09-17T01:41:50.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.180+0000 7f765c800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7654072e90 0x7f765406e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:50.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.180+0000 7f765c800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76540b3550 0x7f765413ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:50.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.180+0000 7f765c800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7654142f40 0x7f76541f9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:50.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.180+0000 7f765c800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f765406d430 con 0x7f7654142f40 2024-09-17T01:41:50.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.180+0000 7f765c800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f765406d5b0 con 0x7f7654072e90 2024-09-17T01:41:50.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.180+0000 7f765c800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f765406d730 con 0x7f76540b3550 2024-09-17T01:41:50.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.181+0000 7f765a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7654142f40 0x7f76541f9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:50.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.181+0000 7f765a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7654142f40 0x7f76541f9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42022/0 (socket says 172.21.15.42:42022) 2024-09-17T01:41:50.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.181+0000 7f765a800640 1 -- 172.21.15.42:0/1011544140 learned_addr learned my addr 172.21.15.42:0/1011544140 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:50.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.181+0000 7f7659400640 1 --2- 172.21.15.42:0/1011544140 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76540b3550 0x7f765413ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:50.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.181+0000 7f7659e00640 1 --2- 172.21.15.42:0/1011544140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7654072e90 0x7f765406e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:50.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.181+0000 7f765a800640 1 -- 172.21.15.42:0/1011544140 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76540b3550 msgr2=0x7f765413ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:50.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.181+0000 7f765a800640 1 --2- 172.21.15.42:0/1011544140 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76540b3550 0x7f765413ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:50.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.181+0000 7f765a800640 1 -- 172.21.15.42:0/1011544140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7654072e90 msgr2=0x7f765406e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:50.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.181+0000 7f765a800640 1 --2- 172.21.15.42:0/1011544140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7654072e90 0x7f765406e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:50.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.181+0000 7f765a800640 1 -- 172.21.15.42:0/1011544140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f765406f980 con 0x7f7654142f40 2024-09-17T01:41:50.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.181+0000 7f7659400640 1 --2- 172.21.15.42:0/1011544140 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76540b3550 0x7f765413ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:41:50.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.181+0000 7f765a800640 1 --2- 172.21.15.42:0/1011544140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7654142f40 0x7f76541f9570 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f765000e990 tx=0x7f765000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:50.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.182+0000 7f764e000640 1 -- 172.21.15.42:0/1011544140 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7650004d20 con 0x7f7654142f40 2024-09-17T01:41:50.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.182+0000 7f764e000640 1 -- 172.21.15.42:0/1011544140 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f765000caa0 con 0x7f7654142f40 2024-09-17T01:41:50.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.182+0000 7f765c800640 1 -- 172.21.15.42:0/1011544140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f765406fc60 con 0x7f7654142f40 2024-09-17T01:41:50.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.182+0000 7f764e000640 1 -- 172.21.15.42:0/1011544140 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7650005020 con 0x7f7654142f40 2024-09-17T01:41:50.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.182+0000 7f765c800640 1 -- 172.21.15.42:0/1011544140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76541f9050 con 0x7f7654142f40 2024-09-17T01:41:50.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.183+0000 7f765c800640 1 -- 172.21.15.42:0/1011544140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f765406dc50 con 0x7f7654142f40 2024-09-17T01:41:50.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.184+0000 7f764e000640 1 -- 172.21.15.42:0/1011544140 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f76500051c0 con 0x7f7654142f40 2024-09-17T01:41:50.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.185+0000 7f764e000640 1 --2- 172.21.15.42:0/1011544140 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7638078b90 0x7f763807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:50.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.185+0000 7f764e000640 1 -- 172.21.15.42:0/1011544140 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f765009b970 con 0x7f7654142f40 2024-09-17T01:41:50.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.185+0000 7f7659e00640 1 --2- 172.21.15.42:0/1011544140 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7638078b90 0x7f763807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:50.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.186+0000 7f7659e00640 1 --2- 172.21.15.42:0/1011544140 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7638078b90 0x7f763807b0a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7648033000 tx=0x7f7648004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:50.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.189+0000 7f764e000640 1 -- 172.21.15.42:0/1011544140 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7650016030 con 0x7f7654142f40 2024-09-17T01:41:50.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.454+0000 7f765c800640 1 -- 172.21.15.42:0/1011544140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f765406f710 con 0x7f7654142f40 2024-09-17T01:41:50.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.458+0000 7f764e000640 1 -- 172.21.15.42:0/1011544140 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v37) ==== 190+0+147 (secure 0 0 0) 0x7f76500636c0 con 0x7f7654142f40 2024-09-17T01:41:50.457 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-09-17T01:41:50.457 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA== 2024-09-17T01:41:50.457 INFO:teuthology.orchestra.run.smithi042.stdout: caps mds = "allow" 2024-09-17T01:41:50.457 INFO:teuthology.orchestra.run.smithi042.stdout: caps mon = "allow r" 2024-09-17T01:41:50.457 INFO:teuthology.orchestra.run.smithi042.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T01:41:50.457 INFO:teuthology.orchestra.run.smithi042.stderr:updated caps for client.0 2024-09-17T01:41:50.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.460+0000 7f765c800640 1 -- 172.21.15.42:0/1011544140 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7638078b90 msgr2=0x7f763807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:50.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.460+0000 7f765c800640 1 --2- 172.21.15.42:0/1011544140 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7638078b90 0x7f763807b0a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7648033000 tx=0x7f7648004730 comp rx=0 tx=0).stop 2024-09-17T01:41:50.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.460+0000 7f765c800640 1 -- 172.21.15.42:0/1011544140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7654142f40 msgr2=0x7f76541f9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:50.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.460+0000 7f765c800640 1 --2- 172.21.15.42:0/1011544140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7654142f40 0x7f76541f9570 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f765000e990 tx=0x7f765000ee50 comp rx=0 tx=0).stop 2024-09-17T01:41:50.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.460+0000 7f765c800640 1 -- 172.21.15.42:0/1011544140 shutdown_connections 2024-09-17T01:41:50.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.460+0000 7f765c800640 1 --2- 172.21.15.42:0/1011544140 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7638078b90 0x7f763807b0a0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:50.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.460+0000 7f765c800640 1 --2- 172.21.15.42:0/1011544140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7654142f40 0x7f76541f9570 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:50.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.460+0000 7f765c800640 1 --2- 172.21.15.42:0/1011544140 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76540b3550 0x7f765413ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:50.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.460+0000 7f765c800640 1 --2- 172.21.15.42:0/1011544140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7654072e90 0x7f765406e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:50.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.460+0000 7f765c800640 1 -- 172.21.15.42:0/1011544140 >> 172.21.15.42:0/1011544140 conn(0x7f76540b2930 msgr2=0x7f765415f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:50.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.461+0000 7f765c800640 1 -- 172.21.15.42:0/1011544140 shutdown_connections 2024-09-17T01:41:50.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.461+0000 7f765c800640 1 -- 172.21.15.42:0/1011544140 wait complete. 2024-09-17T01:41:50.482 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:41:50.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.710+0000 7f23a6000640 1 -- 172.21.15.42:0/72659473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23a0072e90 msgr2=0x7f23a00cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:50.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.710+0000 7f23a6000640 1 --2- 172.21.15.42:0/72659473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23a0072e90 0x7f23a00cec40 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f23a00704d0 tx=0x7f239802aa30 comp rx=0 tx=0).stop 2024-09-17T01:41:50.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.710+0000 7f23a6000640 1 -- 172.21.15.42:0/72659473 shutdown_connections 2024-09-17T01:41:50.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.710+0000 7f23a6000640 1 --2- 172.21.15.42:0/72659473 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23a0072e90 0x7f23a00cec40 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:50.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.710+0000 7f23a6000640 1 --2- 172.21.15.42:0/72659473 >> v2:172.21.15.43:3300/0 conn(0x7f23a0142f40 0x7f23a0072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:50.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.710+0000 7f23a6000640 1 -- 172.21.15.42:0/72659473 >> 172.21.15.42:0/72659473 conn(0x7f23a00b2930 msgr2=0x7f23a006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:50.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.710+0000 7f23a6000640 1 -- 172.21.15.42:0/72659473 shutdown_connections 2024-09-17T01:41:50.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.710+0000 7f23a6000640 1 -- 172.21.15.42:0/72659473 wait complete. 2024-09-17T01:41:50.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.713+0000 7f23a6000640 1 Processor -- start 2024-09-17T01:41:50.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.713+0000 7f23a6000640 1 -- start start 2024-09-17T01:41:50.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.714+0000 7f23a6000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23a0072e90 0x7f23a01f6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:50.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.714+0000 7f23a6000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23a00b3550 0x7f23a013ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:50.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.714+0000 7f23a6000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23a0142f40 0x7f23a00ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:50.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.714+0000 7f23a6000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f23a006d5b0 con 0x7f23a0072e90 2024-09-17T01:41:50.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.714+0000 7f23a6000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f23a006d430 con 0x7f23a00b3550 2024-09-17T01:41:50.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.714+0000 7f23a6000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f23a006d730 con 0x7f23a0142f40 2024-09-17T01:41:50.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.714+0000 7f239f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23a0072e90 0x7f23a01f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:50.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.714+0000 7f239f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23a0072e90 0x7f23a01f6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42050/0 (socket says 172.21.15.42:42050) 2024-09-17T01:41:50.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.714+0000 7f239f400640 1 -- 172.21.15.42:0/1468486117 learned_addr learned my addr 172.21.15.42:0/1468486117 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:50.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.715+0000 7f2397e00640 1 --2- 172.21.15.42:0/1468486117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23a00b3550 0x7f23a013ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:50.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.715+0000 7f239fe00640 1 --2- 172.21.15.42:0/1468486117 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23a0142f40 0x7f23a00ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:50.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.715+0000 7f239f400640 1 -- 172.21.15.42:0/1468486117 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23a0142f40 msgr2=0x7f23a00ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:50.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.715+0000 7f239f400640 1 --2- 172.21.15.42:0/1468486117 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23a0142f40 0x7f23a00ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:50.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.715+0000 7f239f400640 1 -- 172.21.15.42:0/1468486117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23a00b3550 msgr2=0x7f23a013ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:50.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.715+0000 7f239f400640 1 --2- 172.21.15.42:0/1468486117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23a00b3550 0x7f23a013ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:50.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.715+0000 7f239f400640 1 -- 172.21.15.42:0/1468486117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a006e2f0 con 0x7f23a0072e90 2024-09-17T01:41:50.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.715+0000 7f2397e00640 1 --2- 172.21.15.42:0/1468486117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23a00b3550 0x7f23a013ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:41:50.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.715+0000 7f239fe00640 1 --2- 172.21.15.42:0/1468486117 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23a0142f40 0x7f23a00ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:41:50.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.715+0000 7f239f400640 1 --2- 172.21.15.42:0/1468486117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23a0072e90 0x7f23a01f6310 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f239000c3a0 tx=0x7f239000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:50.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.715+0000 7f2397400640 1 -- 172.21.15.42:0/1468486117 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2390017070 con 0x7f23a0072e90 2024-09-17T01:41:50.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.716+0000 7f2397400640 1 -- 172.21.15.42:0/1468486117 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23900053c0 con 0x7f23a0072e90 2024-09-17T01:41:50.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.716+0000 7f23a6000640 1 -- 172.21.15.42:0/1468486117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a006e5d0 con 0x7f23a0072e90 2024-09-17T01:41:50.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.716+0000 7f2397400640 1 -- 172.21.15.42:0/1468486117 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2390003850 con 0x7f23a0072e90 2024-09-17T01:41:50.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.716+0000 7f23a6000640 1 -- 172.21.15.42:0/1468486117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a006eb90 con 0x7f23a0072e90 2024-09-17T01:41:50.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.717+0000 7f23a6000640 1 -- 172.21.15.42:0/1468486117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23a006dc50 con 0x7f23a0072e90 2024-09-17T01:41:50.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.718+0000 7f2397400640 1 -- 172.21.15.42:0/1468486117 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f239001a070 con 0x7f23a0072e90 2024-09-17T01:41:50.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.719+0000 7f2397400640 1 --2- 172.21.15.42:0/1468486117 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f237c078b90 0x7f237c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:50.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.719+0000 7f2397400640 1 -- 172.21.15.42:0/1468486117 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f239009a180 con 0x7f23a0072e90 2024-09-17T01:41:50.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.719+0000 7f2397e00640 1 --2- 172.21.15.42:0/1468486117 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f237c078b90 0x7f237c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:50.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.720+0000 7f2397e00640 1 --2- 172.21.15.42:0/1468486117 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f237c078b90 0x7f237c07b0a0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f23a00cd710 tx=0x7f2388005df0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:50.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.723+0000 7f2397400640 1 -- 172.21.15.42:0/1468486117 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2390062520 con 0x7f23a0072e90 2024-09-17T01:41:50.900 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:41:50.908 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:41:50.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.956+0000 7f23a6000640 1 -- 172.21.15.42:0/1468486117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23a006a170 con 0x7f23a0072e90 2024-09-17T01:41:50.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.957+0000 7f2397400640 1 -- 172.21.15.42:0/1468486117 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5231 (secure 0 0 0) 0x7f2390061e20 con 0x7f23a0072e90 2024-09-17T01:41:50.956 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:41:50.956 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2491855232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2491855232},{"type":"v1","addr":"172.21.15.43:6835","nonce":2491855232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4136787983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4136787983},{"type":"v1","addr":"172.21.15.43:6837","nonce":4136787983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/3441664627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3441664627},{"type":"v1","addr":"172.21.15.42:6834","nonce":3441664627}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:41:39.382305+0000","modified":"2024-09-17T01:41:42.412964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8442":{"gid":8442,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3060441721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3060441721},{"type":"v1","addr":"172.21.15.42:6835","nonce":3060441721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8442,"qdb_cluster":[8442]},"id":9}]} 2024-09-17T01:41:50.956 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 107 2024-09-17T01:41:50.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.960+0000 7f23a6000640 1 -- 172.21.15.42:0/1468486117 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f237c078b90 msgr2=0x7f237c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:50.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.960+0000 7f23a6000640 1 --2- 172.21.15.42:0/1468486117 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f237c078b90 0x7f237c07b0a0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f23a00cd710 tx=0x7f2388005df0 comp rx=0 tx=0).stop 2024-09-17T01:41:50.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.960+0000 7f23a6000640 1 -- 172.21.15.42:0/1468486117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23a0072e90 msgr2=0x7f23a01f6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:50.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.960+0000 7f23a6000640 1 --2- 172.21.15.42:0/1468486117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23a0072e90 0x7f23a01f6310 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f239000c3a0 tx=0x7f239000c860 comp rx=0 tx=0).stop 2024-09-17T01:41:50.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.960+0000 7f23a6000640 1 -- 172.21.15.42:0/1468486117 shutdown_connections 2024-09-17T01:41:50.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.960+0000 7f23a6000640 1 --2- 172.21.15.42:0/1468486117 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f237c078b90 0x7f237c07b0a0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:50.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.960+0000 7f23a6000640 1 --2- 172.21.15.42:0/1468486117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23a00b3550 0x7f23a013ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:50.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.960+0000 7f23a6000640 1 --2- 172.21.15.42:0/1468486117 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23a0142f40 0x7f23a00ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:50.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.960+0000 7f23a6000640 1 --2- 172.21.15.42:0/1468486117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23a0072e90 0x7f23a01f6310 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:50.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.960+0000 7f23a6000640 1 -- 172.21.15.42:0/1468486117 >> 172.21.15.42:0/1468486117 conn(0x7f23a00b2930 msgr2=0x7f23a015af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:50.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.960+0000 7f23a6000640 1 -- 172.21.15.42:0/1468486117 shutdown_connections 2024-09-17T01:41:50.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:50.960+0000 7f23a6000640 1 -- 172.21.15.42:0/1468486117 wait complete. 2024-09-17T01:41:51.385 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 107, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:41:39.382305+0000', 'modified': '2024-09-17T01:41:42.412964+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8442}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8442': {'gid': 8442, 'name': 'a', 'rank': 0, 'incarnation': 103, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.42:6835/3060441721', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6833', 'nonce': 3060441721}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 3060441721}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8442, 'qdb_cluster': [8442]} 2024-09-17T01:41:51.385 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T01:41:51.385 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T01:41:51.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.619+0000 7f47f7200640 1 -- 172.21.15.42:0/4170735035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47dc004800 msgr2=0x7f47dc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:51.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.619+0000 7f47f7200640 1 --2- 172.21.15.42:0/4170735035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47dc004800 0x7f47dc004c10 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f47e00016c0 tx=0x7f47dc005830 comp rx=0 tx=0).stop 2024-09-17T01:41:51.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.619+0000 7f47f7200640 1 -- 172.21.15.42:0/4170735035 shutdown_connections 2024-09-17T01:41:51.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.619+0000 7f47f7200640 1 --2- 172.21.15.42:0/4170735035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47dc004800 0x7f47dc004c10 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.619+0000 7f47f7200640 1 -- 172.21.15.42:0/4170735035 >> 172.21.15.42:0/4170735035 conn(0x7f47f80b25f0 msgr2=0x7f47f80d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:51.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.619+0000 7f47f7200640 1 -- 172.21.15.42:0/4170735035 shutdown_connections 2024-09-17T01:41:51.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.619+0000 7f47f7200640 1 -- 172.21.15.42:0/4170735035 wait complete. 2024-09-17T01:41:51.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.621+0000 7f47f7200640 1 Processor -- start 2024-09-17T01:41:51.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.621+0000 7f47f7200640 1 -- start start 2024-09-17T01:41:51.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.623+0000 7f47f7200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47dc004800 0x7f47f81e4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:51.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.623+0000 7f47f7200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f47f815c250 0x7f47f8153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:51.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.623+0000 7f47f7200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47f80b0a40 0x7f47f80b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:51.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.623+0000 7f47f7200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f47f815dba0 con 0x7f47f80b0a40 2024-09-17T01:41:51.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.623+0000 7f47f7200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f47f815da20 con 0x7f47dc004800 2024-09-17T01:41:51.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.623+0000 7f47f7200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f47f806cd20 con 0x7f47f815c250 2024-09-17T01:41:51.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.623+0000 7f47f6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47f80b0a40 0x7f47f80b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:51.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.623+0000 7f47f6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47f80b0a40 0x7f47f80b0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42066/0 (socket says 172.21.15.42:42066) 2024-09-17T01:41:51.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.623+0000 7f47f6800640 1 -- 172.21.15.42:0/1335844211 learned_addr learned my addr 172.21.15.42:0/1335844211 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:51.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.623+0000 7f47efe00640 1 --2- 172.21.15.42:0/1335844211 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f47f815c250 0x7f47f8153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:51.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.623+0000 7f47f5e00640 1 --2- 172.21.15.42:0/1335844211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47dc004800 0x7f47f81e4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:51.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.624+0000 7f47f6800640 1 -- 172.21.15.42:0/1335844211 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f47f815c250 msgr2=0x7f47f8153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:51.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.624+0000 7f47f6800640 1 --2- 172.21.15.42:0/1335844211 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f47f815c250 0x7f47f8153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.624+0000 7f47f6800640 1 -- 172.21.15.42:0/1335844211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47dc004800 msgr2=0x7f47f81e4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:51.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.624+0000 7f47f6800640 1 --2- 172.21.15.42:0/1335844211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47dc004800 0x7f47f81e4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.624+0000 7f47f6800640 1 -- 172.21.15.42:0/1335844211 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f80b1390 con 0x7f47f80b0a40 2024-09-17T01:41:51.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.624+0000 7f47f6800640 1 --2- 172.21.15.42:0/1335844211 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47f80b0a40 0x7f47f80b0e50 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f47f0011b20 tx=0x7f47f000f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:51.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.624+0000 7f47ee000640 1 -- 172.21.15.42:0/1335844211 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f0004b20 con 0x7f47f80b0a40 2024-09-17T01:41:51.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.624+0000 7f47ee000640 1 -- 172.21.15.42:0/1335844211 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47f0004cc0 con 0x7f47f80b0a40 2024-09-17T01:41:51.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.624+0000 7f47f7200640 1 -- 172.21.15.42:0/1335844211 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f81e57c0 con 0x7f47f80b0a40 2024-09-17T01:41:51.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.624+0000 7f47ee000640 1 -- 172.21.15.42:0/1335844211 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f0003bb0 con 0x7f47f80b0a40 2024-09-17T01:41:51.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.624+0000 7f47f7200640 1 -- 172.21.15.42:0/1335844211 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f81e71d0 con 0x7f47f80b0a40 2024-09-17T01:41:51.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.627+0000 7f47ee000640 1 -- 172.21.15.42:0/1335844211 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f47f0004030 con 0x7f47f80b0a40 2024-09-17T01:41:51.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.628+0000 7f47ee000640 1 --2- 172.21.15.42:0/1335844211 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f47d4078bc0 0x7f47d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:51.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.628+0000 7f47ee000640 1 -- 172.21.15.42:0/1335844211 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f47f009b7c0 con 0x7f47f80b0a40 2024-09-17T01:41:51.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.628+0000 7f47f5e00640 1 --2- 172.21.15.42:0/1335844211 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f47d4078bc0 0x7f47d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:51.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.628+0000 7f4804290740 1 Processor -- start 2024-09-17T01:41:51.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.629+0000 7f4804290740 1 -- start start 2024-09-17T01:41:51.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.629+0000 7f47f5e00640 1 --2- 172.21.15.42:0/1335844211 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f47d4078bc0 0x7f47d407b0d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f47e8006c30 tx=0x7f47e8006720 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:51.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.630+0000 7f4804290740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f3b270 0x5642e930bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:51.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.630+0000 7f4804290740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5642e8f123b0 0x5642e930c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:51.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.630+0000 7f4804290740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5642e8f1a590 0x5642e92dc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:51.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.630+0000 7f4804290740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5642e9265430 con 0x5642e8f3b270 2024-09-17T01:41:51.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.630+0000 7f4804290740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5642e92555d0 con 0x5642e8f123b0 2024-09-17T01:41:51.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.630+0000 7f4804290740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5642e9244a00 con 0x5642e8f1a590 2024-09-17T01:41:51.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.630+0000 7f47f5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f3b270 0x5642e930bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:51.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.630+0000 7f47f5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f3b270 0x5642e930bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42070/0 (socket says 172.21.15.42:42070) 2024-09-17T01:41:51.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.630+0000 7f47f5e00640 1 -- 172.21.15.42:0/3873468002 learned_addr learned my addr 172.21.15.42:0/3873468002 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:51.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.631+0000 7f47efe00640 1 --2- 172.21.15.42:0/3873468002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5642e8f123b0 0x5642e930c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:51.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.631+0000 7f47f6800640 1 --2- 172.21.15.42:0/3873468002 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5642e8f1a590 0x5642e92dc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:51.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.631+0000 7f47f5e00640 1 -- 172.21.15.42:0/3873468002 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5642e8f1a590 msgr2=0x5642e92dc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:51.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.631+0000 7f47f5e00640 1 --2- 172.21.15.42:0/3873468002 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5642e8f1a590 0x5642e92dc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.631+0000 7f47f5e00640 1 -- 172.21.15.42:0/3873468002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5642e8f123b0 msgr2=0x5642e930c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:51.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.631+0000 7f47f5e00640 1 --2- 172.21.15.42:0/3873468002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5642e8f123b0 0x5642e930c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.631+0000 7f47f5e00640 1 -- 172.21.15.42:0/3873468002 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642e920d520 con 0x5642e8f3b270 2024-09-17T01:41:51.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.631+0000 7f47efe00640 1 --2- 172.21.15.42:0/3873468002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5642e8f123b0 0x5642e930c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:41:51.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.631+0000 7f47f6800640 1 --2- 172.21.15.42:0/3873468002 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5642e8f1a590 0x5642e92dc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:41:51.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.631+0000 7f47f5e00640 1 --2- 172.21.15.42:0/3873468002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f3b270 0x5642e930bb60 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f47e8006fc0 tx=0x7f47e8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72e0ad2a2dc3525 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:51.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.631+0000 7f47e6a00640 1 -- 172.21.15.42:0/3873468002 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e8012a80 con 0x5642e8f3b270 2024-09-17T01:41:51.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.631+0000 7f47e6a00640 1 -- 172.21.15.42:0/3873468002 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47e8024020 con 0x5642e8f3b270 2024-09-17T01:41:51.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.631+0000 7f47e6a00640 1 -- 172.21.15.42:0/3873468002 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e8012c20 con 0x5642e8f3b270 2024-09-17T01:41:51.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.632+0000 7f4804290740 1 -- 172.21.15.42:0/3873468002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f3b270 msgr2=0x5642e930bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:51.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.632+0000 7f4804290740 1 --2- 172.21.15.42:0/3873468002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f3b270 0x5642e930bb60 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f47e8006fc0 tx=0x7f47e8015000 comp rx=0 tx=0).stop 2024-09-17T01:41:51.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.632+0000 7f4804290740 1 -- 172.21.15.42:0/3873468002 shutdown_connections 2024-09-17T01:41:51.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.632+0000 7f4804290740 1 --2- 172.21.15.42:0/3873468002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5642e8f123b0 0x5642e930c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.632+0000 7f4804290740 1 --2- 172.21.15.42:0/3873468002 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5642e8f1a590 0x5642e92dc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.632+0000 7f4804290740 1 --2- 172.21.15.42:0/3873468002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f3b270 0x5642e930bb60 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.632+0000 7f4804290740 1 -- 172.21.15.42:0/3873468002 >> 172.21.15.42:0/3873468002 conn(0x5642e8f2f3c0 msgr2=0x5642e92e1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:51.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.632+0000 7f4804290740 1 -- 172.21.15.42:0/3873468002 shutdown_connections 2024-09-17T01:41:51.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.632+0000 7f4804290740 1 -- 172.21.15.42:0/3873468002 wait complete. 2024-09-17T01:41:51.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.633+0000 7f4804290740 1 -- start start 2024-09-17T01:41:51.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.634+0000 7f4804290740 1 Processor -- start 2024-09-17T01:41:51.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.635+0000 7f4804290740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5642e8f123b0 0x5642e92f72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:51.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.635+0000 7f4804290740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f1a590 0x5642e9304470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:51.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.635+0000 7f4804290740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5642e8f3b270 0x5642e93049b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:51.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.635+0000 7f4804290740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5642e91eb330 con 0x5642e8f1a590 2024-09-17T01:41:51.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.635+0000 7f4804290740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5642e9248810 con 0x5642e8f3b270 2024-09-17T01:41:51.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.635+0000 7f4804290740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5642e8fb5620 con 0x5642e8f123b0 2024-09-17T01:41:51.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.635+0000 7f4804290740 10 client.0 _ll_register_callbacks cb 0x5642e91f0420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:41:51.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.635+0000 7f47efe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f1a590 0x5642e9304470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:51.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.636+0000 7f47efe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f1a590 0x5642e9304470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42076/0 (socket says 172.21.15.42:42076) 2024-09-17T01:41:51.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.636+0000 7f47efe00640 1 -- 172.21.15.42:0/2377926655 learned_addr learned my addr 172.21.15.42:0/2377926655 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:51.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.636+0000 7f47f6800640 1 --2- 172.21.15.42:0/2377926655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5642e8f3b270 0x5642e93049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:51.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.636+0000 7f47f5e00640 1 --2- 172.21.15.42:0/2377926655 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5642e8f123b0 0x5642e92f72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:51.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.636+0000 7f47efe00640 1 -- 172.21.15.42:0/2377926655 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5642e8f123b0 msgr2=0x5642e92f72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:51.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.636+0000 7f47efe00640 1 --2- 172.21.15.42:0/2377926655 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5642e8f123b0 0x5642e92f72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.636+0000 7f47efe00640 1 -- 172.21.15.42:0/2377926655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5642e8f3b270 msgr2=0x5642e93049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:51.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.636+0000 7f47efe00640 1 --2- 172.21.15.42:0/2377926655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5642e8f3b270 0x5642e93049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.636+0000 7f47efe00640 1 -- 172.21.15.42:0/2377926655 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642e8fa6850 con 0x5642e8f1a590 2024-09-17T01:41:51.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.636+0000 7f47efe00640 1 --2- 172.21.15.42:0/2377926655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f1a590 0x5642e9304470 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f47e00016c0 tx=0x7f47e00064d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1bbf6370f80e7b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:51.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.636+0000 7f47db400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:41:51.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.637+0000 7f47db400640 1 -- 172.21.15.42:0/2377926655 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e0006920 con 0x5642e8f1a590 2024-09-17T01:41:51.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.637+0000 7f47db400640 1 -- 172.21.15.42:0/2377926655 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f47e0003a00 con 0x5642e8f1a590 2024-09-17T01:41:51.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.637+0000 7f4804290740 1 -- 172.21.15.42:0/2377926655 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47e8024020 con 0x5642e8f1a590 2024-09-17T01:41:51.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.637+0000 7f47db400640 1 -- 172.21.15.42:0/2377926655 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7f47e0049050 con 0x5642e8f1a590 2024-09-17T01:41:51.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.637+0000 7f4804290740 10 client.8580 fetch_fsmap learned FSMap version 107 2024-09-17T01:41:51.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.637+0000 7f4804290740 1 -- 172.21.15.42:0/2377926655 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x5642e901d6b0 con 0x5642e8f1a590 2024-09-17T01:41:51.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.637+0000 7f47db400640 1 -- 172.21.15.42:0/2377926655 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47e8024020 con 0x5642e8f1a590 2024-09-17T01:41:51.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.637+0000 7f47db400640 1 -- 172.21.15.42:0/2377926655 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7f47e004c020 con 0x5642e8f1a590 2024-09-17T01:41:51.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.637+0000 7f4804290740 10 client.8580 fetch_fsmap finished waiting for FSMap version 107 2024-09-17T01:41:51.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.637+0000 7f4804290740 10 client.8580 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T01:41:51.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.637+0000 7f4804290740 20 client.8580 populate_metadata read hostname 'smithi042' 2024-09-17T01:41:51.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.637+0000 7f4804290740 1 --2- 172.21.15.42:0/2377926655 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x5642e8ef9e40 0x5642e9343fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:51.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.637+0000 7f4804290740 4 client.8580 mds_command: new command op to 8442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:41:51.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.637+0000 7f4804290740 1 -- 172.21.15.42:0/2377926655 --> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642e9257520 con 0x5642e8ef9e40 2024-09-17T01:41:51.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.638+0000 7f47f5e00640 1 --2- 172.21.15.42:0/2377926655 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x5642e8ef9e40 0x5642e9343fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:51.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.638+0000 7f47f5e00640 1 --2- 172.21.15.42:0/2377926655 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x5642e8ef9e40 0x5642e9343fa0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fddb8550b6b197f server_cookie=acb19f414fd94bc4 in_seq=0 out_seq=0 2024-09-17T01:41:51.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.638+0000 7f47db400640 10 client.8580 ms_handle_connect on v2:172.21.15.42:6833/3060441721 2024-09-17T01:41:51.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.639+0000 7f47db400640 1 -- 172.21.15.42:0/2377926655 <== mds.0 v2:172.21.15.42:6833/3060441721 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5642e9257520 con 0x5642e8ef9e40 2024-09-17T01:41:51.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.639+0000 7f47db400640 10 client.8580 handle_command_reply: tid=0 2024-09-17T01:41:51.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.639+0000 7f4804290740 1 client.8580 shutdown 2024-09-17T01:41:51.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.639+0000 7f4804290740 1 -- 172.21.15.42:0/2377926655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f1a590 msgr2=0x5642e9304470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:51.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.639+0000 7f4804290740 1 --2- 172.21.15.42:0/2377926655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f1a590 0x5642e9304470 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f47e00016c0 tx=0x7f47e00064d0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.639+0000 7f4804290740 1 -- 172.21.15.42:0/2377926655 shutdown_connections 2024-09-17T01:41:51.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.639+0000 7f4804290740 1 --2- 172.21.15.42:0/2377926655 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x5642e8ef9e40 0x5642e9343fa0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.639+0000 7f4804290740 1 --2- 172.21.15.42:0/2377926655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5642e8f3b270 0x5642e93049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.639+0000 7f4804290740 1 --2- 172.21.15.42:0/2377926655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f1a590 0x5642e9304470 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.639+0000 7f4804290740 1 --2- 172.21.15.42:0/2377926655 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5642e8f123b0 0x5642e92f72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.639+0000 7f47db400640 0 client.8580 ms_handle_reset on v2:172.21.15.42:6833/3060441721 2024-09-17T01:41:51.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.639+0000 7f4804290740 1 -- 172.21.15.42:0/2377926655 >> 172.21.15.42:0/2377926655 conn(0x5642e8f2f3c0 msgr2=0x5642e930bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:51.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.640+0000 7f4804290740 1 -- 172.21.15.42:0/2377926655 shutdown_connections 2024-09-17T01:41:51.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.640+0000 7f4804290740 1 -- 172.21.15.42:0/2377926655 wait complete. 2024-09-17T01:41:51.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.640+0000 7f4804290740 20 client.8580 trim_cache size 0 max 16384 2024-09-17T01:41:51.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.659+0000 7f4804290740 1 Processor -- start 2024-09-17T01:41:51.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.659+0000 7f4804290740 1 -- start start 2024-09-17T01:41:51.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.660+0000 7f4804290740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f123b0 0x5642e93067f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:51.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.660+0000 7f4804290740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5642e8f1a590 0x5642e931c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:51.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.660+0000 7f4804290740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5642e8f3b270 0x5642e931cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:51.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.660+0000 7f4804290740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f47f82011c0 con 0x5642e8f123b0 2024-09-17T01:41:51.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.660+0000 7f4804290740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f47f82005d0 con 0x5642e8f1a590 2024-09-17T01:41:51.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.660+0000 7f4804290740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f47f8200b50 con 0x5642e8f3b270 2024-09-17T01:41:51.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.661+0000 7f47f5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f123b0 0x5642e93067f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:51.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.661+0000 7f47f5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f123b0 0x5642e93067f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42086/0 (socket says 172.21.15.42:42086) 2024-09-17T01:41:51.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.661+0000 7f47f5e00640 1 -- 172.21.15.42:0/1709873678 learned_addr learned my addr 172.21.15.42:0/1709873678 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:51.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.661+0000 7f47efe00640 1 --2- 172.21.15.42:0/1709873678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5642e8f1a590 0x5642e931c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:51.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.661+0000 7f47f6800640 1 --2- 172.21.15.42:0/1709873678 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5642e8f3b270 0x5642e931cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:51.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.661+0000 7f47f5e00640 1 -- 172.21.15.42:0/1709873678 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5642e8f3b270 msgr2=0x5642e931cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:51.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.661+0000 7f47f5e00640 1 --2- 172.21.15.42:0/1709873678 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5642e8f3b270 0x5642e931cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.661+0000 7f47f5e00640 1 -- 172.21.15.42:0/1709873678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5642e8f1a590 msgr2=0x5642e931c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:51.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.661+0000 7f47f5e00640 1 --2- 172.21.15.42:0/1709873678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5642e8f1a590 0x5642e931c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.661+0000 7f47f5e00640 1 -- 172.21.15.42:0/1709873678 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642e92df2a0 con 0x5642e8f123b0 2024-09-17T01:41:51.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.661+0000 7f47f6800640 1 --2- 172.21.15.42:0/1709873678 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5642e8f3b270 0x5642e931cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:41:51.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.661+0000 7f47f5e00640 1 --2- 172.21.15.42:0/1709873678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f123b0 0x5642e93067f0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f47e80066f0 tx=0x7f47e800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ab2b9ee6ce65cb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:51.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.662+0000 7f47e6000640 1 -- 172.21.15.42:0/1709873678 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e8023040 con 0x5642e8f123b0 2024-09-17T01:41:51.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.662+0000 7f47e6000640 1 -- 172.21.15.42:0/1709873678 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47e80323c0 con 0x5642e8f123b0 2024-09-17T01:41:51.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.662+0000 7f47e6000640 1 -- 172.21.15.42:0/1709873678 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e8032790 con 0x5642e8f123b0 2024-09-17T01:41:51.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.662+0000 7f4804290740 1 -- 172.21.15.42:0/1709873678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f123b0 msgr2=0x5642e93067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:51.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.662+0000 7f4804290740 1 --2- 172.21.15.42:0/1709873678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f123b0 0x5642e93067f0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f47e80066f0 tx=0x7f47e800f000 comp rx=0 tx=0).stop 2024-09-17T01:41:51.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.662+0000 7f4804290740 1 -- 172.21.15.42:0/1709873678 shutdown_connections 2024-09-17T01:41:51.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.662+0000 7f4804290740 1 --2- 172.21.15.42:0/1709873678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5642e8f1a590 0x5642e931c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.662+0000 7f4804290740 1 --2- 172.21.15.42:0/1709873678 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5642e8f3b270 0x5642e931cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.662+0000 7f4804290740 1 --2- 172.21.15.42:0/1709873678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f123b0 0x5642e93067f0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.662+0000 7f4804290740 1 -- 172.21.15.42:0/1709873678 >> 172.21.15.42:0/1709873678 conn(0x5642e8f2f3c0 msgr2=0x5642e92dce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:51.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.662+0000 7f4804290740 1 -- 172.21.15.42:0/1709873678 shutdown_connections 2024-09-17T01:41:51.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.662+0000 7f4804290740 1 -- 172.21.15.42:0/1709873678 wait complete. 2024-09-17T01:41:51.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.663+0000 7f4804290740 1 -- start start 2024-09-17T01:41:51.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.664+0000 7f4804290740 1 Processor -- start 2024-09-17T01:41:51.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.665+0000 7f4804290740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5642e8f123b0 0x5642e93a7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:51.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.665+0000 7f4804290740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5642e8f1a590 0x5642e939d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:51.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.665+0000 7f4804290740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f3b270 0x5642e9334d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:51.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.665+0000 7f4804290740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5642e931dce0 con 0x5642e8f3b270 2024-09-17T01:41:51.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.665+0000 7f4804290740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5642e93055a0 con 0x5642e8f123b0 2024-09-17T01:41:51.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.665+0000 7f4804290740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5642e931e300 con 0x5642e8f1a590 2024-09-17T01:41:51.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.665+0000 7f4804290740 10 client.0 _ll_register_callbacks cb 0x7f47e0001560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:41:51.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.665+0000 7f47f6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f3b270 0x5642e9334d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:51.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.665+0000 7f47f6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f3b270 0x5642e9334d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42090/0 (socket says 172.21.15.42:42090) 2024-09-17T01:41:51.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.665+0000 7f47f6800640 1 -- 172.21.15.42:0/190609031 learned_addr learned my addr 172.21.15.42:0/190609031 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:51.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.666+0000 7f47efe00640 1 --2- 172.21.15.42:0/190609031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5642e8f1a590 0x5642e939d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:51.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.666+0000 7f47f5e00640 1 --2- 172.21.15.42:0/190609031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5642e8f123b0 0x5642e93a7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:51.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.666+0000 7f47f6800640 1 -- 172.21.15.42:0/190609031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5642e8f1a590 msgr2=0x5642e939d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:51.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.666+0000 7f47f6800640 1 --2- 172.21.15.42:0/190609031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5642e8f1a590 0x5642e939d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.666+0000 7f47f6800640 1 -- 172.21.15.42:0/190609031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5642e8f123b0 msgr2=0x5642e93a7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:41:51.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.666+0000 7f47f6800640 1 --2- 172.21.15.42:0/190609031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5642e8f123b0 0x5642e93a7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.666+0000 7f47f6800640 1 -- 172.21.15.42:0/190609031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642e93093e0 con 0x5642e8f3b270 2024-09-17T01:41:51.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.666+0000 7f47f6800640 1 --2- 172.21.15.42:0/190609031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f3b270 0x5642e9334d50 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f47f0063530 tx=0x7f47f0063010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d473410b639d1a3c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:51.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.666+0000 7f47db400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:41:51.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.666+0000 7f47db400640 1 -- 172.21.15.42:0/190609031 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f0067fd0 con 0x5642e8f3b270 2024-09-17T01:41:51.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.666+0000 7f47db400640 1 -- 172.21.15.42:0/190609031 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f47f006a1d0 con 0x5642e8f3b270 2024-09-17T01:41:51.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.666+0000 7f4804290740 1 -- 172.21.15.42:0/190609031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47e80323c0 con 0x5642e8f3b270 2024-09-17T01:41:51.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.667+0000 7f47db400640 1 -- 172.21.15.42:0/190609031 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7f47f006ce80 con 0x5642e8f3b270 2024-09-17T01:41:51.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.667+0000 7f4804290740 10 client.8586 fetch_fsmap learned FSMap version 107 2024-09-17T01:41:51.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.667+0000 7f4804290740 1 -- 172.21.15.42:0/190609031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x5642e93356a0 con 0x5642e8f3b270 2024-09-17T01:41:51.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.667+0000 7f47db400640 1 -- 172.21.15.42:0/190609031 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47e80323c0 con 0x5642e8f3b270 2024-09-17T01:41:51.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.667+0000 7f47db400640 1 -- 172.21.15.42:0/190609031 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7f47f0021030 con 0x5642e8f3b270 2024-09-17T01:41:51.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.667+0000 7f4804290740 10 client.8586 fetch_fsmap finished waiting for FSMap version 107 2024-09-17T01:41:51.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.667+0000 7f4804290740 10 client.8586 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T01:41:51.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.667+0000 7f4804290740 20 client.8586 populate_metadata read hostname 'smithi042' 2024-09-17T01:41:51.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.667+0000 7f4804290740 1 --2- 172.21.15.42:0/190609031 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x5642e9335290 0x5642e931cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:51.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.667+0000 7f4804290740 4 client.8586 mds_command: new command op to 8442 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T01:41:51.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.667+0000 7f4804290740 1 -- 172.21.15.42:0/190609031 --> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] -- command(tid 0: {"prefix": "status"}) -- 0x5642e9252fd0 con 0x5642e9335290 2024-09-17T01:41:51.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.667+0000 7f47f5e00640 1 --2- 172.21.15.42:0/190609031 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x5642e9335290 0x5642e931cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:51.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.668+0000 7f47db400640 10 client.8586 ms_handle_connect on v2:172.21.15.42:6833/3060441721 2024-09-17T01:41:51.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.668+0000 7f47f5e00640 1 --2- 172.21.15.42:0/190609031 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x5642e9335290 0x5642e931cc90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1879f7b3fd0310ca server_cookie=a6be3a7e8aee5c4b in_seq=0 out_seq=0 2024-09-17T01:41:51.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.668+0000 7f47db400640 1 -- 172.21.15.42:0/190609031 <== mds.0 v2:172.21.15.42:6833/3060441721 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x5642e9252fd0 con 0x5642e9335290 2024-09-17T01:41:51.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.668+0000 7f47db400640 10 client.8586 handle_command_reply: tid=0 2024-09-17T01:41:51.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.668+0000 7f4804290740 1 client.8586 shutdown 2024-09-17T01:41:51.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.668+0000 7f4804290740 1 -- 172.21.15.42:0/190609031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f3b270 msgr2=0x5642e9334d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:51.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.668+0000 7f4804290740 1 --2- 172.21.15.42:0/190609031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f3b270 0x5642e9334d50 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f47f0063530 tx=0x7f47f0063010 comp rx=0 tx=0).stop 2024-09-17T01:41:51.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.668+0000 7f4804290740 1 -- 172.21.15.42:0/190609031 shutdown_connections 2024-09-17T01:41:51.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.669+0000 7f4804290740 1 --2- 172.21.15.42:0/190609031 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x5642e9335290 0x5642e931cc90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.669+0000 7f4804290740 1 --2- 172.21.15.42:0/190609031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5642e8f3b270 0x5642e9334d50 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.669+0000 7f4804290740 1 --2- 172.21.15.42:0/190609031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5642e8f1a590 0x5642e939d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.669+0000 7f4804290740 1 --2- 172.21.15.42:0/190609031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5642e8f123b0 0x5642e93a7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.669+0000 7f4804290740 1 -- 172.21.15.42:0/190609031 >> 172.21.15.42:0/190609031 conn(0x5642e8f2f3c0 msgr2=0x5642e9307230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:51.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.669+0000 7f47db400640 0 client.8586 ms_handle_reset on v2:172.21.15.42:6833/3060441721 2024-09-17T01:41:51.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.669+0000 7f4804290740 1 -- 172.21.15.42:0/190609031 shutdown_connections 2024-09-17T01:41:51.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.669+0000 7f4804290740 1 -- 172.21.15.42:0/190609031 wait complete. 2024-09-17T01:41:51.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.669+0000 7f4804290740 20 client.8586 trim_cache size 0 max 16384 2024-09-17T01:41:51.672 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:41:51.672 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "fea1c88c-cb05-432f-a745-f9dcbb5f2503", 2024-09-17T01:41:51.672 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-17T01:41:51.672 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 8442, 2024-09-17T01:41:51.672 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-17T01:41:51.672 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-17T01:41:51.672 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-17T01:41:51.672 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 11.796533578, 2024-09-17T01:41:51.672 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 107, 2024-09-17T01:41:51.672 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 136, 2024-09-17T01:41:51.672 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 136, 2024-09-17T01:41:51.673 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 16.767145734 2024-09-17T01:41:51.673 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:41:51.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.669+0000 7f47f7200640 1 -- 172.21.15.42:0/1335844211 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f47d4078bc0 msgr2=0x7f47d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:51.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.669+0000 7f47f7200640 1 --2- 172.21.15.42:0/1335844211 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f47d4078bc0 0x7f47d407b0d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f47e8006c30 tx=0x7f47e8006720 comp rx=0 tx=0).stop 2024-09-17T01:41:51.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.669+0000 7f47f7200640 1 -- 172.21.15.42:0/1335844211 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47f80b0a40 msgr2=0x7f47f80b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:51.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.669+0000 7f47f7200640 1 --2- 172.21.15.42:0/1335844211 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47f80b0a40 0x7f47f80b0e50 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f47f0011b20 tx=0x7f47f000f3c0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.670+0000 7f47f7200640 1 -- 172.21.15.42:0/1335844211 shutdown_connections 2024-09-17T01:41:51.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.670+0000 7f47f7200640 1 --2- 172.21.15.42:0/1335844211 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f47d4078bc0 0x7f47d407b0d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.670+0000 7f47f7200640 1 --2- 172.21.15.42:0/1335844211 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47f80b0a40 0x7f47f80b0e50 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.670+0000 7f47f7200640 1 --2- 172.21.15.42:0/1335844211 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f47f815c250 0x7f47f8153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.670+0000 7f47f7200640 1 --2- 172.21.15.42:0/1335844211 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47dc004800 0x7f47f81e4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.670+0000 7f47f7200640 1 -- 172.21.15.42:0/1335844211 >> 172.21.15.42:0/1335844211 conn(0x7f47f80b25f0 msgr2=0x7f47f80b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:51.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.670+0000 7f47f7200640 1 -- 172.21.15.42:0/1335844211 shutdown_connections 2024-09-17T01:41:51.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.670+0000 7f47f7200640 1 -- 172.21.15.42:0/1335844211 wait complete. 2024-09-17T01:41:51.694 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T01:41:51.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.923+0000 7f17a0800640 1 -- 172.21.15.42:0/2904638689 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f179806d430 msgr2=0x7f179806d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:51.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.923+0000 7f17a0800640 1 --2- 172.21.15.42:0/2904638689 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f179806d430 0x7f179806d840 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f17980d02f0 tx=0x7f179402aa10 comp rx=0 tx=0).stop 2024-09-17T01:41:51.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.923+0000 7f17a0800640 1 -- 172.21.15.42:0/2904638689 shutdown_connections 2024-09-17T01:41:51.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.923+0000 7f17a0800640 1 --2- 172.21.15.42:0/2904638689 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f179806d430 0x7f179806d840 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.923+0000 7f17a0800640 1 --2- 172.21.15.42:0/2904638689 >> v2:172.21.15.43:3300/0 conn(0x7f17980af980 0x7f17980ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.923+0000 7f17a0800640 1 -- 172.21.15.42:0/2904638689 >> 172.21.15.42:0/2904638689 conn(0x7f17980b2930 msgr2=0x7f179806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:51.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.923+0000 7f17a0800640 1 -- 172.21.15.42:0/2904638689 shutdown_connections 2024-09-17T01:41:51.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.923+0000 7f17a0800640 1 -- 172.21.15.42:0/2904638689 wait complete. 2024-09-17T01:41:51.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.925+0000 7f17a0800640 1 Processor -- start 2024-09-17T01:41:51.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.925+0000 7f17a0800640 1 -- start start 2024-09-17T01:41:51.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.927+0000 7f17a0800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f179806d430 0x7f1798142c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:51.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.927+0000 7f17a0800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17980af980 0x7f179815f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:51.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.927+0000 7f17a0800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17980b3880 0x7f179815f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:51.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.927+0000 7f17a0800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1798072ad0 con 0x7f179806d430 2024-09-17T01:41:51.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.927+0000 7f17a0800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1798072950 con 0x7f17980b3880 2024-09-17T01:41:51.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.927+0000 7f17a0800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1798072c50 con 0x7f17980af980 2024-09-17T01:41:51.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.927+0000 7f179de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f179806d430 0x7f1798142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:51.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.927+0000 7f179de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f179806d430 0x7f1798142c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42112/0 (socket says 172.21.15.42:42112) 2024-09-17T01:41:51.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.927+0000 7f179de00640 1 -- 172.21.15.42:0/274714877 learned_addr learned my addr 172.21.15.42:0/274714877 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:41:51.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.927+0000 7f179d400640 1 --2- 172.21.15.42:0/274714877 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17980af980 0x7f179815f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:51.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.927+0000 7f179e800640 1 --2- 172.21.15.42:0/274714877 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17980b3880 0x7f179815f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:51.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.928+0000 7f179de00640 1 -- 172.21.15.42:0/274714877 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17980af980 msgr2=0x7f179815f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:51.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.928+0000 7f179de00640 1 --2- 172.21.15.42:0/274714877 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17980af980 0x7f179815f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.928+0000 7f179de00640 1 -- 172.21.15.42:0/274714877 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17980b3880 msgr2=0x7f179815f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:51.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.928+0000 7f179de00640 1 --2- 172.21.15.42:0/274714877 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17980b3880 0x7f179815f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:51.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.928+0000 7f179de00640 1 -- 172.21.15.42:0/274714877 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17981509e0 con 0x7f179806d430 2024-09-17T01:41:51.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.928+0000 7f179e800640 1 --2- 172.21.15.42:0/274714877 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17980b3880 0x7f179815f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:41:51.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.928+0000 7f179d400640 1 --2- 172.21.15.42:0/274714877 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17980af980 0x7f179815f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:41:51.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.928+0000 7f179de00640 1 --2- 172.21.15.42:0/274714877 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f179806d430 0x7f1798142c90 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f178c00b420 tx=0x7f178c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:51.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.928+0000 7f1792000640 1 -- 172.21.15.42:0/274714877 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c011830 con 0x7f179806d430 2024-09-17T01:41:51.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.928+0000 7f1792000640 1 -- 172.21.15.42:0/274714877 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f178c016070 con 0x7f179806d430 2024-09-17T01:41:51.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.928+0000 7f17a0800640 1 -- 172.21.15.42:0/274714877 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1798150c80 con 0x7f179806d430 2024-09-17T01:41:51.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.928+0000 7f1792000640 1 -- 172.21.15.42:0/274714877 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c011d60 con 0x7f179806d430 2024-09-17T01:41:51.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.928+0000 7f17a0800640 1 -- 172.21.15.42:0/274714877 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1798151240 con 0x7f179806d430 2024-09-17T01:41:51.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.930+0000 7f17a0800640 1 -- 172.21.15.42:0/274714877 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f179806d840 con 0x7f179806d430 2024-09-17T01:41:51.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.931+0000 7f1792000640 1 -- 172.21.15.42:0/274714877 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f178c01b460 con 0x7f179806d430 2024-09-17T01:41:51.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.932+0000 7f1792000640 1 --2- 172.21.15.42:0/274714877 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f177c078bc0 0x7f177c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:51.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.932+0000 7f1792000640 1 -- 172.21.15.42:0/274714877 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f178c09a910 con 0x7f179806d430 2024-09-17T01:41:51.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.932+0000 7f179d400640 1 --2- 172.21.15.42:0/274714877 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f177c078bc0 0x7f177c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:51.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.933+0000 7f179d400640 1 --2- 172.21.15.42:0/274714877 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f177c078bc0 0x7f177c07b0d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1788005fd0 tx=0x7f1788005ea0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:51.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:51.936+0000 7f1792000640 1 -- 172.21.15.42:0/274714877 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f178c020020 con 0x7f179806d430 2024-09-17T01:41:52.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:52.166+0000 7f17a0800640 1 -- 172.21.15.42:0/274714877 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f179806a170 con 0x7f179806d430 2024-09-17T01:41:52.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:52.167+0000 7f1792000640 1 -- 172.21.15.42:0/274714877 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v107) ==== 53+0+73 (secure 0 0 0) 0x7f178c062c30 con 0x7f179806d430 2024-09-17T01:41:52.166 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T01:41:52.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:52.169+0000 7f17a0800640 1 -- 172.21.15.42:0/274714877 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f177c078bc0 msgr2=0x7f177c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:52.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:52.169+0000 7f17a0800640 1 --2- 172.21.15.42:0/274714877 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f177c078bc0 0x7f177c07b0d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1788005fd0 tx=0x7f1788005ea0 comp rx=0 tx=0).stop 2024-09-17T01:41:52.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:52.169+0000 7f17a0800640 1 -- 172.21.15.42:0/274714877 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f179806d430 msgr2=0x7f1798142c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:52.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:52.169+0000 7f17a0800640 1 --2- 172.21.15.42:0/274714877 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f179806d430 0x7f1798142c90 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f178c00b420 tx=0x7f178c00b8e0 comp rx=0 tx=0).stop 2024-09-17T01:41:52.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:52.169+0000 7f17a0800640 1 -- 172.21.15.42:0/274714877 shutdown_connections 2024-09-17T01:41:52.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:52.169+0000 7f17a0800640 1 --2- 172.21.15.42:0/274714877 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f177c078bc0 0x7f177c07b0d0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:52.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:52.169+0000 7f17a0800640 1 --2- 172.21.15.42:0/274714877 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17980b3880 0x7f179815f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:52.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:52.169+0000 7f17a0800640 1 --2- 172.21.15.42:0/274714877 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17980af980 0x7f179815f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:52.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:52.169+0000 7f17a0800640 1 --2- 172.21.15.42:0/274714877 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f179806d430 0x7f1798142c90 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:52.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:52.169+0000 7f17a0800640 1 -- 172.21.15.42:0/274714877 >> 172.21.15.42:0/274714877 conn(0x7f17980b2930 msgr2=0x7f1798073120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:52.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:52.169+0000 7f17a0800640 1 -- 172.21.15.42:0/274714877 shutdown_connections 2024-09-17T01:41:52.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:52.169+0000 7f17a0800640 1 -- 172.21.15.42:0/274714877 wait complete. 2024-09-17T01:41:52.193 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T01:41:52.193 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:41:52.194 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-09-17T01:41:52.194 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T01:41:52.194 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:41:52.194 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T01:41:52.194 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T01:41:52.194 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:41:52.194 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:41:52.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:41:52.194 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-09-17T01:41:52.230 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:41:52.230 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:41:52.230 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:41:52.230 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:41:52.230 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-17T01:41:52.231 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:41:52.231 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:41:52.231 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-09-17T01:41:52.231 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-09-17T01:41:52.231 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:41:52.231 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-09-17T01:41:52.231 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-09-17T01:41:52.231 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:41:52.231 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:41:52.231 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-09-17T01:41:52.231 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-17T01:41:52.231 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42095sec preferred_lft 42095sec 2024-09-17T01:41:52.232 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-17T01:41:52.232 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:41:52.232 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:41:52.232 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:41:52.232 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-09-17T01:41:52.232 INFO:teuthology.orchestra.run.smithi042.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T01:41:52.232 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T01:41:52.232 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T01:41:52.232 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:41:52.232 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::68d2:2bff:fe2f:191a/64 scope link 2024-09-17T01:41:52.232 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:41:52.233 INFO:teuthology.orchestra.run.smithi042.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:41:52.233 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether e2:73:3e:9b:8a:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:41:52.233 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::e073:3eff:fe9b:8a00/64 scope link 2024-09-17T01:41:52.233 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:41:52.233 INFO:teuthology.orchestra.run.smithi042.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:41:52.233 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T01:41:52.233 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::240b:bfff:feb7:6e5b/64 scope link 2024-09-17T01:41:52.233 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:41:52.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:41:52.234 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:41:52.324 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-17T01:41:52.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:41:52.327 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-09-17T01:41:52.364 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-09-17T01:41:52.365 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:41:52.365 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-17T01:41:52.365 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-17T01:41:52.365 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:41:52.365 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:41:52.365 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:52.365 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T01:41:52.365 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T01:41:52.366 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T01:41:52.366 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:52.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:41:52.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:52.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:41:52.563 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-17T01:41:52.599 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T01:41:52.761 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T01:41:52.762 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:41:52.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:41:52.762 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-09-17T01:41:52.820 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:41:52.820 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T01:41:52.856 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:41:52.856 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:41:52.857 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:41:52.931 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T01:41:52.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:41:52.931 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:41:53.129 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:41:53.129 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:41:53.129 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:41:53.152 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:41:53.152 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:41:53.153 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:41:53.153 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:41:53.153 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:41:53.181 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:41:53.181 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:41:53.181 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:41:53.182 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:41:53.182 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:41:53.182 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-09-17T01:41:53.182 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-09-17T01:41:53.182 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fea1c88c-cb05-432f-a745-f9dcbb5f2503" will pass to kernel 2024-09-17T01:41:53.183 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T01:41:53.183 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-09-17T01:41:53.183 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T01:41:53.183 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T01:41:53.183 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T01:41:53.186 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T01:41:53.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:41:53.186 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:41:53.242 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:41:53.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:53.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:53.339 INFO:teuthology.orchestra.run.smithi042.stdout:client8047 2024-09-17T01:41:53.339 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:41:53.339 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:41:53.375 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-17T01:41:53.376 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_control_test_path 2024-09-17T01:41:53.376 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:53.376 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:53.376 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.0 2024-09-17T01:41:53.376 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:53.376 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:53.376 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:53.376 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:53.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:53.533 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:53.533 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:53.533 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226933 s, 46.2 MB/s 2024-09-17T01:41:53.551 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:53.551 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:53.552 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154307 s, 68.0 MB/s 2024-09-17T01:41:53.570 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:53.570 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:53.570 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154465 s, 67.9 MB/s 2024-09-17T01:41:53.592 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:53.592 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:53.592 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191436 s, 54.8 MB/s 2024-09-17T01:41:53.611 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:53.611 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:53.611 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153834 s, 68.2 MB/s 2024-09-17T01:41:53.635 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:53.635 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:53.636 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021337 s, 49.1 MB/s 2024-09-17T01:41:53.658 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:53.658 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:53.658 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198031 s, 53.0 MB/s 2024-09-17T01:41:53.674 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:53.674 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:53.674 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012717 s, 82.5 MB/s 2024-09-17T01:41:53.696 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:53.696 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:53.696 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187929 s, 55.8 MB/s 2024-09-17T01:41:53.715 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:53.715 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:53.715 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162356 s, 64.6 MB/s 2024-09-17T01:41:53.732 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:53.733 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:53.733 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014528 s, 72.2 MB/s 2024-09-17T01:41:53.752 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:53.752 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:53.753 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169121 s, 62.0 MB/s 2024-09-17T01:41:53.769 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:53.769 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:53.769 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116592 s, 89.9 MB/s 2024-09-17T01:41:53.798 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:53.798 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:53.798 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271808 s, 38.6 MB/s 2024-09-17T01:41:53.819 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:53.819 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:53.819 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01766 s, 59.4 MB/s 2024-09-17T01:41:53.846 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:53.846 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:53.846 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246057 s, 42.6 MB/s 2024-09-17T01:41:53.870 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:53.870 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:53.871 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206762 s, 50.7 MB/s 2024-09-17T01:41:53.889 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:53.889 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:53.889 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015188 s, 69.0 MB/s 2024-09-17T01:41:53.907 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:53.907 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:53.907 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148544 s, 70.6 MB/s 2024-09-17T01:41:53.929 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:53.930 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:53.930 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194725 s, 53.8 MB/s 2024-09-17T01:41:53.950 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:53.950 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:53.951 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177586 s, 59.0 MB/s 2024-09-17T01:41:53.972 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:53.973 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:53.973 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019463 s, 53.9 MB/s 2024-09-17T01:41:53.998 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:53.998 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:53.998 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219211 s, 47.8 MB/s 2024-09-17T01:41:54.022 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.022 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.022 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213634 s, 49.1 MB/s 2024-09-17T01:41:54.042 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.042 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.042 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164751 s, 63.6 MB/s 2024-09-17T01:41:54.063 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.063 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.063 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017945 s, 58.4 MB/s 2024-09-17T01:41:54.084 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.084 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.084 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017776 s, 59.0 MB/s 2024-09-17T01:41:54.111 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.112 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.112 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243671 s, 43.0 MB/s 2024-09-17T01:41:54.133 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.134 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.134 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188074 s, 55.8 MB/s 2024-09-17T01:41:54.152 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.152 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.152 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153192 s, 68.4 MB/s 2024-09-17T01:41:54.169 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.169 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.169 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144164 s, 72.7 MB/s 2024-09-17T01:41:54.190 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.191 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.191 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180444 s, 58.1 MB/s 2024-09-17T01:41:54.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:54.200 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:54.200 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:54.200 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.1 2024-09-17T01:41:54.200 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:54.200 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:54.200 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:54.200 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:54.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:54.301 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.302 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.302 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140534 s, 74.6 MB/s 2024-09-17T01:41:54.319 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.319 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.319 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145115 s, 72.3 MB/s 2024-09-17T01:41:54.341 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.341 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.341 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186239 s, 56.3 MB/s 2024-09-17T01:41:54.359 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.360 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.360 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153572 s, 68.3 MB/s 2024-09-17T01:41:54.380 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.380 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.380 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155903 s, 67.3 MB/s 2024-09-17T01:41:54.402 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.402 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.402 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205696 s, 51.0 MB/s 2024-09-17T01:41:54.420 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.421 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.421 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015512 s, 67.6 MB/s 2024-09-17T01:41:54.441 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.441 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.441 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175588 s, 59.7 MB/s 2024-09-17T01:41:54.463 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.463 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.463 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185955 s, 56.4 MB/s 2024-09-17T01:41:54.481 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.481 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.482 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154312 s, 68.0 MB/s 2024-09-17T01:41:54.505 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.506 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.506 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207108 s, 50.6 MB/s 2024-09-17T01:41:54.529 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.529 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.529 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196655 s, 53.3 MB/s 2024-09-17T01:41:54.550 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.551 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.551 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185962 s, 56.4 MB/s 2024-09-17T01:41:54.571 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.572 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.572 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179482 s, 58.4 MB/s 2024-09-17T01:41:54.595 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.595 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.595 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202296 s, 51.8 MB/s 2024-09-17T01:41:54.616 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.616 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.616 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177426 s, 59.1 MB/s 2024-09-17T01:41:54.639 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.639 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.639 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194915 s, 53.8 MB/s 2024-09-17T01:41:54.658 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.658 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.658 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163987 s, 63.9 MB/s 2024-09-17T01:41:54.677 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.677 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.677 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156651 s, 66.9 MB/s 2024-09-17T01:41:54.695 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.695 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.695 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144351 s, 72.6 MB/s 2024-09-17T01:41:54.717 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.717 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.717 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184574 s, 56.8 MB/s 2024-09-17T01:41:54.734 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.735 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.735 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145816 s, 71.9 MB/s 2024-09-17T01:41:54.753 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.754 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.754 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144497 s, 72.6 MB/s 2024-09-17T01:41:54.782 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.782 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.782 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267634 s, 39.2 MB/s 2024-09-17T01:41:54.800 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.800 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.800 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146047 s, 71.8 MB/s 2024-09-17T01:41:54.818 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.818 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.818 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146959 s, 71.4 MB/s 2024-09-17T01:41:54.836 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.836 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.836 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147034 s, 71.3 MB/s 2024-09-17T01:41:54.853 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.854 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.854 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145689 s, 72.0 MB/s 2024-09-17T01:41:54.873 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.873 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.873 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161323 s, 65.0 MB/s 2024-09-17T01:41:54.892 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.892 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.892 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160588 s, 65.3 MB/s 2024-09-17T01:41:54.916 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.916 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.916 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204967 s, 51.2 MB/s 2024-09-17T01:41:54.931 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:54.931 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:54.931 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120226 s, 87.2 MB/s 2024-09-17T01:41:54.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:54.941 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:54.941 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:54.941 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.2 2024-09-17T01:41:54.941 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:54.941 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:54.941 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:54.941 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:55.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:55.042 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.043 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.043 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155097 s, 67.6 MB/s 2024-09-17T01:41:55.059 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.059 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.059 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137798 s, 76.1 MB/s 2024-09-17T01:41:55.083 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.083 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.084 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210353 s, 49.8 MB/s 2024-09-17T01:41:55.103 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.103 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.103 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160401 s, 65.4 MB/s 2024-09-17T01:41:55.121 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.121 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.121 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150928 s, 69.5 MB/s 2024-09-17T01:41:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.142 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181888 s, 57.6 MB/s 2024-09-17T01:41:55.163 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.164 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.164 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184132 s, 56.9 MB/s 2024-09-17T01:41:55.181 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.181 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.181 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143699 s, 73.0 MB/s 2024-09-17T01:41:55.201 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.201 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.201 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015462 s, 67.8 MB/s 2024-09-17T01:41:55.216 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.217 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.217 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137846 s, 76.1 MB/s 2024-09-17T01:41:55.238 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.238 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.238 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186794 s, 56.1 MB/s 2024-09-17T01:41:55.258 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.258 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.258 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164184 s, 63.9 MB/s 2024-09-17T01:41:55.275 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.275 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.275 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143499 s, 73.1 MB/s 2024-09-17T01:41:55.296 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.297 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.297 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176674 s, 59.4 MB/s 2024-09-17T01:41:55.316 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.316 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.316 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167847 s, 62.5 MB/s 2024-09-17T01:41:55.334 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.334 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.334 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152455 s, 68.8 MB/s 2024-09-17T01:41:55.359 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.359 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.359 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211617 s, 49.6 MB/s 2024-09-17T01:41:55.377 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.377 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.377 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152418 s, 68.8 MB/s 2024-09-17T01:41:55.395 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.395 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.395 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141206 s, 74.3 MB/s 2024-09-17T01:41:55.411 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.412 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.412 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135678 s, 77.3 MB/s 2024-09-17T01:41:55.431 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.431 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.431 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160781 s, 65.2 MB/s 2024-09-17T01:41:55.450 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.450 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.450 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160174 s, 65.5 MB/s 2024-09-17T01:41:55.468 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.468 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.468 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147524 s, 71.1 MB/s 2024-09-17T01:41:55.489 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.490 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.490 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185912 s, 56.4 MB/s 2024-09-17T01:41:55.511 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.511 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.512 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186203 s, 56.3 MB/s 2024-09-17T01:41:55.535 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.535 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.536 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208639 s, 50.3 MB/s 2024-09-17T01:41:55.554 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.554 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.554 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01516 s, 69.2 MB/s 2024-09-17T01:41:55.575 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.575 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.575 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182497 s, 57.5 MB/s 2024-09-17T01:41:55.592 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.593 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.593 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144117 s, 72.8 MB/s 2024-09-17T01:41:55.614 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.614 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.614 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185114 s, 56.6 MB/s 2024-09-17T01:41:55.636 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.636 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.636 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187923 s, 55.8 MB/s 2024-09-17T01:41:55.655 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.655 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.655 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157341 s, 66.6 MB/s 2024-09-17T01:41:55.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:55.665 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:55.665 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:55.665 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.3 2024-09-17T01:41:55.665 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:55.665 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:55.666 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:55.666 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:55.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:55.770 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.770 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.770 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179714 s, 58.3 MB/s 2024-09-17T01:41:55.789 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.789 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.789 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158769 s, 66.0 MB/s 2024-09-17T01:41:55.809 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.809 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.809 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168876 s, 62.1 MB/s 2024-09-17T01:41:55.830 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.830 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.830 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179196 s, 58.5 MB/s 2024-09-17T01:41:55.848 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.849 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.849 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154891 s, 67.7 MB/s 2024-09-17T01:41:55.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.866 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142768 s, 73.4 MB/s 2024-09-17T01:41:55.884 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.884 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.885 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142148 s, 73.8 MB/s 2024-09-17T01:41:55.904 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.904 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.905 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180929 s, 58.0 MB/s 2024-09-17T01:41:55.924 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.924 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.924 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158899 s, 66.0 MB/s 2024-09-17T01:41:55.941 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.942 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.942 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142637 s, 73.5 MB/s 2024-09-17T01:41:55.964 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.964 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.964 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187926 s, 55.8 MB/s 2024-09-17T01:41:55.981 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:55.981 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:55.981 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145213 s, 72.2 MB/s 2024-09-17T01:41:56.002 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.003 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.003 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180612 s, 58.1 MB/s 2024-09-17T01:41:56.024 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.025 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.025 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190207 s, 55.1 MB/s 2024-09-17T01:41:56.046 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.046 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.046 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179951 s, 58.3 MB/s 2024-09-17T01:41:56.063 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.063 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.063 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145696 s, 72.0 MB/s 2024-09-17T01:41:56.082 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.082 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.082 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151971 s, 69.0 MB/s 2024-09-17T01:41:56.099 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.099 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.099 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141122 s, 74.3 MB/s 2024-09-17T01:41:56.117 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.117 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.117 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144177 s, 72.7 MB/s 2024-09-17T01:41:56.134 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.134 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.134 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014 s, 74.9 MB/s 2024-09-17T01:41:56.152 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.152 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.152 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149711 s, 70.0 MB/s 2024-09-17T01:41:56.173 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.173 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.173 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180463 s, 58.1 MB/s 2024-09-17T01:41:56.197 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.197 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.197 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211487 s, 49.6 MB/s 2024-09-17T01:41:56.215 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.215 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.216 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150893 s, 69.5 MB/s 2024-09-17T01:41:56.233 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.233 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.233 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145394 s, 72.1 MB/s 2024-09-17T01:41:56.251 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.251 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.251 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014438 s, 72.6 MB/s 2024-09-17T01:41:56.273 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.274 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.274 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019376 s, 54.1 MB/s 2024-09-17T01:41:56.292 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.292 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.292 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158336 s, 66.2 MB/s 2024-09-17T01:41:56.314 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.314 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.314 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186556 s, 56.2 MB/s 2024-09-17T01:41:56.335 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.335 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.335 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176235 s, 59.5 MB/s 2024-09-17T01:41:56.353 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.353 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.353 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151745 s, 69.1 MB/s 2024-09-17T01:41:56.372 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.372 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.372 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156984 s, 66.8 MB/s 2024-09-17T01:41:56.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:56.382 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:56.382 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:56.382 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.4 2024-09-17T01:41:56.382 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:56.382 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:56.382 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:56.382 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:56.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:56.485 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.485 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.486 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168472 s, 62.2 MB/s 2024-09-17T01:41:56.504 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.504 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.504 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150382 s, 69.7 MB/s 2024-09-17T01:41:56.525 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.525 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.525 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181536 s, 57.8 MB/s 2024-09-17T01:41:56.549 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.549 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.549 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210464 s, 49.8 MB/s 2024-09-17T01:41:56.567 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.567 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.567 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145223 s, 72.2 MB/s 2024-09-17T01:41:56.588 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.588 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.588 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180289 s, 58.2 MB/s 2024-09-17T01:41:56.607 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.607 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.607 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159211 s, 65.9 MB/s 2024-09-17T01:41:56.625 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.625 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.625 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145429 s, 72.1 MB/s 2024-09-17T01:41:56.643 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.644 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.644 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155956 s, 67.2 MB/s 2024-09-17T01:41:56.661 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.661 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.661 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140276 s, 74.8 MB/s 2024-09-17T01:41:56.678 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.678 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.678 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01382 s, 75.9 MB/s 2024-09-17T01:41:56.696 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.696 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.696 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153507 s, 68.3 MB/s 2024-09-17T01:41:56.714 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.714 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.714 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147367 s, 71.2 MB/s 2024-09-17T01:41:56.732 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.732 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.732 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143344 s, 73.2 MB/s 2024-09-17T01:41:56.749 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.749 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.749 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137391 s, 76.3 MB/s 2024-09-17T01:41:56.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.771 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189861 s, 55.2 MB/s 2024-09-17T01:41:56.790 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.790 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.790 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155396 s, 67.5 MB/s 2024-09-17T01:41:56.810 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.810 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.810 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169469 s, 61.9 MB/s 2024-09-17T01:41:56.827 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.827 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.827 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142732 s, 73.5 MB/s 2024-09-17T01:41:56.848 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.848 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.848 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181926 s, 57.6 MB/s 2024-09-17T01:41:56.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.866 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146361 s, 71.6 MB/s 2024-09-17T01:41:56.888 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.888 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.888 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182721 s, 57.4 MB/s 2024-09-17T01:41:56.905 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.905 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.905 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138528 s, 75.7 MB/s 2024-09-17T01:41:56.930 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.930 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.930 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02203 s, 47.6 MB/s 2024-09-17T01:41:56.948 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.948 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.948 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147085 s, 71.3 MB/s 2024-09-17T01:41:56.965 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.965 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.965 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138526 s, 75.7 MB/s 2024-09-17T01:41:56.983 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:56.983 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:56.983 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152585 s, 68.7 MB/s 2024-09-17T01:41:57.001 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.001 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.001 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144319 s, 72.7 MB/s 2024-09-17T01:41:57.020 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.020 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.021 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162505 s, 64.5 MB/s 2024-09-17T01:41:57.040 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.040 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.040 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140834 s, 74.5 MB/s 2024-09-17T01:41:57.055 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.055 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.055 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133185 s, 78.7 MB/s 2024-09-17T01:41:57.070 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.071 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.071 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119331 s, 87.9 MB/s 2024-09-17T01:41:57.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:57.080 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:57.080 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:57.080 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.5 2024-09-17T01:41:57.080 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:57.080 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:57.080 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:57.080 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:57.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:57.182 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.182 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.182 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148945 s, 70.4 MB/s 2024-09-17T01:41:57.204 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.204 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.204 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182349 s, 57.5 MB/s 2024-09-17T01:41:57.222 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.222 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.222 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142621 s, 73.5 MB/s 2024-09-17T01:41:57.240 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.240 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.241 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014499 s, 72.3 MB/s 2024-09-17T01:41:57.259 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.260 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.260 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015696 s, 66.8 MB/s 2024-09-17T01:41:57.279 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.279 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.279 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157161 s, 66.7 MB/s 2024-09-17T01:41:57.298 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.298 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.298 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161462 s, 64.9 MB/s 2024-09-17T01:41:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.316 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014181 s, 73.9 MB/s 2024-09-17T01:41:57.334 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.335 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.335 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148114 s, 70.8 MB/s 2024-09-17T01:41:57.354 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.354 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.355 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163806 s, 64.0 MB/s 2024-09-17T01:41:57.379 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.380 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.380 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213087 s, 49.2 MB/s 2024-09-17T01:41:57.397 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.398 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.398 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145658 s, 72.0 MB/s 2024-09-17T01:41:57.415 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.415 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.415 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135341 s, 77.5 MB/s 2024-09-17T01:41:57.435 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.435 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.435 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158596 s, 66.1 MB/s 2024-09-17T01:41:57.454 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.455 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.455 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162325 s, 64.6 MB/s 2024-09-17T01:41:57.476 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.476 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.476 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173243 s, 60.5 MB/s 2024-09-17T01:41:57.497 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.497 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.497 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182454 s, 57.5 MB/s 2024-09-17T01:41:57.515 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.515 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.515 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138477 s, 75.7 MB/s 2024-09-17T01:41:57.533 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.533 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.533 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147855 s, 70.9 MB/s 2024-09-17T01:41:57.552 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.552 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.552 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148304 s, 70.7 MB/s 2024-09-17T01:41:57.571 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.572 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.572 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162665 s, 64.5 MB/s 2024-09-17T01:41:57.589 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.590 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.590 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144342 s, 72.6 MB/s 2024-09-17T01:41:57.607 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.608 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.608 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143115 s, 73.3 MB/s 2024-09-17T01:41:57.629 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.629 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.629 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176176 s, 59.5 MB/s 2024-09-17T01:41:57.651 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.651 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.652 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188889 s, 55.5 MB/s 2024-09-17T01:41:57.670 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.670 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.670 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144334 s, 72.6 MB/s 2024-09-17T01:41:57.686 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.686 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.687 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013523 s, 77.5 MB/s 2024-09-17T01:41:57.705 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.705 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.705 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152094 s, 68.9 MB/s 2024-09-17T01:41:57.721 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.721 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.722 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138273 s, 75.8 MB/s 2024-09-17T01:41:57.739 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.739 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.739 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142846 s, 73.4 MB/s 2024-09-17T01:41:57.757 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.757 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.757 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151507 s, 69.2 MB/s 2024-09-17T01:41:57.774 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.775 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.775 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141723 s, 74.0 MB/s 2024-09-17T01:41:57.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:57.783 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:57.784 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:57.784 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.6 2024-09-17T01:41:57.784 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:57.784 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:57.784 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:57.784 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:57.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:57.883 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.883 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.883 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137629 s, 76.2 MB/s 2024-09-17T01:41:57.900 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.901 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.901 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143033 s, 73.3 MB/s 2024-09-17T01:41:57.922 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.922 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.922 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01763 s, 59.5 MB/s 2024-09-17T01:41:57.941 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.941 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.941 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153175 s, 68.5 MB/s 2024-09-17T01:41:57.960 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.960 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.960 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015153 s, 69.2 MB/s 2024-09-17T01:41:57.979 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:57.980 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:57.980 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015837 s, 66.2 MB/s 2024-09-17T01:41:58.001 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.001 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.001 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185404 s, 56.6 MB/s 2024-09-17T01:41:58.020 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.020 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.021 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154219 s, 68.0 MB/s 2024-09-17T01:41:58.042 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.042 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.042 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177039 s, 59.2 MB/s 2024-09-17T01:41:58.059 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.060 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.060 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142578 s, 73.5 MB/s 2024-09-17T01:41:58.078 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.078 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.078 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145021 s, 72.3 MB/s 2024-09-17T01:41:58.098 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.098 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.098 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169526 s, 61.9 MB/s 2024-09-17T01:41:58.116 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.116 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.116 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139787 s, 75.0 MB/s 2024-09-17T01:41:58.133 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.133 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.133 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013673 s, 76.7 MB/s 2024-09-17T01:41:58.152 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.153 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.153 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154732 s, 67.8 MB/s 2024-09-17T01:41:58.172 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.172 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.172 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164328 s, 63.8 MB/s 2024-09-17T01:41:58.191 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.191 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.191 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014809 s, 70.8 MB/s 2024-09-17T01:41:58.208 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.208 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.208 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144967 s, 72.3 MB/s 2024-09-17T01:41:58.225 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.225 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.225 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141078 s, 74.3 MB/s 2024-09-17T01:41:58.243 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.243 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.243 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147781 s, 71.0 MB/s 2024-09-17T01:41:58.261 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.261 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.261 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148486 s, 70.6 MB/s 2024-09-17T01:41:58.280 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.280 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.280 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152184 s, 68.9 MB/s 2024-09-17T01:41:58.297 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.298 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.298 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014527 s, 72.2 MB/s 2024-09-17T01:41:58.315 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.315 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.315 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146663 s, 71.5 MB/s 2024-09-17T01:41:58.332 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.332 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.333 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138259 s, 75.8 MB/s 2024-09-17T01:41:58.350 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.350 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.350 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014504 s, 72.3 MB/s 2024-09-17T01:41:58.371 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.371 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.371 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176027 s, 59.6 MB/s 2024-09-17T01:41:58.389 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.389 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.389 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144591 s, 72.5 MB/s 2024-09-17T01:41:58.406 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.407 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.407 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145979 s, 71.8 MB/s 2024-09-17T01:41:58.424 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.424 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.424 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139766 s, 75.0 MB/s 2024-09-17T01:41:58.444 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.444 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.444 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171126 s, 61.3 MB/s 2024-09-17T01:41:58.467 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.467 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.467 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198694 s, 52.8 MB/s 2024-09-17T01:41:58.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:58.477 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:58.477 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:58.477 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.7 2024-09-17T01:41:58.477 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:58.477 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:58.477 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:58.477 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:58.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:58.577 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.577 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.577 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136241 s, 77.0 MB/s 2024-09-17T01:41:58.595 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.595 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.595 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147927 s, 70.9 MB/s 2024-09-17T01:41:58.613 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.613 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.613 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155002 s, 67.6 MB/s 2024-09-17T01:41:58.631 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.631 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.632 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014862 s, 70.6 MB/s 2024-09-17T01:41:58.652 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.652 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.653 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180323 s, 58.2 MB/s 2024-09-17T01:41:58.671 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.671 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.671 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158807 s, 66.0 MB/s 2024-09-17T01:41:58.688 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.688 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.688 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133068 s, 78.8 MB/s 2024-09-17T01:41:58.705 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.705 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.705 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143862 s, 72.9 MB/s 2024-09-17T01:41:58.724 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.724 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.724 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157982 s, 66.4 MB/s 2024-09-17T01:41:58.748 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.748 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.748 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205396 s, 51.1 MB/s 2024-09-17T01:41:58.765 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.765 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.765 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141818 s, 73.9 MB/s 2024-09-17T01:41:58.784 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.785 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.785 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147646 s, 71.0 MB/s 2024-09-17T01:41:58.801 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.801 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.801 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144688 s, 72.5 MB/s 2024-09-17T01:41:58.819 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.819 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.819 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144743 s, 72.4 MB/s 2024-09-17T01:41:58.840 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.840 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.840 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173851 s, 60.3 MB/s 2024-09-17T01:41:58.861 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.861 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.861 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180578 s, 58.1 MB/s 2024-09-17T01:41:58.883 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.884 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.884 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186466 s, 56.2 MB/s 2024-09-17T01:41:58.905 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.905 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.905 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178251 s, 58.8 MB/s 2024-09-17T01:41:58.923 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.923 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.923 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150308 s, 69.8 MB/s 2024-09-17T01:41:58.943 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.944 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.944 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162186 s, 64.7 MB/s 2024-09-17T01:41:58.965 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.965 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.965 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179668 s, 58.4 MB/s 2024-09-17T01:41:58.983 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:58.983 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:58.983 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014855 s, 70.6 MB/s 2024-09-17T01:41:59.001 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.001 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.002 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144601 s, 72.5 MB/s 2024-09-17T01:41:59.019 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.020 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.020 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145822 s, 71.9 MB/s 2024-09-17T01:41:59.037 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.038 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.038 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146926 s, 71.4 MB/s 2024-09-17T01:41:59.054 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.055 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.055 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137992 s, 76.0 MB/s 2024-09-17T01:41:59.076 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.076 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.076 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185856 s, 56.4 MB/s 2024-09-17T01:41:59.093 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.094 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.094 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140999 s, 74.4 MB/s 2024-09-17T01:41:59.114 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.114 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.114 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176612 s, 59.4 MB/s 2024-09-17T01:41:59.132 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.132 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.132 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151479 s, 69.2 MB/s 2024-09-17T01:41:59.154 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.154 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.154 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185736 s, 56.5 MB/s 2024-09-17T01:41:59.178 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.178 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.178 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203604 s, 51.5 MB/s 2024-09-17T01:41:59.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:59.187 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:59.187 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:59.187 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.8 2024-09-17T01:41:59.187 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:59.188 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:59.188 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:59.188 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:59.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:41:59.289 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.289 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.289 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141681 s, 74.0 MB/s 2024-09-17T01:41:59.305 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.306 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.306 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143716 s, 73.0 MB/s 2024-09-17T01:41:59.326 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.326 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.327 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176371 s, 59.5 MB/s 2024-09-17T01:41:59.346 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.346 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.346 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157499 s, 66.6 MB/s 2024-09-17T01:41:59.363 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.363 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.363 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144318 s, 72.7 MB/s 2024-09-17T01:41:59.381 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.381 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.381 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014845 s, 70.6 MB/s 2024-09-17T01:41:59.400 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.400 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.400 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162103 s, 64.7 MB/s 2024-09-17T01:41:59.418 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.419 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.419 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153841 s, 68.2 MB/s 2024-09-17T01:41:59.438 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.438 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.438 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163079 s, 64.3 MB/s 2024-09-17T01:41:59.455 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.456 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.456 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142841 s, 73.4 MB/s 2024-09-17T01:41:59.473 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.473 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.473 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142792 s, 73.4 MB/s 2024-09-17T01:41:59.490 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.491 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.491 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144567 s, 72.5 MB/s 2024-09-17T01:41:59.507 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.508 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.508 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138698 s, 75.6 MB/s 2024-09-17T01:41:59.526 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.526 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.526 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141731 s, 74.0 MB/s 2024-09-17T01:41:59.542 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.542 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.542 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136444 s, 76.9 MB/s 2024-09-17T01:41:59.561 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.561 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.561 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154301 s, 68.0 MB/s 2024-09-17T01:41:59.579 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.579 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.579 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147288 s, 71.2 MB/s 2024-09-17T01:41:59.595 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.595 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.595 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136563 s, 76.8 MB/s 2024-09-17T01:41:59.615 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.615 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.615 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167866 s, 62.5 MB/s 2024-09-17T01:41:59.632 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.632 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.632 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013912 s, 75.4 MB/s 2024-09-17T01:41:59.649 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.650 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.650 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140948 s, 74.4 MB/s 2024-09-17T01:41:59.671 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.671 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.671 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180844 s, 58.0 MB/s 2024-09-17T01:41:59.688 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.688 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.688 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141322 s, 74.2 MB/s 2024-09-17T01:41:59.706 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.706 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.706 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145152 s, 72.2 MB/s 2024-09-17T01:41:59.723 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.723 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.723 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135052 s, 77.6 MB/s 2024-09-17T01:41:59.740 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.740 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.740 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140492 s, 74.6 MB/s 2024-09-17T01:41:59.762 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.762 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.762 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191042 s, 54.9 MB/s 2024-09-17T01:41:59.780 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.780 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.780 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144731 s, 72.4 MB/s 2024-09-17T01:41:59.798 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.798 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.798 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151618 s, 69.2 MB/s 2024-09-17T01:41:59.816 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.816 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.816 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145894 s, 71.9 MB/s 2024-09-17T01:41:59.834 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.834 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.834 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014613 s, 71.8 MB/s 2024-09-17T01:41:59.851 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:41:59.851 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:41:59.851 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136015 s, 77.1 MB/s 2024-09-17T01:41:59.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:41:59.860 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:41:59.861 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:41:59.861 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.9 2024-09-17T01:41:59.861 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:41:59.861 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:41:59.861 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:41:59.861 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:41:59.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:41:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:42:00.013 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.013 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.014 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146162 s, 71.7 MB/s 2024-09-17T01:42:00.033 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.034 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.034 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164615 s, 63.7 MB/s 2024-09-17T01:42:00.052 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.053 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.053 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153887 s, 68.1 MB/s 2024-09-17T01:42:00.074 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.075 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.075 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180645 s, 58.0 MB/s 2024-09-17T01:42:00.092 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.092 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.093 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145058 s, 72.3 MB/s 2024-09-17T01:42:00.111 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.112 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.112 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154218 s, 68.0 MB/s 2024-09-17T01:42:00.132 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.133 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.133 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174794 s, 60.0 MB/s 2024-09-17T01:42:00.150 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.150 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.150 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140962 s, 74.4 MB/s 2024-09-17T01:42:00.170 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.170 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.170 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156832 s, 66.9 MB/s 2024-09-17T01:42:00.190 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.190 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.190 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163054 s, 64.3 MB/s 2024-09-17T01:42:00.208 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.208 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.208 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146132 s, 71.8 MB/s 2024-09-17T01:42:00.228 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.228 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.228 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168851 s, 62.1 MB/s 2024-09-17T01:42:00.246 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.246 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.246 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145668 s, 72.0 MB/s 2024-09-17T01:42:00.265 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.265 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.265 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151777 s, 69.1 MB/s 2024-09-17T01:42:00.283 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.283 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.283 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142044 s, 73.8 MB/s 2024-09-17T01:42:00.302 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.302 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.303 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160002 s, 65.5 MB/s 2024-09-17T01:42:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194533 s, 53.9 MB/s 2024-09-17T01:42:00.344 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.344 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.344 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015306 s, 68.5 MB/s 2024-09-17T01:42:00.363 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.363 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.363 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157275 s, 66.7 MB/s 2024-09-17T01:42:00.381 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.381 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.381 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139541 s, 75.1 MB/s 2024-09-17T01:42:00.402 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.403 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.403 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178023 s, 58.9 MB/s 2024-09-17T01:42:00.422 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.422 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.422 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158177 s, 66.3 MB/s 2024-09-17T01:42:00.439 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.440 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.440 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013998 s, 74.9 MB/s 2024-09-17T01:42:00.458 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.458 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.458 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147127 s, 71.3 MB/s 2024-09-17T01:42:00.478 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.478 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.478 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162376 s, 64.6 MB/s 2024-09-17T01:42:00.500 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.500 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.500 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185099 s, 56.6 MB/s 2024-09-17T01:42:00.523 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.523 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.523 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193842 s, 54.1 MB/s 2024-09-17T01:42:00.544 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.544 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.544 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173611 s, 60.4 MB/s 2024-09-17T01:42:00.562 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.562 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.562 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014902 s, 70.4 MB/s 2024-09-17T01:42:00.577 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.577 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.577 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121016 s, 86.6 MB/s 2024-09-17T01:42:00.593 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.593 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.593 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124989 s, 83.9 MB/s 2024-09-17T01:42:00.611 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.612 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.612 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015706 s, 66.8 MB/s 2024-09-17T01:42:00.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:42:00.621 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:42:00.621 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:42:00.621 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.10 2024-09-17T01:42:00.621 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:42:00.621 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:42:00.621 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:42:00.621 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:42:00.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:42:00.722 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.722 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.722 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013589 s, 77.2 MB/s 2024-09-17T01:42:00.741 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.741 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.741 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157348 s, 66.6 MB/s 2024-09-17T01:42:00.760 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.760 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.760 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162428 s, 64.6 MB/s 2024-09-17T01:42:00.783 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.783 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.783 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195918 s, 53.5 MB/s 2024-09-17T01:42:00.802 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.802 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.802 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147417 s, 71.1 MB/s 2024-09-17T01:42:00.818 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.818 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.818 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134554 s, 77.9 MB/s 2024-09-17T01:42:00.835 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.835 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.836 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142899 s, 73.4 MB/s 2024-09-17T01:42:00.856 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.856 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.856 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175197 s, 59.9 MB/s 2024-09-17T01:42:00.874 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.874 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.874 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153007 s, 68.5 MB/s 2024-09-17T01:42:00.894 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.895 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.895 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163749 s, 64.0 MB/s 2024-09-17T01:42:00.912 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.913 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.913 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015012 s, 69.8 MB/s 2024-09-17T01:42:00.930 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.930 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.930 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141922 s, 73.9 MB/s 2024-09-17T01:42:00.948 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.948 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.948 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146776 s, 71.4 MB/s 2024-09-17T01:42:00.965 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.965 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.966 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014115 s, 74.3 MB/s 2024-09-17T01:42:00.984 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:00.984 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:00.984 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157202 s, 66.7 MB/s 2024-09-17T01:42:01.001 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.001 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.001 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135224 s, 77.5 MB/s 2024-09-17T01:42:01.018 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.018 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.018 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014159 s, 74.1 MB/s 2024-09-17T01:42:01.036 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.037 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.037 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152765 s, 68.6 MB/s 2024-09-17T01:42:01.058 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.058 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.058 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181033 s, 57.9 MB/s 2024-09-17T01:42:01.074 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.074 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.074 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137482 s, 76.3 MB/s 2024-09-17T01:42:01.092 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.092 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.092 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142323 s, 73.7 MB/s 2024-09-17T01:42:01.110 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.110 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.110 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150617 s, 69.6 MB/s 2024-09-17T01:42:01.129 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.129 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.129 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157749 s, 66.5 MB/s 2024-09-17T01:42:01.146 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.146 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.146 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136349 s, 76.9 MB/s 2024-09-17T01:42:01.164 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.164 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.164 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151444 s, 69.2 MB/s 2024-09-17T01:42:01.182 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.182 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.182 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014746 s, 71.1 MB/s 2024-09-17T01:42:01.199 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.199 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.199 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141616 s, 74.0 MB/s 2024-09-17T01:42:01.218 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.218 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.218 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158706 s, 66.1 MB/s 2024-09-17T01:42:01.236 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.236 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.237 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153179 s, 68.5 MB/s 2024-09-17T01:42:01.261 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.261 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.261 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213343 s, 49.1 MB/s 2024-09-17T01:42:01.282 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.282 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.283 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180908 s, 58.0 MB/s 2024-09-17T01:42:01.300 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.300 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.300 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144144 s, 72.7 MB/s 2024-09-17T01:42:01.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:42:01.309 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:42:01.309 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:42:01.309 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.11 2024-09-17T01:42:01.309 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:42:01.309 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:42:01.309 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:42:01.309 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:42:01.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:42:01.409 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.409 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.409 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014427 s, 72.7 MB/s 2024-09-17T01:42:01.427 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.427 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.427 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149541 s, 70.1 MB/s 2024-09-17T01:42:01.444 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.444 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.444 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013447 s, 78.0 MB/s 2024-09-17T01:42:01.461 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.461 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.461 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145993 s, 71.8 MB/s 2024-09-17T01:42:01.479 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.479 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.479 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147137 s, 71.3 MB/s 2024-09-17T01:42:01.500 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.500 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.501 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182309 s, 57.5 MB/s 2024-09-17T01:42:01.519 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.519 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.519 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015116 s, 69.4 MB/s 2024-09-17T01:42:01.536 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.536 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.536 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143017 s, 73.3 MB/s 2024-09-17T01:42:01.555 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.555 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.555 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153965 s, 68.1 MB/s 2024-09-17T01:42:01.572 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.572 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.572 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137258 s, 76.4 MB/s 2024-09-17T01:42:01.594 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.594 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.594 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192942 s, 54.3 MB/s 2024-09-17T01:42:01.612 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.612 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.612 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147368 s, 71.2 MB/s 2024-09-17T01:42:01.630 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.630 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.630 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146681 s, 71.5 MB/s 2024-09-17T01:42:01.647 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.647 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.647 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137077 s, 76.5 MB/s 2024-09-17T01:42:01.664 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.664 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.664 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143063 s, 73.3 MB/s 2024-09-17T01:42:01.683 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.683 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.683 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152439 s, 68.8 MB/s 2024-09-17T01:42:01.700 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.700 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.700 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139545 s, 75.1 MB/s 2024-09-17T01:42:01.717 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.717 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.717 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141438 s, 74.1 MB/s 2024-09-17T01:42:01.741 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.742 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.742 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212057 s, 49.4 MB/s 2024-09-17T01:42:01.759 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.760 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.760 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148048 s, 70.8 MB/s 2024-09-17T01:42:01.777 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.777 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.777 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146355 s, 71.6 MB/s 2024-09-17T01:42:01.795 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.796 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.796 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015128 s, 69.3 MB/s 2024-09-17T01:42:01.813 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.813 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.813 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139749 s, 75.0 MB/s 2024-09-17T01:42:01.833 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.833 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.833 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172192 s, 60.9 MB/s 2024-09-17T01:42:01.850 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.851 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.851 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143526 s, 73.1 MB/s 2024-09-17T01:42:01.875 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.875 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.875 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216504 s, 48.4 MB/s 2024-09-17T01:42:01.894 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.894 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.894 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159855 s, 65.6 MB/s 2024-09-17T01:42:01.912 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.912 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.912 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138832 s, 75.5 MB/s 2024-09-17T01:42:01.933 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.934 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.934 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180315 s, 58.2 MB/s 2024-09-17T01:42:01.953 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.953 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.953 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154443 s, 67.9 MB/s 2024-09-17T01:42:01.972 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.972 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.972 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155786 s, 67.3 MB/s 2024-09-17T01:42:01.989 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:01.989 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:01.989 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146532 s, 71.6 MB/s 2024-09-17T01:42:01.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:42:01.998 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:42:01.999 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:42:01.999 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.12 2024-09-17T01:42:01.999 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:42:01.999 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:42:01.999 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:42:01.999 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:42:02.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:42:02.102 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.102 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.102 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168932 s, 62.1 MB/s 2024-09-17T01:42:02.120 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.120 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.120 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154125 s, 68.0 MB/s 2024-09-17T01:42:02.140 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.140 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.140 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169762 s, 61.8 MB/s 2024-09-17T01:42:02.158 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.158 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.159 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149875 s, 70.0 MB/s 2024-09-17T01:42:02.177 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.177 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.177 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154559 s, 67.8 MB/s 2024-09-17T01:42:02.194 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.194 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.194 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139895 s, 75.0 MB/s 2024-09-17T01:42:02.218 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.218 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.218 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021073 s, 49.8 MB/s 2024-09-17T01:42:02.235 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.235 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.236 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014359 s, 73.0 MB/s 2024-09-17T01:42:02.255 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.255 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.255 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160944 s, 65.2 MB/s 2024-09-17T01:42:02.271 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.271 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.271 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139536 s, 75.1 MB/s 2024-09-17T01:42:02.289 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.289 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.289 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014572 s, 72.0 MB/s 2024-09-17T01:42:02.306 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.306 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.306 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134833 s, 77.8 MB/s 2024-09-17T01:42:02.330 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.331 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.331 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214785 s, 48.8 MB/s 2024-09-17T01:42:02.349 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.349 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.349 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150673 s, 69.6 MB/s 2024-09-17T01:42:02.369 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.369 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.369 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168864 s, 62.1 MB/s 2024-09-17T01:42:02.388 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.388 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.388 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159317 s, 65.8 MB/s 2024-09-17T01:42:02.406 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.406 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.407 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152607 s, 68.7 MB/s 2024-09-17T01:42:02.429 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.429 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.429 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194746 s, 53.8 MB/s 2024-09-17T01:42:02.447 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.447 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.447 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145399 s, 72.1 MB/s 2024-09-17T01:42:02.465 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.465 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.465 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150545 s, 69.7 MB/s 2024-09-17T01:42:02.482 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.482 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.482 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143468 s, 73.1 MB/s 2024-09-17T01:42:02.499 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.499 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.499 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141027 s, 74.4 MB/s 2024-09-17T01:42:02.516 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.516 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.516 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013764 s, 76.2 MB/s 2024-09-17T01:42:02.533 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.533 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.533 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139124 s, 75.4 MB/s 2024-09-17T01:42:02.551 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.552 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.552 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153428 s, 68.3 MB/s 2024-09-17T01:42:02.569 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.569 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.570 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141374 s, 74.2 MB/s 2024-09-17T01:42:02.590 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.591 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.591 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181115 s, 57.9 MB/s 2024-09-17T01:42:02.611 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.611 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.611 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179559 s, 58.4 MB/s 2024-09-17T01:42:02.629 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.629 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.629 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144731 s, 72.5 MB/s 2024-09-17T01:42:02.645 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.646 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.646 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134494 s, 78.0 MB/s 2024-09-17T01:42:02.663 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.663 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.664 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147149 s, 71.3 MB/s 2024-09-17T01:42:02.682 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.682 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.682 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014886 s, 70.4 MB/s 2024-09-17T01:42:02.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:42:02.692 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:42:02.692 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:42:02.692 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.13 2024-09-17T01:42:02.692 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:42:02.692 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:42:02.692 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:42:02.692 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:42:02.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:42:02.798 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.798 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.798 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196055 s, 53.5 MB/s 2024-09-17T01:42:02.816 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.817 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.817 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138022 s, 76.0 MB/s 2024-09-17T01:42:02.833 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.833 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.833 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151305 s, 69.3 MB/s 2024-09-17T01:42:02.851 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.851 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.851 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153832 s, 68.2 MB/s 2024-09-17T01:42:02.869 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.869 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.869 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143379 s, 73.1 MB/s 2024-09-17T01:42:02.888 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.888 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.888 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161578 s, 64.9 MB/s 2024-09-17T01:42:02.908 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.908 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.908 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157788 s, 66.5 MB/s 2024-09-17T01:42:02.926 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.927 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.927 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151241 s, 69.3 MB/s 2024-09-17T01:42:02.944 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.944 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.944 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140074 s, 74.9 MB/s 2024-09-17T01:42:02.966 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.966 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.966 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189684 s, 55.3 MB/s 2024-09-17T01:42:02.984 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:02.984 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:02.984 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136523 s, 76.8 MB/s 2024-09-17T01:42:03.002 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.002 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.002 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148246 s, 70.7 MB/s 2024-09-17T01:42:03.025 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.025 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.025 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189498 s, 55.3 MB/s 2024-09-17T01:42:03.043 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.043 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.043 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148302 s, 70.7 MB/s 2024-09-17T01:42:03.060 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.061 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.061 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144041 s, 72.8 MB/s 2024-09-17T01:42:03.077 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.078 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.078 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138994 s, 75.4 MB/s 2024-09-17T01:42:03.097 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.097 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.097 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158169 s, 66.3 MB/s 2024-09-17T01:42:03.116 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.116 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.116 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148711 s, 70.5 MB/s 2024-09-17T01:42:03.135 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.135 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.135 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164621 s, 63.7 MB/s 2024-09-17T01:42:03.152 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.152 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.152 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139224 s, 75.3 MB/s 2024-09-17T01:42:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.170 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014136 s, 74.2 MB/s 2024-09-17T01:42:03.187 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.187 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.187 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136699 s, 76.7 MB/s 2024-09-17T01:42:03.203 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.204 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.204 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140498 s, 74.6 MB/s 2024-09-17T01:42:03.222 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.222 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.222 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147237 s, 71.2 MB/s 2024-09-17T01:42:03.239 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.239 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.239 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142754 s, 73.5 MB/s 2024-09-17T01:42:03.256 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.256 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.256 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144756 s, 72.4 MB/s 2024-09-17T01:42:03.277 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.277 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.277 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174849 s, 60.0 MB/s 2024-09-17T01:42:03.295 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.295 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.295 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146478 s, 71.6 MB/s 2024-09-17T01:42:03.314 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.314 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.314 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015275 s, 68.6 MB/s 2024-09-17T01:42:03.340 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.340 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.340 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224142 s, 46.8 MB/s 2024-09-17T01:42:03.357 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.357 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.357 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013873 s, 75.6 MB/s 2024-09-17T01:42:03.376 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.376 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.376 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156686 s, 66.9 MB/s 2024-09-17T01:42:03.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:42:03.385 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:42:03.385 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:42:03.385 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.14 2024-09-17T01:42:03.385 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:42:03.385 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:42:03.385 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:42:03.385 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:42:03.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:42:03.490 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.490 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.490 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193498 s, 54.2 MB/s 2024-09-17T01:42:03.509 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.509 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.510 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164174 s, 63.9 MB/s 2024-09-17T01:42:03.527 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.527 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.527 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137626 s, 76.2 MB/s 2024-09-17T01:42:03.544 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.544 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.545 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149133 s, 70.3 MB/s 2024-09-17T01:42:03.562 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.562 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.562 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150071 s, 69.9 MB/s 2024-09-17T01:42:03.579 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.579 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.579 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137871 s, 76.1 MB/s 2024-09-17T01:42:03.601 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.601 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.601 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183606 s, 57.1 MB/s 2024-09-17T01:42:03.618 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.618 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.618 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141418 s, 74.1 MB/s 2024-09-17T01:42:03.636 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.637 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.637 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155527 s, 67.4 MB/s 2024-09-17T01:42:03.654 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.654 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.654 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141868 s, 73.9 MB/s 2024-09-17T01:42:03.672 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.672 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.672 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145844 s, 71.9 MB/s 2024-09-17T01:42:03.690 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.690 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.690 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149478 s, 70.1 MB/s 2024-09-17T01:42:03.712 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.712 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.712 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186491 s, 56.2 MB/s 2024-09-17T01:42:03.729 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.729 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.730 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144396 s, 72.6 MB/s 2024-09-17T01:42:03.753 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.753 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.753 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201685 s, 52.0 MB/s 2024-09-17T01:42:03.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.771 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151899 s, 69.0 MB/s 2024-09-17T01:42:03.792 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.792 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.792 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178311 s, 58.8 MB/s 2024-09-17T01:42:03.810 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.810 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.810 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014537 s, 72.1 MB/s 2024-09-17T01:42:03.827 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.827 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.827 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142446 s, 73.6 MB/s 2024-09-17T01:42:03.844 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.844 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.844 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138878 s, 75.5 MB/s 2024-09-17T01:42:03.861 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.861 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.861 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140056 s, 74.9 MB/s 2024-09-17T01:42:03.878 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.879 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.879 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140484 s, 74.6 MB/s 2024-09-17T01:42:03.898 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.898 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.898 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157419 s, 66.6 MB/s 2024-09-17T01:42:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189621 s, 55.3 MB/s 2024-09-17T01:42:03.941 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.942 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.942 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173767 s, 60.3 MB/s 2024-09-17T01:42:03.960 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.960 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.960 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153198 s, 68.4 MB/s 2024-09-17T01:42:03.985 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:03.985 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:03.985 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211926 s, 49.5 MB/s 2024-09-17T01:42:04.003 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.003 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.003 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014501 s, 72.3 MB/s 2024-09-17T01:42:04.023 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.023 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.023 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161951 s, 64.7 MB/s 2024-09-17T01:42:04.041 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.042 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.042 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150656 s, 69.6 MB/s 2024-09-17T01:42:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152054 s, 69.0 MB/s 2024-09-17T01:42:04.078 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.079 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.079 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149171 s, 70.3 MB/s 2024-09-17T01:42:04.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:42:04.088 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:42:04.088 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:42:04.088 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.15 2024-09-17T01:42:04.088 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:42:04.088 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:42:04.088 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:42:04.088 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:42:04.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:42:04.188 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.188 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.188 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142319 s, 73.7 MB/s 2024-09-17T01:42:04.213 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.213 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.213 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021087 s, 49.7 MB/s 2024-09-17T01:42:04.231 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.231 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.231 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148779 s, 70.5 MB/s 2024-09-17T01:42:04.251 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.251 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.251 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016216 s, 64.7 MB/s 2024-09-17T01:42:04.268 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.268 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.269 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138033 s, 76.0 MB/s 2024-09-17T01:42:04.288 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.288 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.288 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159247 s, 65.8 MB/s 2024-09-17T01:42:04.307 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.308 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.308 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160036 s, 65.5 MB/s 2024-09-17T01:42:04.326 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.326 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.326 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143536 s, 73.1 MB/s 2024-09-17T01:42:04.345 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.345 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.345 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158522 s, 66.1 MB/s 2024-09-17T01:42:04.364 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.364 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.364 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151607 s, 69.2 MB/s 2024-09-17T01:42:04.385 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.385 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.385 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170802 s, 61.4 MB/s 2024-09-17T01:42:04.403 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.403 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.403 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140558 s, 74.6 MB/s 2024-09-17T01:42:04.422 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.422 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.422 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151973 s, 69.0 MB/s 2024-09-17T01:42:04.446 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.446 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.447 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210559 s, 49.8 MB/s 2024-09-17T01:42:04.464 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.465 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.465 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142245 s, 73.7 MB/s 2024-09-17T01:42:04.482 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.482 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.482 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138556 s, 75.7 MB/s 2024-09-17T01:42:04.505 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.506 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.506 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190637 s, 55.0 MB/s 2024-09-17T01:42:04.523 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.523 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.523 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147175 s, 71.2 MB/s 2024-09-17T01:42:04.540 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.540 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.541 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135437 s, 77.4 MB/s 2024-09-17T01:42:04.558 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.558 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.558 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140727 s, 74.5 MB/s 2024-09-17T01:42:04.580 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.580 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.580 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178726 s, 58.7 MB/s 2024-09-17T01:42:04.597 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.597 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.597 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133247 s, 78.7 MB/s 2024-09-17T01:42:04.616 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.616 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.616 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152297 s, 68.9 MB/s 2024-09-17T01:42:04.634 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.634 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.634 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142417 s, 73.6 MB/s 2024-09-17T01:42:04.652 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.652 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.652 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144044 s, 72.8 MB/s 2024-09-17T01:42:04.670 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.670 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.670 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140325 s, 74.7 MB/s 2024-09-17T01:42:04.687 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.687 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.687 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135608 s, 77.3 MB/s 2024-09-17T01:42:04.705 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.706 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151812 s, 69.1 MB/s 2024-09-17T01:42:04.725 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.725 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.725 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158053 s, 66.3 MB/s 2024-09-17T01:42:04.746 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.747 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.747 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180201 s, 58.2 MB/s 2024-09-17T01:42:04.765 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.765 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.765 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144613 s, 72.5 MB/s 2024-09-17T01:42:04.783 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.783 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.783 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145945 s, 71.8 MB/s 2024-09-17T01:42:04.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:42:04.792 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:42:04.792 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:42:04.792 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.16 2024-09-17T01:42:04.792 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:42:04.792 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:42:04.793 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:42:04.793 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:42:04.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:42:04.893 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.894 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.894 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014013 s, 74.8 MB/s 2024-09-17T01:42:04.914 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.915 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.915 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179071 s, 58.6 MB/s 2024-09-17T01:42:04.937 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.937 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.937 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188888 s, 55.5 MB/s 2024-09-17T01:42:04.955 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.955 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.955 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146826 s, 71.4 MB/s 2024-09-17T01:42:04.976 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.976 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.976 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171699 s, 61.1 MB/s 2024-09-17T01:42:04.995 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:04.995 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:04.995 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151678 s, 69.1 MB/s 2024-09-17T01:42:05.016 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.016 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.016 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178749 s, 58.7 MB/s 2024-09-17T01:42:05.038 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.038 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.038 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181845 s, 57.7 MB/s 2024-09-17T01:42:05.062 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.062 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.062 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204797 s, 51.2 MB/s 2024-09-17T01:42:05.078 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.078 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.079 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140311 s, 74.7 MB/s 2024-09-17T01:42:05.096 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.097 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.097 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147967 s, 70.9 MB/s 2024-09-17T01:42:05.116 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.116 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.116 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162308 s, 64.6 MB/s 2024-09-17T01:42:05.133 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.133 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.133 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137621 s, 76.2 MB/s 2024-09-17T01:42:05.155 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.155 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.155 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018864 s, 55.6 MB/s 2024-09-17T01:42:05.172 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.172 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.172 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01356 s, 77.3 MB/s 2024-09-17T01:42:05.193 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.193 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.193 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180747 s, 58.0 MB/s 2024-09-17T01:42:05.210 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.210 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.211 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142138 s, 73.8 MB/s 2024-09-17T01:42:05.228 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.228 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.228 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143359 s, 73.1 MB/s 2024-09-17T01:42:05.245 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.246 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.246 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144775 s, 72.4 MB/s 2024-09-17T01:42:05.267 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.267 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.268 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188581 s, 55.6 MB/s 2024-09-17T01:42:05.286 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.286 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.286 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153262 s, 68.4 MB/s 2024-09-17T01:42:05.306 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.306 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.306 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173028 s, 60.6 MB/s 2024-09-17T01:42:05.326 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.326 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.326 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164382 s, 63.8 MB/s 2024-09-17T01:42:05.347 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.348 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.348 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018452 s, 56.8 MB/s 2024-09-17T01:42:05.369 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.369 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.370 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187641 s, 55.9 MB/s 2024-09-17T01:42:05.387 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.387 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.387 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150365 s, 69.7 MB/s 2024-09-17T01:42:05.405 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.405 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.405 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01413 s, 74.2 MB/s 2024-09-17T01:42:05.422 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.422 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.423 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145001 s, 72.3 MB/s 2024-09-17T01:42:05.444 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.445 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.445 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191125 s, 54.9 MB/s 2024-09-17T01:42:05.460 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.460 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.460 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121618 s, 86.2 MB/s 2024-09-17T01:42:05.477 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.477 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.477 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140929 s, 74.4 MB/s 2024-09-17T01:42:05.495 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.495 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.495 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137393 s, 76.3 MB/s 2024-09-17T01:42:05.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:42:05.504 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:42:05.504 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:42:05.505 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.17 2024-09-17T01:42:05.505 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:42:05.505 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:42:05.505 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:42:05.505 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:42:05.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:42:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135345 s, 77.5 MB/s 2024-09-17T01:42:05.621 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.621 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.621 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136243 s, 77.0 MB/s 2024-09-17T01:42:05.643 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.644 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.644 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192198 s, 54.6 MB/s 2024-09-17T01:42:05.667 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.667 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.667 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203375 s, 51.6 MB/s 2024-09-17T01:42:05.689 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.690 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.690 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196702 s, 53.3 MB/s 2024-09-17T01:42:05.707 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.707 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.707 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145652 s, 72.0 MB/s 2024-09-17T01:42:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.729 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.730 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188796 s, 55.5 MB/s 2024-09-17T01:42:05.751 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.752 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.752 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188254 s, 55.7 MB/s 2024-09-17T01:42:05.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.771 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160253 s, 65.4 MB/s 2024-09-17T01:42:05.785 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.785 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.785 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113119 s, 92.7 MB/s 2024-09-17T01:42:05.806 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.806 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.806 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176438 s, 59.4 MB/s 2024-09-17T01:42:05.823 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.823 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.823 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138544 s, 75.7 MB/s 2024-09-17T01:42:05.840 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.840 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.840 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142303 s, 73.7 MB/s 2024-09-17T01:42:05.859 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.859 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.859 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159475 s, 65.8 MB/s 2024-09-17T01:42:05.877 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.877 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.877 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143373 s, 73.1 MB/s 2024-09-17T01:42:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141212 s, 74.3 MB/s 2024-09-17T01:42:05.911 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.911 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.911 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01402 s, 74.8 MB/s 2024-09-17T01:42:05.930 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.930 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.930 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156863 s, 66.8 MB/s 2024-09-17T01:42:05.947 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.947 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.947 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137551 s, 76.2 MB/s 2024-09-17T01:42:05.964 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.964 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.964 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140889 s, 74.4 MB/s 2024-09-17T01:42:05.981 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.982 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.982 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014251 s, 73.6 MB/s 2024-09-17T01:42:05.998 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:05.998 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:05.998 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136052 s, 77.1 MB/s 2024-09-17T01:42:06.017 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.017 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.017 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159147 s, 65.9 MB/s 2024-09-17T01:42:06.034 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.034 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.034 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013889 s, 75.5 MB/s 2024-09-17T01:42:06.053 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.053 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.053 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015264 s, 68.7 MB/s 2024-09-17T01:42:06.072 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.072 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.072 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161559 s, 64.9 MB/s 2024-09-17T01:42:06.089 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.089 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.089 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139012 s, 75.4 MB/s 2024-09-17T01:42:06.104 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.104 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.104 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122026 s, 85.9 MB/s 2024-09-17T01:42:06.121 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.121 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.121 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138923 s, 75.5 MB/s 2024-09-17T01:42:06.138 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.138 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.138 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134671 s, 77.9 MB/s 2024-09-17T01:42:06.158 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173968 s, 60.3 MB/s 2024-09-17T01:42:06.177 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.177 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.177 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152913 s, 68.6 MB/s 2024-09-17T01:42:06.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:42:06.186 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:42:06.186 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:42:06.186 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.18 2024-09-17T01:42:06.186 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:42:06.186 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:42:06.186 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:42:06.186 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:42:06.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:42:06.287 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.287 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.288 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143114 s, 73.3 MB/s 2024-09-17T01:42:06.307 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.307 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.307 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172557 s, 60.8 MB/s 2024-09-17T01:42:06.327 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.327 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.327 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167074 s, 62.8 MB/s 2024-09-17T01:42:06.350 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.350 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.350 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019482 s, 53.8 MB/s 2024-09-17T01:42:06.367 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.367 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.367 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144527 s, 72.6 MB/s 2024-09-17T01:42:06.385 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.385 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.385 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143627 s, 73.0 MB/s 2024-09-17T01:42:06.403 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.403 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.403 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151792 s, 69.1 MB/s 2024-09-17T01:42:06.426 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.426 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.426 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200978 s, 52.2 MB/s 2024-09-17T01:42:06.450 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.450 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.451 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208124 s, 50.4 MB/s 2024-09-17T01:42:06.468 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.468 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.468 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143393 s, 73.1 MB/s 2024-09-17T01:42:06.487 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.487 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.487 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159472 s, 65.8 MB/s 2024-09-17T01:42:06.504 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.505 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.505 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143932 s, 72.9 MB/s 2024-09-17T01:42:06.527 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.528 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.528 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199448 s, 52.6 MB/s 2024-09-17T01:42:06.544 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.545 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.545 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143021 s, 73.3 MB/s 2024-09-17T01:42:06.564 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.565 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.565 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165985 s, 63.2 MB/s 2024-09-17T01:42:06.583 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.583 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.583 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152267 s, 68.9 MB/s 2024-09-17T01:42:06.599 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.599 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131881 s, 79.5 MB/s 2024-09-17T01:42:06.616 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.616 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.616 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013808 s, 75.9 MB/s 2024-09-17T01:42:06.634 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.634 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.634 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143556 s, 73.0 MB/s 2024-09-17T01:42:06.652 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.652 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.652 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153354 s, 68.4 MB/s 2024-09-17T01:42:06.671 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.671 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.671 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153404 s, 68.4 MB/s 2024-09-17T01:42:06.687 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.688 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.688 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137628 s, 76.2 MB/s 2024-09-17T01:42:06.705 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.705 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.705 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141375 s, 74.2 MB/s 2024-09-17T01:42:06.728 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.728 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.728 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195836 s, 53.5 MB/s 2024-09-17T01:42:06.745 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.745 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.745 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143084 s, 73.3 MB/s 2024-09-17T01:42:06.762 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.763 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.763 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144885 s, 72.4 MB/s 2024-09-17T01:42:06.781 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.781 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.781 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148697 s, 70.5 MB/s 2024-09-17T01:42:06.799 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.799 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.800 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156283 s, 67.1 MB/s 2024-09-17T01:42:06.816 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.817 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.817 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138851 s, 75.5 MB/s 2024-09-17T01:42:06.832 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.832 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.832 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125448 s, 83.6 MB/s 2024-09-17T01:42:06.857 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.857 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.857 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213497 s, 49.1 MB/s 2024-09-17T01:42:06.875 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.875 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.875 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147757 s, 71.0 MB/s 2024-09-17T01:42:06.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:42:06.883 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:42:06.884 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:42:06.884 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.19 2024-09-17T01:42:06.884 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:42:06.884 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:42:06.884 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:42:06.884 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:42:06.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:42:06.988 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:06.989 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:06.989 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179798 s, 58.3 MB/s 2024-09-17T01:42:07.006 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.006 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.006 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142792 s, 73.4 MB/s 2024-09-17T01:42:07.024 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.024 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.024 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145141 s, 72.2 MB/s 2024-09-17T01:42:07.043 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.043 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.043 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156736 s, 66.9 MB/s 2024-09-17T01:42:07.059 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.060 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.060 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138043 s, 76.0 MB/s 2024-09-17T01:42:07.083 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.083 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.083 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020231 s, 51.8 MB/s 2024-09-17T01:42:07.101 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.101 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.101 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145983 s, 71.8 MB/s 2024-09-17T01:42:07.117 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.118 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.118 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138875 s, 75.5 MB/s 2024-09-17T01:42:07.134 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.135 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.135 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137106 s, 76.5 MB/s 2024-09-17T01:42:07.152 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.152 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.152 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145514 s, 72.1 MB/s 2024-09-17T01:42:07.170 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.170 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.170 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148334 s, 70.7 MB/s 2024-09-17T01:42:07.192 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.193 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.193 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191388 s, 54.8 MB/s 2024-09-17T01:42:07.210 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.210 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.210 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142096 s, 73.8 MB/s 2024-09-17T01:42:07.226 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.226 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.227 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013493 s, 77.7 MB/s 2024-09-17T01:42:07.245 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.245 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.245 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153081 s, 68.5 MB/s 2024-09-17T01:42:07.262 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.263 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.263 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140497 s, 74.6 MB/s 2024-09-17T01:42:07.281 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.281 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.281 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140561 s, 74.6 MB/s 2024-09-17T01:42:07.297 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.297 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.297 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141294 s, 74.2 MB/s 2024-09-17T01:42:07.314 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.315 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.315 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144829 s, 72.4 MB/s 2024-09-17T01:42:07.332 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.332 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.332 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140192 s, 74.8 MB/s 2024-09-17T01:42:07.349 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.349 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.349 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142051 s, 73.8 MB/s 2024-09-17T01:42:07.367 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.368 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.368 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152306 s, 68.8 MB/s 2024-09-17T01:42:07.385 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.385 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.386 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149944 s, 69.9 MB/s 2024-09-17T01:42:07.409 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.409 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.409 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204974 s, 51.2 MB/s 2024-09-17T01:42:07.426 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.426 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.426 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138684 s, 75.6 MB/s 2024-09-17T01:42:07.443 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.444 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.444 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142397 s, 73.6 MB/s 2024-09-17T01:42:07.460 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.460 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.460 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013158 s, 79.7 MB/s 2024-09-17T01:42:07.485 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.485 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.485 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188367 s, 55.7 MB/s 2024-09-17T01:42:07.503 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.503 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.503 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176491 s, 59.4 MB/s 2024-09-17T01:42:07.520 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.520 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.520 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141226 s, 74.2 MB/s 2024-09-17T01:42:07.537 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.538 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.538 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142898 s, 73.4 MB/s 2024-09-17T01:42:07.556 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.556 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.556 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153901 s, 68.1 MB/s 2024-09-17T01:42:07.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:42:07.565 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:42:07.566 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:42:07.566 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.20 2024-09-17T01:42:07.566 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:42:07.566 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:42:07.566 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:42:07.566 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:42:07.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:42:07.667 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.667 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.667 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150283 s, 69.8 MB/s 2024-09-17T01:42:07.684 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.684 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.684 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139527 s, 75.2 MB/s 2024-09-17T01:42:07.703 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.703 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.703 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156974 s, 66.8 MB/s 2024-09-17T01:42:07.721 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.721 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.721 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148208 s, 70.8 MB/s 2024-09-17T01:42:07.738 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.739 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.739 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142958 s, 73.3 MB/s 2024-09-17T01:42:07.759 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.759 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.759 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169959 s, 61.7 MB/s 2024-09-17T01:42:07.778 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.778 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.778 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159959 s, 65.6 MB/s 2024-09-17T01:42:07.798 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.798 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.798 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170013 s, 61.7 MB/s 2024-09-17T01:42:07.816 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.817 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.817 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156258 s, 67.1 MB/s 2024-09-17T01:42:07.840 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.840 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.840 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202784 s, 51.7 MB/s 2024-09-17T01:42:07.860 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.861 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.861 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175603 s, 59.7 MB/s 2024-09-17T01:42:07.877 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.877 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.878 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013841 s, 75.8 MB/s 2024-09-17T01:42:07.898 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.898 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.898 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178462 s, 58.8 MB/s 2024-09-17T01:42:07.917 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.917 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.918 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016066 s, 65.3 MB/s 2024-09-17T01:42:07.937 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.937 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.937 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015812 s, 66.3 MB/s 2024-09-17T01:42:07.954 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.954 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.954 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145264 s, 72.2 MB/s 2024-09-17T01:42:07.972 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.972 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.972 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144227 s, 72.7 MB/s 2024-09-17T01:42:07.989 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:07.989 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:07.989 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140246 s, 74.8 MB/s 2024-09-17T01:42:08.006 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.006 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.006 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135953 s, 77.1 MB/s 2024-09-17T01:42:08.023 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.023 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.023 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136758 s, 76.7 MB/s 2024-09-17T01:42:08.040 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.040 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.041 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142623 s, 73.5 MB/s 2024-09-17T01:42:08.059 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.059 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.059 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015663 s, 66.9 MB/s 2024-09-17T01:42:08.076 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.077 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.077 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140926 s, 74.4 MB/s 2024-09-17T01:42:08.094 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.094 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.094 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142189 s, 73.7 MB/s 2024-09-17T01:42:08.112 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.112 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.113 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153972 s, 68.1 MB/s 2024-09-17T01:42:08.134 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.134 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.134 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186404 s, 56.3 MB/s 2024-09-17T01:42:08.151 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.151 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.151 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133418 s, 78.6 MB/s 2024-09-17T01:42:08.169 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.169 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.169 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151409 s, 69.3 MB/s 2024-09-17T01:42:08.186 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.186 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.186 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136446 s, 76.8 MB/s 2024-09-17T01:42:08.204 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.204 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.204 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014892 s, 70.4 MB/s 2024-09-17T01:42:08.222 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.222 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.222 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145235 s, 72.2 MB/s 2024-09-17T01:42:08.239 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.239 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.240 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148159 s, 70.8 MB/s 2024-09-17T01:42:08.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:42:08.249 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:42:08.249 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:42:08.249 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.21 2024-09-17T01:42:08.249 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:42:08.249 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:42:08.249 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:42:08.249 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:42:08.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:42:08.351 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.352 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.352 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165454 s, 63.4 MB/s 2024-09-17T01:42:08.369 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.370 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.370 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146914 s, 71.4 MB/s 2024-09-17T01:42:08.387 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.387 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.387 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01456 s, 72.0 MB/s 2024-09-17T01:42:08.404 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.405 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.405 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140685 s, 74.5 MB/s 2024-09-17T01:42:08.422 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.422 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.422 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143139 s, 73.3 MB/s 2024-09-17T01:42:08.446 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.446 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.446 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207369 s, 50.6 MB/s 2024-09-17T01:42:08.467 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.467 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.467 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181084 s, 57.9 MB/s 2024-09-17T01:42:08.486 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.486 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.486 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155911 s, 67.3 MB/s 2024-09-17T01:42:08.501 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.502 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.502 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122271 s, 85.8 MB/s 2024-09-17T01:42:08.518 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.518 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.518 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137396 s, 76.3 MB/s 2024-09-17T01:42:08.536 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.536 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.536 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140763 s, 74.5 MB/s 2024-09-17T01:42:08.557 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.558 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.558 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186802 s, 56.1 MB/s 2024-09-17T01:42:08.576 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.577 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.577 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157244 s, 66.7 MB/s 2024-09-17T01:42:08.599 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.599 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.599 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195928 s, 53.5 MB/s 2024-09-17T01:42:08.618 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.619 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.619 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162701 s, 64.4 MB/s 2024-09-17T01:42:08.640 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.641 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.641 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018754 s, 55.9 MB/s 2024-09-17T01:42:08.659 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.659 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.659 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150294 s, 69.8 MB/s 2024-09-17T01:42:08.678 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.678 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.678 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156544 s, 67.0 MB/s 2024-09-17T01:42:08.700 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.701 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.701 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187513 s, 55.9 MB/s 2024-09-17T01:42:08.718 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.718 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.718 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014344 s, 73.1 MB/s 2024-09-17T01:42:08.735 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.735 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.735 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140135 s, 74.8 MB/s 2024-09-17T01:42:08.752 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.752 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.752 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141073 s, 74.3 MB/s 2024-09-17T01:42:08.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.771 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154167 s, 68.0 MB/s 2024-09-17T01:42:08.789 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.789 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.789 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147704 s, 71.0 MB/s 2024-09-17T01:42:08.807 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.808 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.808 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151691 s, 69.1 MB/s 2024-09-17T01:42:08.825 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.825 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.825 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140611 s, 74.6 MB/s 2024-09-17T01:42:08.843 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.843 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.843 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148046 s, 70.8 MB/s 2024-09-17T01:42:08.860 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.860 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.860 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136804 s, 76.6 MB/s 2024-09-17T01:42:08.878 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.879 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.879 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155387 s, 67.5 MB/s 2024-09-17T01:42:08.897 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.897 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.897 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152951 s, 68.6 MB/s 2024-09-17T01:42:08.915 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.916 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.916 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155969 s, 67.2 MB/s 2024-09-17T01:42:08.933 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:08.933 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:08.933 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141975 s, 73.9 MB/s 2024-09-17T01:42:08.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:42:08.942 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:42:08.942 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:42:08.942 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.22 2024-09-17T01:42:08.942 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:42:08.942 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:42:08.942 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:42:08.942 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:42:09.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:42:09.042 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.042 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.042 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139282 s, 75.3 MB/s 2024-09-17T01:42:09.059 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.059 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.059 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138678 s, 75.6 MB/s 2024-09-17T01:42:09.077 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.078 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.078 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151433 s, 69.2 MB/s 2024-09-17T01:42:09.096 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.096 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.096 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150002 s, 69.9 MB/s 2024-09-17T01:42:09.113 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.114 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.114 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144231 s, 72.7 MB/s 2024-09-17T01:42:09.131 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.132 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.132 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147355 s, 71.2 MB/s 2024-09-17T01:42:09.148 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.148 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.148 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136544 s, 76.8 MB/s 2024-09-17T01:42:09.164 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.165 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.165 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135488 s, 77.4 MB/s 2024-09-17T01:42:09.181 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.182 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.182 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137389 s, 76.3 MB/s 2024-09-17T01:42:09.198 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.199 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.199 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140021 s, 74.9 MB/s 2024-09-17T01:42:09.215 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.216 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.216 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013712 s, 76.5 MB/s 2024-09-17T01:42:09.233 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.234 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.234 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147824 s, 70.9 MB/s 2024-09-17T01:42:09.251 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.251 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.251 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144339 s, 72.6 MB/s 2024-09-17T01:42:09.272 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.272 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.272 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174129 s, 60.2 MB/s 2024-09-17T01:42:09.289 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.289 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.289 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144815 s, 72.4 MB/s 2024-09-17T01:42:09.304 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.305 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.305 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119716 s, 87.6 MB/s 2024-09-17T01:42:09.322 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.322 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.323 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145562 s, 72.0 MB/s 2024-09-17T01:42:09.341 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.341 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.341 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158367 s, 66.2 MB/s 2024-09-17T01:42:09.359 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.359 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.359 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145803 s, 71.9 MB/s 2024-09-17T01:42:09.376 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.376 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.376 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139798 s, 75.0 MB/s 2024-09-17T01:42:09.394 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.394 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.394 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147965 s, 70.9 MB/s 2024-09-17T01:42:09.411 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.411 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.411 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139142 s, 75.4 MB/s 2024-09-17T01:42:09.429 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.430 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.430 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152738 s, 68.7 MB/s 2024-09-17T01:42:09.448 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.448 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.448 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153839 s, 68.2 MB/s 2024-09-17T01:42:09.466 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.466 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.466 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014957 s, 70.1 MB/s 2024-09-17T01:42:09.484 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.484 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.484 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150929 s, 69.5 MB/s 2024-09-17T01:42:09.502 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.502 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.502 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146971 s, 71.3 MB/s 2024-09-17T01:42:09.522 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.523 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.523 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017251 s, 60.8 MB/s 2024-09-17T01:42:09.540 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.540 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.540 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140205 s, 74.8 MB/s 2024-09-17T01:42:09.557 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.557 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.557 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143903 s, 72.9 MB/s 2024-09-17T01:42:09.579 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.579 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.579 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182654 s, 57.4 MB/s 2024-09-17T01:42:09.596 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.596 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.596 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137887 s, 76.0 MB/s 2024-09-17T01:42:09.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:42:09.605 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:42:09.605 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:42:09.606 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.23 2024-09-17T01:42:09.606 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:42:09.606 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:42:09.606 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:42:09.606 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:42:09.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:42:09.706 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.707 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.707 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144391 s, 72.6 MB/s 2024-09-17T01:42:09.725 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.725 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.725 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151031 s, 69.4 MB/s 2024-09-17T01:42:09.741 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.742 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.742 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013508 s, 77.6 MB/s 2024-09-17T01:42:09.760 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.760 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.760 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150636 s, 69.6 MB/s 2024-09-17T01:42:09.776 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.776 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.776 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130601 s, 80.3 MB/s 2024-09-17T01:42:09.795 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.795 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.795 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156822 s, 66.9 MB/s 2024-09-17T01:42:09.813 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.813 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.813 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149602 s, 70.1 MB/s 2024-09-17T01:42:09.831 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.831 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.831 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157227 s, 66.7 MB/s 2024-09-17T01:42:09.848 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.848 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.848 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138076 s, 75.9 MB/s 2024-09-17T01:42:09.865 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.865 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.865 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136446 s, 76.8 MB/s 2024-09-17T01:42:09.882 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.883 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.883 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142536 s, 73.6 MB/s 2024-09-17T01:42:09.904 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.905 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.905 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185432 s, 56.5 MB/s 2024-09-17T01:42:09.922 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.922 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.923 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142936 s, 73.4 MB/s 2024-09-17T01:42:09.945 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.945 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.945 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187095 s, 56.0 MB/s 2024-09-17T01:42:09.963 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.963 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.963 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153608 s, 68.3 MB/s 2024-09-17T01:42:09.982 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:09.982 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:09.982 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151468 s, 69.2 MB/s 2024-09-17T01:42:10.000 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.000 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.000 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142503 s, 73.6 MB/s 2024-09-17T01:42:10.018 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.018 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.019 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147373 s, 71.2 MB/s 2024-09-17T01:42:10.035 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.035 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.036 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138609 s, 75.6 MB/s 2024-09-17T01:42:10.053 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.054 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.054 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150494 s, 69.7 MB/s 2024-09-17T01:42:10.071 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.071 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.071 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140427 s, 74.7 MB/s 2024-09-17T01:42:10.088 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.088 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.088 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141121 s, 74.3 MB/s 2024-09-17T01:42:10.105 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.106 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.106 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144165 s, 72.7 MB/s 2024-09-17T01:42:10.126 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.126 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.126 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169952 s, 61.7 MB/s 2024-09-17T01:42:10.143 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.143 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.143 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014631 s, 71.7 MB/s 2024-09-17T01:42:10.161 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.161 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.161 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140631 s, 74.6 MB/s 2024-09-17T01:42:10.178 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.178 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.178 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014307 s, 73.3 MB/s 2024-09-17T01:42:10.195 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.195 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.195 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139366 s, 75.2 MB/s 2024-09-17T01:42:10.214 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.214 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.214 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151209 s, 69.3 MB/s 2024-09-17T01:42:10.232 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.232 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.232 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014724 s, 71.2 MB/s 2024-09-17T01:42:10.250 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.250 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.250 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148335 s, 70.7 MB/s 2024-09-17T01:42:10.267 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.267 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.267 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141218 s, 74.3 MB/s 2024-09-17T01:42:10.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:42:10.276 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:42:10.276 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:42:10.277 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.24 2024-09-17T01:42:10.277 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:42:10.277 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:42:10.277 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:42:10.277 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:42:10.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:42:10.377 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.377 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.377 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144909 s, 72.4 MB/s 2024-09-17T01:42:10.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.396 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157742 s, 66.5 MB/s 2024-09-17T01:42:10.413 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.413 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.413 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143152 s, 73.2 MB/s 2024-09-17T01:42:10.431 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.432 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.432 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015477 s, 67.8 MB/s 2024-09-17T01:42:10.449 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.449 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.449 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143184 s, 73.2 MB/s 2024-09-17T01:42:10.472 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.472 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.472 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019739 s, 53.1 MB/s 2024-09-17T01:42:10.491 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.491 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.491 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159032 s, 65.9 MB/s 2024-09-17T01:42:10.510 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.510 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.510 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155738 s, 67.3 MB/s 2024-09-17T01:42:10.529 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.529 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.529 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015764 s, 66.5 MB/s 2024-09-17T01:42:10.550 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.550 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.550 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180164 s, 58.2 MB/s 2024-09-17T01:42:10.567 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.568 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.568 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144878 s, 72.4 MB/s 2024-09-17T01:42:10.585 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.585 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.585 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146315 s, 71.7 MB/s 2024-09-17T01:42:10.610 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.611 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.611 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222337 s, 47.2 MB/s 2024-09-17T01:42:10.629 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.629 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.629 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151098 s, 69.4 MB/s 2024-09-17T01:42:10.646 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.646 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.646 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145119 s, 72.3 MB/s 2024-09-17T01:42:10.664 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.664 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.665 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148099 s, 70.8 MB/s 2024-09-17T01:42:10.686 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.686 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.686 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181602 s, 57.7 MB/s 2024-09-17T01:42:10.703 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.704 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.704 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146506 s, 71.6 MB/s 2024-09-17T01:42:10.722 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.722 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.722 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150006 s, 69.9 MB/s 2024-09-17T01:42:10.739 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.739 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.739 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143678 s, 73.0 MB/s 2024-09-17T01:42:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153463 s, 68.3 MB/s 2024-09-17T01:42:10.775 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.776 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.776 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146967 s, 71.3 MB/s 2024-09-17T01:42:10.798 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.798 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.798 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191451 s, 54.8 MB/s 2024-09-17T01:42:10.816 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.816 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.816 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146725 s, 71.5 MB/s 2024-09-17T01:42:10.832 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.833 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.833 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137248 s, 76.4 MB/s 2024-09-17T01:42:10.850 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.850 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.850 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139703 s, 75.1 MB/s 2024-09-17T01:42:10.871 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.871 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.871 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179604 s, 58.4 MB/s 2024-09-17T01:42:10.890 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.890 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.890 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163082 s, 64.3 MB/s 2024-09-17T01:42:10.908 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.908 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.908 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143096 s, 73.3 MB/s 2024-09-17T01:42:10.925 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.925 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.925 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140209 s, 74.8 MB/s 2024-09-17T01:42:10.942 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.942 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.943 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143564 s, 73.0 MB/s 2024-09-17T01:42:10.965 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:10.965 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:10.965 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190979 s, 54.9 MB/s 2024-09-17T01:42:10.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:42:10.974 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:42:10.974 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:42:10.974 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.25 2024-09-17T01:42:10.974 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:42:10.974 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:42:10.974 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:42:10.974 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:42:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:42:11.076 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.076 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.076 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162965 s, 64.3 MB/s 2024-09-17T01:42:11.093 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.093 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.093 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138477 s, 75.7 MB/s 2024-09-17T01:42:11.112 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.113 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.113 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159866 s, 65.6 MB/s 2024-09-17T01:42:11.133 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.133 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.133 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176421 s, 59.4 MB/s 2024-09-17T01:42:11.151 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.151 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.151 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147065 s, 71.3 MB/s 2024-09-17T01:42:11.168 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.168 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.168 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134843 s, 77.8 MB/s 2024-09-17T01:42:11.187 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.187 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.187 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164744 s, 63.6 MB/s 2024-09-17T01:42:11.205 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.205 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.205 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148859 s, 70.4 MB/s 2024-09-17T01:42:11.224 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.224 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.225 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158963 s, 66.0 MB/s 2024-09-17T01:42:11.242 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.242 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.242 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141161 s, 74.3 MB/s 2024-09-17T01:42:11.260 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.260 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.260 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150834 s, 69.5 MB/s 2024-09-17T01:42:11.277 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.278 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.278 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146658 s, 71.5 MB/s 2024-09-17T01:42:11.295 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.295 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.296 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146973 s, 71.3 MB/s 2024-09-17T01:42:11.313 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.313 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.313 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142434 s, 73.6 MB/s 2024-09-17T01:42:11.330 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.330 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.330 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014249 s, 73.6 MB/s 2024-09-17T01:42:11.348 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.348 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.348 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149901 s, 70.0 MB/s 2024-09-17T01:42:11.368 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.369 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.369 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168895 s, 62.1 MB/s 2024-09-17T01:42:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154714 s, 67.8 MB/s 2024-09-17T01:42:11.405 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.405 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.405 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144017 s, 72.8 MB/s 2024-09-17T01:42:11.424 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.424 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.424 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158864 s, 66.0 MB/s 2024-09-17T01:42:11.446 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.446 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.446 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184944 s, 56.7 MB/s 2024-09-17T01:42:11.465 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.465 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.465 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157448 s, 66.6 MB/s 2024-09-17T01:42:11.481 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.481 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.481 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136923 s, 76.6 MB/s 2024-09-17T01:42:11.500 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.500 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.500 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015503 s, 67.6 MB/s 2024-09-17T01:42:11.518 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.518 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.519 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154727 s, 67.8 MB/s 2024-09-17T01:42:11.536 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.536 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.536 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146903 s, 71.4 MB/s 2024-09-17T01:42:11.553 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.553 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.553 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136772 s, 76.7 MB/s 2024-09-17T01:42:11.574 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.575 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.575 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182239 s, 57.5 MB/s 2024-09-17T01:42:11.596 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.596 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.596 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018694 s, 56.1 MB/s 2024-09-17T01:42:11.618 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.618 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.619 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187318 s, 56.0 MB/s 2024-09-17T01:42:11.635 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.635 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.635 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134497 s, 78.0 MB/s 2024-09-17T01:42:11.652 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.653 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.653 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144659 s, 72.5 MB/s 2024-09-17T01:42:11.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:42:11.662 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:42:11.662 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:42:11.662 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.26 2024-09-17T01:42:11.662 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:42:11.662 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:42:11.662 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:42:11.662 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:42:11.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:42:11.766 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.766 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.766 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177676 s, 59.0 MB/s 2024-09-17T01:42:11.784 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.784 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.784 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152048 s, 69.0 MB/s 2024-09-17T01:42:11.801 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.801 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.801 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143876 s, 72.9 MB/s 2024-09-17T01:42:11.820 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.820 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.820 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152112 s, 68.9 MB/s 2024-09-17T01:42:11.836 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.837 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.837 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136803 s, 76.6 MB/s 2024-09-17T01:42:11.853 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.853 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.854 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013844 s, 75.7 MB/s 2024-09-17T01:42:11.877 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.877 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.877 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203446 s, 51.5 MB/s 2024-09-17T01:42:11.895 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.895 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.895 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146277 s, 71.7 MB/s 2024-09-17T01:42:11.917 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.917 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.917 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189198 s, 55.4 MB/s 2024-09-17T01:42:11.942 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.942 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.942 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213564 s, 49.1 MB/s 2024-09-17T01:42:11.960 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.960 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.960 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149504 s, 70.1 MB/s 2024-09-17T01:42:11.978 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.978 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.978 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014826 s, 70.7 MB/s 2024-09-17T01:42:11.995 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:11.995 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:11.995 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138218 s, 75.9 MB/s 2024-09-17T01:42:12.012 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.012 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.012 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139946 s, 74.9 MB/s 2024-09-17T01:42:12.034 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.034 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.034 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185525 s, 56.5 MB/s 2024-09-17T01:42:12.051 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.051 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.051 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138157 s, 75.9 MB/s 2024-09-17T01:42:12.069 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.069 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.069 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146775 s, 71.4 MB/s 2024-09-17T01:42:12.092 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.092 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.092 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196407 s, 53.4 MB/s 2024-09-17T01:42:12.110 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.110 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.110 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154357 s, 67.9 MB/s 2024-09-17T01:42:12.127 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.127 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.127 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134671 s, 77.9 MB/s 2024-09-17T01:42:12.145 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.145 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.145 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150382 s, 69.7 MB/s 2024-09-17T01:42:12.162 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.163 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.163 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140629 s, 74.6 MB/s 2024-09-17T01:42:12.178 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.178 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.178 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120184 s, 87.2 MB/s 2024-09-17T01:42:12.199 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.199 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.200 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182038 s, 57.6 MB/s 2024-09-17T01:42:12.216 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.216 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.216 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138042 s, 76.0 MB/s 2024-09-17T01:42:12.234 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.234 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.234 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143226 s, 73.2 MB/s 2024-09-17T01:42:12.251 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.252 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.252 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147671 s, 71.0 MB/s 2024-09-17T01:42:12.272 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.272 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.272 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168204 s, 62.3 MB/s 2024-09-17T01:42:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149686 s, 70.1 MB/s 2024-09-17T01:42:12.307 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.307 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.307 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140528 s, 74.6 MB/s 2024-09-17T01:42:12.327 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.328 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.328 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173979 s, 60.3 MB/s 2024-09-17T01:42:12.345 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.345 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.345 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143813 s, 72.9 MB/s 2024-09-17T01:42:12.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:42:12.354 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:42:12.354 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:42:12.354 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.27 2024-09-17T01:42:12.354 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:42:12.354 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:42:12.355 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:42:12.355 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:42:12.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:42:12.455 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.456 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.456 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147744 s, 71.0 MB/s 2024-09-17T01:42:12.472 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.473 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.473 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139621 s, 75.1 MB/s 2024-09-17T01:42:12.491 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.491 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.491 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152847 s, 68.6 MB/s 2024-09-17T01:42:12.509 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.509 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.510 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149929 s, 69.9 MB/s 2024-09-17T01:42:12.526 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.527 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.527 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140848 s, 74.4 MB/s 2024-09-17T01:42:12.546 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.546 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.547 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164897 s, 63.6 MB/s 2024-09-17T01:42:12.566 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.566 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.566 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155545 s, 67.4 MB/s 2024-09-17T01:42:12.588 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.589 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.589 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202962 s, 51.7 MB/s 2024-09-17T01:42:12.606 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.607 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.607 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147888 s, 70.9 MB/s 2024-09-17T01:42:12.624 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.624 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.624 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014627 s, 71.7 MB/s 2024-09-17T01:42:12.646 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.646 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.646 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185015 s, 56.7 MB/s 2024-09-17T01:42:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.665 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157057 s, 66.8 MB/s 2024-09-17T01:42:12.687 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.687 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.687 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187153 s, 56.0 MB/s 2024-09-17T01:42:12.705 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.705 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.705 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151151 s, 69.4 MB/s 2024-09-17T01:42:12.719 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.719 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.719 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115061 s, 91.1 MB/s 2024-09-17T01:42:12.735 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.735 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.735 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122811 s, 85.4 MB/s 2024-09-17T01:42:12.753 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.753 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.753 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151737 s, 69.1 MB/s 2024-09-17T01:42:12.770 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.771 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145772 s, 71.9 MB/s 2024-09-17T01:42:12.787 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.787 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.788 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136404 s, 76.9 MB/s 2024-09-17T01:42:12.805 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.805 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.805 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143932 s, 72.9 MB/s 2024-09-17T01:42:12.826 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.826 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.827 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181482 s, 57.8 MB/s 2024-09-17T01:42:12.844 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.844 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.845 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148726 s, 70.5 MB/s 2024-09-17T01:42:12.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.866 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018119 s, 57.9 MB/s 2024-09-17T01:42:12.883 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.883 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.883 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013953 s, 75.2 MB/s 2024-09-17T01:42:12.901 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.901 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.901 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150278 s, 69.8 MB/s 2024-09-17T01:42:12.922 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.922 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.922 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182255 s, 57.5 MB/s 2024-09-17T01:42:12.940 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.941 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.941 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154926 s, 67.7 MB/s 2024-09-17T01:42:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132998 s, 78.8 MB/s 2024-09-17T01:42:12.975 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.975 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.976 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150132 s, 69.8 MB/s 2024-09-17T01:42:12.992 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:12.992 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:12.992 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134541 s, 77.9 MB/s 2024-09-17T01:42:13.013 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.013 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.014 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183614 s, 57.1 MB/s 2024-09-17T01:42:13.032 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.032 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.032 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149942 s, 69.9 MB/s 2024-09-17T01:42:13.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:42:13.041 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:42:13.042 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:42:13.042 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.28 2024-09-17T01:42:13.042 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:42:13.042 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:42:13.043 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:42:13.043 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:42:13.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:42:13.149 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.149 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.149 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193172 s, 54.3 MB/s 2024-09-17T01:42:13.166 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.166 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.166 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140127 s, 74.8 MB/s 2024-09-17T01:42:13.183 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.183 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.183 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137226 s, 76.4 MB/s 2024-09-17T01:42:13.201 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.201 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.201 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145617 s, 72.0 MB/s 2024-09-17T01:42:13.218 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.218 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.219 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145537 s, 72.0 MB/s 2024-09-17T01:42:13.236 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.236 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.236 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148636 s, 70.5 MB/s 2024-09-17T01:42:13.255 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.255 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.255 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157147 s, 66.7 MB/s 2024-09-17T01:42:13.270 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.270 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.270 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011769 s, 89.1 MB/s 2024-09-17T01:42:13.288 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.288 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.288 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143642 s, 73.0 MB/s 2024-09-17T01:42:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.306 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144713 s, 72.5 MB/s 2024-09-17T01:42:13.330 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.330 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.330 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210151 s, 49.9 MB/s 2024-09-17T01:42:13.347 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.347 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.347 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147168 s, 71.3 MB/s 2024-09-17T01:42:13.368 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.369 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.369 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180009 s, 58.3 MB/s 2024-09-17T01:42:13.386 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.386 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.386 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148131 s, 70.8 MB/s 2024-09-17T01:42:13.403 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.403 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.403 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137056 s, 76.5 MB/s 2024-09-17T01:42:13.420 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.421 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.421 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143435 s, 73.1 MB/s 2024-09-17T01:42:13.439 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.439 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.439 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150415 s, 69.7 MB/s 2024-09-17T01:42:13.454 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.454 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.455 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128549 s, 81.6 MB/s 2024-09-17T01:42:13.476 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.476 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.476 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183538 s, 57.1 MB/s 2024-09-17T01:42:13.495 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.495 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.495 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016116 s, 65.1 MB/s 2024-09-17T01:42:13.513 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.513 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.513 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146425 s, 71.6 MB/s 2024-09-17T01:42:13.530 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.530 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.530 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136361 s, 76.9 MB/s 2024-09-17T01:42:13.547 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.547 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.547 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140052 s, 74.9 MB/s 2024-09-17T01:42:13.565 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.565 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.565 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146144 s, 71.7 MB/s 2024-09-17T01:42:13.582 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.582 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.582 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137221 s, 76.4 MB/s 2024-09-17T01:42:13.600 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.601 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.601 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156244 s, 67.1 MB/s 2024-09-17T01:42:13.619 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.619 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.619 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150042 s, 69.9 MB/s 2024-09-17T01:42:13.636 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.637 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.637 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146407 s, 71.6 MB/s 2024-09-17T01:42:13.654 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.654 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.654 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013937 s, 75.2 MB/s 2024-09-17T01:42:13.671 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.671 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.671 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139222 s, 75.3 MB/s 2024-09-17T01:42:13.689 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.689 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.689 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148991 s, 70.4 MB/s 2024-09-17T01:42:13.706 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.706 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.706 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136441 s, 76.9 MB/s 2024-09-17T01:42:13.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:42:13.716 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:42:13.716 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:42:13.716 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.29 2024-09-17T01:42:13.716 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:42:13.716 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:42:13.717 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:42:13.717 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:42:13.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:42:13.823 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.823 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.823 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198818 s, 52.7 MB/s 2024-09-17T01:42:13.841 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.841 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.841 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154921 s, 67.7 MB/s 2024-09-17T01:42:13.858 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.859 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.859 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142174 s, 73.8 MB/s 2024-09-17T01:42:13.876 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.876 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.876 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142646 s, 73.5 MB/s 2024-09-17T01:42:13.894 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.894 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.894 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148233 s, 70.7 MB/s 2024-09-17T01:42:13.912 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.913 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.913 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156971 s, 66.8 MB/s 2024-09-17T01:42:13.933 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.933 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.933 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017274 s, 60.7 MB/s 2024-09-17T01:42:13.951 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.951 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.951 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015382 s, 68.2 MB/s 2024-09-17T01:42:13.972 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.972 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.972 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181258 s, 57.8 MB/s 2024-09-17T01:42:13.991 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:13.991 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:13.991 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155676 s, 67.4 MB/s 2024-09-17T01:42:14.009 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.009 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.009 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145569 s, 72.0 MB/s 2024-09-17T01:42:14.029 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.029 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.029 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173235 s, 60.5 MB/s 2024-09-17T01:42:14.048 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.048 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.048 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151875 s, 69.0 MB/s 2024-09-17T01:42:14.064 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.065 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.065 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138754 s, 75.6 MB/s 2024-09-17T01:42:14.086 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.086 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.086 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181197 s, 57.9 MB/s 2024-09-17T01:42:14.102 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.102 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.102 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139152 s, 75.4 MB/s 2024-09-17T01:42:14.124 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.125 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.125 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186197 s, 56.3 MB/s 2024-09-17T01:42:14.142 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.142 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.142 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143066 s, 73.3 MB/s 2024-09-17T01:42:14.163 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.163 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.163 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176954 s, 59.3 MB/s 2024-09-17T01:42:14.181 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.181 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.181 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150349 s, 69.7 MB/s 2024-09-17T01:42:14.200 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.200 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.200 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159266 s, 65.8 MB/s 2024-09-17T01:42:14.219 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.219 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.219 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153966 s, 68.1 MB/s 2024-09-17T01:42:14.236 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.236 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.236 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01424 s, 73.6 MB/s 2024-09-17T01:42:14.253 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.254 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.254 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140987 s, 74.4 MB/s 2024-09-17T01:42:14.271 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.271 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.271 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143924 s, 72.9 MB/s 2024-09-17T01:42:14.289 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.289 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.289 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145976 s, 71.8 MB/s 2024-09-17T01:42:14.307 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.307 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.307 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149376 s, 70.2 MB/s 2024-09-17T01:42:14.324 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.324 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.325 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143108 s, 73.3 MB/s 2024-09-17T01:42:14.342 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.342 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.342 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146593 s, 71.5 MB/s 2024-09-17T01:42:14.360 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.360 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.360 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142275 s, 73.7 MB/s 2024-09-17T01:42:14.378 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.379 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.379 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154256 s, 68.0 MB/s 2024-09-17T01:42:14.400 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.400 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.400 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187433 s, 55.9 MB/s 2024-09-17T01:42:14.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:42:14.409 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:42:14.410 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:42:14.410 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.30 2024-09-17T01:42:14.410 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:42:14.410 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:42:14.410 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:42:14.410 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:42:14.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:42:14.514 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.514 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.514 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175437 s, 59.8 MB/s 2024-09-17T01:42:14.531 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.531 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.531 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144308 s, 72.7 MB/s 2024-09-17T01:42:14.550 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.550 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.550 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153029 s, 68.5 MB/s 2024-09-17T01:42:14.572 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.572 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.572 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185769 s, 56.4 MB/s 2024-09-17T01:42:14.593 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.593 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.593 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176686 s, 59.3 MB/s 2024-09-17T01:42:14.611 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.611 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.611 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151383 s, 69.3 MB/s 2024-09-17T01:42:14.629 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.629 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.629 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152661 s, 68.7 MB/s 2024-09-17T01:42:14.648 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.648 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.648 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158686 s, 66.1 MB/s 2024-09-17T01:42:14.665 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.665 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.666 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141904 s, 73.9 MB/s 2024-09-17T01:42:14.682 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.683 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.683 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140873 s, 74.4 MB/s 2024-09-17T01:42:14.701 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.701 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.701 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149158 s, 70.3 MB/s 2024-09-17T01:42:14.718 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.718 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.718 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143294 s, 73.2 MB/s 2024-09-17T01:42:14.736 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.736 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.736 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149288 s, 70.2 MB/s 2024-09-17T01:42:14.753 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.753 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.753 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138862 s, 75.5 MB/s 2024-09-17T01:42:14.770 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.770 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.770 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137823 s, 76.1 MB/s 2024-09-17T01:42:14.786 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.786 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.786 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127384 s, 82.3 MB/s 2024-09-17T01:42:14.800 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.801 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.801 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112206 s, 93.5 MB/s 2024-09-17T01:42:14.817 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.817 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.817 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126677 s, 82.8 MB/s 2024-09-17T01:42:14.834 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.834 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.834 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141232 s, 74.2 MB/s 2024-09-17T01:42:14.858 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.858 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.858 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209603 s, 50.0 MB/s 2024-09-17T01:42:14.876 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.877 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.877 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150543 s, 69.7 MB/s 2024-09-17T01:42:14.895 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.895 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.895 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155174 s, 67.6 MB/s 2024-09-17T01:42:14.914 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.914 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.914 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154052 s, 68.1 MB/s 2024-09-17T01:42:14.936 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.936 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.936 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018691 s, 56.1 MB/s 2024-09-17T01:42:14.955 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.955 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.955 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143658 s, 73.0 MB/s 2024-09-17T01:42:14.984 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:14.985 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:14.985 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258455 s, 40.6 MB/s 2024-09-17T01:42:15.002 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.002 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.002 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137103 s, 76.5 MB/s 2024-09-17T01:42:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.019 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141401 s, 74.2 MB/s 2024-09-17T01:42:15.038 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.038 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.038 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153031 s, 68.5 MB/s 2024-09-17T01:42:15.055 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.055 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.055 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141662 s, 74.0 MB/s 2024-09-17T01:42:15.076 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.076 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.077 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180412 s, 58.1 MB/s 2024-09-17T01:42:15.094 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.094 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.094 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140571 s, 74.6 MB/s 2024-09-17T01:42:15.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:42:15.104 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:42:15.104 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:42:15.104 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.31 2024-09-17T01:42:15.104 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:42:15.104 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:42:15.104 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:42:15.104 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:42:15.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:42:15.205 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.205 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.205 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145629 s, 72.0 MB/s 2024-09-17T01:42:15.223 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.223 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.223 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153021 s, 68.5 MB/s 2024-09-17T01:42:15.244 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.244 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.244 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177887 s, 58.9 MB/s 2024-09-17T01:42:15.263 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.263 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.263 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159703 s, 65.7 MB/s 2024-09-17T01:42:15.281 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.281 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.281 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152342 s, 68.8 MB/s 2024-09-17T01:42:15.299 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.299 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.299 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147495 s, 71.1 MB/s 2024-09-17T01:42:15.317 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.317 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.317 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146019 s, 71.8 MB/s 2024-09-17T01:42:15.334 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.334 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.335 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147843 s, 70.9 MB/s 2024-09-17T01:42:15.351 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.352 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.352 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141374 s, 74.2 MB/s 2024-09-17T01:42:15.367 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.367 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.367 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122851 s, 85.4 MB/s 2024-09-17T01:42:15.384 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.384 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.384 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135135 s, 77.6 MB/s 2024-09-17T01:42:15.403 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.403 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.403 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158876 s, 66.0 MB/s 2024-09-17T01:42:15.420 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.420 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.420 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141291 s, 74.2 MB/s 2024-09-17T01:42:15.441 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.441 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.441 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176403 s, 59.4 MB/s 2024-09-17T01:42:15.459 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.460 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.460 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146789 s, 71.4 MB/s 2024-09-17T01:42:15.476 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.476 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.476 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142661 s, 73.5 MB/s 2024-09-17T01:42:15.496 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.496 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.496 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166528 s, 63.0 MB/s 2024-09-17T01:42:15.517 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.517 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.517 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175694 s, 59.7 MB/s 2024-09-17T01:42:15.534 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.534 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.534 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136978 s, 76.6 MB/s 2024-09-17T01:42:15.551 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.551 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.551 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141093 s, 74.3 MB/s 2024-09-17T01:42:15.568 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.569 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.569 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143813 s, 72.9 MB/s 2024-09-17T01:42:15.586 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.586 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.587 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147401 s, 71.1 MB/s 2024-09-17T01:42:15.607 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.608 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.608 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182841 s, 57.3 MB/s 2024-09-17T01:42:15.632 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.632 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.632 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213098 s, 49.2 MB/s 2024-09-17T01:42:15.651 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.651 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.651 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157158 s, 66.7 MB/s 2024-09-17T01:42:15.668 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.668 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.668 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141659 s, 74.0 MB/s 2024-09-17T01:42:15.686 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.686 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.686 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142303 s, 73.7 MB/s 2024-09-17T01:42:15.708 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.708 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.708 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190045 s, 55.2 MB/s 2024-09-17T01:42:15.726 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.726 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.726 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149278 s, 70.2 MB/s 2024-09-17T01:42:15.743 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.743 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.743 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136341 s, 76.9 MB/s 2024-09-17T01:42:15.760 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.760 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.760 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143175 s, 73.2 MB/s 2024-09-17T01:42:15.778 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:42:15.778 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:42:15.778 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145649 s, 72.0 MB/s 2024-09-17T01:42:15.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:42:15.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:42:15.787 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub start /scrub_control_test_path recursive 2024-09-17T01:42:16.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.022+0000 7f37e0000640 1 -- 172.21.15.42:0/2221699304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37d80cdb20 msgr2=0x7f37d80cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.022+0000 7f37e0000640 1 --2- 172.21.15.42:0/2221699304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37d80cdb20 0x7f37d80cdf30 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f37c4005fd0 tx=0x7f37c402a5c0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.022+0000 7f37e0000640 1 -- 172.21.15.42:0/2221699304 shutdown_connections 2024-09-17T01:42:16.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.022+0000 7f37e0000640 1 --2- 172.21.15.42:0/2221699304 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f37d806d430 0x7f37d806d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.022+0000 7f37e0000640 1 --2- 172.21.15.42:0/2221699304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37d80cdb20 0x7f37d80cdf30 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.022+0000 7f37e0000640 1 -- 172.21.15.42:0/2221699304 >> 172.21.15.42:0/2221699304 conn(0x7f37d80b28f0 msgr2=0x7f37d806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:16.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.022+0000 7f37e0000640 1 -- 172.21.15.42:0/2221699304 shutdown_connections 2024-09-17T01:42:16.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.022+0000 7f37e0000640 1 -- 172.21.15.42:0/2221699304 wait complete. 2024-09-17T01:42:16.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.024+0000 7f37e0000640 1 Processor -- start 2024-09-17T01:42:16.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.024+0000 7f37e0000640 1 -- start start 2024-09-17T01:42:16.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.026+0000 7f37e0000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f37d806d430 0x7f37d8072e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.026+0000 7f37e0000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37d80b56d0 0x7f37d8144880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.026+0000 7f37e0000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d80cdb20 0x7f37d815c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.026+0000 7f37e0000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f37d815d560 con 0x7f37d80b56d0 2024-09-17T01:42:16.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.026+0000 7f37e0000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f37d815d3e0 con 0x7f37d80cdb20 2024-09-17T01:42:16.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.026+0000 7f37e0000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f37d815d6e0 con 0x7f37d806d430 2024-09-17T01:42:16.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.026+0000 7f37dcc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37d80b56d0 0x7f37d8144880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.026+0000 7f37dcc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37d80b56d0 0x7f37d8144880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33560/0 (socket says 172.21.15.42:33560) 2024-09-17T01:42:16.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.026+0000 7f37dcc00640 1 -- 172.21.15.42:0/279524672 learned_addr learned my addr 172.21.15.42:0/279524672 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:16.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.026+0000 7f37dd600640 1 --2- 172.21.15.42:0/279524672 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f37d806d430 0x7f37d8072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.026+0000 7f37de000640 1 --2- 172.21.15.42:0/279524672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d80cdb20 0x7f37d815c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.026+0000 7f37dcc00640 1 -- 172.21.15.42:0/279524672 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f37d806d430 msgr2=0x7f37d8072e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.026+0000 7f37dcc00640 1 --2- 172.21.15.42:0/279524672 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f37d806d430 0x7f37d8072e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.026+0000 7f37dcc00640 1 -- 172.21.15.42:0/279524672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d80cdb20 msgr2=0x7f37d815c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.026+0000 7f37dcc00640 1 --2- 172.21.15.42:0/279524672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d80cdb20 0x7f37d815c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.027+0000 7f37dcc00640 1 -- 172.21.15.42:0/279524672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d80736c0 con 0x7f37d80b56d0 2024-09-17T01:42:16.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.027+0000 7f37dcc00640 1 --2- 172.21.15.42:0/279524672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37d80b56d0 0x7f37d8144880 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f37c4006010 tx=0x7f37c40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:16.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.027+0000 7f37d5600640 1 -- 172.21.15.42:0/279524672 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c403e030 con 0x7f37d80b56d0 2024-09-17T01:42:16.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.027+0000 7f37d5600640 1 -- 172.21.15.42:0/279524672 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37c4003d90 con 0x7f37d80b56d0 2024-09-17T01:42:16.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.027+0000 7f37d5600640 1 -- 172.21.15.42:0/279524672 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c4035040 con 0x7f37d80b56d0 2024-09-17T01:42:16.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.027+0000 7f37e0000640 1 -- 172.21.15.42:0/279524672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37d80739a0 con 0x7f37d80b56d0 2024-09-17T01:42:16.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.027+0000 7f37e0000640 1 -- 172.21.15.42:0/279524672 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37d80c5740 con 0x7f37d80b56d0 2024-09-17T01:42:16.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.030+0000 7f37d5600640 1 -- 172.21.15.42:0/279524672 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f37c4041030 con 0x7f37d80b56d0 2024-09-17T01:42:16.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.031+0000 7f37d5600640 1 --2- 172.21.15.42:0/279524672 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f37b8078b90 0x7f37b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.031+0000 7f37d5600640 1 -- 172.21.15.42:0/279524672 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f37c40bb580 con 0x7f37d80b56d0 2024-09-17T01:42:16.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.031+0000 7f37dd600640 1 --2- 172.21.15.42:0/279524672 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f37b8078b90 0x7f37b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.031+0000 7f37e70b1740 1 Processor -- start 2024-09-17T01:42:16.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.031+0000 7f37e70b1740 1 -- start start 2024-09-17T01:42:16.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.032+0000 7f37dd600640 1 --2- 172.21.15.42:0/279524672 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f37b8078b90 0x7f37b807b0a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f37cc001720 tx=0x7f37cc009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:16.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.033+0000 7f37e70b1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ada730 0x563b51ec7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.033+0000 7f37e70b1740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563b51ab1870 0x563b51e9be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.033+0000 7f37e70b1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563b51ab9a50 0x563b51e9c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.033+0000 7f37e70b1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563b51df4a70 con 0x563b51ada730 2024-09-17T01:42:16.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.033+0000 7f37e70b1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563b51de3ea0 con 0x563b51ab9a50 2024-09-17T01:42:16.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.033+0000 7f37e70b1740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x563b51de7cb0 con 0x563b51ab1870 2024-09-17T01:42:16.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.033+0000 7f37dd600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ada730 0x563b51ec7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.033+0000 7f37dd600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ada730 0x563b51ec7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33568/0 (socket says 172.21.15.42:33568) 2024-09-17T01:42:16.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.033+0000 7f37dd600640 1 -- 172.21.15.42:0/715215809 learned_addr learned my addr 172.21.15.42:0/715215809 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:16.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.033+0000 7f37de000640 1 --2- 172.21.15.42:0/715215809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563b51ab9a50 0x563b51e9c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.033+0000 7f37dcc00640 1 --2- 172.21.15.42:0/715215809 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563b51ab1870 0x563b51e9be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.033+0000 7f37dd600640 1 -- 172.21.15.42:0/715215809 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563b51ab1870 msgr2=0x563b51e9be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:16.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.033+0000 7f37dd600640 1 --2- 172.21.15.42:0/715215809 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563b51ab1870 0x563b51e9be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.033+0000 7f37dd600640 1 -- 172.21.15.42:0/715215809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563b51ab9a50 msgr2=0x563b51e9c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:16.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.033+0000 7f37dd600640 1 --2- 172.21.15.42:0/715215809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563b51ab9a50 0x563b51e9c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.033+0000 7f37dd600640 1 -- 172.21.15.42:0/715215809 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b51bbeba0 con 0x563b51ada730 2024-09-17T01:42:16.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.034+0000 7f37dd600640 1 --2- 172.21.15.42:0/715215809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ada730 0x563b51ec7040 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00f970 tx=0x7f37cc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6456b4de5f9f9156 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:16.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.034+0000 7f37c9c00640 1 -- 172.21.15.42:0/715215809 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc025070 con 0x563b51ada730 2024-09-17T01:42:16.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.034+0000 7f37c9c00640 1 -- 172.21.15.42:0/715215809 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37cc01b050 con 0x563b51ada730 2024-09-17T01:42:16.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.034+0000 7f37c9c00640 1 -- 172.21.15.42:0/715215809 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc014e40 con 0x563b51ada730 2024-09-17T01:42:16.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.035+0000 7f37e70b1740 1 -- 172.21.15.42:0/715215809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ada730 msgr2=0x563b51ec7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.035+0000 7f37e70b1740 1 --2- 172.21.15.42:0/715215809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ada730 0x563b51ec7040 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00f970 tx=0x7f37cc012000 comp rx=0 tx=0).stop 2024-09-17T01:42:16.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.035+0000 7f37e70b1740 1 -- 172.21.15.42:0/715215809 shutdown_connections 2024-09-17T01:42:16.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.035+0000 7f37e70b1740 1 --2- 172.21.15.42:0/715215809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563b51ab9a50 0x563b51e9c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.035+0000 7f37e70b1740 1 --2- 172.21.15.42:0/715215809 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563b51ab1870 0x563b51e9be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.035+0000 7f37e70b1740 1 --2- 172.21.15.42:0/715215809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ada730 0x563b51ec7040 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.035+0000 7f37e70b1740 1 -- 172.21.15.42:0/715215809 >> 172.21.15.42:0/715215809 conn(0x563b51ace880 msgr2=0x563b51e82330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:16.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.035+0000 7f37e70b1740 1 -- 172.21.15.42:0/715215809 shutdown_connections 2024-09-17T01:42:16.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.035+0000 7f37e70b1740 1 -- 172.21.15.42:0/715215809 wait complete. 2024-09-17T01:42:16.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.036+0000 7f37e70b1740 1 -- start start 2024-09-17T01:42:16.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.036+0000 7f37e70b1740 1 Processor -- start 2024-09-17T01:42:16.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.038+0000 7f37e70b1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ab1870 0x563b51ec3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.038+0000 7f37e70b1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563b51ab9a50 0x563b51ebcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.038+0000 7f37e70b1740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563b51ada730 0x563b51e815f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.038+0000 7f37e70b1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563b51b54ae0 con 0x563b51ab1870 2024-09-17T01:42:16.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.038+0000 7f37e70b1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563b51d897b0 con 0x563b51ab9a50 2024-09-17T01:42:16.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.038+0000 7f37e70b1740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x563b51eab540 con 0x563b51ada730 2024-09-17T01:42:16.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.038+0000 7f37e70b1740 10 client.0 _ll_register_callbacks cb 0x563b51d8f890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:42:16.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.038+0000 7f37dd600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ab1870 0x563b51ec3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.038+0000 7f37dd600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ab1870 0x563b51ec3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33584/0 (socket says 172.21.15.42:33584) 2024-09-17T01:42:16.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.038+0000 7f37dd600640 1 -- 172.21.15.42:0/520492333 learned_addr learned my addr 172.21.15.42:0/520492333 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:16.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.038+0000 7f37dcc00640 1 --2- 172.21.15.42:0/520492333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563b51ab9a50 0x563b51ebcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.038+0000 7f37de000640 1 --2- 172.21.15.42:0/520492333 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563b51ada730 0x563b51e815f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.038+0000 7f37dd600640 1 -- 172.21.15.42:0/520492333 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563b51ada730 msgr2=0x563b51e815f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:16.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.038+0000 7f37dd600640 1 --2- 172.21.15.42:0/520492333 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563b51ada730 0x563b51e815f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.038+0000 7f37dd600640 1 -- 172.21.15.42:0/520492333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563b51ab9a50 msgr2=0x563b51ebcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:16.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.038+0000 7f37dd600640 1 --2- 172.21.15.42:0/520492333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563b51ab9a50 0x563b51ebcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.038+0000 7f37dd600640 1 -- 172.21.15.42:0/520492333 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b51b23a40 con 0x563b51ab1870 2024-09-17T01:42:16.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.039+0000 7f37dd600640 1 --2- 172.21.15.42:0/520492333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ab1870 0x563b51ec3cd0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f37cc008fd0 tx=0x7f37cc0206c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9affd3813730d278 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:16.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.039+0000 7f37be000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:42:16.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.039+0000 7f37be000640 1 -- 172.21.15.42:0/520492333 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc025040 con 0x563b51ab1870 2024-09-17T01:42:16.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.039+0000 7f37be000640 1 -- 172.21.15.42:0/520492333 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f37cc020ab0 con 0x563b51ab1870 2024-09-17T01:42:16.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.039+0000 7f37e70b1740 1 -- 172.21.15.42:0/520492333 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37cc01b050 con 0x563b51ab1870 2024-09-17T01:42:16.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.039+0000 7f37be000640 1 -- 172.21.15.42:0/520492333 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7f37cc038050 con 0x563b51ab1870 2024-09-17T01:42:16.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.039+0000 7f37e70b1740 10 client.8607 fetch_fsmap learned FSMap version 107 2024-09-17T01:42:16.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.039+0000 7f37e70b1740 1 -- 172.21.15.42:0/520492333 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x563b51c1f330 con 0x563b51ab1870 2024-09-17T01:42:16.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.039+0000 7f37be000640 1 -- 172.21.15.42:0/520492333 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37cc01b050 con 0x563b51ab1870 2024-09-17T01:42:16.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.040+0000 7f37be000640 1 -- 172.21.15.42:0/520492333 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7f37cc03b020 con 0x563b51ab1870 2024-09-17T01:42:16.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.040+0000 7f37e70b1740 10 client.8607 fetch_fsmap finished waiting for FSMap version 107 2024-09-17T01:42:16.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.040+0000 7f37e70b1740 10 client.8607 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-17T01:42:16.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.040+0000 7f37e70b1740 20 client.8607 populate_metadata read hostname 'smithi042' 2024-09-17T01:42:16.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.040+0000 7f37e70b1740 1 --2- 172.21.15.42:0/520492333 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x563b51a99300 0x563b51ec1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.040+0000 7f37e70b1740 4 client.8607 mds_command: new command op to 8442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:42:16.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.040+0000 7f37e70b1740 1 -- 172.21.15.42:0/520492333 --> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b51df69c0 con 0x563b51a99300 2024-09-17T01:42:16.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.040+0000 7f37dcc00640 1 --2- 172.21.15.42:0/520492333 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x563b51a99300 0x563b51ec1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.041+0000 7f37be000640 10 client.8607 ms_handle_connect on v2:172.21.15.42:6833/3060441721 2024-09-17T01:42:16.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.041+0000 7f37dcc00640 1 --2- 172.21.15.42:0/520492333 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x563b51a99300 0x563b51ec1580 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=243a781ce45df632 server_cookie=1c6ca1d8ce393289 in_seq=0 out_seq=0 2024-09-17T01:42:16.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.041+0000 7f37be000640 1 -- 172.21.15.42:0/520492333 <== mds.0 v2:172.21.15.42:6833/3060441721 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563b51df69c0 con 0x563b51a99300 2024-09-17T01:42:16.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.041+0000 7f37be000640 10 client.8607 handle_command_reply: tid=0 2024-09-17T01:42:16.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.041+0000 7f37e70b1740 1 client.8607 shutdown 2024-09-17T01:42:16.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.042+0000 7f37e70b1740 1 -- 172.21.15.42:0/520492333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ab1870 msgr2=0x563b51ec3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.042+0000 7f37e70b1740 1 --2- 172.21.15.42:0/520492333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ab1870 0x563b51ec3cd0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f37cc008fd0 tx=0x7f37cc0206c0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.042+0000 7f37e70b1740 1 -- 172.21.15.42:0/520492333 shutdown_connections 2024-09-17T01:42:16.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.042+0000 7f37e70b1740 1 --2- 172.21.15.42:0/520492333 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x563b51a99300 0x563b51ec1580 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.042+0000 7f37e70b1740 1 --2- 172.21.15.42:0/520492333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563b51ab9a50 0x563b51ebcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.042+0000 7f37e70b1740 1 --2- 172.21.15.42:0/520492333 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563b51ada730 0x563b51e815f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.042+0000 7f37e70b1740 1 --2- 172.21.15.42:0/520492333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ab1870 0x563b51ec3cd0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.042+0000 7f37be000640 0 client.8607 ms_handle_reset on v2:172.21.15.42:6833/3060441721 2024-09-17T01:42:16.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.042+0000 7f37e70b1740 1 -- 172.21.15.42:0/520492333 >> 172.21.15.42:0/520492333 conn(0x563b51ace880 msgr2=0x563b51e9c470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:16.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.042+0000 7f37e70b1740 1 -- 172.21.15.42:0/520492333 shutdown_connections 2024-09-17T01:42:16.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.042+0000 7f37e70b1740 1 -- 172.21.15.42:0/520492333 wait complete. 2024-09-17T01:42:16.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.042+0000 7f37e70b1740 20 client.8607 trim_cache size 0 max 16384 2024-09-17T01:42:16.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.061+0000 7f37e70b1740 1 Processor -- start 2024-09-17T01:42:16.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.061+0000 7f37e70b1740 1 -- start start 2024-09-17T01:42:16.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.062+0000 7f37e70b1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563b51ab1870 0x563b51ea8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.062+0000 7f37e70b1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ab9a50 0x563b51e7cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.062+0000 7f37e70b1740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563b51ada730 0x563b51ec3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.062+0000 7f37e70b1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f37d8202290 con 0x563b51ab9a50 2024-09-17T01:42:16.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.062+0000 7f37e70b1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f37d82012d0 con 0x563b51ab1870 2024-09-17T01:42:16.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.062+0000 7f37e70b1740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f37d80c6a20 con 0x563b51ada730 2024-09-17T01:42:16.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.063+0000 7f37dcc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ab9a50 0x563b51e7cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.063+0000 7f37dcc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ab9a50 0x563b51e7cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33592/0 (socket says 172.21.15.42:33592) 2024-09-17T01:42:16.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.063+0000 7f37dcc00640 1 -- 172.21.15.42:0/854773695 learned_addr learned my addr 172.21.15.42:0/854773695 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:16.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.063+0000 7f37dcc00640 1 -- 172.21.15.42:0/854773695 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563b51ada730 msgr2=0x563b51ec3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:16.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.063+0000 7f37dcc00640 1 --2- 172.21.15.42:0/854773695 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563b51ada730 0x563b51ec3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.063+0000 7f37dcc00640 1 -- 172.21.15.42:0/854773695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563b51ab1870 msgr2=0x563b51ea8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:16.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.063+0000 7f37dcc00640 1 --2- 172.21.15.42:0/854773695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563b51ab1870 0x563b51ea8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.063+0000 7f37dcc00640 1 -- 172.21.15.42:0/854773695 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b51bbcea0 con 0x563b51ab9a50 2024-09-17T01:42:16.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.063+0000 7f37dcc00640 1 --2- 172.21.15.42:0/854773695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ab9a50 0x563b51e7cb30 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f37c4082fd0 tx=0x7f37c4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a96b0f8ec20488e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:16.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.063+0000 7f37c9200640 1 -- 172.21.15.42:0/854773695 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c4048040 con 0x563b51ab9a50 2024-09-17T01:42:16.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.063+0000 7f37c9200640 1 -- 172.21.15.42:0/854773695 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37c40832d0 con 0x563b51ab9a50 2024-09-17T01:42:16.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.063+0000 7f37c9200640 1 -- 172.21.15.42:0/854773695 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c4087d00 con 0x563b51ab9a50 2024-09-17T01:42:16.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.064+0000 7f37e70b1740 1 -- 172.21.15.42:0/854773695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ab9a50 msgr2=0x563b51e7cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.064+0000 7f37e70b1740 1 --2- 172.21.15.42:0/854773695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ab9a50 0x563b51e7cb30 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f37c4082fd0 tx=0x7f37c4009260 comp rx=0 tx=0).stop 2024-09-17T01:42:16.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.064+0000 7f37e70b1740 1 -- 172.21.15.42:0/854773695 shutdown_connections 2024-09-17T01:42:16.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.064+0000 7f37e70b1740 1 --2- 172.21.15.42:0/854773695 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563b51ada730 0x563b51ec3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.064+0000 7f37e70b1740 1 --2- 172.21.15.42:0/854773695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ab9a50 0x563b51e7cb30 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.064+0000 7f37e70b1740 1 --2- 172.21.15.42:0/854773695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563b51ab1870 0x563b51ea8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.064+0000 7f37e70b1740 1 -- 172.21.15.42:0/854773695 >> 172.21.15.42:0/854773695 conn(0x563b51ace880 msgr2=0x563b51e822a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:16.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.064+0000 7f37e70b1740 1 -- 172.21.15.42:0/854773695 shutdown_connections 2024-09-17T01:42:16.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.064+0000 7f37e70b1740 1 -- 172.21.15.42:0/854773695 wait complete. 2024-09-17T01:42:16.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.065+0000 7f37e70b1740 1 -- start start 2024-09-17T01:42:16.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.065+0000 7f37e70b1740 1 Processor -- start 2024-09-17T01:42:16.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.067+0000 7f37e70b1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ab1870 0x563b51f3cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.067+0000 7f37e70b1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563b51ab9a50 0x563b51ea8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.067+0000 7f37e70b1740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563b51ada730 0x563b51ea86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.067+0000 7f37e70b1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563b51eac4a0 con 0x563b51ab1870 2024-09-17T01:42:16.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.067+0000 7f37e70b1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f37d81f9900 con 0x563b51ab9a50 2024-09-17T01:42:16.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.067+0000 7f37e70b1740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x563b51dea150 con 0x563b51ada730 2024-09-17T01:42:16.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.067+0000 7f37e70b1740 10 client.0 _ll_register_callbacks cb 0x7f37c408c040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:42:16.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.067+0000 7f37dd600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ab1870 0x563b51f3cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.067+0000 7f37dd600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ab1870 0x563b51f3cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33608/0 (socket says 172.21.15.42:33608) 2024-09-17T01:42:16.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.067+0000 7f37dd600640 1 -- 172.21.15.42:0/3561088044 learned_addr learned my addr 172.21.15.42:0/3561088044 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:16.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.068+0000 7f37dd600640 1 -- 172.21.15.42:0/3561088044 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563b51ada730 msgr2=0x563b51ea86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:16.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.068+0000 7f37dcc00640 1 --2- 172.21.15.42:0/3561088044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563b51ab9a50 0x563b51ea8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.068+0000 7f37de000640 1 --2- 172.21.15.42:0/3561088044 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563b51ada730 0x563b51ea86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.068+0000 7f37dd600640 1 --2- 172.21.15.42:0/3561088044 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563b51ada730 0x563b51ea86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.068+0000 7f37dd600640 1 -- 172.21.15.42:0/3561088044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563b51ab9a50 msgr2=0x563b51ea8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:16.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.068+0000 7f37dd600640 1 --2- 172.21.15.42:0/3561088044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563b51ab9a50 0x563b51ea8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.068+0000 7f37dd600640 1 -- 172.21.15.42:0/3561088044 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b51e7c630 con 0x563b51ab1870 2024-09-17T01:42:16.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.068+0000 7f37dcc00640 1 --2- 172.21.15.42:0/3561088044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563b51ab9a50 0x563b51ea8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:42:16.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.068+0000 7f37de000640 1 --2- 172.21.15.42:0/3561088044 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563b51ada730 0x563b51ea86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:42:16.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.068+0000 7f37dd600640 1 --2- 172.21.15.42:0/3561088044 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ab1870 0x563b51f3cbd0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f37cc02b6f0 tx=0x7f37cc02b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c355269d89631ae1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:16.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.068+0000 7f37be000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:42:16.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.068+0000 7f37be000640 1 -- 172.21.15.42:0/3561088044 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc025040 con 0x563b51ab1870 2024-09-17T01:42:16.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.068+0000 7f37be000640 1 -- 172.21.15.42:0/3561088044 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f37cc02bb50 con 0x563b51ab1870 2024-09-17T01:42:16.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.068+0000 7f37e70b1740 1 -- 172.21.15.42:0/3561088044 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37c40832d0 con 0x563b51ab1870 2024-09-17T01:42:16.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.068+0000 7f37be000640 1 -- 172.21.15.42:0/3561088044 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7f37cc044050 con 0x563b51ab1870 2024-09-17T01:42:16.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.068+0000 7f37e70b1740 10 client.8613 fetch_fsmap learned FSMap version 107 2024-09-17T01:42:16.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.069+0000 7f37e70b1740 1 -- 172.21.15.42:0/3561088044 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x563b51e9aa80 con 0x563b51ab1870 2024-09-17T01:42:16.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.069+0000 7f37be000640 1 -- 172.21.15.42:0/3561088044 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37c40832d0 con 0x563b51ab1870 2024-09-17T01:42:16.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.069+0000 7f37be000640 1 -- 172.21.15.42:0/3561088044 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7f37cc047020 con 0x563b51ab1870 2024-09-17T01:42:16.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.069+0000 7f37e70b1740 10 client.8613 fetch_fsmap finished waiting for FSMap version 107 2024-09-17T01:42:16.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.069+0000 7f37e70b1740 10 client.8613 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-17T01:42:16.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.069+0000 7f37e70b1740 20 client.8613 populate_metadata read hostname 'smithi042' 2024-09-17T01:42:16.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.069+0000 7f37e70b1740 1 --2- 172.21.15.42:0/3561088044 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x563b51e7cb30 0x563b51ec3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.069+0000 7f37e70b1740 4 client.8613 mds_command: new command op to 8442 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-17T01:42:16.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.069+0000 7f37e70b1740 1 -- 172.21.15.42:0/3561088044 --> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x563b51df2470 con 0x563b51e7cb30 2024-09-17T01:42:16.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.069+0000 7f37dcc00640 1 --2- 172.21.15.42:0/3561088044 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x563b51e7cb30 0x563b51ec3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.070+0000 7f37dcc00640 1 --2- 172.21.15.42:0/3561088044 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x563b51e7cb30 0x563b51ec3ec0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bff69cb6af7dc3ff server_cookie=2cc81670d55300e6 in_seq=0 out_seq=0 2024-09-17T01:42:16.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.070+0000 7f37be000640 10 client.8613 ms_handle_connect on v2:172.21.15.42:6833/3060441721 2024-09-17T01:42:16.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.072+0000 7f37be000640 1 -- 172.21.15.42:0/3561088044 <== mds.0 v2:172.21.15.42:6833/3060441721 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563b51df2470 con 0x563b51e7cb30 2024-09-17T01:42:16.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.072+0000 7f37be000640 10 client.8613 handle_command_reply: tid=0 2024-09-17T01:42:16.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.072+0000 7f37e70b1740 1 client.8613 shutdown 2024-09-17T01:42:16.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.073+0000 7f37e70b1740 1 -- 172.21.15.42:0/3561088044 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ab1870 msgr2=0x563b51f3cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.073+0000 7f37e70b1740 1 --2- 172.21.15.42:0/3561088044 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ab1870 0x563b51f3cbd0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f37cc02b6f0 tx=0x7f37cc02b720 comp rx=0 tx=0).stop 2024-09-17T01:42:16.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.073+0000 7f37e70b1740 1 -- 172.21.15.42:0/3561088044 shutdown_connections 2024-09-17T01:42:16.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.073+0000 7f37e70b1740 1 --2- 172.21.15.42:0/3561088044 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x563b51e7cb30 0x563b51ec3ec0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.073+0000 7f37e70b1740 1 --2- 172.21.15.42:0/3561088044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563b51ab9a50 0x563b51ea8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.073+0000 7f37e70b1740 1 --2- 172.21.15.42:0/3561088044 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x563b51ada730 0x563b51ea86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.073+0000 7f37e70b1740 1 --2- 172.21.15.42:0/3561088044 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563b51ab1870 0x563b51f3cbd0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.073+0000 7f37e70b1740 1 -- 172.21.15.42:0/3561088044 >> 172.21.15.42:0/3561088044 conn(0x563b51ace880 msgr2=0x563b51ec5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:16.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.073+0000 7f37be000640 0 client.8613 ms_handle_reset on v2:172.21.15.42:6833/3060441721 2024-09-17T01:42:16.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.073+0000 7f37e70b1740 1 -- 172.21.15.42:0/3561088044 shutdown_connections 2024-09-17T01:42:16.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.073+0000 7f37e70b1740 1 -- 172.21.15.42:0/3561088044 wait complete. 2024-09-17T01:42:16.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.073+0000 7f37e70b1740 20 client.8613 trim_cache size 0 max 16384 2024-09-17T01:42:16.073 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:42:16.073 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-17T01:42:16.073 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "66cb4c14-2da0-45be-8da9-91bab7343f1d", 2024-09-17T01:42:16.073 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-17T01:42:16.073 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:42:16.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.074+0000 7f37e0000640 1 -- 172.21.15.42:0/279524672 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f37b8078b90 msgr2=0x7f37b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.074+0000 7f37e0000640 1 --2- 172.21.15.42:0/279524672 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f37b8078b90 0x7f37b807b0a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f37cc001720 tx=0x7f37cc009040 comp rx=0 tx=0).stop 2024-09-17T01:42:16.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.074+0000 7f37e0000640 1 -- 172.21.15.42:0/279524672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37d80b56d0 msgr2=0x7f37d8144880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.074+0000 7f37e0000640 1 --2- 172.21.15.42:0/279524672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37d80b56d0 0x7f37d8144880 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f37c4006010 tx=0x7f37c40038a0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.074+0000 7f37e0000640 1 -- 172.21.15.42:0/279524672 shutdown_connections 2024-09-17T01:42:16.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.074+0000 7f37e0000640 1 --2- 172.21.15.42:0/279524672 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f37b8078b90 0x7f37b807b0a0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.074+0000 7f37e0000640 1 --2- 172.21.15.42:0/279524672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f37d80cdb20 0x7f37d815c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.074+0000 7f37e0000640 1 --2- 172.21.15.42:0/279524672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37d80b56d0 0x7f37d8144880 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.074+0000 7f37e0000640 1 --2- 172.21.15.42:0/279524672 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f37d806d430 0x7f37d8072e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.074+0000 7f37e0000640 1 -- 172.21.15.42:0/279524672 >> 172.21.15.42:0/279524672 conn(0x7f37d80b28f0 msgr2=0x7f37d806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:16.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.074+0000 7f37e0000640 1 -- 172.21.15.42:0/279524672 shutdown_connections 2024-09-17T01:42:16.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.074+0000 7f37e0000640 1 -- 172.21.15.42:0/279524672 wait complete. 2024-09-17T01:42:16.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:42:16.103 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub pause 2024-09-17T01:42:16.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.442+0000 7f8ad7200640 1 -- 172.21.15.42:0/2406712539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ad00b3be0 msgr2=0x7f8ad015ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.442+0000 7f8ad7200640 1 --2- 172.21.15.42:0/2406712539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ad00b3be0 0x7f8ad015ea10 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f8acc005fd0 tx=0x7f8acc02a7e0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.442+0000 7f8ad7200640 1 -- 172.21.15.42:0/2406712539 shutdown_connections 2024-09-17T01:42:16.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.442+0000 7f8ad7200640 1 --2- 172.21.15.42:0/2406712539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ad00b3be0 0x7f8ad015ea10 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.442+0000 7f8ad7200640 1 -- 172.21.15.42:0/2406712539 >> 172.21.15.42:0/2406712539 conn(0x7f8ad00b61c0 msgr2=0x7f8ad00b65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:16.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.443+0000 7f8ad7200640 1 -- 172.21.15.42:0/2406712539 shutdown_connections 2024-09-17T01:42:16.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.443+0000 7f8ad7200640 1 -- 172.21.15.42:0/2406712539 wait complete. 2024-09-17T01:42:16.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.447+0000 7f8ad7200640 1 Processor -- start 2024-09-17T01:42:16.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.447+0000 7f8ad7200640 1 -- start start 2024-09-17T01:42:16.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.450+0000 7f8ad7200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8ad00b3be0 0x7f8ad01f34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.450+0000 7f8ad7200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad00d40b0 0x7f8ad0156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.450+0000 7f8ad7200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ad0156d60 0x7f8ad01610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.450+0000 7f8ad7200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad00b86c0 con 0x7f8ad0156d60 2024-09-17T01:42:16.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.450+0000 7f8ad7200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad00b8540 con 0x7f8ad00d40b0 2024-09-17T01:42:16.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.450+0000 7f8ad7200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8ad00b8840 con 0x7f8ad00b3be0 2024-09-17T01:42:16.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.451+0000 7f8ad5e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8ad00b3be0 0x7f8ad01f34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.451+0000 7f8ad5e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8ad00b3be0 0x7f8ad01f34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:35564/0 (socket says 172.21.15.42:35564) 2024-09-17T01:42:16.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.451+0000 7f8ad5e00640 1 -- 172.21.15.42:0/1973294633 learned_addr learned my addr 172.21.15.42:0/1973294633 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:16.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.451+0000 7f8ad5400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad00d40b0 0x7f8ad0156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.451+0000 7f8ad6800640 1 --2- 172.21.15.42:0/1973294633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ad0156d60 0x7f8ad01610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.451+0000 7f8ad5e00640 1 -- 172.21.15.42:0/1973294633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad00d40b0 msgr2=0x7f8ad0156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.451+0000 7f8ad5e00640 1 --2- 172.21.15.42:0/1973294633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad00d40b0 0x7f8ad0156820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.451+0000 7f8ad5e00640 1 -- 172.21.15.42:0/1973294633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ad0156d60 msgr2=0x7f8ad01610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.451+0000 7f8ad5e00640 1 --2- 172.21.15.42:0/1973294633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ad0156d60 0x7f8ad01610c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.451+0000 7f8ad5e00640 1 -- 172.21.15.42:0/1973294633 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad0157340 con 0x7f8ad00b3be0 2024-09-17T01:42:16.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.451+0000 7f8ad5e00640 1 --2- 172.21.15.42:0/1973294633 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8ad00b3be0 0x7f8ad01f34d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8ac400c730 tx=0x7f8ac400cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:16.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.452+0000 7f8aca000640 1 -- 172.21.15.42:0/1973294633 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4017070 con 0x7f8ad00b3be0 2024-09-17T01:42:16.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.452+0000 7f8aca000640 1 -- 172.21.15.42:0/1973294633 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ac4005360 con 0x7f8ad00b3be0 2024-09-17T01:42:16.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.452+0000 7f8aca000640 1 -- 172.21.15.42:0/1973294633 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac400a8a0 con 0x7f8ad00b3be0 2024-09-17T01:42:16.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.452+0000 7f8ad7200640 1 -- 172.21.15.42:0/1973294633 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad01fcd50 con 0x7f8ad00b3be0 2024-09-17T01:42:16.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.452+0000 7f8ad7200640 1 -- 172.21.15.42:0/1973294633 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad01fd2d0 con 0x7f8ad00b3be0 2024-09-17T01:42:16.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.457+0000 7f8aca000640 1 -- 172.21.15.42:0/1973294633 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8ac401a070 con 0x7f8ad00b3be0 2024-09-17T01:42:16.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.459+0000 7f8aca000640 1 --2- 172.21.15.42:0/1973294633 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ab4078b90 0x7f8ab407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.459+0000 7f8aca000640 1 -- 172.21.15.42:0/1973294633 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f8ac409a240 con 0x7f8ad00b3be0 2024-09-17T01:42:16.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.459+0000 7f8ad5400640 1 --2- 172.21.15.42:0/1973294633 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ab4078b90 0x7f8ab407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.460+0000 7f8adf830740 1 Processor -- start 2024-09-17T01:42:16.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.460+0000 7f8adf830740 1 -- start start 2024-09-17T01:42:16.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.460+0000 7f8ad5400640 1 --2- 172.21.15.42:0/1973294633 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ab4078b90 0x7f8ab407b0a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8ad015dbb0 tx=0x7f8ac0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:16.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.462+0000 7f8adf830740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f6b390 0x55f99a35a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.462+0000 7f8adf830740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f424d0 0x55f99a33d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.462+0000 7f8adf830740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f999f4a6b0 0x55f99a33da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.462+0000 7f8adf830740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f99a226c10 con 0x55f999f424d0 2024-09-17T01:42:16.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.462+0000 7f8adf830740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f99a2859f0 con 0x55f999f6b390 2024-09-17T01:42:16.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.462+0000 7f8adf830740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55f99a274e20 con 0x55f999f4a6b0 2024-09-17T01:42:16.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.463+0000 7f8ad5e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f6b390 0x55f99a35a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.463+0000 7f8ad5e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f6b390 0x55f99a35a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:44476/0 (socket says 172.21.15.42:44476) 2024-09-17T01:42:16.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.463+0000 7f8ad5e00640 1 -- 172.21.15.42:0/1164240648 learned_addr learned my addr 172.21.15.42:0/1164240648 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:16.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.463+0000 7f8ad6800640 1 --2- 172.21.15.42:0/1164240648 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f999f4a6b0 0x55f99a33da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.463+0000 7f8ad5400640 1 --2- 172.21.15.42:0/1164240648 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f424d0 0x55f99a33d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.463+0000 7f8ad5e00640 1 -- 172.21.15.42:0/1164240648 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f999f4a6b0 msgr2=0x55f99a33da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:16.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.463+0000 7f8ad5e00640 1 --2- 172.21.15.42:0/1164240648 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f999f4a6b0 0x55f99a33da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.463+0000 7f8ad5e00640 1 -- 172.21.15.42:0/1164240648 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f424d0 msgr2=0x55f99a33d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:16.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.463+0000 7f8ad5e00640 1 --2- 172.21.15.42:0/1164240648 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f424d0 0x55f99a33d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.463+0000 7f8ad5e00640 1 -- 172.21.15.42:0/1164240648 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f99a04d7d0 con 0x55f999f6b390 2024-09-17T01:42:16.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.464+0000 7f8ad5e00640 1 --2- 172.21.15.42:0/1164240648 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f6b390 0x55f99a35a860 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4061f50 tx=0x7f8ac4061ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64fd4d5e4fd12701 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:16.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.464+0000 7f8abe600640 1 -- 172.21.15.42:0/1164240648 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac40620b0 con 0x55f999f6b390 2024-09-17T01:42:16.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.464+0000 7f8abe600640 1 -- 172.21.15.42:0/1164240648 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ac4066ae0 con 0x55f999f6b390 2024-09-17T01:42:16.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.464+0000 7f8abe600640 1 -- 172.21.15.42:0/1164240648 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac406b990 con 0x55f999f6b390 2024-09-17T01:42:16.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.466+0000 7f8adf830740 1 -- 172.21.15.42:0/1164240648 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f6b390 msgr2=0x55f99a35a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.466+0000 7f8adf830740 1 --2- 172.21.15.42:0/1164240648 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f6b390 0x55f99a35a860 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4061f50 tx=0x7f8ac4061ac0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.466+0000 7f8adf830740 1 -- 172.21.15.42:0/1164240648 shutdown_connections 2024-09-17T01:42:16.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.466+0000 7f8adf830740 1 --2- 172.21.15.42:0/1164240648 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f999f4a6b0 0x55f99a33da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.466+0000 7f8adf830740 1 --2- 172.21.15.42:0/1164240648 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f424d0 0x55f99a33d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.466+0000 7f8adf830740 1 --2- 172.21.15.42:0/1164240648 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f6b390 0x55f99a35a860 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.466+0000 7f8adf830740 1 -- 172.21.15.42:0/1164240648 >> 172.21.15.42:0/1164240648 conn(0x55f999f5f4e0 msgr2=0x55f99a313750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:16.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.466+0000 7f8adf830740 1 -- 172.21.15.42:0/1164240648 shutdown_connections 2024-09-17T01:42:16.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.466+0000 7f8adf830740 1 -- 172.21.15.42:0/1164240648 wait complete. 2024-09-17T01:42:16.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.468+0000 7f8adf830740 1 -- start start 2024-09-17T01:42:16.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.468+0000 7f8adf830740 1 Processor -- start 2024-09-17T01:42:16.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.471+0000 7f8adf830740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f424d0 0x55f99a351a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.471+0000 7f8adf830740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f4a6b0 0x55f99a352900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.471+0000 7f8adf830740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f999f6b390 0x55f99a36ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.471+0000 7f8adf830740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f99a21a790 con 0x55f999f424d0 2024-09-17T01:42:16.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.471+0000 7f8adf830740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f99a278c30 con 0x55f999f4a6b0 2024-09-17T01:42:16.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.471+0000 7f8adf830740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55f999fe5740 con 0x55f999f6b390 2024-09-17T01:42:16.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.471+0000 7f8adf830740 10 client.0 _ll_register_callbacks cb 0x55f99a22a260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:42:16.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.471+0000 7f8ad5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f424d0 0x55f99a351a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.471+0000 7f8ad5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f424d0 0x55f99a351a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33654/0 (socket says 172.21.15.42:33654) 2024-09-17T01:42:16.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.472+0000 7f8ad5e00640 1 -- 172.21.15.42:0/3078167895 learned_addr learned my addr 172.21.15.42:0/3078167895 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:16.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.472+0000 7f8ad5400640 1 --2- 172.21.15.42:0/3078167895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f4a6b0 0x55f99a352900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.472+0000 7f8ad6800640 1 --2- 172.21.15.42:0/3078167895 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f999f6b390 0x55f99a36ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.472+0000 7f8ad5400640 1 -- 172.21.15.42:0/3078167895 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f999f6b390 msgr2=0x55f99a36ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.472+0000 7f8ad5400640 1 --2- 172.21.15.42:0/3078167895 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f999f6b390 0x55f99a36ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.472+0000 7f8ad5400640 1 -- 172.21.15.42:0/3078167895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f424d0 msgr2=0x55f99a351a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.472+0000 7f8ad5400640 1 --2- 172.21.15.42:0/3078167895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f424d0 0x55f99a351a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.472+0000 7f8ad5400640 1 -- 172.21.15.42:0/3078167895 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f999fb46a0 con 0x55f999f4a6b0 2024-09-17T01:42:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.472+0000 7f8ad5e00640 1 --2- 172.21.15.42:0/3078167895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f424d0 0x55f99a351a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:42:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.472+0000 7f8ad6800640 1 --2- 172.21.15.42:0/3078167895 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f999f6b390 0x55f99a36ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:42:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.473+0000 7f8ad5400640 1 --2- 172.21.15.42:0/3078167895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f4a6b0 0x55f99a352900 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0000f60 tx=0x7f8ac0000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=750c408f1a98ec2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.473+0000 7f8ab2a00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-17T01:42:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.473+0000 7f8ab2a00640 1 -- 172.21.15.42:0/3078167895 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0001d10 con 0x55f999f4a6b0 2024-09-17T01:42:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.473+0000 7f8ab2a00640 1 -- 172.21.15.42:0/3078167895 <== mon.1 v2:172.21.15.43:3300/0 2 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f8ac00135c0 con 0x55f999f4a6b0 2024-09-17T01:42:16.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.473+0000 7f8adf830740 1 -- 172.21.15.42:0/3078167895 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ac4066ae0 con 0x55f999f4a6b0 2024-09-17T01:42:16.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.474+0000 7f8ab2a00640 1 -- 172.21.15.42:0/3078167895 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7f8ac002e050 con 0x55f999f4a6b0 2024-09-17T01:42:16.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.474+0000 7f8adf830740 10 client.8068 fetch_fsmap learned FSMap version 107 2024-09-17T01:42:16.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.474+0000 7f8adf830740 1 -- 172.21.15.42:0/3078167895 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x55f99a0adf60 con 0x55f999f4a6b0 2024-09-17T01:42:16.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.475+0000 7f8ab2a00640 1 -- 172.21.15.42:0/3078167895 <== mon.1 v2:172.21.15.43:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ac4066ae0 con 0x55f999f4a6b0 2024-09-17T01:42:16.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.475+0000 7f8ab2a00640 1 -- 172.21.15.42:0/3078167895 <== mon.1 v2:172.21.15.43:3300/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7f8ac0031020 con 0x55f999f4a6b0 2024-09-17T01:42:16.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.475+0000 7f8adf830740 10 client.8068 fetch_fsmap finished waiting for FSMap version 107 2024-09-17T01:42:16.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.475+0000 7f8adf830740 10 client.8068 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-17T01:42:16.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.475+0000 7f8adf830740 20 client.8068 populate_metadata read hostname 'smithi042' 2024-09-17T01:42:16.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.475+0000 7f8adf830740 1 --2- 172.21.15.42:0/3078167895 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x55f999f29f60 0x55f99a3686d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.475+0000 7f8adf830740 4 client.8068 mds_command: new command op to 8442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:42:16.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.475+0000 7f8adf830740 1 -- 172.21.15.42:0/3078167895 --> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f99a287940 con 0x55f999f29f60 2024-09-17T01:42:16.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.475+0000 7f8ad5e00640 1 --2- 172.21.15.42:0/3078167895 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x55f999f29f60 0x55f99a3686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.476+0000 7f8ab2a00640 10 client.8068 ms_handle_connect on v2:172.21.15.42:6833/3060441721 2024-09-17T01:42:16.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.476+0000 7f8ad5e00640 1 --2- 172.21.15.42:0/3078167895 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x55f999f29f60 0x55f99a3686d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c237915693729e36 server_cookie=1610230b22991a76 in_seq=0 out_seq=0 2024-09-17T01:42:16.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.479+0000 7f8ab2a00640 1 -- 172.21.15.42:0/3078167895 <== mds.0 v2:172.21.15.42:6833/3060441721 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f99a287940 con 0x55f999f29f60 2024-09-17T01:42:16.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.479+0000 7f8ab2a00640 10 client.8068 handle_command_reply: tid=0 2024-09-17T01:42:16.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.479+0000 7f8adf830740 1 client.8068 shutdown 2024-09-17T01:42:16.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.480+0000 7f8adf830740 1 -- 172.21.15.42:0/3078167895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f4a6b0 msgr2=0x55f99a352900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.480+0000 7f8adf830740 1 --2- 172.21.15.42:0/3078167895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f4a6b0 0x55f99a352900 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0000f60 tx=0x7f8ac0000ed0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.480+0000 7f8adf830740 1 -- 172.21.15.42:0/3078167895 shutdown_connections 2024-09-17T01:42:16.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.480+0000 7f8adf830740 1 --2- 172.21.15.42:0/3078167895 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x55f999f29f60 0x55f99a3686d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.480+0000 7f8adf830740 1 --2- 172.21.15.42:0/3078167895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f4a6b0 0x55f99a352900 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.480+0000 7f8adf830740 1 --2- 172.21.15.42:0/3078167895 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f999f6b390 0x55f99a36ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.480+0000 7f8ab2a00640 0 client.8068 ms_handle_reset on v2:172.21.15.42:6833/3060441721 2024-09-17T01:42:16.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.480+0000 7f8adf830740 1 --2- 172.21.15.42:0/3078167895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f424d0 0x55f99a351a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.480+0000 7f8adf830740 1 -- 172.21.15.42:0/3078167895 >> 172.21.15.42:0/3078167895 conn(0x55f999f5f4e0 msgr2=0x55f99a35b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:16.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.480+0000 7f8adf830740 1 -- 172.21.15.42:0/3078167895 shutdown_connections 2024-09-17T01:42:16.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.480+0000 7f8adf830740 1 -- 172.21.15.42:0/3078167895 wait complete. 2024-09-17T01:42:16.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.480+0000 7f8adf830740 20 client.8068 trim_cache size 0 max 16384 2024-09-17T01:42:16.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.513+0000 7f8adf830740 1 Processor -- start 2024-09-17T01:42:16.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.513+0000 7f8adf830740 1 -- start start 2024-09-17T01:42:16.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.515+0000 7f8adf830740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f999f424d0 0x55f99a33d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.515+0000 7f8adf830740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f4a6b0 0x55f99a30ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.515+0000 7f8adf830740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f6b390 0x55f99a30cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.515+0000 7f8adf830740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad0206380 con 0x55f999f6b390 2024-09-17T01:42:16.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.515+0000 7f8adf830740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad0205360 con 0x55f999f4a6b0 2024-09-17T01:42:16.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.515+0000 7f8adf830740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8ad0155ea0 con 0x55f999f424d0 2024-09-17T01:42:16.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.516+0000 7f8ad5e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f999f424d0 0x55f99a33d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.516+0000 7f8ad5400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f4a6b0 0x55f99a30ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.516+0000 7f8ad5400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f4a6b0 0x55f99a30ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:44498/0 (socket says 172.21.15.42:44498) 2024-09-17T01:42:16.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.516+0000 7f8ad5e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f999f424d0 0x55f99a33d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:35602/0 (socket says 172.21.15.42:35602) 2024-09-17T01:42:16.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.516+0000 7f8ad5400640 1 -- 172.21.15.42:0/1102472478 learned_addr learned my addr 172.21.15.42:0/1102472478 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:16.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.516+0000 7f8ad6800640 1 --2- 172.21.15.42:0/1102472478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f6b390 0x55f99a30cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.516+0000 7f8ad5e00640 1 -- 172.21.15.42:0/1102472478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f4a6b0 msgr2=0x55f99a30ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:16.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.516+0000 7f8ad5e00640 1 --2- 172.21.15.42:0/1102472478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f4a6b0 0x55f99a30ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.516+0000 7f8ad5e00640 1 -- 172.21.15.42:0/1102472478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f6b390 msgr2=0x55f99a30cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:16.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.516+0000 7f8ad5e00640 1 --2- 172.21.15.42:0/1102472478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f6b390 0x55f99a30cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.516+0000 7f8ad5e00640 1 -- 172.21.15.42:0/1102472478 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f99a04bad0 con 0x55f999f424d0 2024-09-17T01:42:16.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.517+0000 7f8ad6800640 1 --2- 172.21.15.42:0/1102472478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f6b390 0x55f99a30cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:42:16.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.517+0000 7f8ad5e00640 1 --2- 172.21.15.42:0/1102472478 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f999f424d0 0x55f99a33d720 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4061f50 tx=0x7f8ac4084040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1dd08d4656bbc80 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:16.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.517+0000 7f8abdc00640 1 -- 172.21.15.42:0/1102472478 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac40881c0 con 0x55f999f424d0 2024-09-17T01:42:16.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.517+0000 7f8abdc00640 1 -- 172.21.15.42:0/1102472478 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ac406b500 con 0x55f999f424d0 2024-09-17T01:42:16.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.517+0000 7f8abdc00640 1 -- 172.21.15.42:0/1102472478 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4061310 con 0x55f999f424d0 2024-09-17T01:42:16.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.518+0000 7f8adf830740 1 -- 172.21.15.42:0/1102472478 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f999f424d0 msgr2=0x55f99a33d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.518+0000 7f8adf830740 1 --2- 172.21.15.42:0/1102472478 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f999f424d0 0x55f99a33d720 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4061f50 tx=0x7f8ac4084040 comp rx=0 tx=0).stop 2024-09-17T01:42:16.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.518+0000 7f8adf830740 1 -- 172.21.15.42:0/1102472478 shutdown_connections 2024-09-17T01:42:16.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.518+0000 7f8adf830740 1 --2- 172.21.15.42:0/1102472478 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f4a6b0 0x55f99a30ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.518+0000 7f8adf830740 1 --2- 172.21.15.42:0/1102472478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f6b390 0x55f99a30cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.518+0000 7f8adf830740 1 --2- 172.21.15.42:0/1102472478 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f999f424d0 0x55f99a33d720 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.518+0000 7f8adf830740 1 -- 172.21.15.42:0/1102472478 >> 172.21.15.42:0/1102472478 conn(0x55f999f5f4e0 msgr2=0x55f99a30d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:16.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.518+0000 7f8adf830740 1 -- 172.21.15.42:0/1102472478 shutdown_connections 2024-09-17T01:42:16.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.518+0000 7f8adf830740 1 -- 172.21.15.42:0/1102472478 wait complete. 2024-09-17T01:42:16.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.520+0000 7f8adf830740 1 -- start start 2024-09-17T01:42:16.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.520+0000 7f8adf830740 1 Processor -- start 2024-09-17T01:42:16.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.522+0000 7f8adf830740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f999f424d0 0x55f99a3bcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.522+0000 7f8adf830740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f4a6b0 0x55f99a3668c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.522+0000 7f8adf830740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f6b390 0x55f99a366e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.522+0000 7f8adf830740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad0204e40 con 0x55f999f6b390 2024-09-17T01:42:16.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.522+0000 7f8adf830740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f99a3587c0 con 0x55f999f4a6b0 2024-09-17T01:42:16.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.522+0000 7f8adf830740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55f99a3bd040 con 0x55f999f424d0 2024-09-17T01:42:16.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.522+0000 7f8adf830740 10 client.0 _ll_register_callbacks cb 0x7f8ac0017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:42:16.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.522+0000 7f8ad6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f6b390 0x55f99a366e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.522+0000 7f8ad6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f6b390 0x55f99a366e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33670/0 (socket says 172.21.15.42:33670) 2024-09-17T01:42:16.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.522+0000 7f8ad6800640 1 -- 172.21.15.42:0/3090521112 learned_addr learned my addr 172.21.15.42:0/3090521112 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:16.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.523+0000 7f8ad5e00640 1 --2- 172.21.15.42:0/3090521112 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f999f424d0 0x55f99a3bcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.523+0000 7f8ad5400640 1 --2- 172.21.15.42:0/3090521112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f4a6b0 0x55f99a3668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.523+0000 7f8ad6800640 1 -- 172.21.15.42:0/3090521112 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f999f424d0 msgr2=0x55f99a3bcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:16.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.523+0000 7f8ad6800640 1 --2- 172.21.15.42:0/3090521112 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f999f424d0 0x55f99a3bcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.523+0000 7f8ad6800640 1 -- 172.21.15.42:0/3090521112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f4a6b0 msgr2=0x55f99a3668c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:16.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.523+0000 7f8ad6800640 1 --2- 172.21.15.42:0/3090521112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f4a6b0 0x55f99a3668c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.523+0000 7f8ad6800640 1 -- 172.21.15.42:0/3090521112 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f99a351b70 con 0x55f999f6b390 2024-09-17T01:42:16.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.523+0000 7f8ad5400640 1 --2- 172.21.15.42:0/3090521112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f4a6b0 0x55f99a3668c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:42:16.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.524+0000 7f8ad6800640 1 --2- 172.21.15.42:0/3090521112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f6b390 0x55f99a366e00 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f8acc009b30 tx=0x7f8acc004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad649965999606e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:16.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.524+0000 7f8ab2a00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:42:16.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.524+0000 7f8ab2a00640 1 -- 172.21.15.42:0/3090521112 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc036040 con 0x55f999f6b390 2024-09-17T01:42:16.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.524+0000 7f8ab2a00640 1 -- 172.21.15.42:0/3090521112 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f8acc0045d0 con 0x55f999f6b390 2024-09-17T01:42:16.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.524+0000 7f8adf830740 1 -- 172.21.15.42:0/3090521112 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ac406b500 con 0x55f999f6b390 2024-09-17T01:42:16.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.525+0000 7f8ab2a00640 1 -- 172.21.15.42:0/3090521112 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7f8acc0047d0 con 0x55f999f6b390 2024-09-17T01:42:16.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.525+0000 7f8adf830740 10 client.8634 fetch_fsmap learned FSMap version 107 2024-09-17T01:42:16.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.525+0000 7f8adf830740 1 -- 172.21.15.42:0/3090521112 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x55f99a3bfab0 con 0x55f999f6b390 2024-09-17T01:42:16.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.525+0000 7f8ab2a00640 1 -- 172.21.15.42:0/3090521112 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ac406b500 con 0x55f999f6b390 2024-09-17T01:42:16.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.525+0000 7f8ab2a00640 1 -- 172.21.15.42:0/3090521112 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7f8acc031530 con 0x55f999f6b390 2024-09-17T01:42:16.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.525+0000 7f8adf830740 10 client.8634 fetch_fsmap finished waiting for FSMap version 107 2024-09-17T01:42:16.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.525+0000 7f8adf830740 10 client.8634 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-17T01:42:16.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.525+0000 7f8adf830740 20 client.8634 populate_metadata read hostname 'smithi042' 2024-09-17T01:42:16.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.525+0000 7f8adf830740 1 --2- 172.21.15.42:0/3090521112 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x55f99a32cb90 0x55f99a3da8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.525+0000 7f8adf830740 4 client.8634 mds_command: new command op to 8442 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-17T01:42:16.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.525+0000 7f8adf830740 1 -- 172.21.15.42:0/3090521112 --> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x55f99a2833f0 con 0x55f99a32cb90 2024-09-17T01:42:16.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.526+0000 7f8ad5e00640 1 --2- 172.21.15.42:0/3090521112 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x55f99a32cb90 0x55f99a3da8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.526+0000 7f8ad5e00640 1 --2- 172.21.15.42:0/3090521112 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x55f99a32cb90 0x55f99a3da8a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6b7ddb04799dd13 server_cookie=c33a8c3764b212e in_seq=0 out_seq=0 2024-09-17T01:42:16.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.526+0000 7f8ab2a00640 10 client.8634 ms_handle_connect on v2:172.21.15.42:6833/3060441721 2024-09-17T01:42:16.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.543+0000 7f8ab2a00640 1 -- 172.21.15.42:0/3090521112 <== mds.0 v2:172.21.15.42:6833/3060441721 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f99a2833f0 con 0x55f99a32cb90 2024-09-17T01:42:16.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.543+0000 7f8ab2a00640 10 client.8634 handle_command_reply: tid=0 2024-09-17T01:42:16.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.543+0000 7f8adf830740 1 client.8634 shutdown 2024-09-17T01:42:16.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.543+0000 7f8adf830740 1 -- 172.21.15.42:0/3090521112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f6b390 msgr2=0x55f99a366e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.543+0000 7f8adf830740 1 --2- 172.21.15.42:0/3090521112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f6b390 0x55f99a366e00 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f8acc009b30 tx=0x7f8acc004290 comp rx=0 tx=0).stop 2024-09-17T01:42:16.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.543+0000 7f8adf830740 1 -- 172.21.15.42:0/3090521112 shutdown_connections 2024-09-17T01:42:16.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.543+0000 7f8adf830740 1 --2- 172.21.15.42:0/3090521112 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x55f99a32cb90 0x55f99a3da8a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.543+0000 7f8adf830740 1 --2- 172.21.15.42:0/3090521112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f999f4a6b0 0x55f99a3668c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.543+0000 7f8adf830740 1 --2- 172.21.15.42:0/3090521112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f999f6b390 0x55f99a366e00 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.543+0000 7f8adf830740 1 --2- 172.21.15.42:0/3090521112 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f999f424d0 0x55f99a3bcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.544+0000 7f8ab2a00640 0 client.8634 ms_handle_reset on v2:172.21.15.42:6833/3060441721 2024-09-17T01:42:16.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.544+0000 7f8adf830740 1 -- 172.21.15.42:0/3090521112 >> 172.21.15.42:0/3090521112 conn(0x55f999f5f4e0 msgr2=0x55f99a357db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:16.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.544+0000 7f8adf830740 1 -- 172.21.15.42:0/3090521112 shutdown_connections 2024-09-17T01:42:16.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.544+0000 7f8adf830740 1 -- 172.21.15.42:0/3090521112 wait complete. 2024-09-17T01:42:16.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.545+0000 7f8adf830740 20 client.8634 trim_cache size 0 max 16384 2024-09-17T01:42:16.544 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:42:16.544 INFO:teuthology.orchestra.run.smithi042.stdout: "message": "", 2024-09-17T01:42:16.544 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0 2024-09-17T01:42:16.544 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:42:16.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.546+0000 7f8ad7200640 1 -- 172.21.15.42:0/1973294633 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ab4078b90 msgr2=0x7f8ab407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.546+0000 7f8ad7200640 1 --2- 172.21.15.42:0/1973294633 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ab4078b90 0x7f8ab407b0a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8ad015dbb0 tx=0x7f8ac0009040 comp rx=0 tx=0).stop 2024-09-17T01:42:16.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.546+0000 7f8ad7200640 1 -- 172.21.15.42:0/1973294633 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8ad00b3be0 msgr2=0x7f8ad01f34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.546+0000 7f8ad7200640 1 --2- 172.21.15.42:0/1973294633 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8ad00b3be0 0x7f8ad01f34d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8ac400c730 tx=0x7f8ac400cbf0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.546+0000 7f8ad7200640 1 -- 172.21.15.42:0/1973294633 shutdown_connections 2024-09-17T01:42:16.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.546+0000 7f8ad7200640 1 --2- 172.21.15.42:0/1973294633 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ab4078b90 0x7f8ab407b0a0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.546+0000 7f8ad7200640 1 --2- 172.21.15.42:0/1973294633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad00d40b0 0x7f8ad0156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.546+0000 7f8ad7200640 1 --2- 172.21.15.42:0/1973294633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ad0156d60 0x7f8ad01610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.546+0000 7f8ad7200640 1 --2- 172.21.15.42:0/1973294633 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8ad00b3be0 0x7f8ad01f34d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.546+0000 7f8ad7200640 1 -- 172.21.15.42:0/1973294633 >> 172.21.15.42:0/1973294633 conn(0x7f8ad00b61c0 msgr2=0x7f8ad00b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:16.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.546+0000 7f8ad7200640 1 -- 172.21.15.42:0/1973294633 shutdown_connections 2024-09-17T01:42:16.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.546+0000 7f8ad7200640 1 -- 172.21.15.42:0/1973294633 wait complete. 2024-09-17T01:42:16.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:42:16.566 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub status 2024-09-17T01:42:16.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.798+0000 7f1fdac00640 1 -- 172.21.15.42:0/2805074927 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1fd406d430 msgr2=0x7f1fd406d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.798+0000 7f1fdac00640 1 --2- 172.21.15.42:0/2805074927 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1fd406d430 0x7f1fd406d840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc009830 tx=0x7f1fbc02a510 comp rx=0 tx=0).stop 2024-09-17T01:42:16.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.798+0000 7f1fdac00640 1 -- 172.21.15.42:0/2805074927 shutdown_connections 2024-09-17T01:42:16.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.798+0000 7f1fdac00640 1 --2- 172.21.15.42:0/2805074927 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1fd406d430 0x7f1fd406d840 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.798+0000 7f1fdac00640 1 --2- 172.21.15.42:0/2805074927 >> v2:172.21.15.43:3300/0 conn(0x7f1fd415cb80 0x7f1fd4152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.799+0000 7f1fdac00640 1 -- 172.21.15.42:0/2805074927 >> 172.21.15.42:0/2805074927 conn(0x7f1fd40b2930 msgr2=0x7f1fd406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:16.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.799+0000 7f1fdac00640 1 -- 172.21.15.42:0/2805074927 shutdown_connections 2024-09-17T01:42:16.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.799+0000 7f1fdac00640 1 -- 172.21.15.42:0/2805074927 wait complete. 2024-09-17T01:42:16.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.801+0000 7f1fdac00640 1 Processor -- start 2024-09-17T01:42:16.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.801+0000 7f1fdac00640 1 -- start start 2024-09-17T01:42:16.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.803+0000 7f1fdac00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1fd406d430 0x7f1fd414fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.803+0000 7f1fdac00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1fd415cb80 0x7f1fd414b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.803+0000 7f1fdac00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fd415f480 0x7f1fd41f6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.803+0000 7f1fdac00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd40737e0 con 0x7f1fd415cb80 2024-09-17T01:42:16.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.803+0000 7f1fdac00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd4073660 con 0x7f1fd415f480 2024-09-17T01:42:16.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.803+0000 7f1fdac00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1fd4073960 con 0x7f1fd406d430 2024-09-17T01:42:16.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.803+0000 7f1fcb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1fd415cb80 0x7f1fd414b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.803+0000 7f1fcb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1fd415cb80 0x7f1fd414b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33678/0 (socket says 172.21.15.42:33678) 2024-09-17T01:42:16.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.803+0000 7f1fcb400640 1 -- 172.21.15.42:0/1471854732 learned_addr learned my addr 172.21.15.42:0/1471854732 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:16.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.803+0000 7f1fd3e00640 1 --2- 172.21.15.42:0/1471854732 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1fd406d430 0x7f1fd414fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.803+0000 7f1fd8c00640 1 --2- 172.21.15.42:0/1471854732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fd415f480 0x7f1fd41f6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.803+0000 7f1fcb400640 1 -- 172.21.15.42:0/1471854732 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1fd406d430 msgr2=0x7f1fd414fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.803+0000 7f1fcb400640 1 --2- 172.21.15.42:0/1471854732 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1fd406d430 0x7f1fd414fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.803+0000 7f1fcb400640 1 -- 172.21.15.42:0/1471854732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fd415f480 msgr2=0x7f1fd41f6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.803+0000 7f1fcb400640 1 --2- 172.21.15.42:0/1471854732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fd415f480 0x7f1fd41f6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.803+0000 7f1fcb400640 1 -- 172.21.15.42:0/1471854732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fd414bbe0 con 0x7f1fd415cb80 2024-09-17T01:42:16.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.804+0000 7f1fcb400640 1 --2- 172.21.15.42:0/1471854732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1fd415cb80 0x7f1fd414b6a0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc009950 tx=0x7f1fbc0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:16.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.804+0000 7f1fd0c00640 1 -- 172.21.15.42:0/1471854732 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc005220 con 0x7f1fd415cb80 2024-09-17T01:42:16.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.804+0000 7f1fdac00640 1 -- 172.21.15.42:0/1471854732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fd414c740 con 0x7f1fd415cb80 2024-09-17T01:42:16.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.804+0000 7f1fd0c00640 1 -- 172.21.15.42:0/1471854732 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fbc0054b0 con 0x7f1fd415cb80 2024-09-17T01:42:16.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.804+0000 7f1fd0c00640 1 -- 172.21.15.42:0/1471854732 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc004a00 con 0x7f1fd415cb80 2024-09-17T01:42:16.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.804+0000 7f1fdac00640 1 -- 172.21.15.42:0/1471854732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fd414cd00 con 0x7f1fd415cb80 2024-09-17T01:42:16.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.806+0000 7f1fd0c00640 1 -- 172.21.15.42:0/1471854732 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1fbc004ba0 con 0x7f1fd415cb80 2024-09-17T01:42:16.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.807+0000 7f1fd0c00640 1 --2- 172.21.15.42:0/1471854732 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1fb0078bc0 0x7f1fb007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.808+0000 7f1fd0c00640 1 -- 172.21.15.42:0/1471854732 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f1fbc0bc040 con 0x7f1fd415cb80 2024-09-17T01:42:16.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.808+0000 7f1fd3e00640 1 --2- 172.21.15.42:0/1471854732 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1fb0078bc0 0x7f1fb007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.808+0000 7f1fe1ca0740 1 Processor -- start 2024-09-17T01:42:16.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.808+0000 7f1fe1ca0740 1 -- start start 2024-09-17T01:42:16.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.809+0000 7f1fd3e00640 1 --2- 172.21.15.42:0/1471854732 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1fb0078bc0 0x7f1fb007b0d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4009b30 tx=0x7f1fc4005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:16.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.810+0000 7f1fe1ca0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b513390 0x55e45b901550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.810+0000 7f1fe1ca0740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e45b4ea4d0 0x55e45b8e4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.810+0000 7f1fe1ca0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e45b4f26b0 0x55e45b8e4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.810+0000 7f1fe1ca0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e45b81a1c0 con 0x55e45b513390 2024-09-17T01:42:16.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.810+0000 7f1fe1ca0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e45b82d870 con 0x55e45b4f26b0 2024-09-17T01:42:16.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.810+0000 7f1fe1ca0740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55e45b81cca0 con 0x55e45b4ea4d0 2024-09-17T01:42:16.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.810+0000 7f1fd3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b513390 0x55e45b901550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.810+0000 7f1fd3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b513390 0x55e45b901550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33680/0 (socket says 172.21.15.42:33680) 2024-09-17T01:42:16.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.810+0000 7f1fd3e00640 1 -- 172.21.15.42:0/242388590 learned_addr learned my addr 172.21.15.42:0/242388590 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:16.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.811+0000 7f1fd3e00640 1 -- 172.21.15.42:0/242388590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e45b4ea4d0 msgr2=0x55e45b8e4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:16.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.811+0000 7f1fcb400640 1 --2- 172.21.15.42:0/242388590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e45b4ea4d0 0x55e45b8e4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.811+0000 7f1fd8c00640 1 --2- 172.21.15.42:0/242388590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e45b4f26b0 0x55e45b8e4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.811+0000 7f1fd3e00640 1 --2- 172.21.15.42:0/242388590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e45b4ea4d0 0x55e45b8e4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.811+0000 7f1fd3e00640 1 -- 172.21.15.42:0/242388590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e45b4f26b0 msgr2=0x55e45b8e4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:16.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.811+0000 7f1fd3e00640 1 --2- 172.21.15.42:0/242388590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e45b4f26b0 0x55e45b8e4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.811+0000 7f1fd3e00640 1 -- 172.21.15.42:0/242388590 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e45b5f57d0 con 0x55e45b513390 2024-09-17T01:42:16.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.811+0000 7f1fd8c00640 1 --2- 172.21.15.42:0/242388590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e45b4f26b0 0x55e45b8e4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:42:16.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.811+0000 7f1fcb400640 1 --2- 172.21.15.42:0/242388590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e45b4ea4d0 0x55e45b8e4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:42:16.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.811+0000 7f1fd3e00640 1 --2- 172.21.15.42:0/242388590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b513390 0x55e45b901550 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4011ec0 tx=0x7f1fc4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3826697fe3424d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:16.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.811+0000 7f1fc3e00640 1 -- 172.21.15.42:0/242388590 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc400ebf0 con 0x55e45b513390 2024-09-17T01:42:16.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.811+0000 7f1fc3e00640 1 -- 172.21.15.42:0/242388590 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fc4004020 con 0x55e45b513390 2024-09-17T01:42:16.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.811+0000 7f1fc3e00640 1 -- 172.21.15.42:0/242388590 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc40043d0 con 0x55e45b513390 2024-09-17T01:42:16.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.812+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/242388590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b513390 msgr2=0x55e45b901550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.812+0000 7f1fe1ca0740 1 --2- 172.21.15.42:0/242388590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b513390 0x55e45b901550 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4011ec0 tx=0x7f1fc4014000 comp rx=0 tx=0).stop 2024-09-17T01:42:16.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.812+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/242388590 shutdown_connections 2024-09-17T01:42:16.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.812+0000 7f1fe1ca0740 1 --2- 172.21.15.42:0/242388590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e45b4f26b0 0x55e45b8e4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.812+0000 7f1fe1ca0740 1 --2- 172.21.15.42:0/242388590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e45b4ea4d0 0x55e45b8e4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.812+0000 7f1fe1ca0740 1 --2- 172.21.15.42:0/242388590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b513390 0x55e45b901550 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.812+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/242388590 >> 172.21.15.42:0/242388590 conn(0x55e45b5074e0 msgr2=0x55e45b8ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:16.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.812+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/242388590 shutdown_connections 2024-09-17T01:42:16.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.812+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/242388590 wait complete. 2024-09-17T01:42:16.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.813+0000 7f1fe1ca0740 1 -- start start 2024-09-17T01:42:16.813 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.814+0000 7f1fe1ca0740 1 Processor -- start 2024-09-17T01:42:16.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.815+0000 7f1fe1ca0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b4ea4d0 0x55e45b8fc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.815+0000 7f1fe1ca0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e45b4f26b0 0x55e45b912510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.815+0000 7f1fe1ca0740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e45b513390 0x55e45b9163a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.815+0000 7f1fe1ca0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e45b7c3410 con 0x55e45b4ea4d0 2024-09-17T01:42:16.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.815+0000 7f1fe1ca0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e45b820ab0 con 0x55e45b4f26b0 2024-09-17T01:42:16.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.815+0000 7f1fe1ca0740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55e45b58d740 con 0x55e45b513390 2024-09-17T01:42:16.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.815+0000 7f1fe1ca0740 10 client.0 _ll_register_callbacks cb 0x55e45b7a0360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:42:16.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.815+0000 7f1fd3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b4ea4d0 0x55e45b8fc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.816+0000 7f1fd3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b4ea4d0 0x55e45b8fc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33686/0 (socket says 172.21.15.42:33686) 2024-09-17T01:42:16.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.816+0000 7f1fd3e00640 1 -- 172.21.15.42:0/1178016887 learned_addr learned my addr 172.21.15.42:0/1178016887 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:16.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.816+0000 7f1fd8c00640 1 --2- 172.21.15.42:0/1178016887 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e45b513390 0x55e45b9163a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.816+0000 7f1fcb400640 1 --2- 172.21.15.42:0/1178016887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e45b4f26b0 0x55e45b912510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.816+0000 7f1fd3e00640 1 -- 172.21.15.42:0/1178016887 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e45b513390 msgr2=0x55e45b9163a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:16.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.816+0000 7f1fd3e00640 1 --2- 172.21.15.42:0/1178016887 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e45b513390 0x55e45b9163a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.816+0000 7f1fd3e00640 1 -- 172.21.15.42:0/1178016887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e45b4f26b0 msgr2=0x55e45b912510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:16.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.816+0000 7f1fd3e00640 1 --2- 172.21.15.42:0/1178016887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e45b4f26b0 0x55e45b912510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.816+0000 7f1fd3e00640 1 -- 172.21.15.42:0/1178016887 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e45b57e970 con 0x55e45b4ea4d0 2024-09-17T01:42:16.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.816+0000 7f1fd3e00640 1 --2- 172.21.15.42:0/1178016887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b4ea4d0 0x55e45b8fc460 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400eb00 tx=0x7f1fc400eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b649e1e4837c6b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:16.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.816+0000 7f1fc0c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:42:16.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.817+0000 7f1fc0c00640 1 -- 172.21.15.42:0/1178016887 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4035060 con 0x55e45b4ea4d0 2024-09-17T01:42:16.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.817+0000 7f1fc0c00640 1 -- 172.21.15.42:0/1178016887 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f1fc40043e0 con 0x55e45b4ea4d0 2024-09-17T01:42:16.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.817+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/1178016887 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fc4004020 con 0x55e45b4ea4d0 2024-09-17T01:42:16.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.817+0000 7f1fc0c00640 1 -- 172.21.15.42:0/1178016887 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7f1fc40035f0 con 0x55e45b4ea4d0 2024-09-17T01:42:16.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.817+0000 7f1fe1ca0740 10 client.8646 fetch_fsmap learned FSMap version 107 2024-09-17T01:42:16.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.817+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/1178016887 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x55e45b55c6a0 con 0x55e45b4ea4d0 2024-09-17T01:42:16.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.817+0000 7f1fc0c00640 1 -- 172.21.15.42:0/1178016887 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fc4004020 con 0x55e45b4ea4d0 2024-09-17T01:42:16.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.817+0000 7f1fc0c00640 1 -- 172.21.15.42:0/1178016887 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7f1fc4003880 con 0x55e45b4ea4d0 2024-09-17T01:42:16.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.817+0000 7f1fe1ca0740 10 client.8646 fetch_fsmap finished waiting for FSMap version 107 2024-09-17T01:42:16.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.817+0000 7f1fe1ca0740 10 client.8646 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-17T01:42:16.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.817+0000 7f1fe1ca0740 20 client.8646 populate_metadata read hostname 'smithi042' 2024-09-17T01:42:16.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.817+0000 7f1fe1ca0740 1 --2- 172.21.15.42:0/1178016887 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x55e45b4d1f60 0x55e45b8f6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.817+0000 7f1fe1ca0740 4 client.8646 mds_command: new command op to 8442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:42:16.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.817+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/1178016887 --> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e45b82f7c0 con 0x55e45b4d1f60 2024-09-17T01:42:16.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.818+0000 7f1fcb400640 1 --2- 172.21.15.42:0/1178016887 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x55e45b4d1f60 0x55e45b8f6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.818+0000 7f1fcb400640 1 --2- 172.21.15.42:0/1178016887 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x55e45b4d1f60 0x55e45b8f6490 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac48832d6818f190 server_cookie=3a81ff0aef17197e in_seq=0 out_seq=0 2024-09-17T01:42:16.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.818+0000 7f1fc0c00640 10 client.8646 ms_handle_connect on v2:172.21.15.42:6833/3060441721 2024-09-17T01:42:16.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.819+0000 7f1fc0c00640 1 -- 172.21.15.42:0/1178016887 <== mds.0 v2:172.21.15.42:6833/3060441721 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e45b82f7c0 con 0x55e45b4d1f60 2024-09-17T01:42:16.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.819+0000 7f1fc0c00640 10 client.8646 handle_command_reply: tid=0 2024-09-17T01:42:16.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.819+0000 7f1fe1ca0740 1 client.8646 shutdown 2024-09-17T01:42:16.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.819+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/1178016887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b4ea4d0 msgr2=0x55e45b8fc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.819+0000 7f1fe1ca0740 1 --2- 172.21.15.42:0/1178016887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b4ea4d0 0x55e45b8fc460 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400eb00 tx=0x7f1fc400eb30 comp rx=0 tx=0).stop 2024-09-17T01:42:16.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.819+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/1178016887 shutdown_connections 2024-09-17T01:42:16.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.819+0000 7f1fe1ca0740 1 --2- 172.21.15.42:0/1178016887 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x55e45b4d1f60 0x55e45b8f6490 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.819+0000 7f1fe1ca0740 1 --2- 172.21.15.42:0/1178016887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e45b4f26b0 0x55e45b912510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.819+0000 7f1fe1ca0740 1 --2- 172.21.15.42:0/1178016887 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e45b513390 0x55e45b9163a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.819+0000 7f1fe1ca0740 1 --2- 172.21.15.42:0/1178016887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b4ea4d0 0x55e45b8fc460 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.819+0000 7f1fc0c00640 0 client.8646 ms_handle_reset on v2:172.21.15.42:6833/3060441721 2024-09-17T01:42:16.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.819+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/1178016887 >> 172.21.15.42:0/1178016887 conn(0x55e45b5074e0 msgr2=0x55e45b8b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:16.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.820+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/1178016887 shutdown_connections 2024-09-17T01:42:16.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.820+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/1178016887 wait complete. 2024-09-17T01:42:16.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.820+0000 7f1fe1ca0740 20 client.8646 trim_cache size 0 max 16384 2024-09-17T01:42:16.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.838+0000 7f1fe1ca0740 1 Processor -- start 2024-09-17T01:42:16.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.838+0000 7f1fe1ca0740 1 -- start start 2024-09-17T01:42:16.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.840+0000 7f1fe1ca0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e45b4ea4d0 0x55e45b8bb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.840+0000 7f1fe1ca0740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e45b4f26b0 0x55e45b9273b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.840+0000 7f1fe1ca0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b513390 0x55e45b9278f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.840+0000 7f1fe1ca0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd41fe0e0 con 0x55e45b513390 2024-09-17T01:42:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.840+0000 7f1fe1ca0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd41551c0 con 0x55e45b4ea4d0 2024-09-17T01:42:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.840+0000 7f1fe1ca0740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1fd4154520 con 0x55e45b4f26b0 2024-09-17T01:42:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.840+0000 7f1fd8c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b513390 0x55e45b9278f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.840+0000 7f1fd8c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b513390 0x55e45b9278f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33702/0 (socket says 172.21.15.42:33702) 2024-09-17T01:42:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.840+0000 7f1fd8c00640 1 -- 172.21.15.42:0/4250098388 learned_addr learned my addr 172.21.15.42:0/4250098388 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.840+0000 7f1fcb400640 1 --2- 172.21.15.42:0/4250098388 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e45b4f26b0 0x55e45b9273b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.840+0000 7f1fd3e00640 1 --2- 172.21.15.42:0/4250098388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e45b4ea4d0 0x55e45b8bb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.841+0000 7f1fd8c00640 1 -- 172.21.15.42:0/4250098388 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e45b4f26b0 msgr2=0x55e45b9273b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.841+0000 7f1fd8c00640 1 --2- 172.21.15.42:0/4250098388 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e45b4f26b0 0x55e45b9273b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.841+0000 7f1fd8c00640 1 -- 172.21.15.42:0/4250098388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e45b4ea4d0 msgr2=0x55e45b8bb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:16.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.841+0000 7f1fd8c00640 1 --2- 172.21.15.42:0/4250098388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e45b4ea4d0 0x55e45b8bb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.841+0000 7f1fd8c00640 1 -- 172.21.15.42:0/4250098388 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e45b8b6fa0 con 0x55e45b513390 2024-09-17T01:42:16.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.841+0000 7f1fd8c00640 1 --2- 172.21.15.42:0/4250098388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b513390 0x55e45b9278f0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0021a0 tx=0x7f1fcc0136a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c210f658c70c8f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:16.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.841+0000 7f1fc3400640 1 -- 172.21.15.42:0/4250098388 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc01a030 con 0x55e45b513390 2024-09-17T01:42:16.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.841+0000 7f1fc3400640 1 -- 172.21.15.42:0/4250098388 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fcc004a40 con 0x55e45b513390 2024-09-17T01:42:16.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.841+0000 7f1fc3400640 1 -- 172.21.15.42:0/4250098388 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc004c90 con 0x55e45b513390 2024-09-17T01:42:16.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.842+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/4250098388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b513390 msgr2=0x55e45b9278f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.842+0000 7f1fe1ca0740 1 --2- 172.21.15.42:0/4250098388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b513390 0x55e45b9278f0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0021a0 tx=0x7f1fcc0136a0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.842+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/4250098388 shutdown_connections 2024-09-17T01:42:16.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.842+0000 7f1fe1ca0740 1 --2- 172.21.15.42:0/4250098388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b513390 0x55e45b9278f0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.842+0000 7f1fe1ca0740 1 --2- 172.21.15.42:0/4250098388 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e45b4f26b0 0x55e45b9273b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.842+0000 7f1fe1ca0740 1 --2- 172.21.15.42:0/4250098388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e45b4ea4d0 0x55e45b8bb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.842+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/4250098388 >> 172.21.15.42:0/4250098388 conn(0x55e45b5074e0 msgr2=0x55e45b8e3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:16.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.842+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/4250098388 shutdown_connections 2024-09-17T01:42:16.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.842+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/4250098388 wait complete. 2024-09-17T01:42:16.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.843+0000 7f1fe1ca0740 1 -- start start 2024-09-17T01:42:16.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.843+0000 7f1fe1ca0740 1 Processor -- start 2024-09-17T01:42:16.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.845+0000 7f1fe1ca0740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e45b4ea4d0 0x55e45b981c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.845+0000 7f1fe1ca0740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b4f26b0 0x55e45b8feab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.845+0000 7f1fe1ca0740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e45b513390 0x55e45b8e2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.845+0000 7f1fe1ca0740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e45b8b6460 con 0x55e45b4f26b0 2024-09-17T01:42:16.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.845+0000 7f1fe1ca0740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1fd4154b70 con 0x55e45b4ea4d0 2024-09-17T01:42:16.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.845+0000 7f1fe1ca0740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55e45b8e0960 con 0x55e45b513390 2024-09-17T01:42:16.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.845+0000 7f1fe1ca0740 10 client.0 _ll_register_callbacks cb 0x7f1fc4011d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:42:16.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.845+0000 7f1fcb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b4f26b0 0x55e45b8feab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.845+0000 7f1fcb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b4f26b0 0x55e45b8feab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33708/0 (socket says 172.21.15.42:33708) 2024-09-17T01:42:16.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.845+0000 7f1fcb400640 1 -- 172.21.15.42:0/1676086857 learned_addr learned my addr 172.21.15.42:0/1676086857 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:16.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.845+0000 7f1fd3e00640 1 --2- 172.21.15.42:0/1676086857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e45b4ea4d0 0x55e45b981c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.845+0000 7f1fd8c00640 1 --2- 172.21.15.42:0/1676086857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e45b513390 0x55e45b8e2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.845+0000 7f1fcb400640 1 -- 172.21.15.42:0/1676086857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e45b513390 msgr2=0x55e45b8e2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:16.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.845+0000 7f1fcb400640 1 --2- 172.21.15.42:0/1676086857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e45b513390 0x55e45b8e2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.845+0000 7f1fcb400640 1 -- 172.21.15.42:0/1676086857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e45b4ea4d0 msgr2=0x55e45b981c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:16.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.845+0000 7f1fcb400640 1 --2- 172.21.15.42:0/1676086857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e45b4ea4d0 0x55e45b981c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.846+0000 7f1fcb400640 1 -- 172.21.15.42:0/1676086857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e45b90c5a0 con 0x55e45b4f26b0 2024-09-17T01:42:16.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.846+0000 7f1fcb400640 1 --2- 172.21.15.42:0/1676086857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b4f26b0 0x55e45b8feab0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc083aa0 tx=0x7f1fbc005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac67571cb79b342 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:16.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.846+0000 7f1fc0c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:42:16.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.846+0000 7f1fc0c00640 1 -- 172.21.15.42:0/1676086857 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc048040 con 0x55e45b4f26b0 2024-09-17T01:42:16.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.846+0000 7f1fc0c00640 1 -- 172.21.15.42:0/1676086857 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f1fbc084000 con 0x55e45b4f26b0 2024-09-17T01:42:16.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.846+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/1676086857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fcc004a40 con 0x55e45b4f26b0 2024-09-17T01:42:16.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.846+0000 7f1fc0c00640 1 -- 172.21.15.42:0/1676086857 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7f1fbc0838b0 con 0x55e45b4f26b0 2024-09-17T01:42:16.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.846+0000 7f1fe1ca0740 10 client.8652 fetch_fsmap learned FSMap version 107 2024-09-17T01:42:16.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.846+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/1676086857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x55e45b8fb110 con 0x55e45b4f26b0 2024-09-17T01:42:16.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.846+0000 7f1fc0c00640 1 -- 172.21.15.42:0/1676086857 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fcc004a40 con 0x55e45b4f26b0 2024-09-17T01:42:16.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.847+0000 7f1fc0c00640 1 -- 172.21.15.42:0/1676086857 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7f1fbc08d1f0 con 0x55e45b4f26b0 2024-09-17T01:42:16.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.847+0000 7f1fe1ca0740 10 client.8652 fetch_fsmap finished waiting for FSMap version 107 2024-09-17T01:42:16.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.847+0000 7f1fe1ca0740 10 client.8652 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-17T01:42:16.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.847+0000 7f1fe1ca0740 20 client.8652 populate_metadata read hostname 'smithi042' 2024-09-17T01:42:16.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.847+0000 7f1fe1ca0740 1 --2- 172.21.15.42:0/1676086857 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x55e45b8b02c0 0x55e45b8e2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:16.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.847+0000 7f1fe1ca0740 4 client.8652 mds_command: new command op to 8442 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:42:16.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.847+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/1676086857 --> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e45b8e3530 con 0x55e45b8b02c0 2024-09-17T01:42:16.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.847+0000 7f1fd3e00640 1 --2- 172.21.15.42:0/1676086857 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x55e45b8b02c0 0x55e45b8e2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:16.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.848+0000 7f1fd3e00640 1 --2- 172.21.15.42:0/1676086857 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x55e45b8b02c0 0x55e45b8e2a50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aee8c09b29d9be68 server_cookie=2d56b55079d94c93 in_seq=0 out_seq=0 2024-09-17T01:42:16.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.848+0000 7f1fc0c00640 10 client.8652 ms_handle_connect on v2:172.21.15.42:6833/3060441721 2024-09-17T01:42:16.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.848+0000 7f1fc0c00640 1 -- 172.21.15.42:0/1676086857 <== mds.0 v2:172.21.15.42:6833/3060441721 1 ==== command_reply(tid 0: 0 ) ==== 8+0+612 (crc 0 0 0) 0x55e45b8e3530 con 0x55e45b8b02c0 2024-09-17T01:42:16.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.848+0000 7f1fc0c00640 10 client.8652 handle_command_reply: tid=0 2024-09-17T01:42:16.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.848+0000 7f1fe1ca0740 1 client.8652 shutdown 2024-09-17T01:42:16.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.848+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/1676086857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b4f26b0 msgr2=0x55e45b8feab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.848+0000 7f1fe1ca0740 1 --2- 172.21.15.42:0/1676086857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b4f26b0 0x55e45b8feab0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc083aa0 tx=0x7f1fbc005f90 comp rx=0 tx=0).stop 2024-09-17T01:42:16.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.848+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/1676086857 shutdown_connections 2024-09-17T01:42:16.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.848+0000 7f1fe1ca0740 1 --2- 172.21.15.42:0/1676086857 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x55e45b8b02c0 0x55e45b8e2a50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.848+0000 7f1fe1ca0740 1 --2- 172.21.15.42:0/1676086857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e45b513390 0x55e45b8e2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.848+0000 7f1fe1ca0740 1 --2- 172.21.15.42:0/1676086857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e45b4f26b0 0x55e45b8feab0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.848+0000 7f1fc0c00640 0 client.8652 ms_handle_reset on v2:172.21.15.42:6833/3060441721 2024-09-17T01:42:16.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.848+0000 7f1fe1ca0740 1 --2- 172.21.15.42:0/1676086857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e45b4ea4d0 0x55e45b981c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.848+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/1676086857 >> 172.21.15.42:0/1676086857 conn(0x55e45b5074e0 msgr2=0x55e45b8e4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:16.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.848+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/1676086857 shutdown_connections 2024-09-17T01:42:16.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.848+0000 7f1fe1ca0740 1 -- 172.21.15.42:0/1676086857 wait complete. 2024-09-17T01:42:16.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.848+0000 7f1fe1ca0740 20 client.8652 trim_cache size 0 max 16384 2024-09-17T01:42:16.850 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:42:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "PAUSED (775 inodes in the stack)", 2024-09-17T01:42:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-09-17T01:42:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "66cb4c14-2da0-45be-8da9-91bab7343f1d": { 2024-09-17T01:42:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_control_test_path", 2024-09-17T01:42:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "66cb4c14-2da0-45be-8da9-91bab7343f1d", 2024-09-17T01:42:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive" 2024-09-17T01:42:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:42:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_stats": { 2024-09-17T01:42:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "66cb4c14-2da0-45be-8da9-91bab7343f1d": { 2024-09-17T01:42:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:42:16.070613+0000", 2024-09-17T01:42:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_control_test_path", 2024-09-17T01:42:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:42:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:42:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:42:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:42:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:16.852 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:42:16.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.849+0000 7f1fdac00640 1 -- 172.21.15.42:0/1471854732 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1fb0078bc0 msgr2=0x7f1fb007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.849+0000 7f1fdac00640 1 --2- 172.21.15.42:0/1471854732 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1fb0078bc0 0x7f1fb007b0d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4009b30 tx=0x7f1fc4005f90 comp rx=0 tx=0).stop 2024-09-17T01:42:16.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.849+0000 7f1fdac00640 1 -- 172.21.15.42:0/1471854732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1fd415cb80 msgr2=0x7f1fd414b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:16.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.849+0000 7f1fdac00640 1 --2- 172.21.15.42:0/1471854732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1fd415cb80 0x7f1fd414b6a0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc009950 tx=0x7f1fbc0040c0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.849+0000 7f1fdac00640 1 -- 172.21.15.42:0/1471854732 shutdown_connections 2024-09-17T01:42:16.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.849+0000 7f1fdac00640 1 --2- 172.21.15.42:0/1471854732 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1fb0078bc0 0x7f1fb007b0d0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.849+0000 7f1fdac00640 1 --2- 172.21.15.42:0/1471854732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fd415f480 0x7f1fd41f6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.849+0000 7f1fdac00640 1 --2- 172.21.15.42:0/1471854732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1fd415cb80 0x7f1fd414b6a0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.849+0000 7f1fdac00640 1 --2- 172.21.15.42:0/1471854732 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1fd406d430 0x7f1fd414fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:16.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.849+0000 7f1fdac00640 1 -- 172.21.15.42:0/1471854732 >> 172.21.15.42:0/1471854732 conn(0x7f1fd40b2930 msgr2=0x7f1fd41519a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:16.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.849+0000 7f1fdac00640 1 -- 172.21.15.42:0/1471854732 shutdown_connections 2024-09-17T01:42:16.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:16.849+0000 7f1fdac00640 1 -- 172.21.15.42:0/1471854732 wait complete. 2024-09-17T01:42:16.870 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:42:17.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.100+0000 7f638da00640 1 -- 172.21.15.42:0/2571358929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f638806d260 msgr2=0x7f6388152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:17.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.100+0000 7f638da00640 1 --2- 172.21.15.42:0/2571358929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f638806d260 0x7f6388152ed0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f63880b4870 tx=0x7f638002aa30 comp rx=0 tx=0).stop 2024-09-17T01:42:17.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.100+0000 7f638da00640 1 -- 172.21.15.42:0/2571358929 shutdown_connections 2024-09-17T01:42:17.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.100+0000 7f638da00640 1 --2- 172.21.15.42:0/2571358929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f638806d260 0x7f6388152ed0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:17.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.100+0000 7f638da00640 1 --2- 172.21.15.42:0/2571358929 >> v2:172.21.15.43:3300/0 conn(0x7f63880cf7c0 0x7f638806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:17.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.100+0000 7f638da00640 1 -- 172.21.15.42:0/2571358929 >> 172.21.15.42:0/2571358929 conn(0x7f63880b25f0 msgr2=0x7f63880d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:17.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.100+0000 7f638da00640 1 -- 172.21.15.42:0/2571358929 shutdown_connections 2024-09-17T01:42:17.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.101+0000 7f638da00640 1 -- 172.21.15.42:0/2571358929 wait complete. 2024-09-17T01:42:17.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.103+0000 7f638da00640 1 Processor -- start 2024-09-17T01:42:17.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.103+0000 7f638da00640 1 -- start start 2024-09-17T01:42:17.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.104+0000 7f638da00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f638806d260 0x7f638814c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:17.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.104+0000 7f638da00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63880b4be0 0x7f63880c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:17.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.104+0000 7f638da00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63880cf7c0 0x7f63880c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:17.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.104+0000 7f638da00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f63881537a0 con 0x7f63880cf7c0 2024-09-17T01:42:17.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.104+0000 7f638da00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6388153620 con 0x7f63880b4be0 2024-09-17T01:42:17.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.104+0000 7f638da00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6388153920 con 0x7f638806d260 2024-09-17T01:42:17.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.105+0000 7f638d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63880cf7c0 0x7f63880c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:17.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.105+0000 7f6387e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f638806d260 0x7f638814c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:17.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.105+0000 7f6387400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63880b4be0 0x7f63880c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:17.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.105+0000 7f638d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63880cf7c0 0x7f63880c9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33726/0 (socket says 172.21.15.42:33726) 2024-09-17T01:42:17.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.105+0000 7f6387e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f638806d260 0x7f638814c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:35708/0 (socket says 172.21.15.42:35708) 2024-09-17T01:42:17.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.105+0000 7f638d000640 1 -- 172.21.15.42:0/859299408 learned_addr learned my addr 172.21.15.42:0/859299408 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:17.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.105+0000 7f638d000640 1 -- 172.21.15.42:0/859299408 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f638806d260 msgr2=0x7f638814c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:17.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.105+0000 7f638d000640 1 --2- 172.21.15.42:0/859299408 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f638806d260 0x7f638814c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:17.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.105+0000 7f638d000640 1 -- 172.21.15.42:0/859299408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63880b4be0 msgr2=0x7f63880c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:17.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.105+0000 7f638d000640 1 --2- 172.21.15.42:0/859299408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63880b4be0 0x7f63880c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:17.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.105+0000 7f638d000640 1 -- 172.21.15.42:0/859299408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63881f9240 con 0x7f63880cf7c0 2024-09-17T01:42:17.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.105+0000 7f638d000640 1 --2- 172.21.15.42:0/859299408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63880cf7c0 0x7f63880c9960 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f638002b020 tx=0x7f6380003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:17.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.106+0000 7f637fe00640 1 -- 172.21.15.42:0/859299408 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6380033050 con 0x7f63880cf7c0 2024-09-17T01:42:17.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.106+0000 7f637fe00640 1 -- 172.21.15.42:0/859299408 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6380004450 con 0x7f63880cf7c0 2024-09-17T01:42:17.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.106+0000 7f637fe00640 1 -- 172.21.15.42:0/859299408 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6380038450 con 0x7f63880cf7c0 2024-09-17T01:42:17.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.106+0000 7f638da00640 1 -- 172.21.15.42:0/859299408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63881f9520 con 0x7f63880cf7c0 2024-09-17T01:42:17.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.106+0000 7f638da00640 1 -- 172.21.15.42:0/859299408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63881f9ae0 con 0x7f63880cf7c0 2024-09-17T01:42:17.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.107+0000 7f638da00640 1 -- 172.21.15.42:0/859299408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6388152ed0 con 0x7f63880cf7c0 2024-09-17T01:42:17.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.108+0000 7f637fe00640 1 -- 172.21.15.42:0/859299408 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6380036070 con 0x7f63880cf7c0 2024-09-17T01:42:17.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.110+0000 7f637fe00640 1 --2- 172.21.15.42:0/859299408 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6368078b90 0x7f636807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:17.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.110+0000 7f637fe00640 1 -- 172.21.15.42:0/859299408 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f63800bc200 con 0x7f63880cf7c0 2024-09-17T01:42:17.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.110+0000 7f6387e00640 1 --2- 172.21.15.42:0/859299408 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6368078b90 0x7f636807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:17.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.111+0000 7f6387e00640 1 --2- 172.21.15.42:0/859299408 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6368078b90 0x7f636807b0a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f6378006fd0 tx=0x7f6378009060 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:17.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.115+0000 7f637fe00640 1 -- 172.21.15.42:0/859299408 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f638806d670 con 0x7f63880cf7c0 2024-09-17T01:42:17.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.350+0000 7f638da00640 1 -- 172.21.15.42:0/859299408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63881f8fd0 con 0x7f63880cf7c0 2024-09-17T01:42:17.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.350+0000 7f637fe00640 1 -- 172.21.15.42:0/859299408 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5231 (secure 0 0 0) 0x7f6380083f60 con 0x7f63880cf7c0 2024-09-17T01:42:17.349 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:17.349 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2491855232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2491855232},{"type":"v1","addr":"172.21.15.43:6835","nonce":2491855232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4136787983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4136787983},{"type":"v1","addr":"172.21.15.43:6837","nonce":4136787983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/3441664627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3441664627},{"type":"v1","addr":"172.21.15.42:6834","nonce":3441664627}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:41:39.382305+0000","modified":"2024-09-17T01:41:42.412964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8442":{"gid":8442,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3060441721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3060441721},{"type":"v1","addr":"172.21.15.42:6835","nonce":3060441721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8442,"qdb_cluster":[8442]},"id":9}]} 2024-09-17T01:42:17.349 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 107 2024-09-17T01:42:17.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.353+0000 7f638da00640 1 -- 172.21.15.42:0/859299408 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6368078b90 msgr2=0x7f636807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:17.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.353+0000 7f638da00640 1 --2- 172.21.15.42:0/859299408 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6368078b90 0x7f636807b0a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f6378006fd0 tx=0x7f6378009060 comp rx=0 tx=0).stop 2024-09-17T01:42:17.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.353+0000 7f638da00640 1 -- 172.21.15.42:0/859299408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63880cf7c0 msgr2=0x7f63880c9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:17.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.353+0000 7f638da00640 1 --2- 172.21.15.42:0/859299408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63880cf7c0 0x7f63880c9960 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f638002b020 tx=0x7f6380003f10 comp rx=0 tx=0).stop 2024-09-17T01:42:17.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.353+0000 7f638da00640 1 -- 172.21.15.42:0/859299408 shutdown_connections 2024-09-17T01:42:17.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.353+0000 7f638da00640 1 --2- 172.21.15.42:0/859299408 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6368078b90 0x7f636807b0a0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:17.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.353+0000 7f638da00640 1 --2- 172.21.15.42:0/859299408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63880b4be0 0x7f63880c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:17.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.353+0000 7f638da00640 1 --2- 172.21.15.42:0/859299408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63880cf7c0 0x7f63880c9960 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:17.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.353+0000 7f638da00640 1 --2- 172.21.15.42:0/859299408 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f638806d260 0x7f638814c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:17.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.353+0000 7f638da00640 1 -- 172.21.15.42:0/859299408 >> 172.21.15.42:0/859299408 conn(0x7f63880b25f0 msgr2=0x7f63880afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:17.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.353+0000 7f638da00640 1 -- 172.21.15.42:0/859299408 shutdown_connections 2024-09-17T01:42:17.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.353+0000 7f638da00640 1 -- 172.21.15.42:0/859299408 wait complete. 2024-09-17T01:42:17.374 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-17T01:42:17.374 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:42:17.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.604+0000 7fb33c200640 1 -- 172.21.15.42:0/2120926973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb31c004800 msgr2=0x7fb31c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:17.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.604+0000 7fb33c200640 1 --2- 172.21.15.42:0/2120926973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb31c004800 0x7fb31c004c10 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fb320001830 tx=0x7fb31c005830 comp rx=0 tx=0).stop 2024-09-17T01:42:17.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.604+0000 7fb33c200640 1 -- 172.21.15.42:0/2120926973 shutdown_connections 2024-09-17T01:42:17.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.604+0000 7fb33c200640 1 --2- 172.21.15.42:0/2120926973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb31c004800 0x7fb31c004c10 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:17.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.604+0000 7fb33c200640 1 -- 172.21.15.42:0/2120926973 >> 172.21.15.42:0/2120926973 conn(0x7fb3340b2930 msgr2=0x7fb33406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:17.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.604+0000 7fb33c200640 1 -- 172.21.15.42:0/2120926973 shutdown_connections 2024-09-17T01:42:17.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.604+0000 7fb33c200640 1 -- 172.21.15.42:0/2120926973 wait complete. 2024-09-17T01:42:17.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.606+0000 7fb33c200640 1 Processor -- start 2024-09-17T01:42:17.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.606+0000 7fb33c200640 1 -- start start 2024-09-17T01:42:17.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.608+0000 7fb33c200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb31c004800 0x7fb334151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:17.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.608+0000 7fb33c200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3341519b0 0x7fb3340b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:17.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.608+0000 7fb33c200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3340b10c0 0x7fb3341e7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:17.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.608+0000 7fb33c200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb334152890 con 0x7fb3341519b0 2024-09-17T01:42:17.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.608+0000 7fb33c200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb334152710 con 0x7fb3340b10c0 2024-09-17T01:42:17.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.608+0000 7fb33c200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb334152a10 con 0x7fb31c004800 2024-09-17T01:42:17.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.608+0000 7fb338e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3341519b0 0x7fb3340b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:17.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.608+0000 7fb338e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3341519b0 0x7fb3340b0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33738/0 (socket says 172.21.15.42:33738) 2024-09-17T01:42:17.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.608+0000 7fb338e00640 1 -- 172.21.15.42:0/445231410 learned_addr learned my addr 172.21.15.42:0/445231410 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:17.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.608+0000 7fb339800640 1 --2- 172.21.15.42:0/445231410 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb31c004800 0x7fb334151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:17.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.608+0000 7fb33a200640 1 --2- 172.21.15.42:0/445231410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3340b10c0 0x7fb3341e7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:17.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.609+0000 7fb338e00640 1 -- 172.21.15.42:0/445231410 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb31c004800 msgr2=0x7fb334151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:17.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.609+0000 7fb338e00640 1 --2- 172.21.15.42:0/445231410 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb31c004800 0x7fb334151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:17.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.609+0000 7fb338e00640 1 -- 172.21.15.42:0/445231410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3340b10c0 msgr2=0x7fb3341e7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:17.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.609+0000 7fb338e00640 1 --2- 172.21.15.42:0/445231410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3340b10c0 0x7fb3341e7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:17.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.609+0000 7fb338e00640 1 -- 172.21.15.42:0/445231410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3340b14d0 con 0x7fb3341519b0 2024-09-17T01:42:17.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.609+0000 7fb338e00640 1 --2- 172.21.15.42:0/445231410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3341519b0 0x7fb3340b0b80 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fb320001950 tx=0x7fb3200060e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:17.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.609+0000 7fb331600640 1 -- 172.21.15.42:0/445231410 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb320043070 con 0x7fb3341519b0 2024-09-17T01:42:17.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.609+0000 7fb331600640 1 -- 172.21.15.42:0/445231410 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb320003af0 con 0x7fb3341519b0 2024-09-17T01:42:17.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.609+0000 7fb331600640 1 -- 172.21.15.42:0/445231410 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3200064c0 con 0x7fb3341519b0 2024-09-17T01:42:17.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.609+0000 7fb33c200640 1 -- 172.21.15.42:0/445231410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3340c5ce0 con 0x7fb3341519b0 2024-09-17T01:42:17.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.610+0000 7fb33c200640 1 -- 172.21.15.42:0/445231410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3340c62a0 con 0x7fb3341519b0 2024-09-17T01:42:17.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.611+0000 7fb33c200640 1 -- 172.21.15.42:0/445231410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3341fa010 con 0x7fb3341519b0 2024-09-17T01:42:17.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.612+0000 7fb331600640 1 -- 172.21.15.42:0/445231410 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb320033480 con 0x7fb3341519b0 2024-09-17T01:42:17.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.613+0000 7fb331600640 1 --2- 172.21.15.42:0/445231410 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb314078b90 0x7fb31407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:17.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.614+0000 7fb331600640 1 -- 172.21.15.42:0/445231410 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7fb3200bac80 con 0x7fb3341519b0 2024-09-17T01:42:17.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.614+0000 7fb339800640 1 --2- 172.21.15.42:0/445231410 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb314078b90 0x7fb31407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:17.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.614+0000 7fb339800640 1 --2- 172.21.15.42:0/445231410 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb314078b90 0x7fb31407b0a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb328001050 tx=0x7fb3280016c0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:17.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.618+0000 7fb331600640 1 -- 172.21.15.42:0/445231410 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb3340b14d0 con 0x7fb3341519b0 2024-09-17T01:42:17.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.887+0000 7fb33c200640 1 -- 172.21.15.42:0/445231410 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb33415f890 con 0x7fb3341519b0 2024-09-17T01:42:17.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.888+0000 7fb331600640 1 -- 172.21.15.42:0/445231410 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1069 (secure 0 0 0) 0x7fb3200829d0 con 0x7fb3341519b0 2024-09-17T01:42:17.886 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:17.886 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":638,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":136,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":992,"data_bytes":1017266125,"bytes_used":2411954176,"bytes_avail":770682159104,"bytes_total":773094113280,"write_bytes_sec":41499845,"read_op_per_sec":0,"write_op_per_sec":42},"fsmap":{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8442}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-17T01:40:29.123222+0000","services":{}},"progress_events":{}} 2024-09-17T01:42:17.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.890+0000 7fb33c200640 1 -- 172.21.15.42:0/445231410 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb314078b90 msgr2=0x7fb31407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:17.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.890+0000 7fb33c200640 1 --2- 172.21.15.42:0/445231410 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb314078b90 0x7fb31407b0a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb328001050 tx=0x7fb3280016c0 comp rx=0 tx=0).stop 2024-09-17T01:42:17.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.890+0000 7fb33c200640 1 -- 172.21.15.42:0/445231410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3341519b0 msgr2=0x7fb3340b0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:17.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.890+0000 7fb33c200640 1 --2- 172.21.15.42:0/445231410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3341519b0 0x7fb3340b0b80 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fb320001950 tx=0x7fb3200060e0 comp rx=0 tx=0).stop 2024-09-17T01:42:17.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.890+0000 7fb33c200640 1 -- 172.21.15.42:0/445231410 shutdown_connections 2024-09-17T01:42:17.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.891+0000 7fb33c200640 1 --2- 172.21.15.42:0/445231410 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb314078b90 0x7fb31407b0a0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:17.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.891+0000 7fb33c200640 1 --2- 172.21.15.42:0/445231410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3340b10c0 0x7fb3341e7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:17.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.891+0000 7fb33c200640 1 --2- 172.21.15.42:0/445231410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3341519b0 0x7fb3340b0b80 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:17.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.891+0000 7fb33c200640 1 --2- 172.21.15.42:0/445231410 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb31c004800 0x7fb334151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:17.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.891+0000 7fb33c200640 1 -- 172.21.15.42:0/445231410 >> 172.21.15.42:0/445231410 conn(0x7fb3340b2930 msgr2=0x7fb3340cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:17.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.891+0000 7fb33c200640 1 -- 172.21.15.42:0/445231410 shutdown_connections 2024-09-17T01:42:17.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:17.891+0000 7fb33c200640 1 -- 172.21.15.42:0/445231410 wait complete. 2024-09-17T01:42:18.910 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:42:19.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.146+0000 7f63b7400640 1 -- 172.21.15.42:0/328695739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63b0072e90 msgr2=0x7f63b00cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:19.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.146+0000 7f63b7400640 1 --2- 172.21.15.42:0/328695739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63b0072e90 0x7f63b00cec40 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f63a8005fd0 tx=0x7f63a802aa10 comp rx=0 tx=0).stop 2024-09-17T01:42:19.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.147+0000 7f63b7400640 1 -- 172.21.15.42:0/328695739 shutdown_connections 2024-09-17T01:42:19.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.147+0000 7f63b7400640 1 --2- 172.21.15.42:0/328695739 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63b0072e90 0x7f63b00cec40 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:19.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.147+0000 7f63b7400640 1 --2- 172.21.15.42:0/328695739 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f63b0142f40 0x7f63b0072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:19.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.147+0000 7f63b7400640 1 -- 172.21.15.42:0/328695739 >> 172.21.15.42:0/328695739 conn(0x7f63b00b2930 msgr2=0x7f63b006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:19.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.147+0000 7f63b7400640 1 -- 172.21.15.42:0/328695739 shutdown_connections 2024-09-17T01:42:19.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.147+0000 7f63b7400640 1 -- 172.21.15.42:0/328695739 wait complete. 2024-09-17T01:42:19.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.149+0000 7f63b7400640 1 Processor -- start 2024-09-17T01:42:19.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.149+0000 7f63b7400640 1 -- start start 2024-09-17T01:42:19.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.151+0000 7f63b7400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f63b0072e90 0x7f63b0159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:19.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.151+0000 7f63b7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63b00b3550 0x7f63b01f9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:19.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.151+0000 7f63b7400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63b0142f40 0x7f63b01f99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:19.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.151+0000 7f63b7400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f63b006d7c0 con 0x7f63b00b3550 2024-09-17T01:42:19.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.151+0000 7f63b7400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f63b006d640 con 0x7f63b0142f40 2024-09-17T01:42:19.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.151+0000 7f63b7400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f63b006d940 con 0x7f63b0072e90 2024-09-17T01:42:19.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.151+0000 7f63afe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63b00b3550 0x7f63b01f9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:19.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.151+0000 7f63afe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63b00b3550 0x7f63b01f9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33750/0 (socket says 172.21.15.42:33750) 2024-09-17T01:42:19.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.151+0000 7f63afe00640 1 -- 172.21.15.42:0/2132887069 learned_addr learned my addr 172.21.15.42:0/2132887069 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:19.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.151+0000 7f63b5400640 1 --2- 172.21.15.42:0/2132887069 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63b0142f40 0x7f63b01f99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:19.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.151+0000 7f63b4a00640 1 --2- 172.21.15.42:0/2132887069 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f63b0072e90 0x7f63b0159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:19.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.151+0000 7f63afe00640 1 -- 172.21.15.42:0/2132887069 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f63b0072e90 msgr2=0x7f63b0159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:19.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.151+0000 7f63afe00640 1 --2- 172.21.15.42:0/2132887069 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f63b0072e90 0x7f63b0159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:19.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.151+0000 7f63afe00640 1 -- 172.21.15.42:0/2132887069 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63b0142f40 msgr2=0x7f63b01f99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:19.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.151+0000 7f63afe00640 1 --2- 172.21.15.42:0/2132887069 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63b0142f40 0x7f63b01f99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:19.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.152+0000 7f63afe00640 1 -- 172.21.15.42:0/2132887069 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b015a4d0 con 0x7f63b00b3550 2024-09-17T01:42:19.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.152+0000 7f63afe00640 1 --2- 172.21.15.42:0/2132887069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63b00b3550 0x7f63b01f9480 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f639c00e7c0 tx=0x7f639c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:19.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.152+0000 7f63acc00640 1 -- 172.21.15.42:0/2132887069 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c00ccc0 con 0x7f63b00b3550 2024-09-17T01:42:19.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.152+0000 7f63acc00640 1 -- 172.21.15.42:0/2132887069 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f639c010430 con 0x7f63b00b3550 2024-09-17T01:42:19.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.152+0000 7f63acc00640 1 -- 172.21.15.42:0/2132887069 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c010860 con 0x7f63b00b3550 2024-09-17T01:42:19.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.152+0000 7f63b7400640 1 -- 172.21.15.42:0/2132887069 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63b015a7b0 con 0x7f63b00b3550 2024-09-17T01:42:19.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.152+0000 7f63b7400640 1 -- 172.21.15.42:0/2132887069 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63b015ad70 con 0x7f63b00b3550 2024-09-17T01:42:19.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.153+0000 7f63b7400640 1 -- 172.21.15.42:0/2132887069 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63b00cec40 con 0x7f63b00b3550 2024-09-17T01:42:19.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.155+0000 7f63acc00640 1 -- 172.21.15.42:0/2132887069 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f639c010a00 con 0x7f63b00b3550 2024-09-17T01:42:19.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.155+0000 7f63acc00640 1 --2- 172.21.15.42:0/2132887069 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6390078b90 0x7f639007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:19.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.156+0000 7f63acc00640 1 -- 172.21.15.42:0/2132887069 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f639c09b620 con 0x7f63b00b3550 2024-09-17T01:42:19.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.156+0000 7f63b4a00640 1 --2- 172.21.15.42:0/2132887069 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6390078b90 0x7f639007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:19.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.157+0000 7f63b4a00640 1 --2- 172.21.15.42:0/2132887069 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6390078b90 0x7f639007b0a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f63a40016c0 tx=0x7f63a4009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:19.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.160+0000 7f63acc00640 1 -- 172.21.15.42:0/2132887069 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f639c063490 con 0x7f63b00b3550 2024-09-17T01:42:19.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.395+0000 7f63b7400640 1 -- 172.21.15.42:0/2132887069 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63b006a170 con 0x7f63b00b3550 2024-09-17T01:42:19.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.396+0000 7f63acc00640 1 -- 172.21.15.42:0/2132887069 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5231 (secure 0 0 0) 0x7f639c06c020 con 0x7f63b00b3550 2024-09-17T01:42:19.394 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:19.394 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2491855232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2491855232},{"type":"v1","addr":"172.21.15.43:6835","nonce":2491855232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4136787983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4136787983},{"type":"v1","addr":"172.21.15.43:6837","nonce":4136787983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/3441664627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3441664627},{"type":"v1","addr":"172.21.15.42:6834","nonce":3441664627}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:41:39.382305+0000","modified":"2024-09-17T01:41:42.412964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8442":{"gid":8442,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3060441721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3060441721},{"type":"v1","addr":"172.21.15.42:6835","nonce":3060441721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8442,"qdb_cluster":[8442]},"id":9}]} 2024-09-17T01:42:19.394 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 107 2024-09-17T01:42:19.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.399+0000 7f63b7400640 1 -- 172.21.15.42:0/2132887069 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6390078b90 msgr2=0x7f639007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:19.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.399+0000 7f63b7400640 1 --2- 172.21.15.42:0/2132887069 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6390078b90 0x7f639007b0a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f63a40016c0 tx=0x7f63a4009040 comp rx=0 tx=0).stop 2024-09-17T01:42:19.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.399+0000 7f63b7400640 1 -- 172.21.15.42:0/2132887069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63b00b3550 msgr2=0x7f63b01f9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:19.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.399+0000 7f63b7400640 1 --2- 172.21.15.42:0/2132887069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63b00b3550 0x7f63b01f9480 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f639c00e7c0 tx=0x7f639c00ec80 comp rx=0 tx=0).stop 2024-09-17T01:42:19.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.399+0000 7f63b7400640 1 -- 172.21.15.42:0/2132887069 shutdown_connections 2024-09-17T01:42:19.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.399+0000 7f63b7400640 1 --2- 172.21.15.42:0/2132887069 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6390078b90 0x7f639007b0a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:19.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.399+0000 7f63b7400640 1 --2- 172.21.15.42:0/2132887069 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63b0142f40 0x7f63b01f99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:19.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.399+0000 7f63b7400640 1 --2- 172.21.15.42:0/2132887069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63b00b3550 0x7f63b01f9480 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:19.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.399+0000 7f63b7400640 1 --2- 172.21.15.42:0/2132887069 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f63b0072e90 0x7f63b0159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:19.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.399+0000 7f63b7400640 1 -- 172.21.15.42:0/2132887069 >> 172.21.15.42:0/2132887069 conn(0x7f63b00b2930 msgr2=0x7f63b0073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:19.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.399+0000 7f63b7400640 1 -- 172.21.15.42:0/2132887069 shutdown_connections 2024-09-17T01:42:19.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.399+0000 7f63b7400640 1 -- 172.21.15.42:0/2132887069 wait complete. 2024-09-17T01:42:19.418 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-17T01:42:19.418 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:42:19.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.650+0000 7fbeb2e00640 1 -- 172.21.15.42:0/2074124126 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbeac0b3550 msgr2=0x7fbeac15cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:19.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.650+0000 7fbeb2e00640 1 --2- 172.21.15.42:0/2074124126 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbeac0b3550 0x7fbeac15cec0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c009860 tx=0x7fbe9c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:42:19.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.650+0000 7fbeb2e00640 1 -- 172.21.15.42:0/2074124126 shutdown_connections 2024-09-17T01:42:19.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.650+0000 7fbeb2e00640 1 --2- 172.21.15.42:0/2074124126 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbeac0b3550 0x7fbeac15cec0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:19.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.650+0000 7fbeb2e00640 1 -- 172.21.15.42:0/2074124126 >> 172.21.15.42:0/2074124126 conn(0x7fbeac0b2930 msgr2=0x7fbeac06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:19.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.650+0000 7fbeb2e00640 1 -- 172.21.15.42:0/2074124126 shutdown_connections 2024-09-17T01:42:19.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.650+0000 7fbeb2e00640 1 -- 172.21.15.42:0/2074124126 wait complete. 2024-09-17T01:42:19.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.652+0000 7fbeb2e00640 1 Processor -- start 2024-09-17T01:42:19.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.653+0000 7fbeb2e00640 1 -- start start 2024-09-17T01:42:19.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.654+0000 7fbeb2e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbeac0b3550 0x7fbeac1615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:19.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.654+0000 7fbeb2e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbeac0cec40 0x7fbeac13e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:19.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.654+0000 7fbeb2e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbeac142f40 0x7fbeac15b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:19.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.654+0000 7fbeb2e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbeac0cf1d0 con 0x7fbeac142f40 2024-09-17T01:42:19.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.654+0000 7fbeb2e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbeac0cf050 con 0x7fbeac0b3550 2024-09-17T01:42:19.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.654+0000 7fbeb2e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbeac0cf350 con 0x7fbeac0cec40 2024-09-17T01:42:19.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.654+0000 7fbeb0e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbeac142f40 0x7fbeac15b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:19.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.654+0000 7fbeb0e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbeac142f40 0x7fbeac15b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33760/0 (socket says 172.21.15.42:33760) 2024-09-17T01:42:19.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.654+0000 7fbeb0e00640 1 -- 172.21.15.42:0/4171848782 learned_addr learned my addr 172.21.15.42:0/4171848782 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:19.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.654+0000 7fbeabe00640 1 --2- 172.21.15.42:0/4171848782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbeac0b3550 0x7fbeac1615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:19.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.654+0000 7fbea3e00640 1 --2- 172.21.15.42:0/4171848782 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbeac0cec40 0x7fbeac13e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:19.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.655+0000 7fbeb0e00640 1 -- 172.21.15.42:0/4171848782 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbeac0cec40 msgr2=0x7fbeac13e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:19.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.655+0000 7fbeb0e00640 1 --2- 172.21.15.42:0/4171848782 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbeac0cec40 0x7fbeac13e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:19.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.655+0000 7fbeb0e00640 1 -- 172.21.15.42:0/4171848782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbeac0b3550 msgr2=0x7fbeac1615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:19.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.655+0000 7fbeb0e00640 1 --2- 172.21.15.42:0/4171848782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbeac0b3550 0x7fbeac1615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:19.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.655+0000 7fbeb0e00640 1 -- 172.21.15.42:0/4171848782 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeac15a5b0 con 0x7fbeac142f40 2024-09-17T01:42:19.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.655+0000 7fbeb0e00640 1 --2- 172.21.15.42:0/4171848782 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbeac142f40 0x7fbeac15b500 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fbea400c730 tx=0x7fbea400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:19.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.655+0000 7fbea8c00640 1 -- 172.21.15.42:0/4171848782 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea4003b70 con 0x7fbeac142f40 2024-09-17T01:42:19.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.655+0000 7fbea8c00640 1 -- 172.21.15.42:0/4171848782 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbea4003d10 con 0x7fbeac142f40 2024-09-17T01:42:19.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.655+0000 7fbea8c00640 1 -- 172.21.15.42:0/4171848782 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea400aab0 con 0x7fbeac142f40 2024-09-17T01:42:19.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.655+0000 7fbeb2e00640 1 -- 172.21.15.42:0/4171848782 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeac1f8f60 con 0x7fbeac142f40 2024-09-17T01:42:19.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.656+0000 7fbeb2e00640 1 -- 172.21.15.42:0/4171848782 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeac13edd0 con 0x7fbeac142f40 2024-09-17T01:42:19.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.657+0000 7fbeb2e00640 1 -- 172.21.15.42:0/4171848782 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeac15cec0 con 0x7fbeac142f40 2024-09-17T01:42:19.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.658+0000 7fbea8c00640 1 -- 172.21.15.42:0/4171848782 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbea400ac50 con 0x7fbeac142f40 2024-09-17T01:42:19.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.659+0000 7fbea8c00640 1 --2- 172.21.15.42:0/4171848782 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbe88078b90 0x7fbe8807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:19.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.659+0000 7fbea8c00640 1 -- 172.21.15.42:0/4171848782 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7fbea409aaf0 con 0x7fbeac142f40 2024-09-17T01:42:19.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.659+0000 7fbeabe00640 1 --2- 172.21.15.42:0/4171848782 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbe88078b90 0x7fbe8807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:19.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.660+0000 7fbeabe00640 1 --2- 172.21.15.42:0/4171848782 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbe88078b90 0x7fbe8807b0a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c034000 tx=0x7fbe9c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:19.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.663+0000 7fbea8c00640 1 -- 172.21.15.42:0/4171848782 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbeac15a5b0 con 0x7fbeac142f40 2024-09-17T01:42:19.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.941+0000 7fbeb2e00640 1 -- 172.21.15.42:0/4171848782 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fbeac1f9130 con 0x7fbeac142f40 2024-09-17T01:42:19.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.942+0000 7fbea8c00640 1 -- 172.21.15.42:0/4171848782 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1070 (secure 0 0 0) 0x7fbea4062840 con 0x7fbeac142f40 2024-09-17T01:42:19.940 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:19.940 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":640,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":136,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1000,"data_bytes":1025654733,"bytes_used":2452848640,"bytes_avail":770641264640,"bytes_total":773094113280,"write_bytes_sec":41236061,"read_op_per_sec":0,"write_op_per_sec":41},"fsmap":{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8442}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-17T01:40:29.123222+0000","services":{}},"progress_events":{}} 2024-09-17T01:42:19.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.944+0000 7fbeb2e00640 1 -- 172.21.15.42:0/4171848782 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbe88078b90 msgr2=0x7fbe8807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:19.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.944+0000 7fbeb2e00640 1 --2- 172.21.15.42:0/4171848782 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbe88078b90 0x7fbe8807b0a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c034000 tx=0x7fbe9c004730 comp rx=0 tx=0).stop 2024-09-17T01:42:19.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.944+0000 7fbeb2e00640 1 -- 172.21.15.42:0/4171848782 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbeac142f40 msgr2=0x7fbeac15b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:19.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.944+0000 7fbeb2e00640 1 --2- 172.21.15.42:0/4171848782 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbeac142f40 0x7fbeac15b500 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fbea400c730 tx=0x7fbea400cbf0 comp rx=0 tx=0).stop 2024-09-17T01:42:19.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.944+0000 7fbeb2e00640 1 -- 172.21.15.42:0/4171848782 shutdown_connections 2024-09-17T01:42:19.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.944+0000 7fbeb2e00640 1 --2- 172.21.15.42:0/4171848782 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbe88078b90 0x7fbe8807b0a0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:19.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.944+0000 7fbeb2e00640 1 --2- 172.21.15.42:0/4171848782 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbeac142f40 0x7fbeac15b500 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:19.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.944+0000 7fbeb2e00640 1 --2- 172.21.15.42:0/4171848782 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbeac0cec40 0x7fbeac13e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:19.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.944+0000 7fbeb2e00640 1 --2- 172.21.15.42:0/4171848782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbeac0b3550 0x7fbeac1615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:19.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.944+0000 7fbeb2e00640 1 -- 172.21.15.42:0/4171848782 >> 172.21.15.42:0/4171848782 conn(0x7fbeac0b2930 msgr2=0x7fbeac15c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:19.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.944+0000 7fbeb2e00640 1 -- 172.21.15.42:0/4171848782 shutdown_connections 2024-09-17T01:42:19.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:19.944+0000 7fbeb2e00640 1 -- 172.21.15.42:0/4171848782 wait complete. 2024-09-17T01:42:20.967 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:42:21.006 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:42:21.018 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:42:21.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.209+0000 7fc393e00640 1 -- 172.21.15.42:0/236962063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc39406d260 msgr2=0x7fc394152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:21.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.209+0000 7fc393e00640 1 --2- 172.21.15.42:0/236962063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc39406d260 0x7fc394152ed0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fc38c005fd0 tx=0x7fc38c02aa00 comp rx=0 tx=0).stop 2024-09-17T01:42:21.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.209+0000 7fc393e00640 1 -- 172.21.15.42:0/236962063 shutdown_connections 2024-09-17T01:42:21.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.209+0000 7fc393e00640 1 --2- 172.21.15.42:0/236962063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc39406d260 0x7fc394152ed0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:21.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.209+0000 7fc393e00640 1 --2- 172.21.15.42:0/236962063 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3940cf7c0 0x7fc39406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:21.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.209+0000 7fc393e00640 1 -- 172.21.15.42:0/236962063 >> 172.21.15.42:0/236962063 conn(0x7fc3940b25f0 msgr2=0x7fc3940d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:21.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.209+0000 7fc393e00640 1 -- 172.21.15.42:0/236962063 shutdown_connections 2024-09-17T01:42:21.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.209+0000 7fc393e00640 1 -- 172.21.15.42:0/236962063 wait complete. 2024-09-17T01:42:21.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.211+0000 7fc393e00640 1 Processor -- start 2024-09-17T01:42:21.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.211+0000 7fc393e00640 1 -- start start 2024-09-17T01:42:21.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.213+0000 7fc393e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc39406d260 0x7fc39414e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:21.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.213+0000 7fc393e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3940b4be0 0x7fc394151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:21.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.213+0000 7fc393e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3940cf7c0 0x7fc3941e92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:21.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.213+0000 7fc393e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc394153850 con 0x7fc3940cf7c0 2024-09-17T01:42:21.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.213+0000 7fc393e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc3941536d0 con 0x7fc3940b4be0 2024-09-17T01:42:21.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.213+0000 7fc393e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc3941539d0 con 0x7fc39406d260 2024-09-17T01:42:21.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.213+0000 7fc393400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3940cf7c0 0x7fc3941e92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:21.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.213+0000 7fc393400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3940cf7c0 0x7fc3941e92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33788/0 (socket says 172.21.15.42:33788) 2024-09-17T01:42:21.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.213+0000 7fc393400640 1 -- 172.21.15.42:0/3017346683 learned_addr learned my addr 172.21.15.42:0/3017346683 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:21.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.213+0000 7fc392a00640 1 --2- 172.21.15.42:0/3017346683 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc39406d260 0x7fc39414e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:21.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.213+0000 7fc38be00640 1 --2- 172.21.15.42:0/3017346683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3940b4be0 0x7fc394151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:21.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.214+0000 7fc393400640 1 -- 172.21.15.42:0/3017346683 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc39406d260 msgr2=0x7fc39414e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:21.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.214+0000 7fc393400640 1 --2- 172.21.15.42:0/3017346683 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc39406d260 0x7fc39414e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:21.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.214+0000 7fc393400640 1 -- 172.21.15.42:0/3017346683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3940b4be0 msgr2=0x7fc394151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:21.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.214+0000 7fc393400640 1 --2- 172.21.15.42:0/3017346683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3940b4be0 0x7fc394151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:21.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.214+0000 7fc393400640 1 -- 172.21.15.42:0/3017346683 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3941f9560 con 0x7fc3940cf7c0 2024-09-17T01:42:21.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.214+0000 7fc393400640 1 --2- 172.21.15.42:0/3017346683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3940cf7c0 0x7fc3941e92d0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fc38c009d90 tx=0x7fc38c003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:21.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.214+0000 7fc38aa00640 1 -- 172.21.15.42:0/3017346683 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c046070 con 0x7fc3940cf7c0 2024-09-17T01:42:21.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.214+0000 7fc38aa00640 1 -- 172.21.15.42:0/3017346683 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc38c004540 con 0x7fc3940cf7c0 2024-09-17T01:42:21.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.214+0000 7fc393e00640 1 -- 172.21.15.42:0/3017346683 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3941f9840 con 0x7fc3940cf7c0 2024-09-17T01:42:21.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.214+0000 7fc38aa00640 1 -- 172.21.15.42:0/3017346683 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c033070 con 0x7fc3940cf7c0 2024-09-17T01:42:21.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.215+0000 7fc393e00640 1 -- 172.21.15.42:0/3017346683 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3941f9e00 con 0x7fc3940cf7c0 2024-09-17T01:42:21.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.216+0000 7fc393e00640 1 -- 172.21.15.42:0/3017346683 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc394152ed0 con 0x7fc3940cf7c0 2024-09-17T01:42:21.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.217+0000 7fc38aa00640 1 -- 172.21.15.42:0/3017346683 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc38c049070 con 0x7fc3940cf7c0 2024-09-17T01:42:21.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.218+0000 7fc38aa00640 1 --2- 172.21.15.42:0/3017346683 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc370078b90 0x7fc37007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.218+0000 7fc38aa00640 1 -- 172.21.15.42:0/3017346683 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7fc38c0bbe90 con 0x7fc3940cf7c0 2024-09-17T01:42:21.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.219+0000 7fc392a00640 1 --2- 172.21.15.42:0/3017346683 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc370078b90 0x7fc37007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:21.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.219+0000 7fc392a00640 1 --2- 172.21.15.42:0/3017346683 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc370078b90 0x7fc37007b0a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc384006fd0 tx=0x7fc384009060 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:21.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.222+0000 7fc38aa00640 1 -- 172.21.15.42:0/3017346683 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc38c03e070 con 0x7fc3940cf7c0 2024-09-17T01:42:21.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.453+0000 7fc393e00640 1 -- 172.21.15.42:0/3017346683 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3940b1180 con 0x7fc3940cf7c0 2024-09-17T01:42:21.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.454+0000 7fc38aa00640 1 -- 172.21.15.42:0/3017346683 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5231 (secure 0 0 0) 0x7fc38c0bd090 con 0x7fc3940cf7c0 2024-09-17T01:42:21.452 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:21.452 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2491855232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2491855232},{"type":"v1","addr":"172.21.15.43:6835","nonce":2491855232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4136787983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4136787983},{"type":"v1","addr":"172.21.15.43:6837","nonce":4136787983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/3441664627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3441664627},{"type":"v1","addr":"172.21.15.42:6834","nonce":3441664627}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:41:39.382305+0000","modified":"2024-09-17T01:41:42.412964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8442":{"gid":8442,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3060441721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3060441721},{"type":"v1","addr":"172.21.15.42:6835","nonce":3060441721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8442,"qdb_cluster":[8442]},"id":9}]} 2024-09-17T01:42:21.453 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 107 2024-09-17T01:42:21.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.456+0000 7fc393e00640 1 -- 172.21.15.42:0/3017346683 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc370078b90 msgr2=0x7fc37007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:21.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.456+0000 7fc393e00640 1 --2- 172.21.15.42:0/3017346683 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc370078b90 0x7fc37007b0a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc384006fd0 tx=0x7fc384009060 comp rx=0 tx=0).stop 2024-09-17T01:42:21.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.456+0000 7fc393e00640 1 -- 172.21.15.42:0/3017346683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3940cf7c0 msgr2=0x7fc3941e92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:21.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.456+0000 7fc393e00640 1 --2- 172.21.15.42:0/3017346683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3940cf7c0 0x7fc3941e92d0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fc38c009d90 tx=0x7fc38c003f20 comp rx=0 tx=0).stop 2024-09-17T01:42:21.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.456+0000 7fc393e00640 1 -- 172.21.15.42:0/3017346683 shutdown_connections 2024-09-17T01:42:21.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.456+0000 7fc393e00640 1 --2- 172.21.15.42:0/3017346683 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc370078b90 0x7fc37007b0a0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:21.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.456+0000 7fc393e00640 1 --2- 172.21.15.42:0/3017346683 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3940b4be0 0x7fc394151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:21.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.456+0000 7fc393e00640 1 --2- 172.21.15.42:0/3017346683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3940cf7c0 0x7fc3941e92d0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:21.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.456+0000 7fc393e00640 1 --2- 172.21.15.42:0/3017346683 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc39406d260 0x7fc39414e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:21.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.456+0000 7fc393e00640 1 -- 172.21.15.42:0/3017346683 >> 172.21.15.42:0/3017346683 conn(0x7fc3940b25f0 msgr2=0x7fc39415f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:21.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.457+0000 7fc393e00640 1 -- 172.21.15.42:0/3017346683 shutdown_connections 2024-09-17T01:42:21.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.457+0000 7fc393e00640 1 -- 172.21.15.42:0/3017346683 wait complete. 2024-09-17T01:42:21.476 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-17T01:42:21.476 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:42:21.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.704+0000 7f4a8b000640 1 -- 172.21.15.42:0/4144627352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a8406d430 msgr2=0x7f4a8406d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:21.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.704+0000 7f4a8b000640 1 --2- 172.21.15.42:0/4144627352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a8406d430 0x7f4a8406d840 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f4a840d02f0 tx=0x7f4a7c02a5f0 comp rx=0 tx=0).stop 2024-09-17T01:42:21.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.705+0000 7f4a8b000640 1 -- 172.21.15.42:0/4144627352 shutdown_connections 2024-09-17T01:42:21.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.705+0000 7f4a8b000640 1 --2- 172.21.15.42:0/4144627352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a8406d430 0x7f4a8406d840 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:21.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.705+0000 7f4a8b000640 1 --2- 172.21.15.42:0/4144627352 >> v2:172.21.15.43:3300/0 conn(0x7f4a840af980 0x7f4a840ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:21.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.705+0000 7f4a8b000640 1 -- 172.21.15.42:0/4144627352 >> 172.21.15.42:0/4144627352 conn(0x7f4a840b2930 msgr2=0x7f4a8406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:21.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.705+0000 7f4a8b000640 1 -- 172.21.15.42:0/4144627352 shutdown_connections 2024-09-17T01:42:21.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.705+0000 7f4a8b000640 1 -- 172.21.15.42:0/4144627352 wait complete. 2024-09-17T01:42:21.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.707+0000 7f4a8b000640 1 Processor -- start 2024-09-17T01:42:21.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.707+0000 7f4a8b000640 1 -- start start 2024-09-17T01:42:21.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.708+0000 7f4a8b000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4a8406d430 0x7f4a84157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:21.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.708+0000 7f4a8b000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a840af980 0x7f4a8414ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:21.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.708+0000 7f4a8b000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a840b3880 0x7f4a84151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:21.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.708+0000 7f4a8b000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4a84072ad0 con 0x7f4a840b3880 2024-09-17T01:42:21.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.708+0000 7f4a8b000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4a84072950 con 0x7f4a840af980 2024-09-17T01:42:21.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.708+0000 7f4a8b000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4a84072c50 con 0x7f4a8406d430 2024-09-17T01:42:21.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.709+0000 7f4a89000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a840b3880 0x7f4a84151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:21.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.709+0000 7f4a89000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a840b3880 0x7f4a84151940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33798/0 (socket says 172.21.15.42:33798) 2024-09-17T01:42:21.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.709+0000 7f4a89000640 1 -- 172.21.15.42:0/1425684552 learned_addr learned my addr 172.21.15.42:0/1425684552 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:21.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.709+0000 7f4a7b400640 1 --2- 172.21.15.42:0/1425684552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a840af980 0x7f4a8414ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:21.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.709+0000 7f4a83e00640 1 --2- 172.21.15.42:0/1425684552 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4a8406d430 0x7f4a84157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:21.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.709+0000 7f4a89000640 1 -- 172.21.15.42:0/1425684552 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4a8406d430 msgr2=0x7f4a84157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:21.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.709+0000 7f4a89000640 1 --2- 172.21.15.42:0/1425684552 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4a8406d430 0x7f4a84157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:21.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.709+0000 7f4a89000640 1 -- 172.21.15.42:0/1425684552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a840af980 msgr2=0x7f4a8414ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:21.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.709+0000 7f4a89000640 1 --2- 172.21.15.42:0/1425684552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a840af980 0x7f4a8414ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:21.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.709+0000 7f4a89000640 1 -- 172.21.15.42:0/1425684552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a84157960 con 0x7f4a840b3880 2024-09-17T01:42:21.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.710+0000 7f4a89000640 1 --2- 172.21.15.42:0/1425684552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a840b3880 0x7f4a84151940 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c009230 tx=0x7f4a7c003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:21.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.710+0000 7f4a80c00640 1 -- 172.21.15.42:0/1425684552 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c03e030 con 0x7f4a840b3880 2024-09-17T01:42:21.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.710+0000 7f4a80c00640 1 -- 172.21.15.42:0/1425684552 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a7c003e50 con 0x7f4a840b3880 2024-09-17T01:42:21.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.710+0000 7f4a80c00640 1 -- 172.21.15.42:0/1425684552 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c035040 con 0x7f4a840b3880 2024-09-17T01:42:21.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.710+0000 7f4a8b000640 1 -- 172.21.15.42:0/1425684552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a8415a480 con 0x7f4a840b3880 2024-09-17T01:42:21.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.710+0000 7f4a8b000640 1 -- 172.21.15.42:0/1425684552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a8415aa40 con 0x7f4a840b3880 2024-09-17T01:42:21.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.711+0000 7f4a8b000640 1 -- 172.21.15.42:0/1425684552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a840b1b00 con 0x7f4a840b3880 2024-09-17T01:42:21.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.712+0000 7f4a80c00640 1 -- 172.21.15.42:0/1425684552 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4a7c041030 con 0x7f4a840b3880 2024-09-17T01:42:21.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.713+0000 7f4a80c00640 1 --2- 172.21.15.42:0/1425684552 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4a60078bc0 0x7f4a6007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:21.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.714+0000 7f4a80c00640 1 -- 172.21.15.42:0/1425684552 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f4a7c0bb4d0 con 0x7f4a840b3880 2024-09-17T01:42:21.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.714+0000 7f4a83e00640 1 --2- 172.21.15.42:0/1425684552 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4a60078bc0 0x7f4a6007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:21.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.715+0000 7f4a83e00640 1 --2- 172.21.15.42:0/1425684552 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4a60078bc0 0x7f4a6007b0d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4a74001e20 tx=0x7f4a74009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:21.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.718+0000 7f4a80c00640 1 -- 172.21.15.42:0/1425684552 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4a840b1b00 con 0x7f4a840b3880 2024-09-17T01:42:21.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.986+0000 7f4a8b000640 1 -- 172.21.15.42:0/1425684552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f4a8406d840 con 0x7f4a840b3880 2024-09-17T01:42:21.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.986+0000 7f4a80c00640 1 -- 172.21.15.42:0/1425684552 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1070 (secure 0 0 0) 0x7f4a8406dd80 con 0x7f4a840b3880 2024-09-17T01:42:21.984 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:21.984 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":642,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":136,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1077002915,"bytes_used":2580774912,"bytes_avail":770513338368,"bytes_total":773094113280,"write_bytes_sec":44048101,"read_op_per_sec":0,"write_op_per_sec":61},"fsmap":{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8442}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-17T01:40:29.123222+0000","services":{}},"progress_events":{}} 2024-09-17T01:42:21.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.988+0000 7f4a8b000640 1 -- 172.21.15.42:0/1425684552 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4a60078bc0 msgr2=0x7f4a6007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:21.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.988+0000 7f4a8b000640 1 --2- 172.21.15.42:0/1425684552 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4a60078bc0 0x7f4a6007b0d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4a74001e20 tx=0x7f4a74009040 comp rx=0 tx=0).stop 2024-09-17T01:42:21.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.988+0000 7f4a8b000640 1 -- 172.21.15.42:0/1425684552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a840b3880 msgr2=0x7f4a84151940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.988+0000 7f4a8b000640 1 --2- 172.21.15.42:0/1425684552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a840b3880 0x7f4a84151940 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c009230 tx=0x7f4a7c003960 comp rx=0 tx=0).stop 2024-09-17T01:42:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.989+0000 7f4a8b000640 1 -- 172.21.15.42:0/1425684552 shutdown_connections 2024-09-17T01:42:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.989+0000 7f4a8b000640 1 --2- 172.21.15.42:0/1425684552 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4a60078bc0 0x7f4a6007b0d0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.989+0000 7f4a8b000640 1 --2- 172.21.15.42:0/1425684552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a840af980 0x7f4a8414ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.989+0000 7f4a8b000640 1 --2- 172.21.15.42:0/1425684552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a840b3880 0x7f4a84151940 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.989+0000 7f4a8b000640 1 --2- 172.21.15.42:0/1425684552 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4a8406d430 0x7f4a84157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.989+0000 7f4a8b000640 1 -- 172.21.15.42:0/1425684552 >> 172.21.15.42:0/1425684552 conn(0x7f4a840b2930 msgr2=0x7f4a8406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.989+0000 7f4a8b000640 1 -- 172.21.15.42:0/1425684552 shutdown_connections 2024-09-17T01:42:21.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:21.989+0000 7f4a8b000640 1 -- 172.21.15.42:0/1425684552 wait complete. 2024-09-17T01:42:23.011 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:42:23.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.252+0000 7f6263200640 1 -- 172.21.15.42:0/351968020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f625c0d2d80 msgr2=0x7f625c0b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:23.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.252+0000 7f6263200640 1 --2- 172.21.15.42:0/351968020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f625c0d2d80 0x7f625c0b6050 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f625c0754a0 tx=0x7f625802aa60 comp rx=0 tx=0).stop 2024-09-17T01:42:23.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.252+0000 7f6263200640 1 -- 172.21.15.42:0/351968020 shutdown_connections 2024-09-17T01:42:23.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.252+0000 7f6263200640 1 --2- 172.21.15.42:0/351968020 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f625c0d2d80 0x7f625c0b6050 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:23.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.252+0000 7f6263200640 1 --2- 172.21.15.42:0/351968020 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f625c0d18b0 0x7f625c0d2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:23.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.252+0000 7f6263200640 1 --2- 172.21.15.42:0/351968020 >> v2:172.21.15.43:3300/0 conn(0x7f625c15ea80 0x7f625c0d1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:23.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.252+0000 7f6263200640 1 -- 172.21.15.42:0/351968020 >> 172.21.15.42:0/351968020 conn(0x7f625c06cf00 msgr2=0x7f625c06d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:23.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.252+0000 7f6263200640 1 -- 172.21.15.42:0/351968020 shutdown_connections 2024-09-17T01:42:23.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.252+0000 7f6263200640 1 -- 172.21.15.42:0/351968020 wait complete. 2024-09-17T01:42:23.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.254+0000 7f6263200640 1 Processor -- start 2024-09-17T01:42:23.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.254+0000 7f6263200640 1 -- start start 2024-09-17T01:42:23.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.256+0000 7f6263200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f625c0d18b0 0x7f625c156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:23.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.256+0000 7f6263200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f625c0d2d80 0x7f625c1f7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:23.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.256+0000 7f6263200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f625c15ea80 0x7f625c14b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:23.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.256+0000 7f6263200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f625c0b69d0 con 0x7f625c0d18b0 2024-09-17T01:42:23.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.256+0000 7f6263200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f625c0b6850 con 0x7f625c15ea80 2024-09-17T01:42:23.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.256+0000 7f6263200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f625c0b6b50 con 0x7f625c0d2d80 2024-09-17T01:42:23.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.256+0000 7f6261e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f625c0d18b0 0x7f625c156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:23.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.256+0000 7f6261e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f625c0d18b0 0x7f625c156ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33812/0 (socket says 172.21.15.42:33812) 2024-09-17T01:42:23.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.256+0000 7f6261e00640 1 -- 172.21.15.42:0/1333192140 learned_addr learned my addr 172.21.15.42:0/1333192140 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:23.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.256+0000 7f6261400640 1 --2- 172.21.15.42:0/1333192140 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f625c0d2d80 0x7f625c1f7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:23.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.256+0000 7f6262800640 1 --2- 172.21.15.42:0/1333192140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f625c15ea80 0x7f625c14b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:23.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.256+0000 7f6261e00640 1 -- 172.21.15.42:0/1333192140 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f625c0d2d80 msgr2=0x7f625c1f7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:23.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.256+0000 7f6261e00640 1 --2- 172.21.15.42:0/1333192140 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f625c0d2d80 0x7f625c1f7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:23.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.256+0000 7f6261e00640 1 -- 172.21.15.42:0/1333192140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f625c15ea80 msgr2=0x7f625c14b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:23.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.256+0000 7f6261e00640 1 --2- 172.21.15.42:0/1333192140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f625c15ea80 0x7f625c14b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:23.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.256+0000 7f6261e00640 1 -- 172.21.15.42:0/1333192140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625c155e30 con 0x7f625c0d18b0 2024-09-17T01:42:23.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.257+0000 7f6261e00640 1 --2- 172.21.15.42:0/1333192140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f625c0d18b0 0x7f625c156ed0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f625000e790 tx=0x7f625000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:23.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.257+0000 7f6256000640 1 -- 172.21.15.42:0/1333192140 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625000eea0 con 0x7f625c0d18b0 2024-09-17T01:42:23.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.257+0000 7f6256000640 1 -- 172.21.15.42:0/1333192140 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f625000cdb0 con 0x7f625c0d18b0 2024-09-17T01:42:23.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.257+0000 7f6263200640 1 -- 172.21.15.42:0/1333192140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f625c156110 con 0x7f625c0d18b0 2024-09-17T01:42:23.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.257+0000 7f6256000640 1 -- 172.21.15.42:0/1333192140 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6250010690 con 0x7f625c0d18b0 2024-09-17T01:42:23.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.257+0000 7f6263200640 1 -- 172.21.15.42:0/1333192140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f625c1566d0 con 0x7f625c0d18b0 2024-09-17T01:42:23.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.258+0000 7f6263200640 1 -- 172.21.15.42:0/1333192140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f625c0b6050 con 0x7f625c0d18b0 2024-09-17T01:42:23.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.260+0000 7f6256000640 1 -- 172.21.15.42:0/1333192140 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6250010830 con 0x7f625c0d18b0 2024-09-17T01:42:23.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.261+0000 7f6256000640 1 --2- 172.21.15.42:0/1333192140 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6240078bc0 0x7f624007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:23.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.261+0000 7f6256000640 1 -- 172.21.15.42:0/1333192140 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f625009b6f0 con 0x7f625c0d18b0 2024-09-17T01:42:23.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.261+0000 7f6261400640 1 --2- 172.21.15.42:0/1333192140 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6240078bc0 0x7f624007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:23.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.262+0000 7f6261400640 1 --2- 172.21.15.42:0/1333192140 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6240078bc0 0x7f624007b0d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f625c0b9ba0 tx=0x7f624c005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:23.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.265+0000 7f6256000640 1 -- 172.21.15.42:0/1333192140 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6250063440 con 0x7f625c0d18b0 2024-09-17T01:42:23.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.500+0000 7f6263200640 1 -- 172.21.15.42:0/1333192140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f625c069870 con 0x7f625c0d18b0 2024-09-17T01:42:23.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.501+0000 7f6256000640 1 -- 172.21.15.42:0/1333192140 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5231 (secure 0 0 0) 0x7f6250067e70 con 0x7f625c0d18b0 2024-09-17T01:42:23.499 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:23.499 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2491855232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2491855232},{"type":"v1","addr":"172.21.15.43:6835","nonce":2491855232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4136787983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4136787983},{"type":"v1","addr":"172.21.15.43:6837","nonce":4136787983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/3441664627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3441664627},{"type":"v1","addr":"172.21.15.42:6834","nonce":3441664627}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:41:39.382305+0000","modified":"2024-09-17T01:41:42.412964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8442":{"gid":8442,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3060441721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3060441721},{"type":"v1","addr":"172.21.15.42:6835","nonce":3060441721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8442,"qdb_cluster":[8442]},"id":9}]} 2024-09-17T01:42:23.499 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 107 2024-09-17T01:42:23.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.503+0000 7f6263200640 1 -- 172.21.15.42:0/1333192140 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6240078bc0 msgr2=0x7f624007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:23.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.503+0000 7f6263200640 1 --2- 172.21.15.42:0/1333192140 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6240078bc0 0x7f624007b0d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f625c0b9ba0 tx=0x7f624c005f90 comp rx=0 tx=0).stop 2024-09-17T01:42:23.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.503+0000 7f6263200640 1 -- 172.21.15.42:0/1333192140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f625c0d18b0 msgr2=0x7f625c156ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:23.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.503+0000 7f6263200640 1 --2- 172.21.15.42:0/1333192140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f625c0d18b0 0x7f625c156ed0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f625000e790 tx=0x7f625000ec50 comp rx=0 tx=0).stop 2024-09-17T01:42:23.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.503+0000 7f6263200640 1 -- 172.21.15.42:0/1333192140 shutdown_connections 2024-09-17T01:42:23.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.503+0000 7f6263200640 1 --2- 172.21.15.42:0/1333192140 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6240078bc0 0x7f624007b0d0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:23.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.503+0000 7f6263200640 1 --2- 172.21.15.42:0/1333192140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f625c15ea80 0x7f625c14b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:23.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.503+0000 7f6263200640 1 --2- 172.21.15.42:0/1333192140 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f625c0d2d80 0x7f625c1f7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:23.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.503+0000 7f6263200640 1 --2- 172.21.15.42:0/1333192140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f625c0d18b0 0x7f625c156ed0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:23.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.503+0000 7f6263200640 1 -- 172.21.15.42:0/1333192140 >> 172.21.15.42:0/1333192140 conn(0x7f625c06cf00 msgr2=0x7f625c0cd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:23.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.503+0000 7f6263200640 1 -- 172.21.15.42:0/1333192140 shutdown_connections 2024-09-17T01:42:23.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.504+0000 7f6263200640 1 -- 172.21.15.42:0/1333192140 wait complete. 2024-09-17T01:42:23.525 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-17T01:42:23.526 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:42:23.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.754+0000 7fc02ba00640 1 -- 172.21.15.42:0/1955757629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc02406d430 msgr2=0x7fc02406d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:23.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.754+0000 7fc02ba00640 1 --2- 172.21.15.42:0/1955757629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc02406d430 0x7fc02406d840 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fc01c005fd0 tx=0x7fc01c02aa90 comp rx=0 tx=0).stop 2024-09-17T01:42:23.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.754+0000 7fc02ba00640 1 -- 172.21.15.42:0/1955757629 shutdown_connections 2024-09-17T01:42:23.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.754+0000 7fc02ba00640 1 --2- 172.21.15.42:0/1955757629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc02406d430 0x7fc02406d840 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:23.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.754+0000 7fc02ba00640 1 --2- 172.21.15.42:0/1955757629 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc0240af980 0x7fc0240ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:23.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.754+0000 7fc02ba00640 1 -- 172.21.15.42:0/1955757629 >> 172.21.15.42:0/1955757629 conn(0x7fc0240b2930 msgr2=0x7fc02406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:23.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.754+0000 7fc02ba00640 1 -- 172.21.15.42:0/1955757629 shutdown_connections 2024-09-17T01:42:23.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.754+0000 7fc02ba00640 1 -- 172.21.15.42:0/1955757629 wait complete. 2024-09-17T01:42:23.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.757+0000 7fc02ba00640 1 Processor -- start 2024-09-17T01:42:23.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.757+0000 7fc02ba00640 1 -- start start 2024-09-17T01:42:23.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.758+0000 7fc02ba00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc02406d430 0x7fc024141c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:23.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.758+0000 7fc02ba00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0240af980 0x7fc024151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:23.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.758+0000 7fc02ba00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0240b3880 0x7fc0241575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:23.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.758+0000 7fc02ba00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc024072ad0 con 0x7fc0240b3880 2024-09-17T01:42:23.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.758+0000 7fc02ba00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc024072950 con 0x7fc0240af980 2024-09-17T01:42:23.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.758+0000 7fc02ba00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc024072c50 con 0x7fc02406d430 2024-09-17T01:42:23.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.758+0000 7fc029a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0240b3880 0x7fc0241575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:23.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.759+0000 7fc029a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0240b3880 0x7fc0241575f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33826/0 (socket says 172.21.15.42:33826) 2024-09-17T01:42:23.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.759+0000 7fc029a00640 1 -- 172.21.15.42:0/1269942049 learned_addr learned my addr 172.21.15.42:0/1269942049 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:23.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.759+0000 7fc01be00640 1 --2- 172.21.15.42:0/1269942049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0240af980 0x7fc024151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:23.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.759+0000 7fc029000640 1 --2- 172.21.15.42:0/1269942049 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc02406d430 0x7fc024141c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:23.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.759+0000 7fc029a00640 1 -- 172.21.15.42:0/1269942049 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc02406d430 msgr2=0x7fc024141c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:23.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.759+0000 7fc029a00640 1 --2- 172.21.15.42:0/1269942049 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc02406d430 0x7fc024141c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:23.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.759+0000 7fc029a00640 1 -- 172.21.15.42:0/1269942049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0240af980 msgr2=0x7fc024151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:23.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.759+0000 7fc029a00640 1 --2- 172.21.15.42:0/1269942049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0240af980 0x7fc024151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:23.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.759+0000 7fc029a00640 1 -- 172.21.15.42:0/1269942049 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc024150770 con 0x7fc0240b3880 2024-09-17T01:42:23.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.759+0000 7fc029000640 1 --2- 172.21.15.42:0/1269942049 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc02406d430 0x7fc024141c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:42:23.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.759+0000 7fc029a00640 1 --2- 172.21.15.42:0/1269942049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0240b3880 0x7fc0241575f0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fc01c006010 tx=0x7fc01c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:23.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.759+0000 7fc021600640 1 -- 172.21.15.42:0/1269942049 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c044070 con 0x7fc0240b3880 2024-09-17T01:42:23.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.760+0000 7fc021600640 1 -- 172.21.15.42:0/1269942049 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc01c02e7f0 con 0x7fc0240b3880 2024-09-17T01:42:23.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.760+0000 7fc021600640 1 -- 172.21.15.42:0/1269942049 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c0044b0 con 0x7fc0240b3880 2024-09-17T01:42:23.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.760+0000 7fc02ba00640 1 -- 172.21.15.42:0/1269942049 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc024150a50 con 0x7fc0240b3880 2024-09-17T01:42:23.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.760+0000 7fc02ba00640 1 -- 172.21.15.42:0/1269942049 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc024151010 con 0x7fc0240b3880 2024-09-17T01:42:23.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.761+0000 7fc02ba00640 1 -- 172.21.15.42:0/1269942049 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0241504e0 con 0x7fc0240b3880 2024-09-17T01:42:23.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.762+0000 7fc021600640 1 -- 172.21.15.42:0/1269942049 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc01c047070 con 0x7fc0240b3880 2024-09-17T01:42:23.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.763+0000 7fc021600640 1 --2- 172.21.15.42:0/1269942049 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc000078b90 0x7fc00007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:23.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.763+0000 7fc021600640 1 -- 172.21.15.42:0/1269942049 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7fc01c0bbc10 con 0x7fc0240b3880 2024-09-17T01:42:23.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.763+0000 7fc029000640 1 --2- 172.21.15.42:0/1269942049 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc000078b90 0x7fc00007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:23.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.764+0000 7fc029000640 1 --2- 172.21.15.42:0/1269942049 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc000078b90 0x7fc00007b0a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc0140016a0 tx=0x7fc014009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:23.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:23.767+0000 7fc021600640 1 -- 172.21.15.42:0/1269942049 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc02406dd80 con 0x7fc0240b3880 2024-09-17T01:42:24.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.036+0000 7fc02ba00640 1 -- 172.21.15.42:0/1269942049 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc02406d840 con 0x7fc0240b3880 2024-09-17T01:42:24.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.036+0000 7fc021600640 1 -- 172.21.15.42:0/1269942049 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1674 (secure 0 0 0) 0x7fc01c032030 con 0x7fc0240b3880 2024-09-17T01:42:24.034 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:24.035 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":644,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":136,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1077002915,"bytes_used":2580774912,"bytes_avail":770513338368,"bytes_total":773094113280,"write_bytes_sec":25221884,"read_op_per_sec":0,"write_op_per_sec":43},"fsmap":{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8442}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-17T01:42:23.159317+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:42:24.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.039+0000 7fc02ba00640 1 -- 172.21.15.42:0/1269942049 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc000078b90 msgr2=0x7fc00007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:24.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.039+0000 7fc02ba00640 1 --2- 172.21.15.42:0/1269942049 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc000078b90 0x7fc00007b0a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc0140016a0 tx=0x7fc014009040 comp rx=0 tx=0).stop 2024-09-17T01:42:24.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.039+0000 7fc02ba00640 1 -- 172.21.15.42:0/1269942049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0240b3880 msgr2=0x7fc0241575f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:24.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.039+0000 7fc02ba00640 1 --2- 172.21.15.42:0/1269942049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0240b3880 0x7fc0241575f0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fc01c006010 tx=0x7fc01c003f10 comp rx=0 tx=0).stop 2024-09-17T01:42:24.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.039+0000 7fc02ba00640 1 -- 172.21.15.42:0/1269942049 shutdown_connections 2024-09-17T01:42:24.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.039+0000 7fc02ba00640 1 --2- 172.21.15.42:0/1269942049 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc000078b90 0x7fc00007b0a0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.039+0000 7fc02ba00640 1 --2- 172.21.15.42:0/1269942049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0240af980 0x7fc024151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.039+0000 7fc02ba00640 1 --2- 172.21.15.42:0/1269942049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0240b3880 0x7fc0241575f0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.039+0000 7fc02ba00640 1 --2- 172.21.15.42:0/1269942049 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc02406d430 0x7fc024141c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.039+0000 7fc02ba00640 1 -- 172.21.15.42:0/1269942049 >> 172.21.15.42:0/1269942049 conn(0x7fc0240b2930 msgr2=0x7fc024073ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:24.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.039+0000 7fc02ba00640 1 -- 172.21.15.42:0/1269942049 shutdown_connections 2024-09-17T01:42:24.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.039+0000 7fc02ba00640 1 -- 172.21.15.42:0/1269942049 wait complete. 2024-09-17T01:42:24.060 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/scrub_control_test_path]'} 2024-09-17T01:42:24.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:42:24.061 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub resume 2024-09-17T01:42:24.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.292+0000 7fa299a00640 1 -- 172.21.15.42:0/2636686264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2940b3880 msgr2=0x7fa2940af980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:24.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.292+0000 7fa299a00640 1 --2- 172.21.15.42:0/2636686264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2940b3880 0x7fa2940af980 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fa284005fd0 tx=0x7fa28402a670 comp rx=0 tx=0).stop 2024-09-17T01:42:24.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.293+0000 7fa299a00640 1 -- 172.21.15.42:0/2636686264 shutdown_connections 2024-09-17T01:42:24.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.293+0000 7fa299a00640 1 --2- 172.21.15.42:0/2636686264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2940b3880 0x7fa2940af980 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.293+0000 7fa299a00640 1 -- 172.21.15.42:0/2636686264 >> 172.21.15.42:0/2636686264 conn(0x7fa2940b2930 msgr2=0x7fa29406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:24.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.293+0000 7fa299a00640 1 -- 172.21.15.42:0/2636686264 shutdown_connections 2024-09-17T01:42:24.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.293+0000 7fa299a00640 1 -- 172.21.15.42:0/2636686264 wait complete. 2024-09-17T01:42:24.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.295+0000 7fa299a00640 1 Processor -- start 2024-09-17T01:42:24.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.295+0000 7fa299a00640 1 -- start start 2024-09-17T01:42:24.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.296+0000 7fa299a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa29406d430 0x7fa29406e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.296+0000 7fa299a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2940b3880 0x7fa294154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.296+0000 7fa299a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa29415cfc0 0x7fa2940ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.296+0000 7fa299a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa294073cf0 con 0x7fa29406d430 2024-09-17T01:42:24.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.296+0000 7fa299a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa294073b70 con 0x7fa2940b3880 2024-09-17T01:42:24.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.296+0000 7fa299a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa294073e70 con 0x7fa29415cfc0 2024-09-17T01:42:24.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.297+0000 7fa292a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa29406d430 0x7fa29406e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.297+0000 7fa292a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa29406d430 0x7fa29406e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33840/0 (socket says 172.21.15.42:33840) 2024-09-17T01:42:24.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.297+0000 7fa292a00640 1 -- 172.21.15.42:0/3656861021 learned_addr learned my addr 172.21.15.42:0/3656861021 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:24.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.297+0000 7fa28be00640 1 --2- 172.21.15.42:0/3656861021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2940b3880 0x7fa294154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.297+0000 7fa293400640 1 --2- 172.21.15.42:0/3656861021 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa29415cfc0 0x7fa2940ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.297+0000 7fa292a00640 1 -- 172.21.15.42:0/3656861021 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa29415cfc0 msgr2=0x7fa2940ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:24.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.297+0000 7fa292a00640 1 --2- 172.21.15.42:0/3656861021 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa29415cfc0 0x7fa2940ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.297+0000 7fa292a00640 1 -- 172.21.15.42:0/3656861021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2940b3880 msgr2=0x7fa294154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:24.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.297+0000 7fa292a00640 1 --2- 172.21.15.42:0/3656861021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2940b3880 0x7fa294154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.297+0000 7fa292a00640 1 -- 172.21.15.42:0/3656861021 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa29406f240 con 0x7fa29406d430 2024-09-17T01:42:24.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.297+0000 7fa293400640 1 --2- 172.21.15.42:0/3656861021 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa29415cfc0 0x7fa2940ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:42:24.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.297+0000 7fa292a00640 1 --2- 172.21.15.42:0/3656861021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa29406d430 0x7fa29406e1c0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fa284006010 tx=0x7fa2840039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:24.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.298+0000 7fa28aa00640 1 -- 172.21.15.42:0/3656861021 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28403e030 con 0x7fa29406d430 2024-09-17T01:42:24.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.298+0000 7fa28aa00640 1 -- 172.21.15.42:0/3656861021 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2840047a0 con 0x7fa29406d430 2024-09-17T01:42:24.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.298+0000 7fa299a00640 1 -- 172.21.15.42:0/3656861021 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa29406ec80 con 0x7fa29406d430 2024-09-17T01:42:24.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.298+0000 7fa28aa00640 1 -- 172.21.15.42:0/3656861021 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa284035040 con 0x7fa29406d430 2024-09-17T01:42:24.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.298+0000 7fa299a00640 1 -- 172.21.15.42:0/3656861021 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa294155e00 con 0x7fa29406d430 2024-09-17T01:42:24.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.300+0000 7fa28aa00640 1 -- 172.21.15.42:0/3656861021 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa284041030 con 0x7fa29406d430 2024-09-17T01:42:24.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.301+0000 7fa28aa00640 1 --2- 172.21.15.42:0/3656861021 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa270078b90 0x7fa27007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.301+0000 7fa28aa00640 1 -- 172.21.15.42:0/3656861021 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7fa2840bb650 con 0x7fa29406d430 2024-09-17T01:42:24.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.302+0000 7fa2a0a3a740 1 Processor -- start 2024-09-17T01:42:24.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.302+0000 7fa28be00640 1 --2- 172.21.15.42:0/3656861021 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa270078b90 0x7fa27007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.302+0000 7fa2a0a3a740 1 -- start start 2024-09-17T01:42:24.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.303+0000 7fa28be00640 1 --2- 172.21.15.42:0/3656861021 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa270078b90 0x7fa27007b0a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa29406f960 tx=0x7fa27c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:24.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.303+0000 7fa2a0a3a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98f16390 0x55eb99304550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.303+0000 7fa2a0a3a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb98eed4d0 0x55eb992e7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.303+0000 7fa2a0a3a740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb98ef56b0 0x55eb992e7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.303+0000 7fa2a0a3a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55eb9921d1c0 con 0x55eb98f16390 2024-09-17T01:42:24.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.303+0000 7fa2a0a3a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55eb99230870 con 0x55eb98eed4d0 2024-09-17T01:42:24.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.303+0000 7fa2a0a3a740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55eb9921fca0 con 0x55eb98ef56b0 2024-09-17T01:42:24.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.304+0000 7fa292a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98f16390 0x55eb99304550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.304+0000 7fa292a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98f16390 0x55eb99304550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33850/0 (socket says 172.21.15.42:33850) 2024-09-17T01:42:24.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.304+0000 7fa292a00640 1 -- 172.21.15.42:0/1562238058 learned_addr learned my addr 172.21.15.42:0/1562238058 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:24.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.304+0000 7fa28be00640 1 --2- 172.21.15.42:0/1562238058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb98eed4d0 0x55eb992e7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.304+0000 7fa293400640 1 --2- 172.21.15.42:0/1562238058 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb98ef56b0 0x55eb992e7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.304+0000 7fa292a00640 1 -- 172.21.15.42:0/1562238058 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb98ef56b0 msgr2=0x55eb992e7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:24.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.304+0000 7fa292a00640 1 --2- 172.21.15.42:0/1562238058 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb98ef56b0 0x55eb992e7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.304+0000 7fa292a00640 1 -- 172.21.15.42:0/1562238058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb98eed4d0 msgr2=0x55eb992e7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:24.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.304+0000 7fa292a00640 1 --2- 172.21.15.42:0/1562238058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb98eed4d0 0x55eb992e7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.304+0000 7fa292a00640 1 -- 172.21.15.42:0/1562238058 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb98ff87d0 con 0x55eb98f16390 2024-09-17T01:42:24.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.304+0000 7fa293400640 1 --2- 172.21.15.42:0/1562238058 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb98ef56b0 0x55eb992e7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:42:24.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.304+0000 7fa292a00640 1 --2- 172.21.15.42:0/1562238058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98f16390 0x55eb99304550 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fa2840830a0 tx=0x7fa284083170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d186e7d09b16b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:24.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.304+0000 7fa283400640 1 -- 172.21.15.42:0/1562238058 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa284048030 con 0x55eb98f16390 2024-09-17T01:42:24.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.305+0000 7fa283400640 1 -- 172.21.15.42:0/1562238058 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa284082eb0 con 0x55eb98f16390 2024-09-17T01:42:24.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.305+0000 7fa283400640 1 -- 172.21.15.42:0/1562238058 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28408caa0 con 0x55eb98f16390 2024-09-17T01:42:24.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.305+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/1562238058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98f16390 msgr2=0x55eb99304550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:24.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.305+0000 7fa2a0a3a740 1 --2- 172.21.15.42:0/1562238058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98f16390 0x55eb99304550 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fa2840830a0 tx=0x7fa284083170 comp rx=0 tx=0).stop 2024-09-17T01:42:24.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.305+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/1562238058 shutdown_connections 2024-09-17T01:42:24.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.305+0000 7fa2a0a3a740 1 --2- 172.21.15.42:0/1562238058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb98eed4d0 0x55eb992e7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.305+0000 7fa2a0a3a740 1 --2- 172.21.15.42:0/1562238058 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb98ef56b0 0x55eb992e7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.305+0000 7fa2a0a3a740 1 --2- 172.21.15.42:0/1562238058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98f16390 0x55eb99304550 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.305+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/1562238058 >> 172.21.15.42:0/1562238058 conn(0x55eb98f0a4e0 msgr2=0x55eb992bd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:24.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.305+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/1562238058 shutdown_connections 2024-09-17T01:42:24.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.305+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/1562238058 wait complete. 2024-09-17T01:42:24.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.306+0000 7fa2a0a3a740 1 -- start start 2024-09-17T01:42:24.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.307+0000 7fa2a0a3a740 1 Processor -- start 2024-09-17T01:42:24.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.308+0000 7fa2a0a3a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98eed4d0 0x55eb99315410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.308+0000 7fa2a0a3a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb98ef56b0 0x55eb992bd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.308+0000 7fa2a0a3a740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb98f16390 0x55eb992bd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.308+0000 7fa2a0a3a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55eb991c6410 con 0x55eb98eed4d0 2024-09-17T01:42:24.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.308+0000 7fa2a0a3a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55eb99223ab0 con 0x55eb98ef56b0 2024-09-17T01:42:24.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.308+0000 7fa2a0a3a740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55eb98f90740 con 0x55eb98f16390 2024-09-17T01:42:24.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.308+0000 7fa2a0a3a740 10 client.0 _ll_register_callbacks cb 0x55eb991a3360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:42:24.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.308+0000 7fa292a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98eed4d0 0x55eb99315410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.309+0000 7fa292a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98eed4d0 0x55eb99315410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33858/0 (socket says 172.21.15.42:33858) 2024-09-17T01:42:24.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.309+0000 7fa292a00640 1 -- 172.21.15.42:0/2509559870 learned_addr learned my addr 172.21.15.42:0/2509559870 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:24.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.309+0000 7fa293400640 1 --2- 172.21.15.42:0/2509559870 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb98f16390 0x55eb992bd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.309+0000 7fa28be00640 1 --2- 172.21.15.42:0/2509559870 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb98ef56b0 0x55eb992bd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.309+0000 7fa292a00640 1 -- 172.21.15.42:0/2509559870 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb98f16390 msgr2=0x55eb992bd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:24.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.309+0000 7fa292a00640 1 --2- 172.21.15.42:0/2509559870 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb98f16390 0x55eb992bd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.309+0000 7fa292a00640 1 -- 172.21.15.42:0/2509559870 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb98ef56b0 msgr2=0x55eb992bd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:24.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.309+0000 7fa292a00640 1 --2- 172.21.15.42:0/2509559870 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb98ef56b0 0x55eb992bd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.309+0000 7fa292a00640 1 -- 172.21.15.42:0/2509559870 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb98f81970 con 0x55eb98eed4d0 2024-09-17T01:42:24.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.309+0000 7fa293400640 1 --2- 172.21.15.42:0/2509559870 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb98f16390 0x55eb992bd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:42:24.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.309+0000 7fa28be00640 1 --2- 172.21.15.42:0/2509559870 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb98ef56b0 0x55eb992bd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:42:24.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.309+0000 7fa292a00640 1 --2- 172.21.15.42:0/2509559870 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98eed4d0 0x55eb99315410 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fa2840830a0 tx=0x7fa28408cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151326896441d784 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:24.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.309+0000 7fa277e00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:42:24.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.309+0000 7fa277e00640 1 -- 172.21.15.42:0/2509559870 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2840833a0 con 0x55eb98eed4d0 2024-09-17T01:42:24.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.309+0000 7fa277e00640 1 -- 172.21.15.42:0/2509559870 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7fa284082810 con 0x55eb98eed4d0 2024-09-17T01:42:24.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.309+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/2509559870 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa284082eb0 con 0x55eb98eed4d0 2024-09-17T01:42:24.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.310+0000 7fa277e00640 1 -- 172.21.15.42:0/2509559870 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7fa2840a2050 con 0x55eb98eed4d0 2024-09-17T01:42:24.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.310+0000 7fa2a0a3a740 10 client.8718 fetch_fsmap learned FSMap version 107 2024-09-17T01:42:24.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.310+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/2509559870 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x55eb98f5f6a0 con 0x55eb98eed4d0 2024-09-17T01:42:24.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.310+0000 7fa277e00640 1 -- 172.21.15.42:0/2509559870 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa284082eb0 con 0x55eb98eed4d0 2024-09-17T01:42:24.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.310+0000 7fa277e00640 1 -- 172.21.15.42:0/2509559870 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7fa2840a5080 con 0x55eb98eed4d0 2024-09-17T01:42:24.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.310+0000 7fa2a0a3a740 10 client.8718 fetch_fsmap finished waiting for FSMap version 107 2024-09-17T01:42:24.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.310+0000 7fa2a0a3a740 10 client.8718 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-17T01:42:24.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.310+0000 7fa2a0a3a740 20 client.8718 populate_metadata read hostname 'smithi042' 2024-09-17T01:42:24.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.310+0000 7fa2a0a3a740 1 --2- 172.21.15.42:0/2509559870 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x55eb98ed4f60 0x55eb99311ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.310+0000 7fa2a0a3a740 4 client.8718 mds_command: new command op to 8442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:42:24.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.310+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/2509559870 --> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb992327c0 con 0x55eb98ed4f60 2024-09-17T01:42:24.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.310+0000 7fa28be00640 1 --2- 172.21.15.42:0/2509559870 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x55eb98ed4f60 0x55eb99311ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.311+0000 7fa28be00640 1 --2- 172.21.15.42:0/2509559870 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x55eb98ed4f60 0x55eb99311ce0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ee2c67a991fc8e5 server_cookie=3fd70b41feeccbdc in_seq=0 out_seq=0 2024-09-17T01:42:24.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.311+0000 7fa277e00640 10 client.8718 ms_handle_connect on v2:172.21.15.42:6833/3060441721 2024-09-17T01:42:24.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.312+0000 7fa277e00640 1 -- 172.21.15.42:0/2509559870 <== mds.0 v2:172.21.15.42:6833/3060441721 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eb992327c0 con 0x55eb98ed4f60 2024-09-17T01:42:24.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.312+0000 7fa277e00640 10 client.8718 handle_command_reply: tid=0 2024-09-17T01:42:24.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.312+0000 7fa2a0a3a740 1 client.8718 shutdown 2024-09-17T01:42:24.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.312+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/2509559870 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98eed4d0 msgr2=0x55eb99315410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:24.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.312+0000 7fa2a0a3a740 1 --2- 172.21.15.42:0/2509559870 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98eed4d0 0x55eb99315410 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fa2840830a0 tx=0x7fa28408cab0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.312+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/2509559870 shutdown_connections 2024-09-17T01:42:24.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.312+0000 7fa2a0a3a740 1 --2- 172.21.15.42:0/2509559870 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x55eb98ed4f60 0x55eb99311ce0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.312+0000 7fa2a0a3a740 1 --2- 172.21.15.42:0/2509559870 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb98ef56b0 0x55eb992bd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.312+0000 7fa2a0a3a740 1 --2- 172.21.15.42:0/2509559870 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb98f16390 0x55eb992bd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.312+0000 7fa2a0a3a740 1 --2- 172.21.15.42:0/2509559870 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98eed4d0 0x55eb99315410 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.312+0000 7fa277e00640 0 client.8718 ms_handle_reset on v2:172.21.15.42:6833/3060441721 2024-09-17T01:42:24.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.312+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/2509559870 >> 172.21.15.42:0/2509559870 conn(0x55eb98f0a4e0 msgr2=0x55eb993052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:24.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.312+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/2509559870 shutdown_connections 2024-09-17T01:42:24.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.312+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/2509559870 wait complete. 2024-09-17T01:42:24.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.312+0000 7fa2a0a3a740 20 client.8718 trim_cache size 0 max 16384 2024-09-17T01:42:24.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.331+0000 7fa2a0a3a740 1 Processor -- start 2024-09-17T01:42:24.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.331+0000 7fa2a0a3a740 1 -- start start 2024-09-17T01:42:24.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.332+0000 7fa2a0a3a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98eed4d0 0x55eb993050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.332+0000 7fa2a0a3a740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb98ef56b0 0x55eb99302af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.332+0000 7fa2a0a3a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb98f16390 0x55eb992fb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.332+0000 7fa2a0a3a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa2941f9fe0 con 0x55eb98eed4d0 2024-09-17T01:42:24.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.332+0000 7fa2a0a3a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa294149c10 con 0x55eb98f16390 2024-09-17T01:42:24.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.332+0000 7fa2a0a3a740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa294154490 con 0x55eb98ef56b0 2024-09-17T01:42:24.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.332+0000 7fa292a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98eed4d0 0x55eb993050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.332+0000 7fa292a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98eed4d0 0x55eb993050c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33870/0 (socket says 172.21.15.42:33870) 2024-09-17T01:42:24.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.332+0000 7fa292a00640 1 -- 172.21.15.42:0/3351365541 learned_addr learned my addr 172.21.15.42:0/3351365541 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:24.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.332+0000 7fa28be00640 1 --2- 172.21.15.42:0/3351365541 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb98ef56b0 0x55eb99302af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.332+0000 7fa293400640 1 --2- 172.21.15.42:0/3351365541 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb98f16390 0x55eb992fb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.333+0000 7fa292a00640 1 -- 172.21.15.42:0/3351365541 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb98ef56b0 msgr2=0x55eb99302af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:24.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.333+0000 7fa292a00640 1 --2- 172.21.15.42:0/3351365541 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb98ef56b0 0x55eb99302af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.333+0000 7fa292a00640 1 -- 172.21.15.42:0/3351365541 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb98f16390 msgr2=0x55eb992fb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:24.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.333+0000 7fa292a00640 1 --2- 172.21.15.42:0/3351365541 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb98f16390 0x55eb992fb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.333+0000 7fa292a00640 1 -- 172.21.15.42:0/3351365541 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb992b7870 con 0x55eb98eed4d0 2024-09-17T01:42:24.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.333+0000 7fa292a00640 1 --2- 172.21.15.42:0/3351365541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98eed4d0 0x55eb993050c0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fa28402ac60 tx=0x7fa2840b9b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91baab32a5bfd74 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:24.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.333+0000 7fa282a00640 1 -- 172.21.15.42:0/3351365541 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa284048070 con 0x55eb98eed4d0 2024-09-17T01:42:24.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.333+0000 7fa282a00640 1 -- 172.21.15.42:0/3351365541 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa284082eb0 con 0x55eb98eed4d0 2024-09-17T01:42:24.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.333+0000 7fa282a00640 1 -- 172.21.15.42:0/3351365541 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2840833a0 con 0x55eb98eed4d0 2024-09-17T01:42:24.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.334+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/3351365541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98eed4d0 msgr2=0x55eb993050c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:24.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.334+0000 7fa2a0a3a740 1 --2- 172.21.15.42:0/3351365541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98eed4d0 0x55eb993050c0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fa28402ac60 tx=0x7fa2840b9b60 comp rx=0 tx=0).stop 2024-09-17T01:42:24.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.334+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/3351365541 shutdown_connections 2024-09-17T01:42:24.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.334+0000 7fa2a0a3a740 1 --2- 172.21.15.42:0/3351365541 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb98f16390 0x55eb992fb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.334+0000 7fa2a0a3a740 1 --2- 172.21.15.42:0/3351365541 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb98ef56b0 0x55eb99302af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.334+0000 7fa2a0a3a740 1 --2- 172.21.15.42:0/3351365541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98eed4d0 0x55eb993050c0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.334+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/3351365541 >> 172.21.15.42:0/3351365541 conn(0x55eb98f0a4e0 msgr2=0x55eb992bd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:24.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.334+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/3351365541 shutdown_connections 2024-09-17T01:42:24.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.334+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/3351365541 wait complete. 2024-09-17T01:42:24.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.335+0000 7fa2a0a3a740 1 -- start start 2024-09-17T01:42:24.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.335+0000 7fa2a0a3a740 1 Processor -- start 2024-09-17T01:42:24.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.337+0000 7fa2a0a3a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb98eed4d0 0x55eb99301e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.337+0000 7fa2a0a3a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98ef56b0 0x55eb99380c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.337+0000 7fa2a0a3a740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb98f16390 0x55eb99384a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.337+0000 7fa2a0a3a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa2941495c0 con 0x55eb98ef56b0 2024-09-17T01:42:24.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.337+0000 7fa2a0a3a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55eb993856c0 con 0x55eb98eed4d0 2024-09-17T01:42:24.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.337+0000 7fa2a0a3a740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55eb993023d0 con 0x55eb98f16390 2024-09-17T01:42:24.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.337+0000 7fa2a0a3a740 10 client.0 _ll_register_callbacks cb 0x7fa27c017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:42:24.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.337+0000 7fa28be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98ef56b0 0x55eb99380c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.337+0000 7fa28be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98ef56b0 0x55eb99380c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33878/0 (socket says 172.21.15.42:33878) 2024-09-17T01:42:24.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.337+0000 7fa28be00640 1 -- 172.21.15.42:0/2378422503 learned_addr learned my addr 172.21.15.42:0/2378422503 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:24.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.337+0000 7fa292a00640 1 --2- 172.21.15.42:0/2378422503 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb98eed4d0 0x55eb99301e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.337+0000 7fa293400640 1 --2- 172.21.15.42:0/2378422503 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb98f16390 0x55eb99384a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.337+0000 7fa28be00640 1 -- 172.21.15.42:0/2378422503 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb98f16390 msgr2=0x55eb99384a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:24.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.337+0000 7fa28be00640 1 --2- 172.21.15.42:0/2378422503 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb98f16390 0x55eb99384a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.337+0000 7fa28be00640 1 -- 172.21.15.42:0/2378422503 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb98eed4d0 msgr2=0x55eb99301e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:24.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.337+0000 7fa28be00640 1 --2- 172.21.15.42:0/2378422503 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb98eed4d0 0x55eb99301e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.337+0000 7fa28be00640 1 -- 172.21.15.42:0/2378422503 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb99325690 con 0x55eb98ef56b0 2024-09-17T01:42:24.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.337+0000 7fa293400640 1 --2- 172.21.15.42:0/2378422503 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb98f16390 0x55eb99384a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:42:24.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.338+0000 7fa28be00640 1 --2- 172.21.15.42:0/2378422503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98ef56b0 0x55eb99380c10 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fa27c000f60 tx=0x7fa27c001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69670f39349645d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:24.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.338+0000 7fa277e00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:42:24.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.338+0000 7fa277e00640 1 -- 172.21.15.42:0/2378422503 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27c00fe90 con 0x55eb98ef56b0 2024-09-17T01:42:24.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.338+0000 7fa277e00640 1 -- 172.21.15.42:0/2378422503 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7fa27c010040 con 0x55eb98ef56b0 2024-09-17T01:42:24.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.338+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/2378422503 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa284082eb0 con 0x55eb98ef56b0 2024-09-17T01:42:24.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.338+0000 7fa277e00640 1 -- 172.21.15.42:0/2378422503 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7fa27c034050 con 0x55eb98ef56b0 2024-09-17T01:42:24.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.338+0000 7fa2a0a3a740 10 client.8724 fetch_fsmap learned FSMap version 107 2024-09-17T01:42:24.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.338+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/2378422503 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x55eb992fd310 con 0x55eb98ef56b0 2024-09-17T01:42:24.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.338+0000 7fa277e00640 1 -- 172.21.15.42:0/2378422503 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa284082eb0 con 0x55eb98ef56b0 2024-09-17T01:42:24.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.338+0000 7fa277e00640 1 -- 172.21.15.42:0/2378422503 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7fa27c037020 con 0x55eb98ef56b0 2024-09-17T01:42:24.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.338+0000 7fa2a0a3a740 10 client.8724 fetch_fsmap finished waiting for FSMap version 107 2024-09-17T01:42:24.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.338+0000 7fa2a0a3a740 10 client.8724 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-17T01:42:24.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.338+0000 7fa2a0a3a740 20 client.8724 populate_metadata read hostname 'smithi042' 2024-09-17T01:42:24.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.338+0000 7fa2a0a3a740 1 --2- 172.21.15.42:0/2378422503 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x55eb99384f50 0x55eb9930a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.338+0000 7fa2a0a3a740 4 client.8724 mds_command: new command op to 8442 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-17T01:42:24.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.339+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/2378422503 --> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x55eb9922e270 con 0x55eb99384f50 2024-09-17T01:42:24.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.339+0000 7fa292a00640 1 --2- 172.21.15.42:0/2378422503 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x55eb99384f50 0x55eb9930a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.339+0000 7fa292a00640 1 --2- 172.21.15.42:0/2378422503 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x55eb99384f50 0x55eb9930a580 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67d29961c75eed6c server_cookie=7a16a6d6e1ee04a0 in_seq=0 out_seq=0 2024-09-17T01:42:24.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.339+0000 7fa277e00640 10 client.8724 ms_handle_connect on v2:172.21.15.42:6833/3060441721 2024-09-17T01:42:24.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.341+0000 7fa277e00640 1 -- 172.21.15.42:0/2378422503 <== mds.0 v2:172.21.15.42:6833/3060441721 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55eb9922e270 con 0x55eb99384f50 2024-09-17T01:42:24.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.341+0000 7fa277e00640 10 client.8724 handle_command_reply: tid=0 2024-09-17T01:42:24.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.341+0000 7fa2a0a3a740 1 client.8724 shutdown 2024-09-17T01:42:24.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.341+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/2378422503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98ef56b0 msgr2=0x55eb99380c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:24.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.341+0000 7fa2a0a3a740 1 --2- 172.21.15.42:0/2378422503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98ef56b0 0x55eb99380c10 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fa27c000f60 tx=0x7fa27c001080 comp rx=0 tx=0).stop 2024-09-17T01:42:24.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.341+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/2378422503 shutdown_connections 2024-09-17T01:42:24.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.341+0000 7fa2a0a3a740 1 --2- 172.21.15.42:0/2378422503 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x55eb99384f50 0x55eb9930a580 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.341+0000 7fa2a0a3a740 1 --2- 172.21.15.42:0/2378422503 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55eb98f16390 0x55eb99384a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.341+0000 7fa2a0a3a740 1 --2- 172.21.15.42:0/2378422503 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55eb98ef56b0 0x55eb99380c10 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.341+0000 7fa2a0a3a740 1 --2- 172.21.15.42:0/2378422503 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55eb98eed4d0 0x55eb99301e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.341+0000 7fa277e00640 0 client.8724 ms_handle_reset on v2:172.21.15.42:6833/3060441721 2024-09-17T01:42:24.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.341+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/2378422503 >> 172.21.15.42:0/2378422503 conn(0x55eb98f0a4e0 msgr2=0x55eb992dec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:24.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.341+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/2378422503 shutdown_connections 2024-09-17T01:42:24.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.341+0000 7fa2a0a3a740 1 -- 172.21.15.42:0/2378422503 wait complete. 2024-09-17T01:42:24.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.341+0000 7fa2a0a3a740 20 client.8724 trim_cache size 0 max 16384 2024-09-17T01:42:24.342 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:42:24.342 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0 2024-09-17T01:42:24.342 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:42:24.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.342+0000 7fa299a00640 1 -- 172.21.15.42:0/3656861021 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa270078b90 msgr2=0x7fa27007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:24.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.342+0000 7fa299a00640 1 --2- 172.21.15.42:0/3656861021 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa270078b90 0x7fa27007b0a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa29406f960 tx=0x7fa27c009040 comp rx=0 tx=0).stop 2024-09-17T01:42:24.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.342+0000 7fa299a00640 1 -- 172.21.15.42:0/3656861021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa29406d430 msgr2=0x7fa29406e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:24.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.342+0000 7fa299a00640 1 --2- 172.21.15.42:0/3656861021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa29406d430 0x7fa29406e1c0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fa284006010 tx=0x7fa2840039e0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.343+0000 7fa299a00640 1 -- 172.21.15.42:0/3656861021 shutdown_connections 2024-09-17T01:42:24.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.343+0000 7fa299a00640 1 --2- 172.21.15.42:0/3656861021 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa270078b90 0x7fa27007b0a0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.343+0000 7fa299a00640 1 --2- 172.21.15.42:0/3656861021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2940b3880 0x7fa294154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.343+0000 7fa299a00640 1 --2- 172.21.15.42:0/3656861021 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa29415cfc0 0x7fa2940ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.343+0000 7fa299a00640 1 --2- 172.21.15.42:0/3656861021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa29406d430 0x7fa29406e1c0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.343+0000 7fa299a00640 1 -- 172.21.15.42:0/3656861021 >> 172.21.15.42:0/3656861021 conn(0x7fa2940b2930 msgr2=0x7fa29415f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:24.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.343+0000 7fa299a00640 1 -- 172.21.15.42:0/3656861021 shutdown_connections 2024-09-17T01:42:24.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.343+0000 7fa299a00640 1 -- 172.21.15.42:0/3656861021 wait complete. 2024-09-17T01:42:24.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:42:24.377 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub status 2024-09-17T01:42:24.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.727+0000 7ff4b3800640 1 -- 172.21.15.42:0/2185369026 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4ac0cef70 msgr2=0x7ff4ac156e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:24.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.727+0000 7ff4b3800640 1 --2- 172.21.15.42:0/2185369026 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4ac0cef70 0x7ff4ac156e50 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7ff498005fd0 tx=0x7ff49802a5d0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.727+0000 7ff4b3800640 1 -- 172.21.15.42:0/2185369026 shutdown_connections 2024-09-17T01:42:24.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.727+0000 7ff4b3800640 1 --2- 172.21.15.42:0/2185369026 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff4ac06d430 0x7ff4ac06d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.727+0000 7ff4b3800640 1 --2- 172.21.15.42:0/2185369026 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4ac0cef70 0x7ff4ac156e50 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.727+0000 7ff4b3800640 1 -- 172.21.15.42:0/2185369026 >> 172.21.15.42:0/2185369026 conn(0x7ff4ac0b2930 msgr2=0x7ff4ac06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:24.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.727+0000 7ff4b3800640 1 -- 172.21.15.42:0/2185369026 shutdown_connections 2024-09-17T01:42:24.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.727+0000 7ff4b3800640 1 -- 172.21.15.42:0/2185369026 wait complete. 2024-09-17T01:42:24.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.731+0000 7ff4b3800640 1 Processor -- start 2024-09-17T01:42:24.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.731+0000 7ff4b3800640 1 -- start start 2024-09-17T01:42:24.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.733+0000 7ff4b3800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4ac06d430 0x7ff4ac1564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.734+0000 7ff4b3800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff4ac0b5100 0x7ff4ac144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.734+0000 7ff4b3800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4ac0cef70 0x7ff4ac0aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.734+0000 7ff4b3800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac0729c0 con 0x7ff4ac06d430 2024-09-17T01:42:24.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.734+0000 7ff4b3800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac072840 con 0x7ff4ac0cef70 2024-09-17T01:42:24.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.734+0000 7ff4b3800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff4ac072b40 con 0x7ff4ac0b5100 2024-09-17T01:42:24.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.734+0000 7ff4abe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff4ac0b5100 0x7ff4ac144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.734+0000 7ff4abe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff4ac0b5100 0x7ff4ac144ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:35910/0 (socket says 172.21.15.42:35910) 2024-09-17T01:42:24.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.734+0000 7ff4abe00640 1 -- 172.21.15.42:0/1098522902 learned_addr learned my addr 172.21.15.42:0/1098522902 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:24.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.734+0000 7ff4b0e00640 1 --2- 172.21.15.42:0/1098522902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4ac06d430 0x7ff4ac1564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.734+0000 7ff4b1800640 1 --2- 172.21.15.42:0/1098522902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4ac0cef70 0x7ff4ac0aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.735+0000 7ff4abe00640 1 -- 172.21.15.42:0/1098522902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4ac0cef70 msgr2=0x7ff4ac0aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:24.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.735+0000 7ff4abe00640 1 --2- 172.21.15.42:0/1098522902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4ac0cef70 0x7ff4ac0aa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.735+0000 7ff4abe00640 1 -- 172.21.15.42:0/1098522902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4ac06d430 msgr2=0x7ff4ac1564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:24.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.735+0000 7ff4abe00640 1 --2- 172.21.15.42:0/1098522902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4ac06d430 0x7ff4ac1564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.735+0000 7ff4abe00640 1 -- 172.21.15.42:0/1098522902 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ac0acfe0 con 0x7ff4ac0b5100 2024-09-17T01:42:24.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.735+0000 7ff4abe00640 1 --2- 172.21.15.42:0/1098522902 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff4ac0b5100 0x7ff4ac144ed0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff498006010 tx=0x7ff4980038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:24.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.736+0000 7ff4a8c00640 1 -- 172.21.15.42:0/1098522902 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49803e030 con 0x7ff4ac0b5100 2024-09-17T01:42:24.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.736+0000 7ff4b3800640 1 -- 172.21.15.42:0/1098522902 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4ac0ad2c0 con 0x7ff4ac0b5100 2024-09-17T01:42:24.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.736+0000 7ff4a8c00640 1 -- 172.21.15.42:0/1098522902 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff498003ca0 con 0x7ff4ac0b5100 2024-09-17T01:42:24.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.736+0000 7ff4a8c00640 1 -- 172.21.15.42:0/1098522902 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff498035040 con 0x7ff4ac0b5100 2024-09-17T01:42:24.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.736+0000 7ff4b3800640 1 -- 172.21.15.42:0/1098522902 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4ac0ad880 con 0x7ff4ac0b5100 2024-09-17T01:42:24.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.740+0000 7ff4a8c00640 1 -- 172.21.15.42:0/1098522902 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff498041030 con 0x7ff4ac0b5100 2024-09-17T01:42:24.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.741+0000 7ff4a8c00640 1 --2- 172.21.15.42:0/1098522902 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff48c078b90 0x7ff48c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.742+0000 7ff4a8c00640 1 -- 172.21.15.42:0/1098522902 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7ff4980bb380 con 0x7ff4ac0b5100 2024-09-17T01:42:24.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.742+0000 7ff4b0e00640 1 --2- 172.21.15.42:0/1098522902 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff48c078b90 0x7ff48c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.742+0000 7ff4ba7e3740 1 Processor -- start 2024-09-17T01:42:24.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.743+0000 7ff4ba7e3740 1 -- start start 2024-09-17T01:42:24.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.744+0000 7ff4b0e00640 1 --2- 172.21.15.42:0/1098522902 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff48c078b90 0x7ff48c07b0a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff4a00015e0 tx=0x7ff4a0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:24.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.745+0000 7ff4ba7e3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557f0e365390 0x557f0e753550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.745+0000 7ff4ba7e3740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e33c4d0 0x557f0e736220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.745+0000 7ff4ba7e3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f0e3446b0 0x557f0e736760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.745+0000 7ff4ba7e3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557f0e66c1c0 con 0x557f0e365390 2024-09-17T01:42:24.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.745+0000 7ff4ba7e3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557f0e67f870 con 0x557f0e3446b0 2024-09-17T01:42:24.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.745+0000 7ff4ba7e3740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x557f0e66eca0 con 0x557f0e33c4d0 2024-09-17T01:42:24.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.745+0000 7ff4abe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e33c4d0 0x557f0e736220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.745+0000 7ff4abe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e33c4d0 0x557f0e736220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:35926/0 (socket says 172.21.15.42:35926) 2024-09-17T01:42:24.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.745+0000 7ff4abe00640 1 -- 172.21.15.42:0/4067529791 learned_addr learned my addr 172.21.15.42:0/4067529791 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:24.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.745+0000 7ff4b1800640 1 --2- 172.21.15.42:0/4067529791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f0e3446b0 0x557f0e736760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.746+0000 7ff4b0e00640 1 --2- 172.21.15.42:0/4067529791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557f0e365390 0x557f0e753550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.746+0000 7ff4abe00640 1 -- 172.21.15.42:0/4067529791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f0e3446b0 msgr2=0x557f0e736760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:24.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.746+0000 7ff4abe00640 1 --2- 172.21.15.42:0/4067529791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f0e3446b0 0x557f0e736760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.746+0000 7ff4abe00640 1 -- 172.21.15.42:0/4067529791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557f0e365390 msgr2=0x557f0e753550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:24.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.747+0000 7ff4abe00640 1 --2- 172.21.15.42:0/4067529791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557f0e365390 0x557f0e753550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.747+0000 7ff4abe00640 1 -- 172.21.15.42:0/4067529791 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f0e4477d0 con 0x557f0e33c4d0 2024-09-17T01:42:24.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.747+0000 7ff4b0e00640 1 --2- 172.21.15.42:0/4067529791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557f0e365390 0x557f0e753550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:42:24.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.748+0000 7ff4abe00640 1 --2- 172.21.15.42:0/4067529791 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e33c4d0 0x557f0e736220 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff498082f70 tx=0x7ff498082ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70f4e6def8f09592 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:24.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.748+0000 7ff49d600640 1 -- 172.21.15.42:0/4067529791 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff498048040 con 0x557f0e33c4d0 2024-09-17T01:42:24.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.748+0000 7ff49d600640 1 -- 172.21.15.42:0/4067529791 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff498087b00 con 0x557f0e33c4d0 2024-09-17T01:42:24.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.748+0000 7ff49d600640 1 -- 172.21.15.42:0/4067529791 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49808ca40 con 0x557f0e33c4d0 2024-09-17T01:42:24.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.749+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/4067529791 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e33c4d0 msgr2=0x557f0e736220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:24.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.749+0000 7ff4ba7e3740 1 --2- 172.21.15.42:0/4067529791 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e33c4d0 0x557f0e736220 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff498082f70 tx=0x7ff498082ae0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.749+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/4067529791 shutdown_connections 2024-09-17T01:42:24.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.749+0000 7ff4ba7e3740 1 --2- 172.21.15.42:0/4067529791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f0e3446b0 0x557f0e736760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.749+0000 7ff4ba7e3740 1 --2- 172.21.15.42:0/4067529791 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e33c4d0 0x557f0e736220 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.749+0000 7ff4ba7e3740 1 --2- 172.21.15.42:0/4067529791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557f0e365390 0x557f0e753550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.749+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/4067529791 >> 172.21.15.42:0/4067529791 conn(0x557f0e3594e0 msgr2=0x557f0e70c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:24.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.749+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/4067529791 shutdown_connections 2024-09-17T01:42:24.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.750+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/4067529791 wait complete. 2024-09-17T01:42:24.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.751+0000 7ff4ba7e3740 1 -- start start 2024-09-17T01:42:24.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.751+0000 7ff4ba7e3740 1 Processor -- start 2024-09-17T01:42:24.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.753+0000 7ff4ba7e3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f0e33c4d0 0x557f0e74d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.753+0000 7ff4ba7e3740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e3446b0 0x557f0e74e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.753+0000 7ff4ba7e3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557f0e365390 0x557f0e723600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.753+0000 7ff4ba7e3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557f0e615410 con 0x557f0e365390 2024-09-17T01:42:24.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.753+0000 7ff4ba7e3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557f0e672ab0 con 0x557f0e33c4d0 2024-09-17T01:42:24.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.753+0000 7ff4ba7e3740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x557f0e3df740 con 0x557f0e3446b0 2024-09-17T01:42:24.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.753+0000 7ff4ba7e3740 10 client.0 _ll_register_callbacks cb 0x557f0e5f2360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:42:24.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.754+0000 7ff4abe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e3446b0 0x557f0e74e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.754+0000 7ff4b1800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557f0e365390 0x557f0e723600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.754+0000 7ff4abe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e3446b0 0x557f0e74e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:35942/0 (socket says 172.21.15.42:35942) 2024-09-17T01:42:24.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.754+0000 7ff4abe00640 1 -- 172.21.15.42:0/524050168 learned_addr learned my addr 172.21.15.42:0/524050168 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:24.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.754+0000 7ff4b0e00640 1 --2- 172.21.15.42:0/524050168 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f0e33c4d0 0x557f0e74d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.754+0000 7ff4abe00640 1 -- 172.21.15.42:0/524050168 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f0e33c4d0 msgr2=0x557f0e74d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:24.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.754+0000 7ff4abe00640 1 --2- 172.21.15.42:0/524050168 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f0e33c4d0 0x557f0e74d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.754+0000 7ff4abe00640 1 -- 172.21.15.42:0/524050168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557f0e365390 msgr2=0x557f0e723600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:24.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.754+0000 7ff4abe00640 1 --2- 172.21.15.42:0/524050168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557f0e365390 0x557f0e723600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.754+0000 7ff4abe00640 1 -- 172.21.15.42:0/524050168 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x557f0e3d0970 con 0x557f0e3446b0 2024-09-17T01:42:24.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.755+0000 7ff4abe00640 1 --2- 172.21.15.42:0/524050168 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e3446b0 0x557f0e74e280 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff4980a8040 tx=0x7ff49807f570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da536c62cc976e0e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:24.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.755+0000 7ff492000640 10 client.0 ms_handle_connect on v2:172.21.15.43:3301/0 2024-09-17T01:42:24.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.755+0000 7ff492000640 1 -- 172.21.15.42:0/524050168 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff498003e50 con 0x557f0e3446b0 2024-09-17T01:42:24.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.755+0000 7ff492000640 1 -- 172.21.15.42:0/524050168 <== mon.2 v2:172.21.15.43:3301/0 2 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7ff49809d2e0 con 0x557f0e3446b0 2024-09-17T01:42:24.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.755+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/524050168 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff498087b00 con 0x557f0e3446b0 2024-09-17T01:42:24.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.756+0000 7ff492000640 1 -- 172.21.15.42:0/524050168 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7ff49808ca40 con 0x557f0e3446b0 2024-09-17T01:42:24.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.756+0000 7ff4ba7e3740 10 client.7355 fetch_fsmap learned FSMap version 107 2024-09-17T01:42:24.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.756+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/524050168 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x557f0e3ae6a0 con 0x557f0e3446b0 2024-09-17T01:42:24.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.756+0000 7ff492000640 1 -- 172.21.15.42:0/524050168 <== mon.2 v2:172.21.15.43:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff498087b00 con 0x557f0e3446b0 2024-09-17T01:42:24.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.757+0000 7ff492000640 1 -- 172.21.15.42:0/524050168 <== mon.2 v2:172.21.15.43:3301/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7ff4980a5350 con 0x557f0e3446b0 2024-09-17T01:42:24.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.757+0000 7ff4ba7e3740 10 client.7355 fetch_fsmap finished waiting for FSMap version 107 2024-09-17T01:42:24.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.757+0000 7ff4ba7e3740 10 client.7355 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-17T01:42:24.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.757+0000 7ff4ba7e3740 20 client.7355 populate_metadata read hostname 'smithi042' 2024-09-17T01:42:24.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.757+0000 7ff4ba7e3740 1 --2- 172.21.15.42:0/524050168 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x557f0e323f60 0x557f0e70c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.757+0000 7ff4ba7e3740 4 client.7355 mds_command: new command op to 8442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:42:24.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.757+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/524050168 --> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f0e6817c0 con 0x557f0e323f60 2024-09-17T01:42:24.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.758+0000 7ff4b0e00640 1 --2- 172.21.15.42:0/524050168 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x557f0e323f60 0x557f0e70c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.759+0000 7ff4b0e00640 1 --2- 172.21.15.42:0/524050168 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x557f0e323f60 0x557f0e70c3d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6922b729a7c4e295 server_cookie=e7083eba007f0ee2 in_seq=0 out_seq=0 2024-09-17T01:42:24.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.759+0000 7ff492000640 10 client.7355 ms_handle_connect on v2:172.21.15.42:6833/3060441721 2024-09-17T01:42:24.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.761+0000 7ff492000640 1 -- 172.21.15.42:0/524050168 <== mds.0 v2:172.21.15.42:6833/3060441721 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557f0e6817c0 con 0x557f0e323f60 2024-09-17T01:42:24.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.761+0000 7ff492000640 10 client.7355 handle_command_reply: tid=0 2024-09-17T01:42:24.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.761+0000 7ff4ba7e3740 1 client.7355 shutdown 2024-09-17T01:42:24.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.762+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/524050168 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e3446b0 msgr2=0x557f0e74e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:24.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.762+0000 7ff4ba7e3740 1 --2- 172.21.15.42:0/524050168 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e3446b0 0x557f0e74e280 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff4980a8040 tx=0x7ff49807f570 comp rx=0 tx=0).stop 2024-09-17T01:42:24.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.762+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/524050168 shutdown_connections 2024-09-17T01:42:24.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.762+0000 7ff4ba7e3740 1 --2- 172.21.15.42:0/524050168 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x557f0e323f60 0x557f0e70c3d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.762+0000 7ff492000640 0 client.7355 ms_handle_reset on v2:172.21.15.42:6833/3060441721 2024-09-17T01:42:24.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.762+0000 7ff4ba7e3740 1 --2- 172.21.15.42:0/524050168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557f0e365390 0x557f0e723600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.762+0000 7ff4ba7e3740 1 --2- 172.21.15.42:0/524050168 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e3446b0 0x557f0e74e280 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.762+0000 7ff4ba7e3740 1 --2- 172.21.15.42:0/524050168 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f0e33c4d0 0x557f0e74d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.762+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/524050168 >> 172.21.15.42:0/524050168 conn(0x557f0e3594e0 msgr2=0x557f0e754e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:24.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.763+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/524050168 shutdown_connections 2024-09-17T01:42:24.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.763+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/524050168 wait complete. 2024-09-17T01:42:24.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.763+0000 7ff4ba7e3740 20 client.7355 trim_cache size 0 max 16384 2024-09-17T01:42:24.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.791+0000 7ff4ba7e3740 1 Processor -- start 2024-09-17T01:42:24.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.791+0000 7ff4ba7e3740 1 -- start start 2024-09-17T01:42:24.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.794+0000 7ff4ba7e3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f0e323f60 0x557f0e749b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.794+0000 7ff4ba7e3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557f0e33c4d0 0x557f0e705830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.794+0000 7ff4ba7e3740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e3446b0 0x557f0e705d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.794+0000 7ff4ba7e3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac206750 con 0x557f0e33c4d0 2024-09-17T01:42:24.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.794+0000 7ff4ba7e3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac15f400 con 0x557f0e323f60 2024-09-17T01:42:24.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.794+0000 7ff4ba7e3740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff4ac15e760 con 0x557f0e3446b0 2024-09-17T01:42:24.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.795+0000 7ff4b1800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e3446b0 0x557f0e705d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.795+0000 7ff4abe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557f0e33c4d0 0x557f0e705830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.795+0000 7ff4b1800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e3446b0 0x557f0e705d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:35950/0 (socket says 172.21.15.42:35950) 2024-09-17T01:42:24.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.795+0000 7ff4b1800640 1 -- 172.21.15.42:0/1131274313 learned_addr learned my addr 172.21.15.42:0/1131274313 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:24.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.795+0000 7ff4b0e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f0e323f60 0x557f0e749b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.795+0000 7ff4b1800640 1 -- 172.21.15.42:0/1131274313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f0e323f60 msgr2=0x557f0e749b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:24.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.795+0000 7ff4b1800640 1 --2- 172.21.15.42:0/1131274313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f0e323f60 0x557f0e749b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.795+0000 7ff4b1800640 1 -- 172.21.15.42:0/1131274313 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557f0e33c4d0 msgr2=0x557f0e705830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:24.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.796+0000 7ff4b1800640 1 --2- 172.21.15.42:0/1131274313 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557f0e33c4d0 0x557f0e705830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.796+0000 7ff4b1800640 1 -- 172.21.15.42:0/1131274313 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f0e733860 con 0x557f0e3446b0 2024-09-17T01:42:24.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.796+0000 7ff4abe00640 1 --2- 172.21.15.42:0/1131274313 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557f0e33c4d0 0x557f0e705830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:42:24.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.796+0000 7ff4b1800640 1 --2- 172.21.15.42:0/1131274313 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e3446b0 0x557f0e705d70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009e70 tx=0x7ff4a40127c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e5b3310917ee71e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:24.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.796+0000 7ff49cc00640 1 -- 172.21.15.42:0/1131274313 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4004b20 con 0x557f0e3446b0 2024-09-17T01:42:24.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.797+0000 7ff49cc00640 1 -- 172.21.15.42:0/1131274313 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4a4004cc0 con 0x557f0e3446b0 2024-09-17T01:42:24.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.797+0000 7ff49cc00640 1 -- 172.21.15.42:0/1131274313 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4005280 con 0x557f0e3446b0 2024-09-17T01:42:24.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.798+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/1131274313 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e3446b0 msgr2=0x557f0e705d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:24.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.798+0000 7ff4ba7e3740 1 --2- 172.21.15.42:0/1131274313 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e3446b0 0x557f0e705d70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009e70 tx=0x7ff4a40127c0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.798+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/1131274313 shutdown_connections 2024-09-17T01:42:24.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.799+0000 7ff4ba7e3740 1 --2- 172.21.15.42:0/1131274313 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e3446b0 0x557f0e705d70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.799+0000 7ff4ba7e3740 1 --2- 172.21.15.42:0/1131274313 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557f0e33c4d0 0x557f0e705830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.799+0000 7ff4ba7e3740 1 --2- 172.21.15.42:0/1131274313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f0e323f60 0x557f0e749b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.799+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/1131274313 >> 172.21.15.42:0/1131274313 conn(0x557f0e3594e0 msgr2=0x557f0e74c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:24.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.799+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/1131274313 shutdown_connections 2024-09-17T01:42:24.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.799+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/1131274313 wait complete. 2024-09-17T01:42:24.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.800+0000 7ff4ba7e3740 1 -- start start 2024-09-17T01:42:24.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.800+0000 7ff4ba7e3740 1 Processor -- start 2024-09-17T01:42:24.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.803+0000 7ff4ba7e3740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e323f60 0x557f0e752cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.803+0000 7ff4ba7e3740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557f0e33c4d0 0x557f0e705a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.803+0000 7ff4ba7e3740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f0e3446b0 0x557f0e747280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.803+0000 7ff4ba7e3740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557f0e708c90 con 0x557f0e33c4d0 2024-09-17T01:42:24.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.803+0000 7ff4ba7e3740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ac15edb0 con 0x557f0e3446b0 2024-09-17T01:42:24.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.803+0000 7ff4ba7e3740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x557f0e763210 con 0x557f0e323f60 2024-09-17T01:42:24.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.803+0000 7ff4ba7e3740 10 client.0 _ll_register_callbacks cb 0x7ff4a0001280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:42:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.803+0000 7ff4b0e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e323f60 0x557f0e752cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.803+0000 7ff4b0e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e323f60 0x557f0e752cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:35956/0 (socket says 172.21.15.42:35956) 2024-09-17T01:42:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.803+0000 7ff4b0e00640 1 -- 172.21.15.42:0/4171402543 learned_addr learned my addr 172.21.15.42:0/4171402543 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.803+0000 7ff4abe00640 1 --2- 172.21.15.42:0/4171402543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557f0e33c4d0 0x557f0e705a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.803+0000 7ff4b1800640 1 --2- 172.21.15.42:0/4171402543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f0e3446b0 0x557f0e747280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.804+0000 7ff4b0e00640 1 -- 172.21.15.42:0/4171402543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f0e3446b0 msgr2=0x557f0e747280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.804+0000 7ff4b0e00640 1 --2- 172.21.15.42:0/4171402543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f0e3446b0 0x557f0e747280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.804+0000 7ff4b0e00640 1 -- 172.21.15.42:0/4171402543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557f0e33c4d0 msgr2=0x557f0e705a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:42:24.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.804+0000 7ff4b0e00640 1 --2- 172.21.15.42:0/4171402543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557f0e33c4d0 0x557f0e705a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.804+0000 7ff4b0e00640 1 -- 172.21.15.42:0/4171402543 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x557f0e706920 con 0x557f0e323f60 2024-09-17T01:42:24.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.804+0000 7ff4abe00640 1 --2- 172.21.15.42:0/4171402543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557f0e33c4d0 0x557f0e705a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:42:24.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.805+0000 7ff4b1800640 1 --2- 172.21.15.42:0/4171402543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f0e3446b0 0x557f0e747280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:42:24.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.805+0000 7ff4b0e00640 1 --2- 172.21.15.42:0/4171402543 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e323f60 0x557f0e752cd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0007fd0 tx=0x7ff4a0000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1e61648e9ed33e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:24.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.805+0000 7ff492000640 10 client.0 ms_handle_connect on v2:172.21.15.43:3301/0 2024-09-17T01:42:24.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.805+0000 7ff492000640 1 -- 172.21.15.42:0/4171402543 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a000f990 con 0x557f0e323f60 2024-09-17T01:42:24.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.805+0000 7ff492000640 1 -- 172.21.15.42:0/4171402543 <== mon.2 v2:172.21.15.43:3301/0 2 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7ff4a0010040 con 0x557f0e323f60 2024-09-17T01:42:24.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.805+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/4171402543 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4a4004cc0 con 0x557f0e323f60 2024-09-17T01:42:24.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.806+0000 7ff492000640 1 -- 172.21.15.42:0/4171402543 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_get_version_reply(handle=1 version=107) ==== 24+0+0 (secure 0 0 0) 0x7ff4a000fb30 con 0x557f0e323f60 2024-09-17T01:42:24.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.806+0000 7ff4ba7e3740 10 client.7361 fetch_fsmap learned FSMap version 107 2024-09-17T01:42:24.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.806+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/4171402543 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) -- 0x557f0e706080 con 0x557f0e323f60 2024-09-17T01:42:24.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.807+0000 7ff492000640 1 -- 172.21.15.42:0/4171402543 <== mon.2 v2:172.21.15.43:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4a4004cc0 con 0x557f0e323f60 2024-09-17T01:42:24.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.807+0000 7ff492000640 1 -- 172.21.15.42:0/4171402543 <== mon.2 v2:172.21.15.43:3301/0 5 ==== fsmap(e 107) ==== 3502+0+0 (secure 0 0 0) 0x7ff4a0029040 con 0x557f0e323f60 2024-09-17T01:42:24.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.807+0000 7ff4ba7e3740 10 client.7361 fetch_fsmap finished waiting for FSMap version 107 2024-09-17T01:42:24.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.807+0000 7ff4ba7e3740 10 client.7361 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.a 2024-09-17T01:42:24.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.807+0000 7ff4ba7e3740 20 client.7361 populate_metadata read hostname 'smithi042' 2024-09-17T01:42:24.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.807+0000 7ff4ba7e3740 1 --2- 172.21.15.42:0/4171402543 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x557f0e2f93a0 0x557f0e7d33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:24.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.807+0000 7ff4ba7e3740 4 client.7361 mds_command: new command op to 8442 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:42:24.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.807+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/4171402543 --> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557f0e67d270 con 0x557f0e2f93a0 2024-09-17T01:42:24.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.808+0000 7ff4abe00640 1 --2- 172.21.15.42:0/4171402543 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x557f0e2f93a0 0x557f0e7d33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:24.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.809+0000 7ff4abe00640 1 --2- 172.21.15.42:0/4171402543 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x557f0e2f93a0 0x557f0e7d33a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fc34f0a9fe7dc6a server_cookie=f99c0f2182de565b in_seq=0 out_seq=0 2024-09-17T01:42:24.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.809+0000 7ff492000640 10 client.7361 ms_handle_connect on v2:172.21.15.42:6833/3060441721 2024-09-17T01:42:24.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.812+0000 7ff492000640 1 -- 172.21.15.42:0/4171402543 <== mds.0 v2:172.21.15.42:6833/3060441721 1 ==== command_reply(tid 0: 0 ) ==== 8+0+618 (crc 0 0 0) 0x557f0e67d270 con 0x557f0e2f93a0 2024-09-17T01:42:24.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.812+0000 7ff492000640 10 client.7361 handle_command_reply: tid=0 2024-09-17T01:42:24.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.812+0000 7ff4ba7e3740 1 client.7361 shutdown 2024-09-17T01:42:24.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.812+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/4171402543 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e323f60 msgr2=0x557f0e752cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:24.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.812+0000 7ff4ba7e3740 1 --2- 172.21.15.42:0/4171402543 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e323f60 0x557f0e752cd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0007fd0 tx=0x7ff4a0000bc0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.812+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/4171402543 shutdown_connections 2024-09-17T01:42:24.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.812+0000 7ff4ba7e3740 1 --2- 172.21.15.42:0/4171402543 >> [v2:172.21.15.42:6833/3060441721,v1:172.21.15.42:6835/3060441721] conn(0x557f0e2f93a0 0x557f0e7d33a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.812+0000 7ff4ba7e3740 1 --2- 172.21.15.42:0/4171402543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557f0e3446b0 0x557f0e747280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.812+0000 7ff4ba7e3740 1 --2- 172.21.15.42:0/4171402543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557f0e33c4d0 0x557f0e705a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.812+0000 7ff4ba7e3740 1 --2- 172.21.15.42:0/4171402543 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557f0e323f60 0x557f0e752cd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.812+0000 7ff492000640 0 client.7361 ms_handle_reset on v2:172.21.15.42:6833/3060441721 2024-09-17T01:42:24.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.812+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/4171402543 >> 172.21.15.42:0/4171402543 conn(0x557f0e3594e0 msgr2=0x557f0e74dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:24.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.813+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/4171402543 shutdown_connections 2024-09-17T01:42:24.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.813+0000 7ff4ba7e3740 1 -- 172.21.15.42:0/4171402543 wait complete. 2024-09-17T01:42:24.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.813+0000 7ff4ba7e3740 20 client.7361 trim_cache size 0 max 16384 2024-09-17T01:42:24.812 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:42:24.812 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "scrub active (544 inodes in the stack)", 2024-09-17T01:42:24.812 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-09-17T01:42:24.812 INFO:teuthology.orchestra.run.smithi042.stdout: "66cb4c14-2da0-45be-8da9-91bab7343f1d": { 2024-09-17T01:42:24.812 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_control_test_path", 2024-09-17T01:42:24.812 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "66cb4c14-2da0-45be-8da9-91bab7343f1d", 2024-09-17T01:42:24.813 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive" 2024-09-17T01:42:24.813 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:24.813 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:42:24.813 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_stats": { 2024-09-17T01:42:24.813 INFO:teuthology.orchestra.run.smithi042.stdout: "66cb4c14-2da0-45be-8da9-91bab7343f1d": { 2024-09-17T01:42:24.813 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:42:16.070613+0000", 2024-09-17T01:42:24.813 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_control_test_path", 2024-09-17T01:42:24.813 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:42:24.813 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:42:24.813 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:42:24.813 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:42:24.813 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:24.814 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:24.814 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:42:24.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.814+0000 7ff4b3800640 1 -- 172.21.15.42:0/1098522902 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff48c078b90 msgr2=0x7ff48c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:24.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.814+0000 7ff4b3800640 1 --2- 172.21.15.42:0/1098522902 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff48c078b90 0x7ff48c07b0a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff4a00015e0 tx=0x7ff4a0009040 comp rx=0 tx=0).stop 2024-09-17T01:42:24.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.814+0000 7ff4b3800640 1 -- 172.21.15.42:0/1098522902 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff4ac0b5100 msgr2=0x7ff4ac144ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:24.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.814+0000 7ff4b3800640 1 --2- 172.21.15.42:0/1098522902 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff4ac0b5100 0x7ff4ac144ed0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff498006010 tx=0x7ff4980038a0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.814+0000 7ff4b3800640 1 -- 172.21.15.42:0/1098522902 shutdown_connections 2024-09-17T01:42:24.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.814+0000 7ff4b3800640 1 --2- 172.21.15.42:0/1098522902 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff48c078b90 0x7ff48c07b0a0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.814+0000 7ff4b3800640 1 --2- 172.21.15.42:0/1098522902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4ac0cef70 0x7ff4ac0aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.814+0000 7ff4b3800640 1 --2- 172.21.15.42:0/1098522902 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff4ac0b5100 0x7ff4ac144ed0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.814+0000 7ff4b3800640 1 --2- 172.21.15.42:0/1098522902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4ac06d430 0x7ff4ac1564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:24.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.814+0000 7ff4b3800640 1 -- 172.21.15.42:0/1098522902 >> 172.21.15.42:0/1098522902 conn(0x7ff4ac0b2930 msgr2=0x7ff4ac073a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:24.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.814+0000 7ff4b3800640 1 -- 172.21.15.42:0/1098522902 shutdown_connections 2024-09-17T01:42:24.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:24.815+0000 7ff4b3800640 1 -- 172.21.15.42:0/1098522902 wait complete. 2024-09-17T01:42:24.846 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:42:25.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.189+0000 7f81b1400640 1 -- 172.21.15.42:0/4072147236 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81ac162fa0 msgr2=0x7f81ac15e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:25.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.189+0000 7f81b1400640 1 --2- 172.21.15.42:0/4072147236 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81ac162fa0 0x7f81ac15e910 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f8198009830 tx=0x7f819802a4d0 comp rx=0 tx=0).stop 2024-09-17T01:42:25.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.189+0000 7f81b1400640 1 -- 172.21.15.42:0/4072147236 shutdown_connections 2024-09-17T01:42:25.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.189+0000 7f81b1400640 1 --2- 172.21.15.42:0/4072147236 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81ac162fa0 0x7f81ac15e910 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:25.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.189+0000 7f81b1400640 1 --2- 172.21.15.42:0/4072147236 >> v2:172.21.15.43:3300/0 conn(0x7f81ac073340 0x7f81ac0d2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:25.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.189+0000 7f81b1400640 1 -- 172.21.15.42:0/4072147236 >> 172.21.15.42:0/4072147236 conn(0x7f81ac0d1210 msgr2=0x7f81ac0d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:25.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.190+0000 7f81b1400640 1 -- 172.21.15.42:0/4072147236 shutdown_connections 2024-09-17T01:42:25.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.190+0000 7f81b1400640 1 -- 172.21.15.42:0/4072147236 wait complete. 2024-09-17T01:42:25.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.193+0000 7f81b1400640 1 Processor -- start 2024-09-17T01:42:25.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.193+0000 7f81b1400640 1 -- start start 2024-09-17T01:42:25.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.195+0000 7f81b1400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81ac073340 0x7f81ac1f9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:25.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.195+0000 7f81b1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81ac0b6030 0x7f81ac15a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:25.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.195+0000 7f81b1400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81ac162fa0 0x7f81ac0b92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:25.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.195+0000 7f81b1400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac15f850 con 0x7f81ac0b6030 2024-09-17T01:42:25.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.195+0000 7f81b1400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac15f6d0 con 0x7f81ac073340 2024-09-17T01:42:25.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.195+0000 7f81b1400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f81ac15f9d0 con 0x7f81ac162fa0 2024-09-17T01:42:25.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.196+0000 7f81ab400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81ac0b6030 0x7f81ac15a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:25.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.196+0000 7f81ab400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81ac0b6030 0x7f81ac15a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33960/0 (socket says 172.21.15.42:33960) 2024-09-17T01:42:25.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.196+0000 7f81ab400640 1 -- 172.21.15.42:0/3243008541 learned_addr learned my addr 172.21.15.42:0/3243008541 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:25.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.196+0000 7f81abe00640 1 --2- 172.21.15.42:0/3243008541 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81ac073340 0x7f81ac1f9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:25.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.196+0000 7f81b0a00640 1 --2- 172.21.15.42:0/3243008541 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81ac162fa0 0x7f81ac0b92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:25.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.197+0000 7f81ab400640 1 -- 172.21.15.42:0/3243008541 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81ac162fa0 msgr2=0x7f81ac0b92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:25.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.197+0000 7f81ab400640 1 --2- 172.21.15.42:0/3243008541 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81ac162fa0 0x7f81ac0b92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:25.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.197+0000 7f81ab400640 1 -- 172.21.15.42:0/3243008541 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81ac073340 msgr2=0x7f81ac1f9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:25.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.197+0000 7f81ab400640 1 --2- 172.21.15.42:0/3243008541 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81ac073340 0x7f81ac1f9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:25.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.197+0000 7f81ab400640 1 -- 172.21.15.42:0/3243008541 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ac1f9cb0 con 0x7f81ac0b6030 2024-09-17T01:42:25.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.197+0000 7f81ab400640 1 --2- 172.21.15.42:0/3243008541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81ac0b6030 0x7f81ac15a3a0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f8198000c00 tx=0x7f8198033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:25.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.198+0000 7f81a3e00640 1 -- 172.21.15.42:0/3243008541 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8198005c90 con 0x7f81ac0b6030 2024-09-17T01:42:25.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.199+0000 7f81a3e00640 1 -- 172.21.15.42:0/3243008541 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8198031e50 con 0x7f81ac0b6030 2024-09-17T01:42:25.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.199+0000 7f81a3e00640 1 -- 172.21.15.42:0/3243008541 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81980332f0 con 0x7f81ac0b6030 2024-09-17T01:42:25.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.199+0000 7f81b1400640 1 -- 172.21.15.42:0/3243008541 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81ac0c9e40 con 0x7f81ac0b6030 2024-09-17T01:42:25.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.199+0000 7f81b1400640 1 -- 172.21.15.42:0/3243008541 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81ac1f5980 con 0x7f81ac0b6030 2024-09-17T01:42:25.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.201+0000 7f81b1400640 1 -- 172.21.15.42:0/3243008541 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81ac0ca0e0 con 0x7f81ac0b6030 2024-09-17T01:42:25.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.203+0000 7f81a3e00640 1 -- 172.21.15.42:0/3243008541 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8198033490 con 0x7f81ac0b6030 2024-09-17T01:42:25.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.205+0000 7f81a3e00640 1 --2- 172.21.15.42:0/3243008541 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f818c078b90 0x7f818c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:25.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.205+0000 7f81a3e00640 1 -- 172.21.15.42:0/3243008541 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f81980bc0d0 con 0x7f81ac0b6030 2024-09-17T01:42:25.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.206+0000 7f81abe00640 1 --2- 172.21.15.42:0/3243008541 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f818c078b90 0x7f818c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:25.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.207+0000 7f81abe00640 1 --2- 172.21.15.42:0/3243008541 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f818c078b90 0x7f818c07b0a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f819c00bb50 tx=0x7f819c00b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:25.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.211+0000 7f81a3e00640 1 -- 172.21.15.42:0/3243008541 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f81ac1f9cb0 con 0x7f81ac0b6030 2024-09-17T01:42:25.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.603+0000 7f81b1400640 1 -- 172.21.15.42:0/3243008541 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81ac0cac60 con 0x7f81ac0b6030 2024-09-17T01:42:25.602 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:25.603 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2491855232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2491855232},{"type":"v1","addr":"172.21.15.43:6835","nonce":2491855232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4136787983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4136787983},{"type":"v1","addr":"172.21.15.43:6837","nonce":4136787983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/3441664627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3441664627},{"type":"v1","addr":"172.21.15.42:6834","nonce":3441664627}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:41:39.382305+0000","modified":"2024-09-17T01:41:42.412964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8442":{"gid":8442,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3060441721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3060441721},{"type":"v1","addr":"172.21.15.42:6835","nonce":3060441721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8442,"qdb_cluster":[8442]},"id":9}]} 2024-09-17T01:42:25.603 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 107 2024-09-17T01:42:25.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.604+0000 7f81a3e00640 1 -- 172.21.15.42:0/3243008541 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5231 (secure 0 0 0) 0x7f819803f030 con 0x7f81ac0b6030 2024-09-17T01:42:25.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.608+0000 7f81b1400640 1 -- 172.21.15.42:0/3243008541 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f818c078b90 msgr2=0x7f818c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:25.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.608+0000 7f81b1400640 1 --2- 172.21.15.42:0/3243008541 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f818c078b90 0x7f818c07b0a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f819c00bb50 tx=0x7f819c00b2e0 comp rx=0 tx=0).stop 2024-09-17T01:42:25.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.608+0000 7f81b1400640 1 -- 172.21.15.42:0/3243008541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81ac0b6030 msgr2=0x7f81ac15a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:25.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.608+0000 7f81b1400640 1 --2- 172.21.15.42:0/3243008541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81ac0b6030 0x7f81ac15a3a0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f8198000c00 tx=0x7f8198033c90 comp rx=0 tx=0).stop 2024-09-17T01:42:25.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.608+0000 7f81b1400640 1 -- 172.21.15.42:0/3243008541 shutdown_connections 2024-09-17T01:42:25.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.608+0000 7f81b1400640 1 --2- 172.21.15.42:0/3243008541 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f818c078b90 0x7f818c07b0a0 secure :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f819c00bb50 tx=0x7f819c00b2e0 comp rx=0 tx=0).stop 2024-09-17T01:42:25.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.608+0000 7f81b1400640 1 --2- 172.21.15.42:0/3243008541 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81ac162fa0 0x7f81ac0b92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:25.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.608+0000 7f81b1400640 1 --2- 172.21.15.42:0/3243008541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81ac0b6030 0x7f81ac15a3a0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:25.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.608+0000 7f81b1400640 1 --2- 172.21.15.42:0/3243008541 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81ac073340 0x7f81ac1f9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:25.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.608+0000 7f81b1400640 1 -- 172.21.15.42:0/3243008541 >> 172.21.15.42:0/3243008541 conn(0x7f81ac0d1210 msgr2=0x7f81ac0b4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:25.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.608+0000 7f81b1400640 1 -- 172.21.15.42:0/3243008541 shutdown_connections 2024-09-17T01:42:25.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.609+0000 7f81b1400640 1 -- 172.21.15.42:0/3243008541 wait complete. 2024-09-17T01:42:25.643 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-17T01:42:25.644 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:42:25.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.966+0000 7f75e0a00640 1 -- 172.21.15.42:0/673883092 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f75c0003c30 msgr2=0x7f75c0004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:25.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.966+0000 7f75e0a00640 1 --2- 172.21.15.42:0/673883092 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f75c0003c30 0x7f75c0004080 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f75cc001ac0 tx=0x7f75c0005830 comp rx=0 tx=0).stop 2024-09-17T01:42:25.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.966+0000 7f75e0a00640 1 -- 172.21.15.42:0/673883092 shutdown_connections 2024-09-17T01:42:25.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.966+0000 7f75e0a00640 1 --2- 172.21.15.42:0/673883092 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f75c0003c30 0x7f75c0004080 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:25.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.966+0000 7f75e0a00640 1 -- 172.21.15.42:0/673883092 >> 172.21.15.42:0/673883092 conn(0x7f75dc06cf00 msgr2=0x7f75dc06d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:25.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.966+0000 7f75e0a00640 1 -- 172.21.15.42:0/673883092 shutdown_connections 2024-09-17T01:42:25.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.967+0000 7f75e0a00640 1 -- 172.21.15.42:0/673883092 wait complete. 2024-09-17T01:42:25.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.969+0000 7f75e0a00640 1 Processor -- start 2024-09-17T01:42:25.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.970+0000 7f75e0a00640 1 -- start start 2024-09-17T01:42:25.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.972+0000 7f75e0a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75c0003c30 0x7f75dc157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:25.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.972+0000 7f75e0a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f75dc1f92d0 0x7f75dc15d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:25.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.972+0000 7f75e0a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75dc1524b0 0x7f75dc1528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:25.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.972+0000 7f75e0a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f75dc0d1b80 con 0x7f75dc1524b0 2024-09-17T01:42:25.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.972+0000 7f75e0a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f75dc0d1a00 con 0x7f75c0003c30 2024-09-17T01:42:25.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.972+0000 7f75e0a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f75dc0d1d00 con 0x7f75dc1f92d0 2024-09-17T01:42:25.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.972+0000 7f75da800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75c0003c30 0x7f75dc157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:25.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.972+0000 7f75da800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75c0003c30 0x7f75dc157ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:58544/0 (socket says 172.21.15.42:58544) 2024-09-17T01:42:25.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.972+0000 7f75da800640 1 -- 172.21.15.42:0/684646321 learned_addr learned my addr 172.21.15.42:0/684646321 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:25.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.972+0000 7f75d9e00640 1 --2- 172.21.15.42:0/684646321 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f75dc1f92d0 0x7f75dc15d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:25.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.972+0000 7f75db200640 1 --2- 172.21.15.42:0/684646321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75dc1524b0 0x7f75dc1528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:25.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.973+0000 7f75da800640 1 -- 172.21.15.42:0/684646321 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f75dc1f92d0 msgr2=0x7f75dc15d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:25.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.973+0000 7f75da800640 1 --2- 172.21.15.42:0/684646321 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f75dc1f92d0 0x7f75dc15d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:25.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.973+0000 7f75da800640 1 -- 172.21.15.42:0/684646321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75dc1524b0 msgr2=0x7f75dc1528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:25.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.973+0000 7f75da800640 1 --2- 172.21.15.42:0/684646321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75dc1524b0 0x7f75dc1528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:25.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.973+0000 7f75da800640 1 -- 172.21.15.42:0/684646321 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75dc1f50f0 con 0x7f75c0003c30 2024-09-17T01:42:25.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.973+0000 7f75da800640 1 --2- 172.21.15.42:0/684646321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75c0003c30 0x7f75dc157ed0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f75cc02aca0 tx=0x7f75cc006ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:25.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.974+0000 7f75d2a00640 1 -- 172.21.15.42:0/684646321 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc043070 con 0x7f75c0003c30 2024-09-17T01:42:25.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.974+0000 7f75d2a00640 1 -- 172.21.15.42:0/684646321 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75cc0036e0 con 0x7f75c0003c30 2024-09-17T01:42:25.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.974+0000 7f75d2a00640 1 -- 172.21.15.42:0/684646321 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc003b10 con 0x7f75c0003c30 2024-09-17T01:42:25.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.974+0000 7f75e0a00640 1 -- 172.21.15.42:0/684646321 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75dc1f5380 con 0x7f75c0003c30 2024-09-17T01:42:25.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.975+0000 7f75e0a00640 1 -- 172.21.15.42:0/684646321 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75dc152e00 con 0x7f75c0003c30 2024-09-17T01:42:25.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.976+0000 7f75e0a00640 1 -- 172.21.15.42:0/684646321 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75dc0ba4b0 con 0x7f75c0003c30 2024-09-17T01:42:25.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.978+0000 7f75d2a00640 1 -- 172.21.15.42:0/684646321 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f75cc003cb0 con 0x7f75c0003c30 2024-09-17T01:42:25.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.980+0000 7f75d2a00640 1 --2- 172.21.15.42:0/684646321 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f75bc078b90 0x7f75bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:25.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.980+0000 7f75d2a00640 1 -- 172.21.15.42:0/684646321 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f75cc0ba880 con 0x7f75c0003c30 2024-09-17T01:42:25.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.981+0000 7f75d9e00640 1 --2- 172.21.15.42:0/684646321 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f75bc078b90 0x7f75bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:25.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.981+0000 7f75d9e00640 1 --2- 172.21.15.42:0/684646321 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f75bc078b90 0x7f75bc07b0a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f75dc076630 tx=0x7f75c8019040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:25.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:25.985+0000 7f75d2a00640 1 -- 172.21.15.42:0/684646321 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f75dc0ba4b0 con 0x7f75c0003c30 2024-09-17T01:42:26.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:26.252+0000 7f75e0a00640 1 -- 172.21.15.42:0/684646321 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f75dc0d2c20 con 0x7f75c0003c30 2024-09-17T01:42:26.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:26.253+0000 7f75d2a00640 1 -- 172.21.15.42:0/684646321 <== mon.1 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1674 (secure 0 0 0) 0x7f75dc0b7ae0 con 0x7f75c0003c30 2024-09-17T01:42:26.251 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:26.251 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":646,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":136,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1077350934,"bytes_used":2580783104,"bytes_avail":770513330176,"bytes_total":773094113280,"write_bytes_sec":25265340,"read_op_per_sec":0,"write_op_per_sec":57},"fsmap":{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8442}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-17T01:42:23.159317+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:42:26.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:26.255+0000 7f75e0a00640 1 -- 172.21.15.42:0/684646321 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f75bc078b90 msgr2=0x7f75bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:26.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:26.255+0000 7f75e0a00640 1 --2- 172.21.15.42:0/684646321 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f75bc078b90 0x7f75bc07b0a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f75dc076630 tx=0x7f75c8019040 comp rx=0 tx=0).stop 2024-09-17T01:42:26.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:26.255+0000 7f75e0a00640 1 -- 172.21.15.42:0/684646321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75c0003c30 msgr2=0x7f75dc157ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:26.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:26.255+0000 7f75e0a00640 1 --2- 172.21.15.42:0/684646321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75c0003c30 0x7f75dc157ed0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f75cc02aca0 tx=0x7f75cc006ab0 comp rx=0 tx=0).stop 2024-09-17T01:42:26.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:26.255+0000 7f75e0a00640 1 -- 172.21.15.42:0/684646321 shutdown_connections 2024-09-17T01:42:26.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:26.255+0000 7f75e0a00640 1 --2- 172.21.15.42:0/684646321 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f75bc078b90 0x7f75bc07b0a0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:26.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:26.255+0000 7f75e0a00640 1 --2- 172.21.15.42:0/684646321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75dc1524b0 0x7f75dc1528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:26.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:26.255+0000 7f75e0a00640 1 --2- 172.21.15.42:0/684646321 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f75dc1f92d0 0x7f75dc15d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:26.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:26.255+0000 7f75e0a00640 1 --2- 172.21.15.42:0/684646321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75c0003c30 0x7f75dc157ed0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:26.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:26.255+0000 7f75e0a00640 1 -- 172.21.15.42:0/684646321 >> 172.21.15.42:0/684646321 conn(0x7f75dc06cf00 msgr2=0x7f75dc1548f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:26.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:26.255+0000 7f75e0a00640 1 -- 172.21.15.42:0/684646321 shutdown_connections 2024-09-17T01:42:26.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:26.255+0000 7f75e0a00640 1 -- 172.21.15.42:0/684646321 wait complete. 2024-09-17T01:42:26.274 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/scrub_control_test_path]'} 2024-09-17T01:42:27.275 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:42:27.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.513+0000 7f26ed800640 1 -- 172.21.15.42:0/3411074638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e806d430 msgr2=0x7f26e806d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:27.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.513+0000 7f26ed800640 1 --2- 172.21.15.42:0/3411074638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e806d430 0x7f26e806d840 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f26d0005fd0 tx=0x7f26d002a5c0 comp rx=0 tx=0).stop 2024-09-17T01:42:27.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.513+0000 7f26ed800640 1 -- 172.21.15.42:0/3411074638 shutdown_connections 2024-09-17T01:42:27.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.513+0000 7f26ed800640 1 --2- 172.21.15.42:0/3411074638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e806d430 0x7f26e806d840 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:27.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.513+0000 7f26ed800640 1 --2- 172.21.15.42:0/3411074638 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f26e815cb80 0x7f26e8152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:27.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.513+0000 7f26ed800640 1 -- 172.21.15.42:0/3411074638 >> 172.21.15.42:0/3411074638 conn(0x7f26e80b2930 msgr2=0x7f26e806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:27.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.514+0000 7f26ed800640 1 -- 172.21.15.42:0/3411074638 shutdown_connections 2024-09-17T01:42:27.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.514+0000 7f26ed800640 1 -- 172.21.15.42:0/3411074638 wait complete. 2024-09-17T01:42:27.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.516+0000 7f26ed800640 1 Processor -- start 2024-09-17T01:42:27.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.516+0000 7f26ed800640 1 -- start start 2024-09-17T01:42:27.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.517+0000 7f26ed800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e806d430 0x7f26e81f39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:27.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.517+0000 7f26ed800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f26e815cb80 0x7f26e814d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:27.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.517+0000 7f26ed800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26e815f480 0x7f26e814cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:27.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.517+0000 7f26ed800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f26e8073820 con 0x7f26e806d430 2024-09-17T01:42:27.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.517+0000 7f26ed800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f26e80736a0 con 0x7f26e815f480 2024-09-17T01:42:27.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.517+0000 7f26ed800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f26e80739a0 con 0x7f26e815cb80 2024-09-17T01:42:27.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.518+0000 7f26e6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e806d430 0x7f26e81f39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:27.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.518+0000 7f26e6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e806d430 0x7f26e81f39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39916/0 (socket says 172.21.15.42:39916) 2024-09-17T01:42:27.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.518+0000 7f26e6a00640 1 -- 172.21.15.42:0/2933646686 learned_addr learned my addr 172.21.15.42:0/2933646686 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:27.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.518+0000 7f26dfe00640 1 --2- 172.21.15.42:0/2933646686 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f26e815cb80 0x7f26e814d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:27.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.518+0000 7f26e7400640 1 --2- 172.21.15.42:0/2933646686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26e815f480 0x7f26e814cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:27.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.518+0000 7f26e6a00640 1 -- 172.21.15.42:0/2933646686 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f26e815cb80 msgr2=0x7f26e814d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:27.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.518+0000 7f26e6a00640 1 --2- 172.21.15.42:0/2933646686 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f26e815cb80 0x7f26e814d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:27.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.518+0000 7f26e6a00640 1 -- 172.21.15.42:0/2933646686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26e815f480 msgr2=0x7f26e814cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:27.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.518+0000 7f26e6a00640 1 --2- 172.21.15.42:0/2933646686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26e815f480 0x7f26e814cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:27.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.518+0000 7f26e6a00640 1 -- 172.21.15.42:0/2933646686 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e81e5230 con 0x7f26e806d430 2024-09-17T01:42:27.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.518+0000 7f26dfe00640 1 --2- 172.21.15.42:0/2933646686 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f26e815cb80 0x7f26e814d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:42:27.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.518+0000 7f26e7400640 1 --2- 172.21.15.42:0/2933646686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26e815f480 0x7f26e814cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:42:27.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.518+0000 7f26e6a00640 1 --2- 172.21.15.42:0/2933646686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e806d430 0x7f26e81f39a0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f26d800c970 tx=0x7f26d800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:27.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.519+0000 7f26dea00640 1 -- 172.21.15.42:0/2933646686 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d8007bb0 con 0x7f26e806d430 2024-09-17T01:42:27.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.519+0000 7f26dea00640 1 -- 172.21.15.42:0/2933646686 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26d8007e40 con 0x7f26e806d430 2024-09-17T01:42:27.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.519+0000 7f26dea00640 1 -- 172.21.15.42:0/2933646686 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d800f690 con 0x7f26e806d430 2024-09-17T01:42:27.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.519+0000 7f26ed800640 1 -- 172.21.15.42:0/2933646686 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e81f4230 con 0x7f26e806d430 2024-09-17T01:42:27.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.519+0000 7f26ed800640 1 -- 172.21.15.42:0/2933646686 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e81f47f0 con 0x7f26e806d430 2024-09-17T01:42:27.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.520+0000 7f26ed800640 1 -- 172.21.15.42:0/2933646686 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26e80afb30 con 0x7f26e806d430 2024-09-17T01:42:27.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.521+0000 7f26dea00640 1 -- 172.21.15.42:0/2933646686 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f26d800f830 con 0x7f26e806d430 2024-09-17T01:42:27.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.522+0000 7f26dea00640 1 --2- 172.21.15.42:0/2933646686 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f26c4078b90 0x7f26c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:27.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.522+0000 7f26dea00640 1 -- 172.21.15.42:0/2933646686 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f26d809b590 con 0x7f26e806d430 2024-09-17T01:42:27.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.523+0000 7f26dfe00640 1 --2- 172.21.15.42:0/2933646686 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f26c4078b90 0x7f26c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:27.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.524+0000 7f26dfe00640 1 --2- 172.21.15.42:0/2933646686 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f26c4078b90 0x7f26c407b0a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f26d0033000 tx=0x7f26d0004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:27.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.527+0000 7f26dea00640 1 -- 172.21.15.42:0/2933646686 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f26e80afb30 con 0x7f26e806d430 2024-09-17T01:42:27.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.761+0000 7f26ed800640 1 -- 172.21.15.42:0/2933646686 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26e8073ec0 con 0x7f26e806d430 2024-09-17T01:42:27.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.761+0000 7f26dea00640 1 -- 172.21.15.42:0/2933646686 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5231 (secure 0 0 0) 0x7f26d8014030 con 0x7f26e806d430 2024-09-17T01:42:27.759 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:27.759 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2491855232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2491855232},{"type":"v1","addr":"172.21.15.43:6835","nonce":2491855232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4136787983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4136787983},{"type":"v1","addr":"172.21.15.43:6837","nonce":4136787983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/3441664627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3441664627},{"type":"v1","addr":"172.21.15.42:6834","nonce":3441664627}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:41:39.382305+0000","modified":"2024-09-17T01:41:42.412964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8442":{"gid":8442,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3060441721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3060441721},{"type":"v1","addr":"172.21.15.42:6835","nonce":3060441721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8442,"qdb_cluster":[8442]},"id":9}]} 2024-09-17T01:42:27.760 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 107 2024-09-17T01:42:27.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.764+0000 7f26ed800640 1 -- 172.21.15.42:0/2933646686 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f26c4078b90 msgr2=0x7f26c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:27.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.764+0000 7f26ed800640 1 --2- 172.21.15.42:0/2933646686 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f26c4078b90 0x7f26c407b0a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f26d0033000 tx=0x7f26d0004730 comp rx=0 tx=0).stop 2024-09-17T01:42:27.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.764+0000 7f26ed800640 1 -- 172.21.15.42:0/2933646686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e806d430 msgr2=0x7f26e81f39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:27.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.764+0000 7f26ed800640 1 --2- 172.21.15.42:0/2933646686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e806d430 0x7f26e81f39a0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f26d800c970 tx=0x7f26d800ce30 comp rx=0 tx=0).stop 2024-09-17T01:42:27.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.764+0000 7f26ed800640 1 -- 172.21.15.42:0/2933646686 shutdown_connections 2024-09-17T01:42:27.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.764+0000 7f26ed800640 1 --2- 172.21.15.42:0/2933646686 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f26c4078b90 0x7f26c407b0a0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:27.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.764+0000 7f26ed800640 1 --2- 172.21.15.42:0/2933646686 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26e815f480 0x7f26e814cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:27.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.764+0000 7f26ed800640 1 --2- 172.21.15.42:0/2933646686 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f26e815cb80 0x7f26e814d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:27.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.764+0000 7f26ed800640 1 --2- 172.21.15.42:0/2933646686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26e806d430 0x7f26e81f39a0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:27.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.764+0000 7f26ed800640 1 -- 172.21.15.42:0/2933646686 >> 172.21.15.42:0/2933646686 conn(0x7f26e80b2930 msgr2=0x7f26e80cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:27.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.764+0000 7f26ed800640 1 -- 172.21.15.42:0/2933646686 shutdown_connections 2024-09-17T01:42:27.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:27.764+0000 7f26ed800640 1 -- 172.21.15.42:0/2933646686 wait complete. 2024-09-17T01:42:27.782 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-17T01:42:27.783 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:42:28.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.012+0000 7f3a38600640 1 -- 172.21.15.42:0/2641223043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a18003a50 msgr2=0x7f3a18003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:28.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.012+0000 7f3a38600640 1 --2- 172.21.15.42:0/2641223043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a18003a50 0x7f3a18003ec0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400c4a0 tx=0x7f3a18005830 comp rx=0 tx=0).stop 2024-09-17T01:42:28.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.012+0000 7f3a36600640 1 -- 172.21.15.42:0/2641223043 reap_dead start 2024-09-17T01:42:28.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.013+0000 7f3a38600640 1 -- 172.21.15.42:0/2641223043 shutdown_connections 2024-09-17T01:42:28.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.013+0000 7f3a38600640 1 -- 172.21.15.42:0/2641223043 >> 172.21.15.42:0/2641223043 conn(0x7f3a300b2930 msgr2=0x7f3a3006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:28.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.013+0000 7f3a38600640 1 -- 172.21.15.42:0/2641223043 shutdown_connections 2024-09-17T01:42:28.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.013+0000 7f3a38600640 1 -- 172.21.15.42:0/2641223043 wait complete. 2024-09-17T01:42:28.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.015+0000 7f3a38600640 1 Processor -- start 2024-09-17T01:42:28.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.015+0000 7f3a38600640 1 -- start start 2024-09-17T01:42:28.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.016+0000 7f3a38600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a18003a50 0x7f3a301513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:28.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.016+0000 7f3a38600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a300abde0 0x7f3a300ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:28.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.016+0000 7f3a38600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3a300ac1f0 0x7f3a300adc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:28.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.016+0000 7f3a38600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3006dbd0 con 0x7f3a18003a50 2024-09-17T01:42:28.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.016+0000 7f3a38600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3006da50 con 0x7f3a300abde0 2024-09-17T01:42:28.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.016+0000 7f3a38600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3a30073450 con 0x7f3a300ac1f0 2024-09-17T01:42:28.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.017+0000 7f3a35c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a18003a50 0x7f3a301513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:28.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.017+0000 7f3a35c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a18003a50 0x7f3a301513c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39932/0 (socket says 172.21.15.42:39932) 2024-09-17T01:42:28.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.017+0000 7f3a35c00640 1 -- 172.21.15.42:0/130741539 learned_addr learned my addr 172.21.15.42:0/130741539 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:28.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.017+0000 7f3a36600640 1 --2- 172.21.15.42:0/130741539 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3a300ac1f0 0x7f3a300adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:28.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.017+0000 7f3a35200640 1 --2- 172.21.15.42:0/130741539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a300abde0 0x7f3a300ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:28.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.017+0000 7f3a35c00640 1 -- 172.21.15.42:0/130741539 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3a300ac1f0 msgr2=0x7f3a300adc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:28.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.017+0000 7f3a35c00640 1 --2- 172.21.15.42:0/130741539 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3a300ac1f0 0x7f3a300adc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:28.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.017+0000 7f3a35c00640 1 -- 172.21.15.42:0/130741539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a300abde0 msgr2=0x7f3a300ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:28.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.017+0000 7f3a35c00640 1 --2- 172.21.15.42:0/130741539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a300abde0 0x7f3a300ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:28.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.017+0000 7f3a35c00640 1 -- 172.21.15.42:0/130741539 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a30151ef0 con 0x7f3a18003a50 2024-09-17T01:42:28.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.017+0000 7f3a36600640 1 --2- 172.21.15.42:0/130741539 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3a300ac1f0 0x7f3a300adc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:42:28.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.017+0000 7f3a35200640 1 --2- 172.21.15.42:0/130741539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a300abde0 0x7f3a300ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:42:28.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.017+0000 7f3a35c00640 1 --2- 172.21.15.42:0/130741539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a18003a50 0x7f3a301513c0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400c5c0 tx=0x7f3a24006060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:28.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.018+0000 7f3a2d600640 1 -- 172.21.15.42:0/130741539 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24006520 con 0x7f3a18003a50 2024-09-17T01:42:28.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.018+0000 7f3a2d600640 1 -- 172.21.15.42:0/130741539 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a2402b660 con 0x7f3a18003a50 2024-09-17T01:42:28.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.018+0000 7f3a2d600640 1 -- 172.21.15.42:0/130741539 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2402bab0 con 0x7f3a18003a50 2024-09-17T01:42:28.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.018+0000 7f3a38600640 1 -- 172.21.15.42:0/130741539 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a301f90b0 con 0x7f3a18003a50 2024-09-17T01:42:28.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.018+0000 7f3a38600640 1 -- 172.21.15.42:0/130741539 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a301f9670 con 0x7f3a18003a50 2024-09-17T01:42:28.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.019+0000 7f3a38600640 1 -- 172.21.15.42:0/130741539 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a3015f890 con 0x7f3a18003a50 2024-09-17T01:42:28.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.020+0000 7f3a2d600640 1 -- 172.21.15.42:0/130741539 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3a2402bc50 con 0x7f3a18003a50 2024-09-17T01:42:28.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.021+0000 7f3a2d600640 1 --2- 172.21.15.42:0/130741539 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3a10078b90 0x7f3a1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:28.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.021+0000 7f3a2d600640 1 -- 172.21.15.42:0/130741539 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f3a240ba910 con 0x7f3a18003a50 2024-09-17T01:42:28.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.022+0000 7f3a35200640 1 --2- 172.21.15.42:0/130741539 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3a10078b90 0x7f3a1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:28.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.022+0000 7f3a35200640 1 --2- 172.21.15.42:0/130741539 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3a10078b90 0x7f3a1007b0a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f3a3015b730 tx=0x7f3a1c005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:28.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.025+0000 7f3a2d600640 1 -- 172.21.15.42:0/130741539 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3a24047020 con 0x7f3a18003a50 2024-09-17T01:42:28.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.290+0000 7f3a38600640 1 -- 172.21.15.42:0/130741539 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f3a3006a170 con 0x7f3a18003a50 2024-09-17T01:42:28.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.291+0000 7f3a2d600640 1 -- 172.21.15.42:0/130741539 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1673 (secure 0 0 0) 0x7f3a3015be20 con 0x7f3a18003a50 2024-09-17T01:42:28.289 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:28.289 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":648,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":136,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1077350934,"bytes_used":2580783104,"bytes_avail":770513330176,"bytes_total":773094113280,"write_bytes_sec":6701145,"read_op_per_sec":0,"write_op_per_sec":39},"fsmap":{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8442}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-17T01:42:27.160467+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"active paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:42:28.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.293+0000 7f3a38600640 1 -- 172.21.15.42:0/130741539 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3a10078b90 msgr2=0x7f3a1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:28.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.293+0000 7f3a38600640 1 --2- 172.21.15.42:0/130741539 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3a10078b90 0x7f3a1007b0a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f3a3015b730 tx=0x7f3a1c005f90 comp rx=0 tx=0).stop 2024-09-17T01:42:28.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.293+0000 7f3a38600640 1 -- 172.21.15.42:0/130741539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a18003a50 msgr2=0x7f3a301513c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:28.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.293+0000 7f3a38600640 1 --2- 172.21.15.42:0/130741539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a18003a50 0x7f3a301513c0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400c5c0 tx=0x7f3a24006060 comp rx=0 tx=0).stop 2024-09-17T01:42:28.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.293+0000 7f3a38600640 1 -- 172.21.15.42:0/130741539 shutdown_connections 2024-09-17T01:42:28.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.293+0000 7f3a38600640 1 --2- 172.21.15.42:0/130741539 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3a10078b90 0x7f3a1007b0a0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:28.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.293+0000 7f3a38600640 1 --2- 172.21.15.42:0/130741539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a300abde0 0x7f3a300ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:28.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.293+0000 7f3a38600640 1 --2- 172.21.15.42:0/130741539 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3a300ac1f0 0x7f3a300adc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:28.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.293+0000 7f3a38600640 1 --2- 172.21.15.42:0/130741539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a18003a50 0x7f3a301513c0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:28.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.293+0000 7f3a38600640 1 -- 172.21.15.42:0/130741539 >> 172.21.15.42:0/130741539 conn(0x7f3a300b2930 msgr2=0x7f3a30072be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:28.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.293+0000 7f3a38600640 1 -- 172.21.15.42:0/130741539 shutdown_connections 2024-09-17T01:42:28.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:28.293+0000 7f3a38600640 1 -- 172.21.15.42:0/130741539 wait complete. 2024-09-17T01:42:28.312 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'active paths [/scrub_control_test_path]'} 2024-09-17T01:42:29.313 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:42:29.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.555+0000 7fa1acc00640 1 -- 172.21.15.42:0/31979921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1a815ea80 msgr2=0x7fa1a80d1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:29.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.555+0000 7fa1acc00640 1 --2- 172.21.15.42:0/31979921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1a815ea80 0x7fa1a80d1370 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fa198005fd0 tx=0x7fa19802a5c0 comp rx=0 tx=0).stop 2024-09-17T01:42:29.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.555+0000 7fa1acc00640 1 -- 172.21.15.42:0/31979921 shutdown_connections 2024-09-17T01:42:29.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.555+0000 7fa1acc00640 1 --2- 172.21.15.42:0/31979921 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa1a80d18b0 0x7fa1a80d2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:29.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.555+0000 7fa1acc00640 1 --2- 172.21.15.42:0/31979921 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1a815ea80 0x7fa1a80d1370 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:29.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.555+0000 7fa1acc00640 1 -- 172.21.15.42:0/31979921 >> 172.21.15.42:0/31979921 conn(0x7fa1a806cf00 msgr2=0x7fa1a806d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:29.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.555+0000 7fa1acc00640 1 -- 172.21.15.42:0/31979921 shutdown_connections 2024-09-17T01:42:29.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.555+0000 7fa1acc00640 1 -- 172.21.15.42:0/31979921 wait complete. 2024-09-17T01:42:29.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.557+0000 7fa1acc00640 1 Processor -- start 2024-09-17T01:42:29.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.558+0000 7fa1acc00640 1 -- start start 2024-09-17T01:42:29.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.559+0000 7fa1acc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1a80d18b0 0x7fa1a815c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:29.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.559+0000 7fa1acc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa1a80d2d80 0x7fa1a815b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:29.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.559+0000 7fa1acc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1a815ea80 0x7fa1a815b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:29.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.559+0000 7fa1acc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a80b6760 con 0x7fa1a815ea80 2024-09-17T01:42:29.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.559+0000 7fa1acc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a80b9550 con 0x7fa1a80d18b0 2024-09-17T01:42:29.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.559+0000 7fa1acc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa1a80b68e0 con 0x7fa1a80d2d80 2024-09-17T01:42:29.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.559+0000 7fa1a7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1a815ea80 0x7fa1a815b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:29.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.560+0000 7fa1a7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1a815ea80 0x7fa1a815b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39958/0 (socket says 172.21.15.42:39958) 2024-09-17T01:42:29.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.560+0000 7fa1a7e00640 1 -- 172.21.15.42:0/3673332656 learned_addr learned my addr 172.21.15.42:0/3673332656 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:29.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.560+0000 7fa1a7400640 1 --2- 172.21.15.42:0/3673332656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1a80d18b0 0x7fa1a815c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:29.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.560+0000 7fa19ea00640 1 --2- 172.21.15.42:0/3673332656 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa1a80d2d80 0x7fa1a815b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:29.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.560+0000 7fa1a7e00640 1 -- 172.21.15.42:0/3673332656 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa1a80d2d80 msgr2=0x7fa1a815b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:29.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.560+0000 7fa1a7e00640 1 --2- 172.21.15.42:0/3673332656 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa1a80d2d80 0x7fa1a815b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:29.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.560+0000 7fa1a7e00640 1 -- 172.21.15.42:0/3673332656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1a80d18b0 msgr2=0x7fa1a815c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:29.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.560+0000 7fa1a7e00640 1 --2- 172.21.15.42:0/3673332656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1a80d18b0 0x7fa1a815c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:29.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.560+0000 7fa1a7e00640 1 -- 172.21.15.42:0/3673332656 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a815caf0 con 0x7fa1a815ea80 2024-09-17T01:42:29.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.560+0000 7fa1a7e00640 1 --2- 172.21.15.42:0/3673332656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1a815ea80 0x7fa1a815b640 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fa1a000c700 tx=0x7fa1a000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:29.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.560+0000 7fa19fe00640 1 -- 172.21.15.42:0/3673332656 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0003b70 con 0x7fa1a815ea80 2024-09-17T01:42:29.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.561+0000 7fa19fe00640 1 -- 172.21.15.42:0/3673332656 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1a0003d10 con 0x7fa1a815ea80 2024-09-17T01:42:29.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.561+0000 7fa19fe00640 1 -- 172.21.15.42:0/3673332656 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a000aab0 con 0x7fa1a815ea80 2024-09-17T01:42:29.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.561+0000 7fa1acc00640 1 -- 172.21.15.42:0/3673332656 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1a81e78f0 con 0x7fa1a815ea80 2024-09-17T01:42:29.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.561+0000 7fa1acc00640 1 -- 172.21.15.42:0/3673332656 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1a8144cc0 con 0x7fa1a815ea80 2024-09-17T01:42:29.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.562+0000 7fa1acc00640 1 -- 172.21.15.42:0/3673332656 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1a81e7360 con 0x7fa1a815ea80 2024-09-17T01:42:29.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.563+0000 7fa19fe00640 1 -- 172.21.15.42:0/3673332656 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa1a000ac50 con 0x7fa1a815ea80 2024-09-17T01:42:29.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.564+0000 7fa19fe00640 1 --2- 172.21.15.42:0/3673332656 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa184078b90 0x7fa18407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:29.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.564+0000 7fa19fe00640 1 -- 172.21.15.42:0/3673332656 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7fa1a009aa80 con 0x7fa1a815ea80 2024-09-17T01:42:29.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.564+0000 7fa1a7400640 1 --2- 172.21.15.42:0/3673332656 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa184078b90 0x7fa18407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:29.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.565+0000 7fa1a7400640 1 --2- 172.21.15.42:0/3673332656 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa184078b90 0x7fa18407b0a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa198033000 tx=0x7fa198004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:29.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.569+0000 7fa19fe00640 1 -- 172.21.15.42:0/3673332656 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa1a009ce20 con 0x7fa1a815ea80 2024-09-17T01:42:29.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.800+0000 7fa1acc00640 1 -- 172.21.15.42:0/3673332656 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1a80b6e20 con 0x7fa1a815ea80 2024-09-17T01:42:29.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.801+0000 7fa19fe00640 1 -- 172.21.15.42:0/3673332656 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5231 (secure 0 0 0) 0x7fa1a80b7ae0 con 0x7fa1a815ea80 2024-09-17T01:42:29.799 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:29.799 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2491855232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2491855232},{"type":"v1","addr":"172.21.15.43:6835","nonce":2491855232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4136787983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4136787983},{"type":"v1","addr":"172.21.15.43:6837","nonce":4136787983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/3441664627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3441664627},{"type":"v1","addr":"172.21.15.42:6834","nonce":3441664627}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:41:39.382305+0000","modified":"2024-09-17T01:41:42.412964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8442":{"gid":8442,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3060441721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3060441721},{"type":"v1","addr":"172.21.15.42:6835","nonce":3060441721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8442,"qdb_cluster":[8442]},"id":9}]} 2024-09-17T01:42:29.799 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 107 2024-09-17T01:42:29.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.803+0000 7fa1acc00640 1 -- 172.21.15.42:0/3673332656 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa184078b90 msgr2=0x7fa18407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:29.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.803+0000 7fa1acc00640 1 --2- 172.21.15.42:0/3673332656 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa184078b90 0x7fa18407b0a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa198033000 tx=0x7fa198004730 comp rx=0 tx=0).stop 2024-09-17T01:42:29.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.803+0000 7fa1acc00640 1 -- 172.21.15.42:0/3673332656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1a815ea80 msgr2=0x7fa1a815b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:29.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.803+0000 7fa1acc00640 1 --2- 172.21.15.42:0/3673332656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1a815ea80 0x7fa1a815b640 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fa1a000c700 tx=0x7fa1a000cbc0 comp rx=0 tx=0).stop 2024-09-17T01:42:29.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.804+0000 7fa1acc00640 1 -- 172.21.15.42:0/3673332656 shutdown_connections 2024-09-17T01:42:29.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.804+0000 7fa1acc00640 1 --2- 172.21.15.42:0/3673332656 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa184078b90 0x7fa18407b0a0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:29.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.804+0000 7fa1acc00640 1 --2- 172.21.15.42:0/3673332656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa1a815ea80 0x7fa1a815b640 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:29.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.804+0000 7fa1acc00640 1 --2- 172.21.15.42:0/3673332656 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa1a80d2d80 0x7fa1a815b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:29.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.804+0000 7fa1acc00640 1 --2- 172.21.15.42:0/3673332656 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1a80d18b0 0x7fa1a815c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:29.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.804+0000 7fa1acc00640 1 -- 172.21.15.42:0/3673332656 >> 172.21.15.42:0/3673332656 conn(0x7fa1a806cf00 msgr2=0x7fa1a806d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:29.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.804+0000 7fa1acc00640 1 -- 172.21.15.42:0/3673332656 shutdown_connections 2024-09-17T01:42:29.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:29.804+0000 7fa1acc00640 1 -- 172.21.15.42:0/3673332656 wait complete. 2024-09-17T01:42:29.823 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-17T01:42:29.823 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:42:30.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.053+0000 7f648de00640 1 -- 172.21.15.42:0/2935762205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6488074500 msgr2=0x7f648806eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:30.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.053+0000 7f648de00640 1 --2- 172.21.15.42:0/2935762205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6488074500 0x7f648806eec0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f64880b3220 tx=0x7f647002a560 comp rx=0 tx=0).stop 2024-09-17T01:42:30.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.053+0000 7f648de00640 1 -- 172.21.15.42:0/2935762205 shutdown_connections 2024-09-17T01:42:30.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.053+0000 7f648de00640 1 --2- 172.21.15.42:0/2935762205 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f648815f740 0x7f648806d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:30.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.053+0000 7f648de00640 1 --2- 172.21.15.42:0/2935762205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6488074500 0x7f648806eec0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:30.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.053+0000 7f648de00640 1 --2- 172.21.15.42:0/2935762205 >> v2:172.21.15.43:3300/0 conn(0x7f64880740f0 0x7f648815f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:30.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.053+0000 7f648de00640 1 -- 172.21.15.42:0/2935762205 >> 172.21.15.42:0/2935762205 conn(0x7f64880b2930 msgr2=0x7f648806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:30.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.053+0000 7f648de00640 1 -- 172.21.15.42:0/2935762205 shutdown_connections 2024-09-17T01:42:30.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.053+0000 7f648de00640 1 -- 172.21.15.42:0/2935762205 wait complete. 2024-09-17T01:42:30.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.056+0000 7f648de00640 1 Processor -- start 2024-09-17T01:42:30.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.056+0000 7f648de00640 1 -- start start 2024-09-17T01:42:30.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.057+0000 7f648de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64880740f0 0x7f64881f6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:30.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.057+0000 7f648de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f648815f740 0x7f64881598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:30.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.057+0000 7f648de00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f64880b52e0 0x7f64880b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:30.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.057+0000 7f648de00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f648806dd00 con 0x7f648815f740 2024-09-17T01:42:30.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.057+0000 7f648de00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f648806db80 con 0x7f64880740f0 2024-09-17T01:42:30.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.057+0000 7f648de00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f64880cef40 con 0x7f64880b52e0 2024-09-17T01:42:30.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.057+0000 7f647fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f648815f740 0x7f64881598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:30.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.057+0000 7f647fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f648815f740 0x7f64881598c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39974/0 (socket says 172.21.15.42:39974) 2024-09-17T01:42:30.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.057+0000 7f647fe00640 1 -- 172.21.15.42:0/425560572 learned_addr learned my addr 172.21.15.42:0/425560572 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:30.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.057+0000 7f6486a00640 1 --2- 172.21.15.42:0/425560572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64880740f0 0x7f64881f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:30.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.058+0000 7f6487400640 1 --2- 172.21.15.42:0/425560572 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f64880b52e0 0x7f64880b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:30.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.058+0000 7f647fe00640 1 -- 172.21.15.42:0/425560572 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f64880b52e0 msgr2=0x7f64880b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:30.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.058+0000 7f647fe00640 1 --2- 172.21.15.42:0/425560572 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f64880b52e0 0x7f64880b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:30.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.058+0000 7f647fe00640 1 -- 172.21.15.42:0/425560572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64880740f0 msgr2=0x7f64881f6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:30.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.058+0000 7f647fe00640 1 --2- 172.21.15.42:0/425560572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64880740f0 0x7f64881f6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:30.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.058+0000 7f647fe00640 1 -- 172.21.15.42:0/425560572 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64880b3680 con 0x7f648815f740 2024-09-17T01:42:30.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.058+0000 7f647fe00640 1 --2- 172.21.15.42:0/425560572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f648815f740 0x7f64881598c0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f6470034040 tx=0x7f64700038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:30.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.059+0000 7f647f400640 1 -- 172.21.15.42:0/425560572 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647003e030 con 0x7f648815f740 2024-09-17T01:42:30.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.059+0000 7f647f400640 1 -- 172.21.15.42:0/425560572 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6470003db0 con 0x7f648815f740 2024-09-17T01:42:30.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.059+0000 7f647f400640 1 -- 172.21.15.42:0/425560572 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6470035040 con 0x7f648815f740 2024-09-17T01:42:30.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.059+0000 7f648de00640 1 -- 172.21.15.42:0/425560572 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64880b3960 con 0x7f648815f740 2024-09-17T01:42:30.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.059+0000 7f648de00640 1 -- 172.21.15.42:0/425560572 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6488159e00 con 0x7f648815f740 2024-09-17T01:42:30.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.060+0000 7f648de00640 1 -- 172.21.15.42:0/425560572 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6488074500 con 0x7f648815f740 2024-09-17T01:42:30.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.061+0000 7f647f400640 1 -- 172.21.15.42:0/425560572 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6470041030 con 0x7f648815f740 2024-09-17T01:42:30.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.062+0000 7f647f400640 1 --2- 172.21.15.42:0/425560572 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6464078b90 0x7f646407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:30.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.062+0000 7f647f400640 1 -- 172.21.15.42:0/425560572 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f64700bb810 con 0x7f648815f740 2024-09-17T01:42:30.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.063+0000 7f6486a00640 1 --2- 172.21.15.42:0/425560572 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6464078b90 0x7f646407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:30.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.064+0000 7f6486a00640 1 --2- 172.21.15.42:0/425560572 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6464078b90 0x7f646407b0a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f6478005fd0 tx=0x7f647800b260 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:30.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.066+0000 7f647f400640 1 -- 172.21.15.42:0/425560572 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6470083560 con 0x7f648815f740 2024-09-17T01:42:30.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.330+0000 7f648de00640 1 -- 172.21.15.42:0/425560572 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f64880b57a0 con 0x7f648815f740 2024-09-17T01:42:30.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.331+0000 7f647f400640 1 -- 172.21.15.42:0/425560572 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1673 (secure 0 0 0) 0x7f6470087f90 con 0x7f648815f740 2024-09-17T01:42:30.329 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:30.329 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":650,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":136,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1077350934,"bytes_used":2580783104,"bytes_avail":770513330176,"bytes_total":773094113280,"write_bytes_sec":5038892,"read_op_per_sec":0,"write_op_per_sec":36},"fsmap":{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8442}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-17T01:42:27.160467+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"active paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:42:30.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.333+0000 7f648de00640 1 -- 172.21.15.42:0/425560572 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6464078b90 msgr2=0x7f646407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:30.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.333+0000 7f648de00640 1 --2- 172.21.15.42:0/425560572 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6464078b90 0x7f646407b0a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f6478005fd0 tx=0x7f647800b260 comp rx=0 tx=0).stop 2024-09-17T01:42:30.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.333+0000 7f648de00640 1 -- 172.21.15.42:0/425560572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f648815f740 msgr2=0x7f64881598c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:30.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.333+0000 7f648de00640 1 --2- 172.21.15.42:0/425560572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f648815f740 0x7f64881598c0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f6470034040 tx=0x7f64700038a0 comp rx=0 tx=0).stop 2024-09-17T01:42:30.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.333+0000 7f648de00640 1 -- 172.21.15.42:0/425560572 shutdown_connections 2024-09-17T01:42:30.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.333+0000 7f648de00640 1 --2- 172.21.15.42:0/425560572 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6464078b90 0x7f646407b0a0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:30.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.333+0000 7f648de00640 1 --2- 172.21.15.42:0/425560572 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f64880b52e0 0x7f64880b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:30.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.333+0000 7f648de00640 1 --2- 172.21.15.42:0/425560572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f648815f740 0x7f64881598c0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:30.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.333+0000 7f648de00640 1 --2- 172.21.15.42:0/425560572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64880740f0 0x7f64881f6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:30.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.333+0000 7f648de00640 1 -- 172.21.15.42:0/425560572 >> 172.21.15.42:0/425560572 conn(0x7f64880b2930 msgr2=0x7f6488157d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:30.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.333+0000 7f648de00640 1 -- 172.21.15.42:0/425560572 shutdown_connections 2024-09-17T01:42:30.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:30.333+0000 7f648de00640 1 -- 172.21.15.42:0/425560572 wait complete. 2024-09-17T01:42:30.354 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'active paths [/scrub_control_test_path]'} 2024-09-17T01:42:31.356 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:42:31.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.598+0000 7f2be3400640 1 -- 172.21.15.42:0/941592396 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bdc0b3550 msgr2=0x7f2bdc15cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:31.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.598+0000 7f2be3400640 1 --2- 172.21.15.42:0/941592396 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bdc0b3550 0x7f2bdc15cec0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0005fd0 tx=0x7f2bd002a5f0 comp rx=0 tx=0).stop 2024-09-17T01:42:31.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.598+0000 7f2be3400640 1 -- 172.21.15.42:0/941592396 shutdown_connections 2024-09-17T01:42:31.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.598+0000 7f2be3400640 1 --2- 172.21.15.42:0/941592396 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bdc0b3550 0x7f2bdc15cec0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:31.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.598+0000 7f2be3400640 1 -- 172.21.15.42:0/941592396 >> 172.21.15.42:0/941592396 conn(0x7f2bdc0b2930 msgr2=0x7f2bdc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:31.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.598+0000 7f2be3400640 1 -- 172.21.15.42:0/941592396 shutdown_connections 2024-09-17T01:42:31.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.598+0000 7f2be3400640 1 -- 172.21.15.42:0/941592396 wait complete. 2024-09-17T01:42:31.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.600+0000 7f2be3400640 1 Processor -- start 2024-09-17T01:42:31.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.601+0000 7f2be3400640 1 -- start start 2024-09-17T01:42:31.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.602+0000 7f2be3400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bdc0b3550 0x7f2bdc157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:31.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.602+0000 7f2be3400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2bdc0cec40 0x7f2bdc157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:31.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.602+0000 7f2be3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bdc142f40 0x7f2bdc158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:31.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.602+0000 7f2be3400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2bdc0cf050 con 0x7f2bdc142f40 2024-09-17T01:42:31.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.602+0000 7f2be3400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2bdc06dd50 con 0x7f2bdc0b3550 2024-09-17T01:42:31.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.602+0000 7f2be3400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2bdc0cf1d0 con 0x7f2bdc0cec40 2024-09-17T01:42:31.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.602+0000 7f2be1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bdc142f40 0x7f2bdc158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:31.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.602+0000 7f2be1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bdc142f40 0x7f2bdc158010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39992/0 (socket says 172.21.15.42:39992) 2024-09-17T01:42:31.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.602+0000 7f2be1400640 1 -- 172.21.15.42:0/477474492 learned_addr learned my addr 172.21.15.42:0/477474492 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:31.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.602+0000 7f2be0a00640 1 --2- 172.21.15.42:0/477474492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bdc0b3550 0x7f2bdc157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:31.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.602+0000 7f2bdbe00640 1 --2- 172.21.15.42:0/477474492 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2bdc0cec40 0x7f2bdc157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:31.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.603+0000 7f2be1400640 1 -- 172.21.15.42:0/477474492 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2bdc0cec40 msgr2=0x7f2bdc157ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:31.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.603+0000 7f2be1400640 1 --2- 172.21.15.42:0/477474492 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2bdc0cec40 0x7f2bdc157ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:31.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.603+0000 7f2be1400640 1 -- 172.21.15.42:0/477474492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bdc0b3550 msgr2=0x7f2bdc157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:31.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.603+0000 7f2be1400640 1 --2- 172.21.15.42:0/477474492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bdc0b3550 0x7f2bdc157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:31.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.603+0000 7f2be1400640 1 -- 172.21.15.42:0/477474492 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bdc1f6050 con 0x7f2bdc142f40 2024-09-17T01:42:31.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.603+0000 7f2be1400640 1 --2- 172.21.15.42:0/477474492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bdc142f40 0x7f2bdc158010 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f2bd400c730 tx=0x7f2bd400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:31.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.603+0000 7f2bd8c00640 1 -- 172.21.15.42:0/477474492 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4003b70 con 0x7f2bdc142f40 2024-09-17T01:42:31.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.603+0000 7f2bd8c00640 1 -- 172.21.15.42:0/477474492 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2bd4003d10 con 0x7f2bdc142f40 2024-09-17T01:42:31.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.603+0000 7f2be3400640 1 -- 172.21.15.42:0/477474492 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bdc1413e0 con 0x7f2bdc142f40 2024-09-17T01:42:31.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.603+0000 7f2bd8c00640 1 -- 172.21.15.42:0/477474492 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd400aab0 con 0x7f2bdc142f40 2024-09-17T01:42:31.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.604+0000 7f2be3400640 1 -- 172.21.15.42:0/477474492 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bdc1f65d0 con 0x7f2bdc142f40 2024-09-17T01:42:31.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.605+0000 7f2be3400640 1 -- 172.21.15.42:0/477474492 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bdc141150 con 0x7f2bdc142f40 2024-09-17T01:42:31.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.606+0000 7f2bd8c00640 1 -- 172.21.15.42:0/477474492 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2bd400ac50 con 0x7f2bdc142f40 2024-09-17T01:42:31.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.607+0000 7f2bd8c00640 1 --2- 172.21.15.42:0/477474492 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2bbc078bc0 0x7f2bbc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:31.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.607+0000 7f2bd8c00640 1 -- 172.21.15.42:0/477474492 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f2bd409aa30 con 0x7f2bdc142f40 2024-09-17T01:42:31.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.608+0000 7f2be0a00640 1 --2- 172.21.15.42:0/477474492 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2bbc078bc0 0x7f2bbc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:31.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.609+0000 7f2be0a00640 1 --2- 172.21.15.42:0/477474492 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2bbc078bc0 0x7f2bbc07b0d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0033000 tx=0x7f2bd0004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:31.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.612+0000 7f2bd8c00640 1 -- 172.21.15.42:0/477474492 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2bd4062780 con 0x7f2bdc142f40 2024-09-17T01:42:31.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.843+0000 7f2be3400640 1 -- 172.21.15.42:0/477474492 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2bdc06d6e0 con 0x7f2bdc142f40 2024-09-17T01:42:31.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.844+0000 7f2bd8c00640 1 -- 172.21.15.42:0/477474492 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5231 (secure 0 0 0) 0x7f2bdc06d6e0 con 0x7f2bdc142f40 2024-09-17T01:42:31.842 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:31.842 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2491855232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2491855232},{"type":"v1","addr":"172.21.15.43:6835","nonce":2491855232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4136787983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4136787983},{"type":"v1","addr":"172.21.15.43:6837","nonce":4136787983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/3441664627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3441664627},{"type":"v1","addr":"172.21.15.42:6834","nonce":3441664627}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:41:39.382305+0000","modified":"2024-09-17T01:41:42.412964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8442":{"gid":8442,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3060441721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3060441721},{"type":"v1","addr":"172.21.15.42:6835","nonce":3060441721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8442,"qdb_cluster":[8442]},"id":9}]} 2024-09-17T01:42:31.842 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 107 2024-09-17T01:42:31.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.846+0000 7f2be3400640 1 -- 172.21.15.42:0/477474492 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2bbc078bc0 msgr2=0x7f2bbc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:31.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.846+0000 7f2be3400640 1 --2- 172.21.15.42:0/477474492 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2bbc078bc0 0x7f2bbc07b0d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0033000 tx=0x7f2bd0004730 comp rx=0 tx=0).stop 2024-09-17T01:42:31.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.846+0000 7f2be3400640 1 -- 172.21.15.42:0/477474492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bdc142f40 msgr2=0x7f2bdc158010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:31.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.846+0000 7f2be3400640 1 --2- 172.21.15.42:0/477474492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bdc142f40 0x7f2bdc158010 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f2bd400c730 tx=0x7f2bd400cbf0 comp rx=0 tx=0).stop 2024-09-17T01:42:31.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.846+0000 7f2be3400640 1 -- 172.21.15.42:0/477474492 shutdown_connections 2024-09-17T01:42:31.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.846+0000 7f2be3400640 1 --2- 172.21.15.42:0/477474492 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2bbc078bc0 0x7f2bbc07b0d0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:31.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.846+0000 7f2be3400640 1 --2- 172.21.15.42:0/477474492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bdc142f40 0x7f2bdc158010 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:31.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.846+0000 7f2be3400640 1 --2- 172.21.15.42:0/477474492 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2bdc0cec40 0x7f2bdc157ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:31.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.846+0000 7f2be3400640 1 --2- 172.21.15.42:0/477474492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bdc0b3550 0x7f2bdc157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:31.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.846+0000 7f2be3400640 1 -- 172.21.15.42:0/477474492 >> 172.21.15.42:0/477474492 conn(0x7f2bdc0b2930 msgr2=0x7f2bdc0cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:31.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.846+0000 7f2be3400640 1 -- 172.21.15.42:0/477474492 shutdown_connections 2024-09-17T01:42:31.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:31.846+0000 7f2be3400640 1 -- 172.21.15.42:0/477474492 wait complete. 2024-09-17T01:42:31.865 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-17T01:42:31.866 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:42:32.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.092+0000 7f7934e00640 1 -- 172.21.15.42:0/469064065 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79300cf7c0 msgr2=0x7f793006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:32.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.092+0000 7f7934e00640 1 --2- 172.21.15.42:0/469064065 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79300cf7c0 0x7f793006cd20 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f7918005fd0 tx=0x7f791802a5d0 comp rx=0 tx=0).stop 2024-09-17T01:42:32.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.092+0000 7f7934e00640 1 -- 172.21.15.42:0/469064065 shutdown_connections 2024-09-17T01:42:32.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.092+0000 7f7934e00640 1 --2- 172.21.15.42:0/469064065 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f793006d260 0x7f7930152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:32.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.092+0000 7f7934e00640 1 --2- 172.21.15.42:0/469064065 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79300cf7c0 0x7f793006cd20 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:32.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.092+0000 7f7934e00640 1 -- 172.21.15.42:0/469064065 >> 172.21.15.42:0/469064065 conn(0x7f79300b25f0 msgr2=0x7f79300d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:32.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.092+0000 7f7934e00640 1 -- 172.21.15.42:0/469064065 shutdown_connections 2024-09-17T01:42:32.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.092+0000 7f7934e00640 1 -- 172.21.15.42:0/469064065 wait complete. 2024-09-17T01:42:32.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.094+0000 7f7934e00640 1 Processor -- start 2024-09-17T01:42:32.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.094+0000 7f7934e00640 1 -- start start 2024-09-17T01:42:32.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.096+0000 7f7934e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f793006d260 0x7f79301f7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:32.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.096+0000 7f7934e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f79300b4be0 0x7f79300c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:32.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.096+0000 7f7934e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79300cf7c0 0x7f793014d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:32.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.096+0000 7f7934e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7930153850 con 0x7f793006d260 2024-09-17T01:42:32.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.096+0000 7f7934e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f79301536d0 con 0x7f79300cf7c0 2024-09-17T01:42:32.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.096+0000 7f7934e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f79301539d0 con 0x7f79300b4be0 2024-09-17T01:42:32.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.096+0000 7f792f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f793006d260 0x7f79301f7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:32.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.096+0000 7f792f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f793006d260 0x7f79301f7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40018/0 (socket says 172.21.15.42:40018) 2024-09-17T01:42:32.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.096+0000 7f792f400640 1 -- 172.21.15.42:0/3645613429 learned_addr learned my addr 172.21.15.42:0/3645613429 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:32.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.096+0000 7f7927e00640 1 --2- 172.21.15.42:0/3645613429 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f79300b4be0 0x7f79300c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:32.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.096+0000 7f792fe00640 1 --2- 172.21.15.42:0/3645613429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79300cf7c0 0x7f793014d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:32.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.097+0000 7f792f400640 1 -- 172.21.15.42:0/3645613429 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f79300b4be0 msgr2=0x7f79300c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:32.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.097+0000 7f792f400640 1 --2- 172.21.15.42:0/3645613429 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f79300b4be0 0x7f79300c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:32.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.097+0000 7f792f400640 1 -- 172.21.15.42:0/3645613429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79300cf7c0 msgr2=0x7f793014d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:32.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.097+0000 7f792f400640 1 --2- 172.21.15.42:0/3645613429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79300cf7c0 0x7f793014d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:32.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.097+0000 7f792f400640 1 -- 172.21.15.42:0/3645613429 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79300741b0 con 0x7f793006d260 2024-09-17T01:42:32.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.097+0000 7f792fe00640 1 --2- 172.21.15.42:0/3645613429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79300cf7c0 0x7f793014d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:42:32.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.097+0000 7f792f400640 1 --2- 172.21.15.42:0/3645613429 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f793006d260 0x7f79301f7620 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f792000c370 tx=0x7f792000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:32.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.097+0000 7f7927400640 1 -- 172.21.15.42:0/3645613429 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79200052d0 con 0x7f793006d260 2024-09-17T01:42:32.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.097+0000 7f7927400640 1 -- 172.21.15.42:0/3645613429 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7920007020 con 0x7f793006d260 2024-09-17T01:42:32.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.097+0000 7f7927400640 1 -- 172.21.15.42:0/3645613429 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7920007470 con 0x7f793006d260 2024-09-17T01:42:32.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.097+0000 7f7934e00640 1 -- 172.21.15.42:0/3645613429 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7930074490 con 0x7f793006d260 2024-09-17T01:42:32.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.098+0000 7f7934e00640 1 -- 172.21.15.42:0/3645613429 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79301f7100 con 0x7f793006d260 2024-09-17T01:42:32.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.099+0000 7f7934e00640 1 -- 172.21.15.42:0/3645613429 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7930152ed0 con 0x7f793006d260 2024-09-17T01:42:32.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.100+0000 7f7927400640 1 -- 172.21.15.42:0/3645613429 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f79200067d0 con 0x7f793006d260 2024-09-17T01:42:32.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.101+0000 7f7927400640 1 --2- 172.21.15.42:0/3645613429 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f790c078bc0 0x7f790c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:32.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.101+0000 7f7927400640 1 -- 172.21.15.42:0/3645613429 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f792009a160 con 0x7f793006d260 2024-09-17T01:42:32.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.101+0000 7f7927e00640 1 --2- 172.21.15.42:0/3645613429 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f790c078bc0 0x7f790c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:32.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.102+0000 7f7927e00640 1 --2- 172.21.15.42:0/3645613429 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f790c078bc0 0x7f790c07b0d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7918033000 tx=0x7f7918004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:32.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.105+0000 7f7927400640 1 -- 172.21.15.42:0/3645613429 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f793006d670 con 0x7f793006d260 2024-09-17T01:42:32.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.370+0000 7f7934e00640 1 -- 172.21.15.42:0/3645613429 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f793015cac0 con 0x7f793006d260 2024-09-17T01:42:32.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.371+0000 7f7927400640 1 -- 172.21.15.42:0/3645613429 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1673 (secure 0 0 0) 0x7f7920061f40 con 0x7f793006d260 2024-09-17T01:42:32.369 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:32.369 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":652,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":136,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1049,"data_bytes":1078607866,"bytes_used":2606727168,"bytes_avail":770487386112,"bytes_total":773094113280,"write_bytes_sec":4496021,"read_op_per_sec":0,"write_op_per_sec":87},"fsmap":{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8442}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-17T01:42:27.160467+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"active paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:42:32.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.373+0000 7f7934e00640 1 -- 172.21.15.42:0/3645613429 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f790c078bc0 msgr2=0x7f790c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:32.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.373+0000 7f7934e00640 1 --2- 172.21.15.42:0/3645613429 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f790c078bc0 0x7f790c07b0d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7918033000 tx=0x7f7918004730 comp rx=0 tx=0).stop 2024-09-17T01:42:32.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.373+0000 7f7934e00640 1 -- 172.21.15.42:0/3645613429 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f793006d260 msgr2=0x7f79301f7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:32.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.373+0000 7f7934e00640 1 --2- 172.21.15.42:0/3645613429 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f793006d260 0x7f79301f7620 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f792000c370 tx=0x7f792000c830 comp rx=0 tx=0).stop 2024-09-17T01:42:32.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.373+0000 7f7934e00640 1 -- 172.21.15.42:0/3645613429 shutdown_connections 2024-09-17T01:42:32.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.373+0000 7f7934e00640 1 --2- 172.21.15.42:0/3645613429 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f790c078bc0 0x7f790c07b0d0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:32.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.373+0000 7f7934e00640 1 --2- 172.21.15.42:0/3645613429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79300cf7c0 0x7f793014d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:32.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.373+0000 7f7934e00640 1 --2- 172.21.15.42:0/3645613429 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f79300b4be0 0x7f79300c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:32.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.373+0000 7f7934e00640 1 --2- 172.21.15.42:0/3645613429 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f793006d260 0x7f79301f7620 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:32.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.373+0000 7f7934e00640 1 -- 172.21.15.42:0/3645613429 >> 172.21.15.42:0/3645613429 conn(0x7f79300b25f0 msgr2=0x7f79300b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:32.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.373+0000 7f7934e00640 1 -- 172.21.15.42:0/3645613429 shutdown_connections 2024-09-17T01:42:32.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:32.373+0000 7f7934e00640 1 -- 172.21.15.42:0/3645613429 wait complete. 2024-09-17T01:42:32.392 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'active paths [/scrub_control_test_path]'} 2024-09-17T01:42:33.393 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:42:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.635+0000 7f4fb7e00640 1 -- 172.21.15.42:0/3843700530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f9c004800 msgr2=0x7f4f9c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.635+0000 7f4fb7e00640 1 --2- 172.21.15.42:0/3843700530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f9c004800 0x7f4f9c004c10 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00016c0 tx=0x7f4f9c005830 comp rx=0 tx=0).stop 2024-09-17T01:42:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.635+0000 7f4fb7e00640 1 -- 172.21.15.42:0/3843700530 shutdown_connections 2024-09-17T01:42:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.635+0000 7f4fb7e00640 1 --2- 172.21.15.42:0/3843700530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f9c004800 0x7f4f9c004c10 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.635+0000 7f4fb7e00640 1 -- 172.21.15.42:0/3843700530 >> 172.21.15.42:0/3843700530 conn(0x7f4fb80b25f0 msgr2=0x7f4fb80d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.635+0000 7f4fb7e00640 1 -- 172.21.15.42:0/3843700530 shutdown_connections 2024-09-17T01:42:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.635+0000 7f4fb7e00640 1 -- 172.21.15.42:0/3843700530 wait complete. 2024-09-17T01:42:33.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.637+0000 7f4fb7e00640 1 Processor -- start 2024-09-17T01:42:33.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.638+0000 7f4fb7e00640 1 -- start start 2024-09-17T01:42:33.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.639+0000 7f4fb7e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f9c004800 0x7f4fb81e4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:33.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.639+0000 7f4fb7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fb815f770 0x7f4fb8153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:33.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.639+0000 7f4fb7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fb8074700 0x7f4fb8074b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:33.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.639+0000 7f4fb7e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb815dba0 con 0x7f4fb8074700 2024-09-17T01:42:33.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.639+0000 7f4fb7e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb815da20 con 0x7f4fb815f770 2024-09-17T01:42:33.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.639+0000 7f4fb7e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4fb806cd20 con 0x7f4f9c004800 2024-09-17T01:42:33.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.639+0000 7f4fb7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fb8074700 0x7f4fb8074b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:33.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.639+0000 7f4fb7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fb8074700 0x7f4fb8074b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40032/0 (socket says 172.21.15.42:40032) 2024-09-17T01:42:33.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.639+0000 7f4fb7400640 1 -- 172.21.15.42:0/2319736397 learned_addr learned my addr 172.21.15.42:0/2319736397 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:33.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.639+0000 7f4fae000640 1 --2- 172.21.15.42:0/2319736397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fb815f770 0x7f4fb8153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:33.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.639+0000 7f4fb6a00640 1 --2- 172.21.15.42:0/2319736397 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f9c004800 0x7f4fb81e4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:33.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.640+0000 7f4fb7400640 1 -- 172.21.15.42:0/2319736397 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f9c004800 msgr2=0x7f4fb81e4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:33.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.640+0000 7f4fb7400640 1 --2- 172.21.15.42:0/2319736397 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f9c004800 0x7f4fb81e4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:33.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.640+0000 7f4fb7400640 1 -- 172.21.15.42:0/2319736397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fb815f770 msgr2=0x7f4fb8153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:33.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.640+0000 7f4fb7400640 1 --2- 172.21.15.42:0/2319736397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fb815f770 0x7f4fb8153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:33.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.640+0000 7f4fb7400640 1 -- 172.21.15.42:0/2319736397 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb8153640 con 0x7f4fb8074700 2024-09-17T01:42:33.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.640+0000 7f4fb6a00640 1 --2- 172.21.15.42:0/2319736397 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f9c004800 0x7f4fb81e4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:42:33.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.640+0000 7f4fb7400640 1 --2- 172.21.15.42:0/2319736397 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fb8074700 0x7f4fb8074b10 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f4fb80cca40 tx=0x7f4fb000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:33.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.640+0000 7f4fafe00640 1 -- 172.21.15.42:0/2319736397 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb0003d80 con 0x7f4fb8074700 2024-09-17T01:42:33.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.640+0000 7f4fafe00640 1 -- 172.21.15.42:0/2319736397 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fb0004b20 con 0x7f4fb8074700 2024-09-17T01:42:33.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.640+0000 7f4fb7e00640 1 -- 172.21.15.42:0/2319736397 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fb815c4d0 con 0x7f4fb8074700 2024-09-17T01:42:33.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.640+0000 7f4fafe00640 1 -- 172.21.15.42:0/2319736397 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb0004030 con 0x7f4fb8074700 2024-09-17T01:42:33.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.641+0000 7f4fb7e00640 1 -- 172.21.15.42:0/2319736397 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fb815bf10 con 0x7f4fb8074700 2024-09-17T01:42:33.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.642+0000 7f4fb7e00640 1 -- 172.21.15.42:0/2319736397 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fb815b990 con 0x7f4fb8074700 2024-09-17T01:42:33.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.643+0000 7f4fafe00640 1 -- 172.21.15.42:0/2319736397 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4fb00041d0 con 0x7f4fb8074700 2024-09-17T01:42:33.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.644+0000 7f4fafe00640 1 --2- 172.21.15.42:0/2319736397 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4f94078b90 0x7f4f9407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:33.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.644+0000 7f4fafe00640 1 -- 172.21.15.42:0/2319736397 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f4fb009bba0 con 0x7f4fb8074700 2024-09-17T01:42:33.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.644+0000 7f4fb6a00640 1 --2- 172.21.15.42:0/2319736397 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4f94078b90 0x7f4f9407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:33.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.645+0000 7f4fb6a00640 1 --2- 172.21.15.42:0/2319736397 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4f94078b90 0x7f4f9407b0a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8000ff0 tx=0x7f4fa80067a0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:33.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.648+0000 7f4fafe00640 1 -- 172.21.15.42:0/2319736397 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4fb815b990 con 0x7f4fb8074700 2024-09-17T01:42:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.882+0000 7f4fb7e00640 1 -- 172.21.15.42:0/2319736397 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4fb8074060 con 0x7f4fb8074700 2024-09-17T01:42:33.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.882+0000 7f4fafe00640 1 -- 172.21.15.42:0/2319736397 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5231 (secure 0 0 0) 0x7f4fb0063fd0 con 0x7f4fb8074700 2024-09-17T01:42:33.880 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:33.881 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2491855232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2491855232},{"type":"v1","addr":"172.21.15.43:6835","nonce":2491855232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4136787983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4136787983},{"type":"v1","addr":"172.21.15.43:6837","nonce":4136787983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/3441664627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3441664627},{"type":"v1","addr":"172.21.15.42:6834","nonce":3441664627}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:41:39.382305+0000","modified":"2024-09-17T01:41:42.412964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8442":{"gid":8442,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3060441721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3060441721},{"type":"v1","addr":"172.21.15.42:6835","nonce":3060441721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8442,"qdb_cluster":[8442]},"id":9}]} 2024-09-17T01:42:33.881 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 107 2024-09-17T01:42:33.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.885+0000 7f4fb7e00640 1 -- 172.21.15.42:0/2319736397 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4f94078b90 msgr2=0x7f4f9407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:33.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.885+0000 7f4fb7e00640 1 --2- 172.21.15.42:0/2319736397 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4f94078b90 0x7f4f9407b0a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8000ff0 tx=0x7f4fa80067a0 comp rx=0 tx=0).stop 2024-09-17T01:42:33.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.885+0000 7f4fb7e00640 1 -- 172.21.15.42:0/2319736397 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fb8074700 msgr2=0x7f4fb8074b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:33.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.885+0000 7f4fb7e00640 1 --2- 172.21.15.42:0/2319736397 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fb8074700 0x7f4fb8074b10 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f4fb80cca40 tx=0x7f4fb000f790 comp rx=0 tx=0).stop 2024-09-17T01:42:33.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.885+0000 7f4fb7e00640 1 -- 172.21.15.42:0/2319736397 shutdown_connections 2024-09-17T01:42:33.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.885+0000 7f4fb7e00640 1 --2- 172.21.15.42:0/2319736397 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4f94078b90 0x7f4f9407b0a0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:33.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.885+0000 7f4fb7e00640 1 --2- 172.21.15.42:0/2319736397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fb815f770 0x7f4fb8153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:33.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.885+0000 7f4fb7e00640 1 --2- 172.21.15.42:0/2319736397 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fb8074700 0x7f4fb8074b10 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:33.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.885+0000 7f4fb7e00640 1 --2- 172.21.15.42:0/2319736397 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4f9c004800 0x7f4fb81e4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:33.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.885+0000 7f4fb7e00640 1 -- 172.21.15.42:0/2319736397 >> 172.21.15.42:0/2319736397 conn(0x7f4fb80b25f0 msgr2=0x7f4fb80b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:33.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.885+0000 7f4fb7e00640 1 -- 172.21.15.42:0/2319736397 shutdown_connections 2024-09-17T01:42:33.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:33.885+0000 7f4fb7e00640 1 -- 172.21.15.42:0/2319736397 wait complete. 2024-09-17T01:42:33.906 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-17T01:42:33.906 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:42:34.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.132+0000 7f1c77c00640 1 -- 172.21.15.42:0/1317281004 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c7015cb80 msgr2=0x7f1c70152710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:34.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.132+0000 7f1c77c00640 1 --2- 172.21.15.42:0/1317281004 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c7015cb80 0x7f1c70152710 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1c64005fd0 tx=0x7f1c6402a8d0 comp rx=0 tx=0).stop 2024-09-17T01:42:34.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.132+0000 7f1c77c00640 1 -- 172.21.15.42:0/1317281004 shutdown_connections 2024-09-17T01:42:34.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.132+0000 7f1c77c00640 1 --2- 172.21.15.42:0/1317281004 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c7015cb80 0x7f1c70152710 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:34.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.132+0000 7f1c77c00640 1 -- 172.21.15.42:0/1317281004 >> 172.21.15.42:0/1317281004 conn(0x7f1c700b2930 msgr2=0x7f1c7006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:34.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.132+0000 7f1c77c00640 1 -- 172.21.15.42:0/1317281004 shutdown_connections 2024-09-17T01:42:34.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.132+0000 7f1c77c00640 1 -- 172.21.15.42:0/1317281004 wait complete. 2024-09-17T01:42:34.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.134+0000 7f1c77c00640 1 Processor -- start 2024-09-17T01:42:34.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.134+0000 7f1c77c00640 1 -- start start 2024-09-17T01:42:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.136+0000 7f1c77c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c7006d430 0x7f1c7014c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.136+0000 7f1c77c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c7015cb80 0x7f1c701f42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.136+0000 7f1c77c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c7015f480 0x7f1c700b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.136+0000 7f1c77c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1c70073900 con 0x7f1c7006d430 2024-09-17T01:42:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.136+0000 7f1c77c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1c70073780 con 0x7f1c7015f480 2024-09-17T01:42:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.136+0000 7f1c77c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1c70073a80 con 0x7f1c7015cb80 2024-09-17T01:42:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.136+0000 7f1c75200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c7006d430 0x7f1c7014c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.136+0000 7f1c75200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c7006d430 0x7f1c7014c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40040/0 (socket says 172.21.15.42:40040) 2024-09-17T01:42:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.136+0000 7f1c75200640 1 -- 172.21.15.42:0/1965344661 learned_addr learned my addr 172.21.15.42:0/1965344661 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.136+0000 7f1c75c00640 1 --2- 172.21.15.42:0/1965344661 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c7015f480 0x7f1c700b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.136+0000 7f1c6fe00640 1 --2- 172.21.15.42:0/1965344661 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c7015cb80 0x7f1c701f42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:34.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.137+0000 7f1c75200640 1 -- 172.21.15.42:0/1965344661 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c7015cb80 msgr2=0x7f1c701f42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:34.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.137+0000 7f1c75200640 1 --2- 172.21.15.42:0/1965344661 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c7015cb80 0x7f1c701f42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:34.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.137+0000 7f1c75200640 1 -- 172.21.15.42:0/1965344661 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c7015f480 msgr2=0x7f1c700b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:34.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.137+0000 7f1c75200640 1 --2- 172.21.15.42:0/1965344661 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c7015f480 0x7f1c700b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:34.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.137+0000 7f1c75200640 1 -- 172.21.15.42:0/1965344661 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c7014ffe0 con 0x7f1c7006d430 2024-09-17T01:42:34.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.137+0000 7f1c75200640 1 --2- 172.21.15.42:0/1965344661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c7006d430 0x7f1c7014c5f0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f1c64005fd0 tx=0x7f1c64032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:34.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.137+0000 7f1c6cc00640 1 -- 172.21.15.42:0/1965344661 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c64041070 con 0x7f1c7006d430 2024-09-17T01:42:34.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.137+0000 7f1c6cc00640 1 -- 172.21.15.42:0/1965344661 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c64003c60 con 0x7f1c7006d430 2024-09-17T01:42:34.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.137+0000 7f1c77c00640 1 -- 172.21.15.42:0/1965344661 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c701f4820 con 0x7f1c7006d430 2024-09-17T01:42:34.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.137+0000 7f1c6cc00640 1 -- 172.21.15.42:0/1965344661 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c64037040 con 0x7f1c7006d430 2024-09-17T01:42:34.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.138+0000 7f1c77c00640 1 -- 172.21.15.42:0/1965344661 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c70149f40 con 0x7f1c7006d430 2024-09-17T01:42:34.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.139+0000 7f1c77c00640 1 -- 172.21.15.42:0/1965344661 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c70152710 con 0x7f1c7006d430 2024-09-17T01:42:34.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.140+0000 7f1c6cc00640 1 -- 172.21.15.42:0/1965344661 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1c6403a070 con 0x7f1c7006d430 2024-09-17T01:42:34.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.141+0000 7f1c6cc00640 1 --2- 172.21.15.42:0/1965344661 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1c50078b90 0x7f1c5007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:34.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.141+0000 7f1c6cc00640 1 -- 172.21.15.42:0/1965344661 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f1c640bb9d0 con 0x7f1c7006d430 2024-09-17T01:42:34.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.142+0000 7f1c6fe00640 1 --2- 172.21.15.42:0/1965344661 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1c50078b90 0x7f1c5007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:34.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.143+0000 7f1c6fe00640 1 --2- 172.21.15.42:0/1965344661 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1c50078b90 0x7f1c5007b0a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c001eb0 tx=0x7f1c5c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:34.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.146+0000 7f1c6cc00640 1 -- 172.21.15.42:0/1965344661 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1c701f4820 con 0x7f1c7006d430 2024-09-17T01:42:34.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.412+0000 7f1c77c00640 1 -- 172.21.15.42:0/1965344661 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f1c7006a170 con 0x7f1c7006d430 2024-09-17T01:42:34.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.413+0000 7f1c6cc00640 1 -- 172.21.15.42:0/1965344661 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1678 (secure 0 0 0) 0x7f1c7014ffe0 con 0x7f1c7006d430 2024-09-17T01:42:34.411 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:34.411 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":654,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":136,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1049,"data_bytes":1078607866,"bytes_used":2606727168,"bytes_avail":770487386112,"bytes_total":773094113280,"write_bytes_sec":199106,"read_op_per_sec":0,"write_op_per_sec":65},"fsmap":{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8442}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-17T01:42:33.162318+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:42:34.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.415+0000 7f1c77c00640 1 -- 172.21.15.42:0/1965344661 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1c50078b90 msgr2=0x7f1c5007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:34.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.415+0000 7f1c77c00640 1 --2- 172.21.15.42:0/1965344661 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1c50078b90 0x7f1c5007b0a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c001eb0 tx=0x7f1c5c009040 comp rx=0 tx=0).stop 2024-09-17T01:42:34.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.415+0000 7f1c77c00640 1 -- 172.21.15.42:0/1965344661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c7006d430 msgr2=0x7f1c7014c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:34.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.415+0000 7f1c77c00640 1 --2- 172.21.15.42:0/1965344661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c7006d430 0x7f1c7014c5f0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f1c64005fd0 tx=0x7f1c64032f60 comp rx=0 tx=0).stop 2024-09-17T01:42:34.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.415+0000 7f1c77c00640 1 -- 172.21.15.42:0/1965344661 shutdown_connections 2024-09-17T01:42:34.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.415+0000 7f1c77c00640 1 --2- 172.21.15.42:0/1965344661 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1c50078b90 0x7f1c5007b0a0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:34.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.415+0000 7f1c77c00640 1 --2- 172.21.15.42:0/1965344661 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c7015f480 0x7f1c700b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:34.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.415+0000 7f1c77c00640 1 --2- 172.21.15.42:0/1965344661 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1c7015cb80 0x7f1c701f42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:34.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.415+0000 7f1c77c00640 1 --2- 172.21.15.42:0/1965344661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c7006d430 0x7f1c7014c5f0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:34.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.415+0000 7f1c77c00640 1 -- 172.21.15.42:0/1965344661 >> 172.21.15.42:0/1965344661 conn(0x7f1c700b2930 msgr2=0x7f1c701551e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:34.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.416+0000 7f1c77c00640 1 -- 172.21.15.42:0/1965344661 shutdown_connections 2024-09-17T01:42:34.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:34.416+0000 7f1c77c00640 1 -- 172.21.15.42:0/1965344661 wait complete. 2024-09-17T01:42:34.435 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'idle+waiting paths [/scrub_control_test_path]'} 2024-09-17T01:42:35.436 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:42:35.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.677+0000 7f7fdde00640 1 -- 172.21.15.42:0/3219821475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fd815cb80 msgr2=0x7f7fd8152710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:35.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.677+0000 7f7fdde00640 1 --2- 172.21.15.42:0/3219821475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fd815cb80 0x7f7fd8152710 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8005fd0 tx=0x7f7fc802a5c0 comp rx=0 tx=0).stop 2024-09-17T01:42:35.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.677+0000 7f7fdde00640 1 -- 172.21.15.42:0/3219821475 shutdown_connections 2024-09-17T01:42:35.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.677+0000 7f7fdde00640 1 --2- 172.21.15.42:0/3219821475 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7fd806d430 0x7f7fd806d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:35.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.677+0000 7f7fdde00640 1 --2- 172.21.15.42:0/3219821475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fd815cb80 0x7f7fd8152710 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:35.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.677+0000 7f7fdde00640 1 -- 172.21.15.42:0/3219821475 >> 172.21.15.42:0/3219821475 conn(0x7f7fd80b2930 msgr2=0x7f7fd806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:35.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.677+0000 7f7fdde00640 1 -- 172.21.15.42:0/3219821475 shutdown_connections 2024-09-17T01:42:35.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.677+0000 7f7fdde00640 1 -- 172.21.15.42:0/3219821475 wait complete. 2024-09-17T01:42:35.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.680+0000 7f7fdde00640 1 Processor -- start 2024-09-17T01:42:35.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.680+0000 7f7fdde00640 1 -- start start 2024-09-17T01:42:35.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.681+0000 7f7fdde00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7fd806d430 0x7f7fd81564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:35.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.681+0000 7f7fdde00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fd815cb80 0x7f7fd814ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:35.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.681+0000 7f7fdde00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fd815f480 0x7f7fd81580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:35.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.681+0000 7f7fdde00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd8073820 con 0x7f7fd815cb80 2024-09-17T01:42:35.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.681+0000 7f7fdde00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd80736a0 con 0x7f7fd815f480 2024-09-17T01:42:35.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.681+0000 7f7fdde00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7fd80739a0 con 0x7f7fd806d430 2024-09-17T01:42:35.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.681+0000 7f7fd6000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fd815cb80 0x7f7fd814ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:35.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.681+0000 7f7fd6000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fd815cb80 0x7f7fd814ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40070/0 (socket says 172.21.15.42:40070) 2024-09-17T01:42:35.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.681+0000 7f7fd6000640 1 -- 172.21.15.42:0/3637369773 learned_addr learned my addr 172.21.15.42:0/3637369773 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:35.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.682+0000 7f7fd6a00640 1 --2- 172.21.15.42:0/3637369773 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7fd806d430 0x7f7fd81564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:35.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.682+0000 7f7fd7400640 1 --2- 172.21.15.42:0/3637369773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fd815f480 0x7f7fd81580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:35.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.682+0000 7f7fd6000640 1 -- 172.21.15.42:0/3637369773 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7fd806d430 msgr2=0x7f7fd81564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:35.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.682+0000 7f7fd6000640 1 --2- 172.21.15.42:0/3637369773 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7fd806d430 0x7f7fd81564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:35.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.682+0000 7f7fd6000640 1 -- 172.21.15.42:0/3637369773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fd815f480 msgr2=0x7f7fd81580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:35.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.682+0000 7f7fd6000640 1 --2- 172.21.15.42:0/3637369773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fd815f480 0x7f7fd81580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:35.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.682+0000 7f7fd6000640 1 -- 172.21.15.42:0/3637369773 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd8156a20 con 0x7f7fd815cb80 2024-09-17T01:42:35.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.682+0000 7f7fd6000640 1 --2- 172.21.15.42:0/3637369773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fd815cb80 0x7f7fd814ab30 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400d650 tx=0x7f7fc400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:35.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.682+0000 7f7fcf400640 1 -- 172.21.15.42:0/3637369773 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4017070 con 0x7f7fd815cb80 2024-09-17T01:42:35.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.683+0000 7f7fcf400640 1 -- 172.21.15.42:0/3637369773 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fc4009b10 con 0x7f7fd815cb80 2024-09-17T01:42:35.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.683+0000 7f7fcf400640 1 -- 172.21.15.42:0/3637369773 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4010460 con 0x7f7fd815cb80 2024-09-17T01:42:35.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.683+0000 7f7fdde00640 1 -- 172.21.15.42:0/3637369773 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd8156f30 con 0x7f7fd815cb80 2024-09-17T01:42:35.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.683+0000 7f7fdde00640 1 -- 172.21.15.42:0/3637369773 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd81574f0 con 0x7f7fd815cb80 2024-09-17T01:42:35.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.684+0000 7f7fdde00640 1 -- 172.21.15.42:0/3637369773 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fd8073ec0 con 0x7f7fd815cb80 2024-09-17T01:42:35.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.685+0000 7f7fcf400640 1 -- 172.21.15.42:0/3637369773 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7fc401a070 con 0x7f7fd815cb80 2024-09-17T01:42:35.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.686+0000 7f7fcf400640 1 --2- 172.21.15.42:0/3637369773 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7fb8078bc0 0x7f7fb807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:35.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.686+0000 7f7fcf400640 1 -- 172.21.15.42:0/3637369773 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f7fc409ad60 con 0x7f7fd815cb80 2024-09-17T01:42:35.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.686+0000 7f7fd6a00640 1 --2- 172.21.15.42:0/3637369773 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7fb8078bc0 0x7f7fb807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:35.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.687+0000 7f7fd6a00640 1 --2- 172.21.15.42:0/3637369773 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7fb8078bc0 0x7f7fb807b0d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8033000 tx=0x7f7fc8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:35.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.691+0000 7f7fcf400640 1 -- 172.21.15.42:0/3637369773 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7fc4062b40 con 0x7f7fd815cb80 2024-09-17T01:42:35.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.927+0000 7f7fdde00640 1 -- 172.21.15.42:0/3637369773 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7fd8156cc0 con 0x7f7fd815cb80 2024-09-17T01:42:35.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.927+0000 7f7fcf400640 1 -- 172.21.15.42:0/3637369773 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5231 (secure 0 0 0) 0x7f7fc4067570 con 0x7f7fd815cb80 2024-09-17T01:42:35.925 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:35.925 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2491855232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2491855232},{"type":"v1","addr":"172.21.15.43:6835","nonce":2491855232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4136787983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4136787983},{"type":"v1","addr":"172.21.15.43:6837","nonce":4136787983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/3441664627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3441664627},{"type":"v1","addr":"172.21.15.42:6834","nonce":3441664627}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:41:39.382305+0000","modified":"2024-09-17T01:41:42.412964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8442":{"gid":8442,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3060441721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3060441721},{"type":"v1","addr":"172.21.15.42:6835","nonce":3060441721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8442,"qdb_cluster":[8442]},"id":9}]} 2024-09-17T01:42:35.926 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 107 2024-09-17T01:42:35.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.930+0000 7f7fdde00640 1 -- 172.21.15.42:0/3637369773 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7fb8078bc0 msgr2=0x7f7fb807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:35.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.930+0000 7f7fdde00640 1 --2- 172.21.15.42:0/3637369773 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7fb8078bc0 0x7f7fb807b0d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8033000 tx=0x7f7fc8004730 comp rx=0 tx=0).stop 2024-09-17T01:42:35.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.930+0000 7f7fdde00640 1 -- 172.21.15.42:0/3637369773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fd815cb80 msgr2=0x7f7fd814ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:35.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.930+0000 7f7fdde00640 1 --2- 172.21.15.42:0/3637369773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fd815cb80 0x7f7fd814ab30 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400d650 tx=0x7f7fc400db10 comp rx=0 tx=0).stop 2024-09-17T01:42:35.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.930+0000 7f7fdde00640 1 -- 172.21.15.42:0/3637369773 shutdown_connections 2024-09-17T01:42:35.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.930+0000 7f7fdde00640 1 --2- 172.21.15.42:0/3637369773 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7fb8078bc0 0x7f7fb807b0d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:35.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.930+0000 7f7fdde00640 1 --2- 172.21.15.42:0/3637369773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fd815f480 0x7f7fd81580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:35.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.930+0000 7f7fdde00640 1 --2- 172.21.15.42:0/3637369773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fd815cb80 0x7f7fd814ab30 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:35.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.930+0000 7f7fdde00640 1 --2- 172.21.15.42:0/3637369773 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7fd806d430 0x7f7fd81564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:35.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.930+0000 7f7fdde00640 1 -- 172.21.15.42:0/3637369773 >> 172.21.15.42:0/3637369773 conn(0x7f7fd80b2930 msgr2=0x7f7fd815f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:35.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.930+0000 7f7fdde00640 1 -- 172.21.15.42:0/3637369773 shutdown_connections 2024-09-17T01:42:35.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:35.930+0000 7f7fdde00640 1 -- 172.21.15.42:0/3637369773 wait complete. 2024-09-17T01:42:35.951 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-17T01:42:35.952 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:42:36.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.179+0000 7fe8e1000640 1 -- 172.21.15.42:0/3363456257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8dc0d0d80 msgr2=0x7fe8dc06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:36.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.179+0000 7fe8e1000640 1 --2- 172.21.15.42:0/3363456257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8dc0d0d80 0x7fe8dc06cd20 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc06dd20 tx=0x7fe8cc02a5f0 comp rx=0 tx=0).stop 2024-09-17T01:42:36.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.179+0000 7fe8e1000640 1 -- 172.21.15.42:0/3363456257 shutdown_connections 2024-09-17T01:42:36.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.179+0000 7fe8e1000640 1 --2- 172.21.15.42:0/3363456257 >> v2:172.21.15.43:3300/0 conn(0x7fe8dc06d260 0x7fe8dc0c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:36.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.179+0000 7fe8e1000640 1 --2- 172.21.15.42:0/3363456257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8dc0d0d80 0x7fe8dc06cd20 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:36.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.179+0000 7fe8e1000640 1 -- 172.21.15.42:0/3363456257 >> 172.21.15.42:0/3363456257 conn(0x7fe8dc0b25f0 msgr2=0x7fe8dc0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:36.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.179+0000 7fe8e1000640 1 -- 172.21.15.42:0/3363456257 shutdown_connections 2024-09-17T01:42:36.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.179+0000 7fe8e1000640 1 -- 172.21.15.42:0/3363456257 wait complete. 2024-09-17T01:42:36.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.181+0000 7fe8e1000640 1 Processor -- start 2024-09-17T01:42:36.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.181+0000 7fe8e1000640 1 -- start start 2024-09-17T01:42:36.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.182+0000 7fe8e1000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe8dc06d260 0x7fe8dc073bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:36.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.183+0000 7fe8e1000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8dc0af460 0x7fe8dc15ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:36.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.183+0000 7fe8e1000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8dc0d0d80 0x7fe8dc0746a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:36.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.183+0000 7fe8e1000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc1632b0 con 0x7fe8dc0af460 2024-09-17T01:42:36.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.183+0000 7fe8e1000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc163130 con 0x7fe8dc0d0d80 2024-09-17T01:42:36.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.183+0000 7fe8e1000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe8dc0ca070 con 0x7fe8dc06d260 2024-09-17T01:42:36.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.183+0000 7fe8d2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8dc0af460 0x7fe8dc15ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:36.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.183+0000 7fe8d2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8dc0af460 0x7fe8dc15ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56050/0 (socket says 172.21.15.42:56050) 2024-09-17T01:42:36.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.183+0000 7fe8d2a00640 1 -- 172.21.15.42:0/3108969928 learned_addr learned my addr 172.21.15.42:0/3108969928 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:36.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.183+0000 7fe8db400640 1 --2- 172.21.15.42:0/3108969928 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe8dc06d260 0x7fe8dc073bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:36.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.183+0000 7fe8dbe00640 1 --2- 172.21.15.42:0/3108969928 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8dc0d0d80 0x7fe8dc0746a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:36.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.183+0000 7fe8d2a00640 1 -- 172.21.15.42:0/3108969928 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe8dc06d260 msgr2=0x7fe8dc073bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:36.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.183+0000 7fe8d2a00640 1 --2- 172.21.15.42:0/3108969928 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe8dc06d260 0x7fe8dc073bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:36.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.183+0000 7fe8d2a00640 1 -- 172.21.15.42:0/3108969928 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8dc0d0d80 msgr2=0x7fe8dc0746a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:36.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.183+0000 7fe8d2a00640 1 --2- 172.21.15.42:0/3108969928 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8dc0d0d80 0x7fe8dc0746a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:36.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.183+0000 7fe8d2a00640 1 -- 172.21.15.42:0/3108969928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8dc1f9010 con 0x7fe8dc0af460 2024-09-17T01:42:36.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.184+0000 7fe8d2a00640 1 --2- 172.21.15.42:0/3108969928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8dc0af460 0x7fe8dc15ce40 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400c3d0 tx=0x7fe8c400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:36.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.184+0000 7fe8d3e00640 1 -- 172.21.15.42:0/3108969928 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4017070 con 0x7fe8dc0af460 2024-09-17T01:42:36.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.184+0000 7fe8d3e00640 1 -- 172.21.15.42:0/3108969928 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8c40053c0 con 0x7fe8dc0af460 2024-09-17T01:42:36.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.184+0000 7fe8d3e00640 1 -- 172.21.15.42:0/3108969928 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4003850 con 0x7fe8dc0af460 2024-09-17T01:42:36.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.184+0000 7fe8e1000640 1 -- 172.21.15.42:0/3108969928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8dc1f92f0 con 0x7fe8dc0af460 2024-09-17T01:42:36.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.184+0000 7fe8e1000640 1 -- 172.21.15.42:0/3108969928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8dc1f98b0 con 0x7fe8dc0af460 2024-09-17T01:42:36.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.185+0000 7fe8e1000640 1 -- 172.21.15.42:0/3108969928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8dc15eb70 con 0x7fe8dc0af460 2024-09-17T01:42:36.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.186+0000 7fe8d3e00640 1 -- 172.21.15.42:0/3108969928 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe8c401a070 con 0x7fe8dc0af460 2024-09-17T01:42:36.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.187+0000 7fe8d3e00640 1 --2- 172.21.15.42:0/3108969928 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe8b8078b90 0x7fe8b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:36.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.188+0000 7fe8d3e00640 1 -- 172.21.15.42:0/3108969928 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7fe8c4099fa0 con 0x7fe8dc0af460 2024-09-17T01:42:36.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.188+0000 7fe8db400640 1 --2- 172.21.15.42:0/3108969928 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe8b8078b90 0x7fe8b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:36.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.189+0000 7fe8db400640 1 --2- 172.21.15.42:0/3108969928 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe8b8078b90 0x7fe8b807b0a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc033000 tx=0x7fe8cc004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:36.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.192+0000 7fe8d3e00640 1 -- 172.21.15.42:0/3108969928 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe8dc06d670 con 0x7fe8dc0af460 2024-09-17T01:42:36.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.456+0000 7fe8e1000640 1 -- 172.21.15.42:0/3108969928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe8dc1f9ab0 con 0x7fe8dc0af460 2024-09-17T01:42:36.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.457+0000 7fe8d3e00640 1 -- 172.21.15.42:0/3108969928 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1678 (secure 0 0 0) 0x7fe8c4061e20 con 0x7fe8dc0af460 2024-09-17T01:42:36.455 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:36.455 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":657,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":136,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1049,"data_bytes":1078609931,"bytes_used":2606735360,"bytes_avail":770487377920,"bytes_total":773094113280,"write_bytes_sec":199366,"read_op_per_sec":0,"write_op_per_sec":65},"fsmap":{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8442}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-17T01:42:33.162318+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:42:36.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.459+0000 7fe8e1000640 1 -- 172.21.15.42:0/3108969928 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe8b8078b90 msgr2=0x7fe8b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:36.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.459+0000 7fe8e1000640 1 --2- 172.21.15.42:0/3108969928 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe8b8078b90 0x7fe8b807b0a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc033000 tx=0x7fe8cc004730 comp rx=0 tx=0).stop 2024-09-17T01:42:36.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.459+0000 7fe8e1000640 1 -- 172.21.15.42:0/3108969928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8dc0af460 msgr2=0x7fe8dc15ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:36.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.459+0000 7fe8e1000640 1 --2- 172.21.15.42:0/3108969928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8dc0af460 0x7fe8dc15ce40 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400c3d0 tx=0x7fe8c400c890 comp rx=0 tx=0).stop 2024-09-17T01:42:36.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.459+0000 7fe8e1000640 1 -- 172.21.15.42:0/3108969928 shutdown_connections 2024-09-17T01:42:36.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.459+0000 7fe8e1000640 1 --2- 172.21.15.42:0/3108969928 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe8b8078b90 0x7fe8b807b0a0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:36.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.459+0000 7fe8e1000640 1 --2- 172.21.15.42:0/3108969928 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe8dc0d0d80 0x7fe8dc0746a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:36.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.459+0000 7fe8e1000640 1 --2- 172.21.15.42:0/3108969928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe8dc0af460 0x7fe8dc15ce40 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:36.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.459+0000 7fe8e1000640 1 --2- 172.21.15.42:0/3108969928 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe8dc06d260 0x7fe8dc073bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:36.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.459+0000 7fe8e1000640 1 -- 172.21.15.42:0/3108969928 >> 172.21.15.42:0/3108969928 conn(0x7fe8dc0b25f0 msgr2=0x7fe8dc15ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:36.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.459+0000 7fe8e1000640 1 -- 172.21.15.42:0/3108969928 shutdown_connections 2024-09-17T01:42:36.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:36.459+0000 7fe8e1000640 1 -- 172.21.15.42:0/3108969928 wait complete. 2024-09-17T01:42:36.480 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'idle+waiting paths [/scrub_control_test_path]'} 2024-09-17T01:42:37.481 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:42:37.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.724+0000 7f3f82400640 1 -- 172.21.15.42:0/3406972568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f7c15f830 msgr2=0x7f3f7c15fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:37.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.724+0000 7f3f82400640 1 --2- 172.21.15.42:0/3406972568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f7c15f830 0x7f3f7c15fcc0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3f68009830 tx=0x7f3f6802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:42:37.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.724+0000 7f3f82400640 1 -- 172.21.15.42:0/3406972568 shutdown_connections 2024-09-17T01:42:37.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.724+0000 7f3f82400640 1 --2- 172.21.15.42:0/3406972568 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3f7c0cafe0 0x7f3f7c06e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:37.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.724+0000 7f3f82400640 1 --2- 172.21.15.42:0/3406972568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f7c15f830 0x7f3f7c15fcc0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:37.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.724+0000 7f3f82400640 1 -- 172.21.15.42:0/3406972568 >> 172.21.15.42:0/3406972568 conn(0x7f3f7c0b25f0 msgr2=0x7f3f7c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:37.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.724+0000 7f3f82400640 1 -- 172.21.15.42:0/3406972568 shutdown_connections 2024-09-17T01:42:37.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.724+0000 7f3f82400640 1 -- 172.21.15.42:0/3406972568 wait complete. 2024-09-17T01:42:37.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.726+0000 7f3f82400640 1 Processor -- start 2024-09-17T01:42:37.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.726+0000 7f3f82400640 1 -- start start 2024-09-17T01:42:37.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.728+0000 7f3f82400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3f7c0cafe0 0x7f3f7c1e6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:37.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.728+0000 7f3f82400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f7c15b680 0x7f3f7c1e7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:37.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.728+0000 7f3f82400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f7c154b00 0x7f3f7c15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:37.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.728+0000 7f3f82400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c06f530 con 0x7f3f7c15b680 2024-09-17T01:42:37.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.728+0000 7f3f82400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c06f3b0 con 0x7f3f7c154b00 2024-09-17T01:42:37.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.728+0000 7f3f82400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3f7c06f6b0 con 0x7f3f7c0cafe0 2024-09-17T01:42:37.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.728+0000 7f3f7be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f7c15b680 0x7f3f7c1e7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:37.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.728+0000 7f3f7be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f7c15b680 0x7f3f7c1e7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56058/0 (socket says 172.21.15.42:56058) 2024-09-17T01:42:37.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.728+0000 7f3f7be00640 1 -- 172.21.15.42:0/1426020403 learned_addr learned my addr 172.21.15.42:0/1426020403 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:37.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.728+0000 7f3f81000640 1 --2- 172.21.15.42:0/1426020403 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3f7c0cafe0 0x7f3f7c1e6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:37.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.728+0000 7f3f81a00640 1 --2- 172.21.15.42:0/1426020403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f7c154b00 0x7f3f7c15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:37.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.728+0000 7f3f7be00640 1 -- 172.21.15.42:0/1426020403 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3f7c0cafe0 msgr2=0x7f3f7c1e6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:37.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.728+0000 7f3f7be00640 1 --2- 172.21.15.42:0/1426020403 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3f7c0cafe0 0x7f3f7c1e6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:37.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.728+0000 7f3f7be00640 1 -- 172.21.15.42:0/1426020403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f7c154b00 msgr2=0x7f3f7c15d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:37.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.728+0000 7f3f7be00640 1 --2- 172.21.15.42:0/1426020403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f7c154b00 0x7f3f7c15d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:37.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.728+0000 7f3f7be00640 1 -- 172.21.15.42:0/1426020403 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7c142690 con 0x7f3f7c15b680 2024-09-17T01:42:37.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.729+0000 7f3f7be00640 1 --2- 172.21.15.42:0/1426020403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f7c15b680 0x7f3f7c1e7170 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f3f68009950 tx=0x7f3f68030650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:37.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.729+0000 7f3f78c00640 1 -- 172.21.15.42:0/1426020403 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6803f070 con 0x7f3f7c15b680 2024-09-17T01:42:37.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.729+0000 7f3f78c00640 1 -- 172.21.15.42:0/1426020403 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f68030d40 con 0x7f3f7c15b680 2024-09-17T01:42:37.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.729+0000 7f3f78c00640 1 -- 172.21.15.42:0/1426020403 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f68004280 con 0x7f3f7c15b680 2024-09-17T01:42:37.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.729+0000 7f3f82400640 1 -- 172.21.15.42:0/1426020403 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f7c142980 con 0x7f3f7c15b680 2024-09-17T01:42:37.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.729+0000 7f3f82400640 1 -- 172.21.15.42:0/1426020403 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f7c15bd10 con 0x7f3f7c15b680 2024-09-17T01:42:37.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.730+0000 7f3f82400640 1 -- 172.21.15.42:0/1426020403 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f7c0763d0 con 0x7f3f7c15b680 2024-09-17T01:42:37.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.731+0000 7f3f78c00640 1 -- 172.21.15.42:0/1426020403 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3f680035f0 con 0x7f3f7c15b680 2024-09-17T01:42:37.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.732+0000 7f3f78c00640 1 --2- 172.21.15.42:0/1426020403 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3f5c078bc0 0x7f3f5c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:37.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.732+0000 7f3f78c00640 1 -- 172.21.15.42:0/1426020403 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f3f680bb6a0 con 0x7f3f7c15b680 2024-09-17T01:42:37.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.733+0000 7f3f81000640 1 --2- 172.21.15.42:0/1426020403 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3f5c078bc0 0x7f3f5c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:37.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.733+0000 7f3f81000640 1 --2- 172.21.15.42:0/1426020403 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3f5c078bc0 0x7f3f5c07b0d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3f70007960 tx=0x7f3f70001d50 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:37.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.737+0000 7f3f78c00640 1 -- 172.21.15.42:0/1426020403 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3f7c0763d0 con 0x7f3f7c15b680 2024-09-17T01:42:37.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.970+0000 7f3f82400640 1 -- 172.21.15.42:0/1426020403 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f7c06e950 con 0x7f3f7c15b680 2024-09-17T01:42:37.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.970+0000 7f3f78c00640 1 -- 172.21.15.42:0/1426020403 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5231 (secure 0 0 0) 0x7f3f68083510 con 0x7f3f7c15b680 2024-09-17T01:42:37.968 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:37.969 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2491855232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2491855232},{"type":"v1","addr":"172.21.15.43:6835","nonce":2491855232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4136787983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4136787983},{"type":"v1","addr":"172.21.15.43:6837","nonce":4136787983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/3441664627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3441664627},{"type":"v1","addr":"172.21.15.42:6834","nonce":3441664627}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:41:39.382305+0000","modified":"2024-09-17T01:41:42.412964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8442":{"gid":8442,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3060441721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3060441721},{"type":"v1","addr":"172.21.15.42:6835","nonce":3060441721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8442,"qdb_cluster":[8442]},"id":9}]} 2024-09-17T01:42:37.969 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 107 2024-09-17T01:42:37.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.973+0000 7f3f82400640 1 -- 172.21.15.42:0/1426020403 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3f5c078bc0 msgr2=0x7f3f5c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:37.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.973+0000 7f3f82400640 1 --2- 172.21.15.42:0/1426020403 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3f5c078bc0 0x7f3f5c07b0d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3f70007960 tx=0x7f3f70001d50 comp rx=0 tx=0).stop 2024-09-17T01:42:37.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.973+0000 7f3f82400640 1 -- 172.21.15.42:0/1426020403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f7c15b680 msgr2=0x7f3f7c1e7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:37.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.973+0000 7f3f82400640 1 --2- 172.21.15.42:0/1426020403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f7c15b680 0x7f3f7c1e7170 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f3f68009950 tx=0x7f3f68030650 comp rx=0 tx=0).stop 2024-09-17T01:42:37.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.973+0000 7f3f82400640 1 -- 172.21.15.42:0/1426020403 shutdown_connections 2024-09-17T01:42:37.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.973+0000 7f3f82400640 1 --2- 172.21.15.42:0/1426020403 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3f5c078bc0 0x7f3f5c07b0d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:37.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.973+0000 7f3f82400640 1 --2- 172.21.15.42:0/1426020403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f7c154b00 0x7f3f7c15d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:37.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.973+0000 7f3f82400640 1 --2- 172.21.15.42:0/1426020403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3f7c15b680 0x7f3f7c1e7170 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:37.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.973+0000 7f3f82400640 1 --2- 172.21.15.42:0/1426020403 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3f7c0cafe0 0x7f3f7c1e6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:37.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.973+0000 7f3f82400640 1 -- 172.21.15.42:0/1426020403 >> 172.21.15.42:0/1426020403 conn(0x7f3f7c0b25f0 msgr2=0x7f3f7c1e8090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:37.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.973+0000 7f3f82400640 1 -- 172.21.15.42:0/1426020403 shutdown_connections 2024-09-17T01:42:37.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:37.973+0000 7f3f82400640 1 -- 172.21.15.42:0/1426020403 wait complete. 2024-09-17T01:42:37.994 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-17T01:42:37.994 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:42:38.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.222+0000 7ffbdf200640 1 -- 172.21.15.42:0/2662488631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbd80cf7c0 msgr2=0x7ffbd806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:38.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.222+0000 7ffbdf200640 1 --2- 172.21.15.42:0/2662488631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbd80cf7c0 0x7ffbd806cd20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8005fd0 tx=0x7ffbc802a5d0 comp rx=0 tx=0).stop 2024-09-17T01:42:38.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.223+0000 7ffbdf200640 1 -- 172.21.15.42:0/2662488631 shutdown_connections 2024-09-17T01:42:38.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.223+0000 7ffbdf200640 1 --2- 172.21.15.42:0/2662488631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbd80cf7c0 0x7ffbd806cd20 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:38.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.223+0000 7ffbdf200640 1 --2- 172.21.15.42:0/2662488631 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbd80b4be0 0x7ffbd815d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:38.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.223+0000 7ffbdf200640 1 -- 172.21.15.42:0/2662488631 >> 172.21.15.42:0/2662488631 conn(0x7ffbd80b25f0 msgr2=0x7ffbd80d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:38.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.223+0000 7ffbdf200640 1 -- 172.21.15.42:0/2662488631 shutdown_connections 2024-09-17T01:42:38.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.223+0000 7ffbdf200640 1 -- 172.21.15.42:0/2662488631 wait complete. 2024-09-17T01:42:38.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.225+0000 7ffbdf200640 1 Processor -- start 2024-09-17T01:42:38.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.225+0000 7ffbdf200640 1 -- start start 2024-09-17T01:42:38.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.226+0000 7ffbdf200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbd806d260 0x7ffbd80cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:38.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.226+0000 7ffbdf200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbd80b4be0 0x7ffbd80c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:38.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.226+0000 7ffbdf200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbd80cf7c0 0x7ffbd80c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:38.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.226+0000 7ffbdf200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd81537f0 con 0x7ffbd80cf7c0 2024-09-17T01:42:38.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.226+0000 7ffbdf200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd80cfdc0 con 0x7ffbd806d260 2024-09-17T01:42:38.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.226+0000 7ffbdf200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ffbd8153970 con 0x7ffbd80b4be0 2024-09-17T01:42:38.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.227+0000 7ffbde800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbd80cf7c0 0x7ffbd80c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:38.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.227+0000 7ffbde800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbd80cf7c0 0x7ffbd80c9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56066/0 (socket says 172.21.15.42:56066) 2024-09-17T01:42:38.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.227+0000 7ffbde800640 1 -- 172.21.15.42:0/3437159179 learned_addr learned my addr 172.21.15.42:0/3437159179 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:38.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.227+0000 7ffbdde00640 1 --2- 172.21.15.42:0/3437159179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbd806d260 0x7ffbd80cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:38.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.227+0000 7ffbdd400640 1 --2- 172.21.15.42:0/3437159179 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbd80b4be0 0x7ffbd80c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:38.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.227+0000 7ffbdde00640 1 -- 172.21.15.42:0/3437159179 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbd80b4be0 msgr2=0x7ffbd80c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:38.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.227+0000 7ffbdde00640 1 --2- 172.21.15.42:0/3437159179 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbd80b4be0 0x7ffbd80c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:38.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.227+0000 7ffbdde00640 1 -- 172.21.15.42:0/3437159179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbd80cf7c0 msgr2=0x7ffbd80c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:38.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.227+0000 7ffbdde00640 1 --2- 172.21.15.42:0/3437159179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbd80cf7c0 0x7ffbd80c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:38.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.227+0000 7ffbdde00640 1 -- 172.21.15.42:0/3437159179 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd8150250 con 0x7ffbd806d260 2024-09-17T01:42:38.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.227+0000 7ffbde800640 1 --2- 172.21.15.42:0/3437159179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbd80cf7c0 0x7ffbd80c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:42:38.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.228+0000 7ffbdde00640 1 --2- 172.21.15.42:0/3437159179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbd806d260 0x7ffbd80cbc80 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00e6d0 tx=0x7ffbcc00eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:38.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.228+0000 7ffbd2000640 1 -- 172.21.15.42:0/3437159179 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc00cab0 con 0x7ffbd806d260 2024-09-17T01:42:38.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.228+0000 7ffbd2000640 1 -- 172.21.15.42:0/3437159179 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffbcc00cd40 con 0x7ffbd806d260 2024-09-17T01:42:38.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.228+0000 7ffbdf200640 1 -- 172.21.15.42:0/3437159179 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbd814ff70 con 0x7ffbd806d260 2024-09-17T01:42:38.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.228+0000 7ffbd2000640 1 -- 172.21.15.42:0/3437159179 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc010690 con 0x7ffbd806d260 2024-09-17T01:42:38.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.228+0000 7ffbdf200640 1 -- 172.21.15.42:0/3437159179 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbd81f9d10 con 0x7ffbd806d260 2024-09-17T01:42:38.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.229+0000 7ffbdf200640 1 -- 172.21.15.42:0/3437159179 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbd81f9850 con 0x7ffbd806d260 2024-09-17T01:42:38.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.231+0000 7ffbd2000640 1 -- 172.21.15.42:0/3437159179 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffbcc010830 con 0x7ffbd806d260 2024-09-17T01:42:38.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.232+0000 7ffbd2000640 1 --2- 172.21.15.42:0/3437159179 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ffbbc078b90 0x7ffbbc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:38.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.232+0000 7ffbd2000640 1 -- 172.21.15.42:0/3437159179 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7ffbcc09be40 con 0x7ffbd806d260 2024-09-17T01:42:38.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.232+0000 7ffbdd400640 1 --2- 172.21.15.42:0/3437159179 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ffbbc078b90 0x7ffbbc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:38.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.233+0000 7ffbdd400640 1 --2- 172.21.15.42:0/3437159179 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ffbbc078b90 0x7ffbbc07b0a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8033000 tx=0x7ffbc8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:38.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.236+0000 7ffbd2000640 1 -- 172.21.15.42:0/3437159179 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffbd81f9850 con 0x7ffbd806d260 2024-09-17T01:42:38.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.502+0000 7ffbdf200640 1 -- 172.21.15.42:0/3437159179 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ffbd815d6b0 con 0x7ffbd806d260 2024-09-17T01:42:38.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.503+0000 7ffbd2000640 1 -- 172.21.15.42:0/3437159179 <== mon.1 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1229 (secure 0 0 0) 0x7ffbcc063cb0 con 0x7ffbd806d260 2024-09-17T01:42:38.501 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:38.501 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":659,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":136,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1049,"data_bytes":1078609931,"bytes_used":2606735360,"bytes_avail":770487377920,"bytes_total":773094113280,"write_bytes_sec":156282,"read_op_per_sec":0,"write_op_per_sec":51},"fsmap":{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8442}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-17T01:42:37.163500+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:42:38.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.505+0000 7ffbdf200640 1 -- 172.21.15.42:0/3437159179 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ffbbc078b90 msgr2=0x7ffbbc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:38.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.505+0000 7ffbdf200640 1 --2- 172.21.15.42:0/3437159179 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ffbbc078b90 0x7ffbbc07b0a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8033000 tx=0x7ffbc8004730 comp rx=0 tx=0).stop 2024-09-17T01:42:38.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.505+0000 7ffbdf200640 1 -- 172.21.15.42:0/3437159179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbd806d260 msgr2=0x7ffbd80cbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:38.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.505+0000 7ffbdf200640 1 --2- 172.21.15.42:0/3437159179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbd806d260 0x7ffbd80cbc80 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00e6d0 tx=0x7ffbcc00eb90 comp rx=0 tx=0).stop 2024-09-17T01:42:38.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.505+0000 7ffbdf200640 1 -- 172.21.15.42:0/3437159179 shutdown_connections 2024-09-17T01:42:38.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.505+0000 7ffbdf200640 1 --2- 172.21.15.42:0/3437159179 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ffbbc078b90 0x7ffbbc07b0a0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:38.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.505+0000 7ffbdf200640 1 --2- 172.21.15.42:0/3437159179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbd80cf7c0 0x7ffbd80c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:38.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.505+0000 7ffbdf200640 1 --2- 172.21.15.42:0/3437159179 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbd80b4be0 0x7ffbd80c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:38.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.505+0000 7ffbdf200640 1 --2- 172.21.15.42:0/3437159179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbd806d260 0x7ffbd80cbc80 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:38.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.505+0000 7ffbdf200640 1 -- 172.21.15.42:0/3437159179 >> 172.21.15.42:0/3437159179 conn(0x7ffbd80b25f0 msgr2=0x7ffbd815fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:38.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.506+0000 7ffbdf200640 1 -- 172.21.15.42:0/3437159179 shutdown_connections 2024-09-17T01:42:38.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:38.506+0000 7ffbdf200640 1 -- 172.21.15.42:0/3437159179 wait complete. 2024-09-17T01:42:38.524 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T01:42:38.525 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:42:38.525 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:42:38.609 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:42:38.717 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:42:38.717 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:42:38.717 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:42:38.717 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:42:38.753 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:42:38.753 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:42:38.829 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T01:42:39.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.099+0000 7f9a49c00640 1 -- 172.21.15.42:0/3080258957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a4406d260 msgr2=0x7f9a44152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:39.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.099+0000 7f9a49c00640 1 --2- 172.21.15.42:0/3080258957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a4406d260 0x7f9a44152ed0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f9a440b4870 tx=0x7f9a3c02aac0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.099+0000 7f9a49c00640 1 -- 172.21.15.42:0/3080258957 shutdown_connections 2024-09-17T01:42:39.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.099+0000 7f9a49c00640 1 --2- 172.21.15.42:0/3080258957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a4406d260 0x7f9a44152ed0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.099+0000 7f9a49c00640 1 --2- 172.21.15.42:0/3080258957 >> v2:172.21.15.43:3300/0 conn(0x7f9a440cf7c0 0x7f9a4406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.099+0000 7f9a49c00640 1 -- 172.21.15.42:0/3080258957 >> 172.21.15.42:0/3080258957 conn(0x7f9a440b25f0 msgr2=0x7f9a440d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:39.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.099+0000 7f9a49c00640 1 -- 172.21.15.42:0/3080258957 shutdown_connections 2024-09-17T01:42:39.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.099+0000 7f9a49c00640 1 -- 172.21.15.42:0/3080258957 wait complete. 2024-09-17T01:42:39.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.101+0000 7f9a49c00640 1 Processor -- start 2024-09-17T01:42:39.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.101+0000 7f9a49c00640 1 -- start start 2024-09-17T01:42:39.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.103+0000 7f9a49c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a4406d260 0x7f9a4409dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:39.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.103+0000 7f9a49c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a440b4be0 0x7f9a441e4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:39.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.103+0000 7f9a49c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9a440cf7c0 0x7f9a4415e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:39.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.103+0000 7f9a49c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9a44153850 con 0x7f9a440b4be0 2024-09-17T01:42:39.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.103+0000 7f9a49c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9a441536d0 con 0x7f9a4406d260 2024-09-17T01:42:39.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.103+0000 7f9a49c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9a441539d0 con 0x7f9a440cf7c0 2024-09-17T01:42:39.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.103+0000 7f9a3b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a440b4be0 0x7f9a441e4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:39.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.103+0000 7f9a3b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a440b4be0 0x7f9a441e4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56080/0 (socket says 172.21.15.42:56080) 2024-09-17T01:42:39.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.103+0000 7f9a3b400640 1 -- 172.21.15.42:0/2821884065 learned_addr learned my addr 172.21.15.42:0/2821884065 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:39.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.103+0000 7f9a43e00640 1 --2- 172.21.15.42:0/2821884065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a4406d260 0x7f9a4409dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:39.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.104+0000 7f9a3b400640 1 -- 172.21.15.42:0/2821884065 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9a440cf7c0 msgr2=0x7f9a4415e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:39.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.104+0000 7f9a49200640 1 --2- 172.21.15.42:0/2821884065 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9a440cf7c0 0x7f9a4415e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:39.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.104+0000 7f9a3b400640 1 --2- 172.21.15.42:0/2821884065 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9a440cf7c0 0x7f9a4415e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.104+0000 7f9a3b400640 1 -- 172.21.15.42:0/2821884065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a4406d260 msgr2=0x7f9a4409dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:39.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.104+0000 7f9a3b400640 1 --2- 172.21.15.42:0/2821884065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a4406d260 0x7f9a4409dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.104+0000 7f9a3b400640 1 -- 172.21.15.42:0/2821884065 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a441f5e80 con 0x7f9a440b4be0 2024-09-17T01:42:39.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.104+0000 7f9a43e00640 1 --2- 172.21.15.42:0/2821884065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a4406d260 0x7f9a4409dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:42:39.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.104+0000 7f9a49200640 1 --2- 172.21.15.42:0/2821884065 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9a440cf7c0 0x7f9a4415e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:42:39.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.104+0000 7f9a3b400640 1 --2- 172.21.15.42:0/2821884065 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a440b4be0 0x7f9a441e4ec0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00d6d0 tx=0x7f9a2c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:39.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.104+0000 7f9a40c00640 1 -- 172.21.15.42:0/2821884065 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c017070 con 0x7f9a440b4be0 2024-09-17T01:42:39.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.104+0000 7f9a40c00640 1 -- 172.21.15.42:0/2821884065 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a2c005330 con 0x7f9a440b4be0 2024-09-17T01:42:39.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.104+0000 7f9a49c00640 1 -- 172.21.15.42:0/2821884065 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a441f6160 con 0x7f9a440b4be0 2024-09-17T01:42:39.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.104+0000 7f9a40c00640 1 -- 172.21.15.42:0/2821884065 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c009820 con 0x7f9a440b4be0 2024-09-17T01:42:39.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.104+0000 7f9a49c00640 1 -- 172.21.15.42:0/2821884065 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a441f6720 con 0x7f9a440b4be0 2024-09-17T01:42:39.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.106+0000 7f9a49c00640 1 -- 172.21.15.42:0/2821884065 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a44152ed0 con 0x7f9a440b4be0 2024-09-17T01:42:39.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.107+0000 7f9a40c00640 1 -- 172.21.15.42:0/2821884065 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9a2c009bd0 con 0x7f9a440b4be0 2024-09-17T01:42:39.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.108+0000 7f9a40c00640 1 --2- 172.21.15.42:0/2821884065 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9a20078b90 0x7f9a2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:39.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.108+0000 7f9a40c00640 1 -- 172.21.15.42:0/2821884065 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f9a2c09b040 con 0x7f9a440b4be0 2024-09-17T01:42:39.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.108+0000 7f9a43e00640 1 --2- 172.21.15.42:0/2821884065 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9a20078b90 0x7f9a2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:39.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.109+0000 7f9a43e00640 1 --2- 172.21.15.42:0/2821884065 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9a20078b90 0x7f9a2007b0a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9a340016a0 tx=0x7f9a34009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:39.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.112+0000 7f9a40c00640 1 -- 172.21.15.42:0/2821884065 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9a2c063480 con 0x7f9a440b4be0 2024-09-17T01:42:39.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.318+0000 7f9a49c00640 1 -- 172.21.15.42:0/2821884065 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9a440b18c0 con 0x7f9a440b4be0 2024-09-17T01:42:39.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.318+0000 7f9a40c00640 1 -- 172.21.15.42:0/2821884065 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v136) ==== 80+0+0 (secure 0 0 0) 0x7f9a2c062d80 con 0x7f9a440b4be0 2024-09-17T01:42:39.316 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-17T01:42:39.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.321+0000 7f9a49c00640 1 -- 172.21.15.42:0/2821884065 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9a20078b90 msgr2=0x7f9a2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:39.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.321+0000 7f9a49c00640 1 --2- 172.21.15.42:0/2821884065 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9a20078b90 0x7f9a2007b0a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9a340016a0 tx=0x7f9a34009040 comp rx=0 tx=0).stop 2024-09-17T01:42:39.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.321+0000 7f9a49c00640 1 -- 172.21.15.42:0/2821884065 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a440b4be0 msgr2=0x7f9a441e4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:39.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.321+0000 7f9a49c00640 1 --2- 172.21.15.42:0/2821884065 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a440b4be0 0x7f9a441e4ec0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00d6d0 tx=0x7f9a2c00db90 comp rx=0 tx=0).stop 2024-09-17T01:42:39.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.321+0000 7f9a49c00640 1 -- 172.21.15.42:0/2821884065 shutdown_connections 2024-09-17T01:42:39.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.321+0000 7f9a49c00640 1 --2- 172.21.15.42:0/2821884065 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9a20078b90 0x7f9a2007b0a0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.321+0000 7f9a49c00640 1 --2- 172.21.15.42:0/2821884065 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9a440cf7c0 0x7f9a4415e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.321+0000 7f9a49c00640 1 --2- 172.21.15.42:0/2821884065 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a440b4be0 0x7f9a441e4ec0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.321+0000 7f9a49c00640 1 --2- 172.21.15.42:0/2821884065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a4406d260 0x7f9a4409dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.321+0000 7f9a49c00640 1 -- 172.21.15.42:0/2821884065 >> 172.21.15.42:0/2821884065 conn(0x7f9a440b25f0 msgr2=0x7f9a440afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:39.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.321+0000 7f9a49c00640 1 -- 172.21.15.42:0/2821884065 shutdown_connections 2024-09-17T01:42:39.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:39.321+0000 7f9a49c00640 1 -- 172.21.15.42:0/2821884065 wait complete. 2024-09-17T01:42:39.343 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T01:42:39.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:42:39.343 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T01:42:39.735 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:42:39.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:42:39.735 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T01:42:39.771 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:42:39.772 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:42:39.772 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:42:39.810 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:42:39.810 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:42:39.810 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:42:39.810 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:42:39.848 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:42:39.848 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:42:39.848 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:42:39.848 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:42:39.886 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:42:39.886 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:42:40.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.118+0000 7f7fb0200640 1 -- 172.21.15.42:0/161257165 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7fa815cec0 msgr2=0x7f7fa815d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:40.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.118+0000 7f7fb0200640 1 --2- 172.21.15.42:0/161257165 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7fa815cec0 0x7f7fa815d2d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009830 tx=0x7f7f9c02a510 comp rx=0 tx=0).stop 2024-09-17T01:42:40.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.119+0000 7f7fb0200640 1 -- 172.21.15.42:0/161257165 shutdown_connections 2024-09-17T01:42:40.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.119+0000 7f7fb0200640 1 --2- 172.21.15.42:0/161257165 >> v2:172.21.15.43:3300/0 conn(0x7f7fa80cf0c0 0x7f7fa806d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.119+0000 7f7fb0200640 1 --2- 172.21.15.42:0/161257165 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7fa815cec0 0x7f7fa815d2d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.119+0000 7f7fb0200640 1 -- 172.21.15.42:0/161257165 >> 172.21.15.42:0/161257165 conn(0x7f7fa80b2930 msgr2=0x7f7fa806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:40.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.119+0000 7f7fb0200640 1 -- 172.21.15.42:0/161257165 shutdown_connections 2024-09-17T01:42:40.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.119+0000 7f7fb0200640 1 -- 172.21.15.42:0/161257165 wait complete. 2024-09-17T01:42:40.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.121+0000 7f7fb0200640 1 Processor -- start 2024-09-17T01:42:40.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.121+0000 7f7fb0200640 1 -- start start 2024-09-17T01:42:40.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.123+0000 7f7fb0200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fa80cecb0 0x7f7fa81f3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:40.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.123+0000 7f7fb0200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7fa80cf0c0 0x7f7fa814a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:40.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.123+0000 7f7fb0200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fa815cec0 0x7f7fa814ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:40.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.123+0000 7f7fb0200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa8074130 con 0x7f7fa80cecb0 2024-09-17T01:42:40.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.123+0000 7f7fb0200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa8073fb0 con 0x7f7fa815cec0 2024-09-17T01:42:40.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.123+0000 7f7fb0200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7fa806d970 con 0x7f7fa80cf0c0 2024-09-17T01:42:40.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.123+0000 7f7fad800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fa80cecb0 0x7f7fa81f3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:40.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.123+0000 7f7fad800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fa80cecb0 0x7f7fa81f3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56086/0 (socket says 172.21.15.42:56086) 2024-09-17T01:42:40.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.123+0000 7f7fad800640 1 -- 172.21.15.42:0/725969793 learned_addr learned my addr 172.21.15.42:0/725969793 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:40.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.123+0000 7f7fae200640 1 --2- 172.21.15.42:0/725969793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fa815cec0 0x7f7fa814ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:40.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.123+0000 7f7face00640 1 --2- 172.21.15.42:0/725969793 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7fa80cf0c0 0x7f7fa814a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:40.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.123+0000 7f7fad800640 1 -- 172.21.15.42:0/725969793 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7fa80cf0c0 msgr2=0x7f7fa814a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:40.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.123+0000 7f7fad800640 1 --2- 172.21.15.42:0/725969793 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7fa80cf0c0 0x7f7fa814a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.123+0000 7f7fad800640 1 -- 172.21.15.42:0/725969793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fa815cec0 msgr2=0x7f7fa814ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:40.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.123+0000 7f7fad800640 1 --2- 172.21.15.42:0/725969793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fa815cec0 0x7f7fa814ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.123+0000 7f7fad800640 1 -- 172.21.15.42:0/725969793 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa814cf80 con 0x7f7fa80cecb0 2024-09-17T01:42:40.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.123+0000 7f7fae200640 1 --2- 172.21.15.42:0/725969793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fa815cec0 0x7f7fa814ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:42:40.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.123+0000 7f7face00640 1 --2- 172.21.15.42:0/725969793 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7fa80cf0c0 0x7f7fa814a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:42:40.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.124+0000 7f7fad800640 1 --2- 172.21.15.42:0/725969793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fa80cecb0 0x7f7fa81f3670 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009950 tx=0x7f7f9c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:40.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.124+0000 7f7fa5600640 1 -- 172.21.15.42:0/725969793 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c031d60 con 0x7f7fa80cecb0 2024-09-17T01:42:40.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.124+0000 7f7fb0200640 1 -- 172.21.15.42:0/725969793 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fa814b390 con 0x7f7fa80cecb0 2024-09-17T01:42:40.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.124+0000 7f7fa5600640 1 -- 172.21.15.42:0/725969793 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f9c033e10 con 0x7f7fa80cecb0 2024-09-17T01:42:40.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.124+0000 7f7fa5600640 1 -- 172.21.15.42:0/725969793 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c033310 con 0x7f7fa80cecb0 2024-09-17T01:42:40.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.124+0000 7f7fb0200640 1 -- 172.21.15.42:0/725969793 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fa81f4250 con 0x7f7fa80cecb0 2024-09-17T01:42:40.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.125+0000 7f7fb0200640 1 -- 172.21.15.42:0/725969793 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fa806d430 con 0x7f7fa80cecb0 2024-09-17T01:42:40.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.126+0000 7f7fa5600640 1 -- 172.21.15.42:0/725969793 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7f9c0334b0 con 0x7f7fa80cecb0 2024-09-17T01:42:40.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.127+0000 7f7fa5600640 1 --2- 172.21.15.42:0/725969793 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7f88078b90 0x7f7f8807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:40.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.128+0000 7f7fa5600640 1 -- 172.21.15.42:0/725969793 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f7f9c0bbfd0 con 0x7f7fa80cecb0 2024-09-17T01:42:40.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.128+0000 7f7face00640 1 --2- 172.21.15.42:0/725969793 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7f88078b90 0x7f7f8807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:40.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.129+0000 7f7face00640 1 --2- 172.21.15.42:0/725969793 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7f88078b90 0x7f7f8807b0a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7fa81514b0 tx=0x7f7f94009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:40.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.132+0000 7f7fa5600640 1 -- 172.21.15.42:0/725969793 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7f9c04a030 con 0x7f7fa80cecb0 2024-09-17T01:42:40.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.366+0000 7f7fb0200640 1 -- 172.21.15.42:0/725969793 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7fa806a170 con 0x7f7fa80cecb0 2024-09-17T01:42:40.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.366+0000 7f7fa5600640 1 -- 172.21.15.42:0/725969793 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5231 (secure 0 0 0) 0x7f7f9c03f030 con 0x7f7fa80cecb0 2024-09-17T01:42:40.365 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:40.365 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2491855232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2491855232},{"type":"v1","addr":"172.21.15.43:6835","nonce":2491855232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4136787983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4136787983},{"type":"v1","addr":"172.21.15.43:6837","nonce":4136787983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/3441664627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3441664627},{"type":"v1","addr":"172.21.15.42:6834","nonce":3441664627}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:41:39.382305+0000","modified":"2024-09-17T01:41:42.412964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8442":{"gid":8442,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3060441721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3060441721},{"type":"v1","addr":"172.21.15.42:6835","nonce":3060441721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8442,"qdb_cluster":[8442]},"id":9}]} 2024-09-17T01:42:40.365 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 107 2024-09-17T01:42:40.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.369+0000 7f7fb0200640 1 -- 172.21.15.42:0/725969793 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7f88078b90 msgr2=0x7f7f8807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:40.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.369+0000 7f7fb0200640 1 --2- 172.21.15.42:0/725969793 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7f88078b90 0x7f7f8807b0a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7fa81514b0 tx=0x7f7f94009040 comp rx=0 tx=0).stop 2024-09-17T01:42:40.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.369+0000 7f7fb0200640 1 -- 172.21.15.42:0/725969793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fa80cecb0 msgr2=0x7f7fa81f3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:40.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.369+0000 7f7fb0200640 1 --2- 172.21.15.42:0/725969793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fa80cecb0 0x7f7fa81f3670 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009950 tx=0x7f7f9c033c20 comp rx=0 tx=0).stop 2024-09-17T01:42:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.369+0000 7f7fb0200640 1 -- 172.21.15.42:0/725969793 shutdown_connections 2024-09-17T01:42:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.369+0000 7f7fb0200640 1 --2- 172.21.15.42:0/725969793 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7f88078b90 0x7f7f8807b0a0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.369+0000 7f7fb0200640 1 --2- 172.21.15.42:0/725969793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fa815cec0 0x7f7fa814ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.369+0000 7f7fb0200640 1 --2- 172.21.15.42:0/725969793 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7fa80cf0c0 0x7f7fa814a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.369+0000 7f7fb0200640 1 --2- 172.21.15.42:0/725969793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fa80cecb0 0x7f7fa81f3670 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.369+0000 7f7fb0200640 1 -- 172.21.15.42:0/725969793 >> 172.21.15.42:0/725969793 conn(0x7f7fa80b2930 msgr2=0x7f7fa80cc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.369+0000 7f7fb0200640 1 -- 172.21.15.42:0/725969793 shutdown_connections 2024-09-17T01:42:40.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.369+0000 7f7fb0200640 1 -- 172.21.15.42:0/725969793 wait complete. 2024-09-17T01:42:40.393 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:42:40.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.621+0000 7fbd1be00640 1 -- 172.21.15.42:0/234585290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd1c0b4be0 msgr2=0x7fbd1c15d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:40.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.621+0000 7fbd1be00640 1 --2- 172.21.15.42:0/234585290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd1c0b4be0 0x7fbd1c15d6b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c009830 tx=0x7fbd0c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.621+0000 7fbd1be00640 1 -- 172.21.15.42:0/234585290 shutdown_connections 2024-09-17T01:42:40.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.621+0000 7fbd1be00640 1 --2- 172.21.15.42:0/234585290 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd1c0cf7c0 0x7fbd1c06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.621+0000 7fbd1be00640 1 --2- 172.21.15.42:0/234585290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd1c0b4be0 0x7fbd1c15d6b0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.621+0000 7fbd1be00640 1 -- 172.21.15.42:0/234585290 >> 172.21.15.42:0/234585290 conn(0x7fbd1c0b25f0 msgr2=0x7fbd1c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:40.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.621+0000 7fbd1be00640 1 -- 172.21.15.42:0/234585290 shutdown_connections 2024-09-17T01:42:40.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.621+0000 7fbd1be00640 1 -- 172.21.15.42:0/234585290 wait complete. 2024-09-17T01:42:40.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.623+0000 7fbd1be00640 1 Processor -- start 2024-09-17T01:42:40.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.623+0000 7fbd1be00640 1 -- start start 2024-09-17T01:42:40.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.625+0000 7fbd1be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd1c06d260 0x7fbd1c0749f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:40.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.625+0000 7fbd1be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd1c0b4be0 0x7fbd1c149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:40.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.625+0000 7fbd1be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd1c0cf7c0 0x7fbd1c072a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:40.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.625+0000 7fbd1be00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1c153970 con 0x7fbd1c06d260 2024-09-17T01:42:40.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.625+0000 7fbd1be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1c1537f0 con 0x7fbd1c0b4be0 2024-09-17T01:42:40.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.625+0000 7fbd1be00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbd1c153af0 con 0x7fbd1c0cf7c0 2024-09-17T01:42:40.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.625+0000 7fbd1aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd1c06d260 0x7fbd1c0749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:40.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.625+0000 7fbd1aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd1c06d260 0x7fbd1c0749f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56100/0 (socket says 172.21.15.42:56100) 2024-09-17T01:42:40.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.625+0000 7fbd1aa00640 1 -- 172.21.15.42:0/164523199 learned_addr learned my addr 172.21.15.42:0/164523199 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:40.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.625+0000 7fbd1a000640 1 --2- 172.21.15.42:0/164523199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd1c0b4be0 0x7fbd1c149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.625+0000 7fbd1b400640 1 --2- 172.21.15.42:0/164523199 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd1c0cf7c0 0x7fbd1c072a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.625+0000 7fbd1aa00640 1 -- 172.21.15.42:0/164523199 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd1c0cf7c0 msgr2=0x7fbd1c072a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.625+0000 7fbd1aa00640 1 --2- 172.21.15.42:0/164523199 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd1c0cf7c0 0x7fbd1c072a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.625+0000 7fbd1aa00640 1 -- 172.21.15.42:0/164523199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd1c0b4be0 msgr2=0x7fbd1c149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.625+0000 7fbd1aa00640 1 --2- 172.21.15.42:0/164523199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd1c0b4be0 0x7fbd1c149790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.625+0000 7fbd1aa00640 1 -- 172.21.15.42:0/164523199 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd1c15e7e0 con 0x7fbd1c06d260 2024-09-17T01:42:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.625+0000 7fbd1b400640 1 --2- 172.21.15.42:0/164523199 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd1c0cf7c0 0x7fbd1c072a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:42:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.626+0000 7fbd1aa00640 1 --2- 172.21.15.42:0/164523199 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd1c06d260 0x7fbd1c0749f0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c02aa90 tx=0x7fbd0c030650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.626+0000 7fbd13400640 1 -- 172.21.15.42:0/164523199 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c03f070 con 0x7fbd1c06d260 2024-09-17T01:42:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.626+0000 7fbd13400640 1 -- 172.21.15.42:0/164523199 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd0c030d60 con 0x7fbd1c06d260 2024-09-17T01:42:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.626+0000 7fbd13400640 1 -- 172.21.15.42:0/164523199 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c004280 con 0x7fbd1c06d260 2024-09-17T01:42:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.626+0000 7fbd1be00640 1 -- 172.21.15.42:0/164523199 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd1c15ece0 con 0x7fbd1c06d260 2024-09-17T01:42:40.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.626+0000 7fbd1be00640 1 -- 172.21.15.42:0/164523199 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd1c15f2a0 con 0x7fbd1c06d260 2024-09-17T01:42:40.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.627+0000 7fbd1be00640 1 -- 172.21.15.42:0/164523199 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd1c15d6b0 con 0x7fbd1c06d260 2024-09-17T01:42:40.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.629+0000 7fbd13400640 1 -- 172.21.15.42:0/164523199 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbd0c0035f0 con 0x7fbd1c06d260 2024-09-17T01:42:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.630+0000 7fbd13400640 1 --2- 172.21.15.42:0/164523199 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbcfc078b90 0x7fbcfc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.630+0000 7fbd13400640 1 -- 172.21.15.42:0/164523199 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7fbd0c0bbe10 con 0x7fbd1c06d260 2024-09-17T01:42:40.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.631+0000 7fbd1a000640 1 --2- 172.21.15.42:0/164523199 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbcfc078b90 0x7fbcfc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:40.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.632+0000 7fbd1a000640 1 --2- 172.21.15.42:0/164523199 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbcfc078b90 0x7fbcfc07b0a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c06d1e0 tx=0x7fbd08005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:40.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.635+0000 7fbd13400640 1 -- 172.21.15.42:0/164523199 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbd0c084250 con 0x7fbd1c06d260 2024-09-17T01:42:40.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.864+0000 7fbd1be00640 1 -- 172.21.15.42:0/164523199 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd1c0d0360 con 0x7fbd1c06d260 2024-09-17T01:42:40.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.865+0000 7fbd13400640 1 -- 172.21.15.42:0/164523199 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5231 (secure 0 0 0) 0x7fbd0c083b50 con 0x7fbd1c06d260 2024-09-17T01:42:40.863 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:40.863 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2491855232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2491855232},{"type":"v1","addr":"172.21.15.43:6835","nonce":2491855232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4136787983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4136787983},{"type":"v1","addr":"172.21.15.43:6837","nonce":4136787983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/3441664627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3441664627},{"type":"v1","addr":"172.21.15.42:6834","nonce":3441664627}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:41:39.382305+0000","modified":"2024-09-17T01:41:42.412964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8442":{"gid":8442,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3060441721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3060441721},{"type":"v1","addr":"172.21.15.42:6835","nonce":3060441721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8442,"qdb_cluster":[8442]},"id":9}]} 2024-09-17T01:42:40.864 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 107 2024-09-17T01:42:40.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.867+0000 7fbd1be00640 1 -- 172.21.15.42:0/164523199 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbcfc078b90 msgr2=0x7fbcfc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.867+0000 7fbd1be00640 1 --2- 172.21.15.42:0/164523199 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbcfc078b90 0x7fbcfc07b0a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c06d1e0 tx=0x7fbd08005f90 comp rx=0 tx=0).stop 2024-09-17T01:42:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.867+0000 7fbd1be00640 1 -- 172.21.15.42:0/164523199 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd1c06d260 msgr2=0x7fbd1c0749f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.867+0000 7fbd1be00640 1 --2- 172.21.15.42:0/164523199 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd1c06d260 0x7fbd1c0749f0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c02aa90 tx=0x7fbd0c030650 comp rx=0 tx=0).stop 2024-09-17T01:42:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.867+0000 7fbd1be00640 1 -- 172.21.15.42:0/164523199 shutdown_connections 2024-09-17T01:42:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.867+0000 7fbd1be00640 1 --2- 172.21.15.42:0/164523199 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbcfc078b90 0x7fbcfc07b0a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.867+0000 7fbd1be00640 1 --2- 172.21.15.42:0/164523199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd1c0b4be0 0x7fbd1c149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.867+0000 7fbd1be00640 1 --2- 172.21.15.42:0/164523199 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd1c0cf7c0 0x7fbd1c072a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.867+0000 7fbd1be00640 1 --2- 172.21.15.42:0/164523199 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd1c06d260 0x7fbd1c0749f0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.868+0000 7fbd1be00640 1 -- 172.21.15.42:0/164523199 >> 172.21.15.42:0/164523199 conn(0x7fbd1c0b25f0 msgr2=0x7fbd1c0ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.868+0000 7fbd1be00640 1 -- 172.21.15.42:0/164523199 shutdown_connections 2024-09-17T01:42:40.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:40.868+0000 7fbd1be00640 1 -- 172.21.15.42:0/164523199 wait complete. 2024-09-17T01:42:40.888 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:42:41.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.117+0000 7f4223000640 1 -- 172.21.15.42:0/3422291786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f421c072e00 msgr2=0x7f421c15bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:41.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.117+0000 7f4223000640 1 --2- 172.21.15.42:0/3422291786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f421c072e00 0x7f421c15bc50 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f421c0723d0 tx=0x7f420c02a5f0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.117+0000 7f4223000640 1 -- 172.21.15.42:0/3422291786 shutdown_connections 2024-09-17T01:42:41.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.117+0000 7f4223000640 1 --2- 172.21.15.42:0/3422291786 >> v2:172.21.15.43:3300/0 conn(0x7f421c06db40 0x7f421c06fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.117+0000 7f4223000640 1 --2- 172.21.15.42:0/3422291786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f421c072e00 0x7f421c15bc50 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.117+0000 7f4223000640 1 -- 172.21.15.42:0/3422291786 >> 172.21.15.42:0/3422291786 conn(0x7f421c0b2930 msgr2=0x7f421c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:41.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.117+0000 7f4223000640 1 -- 172.21.15.42:0/3422291786 shutdown_connections 2024-09-17T01:42:41.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.117+0000 7f4223000640 1 -- 172.21.15.42:0/3422291786 wait complete. 2024-09-17T01:42:41.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.119+0000 7f4223000640 1 Processor -- start 2024-09-17T01:42:41.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.120+0000 7f4223000640 1 -- start start 2024-09-17T01:42:41.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.121+0000 7f4223000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f421c072e00 0x7f421c1e91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:41.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.121+0000 7f4223000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f421c15f190 0x7f421c150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:41.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.121+0000 7f4223000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f421c0b4510 0x7f421c0b4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:41.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.121+0000 7f4223000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f421c15f650 con 0x7f421c0b4510 2024-09-17T01:42:41.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.121+0000 7f4223000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f421c070740 con 0x7f421c072e00 2024-09-17T01:42:41.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.121+0000 7f4223000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f421c151520 con 0x7f421c15f190 2024-09-17T01:42:41.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.121+0000 7f4221000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f421c0b4510 0x7f421c0b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:41.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.121+0000 7f4221000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f421c0b4510 0x7f421c0b4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56122/0 (socket says 172.21.15.42:56122) 2024-09-17T01:42:41.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.121+0000 7f4221000640 1 -- 172.21.15.42:0/2827609862 learned_addr learned my addr 172.21.15.42:0/2827609862 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:41.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.121+0000 7f421be00640 1 --2- 172.21.15.42:0/2827609862 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f421c072e00 0x7f421c1e91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:41.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.121+0000 7f4213e00640 1 --2- 172.21.15.42:0/2827609862 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f421c15f190 0x7f421c150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:41.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.122+0000 7f4221000640 1 -- 172.21.15.42:0/2827609862 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f421c15f190 msgr2=0x7f421c150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:41.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.122+0000 7f4221000640 1 --2- 172.21.15.42:0/2827609862 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f421c15f190 0x7f421c150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.122+0000 7f4221000640 1 -- 172.21.15.42:0/2827609862 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f421c072e00 msgr2=0x7f421c1e91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:41.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.122+0000 7f4221000640 1 --2- 172.21.15.42:0/2827609862 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f421c072e00 0x7f421c1e91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.122+0000 7f4221000640 1 -- 172.21.15.42:0/2827609862 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f421c157b80 con 0x7f421c0b4510 2024-09-17T01:42:41.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.122+0000 7f4221000640 1 --2- 172.21.15.42:0/2827609862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f421c0b4510 0x7f421c0b4920 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f421400ddf0 tx=0x7f421400b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:41.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.122+0000 7f4218c00640 1 -- 172.21.15.42:0/2827609862 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4214004d20 con 0x7f421c0b4510 2024-09-17T01:42:41.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.122+0000 7f4218c00640 1 -- 172.21.15.42:0/2827609862 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f421400be40 con 0x7f421c0b4510 2024-09-17T01:42:41.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.122+0000 7f4218c00640 1 -- 172.21.15.42:0/2827609862 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421400e8a0 con 0x7f421c0b4510 2024-09-17T01:42:41.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.122+0000 7f4223000640 1 -- 172.21.15.42:0/2827609862 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f421c0b4e60 con 0x7f421c0b4510 2024-09-17T01:42:41.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.123+0000 7f4223000640 1 -- 172.21.15.42:0/2827609862 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f421c1585a0 con 0x7f421c0b4510 2024-09-17T01:42:41.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.124+0000 7f4223000640 1 -- 172.21.15.42:0/2827609862 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f421c06e660 con 0x7f421c0b4510 2024-09-17T01:42:41.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.125+0000 7f4218c00640 1 -- 172.21.15.42:0/2827609862 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f421400ea40 con 0x7f421c0b4510 2024-09-17T01:42:41.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.126+0000 7f4218c00640 1 --2- 172.21.15.42:0/2827609862 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f41f8078b90 0x7f41f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:41.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.126+0000 7f4218c00640 1 -- 172.21.15.42:0/2827609862 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f421409b750 con 0x7f421c0b4510 2024-09-17T01:42:41.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.126+0000 7f421be00640 1 --2- 172.21.15.42:0/2827609862 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f41f8078b90 0x7f41f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:41.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.127+0000 7f421be00640 1 --2- 172.21.15.42:0/2827609862 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f41f8078b90 0x7f41f807b0a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f420c033000 tx=0x7f420c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:41.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.130+0000 7f4218c00640 1 -- 172.21.15.42:0/2827609862 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f421c06e660 con 0x7f421c0b4510 2024-09-17T01:42:41.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.330+0000 7f4223000640 1 -- 172.21.15.42:0/2827609862 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f421c06a170 con 0x7f421c0b4510 2024-09-17T01:42:41.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.331+0000 7f4218c00640 1 -- 172.21.15.42:0/2827609862 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) ==== 74+0+16639 (secure 0 0 0) 0x7f421c0b4e60 con 0x7f421c0b4510 2024-09-17T01:42:41.329 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:41.330 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":136,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:41:40.882912+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:41:37.333863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T01:41:38.352978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:42:41.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.334+0000 7f4223000640 1 -- 172.21.15.42:0/2827609862 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f41f8078b90 msgr2=0x7f41f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:41.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.334+0000 7f4223000640 1 --2- 172.21.15.42:0/2827609862 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f41f8078b90 0x7f41f807b0a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f420c033000 tx=0x7f420c004730 comp rx=0 tx=0).stop 2024-09-17T01:42:41.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.334+0000 7f4223000640 1 -- 172.21.15.42:0/2827609862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f421c0b4510 msgr2=0x7f421c0b4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:41.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.334+0000 7f4223000640 1 --2- 172.21.15.42:0/2827609862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f421c0b4510 0x7f421c0b4920 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f421400ddf0 tx=0x7f421400b730 comp rx=0 tx=0).stop 2024-09-17T01:42:41.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.334+0000 7f4223000640 1 -- 172.21.15.42:0/2827609862 shutdown_connections 2024-09-17T01:42:41.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.334+0000 7f4223000640 1 --2- 172.21.15.42:0/2827609862 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f41f8078b90 0x7f41f807b0a0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.334+0000 7f4223000640 1 --2- 172.21.15.42:0/2827609862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f421c0b4510 0x7f421c0b4920 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.334+0000 7f4223000640 1 --2- 172.21.15.42:0/2827609862 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f421c15f190 0x7f421c150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.334+0000 7f4223000640 1 --2- 172.21.15.42:0/2827609862 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f421c072e00 0x7f421c1e91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.334+0000 7f4223000640 1 -- 172.21.15.42:0/2827609862 >> 172.21.15.42:0/2827609862 conn(0x7f421c0b2930 msgr2=0x7f421c0b13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:41.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.334+0000 7f4223000640 1 -- 172.21.15.42:0/2827609862 shutdown_connections 2024-09-17T01:42:41.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.334+0000 7f4223000640 1 -- 172.21.15.42:0/2827609862 wait complete. 2024-09-17T01:42:41.355 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T01:42:41.355 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:42:41.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.588+0000 7f0b87200640 1 -- 172.21.15.42:0/3685498816 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b800d2810 msgr2=0x7f0b8015e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:41.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.588+0000 7f0b87200640 1 --2- 172.21.15.42:0/3685498816 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b800d2810 0x7f0b8015e910 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0b70009860 tx=0x7f0b7002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.588+0000 7f0b87200640 1 -- 172.21.15.42:0/3685498816 shutdown_connections 2024-09-17T01:42:41.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.588+0000 7f0b87200640 1 --2- 172.21.15.42:0/3685498816 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b800d2810 0x7f0b8015e910 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.588+0000 7f0b87200640 1 -- 172.21.15.42:0/3685498816 >> 172.21.15.42:0/3685498816 conn(0x7f0b800d1210 msgr2=0x7f0b800d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:41.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.588+0000 7f0b87200640 1 -- 172.21.15.42:0/3685498816 shutdown_connections 2024-09-17T01:42:41.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.588+0000 7f0b87200640 1 -- 172.21.15.42:0/3685498816 wait complete. 2024-09-17T01:42:41.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.590+0000 7f0b87200640 1 Processor -- start 2024-09-17T01:42:41.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.590+0000 7f0b87200640 1 -- start start 2024-09-17T01:42:41.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.592+0000 7f0b87200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b80073340 0x7f0b800b8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:41.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.592+0000 7f0b87200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b800b6030 0x7f0b800b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:41.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.592+0000 7f0b87200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b800d2810 0x7f0b80158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:41.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.592+0000 7f0b87200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8015fac0 con 0x7f0b800b6030 2024-09-17T01:42:41.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.592+0000 7f0b87200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8015f940 con 0x7f0b800d2810 2024-09-17T01:42:41.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.592+0000 7f0b87200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0b8015fc40 con 0x7f0b80073340 2024-09-17T01:42:41.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.592+0000 7f0b85400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b800b6030 0x7f0b800b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:41.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.592+0000 7f0b85400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b800b6030 0x7f0b800b8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56126/0 (socket says 172.21.15.42:56126) 2024-09-17T01:42:41.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.592+0000 7f0b85400640 1 -- 172.21.15.42:0/576064433 learned_addr learned my addr 172.21.15.42:0/576064433 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:41.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.592+0000 7f0b85e00640 1 --2- 172.21.15.42:0/576064433 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b80073340 0x7f0b800b8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:41.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.592+0000 7f0b86800640 1 --2- 172.21.15.42:0/576064433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b800d2810 0x7f0b80158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:41.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.593+0000 7f0b85400640 1 -- 172.21.15.42:0/576064433 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b80073340 msgr2=0x7f0b800b8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:41.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.593+0000 7f0b85400640 1 --2- 172.21.15.42:0/576064433 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b80073340 0x7f0b800b8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.593+0000 7f0b85400640 1 -- 172.21.15.42:0/576064433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b800d2810 msgr2=0x7f0b80158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:41.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.593+0000 7f0b85400640 1 --2- 172.21.15.42:0/576064433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b800d2810 0x7f0b80158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.593+0000 7f0b85400640 1 -- 172.21.15.42:0/576064433 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b80158fe0 con 0x7f0b800b6030 2024-09-17T01:42:41.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.593+0000 7f0b85400640 1 --2- 172.21.15.42:0/576064433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b800b6030 0x7f0b800b8c50 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f0b7002aa90 tx=0x7f0b70003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:41.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.593+0000 7f0b7a000640 1 -- 172.21.15.42:0/576064433 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70005c90 con 0x7f0b800b6030 2024-09-17T01:42:41.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.593+0000 7f0b7a000640 1 -- 172.21.15.42:0/576064433 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b70005020 con 0x7f0b800b6030 2024-09-17T01:42:41.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.593+0000 7f0b87200640 1 -- 172.21.15.42:0/576064433 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b80159280 con 0x7f0b800b6030 2024-09-17T01:42:41.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.593+0000 7f0b7a000640 1 -- 172.21.15.42:0/576064433 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70005410 con 0x7f0b800b6030 2024-09-17T01:42:41.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.594+0000 7f0b87200640 1 -- 172.21.15.42:0/576064433 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b800c8c40 con 0x7f0b800b6030 2024-09-17T01:42:41.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.595+0000 7f0b87200640 1 -- 172.21.15.42:0/576064433 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b80160180 con 0x7f0b800b6030 2024-09-17T01:42:41.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.596+0000 7f0b7a000640 1 -- 172.21.15.42:0/576064433 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0b700317c0 con 0x7f0b800b6030 2024-09-17T01:42:41.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.597+0000 7f0b7a000640 1 --2- 172.21.15.42:0/576064433 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0b64078b90 0x7f0b6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:41.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.597+0000 7f0b7a000640 1 -- 172.21.15.42:0/576064433 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f0b700bbc60 con 0x7f0b800b6030 2024-09-17T01:42:41.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.598+0000 7f0b85e00640 1 --2- 172.21.15.42:0/576064433 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0b64078b90 0x7f0b6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:41.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.598+0000 7f0b85e00640 1 --2- 172.21.15.42:0/576064433 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0b64078b90 0x7f0b6407b0a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f0b740013c0 tx=0x7f0b74001720 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:41.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.601+0000 7f0b7a000640 1 -- 172.21.15.42:0/576064433 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0b7003f030 con 0x7f0b800b6030 2024-09-17T01:42:41.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.837+0000 7f0b87200640 1 -- 172.21.15.42:0/576064433 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b8015dfc0 con 0x7f0b800b6030 2024-09-17T01:42:41.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.837+0000 7f0b7a000640 1 -- 172.21.15.42:0/576064433 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5231 (secure 0 0 0) 0x7f0b70083ad0 con 0x7f0b800b6030 2024-09-17T01:42:41.835 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:41.835 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2491855232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2491855232},{"type":"v1","addr":"172.21.15.43:6835","nonce":2491855232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4136787983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4136787983},{"type":"v1","addr":"172.21.15.43:6837","nonce":4136787983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/3441664627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3441664627},{"type":"v1","addr":"172.21.15.42:6834","nonce":3441664627}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:41:39.382305+0000","modified":"2024-09-17T01:41:42.412964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8442":{"gid":8442,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3060441721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3060441721},{"type":"v1","addr":"172.21.15.42:6835","nonce":3060441721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8442,"qdb_cluster":[8442]},"id":9}]} 2024-09-17T01:42:41.836 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 107 2024-09-17T01:42:41.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.840+0000 7f0b87200640 1 -- 172.21.15.42:0/576064433 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0b64078b90 msgr2=0x7f0b6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:41.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.840+0000 7f0b87200640 1 --2- 172.21.15.42:0/576064433 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0b64078b90 0x7f0b6407b0a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f0b740013c0 tx=0x7f0b74001720 comp rx=0 tx=0).stop 2024-09-17T01:42:41.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.840+0000 7f0b87200640 1 -- 172.21.15.42:0/576064433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b800b6030 msgr2=0x7f0b800b8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:41.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.840+0000 7f0b87200640 1 --2- 172.21.15.42:0/576064433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b800b6030 0x7f0b800b8c50 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f0b7002aa90 tx=0x7f0b70003c10 comp rx=0 tx=0).stop 2024-09-17T01:42:41.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.840+0000 7f0b87200640 1 -- 172.21.15.42:0/576064433 shutdown_connections 2024-09-17T01:42:41.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.840+0000 7f0b87200640 1 --2- 172.21.15.42:0/576064433 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0b64078b90 0x7f0b6407b0a0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.840+0000 7f0b87200640 1 --2- 172.21.15.42:0/576064433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b800d2810 0x7f0b80158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.840+0000 7f0b87200640 1 --2- 172.21.15.42:0/576064433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b800b6030 0x7f0b800b8c50 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.840+0000 7f0b87200640 1 --2- 172.21.15.42:0/576064433 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b80073340 0x7f0b800b8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.840+0000 7f0b87200640 1 -- 172.21.15.42:0/576064433 >> 172.21.15.42:0/576064433 conn(0x7f0b800d1210 msgr2=0x7f0b8015cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:41.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.840+0000 7f0b87200640 1 -- 172.21.15.42:0/576064433 shutdown_connections 2024-09-17T01:42:41.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:41.840+0000 7f0b87200640 1 -- 172.21.15.42:0/576064433 wait complete. 2024-09-17T01:42:41.861 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:42:42.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.089+0000 7f3277e00640 1 -- 172.21.15.42:0/3222064417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3278162fa0 msgr2=0x7f327815e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:42.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.089+0000 7f3277e00640 1 --2- 172.21.15.42:0/3222064417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3278162fa0 0x7f327815e910 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f3260005fd0 tx=0x7f326002a4f0 comp rx=0 tx=0).stop 2024-09-17T01:42:42.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.089+0000 7f3277e00640 1 -- 172.21.15.42:0/3222064417 shutdown_connections 2024-09-17T01:42:42.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.089+0000 7f3277e00640 1 --2- 172.21.15.42:0/3222064417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3278162fa0 0x7f327815e910 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:42.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.089+0000 7f3277e00640 1 --2- 172.21.15.42:0/3222064417 >> v2:172.21.15.43:3300/0 conn(0x7f3278073340 0x7f32780d2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:42.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.089+0000 7f3277e00640 1 -- 172.21.15.42:0/3222064417 >> 172.21.15.42:0/3222064417 conn(0x7f32780d1210 msgr2=0x7f32780d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:42.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.089+0000 7f3277e00640 1 -- 172.21.15.42:0/3222064417 shutdown_connections 2024-09-17T01:42:42.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.089+0000 7f3277e00640 1 -- 172.21.15.42:0/3222064417 wait complete. 2024-09-17T01:42:42.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.091+0000 7f3277e00640 1 Processor -- start 2024-09-17T01:42:42.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.092+0000 7f3277e00640 1 -- start start 2024-09-17T01:42:42.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.093+0000 7f3277e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3278073340 0x7f32780cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:42.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.093+0000 7f3277e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32780b6030 0x7f3278151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:42.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.093+0000 7f3277e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3278162fa0 0x7f32780cf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:42.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.093+0000 7f3277e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f327815f850 con 0x7f3278162fa0 2024-09-17T01:42:42.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.093+0000 7f3277e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f327815f6d0 con 0x7f32780b6030 2024-09-17T01:42:42.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.093+0000 7f3277e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f327815f9d0 con 0x7f3278073340 2024-09-17T01:42:42.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.093+0000 7f3277400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3278162fa0 0x7f32780cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:42.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.093+0000 7f3277400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3278162fa0 0x7f32780cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56146/0 (socket says 172.21.15.42:56146) 2024-09-17T01:42:42.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.093+0000 7f3277400640 1 -- 172.21.15.42:0/1350291237 learned_addr learned my addr 172.21.15.42:0/1350291237 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:42.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.094+0000 7f326fe00640 1 --2- 172.21.15.42:0/1350291237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32780b6030 0x7f3278151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:42.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.094+0000 7f3276a00640 1 --2- 172.21.15.42:0/1350291237 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3278073340 0x7f32780cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:42.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.094+0000 7f3277400640 1 -- 172.21.15.42:0/1350291237 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3278073340 msgr2=0x7f32780cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:42.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.094+0000 7f3277400640 1 --2- 172.21.15.42:0/1350291237 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3278073340 0x7f32780cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:42.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.094+0000 7f3277400640 1 -- 172.21.15.42:0/1350291237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32780b6030 msgr2=0x7f3278151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:42.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.094+0000 7f3277400640 1 --2- 172.21.15.42:0/1350291237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32780b6030 0x7f3278151360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:42.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.094+0000 7f3277400640 1 -- 172.21.15.42:0/1350291237 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3278156590 con 0x7f3278162fa0 2024-09-17T01:42:42.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.094+0000 7f3277400640 1 --2- 172.21.15.42:0/1350291237 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3278162fa0 0x7f32780cf840 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f327000b9e0 tx=0x7f327000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:42.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.094+0000 7f326f400640 1 -- 172.21.15.42:0/1350291237 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3270003b70 con 0x7f3278162fa0 2024-09-17T01:42:42.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.094+0000 7f326f400640 1 -- 172.21.15.42:0/1350291237 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3270003e00 con 0x7f3278162fa0 2024-09-17T01:42:42.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.095+0000 7f3277e00640 1 -- 172.21.15.42:0/1350291237 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3278159dd0 con 0x7f3278162fa0 2024-09-17T01:42:42.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.095+0000 7f326f400640 1 -- 172.21.15.42:0/1350291237 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327000cb80 con 0x7f3278162fa0 2024-09-17T01:42:42.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.095+0000 7f3277e00640 1 -- 172.21.15.42:0/1350291237 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f327815a390 con 0x7f3278162fa0 2024-09-17T01:42:42.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.096+0000 7f3277e00640 1 -- 172.21.15.42:0/1350291237 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32780d2810 con 0x7f3278162fa0 2024-09-17T01:42:42.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.097+0000 7f326f400640 1 -- 172.21.15.42:0/1350291237 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3270004000 con 0x7f3278162fa0 2024-09-17T01:42:42.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.098+0000 7f326f400640 1 --2- 172.21.15.42:0/1350291237 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3254078b90 0x7f325407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:42.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.098+0000 7f326f400640 1 -- 172.21.15.42:0/1350291237 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f327009ab40 con 0x7f3278162fa0 2024-09-17T01:42:42.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.099+0000 7f3276a00640 1 --2- 172.21.15.42:0/1350291237 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3254078b90 0x7f325407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:42.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.099+0000 7f3276a00640 1 --2- 172.21.15.42:0/1350291237 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3254078b90 0x7f325407b0a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f326800bb50 tx=0x7f326800b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:42.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.103+0000 7f326f400640 1 -- 172.21.15.42:0/1350291237 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3270062920 con 0x7f3278162fa0 2024-09-17T01:42:42.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.333+0000 7f3277e00640 1 -- 172.21.15.42:0/1350291237 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f327815bb30 con 0x7f3278162fa0 2024-09-17T01:42:42.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.334+0000 7f326f400640 1 -- 172.21.15.42:0/1350291237 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) ==== 95+0+5231 (secure 0 0 0) 0x7f3270067350 con 0x7f3278162fa0 2024-09-17T01:42:42.332 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:42.332 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":107,"btime":"2024-09-17T01:41:42:903725+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2491855232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2491855232},{"type":"v1","addr":"172.21.15.43:6835","nonce":2491855232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4136787983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4136787983},{"type":"v1","addr":"172.21.15.43:6837","nonce":4136787983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/3441664627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3441664627},{"type":"v1","addr":"172.21.15.42:6834","nonce":3441664627}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:41:39.382305+0000","modified":"2024-09-17T01:41:42.412964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8442":{"gid":8442,"name":"a","rank":0,"incarnation":103,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3060441721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3060441721},{"type":"v1","addr":"172.21.15.42:6835","nonce":3060441721}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8442,"qdb_cluster":[8442]},"id":9}]} 2024-09-17T01:42:42.332 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 107 2024-09-17T01:42:42.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.336+0000 7f3277e00640 1 -- 172.21.15.42:0/1350291237 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3254078b90 msgr2=0x7f325407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:42.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.336+0000 7f3277e00640 1 --2- 172.21.15.42:0/1350291237 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3254078b90 0x7f325407b0a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f326800bb50 tx=0x7f326800b2e0 comp rx=0 tx=0).stop 2024-09-17T01:42:42.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.336+0000 7f3277e00640 1 -- 172.21.15.42:0/1350291237 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3278162fa0 msgr2=0x7f32780cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:42.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.336+0000 7f3277e00640 1 --2- 172.21.15.42:0/1350291237 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3278162fa0 0x7f32780cf840 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f327000b9e0 tx=0x7f327000bea0 comp rx=0 tx=0).stop 2024-09-17T01:42:42.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.336+0000 7f3277e00640 1 -- 172.21.15.42:0/1350291237 shutdown_connections 2024-09-17T01:42:42.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.336+0000 7f3277e00640 1 --2- 172.21.15.42:0/1350291237 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3254078b90 0x7f325407b0a0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:42.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.336+0000 7f3277e00640 1 --2- 172.21.15.42:0/1350291237 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32780b6030 0x7f3278151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:42.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.336+0000 7f3277e00640 1 --2- 172.21.15.42:0/1350291237 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3278162fa0 0x7f32780cf840 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:42.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.336+0000 7f3277e00640 1 --2- 172.21.15.42:0/1350291237 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3278073340 0x7f32780cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:42.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.336+0000 7f3277e00640 1 -- 172.21.15.42:0/1350291237 >> 172.21.15.42:0/1350291237 conn(0x7f32780d1210 msgr2=0x7f32780b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:42.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.336+0000 7f3277e00640 1 -- 172.21.15.42:0/1350291237 shutdown_connections 2024-09-17T01:42:42.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.336+0000 7f3277e00640 1 -- 172.21.15.42:0/1350291237 wait complete. 2024-09-17T01:42:42.360 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:42:42.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.590+0000 7ff21de00640 1 -- 172.21.15.42:0/687751782 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2180cf7c0 msgr2=0x7ff21806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:42.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.590+0000 7ff21de00640 1 --2- 172.21.15.42:0/687751782 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2180cf7c0 0x7ff21806cd20 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7ff21806deb0 tx=0x7ff20402a5f0 comp rx=0 tx=0).stop 2024-09-17T01:42:42.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.590+0000 7ff21de00640 1 -- 172.21.15.42:0/687751782 shutdown_connections 2024-09-17T01:42:42.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.590+0000 7ff21de00640 1 --2- 172.21.15.42:0/687751782 >> v2:172.21.15.43:3300/0 conn(0x7ff21806d260 0x7ff218152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:42.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.590+0000 7ff21de00640 1 --2- 172.21.15.42:0/687751782 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2180cf7c0 0x7ff21806cd20 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:42.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.590+0000 7ff21de00640 1 -- 172.21.15.42:0/687751782 >> 172.21.15.42:0/687751782 conn(0x7ff2180b25f0 msgr2=0x7ff2180d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:42.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.590+0000 7ff21de00640 1 -- 172.21.15.42:0/687751782 shutdown_connections 2024-09-17T01:42:42.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.591+0000 7ff21de00640 1 -- 172.21.15.42:0/687751782 wait complete. 2024-09-17T01:42:42.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.593+0000 7ff21de00640 1 Processor -- start 2024-09-17T01:42:42.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.593+0000 7ff21de00640 1 -- start start 2024-09-17T01:42:42.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.594+0000 7ff21de00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff21806d260 0x7ff21809de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:42.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.594+0000 7ff21de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2180b4be0 0x7ff2181f9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:42.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.594+0000 7ff21de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2180cf7c0 0x7ff2180cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:42.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.594+0000 7ff21de00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff2181537a0 con 0x7ff2180cf7c0 2024-09-17T01:42:42.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.594+0000 7ff21de00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff218153620 con 0x7ff2180b4be0 2024-09-17T01:42:42.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.594+0000 7ff21de00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff218153920 con 0x7ff21806d260 2024-09-17T01:42:42.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.595+0000 7ff21d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2180cf7c0 0x7ff2180cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:42.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.595+0000 7ff21d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2180cf7c0 0x7ff2180cabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56172/0 (socket says 172.21.15.42:56172) 2024-09-17T01:42:42.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.595+0000 7ff21d400640 1 -- 172.21.15.42:0/680983408 learned_addr learned my addr 172.21.15.42:0/680983408 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:42.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.595+0000 7ff217e00640 1 --2- 172.21.15.42:0/680983408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2180b4be0 0x7ff2181f9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:42.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.595+0000 7ff21ca00640 1 --2- 172.21.15.42:0/680983408 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff21806d260 0x7ff21809de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:42.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.595+0000 7ff21d400640 1 -- 172.21.15.42:0/680983408 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff21806d260 msgr2=0x7ff21809de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:42.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.595+0000 7ff21d400640 1 --2- 172.21.15.42:0/680983408 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff21806d260 0x7ff21809de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:42.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.595+0000 7ff21d400640 1 -- 172.21.15.42:0/680983408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2180b4be0 msgr2=0x7ff2181f9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:42.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.595+0000 7ff21d400640 1 --2- 172.21.15.42:0/680983408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2180b4be0 0x7ff2181f9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:42.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.595+0000 7ff21d400640 1 -- 172.21.15.42:0/680983408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2181f8c80 con 0x7ff2180cf7c0 2024-09-17T01:42:42.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.596+0000 7ff21d400640 1 --2- 172.21.15.42:0/680983408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2180cf7c0 0x7ff2180cabb0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7ff21000eaa0 tx=0x7ff21000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:42.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.596+0000 7ff214c00640 1 -- 172.21.15.42:0/680983408 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21000ce70 con 0x7ff2180cf7c0 2024-09-17T01:42:42.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.596+0000 7ff214c00640 1 -- 172.21.15.42:0/680983408 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff210004c10 con 0x7ff2180cf7c0 2024-09-17T01:42:42.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.596+0000 7ff214c00640 1 -- 172.21.15.42:0/680983408 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff210005020 con 0x7ff2180cf7c0 2024-09-17T01:42:42.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.596+0000 7ff21de00640 1 -- 172.21.15.42:0/680983408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff21814fc60 con 0x7ff2180cf7c0 2024-09-17T01:42:42.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.596+0000 7ff21de00640 1 -- 172.21.15.42:0/680983408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2181f9980 con 0x7ff2180cf7c0 2024-09-17T01:42:42.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.597+0000 7ff21de00640 1 -- 172.21.15.42:0/680983408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff218152ed0 con 0x7ff2180cf7c0 2024-09-17T01:42:42.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.598+0000 7ff214c00640 1 -- 172.21.15.42:0/680983408 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff2100051c0 con 0x7ff2180cf7c0 2024-09-17T01:42:42.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.599+0000 7ff214c00640 1 --2- 172.21.15.42:0/680983408 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff1f8078bc0 0x7ff1f807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:42.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.599+0000 7ff214c00640 1 -- 172.21.15.42:0/680983408 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7ff21009b960 con 0x7ff2180cf7c0 2024-09-17T01:42:42.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.600+0000 7ff21ca00640 1 --2- 172.21.15.42:0/680983408 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff1f8078bc0 0x7ff1f807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:42.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.600+0000 7ff21ca00640 1 --2- 172.21.15.42:0/680983408 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff1f8078bc0 0x7ff1f807b0d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff20c001720 tx=0x7ff20c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:42.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.604+0000 7ff214c00640 1 -- 172.21.15.42:0/680983408 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff2100637e0 con 0x7ff2180cf7c0 2024-09-17T01:42:42.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.804+0000 7ff21de00640 1 -- 172.21.15.42:0/680983408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2180aee60 con 0x7ff2180cf7c0 2024-09-17T01:42:42.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.805+0000 7ff214c00640 1 -- 172.21.15.42:0/680983408 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) ==== 74+0+16639 (secure 0 0 0) 0x7ff210068210 con 0x7ff2180cf7c0 2024-09-17T01:42:42.803 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:42.804 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":136,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:41:40.882912+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:41:37.333863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T01:41:38.352978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:42:42.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.808+0000 7ff21de00640 1 -- 172.21.15.42:0/680983408 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff1f8078bc0 msgr2=0x7ff1f807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:42.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.808+0000 7ff21de00640 1 --2- 172.21.15.42:0/680983408 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff1f8078bc0 0x7ff1f807b0d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff20c001720 tx=0x7ff20c009040 comp rx=0 tx=0).stop 2024-09-17T01:42:42.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.808+0000 7ff21de00640 1 -- 172.21.15.42:0/680983408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2180cf7c0 msgr2=0x7ff2180cabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:42.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.808+0000 7ff21de00640 1 --2- 172.21.15.42:0/680983408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2180cf7c0 0x7ff2180cabb0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7ff21000eaa0 tx=0x7ff21000ef60 comp rx=0 tx=0).stop 2024-09-17T01:42:42.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.808+0000 7ff21de00640 1 -- 172.21.15.42:0/680983408 shutdown_connections 2024-09-17T01:42:42.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.808+0000 7ff21de00640 1 --2- 172.21.15.42:0/680983408 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff1f8078bc0 0x7ff1f807b0d0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:42.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.808+0000 7ff21de00640 1 --2- 172.21.15.42:0/680983408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2180b4be0 0x7ff2181f9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:42.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.808+0000 7ff21de00640 1 --2- 172.21.15.42:0/680983408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2180cf7c0 0x7ff2180cabb0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:42.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.808+0000 7ff21de00640 1 --2- 172.21.15.42:0/680983408 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff21806d260 0x7ff21809de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:42.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.808+0000 7ff21de00640 1 -- 172.21.15.42:0/680983408 >> 172.21.15.42:0/680983408 conn(0x7ff2180b25f0 msgr2=0x7ff2180adc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:42.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.808+0000 7ff21de00640 1 -- 172.21.15.42:0/680983408 shutdown_connections 2024-09-17T01:42:42.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:42.808+0000 7ff21de00640 1 -- 172.21.15.42:0/680983408 wait complete. 2024-09-17T01:42:42.832 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T01:42:43.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.063+0000 7f70bfe00640 1 -- 172.21.15.42:0/3109963911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70c00c9420 msgr2=0x7f70c00c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:43.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.063+0000 7f70bfe00640 1 --2- 172.21.15.42:0/3109963911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70c00c9420 0x7f70c00c9830 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f70c00ca6b0 tx=0x7f70b802aa30 comp rx=0 tx=0).stop 2024-09-17T01:42:43.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.063+0000 7f70bfe00640 1 -- 172.21.15.42:0/3109963911 shutdown_connections 2024-09-17T01:42:43.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.063+0000 7f70bfe00640 1 --2- 172.21.15.42:0/3109963911 >> v2:172.21.15.43:3300/0 conn(0x7f70c00af460 0x7f70c006d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:43.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.063+0000 7f70bfe00640 1 --2- 172.21.15.42:0/3109963911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70c00c9420 0x7f70c00c9830 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:43.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.063+0000 7f70bfe00640 1 --2- 172.21.15.42:0/3109963911 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f70c00d0d80 0x7f70c006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:43.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.063+0000 7f70bfe00640 1 -- 172.21.15.42:0/3109963911 >> 172.21.15.42:0/3109963911 conn(0x7f70c00b25f0 msgr2=0x7f70c00d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:43.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.063+0000 7f70bfe00640 1 -- 172.21.15.42:0/3109963911 shutdown_connections 2024-09-17T01:42:43.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.063+0000 7f70bfe00640 1 -- 172.21.15.42:0/3109963911 wait complete. 2024-09-17T01:42:43.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.065+0000 7f70bfe00640 1 Processor -- start 2024-09-17T01:42:43.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.065+0000 7f70bfe00640 1 -- start start 2024-09-17T01:42:43.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.067+0000 7f70bfe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f70c00af460 0x7f70c00729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:43.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.067+0000 7f70bfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70c00c9420 0x7f70c0159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:43.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.067+0000 7f70bfe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70c00d0d80 0x7f70c00742f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:43.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.067+0000 7f70bfe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f70c015eb80 con 0x7f70c00c9420 2024-09-17T01:42:43.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.067+0000 7f70bfe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f70c015ea00 con 0x7f70c00d0d80 2024-09-17T01:42:43.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.067+0000 7f70bfe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f70c00c9d70 con 0x7f70c00af460 2024-09-17T01:42:43.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.067+0000 7f70b7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70c00c9420 0x7f70c0159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:43.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.067+0000 7f70b7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70c00c9420 0x7f70c0159bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56190/0 (socket says 172.21.15.42:56190) 2024-09-17T01:42:43.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.067+0000 7f70b7e00640 1 -- 172.21.15.42:0/2120302811 learned_addr learned my addr 172.21.15.42:0/2120302811 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:43.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.067+0000 7f70bea00640 1 --2- 172.21.15.42:0/2120302811 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f70c00af460 0x7f70c00729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:43.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.067+0000 7f70bf400640 1 --2- 172.21.15.42:0/2120302811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70c00d0d80 0x7f70c00742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:43.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.068+0000 7f70b7e00640 1 -- 172.21.15.42:0/2120302811 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f70c00af460 msgr2=0x7f70c00729f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:43.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.068+0000 7f70b7e00640 1 --2- 172.21.15.42:0/2120302811 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f70c00af460 0x7f70c00729f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:43.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.068+0000 7f70b7e00640 1 -- 172.21.15.42:0/2120302811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70c00d0d80 msgr2=0x7f70c00742f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:43.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.068+0000 7f70b7e00640 1 --2- 172.21.15.42:0/2120302811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70c00d0d80 0x7f70c00742f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:43.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.068+0000 7f70b7e00640 1 -- 172.21.15.42:0/2120302811 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c01f67b0 con 0x7f70c00c9420 2024-09-17T01:42:43.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.068+0000 7f70bf400640 1 --2- 172.21.15.42:0/2120302811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70c00d0d80 0x7f70c00742f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:42:43.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.068+0000 7f70b7e00640 1 --2- 172.21.15.42:0/2120302811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70c00c9420 0x7f70c0159bb0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f70a800d750 tx=0x7f70a800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:43.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.068+0000 7f70b6a00640 1 -- 172.21.15.42:0/2120302811 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8017070 con 0x7f70c00c9420 2024-09-17T01:42:43.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.068+0000 7f70b6a00640 1 -- 172.21.15.42:0/2120302811 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70a8004310 con 0x7f70c00c9420 2024-09-17T01:42:43.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.068+0000 7f70b6a00640 1 -- 172.21.15.42:0/2120302811 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8009c30 con 0x7f70c00c9420 2024-09-17T01:42:43.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.068+0000 7f70bfe00640 1 -- 172.21.15.42:0/2120302811 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70c00721d0 con 0x7f70c00c9420 2024-09-17T01:42:43.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.068+0000 7f70bfe00640 1 -- 172.21.15.42:0/2120302811 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70c006f590 con 0x7f70c00c9420 2024-09-17T01:42:43.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.070+0000 7f70bfe00640 1 -- 172.21.15.42:0/2120302811 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70c01f6520 con 0x7f70c00c9420 2024-09-17T01:42:43.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.071+0000 7f70b6a00640 1 -- 172.21.15.42:0/2120302811 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f70a80047a0 con 0x7f70c00c9420 2024-09-17T01:42:43.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.072+0000 7f70b6a00640 1 --2- 172.21.15.42:0/2120302811 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f709c078b90 0x7f709c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:43.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.072+0000 7f70b6a00640 1 -- 172.21.15.42:0/2120302811 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f70a809afd0 con 0x7f70c00c9420 2024-09-17T01:42:43.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.072+0000 7f70bea00640 1 --2- 172.21.15.42:0/2120302811 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f709c078b90 0x7f709c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:43.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.073+0000 7f70bea00640 1 --2- 172.21.15.42:0/2120302811 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f709c078b90 0x7f709c07b0a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f70b00045b0 tx=0x7f70b000b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:43.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.076+0000 7f70b6a00640 1 -- 172.21.15.42:0/2120302811 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f70a8020020 con 0x7f70c00c9420 2024-09-17T01:42:43.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.306+0000 7f70bfe00640 1 -- 172.21.15.42:0/2120302811 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f70c00ca220 con 0x7f70c00c9420 2024-09-17T01:42:43.304 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-17T01:42:43.306+0000 7f9961e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:42:43.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.308+0000 7f70b6a00640 1 -- 172.21.15.42:0/2120302811 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v108) ==== 161+0+0 (secure 0 0 0) 0x7f70a80634a0 con 0x7f70c00c9420 2024-09-17T01:42:43.308 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T01:42:43.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.312+0000 7f70bfe00640 1 -- 172.21.15.42:0/2120302811 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f709c078b90 msgr2=0x7f709c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:43.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.312+0000 7f70bfe00640 1 --2- 172.21.15.42:0/2120302811 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f709c078b90 0x7f709c07b0a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f70b00045b0 tx=0x7f70b000b2e0 comp rx=0 tx=0).stop 2024-09-17T01:42:43.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.312+0000 7f70bfe00640 1 -- 172.21.15.42:0/2120302811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70c00c9420 msgr2=0x7f70c0159bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:43.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.312+0000 7f70bfe00640 1 --2- 172.21.15.42:0/2120302811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70c00c9420 0x7f70c0159bb0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f70a800d750 tx=0x7f70a800dc10 comp rx=0 tx=0).stop 2024-09-17T01:42:43.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.312+0000 7f70bfe00640 1 -- 172.21.15.42:0/2120302811 shutdown_connections 2024-09-17T01:42:43.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.312+0000 7f70bfe00640 1 --2- 172.21.15.42:0/2120302811 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f709c078b90 0x7f709c07b0a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:43.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.312+0000 7f70bfe00640 1 --2- 172.21.15.42:0/2120302811 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70c00d0d80 0x7f70c00742f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:43.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.312+0000 7f70bfe00640 1 --2- 172.21.15.42:0/2120302811 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70c00c9420 0x7f70c0159bb0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:43.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.312+0000 7f70bfe00640 1 --2- 172.21.15.42:0/2120302811 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f70c00af460 0x7f70c00729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:43.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.312+0000 7f70bfe00640 1 -- 172.21.15.42:0/2120302811 >> 172.21.15.42:0/2120302811 conn(0x7f70c00b25f0 msgr2=0x7f70c0075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:43.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.312+0000 7f70bfe00640 1 -- 172.21.15.42:0/2120302811 shutdown_connections 2024-09-17T01:42:43.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.312+0000 7f70bfe00640 1 -- 172.21.15.42:0/2120302811 wait complete. 2024-09-17T01:42:43.333 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T01:42:43.453 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:42:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.569+0000 7f3d19c00640 1 -- 172.21.15.42:0/577298830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d140b3550 msgr2=0x7f3d1415cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.569+0000 7f3d19c00640 1 --2- 172.21.15.42:0/577298830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d140b3550 0x7f3d1415cec0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f3d140704d0 tx=0x7f3d0402a4d0 comp rx=0 tx=0).stop 2024-09-17T01:42:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.569+0000 7f3d19c00640 1 -- 172.21.15.42:0/577298830 shutdown_connections 2024-09-17T01:42:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.569+0000 7f3d19c00640 1 --2- 172.21.15.42:0/577298830 >> v2:172.21.15.43:3300/0 conn(0x7f3d14142f40 0x7f3d14072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.569+0000 7f3d19c00640 1 --2- 172.21.15.42:0/577298830 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3d14072e90 0x7f3d140cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.569+0000 7f3d19c00640 1 --2- 172.21.15.42:0/577298830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d140b3550 0x7f3d1415cec0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.569+0000 7f3d19c00640 1 -- 172.21.15.42:0/577298830 >> 172.21.15.42:0/577298830 conn(0x7f3d140b2930 msgr2=0x7f3d1406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.570+0000 7f3d19c00640 1 -- 172.21.15.42:0/577298830 shutdown_connections 2024-09-17T01:42:43.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.570+0000 7f3d19c00640 1 -- 172.21.15.42:0/577298830 wait complete. 2024-09-17T01:42:43.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.572+0000 7f3d19c00640 1 Processor -- start 2024-09-17T01:42:43.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.572+0000 7f3d19c00640 1 -- start start 2024-09-17T01:42:43.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.573+0000 7f3d19c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d14072e90 0x7f3d1413eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:43.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.573+0000 7f3d19c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3d140b3550 0x7f3d141f94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:43.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.573+0000 7f3d19c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d14142f40 0x7f3d141f9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:43.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.573+0000 7f3d19c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1406d430 con 0x7f3d14072e90 2024-09-17T01:42:43.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.573+0000 7f3d19c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1406d5b0 con 0x7f3d14142f40 2024-09-17T01:42:43.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.573+0000 7f3d19c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3d1406d730 con 0x7f3d140b3550 2024-09-17T01:42:43.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.574+0000 7f3d12a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d14072e90 0x7f3d1413eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:43.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.574+0000 7f3d12a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d14072e90 0x7f3d1413eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56226/0 (socket says 172.21.15.42:56226) 2024-09-17T01:42:43.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.574+0000 7f3d12a00640 1 -- 172.21.15.42:0/3487028326 learned_addr learned my addr 172.21.15.42:0/3487028326 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:43.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.574+0000 7f3d0be00640 1 --2- 172.21.15.42:0/3487028326 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3d140b3550 0x7f3d141f94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:43.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.574+0000 7f3d13400640 1 --2- 172.21.15.42:0/3487028326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d14142f40 0x7f3d141f9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:43.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.574+0000 7f3d12a00640 1 -- 172.21.15.42:0/3487028326 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3d140b3550 msgr2=0x7f3d141f94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:43.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.574+0000 7f3d12a00640 1 --2- 172.21.15.42:0/3487028326 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3d140b3550 0x7f3d141f94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:43.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.574+0000 7f3d12a00640 1 -- 172.21.15.42:0/3487028326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d14142f40 msgr2=0x7f3d141f9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:43.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.574+0000 7f3d12a00640 1 --2- 172.21.15.42:0/3487028326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d14142f40 0x7f3d141f9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:43.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.574+0000 7f3d12a00640 1 -- 172.21.15.42:0/3487028326 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d141e62f0 con 0x7f3d14072e90 2024-09-17T01:42:43.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.574+0000 7f3d12a00640 1 --2- 172.21.15.42:0/3487028326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d14072e90 0x7f3d1413eba0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f3d04034040 tx=0x7f3d040038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:43.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.575+0000 7f3d0aa00640 1 -- 172.21.15.42:0/3487028326 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0403e030 con 0x7f3d14072e90 2024-09-17T01:42:43.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.575+0000 7f3d0aa00640 1 -- 172.21.15.42:0/3487028326 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d04003ca0 con 0x7f3d14072e90 2024-09-17T01:42:43.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.575+0000 7f3d19c00640 1 -- 172.21.15.42:0/3487028326 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d14141d10 con 0x7f3d14072e90 2024-09-17T01:42:43.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.575+0000 7f3d0aa00640 1 -- 172.21.15.42:0/3487028326 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d04035040 con 0x7f3d14072e90 2024-09-17T01:42:43.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.575+0000 7f3d19c00640 1 -- 172.21.15.42:0/3487028326 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d141e65b0 con 0x7f3d14072e90 2024-09-17T01:42:43.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.576+0000 7f3d19c00640 1 -- 172.21.15.42:0/3487028326 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d1406dc50 con 0x7f3d14072e90 2024-09-17T01:42:43.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.577+0000 7f3d0aa00640 1 -- 172.21.15.42:0/3487028326 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3d04041030 con 0x7f3d14072e90 2024-09-17T01:42:43.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.579+0000 7f3d0aa00640 1 --2- 172.21.15.42:0/3487028326 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3cf0078b90 0x7f3cf007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:43.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.579+0000 7f3d0aa00640 1 -- 172.21.15.42:0/3487028326 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5795+0+0 (secure 0 0 0) 0x7f3d040bb430 con 0x7f3d14072e90 2024-09-17T01:42:43.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.579+0000 7f3d0be00640 1 --2- 172.21.15.42:0/3487028326 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3cf0078b90 0x7f3cf007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:43.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.580+0000 7f3d0be00640 1 --2- 172.21.15.42:0/3487028326 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3cf0078b90 0x7f3cf007b0a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3d140cfa70 tx=0x7f3cfc005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:43.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.584+0000 7f3d0aa00640 1 -- 172.21.15.42:0/3487028326 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3d040831b0 con 0x7f3d14072e90 2024-09-17T01:42:43.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:43.816+0000 7f3d19c00640 1 -- 172.21.15.42:0/3487028326 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3d1406a170 con 0x7f3d14072e90 2024-09-17T01:42:44.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.310+0000 7f3d0aa00640 1 -- 172.21.15.42:0/3487028326 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v109) ==== 104+0+0 (secure 0 0 0) 0x7f3d04087be0 con 0x7f3d14072e90 2024-09-17T01:42:44.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.313+0000 7f3d19c00640 1 -- 172.21.15.42:0/3487028326 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3cf0078b90 msgr2=0x7f3cf007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:44.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.313+0000 7f3d19c00640 1 --2- 172.21.15.42:0/3487028326 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3cf0078b90 0x7f3cf007b0a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3d140cfa70 tx=0x7f3cfc005f90 comp rx=0 tx=0).stop 2024-09-17T01:42:44.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.313+0000 7f3d19c00640 1 -- 172.21.15.42:0/3487028326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d14072e90 msgr2=0x7f3d1413eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:44.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.313+0000 7f3d19c00640 1 --2- 172.21.15.42:0/3487028326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d14072e90 0x7f3d1413eba0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f3d04034040 tx=0x7f3d040038a0 comp rx=0 tx=0).stop 2024-09-17T01:42:44.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.313+0000 7f3d19c00640 1 -- 172.21.15.42:0/3487028326 shutdown_connections 2024-09-17T01:42:44.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.313+0000 7f3d19c00640 1 --2- 172.21.15.42:0/3487028326 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3cf0078b90 0x7f3cf007b0a0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:44.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.313+0000 7f3d19c00640 1 --2- 172.21.15.42:0/3487028326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d14142f40 0x7f3d141f9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:44.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.313+0000 7f3d19c00640 1 --2- 172.21.15.42:0/3487028326 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3d140b3550 0x7f3d141f94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:44.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.313+0000 7f3d19c00640 1 --2- 172.21.15.42:0/3487028326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3d14072e90 0x7f3d1413eba0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:44.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.313+0000 7f3d19c00640 1 -- 172.21.15.42:0/3487028326 >> 172.21.15.42:0/3487028326 conn(0x7f3d140b2930 msgr2=0x7f3d1415b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:44.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.313+0000 7f3d19c00640 1 -- 172.21.15.42:0/3487028326 shutdown_connections 2024-09-17T01:42:44.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.313+0000 7f3d19c00640 1 -- 172.21.15.42:0/3487028326 wait complete. 2024-09-17T01:42:44.336 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T01:42:44.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.571+0000 7f72d0400640 1 -- 172.21.15.42:0/2640981743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72c80b56d0 msgr2=0x7f72c80b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:44.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.571+0000 7f72d0400640 1 --2- 172.21.15.42:0/2640981743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72c80b56d0 0x7f72c80b46f0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f72c8071930 tx=0x7f72bc02a560 comp rx=0 tx=0).stop 2024-09-17T01:42:44.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.571+0000 7f72d0400640 1 -- 172.21.15.42:0/2640981743 shutdown_connections 2024-09-17T01:42:44.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.571+0000 7f72d0400640 1 --2- 172.21.15.42:0/2640981743 >> v2:172.21.15.43:3300/0 conn(0x7f72c80cdb20 0x7f72c80cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:44.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.571+0000 7f72d0400640 1 --2- 172.21.15.42:0/2640981743 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72c806d430 0x7f72c806d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:44.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.571+0000 7f72d0400640 1 --2- 172.21.15.42:0/2640981743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72c80b56d0 0x7f72c80b46f0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:44.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.571+0000 7f72d0400640 1 -- 172.21.15.42:0/2640981743 >> 172.21.15.42:0/2640981743 conn(0x7f72c80b28f0 msgr2=0x7f72c806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:44.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.572+0000 7f72d0400640 1 -- 172.21.15.42:0/2640981743 shutdown_connections 2024-09-17T01:42:44.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.572+0000 7f72d0400640 1 -- 172.21.15.42:0/2640981743 wait complete. 2024-09-17T01:42:44.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.574+0000 7f72d0400640 1 Processor -- start 2024-09-17T01:42:44.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.574+0000 7f72d0400640 1 -- start start 2024-09-17T01:42:44.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.575+0000 7f72d0400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72c806d430 0x7f72c815ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:44.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.575+0000 7f72d0400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72c80b56d0 0x7f72c815c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:44.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.575+0000 7f72d0400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72c80cdb20 0x7f72c80cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:44.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.576+0000 7f72d0400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f72c815d350 con 0x7f72c806d430 2024-09-17T01:42:44.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.576+0000 7f72d0400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f72c815d1d0 con 0x7f72c80b56d0 2024-09-17T01:42:44.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.576+0000 7f72d0400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f72c815d4d0 con 0x7f72c80cdb20 2024-09-17T01:42:44.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.576+0000 7f72cda00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72c806d430 0x7f72c815ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:44.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.576+0000 7f72cda00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72c806d430 0x7f72c815ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56244/0 (socket says 172.21.15.42:56244) 2024-09-17T01:42:44.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.576+0000 7f72cda00640 1 -- 172.21.15.42:0/3358448548 learned_addr learned my addr 172.21.15.42:0/3358448548 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:44.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.576+0000 7f72ce400640 1 --2- 172.21.15.42:0/3358448548 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72c80cdb20 0x7f72c80cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:44.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.576+0000 7f72cd000640 1 --2- 172.21.15.42:0/3358448548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72c80b56d0 0x7f72c815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:44.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.576+0000 7f72cda00640 1 -- 172.21.15.42:0/3358448548 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72c80cdb20 msgr2=0x7f72c80cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:44.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.576+0000 7f72cda00640 1 --2- 172.21.15.42:0/3358448548 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72c80cdb20 0x7f72c80cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:44.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.576+0000 7f72cda00640 1 -- 172.21.15.42:0/3358448548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72c80b56d0 msgr2=0x7f72c815c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:44.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.576+0000 7f72cda00640 1 --2- 172.21.15.42:0/3358448548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72c80b56d0 0x7f72c815c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:44.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.576+0000 7f72cda00640 1 -- 172.21.15.42:0/3358448548 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c80c9a70 con 0x7f72c806d430 2024-09-17T01:42:44.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.577+0000 7f72cda00640 1 --2- 172.21.15.42:0/3358448548 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72c806d430 0x7f72c815ef70 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f72bc034040 tx=0x7f72bc003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:44.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.577+0000 7f72c5600640 1 -- 172.21.15.42:0/3358448548 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc03e030 con 0x7f72c806d430 2024-09-17T01:42:44.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.577+0000 7f72c5600640 1 -- 172.21.15.42:0/3358448548 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72bc003e00 con 0x7f72c806d430 2024-09-17T01:42:44.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.577+0000 7f72d0400640 1 -- 172.21.15.42:0/3358448548 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c80c9d50 con 0x7f72c806d430 2024-09-17T01:42:44.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.577+0000 7f72c5600640 1 -- 172.21.15.42:0/3358448548 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc035040 con 0x7f72c806d430 2024-09-17T01:42:44.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.577+0000 7f72d0400640 1 -- 172.21.15.42:0/3358448548 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c80cc540 con 0x7f72c806d430 2024-09-17T01:42:44.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.578+0000 7f72d0400640 1 -- 172.21.15.42:0/3358448548 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c80cdfd0 con 0x7f72c806d430 2024-09-17T01:42:44.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.579+0000 7f72c5600640 1 -- 172.21.15.42:0/3358448548 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f72bc041030 con 0x7f72c806d430 2024-09-17T01:42:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.580+0000 7f72c5600640 1 --2- 172.21.15.42:0/3358448548 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f72a8078b90 0x7f72a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.580+0000 7f72c5600640 1 -- 172.21.15.42:0/3358448548 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5795+0+0 (secure 0 0 0) 0x7f72bc0bb530 con 0x7f72c806d430 2024-09-17T01:42:44.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.581+0000 7f72cd000640 1 --2- 172.21.15.42:0/3358448548 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f72a8078b90 0x7f72a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:44.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.582+0000 7f72cd000640 1 --2- 172.21.15.42:0/3358448548 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f72a8078b90 0x7f72a807b0a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f72c8074150 tx=0x7f72b400b390 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:44.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.585+0000 7f72c5600640 1 -- 172.21.15.42:0/3358448548 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f72bc0832b0 con 0x7f72c806d430 2024-09-17T01:42:44.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:44.780+0000 7f72d0400640 1 -- 172.21.15.42:0/3358448548 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f72c80b4670 con 0x7f72c806d430 2024-09-17T01:42:45.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.600+0000 7f72c5600640 1 -- 172.21.15.42:0/3358448548 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v138) ==== 181+0+0 (secure 0 0 0) 0x7f72bc087ce0 con 0x7f72c806d430 2024-09-17T01:42:45.599 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-09-17T01:42:45.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.604+0000 7f72d0400640 1 -- 172.21.15.42:0/3358448548 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f72a8078b90 msgr2=0x7f72a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:45.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.604+0000 7f72d0400640 1 --2- 172.21.15.42:0/3358448548 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f72a8078b90 0x7f72a807b0a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f72c8074150 tx=0x7f72b400b390 comp rx=0 tx=0).stop 2024-09-17T01:42:45.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.604+0000 7f72d0400640 1 -- 172.21.15.42:0/3358448548 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72c806d430 msgr2=0x7f72c815ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:45.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.604+0000 7f72d0400640 1 --2- 172.21.15.42:0/3358448548 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72c806d430 0x7f72c815ef70 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f72bc034040 tx=0x7f72bc003910 comp rx=0 tx=0).stop 2024-09-17T01:42:45.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.605+0000 7f72d0400640 1 -- 172.21.15.42:0/3358448548 shutdown_connections 2024-09-17T01:42:45.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.605+0000 7f72d0400640 1 --2- 172.21.15.42:0/3358448548 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f72a8078b90 0x7f72a807b0a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:45.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.605+0000 7f72d0400640 1 --2- 172.21.15.42:0/3358448548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f72c80b56d0 0x7f72c815c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:45.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.605+0000 7f72d0400640 1 --2- 172.21.15.42:0/3358448548 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72c80cdb20 0x7f72c80cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:45.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.605+0000 7f72d0400640 1 --2- 172.21.15.42:0/3358448548 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72c806d430 0x7f72c815ef70 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:45.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.605+0000 7f72d0400640 1 -- 172.21.15.42:0/3358448548 >> 172.21.15.42:0/3358448548 conn(0x7f72c80b28f0 msgr2=0x7f72c806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:45.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.605+0000 7f72d0400640 1 -- 172.21.15.42:0/3358448548 shutdown_connections 2024-09-17T01:42:45.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.605+0000 7f72d0400640 1 -- 172.21.15.42:0/3358448548 wait complete. 2024-09-17T01:42:45.634 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T01:42:45.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.873+0000 7f8539400640 1 -- 172.21.15.42:0/2982547641 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85340b56d0 msgr2=0x7f85340b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:45.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.873+0000 7f8539400640 1 --2- 172.21.15.42:0/2982547641 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85340b56d0 0x7f85340b46f0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f85340b3270 tx=0x7f852402a560 comp rx=0 tx=0).stop 2024-09-17T01:42:45.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.874+0000 7f8539400640 1 -- 172.21.15.42:0/2982547641 shutdown_connections 2024-09-17T01:42:45.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.874+0000 7f8539400640 1 --2- 172.21.15.42:0/2982547641 >> v2:172.21.15.43:3300/0 conn(0x7f853406d430 0x7f853406d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:45.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.874+0000 7f8539400640 1 --2- 172.21.15.42:0/2982547641 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f85340cdb20 0x7f85340cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:45.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.874+0000 7f8539400640 1 --2- 172.21.15.42:0/2982547641 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85340b56d0 0x7f85340b46f0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:45.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.874+0000 7f8539400640 1 -- 172.21.15.42:0/2982547641 >> 172.21.15.42:0/2982547641 conn(0x7f85340b28f0 msgr2=0x7f853406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:45.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.874+0000 7f8539400640 1 -- 172.21.15.42:0/2982547641 shutdown_connections 2024-09-17T01:42:45.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.874+0000 7f8539400640 1 -- 172.21.15.42:0/2982547641 wait complete. 2024-09-17T01:42:45.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.877+0000 7f8539400640 1 Processor -- start 2024-09-17T01:42:45.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.877+0000 7f8539400640 1 -- start start 2024-09-17T01:42:45.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.878+0000 7f8539400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f853406d430 0x7f85341f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:45.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.878+0000 7f8539400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f85340b56d0 0x7f8534133b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:45.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.878+0000 7f8539400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85340cdb20 0x7f85340c5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:45.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.878+0000 7f8539400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f853415d350 con 0x7f85340cdb20 2024-09-17T01:42:45.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.878+0000 7f8539400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f853415d1d0 con 0x7f853406d430 2024-09-17T01:42:45.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.878+0000 7f8539400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f853415d4d0 con 0x7f85340b56d0 2024-09-17T01:42:45.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.879+0000 7f8533200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85340cdb20 0x7f85340c5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:45.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.879+0000 7f8533200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85340cdb20 0x7f85340c5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42460/0 (socket says 172.21.15.42:42460) 2024-09-17T01:42:45.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.879+0000 7f8533200640 1 -- 172.21.15.42:0/418756567 learned_addr learned my addr 172.21.15.42:0/418756567 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:45.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.879+0000 7f8532800640 1 --2- 172.21.15.42:0/418756567 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f853406d430 0x7f85341f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:45.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.879+0000 7f8531e00640 1 --2- 172.21.15.42:0/418756567 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f85340b56d0 0x7f8534133b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:45.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.879+0000 7f8533200640 1 -- 172.21.15.42:0/418756567 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f85340b56d0 msgr2=0x7f8534133b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:45.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.879+0000 7f8533200640 1 --2- 172.21.15.42:0/418756567 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f85340b56d0 0x7f8534133b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:45.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.879+0000 7f8533200640 1 -- 172.21.15.42:0/418756567 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f853406d430 msgr2=0x7f85341f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:45.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.879+0000 7f8533200640 1 --2- 172.21.15.42:0/418756567 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f853406d430 0x7f85341f9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:45.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.879+0000 7f8533200640 1 -- 172.21.15.42:0/418756567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85341345e0 con 0x7f85340cdb20 2024-09-17T01:42:45.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.880+0000 7f8533200640 1 --2- 172.21.15.42:0/418756567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85340cdb20 0x7f85340c5a40 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f852c00e960 tx=0x7f852c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:45.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.880+0000 7f852aa00640 1 -- 172.21.15.42:0/418756567 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852c004d20 con 0x7f85340cdb20 2024-09-17T01:42:45.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.880+0000 7f852aa00640 1 -- 172.21.15.42:0/418756567 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f852c00ca60 con 0x7f85340cdb20 2024-09-17T01:42:45.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.880+0000 7f8539400640 1 -- 172.21.15.42:0/418756567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85341348c0 con 0x7f85340cdb20 2024-09-17T01:42:45.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.880+0000 7f852aa00640 1 -- 172.21.15.42:0/418756567 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852c005020 con 0x7f85340cdb20 2024-09-17T01:42:45.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.880+0000 7f8539400640 1 -- 172.21.15.42:0/418756567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85341f9070 con 0x7f85340cdb20 2024-09-17T01:42:45.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.881+0000 7f8539400640 1 -- 172.21.15.42:0/418756567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8534134350 con 0x7f85340cdb20 2024-09-17T01:42:45.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.882+0000 7f852aa00640 1 -- 172.21.15.42:0/418756567 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f852c0051c0 con 0x7f85340cdb20 2024-09-17T01:42:45.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.883+0000 7f852aa00640 1 --2- 172.21.15.42:0/418756567 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8514078bc0 0x7f851407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:45.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.884+0000 7f852aa00640 1 -- 172.21.15.42:0/418756567 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5357+0+0 (secure 0 0 0) 0x7f852c09b4d0 con 0x7f85340cdb20 2024-09-17T01:42:45.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.884+0000 7f8532800640 1 --2- 172.21.15.42:0/418756567 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8514078bc0 0x7f851407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:45.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.885+0000 7f8532800640 1 --2- 172.21.15.42:0/418756567 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8514078bc0 0x7f851407b0d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8524033000 tx=0x7f8524004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:45.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:45.888+0000 7f852aa00640 1 -- 172.21.15.42:0/418756567 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f852c016030 con 0x7f85340cdb20 2024-09-17T01:42:46.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.090+0000 7f8539400640 1 -- 172.21.15.42:0/418756567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f85340ce0d0 con 0x7f85340cdb20 2024-09-17T01:42:46.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.603+0000 7f852aa00640 1 -- 172.21.15.42:0/418756567 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v139) ==== 169+0+0 (secure 0 0 0) 0x7f852c063300 con 0x7f85340cdb20 2024-09-17T01:42:46.601 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-09-17T01:42:46.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.606+0000 7f8539400640 1 -- 172.21.15.42:0/418756567 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8514078bc0 msgr2=0x7f851407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:46.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.606+0000 7f8539400640 1 --2- 172.21.15.42:0/418756567 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8514078bc0 0x7f851407b0d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8524033000 tx=0x7f8524004730 comp rx=0 tx=0).stop 2024-09-17T01:42:46.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.606+0000 7f8539400640 1 -- 172.21.15.42:0/418756567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85340cdb20 msgr2=0x7f85340c5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:46.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.606+0000 7f8539400640 1 --2- 172.21.15.42:0/418756567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85340cdb20 0x7f85340c5a40 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f852c00e960 tx=0x7f852c00ee20 comp rx=0 tx=0).stop 2024-09-17T01:42:46.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.607+0000 7f8539400640 1 -- 172.21.15.42:0/418756567 shutdown_connections 2024-09-17T01:42:46.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.607+0000 7f8539400640 1 --2- 172.21.15.42:0/418756567 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8514078bc0 0x7f851407b0d0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:46.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.607+0000 7f8539400640 1 --2- 172.21.15.42:0/418756567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85340cdb20 0x7f85340c5a40 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:46.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.607+0000 7f8539400640 1 --2- 172.21.15.42:0/418756567 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f85340b56d0 0x7f8534133b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:46.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.607+0000 7f8539400640 1 --2- 172.21.15.42:0/418756567 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f853406d430 0x7f85341f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:46.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.607+0000 7f8539400640 1 -- 172.21.15.42:0/418756567 >> 172.21.15.42:0/418756567 conn(0x7f85340b28f0 msgr2=0x7f853406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:46.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.607+0000 7f8539400640 1 -- 172.21.15.42:0/418756567 shutdown_connections 2024-09-17T01:42:46.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.607+0000 7f8539400640 1 -- 172.21.15.42:0/418756567 wait complete. 2024-09-17T01:42:46.637 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T01:42:46.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.879+0000 7f8be5e00640 1 -- 172.21.15.42:0/3111094478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be0142f40 msgr2=0x7f8be0072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:46.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.879+0000 7f8be5e00640 1 --2- 172.21.15.42:0/3111094478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be0142f40 0x7f8be0072950 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8009830 tx=0x7f8bc802a480 comp rx=0 tx=0).stop 2024-09-17T01:42:46.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.879+0000 7f8be5e00640 1 -- 172.21.15.42:0/3111094478 shutdown_connections 2024-09-17T01:42:46.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.879+0000 7f8be5e00640 1 --2- 172.21.15.42:0/3111094478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be0142f40 0x7f8be0072950 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:46.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.879+0000 7f8be5e00640 1 --2- 172.21.15.42:0/3111094478 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8be00b3550 0x7f8be015cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:46.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.879+0000 7f8be5e00640 1 -- 172.21.15.42:0/3111094478 >> 172.21.15.42:0/3111094478 conn(0x7f8be00b2930 msgr2=0x7f8be006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:46.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.879+0000 7f8be5e00640 1 -- 172.21.15.42:0/3111094478 shutdown_connections 2024-09-17T01:42:46.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.879+0000 7f8be5e00640 1 -- 172.21.15.42:0/3111094478 wait complete. 2024-09-17T01:42:46.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.881+0000 7f8be5e00640 1 Processor -- start 2024-09-17T01:42:46.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.882+0000 7f8be5e00640 1 -- start start 2024-09-17T01:42:46.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.883+0000 7f8be5e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8be0072e90 0x7f8be00ab040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:46.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.883+0000 7f8be5e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8be00b3550 0x7f8be0158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:46.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.883+0000 7f8be5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be0142f40 0x7f8be0159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:46.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.883+0000 7f8be5e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8be006d7c0 con 0x7f8be0142f40 2024-09-17T01:42:46.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.883+0000 7f8be5e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8be006d640 con 0x7f8be0072e90 2024-09-17T01:42:46.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.883+0000 7f8be5e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8be006d940 con 0x7f8be00b3550 2024-09-17T01:42:46.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.883+0000 7f8bdf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be0142f40 0x7f8be0159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:46.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.883+0000 7f8bdf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be0142f40 0x7f8be0159090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42484/0 (socket says 172.21.15.42:42484) 2024-09-17T01:42:46.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.883+0000 7f8bdf400640 1 -- 172.21.15.42:0/871786941 learned_addr learned my addr 172.21.15.42:0/871786941 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:46.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.883+0000 7f8bdea00640 1 --2- 172.21.15.42:0/871786941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8be0072e90 0x7f8be00ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:46.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.883+0000 7f8bd6000640 1 --2- 172.21.15.42:0/871786941 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8be00b3550 0x7f8be0158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:46.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.884+0000 7f8bdf400640 1 -- 172.21.15.42:0/871786941 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8be00b3550 msgr2=0x7f8be0158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:46.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.884+0000 7f8bdf400640 1 --2- 172.21.15.42:0/871786941 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8be00b3550 0x7f8be0158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:46.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.884+0000 7f8bdf400640 1 -- 172.21.15.42:0/871786941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8be0072e90 msgr2=0x7f8be00ab040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:46.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.884+0000 7f8bdf400640 1 --2- 172.21.15.42:0/871786941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8be0072e90 0x7f8be00ab040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:46.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.884+0000 7f8bdf400640 1 -- 172.21.15.42:0/871786941 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be01f44d0 con 0x7f8be0142f40 2024-09-17T01:42:46.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.884+0000 7f8bdf400640 1 --2- 172.21.15.42:0/871786941 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be0142f40 0x7f8be0159090 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f8bd800cb40 tx=0x7f8bd800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:46.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.884+0000 7f8bd7e00640 1 -- 172.21.15.42:0/871786941 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd8016020 con 0x7f8be0142f40 2024-09-17T01:42:46.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.884+0000 7f8bd7e00640 1 -- 172.21.15.42:0/871786941 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bd800adb0 con 0x7f8be0142f40 2024-09-17T01:42:46.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.884+0000 7f8bd7e00640 1 -- 172.21.15.42:0/871786941 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd8012680 con 0x7f8be0142f40 2024-09-17T01:42:46.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.884+0000 7f8be5e00640 1 -- 172.21.15.42:0/871786941 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be01f3710 con 0x7f8be0142f40 2024-09-17T01:42:46.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.885+0000 7f8be5e00640 1 -- 172.21.15.42:0/871786941 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be01f3cd0 con 0x7f8be0142f40 2024-09-17T01:42:46.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.886+0000 7f8be5e00640 1 -- 172.21.15.42:0/871786941 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8be015cec0 con 0x7f8be0142f40 2024-09-17T01:42:46.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.887+0000 7f8bd7e00640 1 -- 172.21.15.42:0/871786941 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8bd8019020 con 0x7f8be0142f40 2024-09-17T01:42:46.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.888+0000 7f8bd7e00640 1 --2- 172.21.15.42:0/871786941 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8bbc078b90 0x7f8bbc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:46.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.888+0000 7f8bd7e00640 1 -- 172.21.15.42:0/871786941 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 4943+0+0 (secure 0 0 0) 0x7f8bd809af90 con 0x7f8be0142f40 2024-09-17T01:42:46.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.888+0000 7f8bdea00640 1 --2- 172.21.15.42:0/871786941 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8bbc078b90 0x7f8bbc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:46.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.889+0000 7f8bdea00640 1 --2- 172.21.15.42:0/871786941 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8bbc078b90 0x7f8bbc07b0a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0004590 tx=0x7f8bd000b390 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:46.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:46.892+0000 7f8bd7e00640 1 -- 172.21.15.42:0/871786941 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8bd8020020 con 0x7f8be0142f40 2024-09-17T01:42:47.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.086+0000 7f8be5e00640 1 -- 172.21.15.42:0/871786941 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f8be006a170 con 0x7f8be0142f40 2024-09-17T01:42:47.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.090+0000 7f8bd7e00640 1 -- 172.21.15.42:0/871786941 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v55) ==== 71+0+0 (secure 0 0 0) 0x7f8bd8062fe0 con 0x7f8be0142f40 2024-09-17T01:42:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.093+0000 7f8be5e00640 1 -- 172.21.15.42:0/871786941 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8bbc078b90 msgr2=0x7f8bbc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.093+0000 7f8be5e00640 1 --2- 172.21.15.42:0/871786941 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8bbc078b90 0x7f8bbc07b0a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0004590 tx=0x7f8bd000b390 comp rx=0 tx=0).stop 2024-09-17T01:42:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.093+0000 7f8be5e00640 1 -- 172.21.15.42:0/871786941 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be0142f40 msgr2=0x7f8be0159090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.093+0000 7f8be5e00640 1 --2- 172.21.15.42:0/871786941 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be0142f40 0x7f8be0159090 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f8bd800cb40 tx=0x7f8bd800a060 comp rx=0 tx=0).stop 2024-09-17T01:42:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.093+0000 7f8be5e00640 1 -- 172.21.15.42:0/871786941 shutdown_connections 2024-09-17T01:42:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.093+0000 7f8be5e00640 1 --2- 172.21.15.42:0/871786941 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8bbc078b90 0x7f8bbc07b0a0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.093+0000 7f8be5e00640 1 --2- 172.21.15.42:0/871786941 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8be0142f40 0x7f8be0159090 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.093+0000 7f8be5e00640 1 --2- 172.21.15.42:0/871786941 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8be00b3550 0x7f8be0158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.093+0000 7f8be5e00640 1 --2- 172.21.15.42:0/871786941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8be0072e90 0x7f8be00ab040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.093+0000 7f8be5e00640 1 -- 172.21.15.42:0/871786941 >> 172.21.15.42:0/871786941 conn(0x7f8be00b2930 msgr2=0x7f8be0073df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.093+0000 7f8be5e00640 1 -- 172.21.15.42:0/871786941 shutdown_connections 2024-09-17T01:42:47.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.093+0000 7f8be5e00640 1 -- 172.21.15.42:0/871786941 wait complete. 2024-09-17T01:42:47.114 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-09-17T01:42:47.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.357+0000 7fd7a0000640 1 -- 172.21.15.42:0/173404705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7980b5100 msgr2=0x7fd79815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:47.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.357+0000 7fd7a0000640 1 --2- 172.21.15.42:0/173404705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7980b5100 0x7fd79815d950 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fd78c005fd0 tx=0x7fd78c02a5f0 comp rx=0 tx=0).stop 2024-09-17T01:42:47.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.357+0000 7fd7a0000640 1 -- 172.21.15.42:0/173404705 shutdown_connections 2024-09-17T01:42:47.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.357+0000 7fd7a0000640 1 --2- 172.21.15.42:0/173404705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7980b5100 0x7fd79815d950 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:47.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.358+0000 7fd7a0000640 1 -- 172.21.15.42:0/173404705 >> 172.21.15.42:0/173404705 conn(0x7fd7980b2930 msgr2=0x7fd79806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:47.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.358+0000 7fd7a0000640 1 -- 172.21.15.42:0/173404705 shutdown_connections 2024-09-17T01:42:47.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.358+0000 7fd7a0000640 1 -- 172.21.15.42:0/173404705 wait complete. 2024-09-17T01:42:47.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.360+0000 7fd7a0000640 1 Processor -- start 2024-09-17T01:42:47.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.360+0000 7fd7a0000640 1 -- start start 2024-09-17T01:42:47.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.361+0000 7fd7a0000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd79806d430 0x7fd79806f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:47.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.361+0000 7fd7a0000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7980b5100 0x7fd798145de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:47.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.362+0000 7fd7a0000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7980cef70 0x7fd798146680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:47.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.362+0000 7fd7a0000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd798073bd0 con 0x7fd7980b5100 2024-09-17T01:42:47.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.362+0000 7fd7a0000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd798073a50 con 0x7fd79806d430 2024-09-17T01:42:47.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.362+0000 7fd7a0000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd798073d50 con 0x7fd7980cef70 2024-09-17T01:42:47.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.362+0000 7fd79cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7980b5100 0x7fd798145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:47.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.362+0000 7fd79cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7980b5100 0x7fd798145de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42494/0 (socket says 172.21.15.42:42494) 2024-09-17T01:42:47.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.362+0000 7fd79cc00640 1 -- 172.21.15.42:0/3034792075 learned_addr learned my addr 172.21.15.42:0/3034792075 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:47.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.362+0000 7fd79d600640 1 --2- 172.21.15.42:0/3034792075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd79806d430 0x7fd79806f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:47.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.362+0000 7fd79e000640 1 --2- 172.21.15.42:0/3034792075 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7980cef70 0x7fd798146680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:47.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.362+0000 7fd79cc00640 1 -- 172.21.15.42:0/3034792075 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7980cef70 msgr2=0x7fd798146680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:47.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.362+0000 7fd79cc00640 1 --2- 172.21.15.42:0/3034792075 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7980cef70 0x7fd798146680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:47.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.362+0000 7fd79cc00640 1 -- 172.21.15.42:0/3034792075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd79806d430 msgr2=0x7fd79806f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:47.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.362+0000 7fd79cc00640 1 --2- 172.21.15.42:0/3034792075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd79806d430 0x7fd79806f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:47.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.362+0000 7fd79cc00640 1 -- 172.21.15.42:0/3034792075 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79806ebd0 con 0x7fd7980b5100 2024-09-17T01:42:47.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.363+0000 7fd79cc00640 1 --2- 172.21.15.42:0/3034792075 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7980b5100 0x7fd798145de0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fd78400c3a0 tx=0x7fd78400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:47.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.363+0000 7fd795600640 1 -- 172.21.15.42:0/3034792075 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd784017070 con 0x7fd7980b5100 2024-09-17T01:42:47.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.363+0000 7fd795600640 1 -- 172.21.15.42:0/3034792075 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7840053c0 con 0x7fd7980b5100 2024-09-17T01:42:47.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.363+0000 7fd795600640 1 -- 172.21.15.42:0/3034792075 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd784003850 con 0x7fd7980b5100 2024-09-17T01:42:47.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.363+0000 7fd7a0000640 1 -- 172.21.15.42:0/3034792075 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd798159090 con 0x7fd7980b5100 2024-09-17T01:42:47.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.363+0000 7fd7a0000640 1 -- 172.21.15.42:0/3034792075 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd79806f150 con 0x7fd7980b5100 2024-09-17T01:42:47.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.364+0000 7fd7a0000640 1 -- 172.21.15.42:0/3034792075 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd79815d950 con 0x7fd7980b5100 2024-09-17T01:42:47.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.365+0000 7fd795600640 1 -- 172.21.15.42:0/3034792075 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd78401a070 con 0x7fd7980b5100 2024-09-17T01:42:47.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.366+0000 7fd795600640 1 --2- 172.21.15.42:0/3034792075 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd778078bc0 0x7fd77807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:47.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.366+0000 7fd795600640 1 -- 172.21.15.42:0/3034792075 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 4943+0+0 (secure 0 0 0) 0x7fd784099d20 con 0x7fd7980b5100 2024-09-17T01:42:47.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.367+0000 7fd79d600640 1 --2- 172.21.15.42:0/3034792075 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd778078bc0 0x7fd77807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:47.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.368+0000 7fd79d600640 1 --2- 172.21.15.42:0/3034792075 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd778078bc0 0x7fd77807b0d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd78c033000 tx=0x7fd78c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:47.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.371+0000 7fd795600640 1 -- 172.21.15.42:0/3034792075 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd79815de90 con 0x7fd7980b5100 2024-09-17T01:42:47.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:47.636+0000 7fd7a0000640 1 -- 172.21.15.42:0/3034792075 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) -- 0x7fd79806a170 con 0x7fd7980b5100 2024-09-17T01:42:48.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.616+0000 7fd795600640 1 -- 172.21.15.42:0/3034792075 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v508) ==== 155+0+0 (secure 0 0 0) 0x7fd784061e00 con 0x7fd7980b5100 2024-09-17T01:42:48.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.620+0000 7fd7a0000640 1 -- 172.21.15.42:0/3034792075 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd778078bc0 msgr2=0x7fd77807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:48.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.620+0000 7fd7a0000640 1 --2- 172.21.15.42:0/3034792075 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd778078bc0 0x7fd77807b0d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd78c033000 tx=0x7fd78c004730 comp rx=0 tx=0).stop 2024-09-17T01:42:48.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.620+0000 7fd7a0000640 1 -- 172.21.15.42:0/3034792075 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7980b5100 msgr2=0x7fd798145de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:48.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.620+0000 7fd7a0000640 1 --2- 172.21.15.42:0/3034792075 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7980b5100 0x7fd798145de0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fd78400c3a0 tx=0x7fd78400c860 comp rx=0 tx=0).stop 2024-09-17T01:42:48.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.620+0000 7fd7a0000640 1 -- 172.21.15.42:0/3034792075 shutdown_connections 2024-09-17T01:42:48.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.620+0000 7fd7a0000640 1 --2- 172.21.15.42:0/3034792075 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd778078bc0 0x7fd77807b0d0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:48.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.620+0000 7fd7a0000640 1 --2- 172.21.15.42:0/3034792075 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd7980cef70 0x7fd798146680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:48.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.620+0000 7fd7a0000640 1 --2- 172.21.15.42:0/3034792075 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7980b5100 0x7fd798145de0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:48.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.620+0000 7fd7a0000640 1 --2- 172.21.15.42:0/3034792075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd79806d430 0x7fd79806f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:48.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.620+0000 7fd7a0000640 1 -- 172.21.15.42:0/3034792075 >> 172.21.15.42:0/3034792075 conn(0x7fd7980b2930 msgr2=0x7fd798156e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:48.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.620+0000 7fd7a0000640 1 -- 172.21.15.42:0/3034792075 shutdown_connections 2024-09-17T01:42:48.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.620+0000 7fd7a0000640 1 -- 172.21.15.42:0/3034792075 wait complete. 2024-09-17T01:42:48.644 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-17T01:42:48.644 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-17T01:42:48.644 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:42:48.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.880+0000 7f0dd8400640 1 -- 172.21.15.42:0/1784009829 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dd015f480 msgr2=0x7f0dd015f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:48.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.880+0000 7f0dd8400640 1 --2- 172.21.15.42:0/1784009829 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dd015f480 0x7f0dd015f890 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f0dd00d0360 tx=0x7f0dc802aac0 comp rx=0 tx=0).stop 2024-09-17T01:42:48.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.880+0000 7f0dd8400640 1 -- 172.21.15.42:0/1784009829 shutdown_connections 2024-09-17T01:42:48.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.880+0000 7f0dd8400640 1 --2- 172.21.15.42:0/1784009829 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dd015f480 0x7f0dd015f890 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:48.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.880+0000 7f0dd8400640 1 --2- 172.21.15.42:0/1784009829 >> v2:172.21.15.43:3300/0 conn(0x7f0dd006d430 0x7f0dd006d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:48.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.880+0000 7f0dd8400640 1 -- 172.21.15.42:0/1784009829 >> 172.21.15.42:0/1784009829 conn(0x7f0dd00b2930 msgr2=0x7f0dd006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:48.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.881+0000 7f0dd8400640 1 -- 172.21.15.42:0/1784009829 shutdown_connections 2024-09-17T01:42:48.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.881+0000 7f0dd8400640 1 -- 172.21.15.42:0/1784009829 wait complete. 2024-09-17T01:42:48.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.883+0000 7f0dd8400640 1 Processor -- start 2024-09-17T01:42:48.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.883+0000 7f0dd8400640 1 -- start start 2024-09-17T01:42:48.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.884+0000 7f0dd8400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0dd006d430 0x7f0dd00ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:48.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.884+0000 7f0dd8400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dd015cb80 0x7f0dd01564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:48.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.884+0000 7f0dd8400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0dd015f480 0x7f0dd0156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:48.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.884+0000 7f0dd8400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd0073820 con 0x7f0dd015cb80 2024-09-17T01:42:48.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.884+0000 7f0dd8400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd00736a0 con 0x7f0dd015f480 2024-09-17T01:42:48.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.884+0000 7f0dd8400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0dd00739a0 con 0x7f0dd006d430 2024-09-17T01:42:48.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.885+0000 7f0dd5000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dd015cb80 0x7f0dd01564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:48.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.885+0000 7f0dd5000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dd015cb80 0x7f0dd01564e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42512/0 (socket says 172.21.15.42:42512) 2024-09-17T01:42:48.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.885+0000 7f0dd5000640 1 -- 172.21.15.42:0/2950288567 learned_addr learned my addr 172.21.15.42:0/2950288567 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:48.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.885+0000 7f0dd6400640 1 --2- 172.21.15.42:0/2950288567 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0dd015f480 0x7f0dd0156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:48.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.885+0000 7f0dd5a00640 1 --2- 172.21.15.42:0/2950288567 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0dd006d430 0x7f0dd00ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:48.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.885+0000 7f0dd5000640 1 -- 172.21.15.42:0/2950288567 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0dd006d430 msgr2=0x7f0dd00ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:48.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.885+0000 7f0dd5000640 1 --2- 172.21.15.42:0/2950288567 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0dd006d430 0x7f0dd00ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:48.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.885+0000 7f0dd5000640 1 -- 172.21.15.42:0/2950288567 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0dd015f480 msgr2=0x7f0dd0156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:48.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.885+0000 7f0dd5000640 1 --2- 172.21.15.42:0/2950288567 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0dd015f480 0x7f0dd0156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:48.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.885+0000 7f0dd5000640 1 -- 172.21.15.42:0/2950288567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd00aab90 con 0x7f0dd015cb80 2024-09-17T01:42:48.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.886+0000 7f0dd5000640 1 --2- 172.21.15.42:0/2950288567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dd015cb80 0x7f0dd01564e0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00d700 tx=0x7f0dbc00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:48.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.886+0000 7f0dcd600640 1 -- 172.21.15.42:0/2950288567 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc017070 con 0x7f0dd015cb80 2024-09-17T01:42:48.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.886+0000 7f0dcd600640 1 -- 172.21.15.42:0/2950288567 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0dbc005310 con 0x7f0dd015cb80 2024-09-17T01:42:48.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.886+0000 7f0dd8400640 1 -- 172.21.15.42:0/2950288567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dd0158a90 con 0x7f0dd015cb80 2024-09-17T01:42:48.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.886+0000 7f0dcd600640 1 -- 172.21.15.42:0/2950288567 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc009820 con 0x7f0dd015cb80 2024-09-17T01:42:48.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.886+0000 7f0dd8400640 1 -- 172.21.15.42:0/2950288567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dd0159050 con 0x7f0dd015cb80 2024-09-17T01:42:48.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.887+0000 7f0dd8400640 1 -- 172.21.15.42:0/2950288567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dd00aa900 con 0x7f0dd015cb80 2024-09-17T01:42:48.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.888+0000 7f0dcd600640 1 -- 172.21.15.42:0/2950288567 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0dbc0099c0 con 0x7f0dd015cb80 2024-09-17T01:42:48.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.889+0000 7f0dcd600640 1 --2- 172.21.15.42:0/2950288567 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0db0078b90 0x7f0db007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:48.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.889+0000 7f0dcd600640 1 -- 172.21.15.42:0/2950288567 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 4943+0+0 (secure 0 0 0) 0x7f0dbc09aab0 con 0x7f0dd015cb80 2024-09-17T01:42:48.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.890+0000 7f0dd5a00640 1 --2- 172.21.15.42:0/2950288567 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0db0078b90 0x7f0db007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:48.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.890+0000 7f0dd5a00640 1 --2- 172.21.15.42:0/2950288567 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0db0078b90 0x7f0db007b0a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4001720 tx=0x7f0dc4009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:48.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:48.894+0000 7f0dcd600640 1 -- 172.21.15.42:0/2950288567 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0dbc062b90 con 0x7f0dd015cb80 2024-09-17T01:42:49.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.089+0000 7f0dd8400640 1 -- 172.21.15.42:0/2950288567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0dd0073e90 con 0x7f0dd015cb80 2024-09-17T01:42:49.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.090+0000 7f0dcd600640 1 -- 172.21.15.42:0/2950288567 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) ==== 74+0+12994 (secure 0 0 0) 0x7f0dbc0675c0 con 0x7f0dd015cb80 2024-09-17T01:42:49.088 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:49.088 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":139,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:42:46.601481+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6835/3060441721":"2024-09-18T01:42:43.307273+0000","172.21.15.42:6833/3060441721":"2024-09-18T01:42:43.307273+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:42:49.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.093+0000 7f0dd8400640 1 -- 172.21.15.42:0/2950288567 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0db0078b90 msgr2=0x7f0db007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:49.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.093+0000 7f0dd8400640 1 --2- 172.21.15.42:0/2950288567 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0db0078b90 0x7f0db007b0a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4001720 tx=0x7f0dc4009040 comp rx=0 tx=0).stop 2024-09-17T01:42:49.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.093+0000 7f0dd8400640 1 -- 172.21.15.42:0/2950288567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dd015cb80 msgr2=0x7f0dd01564e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:49.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.093+0000 7f0dd8400640 1 --2- 172.21.15.42:0/2950288567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dd015cb80 0x7f0dd01564e0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00d700 tx=0x7f0dbc00dbc0 comp rx=0 tx=0).stop 2024-09-17T01:42:49.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.093+0000 7f0dd8400640 1 -- 172.21.15.42:0/2950288567 shutdown_connections 2024-09-17T01:42:49.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.093+0000 7f0dd8400640 1 --2- 172.21.15.42:0/2950288567 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0db0078b90 0x7f0db007b0a0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:49.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.093+0000 7f0dd8400640 1 --2- 172.21.15.42:0/2950288567 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0dd015f480 0x7f0dd0156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:49.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.093+0000 7f0dd8400640 1 --2- 172.21.15.42:0/2950288567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0dd015cb80 0x7f0dd01564e0 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:49.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.093+0000 7f0dd8400640 1 --2- 172.21.15.42:0/2950288567 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0dd006d430 0x7f0dd00ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:49.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.093+0000 7f0dd8400640 1 -- 172.21.15.42:0/2950288567 >> 172.21.15.42:0/2950288567 conn(0x7f0dd00b2930 msgr2=0x7f0dd00cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:49.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.093+0000 7f0dd8400640 1 -- 172.21.15.42:0/2950288567 shutdown_connections 2024-09-17T01:42:49.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.093+0000 7f0dd8400640 1 -- 172.21.15.42:0/2950288567 wait complete. 2024-09-17T01:42:49.112 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T01:31:55.004951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T01:42:49.113 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T01:42:49.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.357+0000 7f6647e00640 1 -- 172.21.15.42:0/1069320525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6648074b20 msgr2=0x7f66481600f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:49.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.357+0000 7f6647e00640 1 --2- 172.21.15.42:0/1069320525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6648074b20 0x7f66481600f0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f6648070590 tx=0x7f663002a560 comp rx=0 tx=0).stop 2024-09-17T01:42:49.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.357+0000 7f6647e00640 1 -- 172.21.15.42:0/1069320525 shutdown_connections 2024-09-17T01:42:49.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.357+0000 7f6647e00640 1 --2- 172.21.15.42:0/1069320525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6648074b20 0x7f66481600f0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:49.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.357+0000 7f6647e00640 1 --2- 172.21.15.42:0/1069320525 >> v2:172.21.15.43:3300/0 conn(0x7f6648156ba0 0x7f66480745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:49.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.357+0000 7f6647e00640 1 -- 172.21.15.42:0/1069320525 >> 172.21.15.42:0/1069320525 conn(0x7f66480b27a0 msgr2=0x7f66480d0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:49.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.357+0000 7f6647e00640 1 -- 172.21.15.42:0/1069320525 shutdown_connections 2024-09-17T01:42:49.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.357+0000 7f6647e00640 1 -- 172.21.15.42:0/1069320525 wait complete. 2024-09-17T01:42:49.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.359+0000 7f6647e00640 1 Processor -- start 2024-09-17T01:42:49.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.360+0000 7f6647e00640 1 -- start start 2024-09-17T01:42:49.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.361+0000 7f6647e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6648074b20 0x7f66480cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:49.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.361+0000 7f6647e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6648156ba0 0x7f664814a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:49.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.361+0000 7f6647e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6648160630 0x7f66481f8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:49.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.361+0000 7f6647e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f664815d210 con 0x7f6648074b20 2024-09-17T01:42:49.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.361+0000 7f6647e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f664815de20 con 0x7f6648160630 2024-09-17T01:42:49.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.361+0000 7f6647e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f664815d390 con 0x7f6648156ba0 2024-09-17T01:42:49.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.361+0000 7f6646a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6648074b20 0x7f66480cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:49.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.361+0000 7f6646a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6648074b20 0x7f66480cc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42532/0 (socket says 172.21.15.42:42532) 2024-09-17T01:42:49.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.361+0000 7f6646a00640 1 -- 172.21.15.42:0/2767580616 learned_addr learned my addr 172.21.15.42:0/2767580616 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:49.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.362+0000 7f6647400640 1 --2- 172.21.15.42:0/2767580616 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6648160630 0x7f66481f8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:49.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.362+0000 7f663fe00640 1 --2- 172.21.15.42:0/2767580616 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6648156ba0 0x7f664814a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:49.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.362+0000 7f6646a00640 1 -- 172.21.15.42:0/2767580616 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6648156ba0 msgr2=0x7f664814a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:49.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.362+0000 7f6646a00640 1 --2- 172.21.15.42:0/2767580616 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6648156ba0 0x7f664814a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:49.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.362+0000 7f6646a00640 1 -- 172.21.15.42:0/2767580616 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6648160630 msgr2=0x7f66481f8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:49.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.362+0000 7f6646a00640 1 --2- 172.21.15.42:0/2767580616 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6648160630 0x7f66481f8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:49.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.362+0000 7f6646a00640 1 -- 172.21.15.42:0/2767580616 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66481f9970 con 0x7f6648074b20 2024-09-17T01:42:49.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.362+0000 7f663fe00640 1 --2- 172.21.15.42:0/2767580616 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6648156ba0 0x7f664814a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:42:49.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.362+0000 7f6646a00640 1 --2- 172.21.15.42:0/2767580616 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6648074b20 0x7f66480cc120 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f663800d7a0 tx=0x7f663800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:49.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.362+0000 7f663ea00640 1 -- 172.21.15.42:0/2767580616 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6638017070 con 0x7f6648074b20 2024-09-17T01:42:49.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.362+0000 7f663ea00640 1 -- 172.21.15.42:0/2767580616 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6638009d20 con 0x7f6648074b20 2024-09-17T01:42:49.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.362+0000 7f663ea00640 1 -- 172.21.15.42:0/2767580616 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6638004280 con 0x7f6648074b20 2024-09-17T01:42:49.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.362+0000 7f6647e00640 1 -- 172.21.15.42:0/2767580616 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66481f9c50 con 0x7f6648074b20 2024-09-17T01:42:49.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.363+0000 7f6647e00640 1 -- 172.21.15.42:0/2767580616 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66480cb920 con 0x7f6648074b20 2024-09-17T01:42:49.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.364+0000 7f6647e00640 1 -- 172.21.15.42:0/2767580616 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66480cc660 con 0x7f6648074b20 2024-09-17T01:42:49.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.365+0000 7f663ea00640 1 -- 172.21.15.42:0/2767580616 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6638005020 con 0x7f6648074b20 2024-09-17T01:42:49.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.366+0000 7f663ea00640 1 --2- 172.21.15.42:0/2767580616 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6624078b90 0x7f662407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:49.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.366+0000 7f663ea00640 1 -- 172.21.15.42:0/2767580616 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 4943+0+0 (secure 0 0 0) 0x7f663809aea0 con 0x7f6648074b20 2024-09-17T01:42:49.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.366+0000 7f663fe00640 1 --2- 172.21.15.42:0/2767580616 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6624078b90 0x7f662407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:49.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.367+0000 7f663fe00640 1 --2- 172.21.15.42:0/2767580616 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6624078b90 0x7f662407b0a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f6630033000 tx=0x7f6630004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:49.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.370+0000 7f663ea00640 1 -- 172.21.15.42:0/2767580616 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6638020020 con 0x7f6648074b20 2024-09-17T01:42:49.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.563+0000 7f6647e00640 1 -- 172.21.15.42:0/2767580616 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f664815d820 con 0x7f6648074b20 2024-09-17T01:42:49.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.563+0000 7f663ea00640 1 -- 172.21.15.42:0/2767580616 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v139) ==== 93+0+10 (secure 0 0 0) 0x7f6638023350 con 0x7f6648074b20 2024-09-17T01:42:49.561 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-09-17T01:42:49.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.565+0000 7f6647e00640 1 -- 172.21.15.42:0/2767580616 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6624078b90 msgr2=0x7f662407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:49.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.565+0000 7f6647e00640 1 --2- 172.21.15.42:0/2767580616 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6624078b90 0x7f662407b0a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f6630033000 tx=0x7f6630004730 comp rx=0 tx=0).stop 2024-09-17T01:42:49.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.565+0000 7f6647e00640 1 -- 172.21.15.42:0/2767580616 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6648074b20 msgr2=0x7f66480cc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:49.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.565+0000 7f6647e00640 1 --2- 172.21.15.42:0/2767580616 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6648074b20 0x7f66480cc120 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f663800d7a0 tx=0x7f663800dc60 comp rx=0 tx=0).stop 2024-09-17T01:42:49.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.565+0000 7f6647e00640 1 -- 172.21.15.42:0/2767580616 shutdown_connections 2024-09-17T01:42:49.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.565+0000 7f6647e00640 1 --2- 172.21.15.42:0/2767580616 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6624078b90 0x7f662407b0a0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:49.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.565+0000 7f6647e00640 1 --2- 172.21.15.42:0/2767580616 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6648160630 0x7f66481f8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:49.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.566+0000 7f6647e00640 1 --2- 172.21.15.42:0/2767580616 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6648156ba0 0x7f664814a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:49.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.566+0000 7f6647e00640 1 --2- 172.21.15.42:0/2767580616 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6648074b20 0x7f66480cc120 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:49.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.566+0000 7f6647e00640 1 -- 172.21.15.42:0/2767580616 >> 172.21.15.42:0/2767580616 conn(0x7f66480b27a0 msgr2=0x7f66480d0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:49.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.566+0000 7f6647e00640 1 -- 172.21.15.42:0/2767580616 shutdown_connections 2024-09-17T01:42:49.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.566+0000 7f6647e00640 1 -- 172.21.15.42:0/2767580616 wait complete. 2024-09-17T01:42:49.586 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-09-17T01:42:49.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.817+0000 7fe551c00640 1 -- 172.21.15.42:0/372353229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe530003a30 msgr2=0x7fe530003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:49.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.817+0000 7fe551c00640 1 --2- 172.21.15.42:0/372353229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe530003a30 0x7fe530003ea0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fe53c0016c0 tx=0x7fe530005830 comp rx=0 tx=0).stop 2024-09-17T01:42:49.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.817+0000 7fe54b400640 1 -- 172.21.15.42:0/372353229 reap_dead start 2024-09-17T01:42:49.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.818+0000 7fe551c00640 1 -- 172.21.15.42:0/372353229 shutdown_connections 2024-09-17T01:42:49.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.818+0000 7fe551c00640 1 -- 172.21.15.42:0/372353229 >> 172.21.15.42:0/372353229 conn(0x7fe54c0b2930 msgr2=0x7fe54c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:49.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.818+0000 7fe551c00640 1 -- 172.21.15.42:0/372353229 shutdown_connections 2024-09-17T01:42:49.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.818+0000 7fe551c00640 1 -- 172.21.15.42:0/372353229 wait complete. 2024-09-17T01:42:49.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.820+0000 7fe551c00640 1 Processor -- start 2024-09-17T01:42:49.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.820+0000 7fe551c00640 1 -- start start 2024-09-17T01:42:49.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.821+0000 7fe551c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe54c14feb0 0x7fe54c0ab010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:49.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.821+0000 7fe551c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe54c144dd0 0x7fe54c0b1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:49.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.821+0000 7fe551c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe54c1e9620 0x7fe54c1e9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:49.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.821+0000 7fe551c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c0735d0 con 0x7fe54c14feb0 2024-09-17T01:42:49.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.821+0000 7fe551c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c073450 con 0x7fe54c1e9620 2024-09-17T01:42:49.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.821+0000 7fe551c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe54c073750 con 0x7fe54c144dd0 2024-09-17T01:42:49.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.822+0000 7fe54aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe54c14feb0 0x7fe54c0ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:49.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.822+0000 7fe54aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe54c14feb0 0x7fe54c0ab010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42536/0 (socket says 172.21.15.42:42536) 2024-09-17T01:42:49.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.822+0000 7fe54aa00640 1 -- 172.21.15.42:0/2126935412 learned_addr learned my addr 172.21.15.42:0/2126935412 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:49.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.822+0000 7fe54a000640 1 --2- 172.21.15.42:0/2126935412 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe54c144dd0 0x7fe54c0b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:49.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.822+0000 7fe54b400640 1 --2- 172.21.15.42:0/2126935412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe54c1e9620 0x7fe54c1e9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:49.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.822+0000 7fe54aa00640 1 -- 172.21.15.42:0/2126935412 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe54c144dd0 msgr2=0x7fe54c0b1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:49.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.822+0000 7fe54aa00640 1 --2- 172.21.15.42:0/2126935412 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe54c144dd0 0x7fe54c0b1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:49.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.822+0000 7fe54aa00640 1 -- 172.21.15.42:0/2126935412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe54c1e9620 msgr2=0x7fe54c1e9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:49.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.822+0000 7fe54aa00640 1 --2- 172.21.15.42:0/2126935412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe54c1e9620 0x7fe54c1e9a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:49.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.822+0000 7fe54aa00640 1 -- 172.21.15.42:0/2126935412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe54c1e9f70 con 0x7fe54c14feb0 2024-09-17T01:42:49.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.822+0000 7fe54aa00640 1 --2- 172.21.15.42:0/2126935412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe54c14feb0 0x7fe54c0ab010 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fe53c02a930 tx=0x7fe53c006310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:49.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.823+0000 7fe542a00640 1 -- 172.21.15.42:0/2126935412 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c041070 con 0x7fe54c14feb0 2024-09-17T01:42:49.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.823+0000 7fe542a00640 1 -- 172.21.15.42:0/2126935412 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe53c003af0 con 0x7fe54c14feb0 2024-09-17T01:42:49.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.823+0000 7fe551c00640 1 -- 172.21.15.42:0/2126935412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe54c0cda90 con 0x7fe54c14feb0 2024-09-17T01:42:49.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.823+0000 7fe542a00640 1 -- 172.21.15.42:0/2126935412 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c038070 con 0x7fe54c14feb0 2024-09-17T01:42:49.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.823+0000 7fe551c00640 1 -- 172.21.15.42:0/2126935412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe54c0cd7b0 con 0x7fe54c14feb0 2024-09-17T01:42:49.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.824+0000 7fe551c00640 1 -- 172.21.15.42:0/2126935412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe54c073ce0 con 0x7fe54c14feb0 2024-09-17T01:42:49.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.825+0000 7fe542a00640 1 -- 172.21.15.42:0/2126935412 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe53c044070 con 0x7fe54c14feb0 2024-09-17T01:42:49.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.826+0000 7fe542a00640 1 --2- 172.21.15.42:0/2126935412 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe52c078bc0 0x7fe52c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:49.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.826+0000 7fe542a00640 1 -- 172.21.15.42:0/2126935412 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 4943+0+0 (secure 0 0 0) 0x7fe53c0ba1b0 con 0x7fe54c14feb0 2024-09-17T01:42:49.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.827+0000 7fe54a000640 1 --2- 172.21.15.42:0/2126935412 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe52c078bc0 0x7fe52c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:49.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.827+0000 7fe54a000640 1 --2- 172.21.15.42:0/2126935412 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe52c078bc0 0x7fe52c07b0d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0aed20 tx=0x7fe538005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:49.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:49.831+0000 7fe542a00640 1 -- 172.21.15.42:0/2126935412 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe54c06dd80 con 0x7fe54c14feb0 2024-09-17T01:42:50.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.095+0000 7fe551c00640 1 -- 172.21.15.42:0/2126935412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) -- 0x7fe54c0aac30 con 0x7fe54c14feb0 2024-09-17T01:42:50.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.624+0000 7fe542a00640 1 -- 172.21.15.42:0/2126935412 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v510) ==== 169+0+0 (secure 0 0 0) 0x7fe53c006500 con 0x7fe54c14feb0 2024-09-17T01:42:50.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.627+0000 7fe551c00640 1 -- 172.21.15.42:0/2126935412 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe52c078bc0 msgr2=0x7fe52c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:50.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.627+0000 7fe551c00640 1 --2- 172.21.15.42:0/2126935412 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe52c078bc0 0x7fe52c07b0d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0aed20 tx=0x7fe538005f90 comp rx=0 tx=0).stop 2024-09-17T01:42:50.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.627+0000 7fe551c00640 1 -- 172.21.15.42:0/2126935412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe54c14feb0 msgr2=0x7fe54c0ab010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:50.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.627+0000 7fe551c00640 1 --2- 172.21.15.42:0/2126935412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe54c14feb0 0x7fe54c0ab010 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fe53c02a930 tx=0x7fe53c006310 comp rx=0 tx=0).stop 2024-09-17T01:42:50.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.627+0000 7fe551c00640 1 -- 172.21.15.42:0/2126935412 shutdown_connections 2024-09-17T01:42:50.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.627+0000 7fe551c00640 1 --2- 172.21.15.42:0/2126935412 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe52c078bc0 0x7fe52c07b0d0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:50.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.627+0000 7fe551c00640 1 --2- 172.21.15.42:0/2126935412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe54c1e9620 0x7fe54c1e9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:50.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.627+0000 7fe551c00640 1 --2- 172.21.15.42:0/2126935412 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe54c144dd0 0x7fe54c0b1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:50.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.627+0000 7fe551c00640 1 --2- 172.21.15.42:0/2126935412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe54c14feb0 0x7fe54c0ab010 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:50.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.627+0000 7fe551c00640 1 -- 172.21.15.42:0/2126935412 >> 172.21.15.42:0/2126935412 conn(0x7fe54c0b2930 msgr2=0x7fe54c1511d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:50.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.627+0000 7fe551c00640 1 -- 172.21.15.42:0/2126935412 shutdown_connections 2024-09-17T01:42:50.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.628+0000 7fe551c00640 1 -- 172.21.15.42:0/2126935412 wait complete. 2024-09-17T01:42:50.653 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T01:42:50.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.886+0000 7f79bd600640 1 -- 172.21.15.42:0/2936224077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79b80b4be0 msgr2=0x7f79b815d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:50.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.886+0000 7f79bd600640 1 --2- 172.21.15.42:0/2936224077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79b80b4be0 0x7f79b815d6b0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f79a8005fd0 tx=0x7f79a802a670 comp rx=0 tx=0).stop 2024-09-17T01:42:50.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.886+0000 7f79bd600640 1 -- 172.21.15.42:0/2936224077 shutdown_connections 2024-09-17T01:42:50.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.886+0000 7f79bd600640 1 --2- 172.21.15.42:0/2936224077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79b80b4be0 0x7f79b815d6b0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:50.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.886+0000 7f79bd600640 1 -- 172.21.15.42:0/2936224077 >> 172.21.15.42:0/2936224077 conn(0x7f79b80b25f0 msgr2=0x7f79b80d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:50.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.886+0000 7f79bd600640 1 -- 172.21.15.42:0/2936224077 shutdown_connections 2024-09-17T01:42:50.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.886+0000 7f79bd600640 1 -- 172.21.15.42:0/2936224077 wait complete. 2024-09-17T01:42:50.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.888+0000 7f79bd600640 1 Processor -- start 2024-09-17T01:42:50.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.888+0000 7f79bd600640 1 -- start start 2024-09-17T01:42:50.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.889+0000 7f79bd600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f79b80b4be0 0x7f79b80747c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:50.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.890+0000 7f79bd600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79b80cf7c0 0x7f79b81f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:50.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.890+0000 7f79bd600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79b81f5fb0 0x7f79b815f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:50.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.890+0000 7f79bd600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f79b81535e0 con 0x7f79b80cf7c0 2024-09-17T01:42:50.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.890+0000 7f79bd600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f79b80b4340 con 0x7f79b81f5fb0 2024-09-17T01:42:50.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.890+0000 7f79bd600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f79b8153760 con 0x7f79b80b4be0 2024-09-17T01:42:50.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.890+0000 7f79b7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79b80cf7c0 0x7f79b81f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:50.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.890+0000 7f79b7e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f79b80b4be0 0x7f79b80747c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:50.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.890+0000 7f79b7e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f79b80b4be0 0x7f79b80747c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:42152/0 (socket says 172.21.15.42:42152) 2024-09-17T01:42:50.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.890+0000 7f79b7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79b80cf7c0 0x7f79b81f89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42544/0 (socket says 172.21.15.42:42544) 2024-09-17T01:42:50.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.890+0000 7f79b7e00640 1 -- 172.21.15.42:0/3063901918 learned_addr learned my addr 172.21.15.42:0/3063901918 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:50.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.890+0000 7f79bcc00640 1 --2- 172.21.15.42:0/3063901918 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79b81f5fb0 0x7f79b815f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:50.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.890+0000 7f79b7400640 1 -- 172.21.15.42:0/3063901918 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f79b80b4be0 msgr2=0x7f79b80747c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:50.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.890+0000 7f79b7400640 1 --2- 172.21.15.42:0/3063901918 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f79b80b4be0 0x7f79b80747c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:50.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.890+0000 7f79b7400640 1 -- 172.21.15.42:0/3063901918 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79b81f5fb0 msgr2=0x7f79b815f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:50.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.890+0000 7f79b7400640 1 --2- 172.21.15.42:0/3063901918 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79b81f5fb0 0x7f79b815f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:50.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.890+0000 7f79b7400640 1 -- 172.21.15.42:0/3063901918 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b8151040 con 0x7f79b80cf7c0 2024-09-17T01:42:50.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.891+0000 7f79b7400640 1 --2- 172.21.15.42:0/3063901918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79b80cf7c0 0x7f79b81f89b0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f79a400c390 tx=0x7f79a400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:50.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.891+0000 7f79afe00640 1 -- 172.21.15.42:0/3063901918 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a4017070 con 0x7f79b80cf7c0 2024-09-17T01:42:50.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.891+0000 7f79afe00640 1 -- 172.21.15.42:0/3063901918 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79a40035f0 con 0x7f79b80cf7c0 2024-09-17T01:42:50.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.891+0000 7f79afe00640 1 -- 172.21.15.42:0/3063901918 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a4003a40 con 0x7f79b80cf7c0 2024-09-17T01:42:50.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.891+0000 7f79bd600640 1 -- 172.21.15.42:0/3063901918 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79b80af0c0 con 0x7f79b80cf7c0 2024-09-17T01:42:50.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.891+0000 7f79bd600640 1 -- 172.21.15.42:0/3063901918 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79b81f9520 con 0x7f79b80cf7c0 2024-09-17T01:42:50.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.892+0000 7f79bd600640 1 -- 172.21.15.42:0/3063901918 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79b815d6b0 con 0x7f79b80cf7c0 2024-09-17T01:42:50.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.894+0000 7f79afe00640 1 -- 172.21.15.42:0/3063901918 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f79a401a070 con 0x7f79b80cf7c0 2024-09-17T01:42:50.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.895+0000 7f79afe00640 1 --2- 172.21.15.42:0/3063901918 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7998078b90 0x7f799807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:50.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.895+0000 7f79afe00640 1 -- 172.21.15.42:0/3063901918 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 4943+0+0 (secure 0 0 0) 0x7f79a4099c10 con 0x7f79b80cf7c0 2024-09-17T01:42:50.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.896+0000 7f79b7e00640 1 --2- 172.21.15.42:0/3063901918 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7998078b90 0x7f799807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:50.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.897+0000 7f79b7e00640 1 --2- 172.21.15.42:0/3063901918 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7998078b90 0x7f799807b0a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f79a8005fd0 tx=0x7f79a8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:50.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:50.900+0000 7f79afe00640 1 -- 172.21.15.42:0/3063901918 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f79b815dbf0 con 0x7f79b80cf7c0 2024-09-17T01:42:51.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.095+0000 7f79bd600640 1 -- 172.21.15.42:0/3063901918 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f79b81f92b0 con 0x7f79b80cf7c0 2024-09-17T01:42:51.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.095+0000 7f79afe00640 1 -- 172.21.15.42:0/3063901918 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v55) ==== 59+0+2294 (secure 0 0 0) 0x7f79a4061cf0 con 0x7f79b80cf7c0 2024-09-17T01:42:51.094 INFO:teuthology.orchestra.run.smithi042.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T01:42:51.094 INFO:teuthology.orchestra.run.smithi042.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T01:42:51.094 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced client_mount_timeout 30 2024-09-17T01:42:51.094 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_client 20/20 2024-09-17T01:42:51.094 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_mgr 20/20 2024-09-17T01:42:51.094 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_ms 1/1 2024-09-17T01:42:51.094 INFO:teuthology.orchestra.run.smithi042.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T01:42:51.094 INFO:teuthology.orchestra.run.smithi042.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T01:42:51.094 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3683.959260 2024-09-17T01:42:51.095 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4350.010833 2024-09-17T01:42:51.095 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4316.776055 2024-09-17T01:42:51.095 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3885.595082 2024-09-17T01:42:51.095 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3602.000737 2024-09-17T01:42:51.095 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4883.364748 2024-09-17T01:42:51.095 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3752.484811 2024-09-17T01:42:51.095 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3775.035963 2024-09-17T01:42:51.095 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds 20/20 2024-09-17T01:42:51.095 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T01:42:51.095 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_ms 2/2 2024-09-17T01:42:51.095 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_frag true 2024-09-17T01:42:51.096 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_scatterstat true 2024-09-17T01:42:51.096 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T01:42:51.096 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_verify_scatter true 2024-09-17T01:42:51.096 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T01:42:51.096 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T01:42:51.096 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T01:42:51.096 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced client_mount_timeout 600 2024-09-17T01:42:51.096 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_client 20/20 2024-09-17T01:42:51.096 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_ms 1/1 2024-09-17T01:42:51.096 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T01:42:51.096 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T01:42:51.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.098+0000 7f79bd600640 1 -- 172.21.15.42:0/3063901918 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7998078b90 msgr2=0x7f799807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:51.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.098+0000 7f79bd600640 1 --2- 172.21.15.42:0/3063901918 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7998078b90 0x7f799807b0a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f79a8005fd0 tx=0x7f79a8004730 comp rx=0 tx=0).stop 2024-09-17T01:42:51.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.098+0000 7f79bd600640 1 -- 172.21.15.42:0/3063901918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79b80cf7c0 msgr2=0x7f79b81f89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:51.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.098+0000 7f79bd600640 1 --2- 172.21.15.42:0/3063901918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79b80cf7c0 0x7f79b81f89b0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f79a400c390 tx=0x7f79a400c850 comp rx=0 tx=0).stop 2024-09-17T01:42:51.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.098+0000 7f79bd600640 1 -- 172.21.15.42:0/3063901918 shutdown_connections 2024-09-17T01:42:51.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.098+0000 7f79bd600640 1 --2- 172.21.15.42:0/3063901918 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7998078b90 0x7f799807b0a0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:51.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.098+0000 7f79bd600640 1 --2- 172.21.15.42:0/3063901918 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79b81f5fb0 0x7f79b815f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:51.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.098+0000 7f79bd600640 1 --2- 172.21.15.42:0/3063901918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79b80cf7c0 0x7f79b81f89b0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:51.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.098+0000 7f79bd600640 1 --2- 172.21.15.42:0/3063901918 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f79b80b4be0 0x7f79b80747c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:51.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.098+0000 7f79bd600640 1 -- 172.21.15.42:0/3063901918 >> 172.21.15.42:0/3063901918 conn(0x7f79b80b25f0 msgr2=0x7f79b80c9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:51.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.098+0000 7f79bd600640 1 -- 172.21.15.42:0/3063901918 shutdown_connections 2024-09-17T01:42:51.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.098+0000 7f79bd600640 1 -- 172.21.15.42:0/3063901918 wait complete. 2024-09-17T01:42:51.104 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:42:51.108 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:42:51.123 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T01:42:51.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.398+0000 7f5ec2400640 1 -- 172.21.15.42:0/2293977571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ebc0cf7c0 msgr2=0x7f5ebc06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:51.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.398+0000 7f5ec2400640 1 --2- 172.21.15.42:0/2293977571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ebc0cf7c0 0x7f5ebc06cd20 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8009830 tx=0x7f5ea802a510 comp rx=0 tx=0).stop 2024-09-17T01:42:51.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.398+0000 7f5ec2400640 1 -- 172.21.15.42:0/2293977571 shutdown_connections 2024-09-17T01:42:51.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.398+0000 7f5ec2400640 1 --2- 172.21.15.42:0/2293977571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ebc0cf7c0 0x7f5ebc06cd20 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:51.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.398+0000 7f5ec2400640 1 --2- 172.21.15.42:0/2293977571 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ebc0b4be0 0x7f5ebc15d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:51.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.398+0000 7f5ec2400640 1 -- 172.21.15.42:0/2293977571 >> 172.21.15.42:0/2293977571 conn(0x7f5ebc0b25f0 msgr2=0x7f5ebc0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:51.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.398+0000 7f5ec2400640 1 -- 172.21.15.42:0/2293977571 shutdown_connections 2024-09-17T01:42:51.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.398+0000 7f5ec2400640 1 -- 172.21.15.42:0/2293977571 wait complete. 2024-09-17T01:42:51.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.400+0000 7f5ec2400640 1 Processor -- start 2024-09-17T01:42:51.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.400+0000 7f5ec2400640 1 -- start start 2024-09-17T01:42:51.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.402+0000 7f5ec2400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ebc06d260 0x7f5ebc0cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:51.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.402+0000 7f5ec2400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ebc0b4be0 0x7f5ebc0c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:51.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.402+0000 7f5ec2400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ebc0cf7c0 0x7f5ebc0c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:51.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.402+0000 7f5ec2400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5ebc1537f0 con 0x7f5ebc0cf7c0 2024-09-17T01:42:51.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.402+0000 7f5ec2400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5ebc0cfdc0 con 0x7f5ebc0b4be0 2024-09-17T01:42:51.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.402+0000 7f5ec2400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5ebc153970 con 0x7f5ebc06d260 2024-09-17T01:42:51.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.402+0000 7f5ec1a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ebc0cf7c0 0x7f5ebc0c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:51.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.402+0000 7f5ec1a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ebc0cf7c0 0x7f5ebc0c9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42552/0 (socket says 172.21.15.42:42552) 2024-09-17T01:42:51.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.402+0000 7f5ec1a00640 1 -- 172.21.15.42:0/761062751 learned_addr learned my addr 172.21.15.42:0/761062751 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:51.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.402+0000 7f5ebbe00640 1 --2- 172.21.15.42:0/761062751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ebc0b4be0 0x7f5ebc0c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:51.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.402+0000 7f5ec1000640 1 --2- 172.21.15.42:0/761062751 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ebc06d260 0x7f5ebc0cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:51.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.403+0000 7f5ec1a00640 1 -- 172.21.15.42:0/761062751 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ebc06d260 msgr2=0x7f5ebc0cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:51.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.403+0000 7f5ec1a00640 1 --2- 172.21.15.42:0/761062751 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ebc06d260 0x7f5ebc0cbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:51.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.403+0000 7f5ec1a00640 1 -- 172.21.15.42:0/761062751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ebc0b4be0 msgr2=0x7f5ebc0c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:51.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.403+0000 7f5ec1a00640 1 --2- 172.21.15.42:0/761062751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ebc0b4be0 0x7f5ebc0c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:51.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.403+0000 7f5ec1a00640 1 -- 172.21.15.42:0/761062751 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ebc150250 con 0x7f5ebc0cf7c0 2024-09-17T01:42:51.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.403+0000 7f5ec1a00640 1 --2- 172.21.15.42:0/761062751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ebc0cf7c0 0x7f5ebc0c9960 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400c730 tx=0x7f5eb400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:51.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.403+0000 7f5eb8c00640 1 -- 172.21.15.42:0/761062751 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4017070 con 0x7f5ebc0cf7c0 2024-09-17T01:42:51.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.403+0000 7f5eb8c00640 1 -- 172.21.15.42:0/761062751 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5eb4003c60 con 0x7f5ebc0cf7c0 2024-09-17T01:42:51.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.403+0000 7f5ec2400640 1 -- 172.21.15.42:0/761062751 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ebc14ff70 con 0x7f5ebc0cf7c0 2024-09-17T01:42:51.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.403+0000 7f5eb8c00640 1 -- 172.21.15.42:0/761062751 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb40052d0 con 0x7f5ebc0cf7c0 2024-09-17T01:42:51.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.404+0000 7f5ec2400640 1 -- 172.21.15.42:0/761062751 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ebc1f9d10 con 0x7f5ebc0cf7c0 2024-09-17T01:42:51.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.405+0000 7f5ec2400640 1 -- 172.21.15.42:0/761062751 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ebc1f9850 con 0x7f5ebc0cf7c0 2024-09-17T01:42:51.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.406+0000 7f5eb8c00640 1 -- 172.21.15.42:0/761062751 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5eb401a070 con 0x7f5ebc0cf7c0 2024-09-17T01:42:51.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.407+0000 7f5eb8c00640 1 --2- 172.21.15.42:0/761062751 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5e9c078b90 0x7f5e9c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:51.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.407+0000 7f5eb8c00640 1 -- 172.21.15.42:0/761062751 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 4943+0+0 (secure 0 0 0) 0x7f5eb409a0c0 con 0x7f5ebc0cf7c0 2024-09-17T01:42:51.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.408+0000 7f5ec1000640 1 --2- 172.21.15.42:0/761062751 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5e9c078b90 0x7f5e9c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:51.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.408+0000 7f5ec1000640 1 --2- 172.21.15.42:0/761062751 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5e9c078b90 0x7f5e9c07b0a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000bb50 tx=0x7f5eb000b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:51.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.411+0000 7f5eb8c00640 1 -- 172.21.15.42:0/761062751 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5ebc1f9850 con 0x7f5ebc0cf7c0 2024-09-17T01:42:51.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.609+0000 7f5ec2400640 1 -- 172.21.15.42:0/761062751 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5ebc15d6b0 con 0x7f5ebc0cf7c0 2024-09-17T01:42:51.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.614+0000 7f5eb8c00640 1 -- 172.21.15.42:0/761062751 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v56)=0 v56) ==== 122+0+0 (secure 0 0 0) 0x7f5ebc15dbf0 con 0x7f5ebc0cf7c0 2024-09-17T01:42:51.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.616+0000 7f5ec2400640 1 -- 172.21.15.42:0/761062751 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5e9c078b90 msgr2=0x7f5e9c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:51.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.616+0000 7f5ec2400640 1 --2- 172.21.15.42:0/761062751 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5e9c078b90 0x7f5e9c07b0a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000bb50 tx=0x7f5eb000b2e0 comp rx=0 tx=0).stop 2024-09-17T01:42:51.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.616+0000 7f5ec2400640 1 -- 172.21.15.42:0/761062751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ebc0cf7c0 msgr2=0x7f5ebc0c9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:51.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.616+0000 7f5ec2400640 1 --2- 172.21.15.42:0/761062751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ebc0cf7c0 0x7f5ebc0c9960 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400c730 tx=0x7f5eb400cbf0 comp rx=0 tx=0).stop 2024-09-17T01:42:51.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.616+0000 7f5ec2400640 1 -- 172.21.15.42:0/761062751 shutdown_connections 2024-09-17T01:42:51.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.616+0000 7f5ec2400640 1 --2- 172.21.15.42:0/761062751 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5e9c078b90 0x7f5e9c07b0a0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:51.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.616+0000 7f5ec2400640 1 --2- 172.21.15.42:0/761062751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ebc0b4be0 0x7f5ebc0c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:51.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.616+0000 7f5ec2400640 1 --2- 172.21.15.42:0/761062751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5ebc0cf7c0 0x7f5ebc0c9960 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:51.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.616+0000 7f5ec2400640 1 --2- 172.21.15.42:0/761062751 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5ebc06d260 0x7f5ebc0cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:51.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.616+0000 7f5ec2400640 1 -- 172.21.15.42:0/761062751 >> 172.21.15.42:0/761062751 conn(0x7f5ebc0b25f0 msgr2=0x7f5ebc15fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:51.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.617+0000 7f5ec2400640 1 -- 172.21.15.42:0/761062751 shutdown_connections 2024-09-17T01:42:51.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:51.617+0000 7f5ec2400640 1 -- 172.21.15.42:0/761062751 wait complete. 2024-09-17T01:42:51.642 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:42:51.642 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:42:51.731 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:42:51.830 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:42:51.830 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:42:51.830 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:42:51.866 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:42:51.867 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:42:51.867 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:42:51.905 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:42:51.906 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:42:51.906 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:42:51.942 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:42:51.943 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:42:51.943 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:42:51.981 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:42:51.981 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T01:42:51.981 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:42:52.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.212+0000 7fd2a9e00640 1 -- 172.21.15.42:0/1524171144 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd2a4074500 msgr2=0x7fd2a406eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:52.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.212+0000 7fd2a9e00640 1 --2- 172.21.15.42:0/1524171144 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd2a4074500 0x7fd2a406eec0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009860 tx=0x7fd28c02a5a0 comp rx=0 tx=0).stop 2024-09-17T01:42:52.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.212+0000 7fd2a9e00640 1 -- 172.21.15.42:0/1524171144 shutdown_connections 2024-09-17T01:42:52.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.212+0000 7fd2a9e00640 1 --2- 172.21.15.42:0/1524171144 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd2a4074500 0x7fd2a406eec0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:52.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.212+0000 7fd2a9e00640 1 -- 172.21.15.42:0/1524171144 >> 172.21.15.42:0/1524171144 conn(0x7fd2a40b2930 msgr2=0x7fd2a406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:52.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.212+0000 7fd2a9e00640 1 -- 172.21.15.42:0/1524171144 shutdown_connections 2024-09-17T01:42:52.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.212+0000 7fd2a9e00640 1 -- 172.21.15.42:0/1524171144 wait complete. 2024-09-17T01:42:52.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.215+0000 7fd2a9e00640 1 Processor -- start 2024-09-17T01:42:52.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.215+0000 7fd2a9e00640 1 -- start start 2024-09-17T01:42:52.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.216+0000 7fd2a9e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2a406f400 0x7fd2a414ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:52.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.216+0000 7fd2a9e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd2a40740f0 0x7fd2a41e97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:52.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.216+0000 7fd2a9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd2a414f6b0 0x7fd2a41e9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:52.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.216+0000 7fd2a9e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a40cf2d0 con 0x7fd2a414f6b0 2024-09-17T01:42:52.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.216+0000 7fd2a9e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a40cf150 con 0x7fd2a406f400 2024-09-17T01:42:52.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.216+0000 7fd2a9e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd2a40cf450 con 0x7fd2a40740f0 2024-09-17T01:42:52.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.216+0000 7fd2a3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd2a414f6b0 0x7fd2a41e9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:52.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.216+0000 7fd2a3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd2a414f6b0 0x7fd2a41e9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42568/0 (socket says 172.21.15.42:42568) 2024-09-17T01:42:52.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.216+0000 7fd2a3400640 1 -- 172.21.15.42:0/3359664669 learned_addr learned my addr 172.21.15.42:0/3359664669 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:52.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.217+0000 7fd2a2a00640 1 --2- 172.21.15.42:0/3359664669 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2a406f400 0x7fd2a414ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:52.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.217+0000 7fd29a000640 1 --2- 172.21.15.42:0/3359664669 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd2a40740f0 0x7fd2a41e97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:52.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.217+0000 7fd2a3400640 1 -- 172.21.15.42:0/3359664669 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd2a40740f0 msgr2=0x7fd2a41e97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:52.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.217+0000 7fd2a3400640 1 --2- 172.21.15.42:0/3359664669 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd2a40740f0 0x7fd2a41e97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:52.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.217+0000 7fd2a3400640 1 -- 172.21.15.42:0/3359664669 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2a406f400 msgr2=0x7fd2a414ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:52.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.217+0000 7fd2a3400640 1 --2- 172.21.15.42:0/3359664669 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2a406f400 0x7fd2a414ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:52.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.217+0000 7fd2a3400640 1 -- 172.21.15.42:0/3359664669 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a4150160 con 0x7fd2a414f6b0 2024-09-17T01:42:52.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.217+0000 7fd2a2a00640 1 --2- 172.21.15.42:0/3359664669 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2a406f400 0x7fd2a414ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:42:52.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.217+0000 7fd29a000640 1 --2- 172.21.15.42:0/3359664669 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd2a40740f0 0x7fd2a41e97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:42:52.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.217+0000 7fd2a3400640 1 --2- 172.21.15.42:0/3359664669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd2a414f6b0 0x7fd2a41e9cf0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fd29c00cac0 tx=0x7fd29c00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:52.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.217+0000 7fd29be00640 1 -- 172.21.15.42:0/3359664669 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c016020 con 0x7fd2a414f6b0 2024-09-17T01:42:52.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.217+0000 7fd29be00640 1 -- 172.21.15.42:0/3359664669 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd29c00ad40 con 0x7fd2a414f6b0 2024-09-17T01:42:52.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.217+0000 7fd2a9e00640 1 -- 172.21.15.42:0/3359664669 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2a4150440 con 0x7fd2a414f6b0 2024-09-17T01:42:52.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.218+0000 7fd29be00640 1 -- 172.21.15.42:0/3359664669 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c012680 con 0x7fd2a414f6b0 2024-09-17T01:42:52.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.218+0000 7fd2a9e00640 1 -- 172.21.15.42:0/3359664669 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2a4156480 con 0x7fd2a414f6b0 2024-09-17T01:42:52.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.219+0000 7fd2a9e00640 1 -- 172.21.15.42:0/3359664669 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2a40cec60 con 0x7fd2a414f6b0 2024-09-17T01:42:52.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.220+0000 7fd29be00640 1 -- 172.21.15.42:0/3359664669 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd29c019020 con 0x7fd2a414f6b0 2024-09-17T01:42:52.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.221+0000 7fd29be00640 1 --2- 172.21.15.42:0/3359664669 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd280078bc0 0x7fd28007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:52.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.221+0000 7fd29be00640 1 -- 172.21.15.42:0/3359664669 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 4943+0+0 (secure 0 0 0) 0x7fd29c09b0d0 con 0x7fd2a414f6b0 2024-09-17T01:42:52.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.221+0000 7fd2a2a00640 1 --2- 172.21.15.42:0/3359664669 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd280078bc0 0x7fd28007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:52.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.222+0000 7fd2a2a00640 1 --2- 172.21.15.42:0/3359664669 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd280078bc0 0x7fd28007b0d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd294007fd0 tx=0x7fd294009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:52.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.225+0000 7fd29be00640 1 -- 172.21.15.42:0/3359664669 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd2a40cec60 con 0x7fd2a414f6b0 2024-09-17T01:42:52.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.459+0000 7fd2a9e00640 1 -- 172.21.15.42:0/3359664669 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2a4074500 con 0x7fd2a414f6b0 2024-09-17T01:42:52.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.460+0000 7fd29be00640 1 -- 172.21.15.42:0/3359664669 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) ==== 95+0+3916 (secure 0 0 0) 0x7fd29c020020 con 0x7fd2a414f6b0 2024-09-17T01:42:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:52.458 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":109,"btime":"2024-09-17T01:42:44:309513+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7154,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2491855232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2491855232},{"type":"v1","addr":"172.21.15.43:6835","nonce":2491855232}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4136787983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":4136787983},{"type":"v1","addr":"172.21.15.43:6837","nonce":4136787983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":102},{"gid":8439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/3441664627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3441664627},{"type":"v1","addr":"172.21.15.42:6834","nonce":3441664627}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":101},{"gid":8883,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3927045216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3927045216},{"type":"v1","addr":"172.21.15.42:6835","nonce":3927045216}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":109}],"filesystems":[]} 2024-09-17T01:42:52.458 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 109 2024-09-17T01:42:52.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.462+0000 7fd2a9e00640 1 -- 172.21.15.42:0/3359664669 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd280078bc0 msgr2=0x7fd28007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:52.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.462+0000 7fd2a9e00640 1 --2- 172.21.15.42:0/3359664669 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd280078bc0 0x7fd28007b0d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd294007fd0 tx=0x7fd294009040 comp rx=0 tx=0).stop 2024-09-17T01:42:52.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.462+0000 7fd2a9e00640 1 -- 172.21.15.42:0/3359664669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd2a414f6b0 msgr2=0x7fd2a41e9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:52.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.462+0000 7fd2a9e00640 1 --2- 172.21.15.42:0/3359664669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd2a414f6b0 0x7fd2a41e9cf0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fd29c00cac0 tx=0x7fd29c00cf80 comp rx=0 tx=0).stop 2024-09-17T01:42:52.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.462+0000 7fd2a9e00640 1 -- 172.21.15.42:0/3359664669 shutdown_connections 2024-09-17T01:42:52.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.462+0000 7fd2a9e00640 1 --2- 172.21.15.42:0/3359664669 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd280078bc0 0x7fd28007b0d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:52.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.462+0000 7fd2a9e00640 1 --2- 172.21.15.42:0/3359664669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd2a414f6b0 0x7fd2a41e9cf0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:52.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.462+0000 7fd2a9e00640 1 --2- 172.21.15.42:0/3359664669 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd2a40740f0 0x7fd2a41e97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:52.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.462+0000 7fd2a9e00640 1 --2- 172.21.15.42:0/3359664669 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2a406f400 0x7fd2a414ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:52.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.462+0000 7fd2a9e00640 1 -- 172.21.15.42:0/3359664669 >> 172.21.15.42:0/3359664669 conn(0x7fd2a40b2930 msgr2=0x7fd2a406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:52.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.462+0000 7fd2a9e00640 1 -- 172.21.15.42:0/3359664669 shutdown_connections 2024-09-17T01:42:52.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.462+0000 7fd2a9e00640 1 -- 172.21.15.42:0/3359664669 wait complete. 2024-09-17T01:42:52.484 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T01:42:52.484 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T01:42:52.484 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T01:42:52.485 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:42:52.485 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T01:42:52.485 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T01:42:52.485 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T01:42:52.485 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:42:52.485 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T01:42:52.485 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T01:42:52.486 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T01:42:52.486 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:42:52.486 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T01:42:52.486 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T01:42:52.486 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T01:42:52.486 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:42:52.510 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T01:42:52.510 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T01:42:52.511 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T01:42:52.511 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T01:42:52.515 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T01:42:52.515 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T01:42:52.516 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T01:42:52.516 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T01:42:52.555 INFO:tasks.ceph.mds.b:Started 2024-09-17T01:42:52.555 DEBUG:teuthology.parallel:result is None 2024-09-17T01:42:52.557 INFO:tasks.ceph.mds.d:Started 2024-09-17T01:42:52.557 DEBUG:teuthology.parallel:result is None 2024-09-17T01:42:52.559 INFO:tasks.ceph.mds.a:Started 2024-09-17T01:42:52.559 DEBUG:teuthology.parallel:result is None 2024-09-17T01:42:52.562 INFO:tasks.ceph.mds.c:Started 2024-09-17T01:42:52.562 DEBUG:teuthology.parallel:result is None 2024-09-17T01:42:52.562 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T01:42:52.757 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-09-17T01:42:52.758 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-09-17T01:42:52.759 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:42:52.760 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:42:52.760 INFO:tasks.ceph.mds.b.smithi043.stderr:2024-09-17T01:42:52.762+0000 7f81b0c00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-17T01:42:52.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.803+0000 7fba1f200640 1 -- 172.21.15.42:0/129451523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba201624f0 msgr2=0x7fba20162900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:52.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.803+0000 7fba1f200640 1 --2- 172.21.15.42:0/129451523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba201624f0 0x7fba20162900 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fba18009ca0 tx=0x7fba1802aa30 comp rx=0 tx=0).stop 2024-09-17T01:42:52.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.803+0000 7fba1f200640 1 -- 172.21.15.42:0/129451523 shutdown_connections 2024-09-17T01:42:52.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.803+0000 7fba1f200640 1 --2- 172.21.15.42:0/129451523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba201624f0 0x7fba20162900 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:52.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.803+0000 7fba1f200640 1 --2- 172.21.15.42:0/129451523 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba200b5320 0x7fba20155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:52.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.803+0000 7fba1f200640 1 -- 172.21.15.42:0/129451523 >> 172.21.15.42:0/129451523 conn(0x7fba20070360 msgr2=0x7fba20070770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:52.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.803+0000 7fba1f200640 1 -- 172.21.15.42:0/129451523 shutdown_connections 2024-09-17T01:42:52.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.803+0000 7fba1f200640 1 -- 172.21.15.42:0/129451523 wait complete. 2024-09-17T01:42:52.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.805+0000 7fba1f200640 1 Processor -- start 2024-09-17T01:42:52.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.805+0000 7fba1f200640 1 -- start start 2024-09-17T01:42:52.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.807+0000 7fba1f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba2006df40 0x7fba200b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:52.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.807+0000 7fba1f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba200b5320 0x7fba2014d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:52.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.807+0000 7fba1f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba201624f0 0x7fba20159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:52.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.807+0000 7fba1f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fba200b70b0 con 0x7fba200b5320 2024-09-17T01:42:52.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.807+0000 7fba1f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fba200b6f30 con 0x7fba201624f0 2024-09-17T01:42:52.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.807+0000 7fba1f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fba200b7230 con 0x7fba2006df40 2024-09-17T01:42:52.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.807+0000 7fba17e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba200b5320 0x7fba2014d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:52.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.807+0000 7fba1de00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba2006df40 0x7fba200b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:52.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.807+0000 7fba1e800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba201624f0 0x7fba20159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:52.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.807+0000 7fba17e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba200b5320 0x7fba2014d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42632/0 (socket says 172.21.15.42:42632) 2024-09-17T01:42:52.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.807+0000 7fba17e00640 1 -- 172.21.15.42:0/2076672831 learned_addr learned my addr 172.21.15.42:0/2076672831 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:52.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.808+0000 7fba1e800640 1 -- 172.21.15.42:0/2076672831 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba2006df40 msgr2=0x7fba200b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:52.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.808+0000 7fba1e800640 1 --2- 172.21.15.42:0/2076672831 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba2006df40 0x7fba200b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:52.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.808+0000 7fba1e800640 1 -- 172.21.15.42:0/2076672831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba200b5320 msgr2=0x7fba2014d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:52.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.808+0000 7fba1e800640 1 --2- 172.21.15.42:0/2076672831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba200b5320 0x7fba2014d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:52.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.808+0000 7fba1e800640 1 -- 172.21.15.42:0/2076672831 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba200b22a0 con 0x7fba201624f0 2024-09-17T01:42:52.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.808+0000 7fba17e00640 1 --2- 172.21.15.42:0/2076672831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba200b5320 0x7fba2014d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:42:52.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.808+0000 7fba1e800640 1 --2- 172.21.15.42:0/2076672831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba201624f0 0x7fba20159eb0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fba18032000 tx=0x7fba18003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:52.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.808+0000 7fba16000640 1 -- 172.21.15.42:0/2076672831 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba18046070 con 0x7fba201624f0 2024-09-17T01:42:52.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.808+0000 7fba16000640 1 -- 172.21.15.42:0/2076672831 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba18004600 con 0x7fba201624f0 2024-09-17T01:42:52.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.808+0000 7fba16000640 1 -- 172.21.15.42:0/2076672831 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba18033070 con 0x7fba201624f0 2024-09-17T01:42:52.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.808+0000 7fba1f200640 1 -- 172.21.15.42:0/2076672831 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba200b2580 con 0x7fba201624f0 2024-09-17T01:42:52.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.809+0000 7fba1f200640 1 -- 172.21.15.42:0/2076672831 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba201510f0 con 0x7fba201624f0 2024-09-17T01:42:52.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.810+0000 7fba1f200640 1 -- 172.21.15.42:0/2076672831 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba200b76e0 con 0x7fba201624f0 2024-09-17T01:42:52.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.811+0000 7fba16000640 1 -- 172.21.15.42:0/2076672831 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fba18049070 con 0x7fba201624f0 2024-09-17T01:42:52.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.812+0000 7fba16000640 1 --2- 172.21.15.42:0/2076672831 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb9fc078bc0 0x7fb9fc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:52.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.812+0000 7fba16000640 1 -- 172.21.15.42:0/2076672831 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 4943+0+0 (secure 0 0 0) 0x7fba180bbad0 con 0x7fba201624f0 2024-09-17T01:42:52.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.812+0000 7fba1de00640 1 --2- 172.21.15.42:0/2076672831 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb9fc078bc0 0x7fb9fc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:52.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.813+0000 7fba1de00640 1 --2- 172.21.15.42:0/2076672831 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb9fc078bc0 0x7fb9fc07b0d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fba10005fd0 tx=0x7fba1000b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:52.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:52.817+0000 7fba16000640 1 -- 172.21.15.42:0/2076672831 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fba1803e070 con 0x7fba201624f0 2024-09-17T01:42:53.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.022+0000 7fba1f200640 1 -- 172.21.15.42:0/2076672831 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fba200b10a0 con 0x7fba201624f0 2024-09-17T01:42:53.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.649+0000 7fba16000640 1 -- 172.21.15.42:0/2076672831 <== mon.1 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v141) ==== 97+0+0 (secure 0 0 0) 0x7fba18083c30 con 0x7fba201624f0 2024-09-17T01:42:53.647 INFO:teuthology.orchestra.run.smithi042.stderr: removed all blocklist entries 2024-09-17T01:42:53.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.652+0000 7fba1f200640 1 -- 172.21.15.42:0/2076672831 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb9fc078bc0 msgr2=0x7fb9fc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:53.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.652+0000 7fba1f200640 1 --2- 172.21.15.42:0/2076672831 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb9fc078bc0 0x7fb9fc07b0d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fba10005fd0 tx=0x7fba1000b2e0 comp rx=0 tx=0).stop 2024-09-17T01:42:53.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.652+0000 7fba1f200640 1 -- 172.21.15.42:0/2076672831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba201624f0 msgr2=0x7fba20159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:53.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.652+0000 7fba1f200640 1 --2- 172.21.15.42:0/2076672831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba201624f0 0x7fba20159eb0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fba18032000 tx=0x7fba18003f90 comp rx=0 tx=0).stop 2024-09-17T01:42:53.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.652+0000 7fba1f200640 1 -- 172.21.15.42:0/2076672831 shutdown_connections 2024-09-17T01:42:53.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.652+0000 7fba1f200640 1 --2- 172.21.15.42:0/2076672831 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb9fc078bc0 0x7fb9fc07b0d0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:53.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.652+0000 7fba1f200640 1 --2- 172.21.15.42:0/2076672831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba201624f0 0x7fba20159eb0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:53.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.652+0000 7fba1f200640 1 --2- 172.21.15.42:0/2076672831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba200b5320 0x7fba2014d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:53.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.652+0000 7fba1f200640 1 --2- 172.21.15.42:0/2076672831 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba2006df40 0x7fba200b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:53.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.652+0000 7fba1f200640 1 -- 172.21.15.42:0/2076672831 >> 172.21.15.42:0/2076672831 conn(0x7fba20070360 msgr2=0x7fba2006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:53.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.652+0000 7fba1f200640 1 -- 172.21.15.42:0/2076672831 shutdown_connections 2024-09-17T01:42:53.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.652+0000 7fba1f200640 1 -- 172.21.15.42:0/2076672831 wait complete. 2024-09-17T01:42:53.679 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T01:42:53.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.910+0000 7f6f1c000640 1 -- 172.21.15.42:0/2297973439 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f14073df0 msgr2=0x7f6f14074200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:53.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.910+0000 7f6f1c000640 1 --2- 172.21.15.42:0/2297973439 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f14073df0 0x7f6f14074200 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009830 tx=0x7f6f0c02a480 comp rx=0 tx=0).stop 2024-09-17T01:42:53.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.910+0000 7f6f1c000640 1 -- 172.21.15.42:0/2297973439 shutdown_connections 2024-09-17T01:42:53.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.910+0000 7f6f1c000640 1 --2- 172.21.15.42:0/2297973439 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f14073df0 0x7f6f14074200 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:53.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.910+0000 7f6f1c000640 1 --2- 172.21.15.42:0/2297973439 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f1406ee90 0x7f6f1415f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:53.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.910+0000 7f6f1c000640 1 -- 172.21.15.42:0/2297973439 >> 172.21.15.42:0/2297973439 conn(0x7f6f140b2930 msgr2=0x7f6f1406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:53.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.911+0000 7f6f1c000640 1 -- 172.21.15.42:0/2297973439 shutdown_connections 2024-09-17T01:42:53.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.911+0000 7f6f1c000640 1 -- 172.21.15.42:0/2297973439 wait complete. 2024-09-17T01:42:53.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.913+0000 7f6f1c000640 1 Processor -- start 2024-09-17T01:42:53.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.913+0000 7f6f1c000640 1 -- start start 2024-09-17T01:42:53.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.914+0000 7f6f1c000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f1406ee90 0x7f6f14159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:53.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.915+0000 7f6f1c000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1406f2a0 0x7f6f14147d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:53.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.915+0000 7f6f1c000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f14073df0 0x7f6f14159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:53.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.915+0000 7f6f1c000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6f140cef40 con 0x7f6f1406f2a0 2024-09-17T01:42:53.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.915+0000 7f6f1c000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6f14162ae0 con 0x7f6f1406ee90 2024-09-17T01:42:53.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.915+0000 7f6f1c000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6f140cf0c0 con 0x7f6f14073df0 2024-09-17T01:42:53.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.915+0000 7f6f18c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1406f2a0 0x7f6f14147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:53.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.915+0000 7f6f18c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1406f2a0 0x7f6f14147d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42640/0 (socket says 172.21.15.42:42640) 2024-09-17T01:42:53.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.915+0000 7f6f18c00640 1 -- 172.21.15.42:0/558373437 learned_addr learned my addr 172.21.15.42:0/558373437 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:53.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.915+0000 7f6f19600640 1 --2- 172.21.15.42:0/558373437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f1406ee90 0x7f6f14159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:53.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.915+0000 7f6f1a000640 1 --2- 172.21.15.42:0/558373437 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f14073df0 0x7f6f14159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:53.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.915+0000 7f6f18c00640 1 -- 172.21.15.42:0/558373437 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f14073df0 msgr2=0x7f6f14159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:53.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.915+0000 7f6f18c00640 1 --2- 172.21.15.42:0/558373437 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f14073df0 0x7f6f14159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:53.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.915+0000 7f6f18c00640 1 -- 172.21.15.42:0/558373437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f1406ee90 msgr2=0x7f6f14159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:53.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.915+0000 7f6f18c00640 1 --2- 172.21.15.42:0/558373437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f1406ee90 0x7f6f14159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:53.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.915+0000 7f6f18c00640 1 -- 172.21.15.42:0/558373437 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f14159a70 con 0x7f6f1406f2a0 2024-09-17T01:42:53.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.915+0000 7f6f19600640 1 --2- 172.21.15.42:0/558373437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f1406ee90 0x7f6f14159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:42:53.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.916+0000 7f6f18c00640 1 --2- 172.21.15.42:0/558373437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1406f2a0 0x7f6f14147d50 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000c3a0 tx=0x7f6f0000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:53.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.916+0000 7f6f11600640 1 -- 172.21.15.42:0/558373437 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f00011790 con 0x7f6f1406f2a0 2024-09-17T01:42:53.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.916+0000 7f6f11600640 1 -- 172.21.15.42:0/558373437 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f00017070 con 0x7f6f1406f2a0 2024-09-17T01:42:53.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.916+0000 7f6f11600640 1 -- 172.21.15.42:0/558373437 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f00011cc0 con 0x7f6f1406f2a0 2024-09-17T01:42:53.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.916+0000 7f6f1c000640 1 -- 172.21.15.42:0/558373437 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f141f6c30 con 0x7f6f1406f2a0 2024-09-17T01:42:53.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.916+0000 7f6f1c000640 1 -- 172.21.15.42:0/558373437 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f14158d30 con 0x7f6f1406f2a0 2024-09-17T01:42:53.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.917+0000 7f6f1c000640 1 -- 172.21.15.42:0/558373437 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f141f69a0 con 0x7f6f1406f2a0 2024-09-17T01:42:53.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.919+0000 7f6f11600640 1 -- 172.21.15.42:0/558373437 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6f0001c460 con 0x7f6f1406f2a0 2024-09-17T01:42:53.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.919+0000 7f6f11600640 1 --2- 172.21.15.42:0/558373437 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6ef4078b90 0x7f6ef407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:53.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.920+0000 7f6f11600640 1 -- 172.21.15.42:0/558373437 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4857+0+0 (secure 0 0 0) 0x7f6f0009a870 con 0x7f6f1406f2a0 2024-09-17T01:42:53.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.920+0000 7f6f19600640 1 --2- 172.21.15.42:0/558373437 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6ef4078b90 0x7f6ef407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:53.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.921+0000 7f6f19600640 1 --2- 172.21.15.42:0/558373437 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6ef4078b90 0x7f6ef407b0a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6f08005fd0 tx=0x7f6f08009500 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:53.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:53.924+0000 7f6f11600640 1 -- 172.21.15.42:0/558373437 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6f14074740 con 0x7f6f1406f2a0 2024-09-17T01:42:54.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.190+0000 7f6f1c000640 1 -- 172.21.15.42:0/558373437 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f6f1415f200 con 0x7f6f1406f2a0 2024-09-17T01:42:54.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.191+0000 7f6f11600640 1 -- 172.21.15.42:0/558373437 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v37) ==== 80+0+5304 (secure 0 0 0) 0x7f6f00062f60 con 0x7f6f1406f2a0 2024-09-17T01:42:54.225 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:54.225 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:42:54.225 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_dump": [ 2024-09-17T01:42:54.225 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:42:54.225 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.a", 2024-09-17T01:42:54.225 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmyJK4HRAAIC4E4V7p1fqIEfPIICMxZg==", 2024-09-17T01:42:54.225 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:42:54.225 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:42:54.226 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:42:54.226 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:42:54.226 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:42:54.226 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:54.226 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:42:54.226 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:42:54.226 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.b", 2024-09-17T01:42:54.226 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmXv3vORAALPrYIM6Vtz0g1pOxVhrUig==", 2024-09-17T01:42:54.226 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:42:54.226 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:42:54.226 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:42:54.226 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:42:54.226 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:42:54.227 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:54.227 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:42:54.227 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:42:54.227 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.c", 2024-09-17T01:42:54.227 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmPE7MKxAA9mGG+EO9C3VGVMerOm92+Q==", 2024-09-17T01:42:54.227 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:42:54.227 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:42:54.227 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:42:54.227 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:42:54.227 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:42:54.227 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:54.227 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:42:54.227 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:42:54.228 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.d", 2024-09-17T01:42:54.228 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmaOBSDBAATU4tpjM5IMcuvzZFE7N5bQ==", 2024-09-17T01:42:54.228 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:42:54.228 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:42:54.228 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:42:54.228 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:42:54.228 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:42:54.228 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:54.228 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:42:54.228 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:42:54.228 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.0", 2024-09-17T01:42:54.228 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDP2+hmEJebExAAAdGEoSzM96ybGT9h7t7OkA==", 2024-09-17T01:42:54.228 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:42:54.229 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:42:54.229 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:42:54.229 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:42:54.229 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:54.229 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:42:54.229 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:42:54.229 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.1", 2024-09-17T01:42:54.229 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDS2+hm7dWoMBAAagktrUl0O2/mgKCEfpAstA==", 2024-09-17T01:42:54.229 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:42:54.229 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:42:54.229 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:42:54.229 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:42:54.230 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:54.230 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:42:54.230 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:42:54.230 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.2", 2024-09-17T01:42:54.230 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDW2+hmEfSPBBAAPAa6EZt27yUcJSfZyCKheg==", 2024-09-17T01:42:54.230 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:42:54.230 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:42:54.230 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:42:54.230 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:42:54.230 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:54.230 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:42:54.230 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:42:54.230 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.3", 2024-09-17T01:42:54.231 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDZ2+hmHQhXFRAAj84g+IKqH6KMP7LjRtFvLw==", 2024-09-17T01:42:54.231 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:42:54.231 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:42:54.231 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:42:54.231 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:42:54.231 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:54.231 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:42:54.231 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:42:54.231 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.4", 2024-09-17T01:42:54.231 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDd2+hmaNcMNBAAx1GV/oFdfssMjFWFN5M0VQ==", 2024-09-17T01:42:54.231 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:42:54.231 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:42:54.231 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:42:54.232 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:42:54.232 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:54.232 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:42:54.232 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:42:54.232 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.5", 2024-09-17T01:42:54.232 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDh2+hm301NJhAAnSUH5AAvqhPwM7loH6frww==", 2024-09-17T01:42:54.232 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:42:54.232 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:42:54.232 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:42:54.232 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:42:54.232 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:54.232 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:42:54.232 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:42:54.233 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.6", 2024-09-17T01:42:54.233 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDk2+hm61WNNRAAbCvVvsUpB4fgt4ja60DRZA==", 2024-09-17T01:42:54.233 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:42:54.233 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:42:54.233 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:42:54.233 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:42:54.233 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:54.233 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:42:54.233 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:42:54.233 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.7", 2024-09-17T01:42:54.233 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDo2+hmesiLFhAA29n1eageNvP+lkRyh6gGMw==", 2024-09-17T01:42:54.233 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:42:54.233 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:42:54.234 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:42:54.234 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:42:54.234 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:54.234 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:42:54.234 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:42:54.234 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.0", 2024-09-17T01:42:54.234 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA==", 2024-09-17T01:42:54.234 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:42:54.234 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:42:54.234 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow r", 2024-09-17T01:42:54.234 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T01:42:54.234 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:54.234 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:42:54.235 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:42:54.235 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.1", 2024-09-17T01:42:54.235 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmZLygLhAABlauZgnidFWvfCCPuBLObg==", 2024-09-17T01:42:54.235 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:42:54.235 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:42:54.235 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:42:54.235 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:42:54.235 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:42:54.235 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:54.235 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:42:54.235 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:42:54.235 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.2", 2024-09-17T01:42:54.235 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hm8lnZIxAAN0a2CVMMtu/Nz50OG4a02A==", 2024-09-17T01:42:54.235 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:42:54.236 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:42:54.236 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:42:54.236 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:42:54.236 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:42:54.236 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:54.236 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:42:54.236 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:42:54.236 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.3", 2024-09-17T01:42:54.236 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmgXdAORAAM5Uy66I4nnTJ9Vhkn9JoBw==", 2024-09-17T01:42:54.236 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:42:54.236 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:42:54.236 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:42:54.236 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:42:54.236 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:42:54.237 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:54.237 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:42:54.237 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:42:54.237 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.admin", 2024-09-17T01:42:54.237 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDL2+hmvCreHBAA4CSAhosssViGqD93U+I7Iw==", 2024-09-17T01:42:54.237 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:42:54.237 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:42:54.237 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:42:54.237 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:42:54.237 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:42:54.237 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:54.237 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:42:54.237 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:42:54.238 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.x", 2024-09-17T01:42:54.238 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmYPnlEhAAIcQ11ktWZyMXYdbAONiLog==", 2024-09-17T01:42:54.238 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:42:54.238 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:42:54.238 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:42:54.238 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:42:54.238 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:54.238 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:42:54.238 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:42:54.238 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.y", 2024-09-17T01:42:54.238 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmpCZtBxAAp5tXMc6aEq1aOny2LJZAiA==", 2024-09-17T01:42:54.238 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:42:54.238 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:42:54.238 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:42:54.239 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:42:54.239 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:54.239 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:54.239 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-17T01:42:54.239 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:42:54.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.193+0000 7f6f1c000640 1 -- 172.21.15.42:0/558373437 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6ef4078b90 msgr2=0x7f6ef407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:54.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.193+0000 7f6f1c000640 1 --2- 172.21.15.42:0/558373437 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6ef4078b90 0x7f6ef407b0a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6f08005fd0 tx=0x7f6f08009500 comp rx=0 tx=0).stop 2024-09-17T01:42:54.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.193+0000 7f6f1c000640 1 -- 172.21.15.42:0/558373437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1406f2a0 msgr2=0x7f6f14147d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:54.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.193+0000 7f6f1c000640 1 --2- 172.21.15.42:0/558373437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1406f2a0 0x7f6f14147d50 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000c3a0 tx=0x7f6f0000c860 comp rx=0 tx=0).stop 2024-09-17T01:42:54.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.193+0000 7f6f1c000640 1 -- 172.21.15.42:0/558373437 shutdown_connections 2024-09-17T01:42:54.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.193+0000 7f6f1c000640 1 --2- 172.21.15.42:0/558373437 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6ef4078b90 0x7f6ef407b0a0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:54.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.193+0000 7f6f1c000640 1 --2- 172.21.15.42:0/558373437 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f14073df0 0x7f6f14159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:54.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.193+0000 7f6f1c000640 1 --2- 172.21.15.42:0/558373437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1406f2a0 0x7f6f14147d50 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:54.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.193+0000 7f6f1c000640 1 --2- 172.21.15.42:0/558373437 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f1406ee90 0x7f6f14159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:54.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.193+0000 7f6f1c000640 1 -- 172.21.15.42:0/558373437 >> 172.21.15.42:0/558373437 conn(0x7f6f140b2930 msgr2=0x7f6f14160320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:54.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.194+0000 7f6f1c000640 1 -- 172.21.15.42:0/558373437 shutdown_connections 2024-09-17T01:42:54.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.194+0000 7f6f1c000640 1 -- 172.21.15.42:0/558373437 wait complete. 2024-09-17T01:42:54.242 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T01:42:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.470+0000 7f2af1600640 1 -- 172.21.15.42:0/3873049350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2aec0b3550 msgr2=0x7f2aec15cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.470+0000 7f2af1600640 1 --2- 172.21.15.42:0/3873049350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2aec0b3550 0x7f2aec15cec0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0b3110 tx=0x7f2adc02a4d0 comp rx=0 tx=0).stop 2024-09-17T01:42:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.471+0000 7f2af1600640 1 -- 172.21.15.42:0/3873049350 shutdown_connections 2024-09-17T01:42:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.471+0000 7f2af1600640 1 --2- 172.21.15.42:0/3873049350 >> v2:172.21.15.43:3300/0 conn(0x7f2aec072e90 0x7f2aec0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.471+0000 7f2af1600640 1 --2- 172.21.15.42:0/3873049350 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2aec142f40 0x7f2aec072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.471+0000 7f2af1600640 1 --2- 172.21.15.42:0/3873049350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2aec0b3550 0x7f2aec15cec0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.471+0000 7f2af1600640 1 -- 172.21.15.42:0/3873049350 >> 172.21.15.42:0/3873049350 conn(0x7f2aec0b2930 msgr2=0x7f2aec06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:54.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.471+0000 7f2af1600640 1 -- 172.21.15.42:0/3873049350 shutdown_connections 2024-09-17T01:42:54.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.471+0000 7f2af1600640 1 -- 172.21.15.42:0/3873049350 wait complete. 2024-09-17T01:42:54.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.473+0000 7f2af1600640 1 Processor -- start 2024-09-17T01:42:54.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.473+0000 7f2af1600640 1 -- start start 2024-09-17T01:42:54.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.475+0000 7f2af1600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2aec072e90 0x7f2aec157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:54.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.475+0000 7f2af1600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aec0b3550 0x7f2aec0ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:54.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.475+0000 7f2af1600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2aec142f40 0x7f2aec0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:54.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.475+0000 7f2af1600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec06d430 con 0x7f2aec142f40 2024-09-17T01:42:54.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.475+0000 7f2af1600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec0cf4d0 con 0x7f2aec0b3550 2024-09-17T01:42:54.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.475+0000 7f2af1600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2aec06d5b0 con 0x7f2aec072e90 2024-09-17T01:42:54.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.475+0000 7f2aeb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2aec142f40 0x7f2aec0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:54.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.475+0000 7f2aeaa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2aec072e90 0x7f2aec157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:54.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.475+0000 7f2aeb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2aec142f40 0x7f2aec0aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42662/0 (socket says 172.21.15.42:42662) 2024-09-17T01:42:54.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.475+0000 7f2aeb400640 1 -- 172.21.15.42:0/3687654741 learned_addr learned my addr 172.21.15.42:0/3687654741 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:54.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.475+0000 7f2aea000640 1 --2- 172.21.15.42:0/3687654741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aec0b3550 0x7f2aec0ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:54.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.475+0000 7f2aeb400640 1 -- 172.21.15.42:0/3687654741 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2aec072e90 msgr2=0x7f2aec157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:54.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.475+0000 7f2aeb400640 1 --2- 172.21.15.42:0/3687654741 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2aec072e90 0x7f2aec157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:54.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.475+0000 7f2aeb400640 1 -- 172.21.15.42:0/3687654741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aec0b3550 msgr2=0x7f2aec0ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:54.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.475+0000 7f2aeb400640 1 --2- 172.21.15.42:0/3687654741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aec0b3550 0x7f2aec0ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:54.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.475+0000 7f2aeb400640 1 -- 172.21.15.42:0/3687654741 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aec070190 con 0x7f2aec142f40 2024-09-17T01:42:54.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.476+0000 7f2aeb400640 1 --2- 172.21.15.42:0/3687654741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2aec142f40 0x7f2aec0aede0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f2ae400da10 tx=0x7f2ae400ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:54.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.476+0000 7f2ae2a00640 1 -- 172.21.15.42:0/3687654741 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4017070 con 0x7f2aec142f40 2024-09-17T01:42:54.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.476+0000 7f2ae2a00640 1 -- 172.21.15.42:0/3687654741 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ae4003970 con 0x7f2aec142f40 2024-09-17T01:42:54.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.476+0000 7f2ae2a00640 1 -- 172.21.15.42:0/3687654741 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae400be60 con 0x7f2aec142f40 2024-09-17T01:42:54.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.476+0000 7f2af1600640 1 -- 172.21.15.42:0/3687654741 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aec1581b0 con 0x7f2aec142f40 2024-09-17T01:42:54.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.476+0000 7f2af1600640 1 -- 172.21.15.42:0/3687654741 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aec06e6f0 con 0x7f2aec142f40 2024-09-17T01:42:54.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.477+0000 7f2af1600640 1 -- 172.21.15.42:0/3687654741 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aec06da60 con 0x7f2aec142f40 2024-09-17T01:42:54.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.478+0000 7f2ae2a00640 1 -- 172.21.15.42:0/3687654741 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2ae4010460 con 0x7f2aec142f40 2024-09-17T01:42:54.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.479+0000 7f2ae2a00640 1 --2- 172.21.15.42:0/3687654741 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2acc078b90 0x7f2acc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:54.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.479+0000 7f2ae2a00640 1 -- 172.21.15.42:0/3687654741 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4857+0+0 (secure 0 0 0) 0x7f2ae409add0 con 0x7f2aec142f40 2024-09-17T01:42:54.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.480+0000 7f2aeaa00640 1 --2- 172.21.15.42:0/3687654741 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2acc078b90 0x7f2acc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:54.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.481+0000 7f2aeaa00640 1 --2- 172.21.15.42:0/3687654741 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2acc078b90 0x7f2acc07b0a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2adc033000 tx=0x7f2adc004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:54.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.484+0000 7f2ae2a00640 1 -- 172.21.15.42:0/3687654741 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2ae4062f90 con 0x7f2aec142f40 2024-09-17T01:42:54.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.684+0000 7f2af1600640 1 -- 172.21.15.42:0/3687654741 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2aec1f62f0 con 0x7f2aec142f40 2024-09-17T01:42:54.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.685+0000 7f2ae2a00640 1 -- 172.21.15.42:0/3687654741 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v143) ==== 84+0+65 (secure 0 0 0) 0x7f2ae40679c0 con 0x7f2aec142f40 2024-09-17T01:42:54.683 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:54.683 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-09-17T01:42:54.683 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:42:54.683 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-09-17T01:42:54.683 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-09-17T01:42:54.683 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:42:54.683 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-09-17T01:42:54.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.687+0000 7f2af1600640 1 -- 172.21.15.42:0/3687654741 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2acc078b90 msgr2=0x7f2acc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:54.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.687+0000 7f2af1600640 1 --2- 172.21.15.42:0/3687654741 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2acc078b90 0x7f2acc07b0a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2adc033000 tx=0x7f2adc004730 comp rx=0 tx=0).stop 2024-09-17T01:42:54.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.687+0000 7f2af1600640 1 -- 172.21.15.42:0/3687654741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2aec142f40 msgr2=0x7f2aec0aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:54.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.687+0000 7f2af1600640 1 --2- 172.21.15.42:0/3687654741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2aec142f40 0x7f2aec0aede0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f2ae400da10 tx=0x7f2ae400ded0 comp rx=0 tx=0).stop 2024-09-17T01:42:54.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.688+0000 7f2af1600640 1 -- 172.21.15.42:0/3687654741 shutdown_connections 2024-09-17T01:42:54.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.688+0000 7f2af1600640 1 --2- 172.21.15.42:0/3687654741 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2acc078b90 0x7f2acc07b0a0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:54.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.688+0000 7f2af1600640 1 --2- 172.21.15.42:0/3687654741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aec0b3550 0x7f2aec0ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:54.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.688+0000 7f2af1600640 1 --2- 172.21.15.42:0/3687654741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2aec142f40 0x7f2aec0aede0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:54.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.688+0000 7f2af1600640 1 --2- 172.21.15.42:0/3687654741 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2aec072e90 0x7f2aec157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:54.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.688+0000 7f2af1600640 1 -- 172.21.15.42:0/3687654741 >> 172.21.15.42:0/3687654741 conn(0x7f2aec0b2930 msgr2=0x7f2aec06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:54.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.688+0000 7f2af1600640 1 -- 172.21.15.42:0/3687654741 shutdown_connections 2024-09-17T01:42:54.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.688+0000 7f2af1600640 1 -- 172.21.15.42:0/3687654741 wait complete. 2024-09-17T01:42:54.709 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T01:42:54.709 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T01:42:54.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.946+0000 7f551ac00640 1 -- 172.21.15.42:0/843156533 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f551406db40 msgr2=0x7f55140cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:54.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.946+0000 7f551ac00640 1 --2- 172.21.15.42:0/843156533 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f551406db40 0x7f55140cdf30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f550c005fd0 tx=0x7f550c02aaa0 comp rx=0 tx=0).stop 2024-09-17T01:42:54.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.946+0000 7f551ac00640 1 -- 172.21.15.42:0/843156533 shutdown_connections 2024-09-17T01:42:54.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.946+0000 7f551ac00640 1 --2- 172.21.15.42:0/843156533 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f551406db40 0x7f55140cdf30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:54.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.946+0000 7f551ac00640 1 --2- 172.21.15.42:0/843156533 >> v2:172.21.15.43:3300/0 conn(0x7f55140b56d0 0x7f55140b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:54.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.946+0000 7f551ac00640 1 -- 172.21.15.42:0/843156533 >> 172.21.15.42:0/843156533 conn(0x7f55140b28f0 msgr2=0x7f551406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:54.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.946+0000 7f551ac00640 1 -- 172.21.15.42:0/843156533 shutdown_connections 2024-09-17T01:42:54.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.946+0000 7f551ac00640 1 -- 172.21.15.42:0/843156533 wait complete. 2024-09-17T01:42:54.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.948+0000 7f551ac00640 1 Processor -- start 2024-09-17T01:42:54.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.949+0000 7f551ac00640 1 -- start start 2024-09-17T01:42:54.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.950+0000 7f551ac00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55140b56d0 0x7f55141363e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:54.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.950+0000 7f551ac00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55140cdb20 0x7f5514135aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:54.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.950+0000 7f551ac00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55140cc570 0x7f55140c5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:54.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.950+0000 7f551ac00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f551415d560 con 0x7f55140cc570 2024-09-17T01:42:54.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.950+0000 7f551ac00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f551415d3e0 con 0x7f55140cdb20 2024-09-17T01:42:54.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.950+0000 7f551ac00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f551415d6e0 con 0x7f55140b56d0 2024-09-17T01:42:54.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.950+0000 7f5518c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55140cc570 0x7f55140c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:54.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.950+0000 7f5518c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55140cc570 0x7f55140c5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:42676/0 (socket says 172.21.15.42:42676) 2024-09-17T01:42:54.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.950+0000 7f5513e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55140b56d0 0x7f55141363e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:54.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.951+0000 7f5518c00640 1 -- 172.21.15.42:0/1860705264 learned_addr learned my addr 172.21.15.42:0/1860705264 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:54.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.951+0000 7f5513400640 1 --2- 172.21.15.42:0/1860705264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55140cdb20 0x7f5514135aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:54.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.951+0000 7f5518c00640 1 -- 172.21.15.42:0/1860705264 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55140b56d0 msgr2=0x7f55141363e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:54.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.951+0000 7f5518c00640 1 --2- 172.21.15.42:0/1860705264 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55140b56d0 0x7f55141363e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:54.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.951+0000 7f5518c00640 1 -- 172.21.15.42:0/1860705264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55140cdb20 msgr2=0x7f5514135aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:54.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.951+0000 7f5518c00640 1 --2- 172.21.15.42:0/1860705264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55140cdb20 0x7f5514135aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:54.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.951+0000 7f5518c00640 1 -- 172.21.15.42:0/1860705264 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5514136920 con 0x7f55140cc570 2024-09-17T01:42:54.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.951+0000 7f5518c00640 1 --2- 172.21.15.42:0/1860705264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55140cc570 0x7f55140c5530 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f550c009d90 tx=0x7f550c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:54.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.952+0000 7f550be00640 1 -- 172.21.15.42:0/1860705264 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c044070 con 0x7f55140cc570 2024-09-17T01:42:54.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.952+0000 7f550be00640 1 -- 172.21.15.42:0/1860705264 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f550c004040 con 0x7f55140cc570 2024-09-17T01:42:54.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.952+0000 7f551ac00640 1 -- 172.21.15.42:0/1860705264 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55140c6240 con 0x7f55140cc570 2024-09-17T01:42:54.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.952+0000 7f550be00640 1 -- 172.21.15.42:0/1860705264 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c004430 con 0x7f55140cc570 2024-09-17T01:42:54.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.952+0000 7f551ac00640 1 -- 172.21.15.42:0/1860705264 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55140cba90 con 0x7f55140cc570 2024-09-17T01:42:54.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.953+0000 7f551ac00640 1 -- 172.21.15.42:0/1860705264 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f551415dc00 con 0x7f55140cc570 2024-09-17T01:42:54.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.954+0000 7f550be00640 1 -- 172.21.15.42:0/1860705264 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f550c047070 con 0x7f55140cc570 2024-09-17T01:42:54.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.956+0000 7f550be00640 1 --2- 172.21.15.42:0/1860705264 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f54f4078b90 0x7f54f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:54.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.956+0000 7f550be00640 1 -- 172.21.15.42:0/1860705264 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4857+0+0 (secure 0 0 0) 0x7f550c0bb8a0 con 0x7f55140cc570 2024-09-17T01:42:54.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.956+0000 7f5513e00640 1 --2- 172.21.15.42:0/1860705264 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f54f4078b90 0x7f54f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:54.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.957+0000 7f5513e00640 1 --2- 172.21.15.42:0/1860705264 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f54f4078b90 0x7f54f407b0a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5504009b30 tx=0x7f5504005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:54.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:54.960+0000 7f550be00640 1 -- 172.21.15.42:0/1860705264 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f550c032030 con 0x7f55140cc570 2024-09-17T01:42:55.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.153+0000 7f551ac00640 1 -- 172.21.15.42:0/1860705264 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f551415f0c0 con 0x7f55140cc570 2024-09-17T01:42:55.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.654+0000 7f550be00640 1 -- 172.21.15.42:0/1860705264 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v144) ==== 138+0+0 (secure 0 0 0) 0x7f550c0839e0 con 0x7f55140cc570 2024-09-17T01:42:55.652 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-09-17T01:42:55.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.657+0000 7f551ac00640 1 -- 172.21.15.42:0/1860705264 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f54f4078b90 msgr2=0x7f54f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:55.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.657+0000 7f551ac00640 1 --2- 172.21.15.42:0/1860705264 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f54f4078b90 0x7f54f407b0a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5504009b30 tx=0x7f5504005f90 comp rx=0 tx=0).stop 2024-09-17T01:42:55.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.657+0000 7f551ac00640 1 -- 172.21.15.42:0/1860705264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55140cc570 msgr2=0x7f55140c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:55.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.657+0000 7f551ac00640 1 --2- 172.21.15.42:0/1860705264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55140cc570 0x7f55140c5530 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f550c009d90 tx=0x7f550c003ce0 comp rx=0 tx=0).stop 2024-09-17T01:42:55.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.658+0000 7f551ac00640 1 -- 172.21.15.42:0/1860705264 shutdown_connections 2024-09-17T01:42:55.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.658+0000 7f551ac00640 1 --2- 172.21.15.42:0/1860705264 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f54f4078b90 0x7f54f407b0a0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:55.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.658+0000 7f551ac00640 1 --2- 172.21.15.42:0/1860705264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55140cdb20 0x7f5514135aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:55.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.658+0000 7f551ac00640 1 --2- 172.21.15.42:0/1860705264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55140cc570 0x7f55140c5530 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:55.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.658+0000 7f551ac00640 1 --2- 172.21.15.42:0/1860705264 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55140b56d0 0x7f55141363e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:55.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.658+0000 7f551ac00640 1 -- 172.21.15.42:0/1860705264 >> 172.21.15.42:0/1860705264 conn(0x7f55140b28f0 msgr2=0x7f551415f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:55.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.658+0000 7f551ac00640 1 -- 172.21.15.42:0/1860705264 shutdown_connections 2024-09-17T01:42:55.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.658+0000 7f551ac00640 1 -- 172.21.15.42:0/1860705264 wait complete. 2024-09-17T01:42:55.686 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T01:42:55.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.925+0000 7f9283c00640 1 -- 172.21.15.42:0/220210449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f927c142f40 msgr2=0x7f927c072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:55.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.925+0000 7f9283c00640 1 --2- 172.21.15.42:0/220210449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f927c142f40 0x7f927c072950 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9268005fd0 tx=0x7f926802a540 comp rx=0 tx=0).stop 2024-09-17T01:42:55.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.925+0000 7f9283c00640 1 -- 172.21.15.42:0/220210449 shutdown_connections 2024-09-17T01:42:55.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.925+0000 7f9283c00640 1 --2- 172.21.15.42:0/220210449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f927c142f40 0x7f927c072950 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:55.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.925+0000 7f9283c00640 1 --2- 172.21.15.42:0/220210449 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f927c0b3550 0x7f927c15cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:55.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.925+0000 7f9283c00640 1 -- 172.21.15.42:0/220210449 >> 172.21.15.42:0/220210449 conn(0x7f927c0b2930 msgr2=0x7f927c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:55.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.925+0000 7f9283c00640 1 -- 172.21.15.42:0/220210449 shutdown_connections 2024-09-17T01:42:55.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.925+0000 7f9283c00640 1 -- 172.21.15.42:0/220210449 wait complete. 2024-09-17T01:42:55.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.927+0000 7f9283c00640 1 Processor -- start 2024-09-17T01:42:55.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.927+0000 7f9283c00640 1 -- start start 2024-09-17T01:42:55.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.929+0000 7f9283c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f927c072e90 0x7f927c142000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:55.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.929+0000 7f9283c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f927c0b3550 0x7f927c0c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:55.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.929+0000 7f9283c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f927c142f40 0x7f927c0c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.929+0000 7f9283c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f927c06d7c0 con 0x7f927c0b3550 2024-09-17T01:42:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.929+0000 7f9283c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f927c06d640 con 0x7f927c142f40 2024-09-17T01:42:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.929+0000 7f9283c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f927c06d940 con 0x7f927c072e90 2024-09-17T01:42:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.929+0000 7f927be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f927c0b3550 0x7f927c0c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.929+0000 7f927be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f927c0b3550 0x7f927c0c5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59546/0 (socket says 172.21.15.42:59546) 2024-09-17T01:42:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.929+0000 7f927be00640 1 -- 172.21.15.42:0/3150165322 learned_addr learned my addr 172.21.15.42:0/3150165322 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.929+0000 7f9281200640 1 --2- 172.21.15.42:0/3150165322 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f927c072e90 0x7f927c142000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.929+0000 7f9281c00640 1 --2- 172.21.15.42:0/3150165322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f927c142f40 0x7f927c0c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.930+0000 7f927be00640 1 -- 172.21.15.42:0/3150165322 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f927c072e90 msgr2=0x7f927c142000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:55.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.930+0000 7f927be00640 1 --2- 172.21.15.42:0/3150165322 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f927c072e90 0x7f927c142000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:55.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.930+0000 7f927be00640 1 -- 172.21.15.42:0/3150165322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f927c142f40 msgr2=0x7f927c0c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:55.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.930+0000 7f927be00640 1 --2- 172.21.15.42:0/3150165322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f927c142f40 0x7f927c0c5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:55.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.930+0000 7f927be00640 1 -- 172.21.15.42:0/3150165322 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f927c1f5b50 con 0x7f927c0b3550 2024-09-17T01:42:55.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.930+0000 7f9281c00640 1 --2- 172.21.15.42:0/3150165322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f927c142f40 0x7f927c0c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:42:55.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.930+0000 7f927be00640 1 --2- 172.21.15.42:0/3150165322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f927c0b3550 0x7f927c0c5430 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f9268034040 tx=0x7f92680038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:55.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.930+0000 7f9278c00640 1 -- 172.21.15.42:0/3150165322 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926803e030 con 0x7f927c0b3550 2024-09-17T01:42:55.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.930+0000 7f9278c00640 1 -- 172.21.15.42:0/3150165322 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9268003d90 con 0x7f927c0b3550 2024-09-17T01:42:55.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.930+0000 7f9283c00640 1 -- 172.21.15.42:0/3150165322 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f927c1f5df0 con 0x7f927c0b3550 2024-09-17T01:42:55.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.930+0000 7f9278c00640 1 -- 172.21.15.42:0/3150165322 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9268035040 con 0x7f927c0b3550 2024-09-17T01:42:55.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.930+0000 7f9283c00640 1 -- 172.21.15.42:0/3150165322 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f927c1f63b0 con 0x7f927c0b3550 2024-09-17T01:42:55.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.932+0000 7f9283c00640 1 -- 172.21.15.42:0/3150165322 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f927c06a3f0 con 0x7f927c0b3550 2024-09-17T01:42:55.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.933+0000 7f9278c00640 1 -- 172.21.15.42:0/3150165322 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9268041030 con 0x7f927c0b3550 2024-09-17T01:42:55.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.934+0000 7f9278c00640 1 --2- 172.21.15.42:0/3150165322 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f925c078b90 0x7f925c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:55.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.934+0000 7f9278c00640 1 -- 172.21.15.42:0/3150165322 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5227+0+0 (secure 0 0 0) 0x7f92680bb620 con 0x7f927c0b3550 2024-09-17T01:42:55.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.934+0000 7f9281200640 1 --2- 172.21.15.42:0/3150165322 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f925c078b90 0x7f925c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:55.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.935+0000 7f9281200640 1 --2- 172.21.15.42:0/3150165322 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f925c078b90 0x7f925c07b0a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f9270009b30 tx=0x7f9270005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:55.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:55.939+0000 7f9278c00640 1 -- 172.21.15.42:0/3150165322 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f927c06a3f0 con 0x7f927c0b3550 2024-09-17T01:42:56.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.135+0000 7f9283c00640 1 -- 172.21.15.42:0/3150165322 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f927c15cec0 con 0x7f927c0b3550 2024-09-17T01:42:56.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.657+0000 7f9278c00640 1 -- 172.21.15.42:0/3150165322 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v145) ==== 170+0+0 (secure 0 0 0) 0x7f9268083550 con 0x7f927c0b3550 2024-09-17T01:42:56.655 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-09-17T01:42:56.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.661+0000 7f9283c00640 1 -- 172.21.15.42:0/3150165322 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f925c078b90 msgr2=0x7f925c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:56.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.661+0000 7f9283c00640 1 --2- 172.21.15.42:0/3150165322 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f925c078b90 0x7f925c07b0a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f9270009b30 tx=0x7f9270005f90 comp rx=0 tx=0).stop 2024-09-17T01:42:56.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.661+0000 7f9283c00640 1 -- 172.21.15.42:0/3150165322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f927c0b3550 msgr2=0x7f927c0c5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:56.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.661+0000 7f9283c00640 1 --2- 172.21.15.42:0/3150165322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f927c0b3550 0x7f927c0c5430 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f9268034040 tx=0x7f92680038a0 comp rx=0 tx=0).stop 2024-09-17T01:42:56.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.661+0000 7f9283c00640 1 -- 172.21.15.42:0/3150165322 shutdown_connections 2024-09-17T01:42:56.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.661+0000 7f9283c00640 1 --2- 172.21.15.42:0/3150165322 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f925c078b90 0x7f925c07b0a0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:56.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.661+0000 7f9283c00640 1 --2- 172.21.15.42:0/3150165322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f927c142f40 0x7f927c0c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:56.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.661+0000 7f9283c00640 1 --2- 172.21.15.42:0/3150165322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f927c0b3550 0x7f927c0c5430 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:56.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.661+0000 7f9283c00640 1 --2- 172.21.15.42:0/3150165322 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f927c072e90 0x7f927c142000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:56.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.662+0000 7f9283c00640 1 -- 172.21.15.42:0/3150165322 >> 172.21.15.42:0/3150165322 conn(0x7f927c0b2930 msgr2=0x7f927c15f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:56.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.662+0000 7f9283c00640 1 -- 172.21.15.42:0/3150165322 shutdown_connections 2024-09-17T01:42:56.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.662+0000 7f9283c00640 1 -- 172.21.15.42:0/3150165322 wait complete. 2024-09-17T01:42:56.700 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T01:42:56.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.934+0000 7f2d01000640 1 -- 172.21.15.42:0/2982024625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cfc0d0e10 msgr2=0x7f2cfc0d1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:56.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.934+0000 7f2d01000640 1 --2- 172.21.15.42:0/2982024625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cfc0d0e10 0x7f2cfc0d1220 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4009820 tx=0x7f2ce402a540 comp rx=0 tx=0).stop 2024-09-17T01:42:56.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.934+0000 7f2d01000640 1 -- 172.21.15.42:0/2982024625 shutdown_connections 2024-09-17T01:42:56.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.934+0000 7f2d01000640 1 --2- 172.21.15.42:0/2982024625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cfc0d0e10 0x7f2cfc0d1220 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:56.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.934+0000 7f2d01000640 1 -- 172.21.15.42:0/2982024625 >> 172.21.15.42:0/2982024625 conn(0x7f2cfc0b6140 msgr2=0x7f2cfc0b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:56.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.935+0000 7f2d01000640 1 -- 172.21.15.42:0/2982024625 shutdown_connections 2024-09-17T01:42:56.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.935+0000 7f2d01000640 1 -- 172.21.15.42:0/2982024625 wait complete. 2024-09-17T01:42:56.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.937+0000 7f2d01000640 1 Processor -- start 2024-09-17T01:42:56.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.937+0000 7f2d01000640 1 -- start start 2024-09-17T01:42:56.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.938+0000 7f2d01000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2cfc0cfba0 0x7f2cfc0b9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:56.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.938+0000 7f2d01000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cfc0d0e10 0x7f2cfc0b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:56.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.938+0000 7f2d01000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cfc162500 0x7f2cfc0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:56.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.938+0000 7f2d01000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2cfc0b33f0 con 0x7f2cfc162500 2024-09-17T01:42:56.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.938+0000 7f2d01000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2cfc0b3270 con 0x7f2cfc0d0e10 2024-09-17T01:42:56.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.938+0000 7f2d01000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2cfc0b3570 con 0x7f2cfc0cfba0 2024-09-17T01:42:56.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.939+0000 7f2cfbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cfc162500 0x7f2cfc0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:56.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.939+0000 7f2cfbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cfc162500 0x7f2cfc0b45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59554/0 (socket says 172.21.15.42:59554) 2024-09-17T01:42:56.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.939+0000 7f2cfbe00640 1 -- 172.21.15.42:0/499436635 learned_addr learned my addr 172.21.15.42:0/499436635 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:56.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.939+0000 7f2cf2a00640 1 --2- 172.21.15.42:0/499436635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cfc0d0e10 0x7f2cfc0b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:56.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.939+0000 7f2cfb400640 1 --2- 172.21.15.42:0/499436635 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2cfc0cfba0 0x7f2cfc0b9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:56.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.939+0000 7f2cfbe00640 1 -- 172.21.15.42:0/499436635 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2cfc0cfba0 msgr2=0x7f2cfc0b9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:56.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.939+0000 7f2cfbe00640 1 --2- 172.21.15.42:0/499436635 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2cfc0cfba0 0x7f2cfc0b9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:56.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.939+0000 7f2cfbe00640 1 -- 172.21.15.42:0/499436635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cfc0d0e10 msgr2=0x7f2cfc0b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:56.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.939+0000 7f2cfbe00640 1 --2- 172.21.15.42:0/499436635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cfc0d0e10 0x7f2cfc0b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:56.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.939+0000 7f2cfbe00640 1 -- 172.21.15.42:0/499436635 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cfc158790 con 0x7f2cfc162500 2024-09-17T01:42:56.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.940+0000 7f2cfbe00640 1 --2- 172.21.15.42:0/499436635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cfc162500 0x7f2cfc0b45d0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4002230 tx=0x7f2cf400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:56.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.940+0000 7f2cf3e00640 1 -- 172.21.15.42:0/499436635 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4016020 con 0x7f2cfc162500 2024-09-17T01:42:56.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.940+0000 7f2cf3e00640 1 -- 172.21.15.42:0/499436635 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2cf400ae30 con 0x7f2cfc162500 2024-09-17T01:42:56.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.940+0000 7f2d01000640 1 -- 172.21.15.42:0/499436635 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cfc158a70 con 0x7f2cfc162500 2024-09-17T01:42:56.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.940+0000 7f2cf3e00640 1 -- 172.21.15.42:0/499436635 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4012680 con 0x7f2cfc162500 2024-09-17T01:42:56.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.940+0000 7f2d01000640 1 -- 172.21.15.42:0/499436635 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cfc159030 con 0x7f2cfc162500 2024-09-17T01:42:56.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.941+0000 7f2d01000640 1 -- 172.21.15.42:0/499436635 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cfc0b3a40 con 0x7f2cfc162500 2024-09-17T01:42:56.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.942+0000 7f2cf3e00640 1 -- 172.21.15.42:0/499436635 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2cf4019020 con 0x7f2cfc162500 2024-09-17T01:42:56.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.943+0000 7f2cf3e00640 1 --2- 172.21.15.42:0/499436635 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2cd8078b90 0x7f2cd807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:56.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.943+0000 7f2cf3e00640 1 -- 172.21.15.42:0/499436635 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 5609+0+0 (secure 0 0 0) 0x7f2cf409b360 con 0x7f2cfc162500 2024-09-17T01:42:56.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.944+0000 7f2cfb400640 1 --2- 172.21.15.42:0/499436635 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2cd8078b90 0x7f2cd807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:56.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.945+0000 7f2cfb400640 1 --2- 172.21.15.42:0/499436635 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2cd8078b90 0x7f2cd807b0a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2cec001120 tx=0x7f2cec009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:56.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:56.949+0000 7f2cf3e00640 1 -- 172.21.15.42:0/499436635 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2cf4020020 con 0x7f2cfc162500 2024-09-17T01:42:57.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.183+0000 7f2d01000640 1 -- 172.21.15.42:0/499436635 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2cfc158520 con 0x7f2cfc162500 2024-09-17T01:42:57.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.670+0000 7f2cf3e00640 1 -- 172.21.15.42:0/499436635 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v112) ==== 174+0+0 (secure 0 0 0) 0x7f2cf40631a0 con 0x7f2cfc162500 2024-09-17T01:42:57.668 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 20 and data pool 21 2024-09-17T01:42:57.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.675+0000 7f2d01000640 1 -- 172.21.15.42:0/499436635 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2cd8078b90 msgr2=0x7f2cd807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:57.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.675+0000 7f2d01000640 1 --2- 172.21.15.42:0/499436635 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2cd8078b90 0x7f2cd807b0a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2cec001120 tx=0x7f2cec009040 comp rx=0 tx=0).stop 2024-09-17T01:42:57.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.675+0000 7f2d01000640 1 -- 172.21.15.42:0/499436635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cfc162500 msgr2=0x7f2cfc0b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:57.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.675+0000 7f2d01000640 1 --2- 172.21.15.42:0/499436635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cfc162500 0x7f2cfc0b45d0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4002230 tx=0x7f2cf400a430 comp rx=0 tx=0).stop 2024-09-17T01:42:57.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.675+0000 7f2d01000640 1 -- 172.21.15.42:0/499436635 shutdown_connections 2024-09-17T01:42:57.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.675+0000 7f2d01000640 1 --2- 172.21.15.42:0/499436635 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2cd8078b90 0x7f2cd807b0a0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:57.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.675+0000 7f2d01000640 1 --2- 172.21.15.42:0/499436635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2cfc0d0e10 0x7f2cfc0b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:57.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.675+0000 7f2d01000640 1 --2- 172.21.15.42:0/499436635 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2cfc162500 0x7f2cfc0b45d0 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:57.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.675+0000 7f2d01000640 1 --2- 172.21.15.42:0/499436635 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2cfc0cfba0 0x7f2cfc0b9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:57.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.675+0000 7f2d01000640 1 -- 172.21.15.42:0/499436635 >> 172.21.15.42:0/499436635 conn(0x7f2cfc0b6140 msgr2=0x7f2cfc1600d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:57.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.677+0000 7f2d01000640 1 -- 172.21.15.42:0/499436635 shutdown_connections 2024-09-17T01:42:57.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.677+0000 7f2d01000640 1 -- 172.21.15.42:0/499436635 wait complete. 2024-09-17T01:42:57.730 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:42:57.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.961+0000 7f7d97200640 1 -- 172.21.15.42:0/2413880970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d78005150 msgr2=0x7f7d7800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:57.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.961+0000 7f7d97200640 1 --2- 172.21.15.42:0/2413880970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d78005150 0x7f7d7800b9c0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c005fd0 tx=0x7f7d78005830 comp rx=0 tx=0).stop 2024-09-17T01:42:57.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.961+0000 7f7d96800640 1 -- 172.21.15.42:0/2413880970 reap_dead start 2024-09-17T01:42:57.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.961+0000 7f7d97200640 1 -- 172.21.15.42:0/2413880970 shutdown_connections 2024-09-17T01:42:57.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.961+0000 7f7d97200640 1 -- 172.21.15.42:0/2413880970 >> 172.21.15.42:0/2413880970 conn(0x7f7d900b25f0 msgr2=0x7f7d900d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:57.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.961+0000 7f7d97200640 1 -- 172.21.15.42:0/2413880970 shutdown_connections 2024-09-17T01:42:57.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.961+0000 7f7d97200640 1 -- 172.21.15.42:0/2413880970 wait complete. 2024-09-17T01:42:57.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.964+0000 7f7d97200640 1 Processor -- start 2024-09-17T01:42:57.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.964+0000 7f7d97200640 1 -- start start 2024-09-17T01:42:57.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.965+0000 7f7d97200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d78005150 0x7f7d90072050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:57.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.965+0000 7f7d97200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d9014b2a0 0x7f7d90072590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:57.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.965+0000 7f7d97200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d901ea9c0 0x7f7d90073650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:57.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.965+0000 7f7d97200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7d90152ed0 con 0x7f7d78005150 2024-09-17T01:42:57.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.965+0000 7f7d97200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9006d640 con 0x7f7d9014b2a0 2024-09-17T01:42:57.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.965+0000 7f7d97200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7d90153050 con 0x7f7d901ea9c0 2024-09-17T01:42:57.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.966+0000 7f7d95e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d78005150 0x7f7d90072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:57.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.966+0000 7f7d95e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d78005150 0x7f7d90072050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59570/0 (socket says 172.21.15.42:59570) 2024-09-17T01:42:57.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.966+0000 7f7d95e00640 1 -- 172.21.15.42:0/1740521271 learned_addr learned my addr 172.21.15.42:0/1740521271 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:57.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.966+0000 7f7d96800640 1 --2- 172.21.15.42:0/1740521271 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d901ea9c0 0x7f7d90073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:57.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.966+0000 7f7d95400640 1 --2- 172.21.15.42:0/1740521271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d9014b2a0 0x7f7d90072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:57.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.966+0000 7f7d95e00640 1 -- 172.21.15.42:0/1740521271 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d901ea9c0 msgr2=0x7f7d90073650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:57.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.966+0000 7f7d95e00640 1 --2- 172.21.15.42:0/1740521271 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d901ea9c0 0x7f7d90073650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:57.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.966+0000 7f7d95e00640 1 -- 172.21.15.42:0/1740521271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d9014b2a0 msgr2=0x7f7d90072590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:57.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.966+0000 7f7d95e00640 1 --2- 172.21.15.42:0/1740521271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d9014b2a0 0x7f7d90072590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:57.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.966+0000 7f7d95e00640 1 -- 172.21.15.42:0/1740521271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d901523c0 con 0x7f7d78005150 2024-09-17T01:42:57.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.966+0000 7f7d95e00640 1 --2- 172.21.15.42:0/1740521271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d78005150 0x7f7d90072050 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f7d84011ae0 tx=0x7f7d84009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:57.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.967+0000 7f7d8a000640 1 -- 172.21.15.42:0/1740521271 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8400fcb0 con 0x7f7d78005150 2024-09-17T01:42:57.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.967+0000 7f7d8a000640 1 -- 172.21.15.42:0/1740521271 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d8400fe50 con 0x7f7d78005150 2024-09-17T01:42:57.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.967+0000 7f7d8a000640 1 -- 172.21.15.42:0/1740521271 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d84004280 con 0x7f7d78005150 2024-09-17T01:42:57.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.967+0000 7f7d97200640 1 -- 172.21.15.42:0/1740521271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d90151e00 con 0x7f7d78005150 2024-09-17T01:42:57.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.967+0000 7f7d97200640 1 -- 172.21.15.42:0/1740521271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d9014fa60 con 0x7f7d78005150 2024-09-17T01:42:57.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.968+0000 7f7d97200640 1 -- 172.21.15.42:0/1740521271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d9015d6b0 con 0x7f7d78005150 2024-09-17T01:42:57.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.969+0000 7f7d8a000640 1 -- 172.21.15.42:0/1740521271 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7d840035f0 con 0x7f7d78005150 2024-09-17T01:42:57.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.970+0000 7f7d8a000640 1 --2- 172.21.15.42:0/1740521271 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7d74078b90 0x7f7d7407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:57.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.970+0000 7f7d8a000640 1 -- 172.21.15.42:0/1740521271 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5709+0+0 (secure 0 0 0) 0x7f7d8409b930 con 0x7f7d78005150 2024-09-17T01:42:57.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.971+0000 7f7d95400640 1 --2- 172.21.15.42:0/1740521271 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7d74078b90 0x7f7d7407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:57.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.971+0000 7f7d95400640 1 --2- 172.21.15.42:0/1740521271 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7d74078b90 0x7f7d7407b0a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7d80001a50 tx=0x7f7d80001110 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:57.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:57.975+0000 7f7d8a000640 1 -- 172.21.15.42:0/1740521271 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7d84063cd0 con 0x7f7d78005150 2024-09-17T01:42:58.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.171+0000 7f7d97200640 1 -- 172.21.15.42:0/1740521271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d9014bd40 con 0x7f7d78005150 2024-09-17T01:42:58.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.173+0000 7f7d8a000640 1 -- 172.21.15.42:0/1740521271 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) ==== 74+0+16704 (secure 0 0 0) 0x7f7d840635d0 con 0x7f7d78005150 2024-09-17T01:42:58.171 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:58.171 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":146,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:42:57.184555+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:42:55.166237+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T01:42:56.148712+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:42:58.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.175+0000 7f7d97200640 1 -- 172.21.15.42:0/1740521271 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7d74078b90 msgr2=0x7f7d7407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:58.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.175+0000 7f7d97200640 1 --2- 172.21.15.42:0/1740521271 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7d74078b90 0x7f7d7407b0a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7d80001a50 tx=0x7f7d80001110 comp rx=0 tx=0).stop 2024-09-17T01:42:58.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.175+0000 7f7d97200640 1 -- 172.21.15.42:0/1740521271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d78005150 msgr2=0x7f7d90072050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:58.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.175+0000 7f7d97200640 1 --2- 172.21.15.42:0/1740521271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d78005150 0x7f7d90072050 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f7d84011ae0 tx=0x7f7d84009f10 comp rx=0 tx=0).stop 2024-09-17T01:42:58.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.175+0000 7f7d97200640 1 -- 172.21.15.42:0/1740521271 shutdown_connections 2024-09-17T01:42:58.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.175+0000 7f7d97200640 1 --2- 172.21.15.42:0/1740521271 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7d74078b90 0x7f7d7407b0a0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:58.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.175+0000 7f7d97200640 1 --2- 172.21.15.42:0/1740521271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d9014b2a0 0x7f7d90072590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:58.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.175+0000 7f7d97200640 1 --2- 172.21.15.42:0/1740521271 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d901ea9c0 0x7f7d90073650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:58.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.175+0000 7f7d97200640 1 --2- 172.21.15.42:0/1740521271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d78005150 0x7f7d90072050 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:58.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.175+0000 7f7d97200640 1 -- 172.21.15.42:0/1740521271 >> 172.21.15.42:0/1740521271 conn(0x7f7d900b25f0 msgr2=0x7f7d9015ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:58.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.175+0000 7f7d97200640 1 -- 172.21.15.42:0/1740521271 shutdown_connections 2024-09-17T01:42:58.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.175+0000 7f7d97200640 1 -- 172.21.15.42:0/1740521271 wait complete. 2024-09-17T01:42:58.197 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:42:58.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.427+0000 7f316fe00640 1 -- 172.21.15.42:0/2737513474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f316806db40 msgr2=0x7f316815bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:58.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.427+0000 7f316fe00640 1 --2- 172.21.15.42:0/2737513474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f316806db40 0x7f316815bc50 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f315400a940 tx=0x7f315402b8f0 comp rx=0 tx=0).stop 2024-09-17T01:42:58.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.428+0000 7f316fe00640 1 -- 172.21.15.42:0/2737513474 shutdown_connections 2024-09-17T01:42:58.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.428+0000 7f316fe00640 1 --2- 172.21.15.42:0/2737513474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f316806db40 0x7f316815bc50 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:58.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.428+0000 7f316fe00640 1 -- 172.21.15.42:0/2737513474 >> 172.21.15.42:0/2737513474 conn(0x7f31680b2930 msgr2=0x7f316806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:58.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.428+0000 7f316fe00640 1 -- 172.21.15.42:0/2737513474 shutdown_connections 2024-09-17T01:42:58.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.428+0000 7f316fe00640 1 -- 172.21.15.42:0/2737513474 wait complete. 2024-09-17T01:42:58.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.430+0000 7f316fe00640 1 Processor -- start 2024-09-17T01:42:58.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.430+0000 7f316fe00640 1 -- start start 2024-09-17T01:42:58.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.431+0000 7f316fe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3168072e00 0x7f3168150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:58.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.431+0000 7f316fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f316815f190 0x7f3168158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:58.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.431+0000 7f316fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31680af1e0 0x7f3168159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:58.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.431+0000 7f316fe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3168151c30 con 0x7f316815f190 2024-09-17T01:42:58.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.431+0000 7f316fe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3168070790 con 0x7f31680af1e0 2024-09-17T01:42:58.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.431+0000 7f316fe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3168151db0 con 0x7f3168072e00 2024-09-17T01:42:58.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.432+0000 7f316ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f316815f190 0x7f3168158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:58.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.432+0000 7f316ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f316815f190 0x7f3168158d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59574/0 (socket says 172.21.15.42:59574) 2024-09-17T01:42:58.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.432+0000 7f316ca00640 1 -- 172.21.15.42:0/2198602510 learned_addr learned my addr 172.21.15.42:0/2198602510 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:58.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.432+0000 7f316d400640 1 --2- 172.21.15.42:0/2198602510 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3168072e00 0x7f3168150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:58.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.432+0000 7f316de00640 1 --2- 172.21.15.42:0/2198602510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31680af1e0 0x7f3168159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:58.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.432+0000 7f316ca00640 1 -- 172.21.15.42:0/2198602510 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3168072e00 msgr2=0x7f3168150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:58.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.432+0000 7f316ca00640 1 --2- 172.21.15.42:0/2198602510 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3168072e00 0x7f3168150f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:58.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.432+0000 7f316ca00640 1 -- 172.21.15.42:0/2198602510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31680af1e0 msgr2=0x7f3168159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:58.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.432+0000 7f316ca00640 1 --2- 172.21.15.42:0/2198602510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31680af1e0 0x7f3168159260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:58.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.432+0000 7f316ca00640 1 -- 172.21.15.42:0/2198602510 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3168156470 con 0x7f316815f190 2024-09-17T01:42:58.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.432+0000 7f316d400640 1 --2- 172.21.15.42:0/2198602510 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3168072e00 0x7f3168150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:42:58.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.432+0000 7f316ca00640 1 --2- 172.21.15.42:0/2198602510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f316815f190 0x7f3168158d20 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f315402bee0 tx=0x7f31540042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:58.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.433+0000 7f3165600640 1 -- 172.21.15.42:0/2198602510 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3154005c90 con 0x7f316815f190 2024-09-17T01:42:58.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.433+0000 7f3165600640 1 -- 172.21.15.42:0/2198602510 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f315402e070 con 0x7f316815f190 2024-09-17T01:42:58.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.433+0000 7f3165600640 1 -- 172.21.15.42:0/2198602510 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3154005570 con 0x7f316815f190 2024-09-17T01:42:58.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.433+0000 7f316fe00640 1 -- 172.21.15.42:0/2198602510 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3168155eb0 con 0x7f316815f190 2024-09-17T01:42:58.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.433+0000 7f316fe00640 1 -- 172.21.15.42:0/2198602510 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31681f5e80 con 0x7f316815f190 2024-09-17T01:42:58.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.434+0000 7f316fe00640 1 -- 172.21.15.42:0/2198602510 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f316815bc50 con 0x7f316815f190 2024-09-17T01:42:58.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.435+0000 7f3165600640 1 -- 172.21.15.42:0/2198602510 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f31540047a0 con 0x7f316815f190 2024-09-17T01:42:58.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.436+0000 7f3165600640 1 --2- 172.21.15.42:0/2198602510 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3148078b90 0x7f314807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:58.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.436+0000 7f3165600640 1 -- 172.21.15.42:0/2198602510 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5709+0+0 (secure 0 0 0) 0x7f31540bc540 con 0x7f316815f190 2024-09-17T01:42:58.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.437+0000 7f316d400640 1 --2- 172.21.15.42:0/2198602510 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3148078b90 0x7f314807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:58.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.437+0000 7f316d400640 1 --2- 172.21.15.42:0/2198602510 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3148078b90 0x7f314807b0a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f315c007fd0 tx=0x7f315c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:58.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.440+0000 7f3165600640 1 -- 172.21.15.42:0/2198602510 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3154084aa0 con 0x7f316815f190 2024-09-17T01:42:58.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.636+0000 7f316fe00640 1 -- 172.21.15.42:0/2198602510 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f316806a170 con 0x7f316815f190 2024-09-17T01:42:58.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.637+0000 7f3165600640 1 -- 172.21.15.42:0/2198602510 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) ==== 74+0+16704 (secure 0 0 0) 0x7f31540843a0 con 0x7f316815f190 2024-09-17T01:42:58.636 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:42:58.636 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":146,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:42:57.184555+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:42:55.166237+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T01:42:56.148712+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:42:58.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.640+0000 7f316fe00640 1 -- 172.21.15.42:0/2198602510 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3148078b90 msgr2=0x7f314807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:58.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.640+0000 7f316fe00640 1 --2- 172.21.15.42:0/2198602510 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3148078b90 0x7f314807b0a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f315c007fd0 tx=0x7f315c009040 comp rx=0 tx=0).stop 2024-09-17T01:42:58.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.640+0000 7f316fe00640 1 -- 172.21.15.42:0/2198602510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f316815f190 msgr2=0x7f3168158d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:58.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.640+0000 7f316fe00640 1 --2- 172.21.15.42:0/2198602510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f316815f190 0x7f3168158d20 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f315402bee0 tx=0x7f31540042f0 comp rx=0 tx=0).stop 2024-09-17T01:42:58.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.640+0000 7f316fe00640 1 -- 172.21.15.42:0/2198602510 shutdown_connections 2024-09-17T01:42:58.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.640+0000 7f316fe00640 1 --2- 172.21.15.42:0/2198602510 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3148078b90 0x7f314807b0a0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:58.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.640+0000 7f316fe00640 1 --2- 172.21.15.42:0/2198602510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31680af1e0 0x7f3168159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:58.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.640+0000 7f316fe00640 1 --2- 172.21.15.42:0/2198602510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f316815f190 0x7f3168158d20 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:58.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.640+0000 7f316fe00640 1 --2- 172.21.15.42:0/2198602510 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3168072e00 0x7f3168150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:58.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.640+0000 7f316fe00640 1 -- 172.21.15.42:0/2198602510 >> 172.21.15.42:0/2198602510 conn(0x7f31680b2930 msgr2=0x7f316815a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:58.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.640+0000 7f316fe00640 1 -- 172.21.15.42:0/2198602510 shutdown_connections 2024-09-17T01:42:58.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.640+0000 7f316fe00640 1 -- 172.21.15.42:0/2198602510 wait complete. 2024-09-17T01:42:58.665 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T01:42:58.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.900+0000 7f2126600640 1 -- 172.21.15.42:0/1541986048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2120073960 msgr2=0x7f2120073d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:58.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.900+0000 7f2126600640 1 --2- 172.21.15.42:0/1541986048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2120073960 0x7f2120073d70 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2118005fd0 tx=0x7f211802a8d0 comp rx=0 tx=0).stop 2024-09-17T01:42:58.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.900+0000 7f2126600640 1 -- 172.21.15.42:0/1541986048 shutdown_connections 2024-09-17T01:42:58.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.900+0000 7f2126600640 1 --2- 172.21.15.42:0/1541986048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2120073960 0x7f2120073d70 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:58.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.900+0000 7f2126600640 1 -- 172.21.15.42:0/1541986048 >> 172.21.15.42:0/1541986048 conn(0x7f21200b2930 msgr2=0x7f212006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:58.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.900+0000 7f2126600640 1 -- 172.21.15.42:0/1541986048 shutdown_connections 2024-09-17T01:42:58.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.901+0000 7f2126600640 1 -- 172.21.15.42:0/1541986048 wait complete. 2024-09-17T01:42:58.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.903+0000 7f2126600640 1 Processor -- start 2024-09-17T01:42:58.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.903+0000 7f2126600640 1 -- start start 2024-09-17T01:42:58.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.904+0000 7f2126600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2120073960 0x7f212013fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:58.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.904+0000 7f2126600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21200af980 0x7f2120154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:58.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.904+0000 7f2126600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21200b3880 0x7f2120155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:58.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.904+0000 7f2126600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f212006d7c0 con 0x7f21200af980 2024-09-17T01:42:58.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.904+0000 7f2126600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f212006d640 con 0x7f21200b3880 2024-09-17T01:42:58.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.904+0000 7f2126600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f212006d940 con 0x7f2120073960 2024-09-17T01:42:58.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.905+0000 7f2117e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21200af980 0x7f2120154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:58.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.905+0000 7f2117e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21200af980 0x7f2120154d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59586/0 (socket says 172.21.15.42:59586) 2024-09-17T01:42:58.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.905+0000 7f2117e00640 1 -- 172.21.15.42:0/1854740084 learned_addr learned my addr 172.21.15.42:0/1854740084 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:58.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.905+0000 7f211fe00640 1 --2- 172.21.15.42:0/1854740084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21200b3880 0x7f2120155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:58.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.905+0000 7f211f400640 1 --2- 172.21.15.42:0/1854740084 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2120073960 0x7f212013fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:58.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.905+0000 7f2117e00640 1 -- 172.21.15.42:0/1854740084 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2120073960 msgr2=0x7f212013fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:58.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.905+0000 7f2117e00640 1 --2- 172.21.15.42:0/1854740084 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2120073960 0x7f212013fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:58.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.905+0000 7f2117e00640 1 -- 172.21.15.42:0/1854740084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21200b3880 msgr2=0x7f2120155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:58.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.905+0000 7f2117e00640 1 --2- 172.21.15.42:0/1854740084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21200b3880 0x7f2120155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:58.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.905+0000 7f2117e00640 1 -- 172.21.15.42:0/1854740084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f212015dfe0 con 0x7f21200af980 2024-09-17T01:42:58.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.906+0000 7f2117e00640 1 --2- 172.21.15.42:0/1854740084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21200af980 0x7f2120154d10 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f2108001220 tx=0x7f210800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:58.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.906+0000 7f2117400640 1 -- 172.21.15.42:0/1854740084 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2108016020 con 0x7f21200af980 2024-09-17T01:42:58.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.906+0000 7f2117400640 1 -- 172.21.15.42:0/1854740084 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2108012920 con 0x7f21200af980 2024-09-17T01:42:58.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.906+0000 7f2117400640 1 -- 172.21.15.42:0/1854740084 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2108012d70 con 0x7f21200af980 2024-09-17T01:42:58.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.906+0000 7f2126600640 1 -- 172.21.15.42:0/1854740084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21201569c0 con 0x7f21200af980 2024-09-17T01:42:58.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.906+0000 7f2126600640 1 -- 172.21.15.42:0/1854740084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2120154230 con 0x7f21200af980 2024-09-17T01:42:58.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.907+0000 7f2126600640 1 -- 172.21.15.42:0/1854740084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21200af570 con 0x7f21200af980 2024-09-17T01:42:58.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.908+0000 7f2117400640 1 -- 172.21.15.42:0/1854740084 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2108019020 con 0x7f21200af980 2024-09-17T01:42:58.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.910+0000 7f2117400640 1 --2- 172.21.15.42:0/1854740084 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f20fc078b90 0x7f20fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:58.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.910+0000 7f2117400640 1 -- 172.21.15.42:0/1854740084 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f210809ad50 con 0x7f21200af980 2024-09-17T01:42:58.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.910+0000 7f211f400640 1 --2- 172.21.15.42:0/1854740084 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f20fc078b90 0x7f20fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:58.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.911+0000 7f211f400640 1 --2- 172.21.15.42:0/1854740084 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f20fc078b90 0x7f20fc07b0a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2110000f60 tx=0x7f2110009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:58.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:58.914+0000 7f2117400640 1 -- 172.21.15.42:0/1854740084 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f21200af570 con 0x7f21200af980 2024-09-17T01:42:59.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.145+0000 7f2126600640 1 -- 172.21.15.42:0/1854740084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2120156c50 con 0x7f21200af980 2024-09-17T01:42:59.647 INFO:tasks.ceph.mds.c.smithi042.stderr:2024-09-17T01:42:59.649+0000 7f685ce00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:42:59.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.696+0000 7f2117400640 1 -- 172.21.15.42:0/1854740084 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v115) ==== 118+0+0 (secure 0 0 0) 0x7f2108020020 con 0x7f21200af980 2024-09-17T01:42:59.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.698+0000 7f2126600640 1 -- 172.21.15.42:0/1854740084 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f20fc078b90 msgr2=0x7f20fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:59.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.698+0000 7f2126600640 1 --2- 172.21.15.42:0/1854740084 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f20fc078b90 0x7f20fc07b0a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2110000f60 tx=0x7f2110009040 comp rx=0 tx=0).stop 2024-09-17T01:42:59.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.698+0000 7f2126600640 1 -- 172.21.15.42:0/1854740084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21200af980 msgr2=0x7f2120154d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:59.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.698+0000 7f2126600640 1 --2- 172.21.15.42:0/1854740084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21200af980 0x7f2120154d10 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f2108001220 tx=0x7f210800c940 comp rx=0 tx=0).stop 2024-09-17T01:42:59.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.698+0000 7f2126600640 1 -- 172.21.15.42:0/1854740084 shutdown_connections 2024-09-17T01:42:59.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.698+0000 7f2126600640 1 --2- 172.21.15.42:0/1854740084 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f20fc078b90 0x7f20fc07b0a0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:59.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.698+0000 7f2126600640 1 --2- 172.21.15.42:0/1854740084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21200b3880 0x7f2120155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:59.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.698+0000 7f2126600640 1 --2- 172.21.15.42:0/1854740084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21200af980 0x7f2120154d10 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:59.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.698+0000 7f2126600640 1 --2- 172.21.15.42:0/1854740084 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2120073960 0x7f212013fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:59.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.698+0000 7f2126600640 1 -- 172.21.15.42:0/1854740084 >> 172.21.15.42:0/1854740084 conn(0x7f21200b2930 msgr2=0x7f21200b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:59.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.699+0000 7f2126600640 1 -- 172.21.15.42:0/1854740084 shutdown_connections 2024-09-17T01:42:59.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.699+0000 7f2126600640 1 -- 172.21.15.42:0/1854740084 wait complete. 2024-09-17T01:42:59.720 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T01:42:59.721 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T01:42:59.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.955+0000 7f3e9b200640 1 -- 172.21.15.42:0/3472774135 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e9c0d0d80 msgr2=0x7f3e9c06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:59.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.955+0000 7f3e9b200640 1 --2- 172.21.15.42:0/3472774135 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e9c0d0d80 0x7f3e9c06cd20 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c06dd20 tx=0x7f3e8c02a5f0 comp rx=0 tx=0).stop 2024-09-17T01:42:59.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.955+0000 7f3e9b200640 1 -- 172.21.15.42:0/3472774135 shutdown_connections 2024-09-17T01:42:59.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.955+0000 7f3e9b200640 1 --2- 172.21.15.42:0/3472774135 >> v2:172.21.15.43:3300/0 conn(0x7f3e9c06d260 0x7f3e9c0c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:59.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.955+0000 7f3e9b200640 1 --2- 172.21.15.42:0/3472774135 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e9c0d0d80 0x7f3e9c06cd20 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:59.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.955+0000 7f3e9b200640 1 -- 172.21.15.42:0/3472774135 >> 172.21.15.42:0/3472774135 conn(0x7f3e9c0b25f0 msgr2=0x7f3e9c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:59.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.955+0000 7f3e9b200640 1 -- 172.21.15.42:0/3472774135 shutdown_connections 2024-09-17T01:42:59.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.955+0000 7f3e9b200640 1 -- 172.21.15.42:0/3472774135 wait complete. 2024-09-17T01:42:59.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.957+0000 7f3e9b200640 1 Processor -- start 2024-09-17T01:42:59.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.957+0000 7f3e9b200640 1 -- start start 2024-09-17T01:42:59.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.959+0000 7f3e9b200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3e9c06d260 0x7f3e9c073bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:59.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.959+0000 7f3e9b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e9c0af460 0x7f3e9c15ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:59.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.959+0000 7f3e9b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e9c0d0d80 0x7f3e9c0746a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:59.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.959+0000 7f3e9b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c1632b0 con 0x7f3e9c0af460 2024-09-17T01:42:59.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.959+0000 7f3e9b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c163130 con 0x7f3e9c0d0d80 2024-09-17T01:42:59.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.959+0000 7f3e9b200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3e9c0ca070 con 0x7f3e9c06d260 2024-09-17T01:42:59.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.959+0000 7f3e93e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e9c0af460 0x7f3e9c15ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:59.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.959+0000 7f3e93e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e9c0af460 0x7f3e9c15ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59606/0 (socket says 172.21.15.42:59606) 2024-09-17T01:42:59.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.959+0000 7f3e93e00640 1 -- 172.21.15.42:0/1832175046 learned_addr learned my addr 172.21.15.42:0/1832175046 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:42:59.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.959+0000 7f3e9a800640 1 --2- 172.21.15.42:0/1832175046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e9c0d0d80 0x7f3e9c0746a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:59.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.959+0000 7f3e99e00640 1 --2- 172.21.15.42:0/1832175046 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3e9c06d260 0x7f3e9c073bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:59.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.960+0000 7f3e93e00640 1 -- 172.21.15.42:0/1832175046 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3e9c06d260 msgr2=0x7f3e9c073bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:59.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.960+0000 7f3e93e00640 1 --2- 172.21.15.42:0/1832175046 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3e9c06d260 0x7f3e9c073bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:59.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.960+0000 7f3e93e00640 1 -- 172.21.15.42:0/1832175046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e9c0d0d80 msgr2=0x7f3e9c0746a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:59.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.960+0000 7f3e93e00640 1 --2- 172.21.15.42:0/1832175046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e9c0d0d80 0x7f3e9c0746a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:59.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.960+0000 7f3e93e00640 1 -- 172.21.15.42:0/1832175046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9c1f9010 con 0x7f3e9c0af460 2024-09-17T01:42:59.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.960+0000 7f3e93e00640 1 --2- 172.21.15.42:0/1832175046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e9c0af460 0x7f3e9c15ce40 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400c3d0 tx=0x7f3e8400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:59.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.960+0000 7f3e92000640 1 -- 172.21.15.42:0/1832175046 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e84017070 con 0x7f3e9c0af460 2024-09-17T01:42:59.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.960+0000 7f3e92000640 1 -- 172.21.15.42:0/1832175046 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e840053c0 con 0x7f3e9c0af460 2024-09-17T01:42:59.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.960+0000 7f3e9b200640 1 -- 172.21.15.42:0/1832175046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e9c1f92f0 con 0x7f3e9c0af460 2024-09-17T01:42:59.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.960+0000 7f3e92000640 1 -- 172.21.15.42:0/1832175046 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e84003850 con 0x7f3e9c0af460 2024-09-17T01:42:59.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.960+0000 7f3e9b200640 1 -- 172.21.15.42:0/1832175046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e9c1f98b0 con 0x7f3e9c0af460 2024-09-17T01:42:59.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.962+0000 7f3e9b200640 1 -- 172.21.15.42:0/1832175046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e9c1f8d80 con 0x7f3e9c0af460 2024-09-17T01:42:59.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.963+0000 7f3e92000640 1 -- 172.21.15.42:0/1832175046 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3e8401a070 con 0x7f3e9c0af460 2024-09-17T01:42:59.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.964+0000 7f3e92000640 1 --2- 172.21.15.42:0/1832175046 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3e78078b90 0x7f3e7807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:59.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.964+0000 7f3e92000640 1 -- 172.21.15.42:0/1832175046 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f3e84099fe0 con 0x7f3e9c0af460 2024-09-17T01:42:59.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.964+0000 7f3e99e00640 1 --2- 172.21.15.42:0/1832175046 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3e78078b90 0x7f3e7807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:59.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.966+0000 7f3e99e00640 1 --2- 172.21.15.42:0/1832175046 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3e78078b90 0x7f3e7807b0a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c033000 tx=0x7f3e8c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:59.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:42:59.969+0000 7f3e92000640 1 -- 172.21.15.42:0/1832175046 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3e9c06d670 con 0x7f3e9c0af460 2024-09-17T01:43:00.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.199+0000 7f3e9b200640 1 -- 172.21.15.42:0/1832175046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f3e9c15eb70 con 0x7f3e9c0af460 2024-09-17T01:43:00.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.697+0000 7f3e92000640 1 -- 172.21.15.42:0/1832175046 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v116) ==== 122+0+0 (secure 0 0 0) 0x7f3e84061e20 con 0x7f3e9c0af460 2024-09-17T01:43:00.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.700+0000 7f3e9b200640 1 -- 172.21.15.42:0/1832175046 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3e78078b90 msgr2=0x7f3e7807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:00.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.700+0000 7f3e9b200640 1 --2- 172.21.15.42:0/1832175046 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3e78078b90 0x7f3e7807b0a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c033000 tx=0x7f3e8c004730 comp rx=0 tx=0).stop 2024-09-17T01:43:00.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.700+0000 7f3e9b200640 1 -- 172.21.15.42:0/1832175046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e9c0af460 msgr2=0x7f3e9c15ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:00.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.700+0000 7f3e9b200640 1 --2- 172.21.15.42:0/1832175046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e9c0af460 0x7f3e9c15ce40 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400c3d0 tx=0x7f3e8400c890 comp rx=0 tx=0).stop 2024-09-17T01:43:00.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.700+0000 7f3e9b200640 1 -- 172.21.15.42:0/1832175046 shutdown_connections 2024-09-17T01:43:00.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.700+0000 7f3e9b200640 1 --2- 172.21.15.42:0/1832175046 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3e78078b90 0x7f3e7807b0a0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:00.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.700+0000 7f3e9b200640 1 --2- 172.21.15.42:0/1832175046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e9c0d0d80 0x7f3e9c0746a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:00.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.700+0000 7f3e9b200640 1 --2- 172.21.15.42:0/1832175046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e9c0af460 0x7f3e9c15ce40 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:00.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.700+0000 7f3e9b200640 1 --2- 172.21.15.42:0/1832175046 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3e9c06d260 0x7f3e9c073bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:00.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.701+0000 7f3e9b200640 1 -- 172.21.15.42:0/1832175046 >> 172.21.15.42:0/1832175046 conn(0x7f3e9c0b25f0 msgr2=0x7f3e9c15ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:00.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.701+0000 7f3e9b200640 1 -- 172.21.15.42:0/1832175046 shutdown_connections 2024-09-17T01:43:00.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.701+0000 7f3e9b200640 1 -- 172.21.15.42:0/1832175046 wait complete. 2024-09-17T01:43:00.722 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T01:43:00.723 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:43:00.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.955+0000 7f5603e00640 1 -- 172.21.15.42:0/4078286525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56040b4be0 msgr2=0x7f560415d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:00.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.955+0000 7f5603e00640 1 --2- 172.21.15.42:0/4078286525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56040b4be0 0x7f560415d6b0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f560406deb0 tx=0x7f55f402a560 comp rx=0 tx=0).stop 2024-09-17T01:43:00.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.955+0000 7f5603e00640 1 -- 172.21.15.42:0/4078286525 shutdown_connections 2024-09-17T01:43:00.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.955+0000 7f5603e00640 1 --2- 172.21.15.42:0/4078286525 >> v2:172.21.15.43:3300/0 conn(0x7f560406d430 0x7f5604152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:00.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.955+0000 7f5603e00640 1 --2- 172.21.15.42:0/4078286525 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56040b4be0 0x7f560415d6b0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:00.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.955+0000 7f5603e00640 1 -- 172.21.15.42:0/4078286525 >> 172.21.15.42:0/4078286525 conn(0x7f56040b25f0 msgr2=0x7f56040d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:00.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.955+0000 7f5603e00640 1 -- 172.21.15.42:0/4078286525 shutdown_connections 2024-09-17T01:43:00.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.955+0000 7f5603e00640 1 -- 172.21.15.42:0/4078286525 wait complete. 2024-09-17T01:43:00.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.957+0000 7f5603e00640 1 Processor -- start 2024-09-17T01:43:00.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.957+0000 7f5603e00640 1 -- start start 2024-09-17T01:43:00.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.959+0000 7f5603e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56040b4be0 0x7f56041f6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:00.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.959+0000 7f5603e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f56040cf7c0 0x7f5604143800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:00.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.959+0000 7f5603e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5604143d40 0x7f56040c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:00.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.959+0000 7f5603e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f56041537a0 con 0x7f5604143d40 2024-09-17T01:43:00.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.959+0000 7f5603e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5604153620 con 0x7f56040b4be0 2024-09-17T01:43:00.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.959+0000 7f5603e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5604153920 con 0x7f56040cf7c0 2024-09-17T01:43:00.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.959+0000 7f5603400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5604143d40 0x7f56040c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:00.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.959+0000 7f5602a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56040b4be0 0x7f56041f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:00.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.959+0000 7f5603400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5604143d40 0x7f56040c7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59616/0 (socket says 172.21.15.42:59616) 2024-09-17T01:43:00.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.959+0000 7f5603400640 1 -- 172.21.15.42:0/1463391693 learned_addr learned my addr 172.21.15.42:0/1463391693 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:00.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.959+0000 7f5602a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56040b4be0 0x7f56041f6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:36932/0 (socket says 172.21.15.42:36932) 2024-09-17T01:43:00.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.959+0000 7f55fa000640 1 --2- 172.21.15.42:0/1463391693 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f56040cf7c0 0x7f5604143800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:00.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.960+0000 7f5603400640 1 -- 172.21.15.42:0/1463391693 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f56040cf7c0 msgr2=0x7f5604143800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:00.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.960+0000 7f5603400640 1 --2- 172.21.15.42:0/1463391693 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f56040cf7c0 0x7f5604143800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:00.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.960+0000 7f5603400640 1 -- 172.21.15.42:0/1463391693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56040b4be0 msgr2=0x7f56041f6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:00.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.960+0000 7f5603400640 1 --2- 172.21.15.42:0/1463391693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56040b4be0 0x7f56041f6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:00.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.960+0000 7f5603400640 1 -- 172.21.15.42:0/1463391693 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5604151bd0 con 0x7f5604143d40 2024-09-17T01:43:00.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.960+0000 7f5603400640 1 --2- 172.21.15.42:0/1463391693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5604143d40 0x7f56040c7700 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f55fc005d00 tx=0x7f55fc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:00.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.960+0000 7f55fb400640 1 -- 172.21.15.42:0/1463391693 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55fc017070 con 0x7f5604143d40 2024-09-17T01:43:00.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.960+0000 7f55fb400640 1 -- 172.21.15.42:0/1463391693 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55fc005330 con 0x7f5604143d40 2024-09-17T01:43:00.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.960+0000 7f5603e00640 1 -- 172.21.15.42:0/1463391693 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5604073d00 con 0x7f5604143d40 2024-09-17T01:43:00.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.960+0000 7f55fb400640 1 -- 172.21.15.42:0/1463391693 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55fc0047a0 con 0x7f5604143d40 2024-09-17T01:43:00.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.960+0000 7f5603e00640 1 -- 172.21.15.42:0/1463391693 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56040742c0 con 0x7f5604143d40 2024-09-17T01:43:00.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.962+0000 7f5603e00640 1 -- 172.21.15.42:0/1463391693 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5604152ed0 con 0x7f5604143d40 2024-09-17T01:43:00.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.963+0000 7f55fb400640 1 -- 172.21.15.42:0/1463391693 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f55fc004940 con 0x7f5604143d40 2024-09-17T01:43:00.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.964+0000 7f55fb400640 1 --2- 172.21.15.42:0/1463391693 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f55e0078b90 0x7f55e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:00.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.964+0000 7f55fb400640 1 -- 172.21.15.42:0/1463391693 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f55fc09ac70 con 0x7f5604143d40 2024-09-17T01:43:00.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.965+0000 7f5602a00640 1 --2- 172.21.15.42:0/1463391693 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f55e0078b90 0x7f55e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:00.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.965+0000 7f5602a00640 1 --2- 172.21.15.42:0/1463391693 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f55e0078b90 0x7f55e007b0a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f55f4033000 tx=0x7f55f4004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:00.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:00.969+0000 7f55fb400640 1 -- 172.21.15.42:0/1463391693 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f55fc062af0 con 0x7f5604143d40 2024-09-17T01:43:01.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.203+0000 7f5603e00640 1 -- 172.21.15.42:0/1463391693 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56040b39b0 con 0x7f5604143d40 2024-09-17T01:43:01.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.204+0000 7f55fb400640 1 -- 172.21.15.42:0/1463391693 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) ==== 95+0+5230 (secure 0 0 0) 0x7f55fc067520 con 0x7f5604143d40 2024-09-17T01:43:01.201 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:01.202 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3131119825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3131119825},{"type":"v1","addr":"172.21.15.43:6837","nonce":3131119825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8368,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1988657429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1988657429},{"type":"v1","addr":"172.21.15.43:6836","nonce":1988657429}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/578887548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":578887548},{"type":"v1","addr":"172.21.15.42:6835","nonce":578887548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:42:57.184518+0000","modified":"2024-09-17T01:43:00.201156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8982":{"gid":8982,"name":"c","rank":0,"incarnation":112,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6834/3811049376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3811049376},{"type":"v1","addr":"172.21.15.42:6834","nonce":3811049376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8982,"qdb_cluster":[8982]},"id":10}]} 2024-09-17T01:43:01.202 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 116 2024-09-17T01:43:01.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.206+0000 7f5603e00640 1 -- 172.21.15.42:0/1463391693 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f55e0078b90 msgr2=0x7f55e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:01.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.206+0000 7f5603e00640 1 --2- 172.21.15.42:0/1463391693 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f55e0078b90 0x7f55e007b0a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f55f4033000 tx=0x7f55f4004730 comp rx=0 tx=0).stop 2024-09-17T01:43:01.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.206+0000 7f5603e00640 1 -- 172.21.15.42:0/1463391693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5604143d40 msgr2=0x7f56040c7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:01.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.206+0000 7f5603e00640 1 --2- 172.21.15.42:0/1463391693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5604143d40 0x7f56040c7700 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f55fc005d00 tx=0x7f55fc00dae0 comp rx=0 tx=0).stop 2024-09-17T01:43:01.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.206+0000 7f5603e00640 1 -- 172.21.15.42:0/1463391693 shutdown_connections 2024-09-17T01:43:01.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.206+0000 7f5603e00640 1 --2- 172.21.15.42:0/1463391693 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f55e0078b90 0x7f55e007b0a0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:01.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.206+0000 7f5603e00640 1 --2- 172.21.15.42:0/1463391693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5604143d40 0x7f56040c7700 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:01.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.206+0000 7f5603e00640 1 --2- 172.21.15.42:0/1463391693 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f56040cf7c0 0x7f5604143800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:01.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.206+0000 7f5603e00640 1 --2- 172.21.15.42:0/1463391693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56040b4be0 0x7f56041f6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:01.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.206+0000 7f5603e00640 1 -- 172.21.15.42:0/1463391693 >> 172.21.15.42:0/1463391693 conn(0x7f56040b25f0 msgr2=0x7f56040b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:01.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.206+0000 7f5603e00640 1 -- 172.21.15.42:0/1463391693 shutdown_connections 2024-09-17T01:43:01.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.206+0000 7f5603e00640 1 -- 172.21.15.42:0/1463391693 wait complete. 2024-09-17T01:43:01.230 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:43:01.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.460+0000 7f4aa7e00640 1 -- 172.21.15.42:0/2523276746 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4aa006d430 msgr2=0x7f4aa006d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:01.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.460+0000 7f4aa7e00640 1 --2- 172.21.15.42:0/2523276746 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4aa006d430 0x7f4aa006d840 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f4aa00723d0 tx=0x7f4a8c02a5f0 comp rx=0 tx=0).stop 2024-09-17T01:43:01.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.460+0000 7f4aa7e00640 1 -- 172.21.15.42:0/2523276746 shutdown_connections 2024-09-17T01:43:01.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.460+0000 7f4aa7e00640 1 --2- 172.21.15.42:0/2523276746 >> v2:172.21.15.43:3300/0 conn(0x7f4aa0072520 0x7f4aa0072930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:01.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.460+0000 7f4aa7e00640 1 --2- 172.21.15.42:0/2523276746 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4aa006d430 0x7f4aa006d840 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:01.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.460+0000 7f4aa7e00640 1 -- 172.21.15.42:0/2523276746 >> 172.21.15.42:0/2523276746 conn(0x7f4aa00b2930 msgr2=0x7f4aa006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:01.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.461+0000 7f4aa7e00640 1 -- 172.21.15.42:0/2523276746 shutdown_connections 2024-09-17T01:43:01.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.461+0000 7f4aa7e00640 1 -- 172.21.15.42:0/2523276746 wait complete. 2024-09-17T01:43:01.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.463+0000 7f4aa7e00640 1 Processor -- start 2024-09-17T01:43:01.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.463+0000 7f4aa7e00640 1 -- start start 2024-09-17T01:43:01.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.464+0000 7f4aa7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa006d430 0x7f4aa01443f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:01.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.464+0000 7f4aa7e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4aa0072520 0x7f4aa01e70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:01.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.464+0000 7f4aa7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4aa00afb80 0x7f4aa00ce310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:01.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.465+0000 7f4aa7e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa0072ff0 con 0x7f4aa00afb80 2024-09-17T01:43:01.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.465+0000 7f4aa7e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa0072e70 con 0x7f4aa006d430 2024-09-17T01:43:01.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.465+0000 7f4aa7e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4aa0073170 con 0x7f4aa0072520 2024-09-17T01:43:01.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.465+0000 7f4aa5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4aa00afb80 0x7f4aa00ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:01.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.465+0000 7f4aa5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4aa00afb80 0x7f4aa00ce310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59632/0 (socket says 172.21.15.42:59632) 2024-09-17T01:43:01.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.465+0000 7f4aa5e00640 1 -- 172.21.15.42:0/3424132827 learned_addr learned my addr 172.21.15.42:0/3424132827 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:01.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.465+0000 7f4aa5400640 1 --2- 172.21.15.42:0/3424132827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa006d430 0x7f4aa01443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:01.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.465+0000 7f4aa4a00640 1 --2- 172.21.15.42:0/3424132827 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4aa0072520 0x7f4aa01e70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:01.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.465+0000 7f4aa5e00640 1 -- 172.21.15.42:0/3424132827 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4aa0072520 msgr2=0x7f4aa01e70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:01.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.465+0000 7f4aa5e00640 1 --2- 172.21.15.42:0/3424132827 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4aa0072520 0x7f4aa01e70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:01.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.465+0000 7f4aa5e00640 1 -- 172.21.15.42:0/3424132827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa006d430 msgr2=0x7f4aa01443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:01.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.465+0000 7f4aa5e00640 1 --2- 172.21.15.42:0/3424132827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa006d430 0x7f4aa01443f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:01.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.465+0000 7f4aa5e00640 1 -- 172.21.15.42:0/3424132827 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aa01f6030 con 0x7f4aa00afb80 2024-09-17T01:43:01.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.465+0000 7f4aa5400640 1 --2- 172.21.15.42:0/3424132827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa006d430 0x7f4aa01443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:43:01.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.465+0000 7f4aa4a00640 1 --2- 172.21.15.42:0/3424132827 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4aa0072520 0x7f4aa01e70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:43:01.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.466+0000 7f4aa5e00640 1 --2- 172.21.15.42:0/3424132827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4aa00afb80 0x7f4aa00ce310 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800ea40 tx=0x7f4a9800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:01.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.466+0000 7f4a9d600640 1 -- 172.21.15.42:0/3424132827 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9800ce40 con 0x7f4aa00afb80 2024-09-17T01:43:01.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.466+0000 7f4a9d600640 1 -- 172.21.15.42:0/3424132827 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a98004c10 con 0x7f4aa00afb80 2024-09-17T01:43:01.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.466+0000 7f4a9d600640 1 -- 172.21.15.42:0/3424132827 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a98005020 con 0x7f4aa00afb80 2024-09-17T01:43:01.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.466+0000 7f4aa7e00640 1 -- 172.21.15.42:0/3424132827 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aa01f6310 con 0x7f4aa00afb80 2024-09-17T01:43:01.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.466+0000 7f4aa7e00640 1 -- 172.21.15.42:0/3424132827 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aa01f68d0 con 0x7f4aa00afb80 2024-09-17T01:43:01.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.467+0000 7f4aa7e00640 1 -- 172.21.15.42:0/3424132827 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aa0073700 con 0x7f4aa00afb80 2024-09-17T01:43:01.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.468+0000 7f4a9d600640 1 -- 172.21.15.42:0/3424132827 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4a980051c0 con 0x7f4aa00afb80 2024-09-17T01:43:01.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.469+0000 7f4a9d600640 1 --2- 172.21.15.42:0/3424132827 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4a80078b90 0x7f4a8007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:01.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.469+0000 7f4a9d600640 1 -- 172.21.15.42:0/3424132827 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f4a9809bc70 con 0x7f4aa00afb80 2024-09-17T01:43:01.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.470+0000 7f4aa5400640 1 --2- 172.21.15.42:0/3424132827 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4a80078b90 0x7f4a8007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:01.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.471+0000 7f4aa5400640 1 --2- 172.21.15.42:0/3424132827 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4a80078b90 0x7f4a8007b0a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4a94000f60 tx=0x7f4a94009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:01.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.474+0000 7f4a9d600640 1 -- 172.21.15.42:0/3424132827 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4a98064010 con 0x7f4aa00afb80 2024-09-17T01:43:01.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.670+0000 7f4aa7e00640 1 -- 172.21.15.42:0/3424132827 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4aa006a170 con 0x7f4aa00afb80 2024-09-17T01:43:01.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.672+0000 7f4a9d600640 1 -- 172.21.15.42:0/3424132827 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) ==== 74+0+16691 (secure 0 0 0) 0x7f4a98063910 con 0x7f4aa00afb80 2024-09-17T01:43:01.670 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:01.670 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":147,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:42:58.671208+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:42:55.166237+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T01:42:56.148712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:43:01.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.674+0000 7f4aa7e00640 1 -- 172.21.15.42:0/3424132827 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4a80078b90 msgr2=0x7f4a8007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:01.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.674+0000 7f4aa7e00640 1 --2- 172.21.15.42:0/3424132827 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4a80078b90 0x7f4a8007b0a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4a94000f60 tx=0x7f4a94009040 comp rx=0 tx=0).stop 2024-09-17T01:43:01.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.674+0000 7f4aa7e00640 1 -- 172.21.15.42:0/3424132827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4aa00afb80 msgr2=0x7f4aa00ce310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:01.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.674+0000 7f4aa7e00640 1 --2- 172.21.15.42:0/3424132827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4aa00afb80 0x7f4aa00ce310 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800ea40 tx=0x7f4a9800ef00 comp rx=0 tx=0).stop 2024-09-17T01:43:01.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.674+0000 7f4aa7e00640 1 -- 172.21.15.42:0/3424132827 shutdown_connections 2024-09-17T01:43:01.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.674+0000 7f4aa7e00640 1 --2- 172.21.15.42:0/3424132827 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4a80078b90 0x7f4a8007b0a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:01.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.674+0000 7f4aa7e00640 1 --2- 172.21.15.42:0/3424132827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4aa00afb80 0x7f4aa00ce310 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:01.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.674+0000 7f4aa7e00640 1 --2- 172.21.15.42:0/3424132827 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4aa0072520 0x7f4aa01e70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:01.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.674+0000 7f4aa7e00640 1 --2- 172.21.15.42:0/3424132827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4aa006d430 0x7f4aa01443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:01.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.674+0000 7f4aa7e00640 1 -- 172.21.15.42:0/3424132827 >> 172.21.15.42:0/3424132827 conn(0x7f4aa00b2930 msgr2=0x7f4aa00b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:01.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.674+0000 7f4aa7e00640 1 -- 172.21.15.42:0/3424132827 shutdown_connections 2024-09-17T01:43:01.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.674+0000 7f4aa7e00640 1 -- 172.21.15.42:0/3424132827 wait complete. 2024-09-17T01:43:01.695 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T01:43:01.696 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:43:01.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.928+0000 7ff4fb200640 1 -- 172.21.15.42:0/349922127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4fc0cfba0 msgr2=0x7ff4fc0b9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:01.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.928+0000 7ff4fb200640 1 --2- 172.21.15.42:0/349922127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4fc0cfba0 0x7ff4fc0b9fb0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009830 tx=0x7ff4ec02a510 comp rx=0 tx=0).stop 2024-09-17T01:43:01.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.928+0000 7ff4fb200640 1 -- 172.21.15.42:0/349922127 shutdown_connections 2024-09-17T01:43:01.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.928+0000 7ff4fb200640 1 --2- 172.21.15.42:0/349922127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4fc0cfba0 0x7ff4fc0b9fb0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:01.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.928+0000 7ff4fb200640 1 -- 172.21.15.42:0/349922127 >> 172.21.15.42:0/349922127 conn(0x7ff4fc0b6140 msgr2=0x7ff4fc0b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:01.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.928+0000 7ff4fb200640 1 -- 172.21.15.42:0/349922127 shutdown_connections 2024-09-17T01:43:01.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.928+0000 7ff4fb200640 1 -- 172.21.15.42:0/349922127 wait complete. 2024-09-17T01:43:01.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.930+0000 7ff4fb200640 1 Processor -- start 2024-09-17T01:43:01.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.930+0000 7ff4fb200640 1 -- start start 2024-09-17T01:43:01.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.932+0000 7ff4fb200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4fc0cfba0 0x7ff4fc156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:01.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.932+0000 7ff4fb200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4fc0d0e10 0x7ff4fc1f9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:01.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.932+0000 7ff4fb200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff4fc162500 0x7ff4fc1f9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:01.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.932+0000 7ff4fb200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc0b33f0 con 0x7ff4fc0d0e10 2024-09-17T01:43:01.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.932+0000 7ff4fb200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc0b3270 con 0x7ff4fc0cfba0 2024-09-17T01:43:01.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.932+0000 7ff4fb200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff4fc0b3570 con 0x7ff4fc162500 2024-09-17T01:43:01.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.932+0000 7ff4f3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4fc0d0e10 0x7ff4fc1f9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:01.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.932+0000 7ff4f3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4fc0d0e10 0x7ff4fc1f9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59660/0 (socket says 172.21.15.42:59660) 2024-09-17T01:43:01.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.932+0000 7ff4f3e00640 1 -- 172.21.15.42:0/1816010443 learned_addr learned my addr 172.21.15.42:0/1816010443 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:01.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.932+0000 7ff4f9e00640 1 --2- 172.21.15.42:0/1816010443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4fc0cfba0 0x7ff4fc156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:01.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.932+0000 7ff4fa800640 1 --2- 172.21.15.42:0/1816010443 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff4fc162500 0x7ff4fc1f9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:01.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.932+0000 7ff4f3e00640 1 -- 172.21.15.42:0/1816010443 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff4fc162500 msgr2=0x7ff4fc1f9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:01.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.932+0000 7ff4f3e00640 1 --2- 172.21.15.42:0/1816010443 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff4fc162500 0x7ff4fc1f9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:01.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.932+0000 7ff4f3e00640 1 -- 172.21.15.42:0/1816010443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4fc0cfba0 msgr2=0x7ff4fc156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:01.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.932+0000 7ff4f3e00640 1 --2- 172.21.15.42:0/1816010443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4fc0cfba0 0x7ff4fc156600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:01.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.932+0000 7ff4f3e00640 1 -- 172.21.15.42:0/1816010443 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4fc159940 con 0x7ff4fc0d0e10 2024-09-17T01:43:01.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.933+0000 7ff4f3e00640 1 --2- 172.21.15.42:0/1816010443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4fc0d0e10 0x7ff4fc1f9570 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400c3f0 tx=0x7ff4e400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:01.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.933+0000 7ff4f2000640 1 -- 172.21.15.42:0/1816010443 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4017070 con 0x7ff4fc0d0e10 2024-09-17T01:43:01.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.933+0000 7ff4f2000640 1 -- 172.21.15.42:0/1816010443 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4e40035f0 con 0x7ff4fc0d0e10 2024-09-17T01:43:01.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.933+0000 7ff4f2000640 1 -- 172.21.15.42:0/1816010443 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4003a40 con 0x7ff4fc0d0e10 2024-09-17T01:43:01.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.933+0000 7ff4fb200640 1 -- 172.21.15.42:0/1816010443 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4fc1590a0 con 0x7ff4fc0d0e10 2024-09-17T01:43:01.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.933+0000 7ff4fb200640 1 -- 172.21.15.42:0/1816010443 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4fc159660 con 0x7ff4fc0d0e10 2024-09-17T01:43:01.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.934+0000 7ff4fb200640 1 -- 172.21.15.42:0/1816010443 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4fc158e10 con 0x7ff4fc0d0e10 2024-09-17T01:43:01.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.936+0000 7ff4f2000640 1 -- 172.21.15.42:0/1816010443 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff4e401a070 con 0x7ff4fc0d0e10 2024-09-17T01:43:01.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.937+0000 7ff4f2000640 1 --2- 172.21.15.42:0/1816010443 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff4d8078b90 0x7ff4d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:01.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.937+0000 7ff4f2000640 1 -- 172.21.15.42:0/1816010443 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7ff4e4099ef0 con 0x7ff4fc0d0e10 2024-09-17T01:43:01.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.937+0000 7ff4f9e00640 1 --2- 172.21.15.42:0/1816010443 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff4d8078b90 0x7ff4d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:01.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.938+0000 7ff4f9e00640 1 --2- 172.21.15.42:0/1816010443 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff4d8078b90 0x7ff4d807b0a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec034000 tx=0x7ff4ec004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:01.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:01.941+0000 7ff4f2000640 1 -- 172.21.15.42:0/1816010443 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff4e4061d70 con 0x7ff4fc0d0e10 2024-09-17T01:43:02.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.130+0000 7ff4fb200640 1 -- 172.21.15.42:0/1816010443 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff4fc0b3a60 con 0x7ff4d8078b90 2024-09-17T01:43:02.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.136+0000 7ff4f2000640 1 -- 172.21.15.42:0/1816010443 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252468 (secure 0 0 0) 0x7ff4fc0b3a60 con 0x7ff4d8078b90 2024-09-17T01:43:02.137 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:02.138 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:43:02.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.140+0000 7ff4fb200640 1 -- 172.21.15.42:0/1816010443 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff4d8078b90 msgr2=0x7ff4d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:02.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.140+0000 7ff4fb200640 1 --2- 172.21.15.42:0/1816010443 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff4d8078b90 0x7ff4d807b0a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec034000 tx=0x7ff4ec004730 comp rx=0 tx=0).stop 2024-09-17T01:43:02.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.140+0000 7ff4fb200640 1 -- 172.21.15.42:0/1816010443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4fc0d0e10 msgr2=0x7ff4fc1f9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:02.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.140+0000 7ff4fb200640 1 --2- 172.21.15.42:0/1816010443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4fc0d0e10 0x7ff4fc1f9570 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400c3f0 tx=0x7ff4e400c8b0 comp rx=0 tx=0).stop 2024-09-17T01:43:02.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.140+0000 7ff4fb200640 1 -- 172.21.15.42:0/1816010443 shutdown_connections 2024-09-17T01:43:02.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.140+0000 7ff4fb200640 1 --2- 172.21.15.42:0/1816010443 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff4d8078b90 0x7ff4d807b0a0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:02.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.140+0000 7ff4fb200640 1 --2- 172.21.15.42:0/1816010443 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff4fc162500 0x7ff4fc1f9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:02.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.140+0000 7ff4fb200640 1 --2- 172.21.15.42:0/1816010443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4fc0d0e10 0x7ff4fc1f9570 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:02.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.140+0000 7ff4fb200640 1 --2- 172.21.15.42:0/1816010443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4fc0cfba0 0x7ff4fc156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:02.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.140+0000 7ff4fb200640 1 -- 172.21.15.42:0/1816010443 >> 172.21.15.42:0/1816010443 conn(0x7ff4fc0b6140 msgr2=0x7ff4fc0d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:02.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.140+0000 7ff4fb200640 1 -- 172.21.15.42:0/1816010443 shutdown_connections 2024-09-17T01:43:02.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.140+0000 7ff4fb200640 1 -- 172.21.15.42:0/1816010443 wait complete. 2024-09-17T01:43:02.163 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":474,"stamp":"2024-09-17T01:43:01.169771+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":138,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":445408,"kb_used_data":15468,"kb_used_omap":12,"kb_used_meta":429747,"kb_avail":754529312,"statfs":{"total":773094113280,"available":772638015488,"internally_reserved":0,"allocated":15839232,"data_stored":7592280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":440061492},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.513317"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.570820+0000","last_change":"2024-09-17T01:42:57.700166+0000","last_active":"2024-09-17T01:42:59.570820+0000","last_peered":"2024-09-17T01:42:59.570820+0000","last_clean":"2024-09-17T01:42:59.570820+0000","last_became_active":"2024-09-17T01:42:57.699755+0000","last_became_peered":"2024-09-17T01:42:57.699755+0000","last_unstale":"2024-09-17T01:42:59.570820+0000","last_undegraded":"2024-09-17T01:42:59.570820+0000","last_fullsized":"2024-09-17T01:42:59.570820+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:33.694786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571807+0000","last_change":"2024-09-17T01:42:57.695884+0000","last_active":"2024-09-17T01:42:59.571807+0000","last_peered":"2024-09-17T01:42:59.571807+0000","last_clean":"2024-09-17T01:42:59.571807+0000","last_became_active":"2024-09-17T01:42:57.695523+0000","last_became_peered":"2024-09-17T01:42:57.695523+0000","last_unstale":"2024-09-17T01:42:59.571807+0000","last_undegraded":"2024-09-17T01:42:59.571807+0000","last_fullsized":"2024-09-17T01:42:59.571807+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:06.598801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.441310+0000","last_change":"2024-09-17T01:42:57.689461+0000","last_active":"2024-09-17T01:42:59.441310+0000","last_peered":"2024-09-17T01:42:59.441310+0000","last_clean":"2024-09-17T01:42:59.441310+0000","last_became_active":"2024-09-17T01:42:57.689195+0000","last_became_peered":"2024-09-17T01:42:57.689195+0000","last_unstale":"2024-09-17T01:42:59.441310+0000","last_undegraded":"2024-09-17T01:42:59.441310+0000","last_fullsized":"2024-09-17T01:42:59.441310+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:28.658896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.675950+0000","last_change":"2024-09-17T01:42:57.698370+0000","last_active":"2024-09-17T01:42:58.675950+0000","last_peered":"2024-09-17T01:42:58.675950+0000","last_clean":"2024-09-17T01:42:58.675950+0000","last_became_active":"2024-09-17T01:42:57.697978+0000","last_became_peered":"2024-09-17T01:42:57.697978+0000","last_unstale":"2024-09-17T01:42:58.675950+0000","last_undegraded":"2024-09-17T01:42:58.675950+0000","last_fullsized":"2024-09-17T01:42:58.675950+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:14.600138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.568999+0000","last_change":"2024-09-17T01:42:57.701787+0000","last_active":"2024-09-17T01:42:59.568999+0000","last_peered":"2024-09-17T01:42:59.568999+0000","last_clean":"2024-09-17T01:42:59.568999+0000","last_became_active":"2024-09-17T01:42:57.699509+0000","last_became_peered":"2024-09-17T01:42:57.699509+0000","last_unstale":"2024-09-17T01:42:59.568999+0000","last_undegraded":"2024-09-17T01:42:59.568999+0000","last_fullsized":"2024-09-17T01:42:59.568999+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:26.662798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677908+0000","last_change":"2024-09-17T01:42:57.695198+0000","last_active":"2024-09-17T01:42:58.677908+0000","last_peered":"2024-09-17T01:42:58.677908+0000","last_clean":"2024-09-17T01:42:58.677908+0000","last_became_active":"2024-09-17T01:42:57.694867+0000","last_became_peered":"2024-09-17T01:42:57.694867+0000","last_unstale":"2024-09-17T01:42:58.677908+0000","last_undegraded":"2024-09-17T01:42:58.677908+0000","last_fullsized":"2024-09-17T01:42:58.677908+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:08.635410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677510+0000","last_change":"2024-09-17T01:42:57.699730+0000","last_active":"2024-09-17T01:42:58.677510+0000","last_peered":"2024-09-17T01:42:58.677510+0000","last_clean":"2024-09-17T01:42:58.677510+0000","last_became_active":"2024-09-17T01:42:57.699360+0000","last_became_peered":"2024-09-17T01:42:57.699360+0000","last_unstale":"2024-09-17T01:42:58.677510+0000","last_undegraded":"2024-09-17T01:42:58.677510+0000","last_fullsized":"2024-09-17T01:42:58.677510+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:10.953122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.570104+0000","last_change":"2024-09-17T01:42:57.697256+0000","last_active":"2024-09-17T01:42:59.570104+0000","last_peered":"2024-09-17T01:42:59.570104+0000","last_clean":"2024-09-17T01:42:59.570104+0000","last_became_active":"2024-09-17T01:42:57.696958+0000","last_became_peered":"2024-09-17T01:42:57.696958+0000","last_unstale":"2024-09-17T01:42:59.570104+0000","last_undegraded":"2024-09-17T01:42:59.570104+0000","last_fullsized":"2024-09-17T01:42:59.570104+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:18.422539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677293+0000","last_change":"2024-09-17T01:42:57.690812+0000","last_active":"2024-09-17T01:42:58.677293+0000","last_peered":"2024-09-17T01:42:58.677293+0000","last_clean":"2024-09-17T01:42:58.677293+0000","last_became_active":"2024-09-17T01:42:57.690458+0000","last_became_peered":"2024-09-17T01:42:57.690458+0000","last_unstale":"2024-09-17T01:42:58.677293+0000","last_undegraded":"2024-09-17T01:42:58.677293+0000","last_fullsized":"2024-09-17T01:42:58.677293+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:23.707233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.441328+0000","last_change":"2024-09-17T01:42:57.694663+0000","last_active":"2024-09-17T01:42:59.441328+0000","last_peered":"2024-09-17T01:42:59.441328+0000","last_clean":"2024-09-17T01:42:59.441328+0000","last_became_active":"2024-09-17T01:42:57.694249+0000","last_became_peered":"2024-09-17T01:42:57.694249+0000","last_unstale":"2024-09-17T01:42:59.441328+0000","last_undegraded":"2024-09-17T01:42:59.441328+0000","last_fullsized":"2024-09-17T01:42:59.441328+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:04.706171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.678145+0000","last_change":"2024-09-17T01:42:57.682344+0000","last_active":"2024-09-17T01:42:58.678145+0000","last_peered":"2024-09-17T01:42:58.678145+0000","last_clean":"2024-09-17T01:42:58.678145+0000","last_became_active":"2024-09-17T01:42:57.682025+0000","last_became_peered":"2024-09-17T01:42:57.682025+0000","last_unstale":"2024-09-17T01:42:58.678145+0000","last_undegraded":"2024-09-17T01:42:58.678145+0000","last_fullsized":"2024-09-17T01:42:58.678145+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:51.144774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.446105+0000","last_change":"2024-09-17T01:42:57.713844+0000","last_active":"2024-09-17T01:42:59.446105+0000","last_peered":"2024-09-17T01:42:59.446105+0000","last_clean":"2024-09-17T01:42:59.446105+0000","last_became_active":"2024-09-17T01:42:57.711915+0000","last_became_peered":"2024-09-17T01:42:57.711915+0000","last_unstale":"2024-09-17T01:42:59.446105+0000","last_undegraded":"2024-09-17T01:42:59.446105+0000","last_fullsized":"2024-09-17T01:42:59.446105+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:56.889291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.569184+0000","last_change":"2024-09-17T01:42:57.702461+0000","last_active":"2024-09-17T01:42:59.569184+0000","last_peered":"2024-09-17T01:42:59.569184+0000","last_clean":"2024-09-17T01:42:59.569184+0000","last_became_active":"2024-09-17T01:42:57.700075+0000","last_became_peered":"2024-09-17T01:42:57.700075+0000","last_unstale":"2024-09-17T01:42:59.569184+0000","last_undegraded":"2024-09-17T01:42:59.569184+0000","last_fullsized":"2024-09-17T01:42:59.569184+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:01.116796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.445898+0000","last_change":"2024-09-17T01:42:57.714910+0000","last_active":"2024-09-17T01:42:59.445898+0000","last_peered":"2024-09-17T01:42:59.445898+0000","last_clean":"2024-09-17T01:42:59.445898+0000","last_became_active":"2024-09-17T01:42:57.714530+0000","last_became_peered":"2024-09-17T01:42:57.714530+0000","last_unstale":"2024-09-17T01:42:59.445898+0000","last_undegraded":"2024-09-17T01:42:59.445898+0000","last_fullsized":"2024-09-17T01:42:59.445898+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:48:37.004229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.569056+0000","last_change":"2024-09-17T01:42:57.690420+0000","last_active":"2024-09-17T01:42:59.569056+0000","last_peered":"2024-09-17T01:42:59.569056+0000","last_clean":"2024-09-17T01:42:59.569056+0000","last_became_active":"2024-09-17T01:42:57.689077+0000","last_became_peered":"2024-09-17T01:42:57.689077+0000","last_unstale":"2024-09-17T01:42:59.569056+0000","last_undegraded":"2024-09-17T01:42:59.569056+0000","last_fullsized":"2024-09-17T01:42:59.569056+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:26:47.311240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.676719+0000","last_change":"2024-09-17T01:42:57.689334+0000","last_active":"2024-09-17T01:42:58.676719+0000","last_peered":"2024-09-17T01:42:58.676719+0000","last_clean":"2024-09-17T01:42:58.676719+0000","last_became_active":"2024-09-17T01:42:57.688988+0000","last_became_peered":"2024-09-17T01:42:57.688988+0000","last_unstale":"2024-09-17T01:42:58.676719+0000","last_undegraded":"2024-09-17T01:42:58.676719+0000","last_fullsized":"2024-09-17T01:42:58.676719+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:24.393955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.441611+0000","last_change":"2024-09-17T01:42:57.705810+0000","last_active":"2024-09-17T01:42:59.441611+0000","last_peered":"2024-09-17T01:42:59.441611+0000","last_clean":"2024-09-17T01:42:59.441611+0000","last_became_active":"2024-09-17T01:42:57.705305+0000","last_became_peered":"2024-09-17T01:42:57.705305+0000","last_unstale":"2024-09-17T01:42:59.441611+0000","last_undegraded":"2024-09-17T01:42:59.441611+0000","last_fullsized":"2024-09-17T01:42:59.441611+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:24.014016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.569321+0000","last_change":"2024-09-17T01:42:57.681214+0000","last_active":"2024-09-17T01:42:59.569321+0000","last_peered":"2024-09-17T01:42:59.569321+0000","last_clean":"2024-09-17T01:42:59.569321+0000","last_became_active":"2024-09-17T01:42:57.680854+0000","last_became_peered":"2024-09-17T01:42:57.680854+0000","last_unstale":"2024-09-17T01:42:59.569321+0000","last_undegraded":"2024-09-17T01:42:59.569321+0000","last_fullsized":"2024-09-17T01:42:59.569321+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:14.120505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571477+0000","last_change":"2024-09-17T01:42:57.681483+0000","last_active":"2024-09-17T01:42:59.571477+0000","last_peered":"2024-09-17T01:42:59.571477+0000","last_clean":"2024-09-17T01:42:59.571477+0000","last_became_active":"2024-09-17T01:42:57.681103+0000","last_became_peered":"2024-09-17T01:42:57.681103+0000","last_unstale":"2024-09-17T01:42:59.571477+0000","last_undegraded":"2024-09-17T01:42:59.571477+0000","last_fullsized":"2024-09-17T01:42:59.571477+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:57.506648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571133+0000","last_change":"2024-09-17T01:42:57.701351+0000","last_active":"2024-09-17T01:42:59.571133+0000","last_peered":"2024-09-17T01:42:59.571133+0000","last_clean":"2024-09-17T01:42:59.571133+0000","last_became_active":"2024-09-17T01:42:57.699715+0000","last_became_peered":"2024-09-17T01:42:57.699715+0000","last_unstale":"2024-09-17T01:42:59.571133+0000","last_undegraded":"2024-09-17T01:42:59.571133+0000","last_fullsized":"2024-09-17T01:42:59.571133+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:02.562906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.441204+0000","last_change":"2024-09-17T01:42:57.706077+0000","last_active":"2024-09-17T01:42:59.441204+0000","last_peered":"2024-09-17T01:42:59.441204+0000","last_clean":"2024-09-17T01:42:59.441204+0000","last_became_active":"2024-09-17T01:42:57.705362+0000","last_became_peered":"2024-09-17T01:42:57.705362+0000","last_unstale":"2024-09-17T01:42:59.441204+0000","last_undegraded":"2024-09-17T01:42:59.441204+0000","last_fullsized":"2024-09-17T01:42:59.441204+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:10.727780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.445930+0000","last_change":"2024-09-17T01:42:57.707600+0000","last_active":"2024-09-17T01:42:59.445930+0000","last_peered":"2024-09-17T01:42:59.445930+0000","last_clean":"2024-09-17T01:42:59.445930+0000","last_became_active":"2024-09-17T01:42:57.706939+0000","last_became_peered":"2024-09-17T01:42:57.706939+0000","last_unstale":"2024-09-17T01:42:59.445930+0000","last_undegraded":"2024-09-17T01:42:59.445930+0000","last_fullsized":"2024-09-17T01:42:59.445930+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:10.326059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.675481+0000","last_change":"2024-09-17T01:42:57.699193+0000","last_active":"2024-09-17T01:42:58.675481+0000","last_peered":"2024-09-17T01:42:58.675481+0000","last_clean":"2024-09-17T01:42:58.675481+0000","last_became_active":"2024-09-17T01:42:57.698867+0000","last_became_peered":"2024-09-17T01:42:57.698867+0000","last_unstale":"2024-09-17T01:42:58.675481+0000","last_undegraded":"2024-09-17T01:42:58.675481+0000","last_fullsized":"2024-09-17T01:42:58.675481+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:10.151191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.569075+0000","last_change":"2024-09-17T01:42:57.701279+0000","last_active":"2024-09-17T01:42:59.569075+0000","last_peered":"2024-09-17T01:42:59.569075+0000","last_clean":"2024-09-17T01:42:59.569075+0000","last_became_active":"2024-09-17T01:42:57.700145+0000","last_became_peered":"2024-09-17T01:42:57.700145+0000","last_unstale":"2024-09-17T01:42:59.569075+0000","last_undegraded":"2024-09-17T01:42:59.569075+0000","last_fullsized":"2024-09-17T01:42:59.569075+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:01:08.206170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571993+0000","last_change":"2024-09-17T01:42:57.694581+0000","last_active":"2024-09-17T01:42:59.571993+0000","last_peered":"2024-09-17T01:42:59.571993+0000","last_clean":"2024-09-17T01:42:59.571993+0000","last_became_active":"2024-09-17T01:42:57.693687+0000","last_became_peered":"2024-09-17T01:42:57.693687+0000","last_unstale":"2024-09-17T01:42:59.571993+0000","last_undegraded":"2024-09-17T01:42:59.571993+0000","last_fullsized":"2024-09-17T01:42:59.571993+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:57.251432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.570793+0000","last_change":"2024-09-17T01:42:57.699019+0000","last_active":"2024-09-17T01:42:59.570793+0000","last_peered":"2024-09-17T01:42:59.570793+0000","last_clean":"2024-09-17T01:42:59.570793+0000","last_became_active":"2024-09-17T01:42:57.698415+0000","last_became_peered":"2024-09-17T01:42:57.698415+0000","last_unstale":"2024-09-17T01:42:59.570793+0000","last_undegraded":"2024-09-17T01:42:59.570793+0000","last_fullsized":"2024-09-17T01:42:59.570793+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:47.556619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571714+0000","last_change":"2024-09-17T01:42:57.694253+0000","last_active":"2024-09-17T01:42:59.571714+0000","last_peered":"2024-09-17T01:42:59.571714+0000","last_clean":"2024-09-17T01:42:59.571714+0000","last_became_active":"2024-09-17T01:42:57.692904+0000","last_became_peered":"2024-09-17T01:42:57.692904+0000","last_unstale":"2024-09-17T01:42:59.571714+0000","last_undegraded":"2024-09-17T01:42:59.571714+0000","last_fullsized":"2024-09-17T01:42:59.571714+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:16.168268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571025+0000","last_change":"2024-09-17T01:42:57.695985+0000","last_active":"2024-09-17T01:42:59.571025+0000","last_peered":"2024-09-17T01:42:59.571025+0000","last_clean":"2024-09-17T01:42:59.571025+0000","last_became_active":"2024-09-17T01:42:57.695562+0000","last_became_peered":"2024-09-17T01:42:57.695562+0000","last_unstale":"2024-09-17T01:42:59.571025+0000","last_undegraded":"2024-09-17T01:42:59.571025+0000","last_fullsized":"2024-09-17T01:42:59.571025+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:25.338204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.570576+0000","last_change":"2024-09-17T01:42:57.694580+0000","last_active":"2024-09-17T01:42:59.570576+0000","last_peered":"2024-09-17T01:42:59.570576+0000","last_clean":"2024-09-17T01:42:59.570576+0000","last_became_active":"2024-09-17T01:42:57.694226+0000","last_became_peered":"2024-09-17T01:42:57.694226+0000","last_unstale":"2024-09-17T01:42:59.570576+0000","last_undegraded":"2024-09-17T01:42:59.570576+0000","last_fullsized":"2024-09-17T01:42:59.570576+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:07.359450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.446147+0000","last_change":"2024-09-17T01:42:57.707241+0000","last_active":"2024-09-17T01:42:59.446147+0000","last_peered":"2024-09-17T01:42:59.446147+0000","last_clean":"2024-09-17T01:42:59.446147+0000","last_became_active":"2024-09-17T01:42:57.706734+0000","last_became_peered":"2024-09-17T01:42:57.706734+0000","last_unstale":"2024-09-17T01:42:59.446147+0000","last_undegraded":"2024-09-17T01:42:59.446147+0000","last_fullsized":"2024-09-17T01:42:59.446147+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:05:47.874740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571126+0000","last_change":"2024-09-17T01:42:57.695894+0000","last_active":"2024-09-17T01:42:59.571126+0000","last_peered":"2024-09-17T01:42:59.571126+0000","last_clean":"2024-09-17T01:42:59.571126+0000","last_became_active":"2024-09-17T01:42:57.693703+0000","last_became_peered":"2024-09-17T01:42:57.693703+0000","last_unstale":"2024-09-17T01:42:59.571126+0000","last_undegraded":"2024-09-17T01:42:59.571126+0000","last_fullsized":"2024-09-17T01:42:59.571126+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:02.415574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.570815+0000","last_change":"2024-09-17T01:42:57.706718+0000","last_active":"2024-09-17T01:42:59.570815+0000","last_peered":"2024-09-17T01:42:59.570815+0000","last_clean":"2024-09-17T01:42:59.570815+0000","last_became_active":"2024-09-17T01:42:57.706065+0000","last_became_peered":"2024-09-17T01:42:57.706065+0000","last_unstale":"2024-09-17T01:42:59.570815+0000","last_undegraded":"2024-09-17T01:42:59.570815+0000","last_fullsized":"2024-09-17T01:42:59.570815+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:23:46.237276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.569308+0000","last_change":"2024-09-17T01:42:57.699578+0000","last_active":"2024-09-17T01:42:59.569308+0000","last_peered":"2024-09-17T01:42:59.569308+0000","last_clean":"2024-09-17T01:42:59.569308+0000","last_became_active":"2024-09-17T01:42:57.696964+0000","last_became_peered":"2024-09-17T01:42:57.696964+0000","last_unstale":"2024-09-17T01:42:59.569308+0000","last_undegraded":"2024-09-17T01:42:59.569308+0000","last_fullsized":"2024-09-17T01:42:59.569308+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:35.991862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"146'4","reported_seq":19,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.441560+0000","last_change":"2024-09-17T01:42:56.683623+0000","last_active":"2024-09-17T01:42:59.441560+0000","last_peered":"2024-09-17T01:42:59.441560+0000","last_clean":"2024-09-17T01:42:59.441560+0000","last_became_active":"2024-09-17T01:42:56.683332+0000","last_became_peered":"2024-09-17T01:42:56.683332+0000","last_unstale":"2024-09-17T01:42:59.441560+0000","last_undegraded":"2024-09-17T01:42:59.441560+0000","last_fullsized":"2024-09-17T01:42:59.441560+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:28.084130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.678092+0000","last_change":"2024-09-17T01:42:57.690161+0000","last_active":"2024-09-17T01:42:58.678092+0000","last_peered":"2024-09-17T01:42:58.678092+0000","last_clean":"2024-09-17T01:42:58.678092+0000","last_became_active":"2024-09-17T01:42:57.688286+0000","last_became_peered":"2024-09-17T01:42:57.688286+0000","last_unstale":"2024-09-17T01:42:58.678092+0000","last_undegraded":"2024-09-17T01:42:58.678092+0000","last_fullsized":"2024-09-17T01:42:58.678092+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:27.948090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.1e","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.678377+0000","last_change":"2024-09-17T01:42:56.687186+0000","last_active":"2024-09-17T01:42:58.678377+0000","last_peered":"2024-09-17T01:42:58.678377+0000","last_clean":"2024-09-17T01:42:58.678377+0000","last_became_active":"2024-09-17T01:42:56.686759+0000","last_became_peered":"2024-09-17T01:42:56.686759+0000","last_unstale":"2024-09-17T01:42:58.678377+0000","last_undegraded":"2024-09-17T01:42:58.678377+0000","last_fullsized":"2024-09-17T01:42:58.678377+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:23:24.885433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677825+0000","last_change":"2024-09-17T01:42:57.697497+0000","last_active":"2024-09-17T01:42:58.677825+0000","last_peered":"2024-09-17T01:42:58.677825+0000","last_clean":"2024-09-17T01:42:58.677825+0000","last_became_active":"2024-09-17T01:42:57.697180+0000","last_became_peered":"2024-09-17T01:42:57.697180+0000","last_unstale":"2024-09-17T01:42:58.677825+0000","last_undegraded":"2024-09-17T01:42:58.677825+0000","last_fullsized":"2024-09-17T01:42:58.677825+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:35.766798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1d","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.441496+0000","last_change":"2024-09-17T01:42:56.690465+0000","last_active":"2024-09-17T01:42:59.441496+0000","last_peered":"2024-09-17T01:42:59.441496+0000","last_clean":"2024-09-17T01:42:59.441496+0000","last_became_active":"2024-09-17T01:42:56.689743+0000","last_became_peered":"2024-09-17T01:42:56.689743+0000","last_unstale":"2024-09-17T01:42:59.441496+0000","last_undegraded":"2024-09-17T01:42:59.441496+0000","last_fullsized":"2024-09-17T01:42:59.441496+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:25.451833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.676189+0000","last_change":"2024-09-17T01:42:57.697800+0000","last_active":"2024-09-17T01:42:58.676189+0000","last_peered":"2024-09-17T01:42:58.676189+0000","last_clean":"2024-09-17T01:42:58.676189+0000","last_became_active":"2024-09-17T01:42:57.697446+0000","last_became_peered":"2024-09-17T01:42:57.697446+0000","last_unstale":"2024-09-17T01:42:58.676189+0000","last_undegraded":"2024-09-17T01:42:58.676189+0000","last_fullsized":"2024-09-17T01:42:58.676189+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:20.194771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.441364+0000","last_change":"2024-09-17T01:42:56.682984+0000","last_active":"2024-09-17T01:42:59.441364+0000","last_peered":"2024-09-17T01:42:59.441364+0000","last_clean":"2024-09-17T01:42:59.441364+0000","last_became_active":"2024-09-17T01:42:56.682648+0000","last_became_peered":"2024-09-17T01:42:56.682648+0000","last_unstale":"2024-09-17T01:42:59.441364+0000","last_undegraded":"2024-09-17T01:42:59.441364+0000","last_fullsized":"2024-09-17T01:42:59.441364+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:24.281138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.570521+0000","last_change":"2024-09-17T01:42:57.704961+0000","last_active":"2024-09-17T01:42:59.570521+0000","last_peered":"2024-09-17T01:42:59.570521+0000","last_clean":"2024-09-17T01:42:59.570521+0000","last_became_active":"2024-09-17T01:42:57.704598+0000","last_became_peered":"2024-09-17T01:42:57.704598+0000","last_unstale":"2024-09-17T01:42:59.570521+0000","last_undegraded":"2024-09-17T01:42:59.570521+0000","last_fullsized":"2024-09-17T01:42:59.570521+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:29.547198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571347+0000","last_change":"2024-09-17T01:42:56.679527+0000","last_active":"2024-09-17T01:42:59.571347+0000","last_peered":"2024-09-17T01:42:59.571347+0000","last_clean":"2024-09-17T01:42:59.571347+0000","last_became_active":"2024-09-17T01:42:56.678908+0000","last_became_peered":"2024-09-17T01:42:56.678908+0000","last_unstale":"2024-09-17T01:42:59.571347+0000","last_undegraded":"2024-09-17T01:42:59.571347+0000","last_fullsized":"2024-09-17T01:42:59.571347+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:16.477582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.676141+0000","last_change":"2024-09-17T01:42:57.696723+0000","last_active":"2024-09-17T01:42:58.676141+0000","last_peered":"2024-09-17T01:42:58.676141+0000","last_clean":"2024-09-17T01:42:58.676141+0000","last_became_active":"2024-09-17T01:42:57.696267+0000","last_became_peered":"2024-09-17T01:42:57.696267+0000","last_unstale":"2024-09-17T01:42:58.676141+0000","last_undegraded":"2024-09-17T01:42:58.676141+0000","last_fullsized":"2024-09-17T01:42:58.676141+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:45.947317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.569265+0000","last_change":"2024-09-17T01:42:56.687876+0000","last_active":"2024-09-17T01:42:59.569265+0000","last_peered":"2024-09-17T01:42:59.569265+0000","last_clean":"2024-09-17T01:42:59.569265+0000","last_became_active":"2024-09-17T01:42:56.687517+0000","last_became_peered":"2024-09-17T01:42:56.687517+0000","last_unstale":"2024-09-17T01:42:59.569265+0000","last_undegraded":"2024-09-17T01:42:59.569265+0000","last_fullsized":"2024-09-17T01:42:59.569265+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:51.276938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.570864+0000","last_change":"2024-09-17T01:42:57.704954+0000","last_active":"2024-09-17T01:42:59.570864+0000","last_peered":"2024-09-17T01:42:59.570864+0000","last_clean":"2024-09-17T01:42:59.570864+0000","last_became_active":"2024-09-17T01:42:57.704441+0000","last_became_peered":"2024-09-17T01:42:57.704441+0000","last_unstale":"2024-09-17T01:42:59.570864+0000","last_undegraded":"2024-09-17T01:42:59.570864+0000","last_fullsized":"2024-09-17T01:42:59.570864+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:34:32.038694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677559+0000","last_change":"2024-09-17T01:42:56.674303+0000","last_active":"2024-09-17T01:42:58.677559+0000","last_peered":"2024-09-17T01:42:58.677559+0000","last_clean":"2024-09-17T01:42:58.677559+0000","last_became_active":"2024-09-17T01:42:56.673892+0000","last_became_peered":"2024-09-17T01:42:56.673892+0000","last_unstale":"2024-09-17T01:42:58.677559+0000","last_undegraded":"2024-09-17T01:42:58.677559+0000","last_fullsized":"2024-09-17T01:42:58.677559+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:01:25.236818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.675555+0000","last_change":"2024-09-17T01:42:57.697502+0000","last_active":"2024-09-17T01:42:58.675555+0000","last_peered":"2024-09-17T01:42:58.675555+0000","last_clean":"2024-09-17T01:42:58.675555+0000","last_became_active":"2024-09-17T01:42:57.696794+0000","last_became_peered":"2024-09-17T01:42:57.696794+0000","last_unstale":"2024-09-17T01:42:58.675555+0000","last_undegraded":"2024-09-17T01:42:58.675555+0000","last_fullsized":"2024-09-17T01:42:58.675555+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:44.099890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.441249+0000","last_change":"2024-09-17T01:42:56.685388+0000","last_active":"2024-09-17T01:42:59.441249+0000","last_peered":"2024-09-17T01:42:59.441249+0000","last_clean":"2024-09-17T01:42:59.441249+0000","last_became_active":"2024-09-17T01:42:56.685097+0000","last_became_peered":"2024-09-17T01:42:56.685097+0000","last_unstale":"2024-09-17T01:42:59.441249+0000","last_undegraded":"2024-09-17T01:42:59.441249+0000","last_fullsized":"2024-09-17T01:42:59.441249+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:55.467416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.676386+0000","last_change":"2024-09-17T01:42:57.695811+0000","last_active":"2024-09-17T01:42:58.676386+0000","last_peered":"2024-09-17T01:42:58.676386+0000","last_clean":"2024-09-17T01:42:58.676386+0000","last_became_active":"2024-09-17T01:42:57.695516+0000","last_became_peered":"2024-09-17T01:42:57.695516+0000","last_unstale":"2024-09-17T01:42:58.676386+0000","last_undegraded":"2024-09-17T01:42:58.676386+0000","last_fullsized":"2024-09-17T01:42:58.676386+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:25.174148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677430+0000","last_change":"2024-09-17T01:42:56.672017+0000","last_active":"2024-09-17T01:42:58.677430+0000","last_peered":"2024-09-17T01:42:58.677430+0000","last_clean":"2024-09-17T01:42:58.677430+0000","last_became_active":"2024-09-17T01:42:56.671041+0000","last_became_peered":"2024-09-17T01:42:56.671041+0000","last_unstale":"2024-09-17T01:42:58.677430+0000","last_undegraded":"2024-09-17T01:42:58.677430+0000","last_fullsized":"2024-09-17T01:42:58.677430+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:25.229621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.446160+0000","last_change":"2024-09-17T01:42:57.715324+0000","last_active":"2024-09-17T01:42:59.446160+0000","last_peered":"2024-09-17T01:42:59.446160+0000","last_clean":"2024-09-17T01:42:59.446160+0000","last_became_active":"2024-09-17T01:42:57.714374+0000","last_became_peered":"2024-09-17T01:42:57.714374+0000","last_unstale":"2024-09-17T01:42:59.446160+0000","last_undegraded":"2024-09-17T01:42:59.446160+0000","last_fullsized":"2024-09-17T01:42:59.446160+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:47:24.877388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.569447+0000","last_change":"2024-09-17T01:42:56.685480+0000","last_active":"2024-09-17T01:42:59.569447+0000","last_peered":"2024-09-17T01:42:59.569447+0000","last_clean":"2024-09-17T01:42:59.569447+0000","last_became_active":"2024-09-17T01:42:56.682532+0000","last_became_peered":"2024-09-17T01:42:56.682532+0000","last_unstale":"2024-09-17T01:42:59.569447+0000","last_undegraded":"2024-09-17T01:42:59.569447+0000","last_fullsized":"2024-09-17T01:42:59.569447+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:20.526898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677350+0000","last_change":"2024-09-17T01:42:57.693133+0000","last_active":"2024-09-17T01:42:58.677350+0000","last_peered":"2024-09-17T01:42:58.677350+0000","last_clean":"2024-09-17T01:42:58.677350+0000","last_became_active":"2024-09-17T01:42:57.692822+0000","last_became_peered":"2024-09-17T01:42:57.692822+0000","last_unstale":"2024-09-17T01:42:58.677350+0000","last_undegraded":"2024-09-17T01:42:58.677350+0000","last_fullsized":"2024-09-17T01:42:58.677350+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:57.522458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"146'6","reported_seq":21,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677245+0000","last_change":"2024-09-17T01:42:56.686492+0000","last_active":"2024-09-17T01:42:58.677245+0000","last_peered":"2024-09-17T01:42:58.677245+0000","last_clean":"2024-09-17T01:42:58.677245+0000","last_became_active":"2024-09-17T01:42:56.686037+0000","last_became_peered":"2024-09-17T01:42:56.686037+0000","last_unstale":"2024-09-17T01:42:58.677245+0000","last_undegraded":"2024-09-17T01:42:58.677245+0000","last_fullsized":"2024-09-17T01:42:58.677245+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:44.994594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.675856+0000","last_change":"2024-09-17T01:42:57.701228+0000","last_active":"2024-09-17T01:42:58.675856+0000","last_peered":"2024-09-17T01:42:58.675856+0000","last_clean":"2024-09-17T01:42:58.675856+0000","last_became_active":"2024-09-17T01:42:57.699630+0000","last_became_peered":"2024-09-17T01:42:57.699630+0000","last_unstale":"2024-09-17T01:42:58.675856+0000","last_undegraded":"2024-09-17T01:42:58.675856+0000","last_fullsized":"2024-09-17T01:42:58.675856+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:10.764105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.441188+0000","last_change":"2024-09-17T01:42:56.688578+0000","last_active":"2024-09-17T01:42:59.441188+0000","last_peered":"2024-09-17T01:42:59.441188+0000","last_clean":"2024-09-17T01:42:59.441188+0000","last_became_active":"2024-09-17T01:42:56.688237+0000","last_became_peered":"2024-09-17T01:42:56.688237+0000","last_unstale":"2024-09-17T01:42:59.441188+0000","last_undegraded":"2024-09-17T01:42:59.441188+0000","last_fullsized":"2024-09-17T01:42:59.441188+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:07.272399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.570191+0000","last_change":"2024-09-17T01:42:57.699136+0000","last_active":"2024-09-17T01:42:59.570191+0000","last_peered":"2024-09-17T01:42:59.570191+0000","last_clean":"2024-09-17T01:42:59.570191+0000","last_became_active":"2024-09-17T01:42:57.698813+0000","last_became_peered":"2024-09-17T01:42:57.698813+0000","last_unstale":"2024-09-17T01:42:59.570191+0000","last_undegraded":"2024-09-17T01:42:59.570191+0000","last_fullsized":"2024-09-17T01:42:59.570191+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:25.618345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.446230+0000","last_change":"2024-09-17T01:42:56.688887+0000","last_active":"2024-09-17T01:42:59.446230+0000","last_peered":"2024-09-17T01:42:59.446230+0000","last_clean":"2024-09-17T01:42:59.446230+0000","last_became_active":"2024-09-17T01:42:56.688559+0000","last_became_peered":"2024-09-17T01:42:56.688559+0000","last_unstale":"2024-09-17T01:42:59.446230+0000","last_undegraded":"2024-09-17T01:42:59.446230+0000","last_fullsized":"2024-09-17T01:42:59.446230+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:49.475665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.675488+0000","last_change":"2024-09-17T01:42:57.692049+0000","last_active":"2024-09-17T01:42:58.675488+0000","last_peered":"2024-09-17T01:42:58.675488+0000","last_clean":"2024-09-17T01:42:58.675488+0000","last_became_active":"2024-09-17T01:42:57.691760+0000","last_became_peered":"2024-09-17T01:42:57.691760+0000","last_unstale":"2024-09-17T01:42:58.675488+0000","last_undegraded":"2024-09-17T01:42:58.675488+0000","last_fullsized":"2024-09-17T01:42:58.675488+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:39:31.915345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571277+0000","last_change":"2024-09-17T01:42:56.689578+0000","last_active":"2024-09-17T01:42:59.571277+0000","last_peered":"2024-09-17T01:42:59.571277+0000","last_clean":"2024-09-17T01:42:59.571277+0000","last_became_active":"2024-09-17T01:42:56.688126+0000","last_became_peered":"2024-09-17T01:42:56.688126+0000","last_unstale":"2024-09-17T01:42:59.571277+0000","last_undegraded":"2024-09-17T01:42:59.571277+0000","last_fullsized":"2024-09-17T01:42:59.571277+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:52:29.908251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.676134+0000","last_change":"2024-09-17T01:42:57.697177+0000","last_active":"2024-09-17T01:42:58.676134+0000","last_peered":"2024-09-17T01:42:58.676134+0000","last_clean":"2024-09-17T01:42:58.676134+0000","last_became_active":"2024-09-17T01:42:57.694325+0000","last_became_peered":"2024-09-17T01:42:57.694325+0000","last_unstale":"2024-09-17T01:42:58.676134+0000","last_undegraded":"2024-09-17T01:42:58.676134+0000","last_fullsized":"2024-09-17T01:42:58.676134+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:06:26.948086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"146'8","reported_seq":23,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.570030+0000","last_change":"2024-09-17T01:42:56.680506+0000","last_active":"2024-09-17T01:42:59.570030+0000","last_peered":"2024-09-17T01:42:59.570030+0000","last_clean":"2024-09-17T01:42:59.570030+0000","last_became_active":"2024-09-17T01:42:56.680165+0000","last_became_peered":"2024-09-17T01:42:56.680165+0000","last_unstale":"2024-09-17T01:42:59.570030+0000","last_undegraded":"2024-09-17T01:42:59.570030+0000","last_fullsized":"2024-09-17T01:42:59.570030+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:44:45.071424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.569534+0000","last_change":"2024-09-17T01:42:57.699072+0000","last_active":"2024-09-17T01:42:59.569534+0000","last_peered":"2024-09-17T01:42:59.569534+0000","last_clean":"2024-09-17T01:42:59.569534+0000","last_became_active":"2024-09-17T01:42:57.698185+0000","last_became_peered":"2024-09-17T01:42:57.698185+0000","last_unstale":"2024-09-17T01:42:59.569534+0000","last_undegraded":"2024-09-17T01:42:59.569534+0000","last_fullsized":"2024-09-17T01:42:59.569534+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:15:28.078605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.676457+0000","last_change":"2024-09-17T01:42:56.690934+0000","last_active":"2024-09-17T01:42:58.676457+0000","last_peered":"2024-09-17T01:42:58.676457+0000","last_clean":"2024-09-17T01:42:58.676457+0000","last_became_active":"2024-09-17T01:42:56.690569+0000","last_became_peered":"2024-09-17T01:42:56.690569+0000","last_unstale":"2024-09-17T01:42:58.676457+0000","last_undegraded":"2024-09-17T01:42:58.676457+0000","last_fullsized":"2024-09-17T01:42:58.676457+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:37.745938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571983+0000","last_change":"2024-09-17T01:42:57.696297+0000","last_active":"2024-09-17T01:42:59.571983+0000","last_peered":"2024-09-17T01:42:59.571983+0000","last_clean":"2024-09-17T01:42:59.571983+0000","last_became_active":"2024-09-17T01:42:57.695950+0000","last_became_peered":"2024-09-17T01:42:57.695950+0000","last_unstale":"2024-09-17T01:42:59.571983+0000","last_undegraded":"2024-09-17T01:42:59.571983+0000","last_fullsized":"2024-09-17T01:42:59.571983+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:47.107767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.e","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.570500+0000","last_change":"2024-09-17T01:42:56.685379+0000","last_active":"2024-09-17T01:42:59.570500+0000","last_peered":"2024-09-17T01:42:59.570500+0000","last_clean":"2024-09-17T01:42:59.570500+0000","last_became_active":"2024-09-17T01:42:56.684998+0000","last_became_peered":"2024-09-17T01:42:56.684998+0000","last_unstale":"2024-09-17T01:42:59.570500+0000","last_undegraded":"2024-09-17T01:42:59.570500+0000","last_fullsized":"2024-09-17T01:42:59.570500+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:28.792517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.569085+0000","last_change":"2024-09-17T01:42:57.700440+0000","last_active":"2024-09-17T01:42:59.569085+0000","last_peered":"2024-09-17T01:42:59.569085+0000","last_clean":"2024-09-17T01:42:59.569085+0000","last_became_active":"2024-09-17T01:42:57.700120+0000","last_became_peered":"2024-09-17T01:42:57.700120+0000","last_unstale":"2024-09-17T01:42:59.569085+0000","last_undegraded":"2024-09-17T01:42:59.569085+0000","last_fullsized":"2024-09-17T01:42:59.569085+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:48.337411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.678423+0000","last_change":"2024-09-17T01:42:56.681447+0000","last_active":"2024-09-17T01:42:58.678423+0000","last_peered":"2024-09-17T01:42:58.678423+0000","last_clean":"2024-09-17T01:42:58.678423+0000","last_became_active":"2024-09-17T01:42:56.680795+0000","last_became_peered":"2024-09-17T01:42:56.680795+0000","last_unstale":"2024-09-17T01:42:58.678423+0000","last_undegraded":"2024-09-17T01:42:58.678423+0000","last_fullsized":"2024-09-17T01:42:58.678423+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:25.613391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.678238+0000","last_change":"2024-09-17T01:42:57.701081+0000","last_active":"2024-09-17T01:42:58.678238+0000","last_peered":"2024-09-17T01:42:58.678238+0000","last_clean":"2024-09-17T01:42:58.678238+0000","last_became_active":"2024-09-17T01:42:57.699731+0000","last_became_peered":"2024-09-17T01:42:57.699731+0000","last_unstale":"2024-09-17T01:42:58.678238+0000","last_undegraded":"2024-09-17T01:42:58.678238+0000","last_fullsized":"2024-09-17T01:42:58.678238+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:01:06.944310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.570895+0000","last_change":"2024-09-17T01:42:56.688794+0000","last_active":"2024-09-17T01:42:59.570895+0000","last_peered":"2024-09-17T01:42:59.570895+0000","last_clean":"2024-09-17T01:42:59.570895+0000","last_became_active":"2024-09-17T01:42:56.688421+0000","last_became_peered":"2024-09-17T01:42:56.688421+0000","last_unstale":"2024-09-17T01:42:59.570895+0000","last_undegraded":"2024-09-17T01:42:59.570895+0000","last_fullsized":"2024-09-17T01:42:59.570895+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:09.762975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.446216+0000","last_change":"2024-09-17T01:42:57.708626+0000","last_active":"2024-09-17T01:42:59.446216+0000","last_peered":"2024-09-17T01:42:59.446216+0000","last_clean":"2024-09-17T01:42:59.446216+0000","last_became_active":"2024-09-17T01:42:57.707496+0000","last_became_peered":"2024-09-17T01:42:57.707496+0000","last_unstale":"2024-09-17T01:42:59.446216+0000","last_undegraded":"2024-09-17T01:42:59.446216+0000","last_fullsized":"2024-09-17T01:42:59.446216+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:11.928724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677988+0000","last_change":"2024-09-17T01:42:56.689278+0000","last_active":"2024-09-17T01:42:58.677988+0000","last_peered":"2024-09-17T01:42:58.677988+0000","last_clean":"2024-09-17T01:42:58.677988+0000","last_became_active":"2024-09-17T01:42:56.688717+0000","last_became_peered":"2024-09-17T01:42:56.688717+0000","last_unstale":"2024-09-17T01:42:58.677988+0000","last_undegraded":"2024-09-17T01:42:58.677988+0000","last_fullsized":"2024-09-17T01:42:58.677988+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:30.266364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571016+0000","last_change":"2024-09-17T01:42:57.694677+0000","last_active":"2024-09-17T01:42:59.571016+0000","last_peered":"2024-09-17T01:42:59.571016+0000","last_clean":"2024-09-17T01:42:59.571016+0000","last_became_active":"2024-09-17T01:42:57.694334+0000","last_became_peered":"2024-09-17T01:42:57.694334+0000","last_unstale":"2024-09-17T01:42:59.571016+0000","last_undegraded":"2024-09-17T01:42:59.571016+0000","last_fullsized":"2024-09-17T01:42:59.571016+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:57.569365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.675928+0000","last_change":"2024-09-17T01:42:56.684686+0000","last_active":"2024-09-17T01:42:58.675928+0000","last_peered":"2024-09-17T01:42:58.675928+0000","last_clean":"2024-09-17T01:42:58.675928+0000","last_became_active":"2024-09-17T01:42:56.684389+0000","last_became_peered":"2024-09-17T01:42:56.684389+0000","last_unstale":"2024-09-17T01:42:58.675928+0000","last_undegraded":"2024-09-17T01:42:58.675928+0000","last_fullsized":"2024-09-17T01:42:58.675928+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:33.890204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.445911+0000","last_change":"2024-09-17T01:42:57.699715+0000","last_active":"2024-09-17T01:42:59.445911+0000","last_peered":"2024-09-17T01:42:59.445911+0000","last_clean":"2024-09-17T01:42:59.445911+0000","last_became_active":"2024-09-17T01:42:57.699343+0000","last_became_peered":"2024-09-17T01:42:57.699343+0000","last_unstale":"2024-09-17T01:42:59.445911+0000","last_undegraded":"2024-09-17T01:42:59.445911+0000","last_fullsized":"2024-09-17T01:42:59.445911+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:04.565456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.675630+0000","last_change":"2024-09-17T01:42:56.691836+0000","last_active":"2024-09-17T01:42:58.675630+0000","last_peered":"2024-09-17T01:42:58.675630+0000","last_clean":"2024-09-17T01:42:58.675630+0000","last_became_active":"2024-09-17T01:42:56.689596+0000","last_became_peered":"2024-09-17T01:42:56.689596+0000","last_unstale":"2024-09-17T01:42:58.675630+0000","last_undegraded":"2024-09-17T01:42:58.675630+0000","last_fullsized":"2024-09-17T01:42:58.675630+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:23.663630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571165+0000","last_change":"2024-09-17T01:42:57.697880+0000","last_active":"2024-09-17T01:42:59.571165+0000","last_peered":"2024-09-17T01:42:59.571165+0000","last_clean":"2024-09-17T01:42:59.571165+0000","last_became_active":"2024-09-17T01:42:57.696382+0000","last_became_peered":"2024-09-17T01:42:57.696382+0000","last_unstale":"2024-09-17T01:42:59.571165+0000","last_undegraded":"2024-09-17T01:42:59.571165+0000","last_fullsized":"2024-09-17T01:42:59.571165+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:29.406603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.675681+0000","last_change":"2024-09-17T01:42:56.688129+0000","last_active":"2024-09-17T01:42:58.675681+0000","last_peered":"2024-09-17T01:42:58.675681+0000","last_clean":"2024-09-17T01:42:58.675681+0000","last_became_active":"2024-09-17T01:42:56.687724+0000","last_became_peered":"2024-09-17T01:42:56.687724+0000","last_unstale":"2024-09-17T01:42:58.675681+0000","last_undegraded":"2024-09-17T01:42:58.675681+0000","last_fullsized":"2024-09-17T01:42:58.675681+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:34.627342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.676533+0000","last_change":"2024-09-17T01:42:57.696459+0000","last_active":"2024-09-17T01:42:58.676533+0000","last_peered":"2024-09-17T01:42:58.676533+0000","last_clean":"2024-09-17T01:42:58.676533+0000","last_became_active":"2024-09-17T01:42:57.694746+0000","last_became_peered":"2024-09-17T01:42:57.694746+0000","last_unstale":"2024-09-17T01:42:58.676533+0000","last_undegraded":"2024-09-17T01:42:58.676533+0000","last_fullsized":"2024-09-17T01:42:58.676533+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:43.347912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.676580+0000","last_change":"2024-09-17T01:42:56.690888+0000","last_active":"2024-09-17T01:42:58.676580+0000","last_peered":"2024-09-17T01:42:58.676580+0000","last_clean":"2024-09-17T01:42:58.676580+0000","last_became_active":"2024-09-17T01:42:56.690133+0000","last_became_peered":"2024-09-17T01:42:56.690133+0000","last_unstale":"2024-09-17T01:42:58.676580+0000","last_undegraded":"2024-09-17T01:42:58.676580+0000","last_fullsized":"2024-09-17T01:42:58.676580+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:57.120214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.676528+0000","last_change":"2024-09-17T01:42:57.695835+0000","last_active":"2024-09-17T01:42:58.676528+0000","last_peered":"2024-09-17T01:42:58.676528+0000","last_clean":"2024-09-17T01:42:58.676528+0000","last_became_active":"2024-09-17T01:42:57.695458+0000","last_became_peered":"2024-09-17T01:42:57.695458+0000","last_unstale":"2024-09-17T01:42:58.676528+0000","last_undegraded":"2024-09-17T01:42:58.676528+0000","last_fullsized":"2024-09-17T01:42:58.676528+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:43.476021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"147'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.682384+0000","last_change":"2024-09-17T01:42:56.692834+0000","last_active":"2024-09-17T01:42:59.682384+0000","last_peered":"2024-09-17T01:42:59.682384+0000","last_clean":"2024-09-17T01:42:59.682384+0000","last_became_active":"2024-09-17T01:42:56.692478+0000","last_became_peered":"2024-09-17T01:42:56.692478+0000","last_unstale":"2024-09-17T01:42:59.682384+0000","last_undegraded":"2024-09-17T01:42:59.682384+0000","last_fullsized":"2024-09-17T01:42:59.682384+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:14.550195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571335+0000","last_change":"2024-09-17T01:42:57.700993+0000","last_active":"2024-09-17T01:42:59.571335+0000","last_peered":"2024-09-17T01:42:59.571335+0000","last_clean":"2024-09-17T01:42:59.571335+0000","last_became_active":"2024-09-17T01:42:57.696525+0000","last_became_peered":"2024-09-17T01:42:57.696525+0000","last_unstale":"2024-09-17T01:42:59.571335+0000","last_undegraded":"2024-09-17T01:42:59.571335+0000","last_fullsized":"2024-09-17T01:42:59.571335+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:02.227852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677624+0000","last_change":"2024-09-17T01:42:56.681738+0000","last_active":"2024-09-17T01:42:58.677624+0000","last_peered":"2024-09-17T01:42:58.677624+0000","last_clean":"2024-09-17T01:42:58.677624+0000","last_became_active":"2024-09-17T01:42:56.681255+0000","last_became_peered":"2024-09-17T01:42:56.681255+0000","last_unstale":"2024-09-17T01:42:58.677624+0000","last_undegraded":"2024-09-17T01:42:58.677624+0000","last_fullsized":"2024-09-17T01:42:58.677624+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:11.883828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571076+0000","last_change":"2024-09-17T01:42:57.703471+0000","last_active":"2024-09-17T01:42:59.571076+0000","last_peered":"2024-09-17T01:42:59.571076+0000","last_clean":"2024-09-17T01:42:59.571076+0000","last_became_active":"2024-09-17T01:42:57.702558+0000","last_became_peered":"2024-09-17T01:42:57.702558+0000","last_unstale":"2024-09-17T01:42:59.571076+0000","last_undegraded":"2024-09-17T01:42:59.571076+0000","last_fullsized":"2024-09-17T01:42:59.571076+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:05.763830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677376+0000","last_change":"2024-09-17T01:42:56.685353+0000","last_active":"2024-09-17T01:42:58.677376+0000","last_peered":"2024-09-17T01:42:58.677376+0000","last_clean":"2024-09-17T01:42:58.677376+0000","last_became_active":"2024-09-17T01:42:56.684915+0000","last_became_peered":"2024-09-17T01:42:56.684915+0000","last_unstale":"2024-09-17T01:42:58.677376+0000","last_undegraded":"2024-09-17T01:42:58.677376+0000","last_fullsized":"2024-09-17T01:42:58.677376+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:59:30.156646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677816+0000","last_change":"2024-09-17T01:42:57.697059+0000","last_active":"2024-09-17T01:42:58.677816+0000","last_peered":"2024-09-17T01:42:58.677816+0000","last_clean":"2024-09-17T01:42:58.677816+0000","last_became_active":"2024-09-17T01:42:57.696639+0000","last_became_peered":"2024-09-17T01:42:57.696639+0000","last_unstale":"2024-09-17T01:42:58.677816+0000","last_undegraded":"2024-09-17T01:42:58.677816+0000","last_fullsized":"2024-09-17T01:42:58.677816+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:45.362821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571154+0000","last_change":"2024-09-17T01:42:56.685053+0000","last_active":"2024-09-17T01:42:59.571154+0000","last_peered":"2024-09-17T01:42:59.571154+0000","last_clean":"2024-09-17T01:42:59.571154+0000","last_became_active":"2024-09-17T01:42:56.684753+0000","last_became_peered":"2024-09-17T01:42:56.684753+0000","last_unstale":"2024-09-17T01:42:59.571154+0000","last_undegraded":"2024-09-17T01:42:59.571154+0000","last_fullsized":"2024-09-17T01:42:59.571154+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:53.206898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.676346+0000","last_change":"2024-09-17T01:42:57.694950+0000","last_active":"2024-09-17T01:42:58.676346+0000","last_peered":"2024-09-17T01:42:58.676346+0000","last_clean":"2024-09-17T01:42:58.676346+0000","last_became_active":"2024-09-17T01:42:57.694605+0000","last_became_peered":"2024-09-17T01:42:57.694605+0000","last_unstale":"2024-09-17T01:42:58.676346+0000","last_undegraded":"2024-09-17T01:42:58.676346+0000","last_fullsized":"2024-09-17T01:42:58.676346+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:22.611482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.441052+0000","last_change":"2024-09-17T01:42:56.689553+0000","last_active":"2024-09-17T01:42:59.441052+0000","last_peered":"2024-09-17T01:42:59.441052+0000","last_clean":"2024-09-17T01:42:59.441052+0000","last_became_active":"2024-09-17T01:42:56.687542+0000","last_became_peered":"2024-09-17T01:42:56.687542+0000","last_unstale":"2024-09-17T01:42:59.441052+0000","last_undegraded":"2024-09-17T01:42:59.441052+0000","last_fullsized":"2024-09-17T01:42:59.441052+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:13.200284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.675503+0000","last_change":"2024-09-17T01:42:57.691361+0000","last_active":"2024-09-17T01:42:58.675503+0000","last_peered":"2024-09-17T01:42:58.675503+0000","last_clean":"2024-09-17T01:42:58.675503+0000","last_became_active":"2024-09-17T01:42:57.691049+0000","last_became_peered":"2024-09-17T01:42:57.691049+0000","last_unstale":"2024-09-17T01:42:58.675503+0000","last_undegraded":"2024-09-17T01:42:58.675503+0000","last_fullsized":"2024-09-17T01:42:58.675503+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:14.617948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.445611+0000","last_change":"2024-09-17T01:42:56.683117+0000","last_active":"2024-09-17T01:42:59.445611+0000","last_peered":"2024-09-17T01:42:59.445611+0000","last_clean":"2024-09-17T01:42:59.445611+0000","last_became_active":"2024-09-17T01:42:56.682795+0000","last_became_peered":"2024-09-17T01:42:56.682795+0000","last_unstale":"2024-09-17T01:42:59.445611+0000","last_undegraded":"2024-09-17T01:42:59.445611+0000","last_fullsized":"2024-09-17T01:42:59.445611+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:56.245103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.441071+0000","last_change":"2024-09-17T01:42:57.688270+0000","last_active":"2024-09-17T01:42:59.441071+0000","last_peered":"2024-09-17T01:42:59.441071+0000","last_clean":"2024-09-17T01:42:59.441071+0000","last_became_active":"2024-09-17T01:42:57.687985+0000","last_became_peered":"2024-09-17T01:42:57.687985+0000","last_unstale":"2024-09-17T01:42:59.441071+0000","last_undegraded":"2024-09-17T01:42:59.441071+0000","last_fullsized":"2024-09-17T01:42:59.441071+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:23.411782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677288+0000","last_change":"2024-09-17T01:42:56.676329+0000","last_active":"2024-09-17T01:42:58.677288+0000","last_peered":"2024-09-17T01:42:58.677288+0000","last_clean":"2024-09-17T01:42:58.677288+0000","last_became_active":"2024-09-17T01:42:56.675978+0000","last_became_peered":"2024-09-17T01:42:56.675978+0000","last_unstale":"2024-09-17T01:42:58.677288+0000","last_undegraded":"2024-09-17T01:42:58.677288+0000","last_fullsized":"2024-09-17T01:42:58.677288+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:18.503158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677089+0000","last_change":"2024-09-17T01:42:57.686472+0000","last_active":"2024-09-17T01:42:58.677089+0000","last_peered":"2024-09-17T01:42:58.677089+0000","last_clean":"2024-09-17T01:42:58.677089+0000","last_became_active":"2024-09-17T01:42:57.686092+0000","last_became_peered":"2024-09-17T01:42:57.686092+0000","last_unstale":"2024-09-17T01:42:58.677089+0000","last_undegraded":"2024-09-17T01:42:58.677089+0000","last_fullsized":"2024-09-17T01:42:58.677089+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:41.669396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"146'3","reported_seq":18,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.446053+0000","last_change":"2024-09-17T01:42:56.683406+0000","last_active":"2024-09-17T01:42:59.446053+0000","last_peered":"2024-09-17T01:42:59.446053+0000","last_clean":"2024-09-17T01:42:59.446053+0000","last_became_active":"2024-09-17T01:42:56.682861+0000","last_became_peered":"2024-09-17T01:42:56.682861+0000","last_unstale":"2024-09-17T01:42:59.446053+0000","last_undegraded":"2024-09-17T01:42:59.446053+0000","last_fullsized":"2024-09-17T01:42:59.446053+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:07.902176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":348,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.568707+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:42:59.568707+0000","last_peered":"2024-09-17T01:42:59.568707+0000","last_clean":"2024-09-17T01:42:59.568707+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:42:59.568707+0000","last_undegraded":"2024-09-17T01:42:59.568707+0000","last_fullsized":"2024-09-17T01:42:59.568707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59348,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312492,"statfs":{"total":96636764160,"available":96575991808,"internally_reserved":0,"allocated":1835008,"data_stored":804800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509576,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32968,"kb_used_data":1776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338872,"statfs":{"total":96636764160,"available":96603004928,"internally_reserved":0,"allocated":1818624,"data_stored":798478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509575,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59344,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312496,"statfs":{"total":96636764160,"available":96575995904,"internally_reserved":0,"allocated":1830912,"data_stored":804778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509576,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63516,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308324,"statfs":{"total":96636764160,"available":96571723776,"internally_reserved":0,"allocated":1839104,"data_stored":800694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509576,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59344,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312496,"statfs":{"total":96636764160,"available":96575995904,"internally_reserved":0,"allocated":1826816,"data_stored":799094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509575,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59920,"kb_used_data":2360,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311920,"statfs":{"total":96636764160,"available":96575406080,"internally_reserved":0,"allocated":2416640,"data_stored":1388916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509577,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51028,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320812,"statfs":{"total":96636764160,"available":96584511488,"internally_reserved":0,"allocated":1835008,"data_stored":804868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":50395593},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542281,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59940,"kb_used_data":2380,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311900,"statfs":{"total":96636764160,"available":96575385600,"internally_reserved":0,"allocated":2437120,"data_stored":1390652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:43:02.168 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:43:02.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.434+0000 7fb6d2a00640 1 -- 172.21.15.42:0/1881326695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6cc06d260 msgr2=0x7fb6cc152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:02.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.434+0000 7fb6d2a00640 1 --2- 172.21.15.42:0/1881326695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6cc06d260 0x7fb6cc152ed0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc071cb0 tx=0x7fb6c402aa10 comp rx=0 tx=0).stop 2024-09-17T01:43:02.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.434+0000 7fb6d2a00640 1 -- 172.21.15.42:0/1881326695 shutdown_connections 2024-09-17T01:43:02.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.434+0000 7fb6d2a00640 1 --2- 172.21.15.42:0/1881326695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6cc06d260 0x7fb6cc152ed0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:02.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.434+0000 7fb6d2a00640 1 --2- 172.21.15.42:0/1881326695 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb6cc0cf7c0 0x7fb6cc06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:02.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.434+0000 7fb6d2a00640 1 --2- 172.21.15.42:0/1881326695 >> v2:172.21.15.43:3300/0 conn(0x7fb6cc0b4be0 0x7fb6cc15d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:02.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.434+0000 7fb6d2a00640 1 -- 172.21.15.42:0/1881326695 >> 172.21.15.42:0/1881326695 conn(0x7fb6cc0b25f0 msgr2=0x7fb6cc0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:02.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.434+0000 7fb6d2a00640 1 -- 172.21.15.42:0/1881326695 shutdown_connections 2024-09-17T01:43:02.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.434+0000 7fb6d2a00640 1 -- 172.21.15.42:0/1881326695 wait complete. 2024-09-17T01:43:02.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.437+0000 7fb6d2a00640 1 Processor -- start 2024-09-17T01:43:02.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.437+0000 7fb6d2a00640 1 -- start start 2024-09-17T01:43:02.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.438+0000 7fb6d2a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb6cc06d260 0x7fb6cc152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:02.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.438+0000 7fb6d2a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6cc0b4be0 0x7fb6cc1f5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:02.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.438+0000 7fb6d2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6cc0cf7c0 0x7fb6cc153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:02.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.438+0000 7fb6d2a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc1537a0 con 0x7fb6cc0cf7c0 2024-09-17T01:43:02.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.438+0000 7fb6d2a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc153620 con 0x7fb6cc0b4be0 2024-09-17T01:43:02.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.438+0000 7fb6d2a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb6cc153920 con 0x7fb6cc06d260 2024-09-17T01:43:02.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.439+0000 7fb6d2000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6cc0cf7c0 0x7fb6cc153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:02.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.439+0000 7fb6d2000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6cc0cf7c0 0x7fb6cc153cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59686/0 (socket says 172.21.15.42:59686) 2024-09-17T01:43:02.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.439+0000 7fb6d2000640 1 -- 172.21.15.42:0/2615492208 learned_addr learned my addr 172.21.15.42:0/2615492208 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:02.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.439+0000 7fb6d1600640 1 --2- 172.21.15.42:0/2615492208 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb6cc06d260 0x7fb6cc152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:02.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.439+0000 7fb6d0c00640 1 --2- 172.21.15.42:0/2615492208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6cc0b4be0 0x7fb6cc1f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:02.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.439+0000 7fb6d2000640 1 -- 172.21.15.42:0/2615492208 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb6cc06d260 msgr2=0x7fb6cc152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:02.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.439+0000 7fb6d2000640 1 --2- 172.21.15.42:0/2615492208 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb6cc06d260 0x7fb6cc152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:02.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.439+0000 7fb6d2000640 1 -- 172.21.15.42:0/2615492208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6cc0b4be0 msgr2=0x7fb6cc1f5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:02.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.439+0000 7fb6d2000640 1 --2- 172.21.15.42:0/2615492208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6cc0b4be0 0x7fb6cc1f5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:02.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.439+0000 7fb6d2000640 1 -- 172.21.15.42:0/2615492208 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6cc1f64b0 con 0x7fb6cc0cf7c0 2024-09-17T01:43:02.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.439+0000 7fb6d1600640 1 --2- 172.21.15.42:0/2615492208 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb6cc06d260 0x7fb6cc152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:43:02.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.439+0000 7fb6d0c00640 1 --2- 172.21.15.42:0/2615492208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6cc0b4be0 0x7fb6cc1f5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:43:02.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.440+0000 7fb6d2000640 1 --2- 172.21.15.42:0/2615492208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6cc0cf7c0 0x7fb6cc153cf0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fb6c402b000 tx=0x7fb6c4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:02.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.440+0000 7fb6c9600640 1 -- 172.21.15.42:0/2615492208 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4033050 con 0x7fb6cc0cf7c0 2024-09-17T01:43:02.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.440+0000 7fb6c9600640 1 -- 172.21.15.42:0/2615492208 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6c4004540 con 0x7fb6cc0cf7c0 2024-09-17T01:43:02.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.440+0000 7fb6c9600640 1 -- 172.21.15.42:0/2615492208 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4038450 con 0x7fb6cc0cf7c0 2024-09-17T01:43:02.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.440+0000 7fb6d2a00640 1 -- 172.21.15.42:0/2615492208 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6cc1f9a40 con 0x7fb6cc0cf7c0 2024-09-17T01:43:02.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.440+0000 7fb6d2a00640 1 -- 172.21.15.42:0/2615492208 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6cc154c50 con 0x7fb6cc0cf7c0 2024-09-17T01:43:02.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.441+0000 7fb6d2a00640 1 -- 172.21.15.42:0/2615492208 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6cc15d6b0 con 0x7fb6cc0cf7c0 2024-09-17T01:43:02.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.442+0000 7fb6c9600640 1 -- 172.21.15.42:0/2615492208 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb6c4036070 con 0x7fb6cc0cf7c0 2024-09-17T01:43:02.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.443+0000 7fb6c9600640 1 --2- 172.21.15.42:0/2615492208 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb6ac078b90 0x7fb6ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:02.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.443+0000 7fb6c9600640 1 -- 172.21.15.42:0/2615492208 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fb6c40bc060 con 0x7fb6cc0cf7c0 2024-09-17T01:43:02.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.444+0000 7fb6d1600640 1 --2- 172.21.15.42:0/2615492208 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb6ac078b90 0x7fb6ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:02.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.445+0000 7fb6d1600640 1 --2- 172.21.15.42:0/2615492208 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb6ac078b90 0x7fb6ac07b0a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0009b00 tx=0x7fb6c0005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:02.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.448+0000 7fb6c9600640 1 -- 172.21.15.42:0/2615492208 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb6c4084410 con 0x7fb6cc0cf7c0 2024-09-17T01:43:02.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.639+0000 7fb6d2a00640 1 -- 172.21.15.42:0/2615492208 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb6cc0af780 con 0x7fb6ac078b90 2024-09-17T01:43:02.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.644+0000 7fb6c9600640 1 -- 172.21.15.42:0/2615492208 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252468 (secure 0 0 0) 0x7fb6cc0af780 con 0x7fb6ac078b90 2024-09-17T01:43:02.645 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:02.646 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:43:02.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.648+0000 7fb6d2a00640 1 -- 172.21.15.42:0/2615492208 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb6ac078b90 msgr2=0x7fb6ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:02.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.648+0000 7fb6d2a00640 1 --2- 172.21.15.42:0/2615492208 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb6ac078b90 0x7fb6ac07b0a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0009b00 tx=0x7fb6c0005f90 comp rx=0 tx=0).stop 2024-09-17T01:43:02.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.648+0000 7fb6d2a00640 1 -- 172.21.15.42:0/2615492208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6cc0cf7c0 msgr2=0x7fb6cc153cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:02.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.648+0000 7fb6d2a00640 1 --2- 172.21.15.42:0/2615492208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6cc0cf7c0 0x7fb6cc153cf0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fb6c402b000 tx=0x7fb6c4003f10 comp rx=0 tx=0).stop 2024-09-17T01:43:02.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.648+0000 7fb6d2a00640 1 -- 172.21.15.42:0/2615492208 shutdown_connections 2024-09-17T01:43:02.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.648+0000 7fb6d2a00640 1 --2- 172.21.15.42:0/2615492208 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb6ac078b90 0x7fb6ac07b0a0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:02.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.648+0000 7fb6d2a00640 1 --2- 172.21.15.42:0/2615492208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6cc0b4be0 0x7fb6cc1f5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:02.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.648+0000 7fb6d2a00640 1 --2- 172.21.15.42:0/2615492208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6cc0cf7c0 0x7fb6cc153cf0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:02.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.648+0000 7fb6d2a00640 1 --2- 172.21.15.42:0/2615492208 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb6cc06d260 0x7fb6cc152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:02.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.648+0000 7fb6d2a00640 1 -- 172.21.15.42:0/2615492208 >> 172.21.15.42:0/2615492208 conn(0x7fb6cc0b25f0 msgr2=0x7fb6cc0b1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:02.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.648+0000 7fb6d2a00640 1 -- 172.21.15.42:0/2615492208 shutdown_connections 2024-09-17T01:43:02.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.648+0000 7fb6d2a00640 1 -- 172.21.15.42:0/2615492208 wait complete. 2024-09-17T01:43:02.671 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":474,"stamp":"2024-09-17T01:43:01.169771+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":138,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":445408,"kb_used_data":15468,"kb_used_omap":12,"kb_used_meta":429747,"kb_avail":754529312,"statfs":{"total":773094113280,"available":772638015488,"internally_reserved":0,"allocated":15839232,"data_stored":7592280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":440061492},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.513317"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.570820+0000","last_change":"2024-09-17T01:42:57.700166+0000","last_active":"2024-09-17T01:42:59.570820+0000","last_peered":"2024-09-17T01:42:59.570820+0000","last_clean":"2024-09-17T01:42:59.570820+0000","last_became_active":"2024-09-17T01:42:57.699755+0000","last_became_peered":"2024-09-17T01:42:57.699755+0000","last_unstale":"2024-09-17T01:42:59.570820+0000","last_undegraded":"2024-09-17T01:42:59.570820+0000","last_fullsized":"2024-09-17T01:42:59.570820+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:33.694786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571807+0000","last_change":"2024-09-17T01:42:57.695884+0000","last_active":"2024-09-17T01:42:59.571807+0000","last_peered":"2024-09-17T01:42:59.571807+0000","last_clean":"2024-09-17T01:42:59.571807+0000","last_became_active":"2024-09-17T01:42:57.695523+0000","last_became_peered":"2024-09-17T01:42:57.695523+0000","last_unstale":"2024-09-17T01:42:59.571807+0000","last_undegraded":"2024-09-17T01:42:59.571807+0000","last_fullsized":"2024-09-17T01:42:59.571807+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:06.598801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.441310+0000","last_change":"2024-09-17T01:42:57.689461+0000","last_active":"2024-09-17T01:42:59.441310+0000","last_peered":"2024-09-17T01:42:59.441310+0000","last_clean":"2024-09-17T01:42:59.441310+0000","last_became_active":"2024-09-17T01:42:57.689195+0000","last_became_peered":"2024-09-17T01:42:57.689195+0000","last_unstale":"2024-09-17T01:42:59.441310+0000","last_undegraded":"2024-09-17T01:42:59.441310+0000","last_fullsized":"2024-09-17T01:42:59.441310+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:28.658896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.675950+0000","last_change":"2024-09-17T01:42:57.698370+0000","last_active":"2024-09-17T01:42:58.675950+0000","last_peered":"2024-09-17T01:42:58.675950+0000","last_clean":"2024-09-17T01:42:58.675950+0000","last_became_active":"2024-09-17T01:42:57.697978+0000","last_became_peered":"2024-09-17T01:42:57.697978+0000","last_unstale":"2024-09-17T01:42:58.675950+0000","last_undegraded":"2024-09-17T01:42:58.675950+0000","last_fullsized":"2024-09-17T01:42:58.675950+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:14.600138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.568999+0000","last_change":"2024-09-17T01:42:57.701787+0000","last_active":"2024-09-17T01:42:59.568999+0000","last_peered":"2024-09-17T01:42:59.568999+0000","last_clean":"2024-09-17T01:42:59.568999+0000","last_became_active":"2024-09-17T01:42:57.699509+0000","last_became_peered":"2024-09-17T01:42:57.699509+0000","last_unstale":"2024-09-17T01:42:59.568999+0000","last_undegraded":"2024-09-17T01:42:59.568999+0000","last_fullsized":"2024-09-17T01:42:59.568999+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:26.662798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677908+0000","last_change":"2024-09-17T01:42:57.695198+0000","last_active":"2024-09-17T01:42:58.677908+0000","last_peered":"2024-09-17T01:42:58.677908+0000","last_clean":"2024-09-17T01:42:58.677908+0000","last_became_active":"2024-09-17T01:42:57.694867+0000","last_became_peered":"2024-09-17T01:42:57.694867+0000","last_unstale":"2024-09-17T01:42:58.677908+0000","last_undegraded":"2024-09-17T01:42:58.677908+0000","last_fullsized":"2024-09-17T01:42:58.677908+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:08.635410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677510+0000","last_change":"2024-09-17T01:42:57.699730+0000","last_active":"2024-09-17T01:42:58.677510+0000","last_peered":"2024-09-17T01:42:58.677510+0000","last_clean":"2024-09-17T01:42:58.677510+0000","last_became_active":"2024-09-17T01:42:57.699360+0000","last_became_peered":"2024-09-17T01:42:57.699360+0000","last_unstale":"2024-09-17T01:42:58.677510+0000","last_undegraded":"2024-09-17T01:42:58.677510+0000","last_fullsized":"2024-09-17T01:42:58.677510+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:10.953122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.570104+0000","last_change":"2024-09-17T01:42:57.697256+0000","last_active":"2024-09-17T01:42:59.570104+0000","last_peered":"2024-09-17T01:42:59.570104+0000","last_clean":"2024-09-17T01:42:59.570104+0000","last_became_active":"2024-09-17T01:42:57.696958+0000","last_became_peered":"2024-09-17T01:42:57.696958+0000","last_unstale":"2024-09-17T01:42:59.570104+0000","last_undegraded":"2024-09-17T01:42:59.570104+0000","last_fullsized":"2024-09-17T01:42:59.570104+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:18.422539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677293+0000","last_change":"2024-09-17T01:42:57.690812+0000","last_active":"2024-09-17T01:42:58.677293+0000","last_peered":"2024-09-17T01:42:58.677293+0000","last_clean":"2024-09-17T01:42:58.677293+0000","last_became_active":"2024-09-17T01:42:57.690458+0000","last_became_peered":"2024-09-17T01:42:57.690458+0000","last_unstale":"2024-09-17T01:42:58.677293+0000","last_undegraded":"2024-09-17T01:42:58.677293+0000","last_fullsized":"2024-09-17T01:42:58.677293+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:23.707233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.441328+0000","last_change":"2024-09-17T01:42:57.694663+0000","last_active":"2024-09-17T01:42:59.441328+0000","last_peered":"2024-09-17T01:42:59.441328+0000","last_clean":"2024-09-17T01:42:59.441328+0000","last_became_active":"2024-09-17T01:42:57.694249+0000","last_became_peered":"2024-09-17T01:42:57.694249+0000","last_unstale":"2024-09-17T01:42:59.441328+0000","last_undegraded":"2024-09-17T01:42:59.441328+0000","last_fullsized":"2024-09-17T01:42:59.441328+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:04.706171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.678145+0000","last_change":"2024-09-17T01:42:57.682344+0000","last_active":"2024-09-17T01:42:58.678145+0000","last_peered":"2024-09-17T01:42:58.678145+0000","last_clean":"2024-09-17T01:42:58.678145+0000","last_became_active":"2024-09-17T01:42:57.682025+0000","last_became_peered":"2024-09-17T01:42:57.682025+0000","last_unstale":"2024-09-17T01:42:58.678145+0000","last_undegraded":"2024-09-17T01:42:58.678145+0000","last_fullsized":"2024-09-17T01:42:58.678145+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:51.144774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.446105+0000","last_change":"2024-09-17T01:42:57.713844+0000","last_active":"2024-09-17T01:42:59.446105+0000","last_peered":"2024-09-17T01:42:59.446105+0000","last_clean":"2024-09-17T01:42:59.446105+0000","last_became_active":"2024-09-17T01:42:57.711915+0000","last_became_peered":"2024-09-17T01:42:57.711915+0000","last_unstale":"2024-09-17T01:42:59.446105+0000","last_undegraded":"2024-09-17T01:42:59.446105+0000","last_fullsized":"2024-09-17T01:42:59.446105+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:56.889291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.569184+0000","last_change":"2024-09-17T01:42:57.702461+0000","last_active":"2024-09-17T01:42:59.569184+0000","last_peered":"2024-09-17T01:42:59.569184+0000","last_clean":"2024-09-17T01:42:59.569184+0000","last_became_active":"2024-09-17T01:42:57.700075+0000","last_became_peered":"2024-09-17T01:42:57.700075+0000","last_unstale":"2024-09-17T01:42:59.569184+0000","last_undegraded":"2024-09-17T01:42:59.569184+0000","last_fullsized":"2024-09-17T01:42:59.569184+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:01.116796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.445898+0000","last_change":"2024-09-17T01:42:57.714910+0000","last_active":"2024-09-17T01:42:59.445898+0000","last_peered":"2024-09-17T01:42:59.445898+0000","last_clean":"2024-09-17T01:42:59.445898+0000","last_became_active":"2024-09-17T01:42:57.714530+0000","last_became_peered":"2024-09-17T01:42:57.714530+0000","last_unstale":"2024-09-17T01:42:59.445898+0000","last_undegraded":"2024-09-17T01:42:59.445898+0000","last_fullsized":"2024-09-17T01:42:59.445898+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:48:37.004229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.569056+0000","last_change":"2024-09-17T01:42:57.690420+0000","last_active":"2024-09-17T01:42:59.569056+0000","last_peered":"2024-09-17T01:42:59.569056+0000","last_clean":"2024-09-17T01:42:59.569056+0000","last_became_active":"2024-09-17T01:42:57.689077+0000","last_became_peered":"2024-09-17T01:42:57.689077+0000","last_unstale":"2024-09-17T01:42:59.569056+0000","last_undegraded":"2024-09-17T01:42:59.569056+0000","last_fullsized":"2024-09-17T01:42:59.569056+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:26:47.311240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.676719+0000","last_change":"2024-09-17T01:42:57.689334+0000","last_active":"2024-09-17T01:42:58.676719+0000","last_peered":"2024-09-17T01:42:58.676719+0000","last_clean":"2024-09-17T01:42:58.676719+0000","last_became_active":"2024-09-17T01:42:57.688988+0000","last_became_peered":"2024-09-17T01:42:57.688988+0000","last_unstale":"2024-09-17T01:42:58.676719+0000","last_undegraded":"2024-09-17T01:42:58.676719+0000","last_fullsized":"2024-09-17T01:42:58.676719+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:24.393955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.441611+0000","last_change":"2024-09-17T01:42:57.705810+0000","last_active":"2024-09-17T01:42:59.441611+0000","last_peered":"2024-09-17T01:42:59.441611+0000","last_clean":"2024-09-17T01:42:59.441611+0000","last_became_active":"2024-09-17T01:42:57.705305+0000","last_became_peered":"2024-09-17T01:42:57.705305+0000","last_unstale":"2024-09-17T01:42:59.441611+0000","last_undegraded":"2024-09-17T01:42:59.441611+0000","last_fullsized":"2024-09-17T01:42:59.441611+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:24.014016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.569321+0000","last_change":"2024-09-17T01:42:57.681214+0000","last_active":"2024-09-17T01:42:59.569321+0000","last_peered":"2024-09-17T01:42:59.569321+0000","last_clean":"2024-09-17T01:42:59.569321+0000","last_became_active":"2024-09-17T01:42:57.680854+0000","last_became_peered":"2024-09-17T01:42:57.680854+0000","last_unstale":"2024-09-17T01:42:59.569321+0000","last_undegraded":"2024-09-17T01:42:59.569321+0000","last_fullsized":"2024-09-17T01:42:59.569321+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:14.120505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571477+0000","last_change":"2024-09-17T01:42:57.681483+0000","last_active":"2024-09-17T01:42:59.571477+0000","last_peered":"2024-09-17T01:42:59.571477+0000","last_clean":"2024-09-17T01:42:59.571477+0000","last_became_active":"2024-09-17T01:42:57.681103+0000","last_became_peered":"2024-09-17T01:42:57.681103+0000","last_unstale":"2024-09-17T01:42:59.571477+0000","last_undegraded":"2024-09-17T01:42:59.571477+0000","last_fullsized":"2024-09-17T01:42:59.571477+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:57.506648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571133+0000","last_change":"2024-09-17T01:42:57.701351+0000","last_active":"2024-09-17T01:42:59.571133+0000","last_peered":"2024-09-17T01:42:59.571133+0000","last_clean":"2024-09-17T01:42:59.571133+0000","last_became_active":"2024-09-17T01:42:57.699715+0000","last_became_peered":"2024-09-17T01:42:57.699715+0000","last_unstale":"2024-09-17T01:42:59.571133+0000","last_undegraded":"2024-09-17T01:42:59.571133+0000","last_fullsized":"2024-09-17T01:42:59.571133+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:02.562906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.441204+0000","last_change":"2024-09-17T01:42:57.706077+0000","last_active":"2024-09-17T01:42:59.441204+0000","last_peered":"2024-09-17T01:42:59.441204+0000","last_clean":"2024-09-17T01:42:59.441204+0000","last_became_active":"2024-09-17T01:42:57.705362+0000","last_became_peered":"2024-09-17T01:42:57.705362+0000","last_unstale":"2024-09-17T01:42:59.441204+0000","last_undegraded":"2024-09-17T01:42:59.441204+0000","last_fullsized":"2024-09-17T01:42:59.441204+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:10.727780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.445930+0000","last_change":"2024-09-17T01:42:57.707600+0000","last_active":"2024-09-17T01:42:59.445930+0000","last_peered":"2024-09-17T01:42:59.445930+0000","last_clean":"2024-09-17T01:42:59.445930+0000","last_became_active":"2024-09-17T01:42:57.706939+0000","last_became_peered":"2024-09-17T01:42:57.706939+0000","last_unstale":"2024-09-17T01:42:59.445930+0000","last_undegraded":"2024-09-17T01:42:59.445930+0000","last_fullsized":"2024-09-17T01:42:59.445930+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:10.326059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.675481+0000","last_change":"2024-09-17T01:42:57.699193+0000","last_active":"2024-09-17T01:42:58.675481+0000","last_peered":"2024-09-17T01:42:58.675481+0000","last_clean":"2024-09-17T01:42:58.675481+0000","last_became_active":"2024-09-17T01:42:57.698867+0000","last_became_peered":"2024-09-17T01:42:57.698867+0000","last_unstale":"2024-09-17T01:42:58.675481+0000","last_undegraded":"2024-09-17T01:42:58.675481+0000","last_fullsized":"2024-09-17T01:42:58.675481+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:10.151191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.569075+0000","last_change":"2024-09-17T01:42:57.701279+0000","last_active":"2024-09-17T01:42:59.569075+0000","last_peered":"2024-09-17T01:42:59.569075+0000","last_clean":"2024-09-17T01:42:59.569075+0000","last_became_active":"2024-09-17T01:42:57.700145+0000","last_became_peered":"2024-09-17T01:42:57.700145+0000","last_unstale":"2024-09-17T01:42:59.569075+0000","last_undegraded":"2024-09-17T01:42:59.569075+0000","last_fullsized":"2024-09-17T01:42:59.569075+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:01:08.206170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571993+0000","last_change":"2024-09-17T01:42:57.694581+0000","last_active":"2024-09-17T01:42:59.571993+0000","last_peered":"2024-09-17T01:42:59.571993+0000","last_clean":"2024-09-17T01:42:59.571993+0000","last_became_active":"2024-09-17T01:42:57.693687+0000","last_became_peered":"2024-09-17T01:42:57.693687+0000","last_unstale":"2024-09-17T01:42:59.571993+0000","last_undegraded":"2024-09-17T01:42:59.571993+0000","last_fullsized":"2024-09-17T01:42:59.571993+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:57.251432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.570793+0000","last_change":"2024-09-17T01:42:57.699019+0000","last_active":"2024-09-17T01:42:59.570793+0000","last_peered":"2024-09-17T01:42:59.570793+0000","last_clean":"2024-09-17T01:42:59.570793+0000","last_became_active":"2024-09-17T01:42:57.698415+0000","last_became_peered":"2024-09-17T01:42:57.698415+0000","last_unstale":"2024-09-17T01:42:59.570793+0000","last_undegraded":"2024-09-17T01:42:59.570793+0000","last_fullsized":"2024-09-17T01:42:59.570793+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:47.556619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571714+0000","last_change":"2024-09-17T01:42:57.694253+0000","last_active":"2024-09-17T01:42:59.571714+0000","last_peered":"2024-09-17T01:42:59.571714+0000","last_clean":"2024-09-17T01:42:59.571714+0000","last_became_active":"2024-09-17T01:42:57.692904+0000","last_became_peered":"2024-09-17T01:42:57.692904+0000","last_unstale":"2024-09-17T01:42:59.571714+0000","last_undegraded":"2024-09-17T01:42:59.571714+0000","last_fullsized":"2024-09-17T01:42:59.571714+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:16.168268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571025+0000","last_change":"2024-09-17T01:42:57.695985+0000","last_active":"2024-09-17T01:42:59.571025+0000","last_peered":"2024-09-17T01:42:59.571025+0000","last_clean":"2024-09-17T01:42:59.571025+0000","last_became_active":"2024-09-17T01:42:57.695562+0000","last_became_peered":"2024-09-17T01:42:57.695562+0000","last_unstale":"2024-09-17T01:42:59.571025+0000","last_undegraded":"2024-09-17T01:42:59.571025+0000","last_fullsized":"2024-09-17T01:42:59.571025+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:25.338204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.570576+0000","last_change":"2024-09-17T01:42:57.694580+0000","last_active":"2024-09-17T01:42:59.570576+0000","last_peered":"2024-09-17T01:42:59.570576+0000","last_clean":"2024-09-17T01:42:59.570576+0000","last_became_active":"2024-09-17T01:42:57.694226+0000","last_became_peered":"2024-09-17T01:42:57.694226+0000","last_unstale":"2024-09-17T01:42:59.570576+0000","last_undegraded":"2024-09-17T01:42:59.570576+0000","last_fullsized":"2024-09-17T01:42:59.570576+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:07.359450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.446147+0000","last_change":"2024-09-17T01:42:57.707241+0000","last_active":"2024-09-17T01:42:59.446147+0000","last_peered":"2024-09-17T01:42:59.446147+0000","last_clean":"2024-09-17T01:42:59.446147+0000","last_became_active":"2024-09-17T01:42:57.706734+0000","last_became_peered":"2024-09-17T01:42:57.706734+0000","last_unstale":"2024-09-17T01:42:59.446147+0000","last_undegraded":"2024-09-17T01:42:59.446147+0000","last_fullsized":"2024-09-17T01:42:59.446147+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:05:47.874740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571126+0000","last_change":"2024-09-17T01:42:57.695894+0000","last_active":"2024-09-17T01:42:59.571126+0000","last_peered":"2024-09-17T01:42:59.571126+0000","last_clean":"2024-09-17T01:42:59.571126+0000","last_became_active":"2024-09-17T01:42:57.693703+0000","last_became_peered":"2024-09-17T01:42:57.693703+0000","last_unstale":"2024-09-17T01:42:59.571126+0000","last_undegraded":"2024-09-17T01:42:59.571126+0000","last_fullsized":"2024-09-17T01:42:59.571126+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:02.415574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.570815+0000","last_change":"2024-09-17T01:42:57.706718+0000","last_active":"2024-09-17T01:42:59.570815+0000","last_peered":"2024-09-17T01:42:59.570815+0000","last_clean":"2024-09-17T01:42:59.570815+0000","last_became_active":"2024-09-17T01:42:57.706065+0000","last_became_peered":"2024-09-17T01:42:57.706065+0000","last_unstale":"2024-09-17T01:42:59.570815+0000","last_undegraded":"2024-09-17T01:42:59.570815+0000","last_fullsized":"2024-09-17T01:42:59.570815+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:23:46.237276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.569308+0000","last_change":"2024-09-17T01:42:57.699578+0000","last_active":"2024-09-17T01:42:59.569308+0000","last_peered":"2024-09-17T01:42:59.569308+0000","last_clean":"2024-09-17T01:42:59.569308+0000","last_became_active":"2024-09-17T01:42:57.696964+0000","last_became_peered":"2024-09-17T01:42:57.696964+0000","last_unstale":"2024-09-17T01:42:59.569308+0000","last_undegraded":"2024-09-17T01:42:59.569308+0000","last_fullsized":"2024-09-17T01:42:59.569308+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:35.991862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"146'4","reported_seq":19,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.441560+0000","last_change":"2024-09-17T01:42:56.683623+0000","last_active":"2024-09-17T01:42:59.441560+0000","last_peered":"2024-09-17T01:42:59.441560+0000","last_clean":"2024-09-17T01:42:59.441560+0000","last_became_active":"2024-09-17T01:42:56.683332+0000","last_became_peered":"2024-09-17T01:42:56.683332+0000","last_unstale":"2024-09-17T01:42:59.441560+0000","last_undegraded":"2024-09-17T01:42:59.441560+0000","last_fullsized":"2024-09-17T01:42:59.441560+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:28.084130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.678092+0000","last_change":"2024-09-17T01:42:57.690161+0000","last_active":"2024-09-17T01:42:58.678092+0000","last_peered":"2024-09-17T01:42:58.678092+0000","last_clean":"2024-09-17T01:42:58.678092+0000","last_became_active":"2024-09-17T01:42:57.688286+0000","last_became_peered":"2024-09-17T01:42:57.688286+0000","last_unstale":"2024-09-17T01:42:58.678092+0000","last_undegraded":"2024-09-17T01:42:58.678092+0000","last_fullsized":"2024-09-17T01:42:58.678092+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:27.948090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.1e","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.678377+0000","last_change":"2024-09-17T01:42:56.687186+0000","last_active":"2024-09-17T01:42:58.678377+0000","last_peered":"2024-09-17T01:42:58.678377+0000","last_clean":"2024-09-17T01:42:58.678377+0000","last_became_active":"2024-09-17T01:42:56.686759+0000","last_became_peered":"2024-09-17T01:42:56.686759+0000","last_unstale":"2024-09-17T01:42:58.678377+0000","last_undegraded":"2024-09-17T01:42:58.678377+0000","last_fullsized":"2024-09-17T01:42:58.678377+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:23:24.885433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677825+0000","last_change":"2024-09-17T01:42:57.697497+0000","last_active":"2024-09-17T01:42:58.677825+0000","last_peered":"2024-09-17T01:42:58.677825+0000","last_clean":"2024-09-17T01:42:58.677825+0000","last_became_active":"2024-09-17T01:42:57.697180+0000","last_became_peered":"2024-09-17T01:42:57.697180+0000","last_unstale":"2024-09-17T01:42:58.677825+0000","last_undegraded":"2024-09-17T01:42:58.677825+0000","last_fullsized":"2024-09-17T01:42:58.677825+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:35.766798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1d","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.441496+0000","last_change":"2024-09-17T01:42:56.690465+0000","last_active":"2024-09-17T01:42:59.441496+0000","last_peered":"2024-09-17T01:42:59.441496+0000","last_clean":"2024-09-17T01:42:59.441496+0000","last_became_active":"2024-09-17T01:42:56.689743+0000","last_became_peered":"2024-09-17T01:42:56.689743+0000","last_unstale":"2024-09-17T01:42:59.441496+0000","last_undegraded":"2024-09-17T01:42:59.441496+0000","last_fullsized":"2024-09-17T01:42:59.441496+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:25.451833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.676189+0000","last_change":"2024-09-17T01:42:57.697800+0000","last_active":"2024-09-17T01:42:58.676189+0000","last_peered":"2024-09-17T01:42:58.676189+0000","last_clean":"2024-09-17T01:42:58.676189+0000","last_became_active":"2024-09-17T01:42:57.697446+0000","last_became_peered":"2024-09-17T01:42:57.697446+0000","last_unstale":"2024-09-17T01:42:58.676189+0000","last_undegraded":"2024-09-17T01:42:58.676189+0000","last_fullsized":"2024-09-17T01:42:58.676189+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:20.194771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.441364+0000","last_change":"2024-09-17T01:42:56.682984+0000","last_active":"2024-09-17T01:42:59.441364+0000","last_peered":"2024-09-17T01:42:59.441364+0000","last_clean":"2024-09-17T01:42:59.441364+0000","last_became_active":"2024-09-17T01:42:56.682648+0000","last_became_peered":"2024-09-17T01:42:56.682648+0000","last_unstale":"2024-09-17T01:42:59.441364+0000","last_undegraded":"2024-09-17T01:42:59.441364+0000","last_fullsized":"2024-09-17T01:42:59.441364+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:24.281138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.570521+0000","last_change":"2024-09-17T01:42:57.704961+0000","last_active":"2024-09-17T01:42:59.570521+0000","last_peered":"2024-09-17T01:42:59.570521+0000","last_clean":"2024-09-17T01:42:59.570521+0000","last_became_active":"2024-09-17T01:42:57.704598+0000","last_became_peered":"2024-09-17T01:42:57.704598+0000","last_unstale":"2024-09-17T01:42:59.570521+0000","last_undegraded":"2024-09-17T01:42:59.570521+0000","last_fullsized":"2024-09-17T01:42:59.570521+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:29.547198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571347+0000","last_change":"2024-09-17T01:42:56.679527+0000","last_active":"2024-09-17T01:42:59.571347+0000","last_peered":"2024-09-17T01:42:59.571347+0000","last_clean":"2024-09-17T01:42:59.571347+0000","last_became_active":"2024-09-17T01:42:56.678908+0000","last_became_peered":"2024-09-17T01:42:56.678908+0000","last_unstale":"2024-09-17T01:42:59.571347+0000","last_undegraded":"2024-09-17T01:42:59.571347+0000","last_fullsized":"2024-09-17T01:42:59.571347+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:16.477582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.676141+0000","last_change":"2024-09-17T01:42:57.696723+0000","last_active":"2024-09-17T01:42:58.676141+0000","last_peered":"2024-09-17T01:42:58.676141+0000","last_clean":"2024-09-17T01:42:58.676141+0000","last_became_active":"2024-09-17T01:42:57.696267+0000","last_became_peered":"2024-09-17T01:42:57.696267+0000","last_unstale":"2024-09-17T01:42:58.676141+0000","last_undegraded":"2024-09-17T01:42:58.676141+0000","last_fullsized":"2024-09-17T01:42:58.676141+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:45.947317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.569265+0000","last_change":"2024-09-17T01:42:56.687876+0000","last_active":"2024-09-17T01:42:59.569265+0000","last_peered":"2024-09-17T01:42:59.569265+0000","last_clean":"2024-09-17T01:42:59.569265+0000","last_became_active":"2024-09-17T01:42:56.687517+0000","last_became_peered":"2024-09-17T01:42:56.687517+0000","last_unstale":"2024-09-17T01:42:59.569265+0000","last_undegraded":"2024-09-17T01:42:59.569265+0000","last_fullsized":"2024-09-17T01:42:59.569265+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:51.276938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.570864+0000","last_change":"2024-09-17T01:42:57.704954+0000","last_active":"2024-09-17T01:42:59.570864+0000","last_peered":"2024-09-17T01:42:59.570864+0000","last_clean":"2024-09-17T01:42:59.570864+0000","last_became_active":"2024-09-17T01:42:57.704441+0000","last_became_peered":"2024-09-17T01:42:57.704441+0000","last_unstale":"2024-09-17T01:42:59.570864+0000","last_undegraded":"2024-09-17T01:42:59.570864+0000","last_fullsized":"2024-09-17T01:42:59.570864+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:34:32.038694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677559+0000","last_change":"2024-09-17T01:42:56.674303+0000","last_active":"2024-09-17T01:42:58.677559+0000","last_peered":"2024-09-17T01:42:58.677559+0000","last_clean":"2024-09-17T01:42:58.677559+0000","last_became_active":"2024-09-17T01:42:56.673892+0000","last_became_peered":"2024-09-17T01:42:56.673892+0000","last_unstale":"2024-09-17T01:42:58.677559+0000","last_undegraded":"2024-09-17T01:42:58.677559+0000","last_fullsized":"2024-09-17T01:42:58.677559+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:01:25.236818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.675555+0000","last_change":"2024-09-17T01:42:57.697502+0000","last_active":"2024-09-17T01:42:58.675555+0000","last_peered":"2024-09-17T01:42:58.675555+0000","last_clean":"2024-09-17T01:42:58.675555+0000","last_became_active":"2024-09-17T01:42:57.696794+0000","last_became_peered":"2024-09-17T01:42:57.696794+0000","last_unstale":"2024-09-17T01:42:58.675555+0000","last_undegraded":"2024-09-17T01:42:58.675555+0000","last_fullsized":"2024-09-17T01:42:58.675555+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:44.099890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.441249+0000","last_change":"2024-09-17T01:42:56.685388+0000","last_active":"2024-09-17T01:42:59.441249+0000","last_peered":"2024-09-17T01:42:59.441249+0000","last_clean":"2024-09-17T01:42:59.441249+0000","last_became_active":"2024-09-17T01:42:56.685097+0000","last_became_peered":"2024-09-17T01:42:56.685097+0000","last_unstale":"2024-09-17T01:42:59.441249+0000","last_undegraded":"2024-09-17T01:42:59.441249+0000","last_fullsized":"2024-09-17T01:42:59.441249+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:55.467416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.676386+0000","last_change":"2024-09-17T01:42:57.695811+0000","last_active":"2024-09-17T01:42:58.676386+0000","last_peered":"2024-09-17T01:42:58.676386+0000","last_clean":"2024-09-17T01:42:58.676386+0000","last_became_active":"2024-09-17T01:42:57.695516+0000","last_became_peered":"2024-09-17T01:42:57.695516+0000","last_unstale":"2024-09-17T01:42:58.676386+0000","last_undegraded":"2024-09-17T01:42:58.676386+0000","last_fullsized":"2024-09-17T01:42:58.676386+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:25.174148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677430+0000","last_change":"2024-09-17T01:42:56.672017+0000","last_active":"2024-09-17T01:42:58.677430+0000","last_peered":"2024-09-17T01:42:58.677430+0000","last_clean":"2024-09-17T01:42:58.677430+0000","last_became_active":"2024-09-17T01:42:56.671041+0000","last_became_peered":"2024-09-17T01:42:56.671041+0000","last_unstale":"2024-09-17T01:42:58.677430+0000","last_undegraded":"2024-09-17T01:42:58.677430+0000","last_fullsized":"2024-09-17T01:42:58.677430+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:25.229621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.446160+0000","last_change":"2024-09-17T01:42:57.715324+0000","last_active":"2024-09-17T01:42:59.446160+0000","last_peered":"2024-09-17T01:42:59.446160+0000","last_clean":"2024-09-17T01:42:59.446160+0000","last_became_active":"2024-09-17T01:42:57.714374+0000","last_became_peered":"2024-09-17T01:42:57.714374+0000","last_unstale":"2024-09-17T01:42:59.446160+0000","last_undegraded":"2024-09-17T01:42:59.446160+0000","last_fullsized":"2024-09-17T01:42:59.446160+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:47:24.877388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.569447+0000","last_change":"2024-09-17T01:42:56.685480+0000","last_active":"2024-09-17T01:42:59.569447+0000","last_peered":"2024-09-17T01:42:59.569447+0000","last_clean":"2024-09-17T01:42:59.569447+0000","last_became_active":"2024-09-17T01:42:56.682532+0000","last_became_peered":"2024-09-17T01:42:56.682532+0000","last_unstale":"2024-09-17T01:42:59.569447+0000","last_undegraded":"2024-09-17T01:42:59.569447+0000","last_fullsized":"2024-09-17T01:42:59.569447+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:20.526898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677350+0000","last_change":"2024-09-17T01:42:57.693133+0000","last_active":"2024-09-17T01:42:58.677350+0000","last_peered":"2024-09-17T01:42:58.677350+0000","last_clean":"2024-09-17T01:42:58.677350+0000","last_became_active":"2024-09-17T01:42:57.692822+0000","last_became_peered":"2024-09-17T01:42:57.692822+0000","last_unstale":"2024-09-17T01:42:58.677350+0000","last_undegraded":"2024-09-17T01:42:58.677350+0000","last_fullsized":"2024-09-17T01:42:58.677350+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:57.522458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"146'6","reported_seq":21,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677245+0000","last_change":"2024-09-17T01:42:56.686492+0000","last_active":"2024-09-17T01:42:58.677245+0000","last_peered":"2024-09-17T01:42:58.677245+0000","last_clean":"2024-09-17T01:42:58.677245+0000","last_became_active":"2024-09-17T01:42:56.686037+0000","last_became_peered":"2024-09-17T01:42:56.686037+0000","last_unstale":"2024-09-17T01:42:58.677245+0000","last_undegraded":"2024-09-17T01:42:58.677245+0000","last_fullsized":"2024-09-17T01:42:58.677245+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:44.994594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.675856+0000","last_change":"2024-09-17T01:42:57.701228+0000","last_active":"2024-09-17T01:42:58.675856+0000","last_peered":"2024-09-17T01:42:58.675856+0000","last_clean":"2024-09-17T01:42:58.675856+0000","last_became_active":"2024-09-17T01:42:57.699630+0000","last_became_peered":"2024-09-17T01:42:57.699630+0000","last_unstale":"2024-09-17T01:42:58.675856+0000","last_undegraded":"2024-09-17T01:42:58.675856+0000","last_fullsized":"2024-09-17T01:42:58.675856+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:10.764105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.441188+0000","last_change":"2024-09-17T01:42:56.688578+0000","last_active":"2024-09-17T01:42:59.441188+0000","last_peered":"2024-09-17T01:42:59.441188+0000","last_clean":"2024-09-17T01:42:59.441188+0000","last_became_active":"2024-09-17T01:42:56.688237+0000","last_became_peered":"2024-09-17T01:42:56.688237+0000","last_unstale":"2024-09-17T01:42:59.441188+0000","last_undegraded":"2024-09-17T01:42:59.441188+0000","last_fullsized":"2024-09-17T01:42:59.441188+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:07.272399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.570191+0000","last_change":"2024-09-17T01:42:57.699136+0000","last_active":"2024-09-17T01:42:59.570191+0000","last_peered":"2024-09-17T01:42:59.570191+0000","last_clean":"2024-09-17T01:42:59.570191+0000","last_became_active":"2024-09-17T01:42:57.698813+0000","last_became_peered":"2024-09-17T01:42:57.698813+0000","last_unstale":"2024-09-17T01:42:59.570191+0000","last_undegraded":"2024-09-17T01:42:59.570191+0000","last_fullsized":"2024-09-17T01:42:59.570191+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:25.618345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.446230+0000","last_change":"2024-09-17T01:42:56.688887+0000","last_active":"2024-09-17T01:42:59.446230+0000","last_peered":"2024-09-17T01:42:59.446230+0000","last_clean":"2024-09-17T01:42:59.446230+0000","last_became_active":"2024-09-17T01:42:56.688559+0000","last_became_peered":"2024-09-17T01:42:56.688559+0000","last_unstale":"2024-09-17T01:42:59.446230+0000","last_undegraded":"2024-09-17T01:42:59.446230+0000","last_fullsized":"2024-09-17T01:42:59.446230+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:49.475665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.675488+0000","last_change":"2024-09-17T01:42:57.692049+0000","last_active":"2024-09-17T01:42:58.675488+0000","last_peered":"2024-09-17T01:42:58.675488+0000","last_clean":"2024-09-17T01:42:58.675488+0000","last_became_active":"2024-09-17T01:42:57.691760+0000","last_became_peered":"2024-09-17T01:42:57.691760+0000","last_unstale":"2024-09-17T01:42:58.675488+0000","last_undegraded":"2024-09-17T01:42:58.675488+0000","last_fullsized":"2024-09-17T01:42:58.675488+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:39:31.915345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571277+0000","last_change":"2024-09-17T01:42:56.689578+0000","last_active":"2024-09-17T01:42:59.571277+0000","last_peered":"2024-09-17T01:42:59.571277+0000","last_clean":"2024-09-17T01:42:59.571277+0000","last_became_active":"2024-09-17T01:42:56.688126+0000","last_became_peered":"2024-09-17T01:42:56.688126+0000","last_unstale":"2024-09-17T01:42:59.571277+0000","last_undegraded":"2024-09-17T01:42:59.571277+0000","last_fullsized":"2024-09-17T01:42:59.571277+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:52:29.908251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.676134+0000","last_change":"2024-09-17T01:42:57.697177+0000","last_active":"2024-09-17T01:42:58.676134+0000","last_peered":"2024-09-17T01:42:58.676134+0000","last_clean":"2024-09-17T01:42:58.676134+0000","last_became_active":"2024-09-17T01:42:57.694325+0000","last_became_peered":"2024-09-17T01:42:57.694325+0000","last_unstale":"2024-09-17T01:42:58.676134+0000","last_undegraded":"2024-09-17T01:42:58.676134+0000","last_fullsized":"2024-09-17T01:42:58.676134+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:06:26.948086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"146'8","reported_seq":23,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.570030+0000","last_change":"2024-09-17T01:42:56.680506+0000","last_active":"2024-09-17T01:42:59.570030+0000","last_peered":"2024-09-17T01:42:59.570030+0000","last_clean":"2024-09-17T01:42:59.570030+0000","last_became_active":"2024-09-17T01:42:56.680165+0000","last_became_peered":"2024-09-17T01:42:56.680165+0000","last_unstale":"2024-09-17T01:42:59.570030+0000","last_undegraded":"2024-09-17T01:42:59.570030+0000","last_fullsized":"2024-09-17T01:42:59.570030+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:44:45.071424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.569534+0000","last_change":"2024-09-17T01:42:57.699072+0000","last_active":"2024-09-17T01:42:59.569534+0000","last_peered":"2024-09-17T01:42:59.569534+0000","last_clean":"2024-09-17T01:42:59.569534+0000","last_became_active":"2024-09-17T01:42:57.698185+0000","last_became_peered":"2024-09-17T01:42:57.698185+0000","last_unstale":"2024-09-17T01:42:59.569534+0000","last_undegraded":"2024-09-17T01:42:59.569534+0000","last_fullsized":"2024-09-17T01:42:59.569534+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:15:28.078605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.676457+0000","last_change":"2024-09-17T01:42:56.690934+0000","last_active":"2024-09-17T01:42:58.676457+0000","last_peered":"2024-09-17T01:42:58.676457+0000","last_clean":"2024-09-17T01:42:58.676457+0000","last_became_active":"2024-09-17T01:42:56.690569+0000","last_became_peered":"2024-09-17T01:42:56.690569+0000","last_unstale":"2024-09-17T01:42:58.676457+0000","last_undegraded":"2024-09-17T01:42:58.676457+0000","last_fullsized":"2024-09-17T01:42:58.676457+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:37.745938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571983+0000","last_change":"2024-09-17T01:42:57.696297+0000","last_active":"2024-09-17T01:42:59.571983+0000","last_peered":"2024-09-17T01:42:59.571983+0000","last_clean":"2024-09-17T01:42:59.571983+0000","last_became_active":"2024-09-17T01:42:57.695950+0000","last_became_peered":"2024-09-17T01:42:57.695950+0000","last_unstale":"2024-09-17T01:42:59.571983+0000","last_undegraded":"2024-09-17T01:42:59.571983+0000","last_fullsized":"2024-09-17T01:42:59.571983+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:47.107767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.e","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.570500+0000","last_change":"2024-09-17T01:42:56.685379+0000","last_active":"2024-09-17T01:42:59.570500+0000","last_peered":"2024-09-17T01:42:59.570500+0000","last_clean":"2024-09-17T01:42:59.570500+0000","last_became_active":"2024-09-17T01:42:56.684998+0000","last_became_peered":"2024-09-17T01:42:56.684998+0000","last_unstale":"2024-09-17T01:42:59.570500+0000","last_undegraded":"2024-09-17T01:42:59.570500+0000","last_fullsized":"2024-09-17T01:42:59.570500+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:28.792517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.569085+0000","last_change":"2024-09-17T01:42:57.700440+0000","last_active":"2024-09-17T01:42:59.569085+0000","last_peered":"2024-09-17T01:42:59.569085+0000","last_clean":"2024-09-17T01:42:59.569085+0000","last_became_active":"2024-09-17T01:42:57.700120+0000","last_became_peered":"2024-09-17T01:42:57.700120+0000","last_unstale":"2024-09-17T01:42:59.569085+0000","last_undegraded":"2024-09-17T01:42:59.569085+0000","last_fullsized":"2024-09-17T01:42:59.569085+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:48.337411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"146'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.678423+0000","last_change":"2024-09-17T01:42:56.681447+0000","last_active":"2024-09-17T01:42:58.678423+0000","last_peered":"2024-09-17T01:42:58.678423+0000","last_clean":"2024-09-17T01:42:58.678423+0000","last_became_active":"2024-09-17T01:42:56.680795+0000","last_became_peered":"2024-09-17T01:42:56.680795+0000","last_unstale":"2024-09-17T01:42:58.678423+0000","last_undegraded":"2024-09-17T01:42:58.678423+0000","last_fullsized":"2024-09-17T01:42:58.678423+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:25.613391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.678238+0000","last_change":"2024-09-17T01:42:57.701081+0000","last_active":"2024-09-17T01:42:58.678238+0000","last_peered":"2024-09-17T01:42:58.678238+0000","last_clean":"2024-09-17T01:42:58.678238+0000","last_became_active":"2024-09-17T01:42:57.699731+0000","last_became_peered":"2024-09-17T01:42:57.699731+0000","last_unstale":"2024-09-17T01:42:58.678238+0000","last_undegraded":"2024-09-17T01:42:58.678238+0000","last_fullsized":"2024-09-17T01:42:58.678238+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:01:06.944310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.570895+0000","last_change":"2024-09-17T01:42:56.688794+0000","last_active":"2024-09-17T01:42:59.570895+0000","last_peered":"2024-09-17T01:42:59.570895+0000","last_clean":"2024-09-17T01:42:59.570895+0000","last_became_active":"2024-09-17T01:42:56.688421+0000","last_became_peered":"2024-09-17T01:42:56.688421+0000","last_unstale":"2024-09-17T01:42:59.570895+0000","last_undegraded":"2024-09-17T01:42:59.570895+0000","last_fullsized":"2024-09-17T01:42:59.570895+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:09.762975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.446216+0000","last_change":"2024-09-17T01:42:57.708626+0000","last_active":"2024-09-17T01:42:59.446216+0000","last_peered":"2024-09-17T01:42:59.446216+0000","last_clean":"2024-09-17T01:42:59.446216+0000","last_became_active":"2024-09-17T01:42:57.707496+0000","last_became_peered":"2024-09-17T01:42:57.707496+0000","last_unstale":"2024-09-17T01:42:59.446216+0000","last_undegraded":"2024-09-17T01:42:59.446216+0000","last_fullsized":"2024-09-17T01:42:59.446216+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:11.928724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677988+0000","last_change":"2024-09-17T01:42:56.689278+0000","last_active":"2024-09-17T01:42:58.677988+0000","last_peered":"2024-09-17T01:42:58.677988+0000","last_clean":"2024-09-17T01:42:58.677988+0000","last_became_active":"2024-09-17T01:42:56.688717+0000","last_became_peered":"2024-09-17T01:42:56.688717+0000","last_unstale":"2024-09-17T01:42:58.677988+0000","last_undegraded":"2024-09-17T01:42:58.677988+0000","last_fullsized":"2024-09-17T01:42:58.677988+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:30.266364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571016+0000","last_change":"2024-09-17T01:42:57.694677+0000","last_active":"2024-09-17T01:42:59.571016+0000","last_peered":"2024-09-17T01:42:59.571016+0000","last_clean":"2024-09-17T01:42:59.571016+0000","last_became_active":"2024-09-17T01:42:57.694334+0000","last_became_peered":"2024-09-17T01:42:57.694334+0000","last_unstale":"2024-09-17T01:42:59.571016+0000","last_undegraded":"2024-09-17T01:42:59.571016+0000","last_fullsized":"2024-09-17T01:42:59.571016+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:57.569365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.675928+0000","last_change":"2024-09-17T01:42:56.684686+0000","last_active":"2024-09-17T01:42:58.675928+0000","last_peered":"2024-09-17T01:42:58.675928+0000","last_clean":"2024-09-17T01:42:58.675928+0000","last_became_active":"2024-09-17T01:42:56.684389+0000","last_became_peered":"2024-09-17T01:42:56.684389+0000","last_unstale":"2024-09-17T01:42:58.675928+0000","last_undegraded":"2024-09-17T01:42:58.675928+0000","last_fullsized":"2024-09-17T01:42:58.675928+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:33.890204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.445911+0000","last_change":"2024-09-17T01:42:57.699715+0000","last_active":"2024-09-17T01:42:59.445911+0000","last_peered":"2024-09-17T01:42:59.445911+0000","last_clean":"2024-09-17T01:42:59.445911+0000","last_became_active":"2024-09-17T01:42:57.699343+0000","last_became_peered":"2024-09-17T01:42:57.699343+0000","last_unstale":"2024-09-17T01:42:59.445911+0000","last_undegraded":"2024-09-17T01:42:59.445911+0000","last_fullsized":"2024-09-17T01:42:59.445911+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:04.565456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.675630+0000","last_change":"2024-09-17T01:42:56.691836+0000","last_active":"2024-09-17T01:42:58.675630+0000","last_peered":"2024-09-17T01:42:58.675630+0000","last_clean":"2024-09-17T01:42:58.675630+0000","last_became_active":"2024-09-17T01:42:56.689596+0000","last_became_peered":"2024-09-17T01:42:56.689596+0000","last_unstale":"2024-09-17T01:42:58.675630+0000","last_undegraded":"2024-09-17T01:42:58.675630+0000","last_fullsized":"2024-09-17T01:42:58.675630+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:23.663630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571165+0000","last_change":"2024-09-17T01:42:57.697880+0000","last_active":"2024-09-17T01:42:59.571165+0000","last_peered":"2024-09-17T01:42:59.571165+0000","last_clean":"2024-09-17T01:42:59.571165+0000","last_became_active":"2024-09-17T01:42:57.696382+0000","last_became_peered":"2024-09-17T01:42:57.696382+0000","last_unstale":"2024-09-17T01:42:59.571165+0000","last_undegraded":"2024-09-17T01:42:59.571165+0000","last_fullsized":"2024-09-17T01:42:59.571165+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:29.406603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.675681+0000","last_change":"2024-09-17T01:42:56.688129+0000","last_active":"2024-09-17T01:42:58.675681+0000","last_peered":"2024-09-17T01:42:58.675681+0000","last_clean":"2024-09-17T01:42:58.675681+0000","last_became_active":"2024-09-17T01:42:56.687724+0000","last_became_peered":"2024-09-17T01:42:56.687724+0000","last_unstale":"2024-09-17T01:42:58.675681+0000","last_undegraded":"2024-09-17T01:42:58.675681+0000","last_fullsized":"2024-09-17T01:42:58.675681+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:34.627342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.676533+0000","last_change":"2024-09-17T01:42:57.696459+0000","last_active":"2024-09-17T01:42:58.676533+0000","last_peered":"2024-09-17T01:42:58.676533+0000","last_clean":"2024-09-17T01:42:58.676533+0000","last_became_active":"2024-09-17T01:42:57.694746+0000","last_became_peered":"2024-09-17T01:42:57.694746+0000","last_unstale":"2024-09-17T01:42:58.676533+0000","last_undegraded":"2024-09-17T01:42:58.676533+0000","last_fullsized":"2024-09-17T01:42:58.676533+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:43.347912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"146'2","reported_seq":17,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.676580+0000","last_change":"2024-09-17T01:42:56.690888+0000","last_active":"2024-09-17T01:42:58.676580+0000","last_peered":"2024-09-17T01:42:58.676580+0000","last_clean":"2024-09-17T01:42:58.676580+0000","last_became_active":"2024-09-17T01:42:56.690133+0000","last_became_peered":"2024-09-17T01:42:56.690133+0000","last_unstale":"2024-09-17T01:42:58.676580+0000","last_undegraded":"2024-09-17T01:42:58.676580+0000","last_fullsized":"2024-09-17T01:42:58.676580+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:57.120214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.676528+0000","last_change":"2024-09-17T01:42:57.695835+0000","last_active":"2024-09-17T01:42:58.676528+0000","last_peered":"2024-09-17T01:42:58.676528+0000","last_clean":"2024-09-17T01:42:58.676528+0000","last_became_active":"2024-09-17T01:42:57.695458+0000","last_became_peered":"2024-09-17T01:42:57.695458+0000","last_unstale":"2024-09-17T01:42:58.676528+0000","last_undegraded":"2024-09-17T01:42:58.676528+0000","last_fullsized":"2024-09-17T01:42:58.676528+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:43.476021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"147'1","reported_seq":16,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.682384+0000","last_change":"2024-09-17T01:42:56.692834+0000","last_active":"2024-09-17T01:42:59.682384+0000","last_peered":"2024-09-17T01:42:59.682384+0000","last_clean":"2024-09-17T01:42:59.682384+0000","last_became_active":"2024-09-17T01:42:56.692478+0000","last_became_peered":"2024-09-17T01:42:56.692478+0000","last_unstale":"2024-09-17T01:42:59.682384+0000","last_undegraded":"2024-09-17T01:42:59.682384+0000","last_fullsized":"2024-09-17T01:42:59.682384+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:14.550195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571335+0000","last_change":"2024-09-17T01:42:57.700993+0000","last_active":"2024-09-17T01:42:59.571335+0000","last_peered":"2024-09-17T01:42:59.571335+0000","last_clean":"2024-09-17T01:42:59.571335+0000","last_became_active":"2024-09-17T01:42:57.696525+0000","last_became_peered":"2024-09-17T01:42:57.696525+0000","last_unstale":"2024-09-17T01:42:59.571335+0000","last_undegraded":"2024-09-17T01:42:59.571335+0000","last_fullsized":"2024-09-17T01:42:59.571335+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:02.227852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677624+0000","last_change":"2024-09-17T01:42:56.681738+0000","last_active":"2024-09-17T01:42:58.677624+0000","last_peered":"2024-09-17T01:42:58.677624+0000","last_clean":"2024-09-17T01:42:58.677624+0000","last_became_active":"2024-09-17T01:42:56.681255+0000","last_became_peered":"2024-09-17T01:42:56.681255+0000","last_unstale":"2024-09-17T01:42:58.677624+0000","last_undegraded":"2024-09-17T01:42:58.677624+0000","last_fullsized":"2024-09-17T01:42:58.677624+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:11.883828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571076+0000","last_change":"2024-09-17T01:42:57.703471+0000","last_active":"2024-09-17T01:42:59.571076+0000","last_peered":"2024-09-17T01:42:59.571076+0000","last_clean":"2024-09-17T01:42:59.571076+0000","last_became_active":"2024-09-17T01:42:57.702558+0000","last_became_peered":"2024-09-17T01:42:57.702558+0000","last_unstale":"2024-09-17T01:42:59.571076+0000","last_undegraded":"2024-09-17T01:42:59.571076+0000","last_fullsized":"2024-09-17T01:42:59.571076+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:05.763830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677376+0000","last_change":"2024-09-17T01:42:56.685353+0000","last_active":"2024-09-17T01:42:58.677376+0000","last_peered":"2024-09-17T01:42:58.677376+0000","last_clean":"2024-09-17T01:42:58.677376+0000","last_became_active":"2024-09-17T01:42:56.684915+0000","last_became_peered":"2024-09-17T01:42:56.684915+0000","last_unstale":"2024-09-17T01:42:58.677376+0000","last_undegraded":"2024-09-17T01:42:58.677376+0000","last_fullsized":"2024-09-17T01:42:58.677376+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:59:30.156646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677816+0000","last_change":"2024-09-17T01:42:57.697059+0000","last_active":"2024-09-17T01:42:58.677816+0000","last_peered":"2024-09-17T01:42:58.677816+0000","last_clean":"2024-09-17T01:42:58.677816+0000","last_became_active":"2024-09-17T01:42:57.696639+0000","last_became_peered":"2024-09-17T01:42:57.696639+0000","last_unstale":"2024-09-17T01:42:58.677816+0000","last_undegraded":"2024-09-17T01:42:58.677816+0000","last_fullsized":"2024-09-17T01:42:58.677816+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:45.362821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.571154+0000","last_change":"2024-09-17T01:42:56.685053+0000","last_active":"2024-09-17T01:42:59.571154+0000","last_peered":"2024-09-17T01:42:59.571154+0000","last_clean":"2024-09-17T01:42:59.571154+0000","last_became_active":"2024-09-17T01:42:56.684753+0000","last_became_peered":"2024-09-17T01:42:56.684753+0000","last_unstale":"2024-09-17T01:42:59.571154+0000","last_undegraded":"2024-09-17T01:42:59.571154+0000","last_fullsized":"2024-09-17T01:42:59.571154+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:53.206898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.676346+0000","last_change":"2024-09-17T01:42:57.694950+0000","last_active":"2024-09-17T01:42:58.676346+0000","last_peered":"2024-09-17T01:42:58.676346+0000","last_clean":"2024-09-17T01:42:58.676346+0000","last_became_active":"2024-09-17T01:42:57.694605+0000","last_became_peered":"2024-09-17T01:42:57.694605+0000","last_unstale":"2024-09-17T01:42:58.676346+0000","last_undegraded":"2024-09-17T01:42:58.676346+0000","last_fullsized":"2024-09-17T01:42:58.676346+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:22.611482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.441052+0000","last_change":"2024-09-17T01:42:56.689553+0000","last_active":"2024-09-17T01:42:59.441052+0000","last_peered":"2024-09-17T01:42:59.441052+0000","last_clean":"2024-09-17T01:42:59.441052+0000","last_became_active":"2024-09-17T01:42:56.687542+0000","last_became_peered":"2024-09-17T01:42:56.687542+0000","last_unstale":"2024-09-17T01:42:59.441052+0000","last_undegraded":"2024-09-17T01:42:59.441052+0000","last_fullsized":"2024-09-17T01:42:59.441052+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:13.200284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.675503+0000","last_change":"2024-09-17T01:42:57.691361+0000","last_active":"2024-09-17T01:42:58.675503+0000","last_peered":"2024-09-17T01:42:58.675503+0000","last_clean":"2024-09-17T01:42:58.675503+0000","last_became_active":"2024-09-17T01:42:57.691049+0000","last_became_peered":"2024-09-17T01:42:57.691049+0000","last_unstale":"2024-09-17T01:42:58.675503+0000","last_undegraded":"2024-09-17T01:42:58.675503+0000","last_fullsized":"2024-09-17T01:42:58.675503+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:14.617948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.445611+0000","last_change":"2024-09-17T01:42:56.683117+0000","last_active":"2024-09-17T01:42:59.445611+0000","last_peered":"2024-09-17T01:42:59.445611+0000","last_clean":"2024-09-17T01:42:59.445611+0000","last_became_active":"2024-09-17T01:42:56.682795+0000","last_became_peered":"2024-09-17T01:42:56.682795+0000","last_unstale":"2024-09-17T01:42:59.445611+0000","last_undegraded":"2024-09-17T01:42:59.445611+0000","last_fullsized":"2024-09-17T01:42:59.445611+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:56.245103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.441071+0000","last_change":"2024-09-17T01:42:57.688270+0000","last_active":"2024-09-17T01:42:59.441071+0000","last_peered":"2024-09-17T01:42:59.441071+0000","last_clean":"2024-09-17T01:42:59.441071+0000","last_became_active":"2024-09-17T01:42:57.687985+0000","last_became_peered":"2024-09-17T01:42:57.687985+0000","last_unstale":"2024-09-17T01:42:59.441071+0000","last_undegraded":"2024-09-17T01:42:59.441071+0000","last_fullsized":"2024-09-17T01:42:59.441071+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:23.411782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":15,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677288+0000","last_change":"2024-09-17T01:42:56.676329+0000","last_active":"2024-09-17T01:42:58.677288+0000","last_peered":"2024-09-17T01:42:58.677288+0000","last_clean":"2024-09-17T01:42:58.677288+0000","last_became_active":"2024-09-17T01:42:56.675978+0000","last_became_peered":"2024-09-17T01:42:56.675978+0000","last_unstale":"2024-09-17T01:42:58.677288+0000","last_undegraded":"2024-09-17T01:42:58.677288+0000","last_fullsized":"2024-09-17T01:42:58.677288+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:18.503158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":13,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:58.677089+0000","last_change":"2024-09-17T01:42:57.686472+0000","last_active":"2024-09-17T01:42:58.677089+0000","last_peered":"2024-09-17T01:42:58.677089+0000","last_clean":"2024-09-17T01:42:58.677089+0000","last_became_active":"2024-09-17T01:42:57.686092+0000","last_became_peered":"2024-09-17T01:42:57.686092+0000","last_unstale":"2024-09-17T01:42:58.677089+0000","last_undegraded":"2024-09-17T01:42:58.677089+0000","last_fullsized":"2024-09-17T01:42:58.677089+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":145,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:56.654950+0000","last_clean_scrub_stamp":"2024-09-17T01:42:56.654950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:41.669396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"146'3","reported_seq":18,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.446053+0000","last_change":"2024-09-17T01:42:56.683406+0000","last_active":"2024-09-17T01:42:59.446053+0000","last_peered":"2024-09-17T01:42:59.446053+0000","last_clean":"2024-09-17T01:42:59.446053+0000","last_became_active":"2024-09-17T01:42:56.682861+0000","last_became_peered":"2024-09-17T01:42:56.682861+0000","last_unstale":"2024-09-17T01:42:59.446053+0000","last_undegraded":"2024-09-17T01:42:59.446053+0000","last_fullsized":"2024-09-17T01:42:59.446053+0000","mapping_epoch":144,"log_start":"0'0","ondisk_log_start":"0'0","created":144,"last_epoch_clean":145,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:42:55.648622+0000","last_clean_scrub_stamp":"2024-09-17T01:42:55.648622+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:07.902176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":348,"reported_epoch":147,"state":"active+clean","last_fresh":"2024-09-17T01:42:59.568707+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:42:59.568707+0000","last_peered":"2024-09-17T01:42:59.568707+0000","last_clean":"2024-09-17T01:42:59.568707+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:42:59.568707+0000","last_undegraded":"2024-09-17T01:42:59.568707+0000","last_fullsized":"2024-09-17T01:42:59.568707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59348,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312492,"statfs":{"total":96636764160,"available":96575991808,"internally_reserved":0,"allocated":1835008,"data_stored":804800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509576,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32968,"kb_used_data":1776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338872,"statfs":{"total":96636764160,"available":96603004928,"internally_reserved":0,"allocated":1818624,"data_stored":798478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509575,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59344,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312496,"statfs":{"total":96636764160,"available":96575995904,"internally_reserved":0,"allocated":1830912,"data_stored":804778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509576,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63516,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308324,"statfs":{"total":96636764160,"available":96571723776,"internally_reserved":0,"allocated":1839104,"data_stored":800694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509576,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59344,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312496,"statfs":{"total":96636764160,"available":96575995904,"internally_reserved":0,"allocated":1826816,"data_stored":799094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509575,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59920,"kb_used_data":2360,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311920,"statfs":{"total":96636764160,"available":96575406080,"internally_reserved":0,"allocated":2416640,"data_stored":1388916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509577,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51028,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320812,"statfs":{"total":96636764160,"available":96584511488,"internally_reserved":0,"allocated":1835008,"data_stored":804868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":50395593},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542281,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59940,"kb_used_data":2380,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311900,"statfs":{"total":96636764160,"available":96575385600,"internally_reserved":0,"allocated":2437120,"data_stored":1390652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:43:02.675 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T01:43:02.676 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T01:43:02.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.951+0000 7f1509600640 1 -- 172.21.15.42:0/3117746414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f150406ee90 msgr2=0x7f150415f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:02.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.951+0000 7f1509600640 1 --2- 172.21.15.42:0/3117746414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f150406ee90 0x7f150415f200 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f14f4005fd0 tx=0x7f14f402a5f0 comp rx=0 tx=0).stop 2024-09-17T01:43:02.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.951+0000 7f1509600640 1 -- 172.21.15.42:0/3117746414 shutdown_connections 2024-09-17T01:43:02.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.951+0000 7f1509600640 1 --2- 172.21.15.42:0/3117746414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f150406ee90 0x7f150415f200 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:02.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.951+0000 7f1509600640 1 -- 172.21.15.42:0/3117746414 >> 172.21.15.42:0/3117746414 conn(0x7f15040b2930 msgr2=0x7f150406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:02.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.951+0000 7f1509600640 1 -- 172.21.15.42:0/3117746414 shutdown_connections 2024-09-17T01:43:02.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.951+0000 7f1509600640 1 -- 172.21.15.42:0/3117746414 wait complete. 2024-09-17T01:43:02.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.953+0000 7f1509600640 1 Processor -- start 2024-09-17T01:43:02.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.953+0000 7f1509600640 1 -- start start 2024-09-17T01:43:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.955+0000 7f1509600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f150406ee90 0x7f15041f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.955+0000 7f1509600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f150406f2a0 0x7f1504155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.955+0000 7f1509600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1504073df0 0x7f15041614b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.955+0000 7f1509600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f15040cf0c0 con 0x7f150406ee90 2024-09-17T01:43:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.955+0000 7f1509600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f15040cef40 con 0x7f1504073df0 2024-09-17T01:43:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.955+0000 7f1509600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f15040cf240 con 0x7f150406f2a0 2024-09-17T01:43:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.955+0000 7f1502a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f150406ee90 0x7f15041f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.955+0000 7f1502a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f150406ee90 0x7f15041f55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59704/0 (socket says 172.21.15.42:59704) 2024-09-17T01:43:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.955+0000 7f1502a00640 1 -- 172.21.15.42:0/2398366082 learned_addr learned my addr 172.21.15.42:0/2398366082 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.955+0000 7f1503400640 1 --2- 172.21.15.42:0/2398366082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1504073df0 0x7f15041614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.955+0000 7f1502a00640 1 -- 172.21.15.42:0/2398366082 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f150406f2a0 msgr2=0x7f1504155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.955+0000 7f14fa000640 1 --2- 172.21.15.42:0/2398366082 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f150406f2a0 0x7f1504155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.955+0000 7f1502a00640 1 --2- 172.21.15.42:0/2398366082 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f150406f2a0 0x7f1504155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.955+0000 7f1502a00640 1 -- 172.21.15.42:0/2398366082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1504073df0 msgr2=0x7f15041614b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.955+0000 7f1502a00640 1 --2- 172.21.15.42:0/2398366082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1504073df0 0x7f15041614b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.956+0000 7f1502a00640 1 -- 172.21.15.42:0/2398366082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15040b3aa0 con 0x7f150406ee90 2024-09-17T01:43:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.956+0000 7f1503400640 1 --2- 172.21.15.42:0/2398366082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1504073df0 0x7f15041614b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:43:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.956+0000 7f14fa000640 1 --2- 172.21.15.42:0/2398366082 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f150406f2a0 0x7f1504155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:43:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.956+0000 7f1502a00640 1 --2- 172.21.15.42:0/2398366082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f150406ee90 0x7f15041f55c0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009230 tx=0x7f14f4003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.956+0000 7f14fb400640 1 -- 172.21.15.42:0/2398366082 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f403e030 con 0x7f150406ee90 2024-09-17T01:43:02.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.956+0000 7f14fb400640 1 -- 172.21.15.42:0/2398366082 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14f4003e00 con 0x7f150406ee90 2024-09-17T01:43:02.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.956+0000 7f14fb400640 1 -- 172.21.15.42:0/2398366082 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f4035040 con 0x7f150406ee90 2024-09-17T01:43:02.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.956+0000 7f1509600640 1 -- 172.21.15.42:0/2398366082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15040b3d80 con 0x7f150406ee90 2024-09-17T01:43:02.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.956+0000 7f1509600640 1 -- 172.21.15.42:0/2398366082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15040b4340 con 0x7f150406ee90 2024-09-17T01:43:02.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.957+0000 7f1509600640 1 -- 172.21.15.42:0/2398366082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15040cf6f0 con 0x7f150406ee90 2024-09-17T01:43:02.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.959+0000 7f14fb400640 1 -- 172.21.15.42:0/2398366082 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f14f4041030 con 0x7f150406ee90 2024-09-17T01:43:02.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.959+0000 7f14fb400640 1 --2- 172.21.15.42:0/2398366082 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f14e0078b90 0x7f14e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:02.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.960+0000 7f14fb400640 1 -- 172.21.15.42:0/2398366082 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f14f40bb630 con 0x7f150406ee90 2024-09-17T01:43:02.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.960+0000 7f14fa000640 1 --2- 172.21.15.42:0/2398366082 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f14e0078b90 0x7f14e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:02.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.961+0000 7f14fa000640 1 --2- 172.21.15.42:0/2398366082 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f14e0078b90 0x7f14e007b0a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f150406cfa0 tx=0x7f14ec009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:02.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:02.964+0000 7f14fb400640 1 -- 172.21.15.42:0/2398366082 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f14f4083a70 con 0x7f150406ee90 2024-09-17T01:43:03.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.229+0000 7f1509600640 1 -- 172.21.15.42:0/2398366082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f150406a170 con 0x7f150406ee90 2024-09-17T01:43:03.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.232+0000 7f14fb400640 1 -- 172.21.15.42:0/2398366082 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v38) ==== 190+0+147 (secure 0 0 0) 0x7f14f4083370 con 0x7f150406ee90 2024-09-17T01:43:03.230 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-09-17T01:43:03.230 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA== 2024-09-17T01:43:03.230 INFO:teuthology.orchestra.run.smithi042.stdout: caps mds = "allow" 2024-09-17T01:43:03.230 INFO:teuthology.orchestra.run.smithi042.stdout: caps mon = "allow r" 2024-09-17T01:43:03.230 INFO:teuthology.orchestra.run.smithi042.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T01:43:03.231 INFO:teuthology.orchestra.run.smithi042.stderr:updated caps for client.0 2024-09-17T01:43:03.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.235+0000 7f1509600640 1 -- 172.21.15.42:0/2398366082 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f14e0078b90 msgr2=0x7f14e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:03.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.235+0000 7f1509600640 1 --2- 172.21.15.42:0/2398366082 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f14e0078b90 0x7f14e007b0a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f150406cfa0 tx=0x7f14ec009040 comp rx=0 tx=0).stop 2024-09-17T01:43:03.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.235+0000 7f1509600640 1 -- 172.21.15.42:0/2398366082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f150406ee90 msgr2=0x7f15041f55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:03.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.235+0000 7f1509600640 1 --2- 172.21.15.42:0/2398366082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f150406ee90 0x7f15041f55c0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009230 tx=0x7f14f4003910 comp rx=0 tx=0).stop 2024-09-17T01:43:03.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.235+0000 7f1509600640 1 -- 172.21.15.42:0/2398366082 shutdown_connections 2024-09-17T01:43:03.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.235+0000 7f1509600640 1 --2- 172.21.15.42:0/2398366082 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f14e0078b90 0x7f14e007b0a0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:03.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.235+0000 7f1509600640 1 --2- 172.21.15.42:0/2398366082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1504073df0 0x7f15041614b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:03.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.235+0000 7f1509600640 1 --2- 172.21.15.42:0/2398366082 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f150406f2a0 0x7f1504155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:03.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.235+0000 7f1509600640 1 --2- 172.21.15.42:0/2398366082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f150406ee90 0x7f15041f55c0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:03.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.235+0000 7f1509600640 1 -- 172.21.15.42:0/2398366082 >> 172.21.15.42:0/2398366082 conn(0x7f15040b2930 msgr2=0x7f150406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:03.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.235+0000 7f1509600640 1 -- 172.21.15.42:0/2398366082 shutdown_connections 2024-09-17T01:43:03.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.235+0000 7f1509600640 1 -- 172.21.15.42:0/2398366082 wait complete. 2024-09-17T01:43:03.258 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:43:03.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.488+0000 7f5690a00640 1 -- 172.21.15.42:0/2249909959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f568c0cf7c0 msgr2=0x7f568c06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:03.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.488+0000 7f5690a00640 1 --2- 172.21.15.42:0/2249909959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f568c0cf7c0 0x7f568c06cd20 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f5674009830 tx=0x7f567402a510 comp rx=0 tx=0).stop 2024-09-17T01:43:03.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.488+0000 7f5690a00640 1 -- 172.21.15.42:0/2249909959 shutdown_connections 2024-09-17T01:43:03.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.488+0000 7f5690a00640 1 --2- 172.21.15.42:0/2249909959 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f568c06d260 0x7f568c152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:03.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.488+0000 7f5690a00640 1 --2- 172.21.15.42:0/2249909959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f568c0cf7c0 0x7f568c06cd20 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:03.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.488+0000 7f5690a00640 1 -- 172.21.15.42:0/2249909959 >> 172.21.15.42:0/2249909959 conn(0x7f568c0b25f0 msgr2=0x7f568c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:03.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.488+0000 7f5690a00640 1 -- 172.21.15.42:0/2249909959 shutdown_connections 2024-09-17T01:43:03.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.488+0000 7f5690a00640 1 -- 172.21.15.42:0/2249909959 wait complete. 2024-09-17T01:43:03.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.490+0000 7f5690a00640 1 Processor -- start 2024-09-17T01:43:03.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.490+0000 7f5690a00640 1 -- start start 2024-09-17T01:43:03.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.492+0000 7f5690a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f568c06d260 0x7f568c1520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:03.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.492+0000 7f5690a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f568c0b4be0 0x7f568c151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:03.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.492+0000 7f5690a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f568c0cf7c0 0x7f568c073610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:03.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.492+0000 7f5690a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f568c153850 con 0x7f568c06d260 2024-09-17T01:43:03.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.492+0000 7f5690a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f568c1536d0 con 0x7f568c0cf7c0 2024-09-17T01:43:03.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.492+0000 7f5690a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f568c1539d0 con 0x7f568c0b4be0 2024-09-17T01:43:03.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.492+0000 7f568b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f568c06d260 0x7f568c1520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:03.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.492+0000 7f568b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f568c06d260 0x7f568c1520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59726/0 (socket says 172.21.15.42:59726) 2024-09-17T01:43:03.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.492+0000 7f568b400640 1 -- 172.21.15.42:0/4227962280 learned_addr learned my addr 172.21.15.42:0/4227962280 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:03.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.493+0000 7f568b400640 1 -- 172.21.15.42:0/4227962280 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f568c0b4be0 msgr2=0x7f568c151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:03.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.493+0000 7f5683e00640 1 --2- 172.21.15.42:0/4227962280 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f568c0b4be0 0x7f568c151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:03.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.493+0000 7f568be00640 1 --2- 172.21.15.42:0/4227962280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f568c0cf7c0 0x7f568c073610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:03.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.493+0000 7f568b400640 1 --2- 172.21.15.42:0/4227962280 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f568c0b4be0 0x7f568c151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:03.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.493+0000 7f568b400640 1 -- 172.21.15.42:0/4227962280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f568c0cf7c0 msgr2=0x7f568c073610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:03.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.493+0000 7f568b400640 1 --2- 172.21.15.42:0/4227962280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f568c0cf7c0 0x7f568c073610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:03.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.493+0000 7f568b400640 1 -- 172.21.15.42:0/4227962280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f568c0c5010 con 0x7f568c06d260 2024-09-17T01:43:03.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.493+0000 7f5683e00640 1 --2- 172.21.15.42:0/4227962280 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f568c0b4be0 0x7f568c151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:43:03.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.493+0000 7f568be00640 1 --2- 172.21.15.42:0/4227962280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f568c0cf7c0 0x7f568c073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:43:03.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.493+0000 7f568b400640 1 --2- 172.21.15.42:0/4227962280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f568c06d260 0x7f568c1520d0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f567c00c730 tx=0x7f567c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:03.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.493+0000 7f5683400640 1 -- 172.21.15.42:0/4227962280 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c006890 con 0x7f568c06d260 2024-09-17T01:43:03.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.493+0000 7f5683400640 1 -- 172.21.15.42:0/4227962280 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f567c006a30 con 0x7f568c06d260 2024-09-17T01:43:03.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.493+0000 7f5683400640 1 -- 172.21.15.42:0/4227962280 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c007030 con 0x7f568c06d260 2024-09-17T01:43:03.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.493+0000 7f5690a00640 1 -- 172.21.15.42:0/4227962280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f568c152610 con 0x7f568c06d260 2024-09-17T01:43:03.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.493+0000 7f5690a00640 1 -- 172.21.15.42:0/4227962280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f568c0cb510 con 0x7f568c06d260 2024-09-17T01:43:03.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.494+0000 7f5690a00640 1 -- 172.21.15.42:0/4227962280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f568c152ed0 con 0x7f568c06d260 2024-09-17T01:43:03.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.496+0000 7f5683400640 1 -- 172.21.15.42:0/4227962280 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f567c0071d0 con 0x7f568c06d260 2024-09-17T01:43:03.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.497+0000 7f5683400640 1 --2- 172.21.15.42:0/4227962280 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5668078bc0 0x7f566807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:03.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.497+0000 7f5683400640 1 -- 172.21.15.42:0/4227962280 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f567c09a840 con 0x7f568c06d260 2024-09-17T01:43:03.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.497+0000 7f5683e00640 1 --2- 172.21.15.42:0/4227962280 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5668078bc0 0x7f566807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:03.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.498+0000 7f5683e00640 1 --2- 172.21.15.42:0/4227962280 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5668078bc0 0x7f566807b0d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5674034000 tx=0x7f5674004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:03.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.501+0000 7f5683400640 1 -- 172.21.15.42:0/4227962280 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f568c06d670 con 0x7f568c06d260 2024-09-17T01:43:03.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.733+0000 7f5690a00640 1 -- 172.21.15.42:0/4227962280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f568c06cd20 con 0x7f568c06d260 2024-09-17T01:43:03.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.733+0000 7f5683400640 1 -- 172.21.15.42:0/4227962280 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) ==== 95+0+5230 (secure 0 0 0) 0x7f567c062c70 con 0x7f568c06d260 2024-09-17T01:43:03.731 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:03.731 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3131119825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3131119825},{"type":"v1","addr":"172.21.15.43:6837","nonce":3131119825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8368,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1988657429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1988657429},{"type":"v1","addr":"172.21.15.43:6836","nonce":1988657429}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/578887548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":578887548},{"type":"v1","addr":"172.21.15.42:6835","nonce":578887548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:42:57.184518+0000","modified":"2024-09-17T01:43:00.201156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8982":{"gid":8982,"name":"c","rank":0,"incarnation":112,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6834/3811049376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3811049376},{"type":"v1","addr":"172.21.15.42:6834","nonce":3811049376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8982,"qdb_cluster":[8982]},"id":10}]} 2024-09-17T01:43:03.731 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 116 2024-09-17T01:43:03.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.735+0000 7f5690a00640 1 -- 172.21.15.42:0/4227962280 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5668078bc0 msgr2=0x7f566807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:03.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.735+0000 7f5690a00640 1 --2- 172.21.15.42:0/4227962280 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5668078bc0 0x7f566807b0d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5674034000 tx=0x7f5674004730 comp rx=0 tx=0).stop 2024-09-17T01:43:03.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.735+0000 7f5690a00640 1 -- 172.21.15.42:0/4227962280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f568c06d260 msgr2=0x7f568c1520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:03.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.735+0000 7f5690a00640 1 --2- 172.21.15.42:0/4227962280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f568c06d260 0x7f568c1520d0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f567c00c730 tx=0x7f567c00cbf0 comp rx=0 tx=0).stop 2024-09-17T01:43:03.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.735+0000 7f5690a00640 1 -- 172.21.15.42:0/4227962280 shutdown_connections 2024-09-17T01:43:03.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.735+0000 7f5690a00640 1 --2- 172.21.15.42:0/4227962280 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5668078bc0 0x7f566807b0d0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:03.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.736+0000 7f5690a00640 1 --2- 172.21.15.42:0/4227962280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f568c0cf7c0 0x7f568c073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:03.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.736+0000 7f5690a00640 1 --2- 172.21.15.42:0/4227962280 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f568c0b4be0 0x7f568c151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:03.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.736+0000 7f5690a00640 1 --2- 172.21.15.42:0/4227962280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f568c06d260 0x7f568c1520d0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:03.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.736+0000 7f5690a00640 1 -- 172.21.15.42:0/4227962280 >> 172.21.15.42:0/4227962280 conn(0x7f568c0b25f0 msgr2=0x7f568c15f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:03.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.736+0000 7f5690a00640 1 -- 172.21.15.42:0/4227962280 shutdown_connections 2024-09-17T01:43:03.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:03.736+0000 7f5690a00640 1 -- 172.21.15.42:0/4227962280 wait complete. 2024-09-17T01:43:04.160 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 116, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:42:57.184518+0000', 'modified': '2024-09-17T01:43:00.201156+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8982}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8982': {'gid': 8982, 'name': 'c', 'rank': 0, 'incarnation': 112, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.42:6834/3811049376', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6832', 'nonce': 3811049376}, {'type': 'v1', 'addr': '172.21.15.42:6834', 'nonce': 3811049376}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8982, 'qdb_cluster': [8982]} 2024-09-17T01:43:04.160 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T01:43:04.161 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T01:43:04.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.397+0000 7f2610e00640 1 -- 172.21.15.42:0/1321733961 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f260c0b78f0 msgr2=0x7f260c0d02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:04.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.397+0000 7f2610e00640 1 --2- 172.21.15.42:0/1321733961 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f260c0b78f0 0x7f260c0d02f0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f25fc005fd0 tx=0x7f25fc02a530 comp rx=0 tx=0).stop 2024-09-17T01:43:04.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.397+0000 7f2610e00640 1 -- 172.21.15.42:0/1321733961 shutdown_connections 2024-09-17T01:43:04.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.397+0000 7f2610e00640 1 --2- 172.21.15.42:0/1321733961 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f260c0d0830 0x7f260c0d0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.397+0000 7f2610e00640 1 --2- 172.21.15.42:0/1321733961 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f260c0b78f0 0x7f260c0d02f0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.397+0000 7f2610e00640 1 -- 172.21.15.42:0/1321733961 >> 172.21.15.42:0/1321733961 conn(0x7f260c0b3ed0 msgr2=0x7f260c0b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:04.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.397+0000 7f2610e00640 1 -- 172.21.15.42:0/1321733961 shutdown_connections 2024-09-17T01:43:04.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.397+0000 7f2610e00640 1 -- 172.21.15.42:0/1321733961 wait complete. 2024-09-17T01:43:04.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.399+0000 7f2610e00640 1 Processor -- start 2024-09-17T01:43:04.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.399+0000 7f2610e00640 1 -- start start 2024-09-17T01:43:04.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.401+0000 7f2610e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f260c0b78f0 0x7f260c14eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:04.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.401+0000 7f2610e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f260c0cebc0 0x7f260c1f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:04.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.401+0000 7f2610e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f260c0d0830 0x7f260c1f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:04.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.401+0000 7f2610e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f260c0ce4a0 con 0x7f260c0b78f0 2024-09-17T01:43:04.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.401+0000 7f2610e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f260c0ce320 con 0x7f260c0cebc0 2024-09-17T01:43:04.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.401+0000 7f2610e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f260c0ce620 con 0x7f260c0d0830 2024-09-17T01:43:04.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.401+0000 7f260b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f260c0b78f0 0x7f260c14eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:04.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.401+0000 7f260b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f260c0b78f0 0x7f260c14eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59738/0 (socket says 172.21.15.42:59738) 2024-09-17T01:43:04.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.401+0000 7f260b400640 1 -- 172.21.15.42:0/2578931755 learned_addr learned my addr 172.21.15.42:0/2578931755 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:04.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.401+0000 7f2602a00640 1 --2- 172.21.15.42:0/2578931755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f260c0cebc0 0x7f260c1f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:04.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.401+0000 7f260be00640 1 --2- 172.21.15.42:0/2578931755 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f260c0d0830 0x7f260c1f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:04.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.401+0000 7f260b400640 1 -- 172.21.15.42:0/2578931755 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f260c0d0830 msgr2=0x7f260c1f61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:04.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.401+0000 7f260b400640 1 --2- 172.21.15.42:0/2578931755 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f260c0d0830 0x7f260c1f61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.401+0000 7f260b400640 1 -- 172.21.15.42:0/2578931755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f260c0cebc0 msgr2=0x7f260c1f5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:04.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.401+0000 7f260b400640 1 --2- 172.21.15.42:0/2578931755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f260c0cebc0 0x7f260c1f5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.401+0000 7f260b400640 1 -- 172.21.15.42:0/2578931755 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f260c161fd0 con 0x7f260c0b78f0 2024-09-17T01:43:04.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.401+0000 7f260be00640 1 --2- 172.21.15.42:0/2578931755 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f260c0d0830 0x7f260c1f61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:43:04.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.402+0000 7f260b400640 1 --2- 172.21.15.42:0/2578931755 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f260c0b78f0 0x7f260c14eec0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f25fc034040 tx=0x7f25fc0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:04.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.402+0000 7f2603e00640 1 -- 172.21.15.42:0/2578931755 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25fc03e030 con 0x7f260c0b78f0 2024-09-17T01:43:04.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.402+0000 7f2603e00640 1 -- 172.21.15.42:0/2578931755 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f25fc003d90 con 0x7f260c0b78f0 2024-09-17T01:43:04.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.402+0000 7f2610e00640 1 -- 172.21.15.42:0/2578931755 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f260c15f210 con 0x7f260c0b78f0 2024-09-17T01:43:04.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.402+0000 7f2603e00640 1 -- 172.21.15.42:0/2578931755 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25fc035040 con 0x7f260c0b78f0 2024-09-17T01:43:04.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.402+0000 7f2610e00640 1 -- 172.21.15.42:0/2578931755 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f260c15f7d0 con 0x7f260c0b78f0 2024-09-17T01:43:04.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.405+0000 7f2603e00640 1 -- 172.21.15.42:0/2578931755 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f25fc041030 con 0x7f260c0b78f0 2024-09-17T01:43:04.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.406+0000 7f2603e00640 1 --2- 172.21.15.42:0/2578931755 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f25e8078bf0 0x7f25e807b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:04.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.406+0000 7f2603e00640 1 -- 172.21.15.42:0/2578931755 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f25fc0bb8a0 con 0x7f260c0b78f0 2024-09-17T01:43:04.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.406+0000 7f261941b740 1 Processor -- start 2024-09-17T01:43:04.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.406+0000 7f2602a00640 1 --2- 172.21.15.42:0/2578931755 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f25e8078bf0 0x7f25e807b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:04.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.406+0000 7f261941b740 1 -- start start 2024-09-17T01:43:04.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.407+0000 7f2602a00640 1 --2- 172.21.15.42:0/2578931755 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f25e8078bf0 0x7f25e807b100 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f25f4005fd0 tx=0x7f25f4005850 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:04.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.408+0000 7f261941b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e39270 0x560cb6209b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:04.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.408+0000 7f261941b740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560cb5e103b0 0x560cb620a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:04.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.408+0000 7f261941b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560cb5e18590 0x560cb61da150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:04.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.408+0000 7f261941b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560cb6163430 con 0x560cb5e39270 2024-09-17T01:43:04.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.408+0000 7f261941b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560cb61535d0 con 0x560cb5e18590 2024-09-17T01:43:04.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.408+0000 7f261941b740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x560cb6142a00 con 0x560cb5e103b0 2024-09-17T01:43:04.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.408+0000 7f260b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e39270 0x560cb6209b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:04.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.408+0000 7f260b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e39270 0x560cb6209b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59746/0 (socket says 172.21.15.42:59746) 2024-09-17T01:43:04.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.408+0000 7f260b400640 1 -- 172.21.15.42:0/1287926750 learned_addr learned my addr 172.21.15.42:0/1287926750 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:04.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.408+0000 7f260be00640 1 --2- 172.21.15.42:0/1287926750 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560cb5e18590 0x560cb61da150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:04.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.408+0000 7f2602a00640 1 --2- 172.21.15.42:0/1287926750 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560cb5e103b0 0x560cb620a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:04.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.408+0000 7f260b400640 1 -- 172.21.15.42:0/1287926750 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560cb5e103b0 msgr2=0x560cb620a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:04.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.408+0000 7f260b400640 1 --2- 172.21.15.42:0/1287926750 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560cb5e103b0 0x560cb620a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.408+0000 7f260b400640 1 -- 172.21.15.42:0/1287926750 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560cb5e18590 msgr2=0x560cb61da150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:04.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.408+0000 7f260b400640 1 --2- 172.21.15.42:0/1287926750 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560cb5e18590 0x560cb61da150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.408+0000 7f260b400640 1 -- 172.21.15.42:0/1287926750 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cb610b520 con 0x560cb5e39270 2024-09-17T01:43:04.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.408+0000 7f260be00640 1 --2- 172.21.15.42:0/1287926750 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560cb5e18590 0x560cb61da150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:43:04.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.409+0000 7f260b400640 1 --2- 172.21.15.42:0/1287926750 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e39270 0x560cb6209b60 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f25fc083560 tx=0x7f25fc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e639997209fc1c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:04.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.409+0000 7f25fbe00640 1 -- 172.21.15.42:0/1287926750 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25fc048040 con 0x560cb5e39270 2024-09-17T01:43:04.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.409+0000 7f25fbe00640 1 -- 172.21.15.42:0/1287926750 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f25fc083cd0 con 0x560cb5e39270 2024-09-17T01:43:04.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.409+0000 7f25fbe00640 1 -- 172.21.15.42:0/1287926750 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25fc083a90 con 0x560cb5e39270 2024-09-17T01:43:04.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.410+0000 7f261941b740 1 -- 172.21.15.42:0/1287926750 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e39270 msgr2=0x560cb6209b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:04.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.410+0000 7f261941b740 1 --2- 172.21.15.42:0/1287926750 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e39270 0x560cb6209b60 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f25fc083560 tx=0x7f25fc009260 comp rx=0 tx=0).stop 2024-09-17T01:43:04.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.410+0000 7f261941b740 1 -- 172.21.15.42:0/1287926750 shutdown_connections 2024-09-17T01:43:04.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.410+0000 7f261941b740 1 --2- 172.21.15.42:0/1287926750 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560cb5e18590 0x560cb61da150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.410+0000 7f261941b740 1 --2- 172.21.15.42:0/1287926750 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560cb5e103b0 0x560cb620a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.410+0000 7f261941b740 1 --2- 172.21.15.42:0/1287926750 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e39270 0x560cb6209b60 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.410+0000 7f261941b740 1 -- 172.21.15.42:0/1287926750 >> 172.21.15.42:0/1287926750 conn(0x560cb5e2d3c0 msgr2=0x560cb61dfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:04.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.410+0000 7f261941b740 1 -- 172.21.15.42:0/1287926750 shutdown_connections 2024-09-17T01:43:04.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.410+0000 7f261941b740 1 -- 172.21.15.42:0/1287926750 wait complete. 2024-09-17T01:43:04.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.411+0000 7f261941b740 1 -- start start 2024-09-17T01:43:04.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.411+0000 7f261941b740 1 Processor -- start 2024-09-17T01:43:04.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.413+0000 7f261941b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560cb5e103b0 0x560cb6238050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:04.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.413+0000 7f261941b740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560cb5e18590 0x560cb6200250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:04.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.413+0000 7f261941b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e39270 0x560cb6226ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:04.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.413+0000 7f261941b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560cb60e9330 con 0x560cb5e39270 2024-09-17T01:43:04.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.413+0000 7f261941b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560cb6146810 con 0x560cb5e103b0 2024-09-17T01:43:04.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.413+0000 7f261941b740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x560cb5eb3620 con 0x560cb5e18590 2024-09-17T01:43:04.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.413+0000 7f261941b740 10 client.0 _ll_register_callbacks cb 0x560cb60ee420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:43:04.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.413+0000 7f260be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e39270 0x560cb6226ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:04.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.413+0000 7f260be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e39270 0x560cb6226ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59748/0 (socket says 172.21.15.42:59748) 2024-09-17T01:43:04.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.413+0000 7f260be00640 1 -- 172.21.15.42:0/2985281646 learned_addr learned my addr 172.21.15.42:0/2985281646 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:04.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.413+0000 7f2602a00640 1 --2- 172.21.15.42:0/2985281646 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560cb5e18590 0x560cb6200250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:04.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.413+0000 7f260b400640 1 --2- 172.21.15.42:0/2985281646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560cb5e103b0 0x560cb6238050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:04.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.414+0000 7f260be00640 1 -- 172.21.15.42:0/2985281646 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560cb5e18590 msgr2=0x560cb6200250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:04.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.414+0000 7f260be00640 1 --2- 172.21.15.42:0/2985281646 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560cb5e18590 0x560cb6200250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.414+0000 7f260be00640 1 -- 172.21.15.42:0/2985281646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560cb5e103b0 msgr2=0x560cb6238050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:04.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.414+0000 7f260be00640 1 --2- 172.21.15.42:0/2985281646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560cb5e103b0 0x560cb6238050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.414+0000 7f260be00640 1 -- 172.21.15.42:0/2985281646 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cb5ea4850 con 0x560cb5e39270 2024-09-17T01:43:04.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.414+0000 7f260be00640 1 --2- 172.21.15.42:0/2985281646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e39270 0x560cb6226ab0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f260400eab0 tx=0x7f260400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd62849a285e199 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:04.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.414+0000 7f25f8c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:43:04.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.414+0000 7f25f8c00640 1 -- 172.21.15.42:0/2985281646 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260401a410 con 0x560cb5e39270 2024-09-17T01:43:04.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.414+0000 7f25f8c00640 1 -- 172.21.15.42:0/2985281646 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f260401a5b0 con 0x560cb5e39270 2024-09-17T01:43:04.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.414+0000 7f261941b740 1 -- 172.21.15.42:0/2985281646 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25fc083cd0 con 0x560cb5e39270 2024-09-17T01:43:04.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.414+0000 7f25f8c00640 1 -- 172.21.15.42:0/2985281646 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) ==== 24+0+0 (secure 0 0 0) 0x7f2604022050 con 0x560cb5e39270 2024-09-17T01:43:04.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.414+0000 7f261941b740 10 client.9108 fetch_fsmap learned FSMap version 116 2024-09-17T01:43:04.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.414+0000 7f261941b740 1 -- 172.21.15.42:0/2985281646 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) -- 0x560cb5f1b6b0 con 0x560cb5e39270 2024-09-17T01:43:04.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.415+0000 7f25f8c00640 1 -- 172.21.15.42:0/2985281646 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f25fc083cd0 con 0x560cb5e39270 2024-09-17T01:43:04.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.415+0000 7f25f8c00640 1 -- 172.21.15.42:0/2985281646 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 116) ==== 3502+0+0 (secure 0 0 0) 0x7f2604003970 con 0x560cb5e39270 2024-09-17T01:43:04.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.415+0000 7f261941b740 10 client.9108 fetch_fsmap finished waiting for FSMap version 116 2024-09-17T01:43:04.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.415+0000 7f261941b740 10 client.9108 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:43:04.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.415+0000 7f261941b740 20 client.9108 populate_metadata read hostname 'smithi042' 2024-09-17T01:43:04.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.415+0000 7f261941b740 1 --2- 172.21.15.42:0/2985281646 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x560cb5df7e40 0x560cb6205b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:04.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.415+0000 7f261941b740 4 client.9108 mds_command: new command op to 8982 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:43:04.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.415+0000 7f261941b740 1 -- 172.21.15.42:0/2985281646 --> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560cb6155520 con 0x560cb5df7e40 2024-09-17T01:43:04.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.415+0000 7f260b400640 1 --2- 172.21.15.42:0/2985281646 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x560cb5df7e40 0x560cb6205b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:04.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.416+0000 7f260b400640 1 --2- 172.21.15.42:0/2985281646 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x560cb5df7e40 0x560cb6205b40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f367ad56e9af6bf5 server_cookie=675c279488e620b1 in_seq=0 out_seq=0 2024-09-17T01:43:04.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.416+0000 7f25f8c00640 10 client.9108 ms_handle_connect on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:04.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.417+0000 7f25f8c00640 1 -- 172.21.15.42:0/2985281646 <== mds.0 v2:172.21.15.42:6832/3811049376 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560cb6155520 con 0x560cb5df7e40 2024-09-17T01:43:04.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.417+0000 7f25f8c00640 10 client.9108 handle_command_reply: tid=0 2024-09-17T01:43:04.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.417+0000 7f261941b740 1 client.9108 shutdown 2024-09-17T01:43:04.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.417+0000 7f261941b740 1 -- 172.21.15.42:0/2985281646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e39270 msgr2=0x560cb6226ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:04.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.417+0000 7f261941b740 1 --2- 172.21.15.42:0/2985281646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e39270 0x560cb6226ab0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f260400eab0 tx=0x7f260400ef70 comp rx=0 tx=0).stop 2024-09-17T01:43:04.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.417+0000 7f261941b740 1 -- 172.21.15.42:0/2985281646 shutdown_connections 2024-09-17T01:43:04.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.417+0000 7f261941b740 1 --2- 172.21.15.42:0/2985281646 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x560cb5df7e40 0x560cb6205b40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.417+0000 7f261941b740 1 --2- 172.21.15.42:0/2985281646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e39270 0x560cb6226ab0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.417+0000 7f261941b740 1 --2- 172.21.15.42:0/2985281646 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560cb5e18590 0x560cb6200250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.417+0000 7f261941b740 1 --2- 172.21.15.42:0/2985281646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560cb5e103b0 0x560cb6238050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.417+0000 7f25f8c00640 0 client.9108 ms_handle_reset on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:04.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.417+0000 7f261941b740 1 -- 172.21.15.42:0/2985281646 >> 172.21.15.42:0/2985281646 conn(0x560cb5e2d3c0 msgr2=0x560cb61db550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:04.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.417+0000 7f261941b740 1 -- 172.21.15.42:0/2985281646 shutdown_connections 2024-09-17T01:43:04.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.417+0000 7f261941b740 1 -- 172.21.15.42:0/2985281646 wait complete. 2024-09-17T01:43:04.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.417+0000 7f261941b740 20 client.9108 trim_cache size 0 max 16384 2024-09-17T01:43:04.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.437+0000 7f261941b740 1 Processor -- start 2024-09-17T01:43:04.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.437+0000 7f261941b740 1 -- start start 2024-09-17T01:43:04.436 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.438+0000 7f261941b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e103b0 0x560cb6248430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:04.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.438+0000 7f261941b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560cb5e18590 0x560cb6224ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:04.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.438+0000 7f261941b740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560cb5e39270 0x560cb6225020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:04.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.438+0000 7f261941b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f260c160ab0 con 0x560cb5e103b0 2024-09-17T01:43:04.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.438+0000 7f261941b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f260c15fe10 con 0x560cb5e18590 2024-09-17T01:43:04.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.438+0000 7f261941b740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f260c160460 con 0x560cb5e39270 2024-09-17T01:43:04.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.438+0000 7f260b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e103b0 0x560cb6248430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:04.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.439+0000 7f260b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e103b0 0x560cb6248430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59762/0 (socket says 172.21.15.42:59762) 2024-09-17T01:43:04.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.439+0000 7f260b400640 1 -- 172.21.15.42:0/3033741354 learned_addr learned my addr 172.21.15.42:0/3033741354 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:04.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.439+0000 7f2602a00640 1 --2- 172.21.15.42:0/3033741354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560cb5e18590 0x560cb6224ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:04.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.439+0000 7f260be00640 1 --2- 172.21.15.42:0/3033741354 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560cb5e39270 0x560cb6225020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:04.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.439+0000 7f260b400640 1 -- 172.21.15.42:0/3033741354 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560cb5e39270 msgr2=0x560cb6225020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:04.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.439+0000 7f260b400640 1 --2- 172.21.15.42:0/3033741354 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560cb5e39270 0x560cb6225020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.439+0000 7f260b400640 1 -- 172.21.15.42:0/3033741354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560cb5e18590 msgr2=0x560cb6224ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:04.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.439+0000 7f260b400640 1 --2- 172.21.15.42:0/3033741354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560cb5e18590 0x560cb6224ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.439+0000 7f260b400640 1 -- 172.21.15.42:0/3033741354 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cb61e0840 con 0x560cb5e103b0 2024-09-17T01:43:04.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.439+0000 7f260be00640 1 --2- 172.21.15.42:0/3033741354 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560cb5e39270 0x560cb6225020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:43:04.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.439+0000 7f260b400640 1 --2- 172.21.15.42:0/3033741354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e103b0 0x560cb6248430 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f25fc006010 tx=0x7f25fc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728df037bef8a82 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:04.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.439+0000 7f25fb400640 1 -- 172.21.15.42:0/3033741354 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25fc0a2070 con 0x560cb5e103b0 2024-09-17T01:43:04.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.439+0000 7f25fb400640 1 -- 172.21.15.42:0/3033741354 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f25fc083cd0 con 0x560cb5e103b0 2024-09-17T01:43:04.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.439+0000 7f25fb400640 1 -- 172.21.15.42:0/3033741354 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25fc048040 con 0x560cb5e103b0 2024-09-17T01:43:04.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.440+0000 7f261941b740 1 -- 172.21.15.42:0/3033741354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e103b0 msgr2=0x560cb6248430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:04.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.440+0000 7f261941b740 1 --2- 172.21.15.42:0/3033741354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e103b0 0x560cb6248430 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f25fc006010 tx=0x7f25fc009260 comp rx=0 tx=0).stop 2024-09-17T01:43:04.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.440+0000 7f261941b740 1 -- 172.21.15.42:0/3033741354 shutdown_connections 2024-09-17T01:43:04.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.440+0000 7f261941b740 1 --2- 172.21.15.42:0/3033741354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560cb5e18590 0x560cb6224ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.440+0000 7f261941b740 1 --2- 172.21.15.42:0/3033741354 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560cb5e39270 0x560cb6225020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.440+0000 7f261941b740 1 --2- 172.21.15.42:0/3033741354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e103b0 0x560cb6248430 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.440+0000 7f261941b740 1 -- 172.21.15.42:0/3033741354 >> 172.21.15.42:0/3033741354 conn(0x560cb5e2d3c0 msgr2=0x560cb6226820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:04.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.440+0000 7f261941b740 1 -- 172.21.15.42:0/3033741354 shutdown_connections 2024-09-17T01:43:04.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.440+0000 7f261941b740 1 -- 172.21.15.42:0/3033741354 wait complete. 2024-09-17T01:43:04.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.441+0000 7f261941b740 1 -- start start 2024-09-17T01:43:04.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.441+0000 7f261941b740 1 Processor -- start 2024-09-17T01:43:04.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.443+0000 7f261941b740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560cb5e103b0 0x560cb6200020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:04.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.443+0000 7f261941b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560cb5e18590 0x560cb62a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:04.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.443+0000 7f261941b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e39270 0x560cb62a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:04.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.443+0000 7f261941b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560cb6205500 con 0x560cb5e39270 2024-09-17T01:43:04.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.443+0000 7f261941b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560cb621f300 con 0x560cb5e18590 2024-09-17T01:43:04.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.443+0000 7f261941b740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x560cb6203800 con 0x560cb5e103b0 2024-09-17T01:43:04.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.443+0000 7f261941b740 10 client.0 _ll_register_callbacks cb 0x7f260400e670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:43:04.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.443+0000 7f260be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e39270 0x560cb62a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:04.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.443+0000 7f260be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e39270 0x560cb62a1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59766/0 (socket says 172.21.15.42:59766) 2024-09-17T01:43:04.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.443+0000 7f260be00640 1 -- 172.21.15.42:0/4249334111 learned_addr learned my addr 172.21.15.42:0/4249334111 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:04.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.444+0000 7f2602a00640 1 --2- 172.21.15.42:0/4249334111 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560cb5e18590 0x560cb62a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:04.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.444+0000 7f260b400640 1 --2- 172.21.15.42:0/4249334111 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560cb5e103b0 0x560cb6200020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:04.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.444+0000 7f260be00640 1 -- 172.21.15.42:0/4249334111 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560cb5e103b0 msgr2=0x560cb6200020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:04.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.444+0000 7f260be00640 1 --2- 172.21.15.42:0/4249334111 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560cb5e103b0 0x560cb6200020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.444+0000 7f260be00640 1 -- 172.21.15.42:0/4249334111 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560cb5e18590 msgr2=0x560cb62a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:04.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.444+0000 7f260be00640 1 --2- 172.21.15.42:0/4249334111 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560cb5e18590 0x560cb62a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.444+0000 7f260be00640 1 -- 172.21.15.42:0/4249334111 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cb61d54b0 con 0x560cb5e39270 2024-09-17T01:43:04.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.444+0000 7f260b400640 1 --2- 172.21.15.42:0/4249334111 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560cb5e103b0 0x560cb6200020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:43:04.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.444+0000 7f2602a00640 1 --2- 172.21.15.42:0/4249334111 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560cb5e18590 0x560cb62a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:43:04.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.444+0000 7f260be00640 1 --2- 172.21.15.42:0/4249334111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e39270 0x560cb62a1e20 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f260400e410 tx=0x7f2604007aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7641a0b3c51bd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:04.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.444+0000 7f25f8c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:43:04.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.444+0000 7f25f8c00640 1 -- 172.21.15.42:0/4249334111 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260402f670 con 0x560cb5e39270 2024-09-17T01:43:04.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.444+0000 7f25f8c00640 1 -- 172.21.15.42:0/4249334111 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f2604003e70 con 0x560cb5e39270 2024-09-17T01:43:04.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.444+0000 7f261941b740 1 -- 172.21.15.42:0/4249334111 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560cb61df1a0 con 0x560cb5e39270 2024-09-17T01:43:04.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.445+0000 7f25f8c00640 1 -- 172.21.15.42:0/4249334111 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) ==== 24+0+0 (secure 0 0 0) 0x7f260400c730 con 0x560cb5e39270 2024-09-17T01:43:04.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.445+0000 7f261941b740 10 client.9114 fetch_fsmap learned FSMap version 116 2024-09-17T01:43:04.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.445+0000 7f261941b740 1 -- 172.21.15.42:0/4249334111 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) -- 0x560cb61dfcf0 con 0x560cb5e39270 2024-09-17T01:43:04.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.445+0000 7f25f8c00640 1 -- 172.21.15.42:0/4249334111 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560cb61df1a0 con 0x560cb5e39270 2024-09-17T01:43:04.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.445+0000 7f25f8c00640 1 -- 172.21.15.42:0/4249334111 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 116) ==== 3502+0+0 (secure 0 0 0) 0x7f260402f810 con 0x560cb5e39270 2024-09-17T01:43:04.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.445+0000 7f261941b740 10 client.9114 fetch_fsmap finished waiting for FSMap version 116 2024-09-17T01:43:04.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.445+0000 7f261941b740 10 client.9114 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:43:04.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.445+0000 7f261941b740 20 client.9114 populate_metadata read hostname 'smithi042' 2024-09-17T01:43:04.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.445+0000 7f261941b740 1 --2- 172.21.15.42:0/4249334111 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x560cb62a87d0 0x560cb62235c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:04.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.445+0000 7f261941b740 4 client.9114 mds_command: new command op to 8982 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T01:43:04.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.445+0000 7f261941b740 1 -- 172.21.15.42:0/4249334111 --> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] -- command(tid 0: {"prefix": "status"}) -- 0x560cb61ffc60 con 0x560cb62a87d0 2024-09-17T01:43:04.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.445+0000 7f260b400640 1 --2- 172.21.15.42:0/4249334111 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x560cb62a87d0 0x560cb62235c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:04.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.446+0000 7f260b400640 1 --2- 172.21.15.42:0/4249334111 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x560cb62a87d0 0x560cb62235c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8c0a7b97d88396a server_cookie=2c17204494345a2 in_seq=0 out_seq=0 2024-09-17T01:43:04.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.446+0000 7f25f8c00640 10 client.9114 ms_handle_connect on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:04.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.446+0000 7f25f8c00640 1 -- 172.21.15.42:0/4249334111 <== mds.0 v2:172.21.15.42:6832/3811049376 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x560cb61ffc60 con 0x560cb62a87d0 2024-09-17T01:43:04.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.446+0000 7f25f8c00640 10 client.9114 handle_command_reply: tid=0 2024-09-17T01:43:04.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.446+0000 7f261941b740 1 client.9114 shutdown 2024-09-17T01:43:04.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.446+0000 7f261941b740 1 -- 172.21.15.42:0/4249334111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e39270 msgr2=0x560cb62a1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:04.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.446+0000 7f261941b740 1 --2- 172.21.15.42:0/4249334111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e39270 0x560cb62a1e20 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f260400e410 tx=0x7f2604007aa0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.446+0000 7f261941b740 1 -- 172.21.15.42:0/4249334111 shutdown_connections 2024-09-17T01:43:04.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.446+0000 7f261941b740 1 --2- 172.21.15.42:0/4249334111 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x560cb62a87d0 0x560cb62235c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.446+0000 7f261941b740 1 --2- 172.21.15.42:0/4249334111 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560cb5e18590 0x560cb62a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.446+0000 7f261941b740 1 --2- 172.21.15.42:0/4249334111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560cb5e39270 0x560cb62a1e20 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.446+0000 7f261941b740 1 --2- 172.21.15.42:0/4249334111 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560cb5e103b0 0x560cb6200020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.446+0000 7f25f8c00640 0 client.9114 ms_handle_reset on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:04.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.446+0000 7f261941b740 1 -- 172.21.15.42:0/4249334111 >> 172.21.15.42:0/4249334111 conn(0x560cb5e2d3c0 msgr2=0x560cb6226820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:04.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.447+0000 7f261941b740 1 -- 172.21.15.42:0/4249334111 shutdown_connections 2024-09-17T01:43:04.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.447+0000 7f261941b740 1 -- 172.21.15.42:0/4249334111 wait complete. 2024-09-17T01:43:04.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.447+0000 7f261941b740 20 client.9114 trim_cache size 0 max 16384 2024-09-17T01:43:04.449 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:43:04.449 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "fea1c88c-cb05-432f-a745-f9dcbb5f2503", 2024-09-17T01:43:04.449 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-17T01:43:04.449 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 8982, 2024-09-17T01:43:04.449 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-17T01:43:04.449 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-17T01:43:04.449 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-17T01:43:04.450 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 6.7751405240000002, 2024-09-17T01:43:04.450 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 116, 2024-09-17T01:43:04.450 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 147, 2024-09-17T01:43:04.450 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 147, 2024-09-17T01:43:04.450 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 11.680771175 2024-09-17T01:43:04.450 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:43:04.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.447+0000 7f2610e00640 1 -- 172.21.15.42:0/2578931755 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f25e8078bf0 msgr2=0x7f25e807b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:04.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.447+0000 7f2610e00640 1 --2- 172.21.15.42:0/2578931755 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f25e8078bf0 0x7f25e807b100 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f25f4005fd0 tx=0x7f25f4005850 comp rx=0 tx=0).stop 2024-09-17T01:43:04.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.447+0000 7f2610e00640 1 -- 172.21.15.42:0/2578931755 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f260c0b78f0 msgr2=0x7f260c14eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:04.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.447+0000 7f2610e00640 1 --2- 172.21.15.42:0/2578931755 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f260c0b78f0 0x7f260c14eec0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f25fc034040 tx=0x7f25fc0038a0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.447+0000 7f2610e00640 1 -- 172.21.15.42:0/2578931755 shutdown_connections 2024-09-17T01:43:04.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.447+0000 7f2610e00640 1 --2- 172.21.15.42:0/2578931755 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f25e8078bf0 0x7f25e807b100 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.447+0000 7f2610e00640 1 --2- 172.21.15.42:0/2578931755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f260c0cebc0 0x7f260c1f5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.447+0000 7f2610e00640 1 --2- 172.21.15.42:0/2578931755 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f260c0d0830 0x7f260c1f61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.447+0000 7f2610e00640 1 --2- 172.21.15.42:0/2578931755 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f260c0b78f0 0x7f260c14eec0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.447+0000 7f2610e00640 1 -- 172.21.15.42:0/2578931755 >> 172.21.15.42:0/2578931755 conn(0x7f260c0b3ed0 msgr2=0x7f260c0d13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:04.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.448+0000 7f2610e00640 1 -- 172.21.15.42:0/2578931755 shutdown_connections 2024-09-17T01:43:04.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.448+0000 7f2610e00640 1 -- 172.21.15.42:0/2578931755 wait complete. 2024-09-17T01:43:04.467 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T01:43:04.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.697+0000 7fcf71000640 1 -- 172.21.15.42:0/3846363158 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcf6c142f40 msgr2=0x7fcf6c072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:04.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.697+0000 7fcf71000640 1 --2- 172.21.15.42:0/3846363158 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcf6c142f40 0x7fcf6c072950 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcf58005fd0 tx=0x7fcf5802a540 comp rx=0 tx=0).stop 2024-09-17T01:43:04.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.697+0000 7fcf71000640 1 -- 172.21.15.42:0/3846363158 shutdown_connections 2024-09-17T01:43:04.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.697+0000 7fcf71000640 1 --2- 172.21.15.42:0/3846363158 >> v2:172.21.15.43:3300/0 conn(0x7fcf6c072e90 0x7fcf6c0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.697+0000 7fcf71000640 1 --2- 172.21.15.42:0/3846363158 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcf6c142f40 0x7fcf6c072950 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.697+0000 7fcf71000640 1 -- 172.21.15.42:0/3846363158 >> 172.21.15.42:0/3846363158 conn(0x7fcf6c0b2930 msgr2=0x7fcf6c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:04.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.697+0000 7fcf71000640 1 -- 172.21.15.42:0/3846363158 shutdown_connections 2024-09-17T01:43:04.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.697+0000 7fcf71000640 1 -- 172.21.15.42:0/3846363158 wait complete. 2024-09-17T01:43:04.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.699+0000 7fcf71000640 1 Processor -- start 2024-09-17T01:43:04.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.699+0000 7fcf71000640 1 -- start start 2024-09-17T01:43:04.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.701+0000 7fcf71000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf6c072e90 0x7fcf6c157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:04.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.701+0000 7fcf71000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcf6c0b3550 0x7fcf6c1f7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:04.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.701+0000 7fcf71000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf6c142f40 0x7fcf6c13e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:04.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.701+0000 7fcf71000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6c06d7c0 con 0x7fcf6c072e90 2024-09-17T01:43:04.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.701+0000 7fcf71000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6c06d640 con 0x7fcf6c142f40 2024-09-17T01:43:04.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.701+0000 7fcf71000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fcf6c06d940 con 0x7fcf6c0b3550 2024-09-17T01:43:04.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.701+0000 7fcf69e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf6c072e90 0x7fcf6c157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:04.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.701+0000 7fcf69e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf6c072e90 0x7fcf6c157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59782/0 (socket says 172.21.15.42:59782) 2024-09-17T01:43:04.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.701+0000 7fcf69e00640 1 -- 172.21.15.42:0/3822732185 learned_addr learned my addr 172.21.15.42:0/3822732185 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:04.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.701+0000 7fcf6a800640 1 --2- 172.21.15.42:0/3822732185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf6c142f40 0x7fcf6c13e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:04.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.701+0000 7fcf69400640 1 --2- 172.21.15.42:0/3822732185 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcf6c0b3550 0x7fcf6c1f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:04.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.701+0000 7fcf69e00640 1 -- 172.21.15.42:0/3822732185 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcf6c0b3550 msgr2=0x7fcf6c1f7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:04.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.702+0000 7fcf69e00640 1 --2- 172.21.15.42:0/3822732185 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcf6c0b3550 0x7fcf6c1f7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.702+0000 7fcf69e00640 1 -- 172.21.15.42:0/3822732185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf6c142f40 msgr2=0x7fcf6c13e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:04.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.702+0000 7fcf69e00640 1 --2- 172.21.15.42:0/3822732185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf6c142f40 0x7fcf6c13e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.702+0000 7fcf69e00640 1 -- 172.21.15.42:0/3822732185 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf6c1586e0 con 0x7fcf6c072e90 2024-09-17T01:43:04.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.702+0000 7fcf69e00640 1 --2- 172.21.15.42:0/3822732185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf6c072e90 0x7fcf6c157e20 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00c340 tx=0x7fcf5c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:04.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.702+0000 7fcf62000640 1 -- 172.21.15.42:0/3822732185 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c017070 con 0x7fcf6c072e90 2024-09-17T01:43:04.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.702+0000 7fcf62000640 1 -- 172.21.15.42:0/3822732185 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf5c0053c0 con 0x7fcf6c072e90 2024-09-17T01:43:04.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.702+0000 7fcf62000640 1 -- 172.21.15.42:0/3822732185 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c003850 con 0x7fcf6c072e90 2024-09-17T01:43:04.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.702+0000 7fcf71000640 1 -- 172.21.15.42:0/3822732185 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf6c1589c0 con 0x7fcf6c072e90 2024-09-17T01:43:04.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.702+0000 7fcf71000640 1 -- 172.21.15.42:0/3822732185 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf6c1f5490 con 0x7fcf6c072e90 2024-09-17T01:43:04.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.703+0000 7fcf71000640 1 -- 172.21.15.42:0/3822732185 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf6c1f56f0 con 0x7fcf6c072e90 2024-09-17T01:43:04.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.705+0000 7fcf62000640 1 -- 172.21.15.42:0/3822732185 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcf5c01a070 con 0x7fcf6c072e90 2024-09-17T01:43:04.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.706+0000 7fcf62000640 1 --2- 172.21.15.42:0/3822732185 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcf4c078b90 0x7fcf4c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:04.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.706+0000 7fcf62000640 1 -- 172.21.15.42:0/3822732185 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fcf5c09a060 con 0x7fcf6c072e90 2024-09-17T01:43:04.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.706+0000 7fcf69400640 1 --2- 172.21.15.42:0/3822732185 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcf4c078b90 0x7fcf4c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:04.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.707+0000 7fcf69400640 1 --2- 172.21.15.42:0/3822732185 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcf4c078b90 0x7fcf4c07b0a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fcf58033000 tx=0x7fcf58004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:04.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.710+0000 7fcf62000640 1 -- 172.21.15.42:0/3822732185 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcf5c061e50 con 0x7fcf6c072e90 2024-09-17T01:43:04.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.946+0000 7fcf71000640 1 -- 172.21.15.42:0/3822732185 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcf6c1f6f60 con 0x7fcf6c072e90 2024-09-17T01:43:04.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.947+0000 7fcf62000640 1 -- 172.21.15.42:0/3822732185 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v116) ==== 53+0+73 (secure 0 0 0) 0x7fcf5c066880 con 0x7fcf6c072e90 2024-09-17T01:43:04.945 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T01:43:04.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.949+0000 7fcf71000640 1 -- 172.21.15.42:0/3822732185 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcf4c078b90 msgr2=0x7fcf4c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:04.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.949+0000 7fcf71000640 1 --2- 172.21.15.42:0/3822732185 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcf4c078b90 0x7fcf4c07b0a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fcf58033000 tx=0x7fcf58004730 comp rx=0 tx=0).stop 2024-09-17T01:43:04.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.949+0000 7fcf71000640 1 -- 172.21.15.42:0/3822732185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf6c072e90 msgr2=0x7fcf6c157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:04.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.949+0000 7fcf71000640 1 --2- 172.21.15.42:0/3822732185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf6c072e90 0x7fcf6c157e20 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00c340 tx=0x7fcf5c00c800 comp rx=0 tx=0).stop 2024-09-17T01:43:04.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.950+0000 7fcf71000640 1 -- 172.21.15.42:0/3822732185 shutdown_connections 2024-09-17T01:43:04.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.950+0000 7fcf71000640 1 --2- 172.21.15.42:0/3822732185 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcf4c078b90 0x7fcf4c07b0a0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.950+0000 7fcf71000640 1 --2- 172.21.15.42:0/3822732185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf6c142f40 0x7fcf6c13e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.950+0000 7fcf71000640 1 --2- 172.21.15.42:0/3822732185 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcf6c0b3550 0x7fcf6c1f7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.950+0000 7fcf71000640 1 --2- 172.21.15.42:0/3822732185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf6c072e90 0x7fcf6c157e20 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:04.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.950+0000 7fcf71000640 1 -- 172.21.15.42:0/3822732185 >> 172.21.15.42:0/3822732185 conn(0x7fcf6c0b2930 msgr2=0x7fcf6c15f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:04.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.950+0000 7fcf71000640 1 -- 172.21.15.42:0/3822732185 shutdown_connections 2024-09-17T01:43:04.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:04.950+0000 7fcf71000640 1 -- 172.21.15.42:0/3822732185 wait complete. 2024-09-17T01:43:04.974 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T01:43:04.974 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:43:04.974 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-09-17T01:43:04.974 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T01:43:04.974 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:43:04.974 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T01:43:04.974 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T01:43:04.974 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:43:04.974 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:43:04.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:43:04.975 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-09-17T01:43:05.011 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:43:05.011 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:43:05.012 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:43:05.012 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:43:05.012 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-17T01:43:05.012 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:43:05.012 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:43:05.012 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-09-17T01:43:05.012 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-09-17T01:43:05.012 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:43:05.012 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-09-17T01:43:05.013 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-09-17T01:43:05.013 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:43:05.013 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:43:05.013 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-09-17T01:43:05.013 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-17T01:43:05.013 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42023sec preferred_lft 42023sec 2024-09-17T01:43:05.014 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-17T01:43:05.014 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:43:05.014 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:43:05.014 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:43:05.014 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-09-17T01:43:05.014 INFO:teuthology.orchestra.run.smithi042.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T01:43:05.014 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T01:43:05.014 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T01:43:05.014 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:43:05.014 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::68d2:2bff:fe2f:191a/64 scope link 2024-09-17T01:43:05.014 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:43:05.014 INFO:teuthology.orchestra.run.smithi042.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:43:05.014 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether e2:73:3e:9b:8a:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:43:05.015 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::e073:3eff:fe9b:8a00/64 scope link 2024-09-17T01:43:05.015 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:43:05.015 INFO:teuthology.orchestra.run.smithi042.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:43:05.015 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T01:43:05.015 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::240b:bfff:feb7:6e5b/64 scope link 2024-09-17T01:43:05.015 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:43:05.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:43:05.015 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:43:05.105 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-17T01:43:05.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:43:05.109 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-09-17T01:43:05.145 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-09-17T01:43:05.145 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:43:05.145 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-17T01:43:05.145 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-17T01:43:05.145 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:43:05.145 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:43:05.146 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:05.146 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T01:43:05.146 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T01:43:05.146 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T01:43:05.146 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:05.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:43:05.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:05.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:43:05.344 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-17T01:43:05.379 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T01:43:05.379 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T01:43:05.380 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:43:05.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:43:05.380 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-09-17T01:43:05.477 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:43:05.477 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T01:43:05.513 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:43:05.513 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:43:05.513 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:43:05.587 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T01:43:05.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:43:05.588 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:43:05.789 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:43:05.789 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:43:05.789 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:43:05.810 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:43:05.810 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:43:05.810 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:43:05.810 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:43:05.810 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:43:05.840 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:43:05.840 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:43:05.840 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:43:05.840 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:43:05.840 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:43:05.840 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-09-17T01:43:05.840 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-09-17T01:43:05.840 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fea1c88c-cb05-432f-a745-f9dcbb5f2503" will pass to kernel 2024-09-17T01:43:05.841 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T01:43:05.841 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-09-17T01:43:05.842 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T01:43:05.842 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T01:43:05.842 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T01:43:05.844 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T01:43:05.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:43:05.845 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:43:05.901 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:43:05.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:05.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:05.997 INFO:teuthology.orchestra.run.smithi042.stdout:client9120 2024-09-17T01:43:05.998 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:43:05.998 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:43:06.033 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:06.034 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:06.034 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.0 2024-09-17T01:43:06.034 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:06.034 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:06.034 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:06.034 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:06.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:06.196 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.196 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.196 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273456 s, 38.3 MB/s 2024-09-17T01:43:06.226 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.226 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.226 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239441 s, 43.8 MB/s 2024-09-17T01:43:06.243 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.243 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.243 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167445 s, 62.6 MB/s 2024-09-17T01:43:06.260 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.260 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.260 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141039 s, 74.3 MB/s 2024-09-17T01:43:06.281 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.281 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.281 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176165 s, 59.5 MB/s 2024-09-17T01:43:06.304 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.304 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.304 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196368 s, 53.4 MB/s 2024-09-17T01:43:06.326 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.326 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.326 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188532 s, 55.6 MB/s 2024-09-17T01:43:06.352 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.352 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.352 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022942 s, 45.7 MB/s 2024-09-17T01:43:06.369 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.369 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.369 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137257 s, 76.4 MB/s 2024-09-17T01:43:06.392 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.392 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.392 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199759 s, 52.5 MB/s 2024-09-17T01:43:06.414 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.414 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.414 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188977 s, 55.5 MB/s 2024-09-17T01:43:06.435 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.435 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.435 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017763 s, 59.0 MB/s 2024-09-17T01:43:06.457 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.457 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.457 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189354 s, 55.4 MB/s 2024-09-17T01:43:06.480 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.480 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.480 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201156 s, 52.1 MB/s 2024-09-17T01:43:06.498 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.498 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.499 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149606 s, 70.1 MB/s 2024-09-17T01:43:06.522 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.522 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.522 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203513 s, 51.5 MB/s 2024-09-17T01:43:06.545 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.545 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.546 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201034 s, 52.2 MB/s 2024-09-17T01:43:06.562 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.562 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.562 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013555 s, 77.4 MB/s 2024-09-17T01:43:06.587 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.587 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.587 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216427 s, 48.4 MB/s 2024-09-17T01:43:06.605 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.605 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.605 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149011 s, 70.4 MB/s 2024-09-17T01:43:06.627 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.627 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.627 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01911 s, 54.9 MB/s 2024-09-17T01:43:06.643 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.644 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.644 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01335 s, 78.5 MB/s 2024-09-17T01:43:06.660 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.660 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.661 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138739 s, 75.6 MB/s 2024-09-17T01:43:06.681 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.681 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.681 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170072 s, 61.7 MB/s 2024-09-17T01:43:06.696 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.697 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.697 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130961 s, 80.1 MB/s 2024-09-17T01:43:06.716 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.716 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.716 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162791 s, 64.4 MB/s 2024-09-17T01:43:06.735 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.735 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.735 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158497 s, 66.2 MB/s 2024-09-17T01:43:06.755 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.755 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.755 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167481 s, 62.6 MB/s 2024-09-17T01:43:06.775 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.775 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.775 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164503 s, 63.7 MB/s 2024-09-17T01:43:06.796 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.797 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.797 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188796 s, 55.5 MB/s 2024-09-17T01:43:06.818 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.818 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.818 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184525 s, 56.8 MB/s 2024-09-17T01:43:06.837 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.837 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.837 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149671 s, 70.1 MB/s 2024-09-17T01:43:06.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:06.846 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:06.846 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:06.847 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.1 2024-09-17T01:43:06.847 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:06.847 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:06.847 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:06.847 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:06.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:06.946 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.946 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.946 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129552 s, 80.9 MB/s 2024-09-17T01:43:06.968 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.968 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.968 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184748 s, 56.8 MB/s 2024-09-17T01:43:06.992 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:06.992 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:06.993 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215104 s, 48.7 MB/s 2024-09-17T01:43:07.015 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.015 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.016 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196281 s, 53.4 MB/s 2024-09-17T01:43:07.030 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.030 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.030 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119247 s, 87.9 MB/s 2024-09-17T01:43:07.050 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.050 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.050 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169652 s, 61.8 MB/s 2024-09-17T01:43:07.073 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.073 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.073 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192213 s, 54.6 MB/s 2024-09-17T01:43:07.091 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.091 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.091 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150366 s, 69.7 MB/s 2024-09-17T01:43:07.109 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.109 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.109 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148542 s, 70.6 MB/s 2024-09-17T01:43:07.126 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.126 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.126 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144632 s, 72.5 MB/s 2024-09-17T01:43:07.145 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.145 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.145 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158905 s, 66.0 MB/s 2024-09-17T01:43:07.160 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.161 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.161 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123085 s, 85.2 MB/s 2024-09-17T01:43:07.178 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.178 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.179 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146318 s, 71.7 MB/s 2024-09-17T01:43:07.196 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.196 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.196 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145585 s, 72.0 MB/s 2024-09-17T01:43:07.214 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.214 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.214 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142252 s, 73.7 MB/s 2024-09-17T01:43:07.231 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.232 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.232 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148507 s, 70.6 MB/s 2024-09-17T01:43:07.248 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.248 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.248 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138353 s, 75.8 MB/s 2024-09-17T01:43:07.265 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.265 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.266 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142611 s, 73.5 MB/s 2024-09-17T01:43:07.282 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.283 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.283 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140646 s, 74.6 MB/s 2024-09-17T01:43:07.299 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.299 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.300 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137389 s, 76.3 MB/s 2024-09-17T01:43:07.318 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.318 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.318 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149978 s, 69.9 MB/s 2024-09-17T01:43:07.340 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.340 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.340 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187016 s, 56.1 MB/s 2024-09-17T01:43:07.357 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.357 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.357 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013755 s, 76.2 MB/s 2024-09-17T01:43:07.377 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.377 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.377 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173379 s, 60.5 MB/s 2024-09-17T01:43:07.394 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.394 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.394 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138063 s, 75.9 MB/s 2024-09-17T01:43:07.409 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.409 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.409 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120215 s, 87.2 MB/s 2024-09-17T01:43:07.425 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.425 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.425 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125043 s, 83.9 MB/s 2024-09-17T01:43:07.445 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.445 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.445 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165632 s, 63.3 MB/s 2024-09-17T01:43:07.462 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.463 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.463 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149049 s, 70.4 MB/s 2024-09-17T01:43:07.478 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.478 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.478 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122984 s, 85.3 MB/s 2024-09-17T01:43:07.497 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.498 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.498 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164483 s, 63.7 MB/s 2024-09-17T01:43:07.514 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.515 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.515 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138609 s, 75.6 MB/s 2024-09-17T01:43:07.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:07.524 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:07.524 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:07.524 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.2 2024-09-17T01:43:07.524 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:07.525 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:07.525 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:07.525 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:07.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:07.626 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.626 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.627 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146322 s, 71.7 MB/s 2024-09-17T01:43:07.644 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.644 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.644 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148687 s, 70.5 MB/s 2024-09-17T01:43:07.660 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.660 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.660 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134787 s, 77.8 MB/s 2024-09-17T01:43:07.684 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.684 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.684 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203649 s, 51.5 MB/s 2024-09-17T01:43:07.705 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.705 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.705 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176424 s, 59.4 MB/s 2024-09-17T01:43:07.728 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.728 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.728 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197548 s, 53.1 MB/s 2024-09-17T01:43:07.746 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.746 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.746 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015328 s, 68.4 MB/s 2024-09-17T01:43:07.764 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.764 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.765 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144425 s, 72.6 MB/s 2024-09-17T01:43:07.782 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.783 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.783 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153119 s, 68.5 MB/s 2024-09-17T01:43:07.802 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.802 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.802 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159008 s, 65.9 MB/s 2024-09-17T01:43:07.825 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.826 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.826 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204802 s, 51.2 MB/s 2024-09-17T01:43:07.847 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.847 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.847 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177566 s, 59.1 MB/s 2024-09-17T01:43:07.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.866 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160578 s, 65.3 MB/s 2024-09-17T01:43:07.883 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.883 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.883 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144327 s, 72.7 MB/s 2024-09-17T01:43:07.905 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.905 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.905 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190741 s, 55.0 MB/s 2024-09-17T01:43:07.923 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.923 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.923 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147094 s, 71.3 MB/s 2024-09-17T01:43:07.944 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.945 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.945 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177734 s, 59.0 MB/s 2024-09-17T01:43:07.961 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.962 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.962 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013706 s, 76.5 MB/s 2024-09-17T01:43:07.983 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:07.983 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:07.983 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182565 s, 57.4 MB/s 2024-09-17T01:43:08.000 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.000 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.000 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136478 s, 76.8 MB/s 2024-09-17T01:43:08.017 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.017 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.018 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144302 s, 72.7 MB/s 2024-09-17T01:43:08.038 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.038 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.038 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176585 s, 59.4 MB/s 2024-09-17T01:43:08.059 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.059 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.059 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174448 s, 60.1 MB/s 2024-09-17T01:43:08.080 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.080 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.080 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174702 s, 60.0 MB/s 2024-09-17T01:43:08.102 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.103 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.103 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199531 s, 52.6 MB/s 2024-09-17T01:43:08.121 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.121 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.121 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154707 s, 67.8 MB/s 2024-09-17T01:43:08.139 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.139 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.139 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142153 s, 73.8 MB/s 2024-09-17T01:43:08.156 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.156 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.156 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136935 s, 76.6 MB/s 2024-09-17T01:43:08.180 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.180 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.180 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211736 s, 49.5 MB/s 2024-09-17T01:43:08.196 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.197 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.197 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135037 s, 77.7 MB/s 2024-09-17T01:43:08.215 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.215 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.215 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146321 s, 71.7 MB/s 2024-09-17T01:43:08.231 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.231 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.231 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136103 s, 77.0 MB/s 2024-09-17T01:43:08.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:08.241 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:08.241 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:08.241 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.3 2024-09-17T01:43:08.241 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:08.241 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:08.241 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:08.241 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:08.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:08.341 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.341 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.341 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142103 s, 73.8 MB/s 2024-09-17T01:43:08.361 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.361 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.361 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167178 s, 62.7 MB/s 2024-09-17T01:43:08.378 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.378 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.378 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146077 s, 71.8 MB/s 2024-09-17T01:43:08.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.396 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146379 s, 71.6 MB/s 2024-09-17T01:43:08.412 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.412 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.412 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123257 s, 85.1 MB/s 2024-09-17T01:43:08.429 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.429 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.429 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139807 s, 75.0 MB/s 2024-09-17T01:43:08.447 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.447 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.447 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015141 s, 69.3 MB/s 2024-09-17T01:43:08.465 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.465 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.465 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146572 s, 71.5 MB/s 2024-09-17T01:43:08.482 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.482 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.482 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143022 s, 73.3 MB/s 2024-09-17T01:43:08.499 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.499 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.499 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141574 s, 74.1 MB/s 2024-09-17T01:43:08.516 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.516 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.516 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136131 s, 77.0 MB/s 2024-09-17T01:43:08.533 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.533 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.533 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135638 s, 77.3 MB/s 2024-09-17T01:43:08.552 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.552 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.552 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156414 s, 67.0 MB/s 2024-09-17T01:43:08.570 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.570 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.570 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151883 s, 69.0 MB/s 2024-09-17T01:43:08.588 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.588 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.588 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014954 s, 70.1 MB/s 2024-09-17T01:43:08.612 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.612 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.612 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196323 s, 53.4 MB/s 2024-09-17T01:43:08.630 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.630 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.630 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015793 s, 66.4 MB/s 2024-09-17T01:43:08.647 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.647 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.648 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143064 s, 73.3 MB/s 2024-09-17T01:43:08.665 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.666 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.666 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146327 s, 71.7 MB/s 2024-09-17T01:43:08.683 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.683 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.683 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145809 s, 71.9 MB/s 2024-09-17T01:43:08.699 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.699 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.699 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130529 s, 80.3 MB/s 2024-09-17T01:43:08.720 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.720 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.720 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173249 s, 60.5 MB/s 2024-09-17T01:43:08.737 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.737 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.737 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143526 s, 73.1 MB/s 2024-09-17T01:43:08.757 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.758 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.758 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171408 s, 61.2 MB/s 2024-09-17T01:43:08.772 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.772 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.772 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115099 s, 91.1 MB/s 2024-09-17T01:43:08.790 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.790 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.790 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015075 s, 69.6 MB/s 2024-09-17T01:43:08.808 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.808 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.808 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01459 s, 71.9 MB/s 2024-09-17T01:43:08.826 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.827 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.827 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154506 s, 67.9 MB/s 2024-09-17T01:43:08.846 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.846 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.846 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159806 s, 65.6 MB/s 2024-09-17T01:43:08.863 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.863 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.863 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140719 s, 74.5 MB/s 2024-09-17T01:43:08.884 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.884 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.884 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154457 s, 67.9 MB/s 2024-09-17T01:43:08.900 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:08.900 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:08.900 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149254 s, 70.3 MB/s 2024-09-17T01:43:08.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:08.909 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:08.909 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:08.909 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.4 2024-09-17T01:43:08.909 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:08.909 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:08.909 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:08.909 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:08.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:09.010 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.010 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.010 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148344 s, 70.7 MB/s 2024-09-17T01:43:09.031 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.031 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.031 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177605 s, 59.0 MB/s 2024-09-17T01:43:09.053 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.054 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.054 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193701 s, 54.1 MB/s 2024-09-17T01:43:09.075 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.075 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.076 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191019 s, 54.9 MB/s 2024-09-17T01:43:09.092 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.092 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.092 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128455 s, 81.6 MB/s 2024-09-17T01:43:09.109 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.110 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.110 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149128 s, 70.3 MB/s 2024-09-17T01:43:09.127 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.127 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.127 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137817 s, 76.1 MB/s 2024-09-17T01:43:09.146 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.146 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.146 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158823 s, 66.0 MB/s 2024-09-17T01:43:09.164 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.164 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.164 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147951 s, 70.9 MB/s 2024-09-17T01:43:09.183 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.183 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.183 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156828 s, 66.9 MB/s 2024-09-17T01:43:09.205 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.205 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.205 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019201 s, 54.6 MB/s 2024-09-17T01:43:09.223 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.223 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.223 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146922 s, 71.4 MB/s 2024-09-17T01:43:09.244 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.245 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.245 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185194 s, 56.6 MB/s 2024-09-17T01:43:09.262 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.262 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.262 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143148 s, 73.3 MB/s 2024-09-17T01:43:09.280 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.280 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.281 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150313 s, 69.8 MB/s 2024-09-17T01:43:09.298 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.298 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.298 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143198 s, 73.2 MB/s 2024-09-17T01:43:09.319 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.319 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.319 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182129 s, 57.6 MB/s 2024-09-17T01:43:09.337 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.337 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.337 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141889 s, 73.9 MB/s 2024-09-17T01:43:09.353 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.354 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.354 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140583 s, 74.6 MB/s 2024-09-17T01:43:09.369 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.370 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.370 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125836 s, 83.3 MB/s 2024-09-17T01:43:09.387 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.387 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.387 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140239 s, 74.8 MB/s 2024-09-17T01:43:09.409 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.409 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.409 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190623 s, 55.0 MB/s 2024-09-17T01:43:09.426 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.426 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.426 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140429 s, 74.7 MB/s 2024-09-17T01:43:09.441 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.442 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.442 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121845 s, 86.1 MB/s 2024-09-17T01:43:09.459 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.459 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.460 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146981 s, 71.3 MB/s 2024-09-17T01:43:09.478 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.478 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.478 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157812 s, 66.4 MB/s 2024-09-17T01:43:09.499 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.500 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.500 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178948 s, 58.6 MB/s 2024-09-17T01:43:09.515 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.515 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.516 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129671 s, 80.9 MB/s 2024-09-17T01:43:09.531 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.531 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.531 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119956 s, 87.4 MB/s 2024-09-17T01:43:09.550 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.551 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.551 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163145 s, 64.3 MB/s 2024-09-17T01:43:09.569 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.569 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.569 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152908 s, 68.6 MB/s 2024-09-17T01:43:09.591 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.591 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.591 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188947 s, 55.5 MB/s 2024-09-17T01:43:09.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:09.601 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:09.601 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:09.601 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.5 2024-09-17T01:43:09.602 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:09.602 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:09.602 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:09.602 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:09.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:09.704 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.704 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.704 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151665 s, 69.1 MB/s 2024-09-17T01:43:09.722 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.723 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.723 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151958 s, 69.0 MB/s 2024-09-17T01:43:09.740 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.740 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.740 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134639 s, 77.9 MB/s 2024-09-17T01:43:09.759 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.759 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.760 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165374 s, 63.4 MB/s 2024-09-17T01:43:09.776 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.777 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.777 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138425 s, 75.8 MB/s 2024-09-17T01:43:09.794 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.795 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.795 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149815 s, 70.0 MB/s 2024-09-17T01:43:09.813 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.813 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.813 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151817 s, 69.1 MB/s 2024-09-17T01:43:09.828 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.828 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.828 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012277 s, 85.4 MB/s 2024-09-17T01:43:09.845 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.845 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.845 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141605 s, 74.0 MB/s 2024-09-17T01:43:09.862 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.863 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.863 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140518 s, 74.6 MB/s 2024-09-17T01:43:09.880 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.880 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.880 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142316 s, 73.7 MB/s 2024-09-17T01:43:09.903 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.903 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.903 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198282 s, 52.9 MB/s 2024-09-17T01:43:09.920 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.920 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.920 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138581 s, 75.7 MB/s 2024-09-17T01:43:09.938 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.938 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.939 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143365 s, 73.1 MB/s 2024-09-17T01:43:09.957 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.957 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.957 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157681 s, 66.5 MB/s 2024-09-17T01:43:09.977 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.977 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.978 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01715 s, 61.1 MB/s 2024-09-17T01:43:09.994 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:09.995 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:09.995 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146306 s, 71.7 MB/s 2024-09-17T01:43:10.012 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.012 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.012 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141779 s, 74.0 MB/s 2024-09-17T01:43:10.027 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.028 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.028 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124905 s, 83.9 MB/s 2024-09-17T01:43:10.045 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.045 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.045 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146093 s, 71.8 MB/s 2024-09-17T01:43:10.063 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.063 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.063 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142176 s, 73.8 MB/s 2024-09-17T01:43:10.078 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.078 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.078 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118029 s, 88.8 MB/s 2024-09-17T01:43:10.093 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.093 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.093 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115184 s, 91.0 MB/s 2024-09-17T01:43:10.110 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.110 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.110 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148892 s, 70.4 MB/s 2024-09-17T01:43:10.129 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.129 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.129 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155559 s, 67.4 MB/s 2024-09-17T01:43:10.150 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.150 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.150 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177776 s, 59.0 MB/s 2024-09-17T01:43:10.168 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.168 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.168 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145143 s, 72.2 MB/s 2024-09-17T01:43:10.186 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.186 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.186 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149173 s, 70.3 MB/s 2024-09-17T01:43:10.202 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.202 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.202 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131927 s, 79.5 MB/s 2024-09-17T01:43:10.219 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.219 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.219 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136879 s, 76.6 MB/s 2024-09-17T01:43:10.237 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.237 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.237 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014772 s, 71.0 MB/s 2024-09-17T01:43:10.255 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.255 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.255 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142443 s, 73.6 MB/s 2024-09-17T01:43:10.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:10.264 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:10.264 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:10.264 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.6 2024-09-17T01:43:10.264 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:10.264 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:10.264 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:10.264 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:10.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:10.366 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.366 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.367 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162214 s, 64.6 MB/s 2024-09-17T01:43:10.384 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.384 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.384 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143853 s, 72.9 MB/s 2024-09-17T01:43:10.401 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.401 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.401 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137046 s, 76.5 MB/s 2024-09-17T01:43:10.418 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.418 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.418 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141411 s, 74.2 MB/s 2024-09-17T01:43:10.438 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.438 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.438 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163645 s, 64.1 MB/s 2024-09-17T01:43:10.457 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.457 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.457 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161747 s, 64.8 MB/s 2024-09-17T01:43:10.481 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.481 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.481 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020703 s, 50.6 MB/s 2024-09-17T01:43:10.496 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.496 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.496 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117769 s, 89.0 MB/s 2024-09-17T01:43:10.513 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.513 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.513 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144087 s, 72.8 MB/s 2024-09-17T01:43:10.534 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.534 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.534 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177403 s, 59.1 MB/s 2024-09-17T01:43:10.556 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.556 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.556 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187123 s, 56.0 MB/s 2024-09-17T01:43:10.573 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.573 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.573 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141801 s, 73.9 MB/s 2024-09-17T01:43:10.597 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.597 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.597 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199406 s, 52.6 MB/s 2024-09-17T01:43:10.619 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.619 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.619 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192558 s, 54.5 MB/s 2024-09-17T01:43:10.633 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.633 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.634 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113162 s, 92.7 MB/s 2024-09-17T01:43:10.650 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.651 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.651 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139138 s, 75.4 MB/s 2024-09-17T01:43:10.669 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.669 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.669 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153359 s, 68.4 MB/s 2024-09-17T01:43:10.688 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.688 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.688 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154072 s, 68.1 MB/s 2024-09-17T01:43:10.703 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.703 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.703 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121049 s, 86.6 MB/s 2024-09-17T01:43:10.724 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.724 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.724 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174875 s, 60.0 MB/s 2024-09-17T01:43:10.744 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.745 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.745 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175581 s, 59.7 MB/s 2024-09-17T01:43:10.766 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.766 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.766 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181324 s, 57.8 MB/s 2024-09-17T01:43:10.783 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.783 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.783 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138024 s, 76.0 MB/s 2024-09-17T01:43:10.799 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.800 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.800 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130069 s, 80.6 MB/s 2024-09-17T01:43:10.817 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.817 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.817 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143827 s, 72.9 MB/s 2024-09-17T01:43:10.836 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.836 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.836 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159059 s, 65.9 MB/s 2024-09-17T01:43:10.853 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.854 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.854 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143935 s, 72.9 MB/s 2024-09-17T01:43:10.871 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.872 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.872 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148793 s, 70.5 MB/s 2024-09-17T01:43:10.890 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.890 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.890 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146395 s, 71.6 MB/s 2024-09-17T01:43:10.908 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.908 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.908 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148458 s, 70.6 MB/s 2024-09-17T01:43:10.925 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.925 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.925 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144316 s, 72.7 MB/s 2024-09-17T01:43:10.945 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:10.946 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:10.946 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170748 s, 61.4 MB/s 2024-09-17T01:43:10.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:10.955 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:10.955 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:10.955 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.7 2024-09-17T01:43:10.955 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:10.955 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:10.955 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:10.955 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:11.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:11.057 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.057 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.057 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159658 s, 65.7 MB/s 2024-09-17T01:43:11.077 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.077 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.077 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165477 s, 63.4 MB/s 2024-09-17T01:43:11.094 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.094 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.094 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138747 s, 75.6 MB/s 2024-09-17T01:43:11.111 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.111 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.111 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143491 s, 73.1 MB/s 2024-09-17T01:43:11.130 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.130 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.130 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155367 s, 67.5 MB/s 2024-09-17T01:43:11.147 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.147 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.147 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013622 s, 77.0 MB/s 2024-09-17T01:43:11.163 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.164 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.164 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134204 s, 78.1 MB/s 2024-09-17T01:43:11.181 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.181 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.181 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139354 s, 75.2 MB/s 2024-09-17T01:43:11.202 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.202 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.202 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180774 s, 58.0 MB/s 2024-09-17T01:43:11.216 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.217 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.217 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011395 s, 92.0 MB/s 2024-09-17T01:43:11.234 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.234 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.234 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141824 s, 73.9 MB/s 2024-09-17T01:43:11.252 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.252 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.252 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150288 s, 69.8 MB/s 2024-09-17T01:43:11.272 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.272 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.272 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160364 s, 65.4 MB/s 2024-09-17T01:43:11.289 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.289 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.289 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140733 s, 74.5 MB/s 2024-09-17T01:43:11.308 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.308 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.308 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153692 s, 68.2 MB/s 2024-09-17T01:43:11.325 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.325 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.325 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141433 s, 74.1 MB/s 2024-09-17T01:43:11.343 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.343 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.343 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148152 s, 70.8 MB/s 2024-09-17T01:43:11.360 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.360 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.360 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117564 s, 89.2 MB/s 2024-09-17T01:43:11.376 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.377 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.377 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150073 s, 69.9 MB/s 2024-09-17T01:43:11.393 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.394 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.394 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140907 s, 74.4 MB/s 2024-09-17T01:43:11.411 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.411 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.411 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140525 s, 74.6 MB/s 2024-09-17T01:43:11.430 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.430 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.430 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163388 s, 64.2 MB/s 2024-09-17T01:43:11.447 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.447 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.447 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136081 s, 77.1 MB/s 2024-09-17T01:43:11.466 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.466 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.466 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015824 s, 66.3 MB/s 2024-09-17T01:43:11.485 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.485 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.485 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159655 s, 65.7 MB/s 2024-09-17T01:43:11.504 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.504 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.504 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157489 s, 66.6 MB/s 2024-09-17T01:43:11.521 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.522 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.522 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140566 s, 74.6 MB/s 2024-09-17T01:43:11.539 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.540 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.540 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147742 s, 71.0 MB/s 2024-09-17T01:43:11.558 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.558 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.558 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151748 s, 69.1 MB/s 2024-09-17T01:43:11.574 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.575 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.575 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136448 s, 76.8 MB/s 2024-09-17T01:43:11.592 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.592 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.592 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014252 s, 73.6 MB/s 2024-09-17T01:43:11.616 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.617 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.617 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213747 s, 49.1 MB/s 2024-09-17T01:43:11.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:11.625 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:11.626 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:11.626 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.8 2024-09-17T01:43:11.626 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:11.626 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:11.626 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:11.626 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:11.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:11.731 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.731 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.731 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194098 s, 54.0 MB/s 2024-09-17T01:43:11.749 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.749 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.749 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142859 s, 73.4 MB/s 2024-09-17T01:43:11.767 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.767 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.767 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144699 s, 72.5 MB/s 2024-09-17T01:43:11.784 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.784 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.784 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138603 s, 75.7 MB/s 2024-09-17T01:43:11.801 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.802 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.802 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144455 s, 72.6 MB/s 2024-09-17T01:43:11.819 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.819 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.819 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013927 s, 75.3 MB/s 2024-09-17T01:43:11.836 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.836 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.836 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140107 s, 74.8 MB/s 2024-09-17T01:43:11.851 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.851 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.851 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123911 s, 84.6 MB/s 2024-09-17T01:43:11.870 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.870 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.870 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155394 s, 67.5 MB/s 2024-09-17T01:43:11.890 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.890 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.890 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174042 s, 60.2 MB/s 2024-09-17T01:43:11.907 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.907 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.907 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141351 s, 74.2 MB/s 2024-09-17T01:43:11.926 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.926 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.926 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155374 s, 67.5 MB/s 2024-09-17T01:43:11.946 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.946 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.946 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165698 s, 63.3 MB/s 2024-09-17T01:43:11.963 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.964 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.964 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143121 s, 73.3 MB/s 2024-09-17T01:43:11.985 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:11.985 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:11.985 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181404 s, 57.8 MB/s 2024-09-17T01:43:12.001 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.002 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.002 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136769 s, 76.7 MB/s 2024-09-17T01:43:12.020 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.020 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.020 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153113 s, 68.5 MB/s 2024-09-17T01:43:12.039 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.039 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.039 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156414 s, 67.0 MB/s 2024-09-17T01:43:12.057 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.057 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.057 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015134 s, 69.3 MB/s 2024-09-17T01:43:12.078 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.078 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.078 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018258 s, 57.4 MB/s 2024-09-17T01:43:12.096 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.096 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.096 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139175 s, 75.3 MB/s 2024-09-17T01:43:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138023 s, 76.0 MB/s 2024-09-17T01:43:12.134 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.134 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.134 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180218 s, 58.2 MB/s 2024-09-17T01:43:12.158 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.159 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.159 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215239 s, 48.7 MB/s 2024-09-17T01:43:12.176 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.176 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.176 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140115 s, 74.8 MB/s 2024-09-17T01:43:12.195 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.195 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.195 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160427 s, 65.4 MB/s 2024-09-17T01:43:12.212 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.212 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.212 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136953 s, 76.6 MB/s 2024-09-17T01:43:12.233 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.233 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.233 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177169 s, 59.2 MB/s 2024-09-17T01:43:12.251 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.251 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.251 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152874 s, 68.6 MB/s 2024-09-17T01:43:12.269 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.269 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.269 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144817 s, 72.4 MB/s 2024-09-17T01:43:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183154 s, 57.3 MB/s 2024-09-17T01:43:12.307 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.307 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.307 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135179 s, 77.6 MB/s 2024-09-17T01:43:12.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:12.316 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:12.316 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:12.316 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.9 2024-09-17T01:43:12.316 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:12.317 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:12.317 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:12.317 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:12.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:12.416 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.416 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.416 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140238 s, 74.8 MB/s 2024-09-17T01:43:12.438 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.438 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.438 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188481 s, 55.6 MB/s 2024-09-17T01:43:12.457 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.458 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.458 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163669 s, 64.1 MB/s 2024-09-17T01:43:12.474 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.474 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.474 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136174 s, 77.0 MB/s 2024-09-17T01:43:12.492 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.492 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.492 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145982 s, 71.8 MB/s 2024-09-17T01:43:12.509 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.510 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.510 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141127 s, 74.3 MB/s 2024-09-17T01:43:12.527 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.528 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.528 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147225 s, 71.2 MB/s 2024-09-17T01:43:12.546 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.546 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.546 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157072 s, 66.8 MB/s 2024-09-17T01:43:12.563 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.564 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.564 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141304 s, 74.2 MB/s 2024-09-17T01:43:12.581 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.581 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.581 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01426 s, 73.5 MB/s 2024-09-17T01:43:12.607 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.607 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.607 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226192 s, 46.4 MB/s 2024-09-17T01:43:12.624 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.624 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.624 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141987 s, 73.9 MB/s 2024-09-17T01:43:12.641 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.641 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.641 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141172 s, 74.3 MB/s 2024-09-17T01:43:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.663 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182317 s, 57.5 MB/s 2024-09-17T01:43:12.683 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.683 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.683 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169088 s, 62.0 MB/s 2024-09-17T01:43:12.704 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.704 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.704 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174269 s, 60.2 MB/s 2024-09-17T01:43:12.719 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.719 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.719 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120986 s, 86.7 MB/s 2024-09-17T01:43:12.738 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.739 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.739 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016079 s, 65.2 MB/s 2024-09-17T01:43:12.755 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.756 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.756 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137414 s, 76.3 MB/s 2024-09-17T01:43:12.776 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.776 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.776 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162345 s, 64.6 MB/s 2024-09-17T01:43:12.793 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.794 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.794 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151169 s, 69.4 MB/s 2024-09-17T01:43:12.817 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.817 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.817 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196134 s, 53.5 MB/s 2024-09-17T01:43:12.837 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.837 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.837 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169067 s, 62.0 MB/s 2024-09-17T01:43:12.858 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.858 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.858 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017335 s, 60.5 MB/s 2024-09-17T01:43:12.880 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.880 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.880 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187504 s, 55.9 MB/s 2024-09-17T01:43:12.897 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.897 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.897 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136159 s, 77.0 MB/s 2024-09-17T01:43:12.915 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.915 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.915 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142038 s, 73.8 MB/s 2024-09-17T01:43:12.930 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.930 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.930 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119164 s, 88.0 MB/s 2024-09-17T01:43:12.951 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.951 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.951 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175882 s, 59.6 MB/s 2024-09-17T01:43:12.968 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.968 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.968 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143575 s, 73.0 MB/s 2024-09-17T01:43:12.990 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:12.990 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:12.990 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192751 s, 54.4 MB/s 2024-09-17T01:43:13.007 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.007 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.008 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138497 s, 75.7 MB/s 2024-09-17T01:43:13.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:13.016 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:13.017 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:13.017 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.10 2024-09-17T01:43:13.017 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:13.017 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:13.017 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:13.017 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:13.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:13.117 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.117 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.117 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142034 s, 73.8 MB/s 2024-09-17T01:43:13.134 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.134 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.134 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142823 s, 73.4 MB/s 2024-09-17T01:43:13.151 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.151 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.151 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142277 s, 73.7 MB/s 2024-09-17T01:43:13.168 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.169 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.169 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141994 s, 73.8 MB/s 2024-09-17T01:43:13.185 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.186 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.186 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134871 s, 77.7 MB/s 2024-09-17T01:43:13.203 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.203 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.203 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140998 s, 74.4 MB/s 2024-09-17T01:43:13.219 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.220 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.220 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138391 s, 75.8 MB/s 2024-09-17T01:43:13.237 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.237 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.237 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146146 s, 71.7 MB/s 2024-09-17T01:43:13.255 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.255 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.255 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146635 s, 71.5 MB/s 2024-09-17T01:43:13.272 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.273 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.273 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144414 s, 72.6 MB/s 2024-09-17T01:43:13.290 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.290 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.291 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146174 s, 71.7 MB/s 2024-09-17T01:43:13.312 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.313 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.313 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190743 s, 55.0 MB/s 2024-09-17T01:43:13.330 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.330 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.330 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143515 s, 73.1 MB/s 2024-09-17T01:43:13.347 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.347 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.347 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141128 s, 74.3 MB/s 2024-09-17T01:43:13.362 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.362 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.362 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114684 s, 91.4 MB/s 2024-09-17T01:43:13.379 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.379 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.380 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141078 s, 74.3 MB/s 2024-09-17T01:43:13.401 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.401 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.401 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180438 s, 58.1 MB/s 2024-09-17T01:43:13.418 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.419 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.419 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150372 s, 69.7 MB/s 2024-09-17T01:43:13.436 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.437 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.437 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146338 s, 71.7 MB/s 2024-09-17T01:43:13.455 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.455 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.455 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154191 s, 68.0 MB/s 2024-09-17T01:43:13.473 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.474 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.474 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151691 s, 69.1 MB/s 2024-09-17T01:43:13.491 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.491 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.491 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014335 s, 73.1 MB/s 2024-09-17T01:43:13.508 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.508 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.508 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139006 s, 75.4 MB/s 2024-09-17T01:43:13.528 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.528 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.528 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166504 s, 63.0 MB/s 2024-09-17T01:43:13.543 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.543 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.543 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120535 s, 87.0 MB/s 2024-09-17T01:43:13.564 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.565 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.565 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182387 s, 57.5 MB/s 2024-09-17T01:43:13.587 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.587 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.587 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196685 s, 53.3 MB/s 2024-09-17T01:43:13.612 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.612 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.612 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213217 s, 49.2 MB/s 2024-09-17T01:43:13.629 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.629 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.629 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140774 s, 74.5 MB/s 2024-09-17T01:43:13.645 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.645 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.645 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131026 s, 80.0 MB/s 2024-09-17T01:43:13.662 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.663 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.663 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145242 s, 72.2 MB/s 2024-09-17T01:43:13.679 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.680 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.680 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139398 s, 75.2 MB/s 2024-09-17T01:43:13.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:13.690 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:13.690 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:13.690 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.11 2024-09-17T01:43:13.690 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:13.690 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:13.690 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:13.690 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:13.796 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.796 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.796 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163185 s, 64.3 MB/s 2024-09-17T01:43:13.815 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.815 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.815 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156821 s, 66.9 MB/s 2024-09-17T01:43:13.832 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.832 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.832 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139644 s, 75.1 MB/s 2024-09-17T01:43:13.849 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.849 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.849 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013712 s, 76.5 MB/s 2024-09-17T01:43:13.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.866 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137707 s, 76.1 MB/s 2024-09-17T01:43:13.883 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.883 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.883 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144519 s, 72.6 MB/s 2024-09-17T01:43:13.901 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.901 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.901 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147222 s, 71.2 MB/s 2024-09-17T01:43:13.919 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.919 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.920 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014898 s, 70.4 MB/s 2024-09-17T01:43:13.941 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.942 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.942 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187162 s, 56.0 MB/s 2024-09-17T01:43:13.958 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.958 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.959 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138885 s, 75.5 MB/s 2024-09-17T01:43:13.975 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.975 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.975 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132273 s, 79.3 MB/s 2024-09-17T01:43:13.996 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:13.996 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:13.996 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183569 s, 57.1 MB/s 2024-09-17T01:43:14.014 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.014 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.014 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151657 s, 69.1 MB/s 2024-09-17T01:43:14.038 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.038 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.038 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202041 s, 51.9 MB/s 2024-09-17T01:43:14.055 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.055 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.055 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144269 s, 72.7 MB/s 2024-09-17T01:43:14.072 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.072 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.072 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138794 s, 75.5 MB/s 2024-09-17T01:43:14.092 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.092 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.092 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162932 s, 64.4 MB/s 2024-09-17T01:43:14.109 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.109 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.110 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143248 s, 73.2 MB/s 2024-09-17T01:43:14.126 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.127 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.127 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138646 s, 75.6 MB/s 2024-09-17T01:43:14.144 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.144 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.144 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138665 s, 75.6 MB/s 2024-09-17T01:43:14.161 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.161 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.161 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139827 s, 75.0 MB/s 2024-09-17T01:43:14.178 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.178 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.178 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140549 s, 74.6 MB/s 2024-09-17T01:43:14.195 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.195 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.195 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141596 s, 74.1 MB/s 2024-09-17T01:43:14.212 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.212 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.212 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138847 s, 75.5 MB/s 2024-09-17T01:43:14.229 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.229 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.229 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139001 s, 75.4 MB/s 2024-09-17T01:43:14.246 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.246 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.246 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137255 s, 76.4 MB/s 2024-09-17T01:43:14.263 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.263 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.263 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141165 s, 74.3 MB/s 2024-09-17T01:43:14.280 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.280 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.280 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139465 s, 75.2 MB/s 2024-09-17T01:43:14.298 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.298 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.298 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143025 s, 73.3 MB/s 2024-09-17T01:43:14.315 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.315 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.315 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138353 s, 75.8 MB/s 2024-09-17T01:43:14.331 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.332 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.332 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136798 s, 76.7 MB/s 2024-09-17T01:43:14.348 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.349 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.349 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138229 s, 75.9 MB/s 2024-09-17T01:43:14.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:14.358 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:14.358 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:14.359 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.12 2024-09-17T01:43:14.359 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:14.359 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:14.359 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:14.359 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:14.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:14.460 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.460 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.460 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156692 s, 66.9 MB/s 2024-09-17T01:43:14.478 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.478 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.478 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146625 s, 71.5 MB/s 2024-09-17T01:43:14.495 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.495 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.495 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135172 s, 77.6 MB/s 2024-09-17T01:43:14.518 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.518 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.518 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202431 s, 51.8 MB/s 2024-09-17T01:43:14.535 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.535 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.535 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139691 s, 75.1 MB/s 2024-09-17T01:43:14.551 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.551 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.551 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127141 s, 82.5 MB/s 2024-09-17T01:43:14.571 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.571 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.571 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168473 s, 62.2 MB/s 2024-09-17T01:43:14.588 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.589 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.589 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144543 s, 72.5 MB/s 2024-09-17T01:43:14.608 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.608 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.608 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159241 s, 65.8 MB/s 2024-09-17T01:43:14.624 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.625 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.625 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137248 s, 76.4 MB/s 2024-09-17T01:43:14.646 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.646 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.646 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177394 s, 59.1 MB/s 2024-09-17T01:43:14.660 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.660 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.660 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115044 s, 91.1 MB/s 2024-09-17T01:43:14.677 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.677 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.677 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014107 s, 74.3 MB/s 2024-09-17T01:43:14.696 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.696 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.696 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154755 s, 67.8 MB/s 2024-09-17T01:43:14.716 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.716 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.716 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165566 s, 63.3 MB/s 2024-09-17T01:43:14.733 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.733 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.733 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145472 s, 72.1 MB/s 2024-09-17T01:43:14.753 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.753 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.754 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166015 s, 63.2 MB/s 2024-09-17T01:43:14.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.771 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139933 s, 74.9 MB/s 2024-09-17T01:43:14.792 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.792 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.792 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184891 s, 56.7 MB/s 2024-09-17T01:43:14.810 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.810 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.810 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143769 s, 72.9 MB/s 2024-09-17T01:43:14.828 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.828 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.828 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147093 s, 71.3 MB/s 2024-09-17T01:43:14.844 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.845 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.845 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137029 s, 76.5 MB/s 2024-09-17T01:43:14.862 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.862 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.863 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014621 s, 71.7 MB/s 2024-09-17T01:43:14.880 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.880 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.880 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141422 s, 74.1 MB/s 2024-09-17T01:43:14.900 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.900 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.900 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165813 s, 63.2 MB/s 2024-09-17T01:43:14.916 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.916 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.916 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013396 s, 78.3 MB/s 2024-09-17T01:43:14.938 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.939 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.939 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191812 s, 54.7 MB/s 2024-09-17T01:43:14.955 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.955 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.956 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013554 s, 77.4 MB/s 2024-09-17T01:43:14.977 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.977 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.977 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180755 s, 58.0 MB/s 2024-09-17T01:43:14.995 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:14.995 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:14.995 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147138 s, 71.3 MB/s 2024-09-17T01:43:15.013 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.013 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.013 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154558 s, 67.8 MB/s 2024-09-17T01:43:15.030 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.030 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.030 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132974 s, 78.9 MB/s 2024-09-17T01:43:15.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:15.039 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:15.039 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:15.039 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.13 2024-09-17T01:43:15.039 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:15.039 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:15.039 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:15.039 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:15.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:15.142 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.142 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.142 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162483 s, 64.5 MB/s 2024-09-17T01:43:15.165 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.166 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.166 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205128 s, 51.1 MB/s 2024-09-17T01:43:15.185 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.185 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.185 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166289 s, 63.1 MB/s 2024-09-17T01:43:15.205 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.205 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.205 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167295 s, 62.7 MB/s 2024-09-17T01:43:15.222 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.222 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.223 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140858 s, 74.4 MB/s 2024-09-17T01:43:15.240 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.240 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.240 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135234 s, 77.5 MB/s 2024-09-17T01:43:15.256 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.256 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.256 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143339 s, 73.2 MB/s 2024-09-17T01:43:15.271 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.271 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.271 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119768 s, 87.6 MB/s 2024-09-17T01:43:15.292 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.292 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.292 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017919 s, 58.5 MB/s 2024-09-17T01:43:15.316 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.317 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.317 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211372 s, 49.6 MB/s 2024-09-17T01:43:15.331 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.331 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.331 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115937 s, 90.4 MB/s 2024-09-17T01:43:15.349 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.349 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.349 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145917 s, 71.9 MB/s 2024-09-17T01:43:15.367 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.367 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.367 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147648 s, 71.0 MB/s 2024-09-17T01:43:15.385 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.385 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.385 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015155 s, 69.2 MB/s 2024-09-17T01:43:15.402 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.402 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.402 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139778 s, 75.0 MB/s 2024-09-17T01:43:15.427 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.427 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.427 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218775 s, 47.9 MB/s 2024-09-17T01:43:15.445 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.445 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.445 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144713 s, 72.5 MB/s 2024-09-17T01:43:15.462 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.463 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.463 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145089 s, 72.3 MB/s 2024-09-17T01:43:15.479 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.480 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.480 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138551 s, 75.7 MB/s 2024-09-17T01:43:15.504 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.504 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.504 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210632 s, 49.8 MB/s 2024-09-17T01:43:15.522 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.522 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.522 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149118 s, 70.3 MB/s 2024-09-17T01:43:15.544 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.544 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.544 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183931 s, 57.0 MB/s 2024-09-17T01:43:15.566 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.567 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.567 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194066 s, 54.0 MB/s 2024-09-17T01:43:15.591 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.592 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.592 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215514 s, 48.7 MB/s 2024-09-17T01:43:15.613 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.613 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.613 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180027 s, 58.2 MB/s 2024-09-17T01:43:15.630 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.630 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.630 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140647 s, 74.6 MB/s 2024-09-17T01:43:15.654 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.654 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.654 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207014 s, 50.7 MB/s 2024-09-17T01:43:15.673 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.673 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.674 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164152 s, 63.9 MB/s 2024-09-17T01:43:15.691 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.692 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.692 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144938 s, 72.3 MB/s 2024-09-17T01:43:15.710 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.711 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.711 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156465 s, 67.0 MB/s 2024-09-17T01:43:15.729 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.730 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.730 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158302 s, 66.2 MB/s 2024-09-17T01:43:15.747 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.748 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.748 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149993 s, 69.9 MB/s 2024-09-17T01:43:15.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:15.757 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:15.757 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:15.757 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.14 2024-09-17T01:43:15.757 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:15.757 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:15.757 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:15.757 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:15.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:15.864 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.864 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.864 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201229 s, 52.1 MB/s 2024-09-17T01:43:15.882 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.882 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.882 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149562 s, 70.1 MB/s 2024-09-17T01:43:15.900 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.900 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.900 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014382 s, 72.9 MB/s 2024-09-17T01:43:15.916 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.917 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.917 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136132 s, 77.0 MB/s 2024-09-17T01:43:15.938 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.939 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.939 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018857 s, 55.6 MB/s 2024-09-17T01:43:15.957 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.957 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.957 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150341 s, 69.7 MB/s 2024-09-17T01:43:15.975 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.975 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.975 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144947 s, 72.3 MB/s 2024-09-17T01:43:15.992 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:15.992 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:15.992 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142473 s, 73.6 MB/s 2024-09-17T01:43:16.009 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.009 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.009 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140359 s, 74.7 MB/s 2024-09-17T01:43:16.032 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.032 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.033 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020142 s, 52.1 MB/s 2024-09-17T01:43:16.049 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.049 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.049 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142923 s, 73.4 MB/s 2024-09-17T01:43:16.068 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.068 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.068 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150259 s, 69.8 MB/s 2024-09-17T01:43:16.081 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.081 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.081 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010592 s, 99.0 MB/s 2024-09-17T01:43:16.098 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.098 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.099 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139599 s, 75.1 MB/s 2024-09-17T01:43:16.115 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.115 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.115 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136974 s, 76.6 MB/s 2024-09-17T01:43:16.132 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.132 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.132 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137 s, 76.5 MB/s 2024-09-17T01:43:16.150 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.150 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.150 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142389 s, 73.6 MB/s 2024-09-17T01:43:16.168 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.169 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.169 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153776 s, 68.2 MB/s 2024-09-17T01:43:16.185 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.186 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.186 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142023 s, 73.8 MB/s 2024-09-17T01:43:16.202 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.202 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.202 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013415 s, 78.2 MB/s 2024-09-17T01:43:16.219 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.219 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.219 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133823 s, 78.4 MB/s 2024-09-17T01:43:16.238 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.238 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.238 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161071 s, 65.1 MB/s 2024-09-17T01:43:16.255 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.255 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.255 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141755 s, 74.0 MB/s 2024-09-17T01:43:16.274 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.274 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.274 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145912 s, 71.9 MB/s 2024-09-17T01:43:16.291 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.292 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.292 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149703 s, 70.0 MB/s 2024-09-17T01:43:16.306 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.307 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.307 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120295 s, 87.2 MB/s 2024-09-17T01:43:16.328 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.328 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.328 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184187 s, 56.9 MB/s 2024-09-17T01:43:16.349 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.349 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.349 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169824 s, 61.7 MB/s 2024-09-17T01:43:16.367 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.367 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.367 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155493 s, 67.4 MB/s 2024-09-17T01:43:16.385 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.385 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.385 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147595 s, 71.0 MB/s 2024-09-17T01:43:16.403 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.404 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.404 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151758 s, 69.1 MB/s 2024-09-17T01:43:16.420 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.420 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.420 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139484 s, 75.2 MB/s 2024-09-17T01:43:16.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:16.430 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:16.430 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:16.430 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.15 2024-09-17T01:43:16.430 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:16.430 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:16.430 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:16.430 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:16.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:16.530 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.530 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.531 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139178 s, 75.3 MB/s 2024-09-17T01:43:16.548 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.548 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.548 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143901 s, 72.9 MB/s 2024-09-17T01:43:16.566 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.567 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.567 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150977 s, 69.5 MB/s 2024-09-17T01:43:16.589 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.589 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.589 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190266 s, 55.1 MB/s 2024-09-17T01:43:16.613 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.613 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.613 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020615 s, 50.9 MB/s 2024-09-17T01:43:16.629 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.630 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.630 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136869 s, 76.6 MB/s 2024-09-17T01:43:16.647 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.647 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.647 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142291 s, 73.7 MB/s 2024-09-17T01:43:16.665 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.665 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.665 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146459 s, 71.6 MB/s 2024-09-17T01:43:16.686 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.687 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.687 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188506 s, 55.6 MB/s 2024-09-17T01:43:16.703 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.704 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.704 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136441 s, 76.9 MB/s 2024-09-17T01:43:16.720 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.721 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.721 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139353 s, 75.2 MB/s 2024-09-17T01:43:16.738 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.738 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.739 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146998 s, 71.3 MB/s 2024-09-17T01:43:16.756 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.757 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.757 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144649 s, 72.5 MB/s 2024-09-17T01:43:16.773 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.773 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.773 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138417 s, 75.8 MB/s 2024-09-17T01:43:16.792 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.793 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.793 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015821 s, 66.3 MB/s 2024-09-17T01:43:16.810 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.810 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.811 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146457 s, 71.6 MB/s 2024-09-17T01:43:16.828 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.828 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.829 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150588 s, 69.6 MB/s 2024-09-17T01:43:16.849 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.849 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.849 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169977 s, 61.7 MB/s 2024-09-17T01:43:16.864 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.864 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.864 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118591 s, 88.4 MB/s 2024-09-17T01:43:16.878 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.879 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.879 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118438 s, 88.5 MB/s 2024-09-17T01:43:16.896 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.896 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.896 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141941 s, 73.9 MB/s 2024-09-17T01:43:16.915 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.915 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.915 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160179 s, 65.5 MB/s 2024-09-17T01:43:16.937 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.937 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.937 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184134 s, 56.9 MB/s 2024-09-17T01:43:16.958 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.958 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.958 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179137 s, 58.5 MB/s 2024-09-17T01:43:16.979 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.979 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.979 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174657 s, 60.0 MB/s 2024-09-17T01:43:16.997 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:16.997 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:16.997 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154027 s, 68.1 MB/s 2024-09-17T01:43:17.018 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.018 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.018 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171582 s, 61.1 MB/s 2024-09-17T01:43:17.034 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.034 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.035 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136953 s, 76.6 MB/s 2024-09-17T01:43:17.056 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.056 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.057 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188468 s, 55.6 MB/s 2024-09-17T01:43:17.075 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.075 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.075 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146064 s, 71.8 MB/s 2024-09-17T01:43:17.093 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.094 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.094 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015815 s, 66.3 MB/s 2024-09-17T01:43:17.111 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.111 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.111 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141443 s, 74.1 MB/s 2024-09-17T01:43:17.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:17.120 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:17.120 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:17.120 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.16 2024-09-17T01:43:17.120 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:17.120 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:17.120 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:17.120 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:17.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:17.221 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.222 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.222 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143538 s, 73.1 MB/s 2024-09-17T01:43:17.238 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.238 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.238 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139211 s, 75.3 MB/s 2024-09-17T01:43:17.256 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.256 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.256 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139523 s, 75.2 MB/s 2024-09-17T01:43:17.273 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.273 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.273 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143997 s, 72.8 MB/s 2024-09-17T01:43:17.292 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.292 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.292 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152794 s, 68.6 MB/s 2024-09-17T01:43:17.309 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.309 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.309 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137965 s, 76.0 MB/s 2024-09-17T01:43:17.331 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.331 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.331 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185938 s, 56.4 MB/s 2024-09-17T01:43:17.348 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.348 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.348 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142176 s, 73.8 MB/s 2024-09-17T01:43:17.365 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.365 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.365 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133173 s, 78.7 MB/s 2024-09-17T01:43:17.382 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.382 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.383 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147273 s, 71.2 MB/s 2024-09-17T01:43:17.400 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.400 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.400 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147823 s, 70.9 MB/s 2024-09-17T01:43:17.419 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.419 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.419 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153568 s, 68.3 MB/s 2024-09-17T01:43:17.436 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.437 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.437 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135119 s, 77.6 MB/s 2024-09-17T01:43:17.454 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.454 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.454 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138505 s, 75.7 MB/s 2024-09-17T01:43:17.474 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.474 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.474 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164074 s, 63.9 MB/s 2024-09-17T01:43:17.490 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.491 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.491 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130472 s, 80.4 MB/s 2024-09-17T01:43:17.510 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.511 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.511 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163384 s, 64.2 MB/s 2024-09-17T01:43:17.532 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.532 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.532 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181486 s, 57.8 MB/s 2024-09-17T01:43:17.550 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.550 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.550 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140269 s, 74.8 MB/s 2024-09-17T01:43:17.568 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.568 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.568 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139519 s, 75.2 MB/s 2024-09-17T01:43:17.586 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.586 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.586 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01487 s, 70.5 MB/s 2024-09-17T01:43:17.605 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.605 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.605 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154155 s, 68.0 MB/s 2024-09-17T01:43:17.624 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.625 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.625 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157442 s, 66.6 MB/s 2024-09-17T01:43:17.642 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.642 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.642 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137887 s, 76.0 MB/s 2024-09-17T01:43:17.661 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.661 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.661 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145503 s, 72.1 MB/s 2024-09-17T01:43:17.678 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.679 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.679 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141494 s, 74.1 MB/s 2024-09-17T01:43:17.697 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.697 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.697 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144442 s, 72.6 MB/s 2024-09-17T01:43:17.714 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.714 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.714 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143668 s, 73.0 MB/s 2024-09-17T01:43:17.738 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.739 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.739 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208356 s, 50.3 MB/s 2024-09-17T01:43:17.754 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.754 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.754 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118553 s, 88.4 MB/s 2024-09-17T01:43:17.773 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.773 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.773 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156457 s, 67.0 MB/s 2024-09-17T01:43:17.796 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.796 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.796 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190688 s, 55.0 MB/s 2024-09-17T01:43:17.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:17.805 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:17.805 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:17.805 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.17 2024-09-17T01:43:17.805 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:17.806 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:17.806 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:17.806 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:17.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:17.912 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.912 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.912 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162027 s, 64.7 MB/s 2024-09-17T01:43:17.933 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.933 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.933 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01803 s, 58.2 MB/s 2024-09-17T01:43:17.951 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.951 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.952 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015018 s, 69.8 MB/s 2024-09-17T01:43:17.970 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.970 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.971 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159821 s, 65.6 MB/s 2024-09-17T01:43:17.991 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:17.991 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:17.991 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175204 s, 59.8 MB/s 2024-09-17T01:43:18.010 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.011 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.011 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163312 s, 64.2 MB/s 2024-09-17T01:43:18.035 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.035 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.035 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210458 s, 49.8 MB/s 2024-09-17T01:43:18.052 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.053 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.053 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014474 s, 72.4 MB/s 2024-09-17T01:43:18.071 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.072 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.072 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158962 s, 66.0 MB/s 2024-09-17T01:43:18.089 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.089 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.089 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142528 s, 73.6 MB/s 2024-09-17T01:43:18.107 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.107 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.108 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150061 s, 69.9 MB/s 2024-09-17T01:43:18.126 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.126 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.126 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159267 s, 65.8 MB/s 2024-09-17T01:43:18.143 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.143 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.144 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143105 s, 73.3 MB/s 2024-09-17T01:43:18.161 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.161 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.161 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142125 s, 73.8 MB/s 2024-09-17T01:43:18.179 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.179 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.179 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152797 s, 68.6 MB/s 2024-09-17T01:43:18.196 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.196 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.196 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137332 s, 76.4 MB/s 2024-09-17T01:43:18.218 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.218 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.218 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184412 s, 56.9 MB/s 2024-09-17T01:43:18.232 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.232 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.232 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115287 s, 91.0 MB/s 2024-09-17T01:43:18.251 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.252 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.252 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164841 s, 63.6 MB/s 2024-09-17T01:43:18.270 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.270 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.270 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155922 s, 67.2 MB/s 2024-09-17T01:43:18.292 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.292 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.292 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187438 s, 55.9 MB/s 2024-09-17T01:43:18.313 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.313 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.313 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177961 s, 58.9 MB/s 2024-09-17T01:43:18.330 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.330 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.330 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140688 s, 74.5 MB/s 2024-09-17T01:43:18.347 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.347 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.347 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013684 s, 76.6 MB/s 2024-09-17T01:43:18.363 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.364 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.364 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136827 s, 76.6 MB/s 2024-09-17T01:43:18.381 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.382 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.382 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147072 s, 71.3 MB/s 2024-09-17T01:43:18.399 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.399 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.399 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150209 s, 69.8 MB/s 2024-09-17T01:43:18.420 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.420 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.420 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171997 s, 61.0 MB/s 2024-09-17T01:43:18.437 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.438 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.438 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149209 s, 70.3 MB/s 2024-09-17T01:43:18.454 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.454 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.454 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134969 s, 77.7 MB/s 2024-09-17T01:43:18.472 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.472 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.472 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139635 s, 75.1 MB/s 2024-09-17T01:43:18.489 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.489 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.489 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014296 s, 73.3 MB/s 2024-09-17T01:43:18.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:18.498 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:18.498 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:18.498 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.18 2024-09-17T01:43:18.498 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:18.498 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:18.499 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:18.499 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:18.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:18.602 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.602 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.602 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162897 s, 64.4 MB/s 2024-09-17T01:43:18.620 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.620 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.620 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143964 s, 72.8 MB/s 2024-09-17T01:43:18.637 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.638 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.638 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137556 s, 76.2 MB/s 2024-09-17T01:43:18.657 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.657 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.657 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015599 s, 67.2 MB/s 2024-09-17T01:43:18.676 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.676 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.676 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158573 s, 66.1 MB/s 2024-09-17T01:43:18.694 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.694 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.694 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139148 s, 75.4 MB/s 2024-09-17T01:43:18.711 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.712 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.712 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140706 s, 74.5 MB/s 2024-09-17T01:43:18.729 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.729 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.729 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140733 s, 74.5 MB/s 2024-09-17T01:43:18.747 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.747 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.747 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141623 s, 74.0 MB/s 2024-09-17T01:43:18.769 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.769 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.769 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017932 s, 58.5 MB/s 2024-09-17T01:43:18.785 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.785 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.785 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125299 s, 83.7 MB/s 2024-09-17T01:43:18.803 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.803 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.803 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014758 s, 71.1 MB/s 2024-09-17T01:43:18.819 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.819 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.819 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122281 s, 85.8 MB/s 2024-09-17T01:43:18.837 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.837 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.837 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143862 s, 72.9 MB/s 2024-09-17T01:43:18.853 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.854 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.854 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139708 s, 75.1 MB/s 2024-09-17T01:43:18.875 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.875 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.875 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177776 s, 59.0 MB/s 2024-09-17T01:43:18.891 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.891 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.891 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01377 s, 76.1 MB/s 2024-09-17T01:43:18.910 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.910 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.910 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151166 s, 69.4 MB/s 2024-09-17T01:43:18.932 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.932 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.932 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187598 s, 55.9 MB/s 2024-09-17T01:43:18.949 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.949 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.950 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147569 s, 71.1 MB/s 2024-09-17T01:43:18.967 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.967 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.967 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142718 s, 73.5 MB/s 2024-09-17T01:43:18.983 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:18.983 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:18.983 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129835 s, 80.8 MB/s 2024-09-17T01:43:19.001 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.001 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.001 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015041 s, 69.7 MB/s 2024-09-17T01:43:19.023 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.023 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.023 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184012 s, 57.0 MB/s 2024-09-17T01:43:19.040 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.041 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.041 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139346 s, 75.2 MB/s 2024-09-17T01:43:19.054 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.054 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.054 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114061 s, 91.9 MB/s 2024-09-17T01:43:19.072 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.072 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.072 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148441 s, 70.6 MB/s 2024-09-17T01:43:19.089 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.089 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.089 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138096 s, 75.9 MB/s 2024-09-17T01:43:19.106 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.107 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.107 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142137 s, 73.8 MB/s 2024-09-17T01:43:19.123 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.123 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.123 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136958 s, 76.6 MB/s 2024-09-17T01:43:19.140 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.140 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.141 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138946 s, 75.5 MB/s 2024-09-17T01:43:19.161 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.161 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.161 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174256 s, 60.2 MB/s 2024-09-17T01:43:19.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:19.170 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:19.170 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:19.171 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.19 2024-09-17T01:43:19.171 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:19.171 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:19.171 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:19.171 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:19.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:19.271 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.271 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.271 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138934 s, 75.5 MB/s 2024-09-17T01:43:19.287 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.287 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.287 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125671 s, 83.4 MB/s 2024-09-17T01:43:19.304 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.304 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.304 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139203 s, 75.3 MB/s 2024-09-17T01:43:19.327 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.327 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.327 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198746 s, 52.8 MB/s 2024-09-17T01:43:19.344 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.344 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.344 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143755 s, 72.9 MB/s 2024-09-17T01:43:19.363 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.363 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.363 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161086 s, 65.1 MB/s 2024-09-17T01:43:19.378 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.379 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.379 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118566 s, 88.4 MB/s 2024-09-17T01:43:19.393 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.393 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.393 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113824 s, 92.1 MB/s 2024-09-17T01:43:19.415 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.416 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.416 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187204 s, 56.0 MB/s 2024-09-17T01:43:19.433 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.434 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.434 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149781 s, 70.0 MB/s 2024-09-17T01:43:19.451 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.451 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.451 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150693 s, 69.6 MB/s 2024-09-17T01:43:19.470 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.470 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.471 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157545 s, 66.6 MB/s 2024-09-17T01:43:19.485 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.485 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.485 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119041 s, 88.1 MB/s 2024-09-17T01:43:19.504 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.504 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.504 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157606 s, 66.5 MB/s 2024-09-17T01:43:19.521 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.521 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.521 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138839 s, 75.5 MB/s 2024-09-17T01:43:19.538 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.538 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.538 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137518 s, 76.3 MB/s 2024-09-17T01:43:19.559 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.559 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.559 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175711 s, 59.7 MB/s 2024-09-17T01:43:19.577 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.577 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.577 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153644 s, 68.2 MB/s 2024-09-17T01:43:19.594 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.594 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.594 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137229 s, 76.4 MB/s 2024-09-17T01:43:19.612 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.613 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.613 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151934 s, 69.0 MB/s 2024-09-17T01:43:19.631 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.632 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.632 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158052 s, 66.3 MB/s 2024-09-17T01:43:19.648 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.648 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.648 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133355 s, 78.6 MB/s 2024-09-17T01:43:19.666 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.666 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.666 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150192 s, 69.8 MB/s 2024-09-17T01:43:19.688 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.689 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.689 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188806 s, 55.5 MB/s 2024-09-17T01:43:19.708 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.708 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.708 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160912 s, 65.2 MB/s 2024-09-17T01:43:19.731 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.731 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.731 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01879 s, 55.8 MB/s 2024-09-17T01:43:19.752 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.753 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.753 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184659 s, 56.8 MB/s 2024-09-17T01:43:19.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.771 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143907 s, 72.9 MB/s 2024-09-17T01:43:19.793 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.793 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.793 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186835 s, 56.1 MB/s 2024-09-17T01:43:19.811 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.811 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.812 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146352 s, 71.6 MB/s 2024-09-17T01:43:19.828 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.829 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.829 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136226 s, 77.0 MB/s 2024-09-17T01:43:19.847 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.847 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.847 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152875 s, 68.6 MB/s 2024-09-17T01:43:19.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:19.856 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:19.856 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:19.857 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.20 2024-09-17T01:43:19.857 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:19.857 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:19.857 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:19.857 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:19.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:19.961 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.962 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.962 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180214 s, 58.2 MB/s 2024-09-17T01:43:19.985 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:19.985 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:19.985 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198264 s, 52.9 MB/s 2024-09-17T01:43:20.007 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.007 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.007 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185393 s, 56.6 MB/s 2024-09-17T01:43:20.025 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.025 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.025 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146578 s, 71.5 MB/s 2024-09-17T01:43:20.042 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.043 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.043 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135811 s, 77.2 MB/s 2024-09-17T01:43:20.061 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.061 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.061 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143776 s, 72.9 MB/s 2024-09-17T01:43:20.082 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.082 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.082 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175474 s, 59.8 MB/s 2024-09-17T01:43:20.100 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.100 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.100 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141826 s, 73.9 MB/s 2024-09-17T01:43:20.120 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.120 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.120 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161436 s, 65.0 MB/s 2024-09-17T01:43:20.137 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.137 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.137 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140625 s, 74.6 MB/s 2024-09-17T01:43:20.153 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.154 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.154 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125599 s, 83.5 MB/s 2024-09-17T01:43:20.177 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.177 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.178 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200351 s, 52.3 MB/s 2024-09-17T01:43:20.195 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.195 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.195 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137396 s, 76.3 MB/s 2024-09-17T01:43:20.212 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.212 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.212 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133845 s, 78.3 MB/s 2024-09-17T01:43:20.230 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.230 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.230 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142827 s, 73.4 MB/s 2024-09-17T01:43:20.250 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.251 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.251 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171149 s, 61.3 MB/s 2024-09-17T01:43:20.267 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.267 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.267 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130982 s, 80.1 MB/s 2024-09-17T01:43:20.291 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.291 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.291 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196984 s, 53.2 MB/s 2024-09-17T01:43:20.309 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.309 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.309 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152201 s, 68.9 MB/s 2024-09-17T01:43:20.331 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.331 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.331 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176955 s, 59.3 MB/s 2024-09-17T01:43:20.346 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.346 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.346 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011636 s, 90.1 MB/s 2024-09-17T01:43:20.364 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.364 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.364 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145187 s, 72.2 MB/s 2024-09-17T01:43:20.382 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.382 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.382 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014512 s, 72.3 MB/s 2024-09-17T01:43:20.399 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.399 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.399 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136325 s, 76.9 MB/s 2024-09-17T01:43:20.418 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.418 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.418 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153202 s, 68.4 MB/s 2024-09-17T01:43:20.436 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.436 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.436 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143282 s, 73.2 MB/s 2024-09-17T01:43:20.453 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.454 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.454 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143098 s, 73.3 MB/s 2024-09-17T01:43:20.470 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.470 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.470 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135847 s, 77.2 MB/s 2024-09-17T01:43:20.488 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.488 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.488 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148475 s, 70.6 MB/s 2024-09-17T01:43:20.507 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.507 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.507 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015073 s, 69.6 MB/s 2024-09-17T01:43:20.524 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.524 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.524 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143198 s, 73.2 MB/s 2024-09-17T01:43:20.541 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.541 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.541 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135969 s, 77.1 MB/s 2024-09-17T01:43:20.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:20.551 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:20.551 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:20.551 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.21 2024-09-17T01:43:20.551 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:20.551 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:20.551 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:20.551 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:20.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:20.651 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.651 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.651 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138026 s, 76.0 MB/s 2024-09-17T01:43:20.670 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.670 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.670 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015834 s, 66.2 MB/s 2024-09-17T01:43:20.690 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.690 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.690 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165924 s, 63.2 MB/s 2024-09-17T01:43:20.712 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.713 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.713 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193182 s, 54.3 MB/s 2024-09-17T01:43:20.729 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.730 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.730 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139654 s, 75.1 MB/s 2024-09-17T01:43:20.747 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.748 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.748 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014842 s, 70.6 MB/s 2024-09-17T01:43:20.763 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.763 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.763 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120451 s, 87.1 MB/s 2024-09-17T01:43:20.783 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.783 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.783 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175488 s, 59.8 MB/s 2024-09-17T01:43:20.804 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.804 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.805 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181945 s, 57.6 MB/s 2024-09-17T01:43:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.821 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136831 s, 76.6 MB/s 2024-09-17T01:43:20.836 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.837 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.837 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119757 s, 87.6 MB/s 2024-09-17T01:43:20.854 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.854 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.854 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148001 s, 70.8 MB/s 2024-09-17T01:43:20.872 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.872 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.872 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014206 s, 73.8 MB/s 2024-09-17T01:43:20.889 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.889 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.890 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145156 s, 72.2 MB/s 2024-09-17T01:43:20.906 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.906 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.906 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138086 s, 75.9 MB/s 2024-09-17T01:43:20.925 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.925 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.925 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147773 s, 71.0 MB/s 2024-09-17T01:43:20.941 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.941 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.942 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014089 s, 74.4 MB/s 2024-09-17T01:43:20.962 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.962 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.962 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175517 s, 59.7 MB/s 2024-09-17T01:43:20.979 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:20.979 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:20.980 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141844 s, 73.9 MB/s 2024-09-17T01:43:21.002 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.002 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.002 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019531 s, 53.7 MB/s 2024-09-17T01:43:21.019 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.019 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.019 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139935 s, 74.9 MB/s 2024-09-17T01:43:21.038 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.039 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.039 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016006 s, 65.5 MB/s 2024-09-17T01:43:21.056 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.057 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.057 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147331 s, 71.2 MB/s 2024-09-17T01:43:21.075 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.075 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.075 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159686 s, 65.7 MB/s 2024-09-17T01:43:21.092 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.093 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.093 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137559 s, 76.2 MB/s 2024-09-17T01:43:21.109 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.109 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.110 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013798 s, 76.0 MB/s 2024-09-17T01:43:21.127 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.127 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.127 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146038 s, 71.8 MB/s 2024-09-17T01:43:21.144 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.144 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.145 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140776 s, 74.5 MB/s 2024-09-17T01:43:21.161 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.161 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.161 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134258 s, 78.1 MB/s 2024-09-17T01:43:21.178 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.180 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.180 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139783 s, 75.0 MB/s 2024-09-17T01:43:21.196 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.196 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.196 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144864 s, 72.4 MB/s 2024-09-17T01:43:21.202 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:43:21.206 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:43:21.213 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.213 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.213 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138378 s, 75.8 MB/s 2024-09-17T01:43:21.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:21.223 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:21.223 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:21.223 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.22 2024-09-17T01:43:21.223 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:21.223 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:21.223 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:21.223 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:21.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:21.370 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.370 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.370 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220438 s, 47.6 MB/s 2024-09-17T01:43:21.388 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.388 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.388 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140205 s, 74.8 MB/s 2024-09-17T01:43:21.404 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.404 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.404 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137955 s, 76.0 MB/s 2024-09-17T01:43:21.422 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.423 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.423 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150383 s, 69.7 MB/s 2024-09-17T01:43:21.440 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.440 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.440 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141837 s, 73.9 MB/s 2024-09-17T01:43:21.459 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.459 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.459 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016098 s, 65.1 MB/s 2024-09-17T01:43:21.477 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.477 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.477 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145635 s, 72.0 MB/s 2024-09-17T01:43:21.501 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.501 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.501 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206279 s, 50.8 MB/s 2024-09-17T01:43:21.519 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.519 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.519 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149039 s, 70.4 MB/s 2024-09-17T01:43:21.541 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.541 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.542 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193785 s, 54.1 MB/s 2024-09-17T01:43:21.560 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.560 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.560 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149451 s, 70.2 MB/s 2024-09-17T01:43:21.583 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.583 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.583 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199746 s, 52.5 MB/s 2024-09-17T01:43:21.600 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.600 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.601 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144019 s, 72.8 MB/s 2024-09-17T01:43:21.614 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.614 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.615 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111464 s, 94.1 MB/s 2024-09-17T01:43:21.632 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.632 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.632 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147027 s, 71.3 MB/s 2024-09-17T01:43:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.650 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146462 s, 71.6 MB/s 2024-09-17T01:43:21.667 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.667 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.668 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136345 s, 76.9 MB/s 2024-09-17T01:43:21.687 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.688 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.688 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171892 s, 61.0 MB/s 2024-09-17T01:43:21.711 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.711 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.711 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194443 s, 53.9 MB/s 2024-09-17T01:43:21.733 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.733 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.733 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185435 s, 56.5 MB/s 2024-09-17T01:43:21.752 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.752 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.752 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161303 s, 65.0 MB/s 2024-09-17T01:43:21.772 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.773 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.773 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170375 s, 61.5 MB/s 2024-09-17T01:43:21.790 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.790 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.790 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146618 s, 71.5 MB/s 2024-09-17T01:43:21.812 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.812 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.812 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184442 s, 56.9 MB/s 2024-09-17T01:43:21.831 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.831 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.831 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156661 s, 66.9 MB/s 2024-09-17T01:43:21.850 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.850 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.850 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157097 s, 66.7 MB/s 2024-09-17T01:43:21.871 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.871 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.871 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180133 s, 58.2 MB/s 2024-09-17T01:43:21.888 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.888 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.888 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142532 s, 73.6 MB/s 2024-09-17T01:43:21.909 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.909 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.909 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180794 s, 58.0 MB/s 2024-09-17T01:43:21.925 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.925 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.925 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123058 s, 85.2 MB/s 2024-09-17T01:43:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144265 s, 72.7 MB/s 2024-09-17T01:43:21.960 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:21.960 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:21.961 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148752 s, 70.5 MB/s 2024-09-17T01:43:21.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:21.969 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:21.970 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:21.970 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.23 2024-09-17T01:43:21.970 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:21.970 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:21.970 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:21.970 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:22.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:22.072 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.073 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.073 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159633 s, 65.7 MB/s 2024-09-17T01:43:22.089 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.090 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.090 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141756 s, 74.0 MB/s 2024-09-17T01:43:22.110 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.111 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.111 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178855 s, 58.6 MB/s 2024-09-17T01:43:22.129 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.130 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157294 s, 66.7 MB/s 2024-09-17T01:43:22.150 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.150 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.150 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174306 s, 60.2 MB/s 2024-09-17T01:43:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147056 s, 71.3 MB/s 2024-09-17T01:43:22.185 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.185 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.185 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141287 s, 74.2 MB/s 2024-09-17T01:43:22.203 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.203 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.203 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147393 s, 71.1 MB/s 2024-09-17T01:43:22.220 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.220 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.220 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136828 s, 76.6 MB/s 2024-09-17T01:43:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.239 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015925 s, 65.8 MB/s 2024-09-17T01:43:22.262 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.262 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.262 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196328 s, 53.4 MB/s 2024-09-17T01:43:22.278 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.279 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135452 s, 77.4 MB/s 2024-09-17T01:43:22.295 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.295 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.295 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132482 s, 79.1 MB/s 2024-09-17T01:43:22.310 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.310 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.310 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119562 s, 87.7 MB/s 2024-09-17T01:43:22.327 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.327 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.327 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137682 s, 76.2 MB/s 2024-09-17T01:43:22.343 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.343 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.343 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124487 s, 84.2 MB/s 2024-09-17T01:43:22.364 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.364 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.364 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180018 s, 58.2 MB/s 2024-09-17T01:43:22.383 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.383 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.383 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147405 s, 71.1 MB/s 2024-09-17T01:43:22.400 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.400 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.400 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014358 s, 73.0 MB/s 2024-09-17T01:43:22.417 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.418 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.418 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143779 s, 72.9 MB/s 2024-09-17T01:43:22.432 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.432 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.432 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115626 s, 90.7 MB/s 2024-09-17T01:43:22.451 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.451 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.451 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156817 s, 66.9 MB/s 2024-09-17T01:43:22.472 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.472 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.472 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180093 s, 58.2 MB/s 2024-09-17T01:43:22.493 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.493 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.493 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180337 s, 58.1 MB/s 2024-09-17T01:43:22.513 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.514 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.514 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171774 s, 61.0 MB/s 2024-09-17T01:43:22.530 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.530 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.530 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138724 s, 75.6 MB/s 2024-09-17T01:43:22.548 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.548 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.548 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144138 s, 72.7 MB/s 2024-09-17T01:43:22.565 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.565 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.565 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136307 s, 76.9 MB/s 2024-09-17T01:43:22.584 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.584 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.584 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160862 s, 65.2 MB/s 2024-09-17T01:43:22.606 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.606 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.606 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186333 s, 56.3 MB/s 2024-09-17T01:43:22.627 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.627 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.627 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174593 s, 60.1 MB/s 2024-09-17T01:43:22.646 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.646 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.646 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155142 s, 67.6 MB/s 2024-09-17T01:43:22.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:22.655 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:22.655 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:22.655 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.24 2024-09-17T01:43:22.655 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:22.655 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:22.655 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:22.655 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:22.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:22.756 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.757 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.757 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148541 s, 70.6 MB/s 2024-09-17T01:43:22.773 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.773 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.774 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138698 s, 75.6 MB/s 2024-09-17T01:43:22.794 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.794 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.794 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168396 s, 62.3 MB/s 2024-09-17T01:43:22.816 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.816 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.816 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188652 s, 55.6 MB/s 2024-09-17T01:43:22.835 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.835 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.835 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153506 s, 68.3 MB/s 2024-09-17T01:43:22.855 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.855 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.855 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155575 s, 67.4 MB/s 2024-09-17T01:43:22.872 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.872 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.872 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138903 s, 75.5 MB/s 2024-09-17T01:43:22.890 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.890 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.890 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145463 s, 72.1 MB/s 2024-09-17T01:43:22.909 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.910 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.910 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163514 s, 64.1 MB/s 2024-09-17T01:43:22.926 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.926 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.926 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135983 s, 77.1 MB/s 2024-09-17T01:43:22.942 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.942 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.942 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122438 s, 85.6 MB/s 2024-09-17T01:43:22.963 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.963 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.963 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179526 s, 58.4 MB/s 2024-09-17T01:43:22.980 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.980 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.980 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137107 s, 76.5 MB/s 2024-09-17T01:43:22.995 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:22.995 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:22.995 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120816 s, 86.8 MB/s 2024-09-17T01:43:23.012 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.012 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.012 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135726 s, 77.3 MB/s 2024-09-17T01:43:23.026 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.026 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.026 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116973 s, 89.6 MB/s 2024-09-17T01:43:23.044 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.044 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.044 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139604 s, 75.1 MB/s 2024-09-17T01:43:23.061 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.061 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.061 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143376 s, 73.1 MB/s 2024-09-17T01:43:23.082 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.083 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.083 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181318 s, 57.8 MB/s 2024-09-17T01:43:23.100 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.100 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.100 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138961 s, 75.5 MB/s 2024-09-17T01:43:23.121 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.121 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.121 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182505 s, 57.5 MB/s 2024-09-17T01:43:23.143 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.143 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.143 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182471 s, 57.5 MB/s 2024-09-17T01:43:23.161 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.161 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.161 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150136 s, 69.8 MB/s 2024-09-17T01:43:23.182 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.182 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.182 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182193 s, 57.6 MB/s 2024-09-17T01:43:23.201 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.201 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.201 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155636 s, 67.4 MB/s 2024-09-17T01:43:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.220 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156163 s, 67.1 MB/s 2024-09-17T01:43:23.242 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.242 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.242 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184961 s, 56.7 MB/s 2024-09-17T01:43:23.258 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.258 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.259 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138807 s, 75.5 MB/s 2024-09-17T01:43:23.276 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.277 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.277 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144562 s, 72.5 MB/s 2024-09-17T01:43:23.295 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.295 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.295 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149501 s, 70.1 MB/s 2024-09-17T01:43:23.316 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.316 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.316 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179877 s, 58.3 MB/s 2024-09-17T01:43:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179396 s, 58.5 MB/s 2024-09-17T01:43:23.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:23.346 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:23.346 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:23.346 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.25 2024-09-17T01:43:23.346 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:23.346 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:23.346 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:23.347 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:23.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.447 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144489 s, 72.6 MB/s 2024-09-17T01:43:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.469 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182671 s, 57.4 MB/s 2024-09-17T01:43:23.492 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.492 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.492 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207024 s, 50.6 MB/s 2024-09-17T01:43:23.510 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.510 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.510 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014197 s, 73.9 MB/s 2024-09-17T01:43:23.527 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.527 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.527 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142072 s, 73.8 MB/s 2024-09-17T01:43:23.551 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.551 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.552 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205466 s, 51.0 MB/s 2024-09-17T01:43:23.572 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.572 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.572 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180299 s, 58.2 MB/s 2024-09-17T01:43:23.590 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.590 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.590 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145779 s, 71.9 MB/s 2024-09-17T01:43:23.608 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.608 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.608 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152278 s, 68.9 MB/s 2024-09-17T01:43:23.624 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.625 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.625 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135655 s, 77.3 MB/s 2024-09-17T01:43:23.646 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.646 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.646 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181063 s, 57.9 MB/s 2024-09-17T01:43:23.664 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.664 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.664 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152336 s, 68.8 MB/s 2024-09-17T01:43:23.681 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.682 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.682 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139653 s, 75.1 MB/s 2024-09-17T01:43:23.700 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.701 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.701 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015744 s, 66.6 MB/s 2024-09-17T01:43:23.722 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.722 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.722 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184552 s, 56.8 MB/s 2024-09-17T01:43:23.741 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.741 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.741 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158069 s, 66.3 MB/s 2024-09-17T01:43:23.760 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.760 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.760 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155126 s, 67.6 MB/s 2024-09-17T01:43:23.774 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.775 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.775 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118165 s, 88.7 MB/s 2024-09-17T01:43:23.791 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.791 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.791 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013718 s, 76.4 MB/s 2024-09-17T01:43:23.815 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.815 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.815 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203188 s, 51.6 MB/s 2024-09-17T01:43:23.832 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.832 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.832 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143577 s, 73.0 MB/s 2024-09-17T01:43:23.850 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.850 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.850 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141157 s, 74.3 MB/s 2024-09-17T01:43:23.867 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.867 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.867 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140097 s, 74.8 MB/s 2024-09-17T01:43:23.882 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.883 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.883 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012796 s, 81.9 MB/s 2024-09-17T01:43:23.902 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.902 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.902 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166422 s, 63.0 MB/s 2024-09-17T01:43:23.920 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.921 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151167 s, 69.4 MB/s 2024-09-17T01:43:23.936 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.937 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.937 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128689 s, 81.5 MB/s 2024-09-17T01:43:23.959 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.959 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.959 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197236 s, 53.2 MB/s 2024-09-17T01:43:23.976 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.977 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.977 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014125 s, 74.2 MB/s 2024-09-17T01:43:23.995 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:23.995 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:23.995 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155082 s, 67.6 MB/s 2024-09-17T01:43:24.014 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.015 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.015 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162326 s, 64.6 MB/s 2024-09-17T01:43:24.032 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.032 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.032 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143867 s, 72.9 MB/s 2024-09-17T01:43:24.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:24.042 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:24.042 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:24.042 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.26 2024-09-17T01:43:24.042 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:24.042 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:24.042 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:24.042 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:24.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:24.141 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.141 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.141 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012238 s, 85.7 MB/s 2024-09-17T01:43:24.159 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.160 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.160 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157732 s, 66.5 MB/s 2024-09-17T01:43:24.178 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.178 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.178 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153885 s, 68.1 MB/s 2024-09-17T01:43:24.193 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.193 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.193 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114879 s, 91.3 MB/s 2024-09-17T01:43:24.210 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.210 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.210 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141303 s, 74.2 MB/s 2024-09-17T01:43:24.227 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.227 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.228 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142739 s, 73.5 MB/s 2024-09-17T01:43:24.245 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.246 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.246 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01501 s, 69.9 MB/s 2024-09-17T01:43:24.263 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.263 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.263 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137508 s, 76.3 MB/s 2024-09-17T01:43:24.278 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.278 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.278 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012081 s, 86.8 MB/s 2024-09-17T01:43:24.296 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.296 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.296 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014914 s, 70.3 MB/s 2024-09-17T01:43:24.313 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.313 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.313 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014177 s, 74.0 MB/s 2024-09-17T01:43:24.335 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.335 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.335 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184599 s, 56.8 MB/s 2024-09-17T01:43:24.352 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.352 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.352 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140503 s, 74.6 MB/s 2024-09-17T01:43:24.369 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.369 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.369 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140364 s, 74.7 MB/s 2024-09-17T01:43:24.383 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.384 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.384 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112592 s, 93.1 MB/s 2024-09-17T01:43:24.405 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.405 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.405 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184956 s, 56.7 MB/s 2024-09-17T01:43:24.427 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.427 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.427 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186129 s, 56.3 MB/s 2024-09-17T01:43:24.444 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.444 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.444 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140775 s, 74.5 MB/s 2024-09-17T01:43:24.465 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.465 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.465 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173079 s, 60.6 MB/s 2024-09-17T01:43:24.483 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.483 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.483 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152645 s, 68.7 MB/s 2024-09-17T01:43:24.502 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.502 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.502 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157844 s, 66.4 MB/s 2024-09-17T01:43:24.519 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.519 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.519 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142187 s, 73.7 MB/s 2024-09-17T01:43:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154045 s, 68.1 MB/s 2024-09-17T01:43:24.556 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.557 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.557 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156377 s, 67.1 MB/s 2024-09-17T01:43:24.575 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.575 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.575 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155834 s, 67.3 MB/s 2024-09-17T01:43:24.597 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.597 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.597 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182092 s, 57.6 MB/s 2024-09-17T01:43:24.614 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.615 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.615 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147622 s, 71.0 MB/s 2024-09-17T01:43:24.632 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.632 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.632 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143946 s, 72.8 MB/s 2024-09-17T01:43:24.650 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.650 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.650 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148446 s, 70.6 MB/s 2024-09-17T01:43:24.672 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.672 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.672 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182684 s, 57.4 MB/s 2024-09-17T01:43:24.689 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.689 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.689 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141751 s, 74.0 MB/s 2024-09-17T01:43:24.705 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.706 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.706 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134559 s, 77.9 MB/s 2024-09-17T01:43:24.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:24.714 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:24.715 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:24.715 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.27 2024-09-17T01:43:24.715 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:24.715 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:24.715 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:24.715 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:24.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:24.818 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.819 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.819 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180021 s, 58.2 MB/s 2024-09-17T01:43:24.835 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.835 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.835 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013737 s, 76.3 MB/s 2024-09-17T01:43:24.852 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.853 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.853 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143504 s, 73.1 MB/s 2024-09-17T01:43:24.872 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.873 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.873 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139942 s, 74.9 MB/s 2024-09-17T01:43:24.888 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.888 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.888 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141177 s, 74.3 MB/s 2024-09-17T01:43:24.905 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.905 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.905 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144764 s, 72.4 MB/s 2024-09-17T01:43:24.925 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.926 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.926 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170487 s, 61.5 MB/s 2024-09-17T01:43:24.943 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.943 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.944 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148233 s, 70.7 MB/s 2024-09-17T01:43:24.963 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.963 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.963 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163821 s, 64.0 MB/s 2024-09-17T01:43:24.980 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.980 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.980 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140799 s, 74.5 MB/s 2024-09-17T01:43:24.997 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:24.998 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:24.998 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141311 s, 74.2 MB/s 2024-09-17T01:43:25.015 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.016 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.016 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146525 s, 71.6 MB/s 2024-09-17T01:43:25.032 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.033 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.033 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138937 s, 75.5 MB/s 2024-09-17T01:43:25.051 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.051 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.052 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015575 s, 67.3 MB/s 2024-09-17T01:43:25.070 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.071 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.071 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160454 s, 65.4 MB/s 2024-09-17T01:43:25.087 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.088 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.088 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135384 s, 77.5 MB/s 2024-09-17T01:43:25.105 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.105 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.105 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149132 s, 70.3 MB/s 2024-09-17T01:43:25.123 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.123 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.123 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149056 s, 70.3 MB/s 2024-09-17T01:43:25.147 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.148 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.148 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020916 s, 50.1 MB/s 2024-09-17T01:43:25.164 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.164 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.165 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135149 s, 77.6 MB/s 2024-09-17T01:43:25.186 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.187 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.187 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189377 s, 55.4 MB/s 2024-09-17T01:43:25.204 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.204 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.204 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144726 s, 72.5 MB/s 2024-09-17T01:43:25.221 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.221 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.221 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137224 s, 76.4 MB/s 2024-09-17T01:43:25.242 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.242 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.242 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183141 s, 57.3 MB/s 2024-09-17T01:43:25.262 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.262 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.262 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164311 s, 63.8 MB/s 2024-09-17T01:43:25.281 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.281 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.281 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155649 s, 67.4 MB/s 2024-09-17T01:43:25.302 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.302 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.302 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182052 s, 57.6 MB/s 2024-09-17T01:43:25.319 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.319 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.319 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139403 s, 75.2 MB/s 2024-09-17T01:43:25.336 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.337 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.337 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145914 s, 71.9 MB/s 2024-09-17T01:43:25.354 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.354 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.354 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138506 s, 75.7 MB/s 2024-09-17T01:43:25.371 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.371 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.372 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144712 s, 72.5 MB/s 2024-09-17T01:43:25.389 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.389 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.389 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141788 s, 74.0 MB/s 2024-09-17T01:43:25.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:25.398 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:25.398 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:25.398 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.28 2024-09-17T01:43:25.398 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:25.398 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:25.399 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:25.399 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:25.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:25.502 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.502 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.503 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169097 s, 62.0 MB/s 2024-09-17T01:43:25.520 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.520 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.520 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139223 s, 75.3 MB/s 2024-09-17T01:43:25.540 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.540 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.540 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166861 s, 62.8 MB/s 2024-09-17T01:43:25.556 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.556 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.557 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137476 s, 76.3 MB/s 2024-09-17T01:43:25.577 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.577 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.578 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01768 s, 59.3 MB/s 2024-09-17T01:43:25.596 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.597 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.597 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156899 s, 66.8 MB/s 2024-09-17T01:43:25.613 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.613 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.613 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136439 s, 76.9 MB/s 2024-09-17T01:43:25.630 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.630 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.630 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136575 s, 76.8 MB/s 2024-09-17T01:43:25.652 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.652 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.652 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183436 s, 57.2 MB/s 2024-09-17T01:43:25.668 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.669 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.669 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140104 s, 74.8 MB/s 2024-09-17T01:43:25.687 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.687 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.687 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149224 s, 70.3 MB/s 2024-09-17T01:43:25.706 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.706 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.706 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157099 s, 66.7 MB/s 2024-09-17T01:43:25.728 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.728 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.728 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190432 s, 55.1 MB/s 2024-09-17T01:43:25.745 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.745 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.745 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138683 s, 75.6 MB/s 2024-09-17T01:43:25.762 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.762 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.762 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141551 s, 74.1 MB/s 2024-09-17T01:43:25.785 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.785 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.785 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198628 s, 52.8 MB/s 2024-09-17T01:43:25.803 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.803 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.803 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149884 s, 70.0 MB/s 2024-09-17T01:43:25.820 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.821 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.821 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138833 s, 75.5 MB/s 2024-09-17T01:43:25.838 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.838 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.838 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014325 s, 73.2 MB/s 2024-09-17T01:43:25.857 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.857 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.857 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158018 s, 66.4 MB/s 2024-09-17T01:43:25.875 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.875 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.875 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01501 s, 69.9 MB/s 2024-09-17T01:43:25.892 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.892 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.893 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144455 s, 72.6 MB/s 2024-09-17T01:43:25.909 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.910 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.910 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139308 s, 75.3 MB/s 2024-09-17T01:43:25.927 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.927 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.927 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140718 s, 74.5 MB/s 2024-09-17T01:43:25.943 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.943 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.943 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130237 s, 80.5 MB/s 2024-09-17T01:43:25.961 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.961 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.962 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155467 s, 67.4 MB/s 2024-09-17T01:43:25.979 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.979 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.979 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139647 s, 75.1 MB/s 2024-09-17T01:43:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:25.997 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149411 s, 70.2 MB/s 2024-09-17T01:43:26.014 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.014 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.014 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140707 s, 74.5 MB/s 2024-09-17T01:43:26.029 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.029 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.029 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119222 s, 88.0 MB/s 2024-09-17T01:43:26.047 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.047 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.047 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147361 s, 71.2 MB/s 2024-09-17T01:43:26.065 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.065 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.065 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015346 s, 68.3 MB/s 2024-09-17T01:43:26.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:26.074 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:26.075 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:26.075 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.29 2024-09-17T01:43:26.075 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:26.075 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:26.075 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:26.075 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:26.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:26.175 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.175 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.175 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014489 s, 72.4 MB/s 2024-09-17T01:43:26.193 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.193 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.194 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151044 s, 69.4 MB/s 2024-09-17T01:43:26.211 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.211 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.211 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141185 s, 74.3 MB/s 2024-09-17T01:43:26.228 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.229 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.229 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145462 s, 72.1 MB/s 2024-09-17T01:43:26.247 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.247 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.247 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150057 s, 69.9 MB/s 2024-09-17T01:43:26.264 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.264 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.264 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137603 s, 76.2 MB/s 2024-09-17T01:43:26.280 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.281 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.281 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136302 s, 76.9 MB/s 2024-09-17T01:43:26.302 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.302 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.302 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187112 s, 56.0 MB/s 2024-09-17T01:43:26.319 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.319 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.319 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139561 s, 75.1 MB/s 2024-09-17T01:43:26.341 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.342 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.342 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192028 s, 54.6 MB/s 2024-09-17T01:43:26.359 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.359 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.359 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139705 s, 75.1 MB/s 2024-09-17T01:43:26.376 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.376 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.377 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145098 s, 72.3 MB/s 2024-09-17T01:43:26.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.396 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160034 s, 65.5 MB/s 2024-09-17T01:43:26.417 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.417 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.417 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183955 s, 57.0 MB/s 2024-09-17T01:43:26.435 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.435 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.435 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142889 s, 73.4 MB/s 2024-09-17T01:43:26.454 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.454 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.454 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160961 s, 65.1 MB/s 2024-09-17T01:43:26.471 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.472 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.472 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144569 s, 72.5 MB/s 2024-09-17T01:43:26.489 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.489 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.489 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139165 s, 75.3 MB/s 2024-09-17T01:43:26.507 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.507 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.507 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148661 s, 70.5 MB/s 2024-09-17T01:43:26.529 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.529 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.529 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183335 s, 57.2 MB/s 2024-09-17T01:43:26.545 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.546 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.546 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013727 s, 76.4 MB/s 2024-09-17T01:43:26.564 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.565 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.565 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156942 s, 66.8 MB/s 2024-09-17T01:43:26.582 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.582 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.582 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139253 s, 75.3 MB/s 2024-09-17T01:43:26.599 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.599 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.600 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144126 s, 72.8 MB/s 2024-09-17T01:43:26.617 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.617 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.617 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139886 s, 75.0 MB/s 2024-09-17T01:43:26.634 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.634 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.634 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143506 s, 73.1 MB/s 2024-09-17T01:43:26.654 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.655 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.655 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170344 s, 61.6 MB/s 2024-09-17T01:43:26.670 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.670 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.671 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128019 s, 81.9 MB/s 2024-09-17T01:43:26.690 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.690 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.690 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163298 s, 64.2 MB/s 2024-09-17T01:43:26.707 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.707 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.707 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137062 s, 76.5 MB/s 2024-09-17T01:43:26.724 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.724 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.724 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138455 s, 75.7 MB/s 2024-09-17T01:43:26.741 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.741 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.741 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143911 s, 72.9 MB/s 2024-09-17T01:43:26.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:26.750 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:26.750 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:26.751 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.30 2024-09-17T01:43:26.751 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:26.751 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:26.751 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:26.751 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:26.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:26.851 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.851 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.851 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139215 s, 75.3 MB/s 2024-09-17T01:43:26.867 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.867 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.867 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121992 s, 86.0 MB/s 2024-09-17T01:43:26.891 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.891 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.891 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214686 s, 48.8 MB/s 2024-09-17T01:43:26.913 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.913 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.913 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184776 s, 56.7 MB/s 2024-09-17T01:43:26.930 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.930 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.930 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013978 s, 75.0 MB/s 2024-09-17T01:43:26.948 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.948 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.948 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147049 s, 71.3 MB/s 2024-09-17T01:43:26.968 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.968 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.968 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163867 s, 64.0 MB/s 2024-09-17T01:43:26.985 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:26.985 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:26.985 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140429 s, 74.7 MB/s 2024-09-17T01:43:27.003 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.003 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.003 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147647 s, 71.0 MB/s 2024-09-17T01:43:27.020 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.020 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.020 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139948 s, 74.9 MB/s 2024-09-17T01:43:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.041 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180291 s, 58.2 MB/s 2024-09-17T01:43:27.059 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.059 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.059 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149333 s, 70.2 MB/s 2024-09-17T01:43:27.080 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.080 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.081 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177424 s, 59.1 MB/s 2024-09-17T01:43:27.097 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.097 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.097 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138911 s, 75.5 MB/s 2024-09-17T01:43:27.116 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.116 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.116 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158747 s, 66.1 MB/s 2024-09-17T01:43:27.137 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.137 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.137 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175395 s, 59.8 MB/s 2024-09-17T01:43:27.161 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.161 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.161 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020893 s, 50.2 MB/s 2024-09-17T01:43:27.181 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.182 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.182 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181144 s, 57.9 MB/s 2024-09-17T01:43:27.200 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.200 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.200 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149415 s, 70.2 MB/s 2024-09-17T01:43:27.223 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.223 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.223 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201785 s, 52.0 MB/s 2024-09-17T01:43:27.245 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.245 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.245 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187232 s, 56.0 MB/s 2024-09-17T01:43:27.263 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.264 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.264 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158251 s, 66.3 MB/s 2024-09-17T01:43:27.282 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.282 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.282 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015251 s, 68.8 MB/s 2024-09-17T01:43:27.301 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.301 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.301 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156474 s, 67.0 MB/s 2024-09-17T01:43:27.318 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.318 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.318 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137283 s, 76.4 MB/s 2024-09-17T01:43:27.340 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.340 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.340 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189052 s, 55.5 MB/s 2024-09-17T01:43:27.361 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.362 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.362 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186054 s, 56.4 MB/s 2024-09-17T01:43:27.383 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.383 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.384 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182914 s, 57.3 MB/s 2024-09-17T01:43:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.405 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182359 s, 57.5 MB/s 2024-09-17T01:43:27.425 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.425 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.425 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01715 s, 61.1 MB/s 2024-09-17T01:43:27.446 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.446 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.446 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183452 s, 57.2 MB/s 2024-09-17T01:43:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152311 s, 68.8 MB/s 2024-09-17T01:43:27.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:27.474 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:43:27.474 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:43:27.474 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.31 2024-09-17T01:43:27.474 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:43:27.474 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:43:27.474 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:43:27.474 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:43:27.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:43:27.575 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.575 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.575 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156873 s, 66.8 MB/s 2024-09-17T01:43:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.593 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146929 s, 71.4 MB/s 2024-09-17T01:43:27.611 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.611 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.611 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147484 s, 71.1 MB/s 2024-09-17T01:43:27.630 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.630 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.630 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154207 s, 68.0 MB/s 2024-09-17T01:43:27.648 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.648 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.648 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152009 s, 69.0 MB/s 2024-09-17T01:43:27.669 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.669 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.669 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179314 s, 58.5 MB/s 2024-09-17T01:43:27.686 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.686 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.686 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013691 s, 76.6 MB/s 2024-09-17T01:43:27.704 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.704 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.704 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150458 s, 69.7 MB/s 2024-09-17T01:43:27.723 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.723 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.723 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154517 s, 67.9 MB/s 2024-09-17T01:43:27.745 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.745 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.745 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188442 s, 55.6 MB/s 2024-09-17T01:43:27.764 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.764 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.764 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016287 s, 64.4 MB/s 2024-09-17T01:43:27.806 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.806 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.807 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0387204 s, 27.1 MB/s 2024-09-17T01:43:27.825 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.825 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.825 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149191 s, 70.3 MB/s 2024-09-17T01:43:27.844 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.844 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.844 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015312 s, 68.5 MB/s 2024-09-17T01:43:27.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.867 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.867 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184709 s, 56.8 MB/s 2024-09-17T01:43:27.888 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.888 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.888 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177017 s, 59.2 MB/s 2024-09-17T01:43:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147534 s, 71.1 MB/s 2024-09-17T01:43:27.927 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.927 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.927 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169174 s, 62.0 MB/s 2024-09-17T01:43:27.946 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.946 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.946 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153347 s, 68.4 MB/s 2024-09-17T01:43:27.961 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.961 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.961 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118432 s, 88.5 MB/s 2024-09-17T01:43:27.979 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.979 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.979 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143947 s, 72.8 MB/s 2024-09-17T01:43:27.997 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:27.997 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:27.997 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139593 s, 75.1 MB/s 2024-09-17T01:43:28.016 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:28.016 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:28.016 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148753 s, 70.5 MB/s 2024-09-17T01:43:28.035 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:28.035 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:28.035 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015493 s, 67.7 MB/s 2024-09-17T01:43:28.053 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:28.053 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:28.053 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141255 s, 74.2 MB/s 2024-09-17T01:43:28.074 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:28.074 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:28.074 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176171 s, 59.5 MB/s 2024-09-17T01:43:28.094 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:28.094 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:28.095 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161009 s, 65.1 MB/s 2024-09-17T01:43:28.112 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:28.113 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:28.113 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142765 s, 73.4 MB/s 2024-09-17T01:43:28.130 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:28.130 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:28.130 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137983 s, 76.0 MB/s 2024-09-17T01:43:28.154 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:28.154 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:28.154 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198143 s, 52.9 MB/s 2024-09-17T01:43:28.172 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:28.172 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:28.172 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143966 s, 72.8 MB/s 2024-09-17T01:43:28.189 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:43:28.190 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:43:28.190 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139131 s, 75.4 MB/s 2024-09-17T01:43:28.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:43:28.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:43:28.199 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub start /scrub_control_test_path recursive 2024-09-17T01:43:28.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.434+0000 7f2c3cc00640 1 -- 172.21.15.42:0/632487227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c380af4f0 msgr2=0x7f2c3815d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:28.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.434+0000 7f2c3cc00640 1 --2- 172.21.15.42:0/632487227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c380af4f0 0x7f2c3815d6a0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f2c380af900 tx=0x7f2c2802a560 comp rx=0 tx=0).stop 2024-09-17T01:43:28.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.435+0000 7f2c3cc00640 1 -- 172.21.15.42:0/632487227 shutdown_connections 2024-09-17T01:43:28.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.435+0000 7f2c3cc00640 1 --2- 172.21.15.42:0/632487227 >> v2:172.21.15.43:3300/0 conn(0x7f2c380aebf0 0x7f2c3806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.435+0000 7f2c3cc00640 1 --2- 172.21.15.42:0/632487227 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c3806d260 0x7f2c38160210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.435+0000 7f2c3cc00640 1 --2- 172.21.15.42:0/632487227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c380af4f0 0x7f2c3815d6a0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.435+0000 7f2c3cc00640 1 -- 172.21.15.42:0/632487227 >> 172.21.15.42:0/632487227 conn(0x7f2c380b25d0 msgr2=0x7f2c380d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:28.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.435+0000 7f2c3cc00640 1 -- 172.21.15.42:0/632487227 shutdown_connections 2024-09-17T01:43:28.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.435+0000 7f2c3cc00640 1 -- 172.21.15.42:0/632487227 wait complete. 2024-09-17T01:43:28.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.437+0000 7f2c3cc00640 1 Processor -- start 2024-09-17T01:43:28.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.437+0000 7f2c3cc00640 1 -- start start 2024-09-17T01:43:28.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.438+0000 7f2c3cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c3806d260 0x7f2c381f5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.438+0000 7f2c3cc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c380aebf0 0x7f2c38072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.438+0000 7f2c3cc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c380af4f0 0x7f2c381550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.438+0000 7f2c3cc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2c381608d0 con 0x7f2c3806d260 2024-09-17T01:43:28.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.438+0000 7f2c3cc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2c38160750 con 0x7f2c380af4f0 2024-09-17T01:43:28.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.438+0000 7f2c3cc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2c38160a50 con 0x7f2c380aebf0 2024-09-17T01:43:28.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.439+0000 7f2c37400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c3806d260 0x7f2c381f5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.439+0000 7f2c36a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c380aebf0 0x7f2c38072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.439+0000 7f2c37400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c3806d260 0x7f2c381f5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57046/0 (socket says 172.21.15.42:57046) 2024-09-17T01:43:28.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.439+0000 7f2c37400640 1 -- 172.21.15.42:0/303074851 learned_addr learned my addr 172.21.15.42:0/303074851 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:28.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.439+0000 7f2c37e00640 1 --2- 172.21.15.42:0/303074851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c380af4f0 0x7f2c381550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.439+0000 7f2c37400640 1 -- 172.21.15.42:0/303074851 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c380aebf0 msgr2=0x7f2c38072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:28.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.439+0000 7f2c37400640 1 --2- 172.21.15.42:0/303074851 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c380aebf0 0x7f2c38072ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.439+0000 7f2c37400640 1 -- 172.21.15.42:0/303074851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c380af4f0 msgr2=0x7f2c381550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:28.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.439+0000 7f2c37400640 1 --2- 172.21.15.42:0/303074851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c380af4f0 0x7f2c381550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.439+0000 7f2c37400640 1 -- 172.21.15.42:0/303074851 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c380737e0 con 0x7f2c3806d260 2024-09-17T01:43:28.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.440+0000 7f2c37400640 1 --2- 172.21.15.42:0/303074851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c3806d260 0x7f2c381f5590 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f2c28000c00 tx=0x7f2c28003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:28.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.440+0000 7f2c2f400640 1 -- 172.21.15.42:0/303074851 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2803e030 con 0x7f2c3806d260 2024-09-17T01:43:28.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.440+0000 7f2c2f400640 1 -- 172.21.15.42:0/303074851 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c28003e00 con 0x7f2c3806d260 2024-09-17T01:43:28.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.440+0000 7f2c3cc00640 1 -- 172.21.15.42:0/303074851 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c3815de80 con 0x7f2c3806d260 2024-09-17T01:43:28.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.440+0000 7f2c2f400640 1 -- 172.21.15.42:0/303074851 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28035040 con 0x7f2c3806d260 2024-09-17T01:43:28.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.440+0000 7f2c3cc00640 1 -- 172.21.15.42:0/303074851 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c3815e440 con 0x7f2c3806d260 2024-09-17T01:43:28.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.442+0000 7f2c2f400640 1 -- 172.21.15.42:0/303074851 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2c28041030 con 0x7f2c3806d260 2024-09-17T01:43:28.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.443+0000 7f2c2f400640 1 --2- 172.21.15.42:0/303074851 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2c18078bc0 0x7f2c1807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.443+0000 7f2c2f400640 1 -- 172.21.15.42:0/303074851 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f2c280bb5e0 con 0x7f2c3806d260 2024-09-17T01:43:28.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.444+0000 7f2c36a00640 1 --2- 172.21.15.42:0/303074851 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2c18078bc0 0x7f2c1807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.444+0000 7f2c45284740 1 Processor -- start 2024-09-17T01:43:28.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.444+0000 7f2c45284740 1 -- start start 2024-09-17T01:43:28.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.444+0000 7f2c36a00640 1 --2- 172.21.15.42:0/303074851 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2c18078bc0 0x7f2c1807b0d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2c380b1360 tx=0x7f2c2400b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:28.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.446+0000 7f2c45284740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560df434f730 0x560df473c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.446+0000 7f2c45284740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df4326870 0x560df47110b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.446+0000 7f2c45284740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560df432ea50 0x560df47115f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.446+0000 7f2c45284740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560df4669a70 con 0x560df4326870 2024-09-17T01:43:28.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.446+0000 7f2c45284740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560df4658ea0 con 0x560df434f730 2024-09-17T01:43:28.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.446+0000 7f2c45284740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x560df465ccb0 con 0x560df432ea50 2024-09-17T01:43:28.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.446+0000 7f2c36a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df4326870 0x560df47110b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.446+0000 7f2c36a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df4326870 0x560df47110b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57052/0 (socket says 172.21.15.42:57052) 2024-09-17T01:43:28.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.446+0000 7f2c36a00640 1 -- 172.21.15.42:0/1475543717 learned_addr learned my addr 172.21.15.42:0/1475543717 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:28.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.446+0000 7f2c37400640 1 --2- 172.21.15.42:0/1475543717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560df434f730 0x560df473c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.446+0000 7f2c36a00640 1 -- 172.21.15.42:0/1475543717 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560df432ea50 msgr2=0x560df47115f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:28.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.446+0000 7f2c37e00640 1 --2- 172.21.15.42:0/1475543717 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560df432ea50 0x560df47115f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.446+0000 7f2c36a00640 1 --2- 172.21.15.42:0/1475543717 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560df432ea50 0x560df47115f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.446+0000 7f2c36a00640 1 -- 172.21.15.42:0/1475543717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560df434f730 msgr2=0x560df473c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:28.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.446+0000 7f2c36a00640 1 --2- 172.21.15.42:0/1475543717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560df434f730 0x560df473c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.446+0000 7f2c36a00640 1 -- 172.21.15.42:0/1475543717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560df4433ba0 con 0x560df4326870 2024-09-17T01:43:28.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.446+0000 7f2c37400640 1 --2- 172.21.15.42:0/1475543717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560df434f730 0x560df473c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:43:28.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.446+0000 7f2c37e00640 1 --2- 172.21.15.42:0/1475543717 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560df432ea50 0x560df47115f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:43:28.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.447+0000 7f2c36a00640 1 --2- 172.21.15.42:0/1475543717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df4326870 0x560df47110b0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f2c24010f80 tx=0x7f2c24013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcdc1d80babc5934 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:28.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.447+0000 7f2c23400640 1 -- 172.21.15.42:0/1475543717 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2401e620 con 0x560df4326870 2024-09-17T01:43:28.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.447+0000 7f2c23400640 1 -- 172.21.15.42:0/1475543717 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c2401e7c0 con 0x560df4326870 2024-09-17T01:43:28.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.447+0000 7f2c23400640 1 -- 172.21.15.42:0/1475543717 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2401eb70 con 0x560df4326870 2024-09-17T01:43:28.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.448+0000 7f2c45284740 1 -- 172.21.15.42:0/1475543717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df4326870 msgr2=0x560df47110b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:28.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.448+0000 7f2c45284740 1 --2- 172.21.15.42:0/1475543717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df4326870 0x560df47110b0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f2c24010f80 tx=0x7f2c24013000 comp rx=0 tx=0).stop 2024-09-17T01:43:28.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.448+0000 7f2c45284740 1 -- 172.21.15.42:0/1475543717 shutdown_connections 2024-09-17T01:43:28.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.448+0000 7f2c45284740 1 --2- 172.21.15.42:0/1475543717 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560df432ea50 0x560df47115f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.448+0000 7f2c45284740 1 --2- 172.21.15.42:0/1475543717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df4326870 0x560df47110b0 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.448+0000 7f2c45284740 1 --2- 172.21.15.42:0/1475543717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560df434f730 0x560df473c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.448+0000 7f2c45284740 1 -- 172.21.15.42:0/1475543717 >> 172.21.15.42:0/1475543717 conn(0x560df4343880 msgr2=0x560df46f7550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:28.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.448+0000 7f2c45284740 1 -- 172.21.15.42:0/1475543717 shutdown_connections 2024-09-17T01:43:28.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.448+0000 7f2c45284740 1 -- 172.21.15.42:0/1475543717 wait complete. 2024-09-17T01:43:28.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.449+0000 7f2c45284740 1 -- start start 2024-09-17T01:43:28.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.449+0000 7f2c45284740 1 Processor -- start 2024-09-17T01:43:28.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.451+0000 7f2c45284740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560df4326870 0x560df4733bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.451+0000 7f2c45284740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560df432ea50 0x560df4710080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.451+0000 7f2c45284740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df434f730 0x560df4735220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.451+0000 7f2c45284740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560df43c9ae0 con 0x560df434f730 2024-09-17T01:43:28.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.451+0000 7f2c45284740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560df45fe7b0 con 0x560df4326870 2024-09-17T01:43:28.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.451+0000 7f2c45284740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x560df4720060 con 0x560df432ea50 2024-09-17T01:43:28.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.451+0000 7f2c45284740 10 client.0 _ll_register_callbacks cb 0x560df4604890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:43:28.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.451+0000 7f2c37e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df434f730 0x560df4735220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.451+0000 7f2c37e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df434f730 0x560df4735220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57054/0 (socket says 172.21.15.42:57054) 2024-09-17T01:43:28.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.451+0000 7f2c37e00640 1 -- 172.21.15.42:0/3022378529 learned_addr learned my addr 172.21.15.42:0/3022378529 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:28.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.451+0000 7f2c36a00640 1 --2- 172.21.15.42:0/3022378529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560df432ea50 0x560df4710080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.451+0000 7f2c37400640 1 --2- 172.21.15.42:0/3022378529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560df4326870 0x560df4733bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.451+0000 7f2c37e00640 1 -- 172.21.15.42:0/3022378529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560df432ea50 msgr2=0x560df4710080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:28.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.451+0000 7f2c37e00640 1 --2- 172.21.15.42:0/3022378529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560df432ea50 0x560df4710080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.451+0000 7f2c37e00640 1 -- 172.21.15.42:0/3022378529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560df4326870 msgr2=0x560df4733bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:28.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.451+0000 7f2c37e00640 1 --2- 172.21.15.42:0/3022378529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560df4326870 0x560df4733bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.452+0000 7f2c37e00640 1 -- 172.21.15.42:0/3022378529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560df4398a40 con 0x560df434f730 2024-09-17T01:43:28.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.452+0000 7f2c37e00640 1 --2- 172.21.15.42:0/3022378529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df434f730 0x560df4735220 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f2c300126d0 tx=0x7f2c30012b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7169ed6ffd4b824 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:28.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.452+0000 7f2c17e00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:43:28.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.452+0000 7f2c17e00640 1 -- 172.21.15.42:0/3022378529 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30003d80 con 0x560df434f730 2024-09-17T01:43:28.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.452+0000 7f2c17e00640 1 -- 172.21.15.42:0/3022378529 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f2c3001caf0 con 0x560df434f730 2024-09-17T01:43:28.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.452+0000 7f2c45284740 1 -- 172.21.15.42:0/3022378529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c2401e7c0 con 0x560df434f730 2024-09-17T01:43:28.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.452+0000 7f2c17e00640 1 -- 172.21.15.42:0/3022378529 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) ==== 24+0+0 (secure 0 0 0) 0x7f2c3001ccf0 con 0x560df434f730 2024-09-17T01:43:28.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.452+0000 7f2c45284740 10 client.9132 fetch_fsmap learned FSMap version 116 2024-09-17T01:43:28.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.452+0000 7f2c45284740 1 -- 172.21.15.42:0/3022378529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) -- 0x560df4494330 con 0x560df434f730 2024-09-17T01:43:28.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.453+0000 7f2c17e00640 1 -- 172.21.15.42:0/3022378529 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c2401e7c0 con 0x560df434f730 2024-09-17T01:43:28.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.453+0000 7f2c17e00640 1 -- 172.21.15.42:0/3022378529 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 116) ==== 3502+0+0 (secure 0 0 0) 0x7f2c30023050 con 0x560df434f730 2024-09-17T01:43:28.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.453+0000 7f2c45284740 10 client.9132 fetch_fsmap finished waiting for FSMap version 116 2024-09-17T01:43:28.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.453+0000 7f2c45284740 10 client.9132 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-17T01:43:28.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.453+0000 7f2c45284740 20 client.9132 populate_metadata read hostname 'smithi042' 2024-09-17T01:43:28.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.453+0000 7f2c45284740 1 --2- 172.21.15.42:0/3022378529 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x560df430e300 0x560df471fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.453+0000 7f2c45284740 4 client.9132 mds_command: new command op to 8982 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:43:28.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.453+0000 7f2c45284740 1 -- 172.21.15.42:0/3022378529 --> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560df466b9c0 con 0x560df430e300 2024-09-17T01:43:28.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.453+0000 7f2c37400640 1 --2- 172.21.15.42:0/3022378529 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x560df430e300 0x560df471fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.454+0000 7f2c37400640 1 --2- 172.21.15.42:0/3022378529 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x560df430e300 0x560df471fa70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f069f92db94c828 server_cookie=7f65b38c5e489709 in_seq=0 out_seq=0 2024-09-17T01:43:28.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.454+0000 7f2c17e00640 10 client.9132 ms_handle_connect on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:28.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.455+0000 7f2c17e00640 1 -- 172.21.15.42:0/3022378529 <== mds.0 v2:172.21.15.42:6832/3811049376 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560df466b9c0 con 0x560df430e300 2024-09-17T01:43:28.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.455+0000 7f2c17e00640 10 client.9132 handle_command_reply: tid=0 2024-09-17T01:43:28.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.455+0000 7f2c45284740 1 client.9132 shutdown 2024-09-17T01:43:28.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.455+0000 7f2c45284740 1 -- 172.21.15.42:0/3022378529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df434f730 msgr2=0x560df4735220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:28.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.455+0000 7f2c45284740 1 --2- 172.21.15.42:0/3022378529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df434f730 0x560df4735220 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f2c300126d0 tx=0x7f2c30012b90 comp rx=0 tx=0).stop 2024-09-17T01:43:28.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.455+0000 7f2c45284740 1 -- 172.21.15.42:0/3022378529 shutdown_connections 2024-09-17T01:43:28.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.455+0000 7f2c45284740 1 --2- 172.21.15.42:0/3022378529 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x560df430e300 0x560df471fa70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.455+0000 7f2c45284740 1 --2- 172.21.15.42:0/3022378529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df434f730 0x560df4735220 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.455+0000 7f2c45284740 1 --2- 172.21.15.42:0/3022378529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560df432ea50 0x560df4710080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.455+0000 7f2c17e00640 0 client.9132 ms_handle_reset on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:28.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.455+0000 7f2c45284740 1 --2- 172.21.15.42:0/3022378529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560df4326870 0x560df4733bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.455+0000 7f2c45284740 1 -- 172.21.15.42:0/3022378529 >> 172.21.15.42:0/3022378529 conn(0x560df4343880 msgr2=0x560df473c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:28.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.455+0000 7f2c45284740 1 -- 172.21.15.42:0/3022378529 shutdown_connections 2024-09-17T01:43:28.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.455+0000 7f2c45284740 1 -- 172.21.15.42:0/3022378529 wait complete. 2024-09-17T01:43:28.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.455+0000 7f2c45284740 20 client.9132 trim_cache size 0 max 16384 2024-09-17T01:43:28.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.474+0000 7f2c45284740 1 Processor -- start 2024-09-17T01:43:28.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.474+0000 7f2c45284740 1 -- start start 2024-09-17T01:43:28.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.475+0000 7f2c45284740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df4326870 0x560df4734a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.476+0000 7f2c45284740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560df432ea50 0x560df4734fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.476+0000 7f2c45284740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560df434f730 0x560df473c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.476+0000 7f2c45284740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2c38202140 con 0x560df4326870 2024-09-17T01:43:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.476+0000 7f2c45284740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3815fab0 con 0x560df434f730 2024-09-17T01:43:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.476+0000 7f2c45284740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2c381f9d20 con 0x560df432ea50 2024-09-17T01:43:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.476+0000 7f2c37400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df4326870 0x560df4734a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.476+0000 7f2c37400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df4326870 0x560df4734a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57056/0 (socket says 172.21.15.42:57056) 2024-09-17T01:43:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.476+0000 7f2c37400640 1 -- 172.21.15.42:0/285898176 learned_addr learned my addr 172.21.15.42:0/285898176 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.476+0000 7f2c37e00640 1 --2- 172.21.15.42:0/285898176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560df434f730 0x560df473c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.476+0000 7f2c36a00640 1 --2- 172.21.15.42:0/285898176 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560df432ea50 0x560df4734fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.476+0000 7f2c37400640 1 -- 172.21.15.42:0/285898176 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560df432ea50 msgr2=0x560df4734fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.476+0000 7f2c37400640 1 --2- 172.21.15.42:0/285898176 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560df432ea50 0x560df4734fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.476+0000 7f2c37400640 1 -- 172.21.15.42:0/285898176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560df434f730 msgr2=0x560df473c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.476+0000 7f2c37400640 1 --2- 172.21.15.42:0/285898176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560df434f730 0x560df473c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.476+0000 7f2c37400640 1 -- 172.21.15.42:0/285898176 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560df470fa70 con 0x560df4326870 2024-09-17T01:43:28.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.476+0000 7f2c37e00640 1 --2- 172.21.15.42:0/285898176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560df434f730 0x560df473c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:43:28.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.477+0000 7f2c37400640 1 --2- 172.21.15.42:0/285898176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df4326870 0x560df4734a80 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f2c28005fd0 tx=0x7f2c280b9940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=776bcd98af607bf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:28.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.477+0000 7f2c22a00640 1 -- 172.21.15.42:0/285898176 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28048070 con 0x560df4326870 2024-09-17T01:43:28.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.477+0000 7f2c22a00640 1 -- 172.21.15.42:0/285898176 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c28087d70 con 0x560df4326870 2024-09-17T01:43:28.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.477+0000 7f2c22a00640 1 -- 172.21.15.42:0/285898176 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2808cc20 con 0x560df4326870 2024-09-17T01:43:28.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.477+0000 7f2c45284740 1 -- 172.21.15.42:0/285898176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df4326870 msgr2=0x560df4734a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:28.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.477+0000 7f2c45284740 1 --2- 172.21.15.42:0/285898176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df4326870 0x560df4734a80 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f2c28005fd0 tx=0x7f2c280b9940 comp rx=0 tx=0).stop 2024-09-17T01:43:28.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.478+0000 7f2c45284740 1 -- 172.21.15.42:0/285898176 shutdown_connections 2024-09-17T01:43:28.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.478+0000 7f2c45284740 1 --2- 172.21.15.42:0/285898176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560df434f730 0x560df473c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.478+0000 7f2c45284740 1 --2- 172.21.15.42:0/285898176 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560df432ea50 0x560df4734fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.478+0000 7f2c45284740 1 --2- 172.21.15.42:0/285898176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df4326870 0x560df4734a80 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.478+0000 7f2c45284740 1 -- 172.21.15.42:0/285898176 >> 172.21.15.42:0/285898176 conn(0x560df4343880 msgr2=0x560df470fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:28.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.478+0000 7f2c45284740 1 -- 172.21.15.42:0/285898176 shutdown_connections 2024-09-17T01:43:28.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.478+0000 7f2c45284740 1 -- 172.21.15.42:0/285898176 wait complete. 2024-09-17T01:43:28.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.479+0000 7f2c45284740 1 -- start start 2024-09-17T01:43:28.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.479+0000 7f2c45284740 1 Processor -- start 2024-09-17T01:43:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.480+0000 7f2c45284740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df4326870 0x560df47b90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.480+0000 7f2c45284740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560df432ea50 0x560df46f2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.480+0000 7f2c45284740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560df434f730 0x560df46f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.480+0000 7f2c45284740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3815f460 con 0x560df4326870 2024-09-17T01:43:28.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.480+0000 7f2c45284740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560df47bd250 con 0x560df432ea50 2024-09-17T01:43:28.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.480+0000 7f2c45284740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x560df4737e20 con 0x560df434f730 2024-09-17T01:43:28.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.480+0000 7f2c45284740 10 client.0 _ll_register_callbacks cb 0x7f2c30009cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:43:28.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.481+0000 7f2c37400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df4326870 0x560df47b90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.481+0000 7f2c37400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df4326870 0x560df47b90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57058/0 (socket says 172.21.15.42:57058) 2024-09-17T01:43:28.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.481+0000 7f2c37400640 1 -- 172.21.15.42:0/1842155254 learned_addr learned my addr 172.21.15.42:0/1842155254 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:28.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.481+0000 7f2c37e00640 1 --2- 172.21.15.42:0/1842155254 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560df434f730 0x560df46f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.481+0000 7f2c36a00640 1 --2- 172.21.15.42:0/1842155254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560df432ea50 0x560df46f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.481+0000 7f2c37400640 1 -- 172.21.15.42:0/1842155254 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560df434f730 msgr2=0x560df46f27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:28.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.481+0000 7f2c37400640 1 --2- 172.21.15.42:0/1842155254 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560df434f730 0x560df46f27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.481+0000 7f2c37400640 1 -- 172.21.15.42:0/1842155254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560df432ea50 msgr2=0x560df46f2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:28.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.481+0000 7f2c37400640 1 --2- 172.21.15.42:0/1842155254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560df432ea50 0x560df46f2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.481+0000 7f2c37400640 1 -- 172.21.15.42:0/1842155254 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560df4431ea0 con 0x560df4326870 2024-09-17T01:43:28.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.481+0000 7f2c37e00640 1 --2- 172.21.15.42:0/1842155254 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560df434f730 0x560df46f27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:43:28.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.481+0000 7f2c36a00640 1 --2- 172.21.15.42:0/1842155254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560df432ea50 0x560df46f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:43:28.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.481+0000 7f2c37400640 1 --2- 172.21.15.42:0/1842155254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df4326870 0x560df47b90b0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f2c280832d0 tx=0x7f2c28005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=871a069ddeead826 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:28.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.481+0000 7f2c17e00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:43:28.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.482+0000 7f2c17e00640 1 -- 172.21.15.42:0/1842155254 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28048070 con 0x560df4326870 2024-09-17T01:43:28.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.482+0000 7f2c17e00640 1 -- 172.21.15.42:0/1842155254 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f2c2808c790 con 0x560df4326870 2024-09-17T01:43:28.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.482+0000 7f2c45284740 1 -- 172.21.15.42:0/1842155254 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c28087d70 con 0x560df4326870 2024-09-17T01:43:28.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.482+0000 7f2c17e00640 1 -- 172.21.15.42:0/1842155254 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) ==== 24+0+0 (secure 0 0 0) 0x7f2c2808a2b0 con 0x560df4326870 2024-09-17T01:43:28.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.482+0000 7f2c45284740 10 client.9138 fetch_fsmap learned FSMap version 116 2024-09-17T01:43:28.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.482+0000 7f2c45284740 1 -- 172.21.15.42:0/1842155254 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) -- 0x560df47bcf90 con 0x560df4326870 2024-09-17T01:43:28.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.482+0000 7f2c17e00640 1 -- 172.21.15.42:0/1842155254 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c28087d70 con 0x560df4326870 2024-09-17T01:43:28.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.482+0000 7f2c17e00640 1 -- 172.21.15.42:0/1842155254 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 116) ==== 3502+0+0 (secure 0 0 0) 0x7f2c280825a0 con 0x560df4326870 2024-09-17T01:43:28.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.482+0000 7f2c45284740 10 client.9138 fetch_fsmap finished waiting for FSMap version 116 2024-09-17T01:43:28.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.482+0000 7f2c45284740 10 client.9138 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-17T01:43:28.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.482+0000 7f2c45284740 20 client.9138 populate_metadata read hostname 'smithi042' 2024-09-17T01:43:28.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.482+0000 7f2c45284740 1 --2- 172.21.15.42:0/1842155254 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x560df473cb60 0x560df47bbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.482+0000 7f2c45284740 4 client.9138 mds_command: new command op to 8982 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-17T01:43:28.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.482+0000 7f2c45284740 1 -- 172.21.15.42:0/1842155254 --> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x560df4667470 con 0x560df473cb60 2024-09-17T01:43:28.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.483+0000 7f2c36a00640 1 --2- 172.21.15.42:0/1842155254 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x560df473cb60 0x560df47bbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.483+0000 7f2c36a00640 1 --2- 172.21.15.42:0/1842155254 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x560df473cb60 0x560df47bbef0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db1419391cbb2855 server_cookie=6d555e4f49f1683a in_seq=0 out_seq=0 2024-09-17T01:43:28.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.483+0000 7f2c17e00640 10 client.9138 ms_handle_connect on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:28.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.486+0000 7f2c17e00640 1 -- 172.21.15.42:0/1842155254 <== mds.0 v2:172.21.15.42:6832/3811049376 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560df4667470 con 0x560df473cb60 2024-09-17T01:43:28.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.486+0000 7f2c17e00640 10 client.9138 handle_command_reply: tid=0 2024-09-17T01:43:28.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.486+0000 7f2c45284740 1 client.9138 shutdown 2024-09-17T01:43:28.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.486+0000 7f2c45284740 1 -- 172.21.15.42:0/1842155254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df4326870 msgr2=0x560df47b90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:28.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.486+0000 7f2c45284740 1 --2- 172.21.15.42:0/1842155254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df4326870 0x560df47b90b0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f2c280832d0 tx=0x7f2c28005ef0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.486+0000 7f2c45284740 1 -- 172.21.15.42:0/1842155254 shutdown_connections 2024-09-17T01:43:28.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.486+0000 7f2c45284740 1 --2- 172.21.15.42:0/1842155254 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x560df473cb60 0x560df47bbef0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.486+0000 7f2c45284740 1 --2- 172.21.15.42:0/1842155254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560df432ea50 0x560df46f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.486+0000 7f2c45284740 1 --2- 172.21.15.42:0/1842155254 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560df434f730 0x560df46f27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.486+0000 7f2c45284740 1 --2- 172.21.15.42:0/1842155254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560df4326870 0x560df47b90b0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.486+0000 7f2c45284740 1 -- 172.21.15.42:0/1842155254 >> 172.21.15.42:0/1842155254 conn(0x560df4343880 msgr2=0x560df473c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:28.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.486+0000 7f2c17e00640 0 client.9138 ms_handle_reset on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:28.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.487+0000 7f2c45284740 1 -- 172.21.15.42:0/1842155254 shutdown_connections 2024-09-17T01:43:28.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.487+0000 7f2c45284740 1 -- 172.21.15.42:0/1842155254 wait complete. 2024-09-17T01:43:28.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.487+0000 7f2c45284740 20 client.9138 trim_cache size 0 max 16384 2024-09-17T01:43:28.486 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:43:28.486 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-17T01:43:28.486 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "b7cf205b-474d-4b2b-864d-637bc207bb9a", 2024-09-17T01:43:28.486 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-17T01:43:28.486 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:43:28.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.487+0000 7f2c3cc00640 1 -- 172.21.15.42:0/303074851 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2c18078bc0 msgr2=0x7f2c1807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:28.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.487+0000 7f2c3cc00640 1 --2- 172.21.15.42:0/303074851 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2c18078bc0 0x7f2c1807b0d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2c380b1360 tx=0x7f2c2400b2e0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.488+0000 7f2c3cc00640 1 -- 172.21.15.42:0/303074851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c3806d260 msgr2=0x7f2c381f5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:28.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.488+0000 7f2c3cc00640 1 --2- 172.21.15.42:0/303074851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c3806d260 0x7f2c381f5590 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f2c28000c00 tx=0x7f2c28003910 comp rx=0 tx=0).stop 2024-09-17T01:43:28.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.488+0000 7f2c3cc00640 1 -- 172.21.15.42:0/303074851 shutdown_connections 2024-09-17T01:43:28.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.488+0000 7f2c3cc00640 1 --2- 172.21.15.42:0/303074851 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2c18078bc0 0x7f2c1807b0d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.488+0000 7f2c3cc00640 1 --2- 172.21.15.42:0/303074851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c380af4f0 0x7f2c381550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.488+0000 7f2c3cc00640 1 --2- 172.21.15.42:0/303074851 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c380aebf0 0x7f2c38072ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.488+0000 7f2c3cc00640 1 --2- 172.21.15.42:0/303074851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c3806d260 0x7f2c381f5590 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.488+0000 7f2c3cc00640 1 -- 172.21.15.42:0/303074851 >> 172.21.15.42:0/303074851 conn(0x7f2c380b25d0 msgr2=0x7f2c380ccad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:28.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.488+0000 7f2c3cc00640 1 -- 172.21.15.42:0/303074851 shutdown_connections 2024-09-17T01:43:28.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.488+0000 7f2c3cc00640 1 -- 172.21.15.42:0/303074851 wait complete. 2024-09-17T01:43:28.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:43:28.515 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub pause 2024-09-17T01:43:28.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.784+0000 7f76dfe00640 1 -- 172.21.15.42:0/362311198 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76e00b6c60 msgr2=0x7f76e00b1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:28.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.784+0000 7f76dfe00640 1 --2- 172.21.15.42:0/362311198 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76e00b6c60 0x7f76e00b1eb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f76cc005fd0 tx=0x7f76cc02a540 comp rx=0 tx=0).stop 2024-09-17T01:43:28.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.784+0000 7f76dfe00640 1 -- 172.21.15.42:0/362311198 shutdown_connections 2024-09-17T01:43:28.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.784+0000 7f76dfe00640 1 --2- 172.21.15.42:0/362311198 >> v2:172.21.15.43:3300/0 conn(0x7f76e00b23f0 0x7f76e01663e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.784+0000 7f76dfe00640 1 --2- 172.21.15.42:0/362311198 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76e00b6c60 0x7f76e00b1eb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.784+0000 7f76dfe00640 1 -- 172.21.15.42:0/362311198 >> 172.21.15.42:0/362311198 conn(0x7f76e009ba30 msgr2=0x7f76e00b4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:28.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.784+0000 7f76dfe00640 1 -- 172.21.15.42:0/362311198 shutdown_connections 2024-09-17T01:43:28.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.784+0000 7f76dfe00640 1 -- 172.21.15.42:0/362311198 wait complete. 2024-09-17T01:43:28.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.787+0000 7f76dfe00640 1 Processor -- start 2024-09-17T01:43:28.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.787+0000 7f76dfe00640 1 -- start start 2024-09-17T01:43:28.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.789+0000 7f76dfe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76e00b23f0 0x7f76e014bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.789+0000 7f76dfe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76e00b6850 0x7f76e015b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.789+0000 7f76dfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76e00b6c60 0x7f76e015b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.789+0000 7f76dfe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f76e0166aa0 con 0x7f76e00b6c60 2024-09-17T01:43:28.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.789+0000 7f76dfe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f76e0166920 con 0x7f76e00b23f0 2024-09-17T01:43:28.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.789+0000 7f76dfe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f76e0166c20 con 0x7f76e00b6850 2024-09-17T01:43:28.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.789+0000 7f76dea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76e00b23f0 0x7f76e014bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.789+0000 7f76de000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76e00b6850 0x7f76e015b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.789+0000 7f76dea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76e00b23f0 0x7f76e014bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:37906/0 (socket says 172.21.15.42:37906) 2024-09-17T01:43:28.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.789+0000 7f76dea00640 1 -- 172.21.15.42:0/1978227512 learned_addr learned my addr 172.21.15.42:0/1978227512 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:28.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.789+0000 7f76df400640 1 --2- 172.21.15.42:0/1978227512 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76e00b6c60 0x7f76e015b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.790+0000 7f76de000640 1 -- 172.21.15.42:0/1978227512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76e00b23f0 msgr2=0x7f76e014bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:28.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.790+0000 7f76de000640 1 --2- 172.21.15.42:0/1978227512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76e00b23f0 0x7f76e014bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.790+0000 7f76de000640 1 -- 172.21.15.42:0/1978227512 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76e00b6c60 msgr2=0x7f76e015b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:28.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.790+0000 7f76de000640 1 --2- 172.21.15.42:0/1978227512 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76e00b6c60 0x7f76e015b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.790+0000 7f76de000640 1 -- 172.21.15.42:0/1978227512 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e0165f40 con 0x7f76e00b6850 2024-09-17T01:43:28.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.790+0000 7f76dea00640 1 --2- 172.21.15.42:0/1978227512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76e00b23f0 0x7f76e014bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:43:28.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.790+0000 7f76de000640 1 --2- 172.21.15.42:0/1978227512 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76e00b6850 0x7f76e015b020 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f76cc031000 tx=0x7f76cc0038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:28.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.790+0000 7f76d6a00640 1 -- 172.21.15.42:0/1978227512 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc03e030 con 0x7f76e00b6850 2024-09-17T01:43:28.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.790+0000 7f76d6a00640 1 -- 172.21.15.42:0/1978227512 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76cc003db0 con 0x7f76e00b6850 2024-09-17T01:43:28.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.790+0000 7f76dfe00640 1 -- 172.21.15.42:0/1978227512 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76e0152ec0 con 0x7f76e00b6850 2024-09-17T01:43:28.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.791+0000 7f76d6a00640 1 -- 172.21.15.42:0/1978227512 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc035040 con 0x7f76e00b6850 2024-09-17T01:43:28.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.791+0000 7f76dfe00640 1 -- 172.21.15.42:0/1978227512 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f76e0153480 con 0x7f76e00b6850 2024-09-17T01:43:28.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.793+0000 7f76d6a00640 1 -- 172.21.15.42:0/1978227512 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f76cc041030 con 0x7f76e00b6850 2024-09-17T01:43:28.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.794+0000 7f76eca05740 1 Processor -- start 2024-09-17T01:43:28.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.795+0000 7f76eca05740 1 -- start start 2024-09-17T01:43:28.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.795+0000 7f76d6a00640 1 --2- 172.21.15.42:0/1978227512 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f76c0078b90 0x7f76c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.795+0000 7f76d6a00640 1 -- 172.21.15.42:0/1978227512 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f76cc0bb470 con 0x7f76e00b6850 2024-09-17T01:43:28.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.796+0000 7f76df400640 1 --2- 172.21.15.42:0/1978227512 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f76c0078b90 0x7f76c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.796+0000 7f76eca05740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601431ae390 0x56014359d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.796+0000 7f76eca05740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5601431854d0 0x560143580530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.796+0000 7f76eca05740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56014318d6b0 0x560143580a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.796+0000 7f76eca05740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560143469c10 con 0x5601431ae390 2024-09-17T01:43:28.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.796+0000 7f76eca05740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5601434c89f0 con 0x5601431854d0 2024-09-17T01:43:28.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.796+0000 7f76eca05740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5601434b7e20 con 0x56014318d6b0 2024-09-17T01:43:28.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.797+0000 7f76df400640 1 --2- 172.21.15.42:0/1978227512 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f76c0078b90 0x7f76c007b0a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f76d80099e0 tx=0x7f76d8009500 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:28.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.797+0000 7f76dea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601431ae390 0x56014359d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.797+0000 7f76dea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601431ae390 0x56014359d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57078/0 (socket says 172.21.15.42:57078) 2024-09-17T01:43:28.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.797+0000 7f76dea00640 1 -- 172.21.15.42:0/241978063 learned_addr learned my addr 172.21.15.42:0/241978063 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:28.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.797+0000 7f76de000640 1 --2- 172.21.15.42:0/241978063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5601431854d0 0x560143580530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.797+0000 7f76df400640 1 --2- 172.21.15.42:0/241978063 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56014318d6b0 0x560143580a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.797+0000 7f76dea00640 1 -- 172.21.15.42:0/241978063 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56014318d6b0 msgr2=0x560143580a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:28.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.798+0000 7f76dea00640 1 --2- 172.21.15.42:0/241978063 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56014318d6b0 0x560143580a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.798+0000 7f76dea00640 1 -- 172.21.15.42:0/241978063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5601431854d0 msgr2=0x560143580530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:28.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.798+0000 7f76dea00640 1 --2- 172.21.15.42:0/241978063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5601431854d0 0x560143580530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.798+0000 7f76dea00640 1 -- 172.21.15.42:0/241978063 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601432907d0 con 0x5601431ae390 2024-09-17T01:43:28.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.798+0000 7f76de000640 1 --2- 172.21.15.42:0/241978063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5601431854d0 0x560143580530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:43:28.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.798+0000 7f76dea00640 1 --2- 172.21.15.42:0/241978063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601431ae390 0x56014359d860 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f76d0001d10 tx=0x7f76d0007e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805021cd98783d10 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:28.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.798+0000 7f76cb400640 1 -- 172.21.15.42:0/241978063 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d00050d0 con 0x5601431ae390 2024-09-17T01:43:28.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.798+0000 7f76cb400640 1 -- 172.21.15.42:0/241978063 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76d0018070 con 0x5601431ae390 2024-09-17T01:43:28.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.798+0000 7f76cb400640 1 -- 172.21.15.42:0/241978063 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d00035f0 con 0x5601431ae390 2024-09-17T01:43:28.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.800+0000 7f76eca05740 1 -- 172.21.15.42:0/241978063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601431ae390 msgr2=0x56014359d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:28.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.800+0000 7f76eca05740 1 --2- 172.21.15.42:0/241978063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601431ae390 0x56014359d860 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f76d0001d10 tx=0x7f76d0007e70 comp rx=0 tx=0).stop 2024-09-17T01:43:28.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.800+0000 7f76eca05740 1 -- 172.21.15.42:0/241978063 shutdown_connections 2024-09-17T01:43:28.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.800+0000 7f76eca05740 1 --2- 172.21.15.42:0/241978063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5601431854d0 0x560143580530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.800+0000 7f76eca05740 1 --2- 172.21.15.42:0/241978063 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56014318d6b0 0x560143580a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.800+0000 7f76eca05740 1 --2- 172.21.15.42:0/241978063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601431ae390 0x56014359d860 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.800+0000 7f76eca05740 1 -- 172.21.15.42:0/241978063 >> 172.21.15.42:0/241978063 conn(0x5601431a24e0 msgr2=0x560143556750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:28.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.800+0000 7f76eca05740 1 -- 172.21.15.42:0/241978063 shutdown_connections 2024-09-17T01:43:28.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.800+0000 7f76eca05740 1 -- 172.21.15.42:0/241978063 wait complete. 2024-09-17T01:43:28.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.802+0000 7f76eca05740 1 -- start start 2024-09-17T01:43:28.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.802+0000 7f76eca05740 1 Processor -- start 2024-09-17T01:43:28.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.805+0000 7f76eca05740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601431854d0 0x560143598e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.805+0000 7f76eca05740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56014318d6b0 0x56014356e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.805+0000 7f76eca05740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5601431ae390 0x5601435966d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.805+0000 7f76eca05740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56014345d790 con 0x5601431854d0 2024-09-17T01:43:28.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.805+0000 7f76eca05740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5601434bbc30 con 0x56014318d6b0 2024-09-17T01:43:28.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.805+0000 7f76eca05740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x560143228740 con 0x5601431ae390 2024-09-17T01:43:28.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.805+0000 7f76eca05740 10 client.0 _ll_register_callbacks cb 0x56014346d260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:43:28.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.805+0000 7f76de000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56014318d6b0 0x56014356e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.805+0000 7f76de000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56014318d6b0 0x56014356e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:37914/0 (socket says 172.21.15.42:37914) 2024-09-17T01:43:28.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.805+0000 7f76de000640 1 -- 172.21.15.42:0/2304944382 learned_addr learned my addr 172.21.15.42:0/2304944382 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:28.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.805+0000 7f76dea00640 1 --2- 172.21.15.42:0/2304944382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601431854d0 0x560143598e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.805+0000 7f76df400640 1 --2- 172.21.15.42:0/2304944382 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5601431ae390 0x5601435966d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.806+0000 7f76de000640 1 -- 172.21.15.42:0/2304944382 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5601431ae390 msgr2=0x5601435966d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:28.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.806+0000 7f76de000640 1 --2- 172.21.15.42:0/2304944382 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5601431ae390 0x5601435966d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.806+0000 7f76de000640 1 -- 172.21.15.42:0/2304944382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601431854d0 msgr2=0x560143598e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:28.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.806+0000 7f76de000640 1 --2- 172.21.15.42:0/2304944382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601431854d0 0x560143598e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.806+0000 7f76de000640 1 -- 172.21.15.42:0/2304944382 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601431f76a0 con 0x56014318d6b0 2024-09-17T01:43:28.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.806+0000 7f76de000640 1 --2- 172.21.15.42:0/2304944382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56014318d6b0 0x56014356e770 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f76cc082ec0 tx=0x7f76cc07f6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fca4eb946c3cebb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:28.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.806+0000 7f76bfe00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-17T01:43:28.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.806+0000 7f76bfe00640 1 -- 172.21.15.42:0/2304944382 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc0a9020 con 0x56014318d6b0 2024-09-17T01:43:28.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.807+0000 7f76bfe00640 1 -- 172.21.15.42:0/2304944382 <== mon.1 v2:172.21.15.43:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f76cc08c8a0 con 0x56014318d6b0 2024-09-17T01:43:28.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.807+0000 7f76eca05740 1 -- 172.21.15.42:0/2304944382 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76d0018070 con 0x56014318d6b0 2024-09-17T01:43:28.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.807+0000 7f76bfe00640 1 -- 172.21.15.42:0/2304944382 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) ==== 24+0+0 (secure 0 0 0) 0x7f76cc048040 con 0x56014318d6b0 2024-09-17T01:43:28.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.807+0000 7f76eca05740 10 client.8521 fetch_fsmap learned FSMap version 116 2024-09-17T01:43:28.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.807+0000 7f76eca05740 1 -- 172.21.15.42:0/2304944382 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) -- 0x5601432f0f60 con 0x56014318d6b0 2024-09-17T01:43:28.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.807+0000 7f76bfe00640 1 -- 172.21.15.42:0/2304944382 <== mon.1 v2:172.21.15.43:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76d0018070 con 0x56014318d6b0 2024-09-17T01:43:28.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.807+0000 7f76bfe00640 1 -- 172.21.15.42:0/2304944382 <== mon.1 v2:172.21.15.43:3300/0 5 ==== fsmap(e 116) ==== 3502+0+0 (secure 0 0 0) 0x7f76cc09d150 con 0x56014318d6b0 2024-09-17T01:43:28.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.807+0000 7f76eca05740 10 client.8521 fetch_fsmap finished waiting for FSMap version 116 2024-09-17T01:43:28.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.807+0000 7f76eca05740 10 client.8521 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-17T01:43:28.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.807+0000 7f76eca05740 20 client.8521 populate_metadata read hostname 'smithi042' 2024-09-17T01:43:28.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.807+0000 7f76eca05740 1 --2- 172.21.15.42:0/2304944382 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x56014316cf60 0x5601435ad9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.807+0000 7f76eca05740 4 client.8521 mds_command: new command op to 8982 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:43:28.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.807+0000 7f76eca05740 1 -- 172.21.15.42:0/2304944382 --> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601434ca940 con 0x56014316cf60 2024-09-17T01:43:28.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.808+0000 7f76dea00640 1 --2- 172.21.15.42:0/2304944382 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x56014316cf60 0x5601435ad9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.808+0000 7f76bfe00640 10 client.8521 ms_handle_connect on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:28.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.808+0000 7f76dea00640 1 --2- 172.21.15.42:0/2304944382 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x56014316cf60 0x5601435ad9c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe64cbb89d66658f server_cookie=179b1f8333f7c061 in_seq=0 out_seq=0 2024-09-17T01:43:28.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.811+0000 7f76bfe00640 1 -- 172.21.15.42:0/2304944382 <== mds.0 v2:172.21.15.42:6832/3811049376 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5601434ca940 con 0x56014316cf60 2024-09-17T01:43:28.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.811+0000 7f76bfe00640 10 client.8521 handle_command_reply: tid=0 2024-09-17T01:43:28.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.811+0000 7f76eca05740 1 client.8521 shutdown 2024-09-17T01:43:28.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.811+0000 7f76eca05740 1 -- 172.21.15.42:0/2304944382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56014318d6b0 msgr2=0x56014356e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:28.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.811+0000 7f76eca05740 1 --2- 172.21.15.42:0/2304944382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56014318d6b0 0x56014356e770 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f76cc082ec0 tx=0x7f76cc07f6b0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.811+0000 7f76eca05740 1 -- 172.21.15.42:0/2304944382 shutdown_connections 2024-09-17T01:43:28.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.811+0000 7f76eca05740 1 --2- 172.21.15.42:0/2304944382 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x56014316cf60 0x5601435ad9c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.812+0000 7f76eca05740 1 --2- 172.21.15.42:0/2304944382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56014318d6b0 0x56014356e770 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.812+0000 7f76eca05740 1 --2- 172.21.15.42:0/2304944382 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5601431ae390 0x5601435966d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.812+0000 7f76eca05740 1 --2- 172.21.15.42:0/2304944382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601431854d0 0x560143598e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.812+0000 7f76eca05740 1 -- 172.21.15.42:0/2304944382 >> 172.21.15.42:0/2304944382 conn(0x5601431a24e0 msgr2=0x56014356fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:28.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.812+0000 7f76bfe00640 0 client.8521 ms_handle_reset on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:28.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.812+0000 7f76eca05740 1 -- 172.21.15.42:0/2304944382 shutdown_connections 2024-09-17T01:43:28.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.812+0000 7f76eca05740 1 -- 172.21.15.42:0/2304944382 wait complete. 2024-09-17T01:43:28.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.812+0000 7f76eca05740 20 client.8521 trim_cache size 0 max 16384 2024-09-17T01:43:28.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.836+0000 7f76eca05740 1 Processor -- start 2024-09-17T01:43:28.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.836+0000 7f76eca05740 1 -- start start 2024-09-17T01:43:28.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.838+0000 7f76eca05740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601431854d0 0x56014359b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.838+0000 7f76eca05740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56014318d6b0 0x560143557810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.838+0000 7f76eca05740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5601431ae390 0x5601435be0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.838+0000 7f76eca05740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f76e0201fb0 con 0x5601431854d0 2024-09-17T01:43:28.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.838+0000 7f76eca05740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f76e02010b0 con 0x56014318d6b0 2024-09-17T01:43:28.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.838+0000 7f76eca05740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f76e0152540 con 0x5601431ae390 2024-09-17T01:43:28.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.838+0000 7f76dea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601431854d0 0x56014359b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.839+0000 7f76dea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601431854d0 0x56014359b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57086/0 (socket says 172.21.15.42:57086) 2024-09-17T01:43:28.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.839+0000 7f76dea00640 1 -- 172.21.15.42:0/4013882763 learned_addr learned my addr 172.21.15.42:0/4013882763 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:28.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.839+0000 7f76de000640 1 --2- 172.21.15.42:0/4013882763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56014318d6b0 0x560143557810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.839+0000 7f76df400640 1 --2- 172.21.15.42:0/4013882763 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5601431ae390 0x5601435be0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.839+0000 7f76dea00640 1 -- 172.21.15.42:0/4013882763 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5601431ae390 msgr2=0x5601435be0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:28.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.839+0000 7f76dea00640 1 --2- 172.21.15.42:0/4013882763 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5601431ae390 0x5601435be0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.839+0000 7f76dea00640 1 -- 172.21.15.42:0/4013882763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56014318d6b0 msgr2=0x560143557810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:28.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.839+0000 7f76dea00640 1 --2- 172.21.15.42:0/4013882763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56014318d6b0 0x560143557810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.839+0000 7f76dea00640 1 -- 172.21.15.42:0/4013882763 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56014328ead0 con 0x5601431854d0 2024-09-17T01:43:28.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.839+0000 7f76dea00640 1 --2- 172.21.15.42:0/4013882763 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601431854d0 0x56014359b040 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f76d00018e0 tx=0x7f76d0001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86a11eb75d76a84 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:28.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.840+0000 7f76caa00640 1 -- 172.21.15.42:0/4013882763 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d002c040 con 0x5601431854d0 2024-09-17T01:43:28.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.840+0000 7f76caa00640 1 -- 172.21.15.42:0/4013882763 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76d0018030 con 0x5601431854d0 2024-09-17T01:43:28.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.840+0000 7f76caa00640 1 -- 172.21.15.42:0/4013882763 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d0003a90 con 0x5601431854d0 2024-09-17T01:43:28.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.841+0000 7f76eca05740 1 -- 172.21.15.42:0/4013882763 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601431854d0 msgr2=0x56014359b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:28.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.841+0000 7f76eca05740 1 --2- 172.21.15.42:0/4013882763 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601431854d0 0x56014359b040 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f76d00018e0 tx=0x7f76d0001080 comp rx=0 tx=0).stop 2024-09-17T01:43:28.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.841+0000 7f76eca05740 1 -- 172.21.15.42:0/4013882763 shutdown_connections 2024-09-17T01:43:28.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.841+0000 7f76eca05740 1 --2- 172.21.15.42:0/4013882763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56014318d6b0 0x560143557810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.841+0000 7f76eca05740 1 --2- 172.21.15.42:0/4013882763 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5601431ae390 0x5601435be0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.841+0000 7f76eca05740 1 --2- 172.21.15.42:0/4013882763 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601431854d0 0x56014359b040 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.841+0000 7f76eca05740 1 -- 172.21.15.42:0/4013882763 >> 172.21.15.42:0/4013882763 conn(0x5601431a24e0 msgr2=0x560143580530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:28.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.841+0000 7f76eca05740 1 -- 172.21.15.42:0/4013882763 shutdown_connections 2024-09-17T01:43:28.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.841+0000 7f76eca05740 1 -- 172.21.15.42:0/4013882763 wait complete. 2024-09-17T01:43:28.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.842+0000 7f76eca05740 1 -- start start 2024-09-17T01:43:28.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.842+0000 7f76eca05740 1 Processor -- start 2024-09-17T01:43:28.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.844+0000 7f76eca05740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5601431854d0 0x56014357cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.844+0000 7f76eca05740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56014318d6b0 0x560143618b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.845+0000 7f76eca05740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5601431ae390 0x5601436190b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.845+0000 7f76eca05740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f76e01f96d0 con 0x56014318d6b0 2024-09-17T01:43:28.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.845+0000 7f76eca05740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56014359de10 con 0x5601431854d0 2024-09-17T01:43:28.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.845+0000 7f76eca05740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x560143595eb0 con 0x5601431ae390 2024-09-17T01:43:28.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.845+0000 7f76eca05740 10 client.0 _ll_register_callbacks cb 0x7f76cc0095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:43:28.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.845+0000 7f76dea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5601431854d0 0x56014357cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.845+0000 7f76de000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56014318d6b0 0x560143618b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.845+0000 7f76dea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5601431854d0 0x56014357cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:37928/0 (socket says 172.21.15.42:37928) 2024-09-17T01:43:28.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.845+0000 7f76dea00640 1 -- 172.21.15.42:0/2363236907 learned_addr learned my addr 172.21.15.42:0/2363236907 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:28.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.845+0000 7f76df400640 1 --2- 172.21.15.42:0/2363236907 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5601431ae390 0x5601436190b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.845+0000 7f76dea00640 1 -- 172.21.15.42:0/2363236907 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5601431ae390 msgr2=0x5601436190b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:28.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.845+0000 7f76dea00640 1 --2- 172.21.15.42:0/2363236907 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5601431ae390 0x5601436190b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.845+0000 7f76dea00640 1 -- 172.21.15.42:0/2363236907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56014318d6b0 msgr2=0x560143618b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:28.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.845+0000 7f76dea00640 1 --2- 172.21.15.42:0/2363236907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56014318d6b0 0x560143618b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.845+0000 7f76dea00640 1 -- 172.21.15.42:0/2363236907 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601436195f0 con 0x5601431854d0 2024-09-17T01:43:28.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.845+0000 7f76de000640 1 --2- 172.21.15.42:0/2363236907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56014318d6b0 0x560143618b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:43:28.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.846+0000 7f76dea00640 1 --2- 172.21.15.42:0/2363236907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5601431854d0 0x56014357cf30 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f76d0001230 tx=0x7f76d000fae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c67156125bd1733e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:28.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.846+0000 7f76bfe00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-17T01:43:28.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.846+0000 7f76bfe00640 1 -- 172.21.15.42:0/2363236907 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d002c040 con 0x5601431854d0 2024-09-17T01:43:28.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.846+0000 7f76bfe00640 1 -- 172.21.15.42:0/2363236907 <== mon.1 v2:172.21.15.43:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f76d0007a70 con 0x5601431854d0 2024-09-17T01:43:28.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.846+0000 7f76eca05740 1 -- 172.21.15.42:0/2363236907 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76d0018030 con 0x5601431854d0 2024-09-17T01:43:28.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.847+0000 7f76bfe00640 1 -- 172.21.15.42:0/2363236907 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) ==== 24+0+0 (secure 0 0 0) 0x7f76d00069b0 con 0x5601431854d0 2024-09-17T01:43:28.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.847+0000 7f76eca05740 10 client.8527 fetch_fsmap learned FSMap version 116 2024-09-17T01:43:28.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.847+0000 7f76eca05740 1 -- 172.21.15.42:0/2363236907 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) -- 0x56014361cf00 con 0x5601431854d0 2024-09-17T01:43:28.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.847+0000 7f76bfe00640 1 -- 172.21.15.42:0/2363236907 <== mon.1 v2:172.21.15.43:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76d0018030 con 0x5601431854d0 2024-09-17T01:43:28.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.847+0000 7f76bfe00640 1 -- 172.21.15.42:0/2363236907 <== mon.1 v2:172.21.15.43:3300/0 5 ==== fsmap(e 116) ==== 3502+0+0 (secure 0 0 0) 0x7f76d0006b50 con 0x5601431854d0 2024-09-17T01:43:28.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.847+0000 7f76eca05740 10 client.8527 fetch_fsmap finished waiting for FSMap version 116 2024-09-17T01:43:28.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.847+0000 7f76eca05740 10 client.8527 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-17T01:43:28.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.847+0000 7f76eca05740 20 client.8527 populate_metadata read hostname 'smithi042' 2024-09-17T01:43:28.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.847+0000 7f76eca05740 1 --2- 172.21.15.42:0/2363236907 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x56014359cde0 0x56014359d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:28.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.847+0000 7f76eca05740 4 client.8527 mds_command: new command op to 8982 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-17T01:43:28.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.847+0000 7f76eca05740 1 -- 172.21.15.42:0/2363236907 --> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x5601434c63f0 con 0x56014359cde0 2024-09-17T01:43:28.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.847+0000 7f76de000640 1 --2- 172.21.15.42:0/2363236907 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x56014359cde0 0x56014359d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:28.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.848+0000 7f76de000640 1 --2- 172.21.15.42:0/2363236907 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x56014359cde0 0x56014359d1f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ef0f299fdce849 server_cookie=8524f0fbe400af50 in_seq=0 out_seq=0 2024-09-17T01:43:28.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.848+0000 7f76bfe00640 10 client.8527 ms_handle_connect on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:28.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.862+0000 7f76bfe00640 1 -- 172.21.15.42:0/2363236907 <== mds.0 v2:172.21.15.42:6832/3811049376 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5601434c63f0 con 0x56014359cde0 2024-09-17T01:43:28.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.862+0000 7f76bfe00640 10 client.8527 handle_command_reply: tid=0 2024-09-17T01:43:28.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.862+0000 7f76eca05740 1 client.8527 shutdown 2024-09-17T01:43:28.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.862+0000 7f76eca05740 1 -- 172.21.15.42:0/2363236907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5601431854d0 msgr2=0x56014357cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:28.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.862+0000 7f76eca05740 1 --2- 172.21.15.42:0/2363236907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5601431854d0 0x56014357cf30 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f76d0001230 tx=0x7f76d000fae0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.862+0000 7f76eca05740 1 -- 172.21.15.42:0/2363236907 shutdown_connections 2024-09-17T01:43:28.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.862+0000 7f76eca05740 1 --2- 172.21.15.42:0/2363236907 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x56014359cde0 0x56014359d1f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.862+0000 7f76eca05740 1 --2- 172.21.15.42:0/2363236907 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5601431ae390 0x5601436190b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.862+0000 7f76eca05740 1 --2- 172.21.15.42:0/2363236907 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56014318d6b0 0x560143618b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.862+0000 7f76bfe00640 0 client.8527 ms_handle_reset on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:28.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.862+0000 7f76eca05740 1 --2- 172.21.15.42:0/2363236907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5601431854d0 0x56014357cf30 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.862+0000 7f76eca05740 1 -- 172.21.15.42:0/2363236907 >> 172.21.15.42:0/2363236907 conn(0x5601431a24e0 msgr2=0x5601435a9780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:28.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.862+0000 7f76eca05740 1 -- 172.21.15.42:0/2363236907 shutdown_connections 2024-09-17T01:43:28.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.862+0000 7f76eca05740 1 -- 172.21.15.42:0/2363236907 wait complete. 2024-09-17T01:43:28.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.863+0000 7f76eca05740 20 client.8527 trim_cache size 0 max 16384 2024-09-17T01:43:28.862 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:43:28.862 INFO:teuthology.orchestra.run.smithi042.stdout: "message": "", 2024-09-17T01:43:28.862 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0 2024-09-17T01:43:28.862 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:43:28.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.863+0000 7f76dfe00640 1 -- 172.21.15.42:0/1978227512 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f76c0078b90 msgr2=0x7f76c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:28.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.863+0000 7f76dfe00640 1 --2- 172.21.15.42:0/1978227512 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f76c0078b90 0x7f76c007b0a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f76d80099e0 tx=0x7f76d8009500 comp rx=0 tx=0).stop 2024-09-17T01:43:28.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.863+0000 7f76dfe00640 1 -- 172.21.15.42:0/1978227512 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76e00b6850 msgr2=0x7f76e015b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:28.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.863+0000 7f76dfe00640 1 --2- 172.21.15.42:0/1978227512 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76e00b6850 0x7f76e015b020 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f76cc031000 tx=0x7f76cc0038a0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.863+0000 7f76dfe00640 1 -- 172.21.15.42:0/1978227512 shutdown_connections 2024-09-17T01:43:28.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.863+0000 7f76dfe00640 1 --2- 172.21.15.42:0/1978227512 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f76c0078b90 0x7f76c007b0a0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.863+0000 7f76dfe00640 1 --2- 172.21.15.42:0/1978227512 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76e00b6c60 0x7f76e015b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.863+0000 7f76dfe00640 1 --2- 172.21.15.42:0/1978227512 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76e00b6850 0x7f76e015b020 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.863+0000 7f76dfe00640 1 --2- 172.21.15.42:0/1978227512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76e00b23f0 0x7f76e014bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:28.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.863+0000 7f76dfe00640 1 -- 172.21.15.42:0/1978227512 >> 172.21.15.42:0/1978227512 conn(0x7f76e009ba30 msgr2=0x7f76e0071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:28.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.864+0000 7f76dfe00640 1 -- 172.21.15.42:0/1978227512 shutdown_connections 2024-09-17T01:43:28.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:28.864+0000 7f76dfe00640 1 -- 172.21.15.42:0/1978227512 wait complete. 2024-09-17T01:43:28.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:43:28.886 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-17T01:43:29.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.117+0000 7f7b3e400640 1 -- 172.21.15.42:0/3610929310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b380b3550 msgr2=0x7f7b3815cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:29.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.117+0000 7f7b3e400640 1 --2- 172.21.15.42:0/3610929310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b380b3550 0x7f7b3815cec0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f7b3815aab0 tx=0x7f7b2802a4d0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.118+0000 7f7b3e400640 1 -- 172.21.15.42:0/3610929310 shutdown_connections 2024-09-17T01:43:29.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.118+0000 7f7b3e400640 1 --2- 172.21.15.42:0/3610929310 >> v2:172.21.15.43:3300/0 conn(0x7f7b380cec40 0x7f7b380cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.118+0000 7f7b3e400640 1 --2- 172.21.15.42:0/3610929310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b380b3550 0x7f7b3815cec0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.118+0000 7f7b3e400640 1 -- 172.21.15.42:0/3610929310 >> 172.21.15.42:0/3610929310 conn(0x7f7b380b2930 msgr2=0x7f7b3806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:29.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.118+0000 7f7b3e400640 1 -- 172.21.15.42:0/3610929310 shutdown_connections 2024-09-17T01:43:29.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.118+0000 7f7b3e400640 1 -- 172.21.15.42:0/3610929310 wait complete. 2024-09-17T01:43:29.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.120+0000 7f7b3e400640 1 Processor -- start 2024-09-17T01:43:29.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.120+0000 7f7b3e400640 1 -- start start 2024-09-17T01:43:29.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.121+0000 7f7b3e400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b380b3550 0x7f7b380cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.121+0000 7f7b3e400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b380cec40 0x7f7b3806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.121+0000 7f7b3e400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7b38142f40 0x7f7b38151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.121+0000 7f7b3e400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3806d7c0 con 0x7f7b380cec40 2024-09-17T01:43:29.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.121+0000 7f7b3e400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3806d640 con 0x7f7b380b3550 2024-09-17T01:43:29.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.121+0000 7f7b3e400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7b3806d940 con 0x7f7b38142f40 2024-09-17T01:43:29.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.122+0000 7f7b2fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b380cec40 0x7f7b3806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.122+0000 7f7b2fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b380cec40 0x7f7b3806f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57108/0 (socket says 172.21.15.42:57108) 2024-09-17T01:43:29.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.122+0000 7f7b2fe00640 1 -- 172.21.15.42:0/1419908550 learned_addr learned my addr 172.21.15.42:0/1419908550 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:29.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.122+0000 7f7b37e00640 1 --2- 172.21.15.42:0/1419908550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7b38142f40 0x7f7b38151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.122+0000 7f7b37400640 1 --2- 172.21.15.42:0/1419908550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b380b3550 0x7f7b380cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.122+0000 7f7b2fe00640 1 -- 172.21.15.42:0/1419908550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7b38142f40 msgr2=0x7f7b38151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:29.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.122+0000 7f7b2fe00640 1 --2- 172.21.15.42:0/1419908550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7b38142f40 0x7f7b38151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.122+0000 7f7b2fe00640 1 -- 172.21.15.42:0/1419908550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b380b3550 msgr2=0x7f7b380cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:29.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.122+0000 7f7b2fe00640 1 --2- 172.21.15.42:0/1419908550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b380b3550 0x7f7b380cc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.122+0000 7f7b2fe00640 1 -- 172.21.15.42:0/1419908550 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b3806fb10 con 0x7f7b380cec40 2024-09-17T01:43:29.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.123+0000 7f7b2fe00640 1 --2- 172.21.15.42:0/1419908550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b380cec40 0x7f7b3806f5d0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000b3f0 tx=0x7f7b2000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:29.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.123+0000 7f7b2f400640 1 -- 172.21.15.42:0/1419908550 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b20015020 con 0x7f7b380cec40 2024-09-17T01:43:29.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.123+0000 7f7b2f400640 1 -- 172.21.15.42:0/1419908550 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b20011920 con 0x7f7b380cec40 2024-09-17T01:43:29.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.123+0000 7f7b2f400640 1 -- 172.21.15.42:0/1419908550 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b20011d70 con 0x7f7b380cec40 2024-09-17T01:43:29.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.123+0000 7f7b3e400640 1 -- 172.21.15.42:0/1419908550 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b38151a90 con 0x7f7b380cec40 2024-09-17T01:43:29.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.123+0000 7f7b3e400640 1 -- 172.21.15.42:0/1419908550 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b3806e810 con 0x7f7b380cec40 2024-09-17T01:43:29.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.125+0000 7f7b2f400640 1 -- 172.21.15.42:0/1419908550 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7b20018020 con 0x7f7b380cec40 2024-09-17T01:43:29.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.126+0000 7f7b2f400640 1 --2- 172.21.15.42:0/1419908550 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7b14078b90 0x7f7b1407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.126+0000 7f7b2f400640 1 -- 172.21.15.42:0/1419908550 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f7b2009ab30 con 0x7f7b380cec40 2024-09-17T01:43:29.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.127+0000 7f7b37400640 1 --2- 172.21.15.42:0/1419908550 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7b14078b90 0x7f7b1407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.127+0000 7f7b4561d740 1 Processor -- start 2024-09-17T01:43:29.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.127+0000 7f7b4561d740 1 -- start start 2024-09-17T01:43:29.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.127+0000 7f7b37400640 1 --2- 172.21.15.42:0/1419908550 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7b14078b90 0x7f7b1407b0a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7b28033000 tx=0x7f7b28004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:29.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.128+0000 7f7b4561d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558f9eaac390 0x558f9ee9a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.128+0000 7f7b4561d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9ea834d0 0x558f9ee7d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.128+0000 7f7b4561d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558f9ea8b6b0 0x558f9ee7d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.128+0000 7f7b4561d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558f9edb31c0 con 0x558f9ea834d0 2024-09-17T01:43:29.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.128+0000 7f7b4561d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558f9edc6870 con 0x558f9eaac390 2024-09-17T01:43:29.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.128+0000 7f7b4561d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558f9edb5ca0 con 0x558f9ea8b6b0 2024-09-17T01:43:29.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.129+0000 7f7b2fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9ea834d0 0x558f9ee7d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.129+0000 7f7b2fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9ea834d0 0x558f9ee7d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57114/0 (socket says 172.21.15.42:57114) 2024-09-17T01:43:29.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.129+0000 7f7b2fe00640 1 -- 172.21.15.42:0/2726092257 learned_addr learned my addr 172.21.15.42:0/2726092257 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:29.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.129+0000 7f7b37400640 1 --2- 172.21.15.42:0/2726092257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558f9eaac390 0x558f9ee9a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.129+0000 7f7b37e00640 1 --2- 172.21.15.42:0/2726092257 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558f9ea8b6b0 0x558f9ee7d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.129+0000 7f7b2fe00640 1 -- 172.21.15.42:0/2726092257 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558f9ea8b6b0 msgr2=0x558f9ee7d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:29.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.129+0000 7f7b2fe00640 1 --2- 172.21.15.42:0/2726092257 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558f9ea8b6b0 0x558f9ee7d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.129+0000 7f7b2fe00640 1 -- 172.21.15.42:0/2726092257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558f9eaac390 msgr2=0x558f9ee9a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:29.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.129+0000 7f7b2fe00640 1 --2- 172.21.15.42:0/2726092257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558f9eaac390 0x558f9ee9a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.129+0000 7f7b2fe00640 1 -- 172.21.15.42:0/2726092257 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f9eb8e7d0 con 0x558f9ea834d0 2024-09-17T01:43:29.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.129+0000 7f7b2fe00640 1 --2- 172.21.15.42:0/2726092257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9ea834d0 0x558f9ee7d220 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f7b200624d0 tx=0x7f7b200626d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7737c60c00ab278 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:29.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.130+0000 7f7b27e00640 1 -- 172.21.15.42:0/2726092257 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b200672b0 con 0x558f9ea834d0 2024-09-17T01:43:29.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.130+0000 7f7b27e00640 1 -- 172.21.15.42:0/2726092257 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b2006c1f0 con 0x558f9ea834d0 2024-09-17T01:43:29.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.130+0000 7f7b27e00640 1 -- 172.21.15.42:0/2726092257 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b20061c90 con 0x558f9ea834d0 2024-09-17T01:43:29.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.130+0000 7f7b4561d740 1 -- 172.21.15.42:0/2726092257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9ea834d0 msgr2=0x558f9ee7d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:29.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.130+0000 7f7b4561d740 1 --2- 172.21.15.42:0/2726092257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9ea834d0 0x558f9ee7d220 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f7b200624d0 tx=0x7f7b200626d0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.130+0000 7f7b4561d740 1 -- 172.21.15.42:0/2726092257 shutdown_connections 2024-09-17T01:43:29.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.130+0000 7f7b4561d740 1 --2- 172.21.15.42:0/2726092257 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558f9ea8b6b0 0x558f9ee7d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.130+0000 7f7b4561d740 1 --2- 172.21.15.42:0/2726092257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9ea834d0 0x558f9ee7d220 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.130+0000 7f7b4561d740 1 --2- 172.21.15.42:0/2726092257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558f9eaac390 0x558f9ee9a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.130+0000 7f7b4561d740 1 -- 172.21.15.42:0/2726092257 >> 172.21.15.42:0/2726092257 conn(0x558f9eaa04e0 msgr2=0x558f9ee53440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:29.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.131+0000 7f7b4561d740 1 -- 172.21.15.42:0/2726092257 shutdown_connections 2024-09-17T01:43:29.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.131+0000 7f7b4561d740 1 -- 172.21.15.42:0/2726092257 wait complete. 2024-09-17T01:43:29.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.132+0000 7f7b4561d740 1 -- start start 2024-09-17T01:43:29.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.132+0000 7f7b4561d740 1 Processor -- start 2024-09-17T01:43:29.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.133+0000 7f7b4561d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9ea834d0 0x558f9ee6b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.133+0000 7f7b4561d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558f9ea8b6b0 0x558f9ee97230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.133+0000 7f7b4561d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558f9eaac390 0x558f9ee97770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.133+0000 7f7b4561d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558f9ed5c410 con 0x558f9ea834d0 2024-09-17T01:43:29.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.133+0000 7f7b4561d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558f9edb9ab0 con 0x558f9eaac390 2024-09-17T01:43:29.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.133+0000 7f7b4561d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558f9eb26740 con 0x558f9ea8b6b0 2024-09-17T01:43:29.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.133+0000 7f7b4561d740 10 client.0 _ll_register_callbacks cb 0x558f9ed39360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:43:29.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.133+0000 7f7b37400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9ea834d0 0x558f9ee6b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.134+0000 7f7b37400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9ea834d0 0x558f9ee6b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57130/0 (socket says 172.21.15.42:57130) 2024-09-17T01:43:29.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.134+0000 7f7b37400640 1 -- 172.21.15.42:0/1065134296 learned_addr learned my addr 172.21.15.42:0/1065134296 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:29.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.134+0000 7f7b37e00640 1 --2- 172.21.15.42:0/1065134296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558f9eaac390 0x558f9ee97770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.134+0000 7f7b2fe00640 1 --2- 172.21.15.42:0/1065134296 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558f9ea8b6b0 0x558f9ee97230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.134+0000 7f7b37400640 1 -- 172.21.15.42:0/1065134296 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558f9ea8b6b0 msgr2=0x558f9ee97230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:29.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.134+0000 7f7b37400640 1 --2- 172.21.15.42:0/1065134296 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558f9ea8b6b0 0x558f9ee97230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.134+0000 7f7b37400640 1 -- 172.21.15.42:0/1065134296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558f9eaac390 msgr2=0x558f9ee97770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:29.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.134+0000 7f7b37400640 1 --2- 172.21.15.42:0/1065134296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558f9eaac390 0x558f9ee97770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.134+0000 7f7b37400640 1 -- 172.21.15.42:0/1065134296 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f9eb17970 con 0x558f9ea834d0 2024-09-17T01:43:29.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.134+0000 7f7b37400640 1 --2- 172.21.15.42:0/1065134296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9ea834d0 0x558f9ee6b230 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f7b280099c0 tx=0x7f7b28009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c1dd1b6831b4b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:29.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.134+0000 7f7b24c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:43:29.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.135+0000 7f7b24c00640 1 -- 172.21.15.42:0/1065134296 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b2804d020 con 0x558f9ea834d0 2024-09-17T01:43:29.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.135+0000 7f7b24c00640 1 -- 172.21.15.42:0/1065134296 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f7b280047a0 con 0x558f9ea834d0 2024-09-17T01:43:29.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.135+0000 7f7b4561d740 1 -- 172.21.15.42:0/1065134296 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b2006c1f0 con 0x558f9ea834d0 2024-09-17T01:43:29.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.135+0000 7f7b24c00640 1 -- 172.21.15.42:0/1065134296 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) ==== 24+0+0 (secure 0 0 0) 0x7f7b28057050 con 0x558f9ea834d0 2024-09-17T01:43:29.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.135+0000 7f7b4561d740 10 client.9165 fetch_fsmap learned FSMap version 116 2024-09-17T01:43:29.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.135+0000 7f7b4561d740 1 -- 172.21.15.42:0/1065134296 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) -- 0x558f9eaf56a0 con 0x558f9ea834d0 2024-09-17T01:43:29.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.135+0000 7f7b24c00640 1 -- 172.21.15.42:0/1065134296 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b2006c1f0 con 0x558f9ea834d0 2024-09-17T01:43:29.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.135+0000 7f7b24c00640 1 -- 172.21.15.42:0/1065134296 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 116) ==== 3502+0+0 (secure 0 0 0) 0x7f7b2805a020 con 0x558f9ea834d0 2024-09-17T01:43:29.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.135+0000 7f7b4561d740 10 client.9165 fetch_fsmap finished waiting for FSMap version 116 2024-09-17T01:43:29.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.135+0000 7f7b4561d740 10 client.9165 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-17T01:43:29.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.135+0000 7f7b4561d740 20 client.9165 populate_metadata read hostname 'smithi042' 2024-09-17T01:43:29.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.135+0000 7f7b4561d740 1 --2- 172.21.15.42:0/1065134296 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x558f9ea6af60 0x558f9ee93510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.135+0000 7f7b4561d740 4 client.9165 mds_command: new command op to 8982 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:43:29.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.135+0000 7f7b4561d740 1 -- 172.21.15.42:0/1065134296 --> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f9edc87c0 con 0x558f9ea6af60 2024-09-17T01:43:29.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.136+0000 7f7b2fe00640 1 --2- 172.21.15.42:0/1065134296 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x558f9ea6af60 0x558f9ee93510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.136+0000 7f7b2fe00640 1 --2- 172.21.15.42:0/1065134296 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x558f9ea6af60 0x558f9ee93510 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a348fd3f8cb6bd0 server_cookie=f91f5f7b90f19ddf in_seq=0 out_seq=0 2024-09-17T01:43:29.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.136+0000 7f7b24c00640 10 client.9165 ms_handle_connect on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:29.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.137+0000 7f7b24c00640 1 -- 172.21.15.42:0/1065134296 <== mds.0 v2:172.21.15.42:6832/3811049376 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558f9edc87c0 con 0x558f9ea6af60 2024-09-17T01:43:29.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.137+0000 7f7b24c00640 10 client.9165 handle_command_reply: tid=0 2024-09-17T01:43:29.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.137+0000 7f7b4561d740 1 client.9165 shutdown 2024-09-17T01:43:29.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.137+0000 7f7b4561d740 1 -- 172.21.15.42:0/1065134296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9ea834d0 msgr2=0x558f9ee6b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:29.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.137+0000 7f7b4561d740 1 --2- 172.21.15.42:0/1065134296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9ea834d0 0x558f9ee6b230 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f7b280099c0 tx=0x7f7b28009260 comp rx=0 tx=0).stop 2024-09-17T01:43:29.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.137+0000 7f7b4561d740 1 -- 172.21.15.42:0/1065134296 shutdown_connections 2024-09-17T01:43:29.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.137+0000 7f7b4561d740 1 --2- 172.21.15.42:0/1065134296 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x558f9ea6af60 0x558f9ee93510 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.137+0000 7f7b4561d740 1 --2- 172.21.15.42:0/1065134296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558f9eaac390 0x558f9ee97770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.137+0000 7f7b4561d740 1 --2- 172.21.15.42:0/1065134296 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558f9ea8b6b0 0x558f9ee97230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.137+0000 7f7b4561d740 1 --2- 172.21.15.42:0/1065134296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9ea834d0 0x558f9ee6b230 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.137+0000 7f7b4561d740 1 -- 172.21.15.42:0/1065134296 >> 172.21.15.42:0/1065134296 conn(0x558f9eaa04e0 msgr2=0x558f9ee9be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:29.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.137+0000 7f7b24c00640 0 client.9165 ms_handle_reset on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:29.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.137+0000 7f7b4561d740 1 -- 172.21.15.42:0/1065134296 shutdown_connections 2024-09-17T01:43:29.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.137+0000 7f7b4561d740 1 -- 172.21.15.42:0/1065134296 wait complete. 2024-09-17T01:43:29.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.138+0000 7f7b4561d740 20 client.9165 trim_cache size 0 max 16384 2024-09-17T01:43:29.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.156+0000 7f7b4561d740 1 Processor -- start 2024-09-17T01:43:29.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.156+0000 7f7b4561d740 1 -- start start 2024-09-17T01:43:29.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.157+0000 7f7b4561d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9ea834d0 0x558f9ee6b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.157+0000 7f7b4561d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558f9ea8b6b0 0x558f9ee94a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.157+0000 7f7b4561d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558f9eaac390 0x558f9ee934f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.157+0000 7f7b4561d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7b381f69e0 con 0x558f9ea834d0 2024-09-17T01:43:29.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.157+0000 7f7b4561d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7b380c8a10 con 0x558f9eaac390 2024-09-17T01:43:29.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.157+0000 7f7b4561d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7b380c7d70 con 0x558f9ea8b6b0 2024-09-17T01:43:29.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.158+0000 7f7b37400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9ea834d0 0x558f9ee6b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.158+0000 7f7b37400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9ea834d0 0x558f9ee6b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57142/0 (socket says 172.21.15.42:57142) 2024-09-17T01:43:29.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.158+0000 7f7b37400640 1 -- 172.21.15.42:0/283539323 learned_addr learned my addr 172.21.15.42:0/283539323 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:29.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.158+0000 7f7b37e00640 1 --2- 172.21.15.42:0/283539323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558f9eaac390 0x558f9ee934f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.158+0000 7f7b2fe00640 1 --2- 172.21.15.42:0/283539323 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558f9ea8b6b0 0x558f9ee94a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.158+0000 7f7b37400640 1 -- 172.21.15.42:0/283539323 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558f9ea8b6b0 msgr2=0x558f9ee94a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:29.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.158+0000 7f7b37400640 1 --2- 172.21.15.42:0/283539323 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558f9ea8b6b0 0x558f9ee94a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.158+0000 7f7b37400640 1 -- 172.21.15.42:0/283539323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558f9eaac390 msgr2=0x558f9ee934f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:29.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.158+0000 7f7b37400640 1 --2- 172.21.15.42:0/283539323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558f9eaac390 0x558f9ee934f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.158+0000 7f7b37400640 1 -- 172.21.15.42:0/283539323 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f9eea79f0 con 0x558f9ea834d0 2024-09-17T01:43:29.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.158+0000 7f7b2fe00640 1 --2- 172.21.15.42:0/283539323 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558f9ea8b6b0 0x558f9ee94a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:43:29.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.158+0000 7f7b37400640 1 --2- 172.21.15.42:0/283539323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9ea834d0 0x558f9ee6b1f0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f7b28005480 tx=0x7f7b28003ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6301ea15195816df server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:29.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.159+0000 7f7b27400640 1 -- 172.21.15.42:0/283539323 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b2804d040 con 0x558f9ea834d0 2024-09-17T01:43:29.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.159+0000 7f7b27400640 1 -- 172.21.15.42:0/283539323 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b28004ea0 con 0x558f9ea834d0 2024-09-17T01:43:29.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.159+0000 7f7b27400640 1 -- 172.21.15.42:0/283539323 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b28035040 con 0x558f9ea834d0 2024-09-17T01:43:29.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.159+0000 7f7b4561d740 1 -- 172.21.15.42:0/283539323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9ea834d0 msgr2=0x558f9ee6b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:29.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.159+0000 7f7b4561d740 1 --2- 172.21.15.42:0/283539323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9ea834d0 0x558f9ee6b1f0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f7b28005480 tx=0x7f7b28003ee0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.159+0000 7f7b4561d740 1 -- 172.21.15.42:0/283539323 shutdown_connections 2024-09-17T01:43:29.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.159+0000 7f7b4561d740 1 --2- 172.21.15.42:0/283539323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558f9eaac390 0x558f9ee934f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.159+0000 7f7b4561d740 1 --2- 172.21.15.42:0/283539323 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558f9ea8b6b0 0x558f9ee94a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.159+0000 7f7b4561d740 1 --2- 172.21.15.42:0/283539323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9ea834d0 0x558f9ee6b1f0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.159+0000 7f7b4561d740 1 -- 172.21.15.42:0/283539323 >> 172.21.15.42:0/283539323 conn(0x558f9eaa04e0 msgr2=0x558f9ee4dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:29.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.160+0000 7f7b4561d740 1 -- 172.21.15.42:0/283539323 shutdown_connections 2024-09-17T01:43:29.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.160+0000 7f7b4561d740 1 -- 172.21.15.42:0/283539323 wait complete. 2024-09-17T01:43:29.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.160+0000 7f7b4561d740 1 -- start start 2024-09-17T01:43:29.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.161+0000 7f7b4561d740 1 Processor -- start 2024-09-17T01:43:29.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.162+0000 7f7b4561d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558f9ea834d0 0x558f9ee932d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.162+0000 7f7b4561d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558f9ea8b6b0 0x558f9eea6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.162+0000 7f7b4561d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9eaac390 0x558f9ee4c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.162+0000 7f7b4561d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558f9ee4f030 con 0x558f9eaac390 2024-09-17T01:43:29.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.162+0000 7f7b4561d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7b380c83c0 con 0x558f9ea834d0 2024-09-17T01:43:29.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.162+0000 7f7b4561d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558f9ee536e0 con 0x558f9ea8b6b0 2024-09-17T01:43:29.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.162+0000 7f7b4561d740 10 client.0 _ll_register_callbacks cb 0x7f7b28009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:43:29.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.162+0000 7f7b37e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9eaac390 0x558f9ee4c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.163+0000 7f7b37e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9eaac390 0x558f9ee4c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57152/0 (socket says 172.21.15.42:57152) 2024-09-17T01:43:29.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.163+0000 7f7b37e00640 1 -- 172.21.15.42:0/2191872596 learned_addr learned my addr 172.21.15.42:0/2191872596 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:29.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.163+0000 7f7b37400640 1 --2- 172.21.15.42:0/2191872596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558f9ea834d0 0x558f9ee932d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.163+0000 7f7b2fe00640 1 --2- 172.21.15.42:0/2191872596 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558f9ea8b6b0 0x558f9eea6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.163+0000 7f7b37e00640 1 -- 172.21.15.42:0/2191872596 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558f9ea8b6b0 msgr2=0x558f9eea6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:29.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.163+0000 7f7b37e00640 1 --2- 172.21.15.42:0/2191872596 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558f9ea8b6b0 0x558f9eea6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.163+0000 7f7b37e00640 1 -- 172.21.15.42:0/2191872596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558f9ea834d0 msgr2=0x558f9ee932d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:29.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.163+0000 7f7b37e00640 1 --2- 172.21.15.42:0/2191872596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558f9ea834d0 0x558f9ee932d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.163+0000 7f7b37e00640 1 -- 172.21.15.42:0/2191872596 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f9ee4fd50 con 0x558f9eaac390 2024-09-17T01:43:29.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.163+0000 7f7b2fe00640 1 --2- 172.21.15.42:0/2191872596 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558f9ea8b6b0 0x558f9eea6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:43:29.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.163+0000 7f7b37e00640 1 --2- 172.21.15.42:0/2191872596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9eaac390 0x558f9ee4c830 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f7b30005fd0 tx=0x7f7b30012de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a18ee158d41b41 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:29.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.163+0000 7f7b24c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:43:29.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.163+0000 7f7b24c00640 1 -- 172.21.15.42:0/2191872596 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b30021060 con 0x558f9eaac390 2024-09-17T01:43:29.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.164+0000 7f7b24c00640 1 -- 172.21.15.42:0/2191872596 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f7b30011d90 con 0x558f9eaac390 2024-09-17T01:43:29.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.164+0000 7f7b4561d740 1 -- 172.21.15.42:0/2191872596 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b28004ea0 con 0x558f9eaac390 2024-09-17T01:43:29.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.164+0000 7f7b24c00640 1 -- 172.21.15.42:0/2191872596 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) ==== 24+0+0 (secure 0 0 0) 0x7f7b30027050 con 0x558f9eaac390 2024-09-17T01:43:29.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.164+0000 7f7b4561d740 10 client.9171 fetch_fsmap learned FSMap version 116 2024-09-17T01:43:29.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.164+0000 7f7b4561d740 1 -- 172.21.15.42:0/2191872596 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) -- 0x558f9ee99d50 con 0x558f9eaac390 2024-09-17T01:43:29.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.164+0000 7f7b24c00640 1 -- 172.21.15.42:0/2191872596 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b28004ea0 con 0x558f9eaac390 2024-09-17T01:43:29.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.164+0000 7f7b24c00640 1 -- 172.21.15.42:0/2191872596 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 116) ==== 3502+0+0 (secure 0 0 0) 0x7f7b3002a020 con 0x558f9eaac390 2024-09-17T01:43:29.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.164+0000 7f7b4561d740 10 client.9171 fetch_fsmap finished waiting for FSMap version 116 2024-09-17T01:43:29.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.164+0000 7f7b4561d740 10 client.9171 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-17T01:43:29.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.164+0000 7f7b4561d740 20 client.9171 populate_metadata read hostname 'smithi042' 2024-09-17T01:43:29.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.164+0000 7f7b4561d740 1 --2- 172.21.15.42:0/2191872596 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x558f9eea6a50 0x558f9ee4cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.164+0000 7f7b4561d740 4 client.9171 mds_command: new command op to 8982 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:43:29.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.164+0000 7f7b4561d740 1 -- 172.21.15.42:0/2191872596 --> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558f9edc4270 con 0x558f9eea6a50 2024-09-17T01:43:29.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.164+0000 7f7b37400640 1 --2- 172.21.15.42:0/2191872596 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x558f9eea6a50 0x558f9ee4cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.165+0000 7f7b37400640 1 --2- 172.21.15.42:0/2191872596 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x558f9eea6a50 0x558f9ee4cd70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df119ddb7ee26940 server_cookie=e136a3370f540c0c in_seq=0 out_seq=0 2024-09-17T01:43:29.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.165+0000 7f7b24c00640 10 client.9171 ms_handle_connect on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:29.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.165+0000 7f7b24c00640 1 -- 172.21.15.42:0/2191872596 <== mds.0 v2:172.21.15.42:6832/3811049376 1 ==== command_reply(tid 0: 0 ) ==== 8+0+612 (crc 0 0 0) 0x558f9edc4270 con 0x558f9eea6a50 2024-09-17T01:43:29.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.165+0000 7f7b24c00640 10 client.9171 handle_command_reply: tid=0 2024-09-17T01:43:29.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.165+0000 7f7b4561d740 1 client.9171 shutdown 2024-09-17T01:43:29.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.166+0000 7f7b4561d740 1 -- 172.21.15.42:0/2191872596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9eaac390 msgr2=0x558f9ee4c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:29.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.166+0000 7f7b4561d740 1 --2- 172.21.15.42:0/2191872596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9eaac390 0x558f9ee4c830 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f7b30005fd0 tx=0x7f7b30012de0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.166+0000 7f7b4561d740 1 -- 172.21.15.42:0/2191872596 shutdown_connections 2024-09-17T01:43:29.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.166+0000 7f7b4561d740 1 --2- 172.21.15.42:0/2191872596 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x558f9eea6a50 0x558f9ee4cd70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.166+0000 7f7b4561d740 1 --2- 172.21.15.42:0/2191872596 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558f9eaac390 0x558f9ee4c830 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.166+0000 7f7b4561d740 1 --2- 172.21.15.42:0/2191872596 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558f9ea8b6b0 0x558f9eea6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.166+0000 7f7b4561d740 1 --2- 172.21.15.42:0/2191872596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558f9ea834d0 0x558f9ee932d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.166+0000 7f7b24c00640 0 client.9171 ms_handle_reset on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:29.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.166+0000 7f7b4561d740 1 -- 172.21.15.42:0/2191872596 >> 172.21.15.42:0/2191872596 conn(0x558f9eaa04e0 msgr2=0x558f9ee4f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:29.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.166+0000 7f7b4561d740 1 -- 172.21.15.42:0/2191872596 shutdown_connections 2024-09-17T01:43:29.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.166+0000 7f7b4561d740 1 -- 172.21.15.42:0/2191872596 wait complete. 2024-09-17T01:43:29.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.166+0000 7f7b4561d740 20 client.9171 trim_cache size 0 max 16384 2024-09-17T01:43:29.168 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:43:29.168 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "PAUSED (785 inodes in the stack)", 2024-09-17T01:43:29.168 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-09-17T01:43:29.168 INFO:teuthology.orchestra.run.smithi042.stdout: "b7cf205b-474d-4b2b-864d-637bc207bb9a": { 2024-09-17T01:43:29.168 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_control_test_path", 2024-09-17T01:43:29.168 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "b7cf205b-474d-4b2b-864d-637bc207bb9a", 2024-09-17T01:43:29.168 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive" 2024-09-17T01:43:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:43:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:43:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_stats": { 2024-09-17T01:43:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: "b7cf205b-474d-4b2b-864d-637bc207bb9a": { 2024-09-17T01:43:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:43:28.483031+0000", 2024-09-17T01:43:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_control_test_path", 2024-09-17T01:43:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:43:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:43:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:43:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:43:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:43:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:43:29.169 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:43:29.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.166+0000 7f7b3e400640 1 -- 172.21.15.42:0/1419908550 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7b14078b90 msgr2=0x7f7b1407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:29.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.166+0000 7f7b3e400640 1 --2- 172.21.15.42:0/1419908550 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7b14078b90 0x7f7b1407b0a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7b28033000 tx=0x7f7b28004730 comp rx=0 tx=0).stop 2024-09-17T01:43:29.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.166+0000 7f7b3e400640 1 -- 172.21.15.42:0/1419908550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b380cec40 msgr2=0x7f7b3806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:29.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.166+0000 7f7b3e400640 1 --2- 172.21.15.42:0/1419908550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b380cec40 0x7f7b3806f5d0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000b3f0 tx=0x7f7b2000b8b0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.167+0000 7f7b3e400640 1 -- 172.21.15.42:0/1419908550 shutdown_connections 2024-09-17T01:43:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.167+0000 7f7b3e400640 1 --2- 172.21.15.42:0/1419908550 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7b14078b90 0x7f7b1407b0a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.167+0000 7f7b3e400640 1 --2- 172.21.15.42:0/1419908550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7b38142f40 0x7f7b38151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.167+0000 7f7b3e400640 1 --2- 172.21.15.42:0/1419908550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b380cec40 0x7f7b3806f5d0 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.167+0000 7f7b3e400640 1 --2- 172.21.15.42:0/1419908550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b380b3550 0x7f7b380cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.167+0000 7f7b3e400640 1 -- 172.21.15.42:0/1419908550 >> 172.21.15.42:0/1419908550 conn(0x7f7b380b2930 msgr2=0x7f7b3815f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.167+0000 7f7b3e400640 1 -- 172.21.15.42:0/1419908550 shutdown_connections 2024-09-17T01:43:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.167+0000 7f7b3e400640 1 -- 172.21.15.42:0/1419908550 wait complete. 2024-09-17T01:43:29.187 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:43:29.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.417+0000 7ff300400640 1 -- 172.21.15.42:0/701199284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2f815f190 msgr2=0x7ff2f806fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:29.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.417+0000 7ff300400640 1 --2- 172.21.15.42:0/701199284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2f815f190 0x7ff2f806fe40 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0005fd0 tx=0x7ff2f002aaa0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.417+0000 7ff300400640 1 -- 172.21.15.42:0/701199284 shutdown_connections 2024-09-17T01:43:29.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.417+0000 7ff300400640 1 --2- 172.21.15.42:0/701199284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2f815f190 0x7ff2f806fe40 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.417+0000 7ff300400640 1 --2- 172.21.15.42:0/701199284 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2f806db40 0x7ff2f815bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.417+0000 7ff300400640 1 -- 172.21.15.42:0/701199284 >> 172.21.15.42:0/701199284 conn(0x7ff2f80b2930 msgr2=0x7ff2f806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:29.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.418+0000 7ff300400640 1 -- 172.21.15.42:0/701199284 shutdown_connections 2024-09-17T01:43:29.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.418+0000 7ff300400640 1 -- 172.21.15.42:0/701199284 wait complete. 2024-09-17T01:43:29.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.420+0000 7ff300400640 1 Processor -- start 2024-09-17T01:43:29.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.420+0000 7ff300400640 1 -- start start 2024-09-17T01:43:29.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.421+0000 7ff300400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2f8072e00 0x7ff2f814b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.421+0000 7ff300400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2f815f190 0x7ff2f80b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.421+0000 7ff300400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2f80b4080 0x7ff2f80b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.421+0000 7ff300400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f8151520 con 0x7ff2f80b4080 2024-09-17T01:43:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.421+0000 7ff300400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f8070740 con 0x7ff2f815f190 2024-09-17T01:43:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.421+0000 7ff300400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f81516a0 con 0x7ff2f8072e00 2024-09-17T01:43:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.422+0000 7ff2fe400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2f80b4080 0x7ff2f80b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.422+0000 7ff2fe400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2f80b4080 0x7ff2f80b18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57168/0 (socket says 172.21.15.42:57168) 2024-09-17T01:43:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.422+0000 7ff2fe400640 1 -- 172.21.15.42:0/3383718633 learned_addr learned my addr 172.21.15.42:0/3383718633 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.422+0000 7ff2fd000640 1 --2- 172.21.15.42:0/3383718633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2f815f190 0x7ff2f80b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.422+0000 7ff2fda00640 1 --2- 172.21.15.42:0/3383718633 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2f8072e00 0x7ff2f814b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.422+0000 7ff2fe400640 1 -- 172.21.15.42:0/3383718633 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2f8072e00 msgr2=0x7ff2f814b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.422+0000 7ff2fe400640 1 --2- 172.21.15.42:0/3383718633 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2f8072e00 0x7ff2f814b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.422+0000 7ff2fe400640 1 -- 172.21.15.42:0/3383718633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2f815f190 msgr2=0x7ff2f80b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.422+0000 7ff2fe400640 1 --2- 172.21.15.42:0/3383718633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2f815f190 0x7ff2f80b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.422+0000 7ff2fe400640 1 -- 172.21.15.42:0/3383718633 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f8154df0 con 0x7ff2f80b4080 2024-09-17T01:43:29.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.422+0000 7ff2fd000640 1 --2- 172.21.15.42:0/3383718633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2f815f190 0x7ff2f80b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:43:29.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.423+0000 7ff2fe400640 1 --2- 172.21.15.42:0/3383718633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2f80b4080 0x7ff2f80b18b0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0006010 tx=0x7ff2f0003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:29.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.423+0000 7ff2f5600640 1 -- 172.21.15.42:0/3383718633 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0044070 con 0x7ff2f80b4080 2024-09-17T01:43:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.423+0000 7ff2f5600640 1 -- 172.21.15.42:0/3383718633 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2f0004040 con 0x7ff2f80b4080 2024-09-17T01:43:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.423+0000 7ff2f5600640 1 -- 172.21.15.42:0/3383718633 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0004430 con 0x7ff2f80b4080 2024-09-17T01:43:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.423+0000 7ff300400640 1 -- 172.21.15.42:0/3383718633 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f8154830 con 0x7ff2f80b4080 2024-09-17T01:43:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.423+0000 7ff300400640 1 -- 172.21.15.42:0/3383718633 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f80b45a0 con 0x7ff2f80b4080 2024-09-17T01:43:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.424+0000 7ff300400640 1 -- 172.21.15.42:0/3383718633 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2f80b5910 con 0x7ff2f80b4080 2024-09-17T01:43:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.426+0000 7ff2f5600640 1 -- 172.21.15.42:0/3383718633 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff2f0047070 con 0x7ff2f80b4080 2024-09-17T01:43:29.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.427+0000 7ff2f5600640 1 --2- 172.21.15.42:0/3383718633 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff2d8078bc0 0x7ff2d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.427+0000 7ff2f5600640 1 -- 172.21.15.42:0/3383718633 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7ff2f00bbb00 con 0x7ff2f80b4080 2024-09-17T01:43:29.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.427+0000 7ff2fda00640 1 --2- 172.21.15.42:0/3383718633 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff2d8078bc0 0x7ff2d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.428+0000 7ff2fda00640 1 --2- 172.21.15.42:0/3383718633 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff2d8078bc0 0x7ff2d807b0d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec001720 tx=0x7ff2ec009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:29.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.431+0000 7ff2f5600640 1 -- 172.21.15.42:0/3383718633 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff2f80b5910 con 0x7ff2f80b4080 2024-09-17T01:43:29.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.667+0000 7ff300400640 1 -- 172.21.15.42:0/3383718633 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2f815bc50 con 0x7ff2f80b4080 2024-09-17T01:43:29.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.667+0000 7ff2f5600640 1 -- 172.21.15.42:0/3383718633 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) ==== 95+0+5230 (secure 0 0 0) 0x7ff2f00bbe20 con 0x7ff2f80b4080 2024-09-17T01:43:29.665 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:29.665 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3131119825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3131119825},{"type":"v1","addr":"172.21.15.43:6837","nonce":3131119825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8368,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1988657429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1988657429},{"type":"v1","addr":"172.21.15.43:6836","nonce":1988657429}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/578887548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":578887548},{"type":"v1","addr":"172.21.15.42:6835","nonce":578887548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:42:57.184518+0000","modified":"2024-09-17T01:43:00.201156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8982":{"gid":8982,"name":"c","rank":0,"incarnation":112,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6834/3811049376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3811049376},{"type":"v1","addr":"172.21.15.42:6834","nonce":3811049376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8982,"qdb_cluster":[8982]},"id":10}]} 2024-09-17T01:43:29.666 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 116 2024-09-17T01:43:29.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.670+0000 7ff300400640 1 -- 172.21.15.42:0/3383718633 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff2d8078bc0 msgr2=0x7ff2d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:29.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.670+0000 7ff300400640 1 --2- 172.21.15.42:0/3383718633 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff2d8078bc0 0x7ff2d807b0d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec001720 tx=0x7ff2ec009040 comp rx=0 tx=0).stop 2024-09-17T01:43:29.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.670+0000 7ff300400640 1 -- 172.21.15.42:0/3383718633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2f80b4080 msgr2=0x7ff2f80b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:29.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.670+0000 7ff300400640 1 --2- 172.21.15.42:0/3383718633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2f80b4080 0x7ff2f80b18b0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0006010 tx=0x7ff2f0003ce0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.670+0000 7ff300400640 1 -- 172.21.15.42:0/3383718633 shutdown_connections 2024-09-17T01:43:29.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.670+0000 7ff300400640 1 --2- 172.21.15.42:0/3383718633 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff2d8078bc0 0x7ff2d807b0d0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.670+0000 7ff300400640 1 --2- 172.21.15.42:0/3383718633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2f815f190 0x7ff2f80b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.670+0000 7ff300400640 1 --2- 172.21.15.42:0/3383718633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2f80b4080 0x7ff2f80b18b0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.670+0000 7ff300400640 1 --2- 172.21.15.42:0/3383718633 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2f8072e00 0x7ff2f814b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.670+0000 7ff300400640 1 -- 172.21.15.42:0/3383718633 >> 172.21.15.42:0/3383718633 conn(0x7ff2f80b2930 msgr2=0x7ff2f806f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:29.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.670+0000 7ff300400640 1 -- 172.21.15.42:0/3383718633 shutdown_connections 2024-09-17T01:43:29.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.670+0000 7ff300400640 1 -- 172.21.15.42:0/3383718633 wait complete. 2024-09-17T01:43:29.689 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T01:43:29.689 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:43:29.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.918+0000 7f5267e00640 1 -- 172.21.15.42:0/2901585291 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f526806cd20 msgr2=0x7f526806d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:29.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.918+0000 7f5267e00640 1 --2- 172.21.15.42:0/2901585291 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f526806cd20 0x7f526806d130 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5258009830 tx=0x7f525802a520 comp rx=0 tx=0).stop 2024-09-17T01:43:29.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.918+0000 7f5267e00640 1 -- 172.21.15.42:0/2901585291 shutdown_connections 2024-09-17T01:43:29.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.918+0000 7f5267e00640 1 --2- 172.21.15.42:0/2901585291 >> v2:172.21.15.43:3300/0 conn(0x7f52680cf230 0x7f52680cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.918+0000 7f5267e00640 1 --2- 172.21.15.42:0/2901585291 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f526806cd20 0x7f526806d130 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.918+0000 7f5267e00640 1 -- 172.21.15.42:0/2901585291 >> 172.21.15.42:0/2901585291 conn(0x7f52680b25f0 msgr2=0x7f52680d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:29.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.918+0000 7f5267e00640 1 -- 172.21.15.42:0/2901585291 shutdown_connections 2024-09-17T01:43:29.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.918+0000 7f5267e00640 1 -- 172.21.15.42:0/2901585291 wait complete. 2024-09-17T01:43:29.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.920+0000 7f5267e00640 1 Processor -- start 2024-09-17T01:43:29.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.921+0000 7f5267e00640 1 -- start start 2024-09-17T01:43:29.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.922+0000 7f5267e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f526806cd20 0x7f526814ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.922+0000 7f5267e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52680cf230 0x7f5268151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.922+0000 7f5267e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f526815e3c0 0x7f5268152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.922+0000 7f5267e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f52681552a0 con 0x7f526815e3c0 2024-09-17T01:43:29.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.922+0000 7f5267e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5268155120 con 0x7f526806cd20 2024-09-17T01:43:29.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.922+0000 7f5267e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f52680702f0 con 0x7f52680cf230 2024-09-17T01:43:29.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.922+0000 7f5267400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f526815e3c0 0x7f5268152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.923+0000 7f5267400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f526815e3c0 0x7f5268152490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57170/0 (socket says 172.21.15.42:57170) 2024-09-17T01:43:29.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.923+0000 7f5267400640 1 -- 172.21.15.42:0/3739661322 learned_addr learned my addr 172.21.15.42:0/3739661322 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:29.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.923+0000 7f5266000640 1 --2- 172.21.15.42:0/3739661322 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52680cf230 0x7f5268151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.923+0000 7f5266a00640 1 --2- 172.21.15.42:0/3739661322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f526806cd20 0x7f526814ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.923+0000 7f5266000640 1 -- 172.21.15.42:0/3739661322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f526806cd20 msgr2=0x7f526814ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:29.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.923+0000 7f5266000640 1 --2- 172.21.15.42:0/3739661322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f526806cd20 0x7f526814ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.923+0000 7f5266000640 1 -- 172.21.15.42:0/3739661322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f526815e3c0 msgr2=0x7f5268152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:29.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.923+0000 7f5266000640 1 --2- 172.21.15.42:0/3739661322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f526815e3c0 0x7f5268152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:29.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.923+0000 7f5266000640 1 -- 172.21.15.42:0/3739661322 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5268075060 con 0x7f52680cf230 2024-09-17T01:43:29.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.923+0000 7f5267400640 1 --2- 172.21.15.42:0/3739661322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f526815e3c0 0x7f5268152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:43:29.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.923+0000 7f5266000640 1 --2- 172.21.15.42:0/3739661322 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52680cf230 0x7f5268151f50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f525400ea20 tx=0x7f525400eee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:29.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.924+0000 7f525f400640 1 -- 172.21.15.42:0/3739661322 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525400ccc0 con 0x7f52680cf230 2024-09-17T01:43:29.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.924+0000 7f525f400640 1 -- 172.21.15.42:0/3739661322 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f525400ce60 con 0x7f52680cf230 2024-09-17T01:43:29.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.924+0000 7f5267e00640 1 -- 172.21.15.42:0/3739661322 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5268152c20 con 0x7f52680cf230 2024-09-17T01:43:29.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.924+0000 7f525f400640 1 -- 172.21.15.42:0/3739661322 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254004280 con 0x7f52680cf230 2024-09-17T01:43:29.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.924+0000 7f5267e00640 1 -- 172.21.15.42:0/3739661322 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5268072540 con 0x7f52680cf230 2024-09-17T01:43:29.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.925+0000 7f5267e00640 1 -- 172.21.15.42:0/3739661322 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f526806d130 con 0x7f52680cf230 2024-09-17T01:43:29.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.926+0000 7f525f400640 1 -- 172.21.15.42:0/3739661322 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f52540035f0 con 0x7f52680cf230 2024-09-17T01:43:29.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.927+0000 7f525f400640 1 --2- 172.21.15.42:0/3739661322 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5248078b90 0x7f524807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:29.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.927+0000 7f525f400640 1 -- 172.21.15.42:0/3739661322 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f525409b500 con 0x7f52680cf230 2024-09-17T01:43:29.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.928+0000 7f5266a00640 1 --2- 172.21.15.42:0/3739661322 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5248078b90 0x7f524807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:29.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.928+0000 7f5266a00640 1 --2- 172.21.15.42:0/3739661322 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5248078b90 0x7f524807b0a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f5258034000 tx=0x7f5258004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:29.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:29.933+0000 7f525f400640 1 -- 172.21.15.42:0/3739661322 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5254063410 con 0x7f52680cf230 2024-09-17T01:43:30.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:30.201+0000 7f5267e00640 1 -- 172.21.15.42:0/3739661322 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f52680cf960 con 0x7f52680cf230 2024-09-17T01:43:30.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:30.202+0000 7f525f400640 1 -- 172.21.15.42:0/3739661322 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1231 (secure 0 0 0) 0x7f5254067e40 con 0x7f52680cf230 2024-09-17T01:43:30.201 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:30.201 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":710,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":147,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":905,"data_bytes":926897803,"bytes_used":2232942592,"bytes_avail":770861170688,"bytes_total":773094113280,"write_bytes_sec":41926119,"read_op_per_sec":0,"write_op_per_sec":52},"fsmap":{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":8982}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-17T01:42:37.163500+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:43:30.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:30.205+0000 7f5267e00640 1 -- 172.21.15.42:0/3739661322 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5248078b90 msgr2=0x7f524807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:30.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:30.205+0000 7f5267e00640 1 --2- 172.21.15.42:0/3739661322 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5248078b90 0x7f524807b0a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f5258034000 tx=0x7f5258004730 comp rx=0 tx=0).stop 2024-09-17T01:43:30.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:30.205+0000 7f5267e00640 1 -- 172.21.15.42:0/3739661322 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52680cf230 msgr2=0x7f5268151f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:30.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:30.205+0000 7f5267e00640 1 --2- 172.21.15.42:0/3739661322 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52680cf230 0x7f5268151f50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f525400ea20 tx=0x7f525400eee0 comp rx=0 tx=0).stop 2024-09-17T01:43:30.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:30.205+0000 7f5267e00640 1 -- 172.21.15.42:0/3739661322 shutdown_connections 2024-09-17T01:43:30.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:30.205+0000 7f5267e00640 1 --2- 172.21.15.42:0/3739661322 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5248078b90 0x7f524807b0a0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:30.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:30.205+0000 7f5267e00640 1 --2- 172.21.15.42:0/3739661322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f526815e3c0 0x7f5268152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:30.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:30.205+0000 7f5267e00640 1 --2- 172.21.15.42:0/3739661322 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52680cf230 0x7f5268151f50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:30.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:30.205+0000 7f5267e00640 1 --2- 172.21.15.42:0/3739661322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f526806cd20 0x7f526814ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:30.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:30.205+0000 7f5267e00640 1 -- 172.21.15.42:0/3739661322 >> 172.21.15.42:0/3739661322 conn(0x7f52680b25f0 msgr2=0x7f52680af4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:30.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:30.205+0000 7f5267e00640 1 -- 172.21.15.42:0/3739661322 shutdown_connections 2024-09-17T01:43:30.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:30.205+0000 7f5267e00640 1 -- 172.21.15.42:0/3739661322 wait complete. 2024-09-17T01:43:30.225 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T01:43:31.226 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:43:31.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.469+0000 7f7458000640 1 -- 172.21.15.42:0/3469827724 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7450142f40 msgr2=0x7f7450072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:31.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.469+0000 7f7458000640 1 --2- 172.21.15.42:0/3469827724 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7450142f40 0x7f7450072950 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f743c005fd0 tx=0x7f743c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:43:31.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.469+0000 7f7458000640 1 -- 172.21.15.42:0/3469827724 shutdown_connections 2024-09-17T01:43:31.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.469+0000 7f7458000640 1 --2- 172.21.15.42:0/3469827724 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7450072e90 0x7f74500cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:31.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.469+0000 7f7458000640 1 --2- 172.21.15.42:0/3469827724 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7450142f40 0x7f7450072950 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:31.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.469+0000 7f7458000640 1 -- 172.21.15.42:0/3469827724 >> 172.21.15.42:0/3469827724 conn(0x7f74500b2930 msgr2=0x7f745006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:31.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.469+0000 7f7458000640 1 -- 172.21.15.42:0/3469827724 shutdown_connections 2024-09-17T01:43:31.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.469+0000 7f7458000640 1 -- 172.21.15.42:0/3469827724 wait complete. 2024-09-17T01:43:31.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.471+0000 7f7458000640 1 Processor -- start 2024-09-17T01:43:31.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.472+0000 7f7458000640 1 -- start start 2024-09-17T01:43:31.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.473+0000 7f7458000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7450072e90 0x7f74501f6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:31.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.473+0000 7f7458000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74500b3550 0x7f745006fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:31.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.473+0000 7f7458000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7450142f40 0x7f74500b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:31.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.473+0000 7f7458000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f745006d640 con 0x7f74500b3550 2024-09-17T01:43:31.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.473+0000 7f7458000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f74500cf590 con 0x7f7450142f40 2024-09-17T01:43:31.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.473+0000 7f7458000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f745006d7c0 con 0x7f7450072e90 2024-09-17T01:43:31.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.473+0000 7f7454c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74500b3550 0x7f745006fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:31.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.473+0000 7f7454c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74500b3550 0x7f745006fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57192/0 (socket says 172.21.15.42:57192) 2024-09-17T01:43:31.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.473+0000 7f7454c00640 1 -- 172.21.15.42:0/3749721858 learned_addr learned my addr 172.21.15.42:0/3749721858 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:31.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.473+0000 7f7455600640 1 --2- 172.21.15.42:0/3749721858 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7450072e90 0x7f74501f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:31.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.474+0000 7f7456000640 1 --2- 172.21.15.42:0/3749721858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7450142f40 0x7f74500b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:31.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.474+0000 7f7454c00640 1 -- 172.21.15.42:0/3749721858 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7450072e90 msgr2=0x7f74501f6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:31.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.474+0000 7f7454c00640 1 --2- 172.21.15.42:0/3749721858 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7450072e90 0x7f74501f6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:31.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.474+0000 7f7454c00640 1 -- 172.21.15.42:0/3749721858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7450142f40 msgr2=0x7f74500b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:31.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.474+0000 7f7454c00640 1 --2- 172.21.15.42:0/3749721858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7450142f40 0x7f74500b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:31.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.474+0000 7f7454c00640 1 -- 172.21.15.42:0/3749721858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7450070020 con 0x7f74500b3550 2024-09-17T01:43:31.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.474+0000 7f7454c00640 1 --2- 172.21.15.42:0/3749721858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74500b3550 0x7f745006fae0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f743c034040 tx=0x7f743c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:31.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.474+0000 7f744d600640 1 -- 172.21.15.42:0/3749721858 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743c03e030 con 0x7f74500b3550 2024-09-17T01:43:31.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.474+0000 7f744d600640 1 -- 172.21.15.42:0/3749721858 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f743c003d90 con 0x7f74500b3550 2024-09-17T01:43:31.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.474+0000 7f744d600640 1 -- 172.21.15.42:0/3749721858 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743c035040 con 0x7f74500b3550 2024-09-17T01:43:31.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.475+0000 7f7458000640 1 -- 172.21.15.42:0/3749721858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f745013e230 con 0x7f74500b3550 2024-09-17T01:43:31.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.475+0000 7f7458000640 1 -- 172.21.15.42:0/3749721858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f745013e7f0 con 0x7f74500b3550 2024-09-17T01:43:31.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.476+0000 7f7458000640 1 -- 172.21.15.42:0/3749721858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f745006a3f0 con 0x7f74500b3550 2024-09-17T01:43:31.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.477+0000 7f744d600640 1 -- 172.21.15.42:0/3749721858 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f743c041030 con 0x7f74500b3550 2024-09-17T01:43:31.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.478+0000 7f744d600640 1 --2- 172.21.15.42:0/3749721858 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7430078bc0 0x7f743007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:31.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.478+0000 7f744d600640 1 -- 172.21.15.42:0/3749721858 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f743c0bb7f0 con 0x7f74500b3550 2024-09-17T01:43:31.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.478+0000 7f7455600640 1 --2- 172.21.15.42:0/3749721858 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7430078bc0 0x7f743007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:31.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.479+0000 7f7455600640 1 --2- 172.21.15.42:0/3749721858 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7430078bc0 0x7f743007b0d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7444006fd0 tx=0x7f7444009060 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:31.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.482+0000 7f744d600640 1 -- 172.21.15.42:0/3749721858 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f743c0835d0 con 0x7f74500b3550 2024-09-17T01:43:31.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.715+0000 7f7458000640 1 -- 172.21.15.42:0/3749721858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f745006a170 con 0x7f74500b3550 2024-09-17T01:43:31.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.715+0000 7f744d600640 1 -- 172.21.15.42:0/3749721858 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) ==== 95+0+5230 (secure 0 0 0) 0x7f743c088000 con 0x7f74500b3550 2024-09-17T01:43:31.713 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:31.713 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3131119825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3131119825},{"type":"v1","addr":"172.21.15.43:6837","nonce":3131119825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8368,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1988657429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1988657429},{"type":"v1","addr":"172.21.15.43:6836","nonce":1988657429}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/578887548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":578887548},{"type":"v1","addr":"172.21.15.42:6835","nonce":578887548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:42:57.184518+0000","modified":"2024-09-17T01:43:00.201156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8982":{"gid":8982,"name":"c","rank":0,"incarnation":112,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6834/3811049376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3811049376},{"type":"v1","addr":"172.21.15.42:6834","nonce":3811049376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8982,"qdb_cluster":[8982]},"id":10}]} 2024-09-17T01:43:31.714 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 116 2024-09-17T01:43:31.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.718+0000 7f7458000640 1 -- 172.21.15.42:0/3749721858 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7430078bc0 msgr2=0x7f743007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:31.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.718+0000 7f7458000640 1 --2- 172.21.15.42:0/3749721858 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7430078bc0 0x7f743007b0d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7444006fd0 tx=0x7f7444009060 comp rx=0 tx=0).stop 2024-09-17T01:43:31.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.718+0000 7f7458000640 1 -- 172.21.15.42:0/3749721858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74500b3550 msgr2=0x7f745006fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:31.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.718+0000 7f7458000640 1 --2- 172.21.15.42:0/3749721858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74500b3550 0x7f745006fae0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f743c034040 tx=0x7f743c0038a0 comp rx=0 tx=0).stop 2024-09-17T01:43:31.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.718+0000 7f7458000640 1 -- 172.21.15.42:0/3749721858 shutdown_connections 2024-09-17T01:43:31.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.718+0000 7f7458000640 1 --2- 172.21.15.42:0/3749721858 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7430078bc0 0x7f743007b0d0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:31.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.718+0000 7f7458000640 1 --2- 172.21.15.42:0/3749721858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7450142f40 0x7f74500b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:31.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.718+0000 7f7458000640 1 --2- 172.21.15.42:0/3749721858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74500b3550 0x7f745006fae0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:31.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.718+0000 7f7458000640 1 --2- 172.21.15.42:0/3749721858 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7450072e90 0x7f74501f6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:31.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.718+0000 7f7458000640 1 -- 172.21.15.42:0/3749721858 >> 172.21.15.42:0/3749721858 conn(0x7f74500b2930 msgr2=0x7f745015af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:31.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.718+0000 7f7458000640 1 -- 172.21.15.42:0/3749721858 shutdown_connections 2024-09-17T01:43:31.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.718+0000 7f7458000640 1 -- 172.21.15.42:0/3749721858 wait complete. 2024-09-17T01:43:31.737 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T01:43:31.737 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:43:31.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.966+0000 7f4071800640 1 -- 172.21.15.42:0/2372257701 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f406c15cb80 msgr2=0x7f406c152710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:31.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.966+0000 7f4071800640 1 --2- 172.21.15.42:0/2372257701 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f406c15cb80 0x7f406c152710 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f405c009860 tx=0x7f405c02a530 comp rx=0 tx=0).stop 2024-09-17T01:43:31.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.966+0000 7f4071800640 1 -- 172.21.15.42:0/2372257701 shutdown_connections 2024-09-17T01:43:31.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.966+0000 7f4071800640 1 --2- 172.21.15.42:0/2372257701 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f406c15cb80 0x7f406c152710 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:31.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.966+0000 7f4071800640 1 -- 172.21.15.42:0/2372257701 >> 172.21.15.42:0/2372257701 conn(0x7f406c0b2930 msgr2=0x7f406c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:31.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.966+0000 7f4071800640 1 -- 172.21.15.42:0/2372257701 shutdown_connections 2024-09-17T01:43:31.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.966+0000 7f4071800640 1 -- 172.21.15.42:0/2372257701 wait complete. 2024-09-17T01:43:31.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.968+0000 7f4071800640 1 Processor -- start 2024-09-17T01:43:31.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.969+0000 7f4071800640 1 -- start start 2024-09-17T01:43:31.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.970+0000 7f4071800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f406c06d430 0x7f406c154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:31.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.970+0000 7f4071800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f406c15cb80 0x7f406c075c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:31.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.970+0000 7f4071800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f406c15f480 0x7f406c0761c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:31.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.970+0000 7f4071800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f406c0739e0 con 0x7f406c06d430 2024-09-17T01:43:31.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.970+0000 7f4071800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f406c073860 con 0x7f406c15cb80 2024-09-17T01:43:31.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.970+0000 7f4071800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f406c073b60 con 0x7f406c15f480 2024-09-17T01:43:31.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.970+0000 7f406aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f406c06d430 0x7f406c154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:31.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.970+0000 7f406aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f406c06d430 0x7f406c154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57200/0 (socket says 172.21.15.42:57200) 2024-09-17T01:43:31.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.970+0000 7f406aa00640 1 -- 172.21.15.42:0/2490380881 learned_addr learned my addr 172.21.15.42:0/2490380881 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:31.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.971+0000 7f406a000640 1 --2- 172.21.15.42:0/2490380881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f406c15cb80 0x7f406c075c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:31.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.971+0000 7f406b400640 1 --2- 172.21.15.42:0/2490380881 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f406c15f480 0x7f406c0761c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:31.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.971+0000 7f406aa00640 1 -- 172.21.15.42:0/2490380881 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f406c15f480 msgr2=0x7f406c0761c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.971+0000 7f406aa00640 1 --2- 172.21.15.42:0/2490380881 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f406c15f480 0x7f406c0761c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.971+0000 7f406aa00640 1 -- 172.21.15.42:0/2490380881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f406c15cb80 msgr2=0x7f406c075c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.971+0000 7f406aa00640 1 --2- 172.21.15.42:0/2490380881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f406c15cb80 0x7f406c075c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.971+0000 7f406aa00640 1 -- 172.21.15.42:0/2490380881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f406c154f60 con 0x7f406c06d430 2024-09-17T01:43:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.971+0000 7f406aa00640 1 --2- 172.21.15.42:0/2490380881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f406c06d430 0x7f406c154a20 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f405c009980 tx=0x7f405c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:31.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.972+0000 7f4062a00640 1 -- 172.21.15.42:0/2490380881 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405c005c90 con 0x7f406c06d430 2024-09-17T01:43:31.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.972+0000 7f4062a00640 1 -- 172.21.15.42:0/2490380881 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f405c0317c0 con 0x7f406c06d430 2024-09-17T01:43:31.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.972+0000 7f4062a00640 1 -- 172.21.15.42:0/2490380881 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405c031bf0 con 0x7f406c06d430 2024-09-17T01:43:31.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.972+0000 7f4071800640 1 -- 172.21.15.42:0/2490380881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f406c1e6420 con 0x7f406c06d430 2024-09-17T01:43:31.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.972+0000 7f4071800640 1 -- 172.21.15.42:0/2490380881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f406c1e69e0 con 0x7f406c06d430 2024-09-17T01:43:31.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.973+0000 7f4071800640 1 -- 172.21.15.42:0/2490380881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f406c152710 con 0x7f406c06d430 2024-09-17T01:43:31.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.974+0000 7f4062a00640 1 -- 172.21.15.42:0/2490380881 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f405c03b410 con 0x7f406c06d430 2024-09-17T01:43:31.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.975+0000 7f4062a00640 1 --2- 172.21.15.42:0/2490380881 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f404c078b90 0x7f404c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:31.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.975+0000 7f4062a00640 1 -- 172.21.15.42:0/2490380881 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f405c0bc110 con 0x7f406c06d430 2024-09-17T01:43:31.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.976+0000 7f406a000640 1 --2- 172.21.15.42:0/2490380881 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f404c078b90 0x7f404c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:31.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.976+0000 7f406a000640 1 --2- 172.21.15.42:0/2490380881 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f404c078b90 0x7f404c07b0a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f406c1466d0 tx=0x7f4058009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:31.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:31.979+0000 7f4062a00640 1 -- 172.21.15.42:0/2490380881 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f405c03f030 con 0x7f406c06d430 2024-09-17T01:43:32.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:32.248+0000 7f4071800640 1 -- 172.21.15.42:0/2490380881 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f406c06a170 con 0x7f406c06d430 2024-09-17T01:43:32.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:32.248+0000 7f4062a00640 1 -- 172.21.15.42:0/2490380881 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1233 (secure 0 0 0) 0x7f405c0844c0 con 0x7f406c06d430 2024-09-17T01:43:32.246 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:32.246 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":712,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":147,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076844171,"bytes_used":2594648064,"bytes_avail":770499465216,"bytes_total":773094113280,"write_bytes_sec":52718498,"read_op_per_sec":0,"write_op_per_sec":64},"fsmap":{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":8982}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-17T01:42:37.163500+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:43:32.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:32.251+0000 7f4071800640 1 -- 172.21.15.42:0/2490380881 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f404c078b90 msgr2=0x7f404c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:32.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:32.251+0000 7f4071800640 1 --2- 172.21.15.42:0/2490380881 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f404c078b90 0x7f404c07b0a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f406c1466d0 tx=0x7f4058009040 comp rx=0 tx=0).stop 2024-09-17T01:43:32.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:32.251+0000 7f4071800640 1 -- 172.21.15.42:0/2490380881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f406c06d430 msgr2=0x7f406c154a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:32.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:32.251+0000 7f4071800640 1 --2- 172.21.15.42:0/2490380881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f406c06d430 0x7f406c154a20 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f405c009980 tx=0x7f405c003c10 comp rx=0 tx=0).stop 2024-09-17T01:43:32.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:32.251+0000 7f4071800640 1 -- 172.21.15.42:0/2490380881 shutdown_connections 2024-09-17T01:43:32.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:32.251+0000 7f4071800640 1 --2- 172.21.15.42:0/2490380881 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f404c078b90 0x7f404c07b0a0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:32.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:32.251+0000 7f4071800640 1 --2- 172.21.15.42:0/2490380881 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f406c15cb80 0x7f406c075c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:32.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:32.251+0000 7f4071800640 1 --2- 172.21.15.42:0/2490380881 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f406c15f480 0x7f406c0761c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:32.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:32.251+0000 7f4071800640 1 --2- 172.21.15.42:0/2490380881 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f406c06d430 0x7f406c154a20 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:32.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:32.251+0000 7f4071800640 1 -- 172.21.15.42:0/2490380881 >> 172.21.15.42:0/2490380881 conn(0x7f406c0b2930 msgr2=0x7f406c155130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:32.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:32.251+0000 7f4071800640 1 -- 172.21.15.42:0/2490380881 shutdown_connections 2024-09-17T01:43:32.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:32.251+0000 7f4071800640 1 -- 172.21.15.42:0/2490380881 wait complete. 2024-09-17T01:43:32.269 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T01:43:33.271 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:43:33.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.509+0000 7feecae00640 1 -- 172.21.15.42:0/3398636631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec415e3c0 msgr2=0x7feec415e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:33.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.509+0000 7feecae00640 1 --2- 172.21.15.42:0/3398636631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec415e3c0 0x7feec415e7d0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7feec406dad0 tx=0x7feebc02a6f0 comp rx=0 tx=0).stop 2024-09-17T01:43:33.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.509+0000 7feecae00640 1 -- 172.21.15.42:0/3398636631 shutdown_connections 2024-09-17T01:43:33.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.509+0000 7feecae00640 1 --2- 172.21.15.42:0/3398636631 >> v2:172.21.15.43:3300/0 conn(0x7feec40cf230 0x7feec40cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:33.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.509+0000 7feecae00640 1 --2- 172.21.15.42:0/3398636631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec415e3c0 0x7feec415e7d0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:33.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.509+0000 7feecae00640 1 --2- 172.21.15.42:0/3398636631 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feec406cd20 0x7feec406d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:33.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.510+0000 7feecae00640 1 -- 172.21.15.42:0/3398636631 >> 172.21.15.42:0/3398636631 conn(0x7feec40b25f0 msgr2=0x7feec40d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:33.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.510+0000 7feecae00640 1 -- 172.21.15.42:0/3398636631 shutdown_connections 2024-09-17T01:43:33.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.510+0000 7feecae00640 1 -- 172.21.15.42:0/3398636631 wait complete. 2024-09-17T01:43:33.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.512+0000 7feecae00640 1 Processor -- start 2024-09-17T01:43:33.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.512+0000 7feecae00640 1 -- start start 2024-09-17T01:43:33.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.513+0000 7feecae00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feec406cd20 0x7feec40b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:33.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.513+0000 7feecae00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feec40cf230 0x7feec40721c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:33.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.513+0000 7feecae00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec415e3c0 0x7feec41f26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:33.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.513+0000 7feecae00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7feec41552a0 con 0x7feec415e3c0 2024-09-17T01:43:33.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.513+0000 7feecae00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7feec4155120 con 0x7feec40cf230 2024-09-17T01:43:33.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.513+0000 7feecae00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7feec40702f0 con 0x7feec406cd20 2024-09-17T01:43:33.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.514+0000 7feeca400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec415e3c0 0x7feec41f26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:33.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.514+0000 7feeca400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec415e3c0 0x7feec41f26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57218/0 (socket says 172.21.15.42:57218) 2024-09-17T01:43:33.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.514+0000 7feeca400640 1 -- 172.21.15.42:0/2842798674 learned_addr learned my addr 172.21.15.42:0/2842798674 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:33.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.514+0000 7feec9000640 1 --2- 172.21.15.42:0/2842798674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feec40cf230 0x7feec40721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:33.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.514+0000 7feec9a00640 1 --2- 172.21.15.42:0/2842798674 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feec406cd20 0x7feec40b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:33.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.514+0000 7feeca400640 1 -- 172.21.15.42:0/2842798674 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feec406cd20 msgr2=0x7feec40b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:33.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.514+0000 7feeca400640 1 --2- 172.21.15.42:0/2842798674 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feec406cd20 0x7feec40b0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:33.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.514+0000 7feeca400640 1 -- 172.21.15.42:0/2842798674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feec40cf230 msgr2=0x7feec40721c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:33.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.514+0000 7feeca400640 1 --2- 172.21.15.42:0/2842798674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feec40cf230 0x7feec40721c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:33.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.514+0000 7feeca400640 1 -- 172.21.15.42:0/2842798674 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec4072700 con 0x7feec415e3c0 2024-09-17T01:43:33.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.514+0000 7feec9a00640 1 --2- 172.21.15.42:0/2842798674 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feec406cd20 0x7feec40b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:43:33.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.514+0000 7feec9000640 1 --2- 172.21.15.42:0/2842798674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feec40cf230 0x7feec40721c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:43:33.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.514+0000 7feeca400640 1 --2- 172.21.15.42:0/2842798674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec415e3c0 0x7feec41f26f0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7feebc005fd0 tx=0x7feebc003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:33.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.515+0000 7feec1600640 1 -- 172.21.15.42:0/2842798674 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc004220 con 0x7feec415e3c0 2024-09-17T01:43:33.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.515+0000 7feec1600640 1 -- 172.21.15.42:0/2842798674 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feebc0043c0 con 0x7feec415e3c0 2024-09-17T01:43:33.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.515+0000 7feec1600640 1 -- 172.21.15.42:0/2842798674 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc004810 con 0x7feec415e3c0 2024-09-17T01:43:33.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.515+0000 7feecae00640 1 -- 172.21.15.42:0/2842798674 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec41f5300 con 0x7feec415e3c0 2024-09-17T01:43:33.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.515+0000 7feecae00640 1 -- 172.21.15.42:0/2842798674 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec41f9330 con 0x7feec415e3c0 2024-09-17T01:43:33.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.516+0000 7feecae00640 1 -- 172.21.15.42:0/2842798674 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feec41f8dc0 con 0x7feec415e3c0 2024-09-17T01:43:33.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.517+0000 7feec1600640 1 -- 172.21.15.42:0/2842798674 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feebc03b410 con 0x7feec415e3c0 2024-09-17T01:43:33.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.518+0000 7feec1600640 1 --2- 172.21.15.42:0/2842798674 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feea4078b90 0x7feea407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:33.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.518+0000 7feec1600640 1 -- 172.21.15.42:0/2842798674 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7feebc0bc2a0 con 0x7feec415e3c0 2024-09-17T01:43:33.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.519+0000 7feec9a00640 1 --2- 172.21.15.42:0/2842798674 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feea4078b90 0x7feea407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:33.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.519+0000 7feec9a00640 1 --2- 172.21.15.42:0/2842798674 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feea4078b90 0x7feea407b0a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7feeb800dbe0 tx=0x7feeb8005e50 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:33.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.523+0000 7feec1600640 1 -- 172.21.15.42:0/2842798674 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feebc03f030 con 0x7feec415e3c0 2024-09-17T01:43:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.754+0000 7feecae00640 1 -- 172.21.15.42:0/2842798674 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feec41f2c30 con 0x7feec415e3c0 2024-09-17T01:43:33.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.754+0000 7feec1600640 1 -- 172.21.15.42:0/2842798674 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) ==== 95+0+5230 (secure 0 0 0) 0x7feec406d670 con 0x7feec415e3c0 2024-09-17T01:43:33.754 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:33.754 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3131119825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3131119825},{"type":"v1","addr":"172.21.15.43:6837","nonce":3131119825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8368,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1988657429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1988657429},{"type":"v1","addr":"172.21.15.43:6836","nonce":1988657429}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/578887548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":578887548},{"type":"v1","addr":"172.21.15.42:6835","nonce":578887548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:42:57.184518+0000","modified":"2024-09-17T01:43:00.201156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8982":{"gid":8982,"name":"c","rank":0,"incarnation":112,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6834/3811049376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3811049376},{"type":"v1","addr":"172.21.15.42:6834","nonce":3811049376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8982,"qdb_cluster":[8982]},"id":10}]} 2024-09-17T01:43:33.754 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 116 2024-09-17T01:43:33.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.756+0000 7feecae00640 1 -- 172.21.15.42:0/2842798674 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feea4078b90 msgr2=0x7feea407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:33.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.756+0000 7feecae00640 1 --2- 172.21.15.42:0/2842798674 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feea4078b90 0x7feea407b0a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7feeb800dbe0 tx=0x7feeb8005e50 comp rx=0 tx=0).stop 2024-09-17T01:43:33.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.757+0000 7feecae00640 1 -- 172.21.15.42:0/2842798674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec415e3c0 msgr2=0x7feec41f26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:33.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.757+0000 7feecae00640 1 --2- 172.21.15.42:0/2842798674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec415e3c0 0x7feec41f26f0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7feebc005fd0 tx=0x7feebc003c20 comp rx=0 tx=0).stop 2024-09-17T01:43:33.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.757+0000 7feecae00640 1 -- 172.21.15.42:0/2842798674 shutdown_connections 2024-09-17T01:43:33.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.757+0000 7feecae00640 1 --2- 172.21.15.42:0/2842798674 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feea4078b90 0x7feea407b0a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:33.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.757+0000 7feecae00640 1 --2- 172.21.15.42:0/2842798674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feec40cf230 0x7feec40721c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:33.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.757+0000 7feecae00640 1 --2- 172.21.15.42:0/2842798674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec415e3c0 0x7feec41f26f0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:33.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.757+0000 7feecae00640 1 --2- 172.21.15.42:0/2842798674 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feec406cd20 0x7feec40b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:33.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.757+0000 7feecae00640 1 -- 172.21.15.42:0/2842798674 >> 172.21.15.42:0/2842798674 conn(0x7feec40b25f0 msgr2=0x7feec40749b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:33.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.757+0000 7feecae00640 1 -- 172.21.15.42:0/2842798674 shutdown_connections 2024-09-17T01:43:33.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:33.757+0000 7feecae00640 1 -- 172.21.15.42:0/2842798674 wait complete. 2024-09-17T01:43:33.779 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T01:43:33.779 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:43:34.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.005+0000 7fa5fbe00640 1 -- 172.21.15.42:0/3816336955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5f415f190 msgr2=0x7fa5f406fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:34.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.005+0000 7fa5fbe00640 1 --2- 172.21.15.42:0/3816336955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5f415f190 0x7fa5f406fe40 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec005fd0 tx=0x7fa5ec02a790 comp rx=0 tx=0).stop 2024-09-17T01:43:34.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.005+0000 7fa5fbe00640 1 -- 172.21.15.42:0/3816336955 shutdown_connections 2024-09-17T01:43:34.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.005+0000 7fa5fbe00640 1 --2- 172.21.15.42:0/3816336955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5f415f190 0x7fa5f406fe40 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:34.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.005+0000 7fa5fbe00640 1 --2- 172.21.15.42:0/3816336955 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa5f406db40 0x7fa5f415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:34.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.005+0000 7fa5fbe00640 1 -- 172.21.15.42:0/3816336955 >> 172.21.15.42:0/3816336955 conn(0x7fa5f40b2930 msgr2=0x7fa5f406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:34.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.006+0000 7fa5fbe00640 1 -- 172.21.15.42:0/3816336955 shutdown_connections 2024-09-17T01:43:34.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.006+0000 7fa5fbe00640 1 -- 172.21.15.42:0/3816336955 wait complete. 2024-09-17T01:43:34.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.008+0000 7fa5fbe00640 1 Processor -- start 2024-09-17T01:43:34.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.008+0000 7fa5fbe00640 1 -- start start 2024-09-17T01:43:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.009+0000 7fa5fbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5f4072e00 0x7fa5f414ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.009+0000 7fa5fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5f415f190 0x7fa5f4154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.009+0000 7fa5fbe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa5f40ccc10 0x7fa5f40cd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.009+0000 7fa5fbe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f4151520 con 0x7fa5f415f190 2024-09-17T01:43:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.009+0000 7fa5fbe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f4070740 con 0x7fa5f4072e00 2024-09-17T01:43:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.009+0000 7fa5fbe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa5f41516a0 con 0x7fa5f40ccc10 2024-09-17T01:43:34.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.010+0000 7fa5f8a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5f415f190 0x7fa5f4154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:34.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.010+0000 7fa5f8a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5f415f190 0x7fa5f4154620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57232/0 (socket says 172.21.15.42:57232) 2024-09-17T01:43:34.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.010+0000 7fa5f8a00640 1 -- 172.21.15.42:0/3045670861 learned_addr learned my addr 172.21.15.42:0/3045670861 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:34.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.010+0000 7fa5f9400640 1 --2- 172.21.15.42:0/3045670861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5f4072e00 0x7fa5f414ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:34.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.010+0000 7fa5f9e00640 1 --2- 172.21.15.42:0/3045670861 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa5f40ccc10 0x7fa5f40cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:34.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.010+0000 7fa5f8a00640 1 -- 172.21.15.42:0/3045670861 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa5f40ccc10 msgr2=0x7fa5f40cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:34.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.010+0000 7fa5f8a00640 1 --2- 172.21.15.42:0/3045670861 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa5f40ccc10 0x7fa5f40cd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:34.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.010+0000 7fa5f8a00640 1 -- 172.21.15.42:0/3045670861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5f4072e00 msgr2=0x7fa5f414ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:34.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.010+0000 7fa5f8a00640 1 --2- 172.21.15.42:0/3045670861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5f4072e00 0x7fa5f414ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:34.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.010+0000 7fa5f8a00640 1 -- 172.21.15.42:0/3045670861 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f40cd560 con 0x7fa5f415f190 2024-09-17T01:43:34.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.010+0000 7fa5f8a00640 1 --2- 172.21.15.42:0/3045670861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5f415f190 0x7fa5f4154620 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000da30 tx=0x7fa5e000def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:34.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.011+0000 7fa5f1600640 1 -- 172.21.15.42:0/3045670861 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e000adc0 con 0x7fa5f415f190 2024-09-17T01:43:34.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.011+0000 7fa5f1600640 1 -- 172.21.15.42:0/3045670861 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5e0005110 con 0x7fa5f415f190 2024-09-17T01:43:34.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.011+0000 7fa5f1600640 1 -- 172.21.15.42:0/3045670861 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0005560 con 0x7fa5f415f190 2024-09-17T01:43:34.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.011+0000 7fa5fbe00640 1 -- 172.21.15.42:0/3045670861 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f414ef50 con 0x7fa5f415f190 2024-09-17T01:43:34.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.011+0000 7fa5fbe00640 1 -- 172.21.15.42:0/3045670861 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f415d220 con 0x7fa5f415f190 2024-09-17T01:43:34.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.012+0000 7fa5fbe00640 1 -- 172.21.15.42:0/3045670861 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5f415c360 con 0x7fa5f415f190 2024-09-17T01:43:34.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.014+0000 7fa5f1600640 1 -- 172.21.15.42:0/3045670861 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa5e00047a0 con 0x7fa5f415f190 2024-09-17T01:43:34.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.015+0000 7fa5f1600640 1 --2- 172.21.15.42:0/3045670861 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa5d4078bc0 0x7fa5d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:34.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.015+0000 7fa5f1600640 1 -- 172.21.15.42:0/3045670861 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fa5e009b3c0 con 0x7fa5f415f190 2024-09-17T01:43:34.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.016+0000 7fa5f9400640 1 --2- 172.21.15.42:0/3045670861 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa5d4078bc0 0x7fa5d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:34.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.017+0000 7fa5f9400640 1 --2- 172.21.15.42:0/3045670861 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa5d4078bc0 0x7fa5d407b0d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8001720 tx=0x7fa5e8009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:34.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.019+0000 7fa5f1600640 1 -- 172.21.15.42:0/3045670861 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa5f40cd560 con 0x7fa5f415f190 2024-09-17T01:43:34.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.289+0000 7fa5fbe00640 1 -- 172.21.15.42:0/3045670861 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa5f406a170 con 0x7fa5f415f190 2024-09-17T01:43:34.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.290+0000 7fa5f1600640 1 -- 172.21.15.42:0/3045670861 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1233 (secure 0 0 0) 0x7fa5e0063220 con 0x7fa5f415f190 2024-09-17T01:43:34.289 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:34.289 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":714,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":147,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076844171,"bytes_used":2594648064,"bytes_avail":770499465216,"bytes_total":773094113280,"write_bytes_sec":33932898,"read_op_per_sec":0,"write_op_per_sec":45},"fsmap":{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":8982}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-17T01:42:37.163500+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:43:34.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.293+0000 7fa5fbe00640 1 -- 172.21.15.42:0/3045670861 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa5d4078bc0 msgr2=0x7fa5d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:34.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.293+0000 7fa5fbe00640 1 --2- 172.21.15.42:0/3045670861 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa5d4078bc0 0x7fa5d407b0d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8001720 tx=0x7fa5e8009040 comp rx=0 tx=0).stop 2024-09-17T01:43:34.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.293+0000 7fa5fbe00640 1 -- 172.21.15.42:0/3045670861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5f415f190 msgr2=0x7fa5f4154620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:34.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.293+0000 7fa5fbe00640 1 --2- 172.21.15.42:0/3045670861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5f415f190 0x7fa5f4154620 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000da30 tx=0x7fa5e000def0 comp rx=0 tx=0).stop 2024-09-17T01:43:34.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.293+0000 7fa5fbe00640 1 -- 172.21.15.42:0/3045670861 shutdown_connections 2024-09-17T01:43:34.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.293+0000 7fa5fbe00640 1 --2- 172.21.15.42:0/3045670861 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa5d4078bc0 0x7fa5d407b0d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:34.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.293+0000 7fa5fbe00640 1 --2- 172.21.15.42:0/3045670861 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa5f40ccc10 0x7fa5f40cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:34.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.293+0000 7fa5fbe00640 1 --2- 172.21.15.42:0/3045670861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5f415f190 0x7fa5f4154620 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:34.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.293+0000 7fa5fbe00640 1 --2- 172.21.15.42:0/3045670861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5f4072e00 0x7fa5f414ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:34.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.293+0000 7fa5fbe00640 1 -- 172.21.15.42:0/3045670861 >> 172.21.15.42:0/3045670861 conn(0x7fa5f40b2930 msgr2=0x7fa5f406f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:34.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.293+0000 7fa5fbe00640 1 -- 172.21.15.42:0/3045670861 shutdown_connections 2024-09-17T01:43:34.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:34.293+0000 7fa5fbe00640 1 -- 172.21.15.42:0/3045670861 wait complete. 2024-09-17T01:43:34.313 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T01:43:35.316 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:43:35.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.555+0000 7f7cd5200640 1 -- 172.21.15.42:0/4208382728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cd00d18b0 msgr2=0x7f7cd00d2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:35.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.555+0000 7f7cd5200640 1 --2- 172.21.15.42:0/4208382728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cd00d18b0 0x7f7cd00d2840 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f7cd00754a0 tx=0x7f7cb802a530 comp rx=0 tx=0).stop 2024-09-17T01:43:35.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.555+0000 7f7cd5200640 1 -- 172.21.15.42:0/4208382728 shutdown_connections 2024-09-17T01:43:35.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.555+0000 7f7cd5200640 1 --2- 172.21.15.42:0/4208382728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cd00d18b0 0x7f7cd00d2840 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:35.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.555+0000 7f7cd5200640 1 --2- 172.21.15.42:0/4208382728 >> v2:172.21.15.43:3300/0 conn(0x7f7cd015ea80 0x7f7cd00d1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:35.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.555+0000 7f7cd5200640 1 -- 172.21.15.42:0/4208382728 >> 172.21.15.42:0/4208382728 conn(0x7f7cd006cf00 msgr2=0x7f7cd006d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:35.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.555+0000 7f7cd5200640 1 -- 172.21.15.42:0/4208382728 shutdown_connections 2024-09-17T01:43:35.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.556+0000 7f7cd5200640 1 -- 172.21.15.42:0/4208382728 wait complete. 2024-09-17T01:43:35.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.558+0000 7f7cd5200640 1 Processor -- start 2024-09-17T01:43:35.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.558+0000 7f7cd5200640 1 -- start start 2024-09-17T01:43:35.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.559+0000 7f7cd5200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cd00d18b0 0x7f7cd00aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:35.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.559+0000 7f7cd5200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7cd00d2d80 0x7f7cd01f2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:35.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.559+0000 7f7cd5200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd015ea80 0x7f7cd01f8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:35.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.559+0000 7f7cd5200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd00b6760 con 0x7f7cd00d18b0 2024-09-17T01:43:35.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.559+0000 7f7cd5200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd00b94a0 con 0x7f7cd015ea80 2024-09-17T01:43:35.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.559+0000 7f7cd5200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd00b68e0 con 0x7f7cd00d2d80 2024-09-17T01:43:35.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.559+0000 7f7ccf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cd00d18b0 0x7f7cd00aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:35.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.560+0000 7f7ccf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cd00d18b0 0x7f7cd00aaf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57246/0 (socket says 172.21.15.42:57246) 2024-09-17T01:43:35.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.560+0000 7f7ccf400640 1 -- 172.21.15.42:0/3862881425 learned_addr learned my addr 172.21.15.42:0/3862881425 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:35.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.560+0000 7f7ccfe00640 1 --2- 172.21.15.42:0/3862881425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd015ea80 0x7f7cd01f8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:35.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.560+0000 7f7cc6a00640 1 --2- 172.21.15.42:0/3862881425 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7cd00d2d80 0x7f7cd01f2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:35.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.560+0000 7f7ccf400640 1 -- 172.21.15.42:0/3862881425 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7cd00d2d80 msgr2=0x7f7cd01f2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:35.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.560+0000 7f7ccf400640 1 --2- 172.21.15.42:0/3862881425 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7cd00d2d80 0x7f7cd01f2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:35.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.560+0000 7f7ccf400640 1 -- 172.21.15.42:0/3862881425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd015ea80 msgr2=0x7f7cd01f8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:35.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.560+0000 7f7ccf400640 1 --2- 172.21.15.42:0/3862881425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd015ea80 0x7f7cd01f8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:35.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.560+0000 7f7ccf400640 1 -- 172.21.15.42:0/3862881425 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd00ab7c0 con 0x7f7cd00d18b0 2024-09-17T01:43:35.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.560+0000 7f7ccfe00640 1 --2- 172.21.15.42:0/3862881425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd015ea80 0x7f7cd01f8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:43:35.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.560+0000 7f7ccf400640 1 --2- 172.21.15.42:0/3862881425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cd00d18b0 0x7f7cd00aaf70 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000d770 tx=0x7f7cc000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:35.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.561+0000 7f7cc7e00640 1 -- 172.21.15.42:0/3862881425 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0017070 con 0x7f7cd00d18b0 2024-09-17T01:43:35.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.561+0000 7f7cc7e00640 1 -- 172.21.15.42:0/3862881425 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7cc0009d20 con 0x7f7cd00d18b0 2024-09-17T01:43:35.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.561+0000 7f7cc7e00640 1 -- 172.21.15.42:0/3862881425 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00106c0 con 0x7f7cd00d18b0 2024-09-17T01:43:35.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.561+0000 7f7cd5200640 1 -- 172.21.15.42:0/3862881425 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cd00abaa0 con 0x7f7cd00d18b0 2024-09-17T01:43:35.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.561+0000 7f7cd5200640 1 -- 172.21.15.42:0/3862881425 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cd00ac060 con 0x7f7cd00d18b0 2024-09-17T01:43:35.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.562+0000 7f7cd5200640 1 -- 172.21.15.42:0/3862881425 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cd00b6e20 con 0x7f7cd00d18b0 2024-09-17T01:43:35.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.563+0000 7f7cc7e00640 1 -- 172.21.15.42:0/3862881425 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7cc001a070 con 0x7f7cd00d18b0 2024-09-17T01:43:35.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.564+0000 7f7cc7e00640 1 --2- 172.21.15.42:0/3862881425 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7cac078b90 0x7f7cac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:35.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.564+0000 7f7cc7e00640 1 -- 172.21.15.42:0/3862881425 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f7cc009aec0 con 0x7f7cd00d18b0 2024-09-17T01:43:35.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.565+0000 7f7cc6a00640 1 --2- 172.21.15.42:0/3862881425 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7cac078b90 0x7f7cac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:35.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.565+0000 7f7cc6a00640 1 --2- 172.21.15.42:0/3862881425 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7cac078b90 0x7f7cac07b0a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8034000 tx=0x7f7cb8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:35.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.569+0000 7f7cc7e00640 1 -- 172.21.15.42:0/3862881425 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7cc00632f0 con 0x7f7cd00d18b0 2024-09-17T01:43:35.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.800+0000 7f7cd5200640 1 -- 172.21.15.42:0/3862881425 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7cd006d440 con 0x7f7cd00d18b0 2024-09-17T01:43:35.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.801+0000 7f7cc7e00640 1 -- 172.21.15.42:0/3862881425 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) ==== 95+0+5230 (secure 0 0 0) 0x7f7cc0062bf0 con 0x7f7cd00d18b0 2024-09-17T01:43:35.800 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:35.800 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3131119825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3131119825},{"type":"v1","addr":"172.21.15.43:6837","nonce":3131119825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8368,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1988657429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1988657429},{"type":"v1","addr":"172.21.15.43:6836","nonce":1988657429}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/578887548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":578887548},{"type":"v1","addr":"172.21.15.42:6835","nonce":578887548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:42:57.184518+0000","modified":"2024-09-17T01:43:00.201156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8982":{"gid":8982,"name":"c","rank":0,"incarnation":112,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6834/3811049376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3811049376},{"type":"v1","addr":"172.21.15.42:6834","nonce":3811049376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8982,"qdb_cluster":[8982]},"id":10}]} 2024-09-17T01:43:35.800 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 116 2024-09-17T01:43:35.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.803+0000 7f7cd5200640 1 -- 172.21.15.42:0/3862881425 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7cac078b90 msgr2=0x7f7cac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:35.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.803+0000 7f7cd5200640 1 --2- 172.21.15.42:0/3862881425 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7cac078b90 0x7f7cac07b0a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8034000 tx=0x7f7cb8004730 comp rx=0 tx=0).stop 2024-09-17T01:43:35.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.803+0000 7f7cd5200640 1 -- 172.21.15.42:0/3862881425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cd00d18b0 msgr2=0x7f7cd00aaf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:35.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.803+0000 7f7cd5200640 1 --2- 172.21.15.42:0/3862881425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cd00d18b0 0x7f7cd00aaf70 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000d770 tx=0x7f7cc000dc30 comp rx=0 tx=0).stop 2024-09-17T01:43:35.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.803+0000 7f7cd5200640 1 -- 172.21.15.42:0/3862881425 shutdown_connections 2024-09-17T01:43:35.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.803+0000 7f7cd5200640 1 --2- 172.21.15.42:0/3862881425 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7cac078b90 0x7f7cac07b0a0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:35.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.803+0000 7f7cd5200640 1 --2- 172.21.15.42:0/3862881425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd015ea80 0x7f7cd01f8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:35.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.803+0000 7f7cd5200640 1 --2- 172.21.15.42:0/3862881425 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7cd00d2d80 0x7f7cd01f2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:35.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.803+0000 7f7cd5200640 1 --2- 172.21.15.42:0/3862881425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cd00d18b0 0x7f7cd00aaf70 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:35.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.803+0000 7f7cd5200640 1 -- 172.21.15.42:0/3862881425 >> 172.21.15.42:0/3862881425 conn(0x7f7cd006cf00 msgr2=0x7f7cd00cdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:35.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.803+0000 7f7cd5200640 1 -- 172.21.15.42:0/3862881425 shutdown_connections 2024-09-17T01:43:35.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:35.803+0000 7f7cd5200640 1 -- 172.21.15.42:0/3862881425 wait complete. 2024-09-17T01:43:35.823 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T01:43:35.823 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:43:36.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.049+0000 7f8d8fe00640 1 -- 172.21.15.42:0/3202076703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d900b14a0 msgr2=0x7f8d90068d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:36.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.049+0000 7f8d8fe00640 1 --2- 172.21.15.42:0/3202076703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d900b14a0 0x7f8d90068d40 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f8d90071cb0 tx=0x7f8d7802a560 comp rx=0 tx=0).stop 2024-09-17T01:43:36.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.049+0000 7f8d8fe00640 1 -- 172.21.15.42:0/3202076703 shutdown_connections 2024-09-17T01:43:36.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.049+0000 7f8d8fe00640 1 --2- 172.21.15.42:0/3202076703 >> v2:172.21.15.43:3300/0 conn(0x7f8d90069280 0x7f8d90074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.049+0000 7f8d8fe00640 1 --2- 172.21.15.42:0/3202076703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d900b14a0 0x7f8d90068d40 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.049+0000 7f8d8fe00640 1 -- 172.21.15.42:0/3202076703 >> 172.21.15.42:0/3202076703 conn(0x7f8d900734a0 msgr2=0x7f8d900b61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:36.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.049+0000 7f8d8fe00640 1 -- 172.21.15.42:0/3202076703 shutdown_connections 2024-09-17T01:43:36.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.049+0000 7f8d8fe00640 1 -- 172.21.15.42:0/3202076703 wait complete. 2024-09-17T01:43:36.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.051+0000 7f8d8fe00640 1 Processor -- start 2024-09-17T01:43:36.050 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.051+0000 7f8d8fe00640 1 -- start start 2024-09-17T01:43:36.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.053+0000 7f8d8fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d90069280 0x7f8d90145f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.053+0000 7f8d8fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d900b14a0 0x7f8d900af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.053+0000 7f8d8fe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d9015a2a0 0x7f8d900af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.053+0000 7f8d8fe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8d900b1ac0 con 0x7f8d900b14a0 2024-09-17T01:43:36.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.053+0000 7f8d8fe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8d90069bd0 con 0x7f8d90069280 2024-09-17T01:43:36.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.053+0000 7f8d8fe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8d90074f40 con 0x7f8d9015a2a0 2024-09-17T01:43:36.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.053+0000 7f8d87e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d900b14a0 0x7f8d900af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.053+0000 7f8d87e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d900b14a0 0x7f8d900af220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59100/0 (socket says 172.21.15.42:59100) 2024-09-17T01:43:36.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.053+0000 7f8d87e00640 1 -- 172.21.15.42:0/2807773670 learned_addr learned my addr 172.21.15.42:0/2807773670 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:36.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.053+0000 7f8d8ea00640 1 --2- 172.21.15.42:0/2807773670 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d90069280 0x7f8d90145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.053+0000 7f8d8f400640 1 --2- 172.21.15.42:0/2807773670 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d9015a2a0 0x7f8d900af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.053+0000 7f8d87e00640 1 -- 172.21.15.42:0/2807773670 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d9015a2a0 msgr2=0x7f8d900af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:36.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.053+0000 7f8d87e00640 1 --2- 172.21.15.42:0/2807773670 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d9015a2a0 0x7f8d900af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.054+0000 7f8d87e00640 1 -- 172.21.15.42:0/2807773670 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d90069280 msgr2=0x7f8d90145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:36.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.054+0000 7f8d87e00640 1 --2- 172.21.15.42:0/2807773670 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d90069280 0x7f8d90145f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.054+0000 7f8d87e00640 1 -- 172.21.15.42:0/2807773670 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d900ae1a0 con 0x7f8d900b14a0 2024-09-17T01:43:36.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.054+0000 7f8d8f400640 1 --2- 172.21.15.42:0/2807773670 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d9015a2a0 0x7f8d900af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:43:36.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.054+0000 7f8d87e00640 1 --2- 172.21.15.42:0/2807773670 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d900b14a0 0x7f8d900af220 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f8d780099c0 tx=0x7f8d780039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:36.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.054+0000 7f8d86a00640 1 -- 172.21.15.42:0/2807773670 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7803e030 con 0x7f8d900b14a0 2024-09-17T01:43:36.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.054+0000 7f8d86a00640 1 -- 172.21.15.42:0/2807773670 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d780047a0 con 0x7f8d900b14a0 2024-09-17T01:43:36.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.054+0000 7f8d86a00640 1 -- 172.21.15.42:0/2807773670 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d78035040 con 0x7f8d900b14a0 2024-09-17T01:43:36.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.054+0000 7f8d8fe00640 1 -- 172.21.15.42:0/2807773670 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d900ae460 con 0x7f8d900b14a0 2024-09-17T01:43:36.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.054+0000 7f8d8fe00640 1 -- 172.21.15.42:0/2807773670 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d900aea20 con 0x7f8d900b14a0 2024-09-17T01:43:36.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.055+0000 7f8d8fe00640 1 -- 172.21.15.42:0/2807773670 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d901f66f0 con 0x7f8d900b14a0 2024-09-17T01:43:36.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.057+0000 7f8d86a00640 1 -- 172.21.15.42:0/2807773670 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8d78041030 con 0x7f8d900b14a0 2024-09-17T01:43:36.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.058+0000 7f8d86a00640 1 --2- 172.21.15.42:0/2807773670 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8d6c078bc0 0x7f8d6c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.058+0000 7f8d86a00640 1 -- 172.21.15.42:0/2807773670 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f8d780bb520 con 0x7f8d900b14a0 2024-09-17T01:43:36.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.059+0000 7f8d8ea00640 1 --2- 172.21.15.42:0/2807773670 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8d6c078bc0 0x7f8d6c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.060+0000 7f8d8ea00640 1 --2- 172.21.15.42:0/2807773670 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8d6c078bc0 0x7f8d6c07b0d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8d80006fd0 tx=0x7f8d80009060 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:36.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.063+0000 7f8d86a00640 1 -- 172.21.15.42:0/2807773670 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8d90069690 con 0x7f8d900b14a0 2024-09-17T01:43:36.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.329+0000 7f8d8fe00640 1 -- 172.21.15.42:0/2807773670 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f8d900754c0 con 0x7f8d900b14a0 2024-09-17T01:43:36.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.330+0000 7f8d86a00640 1 -- 172.21.15.42:0/2807773670 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7f8d78083270 con 0x7f8d900b14a0 2024-09-17T01:43:36.330 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:36.330 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":716,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":147,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1077031982,"bytes_used":2596196352,"bytes_avail":770497916928,"bytes_total":773094113280,"write_bytes_sec":33956187,"read_op_per_sec":0,"write_op_per_sec":53},"fsmap":{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":8982}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-17T01:43:35.179714+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:43:36.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.332+0000 7f8d8fe00640 1 -- 172.21.15.42:0/2807773670 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8d6c078bc0 msgr2=0x7f8d6c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:36.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.332+0000 7f8d8fe00640 1 --2- 172.21.15.42:0/2807773670 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8d6c078bc0 0x7f8d6c07b0d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8d80006fd0 tx=0x7f8d80009060 comp rx=0 tx=0).stop 2024-09-17T01:43:36.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.332+0000 7f8d8fe00640 1 -- 172.21.15.42:0/2807773670 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d900b14a0 msgr2=0x7f8d900af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:36.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.332+0000 7f8d8fe00640 1 --2- 172.21.15.42:0/2807773670 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d900b14a0 0x7f8d900af220 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f8d780099c0 tx=0x7f8d780039e0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.332+0000 7f8d8fe00640 1 -- 172.21.15.42:0/2807773670 shutdown_connections 2024-09-17T01:43:36.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.332+0000 7f8d8fe00640 1 --2- 172.21.15.42:0/2807773670 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8d6c078bc0 0x7f8d6c07b0d0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.332+0000 7f8d8fe00640 1 --2- 172.21.15.42:0/2807773670 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d9015a2a0 0x7f8d900af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.332+0000 7f8d8fe00640 1 --2- 172.21.15.42:0/2807773670 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d900b14a0 0x7f8d900af220 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.332+0000 7f8d8fe00640 1 --2- 172.21.15.42:0/2807773670 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d90069280 0x7f8d90145f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.332+0000 7f8d8fe00640 1 -- 172.21.15.42:0/2807773670 >> 172.21.15.42:0/2807773670 conn(0x7f8d900734a0 msgr2=0x7f8d90159900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:36.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.333+0000 7f8d8fe00640 1 -- 172.21.15.42:0/2807773670 shutdown_connections 2024-09-17T01:43:36.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.333+0000 7f8d8fe00640 1 -- 172.21.15.42:0/2807773670 wait complete. 2024-09-17T01:43:36.354 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-17T01:43:36.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:43:36.355 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub abort 2024-09-17T01:43:36.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.586+0000 7f0750400640 1 -- 172.21.15.42:0/4014492621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0748142f40 msgr2=0x7f0748072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:36.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.586+0000 7f0750400640 1 --2- 172.21.15.42:0/4014492621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0748142f40 0x7f0748072950 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f0748071ef0 tx=0x7f073402a4d0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.587+0000 7f0750400640 1 -- 172.21.15.42:0/4014492621 shutdown_connections 2024-09-17T01:43:36.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.587+0000 7f0750400640 1 --2- 172.21.15.42:0/4014492621 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0748072e90 0x7f07480cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.587+0000 7f0750400640 1 --2- 172.21.15.42:0/4014492621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0748142f40 0x7f0748072950 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.587+0000 7f0750400640 1 --2- 172.21.15.42:0/4014492621 >> v2:172.21.15.43:3300/0 conn(0x7f07480b3550 0x7f074815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.587+0000 7f0750400640 1 -- 172.21.15.42:0/4014492621 >> 172.21.15.42:0/4014492621 conn(0x7f07480b2930 msgr2=0x7f074806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:36.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.587+0000 7f0750400640 1 -- 172.21.15.42:0/4014492621 shutdown_connections 2024-09-17T01:43:36.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.587+0000 7f0750400640 1 -- 172.21.15.42:0/4014492621 wait complete. 2024-09-17T01:43:36.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.589+0000 7f0750400640 1 Processor -- start 2024-09-17T01:43:36.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.589+0000 7f0750400640 1 -- start start 2024-09-17T01:43:36.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.591+0000 7f0750400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0748072e90 0x7f0748131a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.591+0000 7f0750400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07480b3550 0x7f074815bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.591+0000 7f0750400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0748142f40 0x7f074815c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.591+0000 7f0750400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f074806d430 con 0x7f0748142f40 2024-09-17T01:43:36.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.591+0000 7f0750400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f074806d5b0 con 0x7f07480b3550 2024-09-17T01:43:36.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.591+0000 7f0750400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f074806d730 con 0x7f0748072e90 2024-09-17T01:43:36.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.591+0000 7f074e400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0748142f40 0x7f074815c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.591+0000 7f074da00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0748072e90 0x7f0748131a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.591+0000 7f074e400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0748142f40 0x7f074815c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59118/0 (socket says 172.21.15.42:59118) 2024-09-17T01:43:36.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.591+0000 7f074e400640 1 -- 172.21.15.42:0/13332835 learned_addr learned my addr 172.21.15.42:0/13332835 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:36.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.591+0000 7f074d000640 1 --2- 172.21.15.42:0/13332835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07480b3550 0x7f074815bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.591+0000 7f074e400640 1 -- 172.21.15.42:0/13332835 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0748072e90 msgr2=0x7f0748131a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:36.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.591+0000 7f074e400640 1 --2- 172.21.15.42:0/13332835 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0748072e90 0x7f0748131a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.591+0000 7f074e400640 1 -- 172.21.15.42:0/13332835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07480b3550 msgr2=0x7f074815bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:36.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.591+0000 7f074e400640 1 --2- 172.21.15.42:0/13332835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07480b3550 0x7f074815bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.592+0000 7f074e400640 1 -- 172.21.15.42:0/13332835 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07481f4960 con 0x7f0748142f40 2024-09-17T01:43:36.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.592+0000 7f074e400640 1 --2- 172.21.15.42:0/13332835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0748142f40 0x7f074815c2d0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f074000e990 tx=0x7f074000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:36.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.592+0000 7f0745600640 1 -- 172.21.15.42:0/13332835 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0740004d20 con 0x7f0748142f40 2024-09-17T01:43:36.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.592+0000 7f0745600640 1 -- 172.21.15.42:0/13332835 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f074000caa0 con 0x7f0748142f40 2024-09-17T01:43:36.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.592+0000 7f0745600640 1 -- 172.21.15.42:0/13332835 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0740005020 con 0x7f0748142f40 2024-09-17T01:43:36.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.592+0000 7f0750400640 1 -- 172.21.15.42:0/13332835 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07481f4c40 con 0x7f0748142f40 2024-09-17T01:43:36.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.592+0000 7f0750400640 1 -- 172.21.15.42:0/13332835 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07481f5200 con 0x7f0748142f40 2024-09-17T01:43:36.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.595+0000 7f0745600640 1 -- 172.21.15.42:0/13332835 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f07400051c0 con 0x7f0748142f40 2024-09-17T01:43:36.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.595+0000 7f0745600640 1 --2- 172.21.15.42:0/13332835 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0728078bc0 0x7f072807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.596+0000 7f0745600640 1 -- 172.21.15.42:0/13332835 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f074009b4e0 con 0x7f0748142f40 2024-09-17T01:43:36.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.596+0000 7f074da00640 1 --2- 172.21.15.42:0/13332835 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0728078bc0 0x7f072807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.596+0000 7f07573d2740 1 Processor -- start 2024-09-17T01:43:36.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.597+0000 7f07573d2740 1 -- start start 2024-09-17T01:43:36.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.597+0000 7f074da00640 1 --2- 172.21.15.42:0/13332835 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0728078bc0 0x7f072807b0d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f073c005fd0 tx=0x7f073c00a250 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:36.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.598+0000 7f07573d2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998d20390 0x55599910f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.598+0000 7f07573d2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555998cf74d0 0x5559990f2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.598+0000 7f07573d2740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555998cff6b0 0x5559990f28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.598+0000 7f07573d2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555998fdbc10 con 0x555998d20390 2024-09-17T01:43:36.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.598+0000 7f07573d2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55599903a9f0 con 0x555998cf74d0 2024-09-17T01:43:36.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.598+0000 7f07573d2740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x555999029e20 con 0x555998cff6b0 2024-09-17T01:43:36.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.598+0000 7f074da00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998d20390 0x55599910f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.598+0000 7f074da00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998d20390 0x55599910f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59120/0 (socket says 172.21.15.42:59120) 2024-09-17T01:43:36.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.598+0000 7f074da00640 1 -- 172.21.15.42:0/2996606989 learned_addr learned my addr 172.21.15.42:0/2996606989 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:36.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.599+0000 7f074d000640 1 --2- 172.21.15.42:0/2996606989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555998cf74d0 0x5559990f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.599+0000 7f074e400640 1 --2- 172.21.15.42:0/2996606989 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555998cff6b0 0x5559990f28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.599+0000 7f074da00640 1 -- 172.21.15.42:0/2996606989 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555998cff6b0 msgr2=0x5559990f28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:36.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.599+0000 7f074da00640 1 --2- 172.21.15.42:0/2996606989 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555998cff6b0 0x5559990f28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.599+0000 7f074da00640 1 -- 172.21.15.42:0/2996606989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555998cf74d0 msgr2=0x5559990f2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:36.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.599+0000 7f074da00640 1 --2- 172.21.15.42:0/2996606989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555998cf74d0 0x5559990f2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.599+0000 7f074da00640 1 -- 172.21.15.42:0/2996606989 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555998e027d0 con 0x555998d20390 2024-09-17T01:43:36.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.599+0000 7f074da00640 1 --2- 172.21.15.42:0/2996606989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998d20390 0x55599910f6a0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f073c00ff30 tx=0x7f073c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7421d93ee3f5c894 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:36.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.599+0000 7f073a000640 1 -- 172.21.15.42:0/2996606989 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073c016070 con 0x555998d20390 2024-09-17T01:43:36.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.599+0000 7f073a000640 1 -- 172.21.15.42:0/2996606989 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f073c025630 con 0x555998d20390 2024-09-17T01:43:36.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.599+0000 7f073a000640 1 -- 172.21.15.42:0/2996606989 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073c025a20 con 0x555998d20390 2024-09-17T01:43:36.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.600+0000 7f07573d2740 1 -- 172.21.15.42:0/2996606989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998d20390 msgr2=0x55599910f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:36.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.600+0000 7f07573d2740 1 --2- 172.21.15.42:0/2996606989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998d20390 0x55599910f6a0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f073c00ff30 tx=0x7f073c012000 comp rx=0 tx=0).stop 2024-09-17T01:43:36.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.600+0000 7f07573d2740 1 -- 172.21.15.42:0/2996606989 shutdown_connections 2024-09-17T01:43:36.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.600+0000 7f07573d2740 1 --2- 172.21.15.42:0/2996606989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555998cf74d0 0x5559990f2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.600+0000 7f07573d2740 1 --2- 172.21.15.42:0/2996606989 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555998cff6b0 0x5559990f28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.600+0000 7f07573d2740 1 --2- 172.21.15.42:0/2996606989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998d20390 0x55599910f6a0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.600+0000 7f07573d2740 1 -- 172.21.15.42:0/2996606989 >> 172.21.15.42:0/2996606989 conn(0x555998d144e0 msgr2=0x5559990c8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:36.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.600+0000 7f07573d2740 1 -- 172.21.15.42:0/2996606989 shutdown_connections 2024-09-17T01:43:36.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.600+0000 7f07573d2740 1 -- 172.21.15.42:0/2996606989 wait complete. 2024-09-17T01:43:36.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.601+0000 7f07573d2740 1 -- start start 2024-09-17T01:43:36.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.602+0000 7f07573d2740 1 Processor -- start 2024-09-17T01:43:36.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.603+0000 7f07573d2740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555998cf74d0 0x5559990ed760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.603+0000 7f07573d2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555998cff6b0 0x55599910db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.603+0000 7f07573d2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998d20390 0x5559990eba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.603+0000 7f07573d2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555998fcf790 con 0x555998d20390 2024-09-17T01:43:36.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.603+0000 7f07573d2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55599902dc30 con 0x555998cff6b0 2024-09-17T01:43:36.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.603+0000 7f07573d2740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x555998d9a740 con 0x555998cf74d0 2024-09-17T01:43:36.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.603+0000 7f07573d2740 10 client.0 _ll_register_callbacks cb 0x555998fdf260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:43:36.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.603+0000 7f074e400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998d20390 0x5559990eba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.604+0000 7f074e400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998d20390 0x5559990eba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59132/0 (socket says 172.21.15.42:59132) 2024-09-17T01:43:36.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.604+0000 7f074e400640 1 -- 172.21.15.42:0/318723994 learned_addr learned my addr 172.21.15.42:0/318723994 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:36.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.604+0000 7f074d000640 1 --2- 172.21.15.42:0/318723994 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555998cff6b0 0x55599910db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.604+0000 7f074da00640 1 --2- 172.21.15.42:0/318723994 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555998cf74d0 0x5559990ed760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.604+0000 7f074e400640 1 -- 172.21.15.42:0/318723994 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555998cf74d0 msgr2=0x5559990ed760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:36.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.604+0000 7f074e400640 1 --2- 172.21.15.42:0/318723994 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555998cf74d0 0x5559990ed760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.604+0000 7f074e400640 1 -- 172.21.15.42:0/318723994 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555998cff6b0 msgr2=0x55599910db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:36.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.604+0000 7f074e400640 1 --2- 172.21.15.42:0/318723994 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555998cff6b0 0x55599910db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.604+0000 7f074e400640 1 -- 172.21.15.42:0/318723994 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555998d696a0 con 0x555998d20390 2024-09-17T01:43:36.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.604+0000 7f074d000640 1 --2- 172.21.15.42:0/318723994 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555998cff6b0 0x55599910db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:43:36.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.604+0000 7f074e400640 1 --2- 172.21.15.42:0/318723994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998d20390 0x5559990eba10 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f0740099a00 tx=0x7f0740063920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3e3a5eaddc3b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:36.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.604+0000 7f072ea00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:43:36.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.604+0000 7f072ea00640 1 -- 172.21.15.42:0/318723994 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0740089070 con 0x555998d20390 2024-09-17T01:43:36.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.604+0000 7f072ea00640 1 -- 172.21.15.42:0/318723994 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f07400625b0 con 0x555998d20390 2024-09-17T01:43:36.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.604+0000 7f07573d2740 1 -- 172.21.15.42:0/318723994 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f073c025630 con 0x555998d20390 2024-09-17T01:43:36.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.605+0000 7f072ea00640 1 -- 172.21.15.42:0/318723994 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) ==== 24+0+0 (secure 0 0 0) 0x7f074001f040 con 0x555998d20390 2024-09-17T01:43:36.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.605+0000 7f07573d2740 10 client.9228 fetch_fsmap learned FSMap version 116 2024-09-17T01:43:36.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.605+0000 7f07573d2740 1 -- 172.21.15.42:0/318723994 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) -- 0x555998e62f60 con 0x555998d20390 2024-09-17T01:43:36.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.605+0000 7f072ea00640 1 -- 172.21.15.42:0/318723994 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f073c025630 con 0x555998d20390 2024-09-17T01:43:36.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.605+0000 7f072ea00640 1 -- 172.21.15.42:0/318723994 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 116) ==== 3502+0+0 (secure 0 0 0) 0x7f074000f040 con 0x555998d20390 2024-09-17T01:43:36.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.605+0000 7f07573d2740 10 client.9228 fetch_fsmap finished waiting for FSMap version 116 2024-09-17T01:43:36.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.605+0000 7f07573d2740 10 client.9228 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-17T01:43:36.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.605+0000 7f07573d2740 20 client.9228 populate_metadata read hostname 'smithi042' 2024-09-17T01:43:36.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.605+0000 7f07573d2740 1 --2- 172.21.15.42:0/318723994 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x555998cdef60 0x55599911ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.605+0000 7f07573d2740 4 client.9228 mds_command: new command op to 8982 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:43:36.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.605+0000 7f07573d2740 1 -- 172.21.15.42:0/318723994 --> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55599903c940 con 0x555998cdef60 2024-09-17T01:43:36.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.605+0000 7f074da00640 1 --2- 172.21.15.42:0/318723994 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x555998cdef60 0x55599911ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.606+0000 7f074da00640 1 --2- 172.21.15.42:0/318723994 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x555998cdef60 0x55599911ff70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=243bb2ad05b0d579 server_cookie=350024bbe4d78c02 in_seq=0 out_seq=0 2024-09-17T01:43:36.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.606+0000 7f072ea00640 10 client.9228 ms_handle_connect on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:36.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.607+0000 7f072ea00640 1 -- 172.21.15.42:0/318723994 <== mds.0 v2:172.21.15.42:6832/3811049376 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55599903c940 con 0x555998cdef60 2024-09-17T01:43:36.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.607+0000 7f072ea00640 10 client.9228 handle_command_reply: tid=0 2024-09-17T01:43:36.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.607+0000 7f07573d2740 1 client.9228 shutdown 2024-09-17T01:43:36.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.607+0000 7f07573d2740 1 -- 172.21.15.42:0/318723994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998d20390 msgr2=0x5559990eba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:36.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.607+0000 7f07573d2740 1 --2- 172.21.15.42:0/318723994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998d20390 0x5559990eba10 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f0740099a00 tx=0x7f0740063920 comp rx=0 tx=0).stop 2024-09-17T01:43:36.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.607+0000 7f07573d2740 1 -- 172.21.15.42:0/318723994 shutdown_connections 2024-09-17T01:43:36.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.607+0000 7f07573d2740 1 --2- 172.21.15.42:0/318723994 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x555998cdef60 0x55599911ff70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.607+0000 7f07573d2740 1 --2- 172.21.15.42:0/318723994 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555998cff6b0 0x55599910db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.607+0000 7f07573d2740 1 --2- 172.21.15.42:0/318723994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998d20390 0x5559990eba10 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.607+0000 7f07573d2740 1 --2- 172.21.15.42:0/318723994 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555998cf74d0 0x5559990ed760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.607+0000 7f072ea00640 0 client.9228 ms_handle_reset on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:36.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.607+0000 7f07573d2740 1 -- 172.21.15.42:0/318723994 >> 172.21.15.42:0/318723994 conn(0x555998d144e0 msgr2=0x5559990c1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:36.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.607+0000 7f07573d2740 1 -- 172.21.15.42:0/318723994 shutdown_connections 2024-09-17T01:43:36.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.607+0000 7f07573d2740 1 -- 172.21.15.42:0/318723994 wait complete. 2024-09-17T01:43:36.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.607+0000 7f07573d2740 20 client.9228 trim_cache size 0 max 16384 2024-09-17T01:43:36.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.627+0000 7f07573d2740 1 Processor -- start 2024-09-17T01:43:36.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.628+0000 7f07573d2740 1 -- start start 2024-09-17T01:43:36.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.629+0000 7f07573d2740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555998cf74d0 0x5559990ed210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.629+0000 7f07573d2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998cff6b0 0x5559990ebf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.629+0000 7f07573d2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555998d20390 0x5559991066e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.629+0000 7f07573d2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f07482000d0 con 0x555998cff6b0 2024-09-17T01:43:36.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.629+0000 7f07573d2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f07481f6ad0 con 0x555998d20390 2024-09-17T01:43:36.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.629+0000 7f07573d2740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f07481f79e0 con 0x555998cf74d0 2024-09-17T01:43:36.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.629+0000 7f074d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998cff6b0 0x5559990ebf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.629+0000 7f074d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998cff6b0 0x5559990ebf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59140/0 (socket says 172.21.15.42:59140) 2024-09-17T01:43:36.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.629+0000 7f074d000640 1 -- 172.21.15.42:0/3005685176 learned_addr learned my addr 172.21.15.42:0/3005685176 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:36.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.630+0000 7f074da00640 1 --2- 172.21.15.42:0/3005685176 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555998cf74d0 0x5559990ed210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.630+0000 7f074e400640 1 --2- 172.21.15.42:0/3005685176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555998d20390 0x5559991066e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.630+0000 7f074d000640 1 -- 172.21.15.42:0/3005685176 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555998cf74d0 msgr2=0x5559990ed210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:36.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.630+0000 7f074d000640 1 --2- 172.21.15.42:0/3005685176 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555998cf74d0 0x5559990ed210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.630+0000 7f074d000640 1 -- 172.21.15.42:0/3005685176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555998d20390 msgr2=0x5559991066e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:36.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.630+0000 7f074d000640 1 --2- 172.21.15.42:0/3005685176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555998d20390 0x5559991066e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.630+0000 7f074d000640 1 -- 172.21.15.42:0/3005685176 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555998e00ad0 con 0x555998cff6b0 2024-09-17T01:43:36.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.630+0000 7f074da00640 1 --2- 172.21.15.42:0/3005685176 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555998cf74d0 0x5559990ed210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:43:36.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.630+0000 7f074d000640 1 --2- 172.21.15.42:0/3005685176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998cff6b0 0x5559990ebf40 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f0734009850 tx=0x7f07340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a094f8caa6623bf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:36.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.630+0000 7f0739600640 1 -- 172.21.15.42:0/3005685176 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0734035040 con 0x555998cff6b0 2024-09-17T01:43:36.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.630+0000 7f0739600640 1 -- 172.21.15.42:0/3005685176 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0734004340 con 0x555998cff6b0 2024-09-17T01:43:36.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.630+0000 7f0739600640 1 -- 172.21.15.42:0/3005685176 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0734003850 con 0x555998cff6b0 2024-09-17T01:43:36.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.631+0000 7f07573d2740 1 -- 172.21.15.42:0/3005685176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998cff6b0 msgr2=0x5559990ebf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:36.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.631+0000 7f07573d2740 1 --2- 172.21.15.42:0/3005685176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998cff6b0 0x5559990ebf40 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f0734009850 tx=0x7f07340046c0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.631+0000 7f07573d2740 1 -- 172.21.15.42:0/3005685176 shutdown_connections 2024-09-17T01:43:36.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.631+0000 7f07573d2740 1 --2- 172.21.15.42:0/3005685176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555998d20390 0x5559991066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.631+0000 7f07573d2740 1 --2- 172.21.15.42:0/3005685176 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998cff6b0 0x5559990ebf40 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.631+0000 7f07573d2740 1 --2- 172.21.15.42:0/3005685176 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555998cf74d0 0x5559990ed210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.631+0000 7f07573d2740 1 -- 172.21.15.42:0/3005685176 >> 172.21.15.42:0/3005685176 conn(0x555998d144e0 msgr2=0x5559990ea880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:36.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.631+0000 7f07573d2740 1 -- 172.21.15.42:0/3005685176 shutdown_connections 2024-09-17T01:43:36.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.631+0000 7f07573d2740 1 -- 172.21.15.42:0/3005685176 wait complete. 2024-09-17T01:43:36.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.632+0000 7f07573d2740 1 -- start start 2024-09-17T01:43:36.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.633+0000 7f07573d2740 1 Processor -- start 2024-09-17T01:43:36.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.634+0000 7f07573d2740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555998cf74d0 0x555999186d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.634+0000 7f07573d2740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555998cff6b0 0x5559990c1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.634+0000 7f07573d2740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998d20390 0x5559990c1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.634+0000 7f07573d2740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555998fe5140 con 0x555998d20390 2024-09-17T01:43:36.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.634+0000 7f07573d2740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f07481f6480 con 0x555998cff6b0 2024-09-17T01:43:36.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.634+0000 7f07573d2740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55599910e180 con 0x555998cf74d0 2024-09-17T01:43:36.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.634+0000 7f07573d2740 10 client.0 _ll_register_callbacks cb 0x7f073c005ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:43:36.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.634+0000 7f074e400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998d20390 0x5559990c1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.634+0000 7f074e400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998d20390 0x5559990c1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59152/0 (socket says 172.21.15.42:59152) 2024-09-17T01:43:36.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.634+0000 7f074da00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555998cf74d0 0x555999186d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.634+0000 7f074e400640 1 -- 172.21.15.42:0/3332091901 learned_addr learned my addr 172.21.15.42:0/3332091901 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:36.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.634+0000 7f074d000640 1 --2- 172.21.15.42:0/3332091901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555998cff6b0 0x5559990c1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.635+0000 7f074e400640 1 -- 172.21.15.42:0/3332091901 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555998cf74d0 msgr2=0x555999186d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:36.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.635+0000 7f074e400640 1 --2- 172.21.15.42:0/3332091901 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555998cf74d0 0x555999186d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.635+0000 7f074e400640 1 -- 172.21.15.42:0/3332091901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555998cff6b0 msgr2=0x5559990c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:36.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.635+0000 7f074e400640 1 --2- 172.21.15.42:0/3332091901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555998cff6b0 0x5559990c1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.635+0000 7f074e400640 1 -- 172.21.15.42:0/3332091901 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55599911ed00 con 0x555998d20390 2024-09-17T01:43:36.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.635+0000 7f074e400640 1 --2- 172.21.15.42:0/3332091901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998d20390 0x5559990c1d50 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f0740062df0 tx=0x7f074005f2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499355232928d72f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:36.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.635+0000 7f072ea00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:43:36.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.635+0000 7f072ea00640 1 -- 172.21.15.42:0/3332091901 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0740089040 con 0x555998d20390 2024-09-17T01:43:36.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.635+0000 7f072ea00640 1 -- 172.21.15.42:0/3332091901 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f074001bab0 con 0x555998d20390 2024-09-17T01:43:36.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.635+0000 7f07573d2740 1 -- 172.21.15.42:0/3332091901 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0734004340 con 0x555998d20390 2024-09-17T01:43:36.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.636+0000 7f072ea00640 1 -- 172.21.15.42:0/3332091901 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) ==== 24+0+0 (secure 0 0 0) 0x7f0740062ac0 con 0x555998d20390 2024-09-17T01:43:36.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.636+0000 7f07573d2740 10 client.9234 fetch_fsmap learned FSMap version 116 2024-09-17T01:43:36.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.636+0000 7f07573d2740 1 -- 172.21.15.42:0/3332091901 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) -- 0x55599918d0f0 con 0x555998d20390 2024-09-17T01:43:36.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.636+0000 7f072ea00640 1 -- 172.21.15.42:0/3332091901 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0734004340 con 0x555998d20390 2024-09-17T01:43:36.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.636+0000 7f072ea00640 1 -- 172.21.15.42:0/3332091901 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 116) ==== 3502+0+0 (secure 0 0 0) 0x7f074001bcb0 con 0x555998d20390 2024-09-17T01:43:36.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.636+0000 7f07573d2740 10 client.9234 fetch_fsmap finished waiting for FSMap version 116 2024-09-17T01:43:36.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.636+0000 7f07573d2740 10 client.9234 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-17T01:43:36.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.636+0000 7f07573d2740 20 client.9234 populate_metadata read hostname 'smithi042' 2024-09-17T01:43:36.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.636+0000 7f07573d2740 1 --2- 172.21.15.42:0/3332091901 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x55599918cce0 0x555999105a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.636+0000 7f07573d2740 4 client.9234 mds_command: new command op to 8982 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-17T01:43:36.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.636+0000 7f07573d2740 1 -- 172.21.15.42:0/3332091901 --> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x5559990383f0 con 0x55599918cce0 2024-09-17T01:43:36.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.636+0000 7f074da00640 1 --2- 172.21.15.42:0/3332091901 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x55599918cce0 0x555999105a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.637+0000 7f074da00640 1 --2- 172.21.15.42:0/3332091901 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x55599918cce0 0x555999105a30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64cec3bd71f03ced server_cookie=5cbf6c85c3df5678 in_seq=0 out_seq=0 2024-09-17T01:43:36.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.637+0000 7f072ea00640 10 client.9234 ms_handle_connect on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:36.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.638+0000 7f072ea00640 1 -- 172.21.15.42:0/3332091901 <== mds.0 v2:172.21.15.42:6832/3811049376 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5559990383f0 con 0x55599918cce0 2024-09-17T01:43:36.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.638+0000 7f072ea00640 10 client.9234 handle_command_reply: tid=0 2024-09-17T01:43:36.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.638+0000 7f07573d2740 1 client.9234 shutdown 2024-09-17T01:43:36.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.638+0000 7f07573d2740 1 -- 172.21.15.42:0/3332091901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998d20390 msgr2=0x5559990c1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:36.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.638+0000 7f07573d2740 1 --2- 172.21.15.42:0/3332091901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998d20390 0x5559990c1d50 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f0740062df0 tx=0x7f074005f2c0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.638+0000 7f07573d2740 1 -- 172.21.15.42:0/3332091901 shutdown_connections 2024-09-17T01:43:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.638+0000 7f07573d2740 1 --2- 172.21.15.42:0/3332091901 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x55599918cce0 0x555999105a30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.638+0000 7f07573d2740 1 --2- 172.21.15.42:0/3332091901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555998cff6b0 0x5559990c1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.638+0000 7f07573d2740 1 --2- 172.21.15.42:0/3332091901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555998d20390 0x5559990c1d50 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.638+0000 7f07573d2740 1 --2- 172.21.15.42:0/3332091901 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555998cf74d0 0x555999186d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.638+0000 7f072ea00640 0 client.9234 ms_handle_reset on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.638+0000 7f07573d2740 1 -- 172.21.15.42:0/3332091901 >> 172.21.15.42:0/3332091901 conn(0x555998d144e0 msgr2=0x555999106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.638+0000 7f07573d2740 1 -- 172.21.15.42:0/3332091901 shutdown_connections 2024-09-17T01:43:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.638+0000 7f07573d2740 1 -- 172.21.15.42:0/3332091901 wait complete. 2024-09-17T01:43:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.639+0000 7f07573d2740 20 client.9234 trim_cache size 0 max 16384 2024-09-17T01:43:36.641 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:43:36.641 INFO:teuthology.orchestra.run.smithi042.stdout: "message": "", 2024-09-17T01:43:36.641 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0 2024-09-17T01:43:36.641 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:43:36.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.639+0000 7f0750400640 1 -- 172.21.15.42:0/13332835 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0728078bc0 msgr2=0x7f072807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:36.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.639+0000 7f0750400640 1 --2- 172.21.15.42:0/13332835 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0728078bc0 0x7f072807b0d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f073c005fd0 tx=0x7f073c00a250 comp rx=0 tx=0).stop 2024-09-17T01:43:36.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.639+0000 7f0750400640 1 -- 172.21.15.42:0/13332835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0748142f40 msgr2=0x7f074815c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:36.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.639+0000 7f0750400640 1 --2- 172.21.15.42:0/13332835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0748142f40 0x7f074815c2d0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f074000e990 tx=0x7f074000ee50 comp rx=0 tx=0).stop 2024-09-17T01:43:36.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.639+0000 7f0750400640 1 -- 172.21.15.42:0/13332835 shutdown_connections 2024-09-17T01:43:36.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.639+0000 7f0750400640 1 --2- 172.21.15.42:0/13332835 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0728078bc0 0x7f072807b0d0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.639+0000 7f0750400640 1 --2- 172.21.15.42:0/13332835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07480b3550 0x7f074815bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.639+0000 7f0750400640 1 --2- 172.21.15.42:0/13332835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0748142f40 0x7f074815c2d0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.639+0000 7f0750400640 1 --2- 172.21.15.42:0/13332835 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0748072e90 0x7f0748131a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.639+0000 7f0750400640 1 -- 172.21.15.42:0/13332835 >> 172.21.15.42:0/13332835 conn(0x7f07480b2930 msgr2=0x7f0748073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:36.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.639+0000 7f0750400640 1 -- 172.21.15.42:0/13332835 shutdown_connections 2024-09-17T01:43:36.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.639+0000 7f0750400640 1 -- 172.21.15.42:0/13332835 wait complete. 2024-09-17T01:43:36.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:43:36.662 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-17T01:43:36.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.895+0000 7f46f5800640 1 -- 172.21.15.42:0/3644860622 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46f00d3020 msgr2=0x7f46f00d3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:36.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.895+0000 7f46f5800640 1 --2- 172.21.15.42:0/3644860622 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46f00d3020 0x7f46f00d3430 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f46e8005fd0 tx=0x7f46e802a820 comp rx=0 tx=0).stop 2024-09-17T01:43:36.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.895+0000 7f46f5800640 1 -- 172.21.15.42:0/3644860622 shutdown_connections 2024-09-17T01:43:36.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.895+0000 7f46f5800640 1 --2- 172.21.15.42:0/3644860622 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46f00d3020 0x7f46f00d3430 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.895+0000 7f46f5800640 1 --2- 172.21.15.42:0/3644860622 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46f00d1b20 0x7f46f0162ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.895+0000 7f46f5800640 1 -- 172.21.15.42:0/3644860622 >> 172.21.15.42:0/3644860622 conn(0x7f46f006cf00 msgr2=0x7f46f006d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:36.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.895+0000 7f46f5800640 1 -- 172.21.15.42:0/3644860622 shutdown_connections 2024-09-17T01:43:36.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.895+0000 7f46f5800640 1 -- 172.21.15.42:0/3644860622 wait complete. 2024-09-17T01:43:36.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.898+0000 7f46f5800640 1 Processor -- start 2024-09-17T01:43:36.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.898+0000 7f46f5800640 1 -- start start 2024-09-17T01:43:36.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.899+0000 7f46f5800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46f00d3020 0x7f46f00ac050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.899+0000 7f46f5800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46f015e980 0x7f46f00acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.899+0000 7f46f5800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46f00cb6b0 0x7f46f00cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.899+0000 7f46f5800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f46f00d3d00 con 0x7f46f015e980 2024-09-17T01:43:36.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.899+0000 7f46f5800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f46f00d3b80 con 0x7f46f00d3020 2024-09-17T01:43:36.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.899+0000 7f46f5800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f46f00d3e80 con 0x7f46f00cb6b0 2024-09-17T01:43:36.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.899+0000 7f46e7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46f015e980 0x7f46f00acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.899+0000 7f46e7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46f015e980 0x7f46f00acde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59158/0 (socket says 172.21.15.42:59158) 2024-09-17T01:43:36.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.899+0000 7f46e7400640 1 -- 172.21.15.42:0/2857529084 learned_addr learned my addr 172.21.15.42:0/2857529084 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:36.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.899+0000 7f46efe00640 1 --2- 172.21.15.42:0/2857529084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46f00d3020 0x7f46f00ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.900+0000 7f46f4e00640 1 --2- 172.21.15.42:0/2857529084 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46f00cb6b0 0x7f46f00cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.900+0000 7f46e7400640 1 -- 172.21.15.42:0/2857529084 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46f00cb6b0 msgr2=0x7f46f00cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:36.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.900+0000 7f46e7400640 1 --2- 172.21.15.42:0/2857529084 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46f00cb6b0 0x7f46f00cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.900+0000 7f46e7400640 1 -- 172.21.15.42:0/2857529084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46f00d3020 msgr2=0x7f46f00ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:36.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.900+0000 7f46e7400640 1 --2- 172.21.15.42:0/2857529084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46f00d3020 0x7f46f00ac050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.900+0000 7f46e7400640 1 -- 172.21.15.42:0/2857529084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f00ad320 con 0x7f46f015e980 2024-09-17T01:43:36.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.900+0000 7f46e7400640 1 --2- 172.21.15.42:0/2857529084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46f015e980 0x7f46f00acde0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f46d800e9f0 tx=0x7f46d800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:36.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.900+0000 7f46ecc00640 1 -- 172.21.15.42:0/2857529084 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d800cd80 con 0x7f46f015e980 2024-09-17T01:43:36.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.901+0000 7f46f5800640 1 -- 172.21.15.42:0/2857529084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46f00ab290 con 0x7f46f015e980 2024-09-17T01:43:36.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.901+0000 7f46ecc00640 1 -- 172.21.15.42:0/2857529084 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46d8004020 con 0x7f46f015e980 2024-09-17T01:43:36.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.901+0000 7f46ecc00640 1 -- 172.21.15.42:0/2857529084 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d8004450 con 0x7f46f015e980 2024-09-17T01:43:36.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.901+0000 7f46f5800640 1 -- 172.21.15.42:0/2857529084 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46f00ab850 con 0x7f46f015e980 2024-09-17T01:43:36.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.903+0000 7f46ecc00640 1 -- 172.21.15.42:0/2857529084 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f46d8005030 con 0x7f46f015e980 2024-09-17T01:43:36.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.905+0000 7f46ecc00640 1 --2- 172.21.15.42:0/2857529084 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f46cc078bc0 0x7f46cc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.905+0000 7f46ecc00640 1 -- 172.21.15.42:0/2857529084 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f46d809b5a0 con 0x7f46f015e980 2024-09-17T01:43:36.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.905+0000 7f46efe00640 1 --2- 172.21.15.42:0/2857529084 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f46cc078bc0 0x7f46cc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.905+0000 7f46fe028740 1 Processor -- start 2024-09-17T01:43:36.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.905+0000 7f46fe028740 1 -- start start 2024-09-17T01:43:36.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.906+0000 7f46efe00640 1 --2- 172.21.15.42:0/2857529084 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f46cc078bc0 0x7f46cc07b0d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f46e0001720 tx=0x7f46e0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:36.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.907+0000 7f46fe028740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebbbc390 0x5585ebfaa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.907+0000 7f46fe028740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585ebb934d0 0x5585ebf8d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.907+0000 7f46fe028740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5585ebb9b6b0 0x5585ebf8d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.907+0000 7f46fe028740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5585ebec31c0 con 0x5585ebbbc390 2024-09-17T01:43:36.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.907+0000 7f46fe028740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5585ebed6870 con 0x5585ebb934d0 2024-09-17T01:43:36.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.907+0000 7f46fe028740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5585ebec5ca0 con 0x5585ebb9b6b0 2024-09-17T01:43:36.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.907+0000 7f46efe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebbbc390 0x5585ebfaa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.907+0000 7f46efe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebbbc390 0x5585ebfaa730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59166/0 (socket says 172.21.15.42:59166) 2024-09-17T01:43:36.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.907+0000 7f46efe00640 1 -- 172.21.15.42:0/3872803627 learned_addr learned my addr 172.21.15.42:0/3872803627 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:36.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.907+0000 7f46f4e00640 1 --2- 172.21.15.42:0/3872803627 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5585ebb9b6b0 0x5585ebf8d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.907+0000 7f46e7400640 1 --2- 172.21.15.42:0/3872803627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585ebb934d0 0x5585ebf8d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.907+0000 7f46efe00640 1 -- 172.21.15.42:0/3872803627 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5585ebb9b6b0 msgr2=0x5585ebf8d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:36.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.907+0000 7f46efe00640 1 --2- 172.21.15.42:0/3872803627 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5585ebb9b6b0 0x5585ebf8d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.907+0000 7f46efe00640 1 -- 172.21.15.42:0/3872803627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585ebb934d0 msgr2=0x5585ebf8d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:36.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.907+0000 7f46efe00640 1 --2- 172.21.15.42:0/3872803627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585ebb934d0 0x5585ebf8d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.907+0000 7f46efe00640 1 -- 172.21.15.42:0/3872803627 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585ebc9e7d0 con 0x5585ebbbc390 2024-09-17T01:43:36.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.907+0000 7f46e7400640 1 --2- 172.21.15.42:0/3872803627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585ebb934d0 0x5585ebf8d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:43:36.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.908+0000 7f46efe00640 1 --2- 172.21.15.42:0/3872803627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebbbc390 0x5585ebfaa730 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f46e000f9a0 tx=0x7f46e0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b24f116400d9818 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:36.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.908+0000 7f46e4c00640 1 -- 172.21.15.42:0/3872803627 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0025070 con 0x5585ebbbc390 2024-09-17T01:43:36.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.908+0000 7f46e4c00640 1 -- 172.21.15.42:0/3872803627 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46e001b050 con 0x5585ebbbc390 2024-09-17T01:43:36.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.908+0000 7f46e4c00640 1 -- 172.21.15.42:0/3872803627 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0014de0 con 0x5585ebbbc390 2024-09-17T01:43:36.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.909+0000 7f46fe028740 1 -- 172.21.15.42:0/3872803627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebbbc390 msgr2=0x5585ebfaa730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:36.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.909+0000 7f46fe028740 1 --2- 172.21.15.42:0/3872803627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebbbc390 0x5585ebfaa730 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f46e000f9a0 tx=0x7f46e0012000 comp rx=0 tx=0).stop 2024-09-17T01:43:36.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.909+0000 7f46fe028740 1 -- 172.21.15.42:0/3872803627 shutdown_connections 2024-09-17T01:43:36.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.909+0000 7f46fe028740 1 --2- 172.21.15.42:0/3872803627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585ebb934d0 0x5585ebf8d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.909+0000 7f46fe028740 1 --2- 172.21.15.42:0/3872803627 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5585ebb9b6b0 0x5585ebf8d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.909+0000 7f46fe028740 1 --2- 172.21.15.42:0/3872803627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebbbc390 0x5585ebfaa730 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.909+0000 7f46fe028740 1 -- 172.21.15.42:0/3872803627 >> 172.21.15.42:0/3872803627 conn(0x5585ebbb04e0 msgr2=0x5585ebf63620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:36.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.909+0000 7f46fe028740 1 -- 172.21.15.42:0/3872803627 shutdown_connections 2024-09-17T01:43:36.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.909+0000 7f46fe028740 1 -- 172.21.15.42:0/3872803627 wait complete. 2024-09-17T01:43:36.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.910+0000 7f46fe028740 1 -- start start 2024-09-17T01:43:36.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.910+0000 7f46fe028740 1 Processor -- start 2024-09-17T01:43:36.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.912+0000 7f46fe028740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585ebb934d0 0x5585ebf7b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.912+0000 7f46fe028740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebb9b6b0 0x5585ebf8a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.912+0000 7f46fe028740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5585ebbbc390 0x5585ebf62960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.912+0000 7f46fe028740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5585ebe6c410 con 0x5585ebb9b6b0 2024-09-17T01:43:36.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.912+0000 7f46fe028740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5585ebec9ab0 con 0x5585ebb934d0 2024-09-17T01:43:36.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.912+0000 7f46fe028740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5585ebc36740 con 0x5585ebbbc390 2024-09-17T01:43:36.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.912+0000 7f46fe028740 10 client.0 _ll_register_callbacks cb 0x5585ebe49360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:43:36.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.912+0000 7f46e7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebb9b6b0 0x5585ebf8a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.912+0000 7f46e7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebb9b6b0 0x5585ebf8a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59168/0 (socket says 172.21.15.42:59168) 2024-09-17T01:43:36.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.912+0000 7f46e7400640 1 -- 172.21.15.42:0/714222376 learned_addr learned my addr 172.21.15.42:0/714222376 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:36.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.912+0000 7f46f4e00640 1 --2- 172.21.15.42:0/714222376 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5585ebbbc390 0x5585ebf62960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.912+0000 7f46efe00640 1 --2- 172.21.15.42:0/714222376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585ebb934d0 0x5585ebf7b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.912+0000 7f46e7400640 1 -- 172.21.15.42:0/714222376 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5585ebbbc390 msgr2=0x5585ebf62960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:36.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.912+0000 7f46e7400640 1 --2- 172.21.15.42:0/714222376 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5585ebbbc390 0x5585ebf62960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.912+0000 7f46e7400640 1 -- 172.21.15.42:0/714222376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585ebb934d0 msgr2=0x5585ebf7b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:36.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.912+0000 7f46e7400640 1 --2- 172.21.15.42:0/714222376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585ebb934d0 0x5585ebf7b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.913+0000 7f46e7400640 1 -- 172.21.15.42:0/714222376 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585ebc27970 con 0x5585ebb9b6b0 2024-09-17T01:43:36.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.913+0000 7f46e7400640 1 --2- 172.21.15.42:0/714222376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebb9b6b0 0x5585ebf8a380 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f46d8060570 tx=0x7f46d80638d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=690cba57610a57cb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:36.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.913+0000 7f46dd600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:43:36.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.913+0000 7f46dd600640 1 -- 172.21.15.42:0/714222376 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d8089020 con 0x5585ebb9b6b0 2024-09-17T01:43:36.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.913+0000 7f46dd600640 1 -- 172.21.15.42:0/714222376 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f46d809b2c0 con 0x5585ebb9b6b0 2024-09-17T01:43:36.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.913+0000 7f46fe028740 1 -- 172.21.15.42:0/714222376 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46e001b050 con 0x5585ebb9b6b0 2024-09-17T01:43:36.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.913+0000 7f46dd600640 1 -- 172.21.15.42:0/714222376 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) ==== 24+0+0 (secure 0 0 0) 0x7f46d8082050 con 0x5585ebb9b6b0 2024-09-17T01:43:36.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.913+0000 7f46fe028740 10 client.9243 fetch_fsmap learned FSMap version 116 2024-09-17T01:43:36.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.913+0000 7f46fe028740 1 -- 172.21.15.42:0/714222376 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) -- 0x5585ebc056a0 con 0x5585ebb9b6b0 2024-09-17T01:43:36.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.913+0000 7f46dd600640 1 -- 172.21.15.42:0/714222376 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46e001b050 con 0x5585ebb9b6b0 2024-09-17T01:43:36.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.914+0000 7f46dd600640 1 -- 172.21.15.42:0/714222376 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 116) ==== 3502+0+0 (secure 0 0 0) 0x7f46d8062560 con 0x5585ebb9b6b0 2024-09-17T01:43:36.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.914+0000 7f46fe028740 10 client.9243 fetch_fsmap finished waiting for FSMap version 116 2024-09-17T01:43:36.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.914+0000 7f46fe028740 10 client.9243 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-17T01:43:36.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.914+0000 7f46fe028740 20 client.9243 populate_metadata read hostname 'smithi042' 2024-09-17T01:43:36.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.914+0000 7f46fe028740 1 --2- 172.21.15.42:0/714222376 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x5585ebb7af60 0x5585ebfba7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.914+0000 7f46fe028740 4 client.9243 mds_command: new command op to 8982 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:43:36.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.914+0000 7f46fe028740 1 -- 172.21.15.42:0/714222376 --> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585ebed87c0 con 0x5585ebb7af60 2024-09-17T01:43:36.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.914+0000 7f46efe00640 1 --2- 172.21.15.42:0/714222376 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x5585ebb7af60 0x5585ebfba7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.915+0000 7f46efe00640 1 --2- 172.21.15.42:0/714222376 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x5585ebb7af60 0x5585ebfba7b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21aed27b323e6e67 server_cookie=c73c0cf1d1feaf29 in_seq=0 out_seq=0 2024-09-17T01:43:36.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.915+0000 7f46dd600640 10 client.9243 ms_handle_connect on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:36.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.915+0000 7f46dd600640 1 -- 172.21.15.42:0/714222376 <== mds.0 v2:172.21.15.42:6832/3811049376 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5585ebed87c0 con 0x5585ebb7af60 2024-09-17T01:43:36.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.915+0000 7f46dd600640 10 client.9243 handle_command_reply: tid=0 2024-09-17T01:43:36.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.915+0000 7f46fe028740 1 client.9243 shutdown 2024-09-17T01:43:36.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.916+0000 7f46fe028740 1 -- 172.21.15.42:0/714222376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebb9b6b0 msgr2=0x5585ebf8a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:36.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.916+0000 7f46fe028740 1 --2- 172.21.15.42:0/714222376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebb9b6b0 0x5585ebf8a380 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f46d8060570 tx=0x7f46d80638d0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.916+0000 7f46fe028740 1 -- 172.21.15.42:0/714222376 shutdown_connections 2024-09-17T01:43:36.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.916+0000 7f46fe028740 1 --2- 172.21.15.42:0/714222376 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x5585ebb7af60 0x5585ebfba7b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.916+0000 7f46fe028740 1 --2- 172.21.15.42:0/714222376 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5585ebbbc390 0x5585ebf62960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.916+0000 7f46fe028740 1 --2- 172.21.15.42:0/714222376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebb9b6b0 0x5585ebf8a380 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.916+0000 7f46fe028740 1 --2- 172.21.15.42:0/714222376 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585ebb934d0 0x5585ebf7b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.916+0000 7f46fe028740 1 -- 172.21.15.42:0/714222376 >> 172.21.15.42:0/714222376 conn(0x5585ebbb04e0 msgr2=0x5585ebf5c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:36.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.916+0000 7f46dd600640 0 client.9243 ms_handle_reset on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:36.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.916+0000 7f46fe028740 1 -- 172.21.15.42:0/714222376 shutdown_connections 2024-09-17T01:43:36.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.916+0000 7f46fe028740 1 -- 172.21.15.42:0/714222376 wait complete. 2024-09-17T01:43:36.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.916+0000 7f46fe028740 20 client.9243 trim_cache size 0 max 16384 2024-09-17T01:43:36.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.935+0000 7f46fe028740 1 Processor -- start 2024-09-17T01:43:36.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.935+0000 7f46fe028740 1 -- start start 2024-09-17T01:43:36.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.936+0000 7f46fe028740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5585ebb934d0 0x5585ebf8d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.936+0000 7f46fe028740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585ebb9b6b0 0x5585ebf9e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.936+0000 7f46fe028740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebbbc390 0x5585ebf9e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.936+0000 7f46fe028740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f46f0202140 con 0x5585ebbbc390 2024-09-17T01:43:36.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.936+0000 7f46fe028740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f46f0201120 con 0x5585ebb9b6b0 2024-09-17T01:43:36.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.936+0000 7f46fe028740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f46f01f9140 con 0x5585ebb934d0 2024-09-17T01:43:36.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.936+0000 7f46f4e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebbbc390 0x5585ebf9e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.936+0000 7f46f4e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebbbc390 0x5585ebf9e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59182/0 (socket says 172.21.15.42:59182) 2024-09-17T01:43:36.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.936+0000 7f46f4e00640 1 -- 172.21.15.42:0/482590306 learned_addr learned my addr 172.21.15.42:0/482590306 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:36.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.936+0000 7f46efe00640 1 --2- 172.21.15.42:0/482590306 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5585ebb934d0 0x5585ebf8d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.936+0000 7f46e7400640 1 --2- 172.21.15.42:0/482590306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585ebb9b6b0 0x5585ebf9e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.937+0000 7f46f4e00640 1 -- 172.21.15.42:0/482590306 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5585ebb934d0 msgr2=0x5585ebf8d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:36.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.937+0000 7f46f4e00640 1 --2- 172.21.15.42:0/482590306 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5585ebb934d0 0x5585ebf8d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.937+0000 7f46f4e00640 1 -- 172.21.15.42:0/482590306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585ebb9b6b0 msgr2=0x5585ebf9e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:36.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.937+0000 7f46f4e00640 1 --2- 172.21.15.42:0/482590306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585ebb9b6b0 0x5585ebf9e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.937+0000 7f46f4e00640 1 -- 172.21.15.42:0/482590306 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585ebfb6bc0 con 0x5585ebbbc390 2024-09-17T01:43:36.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.937+0000 7f46e7400640 1 --2- 172.21.15.42:0/482590306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585ebb9b6b0 0x5585ebf9e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:43:36.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.937+0000 7f46f4e00640 1 --2- 172.21.15.42:0/482590306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebbbc390 0x5585ebf9e850 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009cd0 tx=0x7f46e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a187f6dd44a325c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:36.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.937+0000 7f46dfe00640 1 -- 172.21.15.42:0/482590306 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e804b070 con 0x5585ebbbc390 2024-09-17T01:43:36.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.937+0000 7f46dfe00640 1 -- 172.21.15.42:0/482590306 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46e8003e30 con 0x5585ebbbc390 2024-09-17T01:43:36.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.937+0000 7f46dfe00640 1 -- 172.21.15.42:0/482590306 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e8037040 con 0x5585ebbbc390 2024-09-17T01:43:36.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.938+0000 7f46fe028740 1 -- 172.21.15.42:0/482590306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebbbc390 msgr2=0x5585ebf9e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:36.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.938+0000 7f46fe028740 1 --2- 172.21.15.42:0/482590306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebbbc390 0x5585ebf9e850 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009cd0 tx=0x7f46e8004a40 comp rx=0 tx=0).stop 2024-09-17T01:43:36.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.938+0000 7f46fe028740 1 -- 172.21.15.42:0/482590306 shutdown_connections 2024-09-17T01:43:36.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.938+0000 7f46fe028740 1 --2- 172.21.15.42:0/482590306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585ebb9b6b0 0x5585ebf9e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.938+0000 7f46fe028740 1 --2- 172.21.15.42:0/482590306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebbbc390 0x5585ebf9e850 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.938+0000 7f46fe028740 1 --2- 172.21.15.42:0/482590306 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5585ebb934d0 0x5585ebf8d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.938+0000 7f46fe028740 1 -- 172.21.15.42:0/482590306 >> 172.21.15.42:0/482590306 conn(0x5585ebbb04e0 msgr2=0x5585ebf5c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:36.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.938+0000 7f46fe028740 1 -- 172.21.15.42:0/482590306 shutdown_connections 2024-09-17T01:43:36.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.938+0000 7f46fe028740 1 -- 172.21.15.42:0/482590306 wait complete. 2024-09-17T01:43:36.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.939+0000 7f46fe028740 1 -- start start 2024-09-17T01:43:36.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.939+0000 7f46fe028740 1 Processor -- start 2024-09-17T01:43:36.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.941+0000 7f46fe028740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5585ebb934d0 0x5585ec0243e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.941+0000 7f46fe028740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585ebb9b6b0 0x5585ebfc0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.941+0000 7f46fe028740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebbbc390 0x5585ebf8d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.941+0000 7f46fe028740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5585ebf85440 con 0x5585ebbbc390 2024-09-17T01:43:36.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.941+0000 7f46fe028740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f46f0200bc0 con 0x5585ebb9b6b0 2024-09-17T01:43:36.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.941+0000 7f46fe028740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5585ebfc0ec0 con 0x5585ebb934d0 2024-09-17T01:43:36.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.941+0000 7f46fe028740 10 client.0 _ll_register_callbacks cb 0x7f46d8004680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:43:36.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.941+0000 7f46f4e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebbbc390 0x5585ebf8d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.941+0000 7f46f4e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebbbc390 0x5585ebf8d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59184/0 (socket says 172.21.15.42:59184) 2024-09-17T01:43:36.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.941+0000 7f46f4e00640 1 -- 172.21.15.42:0/4075332029 learned_addr learned my addr 172.21.15.42:0/4075332029 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:36.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.941+0000 7f46efe00640 1 --2- 172.21.15.42:0/4075332029 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5585ebb934d0 0x5585ec0243e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.941+0000 7f46e7400640 1 --2- 172.21.15.42:0/4075332029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585ebb9b6b0 0x5585ebfc0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.942+0000 7f46f4e00640 1 -- 172.21.15.42:0/4075332029 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5585ebb934d0 msgr2=0x5585ec0243e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:36.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.942+0000 7f46f4e00640 1 --2- 172.21.15.42:0/4075332029 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5585ebb934d0 0x5585ec0243e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.942+0000 7f46f4e00640 1 -- 172.21.15.42:0/4075332029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585ebb9b6b0 msgr2=0x5585ebfc0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:36.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.942+0000 7f46f4e00640 1 --2- 172.21.15.42:0/4075332029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585ebb9b6b0 0x5585ebfc0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.942+0000 7f46f4e00640 1 -- 172.21.15.42:0/4075332029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585ec0278c0 con 0x5585ebbbc390 2024-09-17T01:43:36.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.942+0000 7f46f4e00640 1 --2- 172.21.15.42:0/4075332029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebbbc390 0x5585ebf8d820 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009420 tx=0x7f46e80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4318de3e9eeb84fd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:36.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.942+0000 7f46dd600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:43:36.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.942+0000 7f46dd600640 1 -- 172.21.15.42:0/4075332029 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e804b070 con 0x5585ebbbc390 2024-09-17T01:43:36.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.942+0000 7f46dd600640 1 -- 172.21.15.42:0/4075332029 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f46e8043040 con 0x5585ebbbc390 2024-09-17T01:43:36.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.942+0000 7f46fe028740 1 -- 172.21.15.42:0/4075332029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46e8003e30 con 0x5585ebbbc390 2024-09-17T01:43:36.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.943+0000 7f46dd600640 1 -- 172.21.15.42:0/4075332029 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) ==== 24+0+0 (secure 0 0 0) 0x7f46e8059050 con 0x5585ebbbc390 2024-09-17T01:43:36.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.943+0000 7f46fe028740 10 client.9249 fetch_fsmap learned FSMap version 116 2024-09-17T01:43:36.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.943+0000 7f46fe028740 1 -- 172.21.15.42:0/4075332029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) -- 0x5585ebf85b20 con 0x5585ebbbc390 2024-09-17T01:43:36.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.943+0000 7f46dd600640 1 -- 172.21.15.42:0/4075332029 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46e8003e30 con 0x5585ebbbc390 2024-09-17T01:43:36.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.943+0000 7f46dd600640 1 -- 172.21.15.42:0/4075332029 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 116) ==== 3502+0+0 (secure 0 0 0) 0x7f46e805c020 con 0x5585ebbbc390 2024-09-17T01:43:36.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.943+0000 7f46fe028740 10 client.9249 fetch_fsmap finished waiting for FSMap version 116 2024-09-17T01:43:36.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.943+0000 7f46fe028740 10 client.9249 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-17T01:43:36.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.943+0000 7f46fe028740 20 client.9249 populate_metadata read hostname 'smithi042' 2024-09-17T01:43:36.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.943+0000 7f46fe028740 1 --2- 172.21.15.42:0/4075332029 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x5585ebf8dd60 0x5585ebf9e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:36.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.943+0000 7f46fe028740 4 client.9249 mds_command: new command op to 8982 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:43:36.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.943+0000 7f46fe028740 1 -- 172.21.15.42:0/4075332029 --> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5585ebf87eb0 con 0x5585ebf8dd60 2024-09-17T01:43:36.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.943+0000 7f46efe00640 1 --2- 172.21.15.42:0/4075332029 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x5585ebf8dd60 0x5585ebf9e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:36.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.944+0000 7f46efe00640 1 --2- 172.21.15.42:0/4075332029 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x5585ebf8dd60 0x5585ebf9e310 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73fb4e2f9fa8a771 server_cookie=55d099128ca3e11 in_seq=0 out_seq=0 2024-09-17T01:43:36.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.944+0000 7f46dd600640 10 client.9249 ms_handle_connect on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:36.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.944+0000 7f46dd600640 1 -- 172.21.15.42:0/4075332029 <== mds.0 v2:172.21.15.42:6832/3811049376 1 ==== command_reply(tid 0: 0 ) ==== 8+0+610 (crc 0 0 0) 0x5585ebf87eb0 con 0x5585ebf8dd60 2024-09-17T01:43:36.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.944+0000 7f46dd600640 10 client.9249 handle_command_reply: tid=0 2024-09-17T01:43:36.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.944+0000 7f46fe028740 1 client.9249 shutdown 2024-09-17T01:43:36.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.944+0000 7f46fe028740 1 -- 172.21.15.42:0/4075332029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebbbc390 msgr2=0x5585ebf8d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:36.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.944+0000 7f46fe028740 1 --2- 172.21.15.42:0/4075332029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebbbc390 0x5585ebf8d820 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009420 tx=0x7f46e80043c0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.944+0000 7f46fe028740 1 -- 172.21.15.42:0/4075332029 shutdown_connections 2024-09-17T01:43:36.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.944+0000 7f46fe028740 1 --2- 172.21.15.42:0/4075332029 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x5585ebf8dd60 0x5585ebf9e310 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.944+0000 7f46fe028740 1 --2- 172.21.15.42:0/4075332029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585ebb9b6b0 0x5585ebfc0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.944+0000 7f46fe028740 1 --2- 172.21.15.42:0/4075332029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5585ebbbc390 0x5585ebf8d820 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.944+0000 7f46fe028740 1 --2- 172.21.15.42:0/4075332029 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5585ebb934d0 0x5585ec0243e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.944+0000 7f46dd600640 0 client.9249 ms_handle_reset on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:36.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.944+0000 7f46fe028740 1 -- 172.21.15.42:0/4075332029 >> 172.21.15.42:0/4075332029 conn(0x5585ebbb04e0 msgr2=0x5585ebf58f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:36.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.945+0000 7f46fe028740 1 -- 172.21.15.42:0/4075332029 shutdown_connections 2024-09-17T01:43:36.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.945+0000 7f46fe028740 1 -- 172.21.15.42:0/4075332029 wait complete. 2024-09-17T01:43:36.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.945+0000 7f46fe028740 20 client.9249 trim_cache size 0 max 16384 2024-09-17T01:43:36.960 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:43:36.960 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-17T01:43:36.960 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-09-17T01:43:36.960 INFO:teuthology.orchestra.run.smithi042.stdout: "b7cf205b-474d-4b2b-864d-637bc207bb9a": { 2024-09-17T01:43:36.960 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_control_test_path", 2024-09-17T01:43:36.961 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "b7cf205b-474d-4b2b-864d-637bc207bb9a", 2024-09-17T01:43:36.961 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive" 2024-09-17T01:43:36.961 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:43:36.961 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:43:36.961 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_stats": { 2024-09-17T01:43:36.962 INFO:teuthology.orchestra.run.smithi042.stdout: "b7cf205b-474d-4b2b-864d-637bc207bb9a": { 2024-09-17T01:43:36.962 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:43:28.483031+0000", 2024-09-17T01:43:36.962 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_control_test_path", 2024-09-17T01:43:36.962 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:43:36.962 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:43:36.962 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:43:36.963 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:43:36.963 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:43:36.963 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:43:36.963 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:43:36.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.945+0000 7f46f5800640 1 -- 172.21.15.42:0/2857529084 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f46cc078bc0 msgr2=0x7f46cc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:36.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.945+0000 7f46f5800640 1 --2- 172.21.15.42:0/2857529084 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f46cc078bc0 0x7f46cc07b0d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f46e0001720 tx=0x7f46e0009040 comp rx=0 tx=0).stop 2024-09-17T01:43:36.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.945+0000 7f46f5800640 1 -- 172.21.15.42:0/2857529084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46f015e980 msgr2=0x7f46f00acde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:36.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.945+0000 7f46f5800640 1 --2- 172.21.15.42:0/2857529084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46f015e980 0x7f46f00acde0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f46d800e9f0 tx=0x7f46d800eeb0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.945+0000 7f46f5800640 1 -- 172.21.15.42:0/2857529084 shutdown_connections 2024-09-17T01:43:36.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.945+0000 7f46f5800640 1 --2- 172.21.15.42:0/2857529084 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f46cc078bc0 0x7f46cc07b0d0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.945+0000 7f46f5800640 1 --2- 172.21.15.42:0/2857529084 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46f00cb6b0 0x7f46f00cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.945+0000 7f46f5800640 1 --2- 172.21.15.42:0/2857529084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46f015e980 0x7f46f00acde0 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.945+0000 7f46f5800640 1 --2- 172.21.15.42:0/2857529084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46f00d3020 0x7f46f00ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:36.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.945+0000 7f46f5800640 1 -- 172.21.15.42:0/2857529084 >> 172.21.15.42:0/2857529084 conn(0x7f46f006cf00 msgr2=0x7f46f015f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:36.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.945+0000 7f46f5800640 1 -- 172.21.15.42:0/2857529084 shutdown_connections 2024-09-17T01:43:36.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:36.945+0000 7f46f5800640 1 -- 172.21.15.42:0/2857529084 wait complete. 2024-09-17T01:43:36.967 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:43:37.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.196+0000 7f9b83000640 1 -- 172.21.15.42:0/1743069213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b7c0cec40 msgr2=0x7f9b7c0cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:37.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.196+0000 7f9b83000640 1 --2- 172.21.15.42:0/1743069213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b7c0cec40 0x7f9b7c0cf050 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f9b74005fd0 tx=0x7f9b7402a8b0 comp rx=0 tx=0).stop 2024-09-17T01:43:37.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.197+0000 7f9b83000640 1 -- 172.21.15.42:0/1743069213 shutdown_connections 2024-09-17T01:43:37.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.197+0000 7f9b83000640 1 --2- 172.21.15.42:0/1743069213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b7c0cec40 0x7f9b7c0cf050 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:37.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.197+0000 7f9b83000640 1 -- 172.21.15.42:0/1743069213 >> 172.21.15.42:0/1743069213 conn(0x7f9b7c0b2930 msgr2=0x7f9b7c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:37.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.197+0000 7f9b83000640 1 -- 172.21.15.42:0/1743069213 shutdown_connections 2024-09-17T01:43:37.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.197+0000 7f9b83000640 1 -- 172.21.15.42:0/1743069213 wait complete. 2024-09-17T01:43:37.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.199+0000 7f9b83000640 1 Processor -- start 2024-09-17T01:43:37.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.199+0000 7f9b83000640 1 -- start start 2024-09-17T01:43:37.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.200+0000 7f9b83000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b7c0b3550 0x7f9b7c13e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:37.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.200+0000 7f9b83000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9b7c0cec40 0x7f9b7c1580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:37.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.200+0000 7f9b83000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b7c142f40 0x7f9b7c1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:37.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.201+0000 7f9b83000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c06d900 con 0x7f9b7c0b3550 2024-09-17T01:43:37.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.201+0000 7f9b83000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c06d780 con 0x7f9b7c142f40 2024-09-17T01:43:37.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.201+0000 7f9b83000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9b7c06da80 con 0x7f9b7c0cec40 2024-09-17T01:43:37.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.201+0000 7f9b7be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b7c0b3550 0x7f9b7c13e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:37.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.201+0000 7f9b7be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b7c0b3550 0x7f9b7c13e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59206/0 (socket says 172.21.15.42:59206) 2024-09-17T01:43:37.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.201+0000 7f9b7be00640 1 -- 172.21.15.42:0/1639552382 learned_addr learned my addr 172.21.15.42:0/1639552382 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:37.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.201+0000 7f9b73e00640 1 --2- 172.21.15.42:0/1639552382 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9b7c0cec40 0x7f9b7c1580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:37.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.201+0000 7f9b81000640 1 --2- 172.21.15.42:0/1639552382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b7c142f40 0x7f9b7c1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:37.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.201+0000 7f9b7be00640 1 -- 172.21.15.42:0/1639552382 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9b7c0cec40 msgr2=0x7f9b7c1580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:37.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.201+0000 7f9b7be00640 1 --2- 172.21.15.42:0/1639552382 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9b7c0cec40 0x7f9b7c1580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:37.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.201+0000 7f9b7be00640 1 -- 172.21.15.42:0/1639552382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b7c142f40 msgr2=0x7f9b7c1585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:37.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.201+0000 7f9b7be00640 1 --2- 172.21.15.42:0/1639552382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b7c142f40 0x7f9b7c1585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:37.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.201+0000 7f9b7be00640 1 -- 172.21.15.42:0/1639552382 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b7c0af420 con 0x7f9b7c0b3550 2024-09-17T01:43:37.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.202+0000 7f9b7be00640 1 --2- 172.21.15.42:0/1639552382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b7c0b3550 0x7f9b7c13e220 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00c430 tx=0x7f9b6c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:37.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.202+0000 7f9b78c00640 1 -- 172.21.15.42:0/1639552382 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c011790 con 0x7f9b7c0b3550 2024-09-17T01:43:37.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.202+0000 7f9b78c00640 1 -- 172.21.15.42:0/1639552382 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b6c017070 con 0x7f9b7c0b3550 2024-09-17T01:43:37.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.202+0000 7f9b83000640 1 -- 172.21.15.42:0/1639552382 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b7c0af700 con 0x7f9b7c0b3550 2024-09-17T01:43:37.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.202+0000 7f9b78c00640 1 -- 172.21.15.42:0/1639552382 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c011ce0 con 0x7f9b7c0b3550 2024-09-17T01:43:37.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.202+0000 7f9b83000640 1 -- 172.21.15.42:0/1639552382 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b7c1555c0 con 0x7f9b7c0b3550 2024-09-17T01:43:37.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.203+0000 7f9b83000640 1 -- 172.21.15.42:0/1639552382 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b7c0cf050 con 0x7f9b7c0b3550 2024-09-17T01:43:37.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.204+0000 7f9b78c00640 1 -- 172.21.15.42:0/1639552382 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9b6c01c460 con 0x7f9b7c0b3550 2024-09-17T01:43:37.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.205+0000 7f9b78c00640 1 --2- 172.21.15.42:0/1639552382 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9b58078bc0 0x7f9b5807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:37.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.205+0000 7f9b78c00640 1 -- 172.21.15.42:0/1639552382 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f9b6c09aa50 con 0x7f9b7c0b3550 2024-09-17T01:43:37.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.206+0000 7f9b73e00640 1 --2- 172.21.15.42:0/1639552382 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9b58078bc0 0x7f9b5807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:37.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.207+0000 7f9b73e00640 1 --2- 172.21.15.42:0/1639552382 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9b58078bc0 0x7f9b5807b0d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c1680c0 tx=0x7f9b64009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:37.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.210+0000 7f9b78c00640 1 -- 172.21.15.42:0/1639552382 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9b6c0627a0 con 0x7f9b7c0b3550 2024-09-17T01:43:37.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.442+0000 7f9b83000640 1 -- 172.21.15.42:0/1639552382 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b7c06a170 con 0x7f9b7c0b3550 2024-09-17T01:43:37.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.443+0000 7f9b78c00640 1 -- 172.21.15.42:0/1639552382 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) ==== 95+0+5230 (secure 0 0 0) 0x7f9b6c0671d0 con 0x7f9b7c0b3550 2024-09-17T01:43:37.442 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:37.442 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3131119825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3131119825},{"type":"v1","addr":"172.21.15.43:6837","nonce":3131119825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8368,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1988657429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1988657429},{"type":"v1","addr":"172.21.15.43:6836","nonce":1988657429}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/578887548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":578887548},{"type":"v1","addr":"172.21.15.42:6835","nonce":578887548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:42:57.184518+0000","modified":"2024-09-17T01:43:00.201156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8982":{"gid":8982,"name":"c","rank":0,"incarnation":112,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6834/3811049376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3811049376},{"type":"v1","addr":"172.21.15.42:6834","nonce":3811049376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8982,"qdb_cluster":[8982]},"id":10}]} 2024-09-17T01:43:37.442 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 116 2024-09-17T01:43:37.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.445+0000 7f9b83000640 1 -- 172.21.15.42:0/1639552382 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9b58078bc0 msgr2=0x7f9b5807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:37.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.445+0000 7f9b83000640 1 --2- 172.21.15.42:0/1639552382 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9b58078bc0 0x7f9b5807b0d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c1680c0 tx=0x7f9b64009040 comp rx=0 tx=0).stop 2024-09-17T01:43:37.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.445+0000 7f9b83000640 1 -- 172.21.15.42:0/1639552382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b7c0b3550 msgr2=0x7f9b7c13e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:37.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.445+0000 7f9b83000640 1 --2- 172.21.15.42:0/1639552382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b7c0b3550 0x7f9b7c13e220 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00c430 tx=0x7f9b6c00c8f0 comp rx=0 tx=0).stop 2024-09-17T01:43:37.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.446+0000 7f9b83000640 1 -- 172.21.15.42:0/1639552382 shutdown_connections 2024-09-17T01:43:37.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.446+0000 7f9b83000640 1 --2- 172.21.15.42:0/1639552382 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9b58078bc0 0x7f9b5807b0d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:37.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.446+0000 7f9b83000640 1 --2- 172.21.15.42:0/1639552382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b7c142f40 0x7f9b7c1585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:37.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.446+0000 7f9b83000640 1 --2- 172.21.15.42:0/1639552382 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9b7c0cec40 0x7f9b7c1580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:37.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.446+0000 7f9b83000640 1 --2- 172.21.15.42:0/1639552382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b7c0b3550 0x7f9b7c13e220 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:37.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.446+0000 7f9b83000640 1 -- 172.21.15.42:0/1639552382 >> 172.21.15.42:0/1639552382 conn(0x7f9b7c0b2930 msgr2=0x7f9b7c15eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:37.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.446+0000 7f9b83000640 1 -- 172.21.15.42:0/1639552382 shutdown_connections 2024-09-17T01:43:37.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.446+0000 7f9b83000640 1 -- 172.21.15.42:0/1639552382 wait complete. 2024-09-17T01:43:37.468 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T01:43:37.469 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:43:37.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.697+0000 7f2369c00640 1 -- 172.21.15.42:0/4244348319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2364162fa0 msgr2=0x7f236415e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:37.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.697+0000 7f2369c00640 1 --2- 172.21.15.42:0/4244348319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2364162fa0 0x7f236415e910 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f234c009830 tx=0x7f234c02a4d0 comp rx=0 tx=0).stop 2024-09-17T01:43:37.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.697+0000 7f2369c00640 1 -- 172.21.15.42:0/4244348319 shutdown_connections 2024-09-17T01:43:37.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.697+0000 7f2369c00640 1 --2- 172.21.15.42:0/4244348319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2364162fa0 0x7f236415e910 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:37.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.697+0000 7f2369c00640 1 --2- 172.21.15.42:0/4244348319 >> v2:172.21.15.43:3300/0 conn(0x7f2364073340 0x7f23640d2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:37.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.697+0000 7f2369c00640 1 -- 172.21.15.42:0/4244348319 >> 172.21.15.42:0/4244348319 conn(0x7f23640d1210 msgr2=0x7f23640d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:37.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.697+0000 7f2369c00640 1 -- 172.21.15.42:0/4244348319 shutdown_connections 2024-09-17T01:43:37.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.697+0000 7f2369c00640 1 -- 172.21.15.42:0/4244348319 wait complete. 2024-09-17T01:43:37.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.700+0000 7f2369c00640 1 Processor -- start 2024-09-17T01:43:37.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.700+0000 7f2369c00640 1 -- start start 2024-09-17T01:43:37.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.702+0000 7f2369c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2364073340 0x7f23641499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:37.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.702+0000 7f2369c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23640b6030 0x7f2364160a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:37.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.702+0000 7f2369c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2364162fa0 0x7f23640ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:37.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.702+0000 7f2369c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f236415f850 con 0x7f2364073340 2024-09-17T01:43:37.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.702+0000 7f2369c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f236415f6d0 con 0x7f23640b6030 2024-09-17T01:43:37.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.702+0000 7f2369c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f236415f9d0 con 0x7f2364162fa0 2024-09-17T01:43:37.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.702+0000 7f2363e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2364073340 0x7f23641499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:37.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.702+0000 7f2363e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2364073340 0x7f23641499a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59212/0 (socket says 172.21.15.42:59212) 2024-09-17T01:43:37.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.702+0000 7f2363e00640 1 -- 172.21.15.42:0/1710911855 learned_addr learned my addr 172.21.15.42:0/1710911855 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:37.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.702+0000 7f235be00640 1 --2- 172.21.15.42:0/1710911855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23640b6030 0x7f2364160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:37.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.702+0000 7f2369200640 1 --2- 172.21.15.42:0/1710911855 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2364162fa0 0x7f23640ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:37.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.702+0000 7f2363e00640 1 -- 172.21.15.42:0/1710911855 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2364162fa0 msgr2=0x7f23640ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:37.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.702+0000 7f2363e00640 1 --2- 172.21.15.42:0/1710911855 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2364162fa0 0x7f23640ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:37.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.702+0000 7f2363e00640 1 -- 172.21.15.42:0/1710911855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23640b6030 msgr2=0x7f2364160a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:37.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.702+0000 7f2363e00640 1 --2- 172.21.15.42:0/1710911855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23640b6030 0x7f2364160a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:37.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.702+0000 7f2363e00640 1 -- 172.21.15.42:0/1710911855 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2364149ee0 con 0x7f2364073340 2024-09-17T01:43:37.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.702+0000 7f235be00640 1 --2- 172.21.15.42:0/1710911855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23640b6030 0x7f2364160a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:43:37.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.703+0000 7f2363e00640 1 --2- 172.21.15.42:0/1710911855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2364073340 0x7f23641499a0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f235400e7c0 tx=0x7f235400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:37.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.703+0000 7f2360c00640 1 -- 172.21.15.42:0/1710911855 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235400ccc0 con 0x7f2364073340 2024-09-17T01:43:37.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.703+0000 7f2360c00640 1 -- 172.21.15.42:0/1710911855 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2354010430 con 0x7f2364073340 2024-09-17T01:43:37.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.703+0000 7f2369c00640 1 -- 172.21.15.42:0/1710911855 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23641576f0 con 0x7f2364073340 2024-09-17T01:43:37.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.703+0000 7f2360c00640 1 -- 172.21.15.42:0/1710911855 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2354010860 con 0x7f2364073340 2024-09-17T01:43:37.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.703+0000 7f2369c00640 1 -- 172.21.15.42:0/1710911855 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2364157410 con 0x7f2364073340 2024-09-17T01:43:37.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.704+0000 7f2369c00640 1 -- 172.21.15.42:0/1710911855 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2364076450 con 0x7f2364073340 2024-09-17T01:43:37.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.706+0000 7f2360c00640 1 -- 172.21.15.42:0/1710911855 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2354010a00 con 0x7f2364073340 2024-09-17T01:43:37.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.707+0000 7f2360c00640 1 --2- 172.21.15.42:0/1710911855 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2340078b90 0x7f234007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:37.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.707+0000 7f2360c00640 1 -- 172.21.15.42:0/1710911855 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f235409b830 con 0x7f2364073340 2024-09-17T01:43:37.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.707+0000 7f235be00640 1 --2- 172.21.15.42:0/1710911855 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2340078b90 0x7f234007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:37.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.708+0000 7f235be00640 1 --2- 172.21.15.42:0/1710911855 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2340078b90 0x7f234007b0a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f234c034000 tx=0x7f234c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:37.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.711+0000 7f2360c00640 1 -- 172.21.15.42:0/1710911855 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2364076450 con 0x7f2364073340 2024-09-17T01:43:37.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.981+0000 7f2369c00640 1 -- 172.21.15.42:0/1710911855 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f23640d2810 con 0x7f2364073340 2024-09-17T01:43:37.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.981+0000 7f2360c00640 1 -- 172.21.15.42:0/1710911855 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7f2364149ee0 con 0x7f2364073340 2024-09-17T01:43:37.981 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:37.981 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":718,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":147,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1077031982,"bytes_used":2596196352,"bytes_avail":770497916928,"bytes_total":773094113280,"write_bytes_sec":18710149,"read_op_per_sec":0,"write_op_per_sec":37},"fsmap":{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":8982}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-17T01:43:35.179714+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:43:37.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.984+0000 7f2369c00640 1 -- 172.21.15.42:0/1710911855 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2340078b90 msgr2=0x7f234007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:37.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.984+0000 7f2369c00640 1 --2- 172.21.15.42:0/1710911855 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2340078b90 0x7f234007b0a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f234c034000 tx=0x7f234c004730 comp rx=0 tx=0).stop 2024-09-17T01:43:37.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.984+0000 7f2369c00640 1 -- 172.21.15.42:0/1710911855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2364073340 msgr2=0x7f23641499a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:37.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.984+0000 7f2369c00640 1 --2- 172.21.15.42:0/1710911855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2364073340 0x7f23641499a0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f235400e7c0 tx=0x7f235400ec80 comp rx=0 tx=0).stop 2024-09-17T01:43:37.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.984+0000 7f2369c00640 1 -- 172.21.15.42:0/1710911855 shutdown_connections 2024-09-17T01:43:37.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.984+0000 7f2369c00640 1 --2- 172.21.15.42:0/1710911855 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2340078b90 0x7f234007b0a0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:37.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.984+0000 7f2369c00640 1 --2- 172.21.15.42:0/1710911855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23640b6030 0x7f2364160a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:37.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.984+0000 7f2369c00640 1 --2- 172.21.15.42:0/1710911855 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2364162fa0 0x7f23640ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:37.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.984+0000 7f2369c00640 1 --2- 172.21.15.42:0/1710911855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2364073340 0x7f23641499a0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:37.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.984+0000 7f2369c00640 1 -- 172.21.15.42:0/1710911855 >> 172.21.15.42:0/1710911855 conn(0x7f23640d1210 msgr2=0x7f23640d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:37.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.984+0000 7f2369c00640 1 -- 172.21.15.42:0/1710911855 shutdown_connections 2024-09-17T01:43:37.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:37.984+0000 7f2369c00640 1 -- 172.21.15.42:0/1710911855 wait complete. 2024-09-17T01:43:38.005 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-17T01:43:38.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:43:38.006 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub resume 2024-09-17T01:43:38.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.235+0000 7f7d94e00640 1 -- 172.21.15.42:0/1405784467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d90145210 msgr2=0x7f7d90070bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:38.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.235+0000 7f7d94e00640 1 --2- 172.21.15.42:0/1405784467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d90145210 0x7f7d90070bc0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f7d900b0c80 tx=0x7f7d8002aac0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.236+0000 7f7d94e00640 1 -- 172.21.15.42:0/1405784467 shutdown_connections 2024-09-17T01:43:38.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.236+0000 7f7d94e00640 1 --2- 172.21.15.42:0/1405784467 >> v2:172.21.15.43:3300/0 conn(0x7f7d900b5450 0x7f7d900b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.236+0000 7f7d94e00640 1 --2- 172.21.15.42:0/1405784467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d90145210 0x7f7d90070bc0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.236+0000 7f7d94e00640 1 -- 172.21.15.42:0/1405784467 >> 172.21.15.42:0/1405784467 conn(0x7f7d900746c0 msgr2=0x7f7d9006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:38.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.236+0000 7f7d94e00640 1 -- 172.21.15.42:0/1405784467 shutdown_connections 2024-09-17T01:43:38.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.236+0000 7f7d94e00640 1 -- 172.21.15.42:0/1405784467 wait complete. 2024-09-17T01:43:38.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.238+0000 7f7d94e00640 1 Processor -- start 2024-09-17T01:43:38.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.238+0000 7f7d94e00640 1 -- start start 2024-09-17T01:43:38.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.239+0000 7f7d94e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d900b5450 0x7f7d901f4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.239+0000 7f7d94e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d90145210 0x7f7d9013ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.239+0000 7f7d94e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d9015f390 0x7f7d900b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.239+0000 7f7d94e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7d900d0b40 con 0x7f7d90145210 2024-09-17T01:43:38.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.239+0000 7f7d94e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7d900b76f0 con 0x7f7d900b5450 2024-09-17T01:43:38.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.239+0000 7f7d94e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7d900d0cc0 con 0x7f7d9015f390 2024-09-17T01:43:38.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.240+0000 7f7d85400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d90145210 0x7f7d9013ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.240+0000 7f7d85400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d90145210 0x7f7d9013ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59224/0 (socket says 172.21.15.42:59224) 2024-09-17T01:43:38.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.240+0000 7f7d85400640 1 -- 172.21.15.42:0/2842968046 learned_addr learned my addr 172.21.15.42:0/2842968046 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:38.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.240+0000 7f7d8de00640 1 --2- 172.21.15.42:0/2842968046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d900b5450 0x7f7d901f4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.240+0000 7f7d8e800640 1 --2- 172.21.15.42:0/2842968046 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d9015f390 0x7f7d900b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.240+0000 7f7d85400640 1 -- 172.21.15.42:0/2842968046 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d9015f390 msgr2=0x7f7d900b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:38.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.240+0000 7f7d85400640 1 --2- 172.21.15.42:0/2842968046 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d9015f390 0x7f7d900b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.240+0000 7f7d85400640 1 -- 172.21.15.42:0/2842968046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d900b5450 msgr2=0x7f7d901f4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:38.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.240+0000 7f7d85400640 1 --2- 172.21.15.42:0/2842968046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d900b5450 0x7f7d901f4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.240+0000 7f7d85400640 1 -- 172.21.15.42:0/2842968046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d901f4990 con 0x7f7d90145210 2024-09-17T01:43:38.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.241+0000 7f7d85400640 1 --2- 172.21.15.42:0/2842968046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d90145210 0x7f7d9013ebd0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f7d7800e790 tx=0x7f7d7800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:38.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.241+0000 7f7d86a00640 1 -- 172.21.15.42:0/2842968046 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7800eea0 con 0x7f7d90145210 2024-09-17T01:43:38.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.241+0000 7f7d86a00640 1 -- 172.21.15.42:0/2842968046 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d7800cd50 con 0x7f7d90145210 2024-09-17T01:43:38.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.241+0000 7f7d94e00640 1 -- 172.21.15.42:0/2842968046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d900aa6a0 con 0x7f7d90145210 2024-09-17T01:43:38.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.241+0000 7f7d86a00640 1 -- 172.21.15.42:0/2842968046 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d78010690 con 0x7f7d90145210 2024-09-17T01:43:38.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.241+0000 7f7d94e00640 1 -- 172.21.15.42:0/2842968046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d900aa980 con 0x7f7d90145210 2024-09-17T01:43:38.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.243+0000 7f7d86a00640 1 -- 172.21.15.42:0/2842968046 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7d78010830 con 0x7f7d90145210 2024-09-17T01:43:38.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.244+0000 7f7d86a00640 1 --2- 172.21.15.42:0/2842968046 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7d6c078bc0 0x7f7d6c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.245+0000 7f7d86a00640 1 -- 172.21.15.42:0/2842968046 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f7d7809b6f0 con 0x7f7d90145210 2024-09-17T01:43:38.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.245+0000 7f7d8de00640 1 --2- 172.21.15.42:0/2842968046 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7d6c078bc0 0x7f7d6c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.245+0000 7f7d9c020740 1 Processor -- start 2024-09-17T01:43:38.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.245+0000 7f7d9c020740 1 -- start start 2024-09-17T01:43:38.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.246+0000 7f7d8de00640 1 --2- 172.21.15.42:0/2842968046 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7d6c078bc0 0x7f7d6c07b0d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7d80035000 tx=0x7f7d80038040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:38.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.247+0000 7f7d9c020740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf431390 0x564edf81f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.247+0000 7f7d9c020740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564edf4084d0 0x564edf802220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.247+0000 7f7d9c020740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564edf4106b0 0x564edf802760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.247+0000 7f7d9c020740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564edf7381c0 con 0x564edf431390 2024-09-17T01:43:38.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.247+0000 7f7d9c020740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564edf74b870 con 0x564edf4106b0 2024-09-17T01:43:38.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.247+0000 7f7d9c020740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x564edf73aca0 con 0x564edf4084d0 2024-09-17T01:43:38.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.247+0000 7f7d8de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf431390 0x564edf81f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.247+0000 7f7d8de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf431390 0x564edf81f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59228/0 (socket says 172.21.15.42:59228) 2024-09-17T01:43:38.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.247+0000 7f7d8de00640 1 -- 172.21.15.42:0/1137101892 learned_addr learned my addr 172.21.15.42:0/1137101892 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:38.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.248+0000 7f7d8e800640 1 --2- 172.21.15.42:0/1137101892 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564edf4106b0 0x564edf802760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.248+0000 7f7d85400640 1 --2- 172.21.15.42:0/1137101892 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564edf4084d0 0x564edf802220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.248+0000 7f7d8de00640 1 -- 172.21.15.42:0/1137101892 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564edf4084d0 msgr2=0x564edf802220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:38.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.248+0000 7f7d8de00640 1 --2- 172.21.15.42:0/1137101892 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564edf4084d0 0x564edf802220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.248+0000 7f7d8de00640 1 -- 172.21.15.42:0/1137101892 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564edf4106b0 msgr2=0x564edf802760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:38.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.248+0000 7f7d8de00640 1 --2- 172.21.15.42:0/1137101892 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564edf4106b0 0x564edf802760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.248+0000 7f7d8de00640 1 -- 172.21.15.42:0/1137101892 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564edf5137d0 con 0x564edf431390 2024-09-17T01:43:38.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.248+0000 7f7d8de00640 1 --2- 172.21.15.42:0/1137101892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf431390 0x564edf81f550 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f7d8002b0b0 tx=0x7f7d8002aac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10aefd875e51f26f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:38.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.248+0000 7f7d7ea00640 1 -- 172.21.15.42:0/1137101892 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d80003e40 con 0x564edf431390 2024-09-17T01:43:38.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.248+0000 7f7d7ea00640 1 -- 172.21.15.42:0/1137101892 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d80004040 con 0x564edf431390 2024-09-17T01:43:38.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.248+0000 7f7d7ea00640 1 -- 172.21.15.42:0/1137101892 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d80004430 con 0x564edf431390 2024-09-17T01:43:38.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.249+0000 7f7d9c020740 1 -- 172.21.15.42:0/1137101892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf431390 msgr2=0x564edf81f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.249+0000 7f7d9c020740 1 --2- 172.21.15.42:0/1137101892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf431390 0x564edf81f550 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f7d8002b0b0 tx=0x7f7d8002aac0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.249+0000 7f7d9c020740 1 -- 172.21.15.42:0/1137101892 shutdown_connections 2024-09-17T01:43:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.249+0000 7f7d9c020740 1 --2- 172.21.15.42:0/1137101892 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564edf4106b0 0x564edf802760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.249+0000 7f7d9c020740 1 --2- 172.21.15.42:0/1137101892 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564edf4084d0 0x564edf802220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.249+0000 7f7d9c020740 1 --2- 172.21.15.42:0/1137101892 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf431390 0x564edf81f550 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.249+0000 7f7d9c020740 1 -- 172.21.15.42:0/1137101892 >> 172.21.15.42:0/1137101892 conn(0x564edf4254e0 msgr2=0x564edf7d8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.249+0000 7f7d9c020740 1 -- 172.21.15.42:0/1137101892 shutdown_connections 2024-09-17T01:43:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.249+0000 7f7d9c020740 1 -- 172.21.15.42:0/1137101892 wait complete. 2024-09-17T01:43:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.250+0000 7f7d9c020740 1 -- start start 2024-09-17T01:43:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.250+0000 7f7d9c020740 1 Processor -- start 2024-09-17T01:43:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.252+0000 7f7d9c020740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf4084d0 0x564edf81c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.252+0000 7f7d9c020740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564edf4106b0 0x564edf8188e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.252+0000 7f7d9c020740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564edf431390 0x564edf819b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.252+0000 7f7d9c020740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564edf6e1410 con 0x564edf4084d0 2024-09-17T01:43:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.252+0000 7f7d9c020740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564edf73eab0 con 0x564edf4106b0 2024-09-17T01:43:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.252+0000 7f7d9c020740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x564edf4ab740 con 0x564edf431390 2024-09-17T01:43:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.252+0000 7f7d9c020740 10 client.0 _ll_register_callbacks cb 0x564edf6be360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:43:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.252+0000 7f7d8de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf4084d0 0x564edf81c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.252+0000 7f7d8de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf4084d0 0x564edf81c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59244/0 (socket says 172.21.15.42:59244) 2024-09-17T01:43:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.252+0000 7f7d8de00640 1 -- 172.21.15.42:0/2446331865 learned_addr learned my addr 172.21.15.42:0/2446331865 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.252+0000 7f7d8e800640 1 --2- 172.21.15.42:0/2446331865 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564edf431390 0x564edf819b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.252+0000 7f7d85400640 1 --2- 172.21.15.42:0/2446331865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564edf4106b0 0x564edf8188e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.253+0000 7f7d8de00640 1 -- 172.21.15.42:0/2446331865 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564edf431390 msgr2=0x564edf819b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.253+0000 7f7d8de00640 1 --2- 172.21.15.42:0/2446331865 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564edf431390 0x564edf819b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.253+0000 7f7d8de00640 1 -- 172.21.15.42:0/2446331865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564edf4106b0 msgr2=0x564edf8188e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.253+0000 7f7d8de00640 1 --2- 172.21.15.42:0/2446331865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564edf4106b0 0x564edf8188e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.253+0000 7f7d8de00640 1 -- 172.21.15.42:0/2446331865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564edf49c970 con 0x564edf4084d0 2024-09-17T01:43:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.253+0000 7f7d85400640 1 --2- 172.21.15.42:0/2446331865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564edf4106b0 0x564edf8188e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:43:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.253+0000 7f7d8de00640 1 --2- 172.21.15.42:0/2446331865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf4084d0 0x564edf81c040 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f7d8002cad0 tx=0x7f7d80004420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21730e6c8ba45679 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.253+0000 7f7d73400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:43:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.253+0000 7f7d73400640 1 -- 172.21.15.42:0/2446331865 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8005a060 con 0x564edf4084d0 2024-09-17T01:43:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.253+0000 7f7d73400640 1 -- 172.21.15.42:0/2446331865 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f7d80041480 con 0x564edf4084d0 2024-09-17T01:43:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.253+0000 7f7d9c020740 1 -- 172.21.15.42:0/2446331865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d80004040 con 0x564edf4084d0 2024-09-17T01:43:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.253+0000 7f7d73400640 1 -- 172.21.15.42:0/2446331865 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) ==== 24+0+0 (secure 0 0 0) 0x7f7d80060050 con 0x564edf4084d0 2024-09-17T01:43:38.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.253+0000 7f7d9c020740 10 client.9279 fetch_fsmap learned FSMap version 116 2024-09-17T01:43:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.253+0000 7f7d9c020740 1 -- 172.21.15.42:0/2446331865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) -- 0x564edf47a6a0 con 0x564edf4084d0 2024-09-17T01:43:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.254+0000 7f7d73400640 1 -- 172.21.15.42:0/2446331865 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d80004040 con 0x564edf4084d0 2024-09-17T01:43:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.254+0000 7f7d73400640 1 -- 172.21.15.42:0/2446331865 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 116) ==== 3502+0+0 (secure 0 0 0) 0x7f7d80063020 con 0x564edf4084d0 2024-09-17T01:43:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.254+0000 7f7d9c020740 10 client.9279 fetch_fsmap finished waiting for FSMap version 116 2024-09-17T01:43:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.254+0000 7f7d9c020740 10 client.9279 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-17T01:43:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.254+0000 7f7d9c020740 20 client.9279 populate_metadata read hostname 'smithi042' 2024-09-17T01:43:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.254+0000 7f7d9c020740 1 --2- 172.21.15.42:0/2446331865 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x564edf3eff60 0x564edf82be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.254+0000 7f7d9c020740 4 client.9279 mds_command: new command op to 8982 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:43:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.254+0000 7f7d9c020740 1 -- 172.21.15.42:0/2446331865 --> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564edf74d7c0 con 0x564edf3eff60 2024-09-17T01:43:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.254+0000 7f7d85400640 1 --2- 172.21.15.42:0/2446331865 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x564edf3eff60 0x564edf82be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.255+0000 7f7d85400640 1 --2- 172.21.15.42:0/2446331865 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x564edf3eff60 0x564edf82be40 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0bd55e7f9b45623 server_cookie=7ae6dfd1ab46ef04 in_seq=0 out_seq=0 2024-09-17T01:43:38.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.255+0000 7f7d73400640 10 client.9279 ms_handle_connect on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.255+0000 7f7d73400640 1 -- 172.21.15.42:0/2446331865 <== mds.0 v2:172.21.15.42:6832/3811049376 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564edf74d7c0 con 0x564edf3eff60 2024-09-17T01:43:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.255+0000 7f7d73400640 10 client.9279 handle_command_reply: tid=0 2024-09-17T01:43:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.255+0000 7f7d9c020740 1 client.9279 shutdown 2024-09-17T01:43:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.256+0000 7f7d9c020740 1 -- 172.21.15.42:0/2446331865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf4084d0 msgr2=0x564edf81c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.256+0000 7f7d9c020740 1 --2- 172.21.15.42:0/2446331865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf4084d0 0x564edf81c040 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f7d8002cad0 tx=0x7f7d80004420 comp rx=0 tx=0).stop 2024-09-17T01:43:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.256+0000 7f7d9c020740 1 -- 172.21.15.42:0/2446331865 shutdown_connections 2024-09-17T01:43:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.256+0000 7f7d9c020740 1 --2- 172.21.15.42:0/2446331865 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x564edf3eff60 0x564edf82be40 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.256+0000 7f7d9c020740 1 --2- 172.21.15.42:0/2446331865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564edf4106b0 0x564edf8188e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.256+0000 7f7d9c020740 1 --2- 172.21.15.42:0/2446331865 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564edf431390 0x564edf819b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.256+0000 7f7d9c020740 1 --2- 172.21.15.42:0/2446331865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf4084d0 0x564edf81c040 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.256+0000 7f7d73400640 0 client.9279 ms_handle_reset on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.256+0000 7f7d9c020740 1 -- 172.21.15.42:0/2446331865 >> 172.21.15.42:0/2446331865 conn(0x564edf4254e0 msgr2=0x564edf7f19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:38.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.256+0000 7f7d9c020740 1 -- 172.21.15.42:0/2446331865 shutdown_connections 2024-09-17T01:43:38.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.256+0000 7f7d9c020740 1 -- 172.21.15.42:0/2446331865 wait complete. 2024-09-17T01:43:38.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.256+0000 7f7d9c020740 20 client.9279 trim_cache size 0 max 16384 2024-09-17T01:43:38.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.274+0000 7f7d9c020740 1 Processor -- start 2024-09-17T01:43:38.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.275+0000 7f7d9c020740 1 -- start start 2024-09-17T01:43:38.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.276+0000 7f7d9c020740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564edf4084d0 0x564edf7f9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.276+0000 7f7d9c020740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf4106b0 0x564edf816ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.276+0000 7f7d9c020740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564edf431390 0x564edf81c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.276+0000 7f7d9c020740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7d902000c0 con 0x564edf4106b0 2024-09-17T01:43:38.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.276+0000 7f7d9c020740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7d901f5a60 con 0x564edf431390 2024-09-17T01:43:38.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.276+0000 7f7d9c020740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7d901f4dc0 con 0x564edf4084d0 2024-09-17T01:43:38.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.276+0000 7f7d85400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf4106b0 0x564edf816ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.276+0000 7f7d85400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf4106b0 0x564edf816ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59250/0 (socket says 172.21.15.42:59250) 2024-09-17T01:43:38.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.276+0000 7f7d85400640 1 -- 172.21.15.42:0/1632225600 learned_addr learned my addr 172.21.15.42:0/1632225600 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:38.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.276+0000 7f7d8de00640 1 --2- 172.21.15.42:0/1632225600 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564edf4084d0 0x564edf7f9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.276+0000 7f7d8e800640 1 --2- 172.21.15.42:0/1632225600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564edf431390 0x564edf81c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.277+0000 7f7d85400640 1 -- 172.21.15.42:0/1632225600 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564edf4084d0 msgr2=0x564edf7f9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:38.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.277+0000 7f7d85400640 1 --2- 172.21.15.42:0/1632225600 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564edf4084d0 0x564edf7f9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.277+0000 7f7d85400640 1 -- 172.21.15.42:0/1632225600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564edf431390 msgr2=0x564edf81c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:38.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.277+0000 7f7d85400640 1 --2- 172.21.15.42:0/1632225600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564edf431390 0x564edf81c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.277+0000 7f7d85400640 1 -- 172.21.15.42:0/1632225600 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564edf8198d0 con 0x564edf4106b0 2024-09-17T01:43:38.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.277+0000 7f7d85400640 1 --2- 172.21.15.42:0/1632225600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf4106b0 0x564edf816ac0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f7d780631d0 tx=0x7f7d78009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815eafaed947642f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:38.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.277+0000 7f7d7e000640 1 -- 172.21.15.42:0/1632225600 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7806cdb0 con 0x564edf4106b0 2024-09-17T01:43:38.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.277+0000 7f7d7e000640 1 -- 172.21.15.42:0/1632225600 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d7805f830 con 0x564edf4106b0 2024-09-17T01:43:38.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.277+0000 7f7d7e000640 1 -- 172.21.15.42:0/1632225600 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d78085df0 con 0x564edf4106b0 2024-09-17T01:43:38.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.278+0000 7f7d9c020740 1 -- 172.21.15.42:0/1632225600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf4106b0 msgr2=0x564edf816ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:38.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.278+0000 7f7d9c020740 1 --2- 172.21.15.42:0/1632225600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf4106b0 0x564edf816ac0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f7d780631d0 tx=0x7f7d78009600 comp rx=0 tx=0).stop 2024-09-17T01:43:38.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.278+0000 7f7d9c020740 1 -- 172.21.15.42:0/1632225600 shutdown_connections 2024-09-17T01:43:38.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.278+0000 7f7d9c020740 1 --2- 172.21.15.42:0/1632225600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564edf431390 0x564edf81c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.278+0000 7f7d9c020740 1 --2- 172.21.15.42:0/1632225600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf4106b0 0x564edf816ac0 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.278+0000 7f7d9c020740 1 --2- 172.21.15.42:0/1632225600 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564edf4084d0 0x564edf7f9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.278+0000 7f7d9c020740 1 -- 172.21.15.42:0/1632225600 >> 172.21.15.42:0/1632225600 conn(0x564edf4254e0 msgr2=0x564edf82ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:38.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.278+0000 7f7d9c020740 1 -- 172.21.15.42:0/1632225600 shutdown_connections 2024-09-17T01:43:38.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.278+0000 7f7d9c020740 1 -- 172.21.15.42:0/1632225600 wait complete. 2024-09-17T01:43:38.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.279+0000 7f7d9c020740 1 -- start start 2024-09-17T01:43:38.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.279+0000 7f7d9c020740 1 Processor -- start 2024-09-17T01:43:38.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.281+0000 7f7d9c020740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564edf4084d0 0x564edf89fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.281+0000 7f7d9c020740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564edf4106b0 0x564edf892460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.281+0000 7f7d9c020740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf431390 0x564edf8022b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.281+0000 7f7d9c020740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7d901f5410 con 0x564edf431390 2024-09-17T01:43:38.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.281+0000 7f7d9c020740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564edf7ff160 con 0x564edf4084d0 2024-09-17T01:43:38.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.281+0000 7f7d9c020740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x564edf840850 con 0x564edf4106b0 2024-09-17T01:43:38.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.281+0000 7f7d9c020740 10 client.0 _ll_register_callbacks cb 0x7f7d8002c910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:43:38.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.281+0000 7f7d8e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf431390 0x564edf8022b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.281+0000 7f7d8e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf431390 0x564edf8022b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59266/0 (socket says 172.21.15.42:59266) 2024-09-17T01:43:38.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.281+0000 7f7d8e800640 1 -- 172.21.15.42:0/249463431 learned_addr learned my addr 172.21.15.42:0/249463431 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:38.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.281+0000 7f7d85400640 1 --2- 172.21.15.42:0/249463431 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564edf4106b0 0x564edf892460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.281+0000 7f7d8de00640 1 --2- 172.21.15.42:0/249463431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564edf4084d0 0x564edf89fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.281+0000 7f7d8e800640 1 -- 172.21.15.42:0/249463431 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564edf4106b0 msgr2=0x564edf892460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:38.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.281+0000 7f7d8e800640 1 --2- 172.21.15.42:0/249463431 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564edf4106b0 0x564edf892460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.281+0000 7f7d8e800640 1 -- 172.21.15.42:0/249463431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564edf4084d0 msgr2=0x564edf89fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:38.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.281+0000 7f7d8e800640 1 --2- 172.21.15.42:0/249463431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564edf4084d0 0x564edf89fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.281+0000 7f7d8e800640 1 -- 172.21.15.42:0/249463431 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564edf89ba70 con 0x564edf431390 2024-09-17T01:43:38.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.282+0000 7f7d8e800640 1 --2- 172.21.15.42:0/249463431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf431390 0x564edf8022b0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f7d88000f60 tx=0x7f7d880178c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2694f7b161cfd709 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:38.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.282+0000 7f7d73400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:43:38.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.282+0000 7f7d73400640 1 -- 172.21.15.42:0/249463431 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d88007020 con 0x564edf431390 2024-09-17T01:43:38.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.282+0000 7f7d73400640 1 -- 172.21.15.42:0/249463431 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f7d88020aa0 con 0x564edf431390 2024-09-17T01:43:38.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.282+0000 7f7d9c020740 1 -- 172.21.15.42:0/249463431 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d7805f830 con 0x564edf431390 2024-09-17T01:43:38.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.282+0000 7f7d73400640 1 -- 172.21.15.42:0/249463431 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) ==== 24+0+0 (secure 0 0 0) 0x7f7d88020ce0 con 0x564edf431390 2024-09-17T01:43:38.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.282+0000 7f7d9c020740 10 client.9285 fetch_fsmap learned FSMap version 116 2024-09-17T01:43:38.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.282+0000 7f7d9c020740 1 -- 172.21.15.42:0/249463431 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) -- 0x564edf8028b0 con 0x564edf431390 2024-09-17T01:43:38.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.282+0000 7f7d73400640 1 -- 172.21.15.42:0/249463431 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d7805f830 con 0x564edf431390 2024-09-17T01:43:38.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.282+0000 7f7d73400640 1 -- 172.21.15.42:0/249463431 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 116) ==== 3502+0+0 (secure 0 0 0) 0x7f7d8801e030 con 0x564edf431390 2024-09-17T01:43:38.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.283+0000 7f7d9c020740 10 client.9285 fetch_fsmap finished waiting for FSMap version 116 2024-09-17T01:43:38.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.283+0000 7f7d9c020740 10 client.9285 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-17T01:43:38.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.283+0000 7f7d9c020740 20 client.9285 populate_metadata read hostname 'smithi042' 2024-09-17T01:43:38.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.283+0000 7f7d9c020740 1 --2- 172.21.15.42:0/249463431 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x564edf7d6160 0x564edf7d6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.283+0000 7f7d9c020740 4 client.9285 mds_command: new command op to 8982 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-17T01:43:38.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.283+0000 7f7d9c020740 1 -- 172.21.15.42:0/249463431 --> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x564edf749270 con 0x564edf7d6160 2024-09-17T01:43:38.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.283+0000 7f7d8de00640 1 --2- 172.21.15.42:0/249463431 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x564edf7d6160 0x564edf7d6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.283+0000 7f7d8de00640 1 --2- 172.21.15.42:0/249463431 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x564edf7d6160 0x564edf7d6570 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbff3eff35086682 server_cookie=be6574e17425fe2c in_seq=0 out_seq=0 2024-09-17T01:43:38.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.283+0000 7f7d73400640 10 client.9285 ms_handle_connect on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:38.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.284+0000 7f7d73400640 1 -- 172.21.15.42:0/249463431 <== mds.0 v2:172.21.15.42:6832/3811049376 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x564edf749270 con 0x564edf7d6160 2024-09-17T01:43:38.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.284+0000 7f7d73400640 10 client.9285 handle_command_reply: tid=0 2024-09-17T01:43:38.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.284+0000 7f7d9c020740 1 client.9285 shutdown 2024-09-17T01:43:38.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.284+0000 7f7d9c020740 1 -- 172.21.15.42:0/249463431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf431390 msgr2=0x564edf8022b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:38.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.284+0000 7f7d9c020740 1 --2- 172.21.15.42:0/249463431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf431390 0x564edf8022b0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f7d88000f60 tx=0x7f7d880178c0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.284+0000 7f7d9c020740 1 -- 172.21.15.42:0/249463431 shutdown_connections 2024-09-17T01:43:38.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.284+0000 7f7d9c020740 1 --2- 172.21.15.42:0/249463431 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x564edf7d6160 0x564edf7d6570 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.284+0000 7f7d9c020740 1 --2- 172.21.15.42:0/249463431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564edf431390 0x564edf8022b0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.284+0000 7f7d9c020740 1 --2- 172.21.15.42:0/249463431 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564edf4106b0 0x564edf892460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.284+0000 7f7d9c020740 1 --2- 172.21.15.42:0/249463431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564edf4084d0 0x564edf89fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.284+0000 7f7d9c020740 1 -- 172.21.15.42:0/249463431 >> 172.21.15.42:0/249463431 conn(0x564edf4254e0 msgr2=0x564edf7f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:38.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.284+0000 7f7d73400640 0 client.9285 ms_handle_reset on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:38.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.284+0000 7f7d9c020740 1 -- 172.21.15.42:0/249463431 shutdown_connections 2024-09-17T01:43:38.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.284+0000 7f7d9c020740 1 -- 172.21.15.42:0/249463431 wait complete. 2024-09-17T01:43:38.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.284+0000 7f7d9c020740 20 client.9285 trim_cache size 0 max 16384 2024-09-17T01:43:38.289 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:43:38.290 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0 2024-09-17T01:43:38.290 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:43:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.285+0000 7f7d94e00640 1 -- 172.21.15.42:0/2842968046 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7d6c078bc0 msgr2=0x7f7d6c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.285+0000 7f7d94e00640 1 --2- 172.21.15.42:0/2842968046 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7d6c078bc0 0x7f7d6c07b0d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7d80035000 tx=0x7f7d80038040 comp rx=0 tx=0).stop 2024-09-17T01:43:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.285+0000 7f7d94e00640 1 -- 172.21.15.42:0/2842968046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d90145210 msgr2=0x7f7d9013ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.285+0000 7f7d94e00640 1 --2- 172.21.15.42:0/2842968046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d90145210 0x7f7d9013ebd0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f7d7800e790 tx=0x7f7d7800ec50 comp rx=0 tx=0).stop 2024-09-17T01:43:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.285+0000 7f7d94e00640 1 -- 172.21.15.42:0/2842968046 shutdown_connections 2024-09-17T01:43:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.285+0000 7f7d94e00640 1 --2- 172.21.15.42:0/2842968046 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7d6c078bc0 0x7f7d6c07b0d0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.285+0000 7f7d94e00640 1 --2- 172.21.15.42:0/2842968046 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7d9015f390 0x7f7d900b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.285+0000 7f7d94e00640 1 --2- 172.21.15.42:0/2842968046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7d90145210 0x7f7d9013ebd0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.285+0000 7f7d94e00640 1 --2- 172.21.15.42:0/2842968046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d900b5450 0x7f7d901f4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.285+0000 7f7d94e00640 1 -- 172.21.15.42:0/2842968046 >> 172.21.15.42:0/2842968046 conn(0x7f7d900746c0 msgr2=0x7f7d9006f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:38.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.285+0000 7f7d94e00640 1 -- 172.21.15.42:0/2842968046 shutdown_connections 2024-09-17T01:43:38.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.285+0000 7f7d94e00640 1 -- 172.21.15.42:0/2842968046 wait complete. 2024-09-17T01:43:38.307 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T01:43:38.308 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-17T01:43:38.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.538+0000 7fc9dae00640 1 -- 172.21.15.42:0/1390466246 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9d406d430 msgr2=0x7fc9d406d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:38.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.538+0000 7fc9dae00640 1 --2- 172.21.15.42:0/1390466246 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9d406d430 0x7fc9d406d840 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40b3100 tx=0x7fc9cc02aac0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.538+0000 7fc9dae00640 1 -- 172.21.15.42:0/1390466246 shutdown_connections 2024-09-17T01:43:38.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.538+0000 7fc9dae00640 1 --2- 172.21.15.42:0/1390466246 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9d406d430 0x7fc9d406d840 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.538+0000 7fc9dae00640 1 --2- 172.21.15.42:0/1390466246 >> v2:172.21.15.43:3300/0 conn(0x7fc9d40b3880 0x7fc9d40af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.538+0000 7fc9dae00640 1 -- 172.21.15.42:0/1390466246 >> 172.21.15.42:0/1390466246 conn(0x7fc9d40b2930 msgr2=0x7fc9d406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:38.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.538+0000 7fc9dae00640 1 -- 172.21.15.42:0/1390466246 shutdown_connections 2024-09-17T01:43:38.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.539+0000 7fc9dae00640 1 -- 172.21.15.42:0/1390466246 wait complete. 2024-09-17T01:43:38.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.541+0000 7fc9dae00640 1 Processor -- start 2024-09-17T01:43:38.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.541+0000 7fc9dae00640 1 -- start start 2024-09-17T01:43:38.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.542+0000 7fc9dae00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9d406d430 0x7fc9d4148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.542+0000 7fc9dae00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9d40b3880 0x7fc9d4160a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.542+0000 7fc9dae00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9d415cfc0 0x7fc9d4160fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.542+0000 7fc9dae00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d4072950 con 0x7fc9d406d430 2024-09-17T01:43:38.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.542+0000 7fc9dae00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d415d5e0 con 0x7fc9d415cfc0 2024-09-17T01:43:38.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.542+0000 7fc9dae00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc9d4072ad0 con 0x7fc9d40b3880 2024-09-17T01:43:38.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.542+0000 7fc9d3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9d406d430 0x7fc9d4148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.543+0000 7fc9d3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9d406d430 0x7fc9d4148b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59274/0 (socket says 172.21.15.42:59274) 2024-09-17T01:43:38.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.543+0000 7fc9d3e00640 1 -- 172.21.15.42:0/3314281018 learned_addr learned my addr 172.21.15.42:0/3314281018 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:38.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.543+0000 7fc9cbe00640 1 --2- 172.21.15.42:0/3314281018 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9d40b3880 0x7fc9d4160a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.543+0000 7fc9d8e00640 1 --2- 172.21.15.42:0/3314281018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9d415cfc0 0x7fc9d4160fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.543+0000 7fc9d3e00640 1 -- 172.21.15.42:0/3314281018 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9d40b3880 msgr2=0x7fc9d4160a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:38.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.543+0000 7fc9d3e00640 1 --2- 172.21.15.42:0/3314281018 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9d40b3880 0x7fc9d4160a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.543+0000 7fc9d3e00640 1 -- 172.21.15.42:0/3314281018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9d415cfc0 msgr2=0x7fc9d4160fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:38.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.543+0000 7fc9d3e00640 1 --2- 172.21.15.42:0/3314281018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9d415cfc0 0x7fc9d4160fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.543+0000 7fc9d3e00640 1 -- 172.21.15.42:0/3314281018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d41f90b0 con 0x7fc9d406d430 2024-09-17T01:43:38.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.544+0000 7fc9d3e00640 1 --2- 172.21.15.42:0/3314281018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9d406d430 0x7fc9d4148b30 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fc9c400e790 tx=0x7fc9c400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:38.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.544+0000 7fc9d0c00640 1 -- 172.21.15.42:0/3314281018 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c400eea0 con 0x7fc9d406d430 2024-09-17T01:43:38.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.544+0000 7fc9d0c00640 1 -- 172.21.15.42:0/3314281018 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9c400cdb0 con 0x7fc9d406d430 2024-09-17T01:43:38.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.544+0000 7fc9d0c00640 1 -- 172.21.15.42:0/3314281018 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4010690 con 0x7fc9d406d430 2024-09-17T01:43:38.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.544+0000 7fc9dae00640 1 -- 172.21.15.42:0/3314281018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9d41f9390 con 0x7fc9d406d430 2024-09-17T01:43:38.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.544+0000 7fc9dae00640 1 -- 172.21.15.42:0/3314281018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9d41f9950 con 0x7fc9d406d430 2024-09-17T01:43:38.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.547+0000 7fc9d0c00640 1 -- 172.21.15.42:0/3314281018 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc9c4010830 con 0x7fc9d406d430 2024-09-17T01:43:38.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.547+0000 7fc9d0c00640 1 --2- 172.21.15.42:0/3314281018 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc9b0078b90 0x7fc9b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.548+0000 7fc9d0c00640 1 -- 172.21.15.42:0/3314281018 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fc9c409b780 con 0x7fc9d406d430 2024-09-17T01:43:38.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.548+0000 7fc9e1ff4740 1 Processor -- start 2024-09-17T01:43:38.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.548+0000 7fc9cbe00640 1 --2- 172.21.15.42:0/3314281018 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc9b0078b90 0x7fc9b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.548+0000 7fc9e1ff4740 1 -- start start 2024-09-17T01:43:38.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.549+0000 7fc9cbe00640 1 --2- 172.21.15.42:0/3314281018 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc9b0078b90 0x7fc9b007b0a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40b1220 tx=0x7fc9bc009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:38.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.549+0000 7fc9e1ff4740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557acd6d3390 0x557acdac1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.549+0000 7fc9e1ff4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557acd6aa4d0 0x557acdaa4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.549+0000 7fc9e1ff4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6b26b0 0x557acdaa4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.549+0000 7fc9e1ff4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557acd9da1c0 con 0x557acd6b26b0 2024-09-17T01:43:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.549+0000 7fc9e1ff4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557acd9ed870 con 0x557acd6aa4d0 2024-09-17T01:43:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.549+0000 7fc9e1ff4740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x557acd9dcca0 con 0x557acd6d3390 2024-09-17T01:43:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.550+0000 7fc9d8e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6b26b0 0x557acdaa4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.550+0000 7fc9d8e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6b26b0 0x557acdaa4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59278/0 (socket says 172.21.15.42:59278) 2024-09-17T01:43:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.550+0000 7fc9d8e00640 1 -- 172.21.15.42:0/1795141760 learned_addr learned my addr 172.21.15.42:0/1795141760 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.550+0000 7fc9d3e00640 1 --2- 172.21.15.42:0/1795141760 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557acd6d3390 0x557acdac1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.550+0000 7fc9cbe00640 1 --2- 172.21.15.42:0/1795141760 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557acd6aa4d0 0x557acdaa4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.550+0000 7fc9d8e00640 1 -- 172.21.15.42:0/1795141760 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557acd6d3390 msgr2=0x557acdac1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.550+0000 7fc9d8e00640 1 --2- 172.21.15.42:0/1795141760 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557acd6d3390 0x557acdac1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.550+0000 7fc9d8e00640 1 -- 172.21.15.42:0/1795141760 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557acd6aa4d0 msgr2=0x557acdaa4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.550+0000 7fc9d8e00640 1 --2- 172.21.15.42:0/1795141760 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557acd6aa4d0 0x557acdaa4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.550+0000 7fc9d8e00640 1 -- 172.21.15.42:0/1795141760 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557acd7b57d0 con 0x557acd6b26b0 2024-09-17T01:43:38.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.550+0000 7fc9d8e00640 1 --2- 172.21.15.42:0/1795141760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6b26b0 0x557acdaa4760 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc009950 tx=0x7fc9cc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1be71f4b55fc146 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:38.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.551+0000 7fc9c8c00640 1 -- 172.21.15.42:0/1795141760 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc045070 con 0x557acd6b26b0 2024-09-17T01:43:38.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.551+0000 7fc9c8c00640 1 -- 172.21.15.42:0/1795141760 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9cc02cab0 con 0x557acd6b26b0 2024-09-17T01:43:38.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.551+0000 7fc9c8c00640 1 -- 172.21.15.42:0/1795141760 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc02cec0 con 0x557acd6b26b0 2024-09-17T01:43:38.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.551+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/1795141760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6b26b0 msgr2=0x557acdaa4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:38.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.551+0000 7fc9e1ff4740 1 --2- 172.21.15.42:0/1795141760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6b26b0 0x557acdaa4760 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc009950 tx=0x7fc9cc004ab0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.552+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/1795141760 shutdown_connections 2024-09-17T01:43:38.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.552+0000 7fc9e1ff4740 1 --2- 172.21.15.42:0/1795141760 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557acd6aa4d0 0x557acdaa4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.552+0000 7fc9e1ff4740 1 --2- 172.21.15.42:0/1795141760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6b26b0 0x557acdaa4760 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.552+0000 7fc9e1ff4740 1 --2- 172.21.15.42:0/1795141760 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557acd6d3390 0x557acdac1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.552+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/1795141760 >> 172.21.15.42:0/1795141760 conn(0x557acd6c74e0 msgr2=0x557acda7a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:38.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.552+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/1795141760 shutdown_connections 2024-09-17T01:43:38.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.552+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/1795141760 wait complete. 2024-09-17T01:43:38.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.553+0000 7fc9e1ff4740 1 -- start start 2024-09-17T01:43:38.555 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.553+0000 7fc9e1ff4740 1 Processor -- start 2024-09-17T01:43:38.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.555+0000 7fc9e1ff4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557acd6aa4d0 0x557acdacdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.555+0000 7fc9e1ff4740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557acd6b26b0 0x557acdabc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.555+0000 7fc9e1ff4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6d3390 0x557acda929b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.555+0000 7fc9e1ff4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557acd983410 con 0x557acd6d3390 2024-09-17T01:43:38.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.555+0000 7fc9e1ff4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557acd9e0ab0 con 0x557acd6aa4d0 2024-09-17T01:43:38.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.555+0000 7fc9e1ff4740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x557acd74d740 con 0x557acd6b26b0 2024-09-17T01:43:38.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.555+0000 7fc9e1ff4740 10 client.0 _ll_register_callbacks cb 0x557acd960360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:43:38.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.555+0000 7fc9d8e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6d3390 0x557acda929b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.555+0000 7fc9d8e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6d3390 0x557acda929b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59284/0 (socket says 172.21.15.42:59284) 2024-09-17T01:43:38.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.555+0000 7fc9d8e00640 1 -- 172.21.15.42:0/2959188859 learned_addr learned my addr 172.21.15.42:0/2959188859 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:38.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.555+0000 7fc9d3e00640 1 --2- 172.21.15.42:0/2959188859 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557acd6aa4d0 0x557acdacdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.555+0000 7fc9cbe00640 1 --2- 172.21.15.42:0/2959188859 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557acd6b26b0 0x557acdabc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.555+0000 7fc9d8e00640 1 -- 172.21.15.42:0/2959188859 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557acd6b26b0 msgr2=0x557acdabc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:38.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.555+0000 7fc9d8e00640 1 --2- 172.21.15.42:0/2959188859 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557acd6b26b0 0x557acdabc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.555+0000 7fc9d8e00640 1 -- 172.21.15.42:0/2959188859 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557acd6aa4d0 msgr2=0x557acdacdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:38.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.555+0000 7fc9d8e00640 1 --2- 172.21.15.42:0/2959188859 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557acd6aa4d0 0x557acdacdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.555+0000 7fc9d8e00640 1 -- 172.21.15.42:0/2959188859 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557acd73e970 con 0x557acd6d3390 2024-09-17T01:43:38.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.556+0000 7fc9d8e00640 1 --2- 172.21.15.42:0/2959188859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6d3390 0x557acda929b0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc02b0b0 tx=0x7fc9cc02c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c713f96ec46d0222 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:38.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.556+0000 7fc9c1600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:43:38.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.556+0000 7fc9c1600640 1 -- 172.21.15.42:0/2959188859 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc045040 con 0x557acd6d3390 2024-09-17T01:43:38.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.556+0000 7fc9c1600640 1 -- 172.21.15.42:0/2959188859 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fc9cc003b70 con 0x557acd6d3390 2024-09-17T01:43:38.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.556+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/2959188859 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9cc02cab0 con 0x557acd6d3390 2024-09-17T01:43:38.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.556+0000 7fc9c1600640 1 -- 172.21.15.42:0/2959188859 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) ==== 24+0+0 (secure 0 0 0) 0x7fc9cc057050 con 0x557acd6d3390 2024-09-17T01:43:38.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.556+0000 7fc9e1ff4740 10 client.9297 fetch_fsmap learned FSMap version 116 2024-09-17T01:43:38.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.556+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/2959188859 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) -- 0x557acd71c6a0 con 0x557acd6d3390 2024-09-17T01:43:38.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.557+0000 7fc9c1600640 1 -- 172.21.15.42:0/2959188859 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9cc02cab0 con 0x557acd6d3390 2024-09-17T01:43:38.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.557+0000 7fc9c1600640 1 -- 172.21.15.42:0/2959188859 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 116) ==== 3502+0+0 (secure 0 0 0) 0x7fc9cc05a020 con 0x557acd6d3390 2024-09-17T01:43:38.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.557+0000 7fc9e1ff4740 10 client.9297 fetch_fsmap finished waiting for FSMap version 116 2024-09-17T01:43:38.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.557+0000 7fc9e1ff4740 10 client.9297 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-17T01:43:38.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.557+0000 7fc9e1ff4740 20 client.9297 populate_metadata read hostname 'smithi042' 2024-09-17T01:43:38.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.557+0000 7fc9e1ff4740 1 --2- 172.21.15.42:0/2959188859 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x557acd691f60 0x557acda79f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.557+0000 7fc9e1ff4740 4 client.9297 mds_command: new command op to 8982 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:43:38.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.557+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/2959188859 --> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557acd9ef7c0 con 0x557acd691f60 2024-09-17T01:43:38.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.557+0000 7fc9d3e00640 1 --2- 172.21.15.42:0/2959188859 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x557acd691f60 0x557acda79f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.558+0000 7fc9c1600640 10 client.9297 ms_handle_connect on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:38.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.558+0000 7fc9d3e00640 1 --2- 172.21.15.42:0/2959188859 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x557acd691f60 0x557acda79f60 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ef890d6c5f896a1 server_cookie=be7616597b9512ed in_seq=0 out_seq=0 2024-09-17T01:43:38.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.558+0000 7fc9c1600640 1 -- 172.21.15.42:0/2959188859 <== mds.0 v2:172.21.15.42:6832/3811049376 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557acd9ef7c0 con 0x557acd691f60 2024-09-17T01:43:38.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.558+0000 7fc9c1600640 10 client.9297 handle_command_reply: tid=0 2024-09-17T01:43:38.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.558+0000 7fc9e1ff4740 1 client.9297 shutdown 2024-09-17T01:43:38.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.559+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/2959188859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6d3390 msgr2=0x557acda929b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:38.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.559+0000 7fc9e1ff4740 1 --2- 172.21.15.42:0/2959188859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6d3390 0x557acda929b0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc02b0b0 tx=0x7fc9cc02c780 comp rx=0 tx=0).stop 2024-09-17T01:43:38.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.559+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/2959188859 shutdown_connections 2024-09-17T01:43:38.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.559+0000 7fc9e1ff4740 1 --2- 172.21.15.42:0/2959188859 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x557acd691f60 0x557acda79f60 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.559+0000 7fc9e1ff4740 1 --2- 172.21.15.42:0/2959188859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6d3390 0x557acda929b0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.559+0000 7fc9e1ff4740 1 --2- 172.21.15.42:0/2959188859 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557acd6b26b0 0x557acdabc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.559+0000 7fc9e1ff4740 1 --2- 172.21.15.42:0/2959188859 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557acd6aa4d0 0x557acdacdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.559+0000 7fc9c1600640 0 client.9297 ms_handle_reset on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:38.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.559+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/2959188859 >> 172.21.15.42:0/2959188859 conn(0x557acd6c74e0 msgr2=0x557acdaa1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:38.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.559+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/2959188859 shutdown_connections 2024-09-17T01:43:38.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.559+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/2959188859 wait complete. 2024-09-17T01:43:38.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.559+0000 7fc9e1ff4740 20 client.9297 trim_cache size 0 max 16384 2024-09-17T01:43:38.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.578+0000 7fc9e1ff4740 1 Processor -- start 2024-09-17T01:43:38.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.578+0000 7fc9e1ff4740 1 -- start start 2024-09-17T01:43:38.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.579+0000 7fc9e1ff4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6aa4d0 0x557acdabe320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.579+0000 7fc9e1ff4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557acd6b26b0 0x557acda7b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.579+0000 7fc9e1ff4740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557acd6d3390 0x557acdae1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.579+0000 7fc9e1ff4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d42020d0 con 0x557acd6aa4d0 2024-09-17T01:43:38.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.579+0000 7fc9e1ff4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d42011f0 con 0x557acd6b26b0 2024-09-17T01:43:38.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.579+0000 7fc9e1ff4740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc9d4070090 con 0x557acd6d3390 2024-09-17T01:43:38.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.580+0000 7fc9d3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6aa4d0 0x557acdabe320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.580+0000 7fc9d3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6aa4d0 0x557acdabe320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59290/0 (socket says 172.21.15.42:59290) 2024-09-17T01:43:38.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.580+0000 7fc9d3e00640 1 -- 172.21.15.42:0/1317057536 learned_addr learned my addr 172.21.15.42:0/1317057536 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:38.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.580+0000 7fc9cbe00640 1 --2- 172.21.15.42:0/1317057536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557acd6b26b0 0x557acda7b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.580+0000 7fc9d8e00640 1 --2- 172.21.15.42:0/1317057536 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557acd6d3390 0x557acdae1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.580+0000 7fc9d3e00640 1 -- 172.21.15.42:0/1317057536 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557acd6d3390 msgr2=0x557acdae1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:38.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.580+0000 7fc9d3e00640 1 --2- 172.21.15.42:0/1317057536 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557acd6d3390 0x557acdae1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.580+0000 7fc9d3e00640 1 -- 172.21.15.42:0/1317057536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557acd6b26b0 msgr2=0x557acda7b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:38.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.580+0000 7fc9d3e00640 1 --2- 172.21.15.42:0/1317057536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557acd6b26b0 0x557acda7b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.580+0000 7fc9d3e00640 1 -- 172.21.15.42:0/1317057536 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557acda76fa0 con 0x557acd6aa4d0 2024-09-17T01:43:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.580+0000 7fc9d8e00640 1 --2- 172.21.15.42:0/1317057536 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557acd6d3390 0x557acdae1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:43:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.580+0000 7fc9cbe00640 1 --2- 172.21.15.42:0/1317057536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557acd6b26b0 0x557acda7b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:43:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.580+0000 7fc9d3e00640 1 --2- 172.21.15.42:0/1317057536 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6aa4d0 0x557acdabe320 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4009fd0 tx=0x7fc9c4085040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d25bf851e22e3a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.580+0000 7fc9c3e00640 1 -- 172.21.15.42:0/1317057536 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c406ce40 con 0x557acd6aa4d0 2024-09-17T01:43:38.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.580+0000 7fc9c3e00640 1 -- 172.21.15.42:0/1317057536 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9c405f830 con 0x557acd6aa4d0 2024-09-17T01:43:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.580+0000 7fc9c3e00640 1 -- 172.21.15.42:0/1317057536 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4062930 con 0x557acd6aa4d0 2024-09-17T01:43:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.581+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/1317057536 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6aa4d0 msgr2=0x557acdabe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.581+0000 7fc9e1ff4740 1 --2- 172.21.15.42:0/1317057536 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6aa4d0 0x557acdabe320 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4009fd0 tx=0x7fc9c4085040 comp rx=0 tx=0).stop 2024-09-17T01:43:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.581+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/1317057536 shutdown_connections 2024-09-17T01:43:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.581+0000 7fc9e1ff4740 1 --2- 172.21.15.42:0/1317057536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557acd6b26b0 0x557acda7b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.581+0000 7fc9e1ff4740 1 --2- 172.21.15.42:0/1317057536 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557acd6d3390 0x557acdae1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.581+0000 7fc9e1ff4740 1 --2- 172.21.15.42:0/1317057536 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6aa4d0 0x557acdabe320 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.581+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/1317057536 >> 172.21.15.42:0/1317057536 conn(0x557acd6c74e0 msgr2=0x557acdaa4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:38.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.581+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/1317057536 shutdown_connections 2024-09-17T01:43:38.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.581+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/1317057536 wait complete. 2024-09-17T01:43:38.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.582+0000 7fc9e1ff4740 1 -- start start 2024-09-17T01:43:38.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.582+0000 7fc9e1ff4740 1 Processor -- start 2024-09-17T01:43:38.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.584+0000 7fc9e1ff4740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557acd6aa4d0 0x557acda78ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.584+0000 7fc9e1ff4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6b26b0 0x557acdb37360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.584+0000 7fc9e1ff4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557acd6d3390 0x557acda73830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.584+0000 7fc9e1ff4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d4154f90 con 0x557acd6b26b0 2024-09-17T01:43:38.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.584+0000 7fc9e1ff4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557acda943f0 con 0x557acd6d3390 2024-09-17T01:43:38.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.584+0000 7fc9e1ff4740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x557acdacd740 con 0x557acd6aa4d0 2024-09-17T01:43:38.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.584+0000 7fc9e1ff4740 10 client.0 _ll_register_callbacks cb 0x7fc9cc043070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:43:38.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.584+0000 7fc9cbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6b26b0 0x557acdb37360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.584+0000 7fc9cbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6b26b0 0x557acdb37360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59296/0 (socket says 172.21.15.42:59296) 2024-09-17T01:43:38.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.584+0000 7fc9cbe00640 1 -- 172.21.15.42:0/82095453 learned_addr learned my addr 172.21.15.42:0/82095453 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:38.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.584+0000 7fc9d8e00640 1 --2- 172.21.15.42:0/82095453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557acd6d3390 0x557acda73830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.584+0000 7fc9d3e00640 1 --2- 172.21.15.42:0/82095453 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557acd6aa4d0 0x557acda78ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.585+0000 7fc9cbe00640 1 -- 172.21.15.42:0/82095453 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557acd6aa4d0 msgr2=0x557acda78ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:38.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.585+0000 7fc9cbe00640 1 --2- 172.21.15.42:0/82095453 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557acd6aa4d0 0x557acda78ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.585+0000 7fc9cbe00640 1 -- 172.21.15.42:0/82095453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557acd6d3390 msgr2=0x557acda73830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:43:38.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.585+0000 7fc9cbe00640 1 --2- 172.21.15.42:0/82095453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557acd6d3390 0x557acda73830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.585+0000 7fc9cbe00640 1 -- 172.21.15.42:0/82095453 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557acdae12e0 con 0x557acd6b26b0 2024-09-17T01:43:38.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.585+0000 7fc9d8e00640 1 --2- 172.21.15.42:0/82095453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557acd6d3390 0x557acda73830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:43:38.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.585+0000 7fc9cbe00640 1 --2- 172.21.15.42:0/82095453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6b26b0 0x557acdb37360 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4151690 tx=0x7fc9bc001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41173e6935a90eb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:38.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.585+0000 7fc9c1600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:43:38.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.585+0000 7fc9c1600640 1 -- 172.21.15.42:0/82095453 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc027070 con 0x557acd6b26b0 2024-09-17T01:43:38.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.585+0000 7fc9c1600640 1 -- 172.21.15.42:0/82095453 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fc9bc0236c0 con 0x557acd6b26b0 2024-09-17T01:43:38.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.585+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/82095453 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9c405f830 con 0x557acd6b26b0 2024-09-17T01:43:38.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.586+0000 7fc9c1600640 1 -- 172.21.15.42:0/82095453 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) ==== 24+0+0 (secure 0 0 0) 0x7fc9bc032050 con 0x557acd6b26b0 2024-09-17T01:43:38.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.586+0000 7fc9e1ff4740 10 client.9303 fetch_fsmap learned FSMap version 116 2024-09-17T01:43:38.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.586+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/82095453 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) -- 0x557acda94060 con 0x557acd6b26b0 2024-09-17T01:43:38.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.586+0000 7fc9c1600640 1 -- 172.21.15.42:0/82095453 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9c405f830 con 0x557acd6b26b0 2024-09-17T01:43:38.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.586+0000 7fc9c1600640 1 -- 172.21.15.42:0/82095453 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 116) ==== 3502+0+0 (secure 0 0 0) 0x7fc9bc035020 con 0x557acd6b26b0 2024-09-17T01:43:38.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.586+0000 7fc9e1ff4740 10 client.9303 fetch_fsmap finished waiting for FSMap version 116 2024-09-17T01:43:38.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.586+0000 7fc9e1ff4740 10 client.9303 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-17T01:43:38.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.586+0000 7fc9e1ff4740 20 client.9303 populate_metadata read hostname 'smithi042' 2024-09-17T01:43:38.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.586+0000 7fc9e1ff4740 1 --2- 172.21.15.42:0/82095453 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x557acda73d70 0x557acdb3db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.586+0000 7fc9e1ff4740 4 client.9303 mds_command: new command op to 8982 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:43:38.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.586+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/82095453 --> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557acd9eb270 con 0x557acda73d70 2024-09-17T01:43:38.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.586+0000 7fc9d3e00640 1 --2- 172.21.15.42:0/82095453 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x557acda73d70 0x557acdb3db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.587+0000 7fc9c1600640 10 client.9303 ms_handle_connect on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:38.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.587+0000 7fc9d3e00640 1 --2- 172.21.15.42:0/82095453 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x557acda73d70 0x557acdb3db10 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9629b265be5a290f server_cookie=e5e02607264450f4 in_seq=0 out_seq=0 2024-09-17T01:43:38.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.587+0000 7fc9c1600640 1 -- 172.21.15.42:0/82095453 <== mds.0 v2:172.21.15.42:6832/3811049376 1 ==== command_reply(tid 0: 0 ) ==== 8+0+397 (crc 0 0 0) 0x557acd9eb270 con 0x557acda73d70 2024-09-17T01:43:38.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.587+0000 7fc9c1600640 10 client.9303 handle_command_reply: tid=0 2024-09-17T01:43:38.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.587+0000 7fc9e1ff4740 1 client.9303 shutdown 2024-09-17T01:43:38.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.587+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/82095453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6b26b0 msgr2=0x557acdb37360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:38.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.587+0000 7fc9e1ff4740 1 --2- 172.21.15.42:0/82095453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6b26b0 0x557acdb37360 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4151690 tx=0x7fc9bc001080 comp rx=0 tx=0).stop 2024-09-17T01:43:38.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.587+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/82095453 shutdown_connections 2024-09-17T01:43:38.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.587+0000 7fc9e1ff4740 1 --2- 172.21.15.42:0/82095453 >> [v2:172.21.15.42:6832/3811049376,v1:172.21.15.42:6834/3811049376] conn(0x557acda73d70 0x557acdb3db10 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.587+0000 7fc9e1ff4740 1 --2- 172.21.15.42:0/82095453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557acd6d3390 0x557acda73830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.587+0000 7fc9e1ff4740 1 --2- 172.21.15.42:0/82095453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557acd6b26b0 0x557acdb37360 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.587+0000 7fc9e1ff4740 1 --2- 172.21.15.42:0/82095453 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557acd6aa4d0 0x557acda78ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.587+0000 7fc9c1600640 0 client.9303 ms_handle_reset on v2:172.21.15.42:6832/3811049376 2024-09-17T01:43:38.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.587+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/82095453 >> 172.21.15.42:0/82095453 conn(0x557acd6c74e0 msgr2=0x557acdae1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:38.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.587+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/82095453 shutdown_connections 2024-09-17T01:43:38.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.587+0000 7fc9e1ff4740 1 -- 172.21.15.42:0/82095453 wait complete. 2024-09-17T01:43:38.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.588+0000 7fc9e1ff4740 20 client.9303 trim_cache size 0 max 16384 2024-09-17T01:43:38.599 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:43:38.599 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-09-17T01:43:38.599 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {}, 2024-09-17T01:43:38.599 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_stats": { 2024-09-17T01:43:38.599 INFO:teuthology.orchestra.run.smithi042.stdout: "b7cf205b-474d-4b2b-864d-637bc207bb9a": { 2024-09-17T01:43:38.599 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:43:28.483031+0000", 2024-09-17T01:43:38.599 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_control_test_path", 2024-09-17T01:43:38.599 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:43:38.599 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:43:38.599 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:43:38.600 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:43:38.600 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:43:38.600 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:43:38.600 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:43:38.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.588+0000 7fc9dae00640 1 -- 172.21.15.42:0/3314281018 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc9b0078b90 msgr2=0x7fc9b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:38.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.588+0000 7fc9dae00640 1 --2- 172.21.15.42:0/3314281018 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc9b0078b90 0x7fc9b007b0a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40b1220 tx=0x7fc9bc009040 comp rx=0 tx=0).stop 2024-09-17T01:43:38.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.588+0000 7fc9dae00640 1 -- 172.21.15.42:0/3314281018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9d406d430 msgr2=0x7fc9d4148b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:38.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.588+0000 7fc9dae00640 1 --2- 172.21.15.42:0/3314281018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9d406d430 0x7fc9d4148b30 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fc9c400e790 tx=0x7fc9c400ec50 comp rx=0 tx=0).stop 2024-09-17T01:43:38.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.588+0000 7fc9dae00640 1 -- 172.21.15.42:0/3314281018 shutdown_connections 2024-09-17T01:43:38.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.588+0000 7fc9dae00640 1 --2- 172.21.15.42:0/3314281018 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc9b0078b90 0x7fc9b007b0a0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.588+0000 7fc9dae00640 1 --2- 172.21.15.42:0/3314281018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9d415cfc0 0x7fc9d4160fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.588+0000 7fc9dae00640 1 --2- 172.21.15.42:0/3314281018 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc9d40b3880 0x7fc9d4160a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.588+0000 7fc9dae00640 1 --2- 172.21.15.42:0/3314281018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9d406d430 0x7fc9d4148b30 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.588+0000 7fc9dae00640 1 -- 172.21.15.42:0/3314281018 >> 172.21.15.42:0/3314281018 conn(0x7fc9d40b2930 msgr2=0x7fc9d40ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:38.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.588+0000 7fc9dae00640 1 -- 172.21.15.42:0/3314281018 shutdown_connections 2024-09-17T01:43:38.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.588+0000 7fc9dae00640 1 -- 172.21.15.42:0/3314281018 wait complete. 2024-09-17T01:43:38.608 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T01:43:38.608 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:43:38.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.837+0000 7f3ed0000640 1 -- 172.21.15.42:0/2639666440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ec80b5100 msgr2=0x7f3ec815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:38.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.837+0000 7f3ed0000640 1 --2- 172.21.15.42:0/2639666440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ec80b5100 0x7f3ec815d950 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc005fd0 tx=0x7f3ebc02a5d0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.837+0000 7f3ed0000640 1 -- 172.21.15.42:0/2639666440 shutdown_connections 2024-09-17T01:43:38.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.837+0000 7f3ed0000640 1 --2- 172.21.15.42:0/2639666440 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3ec80cef70 0x7f3ec8156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.838+0000 7f3ed0000640 1 --2- 172.21.15.42:0/2639666440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ec80b5100 0x7f3ec815d950 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.838+0000 7f3ed0000640 1 -- 172.21.15.42:0/2639666440 >> 172.21.15.42:0/2639666440 conn(0x7f3ec80b2930 msgr2=0x7f3ec806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:38.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.838+0000 7f3ed0000640 1 -- 172.21.15.42:0/2639666440 shutdown_connections 2024-09-17T01:43:38.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.838+0000 7f3ed0000640 1 -- 172.21.15.42:0/2639666440 wait complete. 2024-09-17T01:43:38.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.840+0000 7f3ed0000640 1 Processor -- start 2024-09-17T01:43:38.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.840+0000 7f3ed0000640 1 -- start start 2024-09-17T01:43:38.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.841+0000 7f3ed0000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ec806d430 0x7f3ec80c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.841+0000 7f3ed0000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3ec80b5100 0x7f3ec80b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.841+0000 7f3ed0000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ec80cef70 0x7f3ec81f8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.841+0000 7f3ed0000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec8072970 con 0x7f3ec80cef70 2024-09-17T01:43:38.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.841+0000 7f3ed0000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec80727f0 con 0x7f3ec806d430 2024-09-17T01:43:38.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.841+0000 7f3ed0000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3ec8072af0 con 0x7f3ec80b5100 2024-09-17T01:43:38.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.842+0000 7f3ece000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ec80cef70 0x7f3ec81f8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.842+0000 7f3ece000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ec80cef70 0x7f3ec81f8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59306/0 (socket says 172.21.15.42:59306) 2024-09-17T01:43:38.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.842+0000 7f3ece000640 1 -- 172.21.15.42:0/1290086125 learned_addr learned my addr 172.21.15.42:0/1290086125 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:38.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.842+0000 7f3eccc00640 1 --2- 172.21.15.42:0/1290086125 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3ec80b5100 0x7f3ec80b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.842+0000 7f3ecd600640 1 --2- 172.21.15.42:0/1290086125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ec806d430 0x7f3ec80c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.842+0000 7f3ece000640 1 -- 172.21.15.42:0/1290086125 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3ec80b5100 msgr2=0x7f3ec80b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:38.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.842+0000 7f3ece000640 1 --2- 172.21.15.42:0/1290086125 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3ec80b5100 0x7f3ec80b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.842+0000 7f3ece000640 1 -- 172.21.15.42:0/1290086125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ec806d430 msgr2=0x7f3ec80c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:38.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.842+0000 7f3ece000640 1 --2- 172.21.15.42:0/1290086125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ec806d430 0x7f3ec80c60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:38.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.842+0000 7f3ece000640 1 -- 172.21.15.42:0/1290086125 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec81f9c80 con 0x7f3ec80cef70 2024-09-17T01:43:38.843 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.842+0000 7f3ece000640 1 --2- 172.21.15.42:0/1290086125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ec80cef70 0x7f3ec81f8fc0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000c760 tx=0x7f3ec000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:38.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.843+0000 7f3ec5600640 1 -- 172.21.15.42:0/1290086125 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0017070 con 0x7f3ec80cef70 2024-09-17T01:43:38.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.843+0000 7f3ec5600640 1 -- 172.21.15.42:0/1290086125 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ec000ce10 con 0x7f3ec80cef70 2024-09-17T01:43:38.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.843+0000 7f3ed0000640 1 -- 172.21.15.42:0/1290086125 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec80c5610 con 0x7f3ec80cef70 2024-09-17T01:43:38.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.843+0000 7f3ec5600640 1 -- 172.21.15.42:0/1290086125 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec00052b0 con 0x7f3ec80cef70 2024-09-17T01:43:38.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.843+0000 7f3ed0000640 1 -- 172.21.15.42:0/1290086125 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec80c5bd0 con 0x7f3ec80cef70 2024-09-17T01:43:38.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.844+0000 7f3ed0000640 1 -- 172.21.15.42:0/1290086125 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec80c5430 con 0x7f3ec80cef70 2024-09-17T01:43:38.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.845+0000 7f3ec5600640 1 -- 172.21.15.42:0/1290086125 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3ec001a070 con 0x7f3ec80cef70 2024-09-17T01:43:38.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.846+0000 7f3ec5600640 1 --2- 172.21.15.42:0/1290086125 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3ea8078bc0 0x7f3ea807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:38.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.846+0000 7f3ec5600640 1 -- 172.21.15.42:0/1290086125 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f3ec009a390 con 0x7f3ec80cef70 2024-09-17T01:43:38.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.847+0000 7f3ecd600640 1 --2- 172.21.15.42:0/1290086125 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3ea8078bc0 0x7f3ea807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:38.848 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.848+0000 7f3ecd600640 1 --2- 172.21.15.42:0/1290086125 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3ea8078bc0 0x7f3ea807b0d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc033000 tx=0x7f3ebc004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:38.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:38.851+0000 7f3ec5600640 1 -- 172.21.15.42:0/1290086125 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3ec80c5430 con 0x7f3ec80cef70 2024-09-17T01:43:39.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.084+0000 7f3ed0000640 1 -- 172.21.15.42:0/1290086125 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ec81f9a10 con 0x7f3ec80cef70 2024-09-17T01:43:39.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.085+0000 7f3ec5600640 1 -- 172.21.15.42:0/1290086125 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) ==== 95+0+5230 (secure 0 0 0) 0x7f3ec815de90 con 0x7f3ec80cef70 2024-09-17T01:43:39.084 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:39.084 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3131119825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3131119825},{"type":"v1","addr":"172.21.15.43:6837","nonce":3131119825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8368,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1988657429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1988657429},{"type":"v1","addr":"172.21.15.43:6836","nonce":1988657429}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/578887548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":578887548},{"type":"v1","addr":"172.21.15.42:6835","nonce":578887548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:42:57.184518+0000","modified":"2024-09-17T01:43:00.201156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8982":{"gid":8982,"name":"c","rank":0,"incarnation":112,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6834/3811049376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3811049376},{"type":"v1","addr":"172.21.15.42:6834","nonce":3811049376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8982,"qdb_cluster":[8982]},"id":10}]} 2024-09-17T01:43:39.084 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 116 2024-09-17T01:43:39.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.088+0000 7f3ed0000640 1 -- 172.21.15.42:0/1290086125 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3ea8078bc0 msgr2=0x7f3ea807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:39.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.088+0000 7f3ed0000640 1 --2- 172.21.15.42:0/1290086125 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3ea8078bc0 0x7f3ea807b0d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc033000 tx=0x7f3ebc004730 comp rx=0 tx=0).stop 2024-09-17T01:43:39.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.088+0000 7f3ed0000640 1 -- 172.21.15.42:0/1290086125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ec80cef70 msgr2=0x7f3ec81f8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:39.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.088+0000 7f3ed0000640 1 --2- 172.21.15.42:0/1290086125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ec80cef70 0x7f3ec81f8fc0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000c760 tx=0x7f3ec000cc20 comp rx=0 tx=0).stop 2024-09-17T01:43:39.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.088+0000 7f3ed0000640 1 -- 172.21.15.42:0/1290086125 shutdown_connections 2024-09-17T01:43:39.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.088+0000 7f3ed0000640 1 --2- 172.21.15.42:0/1290086125 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3ea8078bc0 0x7f3ea807b0d0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:39.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.088+0000 7f3ed0000640 1 --2- 172.21.15.42:0/1290086125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ec80cef70 0x7f3ec81f8fc0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:39.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.088+0000 7f3ed0000640 1 --2- 172.21.15.42:0/1290086125 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3ec80b5100 0x7f3ec80b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:39.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.088+0000 7f3ed0000640 1 --2- 172.21.15.42:0/1290086125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ec806d430 0x7f3ec80c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:39.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.088+0000 7f3ed0000640 1 -- 172.21.15.42:0/1290086125 >> 172.21.15.42:0/1290086125 conn(0x7f3ec80b2930 msgr2=0x7f3ec80cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:39.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.088+0000 7f3ed0000640 1 -- 172.21.15.42:0/1290086125 shutdown_connections 2024-09-17T01:43:39.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.088+0000 7f3ed0000640 1 -- 172.21.15.42:0/1290086125 wait complete. 2024-09-17T01:43:39.110 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T01:43:39.110 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:43:39.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.339+0000 7f4ce7e00640 1 -- 172.21.15.42:0/3752993141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ce00b3550 msgr2=0x7f4ce015cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:39.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.339+0000 7f4ce7e00640 1 --2- 172.21.15.42:0/3752993141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ce00b3550 0x7f4ce015cec0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00704d0 tx=0x7f4cd402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:43:39.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.339+0000 7f4ce7e00640 1 -- 172.21.15.42:0/3752993141 shutdown_connections 2024-09-17T01:43:39.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.339+0000 7f4ce7e00640 1 --2- 172.21.15.42:0/3752993141 >> v2:172.21.15.43:3300/0 conn(0x7f4ce0142f40 0x7f4ce0072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:39.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.339+0000 7f4ce7e00640 1 --2- 172.21.15.42:0/3752993141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ce00b3550 0x7f4ce015cec0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:39.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.339+0000 7f4ce7e00640 1 -- 172.21.15.42:0/3752993141 >> 172.21.15.42:0/3752993141 conn(0x7f4ce00b2930 msgr2=0x7f4ce006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:39.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.339+0000 7f4ce7e00640 1 -- 172.21.15.42:0/3752993141 shutdown_connections 2024-09-17T01:43:39.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.339+0000 7f4ce7e00640 1 -- 172.21.15.42:0/3752993141 wait complete. 2024-09-17T01:43:39.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.342+0000 7f4ce7e00640 1 Processor -- start 2024-09-17T01:43:39.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.342+0000 7f4ce7e00640 1 -- start start 2024-09-17T01:43:39.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.343+0000 7f4ce7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ce0072e90 0x7f4ce013fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:39.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.343+0000 7f4ce7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ce00b3550 0x7f4ce006fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:39.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.343+0000 7f4ce7e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4ce0142f40 0x7f4ce01359a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:39.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.343+0000 7f4ce7e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce006d5b0 con 0x7f4ce0072e90 2024-09-17T01:43:39.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.343+0000 7f4ce7e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce006d430 con 0x7f4ce00b3550 2024-09-17T01:43:39.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.343+0000 7f4ce7e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4ce006d730 con 0x7f4ce0142f40 2024-09-17T01:43:39.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.343+0000 7f4ce5400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ce0072e90 0x7f4ce013fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:39.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.343+0000 7f4ce5400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ce0072e90 0x7f4ce013fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59324/0 (socket says 172.21.15.42:59324) 2024-09-17T01:43:39.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.343+0000 7f4ce5400640 1 -- 172.21.15.42:0/2788826104 learned_addr learned my addr 172.21.15.42:0/2788826104 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:39.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.344+0000 7f4ce4a00640 1 --2- 172.21.15.42:0/2788826104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ce00b3550 0x7f4ce006fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:39.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.344+0000 7f4ce5e00640 1 --2- 172.21.15.42:0/2788826104 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4ce0142f40 0x7f4ce01359a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:39.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.344+0000 7f4ce5400640 1 -- 172.21.15.42:0/2788826104 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4ce0142f40 msgr2=0x7f4ce01359a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:39.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.344+0000 7f4ce5400640 1 --2- 172.21.15.42:0/2788826104 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4ce0142f40 0x7f4ce01359a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:39.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.344+0000 7f4ce5400640 1 -- 172.21.15.42:0/2788826104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ce00b3550 msgr2=0x7f4ce006fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:39.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.344+0000 7f4ce5400640 1 --2- 172.21.15.42:0/2788826104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ce00b3550 0x7f4ce006fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:39.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.344+0000 7f4ce5400640 1 -- 172.21.15.42:0/2788826104 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce015bd80 con 0x7f4ce0072e90 2024-09-17T01:43:39.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.344+0000 7f4ce5400640 1 --2- 172.21.15.42:0/2788826104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ce0072e90 0x7f4ce013fda0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f4cd402aa90 tx=0x7f4cd4033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:39.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.345+0000 7f4cdd600640 1 -- 172.21.15.42:0/2788826104 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4005c90 con 0x7f4ce0072e90 2024-09-17T01:43:39.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.345+0000 7f4cdd600640 1 -- 172.21.15.42:0/2788826104 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cd4031e50 con 0x7f4ce0072e90 2024-09-17T01:43:39.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.345+0000 7f4cdd600640 1 -- 172.21.15.42:0/2788826104 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4005260 con 0x7f4ce0072e90 2024-09-17T01:43:39.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.345+0000 7f4ce7e00640 1 -- 172.21.15.42:0/2788826104 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce006f370 con 0x7f4ce0072e90 2024-09-17T01:43:39.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.345+0000 7f4ce7e00640 1 -- 172.21.15.42:0/2788826104 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce013d470 con 0x7f4ce0072e90 2024-09-17T01:43:39.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.346+0000 7f4ce7e00640 1 -- 172.21.15.42:0/2788826104 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ce006dbe0 con 0x7f4ce0072e90 2024-09-17T01:43:39.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.347+0000 7f4cdd600640 1 -- 172.21.15.42:0/2788826104 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4cd4005400 con 0x7f4ce0072e90 2024-09-17T01:43:39.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.348+0000 7f4cdd600640 1 --2- 172.21.15.42:0/2788826104 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4cc0078b90 0x7f4cc007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:39.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.348+0000 7f4cdd600640 1 -- 172.21.15.42:0/2788826104 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f4cd40bbe00 con 0x7f4ce0072e90 2024-09-17T01:43:39.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.349+0000 7f4ce4a00640 1 --2- 172.21.15.42:0/2788826104 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4cc0078b90 0x7f4cc007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:39.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.349+0000 7f4ce4a00640 1 --2- 172.21.15.42:0/2788826104 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4cc0078b90 0x7f4cc007b0a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00ccd70 tx=0x7f4ccc005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:39.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.353+0000 7f4cdd600640 1 -- 172.21.15.42:0/2788826104 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4cd403f030 con 0x7f4ce0072e90 2024-09-17T01:43:39.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.621+0000 7f4ce7e00640 1 -- 172.21.15.42:0/2788826104 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f4ce006a170 con 0x7f4ce0072e90 2024-09-17T01:43:39.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.622+0000 7f4cdd600640 1 -- 172.21.15.42:0/2788826104 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7f4cd4031770 con 0x7f4ce0072e90 2024-09-17T01:43:39.621 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:39.621 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":720,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":147,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1077031982,"bytes_used":2596196352,"bytes_avail":770497916928,"bytes_total":773094113280,"write_bytes_sec":18710149,"read_op_per_sec":0,"write_op_per_sec":37},"fsmap":{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":8982}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-17T01:43:35.179714+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:43:39.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.624+0000 7f4ce7e00640 1 -- 172.21.15.42:0/2788826104 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4cc0078b90 msgr2=0x7f4cc007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:39.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.624+0000 7f4ce7e00640 1 --2- 172.21.15.42:0/2788826104 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4cc0078b90 0x7f4cc007b0a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00ccd70 tx=0x7f4ccc005f90 comp rx=0 tx=0).stop 2024-09-17T01:43:39.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.624+0000 7f4ce7e00640 1 -- 172.21.15.42:0/2788826104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ce0072e90 msgr2=0x7f4ce013fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:39.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.624+0000 7f4ce7e00640 1 --2- 172.21.15.42:0/2788826104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ce0072e90 0x7f4ce013fda0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f4cd402aa90 tx=0x7f4cd4033c20 comp rx=0 tx=0).stop 2024-09-17T01:43:39.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.624+0000 7f4ce7e00640 1 -- 172.21.15.42:0/2788826104 shutdown_connections 2024-09-17T01:43:39.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.624+0000 7f4ce7e00640 1 --2- 172.21.15.42:0/2788826104 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4cc0078b90 0x7f4cc007b0a0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:39.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.624+0000 7f4ce7e00640 1 --2- 172.21.15.42:0/2788826104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4ce00b3550 0x7f4ce006fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:39.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.624+0000 7f4ce7e00640 1 --2- 172.21.15.42:0/2788826104 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4ce0142f40 0x7f4ce01359a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:39.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.624+0000 7f4ce7e00640 1 --2- 172.21.15.42:0/2788826104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ce0072e90 0x7f4ce013fda0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:39.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.624+0000 7f4ce7e00640 1 -- 172.21.15.42:0/2788826104 >> 172.21.15.42:0/2788826104 conn(0x7f4ce00b2930 msgr2=0x7f4ce015a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:39.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.624+0000 7f4ce7e00640 1 -- 172.21.15.42:0/2788826104 shutdown_connections 2024-09-17T01:43:39.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:39.624+0000 7f4ce7e00640 1 -- 172.21.15.42:0/2788826104 wait complete. 2024-09-17T01:43:39.647 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-17T01:43:40.648 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:43:40.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.889+0000 7fba31e00640 1 -- 172.21.15.42:0/3002624756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba10005350 msgr2=0x7fba1000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:40.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.889+0000 7fba31e00640 1 --2- 172.21.15.42:0/3002624756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba10005350 0x7fba1000b9c0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fba24005fd0 tx=0x7fba10005830 comp rx=0 tx=0).stop 2024-09-17T01:43:40.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.889+0000 7fba2b400640 1 -- 172.21.15.42:0/3002624756 reap_dead start 2024-09-17T01:43:40.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.889+0000 7fba31e00640 1 -- 172.21.15.42:0/3002624756 shutdown_connections 2024-09-17T01:43:40.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.889+0000 7fba31e00640 1 -- 172.21.15.42:0/3002624756 >> 172.21.15.42:0/3002624756 conn(0x7fba2c0b2930 msgr2=0x7fba2c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:40.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.890+0000 7fba31e00640 1 -- 172.21.15.42:0/3002624756 shutdown_connections 2024-09-17T01:43:40.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.890+0000 7fba31e00640 1 -- 172.21.15.42:0/3002624756 wait complete. 2024-09-17T01:43:40.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.892+0000 7fba31e00640 1 Processor -- start 2024-09-17T01:43:40.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.892+0000 7fba31e00640 1 -- start start 2024-09-17T01:43:40.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.893+0000 7fba31e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba10005350 0x7fba2c06e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:40.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.893+0000 7fba31e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba2c0ae950 0x7fba2c1f9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:40.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.893+0000 7fba31e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba2c158780 0x7fba2c158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:40.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.893+0000 7fba31e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fba2c0737e0 con 0x7fba10005350 2024-09-17T01:43:40.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.893+0000 7fba31e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fba2c073660 con 0x7fba2c0ae950 2024-09-17T01:43:40.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.893+0000 7fba31e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fba2c073960 con 0x7fba2c158780 2024-09-17T01:43:40.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.894+0000 7fba2aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba10005350 0x7fba2c06e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:40.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.894+0000 7fba2aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba10005350 0x7fba2c06e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59340/0 (socket says 172.21.15.42:59340) 2024-09-17T01:43:40.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.894+0000 7fba2aa00640 1 -- 172.21.15.42:0/3456779775 learned_addr learned my addr 172.21.15.42:0/3456779775 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:40.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.894+0000 7fba2b400640 1 --2- 172.21.15.42:0/3456779775 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba2c158780 0x7fba2c158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:40.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.894+0000 7fba2a000640 1 --2- 172.21.15.42:0/3456779775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba2c0ae950 0x7fba2c1f9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:40.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.894+0000 7fba2aa00640 1 -- 172.21.15.42:0/3456779775 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba2c158780 msgr2=0x7fba2c158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:40.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.894+0000 7fba2aa00640 1 --2- 172.21.15.42:0/3456779775 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba2c158780 0x7fba2c158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:40.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.894+0000 7fba2aa00640 1 -- 172.21.15.42:0/3456779775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba2c0ae950 msgr2=0x7fba2c1f9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:40.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.894+0000 7fba2aa00640 1 --2- 172.21.15.42:0/3456779775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba2c0ae950 0x7fba2c1f9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:40.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.894+0000 7fba2aa00640 1 -- 172.21.15.42:0/3456779775 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba2c1fa490 con 0x7fba10005350 2024-09-17T01:43:40.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.894+0000 7fba2aa00640 1 --2- 172.21.15.42:0/3456779775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba10005350 0x7fba2c06e1c0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fba1c003f80 tx=0x7fba1c0016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:40.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.895+0000 7fba23400640 1 -- 172.21.15.42:0/3456779775 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c011700 con 0x7fba10005350 2024-09-17T01:43:40.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.895+0000 7fba23400640 1 -- 172.21.15.42:0/3456779775 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba1c016020 con 0x7fba10005350 2024-09-17T01:43:40.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.895+0000 7fba23400640 1 -- 172.21.15.42:0/3456779775 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c011b20 con 0x7fba10005350 2024-09-17T01:43:40.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.895+0000 7fba31e00640 1 -- 172.21.15.42:0/3456779775 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba2c0aee20 con 0x7fba10005350 2024-09-17T01:43:40.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.895+0000 7fba31e00640 1 -- 172.21.15.42:0/3456779775 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba2c15b980 con 0x7fba10005350 2024-09-17T01:43:40.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.896+0000 7fba31e00640 1 -- 172.21.15.42:0/3456779775 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba2c073ef0 con 0x7fba10005350 2024-09-17T01:43:40.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.897+0000 7fba23400640 1 -- 172.21.15.42:0/3456779775 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fba1c011cc0 con 0x7fba10005350 2024-09-17T01:43:40.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.899+0000 7fba23400640 1 --2- 172.21.15.42:0/3456779775 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fba0c078b90 0x7fba0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:40.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.899+0000 7fba23400640 1 -- 172.21.15.42:0/3456779775 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fba1c09bad0 con 0x7fba10005350 2024-09-17T01:43:40.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.899+0000 7fba2a000640 1 --2- 172.21.15.42:0/3456779775 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fba0c078b90 0x7fba0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:40.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.900+0000 7fba2a000640 1 --2- 172.21.15.42:0/3456779775 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fba0c078b90 0x7fba0c07b0a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fba2c072c20 tx=0x7fba18006970 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:40.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:40.904+0000 7fba23400640 1 -- 172.21.15.42:0/3456779775 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fba1c020020 con 0x7fba10005350 2024-09-17T01:43:41.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.134+0000 7fba31e00640 1 -- 172.21.15.42:0/3456779775 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba2c06a170 con 0x7fba10005350 2024-09-17T01:43:41.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.135+0000 7fba23400640 1 -- 172.21.15.42:0/3456779775 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) ==== 95+0+5230 (secure 0 0 0) 0x7fba2c1fa490 con 0x7fba10005350 2024-09-17T01:43:41.134 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:41.134 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3131119825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3131119825},{"type":"v1","addr":"172.21.15.43:6837","nonce":3131119825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8368,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1988657429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1988657429},{"type":"v1","addr":"172.21.15.43:6836","nonce":1988657429}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/578887548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":578887548},{"type":"v1","addr":"172.21.15.42:6835","nonce":578887548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:42:57.184518+0000","modified":"2024-09-17T01:43:00.201156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8982":{"gid":8982,"name":"c","rank":0,"incarnation":112,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6834/3811049376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3811049376},{"type":"v1","addr":"172.21.15.42:6834","nonce":3811049376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8982,"qdb_cluster":[8982]},"id":10}]} 2024-09-17T01:43:41.134 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 116 2024-09-17T01:43:41.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.137+0000 7fba31e00640 1 -- 172.21.15.42:0/3456779775 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fba0c078b90 msgr2=0x7fba0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:41.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.137+0000 7fba31e00640 1 --2- 172.21.15.42:0/3456779775 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fba0c078b90 0x7fba0c07b0a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fba2c072c20 tx=0x7fba18006970 comp rx=0 tx=0).stop 2024-09-17T01:43:41.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.137+0000 7fba31e00640 1 -- 172.21.15.42:0/3456779775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba10005350 msgr2=0x7fba2c06e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:41.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.137+0000 7fba31e00640 1 --2- 172.21.15.42:0/3456779775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba10005350 0x7fba2c06e1c0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fba1c003f80 tx=0x7fba1c0016f0 comp rx=0 tx=0).stop 2024-09-17T01:43:41.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.137+0000 7fba31e00640 1 -- 172.21.15.42:0/3456779775 shutdown_connections 2024-09-17T01:43:41.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.137+0000 7fba31e00640 1 --2- 172.21.15.42:0/3456779775 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fba0c078b90 0x7fba0c07b0a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:41.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.137+0000 7fba31e00640 1 --2- 172.21.15.42:0/3456779775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba2c0ae950 0x7fba2c1f9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:41.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.137+0000 7fba31e00640 1 --2- 172.21.15.42:0/3456779775 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fba2c158780 0x7fba2c158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:41.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.137+0000 7fba31e00640 1 --2- 172.21.15.42:0/3456779775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba10005350 0x7fba2c06e1c0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:41.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.137+0000 7fba31e00640 1 -- 172.21.15.42:0/3456779775 >> 172.21.15.42:0/3456779775 conn(0x7fba2c0b2930 msgr2=0x7fba2c15cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:41.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.138+0000 7fba31e00640 1 -- 172.21.15.42:0/3456779775 shutdown_connections 2024-09-17T01:43:41.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.138+0000 7fba31e00640 1 -- 172.21.15.42:0/3456779775 wait complete. 2024-09-17T01:43:41.159 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T01:43:41.159 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:43:41.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.389+0000 7f1eb6800640 1 -- 172.21.15.42:0/4195716832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e98003c10 msgr2=0x7f1e98004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:41.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.389+0000 7f1eb6800640 1 --2- 172.21.15.42:0/4195716832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1e98003c10 0x7f1e98004060 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4006f60 tx=0x7f1e98005830 comp rx=0 tx=0).stop 2024-09-17T01:43:41.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.389+0000 7f1eb5e00640 1 -- 172.21.15.42:0/4195716832 reap_dead start 2024-09-17T01:43:41.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.389+0000 7f1eb6800640 1 -- 172.21.15.42:0/4195716832 shutdown_connections 2024-09-17T01:43:41.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.389+0000 7f1eb6800640 1 -- 172.21.15.42:0/4195716832 >> 172.21.15.42:0/4195716832 conn(0x7f1eb0073f20 msgr2=0x7f1eb006cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:41.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.389+0000 7f1eb6800640 1 -- 172.21.15.42:0/4195716832 shutdown_connections 2024-09-17T01:43:41.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.389+0000 7f1eb6800640 1 -- 172.21.15.42:0/4195716832 wait complete. 2024-09-17T01:43:41.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.391+0000 7f1eb6800640 1 Processor -- start 2024-09-17T01:43:41.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.391+0000 7f1eb6800640 1 -- start start 2024-09-17T01:43:41.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.393+0000 7f1eb6800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e98003c10 0x7f1eb0159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:41.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.393+0000 7f1eb6800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1eb015a980 0x7f1eb00ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:41.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.393+0000 7f1eb6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1eb015a3c0 0x7f1eb00ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:41.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.393+0000 7f1eb6800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb00d3710 con 0x7f1eb015a3c0 2024-09-17T01:43:41.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.393+0000 7f1eb6800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb00d3590 con 0x7f1e98003c10 2024-09-17T01:43:41.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.393+0000 7f1eb6800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1eb00d3890 con 0x7f1eb015a980 2024-09-17T01:43:41.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.393+0000 7f1eb5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1eb015a3c0 0x7f1eb00ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:41.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.393+0000 7f1eb5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1eb015a3c0 0x7f1eb00ca7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59356/0 (socket says 172.21.15.42:59356) 2024-09-17T01:43:41.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.393+0000 7f1eb5e00640 1 -- 172.21.15.42:0/1273026039 learned_addr learned my addr 172.21.15.42:0/1273026039 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:41.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.393+0000 7f1eb5400640 1 --2- 172.21.15.42:0/1273026039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e98003c10 0x7f1eb0159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:41.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.393+0000 7f1eb4a00640 1 --2- 172.21.15.42:0/1273026039 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1eb015a980 0x7f1eb00ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:41.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.394+0000 7f1eb5e00640 1 -- 172.21.15.42:0/1273026039 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1eb015a980 msgr2=0x7f1eb00ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:41.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.394+0000 7f1eb5e00640 1 --2- 172.21.15.42:0/1273026039 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1eb015a980 0x7f1eb00ca2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:41.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.394+0000 7f1eb5e00640 1 -- 172.21.15.42:0/1273026039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e98003c10 msgr2=0x7f1eb0159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:41.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.394+0000 7f1eb5e00640 1 --2- 172.21.15.42:0/1273026039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e98003c10 0x7f1eb0159ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:41.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.394+0000 7f1eb5e00640 1 -- 172.21.15.42:0/1273026039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb01eb6a0 con 0x7f1eb015a3c0 2024-09-17T01:43:41.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.394+0000 7f1eb5e00640 1 --2- 172.21.15.42:0/1273026039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1eb015a3c0 0x7f1eb00ca7f0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00754a0 tx=0x7f1ea8010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:41.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.394+0000 7f1ead600640 1 -- 172.21.15.42:0/1273026039 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8003970 con 0x7f1eb015a3c0 2024-09-17T01:43:41.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.394+0000 7f1ead600640 1 -- 172.21.15.42:0/1273026039 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ea8015070 con 0x7f1eb015a3c0 2024-09-17T01:43:41.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.394+0000 7f1ead600640 1 -- 172.21.15.42:0/1273026039 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8004030 con 0x7f1eb015a3c0 2024-09-17T01:43:41.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.394+0000 7f1eb6800640 1 -- 172.21.15.42:0/1273026039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eb01f9a00 con 0x7f1eb015a3c0 2024-09-17T01:43:41.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.394+0000 7f1eb6800640 1 -- 172.21.15.42:0/1273026039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eb00cd750 con 0x7f1eb015a3c0 2024-09-17T01:43:41.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.396+0000 7f1eb6800640 1 -- 172.21.15.42:0/1273026039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eb015c3c0 con 0x7f1eb015a3c0 2024-09-17T01:43:41.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.397+0000 7f1ead600640 1 -- 172.21.15.42:0/1273026039 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1ea80041d0 con 0x7f1eb015a3c0 2024-09-17T01:43:41.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.398+0000 7f1ead600640 1 --2- 172.21.15.42:0/1273026039 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1e90078b90 0x7f1e9007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:41.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.398+0000 7f1ead600640 1 -- 172.21.15.42:0/1273026039 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f1ea809b7b0 con 0x7f1eb015a3c0 2024-09-17T01:43:41.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.398+0000 7f1eb5400640 1 --2- 172.21.15.42:0/1273026039 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1e90078b90 0x7f1e9007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:41.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.399+0000 7f1eb5400640 1 --2- 172.21.15.42:0/1273026039 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1e90078b90 0x7f1e9007b0a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4033000 tx=0x7f1eb00cf210 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:41.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.402+0000 7f1ead600640 1 -- 172.21.15.42:0/1273026039 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1ea8063d10 con 0x7f1eb015a3c0 2024-09-17T01:43:41.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.670+0000 7f1eb6800640 1 -- 172.21.15.42:0/1273026039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f1eb006cde0 con 0x7f1eb015a3c0 2024-09-17T01:43:41.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.670+0000 7f1ead600640 1 -- 172.21.15.42:0/1273026039 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7f1ea8063610 con 0x7f1eb015a3c0 2024-09-17T01:43:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:41.669 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":722,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":147,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1077031982,"bytes_used":2600460288,"bytes_avail":770493652992,"bytes_total":773094113280,"write_bytes_sec":14254972,"read_op_per_sec":0,"write_op_per_sec":33},"fsmap":{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":8982}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-17T01:43:35.179714+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:43:41.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.673+0000 7f1eb6800640 1 -- 172.21.15.42:0/1273026039 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1e90078b90 msgr2=0x7f1e9007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:41.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.673+0000 7f1eb6800640 1 --2- 172.21.15.42:0/1273026039 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1e90078b90 0x7f1e9007b0a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4033000 tx=0x7f1eb00cf210 comp rx=0 tx=0).stop 2024-09-17T01:43:41.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.673+0000 7f1eb6800640 1 -- 172.21.15.42:0/1273026039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1eb015a3c0 msgr2=0x7f1eb00ca7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:41.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.673+0000 7f1eb6800640 1 --2- 172.21.15.42:0/1273026039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1eb015a3c0 0x7f1eb00ca7f0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00754a0 tx=0x7f1ea8010f40 comp rx=0 tx=0).stop 2024-09-17T01:43:41.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.673+0000 7f1eb6800640 1 -- 172.21.15.42:0/1273026039 shutdown_connections 2024-09-17T01:43:41.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.673+0000 7f1eb6800640 1 --2- 172.21.15.42:0/1273026039 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1e90078b90 0x7f1e9007b0a0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:41.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.673+0000 7f1eb6800640 1 --2- 172.21.15.42:0/1273026039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1eb015a3c0 0x7f1eb00ca7f0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:41.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.673+0000 7f1eb6800640 1 --2- 172.21.15.42:0/1273026039 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1eb015a980 0x7f1eb00ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:41.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.673+0000 7f1eb6800640 1 --2- 172.21.15.42:0/1273026039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e98003c10 0x7f1eb0159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:41.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.673+0000 7f1eb6800640 1 -- 172.21.15.42:0/1273026039 >> 172.21.15.42:0/1273026039 conn(0x7f1eb0073f20 msgr2=0x7f1eb0075f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:41.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.673+0000 7f1eb6800640 1 -- 172.21.15.42:0/1273026039 shutdown_connections 2024-09-17T01:43:41.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:41.673+0000 7f1eb6800640 1 -- 172.21.15.42:0/1273026039 wait complete. 2024-09-17T01:43:41.693 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-17T01:43:42.693 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:43:42.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.934+0000 7fb4a2c00640 1 -- 172.21.15.42:0/2488610287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb49c06d260 msgr2=0x7fb49c152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:42.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.934+0000 7fb4a2c00640 1 --2- 172.21.15.42:0/2488610287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb49c06d260 0x7fb49c152ed0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fb494005fd0 tx=0x7fb49402aa90 comp rx=0 tx=0).stop 2024-09-17T01:43:42.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.934+0000 7fb4a2c00640 1 -- 172.21.15.42:0/2488610287 shutdown_connections 2024-09-17T01:43:42.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.934+0000 7fb4a2c00640 1 --2- 172.21.15.42:0/2488610287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb49c06d260 0x7fb49c152ed0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:42.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.934+0000 7fb4a2c00640 1 --2- 172.21.15.42:0/2488610287 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb49c0cf7c0 0x7fb49c06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:42.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.934+0000 7fb4a2c00640 1 -- 172.21.15.42:0/2488610287 >> 172.21.15.42:0/2488610287 conn(0x7fb49c0b25f0 msgr2=0x7fb49c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:42.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.934+0000 7fb4a2c00640 1 -- 172.21.15.42:0/2488610287 shutdown_connections 2024-09-17T01:43:42.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.934+0000 7fb4a2c00640 1 -- 172.21.15.42:0/2488610287 wait complete. 2024-09-17T01:43:42.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.937+0000 7fb4a2c00640 1 Processor -- start 2024-09-17T01:43:42.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.937+0000 7fb4a2c00640 1 -- start start 2024-09-17T01:43:42.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.938+0000 7fb4a2c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb49c06d260 0x7fb49c14fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:42.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.938+0000 7fb4a2c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb49c0b4be0 0x7fb49c14e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:42.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.938+0000 7fb4a2c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb49c0cf7c0 0x7fb49c151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:42.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.938+0000 7fb4a2c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb49c1537d0 con 0x7fb49c0b4be0 2024-09-17T01:43:42.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.938+0000 7fb4a2c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb49c153650 con 0x7fb49c0cf7c0 2024-09-17T01:43:42.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.938+0000 7fb4a2c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb49c153950 con 0x7fb49c06d260 2024-09-17T01:43:42.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.938+0000 7fb4a0e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb49c0b4be0 0x7fb49c14e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:42.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.938+0000 7fb4a0e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb49c0b4be0 0x7fb49c14e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59370/0 (socket says 172.21.15.42:59370) 2024-09-17T01:43:42.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.939+0000 7fb4a0e00640 1 -- 172.21.15.42:0/431026916 learned_addr learned my addr 172.21.15.42:0/431026916 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:42.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.939+0000 7fb4a1800640 1 --2- 172.21.15.42:0/431026916 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb49c06d260 0x7fb49c14fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:42.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.939+0000 7fb4a2200640 1 --2- 172.21.15.42:0/431026916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb49c0cf7c0 0x7fb49c151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:42.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.939+0000 7fb4a0e00640 1 -- 172.21.15.42:0/431026916 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb49c06d260 msgr2=0x7fb49c14fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:42.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.939+0000 7fb4a0e00640 1 --2- 172.21.15.42:0/431026916 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb49c06d260 0x7fb49c14fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:42.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.939+0000 7fb4a0e00640 1 -- 172.21.15.42:0/431026916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb49c0cf7c0 msgr2=0x7fb49c151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:42.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.939+0000 7fb4a0e00640 1 --2- 172.21.15.42:0/431026916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb49c0cf7c0 0x7fb49c151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:42.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.939+0000 7fb4a0e00640 1 -- 172.21.15.42:0/431026916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb49c150580 con 0x7fb49c0b4be0 2024-09-17T01:43:42.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.939+0000 7fb4a1800640 1 --2- 172.21.15.42:0/431026916 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb49c06d260 0x7fb49c14fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:43:42.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.939+0000 7fb4a0e00640 1 --2- 172.21.15.42:0/431026916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb49c0b4be0 0x7fb49c14e5b0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fb48800e790 tx=0x7fb48800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:42.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.939+0000 7fb499600640 1 -- 172.21.15.42:0/431026916 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48800eea0 con 0x7fb49c0b4be0 2024-09-17T01:43:42.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.940+0000 7fb499600640 1 -- 172.21.15.42:0/431026916 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb48800cdb0 con 0x7fb49c0b4be0 2024-09-17T01:43:42.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.940+0000 7fb499600640 1 -- 172.21.15.42:0/431026916 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb488010690 con 0x7fb49c0b4be0 2024-09-17T01:43:42.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.940+0000 7fb4a2c00640 1 -- 172.21.15.42:0/431026916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb49c1e94a0 con 0x7fb49c0b4be0 2024-09-17T01:43:42.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.940+0000 7fb4a2c00640 1 -- 172.21.15.42:0/431026916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb49c1e9a60 con 0x7fb49c0b4be0 2024-09-17T01:43:42.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.941+0000 7fb4a2c00640 1 -- 172.21.15.42:0/431026916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb49c152ed0 con 0x7fb49c0b4be0 2024-09-17T01:43:42.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.942+0000 7fb499600640 1 -- 172.21.15.42:0/431026916 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb488010830 con 0x7fb49c0b4be0 2024-09-17T01:43:42.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.943+0000 7fb499600640 1 --2- 172.21.15.42:0/431026916 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb47c078b90 0x7fb47c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:42.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.943+0000 7fb499600640 1 -- 172.21.15.42:0/431026916 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fb48809b710 con 0x7fb49c0b4be0 2024-09-17T01:43:42.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.944+0000 7fb4a1800640 1 --2- 172.21.15.42:0/431026916 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb47c078b90 0x7fb47c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:42.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.945+0000 7fb4a1800640 1 --2- 172.21.15.42:0/431026916 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb47c078b90 0x7fb47c07b0a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb490007fd0 tx=0x7fb490009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:42.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:42.947+0000 7fb499600640 1 -- 172.21.15.42:0/431026916 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb49c150580 con 0x7fb49c0b4be0 2024-09-17T01:43:43.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.195+0000 7fb4a2c00640 1 -- 172.21.15.42:0/431026916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb49c0afac0 con 0x7fb49c0b4be0 2024-09-17T01:43:43.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.196+0000 7fb499600640 1 -- 172.21.15.42:0/431026916 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) ==== 95+0+5230 (secure 0 0 0) 0x7fb488063bd0 con 0x7fb49c0b4be0 2024-09-17T01:43:43.195 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:43.195 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3131119825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3131119825},{"type":"v1","addr":"172.21.15.43:6837","nonce":3131119825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8368,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1988657429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1988657429},{"type":"v1","addr":"172.21.15.43:6836","nonce":1988657429}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/578887548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":578887548},{"type":"v1","addr":"172.21.15.42:6835","nonce":578887548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:42:57.184518+0000","modified":"2024-09-17T01:43:00.201156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8982":{"gid":8982,"name":"c","rank":0,"incarnation":112,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6834/3811049376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3811049376},{"type":"v1","addr":"172.21.15.42:6834","nonce":3811049376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8982,"qdb_cluster":[8982]},"id":10}]} 2024-09-17T01:43:43.195 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 116 2024-09-17T01:43:43.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.200+0000 7fb4a2c00640 1 -- 172.21.15.42:0/431026916 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb47c078b90 msgr2=0x7fb47c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:43.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.200+0000 7fb4a2c00640 1 --2- 172.21.15.42:0/431026916 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb47c078b90 0x7fb47c07b0a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb490007fd0 tx=0x7fb490009040 comp rx=0 tx=0).stop 2024-09-17T01:43:43.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.200+0000 7fb4a2c00640 1 -- 172.21.15.42:0/431026916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb49c0b4be0 msgr2=0x7fb49c14e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.200+0000 7fb4a2c00640 1 --2- 172.21.15.42:0/431026916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb49c0b4be0 0x7fb49c14e5b0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fb48800e790 tx=0x7fb48800ec50 comp rx=0 tx=0).stop 2024-09-17T01:43:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.200+0000 7fb4a2c00640 1 -- 172.21.15.42:0/431026916 shutdown_connections 2024-09-17T01:43:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.200+0000 7fb4a2c00640 1 --2- 172.21.15.42:0/431026916 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb47c078b90 0x7fb47c07b0a0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.200+0000 7fb4a2c00640 1 --2- 172.21.15.42:0/431026916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb49c0cf7c0 0x7fb49c151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.200+0000 7fb4a2c00640 1 --2- 172.21.15.42:0/431026916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb49c0b4be0 0x7fb49c14e5b0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.200+0000 7fb4a2c00640 1 --2- 172.21.15.42:0/431026916 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb49c06d260 0x7fb49c14fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.200+0000 7fb4a2c00640 1 -- 172.21.15.42:0/431026916 >> 172.21.15.42:0/431026916 conn(0x7fb49c0b25f0 msgr2=0x7fb49c0adab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.200+0000 7fb4a2c00640 1 -- 172.21.15.42:0/431026916 shutdown_connections 2024-09-17T01:43:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.200+0000 7fb4a2c00640 1 -- 172.21.15.42:0/431026916 wait complete. 2024-09-17T01:43:43.235 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T01:43:43.235 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:43:43.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.461+0000 7f38e4800640 1 -- 172.21.15.42:0/1637722684 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38dc06db40 msgr2=0x7f38dc06fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:43.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.461+0000 7f38e4800640 1 --2- 172.21.15.42:0/1637722684 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38dc06db40 0x7f38dc06fe40 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f38dc0b3110 tx=0x7f38d802aac0 comp rx=0 tx=0).stop 2024-09-17T01:43:43.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.461+0000 7f38e4800640 1 -- 172.21.15.42:0/1637722684 shutdown_connections 2024-09-17T01:43:43.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.461+0000 7f38e4800640 1 --2- 172.21.15.42:0/1637722684 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38dc06db40 0x7f38dc06fe40 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:43.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.461+0000 7f38e4800640 1 --2- 172.21.15.42:0/1637722684 >> v2:172.21.15.43:3300/0 conn(0x7f38dc072e00 0x7f38dc15bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:43.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.461+0000 7f38e4800640 1 -- 172.21.15.42:0/1637722684 >> 172.21.15.42:0/1637722684 conn(0x7f38dc0b2930 msgr2=0x7f38dc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:43.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.461+0000 7f38e4800640 1 -- 172.21.15.42:0/1637722684 shutdown_connections 2024-09-17T01:43:43.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.461+0000 7f38e4800640 1 -- 172.21.15.42:0/1637722684 wait complete. 2024-09-17T01:43:43.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.463+0000 7f38e4800640 1 Processor -- start 2024-09-17T01:43:43.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.463+0000 7f38e4800640 1 -- start start 2024-09-17T01:43:43.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.465+0000 7f38e4800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f38dc072e00 0x7f38dc14cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:43.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.465+0000 7f38e4800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38dc15f190 0x7f38dc0b0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:43.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.465+0000 7f38e4800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38dc14d550 0x7f38dc0b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:43.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.465+0000 7f38e4800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f38dc151520 con 0x7f38dc15f190 2024-09-17T01:43:43.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.465+0000 7f38e4800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f38dc070740 con 0x7f38dc14d550 2024-09-17T01:43:43.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.465+0000 7f38e4800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f38dc1516a0 con 0x7f38dc072e00 2024-09-17T01:43:43.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.465+0000 7f38e1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38dc15f190 0x7f38dc0b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:43.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.465+0000 7f38e1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38dc15f190 0x7f38dc0b0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59398/0 (socket says 172.21.15.42:59398) 2024-09-17T01:43:43.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.465+0000 7f38e1400640 1 -- 172.21.15.42:0/2191930837 learned_addr learned my addr 172.21.15.42:0/2191930837 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:43.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.465+0000 7f38e1e00640 1 --2- 172.21.15.42:0/2191930837 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f38dc072e00 0x7f38dc14cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:43.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.465+0000 7f38e2800640 1 --2- 172.21.15.42:0/2191930837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38dc14d550 0x7f38dc0b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:43.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.466+0000 7f38e1400640 1 -- 172.21.15.42:0/2191930837 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f38dc072e00 msgr2=0x7f38dc14cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:43.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.466+0000 7f38e1400640 1 --2- 172.21.15.42:0/2191930837 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f38dc072e00 0x7f38dc14cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:43.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.466+0000 7f38e1400640 1 -- 172.21.15.42:0/2191930837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38dc14d550 msgr2=0x7f38dc0b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:43.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.466+0000 7f38e1400640 1 --2- 172.21.15.42:0/2191930837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38dc14d550 0x7f38dc0b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:43.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.466+0000 7f38e1400640 1 -- 172.21.15.42:0/2191930837 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38dc151e10 con 0x7f38dc15f190 2024-09-17T01:43:43.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.466+0000 7f38e1400640 1 --2- 172.21.15.42:0/2191930837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38dc15f190 0x7f38dc0b0130 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00c3c0 tx=0x7f38cc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:43.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.466+0000 7f38d6000640 1 -- 172.21.15.42:0/2191930837 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc017070 con 0x7f38dc15f190 2024-09-17T01:43:43.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.466+0000 7f38d6000640 1 -- 172.21.15.42:0/2191930837 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38cc0035f0 con 0x7f38dc15f190 2024-09-17T01:43:43.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.466+0000 7f38d6000640 1 -- 172.21.15.42:0/2191930837 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc003a40 con 0x7f38dc15f190 2024-09-17T01:43:43.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.466+0000 7f38e4800640 1 -- 172.21.15.42:0/2191930837 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38dc0b55d0 con 0x7f38dc15f190 2024-09-17T01:43:43.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.466+0000 7f38e4800640 1 -- 172.21.15.42:0/2191930837 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38dc0b5870 con 0x7f38dc15f190 2024-09-17T01:43:43.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.468+0000 7f38e4800640 1 -- 172.21.15.42:0/2191930837 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38dc06fe40 con 0x7f38dc15f190 2024-09-17T01:43:43.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.469+0000 7f38d6000640 1 -- 172.21.15.42:0/2191930837 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f38cc01a070 con 0x7f38dc15f190 2024-09-17T01:43:43.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.470+0000 7f38d6000640 1 --2- 172.21.15.42:0/2191930837 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f38c0078b90 0x7f38c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:43.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.470+0000 7f38d6000640 1 -- 172.21.15.42:0/2191930837 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f38cc09a0c0 con 0x7f38dc15f190 2024-09-17T01:43:43.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.470+0000 7f38e1e00640 1 --2- 172.21.15.42:0/2191930837 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f38c0078b90 0x7f38c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:43.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.471+0000 7f38e1e00640 1 --2- 172.21.15.42:0/2191930837 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f38c0078b90 0x7f38c007b0a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f38d0005fd0 tx=0x7f38d0005850 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:43.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.474+0000 7f38d6000640 1 -- 172.21.15.42:0/2191930837 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f38cc0624f0 con 0x7f38dc15f190 2024-09-17T01:43:43.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.746+0000 7f38e4800640 1 -- 172.21.15.42:0/2191930837 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f38dc06a170 con 0x7f38dc15f190 2024-09-17T01:43:43.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.747+0000 7f38d6000640 1 -- 172.21.15.42:0/2191930837 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7f38cc061df0 con 0x7f38dc15f190 2024-09-17T01:43:43.745 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:43.746 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":724,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":147,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1077031982,"bytes_used":2600460288,"bytes_avail":770493652992,"bytes_total":773094113280,"write_bytes_sec":12516696,"read_op_per_sec":0,"write_op_per_sec":20},"fsmap":{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":8982}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-17T01:43:35.179714+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:43:43.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.749+0000 7f38e4800640 1 -- 172.21.15.42:0/2191930837 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f38c0078b90 msgr2=0x7f38c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:43.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.749+0000 7f38e4800640 1 --2- 172.21.15.42:0/2191930837 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f38c0078b90 0x7f38c007b0a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f38d0005fd0 tx=0x7f38d0005850 comp rx=0 tx=0).stop 2024-09-17T01:43:43.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.749+0000 7f38e4800640 1 -- 172.21.15.42:0/2191930837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38dc15f190 msgr2=0x7f38dc0b0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:43.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.749+0000 7f38e4800640 1 --2- 172.21.15.42:0/2191930837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38dc15f190 0x7f38dc0b0130 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00c3c0 tx=0x7f38cc00c880 comp rx=0 tx=0).stop 2024-09-17T01:43:43.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.749+0000 7f38e4800640 1 -- 172.21.15.42:0/2191930837 shutdown_connections 2024-09-17T01:43:43.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.749+0000 7f38e4800640 1 --2- 172.21.15.42:0/2191930837 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f38c0078b90 0x7f38c007b0a0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:43.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.749+0000 7f38e4800640 1 --2- 172.21.15.42:0/2191930837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38dc14d550 0x7f38dc0b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:43.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.749+0000 7f38e4800640 1 --2- 172.21.15.42:0/2191930837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38dc15f190 0x7f38dc0b0130 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:43.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.749+0000 7f38e4800640 1 --2- 172.21.15.42:0/2191930837 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f38dc072e00 0x7f38dc14cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:43.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.749+0000 7f38e4800640 1 -- 172.21.15.42:0/2191930837 >> 172.21.15.42:0/2191930837 conn(0x7f38dc0b2930 msgr2=0x7f38dc0b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:43.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.749+0000 7f38e4800640 1 -- 172.21.15.42:0/2191930837 shutdown_connections 2024-09-17T01:43:43.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:43.749+0000 7f38e4800640 1 -- 172.21.15.42:0/2191930837 wait complete. 2024-09-17T01:43:43.772 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-17T01:43:44.773 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:43:45.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.014+0000 7f5551600640 1 -- 172.21.15.42:0/3836941482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f554c0b3550 msgr2=0x7f554c15cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:45.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.014+0000 7f5551600640 1 --2- 172.21.15.42:0/3836941482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f554c0b3550 0x7f554c15cec0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f554c15aab0 tx=0x7f553c02a4d0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.014+0000 7f5551600640 1 -- 172.21.15.42:0/3836941482 shutdown_connections 2024-09-17T01:43:45.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.014+0000 7f5551600640 1 --2- 172.21.15.42:0/3836941482 >> v2:172.21.15.43:3300/0 conn(0x7f554c0cec40 0x7f554c0cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.014+0000 7f5551600640 1 --2- 172.21.15.42:0/3836941482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f554c0b3550 0x7f554c15cec0 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.014+0000 7f5551600640 1 -- 172.21.15.42:0/3836941482 >> 172.21.15.42:0/3836941482 conn(0x7f554c0b2930 msgr2=0x7f554c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:45.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.014+0000 7f5551600640 1 -- 172.21.15.42:0/3836941482 shutdown_connections 2024-09-17T01:43:45.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.014+0000 7f5551600640 1 -- 172.21.15.42:0/3836941482 wait complete. 2024-09-17T01:43:45.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.016+0000 7f5551600640 1 Processor -- start 2024-09-17T01:43:45.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.016+0000 7f5551600640 1 -- start start 2024-09-17T01:43:45.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.018+0000 7f5551600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f554c0b3550 0x7f554c1e8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:45.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.018+0000 7f5551600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f554c0cec40 0x7f554c1e8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.018+0000 7f5551600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f554c142f40 0x7f554c1f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.018+0000 7f5551600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f554c06d7c0 con 0x7f554c142f40 2024-09-17T01:43:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.018+0000 7f5551600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f554c06d640 con 0x7f554c0cec40 2024-09-17T01:43:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.018+0000 7f5551600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f554c06d940 con 0x7f554c0b3550 2024-09-17T01:43:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.018+0000 7f554b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f554c142f40 0x7f554c1f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.018+0000 7f554b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f554c142f40 0x7f554c1f5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59416/0 (socket says 172.21.15.42:59416) 2024-09-17T01:43:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.018+0000 7f554b400640 1 -- 172.21.15.42:0/193520386 learned_addr learned my addr 172.21.15.42:0/193520386 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.018+0000 7f554aa00640 1 --2- 172.21.15.42:0/193520386 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f554c0b3550 0x7f554c1e8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.018+0000 7f5542000640 1 --2- 172.21.15.42:0/193520386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f554c0cec40 0x7f554c1e8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.019+0000 7f554b400640 1 -- 172.21.15.42:0/193520386 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f554c0b3550 msgr2=0x7f554c1e8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.019+0000 7f554b400640 1 --2- 172.21.15.42:0/193520386 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f554c0b3550 0x7f554c1e8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.019+0000 7f554b400640 1 -- 172.21.15.42:0/193520386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f554c0cec40 msgr2=0x7f554c1e8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:45.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.019+0000 7f554b400640 1 --2- 172.21.15.42:0/193520386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f554c0cec40 0x7f554c1e8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.019+0000 7f554b400640 1 -- 172.21.15.42:0/193520386 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f554c1e7a70 con 0x7f554c142f40 2024-09-17T01:43:45.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.019+0000 7f554b400640 1 --2- 172.21.15.42:0/193520386 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f554c142f40 0x7f554c1f5d80 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f554400e960 tx=0x7f554400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:45.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.019+0000 7f5543400640 1 -- 172.21.15.42:0/193520386 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5544004d20 con 0x7f554c142f40 2024-09-17T01:43:45.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.019+0000 7f5543400640 1 -- 172.21.15.42:0/193520386 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f554400cac0 con 0x7f554c142f40 2024-09-17T01:43:45.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.019+0000 7f5543400640 1 -- 172.21.15.42:0/193520386 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5544005020 con 0x7f554c142f40 2024-09-17T01:43:45.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.019+0000 7f5551600640 1 -- 172.21.15.42:0/193520386 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f554c1e69d0 con 0x7f554c142f40 2024-09-17T01:43:45.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.020+0000 7f5551600640 1 -- 172.21.15.42:0/193520386 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f554c1e6f90 con 0x7f554c142f40 2024-09-17T01:43:45.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.020+0000 7f5551600640 1 -- 172.21.15.42:0/193520386 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f554c15cec0 con 0x7f554c142f40 2024-09-17T01:43:45.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.022+0000 7f5543400640 1 -- 172.21.15.42:0/193520386 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f55440051c0 con 0x7f554c142f40 2024-09-17T01:43:45.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.023+0000 7f5543400640 1 --2- 172.21.15.42:0/193520386 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5528078b90 0x7f552807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:45.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.023+0000 7f5543400640 1 -- 172.21.15.42:0/193520386 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f554409b470 con 0x7f554c142f40 2024-09-17T01:43:45.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.023+0000 7f554aa00640 1 --2- 172.21.15.42:0/193520386 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5528078b90 0x7f552807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:45.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.024+0000 7f554aa00640 1 --2- 172.21.15.42:0/193520386 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5528078b90 0x7f552807b0a0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f553c033000 tx=0x7f553c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:45.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.027+0000 7f5543400640 1 -- 172.21.15.42:0/193520386 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5544016030 con 0x7f554c142f40 2024-09-17T01:43:45.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.260+0000 7f5551600640 1 -- 172.21.15.42:0/193520386 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f554c06a170 con 0x7f554c142f40 2024-09-17T01:43:45.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.261+0000 7f5543400640 1 -- 172.21.15.42:0/193520386 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) ==== 95+0+5230 (secure 0 0 0) 0x7f55440632e0 con 0x7f554c142f40 2024-09-17T01:43:45.260 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:45.260 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3131119825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3131119825},{"type":"v1","addr":"172.21.15.43:6837","nonce":3131119825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8368,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1988657429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1988657429},{"type":"v1","addr":"172.21.15.43:6836","nonce":1988657429}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/578887548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":578887548},{"type":"v1","addr":"172.21.15.42:6835","nonce":578887548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:42:57.184518+0000","modified":"2024-09-17T01:43:00.201156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8982":{"gid":8982,"name":"c","rank":0,"incarnation":112,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6834/3811049376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3811049376},{"type":"v1","addr":"172.21.15.42:6834","nonce":3811049376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8982,"qdb_cluster":[8982]},"id":10}]} 2024-09-17T01:43:45.260 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 116 2024-09-17T01:43:45.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.263+0000 7f5551600640 1 -- 172.21.15.42:0/193520386 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5528078b90 msgr2=0x7f552807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:45.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.263+0000 7f5551600640 1 --2- 172.21.15.42:0/193520386 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5528078b90 0x7f552807b0a0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f553c033000 tx=0x7f553c004730 comp rx=0 tx=0).stop 2024-09-17T01:43:45.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.263+0000 7f5551600640 1 -- 172.21.15.42:0/193520386 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f554c142f40 msgr2=0x7f554c1f5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:45.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.263+0000 7f5551600640 1 --2- 172.21.15.42:0/193520386 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f554c142f40 0x7f554c1f5d80 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f554400e960 tx=0x7f554400ee20 comp rx=0 tx=0).stop 2024-09-17T01:43:45.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.263+0000 7f5551600640 1 -- 172.21.15.42:0/193520386 shutdown_connections 2024-09-17T01:43:45.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.263+0000 7f5551600640 1 --2- 172.21.15.42:0/193520386 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5528078b90 0x7f552807b0a0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.263+0000 7f5551600640 1 --2- 172.21.15.42:0/193520386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f554c0cec40 0x7f554c1e8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.263+0000 7f5551600640 1 --2- 172.21.15.42:0/193520386 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f554c142f40 0x7f554c1f5d80 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.263+0000 7f5551600640 1 --2- 172.21.15.42:0/193520386 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f554c0b3550 0x7f554c1e8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.263+0000 7f5551600640 1 -- 172.21.15.42:0/193520386 >> 172.21.15.42:0/193520386 conn(0x7f554c0b2930 msgr2=0x7f554c15eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:45.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.263+0000 7f5551600640 1 -- 172.21.15.42:0/193520386 shutdown_connections 2024-09-17T01:43:45.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.263+0000 7f5551600640 1 -- 172.21.15.42:0/193520386 wait complete. 2024-09-17T01:43:45.285 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T01:43:45.285 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:43:45.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.513+0000 7ff7f5400640 1 -- 172.21.15.42:0/2489799946 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7f006d260 msgr2=0x7ff7f0152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:45.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.513+0000 7ff7f5400640 1 --2- 172.21.15.42:0/2489799946 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7f006d260 0x7ff7f0152ed0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8005fd0 tx=0x7ff7e802aa90 comp rx=0 tx=0).stop 2024-09-17T01:43:45.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.513+0000 7ff7f5400640 1 -- 172.21.15.42:0/2489799946 shutdown_connections 2024-09-17T01:43:45.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.513+0000 7ff7f5400640 1 --2- 172.21.15.42:0/2489799946 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7f006d260 0x7ff7f0152ed0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.513+0000 7ff7f5400640 1 --2- 172.21.15.42:0/2489799946 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff7f00cf7c0 0x7ff7f006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.513+0000 7ff7f5400640 1 -- 172.21.15.42:0/2489799946 >> 172.21.15.42:0/2489799946 conn(0x7ff7f00b25f0 msgr2=0x7ff7f00d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:45.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.513+0000 7ff7f5400640 1 -- 172.21.15.42:0/2489799946 shutdown_connections 2024-09-17T01:43:45.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.513+0000 7ff7f5400640 1 -- 172.21.15.42:0/2489799946 wait complete. 2024-09-17T01:43:45.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.515+0000 7ff7f5400640 1 Processor -- start 2024-09-17T01:43:45.514 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.515+0000 7ff7f5400640 1 -- start start 2024-09-17T01:43:45.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.517+0000 7ff7f5400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7f006d260 0x7ff7f01543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:45.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.517+0000 7ff7f5400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7f00b4be0 0x7ff7f00b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:45.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.517+0000 7ff7f5400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff7f00cf7c0 0x7ff7f0152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:45.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.517+0000 7ff7f5400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f01538b0 con 0x7ff7f006d260 2024-09-17T01:43:45.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.517+0000 7ff7f5400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f0153730 con 0x7ff7f00b4be0 2024-09-17T01:43:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.517+0000 7ff7f5400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff7f0153a30 con 0x7ff7f00cf7c0 2024-09-17T01:43:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.517+0000 7ff7efe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7f006d260 0x7ff7f01543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.517+0000 7ff7efe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7f006d260 0x7ff7f01543a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59446/0 (socket says 172.21.15.42:59446) 2024-09-17T01:43:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.517+0000 7ff7efe00640 1 -- 172.21.15.42:0/2810672077 learned_addr learned my addr 172.21.15.42:0/2810672077 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.517+0000 7ff7e7e00640 1 --2- 172.21.15.42:0/2810672077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7f00b4be0 0x7ff7f00b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.517+0000 7ff7f4a00640 1 --2- 172.21.15.42:0/2810672077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff7f00cf7c0 0x7ff7f0152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.518+0000 7ff7efe00640 1 -- 172.21.15.42:0/2810672077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff7f00cf7c0 msgr2=0x7ff7f0152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.518+0000 7ff7efe00640 1 --2- 172.21.15.42:0/2810672077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff7f00cf7c0 0x7ff7f0152300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.518+0000 7ff7efe00640 1 -- 172.21.15.42:0/2810672077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7f00b4be0 msgr2=0x7ff7f00b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.518+0000 7ff7efe00640 1 --2- 172.21.15.42:0/2810672077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7f00b4be0 0x7ff7f00b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.518+0000 7ff7efe00640 1 -- 172.21.15.42:0/2810672077 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f0072260 con 0x7ff7f006d260 2024-09-17T01:43:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.518+0000 7ff7efe00640 1 --2- 172.21.15.42:0/2810672077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7f006d260 0x7ff7f01543a0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000c3a0 tx=0x7ff7e000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:45.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.518+0000 7ff7ecc00640 1 -- 172.21.15.42:0/2810672077 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0017070 con 0x7ff7f006d260 2024-09-17T01:43:45.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.518+0000 7ff7ecc00640 1 -- 172.21.15.42:0/2810672077 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7e00053c0 con 0x7ff7f006d260 2024-09-17T01:43:45.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.518+0000 7ff7f5400640 1 -- 172.21.15.42:0/2810672077 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f0072540 con 0x7ff7f006d260 2024-09-17T01:43:45.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.518+0000 7ff7ecc00640 1 -- 172.21.15.42:0/2810672077 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0003850 con 0x7ff7f006d260 2024-09-17T01:43:45.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.518+0000 7ff7f5400640 1 -- 172.21.15.42:0/2810672077 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f0074110 con 0x7ff7f006d260 2024-09-17T01:43:45.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.519+0000 7ff7f5400640 1 -- 172.21.15.42:0/2810672077 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f00b1aa0 con 0x7ff7f006d260 2024-09-17T01:43:45.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.521+0000 7ff7ecc00640 1 -- 172.21.15.42:0/2810672077 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff7e001a070 con 0x7ff7f006d260 2024-09-17T01:43:45.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.522+0000 7ff7ecc00640 1 --2- 172.21.15.42:0/2810672077 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff7cc078b90 0x7ff7cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:45.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.522+0000 7ff7ecc00640 1 -- 172.21.15.42:0/2810672077 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7ff7e009a0d0 con 0x7ff7f006d260 2024-09-17T01:43:45.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.523+0000 7ff7e7e00640 1 --2- 172.21.15.42:0/2810672077 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff7cc078b90 0x7ff7cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:45.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.524+0000 7ff7e7e00640 1 --2- 172.21.15.42:0/2810672077 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff7cc078b90 0x7ff7cc07b0a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff7f015bf00 tx=0x7ff7d8005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:45.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.527+0000 7ff7ecc00640 1 -- 172.21.15.42:0/2810672077 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff7f006d670 con 0x7ff7f006d260 2024-09-17T01:43:45.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.798+0000 7ff7f5400640 1 -- 172.21.15.42:0/2810672077 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff7f0069870 con 0x7ff7f006d260 2024-09-17T01:43:45.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.799+0000 7ff7ecc00640 1 -- 172.21.15.42:0/2810672077 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1672 (secure 0 0 0) 0x7ff7e0061e20 con 0x7ff7f006d260 2024-09-17T01:43:45.798 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:45.798 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":726,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":147,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1077031982,"bytes_used":2600460288,"bytes_avail":770493652992,"bytes_total":773094113280,"write_bytes_sec":23287,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":8982}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-17T01:43:35.179714+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:43:45.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.801+0000 7ff7f5400640 1 -- 172.21.15.42:0/2810672077 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff7cc078b90 msgr2=0x7ff7cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:45.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.801+0000 7ff7f5400640 1 --2- 172.21.15.42:0/2810672077 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff7cc078b90 0x7ff7cc07b0a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff7f015bf00 tx=0x7ff7d8005f90 comp rx=0 tx=0).stop 2024-09-17T01:43:45.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.801+0000 7ff7f5400640 1 -- 172.21.15.42:0/2810672077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7f006d260 msgr2=0x7ff7f01543a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:45.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.801+0000 7ff7f5400640 1 --2- 172.21.15.42:0/2810672077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7f006d260 0x7ff7f01543a0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000c3a0 tx=0x7ff7e000c860 comp rx=0 tx=0).stop 2024-09-17T01:43:45.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.801+0000 7ff7f5400640 1 -- 172.21.15.42:0/2810672077 shutdown_connections 2024-09-17T01:43:45.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.801+0000 7ff7f5400640 1 --2- 172.21.15.42:0/2810672077 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff7cc078b90 0x7ff7cc07b0a0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.801+0000 7ff7f5400640 1 --2- 172.21.15.42:0/2810672077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7f00b4be0 0x7ff7f00b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.801+0000 7ff7f5400640 1 --2- 172.21.15.42:0/2810672077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff7f00cf7c0 0x7ff7f0152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.801+0000 7ff7f5400640 1 --2- 172.21.15.42:0/2810672077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7f006d260 0x7ff7f01543a0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.801+0000 7ff7f5400640 1 -- 172.21.15.42:0/2810672077 >> 172.21.15.42:0/2810672077 conn(0x7ff7f00b25f0 msgr2=0x7ff7f00d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:45.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.801+0000 7ff7f5400640 1 -- 172.21.15.42:0/2810672077 shutdown_connections 2024-09-17T01:43:45.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:45.801+0000 7ff7f5400640 1 -- 172.21.15.42:0/2810672077 wait complete. 2024-09-17T01:43:45.822 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-17T01:43:46.823 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:43:47.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.061+0000 7f0d3d800640 1 -- 172.21.15.42:0/122744220 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d3815f480 msgr2=0x7f0d3815f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:47.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.061+0000 7f0d3d800640 1 --2- 172.21.15.42:0/122744220 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d3815f480 0x7f0d3815f890 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f0d38071ef0 tx=0x7f0d3002aac0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.062+0000 7f0d3d800640 1 -- 172.21.15.42:0/122744220 shutdown_connections 2024-09-17T01:43:47.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.062+0000 7f0d3d800640 1 --2- 172.21.15.42:0/122744220 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d3815f480 0x7f0d3815f890 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.062+0000 7f0d3d800640 1 --2- 172.21.15.42:0/122744220 >> v2:172.21.15.43:3300/0 conn(0x7f0d3815cb80 0x7f0d38152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.062+0000 7f0d3d800640 1 -- 172.21.15.42:0/122744220 >> 172.21.15.42:0/122744220 conn(0x7f0d380b2930 msgr2=0x7f0d3806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:47.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.062+0000 7f0d3d800640 1 -- 172.21.15.42:0/122744220 shutdown_connections 2024-09-17T01:43:47.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.062+0000 7f0d3d800640 1 -- 172.21.15.42:0/122744220 wait complete. 2024-09-17T01:43:47.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.064+0000 7f0d3d800640 1 Processor -- start 2024-09-17T01:43:47.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.064+0000 7f0d3d800640 1 -- start start 2024-09-17T01:43:47.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.065+0000 7f0d3d800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0d3806d430 0x7f0d38158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:47.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.065+0000 7f0d3d800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d3815cb80 0x7f0d3814ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:47.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.066+0000 7f0d3d800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d3815f480 0x7f0d380ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:47.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.066+0000 7f0d3d800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0d380737e0 con 0x7f0d3815f480 2024-09-17T01:43:47.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.066+0000 7f0d3d800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0d38073660 con 0x7f0d3815cb80 2024-09-17T01:43:47.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.066+0000 7f0d3d800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0d38073960 con 0x7f0d3806d430 2024-09-17T01:43:47.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.066+0000 7f0d37400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d3815f480 0x7f0d380ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:47.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.066+0000 7f0d37400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d3815f480 0x7f0d380ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50078/0 (socket says 172.21.15.42:50078) 2024-09-17T01:43:47.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.066+0000 7f0d37400640 1 -- 172.21.15.42:0/2314576897 learned_addr learned my addr 172.21.15.42:0/2314576897 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:47.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.066+0000 7f0d36a00640 1 --2- 172.21.15.42:0/2314576897 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0d3806d430 0x7f0d38158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:47.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.066+0000 7f0d2fe00640 1 --2- 172.21.15.42:0/2314576897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d3815cb80 0x7f0d3814ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:47.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.066+0000 7f0d37400640 1 -- 172.21.15.42:0/2314576897 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0d3806d430 msgr2=0x7f0d38158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:47.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.066+0000 7f0d37400640 1 --2- 172.21.15.42:0/2314576897 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0d3806d430 0x7f0d38158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.066+0000 7f0d37400640 1 -- 172.21.15.42:0/2314576897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d3815cb80 msgr2=0x7f0d3814ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:47.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.066+0000 7f0d37400640 1 --2- 172.21.15.42:0/2314576897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d3815cb80 0x7f0d3814ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.066+0000 7f0d37400640 1 -- 172.21.15.42:0/2314576897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d381f9e80 con 0x7f0d3815f480 2024-09-17T01:43:47.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.067+0000 7f0d37400640 1 --2- 172.21.15.42:0/2314576897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d3815f480 0x7f0d380ae8a0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f0d30009d60 tx=0x7f0d30003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:47.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.067+0000 7f0d2ea00640 1 -- 172.21.15.42:0/2314576897 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d30044070 con 0x7f0d3815f480 2024-09-17T01:43:47.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.067+0000 7f0d2ea00640 1 -- 172.21.15.42:0/2314576897 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d30004250 con 0x7f0d3815f480 2024-09-17T01:43:47.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.067+0000 7f0d2ea00640 1 -- 172.21.15.42:0/2314576897 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d30004680 con 0x7f0d3815f480 2024-09-17T01:43:47.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.067+0000 7f0d3d800640 1 -- 172.21.15.42:0/2314576897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d381564e0 con 0x7f0d3815f480 2024-09-17T01:43:47.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.067+0000 7f0d3d800640 1 -- 172.21.15.42:0/2314576897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d381f90c0 con 0x7f0d3815f480 2024-09-17T01:43:47.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.068+0000 7f0d3d800640 1 -- 172.21.15.42:0/2314576897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d38073e80 con 0x7f0d3815f480 2024-09-17T01:43:47.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.069+0000 7f0d2ea00640 1 -- 172.21.15.42:0/2314576897 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0d30036400 con 0x7f0d3815f480 2024-09-17T01:43:47.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.070+0000 7f0d2ea00640 1 --2- 172.21.15.42:0/2314576897 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0d14078b90 0x7f0d1407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:47.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.070+0000 7f0d2ea00640 1 -- 172.21.15.42:0/2314576897 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f0d300bb3a0 con 0x7f0d3815f480 2024-09-17T01:43:47.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.071+0000 7f0d36a00640 1 --2- 172.21.15.42:0/2314576897 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0d14078b90 0x7f0d1407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:47.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.071+0000 7f0d36a00640 1 --2- 172.21.15.42:0/2314576897 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0d14078b90 0x7f0d1407b0a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f0d28005fd0 tx=0x7f0d2800b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:47.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.074+0000 7f0d2ea00640 1 -- 172.21.15.42:0/2314576897 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0d30032030 con 0x7f0d3815f480 2024-09-17T01:43:47.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.311+0000 7f0d3d800640 1 -- 172.21.15.42:0/2314576897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d38158760 con 0x7f0d3815f480 2024-09-17T01:43:47.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.311+0000 7f0d2ea00640 1 -- 172.21.15.42:0/2314576897 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) ==== 95+0+5230 (secure 0 0 0) 0x7f0d30004820 con 0x7f0d3815f480 2024-09-17T01:43:47.310 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:47.311 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3131119825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3131119825},{"type":"v1","addr":"172.21.15.43:6837","nonce":3131119825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8368,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1988657429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1988657429},{"type":"v1","addr":"172.21.15.43:6836","nonce":1988657429}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/578887548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":578887548},{"type":"v1","addr":"172.21.15.42:6835","nonce":578887548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:42:57.184518+0000","modified":"2024-09-17T01:43:00.201156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8982":{"gid":8982,"name":"c","rank":0,"incarnation":112,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6834/3811049376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3811049376},{"type":"v1","addr":"172.21.15.42:6834","nonce":3811049376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8982,"qdb_cluster":[8982]},"id":10}]} 2024-09-17T01:43:47.311 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 116 2024-09-17T01:43:47.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.314+0000 7f0d3d800640 1 -- 172.21.15.42:0/2314576897 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0d14078b90 msgr2=0x7f0d1407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:47.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.314+0000 7f0d3d800640 1 --2- 172.21.15.42:0/2314576897 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0d14078b90 0x7f0d1407b0a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f0d28005fd0 tx=0x7f0d2800b2e0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.314+0000 7f0d3d800640 1 -- 172.21.15.42:0/2314576897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d3815f480 msgr2=0x7f0d380ae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:47.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.314+0000 7f0d3d800640 1 --2- 172.21.15.42:0/2314576897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d3815f480 0x7f0d380ae8a0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f0d30009d60 tx=0x7f0d30003f10 comp rx=0 tx=0).stop 2024-09-17T01:43:47.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.314+0000 7f0d3d800640 1 -- 172.21.15.42:0/2314576897 shutdown_connections 2024-09-17T01:43:47.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.314+0000 7f0d3d800640 1 --2- 172.21.15.42:0/2314576897 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0d14078b90 0x7f0d1407b0a0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.314+0000 7f0d3d800640 1 --2- 172.21.15.42:0/2314576897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d3815cb80 0x7f0d3814ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.314+0000 7f0d3d800640 1 --2- 172.21.15.42:0/2314576897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0d3815f480 0x7f0d380ae8a0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.314+0000 7f0d3d800640 1 --2- 172.21.15.42:0/2314576897 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0d3806d430 0x7f0d38158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.314+0000 7f0d3d800640 1 -- 172.21.15.42:0/2314576897 >> 172.21.15.42:0/2314576897 conn(0x7f0d380b2930 msgr2=0x7f0d380ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:47.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.315+0000 7f0d3d800640 1 -- 172.21.15.42:0/2314576897 shutdown_connections 2024-09-17T01:43:47.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.315+0000 7f0d3d800640 1 -- 172.21.15.42:0/2314576897 wait complete. 2024-09-17T01:43:47.338 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T01:43:47.338 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:43:47.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.566+0000 7fdd6d800640 1 -- 172.21.15.42:0/4289627165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd680cf7c0 msgr2=0x7fdd6806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:47.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.566+0000 7fdd6d800640 1 --2- 172.21.15.42:0/4289627165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd680cf7c0 0x7fdd6806cd20 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fdd50009830 tx=0x7fdd5002a510 comp rx=0 tx=0).stop 2024-09-17T01:43:47.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.566+0000 7fdd6d800640 1 -- 172.21.15.42:0/4289627165 shutdown_connections 2024-09-17T01:43:47.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.566+0000 7fdd6d800640 1 --2- 172.21.15.42:0/4289627165 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd6806d260 0x7fdd68152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.566+0000 7fdd6d800640 1 --2- 172.21.15.42:0/4289627165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd680cf7c0 0x7fdd6806cd20 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.566+0000 7fdd6d800640 1 -- 172.21.15.42:0/4289627165 >> 172.21.15.42:0/4289627165 conn(0x7fdd680b25f0 msgr2=0x7fdd680d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:47.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.566+0000 7fdd6d800640 1 -- 172.21.15.42:0/4289627165 shutdown_connections 2024-09-17T01:43:47.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.566+0000 7fdd6d800640 1 -- 172.21.15.42:0/4289627165 wait complete. 2024-09-17T01:43:47.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.568+0000 7fdd6d800640 1 Processor -- start 2024-09-17T01:43:47.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.569+0000 7fdd6d800640 1 -- start start 2024-09-17T01:43:47.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.570+0000 7fdd6d800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd6806d260 0x7fdd68072420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:47.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.570+0000 7fdd6d800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd680b4be0 0x7fdd681e4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:47.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.570+0000 7fdd6d800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd680cf7c0 0x7fdd68074690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:47.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.570+0000 7fdd6d800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdd68153850 con 0x7fdd680cf7c0 2024-09-17T01:43:47.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.570+0000 7fdd6d800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdd681536d0 con 0x7fdd6806d260 2024-09-17T01:43:47.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.570+0000 7fdd6d800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fdd681539d0 con 0x7fdd680b4be0 2024-09-17T01:43:47.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.570+0000 7fdd6ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd680cf7c0 0x7fdd68074690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:47.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.570+0000 7fdd6ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd680cf7c0 0x7fdd68074690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50090/0 (socket says 172.21.15.42:50090) 2024-09-17T01:43:47.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.570+0000 7fdd6ce00640 1 -- 172.21.15.42:0/3806011312 learned_addr learned my addr 172.21.15.42:0/3806011312 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:47.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.570+0000 7fdd5fe00640 1 --2- 172.21.15.42:0/3806011312 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd680b4be0 0x7fdd681e4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:47.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.570+0000 7fdd67e00640 1 --2- 172.21.15.42:0/3806011312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd6806d260 0x7fdd68072420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:47.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.571+0000 7fdd6ce00640 1 -- 172.21.15.42:0/3806011312 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd680b4be0 msgr2=0x7fdd681e4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:47.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.571+0000 7fdd6ce00640 1 --2- 172.21.15.42:0/3806011312 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd680b4be0 0x7fdd681e4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.571+0000 7fdd6ce00640 1 -- 172.21.15.42:0/3806011312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd6806d260 msgr2=0x7fdd68072420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:47.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.571+0000 7fdd6ce00640 1 --2- 172.21.15.42:0/3806011312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd6806d260 0x7fdd68072420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.571+0000 7fdd6ce00640 1 -- 172.21.15.42:0/3806011312 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd68141750 con 0x7fdd680cf7c0 2024-09-17T01:43:47.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.571+0000 7fdd6ce00640 1 --2- 172.21.15.42:0/3806011312 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd680cf7c0 0x7fdd68074690 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fdd6000ea40 tx=0x7fdd6000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:47.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.571+0000 7fdd64c00640 1 -- 172.21.15.42:0/3806011312 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6000ce40 con 0x7fdd680cf7c0 2024-09-17T01:43:47.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.571+0000 7fdd64c00640 1 -- 172.21.15.42:0/3806011312 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd60004c10 con 0x7fdd680cf7c0 2024-09-17T01:43:47.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.571+0000 7fdd64c00640 1 -- 172.21.15.42:0/3806011312 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd60005020 con 0x7fdd680cf7c0 2024-09-17T01:43:47.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.572+0000 7fdd6d800640 1 -- 172.21.15.42:0/3806011312 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd6813ed90 con 0x7fdd680cf7c0 2024-09-17T01:43:47.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.572+0000 7fdd6d800640 1 -- 172.21.15.42:0/3806011312 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd6813f350 con 0x7fdd680cf7c0 2024-09-17T01:43:47.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.573+0000 7fdd6d800640 1 -- 172.21.15.42:0/3806011312 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd68152ed0 con 0x7fdd680cf7c0 2024-09-17T01:43:47.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.574+0000 7fdd64c00640 1 -- 172.21.15.42:0/3806011312 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdd600051c0 con 0x7fdd680cf7c0 2024-09-17T01:43:47.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.575+0000 7fdd64c00640 1 --2- 172.21.15.42:0/3806011312 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdd44078b90 0x7fdd4407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:47.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.575+0000 7fdd64c00640 1 -- 172.21.15.42:0/3806011312 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fdd6009ba70 con 0x7fdd680cf7c0 2024-09-17T01:43:47.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.576+0000 7fdd67e00640 1 --2- 172.21.15.42:0/3806011312 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdd44078b90 0x7fdd4407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:47.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.576+0000 7fdd67e00640 1 --2- 172.21.15.42:0/3806011312 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdd44078b90 0x7fdd4407b0a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdd58007d60 tx=0x7fdd58007cf0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:47.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.579+0000 7fdd64c00640 1 -- 172.21.15.42:0/3806011312 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdd600637c0 con 0x7fdd680cf7c0 2024-09-17T01:43:47.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.850+0000 7fdd6d800640 1 -- 172.21.15.42:0/3806011312 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fdd6815bf50 con 0x7fdd680cf7c0 2024-09-17T01:43:47.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.851+0000 7fdd64c00640 1 -- 172.21.15.42:0/3806011312 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1614 (secure 0 0 0) 0x7fdd600681f0 con 0x7fdd680cf7c0 2024-09-17T01:43:47.850 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:47.850 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":728,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":147,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1077039674,"bytes_used":2600476672,"bytes_avail":770493636608,"bytes_total":773094113280,"write_bytes_sec":682,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":8982}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-09-17T01:43:45.183247+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:43:47.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.853+0000 7fdd6d800640 1 -- 172.21.15.42:0/3806011312 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdd44078b90 msgr2=0x7fdd4407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:47.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.853+0000 7fdd6d800640 1 --2- 172.21.15.42:0/3806011312 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdd44078b90 0x7fdd4407b0a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdd58007d60 tx=0x7fdd58007cf0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.853+0000 7fdd6d800640 1 -- 172.21.15.42:0/3806011312 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd680cf7c0 msgr2=0x7fdd68074690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:47.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.853+0000 7fdd6d800640 1 --2- 172.21.15.42:0/3806011312 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd680cf7c0 0x7fdd68074690 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fdd6000ea40 tx=0x7fdd6000ef00 comp rx=0 tx=0).stop 2024-09-17T01:43:47.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.853+0000 7fdd6d800640 1 -- 172.21.15.42:0/3806011312 shutdown_connections 2024-09-17T01:43:47.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.853+0000 7fdd6d800640 1 --2- 172.21.15.42:0/3806011312 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdd44078b90 0x7fdd4407b0a0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.853+0000 7fdd6d800640 1 --2- 172.21.15.42:0/3806011312 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd680cf7c0 0x7fdd68074690 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.853+0000 7fdd6d800640 1 --2- 172.21.15.42:0/3806011312 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd680b4be0 0x7fdd681e4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.853+0000 7fdd6d800640 1 --2- 172.21.15.42:0/3806011312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd6806d260 0x7fdd68072420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.853+0000 7fdd6d800640 1 -- 172.21.15.42:0/3806011312 >> 172.21.15.42:0/3806011312 conn(0x7fdd680b25f0 msgr2=0x7fdd680ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:47.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.853+0000 7fdd6d800640 1 -- 172.21.15.42:0/3806011312 shutdown_connections 2024-09-17T01:43:47.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:47.854+0000 7fdd6d800640 1 -- 172.21.15.42:0/3806011312 wait complete. 2024-09-17T01:43:47.876 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T01:43:47.876 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:43:47.876 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:43:47.964 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:43:48.065 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:43:48.065 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:43:48.065 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:43:48.065 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:43:48.101 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:43:48.101 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:43:48.177 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T01:43:48.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.446+0000 7fd21b200640 1 -- 172.21.15.42:0/3647880106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd21c15ea80 msgr2=0x7fd21c0d1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:48.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.446+0000 7fd21b200640 1 --2- 172.21.15.42:0/3647880106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd21c15ea80 0x7fd21c0d1370 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fd21c162480 tx=0x7fd20c02a590 comp rx=0 tx=0).stop 2024-09-17T01:43:48.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.446+0000 7fd21b200640 1 -- 172.21.15.42:0/3647880106 shutdown_connections 2024-09-17T01:43:48.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.446+0000 7fd21b200640 1 --2- 172.21.15.42:0/3647880106 >> v2:172.21.15.43:3300/0 conn(0x7fd21c0d18b0 0x7fd21c0d2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:48.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.446+0000 7fd21b200640 1 --2- 172.21.15.42:0/3647880106 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd21c0d2d80 0x7fd21c0b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:48.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.446+0000 7fd21b200640 1 --2- 172.21.15.42:0/3647880106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd21c15ea80 0x7fd21c0d1370 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:48.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.446+0000 7fd21b200640 1 -- 172.21.15.42:0/3647880106 >> 172.21.15.42:0/3647880106 conn(0x7fd21c06cf00 msgr2=0x7fd21c06d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:48.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.446+0000 7fd21b200640 1 -- 172.21.15.42:0/3647880106 shutdown_connections 2024-09-17T01:43:48.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.446+0000 7fd21b200640 1 -- 172.21.15.42:0/3647880106 wait complete. 2024-09-17T01:43:48.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.448+0000 7fd21b200640 1 Processor -- start 2024-09-17T01:43:48.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.448+0000 7fd21b200640 1 -- start start 2024-09-17T01:43:48.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.450+0000 7fd21b200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd21c0d18b0 0x7fd21c1f59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:48.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.450+0000 7fd21b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd21c0d2d80 0x7fd21c158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:48.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.450+0000 7fd21b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd21c15ea80 0x7fd21c157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:48.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.450+0000 7fd21b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c0b6920 con 0x7fd21c15ea80 2024-09-17T01:43:48.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.450+0000 7fd21b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c0b67a0 con 0x7fd21c0d2d80 2024-09-17T01:43:48.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.450+0000 7fd21b200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd21c0b6aa0 con 0x7fd21c0d18b0 2024-09-17T01:43:48.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.450+0000 7fd21a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd21c15ea80 0x7fd21c157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:48.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.450+0000 7fd21a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd21c15ea80 0x7fd21c157820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50100/0 (socket says 172.21.15.42:50100) 2024-09-17T01:43:48.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.450+0000 7fd21a800640 1 -- 172.21.15.42:0/195902426 learned_addr learned my addr 172.21.15.42:0/195902426 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:48.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.450+0000 7fd219400640 1 --2- 172.21.15.42:0/195902426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd21c0d2d80 0x7fd21c158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:48.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.450+0000 7fd219e00640 1 --2- 172.21.15.42:0/195902426 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd21c0d18b0 0x7fd21c1f59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:48.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.450+0000 7fd21a800640 1 -- 172.21.15.42:0/195902426 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd21c0d18b0 msgr2=0x7fd21c1f59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:48.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.450+0000 7fd21a800640 1 --2- 172.21.15.42:0/195902426 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd21c0d18b0 0x7fd21c1f59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:48.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.450+0000 7fd21a800640 1 -- 172.21.15.42:0/195902426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd21c0d2d80 msgr2=0x7fd21c158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:48.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.450+0000 7fd21a800640 1 --2- 172.21.15.42:0/195902426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd21c0d2d80 0x7fd21c158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:48.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.450+0000 7fd21a800640 1 -- 172.21.15.42:0/195902426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c15b620 con 0x7fd21c15ea80 2024-09-17T01:43:48.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.451+0000 7fd21a800640 1 --2- 172.21.15.42:0/195902426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd21c15ea80 0x7fd21c157820 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fd21400d9a0 tx=0x7fd21400de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:48.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.451+0000 7fd212000640 1 -- 172.21.15.42:0/195902426 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214017070 con 0x7fd21c15ea80 2024-09-17T01:43:48.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.451+0000 7fd212000640 1 -- 172.21.15.42:0/195902426 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd21400be00 con 0x7fd21c15ea80 2024-09-17T01:43:48.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.451+0000 7fd212000640 1 -- 172.21.15.42:0/195902426 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214003bd0 con 0x7fd21c15ea80 2024-09-17T01:43:48.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.451+0000 7fd21b200640 1 -- 172.21.15.42:0/195902426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd21c15b900 con 0x7fd21c15ea80 2024-09-17T01:43:48.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.451+0000 7fd21b200640 1 -- 172.21.15.42:0/195902426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd21c15bec0 con 0x7fd21c15ea80 2024-09-17T01:43:48.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.452+0000 7fd21b200640 1 -- 172.21.15.42:0/195902426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd21c15b390 con 0x7fd21c15ea80 2024-09-17T01:43:48.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.453+0000 7fd212000640 1 -- 172.21.15.42:0/195902426 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd214010460 con 0x7fd21c15ea80 2024-09-17T01:43:48.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.454+0000 7fd212000640 1 --2- 172.21.15.42:0/195902426 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd1fc078bc0 0x7fd1fc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:48.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.454+0000 7fd212000640 1 -- 172.21.15.42:0/195902426 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7fd21409b070 con 0x7fd21c15ea80 2024-09-17T01:43:48.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.455+0000 7fd219e00640 1 --2- 172.21.15.42:0/195902426 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd1fc078bc0 0x7fd1fc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:48.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.456+0000 7fd219e00640 1 --2- 172.21.15.42:0/195902426 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd1fc078bc0 0x7fd1fc07b0d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd20c033000 tx=0x7fd20c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:48.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.459+0000 7fd212000640 1 -- 172.21.15.42:0/195902426 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd214062e50 con 0x7fd21c15ea80 2024-09-17T01:43:48.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.665+0000 7fd21b200640 1 -- 172.21.15.42:0/195902426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd21c0b6050 con 0x7fd21c15ea80 2024-09-17T01:43:48.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.665+0000 7fd212000640 1 -- 172.21.15.42:0/195902426 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v147) ==== 80+0+0 (secure 0 0 0) 0x7fd214067880 con 0x7fd21c15ea80 2024-09-17T01:43:48.665 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-17T01:43:48.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.668+0000 7fd21b200640 1 -- 172.21.15.42:0/195902426 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd1fc078bc0 msgr2=0x7fd1fc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:48.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.668+0000 7fd21b200640 1 --2- 172.21.15.42:0/195902426 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd1fc078bc0 0x7fd1fc07b0d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd20c033000 tx=0x7fd20c004730 comp rx=0 tx=0).stop 2024-09-17T01:43:48.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.668+0000 7fd21b200640 1 -- 172.21.15.42:0/195902426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd21c15ea80 msgr2=0x7fd21c157820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:48.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.668+0000 7fd21b200640 1 --2- 172.21.15.42:0/195902426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd21c15ea80 0x7fd21c157820 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fd21400d9a0 tx=0x7fd21400de60 comp rx=0 tx=0).stop 2024-09-17T01:43:48.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.668+0000 7fd21b200640 1 -- 172.21.15.42:0/195902426 shutdown_connections 2024-09-17T01:43:48.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.668+0000 7fd21b200640 1 --2- 172.21.15.42:0/195902426 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd1fc078bc0 0x7fd1fc07b0d0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:48.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.668+0000 7fd21b200640 1 --2- 172.21.15.42:0/195902426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd21c0d2d80 0x7fd21c158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:48.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.668+0000 7fd21b200640 1 --2- 172.21.15.42:0/195902426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd21c15ea80 0x7fd21c157820 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:48.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.668+0000 7fd21b200640 1 --2- 172.21.15.42:0/195902426 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd21c0d18b0 0x7fd21c1f59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:48.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.668+0000 7fd21b200640 1 -- 172.21.15.42:0/195902426 >> 172.21.15.42:0/195902426 conn(0x7fd21c06cf00 msgr2=0x7fd21c0cf5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:48.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.668+0000 7fd21b200640 1 -- 172.21.15.42:0/195902426 shutdown_connections 2024-09-17T01:43:48.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:48.668+0000 7fd21b200640 1 -- 172.21.15.42:0/195902426 wait complete. 2024-09-17T01:43:48.691 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T01:43:48.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:43:48.691 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T01:43:49.377 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:43:49.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:43:49.378 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T01:43:49.414 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:43:49.415 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:43:49.415 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:43:49.452 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:43:49.453 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:43:49.453 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:43:49.453 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:43:49.490 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:43:49.490 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:43:49.491 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:43:49.491 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:43:49.529 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:43:49.529 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:43:49.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.758+0000 7f227b400640 1 -- 172.21.15.42:0/2546502141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f227406d970 msgr2=0x7f227415f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:49.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.758+0000 7f227b400640 1 --2- 172.21.15.42:0/2546502141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f227406d970 0x7f227415f480 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f227406df30 tx=0x7f226c02a970 comp rx=0 tx=0).stop 2024-09-17T01:43:49.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.758+0000 7f227b400640 1 -- 172.21.15.42:0/2546502141 shutdown_connections 2024-09-17T01:43:49.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.758+0000 7f227b400640 1 --2- 172.21.15.42:0/2546502141 >> v2:172.21.15.43:3300/0 conn(0x7f2274152a70 0x7f227406d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:49.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.758+0000 7f227b400640 1 --2- 172.21.15.42:0/2546502141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f227406d970 0x7f227415f480 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:49.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.758+0000 7f227b400640 1 --2- 172.21.15.42:0/2546502141 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f227415cb80 0x7f2274152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:49.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.758+0000 7f227b400640 1 -- 172.21.15.42:0/2546502141 >> 172.21.15.42:0/2546502141 conn(0x7f22740b2930 msgr2=0x7f227406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:49.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.758+0000 7f227b400640 1 -- 172.21.15.42:0/2546502141 shutdown_connections 2024-09-17T01:43:49.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.758+0000 7f227b400640 1 -- 172.21.15.42:0/2546502141 wait complete. 2024-09-17T01:43:49.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.760+0000 7f227b400640 1 Processor -- start 2024-09-17T01:43:49.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.761+0000 7f227b400640 1 -- start start 2024-09-17T01:43:49.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.762+0000 7f227b400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f227406d970 0x7f2274154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:49.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.762+0000 7f227b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2274152a70 0x7f22740aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:49.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.762+0000 7f227b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f227415cb80 0x7f2274139bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:49.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.762+0000 7f227b400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f22740735d0 con 0x7f2274152a70 2024-09-17T01:43:49.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.762+0000 7f227b400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2274073450 con 0x7f227415cb80 2024-09-17T01:43:49.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.762+0000 7f227b400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2274073750 con 0x7f227406d970 2024-09-17T01:43:49.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.762+0000 7f2273e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2274152a70 0x7f22740aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:49.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.762+0000 7f2273e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2274152a70 0x7f22740aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50126/0 (socket says 172.21.15.42:50126) 2024-09-17T01:43:49.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.762+0000 7f2273e00640 1 -- 172.21.15.42:0/878295886 learned_addr learned my addr 172.21.15.42:0/878295886 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:49.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.762+0000 7f2279400640 1 --2- 172.21.15.42:0/878295886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f227415cb80 0x7f2274139bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:49.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.762+0000 7f2278a00640 1 --2- 172.21.15.42:0/878295886 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f227406d970 0x7f2274154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:49.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.763+0000 7f2273e00640 1 -- 172.21.15.42:0/878295886 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f227406d970 msgr2=0x7f2274154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:49.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.763+0000 7f2273e00640 1 --2- 172.21.15.42:0/878295886 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f227406d970 0x7f2274154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:49.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.763+0000 7f2273e00640 1 -- 172.21.15.42:0/878295886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f227415cb80 msgr2=0x7f2274139bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:49.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.763+0000 7f2273e00640 1 --2- 172.21.15.42:0/878295886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f227415cb80 0x7f2274139bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:49.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.763+0000 7f2273e00640 1 -- 172.21.15.42:0/878295886 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22740af320 con 0x7f2274152a70 2024-09-17T01:43:49.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.763+0000 7f2273e00640 1 --2- 172.21.15.42:0/878295886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2274152a70 0x7f22740aede0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f226000e790 tx=0x7f226000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:49.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.763+0000 7f2270c00640 1 -- 172.21.15.42:0/878295886 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226000eea0 con 0x7f2274152a70 2024-09-17T01:43:49.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.763+0000 7f2270c00640 1 -- 172.21.15.42:0/878295886 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f226000cdb0 con 0x7f2274152a70 2024-09-17T01:43:49.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.764+0000 7f227b400640 1 -- 172.21.15.42:0/878295886 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22741552f0 con 0x7f2274152a70 2024-09-17T01:43:49.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.764+0000 7f2270c00640 1 -- 172.21.15.42:0/878295886 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2260010690 con 0x7f2274152a70 2024-09-17T01:43:49.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.764+0000 7f227b400640 1 -- 172.21.15.42:0/878295886 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2274137c50 con 0x7f2274152a70 2024-09-17T01:43:49.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.765+0000 7f227b400640 1 -- 172.21.15.42:0/878295886 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2274155060 con 0x7f2274152a70 2024-09-17T01:43:49.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.766+0000 7f2270c00640 1 -- 172.21.15.42:0/878295886 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2260010830 con 0x7f2274152a70 2024-09-17T01:43:49.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.768+0000 7f2270c00640 1 --2- 172.21.15.42:0/878295886 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2254078b90 0x7f225407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:49.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.768+0000 7f2270c00640 1 -- 172.21.15.42:0/878295886 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 5709+0+0 (secure 0 0 0) 0x7f226009b6f0 con 0x7f2274152a70 2024-09-17T01:43:49.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.768+0000 7f2278a00640 1 --2- 172.21.15.42:0/878295886 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2254078b90 0x7f225407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:49.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.769+0000 7f2278a00640 1 --2- 172.21.15.42:0/878295886 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2254078b90 0x7f225407b0a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f2268009ab0 tx=0x7f2268005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:49.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:49.773+0000 7f2270c00640 1 -- 172.21.15.42:0/878295886 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f22600634d0 con 0x7f2274152a70 2024-09-17T01:43:50.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.011+0000 7f227b400640 1 -- 172.21.15.42:0/878295886 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2274073c60 con 0x7f2274152a70 2024-09-17T01:43:50.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.012+0000 7f2270c00640 1 -- 172.21.15.42:0/878295886 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) ==== 95+0+5230 (secure 0 0 0) 0x7f2260067f00 con 0x7f2274152a70 2024-09-17T01:43:50.011 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:50.011 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3131119825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3131119825},{"type":"v1","addr":"172.21.15.43:6837","nonce":3131119825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8368,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1988657429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1988657429},{"type":"v1","addr":"172.21.15.43:6836","nonce":1988657429}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/578887548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":578887548},{"type":"v1","addr":"172.21.15.42:6835","nonce":578887548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:42:57.184518+0000","modified":"2024-09-17T01:43:00.201156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8982":{"gid":8982,"name":"c","rank":0,"incarnation":112,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6834/3811049376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3811049376},{"type":"v1","addr":"172.21.15.42:6834","nonce":3811049376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8982,"qdb_cluster":[8982]},"id":10}]} 2024-09-17T01:43:50.011 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 116 2024-09-17T01:43:50.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.014+0000 7f227b400640 1 -- 172.21.15.42:0/878295886 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2254078b90 msgr2=0x7f225407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:50.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.014+0000 7f227b400640 1 --2- 172.21.15.42:0/878295886 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2254078b90 0x7f225407b0a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f2268009ab0 tx=0x7f2268005f90 comp rx=0 tx=0).stop 2024-09-17T01:43:50.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.014+0000 7f227b400640 1 -- 172.21.15.42:0/878295886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2274152a70 msgr2=0x7f22740aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:50.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.014+0000 7f227b400640 1 --2- 172.21.15.42:0/878295886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2274152a70 0x7f22740aede0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f226000e790 tx=0x7f226000ec50 comp rx=0 tx=0).stop 2024-09-17T01:43:50.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.014+0000 7f227b400640 1 -- 172.21.15.42:0/878295886 shutdown_connections 2024-09-17T01:43:50.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.014+0000 7f227b400640 1 --2- 172.21.15.42:0/878295886 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2254078b90 0x7f225407b0a0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:50.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.014+0000 7f227b400640 1 --2- 172.21.15.42:0/878295886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f227415cb80 0x7f2274139bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:50.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.014+0000 7f227b400640 1 --2- 172.21.15.42:0/878295886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2274152a70 0x7f22740aede0 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:50.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.014+0000 7f227b400640 1 --2- 172.21.15.42:0/878295886 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f227406d970 0x7f2274154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:50.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.014+0000 7f227b400640 1 -- 172.21.15.42:0/878295886 >> 172.21.15.42:0/878295886 conn(0x7f22740b2930 msgr2=0x7f227415d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:50.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.015+0000 7f227b400640 1 -- 172.21.15.42:0/878295886 shutdown_connections 2024-09-17T01:43:50.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.015+0000 7f227b400640 1 -- 172.21.15.42:0/878295886 wait complete. 2024-09-17T01:43:50.037 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:43:50.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.265+0000 7f55eec00640 1 -- 172.21.15.42:0/2052675498 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55e8074500 msgr2=0x7f55e806eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:50.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.265+0000 7f55eec00640 1 --2- 172.21.15.42:0/2052675498 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55e8074500 0x7f55e806eec0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f55d4005fd0 tx=0x7f55d402a5d0 comp rx=0 tx=0).stop 2024-09-17T01:43:50.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.265+0000 7f55eec00640 1 -- 172.21.15.42:0/2052675498 shutdown_connections 2024-09-17T01:43:50.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.265+0000 7f55eec00640 1 --2- 172.21.15.42:0/2052675498 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55e8074500 0x7f55e806eec0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:50.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.265+0000 7f55eec00640 1 --2- 172.21.15.42:0/2052675498 >> v2:172.21.15.43:3300/0 conn(0x7f55e80740f0 0x7f55e815f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:50.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.265+0000 7f55eec00640 1 -- 172.21.15.42:0/2052675498 >> 172.21.15.42:0/2052675498 conn(0x7f55e80b2930 msgr2=0x7f55e806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:50.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.265+0000 7f55eec00640 1 -- 172.21.15.42:0/2052675498 shutdown_connections 2024-09-17T01:43:50.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.265+0000 7f55eec00640 1 -- 172.21.15.42:0/2052675498 wait complete. 2024-09-17T01:43:50.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.267+0000 7f55eec00640 1 Processor -- start 2024-09-17T01:43:50.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.267+0000 7f55eec00640 1 -- start start 2024-09-17T01:43:50.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.269+0000 7f55eec00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55e80740f0 0x7f55e815d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:50.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.269+0000 7f55eec00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55e815f740 0x7f55e815ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:50.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.269+0000 7f55eec00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55e806cf00 0x7f55e806d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:50.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.269+0000 7f55eec00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f55e80cef40 con 0x7f55e80740f0 2024-09-17T01:43:50.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.269+0000 7f55eec00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f55e806f6c0 con 0x7f55e815f740 2024-09-17T01:43:50.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.269+0000 7f55eec00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f55e80cf0c0 con 0x7f55e806cf00 2024-09-17T01:43:50.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.269+0000 7f55e7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55e80740f0 0x7f55e815d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:50.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.269+0000 7f55e7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55e80740f0 0x7f55e815d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50132/0 (socket says 172.21.15.42:50132) 2024-09-17T01:43:50.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.269+0000 7f55e7e00640 1 -- 172.21.15.42:0/660510590 learned_addr learned my addr 172.21.15.42:0/660510590 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:50.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.269+0000 7f55e7400640 1 --2- 172.21.15.42:0/660510590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55e815f740 0x7f55e815ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:50.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.269+0000 7f55ecc00640 1 --2- 172.21.15.42:0/660510590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55e806cf00 0x7f55e806d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:50.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.270+0000 7f55e7e00640 1 -- 172.21.15.42:0/660510590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55e806cf00 msgr2=0x7f55e806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:50.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.270+0000 7f55e7e00640 1 --2- 172.21.15.42:0/660510590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55e806cf00 0x7f55e806d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:50.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.270+0000 7f55e7e00640 1 -- 172.21.15.42:0/660510590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55e815f740 msgr2=0x7f55e815ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:50.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.270+0000 7f55e7e00640 1 --2- 172.21.15.42:0/660510590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55e815f740 0x7f55e815ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:50.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.270+0000 7f55e7e00640 1 -- 172.21.15.42:0/660510590 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e815b600 con 0x7f55e80740f0 2024-09-17T01:43:50.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.270+0000 7f55e7e00640 1 --2- 172.21.15.42:0/660510590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55e80740f0 0x7f55e815d320 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f55d800e790 tx=0x7f55d800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:50.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.270+0000 7f55dfe00640 1 -- 172.21.15.42:0/660510590 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d800eea0 con 0x7f55e80740f0 2024-09-17T01:43:50.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.270+0000 7f55dfe00640 1 -- 172.21.15.42:0/660510590 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55d800cdb0 con 0x7f55e80740f0 2024-09-17T01:43:50.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.270+0000 7f55dfe00640 1 -- 172.21.15.42:0/660510590 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d8010690 con 0x7f55e80740f0 2024-09-17T01:43:50.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.270+0000 7f55eec00640 1 -- 172.21.15.42:0/660510590 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e815b8e0 con 0x7f55e80740f0 2024-09-17T01:43:50.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.270+0000 7f55eec00640 1 -- 172.21.15.42:0/660510590 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e815bea0 con 0x7f55e80740f0 2024-09-17T01:43:50.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.271+0000 7f55eec00640 1 -- 172.21.15.42:0/660510590 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e8074500 con 0x7f55e80740f0 2024-09-17T01:43:50.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.273+0000 7f55dfe00640 1 -- 172.21.15.42:0/660510590 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f55d8010830 con 0x7f55e80740f0 2024-09-17T01:43:50.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.274+0000 7f55dfe00640 1 --2- 172.21.15.42:0/660510590 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f55c8078bc0 0x7f55c807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:50.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.274+0000 7f55dfe00640 1 -- 172.21.15.42:0/660510590 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 5767+0+0 (secure 0 0 0) 0x7f55d809b770 con 0x7f55e80740f0 2024-09-17T01:43:50.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.274+0000 7f55e7400640 1 --2- 172.21.15.42:0/660510590 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f55c8078bc0 0x7f55c807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:50.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.275+0000 7f55e7400640 1 --2- 172.21.15.42:0/660510590 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f55c8078bc0 0x7f55c807b0d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f55d4033000 tx=0x7f55d4004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:50.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.278+0000 7f55dfe00640 1 -- 172.21.15.42:0/660510590 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f55d8063480 con 0x7f55e80740f0 2024-09-17T01:43:50.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.508+0000 7f55eec00640 1 -- 172.21.15.42:0/660510590 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55e806a170 con 0x7f55e80740f0 2024-09-17T01:43:50.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.509+0000 7f55dfe00640 1 -- 172.21.15.42:0/660510590 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) ==== 95+0+5230 (secure 0 0 0) 0x7f55d8067eb0 con 0x7f55e80740f0 2024-09-17T01:43:50.508 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:50.508 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3131119825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3131119825},{"type":"v1","addr":"172.21.15.43:6837","nonce":3131119825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8368,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1988657429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1988657429},{"type":"v1","addr":"172.21.15.43:6836","nonce":1988657429}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/578887548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":578887548},{"type":"v1","addr":"172.21.15.42:6835","nonce":578887548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:42:57.184518+0000","modified":"2024-09-17T01:43:00.201156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8982":{"gid":8982,"name":"c","rank":0,"incarnation":112,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6834/3811049376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3811049376},{"type":"v1","addr":"172.21.15.42:6834","nonce":3811049376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8982,"qdb_cluster":[8982]},"id":10}]} 2024-09-17T01:43:50.508 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 116 2024-09-17T01:43:50.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.511+0000 7f55eec00640 1 -- 172.21.15.42:0/660510590 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f55c8078bc0 msgr2=0x7f55c807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:50.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.511+0000 7f55eec00640 1 --2- 172.21.15.42:0/660510590 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f55c8078bc0 0x7f55c807b0d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f55d4033000 tx=0x7f55d4004730 comp rx=0 tx=0).stop 2024-09-17T01:43:50.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.511+0000 7f55eec00640 1 -- 172.21.15.42:0/660510590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55e80740f0 msgr2=0x7f55e815d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:50.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.511+0000 7f55eec00640 1 --2- 172.21.15.42:0/660510590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55e80740f0 0x7f55e815d320 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f55d800e790 tx=0x7f55d800ec50 comp rx=0 tx=0).stop 2024-09-17T01:43:50.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.511+0000 7f55eec00640 1 -- 172.21.15.42:0/660510590 shutdown_connections 2024-09-17T01:43:50.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.511+0000 7f55eec00640 1 --2- 172.21.15.42:0/660510590 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f55c8078bc0 0x7f55c807b0d0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:50.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.511+0000 7f55eec00640 1 --2- 172.21.15.42:0/660510590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f55e815f740 0x7f55e815ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:50.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.511+0000 7f55eec00640 1 --2- 172.21.15.42:0/660510590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55e806cf00 0x7f55e806d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:50.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.511+0000 7f55eec00640 1 --2- 172.21.15.42:0/660510590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55e80740f0 0x7f55e815d320 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:50.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.511+0000 7f55eec00640 1 -- 172.21.15.42:0/660510590 >> 172.21.15.42:0/660510590 conn(0x7f55e80b2930 msgr2=0x7f55e8161200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:50.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.511+0000 7f55eec00640 1 -- 172.21.15.42:0/660510590 shutdown_connections 2024-09-17T01:43:50.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.511+0000 7f55eec00640 1 -- 172.21.15.42:0/660510590 wait complete. 2024-09-17T01:43:50.534 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:43:50.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.764+0000 7f1731800640 1 -- 172.21.15.42:0/248082737 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f172c0b4be0 msgr2=0x7f172c15d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:50.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.764+0000 7f1731800640 1 --2- 172.21.15.42:0/248082737 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f172c0b4be0 0x7f172c15d6b0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f171c005fd0 tx=0x7f171c02a5d0 comp rx=0 tx=0).stop 2024-09-17T01:43:50.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.764+0000 7f1731800640 1 -- 172.21.15.42:0/248082737 shutdown_connections 2024-09-17T01:43:50.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.764+0000 7f1731800640 1 --2- 172.21.15.42:0/248082737 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f172c06d430 0x7f172c152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:50.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.764+0000 7f1731800640 1 --2- 172.21.15.42:0/248082737 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f172c0b4be0 0x7f172c15d6b0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:50.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.764+0000 7f1731800640 1 -- 172.21.15.42:0/248082737 >> 172.21.15.42:0/248082737 conn(0x7f172c0b25f0 msgr2=0x7f172c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:50.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.764+0000 7f1731800640 1 -- 172.21.15.42:0/248082737 shutdown_connections 2024-09-17T01:43:50.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.764+0000 7f1731800640 1 -- 172.21.15.42:0/248082737 wait complete. 2024-09-17T01:43:50.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.766+0000 7f1731800640 1 Processor -- start 2024-09-17T01:43:50.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.766+0000 7f1731800640 1 -- start start 2024-09-17T01:43:50.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.768+0000 7f1731800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f172c0b4be0 0x7f172c0cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:50.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.768+0000 7f1731800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f172c0cf7c0 0x7f172c072c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:50.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.768+0000 7f1731800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f172c1f5420 0x7f172c0c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:50.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.768+0000 7f1731800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f172c153850 con 0x7f172c0b4be0 2024-09-17T01:43:50.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.768+0000 7f1731800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f172c1536d0 con 0x7f172c0cf7c0 2024-09-17T01:43:50.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.768+0000 7f1731800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f172c1539d0 con 0x7f172c1f5420 2024-09-17T01:43:50.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.768+0000 7f172be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f172c0b4be0 0x7f172c0cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:50.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.768+0000 7f172be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f172c0b4be0 0x7f172c0cbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50152/0 (socket says 172.21.15.42:50152) 2024-09-17T01:43:50.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.768+0000 7f172be00640 1 -- 172.21.15.42:0/3482064834 learned_addr learned my addr 172.21.15.42:0/3482064834 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:50.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.768+0000 7f1730e00640 1 --2- 172.21.15.42:0/3482064834 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f172c1f5420 0x7f172c0c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:50.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.768+0000 7f172be00640 1 -- 172.21.15.42:0/3482064834 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f172c1f5420 msgr2=0x7f172c0c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:50.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.768+0000 7f1723400640 1 --2- 172.21.15.42:0/3482064834 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f172c0cf7c0 0x7f172c072c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:50.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.769+0000 7f172be00640 1 --2- 172.21.15.42:0/3482064834 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f172c1f5420 0x7f172c0c9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:50.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.769+0000 7f172be00640 1 -- 172.21.15.42:0/3482064834 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f172c0cf7c0 msgr2=0x7f172c072c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:50.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.769+0000 7f172be00640 1 --2- 172.21.15.42:0/3482064834 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f172c0cf7c0 0x7f172c072c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:50.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.769+0000 7f172be00640 1 -- 172.21.15.42:0/3482064834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f172c0cc4d0 con 0x7f172c0b4be0 2024-09-17T01:43:50.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.769+0000 7f1730e00640 1 --2- 172.21.15.42:0/3482064834 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f172c1f5420 0x7f172c0c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:43:50.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.769+0000 7f1723400640 1 --2- 172.21.15.42:0/3482064834 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f172c0cf7c0 0x7f172c072c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:43:50.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.769+0000 7f172be00640 1 --2- 172.21.15.42:0/3482064834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f172c0b4be0 0x7f172c0cbb60 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f171c034040 tx=0x7f171c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:50.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.769+0000 7f1728c00640 1 -- 172.21.15.42:0/3482064834 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c03e030 con 0x7f172c0b4be0 2024-09-17T01:43:50.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.769+0000 7f1728c00640 1 -- 172.21.15.42:0/3482064834 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f171c003ca0 con 0x7f172c0b4be0 2024-09-17T01:43:50.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.769+0000 7f1728c00640 1 -- 172.21.15.42:0/3482064834 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c035040 con 0x7f172c0b4be0 2024-09-17T01:43:50.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.769+0000 7f1731800640 1 -- 172.21.15.42:0/3482064834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f172c072180 con 0x7f172c0b4be0 2024-09-17T01:43:50.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.769+0000 7f1731800640 1 -- 172.21.15.42:0/3482064834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f172c072740 con 0x7f172c0b4be0 2024-09-17T01:43:50.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.771+0000 7f1731800640 1 -- 172.21.15.42:0/3482064834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f172c152ed0 con 0x7f172c0b4be0 2024-09-17T01:43:50.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.772+0000 7f1728c00640 1 -- 172.21.15.42:0/3482064834 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f171c041030 con 0x7f172c0b4be0 2024-09-17T01:43:50.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.773+0000 7f1728c00640 1 --2- 172.21.15.42:0/3482064834 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1708078bc0 0x7f170807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:50.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.773+0000 7f1728c00640 1 -- 172.21.15.42:0/3482064834 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 5767+0+0 (secure 0 0 0) 0x7f171c0bb3d0 con 0x7f172c0b4be0 2024-09-17T01:43:50.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.773+0000 7f1723400640 1 --2- 172.21.15.42:0/3482064834 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1708078bc0 0x7f170807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:50.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.774+0000 7f1723400640 1 --2- 172.21.15.42:0/3482064834 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1708078bc0 0x7f170807b0d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f172c15ffa0 tx=0x7f1714009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:50.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.777+0000 7f1728c00640 1 -- 172.21.15.42:0/3482064834 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f171c0837c0 con 0x7f172c0b4be0 2024-09-17T01:43:50.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.977+0000 7f1731800640 1 -- 172.21.15.42:0/3482064834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f172c0b35d0 con 0x7f172c0b4be0 2024-09-17T01:43:50.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.978+0000 7f1728c00640 1 -- 172.21.15.42:0/3482064834 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) ==== 74+0+16729 (secure 0 0 0) 0x7f171c0830c0 con 0x7f172c0b4be0 2024-09-17T01:43:50.977 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:50.978 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":149,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:43:50.839439+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:42:55.166237+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T01:42:56.148712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.11","mappings":[{"from":2,"to":5}]},{"pgid":"21.1e","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:43:50.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.981+0000 7f1731800640 1 -- 172.21.15.42:0/3482064834 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1708078bc0 msgr2=0x7f170807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:50.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.981+0000 7f1731800640 1 --2- 172.21.15.42:0/3482064834 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1708078bc0 0x7f170807b0d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f172c15ffa0 tx=0x7f1714009040 comp rx=0 tx=0).stop 2024-09-17T01:43:50.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.981+0000 7f1731800640 1 -- 172.21.15.42:0/3482064834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f172c0b4be0 msgr2=0x7f172c0cbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:50.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.981+0000 7f1731800640 1 --2- 172.21.15.42:0/3482064834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f172c0b4be0 0x7f172c0cbb60 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f171c034040 tx=0x7f171c0038a0 comp rx=0 tx=0).stop 2024-09-17T01:43:50.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.981+0000 7f1731800640 1 -- 172.21.15.42:0/3482064834 shutdown_connections 2024-09-17T01:43:50.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.981+0000 7f1731800640 1 --2- 172.21.15.42:0/3482064834 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1708078bc0 0x7f170807b0d0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:50.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.981+0000 7f1731800640 1 --2- 172.21.15.42:0/3482064834 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f172c0cf7c0 0x7f172c072c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:50.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.981+0000 7f1731800640 1 --2- 172.21.15.42:0/3482064834 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f172c1f5420 0x7f172c0c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:50.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.981+0000 7f1731800640 1 --2- 172.21.15.42:0/3482064834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f172c0b4be0 0x7f172c0cbb60 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:50.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.981+0000 7f1731800640 1 -- 172.21.15.42:0/3482064834 >> 172.21.15.42:0/3482064834 conn(0x7f172c0b25f0 msgr2=0x7f172c0b0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:50.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.981+0000 7f1731800640 1 -- 172.21.15.42:0/3482064834 shutdown_connections 2024-09-17T01:43:50.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:50.981+0000 7f1731800640 1 -- 172.21.15.42:0/3482064834 wait complete. 2024-09-17T01:43:51.004 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T01:43:51.004 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:43:51.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.233+0000 7f82dca00640 1 -- 172.21.15.42:0/3878184436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82d80af980 msgr2=0x7f82d80ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:51.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.233+0000 7f82dca00640 1 --2- 172.21.15.42:0/3878184436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82d80af980 0x7f82d80ceb40 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f82c0005fd0 tx=0x7f82c002a670 comp rx=0 tx=0).stop 2024-09-17T01:43:51.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.233+0000 7f82dca00640 1 -- 172.21.15.42:0/3878184436 shutdown_connections 2024-09-17T01:43:51.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.233+0000 7f82dca00640 1 --2- 172.21.15.42:0/3878184436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82d80af980 0x7f82d80ceb40 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:51.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.233+0000 7f82dca00640 1 -- 172.21.15.42:0/3878184436 >> 172.21.15.42:0/3878184436 conn(0x7f82d80b2930 msgr2=0x7f82d806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:51.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.233+0000 7f82dca00640 1 -- 172.21.15.42:0/3878184436 shutdown_connections 2024-09-17T01:43:51.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.233+0000 7f82dca00640 1 -- 172.21.15.42:0/3878184436 wait complete. 2024-09-17T01:43:51.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.235+0000 7f82dca00640 1 Processor -- start 2024-09-17T01:43:51.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.236+0000 7f82dca00640 1 -- start start 2024-09-17T01:43:51.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.237+0000 7f82dca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82d806d430 0x7f82d81f5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:51.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.237+0000 7f82dca00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82d80af980 0x7f82d806fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:51.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.237+0000 7f82dca00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82d80b3880 0x7f82d80ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:51.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.237+0000 7f82dca00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f82d8073cf0 con 0x7f82d806d430 2024-09-17T01:43:51.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.237+0000 7f82dca00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f82d8073b70 con 0x7f82d80af980 2024-09-17T01:43:51.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.237+0000 7f82dca00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f82d8073e70 con 0x7f82d80b3880 2024-09-17T01:43:51.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.237+0000 7f82d5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82d806d430 0x7f82d81f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:51.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.237+0000 7f82d5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82d806d430 0x7f82d81f5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50170/0 (socket says 172.21.15.42:50170) 2024-09-17T01:43:51.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.237+0000 7f82d5e00640 1 -- 172.21.15.42:0/4260359902 learned_addr learned my addr 172.21.15.42:0/4260359902 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:51.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.238+0000 7f82cfe00640 1 --2- 172.21.15.42:0/4260359902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82d80af980 0x7f82d806fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:51.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.238+0000 7f82d5e00640 1 -- 172.21.15.42:0/4260359902 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82d80b3880 msgr2=0x7f82d80ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:51.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.238+0000 7f82d6800640 1 --2- 172.21.15.42:0/4260359902 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82d80b3880 0x7f82d80ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:51.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.238+0000 7f82d5e00640 1 --2- 172.21.15.42:0/4260359902 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82d80b3880 0x7f82d80ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:51.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.238+0000 7f82d5e00640 1 -- 172.21.15.42:0/4260359902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82d80af980 msgr2=0x7f82d806fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:51.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.238+0000 7f82d5e00640 1 --2- 172.21.15.42:0/4260359902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82d80af980 0x7f82d806fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:51.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.238+0000 7f82d5e00640 1 -- 172.21.15.42:0/4260359902 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d806e260 con 0x7f82d806d430 2024-09-17T01:43:51.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.238+0000 7f82cfe00640 1 --2- 172.21.15.42:0/4260359902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82d80af980 0x7f82d806fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:43:51.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.238+0000 7f82d6800640 1 --2- 172.21.15.42:0/4260359902 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82d80b3880 0x7f82d80ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:43:51.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.238+0000 7f82d5e00640 1 --2- 172.21.15.42:0/4260359902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82d806d430 0x7f82d81f5900 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f82c800c430 tx=0x7f82c800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:51.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.238+0000 7f82ce000640 1 -- 172.21.15.42:0/4260359902 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c8017070 con 0x7f82d806d430 2024-09-17T01:43:51.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.238+0000 7f82ce000640 1 -- 172.21.15.42:0/4260359902 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82c80053c0 con 0x7f82d806d430 2024-09-17T01:43:51.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.238+0000 7f82ce000640 1 -- 172.21.15.42:0/4260359902 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c8003850 con 0x7f82d806d430 2024-09-17T01:43:51.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.238+0000 7f82dca00640 1 -- 172.21.15.42:0/4260359902 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d81f61a0 con 0x7f82d806d430 2024-09-17T01:43:51.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.238+0000 7f82dca00640 1 -- 172.21.15.42:0/4260359902 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d806e4d0 con 0x7f82d806d430 2024-09-17T01:43:51.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.240+0000 7f82dca00640 1 -- 172.21.15.42:0/4260359902 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d80ceb40 con 0x7f82d806d430 2024-09-17T01:43:51.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.241+0000 7f82ce000640 1 -- 172.21.15.42:0/4260359902 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f82c801a070 con 0x7f82d806d430 2024-09-17T01:43:51.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.242+0000 7f82ce000640 1 --2- 172.21.15.42:0/4260359902 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f82b4078b90 0x7f82b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:51.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.242+0000 7f82ce000640 1 -- 172.21.15.42:0/4260359902 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5767+0+0 (secure 0 0 0) 0x7f82c809a220 con 0x7f82d806d430 2024-09-17T01:43:51.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.242+0000 7f82cfe00640 1 --2- 172.21.15.42:0/4260359902 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f82b4078b90 0x7f82b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:51.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.243+0000 7f82cfe00640 1 --2- 172.21.15.42:0/4260359902 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f82b4078b90 0x7f82b407b0a0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f82c0033000 tx=0x7f82c0004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:51.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.246+0000 7f82ce000640 1 -- 172.21.15.42:0/4260359902 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f82c8062580 con 0x7f82d806d430 2024-09-17T01:43:51.297 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:43:51.301 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:43:51.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.478+0000 7f82dca00640 1 -- 172.21.15.42:0/4260359902 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82d806a170 con 0x7f82d806d430 2024-09-17T01:43:51.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.479+0000 7f82ce000640 1 -- 172.21.15.42:0/4260359902 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) ==== 95+0+5230 (secure 0 0 0) 0x7f82c8061e80 con 0x7f82d806d430 2024-09-17T01:43:51.478 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:51.478 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3131119825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3131119825},{"type":"v1","addr":"172.21.15.43:6837","nonce":3131119825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8368,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1988657429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1988657429},{"type":"v1","addr":"172.21.15.43:6836","nonce":1988657429}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/578887548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":578887548},{"type":"v1","addr":"172.21.15.42:6835","nonce":578887548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:42:57.184518+0000","modified":"2024-09-17T01:43:00.201156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8982":{"gid":8982,"name":"c","rank":0,"incarnation":112,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6834/3811049376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3811049376},{"type":"v1","addr":"172.21.15.42:6834","nonce":3811049376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8982,"qdb_cluster":[8982]},"id":10}]} 2024-09-17T01:43:51.478 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 116 2024-09-17T01:43:51.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.481+0000 7f82dca00640 1 -- 172.21.15.42:0/4260359902 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f82b4078b90 msgr2=0x7f82b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:51.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.481+0000 7f82dca00640 1 --2- 172.21.15.42:0/4260359902 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f82b4078b90 0x7f82b407b0a0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f82c0033000 tx=0x7f82c0004730 comp rx=0 tx=0).stop 2024-09-17T01:43:51.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.481+0000 7f82dca00640 1 -- 172.21.15.42:0/4260359902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82d806d430 msgr2=0x7f82d81f5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:51.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.481+0000 7f82dca00640 1 --2- 172.21.15.42:0/4260359902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82d806d430 0x7f82d81f5900 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f82c800c430 tx=0x7f82c800c8f0 comp rx=0 tx=0).stop 2024-09-17T01:43:51.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.481+0000 7f82dca00640 1 -- 172.21.15.42:0/4260359902 shutdown_connections 2024-09-17T01:43:51.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.481+0000 7f82dca00640 1 --2- 172.21.15.42:0/4260359902 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f82b4078b90 0x7f82b407b0a0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:51.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.481+0000 7f82dca00640 1 --2- 172.21.15.42:0/4260359902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82d80af980 0x7f82d806fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:51.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.481+0000 7f82dca00640 1 --2- 172.21.15.42:0/4260359902 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82d80b3880 0x7f82d80ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:51.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.481+0000 7f82dca00640 1 --2- 172.21.15.42:0/4260359902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82d806d430 0x7f82d81f5900 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:51.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.481+0000 7f82dca00640 1 -- 172.21.15.42:0/4260359902 >> 172.21.15.42:0/4260359902 conn(0x7f82d80b2930 msgr2=0x7f82d8160e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:51.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.481+0000 7f82dca00640 1 -- 172.21.15.42:0/4260359902 shutdown_connections 2024-09-17T01:43:51.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.481+0000 7f82dca00640 1 -- 172.21.15.42:0/4260359902 wait complete. 2024-09-17T01:43:51.502 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:43:51.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.731+0000 7fd252400640 1 -- 172.21.15.42:0/1531877846 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd24c142f40 msgr2=0x7fd24c072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:51.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.731+0000 7fd252400640 1 --2- 172.21.15.42:0/1531877846 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd24c142f40 0x7fd24c072950 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd234009860 tx=0x7fd23402a510 comp rx=0 tx=0).stop 2024-09-17T01:43:51.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.731+0000 7fd252400640 1 -- 172.21.15.42:0/1531877846 shutdown_connections 2024-09-17T01:43:51.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.731+0000 7fd252400640 1 --2- 172.21.15.42:0/1531877846 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd24c142f40 0x7fd24c072950 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:51.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.731+0000 7fd252400640 1 -- 172.21.15.42:0/1531877846 >> 172.21.15.42:0/1531877846 conn(0x7fd24c0b2930 msgr2=0x7fd24c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:51.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.731+0000 7fd252400640 1 -- 172.21.15.42:0/1531877846 shutdown_connections 2024-09-17T01:43:51.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.731+0000 7fd252400640 1 -- 172.21.15.42:0/1531877846 wait complete. 2024-09-17T01:43:51.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.733+0000 7fd252400640 1 Processor -- start 2024-09-17T01:43:51.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.733+0000 7fd252400640 1 -- start start 2024-09-17T01:43:51.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.735+0000 7fd252400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd24c072e90 0x7fd24c1f8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:51.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.735+0000 7fd252400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd24c0b3550 0x7fd24c0c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:51.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.735+0000 7fd252400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24c142f40 0x7fd24c15bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:51.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.735+0000 7fd252400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c06d8d0 con 0x7fd24c072e90 2024-09-17T01:43:51.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.735+0000 7fd252400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c06d750 con 0x7fd24c142f40 2024-09-17T01:43:51.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.735+0000 7fd252400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd24c06da50 con 0x7fd24c0b3550 2024-09-17T01:43:51.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.735+0000 7fd24b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd24c072e90 0x7fd24c1f8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:51.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.735+0000 7fd24b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd24c072e90 0x7fd24c1f8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50174/0 (socket says 172.21.15.42:50174) 2024-09-17T01:43:51.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.735+0000 7fd24b400640 1 -- 172.21.15.42:0/2268137147 learned_addr learned my addr 172.21.15.42:0/2268137147 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:51.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.735+0000 7fd243e00640 1 --2- 172.21.15.42:0/2268137147 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd24c0b3550 0x7fd24c0c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:51.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.735+0000 7fd24be00640 1 --2- 172.21.15.42:0/2268137147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24c142f40 0x7fd24c15bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:51.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.736+0000 7fd24b400640 1 -- 172.21.15.42:0/2268137147 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd24c0b3550 msgr2=0x7fd24c0c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:51.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.736+0000 7fd24b400640 1 --2- 172.21.15.42:0/2268137147 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd24c0b3550 0x7fd24c0c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:51.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.736+0000 7fd24b400640 1 -- 172.21.15.42:0/2268137147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24c142f40 msgr2=0x7fd24c15bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:51.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.736+0000 7fd24b400640 1 --2- 172.21.15.42:0/2268137147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24c142f40 0x7fd24c15bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:51.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.736+0000 7fd24b400640 1 -- 172.21.15.42:0/2268137147 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd24c153460 con 0x7fd24c072e90 2024-09-17T01:43:51.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.736+0000 7fd24b400640 1 --2- 172.21.15.42:0/2268137147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd24c072e90 0x7fd24c1f8c70 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00c3c0 tx=0x7fd23c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:51.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.736+0000 7fd243400640 1 -- 172.21.15.42:0/2268137147 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c011790 con 0x7fd24c072e90 2024-09-17T01:43:51.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.736+0000 7fd252400640 1 -- 172.21.15.42:0/2268137147 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd24c1f9410 con 0x7fd24c072e90 2024-09-17T01:43:51.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.736+0000 7fd243400640 1 -- 172.21.15.42:0/2268137147 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd23c017070 con 0x7fd24c072e90 2024-09-17T01:43:51.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.736+0000 7fd243400640 1 -- 172.21.15.42:0/2268137147 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c011cc0 con 0x7fd24c072e90 2024-09-17T01:43:51.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.736+0000 7fd252400640 1 -- 172.21.15.42:0/2268137147 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd24c1f99d0 con 0x7fd24c072e90 2024-09-17T01:43:51.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.738+0000 7fd252400640 1 -- 172.21.15.42:0/2268137147 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd24c06a170 con 0x7fd24c072e90 2024-09-17T01:43:51.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.739+0000 7fd243400640 1 -- 172.21.15.42:0/2268137147 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd23c01c460 con 0x7fd24c072e90 2024-09-17T01:43:51.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.740+0000 7fd243400640 1 --2- 172.21.15.42:0/2268137147 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd228078bc0 0x7fd22807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:51.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.740+0000 7fd243400640 1 -- 172.21.15.42:0/2268137147 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5767+0+0 (secure 0 0 0) 0x7fd23c09ab10 con 0x7fd24c072e90 2024-09-17T01:43:51.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.741+0000 7fd243e00640 1 --2- 172.21.15.42:0/2268137147 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd228078bc0 0x7fd22807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:51.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.741+0000 7fd243e00640 1 --2- 172.21.15.42:0/2268137147 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd228078bc0 0x7fd22807b0d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd234034000 tx=0x7fd234004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:51.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.744+0000 7fd243400640 1 -- 172.21.15.42:0/2268137147 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd23c0627a0 con 0x7fd24c072e90 2024-09-17T01:43:51.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.976+0000 7fd252400640 1 -- 172.21.15.42:0/2268137147 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd24c0c6210 con 0x7fd24c072e90 2024-09-17T01:43:51.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.977+0000 7fd243400640 1 -- 172.21.15.42:0/2268137147 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) ==== 95+0+5230 (secure 0 0 0) 0x7fd23c0671d0 con 0x7fd24c072e90 2024-09-17T01:43:51.976 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:51.976 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":116,"btime":"2024-09-17T01:43:00:696661+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3131119825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3131119825},{"type":"v1","addr":"172.21.15.43:6837","nonce":3131119825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8368,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1988657429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1988657429},{"type":"v1","addr":"172.21.15.43:6836","nonce":1988657429}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/578887548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":578887548},{"type":"v1","addr":"172.21.15.42:6835","nonce":578887548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:42:57.184518+0000","modified":"2024-09-17T01:43:00.201156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8982":{"gid":8982,"name":"c","rank":0,"incarnation":112,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6834/3811049376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3811049376},{"type":"v1","addr":"172.21.15.42:6834","nonce":3811049376}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8982,"qdb_cluster":[8982]},"id":10}]} 2024-09-17T01:43:51.976 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 116 2024-09-17T01:43:51.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.979+0000 7fd252400640 1 -- 172.21.15.42:0/2268137147 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd228078bc0 msgr2=0x7fd22807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:51.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.979+0000 7fd252400640 1 --2- 172.21.15.42:0/2268137147 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd228078bc0 0x7fd22807b0d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd234034000 tx=0x7fd234004730 comp rx=0 tx=0).stop 2024-09-17T01:43:51.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.979+0000 7fd252400640 1 -- 172.21.15.42:0/2268137147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd24c072e90 msgr2=0x7fd24c1f8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:51.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.979+0000 7fd252400640 1 --2- 172.21.15.42:0/2268137147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd24c072e90 0x7fd24c1f8c70 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00c3c0 tx=0x7fd23c00c880 comp rx=0 tx=0).stop 2024-09-17T01:43:51.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.979+0000 7fd252400640 1 -- 172.21.15.42:0/2268137147 shutdown_connections 2024-09-17T01:43:51.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.979+0000 7fd252400640 1 --2- 172.21.15.42:0/2268137147 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd228078bc0 0x7fd22807b0d0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:51.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.979+0000 7fd252400640 1 --2- 172.21.15.42:0/2268137147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd24c142f40 0x7fd24c15bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:51.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.979+0000 7fd252400640 1 --2- 172.21.15.42:0/2268137147 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd24c0b3550 0x7fd24c0c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:51.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.979+0000 7fd252400640 1 --2- 172.21.15.42:0/2268137147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd24c072e90 0x7fd24c1f8c70 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:51.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.979+0000 7fd252400640 1 -- 172.21.15.42:0/2268137147 >> 172.21.15.42:0/2268137147 conn(0x7fd24c0b2930 msgr2=0x7fd24c15e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:51.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.979+0000 7fd252400640 1 -- 172.21.15.42:0/2268137147 shutdown_connections 2024-09-17T01:43:51.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:51.979+0000 7fd252400640 1 -- 172.21.15.42:0/2268137147 wait complete. 2024-09-17T01:43:52.001 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:43:52.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.231+0000 7efc56600640 1 -- 172.21.15.42:0/2111100585 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc5015c610 msgr2=0x7efc500d1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:52.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.231+0000 7efc56600640 1 --2- 172.21.15.42:0/2111100585 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc5015c610 0x7efc500d1340 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efc40009860 tx=0x7efc4002a5a0 comp rx=0 tx=0).stop 2024-09-17T01:43:52.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.231+0000 7efc56600640 1 -- 172.21.15.42:0/2111100585 shutdown_connections 2024-09-17T01:43:52.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.231+0000 7efc56600640 1 --2- 172.21.15.42:0/2111100585 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc5015c610 0x7efc500d1340 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:52.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.231+0000 7efc56600640 1 -- 172.21.15.42:0/2111100585 >> 172.21.15.42:0/2111100585 conn(0x7efc5006cf00 msgr2=0x7efc5006d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:52.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.231+0000 7efc56600640 1 -- 172.21.15.42:0/2111100585 shutdown_connections 2024-09-17T01:43:52.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.231+0000 7efc56600640 1 -- 172.21.15.42:0/2111100585 wait complete. 2024-09-17T01:43:52.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.233+0000 7efc56600640 1 Processor -- start 2024-09-17T01:43:52.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.234+0000 7efc56600640 1 -- start start 2024-09-17T01:43:52.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.235+0000 7efc56600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc500d1880 0x7efc501f9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:52.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.235+0000 7efc56600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc5015c610 0x7efc50156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:52.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.235+0000 7efc56600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc50162e60 0x7efc501e8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:52.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.235+0000 7efc56600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efc500b3700 con 0x7efc500d1880 2024-09-17T01:43:52.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.235+0000 7efc56600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efc5015ca20 con 0x7efc5015c610 2024-09-17T01:43:52.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.235+0000 7efc56600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7efc500b3880 con 0x7efc50162e60 2024-09-17T01:43:52.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.235+0000 7efc55200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc500d1880 0x7efc501f9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:52.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.235+0000 7efc55200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc500d1880 0x7efc501f9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50182/0 (socket says 172.21.15.42:50182) 2024-09-17T01:43:52.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.235+0000 7efc55200640 1 -- 172.21.15.42:0/2667157420 learned_addr learned my addr 172.21.15.42:0/2667157420 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:52.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.235+0000 7efc47e00640 1 --2- 172.21.15.42:0/2667157420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc5015c610 0x7efc50156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:52.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.236+0000 7efc55c00640 1 --2- 172.21.15.42:0/2667157420 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc50162e60 0x7efc501e8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:52.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.236+0000 7efc55200640 1 -- 172.21.15.42:0/2667157420 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc50162e60 msgr2=0x7efc501e8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:52.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.236+0000 7efc55200640 1 --2- 172.21.15.42:0/2667157420 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc50162e60 0x7efc501e8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:52.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.236+0000 7efc55200640 1 -- 172.21.15.42:0/2667157420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc5015c610 msgr2=0x7efc50156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:52.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.236+0000 7efc55200640 1 --2- 172.21.15.42:0/2667157420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc5015c610 0x7efc50156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:52.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.236+0000 7efc55200640 1 -- 172.21.15.42:0/2667157420 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc500b6160 con 0x7efc500d1880 2024-09-17T01:43:52.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.236+0000 7efc55200640 1 --2- 172.21.15.42:0/2667157420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc500d1880 0x7efc501f9970 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7efc40009980 tx=0x7efc40033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:52.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.237+0000 7efc4d600640 1 -- 172.21.15.42:0/2667157420 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc40005c90 con 0x7efc500d1880 2024-09-17T01:43:52.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.237+0000 7efc4d600640 1 -- 172.21.15.42:0/2667157420 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc40031e50 con 0x7efc500d1880 2024-09-17T01:43:52.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.237+0000 7efc4d600640 1 -- 172.21.15.42:0/2667157420 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc40005260 con 0x7efc500d1880 2024-09-17T01:43:52.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.237+0000 7efc56600640 1 -- 172.21.15.42:0/2667157420 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc50158530 con 0x7efc500d1880 2024-09-17T01:43:52.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.237+0000 7efc56600640 1 -- 172.21.15.42:0/2667157420 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc501587d0 con 0x7efc500d1880 2024-09-17T01:43:52.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.238+0000 7efc56600640 1 -- 172.21.15.42:0/2667157420 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc500d1340 con 0x7efc500d1880 2024-09-17T01:43:52.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.239+0000 7efc4d600640 1 -- 172.21.15.42:0/2667157420 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efc40005400 con 0x7efc500d1880 2024-09-17T01:43:52.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.241+0000 7efc4d600640 1 --2- 172.21.15.42:0/2667157420 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efc2c078bc0 0x7efc2c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:52.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.241+0000 7efc4d600640 1 -- 172.21.15.42:0/2667157420 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5767+0+0 (secure 0 0 0) 0x7efc400bbcc0 con 0x7efc500d1880 2024-09-17T01:43:52.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.241+0000 7efc47e00640 1 --2- 172.21.15.42:0/2667157420 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efc2c078bc0 0x7efc2c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:52.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.242+0000 7efc47e00640 1 --2- 172.21.15.42:0/2667157420 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efc2c078bc0 0x7efc2c07b0d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7efc500b6a70 tx=0x7efc38009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:52.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.246+0000 7efc4d600640 1 -- 172.21.15.42:0/2667157420 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efc400c2080 con 0x7efc500d1880 2024-09-17T01:43:52.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.439+0000 7efc56600640 1 -- 172.21.15.42:0/2667157420 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc501626f0 con 0x7efc500d1880 2024-09-17T01:43:52.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.440+0000 7efc4d600640 1 -- 172.21.15.42:0/2667157420 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) ==== 74+0+16729 (secure 0 0 0) 0x7efc4003f030 con 0x7efc500d1880 2024-09-17T01:43:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:52.440 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":149,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:43:50.839439+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:42:55.166237+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T01:42:56.148712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.11","mappings":[{"from":2,"to":5}]},{"pgid":"21.1e","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:43:52.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.443+0000 7efc56600640 1 -- 172.21.15.42:0/2667157420 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efc2c078bc0 msgr2=0x7efc2c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:52.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.443+0000 7efc56600640 1 --2- 172.21.15.42:0/2667157420 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efc2c078bc0 0x7efc2c07b0d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7efc500b6a70 tx=0x7efc38009040 comp rx=0 tx=0).stop 2024-09-17T01:43:52.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.443+0000 7efc56600640 1 -- 172.21.15.42:0/2667157420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc500d1880 msgr2=0x7efc501f9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:52.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.443+0000 7efc56600640 1 --2- 172.21.15.42:0/2667157420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc500d1880 0x7efc501f9970 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7efc40009980 tx=0x7efc40033c20 comp rx=0 tx=0).stop 2024-09-17T01:43:52.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.443+0000 7efc56600640 1 -- 172.21.15.42:0/2667157420 shutdown_connections 2024-09-17T01:43:52.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.443+0000 7efc56600640 1 --2- 172.21.15.42:0/2667157420 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efc2c078bc0 0x7efc2c07b0d0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:52.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.443+0000 7efc56600640 1 --2- 172.21.15.42:0/2667157420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc5015c610 0x7efc50156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:52.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.443+0000 7efc56600640 1 --2- 172.21.15.42:0/2667157420 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efc50162e60 0x7efc501e8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:52.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.443+0000 7efc56600640 1 --2- 172.21.15.42:0/2667157420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc500d1880 0x7efc501f9970 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:52.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.443+0000 7efc56600640 1 -- 172.21.15.42:0/2667157420 >> 172.21.15.42:0/2667157420 conn(0x7efc5006cf00 msgr2=0x7efc500b7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:52.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.443+0000 7efc56600640 1 -- 172.21.15.42:0/2667157420 shutdown_connections 2024-09-17T01:43:52.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.443+0000 7efc56600640 1 -- 172.21.15.42:0/2667157420 wait complete. 2024-09-17T01:43:52.469 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T01:43:52.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.702+0000 7f6812600640 1 -- 172.21.15.42:0/1191341219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f680c0cf7c0 msgr2=0x7f680c06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:52.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.702+0000 7f6812600640 1 --2- 172.21.15.42:0/1191341219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f680c0cf7c0 0x7f680c06cd20 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f67f8009830 tx=0x7f67f802a510 comp rx=0 tx=0).stop 2024-09-17T01:43:52.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.703+0000 7f6812600640 1 -- 172.21.15.42:0/1191341219 shutdown_connections 2024-09-17T01:43:52.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.703+0000 7f6812600640 1 --2- 172.21.15.42:0/1191341219 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f680c06d260 0x7f680c152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:52.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.703+0000 7f6812600640 1 --2- 172.21.15.42:0/1191341219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f680c0cf7c0 0x7f680c06cd20 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:52.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.703+0000 7f6812600640 1 -- 172.21.15.42:0/1191341219 >> 172.21.15.42:0/1191341219 conn(0x7f680c0b25f0 msgr2=0x7f680c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:52.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.703+0000 7f6812600640 1 -- 172.21.15.42:0/1191341219 shutdown_connections 2024-09-17T01:43:52.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.703+0000 7f6812600640 1 -- 172.21.15.42:0/1191341219 wait complete. 2024-09-17T01:43:52.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.705+0000 7f6812600640 1 Processor -- start 2024-09-17T01:43:52.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.705+0000 7f6812600640 1 -- start start 2024-09-17T01:43:52.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.706+0000 7f6812600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f680c06d260 0x7f680c0cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:52.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.706+0000 7f6812600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f680c0b4be0 0x7f680c0c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:52.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.706+0000 7f6812600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f680c0cf7c0 0x7f680c073910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:52.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.706+0000 7f6812600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f680c153850 con 0x7f680c06d260 2024-09-17T01:43:52.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.706+0000 7f6812600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f680c1536d0 con 0x7f680c0b4be0 2024-09-17T01:43:52.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.706+0000 7f6812600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f680c1539d0 con 0x7f680c0cf7c0 2024-09-17T01:43:52.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.707+0000 7f6811200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f680c06d260 0x7f680c0cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:52.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.707+0000 7f6811200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f680c06d260 0x7f680c0cb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50196/0 (socket says 172.21.15.42:50196) 2024-09-17T01:43:52.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.707+0000 7f6811200640 1 -- 172.21.15.42:0/1551951704 learned_addr learned my addr 172.21.15.42:0/1551951704 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:52.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.707+0000 7f680be00640 1 --2- 172.21.15.42:0/1551951704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f680c0b4be0 0x7f680c0c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:52.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.707+0000 7f6811c00640 1 --2- 172.21.15.42:0/1551951704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f680c0cf7c0 0x7f680c073910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:52.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.707+0000 7f6811200640 1 -- 172.21.15.42:0/1551951704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f680c0cf7c0 msgr2=0x7f680c073910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:52.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.707+0000 7f6811200640 1 --2- 172.21.15.42:0/1551951704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f680c0cf7c0 0x7f680c073910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:52.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.707+0000 7f6811200640 1 -- 172.21.15.42:0/1551951704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f680c0b4be0 msgr2=0x7f680c0c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:52.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.707+0000 7f6811200640 1 --2- 172.21.15.42:0/1551951704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f680c0b4be0 0x7f680c0c9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:52.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.707+0000 7f6811200640 1 -- 172.21.15.42:0/1551951704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f680c0cc350 con 0x7f680c06d260 2024-09-17T01:43:52.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.707+0000 7f680be00640 1 --2- 172.21.15.42:0/1551951704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f680c0b4be0 0x7f680c0c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:43:52.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.707+0000 7f6811200640 1 --2- 172.21.15.42:0/1551951704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f680c06d260 0x7f680c0cb890 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f680000c370 tx=0x7f680000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:52.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.708+0000 7f6808c00640 1 -- 172.21.15.42:0/1551951704 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6800006890 con 0x7f680c06d260 2024-09-17T01:43:52.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.708+0000 7f6808c00640 1 -- 172.21.15.42:0/1551951704 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6800006b20 con 0x7f680c06d260 2024-09-17T01:43:52.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.708+0000 7f6812600640 1 -- 172.21.15.42:0/1551951704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f680c1f90c0 con 0x7f680c06d260 2024-09-17T01:43:52.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.708+0000 7f6808c00640 1 -- 172.21.15.42:0/1551951704 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6800007020 con 0x7f680c06d260 2024-09-17T01:43:52.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.708+0000 7f6812600640 1 -- 172.21.15.42:0/1551951704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f680c1f9680 con 0x7f680c06d260 2024-09-17T01:43:52.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.709+0000 7f6812600640 1 -- 172.21.15.42:0/1551951704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f680c152ed0 con 0x7f680c06d260 2024-09-17T01:43:52.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.710+0000 7f6808c00640 1 -- 172.21.15.42:0/1551951704 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6800019020 con 0x7f680c06d260 2024-09-17T01:43:52.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.711+0000 7f6808c00640 1 --2- 172.21.15.42:0/1551951704 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f67ec078b90 0x7f67ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:52.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.711+0000 7f6808c00640 1 -- 172.21.15.42:0/1551951704 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5767+0+0 (secure 0 0 0) 0x7f680009a550 con 0x7f680c06d260 2024-09-17T01:43:52.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.712+0000 7f680be00640 1 --2- 172.21.15.42:0/1551951704 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f67ec078b90 0x7f67ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:52.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.713+0000 7f680be00640 1 --2- 172.21.15.42:0/1551951704 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f67ec078b90 0x7f67ec07b0a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f67f8034000 tx=0x7f67f8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:52.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.716+0000 7f6808c00640 1 -- 172.21.15.42:0/1551951704 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f680c06d670 con 0x7f680c06d260 2024-09-17T01:43:52.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.948+0000 7f6812600640 1 -- 172.21.15.42:0/1551951704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f680c0b4320 con 0x7f680c06d260 2024-09-17T01:43:52.948 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-17T01:43:52.949+0000 7f9961e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:43:52.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.951+0000 7f6808c00640 1 -- 172.21.15.42:0/1551951704 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v117) ==== 161+0+0 (secure 0 0 0) 0x7f68000628b0 con 0x7f680c06d260 2024-09-17T01:43:52.950 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T01:43:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.954+0000 7f6812600640 1 -- 172.21.15.42:0/1551951704 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f67ec078b90 msgr2=0x7f67ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.954+0000 7f6812600640 1 --2- 172.21.15.42:0/1551951704 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f67ec078b90 0x7f67ec07b0a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f67f8034000 tx=0x7f67f8004730 comp rx=0 tx=0).stop 2024-09-17T01:43:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.954+0000 7f6812600640 1 -- 172.21.15.42:0/1551951704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f680c06d260 msgr2=0x7f680c0cb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.954+0000 7f6812600640 1 --2- 172.21.15.42:0/1551951704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f680c06d260 0x7f680c0cb890 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f680000c370 tx=0x7f680000c830 comp rx=0 tx=0).stop 2024-09-17T01:43:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.955+0000 7f6812600640 1 -- 172.21.15.42:0/1551951704 shutdown_connections 2024-09-17T01:43:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.955+0000 7f6812600640 1 --2- 172.21.15.42:0/1551951704 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f67ec078b90 0x7f67ec07b0a0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.955+0000 7f6812600640 1 --2- 172.21.15.42:0/1551951704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f680c0b4be0 0x7f680c0c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:52.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.955+0000 7f6812600640 1 --2- 172.21.15.42:0/1551951704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f680c0cf7c0 0x7f680c073910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:52.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.955+0000 7f6812600640 1 --2- 172.21.15.42:0/1551951704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f680c06d260 0x7f680c0cb890 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:52.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.955+0000 7f6812600640 1 -- 172.21.15.42:0/1551951704 >> 172.21.15.42:0/1551951704 conn(0x7f680c0b25f0 msgr2=0x7f680c0b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:52.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.955+0000 7f6812600640 1 -- 172.21.15.42:0/1551951704 shutdown_connections 2024-09-17T01:43:52.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:52.955+0000 7f6812600640 1 -- 172.21.15.42:0/1551951704 wait complete. 2024-09-17T01:43:52.979 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T01:43:53.098 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:43:53.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.216+0000 7f44a3400640 1 -- 172.21.15.42:0/876285007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f449c06f2a0 msgr2=0x7f449c06d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:53.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.216+0000 7f44a3400640 1 --2- 172.21.15.42:0/876285007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f449c06f2a0 0x7f449c06d610 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f449c071370 tx=0x7f448802a560 comp rx=0 tx=0).stop 2024-09-17T01:43:53.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.216+0000 7f44a3400640 1 -- 172.21.15.42:0/876285007 shutdown_connections 2024-09-17T01:43:53.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.216+0000 7f44a3400640 1 --2- 172.21.15.42:0/876285007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f449c06f2a0 0x7f449c06d610 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:53.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.216+0000 7f44a3400640 1 --2- 172.21.15.42:0/876285007 >> v2:172.21.15.43:3300/0 conn(0x7f449c06ee90 0x7f449c15f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:53.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.216+0000 7f44a3400640 1 -- 172.21.15.42:0/876285007 >> 172.21.15.42:0/876285007 conn(0x7f449c0b2930 msgr2=0x7f449c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:53.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.216+0000 7f44a3400640 1 -- 172.21.15.42:0/876285007 shutdown_connections 2024-09-17T01:43:53.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.216+0000 7f44a3400640 1 -- 172.21.15.42:0/876285007 wait complete. 2024-09-17T01:43:53.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.218+0000 7f44a3400640 1 Processor -- start 2024-09-17T01:43:53.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.219+0000 7f44a3400640 1 -- start start 2024-09-17T01:43:53.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.220+0000 7f44a3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f449c06db50 0x7f449c15d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:53.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.220+0000 7f44a3400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f449c06ee90 0x7f449c1f9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:53.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.220+0000 7f44a3400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f449c06f2a0 0x7f449c0b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:53.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.220+0000 7f44a3400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f449c0cef40 con 0x7f449c06db50 2024-09-17T01:43:53.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.220+0000 7f44a3400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f449c074750 con 0x7f449c06f2a0 2024-09-17T01:43:53.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.220+0000 7f44a3400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f449c0cf0c0 con 0x7f449c06ee90 2024-09-17T01:43:53.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.220+0000 7f44a0a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f449c06db50 0x7f449c15d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:53.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.220+0000 7f44a0a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f449c06db50 0x7f449c15d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50228/0 (socket says 172.21.15.42:50228) 2024-09-17T01:43:53.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.220+0000 7f44a0a00640 1 -- 172.21.15.42:0/3827021991 learned_addr learned my addr 172.21.15.42:0/3827021991 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:53.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.220+0000 7f449be00640 1 --2- 172.21.15.42:0/3827021991 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f449c06ee90 0x7f449c1f9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:53.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.220+0000 7f44a1400640 1 --2- 172.21.15.42:0/3827021991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f449c06f2a0 0x7f449c0b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:53.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.221+0000 7f44a0a00640 1 -- 172.21.15.42:0/3827021991 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f449c06ee90 msgr2=0x7f449c1f9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:53.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.221+0000 7f44a0a00640 1 --2- 172.21.15.42:0/3827021991 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f449c06ee90 0x7f449c1f9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:53.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.221+0000 7f44a0a00640 1 -- 172.21.15.42:0/3827021991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f449c06f2a0 msgr2=0x7f449c0b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:53.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.221+0000 7f44a0a00640 1 --2- 172.21.15.42:0/3827021991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f449c06f2a0 0x7f449c0b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:53.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.221+0000 7f44a0a00640 1 -- 172.21.15.42:0/3827021991 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449c15d6e0 con 0x7f449c06db50 2024-09-17T01:43:53.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.221+0000 7f44a0a00640 1 --2- 172.21.15.42:0/3827021991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f449c06db50 0x7f449c15d1a0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f449000d740 tx=0x7f449000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:53.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.221+0000 7f4498c00640 1 -- 172.21.15.42:0/3827021991 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4490017070 con 0x7f449c06db50 2024-09-17T01:43:53.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.221+0000 7f4498c00640 1 -- 172.21.15.42:0/3827021991 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4490009d20 con 0x7f449c06db50 2024-09-17T01:43:53.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.221+0000 7f44a3400640 1 -- 172.21.15.42:0/3827021991 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f449c1fa3f0 con 0x7f449c06db50 2024-09-17T01:43:53.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.222+0000 7f4498c00640 1 -- 172.21.15.42:0/3827021991 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44900106c0 con 0x7f449c06db50 2024-09-17T01:43:53.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.222+0000 7f44a3400640 1 -- 172.21.15.42:0/3827021991 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f449c1f6570 con 0x7f449c06db50 2024-09-17T01:43:53.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.223+0000 7f44a3400640 1 -- 172.21.15.42:0/3827021991 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f449c15f200 con 0x7f449c06db50 2024-09-17T01:43:53.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.224+0000 7f4498c00640 1 -- 172.21.15.42:0/3827021991 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f449001a070 con 0x7f449c06db50 2024-09-17T01:43:53.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.225+0000 7f4498c00640 1 --2- 172.21.15.42:0/3827021991 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f447c078b90 0x7f447c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:53.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.225+0000 7f4498c00640 1 -- 172.21.15.42:0/3827021991 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 5853+0+0 (secure 0 0 0) 0x7f449009afd0 con 0x7f449c06db50 2024-09-17T01:43:53.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.226+0000 7f449be00640 1 --2- 172.21.15.42:0/3827021991 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f447c078b90 0x7f447c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:53.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.226+0000 7f449be00640 1 --2- 172.21.15.42:0/3827021991 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f447c078b90 0x7f447c07b0a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4488033000 tx=0x7f4488004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:53.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.229+0000 7f4498c00640 1 -- 172.21.15.42:0/3827021991 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f449c1fa3f0 con 0x7f449c06db50 2024-09-17T01:43:53.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.463+0000 7f44a3400640 1 -- 172.21.15.42:0/3827021991 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f449c06a170 con 0x7f449c06db50 2024-09-17T01:43:53.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.957+0000 7f4498c00640 1 -- 172.21.15.42:0/3827021991 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v118) ==== 104+0+0 (secure 0 0 0) 0x7f4490062c90 con 0x7f449c06db50 2024-09-17T01:43:53.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.960+0000 7f44a3400640 1 -- 172.21.15.42:0/3827021991 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f447c078b90 msgr2=0x7f447c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:53.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.960+0000 7f44a3400640 1 --2- 172.21.15.42:0/3827021991 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f447c078b90 0x7f447c07b0a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4488033000 tx=0x7f4488004730 comp rx=0 tx=0).stop 2024-09-17T01:43:53.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.960+0000 7f44a3400640 1 -- 172.21.15.42:0/3827021991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f449c06db50 msgr2=0x7f449c15d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:53.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.960+0000 7f44a3400640 1 --2- 172.21.15.42:0/3827021991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f449c06db50 0x7f449c15d1a0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f449000d740 tx=0x7f449000dc00 comp rx=0 tx=0).stop 2024-09-17T01:43:53.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.960+0000 7f44a3400640 1 -- 172.21.15.42:0/3827021991 shutdown_connections 2024-09-17T01:43:53.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.960+0000 7f44a3400640 1 --2- 172.21.15.42:0/3827021991 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f447c078b90 0x7f447c07b0a0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:53.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.960+0000 7f44a3400640 1 --2- 172.21.15.42:0/3827021991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f449c06f2a0 0x7f449c0b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:53.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.960+0000 7f44a3400640 1 --2- 172.21.15.42:0/3827021991 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f449c06ee90 0x7f449c1f9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:53.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.960+0000 7f44a3400640 1 --2- 172.21.15.42:0/3827021991 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f449c06db50 0x7f449c15d1a0 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:53.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.960+0000 7f44a3400640 1 -- 172.21.15.42:0/3827021991 >> 172.21.15.42:0/3827021991 conn(0x7f449c0b2930 msgr2=0x7f449c1615d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:53.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.960+0000 7f44a3400640 1 -- 172.21.15.42:0/3827021991 shutdown_connections 2024-09-17T01:43:53.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:53.960+0000 7f44a3400640 1 -- 172.21.15.42:0/3827021991 wait complete. 2024-09-17T01:43:53.989 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T01:43:54.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.223+0000 7fa9a7e00640 1 -- 172.21.15.42:0/3963841363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9a80aebf0 msgr2=0x7fa9a806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:54.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.223+0000 7fa9a7e00640 1 --2- 172.21.15.42:0/3963841363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9a80aebf0 0x7fa9a806cd20 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fa9a80719b0 tx=0x7fa99402a540 comp rx=0 tx=0).stop 2024-09-17T01:43:54.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.223+0000 7fa9a7e00640 1 -- 172.21.15.42:0/3963841363 shutdown_connections 2024-09-17T01:43:54.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.223+0000 7fa9a7e00640 1 --2- 172.21.15.42:0/3963841363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9a80aebf0 0x7fa9a806cd20 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:54.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.223+0000 7fa9a7e00640 1 --2- 172.21.15.42:0/3963841363 >> v2:172.21.15.43:3300/0 conn(0x7fa9a80af4f0 0x7fa9a815d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:54.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.223+0000 7fa9a7e00640 1 -- 172.21.15.42:0/3963841363 >> 172.21.15.42:0/3963841363 conn(0x7fa9a80b25d0 msgr2=0x7fa9a80d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:54.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.223+0000 7fa9a7e00640 1 -- 172.21.15.42:0/3963841363 shutdown_connections 2024-09-17T01:43:54.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.223+0000 7fa9a7e00640 1 -- 172.21.15.42:0/3963841363 wait complete. 2024-09-17T01:43:54.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.225+0000 7fa9a7e00640 1 Processor -- start 2024-09-17T01:43:54.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.225+0000 7fa9a7e00640 1 -- start start 2024-09-17T01:43:54.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.227+0000 7fa9a7e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa9a806d260 0x7fa9a8072030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:54.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.227+0000 7fa9a7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9a80aebf0 0x7fa9a806f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:54.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.227+0000 7fa9a7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9a80af4f0 0x7fa9a806f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:54.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.227+0000 7fa9a7e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a8160920 con 0x7fa9a80af4f0 2024-09-17T01:43:54.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.227+0000 7fa9a7e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a80cca50 con 0x7fa9a80aebf0 2024-09-17T01:43:54.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.227+0000 7fa9a7e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa9a8160aa0 con 0x7fa9a806d260 2024-09-17T01:43:54.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.227+0000 7fa9a7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9a80af4f0 0x7fa9a806f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:54.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.227+0000 7fa9a7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9a80af4f0 0x7fa9a806f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50242/0 (socket says 172.21.15.42:50242) 2024-09-17T01:43:54.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.227+0000 7fa9a7400640 1 -- 172.21.15.42:0/4254855820 learned_addr learned my addr 172.21.15.42:0/4254855820 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:54.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.227+0000 7fa9a6000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9a80aebf0 0x7fa9a806f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:54.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.227+0000 7fa9a6a00640 1 --2- 172.21.15.42:0/4254855820 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa9a806d260 0x7fa9a8072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:54.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.228+0000 7fa9a7400640 1 -- 172.21.15.42:0/4254855820 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa9a806d260 msgr2=0x7fa9a8072030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:54.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.228+0000 7fa9a7400640 1 --2- 172.21.15.42:0/4254855820 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa9a806d260 0x7fa9a8072030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:54.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.228+0000 7fa9a7400640 1 -- 172.21.15.42:0/4254855820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9a80aebf0 msgr2=0x7fa9a806f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:54.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.228+0000 7fa9a7400640 1 --2- 172.21.15.42:0/4254855820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9a80aebf0 0x7fa9a806f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:54.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.228+0000 7fa9a7400640 1 -- 172.21.15.42:0/4254855820 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a80c8b10 con 0x7fa9a80af4f0 2024-09-17T01:43:54.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.228+0000 7fa9a7400640 1 --2- 172.21.15.42:0/4254855820 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9a80af4f0 0x7fa9a806f790 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000cb10 tx=0x7fa9a000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:54.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.228+0000 7fa99ea00640 1 -- 172.21.15.42:0/4254855820 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0016020 con 0x7fa9a80af4f0 2024-09-17T01:43:54.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.228+0000 7fa99ea00640 1 -- 172.21.15.42:0/4254855820 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9a000ad60 con 0x7fa9a80af4f0 2024-09-17T01:43:54.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.228+0000 7fa99ea00640 1 -- 172.21.15.42:0/4254855820 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0012680 con 0x7fa9a80af4f0 2024-09-17T01:43:54.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.228+0000 7fa9a7e00640 1 -- 172.21.15.42:0/4254855820 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a81f3790 con 0x7fa9a80af4f0 2024-09-17T01:43:54.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.228+0000 7fa9a7e00640 1 -- 172.21.15.42:0/4254855820 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9a81f3d10 con 0x7fa9a80af4f0 2024-09-17T01:43:54.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.230+0000 7fa9a7e00640 1 -- 172.21.15.42:0/4254855820 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9a80c8ce0 con 0x7fa9a80af4f0 2024-09-17T01:43:54.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.231+0000 7fa99ea00640 1 -- 172.21.15.42:0/4254855820 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa9a0019020 con 0x7fa9a80af4f0 2024-09-17T01:43:54.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.232+0000 7fa99ea00640 1 --2- 172.21.15.42:0/4254855820 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa988078b90 0x7fa98807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:54.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.232+0000 7fa99ea00640 1 -- 172.21.15.42:0/4254855820 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 5853+0+0 (secure 0 0 0) 0x7fa9a009b390 con 0x7fa9a80af4f0 2024-09-17T01:43:54.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.232+0000 7fa9a6a00640 1 --2- 172.21.15.42:0/4254855820 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa988078b90 0x7fa98807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:54.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.233+0000 7fa9a6a00640 1 --2- 172.21.15.42:0/4254855820 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa988078b90 0x7fa98807b0a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa9a80b4ff0 tx=0x7fa99800a2d0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:54.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.236+0000 7fa99ea00640 1 -- 172.21.15.42:0/4254855820 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa9a0020020 con 0x7fa9a80af4f0 2024-09-17T01:43:54.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.429+0000 7fa9a7e00640 1 -- 172.21.15.42:0/4254855820 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa9a8072570 con 0x7fa9a80af4f0 2024-09-17T01:43:54.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.959+0000 7fa99ea00640 1 -- 172.21.15.42:0/4254855820 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v151) ==== 181+0+0 (secure 0 0 0) 0x7fa9a806d670 con 0x7fa9a80af4f0 2024-09-17T01:43:54.958 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-09-17T01:43:54.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.962+0000 7fa9a7e00640 1 -- 172.21.15.42:0/4254855820 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa988078b90 msgr2=0x7fa98807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:54.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.962+0000 7fa9a7e00640 1 --2- 172.21.15.42:0/4254855820 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa988078b90 0x7fa98807b0a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa9a80b4ff0 tx=0x7fa99800a2d0 comp rx=0 tx=0).stop 2024-09-17T01:43:54.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.962+0000 7fa9a7e00640 1 -- 172.21.15.42:0/4254855820 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9a80af4f0 msgr2=0x7fa9a806f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:54.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.962+0000 7fa9a7e00640 1 --2- 172.21.15.42:0/4254855820 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9a80af4f0 0x7fa9a806f790 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000cb10 tx=0x7fa9a000a060 comp rx=0 tx=0).stop 2024-09-17T01:43:54.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.963+0000 7fa9a7e00640 1 -- 172.21.15.42:0/4254855820 shutdown_connections 2024-09-17T01:43:54.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.963+0000 7fa9a7e00640 1 --2- 172.21.15.42:0/4254855820 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa988078b90 0x7fa98807b0a0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:54.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.963+0000 7fa9a7e00640 1 --2- 172.21.15.42:0/4254855820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9a80aebf0 0x7fa9a806f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:54.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.963+0000 7fa9a7e00640 1 --2- 172.21.15.42:0/4254855820 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9a80af4f0 0x7fa9a806f790 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:54.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.963+0000 7fa9a7e00640 1 --2- 172.21.15.42:0/4254855820 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa9a806d260 0x7fa9a8072030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:54.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.963+0000 7fa9a7e00640 1 -- 172.21.15.42:0/4254855820 >> 172.21.15.42:0/4254855820 conn(0x7fa9a80b25d0 msgr2=0x7fa9a80b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:54.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.964+0000 7fa9a7e00640 1 -- 172.21.15.42:0/4254855820 shutdown_connections 2024-09-17T01:43:54.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:54.964+0000 7fa9a7e00640 1 -- 172.21.15.42:0/4254855820 wait complete. 2024-09-17T01:43:54.987 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T01:43:55.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.221+0000 7f9532800640 1 -- 172.21.15.42:0/4268517627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9514003a00 msgr2=0x7f9514003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:55.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.221+0000 7f9532800640 1 --2- 172.21.15.42:0/4268517627 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9514003a00 0x7f9514003e70 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f952000c290 tx=0x7f9514005830 comp rx=0 tx=0).stop 2024-09-17T01:43:55.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.221+0000 7f9531e00640 1 -- 172.21.15.42:0/4268517627 reap_dead start 2024-09-17T01:43:55.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.221+0000 7f9532800640 1 -- 172.21.15.42:0/4268517627 shutdown_connections 2024-09-17T01:43:55.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.221+0000 7f9532800640 1 -- 172.21.15.42:0/4268517627 >> 172.21.15.42:0/4268517627 conn(0x7f952c0b25d0 msgr2=0x7f952c0d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:55.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.221+0000 7f9532800640 1 -- 172.21.15.42:0/4268517627 shutdown_connections 2024-09-17T01:43:55.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.221+0000 7f9532800640 1 -- 172.21.15.42:0/4268517627 wait complete. 2024-09-17T01:43:55.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.223+0000 7f9532800640 1 Processor -- start 2024-09-17T01:43:55.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.224+0000 7f9532800640 1 -- start start 2024-09-17T01:43:55.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.225+0000 7f9532800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9514003a00 0x7f952c160b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:55.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.225+0000 7f9532800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f952c15f0a0 0x7f952c1559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:55.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.225+0000 7f9532800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f952c06f7f0 0x7f952c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:55.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.225+0000 7f9532800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f952c06d5b0 con 0x7f952c15f0a0 2024-09-17T01:43:55.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.225+0000 7f9532800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f952c06d430 con 0x7f9514003a00 2024-09-17T01:43:55.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.225+0000 7f9532800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f952c0cf120 con 0x7f952c06f7f0 2024-09-17T01:43:55.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.225+0000 7f9530a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f952c15f0a0 0x7f952c1559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:55.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.225+0000 7f9530a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f952c15f0a0 0x7f952c1559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50268/0 (socket says 172.21.15.42:50268) 2024-09-17T01:43:55.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.225+0000 7f9530a00640 1 -- 172.21.15.42:0/1192447008 learned_addr learned my addr 172.21.15.42:0/1192447008 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:55.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.225+0000 7f9531400640 1 --2- 172.21.15.42:0/1192447008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9514003a00 0x7f952c160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:55.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.225+0000 7f9531e00640 1 --2- 172.21.15.42:0/1192447008 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f952c06f7f0 0x7f952c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:55.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.226+0000 7f9530a00640 1 -- 172.21.15.42:0/1192447008 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f952c06f7f0 msgr2=0x7f952c06fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:55.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.226+0000 7f9530a00640 1 --2- 172.21.15.42:0/1192447008 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f952c06f7f0 0x7f952c06fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:55.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.226+0000 7f9530a00640 1 -- 172.21.15.42:0/1192447008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9514003a00 msgr2=0x7f952c160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:55.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.226+0000 7f9530a00640 1 --2- 172.21.15.42:0/1192447008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9514003a00 0x7f952c160b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:55.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.226+0000 7f9530a00640 1 -- 172.21.15.42:0/1192447008 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952c070140 con 0x7f952c15f0a0 2024-09-17T01:43:55.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.226+0000 7f9531e00640 1 --2- 172.21.15.42:0/1192447008 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f952c06f7f0 0x7f952c06fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:43:55.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.226+0000 7f9530a00640 1 --2- 172.21.15.42:0/1192447008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f952c15f0a0 0x7f952c1559d0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f9518011820 tx=0x7f9518011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:55.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.226+0000 7f9529600640 1 -- 172.21.15.42:0/1192447008 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951800fd50 con 0x7f952c15f0a0 2024-09-17T01:43:55.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.226+0000 7f9529600640 1 -- 172.21.15.42:0/1192447008 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9518016070 con 0x7f952c15f0a0 2024-09-17T01:43:55.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.226+0000 7f9532800640 1 -- 172.21.15.42:0/1192447008 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f952c161390 con 0x7f952c15f0a0 2024-09-17T01:43:55.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.226+0000 7f9529600640 1 -- 172.21.15.42:0/1192447008 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518012690 con 0x7f952c15f0a0 2024-09-17T01:43:55.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.227+0000 7f9532800640 1 -- 172.21.15.42:0/1192447008 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f952c161950 con 0x7f952c15f0a0 2024-09-17T01:43:55.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.228+0000 7f9532800640 1 -- 172.21.15.42:0/1192447008 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f952c0d0d30 con 0x7f952c15f0a0 2024-09-17T01:43:55.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.230+0000 7f9529600640 1 -- 172.21.15.42:0/1192447008 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9518018030 con 0x7f952c15f0a0 2024-09-17T01:43:55.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.231+0000 7f9529600640 1 --2- 172.21.15.42:0/1192447008 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f950c078b90 0x7f950c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:55.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.231+0000 7f9529600640 1 -- 172.21.15.42:0/1192447008 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5415+0+0 (secure 0 0 0) 0x7f951809bc40 con 0x7f952c15f0a0 2024-09-17T01:43:55.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.232+0000 7f9531400640 1 --2- 172.21.15.42:0/1192447008 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f950c078b90 0x7f950c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:55.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.233+0000 7f9531400640 1 --2- 172.21.15.42:0/1192447008 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f950c078b90 0x7f950c07b0a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f9520033000 tx=0x7f9520038040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:55.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.234+0000 7f9529600640 1 -- 172.21.15.42:0/1192447008 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f952c070140 con 0x7f952c15f0a0 2024-09-17T01:43:55.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.432+0000 7f9532800640 1 -- 172.21.15.42:0/1192447008 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f952c06cd20 con 0x7f952c15f0a0 2024-09-17T01:43:55.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.967+0000 7f9529600640 1 -- 172.21.15.42:0/1192447008 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v152) ==== 169+0+0 (secure 0 0 0) 0x7f9518063b40 con 0x7f952c15f0a0 2024-09-17T01:43:55.966 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-09-17T01:43:55.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.975+0000 7f9532800640 1 -- 172.21.15.42:0/1192447008 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f950c078b90 msgr2=0x7f950c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:55.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.975+0000 7f9532800640 1 --2- 172.21.15.42:0/1192447008 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f950c078b90 0x7f950c07b0a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f9520033000 tx=0x7f9520038040 comp rx=0 tx=0).stop 2024-09-17T01:43:55.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.975+0000 7f9532800640 1 -- 172.21.15.42:0/1192447008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f952c15f0a0 msgr2=0x7f952c1559d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:55.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.975+0000 7f9532800640 1 --2- 172.21.15.42:0/1192447008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f952c15f0a0 0x7f952c1559d0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f9518011820 tx=0x7f9518011ce0 comp rx=0 tx=0).stop 2024-09-17T01:43:55.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.975+0000 7f9532800640 1 -- 172.21.15.42:0/1192447008 shutdown_connections 2024-09-17T01:43:55.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.975+0000 7f9532800640 1 --2- 172.21.15.42:0/1192447008 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f950c078b90 0x7f950c07b0a0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:55.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.975+0000 7f9532800640 1 --2- 172.21.15.42:0/1192447008 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f952c06f7f0 0x7f952c06fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:55.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.975+0000 7f9532800640 1 --2- 172.21.15.42:0/1192447008 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f952c15f0a0 0x7f952c1559d0 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:55.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.975+0000 7f9532800640 1 --2- 172.21.15.42:0/1192447008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9514003a00 0x7f952c160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:55.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.975+0000 7f9532800640 1 -- 172.21.15.42:0/1192447008 >> 172.21.15.42:0/1192447008 conn(0x7f952c0b25d0 msgr2=0x7f952c0aff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:55.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.976+0000 7f9532800640 1 -- 172.21.15.42:0/1192447008 shutdown_connections 2024-09-17T01:43:55.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:55.976+0000 7f9532800640 1 -- 172.21.15.42:0/1192447008 wait complete. 2024-09-17T01:43:56.032 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T01:43:56.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.270+0000 7fe1bb200640 1 -- 172.21.15.42:0/2005822745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1b40cec40 msgr2=0x7fe1b40cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:56.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.270+0000 7fe1bb200640 1 --2- 172.21.15.42:0/2005822745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1b40cec40 0x7fe1b40cf050 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac005fd0 tx=0x7fe1ac02aa00 comp rx=0 tx=0).stop 2024-09-17T01:43:56.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.270+0000 7fe1bb200640 1 -- 172.21.15.42:0/2005822745 shutdown_connections 2024-09-17T01:43:56.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.270+0000 7fe1bb200640 1 --2- 172.21.15.42:0/2005822745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1b40cec40 0x7fe1b40cf050 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:56.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.270+0000 7fe1bb200640 1 --2- 172.21.15.42:0/2005822745 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1b40b3550 0x7fe1b415cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:56.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.270+0000 7fe1bb200640 1 -- 172.21.15.42:0/2005822745 >> 172.21.15.42:0/2005822745 conn(0x7fe1b40b2930 msgr2=0x7fe1b406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:56.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.270+0000 7fe1bb200640 1 -- 172.21.15.42:0/2005822745 shutdown_connections 2024-09-17T01:43:56.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.270+0000 7fe1bb200640 1 -- 172.21.15.42:0/2005822745 wait complete. 2024-09-17T01:43:56.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.272+0000 7fe1bb200640 1 Processor -- start 2024-09-17T01:43:56.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.273+0000 7fe1bb200640 1 -- start start 2024-09-17T01:43:56.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.274+0000 7fe1bb200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1b40b3550 0x7fe1b413e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:56.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.274+0000 7fe1bb200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b40cec40 0x7fe1b4159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:56.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.274+0000 7fe1bb200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1b4142f40 0x7fe1b415a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:56.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.274+0000 7fe1bb200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b406d7c0 con 0x7fe1b4142f40 2024-09-17T01:43:56.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.274+0000 7fe1bb200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b406d640 con 0x7fe1b40cec40 2024-09-17T01:43:56.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.274+0000 7fe1bb200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe1b406d940 con 0x7fe1b40b3550 2024-09-17T01:43:56.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.274+0000 7fe1b9200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1b4142f40 0x7fe1b415a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:56.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.274+0000 7fe1b9200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1b4142f40 0x7fe1b415a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54078/0 (socket says 172.21.15.42:54078) 2024-09-17T01:43:56.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.274+0000 7fe1b9200640 1 -- 172.21.15.42:0/2031085215 learned_addr learned my addr 172.21.15.42:0/2031085215 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:56.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.275+0000 7fe1ab400640 1 --2- 172.21.15.42:0/2031085215 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b40cec40 0x7fe1b4159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:56.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.275+0000 7fe1b3e00640 1 --2- 172.21.15.42:0/2031085215 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1b40b3550 0x7fe1b413e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:56.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.275+0000 7fe1b9200640 1 -- 172.21.15.42:0/2031085215 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1b40b3550 msgr2=0x7fe1b413e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:56.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.275+0000 7fe1b9200640 1 --2- 172.21.15.42:0/2031085215 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1b40b3550 0x7fe1b413e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:56.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.275+0000 7fe1b9200640 1 -- 172.21.15.42:0/2031085215 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b40cec40 msgr2=0x7fe1b4159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:56.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.275+0000 7fe1b9200640 1 --2- 172.21.15.42:0/2031085215 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b40cec40 0x7fe1b4159cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:56.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.275+0000 7fe1b9200640 1 -- 172.21.15.42:0/2031085215 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b41e6360 con 0x7fe1b4142f40 2024-09-17T01:43:56.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.275+0000 7fe1b9200640 1 --2- 172.21.15.42:0/2031085215 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1b4142f40 0x7fe1b415a200 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac009d90 tx=0x7fe1ac003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:56.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.276+0000 7fe1b0c00640 1 -- 172.21.15.42:0/2031085215 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac033050 con 0x7fe1b4142f40 2024-09-17T01:43:56.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.276+0000 7fe1b0c00640 1 -- 172.21.15.42:0/2031085215 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1ac004450 con 0x7fe1b4142f40 2024-09-17T01:43:56.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.276+0000 7fe1bb200640 1 -- 172.21.15.42:0/2031085215 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1b413f610 con 0x7fe1b4142f40 2024-09-17T01:43:56.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.276+0000 7fe1b0c00640 1 -- 172.21.15.42:0/2031085215 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac004860 con 0x7fe1b4142f40 2024-09-17T01:43:56.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.276+0000 7fe1bb200640 1 -- 172.21.15.42:0/2031085215 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1b413fb90 con 0x7fe1b4142f40 2024-09-17T01:43:56.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.277+0000 7fe1bb200640 1 -- 172.21.15.42:0/2031085215 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1b415cec0 con 0x7fe1b4142f40 2024-09-17T01:43:56.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.278+0000 7fe1b0c00640 1 -- 172.21.15.42:0/2031085215 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe1ac036070 con 0x7fe1b4142f40 2024-09-17T01:43:56.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.279+0000 7fe1b0c00640 1 --2- 172.21.15.42:0/2031085215 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe190078b90 0x7fe19007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:56.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.279+0000 7fe1b0c00640 1 -- 172.21.15.42:0/2031085215 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 4943+0+0 (secure 0 0 0) 0x7fe1ac0bbd20 con 0x7fe1b4142f40 2024-09-17T01:43:56.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.280+0000 7fe1b3e00640 1 --2- 172.21.15.42:0/2031085215 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe190078b90 0x7fe19007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:56.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.280+0000 7fe1b3e00640 1 --2- 172.21.15.42:0/2031085215 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe190078b90 0x7fe19007b0a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009b30 tx=0x7fe1a4005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:56.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.283+0000 7fe1b0c00640 1 -- 172.21.15.42:0/2031085215 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe1ac083d80 con 0x7fe1b4142f40 2024-09-17T01:43:56.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.477+0000 7fe1bb200640 1 -- 172.21.15.42:0/2031085215 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fe1b406a170 con 0x7fe1b4142f40 2024-09-17T01:43:56.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.481+0000 7fe1b0c00640 1 -- 172.21.15.42:0/2031085215 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v57) ==== 71+0+0 (secure 0 0 0) 0x7fe1ac0887b0 con 0x7fe1b4142f40 2024-09-17T01:43:56.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.484+0000 7fe1bb200640 1 -- 172.21.15.42:0/2031085215 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe190078b90 msgr2=0x7fe19007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:56.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.484+0000 7fe1bb200640 1 --2- 172.21.15.42:0/2031085215 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe190078b90 0x7fe19007b0a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009b30 tx=0x7fe1a4005f90 comp rx=0 tx=0).stop 2024-09-17T01:43:56.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.484+0000 7fe1bb200640 1 -- 172.21.15.42:0/2031085215 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1b4142f40 msgr2=0x7fe1b415a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:56.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.484+0000 7fe1bb200640 1 --2- 172.21.15.42:0/2031085215 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1b4142f40 0x7fe1b415a200 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac009d90 tx=0x7fe1ac003f10 comp rx=0 tx=0).stop 2024-09-17T01:43:56.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.484+0000 7fe1bb200640 1 -- 172.21.15.42:0/2031085215 shutdown_connections 2024-09-17T01:43:56.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.484+0000 7fe1bb200640 1 --2- 172.21.15.42:0/2031085215 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe190078b90 0x7fe19007b0a0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:56.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.484+0000 7fe1bb200640 1 --2- 172.21.15.42:0/2031085215 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b40cec40 0x7fe1b4159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:56.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.484+0000 7fe1bb200640 1 --2- 172.21.15.42:0/2031085215 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1b4142f40 0x7fe1b415a200 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:56.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.484+0000 7fe1bb200640 1 --2- 172.21.15.42:0/2031085215 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1b40b3550 0x7fe1b413e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:56.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.484+0000 7fe1bb200640 1 -- 172.21.15.42:0/2031085215 >> 172.21.15.42:0/2031085215 conn(0x7fe1b40b2930 msgr2=0x7fe1b406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:56.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.484+0000 7fe1bb200640 1 -- 172.21.15.42:0/2031085215 shutdown_connections 2024-09-17T01:43:56.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.484+0000 7fe1bb200640 1 -- 172.21.15.42:0/2031085215 wait complete. 2024-09-17T01:43:56.507 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-09-17T01:43:56.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.735+0000 7fb736e00640 1 -- 172.21.15.42:0/2705038058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7300cafe0 msgr2=0x7fb73006e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:56.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.735+0000 7fb736e00640 1 --2- 172.21.15.42:0/2705038058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7300cafe0 0x7fb73006e950 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fb730072190 tx=0x7fb72802a8b0 comp rx=0 tx=0).stop 2024-09-17T01:43:56.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.735+0000 7fb736e00640 1 -- 172.21.15.42:0/2705038058 shutdown_connections 2024-09-17T01:43:56.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.735+0000 7fb736e00640 1 --2- 172.21.15.42:0/2705038058 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7300cafe0 0x7fb73006e950 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:56.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.735+0000 7fb736e00640 1 --2- 172.21.15.42:0/2705038058 >> v2:172.21.15.43:3300/0 conn(0x7fb73015f830 0x7fb73015fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:56.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.735+0000 7fb736e00640 1 -- 172.21.15.42:0/2705038058 >> 172.21.15.42:0/2705038058 conn(0x7fb7300b25f0 msgr2=0x7fb7300d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:56.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.736+0000 7fb736e00640 1 -- 172.21.15.42:0/2705038058 shutdown_connections 2024-09-17T01:43:56.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.736+0000 7fb736e00640 1 -- 172.21.15.42:0/2705038058 wait complete. 2024-09-17T01:43:56.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.738+0000 7fb736e00640 1 Processor -- start 2024-09-17T01:43:56.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.738+0000 7fb736e00640 1 -- start start 2024-09-17T01:43:56.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.739+0000 7fb736e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7300cafe0 0x7fb73015e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:56.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.739+0000 7fb736e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb73015b680 0x7fb73014d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:56.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.739+0000 7fb736e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7300c9420 0x7fb7300c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:56.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.739+0000 7fb736e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb73006f490 con 0x7fb7300cafe0 2024-09-17T01:43:56.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.739+0000 7fb736e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb73006f310 con 0x7fb7300c9420 2024-09-17T01:43:56.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.739+0000 7fb736e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb73006f610 con 0x7fb73015b680 2024-09-17T01:43:56.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.740+0000 7fb735a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7300cafe0 0x7fb73015e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:56.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.740+0000 7fb735a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7300cafe0 0x7fb73015e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54084/0 (socket says 172.21.15.42:54084) 2024-09-17T01:43:56.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.740+0000 7fb735a00640 1 -- 172.21.15.42:0/2738539490 learned_addr learned my addr 172.21.15.42:0/2738539490 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:56.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.740+0000 7fb735000640 1 --2- 172.21.15.42:0/2738539490 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb73015b680 0x7fb73014d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:56.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.740+0000 7fb736400640 1 --2- 172.21.15.42:0/2738539490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7300c9420 0x7fb7300c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:56.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.740+0000 7fb735a00640 1 -- 172.21.15.42:0/2738539490 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb73015b680 msgr2=0x7fb73014d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:56.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.740+0000 7fb735a00640 1 --2- 172.21.15.42:0/2738539490 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb73015b680 0x7fb73014d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:56.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.740+0000 7fb735a00640 1 -- 172.21.15.42:0/2738539490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7300c9420 msgr2=0x7fb7300c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:56.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.740+0000 7fb735a00640 1 --2- 172.21.15.42:0/2738539490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7300c9420 0x7fb7300c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:56.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.740+0000 7fb735a00640 1 -- 172.21.15.42:0/2738539490 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7300c9d70 con 0x7fb7300cafe0 2024-09-17T01:43:56.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.741+0000 7fb735a00640 1 --2- 172.21.15.42:0/2738539490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7300cafe0 0x7fb73015e6b0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fb72400c3c0 tx=0x7fb72400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:56.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.741+0000 7fb72d600640 1 -- 172.21.15.42:0/2738539490 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb724017070 con 0x7fb7300cafe0 2024-09-17T01:43:56.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.741+0000 7fb72d600640 1 -- 172.21.15.42:0/2738539490 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7240035f0 con 0x7fb7300cafe0 2024-09-17T01:43:56.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.741+0000 7fb72d600640 1 -- 172.21.15.42:0/2738539490 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb724003a80 con 0x7fb7300cafe0 2024-09-17T01:43:56.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.741+0000 7fb736e00640 1 -- 172.21.15.42:0/2738539490 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb73014de30 con 0x7fb7300cafe0 2024-09-17T01:43:56.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.741+0000 7fb736e00640 1 -- 172.21.15.42:0/2738539490 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7301559e0 con 0x7fb7300cafe0 2024-09-17T01:43:56.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.742+0000 7fb736e00640 1 -- 172.21.15.42:0/2738539490 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb730155230 con 0x7fb7300cafe0 2024-09-17T01:43:56.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.744+0000 7fb72d600640 1 -- 172.21.15.42:0/2738539490 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb72401a070 con 0x7fb7300cafe0 2024-09-17T01:43:56.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.745+0000 7fb72d600640 1 --2- 172.21.15.42:0/2738539490 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb710078b90 0x7fb71007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:56.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.745+0000 7fb72d600640 1 -- 172.21.15.42:0/2738539490 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 4943+0+0 (secure 0 0 0) 0x7fb72409a100 con 0x7fb7300cafe0 2024-09-17T01:43:56.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.745+0000 7fb735000640 1 --2- 172.21.15.42:0/2738539490 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb710078b90 0x7fb71007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:56.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.746+0000 7fb735000640 1 --2- 172.21.15.42:0/2738539490 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb710078b90 0x7fb71007b0a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb7300aee40 tx=0x7fb71c00b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:56.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:56.748+0000 7fb72d600640 1 -- 172.21.15.42:0/2738539490 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb724021020 con 0x7fb7300cafe0 2024-09-17T01:43:57.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:57.019+0000 7fb736e00640 1 -- 172.21.15.42:0/2738539490 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) -- 0x7fb73006fac0 con 0x7fb7300cafe0 2024-09-17T01:43:57.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:57.975+0000 7fb72d600640 1 -- 172.21.15.42:0/2738539490 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v565) ==== 166+0+0 (secure 0 0 0) 0x7fb724067e20 con 0x7fb7300cafe0 2024-09-17T01:43:57.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:57.978+0000 7fb736e00640 1 -- 172.21.15.42:0/2738539490 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb710078b90 msgr2=0x7fb71007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:57.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:57.978+0000 7fb736e00640 1 --2- 172.21.15.42:0/2738539490 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb710078b90 0x7fb71007b0a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb7300aee40 tx=0x7fb71c00b2e0 comp rx=0 tx=0).stop 2024-09-17T01:43:57.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:57.979+0000 7fb736e00640 1 -- 172.21.15.42:0/2738539490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7300cafe0 msgr2=0x7fb73015e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:57.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:57.979+0000 7fb736e00640 1 --2- 172.21.15.42:0/2738539490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7300cafe0 0x7fb73015e6b0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fb72400c3c0 tx=0x7fb72400c880 comp rx=0 tx=0).stop 2024-09-17T01:43:57.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:57.979+0000 7fb736e00640 1 -- 172.21.15.42:0/2738539490 shutdown_connections 2024-09-17T01:43:57.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:57.979+0000 7fb736e00640 1 --2- 172.21.15.42:0/2738539490 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb710078b90 0x7fb71007b0a0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:57.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:57.979+0000 7fb736e00640 1 --2- 172.21.15.42:0/2738539490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7300c9420 0x7fb7300c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:57.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:57.979+0000 7fb736e00640 1 --2- 172.21.15.42:0/2738539490 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb73015b680 0x7fb73014d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:57.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:57.979+0000 7fb736e00640 1 --2- 172.21.15.42:0/2738539490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb7300cafe0 0x7fb73015e6b0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:57.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:57.979+0000 7fb736e00640 1 -- 172.21.15.42:0/2738539490 >> 172.21.15.42:0/2738539490 conn(0x7fb7300b25f0 msgr2=0x7fb7300aff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:57.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:57.979+0000 7fb736e00640 1 -- 172.21.15.42:0/2738539490 shutdown_connections 2024-09-17T01:43:57.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:57.979+0000 7fb736e00640 1 -- 172.21.15.42:0/2738539490 wait complete. 2024-09-17T01:43:58.005 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-17T01:43:58.005 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-17T01:43:58.006 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:43:58.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.237+0000 7fe0b1600640 1 -- 172.21.15.42:0/2264703390 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0ac0cafe0 msgr2=0x7fe0ac15f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:58.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.237+0000 7fe0b1600640 1 --2- 172.21.15.42:0/2264703390 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0ac0cafe0 0x7fe0ac15f120 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7fe098005fd0 tx=0x7fe09802a5c0 comp rx=0 tx=0).stop 2024-09-17T01:43:58.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.237+0000 7fe0b1600640 1 -- 172.21.15.42:0/2264703390 shutdown_connections 2024-09-17T01:43:58.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.237+0000 7fe0b1600640 1 --2- 172.21.15.42:0/2264703390 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0ac0cafe0 0x7fe0ac15f120 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:58.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.237+0000 7fe0b1600640 1 --2- 172.21.15.42:0/2264703390 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0ac15b680 0x7fe0ac15fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:58.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.237+0000 7fe0b1600640 1 -- 172.21.15.42:0/2264703390 >> 172.21.15.42:0/2264703390 conn(0x7fe0ac0b25f0 msgr2=0x7fe0ac0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:58.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.237+0000 7fe0b1600640 1 -- 172.21.15.42:0/2264703390 shutdown_connections 2024-09-17T01:43:58.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.237+0000 7fe0b1600640 1 -- 172.21.15.42:0/2264703390 wait complete. 2024-09-17T01:43:58.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.240+0000 7fe0b1600640 1 Processor -- start 2024-09-17T01:43:58.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.240+0000 7fe0b1600640 1 -- start start 2024-09-17T01:43:58.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.241+0000 7fe0b1600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0ac0cafe0 0x7fe0ac1f9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:58.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.241+0000 7fe0b1600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0ac15b680 0x7fe0ac154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:58.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.241+0000 7fe0b1600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0ac15f660 0x7fe0ac0ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:58.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.241+0000 7fe0b1600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ac0b37b0 con 0x7fe0ac15b680 2024-09-17T01:43:58.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.241+0000 7fe0b1600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ac06fc80 con 0x7fe0ac15f660 2024-09-17T01:43:58.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.242+0000 7fe0b1600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe0ac0b3930 con 0x7fe0ac0cafe0 2024-09-17T01:43:58.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.242+0000 7fe0ab400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0ac15b680 0x7fe0ac154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:58.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.242+0000 7fe0ab400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0ac15b680 0x7fe0ac154610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54100/0 (socket says 172.21.15.42:54100) 2024-09-17T01:43:58.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.242+0000 7fe0ab400640 1 -- 172.21.15.42:0/2455651971 learned_addr learned my addr 172.21.15.42:0/2455651971 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:58.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.242+0000 7fe0abe00640 1 --2- 172.21.15.42:0/2455651971 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0ac0cafe0 0x7fe0ac1f9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:58.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.242+0000 7fe0b0c00640 1 --2- 172.21.15.42:0/2455651971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0ac15f660 0x7fe0ac0ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:58.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.242+0000 7fe0ab400640 1 -- 172.21.15.42:0/2455651971 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0ac0cafe0 msgr2=0x7fe0ac1f9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:58.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.242+0000 7fe0ab400640 1 --2- 172.21.15.42:0/2455651971 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0ac0cafe0 0x7fe0ac1f9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:58.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.242+0000 7fe0ab400640 1 -- 172.21.15.42:0/2455651971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0ac15f660 msgr2=0x7fe0ac0ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:58.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.242+0000 7fe0ab400640 1 --2- 172.21.15.42:0/2455651971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0ac15f660 0x7fe0ac0ae140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:58.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.242+0000 7fe0ab400640 1 -- 172.21.15.42:0/2455651971 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0ac1fa210 con 0x7fe0ac15b680 2024-09-17T01:43:58.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.242+0000 7fe0ab400640 1 --2- 172.21.15.42:0/2455651971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0ac15b680 0x7fe0ac154610 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fe098034040 tx=0x7fe0980038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:58.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.243+0000 7fe0a3e00640 1 -- 172.21.15.42:0/2455651971 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09803e030 con 0x7fe0ac15b680 2024-09-17T01:43:58.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.243+0000 7fe0a3e00640 1 -- 172.21.15.42:0/2455651971 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe098003d90 con 0x7fe0ac15b680 2024-09-17T01:43:58.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.243+0000 7fe0a3e00640 1 -- 172.21.15.42:0/2455651971 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe098035040 con 0x7fe0ac15b680 2024-09-17T01:43:58.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.243+0000 7fe0b1600640 1 -- 172.21.15.42:0/2455651971 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0ac1f62c0 con 0x7fe0ac15b680 2024-09-17T01:43:58.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.243+0000 7fe0b1600640 1 -- 172.21.15.42:0/2455651971 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0ac1f6880 con 0x7fe0ac15b680 2024-09-17T01:43:58.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.244+0000 7fe0b1600640 1 -- 172.21.15.42:0/2455651971 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0ac0b3e50 con 0x7fe0ac15b680 2024-09-17T01:43:58.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.245+0000 7fe0a3e00640 1 -- 172.21.15.42:0/2455651971 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe098041030 con 0x7fe0ac15b680 2024-09-17T01:43:58.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.246+0000 7fe0a3e00640 1 --2- 172.21.15.42:0/2455651971 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe08c078b90 0x7fe08c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:58.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.246+0000 7fe0a3e00640 1 -- 172.21.15.42:0/2455651971 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 4943+0+0 (secure 0 0 0) 0x7fe0980bb550 con 0x7fe0ac15b680 2024-09-17T01:43:58.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.247+0000 7fe0abe00640 1 --2- 172.21.15.42:0/2455651971 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe08c078b90 0x7fe08c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:58.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.247+0000 7fe0abe00640 1 --2- 172.21.15.42:0/2455651971 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe08c078b90 0x7fe08c07b0a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00bb50 tx=0x7fe09c00b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:58.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.251+0000 7fe0a3e00640 1 -- 172.21.15.42:0/2455651971 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe0ac1fa210 con 0x7fe0ac15b680 2024-09-17T01:43:58.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.443+0000 7fe0b1600640 1 -- 172.21.15.42:0/2455651971 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0ac0cf5a0 con 0x7fe0ac15b680 2024-09-17T01:43:58.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.444+0000 7fe0a3e00640 1 -- 172.21.15.42:0/2455651971 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) ==== 74+0+12994 (secure 0 0 0) 0x7fe098083640 con 0x7fe0ac15b680 2024-09-17T01:43:58.443 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:43:58.443 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":152,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:43:55.961512+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6834/3811049376":"2024-09-18T01:43:52.950915+0000","172.21.15.42:6832/3811049376":"2024-09-18T01:43:52.950915+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:43:58.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.447+0000 7fe0b1600640 1 -- 172.21.15.42:0/2455651971 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe08c078b90 msgr2=0x7fe08c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:58.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.447+0000 7fe0b1600640 1 --2- 172.21.15.42:0/2455651971 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe08c078b90 0x7fe08c07b0a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00bb50 tx=0x7fe09c00b2e0 comp rx=0 tx=0).stop 2024-09-17T01:43:58.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.447+0000 7fe0b1600640 1 -- 172.21.15.42:0/2455651971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0ac15b680 msgr2=0x7fe0ac154610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:58.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.447+0000 7fe0b1600640 1 --2- 172.21.15.42:0/2455651971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0ac15b680 0x7fe0ac154610 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fe098034040 tx=0x7fe0980038a0 comp rx=0 tx=0).stop 2024-09-17T01:43:58.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.447+0000 7fe0b1600640 1 -- 172.21.15.42:0/2455651971 shutdown_connections 2024-09-17T01:43:58.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.447+0000 7fe0b1600640 1 --2- 172.21.15.42:0/2455651971 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe08c078b90 0x7fe08c07b0a0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:58.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.447+0000 7fe0b1600640 1 --2- 172.21.15.42:0/2455651971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0ac15f660 0x7fe0ac0ae140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:58.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.447+0000 7fe0b1600640 1 --2- 172.21.15.42:0/2455651971 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0ac15b680 0x7fe0ac154610 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:58.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.447+0000 7fe0b1600640 1 --2- 172.21.15.42:0/2455651971 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0ac0cafe0 0x7fe0ac1f9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:58.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.447+0000 7fe0b1600640 1 -- 172.21.15.42:0/2455651971 >> 172.21.15.42:0/2455651971 conn(0x7fe0ac0b25f0 msgr2=0x7fe0ac0cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:58.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.447+0000 7fe0b1600640 1 -- 172.21.15.42:0/2455651971 shutdown_connections 2024-09-17T01:43:58.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.447+0000 7fe0b1600640 1 -- 172.21.15.42:0/2455651971 wait complete. 2024-09-17T01:43:58.471 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T01:31:55.004951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T01:43:58.471 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T01:43:58.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.702+0000 7f3fb3200640 1 -- 172.21.15.42:0/3829928313 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fb40b3b80 msgr2=0x7f3fb40b3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:58.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.702+0000 7f3fb3200640 1 --2- 172.21.15.42:0/3829928313 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fb40b3b80 0x7f3fb40b3f90 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f3fac005fd0 tx=0x7f3fac02aa10 comp rx=0 tx=0).stop 2024-09-17T01:43:58.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.702+0000 7f3fb3200640 1 -- 172.21.15.42:0/3829928313 shutdown_connections 2024-09-17T01:43:58.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.702+0000 7f3fb3200640 1 --2- 172.21.15.42:0/3829928313 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fb40b3b80 0x7f3fb40b3f90 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:58.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.702+0000 7f3fb3200640 1 --2- 172.21.15.42:0/3829928313 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3fb41600f0 0x7f3fb4160500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:58.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.702+0000 7f3fb3200640 1 -- 172.21.15.42:0/3829928313 >> 172.21.15.42:0/3829928313 conn(0x7f3fb40b27a0 msgr2=0x7f3fb40d0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:58.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.703+0000 7f3fb3200640 1 -- 172.21.15.42:0/3829928313 shutdown_connections 2024-09-17T01:43:58.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.703+0000 7f3fb3200640 1 -- 172.21.15.42:0/3829928313 wait complete. 2024-09-17T01:43:58.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.705+0000 7f3fb3200640 1 Processor -- start 2024-09-17T01:43:58.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.705+0000 7f3fb3200640 1 -- start start 2024-09-17T01:43:58.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.706+0000 7f3fb3200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3fb40b3b80 0x7f3fb41f38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:58.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.706+0000 7f3fb3200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fb4156ba0 0x7f3fb4158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:58.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.706+0000 7f3fb3200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fb41600f0 0x7f3fb4158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:58.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.706+0000 7f3fb3200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb4074e90 con 0x7f3fb4156ba0 2024-09-17T01:43:58.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.706+0000 7f3fb3200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb415de20 con 0x7f3fb41600f0 2024-09-17T01:43:58.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.706+0000 7f3fb3200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3fb40b44d0 con 0x7f3fb40b3b80 2024-09-17T01:43:58.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.707+0000 7f3fb1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fb4156ba0 0x7f3fb4158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:58.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.707+0000 7f3fb1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fb4156ba0 0x7f3fb4158720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54116/0 (socket says 172.21.15.42:54116) 2024-09-17T01:43:58.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.707+0000 7f3fb1400640 1 -- 172.21.15.42:0/1800793702 learned_addr learned my addr 172.21.15.42:0/1800793702 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:58.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.707+0000 7f3fb1e00640 1 --2- 172.21.15.42:0/1800793702 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3fb40b3b80 0x7f3fb41f38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:58.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.707+0000 7f3fb2800640 1 --2- 172.21.15.42:0/1800793702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fb41600f0 0x7f3fb4158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:58.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.707+0000 7f3fb1400640 1 -- 172.21.15.42:0/1800793702 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3fb40b3b80 msgr2=0x7f3fb41f38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:58.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.707+0000 7f3fb1400640 1 --2- 172.21.15.42:0/1800793702 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3fb40b3b80 0x7f3fb41f38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:58.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.707+0000 7f3fb1400640 1 -- 172.21.15.42:0/1800793702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fb41600f0 msgr2=0x7f3fb4158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:58.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.707+0000 7f3fb1400640 1 --2- 172.21.15.42:0/1800793702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fb41600f0 0x7f3fb4158c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:58.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.707+0000 7f3fb1400640 1 -- 172.21.15.42:0/1800793702 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb41f4160 con 0x7f3fb4156ba0 2024-09-17T01:43:58.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.708+0000 7f3fb1400640 1 --2- 172.21.15.42:0/1800793702 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fb4156ba0 0x7f3fb4158720 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009fd0 tx=0x7f3fa000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:58.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.708+0000 7f3faa000640 1 -- 172.21.15.42:0/1800793702 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa000ccc0 con 0x7f3fb4156ba0 2024-09-17T01:43:58.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.708+0000 7f3faa000640 1 -- 172.21.15.42:0/1800793702 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fa000ee70 con 0x7f3fb4156ba0 2024-09-17T01:43:58.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.708+0000 7f3faa000640 1 -- 172.21.15.42:0/1800793702 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa000ce60 con 0x7f3fb4156ba0 2024-09-17T01:43:58.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.708+0000 7f3fb3200640 1 -- 172.21.15.42:0/1800793702 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fb41f4440 con 0x7f3fb4156ba0 2024-09-17T01:43:58.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.708+0000 7f3fb3200640 1 -- 172.21.15.42:0/1800793702 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fb409cf40 con 0x7f3fb4156ba0 2024-09-17T01:43:58.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.709+0000 7f3fb3200640 1 -- 172.21.15.42:0/1800793702 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fb40b4950 con 0x7f3fb4156ba0 2024-09-17T01:43:58.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.710+0000 7f3faa000640 1 -- 172.21.15.42:0/1800793702 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3fa0005260 con 0x7f3fb4156ba0 2024-09-17T01:43:58.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.711+0000 7f3faa000640 1 --2- 172.21.15.42:0/1800793702 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3f94078b90 0x7f3f9407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:58.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.712+0000 7f3faa000640 1 -- 172.21.15.42:0/1800793702 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 4943+0+0 (secure 0 0 0) 0x7f3fa009b620 con 0x7f3fb4156ba0 2024-09-17T01:43:58.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.712+0000 7f3fb1e00640 1 --2- 172.21.15.42:0/1800793702 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3f94078b90 0x7f3f9407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:58.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.713+0000 7f3fb1e00640 1 --2- 172.21.15.42:0/1800793702 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3f94078b90 0x7f3f9407b0a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4001720 tx=0x7f3fa4009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:58.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.715+0000 7f3faa000640 1 -- 172.21.15.42:0/1800793702 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3fa0063810 con 0x7f3fb4156ba0 2024-09-17T01:43:58.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.908+0000 7f3fb3200640 1 -- 172.21.15.42:0/1800793702 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3fb40725a0 con 0x7f3fb4156ba0 2024-09-17T01:43:58.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.909+0000 7f3faa000640 1 -- 172.21.15.42:0/1800793702 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v152) ==== 93+0+10 (secure 0 0 0) 0x7f3fa0068240 con 0x7f3fb4156ba0 2024-09-17T01:43:58.908 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-09-17T01:43:58.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.911+0000 7f3fb3200640 1 -- 172.21.15.42:0/1800793702 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3f94078b90 msgr2=0x7f3f9407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:58.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.911+0000 7f3fb3200640 1 --2- 172.21.15.42:0/1800793702 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3f94078b90 0x7f3f9407b0a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4001720 tx=0x7f3fa4009040 comp rx=0 tx=0).stop 2024-09-17T01:43:58.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.911+0000 7f3fb3200640 1 -- 172.21.15.42:0/1800793702 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fb4156ba0 msgr2=0x7f3fb4158720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:58.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.911+0000 7f3fb3200640 1 --2- 172.21.15.42:0/1800793702 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fb4156ba0 0x7f3fb4158720 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009fd0 tx=0x7f3fa000ec20 comp rx=0 tx=0).stop 2024-09-17T01:43:58.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.911+0000 7f3fb3200640 1 -- 172.21.15.42:0/1800793702 shutdown_connections 2024-09-17T01:43:58.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.911+0000 7f3fb3200640 1 --2- 172.21.15.42:0/1800793702 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3f94078b90 0x7f3f9407b0a0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:58.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.911+0000 7f3fb3200640 1 --2- 172.21.15.42:0/1800793702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fb41600f0 0x7f3fb4158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:58.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.911+0000 7f3fb3200640 1 --2- 172.21.15.42:0/1800793702 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fb4156ba0 0x7f3fb4158720 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:58.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.911+0000 7f3fb3200640 1 --2- 172.21.15.42:0/1800793702 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3fb40b3b80 0x7f3fb41f38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:58.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.911+0000 7f3fb3200640 1 -- 172.21.15.42:0/1800793702 >> 172.21.15.42:0/1800793702 conn(0x7f3fb40b27a0 msgr2=0x7f3fb40b1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:58.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.911+0000 7f3fb3200640 1 -- 172.21.15.42:0/1800793702 shutdown_connections 2024-09-17T01:43:58.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:58.912+0000 7f3fb3200640 1 -- 172.21.15.42:0/1800793702 wait complete. 2024-09-17T01:43:58.937 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-09-17T01:43:59.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.166+0000 7f1e02e00640 1 -- 172.21.15.42:0/2101303161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dfc0b4be0 msgr2=0x7f1dfc15d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:59.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.166+0000 7f1e02e00640 1 --2- 172.21.15.42:0/2101303161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dfc0b4be0 0x7f1dfc15d6b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1df0005fd0 tx=0x7f1df002a5d0 comp rx=0 tx=0).stop 2024-09-17T01:43:59.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.166+0000 7f1e02e00640 1 -- 172.21.15.42:0/2101303161 shutdown_connections 2024-09-17T01:43:59.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.166+0000 7f1e02e00640 1 --2- 172.21.15.42:0/2101303161 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1dfc0cf7c0 0x7f1dfc06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:59.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.166+0000 7f1e02e00640 1 --2- 172.21.15.42:0/2101303161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dfc0b4be0 0x7f1dfc15d6b0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:59.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.166+0000 7f1e02e00640 1 -- 172.21.15.42:0/2101303161 >> 172.21.15.42:0/2101303161 conn(0x7f1dfc0b25f0 msgr2=0x7f1dfc0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:59.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.166+0000 7f1e02e00640 1 -- 172.21.15.42:0/2101303161 shutdown_connections 2024-09-17T01:43:59.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.166+0000 7f1e02e00640 1 -- 172.21.15.42:0/2101303161 wait complete. 2024-09-17T01:43:59.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.168+0000 7f1e02e00640 1 Processor -- start 2024-09-17T01:43:59.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.168+0000 7f1e02e00640 1 -- start start 2024-09-17T01:43:59.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.170+0000 7f1e02e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1dfc06d260 0x7f1dfc0749f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:59.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.170+0000 7f1e02e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dfc0b4be0 0x7f1dfc149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:59.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.170+0000 7f1e02e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dfc0cf7c0 0x7f1dfc0728d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:59.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.170+0000 7f1e02e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc153970 con 0x7f1dfc0cf7c0 2024-09-17T01:43:59.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.170+0000 7f1e02e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc1537f0 con 0x7f1dfc0b4be0 2024-09-17T01:43:59.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.170+0000 7f1e02e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1dfc153af0 con 0x7f1dfc06d260 2024-09-17T01:43:59.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.170+0000 7f1e02400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dfc0cf7c0 0x7f1dfc0728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:59.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.170+0000 7f1e01a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1dfc06d260 0x7f1dfc0749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:59.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.170+0000 7f1e02400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dfc0cf7c0 0x7f1dfc0728d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54120/0 (socket says 172.21.15.42:54120) 2024-09-17T01:43:59.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.170+0000 7f1e02400640 1 -- 172.21.15.42:0/898447618 learned_addr learned my addr 172.21.15.42:0/898447618 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:43:59.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.170+0000 7f1e01000640 1 --2- 172.21.15.42:0/898447618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dfc0b4be0 0x7f1dfc149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:59.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.171+0000 7f1e01a00640 1 -- 172.21.15.42:0/898447618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dfc0b4be0 msgr2=0x7f1dfc149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:59.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.171+0000 7f1e01a00640 1 --2- 172.21.15.42:0/898447618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dfc0b4be0 0x7f1dfc149790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:59.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.171+0000 7f1e01a00640 1 -- 172.21.15.42:0/898447618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dfc0cf7c0 msgr2=0x7f1dfc0728d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:59.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.171+0000 7f1e01a00640 1 --2- 172.21.15.42:0/898447618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dfc0cf7c0 0x7f1dfc0728d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:59.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.171+0000 7f1e01a00640 1 -- 172.21.15.42:0/898447618 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dfc150ea0 con 0x7f1dfc06d260 2024-09-17T01:43:59.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.171+0000 7f1e02400640 1 --2- 172.21.15.42:0/898447618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dfc0cf7c0 0x7f1dfc0728d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:43:59.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.171+0000 7f1e01000640 1 --2- 172.21.15.42:0/898447618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dfc0b4be0 0x7f1dfc149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:43:59.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.171+0000 7f1e01a00640 1 --2- 172.21.15.42:0/898447618 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1dfc06d260 0x7f1dfc0749f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc09e3d0 tx=0x7f1df00035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:59.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.172+0000 7f1df9600640 1 -- 172.21.15.42:0/898447618 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df003e030 con 0x7f1dfc06d260 2024-09-17T01:43:59.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.172+0000 7f1e02e00640 1 -- 172.21.15.42:0/898447618 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dfc151140 con 0x7f1dfc06d260 2024-09-17T01:43:59.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.172+0000 7f1df9600640 1 -- 172.21.15.42:0/898447618 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1df0003ae0 con 0x7f1dfc06d260 2024-09-17T01:43:59.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.172+0000 7f1df9600640 1 -- 172.21.15.42:0/898447618 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df0035040 con 0x7f1dfc06d260 2024-09-17T01:43:59.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.172+0000 7f1e02e00640 1 -- 172.21.15.42:0/898447618 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dfc151700 con 0x7f1dfc06d260 2024-09-17T01:43:59.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.173+0000 7f1e02e00640 1 -- 172.21.15.42:0/898447618 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dfc15d6b0 con 0x7f1dfc06d260 2024-09-17T01:43:59.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.174+0000 7f1df9600640 1 -- 172.21.15.42:0/898447618 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1df0041030 con 0x7f1dfc06d260 2024-09-17T01:43:59.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.175+0000 7f1df9600640 1 --2- 172.21.15.42:0/898447618 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1ddc078b90 0x7f1ddc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:59.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.175+0000 7f1df9600640 1 -- 172.21.15.42:0/898447618 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(152..152 src has 1..152) ==== 4943+0+0 (secure 0 0 0) 0x7f1df00bb0c0 con 0x7f1dfc06d260 2024-09-17T01:43:59.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.175+0000 7f1e01000640 1 --2- 172.21.15.42:0/898447618 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1ddc078b90 0x7f1ddc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:59.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.176+0000 7f1e01000640 1 --2- 172.21.15.42:0/898447618 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1ddc078b90 0x7f1ddc07b0a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0af560 tx=0x7f1de8005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:59.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.179+0000 7f1df9600640 1 -- 172.21.15.42:0/898447618 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1df0083110 con 0x7f1dfc06d260 2024-09-17T01:43:59.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.444+0000 7f1e02e00640 1 -- 172.21.15.42:0/898447618 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) -- 0x7f1dfc0b17e0 con 0x7f1dfc06d260 2024-09-17T01:43:59.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.989+0000 7f1df9600640 1 -- 172.21.15.42:0/898447618 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v567) ==== 169+0+0 (secure 0 0 0) 0x7f1df0087b40 con 0x7f1dfc06d260 2024-09-17T01:43:59.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.992+0000 7f1e02e00640 1 -- 172.21.15.42:0/898447618 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1ddc078b90 msgr2=0x7f1ddc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:59.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.992+0000 7f1e02e00640 1 --2- 172.21.15.42:0/898447618 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1ddc078b90 0x7f1ddc07b0a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0af560 tx=0x7f1de8005f90 comp rx=0 tx=0).stop 2024-09-17T01:43:59.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.992+0000 7f1e02e00640 1 -- 172.21.15.42:0/898447618 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1dfc06d260 msgr2=0x7f1dfc0749f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:59.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.992+0000 7f1e02e00640 1 --2- 172.21.15.42:0/898447618 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1dfc06d260 0x7f1dfc0749f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc09e3d0 tx=0x7f1df00035f0 comp rx=0 tx=0).stop 2024-09-17T01:43:59.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.992+0000 7f1e02e00640 1 -- 172.21.15.42:0/898447618 shutdown_connections 2024-09-17T01:43:59.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.992+0000 7f1e02e00640 1 --2- 172.21.15.42:0/898447618 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1ddc078b90 0x7f1ddc07b0a0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:59.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.992+0000 7f1e02e00640 1 --2- 172.21.15.42:0/898447618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dfc0b4be0 0x7f1dfc149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:59.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.992+0000 7f1e02e00640 1 --2- 172.21.15.42:0/898447618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dfc0cf7c0 0x7f1dfc0728d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:59.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.992+0000 7f1e02e00640 1 --2- 172.21.15.42:0/898447618 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1dfc06d260 0x7f1dfc0749f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:59.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.992+0000 7f1e02e00640 1 -- 172.21.15.42:0/898447618 >> 172.21.15.42:0/898447618 conn(0x7f1dfc0b25f0 msgr2=0x7f1dfc0b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:59.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.992+0000 7f1e02e00640 1 -- 172.21.15.42:0/898447618 shutdown_connections 2024-09-17T01:43:59.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:43:59.992+0000 7f1e02e00640 1 -- 172.21.15.42:0/898447618 wait complete. 2024-09-17T01:44:00.018 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T01:44:00.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.248+0000 7f0c17200640 1 -- 172.21.15.42:0/367029326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bfc0050c0 msgr2=0x7f0bfc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:00.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.248+0000 7f0c17200640 1 --2- 172.21.15.42:0/367029326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bfc0050c0 0x7f0bfc00b9c0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f0c10005fd0 tx=0x7f0bfc005830 comp rx=0 tx=0).stop 2024-09-17T01:44:00.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.248+0000 7f0c16800640 1 -- 172.21.15.42:0/367029326 reap_dead start 2024-09-17T01:44:00.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.248+0000 7f0c17200640 1 -- 172.21.15.42:0/367029326 shutdown_connections 2024-09-17T01:44:00.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.248+0000 7f0c17200640 1 -- 172.21.15.42:0/367029326 >> 172.21.15.42:0/367029326 conn(0x7f0c180b25f0 msgr2=0x7f0c180d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:00.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.248+0000 7f0c17200640 1 -- 172.21.15.42:0/367029326 shutdown_connections 2024-09-17T01:44:00.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.248+0000 7f0c17200640 1 -- 172.21.15.42:0/367029326 wait complete. 2024-09-17T01:44:00.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.251+0000 7f0c17200640 1 Processor -- start 2024-09-17T01:44:00.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.251+0000 7f0c17200640 1 -- start start 2024-09-17T01:44:00.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.252+0000 7f0c17200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bfc0050c0 0x7f0c180ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:00.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.252+0000 7f0c17200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c1809def0 0x7f0c180c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:00.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.252+0000 7f0c17200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0c180c9b70 0x7f0c180aea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:00.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.252+0000 7f0c17200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0c180b4230 con 0x7f0bfc0050c0 2024-09-17T01:44:00.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.252+0000 7f0c17200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0c180b40b0 con 0x7f0c1809def0 2024-09-17T01:44:00.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.252+0000 7f0c17200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0c18152ed0 con 0x7f0c180c9b70 2024-09-17T01:44:00.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.252+0000 7f0c15e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bfc0050c0 0x7f0c180ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:00.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.252+0000 7f0c15e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bfc0050c0 0x7f0c180ca760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54144/0 (socket says 172.21.15.42:54144) 2024-09-17T01:44:00.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.252+0000 7f0c15e00640 1 -- 172.21.15.42:0/3725021017 learned_addr learned my addr 172.21.15.42:0/3725021017 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:00.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.253+0000 7f0c15e00640 1 -- 172.21.15.42:0/3725021017 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0c180c9b70 msgr2=0x7f0c180aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:00.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.253+0000 7f0c15e00640 1 --2- 172.21.15.42:0/3725021017 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0c180c9b70 0x7f0c180aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:00.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.253+0000 7f0c15400640 1 --2- 172.21.15.42:0/3725021017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c1809def0 0x7f0c180c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:00.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.253+0000 7f0c15e00640 1 -- 172.21.15.42:0/3725021017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c1809def0 msgr2=0x7f0c180c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:00.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.253+0000 7f0c15e00640 1 --2- 172.21.15.42:0/3725021017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c1809def0 0x7f0c180c9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:00.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.253+0000 7f0c15e00640 1 -- 172.21.15.42:0/3725021017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c181e72d0 con 0x7f0bfc0050c0 2024-09-17T01:44:00.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.253+0000 7f0c15400640 1 --2- 172.21.15.42:0/3725021017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c1809def0 0x7f0c180c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:44:00.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.253+0000 7f0c15e00640 1 --2- 172.21.15.42:0/3725021017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bfc0050c0 0x7f0c180ca760 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f0c08003ed0 tx=0x7f0c08001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:00.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.253+0000 7f0c0e000640 1 -- 172.21.15.42:0/3725021017 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c08015070 con 0x7f0bfc0050c0 2024-09-17T01:44:00.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.254+0000 7f0c0e000640 1 -- 172.21.15.42:0/3725021017 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c08011840 con 0x7f0bfc0050c0 2024-09-17T01:44:00.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.254+0000 7f0c0e000640 1 -- 172.21.15.42:0/3725021017 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c08011c90 con 0x7f0bfc0050c0 2024-09-17T01:44:00.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.254+0000 7f0c17200640 1 -- 172.21.15.42:0/3725021017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c181e75b0 con 0x7f0bfc0050c0 2024-09-17T01:44:00.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.254+0000 7f0c17200640 1 -- 172.21.15.42:0/3725021017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c181e7b70 con 0x7f0bfc0050c0 2024-09-17T01:44:00.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.255+0000 7f0c17200640 1 -- 172.21.15.42:0/3725021017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c181e7040 con 0x7f0bfc0050c0 2024-09-17T01:44:00.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.256+0000 7f0c0e000640 1 -- 172.21.15.42:0/3725021017 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0c08018070 con 0x7f0bfc0050c0 2024-09-17T01:44:00.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.257+0000 7f0c0e000640 1 --2- 172.21.15.42:0/3725021017 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0bf8078b90 0x7f0bf807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:00.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.257+0000 7f0c0e000640 1 -- 172.21.15.42:0/3725021017 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 4943+0+0 (secure 0 0 0) 0x7f0c0809b7b0 con 0x7f0bfc0050c0 2024-09-17T01:44:00.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.257+0000 7f0c15400640 1 --2- 172.21.15.42:0/3725021017 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0bf8078b90 0x7f0bf807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:00.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.258+0000 7f0c15400640 1 --2- 172.21.15.42:0/3725021017 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0bf8078b90 0x7f0bf807b0a0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0c04001010 tx=0x7f0c040067d0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:00.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.262+0000 7f0c0e000640 1 -- 172.21.15.42:0/3725021017 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0c08063e50 con 0x7f0bfc0050c0 2024-09-17T01:44:00.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.458+0000 7f0c17200640 1 -- 172.21.15.42:0/3725021017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f0c1806cd20 con 0x7f0bfc0050c0 2024-09-17T01:44:00.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.459+0000 7f0c0e000640 1 -- 172.21.15.42:0/3725021017 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v57) ==== 59+0+2294 (secure 0 0 0) 0x7f0c08063750 con 0x7f0bfc0050c0 2024-09-17T01:44:00.458 INFO:teuthology.orchestra.run.smithi042.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T01:44:00.458 INFO:teuthology.orchestra.run.smithi042.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T01:44:00.458 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced client_mount_timeout 30 2024-09-17T01:44:00.458 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_client 20/20 2024-09-17T01:44:00.458 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_mgr 20/20 2024-09-17T01:44:00.459 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_ms 1/1 2024-09-17T01:44:00.459 INFO:teuthology.orchestra.run.smithi042.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T01:44:00.459 INFO:teuthology.orchestra.run.smithi042.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T01:44:00.459 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3683.959260 2024-09-17T01:44:00.459 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4350.010833 2024-09-17T01:44:00.459 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4316.776055 2024-09-17T01:44:00.459 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3885.595082 2024-09-17T01:44:00.459 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3602.000737 2024-09-17T01:44:00.459 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4883.364748 2024-09-17T01:44:00.459 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3752.484811 2024-09-17T01:44:00.459 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3775.035963 2024-09-17T01:44:00.459 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds 20/20 2024-09-17T01:44:00.460 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T01:44:00.460 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_ms 2/2 2024-09-17T01:44:00.460 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_frag true 2024-09-17T01:44:00.460 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_scatterstat true 2024-09-17T01:44:00.460 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T01:44:00.460 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_verify_scatter true 2024-09-17T01:44:00.460 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T01:44:00.460 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T01:44:00.460 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T01:44:00.460 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced client_mount_timeout 600 2024-09-17T01:44:00.460 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_client 20/20 2024-09-17T01:44:00.461 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_ms 1/1 2024-09-17T01:44:00.461 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T01:44:00.461 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T01:44:00.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.462+0000 7f0c17200640 1 -- 172.21.15.42:0/3725021017 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0bf8078b90 msgr2=0x7f0bf807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:00.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.462+0000 7f0c17200640 1 --2- 172.21.15.42:0/3725021017 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0bf8078b90 0x7f0bf807b0a0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0c04001010 tx=0x7f0c040067d0 comp rx=0 tx=0).stop 2024-09-17T01:44:00.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.462+0000 7f0c17200640 1 -- 172.21.15.42:0/3725021017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bfc0050c0 msgr2=0x7f0c180ca760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:00.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.462+0000 7f0c17200640 1 --2- 172.21.15.42:0/3725021017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bfc0050c0 0x7f0c180ca760 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f0c08003ed0 tx=0x7f0c08001710 comp rx=0 tx=0).stop 2024-09-17T01:44:00.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.462+0000 7f0c17200640 1 -- 172.21.15.42:0/3725021017 shutdown_connections 2024-09-17T01:44:00.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.462+0000 7f0c17200640 1 --2- 172.21.15.42:0/3725021017 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0bf8078b90 0x7f0bf807b0a0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:00.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.462+0000 7f0c17200640 1 --2- 172.21.15.42:0/3725021017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c1809def0 0x7f0c180c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:00.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.462+0000 7f0c17200640 1 --2- 172.21.15.42:0/3725021017 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0c180c9b70 0x7f0c180aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:00.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.462+0000 7f0c17200640 1 --2- 172.21.15.42:0/3725021017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bfc0050c0 0x7f0c180ca760 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:00.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.462+0000 7f0c17200640 1 -- 172.21.15.42:0/3725021017 >> 172.21.15.42:0/3725021017 conn(0x7f0c180b25f0 msgr2=0x7f0c180b06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:00.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.462+0000 7f0c17200640 1 -- 172.21.15.42:0/3725021017 shutdown_connections 2024-09-17T01:44:00.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.462+0000 7f0c17200640 1 -- 172.21.15.42:0/3725021017 wait complete. 2024-09-17T01:44:00.483 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T01:44:00.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.715+0000 7f2f38600640 1 -- 172.21.15.42:0/1971565524 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f3006d430 msgr2=0x7f2f3006d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:00.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.715+0000 7f2f38600640 1 --2- 172.21.15.42:0/1971565524 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f3006d430 0x7f2f3006d840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2f28005fd0 tx=0x7f2f2802a840 comp rx=0 tx=0).stop 2024-09-17T01:44:00.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.715+0000 7f2f38600640 1 -- 172.21.15.42:0/1971565524 shutdown_connections 2024-09-17T01:44:00.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.715+0000 7f2f38600640 1 --2- 172.21.15.42:0/1971565524 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f3006d430 0x7f2f3006d840 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:00.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.715+0000 7f2f38600640 1 --2- 172.21.15.42:0/1971565524 >> v2:172.21.15.43:3300/0 conn(0x7f2f300af980 0x7f2f300ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:00.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.715+0000 7f2f38600640 1 -- 172.21.15.42:0/1971565524 >> 172.21.15.42:0/1971565524 conn(0x7f2f300b2930 msgr2=0x7f2f3006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:00.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.715+0000 7f2f38600640 1 -- 172.21.15.42:0/1971565524 shutdown_connections 2024-09-17T01:44:00.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.715+0000 7f2f38600640 1 -- 172.21.15.42:0/1971565524 wait complete. 2024-09-17T01:44:00.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.717+0000 7f2f38600640 1 Processor -- start 2024-09-17T01:44:00.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.717+0000 7f2f38600640 1 -- start start 2024-09-17T01:44:00.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.719+0000 7f2f38600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f3006d430 0x7f2f301f5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:00.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.719+0000 7f2f38600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f300af980 0x7f2f30155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:00.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.719+0000 7f2f38600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f300b3880 0x7f2f300b1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:00.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.719+0000 7f2f38600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2f30072ad0 con 0x7f2f300b3880 2024-09-17T01:44:00.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.719+0000 7f2f38600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2f30072950 con 0x7f2f300af980 2024-09-17T01:44:00.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.719+0000 7f2f38600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2f30072c50 con 0x7f2f3006d430 2024-09-17T01:44:00.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.719+0000 7f2f36600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f300b3880 0x7f2f300b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:00.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.719+0000 7f2f36600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f300b3880 0x7f2f300b1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54156/0 (socket says 172.21.15.42:54156) 2024-09-17T01:44:00.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.719+0000 7f2f36600640 1 -- 172.21.15.42:0/3032601268 learned_addr learned my addr 172.21.15.42:0/3032601268 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:00.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.719+0000 7f2f35200640 1 --2- 172.21.15.42:0/3032601268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f300af980 0x7f2f30155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:00.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.719+0000 7f2f35c00640 1 --2- 172.21.15.42:0/3032601268 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f3006d430 0x7f2f301f5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:00.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.720+0000 7f2f36600640 1 -- 172.21.15.42:0/3032601268 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f3006d430 msgr2=0x7f2f301f5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:00.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.720+0000 7f2f36600640 1 --2- 172.21.15.42:0/3032601268 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f3006d430 0x7f2f301f5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:00.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.720+0000 7f2f36600640 1 -- 172.21.15.42:0/3032601268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f300af980 msgr2=0x7f2f30155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:00.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.720+0000 7f2f36600640 1 --2- 172.21.15.42:0/3032601268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f300af980 0x7f2f30155660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:00.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.720+0000 7f2f36600640 1 -- 172.21.15.42:0/3032601268 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f301545c0 con 0x7f2f300b3880 2024-09-17T01:44:00.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.720+0000 7f2f36600640 1 --2- 172.21.15.42:0/3032601268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f300b3880 0x7f2f300b1230 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f2f28009cd0 tx=0x7f2f28032cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:00.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.720+0000 7f2f2d600640 1 -- 172.21.15.42:0/3032601268 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f28040070 con 0x7f2f300b3880 2024-09-17T01:44:00.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.720+0000 7f2f2d600640 1 -- 172.21.15.42:0/3032601268 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f28004560 con 0x7f2f300b3880 2024-09-17T01:44:00.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.720+0000 7f2f2d600640 1 -- 172.21.15.42:0/3032601268 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f28003e60 con 0x7f2f300b3880 2024-09-17T01:44:00.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.720+0000 7f2f38600640 1 -- 172.21.15.42:0/3032601268 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f301548a0 con 0x7f2f300b3880 2024-09-17T01:44:00.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.720+0000 7f2f38600640 1 -- 172.21.15.42:0/3032601268 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f30154e60 con 0x7f2f300b3880 2024-09-17T01:44:00.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.722+0000 7f2f38600640 1 -- 172.21.15.42:0/3032601268 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f3006d840 con 0x7f2f300b3880 2024-09-17T01:44:00.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.723+0000 7f2f2d600640 1 -- 172.21.15.42:0/3032601268 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2f28043070 con 0x7f2f300b3880 2024-09-17T01:44:00.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.724+0000 7f2f2d600640 1 --2- 172.21.15.42:0/3032601268 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f10078bc0 0x7f2f1007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:00.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.725+0000 7f2f2d600640 1 -- 172.21.15.42:0/3032601268 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 4943+0+0 (secure 0 0 0) 0x7f2f280bbc40 con 0x7f2f300b3880 2024-09-17T01:44:00.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.725+0000 7f2f35c00640 1 --2- 172.21.15.42:0/3032601268 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f10078bc0 0x7f2f1007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:00.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.726+0000 7f2f35c00640 1 --2- 172.21.15.42:0/3032601268 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f10078bc0 0x7f2f1007b0d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2f300cfb10 tx=0x7f2f24009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:00.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.729+0000 7f2f2d600640 1 -- 172.21.15.42:0/3032601268 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2f3006dd80 con 0x7f2f300b3880 2024-09-17T01:44:00.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.927+0000 7f2f38600640 1 -- 172.21.15.42:0/3032601268 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f2f3006a170 con 0x7f2f300b3880 2024-09-17T01:44:00.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.931+0000 7f2f2d600640 1 -- 172.21.15.42:0/3032601268 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v58)=0 v58) ==== 122+0+0 (secure 0 0 0) 0x7f2f28083c10 con 0x7f2f300b3880 2024-09-17T01:44:00.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.934+0000 7f2f38600640 1 -- 172.21.15.42:0/3032601268 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f10078bc0 msgr2=0x7f2f1007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:00.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.934+0000 7f2f38600640 1 --2- 172.21.15.42:0/3032601268 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f10078bc0 0x7f2f1007b0d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2f300cfb10 tx=0x7f2f24009040 comp rx=0 tx=0).stop 2024-09-17T01:44:00.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.934+0000 7f2f38600640 1 -- 172.21.15.42:0/3032601268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f300b3880 msgr2=0x7f2f300b1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:00.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.934+0000 7f2f38600640 1 --2- 172.21.15.42:0/3032601268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f300b3880 0x7f2f300b1230 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f2f28009cd0 tx=0x7f2f28032cf0 comp rx=0 tx=0).stop 2024-09-17T01:44:00.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.934+0000 7f2f38600640 1 -- 172.21.15.42:0/3032601268 shutdown_connections 2024-09-17T01:44:00.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.935+0000 7f2f38600640 1 --2- 172.21.15.42:0/3032601268 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f10078bc0 0x7f2f1007b0d0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:00.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.935+0000 7f2f38600640 1 --2- 172.21.15.42:0/3032601268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f300af980 0x7f2f30155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:00.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.935+0000 7f2f38600640 1 --2- 172.21.15.42:0/3032601268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f300b3880 0x7f2f300b1230 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:00.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.935+0000 7f2f38600640 1 --2- 172.21.15.42:0/3032601268 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f3006d430 0x7f2f301f5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:00.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.935+0000 7f2f38600640 1 -- 172.21.15.42:0/3032601268 >> 172.21.15.42:0/3032601268 conn(0x7f2f300b2930 msgr2=0x7f2f300cd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:00.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.935+0000 7f2f38600640 1 -- 172.21.15.42:0/3032601268 shutdown_connections 2024-09-17T01:44:00.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:00.935+0000 7f2f38600640 1 -- 172.21.15.42:0/3032601268 wait complete. 2024-09-17T01:44:00.955 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:44:00.955 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:44:01.046 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:44:01.144 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:44:01.144 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:44:01.144 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:44:01.180 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:44:01.180 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:44:01.180 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:44:01.217 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:44:01.218 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:44:01.218 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:44:01.255 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:44:01.256 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:44:01.256 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:44:01.294 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:44:01.294 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T01:44:01.295 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:44:01.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.525+0000 7f7133e00640 1 -- 172.21.15.42:0/961372397 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7118004800 msgr2=0x7f7118004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:01.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.525+0000 7f7133e00640 1 --2- 172.21.15.42:0/961372397 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7118004800 0x7f7118004c10 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f711c00c4a0 tx=0x7f7118005830 comp rx=0 tx=0).stop 2024-09-17T01:44:01.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.525+0000 7f7133400640 1 -- 172.21.15.42:0/961372397 reap_dead start 2024-09-17T01:44:01.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.525+0000 7f7133e00640 1 -- 172.21.15.42:0/961372397 shutdown_connections 2024-09-17T01:44:01.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.525+0000 7f7133e00640 1 -- 172.21.15.42:0/961372397 >> 172.21.15.42:0/961372397 conn(0x7f71340b25f0 msgr2=0x7f71340d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:01.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.525+0000 7f7133e00640 1 -- 172.21.15.42:0/961372397 shutdown_connections 2024-09-17T01:44:01.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.525+0000 7f7133e00640 1 -- 172.21.15.42:0/961372397 wait complete. 2024-09-17T01:44:01.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.528+0000 7f7133e00640 1 Processor -- start 2024-09-17T01:44:01.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.528+0000 7f7133e00640 1 -- start start 2024-09-17T01:44:01.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.529+0000 7f7133e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7118004800 0x7f713409dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:01.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.529+0000 7f7133e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f713414c280 0x7f71341517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:01.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.529+0000 7f7133e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7134151ce0 0x7f713414cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:01.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.529+0000 7f7133e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f713415d6b0 con 0x7f7118004800 2024-09-17T01:44:01.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.529+0000 7f7133e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f71340b42c0 con 0x7f713414c280 2024-09-17T01:44:01.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.529+0000 7f7133e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f713415d830 con 0x7f7134151ce0 2024-09-17T01:44:01.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.529+0000 7f7132a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7118004800 0x7f713409dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:01.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.529+0000 7f7132a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7118004800 0x7f713409dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54184/0 (socket says 172.21.15.42:54184) 2024-09-17T01:44:01.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.529+0000 7f7132a00640 1 -- 172.21.15.42:0/490792729 learned_addr learned my addr 172.21.15.42:0/490792729 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:01.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.530+0000 7f7133400640 1 --2- 172.21.15.42:0/490792729 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7134151ce0 0x7f713414cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:01.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.530+0000 7f712be00640 1 --2- 172.21.15.42:0/490792729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f713414c280 0x7f71341517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:01.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.530+0000 7f7132a00640 1 -- 172.21.15.42:0/490792729 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7134151ce0 msgr2=0x7f713414cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:01.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.530+0000 7f7132a00640 1 --2- 172.21.15.42:0/490792729 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7134151ce0 0x7f713414cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:01.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.530+0000 7f7132a00640 1 -- 172.21.15.42:0/490792729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f713414c280 msgr2=0x7f71341517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:01.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.530+0000 7f7132a00640 1 --2- 172.21.15.42:0/490792729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f713414c280 0x7f71341517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:01.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.530+0000 7f7132a00640 1 -- 172.21.15.42:0/490792729 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71341520f0 con 0x7f7118004800 2024-09-17T01:44:01.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.530+0000 7f7132a00640 1 --2- 172.21.15.42:0/490792729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7118004800 0x7f713409dbb0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f7124011a50 tx=0x7f7124011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:01.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.530+0000 7f712aa00640 1 -- 172.21.15.42:0/490792729 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712401f070 con 0x7f7118004800 2024-09-17T01:44:01.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.530+0000 7f712aa00640 1 -- 172.21.15.42:0/490792729 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f712400fe80 con 0x7f7118004800 2024-09-17T01:44:01.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.530+0000 7f712aa00640 1 -- 172.21.15.42:0/490792729 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7124012690 con 0x7f7118004800 2024-09-17T01:44:01.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.531+0000 7f7133e00640 1 -- 172.21.15.42:0/490792729 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7134152e50 con 0x7f7118004800 2024-09-17T01:44:01.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.531+0000 7f7133e00640 1 -- 172.21.15.42:0/490792729 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f713414f870 con 0x7f7118004800 2024-09-17T01:44:01.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.532+0000 7f7133e00640 1 -- 172.21.15.42:0/490792729 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7134153750 con 0x7f7118004800 2024-09-17T01:44:01.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.533+0000 7f712aa00640 1 -- 172.21.15.42:0/490792729 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7124022070 con 0x7f7118004800 2024-09-17T01:44:01.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.534+0000 7f712aa00640 1 --2- 172.21.15.42:0/490792729 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7110078b90 0x7f711007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:01.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.534+0000 7f712aa00640 1 -- 172.21.15.42:0/490792729 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 4943+0+0 (secure 0 0 0) 0x7f712409b570 con 0x7f7118004800 2024-09-17T01:44:01.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.534+0000 7f712be00640 1 --2- 172.21.15.42:0/490792729 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7110078b90 0x7f711007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:01.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.535+0000 7f712be00640 1 --2- 172.21.15.42:0/490792729 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7110078b90 0x7f711007b0a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f711c033000 tx=0x7f713406fae0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:01.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.538+0000 7f712aa00640 1 -- 172.21.15.42:0/490792729 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f71341520f0 con 0x7f7118004800 2024-09-17T01:44:01.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.777+0000 7f7133e00640 1 -- 172.21.15.42:0/490792729 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71340b0e80 con 0x7f7118004800 2024-09-17T01:44:01.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.777+0000 7f712aa00640 1 -- 172.21.15.42:0/490792729 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) ==== 95+0+3913 (secure 0 0 0) 0x7f71240635c0 con 0x7f7118004800 2024-09-17T01:44:01.777 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:44:01.777 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":118,"btime":"2024-09-17T01:43:53:953319+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3131119825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3131119825},{"type":"v1","addr":"172.21.15.43:6837","nonce":3131119825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":110},{"gid":8368,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1988657429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1988657429},{"type":"v1","addr":"172.21.15.43:6836","nonce":1988657429}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":8377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/578887548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":578887548},{"type":"v1","addr":"172.21.15.42:6835","nonce":578887548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":111},{"gid":9426,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/3580759959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3580759959},{"type":"v1","addr":"172.21.15.42:6834","nonce":3580759959}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":118}],"filesystems":[]} 2024-09-17T01:44:01.777 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 118 2024-09-17T01:44:01.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.780+0000 7f7133e00640 1 -- 172.21.15.42:0/490792729 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7110078b90 msgr2=0x7f711007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:01.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.780+0000 7f7133e00640 1 --2- 172.21.15.42:0/490792729 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7110078b90 0x7f711007b0a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f711c033000 tx=0x7f713406fae0 comp rx=0 tx=0).stop 2024-09-17T01:44:01.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.780+0000 7f7133e00640 1 -- 172.21.15.42:0/490792729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7118004800 msgr2=0x7f713409dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:01.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.780+0000 7f7133e00640 1 --2- 172.21.15.42:0/490792729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7118004800 0x7f713409dbb0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f7124011a50 tx=0x7f7124011f10 comp rx=0 tx=0).stop 2024-09-17T01:44:01.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.780+0000 7f7133e00640 1 -- 172.21.15.42:0/490792729 shutdown_connections 2024-09-17T01:44:01.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.780+0000 7f7133e00640 1 --2- 172.21.15.42:0/490792729 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7110078b90 0x7f711007b0a0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:01.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.780+0000 7f7133e00640 1 --2- 172.21.15.42:0/490792729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f713414c280 0x7f71341517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:01.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.780+0000 7f7133e00640 1 --2- 172.21.15.42:0/490792729 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7134151ce0 0x7f713414cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:01.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.780+0000 7f7133e00640 1 --2- 172.21.15.42:0/490792729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7118004800 0x7f713409dbb0 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:01.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.780+0000 7f7133e00640 1 -- 172.21.15.42:0/490792729 >> 172.21.15.42:0/490792729 conn(0x7f71340b25f0 msgr2=0x7f71340b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:01.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.780+0000 7f7133e00640 1 -- 172.21.15.42:0/490792729 shutdown_connections 2024-09-17T01:44:01.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:01.780+0000 7f7133e00640 1 -- 172.21.15.42:0/490792729 wait complete. 2024-09-17T01:44:01.802 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T01:44:01.802 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T01:44:01.802 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T01:44:01.802 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:44:01.802 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T01:44:01.803 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T01:44:01.803 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T01:44:01.803 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:44:01.803 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T01:44:01.803 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T01:44:01.803 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T01:44:01.803 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:44:01.804 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T01:44:01.804 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T01:44:01.804 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T01:44:01.804 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:44:01.828 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T01:44:01.828 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T01:44:01.830 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T01:44:01.830 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T01:44:01.831 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T01:44:01.831 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T01:44:01.832 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T01:44:01.832 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T01:44:01.874 INFO:tasks.ceph.mds.a:Started 2024-09-17T01:44:01.874 DEBUG:teuthology.parallel:result is None 2024-09-17T01:44:01.875 INFO:tasks.ceph.mds.b:Started 2024-09-17T01:44:01.875 DEBUG:teuthology.parallel:result is None 2024-09-17T01:44:01.877 INFO:tasks.ceph.mds.c:Started 2024-09-17T01:44:01.877 DEBUG:teuthology.parallel:result is None 2024-09-17T01:44:01.878 INFO:tasks.ceph.mds.d:Started 2024-09-17T01:44:01.878 DEBUG:teuthology.parallel:result is None 2024-09-17T01:44:01.878 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T01:44:02.076 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:44:02.076 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-09-17T01:44:02.077 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:44:02.077 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-09-17T01:44:02.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.120+0000 7f04afc00640 1 -- 172.21.15.42:0/2943068341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04a806d430 msgr2=0x7f04a806d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:02.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.120+0000 7f04afc00640 1 --2- 172.21.15.42:0/2943068341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04a806d430 0x7f04a806d840 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0494009830 tx=0x7f049402a500 comp rx=0 tx=0).stop 2024-09-17T01:44:02.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.120+0000 7f04afc00640 1 -- 172.21.15.42:0/2943068341 shutdown_connections 2024-09-17T01:44:02.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.120+0000 7f04afc00640 1 --2- 172.21.15.42:0/2943068341 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f04a815f480 0x7f04a815f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:02.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.120+0000 7f04afc00640 1 --2- 172.21.15.42:0/2943068341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04a806d430 0x7f04a806d840 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:02.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.120+0000 7f04afc00640 1 -- 172.21.15.42:0/2943068341 >> 172.21.15.42:0/2943068341 conn(0x7f04a80b2930 msgr2=0x7f04a806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:02.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.121+0000 7f04afc00640 1 -- 172.21.15.42:0/2943068341 shutdown_connections 2024-09-17T01:44:02.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.121+0000 7f04afc00640 1 -- 172.21.15.42:0/2943068341 wait complete. 2024-09-17T01:44:02.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.123+0000 7f04afc00640 1 Processor -- start 2024-09-17T01:44:02.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.123+0000 7f04afc00640 1 -- start start 2024-09-17T01:44:02.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.124+0000 7f04afc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04a806d430 0x7f04a81f9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:02.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.124+0000 7f04afc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f04a815cb80 0x7f04a814abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:02.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.124+0000 7f04afc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a815f480 0x7f04a8152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:02.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.124+0000 7f04afc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f04a8073820 con 0x7f04a815f480 2024-09-17T01:44:02.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.124+0000 7f04afc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f04a80736a0 con 0x7f04a806d430 2024-09-17T01:44:02.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.124+0000 7f04afc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f04a80739a0 con 0x7f04a815cb80 2024-09-17T01:44:02.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.125+0000 7f04adc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a815f480 0x7f04a8152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:02.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.125+0000 7f04adc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a815f480 0x7f04a8152f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54204/0 (socket says 172.21.15.42:54204) 2024-09-17T01:44:02.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.125+0000 7f04adc00640 1 -- 172.21.15.42:0/3290151698 learned_addr learned my addr 172.21.15.42:0/3290151698 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:02.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.125+0000 7f04ad200640 1 --2- 172.21.15.42:0/3290151698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04a806d430 0x7f04a81f9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:02.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.125+0000 7f04a7e00640 1 --2- 172.21.15.42:0/3290151698 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f04a815cb80 0x7f04a814abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:02.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.125+0000 7f04adc00640 1 -- 172.21.15.42:0/3290151698 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f04a815cb80 msgr2=0x7f04a814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:02.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.125+0000 7f04adc00640 1 --2- 172.21.15.42:0/3290151698 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f04a815cb80 0x7f04a814abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:02.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.125+0000 7f04adc00640 1 -- 172.21.15.42:0/3290151698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04a806d430 msgr2=0x7f04a81f9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:02.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.125+0000 7f04adc00640 1 --2- 172.21.15.42:0/3290151698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04a806d430 0x7f04a81f9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:02.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.125+0000 7f04adc00640 1 -- 172.21.15.42:0/3290151698 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a8153e00 con 0x7f04a815f480 2024-09-17T01:44:02.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.126+0000 7f04adc00640 1 --2- 172.21.15.42:0/3290151698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a815f480 0x7f04a8152f40 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f04a000eab0 tx=0x7f04a000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:02.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.126+0000 7f04a4c00640 1 -- 172.21.15.42:0/3290151698 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a000cea0 con 0x7f04a815f480 2024-09-17T01:44:02.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.126+0000 7f04a4c00640 1 -- 172.21.15.42:0/3290151698 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04a0004b20 con 0x7f04a815f480 2024-09-17T01:44:02.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.126+0000 7f04a4c00640 1 -- 172.21.15.42:0/3290151698 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a0005020 con 0x7f04a815f480 2024-09-17T01:44:02.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.126+0000 7f04afc00640 1 -- 172.21.15.42:0/3290151698 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a8153b20 con 0x7f04a815f480 2024-09-17T01:44:02.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.126+0000 7f04afc00640 1 -- 172.21.15.42:0/3290151698 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a81f9070 con 0x7f04a815f480 2024-09-17T01:44:02.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.127+0000 7f04afc00640 1 -- 172.21.15.42:0/3290151698 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a8153870 con 0x7f04a815f480 2024-09-17T01:44:02.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.128+0000 7f04a4c00640 1 -- 172.21.15.42:0/3290151698 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f04a00051c0 con 0x7f04a815f480 2024-09-17T01:44:02.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.129+0000 7f04a4c00640 1 --2- 172.21.15.42:0/3290151698 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0488078b90 0x7f048807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:02.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.129+0000 7f04a4c00640 1 -- 172.21.15.42:0/3290151698 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 4943+0+0 (secure 0 0 0) 0x7f04a009b650 con 0x7f04a815f480 2024-09-17T01:44:02.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.130+0000 7f04ad200640 1 --2- 172.21.15.42:0/3290151698 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0488078b90 0x7f048807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:02.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.130+0000 7f04ad200640 1 --2- 172.21.15.42:0/3290151698 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0488078b90 0x7f048807b0a0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f049c000f60 tx=0x7f049c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:02.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.134+0000 7f04a4c00640 1 -- 172.21.15.42:0/3290151698 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f04a00636a0 con 0x7f04a815f480 2024-09-17T01:44:02.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:02.339+0000 7f04afc00640 1 -- 172.21.15.42:0/3290151698 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f04a8073ec0 con 0x7f04a815f480 2024-09-17T01:44:03.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.006+0000 7f04a4c00640 1 -- 172.21.15.42:0/3290151698 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v154) ==== 97+0+0 (secure 0 0 0) 0x7f04a00680d0 con 0x7f04a815f480 2024-09-17T01:44:03.006 INFO:teuthology.orchestra.run.smithi042.stderr: removed all blocklist entries 2024-09-17T01:44:03.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.010+0000 7f04afc00640 1 -- 172.21.15.42:0/3290151698 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0488078b90 msgr2=0x7f048807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:03.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.010+0000 7f04afc00640 1 --2- 172.21.15.42:0/3290151698 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0488078b90 0x7f048807b0a0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f049c000f60 tx=0x7f049c009040 comp rx=0 tx=0).stop 2024-09-17T01:44:03.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.010+0000 7f04afc00640 1 -- 172.21.15.42:0/3290151698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a815f480 msgr2=0x7f04a8152f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:03.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.010+0000 7f04afc00640 1 --2- 172.21.15.42:0/3290151698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a815f480 0x7f04a8152f40 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f04a000eab0 tx=0x7f04a000ef70 comp rx=0 tx=0).stop 2024-09-17T01:44:03.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.010+0000 7f04afc00640 1 -- 172.21.15.42:0/3290151698 shutdown_connections 2024-09-17T01:44:03.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.010+0000 7f04afc00640 1 --2- 172.21.15.42:0/3290151698 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0488078b90 0x7f048807b0a0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:03.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.010+0000 7f04afc00640 1 --2- 172.21.15.42:0/3290151698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04a815f480 0x7f04a8152f40 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:03.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.010+0000 7f04afc00640 1 --2- 172.21.15.42:0/3290151698 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f04a815cb80 0x7f04a814abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:03.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.010+0000 7f04afc00640 1 --2- 172.21.15.42:0/3290151698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f04a806d430 0x7f04a81f9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:03.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.010+0000 7f04afc00640 1 -- 172.21.15.42:0/3290151698 >> 172.21.15.42:0/3290151698 conn(0x7f04a80b2930 msgr2=0x7f04a8072be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:03.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.011+0000 7f04afc00640 1 -- 172.21.15.42:0/3290151698 shutdown_connections 2024-09-17T01:44:03.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.011+0000 7f04afc00640 1 -- 172.21.15.42:0/3290151698 wait complete. 2024-09-17T01:44:03.038 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T01:44:03.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.269+0000 7f8e62400640 1 -- 172.21.15.42:0/3055951482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e5c142f40 msgr2=0x7f8e5c072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:03.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.269+0000 7f8e62400640 1 --2- 172.21.15.42:0/3055951482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e5c142f40 0x7f8e5c072950 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c071ef0 tx=0x7f8e4402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:44:03.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.269+0000 7f8e62400640 1 -- 172.21.15.42:0/3055951482 shutdown_connections 2024-09-17T01:44:03.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.269+0000 7f8e62400640 1 --2- 172.21.15.42:0/3055951482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e5c142f40 0x7f8e5c072950 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:03.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.269+0000 7f8e62400640 1 --2- 172.21.15.42:0/3055951482 >> v2:172.21.15.43:3300/0 conn(0x7f8e5c0b3550 0x7f8e5c15cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:03.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.269+0000 7f8e62400640 1 -- 172.21.15.42:0/3055951482 >> 172.21.15.42:0/3055951482 conn(0x7f8e5c0b2930 msgr2=0x7f8e5c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:03.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.269+0000 7f8e62400640 1 -- 172.21.15.42:0/3055951482 shutdown_connections 2024-09-17T01:44:03.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.269+0000 7f8e62400640 1 -- 172.21.15.42:0/3055951482 wait complete. 2024-09-17T01:44:03.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.271+0000 7f8e62400640 1 Processor -- start 2024-09-17T01:44:03.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.271+0000 7f8e62400640 1 -- start start 2024-09-17T01:44:03.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.274+0000 7f8e62400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e5c072e90 0x7f8e5c1f6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:03.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.274+0000 7f8e62400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e5c0b3550 0x7f8e5c155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:03.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.274+0000 7f8e62400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8e5c142f40 0x7f8e5c152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:03.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.274+0000 7f8e62400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5c06d5b0 con 0x7f8e5c072e90 2024-09-17T01:44:03.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.274+0000 7f8e62400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5c06d430 con 0x7f8e5c0b3550 2024-09-17T01:44:03.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.274+0000 7f8e62400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8e5c06d730 con 0x7f8e5c142f40 2024-09-17T01:44:03.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.274+0000 7f8e5b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e5c072e90 0x7f8e5c1f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:03.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.274+0000 7f8e5b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e5c072e90 0x7f8e5c1f6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54220/0 (socket says 172.21.15.42:54220) 2024-09-17T01:44:03.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.274+0000 7f8e5b400640 1 -- 172.21.15.42:0/4036758219 learned_addr learned my addr 172.21.15.42:0/4036758219 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:03.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.274+0000 7f8e53e00640 1 --2- 172.21.15.42:0/4036758219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e5c0b3550 0x7f8e5c155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:03.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.274+0000 7f8e5be00640 1 --2- 172.21.15.42:0/4036758219 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8e5c142f40 0x7f8e5c152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:03.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.274+0000 7f8e5b400640 1 -- 172.21.15.42:0/4036758219 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8e5c142f40 msgr2=0x7f8e5c152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:03.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.274+0000 7f8e5b400640 1 --2- 172.21.15.42:0/4036758219 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8e5c142f40 0x7f8e5c152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:03.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.274+0000 7f8e5b400640 1 -- 172.21.15.42:0/4036758219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e5c0b3550 msgr2=0x7f8e5c155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:03.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.274+0000 7f8e5b400640 1 --2- 172.21.15.42:0/4036758219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e5c0b3550 0x7f8e5c155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:03.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.274+0000 7f8e5b400640 1 -- 172.21.15.42:0/4036758219 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e5c1ecba0 con 0x7f8e5c072e90 2024-09-17T01:44:03.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.274+0000 7f8e53e00640 1 --2- 172.21.15.42:0/4036758219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e5c0b3550 0x7f8e5c155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:44:03.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.274+0000 7f8e5b400640 1 --2- 172.21.15.42:0/4036758219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e5c072e90 0x7f8e5c1f6670 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00d740 tx=0x7f8e4c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:03.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.274+0000 7f8e53400640 1 -- 172.21.15.42:0/4036758219 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c017070 con 0x7f8e5c072e90 2024-09-17T01:44:03.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.274+0000 7f8e53400640 1 -- 172.21.15.42:0/4036758219 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e4c009d20 con 0x7f8e5c072e90 2024-09-17T01:44:03.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.274+0000 7f8e53400640 1 -- 172.21.15.42:0/4036758219 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c0106c0 con 0x7f8e5c072e90 2024-09-17T01:44:03.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.274+0000 7f8e62400640 1 -- 172.21.15.42:0/4036758219 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e5c155bf0 con 0x7f8e5c072e90 2024-09-17T01:44:03.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.275+0000 7f8e62400640 1 -- 172.21.15.42:0/4036758219 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e5c0b0160 con 0x7f8e5c072e90 2024-09-17T01:44:03.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.277+0000 7f8e62400640 1 -- 172.21.15.42:0/4036758219 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e5c06dbe0 con 0x7f8e5c072e90 2024-09-17T01:44:03.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.277+0000 7f8e53400640 1 -- 172.21.15.42:0/4036758219 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8e4c01a070 con 0x7f8e5c072e90 2024-09-17T01:44:03.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.278+0000 7f8e53400640 1 --2- 172.21.15.42:0/4036758219 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8e38078bc0 0x7f8e3807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:03.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.278+0000 7f8e53400640 1 -- 172.21.15.42:0/4036758219 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 4857+0+0 (secure 0 0 0) 0x7f8e4c09aef0 con 0x7f8e5c072e90 2024-09-17T01:44:03.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.278+0000 7f8e53e00640 1 --2- 172.21.15.42:0/4036758219 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8e38078bc0 0x7f8e3807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:03.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.279+0000 7f8e53e00640 1 --2- 172.21.15.42:0/4036758219 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8e38078bc0 0x7f8e3807b0d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8e44034000 tx=0x7f8e44004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:03.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.281+0000 7f8e53400640 1 -- 172.21.15.42:0/4036758219 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8e4c063780 con 0x7f8e5c072e90 2024-09-17T01:44:03.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.548+0000 7f8e62400640 1 -- 172.21.15.42:0/4036758219 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f8e5c06a170 con 0x7f8e5c072e90 2024-09-17T01:44:03.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.549+0000 7f8e53400640 1 -- 172.21.15.42:0/4036758219 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v39) ==== 80+0+5304 (secure 0 0 0) 0x7f8e4c063080 con 0x7f8e5c072e90 2024-09-17T01:44:03.547 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:44:03.547 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:44:03.548 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_dump": [ 2024-09-17T01:44:03.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:44:03.548 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.a", 2024-09-17T01:44:03.548 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmyJK4HRAAIC4E4V7p1fqIEfPIICMxZg==", 2024-09-17T01:44:03.548 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:44:03.548 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:44:03.548 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:44:03.549 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:44:03.549 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:44:03.549 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:44:03.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:44:03.549 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:44:03.549 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.b", 2024-09-17T01:44:03.550 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmXv3vORAALPrYIM6Vtz0g1pOxVhrUig==", 2024-09-17T01:44:03.550 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:44:03.550 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:44:03.550 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:44:03.550 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:44:03.550 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:44:03.551 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:44:03.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:44:03.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:44:03.551 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.c", 2024-09-17T01:44:03.551 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmPE7MKxAA9mGG+EO9C3VGVMerOm92+Q==", 2024-09-17T01:44:03.551 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:44:03.551 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:44:03.552 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:44:03.552 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:44:03.552 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:44:03.552 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:44:03.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:44:03.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:44:03.553 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.d", 2024-09-17T01:44:03.553 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmaOBSDBAATU4tpjM5IMcuvzZFE7N5bQ==", 2024-09-17T01:44:03.553 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:44:03.553 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:44:03.553 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:44:03.553 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:44:03.553 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:44:03.553 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:44:03.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:44:03.554 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:44:03.554 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.0", 2024-09-17T01:44:03.554 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDP2+hmEJebExAAAdGEoSzM96ybGT9h7t7OkA==", 2024-09-17T01:44:03.554 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:44:03.554 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:44:03.554 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:44:03.554 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:44:03.555 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:44:03.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:44:03.555 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:44:03.555 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.1", 2024-09-17T01:44:03.555 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDS2+hm7dWoMBAAagktrUl0O2/mgKCEfpAstA==", 2024-09-17T01:44:03.555 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:44:03.555 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:44:03.555 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:44:03.555 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:44:03.555 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:44:03.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:44:03.555 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:44:03.555 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.2", 2024-09-17T01:44:03.555 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDW2+hmEfSPBBAAPAa6EZt27yUcJSfZyCKheg==", 2024-09-17T01:44:03.556 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:44:03.556 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:44:03.556 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:44:03.556 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:44:03.556 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:44:03.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:44:03.556 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:44:03.556 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.3", 2024-09-17T01:44:03.556 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDZ2+hmHQhXFRAAj84g+IKqH6KMP7LjRtFvLw==", 2024-09-17T01:44:03.556 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:44:03.556 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:44:03.556 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:44:03.556 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:44:03.557 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:44:03.557 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:44:03.557 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:44:03.557 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.4", 2024-09-17T01:44:03.557 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDd2+hmaNcMNBAAx1GV/oFdfssMjFWFN5M0VQ==", 2024-09-17T01:44:03.557 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:44:03.557 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:44:03.558 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:44:03.558 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:44:03.558 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:44:03.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:44:03.558 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:44:03.558 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.5", 2024-09-17T01:44:03.559 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDh2+hm301NJhAAnSUH5AAvqhPwM7loH6frww==", 2024-09-17T01:44:03.559 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:44:03.559 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:44:03.559 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:44:03.559 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:44:03.559 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:44:03.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:44:03.560 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:44:03.560 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.6", 2024-09-17T01:44:03.560 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDk2+hm61WNNRAAbCvVvsUpB4fgt4ja60DRZA==", 2024-09-17T01:44:03.560 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:44:03.560 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:44:03.560 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:44:03.560 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:44:03.561 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:44:03.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:44:03.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:44:03.561 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.7", 2024-09-17T01:44:03.561 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDo2+hmesiLFhAA29n1eageNvP+lkRyh6gGMw==", 2024-09-17T01:44:03.561 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:44:03.561 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:44:03.562 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:44:03.562 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:44:03.562 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:44:03.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:44:03.562 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:44:03.562 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.0", 2024-09-17T01:44:03.563 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA==", 2024-09-17T01:44:03.563 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:44:03.563 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:44:03.563 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow r", 2024-09-17T01:44:03.563 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T01:44:03.563 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:44:03.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:44:03.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:44:03.564 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.1", 2024-09-17T01:44:03.564 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmZLygLhAABlauZgnidFWvfCCPuBLObg==", 2024-09-17T01:44:03.564 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:44:03.564 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:44:03.565 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:44:03.565 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:44:03.565 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:44:03.565 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:44:03.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:44:03.565 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:44:03.565 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.2", 2024-09-17T01:44:03.565 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hm8lnZIxAAN0a2CVMMtu/Nz50OG4a02A==", 2024-09-17T01:44:03.565 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:44:03.566 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:44:03.566 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:44:03.566 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:44:03.566 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:44:03.566 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:44:03.566 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:44:03.566 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:44:03.566 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.3", 2024-09-17T01:44:03.566 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmgXdAORAAM5Uy66I4nnTJ9Vhkn9JoBw==", 2024-09-17T01:44:03.566 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:44:03.566 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:44:03.566 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:44:03.566 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:44:03.567 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:44:03.567 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:44:03.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:44:03.567 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:44:03.567 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.admin", 2024-09-17T01:44:03.567 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDL2+hmvCreHBAA4CSAhosssViGqD93U+I7Iw==", 2024-09-17T01:44:03.567 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:44:03.567 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:44:03.567 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:44:03.567 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:44:03.567 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:44:03.567 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:44:03.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:44:03.567 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:44:03.568 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.x", 2024-09-17T01:44:03.568 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmYPnlEhAAIcQ11ktWZyMXYdbAONiLog==", 2024-09-17T01:44:03.568 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:44:03.568 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:44:03.568 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:44:03.568 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:44:03.568 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:44:03.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:44:03.568 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:44:03.568 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.y", 2024-09-17T01:44:03.568 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmpCZtBxAAp5tXMc6aEq1aOny2LJZAiA==", 2024-09-17T01:44:03.568 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:44:03.568 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:44:03.569 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:44:03.569 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:44:03.569 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:44:03.569 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:44:03.569 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-17T01:44:03.569 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:44:03.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.551+0000 7f8e62400640 1 -- 172.21.15.42:0/4036758219 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8e38078bc0 msgr2=0x7f8e3807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:03.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.551+0000 7f8e62400640 1 --2- 172.21.15.42:0/4036758219 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8e38078bc0 0x7f8e3807b0d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8e44034000 tx=0x7f8e44004730 comp rx=0 tx=0).stop 2024-09-17T01:44:03.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.551+0000 7f8e62400640 1 -- 172.21.15.42:0/4036758219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e5c072e90 msgr2=0x7f8e5c1f6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:03.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.551+0000 7f8e62400640 1 --2- 172.21.15.42:0/4036758219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e5c072e90 0x7f8e5c1f6670 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00d740 tx=0x7f8e4c00dc00 comp rx=0 tx=0).stop 2024-09-17T01:44:03.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.551+0000 7f8e62400640 1 -- 172.21.15.42:0/4036758219 shutdown_connections 2024-09-17T01:44:03.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.551+0000 7f8e62400640 1 --2- 172.21.15.42:0/4036758219 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8e38078bc0 0x7f8e3807b0d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:03.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.551+0000 7f8e62400640 1 --2- 172.21.15.42:0/4036758219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e5c0b3550 0x7f8e5c155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:03.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.551+0000 7f8e62400640 1 --2- 172.21.15.42:0/4036758219 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8e5c142f40 0x7f8e5c152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:03.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.551+0000 7f8e62400640 1 --2- 172.21.15.42:0/4036758219 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8e5c072e90 0x7f8e5c1f6670 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:03.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.551+0000 7f8e62400640 1 -- 172.21.15.42:0/4036758219 >> 172.21.15.42:0/4036758219 conn(0x7f8e5c0b2930 msgr2=0x7f8e5c075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:03.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.551+0000 7f8e62400640 1 -- 172.21.15.42:0/4036758219 shutdown_connections 2024-09-17T01:44:03.571 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.551+0000 7f8e62400640 1 -- 172.21.15.42:0/4036758219 wait complete. 2024-09-17T01:44:03.572 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T01:44:03.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.802+0000 7fde4fe00640 1 -- 172.21.15.42:0/4275462908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde500af460 msgr2=0x7fde500ad790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:03.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.802+0000 7fde4fe00640 1 --2- 172.21.15.42:0/4275462908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde500af460 0x7fde500ad790 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fde48005fd0 tx=0x7fde4802ab30 comp rx=0 tx=0).stop 2024-09-17T01:44:03.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.802+0000 7fde4fe00640 1 -- 172.21.15.42:0/4275462908 shutdown_connections 2024-09-17T01:44:03.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.802+0000 7fde4fe00640 1 --2- 172.21.15.42:0/4275462908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde500af460 0x7fde500ad790 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:03.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.802+0000 7fde4fe00640 1 -- 172.21.15.42:0/4275462908 >> 172.21.15.42:0/4275462908 conn(0x7fde500b25f0 msgr2=0x7fde500d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:03.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.802+0000 7fde4fe00640 1 -- 172.21.15.42:0/4275462908 shutdown_connections 2024-09-17T01:44:03.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.802+0000 7fde4fe00640 1 -- 172.21.15.42:0/4275462908 wait complete. 2024-09-17T01:44:03.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.804+0000 7fde4fe00640 1 Processor -- start 2024-09-17T01:44:03.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.805+0000 7fde4fe00640 1 -- start start 2024-09-17T01:44:03.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.806+0000 7fde4fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde500af460 0x7fde5015c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:03.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.806+0000 7fde4fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde500d0d80 0x7fde50159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:03.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.806+0000 7fde4fe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde500b46c0 0x7fde501f8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:03.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.806+0000 7fde4fe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fde5015ec10 con 0x7fde500af460 2024-09-17T01:44:03.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.806+0000 7fde4fe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fde500adcd0 con 0x7fde500d0d80 2024-09-17T01:44:03.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.806+0000 7fde4fe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fde5006f000 con 0x7fde500b46c0 2024-09-17T01:44:03.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.806+0000 7fde4ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde500af460 0x7fde5015c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:03.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.806+0000 7fde4ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde500af460 0x7fde5015c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54242/0 (socket says 172.21.15.42:54242) 2024-09-17T01:44:03.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.806+0000 7fde4ea00640 1 -- 172.21.15.42:0/3779898845 learned_addr learned my addr 172.21.15.42:0/3779898845 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:03.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.807+0000 7fde4ea00640 1 -- 172.21.15.42:0/3779898845 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde500b46c0 msgr2=0x7fde501f8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:03.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.807+0000 7fde4ea00640 1 --2- 172.21.15.42:0/3779898845 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde500b46c0 0x7fde501f8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:03.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.807+0000 7fde4ea00640 1 -- 172.21.15.42:0/3779898845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde500d0d80 msgr2=0x7fde50159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:03.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.807+0000 7fde4ea00640 1 --2- 172.21.15.42:0/3779898845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde500d0d80 0x7fde50159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:03.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.807+0000 7fde4ea00640 1 -- 172.21.15.42:0/3779898845 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5015cd00 con 0x7fde500af460 2024-09-17T01:44:03.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.807+0000 7fde4ea00640 1 --2- 172.21.15.42:0/3779898845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde500af460 0x7fde5015c080 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fde4000c430 tx=0x7fde4000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:03.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.807+0000 7fde46a00640 1 -- 172.21.15.42:0/3779898845 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde40017070 con 0x7fde500af460 2024-09-17T01:44:03.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.807+0000 7fde46a00640 1 -- 172.21.15.42:0/3779898845 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde400053c0 con 0x7fde500af460 2024-09-17T01:44:03.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.807+0000 7fde46a00640 1 -- 172.21.15.42:0/3779898845 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde40003850 con 0x7fde500af460 2024-09-17T01:44:03.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.807+0000 7fde4fe00640 1 -- 172.21.15.42:0/3779898845 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde500b3be0 con 0x7fde500af460 2024-09-17T01:44:03.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.808+0000 7fde4fe00640 1 -- 172.21.15.42:0/3779898845 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde500b41a0 con 0x7fde500af460 2024-09-17T01:44:03.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.809+0000 7fde4fe00640 1 -- 172.21.15.42:0/3779898845 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde5006cd20 con 0x7fde500af460 2024-09-17T01:44:03.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.810+0000 7fde46a00640 1 -- 172.21.15.42:0/3779898845 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fde4001a070 con 0x7fde500af460 2024-09-17T01:44:03.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.811+0000 7fde46a00640 1 --2- 172.21.15.42:0/3779898845 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde30078b90 0x7fde3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:03.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.811+0000 7fde46a00640 1 -- 172.21.15.42:0/3779898845 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 4857+0+0 (secure 0 0 0) 0x7fde40099de0 con 0x7fde500af460 2024-09-17T01:44:03.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.812+0000 7fde4e000640 1 --2- 172.21.15.42:0/3779898845 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde30078b90 0x7fde3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:03.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.813+0000 7fde4e000640 1 --2- 172.21.15.42:0/3779898845 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde30078b90 0x7fde3007b0a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fde3c000f60 tx=0x7fde3c0079b0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:03.814 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:03.816+0000 7fde46a00640 1 -- 172.21.15.42:0/3779898845 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fde40062560 con 0x7fde500af460 2024-09-17T01:44:04.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.017+0000 7fde4fe00640 1 -- 172.21.15.42:0/3779898845 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fde500ccda0 con 0x7fde500af460 2024-09-17T01:44:04.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.017+0000 7fde46a00640 1 -- 172.21.15.42:0/3779898845 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v156) ==== 84+0+65 (secure 0 0 0) 0x7fde40061e60 con 0x7fde500af460 2024-09-17T01:44:04.015 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:44:04.015 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-09-17T01:44:04.015 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:44:04.015 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-09-17T01:44:04.016 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-09-17T01:44:04.016 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:44:04.016 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-09-17T01:44:04.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.020+0000 7fde4fe00640 1 -- 172.21.15.42:0/3779898845 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde30078b90 msgr2=0x7fde3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:04.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.020+0000 7fde4fe00640 1 --2- 172.21.15.42:0/3779898845 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde30078b90 0x7fde3007b0a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fde3c000f60 tx=0x7fde3c0079b0 comp rx=0 tx=0).stop 2024-09-17T01:44:04.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.020+0000 7fde4fe00640 1 -- 172.21.15.42:0/3779898845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde500af460 msgr2=0x7fde5015c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:04.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.020+0000 7fde4fe00640 1 --2- 172.21.15.42:0/3779898845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde500af460 0x7fde5015c080 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fde4000c430 tx=0x7fde4000c8f0 comp rx=0 tx=0).stop 2024-09-17T01:44:04.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.020+0000 7fde4fe00640 1 -- 172.21.15.42:0/3779898845 shutdown_connections 2024-09-17T01:44:04.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.020+0000 7fde4fe00640 1 --2- 172.21.15.42:0/3779898845 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde30078b90 0x7fde3007b0a0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:04.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.020+0000 7fde4fe00640 1 --2- 172.21.15.42:0/3779898845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde500d0d80 0x7fde50159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:04.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.020+0000 7fde4fe00640 1 --2- 172.21.15.42:0/3779898845 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde500b46c0 0x7fde501f8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:04.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.020+0000 7fde4fe00640 1 --2- 172.21.15.42:0/3779898845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde500af460 0x7fde5015c080 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:04.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.020+0000 7fde4fe00640 1 -- 172.21.15.42:0/3779898845 >> 172.21.15.42:0/3779898845 conn(0x7fde500b25f0 msgr2=0x7fde5006d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:04.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.020+0000 7fde4fe00640 1 -- 172.21.15.42:0/3779898845 shutdown_connections 2024-09-17T01:44:04.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.020+0000 7fde4fe00640 1 -- 172.21.15.42:0/3779898845 wait complete. 2024-09-17T01:44:04.043 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T01:44:04.043 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T01:44:04.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.278+0000 7fcf8b400640 1 -- 172.21.15.42:0/3291925845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf840b56d0 msgr2=0x7fcf840b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:04.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.278+0000 7fcf8b400640 1 --2- 172.21.15.42:0/3291925845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf840b56d0 0x7fcf840b46f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fcf74009830 tx=0x7fcf7402a5b0 comp rx=0 tx=0).stop 2024-09-17T01:44:04.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.278+0000 7fcf8b400640 1 -- 172.21.15.42:0/3291925845 shutdown_connections 2024-09-17T01:44:04.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.278+0000 7fcf8b400640 1 --2- 172.21.15.42:0/3291925845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf840b56d0 0x7fcf840b46f0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:04.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.278+0000 7fcf8b400640 1 -- 172.21.15.42:0/3291925845 >> 172.21.15.42:0/3291925845 conn(0x7fcf840b28f0 msgr2=0x7fcf8406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:04.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.278+0000 7fcf8b400640 1 -- 172.21.15.42:0/3291925845 shutdown_connections 2024-09-17T01:44:04.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.278+0000 7fcf8b400640 1 -- 172.21.15.42:0/3291925845 wait complete. 2024-09-17T01:44:04.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.280+0000 7fcf8b400640 1 Processor -- start 2024-09-17T01:44:04.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.281+0000 7fcf8b400640 1 -- start start 2024-09-17T01:44:04.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.282+0000 7fcf8b400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcf840b56d0 0x7fcf84134d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:04.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.282+0000 7fcf8b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf840cdb20 0x7fcf840ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:04.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.282+0000 7fcf8b400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf8413f4b0 0x7fcf840aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:04.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.282+0000 7fcf8b400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8415dd30 con 0x7fcf840cdb20 2024-09-17T01:44:04.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.282+0000 7fcf8b400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8415dbb0 con 0x7fcf8413f4b0 2024-09-17T01:44:04.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.282+0000 7fcf8b400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fcf840cdf30 con 0x7fcf840b56d0 2024-09-17T01:44:04.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.282+0000 7fcf7be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf840cdb20 0x7fcf840ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:04.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.282+0000 7fcf7be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf840cdb20 0x7fcf840ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54250/0 (socket says 172.21.15.42:54250) 2024-09-17T01:44:04.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.282+0000 7fcf7be00640 1 -- 172.21.15.42:0/3572761795 learned_addr learned my addr 172.21.15.42:0/3572761795 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:04.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.283+0000 7fcf88a00640 1 --2- 172.21.15.42:0/3572761795 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcf840b56d0 0x7fcf84134d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:04.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.283+0000 7fcf89400640 1 --2- 172.21.15.42:0/3572761795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf8413f4b0 0x7fcf840aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:04.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.283+0000 7fcf7be00640 1 -- 172.21.15.42:0/3572761795 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcf840b56d0 msgr2=0x7fcf84134d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:04.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.283+0000 7fcf7be00640 1 --2- 172.21.15.42:0/3572761795 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcf840b56d0 0x7fcf84134d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:04.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.283+0000 7fcf7be00640 1 -- 172.21.15.42:0/3572761795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf8413f4b0 msgr2=0x7fcf840aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:04.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.283+0000 7fcf7be00640 1 --2- 172.21.15.42:0/3572761795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf8413f4b0 0x7fcf840aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:04.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.283+0000 7fcf7be00640 1 -- 172.21.15.42:0/3572761795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf841f9e20 con 0x7fcf840cdb20 2024-09-17T01:44:04.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.283+0000 7fcf7be00640 1 --2- 172.21.15.42:0/3572761795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf840cdb20 0x7fcf840ae8a0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c00c460 tx=0x7fcf6c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:04.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.284+0000 7fcf81600640 1 -- 172.21.15.42:0/3572761795 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c016020 con 0x7fcf840cdb20 2024-09-17T01:44:04.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.284+0000 7fcf81600640 1 -- 172.21.15.42:0/3572761795 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf6c012940 con 0x7fcf840cdb20 2024-09-17T01:44:04.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.284+0000 7fcf8b400640 1 -- 172.21.15.42:0/3572761795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf841f92a0 con 0x7fcf840cdb20 2024-09-17T01:44:04.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.284+0000 7fcf81600640 1 -- 172.21.15.42:0/3572761795 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c012d90 con 0x7fcf840cdb20 2024-09-17T01:44:04.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.284+0000 7fcf8b400640 1 -- 172.21.15.42:0/3572761795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf841f9860 con 0x7fcf840cdb20 2024-09-17T01:44:04.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.285+0000 7fcf8b400640 1 -- 172.21.15.42:0/3572761795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf840ce370 con 0x7fcf840cdb20 2024-09-17T01:44:04.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.286+0000 7fcf81600640 1 -- 172.21.15.42:0/3572761795 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcf6c019020 con 0x7fcf840cdb20 2024-09-17T01:44:04.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.287+0000 7fcf81600640 1 --2- 172.21.15.42:0/3572761795 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcf60078b90 0x7fcf6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:04.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.287+0000 7fcf81600640 1 -- 172.21.15.42:0/3572761795 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 4857+0+0 (secure 0 0 0) 0x7fcf6c09a820 con 0x7fcf840cdb20 2024-09-17T01:44:04.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.287+0000 7fcf88a00640 1 --2- 172.21.15.42:0/3572761795 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcf60078b90 0x7fcf6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:04.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.288+0000 7fcf88a00640 1 --2- 172.21.15.42:0/3572761795 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcf60078b90 0x7fcf6007b0a0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fcf74034000 tx=0x7fcf74004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:04.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.291+0000 7fcf81600640 1 -- 172.21.15.42:0/3572761795 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcf6c020020 con 0x7fcf840cdb20 2024-09-17T01:44:04.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:04.486+0000 7fcf8b400640 1 -- 172.21.15.42:0/3572761795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fcf8415fe60 con 0x7fcf840cdb20 2024-09-17T01:44:05.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.022+0000 7fcf81600640 1 -- 172.21.15.42:0/3572761795 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v157) ==== 138+0+0 (secure 0 0 0) 0x7fcf6c062960 con 0x7fcf840cdb20 2024-09-17T01:44:05.020 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-09-17T01:44:05.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.026+0000 7fcf8b400640 1 -- 172.21.15.42:0/3572761795 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcf60078b90 msgr2=0x7fcf6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:05.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.026+0000 7fcf8b400640 1 --2- 172.21.15.42:0/3572761795 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcf60078b90 0x7fcf6007b0a0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fcf74034000 tx=0x7fcf74004730 comp rx=0 tx=0).stop 2024-09-17T01:44:05.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.026+0000 7fcf8b400640 1 -- 172.21.15.42:0/3572761795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf840cdb20 msgr2=0x7fcf840ae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:05.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.026+0000 7fcf8b400640 1 --2- 172.21.15.42:0/3572761795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf840cdb20 0x7fcf840ae8a0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c00c460 tx=0x7fcf6c00c920 comp rx=0 tx=0).stop 2024-09-17T01:44:05.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.027+0000 7fcf8b400640 1 -- 172.21.15.42:0/3572761795 shutdown_connections 2024-09-17T01:44:05.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.027+0000 7fcf8b400640 1 --2- 172.21.15.42:0/3572761795 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcf60078b90 0x7fcf6007b0a0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:05.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.027+0000 7fcf8b400640 1 --2- 172.21.15.42:0/3572761795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf8413f4b0 0x7fcf840aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:05.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.027+0000 7fcf8b400640 1 --2- 172.21.15.42:0/3572761795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf840cdb20 0x7fcf840ae8a0 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:05.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.027+0000 7fcf8b400640 1 --2- 172.21.15.42:0/3572761795 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcf840b56d0 0x7fcf84134d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:05.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.027+0000 7fcf8b400640 1 -- 172.21.15.42:0/3572761795 >> 172.21.15.42:0/3572761795 conn(0x7fcf840b28f0 msgr2=0x7fcf840b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:05.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.027+0000 7fcf8b400640 1 -- 172.21.15.42:0/3572761795 shutdown_connections 2024-09-17T01:44:05.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.027+0000 7fcf8b400640 1 -- 172.21.15.42:0/3572761795 wait complete. 2024-09-17T01:44:05.059 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T01:44:05.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.299+0000 7ff97f600640 1 -- 172.21.15.42:0/2063320742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff978142f40 msgr2=0x7ff978072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:05.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.299+0000 7ff97f600640 1 --2- 172.21.15.42:0/2063320742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff978142f40 0x7ff978072950 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7ff978071ef0 tx=0x7ff96402a4d0 comp rx=0 tx=0).stop 2024-09-17T01:44:05.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.299+0000 7ff97f600640 1 -- 172.21.15.42:0/2063320742 shutdown_connections 2024-09-17T01:44:05.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.299+0000 7ff97f600640 1 --2- 172.21.15.42:0/2063320742 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff978072e90 0x7ff9780cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:05.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.299+0000 7ff97f600640 1 --2- 172.21.15.42:0/2063320742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff978142f40 0x7ff978072950 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:05.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.299+0000 7ff97f600640 1 --2- 172.21.15.42:0/2063320742 >> v2:172.21.15.43:3300/0 conn(0x7ff9780b3550 0x7ff97815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:05.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.299+0000 7ff97f600640 1 -- 172.21.15.42:0/2063320742 >> 172.21.15.42:0/2063320742 conn(0x7ff9780b2930 msgr2=0x7ff97806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:05.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.299+0000 7ff97f600640 1 -- 172.21.15.42:0/2063320742 shutdown_connections 2024-09-17T01:44:05.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.299+0000 7ff97f600640 1 -- 172.21.15.42:0/2063320742 wait complete. 2024-09-17T01:44:05.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.301+0000 7ff97f600640 1 Processor -- start 2024-09-17T01:44:05.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.301+0000 7ff97f600640 1 -- start start 2024-09-17T01:44:05.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.303+0000 7ff97f600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff978072e90 0x7ff97813ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:05.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.303+0000 7ff97f600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9780b3550 0x7ff978140a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:05.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.303+0000 7ff97f600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff978142f40 0x7ff978140fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:05.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.303+0000 7ff97f600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff97806d430 con 0x7ff978072e90 2024-09-17T01:44:05.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.303+0000 7ff97f600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff97806d5b0 con 0x7ff9780b3550 2024-09-17T01:44:05.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.303+0000 7ff97f600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff97806d730 con 0x7ff978142f40 2024-09-17T01:44:05.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.303+0000 7ff97cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff978072e90 0x7ff97813ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:05.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.303+0000 7ff97cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff978072e90 0x7ff97813ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54260/0 (socket says 172.21.15.42:54260) 2024-09-17T01:44:05.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.303+0000 7ff97cc00640 1 -- 172.21.15.42:0/326043501 learned_addr learned my addr 172.21.15.42:0/326043501 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:05.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.303+0000 7ff97d600640 1 --2- 172.21.15.42:0/326043501 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff978142f40 0x7ff978140fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:05.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.303+0000 7ff977e00640 1 --2- 172.21.15.42:0/326043501 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9780b3550 0x7ff978140a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:05.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.304+0000 7ff97cc00640 1 -- 172.21.15.42:0/326043501 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff978142f40 msgr2=0x7ff978140fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:05.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.304+0000 7ff97cc00640 1 --2- 172.21.15.42:0/326043501 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff978142f40 0x7ff978140fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:05.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.304+0000 7ff97cc00640 1 -- 172.21.15.42:0/326043501 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9780b3550 msgr2=0x7ff978140a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:05.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.304+0000 7ff97cc00640 1 --2- 172.21.15.42:0/326043501 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9780b3550 0x7ff978140a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:05.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.304+0000 7ff97cc00640 1 -- 172.21.15.42:0/326043501 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9781f7830 con 0x7ff978072e90 2024-09-17T01:44:05.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.304+0000 7ff97cc00640 1 --2- 172.21.15.42:0/326043501 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff978072e90 0x7ff97813ec50 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00d770 tx=0x7ff96c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:05.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.304+0000 7ff974c00640 1 -- 172.21.15.42:0/326043501 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c017070 con 0x7ff978072e90 2024-09-17T01:44:05.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.304+0000 7ff974c00640 1 -- 172.21.15.42:0/326043501 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff96c009d20 con 0x7ff978072e90 2024-09-17T01:44:05.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.304+0000 7ff97f600640 1 -- 172.21.15.42:0/326043501 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9781f7b10 con 0x7ff978072e90 2024-09-17T01:44:05.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.304+0000 7ff974c00640 1 -- 172.21.15.42:0/326043501 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c004280 con 0x7ff978072e90 2024-09-17T01:44:05.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.305+0000 7ff97f600640 1 -- 172.21.15.42:0/326043501 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9781e8030 con 0x7ff978072e90 2024-09-17T01:44:05.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.306+0000 7ff97f600640 1 -- 172.21.15.42:0/326043501 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9780cebb0 con 0x7ff978072e90 2024-09-17T01:44:05.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.307+0000 7ff974c00640 1 -- 172.21.15.42:0/326043501 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff96c005020 con 0x7ff978072e90 2024-09-17T01:44:05.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.308+0000 7ff974c00640 1 --2- 172.21.15.42:0/326043501 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff958078b90 0x7ff95807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:05.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.308+0000 7ff974c00640 1 -- 172.21.15.42:0/326043501 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5227+0+0 (secure 0 0 0) 0x7ff96c09ae50 con 0x7ff978072e90 2024-09-17T01:44:05.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.308+0000 7ff977e00640 1 --2- 172.21.15.42:0/326043501 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff958078b90 0x7ff95807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:05.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.309+0000 7ff977e00640 1 --2- 172.21.15.42:0/326043501 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff958078b90 0x7ff95807b0a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff964033000 tx=0x7ff964004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:05.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.313+0000 7ff974c00640 1 -- 172.21.15.42:0/326043501 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff9780cebb0 con 0x7ff978072e90 2024-09-17T01:44:05.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:05.506+0000 7ff97f600640 1 -- 172.21.15.42:0/326043501 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff97806dc50 con 0x7ff978072e90 2024-09-17T01:44:06.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.031+0000 7ff974c00640 1 -- 172.21.15.42:0/326043501 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v158) ==== 170+0+0 (secure 0 0 0) 0x7ff96c020020 con 0x7ff978072e90 2024-09-17T01:44:06.029 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-09-17T01:44:06.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.035+0000 7ff97f600640 1 -- 172.21.15.42:0/326043501 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff958078b90 msgr2=0x7ff95807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:06.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.035+0000 7ff97f600640 1 --2- 172.21.15.42:0/326043501 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff958078b90 0x7ff95807b0a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff964033000 tx=0x7ff964004730 comp rx=0 tx=0).stop 2024-09-17T01:44:06.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.035+0000 7ff97f600640 1 -- 172.21.15.42:0/326043501 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff978072e90 msgr2=0x7ff97813ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:06.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.035+0000 7ff97f600640 1 --2- 172.21.15.42:0/326043501 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff978072e90 0x7ff97813ec50 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00d770 tx=0x7ff96c00dc30 comp rx=0 tx=0).stop 2024-09-17T01:44:06.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.035+0000 7ff97f600640 1 -- 172.21.15.42:0/326043501 shutdown_connections 2024-09-17T01:44:06.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.035+0000 7ff97f600640 1 --2- 172.21.15.42:0/326043501 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff958078b90 0x7ff95807b0a0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:06.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.035+0000 7ff97f600640 1 --2- 172.21.15.42:0/326043501 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9780b3550 0x7ff978140a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:06.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.035+0000 7ff97f600640 1 --2- 172.21.15.42:0/326043501 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff978142f40 0x7ff978140fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:06.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.035+0000 7ff97f600640 1 --2- 172.21.15.42:0/326043501 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff978072e90 0x7ff97813ec50 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:06.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.035+0000 7ff97f600640 1 -- 172.21.15.42:0/326043501 >> 172.21.15.42:0/326043501 conn(0x7ff9780b2930 msgr2=0x7ff97815ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:06.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.035+0000 7ff97f600640 1 -- 172.21.15.42:0/326043501 shutdown_connections 2024-09-17T01:44:06.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.035+0000 7ff97f600640 1 -- 172.21.15.42:0/326043501 wait complete. 2024-09-17T01:44:06.071 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T01:44:06.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.306+0000 7f5236e00640 1 -- 172.21.15.42:0/546272653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52300b7040 msgr2=0x7f5230162870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:06.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.306+0000 7f5236e00640 1 --2- 172.21.15.42:0/546272653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52300b7040 0x7f5230162870 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f5228005fd0 tx=0x7f522802a820 comp rx=0 tx=0).stop 2024-09-17T01:44:06.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.306+0000 7f5236e00640 1 -- 172.21.15.42:0/546272653 shutdown_connections 2024-09-17T01:44:06.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.306+0000 7f5236e00640 1 --2- 172.21.15.42:0/546272653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52300b7040 0x7f5230162870 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:06.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.306+0000 7f5236e00640 1 --2- 172.21.15.42:0/546272653 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52300af3a0 0x7f523006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:06.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.306+0000 7f5236e00640 1 -- 172.21.15.42:0/546272653 >> 172.21.15.42:0/546272653 conn(0x7f52300b7990 msgr2=0x7f52300b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:06.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.306+0000 7f5236e00640 1 -- 172.21.15.42:0/546272653 shutdown_connections 2024-09-17T01:44:06.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.306+0000 7f5236e00640 1 -- 172.21.15.42:0/546272653 wait complete. 2024-09-17T01:44:06.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.309+0000 7f5236e00640 1 Processor -- start 2024-09-17T01:44:06.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.309+0000 7f5236e00640 1 -- start start 2024-09-17T01:44:06.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.310+0000 7f5236e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52300af3a0 0x7f523014c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:06.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.310+0000 7f5236e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52300b7040 0x7f5230148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:06.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.310+0000 7f5236e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52300d21b0 0x7f52301f8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:06.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.310+0000 7f5236e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5230162db0 con 0x7f52300af3a0 2024-09-17T01:44:06.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.310+0000 7f5236e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f52300b7720 con 0x7f52300d21b0 2024-09-17T01:44:06.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.310+0000 7f5236e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5230162f30 con 0x7f52300b7040 2024-09-17T01:44:06.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.310+0000 7f522fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52300af3a0 0x7f523014c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:06.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.310+0000 7f522fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52300af3a0 0x7f523014c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36320/0 (socket says 172.21.15.42:36320) 2024-09-17T01:44:06.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.310+0000 7f522fe00640 1 -- 172.21.15.42:0/3623155675 learned_addr learned my addr 172.21.15.42:0/3623155675 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:06.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.311+0000 7f5227400640 1 --2- 172.21.15.42:0/3623155675 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52300b7040 0x7f5230148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:06.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.311+0000 7f5234e00640 1 --2- 172.21.15.42:0/3623155675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52300d21b0 0x7f52301f8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:06.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.311+0000 7f522fe00640 1 -- 172.21.15.42:0/3623155675 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52300b7040 msgr2=0x7f5230148e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:06.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.311+0000 7f522fe00640 1 --2- 172.21.15.42:0/3623155675 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52300b7040 0x7f5230148e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:06.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.311+0000 7f522fe00640 1 -- 172.21.15.42:0/3623155675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52300d21b0 msgr2=0x7f52301f8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:06.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.311+0000 7f522fe00640 1 --2- 172.21.15.42:0/3623155675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52300d21b0 0x7f52301f8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:06.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.311+0000 7f522fe00640 1 -- 172.21.15.42:0/3623155675 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52300a0320 con 0x7f52300af3a0 2024-09-17T01:44:06.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.311+0000 7f522fe00640 1 --2- 172.21.15.42:0/3623155675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52300af3a0 0x7f523014c1a0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f522000c730 tx=0x7f522000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:06.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.312+0000 7f522cc00640 1 -- 172.21.15.42:0/3623155675 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5220016020 con 0x7f52300af3a0 2024-09-17T01:44:06.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.312+0000 7f5236e00640 1 -- 172.21.15.42:0/3623155675 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f523015e4b0 con 0x7f52300af3a0 2024-09-17T01:44:06.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.312+0000 7f522cc00640 1 -- 172.21.15.42:0/3623155675 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f522000a950 con 0x7f52300af3a0 2024-09-17T01:44:06.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.312+0000 7f522cc00640 1 -- 172.21.15.42:0/3623155675 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f522000ada0 con 0x7f52300af3a0 2024-09-17T01:44:06.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.312+0000 7f5236e00640 1 -- 172.21.15.42:0/3623155675 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f523015ea70 con 0x7f52300af3a0 2024-09-17T01:44:06.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.313+0000 7f5236e00640 1 -- 172.21.15.42:0/3623155675 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f523006cd20 con 0x7f52300af3a0 2024-09-17T01:44:06.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.314+0000 7f522cc00640 1 -- 172.21.15.42:0/3623155675 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5220019020 con 0x7f52300af3a0 2024-09-17T01:44:06.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.315+0000 7f522cc00640 1 --2- 172.21.15.42:0/3623155675 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f520c078b90 0x7f520c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:06.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.315+0000 7f522cc00640 1 -- 172.21.15.42:0/3623155675 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5609+0+0 (secure 0 0 0) 0x7f522009ad10 con 0x7f52300af3a0 2024-09-17T01:44:06.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.316+0000 7f5227400640 1 --2- 172.21.15.42:0/3623155675 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f520c078b90 0x7f520c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:06.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.317+0000 7f5227400640 1 --2- 172.21.15.42:0/3623155675 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f520c078b90 0x7f520c07b0a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f52300d1ef0 tx=0x7f5218005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:06.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.319+0000 7f522cc00640 1 -- 172.21.15.42:0/3623155675 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5220020030 con 0x7f52300af3a0 2024-09-17T01:44:06.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:06.555+0000 7f5236e00640 1 -- 172.21.15.42:0/3623155675 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f523014c6e0 con 0x7f52300af3a0 2024-09-17T01:44:07.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.033+0000 7f522cc00640 1 -- 172.21.15.42:0/3623155675 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v121) ==== 174+0+0 (secure 0 0 0) 0x7f52300b80d0 con 0x7f52300af3a0 2024-09-17T01:44:07.031 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 22 and data pool 23 2024-09-17T01:44:07.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.038+0000 7f5236e00640 1 -- 172.21.15.42:0/3623155675 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f520c078b90 msgr2=0x7f520c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:07.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.038+0000 7f5236e00640 1 --2- 172.21.15.42:0/3623155675 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f520c078b90 0x7f520c07b0a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f52300d1ef0 tx=0x7f5218005f90 comp rx=0 tx=0).stop 2024-09-17T01:44:07.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.038+0000 7f5236e00640 1 -- 172.21.15.42:0/3623155675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52300af3a0 msgr2=0x7f523014c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:07.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.038+0000 7f5236e00640 1 --2- 172.21.15.42:0/3623155675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52300af3a0 0x7f523014c1a0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f522000c730 tx=0x7f522000cbf0 comp rx=0 tx=0).stop 2024-09-17T01:44:07.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.040+0000 7f5236e00640 1 -- 172.21.15.42:0/3623155675 shutdown_connections 2024-09-17T01:44:07.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.040+0000 7f5236e00640 1 --2- 172.21.15.42:0/3623155675 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f520c078b90 0x7f520c07b0a0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:07.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.040+0000 7f5236e00640 1 --2- 172.21.15.42:0/3623155675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52300d21b0 0x7f52301f8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:07.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.040+0000 7f5236e00640 1 --2- 172.21.15.42:0/3623155675 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52300b7040 0x7f5230148e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:07.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.040+0000 7f5236e00640 1 --2- 172.21.15.42:0/3623155675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52300af3a0 0x7f523014c1a0 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:07.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.040+0000 7f5236e00640 1 -- 172.21.15.42:0/3623155675 >> 172.21.15.42:0/3623155675 conn(0x7f52300b7990 msgr2=0x7f523015c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:07.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.041+0000 7f5236e00640 1 -- 172.21.15.42:0/3623155675 shutdown_connections 2024-09-17T01:44:07.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.041+0000 7f5236e00640 1 -- 172.21.15.42:0/3623155675 wait complete. 2024-09-17T01:44:07.089 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:44:07.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.319+0000 7f1f7a600640 1 -- 172.21.15.42:0/2829384833 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f740cec40 msgr2=0x7f1f740cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:07.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.320+0000 7f1f7a600640 1 --2- 172.21.15.42:0/2829384833 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f740cec40 0x7f1f740cf050 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009be0 tx=0x7f1f6c02a890 comp rx=0 tx=0).stop 2024-09-17T01:44:07.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.320+0000 7f1f7a600640 1 -- 172.21.15.42:0/2829384833 shutdown_connections 2024-09-17T01:44:07.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.320+0000 7f1f7a600640 1 --2- 172.21.15.42:0/2829384833 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f740cec40 0x7f1f740cf050 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:07.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.320+0000 7f1f7a600640 1 -- 172.21.15.42:0/2829384833 >> 172.21.15.42:0/2829384833 conn(0x7f1f740b2930 msgr2=0x7f1f7406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:07.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.320+0000 7f1f7a600640 1 -- 172.21.15.42:0/2829384833 shutdown_connections 2024-09-17T01:44:07.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.320+0000 7f1f7a600640 1 -- 172.21.15.42:0/2829384833 wait complete. 2024-09-17T01:44:07.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.322+0000 7f1f7a600640 1 Processor -- start 2024-09-17T01:44:07.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.322+0000 7f1f7a600640 1 -- start start 2024-09-17T01:44:07.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.323+0000 7f1f7a600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f740b3550 0x7f1f740ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:07.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.323+0000 7f1f7a600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f740cec40 0x7f1f740af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:07.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.323+0000 7f1f7a600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f74142f40 0x7f1f74141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:07.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.323+0000 7f1f7a600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7406d8d0 con 0x7f1f74142f40 2024-09-17T01:44:07.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.324+0000 7f1f7a600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7406d750 con 0x7f1f740b3550 2024-09-17T01:44:07.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.324+0000 7f1f7a600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1f7406da50 con 0x7f1f740cec40 2024-09-17T01:44:07.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.324+0000 7f1f73e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f74142f40 0x7f1f74141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:07.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.324+0000 7f1f73e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f74142f40 0x7f1f74141e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36336/0 (socket says 172.21.15.42:36336) 2024-09-17T01:44:07.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.324+0000 7f1f73e00640 1 -- 172.21.15.42:0/39997846 learned_addr learned my addr 172.21.15.42:0/39997846 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:07.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.324+0000 7f1f6be00640 1 --2- 172.21.15.42:0/39997846 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f740cec40 0x7f1f740af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:07.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.324+0000 7f1f73400640 1 --2- 172.21.15.42:0/39997846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f740b3550 0x7f1f740ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:07.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.324+0000 7f1f73e00640 1 -- 172.21.15.42:0/39997846 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f740cec40 msgr2=0x7f1f740af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:07.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.324+0000 7f1f73e00640 1 --2- 172.21.15.42:0/39997846 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f740cec40 0x7f1f740af530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:07.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.324+0000 7f1f73e00640 1 -- 172.21.15.42:0/39997846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f740b3550 msgr2=0x7f1f740ac2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:07.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.324+0000 7f1f73e00640 1 --2- 172.21.15.42:0/39997846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f740b3550 0x7f1f740ac2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:07.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.324+0000 7f1f73e00640 1 -- 172.21.15.42:0/39997846 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f740aa630 con 0x7f1f74142f40 2024-09-17T01:44:07.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.324+0000 7f1f6be00640 1 --2- 172.21.15.42:0/39997846 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f740cec40 0x7f1f740af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:44:07.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.325+0000 7f1f73e00640 1 --2- 172.21.15.42:0/39997846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f74142f40 0x7f1f74141e20 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009d00 tx=0x7f1f6c033f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:07.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.325+0000 7f1f6b400640 1 -- 172.21.15.42:0/39997846 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c031d80 con 0x7f1f74142f40 2024-09-17T01:44:07.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.325+0000 7f1f6b400640 1 -- 172.21.15.42:0/39997846 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f6c003a60 con 0x7f1f74142f40 2024-09-17T01:44:07.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.325+0000 7f1f7a600640 1 -- 172.21.15.42:0/39997846 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f740aa910 con 0x7f1f74142f40 2024-09-17T01:44:07.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.325+0000 7f1f6b400640 1 -- 172.21.15.42:0/39997846 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c0330d0 con 0x7f1f74142f40 2024-09-17T01:44:07.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.325+0000 7f1f7a600640 1 -- 172.21.15.42:0/39997846 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f740aaed0 con 0x7f1f74142f40 2024-09-17T01:44:07.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.326+0000 7f1f7a600640 1 -- 172.21.15.42:0/39997846 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f740cf050 con 0x7f1f74142f40 2024-09-17T01:44:07.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.327+0000 7f1f6b400640 1 -- 172.21.15.42:0/39997846 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1f6c033270 con 0x7f1f74142f40 2024-09-17T01:44:07.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.328+0000 7f1f6b400640 1 --2- 172.21.15.42:0/39997846 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1f50078b90 0x7f1f5007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:07.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.328+0000 7f1f6b400640 1 -- 172.21.15.42:0/39997846 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5709+0+0 (secure 0 0 0) 0x7f1f6c0bbff0 con 0x7f1f74142f40 2024-09-17T01:44:07.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.329+0000 7f1f73400640 1 --2- 172.21.15.42:0/39997846 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1f50078b90 0x7f1f5007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:07.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.330+0000 7f1f73400640 1 --2- 172.21.15.42:0/39997846 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1f50078b90 0x7f1f5007b0a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f1f64007fd0 tx=0x7f1f64009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:07.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.333+0000 7f1f6b400640 1 -- 172.21.15.42:0/39997846 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1f6c03f030 con 0x7f1f74142f40 2024-09-17T01:44:07.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.529+0000 7f1f7a600640 1 -- 172.21.15.42:0/39997846 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f740ac930 con 0x7f1f74142f40 2024-09-17T01:44:07.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.530+0000 7f1f6b400640 1 -- 172.21.15.42:0/39997846 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) ==== 74+0+16704 (secure 0 0 0) 0x7f1f6c031790 con 0x7f1f74142f40 2024-09-17T01:44:07.528 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:44:07.528 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":159,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:44:06.556701+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:44:04.499543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T01:44:05.519952+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:44:07.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.532+0000 7f1f7a600640 1 -- 172.21.15.42:0/39997846 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1f50078b90 msgr2=0x7f1f5007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:07.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.532+0000 7f1f7a600640 1 --2- 172.21.15.42:0/39997846 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1f50078b90 0x7f1f5007b0a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f1f64007fd0 tx=0x7f1f64009040 comp rx=0 tx=0).stop 2024-09-17T01:44:07.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.532+0000 7f1f7a600640 1 -- 172.21.15.42:0/39997846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f74142f40 msgr2=0x7f1f74141e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:07.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.532+0000 7f1f7a600640 1 --2- 172.21.15.42:0/39997846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f74142f40 0x7f1f74141e20 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009d00 tx=0x7f1f6c033f30 comp rx=0 tx=0).stop 2024-09-17T01:44:07.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.532+0000 7f1f7a600640 1 -- 172.21.15.42:0/39997846 shutdown_connections 2024-09-17T01:44:07.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.532+0000 7f1f7a600640 1 --2- 172.21.15.42:0/39997846 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1f50078b90 0x7f1f5007b0a0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:07.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.532+0000 7f1f7a600640 1 --2- 172.21.15.42:0/39997846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1f74142f40 0x7f1f74141e20 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:07.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.532+0000 7f1f7a600640 1 --2- 172.21.15.42:0/39997846 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1f740cec40 0x7f1f740af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:07.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.532+0000 7f1f7a600640 1 --2- 172.21.15.42:0/39997846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f740b3550 0x7f1f740ac2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:07.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.532+0000 7f1f7a600640 1 -- 172.21.15.42:0/39997846 >> 172.21.15.42:0/39997846 conn(0x7f1f740b2930 msgr2=0x7f1f7415bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:07.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.533+0000 7f1f7a600640 1 -- 172.21.15.42:0/39997846 shutdown_connections 2024-09-17T01:44:07.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.533+0000 7f1f7a600640 1 -- 172.21.15.42:0/39997846 wait complete. 2024-09-17T01:44:07.553 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:44:07.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.783+0000 7f3576200640 1 -- 172.21.15.42:0/38764021 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3570070c40 msgr2=0x7f357015cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:07.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.783+0000 7f3576200640 1 --2- 172.21.15.42:0/38764021 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3570070c40 0x7f357015cb80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f355c009860 tx=0x7f355c02a510 comp rx=0 tx=0).stop 2024-09-17T01:44:07.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.783+0000 7f3576200640 1 -- 172.21.15.42:0/38764021 shutdown_connections 2024-09-17T01:44:07.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.783+0000 7f3576200640 1 --2- 172.21.15.42:0/38764021 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3570070c40 0x7f357015cb80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:07.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.783+0000 7f3576200640 1 -- 172.21.15.42:0/38764021 >> 172.21.15.42:0/38764021 conn(0x7f35700cd4c0 msgr2=0x7f35700cd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:07.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.783+0000 7f3576200640 1 -- 172.21.15.42:0/38764021 shutdown_connections 2024-09-17T01:44:07.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.783+0000 7f3576200640 1 -- 172.21.15.42:0/38764021 wait complete. 2024-09-17T01:44:07.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.785+0000 7f3576200640 1 Processor -- start 2024-09-17T01:44:07.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.785+0000 7f3576200640 1 -- start start 2024-09-17T01:44:07.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.787+0000 7f3576200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f357006eb00 0x7f35701f67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:07.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.787+0000 7f3576200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f35700b64b0 0x7f3570145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:07.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.787+0000 7f3576200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f357014d440 0x7f35701f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:07.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.787+0000 7f3576200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3570153530 con 0x7f357006eb00 2024-09-17T01:44:07.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.787+0000 7f3576200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f35701533b0 con 0x7f357014d440 2024-09-17T01:44:07.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.787+0000 7f3576200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f35701536b0 con 0x7f35700b64b0 2024-09-17T01:44:07.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.787+0000 7f3574e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f357006eb00 0x7f35701f67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:07.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.787+0000 7f3574e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f357006eb00 0x7f35701f67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36338/0 (socket says 172.21.15.42:36338) 2024-09-17T01:44:07.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.787+0000 7f3574e00640 1 -- 172.21.15.42:0/3863867306 learned_addr learned my addr 172.21.15.42:0/3863867306 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:07.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.787+0000 7f356fe00640 1 --2- 172.21.15.42:0/3863867306 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f35700b64b0 0x7f3570145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:07.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.787+0000 7f3575800640 1 --2- 172.21.15.42:0/3863867306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f357014d440 0x7f35701f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:07.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.788+0000 7f3574e00640 1 -- 172.21.15.42:0/3863867306 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f35700b64b0 msgr2=0x7f3570145490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:07.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.788+0000 7f3574e00640 1 --2- 172.21.15.42:0/3863867306 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f35700b64b0 0x7f3570145490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:07.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.788+0000 7f3574e00640 1 -- 172.21.15.42:0/3863867306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f357014d440 msgr2=0x7f35701f3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:07.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.788+0000 7f3574e00640 1 --2- 172.21.15.42:0/3863867306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f357014d440 0x7f35701f3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:07.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.788+0000 7f3574e00640 1 -- 172.21.15.42:0/3863867306 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35701459d0 con 0x7f357006eb00 2024-09-17T01:44:07.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.788+0000 7f3575800640 1 --2- 172.21.15.42:0/3863867306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f357014d440 0x7f35701f3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:44:07.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.788+0000 7f3574e00640 1 --2- 172.21.15.42:0/3863867306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f357006eb00 0x7f35701f67f0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f356400c430 tx=0x7f356400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:07.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.788+0000 7f356cc00640 1 -- 172.21.15.42:0/3863867306 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3564011790 con 0x7f357006eb00 2024-09-17T01:44:07.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.788+0000 7f356cc00640 1 -- 172.21.15.42:0/3863867306 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3564017070 con 0x7f357006eb00 2024-09-17T01:44:07.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.788+0000 7f3576200640 1 -- 172.21.15.42:0/3863867306 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35701f40e0 con 0x7f357006eb00 2024-09-17T01:44:07.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.788+0000 7f356cc00640 1 -- 172.21.15.42:0/3863867306 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3564011ce0 con 0x7f357006eb00 2024-09-17T01:44:07.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.788+0000 7f3576200640 1 -- 172.21.15.42:0/3863867306 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35701f73b0 con 0x7f357006eb00 2024-09-17T01:44:07.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.789+0000 7f3576200640 1 -- 172.21.15.42:0/3863867306 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f357015cb80 con 0x7f357006eb00 2024-09-17T01:44:07.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.791+0000 7f356cc00640 1 -- 172.21.15.42:0/3863867306 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f356401c460 con 0x7f357006eb00 2024-09-17T01:44:07.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.791+0000 7f356cc00640 1 --2- 172.21.15.42:0/3863867306 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3550078bc0 0x7f355007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:07.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.792+0000 7f356cc00640 1 -- 172.21.15.42:0/3863867306 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5709+0+0 (secure 0 0 0) 0x7f356409ab10 con 0x7f357006eb00 2024-09-17T01:44:07.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.792+0000 7f356fe00640 1 --2- 172.21.15.42:0/3863867306 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3550078bc0 0x7f355007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:07.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.793+0000 7f356fe00640 1 --2- 172.21.15.42:0/3863867306 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3550078bc0 0x7f355007b0d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f355c034000 tx=0x7f355c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:07.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.796+0000 7f356cc00640 1 -- 172.21.15.42:0/3863867306 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3564062f40 con 0x7f357006eb00 2024-09-17T01:44:07.990 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.992+0000 7f3576200640 1 -- 172.21.15.42:0/3863867306 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35700b5bd0 con 0x7f357006eb00 2024-09-17T01:44:07.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.994+0000 7f356cc00640 1 -- 172.21.15.42:0/3863867306 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) ==== 74+0+16704 (secure 0 0 0) 0x7f3564062840 con 0x7f357006eb00 2024-09-17T01:44:07.992 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:44:07.992 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":159,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:44:06.556701+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:44:04.499543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T01:44:05.519952+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:44:07.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.996+0000 7f3576200640 1 -- 172.21.15.42:0/3863867306 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3550078bc0 msgr2=0x7f355007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:07.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.996+0000 7f3576200640 1 --2- 172.21.15.42:0/3863867306 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3550078bc0 0x7f355007b0d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f355c034000 tx=0x7f355c004730 comp rx=0 tx=0).stop 2024-09-17T01:44:07.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.996+0000 7f3576200640 1 -- 172.21.15.42:0/3863867306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f357006eb00 msgr2=0x7f35701f67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:07.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.996+0000 7f3576200640 1 --2- 172.21.15.42:0/3863867306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f357006eb00 0x7f35701f67f0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f356400c430 tx=0x7f356400c8f0 comp rx=0 tx=0).stop 2024-09-17T01:44:07.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.996+0000 7f3576200640 1 -- 172.21.15.42:0/3863867306 shutdown_connections 2024-09-17T01:44:07.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.996+0000 7f3576200640 1 --2- 172.21.15.42:0/3863867306 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3550078bc0 0x7f355007b0d0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:07.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.996+0000 7f3576200640 1 --2- 172.21.15.42:0/3863867306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f357014d440 0x7f35701f3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:07.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.996+0000 7f3576200640 1 --2- 172.21.15.42:0/3863867306 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f35700b64b0 0x7f3570145490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:07.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.996+0000 7f3576200640 1 --2- 172.21.15.42:0/3863867306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f357006eb00 0x7f35701f67f0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:07.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.996+0000 7f3576200640 1 -- 172.21.15.42:0/3863867306 >> 172.21.15.42:0/3863867306 conn(0x7f35700cd4c0 msgr2=0x7f357014f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:07.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.996+0000 7f3576200640 1 -- 172.21.15.42:0/3863867306 shutdown_connections 2024-09-17T01:44:07.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:07.996+0000 7f3576200640 1 -- 172.21.15.42:0/3863867306 wait complete. 2024-09-17T01:44:08.019 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T01:44:08.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.254+0000 7fb710a00640 1 -- 172.21.15.42:0/2588159895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb70c0cec40 msgr2=0x7fb70c0cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:08.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.254+0000 7fb710a00640 1 --2- 172.21.15.42:0/2588159895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb70c0cec40 0x7fb70c0cf050 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fb704005fd0 tx=0x7fb70402a820 comp rx=0 tx=0).stop 2024-09-17T01:44:08.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.254+0000 7fb710a00640 1 -- 172.21.15.42:0/2588159895 shutdown_connections 2024-09-17T01:44:08.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.254+0000 7fb710a00640 1 --2- 172.21.15.42:0/2588159895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb70c0cec40 0x7fb70c0cf050 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:08.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.254+0000 7fb710a00640 1 --2- 172.21.15.42:0/2588159895 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb70c0b3550 0x7fb70c15cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:08.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.254+0000 7fb710a00640 1 -- 172.21.15.42:0/2588159895 >> 172.21.15.42:0/2588159895 conn(0x7fb70c0b2930 msgr2=0x7fb70c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:08.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.254+0000 7fb710a00640 1 -- 172.21.15.42:0/2588159895 shutdown_connections 2024-09-17T01:44:08.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.254+0000 7fb710a00640 1 -- 172.21.15.42:0/2588159895 wait complete. 2024-09-17T01:44:08.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.256+0000 7fb710a00640 1 Processor -- start 2024-09-17T01:44:08.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.257+0000 7fb710a00640 1 -- start start 2024-09-17T01:44:08.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.258+0000 7fb710a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb70c0b3550 0x7fb70c06fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:08.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.258+0000 7fb710a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb70c0cec40 0x7fb70c13eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:08.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.258+0000 7fb710a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb70c142f40 0x7fb70c0ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:08.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.258+0000 7fb710a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c06d7c0 con 0x7fb70c142f40 2024-09-17T01:44:08.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.258+0000 7fb710a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c06d640 con 0x7fb70c0cec40 2024-09-17T01:44:08.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.258+0000 7fb710a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb70c06d940 con 0x7fb70c0b3550 2024-09-17T01:44:08.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.258+0000 7fb70a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb70c142f40 0x7fb70c0ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:08.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.258+0000 7fb70a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb70c142f40 0x7fb70c0ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36354/0 (socket says 172.21.15.42:36354) 2024-09-17T01:44:08.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.258+0000 7fb70a800640 1 -- 172.21.15.42:0/42216393 learned_addr learned my addr 172.21.15.42:0/42216393 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:08.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.259+0000 7fb709e00640 1 --2- 172.21.15.42:0/42216393 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb70c0b3550 0x7fb70c06fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:08.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.259+0000 7fb703e00640 1 --2- 172.21.15.42:0/42216393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb70c0cec40 0x7fb70c13eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:08.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.259+0000 7fb70a800640 1 -- 172.21.15.42:0/42216393 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb70c0b3550 msgr2=0x7fb70c06fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:08.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.259+0000 7fb70a800640 1 --2- 172.21.15.42:0/42216393 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb70c0b3550 0x7fb70c06fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:08.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.259+0000 7fb70a800640 1 -- 172.21.15.42:0/42216393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb70c0cec40 msgr2=0x7fb70c13eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:08.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.259+0000 7fb70a800640 1 --2- 172.21.15.42:0/42216393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb70c0cec40 0x7fb70c13eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:08.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.259+0000 7fb70a800640 1 -- 172.21.15.42:0/42216393 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70c1f9700 con 0x7fb70c142f40 2024-09-17T01:44:08.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.259+0000 7fb70a800640 1 --2- 172.21.15.42:0/42216393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb70c142f40 0x7fb70c0ae8a0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fb704035040 tx=0x7fb704032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:08.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.259+0000 7fb702000640 1 -- 172.21.15.42:0/42216393 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb704037040 con 0x7fb70c142f40 2024-09-17T01:44:08.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.260+0000 7fb702000640 1 -- 172.21.15.42:0/42216393 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb704042070 con 0x7fb70c142f40 2024-09-17T01:44:08.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.260+0000 7fb710a00640 1 -- 172.21.15.42:0/42216393 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb70c1f99e0 con 0x7fb70c142f40 2024-09-17T01:44:08.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.260+0000 7fb702000640 1 -- 172.21.15.42:0/42216393 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb704004260 con 0x7fb70c142f40 2024-09-17T01:44:08.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.260+0000 7fb710a00640 1 -- 172.21.15.42:0/42216393 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb70c0c6c20 con 0x7fb70c142f40 2024-09-17T01:44:08.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.261+0000 7fb710a00640 1 -- 172.21.15.42:0/42216393 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb70c1f9470 con 0x7fb70c142f40 2024-09-17T01:44:08.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.262+0000 7fb702000640 1 -- 172.21.15.42:0/42216393 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb704004400 con 0x7fb70c142f40 2024-09-17T01:44:08.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.263+0000 7fb702000640 1 --2- 172.21.15.42:0/42216393 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb6e8078b90 0x7fb6e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:08.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.263+0000 7fb702000640 1 -- 172.21.15.42:0/42216393 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7fb7040bbbe0 con 0x7fb70c142f40 2024-09-17T01:44:08.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.263+0000 7fb709e00640 1 --2- 172.21.15.42:0/42216393 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb6e8078b90 0x7fb6e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:08.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.264+0000 7fb709e00640 1 --2- 172.21.15.42:0/42216393 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb6e8078b90 0x7fb6e807b0a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc005fd0 tx=0x7fb6fc005850 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:08.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.267+0000 7fb702000640 1 -- 172.21.15.42:0/42216393 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb7040840a0 con 0x7fb70c142f40 2024-09-17T01:44:08.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:08.498+0000 7fb710a00640 1 -- 172.21.15.42:0/42216393 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb70c15cec0 con 0x7fb70c142f40 2024-09-17T01:44:09.010 INFO:tasks.ceph.mds.c.smithi042.stderr:2024-09-17T01:44:09.013+0000 7f3932400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:44:09.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.056+0000 7fb702000640 1 -- 172.21.15.42:0/42216393 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v124) ==== 118+0+0 (secure 0 0 0) 0x7fb7040839a0 con 0x7fb70c142f40 2024-09-17T01:44:09.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.059+0000 7fb710a00640 1 -- 172.21.15.42:0/42216393 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb6e8078b90 msgr2=0x7fb6e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:09.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.059+0000 7fb710a00640 1 --2- 172.21.15.42:0/42216393 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb6e8078b90 0x7fb6e807b0a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc005fd0 tx=0x7fb6fc005850 comp rx=0 tx=0).stop 2024-09-17T01:44:09.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.059+0000 7fb710a00640 1 -- 172.21.15.42:0/42216393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb70c142f40 msgr2=0x7fb70c0ae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:09.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.059+0000 7fb710a00640 1 --2- 172.21.15.42:0/42216393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb70c142f40 0x7fb70c0ae8a0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fb704035040 tx=0x7fb704032d10 comp rx=0 tx=0).stop 2024-09-17T01:44:09.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.059+0000 7fb710a00640 1 -- 172.21.15.42:0/42216393 shutdown_connections 2024-09-17T01:44:09.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.059+0000 7fb710a00640 1 --2- 172.21.15.42:0/42216393 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb6e8078b90 0x7fb6e807b0a0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:09.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.059+0000 7fb710a00640 1 --2- 172.21.15.42:0/42216393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb70c0cec40 0x7fb70c13eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:09.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.059+0000 7fb710a00640 1 --2- 172.21.15.42:0/42216393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb70c142f40 0x7fb70c0ae8a0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:09.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.059+0000 7fb710a00640 1 --2- 172.21.15.42:0/42216393 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb70c0b3550 0x7fb70c06fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:09.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.059+0000 7fb710a00640 1 -- 172.21.15.42:0/42216393 >> 172.21.15.42:0/42216393 conn(0x7fb70c0b2930 msgr2=0x7fb70c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:09.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.059+0000 7fb710a00640 1 -- 172.21.15.42:0/42216393 shutdown_connections 2024-09-17T01:44:09.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.059+0000 7fb710a00640 1 -- 172.21.15.42:0/42216393 wait complete. 2024-09-17T01:44:09.081 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T01:44:09.081 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T01:44:09.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.318+0000 7f9e6fe00640 1 -- 172.21.15.42:0/1475405102 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e54004800 msgr2=0x7f9e54004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:09.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.319+0000 7f9e6fe00640 1 --2- 172.21.15.42:0/1475405102 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e54004800 0x7f9e54004c10 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f9e580017c0 tx=0x7f9e54005830 comp rx=0 tx=0).stop 2024-09-17T01:44:09.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.319+0000 7f9e6f400640 1 -- 172.21.15.42:0/1475405102 reap_dead start 2024-09-17T01:44:09.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.319+0000 7f9e6fe00640 1 -- 172.21.15.42:0/1475405102 shutdown_connections 2024-09-17T01:44:09.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.319+0000 7f9e6fe00640 1 -- 172.21.15.42:0/1475405102 >> 172.21.15.42:0/1475405102 conn(0x7f9e700b25f0 msgr2=0x7f9e700d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:09.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.319+0000 7f9e6fe00640 1 -- 172.21.15.42:0/1475405102 shutdown_connections 2024-09-17T01:44:09.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.319+0000 7f9e6fe00640 1 -- 172.21.15.42:0/1475405102 wait complete. 2024-09-17T01:44:09.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.321+0000 7f9e6fe00640 1 Processor -- start 2024-09-17T01:44:09.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.321+0000 7f9e6fe00640 1 -- start start 2024-09-17T01:44:09.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.323+0000 7f9e6fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e54004800 0x7f9e70073630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:09.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.323+0000 7f9e6fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e701e5880 0x7f9e700caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:09.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.323+0000 7f9e6fe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e701e5c90 0x7f9e7014f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:09.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.323+0000 7f9e6fe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7006d6a0 con 0x7f9e54004800 2024-09-17T01:44:09.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.323+0000 7f9e6fe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9e700b42c0 con 0x7f9e701e5880 2024-09-17T01:44:09.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.323+0000 7f9e6fe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9e70152ed0 con 0x7f9e701e5c90 2024-09-17T01:44:09.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.323+0000 7f9e6ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e54004800 0x7f9e70073630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:09.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.323+0000 7f9e6ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e54004800 0x7f9e70073630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36372/0 (socket says 172.21.15.42:36372) 2024-09-17T01:44:09.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.323+0000 7f9e6ea00640 1 -- 172.21.15.42:0/4099229841 learned_addr learned my addr 172.21.15.42:0/4099229841 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:09.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.323+0000 7f9e67e00640 1 --2- 172.21.15.42:0/4099229841 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e701e5880 0x7f9e700caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:09.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.323+0000 7f9e6f400640 1 --2- 172.21.15.42:0/4099229841 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e701e5c90 0x7f9e7014f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:09.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.323+0000 7f9e6ea00640 1 -- 172.21.15.42:0/4099229841 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e701e5c90 msgr2=0x7f9e7014f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:09.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.323+0000 7f9e6ea00640 1 --2- 172.21.15.42:0/4099229841 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e701e5c90 0x7f9e7014f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:09.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.323+0000 7f9e6ea00640 1 -- 172.21.15.42:0/4099229841 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e701e5880 msgr2=0x7f9e700caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:09.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.323+0000 7f9e6ea00640 1 --2- 172.21.15.42:0/4099229841 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e701e5880 0x7f9e700caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:09.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.323+0000 7f9e6ea00640 1 -- 172.21.15.42:0/4099229841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e700ca760 con 0x7f9e54004800 2024-09-17T01:44:09.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.323+0000 7f9e67e00640 1 --2- 172.21.15.42:0/4099229841 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e701e5880 0x7f9e700caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:44:09.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.324+0000 7f9e6ea00640 1 --2- 172.21.15.42:0/4099229841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e54004800 0x7f9e70073630 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f9e60006480 tx=0x7f9e600039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:09.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.324+0000 7f9e66a00640 1 -- 172.21.15.42:0/4099229841 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e60015070 con 0x7f9e54004800 2024-09-17T01:44:09.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.324+0000 7f9e66a00640 1 -- 172.21.15.42:0/4099229841 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e60011920 con 0x7f9e54004800 2024-09-17T01:44:09.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.324+0000 7f9e6fe00640 1 -- 172.21.15.42:0/4099229841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e701500f0 con 0x7f9e54004800 2024-09-17T01:44:09.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.324+0000 7f9e66a00640 1 -- 172.21.15.42:0/4099229841 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e60011d70 con 0x7f9e54004800 2024-09-17T01:44:09.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.324+0000 7f9e6fe00640 1 -- 172.21.15.42:0/4099229841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e700cc090 con 0x7f9e54004800 2024-09-17T01:44:09.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.325+0000 7f9e6fe00640 1 -- 172.21.15.42:0/4099229841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e7006cd20 con 0x7f9e54004800 2024-09-17T01:44:09.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.326+0000 7f9e66a00640 1 -- 172.21.15.42:0/4099229841 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9e60018070 con 0x7f9e54004800 2024-09-17T01:44:09.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.327+0000 7f9e66a00640 1 --2- 172.21.15.42:0/4099229841 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e4c078bc0 0x7f9e4c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:09.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.327+0000 7f9e66a00640 1 -- 172.21.15.42:0/4099229841 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7f9e6009bac0 con 0x7f9e54004800 2024-09-17T01:44:09.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.328+0000 7f9e67e00640 1 --2- 172.21.15.42:0/4099229841 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e4c078bc0 0x7f9e4c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:09.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.329+0000 7f9e67e00640 1 --2- 172.21.15.42:0/4099229841 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e4c078bc0 0x7f9e4c07b0d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9e58032000 tx=0x7f9e5802c000 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:09.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.332+0000 7f9e66a00640 1 -- 172.21.15.42:0/4099229841 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9e60063f00 con 0x7f9e54004800 2024-09-17T01:44:09.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:09.562+0000 7f9e6fe00640 1 -- 172.21.15.42:0/4099229841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f9e700b0890 con 0x7f9e54004800 2024-09-17T01:44:10.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.062+0000 7f9e66a00640 1 -- 172.21.15.42:0/4099229841 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v125) ==== 122+0+0 (secure 0 0 0) 0x7f9e60063800 con 0x7f9e54004800 2024-09-17T01:44:10.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.065+0000 7f9e6fe00640 1 -- 172.21.15.42:0/4099229841 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e4c078bc0 msgr2=0x7f9e4c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:10.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.065+0000 7f9e6fe00640 1 --2- 172.21.15.42:0/4099229841 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e4c078bc0 0x7f9e4c07b0d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9e58032000 tx=0x7f9e5802c000 comp rx=0 tx=0).stop 2024-09-17T01:44:10.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.065+0000 7f9e6fe00640 1 -- 172.21.15.42:0/4099229841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e54004800 msgr2=0x7f9e70073630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:10.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.065+0000 7f9e6fe00640 1 --2- 172.21.15.42:0/4099229841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e54004800 0x7f9e70073630 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f9e60006480 tx=0x7f9e600039c0 comp rx=0 tx=0).stop 2024-09-17T01:44:10.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.066+0000 7f9e6fe00640 1 -- 172.21.15.42:0/4099229841 shutdown_connections 2024-09-17T01:44:10.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.066+0000 7f9e6fe00640 1 --2- 172.21.15.42:0/4099229841 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e4c078bc0 0x7f9e4c07b0d0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:10.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.066+0000 7f9e6fe00640 1 --2- 172.21.15.42:0/4099229841 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e701e5880 0x7f9e700caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:10.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.066+0000 7f9e6fe00640 1 --2- 172.21.15.42:0/4099229841 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e701e5c90 0x7f9e7014f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:10.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.066+0000 7f9e6fe00640 1 --2- 172.21.15.42:0/4099229841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e54004800 0x7f9e70073630 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:10.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.066+0000 7f9e6fe00640 1 -- 172.21.15.42:0/4099229841 >> 172.21.15.42:0/4099229841 conn(0x7f9e700b25f0 msgr2=0x7f9e700ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:10.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.066+0000 7f9e6fe00640 1 -- 172.21.15.42:0/4099229841 shutdown_connections 2024-09-17T01:44:10.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.066+0000 7f9e6fe00640 1 -- 172.21.15.42:0/4099229841 wait complete. 2024-09-17T01:44:10.093 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T01:44:10.093 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:44:10.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.325+0000 7fad82600640 1 -- 172.21.15.42:0/387648114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad64004020 msgr2=0x7fad64004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:10.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.325+0000 7fad82600640 1 --2- 172.21.15.42:0/387648114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad64004020 0x7fad64004800 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fad68009cd0 tx=0x7fad64005830 comp rx=0 tx=0).stop 2024-09-17T01:44:10.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.325+0000 7fad81c00640 1 -- 172.21.15.42:0/387648114 reap_dead start 2024-09-17T01:44:10.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.325+0000 7fad82600640 1 -- 172.21.15.42:0/387648114 shutdown_connections 2024-09-17T01:44:10.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.325+0000 7fad82600640 1 -- 172.21.15.42:0/387648114 >> 172.21.15.42:0/387648114 conn(0x7fad7c0b25f0 msgr2=0x7fad7c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:10.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.326+0000 7fad82600640 1 -- 172.21.15.42:0/387648114 shutdown_connections 2024-09-17T01:44:10.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.326+0000 7fad82600640 1 -- 172.21.15.42:0/387648114 wait complete. 2024-09-17T01:44:10.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.328+0000 7fad82600640 1 Processor -- start 2024-09-17T01:44:10.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.328+0000 7fad82600640 1 -- start start 2024-09-17T01:44:10.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.329+0000 7fad82600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad64004020 0x7fad7c074880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:10.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.329+0000 7fad82600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad7c1f70f0 0x7fad7c0b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:10.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.329+0000 7fad82600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad7c1f7500 0x7fad7c0b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:10.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.329+0000 7fad82600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fad7c15fcc0 con 0x7fad64004020 2024-09-17T01:44:10.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.329+0000 7fad82600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fad7c06fc50 con 0x7fad7c1f70f0 2024-09-17T01:44:10.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.329+0000 7fad82600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fad7c15fe40 con 0x7fad7c1f7500 2024-09-17T01:44:10.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.330+0000 7fad81200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad64004020 0x7fad7c074880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:10.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.330+0000 7fad81200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad64004020 0x7fad7c074880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36380/0 (socket says 172.21.15.42:36380) 2024-09-17T01:44:10.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.330+0000 7fad81200640 1 -- 172.21.15.42:0/642613792 learned_addr learned my addr 172.21.15.42:0/642613792 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:10.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.330+0000 7fad81c00640 1 --2- 172.21.15.42:0/642613792 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad7c1f7500 0x7fad7c0b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:10.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.330+0000 7fad7be00640 1 --2- 172.21.15.42:0/642613792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad7c1f70f0 0x7fad7c0b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:10.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.330+0000 7fad81200640 1 -- 172.21.15.42:0/642613792 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad7c1f7500 msgr2=0x7fad7c0b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:10.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.330+0000 7fad81200640 1 --2- 172.21.15.42:0/642613792 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad7c1f7500 0x7fad7c0b3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:10.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.330+0000 7fad81200640 1 -- 172.21.15.42:0/642613792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad7c1f70f0 msgr2=0x7fad7c0b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:10.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.330+0000 7fad81200640 1 --2- 172.21.15.42:0/642613792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad7c1f70f0 0x7fad7c0b3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:10.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.330+0000 7fad81200640 1 -- 172.21.15.42:0/642613792 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7c1f3440 con 0x7fad64004020 2024-09-17T01:44:10.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.330+0000 7fad7be00640 1 --2- 172.21.15.42:0/642613792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad7c1f70f0 0x7fad7c0b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:44:10.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.330+0000 7fad81200640 1 --2- 172.21.15.42:0/642613792 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad64004020 0x7fad7c074880 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fad70011b10 tx=0x7fad70009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:10.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.331+0000 7fad78c00640 1 -- 172.21.15.42:0/642613792 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7001e070 con 0x7fad64004020 2024-09-17T01:44:10.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.331+0000 7fad78c00640 1 -- 172.21.15.42:0/642613792 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad70004460 con 0x7fad64004020 2024-09-17T01:44:10.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.331+0000 7fad82600640 1 -- 172.21.15.42:0/642613792 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad7c1f36e0 con 0x7fad64004020 2024-09-17T01:44:10.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.331+0000 7fad78c00640 1 -- 172.21.15.42:0/642613792 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7000fc30 con 0x7fad64004020 2024-09-17T01:44:10.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.331+0000 7fad82600640 1 -- 172.21.15.42:0/642613792 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad7c1f3ca0 con 0x7fad64004020 2024-09-17T01:44:10.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.332+0000 7fad82600640 1 -- 172.21.15.42:0/642613792 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad7c15f120 con 0x7fad64004020 2024-09-17T01:44:10.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.333+0000 7fad78c00640 1 -- 172.21.15.42:0/642613792 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fad70021070 con 0x7fad64004020 2024-09-17T01:44:10.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.334+0000 7fad78c00640 1 --2- 172.21.15.42:0/642613792 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fad5c078bc0 0x7fad5c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:10.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.334+0000 7fad78c00640 1 -- 172.21.15.42:0/642613792 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7fad7009b6e0 con 0x7fad64004020 2024-09-17T01:44:10.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.335+0000 7fad7be00640 1 --2- 172.21.15.42:0/642613792 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fad5c078bc0 0x7fad5c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:10.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.335+0000 7fad7be00640 1 --2- 172.21.15.42:0/642613792 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fad5c078bc0 0x7fad5c07b0d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fad68035000 tx=0x7fad680046c0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:10.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.338+0000 7fad78c00640 1 -- 172.21.15.42:0/642613792 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fad700634f0 con 0x7fad64004020 2024-09-17T01:44:10.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.571+0000 7fad82600640 1 -- 172.21.15.42:0/642613792 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad7c15b0a0 con 0x7fad64004020 2024-09-17T01:44:10.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.572+0000 7fad78c00640 1 -- 172.21.15.42:0/642613792 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5230 (secure 0 0 0) 0x7fad70067f20 con 0x7fad64004020 2024-09-17T01:44:10.570 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:44:10.570 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":125,"btime":"2024-09-17T01:44:10:057034+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8872,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3393274334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3393274334},{"type":"v1","addr":"172.21.15.43:6836","nonce":3393274334}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":8875,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2869136532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2869136532},{"type":"v1","addr":"172.21.15.43:6837","nonce":2869136532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":9513,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/297557585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":297557585},{"type":"v1","addr":"172.21.15.42:6834","nonce":297557585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":119}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:44:06.556661+0000","modified":"2024-09-17T01:44:09.563813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9516},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9516":{"gid":9516,"name":"c","rank":0,"incarnation":121,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1557345672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1557345672},{"type":"v1","addr":"172.21.15.42:6835","nonce":1557345672}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9516,"qdb_cluster":[9516]},"id":11}]} 2024-09-17T01:44:10.570 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 125 2024-09-17T01:44:10.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.574+0000 7fad82600640 1 -- 172.21.15.42:0/642613792 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fad5c078bc0 msgr2=0x7fad5c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:10.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.574+0000 7fad82600640 1 --2- 172.21.15.42:0/642613792 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fad5c078bc0 0x7fad5c07b0d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fad68035000 tx=0x7fad680046c0 comp rx=0 tx=0).stop 2024-09-17T01:44:10.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.574+0000 7fad82600640 1 -- 172.21.15.42:0/642613792 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad64004020 msgr2=0x7fad7c074880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:10.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.574+0000 7fad82600640 1 --2- 172.21.15.42:0/642613792 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad64004020 0x7fad7c074880 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fad70011b10 tx=0x7fad70009e90 comp rx=0 tx=0).stop 2024-09-17T01:44:10.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.574+0000 7fad82600640 1 -- 172.21.15.42:0/642613792 shutdown_connections 2024-09-17T01:44:10.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.574+0000 7fad82600640 1 --2- 172.21.15.42:0/642613792 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fad5c078bc0 0x7fad5c07b0d0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:10.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.574+0000 7fad82600640 1 --2- 172.21.15.42:0/642613792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fad7c1f70f0 0x7fad7c0b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:10.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.574+0000 7fad82600640 1 --2- 172.21.15.42:0/642613792 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fad7c1f7500 0x7fad7c0b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:10.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.574+0000 7fad82600640 1 --2- 172.21.15.42:0/642613792 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad64004020 0x7fad7c074880 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:10.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.574+0000 7fad82600640 1 -- 172.21.15.42:0/642613792 >> 172.21.15.42:0/642613792 conn(0x7fad7c0b25f0 msgr2=0x7fad7c0b0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:10.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.574+0000 7fad82600640 1 -- 172.21.15.42:0/642613792 shutdown_connections 2024-09-17T01:44:10.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.574+0000 7fad82600640 1 -- 172.21.15.42:0/642613792 wait complete. 2024-09-17T01:44:10.594 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:44:10.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.822+0000 7fce8f800640 1 -- 172.21.15.42:0/3940895223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce880b3550 msgr2=0x7fce8815cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:10.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.822+0000 7fce8f800640 1 --2- 172.21.15.42:0/3940895223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce880b3550 0x7fce8815cec0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fce78009830 tx=0x7fce7802a520 comp rx=0 tx=0).stop 2024-09-17T01:44:10.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.822+0000 7fce8f800640 1 -- 172.21.15.42:0/3940895223 shutdown_connections 2024-09-17T01:44:10.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.822+0000 7fce8f800640 1 --2- 172.21.15.42:0/3940895223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce880b3550 0x7fce8815cec0 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:10.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.822+0000 7fce8f800640 1 -- 172.21.15.42:0/3940895223 >> 172.21.15.42:0/3940895223 conn(0x7fce880b2930 msgr2=0x7fce8806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:10.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.823+0000 7fce8f800640 1 -- 172.21.15.42:0/3940895223 shutdown_connections 2024-09-17T01:44:10.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.823+0000 7fce8f800640 1 -- 172.21.15.42:0/3940895223 wait complete. 2024-09-17T01:44:10.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.825+0000 7fce8f800640 1 Processor -- start 2024-09-17T01:44:10.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.825+0000 7fce8f800640 1 -- start start 2024-09-17T01:44:10.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.826+0000 7fce8f800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce880b3550 0x7fce88137df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:10.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.826+0000 7fce8f800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce880cec40 0x7fce88155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:10.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.826+0000 7fce8f800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce88142f40 0x7fce8806ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:10.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.826+0000 7fce8f800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fce880cf050 con 0x7fce88142f40 2024-09-17T01:44:10.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.826+0000 7fce8f800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fce8806dd50 con 0x7fce880cec40 2024-09-17T01:44:10.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.826+0000 7fce8f800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fce880cf1d0 con 0x7fce880b3550 2024-09-17T01:44:10.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.827+0000 7fce8d800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce88142f40 0x7fce8806ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:10.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.827+0000 7fce8d800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce88142f40 0x7fce8806ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36400/0 (socket says 172.21.15.42:36400) 2024-09-17T01:44:10.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.827+0000 7fce8d800640 1 -- 172.21.15.42:0/3579725843 learned_addr learned my addr 172.21.15.42:0/3579725843 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:10.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.827+0000 7fce7fe00640 1 --2- 172.21.15.42:0/3579725843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce880cec40 0x7fce88155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:10.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.827+0000 7fce8ce00640 1 --2- 172.21.15.42:0/3579725843 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce880b3550 0x7fce88137df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:10.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.827+0000 7fce8d800640 1 -- 172.21.15.42:0/3579725843 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce880b3550 msgr2=0x7fce88137df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:10.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.827+0000 7fce8d800640 1 --2- 172.21.15.42:0/3579725843 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce880b3550 0x7fce88137df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:10.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.827+0000 7fce8d800640 1 -- 172.21.15.42:0/3579725843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce880cec40 msgr2=0x7fce88155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:10.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.827+0000 7fce8d800640 1 --2- 172.21.15.42:0/3579725843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce880cec40 0x7fce88155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:10.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.827+0000 7fce8d800640 1 -- 172.21.15.42:0/3579725843 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce881545e0 con 0x7fce88142f40 2024-09-17T01:44:10.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.827+0000 7fce7fe00640 1 --2- 172.21.15.42:0/3579725843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce880cec40 0x7fce88155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:44:10.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.827+0000 7fce8ce00640 1 --2- 172.21.15.42:0/3579725843 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce880b3550 0x7fce88137df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:44:10.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.827+0000 7fce8d800640 1 --2- 172.21.15.42:0/3579725843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce88142f40 0x7fce8806ebd0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fce8000cb10 tx=0x7fce8000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:10.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.828+0000 7fce85600640 1 -- 172.21.15.42:0/3579725843 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce80016020 con 0x7fce88142f40 2024-09-17T01:44:10.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.828+0000 7fce85600640 1 -- 172.21.15.42:0/3579725843 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce8000ad60 con 0x7fce88142f40 2024-09-17T01:44:10.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.828+0000 7fce8f800640 1 -- 172.21.15.42:0/3579725843 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce88159000 con 0x7fce88142f40 2024-09-17T01:44:10.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.828+0000 7fce85600640 1 -- 172.21.15.42:0/3579725843 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce80012680 con 0x7fce88142f40 2024-09-17T01:44:10.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.828+0000 7fce8f800640 1 -- 172.21.15.42:0/3579725843 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce881595c0 con 0x7fce88142f40 2024-09-17T01:44:10.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.829+0000 7fce8f800640 1 -- 172.21.15.42:0/3579725843 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce881547b0 con 0x7fce88142f40 2024-09-17T01:44:10.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.830+0000 7fce85600640 1 -- 172.21.15.42:0/3579725843 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fce80019020 con 0x7fce88142f40 2024-09-17T01:44:10.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.831+0000 7fce85600640 1 --2- 172.21.15.42:0/3579725843 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fce64078bc0 0x7fce6407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:10.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.831+0000 7fce85600640 1 -- 172.21.15.42:0/3579725843 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7fce8009b460 con 0x7fce88142f40 2024-09-17T01:44:10.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.831+0000 7fce8ce00640 1 --2- 172.21.15.42:0/3579725843 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fce64078bc0 0x7fce6407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:10.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.832+0000 7fce8ce00640 1 --2- 172.21.15.42:0/3579725843 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fce64078bc0 0x7fce6407b0d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fce78034000 tx=0x7fce78004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:10.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:10.835+0000 7fce85600640 1 -- 172.21.15.42:0/3579725843 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fce80020020 con 0x7fce88142f40 2024-09-17T01:44:11.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.029+0000 7fce8f800640 1 -- 172.21.15.42:0/3579725843 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce8806d6e0 con 0x7fce88142f40 2024-09-17T01:44:11.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.030+0000 7fce85600640 1 -- 172.21.15.42:0/3579725843 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) ==== 74+0+16691 (secure 0 0 0) 0x7fce8806d6e0 con 0x7fce88142f40 2024-09-17T01:44:11.029 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:44:11.029 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":160,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:44:08.043186+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:44:04.499543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T01:44:05.519952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:44:11.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.033+0000 7fce8f800640 1 -- 172.21.15.42:0/3579725843 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fce64078bc0 msgr2=0x7fce6407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:11.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.033+0000 7fce8f800640 1 --2- 172.21.15.42:0/3579725843 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fce64078bc0 0x7fce6407b0d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fce78034000 tx=0x7fce78004730 comp rx=0 tx=0).stop 2024-09-17T01:44:11.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.033+0000 7fce8f800640 1 -- 172.21.15.42:0/3579725843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce88142f40 msgr2=0x7fce8806ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:11.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.033+0000 7fce8f800640 1 --2- 172.21.15.42:0/3579725843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce88142f40 0x7fce8806ebd0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fce8000cb10 tx=0x7fce8000a060 comp rx=0 tx=0).stop 2024-09-17T01:44:11.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.033+0000 7fce8f800640 1 -- 172.21.15.42:0/3579725843 shutdown_connections 2024-09-17T01:44:11.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.033+0000 7fce8f800640 1 --2- 172.21.15.42:0/3579725843 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fce64078bc0 0x7fce6407b0d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:11.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.033+0000 7fce8f800640 1 --2- 172.21.15.42:0/3579725843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce880cec40 0x7fce88155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:11.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.033+0000 7fce8f800640 1 --2- 172.21.15.42:0/3579725843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce88142f40 0x7fce8806ebd0 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:11.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.033+0000 7fce8f800640 1 --2- 172.21.15.42:0/3579725843 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce880b3550 0x7fce88137df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:11.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.033+0000 7fce8f800640 1 -- 172.21.15.42:0/3579725843 >> 172.21.15.42:0/3579725843 conn(0x7fce880b2930 msgr2=0x7fce88073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:11.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.033+0000 7fce8f800640 1 -- 172.21.15.42:0/3579725843 shutdown_connections 2024-09-17T01:44:11.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.033+0000 7fce8f800640 1 -- 172.21.15.42:0/3579725843 wait complete. 2024-09-17T01:44:11.053 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T01:44:11.053 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:44:11.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.283+0000 7faa14400640 1 -- 172.21.15.42:0/1504182267 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faa0c142f40 msgr2=0x7faa0c072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:11.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.283+0000 7faa14400640 1 --2- 172.21.15.42:0/1504182267 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faa0c142f40 0x7faa0c072950 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8009860 tx=0x7fa9f802a510 comp rx=0 tx=0).stop 2024-09-17T01:44:11.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.283+0000 7faa14400640 1 -- 172.21.15.42:0/1504182267 shutdown_connections 2024-09-17T01:44:11.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.283+0000 7faa14400640 1 --2- 172.21.15.42:0/1504182267 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faa0c142f40 0x7faa0c072950 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:11.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.283+0000 7faa14400640 1 -- 172.21.15.42:0/1504182267 >> 172.21.15.42:0/1504182267 conn(0x7faa0c0b2930 msgr2=0x7faa0c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:11.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.283+0000 7faa14400640 1 -- 172.21.15.42:0/1504182267 shutdown_connections 2024-09-17T01:44:11.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.283+0000 7faa14400640 1 -- 172.21.15.42:0/1504182267 wait complete. 2024-09-17T01:44:11.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.285+0000 7faa14400640 1 Processor -- start 2024-09-17T01:44:11.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.285+0000 7faa14400640 1 -- start start 2024-09-17T01:44:11.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.287+0000 7faa14400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa0c072e90 0x7faa0c131e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:11.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.287+0000 7faa14400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa0c0b3550 0x7faa0c1f9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:11.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.287+0000 7faa14400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faa0c142f40 0x7faa0c0ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:11.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.287+0000 7faa14400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c06d8d0 con 0x7faa0c072e90 2024-09-17T01:44:11.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.287+0000 7faa14400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c06d750 con 0x7faa0c0b3550 2024-09-17T01:44:11.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.287+0000 7faa14400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7faa0c06da50 con 0x7faa0c142f40 2024-09-17T01:44:11.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.287+0000 7faa11a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa0c072e90 0x7faa0c131e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:11.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.287+0000 7faa11a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa0c072e90 0x7faa0c131e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36402/0 (socket says 172.21.15.42:36402) 2024-09-17T01:44:11.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.287+0000 7faa11a00640 1 -- 172.21.15.42:0/2949700795 learned_addr learned my addr 172.21.15.42:0/2949700795 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:11.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.287+0000 7faa12400640 1 --2- 172.21.15.42:0/2949700795 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faa0c142f40 0x7faa0c0ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:11.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.287+0000 7faa11000640 1 --2- 172.21.15.42:0/2949700795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa0c0b3550 0x7faa0c1f9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:11.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.287+0000 7faa11a00640 1 -- 172.21.15.42:0/2949700795 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faa0c142f40 msgr2=0x7faa0c0ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:11.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.287+0000 7faa11a00640 1 --2- 172.21.15.42:0/2949700795 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faa0c142f40 0x7faa0c0ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:11.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.287+0000 7faa11a00640 1 -- 172.21.15.42:0/2949700795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa0c0b3550 msgr2=0x7faa0c1f9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:11.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.287+0000 7faa11a00640 1 --2- 172.21.15.42:0/2949700795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa0c0b3550 0x7faa0c1f9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:11.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.287+0000 7faa11a00640 1 -- 172.21.15.42:0/2949700795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0c134670 con 0x7faa0c072e90 2024-09-17T01:44:11.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.287+0000 7faa11000640 1 --2- 172.21.15.42:0/2949700795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa0c0b3550 0x7faa0c1f9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:44:11.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.288+0000 7faa11a00640 1 --2- 172.21.15.42:0/2949700795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa0c072e90 0x7faa0c131e00 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7faa0000c430 tx=0x7faa0000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:11.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.288+0000 7faa09600640 1 -- 172.21.15.42:0/2949700795 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa00017070 con 0x7faa0c072e90 2024-09-17T01:44:11.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.288+0000 7faa09600640 1 -- 172.21.15.42:0/2949700795 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa000053e0 con 0x7faa0c072e90 2024-09-17T01:44:11.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.288+0000 7faa09600640 1 -- 172.21.15.42:0/2949700795 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa00003850 con 0x7faa0c072e90 2024-09-17T01:44:11.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.288+0000 7faa14400640 1 -- 172.21.15.42:0/2949700795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa0c134950 con 0x7faa0c072e90 2024-09-17T01:44:11.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.288+0000 7faa14400640 1 -- 172.21.15.42:0/2949700795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa0c1324b0 con 0x7faa0c072e90 2024-09-17T01:44:11.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.289+0000 7faa14400640 1 -- 172.21.15.42:0/2949700795 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa0c1f9240 con 0x7faa0c072e90 2024-09-17T01:44:11.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.290+0000 7faa09600640 1 -- 172.21.15.42:0/2949700795 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faa0001a070 con 0x7faa0c072e90 2024-09-17T01:44:11.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.292+0000 7faa09600640 1 --2- 172.21.15.42:0/2949700795 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa9ec078b90 0x7fa9ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:11.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.292+0000 7faa09600640 1 -- 172.21.15.42:0/2949700795 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7faa0009a1b0 con 0x7faa0c072e90 2024-09-17T01:44:11.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.293+0000 7faa11000640 1 --2- 172.21.15.42:0/2949700795 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa9ec078b90 0x7fa9ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:11.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.294+0000 7faa11000640 1 --2- 172.21.15.42:0/2949700795 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa9ec078b90 0x7fa9ec07b0a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8034000 tx=0x7fa9f8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:11.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.297+0000 7faa09600640 1 -- 172.21.15.42:0/2949700795 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faa00061e80 con 0x7faa0c072e90 2024-09-17T01:44:11.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.490+0000 7faa14400640 1 -- 172.21.15.42:0/2949700795 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faa0c132750 con 0x7fa9ec078b90 2024-09-17T01:44:11.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.495+0000 7faa09600640 1 -- 172.21.15.42:0/2949700795 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252474 (secure 0 0 0) 0x7faa0c132750 con 0x7fa9ec078b90 2024-09-17T01:44:11.496 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:44:11.497 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:44:11.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.499+0000 7faa14400640 1 -- 172.21.15.42:0/2949700795 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa9ec078b90 msgr2=0x7fa9ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:11.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.499+0000 7faa14400640 1 --2- 172.21.15.42:0/2949700795 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa9ec078b90 0x7fa9ec07b0a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8034000 tx=0x7fa9f8004730 comp rx=0 tx=0).stop 2024-09-17T01:44:11.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.499+0000 7faa14400640 1 -- 172.21.15.42:0/2949700795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa0c072e90 msgr2=0x7faa0c131e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:11.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.499+0000 7faa14400640 1 --2- 172.21.15.42:0/2949700795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa0c072e90 0x7faa0c131e00 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7faa0000c430 tx=0x7faa0000c8f0 comp rx=0 tx=0).stop 2024-09-17T01:44:11.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.499+0000 7faa14400640 1 -- 172.21.15.42:0/2949700795 shutdown_connections 2024-09-17T01:44:11.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.499+0000 7faa14400640 1 --2- 172.21.15.42:0/2949700795 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa9ec078b90 0x7fa9ec07b0a0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:11.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.499+0000 7faa14400640 1 --2- 172.21.15.42:0/2949700795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa0c0b3550 0x7faa0c1f9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:11.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.499+0000 7faa14400640 1 --2- 172.21.15.42:0/2949700795 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faa0c142f40 0x7faa0c0ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:11.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.499+0000 7faa14400640 1 --2- 172.21.15.42:0/2949700795 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa0c072e90 0x7faa0c131e00 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:11.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.499+0000 7faa14400640 1 -- 172.21.15.42:0/2949700795 >> 172.21.15.42:0/2949700795 conn(0x7faa0c0b2930 msgr2=0x7faa0c073500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:11.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.499+0000 7faa14400640 1 -- 172.21.15.42:0/2949700795 shutdown_connections 2024-09-17T01:44:11.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.499+0000 7faa14400640 1 -- 172.21.15.42:0/2949700795 wait complete. 2024-09-17T01:44:11.520 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":522,"stamp":"2024-09-17T01:44:11.189856+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":456524,"kb_used_data":16840,"kb_used_omap":12,"kb_used_meta":439475,"kb_avail":754518196,"statfs":{"total":773094113280,"available":772626632704,"internally_reserved":0,"allocated":17244160,"data_stored":8226644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":450022964},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001598"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956942+0000","last_change":"2024-09-17T01:44:07.056949+0000","last_active":"2024-09-17T01:44:08.956942+0000","last_peered":"2024-09-17T01:44:08.956942+0000","last_clean":"2024-09-17T01:44:08.956942+0000","last_became_active":"2024-09-17T01:44:07.056000+0000","last_became_peered":"2024-09-17T01:44:07.056000+0000","last_unstale":"2024-09-17T01:44:08.956942+0000","last_undegraded":"2024-09-17T01:44:08.956942+0000","last_fullsized":"2024-09-17T01:44:08.956942+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:04:35.810368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956869+0000","last_change":"2024-09-17T01:44:07.055661+0000","last_active":"2024-09-17T01:44:08.956869+0000","last_peered":"2024-09-17T01:44:08.956869+0000","last_clean":"2024-09-17T01:44:08.956869+0000","last_became_active":"2024-09-17T01:44:07.053339+0000","last_became_peered":"2024-09-17T01:44:07.053339+0000","last_unstale":"2024-09-17T01:44:08.956869+0000","last_undegraded":"2024-09-17T01:44:08.956869+0000","last_fullsized":"2024-09-17T01:44:08.956869+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:14.421726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956684+0000","last_change":"2024-09-17T01:44:07.069568+0000","last_active":"2024-09-17T01:44:08.956684+0000","last_peered":"2024-09-17T01:44:08.956684+0000","last_clean":"2024-09-17T01:44:08.956684+0000","last_became_active":"2024-09-17T01:44:07.068559+0000","last_became_peered":"2024-09-17T01:44:07.068559+0000","last_unstale":"2024-09-17T01:44:08.956684+0000","last_undegraded":"2024-09-17T01:44:08.956684+0000","last_fullsized":"2024-09-17T01:44:08.956684+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:53.057724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052805+0000","last_change":"2024-09-17T01:44:07.065964+0000","last_active":"2024-09-17T01:44:08.052805+0000","last_peered":"2024-09-17T01:44:08.052805+0000","last_clean":"2024-09-17T01:44:08.052805+0000","last_became_active":"2024-09-17T01:44:07.065253+0000","last_became_peered":"2024-09-17T01:44:07.065253+0000","last_unstale":"2024-09-17T01:44:08.052805+0000","last_undegraded":"2024-09-17T01:44:08.052805+0000","last_fullsized":"2024-09-17T01:44:08.052805+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:33.266656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.051916+0000","last_change":"2024-09-17T01:44:07.060920+0000","last_active":"2024-09-17T01:44:08.051916+0000","last_peered":"2024-09-17T01:44:08.051916+0000","last_clean":"2024-09-17T01:44:08.051916+0000","last_became_active":"2024-09-17T01:44:07.059553+0000","last_became_peered":"2024-09-17T01:44:07.059553+0000","last_unstale":"2024-09-17T01:44:08.051916+0000","last_undegraded":"2024-09-17T01:44:08.051916+0000","last_fullsized":"2024-09-17T01:44:08.051916+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:09.397644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.805802+0000","last_change":"2024-09-17T01:44:07.059762+0000","last_active":"2024-09-17T01:44:08.805802+0000","last_peered":"2024-09-17T01:44:08.805802+0000","last_clean":"2024-09-17T01:44:08.805802+0000","last_became_active":"2024-09-17T01:44:07.058862+0000","last_became_peered":"2024-09-17T01:44:07.058862+0000","last_unstale":"2024-09-17T01:44:08.805802+0000","last_undegraded":"2024-09-17T01:44:08.805802+0000","last_fullsized":"2024-09-17T01:44:08.805802+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:33.076212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.957111+0000","last_change":"2024-09-17T01:44:07.059944+0000","last_active":"2024-09-17T01:44:08.957111+0000","last_peered":"2024-09-17T01:44:08.957111+0000","last_clean":"2024-09-17T01:44:08.957111+0000","last_became_active":"2024-09-17T01:44:07.053740+0000","last_became_peered":"2024-09-17T01:44:07.053740+0000","last_unstale":"2024-09-17T01:44:08.957111+0000","last_undegraded":"2024-09-17T01:44:08.957111+0000","last_fullsized":"2024-09-17T01:44:08.957111+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:26.728809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052775+0000","last_change":"2024-09-17T01:44:07.055022+0000","last_active":"2024-09-17T01:44:08.052775+0000","last_peered":"2024-09-17T01:44:08.052775+0000","last_clean":"2024-09-17T01:44:08.052775+0000","last_became_active":"2024-09-17T01:44:07.054012+0000","last_became_peered":"2024-09-17T01:44:07.054012+0000","last_unstale":"2024-09-17T01:44:08.052775+0000","last_undegraded":"2024-09-17T01:44:08.052775+0000","last_fullsized":"2024-09-17T01:44:08.052775+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:44.216836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.054014+0000","last_change":"2024-09-17T01:44:07.078380+0000","last_active":"2024-09-17T01:44:08.054014+0000","last_peered":"2024-09-17T01:44:08.054014+0000","last_clean":"2024-09-17T01:44:08.054014+0000","last_became_active":"2024-09-17T01:44:07.076672+0000","last_became_peered":"2024-09-17T01:44:07.076672+0000","last_unstale":"2024-09-17T01:44:08.054014+0000","last_undegraded":"2024-09-17T01:44:08.054014+0000","last_fullsized":"2024-09-17T01:44:08.054014+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:27.791518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.053636+0000","last_change":"2024-09-17T01:44:07.065120+0000","last_active":"2024-09-17T01:44:08.053636+0000","last_peered":"2024-09-17T01:44:08.053636+0000","last_clean":"2024-09-17T01:44:08.053636+0000","last_became_active":"2024-09-17T01:44:07.064791+0000","last_became_peered":"2024-09-17T01:44:07.064791+0000","last_unstale":"2024-09-17T01:44:08.053636+0000","last_undegraded":"2024-09-17T01:44:08.053636+0000","last_fullsized":"2024-09-17T01:44:08.053636+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:08.041303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.051932+0000","last_change":"2024-09-17T01:44:07.060491+0000","last_active":"2024-09-17T01:44:08.051932+0000","last_peered":"2024-09-17T01:44:08.051932+0000","last_clean":"2024-09-17T01:44:08.051932+0000","last_became_active":"2024-09-17T01:44:07.059626+0000","last_became_peered":"2024-09-17T01:44:07.059626+0000","last_unstale":"2024-09-17T01:44:08.051932+0000","last_undegraded":"2024-09-17T01:44:08.051932+0000","last_fullsized":"2024-09-17T01:44:08.051932+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:59.090145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.751093+0000","last_change":"2024-09-17T01:44:07.059323+0000","last_active":"2024-09-17T01:44:08.751093+0000","last_peered":"2024-09-17T01:44:08.751093+0000","last_clean":"2024-09-17T01:44:08.751093+0000","last_became_active":"2024-09-17T01:44:07.057787+0000","last_became_peered":"2024-09-17T01:44:07.057787+0000","last_unstale":"2024-09-17T01:44:08.751093+0000","last_undegraded":"2024-09-17T01:44:08.751093+0000","last_fullsized":"2024-09-17T01:44:08.751093+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:42.797495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.751019+0000","last_change":"2024-09-17T01:44:07.059462+0000","last_active":"2024-09-17T01:44:08.751019+0000","last_peered":"2024-09-17T01:44:08.751019+0000","last_clean":"2024-09-17T01:44:08.751019+0000","last_became_active":"2024-09-17T01:44:07.059109+0000","last_became_peered":"2024-09-17T01:44:07.059109+0000","last_unstale":"2024-09-17T01:44:08.751019+0000","last_undegraded":"2024-09-17T01:44:08.751019+0000","last_fullsized":"2024-09-17T01:44:08.751019+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:22.914102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052715+0000","last_change":"2024-09-17T01:44:07.068602+0000","last_active":"2024-09-17T01:44:08.052715+0000","last_peered":"2024-09-17T01:44:08.052715+0000","last_clean":"2024-09-17T01:44:08.052715+0000","last_became_active":"2024-09-17T01:44:07.068270+0000","last_became_peered":"2024-09-17T01:44:07.068270+0000","last_unstale":"2024-09-17T01:44:08.052715+0000","last_undegraded":"2024-09-17T01:44:08.052715+0000","last_fullsized":"2024-09-17T01:44:08.052715+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:13.435546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052649+0000","last_change":"2024-09-17T01:44:07.063045+0000","last_active":"2024-09-17T01:44:08.052649+0000","last_peered":"2024-09-17T01:44:08.052649+0000","last_clean":"2024-09-17T01:44:08.052649+0000","last_became_active":"2024-09-17T01:44:07.062424+0000","last_became_peered":"2024-09-17T01:44:07.062424+0000","last_unstale":"2024-09-17T01:44:08.052649+0000","last_undegraded":"2024-09-17T01:44:08.052649+0000","last_fullsized":"2024-09-17T01:44:08.052649+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:42.406315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956827+0000","last_change":"2024-09-17T01:44:07.056300+0000","last_active":"2024-09-17T01:44:08.956827+0000","last_peered":"2024-09-17T01:44:08.956827+0000","last_clean":"2024-09-17T01:44:08.956827+0000","last_became_active":"2024-09-17T01:44:07.054575+0000","last_became_peered":"2024-09-17T01:44:07.054575+0000","last_unstale":"2024-09-17T01:44:08.956827+0000","last_undegraded":"2024-09-17T01:44:08.956827+0000","last_fullsized":"2024-09-17T01:44:08.956827+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:55:03.619819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.806269+0000","last_change":"2024-09-17T01:44:07.064387+0000","last_active":"2024-09-17T01:44:08.806269+0000","last_peered":"2024-09-17T01:44:08.806269+0000","last_clean":"2024-09-17T01:44:08.806269+0000","last_became_active":"2024-09-17T01:44:07.064011+0000","last_became_peered":"2024-09-17T01:44:07.064011+0000","last_unstale":"2024-09-17T01:44:08.806269+0000","last_undegraded":"2024-09-17T01:44:08.806269+0000","last_fullsized":"2024-09-17T01:44:08.806269+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:44.586467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052889+0000","last_change":"2024-09-17T01:44:07.062809+0000","last_active":"2024-09-17T01:44:08.052889+0000","last_peered":"2024-09-17T01:44:08.052889+0000","last_clean":"2024-09-17T01:44:08.052889+0000","last_became_active":"2024-09-17T01:44:07.062486+0000","last_became_peered":"2024-09-17T01:44:07.062486+0000","last_unstale":"2024-09-17T01:44:08.052889+0000","last_undegraded":"2024-09-17T01:44:08.052889+0000","last_fullsized":"2024-09-17T01:44:08.052889+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:44:00.023467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.957475+0000","last_change":"2024-09-17T01:44:07.074402+0000","last_active":"2024-09-17T01:44:08.957475+0000","last_peered":"2024-09-17T01:44:08.957475+0000","last_clean":"2024-09-17T01:44:08.957475+0000","last_became_active":"2024-09-17T01:44:07.074042+0000","last_became_peered":"2024-09-17T01:44:07.074042+0000","last_unstale":"2024-09-17T01:44:08.957475+0000","last_undegraded":"2024-09-17T01:44:08.957475+0000","last_fullsized":"2024-09-17T01:44:08.957475+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:38.027875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.751190+0000","last_change":"2024-09-17T01:44:07.068958+0000","last_active":"2024-09-17T01:44:08.751190+0000","last_peered":"2024-09-17T01:44:08.751190+0000","last_clean":"2024-09-17T01:44:08.751190+0000","last_became_active":"2024-09-17T01:44:07.068629+0000","last_became_peered":"2024-09-17T01:44:07.068629+0000","last_unstale":"2024-09-17T01:44:08.751190+0000","last_undegraded":"2024-09-17T01:44:08.751190+0000","last_fullsized":"2024-09-17T01:44:08.751190+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:52.042531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.805850+0000","last_change":"2024-09-17T01:44:07.071434+0000","last_active":"2024-09-17T01:44:08.805850+0000","last_peered":"2024-09-17T01:44:08.805850+0000","last_clean":"2024-09-17T01:44:08.805850+0000","last_became_active":"2024-09-17T01:44:07.071098+0000","last_became_peered":"2024-09-17T01:44:07.071098+0000","last_unstale":"2024-09-17T01:44:08.805850+0000","last_undegraded":"2024-09-17T01:44:08.805850+0000","last_fullsized":"2024-09-17T01:44:08.805850+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:45:55.446731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.051514+0000","last_change":"2024-09-17T01:44:07.062922+0000","last_active":"2024-09-17T01:44:08.051514+0000","last_peered":"2024-09-17T01:44:08.051514+0000","last_clean":"2024-09-17T01:44:08.051514+0000","last_became_active":"2024-09-17T01:44:07.062527+0000","last_became_peered":"2024-09-17T01:44:07.062527+0000","last_unstale":"2024-09-17T01:44:08.051514+0000","last_undegraded":"2024-09-17T01:44:08.051514+0000","last_fullsized":"2024-09-17T01:44:08.051514+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:09.266678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.063298+0000","last_change":"2024-09-17T01:44:07.073949+0000","last_active":"2024-09-17T01:44:08.063298+0000","last_peered":"2024-09-17T01:44:08.063298+0000","last_clean":"2024-09-17T01:44:08.063298+0000","last_became_active":"2024-09-17T01:44:07.073607+0000","last_became_peered":"2024-09-17T01:44:07.073607+0000","last_unstale":"2024-09-17T01:44:08.063298+0000","last_undegraded":"2024-09-17T01:44:08.063298+0000","last_fullsized":"2024-09-17T01:44:08.063298+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:43.757898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.051190+0000","last_change":"2024-09-17T01:44:07.057969+0000","last_active":"2024-09-17T01:44:08.051190+0000","last_peered":"2024-09-17T01:44:08.051190+0000","last_clean":"2024-09-17T01:44:08.051190+0000","last_became_active":"2024-09-17T01:44:07.056864+0000","last_became_peered":"2024-09-17T01:44:07.056864+0000","last_unstale":"2024-09-17T01:44:08.051190+0000","last_undegraded":"2024-09-17T01:44:08.051190+0000","last_fullsized":"2024-09-17T01:44:08.051190+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:20.599660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.051538+0000","last_change":"2024-09-17T01:44:07.065532+0000","last_active":"2024-09-17T01:44:08.051538+0000","last_peered":"2024-09-17T01:44:08.051538+0000","last_clean":"2024-09-17T01:44:08.051538+0000","last_became_active":"2024-09-17T01:44:07.065213+0000","last_became_peered":"2024-09-17T01:44:07.065213+0000","last_unstale":"2024-09-17T01:44:08.051538+0000","last_undegraded":"2024-09-17T01:44:08.051538+0000","last_fullsized":"2024-09-17T01:44:08.051538+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:55.316296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.063763+0000","last_change":"2024-09-17T01:44:07.064555+0000","last_active":"2024-09-17T01:44:08.063763+0000","last_peered":"2024-09-17T01:44:08.063763+0000","last_clean":"2024-09-17T01:44:08.063763+0000","last_became_active":"2024-09-17T01:44:07.061010+0000","last_became_peered":"2024-09-17T01:44:07.061010+0000","last_unstale":"2024-09-17T01:44:08.063763+0000","last_undegraded":"2024-09-17T01:44:08.063763+0000","last_fullsized":"2024-09-17T01:44:08.063763+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:15.904864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052024+0000","last_change":"2024-09-17T01:44:07.060855+0000","last_active":"2024-09-17T01:44:08.052024+0000","last_peered":"2024-09-17T01:44:08.052024+0000","last_clean":"2024-09-17T01:44:08.052024+0000","last_became_active":"2024-09-17T01:44:07.060134+0000","last_became_peered":"2024-09-17T01:44:07.060134+0000","last_unstale":"2024-09-17T01:44:08.052024+0000","last_undegraded":"2024-09-17T01:44:08.052024+0000","last_fullsized":"2024-09-17T01:44:08.052024+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:32:46.666818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.957492+0000","last_change":"2024-09-17T01:44:07.063911+0000","last_active":"2024-09-17T01:44:08.957492+0000","last_peered":"2024-09-17T01:44:08.957492+0000","last_clean":"2024-09-17T01:44:08.957492+0000","last_became_active":"2024-09-17T01:44:07.063480+0000","last_became_peered":"2024-09-17T01:44:07.063480+0000","last_unstale":"2024-09-17T01:44:08.957492+0000","last_undegraded":"2024-09-17T01:44:08.957492+0000","last_fullsized":"2024-09-17T01:44:08.957492+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:07.410131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956367+0000","last_change":"2024-09-17T01:44:07.073549+0000","last_active":"2024-09-17T01:44:08.956367+0000","last_peered":"2024-09-17T01:44:08.956367+0000","last_clean":"2024-09-17T01:44:08.956367+0000","last_became_active":"2024-09-17T01:44:07.073255+0000","last_became_peered":"2024-09-17T01:44:07.073255+0000","last_unstale":"2024-09-17T01:44:08.956367+0000","last_undegraded":"2024-09-17T01:44:08.956367+0000","last_fullsized":"2024-09-17T01:44:08.956367+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:59.473400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052908+0000","last_change":"2024-09-17T01:44:07.069810+0000","last_active":"2024-09-17T01:44:08.052908+0000","last_peered":"2024-09-17T01:44:08.052908+0000","last_clean":"2024-09-17T01:44:08.052908+0000","last_became_active":"2024-09-17T01:44:07.069485+0000","last_became_peered":"2024-09-17T01:44:07.069485+0000","last_unstale":"2024-09-17T01:44:08.052908+0000","last_undegraded":"2024-09-17T01:44:08.052908+0000","last_fullsized":"2024-09-17T01:44:08.052908+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:24.906782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956377+0000","last_change":"2024-09-17T01:44:07.054155+0000","last_active":"2024-09-17T01:44:08.956377+0000","last_peered":"2024-09-17T01:44:08.956377+0000","last_clean":"2024-09-17T01:44:08.956377+0000","last_became_active":"2024-09-17T01:44:07.052587+0000","last_became_peered":"2024-09-17T01:44:07.052587+0000","last_unstale":"2024-09-17T01:44:08.956377+0000","last_undegraded":"2024-09-17T01:44:08.956377+0000","last_fullsized":"2024-09-17T01:44:08.956377+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:42.694787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.806184+0000","last_change":"2024-09-17T01:44:07.077859+0000","last_active":"2024-09-17T01:44:08.806184+0000","last_peered":"2024-09-17T01:44:08.806184+0000","last_clean":"2024-09-17T01:44:08.806184+0000","last_became_active":"2024-09-17T01:44:07.077504+0000","last_became_peered":"2024-09-17T01:44:07.077504+0000","last_unstale":"2024-09-17T01:44:08.806184+0000","last_undegraded":"2024-09-17T01:44:08.806184+0000","last_fullsized":"2024-09-17T01:44:08.806184+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:39.167825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052904+0000","last_change":"2024-09-17T01:44:07.073916+0000","last_active":"2024-09-17T01:44:08.052904+0000","last_peered":"2024-09-17T01:44:08.052904+0000","last_clean":"2024-09-17T01:44:08.052904+0000","last_became_active":"2024-09-17T01:44:07.073550+0000","last_became_peered":"2024-09-17T01:44:07.073550+0000","last_unstale":"2024-09-17T01:44:08.052904+0000","last_undegraded":"2024-09-17T01:44:08.052904+0000","last_fullsized":"2024-09-17T01:44:08.052904+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:39.375581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"159'4","reported_seq":19,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.957010+0000","last_change":"2024-09-17T01:44:06.063856+0000","last_active":"2024-09-17T01:44:08.957010+0000","last_peered":"2024-09-17T01:44:08.957010+0000","last_clean":"2024-09-17T01:44:08.957010+0000","last_became_active":"2024-09-17T01:44:06.063513+0000","last_became_peered":"2024-09-17T01:44:06.063513+0000","last_unstale":"2024-09-17T01:44:08.957010+0000","last_undegraded":"2024-09-17T01:44:08.957010+0000","last_fullsized":"2024-09-17T01:44:08.957010+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:33:17.282659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956959+0000","last_change":"2024-09-17T01:44:07.070683+0000","last_active":"2024-09-17T01:44:08.956959+0000","last_peered":"2024-09-17T01:44:08.956959+0000","last_clean":"2024-09-17T01:44:08.956959+0000","last_became_active":"2024-09-17T01:44:07.070335+0000","last_became_peered":"2024-09-17T01:44:07.070335+0000","last_unstale":"2024-09-17T01:44:08.956959+0000","last_undegraded":"2024-09-17T01:44:08.956959+0000","last_fullsized":"2024-09-17T01:44:08.956959+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:30.264212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"159'1","reported_seq":16,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.053825+0000","last_change":"2024-09-17T01:44:06.058625+0000","last_active":"2024-09-17T01:44:08.053825+0000","last_peered":"2024-09-17T01:44:08.053825+0000","last_clean":"2024-09-17T01:44:08.053825+0000","last_became_active":"2024-09-17T01:44:06.058268+0000","last_became_peered":"2024-09-17T01:44:06.058268+0000","last_unstale":"2024-09-17T01:44:08.053825+0000","last_undegraded":"2024-09-17T01:44:08.053825+0000","last_fullsized":"2024-09-17T01:44:08.053825+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:40.853304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.805903+0000","last_change":"2024-09-17T01:44:07.071609+0000","last_active":"2024-09-17T01:44:08.805903+0000","last_peered":"2024-09-17T01:44:08.805903+0000","last_clean":"2024-09-17T01:44:08.805903+0000","last_became_active":"2024-09-17T01:44:07.071259+0000","last_became_peered":"2024-09-17T01:44:07.071259+0000","last_unstale":"2024-09-17T01:44:08.805903+0000","last_undegraded":"2024-09-17T01:44:08.805903+0000","last_fullsized":"2024-09-17T01:44:08.805903+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:26.852889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1d","version":"159'2","reported_seq":17,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.805991+0000","last_change":"2024-09-17T01:44:06.056357+0000","last_active":"2024-09-17T01:44:08.805991+0000","last_peered":"2024-09-17T01:44:08.805991+0000","last_clean":"2024-09-17T01:44:08.805991+0000","last_became_active":"2024-09-17T01:44:06.056044+0000","last_became_peered":"2024-09-17T01:44:06.056044+0000","last_unstale":"2024-09-17T01:44:08.805991+0000","last_undegraded":"2024-09-17T01:44:08.805991+0000","last_fullsized":"2024-09-17T01:44:08.805991+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:42.463174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.053478+0000","last_change":"2024-09-17T01:44:07.058955+0000","last_active":"2024-09-17T01:44:08.053478+0000","last_peered":"2024-09-17T01:44:08.053478+0000","last_clean":"2024-09-17T01:44:08.053478+0000","last_became_active":"2024-09-17T01:44:07.058665+0000","last_became_peered":"2024-09-17T01:44:07.058665+0000","last_unstale":"2024-09-17T01:44:08.053478+0000","last_undegraded":"2024-09-17T01:44:08.053478+0000","last_fullsized":"2024-09-17T01:44:08.053478+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:44.986085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"159'2","reported_seq":17,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.063337+0000","last_change":"2024-09-17T01:44:06.059041+0000","last_active":"2024-09-17T01:44:08.063337+0000","last_peered":"2024-09-17T01:44:08.063337+0000","last_clean":"2024-09-17T01:44:08.063337+0000","last_became_active":"2024-09-17T01:44:06.058214+0000","last_became_peered":"2024-09-17T01:44:06.058214+0000","last_unstale":"2024-09-17T01:44:08.063337+0000","last_undegraded":"2024-09-17T01:44:08.063337+0000","last_fullsized":"2024-09-17T01:44:08.063337+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:41.001043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052458+0000","last_change":"2024-09-17T01:44:07.052280+0000","last_active":"2024-09-17T01:44:08.052458+0000","last_peered":"2024-09-17T01:44:08.052458+0000","last_clean":"2024-09-17T01:44:08.052458+0000","last_became_active":"2024-09-17T01:44:07.051919+0000","last_became_peered":"2024-09-17T01:44:07.051919+0000","last_unstale":"2024-09-17T01:44:08.052458+0000","last_undegraded":"2024-09-17T01:44:08.052458+0000","last_fullsized":"2024-09-17T01:44:08.052458+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:46:07.361501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1b","version":"159'1","reported_seq":16,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956500+0000","last_change":"2024-09-17T01:44:06.065877+0000","last_active":"2024-09-17T01:44:08.956500+0000","last_peered":"2024-09-17T01:44:08.956500+0000","last_clean":"2024-09-17T01:44:08.956500+0000","last_became_active":"2024-09-17T01:44:06.065297+0000","last_became_peered":"2024-09-17T01:44:06.065297+0000","last_unstale":"2024-09-17T01:44:08.956500+0000","last_undegraded":"2024-09-17T01:44:08.956500+0000","last_fullsized":"2024-09-17T01:44:08.956500+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:34.299332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.805823+0000","last_change":"2024-09-17T01:44:07.077934+0000","last_active":"2024-09-17T01:44:08.805823+0000","last_peered":"2024-09-17T01:44:08.805823+0000","last_clean":"2024-09-17T01:44:08.805823+0000","last_became_active":"2024-09-17T01:44:07.076733+0000","last_became_peered":"2024-09-17T01:44:07.076733+0000","last_unstale":"2024-09-17T01:44:08.805823+0000","last_undegraded":"2024-09-17T01:44:08.805823+0000","last_fullsized":"2024-09-17T01:44:08.805823+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:18.004388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"159'1","reported_seq":16,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052427+0000","last_change":"2024-09-17T01:44:06.066094+0000","last_active":"2024-09-17T01:44:08.052427+0000","last_peered":"2024-09-17T01:44:08.052427+0000","last_clean":"2024-09-17T01:44:08.052427+0000","last_became_active":"2024-09-17T01:44:06.065584+0000","last_became_peered":"2024-09-17T01:44:06.065584+0000","last_unstale":"2024-09-17T01:44:08.052427+0000","last_undegraded":"2024-09-17T01:44:08.052427+0000","last_fullsized":"2024-09-17T01:44:08.052427+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:30.925985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.063324+0000","last_change":"2024-09-17T01:44:07.060010+0000","last_active":"2024-09-17T01:44:08.063324+0000","last_peered":"2024-09-17T01:44:08.063324+0000","last_clean":"2024-09-17T01:44:08.063324+0000","last_became_active":"2024-09-17T01:44:07.058480+0000","last_became_peered":"2024-09-17T01:44:07.058480+0000","last_unstale":"2024-09-17T01:44:08.063324+0000","last_undegraded":"2024-09-17T01:44:08.063324+0000","last_fullsized":"2024-09-17T01:44:08.063324+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:43.693214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956368+0000","last_change":"2024-09-17T01:44:06.063878+0000","last_active":"2024-09-17T01:44:08.956368+0000","last_peered":"2024-09-17T01:44:08.956368+0000","last_clean":"2024-09-17T01:44:08.956368+0000","last_became_active":"2024-09-17T01:44:06.063544+0000","last_became_peered":"2024-09-17T01:44:06.063544+0000","last_unstale":"2024-09-17T01:44:08.956368+0000","last_undegraded":"2024-09-17T01:44:08.956368+0000","last_fullsized":"2024-09-17T01:44:08.956368+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:29.035499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052279+0000","last_change":"2024-09-17T01:44:07.071044+0000","last_active":"2024-09-17T01:44:08.052279+0000","last_peered":"2024-09-17T01:44:08.052279+0000","last_clean":"2024-09-17T01:44:08.052279+0000","last_became_active":"2024-09-17T01:44:07.070714+0000","last_became_peered":"2024-09-17T01:44:07.070714+0000","last_unstale":"2024-09-17T01:44:08.052279+0000","last_undegraded":"2024-09-17T01:44:08.052279+0000","last_fullsized":"2024-09-17T01:44:08.052279+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:04.124920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.062971+0000","last_change":"2024-09-17T01:44:06.052770+0000","last_active":"2024-09-17T01:44:08.062971+0000","last_peered":"2024-09-17T01:44:08.062971+0000","last_clean":"2024-09-17T01:44:08.062971+0000","last_became_active":"2024-09-17T01:44:06.052422+0000","last_became_peered":"2024-09-17T01:44:06.052422+0000","last_unstale":"2024-09-17T01:44:08.062971+0000","last_undegraded":"2024-09-17T01:44:08.062971+0000","last_fullsized":"2024-09-17T01:44:08.062971+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:28.734087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.957329+0000","last_change":"2024-09-17T01:44:07.061550+0000","last_active":"2024-09-17T01:44:08.957329+0000","last_peered":"2024-09-17T01:44:08.957329+0000","last_clean":"2024-09-17T01:44:08.957329+0000","last_became_active":"2024-09-17T01:44:07.061209+0000","last_became_peered":"2024-09-17T01:44:07.061209+0000","last_unstale":"2024-09-17T01:44:08.957329+0000","last_undegraded":"2024-09-17T01:44:08.957329+0000","last_fullsized":"2024-09-17T01:44:08.957329+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:23.166764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.806296+0000","last_change":"2024-09-17T01:44:06.066408+0000","last_active":"2024-09-17T01:44:08.806296+0000","last_peered":"2024-09-17T01:44:08.806296+0000","last_clean":"2024-09-17T01:44:08.806296+0000","last_became_active":"2024-09-17T01:44:06.065968+0000","last_became_peered":"2024-09-17T01:44:06.065968+0000","last_unstale":"2024-09-17T01:44:08.806296+0000","last_undegraded":"2024-09-17T01:44:08.806296+0000","last_fullsized":"2024-09-17T01:44:08.806296+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:31.359967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.957424+0000","last_change":"2024-09-17T01:44:07.059461+0000","last_active":"2024-09-17T01:44:08.957424+0000","last_peered":"2024-09-17T01:44:08.957424+0000","last_clean":"2024-09-17T01:44:08.957424+0000","last_became_active":"2024-09-17T01:44:07.059056+0000","last_became_peered":"2024-09-17T01:44:07.059056+0000","last_unstale":"2024-09-17T01:44:08.957424+0000","last_undegraded":"2024-09-17T01:44:08.957424+0000","last_fullsized":"2024-09-17T01:44:08.957424+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:20.096759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.15","version":"159'3","reported_seq":18,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.063547+0000","last_change":"2024-09-17T01:44:06.058705+0000","last_active":"2024-09-17T01:44:08.063547+0000","last_peered":"2024-09-17T01:44:08.063547+0000","last_clean":"2024-09-17T01:44:08.063547+0000","last_became_active":"2024-09-17T01:44:06.058279+0000","last_became_peered":"2024-09-17T01:44:06.058279+0000","last_unstale":"2024-09-17T01:44:08.063547+0000","last_undegraded":"2024-09-17T01:44:08.063547+0000","last_fullsized":"2024-09-17T01:44:08.063547+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:58:08.665454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956714+0000","last_change":"2024-09-17T01:44:07.072446+0000","last_active":"2024-09-17T01:44:08.956714+0000","last_peered":"2024-09-17T01:44:08.956714+0000","last_clean":"2024-09-17T01:44:08.956714+0000","last_became_active":"2024-09-17T01:44:07.072101+0000","last_became_peered":"2024-09-17T01:44:07.072101+0000","last_unstale":"2024-09-17T01:44:08.956714+0000","last_undegraded":"2024-09-17T01:44:08.956714+0000","last_fullsized":"2024-09-17T01:44:08.956714+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:16.213903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"159'6","reported_seq":21,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.051485+0000","last_change":"2024-09-17T01:44:06.049256+0000","last_active":"2024-09-17T01:44:08.051485+0000","last_peered":"2024-09-17T01:44:08.051485+0000","last_clean":"2024-09-17T01:44:08.051485+0000","last_became_active":"2024-09-17T01:44:06.047272+0000","last_became_peered":"2024-09-17T01:44:06.047272+0000","last_unstale":"2024-09-17T01:44:08.051485+0000","last_undegraded":"2024-09-17T01:44:08.051485+0000","last_fullsized":"2024-09-17T01:44:08.051485+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:49.444685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.957258+0000","last_change":"2024-09-17T01:44:07.057968+0000","last_active":"2024-09-17T01:44:08.957258+0000","last_peered":"2024-09-17T01:44:08.957258+0000","last_clean":"2024-09-17T01:44:08.957258+0000","last_became_active":"2024-09-17T01:44:07.057576+0000","last_became_peered":"2024-09-17T01:44:07.057576+0000","last_unstale":"2024-09-17T01:44:08.957258+0000","last_undegraded":"2024-09-17T01:44:08.957258+0000","last_fullsized":"2024-09-17T01:44:08.957258+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:44.257666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"159'2","reported_seq":17,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052527+0000","last_change":"2024-09-17T01:44:06.047448+0000","last_active":"2024-09-17T01:44:08.052527+0000","last_peered":"2024-09-17T01:44:08.052527+0000","last_clean":"2024-09-17T01:44:08.052527+0000","last_became_active":"2024-09-17T01:44:06.047074+0000","last_became_peered":"2024-09-17T01:44:06.047074+0000","last_unstale":"2024-09-17T01:44:08.052527+0000","last_undegraded":"2024-09-17T01:44:08.052527+0000","last_fullsized":"2024-09-17T01:44:08.052527+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:17.653960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.063391+0000","last_change":"2024-09-17T01:44:07.069468+0000","last_active":"2024-09-17T01:44:08.063391+0000","last_peered":"2024-09-17T01:44:08.063391+0000","last_clean":"2024-09-17T01:44:08.063391+0000","last_became_active":"2024-09-17T01:44:07.068998+0000","last_became_peered":"2024-09-17T01:44:07.068998+0000","last_unstale":"2024-09-17T01:44:08.063391+0000","last_undegraded":"2024-09-17T01:44:08.063391+0000","last_fullsized":"2024-09-17T01:44:08.063391+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:11.574732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.806147+0000","last_change":"2024-09-17T01:44:06.055750+0000","last_active":"2024-09-17T01:44:08.806147+0000","last_peered":"2024-09-17T01:44:08.806147+0000","last_clean":"2024-09-17T01:44:08.806147+0000","last_became_active":"2024-09-17T01:44:06.054989+0000","last_became_peered":"2024-09-17T01:44:06.054989+0000","last_unstale":"2024-09-17T01:44:08.806147+0000","last_undegraded":"2024-09-17T01:44:08.806147+0000","last_fullsized":"2024-09-17T01:44:08.806147+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:23.696085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.805792+0000","last_change":"2024-09-17T01:44:07.075995+0000","last_active":"2024-09-17T01:44:08.805792+0000","last_peered":"2024-09-17T01:44:08.805792+0000","last_clean":"2024-09-17T01:44:08.805792+0000","last_became_active":"2024-09-17T01:44:07.074910+0000","last_became_peered":"2024-09-17T01:44:07.074910+0000","last_unstale":"2024-09-17T01:44:08.805792+0000","last_undegraded":"2024-09-17T01:44:08.805792+0000","last_fullsized":"2024-09-17T01:44:08.805792+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:16.913340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.957140+0000","last_change":"2024-09-17T01:44:06.058872+0000","last_active":"2024-09-17T01:44:08.957140+0000","last_peered":"2024-09-17T01:44:08.957140+0000","last_clean":"2024-09-17T01:44:08.957140+0000","last_became_active":"2024-09-17T01:44:06.058100+0000","last_became_peered":"2024-09-17T01:44:06.058100+0000","last_unstale":"2024-09-17T01:44:08.957140+0000","last_undegraded":"2024-09-17T01:44:08.957140+0000","last_fullsized":"2024-09-17T01:44:08.957140+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:31:16.751459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052648+0000","last_change":"2024-09-17T01:44:07.071686+0000","last_active":"2024-09-17T01:44:08.052648+0000","last_peered":"2024-09-17T01:44:08.052648+0000","last_clean":"2024-09-17T01:44:08.052648+0000","last_became_active":"2024-09-17T01:44:07.070532+0000","last_became_peered":"2024-09-17T01:44:07.070532+0000","last_unstale":"2024-09-17T01:44:08.052648+0000","last_undegraded":"2024-09-17T01:44:08.052648+0000","last_fullsized":"2024-09-17T01:44:08.052648+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:55.941343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"159'8","reported_seq":23,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.051155+0000","last_change":"2024-09-17T01:44:06.052261+0000","last_active":"2024-09-17T01:44:08.051155+0000","last_peered":"2024-09-17T01:44:08.051155+0000","last_clean":"2024-09-17T01:44:08.051155+0000","last_became_active":"2024-09-17T01:44:06.048839+0000","last_became_peered":"2024-09-17T01:44:06.048839+0000","last_unstale":"2024-09-17T01:44:08.051155+0000","last_undegraded":"2024-09-17T01:44:08.051155+0000","last_fullsized":"2024-09-17T01:44:08.051155+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:38.101410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.957485+0000","last_change":"2024-09-17T01:44:07.069986+0000","last_active":"2024-09-17T01:44:08.957485+0000","last_peered":"2024-09-17T01:44:08.957485+0000","last_clean":"2024-09-17T01:44:08.957485+0000","last_became_active":"2024-09-17T01:44:07.069636+0000","last_became_peered":"2024-09-17T01:44:07.069636+0000","last_unstale":"2024-09-17T01:44:08.957485+0000","last_undegraded":"2024-09-17T01:44:08.957485+0000","last_fullsized":"2024-09-17T01:44:08.957485+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:14.075149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"159'1","reported_seq":16,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.051928+0000","last_change":"2024-09-17T01:44:06.048474+0000","last_active":"2024-09-17T01:44:08.051928+0000","last_peered":"2024-09-17T01:44:08.051928+0000","last_clean":"2024-09-17T01:44:08.051928+0000","last_became_active":"2024-09-17T01:44:06.048093+0000","last_became_peered":"2024-09-17T01:44:06.048093+0000","last_unstale":"2024-09-17T01:44:08.051928+0000","last_undegraded":"2024-09-17T01:44:08.051928+0000","last_fullsized":"2024-09-17T01:44:08.051928+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:22.123898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.053243+0000","last_change":"2024-09-17T01:44:07.072403+0000","last_active":"2024-09-17T01:44:08.053243+0000","last_peered":"2024-09-17T01:44:08.053243+0000","last_clean":"2024-09-17T01:44:08.053243+0000","last_became_active":"2024-09-17T01:44:07.072098+0000","last_became_peered":"2024-09-17T01:44:07.072098+0000","last_unstale":"2024-09-17T01:44:08.053243+0000","last_undegraded":"2024-09-17T01:44:08.053243+0000","last_fullsized":"2024-09-17T01:44:08.053243+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:18.100268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.e","version":"159'2","reported_seq":17,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.053830+0000","last_change":"2024-09-17T01:44:06.059420+0000","last_active":"2024-09-17T01:44:08.053830+0000","last_peered":"2024-09-17T01:44:08.053830+0000","last_clean":"2024-09-17T01:44:08.053830+0000","last_became_active":"2024-09-17T01:44:06.059101+0000","last_became_peered":"2024-09-17T01:44:06.059101+0000","last_unstale":"2024-09-17T01:44:08.053830+0000","last_undegraded":"2024-09-17T01:44:08.053830+0000","last_fullsized":"2024-09-17T01:44:08.053830+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:15.910241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.053087+0000","last_change":"2024-09-17T01:44:07.067227+0000","last_active":"2024-09-17T01:44:08.053087+0000","last_peered":"2024-09-17T01:44:08.053087+0000","last_clean":"2024-09-17T01:44:08.053087+0000","last_became_active":"2024-09-17T01:44:07.058937+0000","last_became_peered":"2024-09-17T01:44:07.058937+0000","last_unstale":"2024-09-17T01:44:08.053087+0000","last_undegraded":"2024-09-17T01:44:08.053087+0000","last_fullsized":"2024-09-17T01:44:08.053087+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:17.474743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.d","version":"159'1","reported_seq":16,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052041+0000","last_change":"2024-09-17T01:44:06.063895+0000","last_active":"2024-09-17T01:44:08.052041+0000","last_peered":"2024-09-17T01:44:08.052041+0000","last_clean":"2024-09-17T01:44:08.052041+0000","last_became_active":"2024-09-17T01:44:06.063199+0000","last_became_peered":"2024-09-17T01:44:06.063199+0000","last_unstale":"2024-09-17T01:44:08.052041+0000","last_undegraded":"2024-09-17T01:44:08.052041+0000","last_fullsized":"2024-09-17T01:44:08.052041+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:23.762189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.063649+0000","last_change":"2024-09-17T01:44:07.080205+0000","last_active":"2024-09-17T01:44:08.063649+0000","last_peered":"2024-09-17T01:44:08.063649+0000","last_clean":"2024-09-17T01:44:08.063649+0000","last_became_active":"2024-09-17T01:44:07.079889+0000","last_became_peered":"2024-09-17T01:44:07.079889+0000","last_unstale":"2024-09-17T01:44:08.063649+0000","last_undegraded":"2024-09-17T01:44:08.063649+0000","last_fullsized":"2024-09-17T01:44:08.063649+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:55.769410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.751165+0000","last_change":"2024-09-17T01:44:06.049664+0000","last_active":"2024-09-17T01:44:08.751165+0000","last_peered":"2024-09-17T01:44:08.751165+0000","last_clean":"2024-09-17T01:44:08.751165+0000","last_became_active":"2024-09-17T01:44:06.048649+0000","last_became_peered":"2024-09-17T01:44:06.048649+0000","last_unstale":"2024-09-17T01:44:08.751165+0000","last_undegraded":"2024-09-17T01:44:08.751165+0000","last_fullsized":"2024-09-17T01:44:08.751165+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:39.411816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956483+0000","last_change":"2024-09-17T01:44:07.053845+0000","last_active":"2024-09-17T01:44:08.956483+0000","last_peered":"2024-09-17T01:44:08.956483+0000","last_clean":"2024-09-17T01:44:08.956483+0000","last_became_active":"2024-09-17T01:44:07.052644+0000","last_became_peered":"2024-09-17T01:44:07.052644+0000","last_unstale":"2024-09-17T01:44:08.956483+0000","last_undegraded":"2024-09-17T01:44:08.956483+0000","last_fullsized":"2024-09-17T01:44:08.956483+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:07.089616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"159'2","reported_seq":17,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.063559+0000","last_change":"2024-09-17T01:44:06.057365+0000","last_active":"2024-09-17T01:44:08.063559+0000","last_peered":"2024-09-17T01:44:08.063559+0000","last_clean":"2024-09-17T01:44:08.063559+0000","last_became_active":"2024-09-17T01:44:06.056755+0000","last_became_peered":"2024-09-17T01:44:06.056755+0000","last_unstale":"2024-09-17T01:44:08.063559+0000","last_undegraded":"2024-09-17T01:44:08.063559+0000","last_fullsized":"2024-09-17T01:44:08.063559+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:55.382179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.063415+0000","last_change":"2024-09-17T01:44:07.064923+0000","last_active":"2024-09-17T01:44:08.063415+0000","last_peered":"2024-09-17T01:44:08.063415+0000","last_clean":"2024-09-17T01:44:08.063415+0000","last_became_active":"2024-09-17T01:44:07.063318+0000","last_became_peered":"2024-09-17T01:44:07.063318+0000","last_unstale":"2024-09-17T01:44:08.063415+0000","last_undegraded":"2024-09-17T01:44:08.063415+0000","last_fullsized":"2024-09-17T01:44:08.063415+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:47.471862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.750852+0000","last_change":"2024-09-17T01:44:06.057558+0000","last_active":"2024-09-17T01:44:08.750852+0000","last_peered":"2024-09-17T01:44:08.750852+0000","last_clean":"2024-09-17T01:44:08.750852+0000","last_became_active":"2024-09-17T01:44:06.056268+0000","last_became_peered":"2024-09-17T01:44:06.056268+0000","last_unstale":"2024-09-17T01:44:08.750852+0000","last_undegraded":"2024-09-17T01:44:08.750852+0000","last_fullsized":"2024-09-17T01:44:08.750852+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:39.846868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956190+0000","last_change":"2024-09-17T01:44:07.047859+0000","last_active":"2024-09-17T01:44:08.956190+0000","last_peered":"2024-09-17T01:44:08.956190+0000","last_clean":"2024-09-17T01:44:08.956190+0000","last_became_active":"2024-09-17T01:44:07.047515+0000","last_became_peered":"2024-09-17T01:44:07.047515+0000","last_unstale":"2024-09-17T01:44:08.956190+0000","last_undegraded":"2024-09-17T01:44:08.956190+0000","last_fullsized":"2024-09-17T01:44:08.956190+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:28:16.059989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052262+0000","last_change":"2024-09-17T01:44:06.066340+0000","last_active":"2024-09-17T01:44:08.052262+0000","last_peered":"2024-09-17T01:44:08.052262+0000","last_clean":"2024-09-17T01:44:08.052262+0000","last_became_active":"2024-09-17T01:44:06.065528+0000","last_became_peered":"2024-09-17T01:44:06.065528+0000","last_unstale":"2024-09-17T01:44:08.052262+0000","last_undegraded":"2024-09-17T01:44:08.052262+0000","last_fullsized":"2024-09-17T01:44:08.052262+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:13.037794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956983+0000","last_change":"2024-09-17T01:44:07.061163+0000","last_active":"2024-09-17T01:44:08.956983+0000","last_peered":"2024-09-17T01:44:08.956983+0000","last_clean":"2024-09-17T01:44:08.956983+0000","last_became_active":"2024-09-17T01:44:07.060788+0000","last_became_peered":"2024-09-17T01:44:07.060788+0000","last_unstale":"2024-09-17T01:44:08.956983+0000","last_undegraded":"2024-09-17T01:44:08.956983+0000","last_fullsized":"2024-09-17T01:44:08.956983+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:56:35.021505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.750877+0000","last_change":"2024-09-17T01:44:06.058197+0000","last_active":"2024-09-17T01:44:08.750877+0000","last_peered":"2024-09-17T01:44:08.750877+0000","last_clean":"2024-09-17T01:44:08.750877+0000","last_became_active":"2024-09-17T01:44:06.057891+0000","last_became_peered":"2024-09-17T01:44:06.057891+0000","last_unstale":"2024-09-17T01:44:08.750877+0000","last_undegraded":"2024-09-17T01:44:08.750877+0000","last_fullsized":"2024-09-17T01:44:08.750877+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:46.039272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.063812+0000","last_change":"2024-09-17T01:44:07.066010+0000","last_active":"2024-09-17T01:44:08.063812+0000","last_peered":"2024-09-17T01:44:08.063812+0000","last_clean":"2024-09-17T01:44:08.063812+0000","last_became_active":"2024-09-17T01:44:07.064179+0000","last_became_peered":"2024-09-17T01:44:07.064179+0000","last_unstale":"2024-09-17T01:44:08.063812+0000","last_undegraded":"2024-09-17T01:44:08.063812+0000","last_fullsized":"2024-09-17T01:44:08.063812+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:23.066587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.7","version":"159'2","reported_seq":17,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.806207+0000","last_change":"2024-09-17T01:44:06.054637+0000","last_active":"2024-09-17T01:44:08.806207+0000","last_peered":"2024-09-17T01:44:08.806207+0000","last_clean":"2024-09-17T01:44:08.806207+0000","last_became_active":"2024-09-17T01:44:06.053809+0000","last_became_peered":"2024-09-17T01:44:06.053809+0000","last_unstale":"2024-09-17T01:44:08.806207+0000","last_undegraded":"2024-09-17T01:44:08.806207+0000","last_fullsized":"2024-09-17T01:44:08.806207+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:27.875367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.053478+0000","last_change":"2024-09-17T01:44:07.048127+0000","last_active":"2024-09-17T01:44:08.053478+0000","last_peered":"2024-09-17T01:44:08.053478+0000","last_clean":"2024-09-17T01:44:08.053478+0000","last_became_active":"2024-09-17T01:44:07.047779+0000","last_became_peered":"2024-09-17T01:44:07.047779+0000","last_unstale":"2024-09-17T01:44:08.053478+0000","last_undegraded":"2024-09-17T01:44:08.053478+0000","last_fullsized":"2024-09-17T01:44:08.053478+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:51:34.161640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.6","version":"160'1","reported_seq":16,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:09.050629+0000","last_change":"2024-09-17T01:44:06.061164+0000","last_active":"2024-09-17T01:44:09.050629+0000","last_peered":"2024-09-17T01:44:09.050629+0000","last_clean":"2024-09-17T01:44:09.050629+0000","last_became_active":"2024-09-17T01:44:06.060867+0000","last_became_peered":"2024-09-17T01:44:06.060867+0000","last_unstale":"2024-09-17T01:44:09.050629+0000","last_undegraded":"2024-09-17T01:44:09.050629+0000","last_fullsized":"2024-09-17T01:44:09.050629+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:42.056841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.053348+0000","last_change":"2024-09-17T01:44:07.066301+0000","last_active":"2024-09-17T01:44:08.053348+0000","last_peered":"2024-09-17T01:44:08.053348+0000","last_clean":"2024-09-17T01:44:08.053348+0000","last_became_active":"2024-09-17T01:44:07.065645+0000","last_became_peered":"2024-09-17T01:44:07.065645+0000","last_unstale":"2024-09-17T01:44:08.053348+0000","last_undegraded":"2024-09-17T01:44:08.053348+0000","last_fullsized":"2024-09-17T01:44:08.053348+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:34.274919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956781+0000","last_change":"2024-09-17T01:44:06.062628+0000","last_active":"2024-09-17T01:44:08.956781+0000","last_peered":"2024-09-17T01:44:08.956781+0000","last_clean":"2024-09-17T01:44:08.956781+0000","last_became_active":"2024-09-17T01:44:06.062315+0000","last_became_peered":"2024-09-17T01:44:06.062315+0000","last_unstale":"2024-09-17T01:44:08.956781+0000","last_undegraded":"2024-09-17T01:44:08.956781+0000","last_fullsized":"2024-09-17T01:44:08.956781+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:33.128051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052795+0000","last_change":"2024-09-17T01:44:07.056442+0000","last_active":"2024-09-17T01:44:08.052795+0000","last_peered":"2024-09-17T01:44:08.052795+0000","last_clean":"2024-09-17T01:44:08.052795+0000","last_became_active":"2024-09-17T01:44:07.056118+0000","last_became_peered":"2024-09-17T01:44:07.056118+0000","last_unstale":"2024-09-17T01:44:08.052795+0000","last_undegraded":"2024-09-17T01:44:08.052795+0000","last_fullsized":"2024-09-17T01:44:08.052795+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:17.285808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.063363+0000","last_change":"2024-09-17T01:44:06.054673+0000","last_active":"2024-09-17T01:44:08.063363+0000","last_peered":"2024-09-17T01:44:08.063363+0000","last_clean":"2024-09-17T01:44:08.063363+0000","last_became_active":"2024-09-17T01:44:06.054251+0000","last_became_peered":"2024-09-17T01:44:06.054251+0000","last_unstale":"2024-09-17T01:44:08.063363+0000","last_undegraded":"2024-09-17T01:44:08.063363+0000","last_fullsized":"2024-09-17T01:44:08.063363+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:32.801124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.805971+0000","last_change":"2024-09-17T01:44:07.074858+0000","last_active":"2024-09-17T01:44:08.805971+0000","last_peered":"2024-09-17T01:44:08.805971+0000","last_clean":"2024-09-17T01:44:08.805971+0000","last_became_active":"2024-09-17T01:44:07.074517+0000","last_became_peered":"2024-09-17T01:44:07.074517+0000","last_unstale":"2024-09-17T01:44:08.805971+0000","last_undegraded":"2024-09-17T01:44:08.805971+0000","last_fullsized":"2024-09-17T01:44:08.805971+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:45.135777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.051569+0000","last_change":"2024-09-17T01:44:06.048219+0000","last_active":"2024-09-17T01:44:08.051569+0000","last_peered":"2024-09-17T01:44:08.051569+0000","last_clean":"2024-09-17T01:44:08.051569+0000","last_became_active":"2024-09-17T01:44:06.047851+0000","last_became_peered":"2024-09-17T01:44:06.047851+0000","last_unstale":"2024-09-17T01:44:08.051569+0000","last_undegraded":"2024-09-17T01:44:08.051569+0000","last_fullsized":"2024-09-17T01:44:08.051569+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:02.640019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956501+0000","last_change":"2024-09-17T01:44:07.051500+0000","last_active":"2024-09-17T01:44:08.956501+0000","last_peered":"2024-09-17T01:44:08.956501+0000","last_clean":"2024-09-17T01:44:08.956501+0000","last_became_active":"2024-09-17T01:44:07.051119+0000","last_became_peered":"2024-09-17T01:44:07.051119+0000","last_unstale":"2024-09-17T01:44:08.956501+0000","last_undegraded":"2024-09-17T01:44:08.956501+0000","last_fullsized":"2024-09-17T01:44:08.956501+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:44.318905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956789+0000","last_change":"2024-09-17T01:44:06.044946+0000","last_active":"2024-09-17T01:44:08.956789+0000","last_peered":"2024-09-17T01:44:08.956789+0000","last_clean":"2024-09-17T01:44:08.956789+0000","last_became_active":"2024-09-17T01:44:06.044583+0000","last_became_peered":"2024-09-17T01:44:06.044583+0000","last_unstale":"2024-09-17T01:44:08.956789+0000","last_undegraded":"2024-09-17T01:44:08.956789+0000","last_fullsized":"2024-09-17T01:44:08.956789+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:05.148132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.957218+0000","last_change":"2024-09-17T01:44:07.057465+0000","last_active":"2024-09-17T01:44:08.957218+0000","last_peered":"2024-09-17T01:44:08.957218+0000","last_clean":"2024-09-17T01:44:08.957218+0000","last_became_active":"2024-09-17T01:44:07.057065+0000","last_became_peered":"2024-09-17T01:44:07.057065+0000","last_unstale":"2024-09-17T01:44:08.957218+0000","last_undegraded":"2024-09-17T01:44:08.957218+0000","last_fullsized":"2024-09-17T01:44:08.957218+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:17.593862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956457+0000","last_change":"2024-09-17T01:44:06.066315+0000","last_active":"2024-09-17T01:44:08.956457+0000","last_peered":"2024-09-17T01:44:08.956457+0000","last_clean":"2024-09-17T01:44:08.956457+0000","last_became_active":"2024-09-17T01:44:06.065250+0000","last_became_peered":"2024-09-17T01:44:06.065250+0000","last_unstale":"2024-09-17T01:44:08.956457+0000","last_undegraded":"2024-09-17T01:44:08.956457+0000","last_fullsized":"2024-09-17T01:44:08.956457+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:22.751154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956280+0000","last_change":"2024-09-17T01:44:07.071538+0000","last_active":"2024-09-17T01:44:08.956280+0000","last_peered":"2024-09-17T01:44:08.956280+0000","last_clean":"2024-09-17T01:44:08.956280+0000","last_became_active":"2024-09-17T01:44:07.071189+0000","last_became_peered":"2024-09-17T01:44:07.071189+0000","last_unstale":"2024-09-17T01:44:08.956280+0000","last_undegraded":"2024-09-17T01:44:08.956280+0000","last_fullsized":"2024-09-17T01:44:08.956280+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:40.861349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956017+0000","last_change":"2024-09-17T01:44:06.062899+0000","last_active":"2024-09-17T01:44:08.956017+0000","last_peered":"2024-09-17T01:44:08.956017+0000","last_clean":"2024-09-17T01:44:08.956017+0000","last_became_active":"2024-09-17T01:44:06.062331+0000","last_became_peered":"2024-09-17T01:44:06.062331+0000","last_unstale":"2024-09-17T01:44:08.956017+0000","last_undegraded":"2024-09-17T01:44:08.956017+0000","last_fullsized":"2024-09-17T01:44:08.956017+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:20.808926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.957387+0000","last_change":"2024-09-17T01:44:07.051999+0000","last_active":"2024-09-17T01:44:08.957387+0000","last_peered":"2024-09-17T01:44:08.957387+0000","last_clean":"2024-09-17T01:44:08.957387+0000","last_became_active":"2024-09-17T01:44:07.051667+0000","last_became_peered":"2024-09-17T01:44:07.051667+0000","last_unstale":"2024-09-17T01:44:08.957387+0000","last_undegraded":"2024-09-17T01:44:08.957387+0000","last_fullsized":"2024-09-17T01:44:08.957387+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:32.780761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.051727+0000","last_change":"2024-09-17T01:44:06.053633+0000","last_active":"2024-09-17T01:44:08.051727+0000","last_peered":"2024-09-17T01:44:08.051727+0000","last_clean":"2024-09-17T01:44:08.051727+0000","last_became_active":"2024-09-17T01:44:06.053303+0000","last_became_peered":"2024-09-17T01:44:06.053303+0000","last_unstale":"2024-09-17T01:44:08.051727+0000","last_undegraded":"2024-09-17T01:44:08.051727+0000","last_fullsized":"2024-09-17T01:44:08.051727+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:45.135104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":374,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.051225+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:44:08.051225+0000","last_peered":"2024-09-17T01:44:08.051225+0000","last_clean":"2024-09-17T01:44:08.051225+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:44:08.051225+0000","last_undegraded":"2024-09-17T01:44:08.051225+0000","last_fullsized":"2024-09-17T01:44:08.051225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476887,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59516,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312324,"statfs":{"total":96636764160,"available":96575819776,"internally_reserved":0,"allocated":2002944,"data_stored":880718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509590,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51196,"kb_used_data":1952,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320644,"statfs":{"total":96636764160,"available":96584339456,"internally_reserved":0,"allocated":1998848,"data_stored":880136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59512,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312328,"statfs":{"total":96636764160,"available":96575823872,"internally_reserved":0,"allocated":2002944,"data_stored":880170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509590,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47040,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324800,"statfs":{"total":96636764160,"available":96588595200,"internally_reserved":0,"allocated":2002944,"data_stored":880170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509590,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59524,"kb_used_data":1968,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312316,"statfs":{"total":96636764160,"available":96575811584,"internally_reserved":0,"allocated":2015232,"data_stored":881770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509589,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60120,"kb_used_data":2556,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311720,"statfs":{"total":96636764160,"available":96575201280,"internally_reserved":0,"allocated":2617344,"data_stored":1472298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509591,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55360,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316480,"statfs":{"total":96636764160,"available":96580075520,"internally_reserved":0,"allocated":2002944,"data_stored":880206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":54655433},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542295,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64256,"kb_used_data":2540,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307584,"statfs":{"total":96636764160,"available":96570966016,"internally_reserved":0,"allocated":2600960,"data_stored":1471176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:44:11.525 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:44:11.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.790+0000 7fbc67000640 1 -- 172.21.15.42:0/3001145651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc48004d90 msgr2=0x7fbc48005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:11.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.790+0000 7fbc67000640 1 --2- 172.21.15.42:0/3001145651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc48004d90 0x7fbc48005220 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fbc600b4890 tx=0x7fbc48005830 comp rx=0 tx=0).stop 2024-09-17T01:44:11.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.790+0000 7fbc66600640 1 -- 172.21.15.42:0/3001145651 reap_dead start 2024-09-17T01:44:11.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.791+0000 7fbc67000640 1 -- 172.21.15.42:0/3001145651 shutdown_connections 2024-09-17T01:44:11.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.791+0000 7fbc67000640 1 -- 172.21.15.42:0/3001145651 >> 172.21.15.42:0/3001145651 conn(0x7fbc600b25f0 msgr2=0x7fbc600d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:11.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.791+0000 7fbc67000640 1 -- 172.21.15.42:0/3001145651 shutdown_connections 2024-09-17T01:44:11.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.791+0000 7fbc67000640 1 -- 172.21.15.42:0/3001145651 wait complete. 2024-09-17T01:44:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.793+0000 7fbc67000640 1 Processor -- start 2024-09-17T01:44:11.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.793+0000 7fbc67000640 1 -- start start 2024-09-17T01:44:11.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.795+0000 7fbc67000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbc48004d90 0x7fbc601f9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:11.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.795+0000 7fbc67000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc6014f890 0x7fbc6015e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:11.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.795+0000 7fbc67000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc6015eab0 0x7fbc601503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:11.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.795+0000 7fbc67000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6006cd20 con 0x7fbc6014f890 2024-09-17T01:44:11.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.795+0000 7fbc67000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbc600b42f0 con 0x7fbc6015eab0 2024-09-17T01:44:11.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.795+0000 7fbc67000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbc6006cea0 con 0x7fbc48004d90 2024-09-17T01:44:11.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.795+0000 7fbc65200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc6014f890 0x7fbc6015e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:11.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.795+0000 7fbc65200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc6014f890 0x7fbc6015e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36408/0 (socket says 172.21.15.42:36408) 2024-09-17T01:44:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.795+0000 7fbc65200640 1 -- 172.21.15.42:0/1145113810 learned_addr learned my addr 172.21.15.42:0/1145113810 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.795+0000 7fbc65c00640 1 --2- 172.21.15.42:0/1145113810 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbc48004d90 0x7fbc601f9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.795+0000 7fbc66600640 1 --2- 172.21.15.42:0/1145113810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc6015eab0 0x7fbc601503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.795+0000 7fbc65200640 1 -- 172.21.15.42:0/1145113810 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbc48004d90 msgr2=0x7fbc601f9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.795+0000 7fbc65200640 1 --2- 172.21.15.42:0/1145113810 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbc48004d90 0x7fbc601f9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.796+0000 7fbc65200640 1 -- 172.21.15.42:0/1145113810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc6015eab0 msgr2=0x7fbc601503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.796+0000 7fbc65200640 1 --2- 172.21.15.42:0/1145113810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc6015eab0 0x7fbc601503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.796+0000 7fbc65200640 1 -- 172.21.15.42:0/1145113810 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc6015eec0 con 0x7fbc6014f890 2024-09-17T01:44:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.796+0000 7fbc65c00640 1 --2- 172.21.15.42:0/1145113810 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbc48004d90 0x7fbc601f9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:44:11.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.796+0000 7fbc65200640 1 --2- 172.21.15.42:0/1145113810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc6014f890 0x7fbc6015e570 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c011b10 tx=0x7fbc4c009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:11.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.796+0000 7fbc5d600640 1 -- 172.21.15.42:0/1145113810 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c01e070 con 0x7fbc6014f890 2024-09-17T01:44:11.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.796+0000 7fbc5d600640 1 -- 172.21.15.42:0/1145113810 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc4c004460 con 0x7fbc6014f890 2024-09-17T01:44:11.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.796+0000 7fbc5d600640 1 -- 172.21.15.42:0/1145113810 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c00fc70 con 0x7fbc6014f890 2024-09-17T01:44:11.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.796+0000 7fbc67000640 1 -- 172.21.15.42:0/1145113810 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc601f5b60 con 0x7fbc6014f890 2024-09-17T01:44:11.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.796+0000 7fbc67000640 1 -- 172.21.15.42:0/1145113810 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc601f6120 con 0x7fbc6014f890 2024-09-17T01:44:11.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.798+0000 7fbc67000640 1 -- 172.21.15.42:0/1145113810 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc60153750 con 0x7fbc6014f890 2024-09-17T01:44:11.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.798+0000 7fbc5d600640 1 -- 172.21.15.42:0/1145113810 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbc4c021070 con 0x7fbc6014f890 2024-09-17T01:44:11.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.799+0000 7fbc5d600640 1 --2- 172.21.15.42:0/1145113810 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbc40078b90 0x7fbc4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:11.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.800+0000 7fbc5d600640 1 -- 172.21.15.42:0/1145113810 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7fbc4c09b7f0 con 0x7fbc6014f890 2024-09-17T01:44:11.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.800+0000 7fbc65c00640 1 --2- 172.21.15.42:0/1145113810 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbc40078b90 0x7fbc4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:11.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.801+0000 7fbc65c00640 1 --2- 172.21.15.42:0/1145113810 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbc40078b90 0x7fbc4007b0a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fbc54001eb0 tx=0x7fbc540068a0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:11.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.804+0000 7fbc5d600640 1 -- 172.21.15.42:0/1145113810 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbc6015eec0 con 0x7fbc6014f890 2024-09-17T01:44:11.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:11.998+0000 7fbc67000640 1 -- 172.21.15.42:0/1145113810 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbc601f6570 con 0x7fbc40078b90 2024-09-17T01:44:12.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.003+0000 7fbc5d600640 1 -- 172.21.15.42:0/1145113810 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252474 (secure 0 0 0) 0x7fbc601f6570 con 0x7fbc40078b90 2024-09-17T01:44:12.003 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:44:12.005 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:44:12.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.007+0000 7fbc67000640 1 -- 172.21.15.42:0/1145113810 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbc40078b90 msgr2=0x7fbc4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:12.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.007+0000 7fbc67000640 1 --2- 172.21.15.42:0/1145113810 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbc40078b90 0x7fbc4007b0a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fbc54001eb0 tx=0x7fbc540068a0 comp rx=0 tx=0).stop 2024-09-17T01:44:12.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.007+0000 7fbc67000640 1 -- 172.21.15.42:0/1145113810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc6014f890 msgr2=0x7fbc6015e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:12.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.007+0000 7fbc67000640 1 --2- 172.21.15.42:0/1145113810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc6014f890 0x7fbc6015e570 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c011b10 tx=0x7fbc4c009e90 comp rx=0 tx=0).stop 2024-09-17T01:44:12.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.007+0000 7fbc67000640 1 -- 172.21.15.42:0/1145113810 shutdown_connections 2024-09-17T01:44:12.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.007+0000 7fbc67000640 1 --2- 172.21.15.42:0/1145113810 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbc40078b90 0x7fbc4007b0a0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:12.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.007+0000 7fbc67000640 1 --2- 172.21.15.42:0/1145113810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc6015eab0 0x7fbc601503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:12.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.007+0000 7fbc67000640 1 --2- 172.21.15.42:0/1145113810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc6014f890 0x7fbc6015e570 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:12.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.007+0000 7fbc67000640 1 --2- 172.21.15.42:0/1145113810 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbc48004d90 0x7fbc601f9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:12.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.007+0000 7fbc67000640 1 -- 172.21.15.42:0/1145113810 >> 172.21.15.42:0/1145113810 conn(0x7fbc600b25f0 msgr2=0x7fbc600cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:12.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.007+0000 7fbc67000640 1 -- 172.21.15.42:0/1145113810 shutdown_connections 2024-09-17T01:44:12.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.007+0000 7fbc67000640 1 -- 172.21.15.42:0/1145113810 wait complete. 2024-09-17T01:44:12.031 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":522,"stamp":"2024-09-17T01:44:11.189856+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":456524,"kb_used_data":16840,"kb_used_omap":12,"kb_used_meta":439475,"kb_avail":754518196,"statfs":{"total":773094113280,"available":772626632704,"internally_reserved":0,"allocated":17244160,"data_stored":8226644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":450022964},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001598"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956942+0000","last_change":"2024-09-17T01:44:07.056949+0000","last_active":"2024-09-17T01:44:08.956942+0000","last_peered":"2024-09-17T01:44:08.956942+0000","last_clean":"2024-09-17T01:44:08.956942+0000","last_became_active":"2024-09-17T01:44:07.056000+0000","last_became_peered":"2024-09-17T01:44:07.056000+0000","last_unstale":"2024-09-17T01:44:08.956942+0000","last_undegraded":"2024-09-17T01:44:08.956942+0000","last_fullsized":"2024-09-17T01:44:08.956942+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:04:35.810368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956869+0000","last_change":"2024-09-17T01:44:07.055661+0000","last_active":"2024-09-17T01:44:08.956869+0000","last_peered":"2024-09-17T01:44:08.956869+0000","last_clean":"2024-09-17T01:44:08.956869+0000","last_became_active":"2024-09-17T01:44:07.053339+0000","last_became_peered":"2024-09-17T01:44:07.053339+0000","last_unstale":"2024-09-17T01:44:08.956869+0000","last_undegraded":"2024-09-17T01:44:08.956869+0000","last_fullsized":"2024-09-17T01:44:08.956869+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:14.421726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956684+0000","last_change":"2024-09-17T01:44:07.069568+0000","last_active":"2024-09-17T01:44:08.956684+0000","last_peered":"2024-09-17T01:44:08.956684+0000","last_clean":"2024-09-17T01:44:08.956684+0000","last_became_active":"2024-09-17T01:44:07.068559+0000","last_became_peered":"2024-09-17T01:44:07.068559+0000","last_unstale":"2024-09-17T01:44:08.956684+0000","last_undegraded":"2024-09-17T01:44:08.956684+0000","last_fullsized":"2024-09-17T01:44:08.956684+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:53.057724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052805+0000","last_change":"2024-09-17T01:44:07.065964+0000","last_active":"2024-09-17T01:44:08.052805+0000","last_peered":"2024-09-17T01:44:08.052805+0000","last_clean":"2024-09-17T01:44:08.052805+0000","last_became_active":"2024-09-17T01:44:07.065253+0000","last_became_peered":"2024-09-17T01:44:07.065253+0000","last_unstale":"2024-09-17T01:44:08.052805+0000","last_undegraded":"2024-09-17T01:44:08.052805+0000","last_fullsized":"2024-09-17T01:44:08.052805+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:33.266656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.051916+0000","last_change":"2024-09-17T01:44:07.060920+0000","last_active":"2024-09-17T01:44:08.051916+0000","last_peered":"2024-09-17T01:44:08.051916+0000","last_clean":"2024-09-17T01:44:08.051916+0000","last_became_active":"2024-09-17T01:44:07.059553+0000","last_became_peered":"2024-09-17T01:44:07.059553+0000","last_unstale":"2024-09-17T01:44:08.051916+0000","last_undegraded":"2024-09-17T01:44:08.051916+0000","last_fullsized":"2024-09-17T01:44:08.051916+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:09.397644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.805802+0000","last_change":"2024-09-17T01:44:07.059762+0000","last_active":"2024-09-17T01:44:08.805802+0000","last_peered":"2024-09-17T01:44:08.805802+0000","last_clean":"2024-09-17T01:44:08.805802+0000","last_became_active":"2024-09-17T01:44:07.058862+0000","last_became_peered":"2024-09-17T01:44:07.058862+0000","last_unstale":"2024-09-17T01:44:08.805802+0000","last_undegraded":"2024-09-17T01:44:08.805802+0000","last_fullsized":"2024-09-17T01:44:08.805802+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:33.076212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.957111+0000","last_change":"2024-09-17T01:44:07.059944+0000","last_active":"2024-09-17T01:44:08.957111+0000","last_peered":"2024-09-17T01:44:08.957111+0000","last_clean":"2024-09-17T01:44:08.957111+0000","last_became_active":"2024-09-17T01:44:07.053740+0000","last_became_peered":"2024-09-17T01:44:07.053740+0000","last_unstale":"2024-09-17T01:44:08.957111+0000","last_undegraded":"2024-09-17T01:44:08.957111+0000","last_fullsized":"2024-09-17T01:44:08.957111+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:26.728809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052775+0000","last_change":"2024-09-17T01:44:07.055022+0000","last_active":"2024-09-17T01:44:08.052775+0000","last_peered":"2024-09-17T01:44:08.052775+0000","last_clean":"2024-09-17T01:44:08.052775+0000","last_became_active":"2024-09-17T01:44:07.054012+0000","last_became_peered":"2024-09-17T01:44:07.054012+0000","last_unstale":"2024-09-17T01:44:08.052775+0000","last_undegraded":"2024-09-17T01:44:08.052775+0000","last_fullsized":"2024-09-17T01:44:08.052775+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:44.216836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.054014+0000","last_change":"2024-09-17T01:44:07.078380+0000","last_active":"2024-09-17T01:44:08.054014+0000","last_peered":"2024-09-17T01:44:08.054014+0000","last_clean":"2024-09-17T01:44:08.054014+0000","last_became_active":"2024-09-17T01:44:07.076672+0000","last_became_peered":"2024-09-17T01:44:07.076672+0000","last_unstale":"2024-09-17T01:44:08.054014+0000","last_undegraded":"2024-09-17T01:44:08.054014+0000","last_fullsized":"2024-09-17T01:44:08.054014+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:27.791518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.053636+0000","last_change":"2024-09-17T01:44:07.065120+0000","last_active":"2024-09-17T01:44:08.053636+0000","last_peered":"2024-09-17T01:44:08.053636+0000","last_clean":"2024-09-17T01:44:08.053636+0000","last_became_active":"2024-09-17T01:44:07.064791+0000","last_became_peered":"2024-09-17T01:44:07.064791+0000","last_unstale":"2024-09-17T01:44:08.053636+0000","last_undegraded":"2024-09-17T01:44:08.053636+0000","last_fullsized":"2024-09-17T01:44:08.053636+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:08.041303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.051932+0000","last_change":"2024-09-17T01:44:07.060491+0000","last_active":"2024-09-17T01:44:08.051932+0000","last_peered":"2024-09-17T01:44:08.051932+0000","last_clean":"2024-09-17T01:44:08.051932+0000","last_became_active":"2024-09-17T01:44:07.059626+0000","last_became_peered":"2024-09-17T01:44:07.059626+0000","last_unstale":"2024-09-17T01:44:08.051932+0000","last_undegraded":"2024-09-17T01:44:08.051932+0000","last_fullsized":"2024-09-17T01:44:08.051932+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:59.090145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.751093+0000","last_change":"2024-09-17T01:44:07.059323+0000","last_active":"2024-09-17T01:44:08.751093+0000","last_peered":"2024-09-17T01:44:08.751093+0000","last_clean":"2024-09-17T01:44:08.751093+0000","last_became_active":"2024-09-17T01:44:07.057787+0000","last_became_peered":"2024-09-17T01:44:07.057787+0000","last_unstale":"2024-09-17T01:44:08.751093+0000","last_undegraded":"2024-09-17T01:44:08.751093+0000","last_fullsized":"2024-09-17T01:44:08.751093+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:42.797495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.751019+0000","last_change":"2024-09-17T01:44:07.059462+0000","last_active":"2024-09-17T01:44:08.751019+0000","last_peered":"2024-09-17T01:44:08.751019+0000","last_clean":"2024-09-17T01:44:08.751019+0000","last_became_active":"2024-09-17T01:44:07.059109+0000","last_became_peered":"2024-09-17T01:44:07.059109+0000","last_unstale":"2024-09-17T01:44:08.751019+0000","last_undegraded":"2024-09-17T01:44:08.751019+0000","last_fullsized":"2024-09-17T01:44:08.751019+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:22.914102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052715+0000","last_change":"2024-09-17T01:44:07.068602+0000","last_active":"2024-09-17T01:44:08.052715+0000","last_peered":"2024-09-17T01:44:08.052715+0000","last_clean":"2024-09-17T01:44:08.052715+0000","last_became_active":"2024-09-17T01:44:07.068270+0000","last_became_peered":"2024-09-17T01:44:07.068270+0000","last_unstale":"2024-09-17T01:44:08.052715+0000","last_undegraded":"2024-09-17T01:44:08.052715+0000","last_fullsized":"2024-09-17T01:44:08.052715+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:13.435546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052649+0000","last_change":"2024-09-17T01:44:07.063045+0000","last_active":"2024-09-17T01:44:08.052649+0000","last_peered":"2024-09-17T01:44:08.052649+0000","last_clean":"2024-09-17T01:44:08.052649+0000","last_became_active":"2024-09-17T01:44:07.062424+0000","last_became_peered":"2024-09-17T01:44:07.062424+0000","last_unstale":"2024-09-17T01:44:08.052649+0000","last_undegraded":"2024-09-17T01:44:08.052649+0000","last_fullsized":"2024-09-17T01:44:08.052649+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:42.406315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956827+0000","last_change":"2024-09-17T01:44:07.056300+0000","last_active":"2024-09-17T01:44:08.956827+0000","last_peered":"2024-09-17T01:44:08.956827+0000","last_clean":"2024-09-17T01:44:08.956827+0000","last_became_active":"2024-09-17T01:44:07.054575+0000","last_became_peered":"2024-09-17T01:44:07.054575+0000","last_unstale":"2024-09-17T01:44:08.956827+0000","last_undegraded":"2024-09-17T01:44:08.956827+0000","last_fullsized":"2024-09-17T01:44:08.956827+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:55:03.619819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.806269+0000","last_change":"2024-09-17T01:44:07.064387+0000","last_active":"2024-09-17T01:44:08.806269+0000","last_peered":"2024-09-17T01:44:08.806269+0000","last_clean":"2024-09-17T01:44:08.806269+0000","last_became_active":"2024-09-17T01:44:07.064011+0000","last_became_peered":"2024-09-17T01:44:07.064011+0000","last_unstale":"2024-09-17T01:44:08.806269+0000","last_undegraded":"2024-09-17T01:44:08.806269+0000","last_fullsized":"2024-09-17T01:44:08.806269+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:44.586467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052889+0000","last_change":"2024-09-17T01:44:07.062809+0000","last_active":"2024-09-17T01:44:08.052889+0000","last_peered":"2024-09-17T01:44:08.052889+0000","last_clean":"2024-09-17T01:44:08.052889+0000","last_became_active":"2024-09-17T01:44:07.062486+0000","last_became_peered":"2024-09-17T01:44:07.062486+0000","last_unstale":"2024-09-17T01:44:08.052889+0000","last_undegraded":"2024-09-17T01:44:08.052889+0000","last_fullsized":"2024-09-17T01:44:08.052889+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:44:00.023467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.957475+0000","last_change":"2024-09-17T01:44:07.074402+0000","last_active":"2024-09-17T01:44:08.957475+0000","last_peered":"2024-09-17T01:44:08.957475+0000","last_clean":"2024-09-17T01:44:08.957475+0000","last_became_active":"2024-09-17T01:44:07.074042+0000","last_became_peered":"2024-09-17T01:44:07.074042+0000","last_unstale":"2024-09-17T01:44:08.957475+0000","last_undegraded":"2024-09-17T01:44:08.957475+0000","last_fullsized":"2024-09-17T01:44:08.957475+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:38.027875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.751190+0000","last_change":"2024-09-17T01:44:07.068958+0000","last_active":"2024-09-17T01:44:08.751190+0000","last_peered":"2024-09-17T01:44:08.751190+0000","last_clean":"2024-09-17T01:44:08.751190+0000","last_became_active":"2024-09-17T01:44:07.068629+0000","last_became_peered":"2024-09-17T01:44:07.068629+0000","last_unstale":"2024-09-17T01:44:08.751190+0000","last_undegraded":"2024-09-17T01:44:08.751190+0000","last_fullsized":"2024-09-17T01:44:08.751190+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:52.042531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.805850+0000","last_change":"2024-09-17T01:44:07.071434+0000","last_active":"2024-09-17T01:44:08.805850+0000","last_peered":"2024-09-17T01:44:08.805850+0000","last_clean":"2024-09-17T01:44:08.805850+0000","last_became_active":"2024-09-17T01:44:07.071098+0000","last_became_peered":"2024-09-17T01:44:07.071098+0000","last_unstale":"2024-09-17T01:44:08.805850+0000","last_undegraded":"2024-09-17T01:44:08.805850+0000","last_fullsized":"2024-09-17T01:44:08.805850+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:45:55.446731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.051514+0000","last_change":"2024-09-17T01:44:07.062922+0000","last_active":"2024-09-17T01:44:08.051514+0000","last_peered":"2024-09-17T01:44:08.051514+0000","last_clean":"2024-09-17T01:44:08.051514+0000","last_became_active":"2024-09-17T01:44:07.062527+0000","last_became_peered":"2024-09-17T01:44:07.062527+0000","last_unstale":"2024-09-17T01:44:08.051514+0000","last_undegraded":"2024-09-17T01:44:08.051514+0000","last_fullsized":"2024-09-17T01:44:08.051514+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:09.266678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.063298+0000","last_change":"2024-09-17T01:44:07.073949+0000","last_active":"2024-09-17T01:44:08.063298+0000","last_peered":"2024-09-17T01:44:08.063298+0000","last_clean":"2024-09-17T01:44:08.063298+0000","last_became_active":"2024-09-17T01:44:07.073607+0000","last_became_peered":"2024-09-17T01:44:07.073607+0000","last_unstale":"2024-09-17T01:44:08.063298+0000","last_undegraded":"2024-09-17T01:44:08.063298+0000","last_fullsized":"2024-09-17T01:44:08.063298+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:43.757898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.051190+0000","last_change":"2024-09-17T01:44:07.057969+0000","last_active":"2024-09-17T01:44:08.051190+0000","last_peered":"2024-09-17T01:44:08.051190+0000","last_clean":"2024-09-17T01:44:08.051190+0000","last_became_active":"2024-09-17T01:44:07.056864+0000","last_became_peered":"2024-09-17T01:44:07.056864+0000","last_unstale":"2024-09-17T01:44:08.051190+0000","last_undegraded":"2024-09-17T01:44:08.051190+0000","last_fullsized":"2024-09-17T01:44:08.051190+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:58:20.599660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.051538+0000","last_change":"2024-09-17T01:44:07.065532+0000","last_active":"2024-09-17T01:44:08.051538+0000","last_peered":"2024-09-17T01:44:08.051538+0000","last_clean":"2024-09-17T01:44:08.051538+0000","last_became_active":"2024-09-17T01:44:07.065213+0000","last_became_peered":"2024-09-17T01:44:07.065213+0000","last_unstale":"2024-09-17T01:44:08.051538+0000","last_undegraded":"2024-09-17T01:44:08.051538+0000","last_fullsized":"2024-09-17T01:44:08.051538+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:55.316296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.063763+0000","last_change":"2024-09-17T01:44:07.064555+0000","last_active":"2024-09-17T01:44:08.063763+0000","last_peered":"2024-09-17T01:44:08.063763+0000","last_clean":"2024-09-17T01:44:08.063763+0000","last_became_active":"2024-09-17T01:44:07.061010+0000","last_became_peered":"2024-09-17T01:44:07.061010+0000","last_unstale":"2024-09-17T01:44:08.063763+0000","last_undegraded":"2024-09-17T01:44:08.063763+0000","last_fullsized":"2024-09-17T01:44:08.063763+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:15.904864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052024+0000","last_change":"2024-09-17T01:44:07.060855+0000","last_active":"2024-09-17T01:44:08.052024+0000","last_peered":"2024-09-17T01:44:08.052024+0000","last_clean":"2024-09-17T01:44:08.052024+0000","last_became_active":"2024-09-17T01:44:07.060134+0000","last_became_peered":"2024-09-17T01:44:07.060134+0000","last_unstale":"2024-09-17T01:44:08.052024+0000","last_undegraded":"2024-09-17T01:44:08.052024+0000","last_fullsized":"2024-09-17T01:44:08.052024+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:32:46.666818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.957492+0000","last_change":"2024-09-17T01:44:07.063911+0000","last_active":"2024-09-17T01:44:08.957492+0000","last_peered":"2024-09-17T01:44:08.957492+0000","last_clean":"2024-09-17T01:44:08.957492+0000","last_became_active":"2024-09-17T01:44:07.063480+0000","last_became_peered":"2024-09-17T01:44:07.063480+0000","last_unstale":"2024-09-17T01:44:08.957492+0000","last_undegraded":"2024-09-17T01:44:08.957492+0000","last_fullsized":"2024-09-17T01:44:08.957492+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:07.410131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956367+0000","last_change":"2024-09-17T01:44:07.073549+0000","last_active":"2024-09-17T01:44:08.956367+0000","last_peered":"2024-09-17T01:44:08.956367+0000","last_clean":"2024-09-17T01:44:08.956367+0000","last_became_active":"2024-09-17T01:44:07.073255+0000","last_became_peered":"2024-09-17T01:44:07.073255+0000","last_unstale":"2024-09-17T01:44:08.956367+0000","last_undegraded":"2024-09-17T01:44:08.956367+0000","last_fullsized":"2024-09-17T01:44:08.956367+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:59.473400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052908+0000","last_change":"2024-09-17T01:44:07.069810+0000","last_active":"2024-09-17T01:44:08.052908+0000","last_peered":"2024-09-17T01:44:08.052908+0000","last_clean":"2024-09-17T01:44:08.052908+0000","last_became_active":"2024-09-17T01:44:07.069485+0000","last_became_peered":"2024-09-17T01:44:07.069485+0000","last_unstale":"2024-09-17T01:44:08.052908+0000","last_undegraded":"2024-09-17T01:44:08.052908+0000","last_fullsized":"2024-09-17T01:44:08.052908+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:24.906782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956377+0000","last_change":"2024-09-17T01:44:07.054155+0000","last_active":"2024-09-17T01:44:08.956377+0000","last_peered":"2024-09-17T01:44:08.956377+0000","last_clean":"2024-09-17T01:44:08.956377+0000","last_became_active":"2024-09-17T01:44:07.052587+0000","last_became_peered":"2024-09-17T01:44:07.052587+0000","last_unstale":"2024-09-17T01:44:08.956377+0000","last_undegraded":"2024-09-17T01:44:08.956377+0000","last_fullsized":"2024-09-17T01:44:08.956377+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:42.694787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.806184+0000","last_change":"2024-09-17T01:44:07.077859+0000","last_active":"2024-09-17T01:44:08.806184+0000","last_peered":"2024-09-17T01:44:08.806184+0000","last_clean":"2024-09-17T01:44:08.806184+0000","last_became_active":"2024-09-17T01:44:07.077504+0000","last_became_peered":"2024-09-17T01:44:07.077504+0000","last_unstale":"2024-09-17T01:44:08.806184+0000","last_undegraded":"2024-09-17T01:44:08.806184+0000","last_fullsized":"2024-09-17T01:44:08.806184+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:39.167825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052904+0000","last_change":"2024-09-17T01:44:07.073916+0000","last_active":"2024-09-17T01:44:08.052904+0000","last_peered":"2024-09-17T01:44:08.052904+0000","last_clean":"2024-09-17T01:44:08.052904+0000","last_became_active":"2024-09-17T01:44:07.073550+0000","last_became_peered":"2024-09-17T01:44:07.073550+0000","last_unstale":"2024-09-17T01:44:08.052904+0000","last_undegraded":"2024-09-17T01:44:08.052904+0000","last_fullsized":"2024-09-17T01:44:08.052904+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:39.375581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"159'4","reported_seq":19,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.957010+0000","last_change":"2024-09-17T01:44:06.063856+0000","last_active":"2024-09-17T01:44:08.957010+0000","last_peered":"2024-09-17T01:44:08.957010+0000","last_clean":"2024-09-17T01:44:08.957010+0000","last_became_active":"2024-09-17T01:44:06.063513+0000","last_became_peered":"2024-09-17T01:44:06.063513+0000","last_unstale":"2024-09-17T01:44:08.957010+0000","last_undegraded":"2024-09-17T01:44:08.957010+0000","last_fullsized":"2024-09-17T01:44:08.957010+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:33:17.282659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956959+0000","last_change":"2024-09-17T01:44:07.070683+0000","last_active":"2024-09-17T01:44:08.956959+0000","last_peered":"2024-09-17T01:44:08.956959+0000","last_clean":"2024-09-17T01:44:08.956959+0000","last_became_active":"2024-09-17T01:44:07.070335+0000","last_became_peered":"2024-09-17T01:44:07.070335+0000","last_unstale":"2024-09-17T01:44:08.956959+0000","last_undegraded":"2024-09-17T01:44:08.956959+0000","last_fullsized":"2024-09-17T01:44:08.956959+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:30.264212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"159'1","reported_seq":16,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.053825+0000","last_change":"2024-09-17T01:44:06.058625+0000","last_active":"2024-09-17T01:44:08.053825+0000","last_peered":"2024-09-17T01:44:08.053825+0000","last_clean":"2024-09-17T01:44:08.053825+0000","last_became_active":"2024-09-17T01:44:06.058268+0000","last_became_peered":"2024-09-17T01:44:06.058268+0000","last_unstale":"2024-09-17T01:44:08.053825+0000","last_undegraded":"2024-09-17T01:44:08.053825+0000","last_fullsized":"2024-09-17T01:44:08.053825+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:40.853304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.805903+0000","last_change":"2024-09-17T01:44:07.071609+0000","last_active":"2024-09-17T01:44:08.805903+0000","last_peered":"2024-09-17T01:44:08.805903+0000","last_clean":"2024-09-17T01:44:08.805903+0000","last_became_active":"2024-09-17T01:44:07.071259+0000","last_became_peered":"2024-09-17T01:44:07.071259+0000","last_unstale":"2024-09-17T01:44:08.805903+0000","last_undegraded":"2024-09-17T01:44:08.805903+0000","last_fullsized":"2024-09-17T01:44:08.805903+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:26.852889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1d","version":"159'2","reported_seq":17,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.805991+0000","last_change":"2024-09-17T01:44:06.056357+0000","last_active":"2024-09-17T01:44:08.805991+0000","last_peered":"2024-09-17T01:44:08.805991+0000","last_clean":"2024-09-17T01:44:08.805991+0000","last_became_active":"2024-09-17T01:44:06.056044+0000","last_became_peered":"2024-09-17T01:44:06.056044+0000","last_unstale":"2024-09-17T01:44:08.805991+0000","last_undegraded":"2024-09-17T01:44:08.805991+0000","last_fullsized":"2024-09-17T01:44:08.805991+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:42.463174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.053478+0000","last_change":"2024-09-17T01:44:07.058955+0000","last_active":"2024-09-17T01:44:08.053478+0000","last_peered":"2024-09-17T01:44:08.053478+0000","last_clean":"2024-09-17T01:44:08.053478+0000","last_became_active":"2024-09-17T01:44:07.058665+0000","last_became_peered":"2024-09-17T01:44:07.058665+0000","last_unstale":"2024-09-17T01:44:08.053478+0000","last_undegraded":"2024-09-17T01:44:08.053478+0000","last_fullsized":"2024-09-17T01:44:08.053478+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:44.986085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"159'2","reported_seq":17,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.063337+0000","last_change":"2024-09-17T01:44:06.059041+0000","last_active":"2024-09-17T01:44:08.063337+0000","last_peered":"2024-09-17T01:44:08.063337+0000","last_clean":"2024-09-17T01:44:08.063337+0000","last_became_active":"2024-09-17T01:44:06.058214+0000","last_became_peered":"2024-09-17T01:44:06.058214+0000","last_unstale":"2024-09-17T01:44:08.063337+0000","last_undegraded":"2024-09-17T01:44:08.063337+0000","last_fullsized":"2024-09-17T01:44:08.063337+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:41.001043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052458+0000","last_change":"2024-09-17T01:44:07.052280+0000","last_active":"2024-09-17T01:44:08.052458+0000","last_peered":"2024-09-17T01:44:08.052458+0000","last_clean":"2024-09-17T01:44:08.052458+0000","last_became_active":"2024-09-17T01:44:07.051919+0000","last_became_peered":"2024-09-17T01:44:07.051919+0000","last_unstale":"2024-09-17T01:44:08.052458+0000","last_undegraded":"2024-09-17T01:44:08.052458+0000","last_fullsized":"2024-09-17T01:44:08.052458+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:46:07.361501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1b","version":"159'1","reported_seq":16,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956500+0000","last_change":"2024-09-17T01:44:06.065877+0000","last_active":"2024-09-17T01:44:08.956500+0000","last_peered":"2024-09-17T01:44:08.956500+0000","last_clean":"2024-09-17T01:44:08.956500+0000","last_became_active":"2024-09-17T01:44:06.065297+0000","last_became_peered":"2024-09-17T01:44:06.065297+0000","last_unstale":"2024-09-17T01:44:08.956500+0000","last_undegraded":"2024-09-17T01:44:08.956500+0000","last_fullsized":"2024-09-17T01:44:08.956500+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:34.299332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.805823+0000","last_change":"2024-09-17T01:44:07.077934+0000","last_active":"2024-09-17T01:44:08.805823+0000","last_peered":"2024-09-17T01:44:08.805823+0000","last_clean":"2024-09-17T01:44:08.805823+0000","last_became_active":"2024-09-17T01:44:07.076733+0000","last_became_peered":"2024-09-17T01:44:07.076733+0000","last_unstale":"2024-09-17T01:44:08.805823+0000","last_undegraded":"2024-09-17T01:44:08.805823+0000","last_fullsized":"2024-09-17T01:44:08.805823+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:18.004388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"159'1","reported_seq":16,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052427+0000","last_change":"2024-09-17T01:44:06.066094+0000","last_active":"2024-09-17T01:44:08.052427+0000","last_peered":"2024-09-17T01:44:08.052427+0000","last_clean":"2024-09-17T01:44:08.052427+0000","last_became_active":"2024-09-17T01:44:06.065584+0000","last_became_peered":"2024-09-17T01:44:06.065584+0000","last_unstale":"2024-09-17T01:44:08.052427+0000","last_undegraded":"2024-09-17T01:44:08.052427+0000","last_fullsized":"2024-09-17T01:44:08.052427+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:30.925985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.063324+0000","last_change":"2024-09-17T01:44:07.060010+0000","last_active":"2024-09-17T01:44:08.063324+0000","last_peered":"2024-09-17T01:44:08.063324+0000","last_clean":"2024-09-17T01:44:08.063324+0000","last_became_active":"2024-09-17T01:44:07.058480+0000","last_became_peered":"2024-09-17T01:44:07.058480+0000","last_unstale":"2024-09-17T01:44:08.063324+0000","last_undegraded":"2024-09-17T01:44:08.063324+0000","last_fullsized":"2024-09-17T01:44:08.063324+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:43.693214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956368+0000","last_change":"2024-09-17T01:44:06.063878+0000","last_active":"2024-09-17T01:44:08.956368+0000","last_peered":"2024-09-17T01:44:08.956368+0000","last_clean":"2024-09-17T01:44:08.956368+0000","last_became_active":"2024-09-17T01:44:06.063544+0000","last_became_peered":"2024-09-17T01:44:06.063544+0000","last_unstale":"2024-09-17T01:44:08.956368+0000","last_undegraded":"2024-09-17T01:44:08.956368+0000","last_fullsized":"2024-09-17T01:44:08.956368+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:29.035499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052279+0000","last_change":"2024-09-17T01:44:07.071044+0000","last_active":"2024-09-17T01:44:08.052279+0000","last_peered":"2024-09-17T01:44:08.052279+0000","last_clean":"2024-09-17T01:44:08.052279+0000","last_became_active":"2024-09-17T01:44:07.070714+0000","last_became_peered":"2024-09-17T01:44:07.070714+0000","last_unstale":"2024-09-17T01:44:08.052279+0000","last_undegraded":"2024-09-17T01:44:08.052279+0000","last_fullsized":"2024-09-17T01:44:08.052279+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:04.124920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.062971+0000","last_change":"2024-09-17T01:44:06.052770+0000","last_active":"2024-09-17T01:44:08.062971+0000","last_peered":"2024-09-17T01:44:08.062971+0000","last_clean":"2024-09-17T01:44:08.062971+0000","last_became_active":"2024-09-17T01:44:06.052422+0000","last_became_peered":"2024-09-17T01:44:06.052422+0000","last_unstale":"2024-09-17T01:44:08.062971+0000","last_undegraded":"2024-09-17T01:44:08.062971+0000","last_fullsized":"2024-09-17T01:44:08.062971+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:28.734087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.957329+0000","last_change":"2024-09-17T01:44:07.061550+0000","last_active":"2024-09-17T01:44:08.957329+0000","last_peered":"2024-09-17T01:44:08.957329+0000","last_clean":"2024-09-17T01:44:08.957329+0000","last_became_active":"2024-09-17T01:44:07.061209+0000","last_became_peered":"2024-09-17T01:44:07.061209+0000","last_unstale":"2024-09-17T01:44:08.957329+0000","last_undegraded":"2024-09-17T01:44:08.957329+0000","last_fullsized":"2024-09-17T01:44:08.957329+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:23.166764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.806296+0000","last_change":"2024-09-17T01:44:06.066408+0000","last_active":"2024-09-17T01:44:08.806296+0000","last_peered":"2024-09-17T01:44:08.806296+0000","last_clean":"2024-09-17T01:44:08.806296+0000","last_became_active":"2024-09-17T01:44:06.065968+0000","last_became_peered":"2024-09-17T01:44:06.065968+0000","last_unstale":"2024-09-17T01:44:08.806296+0000","last_undegraded":"2024-09-17T01:44:08.806296+0000","last_fullsized":"2024-09-17T01:44:08.806296+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:31.359967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.957424+0000","last_change":"2024-09-17T01:44:07.059461+0000","last_active":"2024-09-17T01:44:08.957424+0000","last_peered":"2024-09-17T01:44:08.957424+0000","last_clean":"2024-09-17T01:44:08.957424+0000","last_became_active":"2024-09-17T01:44:07.059056+0000","last_became_peered":"2024-09-17T01:44:07.059056+0000","last_unstale":"2024-09-17T01:44:08.957424+0000","last_undegraded":"2024-09-17T01:44:08.957424+0000","last_fullsized":"2024-09-17T01:44:08.957424+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:20.096759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.15","version":"159'3","reported_seq":18,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.063547+0000","last_change":"2024-09-17T01:44:06.058705+0000","last_active":"2024-09-17T01:44:08.063547+0000","last_peered":"2024-09-17T01:44:08.063547+0000","last_clean":"2024-09-17T01:44:08.063547+0000","last_became_active":"2024-09-17T01:44:06.058279+0000","last_became_peered":"2024-09-17T01:44:06.058279+0000","last_unstale":"2024-09-17T01:44:08.063547+0000","last_undegraded":"2024-09-17T01:44:08.063547+0000","last_fullsized":"2024-09-17T01:44:08.063547+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:58:08.665454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956714+0000","last_change":"2024-09-17T01:44:07.072446+0000","last_active":"2024-09-17T01:44:08.956714+0000","last_peered":"2024-09-17T01:44:08.956714+0000","last_clean":"2024-09-17T01:44:08.956714+0000","last_became_active":"2024-09-17T01:44:07.072101+0000","last_became_peered":"2024-09-17T01:44:07.072101+0000","last_unstale":"2024-09-17T01:44:08.956714+0000","last_undegraded":"2024-09-17T01:44:08.956714+0000","last_fullsized":"2024-09-17T01:44:08.956714+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:16.213903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"159'6","reported_seq":21,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.051485+0000","last_change":"2024-09-17T01:44:06.049256+0000","last_active":"2024-09-17T01:44:08.051485+0000","last_peered":"2024-09-17T01:44:08.051485+0000","last_clean":"2024-09-17T01:44:08.051485+0000","last_became_active":"2024-09-17T01:44:06.047272+0000","last_became_peered":"2024-09-17T01:44:06.047272+0000","last_unstale":"2024-09-17T01:44:08.051485+0000","last_undegraded":"2024-09-17T01:44:08.051485+0000","last_fullsized":"2024-09-17T01:44:08.051485+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:49.444685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.957258+0000","last_change":"2024-09-17T01:44:07.057968+0000","last_active":"2024-09-17T01:44:08.957258+0000","last_peered":"2024-09-17T01:44:08.957258+0000","last_clean":"2024-09-17T01:44:08.957258+0000","last_became_active":"2024-09-17T01:44:07.057576+0000","last_became_peered":"2024-09-17T01:44:07.057576+0000","last_unstale":"2024-09-17T01:44:08.957258+0000","last_undegraded":"2024-09-17T01:44:08.957258+0000","last_fullsized":"2024-09-17T01:44:08.957258+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:44.257666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"159'2","reported_seq":17,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052527+0000","last_change":"2024-09-17T01:44:06.047448+0000","last_active":"2024-09-17T01:44:08.052527+0000","last_peered":"2024-09-17T01:44:08.052527+0000","last_clean":"2024-09-17T01:44:08.052527+0000","last_became_active":"2024-09-17T01:44:06.047074+0000","last_became_peered":"2024-09-17T01:44:06.047074+0000","last_unstale":"2024-09-17T01:44:08.052527+0000","last_undegraded":"2024-09-17T01:44:08.052527+0000","last_fullsized":"2024-09-17T01:44:08.052527+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:17.653960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.063391+0000","last_change":"2024-09-17T01:44:07.069468+0000","last_active":"2024-09-17T01:44:08.063391+0000","last_peered":"2024-09-17T01:44:08.063391+0000","last_clean":"2024-09-17T01:44:08.063391+0000","last_became_active":"2024-09-17T01:44:07.068998+0000","last_became_peered":"2024-09-17T01:44:07.068998+0000","last_unstale":"2024-09-17T01:44:08.063391+0000","last_undegraded":"2024-09-17T01:44:08.063391+0000","last_fullsized":"2024-09-17T01:44:08.063391+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:11.574732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.806147+0000","last_change":"2024-09-17T01:44:06.055750+0000","last_active":"2024-09-17T01:44:08.806147+0000","last_peered":"2024-09-17T01:44:08.806147+0000","last_clean":"2024-09-17T01:44:08.806147+0000","last_became_active":"2024-09-17T01:44:06.054989+0000","last_became_peered":"2024-09-17T01:44:06.054989+0000","last_unstale":"2024-09-17T01:44:08.806147+0000","last_undegraded":"2024-09-17T01:44:08.806147+0000","last_fullsized":"2024-09-17T01:44:08.806147+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:23.696085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.805792+0000","last_change":"2024-09-17T01:44:07.075995+0000","last_active":"2024-09-17T01:44:08.805792+0000","last_peered":"2024-09-17T01:44:08.805792+0000","last_clean":"2024-09-17T01:44:08.805792+0000","last_became_active":"2024-09-17T01:44:07.074910+0000","last_became_peered":"2024-09-17T01:44:07.074910+0000","last_unstale":"2024-09-17T01:44:08.805792+0000","last_undegraded":"2024-09-17T01:44:08.805792+0000","last_fullsized":"2024-09-17T01:44:08.805792+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:16.913340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.957140+0000","last_change":"2024-09-17T01:44:06.058872+0000","last_active":"2024-09-17T01:44:08.957140+0000","last_peered":"2024-09-17T01:44:08.957140+0000","last_clean":"2024-09-17T01:44:08.957140+0000","last_became_active":"2024-09-17T01:44:06.058100+0000","last_became_peered":"2024-09-17T01:44:06.058100+0000","last_unstale":"2024-09-17T01:44:08.957140+0000","last_undegraded":"2024-09-17T01:44:08.957140+0000","last_fullsized":"2024-09-17T01:44:08.957140+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:31:16.751459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052648+0000","last_change":"2024-09-17T01:44:07.071686+0000","last_active":"2024-09-17T01:44:08.052648+0000","last_peered":"2024-09-17T01:44:08.052648+0000","last_clean":"2024-09-17T01:44:08.052648+0000","last_became_active":"2024-09-17T01:44:07.070532+0000","last_became_peered":"2024-09-17T01:44:07.070532+0000","last_unstale":"2024-09-17T01:44:08.052648+0000","last_undegraded":"2024-09-17T01:44:08.052648+0000","last_fullsized":"2024-09-17T01:44:08.052648+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:55.941343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"159'8","reported_seq":23,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.051155+0000","last_change":"2024-09-17T01:44:06.052261+0000","last_active":"2024-09-17T01:44:08.051155+0000","last_peered":"2024-09-17T01:44:08.051155+0000","last_clean":"2024-09-17T01:44:08.051155+0000","last_became_active":"2024-09-17T01:44:06.048839+0000","last_became_peered":"2024-09-17T01:44:06.048839+0000","last_unstale":"2024-09-17T01:44:08.051155+0000","last_undegraded":"2024-09-17T01:44:08.051155+0000","last_fullsized":"2024-09-17T01:44:08.051155+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:38.101410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.957485+0000","last_change":"2024-09-17T01:44:07.069986+0000","last_active":"2024-09-17T01:44:08.957485+0000","last_peered":"2024-09-17T01:44:08.957485+0000","last_clean":"2024-09-17T01:44:08.957485+0000","last_became_active":"2024-09-17T01:44:07.069636+0000","last_became_peered":"2024-09-17T01:44:07.069636+0000","last_unstale":"2024-09-17T01:44:08.957485+0000","last_undegraded":"2024-09-17T01:44:08.957485+0000","last_fullsized":"2024-09-17T01:44:08.957485+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:14.075149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"159'1","reported_seq":16,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.051928+0000","last_change":"2024-09-17T01:44:06.048474+0000","last_active":"2024-09-17T01:44:08.051928+0000","last_peered":"2024-09-17T01:44:08.051928+0000","last_clean":"2024-09-17T01:44:08.051928+0000","last_became_active":"2024-09-17T01:44:06.048093+0000","last_became_peered":"2024-09-17T01:44:06.048093+0000","last_unstale":"2024-09-17T01:44:08.051928+0000","last_undegraded":"2024-09-17T01:44:08.051928+0000","last_fullsized":"2024-09-17T01:44:08.051928+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:22.123898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.053243+0000","last_change":"2024-09-17T01:44:07.072403+0000","last_active":"2024-09-17T01:44:08.053243+0000","last_peered":"2024-09-17T01:44:08.053243+0000","last_clean":"2024-09-17T01:44:08.053243+0000","last_became_active":"2024-09-17T01:44:07.072098+0000","last_became_peered":"2024-09-17T01:44:07.072098+0000","last_unstale":"2024-09-17T01:44:08.053243+0000","last_undegraded":"2024-09-17T01:44:08.053243+0000","last_fullsized":"2024-09-17T01:44:08.053243+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:18.100268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.e","version":"159'2","reported_seq":17,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.053830+0000","last_change":"2024-09-17T01:44:06.059420+0000","last_active":"2024-09-17T01:44:08.053830+0000","last_peered":"2024-09-17T01:44:08.053830+0000","last_clean":"2024-09-17T01:44:08.053830+0000","last_became_active":"2024-09-17T01:44:06.059101+0000","last_became_peered":"2024-09-17T01:44:06.059101+0000","last_unstale":"2024-09-17T01:44:08.053830+0000","last_undegraded":"2024-09-17T01:44:08.053830+0000","last_fullsized":"2024-09-17T01:44:08.053830+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:15.910241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.053087+0000","last_change":"2024-09-17T01:44:07.067227+0000","last_active":"2024-09-17T01:44:08.053087+0000","last_peered":"2024-09-17T01:44:08.053087+0000","last_clean":"2024-09-17T01:44:08.053087+0000","last_became_active":"2024-09-17T01:44:07.058937+0000","last_became_peered":"2024-09-17T01:44:07.058937+0000","last_unstale":"2024-09-17T01:44:08.053087+0000","last_undegraded":"2024-09-17T01:44:08.053087+0000","last_fullsized":"2024-09-17T01:44:08.053087+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:17.474743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.d","version":"159'1","reported_seq":16,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052041+0000","last_change":"2024-09-17T01:44:06.063895+0000","last_active":"2024-09-17T01:44:08.052041+0000","last_peered":"2024-09-17T01:44:08.052041+0000","last_clean":"2024-09-17T01:44:08.052041+0000","last_became_active":"2024-09-17T01:44:06.063199+0000","last_became_peered":"2024-09-17T01:44:06.063199+0000","last_unstale":"2024-09-17T01:44:08.052041+0000","last_undegraded":"2024-09-17T01:44:08.052041+0000","last_fullsized":"2024-09-17T01:44:08.052041+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:23.762189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.063649+0000","last_change":"2024-09-17T01:44:07.080205+0000","last_active":"2024-09-17T01:44:08.063649+0000","last_peered":"2024-09-17T01:44:08.063649+0000","last_clean":"2024-09-17T01:44:08.063649+0000","last_became_active":"2024-09-17T01:44:07.079889+0000","last_became_peered":"2024-09-17T01:44:07.079889+0000","last_unstale":"2024-09-17T01:44:08.063649+0000","last_undegraded":"2024-09-17T01:44:08.063649+0000","last_fullsized":"2024-09-17T01:44:08.063649+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:55.769410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.751165+0000","last_change":"2024-09-17T01:44:06.049664+0000","last_active":"2024-09-17T01:44:08.751165+0000","last_peered":"2024-09-17T01:44:08.751165+0000","last_clean":"2024-09-17T01:44:08.751165+0000","last_became_active":"2024-09-17T01:44:06.048649+0000","last_became_peered":"2024-09-17T01:44:06.048649+0000","last_unstale":"2024-09-17T01:44:08.751165+0000","last_undegraded":"2024-09-17T01:44:08.751165+0000","last_fullsized":"2024-09-17T01:44:08.751165+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:39.411816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956483+0000","last_change":"2024-09-17T01:44:07.053845+0000","last_active":"2024-09-17T01:44:08.956483+0000","last_peered":"2024-09-17T01:44:08.956483+0000","last_clean":"2024-09-17T01:44:08.956483+0000","last_became_active":"2024-09-17T01:44:07.052644+0000","last_became_peered":"2024-09-17T01:44:07.052644+0000","last_unstale":"2024-09-17T01:44:08.956483+0000","last_undegraded":"2024-09-17T01:44:08.956483+0000","last_fullsized":"2024-09-17T01:44:08.956483+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:07.089616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"159'2","reported_seq":17,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.063559+0000","last_change":"2024-09-17T01:44:06.057365+0000","last_active":"2024-09-17T01:44:08.063559+0000","last_peered":"2024-09-17T01:44:08.063559+0000","last_clean":"2024-09-17T01:44:08.063559+0000","last_became_active":"2024-09-17T01:44:06.056755+0000","last_became_peered":"2024-09-17T01:44:06.056755+0000","last_unstale":"2024-09-17T01:44:08.063559+0000","last_undegraded":"2024-09-17T01:44:08.063559+0000","last_fullsized":"2024-09-17T01:44:08.063559+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:55.382179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.063415+0000","last_change":"2024-09-17T01:44:07.064923+0000","last_active":"2024-09-17T01:44:08.063415+0000","last_peered":"2024-09-17T01:44:08.063415+0000","last_clean":"2024-09-17T01:44:08.063415+0000","last_became_active":"2024-09-17T01:44:07.063318+0000","last_became_peered":"2024-09-17T01:44:07.063318+0000","last_unstale":"2024-09-17T01:44:08.063415+0000","last_undegraded":"2024-09-17T01:44:08.063415+0000","last_fullsized":"2024-09-17T01:44:08.063415+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:47.471862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.750852+0000","last_change":"2024-09-17T01:44:06.057558+0000","last_active":"2024-09-17T01:44:08.750852+0000","last_peered":"2024-09-17T01:44:08.750852+0000","last_clean":"2024-09-17T01:44:08.750852+0000","last_became_active":"2024-09-17T01:44:06.056268+0000","last_became_peered":"2024-09-17T01:44:06.056268+0000","last_unstale":"2024-09-17T01:44:08.750852+0000","last_undegraded":"2024-09-17T01:44:08.750852+0000","last_fullsized":"2024-09-17T01:44:08.750852+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:39.846868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956190+0000","last_change":"2024-09-17T01:44:07.047859+0000","last_active":"2024-09-17T01:44:08.956190+0000","last_peered":"2024-09-17T01:44:08.956190+0000","last_clean":"2024-09-17T01:44:08.956190+0000","last_became_active":"2024-09-17T01:44:07.047515+0000","last_became_peered":"2024-09-17T01:44:07.047515+0000","last_unstale":"2024-09-17T01:44:08.956190+0000","last_undegraded":"2024-09-17T01:44:08.956190+0000","last_fullsized":"2024-09-17T01:44:08.956190+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:28:16.059989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052262+0000","last_change":"2024-09-17T01:44:06.066340+0000","last_active":"2024-09-17T01:44:08.052262+0000","last_peered":"2024-09-17T01:44:08.052262+0000","last_clean":"2024-09-17T01:44:08.052262+0000","last_became_active":"2024-09-17T01:44:06.065528+0000","last_became_peered":"2024-09-17T01:44:06.065528+0000","last_unstale":"2024-09-17T01:44:08.052262+0000","last_undegraded":"2024-09-17T01:44:08.052262+0000","last_fullsized":"2024-09-17T01:44:08.052262+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:13.037794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956983+0000","last_change":"2024-09-17T01:44:07.061163+0000","last_active":"2024-09-17T01:44:08.956983+0000","last_peered":"2024-09-17T01:44:08.956983+0000","last_clean":"2024-09-17T01:44:08.956983+0000","last_became_active":"2024-09-17T01:44:07.060788+0000","last_became_peered":"2024-09-17T01:44:07.060788+0000","last_unstale":"2024-09-17T01:44:08.956983+0000","last_undegraded":"2024-09-17T01:44:08.956983+0000","last_fullsized":"2024-09-17T01:44:08.956983+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:56:35.021505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.750877+0000","last_change":"2024-09-17T01:44:06.058197+0000","last_active":"2024-09-17T01:44:08.750877+0000","last_peered":"2024-09-17T01:44:08.750877+0000","last_clean":"2024-09-17T01:44:08.750877+0000","last_became_active":"2024-09-17T01:44:06.057891+0000","last_became_peered":"2024-09-17T01:44:06.057891+0000","last_unstale":"2024-09-17T01:44:08.750877+0000","last_undegraded":"2024-09-17T01:44:08.750877+0000","last_fullsized":"2024-09-17T01:44:08.750877+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:46.039272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.063812+0000","last_change":"2024-09-17T01:44:07.066010+0000","last_active":"2024-09-17T01:44:08.063812+0000","last_peered":"2024-09-17T01:44:08.063812+0000","last_clean":"2024-09-17T01:44:08.063812+0000","last_became_active":"2024-09-17T01:44:07.064179+0000","last_became_peered":"2024-09-17T01:44:07.064179+0000","last_unstale":"2024-09-17T01:44:08.063812+0000","last_undegraded":"2024-09-17T01:44:08.063812+0000","last_fullsized":"2024-09-17T01:44:08.063812+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:23.066587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.7","version":"159'2","reported_seq":17,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.806207+0000","last_change":"2024-09-17T01:44:06.054637+0000","last_active":"2024-09-17T01:44:08.806207+0000","last_peered":"2024-09-17T01:44:08.806207+0000","last_clean":"2024-09-17T01:44:08.806207+0000","last_became_active":"2024-09-17T01:44:06.053809+0000","last_became_peered":"2024-09-17T01:44:06.053809+0000","last_unstale":"2024-09-17T01:44:08.806207+0000","last_undegraded":"2024-09-17T01:44:08.806207+0000","last_fullsized":"2024-09-17T01:44:08.806207+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:27.875367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.053478+0000","last_change":"2024-09-17T01:44:07.048127+0000","last_active":"2024-09-17T01:44:08.053478+0000","last_peered":"2024-09-17T01:44:08.053478+0000","last_clean":"2024-09-17T01:44:08.053478+0000","last_became_active":"2024-09-17T01:44:07.047779+0000","last_became_peered":"2024-09-17T01:44:07.047779+0000","last_unstale":"2024-09-17T01:44:08.053478+0000","last_undegraded":"2024-09-17T01:44:08.053478+0000","last_fullsized":"2024-09-17T01:44:08.053478+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:51:34.161640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.6","version":"160'1","reported_seq":16,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:09.050629+0000","last_change":"2024-09-17T01:44:06.061164+0000","last_active":"2024-09-17T01:44:09.050629+0000","last_peered":"2024-09-17T01:44:09.050629+0000","last_clean":"2024-09-17T01:44:09.050629+0000","last_became_active":"2024-09-17T01:44:06.060867+0000","last_became_peered":"2024-09-17T01:44:06.060867+0000","last_unstale":"2024-09-17T01:44:09.050629+0000","last_undegraded":"2024-09-17T01:44:09.050629+0000","last_fullsized":"2024-09-17T01:44:09.050629+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:42.056841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.053348+0000","last_change":"2024-09-17T01:44:07.066301+0000","last_active":"2024-09-17T01:44:08.053348+0000","last_peered":"2024-09-17T01:44:08.053348+0000","last_clean":"2024-09-17T01:44:08.053348+0000","last_became_active":"2024-09-17T01:44:07.065645+0000","last_became_peered":"2024-09-17T01:44:07.065645+0000","last_unstale":"2024-09-17T01:44:08.053348+0000","last_undegraded":"2024-09-17T01:44:08.053348+0000","last_fullsized":"2024-09-17T01:44:08.053348+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:34.274919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956781+0000","last_change":"2024-09-17T01:44:06.062628+0000","last_active":"2024-09-17T01:44:08.956781+0000","last_peered":"2024-09-17T01:44:08.956781+0000","last_clean":"2024-09-17T01:44:08.956781+0000","last_became_active":"2024-09-17T01:44:06.062315+0000","last_became_peered":"2024-09-17T01:44:06.062315+0000","last_unstale":"2024-09-17T01:44:08.956781+0000","last_undegraded":"2024-09-17T01:44:08.956781+0000","last_fullsized":"2024-09-17T01:44:08.956781+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:33.128051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.052795+0000","last_change":"2024-09-17T01:44:07.056442+0000","last_active":"2024-09-17T01:44:08.052795+0000","last_peered":"2024-09-17T01:44:08.052795+0000","last_clean":"2024-09-17T01:44:08.052795+0000","last_became_active":"2024-09-17T01:44:07.056118+0000","last_became_peered":"2024-09-17T01:44:07.056118+0000","last_unstale":"2024-09-17T01:44:08.052795+0000","last_undegraded":"2024-09-17T01:44:08.052795+0000","last_fullsized":"2024-09-17T01:44:08.052795+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:17.285808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.063363+0000","last_change":"2024-09-17T01:44:06.054673+0000","last_active":"2024-09-17T01:44:08.063363+0000","last_peered":"2024-09-17T01:44:08.063363+0000","last_clean":"2024-09-17T01:44:08.063363+0000","last_became_active":"2024-09-17T01:44:06.054251+0000","last_became_peered":"2024-09-17T01:44:06.054251+0000","last_unstale":"2024-09-17T01:44:08.063363+0000","last_undegraded":"2024-09-17T01:44:08.063363+0000","last_fullsized":"2024-09-17T01:44:08.063363+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:32.801124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.805971+0000","last_change":"2024-09-17T01:44:07.074858+0000","last_active":"2024-09-17T01:44:08.805971+0000","last_peered":"2024-09-17T01:44:08.805971+0000","last_clean":"2024-09-17T01:44:08.805971+0000","last_became_active":"2024-09-17T01:44:07.074517+0000","last_became_peered":"2024-09-17T01:44:07.074517+0000","last_unstale":"2024-09-17T01:44:08.805971+0000","last_undegraded":"2024-09-17T01:44:08.805971+0000","last_fullsized":"2024-09-17T01:44:08.805971+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:45.135777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.051569+0000","last_change":"2024-09-17T01:44:06.048219+0000","last_active":"2024-09-17T01:44:08.051569+0000","last_peered":"2024-09-17T01:44:08.051569+0000","last_clean":"2024-09-17T01:44:08.051569+0000","last_became_active":"2024-09-17T01:44:06.047851+0000","last_became_peered":"2024-09-17T01:44:06.047851+0000","last_unstale":"2024-09-17T01:44:08.051569+0000","last_undegraded":"2024-09-17T01:44:08.051569+0000","last_fullsized":"2024-09-17T01:44:08.051569+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:02.640019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956501+0000","last_change":"2024-09-17T01:44:07.051500+0000","last_active":"2024-09-17T01:44:08.956501+0000","last_peered":"2024-09-17T01:44:08.956501+0000","last_clean":"2024-09-17T01:44:08.956501+0000","last_became_active":"2024-09-17T01:44:07.051119+0000","last_became_peered":"2024-09-17T01:44:07.051119+0000","last_unstale":"2024-09-17T01:44:08.956501+0000","last_undegraded":"2024-09-17T01:44:08.956501+0000","last_fullsized":"2024-09-17T01:44:08.956501+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:44.318905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956789+0000","last_change":"2024-09-17T01:44:06.044946+0000","last_active":"2024-09-17T01:44:08.956789+0000","last_peered":"2024-09-17T01:44:08.956789+0000","last_clean":"2024-09-17T01:44:08.956789+0000","last_became_active":"2024-09-17T01:44:06.044583+0000","last_became_peered":"2024-09-17T01:44:06.044583+0000","last_unstale":"2024-09-17T01:44:08.956789+0000","last_undegraded":"2024-09-17T01:44:08.956789+0000","last_fullsized":"2024-09-17T01:44:08.956789+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:05.148132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.957218+0000","last_change":"2024-09-17T01:44:07.057465+0000","last_active":"2024-09-17T01:44:08.957218+0000","last_peered":"2024-09-17T01:44:08.957218+0000","last_clean":"2024-09-17T01:44:08.957218+0000","last_became_active":"2024-09-17T01:44:07.057065+0000","last_became_peered":"2024-09-17T01:44:07.057065+0000","last_unstale":"2024-09-17T01:44:08.957218+0000","last_undegraded":"2024-09-17T01:44:08.957218+0000","last_fullsized":"2024-09-17T01:44:08.957218+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:17.593862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956457+0000","last_change":"2024-09-17T01:44:06.066315+0000","last_active":"2024-09-17T01:44:08.956457+0000","last_peered":"2024-09-17T01:44:08.956457+0000","last_clean":"2024-09-17T01:44:08.956457+0000","last_became_active":"2024-09-17T01:44:06.065250+0000","last_became_peered":"2024-09-17T01:44:06.065250+0000","last_unstale":"2024-09-17T01:44:08.956457+0000","last_undegraded":"2024-09-17T01:44:08.956457+0000","last_fullsized":"2024-09-17T01:44:08.956457+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:22.751154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956280+0000","last_change":"2024-09-17T01:44:07.071538+0000","last_active":"2024-09-17T01:44:08.956280+0000","last_peered":"2024-09-17T01:44:08.956280+0000","last_clean":"2024-09-17T01:44:08.956280+0000","last_became_active":"2024-09-17T01:44:07.071189+0000","last_became_peered":"2024-09-17T01:44:07.071189+0000","last_unstale":"2024-09-17T01:44:08.956280+0000","last_undegraded":"2024-09-17T01:44:08.956280+0000","last_fullsized":"2024-09-17T01:44:08.956280+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:40.861349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.956017+0000","last_change":"2024-09-17T01:44:06.062899+0000","last_active":"2024-09-17T01:44:08.956017+0000","last_peered":"2024-09-17T01:44:08.956017+0000","last_clean":"2024-09-17T01:44:08.956017+0000","last_became_active":"2024-09-17T01:44:06.062331+0000","last_became_peered":"2024-09-17T01:44:06.062331+0000","last_unstale":"2024-09-17T01:44:08.956017+0000","last_undegraded":"2024-09-17T01:44:08.956017+0000","last_fullsized":"2024-09-17T01:44:08.956017+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:20.808926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.957387+0000","last_change":"2024-09-17T01:44:07.051999+0000","last_active":"2024-09-17T01:44:08.957387+0000","last_peered":"2024-09-17T01:44:08.957387+0000","last_clean":"2024-09-17T01:44:08.957387+0000","last_became_active":"2024-09-17T01:44:07.051667+0000","last_became_peered":"2024-09-17T01:44:07.051667+0000","last_unstale":"2024-09-17T01:44:08.957387+0000","last_undegraded":"2024-09-17T01:44:08.957387+0000","last_fullsized":"2024-09-17T01:44:08.957387+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:06.023929+0000","last_clean_scrub_stamp":"2024-09-17T01:44:06.023929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:32.780761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":15,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.051727+0000","last_change":"2024-09-17T01:44:06.053633+0000","last_active":"2024-09-17T01:44:08.051727+0000","last_peered":"2024-09-17T01:44:08.051727+0000","last_clean":"2024-09-17T01:44:08.051727+0000","last_became_active":"2024-09-17T01:44:06.053303+0000","last_became_peered":"2024-09-17T01:44:06.053303+0000","last_unstale":"2024-09-17T01:44:08.051727+0000","last_undegraded":"2024-09-17T01:44:08.051727+0000","last_fullsized":"2024-09-17T01:44:08.051727+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:44:05.020831+0000","last_clean_scrub_stamp":"2024-09-17T01:44:05.020831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:45.135104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":374,"reported_epoch":160,"state":"active+clean","last_fresh":"2024-09-17T01:44:08.051225+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:44:08.051225+0000","last_peered":"2024-09-17T01:44:08.051225+0000","last_clean":"2024-09-17T01:44:08.051225+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:44:08.051225+0000","last_undegraded":"2024-09-17T01:44:08.051225+0000","last_fullsized":"2024-09-17T01:44:08.051225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476887,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59516,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312324,"statfs":{"total":96636764160,"available":96575819776,"internally_reserved":0,"allocated":2002944,"data_stored":880718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509590,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51196,"kb_used_data":1952,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320644,"statfs":{"total":96636764160,"available":96584339456,"internally_reserved":0,"allocated":1998848,"data_stored":880136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59512,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312328,"statfs":{"total":96636764160,"available":96575823872,"internally_reserved":0,"allocated":2002944,"data_stored":880170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509590,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47040,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324800,"statfs":{"total":96636764160,"available":96588595200,"internally_reserved":0,"allocated":2002944,"data_stored":880170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509590,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59524,"kb_used_data":1968,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312316,"statfs":{"total":96636764160,"available":96575811584,"internally_reserved":0,"allocated":2015232,"data_stored":881770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509589,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60120,"kb_used_data":2556,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311720,"statfs":{"total":96636764160,"available":96575201280,"internally_reserved":0,"allocated":2617344,"data_stored":1472298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509591,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55360,"kb_used_data":1956,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316480,"statfs":{"total":96636764160,"available":96580075520,"internally_reserved":0,"allocated":2002944,"data_stored":880206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":54655433},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542295,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64256,"kb_used_data":2540,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307584,"statfs":{"total":96636764160,"available":96570966016,"internally_reserved":0,"allocated":2600960,"data_stored":1471176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:44:12.035 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T01:44:12.036 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T01:44:12.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.309+0000 7f9ea5a00640 1 -- 172.21.15.42:0/2689611773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e84004d40 msgr2=0x7f9e84005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:12.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.309+0000 7f9ea5a00640 1 --2- 172.21.15.42:0/2689611773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e84004d40 0x7f9e84005150 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f9ea006df10 tx=0x7f9e84005830 comp rx=0 tx=0).stop 2024-09-17T01:44:12.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.309+0000 7f9ea5000640 1 -- 172.21.15.42:0/2689611773 reap_dead start 2024-09-17T01:44:12.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.309+0000 7f9ea5a00640 1 -- 172.21.15.42:0/2689611773 shutdown_connections 2024-09-17T01:44:12.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.309+0000 7f9ea5a00640 1 -- 172.21.15.42:0/2689611773 >> 172.21.15.42:0/2689611773 conn(0x7f9ea00b25f0 msgr2=0x7f9ea00d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:12.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.309+0000 7f9ea5a00640 1 -- 172.21.15.42:0/2689611773 shutdown_connections 2024-09-17T01:44:12.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.309+0000 7f9ea5a00640 1 -- 172.21.15.42:0/2689611773 wait complete. 2024-09-17T01:44:12.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.312+0000 7f9ea5a00640 1 Processor -- start 2024-09-17T01:44:12.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.312+0000 7f9ea5a00640 1 -- start start 2024-09-17T01:44:12.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.313+0000 7f9ea5a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e84004d40 0x7f9ea014a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:12.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.313+0000 7f9ea5a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ea01535a0 0x7f9ea00b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:12.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.313+0000 7f9ea5a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ea00b4370 0x7f9ea015feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:12.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.313+0000 7f9ea5a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea01632b0 con 0x7f9ea01535a0 2024-09-17T01:44:12.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.313+0000 7f9ea5a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea0163130 con 0x7f9e84004d40 2024-09-17T01:44:12.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.313+0000 7f9ea5a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea00ca070 con 0x7f9ea00b4370 2024-09-17T01:44:12.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.313+0000 7f9e97e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ea01535a0 0x7f9ea00b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:12.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.313+0000 7f9e97e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ea01535a0 0x7f9ea00b3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36430/0 (socket says 172.21.15.42:36430) 2024-09-17T01:44:12.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.313+0000 7f9e97e00640 1 -- 172.21.15.42:0/1682741649 learned_addr learned my addr 172.21.15.42:0/1682741649 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:12.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.314+0000 7f9e9fe00640 1 --2- 172.21.15.42:0/1682741649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e84004d40 0x7f9ea014a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:12.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.314+0000 7f9ea5000640 1 --2- 172.21.15.42:0/1682741649 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ea00b4370 0x7f9ea015feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:12.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.314+0000 7f9e97e00640 1 -- 172.21.15.42:0/1682741649 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ea00b4370 msgr2=0x7f9ea015feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:12.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.314+0000 7f9e97e00640 1 --2- 172.21.15.42:0/1682741649 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ea00b4370 0x7f9ea015feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:12.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.314+0000 7f9e97e00640 1 -- 172.21.15.42:0/1682741649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e84004d40 msgr2=0x7f9ea014a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:12.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.314+0000 7f9e97e00640 1 --2- 172.21.15.42:0/1682741649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e84004d40 0x7f9ea014a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:12.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.314+0000 7f9e97e00640 1 -- 172.21.15.42:0/1682741649 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea00b4780 con 0x7f9ea01535a0 2024-09-17T01:44:12.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.314+0000 7f9e97e00640 1 --2- 172.21.15.42:0/1682741649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ea01535a0 0x7f9ea00b3e30 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f9e880013f0 tx=0x7f9e880039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:12.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.314+0000 7f9e9cc00640 1 -- 172.21.15.42:0/1682741649 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e88015070 con 0x7f9ea01535a0 2024-09-17T01:44:12.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.315+0000 7f9e9cc00640 1 -- 172.21.15.42:0/1682741649 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e88011920 con 0x7f9ea01535a0 2024-09-17T01:44:12.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.315+0000 7f9e9cc00640 1 -- 172.21.15.42:0/1682741649 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e88011d70 con 0x7f9ea01535a0 2024-09-17T01:44:12.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.315+0000 7f9ea5a00640 1 -- 172.21.15.42:0/1682741649 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea015c300 con 0x7f9ea01535a0 2024-09-17T01:44:12.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.315+0000 7f9ea5a00640 1 -- 172.21.15.42:0/1682741649 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea015b820 con 0x7f9ea01535a0 2024-09-17T01:44:12.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.316+0000 7f9ea5a00640 1 -- 172.21.15.42:0/1682741649 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ea015eb70 con 0x7f9ea01535a0 2024-09-17T01:44:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.317+0000 7f9e9cc00640 1 -- 172.21.15.42:0/1682741649 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9e88018070 con 0x7f9ea01535a0 2024-09-17T01:44:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.318+0000 7f9e9cc00640 1 --2- 172.21.15.42:0/1682741649 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e7c078bc0 0x7f9e7c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.318+0000 7f9e9cc00640 1 -- 172.21.15.42:0/1682741649 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7f9e8809ba90 con 0x7f9ea01535a0 2024-09-17T01:44:12.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.318+0000 7f9e9fe00640 1 --2- 172.21.15.42:0/1682741649 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e7c078bc0 0x7f9e7c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:12.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.319+0000 7f9e9fe00640 1 --2- 172.21.15.42:0/1682741649 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e7c078bc0 0x7f9e7c07b0d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009c50 tx=0x7f9e90005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:12.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.322+0000 7f9e9cc00640 1 -- 172.21.15.42:0/1682741649 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9ea00b4780 con 0x7f9ea01535a0 2024-09-17T01:44:12.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.589+0000 7f9ea5a00640 1 -- 172.21.15.42:0/1682741649 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f9ea00cb2d0 con 0x7f9ea01535a0 2024-09-17T01:44:12.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.592+0000 7f9e9cc00640 1 -- 172.21.15.42:0/1682741649 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v40) ==== 190+0+147 (secure 0 0 0) 0x7f9ea006d670 con 0x7f9ea01535a0 2024-09-17T01:44:12.590 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-09-17T01:44:12.590 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA== 2024-09-17T01:44:12.591 INFO:teuthology.orchestra.run.smithi042.stdout: caps mds = "allow" 2024-09-17T01:44:12.591 INFO:teuthology.orchestra.run.smithi042.stdout: caps mon = "allow r" 2024-09-17T01:44:12.591 INFO:teuthology.orchestra.run.smithi042.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T01:44:12.591 INFO:teuthology.orchestra.run.smithi042.stderr:updated caps for client.0 2024-09-17T01:44:12.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.595+0000 7f9ea5a00640 1 -- 172.21.15.42:0/1682741649 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e7c078bc0 msgr2=0x7f9e7c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:12.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.595+0000 7f9ea5a00640 1 --2- 172.21.15.42:0/1682741649 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e7c078bc0 0x7f9e7c07b0d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009c50 tx=0x7f9e90005f90 comp rx=0 tx=0).stop 2024-09-17T01:44:12.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.595+0000 7f9ea5a00640 1 -- 172.21.15.42:0/1682741649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ea01535a0 msgr2=0x7f9ea00b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:12.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.595+0000 7f9ea5a00640 1 --2- 172.21.15.42:0/1682741649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ea01535a0 0x7f9ea00b3e30 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f9e880013f0 tx=0x7f9e880039c0 comp rx=0 tx=0).stop 2024-09-17T01:44:12.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.595+0000 7f9ea5a00640 1 -- 172.21.15.42:0/1682741649 shutdown_connections 2024-09-17T01:44:12.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.595+0000 7f9ea5a00640 1 --2- 172.21.15.42:0/1682741649 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e7c078bc0 0x7f9e7c07b0d0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:12.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.595+0000 7f9ea5a00640 1 --2- 172.21.15.42:0/1682741649 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ea00b4370 0x7f9ea015feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:12.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.595+0000 7f9ea5a00640 1 --2- 172.21.15.42:0/1682741649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ea01535a0 0x7f9ea00b3e30 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:12.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.595+0000 7f9ea5a00640 1 --2- 172.21.15.42:0/1682741649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e84004d40 0x7f9ea014a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:12.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.595+0000 7f9ea5a00640 1 -- 172.21.15.42:0/1682741649 >> 172.21.15.42:0/1682741649 conn(0x7f9ea00b25f0 msgr2=0x7f9ea00cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:12.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.595+0000 7f9ea5a00640 1 -- 172.21.15.42:0/1682741649 shutdown_connections 2024-09-17T01:44:12.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.595+0000 7f9ea5a00640 1 -- 172.21.15.42:0/1682741649 wait complete. 2024-09-17T01:44:12.617 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:44:12.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.847+0000 7f13c7e00640 1 -- 172.21.15.42:0/2685694901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13c80cf7c0 msgr2=0x7f13c806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:12.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.847+0000 7f13c7e00640 1 --2- 172.21.15.42:0/2685694901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13c80cf7c0 0x7f13c806cd20 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f13b0005fd0 tx=0x7f13b002a5d0 comp rx=0 tx=0).stop 2024-09-17T01:44:12.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.847+0000 7f13c7e00640 1 -- 172.21.15.42:0/2685694901 shutdown_connections 2024-09-17T01:44:12.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.847+0000 7f13c7e00640 1 --2- 172.21.15.42:0/2685694901 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f13c806d260 0x7f13c8152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:12.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.847+0000 7f13c7e00640 1 --2- 172.21.15.42:0/2685694901 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13c80cf7c0 0x7f13c806cd20 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:12.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.847+0000 7f13c7e00640 1 -- 172.21.15.42:0/2685694901 >> 172.21.15.42:0/2685694901 conn(0x7f13c80b25f0 msgr2=0x7f13c80d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:12.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.847+0000 7f13c7e00640 1 -- 172.21.15.42:0/2685694901 shutdown_connections 2024-09-17T01:44:12.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.847+0000 7f13c7e00640 1 -- 172.21.15.42:0/2685694901 wait complete. 2024-09-17T01:44:12.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.849+0000 7f13c7e00640 1 Processor -- start 2024-09-17T01:44:12.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.849+0000 7f13c7e00640 1 -- start start 2024-09-17T01:44:12.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.851+0000 7f13c7e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f13c806d260 0x7f13c81f6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:12.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.851+0000 7f13c7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13c80b4be0 0x7f13c81f9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:12.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.851+0000 7f13c7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13c80cf7c0 0x7f13c815e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:12.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.851+0000 7f13c7e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f13c8153850 con 0x7f13c80b4be0 2024-09-17T01:44:12.849 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.851+0000 7f13c7e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f13c81536d0 con 0x7f13c80cf7c0 2024-09-17T01:44:12.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.851+0000 7f13c7e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f13c81539d0 con 0x7f13c806d260 2024-09-17T01:44:12.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.851+0000 7f13bfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13c80b4be0 0x7f13c81f9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:12.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.851+0000 7f13bfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13c80b4be0 0x7f13c81f9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36454/0 (socket says 172.21.15.42:36454) 2024-09-17T01:44:12.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.851+0000 7f13bfe00640 1 -- 172.21.15.42:0/3170657007 learned_addr learned my addr 172.21.15.42:0/3170657007 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:12.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.851+0000 7f13c7400640 1 --2- 172.21.15.42:0/3170657007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13c80cf7c0 0x7f13c815e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:12.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.851+0000 7f13c6a00640 1 --2- 172.21.15.42:0/3170657007 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f13c806d260 0x7f13c81f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:12.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.851+0000 7f13bfe00640 1 -- 172.21.15.42:0/3170657007 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f13c806d260 msgr2=0x7f13c81f6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:12.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.851+0000 7f13bfe00640 1 --2- 172.21.15.42:0/3170657007 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f13c806d260 0x7f13c81f6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:12.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.851+0000 7f13bfe00640 1 -- 172.21.15.42:0/3170657007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13c80cf7c0 msgr2=0x7f13c815e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:12.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.851+0000 7f13bfe00640 1 --2- 172.21.15.42:0/3170657007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13c80cf7c0 0x7f13c815e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:12.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.851+0000 7f13bfe00640 1 -- 172.21.15.42:0/3170657007 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c81f9b80 con 0x7f13c80b4be0 2024-09-17T01:44:12.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.851+0000 7f13c6a00640 1 --2- 172.21.15.42:0/3170657007 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f13c806d260 0x7f13c81f6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:44:12.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.852+0000 7f13bfe00640 1 --2- 172.21.15.42:0/3170657007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13c80b4be0 0x7f13c81f9640 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f13b0034040 tx=0x7f13b00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:12.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.852+0000 7f13bea00640 1 -- 172.21.15.42:0/3170657007 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b003e030 con 0x7f13c80b4be0 2024-09-17T01:44:12.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.852+0000 7f13bea00640 1 -- 172.21.15.42:0/3170657007 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13b0003ca0 con 0x7f13c80b4be0 2024-09-17T01:44:12.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.852+0000 7f13c7e00640 1 -- 172.21.15.42:0/3170657007 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c81e5de0 con 0x7f13c80b4be0 2024-09-17T01:44:12.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.852+0000 7f13bea00640 1 -- 172.21.15.42:0/3170657007 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b0035040 con 0x7f13c80b4be0 2024-09-17T01:44:12.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.852+0000 7f13c7e00640 1 -- 172.21.15.42:0/3170657007 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c81f5a30 con 0x7f13c80b4be0 2024-09-17T01:44:12.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.853+0000 7f13c7e00640 1 -- 172.21.15.42:0/3170657007 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c8152ed0 con 0x7f13c80b4be0 2024-09-17T01:44:12.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.854+0000 7f13bea00640 1 -- 172.21.15.42:0/3170657007 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f13b0041030 con 0x7f13c80b4be0 2024-09-17T01:44:12.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.855+0000 7f13bea00640 1 --2- 172.21.15.42:0/3170657007 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f13a4078b90 0x7f13a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:12.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.856+0000 7f13bea00640 1 -- 172.21.15.42:0/3170657007 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7f13b00bb370 con 0x7f13c80b4be0 2024-09-17T01:44:12.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.856+0000 7f13c6a00640 1 --2- 172.21.15.42:0/3170657007 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f13a4078b90 0x7f13a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:12.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.857+0000 7f13c6a00640 1 --2- 172.21.15.42:0/3170657007 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f13a4078b90 0x7f13a407b0a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f13b8007fd0 tx=0x7f13b8009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:12.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:12.860+0000 7f13bea00640 1 -- 172.21.15.42:0/3170657007 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f13c81f9b80 con 0x7f13c80b4be0 2024-09-17T01:44:13.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.093+0000 7f13c7e00640 1 -- 172.21.15.42:0/3170657007 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13c80b1aa0 con 0x7f13c80b4be0 2024-09-17T01:44:13.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.093+0000 7f13bea00640 1 -- 172.21.15.42:0/3170657007 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5230 (secure 0 0 0) 0x7f13b0083830 con 0x7f13c80b4be0 2024-09-17T01:44:13.091 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:44:13.092 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":125,"btime":"2024-09-17T01:44:10:057034+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8872,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3393274334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3393274334},{"type":"v1","addr":"172.21.15.43:6836","nonce":3393274334}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":8875,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2869136532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2869136532},{"type":"v1","addr":"172.21.15.43:6837","nonce":2869136532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":9513,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/297557585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":297557585},{"type":"v1","addr":"172.21.15.42:6834","nonce":297557585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":119}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:44:06.556661+0000","modified":"2024-09-17T01:44:09.563813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9516},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9516":{"gid":9516,"name":"c","rank":0,"incarnation":121,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1557345672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1557345672},{"type":"v1","addr":"172.21.15.42:6835","nonce":1557345672}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9516,"qdb_cluster":[9516]},"id":11}]} 2024-09-17T01:44:13.092 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 125 2024-09-17T01:44:13.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.096+0000 7f13c7e00640 1 -- 172.21.15.42:0/3170657007 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f13a4078b90 msgr2=0x7f13a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:13.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.096+0000 7f13c7e00640 1 --2- 172.21.15.42:0/3170657007 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f13a4078b90 0x7f13a407b0a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f13b8007fd0 tx=0x7f13b8009040 comp rx=0 tx=0).stop 2024-09-17T01:44:13.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.096+0000 7f13c7e00640 1 -- 172.21.15.42:0/3170657007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13c80b4be0 msgr2=0x7f13c81f9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:13.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.096+0000 7f13c7e00640 1 --2- 172.21.15.42:0/3170657007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13c80b4be0 0x7f13c81f9640 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f13b0034040 tx=0x7f13b00038a0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.096+0000 7f13c7e00640 1 -- 172.21.15.42:0/3170657007 shutdown_connections 2024-09-17T01:44:13.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.096+0000 7f13c7e00640 1 --2- 172.21.15.42:0/3170657007 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f13a4078b90 0x7f13a407b0a0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.096+0000 7f13c7e00640 1 --2- 172.21.15.42:0/3170657007 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13c80cf7c0 0x7f13c815e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.096+0000 7f13c7e00640 1 --2- 172.21.15.42:0/3170657007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13c80b4be0 0x7f13c81f9640 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.096+0000 7f13c7e00640 1 --2- 172.21.15.42:0/3170657007 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f13c806d260 0x7f13c81f6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.096+0000 7f13c7e00640 1 -- 172.21.15.42:0/3170657007 >> 172.21.15.42:0/3170657007 conn(0x7f13c80b25f0 msgr2=0x7f13c80c9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:13.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.096+0000 7f13c7e00640 1 -- 172.21.15.42:0/3170657007 shutdown_connections 2024-09-17T01:44:13.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.097+0000 7f13c7e00640 1 -- 172.21.15.42:0/3170657007 wait complete. 2024-09-17T01:44:13.522 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 125, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:44:06.556661+0000', 'modified': '2024-09-17T01:44:09.563813+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9516}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9516': {'gid': 9516, 'name': 'c', 'rank': 0, 'incarnation': 121, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.42:6835/1557345672', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6833', 'nonce': 1557345672}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 1557345672}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9516, 'qdb_cluster': [9516]} 2024-09-17T01:44:13.522 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T01:44:13.523 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T01:44:13.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.755+0000 7f62b3600640 1 -- 172.21.15.42:0/499345136 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6294003c10 msgr2=0x7f6294004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:13.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.755+0000 7f62b3600640 1 --2- 172.21.15.42:0/499345136 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6294003c10 0x7f6294004060 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f62a0001830 tx=0x7f6294005830 comp rx=0 tx=0).stop 2024-09-17T01:44:13.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.755+0000 7f62b1600640 1 -- 172.21.15.42:0/499345136 reap_dead start 2024-09-17T01:44:13.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.755+0000 7f62b3600640 1 -- 172.21.15.42:0/499345136 shutdown_connections 2024-09-17T01:44:13.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.755+0000 7f62b3600640 1 -- 172.21.15.42:0/499345136 >> 172.21.15.42:0/499345136 conn(0x7f62ac0b2930 msgr2=0x7f62ac06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:13.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.755+0000 7f62b3600640 1 -- 172.21.15.42:0/499345136 shutdown_connections 2024-09-17T01:44:13.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.755+0000 7f62b3600640 1 -- 172.21.15.42:0/499345136 wait complete. 2024-09-17T01:44:13.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.758+0000 7f62b3600640 1 Processor -- start 2024-09-17T01:44:13.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.758+0000 7f62b3600640 1 -- start start 2024-09-17T01:44:13.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.759+0000 7f62b3600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6294003c10 0x7f62ac15fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:13.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.759+0000 7f62b3600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f62ac134660 0x7f62ac1f88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:13.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.759+0000 7f62b3600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62ac06f210 0x7f62ac06f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:13.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.759+0000 7f62b3600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f62ac06d430 con 0x7f6294003c10 2024-09-17T01:44:13.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.759+0000 7f62b3600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f62ac072be0 con 0x7f62ac06f210 2024-09-17T01:44:13.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.759+0000 7f62b3600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f62ac06d5b0 con 0x7f62ac134660 2024-09-17T01:44:13.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.759+0000 7f62b0c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6294003c10 0x7f62ac15fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:13.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.759+0000 7f62b0c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6294003c10 0x7f62ac15fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36466/0 (socket says 172.21.15.42:36466) 2024-09-17T01:44:13.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.759+0000 7f62b0c00640 1 -- 172.21.15.42:0/1756103603 learned_addr learned my addr 172.21.15.42:0/1756103603 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:13.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.760+0000 7f62b1600640 1 --2- 172.21.15.42:0/1756103603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62ac06f210 0x7f62ac06f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:13.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.760+0000 7f62abe00640 1 --2- 172.21.15.42:0/1756103603 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f62ac134660 0x7f62ac1f88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:13.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.760+0000 7f62b0c00640 1 -- 172.21.15.42:0/1756103603 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f62ac134660 msgr2=0x7f62ac1f88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:13.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.760+0000 7f62b0c00640 1 --2- 172.21.15.42:0/1756103603 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f62ac134660 0x7f62ac1f88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.760+0000 7f62b0c00640 1 -- 172.21.15.42:0/1756103603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62ac06f210 msgr2=0x7f62ac06f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:13.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.760+0000 7f62b0c00640 1 --2- 172.21.15.42:0/1756103603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62ac06f210 0x7f62ac06f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.760+0000 7f62b0c00640 1 -- 172.21.15.42:0/1756103603 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ac06fb60 con 0x7f6294003c10 2024-09-17T01:44:13.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.760+0000 7f62abe00640 1 --2- 172.21.15.42:0/1756103603 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f62ac134660 0x7f62ac1f88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:44:13.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.760+0000 7f62b0c00640 1 --2- 172.21.15.42:0/1756103603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6294003c10 0x7f62ac15fb90 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f62a0001920 tx=0x7f62a00060e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:13.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.760+0000 7f62a8c00640 1 -- 172.21.15.42:0/1756103603 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a0043070 con 0x7f6294003c10 2024-09-17T01:44:13.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.761+0000 7f62a8c00640 1 -- 172.21.15.42:0/1756103603 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62a0003af0 con 0x7f6294003c10 2024-09-17T01:44:13.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.761+0000 7f62b3600640 1 -- 172.21.15.42:0/1756103603 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62ac0c54d0 con 0x7f6294003c10 2024-09-17T01:44:13.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.761+0000 7f62a8c00640 1 -- 172.21.15.42:0/1756103603 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a00064c0 con 0x7f6294003c10 2024-09-17T01:44:13.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.761+0000 7f62b3600640 1 -- 172.21.15.42:0/1756103603 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62ac131c60 con 0x7f6294003c10 2024-09-17T01:44:13.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.763+0000 7f62a8c00640 1 -- 172.21.15.42:0/1756103603 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f62a0046070 con 0x7f6294003c10 2024-09-17T01:44:13.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.764+0000 7f62a8c00640 1 --2- 172.21.15.42:0/1756103603 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f628c078b90 0x7f628c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:13.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.764+0000 7f62a8c00640 1 -- 172.21.15.42:0/1756103603 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7f62a00bac40 con 0x7f6294003c10 2024-09-17T01:44:13.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.764+0000 7f62ba843740 1 Processor -- start 2024-09-17T01:44:13.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.765+0000 7f62abe00640 1 --2- 172.21.15.42:0/1756103603 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f628c078b90 0x7f628c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:13.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.765+0000 7f62ba843740 1 -- start start 2024-09-17T01:44:13.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.765+0000 7f62abe00640 1 --2- 172.21.15.42:0/1756103603 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f628c078b90 0x7f628c07b0a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f62ac1429c0 tx=0x7f6298005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:13.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.766+0000 7f62ba843740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4f23270 0x562af52f3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:13.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.766+0000 7f62ba843740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562af4efa3b0 0x562af52f3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:13.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.766+0000 7f62ba843740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562af4f02590 0x562af52c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:13.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.766+0000 7f62ba843740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562af524d430 con 0x562af4f23270 2024-09-17T01:44:13.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.766+0000 7f62ba843740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562af523d5d0 con 0x562af4f02590 2024-09-17T01:44:13.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.766+0000 7f62ba843740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x562af522ca00 con 0x562af4efa3b0 2024-09-17T01:44:13.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.766+0000 7f62b0c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4f23270 0x562af52f3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:13.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.766+0000 7f62abe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562af4efa3b0 0x562af52f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:13.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.766+0000 7f62b0c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4f23270 0x562af52f3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36468/0 (socket says 172.21.15.42:36468) 2024-09-17T01:44:13.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.766+0000 7f62b0c00640 1 -- 172.21.15.42:0/2166511691 learned_addr learned my addr 172.21.15.42:0/2166511691 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:13.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.766+0000 7f62b1600640 1 --2- 172.21.15.42:0/2166511691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562af4f02590 0x562af52c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:13.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.767+0000 7f62b0c00640 1 -- 172.21.15.42:0/2166511691 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562af4efa3b0 msgr2=0x562af52f3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:13.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.767+0000 7f62b0c00640 1 --2- 172.21.15.42:0/2166511691 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562af4efa3b0 0x562af52f3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.767+0000 7f62b0c00640 1 -- 172.21.15.42:0/2166511691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562af4f02590 msgr2=0x562af52c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:13.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.767+0000 7f62b0c00640 1 --2- 172.21.15.42:0/2166511691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562af4f02590 0x562af52c3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.767+0000 7f62b0c00640 1 -- 172.21.15.42:0/2166511691 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562af51f5520 con 0x562af4f23270 2024-09-17T01:44:13.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.767+0000 7f62b0c00640 1 --2- 172.21.15.42:0/2166511691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4f23270 0x562af52f3970 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f62a0082930 tx=0x7f62a00821d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54424d0b489884da server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:13.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.767+0000 7f629d200640 1 -- 172.21.15.42:0/2166511691 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a008c280 con 0x562af4f23270 2024-09-17T01:44:13.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.767+0000 7f629d200640 1 -- 172.21.15.42:0/2166511691 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62a00a7020 con 0x562af4f23270 2024-09-17T01:44:13.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.767+0000 7f629d200640 1 -- 172.21.15.42:0/2166511691 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a008bdf0 con 0x562af4f23270 2024-09-17T01:44:13.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.768+0000 7f62ba843740 1 -- 172.21.15.42:0/2166511691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4f23270 msgr2=0x562af52f3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:13.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.768+0000 7f62ba843740 1 --2- 172.21.15.42:0/2166511691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4f23270 0x562af52f3970 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f62a0082930 tx=0x7f62a00821d0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.768+0000 7f62ba843740 1 -- 172.21.15.42:0/2166511691 shutdown_connections 2024-09-17T01:44:13.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.768+0000 7f62ba843740 1 --2- 172.21.15.42:0/2166511691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562af4f02590 0x562af52c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.768+0000 7f62ba843740 1 --2- 172.21.15.42:0/2166511691 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562af4efa3b0 0x562af52f3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.768+0000 7f62ba843740 1 --2- 172.21.15.42:0/2166511691 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4f23270 0x562af52f3970 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.768+0000 7f62ba843740 1 -- 172.21.15.42:0/2166511691 >> 172.21.15.42:0/2166511691 conn(0x562af4f173c0 msgr2=0x562af52c9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:13.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.768+0000 7f62ba843740 1 -- 172.21.15.42:0/2166511691 shutdown_connections 2024-09-17T01:44:13.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.768+0000 7f62ba843740 1 -- 172.21.15.42:0/2166511691 wait complete. 2024-09-17T01:44:13.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.769+0000 7f62ba843740 1 -- start start 2024-09-17T01:44:13.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.770+0000 7f62ba843740 1 Processor -- start 2024-09-17T01:44:13.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.771+0000 7f62ba843740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562af4efa3b0 0x562af52f08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:13.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.771+0000 7f62ba843740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562af4f02590 0x562af5311130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:13.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.771+0000 7f62ba843740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4f23270 0x562af5311670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:13.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.771+0000 7f62ba843740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562af51d3330 con 0x562af4f23270 2024-09-17T01:44:13.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.771+0000 7f62ba843740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562af5230810 con 0x562af4f02590 2024-09-17T01:44:13.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.771+0000 7f62ba843740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x562af4f9d620 con 0x562af4efa3b0 2024-09-17T01:44:13.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.771+0000 7f62ba843740 10 client.0 _ll_register_callbacks cb 0x562af51d8420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:44:13.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.771+0000 7f62b1600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4f23270 0x562af5311670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:13.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.772+0000 7f62b1600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4f23270 0x562af5311670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36474/0 (socket says 172.21.15.42:36474) 2024-09-17T01:44:13.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.772+0000 7f62b1600640 1 -- 172.21.15.42:0/1797305281 learned_addr learned my addr 172.21.15.42:0/1797305281 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:13.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.772+0000 7f62b0c00640 1 --2- 172.21.15.42:0/1797305281 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562af4efa3b0 0x562af52f08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:13.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.772+0000 7f62abe00640 1 --2- 172.21.15.42:0/1797305281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562af4f02590 0x562af5311130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:13.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.772+0000 7f62b1600640 1 -- 172.21.15.42:0/1797305281 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562af4efa3b0 msgr2=0x562af52f08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:13.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.772+0000 7f62b1600640 1 --2- 172.21.15.42:0/1797305281 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562af4efa3b0 0x562af52f08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.772+0000 7f62b1600640 1 -- 172.21.15.42:0/1797305281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562af4f02590 msgr2=0x562af5311130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.772+0000 7f62b1600640 1 --2- 172.21.15.42:0/1797305281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562af4f02590 0x562af5311130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.772+0000 7f62b1600640 1 -- 172.21.15.42:0/1797305281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562af4f8e850 con 0x562af4f23270 2024-09-17T01:44:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.772+0000 7f62b1600640 1 --2- 172.21.15.42:0/1797305281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4f23270 0x562af5311670 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f62ac0cf940 tx=0x7f62a4006410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8cd59e1005def62 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.772+0000 7f6291600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:44:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.772+0000 7f6291600640 1 -- 172.21.15.42:0/1797305281 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a4011700 con 0x562af4f23270 2024-09-17T01:44:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.773+0000 7f62ba843740 1 -- 172.21.15.42:0/1797305281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62a00a7020 con 0x562af4f23270 2024-09-17T01:44:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.773+0000 7f6291600640 1 -- 172.21.15.42:0/1797305281 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7f62a40118a0 con 0x562af4f23270 2024-09-17T01:44:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.773+0000 7f6291600640 1 -- 172.21.15.42:0/1797305281 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=125) ==== 24+0+0 (secure 0 0 0) 0x7f62a4022050 con 0x562af4f23270 2024-09-17T01:44:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.773+0000 7f62ba843740 10 client.9645 fetch_fsmap learned FSMap version 125 2024-09-17T01:44:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.773+0000 7f62ba843740 1 -- 172.21.15.42:0/1797305281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=125,monmap=2+}) -- 0x562af50056b0 con 0x562af4f23270 2024-09-17T01:44:13.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.773+0000 7f6291600640 1 -- 172.21.15.42:0/1797305281 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62a00a7020 con 0x562af4f23270 2024-09-17T01:44:13.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.773+0000 7f6291600640 1 -- 172.21.15.42:0/1797305281 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 125) ==== 3502+0+0 (secure 0 0 0) 0x7f62a4025020 con 0x562af4f23270 2024-09-17T01:44:13.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.773+0000 7f62ba843740 10 client.9645 fetch_fsmap finished waiting for FSMap version 125 2024-09-17T01:44:13.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.773+0000 7f62ba843740 10 client.9645 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:44:13.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.773+0000 7f62ba843740 20 client.9645 populate_metadata read hostname 'smithi042' 2024-09-17T01:44:13.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.773+0000 7f62ba843740 1 --2- 172.21.15.42:0/1797305281 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x562af4ee1e40 0x562af52ef020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:13.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.773+0000 7f62ba843740 4 client.9645 mds_command: new command op to 9516 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:44:13.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.773+0000 7f62ba843740 1 -- 172.21.15.42:0/1797305281 --> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562af523f520 con 0x562af4ee1e40 2024-09-17T01:44:13.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.774+0000 7f62b0c00640 1 --2- 172.21.15.42:0/1797305281 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x562af4ee1e40 0x562af52ef020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:13.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.774+0000 7f62b0c00640 1 --2- 172.21.15.42:0/1797305281 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x562af4ee1e40 0x562af52ef020 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c4984c94c35ea9a server_cookie=f48caec1ae1b9710 in_seq=0 out_seq=0 2024-09-17T01:44:13.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.774+0000 7f6291600640 10 client.9645 ms_handle_connect on v2:172.21.15.42:6833/1557345672 2024-09-17T01:44:13.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.775+0000 7f6291600640 1 -- 172.21.15.42:0/1797305281 <== mds.0 v2:172.21.15.42:6833/1557345672 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562af523f520 con 0x562af4ee1e40 2024-09-17T01:44:13.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.775+0000 7f6291600640 10 client.9645 handle_command_reply: tid=0 2024-09-17T01:44:13.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.775+0000 7f62ba843740 1 client.9645 shutdown 2024-09-17T01:44:13.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.775+0000 7f62ba843740 1 -- 172.21.15.42:0/1797305281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4f23270 msgr2=0x562af5311670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:13.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.775+0000 7f62ba843740 1 --2- 172.21.15.42:0/1797305281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4f23270 0x562af5311670 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f62ac0cf940 tx=0x7f62a4006410 comp rx=0 tx=0).stop 2024-09-17T01:44:13.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.775+0000 7f62ba843740 1 -- 172.21.15.42:0/1797305281 shutdown_connections 2024-09-17T01:44:13.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.775+0000 7f62ba843740 1 --2- 172.21.15.42:0/1797305281 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x562af4ee1e40 0x562af52ef020 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.775+0000 7f62ba843740 1 --2- 172.21.15.42:0/1797305281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562af4f02590 0x562af5311130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.775+0000 7f62ba843740 1 --2- 172.21.15.42:0/1797305281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4f23270 0x562af5311670 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.775+0000 7f6291600640 0 client.9645 ms_handle_reset on v2:172.21.15.42:6833/1557345672 2024-09-17T01:44:13.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.775+0000 7f62ba843740 1 --2- 172.21.15.42:0/1797305281 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562af4efa3b0 0x562af52f08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.775+0000 7f62ba843740 1 -- 172.21.15.42:0/1797305281 >> 172.21.15.42:0/1797305281 conn(0x562af4f173c0 msgr2=0x562af53108c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:13.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.775+0000 7f62ba843740 1 -- 172.21.15.42:0/1797305281 shutdown_connections 2024-09-17T01:44:13.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.775+0000 7f62ba843740 1 -- 172.21.15.42:0/1797305281 wait complete. 2024-09-17T01:44:13.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.776+0000 7f62ba843740 20 client.9645 trim_cache size 0 max 16384 2024-09-17T01:44:13.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.795+0000 7f62ba843740 1 Processor -- start 2024-09-17T01:44:13.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.795+0000 7f62ba843740 1 -- start start 2024-09-17T01:44:13.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.797+0000 7f62ba843740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562af4efa3b0 0x562af52ee290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:13.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.797+0000 7f62ba843740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4f02590 0x562af530f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:13.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.797+0000 7f62ba843740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562af4f23270 0x562af5309cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:13.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.797+0000 7f62ba843740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f62ac201900 con 0x562af4f02590 2024-09-17T01:44:13.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.797+0000 7f62ba843740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f62ac133270 con 0x562af4efa3b0 2024-09-17T01:44:13.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.797+0000 7f62ba843740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f62ac201300 con 0x562af4f23270 2024-09-17T01:44:13.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.797+0000 7f62abe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4f02590 0x562af530f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:13.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.797+0000 7f62abe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4f02590 0x562af530f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36480/0 (socket says 172.21.15.42:36480) 2024-09-17T01:44:13.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.797+0000 7f62abe00640 1 -- 172.21.15.42:0/3577758797 learned_addr learned my addr 172.21.15.42:0/3577758797 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:13.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.797+0000 7f62b0c00640 1 --2- 172.21.15.42:0/3577758797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562af4efa3b0 0x562af52ee290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:13.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.797+0000 7f62b1600640 1 --2- 172.21.15.42:0/3577758797 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562af4f23270 0x562af5309cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:13.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.797+0000 7f62abe00640 1 -- 172.21.15.42:0/3577758797 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562af4f23270 msgr2=0x562af5309cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:13.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.797+0000 7f62abe00640 1 --2- 172.21.15.42:0/3577758797 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562af4f23270 0x562af5309cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.797+0000 7f62abe00640 1 -- 172.21.15.42:0/3577758797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562af4efa3b0 msgr2=0x562af52ee290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:13.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.797+0000 7f62abe00640 1 --2- 172.21.15.42:0/3577758797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562af4efa3b0 0x562af52ee290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.797+0000 7f62abe00640 1 -- 172.21.15.42:0/3577758797 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562af52ca650 con 0x562af4f02590 2024-09-17T01:44:13.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.797+0000 7f62b0c00640 1 --2- 172.21.15.42:0/3577758797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562af4efa3b0 0x562af52ee290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:44:13.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.798+0000 7f62abe00640 1 --2- 172.21.15.42:0/3577758797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4f02590 0x562af530f820 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f6298013830 tx=0x7f6298011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc81c86727145718 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:13.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.798+0000 7f6293e00640 1 -- 172.21.15.42:0/3577758797 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629802c070 con 0x562af4f02590 2024-09-17T01:44:13.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.798+0000 7f6293e00640 1 -- 172.21.15.42:0/3577758797 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f629801c750 con 0x562af4f02590 2024-09-17T01:44:13.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.798+0000 7f6293e00640 1 -- 172.21.15.42:0/3577758797 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629801cba0 con 0x562af4f02590 2024-09-17T01:44:13.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.799+0000 7f62ba843740 1 -- 172.21.15.42:0/3577758797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4f02590 msgr2=0x562af530f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:13.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.799+0000 7f62ba843740 1 --2- 172.21.15.42:0/3577758797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4f02590 0x562af530f820 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f6298013830 tx=0x7f6298011000 comp rx=0 tx=0).stop 2024-09-17T01:44:13.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.799+0000 7f62ba843740 1 -- 172.21.15.42:0/3577758797 shutdown_connections 2024-09-17T01:44:13.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.799+0000 7f62ba843740 1 --2- 172.21.15.42:0/3577758797 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562af4f23270 0x562af5309cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.799+0000 7f62ba843740 1 --2- 172.21.15.42:0/3577758797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4f02590 0x562af530f820 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.799+0000 7f62ba843740 1 --2- 172.21.15.42:0/3577758797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562af4efa3b0 0x562af52ee290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.799+0000 7f62ba843740 1 -- 172.21.15.42:0/3577758797 >> 172.21.15.42:0/3577758797 conn(0x562af4f173c0 msgr2=0x562af52f04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:13.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.799+0000 7f62ba843740 1 -- 172.21.15.42:0/3577758797 shutdown_connections 2024-09-17T01:44:13.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.799+0000 7f62ba843740 1 -- 172.21.15.42:0/3577758797 wait complete. 2024-09-17T01:44:13.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.800+0000 7f62ba843740 1 -- start start 2024-09-17T01:44:13.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.800+0000 7f62ba843740 1 Processor -- start 2024-09-17T01:44:13.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.801+0000 7f62ba843740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4efa3b0 0x562af538bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:13.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.801+0000 7f62ba843740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562af4f02590 0x562af5309cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:13.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.801+0000 7f62ba843740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562af4f23270 0x562af530a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:13.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.801+0000 7f62ba843740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562af52ecb60 con 0x562af4efa3b0 2024-09-17T01:44:13.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.801+0000 7f62ba843740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562af531e5e0 con 0x562af4f02590 2024-09-17T01:44:13.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.801+0000 7f62ba843740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x562af52ed180 con 0x562af4f23270 2024-09-17T01:44:13.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.801+0000 7f62ba843740 10 client.0 _ll_register_callbacks cb 0x7f62a4004d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:44:13.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.802+0000 7f62b0c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4efa3b0 0x562af538bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:13.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.802+0000 7f62b0c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4efa3b0 0x562af538bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36496/0 (socket says 172.21.15.42:36496) 2024-09-17T01:44:13.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.802+0000 7f62b0c00640 1 -- 172.21.15.42:0/545594482 learned_addr learned my addr 172.21.15.42:0/545594482 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:13.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.802+0000 7f62b1600640 1 --2- 172.21.15.42:0/545594482 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562af4f23270 0x562af530a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:13.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.802+0000 7f62abe00640 1 --2- 172.21.15.42:0/545594482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562af4f02590 0x562af5309cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:13.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.802+0000 7f62b0c00640 1 -- 172.21.15.42:0/545594482 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562af4f23270 msgr2=0x562af530a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:13.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.802+0000 7f62b0c00640 1 --2- 172.21.15.42:0/545594482 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562af4f23270 0x562af530a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.802+0000 7f62b0c00640 1 -- 172.21.15.42:0/545594482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562af4f02590 msgr2=0x562af5309cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:13.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.802+0000 7f62b0c00640 1 --2- 172.21.15.42:0/545594482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562af4f02590 0x562af5309cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.802+0000 7f62b0c00640 1 -- 172.21.15.42:0/545594482 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562af53208d0 con 0x562af4efa3b0 2024-09-17T01:44:13.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.802+0000 7f62abe00640 1 --2- 172.21.15.42:0/545594482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562af4f02590 0x562af5309cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:44:13.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.802+0000 7f62b0c00640 1 --2- 172.21.15.42:0/545594482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4efa3b0 0x562af538bd10 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f62a0082930 tx=0x7f62a00b8fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8cc5c3a7e6e5dc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:13.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.802+0000 7f6291600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:44:13.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.803+0000 7f6291600640 1 -- 172.21.15.42:0/545594482 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a008c280 con 0x562af4efa3b0 2024-09-17T01:44:13.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.803+0000 7f6291600640 1 -- 172.21.15.42:0/545594482 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7f62a008bdf0 con 0x562af4efa3b0 2024-09-17T01:44:13.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.803+0000 7f62ba843740 1 -- 172.21.15.42:0/545594482 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f629801c750 con 0x562af4efa3b0 2024-09-17T01:44:13.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.803+0000 7f6291600640 1 -- 172.21.15.42:0/545594482 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=125) ==== 24+0+0 (secure 0 0 0) 0x7f62a008bff0 con 0x562af4efa3b0 2024-09-17T01:44:13.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.803+0000 7f62ba843740 10 client.9651 fetch_fsmap learned FSMap version 125 2024-09-17T01:44:13.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.803+0000 7f62ba843740 1 -- 172.21.15.42:0/545594482 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=125,monmap=2+}) -- 0x562af5320f90 con 0x562af4efa3b0 2024-09-17T01:44:13.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.803+0000 7f6291600640 1 -- 172.21.15.42:0/545594482 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f629801c750 con 0x562af4efa3b0 2024-09-17T01:44:13.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.803+0000 7f6291600640 1 -- 172.21.15.42:0/545594482 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 125) ==== 3502+0+0 (secure 0 0 0) 0x7f62a0081c00 con 0x562af4efa3b0 2024-09-17T01:44:13.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.803+0000 7f62ba843740 10 client.9651 fetch_fsmap finished waiting for FSMap version 125 2024-09-17T01:44:13.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.803+0000 7f62ba843740 10 client.9651 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:44:13.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.803+0000 7f62ba843740 20 client.9651 populate_metadata read hostname 'smithi042' 2024-09-17T01:44:13.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.803+0000 7f62ba843740 1 --2- 172.21.15.42:0/545594482 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x562af538ee40 0x562af538f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:13.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.803+0000 7f62ba843740 4 client.9651 mds_command: new command op to 9516 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T01:44:13.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.803+0000 7f62ba843740 1 -- 172.21.15.42:0/545594482 --> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] -- command(tid 0: {"prefix": "status"}) -- 0x562af530aba0 con 0x562af538ee40 2024-09-17T01:44:13.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.804+0000 7f62abe00640 1 --2- 172.21.15.42:0/545594482 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x562af538ee40 0x562af538f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:13.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.804+0000 7f6291600640 10 client.9651 ms_handle_connect on v2:172.21.15.42:6833/1557345672 2024-09-17T01:44:13.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.804+0000 7f62abe00640 1 --2- 172.21.15.42:0/545594482 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x562af538ee40 0x562af538f250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8d90b947fae27d1 server_cookie=a131f8fb2add9f7 in_seq=0 out_seq=0 2024-09-17T01:44:13.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.804+0000 7f6291600640 1 -- 172.21.15.42:0/545594482 <== mds.0 v2:172.21.15.42:6833/1557345672 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x562af530aba0 con 0x562af538ee40 2024-09-17T01:44:13.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.804+0000 7f6291600640 10 client.9651 handle_command_reply: tid=0 2024-09-17T01:44:13.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.804+0000 7f62ba843740 1 client.9651 shutdown 2024-09-17T01:44:13.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.805+0000 7f62ba843740 1 -- 172.21.15.42:0/545594482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4efa3b0 msgr2=0x562af538bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:13.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.805+0000 7f62ba843740 1 --2- 172.21.15.42:0/545594482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4efa3b0 0x562af538bd10 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f62a0082930 tx=0x7f62a00b8fa0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.805+0000 7f62ba843740 1 -- 172.21.15.42:0/545594482 shutdown_connections 2024-09-17T01:44:13.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.805+0000 7f62ba843740 1 --2- 172.21.15.42:0/545594482 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x562af538ee40 0x562af538f250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.805+0000 7f62ba843740 1 --2- 172.21.15.42:0/545594482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562af4f02590 0x562af5309cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.805+0000 7f62ba843740 1 --2- 172.21.15.42:0/545594482 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562af4f23270 0x562af530a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.805+0000 7f6291600640 0 client.9651 ms_handle_reset on v2:172.21.15.42:6833/1557345672 2024-09-17T01:44:13.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.805+0000 7f62ba843740 1 --2- 172.21.15.42:0/545594482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562af4efa3b0 0x562af538bd10 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.805+0000 7f62ba843740 1 -- 172.21.15.42:0/545594482 >> 172.21.15.42:0/545594482 conn(0x562af4f173c0 msgr2=0x562af52f0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:13.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.805+0000 7f62ba843740 1 -- 172.21.15.42:0/545594482 shutdown_connections 2024-09-17T01:44:13.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.805+0000 7f62ba843740 1 -- 172.21.15.42:0/545594482 wait complete. 2024-09-17T01:44:13.812 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.805+0000 7f62ba843740 20 client.9651 trim_cache size 0 max 16384 2024-09-17T01:44:13.813 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:44:13.813 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "fea1c88c-cb05-432f-a745-f9dcbb5f2503", 2024-09-17T01:44:13.813 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-17T01:44:13.813 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 9516, 2024-09-17T01:44:13.813 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-17T01:44:13.813 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-17T01:44:13.813 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-17T01:44:13.814 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 6.7703240210000004, 2024-09-17T01:44:13.814 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 125, 2024-09-17T01:44:13.814 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 160, 2024-09-17T01:44:13.814 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 160, 2024-09-17T01:44:13.814 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 11.721678534 2024-09-17T01:44:13.814 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:44:13.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.806+0000 7f62b3600640 1 -- 172.21.15.42:0/1756103603 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f628c078b90 msgr2=0x7f628c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:13.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.806+0000 7f62b3600640 1 --2- 172.21.15.42:0/1756103603 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f628c078b90 0x7f628c07b0a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f62ac1429c0 tx=0x7f6298005f90 comp rx=0 tx=0).stop 2024-09-17T01:44:13.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.806+0000 7f62b3600640 1 -- 172.21.15.42:0/1756103603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6294003c10 msgr2=0x7f62ac15fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:13.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.806+0000 7f62b3600640 1 --2- 172.21.15.42:0/1756103603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6294003c10 0x7f62ac15fb90 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f62a0001920 tx=0x7f62a00060e0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.806+0000 7f62b3600640 1 -- 172.21.15.42:0/1756103603 shutdown_connections 2024-09-17T01:44:13.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.806+0000 7f62b3600640 1 --2- 172.21.15.42:0/1756103603 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f628c078b90 0x7f628c07b0a0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.806+0000 7f62b3600640 1 --2- 172.21.15.42:0/1756103603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62ac06f210 0x7f62ac06f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.806+0000 7f62b3600640 1 --2- 172.21.15.42:0/1756103603 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f62ac134660 0x7f62ac1f88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.815 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.806+0000 7f62b3600640 1 --2- 172.21.15.42:0/1756103603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6294003c10 0x7f62ac15fb90 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:13.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.806+0000 7f62b3600640 1 -- 172.21.15.42:0/1756103603 >> 172.21.15.42:0/1756103603 conn(0x7f62ac0b2930 msgr2=0x7f62ac073f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:13.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.806+0000 7f62b3600640 1 -- 172.21.15.42:0/1756103603 shutdown_connections 2024-09-17T01:44:13.816 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:13.806+0000 7f62b3600640 1 -- 172.21.15.42:0/1756103603 wait complete. 2024-09-17T01:44:13.825 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T01:44:14.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.053+0000 7f8133000640 1 -- 172.21.15.42:0/776003068 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f812c162fa0 msgr2=0x7f812c15e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:14.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.053+0000 7f8133000640 1 --2- 172.21.15.42:0/776003068 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f812c162fa0 0x7f812c15e910 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8118009830 tx=0x7f811802a480 comp rx=0 tx=0).stop 2024-09-17T01:44:14.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.054+0000 7f8133000640 1 -- 172.21.15.42:0/776003068 shutdown_connections 2024-09-17T01:44:14.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.054+0000 7f8133000640 1 --2- 172.21.15.42:0/776003068 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f812c162fa0 0x7f812c15e910 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:14.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.054+0000 7f8133000640 1 --2- 172.21.15.42:0/776003068 >> v2:172.21.15.43:3300/0 conn(0x7f812c073340 0x7f812c0d2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:14.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.054+0000 7f8133000640 1 -- 172.21.15.42:0/776003068 >> 172.21.15.42:0/776003068 conn(0x7f812c0d1210 msgr2=0x7f812c0d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:14.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.054+0000 7f8133000640 1 -- 172.21.15.42:0/776003068 shutdown_connections 2024-09-17T01:44:14.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.054+0000 7f8133000640 1 -- 172.21.15.42:0/776003068 wait complete. 2024-09-17T01:44:14.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.056+0000 7f8133000640 1 Processor -- start 2024-09-17T01:44:14.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.056+0000 7f8133000640 1 -- start start 2024-09-17T01:44:14.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.058+0000 7f8133000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f812c073340 0x7f812c14c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:14.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.058+0000 7f8133000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f812c0b6030 0x7f812c1f5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:14.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.058+0000 7f8133000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f812c162fa0 0x7f812c1f6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:14.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.058+0000 7f8133000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f812c15f850 con 0x7f812c162fa0 2024-09-17T01:44:14.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.058+0000 7f8133000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f812c15f6d0 con 0x7f812c0b6030 2024-09-17T01:44:14.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.058+0000 7f8133000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f812c15f9d0 con 0x7f812c073340 2024-09-17T01:44:14.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.058+0000 7f8132600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f812c162fa0 0x7f812c1f6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:14.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.058+0000 7f8132600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f812c162fa0 0x7f812c1f6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36502/0 (socket says 172.21.15.42:36502) 2024-09-17T01:44:14.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.058+0000 7f8132600640 1 -- 172.21.15.42:0/1474982707 learned_addr learned my addr 172.21.15.42:0/1474982707 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:14.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.058+0000 7f8131c00640 1 --2- 172.21.15.42:0/1474982707 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f812c073340 0x7f812c14c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:14.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.058+0000 7f8131200640 1 --2- 172.21.15.42:0/1474982707 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f812c0b6030 0x7f812c1f5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:14.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.059+0000 7f8132600640 1 -- 172.21.15.42:0/1474982707 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f812c073340 msgr2=0x7f812c14c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:14.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.059+0000 7f8132600640 1 --2- 172.21.15.42:0/1474982707 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f812c073340 0x7f812c14c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:14.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.059+0000 7f8132600640 1 -- 172.21.15.42:0/1474982707 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f812c0b6030 msgr2=0x7f812c1f5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:14.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.059+0000 7f8132600640 1 --2- 172.21.15.42:0/1474982707 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f812c0b6030 0x7f812c1f5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:14.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.059+0000 7f8132600640 1 -- 172.21.15.42:0/1474982707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812c1595e0 con 0x7f812c162fa0 2024-09-17T01:44:14.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.059+0000 7f8132600640 1 --2- 172.21.15.42:0/1474982707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f812c162fa0 0x7f812c1f6020 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f812400cb10 tx=0x7f812400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:14.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.059+0000 7f8129600640 1 -- 172.21.15.42:0/1474982707 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8124016020 con 0x7f812c162fa0 2024-09-17T01:44:14.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.059+0000 7f8129600640 1 -- 172.21.15.42:0/1474982707 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f812400ad80 con 0x7f812c162fa0 2024-09-17T01:44:14.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.059+0000 7f8129600640 1 -- 172.21.15.42:0/1474982707 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8124012680 con 0x7f812c162fa0 2024-09-17T01:44:14.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.059+0000 7f8133000640 1 -- 172.21.15.42:0/1474982707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f812c158540 con 0x7f812c162fa0 2024-09-17T01:44:14.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.060+0000 7f8133000640 1 -- 172.21.15.42:0/1474982707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f812c158b00 con 0x7f812c162fa0 2024-09-17T01:44:14.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.061+0000 7f8133000640 1 -- 172.21.15.42:0/1474982707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f812c0d2810 con 0x7f812c162fa0 2024-09-17T01:44:14.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.062+0000 7f8129600640 1 -- 172.21.15.42:0/1474982707 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8124019020 con 0x7f812c162fa0 2024-09-17T01:44:14.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.063+0000 7f8129600640 1 --2- 172.21.15.42:0/1474982707 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f810c078bc0 0x7f810c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:14.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.063+0000 7f8129600640 1 -- 172.21.15.42:0/1474982707 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7f812409b220 con 0x7f812c162fa0 2024-09-17T01:44:14.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.064+0000 7f8131c00640 1 --2- 172.21.15.42:0/1474982707 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f810c078bc0 0x7f810c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:14.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.065+0000 7f8131c00640 1 --2- 172.21.15.42:0/1474982707 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f810c078bc0 0x7f810c07b0d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8120009b30 tx=0x7f8120005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:14.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.068+0000 7f8129600640 1 -- 172.21.15.42:0/1474982707 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8124020020 con 0x7f812c162fa0 2024-09-17T01:44:14.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.307+0000 7f8133000640 1 -- 172.21.15.42:0/1474982707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f812c1582b0 con 0x7f812c162fa0 2024-09-17T01:44:14.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.307+0000 7f8129600640 1 -- 172.21.15.42:0/1474982707 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v125) ==== 53+0+73 (secure 0 0 0) 0x7f8124063010 con 0x7f812c162fa0 2024-09-17T01:44:14.305 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T01:44:14.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.310+0000 7f8133000640 1 -- 172.21.15.42:0/1474982707 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f810c078bc0 msgr2=0x7f810c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:14.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.310+0000 7f8133000640 1 --2- 172.21.15.42:0/1474982707 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f810c078bc0 0x7f810c07b0d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8120009b30 tx=0x7f8120005f90 comp rx=0 tx=0).stop 2024-09-17T01:44:14.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.310+0000 7f8133000640 1 -- 172.21.15.42:0/1474982707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f812c162fa0 msgr2=0x7f812c1f6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:14.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.310+0000 7f8133000640 1 --2- 172.21.15.42:0/1474982707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f812c162fa0 0x7f812c1f6020 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f812400cb10 tx=0x7f812400a060 comp rx=0 tx=0).stop 2024-09-17T01:44:14.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.310+0000 7f8133000640 1 -- 172.21.15.42:0/1474982707 shutdown_connections 2024-09-17T01:44:14.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.310+0000 7f8133000640 1 --2- 172.21.15.42:0/1474982707 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f810c078bc0 0x7f810c07b0d0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:14.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.310+0000 7f8133000640 1 --2- 172.21.15.42:0/1474982707 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f812c0b6030 0x7f812c1f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:14.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.310+0000 7f8133000640 1 --2- 172.21.15.42:0/1474982707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f812c162fa0 0x7f812c1f6020 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:14.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.310+0000 7f8133000640 1 --2- 172.21.15.42:0/1474982707 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f812c073340 0x7f812c14c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:14.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.310+0000 7f8133000640 1 -- 172.21.15.42:0/1474982707 >> 172.21.15.42:0/1474982707 conn(0x7f812c0d1210 msgr2=0x7f812c15cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:14.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.310+0000 7f8133000640 1 -- 172.21.15.42:0/1474982707 shutdown_connections 2024-09-17T01:44:14.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14.310+0000 7f8133000640 1 -- 172.21.15.42:0/1474982707 wait complete. 2024-09-17T01:44:14.335 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T01:44:14.335 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:44:14.335 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-09-17T01:44:14.335 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T01:44:14.335 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:44:14.335 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T01:44:14.335 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T01:44:14.335 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:44:14.335 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:44:14.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:44:14.336 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-09-17T01:44:14.371 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:44:14.372 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:44:14.372 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:44:14.372 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:44:14.372 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-17T01:44:14.372 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:44:14.372 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:44:14.372 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-09-17T01:44:14.372 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-09-17T01:44:14.372 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:44:14.372 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-09-17T01:44:14.372 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-09-17T01:44:14.372 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:44:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:44:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-09-17T01:44:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-17T01:44:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 41953sec preferred_lft 41953sec 2024-09-17T01:44:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-17T01:44:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:44:14.373 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:44:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:44:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-09-17T01:44:14.373 INFO:teuthology.orchestra.run.smithi042.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T01:44:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T01:44:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T01:44:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:44:14.374 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::68d2:2bff:fe2f:191a/64 scope link 2024-09-17T01:44:14.374 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:44:14.374 INFO:teuthology.orchestra.run.smithi042.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:44:14.374 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether e2:73:3e:9b:8a:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:44:14.374 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::e073:3eff:fe9b:8a00/64 scope link 2024-09-17T01:44:14.374 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:44:14.374 INFO:teuthology.orchestra.run.smithi042.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:44:14.374 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T01:44:14.374 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::240b:bfff:feb7:6e5b/64 scope link 2024-09-17T01:44:14.374 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:44:14.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:44:14.375 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:44:14.465 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-17T01:44:14.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:44:14.468 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-09-17T01:44:14.504 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-09-17T01:44:14.504 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:44:14.504 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-17T01:44:14.504 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-17T01:44:14.504 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:44:14.505 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:44:14.505 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:14.505 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T01:44:14.505 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T01:44:14.505 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T01:44:14.505 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:14.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:44:14.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:14.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:44:14.704 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-17T01:44:14.739 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T01:44:14.739 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T01:44:14.740 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:44:14.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:44:14.740 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-09-17T01:44:14.837 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:44:14.837 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T01:44:14.873 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:44:14.873 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:44:14.873 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:44:14.949 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T01:44:14.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:44:14.949 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:44:15.149 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:44:15.150 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:44:15.150 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:44:15.170 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:44:15.170 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:44:15.170 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:44:15.170 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:44:15.170 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:44:15.201 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:44:15.201 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:44:15.201 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:44:15.201 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:44:15.201 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:44:15.201 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-09-17T01:44:15.202 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-09-17T01:44:15.202 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fea1c88c-cb05-432f-a745-f9dcbb5f2503" will pass to kernel 2024-09-17T01:44:15.203 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T01:44:15.203 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-09-17T01:44:15.203 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T01:44:15.203 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T01:44:15.203 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T01:44:15.206 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T01:44:15.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:44:15.206 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:44:15.262 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:44:15.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:15.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:15.359 INFO:teuthology.orchestra.run.smithi042.stdout:client8986 2024-09-17T01:44:15.360 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:44:15.360 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:44:15.395 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:44:15.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.664+0000 7ffbea600640 1 -- 172.21.15.42:0/4282729505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbe415ea80 msgr2=0x7ffbe40d1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:15.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.664+0000 7ffbea600640 1 --2- 172.21.15.42:0/4282729505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbe415ea80 0x7ffbe40d1370 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8005fd0 tx=0x7ffbd802a5c0 comp rx=0 tx=0).stop 2024-09-17T01:44:15.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.664+0000 7ffbea600640 1 -- 172.21.15.42:0/4282729505 shutdown_connections 2024-09-17T01:44:15.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.664+0000 7ffbea600640 1 --2- 172.21.15.42:0/4282729505 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbe40d2f50 0x7ffbe40b8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:15.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.664+0000 7ffbea600640 1 --2- 172.21.15.42:0/4282729505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbe415ea80 0x7ffbe40d1370 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:15.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.664+0000 7ffbea600640 1 -- 172.21.15.42:0/4282729505 >> 172.21.15.42:0/4282729505 conn(0x7ffbe406cf00 msgr2=0x7ffbe406d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:15.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.664+0000 7ffbea600640 1 -- 172.21.15.42:0/4282729505 shutdown_connections 2024-09-17T01:44:15.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.664+0000 7ffbea600640 1 -- 172.21.15.42:0/4282729505 wait complete. 2024-09-17T01:44:15.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.666+0000 7ffbea600640 1 Processor -- start 2024-09-17T01:44:15.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.666+0000 7ffbea600640 1 -- start start 2024-09-17T01:44:15.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.668+0000 7ffbea600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbe40d18b0 0x7ffbe41f9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:15.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.668+0000 7ffbea600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbe40d2f50 0x7ffbe41f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:15.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.668+0000 7ffbea600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbe415ea80 0x7ffbe41f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:15.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.668+0000 7ffbea600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe40b8d50 con 0x7ffbe40d18b0 2024-09-17T01:44:15.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.668+0000 7ffbea600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe40b8bd0 con 0x7ffbe40d2f50 2024-09-17T01:44:15.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.668+0000 7ffbea600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ffbe40b8ed0 con 0x7ffbe415ea80 2024-09-17T01:44:15.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.668+0000 7ffbe9200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbe40d18b0 0x7ffbe41f9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:15.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.668+0000 7ffbe9200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbe40d18b0 0x7ffbe41f9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36522/0 (socket says 172.21.15.42:36522) 2024-09-17T01:44:15.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.668+0000 7ffbe9200640 1 -- 172.21.15.42:0/500115017 learned_addr learned my addr 172.21.15.42:0/500115017 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:15.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.668+0000 7ffbe9c00640 1 --2- 172.21.15.42:0/500115017 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbe415ea80 0x7ffbe41f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:15.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.668+0000 7ffbe3e00640 1 --2- 172.21.15.42:0/500115017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbe40d2f50 0x7ffbe41f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:15.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.668+0000 7ffbe9200640 1 -- 172.21.15.42:0/500115017 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbe415ea80 msgr2=0x7ffbe41f5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:15.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.668+0000 7ffbe9200640 1 --2- 172.21.15.42:0/500115017 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbe415ea80 0x7ffbe41f5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:15.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.668+0000 7ffbe9200640 1 -- 172.21.15.42:0/500115017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbe40d2f50 msgr2=0x7ffbe41f5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:15.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.668+0000 7ffbe9200640 1 --2- 172.21.15.42:0/500115017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbe40d2f50 0x7ffbe41f5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:15.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.668+0000 7ffbe9200640 1 -- 172.21.15.42:0/500115017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe41f6720 con 0x7ffbe40d18b0 2024-09-17T01:44:15.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.669+0000 7ffbe9200640 1 --2- 172.21.15.42:0/500115017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbe40d18b0 0x7ffbe41f9170 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8034040 tx=0x7ffbd80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:15.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.669+0000 7ffbe0c00640 1 -- 172.21.15.42:0/500115017 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd803e030 con 0x7ffbe40d18b0 2024-09-17T01:44:15.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.669+0000 7ffbe0c00640 1 -- 172.21.15.42:0/500115017 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffbd8003db0 con 0x7ffbe40d18b0 2024-09-17T01:44:15.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.669+0000 7ffbea600640 1 -- 172.21.15.42:0/500115017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbe40ac160 con 0x7ffbe40d18b0 2024-09-17T01:44:15.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.669+0000 7ffbe0c00640 1 -- 172.21.15.42:0/500115017 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8035040 con 0x7ffbe40d18b0 2024-09-17T01:44:15.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.669+0000 7ffbea600640 1 -- 172.21.15.42:0/500115017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbe414cf70 con 0x7ffbe40d18b0 2024-09-17T01:44:15.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.670+0000 7ffbea600640 1 -- 172.21.15.42:0/500115017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbe40b9480 con 0x7ffbe40d18b0 2024-09-17T01:44:15.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.672+0000 7ffbe0c00640 1 -- 172.21.15.42:0/500115017 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffbd8041030 con 0x7ffbe40d18b0 2024-09-17T01:44:15.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.672+0000 7ffbe0c00640 1 --2- 172.21.15.42:0/500115017 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ffbc4078b90 0x7ffbc407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:15.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.673+0000 7ffbe0c00640 1 -- 172.21.15.42:0/500115017 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7ffbd80bb400 con 0x7ffbe40d18b0 2024-09-17T01:44:15.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.673+0000 7ffbe3e00640 1 --2- 172.21.15.42:0/500115017 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ffbc4078b90 0x7ffbc407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:15.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.674+0000 7ffbe3e00640 1 --2- 172.21.15.42:0/500115017 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ffbc4078b90 0x7ffbc407b0a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0000f60 tx=0x7ffbd0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:15.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.677+0000 7ffbe0c00640 1 -- 172.21.15.42:0/500115017 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffbe40d3360 con 0x7ffbe40d18b0 2024-09-17T01:44:15.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.908+0000 7ffbea600640 1 -- 172.21.15.42:0/500115017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffbe40cee50 con 0x7ffbe40d18b0 2024-09-17T01:44:15.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.909+0000 7ffbe0c00640 1 -- 172.21.15.42:0/500115017 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5230 (secure 0 0 0) 0x7ffbd80838c0 con 0x7ffbe40d18b0 2024-09-17T01:44:15.907 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:44:15.907 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":125,"btime":"2024-09-17T01:44:10:057034+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8872,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3393274334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3393274334},{"type":"v1","addr":"172.21.15.43:6836","nonce":3393274334}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":8875,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2869136532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2869136532},{"type":"v1","addr":"172.21.15.43:6837","nonce":2869136532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":9513,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/297557585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":297557585},{"type":"v1","addr":"172.21.15.42:6834","nonce":297557585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":119}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:44:06.556661+0000","modified":"2024-09-17T01:44:09.563813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9516},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9516":{"gid":9516,"name":"c","rank":0,"incarnation":121,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1557345672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1557345672},{"type":"v1","addr":"172.21.15.42:6835","nonce":1557345672}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9516,"qdb_cluster":[9516]},"id":11}]} 2024-09-17T01:44:15.907 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 125 2024-09-17T01:44:15.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.911+0000 7ffbea600640 1 -- 172.21.15.42:0/500115017 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ffbc4078b90 msgr2=0x7ffbc407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:15.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.911+0000 7ffbea600640 1 --2- 172.21.15.42:0/500115017 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ffbc4078b90 0x7ffbc407b0a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0000f60 tx=0x7ffbd0009040 comp rx=0 tx=0).stop 2024-09-17T01:44:15.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.911+0000 7ffbea600640 1 -- 172.21.15.42:0/500115017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbe40d18b0 msgr2=0x7ffbe41f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:15.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.911+0000 7ffbea600640 1 --2- 172.21.15.42:0/500115017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbe40d18b0 0x7ffbe41f9170 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8034040 tx=0x7ffbd80038a0 comp rx=0 tx=0).stop 2024-09-17T01:44:15.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.911+0000 7ffbea600640 1 -- 172.21.15.42:0/500115017 shutdown_connections 2024-09-17T01:44:15.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.911+0000 7ffbea600640 1 --2- 172.21.15.42:0/500115017 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ffbc4078b90 0x7ffbc407b0a0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:15.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.911+0000 7ffbea600640 1 --2- 172.21.15.42:0/500115017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbe40d2f50 0x7ffbe41f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:15.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.911+0000 7ffbea600640 1 --2- 172.21.15.42:0/500115017 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ffbe415ea80 0x7ffbe41f5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:15.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.911+0000 7ffbea600640 1 --2- 172.21.15.42:0/500115017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbe40d18b0 0x7ffbe41f9170 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:15.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.911+0000 7ffbea600640 1 -- 172.21.15.42:0/500115017 >> 172.21.15.42:0/500115017 conn(0x7ffbe406cf00 msgr2=0x7ffbe40cd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:15.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.911+0000 7ffbea600640 1 -- 172.21.15.42:0/500115017 shutdown_connections 2024-09-17T01:44:15.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:15.911+0000 7ffbea600640 1 -- 172.21.15.42:0/500115017 wait complete. 2024-09-17T01:44:15.933 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:44:16.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.164+0000 7fc536200640 1 -- 172.21.15.42:0/3081069222 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc514004800 msgr2=0x7fc514004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:16.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.164+0000 7fc536200640 1 --2- 172.21.15.42:0/3081069222 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc514004800 0x7fc514004c10 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fc51800c4a0 tx=0x7fc514005830 comp rx=0 tx=0).stop 2024-09-17T01:44:16.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.164+0000 7fc535800640 1 -- 172.21.15.42:0/3081069222 reap_dead start 2024-09-17T01:44:16.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.164+0000 7fc536200640 1 -- 172.21.15.42:0/3081069222 shutdown_connections 2024-09-17T01:44:16.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.164+0000 7fc536200640 1 -- 172.21.15.42:0/3081069222 >> 172.21.15.42:0/3081069222 conn(0x7fc5300b25f0 msgr2=0x7fc5300d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:16.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.164+0000 7fc536200640 1 -- 172.21.15.42:0/3081069222 shutdown_connections 2024-09-17T01:44:16.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.164+0000 7fc536200640 1 -- 172.21.15.42:0/3081069222 wait complete. 2024-09-17T01:44:16.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.167+0000 7fc536200640 1 Processor -- start 2024-09-17T01:44:16.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.167+0000 7fc536200640 1 -- start start 2024-09-17T01:44:16.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.168+0000 7fc536200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc514004800 0x7fc530074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:16.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.168+0000 7fc536200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5301f8910 0x7fc5301f8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:16.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.168+0000 7fc536200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5301f9260 0x7fc5300add00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:16.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.168+0000 7fc536200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc53015d6b0 con 0x7fc514004800 2024-09-17T01:44:16.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.168+0000 7fc536200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc5300b42c0 con 0x7fc5301f9260 2024-09-17T01:44:16.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.168+0000 7fc536200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc53015d830 con 0x7fc5301f8910 2024-09-17T01:44:16.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.168+0000 7fc534e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc514004800 0x7fc530074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:16.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.168+0000 7fc534e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc514004800 0x7fc530074ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55702/0 (socket says 172.21.15.42:55702) 2024-09-17T01:44:16.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.169+0000 7fc534e00640 1 -- 172.21.15.42:0/3614858618 learned_addr learned my addr 172.21.15.42:0/3614858618 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:16.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.169+0000 7fc527e00640 1 --2- 172.21.15.42:0/3614858618 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5301f8910 0x7fc5301f8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:16.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.169+0000 7fc535800640 1 --2- 172.21.15.42:0/3614858618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5301f9260 0x7fc5300add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:16.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.169+0000 7fc534e00640 1 -- 172.21.15.42:0/3614858618 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5301f8910 msgr2=0x7fc5301f8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:16.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.169+0000 7fc534e00640 1 --2- 172.21.15.42:0/3614858618 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5301f8910 0x7fc5301f8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:16.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.169+0000 7fc534e00640 1 -- 172.21.15.42:0/3614858618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5301f9260 msgr2=0x7fc5300add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:16.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.169+0000 7fc534e00640 1 --2- 172.21.15.42:0/3614858618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5301f9260 0x7fc5300add00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:16.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.169+0000 7fc534e00640 1 -- 172.21.15.42:0/3614858618 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5301f64e0 con 0x7fc514004800 2024-09-17T01:44:16.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.169+0000 7fc534e00640 1 --2- 172.21.15.42:0/3614858618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc514004800 0x7fc530074ac0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7fc520011ae0 tx=0x7fc520009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:16.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.170+0000 7fc52d600640 1 -- 172.21.15.42:0/3614858618 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc52001e070 con 0x7fc514004800 2024-09-17T01:44:16.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.170+0000 7fc52d600640 1 -- 172.21.15.42:0/3614858618 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc52000fe70 con 0x7fc514004800 2024-09-17T01:44:16.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.170+0000 7fc536200640 1 -- 172.21.15.42:0/3614858618 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5300cbde0 con 0x7fc514004800 2024-09-17T01:44:16.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.170+0000 7fc52d600640 1 -- 172.21.15.42:0/3614858618 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc520004290 con 0x7fc514004800 2024-09-17T01:44:16.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.170+0000 7fc536200640 1 -- 172.21.15.42:0/3614858618 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5300ad500 con 0x7fc514004800 2024-09-17T01:44:16.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.171+0000 7fc536200640 1 -- 172.21.15.42:0/3614858618 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5301f66b0 con 0x7fc514004800 2024-09-17T01:44:16.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.172+0000 7fc52d600640 1 -- 172.21.15.42:0/3614858618 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc520021070 con 0x7fc514004800 2024-09-17T01:44:16.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.173+0000 7fc52d600640 1 --2- 172.21.15.42:0/3614858618 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc50c078b90 0x7fc50c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:16.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.173+0000 7fc52d600640 1 -- 172.21.15.42:0/3614858618 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7fc52009b7d0 con 0x7fc514004800 2024-09-17T01:44:16.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.174+0000 7fc527e00640 1 --2- 172.21.15.42:0/3614858618 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc50c078b90 0x7fc50c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:16.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.174+0000 7fc527e00640 1 --2- 172.21.15.42:0/3614858618 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc50c078b90 0x7fc50c07b0a0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc518033000 tx=0x7fc53006fae0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:16.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.177+0000 7fc52d600640 1 -- 172.21.15.42:0/3614858618 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc5200635e0 con 0x7fc514004800 2024-09-17T01:44:16.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.406+0000 7fc536200640 1 -- 172.21.15.42:0/3614858618 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc530153750 con 0x7fc514004800 2024-09-17T01:44:16.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.407+0000 7fc52d600640 1 -- 172.21.15.42:0/3614858618 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5230 (secure 0 0 0) 0x7fc520068010 con 0x7fc514004800 2024-09-17T01:44:16.405 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:44:16.405 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":125,"btime":"2024-09-17T01:44:10:057034+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8872,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3393274334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3393274334},{"type":"v1","addr":"172.21.15.43:6836","nonce":3393274334}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":8875,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2869136532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2869136532},{"type":"v1","addr":"172.21.15.43:6837","nonce":2869136532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":9513,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/297557585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":297557585},{"type":"v1","addr":"172.21.15.42:6834","nonce":297557585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":119}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:44:06.556661+0000","modified":"2024-09-17T01:44:09.563813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9516},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9516":{"gid":9516,"name":"c","rank":0,"incarnation":121,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1557345672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1557345672},{"type":"v1","addr":"172.21.15.42:6835","nonce":1557345672}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9516,"qdb_cluster":[9516]},"id":11}]} 2024-09-17T01:44:16.405 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 125 2024-09-17T01:44:16.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.409+0000 7fc536200640 1 -- 172.21.15.42:0/3614858618 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc50c078b90 msgr2=0x7fc50c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:16.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.409+0000 7fc536200640 1 --2- 172.21.15.42:0/3614858618 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc50c078b90 0x7fc50c07b0a0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc518033000 tx=0x7fc53006fae0 comp rx=0 tx=0).stop 2024-09-17T01:44:16.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.409+0000 7fc536200640 1 -- 172.21.15.42:0/3614858618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc514004800 msgr2=0x7fc530074ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:16.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.409+0000 7fc536200640 1 --2- 172.21.15.42:0/3614858618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc514004800 0x7fc530074ac0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7fc520011ae0 tx=0x7fc520009e90 comp rx=0 tx=0).stop 2024-09-17T01:44:16.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.409+0000 7fc536200640 1 -- 172.21.15.42:0/3614858618 shutdown_connections 2024-09-17T01:44:16.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.409+0000 7fc536200640 1 --2- 172.21.15.42:0/3614858618 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc50c078b90 0x7fc50c07b0a0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:16.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.409+0000 7fc536200640 1 --2- 172.21.15.42:0/3614858618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5301f9260 0x7fc5300add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:16.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.409+0000 7fc536200640 1 --2- 172.21.15.42:0/3614858618 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc5301f8910 0x7fc5301f8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:16.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.409+0000 7fc536200640 1 --2- 172.21.15.42:0/3614858618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc514004800 0x7fc530074ac0 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:16.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.409+0000 7fc536200640 1 -- 172.21.15.42:0/3614858618 >> 172.21.15.42:0/3614858618 conn(0x7fc5300b25f0 msgr2=0x7fc5300b1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:16.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.410+0000 7fc536200640 1 -- 172.21.15.42:0/3614858618 shutdown_connections 2024-09-17T01:44:16.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16.410+0000 7fc536200640 1 -- 172.21.15.42:0/3614858618 wait complete. 2024-09-17T01:44:16.430 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:16.430 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:16.430 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.0 2024-09-17T01:44:16.430 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:16.430 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:16.430 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:16.430 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:16.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:16.545 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:16.545 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:16.545 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166073 s, 63.1 MB/s 2024-09-17T01:44:16.572 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:16.572 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:16.572 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237416 s, 44.2 MB/s 2024-09-17T01:44:16.590 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:16.591 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:16.591 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149042 s, 70.4 MB/s 2024-09-17T01:44:16.613 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:16.613 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:16.613 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192172 s, 54.6 MB/s 2024-09-17T01:44:16.633 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:16.634 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:16.634 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016523 s, 63.5 MB/s 2024-09-17T01:44:16.660 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:16.660 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:16.660 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229962 s, 45.6 MB/s 2024-09-17T01:44:16.679 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:16.679 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:16.679 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153217 s, 68.4 MB/s 2024-09-17T01:44:16.703 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:16.703 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:16.703 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205541 s, 51.0 MB/s 2024-09-17T01:44:16.734 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:16.734 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:16.734 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270018 s, 38.8 MB/s 2024-09-17T01:44:16.751 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:16.751 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:16.751 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140447 s, 74.7 MB/s 2024-09-17T01:44:16.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:16.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:16.771 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163324 s, 64.2 MB/s 2024-09-17T01:44:16.791 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:16.791 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:16.791 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161944 s, 64.7 MB/s 2024-09-17T01:44:16.813 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:16.813 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:16.813 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183816 s, 57.0 MB/s 2024-09-17T01:44:16.829 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:16.829 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:16.829 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124046 s, 84.5 MB/s 2024-09-17T01:44:16.849 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:16.850 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:16.850 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168188 s, 62.3 MB/s 2024-09-17T01:44:16.870 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:16.870 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:16.870 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164404 s, 63.8 MB/s 2024-09-17T01:44:16.895 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:16.895 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:16.895 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211765 s, 49.5 MB/s 2024-09-17T01:44:16.917 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:16.917 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:16.917 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183974 s, 57.0 MB/s 2024-09-17T01:44:16.937 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:16.937 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:16.937 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170918 s, 61.3 MB/s 2024-09-17T01:44:16.960 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:16.960 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:16.960 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018572 s, 56.5 MB/s 2024-09-17T01:44:16.982 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:16.982 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:16.983 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191607 s, 54.7 MB/s 2024-09-17T01:44:17.001 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.001 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.002 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154795 s, 67.7 MB/s 2024-09-17T01:44:17.019 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.020 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.020 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145887 s, 71.9 MB/s 2024-09-17T01:44:17.037 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.037 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.037 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141808 s, 73.9 MB/s 2024-09-17T01:44:17.057 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.057 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.057 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165519 s, 63.4 MB/s 2024-09-17T01:44:17.076 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.076 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.076 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156825 s, 66.9 MB/s 2024-09-17T01:44:17.097 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.097 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.097 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177354 s, 59.1 MB/s 2024-09-17T01:44:17.119 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.119 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.119 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192244 s, 54.5 MB/s 2024-09-17T01:44:17.139 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.139 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.139 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016781 s, 62.5 MB/s 2024-09-17T01:44:17.160 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.160 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.160 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176439 s, 59.4 MB/s 2024-09-17T01:44:17.182 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.182 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.183 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019342 s, 54.2 MB/s 2024-09-17T01:44:17.200 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.200 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.200 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014249 s, 73.6 MB/s 2024-09-17T01:44:17.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:17.209 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:17.209 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:17.209 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.1 2024-09-17T01:44:17.209 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:17.209 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:17.210 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:17.210 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:17.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:17.310 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.310 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.310 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146805 s, 71.4 MB/s 2024-09-17T01:44:17.328 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.329 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.329 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151568 s, 69.2 MB/s 2024-09-17T01:44:17.350 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.350 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.350 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185399 s, 56.6 MB/s 2024-09-17T01:44:17.371 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.371 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.371 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172283 s, 60.9 MB/s 2024-09-17T01:44:17.388 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.388 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.388 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143407 s, 73.1 MB/s 2024-09-17T01:44:17.407 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.407 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.407 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157079 s, 66.8 MB/s 2024-09-17T01:44:17.429 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.429 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.429 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190861 s, 54.9 MB/s 2024-09-17T01:44:17.448 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.448 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.448 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159328 s, 65.8 MB/s 2024-09-17T01:44:17.467 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.467 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.467 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160373 s, 65.4 MB/s 2024-09-17T01:44:17.485 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.485 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.485 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148778 s, 70.5 MB/s 2024-09-17T01:44:17.507 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.507 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.508 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189629 s, 55.3 MB/s 2024-09-17T01:44:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.530 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198154 s, 52.9 MB/s 2024-09-17T01:44:17.549 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.549 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.550 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159832 s, 65.6 MB/s 2024-09-17T01:44:17.568 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.568 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.568 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156463 s, 67.0 MB/s 2024-09-17T01:44:17.587 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.587 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.587 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155582 s, 67.4 MB/s 2024-09-17T01:44:17.607 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.608 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.608 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171238 s, 61.2 MB/s 2024-09-17T01:44:17.629 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.629 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.629 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187225 s, 56.0 MB/s 2024-09-17T01:44:17.647 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.647 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.647 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014184 s, 73.9 MB/s 2024-09-17T01:44:17.669 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.669 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.669 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189092 s, 55.5 MB/s 2024-09-17T01:44:17.693 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.693 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.693 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209043 s, 50.2 MB/s 2024-09-17T01:44:17.711 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.711 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.711 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151543 s, 69.2 MB/s 2024-09-17T01:44:17.734 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.735 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.735 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203527 s, 51.5 MB/s 2024-09-17T01:44:17.753 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.753 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.753 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156435 s, 67.0 MB/s 2024-09-17T01:44:17.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.771 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146617 s, 71.5 MB/s 2024-09-17T01:44:17.789 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.789 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.789 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147987 s, 70.9 MB/s 2024-09-17T01:44:17.807 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.807 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.807 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148284 s, 70.7 MB/s 2024-09-17T01:44:17.824 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.825 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.825 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143234 s, 73.2 MB/s 2024-09-17T01:44:17.841 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.842 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.842 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137647 s, 76.2 MB/s 2024-09-17T01:44:17.860 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.860 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.860 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155868 s, 67.3 MB/s 2024-09-17T01:44:17.878 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.878 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.878 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143137 s, 73.3 MB/s 2024-09-17T01:44:17.895 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.895 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.895 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138552 s, 75.7 MB/s 2024-09-17T01:44:17.912 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:17.912 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:17.912 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137061 s, 76.5 MB/s 2024-09-17T01:44:17.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:17.921 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:17.921 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:17.921 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.2 2024-09-17T01:44:17.922 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:17.922 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:17.922 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:17.922 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:18.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:18.022 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.022 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.022 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142588 s, 73.5 MB/s 2024-09-17T01:44:18.047 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.047 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.047 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218425 s, 48.0 MB/s 2024-09-17T01:44:18.065 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.065 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.065 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145647 s, 72.0 MB/s 2024-09-17T01:44:18.083 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.083 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.083 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014887 s, 70.4 MB/s 2024-09-17T01:44:18.104 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.105 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.105 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183586 s, 57.1 MB/s 2024-09-17T01:44:18.122 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.122 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.122 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141221 s, 74.3 MB/s 2024-09-17T01:44:18.139 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.139 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.139 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141332 s, 74.2 MB/s 2024-09-17T01:44:18.157 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.157 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.157 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142066 s, 73.8 MB/s 2024-09-17T01:44:18.174 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.174 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.174 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139041 s, 75.4 MB/s 2024-09-17T01:44:18.191 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.191 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.191 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144337 s, 72.6 MB/s 2024-09-17T01:44:18.212 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.212 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.212 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176566 s, 59.4 MB/s 2024-09-17T01:44:18.231 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.231 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.231 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158099 s, 66.3 MB/s 2024-09-17T01:44:18.248 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.248 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.249 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141323 s, 74.2 MB/s 2024-09-17T01:44:18.266 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.266 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.266 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148669 s, 70.5 MB/s 2024-09-17T01:44:18.284 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.284 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.284 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144067 s, 72.8 MB/s 2024-09-17T01:44:18.302 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.303 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.303 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151324 s, 69.3 MB/s 2024-09-17T01:44:18.325 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.326 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.326 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197952 s, 53.0 MB/s 2024-09-17T01:44:18.342 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.342 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.342 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137899 s, 76.0 MB/s 2024-09-17T01:44:18.364 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.365 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.365 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185566 s, 56.5 MB/s 2024-09-17T01:44:18.381 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.381 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.381 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013686 s, 76.6 MB/s 2024-09-17T01:44:18.398 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.398 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.398 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139615 s, 75.1 MB/s 2024-09-17T01:44:18.420 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.420 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.420 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185995 s, 56.4 MB/s 2024-09-17T01:44:18.440 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.441 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.441 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171724 s, 61.1 MB/s 2024-09-17T01:44:18.458 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.458 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.458 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143859 s, 72.9 MB/s 2024-09-17T01:44:18.475 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.475 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.475 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142837 s, 73.4 MB/s 2024-09-17T01:44:18.493 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.493 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.493 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148805 s, 70.5 MB/s 2024-09-17T01:44:18.511 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.511 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.511 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141922 s, 73.9 MB/s 2024-09-17T01:44:18.528 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.528 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.528 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137808 s, 76.1 MB/s 2024-09-17T01:44:18.547 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.547 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.547 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156009 s, 67.2 MB/s 2024-09-17T01:44:18.564 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.565 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.565 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147087 s, 71.3 MB/s 2024-09-17T01:44:18.583 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.584 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.584 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158156 s, 66.3 MB/s 2024-09-17T01:44:18.601 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.602 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.602 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148969 s, 70.4 MB/s 2024-09-17T01:44:18.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:18.611 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:18.611 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:18.611 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.3 2024-09-17T01:44:18.611 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:18.611 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:18.611 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:18.611 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:18.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:18.714 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.714 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.714 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158361 s, 66.2 MB/s 2024-09-17T01:44:18.731 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.731 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.731 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014024 s, 74.8 MB/s 2024-09-17T01:44:18.749 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.749 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.749 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147008 s, 71.3 MB/s 2024-09-17T01:44:18.767 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.767 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.767 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144647 s, 72.5 MB/s 2024-09-17T01:44:18.788 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.788 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.788 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179634 s, 58.4 MB/s 2024-09-17T01:44:18.808 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.809 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.809 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174677 s, 60.0 MB/s 2024-09-17T01:44:18.827 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.827 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.827 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151346 s, 69.3 MB/s 2024-09-17T01:44:18.844 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.845 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.845 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147267 s, 71.2 MB/s 2024-09-17T01:44:18.863 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.863 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.863 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148951 s, 70.4 MB/s 2024-09-17T01:44:18.880 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.880 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.880 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141857 s, 73.9 MB/s 2024-09-17T01:44:18.901 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.901 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.901 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176143 s, 59.5 MB/s 2024-09-17T01:44:18.922 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.922 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.922 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187479 s, 55.9 MB/s 2024-09-17T01:44:18.939 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.939 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.940 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139097 s, 75.4 MB/s 2024-09-17T01:44:18.964 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.964 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.965 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203838 s, 51.4 MB/s 2024-09-17T01:44:18.982 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:18.982 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:18.982 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015154 s, 69.2 MB/s 2024-09-17T01:44:19.000 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.000 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.000 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153911 s, 68.1 MB/s 2024-09-17T01:44:19.022 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.022 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.022 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018292 s, 57.3 MB/s 2024-09-17T01:44:19.037 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.037 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.037 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122489 s, 85.6 MB/s 2024-09-17T01:44:19.054 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.054 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.055 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145399 s, 72.1 MB/s 2024-09-17T01:44:19.073 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.073 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.073 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154903 s, 67.7 MB/s 2024-09-17T01:44:19.090 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.090 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.090 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141911 s, 73.9 MB/s 2024-09-17T01:44:19.111 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.111 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.111 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174128 s, 60.2 MB/s 2024-09-17T01:44:19.130 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.131 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.131 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164949 s, 63.6 MB/s 2024-09-17T01:44:19.152 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.152 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.153 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187348 s, 56.0 MB/s 2024-09-17T01:44:19.171 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.171 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.171 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153284 s, 68.4 MB/s 2024-09-17T01:44:19.190 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.190 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.190 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159281 s, 65.8 MB/s 2024-09-17T01:44:19.208 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.208 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.208 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146018 s, 71.8 MB/s 2024-09-17T01:44:19.226 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.227 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.227 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155184 s, 67.6 MB/s 2024-09-17T01:44:19.248 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.248 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.248 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180688 s, 58.0 MB/s 2024-09-17T01:44:19.269 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.269 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.269 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177203 s, 59.2 MB/s 2024-09-17T01:44:19.290 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.290 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.290 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018429 s, 56.9 MB/s 2024-09-17T01:44:19.308 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.308 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.309 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147695 s, 71.0 MB/s 2024-09-17T01:44:19.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:19.318 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:19.318 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:19.318 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.4 2024-09-17T01:44:19.318 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:19.318 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:19.318 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:19.318 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:19.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:19.418 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.418 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.418 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140911 s, 74.4 MB/s 2024-09-17T01:44:19.435 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.435 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.435 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134359 s, 78.0 MB/s 2024-09-17T01:44:19.460 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.460 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.461 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220397 s, 47.6 MB/s 2024-09-17T01:44:19.480 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.480 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.480 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155911 s, 67.3 MB/s 2024-09-17T01:44:19.498 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.498 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.498 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153393 s, 68.4 MB/s 2024-09-17T01:44:19.515 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.515 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.515 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140693 s, 74.5 MB/s 2024-09-17T01:44:19.538 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.538 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.539 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202116 s, 51.9 MB/s 2024-09-17T01:44:19.555 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.555 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.555 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138007 s, 76.0 MB/s 2024-09-17T01:44:19.572 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.572 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.572 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137687 s, 76.2 MB/s 2024-09-17T01:44:19.589 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.590 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.590 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144566 s, 72.5 MB/s 2024-09-17T01:44:19.607 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.607 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.608 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015132 s, 69.3 MB/s 2024-09-17T01:44:19.625 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.625 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.625 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139224 s, 75.3 MB/s 2024-09-17T01:44:19.642 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.642 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.642 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136825 s, 76.6 MB/s 2024-09-17T01:44:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.659 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140044 s, 74.9 MB/s 2024-09-17T01:44:19.677 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.677 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.677 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145005 s, 72.3 MB/s 2024-09-17T01:44:19.699 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.700 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.700 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192679 s, 54.4 MB/s 2024-09-17T01:44:19.716 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.717 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.717 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136636 s, 76.7 MB/s 2024-09-17T01:44:19.734 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.734 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.734 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144047 s, 72.8 MB/s 2024-09-17T01:44:19.754 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.754 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.754 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016576 s, 63.3 MB/s 2024-09-17T01:44:19.772 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.772 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.772 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146201 s, 71.7 MB/s 2024-09-17T01:44:19.788 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.789 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.789 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136957 s, 76.6 MB/s 2024-09-17T01:44:19.806 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.807 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.807 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148305 s, 70.7 MB/s 2024-09-17T01:44:19.825 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.825 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.825 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153405 s, 68.4 MB/s 2024-09-17T01:44:19.844 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.844 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.844 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155613 s, 67.4 MB/s 2024-09-17T01:44:19.862 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.862 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.862 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149918 s, 69.9 MB/s 2024-09-17T01:44:19.881 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.881 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.881 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151118 s, 69.4 MB/s 2024-09-17T01:44:19.900 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.900 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.900 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161472 s, 64.9 MB/s 2024-09-17T01:44:19.917 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.918 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.918 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147416 s, 71.1 MB/s 2024-09-17T01:44:19.935 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.935 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.935 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148294 s, 70.7 MB/s 2024-09-17T01:44:19.955 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.955 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.955 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165917 s, 63.2 MB/s 2024-09-17T01:44:19.977 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.977 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.977 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188586 s, 55.6 MB/s 2024-09-17T01:44:19.995 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:19.995 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:19.995 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144751 s, 72.4 MB/s 2024-09-17T01:44:19.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:20.005 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:20.005 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:20.005 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.5 2024-09-17T01:44:20.005 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:20.005 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:20.005 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:20.005 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:20.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:20.108 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.108 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.108 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170728 s, 61.4 MB/s 2024-09-17T01:44:20.127 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.127 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.127 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149365 s, 70.2 MB/s 2024-09-17T01:44:20.148 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.148 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.148 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185796 s, 56.4 MB/s 2024-09-17T01:44:20.165 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.166 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.166 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142474 s, 73.6 MB/s 2024-09-17T01:44:20.190 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.190 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.190 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209766 s, 50.0 MB/s 2024-09-17T01:44:20.207 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.207 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.207 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144652 s, 72.5 MB/s 2024-09-17T01:44:20.226 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.227 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.227 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156673 s, 66.9 MB/s 2024-09-17T01:44:20.245 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.245 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.245 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154004 s, 68.1 MB/s 2024-09-17T01:44:20.267 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.267 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.267 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184504 s, 56.8 MB/s 2024-09-17T01:44:20.287 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.287 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.287 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170949 s, 61.3 MB/s 2024-09-17T01:44:20.301 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.301 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.301 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111925 s, 93.7 MB/s 2024-09-17T01:44:20.320 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.320 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.320 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160807 s, 65.2 MB/s 2024-09-17T01:44:20.338 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.338 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.338 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153248 s, 68.4 MB/s 2024-09-17T01:44:20.362 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.362 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.362 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204881 s, 51.2 MB/s 2024-09-17T01:44:20.380 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.380 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.380 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144363 s, 72.6 MB/s 2024-09-17T01:44:20.398 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.398 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.398 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148785 s, 70.5 MB/s 2024-09-17T01:44:20.416 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.417 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.417 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155047 s, 67.6 MB/s 2024-09-17T01:44:20.435 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.435 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.435 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152863 s, 68.6 MB/s 2024-09-17T01:44:20.451 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.451 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.452 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136304 s, 76.9 MB/s 2024-09-17T01:44:20.472 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.472 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.472 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174134 s, 60.2 MB/s 2024-09-17T01:44:20.490 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.490 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.490 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151862 s, 69.0 MB/s 2024-09-17T01:44:20.508 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.508 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.509 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156037 s, 67.2 MB/s 2024-09-17T01:44:20.527 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.527 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.527 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154776 s, 67.7 MB/s 2024-09-17T01:44:20.551 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.551 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.551 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205526 s, 51.0 MB/s 2024-09-17T01:44:20.568 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.568 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.568 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141377 s, 74.2 MB/s 2024-09-17T01:44:20.589 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.589 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.589 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172945 s, 60.6 MB/s 2024-09-17T01:44:20.607 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.607 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.607 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153259 s, 68.4 MB/s 2024-09-17T01:44:20.628 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.628 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.628 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177431 s, 59.1 MB/s 2024-09-17T01:44:20.646 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.646 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.646 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147488 s, 71.1 MB/s 2024-09-17T01:44:20.665 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.665 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.665 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156005 s, 67.2 MB/s 2024-09-17T01:44:20.681 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.682 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.682 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138238 s, 75.9 MB/s 2024-09-17T01:44:20.701 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.701 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.701 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161312 s, 65.0 MB/s 2024-09-17T01:44:20.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:20.710 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:20.710 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:20.711 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.6 2024-09-17T01:44:20.711 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:20.711 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:20.711 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:20.711 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:20.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.815 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174825 s, 60.0 MB/s 2024-09-17T01:44:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.834 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156064 s, 67.2 MB/s 2024-09-17T01:44:20.852 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.853 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.853 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156135 s, 67.2 MB/s 2024-09-17T01:44:20.873 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.873 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.874 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175443 s, 59.8 MB/s 2024-09-17T01:44:20.891 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.891 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.891 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014268 s, 73.5 MB/s 2024-09-17T01:44:20.909 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.909 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.909 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147409 s, 71.1 MB/s 2024-09-17T01:44:20.936 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.936 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.936 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024299 s, 43.2 MB/s 2024-09-17T01:44:20.953 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.953 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.953 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140931 s, 74.4 MB/s 2024-09-17T01:44:20.975 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.975 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.975 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018325 s, 57.2 MB/s 2024-09-17T01:44:20.992 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:20.992 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:20.992 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141219 s, 74.3 MB/s 2024-09-17T01:44:21.010 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.010 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.010 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146506 s, 71.6 MB/s 2024-09-17T01:44:21.028 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.028 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.029 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152244 s, 68.9 MB/s 2024-09-17T01:44:21.045 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.045 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.045 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138054 s, 76.0 MB/s 2024-09-17T01:44:21.063 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.063 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.064 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146466 s, 71.6 MB/s 2024-09-17T01:44:21.086 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.086 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.086 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195509 s, 53.6 MB/s 2024-09-17T01:44:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148001 s, 70.8 MB/s 2024-09-17T01:44:21.121 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.122 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.122 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139077 s, 75.4 MB/s 2024-09-17T01:44:21.143 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.144 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.144 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186476 s, 56.2 MB/s 2024-09-17T01:44:21.168 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.168 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.168 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210616 s, 49.8 MB/s 2024-09-17T01:44:21.185 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.185 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.185 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144587 s, 72.5 MB/s 2024-09-17T01:44:21.205 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.205 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.205 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163673 s, 64.1 MB/s 2024-09-17T01:44:21.226 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.226 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.226 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178087 s, 58.9 MB/s 2024-09-17T01:44:21.248 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.248 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.248 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186956 s, 56.1 MB/s 2024-09-17T01:44:21.265 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.265 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.265 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137825 s, 76.1 MB/s 2024-09-17T01:44:21.283 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.283 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.283 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149246 s, 70.3 MB/s 2024-09-17T01:44:21.305 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.305 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.305 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187893 s, 55.8 MB/s 2024-09-17T01:44:21.329 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.329 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.329 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208171 s, 50.4 MB/s 2024-09-17T01:44:21.349 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.349 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.349 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170075 s, 61.7 MB/s 2024-09-17T01:44:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.366 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143501 s, 73.1 MB/s 2024-09-17T01:44:21.385 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.385 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.385 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156534 s, 67.0 MB/s 2024-09-17T01:44:21.394 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:44:21.398 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:44:21.406 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.406 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.406 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176706 s, 59.3 MB/s 2024-09-17T01:44:21.424 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.424 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.424 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146247 s, 71.7 MB/s 2024-09-17T01:44:21.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:21.433 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:21.433 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:21.433 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.7 2024-09-17T01:44:21.433 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:21.433 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:21.433 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:21.433 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:21.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:21.571 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.571 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.571 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115755 s, 90.6 MB/s 2024-09-17T01:44:21.589 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.589 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.589 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147658 s, 71.0 MB/s 2024-09-17T01:44:21.605 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.606 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.606 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136244 s, 77.0 MB/s 2024-09-17T01:44:21.625 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.626 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.626 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169765 s, 61.8 MB/s 2024-09-17T01:44:21.643 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.644 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.644 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015102 s, 69.4 MB/s 2024-09-17T01:44:21.664 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.664 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.664 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169713 s, 61.8 MB/s 2024-09-17T01:44:21.680 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.681 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.681 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135476 s, 77.4 MB/s 2024-09-17T01:44:21.698 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.699 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.699 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149825 s, 70.0 MB/s 2024-09-17T01:44:21.716 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.716 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.716 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142559 s, 73.6 MB/s 2024-09-17T01:44:21.735 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.735 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.735 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154479 s, 67.9 MB/s 2024-09-17T01:44:21.757 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.757 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.757 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189635 s, 55.3 MB/s 2024-09-17T01:44:21.781 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.781 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.781 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205679 s, 51.0 MB/s 2024-09-17T01:44:21.799 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.799 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.799 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152193 s, 68.9 MB/s 2024-09-17T01:44:21.817 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.817 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.817 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151144 s, 69.4 MB/s 2024-09-17T01:44:21.839 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.840 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191975 s, 54.6 MB/s 2024-09-17T01:44:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.861 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181815 s, 57.7 MB/s 2024-09-17T01:44:21.879 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.880 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.880 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154452 s, 67.9 MB/s 2024-09-17T01:44:21.901 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.901 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.901 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181573 s, 57.7 MB/s 2024-09-17T01:44:21.919 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.919 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.919 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151951 s, 69.0 MB/s 2024-09-17T01:44:21.941 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.941 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.941 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185564 s, 56.5 MB/s 2024-09-17T01:44:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138646 s, 75.6 MB/s 2024-09-17T01:44:21.976 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.976 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.976 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151806 s, 69.1 MB/s 2024-09-17T01:44:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:21.994 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144766 s, 72.4 MB/s 2024-09-17T01:44:22.011 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.011 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.011 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139138 s, 75.4 MB/s 2024-09-17T01:44:22.028 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.028 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.029 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143638 s, 73.0 MB/s 2024-09-17T01:44:22.049 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.049 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.049 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175107 s, 59.9 MB/s 2024-09-17T01:44:22.068 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.068 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.068 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152238 s, 68.9 MB/s 2024-09-17T01:44:22.087 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.087 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.087 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158798 s, 66.0 MB/s 2024-09-17T01:44:22.107 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.107 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.107 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154495 s, 67.9 MB/s 2024-09-17T01:44:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.128 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178142 s, 58.9 MB/s 2024-09-17T01:44:22.150 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.150 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.150 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175968 s, 59.6 MB/s 2024-09-17T01:44:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.168 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143641 s, 73.0 MB/s 2024-09-17T01:44:22.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:22.177 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:22.178 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:22.178 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.8 2024-09-17T01:44:22.178 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:22.178 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:22.178 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:22.178 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:22.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.284 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145183 s, 72.2 MB/s 2024-09-17T01:44:22.306 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.306 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.306 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191785 s, 54.7 MB/s 2024-09-17T01:44:22.324 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.324 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.324 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142351 s, 73.7 MB/s 2024-09-17T01:44:22.343 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.343 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.344 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154613 s, 67.8 MB/s 2024-09-17T01:44:22.363 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.364 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.364 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163707 s, 64.1 MB/s 2024-09-17T01:44:22.381 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.381 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.381 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139852 s, 75.0 MB/s 2024-09-17T01:44:22.399 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.399 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.399 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140817 s, 74.5 MB/s 2024-09-17T01:44:22.423 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.423 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.423 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204324 s, 51.3 MB/s 2024-09-17T01:44:22.442 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.442 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.443 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159752 s, 65.6 MB/s 2024-09-17T01:44:22.461 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.461 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.462 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151808 s, 69.1 MB/s 2024-09-17T01:44:22.483 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.483 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.483 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183691 s, 57.1 MB/s 2024-09-17T01:44:22.504 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.505 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.505 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175625 s, 59.7 MB/s 2024-09-17T01:44:22.524 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.524 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.524 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156154 s, 67.1 MB/s 2024-09-17T01:44:22.545 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.545 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.545 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174468 s, 60.1 MB/s 2024-09-17T01:44:22.563 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.563 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.564 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146683 s, 71.5 MB/s 2024-09-17T01:44:22.585 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.586 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.586 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184382 s, 56.9 MB/s 2024-09-17T01:44:22.603 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.604 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.604 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143699 s, 73.0 MB/s 2024-09-17T01:44:22.625 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.625 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.625 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177502 s, 59.1 MB/s 2024-09-17T01:44:22.647 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.647 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.647 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180148 s, 58.2 MB/s 2024-09-17T01:44:22.669 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.669 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.669 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183038 s, 57.3 MB/s 2024-09-17T01:44:22.690 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.690 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.690 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017474 s, 60.0 MB/s 2024-09-17T01:44:22.708 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.708 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.708 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142732 s, 73.5 MB/s 2024-09-17T01:44:22.727 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.727 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.727 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155268 s, 67.5 MB/s 2024-09-17T01:44:22.746 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.746 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.746 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153304 s, 68.4 MB/s 2024-09-17T01:44:22.764 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.764 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.764 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138742 s, 75.6 MB/s 2024-09-17T01:44:22.786 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.786 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.786 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182746 s, 57.4 MB/s 2024-09-17T01:44:22.803 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.803 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.804 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139878 s, 75.0 MB/s 2024-09-17T01:44:22.821 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.821 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.821 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142269 s, 73.7 MB/s 2024-09-17T01:44:22.842 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.843 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.843 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176758 s, 59.3 MB/s 2024-09-17T01:44:22.864 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.865 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.865 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180827 s, 58.0 MB/s 2024-09-17T01:44:22.887 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.887 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.888 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194014 s, 54.0 MB/s 2024-09-17T01:44:22.911 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:22.912 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:22.912 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204059 s, 51.4 MB/s 2024-09-17T01:44:22.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:22.922 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:22.922 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:22.922 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.9 2024-09-17T01:44:22.922 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:22.922 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:22.922 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:22.922 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:23.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:23.028 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.028 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.028 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183398 s, 57.2 MB/s 2024-09-17T01:44:23.050 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.050 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.050 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186685 s, 56.2 MB/s 2024-09-17T01:44:23.073 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.074 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.074 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197033 s, 53.2 MB/s 2024-09-17T01:44:23.092 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.092 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.092 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148842 s, 70.4 MB/s 2024-09-17T01:44:23.111 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.111 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.112 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163089 s, 64.3 MB/s 2024-09-17T01:44:23.132 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.132 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.132 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172726 s, 60.7 MB/s 2024-09-17T01:44:23.155 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.155 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.155 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199314 s, 52.6 MB/s 2024-09-17T01:44:23.172 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.173 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.173 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144577 s, 72.5 MB/s 2024-09-17T01:44:23.191 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.191 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.191 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154463 s, 67.9 MB/s 2024-09-17T01:44:23.211 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.211 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.211 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173567 s, 60.4 MB/s 2024-09-17T01:44:23.229 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.229 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.229 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141275 s, 74.2 MB/s 2024-09-17T01:44:23.246 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.246 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.246 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143773 s, 72.9 MB/s 2024-09-17T01:44:23.264 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.264 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.264 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141264 s, 74.2 MB/s 2024-09-17T01:44:23.288 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.288 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.288 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209004 s, 50.2 MB/s 2024-09-17T01:44:23.310 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.310 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.310 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185651 s, 56.5 MB/s 2024-09-17T01:44:23.329 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.329 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.330 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161047 s, 65.1 MB/s 2024-09-17T01:44:23.348 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.348 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.348 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154007 s, 68.1 MB/s 2024-09-17T01:44:23.369 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.369 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.370 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181624 s, 57.7 MB/s 2024-09-17T01:44:23.386 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.386 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.386 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139504 s, 75.2 MB/s 2024-09-17T01:44:23.403 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.403 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.403 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135397 s, 77.4 MB/s 2024-09-17T01:44:23.420 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.420 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.420 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137995 s, 76.0 MB/s 2024-09-17T01:44:23.441 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.441 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.441 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176377 s, 59.5 MB/s 2024-09-17T01:44:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188951 s, 55.5 MB/s 2024-09-17T01:44:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160085 s, 65.5 MB/s 2024-09-17T01:44:23.499 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.499 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.499 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135831 s, 77.2 MB/s 2024-09-17T01:44:23.519 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.519 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.519 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169221 s, 62.0 MB/s 2024-09-17T01:44:23.539 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.539 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.540 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171847 s, 61.0 MB/s 2024-09-17T01:44:23.557 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.557 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.557 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147125 s, 71.3 MB/s 2024-09-17T01:44:23.573 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.574 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.574 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137416 s, 76.3 MB/s 2024-09-17T01:44:23.591 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.591 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.591 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146402 s, 71.6 MB/s 2024-09-17T01:44:23.610 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.610 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.610 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155001 s, 67.6 MB/s 2024-09-17T01:44:23.628 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.628 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.628 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152623 s, 68.7 MB/s 2024-09-17T01:44:23.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:23.637 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:23.638 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:23.638 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.10 2024-09-17T01:44:23.638 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:23.638 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:23.638 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:23.638 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:23.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:23.739 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.739 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.739 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150943 s, 69.5 MB/s 2024-09-17T01:44:23.757 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.757 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.757 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143049 s, 73.3 MB/s 2024-09-17T01:44:23.773 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.774 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.774 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138011 s, 76.0 MB/s 2024-09-17T01:44:23.794 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.795 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.795 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179119 s, 58.5 MB/s 2024-09-17T01:44:23.815 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.816 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.816 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179698 s, 58.4 MB/s 2024-09-17T01:44:23.833 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.833 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.833 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142581 s, 73.5 MB/s 2024-09-17T01:44:23.853 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.854 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.854 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173154 s, 60.6 MB/s 2024-09-17T01:44:23.872 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.872 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.872 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157351 s, 66.6 MB/s 2024-09-17T01:44:23.893 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.893 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.893 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142575 s, 73.5 MB/s 2024-09-17T01:44:23.908 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.908 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.908 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015335 s, 68.4 MB/s 2024-09-17T01:44:23.929 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.929 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.929 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172672 s, 60.7 MB/s 2024-09-17T01:44:23.946 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.946 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.946 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142381 s, 73.6 MB/s 2024-09-17T01:44:23.964 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.964 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.964 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145794 s, 71.9 MB/s 2024-09-17T01:44:23.988 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:23.988 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:23.988 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209161 s, 50.1 MB/s 2024-09-17T01:44:24.005 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.006 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.006 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144261 s, 72.7 MB/s 2024-09-17T01:44:24.024 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.024 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.024 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014693 s, 71.4 MB/s 2024-09-17T01:44:24.041 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.041 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.041 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136997 s, 76.5 MB/s 2024-09-17T01:44:24.060 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.060 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.060 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153509 s, 68.3 MB/s 2024-09-17T01:44:24.085 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.085 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.085 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020702 s, 50.7 MB/s 2024-09-17T01:44:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.106 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177983 s, 58.9 MB/s 2024-09-17T01:44:24.123 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.124 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.124 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140583 s, 74.6 MB/s 2024-09-17T01:44:24.143 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.143 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.143 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158025 s, 66.4 MB/s 2024-09-17T01:44:24.165 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.165 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.165 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179976 s, 58.3 MB/s 2024-09-17T01:44:24.183 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.183 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.183 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144081 s, 72.8 MB/s 2024-09-17T01:44:24.201 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.201 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.201 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142215 s, 73.7 MB/s 2024-09-17T01:44:24.218 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.218 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.219 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140516 s, 74.6 MB/s 2024-09-17T01:44:24.236 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.236 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.236 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140217 s, 74.8 MB/s 2024-09-17T01:44:24.255 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.255 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.255 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151295 s, 69.3 MB/s 2024-09-17T01:44:24.272 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.272 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.272 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133909 s, 78.3 MB/s 2024-09-17T01:44:24.290 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.290 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.290 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142627 s, 73.5 MB/s 2024-09-17T01:44:24.307 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.308 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.308 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013659 s, 76.8 MB/s 2024-09-17T01:44:24.331 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.331 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.331 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193604 s, 54.2 MB/s 2024-09-17T01:44:24.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:24.340 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:24.340 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:24.340 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.11 2024-09-17T01:44:24.340 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:24.340 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:24.340 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:24.340 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:24.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:24.444 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.444 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.444 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165244 s, 63.5 MB/s 2024-09-17T01:44:24.462 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.462 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.462 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142872 s, 73.4 MB/s 2024-09-17T01:44:24.479 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.480 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.480 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141614 s, 74.0 MB/s 2024-09-17T01:44:24.498 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.498 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.498 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151714 s, 69.1 MB/s 2024-09-17T01:44:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182504 s, 57.5 MB/s 2024-09-17T01:44:24.537 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.538 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138394 s, 75.8 MB/s 2024-09-17T01:44:24.560 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.560 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.560 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187496 s, 55.9 MB/s 2024-09-17T01:44:24.579 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.580 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.580 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159365 s, 65.8 MB/s 2024-09-17T01:44:24.599 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.600 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.600 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165037 s, 63.5 MB/s 2024-09-17T01:44:24.617 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.617 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.617 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139095 s, 75.4 MB/s 2024-09-17T01:44:24.636 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.636 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.636 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153707 s, 68.2 MB/s 2024-09-17T01:44:24.654 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.654 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.654 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144808 s, 72.4 MB/s 2024-09-17T01:44:24.676 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.676 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.676 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179808 s, 58.3 MB/s 2024-09-17T01:44:24.696 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.696 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.696 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163994 s, 63.9 MB/s 2024-09-17T01:44:24.716 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.717 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.717 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158996 s, 65.9 MB/s 2024-09-17T01:44:24.736 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.737 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.737 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175003 s, 59.9 MB/s 2024-09-17T01:44:24.756 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.757 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.757 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163139 s, 64.3 MB/s 2024-09-17T01:44:24.775 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.775 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.775 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144358 s, 72.6 MB/s 2024-09-17T01:44:24.794 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.795 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.795 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016087 s, 65.2 MB/s 2024-09-17T01:44:24.814 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.814 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.814 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015095 s, 69.5 MB/s 2024-09-17T01:44:24.830 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.831 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.831 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137813 s, 76.1 MB/s 2024-09-17T01:44:24.849 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.849 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.849 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143927 s, 72.9 MB/s 2024-09-17T01:44:24.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.866 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138551 s, 75.7 MB/s 2024-09-17T01:44:24.889 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.889 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.890 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193462 s, 54.2 MB/s 2024-09-17T01:44:24.907 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.907 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.907 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145591 s, 72.0 MB/s 2024-09-17T01:44:24.926 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.926 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.927 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155492 s, 67.4 MB/s 2024-09-17T01:44:24.945 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.945 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.945 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154469 s, 67.9 MB/s 2024-09-17T01:44:24.969 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.969 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.969 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203352 s, 51.6 MB/s 2024-09-17T01:44:24.987 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:24.987 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:24.987 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014063 s, 74.6 MB/s 2024-09-17T01:44:25.004 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.004 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.004 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130049 s, 80.6 MB/s 2024-09-17T01:44:25.025 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.025 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.025 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179302 s, 58.5 MB/s 2024-09-17T01:44:25.043 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.043 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.043 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145342 s, 72.1 MB/s 2024-09-17T01:44:25.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:25.053 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:25.053 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:25.053 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.12 2024-09-17T01:44:25.053 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:25.053 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:25.053 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:25.053 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:25.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:25.154 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.154 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.154 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014564 s, 72.0 MB/s 2024-09-17T01:44:25.172 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.172 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.173 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153076 s, 68.5 MB/s 2024-09-17T01:44:25.193 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.193 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.193 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176728 s, 59.3 MB/s 2024-09-17T01:44:25.208 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.208 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.208 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116116 s, 90.3 MB/s 2024-09-17T01:44:25.226 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.226 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.226 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152231 s, 68.9 MB/s 2024-09-17T01:44:25.244 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.244 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.244 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151792 s, 69.1 MB/s 2024-09-17T01:44:25.264 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.264 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.264 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167055 s, 62.8 MB/s 2024-09-17T01:44:25.281 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.281 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.282 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139567 s, 75.1 MB/s 2024-09-17T01:44:25.302 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.302 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.302 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174811 s, 60.0 MB/s 2024-09-17T01:44:25.320 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.320 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.320 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144903 s, 72.4 MB/s 2024-09-17T01:44:25.340 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.340 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.340 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173196 s, 60.5 MB/s 2024-09-17T01:44:25.359 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.360 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.360 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163902 s, 64.0 MB/s 2024-09-17T01:44:25.381 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.381 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.381 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179997 s, 58.3 MB/s 2024-09-17T01:44:25.399 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.399 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.399 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157168 s, 66.7 MB/s 2024-09-17T01:44:25.420 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.420 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.421 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177259 s, 59.2 MB/s 2024-09-17T01:44:25.439 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.439 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.440 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158682 s, 66.1 MB/s 2024-09-17T01:44:25.460 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.460 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.460 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174068 s, 60.2 MB/s 2024-09-17T01:44:25.479 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.479 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.479 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158923 s, 66.0 MB/s 2024-09-17T01:44:25.496 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.496 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.496 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137325 s, 76.4 MB/s 2024-09-17T01:44:25.513 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.513 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.513 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139659 s, 75.1 MB/s 2024-09-17T01:44:25.533 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.533 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.533 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147791 s, 70.9 MB/s 2024-09-17T01:44:25.550 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.550 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.551 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158758 s, 66.0 MB/s 2024-09-17T01:44:25.568 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.569 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.569 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151557 s, 69.2 MB/s 2024-09-17T01:44:25.586 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.586 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.586 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140438 s, 74.7 MB/s 2024-09-17T01:44:25.609 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.610 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.610 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206726 s, 50.7 MB/s 2024-09-17T01:44:25.626 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.626 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.626 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137047 s, 76.5 MB/s 2024-09-17T01:44:25.643 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.643 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.643 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013883 s, 75.5 MB/s 2024-09-17T01:44:25.665 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.665 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.665 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184312 s, 56.9 MB/s 2024-09-17T01:44:25.681 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.682 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.682 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135947 s, 77.1 MB/s 2024-09-17T01:44:25.699 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.699 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.699 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014421 s, 72.7 MB/s 2024-09-17T01:44:25.717 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.717 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.717 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148959 s, 70.4 MB/s 2024-09-17T01:44:25.738 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.738 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.739 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181882 s, 57.7 MB/s 2024-09-17T01:44:25.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:25.747 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:25.748 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:25.748 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.13 2024-09-17T01:44:25.748 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:25.748 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:25.748 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:25.748 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:25.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:25.849 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.849 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.849 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144837 s, 72.4 MB/s 2024-09-17T01:44:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.866 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143477 s, 73.1 MB/s 2024-09-17T01:44:25.887 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.888 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.888 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179621 s, 58.4 MB/s 2024-09-17T01:44:25.911 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.911 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.911 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208578 s, 50.3 MB/s 2024-09-17T01:44:25.930 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.930 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.930 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016037 s, 65.4 MB/s 2024-09-17T01:44:25.950 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.950 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.950 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167142 s, 62.7 MB/s 2024-09-17T01:44:25.969 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.970 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.970 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160374 s, 65.4 MB/s 2024-09-17T01:44:25.987 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:25.987 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:25.987 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140385 s, 74.7 MB/s 2024-09-17T01:44:26.003 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.004 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.004 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013489 s, 77.7 MB/s 2024-09-17T01:44:26.021 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.021 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.021 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139857 s, 75.0 MB/s 2024-09-17T01:44:26.042 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.042 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.042 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180543 s, 58.1 MB/s 2024-09-17T01:44:26.059 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.059 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.059 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136832 s, 76.6 MB/s 2024-09-17T01:44:26.077 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.077 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.077 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145565 s, 72.0 MB/s 2024-09-17T01:44:26.093 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.094 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.094 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135464 s, 77.4 MB/s 2024-09-17T01:44:26.115 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.115 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.115 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179061 s, 58.6 MB/s 2024-09-17T01:44:26.136 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.137 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.137 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187093 s, 56.0 MB/s 2024-09-17T01:44:26.158 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.158 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.159 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184849 s, 56.7 MB/s 2024-09-17T01:44:26.175 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.207 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.208 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138597 s, 75.7 MB/s 2024-09-17T01:44:26.208 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.209 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.209 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157054 s, 66.8 MB/s 2024-09-17T01:44:26.211 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.211 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.211 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139296 s, 75.3 MB/s 2024-09-17T01:44:26.228 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.228 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.228 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136007 s, 77.1 MB/s 2024-09-17T01:44:26.247 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.247 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.247 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162679 s, 64.5 MB/s 2024-09-17T01:44:26.265 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.265 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.265 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142595 s, 73.5 MB/s 2024-09-17T01:44:26.282 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.283 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.283 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146108 s, 71.8 MB/s 2024-09-17T01:44:26.299 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.299 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.300 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135972 s, 77.1 MB/s 2024-09-17T01:44:26.317 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.317 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.318 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014795 s, 70.9 MB/s 2024-09-17T01:44:26.337 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.338 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.338 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169241 s, 62.0 MB/s 2024-09-17T01:44:26.355 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.355 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.355 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142205 s, 73.7 MB/s 2024-09-17T01:44:26.377 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.377 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.377 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185031 s, 56.7 MB/s 2024-09-17T01:44:26.393 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.394 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138236 s, 75.9 MB/s 2024-09-17T01:44:26.415 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.416 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.416 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183163 s, 57.2 MB/s 2024-09-17T01:44:26.434 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.434 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.434 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145313 s, 72.2 MB/s 2024-09-17T01:44:26.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:26.443 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:26.444 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:26.444 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.14 2024-09-17T01:44:26.444 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:26.444 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:26.444 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:26.444 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:26.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:26.545 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.545 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.546 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141365 s, 74.2 MB/s 2024-09-17T01:44:26.567 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.568 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.568 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184416 s, 56.9 MB/s 2024-09-17T01:44:26.589 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.589 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.589 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171602 s, 61.1 MB/s 2024-09-17T01:44:26.605 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.606 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.606 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138909 s, 75.5 MB/s 2024-09-17T01:44:26.628 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.628 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.628 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183771 s, 57.1 MB/s 2024-09-17T01:44:26.646 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.646 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.646 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144551 s, 72.5 MB/s 2024-09-17T01:44:26.665 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.665 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.665 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149301 s, 70.2 MB/s 2024-09-17T01:44:26.690 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.690 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.690 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213439 s, 49.1 MB/s 2024-09-17T01:44:26.709 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.710 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.710 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162932 s, 64.4 MB/s 2024-09-17T01:44:26.728 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.728 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.728 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145052 s, 72.3 MB/s 2024-09-17T01:44:26.746 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.746 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.746 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145563 s, 72.0 MB/s 2024-09-17T01:44:26.764 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.765 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.765 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145959 s, 71.8 MB/s 2024-09-17T01:44:26.782 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.782 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.783 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142115 s, 73.8 MB/s 2024-09-17T01:44:26.804 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.804 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.804 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178981 s, 58.6 MB/s 2024-09-17T01:44:26.829 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.829 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.829 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217795 s, 48.1 MB/s 2024-09-17T01:44:26.847 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.848 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.848 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144239 s, 72.7 MB/s 2024-09-17T01:44:26.865 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.865 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.865 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138685 s, 75.6 MB/s 2024-09-17T01:44:26.884 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.884 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.884 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156185 s, 67.1 MB/s 2024-09-17T01:44:26.902 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.902 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.902 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013627 s, 76.9 MB/s 2024-09-17T01:44:26.921 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.921 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.921 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157193 s, 66.7 MB/s 2024-09-17T01:44:26.940 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.940 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.940 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155343 s, 67.5 MB/s 2024-09-17T01:44:26.959 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.959 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.959 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150929 s, 69.5 MB/s 2024-09-17T01:44:26.978 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.978 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.978 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150538 s, 69.7 MB/s 2024-09-17T01:44:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173755 s, 60.3 MB/s 2024-09-17T01:44:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.017 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149093 s, 70.3 MB/s 2024-09-17T01:44:27.034 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.034 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.034 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137631 s, 76.2 MB/s 2024-09-17T01:44:27.051 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.051 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.051 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143521 s, 73.1 MB/s 2024-09-17T01:44:27.073 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.073 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.073 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185776 s, 56.4 MB/s 2024-09-17T01:44:27.093 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.093 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.093 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165287 s, 63.4 MB/s 2024-09-17T01:44:27.111 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.111 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.111 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141589 s, 74.1 MB/s 2024-09-17T01:44:27.133 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.133 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.133 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184547 s, 56.8 MB/s 2024-09-17T01:44:27.152 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.153 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.153 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154371 s, 67.9 MB/s 2024-09-17T01:44:27.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:27.162 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:27.162 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:27.162 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.15 2024-09-17T01:44:27.162 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:27.162 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:27.162 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:27.162 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:27.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:27.264 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.264 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.264 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161829 s, 64.8 MB/s 2024-09-17T01:44:27.286 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.286 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.286 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189492 s, 55.3 MB/s 2024-09-17T01:44:27.304 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.304 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.304 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149635 s, 70.1 MB/s 2024-09-17T01:44:27.325 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.325 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.325 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174188 s, 60.2 MB/s 2024-09-17T01:44:27.343 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.343 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.343 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151288 s, 69.3 MB/s 2024-09-17T01:44:27.362 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.362 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.362 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157349 s, 66.6 MB/s 2024-09-17T01:44:27.383 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.383 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.383 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177263 s, 59.2 MB/s 2024-09-17T01:44:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.404 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181445 s, 57.8 MB/s 2024-09-17T01:44:27.427 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.427 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.427 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203458 s, 51.5 MB/s 2024-09-17T01:44:27.445 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.445 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.446 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151033 s, 69.4 MB/s 2024-09-17T01:44:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.463 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150856 s, 69.5 MB/s 2024-09-17T01:44:27.482 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.482 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.482 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155848 s, 67.3 MB/s 2024-09-17T01:44:27.499 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.499 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.500 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145295 s, 72.2 MB/s 2024-09-17T01:44:27.519 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.520 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.520 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171148 s, 61.3 MB/s 2024-09-17T01:44:27.537 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.538 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.538 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150541 s, 69.7 MB/s 2024-09-17T01:44:27.555 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.555 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.555 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138701 s, 75.6 MB/s 2024-09-17T01:44:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.573 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154677 s, 67.8 MB/s 2024-09-17T01:44:27.595 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.596 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185011 s, 56.7 MB/s 2024-09-17T01:44:27.615 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.615 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.615 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170928 s, 61.3 MB/s 2024-09-17T01:44:27.633 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.633 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.633 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143552 s, 73.0 MB/s 2024-09-17T01:44:27.650 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.650 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.650 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139621 s, 75.1 MB/s 2024-09-17T01:44:27.667 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.667 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.667 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143118 s, 73.3 MB/s 2024-09-17T01:44:27.685 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.685 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.685 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145226 s, 72.2 MB/s 2024-09-17T01:44:27.710 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.710 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.710 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216499 s, 48.4 MB/s 2024-09-17T01:44:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017074 s, 61.4 MB/s 2024-09-17T01:44:27.749 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.750 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.750 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160524 s, 65.3 MB/s 2024-09-17T01:44:27.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.771 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179707 s, 58.3 MB/s 2024-09-17T01:44:27.787 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.788 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.788 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137252 s, 76.4 MB/s 2024-09-17T01:44:27.803 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.803 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.803 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121322 s, 86.4 MB/s 2024-09-17T01:44:27.820 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.820 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.820 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143226 s, 73.2 MB/s 2024-09-17T01:44:27.841 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.841 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.841 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178959 s, 58.6 MB/s 2024-09-17T01:44:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147517 s, 71.1 MB/s 2024-09-17T01:44:27.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:27.867 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:27.868 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:27.868 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.16 2024-09-17T01:44:27.868 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:27.868 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:27.868 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:27.868 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:27.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:27.969 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.969 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.970 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158954 s, 66.0 MB/s 2024-09-17T01:44:27.990 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:27.990 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:27.990 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174582 s, 60.1 MB/s 2024-09-17T01:44:28.007 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.007 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.007 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143537 s, 73.1 MB/s 2024-09-17T01:44:28.025 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.025 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.025 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147471 s, 71.1 MB/s 2024-09-17T01:44:28.044 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.044 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.044 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157956 s, 66.4 MB/s 2024-09-17T01:44:28.066 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.067 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.067 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193374 s, 54.2 MB/s 2024-09-17T01:44:28.084 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.084 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.084 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139975 s, 74.9 MB/s 2024-09-17T01:44:28.104 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.104 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.105 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175305 s, 59.8 MB/s 2024-09-17T01:44:28.129 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.129 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.129 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213534 s, 49.1 MB/s 2024-09-17T01:44:28.147 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.147 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.148 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153499 s, 68.3 MB/s 2024-09-17T01:44:28.165 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.165 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.165 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145961 s, 71.8 MB/s 2024-09-17T01:44:28.186 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.186 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.186 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177191 s, 59.2 MB/s 2024-09-17T01:44:28.203 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.204 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.204 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143975 s, 72.8 MB/s 2024-09-17T01:44:28.221 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.221 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.221 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140577 s, 74.6 MB/s 2024-09-17T01:44:28.241 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.241 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.242 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175588 s, 59.7 MB/s 2024-09-17T01:44:28.261 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.261 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.261 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016083 s, 65.2 MB/s 2024-09-17T01:44:28.278 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.278 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.278 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014145 s, 74.1 MB/s 2024-09-17T01:44:28.295 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.295 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.295 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142941 s, 73.4 MB/s 2024-09-17T01:44:28.313 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.313 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.313 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147268 s, 71.2 MB/s 2024-09-17T01:44:28.331 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.331 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.331 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146309 s, 71.7 MB/s 2024-09-17T01:44:28.353 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.353 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.353 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187828 s, 55.8 MB/s 2024-09-17T01:44:28.376 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.377 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.377 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204867 s, 51.2 MB/s 2024-09-17T01:44:28.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.396 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142612 s, 73.5 MB/s 2024-09-17T01:44:28.415 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.416 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.416 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180716 s, 58.0 MB/s 2024-09-17T01:44:28.434 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.434 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.434 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016211 s, 64.7 MB/s 2024-09-17T01:44:28.452 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.452 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.452 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143565 s, 73.0 MB/s 2024-09-17T01:44:28.470 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.470 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.470 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145853 s, 71.9 MB/s 2024-09-17T01:44:28.489 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.490 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.490 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167658 s, 62.5 MB/s 2024-09-17T01:44:28.508 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.508 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.508 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152478 s, 68.8 MB/s 2024-09-17T01:44:28.529 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.530 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.530 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182739 s, 57.4 MB/s 2024-09-17T01:44:28.548 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.548 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.548 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153595 s, 68.3 MB/s 2024-09-17T01:44:28.566 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.566 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.566 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145792 s, 71.9 MB/s 2024-09-17T01:44:28.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:28.575 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:28.575 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:28.575 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.17 2024-09-17T01:44:28.575 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:28.575 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:28.575 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:28.575 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:28.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:28.675 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.676 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.676 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140976 s, 74.4 MB/s 2024-09-17T01:44:28.693 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.693 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.693 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143055 s, 73.3 MB/s 2024-09-17T01:44:28.709 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.710 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.710 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136786 s, 76.7 MB/s 2024-09-17T01:44:28.728 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.728 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.728 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156578 s, 67.0 MB/s 2024-09-17T01:44:28.751 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.751 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.751 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195549 s, 53.6 MB/s 2024-09-17T01:44:28.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.771 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162681 s, 64.5 MB/s 2024-09-17T01:44:28.788 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.788 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.788 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014228 s, 73.7 MB/s 2024-09-17T01:44:28.808 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.808 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.808 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166352 s, 63.0 MB/s 2024-09-17T01:44:28.825 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.826 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.826 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014658 s, 71.5 MB/s 2024-09-17T01:44:28.843 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.843 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.843 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141571 s, 74.1 MB/s 2024-09-17T01:44:28.860 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.860 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.861 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143641 s, 73.0 MB/s 2024-09-17T01:44:28.881 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.881 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.881 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173028 s, 60.6 MB/s 2024-09-17T01:44:28.899 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.899 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.899 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148538 s, 70.6 MB/s 2024-09-17T01:44:28.918 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.918 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.918 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158154 s, 66.3 MB/s 2024-09-17T01:44:28.935 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.935 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.935 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138688 s, 75.6 MB/s 2024-09-17T01:44:28.956 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.957 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.957 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183522 s, 57.1 MB/s 2024-09-17T01:44:28.973 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.974 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.974 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141125 s, 74.3 MB/s 2024-09-17T01:44:28.992 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:28.992 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:28.992 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151486 s, 69.2 MB/s 2024-09-17T01:44:29.017 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.017 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.017 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223219 s, 47.0 MB/s 2024-09-17T01:44:29.035 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.035 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.035 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140317 s, 74.7 MB/s 2024-09-17T01:44:29.052 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.052 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.052 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142249 s, 73.7 MB/s 2024-09-17T01:44:29.074 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.074 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.074 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189091 s, 55.5 MB/s 2024-09-17T01:44:29.095 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.095 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.095 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172821 s, 60.7 MB/s 2024-09-17T01:44:29.112 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.112 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.112 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137588 s, 76.2 MB/s 2024-09-17T01:44:29.133 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.134 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.134 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187757 s, 55.8 MB/s 2024-09-17T01:44:29.153 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.153 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.153 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159756 s, 65.6 MB/s 2024-09-17T01:44:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.171 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148904 s, 70.4 MB/s 2024-09-17T01:44:29.189 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.189 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.189 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146925 s, 71.4 MB/s 2024-09-17T01:44:29.206 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.207 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.207 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01464 s, 71.6 MB/s 2024-09-17T01:44:29.223 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.223 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.223 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134952 s, 77.7 MB/s 2024-09-17T01:44:29.240 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.240 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.240 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139817 s, 75.0 MB/s 2024-09-17T01:44:29.261 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.261 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.261 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170996 s, 61.3 MB/s 2024-09-17T01:44:29.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:29.270 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:29.270 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:29.270 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.18 2024-09-17T01:44:29.270 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:29.270 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:29.270 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:29.270 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:29.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:29.370 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.370 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.371 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143288 s, 73.2 MB/s 2024-09-17T01:44:29.387 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.387 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.388 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140618 s, 74.6 MB/s 2024-09-17T01:44:29.406 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.406 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.406 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150601 s, 69.6 MB/s 2024-09-17T01:44:29.424 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.424 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.424 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150281 s, 69.8 MB/s 2024-09-17T01:44:29.445 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.445 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.445 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175472 s, 59.8 MB/s 2024-09-17T01:44:29.459 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.460 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.460 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117127 s, 89.5 MB/s 2024-09-17T01:44:29.477 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.477 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.477 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142494 s, 73.6 MB/s 2024-09-17T01:44:29.494 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.494 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.494 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138598 s, 75.7 MB/s 2024-09-17T01:44:29.511 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.511 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.511 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136901 s, 76.6 MB/s 2024-09-17T01:44:29.534 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.534 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.534 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020383 s, 51.4 MB/s 2024-09-17T01:44:29.552 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.553 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.553 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151431 s, 69.2 MB/s 2024-09-17T01:44:29.571 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.571 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.571 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153294 s, 68.4 MB/s 2024-09-17T01:44:29.589 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.589 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.589 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144962 s, 72.3 MB/s 2024-09-17T01:44:29.606 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.606 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.606 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142806 s, 73.4 MB/s 2024-09-17T01:44:29.624 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.624 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.625 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143988 s, 72.8 MB/s 2024-09-17T01:44:29.642 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.642 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.642 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150725 s, 69.6 MB/s 2024-09-17T01:44:29.659 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.659 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.659 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141886 s, 73.9 MB/s 2024-09-17T01:44:29.676 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.676 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.676 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139119 s, 75.4 MB/s 2024-09-17T01:44:29.693 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.693 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.693 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013834 s, 75.8 MB/s 2024-09-17T01:44:29.712 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.712 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.712 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156821 s, 66.9 MB/s 2024-09-17T01:44:29.730 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.730 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.730 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142185 s, 73.7 MB/s 2024-09-17T01:44:29.753 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.753 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.753 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200151 s, 52.4 MB/s 2024-09-17T01:44:29.770 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.770 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.770 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140222 s, 74.8 MB/s 2024-09-17T01:44:29.789 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.789 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.789 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157486 s, 66.6 MB/s 2024-09-17T01:44:29.807 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.807 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.807 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146639 s, 71.5 MB/s 2024-09-17T01:44:29.825 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.825 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.825 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146167 s, 71.7 MB/s 2024-09-17T01:44:29.842 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.842 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.842 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141442 s, 74.1 MB/s 2024-09-17T01:44:29.860 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.860 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.860 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014921 s, 70.3 MB/s 2024-09-17T01:44:29.877 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.877 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.877 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139381 s, 75.2 MB/s 2024-09-17T01:44:29.898 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.898 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.898 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178516 s, 58.7 MB/s 2024-09-17T01:44:29.920 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.920 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.920 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189645 s, 55.3 MB/s 2024-09-17T01:44:29.939 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:29.940 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:29.940 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162648 s, 64.5 MB/s 2024-09-17T01:44:29.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:29.949 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:29.949 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:29.949 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.19 2024-09-17T01:44:29.950 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:29.950 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:29.950 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:29.950 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:30.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:30.052 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.053 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.053 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163989 s, 63.9 MB/s 2024-09-17T01:44:30.072 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.072 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.072 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159725 s, 65.6 MB/s 2024-09-17T01:44:30.090 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.090 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.090 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146334 s, 71.7 MB/s 2024-09-17T01:44:30.109 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.109 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.109 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159778 s, 65.6 MB/s 2024-09-17T01:44:30.125 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.126 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.126 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132608 s, 79.1 MB/s 2024-09-17T01:44:30.146 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.147 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.147 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171823 s, 61.0 MB/s 2024-09-17T01:44:30.163 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.163 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.163 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144482 s, 72.6 MB/s 2024-09-17T01:44:30.180 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.181 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.181 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137717 s, 76.1 MB/s 2024-09-17T01:44:30.197 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.197 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.198 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139988 s, 74.9 MB/s 2024-09-17T01:44:30.214 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.214 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.215 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137238 s, 76.4 MB/s 2024-09-17T01:44:30.236 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.237 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.237 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189653 s, 55.3 MB/s 2024-09-17T01:44:30.258 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.259 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.259 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184383 s, 56.9 MB/s 2024-09-17T01:44:30.280 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.280 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.280 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178472 s, 58.8 MB/s 2024-09-17T01:44:30.298 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.298 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.298 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015205 s, 69.0 MB/s 2024-09-17T01:44:30.318 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.318 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.318 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172663 s, 60.7 MB/s 2024-09-17T01:44:30.336 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.336 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.336 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140936 s, 74.4 MB/s 2024-09-17T01:44:30.353 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.353 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.353 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014075 s, 74.5 MB/s 2024-09-17T01:44:30.370 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.370 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.370 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140488 s, 74.6 MB/s 2024-09-17T01:44:30.387 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.387 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.387 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136385 s, 76.9 MB/s 2024-09-17T01:44:30.405 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.405 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.405 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153446 s, 68.3 MB/s 2024-09-17T01:44:30.423 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.423 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.423 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142719 s, 73.5 MB/s 2024-09-17T01:44:30.444 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.445 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.445 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174324 s, 60.2 MB/s 2024-09-17T01:44:30.462 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.462 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.462 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015929 s, 65.8 MB/s 2024-09-17T01:44:30.479 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.479 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.480 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138507 s, 75.7 MB/s 2024-09-17T01:44:30.496 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.496 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.496 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137291 s, 76.4 MB/s 2024-09-17T01:44:30.514 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.514 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.514 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145035 s, 72.3 MB/s 2024-09-17T01:44:30.530 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.530 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.530 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137049 s, 76.5 MB/s 2024-09-17T01:44:30.547 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.547 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.548 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140498 s, 74.6 MB/s 2024-09-17T01:44:30.564 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.564 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.564 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133266 s, 78.7 MB/s 2024-09-17T01:44:30.581 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.581 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.581 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139954 s, 74.9 MB/s 2024-09-17T01:44:30.598 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.598 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.598 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140831 s, 74.5 MB/s 2024-09-17T01:44:30.617 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.617 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.617 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155289 s, 67.5 MB/s 2024-09-17T01:44:30.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:30.626 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:30.626 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:30.626 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.20 2024-09-17T01:44:30.626 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:30.626 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:30.626 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:30.626 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:30.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:30.727 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.727 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.727 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142384 s, 73.6 MB/s 2024-09-17T01:44:30.745 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.745 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.745 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144937 s, 72.3 MB/s 2024-09-17T01:44:30.764 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.764 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.764 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015836 s, 66.2 MB/s 2024-09-17T01:44:30.786 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.787 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.787 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189847 s, 55.2 MB/s 2024-09-17T01:44:30.804 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.804 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.804 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014297 s, 73.3 MB/s 2024-09-17T01:44:30.825 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.825 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.825 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181016 s, 57.9 MB/s 2024-09-17T01:44:30.845 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.845 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.845 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171298 s, 61.2 MB/s 2024-09-17T01:44:30.861 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.862 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.862 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013468 s, 77.9 MB/s 2024-09-17T01:44:30.879 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.879 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.879 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144565 s, 72.5 MB/s 2024-09-17T01:44:30.901 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.901 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.901 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192372 s, 54.5 MB/s 2024-09-17T01:44:30.918 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.918 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.918 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135257 s, 77.5 MB/s 2024-09-17T01:44:30.935 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.935 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.935 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136468 s, 76.8 MB/s 2024-09-17T01:44:30.959 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.959 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.959 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212742 s, 49.3 MB/s 2024-09-17T01:44:30.977 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.977 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.977 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147787 s, 71.0 MB/s 2024-09-17T01:44:30.998 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:30.998 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:30.999 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180576 s, 58.1 MB/s 2024-09-17T01:44:31.016 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.016 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.016 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144786 s, 72.4 MB/s 2024-09-17T01:44:31.033 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.033 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.033 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140371 s, 74.7 MB/s 2024-09-17T01:44:31.051 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.051 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.051 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144494 s, 72.6 MB/s 2024-09-17T01:44:31.075 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.075 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.075 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199443 s, 52.6 MB/s 2024-09-17T01:44:31.090 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.091 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.091 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125189 s, 83.8 MB/s 2024-09-17T01:44:31.112 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.112 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.112 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182152 s, 57.6 MB/s 2024-09-17T01:44:31.130 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.130 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.130 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150882 s, 69.5 MB/s 2024-09-17T01:44:31.147 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.148 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.148 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138549 s, 75.7 MB/s 2024-09-17T01:44:31.171 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.171 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.171 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020124 s, 52.1 MB/s 2024-09-17T01:44:31.188 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.188 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.188 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136456 s, 76.8 MB/s 2024-09-17T01:44:31.205 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.205 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.205 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145608 s, 72.0 MB/s 2024-09-17T01:44:31.226 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.226 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.226 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177132 s, 59.2 MB/s 2024-09-17T01:44:31.244 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.244 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.244 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148644 s, 70.5 MB/s 2024-09-17T01:44:31.263 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.263 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.263 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156042 s, 67.2 MB/s 2024-09-17T01:44:31.284 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.284 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.285 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180932 s, 58.0 MB/s 2024-09-17T01:44:31.301 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.301 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.301 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136408 s, 76.9 MB/s 2024-09-17T01:44:31.321 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.321 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.321 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016443 s, 63.8 MB/s 2024-09-17T01:44:31.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:31.330 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:31.330 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:31.330 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.21 2024-09-17T01:44:31.330 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:31.330 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:31.330 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:31.330 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:31.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:31.431 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.431 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.431 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150173 s, 69.8 MB/s 2024-09-17T01:44:31.452 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.452 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.452 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017505 s, 59.9 MB/s 2024-09-17T01:44:31.476 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.476 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.476 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208453 s, 50.3 MB/s 2024-09-17T01:44:31.495 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.495 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.495 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016427 s, 63.8 MB/s 2024-09-17T01:44:31.517 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.517 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.517 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186445 s, 56.2 MB/s 2024-09-17T01:44:31.536 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.536 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.536 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158759 s, 66.0 MB/s 2024-09-17T01:44:31.554 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.554 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.554 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146666 s, 71.5 MB/s 2024-09-17T01:44:31.571 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.572 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.572 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144369 s, 72.6 MB/s 2024-09-17T01:44:31.588 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.588 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.588 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135356 s, 77.5 MB/s 2024-09-17T01:44:31.607 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.607 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.607 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153565 s, 68.3 MB/s 2024-09-17T01:44:31.623 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.623 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.623 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134481 s, 78.0 MB/s 2024-09-17T01:44:31.642 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.642 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.642 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156114 s, 67.2 MB/s 2024-09-17T01:44:31.660 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.660 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.660 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146401 s, 71.6 MB/s 2024-09-17T01:44:31.677 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.678 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.678 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142861 s, 73.4 MB/s 2024-09-17T01:44:31.693 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.694 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.694 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127061 s, 82.5 MB/s 2024-09-17T01:44:31.714 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.715 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.715 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176627 s, 59.4 MB/s 2024-09-17T01:44:31.731 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.731 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.731 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135411 s, 77.4 MB/s 2024-09-17T01:44:31.750 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.750 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.750 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157782 s, 66.5 MB/s 2024-09-17T01:44:31.768 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.768 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.768 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145448 s, 72.1 MB/s 2024-09-17T01:44:31.789 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.789 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.789 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180632 s, 58.1 MB/s 2024-09-17T01:44:31.806 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.806 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.806 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138328 s, 75.8 MB/s 2024-09-17T01:44:31.823 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.823 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.824 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145927 s, 71.9 MB/s 2024-09-17T01:44:31.841 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.841 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.841 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142345 s, 73.7 MB/s 2024-09-17T01:44:31.859 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.860 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.860 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154018 s, 68.1 MB/s 2024-09-17T01:44:31.881 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.881 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.881 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186192 s, 56.3 MB/s 2024-09-17T01:44:31.898 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.898 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.898 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137597 s, 76.2 MB/s 2024-09-17T01:44:31.915 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.915 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.916 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142292 s, 73.7 MB/s 2024-09-17T01:44:31.933 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.933 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.934 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147439 s, 71.1 MB/s 2024-09-17T01:44:31.952 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.952 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.952 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154989 s, 67.7 MB/s 2024-09-17T01:44:31.972 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.973 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.973 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170744 s, 61.4 MB/s 2024-09-17T01:44:31.991 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:31.992 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:31.992 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160882 s, 65.2 MB/s 2024-09-17T01:44:32.015 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.015 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.015 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202642 s, 51.7 MB/s 2024-09-17T01:44:32.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:32.024 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:32.024 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:32.024 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.22 2024-09-17T01:44:32.024 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:32.024 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:32.024 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:32.024 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:32.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:32.172 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.172 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.172 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014924 s, 70.3 MB/s 2024-09-17T01:44:32.194 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.194 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.194 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174134 s, 60.2 MB/s 2024-09-17T01:44:32.211 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.212 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.212 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160319 s, 65.4 MB/s 2024-09-17T01:44:32.234 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.234 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.234 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187303 s, 56.0 MB/s 2024-09-17T01:44:32.250 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.251 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.251 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137981 s, 76.0 MB/s 2024-09-17T01:44:32.272 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.272 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.272 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180977 s, 57.9 MB/s 2024-09-17T01:44:32.288 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.289 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.289 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136223 s, 77.0 MB/s 2024-09-17T01:44:32.307 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.308 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.308 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157575 s, 66.5 MB/s 2024-09-17T01:44:32.324 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.324 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.324 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139388 s, 75.2 MB/s 2024-09-17T01:44:32.341 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.341 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.341 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136308 s, 76.9 MB/s 2024-09-17T01:44:32.358 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.358 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.358 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137797 s, 76.1 MB/s 2024-09-17T01:44:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.379 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181709 s, 57.7 MB/s 2024-09-17T01:44:32.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.396 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141919 s, 73.9 MB/s 2024-09-17T01:44:32.413 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.413 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.413 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138287 s, 75.8 MB/s 2024-09-17T01:44:32.430 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.431 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.431 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142028 s, 73.8 MB/s 2024-09-17T01:44:32.448 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.448 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.448 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139937 s, 74.9 MB/s 2024-09-17T01:44:32.462 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.462 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.462 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118044 s, 88.8 MB/s 2024-09-17T01:44:32.480 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.481 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.481 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149309 s, 70.2 MB/s 2024-09-17T01:44:32.502 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.502 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.502 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139811 s, 75.0 MB/s 2024-09-17T01:44:32.515 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.515 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.515 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140601 s, 74.6 MB/s 2024-09-17T01:44:32.532 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.532 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.532 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136082 s, 77.1 MB/s 2024-09-17T01:44:32.549 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.549 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.549 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141183 s, 74.3 MB/s 2024-09-17T01:44:32.566 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.566 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.566 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136816 s, 76.6 MB/s 2024-09-17T01:44:32.586 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.586 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.586 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171448 s, 61.2 MB/s 2024-09-17T01:44:32.610 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.610 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.610 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204877 s, 51.2 MB/s 2024-09-17T01:44:32.626 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.627 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.627 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136843 s, 76.6 MB/s 2024-09-17T01:44:32.648 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.648 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.648 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017968 s, 58.4 MB/s 2024-09-17T01:44:32.671 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.671 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.671 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204708 s, 51.2 MB/s 2024-09-17T01:44:32.688 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.689 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.689 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138627 s, 75.6 MB/s 2024-09-17T01:44:32.709 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.709 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.709 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170111 s, 61.6 MB/s 2024-09-17T01:44:32.726 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.726 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.726 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146896 s, 71.4 MB/s 2024-09-17T01:44:32.745 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.745 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.745 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155205 s, 67.6 MB/s 2024-09-17T01:44:32.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:32.754 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:32.754 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:32.754 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.23 2024-09-17T01:44:32.754 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:32.754 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:32.754 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:32.754 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:32.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:32.855 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.855 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.855 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147387 s, 71.1 MB/s 2024-09-17T01:44:32.873 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.873 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.873 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152109 s, 68.9 MB/s 2024-09-17T01:44:32.891 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.891 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.891 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149451 s, 70.2 MB/s 2024-09-17T01:44:32.912 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.913 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.913 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173349 s, 60.5 MB/s 2024-09-17T01:44:32.936 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.936 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.936 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212397 s, 49.4 MB/s 2024-09-17T01:44:32.954 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.955 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.955 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155539 s, 67.4 MB/s 2024-09-17T01:44:32.972 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.972 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.973 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014617 s, 71.7 MB/s 2024-09-17T01:44:32.990 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:32.990 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:32.990 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148224 s, 70.7 MB/s 2024-09-17T01:44:33.007 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.007 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.007 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140926 s, 74.4 MB/s 2024-09-17T01:44:33.022 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.023 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.023 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012071 s, 86.9 MB/s 2024-09-17T01:44:33.040 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.040 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.040 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142088 s, 73.8 MB/s 2024-09-17T01:44:33.060 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.060 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.060 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162834 s, 64.4 MB/s 2024-09-17T01:44:33.078 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.078 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.078 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154369 s, 67.9 MB/s 2024-09-17T01:44:33.095 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.095 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.095 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137589 s, 76.2 MB/s 2024-09-17T01:44:33.116 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.116 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.116 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147543 s, 71.1 MB/s 2024-09-17T01:44:33.131 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.131 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.131 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142838 s, 73.4 MB/s 2024-09-17T01:44:33.152 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.152 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.152 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178717 s, 58.7 MB/s 2024-09-17T01:44:33.169 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.169 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.170 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145322 s, 72.2 MB/s 2024-09-17T01:44:33.191 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.191 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.191 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185229 s, 56.6 MB/s 2024-09-17T01:44:33.208 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.208 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.208 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137482 s, 76.3 MB/s 2024-09-17T01:44:33.229 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.229 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.230 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179509 s, 58.4 MB/s 2024-09-17T01:44:33.250 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.250 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.250 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171677 s, 61.1 MB/s 2024-09-17T01:44:33.269 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.269 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.269 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162581 s, 64.5 MB/s 2024-09-17T01:44:33.286 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.286 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.286 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135192 s, 77.6 MB/s 2024-09-17T01:44:33.307 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.308 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.308 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187455 s, 55.9 MB/s 2024-09-17T01:44:33.329 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.330 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.330 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187427 s, 55.9 MB/s 2024-09-17T01:44:33.347 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.348 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.348 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144677 s, 72.5 MB/s 2024-09-17T01:44:33.367 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.367 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.367 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166916 s, 62.8 MB/s 2024-09-17T01:44:33.385 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.385 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.386 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152674 s, 68.7 MB/s 2024-09-17T01:44:33.405 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.406 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.406 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169302 s, 61.9 MB/s 2024-09-17T01:44:33.426 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.426 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.426 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017765 s, 59.0 MB/s 2024-09-17T01:44:33.443 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.443 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.443 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143333 s, 73.2 MB/s 2024-09-17T01:44:33.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:33.452 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:33.452 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:33.453 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.24 2024-09-17T01:44:33.453 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:33.453 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:33.453 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:33.453 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:33.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:33.553 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.553 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.553 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141105 s, 74.3 MB/s 2024-09-17T01:44:33.571 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.571 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.571 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151958 s, 69.0 MB/s 2024-09-17T01:44:33.589 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.589 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.589 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153766 s, 68.2 MB/s 2024-09-17T01:44:33.606 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.606 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.606 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138161 s, 75.9 MB/s 2024-09-17T01:44:33.624 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.624 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.624 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149005 s, 70.4 MB/s 2024-09-17T01:44:33.643 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.643 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.643 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154925 s, 67.7 MB/s 2024-09-17T01:44:33.663 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.664 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.664 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017984 s, 58.3 MB/s 2024-09-17T01:44:33.681 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.681 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.681 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146706 s, 71.5 MB/s 2024-09-17T01:44:33.701 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.701 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.701 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161433 s, 65.0 MB/s 2024-09-17T01:44:33.720 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.720 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.720 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159671 s, 65.7 MB/s 2024-09-17T01:44:33.740 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.740 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.741 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159967 s, 65.5 MB/s 2024-09-17T01:44:33.758 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.758 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.759 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015893 s, 66.0 MB/s 2024-09-17T01:44:33.775 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.775 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.775 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135625 s, 77.3 MB/s 2024-09-17T01:44:33.793 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.793 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.793 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152901 s, 68.6 MB/s 2024-09-17T01:44:33.810 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.810 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.810 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139174 s, 75.3 MB/s 2024-09-17T01:44:33.827 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.827 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.827 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139835 s, 75.0 MB/s 2024-09-17T01:44:33.844 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.844 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.844 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137722 s, 76.1 MB/s 2024-09-17T01:44:33.861 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.861 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.861 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138493 s, 75.7 MB/s 2024-09-17T01:44:33.883 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.883 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.883 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183442 s, 57.2 MB/s 2024-09-17T01:44:33.900 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.900 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.900 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142574 s, 73.5 MB/s 2024-09-17T01:44:33.917 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.917 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.917 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140393 s, 74.7 MB/s 2024-09-17T01:44:33.934 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.935 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.935 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144366 s, 72.6 MB/s 2024-09-17T01:44:33.951 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.951 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.952 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135572 s, 77.3 MB/s 2024-09-17T01:44:33.969 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.969 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.969 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145135 s, 72.2 MB/s 2024-09-17T01:44:33.992 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:33.993 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:33.993 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191476 s, 54.8 MB/s 2024-09-17T01:44:34.015 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.015 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.015 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203317 s, 51.6 MB/s 2024-09-17T01:44:34.033 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.034 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.034 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155269 s, 67.5 MB/s 2024-09-17T01:44:34.047 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.047 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.047 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110665 s, 94.8 MB/s 2024-09-17T01:44:34.066 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.066 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.066 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158278 s, 66.2 MB/s 2024-09-17T01:44:34.083 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.084 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.084 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142489 s, 73.6 MB/s 2024-09-17T01:44:34.106 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.106 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.106 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189917 s, 55.2 MB/s 2024-09-17T01:44:34.125 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.125 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.125 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159634 s, 65.7 MB/s 2024-09-17T01:44:34.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:34.134 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:34.134 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:34.134 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.25 2024-09-17T01:44:34.134 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:34.134 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:34.134 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:34.135 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:34.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:34.235 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.235 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.235 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142763 s, 73.4 MB/s 2024-09-17T01:44:34.252 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.252 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.253 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140437 s, 74.7 MB/s 2024-09-17T01:44:34.270 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.271 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.271 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149946 s, 69.9 MB/s 2024-09-17T01:44:34.289 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.289 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.289 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146024 s, 71.8 MB/s 2024-09-17T01:44:34.305 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.305 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.306 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136453 s, 76.8 MB/s 2024-09-17T01:44:34.322 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.323 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.323 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144725 s, 72.5 MB/s 2024-09-17T01:44:34.342 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.343 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.343 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170061 s, 61.7 MB/s 2024-09-17T01:44:34.359 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.359 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.359 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135911 s, 77.2 MB/s 2024-09-17T01:44:34.378 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.378 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.378 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154917 s, 67.7 MB/s 2024-09-17T01:44:34.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.396 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153073 s, 68.5 MB/s 2024-09-17T01:44:34.415 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.415 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.415 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148937 s, 70.4 MB/s 2024-09-17T01:44:34.433 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.433 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.433 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156207 s, 67.1 MB/s 2024-09-17T01:44:34.450 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.451 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.451 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142153 s, 73.8 MB/s 2024-09-17T01:44:34.472 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.472 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.472 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185603 s, 56.5 MB/s 2024-09-17T01:44:34.491 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.491 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.491 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155094 s, 67.6 MB/s 2024-09-17T01:44:34.508 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.508 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.508 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142977 s, 73.3 MB/s 2024-09-17T01:44:34.524 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.525 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.525 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133801 s, 78.4 MB/s 2024-09-17T01:44:34.543 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.543 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.543 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156884 s, 66.8 MB/s 2024-09-17T01:44:34.565 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.565 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.565 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183186 s, 57.2 MB/s 2024-09-17T01:44:34.586 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.586 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.586 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018097 s, 57.9 MB/s 2024-09-17T01:44:34.604 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.604 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.604 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146152 s, 71.7 MB/s 2024-09-17T01:44:34.620 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.620 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.620 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132869 s, 78.9 MB/s 2024-09-17T01:44:34.638 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.638 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.638 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143945 s, 72.8 MB/s 2024-09-17T01:44:34.659 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.659 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.659 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177668 s, 59.0 MB/s 2024-09-17T01:44:34.676 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.676 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.676 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142526 s, 73.6 MB/s 2024-09-17T01:44:34.695 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.695 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.695 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158082 s, 66.3 MB/s 2024-09-17T01:44:34.716 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.716 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.716 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178439 s, 58.8 MB/s 2024-09-17T01:44:34.736 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.737 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.737 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177707 s, 59.0 MB/s 2024-09-17T01:44:34.755 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.755 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.755 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149125 s, 70.3 MB/s 2024-09-17T01:44:34.772 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.772 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.772 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144842 s, 72.4 MB/s 2024-09-17T01:44:34.789 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.790 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.790 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146028 s, 71.8 MB/s 2024-09-17T01:44:34.807 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.808 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.808 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144262 s, 72.7 MB/s 2024-09-17T01:44:34.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:34.818 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:34.818 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:34.818 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.26 2024-09-17T01:44:34.818 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:34.819 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:34.819 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:34.819 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:34.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:34.926 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.926 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.926 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205995 s, 50.9 MB/s 2024-09-17T01:44:34.943 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.943 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.943 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140116 s, 74.8 MB/s 2024-09-17T01:44:34.962 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.962 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.962 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156892 s, 66.8 MB/s 2024-09-17T01:44:34.981 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:34.981 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:34.981 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154917 s, 67.7 MB/s 2024-09-17T01:44:35.003 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.003 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.003 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189792 s, 55.2 MB/s 2024-09-17T01:44:35.021 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.021 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.021 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148843 s, 70.4 MB/s 2024-09-17T01:44:35.040 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.041 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.041 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164305 s, 63.8 MB/s 2024-09-17T01:44:35.057 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.058 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.058 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014238 s, 73.6 MB/s 2024-09-17T01:44:35.080 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.080 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.080 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193493 s, 54.2 MB/s 2024-09-17T01:44:35.098 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.098 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.098 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146214 s, 71.7 MB/s 2024-09-17T01:44:35.117 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.117 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.117 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159741 s, 65.6 MB/s 2024-09-17T01:44:35.132 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.132 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.133 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121076 s, 86.6 MB/s 2024-09-17T01:44:35.150 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.150 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.150 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145389 s, 72.1 MB/s 2024-09-17T01:44:35.168 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.168 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.169 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015322 s, 68.4 MB/s 2024-09-17T01:44:35.186 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.186 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.186 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146246 s, 71.7 MB/s 2024-09-17T01:44:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178538 s, 58.7 MB/s 2024-09-17T01:44:35.226 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.226 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.226 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155176 s, 67.6 MB/s 2024-09-17T01:44:35.243 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.243 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.243 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143202 s, 73.2 MB/s 2024-09-17T01:44:35.261 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.261 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.261 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147074 s, 71.3 MB/s 2024-09-17T01:44:35.281 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.281 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.281 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163556 s, 64.1 MB/s 2024-09-17T01:44:35.300 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.300 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.300 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159074 s, 65.9 MB/s 2024-09-17T01:44:35.324 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.324 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.324 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211509 s, 49.6 MB/s 2024-09-17T01:44:35.347 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.347 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.347 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192168 s, 54.6 MB/s 2024-09-17T01:44:35.364 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.364 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.364 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140101 s, 74.8 MB/s 2024-09-17T01:44:35.382 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.382 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.382 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151453 s, 69.2 MB/s 2024-09-17T01:44:35.403 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.404 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.404 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184441 s, 56.9 MB/s 2024-09-17T01:44:35.422 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.422 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.422 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015357 s, 68.3 MB/s 2024-09-17T01:44:35.441 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.441 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.441 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157758 s, 66.5 MB/s 2024-09-17T01:44:35.458 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.459 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.459 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143444 s, 73.1 MB/s 2024-09-17T01:44:35.476 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.476 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.476 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142081 s, 73.8 MB/s 2024-09-17T01:44:35.496 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.496 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.497 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172293 s, 60.9 MB/s 2024-09-17T01:44:35.514 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.514 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.515 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152127 s, 68.9 MB/s 2024-09-17T01:44:35.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:35.524 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:35.524 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:35.525 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.27 2024-09-17T01:44:35.525 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:35.525 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:35.525 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:35.525 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:35.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:35.626 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.626 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.626 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146114 s, 71.8 MB/s 2024-09-17T01:44:35.643 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.643 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.643 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135932 s, 77.1 MB/s 2024-09-17T01:44:35.663 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.663 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.663 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173826 s, 60.3 MB/s 2024-09-17T01:44:35.681 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.681 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.681 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144906 s, 72.4 MB/s 2024-09-17T01:44:35.705 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.705 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.705 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209505 s, 50.1 MB/s 2024-09-17T01:44:35.723 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.723 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.723 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148892 s, 70.4 MB/s 2024-09-17T01:44:35.748 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.748 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.748 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216844 s, 48.4 MB/s 2024-09-17T01:44:35.766 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.766 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.766 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143745 s, 72.9 MB/s 2024-09-17T01:44:35.786 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.787 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.787 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175827 s, 59.6 MB/s 2024-09-17T01:44:35.801 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.801 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.801 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01172 s, 89.5 MB/s 2024-09-17T01:44:35.818 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.818 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.818 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136392 s, 76.9 MB/s 2024-09-17T01:44:35.836 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.836 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.836 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144843 s, 72.4 MB/s 2024-09-17T01:44:35.855 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.855 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.855 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156305 s, 67.1 MB/s 2024-09-17T01:44:35.873 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.873 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.873 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151157 s, 69.4 MB/s 2024-09-17T01:44:35.894 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.895 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.895 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186474 s, 56.2 MB/s 2024-09-17T01:44:35.912 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.912 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.912 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140689 s, 74.5 MB/s 2024-09-17T01:44:35.930 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.930 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.930 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149971 s, 69.9 MB/s 2024-09-17T01:44:35.948 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.948 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.948 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145929 s, 71.9 MB/s 2024-09-17T01:44:35.969 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.969 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.969 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178906 s, 58.6 MB/s 2024-09-17T01:44:35.989 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:35.989 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:35.990 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176335 s, 59.5 MB/s 2024-09-17T01:44:36.008 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.008 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.008 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148485 s, 70.6 MB/s 2024-09-17T01:44:36.025 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.025 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.025 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145331 s, 72.2 MB/s 2024-09-17T01:44:36.043 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.043 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.043 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148873 s, 70.4 MB/s 2024-09-17T01:44:36.064 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.064 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.064 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176105 s, 59.5 MB/s 2024-09-17T01:44:36.082 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.082 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.083 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154828 s, 67.7 MB/s 2024-09-17T01:44:36.104 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.104 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.105 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188932 s, 55.5 MB/s 2024-09-17T01:44:36.123 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.123 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.123 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151683 s, 69.1 MB/s 2024-09-17T01:44:36.140 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.140 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.141 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138474 s, 75.7 MB/s 2024-09-17T01:44:36.156 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.157 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.157 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133834 s, 78.3 MB/s 2024-09-17T01:44:36.177 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.177 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.178 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175827 s, 59.6 MB/s 2024-09-17T01:44:36.194 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.194 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.194 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139968 s, 74.9 MB/s 2024-09-17T01:44:36.212 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.212 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.212 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141357 s, 74.2 MB/s 2024-09-17T01:44:36.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:36.221 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:36.221 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:36.221 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.28 2024-09-17T01:44:36.221 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:36.221 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:36.221 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:36.221 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:36.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:36.324 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.324 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.324 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144008 s, 72.8 MB/s 2024-09-17T01:44:36.347 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.347 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.347 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197644 s, 53.1 MB/s 2024-09-17T01:44:36.363 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.364 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.364 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138144 s, 75.9 MB/s 2024-09-17T01:44:36.380 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.381 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.381 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143337 s, 73.2 MB/s 2024-09-17T01:44:36.401 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.402 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.402 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017612 s, 59.5 MB/s 2024-09-17T01:44:36.423 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.423 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.423 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184011 s, 57.0 MB/s 2024-09-17T01:44:36.440 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.441 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.441 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141568 s, 74.1 MB/s 2024-09-17T01:44:36.458 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.458 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.458 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142853 s, 73.4 MB/s 2024-09-17T01:44:36.475 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.475 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.475 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139553 s, 75.1 MB/s 2024-09-17T01:44:36.492 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.492 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.492 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136403 s, 76.9 MB/s 2024-09-17T01:44:36.509 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.509 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.509 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01403 s, 74.7 MB/s 2024-09-17T01:44:36.526 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.526 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.526 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135223 s, 77.5 MB/s 2024-09-17T01:44:36.544 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.545 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.545 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154871 s, 67.7 MB/s 2024-09-17T01:44:36.563 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.563 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.563 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153889 s, 68.1 MB/s 2024-09-17T01:44:36.583 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.583 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.583 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166374 s, 63.0 MB/s 2024-09-17T01:44:36.604 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.604 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.604 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180871 s, 58.0 MB/s 2024-09-17T01:44:36.622 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.623 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.623 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150274 s, 69.8 MB/s 2024-09-17T01:44:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.640 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140524 s, 74.6 MB/s 2024-09-17T01:44:36.656 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.656 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.656 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134106 s, 78.2 MB/s 2024-09-17T01:44:36.676 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.676 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.676 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173199 s, 60.5 MB/s 2024-09-17T01:44:36.694 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.694 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.694 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141867 s, 73.9 MB/s 2024-09-17T01:44:36.712 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.712 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.712 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150143 s, 69.8 MB/s 2024-09-17T01:44:36.733 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.733 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.733 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183802 s, 57.0 MB/s 2024-09-17T01:44:36.751 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.751 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.751 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144476 s, 72.6 MB/s 2024-09-17T01:44:36.768 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.768 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.768 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141737 s, 74.0 MB/s 2024-09-17T01:44:36.789 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.789 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.789 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176172 s, 59.5 MB/s 2024-09-17T01:44:36.806 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.807 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.807 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144099 s, 72.8 MB/s 2024-09-17T01:44:36.824 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.825 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.825 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128199 s, 81.8 MB/s 2024-09-17T01:44:36.839 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.840 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.840 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137875 s, 76.1 MB/s 2024-09-17T01:44:36.857 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.857 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.858 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143648 s, 73.0 MB/s 2024-09-17T01:44:36.879 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.879 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.879 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018767 s, 55.9 MB/s 2024-09-17T01:44:36.900 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:36.900 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:36.900 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181008 s, 57.9 MB/s 2024-09-17T01:44:36.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:36.909 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:36.909 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:36.909 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.29 2024-09-17T01:44:36.910 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:36.910 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:36.910 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:36.910 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:36.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:37.012 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.012 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.012 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159286 s, 65.8 MB/s 2024-09-17T01:44:37.032 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.032 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.033 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147709 s, 71.0 MB/s 2024-09-17T01:44:37.052 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.052 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.052 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188783 s, 55.5 MB/s 2024-09-17T01:44:37.075 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.075 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.076 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019883 s, 52.7 MB/s 2024-09-17T01:44:37.101 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.101 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.101 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223619 s, 46.9 MB/s 2024-09-17T01:44:37.125 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.125 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.125 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211168 s, 49.7 MB/s 2024-09-17T01:44:37.143 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.143 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.143 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139722 s, 75.0 MB/s 2024-09-17T01:44:37.163 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.163 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.163 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162282 s, 64.6 MB/s 2024-09-17T01:44:37.182 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.182 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.182 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159184 s, 65.9 MB/s 2024-09-17T01:44:37.203 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.203 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.203 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182892 s, 57.3 MB/s 2024-09-17T01:44:37.221 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.221 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.221 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145121 s, 72.3 MB/s 2024-09-17T01:44:37.238 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.238 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.238 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138569 s, 75.7 MB/s 2024-09-17T01:44:37.259 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.260 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.260 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182932 s, 57.3 MB/s 2024-09-17T01:44:37.278 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.279 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.279 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158356 s, 66.2 MB/s 2024-09-17T01:44:37.297 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.297 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.297 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150711 s, 69.6 MB/s 2024-09-17T01:44:37.314 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.315 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.315 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144135 s, 72.7 MB/s 2024-09-17T01:44:37.333 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.333 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.333 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015093 s, 69.5 MB/s 2024-09-17T01:44:37.348 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.348 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.348 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119959 s, 87.4 MB/s 2024-09-17T01:44:37.365 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.365 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.365 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141643 s, 74.0 MB/s 2024-09-17T01:44:37.382 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.382 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.382 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140394 s, 74.7 MB/s 2024-09-17T01:44:37.407 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.407 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.407 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214203 s, 49.0 MB/s 2024-09-17T01:44:37.424 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.424 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.424 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014257 s, 73.5 MB/s 2024-09-17T01:44:37.447 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.447 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.447 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194596 s, 53.9 MB/s 2024-09-17T01:44:37.468 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.468 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.468 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174274 s, 60.2 MB/s 2024-09-17T01:44:37.490 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.490 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.490 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188589 s, 55.6 MB/s 2024-09-17T01:44:37.508 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.508 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.508 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153969 s, 68.1 MB/s 2024-09-17T01:44:37.526 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.526 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.526 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01423 s, 73.7 MB/s 2024-09-17T01:44:37.545 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.545 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.546 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165546 s, 63.3 MB/s 2024-09-17T01:44:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.567 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.568 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190034 s, 55.2 MB/s 2024-09-17T01:44:37.586 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.586 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.586 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150149 s, 69.8 MB/s 2024-09-17T01:44:37.602 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.603 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.603 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137615 s, 76.2 MB/s 2024-09-17T01:44:37.621 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.621 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.621 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154649 s, 67.8 MB/s 2024-09-17T01:44:37.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:37.630 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:37.631 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:37.631 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.30 2024-09-17T01:44:37.631 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:37.631 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:37.631 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:37.631 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:37.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:37.736 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.736 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.736 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019141 s, 54.8 MB/s 2024-09-17T01:44:37.752 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.752 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.752 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013309 s, 78.8 MB/s 2024-09-17T01:44:37.772 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.773 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.773 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174155 s, 60.2 MB/s 2024-09-17T01:44:37.791 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.791 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.791 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157239 s, 66.7 MB/s 2024-09-17T01:44:37.810 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.810 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.810 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158656 s, 66.1 MB/s 2024-09-17T01:44:37.834 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.834 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.834 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208858 s, 50.2 MB/s 2024-09-17T01:44:37.858 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.858 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.858 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210215 s, 49.9 MB/s 2024-09-17T01:44:37.877 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.877 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.877 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152817 s, 68.6 MB/s 2024-09-17T01:44:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.896 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163788 s, 64.0 MB/s 2024-09-17T01:44:37.913 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.913 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.913 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141041 s, 74.3 MB/s 2024-09-17T01:44:37.935 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.935 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.935 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186446 s, 56.2 MB/s 2024-09-17T01:44:37.954 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.954 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.954 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158479 s, 66.2 MB/s 2024-09-17T01:44:37.971 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.971 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.971 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136998 s, 76.5 MB/s 2024-09-17T01:44:37.991 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:37.992 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:37.992 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176342 s, 59.5 MB/s 2024-09-17T01:44:38.009 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.009 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.009 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138895 s, 75.5 MB/s 2024-09-17T01:44:38.028 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.028 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.028 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155796 s, 67.3 MB/s 2024-09-17T01:44:38.052 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.053 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.053 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018541 s, 56.6 MB/s 2024-09-17T01:44:38.070 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.070 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.070 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017068 s, 61.4 MB/s 2024-09-17T01:44:38.087 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.087 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.087 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137226 s, 76.4 MB/s 2024-09-17T01:44:38.106 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.106 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.106 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152854 s, 68.6 MB/s 2024-09-17T01:44:38.122 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.122 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.122 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137454 s, 76.3 MB/s 2024-09-17T01:44:38.139 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.139 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.140 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138791 s, 75.6 MB/s 2024-09-17T01:44:38.158 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.159 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.159 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158238 s, 66.3 MB/s 2024-09-17T01:44:38.177 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.177 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.177 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142822 s, 73.4 MB/s 2024-09-17T01:44:38.195 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.195 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.195 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149267 s, 70.2 MB/s 2024-09-17T01:44:38.215 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.216 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.216 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172706 s, 60.7 MB/s 2024-09-17T01:44:38.233 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.233 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.233 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138325 s, 75.8 MB/s 2024-09-17T01:44:38.251 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.251 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.251 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146105 s, 71.8 MB/s 2024-09-17T01:44:38.268 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.269 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.269 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142755 s, 73.5 MB/s 2024-09-17T01:44:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185801 s, 56.4 MB/s 2024-09-17T01:44:38.308 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.308 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.309 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139352 s, 75.2 MB/s 2024-09-17T01:44:38.326 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.326 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.326 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138533 s, 75.7 MB/s 2024-09-17T01:44:38.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:38.335 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:44:38.335 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:44:38.335 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.31 2024-09-17T01:44:38.335 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:44:38.335 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:44:38.335 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:44:38.335 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:44:38.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:44:38.436 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.436 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.436 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141603 s, 74.1 MB/s 2024-09-17T01:44:38.454 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.454 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.454 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138787 s, 75.6 MB/s 2024-09-17T01:44:38.472 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.472 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.472 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142626 s, 73.5 MB/s 2024-09-17T01:44:38.490 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.491 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.491 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014841 s, 70.7 MB/s 2024-09-17T01:44:38.515 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.515 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.515 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209661 s, 50.0 MB/s 2024-09-17T01:44:38.539 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.539 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.540 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204989 s, 51.2 MB/s 2024-09-17T01:44:38.558 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.558 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.558 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152378 s, 68.8 MB/s 2024-09-17T01:44:38.576 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.576 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.576 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140308 s, 74.7 MB/s 2024-09-17T01:44:38.593 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.594 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.594 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144422 s, 72.6 MB/s 2024-09-17T01:44:38.613 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.613 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.613 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159216 s, 65.9 MB/s 2024-09-17T01:44:38.630 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.630 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.630 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135257 s, 77.5 MB/s 2024-09-17T01:44:38.650 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.650 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.650 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156048 s, 67.2 MB/s 2024-09-17T01:44:38.668 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.668 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.668 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144126 s, 72.8 MB/s 2024-09-17T01:44:38.686 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.686 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.686 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014559 s, 72.0 MB/s 2024-09-17T01:44:38.704 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.704 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.704 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144284 s, 72.7 MB/s 2024-09-17T01:44:38.722 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.722 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.722 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143366 s, 73.1 MB/s 2024-09-17T01:44:38.741 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.741 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.741 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152411 s, 68.8 MB/s 2024-09-17T01:44:38.759 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.759 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.759 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142287 s, 73.7 MB/s 2024-09-17T01:44:38.776 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.777 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.777 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143834 s, 72.9 MB/s 2024-09-17T01:44:38.794 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.795 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.795 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141697 s, 74.0 MB/s 2024-09-17T01:44:38.816 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.817 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.817 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187936 s, 55.8 MB/s 2024-09-17T01:44:38.834 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.834 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.834 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134309 s, 78.1 MB/s 2024-09-17T01:44:38.851 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.852 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.852 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142168 s, 73.8 MB/s 2024-09-17T01:44:38.872 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.872 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.872 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017147 s, 61.2 MB/s 2024-09-17T01:44:38.890 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.890 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.890 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136615 s, 76.8 MB/s 2024-09-17T01:44:38.907 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.907 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.907 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140829 s, 74.5 MB/s 2024-09-17T01:44:38.924 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.924 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.924 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138574 s, 75.7 MB/s 2024-09-17T01:44:38.945 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.946 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.946 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179145 s, 58.5 MB/s 2024-09-17T01:44:38.963 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.963 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.963 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01336 s, 78.5 MB/s 2024-09-17T01:44:38.981 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:38.981 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:38.981 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146879 s, 71.4 MB/s 2024-09-17T01:44:39.001 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:39.001 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:39.001 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164026 s, 63.9 MB/s 2024-09-17T01:44:39.021 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:44:39.021 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:44:39.021 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164924 s, 63.6 MB/s 2024-09-17T01:44:39.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:44:39.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:44:39.030 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub start /scrub_control_test_path recursive 2024-09-17T01:44:39.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.268+0000 7f51f9c00640 1 -- 172.21.15.42:0/3693489383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f40b56d0 msgr2=0x7f51f40b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:39.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.268+0000 7f51f9c00640 1 --2- 172.21.15.42:0/3693489383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f40b56d0 0x7f51f40b46f0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f51f4160340 tx=0x7f51e402a5f0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.268+0000 7f51f9c00640 1 -- 172.21.15.42:0/3693489383 shutdown_connections 2024-09-17T01:44:39.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.268+0000 7f51f9c00640 1 --2- 172.21.15.42:0/3693489383 >> v2:172.21.15.43:3300/0 conn(0x7f51f406db40 0x7f51f40cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.268+0000 7f51f9c00640 1 --2- 172.21.15.42:0/3693489383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f40b56d0 0x7f51f40b46f0 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.268+0000 7f51f9c00640 1 -- 172.21.15.42:0/3693489383 >> 172.21.15.42:0/3693489383 conn(0x7f51f40b28f0 msgr2=0x7f51f406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:39.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.268+0000 7f51f9c00640 1 -- 172.21.15.42:0/3693489383 shutdown_connections 2024-09-17T01:44:39.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.269+0000 7f51f9c00640 1 -- 172.21.15.42:0/3693489383 wait complete. 2024-09-17T01:44:39.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.271+0000 7f51f9c00640 1 Processor -- start 2024-09-17T01:44:39.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.271+0000 7f51f9c00640 1 -- start start 2024-09-17T01:44:39.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.272+0000 7f51f9c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f40b56d0 0x7f51f41e8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.272+0000 7f51f9c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51f40cdb20 0x7f51f4144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.272+0000 7f51f9c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f4144950 0x7f51f41e8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.272+0000 7f51f9c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f51f415d560 con 0x7f51f40b56d0 2024-09-17T01:44:39.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.272+0000 7f51f9c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f51f415d3e0 con 0x7f51f4144950 2024-09-17T01:44:39.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.272+0000 7f51f9c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f51f415d6e0 con 0x7f51f40cdb20 2024-09-17T01:44:39.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.272+0000 7f51f2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f40b56d0 0x7f51f41e8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.272+0000 7f51f2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f40b56d0 0x7f51f41e8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33766/0 (socket says 172.21.15.42:33766) 2024-09-17T01:44:39.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.272+0000 7f51f2a00640 1 -- 172.21.15.42:0/2000530598 learned_addr learned my addr 172.21.15.42:0/2000530598 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:39.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.273+0000 7f51f3400640 1 --2- 172.21.15.42:0/2000530598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f4144950 0x7f51f41e8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.273+0000 7f51ebe00640 1 --2- 172.21.15.42:0/2000530598 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51f40cdb20 0x7f51f4144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.273+0000 7f51f2a00640 1 -- 172.21.15.42:0/2000530598 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51f40cdb20 msgr2=0x7f51f4144410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:39.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.273+0000 7f51f2a00640 1 --2- 172.21.15.42:0/2000530598 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51f40cdb20 0x7f51f4144410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.273+0000 7f51f2a00640 1 -- 172.21.15.42:0/2000530598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f4144950 msgr2=0x7f51f41e8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:39.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.273+0000 7f51f2a00640 1 --2- 172.21.15.42:0/2000530598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f4144950 0x7f51f41e8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.273+0000 7f51f2a00640 1 -- 172.21.15.42:0/2000530598 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f41f5a00 con 0x7f51f40b56d0 2024-09-17T01:44:39.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.273+0000 7f51f3400640 1 --2- 172.21.15.42:0/2000530598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f4144950 0x7f51f41e8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:44:39.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.273+0000 7f51ebe00640 1 --2- 172.21.15.42:0/2000530598 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51f40cdb20 0x7f51f4144410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:44:39.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.273+0000 7f51f2a00640 1 --2- 172.21.15.42:0/2000530598 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f40b56d0 0x7f51f41e8480 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f51e40099c0 tx=0x7f51e40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:39.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.274+0000 7f51eaa00640 1 -- 172.21.15.42:0/2000530598 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e403e030 con 0x7f51f40b56d0 2024-09-17T01:44:39.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.274+0000 7f51eaa00640 1 -- 172.21.15.42:0/2000530598 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51e4003db0 con 0x7f51f40b56d0 2024-09-17T01:44:39.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.274+0000 7f51f9c00640 1 -- 172.21.15.42:0/2000530598 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51f41f5ce0 con 0x7f51f40b56d0 2024-09-17T01:44:39.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.274+0000 7f51eaa00640 1 -- 172.21.15.42:0/2000530598 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4035040 con 0x7f51f40b56d0 2024-09-17T01:44:39.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.274+0000 7f51f9c00640 1 -- 172.21.15.42:0/2000530598 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51f41f62a0 con 0x7f51f40b56d0 2024-09-17T01:44:39.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.276+0000 7f51eaa00640 1 -- 172.21.15.42:0/2000530598 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f51e4041030 con 0x7f51f40b56d0 2024-09-17T01:44:39.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.277+0000 7f51eaa00640 1 --2- 172.21.15.42:0/2000530598 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f51d0078b90 0x7f51d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.277+0000 7f51eaa00640 1 -- 172.21.15.42:0/2000530598 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7f51e40bb860 con 0x7f51f40b56d0 2024-09-17T01:44:39.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.278+0000 7f5200c08740 1 Processor -- start 2024-09-17T01:44:39.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.278+0000 7f51ebe00640 1 --2- 172.21.15.42:0/2000530598 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f51d0078b90 0x7f51d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.278+0000 7f5200c08740 1 -- start start 2024-09-17T01:44:39.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.278+0000 7f51ebe00640 1 --2- 172.21.15.42:0/2000530598 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f51d0078b90 0x7f51d007b0a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f51f40b0550 tx=0x7f51dc009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:39.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.279+0000 7f5200c08740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d66e730 0x56545da5b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.279+0000 7f5200c08740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56545d645870 0x56545da2fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.279+0000 7f5200c08740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56545d64da50 0x56545da303d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.279+0000 7f5200c08740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56545d988a70 con 0x56545d66e730 2024-09-17T01:44:39.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.279+0000 7f5200c08740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56545d977ea0 con 0x56545d645870 2024-09-17T01:44:39.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.279+0000 7f5200c08740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56545d97bcb0 con 0x56545d64da50 2024-09-17T01:44:39.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.279+0000 7f51f2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d66e730 0x56545da5b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.279+0000 7f51f2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d66e730 0x56545da5b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33770/0 (socket says 172.21.15.42:33770) 2024-09-17T01:44:39.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.279+0000 7f51ebe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56545d645870 0x56545da2fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.279+0000 7f51f2a00640 1 -- 172.21.15.42:0/955540949 learned_addr learned my addr 172.21.15.42:0/955540949 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:39.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.279+0000 7f51f3400640 1 --2- 172.21.15.42:0/955540949 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56545d64da50 0x56545da303d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.280+0000 7f51f2a00640 1 -- 172.21.15.42:0/955540949 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56545d64da50 msgr2=0x56545da303d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:39.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.280+0000 7f51f2a00640 1 --2- 172.21.15.42:0/955540949 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56545d64da50 0x56545da303d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.280+0000 7f51f2a00640 1 -- 172.21.15.42:0/955540949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56545d645870 msgr2=0x56545da2fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:39.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.280+0000 7f51f2a00640 1 --2- 172.21.15.42:0/955540949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56545d645870 0x56545da2fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.280+0000 7f51f2a00640 1 -- 172.21.15.42:0/955540949 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545d752ba0 con 0x56545d66e730 2024-09-17T01:44:39.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.280+0000 7f51f2a00640 1 --2- 172.21.15.42:0/955540949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d66e730 0x56545da5b040 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f51e40b9c30 tx=0x7f51e4082ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f14852e5c16611 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:39.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.280+0000 7f51e3400640 1 -- 172.21.15.42:0/955540949 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4048070 con 0x56545d66e730 2024-09-17T01:44:39.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.280+0000 7f51e3400640 1 -- 172.21.15.42:0/955540949 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51e4083c80 con 0x56545d66e730 2024-09-17T01:44:39.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.280+0000 7f51e3400640 1 -- 172.21.15.42:0/955540949 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e40839e0 con 0x56545d66e730 2024-09-17T01:44:39.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.281+0000 7f5200c08740 1 -- 172.21.15.42:0/955540949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d66e730 msgr2=0x56545da5b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:39.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.281+0000 7f5200c08740 1 --2- 172.21.15.42:0/955540949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d66e730 0x56545da5b040 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f51e40b9c30 tx=0x7f51e4082ed0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.281+0000 7f5200c08740 1 -- 172.21.15.42:0/955540949 shutdown_connections 2024-09-17T01:44:39.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.281+0000 7f5200c08740 1 --2- 172.21.15.42:0/955540949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56545d645870 0x56545da2fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.281+0000 7f5200c08740 1 --2- 172.21.15.42:0/955540949 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56545d64da50 0x56545da303d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.281+0000 7f5200c08740 1 --2- 172.21.15.42:0/955540949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d66e730 0x56545da5b040 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.281+0000 7f5200c08740 1 -- 172.21.15.42:0/955540949 >> 172.21.15.42:0/955540949 conn(0x56545d662880 msgr2=0x56545da16330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:39.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.281+0000 7f5200c08740 1 -- 172.21.15.42:0/955540949 shutdown_connections 2024-09-17T01:44:39.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.281+0000 7f5200c08740 1 -- 172.21.15.42:0/955540949 wait complete. 2024-09-17T01:44:39.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.282+0000 7f5200c08740 1 -- start start 2024-09-17T01:44:39.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.282+0000 7f5200c08740 1 Processor -- start 2024-09-17T01:44:39.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.284+0000 7f5200c08740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56545d645870 0x56545da54220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.284+0000 7f5200c08740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56545d64da50 0x56545da2f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.284+0000 7f5200c08740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d66e730 0x56545da6cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.284+0000 7f5200c08740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56545d6e8ae0 con 0x56545d66e730 2024-09-17T01:44:39.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.284+0000 7f5200c08740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56545d91d7b0 con 0x56545d64da50 2024-09-17T01:44:39.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.284+0000 7f5200c08740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56545d988a70 con 0x56545d645870 2024-09-17T01:44:39.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.284+0000 7f5200c08740 10 client.0 _ll_register_callbacks cb 0x56545d923890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:44:39.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.284+0000 7f51f3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d66e730 0x56545da6cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.284+0000 7f51f3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d66e730 0x56545da6cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33782/0 (socket says 172.21.15.42:33782) 2024-09-17T01:44:39.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.284+0000 7f51f3400640 1 -- 172.21.15.42:0/3365961590 learned_addr learned my addr 172.21.15.42:0/3365961590 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:39.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.284+0000 7f51ebe00640 1 --2- 172.21.15.42:0/3365961590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56545d64da50 0x56545da2f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.284+0000 7f51f2a00640 1 --2- 172.21.15.42:0/3365961590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56545d645870 0x56545da54220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.285+0000 7f51f3400640 1 -- 172.21.15.42:0/3365961590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56545d645870 msgr2=0x56545da54220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:39.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.285+0000 7f51f3400640 1 --2- 172.21.15.42:0/3365961590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56545d645870 0x56545da54220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.285+0000 7f51f3400640 1 -- 172.21.15.42:0/3365961590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56545d64da50 msgr2=0x56545da2f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:39.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.285+0000 7f51f3400640 1 --2- 172.21.15.42:0/3365961590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56545d64da50 0x56545da2f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.285+0000 7f51f3400640 1 -- 172.21.15.42:0/3365961590 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56545d6b7a40 con 0x56545d66e730 2024-09-17T01:44:39.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.285+0000 7f51f3400640 1 --2- 172.21.15.42:0/3365961590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d66e730 0x56545da6cf60 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f51ec012730 tx=0x7f51ec012bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f4db93fb27f1c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:39.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.285+0000 7f51d7e00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:44:39.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.285+0000 7f51d7e00640 1 -- 172.21.15.42:0/3365961590 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec010d40 con 0x56545d66e730 2024-09-17T01:44:39.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.285+0000 7f51d7e00640 1 -- 172.21.15.42:0/3365961590 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7f51ec01caf0 con 0x56545d66e730 2024-09-17T01:44:39.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.285+0000 7f5200c08740 1 -- 172.21.15.42:0/3365961590 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51e4083c80 con 0x56545d66e730 2024-09-17T01:44:39.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.286+0000 7f51d7e00640 1 -- 172.21.15.42:0/3365961590 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=125) ==== 24+0+0 (secure 0 0 0) 0x7f51ec01ccf0 con 0x56545d66e730 2024-09-17T01:44:39.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.286+0000 7f5200c08740 10 client.9684 fetch_fsmap learned FSMap version 125 2024-09-17T01:44:39.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.286+0000 7f5200c08740 1 -- 172.21.15.42:0/3365961590 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=125,monmap=2+}) -- 0x56545d7b3330 con 0x56545d66e730 2024-09-17T01:44:39.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.286+0000 7f51d7e00640 1 -- 172.21.15.42:0/3365961590 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51e4083c80 con 0x56545d66e730 2024-09-17T01:44:39.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.286+0000 7f51d7e00640 1 -- 172.21.15.42:0/3365961590 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 125) ==== 3502+0+0 (secure 0 0 0) 0x7f51ec023050 con 0x56545d66e730 2024-09-17T01:44:39.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.286+0000 7f5200c08740 10 client.9684 fetch_fsmap finished waiting for FSMap version 125 2024-09-17T01:44:39.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.286+0000 7f5200c08740 10 client.9684 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2024-09-17T01:44:39.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.286+0000 7f5200c08740 20 client.9684 populate_metadata read hostname 'smithi042' 2024-09-17T01:44:39.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.286+0000 7f5200c08740 1 --2- 172.21.15.42:0/3365961590 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x56545d62d300 0x56545da55580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.286+0000 7f5200c08740 4 client.9684 mds_command: new command op to 9516 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:44:39.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.286+0000 7f5200c08740 1 -- 172.21.15.42:0/3365961590 --> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56545d98a9c0 con 0x56545d62d300 2024-09-17T01:44:39.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.286+0000 7f51f2a00640 1 --2- 172.21.15.42:0/3365961590 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x56545d62d300 0x56545da55580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.287+0000 7f51f2a00640 1 --2- 172.21.15.42:0/3365961590 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x56545d62d300 0x56545da55580 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba8aa1fa5cf8ce72 server_cookie=d3f67d966787baea in_seq=0 out_seq=0 2024-09-17T01:44:39.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.287+0000 7f51d7e00640 10 client.9684 ms_handle_connect on v2:172.21.15.42:6833/1557345672 2024-09-17T01:44:39.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.288+0000 7f51d7e00640 1 -- 172.21.15.42:0/3365961590 <== mds.0 v2:172.21.15.42:6833/1557345672 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56545d98a9c0 con 0x56545d62d300 2024-09-17T01:44:39.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.288+0000 7f51d7e00640 10 client.9684 handle_command_reply: tid=0 2024-09-17T01:44:39.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.288+0000 7f5200c08740 1 client.9684 shutdown 2024-09-17T01:44:39.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.288+0000 7f5200c08740 1 -- 172.21.15.42:0/3365961590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d66e730 msgr2=0x56545da6cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:39.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.288+0000 7f5200c08740 1 --2- 172.21.15.42:0/3365961590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d66e730 0x56545da6cf60 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f51ec012730 tx=0x7f51ec012bf0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.288+0000 7f5200c08740 1 -- 172.21.15.42:0/3365961590 shutdown_connections 2024-09-17T01:44:39.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.288+0000 7f5200c08740 1 --2- 172.21.15.42:0/3365961590 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x56545d62d300 0x56545da55580 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.288+0000 7f5200c08740 1 --2- 172.21.15.42:0/3365961590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56545d64da50 0x56545da2f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.288+0000 7f5200c08740 1 --2- 172.21.15.42:0/3365961590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d66e730 0x56545da6cf60 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.288+0000 7f5200c08740 1 --2- 172.21.15.42:0/3365961590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56545d645870 0x56545da54220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.288+0000 7f51d7e00640 0 client.9684 ms_handle_reset on v2:172.21.15.42:6833/1557345672 2024-09-17T01:44:39.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.288+0000 7f5200c08740 1 -- 172.21.15.42:0/3365961590 >> 172.21.15.42:0/3365961590 conn(0x56545d662880 msgr2=0x56545da5b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:39.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.288+0000 7f5200c08740 1 -- 172.21.15.42:0/3365961590 shutdown_connections 2024-09-17T01:44:39.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.288+0000 7f5200c08740 1 -- 172.21.15.42:0/3365961590 wait complete. 2024-09-17T01:44:39.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.288+0000 7f5200c08740 20 client.9684 trim_cache size 0 max 16384 2024-09-17T01:44:39.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.307+0000 7f5200c08740 1 Processor -- start 2024-09-17T01:44:39.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.307+0000 7f5200c08740 1 -- start start 2024-09-17T01:44:39.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.309+0000 7f5200c08740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d645870 0x56545da56c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.309+0000 7f5200c08740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56545d64da50 0x56545da5b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.309+0000 7f5200c08740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56545d66e730 0x56545da73280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.309+0000 7f5200c08740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f51f4202170 con 0x56545d645870 2024-09-17T01:44:39.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.309+0000 7f5200c08740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f51f42011f0 con 0x56545d66e730 2024-09-17T01:44:39.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.309+0000 7f5200c08740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f51f40cce20 con 0x56545d64da50 2024-09-17T01:44:39.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.309+0000 7f51f2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d645870 0x56545da56c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.309+0000 7f51f2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d645870 0x56545da56c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33788/0 (socket says 172.21.15.42:33788) 2024-09-17T01:44:39.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.309+0000 7f51f2a00640 1 -- 172.21.15.42:0/3095040118 learned_addr learned my addr 172.21.15.42:0/3095040118 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:39.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.309+0000 7f51f3400640 1 --2- 172.21.15.42:0/3095040118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56545d66e730 0x56545da73280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.309+0000 7f51ebe00640 1 --2- 172.21.15.42:0/3095040118 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56545d64da50 0x56545da5b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.309+0000 7f51f2a00640 1 -- 172.21.15.42:0/3095040118 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56545d64da50 msgr2=0x56545da5b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:39.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.309+0000 7f51f2a00640 1 --2- 172.21.15.42:0/3095040118 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56545d64da50 0x56545da5b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.309+0000 7f51f2a00640 1 -- 172.21.15.42:0/3095040118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56545d66e730 msgr2=0x56545da73280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:39.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.309+0000 7f51f2a00640 1 --2- 172.21.15.42:0/3095040118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56545d66e730 0x56545da73280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.309+0000 7f51f2a00640 1 -- 172.21.15.42:0/3095040118 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545da2f590 con 0x56545d645870 2024-09-17T01:44:39.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.309+0000 7f51f3400640 1 --2- 172.21.15.42:0/3095040118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56545d66e730 0x56545da73280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:44:39.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.310+0000 7f51f2a00640 1 --2- 172.21.15.42:0/3095040118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d645870 0x56545da56c70 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f51e40a8040 tx=0x7f51e4005e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5510989894e3836f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:39.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.310+0000 7f51e2a00640 1 -- 172.21.15.42:0/3095040118 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e408e020 con 0x56545d645870 2024-09-17T01:44:39.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.310+0000 7f51e2a00640 1 -- 172.21.15.42:0/3095040118 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51e40a1070 con 0x56545d645870 2024-09-17T01:44:39.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.310+0000 7f51e2a00640 1 -- 172.21.15.42:0/3095040118 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4048040 con 0x56545d645870 2024-09-17T01:44:39.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.311+0000 7f5200c08740 1 -- 172.21.15.42:0/3095040118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d645870 msgr2=0x56545da56c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:39.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.311+0000 7f5200c08740 1 --2- 172.21.15.42:0/3095040118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d645870 0x56545da56c70 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f51e40a8040 tx=0x7f51e4005e90 comp rx=0 tx=0).stop 2024-09-17T01:44:39.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.311+0000 7f5200c08740 1 -- 172.21.15.42:0/3095040118 shutdown_connections 2024-09-17T01:44:39.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.311+0000 7f5200c08740 1 --2- 172.21.15.42:0/3095040118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56545d66e730 0x56545da73280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.311+0000 7f5200c08740 1 --2- 172.21.15.42:0/3095040118 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56545d64da50 0x56545da5b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.311+0000 7f5200c08740 1 --2- 172.21.15.42:0/3095040118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d645870 0x56545da56c70 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.311+0000 7f5200c08740 1 -- 172.21.15.42:0/3095040118 >> 172.21.15.42:0/3095040118 conn(0x56545d662880 msgr2=0x56545da2fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:39.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.311+0000 7f5200c08740 1 -- 172.21.15.42:0/3095040118 shutdown_connections 2024-09-17T01:44:39.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.311+0000 7f5200c08740 1 -- 172.21.15.42:0/3095040118 wait complete. 2024-09-17T01:44:39.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.312+0000 7f5200c08740 1 -- start start 2024-09-17T01:44:39.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.312+0000 7f5200c08740 1 Processor -- start 2024-09-17T01:44:39.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.313+0000 7f5200c08740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56545d645870 0x56545da100b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.313+0000 7f5200c08740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56545d64da50 0x56545da2e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.313+0000 7f5200c08740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d66e730 0x56545da2fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.313+0000 7f5200c08740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56545da3d2b0 con 0x56545d66e730 2024-09-17T01:44:39.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.313+0000 7f5200c08740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f51f413f4f0 con 0x56545d645870 2024-09-17T01:44:39.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.313+0000 7f5200c08740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56545dada730 con 0x56545d64da50 2024-09-17T01:44:39.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.313+0000 7f5200c08740 10 client.0 _ll_register_callbacks cb 0x7f51ec009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:44:39.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.314+0000 7f51f3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d66e730 0x56545da2fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.314+0000 7f51f3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d66e730 0x56545da2fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33804/0 (socket says 172.21.15.42:33804) 2024-09-17T01:44:39.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.314+0000 7f51ebe00640 1 --2- 172.21.15.42:0/646666800 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56545d64da50 0x56545da2e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.314+0000 7f51f3400640 1 -- 172.21.15.42:0/646666800 learned_addr learned my addr 172.21.15.42:0/646666800 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:39.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.314+0000 7f51f2a00640 1 --2- 172.21.15.42:0/646666800 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56545d645870 0x56545da100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.314+0000 7f51f3400640 1 -- 172.21.15.42:0/646666800 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56545d64da50 msgr2=0x56545da2e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:39.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.314+0000 7f51f3400640 1 --2- 172.21.15.42:0/646666800 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56545d64da50 0x56545da2e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.314+0000 7f51f3400640 1 -- 172.21.15.42:0/646666800 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56545d645870 msgr2=0x56545da100b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:39.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.314+0000 7f51f3400640 1 --2- 172.21.15.42:0/646666800 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56545d645870 0x56545da100b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.314+0000 7f51f3400640 1 -- 172.21.15.42:0/646666800 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56545d750ea0 con 0x56545d66e730 2024-09-17T01:44:39.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.314+0000 7f51f3400640 1 --2- 172.21.15.42:0/646666800 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d66e730 0x56545da2fe70 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f51ec01c490 tx=0x7f51ec01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa2a895a14c4f1f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:39.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.314+0000 7f51d7e00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:44:39.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.315+0000 7f51d7e00640 1 -- 172.21.15.42:0/646666800 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec01cab0 con 0x56545d66e730 2024-09-17T01:44:39.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.315+0000 7f51d7e00640 1 -- 172.21.15.42:0/646666800 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7f51ec01e6b0 con 0x56545d66e730 2024-09-17T01:44:39.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.315+0000 7f5200c08740 1 -- 172.21.15.42:0/646666800 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51e40a1070 con 0x56545d66e730 2024-09-17T01:44:39.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.315+0000 7f51d7e00640 1 -- 172.21.15.42:0/646666800 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=125) ==== 24+0+0 (secure 0 0 0) 0x7f51ec01e8f0 con 0x56545d66e730 2024-09-17T01:44:39.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.315+0000 7f5200c08740 10 client.9690 fetch_fsmap learned FSMap version 125 2024-09-17T01:44:39.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.315+0000 7f5200c08740 1 -- 172.21.15.42:0/646666800 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=125,monmap=2+}) -- 0x56545da2e9b0 con 0x56545d66e730 2024-09-17T01:44:39.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.315+0000 7f51d7e00640 1 -- 172.21.15.42:0/646666800 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51e40a1070 con 0x56545d66e730 2024-09-17T01:44:39.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.315+0000 7f51d7e00640 1 -- 172.21.15.42:0/646666800 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 125) ==== 3502+0+0 (secure 0 0 0) 0x7f51ec023040 con 0x56545d66e730 2024-09-17T01:44:39.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.315+0000 7f5200c08740 10 client.9690 fetch_fsmap finished waiting for FSMap version 125 2024-09-17T01:44:39.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.315+0000 7f5200c08740 10 client.9690 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2024-09-17T01:44:39.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.315+0000 7f5200c08740 20 client.9690 populate_metadata read hostname 'smithi042' 2024-09-17T01:44:39.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.315+0000 7f5200c08740 1 --2- 172.21.15.42:0/646666800 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x56545da303b0 0x56545da4ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.315+0000 7f5200c08740 4 client.9690 mds_command: new command op to 9516 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-17T01:44:39.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.315+0000 7f5200c08740 1 -- 172.21.15.42:0/646666800 --> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x56545d986470 con 0x56545da303b0 2024-09-17T01:44:39.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.316+0000 7f51f2a00640 1 --2- 172.21.15.42:0/646666800 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x56545da303b0 0x56545da4ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.316+0000 7f51f2a00640 1 --2- 172.21.15.42:0/646666800 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x56545da303b0 0x56545da4ff80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ec8b4a51a76502a server_cookie=b4a87e3df150fe6c in_seq=0 out_seq=0 2024-09-17T01:44:39.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.316+0000 7f51d7e00640 10 client.9690 ms_handle_connect on v2:172.21.15.42:6833/1557345672 2024-09-17T01:44:39.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.319+0000 7f51d7e00640 1 -- 172.21.15.42:0/646666800 <== mds.0 v2:172.21.15.42:6833/1557345672 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56545d986470 con 0x56545da303b0 2024-09-17T01:44:39.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.319+0000 7f51d7e00640 10 client.9690 handle_command_reply: tid=0 2024-09-17T01:44:39.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.319+0000 7f5200c08740 1 client.9690 shutdown 2024-09-17T01:44:39.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.319+0000 7f5200c08740 1 -- 172.21.15.42:0/646666800 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d66e730 msgr2=0x56545da2fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:39.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.319+0000 7f5200c08740 1 --2- 172.21.15.42:0/646666800 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d66e730 0x56545da2fe70 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f51ec01c490 tx=0x7f51ec01c4c0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.319+0000 7f5200c08740 1 -- 172.21.15.42:0/646666800 shutdown_connections 2024-09-17T01:44:39.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.319+0000 7f5200c08740 1 --2- 172.21.15.42:0/646666800 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x56545da303b0 0x56545da4ff80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.319+0000 7f5200c08740 1 --2- 172.21.15.42:0/646666800 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56545d66e730 0x56545da2fe70 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.319+0000 7f5200c08740 1 --2- 172.21.15.42:0/646666800 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56545d64da50 0x56545da2e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.319+0000 7f5200c08740 1 --2- 172.21.15.42:0/646666800 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56545d645870 0x56545da100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.319+0000 7f51d7e00640 0 client.9690 ms_handle_reset on v2:172.21.15.42:6833/1557345672 2024-09-17T01:44:39.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.319+0000 7f5200c08740 1 -- 172.21.15.42:0/646666800 >> 172.21.15.42:0/646666800 conn(0x56545d662880 msgr2=0x56545da73650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:39.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.320+0000 7f5200c08740 1 -- 172.21.15.42:0/646666800 shutdown_connections 2024-09-17T01:44:39.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.320+0000 7f5200c08740 1 -- 172.21.15.42:0/646666800 wait complete. 2024-09-17T01:44:39.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.320+0000 7f5200c08740 20 client.9690 trim_cache size 0 max 16384 2024-09-17T01:44:39.320 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:44:39.320 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-17T01:44:39.320 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "06bdf393-e52f-4211-93fa-43da1f9290da", 2024-09-17T01:44:39.321 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-17T01:44:39.321 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:44:39.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.320+0000 7f51f9c00640 1 -- 172.21.15.42:0/2000530598 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f51d0078b90 msgr2=0x7f51d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:39.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.320+0000 7f51f9c00640 1 --2- 172.21.15.42:0/2000530598 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f51d0078b90 0x7f51d007b0a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f51f40b0550 tx=0x7f51dc009040 comp rx=0 tx=0).stop 2024-09-17T01:44:39.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.320+0000 7f51f9c00640 1 -- 172.21.15.42:0/2000530598 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f40b56d0 msgr2=0x7f51f41e8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:39.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.320+0000 7f51f9c00640 1 --2- 172.21.15.42:0/2000530598 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f40b56d0 0x7f51f41e8480 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f51e40099c0 tx=0x7f51e40038a0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.321+0000 7f51f9c00640 1 -- 172.21.15.42:0/2000530598 shutdown_connections 2024-09-17T01:44:39.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.321+0000 7f51f9c00640 1 --2- 172.21.15.42:0/2000530598 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f51d0078b90 0x7f51d007b0a0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.321+0000 7f51f9c00640 1 --2- 172.21.15.42:0/2000530598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f4144950 0x7f51f41e8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.321+0000 7f51f9c00640 1 --2- 172.21.15.42:0/2000530598 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51f40cdb20 0x7f51f4144410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.321+0000 7f51f9c00640 1 --2- 172.21.15.42:0/2000530598 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f40b56d0 0x7f51f41e8480 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.321+0000 7f51f9c00640 1 -- 172.21.15.42:0/2000530598 >> 172.21.15.42:0/2000530598 conn(0x7f51f40b28f0 msgr2=0x7f51f40b1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:39.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.321+0000 7f51f9c00640 1 -- 172.21.15.42:0/2000530598 shutdown_connections 2024-09-17T01:44:39.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.321+0000 7f51f9c00640 1 -- 172.21.15.42:0/2000530598 wait complete. 2024-09-17T01:44:39.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:44:39.343 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub pause 2024-09-17T01:44:39.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.668+0000 7f821ae00640 1 -- 172.21.15.42:0/2285130444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82140d0d20 msgr2=0x7f82140d1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:39.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.668+0000 7f821ae00640 1 --2- 172.21.15.42:0/2285130444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82140d0d20 0x7f82140d1130 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f82140d42e0 tx=0x7f820002a560 comp rx=0 tx=0).stop 2024-09-17T01:44:39.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.668+0000 7f821ae00640 1 -- 172.21.15.42:0/2285130444 shutdown_connections 2024-09-17T01:44:39.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.668+0000 7f821ae00640 1 --2- 172.21.15.42:0/2285130444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82140d0d20 0x7f82140d1130 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.668+0000 7f821ae00640 1 --2- 172.21.15.42:0/2285130444 >> v2:172.21.15.43:3300/0 conn(0x7f82140d3e40 0x7f82140cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.668+0000 7f821ae00640 1 -- 172.21.15.42:0/2285130444 >> 172.21.15.42:0/2285130444 conn(0x7f821406cd20 msgr2=0x7f821406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:39.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.669+0000 7f821ae00640 1 -- 172.21.15.42:0/2285130444 shutdown_connections 2024-09-17T01:44:39.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.669+0000 7f821ae00640 1 -- 172.21.15.42:0/2285130444 wait complete. 2024-09-17T01:44:39.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.671+0000 7f821ae00640 1 Processor -- start 2024-09-17T01:44:39.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.672+0000 7f821ae00640 1 -- start start 2024-09-17T01:44:39.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.673+0000 7f821ae00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82140d0d20 0x7f82140c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.673+0000 7f821ae00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82140d3e40 0x7f821415dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.674+0000 7f821ae00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f821415ede0 0x7f821415aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.674+0000 7f821ae00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f82140d2b70 con 0x7f82140d3e40 2024-09-17T01:44:39.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.674+0000 7f821ae00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f82140d29f0 con 0x7f821415ede0 2024-09-17T01:44:39.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.674+0000 7f821ae00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f82140d2cf0 con 0x7f82140d0d20 2024-09-17T01:44:39.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.674+0000 7f8219a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82140d0d20 0x7f82140c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.674+0000 7f8219000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82140d3e40 0x7f821415dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.674+0000 7f8219a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82140d0d20 0x7f82140c74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:46498/0 (socket says 172.21.15.42:46498) 2024-09-17T01:44:39.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.674+0000 7f8219a00640 1 -- 172.21.15.42:0/4000047797 learned_addr learned my addr 172.21.15.42:0/4000047797 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:39.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.674+0000 7f821a400640 1 --2- 172.21.15.42:0/4000047797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f821415ede0 0x7f821415aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.675+0000 7f8219a00640 1 -- 172.21.15.42:0/4000047797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f821415ede0 msgr2=0x7f821415aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:39.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.675+0000 7f8219a00640 1 --2- 172.21.15.42:0/4000047797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f821415ede0 0x7f821415aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.675+0000 7f8219a00640 1 -- 172.21.15.42:0/4000047797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82140d3e40 msgr2=0x7f821415dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:39.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.675+0000 7f8219a00640 1 --2- 172.21.15.42:0/4000047797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82140d3e40 0x7f821415dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.675+0000 7f8219a00640 1 -- 172.21.15.42:0/4000047797 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82141599f0 con 0x7f82140d0d20 2024-09-17T01:44:39.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.675+0000 7f8219000640 1 --2- 172.21.15.42:0/4000047797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82140d3e40 0x7f821415dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:44:39.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.675+0000 7f8219a00640 1 --2- 172.21.15.42:0/4000047797 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82140d0d20 0x7f82140c74c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f820800e790 tx=0x7f820800ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:39.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.676+0000 7f8211600640 1 -- 172.21.15.42:0/4000047797 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820800eea0 con 0x7f82140d0d20 2024-09-17T01:44:39.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.676+0000 7f8211600640 1 -- 172.21.15.42:0/4000047797 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f820800cdb0 con 0x7f82140d0d20 2024-09-17T01:44:39.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.676+0000 7f8211600640 1 -- 172.21.15.42:0/4000047797 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8208010690 con 0x7f82140d0d20 2024-09-17T01:44:39.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.676+0000 7f821ae00640 1 -- 172.21.15.42:0/4000047797 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8214159cd0 con 0x7f82140d0d20 2024-09-17T01:44:39.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.676+0000 7f821ae00640 1 -- 172.21.15.42:0/4000047797 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f821415a290 con 0x7f82140d0d20 2024-09-17T01:44:39.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.679+0000 7f8211600640 1 -- 172.21.15.42:0/4000047797 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8208010830 con 0x7f82140d0d20 2024-09-17T01:44:39.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.680+0000 7f8211600640 1 --2- 172.21.15.42:0/4000047797 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f81f4078b90 0x7f81f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.681+0000 7f8211600640 1 -- 172.21.15.42:0/4000047797 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7f820809b780 con 0x7f82140d0d20 2024-09-17T01:44:39.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.681+0000 7f8219000640 1 --2- 172.21.15.42:0/4000047797 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f81f4078b90 0x7f81f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.683+0000 7f82234a9740 1 Processor -- start 2024-09-17T01:44:39.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.683+0000 7f82234a9740 1 -- start start 2024-09-17T01:44:39.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.684+0000 7f8219000640 1 --2- 172.21.15.42:0/4000047797 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f81f4078b90 0x7f81f407b0a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8200033000 tx=0x7f8200004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:39.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.685+0000 7f82234a9740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347bb5390 0x557347fa4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.685+0000 7f82234a9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347b8c4d0 0x557347f87530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.685+0000 7f82234a9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557347b946b0 0x557347f87a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.685+0000 7f82234a9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557347e70c10 con 0x557347b946b0 2024-09-17T01:44:39.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.685+0000 7f82234a9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557347ecf9f0 con 0x557347b8c4d0 2024-09-17T01:44:39.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.685+0000 7f82234a9740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x557347ebee20 con 0x557347bb5390 2024-09-17T01:44:39.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.685+0000 7f8219000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347b8c4d0 0x557347f87530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.686+0000 7f8219a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347bb5390 0x557347fa4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.686+0000 7f821a400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557347b946b0 0x557347f87a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.686+0000 7f8219a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347bb5390 0x557347fa4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:46500/0 (socket says 172.21.15.42:46500) 2024-09-17T01:44:39.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.686+0000 7f8219a00640 1 -- 172.21.15.42:0/3547047440 learned_addr learned my addr 172.21.15.42:0/3547047440 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:39.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.686+0000 7f8219a00640 1 -- 172.21.15.42:0/3547047440 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347b8c4d0 msgr2=0x557347f87530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:39.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.686+0000 7f8219a00640 1 --2- 172.21.15.42:0/3547047440 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347b8c4d0 0x557347f87530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.686+0000 7f8219a00640 1 -- 172.21.15.42:0/3547047440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557347b946b0 msgr2=0x557347f87a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:39.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.686+0000 7f8219a00640 1 --2- 172.21.15.42:0/3547047440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557347b946b0 0x557347f87a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.686+0000 7f8219a00640 1 -- 172.21.15.42:0/3547047440 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557347c977d0 con 0x557347bb5390 2024-09-17T01:44:39.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.686+0000 7f821a400640 1 --2- 172.21.15.42:0/3547047440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557347b946b0 0x557347f87a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:44:39.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.687+0000 7f8219a00640 1 --2- 172.21.15.42:0/3547047440 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347bb5390 0x557347fa4860 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8208060740 tx=0x7f820801f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=475249cd398e8c03 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:39.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.687+0000 7f8206000640 1 -- 172.21.15.42:0/3547047440 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8208067f00 con 0x557347bb5390 2024-09-17T01:44:39.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.687+0000 7f8206000640 1 -- 172.21.15.42:0/3547047440 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f820806ce40 con 0x557347bb5390 2024-09-17T01:44:39.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.687+0000 7f8206000640 1 -- 172.21.15.42:0/3547047440 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8208062970 con 0x557347bb5390 2024-09-17T01:44:39.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.688+0000 7f82234a9740 1 -- 172.21.15.42:0/3547047440 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347bb5390 msgr2=0x557347fa4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:39.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.688+0000 7f82234a9740 1 --2- 172.21.15.42:0/3547047440 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347bb5390 0x557347fa4860 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8208060740 tx=0x7f820801f000 comp rx=0 tx=0).stop 2024-09-17T01:44:39.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.689+0000 7f82234a9740 1 -- 172.21.15.42:0/3547047440 shutdown_connections 2024-09-17T01:44:39.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.689+0000 7f82234a9740 1 --2- 172.21.15.42:0/3547047440 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347b8c4d0 0x557347f87530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.689+0000 7f82234a9740 1 --2- 172.21.15.42:0/3547047440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557347b946b0 0x557347f87a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.689+0000 7f82234a9740 1 --2- 172.21.15.42:0/3547047440 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347bb5390 0x557347fa4860 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.689+0000 7f82234a9740 1 -- 172.21.15.42:0/3547047440 >> 172.21.15.42:0/3547047440 conn(0x557347ba94e0 msgr2=0x557347f5d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:39.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.689+0000 7f82234a9740 1 -- 172.21.15.42:0/3547047440 shutdown_connections 2024-09-17T01:44:39.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.689+0000 7f82234a9740 1 -- 172.21.15.42:0/3547047440 wait complete. 2024-09-17T01:44:39.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.691+0000 7f82234a9740 1 -- start start 2024-09-17T01:44:39.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.691+0000 7f82234a9740 1 Processor -- start 2024-09-17T01:44:39.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.694+0000 7f82234a9740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347b8c4d0 0x557347f9a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.694+0000 7f82234a9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557347b946b0 0x557347f9e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.694+0000 7f82234a9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347bb5390 0x557347f97fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.694+0000 7f82234a9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557347e64790 con 0x557347b946b0 2024-09-17T01:44:39.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.694+0000 7f82234a9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557347ec2c30 con 0x557347bb5390 2024-09-17T01:44:39.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.694+0000 7f82234a9740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x557347c2f740 con 0x557347b8c4d0 2024-09-17T01:44:39.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.694+0000 7f82234a9740 10 client.0 _ll_register_callbacks cb 0x557347e74260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:44:39.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.694+0000 7f821a400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347bb5390 0x557347f97fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.694+0000 7f821a400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347bb5390 0x557347f97fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:58066/0 (socket says 172.21.15.42:58066) 2024-09-17T01:44:39.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.694+0000 7f821a400640 1 -- 172.21.15.42:0/3024060623 learned_addr learned my addr 172.21.15.42:0/3024060623 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:39.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.694+0000 7f8219a00640 1 --2- 172.21.15.42:0/3024060623 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347b8c4d0 0x557347f9a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.695+0000 7f8219000640 1 --2- 172.21.15.42:0/3024060623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557347b946b0 0x557347f9e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.695+0000 7f821a400640 1 -- 172.21.15.42:0/3024060623 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347b8c4d0 msgr2=0x557347f9a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:39.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.695+0000 7f821a400640 1 --2- 172.21.15.42:0/3024060623 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347b8c4d0 0x557347f9a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.695+0000 7f821a400640 1 -- 172.21.15.42:0/3024060623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557347b946b0 msgr2=0x557347f9e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:39.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.695+0000 7f821a400640 1 --2- 172.21.15.42:0/3024060623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557347b946b0 0x557347f9e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.695+0000 7f821a400640 1 -- 172.21.15.42:0/3024060623 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557347bfe6a0 con 0x557347bb5390 2024-09-17T01:44:39.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.695+0000 7f8219000640 1 --2- 172.21.15.42:0/3024060623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557347b946b0 0x557347f9e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:44:39.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.695+0000 7f8219a00640 1 --2- 172.21.15.42:0/3024060623 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347b8c4d0 0x557347f9a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:44:39.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.696+0000 7f821a400640 1 --2- 172.21.15.42:0/3024060623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347bb5390 0x557347f97fe0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f820c0125a0 tx=0x7f820c012a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8794359008760da server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:39.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.696+0000 7f81faa00640 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2024-09-17T01:44:39.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.696+0000 7f81faa00640 1 -- 172.21.15.42:0/3024060623 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820c019020 con 0x557347bb5390 2024-09-17T01:44:39.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.696+0000 7f82234a9740 1 -- 172.21.15.42:0/3024060623 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f820806ce40 con 0x557347bb5390 2024-09-17T01:44:39.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.697+0000 7f81faa00640 1 -- 172.21.15.42:0/3024060623 <== mon.1 v2:172.21.15.43:3300/0 2 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7f820c003b80 con 0x557347bb5390 2024-09-17T01:44:39.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.697+0000 7f81faa00640 1 -- 172.21.15.42:0/3024060623 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=125) ==== 24+0+0 (secure 0 0 0) 0x7f820c023050 con 0x557347bb5390 2024-09-17T01:44:39.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.697+0000 7f82234a9740 10 client.9025 fetch_fsmap learned FSMap version 125 2024-09-17T01:44:39.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.697+0000 7f82234a9740 1 -- 172.21.15.42:0/3024060623 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=125,monmap=2+}) -- 0x557347cf7f60 con 0x557347bb5390 2024-09-17T01:44:39.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.698+0000 7f81faa00640 1 -- 172.21.15.42:0/3024060623 <== mon.1 v2:172.21.15.43:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f820806ce40 con 0x557347bb5390 2024-09-17T01:44:39.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.698+0000 7f81faa00640 1 -- 172.21.15.42:0/3024060623 <== mon.1 v2:172.21.15.43:3300/0 5 ==== fsmap(e 125) ==== 3502+0+0 (secure 0 0 0) 0x7f820c026020 con 0x557347bb5390 2024-09-17T01:44:39.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.698+0000 7f82234a9740 10 client.9025 fetch_fsmap finished waiting for FSMap version 125 2024-09-17T01:44:39.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.698+0000 7f82234a9740 10 client.9025 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2024-09-17T01:44:39.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.698+0000 7f82234a9740 20 client.9025 populate_metadata read hostname 'smithi042' 2024-09-17T01:44:39.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.698+0000 7f82234a9740 1 --2- 172.21.15.42:0/3024060623 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x557347b73f60 0x557347f746b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.698+0000 7f82234a9740 4 client.9025 mds_command: new command op to 9516 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:44:39.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.698+0000 7f82234a9740 1 -- 172.21.15.42:0/3024060623 --> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557347ed1940 con 0x557347b73f60 2024-09-17T01:44:39.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.698+0000 7f8219a00640 1 --2- 172.21.15.42:0/3024060623 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x557347b73f60 0x557347f746b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.699+0000 7f81faa00640 10 client.9025 ms_handle_connect on v2:172.21.15.42:6833/1557345672 2024-09-17T01:44:39.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.699+0000 7f8219a00640 1 --2- 172.21.15.42:0/3024060623 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x557347b73f60 0x557347f746b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2adf143e8c06f0 server_cookie=9a805ce9d8a903aa in_seq=0 out_seq=0 2024-09-17T01:44:39.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.703+0000 7f81faa00640 1 -- 172.21.15.42:0/3024060623 <== mds.0 v2:172.21.15.42:6833/1557345672 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557347ed1940 con 0x557347b73f60 2024-09-17T01:44:39.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.703+0000 7f81faa00640 10 client.9025 handle_command_reply: tid=0 2024-09-17T01:44:39.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.703+0000 7f82234a9740 1 client.9025 shutdown 2024-09-17T01:44:39.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.704+0000 7f82234a9740 1 -- 172.21.15.42:0/3024060623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347bb5390 msgr2=0x557347f97fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:39.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.704+0000 7f82234a9740 1 --2- 172.21.15.42:0/3024060623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347bb5390 0x557347f97fe0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f820c0125a0 tx=0x7f820c012a60 comp rx=0 tx=0).stop 2024-09-17T01:44:39.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.704+0000 7f82234a9740 1 -- 172.21.15.42:0/3024060623 shutdown_connections 2024-09-17T01:44:39.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.704+0000 7f82234a9740 1 --2- 172.21.15.42:0/3024060623 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x557347b73f60 0x557347f746b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.704+0000 7f82234a9740 1 --2- 172.21.15.42:0/3024060623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347bb5390 0x557347f97fe0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.704+0000 7f82234a9740 1 --2- 172.21.15.42:0/3024060623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557347b946b0 0x557347f9e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.704+0000 7f82234a9740 1 --2- 172.21.15.42:0/3024060623 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347b8c4d0 0x557347f9a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.704+0000 7f82234a9740 1 -- 172.21.15.42:0/3024060623 >> 172.21.15.42:0/3024060623 conn(0x557347ba94e0 msgr2=0x557347fa58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:39.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.704+0000 7f81faa00640 0 client.9025 ms_handle_reset on v2:172.21.15.42:6833/1557345672 2024-09-17T01:44:39.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.704+0000 7f82234a9740 1 -- 172.21.15.42:0/3024060623 shutdown_connections 2024-09-17T01:44:39.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.704+0000 7f82234a9740 1 -- 172.21.15.42:0/3024060623 wait complete. 2024-09-17T01:44:39.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.705+0000 7f82234a9740 20 client.9025 trim_cache size 0 max 16384 2024-09-17T01:44:39.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.731+0000 7f82234a9740 1 Processor -- start 2024-09-17T01:44:39.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.731+0000 7f82234a9740 1 -- start start 2024-09-17T01:44:39.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.733+0000 7f82234a9740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347b8c4d0 0x557347fa28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.733+0000 7f82234a9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347b946b0 0x557347fa2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.733+0000 7f82234a9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557347bb5390 0x557347fa58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.733+0000 7f82234a9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f82140715f0 con 0x557347bb5390 2024-09-17T01:44:39.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.733+0000 7f82234a9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8214070610 con 0x557347b946b0 2024-09-17T01:44:39.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.733+0000 7f82234a9740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f82141eaba0 con 0x557347b8c4d0 2024-09-17T01:44:39.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.733+0000 7f8219a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347b8c4d0 0x557347fa28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.734+0000 7f8219000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347b946b0 0x557347fa2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.734+0000 7f8219000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347b946b0 0x557347fa2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:58078/0 (socket says 172.21.15.42:58078) 2024-09-17T01:44:39.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.734+0000 7f8219a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347b8c4d0 0x557347fa28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:46530/0 (socket says 172.21.15.42:46530) 2024-09-17T01:44:39.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.734+0000 7f8219000640 1 -- 172.21.15.42:0/96954764 learned_addr learned my addr 172.21.15.42:0/96954764 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:39.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.734+0000 7f821a400640 1 --2- 172.21.15.42:0/96954764 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557347bb5390 0x557347fa58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.734+0000 7f8219a00640 1 -- 172.21.15.42:0/96954764 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347b946b0 msgr2=0x557347fa2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:39.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.734+0000 7f8219a00640 1 --2- 172.21.15.42:0/96954764 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347b946b0 0x557347fa2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.734+0000 7f8219a00640 1 -- 172.21.15.42:0/96954764 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557347bb5390 msgr2=0x557347fa58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:39.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.735+0000 7f8219a00640 1 --2- 172.21.15.42:0/96954764 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557347bb5390 0x557347fa58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.735+0000 7f8219a00640 1 -- 172.21.15.42:0/96954764 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557347f98a70 con 0x557347b8c4d0 2024-09-17T01:44:39.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.735+0000 7f821a400640 1 --2- 172.21.15.42:0/96954764 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557347bb5390 0x557347fa58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:44:39.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.735+0000 7f8219a00640 1 --2- 172.21.15.42:0/96954764 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347b8c4d0 0x557347fa28f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8208086000 tx=0x7f820801f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d2d2545a9210ee server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:39.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.735+0000 7f8205600640 1 -- 172.21.15.42:0/96954764 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8208062730 con 0x557347b8c4d0 2024-09-17T01:44:39.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.735+0000 7f8205600640 1 -- 172.21.15.42:0/96954764 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82080628d0 con 0x557347b8c4d0 2024-09-17T01:44:39.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.735+0000 7f8205600640 1 -- 172.21.15.42:0/96954764 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8208010d60 con 0x557347b8c4d0 2024-09-17T01:44:39.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.736+0000 7f82234a9740 1 -- 172.21.15.42:0/96954764 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347b8c4d0 msgr2=0x557347fa28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:39.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.736+0000 7f82234a9740 1 --2- 172.21.15.42:0/96954764 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347b8c4d0 0x557347fa28f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8208086000 tx=0x7f820801f000 comp rx=0 tx=0).stop 2024-09-17T01:44:39.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.737+0000 7f82234a9740 1 -- 172.21.15.42:0/96954764 shutdown_connections 2024-09-17T01:44:39.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.737+0000 7f82234a9740 1 --2- 172.21.15.42:0/96954764 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347b946b0 0x557347fa2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.737+0000 7f82234a9740 1 --2- 172.21.15.42:0/96954764 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557347bb5390 0x557347fa58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.737+0000 7f82234a9740 1 --2- 172.21.15.42:0/96954764 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347b8c4d0 0x557347fa28f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.737+0000 7f82234a9740 1 -- 172.21.15.42:0/96954764 >> 172.21.15.42:0/96954764 conn(0x557347ba94e0 msgr2=0x557347f99dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:39.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.737+0000 7f82234a9740 1 -- 172.21.15.42:0/96954764 shutdown_connections 2024-09-17T01:44:39.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.737+0000 7f82234a9740 1 -- 172.21.15.42:0/96954764 wait complete. 2024-09-17T01:44:39.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.738+0000 7f82234a9740 1 -- start start 2024-09-17T01:44:39.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.739+0000 7f82234a9740 1 Processor -- start 2024-09-17T01:44:39.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.740+0000 7f82234a9740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347b8c4d0 0x557347fb12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.740+0000 7f82234a9740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347b946b0 0x557347fa28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.740+0000 7f82234a9740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557347bb5390 0x557347fa2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.740+0000 7f82234a9740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557347f97670 con 0x557347bb5390 2024-09-17T01:44:39.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.740+0000 7f82234a9740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557347f5ec40 con 0x557347b946b0 2024-09-17T01:44:39.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.740+0000 7f82234a9740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x557347fb0d40 con 0x557347b8c4d0 2024-09-17T01:44:39.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.741+0000 7f82234a9740 10 client.0 _ll_register_callbacks cb 0x7f820c001910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:44:39.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.741+0000 7f8219000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347b946b0 0x557347fa28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.741+0000 7f8219000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347b946b0 0x557347fa28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:58080/0 (socket says 172.21.15.42:58080) 2024-09-17T01:44:39.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.741+0000 7f8219000640 1 -- 172.21.15.42:0/950382783 learned_addr learned my addr 172.21.15.42:0/950382783 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:39.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.741+0000 7f821a400640 1 --2- 172.21.15.42:0/950382783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557347bb5390 0x557347fa2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.741+0000 7f8219a00640 1 --2- 172.21.15.42:0/950382783 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347b8c4d0 0x557347fb12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.742+0000 7f821a400640 1 -- 172.21.15.42:0/950382783 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347b8c4d0 msgr2=0x557347fb12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:39.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.742+0000 7f821a400640 1 --2- 172.21.15.42:0/950382783 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347b8c4d0 0x557347fb12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.742+0000 7f821a400640 1 -- 172.21.15.42:0/950382783 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347b946b0 msgr2=0x557347fa28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:39.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.742+0000 7f821a400640 1 --2- 172.21.15.42:0/950382783 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347b946b0 0x557347fa28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.742+0000 7f821a400640 1 -- 172.21.15.42:0/950382783 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557347c95ad0 con 0x557347bb5390 2024-09-17T01:44:39.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.743+0000 7f8219000640 1 --2- 172.21.15.42:0/950382783 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347b946b0 0x557347fa28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:44:39.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.743+0000 7f821a400640 1 --2- 172.21.15.42:0/950382783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557347bb5390 0x557347fa2e30 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f820c001a10 tx=0x7f820c0016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c9a458f163c62c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:39.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.743+0000 7f81faa00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:44:39.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.743+0000 7f81faa00640 1 -- 172.21.15.42:0/950382783 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820c023050 con 0x557347bb5390 2024-09-17T01:44:39.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.743+0000 7f81faa00640 1 -- 172.21.15.42:0/950382783 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7f820c005680 con 0x557347bb5390 2024-09-17T01:44:39.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.743+0000 7f82234a9740 1 -- 172.21.15.42:0/950382783 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82080628d0 con 0x557347bb5390 2024-09-17T01:44:39.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.744+0000 7f81faa00640 1 -- 172.21.15.42:0/950382783 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=125) ==== 24+0+0 (secure 0 0 0) 0x7f820c015440 con 0x557347bb5390 2024-09-17T01:44:39.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.744+0000 7f82234a9740 10 client.9708 fetch_fsmap learned FSMap version 125 2024-09-17T01:44:39.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.744+0000 7f82234a9740 1 -- 172.21.15.42:0/950382783 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=125,monmap=2+}) -- 0x55734802e630 con 0x557347bb5390 2024-09-17T01:44:39.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.745+0000 7f81faa00640 1 -- 172.21.15.42:0/950382783 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82080628d0 con 0x557347bb5390 2024-09-17T01:44:39.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.745+0000 7f81faa00640 1 -- 172.21.15.42:0/950382783 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 125) ==== 3502+0+0 (secure 0 0 0) 0x7f820c03a080 con 0x557347bb5390 2024-09-17T01:44:39.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.745+0000 7f82234a9740 10 client.9708 fetch_fsmap finished waiting for FSMap version 125 2024-09-17T01:44:39.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.745+0000 7f82234a9740 10 client.9708 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2024-09-17T01:44:39.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.745+0000 7f82234a9740 20 client.9708 populate_metadata read hostname 'smithi042' 2024-09-17T01:44:39.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.745+0000 7f82234a9740 1 --2- 172.21.15.42:0/950382783 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x557347fa51d0 0x55734802a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:39.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.745+0000 7f82234a9740 4 client.9708 mds_command: new command op to 9516 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-17T01:44:39.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.745+0000 7f82234a9740 1 -- 172.21.15.42:0/950382783 --> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x557347ecd3f0 con 0x557347fa51d0 2024-09-17T01:44:39.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.746+0000 7f8219a00640 1 --2- 172.21.15.42:0/950382783 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x557347fa51d0 0x55734802a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:39.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.747+0000 7f8219a00640 1 --2- 172.21.15.42:0/950382783 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x557347fa51d0 0x55734802a390 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8949c28d6de2fdc5 server_cookie=a7c2d126af59e1e6 in_seq=0 out_seq=0 2024-09-17T01:44:39.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.747+0000 7f81faa00640 10 client.9708 ms_handle_connect on v2:172.21.15.42:6833/1557345672 2024-09-17T01:44:39.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.764+0000 7f81faa00640 1 -- 172.21.15.42:0/950382783 <== mds.0 v2:172.21.15.42:6833/1557345672 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557347ecd3f0 con 0x557347fa51d0 2024-09-17T01:44:39.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.765+0000 7f81faa00640 10 client.9708 handle_command_reply: tid=0 2024-09-17T01:44:39.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.765+0000 7f82234a9740 1 client.9708 shutdown 2024-09-17T01:44:39.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.765+0000 7f82234a9740 1 -- 172.21.15.42:0/950382783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557347bb5390 msgr2=0x557347fa2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:39.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.765+0000 7f82234a9740 1 --2- 172.21.15.42:0/950382783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557347bb5390 0x557347fa2e30 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f820c001a10 tx=0x7f820c0016b0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.765+0000 7f82234a9740 1 -- 172.21.15.42:0/950382783 shutdown_connections 2024-09-17T01:44:39.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.765+0000 7f82234a9740 1 --2- 172.21.15.42:0/950382783 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x557347fa51d0 0x55734802a390 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.765+0000 7f82234a9740 1 --2- 172.21.15.42:0/950382783 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557347b946b0 0x557347fa28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.765+0000 7f82234a9740 1 --2- 172.21.15.42:0/950382783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557347bb5390 0x557347fa2e30 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.765+0000 7f82234a9740 1 --2- 172.21.15.42:0/950382783 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557347b8c4d0 0x557347fb12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.765+0000 7f81faa00640 0 client.9708 ms_handle_reset on v2:172.21.15.42:6833/1557345672 2024-09-17T01:44:39.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.765+0000 7f82234a9740 1 -- 172.21.15.42:0/950382783 >> 172.21.15.42:0/950382783 conn(0x557347ba94e0 msgr2=0x557347fccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:39.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.766+0000 7f82234a9740 1 -- 172.21.15.42:0/950382783 shutdown_connections 2024-09-17T01:44:39.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.766+0000 7f82234a9740 1 -- 172.21.15.42:0/950382783 wait complete. 2024-09-17T01:44:39.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.766+0000 7f82234a9740 20 client.9708 trim_cache size 0 max 16384 2024-09-17T01:44:39.765 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:44:39.765 INFO:teuthology.orchestra.run.smithi042.stdout: "message": "", 2024-09-17T01:44:39.765 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0 2024-09-17T01:44:39.765 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:44:39.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.767+0000 7f821ae00640 1 -- 172.21.15.42:0/4000047797 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f81f4078b90 msgr2=0x7f81f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:39.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.767+0000 7f821ae00640 1 --2- 172.21.15.42:0/4000047797 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f81f4078b90 0x7f81f407b0a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8200033000 tx=0x7f8200004730 comp rx=0 tx=0).stop 2024-09-17T01:44:39.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.767+0000 7f821ae00640 1 -- 172.21.15.42:0/4000047797 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82140d0d20 msgr2=0x7f82140c74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:39.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.767+0000 7f821ae00640 1 --2- 172.21.15.42:0/4000047797 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82140d0d20 0x7f82140c74c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f820800e790 tx=0x7f820800ec50 comp rx=0 tx=0).stop 2024-09-17T01:44:39.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.767+0000 7f821ae00640 1 -- 172.21.15.42:0/4000047797 shutdown_connections 2024-09-17T01:44:39.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.767+0000 7f821ae00640 1 --2- 172.21.15.42:0/4000047797 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f81f4078b90 0x7f81f407b0a0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.767+0000 7f821ae00640 1 --2- 172.21.15.42:0/4000047797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f821415ede0 0x7f821415aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.767+0000 7f821ae00640 1 --2- 172.21.15.42:0/4000047797 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82140d3e40 0x7f821415dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.767+0000 7f821ae00640 1 --2- 172.21.15.42:0/4000047797 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82140d0d20 0x7f82140c74c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:39.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.767+0000 7f821ae00640 1 -- 172.21.15.42:0/4000047797 >> 172.21.15.42:0/4000047797 conn(0x7f821406cd20 msgr2=0x7f82140b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:39.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.767+0000 7f821ae00640 1 -- 172.21.15.42:0/4000047797 shutdown_connections 2024-09-17T01:44:39.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:39.767+0000 7f821ae00640 1 -- 172.21.15.42:0/4000047797 wait complete. 2024-09-17T01:44:39.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:44:39.786 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub status 2024-09-17T01:44:40.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.019+0000 7fe1aa400640 1 -- 172.21.15.42:0/3687990376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1a41624b0 msgr2=0x7fe1a40d26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:40.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.019+0000 7fe1aa400640 1 --2- 172.21.15.42:0/3687990376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1a41624b0 0x7fe1a40d26d0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fe194005fd0 tx=0x7fe19402a510 comp rx=0 tx=0).stop 2024-09-17T01:44:40.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.019+0000 7fe1aa400640 1 -- 172.21.15.42:0/3687990376 shutdown_connections 2024-09-17T01:44:40.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.019+0000 7fe1aa400640 1 --2- 172.21.15.42:0/3687990376 >> v2:172.21.15.43:3300/0 conn(0x7fe1a40cf630 0x7fe1a40cfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.019+0000 7fe1aa400640 1 --2- 172.21.15.42:0/3687990376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1a41624b0 0x7fe1a40d26d0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.019+0000 7fe1aa400640 1 -- 172.21.15.42:0/3687990376 >> 172.21.15.42:0/3687990376 conn(0x7fe1a406cf00 msgr2=0x7fe1a406d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:40.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.019+0000 7fe1aa400640 1 -- 172.21.15.42:0/3687990376 shutdown_connections 2024-09-17T01:44:40.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.019+0000 7fe1aa400640 1 -- 172.21.15.42:0/3687990376 wait complete. 2024-09-17T01:44:40.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.021+0000 7fe1aa400640 1 Processor -- start 2024-09-17T01:44:40.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.022+0000 7fe1aa400640 1 -- start start 2024-09-17T01:44:40.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.023+0000 7fe1aa400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1a40cf630 0x7fe1a40b65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.023+0000 7fe1aa400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1a40d1420 0x7fe1a4158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.023+0000 7fe1aa400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1a41624b0 0x7fe1a41e82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.023+0000 7fe1aa400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a415f630 con 0x7fe1a40d1420 2024-09-17T01:44:40.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.023+0000 7fe1aa400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a415f4b0 con 0x7fe1a40cf630 2024-09-17T01:44:40.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.023+0000 7fe1aa400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe1a415f7b0 con 0x7fe1a41624b0 2024-09-17T01:44:40.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.023+0000 7fe19be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1a40d1420 0x7fe1a4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.023+0000 7fe19be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1a40d1420 0x7fe1a4158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33876/0 (socket says 172.21.15.42:33876) 2024-09-17T01:44:40.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.023+0000 7fe19be00640 1 -- 172.21.15.42:0/2764327827 learned_addr learned my addr 172.21.15.42:0/2764327827 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:40.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.023+0000 7fe1a9000640 1 --2- 172.21.15.42:0/2764327827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1a40cf630 0x7fe1a40b65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.023+0000 7fe1a9a00640 1 --2- 172.21.15.42:0/2764327827 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1a41624b0 0x7fe1a41e82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.024+0000 7fe19be00640 1 -- 172.21.15.42:0/2764327827 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1a41624b0 msgr2=0x7fe1a41e82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:40.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.024+0000 7fe19be00640 1 --2- 172.21.15.42:0/2764327827 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1a41624b0 0x7fe1a41e82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.024+0000 7fe19be00640 1 -- 172.21.15.42:0/2764327827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1a40cf630 msgr2=0x7fe1a40b65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:40.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.024+0000 7fe19be00640 1 --2- 172.21.15.42:0/2764327827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1a40cf630 0x7fe1a40b65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.024+0000 7fe19be00640 1 -- 172.21.15.42:0/2764327827 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a41e8e90 con 0x7fe1a40d1420 2024-09-17T01:44:40.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.024+0000 7fe19be00640 1 --2- 172.21.15.42:0/2764327827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1a40d1420 0x7fe1a4158110 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00c370 tx=0x7fe18c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:40.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.024+0000 7fe1a1600640 1 -- 172.21.15.42:0/2764327827 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c017070 con 0x7fe1a40d1420 2024-09-17T01:44:40.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.024+0000 7fe1a1600640 1 -- 172.21.15.42:0/2764327827 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe18c0053c0 con 0x7fe1a40d1420 2024-09-17T01:44:40.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.024+0000 7fe1a1600640 1 -- 172.21.15.42:0/2764327827 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c003850 con 0x7fe1a40d1420 2024-09-17T01:44:40.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.024+0000 7fe1aa400640 1 -- 172.21.15.42:0/2764327827 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a41e9170 con 0x7fe1a40d1420 2024-09-17T01:44:40.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.025+0000 7fe1aa400640 1 -- 172.21.15.42:0/2764327827 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a40b4bf0 con 0x7fe1a40d1420 2024-09-17T01:44:40.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.027+0000 7fe1a1600640 1 -- 172.21.15.42:0/2764327827 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe18c01a070 con 0x7fe1a40d1420 2024-09-17T01:44:40.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.028+0000 7fe1a1600640 1 --2- 172.21.15.42:0/2764327827 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe180078b90 0x7fe18007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.028+0000 7fe1a1600640 1 -- 172.21.15.42:0/2764327827 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7fe18c09a080 con 0x7fe1a40d1420 2024-09-17T01:44:40.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.028+0000 7fe1b2a7f740 1 Processor -- start 2024-09-17T01:44:40.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.028+0000 7fe1a9000640 1 --2- 172.21.15.42:0/2764327827 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe180078b90 0x7fe18007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.028+0000 7fe1b2a7f740 1 -- start start 2024-09-17T01:44:40.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.029+0000 7fe1a9000640 1 --2- 172.21.15.42:0/2764327827 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe180078b90 0x7fe18007b0a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe194033000 tx=0x7fe194004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:40.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.030+0000 7fe1b2a7f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed4483e390 0x55ed44c2c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.030+0000 7fe1b2a7f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed448154d0 0x55ed44c0f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.030+0000 7fe1b2a7f740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ed4481d6b0 0x55ed44c0f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.030+0000 7fe1b2a7f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ed44b451c0 con 0x55ed4483e390 2024-09-17T01:44:40.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.030+0000 7fe1b2a7f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ed44b58870 con 0x55ed448154d0 2024-09-17T01:44:40.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.030+0000 7fe1b2a7f740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55ed44b47ca0 con 0x55ed4481d6b0 2024-09-17T01:44:40.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.030+0000 7fe1a9000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed4483e390 0x55ed44c2c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.030+0000 7fe1a9000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed4483e390 0x55ed44c2c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33886/0 (socket says 172.21.15.42:33886) 2024-09-17T01:44:40.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.030+0000 7fe1a9000640 1 -- 172.21.15.42:0/1653970956 learned_addr learned my addr 172.21.15.42:0/1653970956 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:40.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.030+0000 7fe1a9a00640 1 --2- 172.21.15.42:0/1653970956 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ed4481d6b0 0x55ed44c0f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.030+0000 7fe19be00640 1 --2- 172.21.15.42:0/1653970956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed448154d0 0x55ed44c0f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.031+0000 7fe1a9000640 1 -- 172.21.15.42:0/1653970956 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ed4481d6b0 msgr2=0x55ed44c0f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:40.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.031+0000 7fe1a9000640 1 --2- 172.21.15.42:0/1653970956 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ed4481d6b0 0x55ed44c0f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.031+0000 7fe1a9000640 1 -- 172.21.15.42:0/1653970956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed448154d0 msgr2=0x55ed44c0f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:40.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.031+0000 7fe1a9000640 1 --2- 172.21.15.42:0/1653970956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed448154d0 0x55ed44c0f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.031+0000 7fe1a9000640 1 -- 172.21.15.42:0/1653970956 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed449207d0 con 0x55ed4483e390 2024-09-17T01:44:40.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.031+0000 7fe1a9000640 1 --2- 172.21.15.42:0/1653970956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed4483e390 0x55ed44c2c730 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7fe19402ab00 tx=0x7fe19403d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830633658c1a1dc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:40.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.031+0000 7fe199600640 1 -- 172.21.15.42:0/1653970956 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe194035040 con 0x55ed4483e390 2024-09-17T01:44:40.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.031+0000 7fe199600640 1 -- 172.21.15.42:0/1653970956 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe19404d070 con 0x55ed4483e390 2024-09-17T01:44:40.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.031+0000 7fe199600640 1 -- 172.21.15.42:0/1653970956 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe194003a80 con 0x55ed4483e390 2024-09-17T01:44:40.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.032+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/1653970956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed4483e390 msgr2=0x55ed44c2c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:40.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.032+0000 7fe1b2a7f740 1 --2- 172.21.15.42:0/1653970956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed4483e390 0x55ed44c2c730 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7fe19402ab00 tx=0x7fe19403d000 comp rx=0 tx=0).stop 2024-09-17T01:44:40.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.032+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/1653970956 shutdown_connections 2024-09-17T01:44:40.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.032+0000 7fe1b2a7f740 1 --2- 172.21.15.42:0/1653970956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed448154d0 0x55ed44c0f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.032+0000 7fe1b2a7f740 1 --2- 172.21.15.42:0/1653970956 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ed4481d6b0 0x55ed44c0f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.032+0000 7fe1b2a7f740 1 --2- 172.21.15.42:0/1653970956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed4483e390 0x55ed44c2c730 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.032+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/1653970956 >> 172.21.15.42:0/1653970956 conn(0x55ed448324e0 msgr2=0x55ed44be5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:40.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.032+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/1653970956 shutdown_connections 2024-09-17T01:44:40.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.032+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/1653970956 wait complete. 2024-09-17T01:44:40.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.033+0000 7fe1b2a7f740 1 -- start start 2024-09-17T01:44:40.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.034+0000 7fe1b2a7f740 1 Processor -- start 2024-09-17T01:44:40.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.035+0000 7fe1b2a7f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed448154d0 0x55ed44c23cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.035+0000 7fe1b2a7f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed4481d6b0 0x55ed44bfd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.035+0000 7fe1b2a7f740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ed4483e390 0x55ed44c24c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.035+0000 7fe1b2a7f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ed44aee410 con 0x55ed448154d0 2024-09-17T01:44:40.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.035+0000 7fe1b2a7f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ed44b4bab0 con 0x55ed4481d6b0 2024-09-17T01:44:40.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.035+0000 7fe1b2a7f740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55ed448b8740 con 0x55ed4483e390 2024-09-17T01:44:40.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.035+0000 7fe1b2a7f740 10 client.0 _ll_register_callbacks cb 0x55ed44acb360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:44:40.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.035+0000 7fe1a9000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed448154d0 0x55ed44c23cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.035+0000 7fe1a9000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed448154d0 0x55ed44c23cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33892/0 (socket says 172.21.15.42:33892) 2024-09-17T01:44:40.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.035+0000 7fe1a9000640 1 -- 172.21.15.42:0/3432530311 learned_addr learned my addr 172.21.15.42:0/3432530311 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:40.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.036+0000 7fe1a9a00640 1 --2- 172.21.15.42:0/3432530311 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ed4483e390 0x55ed44c24c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.036+0000 7fe19be00640 1 --2- 172.21.15.42:0/3432530311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed4481d6b0 0x55ed44bfd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.036+0000 7fe1a9000640 1 -- 172.21.15.42:0/3432530311 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ed4483e390 msgr2=0x55ed44c24c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:40.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.036+0000 7fe1a9000640 1 --2- 172.21.15.42:0/3432530311 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ed4483e390 0x55ed44c24c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.036+0000 7fe1a9000640 1 -- 172.21.15.42:0/3432530311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed4481d6b0 msgr2=0x55ed44bfd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:40.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.036+0000 7fe1a9000640 1 --2- 172.21.15.42:0/3432530311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed4481d6b0 0x55ed44bfd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.036+0000 7fe1a9000640 1 -- 172.21.15.42:0/3432530311 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed448a9970 con 0x55ed448154d0 2024-09-17T01:44:40.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.036+0000 7fe1a9000640 1 --2- 172.21.15.42:0/3432530311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed448154d0 0x55ed44c23cb0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7fe1940099f0 tx=0x7fe194003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba66c2b4f759b3b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:40.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.036+0000 7fe192000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:44:40.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.036+0000 7fe192000640 1 -- 172.21.15.42:0/3432530311 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1940047a0 con 0x55ed448154d0 2024-09-17T01:44:40.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.036+0000 7fe192000640 1 -- 172.21.15.42:0/3432530311 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7fe194004940 con 0x55ed448154d0 2024-09-17T01:44:40.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.036+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/3432530311 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe19404d070 con 0x55ed448154d0 2024-09-17T01:44:40.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.037+0000 7fe192000640 1 -- 172.21.15.42:0/3432530311 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=125) ==== 24+0+0 (secure 0 0 0) 0x7fe194065050 con 0x55ed448154d0 2024-09-17T01:44:40.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.037+0000 7fe1b2a7f740 10 client.9720 fetch_fsmap learned FSMap version 125 2024-09-17T01:44:40.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.037+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/3432530311 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=125,monmap=2+}) -- 0x55ed448876a0 con 0x55ed448154d0 2024-09-17T01:44:40.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.037+0000 7fe192000640 1 -- 172.21.15.42:0/3432530311 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe19404d070 con 0x55ed448154d0 2024-09-17T01:44:40.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.037+0000 7fe192000640 1 -- 172.21.15.42:0/3432530311 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 125) ==== 3502+0+0 (secure 0 0 0) 0x7fe194068020 con 0x55ed448154d0 2024-09-17T01:44:40.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.037+0000 7fe1b2a7f740 10 client.9720 fetch_fsmap finished waiting for FSMap version 125 2024-09-17T01:44:40.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.037+0000 7fe1b2a7f740 10 client.9720 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2024-09-17T01:44:40.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.037+0000 7fe1b2a7f740 20 client.9720 populate_metadata read hostname 'smithi042' 2024-09-17T01:44:40.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.037+0000 7fe1b2a7f740 1 --2- 172.21.15.42:0/3432530311 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x55ed447fcf60 0x55ed44c21870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.037+0000 7fe1b2a7f740 4 client.9720 mds_command: new command op to 9516 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:44:40.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.037+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/3432530311 --> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed44b5a7c0 con 0x55ed447fcf60 2024-09-17T01:44:40.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.037+0000 7fe19be00640 1 --2- 172.21.15.42:0/3432530311 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x55ed447fcf60 0x55ed44c21870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.038+0000 7fe19be00640 1 --2- 172.21.15.42:0/3432530311 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x55ed447fcf60 0x55ed44c21870 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=735e42fa9588d47 server_cookie=ccd032f23e43f287 in_seq=0 out_seq=0 2024-09-17T01:44:40.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.038+0000 7fe192000640 10 client.9720 ms_handle_connect on v2:172.21.15.42:6833/1557345672 2024-09-17T01:44:40.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.039+0000 7fe192000640 1 -- 172.21.15.42:0/3432530311 <== mds.0 v2:172.21.15.42:6833/1557345672 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ed44b5a7c0 con 0x55ed447fcf60 2024-09-17T01:44:40.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.039+0000 7fe192000640 10 client.9720 handle_command_reply: tid=0 2024-09-17T01:44:40.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.039+0000 7fe1b2a7f740 1 client.9720 shutdown 2024-09-17T01:44:40.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.039+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/3432530311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed448154d0 msgr2=0x55ed44c23cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:40.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.039+0000 7fe1b2a7f740 1 --2- 172.21.15.42:0/3432530311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed448154d0 0x55ed44c23cb0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7fe1940099f0 tx=0x7fe194003820 comp rx=0 tx=0).stop 2024-09-17T01:44:40.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.039+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/3432530311 shutdown_connections 2024-09-17T01:44:40.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.039+0000 7fe1b2a7f740 1 --2- 172.21.15.42:0/3432530311 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x55ed447fcf60 0x55ed44c21870 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.039+0000 7fe1b2a7f740 1 --2- 172.21.15.42:0/3432530311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed4481d6b0 0x55ed44bfd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.039+0000 7fe1b2a7f740 1 --2- 172.21.15.42:0/3432530311 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ed4483e390 0x55ed44c24c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.039+0000 7fe1b2a7f740 1 --2- 172.21.15.42:0/3432530311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed448154d0 0x55ed44c23cb0 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.039+0000 7fe192000640 0 client.9720 ms_handle_reset on v2:172.21.15.42:6833/1557345672 2024-09-17T01:44:40.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.039+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/3432530311 >> 172.21.15.42:0/3432530311 conn(0x55ed448324e0 msgr2=0x55ed44c2d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:40.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.039+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/3432530311 shutdown_connections 2024-09-17T01:44:40.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.039+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/3432530311 wait complete. 2024-09-17T01:44:40.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.039+0000 7fe1b2a7f740 20 client.9720 trim_cache size 0 max 16384 2024-09-17T01:44:40.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.058+0000 7fe1b2a7f740 1 Processor -- start 2024-09-17T01:44:40.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.059+0000 7fe1b2a7f740 1 -- start start 2024-09-17T01:44:40.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.060+0000 7fe1b2a7f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed448154d0 0x55ed44be6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.060+0000 7fe1b2a7f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed4481d6b0 0x55ed44be6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.060+0000 7fe1b2a7f740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ed4483e390 0x55ed44c2d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.060+0000 7fe1b2a7f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a4202020 con 0x55ed448154d0 2024-09-17T01:44:40.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.060+0000 7fe1b2a7f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a4201040 con 0x55ed4481d6b0 2024-09-17T01:44:40.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.060+0000 7fe1b2a7f740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe1a42003d0 con 0x55ed4483e390 2024-09-17T01:44:40.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.061+0000 7fe1a9000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed448154d0 0x55ed44be6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.061+0000 7fe1a9000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed448154d0 0x55ed44be6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33894/0 (socket says 172.21.15.42:33894) 2024-09-17T01:44:40.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.061+0000 7fe1a9000640 1 -- 172.21.15.42:0/3857467737 learned_addr learned my addr 172.21.15.42:0/3857467737 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:40.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.061+0000 7fe1a9a00640 1 --2- 172.21.15.42:0/3857467737 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ed4483e390 0x55ed44c2d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.061+0000 7fe19be00640 1 --2- 172.21.15.42:0/3857467737 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed4481d6b0 0x55ed44be6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.061+0000 7fe1a9000640 1 -- 172.21.15.42:0/3857467737 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ed4483e390 msgr2=0x55ed44c2d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:40.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.061+0000 7fe1a9000640 1 --2- 172.21.15.42:0/3857467737 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ed4483e390 0x55ed44c2d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.061+0000 7fe1a9000640 1 -- 172.21.15.42:0/3857467737 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed4481d6b0 msgr2=0x55ed44be6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:40.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.061+0000 7fe1a9000640 1 --2- 172.21.15.42:0/3857467737 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed4481d6b0 0x55ed44be6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.061+0000 7fe1a9000640 1 -- 172.21.15.42:0/3857467737 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed44c3b460 con 0x55ed448154d0 2024-09-17T01:44:40.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.061+0000 7fe19be00640 1 --2- 172.21.15.42:0/3857467737 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed4481d6b0 0x55ed44be6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:44:40.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.061+0000 7fe1a9000640 1 --2- 172.21.15.42:0/3857467737 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed448154d0 0x55ed44be6300 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fe194006010 tx=0x7fe1940045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74020858931245f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:40.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.061+0000 7fe198c00640 1 -- 172.21.15.42:0/3857467737 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19406e070 con 0x55ed448154d0 2024-09-17T01:44:40.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.062+0000 7fe198c00640 1 -- 172.21.15.42:0/3857467737 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe19404d070 con 0x55ed448154d0 2024-09-17T01:44:40.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.062+0000 7fe198c00640 1 -- 172.21.15.42:0/3857467737 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe194040040 con 0x55ed448154d0 2024-09-17T01:44:40.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.062+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/3857467737 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed448154d0 msgr2=0x55ed44be6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:40.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.062+0000 7fe1b2a7f740 1 --2- 172.21.15.42:0/3857467737 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed448154d0 0x55ed44be6300 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fe194006010 tx=0x7fe1940045a0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.062+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/3857467737 shutdown_connections 2024-09-17T01:44:40.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.062+0000 7fe1b2a7f740 1 --2- 172.21.15.42:0/3857467737 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed4481d6b0 0x55ed44be6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.062+0000 7fe1b2a7f740 1 --2- 172.21.15.42:0/3857467737 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ed4483e390 0x55ed44c2d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.062+0000 7fe1b2a7f740 1 --2- 172.21.15.42:0/3857467737 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed448154d0 0x55ed44be6300 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.062+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/3857467737 >> 172.21.15.42:0/3857467737 conn(0x55ed448324e0 msgr2=0x55ed44bfd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:40.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.063+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/3857467737 shutdown_connections 2024-09-17T01:44:40.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.063+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/3857467737 wait complete. 2024-09-17T01:44:40.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.063+0000 7fe1b2a7f740 1 -- start start 2024-09-17T01:44:40.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.064+0000 7fe1b2a7f740 1 Processor -- start 2024-09-17T01:44:40.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.065+0000 7fe1b2a7f740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed448154d0 0x55ed44ca5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.065+0000 7fe1b2a7f740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ed4481d6b0 0x55ed44bfd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.065+0000 7fe1b2a7f740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed4483e390 0x55ed44bfd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.065+0000 7fe1b2a7f740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a4200a20 con 0x55ed448154d0 2024-09-17T01:44:40.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.065+0000 7fe1b2a7f740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ed44be6300 con 0x55ed4483e390 2024-09-17T01:44:40.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.065+0000 7fe1b2a7f740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55ed44c2a140 con 0x55ed4481d6b0 2024-09-17T01:44:40.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.065+0000 7fe1b2a7f740 10 client.0 _ll_register_callbacks cb 0x7fe19c009840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:44:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.065+0000 7fe1a9000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed448154d0 0x55ed44ca5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.065+0000 7fe1a9000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed448154d0 0x55ed44ca5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33906/0 (socket says 172.21.15.42:33906) 2024-09-17T01:44:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.065+0000 7fe1a9000640 1 -- 172.21.15.42:0/2685233768 learned_addr learned my addr 172.21.15.42:0/2685233768 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.065+0000 7fe1a9a00640 1 --2- 172.21.15.42:0/2685233768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed4483e390 0x55ed44bfd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.066+0000 7fe19be00640 1 --2- 172.21.15.42:0/2685233768 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ed4481d6b0 0x55ed44bfd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.066+0000 7fe1a9000640 1 -- 172.21.15.42:0/2685233768 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ed4481d6b0 msgr2=0x55ed44bfd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.066+0000 7fe1a9000640 1 --2- 172.21.15.42:0/2685233768 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ed4481d6b0 0x55ed44bfd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.066+0000 7fe1a9000640 1 -- 172.21.15.42:0/2685233768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed4483e390 msgr2=0x55ed44bfd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:44:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.066+0000 7fe1a9000640 1 --2- 172.21.15.42:0/2685233768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed4483e390 0x55ed44bfd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.066+0000 7fe1a9000640 1 -- 172.21.15.42:0/2685233768 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed44ca8690 con 0x55ed448154d0 2024-09-17T01:44:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.066+0000 7fe1a9000640 1 --2- 172.21.15.42:0/2685233768 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed448154d0 0x55ed44ca5c60 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7fe194005490 tx=0x7fe194005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2feb38bf3a9748 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:40.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.066+0000 7fe192000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:44:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.066+0000 7fe192000640 1 -- 172.21.15.42:0/2685233768 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19406e070 con 0x55ed448154d0 2024-09-17T01:44:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.066+0000 7fe192000640 1 -- 172.21.15.42:0/2685233768 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7fe19405d680 con 0x55ed448154d0 2024-09-17T01:44:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.067+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/2685233768 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe19404d070 con 0x55ed448154d0 2024-09-17T01:44:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.067+0000 7fe192000640 1 -- 172.21.15.42:0/2685233768 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=125) ==== 24+0+0 (secure 0 0 0) 0x7fe194040040 con 0x55ed448154d0 2024-09-17T01:44:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.067+0000 7fe1b2a7f740 10 client.9726 fetch_fsmap learned FSMap version 125 2024-09-17T01:44:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.067+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/2685233768 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=125,monmap=2+}) -- 0x55ed44c3b930 con 0x55ed448154d0 2024-09-17T01:44:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.067+0000 7fe192000640 1 -- 172.21.15.42:0/2685233768 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe19404d070 con 0x55ed448154d0 2024-09-17T01:44:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.067+0000 7fe192000640 1 -- 172.21.15.42:0/2685233768 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 125) ==== 3502+0+0 (secure 0 0 0) 0x7fe19407e020 con 0x55ed448154d0 2024-09-17T01:44:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.067+0000 7fe1b2a7f740 10 client.9726 fetch_fsmap finished waiting for FSMap version 125 2024-09-17T01:44:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.067+0000 7fe1b2a7f740 10 client.9726 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2024-09-17T01:44:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.067+0000 7fe1b2a7f740 20 client.9726 populate_metadata read hostname 'smithi042' 2024-09-17T01:44:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.067+0000 7fe1b2a7f740 1 --2- 172.21.15.42:0/2685233768 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x55ed44c24fd0 0x55ed44cabc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.067+0000 7fe1b2a7f740 4 client.9726 mds_command: new command op to 9516 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:44:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.067+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/2685233768 --> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ed44b56270 con 0x55ed44c24fd0 2024-09-17T01:44:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.068+0000 7fe19be00640 1 --2- 172.21.15.42:0/2685233768 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x55ed44c24fd0 0x55ed44cabc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.068+0000 7fe19be00640 1 --2- 172.21.15.42:0/2685233768 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x55ed44c24fd0 0x55ed44cabc10 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a11f523f1a26b5ac server_cookie=a80c33d0520d23b0 in_seq=0 out_seq=0 2024-09-17T01:44:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.068+0000 7fe192000640 10 client.9726 ms_handle_connect on v2:172.21.15.42:6833/1557345672 2024-09-17T01:44:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.068+0000 7fe192000640 1 -- 172.21.15.42:0/2685233768 <== mds.0 v2:172.21.15.42:6833/1557345672 1 ==== command_reply(tid 0: 0 ) ==== 8+0+612 (crc 0 0 0) 0x55ed44b56270 con 0x55ed44c24fd0 2024-09-17T01:44:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.068+0000 7fe192000640 10 client.9726 handle_command_reply: tid=0 2024-09-17T01:44:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.068+0000 7fe1b2a7f740 1 client.9726 shutdown 2024-09-17T01:44:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.068+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/2685233768 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed448154d0 msgr2=0x55ed44ca5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.068+0000 7fe1b2a7f740 1 --2- 172.21.15.42:0/2685233768 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed448154d0 0x55ed44ca5c60 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7fe194005490 tx=0x7fe194005c90 comp rx=0 tx=0).stop 2024-09-17T01:44:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.069+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/2685233768 shutdown_connections 2024-09-17T01:44:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.069+0000 7fe1b2a7f740 1 --2- 172.21.15.42:0/2685233768 >> [v2:172.21.15.42:6833/1557345672,v1:172.21.15.42:6835/1557345672] conn(0x55ed44c24fd0 0x55ed44cabc10 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.069+0000 7fe1b2a7f740 1 --2- 172.21.15.42:0/2685233768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed4483e390 0x55ed44bfd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.069+0000 7fe1b2a7f740 1 --2- 172.21.15.42:0/2685233768 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ed4481d6b0 0x55ed44bfd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.069+0000 7fe1b2a7f740 1 --2- 172.21.15.42:0/2685233768 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ed448154d0 0x55ed44ca5c60 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.069+0000 7fe192000640 0 client.9726 ms_handle_reset on v2:172.21.15.42:6833/1557345672 2024-09-17T01:44:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.069+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/2685233768 >> 172.21.15.42:0/2685233768 conn(0x55ed448324e0 msgr2=0x55ed44c219c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.069+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/2685233768 shutdown_connections 2024-09-17T01:44:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.069+0000 7fe1b2a7f740 1 -- 172.21.15.42:0/2685233768 wait complete. 2024-09-17T01:44:40.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.069+0000 7fe1b2a7f740 20 client.9726 trim_cache size 0 max 16384 2024-09-17T01:44:40.073 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:44:40.073 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "PAUSED (747 inodes in the stack)", 2024-09-17T01:44:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-09-17T01:44:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: "06bdf393-e52f-4211-93fa-43da1f9290da": { 2024-09-17T01:44:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_control_test_path", 2024-09-17T01:44:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "06bdf393-e52f-4211-93fa-43da1f9290da", 2024-09-17T01:44:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive" 2024-09-17T01:44:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:44:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:44:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_stats": { 2024-09-17T01:44:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: "06bdf393-e52f-4211-93fa-43da1f9290da": { 2024-09-17T01:44:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:44:39.316463+0000", 2024-09-17T01:44:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/scrub_control_test_path", 2024-09-17T01:44:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:44:40.074 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:44:40.075 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:44:40.075 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:44:40.075 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:44:40.075 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:44:40.075 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:44:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.069+0000 7fe1aa400640 1 -- 172.21.15.42:0/2764327827 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe180078b90 msgr2=0x7fe18007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.069+0000 7fe1aa400640 1 --2- 172.21.15.42:0/2764327827 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe180078b90 0x7fe18007b0a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe194033000 tx=0x7fe194004730 comp rx=0 tx=0).stop 2024-09-17T01:44:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.069+0000 7fe1aa400640 1 -- 172.21.15.42:0/2764327827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1a40d1420 msgr2=0x7fe1a4158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.069+0000 7fe1aa400640 1 --2- 172.21.15.42:0/2764327827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1a40d1420 0x7fe1a4158110 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00c370 tx=0x7fe18c00c830 comp rx=0 tx=0).stop 2024-09-17T01:44:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.070+0000 7fe1aa400640 1 -- 172.21.15.42:0/2764327827 shutdown_connections 2024-09-17T01:44:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.070+0000 7fe1aa400640 1 --2- 172.21.15.42:0/2764327827 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe180078b90 0x7fe18007b0a0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.070+0000 7fe1aa400640 1 --2- 172.21.15.42:0/2764327827 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1a41624b0 0x7fe1a41e82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.070+0000 7fe1aa400640 1 --2- 172.21.15.42:0/2764327827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1a40d1420 0x7fe1a4158110 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.070+0000 7fe1aa400640 1 --2- 172.21.15.42:0/2764327827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1a40cf630 0x7fe1a40b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.070+0000 7fe1aa400640 1 -- 172.21.15.42:0/2764327827 >> 172.21.15.42:0/2764327827 conn(0x7fe1a406cf00 msgr2=0x7fe1a415cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:40.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.070+0000 7fe1aa400640 1 -- 172.21.15.42:0/2764327827 shutdown_connections 2024-09-17T01:44:40.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.070+0000 7fe1aa400640 1 -- 172.21.15.42:0/2764327827 wait complete. 2024-09-17T01:44:40.090 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:44:40.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.319+0000 7feecd000640 1 -- 172.21.15.42:0/437371013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec80b3550 msgr2=0x7feec815cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:40.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.319+0000 7feecd000640 1 --2- 172.21.15.42:0/437371013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec80b3550 0x7feec815cec0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7feec815aab0 tx=0x7feeb802a560 comp rx=0 tx=0).stop 2024-09-17T01:44:40.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.319+0000 7feecd000640 1 -- 172.21.15.42:0/437371013 shutdown_connections 2024-09-17T01:44:40.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.319+0000 7feecd000640 1 --2- 172.21.15.42:0/437371013 >> v2:172.21.15.43:3300/0 conn(0x7feec80cec40 0x7feec80cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.319+0000 7feecd000640 1 --2- 172.21.15.42:0/437371013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec80b3550 0x7feec815cec0 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.320+0000 7feecd000640 1 -- 172.21.15.42:0/437371013 >> 172.21.15.42:0/437371013 conn(0x7feec80b2930 msgr2=0x7feec806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:40.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.320+0000 7feecd000640 1 -- 172.21.15.42:0/437371013 shutdown_connections 2024-09-17T01:44:40.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.320+0000 7feecd000640 1 -- 172.21.15.42:0/437371013 wait complete. 2024-09-17T01:44:40.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.322+0000 7feecd000640 1 Processor -- start 2024-09-17T01:44:40.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.322+0000 7feecd000640 1 -- start start 2024-09-17T01:44:40.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.323+0000 7feecd000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec80b3550 0x7feec80aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.324+0000 7feecd000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feec80cec40 0x7feec80c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.324+0000 7feecd000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feec8142f40 0x7feec813e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.324+0000 7feecd000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7feec806d7c0 con 0x7feec80b3550 2024-09-17T01:44:40.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.324+0000 7feecd000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7feec806d640 con 0x7feec8142f40 2024-09-17T01:44:40.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.324+0000 7feecd000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7feec806d940 con 0x7feec80cec40 2024-09-17T01:44:40.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.324+0000 7feec5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec80b3550 0x7feec80aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.324+0000 7feec5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec80b3550 0x7feec80aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33930/0 (socket says 172.21.15.42:33930) 2024-09-17T01:44:40.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.324+0000 7feec5e00640 1 -- 172.21.15.42:0/1375634754 learned_addr learned my addr 172.21.15.42:0/1375634754 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:40.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.324+0000 7feebfe00640 1 --2- 172.21.15.42:0/1375634754 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feec80cec40 0x7feec80c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.324+0000 7feec6800640 1 --2- 172.21.15.42:0/1375634754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feec8142f40 0x7feec813e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.324+0000 7feec5e00640 1 -- 172.21.15.42:0/1375634754 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feec80cec40 msgr2=0x7feec80c54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:40.323 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.324+0000 7feec5e00640 1 --2- 172.21.15.42:0/1375634754 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feec80cec40 0x7feec80c54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.324+0000 7feec5e00640 1 -- 172.21.15.42:0/1375634754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feec8142f40 msgr2=0x7feec813e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:40.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.324+0000 7feec5e00640 1 --2- 172.21.15.42:0/1375634754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feec8142f40 0x7feec813e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.324+0000 7feec5e00640 1 -- 172.21.15.42:0/1375634754 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec806e9b0 con 0x7feec80b3550 2024-09-17T01:44:40.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.325+0000 7feec5e00640 1 --2- 172.21.15.42:0/1375634754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec80b3550 0x7feec80aea80 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7feeb8034040 tx=0x7feeb8003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:40.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.325+0000 7feebe000640 1 -- 172.21.15.42:0/1375634754 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb803e030 con 0x7feec80b3550 2024-09-17T01:44:40.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.325+0000 7feebe000640 1 -- 172.21.15.42:0/1375634754 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feeb8003d10 con 0x7feec80b3550 2024-09-17T01:44:40.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.325+0000 7feebe000640 1 -- 172.21.15.42:0/1375634754 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb8035040 con 0x7feec80b3550 2024-09-17T01:44:40.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.325+0000 7feecd000640 1 -- 172.21.15.42:0/1375634754 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec81f91d0 con 0x7feec80b3550 2024-09-17T01:44:40.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.325+0000 7feecd000640 1 -- 172.21.15.42:0/1375634754 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec81f9750 con 0x7feec80b3550 2024-09-17T01:44:40.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.326+0000 7feecd000640 1 -- 172.21.15.42:0/1375634754 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feec815cec0 con 0x7feec80b3550 2024-09-17T01:44:40.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.327+0000 7feebe000640 1 -- 172.21.15.42:0/1375634754 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feeb8041030 con 0x7feec80b3550 2024-09-17T01:44:40.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.328+0000 7feebe000640 1 --2- 172.21.15.42:0/1375634754 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feea4078bc0 0x7feea407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.328+0000 7feebe000640 1 -- 172.21.15.42:0/1375634754 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7feeb80bb540 con 0x7feec80b3550 2024-09-17T01:44:40.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.329+0000 7feebfe00640 1 --2- 172.21.15.42:0/1375634754 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feea4078bc0 0x7feea407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.330+0000 7feebfe00640 1 --2- 172.21.15.42:0/1375634754 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feea4078bc0 0x7feea407b0d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7feec81fa230 tx=0x7feeb0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:40.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.333+0000 7feebe000640 1 -- 172.21.15.42:0/1375634754 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feeb8083290 con 0x7feec80b3550 2024-09-17T01:44:40.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.565+0000 7feecd000640 1 -- 172.21.15.42:0/1375634754 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feec806a170 con 0x7feec80b3550 2024-09-17T01:44:40.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.566+0000 7feebe000640 1 -- 172.21.15.42:0/1375634754 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5230 (secure 0 0 0) 0x7feeb8087cc0 con 0x7feec80b3550 2024-09-17T01:44:40.564 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:44:40.565 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":125,"btime":"2024-09-17T01:44:10:057034+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8872,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3393274334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3393274334},{"type":"v1","addr":"172.21.15.43:6836","nonce":3393274334}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":8875,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2869136532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2869136532},{"type":"v1","addr":"172.21.15.43:6837","nonce":2869136532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":9513,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/297557585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":297557585},{"type":"v1","addr":"172.21.15.42:6834","nonce":297557585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":119}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:44:06.556661+0000","modified":"2024-09-17T01:44:09.563813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9516},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9516":{"gid":9516,"name":"c","rank":0,"incarnation":121,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1557345672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1557345672},{"type":"v1","addr":"172.21.15.42:6835","nonce":1557345672}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9516,"qdb_cluster":[9516]},"id":11}]} 2024-09-17T01:44:40.565 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 125 2024-09-17T01:44:40.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.568+0000 7feecd000640 1 -- 172.21.15.42:0/1375634754 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feea4078bc0 msgr2=0x7feea407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:40.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.568+0000 7feecd000640 1 --2- 172.21.15.42:0/1375634754 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feea4078bc0 0x7feea407b0d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7feec81fa230 tx=0x7feeb0009040 comp rx=0 tx=0).stop 2024-09-17T01:44:40.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.568+0000 7feecd000640 1 -- 172.21.15.42:0/1375634754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec80b3550 msgr2=0x7feec80aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:40.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.568+0000 7feecd000640 1 --2- 172.21.15.42:0/1375634754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec80b3550 0x7feec80aea80 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7feeb8034040 tx=0x7feeb8003820 comp rx=0 tx=0).stop 2024-09-17T01:44:40.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.569+0000 7feecd000640 1 -- 172.21.15.42:0/1375634754 shutdown_connections 2024-09-17T01:44:40.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.569+0000 7feecd000640 1 --2- 172.21.15.42:0/1375634754 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feea4078bc0 0x7feea407b0d0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.569+0000 7feecd000640 1 --2- 172.21.15.42:0/1375634754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feec8142f40 0x7feec813e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.569+0000 7feecd000640 1 --2- 172.21.15.42:0/1375634754 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feec80cec40 0x7feec80c54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.569+0000 7feecd000640 1 --2- 172.21.15.42:0/1375634754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feec80b3550 0x7feec80aea80 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.569+0000 7feecd000640 1 -- 172.21.15.42:0/1375634754 >> 172.21.15.42:0/1375634754 conn(0x7feec80b2930 msgr2=0x7feec806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:40.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.569+0000 7feecd000640 1 -- 172.21.15.42:0/1375634754 shutdown_connections 2024-09-17T01:44:40.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.569+0000 7feecd000640 1 -- 172.21.15.42:0/1375634754 wait complete. 2024-09-17T01:44:40.590 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T01:44:40.591 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:44:40.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.818+0000 7f22de400640 1 -- 172.21.15.42:0/3192200790 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22d806d430 msgr2=0x7f22d806d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:40.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.818+0000 7f22de400640 1 --2- 172.21.15.42:0/3192200790 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22d806d430 0x7f22d806d840 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f22d8070530 tx=0x7f22d002aa50 comp rx=0 tx=0).stop 2024-09-17T01:44:40.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.818+0000 7f22de400640 1 -- 172.21.15.42:0/3192200790 shutdown_connections 2024-09-17T01:44:40.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.818+0000 7f22de400640 1 --2- 172.21.15.42:0/3192200790 >> v2:172.21.15.43:3300/0 conn(0x7f22d815cfc0 0x7f22d80ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.818+0000 7f22de400640 1 --2- 172.21.15.42:0/3192200790 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22d806d430 0x7f22d806d840 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.818+0000 7f22de400640 1 --2- 172.21.15.42:0/3192200790 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f22d80b3880 0x7f22d80af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.819+0000 7f22de400640 1 -- 172.21.15.42:0/3192200790 >> 172.21.15.42:0/3192200790 conn(0x7f22d80b2930 msgr2=0x7f22d806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:40.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.819+0000 7f22de400640 1 -- 172.21.15.42:0/3192200790 shutdown_connections 2024-09-17T01:44:40.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.819+0000 7f22de400640 1 -- 172.21.15.42:0/3192200790 wait complete. 2024-09-17T01:44:40.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.821+0000 7f22de400640 1 Processor -- start 2024-09-17T01:44:40.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.821+0000 7f22de400640 1 -- start start 2024-09-17T01:44:40.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.822+0000 7f22de400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f22d806d430 0x7f22d81470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.822+0000 7f22de400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22d80b3880 0x7f22d81557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.822+0000 7f22de400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22d815cfc0 0x7f22d81f65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.822+0000 7f22de400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f22d815d5e0 con 0x7f22d815cfc0 2024-09-17T01:44:40.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.822+0000 7f22de400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f22d81605b0 con 0x7f22d80b3880 2024-09-17T01:44:40.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.822+0000 7f22de400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f22d8147730 con 0x7f22d806d430 2024-09-17T01:44:40.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.823+0000 7f22d7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22d815cfc0 0x7f22d81f65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.823+0000 7f22d7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22d815cfc0 0x7f22d81f65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33946/0 (socket says 172.21.15.42:33946) 2024-09-17T01:44:40.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.823+0000 7f22d7e00640 1 -- 172.21.15.42:0/225721516 learned_addr learned my addr 172.21.15.42:0/225721516 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:40.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.823+0000 7f22d7400640 1 --2- 172.21.15.42:0/225721516 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f22d806d430 0x7f22d81470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.823+0000 7f22cea00640 1 --2- 172.21.15.42:0/225721516 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22d80b3880 0x7f22d81557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.823+0000 7f22d7e00640 1 -- 172.21.15.42:0/225721516 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f22d806d430 msgr2=0x7f22d81470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:40.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.823+0000 7f22d7e00640 1 --2- 172.21.15.42:0/225721516 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f22d806d430 0x7f22d81470a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.823+0000 7f22d7e00640 1 -- 172.21.15.42:0/225721516 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22d80b3880 msgr2=0x7f22d81557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:40.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.823+0000 7f22d7e00640 1 --2- 172.21.15.42:0/225721516 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22d80b3880 0x7f22d81557c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:40.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.823+0000 7f22d7e00640 1 -- 172.21.15.42:0/225721516 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d81fa210 con 0x7f22d815cfc0 2024-09-17T01:44:40.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.824+0000 7f22d7e00640 1 --2- 172.21.15.42:0/225721516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22d815cfc0 0x7f22d81f65d0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f22d002b010 tx=0x7f22d0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:40.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.824+0000 7f22cfe00640 1 -- 172.21.15.42:0/225721516 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d0033050 con 0x7f22d815cfc0 2024-09-17T01:44:40.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.824+0000 7f22cfe00640 1 -- 172.21.15.42:0/225721516 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22d0004250 con 0x7f22d815cfc0 2024-09-17T01:44:40.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.824+0000 7f22cfe00640 1 -- 172.21.15.42:0/225721516 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d0004680 con 0x7f22d815cfc0 2024-09-17T01:44:40.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.824+0000 7f22de400640 1 -- 172.21.15.42:0/225721516 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22d8147980 con 0x7f22d815cfc0 2024-09-17T01:44:40.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.824+0000 7f22de400640 1 -- 172.21.15.42:0/225721516 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22d8147f40 con 0x7f22d815cfc0 2024-09-17T01:44:40.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.825+0000 7f22de400640 1 -- 172.21.15.42:0/225721516 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22d80af980 con 0x7f22d815cfc0 2024-09-17T01:44:40.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.826+0000 7f22cfe00640 1 -- 172.21.15.42:0/225721516 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f22d0036070 con 0x7f22d815cfc0 2024-09-17T01:44:40.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.827+0000 7f22cfe00640 1 --2- 172.21.15.42:0/225721516 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f22b4078b90 0x7f22b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:40.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.828+0000 7f22cfe00640 1 -- 172.21.15.42:0/225721516 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7f22d00bbeb0 con 0x7f22d815cfc0 2024-09-17T01:44:40.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.828+0000 7f22d7400640 1 --2- 172.21.15.42:0/225721516 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f22b4078b90 0x7f22b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:40.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.829+0000 7f22d7400640 1 --2- 172.21.15.42:0/225721516 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f22b4078b90 0x7f22b407b0a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f22c8004630 tx=0x7f22c800b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:40.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:40.832+0000 7f22cfe00640 1 -- 172.21.15.42:0/225721516 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f22d806dd80 con 0x7f22d815cfc0 2024-09-17T01:44:41.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:41.101+0000 7f22de400640 1 -- 172.21.15.42:0/225721516 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f22d806a170 con 0x7f22d815cfc0 2024-09-17T01:44:41.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:41.102+0000 7f22cfe00640 1 -- 172.21.15.42:0/225721516 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1231 (secure 0 0 0) 0x7f22d0004820 con 0x7f22d815cfc0 2024-09-17T01:44:41.100 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:44:41.100 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":781,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":160,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":885,"data_bytes":904958201,"bytes_used":2225676288,"bytes_avail":770868436992,"bytes_total":773094113280,"write_bytes_sec":43154771,"read_op_per_sec":0,"write_op_per_sec":43},"fsmap":{"epoch":125,"btime":"2024-09-17T01:44:10:057034+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":9516}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":29,"modified":"2024-09-17T01:43:55.185894+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:44:41.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:41.104+0000 7f22de400640 1 -- 172.21.15.42:0/225721516 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f22b4078b90 msgr2=0x7f22b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:41.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:41.104+0000 7f22de400640 1 --2- 172.21.15.42:0/225721516 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f22b4078b90 0x7f22b407b0a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f22c8004630 tx=0x7f22c800b2e0 comp rx=0 tx=0).stop 2024-09-17T01:44:41.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:41.104+0000 7f22de400640 1 -- 172.21.15.42:0/225721516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22d815cfc0 msgr2=0x7f22d81f65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:41.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:41.104+0000 7f22de400640 1 --2- 172.21.15.42:0/225721516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22d815cfc0 0x7f22d81f65d0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f22d002b010 tx=0x7f22d0003f10 comp rx=0 tx=0).stop 2024-09-17T01:44:41.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:41.104+0000 7f22de400640 1 -- 172.21.15.42:0/225721516 shutdown_connections 2024-09-17T01:44:41.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:41.104+0000 7f22de400640 1 --2- 172.21.15.42:0/225721516 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f22b4078b90 0x7f22b407b0a0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:41.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:41.104+0000 7f22de400640 1 --2- 172.21.15.42:0/225721516 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22d80b3880 0x7f22d81557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:41.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:41.104+0000 7f22de400640 1 --2- 172.21.15.42:0/225721516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22d815cfc0 0x7f22d81f65d0 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:41.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:41.104+0000 7f22de400640 1 --2- 172.21.15.42:0/225721516 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f22d806d430 0x7f22d81470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:41.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:41.104+0000 7f22de400640 1 -- 172.21.15.42:0/225721516 >> 172.21.15.42:0/225721516 conn(0x7f22d80b2930 msgr2=0x7f22d815e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:41.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:41.104+0000 7f22de400640 1 -- 172.21.15.42:0/225721516 shutdown_connections 2024-09-17T01:44:41.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:41.104+0000 7f22de400640 1 -- 172.21.15.42:0/225721516 wait complete. 2024-09-17T01:44:41.123 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T01:44:42.125 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:44:42.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.366+0000 7f2fb1c00640 1 -- 172.21.15.42:0/837989289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f90003c10 msgr2=0x7f2f90004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:42.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.366+0000 7f2fb1c00640 1 --2- 172.21.15.42:0/837989289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f90003c10 0x7f2f90004060 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c006ec0 tx=0x7f2f90005830 comp rx=0 tx=0).stop 2024-09-17T01:44:42.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.366+0000 7f2fab400640 1 -- 172.21.15.42:0/837989289 reap_dead start 2024-09-17T01:44:42.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.366+0000 7f2fb1c00640 1 -- 172.21.15.42:0/837989289 shutdown_connections 2024-09-17T01:44:42.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.366+0000 7f2fb1c00640 1 -- 172.21.15.42:0/837989289 >> 172.21.15.42:0/837989289 conn(0x7f2fac0b2930 msgr2=0x7f2fac06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:42.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.366+0000 7f2fb1c00640 1 -- 172.21.15.42:0/837989289 shutdown_connections 2024-09-17T01:44:42.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.366+0000 7f2fb1c00640 1 -- 172.21.15.42:0/837989289 wait complete. 2024-09-17T01:44:42.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.369+0000 7f2fb1c00640 1 Processor -- start 2024-09-17T01:44:42.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.369+0000 7f2fb1c00640 1 -- start start 2024-09-17T01:44:42.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.370+0000 7f2fb1c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f90003c10 0x7f2fac13e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:42.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.370+0000 7f2fb1c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2fac13e950 0x7f2fac06f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:42.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.370+0000 7f2fb1c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2fac06fb90 0x7f2fac13f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:42.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.370+0000 7f2fb1c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2fac072ce0 con 0x7f2fac13e950 2024-09-17T01:44:42.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.370+0000 7f2fb1c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2fac072b60 con 0x7f2fac06fb90 2024-09-17T01:44:42.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.370+0000 7f2fb1c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2fac06d430 con 0x7f2f90003c10 2024-09-17T01:44:42.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.370+0000 7f2faa000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2fac13e950 0x7f2fac06f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:42.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.370+0000 7f2faa000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2fac13e950 0x7f2fac06f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33958/0 (socket says 172.21.15.42:33958) 2024-09-17T01:44:42.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.370+0000 7f2faa000640 1 -- 172.21.15.42:0/4054368865 learned_addr learned my addr 172.21.15.42:0/4054368865 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:42.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.371+0000 7f2faaa00640 1 --2- 172.21.15.42:0/4054368865 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f90003c10 0x7f2fac13e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:42.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.371+0000 7f2fab400640 1 --2- 172.21.15.42:0/4054368865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2fac06fb90 0x7f2fac13f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:42.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.371+0000 7f2faa000640 1 -- 172.21.15.42:0/4054368865 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f90003c10 msgr2=0x7f2fac13e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:42.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.371+0000 7f2faa000640 1 --2- 172.21.15.42:0/4054368865 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f90003c10 0x7f2fac13e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:42.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.371+0000 7f2faa000640 1 -- 172.21.15.42:0/4054368865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2fac06fb90 msgr2=0x7f2fac13f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:42.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.371+0000 7f2faa000640 1 --2- 172.21.15.42:0/4054368865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2fac06fb90 0x7f2fac13f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:42.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.371+0000 7f2faa000640 1 -- 172.21.15.42:0/4054368865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fac13f230 con 0x7f2fac13e950 2024-09-17T01:44:42.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.371+0000 7f2faa000640 1 --2- 172.21.15.42:0/4054368865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2fac13e950 0x7f2fac06f650 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f2f98011b10 tx=0x7f2f98009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:42.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.371+0000 7f2fa2a00640 1 -- 172.21.15.42:0/4054368865 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9801e070 con 0x7f2fac13e950 2024-09-17T01:44:42.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.371+0000 7f2fa2a00640 1 -- 172.21.15.42:0/4054368865 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f98004050 con 0x7f2fac13e950 2024-09-17T01:44:42.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.372+0000 7f2fb1c00640 1 -- 172.21.15.42:0/4054368865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fac06ffa0 con 0x7f2fac13e950 2024-09-17T01:44:42.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.372+0000 7f2fa2a00640 1 -- 172.21.15.42:0/4054368865 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9800fea0 con 0x7f2fac13e950 2024-09-17T01:44:42.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.372+0000 7f2fb1c00640 1 -- 172.21.15.42:0/4054368865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fac1413b0 con 0x7f2fac13e950 2024-09-17T01:44:42.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.373+0000 7f2fb1c00640 1 -- 172.21.15.42:0/4054368865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fac1411d0 con 0x7f2fac13e950 2024-09-17T01:44:42.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.374+0000 7f2fa2a00640 1 -- 172.21.15.42:0/4054368865 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2f98021070 con 0x7f2fac13e950 2024-09-17T01:44:42.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.375+0000 7f2fa2a00640 1 --2- 172.21.15.42:0/4054368865 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f8c078b90 0x7f2f8c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:42.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.375+0000 7f2fa2a00640 1 -- 172.21.15.42:0/4054368865 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7f2f9809b7a0 con 0x7f2fac13e950 2024-09-17T01:44:42.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.376+0000 7f2faaa00640 1 --2- 172.21.15.42:0/4054368865 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f8c078b90 0x7f2f8c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:42.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.376+0000 7f2faaa00640 1 --2- 172.21.15.42:0/4054368865 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f8c078b90 0x7f2f8c07b0a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c033000 tx=0x7f2f9c0018d0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:42.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.380+0000 7f2fa2a00640 1 -- 172.21.15.42:0/4054368865 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2fac1411d0 con 0x7f2fac13e950 2024-09-17T01:44:42.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.612+0000 7f2fb1c00640 1 -- 172.21.15.42:0/4054368865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fac06d990 con 0x7f2fac13e950 2024-09-17T01:44:42.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.612+0000 7f2fa2a00640 1 -- 172.21.15.42:0/4054368865 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5230 (secure 0 0 0) 0x7f2fac06ffa0 con 0x7f2fac13e950 2024-09-17T01:44:42.610 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:44:42.610 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":125,"btime":"2024-09-17T01:44:10:057034+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8872,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3393274334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3393274334},{"type":"v1","addr":"172.21.15.43:6836","nonce":3393274334}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":8875,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2869136532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2869136532},{"type":"v1","addr":"172.21.15.43:6837","nonce":2869136532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":9513,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/297557585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":297557585},{"type":"v1","addr":"172.21.15.42:6834","nonce":297557585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":119}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:44:06.556661+0000","modified":"2024-09-17T01:44:09.563813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9516},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9516":{"gid":9516,"name":"c","rank":0,"incarnation":121,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1557345672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1557345672},{"type":"v1","addr":"172.21.15.42:6835","nonce":1557345672}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9516,"qdb_cluster":[9516]},"id":11}]} 2024-09-17T01:44:42.611 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 125 2024-09-17T01:44:42.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.615+0000 7f2fb1c00640 1 -- 172.21.15.42:0/4054368865 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f8c078b90 msgr2=0x7f2f8c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:42.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.615+0000 7f2fb1c00640 1 --2- 172.21.15.42:0/4054368865 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f8c078b90 0x7f2f8c07b0a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c033000 tx=0x7f2f9c0018d0 comp rx=0 tx=0).stop 2024-09-17T01:44:42.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.615+0000 7f2fb1c00640 1 -- 172.21.15.42:0/4054368865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2fac13e950 msgr2=0x7f2fac06f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:42.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.615+0000 7f2fb1c00640 1 --2- 172.21.15.42:0/4054368865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2fac13e950 0x7f2fac06f650 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f2f98011b10 tx=0x7f2f98009e90 comp rx=0 tx=0).stop 2024-09-17T01:44:42.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.615+0000 7f2fb1c00640 1 -- 172.21.15.42:0/4054368865 shutdown_connections 2024-09-17T01:44:42.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.615+0000 7f2fb1c00640 1 --2- 172.21.15.42:0/4054368865 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f8c078b90 0x7f2f8c07b0a0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:42.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.615+0000 7f2fb1c00640 1 --2- 172.21.15.42:0/4054368865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2fac06fb90 0x7f2fac13f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:42.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.615+0000 7f2fb1c00640 1 --2- 172.21.15.42:0/4054368865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2fac13e950 0x7f2fac06f650 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:42.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.615+0000 7f2fb1c00640 1 --2- 172.21.15.42:0/4054368865 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f90003c10 0x7f2fac13e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:42.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.615+0000 7f2fb1c00640 1 -- 172.21.15.42:0/4054368865 >> 172.21.15.42:0/4054368865 conn(0x7f2fac0b2930 msgr2=0x7f2fac0cc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:42.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.615+0000 7f2fb1c00640 1 -- 172.21.15.42:0/4054368865 shutdown_connections 2024-09-17T01:44:42.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.615+0000 7f2fb1c00640 1 -- 172.21.15.42:0/4054368865 wait complete. 2024-09-17T01:44:42.636 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T01:44:42.636 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:44:42.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.865+0000 7f2f63000640 1 -- 172.21.15.42:0/3841837127 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f5c15f480 msgr2=0x7f2f5c15f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:42.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.865+0000 7f2f63000640 1 --2- 172.21.15.42:0/3841837127 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f5c15f480 0x7f2f5c15f890 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2f54005fd0 tx=0x7f2f5402a8b0 comp rx=0 tx=0).stop 2024-09-17T01:44:42.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.865+0000 7f2f63000640 1 -- 172.21.15.42:0/3841837127 shutdown_connections 2024-09-17T01:44:42.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.865+0000 7f2f63000640 1 --2- 172.21.15.42:0/3841837127 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f5c15f480 0x7f2f5c15f890 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:42.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.865+0000 7f2f63000640 1 --2- 172.21.15.42:0/3841837127 >> v2:172.21.15.43:3300/0 conn(0x7f2f5c06d430 0x7f2f5c06d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:42.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.865+0000 7f2f63000640 1 -- 172.21.15.42:0/3841837127 >> 172.21.15.42:0/3841837127 conn(0x7f2f5c0b2930 msgr2=0x7f2f5c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:42.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.865+0000 7f2f63000640 1 -- 172.21.15.42:0/3841837127 shutdown_connections 2024-09-17T01:44:42.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.865+0000 7f2f63000640 1 -- 172.21.15.42:0/3841837127 wait complete. 2024-09-17T01:44:42.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.867+0000 7f2f63000640 1 Processor -- start 2024-09-17T01:44:42.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.867+0000 7f2f63000640 1 -- start start 2024-09-17T01:44:42.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.869+0000 7f2f63000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f5c06d430 0x7f2f5c1f9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:42.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.869+0000 7f2f63000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f5c15cb80 0x7f2f5c145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:42.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.869+0000 7f2f63000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f5c15f480 0x7f2f5c0ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:42.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.869+0000 7f2f63000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c073820 con 0x7f2f5c15cb80 2024-09-17T01:44:42.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.869+0000 7f2f63000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c0736a0 con 0x7f2f5c15f480 2024-09-17T01:44:42.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.869+0000 7f2f63000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2f5c0739a0 con 0x7f2f5c06d430 2024-09-17T01:44:42.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.869+0000 7f2f5b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f5c15cb80 0x7f2f5c145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:42.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.869+0000 7f2f5b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f5c15cb80 0x7f2f5c145640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33962/0 (socket says 172.21.15.42:33962) 2024-09-17T01:44:42.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.869+0000 7f2f5b400640 1 -- 172.21.15.42:0/3937617342 learned_addr learned my addr 172.21.15.42:0/3937617342 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:42.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.869+0000 7f2f61000640 1 --2- 172.21.15.42:0/3937617342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f5c15f480 0x7f2f5c0ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:42.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.869+0000 7f2f5be00640 1 --2- 172.21.15.42:0/3937617342 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f5c06d430 0x7f2f5c1f9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:42.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.869+0000 7f2f5b400640 1 -- 172.21.15.42:0/3937617342 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f5c06d430 msgr2=0x7f2f5c1f9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:42.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.869+0000 7f2f5b400640 1 --2- 172.21.15.42:0/3937617342 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f5c06d430 0x7f2f5c1f9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:42.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.869+0000 7f2f5b400640 1 -- 172.21.15.42:0/3937617342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f5c15f480 msgr2=0x7f2f5c0ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:42.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.869+0000 7f2f5b400640 1 --2- 172.21.15.42:0/3937617342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f5c15f480 0x7f2f5c0ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:42.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.869+0000 7f2f5b400640 1 -- 172.21.15.42:0/3937617342 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c1fa1c0 con 0x7f2f5c15cb80 2024-09-17T01:44:42.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.869+0000 7f2f5be00640 1 --2- 172.21.15.42:0/3937617342 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f5c06d430 0x7f2f5c1f9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:44:42.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.870+0000 7f2f5b400640 1 --2- 172.21.15.42:0/3937617342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f5c15cb80 0x7f2f5c145640 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f2f4800e7c0 tx=0x7f2f4800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:42.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.870+0000 7f2f53e00640 1 -- 172.21.15.42:0/3937617342 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4800ccc0 con 0x7f2f5c15cb80 2024-09-17T01:44:42.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.870+0000 7f2f53e00640 1 -- 172.21.15.42:0/3937617342 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f48010430 con 0x7f2f5c15cb80 2024-09-17T01:44:42.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.870+0000 7f2f53e00640 1 -- 172.21.15.42:0/3937617342 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f48010860 con 0x7f2f5c15cb80 2024-09-17T01:44:42.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.870+0000 7f2f63000640 1 -- 172.21.15.42:0/3937617342 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5c146040 con 0x7f2f5c15cb80 2024-09-17T01:44:42.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.870+0000 7f2f63000640 1 -- 172.21.15.42:0/3937617342 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f5c0caa70 con 0x7f2f5c15cb80 2024-09-17T01:44:42.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.871+0000 7f2f63000640 1 -- 172.21.15.42:0/3937617342 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f5c0ca890 con 0x7f2f5c15cb80 2024-09-17T01:44:42.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.873+0000 7f2f53e00640 1 -- 172.21.15.42:0/3937617342 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2f48010a00 con 0x7f2f5c15cb80 2024-09-17T01:44:42.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.874+0000 7f2f53e00640 1 --2- 172.21.15.42:0/3937617342 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f3c078bc0 0x7f2f3c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:42.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.874+0000 7f2f53e00640 1 -- 172.21.15.42:0/3937617342 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7f2f4809b9a0 con 0x7f2f5c15cb80 2024-09-17T01:44:42.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.874+0000 7f2f5be00640 1 --2- 172.21.15.42:0/3937617342 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f3c078bc0 0x7f2f3c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:42.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.875+0000 7f2f5be00640 1 --2- 172.21.15.42:0/3937617342 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f3c078bc0 0x7f2f3c07b0d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c0013f0 tx=0x7f2f4c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:42.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:42.877+0000 7f2f53e00640 1 -- 172.21.15.42:0/3937617342 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2f5c0ca890 con 0x7f2f5c15cb80 2024-09-17T01:44:43.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:43.144+0000 7f2f63000640 1 -- 172.21.15.42:0/3937617342 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f2f5c0b3c20 con 0x7f2f5c15cb80 2024-09-17T01:44:43.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:43.145+0000 7f2f53e00640 1 -- 172.21.15.42:0/3937617342 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1233 (secure 0 0 0) 0x7f2f5c0b3c20 con 0x7f2f5c15cb80 2024-09-17T01:44:43.143 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:44:43.143 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":783,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":160,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076888962,"bytes_used":2595774464,"bytes_avail":770498338816,"bytes_total":773094113280,"write_bytes_sec":54261229,"read_op_per_sec":0,"write_op_per_sec":67},"fsmap":{"epoch":125,"btime":"2024-09-17T01:44:10:057034+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":9516}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":29,"modified":"2024-09-17T01:43:55.185894+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:44:43.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:43.147+0000 7f2f63000640 1 -- 172.21.15.42:0/3937617342 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f3c078bc0 msgr2=0x7f2f3c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:43.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:43.147+0000 7f2f63000640 1 --2- 172.21.15.42:0/3937617342 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f3c078bc0 0x7f2f3c07b0d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c0013f0 tx=0x7f2f4c009040 comp rx=0 tx=0).stop 2024-09-17T01:44:43.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:43.147+0000 7f2f63000640 1 -- 172.21.15.42:0/3937617342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f5c15cb80 msgr2=0x7f2f5c145640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:43.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:43.147+0000 7f2f63000640 1 --2- 172.21.15.42:0/3937617342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f5c15cb80 0x7f2f5c145640 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f2f4800e7c0 tx=0x7f2f4800ec80 comp rx=0 tx=0).stop 2024-09-17T01:44:43.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:43.147+0000 7f2f63000640 1 -- 172.21.15.42:0/3937617342 shutdown_connections 2024-09-17T01:44:43.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:43.147+0000 7f2f63000640 1 --2- 172.21.15.42:0/3937617342 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f3c078bc0 0x7f2f3c07b0d0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:43.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:43.147+0000 7f2f63000640 1 --2- 172.21.15.42:0/3937617342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f5c15f480 0x7f2f5c0ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:43.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:43.147+0000 7f2f63000640 1 --2- 172.21.15.42:0/3937617342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f5c15cb80 0x7f2f5c145640 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:43.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:43.147+0000 7f2f63000640 1 --2- 172.21.15.42:0/3937617342 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f5c06d430 0x7f2f5c1f9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:43.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:43.147+0000 7f2f63000640 1 -- 172.21.15.42:0/3937617342 >> 172.21.15.42:0/3937617342 conn(0x7f2f5c0b2930 msgr2=0x7f2f5c072c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:43.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:43.147+0000 7f2f63000640 1 -- 172.21.15.42:0/3937617342 shutdown_connections 2024-09-17T01:44:43.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:43.147+0000 7f2f63000640 1 -- 172.21.15.42:0/3937617342 wait complete. 2024-09-17T01:44:43.166 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T01:44:44.167 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:44:44.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.407+0000 7fcd32e00640 1 -- 172.21.15.42:0/3856095806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd2c0b3550 msgr2=0x7fcd2c15cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:44.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.407+0000 7fcd32e00640 1 --2- 172.21.15.42:0/3856095806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd2c0b3550 0x7fcd2c15cec0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c005fd0 tx=0x7fcd1c02a540 comp rx=0 tx=0).stop 2024-09-17T01:44:44.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.407+0000 7fcd32e00640 1 -- 172.21.15.42:0/3856095806 shutdown_connections 2024-09-17T01:44:44.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.407+0000 7fcd32e00640 1 --2- 172.21.15.42:0/3856095806 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcd2c0cec40 0x7fcd2c0cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:44.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.407+0000 7fcd32e00640 1 --2- 172.21.15.42:0/3856095806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd2c0b3550 0x7fcd2c15cec0 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:44.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.407+0000 7fcd32e00640 1 -- 172.21.15.42:0/3856095806 >> 172.21.15.42:0/3856095806 conn(0x7fcd2c0b2930 msgr2=0x7fcd2c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:44.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.407+0000 7fcd32e00640 1 -- 172.21.15.42:0/3856095806 shutdown_connections 2024-09-17T01:44:44.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.407+0000 7fcd32e00640 1 -- 172.21.15.42:0/3856095806 wait complete. 2024-09-17T01:44:44.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.410+0000 7fcd32e00640 1 Processor -- start 2024-09-17T01:44:44.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.410+0000 7fcd32e00640 1 -- start start 2024-09-17T01:44:44.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.411+0000 7fcd32e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd2c0b3550 0x7fcd2c137920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:44.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.411+0000 7fcd32e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcd2c0cec40 0x7fcd2c0ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:44.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.411+0000 7fcd32e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd2c142f40 0x7fcd2c0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:44.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.411+0000 7fcd32e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c06d7c0 con 0x7fcd2c142f40 2024-09-17T01:44:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.411+0000 7fcd32e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c06d640 con 0x7fcd2c0b3550 2024-09-17T01:44:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.411+0000 7fcd32e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fcd2c06d940 con 0x7fcd2c0cec40 2024-09-17T01:44:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.412+0000 7fcd30e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd2c142f40 0x7fcd2c0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.412+0000 7fcd30e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd2c142f40 0x7fcd2c0aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33980/0 (socket says 172.21.15.42:33980) 2024-09-17T01:44:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.412+0000 7fcd30e00640 1 -- 172.21.15.42:0/4048275230 learned_addr learned my addr 172.21.15.42:0/4048275230 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.412+0000 7fcd2be00640 1 --2- 172.21.15.42:0/4048275230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd2c0b3550 0x7fcd2c137920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.412+0000 7fcd23400640 1 --2- 172.21.15.42:0/4048275230 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcd2c0cec40 0x7fcd2c0ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.412+0000 7fcd30e00640 1 -- 172.21.15.42:0/4048275230 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcd2c0cec40 msgr2=0x7fcd2c0ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.412+0000 7fcd30e00640 1 --2- 172.21.15.42:0/4048275230 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcd2c0cec40 0x7fcd2c0ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.412+0000 7fcd30e00640 1 -- 172.21.15.42:0/4048275230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd2c0b3550 msgr2=0x7fcd2c137920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.412+0000 7fcd30e00640 1 --2- 172.21.15.42:0/4048275230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd2c0b3550 0x7fcd2c137920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.412+0000 7fcd30e00640 1 -- 172.21.15.42:0/4048275230 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd2c141c80 con 0x7fcd2c142f40 2024-09-17T01:44:44.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.412+0000 7fcd23400640 1 --2- 172.21.15.42:0/4048275230 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcd2c0cec40 0x7fcd2c0ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:44:44.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.412+0000 7fcd30e00640 1 --2- 172.21.15.42:0/4048275230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd2c142f40 0x7fcd2c0aede0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7fcd2400e960 tx=0x7fcd2400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:44.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.413+0000 7fcd28c00640 1 -- 172.21.15.42:0/4048275230 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd24004d20 con 0x7fcd2c142f40 2024-09-17T01:44:44.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.413+0000 7fcd28c00640 1 -- 172.21.15.42:0/4048275230 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd2400cac0 con 0x7fcd2c142f40 2024-09-17T01:44:44.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.413+0000 7fcd28c00640 1 -- 172.21.15.42:0/4048275230 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd24005020 con 0x7fcd2c142f40 2024-09-17T01:44:44.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.413+0000 7fcd32e00640 1 -- 172.21.15.42:0/4048275230 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd2c141ef0 con 0x7fcd2c142f40 2024-09-17T01:44:44.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.413+0000 7fcd32e00640 1 -- 172.21.15.42:0/4048275230 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd2c156e10 con 0x7fcd2c142f40 2024-09-17T01:44:44.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.414+0000 7fcd32e00640 1 -- 172.21.15.42:0/4048275230 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd2c06a170 con 0x7fcd2c142f40 2024-09-17T01:44:44.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.415+0000 7fcd28c00640 1 -- 172.21.15.42:0/4048275230 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcd240051c0 con 0x7fcd2c142f40 2024-09-17T01:44:44.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.417+0000 7fcd28c00640 1 --2- 172.21.15.42:0/4048275230 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcd08078b90 0x7fcd0807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:44.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.417+0000 7fcd28c00640 1 -- 172.21.15.42:0/4048275230 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7fcd2409b5c0 con 0x7fcd2c142f40 2024-09-17T01:44:44.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.417+0000 7fcd2be00640 1 --2- 172.21.15.42:0/4048275230 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcd08078b90 0x7fcd0807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:44.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.418+0000 7fcd2be00640 1 --2- 172.21.15.42:0/4048275230 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcd08078b90 0x7fcd0807b0a0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c033000 tx=0x7fcd1c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:44.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.421+0000 7fcd28c00640 1 -- 172.21.15.42:0/4048275230 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcd24016030 con 0x7fcd2c142f40 2024-09-17T01:44:44.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.654+0000 7fcd32e00640 1 -- 172.21.15.42:0/4048275230 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd2c15cea0 con 0x7fcd2c142f40 2024-09-17T01:44:44.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.655+0000 7fcd28c00640 1 -- 172.21.15.42:0/4048275230 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5230 (secure 0 0 0) 0x7fcd24063a80 con 0x7fcd2c142f40 2024-09-17T01:44:44.653 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:44:44.653 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":125,"btime":"2024-09-17T01:44:10:057034+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8872,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3393274334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3393274334},{"type":"v1","addr":"172.21.15.43:6836","nonce":3393274334}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":8875,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2869136532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2869136532},{"type":"v1","addr":"172.21.15.43:6837","nonce":2869136532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":9513,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/297557585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":297557585},{"type":"v1","addr":"172.21.15.42:6834","nonce":297557585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":119}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:44:06.556661+0000","modified":"2024-09-17T01:44:09.563813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9516},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9516":{"gid":9516,"name":"c","rank":0,"incarnation":121,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1557345672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1557345672},{"type":"v1","addr":"172.21.15.42:6835","nonce":1557345672}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9516,"qdb_cluster":[9516]},"id":11}]} 2024-09-17T01:44:44.653 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 125 2024-09-17T01:44:44.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.657+0000 7fcd32e00640 1 -- 172.21.15.42:0/4048275230 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcd08078b90 msgr2=0x7fcd0807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:44.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.657+0000 7fcd32e00640 1 --2- 172.21.15.42:0/4048275230 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcd08078b90 0x7fcd0807b0a0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c033000 tx=0x7fcd1c004730 comp rx=0 tx=0).stop 2024-09-17T01:44:44.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.657+0000 7fcd32e00640 1 -- 172.21.15.42:0/4048275230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd2c142f40 msgr2=0x7fcd2c0aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:44.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.657+0000 7fcd32e00640 1 --2- 172.21.15.42:0/4048275230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd2c142f40 0x7fcd2c0aede0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7fcd2400e960 tx=0x7fcd2400ee20 comp rx=0 tx=0).stop 2024-09-17T01:44:44.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.657+0000 7fcd32e00640 1 -- 172.21.15.42:0/4048275230 shutdown_connections 2024-09-17T01:44:44.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.657+0000 7fcd32e00640 1 --2- 172.21.15.42:0/4048275230 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcd08078b90 0x7fcd0807b0a0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:44.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.657+0000 7fcd32e00640 1 --2- 172.21.15.42:0/4048275230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcd2c142f40 0x7fcd2c0aede0 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:44.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.657+0000 7fcd32e00640 1 --2- 172.21.15.42:0/4048275230 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcd2c0cec40 0x7fcd2c0ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:44.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.657+0000 7fcd32e00640 1 --2- 172.21.15.42:0/4048275230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd2c0b3550 0x7fcd2c137920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:44.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.657+0000 7fcd32e00640 1 -- 172.21.15.42:0/4048275230 >> 172.21.15.42:0/4048275230 conn(0x7fcd2c0b2930 msgr2=0x7fcd2c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:44.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.657+0000 7fcd32e00640 1 -- 172.21.15.42:0/4048275230 shutdown_connections 2024-09-17T01:44:44.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.657+0000 7fcd32e00640 1 -- 172.21.15.42:0/4048275230 wait complete. 2024-09-17T01:44:44.677 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T01:44:44.678 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:44:44.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.907+0000 7f109c400640 1 -- 172.21.15.42:0/1268598487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10940b3550 msgr2=0x7f109415cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:44.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.907+0000 7f109c400640 1 --2- 172.21.15.42:0/1268598487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10940b3550 0x7f109415cec0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f1088005fd0 tx=0x7f108802a540 comp rx=0 tx=0).stop 2024-09-17T01:44:44.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.907+0000 7f109c400640 1 -- 172.21.15.42:0/1268598487 shutdown_connections 2024-09-17T01:44:44.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.907+0000 7f109c400640 1 --2- 172.21.15.42:0/1268598487 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10940cec40 0x7f10940cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:44.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.907+0000 7f109c400640 1 --2- 172.21.15.42:0/1268598487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10940b3550 0x7f109415cec0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:44.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.907+0000 7f109c400640 1 -- 172.21.15.42:0/1268598487 >> 172.21.15.42:0/1268598487 conn(0x7f10940b2930 msgr2=0x7f109406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:44.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.907+0000 7f109c400640 1 -- 172.21.15.42:0/1268598487 shutdown_connections 2024-09-17T01:44:44.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.907+0000 7f109c400640 1 -- 172.21.15.42:0/1268598487 wait complete. 2024-09-17T01:44:44.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.910+0000 7f109c400640 1 Processor -- start 2024-09-17T01:44:44.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.910+0000 7f109c400640 1 -- start start 2024-09-17T01:44:44.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.911+0000 7f109c400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10940b3550 0x7f1094158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:44.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.911+0000 7f109c400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10940cec40 0x7f109412e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:44.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.911+0000 7f109c400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1094142f40 0x7f109412e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:44.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.911+0000 7f109c400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f109406d7c0 con 0x7f1094142f40 2024-09-17T01:44:44.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.911+0000 7f109c400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f109406d640 con 0x7f10940b3550 2024-09-17T01:44:44.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.911+0000 7f109c400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f109406d940 con 0x7f10940cec40 2024-09-17T01:44:44.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.912+0000 7f109a400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1094142f40 0x7f109412e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:44.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.912+0000 7f109a400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1094142f40 0x7f109412e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33994/0 (socket says 172.21.15.42:33994) 2024-09-17T01:44:44.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.912+0000 7f109a400640 1 -- 172.21.15.42:0/2775768949 learned_addr learned my addr 172.21.15.42:0/2775768949 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:44.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.912+0000 7f1099000640 1 --2- 172.21.15.42:0/2775768949 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10940cec40 0x7f109412e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:44.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.912+0000 7f1099a00640 1 --2- 172.21.15.42:0/2775768949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10940b3550 0x7f1094158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:44.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.912+0000 7f109a400640 1 -- 172.21.15.42:0/2775768949 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10940cec40 msgr2=0x7f109412e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:44.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.912+0000 7f109a400640 1 --2- 172.21.15.42:0/2775768949 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10940cec40 0x7f109412e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:44.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.912+0000 7f109a400640 1 -- 172.21.15.42:0/2775768949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10940b3550 msgr2=0x7f1094158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:44.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.912+0000 7f109a400640 1 --2- 172.21.15.42:0/2775768949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10940b3550 0x7f1094158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:44.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.912+0000 7f109a400640 1 -- 172.21.15.42:0/2775768949 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f109413f000 con 0x7f1094142f40 2024-09-17T01:44:44.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.912+0000 7f109a400640 1 --2- 172.21.15.42:0/2775768949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1094142f40 0x7f109412e610 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f108c00e960 tx=0x7f108c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:44.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.913+0000 7f1091600640 1 -- 172.21.15.42:0/2775768949 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c004d20 con 0x7f1094142f40 2024-09-17T01:44:44.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.913+0000 7f1091600640 1 -- 172.21.15.42:0/2775768949 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f108c00cac0 con 0x7f1094142f40 2024-09-17T01:44:44.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.913+0000 7f1091600640 1 -- 172.21.15.42:0/2775768949 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c005020 con 0x7f1094142f40 2024-09-17T01:44:44.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.913+0000 7f109c400640 1 -- 172.21.15.42:0/2775768949 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1094140c70 con 0x7f1094142f40 2024-09-17T01:44:44.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.913+0000 7f109c400640 1 -- 172.21.15.42:0/2775768949 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f109412d8d0 con 0x7f1094142f40 2024-09-17T01:44:44.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.914+0000 7f109c400640 1 -- 172.21.15.42:0/2775768949 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f109406a170 con 0x7f1094142f40 2024-09-17T01:44:44.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.915+0000 7f1091600640 1 -- 172.21.15.42:0/2775768949 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f108c0051c0 con 0x7f1094142f40 2024-09-17T01:44:44.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.916+0000 7f1091600640 1 --2- 172.21.15.42:0/2775768949 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1074078b90 0x7f107407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:44.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.916+0000 7f1091600640 1 -- 172.21.15.42:0/2775768949 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7f108c09b700 con 0x7f1094142f40 2024-09-17T01:44:44.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.917+0000 7f1099a00640 1 --2- 172.21.15.42:0/2775768949 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1074078b90 0x7f107407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:44.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.918+0000 7f1099a00640 1 --2- 172.21.15.42:0/2775768949 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1074078b90 0x7f107407b0a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1088033000 tx=0x7f1088004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:44.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:44.921+0000 7f1091600640 1 -- 172.21.15.42:0/2775768949 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f108c016030 con 0x7f1094142f40 2024-09-17T01:44:45.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:45.187+0000 7f109c400640 1 -- 172.21.15.42:0/2775768949 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f109415cea0 con 0x7f1094142f40 2024-09-17T01:44:45.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:45.188+0000 7f1091600640 1 -- 172.21.15.42:0/2775768949 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1233 (secure 0 0 0) 0x7f108c063aa0 con 0x7f1094142f40 2024-09-17T01:44:45.186 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:44:45.186 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":785,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":160,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076888962,"bytes_used":2595774464,"bytes_avail":770498338816,"bytes_total":773094113280,"write_bytes_sec":37270404,"read_op_per_sec":0,"write_op_per_sec":50},"fsmap":{"epoch":125,"btime":"2024-09-17T01:44:10:057034+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":9516}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":29,"modified":"2024-09-17T01:43:55.185894+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:44:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:45.191+0000 7f109c400640 1 -- 172.21.15.42:0/2775768949 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1074078b90 msgr2=0x7f107407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:45.191+0000 7f109c400640 1 --2- 172.21.15.42:0/2775768949 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1074078b90 0x7f107407b0a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1088033000 tx=0x7f1088004730 comp rx=0 tx=0).stop 2024-09-17T01:44:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:45.191+0000 7f109c400640 1 -- 172.21.15.42:0/2775768949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1094142f40 msgr2=0x7f109412e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:45.191+0000 7f109c400640 1 --2- 172.21.15.42:0/2775768949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1094142f40 0x7f109412e610 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f108c00e960 tx=0x7f108c00ee20 comp rx=0 tx=0).stop 2024-09-17T01:44:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:45.191+0000 7f109c400640 1 -- 172.21.15.42:0/2775768949 shutdown_connections 2024-09-17T01:44:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:45.191+0000 7f109c400640 1 --2- 172.21.15.42:0/2775768949 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1074078b90 0x7f107407b0a0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:45.191+0000 7f109c400640 1 --2- 172.21.15.42:0/2775768949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1094142f40 0x7f109412e610 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:45.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:45.191+0000 7f109c400640 1 --2- 172.21.15.42:0/2775768949 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10940cec40 0x7f109412e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:45.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:45.191+0000 7f109c400640 1 --2- 172.21.15.42:0/2775768949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10940b3550 0x7f1094158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:45.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:45.191+0000 7f109c400640 1 -- 172.21.15.42:0/2775768949 >> 172.21.15.42:0/2775768949 conn(0x7f10940b2930 msgr2=0x7f109406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:45.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:45.191+0000 7f109c400640 1 -- 172.21.15.42:0/2775768949 shutdown_connections 2024-09-17T01:44:45.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:45.191+0000 7f109c400640 1 -- 172.21.15.42:0/2775768949 wait complete. 2024-09-17T01:44:45.213 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T01:44:46.214 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:44:46.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.455+0000 7ff5dae00640 1 -- 172.21.15.42:0/2881169728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5d40b3550 msgr2=0x7ff5d415cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:46.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.455+0000 7ff5dae00640 1 --2- 172.21.15.42:0/2881169728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5d40b3550 0x7ff5d415cec0 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7ff5d415aab0 tx=0x7ff5c402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:44:46.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.455+0000 7ff5dae00640 1 -- 172.21.15.42:0/2881169728 shutdown_connections 2024-09-17T01:44:46.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.455+0000 7ff5dae00640 1 --2- 172.21.15.42:0/2881169728 >> v2:172.21.15.43:3300/0 conn(0x7ff5d40cec40 0x7ff5d40cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:46.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.455+0000 7ff5dae00640 1 --2- 172.21.15.42:0/2881169728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5d40b3550 0x7ff5d415cec0 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:46.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.455+0000 7ff5dae00640 1 -- 172.21.15.42:0/2881169728 >> 172.21.15.42:0/2881169728 conn(0x7ff5d40b2930 msgr2=0x7ff5d406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:46.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.455+0000 7ff5dae00640 1 -- 172.21.15.42:0/2881169728 shutdown_connections 2024-09-17T01:44:46.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.455+0000 7ff5dae00640 1 -- 172.21.15.42:0/2881169728 wait complete. 2024-09-17T01:44:46.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.457+0000 7ff5dae00640 1 Processor -- start 2024-09-17T01:44:46.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.457+0000 7ff5dae00640 1 -- start start 2024-09-17T01:44:46.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.459+0000 7ff5dae00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5d40b3550 0x7ff5d413ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:46.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.459+0000 7ff5dae00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5d40cec40 0x7ff5d40c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:46.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.459+0000 7ff5dae00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5d4142f40 0x7ff5d40b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:46.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.459+0000 7ff5dae00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d406d7c0 con 0x7ff5d4142f40 2024-09-17T01:44:46.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.459+0000 7ff5dae00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d406d640 con 0x7ff5d40b3550 2024-09-17T01:44:46.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.459+0000 7ff5dae00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff5d406d940 con 0x7ff5d40cec40 2024-09-17T01:44:46.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.459+0000 7ff5d8e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5d4142f40 0x7ff5d40b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:46.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.459+0000 7ff5d8e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5d4142f40 0x7ff5d40b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49592/0 (socket says 172.21.15.42:49592) 2024-09-17T01:44:46.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.459+0000 7ff5d8e00640 1 -- 172.21.15.42:0/1147467287 learned_addr learned my addr 172.21.15.42:0/1147467287 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:46.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.459+0000 7ff5d3400640 1 --2- 172.21.15.42:0/1147467287 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5d40cec40 0x7ff5d40c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:46.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.459+0000 7ff5d3e00640 1 --2- 172.21.15.42:0/1147467287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5d40b3550 0x7ff5d413ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:46.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.460+0000 7ff5d8e00640 1 -- 172.21.15.42:0/1147467287 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5d40cec40 msgr2=0x7ff5d40c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:46.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.460+0000 7ff5d8e00640 1 --2- 172.21.15.42:0/1147467287 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5d40cec40 0x7ff5d40c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:46.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.460+0000 7ff5d8e00640 1 -- 172.21.15.42:0/1147467287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5d40b3550 msgr2=0x7ff5d413ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:46.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.460+0000 7ff5d8e00640 1 --2- 172.21.15.42:0/1147467287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5d40b3550 0x7ff5d413ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:46.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.460+0000 7ff5d8e00640 1 -- 172.21.15.42:0/1147467287 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d415a8c0 con 0x7ff5d4142f40 2024-09-17T01:44:46.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.460+0000 7ff5d3e00640 1 --2- 172.21.15.42:0/1147467287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5d40b3550 0x7ff5d413ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:44:46.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.460+0000 7ff5d8e00640 1 --2- 172.21.15.42:0/1147467287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5d4142f40 0x7ff5d40b00a0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc00cb00 tx=0x7ff5cc00a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:46.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.460+0000 7ff5cbe00640 1 -- 172.21.15.42:0/1147467287 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc00f450 con 0x7ff5d4142f40 2024-09-17T01:44:46.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.460+0000 7ff5cbe00640 1 -- 172.21.15.42:0/1147467287 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5cc00f700 con 0x7ff5d4142f40 2024-09-17T01:44:46.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.460+0000 7ff5dae00640 1 -- 172.21.15.42:0/1147467287 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d40c5fe0 con 0x7ff5d4142f40 2024-09-17T01:44:46.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.460+0000 7ff5cbe00640 1 -- 172.21.15.42:0/1147467287 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc00fb50 con 0x7ff5d4142f40 2024-09-17T01:44:46.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.460+0000 7ff5dae00640 1 -- 172.21.15.42:0/1147467287 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5d415ab60 con 0x7ff5d4142f40 2024-09-17T01:44:46.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.461+0000 7ff5dae00640 1 -- 172.21.15.42:0/1147467287 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5d415cec0 con 0x7ff5d4142f40 2024-09-17T01:44:46.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.463+0000 7ff5cbe00640 1 -- 172.21.15.42:0/1147467287 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff5cc00fcf0 con 0x7ff5d4142f40 2024-09-17T01:44:46.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.464+0000 7ff5cbe00640 1 --2- 172.21.15.42:0/1147467287 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff5b4078bc0 0x7ff5b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:46.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.464+0000 7ff5cbe00640 1 -- 172.21.15.42:0/1147467287 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7ff5cc09b900 con 0x7ff5d4142f40 2024-09-17T01:44:46.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.464+0000 7ff5d3e00640 1 --2- 172.21.15.42:0/1147467287 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff5b4078bc0 0x7ff5b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:46.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.465+0000 7ff5d3e00640 1 --2- 172.21.15.42:0/1147467287 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff5b4078bc0 0x7ff5b407b0d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4034000 tx=0x7ff5c4004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:46.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.468+0000 7ff5cbe00640 1 -- 172.21.15.42:0/1147467287 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff5cc014030 con 0x7ff5d4142f40 2024-09-17T01:44:46.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.701+0000 7ff5dae00640 1 -- 172.21.15.42:0/1147467287 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5d406a170 con 0x7ff5d4142f40 2024-09-17T01:44:46.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.702+0000 7ff5cbe00640 1 -- 172.21.15.42:0/1147467287 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5230 (secure 0 0 0) 0x7ff5cc09b020 con 0x7ff5d4142f40 2024-09-17T01:44:46.700 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:44:46.700 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":125,"btime":"2024-09-17T01:44:10:057034+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8872,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3393274334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3393274334},{"type":"v1","addr":"172.21.15.43:6836","nonce":3393274334}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":8875,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2869136532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2869136532},{"type":"v1","addr":"172.21.15.43:6837","nonce":2869136532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":9513,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/297557585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":297557585},{"type":"v1","addr":"172.21.15.42:6834","nonce":297557585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":119}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:44:06.556661+0000","modified":"2024-09-17T01:44:09.563813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9516},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9516":{"gid":9516,"name":"c","rank":0,"incarnation":121,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1557345672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1557345672},{"type":"v1","addr":"172.21.15.42:6835","nonce":1557345672}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9516,"qdb_cluster":[9516]},"id":11}]} 2024-09-17T01:44:46.700 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 125 2024-09-17T01:44:46.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.704+0000 7ff5dae00640 1 -- 172.21.15.42:0/1147467287 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff5b4078bc0 msgr2=0x7ff5b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:46.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.704+0000 7ff5dae00640 1 --2- 172.21.15.42:0/1147467287 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff5b4078bc0 0x7ff5b407b0d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4034000 tx=0x7ff5c4004730 comp rx=0 tx=0).stop 2024-09-17T01:44:46.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.704+0000 7ff5dae00640 1 -- 172.21.15.42:0/1147467287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5d4142f40 msgr2=0x7ff5d40b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:46.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.704+0000 7ff5dae00640 1 --2- 172.21.15.42:0/1147467287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5d4142f40 0x7ff5d40b00a0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc00cb00 tx=0x7ff5cc00a250 comp rx=0 tx=0).stop 2024-09-17T01:44:46.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.704+0000 7ff5dae00640 1 -- 172.21.15.42:0/1147467287 shutdown_connections 2024-09-17T01:44:46.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.704+0000 7ff5dae00640 1 --2- 172.21.15.42:0/1147467287 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff5b4078bc0 0x7ff5b407b0d0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:46.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.704+0000 7ff5dae00640 1 --2- 172.21.15.42:0/1147467287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5d4142f40 0x7ff5d40b00a0 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:46.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.704+0000 7ff5dae00640 1 --2- 172.21.15.42:0/1147467287 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff5d40cec40 0x7ff5d40c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:46.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.704+0000 7ff5dae00640 1 --2- 172.21.15.42:0/1147467287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5d40b3550 0x7ff5d413ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:46.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.704+0000 7ff5dae00640 1 -- 172.21.15.42:0/1147467287 >> 172.21.15.42:0/1147467287 conn(0x7ff5d40b2930 msgr2=0x7ff5d406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:46.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.705+0000 7ff5dae00640 1 -- 172.21.15.42:0/1147467287 shutdown_connections 2024-09-17T01:44:46.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.705+0000 7ff5dae00640 1 -- 172.21.15.42:0/1147467287 wait complete. 2024-09-17T01:44:46.724 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-17T01:44:46.724 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:44:46.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.953+0000 7f9960400640 1 -- 172.21.15.42:0/4215464654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f995806f2a0 msgr2=0x7f995806d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:46.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.953+0000 7f9960400640 1 --2- 172.21.15.42:0/4215464654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f995806f2a0 0x7f995806d610 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f9944005fd0 tx=0x7f994402a540 comp rx=0 tx=0).stop 2024-09-17T01:44:46.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.953+0000 7f9960400640 1 -- 172.21.15.42:0/4215464654 shutdown_connections 2024-09-17T01:44:46.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.953+0000 7f9960400640 1 --2- 172.21.15.42:0/4215464654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f995806f2a0 0x7f995806d610 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:46.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.953+0000 7f9960400640 1 --2- 172.21.15.42:0/4215464654 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f995806ee90 0x7f995815f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:46.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.953+0000 7f9960400640 1 -- 172.21.15.42:0/4215464654 >> 172.21.15.42:0/4215464654 conn(0x7f99580b2930 msgr2=0x7f995806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:46.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.953+0000 7f9960400640 1 -- 172.21.15.42:0/4215464654 shutdown_connections 2024-09-17T01:44:46.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.953+0000 7f9960400640 1 -- 172.21.15.42:0/4215464654 wait complete. 2024-09-17T01:44:46.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.955+0000 7f9960400640 1 Processor -- start 2024-09-17T01:44:46.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.955+0000 7f9960400640 1 -- start start 2024-09-17T01:44:46.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.957+0000 7f9960400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f995806db50 0x7f9958146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:46.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.957+0000 7f9960400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f995806ee90 0x7f99580b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:46.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.957+0000 7f9960400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f995806f2a0 0x7f99580b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:46.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.957+0000 7f9960400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f99580cef40 con 0x7f995806f2a0 2024-09-17T01:44:46.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.957+0000 7f9960400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9958074750 con 0x7f995806db50 2024-09-17T01:44:46.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.957+0000 7f9960400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f99580cf0c0 con 0x7f995806ee90 2024-09-17T01:44:46.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.957+0000 7f995e400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f995806f2a0 0x7f99580b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:46.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.957+0000 7f995e400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f995806f2a0 0x7f99580b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49614/0 (socket says 172.21.15.42:49614) 2024-09-17T01:44:46.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.957+0000 7f995e400640 1 -- 172.21.15.42:0/1762285858 learned_addr learned my addr 172.21.15.42:0/1762285858 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:46.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.957+0000 7f995d000640 1 --2- 172.21.15.42:0/1762285858 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f995806ee90 0x7f99580b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:46.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.958+0000 7f995da00640 1 --2- 172.21.15.42:0/1762285858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f995806db50 0x7f9958146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:46.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.958+0000 7f995e400640 1 -- 172.21.15.42:0/1762285858 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f995806ee90 msgr2=0x7f99580b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:46.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.958+0000 7f995e400640 1 --2- 172.21.15.42:0/1762285858 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f995806ee90 0x7f99580b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:46.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.958+0000 7f995e400640 1 -- 172.21.15.42:0/1762285858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f995806db50 msgr2=0x7f9958146d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:46.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.958+0000 7f995e400640 1 --2- 172.21.15.42:0/1762285858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f995806db50 0x7f9958146d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:46.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.958+0000 7f995e400640 1 -- 172.21.15.42:0/1762285858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9958147a40 con 0x7f995806f2a0 2024-09-17T01:44:46.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.958+0000 7f995e400640 1 --2- 172.21.15.42:0/1762285858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f995806f2a0 0x7f99580b0630 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f995000c730 tx=0x7f995000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:46.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.958+0000 7f9955600640 1 -- 172.21.15.42:0/1762285858 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9950017070 con 0x7f995806f2a0 2024-09-17T01:44:46.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.958+0000 7f9955600640 1 -- 172.21.15.42:0/1762285858 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9950003c60 con 0x7f995806f2a0 2024-09-17T01:44:46.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.958+0000 7f9955600640 1 -- 172.21.15.42:0/1762285858 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99500052d0 con 0x7f995806f2a0 2024-09-17T01:44:46.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.958+0000 7f9960400640 1 -- 172.21.15.42:0/1762285858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9958147d20 con 0x7f995806f2a0 2024-09-17T01:44:46.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.958+0000 7f9960400640 1 -- 172.21.15.42:0/1762285858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99581482e0 con 0x7f995806f2a0 2024-09-17T01:44:46.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.959+0000 7f9960400640 1 -- 172.21.15.42:0/1762285858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99581477b0 con 0x7f995806f2a0 2024-09-17T01:44:46.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.961+0000 7f9955600640 1 -- 172.21.15.42:0/1762285858 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f995001a070 con 0x7f995806f2a0 2024-09-17T01:44:46.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.962+0000 7f9955600640 1 --2- 172.21.15.42:0/1762285858 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9938078b90 0x7f993807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:46.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.962+0000 7f9955600640 1 -- 172.21.15.42:0/1762285858 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7f995009a540 con 0x7f995806f2a0 2024-09-17T01:44:46.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.962+0000 7f995da00640 1 --2- 172.21.15.42:0/1762285858 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9938078b90 0x7f993807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:46.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.963+0000 7f995da00640 1 --2- 172.21.15.42:0/1762285858 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9938078b90 0x7f993807b0a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f994c009ac0 tx=0x7f994c005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:46.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:46.966+0000 7f9955600640 1 -- 172.21.15.42:0/1762285858 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9950062970 con 0x7f995806f2a0 2024-09-17T01:44:47.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.237+0000 7f9960400640 1 -- 172.21.15.42:0/1762285858 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f995815f200 con 0x7f995806f2a0 2024-09-17T01:44:47.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.238+0000 7f9955600640 1 -- 172.21.15.42:0/1762285858 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7f9950062270 con 0x7f995806f2a0 2024-09-17T01:44:47.236 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:44:47.236 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":787,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":160,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076961345,"bytes_used":2598846464,"bytes_avail":770495266816,"bytes_total":773094113280,"write_bytes_sec":37279828,"read_op_per_sec":0,"write_op_per_sec":53},"fsmap":{"epoch":125,"btime":"2024-09-17T01:44:10:057034+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":9516}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":30,"modified":"2024-09-17T01:44:45.199230+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:44:47.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.240+0000 7f9960400640 1 -- 172.21.15.42:0/1762285858 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9938078b90 msgr2=0x7f993807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:47.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.240+0000 7f9960400640 1 --2- 172.21.15.42:0/1762285858 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9938078b90 0x7f993807b0a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f994c009ac0 tx=0x7f994c005f90 comp rx=0 tx=0).stop 2024-09-17T01:44:47.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.240+0000 7f9960400640 1 -- 172.21.15.42:0/1762285858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f995806f2a0 msgr2=0x7f99580b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:47.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.240+0000 7f9960400640 1 --2- 172.21.15.42:0/1762285858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f995806f2a0 0x7f99580b0630 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f995000c730 tx=0x7f995000cbf0 comp rx=0 tx=0).stop 2024-09-17T01:44:47.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.241+0000 7f9960400640 1 -- 172.21.15.42:0/1762285858 shutdown_connections 2024-09-17T01:44:47.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.241+0000 7f9960400640 1 --2- 172.21.15.42:0/1762285858 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9938078b90 0x7f993807b0a0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:47.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.241+0000 7f9960400640 1 --2- 172.21.15.42:0/1762285858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f995806f2a0 0x7f99580b0630 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:47.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.241+0000 7f9960400640 1 --2- 172.21.15.42:0/1762285858 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f995806ee90 0x7f99580b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:47.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.241+0000 7f9960400640 1 --2- 172.21.15.42:0/1762285858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f995806db50 0x7f9958146d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:47.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.241+0000 7f9960400640 1 -- 172.21.15.42:0/1762285858 >> 172.21.15.42:0/1762285858 conn(0x7f99580b2930 msgr2=0x7f9958161530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:47.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.241+0000 7f9960400640 1 -- 172.21.15.42:0/1762285858 shutdown_connections 2024-09-17T01:44:47.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.241+0000 7f9960400640 1 -- 172.21.15.42:0/1762285858 wait complete. 2024-09-17T01:44:47.261 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-17T01:44:47.261 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T01:44:47.261 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:44:47.286 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T01:44:47.286 INFO:tasks.cephfs.test_scrub_checks:Waiting for promotion of one of the original standbys {'b', 'd', 'a'} 2024-09-17T01:44:47.287 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2024-09-17T01:44:47.564 INFO:teuthology.orchestra.run.smithi042.stdout:{"mds_beacon_grace":"15.000000"} 2024-09-17T01:44:47.564 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2024-09-17T01:44:47.565 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:44:47.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.793+0000 7f916a600640 1 -- 172.21.15.42:0/3232655628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91640b3550 msgr2=0x7f916415cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:47.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.793+0000 7f916a600640 1 --2- 172.21.15.42:0/3232655628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91640b3550 0x7f916415cec0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f9154009830 tx=0x7f915402a530 comp rx=0 tx=0).stop 2024-09-17T01:44:47.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.793+0000 7f916a600640 1 -- 172.21.15.42:0/3232655628 shutdown_connections 2024-09-17T01:44:47.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.793+0000 7f916a600640 1 --2- 172.21.15.42:0/3232655628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91640b3550 0x7f916415cec0 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:47.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.793+0000 7f916a600640 1 -- 172.21.15.42:0/3232655628 >> 172.21.15.42:0/3232655628 conn(0x7f91640b2930 msgr2=0x7f916406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:47.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.793+0000 7f916a600640 1 -- 172.21.15.42:0/3232655628 shutdown_connections 2024-09-17T01:44:47.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.793+0000 7f916a600640 1 -- 172.21.15.42:0/3232655628 wait complete. 2024-09-17T01:44:47.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.795+0000 7f916a600640 1 Processor -- start 2024-09-17T01:44:47.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.796+0000 7f916a600640 1 -- start start 2024-09-17T01:44:47.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.797+0000 7f916a600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91640b3550 0x7f9164141d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:47.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.797+0000 7f916a600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91640cec40 0x7f916412f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:47.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.797+0000 7f916a600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9164142f40 0x7f9164159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:47.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.797+0000 7f916a600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f91640cf050 con 0x7f91640cec40 2024-09-17T01:44:47.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.797+0000 7f916a600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f916406dd50 con 0x7f91640b3550 2024-09-17T01:44:47.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.797+0000 7f916a600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f91640cf1d0 con 0x7f9164142f40 2024-09-17T01:44:47.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.797+0000 7f915aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91640cec40 0x7f916412f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:47.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.797+0000 7f915aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91640cec40 0x7f916412f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49640/0 (socket says 172.21.15.42:49640) 2024-09-17T01:44:47.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.797+0000 7f915aa00640 1 -- 172.21.15.42:0/2161329869 learned_addr learned my addr 172.21.15.42:0/2161329869 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:47.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.798+0000 7f9163400640 1 --2- 172.21.15.42:0/2161329869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91640b3550 0x7f9164141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:47.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.798+0000 7f9163e00640 1 --2- 172.21.15.42:0/2161329869 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9164142f40 0x7f9164159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:47.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.798+0000 7f915aa00640 1 -- 172.21.15.42:0/2161329869 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9164142f40 msgr2=0x7f9164159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:47.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.798+0000 7f915aa00640 1 --2- 172.21.15.42:0/2161329869 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9164142f40 0x7f9164159410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:47.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.798+0000 7f915aa00640 1 -- 172.21.15.42:0/2161329869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91640b3550 msgr2=0x7f9164141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:47.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.798+0000 7f915aa00640 1 --2- 172.21.15.42:0/2161329869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91640b3550 0x7f9164141d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:47.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.798+0000 7f915aa00640 1 -- 172.21.15.42:0/2161329869 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91641422c0 con 0x7f91640cec40 2024-09-17T01:44:47.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.798+0000 7f9163400640 1 --2- 172.21.15.42:0/2161329869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91640b3550 0x7f9164141d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:44:47.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.798+0000 7f915aa00640 1 --2- 172.21.15.42:0/2161329869 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91640cec40 0x7f916412f6c0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f914c00c430 tx=0x7f914c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:47.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.798+0000 7f915be00640 1 -- 172.21.15.42:0/2161329869 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914c011790 con 0x7f91640cec40 2024-09-17T01:44:47.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.798+0000 7f915be00640 1 -- 172.21.15.42:0/2161329869 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f914c017070 con 0x7f91640cec40 2024-09-17T01:44:47.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.799+0000 7f915be00640 1 -- 172.21.15.42:0/2161329869 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914c011cc0 con 0x7f91640cec40 2024-09-17T01:44:47.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.799+0000 7f916a600640 1 -- 172.21.15.42:0/2161329869 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9164140ce0 con 0x7f91640cec40 2024-09-17T01:44:47.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.799+0000 7f916a600640 1 -- 172.21.15.42:0/2161329869 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91641412a0 con 0x7f91640cec40 2024-09-17T01:44:47.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.800+0000 7f916a600640 1 -- 172.21.15.42:0/2161329869 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9164140a50 con 0x7f91640cec40 2024-09-17T01:44:47.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.801+0000 7f915be00640 1 -- 172.21.15.42:0/2161329869 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f914c005020 con 0x7f91640cec40 2024-09-17T01:44:47.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.802+0000 7f915be00640 1 --2- 172.21.15.42:0/2161329869 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9140078b90 0x7f914007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:47.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.802+0000 7f915be00640 1 -- 172.21.15.42:0/2161329869 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5709+0+0 (secure 0 0 0) 0x7f914c09b320 con 0x7f91640cec40 2024-09-17T01:44:47.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.803+0000 7f9163400640 1 --2- 172.21.15.42:0/2161329869 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9140078b90 0x7f914007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:47.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.804+0000 7f9163400640 1 --2- 172.21.15.42:0/2161329869 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9140078b90 0x7f914007b0a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9154034000 tx=0x7f9154004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:47.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:47.805+0000 7f915be00640 1 -- 172.21.15.42:0/2161329869 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f914c021020 con 0x7f91640cec40 2024-09-17T01:44:48.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:48.037+0000 7f916a600640 1 -- 172.21.15.42:0/2161329869 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f916415cec0 con 0x7f91640cec40 2024-09-17T01:44:48.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:48.037+0000 7f915be00640 1 -- 172.21.15.42:0/2161329869 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5230 (secure 0 0 0) 0x7f914c063800 con 0x7f91640cec40 2024-09-17T01:44:48.036 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:44:48.036 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":125,"btime":"2024-09-17T01:44:10:057034+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8872,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3393274334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3393274334},{"type":"v1","addr":"172.21.15.43:6836","nonce":3393274334}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":8875,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2869136532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2869136532},{"type":"v1","addr":"172.21.15.43:6837","nonce":2869136532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":9513,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/297557585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":297557585},{"type":"v1","addr":"172.21.15.42:6834","nonce":297557585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":119}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:44:06.556661+0000","modified":"2024-09-17T01:44:09.563813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9516},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9516":{"gid":9516,"name":"c","rank":0,"incarnation":121,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1557345672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1557345672},{"type":"v1","addr":"172.21.15.42:6835","nonce":1557345672}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9516,"qdb_cluster":[9516]},"id":11}]} 2024-09-17T01:44:48.036 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 125 2024-09-17T01:44:48.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:48.040+0000 7f916a600640 1 -- 172.21.15.42:0/2161329869 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9140078b90 msgr2=0x7f914007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:48.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:48.040+0000 7f916a600640 1 --2- 172.21.15.42:0/2161329869 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9140078b90 0x7f914007b0a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9154034000 tx=0x7f9154004730 comp rx=0 tx=0).stop 2024-09-17T01:44:48.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:48.040+0000 7f916a600640 1 -- 172.21.15.42:0/2161329869 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91640cec40 msgr2=0x7f916412f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:48.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:48.040+0000 7f916a600640 1 --2- 172.21.15.42:0/2161329869 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91640cec40 0x7f916412f6c0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f914c00c430 tx=0x7f914c00c8f0 comp rx=0 tx=0).stop 2024-09-17T01:44:48.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:48.040+0000 7f916a600640 1 -- 172.21.15.42:0/2161329869 shutdown_connections 2024-09-17T01:44:48.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:48.040+0000 7f916a600640 1 --2- 172.21.15.42:0/2161329869 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9140078b90 0x7f914007b0a0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:48.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:48.040+0000 7f916a600640 1 --2- 172.21.15.42:0/2161329869 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9164142f40 0x7f9164159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:48.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:48.040+0000 7f916a600640 1 --2- 172.21.15.42:0/2161329869 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91640cec40 0x7f916412f6c0 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:48.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:48.040+0000 7f916a600640 1 --2- 172.21.15.42:0/2161329869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91640b3550 0x7f9164141d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:48.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:48.040+0000 7f916a600640 1 -- 172.21.15.42:0/2161329869 >> 172.21.15.42:0/2161329869 conn(0x7f91640b2930 msgr2=0x7f9164073700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:48.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:48.040+0000 7f916a600640 1 -- 172.21.15.42:0/2161329869 shutdown_connections 2024-09-17T01:44:48.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:48.040+0000 7f916a600640 1 -- 172.21.15.42:0/2161329869 wait complete. 2024-09-17T01:44:48.064 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-17T01:44:51.487 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:44:51.492 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:44:53.065 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:44:53.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.307+0000 7f2162e00640 1 -- 172.21.15.42:0/1095801483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f215c06ee90 msgr2=0x7f215c15f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:53.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.307+0000 7f2162e00640 1 --2- 172.21.15.42:0/1095801483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f215c06ee90 0x7f215c15f200 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f214c009830 tx=0x7f214c02a480 comp rx=0 tx=0).stop 2024-09-17T01:44:53.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.307+0000 7f2162e00640 1 -- 172.21.15.42:0/1095801483 shutdown_connections 2024-09-17T01:44:53.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.307+0000 7f2162e00640 1 --2- 172.21.15.42:0/1095801483 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f215c06f2a0 0x7f215c06d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:53.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.307+0000 7f2162e00640 1 --2- 172.21.15.42:0/1095801483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f215c06ee90 0x7f215c15f200 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:53.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.307+0000 7f2162e00640 1 -- 172.21.15.42:0/1095801483 >> 172.21.15.42:0/1095801483 conn(0x7f215c0b2930 msgr2=0x7f215c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:53.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.308+0000 7f2162e00640 1 -- 172.21.15.42:0/1095801483 shutdown_connections 2024-09-17T01:44:53.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.308+0000 7f2162e00640 1 -- 172.21.15.42:0/1095801483 wait complete. 2024-09-17T01:44:53.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.310+0000 7f2162e00640 1 Processor -- start 2024-09-17T01:44:53.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.310+0000 7f2162e00640 1 -- start start 2024-09-17T01:44:53.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.311+0000 7f2162e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f215c06db50 0x7f215c1f6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:53.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.311+0000 7f2162e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f215c06ee90 0x7f215c0b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:53.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.311+0000 7f2162e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f215c06f2a0 0x7f215c155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:53.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.311+0000 7f2162e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f215c0cef40 con 0x7f215c06db50 2024-09-17T01:44:53.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.311+0000 7f2162e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f215c074710 con 0x7f215c06ee90 2024-09-17T01:44:53.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.311+0000 7f2162e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f215c0cf0c0 con 0x7f215c06f2a0 2024-09-17T01:44:53.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.312+0000 7f215be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f215c06db50 0x7f215c1f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:53.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.312+0000 7f215be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f215c06db50 0x7f215c1f6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49652/0 (socket says 172.21.15.42:49652) 2024-09-17T01:44:53.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.312+0000 7f215be00640 1 -- 172.21.15.42:0/2407137005 learned_addr learned my addr 172.21.15.42:0/2407137005 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:53.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.312+0000 7f2153400640 1 --2- 172.21.15.42:0/2407137005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f215c06ee90 0x7f215c0b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:53.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.312+0000 7f2160e00640 1 --2- 172.21.15.42:0/2407137005 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f215c06f2a0 0x7f215c155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:53.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.312+0000 7f215be00640 1 -- 172.21.15.42:0/2407137005 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f215c06f2a0 msgr2=0x7f215c155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:53.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.312+0000 7f215be00640 1 --2- 172.21.15.42:0/2407137005 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f215c06f2a0 0x7f215c155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:53.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.312+0000 7f215be00640 1 -- 172.21.15.42:0/2407137005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f215c06ee90 msgr2=0x7f215c0b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:53.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.312+0000 7f215be00640 1 --2- 172.21.15.42:0/2407137005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f215c06ee90 0x7f215c0b0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:53.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.312+0000 7f215be00640 1 -- 172.21.15.42:0/2407137005 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215c1f6990 con 0x7f215c06db50 2024-09-17T01:44:53.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.312+0000 7f2153400640 1 --2- 172.21.15.42:0/2407137005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f215c06ee90 0x7f215c0b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:44:53.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.312+0000 7f2160e00640 1 --2- 172.21.15.42:0/2407137005 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f215c06f2a0 0x7f215c155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:44:53.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.312+0000 7f215be00640 1 --2- 172.21.15.42:0/2407137005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f215c06db50 0x7f215c1f6120 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f214c000c00 tx=0x7f214c033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:53.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.313+0000 7f2158c00640 1 -- 172.21.15.42:0/2407137005 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c005c90 con 0x7f215c06db50 2024-09-17T01:44:53.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.313+0000 7f2158c00640 1 -- 172.21.15.42:0/2407137005 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f214c031e50 con 0x7f215c06db50 2024-09-17T01:44:53.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.313+0000 7f2158c00640 1 -- 172.21.15.42:0/2407137005 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c033310 con 0x7f215c06db50 2024-09-17T01:44:53.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.313+0000 7f2162e00640 1 -- 172.21.15.42:0/2407137005 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215c1f6c70 con 0x7f215c06db50 2024-09-17T01:44:53.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.313+0000 7f2162e00640 1 -- 172.21.15.42:0/2407137005 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f215c1f7230 con 0x7f215c06db50 2024-09-17T01:44:53.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.314+0000 7f2162e00640 1 -- 172.21.15.42:0/2407137005 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f215c15f200 con 0x7f215c06db50 2024-09-17T01:44:53.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.315+0000 7f2158c00640 1 -- 172.21.15.42:0/2407137005 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f214c0334b0 con 0x7f215c06db50 2024-09-17T01:44:53.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.316+0000 7f2158c00640 1 --2- 172.21.15.42:0/2407137005 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2138078b90 0x7f213807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:53.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.316+0000 7f2158c00640 1 -- 172.21.15.42:0/2407137005 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5738+0+0 (secure 0 0 0) 0x7f214c0bc2d0 con 0x7f215c06db50 2024-09-17T01:44:53.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.317+0000 7f2153400640 1 --2- 172.21.15.42:0/2407137005 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2138078b90 0x7f213807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:53.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.317+0000 7f2153400640 1 --2- 172.21.15.42:0/2407137005 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2138078b90 0x7f213807b0a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2144005fd0 tx=0x7f214400f360 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:53.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.321+0000 7f2158c00640 1 -- 172.21.15.42:0/2407137005 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f214c03f030 con 0x7f215c06db50 2024-09-17T01:44:53.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.555+0000 7f2162e00640 1 -- 172.21.15.42:0/2407137005 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f215c06a170 con 0x7f215c06db50 2024-09-17T01:44:53.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.556+0000 7f2158c00640 1 -- 172.21.15.42:0/2407137005 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5230 (secure 0 0 0) 0x7f214c0846e0 con 0x7f215c06db50 2024-09-17T01:44:53.554 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:44:53.554 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":125,"btime":"2024-09-17T01:44:10:057034+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8872,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3393274334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3393274334},{"type":"v1","addr":"172.21.15.43:6836","nonce":3393274334}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":8875,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2869136532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2869136532},{"type":"v1","addr":"172.21.15.43:6837","nonce":2869136532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":9513,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/297557585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":297557585},{"type":"v1","addr":"172.21.15.42:6834","nonce":297557585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":119}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:44:06.556661+0000","modified":"2024-09-17T01:44:09.563813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9516},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9516":{"gid":9516,"name":"c","rank":0,"incarnation":121,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1557345672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1557345672},{"type":"v1","addr":"172.21.15.42:6835","nonce":1557345672}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9516,"qdb_cluster":[9516]},"id":11}]} 2024-09-17T01:44:53.554 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 125 2024-09-17T01:44:53.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.558+0000 7f2162e00640 1 -- 172.21.15.42:0/2407137005 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2138078b90 msgr2=0x7f213807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:53.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.558+0000 7f2162e00640 1 --2- 172.21.15.42:0/2407137005 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2138078b90 0x7f213807b0a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2144005fd0 tx=0x7f214400f360 comp rx=0 tx=0).stop 2024-09-17T01:44:53.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.558+0000 7f2162e00640 1 -- 172.21.15.42:0/2407137005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f215c06db50 msgr2=0x7f215c1f6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:53.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.558+0000 7f2162e00640 1 --2- 172.21.15.42:0/2407137005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f215c06db50 0x7f215c1f6120 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f214c000c00 tx=0x7f214c033c90 comp rx=0 tx=0).stop 2024-09-17T01:44:53.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.558+0000 7f2162e00640 1 -- 172.21.15.42:0/2407137005 shutdown_connections 2024-09-17T01:44:53.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.558+0000 7f2162e00640 1 --2- 172.21.15.42:0/2407137005 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2138078b90 0x7f213807b0a0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:53.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.558+0000 7f2162e00640 1 --2- 172.21.15.42:0/2407137005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f215c06ee90 0x7f215c0b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:53.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.558+0000 7f2162e00640 1 --2- 172.21.15.42:0/2407137005 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f215c06f2a0 0x7f215c155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:53.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.558+0000 7f2162e00640 1 --2- 172.21.15.42:0/2407137005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f215c06db50 0x7f215c1f6120 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:53.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.558+0000 7f2162e00640 1 -- 172.21.15.42:0/2407137005 >> 172.21.15.42:0/2407137005 conn(0x7f215c0b2930 msgr2=0x7f215c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:53.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.558+0000 7f2162e00640 1 -- 172.21.15.42:0/2407137005 shutdown_connections 2024-09-17T01:44:53.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:53.558+0000 7f2162e00640 1 -- 172.21.15.42:0/2407137005 wait complete. 2024-09-17T01:44:53.578 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-17T01:44:58.579 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:44:58.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.820+0000 7f1dc4000640 1 -- 172.21.15.42:0/1094351293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dbc15cb80 msgr2=0x7f1dbc152710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:58.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.820+0000 7f1dc4000640 1 --2- 172.21.15.42:0/1094351293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dbc15cb80 0x7f1dbc152710 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f1db0009830 tx=0x7f1db002a520 comp rx=0 tx=0).stop 2024-09-17T01:44:58.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.820+0000 7f1dc4000640 1 -- 172.21.15.42:0/1094351293 shutdown_connections 2024-09-17T01:44:58.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.820+0000 7f1dc4000640 1 --2- 172.21.15.42:0/1094351293 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1dbc06d430 0x7f1dbc06d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:58.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.820+0000 7f1dc4000640 1 --2- 172.21.15.42:0/1094351293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dbc15cb80 0x7f1dbc152710 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:58.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.820+0000 7f1dc4000640 1 -- 172.21.15.42:0/1094351293 >> 172.21.15.42:0/1094351293 conn(0x7f1dbc0b2930 msgr2=0x7f1dbc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:58.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.820+0000 7f1dc4000640 1 -- 172.21.15.42:0/1094351293 shutdown_connections 2024-09-17T01:44:58.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.820+0000 7f1dc4000640 1 -- 172.21.15.42:0/1094351293 wait complete. 2024-09-17T01:44:58.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.822+0000 7f1dc4000640 1 Processor -- start 2024-09-17T01:44:58.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.822+0000 7f1dc4000640 1 -- start start 2024-09-17T01:44:58.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.824+0000 7f1dc4000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1dbc06d430 0x7f1dbc1f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:58.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.824+0000 7f1dc4000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dbc15cb80 0x7f1dbc0aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:58.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.824+0000 7f1dc4000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dbc15f480 0x7f1dbc144680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:58.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.824+0000 7f1dc4000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1dbc073820 con 0x7f1dbc15f480 2024-09-17T01:44:58.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.824+0000 7f1dc4000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1dbc0736a0 con 0x7f1dbc15cb80 2024-09-17T01:44:58.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.824+0000 7f1dc4000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1dbc0739a0 con 0x7f1dbc06d430 2024-09-17T01:44:58.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.824+0000 7f1dc2000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dbc15f480 0x7f1dbc144680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:58.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.824+0000 7f1dc1600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1dbc06d430 0x7f1dbc1f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:58.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.824+0000 7f1dc2000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dbc15f480 0x7f1dbc144680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40022/0 (socket says 172.21.15.42:40022) 2024-09-17T01:44:58.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.824+0000 7f1dc1600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1dbc06d430 0x7f1dbc1f5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:58190/0 (socket says 172.21.15.42:58190) 2024-09-17T01:44:58.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.824+0000 7f1dc2000640 1 -- 172.21.15.42:0/3931195520 learned_addr learned my addr 172.21.15.42:0/3931195520 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:44:58.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.824+0000 7f1dc0c00640 1 --2- 172.21.15.42:0/3931195520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dbc15cb80 0x7f1dbc0aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:58.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.825+0000 7f1dc2000640 1 -- 172.21.15.42:0/3931195520 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1dbc06d430 msgr2=0x7f1dbc1f5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:58.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.825+0000 7f1dc2000640 1 --2- 172.21.15.42:0/3931195520 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1dbc06d430 0x7f1dbc1f5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:58.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.825+0000 7f1dc2000640 1 -- 172.21.15.42:0/3931195520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dbc15cb80 msgr2=0x7f1dbc0aef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:58.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.825+0000 7f1dc2000640 1 --2- 172.21.15.42:0/3931195520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dbc15cb80 0x7f1dbc0aef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:58.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.825+0000 7f1dc2000640 1 -- 172.21.15.42:0/3931195520 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dbc146fd0 con 0x7f1dbc15f480 2024-09-17T01:44:58.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.825+0000 7f1dc2000640 1 --2- 172.21.15.42:0/3931195520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dbc15f480 0x7f1dbc144680 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f1db400c760 tx=0x7f1db400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:58.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.825+0000 7f1db9600640 1 -- 172.21.15.42:0/3931195520 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db4003b70 con 0x7f1dbc15f480 2024-09-17T01:44:58.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.825+0000 7f1db9600640 1 -- 172.21.15.42:0/3931195520 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1db4003d10 con 0x7f1dbc15f480 2024-09-17T01:44:58.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.825+0000 7f1db9600640 1 -- 172.21.15.42:0/3931195520 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db4005330 con 0x7f1dbc15f480 2024-09-17T01:44:58.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.825+0000 7f1dc4000640 1 -- 172.21.15.42:0/3931195520 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dbc1f6420 con 0x7f1dbc15f480 2024-09-17T01:44:58.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.825+0000 7f1dc4000640 1 -- 172.21.15.42:0/3931195520 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dbc1f69e0 con 0x7f1dbc15f480 2024-09-17T01:44:58.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.826+0000 7f1dc4000640 1 -- 172.21.15.42:0/3931195520 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dbc1f6190 con 0x7f1dbc15f480 2024-09-17T01:44:58.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.828+0000 7f1db9600640 1 -- 172.21.15.42:0/3931195520 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1db40054d0 con 0x7f1dbc15f480 2024-09-17T01:44:58.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.829+0000 7f1db9600640 1 --2- 172.21.15.42:0/3931195520 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1d9c078b90 0x7f1d9c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:58.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.829+0000 7f1db9600640 1 -- 172.21.15.42:0/3931195520 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5738+0+0 (secure 0 0 0) 0x7f1db409a9d0 con 0x7f1dbc15f480 2024-09-17T01:44:58.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.829+0000 7f1dc1600640 1 --2- 172.21.15.42:0/3931195520 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1d9c078b90 0x7f1d9c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:58.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.830+0000 7f1dc1600640 1 --2- 172.21.15.42:0/3931195520 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1d9c078b90 0x7f1d9c07b0a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1db0034000 tx=0x7f1db0004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:58.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:58.833+0000 7f1db9600640 1 -- 172.21.15.42:0/3931195520 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1dbc15be20 con 0x7f1dbc15f480 2024-09-17T01:44:59.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:59.065+0000 7f1dc4000640 1 -- 172.21.15.42:0/3931195520 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1dbc073ec0 con 0x7f1dbc15f480 2024-09-17T01:44:59.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:59.065+0000 7f1db9600640 1 -- 172.21.15.42:0/3931195520 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) ==== 95+0+5230 (secure 0 0 0) 0x7f1db4062790 con 0x7f1dbc15f480 2024-09-17T01:44:59.063 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:44:59.063 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":125,"btime":"2024-09-17T01:44:10:057034+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8872,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3393274334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3393274334},{"type":"v1","addr":"172.21.15.43:6836","nonce":3393274334}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":8875,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2869136532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2869136532},{"type":"v1","addr":"172.21.15.43:6837","nonce":2869136532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":9513,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/297557585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":297557585},{"type":"v1","addr":"172.21.15.42:6834","nonce":297557585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":119}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:44:06.556661+0000","modified":"2024-09-17T01:44:09.563813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9516},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9516":{"gid":9516,"name":"c","rank":0,"incarnation":121,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1557345672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1557345672},{"type":"v1","addr":"172.21.15.42:6835","nonce":1557345672}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9516,"qdb_cluster":[9516]},"id":11}]} 2024-09-17T01:44:59.064 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 125 2024-09-17T01:44:59.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:59.068+0000 7f1dc4000640 1 -- 172.21.15.42:0/3931195520 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1d9c078b90 msgr2=0x7f1d9c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:59.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:59.068+0000 7f1dc4000640 1 --2- 172.21.15.42:0/3931195520 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1d9c078b90 0x7f1d9c07b0a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1db0034000 tx=0x7f1db0004730 comp rx=0 tx=0).stop 2024-09-17T01:44:59.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:59.068+0000 7f1dc4000640 1 -- 172.21.15.42:0/3931195520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dbc15f480 msgr2=0x7f1dbc144680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:59.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:59.068+0000 7f1dc4000640 1 --2- 172.21.15.42:0/3931195520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dbc15f480 0x7f1dbc144680 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f1db400c760 tx=0x7f1db400cb60 comp rx=0 tx=0).stop 2024-09-17T01:44:59.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:59.068+0000 7f1dc4000640 1 -- 172.21.15.42:0/3931195520 shutdown_connections 2024-09-17T01:44:59.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:59.068+0000 7f1dc4000640 1 --2- 172.21.15.42:0/3931195520 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1d9c078b90 0x7f1d9c07b0a0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:59.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:59.068+0000 7f1dc4000640 1 --2- 172.21.15.42:0/3931195520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1dbc15cb80 0x7f1dbc0aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:59.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:59.068+0000 7f1dc4000640 1 --2- 172.21.15.42:0/3931195520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1dbc15f480 0x7f1dbc144680 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:59.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:59.068+0000 7f1dc4000640 1 --2- 172.21.15.42:0/3931195520 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1dbc06d430 0x7f1dbc1f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:59.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:59.068+0000 7f1dc4000640 1 -- 172.21.15.42:0/3931195520 >> 172.21.15.42:0/3931195520 conn(0x7f1dbc0b2930 msgr2=0x7f1dbc075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:59.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:59.068+0000 7f1dc4000640 1 -- 172.21.15.42:0/3931195520 shutdown_connections 2024-09-17T01:44:59.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:44:59.068+0000 7f1dc4000640 1 -- 172.21.15.42:0/3931195520 wait complete. 2024-09-17T01:44:59.091 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-17T01:45:04.092 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:45:04.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.332+0000 7fbac2c00640 1 -- 172.21.15.42:0/2374504130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbabc06db40 msgr2=0x7fbabc06fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:04.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.332+0000 7fbac2c00640 1 --2- 172.21.15.42:0/2374504130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbabc06db40 0x7fbabc06fe40 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fbab4005fd0 tx=0x7fbab402aa90 comp rx=0 tx=0).stop 2024-09-17T01:45:04.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.332+0000 7fbac2c00640 1 -- 172.21.15.42:0/2374504130 shutdown_connections 2024-09-17T01:45:04.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.332+0000 7fbac2c00640 1 --2- 172.21.15.42:0/2374504130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbabc06db40 0x7fbabc06fe40 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:04.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.332+0000 7fbac2c00640 1 --2- 172.21.15.42:0/2374504130 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbabc072e00 0x7fbabc15bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:04.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.332+0000 7fbac2c00640 1 -- 172.21.15.42:0/2374504130 >> 172.21.15.42:0/2374504130 conn(0x7fbabc0b2930 msgr2=0x7fbabc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:04.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.332+0000 7fbac2c00640 1 -- 172.21.15.42:0/2374504130 shutdown_connections 2024-09-17T01:45:04.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.332+0000 7fbac2c00640 1 -- 172.21.15.42:0/2374504130 wait complete. 2024-09-17T01:45:04.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.334+0000 7fbac2c00640 1 Processor -- start 2024-09-17T01:45:04.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.334+0000 7fbac2c00640 1 -- start start 2024-09-17T01:45:04.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.336+0000 7fbac2c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbabc072e00 0x7fbabc1f77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:04.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.336+0000 7fbac2c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbabc15f190 0x7fbabc153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:04.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.336+0000 7fbac2c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbabc14cdb0 0x7fbabc14a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:04.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.336+0000 7fbac2c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbabc151520 con 0x7fbabc14cdb0 2024-09-17T01:45:04.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.336+0000 7fbac2c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbabc070740 con 0x7fbabc15f190 2024-09-17T01:45:04.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.336+0000 7fbac2c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbabc1516a0 con 0x7fbabc072e00 2024-09-17T01:45:04.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.336+0000 7fbac0c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbabc14cdb0 0x7fbabc14a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:04.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.336+0000 7fbac0c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbabc14cdb0 0x7fbabc14a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40040/0 (socket says 172.21.15.42:40040) 2024-09-17T01:45:04.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.336+0000 7fbac0c00640 1 -- 172.21.15.42:0/1387347116 learned_addr learned my addr 172.21.15.42:0/1387347116 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:04.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.336+0000 7fbabbe00640 1 --2- 172.21.15.42:0/1387347116 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbabc072e00 0x7fbabc1f77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:04.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.336+0000 7fbab3e00640 1 --2- 172.21.15.42:0/1387347116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbabc15f190 0x7fbabc153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:04.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.337+0000 7fbac0c00640 1 -- 172.21.15.42:0/1387347116 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbabc072e00 msgr2=0x7fbabc1f77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:04.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.337+0000 7fbac0c00640 1 --2- 172.21.15.42:0/1387347116 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbabc072e00 0x7fbabc1f77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:04.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.337+0000 7fbac0c00640 1 -- 172.21.15.42:0/1387347116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbabc15f190 msgr2=0x7fbabc153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:04.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.337+0000 7fbac0c00640 1 --2- 172.21.15.42:0/1387347116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbabc15f190 0x7fbabc153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:04.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.337+0000 7fbac0c00640 1 -- 172.21.15.42:0/1387347116 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbabc1f6d50 con 0x7fbabc14cdb0 2024-09-17T01:45:04.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.337+0000 7fbac0c00640 1 --2- 172.21.15.42:0/1387347116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbabc14cdb0 0x7fbabc14a120 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009d90 tx=0x7fbab4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:04.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.337+0000 7fbab8c00640 1 -- 172.21.15.42:0/1387347116 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab4044070 con 0x7fbabc14cdb0 2024-09-17T01:45:04.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.337+0000 7fbab8c00640 1 -- 172.21.15.42:0/1387347116 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbab4003e00 con 0x7fbabc14cdb0 2024-09-17T01:45:04.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.337+0000 7fbab8c00640 1 -- 172.21.15.42:0/1387347116 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab40044b0 con 0x7fbabc14cdb0 2024-09-17T01:45:04.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.337+0000 7fbac2c00640 1 -- 172.21.15.42:0/1387347116 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbabc1546e0 con 0x7fbabc14cdb0 2024-09-17T01:45:04.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.337+0000 7fbac2c00640 1 -- 172.21.15.42:0/1387347116 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbabc1f72d0 con 0x7fbabc14cdb0 2024-09-17T01:45:04.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.338+0000 7fbac2c00640 1 -- 172.21.15.42:0/1387347116 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbabc06fe40 con 0x7fbabc14cdb0 2024-09-17T01:45:04.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.340+0000 7fbab8c00640 1 -- 172.21.15.42:0/1387347116 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbab4047070 con 0x7fbabc14cdb0 2024-09-17T01:45:04.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.341+0000 7fbab8c00640 1 --2- 172.21.15.42:0/1387347116 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fba98078b90 0x7fba9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:04.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.341+0000 7fbab8c00640 1 -- 172.21.15.42:0/1387347116 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5738+0+0 (secure 0 0 0) 0x7fbab40bbca0 con 0x7fbabc14cdb0 2024-09-17T01:45:04.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.341+0000 7fbabbe00640 1 --2- 172.21.15.42:0/1387347116 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fba98078b90 0x7fba9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:04.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.342+0000 7fbabbe00640 1 --2- 172.21.15.42:0/1387347116 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fba98078b90 0x7fba9807b0a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fbaac009b30 tx=0x7fbaac005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:04.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.346+0000 7fbab8c00640 1 -- 172.21.15.42:0/1387347116 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbab4032030 con 0x7fbabc14cdb0 2024-09-17T01:45:04.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.585+0000 7fbac2c00640 1 -- 172.21.15.42:0/1387347116 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbabc06a170 con 0x7fbabc14cdb0 2024-09-17T01:45:04.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.586+0000 7fbab8c00640 1 -- 172.21.15.42:0/1387347116 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 126 v126) ==== 95+0+4399 (secure 0 0 0) 0x7fbab40098b0 con 0x7fbabc14cdb0 2024-09-17T01:45:04.584 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:45:04.584 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":126,"btime":"2024-09-17T01:45:04:547328+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8872,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3393274334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3393274334},{"type":"v1","addr":"172.21.15.43:6836","nonce":3393274334}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":8875,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2869136532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2869136532},{"type":"v1","addr":"172.21.15.43:6837","nonce":2869136532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120}],"filesystems":[{"mdsmap":{"epoch":126,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:44:06.556661+0000","modified":"2024-09-17T01:45:04.547324+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":163,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9513},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9513":{"gid":9513,"name":"a","rank":0,"incarnation":126,"state":"up:replay","state_seq":1,"addr":"172.21.15.42:6834/297557585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":297557585},{"type":"v1","addr":"172.21.15.42:6834","nonce":297557585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":11}]} 2024-09-17T01:45:04.585 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 126 2024-09-17T01:45:04.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.589+0000 7fbac2c00640 1 -- 172.21.15.42:0/1387347116 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fba98078b90 msgr2=0x7fba9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:04.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.589+0000 7fbac2c00640 1 --2- 172.21.15.42:0/1387347116 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fba98078b90 0x7fba9807b0a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fbaac009b30 tx=0x7fbaac005f90 comp rx=0 tx=0).stop 2024-09-17T01:45:04.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.589+0000 7fbac2c00640 1 -- 172.21.15.42:0/1387347116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbabc14cdb0 msgr2=0x7fbabc14a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:04.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.589+0000 7fbac2c00640 1 --2- 172.21.15.42:0/1387347116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbabc14cdb0 0x7fbabc14a120 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fbab4009d90 tx=0x7fbab4003c10 comp rx=0 tx=0).stop 2024-09-17T01:45:04.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.589+0000 7fbac2c00640 1 -- 172.21.15.42:0/1387347116 shutdown_connections 2024-09-17T01:45:04.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.589+0000 7fbac2c00640 1 --2- 172.21.15.42:0/1387347116 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fba98078b90 0x7fba9807b0a0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:04.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.589+0000 7fbac2c00640 1 --2- 172.21.15.42:0/1387347116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbabc15f190 0x7fbabc153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:04.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.589+0000 7fbac2c00640 1 --2- 172.21.15.42:0/1387347116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbabc14cdb0 0x7fbabc14a120 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:04.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.589+0000 7fbac2c00640 1 --2- 172.21.15.42:0/1387347116 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbabc072e00 0x7fbabc1f77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:04.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.589+0000 7fbac2c00640 1 -- 172.21.15.42:0/1387347116 >> 172.21.15.42:0/1387347116 conn(0x7fbabc0b2930 msgr2=0x7fbabc06f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:04.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.590+0000 7fbac2c00640 1 -- 172.21.15.42:0/1387347116 shutdown_connections 2024-09-17T01:45:04.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:04.590+0000 7fbac2c00640 1 -- 172.21.15.42:0/1387347116 wait complete. 2024-09-17T01:45:04.611 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-17T01:45:08.013 INFO:tasks.ceph.mds.a.smithi042.stderr:2024-09-17T01:45:08.015+0000 7f0db2800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:45:09.611 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:45:09.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.852+0000 7f1005c00640 1 -- 172.21.15.42:0/3291644576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10000cec40 msgr2=0x7f10000cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:09.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.852+0000 7f1005c00640 1 --2- 172.21.15.42:0/3291644576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10000cec40 0x7f10000cf050 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8005fd0 tx=0x7f0ff802a8b0 comp rx=0 tx=0).stop 2024-09-17T01:45:09.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.852+0000 7f1005c00640 1 -- 172.21.15.42:0/3291644576 shutdown_connections 2024-09-17T01:45:09.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.852+0000 7f1005c00640 1 --2- 172.21.15.42:0/3291644576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10000cec40 0x7f10000cf050 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:09.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.852+0000 7f1005c00640 1 -- 172.21.15.42:0/3291644576 >> 172.21.15.42:0/3291644576 conn(0x7f10000b2930 msgr2=0x7f100006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:09.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.852+0000 7f1005c00640 1 -- 172.21.15.42:0/3291644576 shutdown_connections 2024-09-17T01:45:09.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.852+0000 7f1005c00640 1 -- 172.21.15.42:0/3291644576 wait complete. 2024-09-17T01:45:09.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.854+0000 7f1005c00640 1 Processor -- start 2024-09-17T01:45:09.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.854+0000 7f1005c00640 1 -- start start 2024-09-17T01:45:09.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.856+0000 7f1005c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10000b3550 0x7f10001f6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:09.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.856+0000 7f1005c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10000cec40 0x7f10000cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:09.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.856+0000 7f1005c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1000142f40 0x7f1000141cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:09.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.856+0000 7f1005c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f100006d900 con 0x7f1000142f40 2024-09-17T01:45:09.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.856+0000 7f1005c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f100006d780 con 0x7f10000b3550 2024-09-17T01:45:09.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.856+0000 7f1005c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f100006da80 con 0x7f10000cec40 2024-09-17T01:45:09.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.856+0000 7f0fff400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1000142f40 0x7f1000141cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:09.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.856+0000 7f0fff400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1000142f40 0x7f1000141cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34104/0 (socket says 172.21.15.42:34104) 2024-09-17T01:45:09.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.856+0000 7f0fff400640 1 -- 172.21.15.42:0/2289075199 learned_addr learned my addr 172.21.15.42:0/2289075199 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:09.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.856+0000 7f0ffea00640 1 --2- 172.21.15.42:0/2289075199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10000b3550 0x7f10001f6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:09.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.856+0000 7f0ff7e00640 1 --2- 172.21.15.42:0/2289075199 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10000cec40 0x7f10000cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:09.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.857+0000 7f0fff400640 1 -- 172.21.15.42:0/2289075199 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10000cec40 msgr2=0x7f10000cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:09.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.857+0000 7f0fff400640 1 --2- 172.21.15.42:0/2289075199 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10000cec40 0x7f10000cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:09.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.857+0000 7f0fff400640 1 -- 172.21.15.42:0/2289075199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10000b3550 msgr2=0x7f10001f6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:09.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.857+0000 7f0fff400640 1 --2- 172.21.15.42:0/2289075199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10000b3550 0x7f10001f6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:09.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.857+0000 7f0fff400640 1 -- 172.21.15.42:0/2289075199 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1000141300 con 0x7f1000142f40 2024-09-17T01:45:09.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.857+0000 7f0ff7e00640 1 --2- 172.21.15.42:0/2289075199 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10000cec40 0x7f10000cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:45:09.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.857+0000 7f0fff400640 1 --2- 172.21.15.42:0/2289075199 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1000142f40 0x7f1000141cb0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8009cd0 tx=0x7f0ff8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:09.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.857+0000 7f0ff6a00640 1 -- 172.21.15.42:0/2289075199 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8031da0 con 0x7f1000142f40 2024-09-17T01:45:09.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.857+0000 7f0ff6a00640 1 -- 172.21.15.42:0/2289075199 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ff8003e10 con 0x7f1000142f40 2024-09-17T01:45:09.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.857+0000 7f0ff6a00640 1 -- 172.21.15.42:0/2289075199 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8033330 con 0x7f1000142f40 2024-09-17T01:45:09.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.857+0000 7f1005c00640 1 -- 172.21.15.42:0/2289075199 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10001415e0 con 0x7f1000142f40 2024-09-17T01:45:09.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.857+0000 7f1005c00640 1 -- 172.21.15.42:0/2289075199 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f100015a020 con 0x7f1000142f40 2024-09-17T01:45:09.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.859+0000 7f1005c00640 1 -- 172.21.15.42:0/2289075199 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f100015a280 con 0x7f1000142f40 2024-09-17T01:45:09.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.860+0000 7f0ff6a00640 1 -- 172.21.15.42:0/2289075199 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0ff80334d0 con 0x7f1000142f40 2024-09-17T01:45:09.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.861+0000 7f0ff6a00640 1 --2- 172.21.15.42:0/2289075199 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0fdc078b90 0x7f0fdc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:09.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.861+0000 7f0ff6a00640 1 -- 172.21.15.42:0/2289075199 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5824+0+0 (secure 0 0 0) 0x7f0ff80bc320 con 0x7f1000142f40 2024-09-17T01:45:09.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.861+0000 7f0ffea00640 1 --2- 172.21.15.42:0/2289075199 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0fdc078b90 0x7f0fdc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:09.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.862+0000 7f0ffea00640 1 --2- 172.21.15.42:0/2289075199 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0fdc078b90 0x7f0fdc07b0a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0001720 tx=0x7f0ff0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:09.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:09.866+0000 7f0ff6a00640 1 -- 172.21.15.42:0/2289075199 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0ff803f030 con 0x7f1000142f40 2024-09-17T01:45:10.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.098+0000 7f1005c00640 1 -- 172.21.15.42:0/2289075199 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10000cf050 con 0x7f1000142f40 2024-09-17T01:45:10.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.099+0000 7f0ff6a00640 1 -- 172.21.15.42:0/2289075199 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) ==== 95+0+4407 (secure 0 0 0) 0x7f0ff8084790 con 0x7f1000142f40 2024-09-17T01:45:10.097 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:45:10.097 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":129,"btime":"2024-09-17T01:45:07:563535+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8872,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3393274334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3393274334},{"type":"v1","addr":"172.21.15.43:6836","nonce":3393274334}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":8875,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2869136532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2869136532},{"type":"v1","addr":"172.21.15.43:6837","nonce":2869136532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120}],"filesystems":[{"mdsmap":{"epoch":129,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:44:06.556661+0000","modified":"2024-09-17T01:45:07.563524+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":163,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9513},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9513":{"gid":9513,"name":"a","rank":0,"incarnation":126,"state":"up:active","state_seq":19,"addr":"172.21.15.42:6834/297557585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":297557585},{"type":"v1","addr":"172.21.15.42:6834","nonce":297557585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9513,"qdb_cluster":[9513]},"id":11}]} 2024-09-17T01:45:10.097 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 129 2024-09-17T01:45:10.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.101+0000 7f1005c00640 1 -- 172.21.15.42:0/2289075199 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0fdc078b90 msgr2=0x7f0fdc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:10.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.101+0000 7f1005c00640 1 --2- 172.21.15.42:0/2289075199 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0fdc078b90 0x7f0fdc07b0a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0001720 tx=0x7f0ff0009040 comp rx=0 tx=0).stop 2024-09-17T01:45:10.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.101+0000 7f1005c00640 1 -- 172.21.15.42:0/2289075199 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1000142f40 msgr2=0x7f1000141cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:10.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.101+0000 7f1005c00640 1 --2- 172.21.15.42:0/2289075199 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1000142f40 0x7f1000141cb0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8009cd0 tx=0x7f0ff8003c20 comp rx=0 tx=0).stop 2024-09-17T01:45:10.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.101+0000 7f1005c00640 1 -- 172.21.15.42:0/2289075199 shutdown_connections 2024-09-17T01:45:10.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.101+0000 7f1005c00640 1 --2- 172.21.15.42:0/2289075199 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0fdc078b90 0x7f0fdc07b0a0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:10.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.101+0000 7f1005c00640 1 --2- 172.21.15.42:0/2289075199 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1000142f40 0x7f1000141cb0 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:10.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.101+0000 7f1005c00640 1 --2- 172.21.15.42:0/2289075199 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10000cec40 0x7f10000cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:10.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.101+0000 7f1005c00640 1 --2- 172.21.15.42:0/2289075199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10000b3550 0x7f10001f6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:10.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.101+0000 7f1005c00640 1 -- 172.21.15.42:0/2289075199 >> 172.21.15.42:0/2289075199 conn(0x7f10000b2930 msgr2=0x7f1000073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:10.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.102+0000 7f1005c00640 1 -- 172.21.15.42:0/2289075199 shutdown_connections 2024-09-17T01:45:10.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.102+0000 7f1005c00640 1 -- 172.21.15.42:0/2289075199 wait complete. 2024-09-17T01:45:10.125 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2024-09-17T01:45:10.125 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:45:10.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.354+0000 7efe06000640 1 -- 172.21.15.42:0/1084269830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efde4005280 msgr2=0x7efde400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:10.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.354+0000 7efe06000640 1 --2- 172.21.15.42:0/1084269830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efde4005280 0x7efde400b9c0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7efdf8009ed0 tx=0x7efde4005830 comp rx=0 tx=0).stop 2024-09-17T01:45:10.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.354+0000 7efe06000640 1 -- 172.21.15.42:0/1084269830 shutdown_connections 2024-09-17T01:45:10.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.354+0000 7efe06000640 1 --2- 172.21.15.42:0/1084269830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efde4005280 0x7efde400b9c0 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:10.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.354+0000 7efe06000640 1 -- 172.21.15.42:0/1084269830 >> 172.21.15.42:0/1084269830 conn(0x7efe000b2930 msgr2=0x7efe0006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:10.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.355+0000 7efe06000640 1 -- 172.21.15.42:0/1084269830 shutdown_connections 2024-09-17T01:45:10.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.355+0000 7efe06000640 1 -- 172.21.15.42:0/1084269830 wait complete. 2024-09-17T01:45:10.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.357+0000 7efe06000640 1 Processor -- start 2024-09-17T01:45:10.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.357+0000 7efe06000640 1 -- start start 2024-09-17T01:45:10.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.358+0000 7efe06000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efde4005280 0x7efe000b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:10.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.358+0000 7efe06000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe001f59c0 0x7efe0014fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:10.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.358+0000 7efe06000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe000b0960 0x7efe00150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:10.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.358+0000 7efe06000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efe00152890 con 0x7efde4005280 2024-09-17T01:45:10.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.358+0000 7efe06000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efe00152710 con 0x7efe001f59c0 2024-09-17T01:45:10.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.359+0000 7efe06000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7efe00152a10 con 0x7efe000b0960 2024-09-17T01:45:10.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.359+0000 7efdff400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efde4005280 0x7efe000b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:10.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.359+0000 7efdff400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efde4005280 0x7efe000b0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34120/0 (socket says 172.21.15.42:34120) 2024-09-17T01:45:10.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.359+0000 7efdff400640 1 -- 172.21.15.42:0/1047754228 learned_addr learned my addr 172.21.15.42:0/1047754228 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:10.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.359+0000 7efdf6a00640 1 --2- 172.21.15.42:0/1047754228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe001f59c0 0x7efe0014fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:10.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.359+0000 7efdffe00640 1 --2- 172.21.15.42:0/1047754228 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe000b0960 0x7efe00150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:10.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.359+0000 7efdff400640 1 -- 172.21.15.42:0/1047754228 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe000b0960 msgr2=0x7efe00150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:10.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.359+0000 7efdff400640 1 --2- 172.21.15.42:0/1047754228 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe000b0960 0x7efe00150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:10.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.359+0000 7efdff400640 1 -- 172.21.15.42:0/1047754228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe001f59c0 msgr2=0x7efe0014fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:10.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.359+0000 7efdff400640 1 --2- 172.21.15.42:0/1047754228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe001f59c0 0x7efe0014fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:10.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.359+0000 7efdff400640 1 -- 172.21.15.42:0/1047754228 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe001f8fb0 con 0x7efde4005280 2024-09-17T01:45:10.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.359+0000 7efdff400640 1 --2- 172.21.15.42:0/1047754228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efde4005280 0x7efe000b0420 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7efdf00065c0 tx=0x7efdf00066b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:10.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.360+0000 7efdf7e00640 1 -- 172.21.15.42:0/1047754228 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf0015070 con 0x7efde4005280 2024-09-17T01:45:10.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.360+0000 7efdf7e00640 1 -- 172.21.15.42:0/1047754228 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdf0011900 con 0x7efde4005280 2024-09-17T01:45:10.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.360+0000 7efe06000640 1 -- 172.21.15.42:0/1047754228 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe001f9290 con 0x7efde4005280 2024-09-17T01:45:10.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.360+0000 7efdf7e00640 1 -- 172.21.15.42:0/1047754228 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf0011d50 con 0x7efde4005280 2024-09-17T01:45:10.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.360+0000 7efe06000640 1 -- 172.21.15.42:0/1047754228 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe001f9850 con 0x7efde4005280 2024-09-17T01:45:10.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.361+0000 7efe06000640 1 -- 172.21.15.42:0/1047754228 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe0015f890 con 0x7efde4005280 2024-09-17T01:45:10.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.362+0000 7efdf7e00640 1 -- 172.21.15.42:0/1047754228 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efdf0018070 con 0x7efde4005280 2024-09-17T01:45:10.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.363+0000 7efdf7e00640 1 --2- 172.21.15.42:0/1047754228 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efddc078bc0 0x7efddc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:10.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.363+0000 7efdf7e00640 1 -- 172.21.15.42:0/1047754228 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5824+0+0 (secure 0 0 0) 0x7efdf009bce0 con 0x7efde4005280 2024-09-17T01:45:10.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.364+0000 7efdf6a00640 1 --2- 172.21.15.42:0/1047754228 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efddc078bc0 0x7efddc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:10.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.365+0000 7efdf6a00640 1 --2- 172.21.15.42:0/1047754228 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efddc078bc0 0x7efddc07b0d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7efe000cd690 tx=0x7efde8006b10 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:10.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.368+0000 7efdf7e00640 1 -- 172.21.15.42:0/1047754228 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efe0015be20 con 0x7efde4005280 2024-09-17T01:45:10.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.600+0000 7efe06000640 1 -- 172.21.15.42:0/1047754228 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe0006a170 con 0x7efde4005280 2024-09-17T01:45:10.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.600+0000 7efdf7e00640 1 -- 172.21.15.42:0/1047754228 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) ==== 95+0+4407 (secure 0 0 0) 0x7efdf0064030 con 0x7efde4005280 2024-09-17T01:45:10.599 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:45:10.599 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":129,"btime":"2024-09-17T01:45:07:563535+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8872,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3393274334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3393274334},{"type":"v1","addr":"172.21.15.43:6836","nonce":3393274334}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":8875,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2869136532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2869136532},{"type":"v1","addr":"172.21.15.43:6837","nonce":2869136532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120}],"filesystems":[{"mdsmap":{"epoch":129,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:44:06.556661+0000","modified":"2024-09-17T01:45:07.563524+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":163,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9513},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9513":{"gid":9513,"name":"a","rank":0,"incarnation":126,"state":"up:active","state_seq":19,"addr":"172.21.15.42:6834/297557585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":297557585},{"type":"v1","addr":"172.21.15.42:6834","nonce":297557585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9513,"qdb_cluster":[9513]},"id":11}]} 2024-09-17T01:45:10.599 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 129 2024-09-17T01:45:10.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.603+0000 7efe06000640 1 -- 172.21.15.42:0/1047754228 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efddc078bc0 msgr2=0x7efddc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:10.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.603+0000 7efe06000640 1 --2- 172.21.15.42:0/1047754228 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efddc078bc0 0x7efddc07b0d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7efe000cd690 tx=0x7efde8006b10 comp rx=0 tx=0).stop 2024-09-17T01:45:10.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.603+0000 7efe06000640 1 -- 172.21.15.42:0/1047754228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efde4005280 msgr2=0x7efe000b0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:10.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.603+0000 7efe06000640 1 --2- 172.21.15.42:0/1047754228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efde4005280 0x7efe000b0420 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7efdf00065c0 tx=0x7efdf00066b0 comp rx=0 tx=0).stop 2024-09-17T01:45:10.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.603+0000 7efe06000640 1 -- 172.21.15.42:0/1047754228 shutdown_connections 2024-09-17T01:45:10.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.603+0000 7efe06000640 1 --2- 172.21.15.42:0/1047754228 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efddc078bc0 0x7efddc07b0d0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:10.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.603+0000 7efe06000640 1 --2- 172.21.15.42:0/1047754228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe001f59c0 0x7efe0014fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:10.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.603+0000 7efe06000640 1 --2- 172.21.15.42:0/1047754228 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efe000b0960 0x7efe00150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:10.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.603+0000 7efe06000640 1 --2- 172.21.15.42:0/1047754228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efde4005280 0x7efe000b0420 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:10.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.603+0000 7efe06000640 1 -- 172.21.15.42:0/1047754228 >> 172.21.15.42:0/1047754228 conn(0x7efe000b2930 msgr2=0x7efe001eb250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:10.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.603+0000 7efe06000640 1 -- 172.21.15.42:0/1047754228 shutdown_connections 2024-09-17T01:45:10.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.603+0000 7efe06000640 1 -- 172.21.15.42:0/1047754228 wait complete. 2024-09-17T01:45:10.625 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-17T01:45:10.625 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:45:10.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.854+0000 7f2958200640 1 -- 172.21.15.42:0/3665742675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f295006db50 msgr2=0x7f2950073df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:10.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.854+0000 7f2958200640 1 --2- 172.21.15.42:0/3665742675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f295006db50 0x7f2950073df0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f2950072240 tx=0x7f294802aa30 comp rx=0 tx=0).stop 2024-09-17T01:45:10.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.854+0000 7f2958200640 1 -- 172.21.15.42:0/3665742675 shutdown_connections 2024-09-17T01:45:10.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.854+0000 7f2958200640 1 --2- 172.21.15.42:0/3665742675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f295006db50 0x7f2950073df0 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:10.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.854+0000 7f2958200640 1 --2- 172.21.15.42:0/3665742675 >> v2:172.21.15.43:3300/0 conn(0x7f295006f2a0 0x7f295006d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:10.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.854+0000 7f2958200640 1 -- 172.21.15.42:0/3665742675 >> 172.21.15.42:0/3665742675 conn(0x7f29500b2930 msgr2=0x7f295006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:10.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.854+0000 7f2958200640 1 -- 172.21.15.42:0/3665742675 shutdown_connections 2024-09-17T01:45:10.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.854+0000 7f2958200640 1 -- 172.21.15.42:0/3665742675 wait complete. 2024-09-17T01:45:10.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.856+0000 7f2958200640 1 Processor -- start 2024-09-17T01:45:10.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.857+0000 7f2958200640 1 -- start start 2024-09-17T01:45:10.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.858+0000 7f2958200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f295006db50 0x7f29501616d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:10.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.858+0000 7f2958200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f295006ee90 0x7f29500b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:10.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.858+0000 7f2958200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f295006f2a0 0x7f29501498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:10.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.858+0000 7f2958200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f29500cef40 con 0x7f295006db50 2024-09-17T01:45:10.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.858+0000 7f2958200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2950074650 con 0x7f295006ee90 2024-09-17T01:45:10.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.858+0000 7f2958200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f29500cf0c0 con 0x7f295006f2a0 2024-09-17T01:45:10.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.858+0000 7f2955800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f295006db50 0x7f29501616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:10.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.858+0000 7f2955800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f295006db50 0x7f29501616d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34128/0 (socket says 172.21.15.42:34128) 2024-09-17T01:45:10.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.858+0000 7f2955800640 1 -- 172.21.15.42:0/4209484798 learned_addr learned my addr 172.21.15.42:0/4209484798 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:10.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.859+0000 7f2954e00640 1 --2- 172.21.15.42:0/4209484798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f295006ee90 0x7f29500b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:10.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.859+0000 7f2956200640 1 --2- 172.21.15.42:0/4209484798 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f295006f2a0 0x7f29501498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:10.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.859+0000 7f2955800640 1 -- 172.21.15.42:0/4209484798 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f295006f2a0 msgr2=0x7f29501498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:10.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.859+0000 7f2955800640 1 --2- 172.21.15.42:0/4209484798 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f295006f2a0 0x7f29501498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:10.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.859+0000 7f2955800640 1 -- 172.21.15.42:0/4209484798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f295006ee90 msgr2=0x7f29500b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:10.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.859+0000 7f2955800640 1 --2- 172.21.15.42:0/4209484798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f295006ee90 0x7f29500b4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:10.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.859+0000 7f2955800640 1 -- 172.21.15.42:0/4209484798 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29501586b0 con 0x7f295006db50 2024-09-17T01:45:10.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.859+0000 7f2956200640 1 --2- 172.21.15.42:0/4209484798 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f295006f2a0 0x7f29501498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:45:10.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.859+0000 7f2955800640 1 --2- 172.21.15.42:0/4209484798 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f295006db50 0x7f29501616d0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f294400c3a0 tx=0x7f294400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:10.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.859+0000 7f294d600640 1 -- 172.21.15.42:0/4209484798 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2944017070 con 0x7f295006db50 2024-09-17T01:45:10.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.859+0000 7f294d600640 1 -- 172.21.15.42:0/4209484798 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29440053c0 con 0x7f295006db50 2024-09-17T01:45:10.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.859+0000 7f294d600640 1 -- 172.21.15.42:0/4209484798 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2944003850 con 0x7f295006db50 2024-09-17T01:45:10.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.859+0000 7f2958200640 1 -- 172.21.15.42:0/4209484798 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29501f5ba0 con 0x7f295006db50 2024-09-17T01:45:10.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.860+0000 7f2958200640 1 -- 172.21.15.42:0/4209484798 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29501f6130 con 0x7f295006db50 2024-09-17T01:45:10.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.860+0000 7f2958200640 1 -- 172.21.15.42:0/4209484798 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29500b5a10 con 0x7f295006db50 2024-09-17T01:45:10.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.862+0000 7f294d600640 1 -- 172.21.15.42:0/4209484798 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f294401a070 con 0x7f295006db50 2024-09-17T01:45:10.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.863+0000 7f294d600640 1 --2- 172.21.15.42:0/4209484798 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2930078b90 0x7f293007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:10.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.863+0000 7f294d600640 1 -- 172.21.15.42:0/4209484798 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5824+0+0 (secure 0 0 0) 0x7f294409a1e0 con 0x7f295006db50 2024-09-17T01:45:10.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.863+0000 7f2954e00640 1 --2- 172.21.15.42:0/4209484798 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2930078b90 0x7f293007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:10.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.864+0000 7f2954e00640 1 --2- 172.21.15.42:0/4209484798 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2930078b90 0x7f293007b0a0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f295006daa0 tx=0x7f293c005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:10.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:10.867+0000 7f294d600640 1 -- 172.21.15.42:0/4209484798 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f29440625c0 con 0x7f295006db50 2024-09-17T01:45:11.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.137+0000 7f2958200640 1 -- 172.21.15.42:0/4209484798 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f2950073df0 con 0x7f295006db50 2024-09-17T01:45:11.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.138+0000 7f294d600640 1 -- 172.21.15.42:0/4209484798 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1068 (secure 0 0 0) 0x7f2944061ec0 con 0x7f295006db50 2024-09-17T01:45:11.136 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:45:11.136 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":811,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":163,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076961345,"bytes_used":2603368448,"bytes_avail":770490744832,"bytes_total":773094113280,"read_bytes_sec":270974,"read_op_per_sec":3,"write_op_per_sec":0},"fsmap":{"epoch":129,"btime":"2024-09-17T01:45:07:563535+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9513}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":32,"modified":"2024-09-17T01:45:05.204824+0000","services":{}},"progress_events":{}} 2024-09-17T01:45:11.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.140+0000 7f2958200640 1 -- 172.21.15.42:0/4209484798 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2930078b90 msgr2=0x7f293007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:11.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.140+0000 7f2958200640 1 --2- 172.21.15.42:0/4209484798 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2930078b90 0x7f293007b0a0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f295006daa0 tx=0x7f293c005f90 comp rx=0 tx=0).stop 2024-09-17T01:45:11.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.140+0000 7f2958200640 1 -- 172.21.15.42:0/4209484798 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f295006db50 msgr2=0x7f29501616d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:11.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.140+0000 7f2958200640 1 --2- 172.21.15.42:0/4209484798 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f295006db50 0x7f29501616d0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f294400c3a0 tx=0x7f294400c860 comp rx=0 tx=0).stop 2024-09-17T01:45:11.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.140+0000 7f2958200640 1 -- 172.21.15.42:0/4209484798 shutdown_connections 2024-09-17T01:45:11.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.140+0000 7f2958200640 1 --2- 172.21.15.42:0/4209484798 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2930078b90 0x7f293007b0a0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:11.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.140+0000 7f2958200640 1 --2- 172.21.15.42:0/4209484798 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f295006ee90 0x7f29500b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:11.138 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.140+0000 7f2958200640 1 --2- 172.21.15.42:0/4209484798 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f295006f2a0 0x7f29501498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:11.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.140+0000 7f2958200640 1 --2- 172.21.15.42:0/4209484798 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f295006db50 0x7f29501616d0 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:11.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.140+0000 7f2958200640 1 -- 172.21.15.42:0/4209484798 >> 172.21.15.42:0/4209484798 conn(0x7f29500b2930 msgr2=0x7f29500ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:11.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.140+0000 7f2958200640 1 -- 172.21.15.42:0/4209484798 shutdown_connections 2024-09-17T01:45:11.139 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.140+0000 7f2958200640 1 -- 172.21.15.42:0/4209484798 wait complete. 2024-09-17T01:45:11.164 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:45:11.165 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:45:11.255 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:45:11.359 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:45:11.359 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:45:11.359 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:45:11.359 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:45:11.395 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:45:11.395 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:45:11.471 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T01:45:11.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.744+0000 7fe1c6c00640 1 -- 172.21.15.42:0/661758315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1c006f2a0 msgr2=0x7fe1c006d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:11.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.744+0000 7fe1c6c00640 1 --2- 172.21.15.42:0/661758315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1c006f2a0 0x7fe1c006d610 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0071370 tx=0x7fe1a802a560 comp rx=0 tx=0).stop 2024-09-17T01:45:11.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.744+0000 7fe1c6c00640 1 -- 172.21.15.42:0/661758315 shutdown_connections 2024-09-17T01:45:11.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.744+0000 7fe1c6c00640 1 --2- 172.21.15.42:0/661758315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1c006f2a0 0x7fe1c006d610 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:11.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.744+0000 7fe1c6c00640 1 --2- 172.21.15.42:0/661758315 >> v2:172.21.15.43:3300/0 conn(0x7fe1c006ee90 0x7fe1c015f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:11.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.744+0000 7fe1c6c00640 1 -- 172.21.15.42:0/661758315 >> 172.21.15.42:0/661758315 conn(0x7fe1c00b2930 msgr2=0x7fe1c006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:11.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.744+0000 7fe1c6c00640 1 -- 172.21.15.42:0/661758315 shutdown_connections 2024-09-17T01:45:11.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.744+0000 7fe1c6c00640 1 -- 172.21.15.42:0/661758315 wait complete. 2024-09-17T01:45:11.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.747+0000 7fe1c6c00640 1 Processor -- start 2024-09-17T01:45:11.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.747+0000 7fe1c6c00640 1 -- start start 2024-09-17T01:45:11.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.748+0000 7fe1c6c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1c006db50 0x7fe1c0144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:11.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.748+0000 7fe1c6c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1c006ee90 0x7fe1c00b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:11.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.748+0000 7fe1c6c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1c006f2a0 0x7fe1c01550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:11.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.748+0000 7fe1c6c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c00cef40 con 0x7fe1c006f2a0 2024-09-17T01:45:11.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.748+0000 7fe1c6c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c0074750 con 0x7fe1c006db50 2024-09-17T01:45:11.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.748+0000 7fe1c6c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe1c00cf0c0 con 0x7fe1c006ee90 2024-09-17T01:45:11.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.748+0000 7fe1c4c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1c006f2a0 0x7fe1c01550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:11.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.749+0000 7fe1c4c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1c006f2a0 0x7fe1c01550b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34148/0 (socket says 172.21.15.42:34148) 2024-09-17T01:45:11.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.749+0000 7fe1c4c00640 1 -- 172.21.15.42:0/2143077231 learned_addr learned my addr 172.21.15.42:0/2143077231 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:11.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.749+0000 7fe1bfe00640 1 --2- 172.21.15.42:0/2143077231 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1c006db50 0x7fe1c0144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:11.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.749+0000 7fe1b7e00640 1 --2- 172.21.15.42:0/2143077231 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1c006ee90 0x7fe1c00b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:11.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.749+0000 7fe1c4c00640 1 -- 172.21.15.42:0/2143077231 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1c006ee90 msgr2=0x7fe1c00b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:11.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.749+0000 7fe1c4c00640 1 --2- 172.21.15.42:0/2143077231 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1c006ee90 0x7fe1c00b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:11.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.749+0000 7fe1c4c00640 1 -- 172.21.15.42:0/2143077231 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1c006db50 msgr2=0x7fe1c0144740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:11.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.749+0000 7fe1c4c00640 1 --2- 172.21.15.42:0/2143077231 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1c006db50 0x7fe1c0144740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:11.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.749+0000 7fe1c4c00640 1 -- 172.21.15.42:0/2143077231 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c00b34c0 con 0x7fe1c006f2a0 2024-09-17T01:45:11.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.749+0000 7fe1c4c00640 1 --2- 172.21.15.42:0/2143077231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1c006f2a0 0x7fe1c01550b0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800c700 tx=0x7fe1b800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:11.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.750+0000 7fe1bcc00640 1 -- 172.21.15.42:0/2143077231 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8003b70 con 0x7fe1c006f2a0 2024-09-17T01:45:11.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.750+0000 7fe1bcc00640 1 -- 172.21.15.42:0/2143077231 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1b8003d10 con 0x7fe1c006f2a0 2024-09-17T01:45:11.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.750+0000 7fe1bcc00640 1 -- 172.21.15.42:0/2143077231 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b800aab0 con 0x7fe1c006f2a0 2024-09-17T01:45:11.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.750+0000 7fe1c6c00640 1 -- 172.21.15.42:0/2143077231 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1c01f95f0 con 0x7fe1c006f2a0 2024-09-17T01:45:11.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.750+0000 7fe1c6c00640 1 -- 172.21.15.42:0/2143077231 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1c01f9bb0 con 0x7fe1c006f2a0 2024-09-17T01:45:11.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.751+0000 7fe1c6c00640 1 -- 172.21.15.42:0/2143077231 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1c015f200 con 0x7fe1c006f2a0 2024-09-17T01:45:11.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.752+0000 7fe1bcc00640 1 -- 172.21.15.42:0/2143077231 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe1b800ac50 con 0x7fe1c006f2a0 2024-09-17T01:45:11.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.753+0000 7fe1bcc00640 1 --2- 172.21.15.42:0/2143077231 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe19c078b90 0x7fe19c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:11.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.753+0000 7fe1bcc00640 1 -- 172.21.15.42:0/2143077231 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5824+0+0 (secure 0 0 0) 0x7fe1b809aab0 con 0x7fe1c006f2a0 2024-09-17T01:45:11.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.753+0000 7fe1bfe00640 1 --2- 172.21.15.42:0/2143077231 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe19c078b90 0x7fe19c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:11.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.754+0000 7fe1bfe00640 1 --2- 172.21.15.42:0/2143077231 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe19c078b90 0x7fe19c07b0a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0004630 tx=0x7fe1b000b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:11.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.757+0000 7fe1bcc00640 1 -- 172.21.15.42:0/2143077231 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe1b80627b0 con 0x7fe1c006f2a0 2024-09-17T01:45:11.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.966+0000 7fe1c6c00640 1 -- 172.21.15.42:0/2143077231 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe1c01f9380 con 0x7fe1c006f2a0 2024-09-17T01:45:11.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.967+0000 7fe1bcc00640 1 -- 172.21.15.42:0/2143077231 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v163) ==== 80+0+122 (secure 0 0 0) 0x7fe1b80671e0 con 0x7fe1c006f2a0 2024-09-17T01:45:11.965 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6835/1557345672 2024-09-18T01:45:04.547026+0000 2024-09-17T01:45:11.966 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6833/1557345672 2024-09-18T01:45:04.547026+0000 2024-09-17T01:45:11.966 INFO:teuthology.orchestra.run.smithi042.stderr:listed 2 entries 2024-09-17T01:45:11.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.969+0000 7fe1c6c00640 1 -- 172.21.15.42:0/2143077231 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe19c078b90 msgr2=0x7fe19c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:11.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.969+0000 7fe1c6c00640 1 --2- 172.21.15.42:0/2143077231 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe19c078b90 0x7fe19c07b0a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0004630 tx=0x7fe1b000b2e0 comp rx=0 tx=0).stop 2024-09-17T01:45:11.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.969+0000 7fe1c6c00640 1 -- 172.21.15.42:0/2143077231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1c006f2a0 msgr2=0x7fe1c01550b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:11.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.969+0000 7fe1c6c00640 1 --2- 172.21.15.42:0/2143077231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1c006f2a0 0x7fe1c01550b0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800c700 tx=0x7fe1b800cbc0 comp rx=0 tx=0).stop 2024-09-17T01:45:11.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.969+0000 7fe1c6c00640 1 -- 172.21.15.42:0/2143077231 shutdown_connections 2024-09-17T01:45:11.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.969+0000 7fe1c6c00640 1 --2- 172.21.15.42:0/2143077231 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe19c078b90 0x7fe19c07b0a0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:11.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.969+0000 7fe1c6c00640 1 --2- 172.21.15.42:0/2143077231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1c006f2a0 0x7fe1c01550b0 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:11.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.969+0000 7fe1c6c00640 1 --2- 172.21.15.42:0/2143077231 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1c006ee90 0x7fe1c00b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:11.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.969+0000 7fe1c6c00640 1 --2- 172.21.15.42:0/2143077231 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1c006db50 0x7fe1c0144740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:11.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.969+0000 7fe1c6c00640 1 -- 172.21.15.42:0/2143077231 >> 172.21.15.42:0/2143077231 conn(0x7fe1c00b2930 msgr2=0x7fe1c00ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:11.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.969+0000 7fe1c6c00640 1 -- 172.21.15.42:0/2143077231 shutdown_connections 2024-09-17T01:45:11.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:11.969+0000 7fe1c6c00640 1 -- 172.21.15.42:0/2143077231 wait complete. 2024-09-17T01:45:11.989 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T01:45:11.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:45:11.990 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T01:45:12.071 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:45:12.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:45:12.071 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T01:45:12.108 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:45:12.108 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:45:12.109 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:45:12.148 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:45:12.149 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:45:12.149 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:45:12.149 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:45:12.185 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:45:12.185 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:45:12.185 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:45:12.185 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:45:12.226 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:45:12.226 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:45:12.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.455+0000 7fc47fe00640 1 -- 172.21.15.42:0/2830401628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4800b4be0 msgr2=0x7fc48015d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:12.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.455+0000 7fc47fe00640 1 --2- 172.21.15.42:0/2830401628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4800b4be0 0x7fc48015d6b0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7fc480071cb0 tx=0x7fc47002a510 comp rx=0 tx=0).stop 2024-09-17T01:45:12.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.455+0000 7fc47fe00640 1 -- 172.21.15.42:0/2830401628 shutdown_connections 2024-09-17T01:45:12.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.455+0000 7fc47fe00640 1 --2- 172.21.15.42:0/2830401628 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc48006d430 0x7fc480152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:12.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.455+0000 7fc47fe00640 1 --2- 172.21.15.42:0/2830401628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4800b4be0 0x7fc48015d6b0 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:12.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.455+0000 7fc47fe00640 1 -- 172.21.15.42:0/2830401628 >> 172.21.15.42:0/2830401628 conn(0x7fc4800b25f0 msgr2=0x7fc4800d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:12.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.455+0000 7fc47fe00640 1 -- 172.21.15.42:0/2830401628 shutdown_connections 2024-09-17T01:45:12.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.455+0000 7fc47fe00640 1 -- 172.21.15.42:0/2830401628 wait complete. 2024-09-17T01:45:12.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.457+0000 7fc47fe00640 1 Processor -- start 2024-09-17T01:45:12.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.457+0000 7fc47fe00640 1 -- start start 2024-09-17T01:45:12.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.459+0000 7fc47fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4800b4be0 0x7fc480074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:12.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.459+0000 7fc47fe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc4800cf7c0 0x7fc4800cac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:12.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.459+0000 7fc47fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4801519b0 0x7fc48014b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:12.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.459+0000 7fc47fe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc480153850 con 0x7fc4800b4be0 2024-09-17T01:45:12.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.459+0000 7fc47fe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc4801536d0 con 0x7fc4801519b0 2024-09-17T01:45:12.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.459+0000 7fc47fe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc4801539d0 con 0x7fc4800cf7c0 2024-09-17T01:45:12.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.459+0000 7fc47ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4800b4be0 0x7fc480074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:12.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.459+0000 7fc47ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4800b4be0 0x7fc480074c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34168/0 (socket says 172.21.15.42:34168) 2024-09-17T01:45:12.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.459+0000 7fc47ea00640 1 -- 172.21.15.42:0/46050649 learned_addr learned my addr 172.21.15.42:0/46050649 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:12.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.459+0000 7fc477e00640 1 --2- 172.21.15.42:0/46050649 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc4800cf7c0 0x7fc4800cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:12.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.460+0000 7fc47f400640 1 --2- 172.21.15.42:0/46050649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4801519b0 0x7fc48014b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:12.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.460+0000 7fc47ea00640 1 -- 172.21.15.42:0/46050649 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc4800cf7c0 msgr2=0x7fc4800cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:12.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.460+0000 7fc47ea00640 1 --2- 172.21.15.42:0/46050649 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc4800cf7c0 0x7fc4800cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:12.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.460+0000 7fc47ea00640 1 -- 172.21.15.42:0/46050649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4801519b0 msgr2=0x7fc48014b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:12.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.460+0000 7fc47ea00640 1 --2- 172.21.15.42:0/46050649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4801519b0 0x7fc48014b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:12.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.460+0000 7fc47ea00640 1 -- 172.21.15.42:0/46050649 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4801f9100 con 0x7fc4800b4be0 2024-09-17T01:45:12.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.460+0000 7fc47f400640 1 --2- 172.21.15.42:0/46050649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4801519b0 0x7fc48014b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:45:12.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.460+0000 7fc47ea00640 1 --2- 172.21.15.42:0/46050649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4800b4be0 0x7fc480074c50 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7fc470000c00 tx=0x7fc470003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:12.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.460+0000 7fc477400640 1 -- 172.21.15.42:0/46050649 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc47003e030 con 0x7fc4800b4be0 2024-09-17T01:45:12.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.460+0000 7fc477400640 1 -- 172.21.15.42:0/46050649 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc470003e00 con 0x7fc4800b4be0 2024-09-17T01:45:12.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.460+0000 7fc47fe00640 1 -- 172.21.15.42:0/46050649 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4801f93e0 con 0x7fc4800b4be0 2024-09-17T01:45:12.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.460+0000 7fc477400640 1 -- 172.21.15.42:0/46050649 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc470035040 con 0x7fc4800b4be0 2024-09-17T01:45:12.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.461+0000 7fc47fe00640 1 -- 172.21.15.42:0/46050649 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4801f99a0 con 0x7fc4800b4be0 2024-09-17T01:45:12.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.462+0000 7fc47fe00640 1 -- 172.21.15.42:0/46050649 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc480152ed0 con 0x7fc4800b4be0 2024-09-17T01:45:12.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.463+0000 7fc477400640 1 -- 172.21.15.42:0/46050649 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc470041030 con 0x7fc4800b4be0 2024-09-17T01:45:12.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.464+0000 7fc477400640 1 --2- 172.21.15.42:0/46050649 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc45c078b90 0x7fc45c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:12.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.464+0000 7fc477400640 1 -- 172.21.15.42:0/46050649 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5824+0+0 (secure 0 0 0) 0x7fc4700bb5f0 con 0x7fc4800b4be0 2024-09-17T01:45:12.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.464+0000 7fc477e00640 1 --2- 172.21.15.42:0/46050649 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc45c078b90 0x7fc45c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:12.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.465+0000 7fc477e00640 1 --2- 172.21.15.42:0/46050649 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc45c078b90 0x7fc45c07b0a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fc480075200 tx=0x7fc468009060 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:12.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.469+0000 7fc477400640 1 -- 172.21.15.42:0/46050649 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc48015dbf0 con 0x7fc4800b4be0 2024-09-17T01:45:12.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.700+0000 7fc47fe00640 1 -- 172.21.15.42:0/46050649 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc48015efe0 con 0x7fc4800b4be0 2024-09-17T01:45:12.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.700+0000 7fc477400640 1 -- 172.21.15.42:0/46050649 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) ==== 95+0+4407 (secure 0 0 0) 0x7fc4700832f0 con 0x7fc4800b4be0 2024-09-17T01:45:12.698 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:45:12.699 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":129,"btime":"2024-09-17T01:45:07:563535+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8872,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3393274334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3393274334},{"type":"v1","addr":"172.21.15.43:6836","nonce":3393274334}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":8875,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2869136532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2869136532},{"type":"v1","addr":"172.21.15.43:6837","nonce":2869136532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120}],"filesystems":[{"mdsmap":{"epoch":129,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:44:06.556661+0000","modified":"2024-09-17T01:45:07.563524+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":163,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9513},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9513":{"gid":9513,"name":"a","rank":0,"incarnation":126,"state":"up:active","state_seq":19,"addr":"172.21.15.42:6834/297557585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":297557585},{"type":"v1","addr":"172.21.15.42:6834","nonce":297557585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9513,"qdb_cluster":[9513]},"id":11}]} 2024-09-17T01:45:12.699 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 129 2024-09-17T01:45:12.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.703+0000 7fc47fe00640 1 -- 172.21.15.42:0/46050649 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc45c078b90 msgr2=0x7fc45c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:12.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.703+0000 7fc47fe00640 1 --2- 172.21.15.42:0/46050649 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc45c078b90 0x7fc45c07b0a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fc480075200 tx=0x7fc468009060 comp rx=0 tx=0).stop 2024-09-17T01:45:12.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.703+0000 7fc47fe00640 1 -- 172.21.15.42:0/46050649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4800b4be0 msgr2=0x7fc480074c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:12.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.703+0000 7fc47fe00640 1 --2- 172.21.15.42:0/46050649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4800b4be0 0x7fc480074c50 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7fc470000c00 tx=0x7fc470003910 comp rx=0 tx=0).stop 2024-09-17T01:45:12.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.703+0000 7fc47fe00640 1 -- 172.21.15.42:0/46050649 shutdown_connections 2024-09-17T01:45:12.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.703+0000 7fc47fe00640 1 --2- 172.21.15.42:0/46050649 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc45c078b90 0x7fc45c07b0a0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:12.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.703+0000 7fc47fe00640 1 --2- 172.21.15.42:0/46050649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4801519b0 0x7fc48014b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:12.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.703+0000 7fc47fe00640 1 --2- 172.21.15.42:0/46050649 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc4800cf7c0 0x7fc4800cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:12.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.703+0000 7fc47fe00640 1 --2- 172.21.15.42:0/46050649 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4800b4be0 0x7fc480074c50 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:12.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.703+0000 7fc47fe00640 1 -- 172.21.15.42:0/46050649 >> 172.21.15.42:0/46050649 conn(0x7fc4800b25f0 msgr2=0x7fc4800d00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:12.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.703+0000 7fc47fe00640 1 -- 172.21.15.42:0/46050649 shutdown_connections 2024-09-17T01:45:12.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.703+0000 7fc47fe00640 1 -- 172.21.15.42:0/46050649 wait complete. 2024-09-17T01:45:12.729 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:45:12.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.958+0000 7fd345e00640 1 -- 172.21.15.42:0/2405536802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3400721d0 msgr2=0x7fd3400d09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.958+0000 7fd345e00640 1 --2- 172.21.15.42:0/2405536802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3400721d0 0x7fd3400d09f0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7fd338009ca0 tx=0x7fd33802aa30 comp rx=0 tx=0).stop 2024-09-17T01:45:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.958+0000 7fd345e00640 1 -- 172.21.15.42:0/2405536802 shutdown_connections 2024-09-17T01:45:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.958+0000 7fd345e00640 1 --2- 172.21.15.42:0/2405536802 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3400721d0 0x7fd3400d09f0 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.958+0000 7fd345e00640 1 --2- 172.21.15.42:0/2405536802 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3401602e0 0x7fd34015ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.958+0000 7fd345e00640 1 -- 172.21.15.42:0/2405536802 >> 172.21.15.42:0/2405536802 conn(0x7fd340070360 msgr2=0x7fd340070770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.958+0000 7fd345e00640 1 -- 172.21.15.42:0/2405536802 shutdown_connections 2024-09-17T01:45:12.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.958+0000 7fd345e00640 1 -- 172.21.15.42:0/2405536802 wait complete. 2024-09-17T01:45:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.960+0000 7fd345e00640 1 Processor -- start 2024-09-17T01:45:12.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.960+0000 7fd345e00640 1 -- start start 2024-09-17T01:45:12.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.962+0000 7fd345e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3401537c0 0x7fd3401f6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:12.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.962+0000 7fd345e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3401602e0 0x7fd340141b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:12.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.962+0000 7fd345e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3400b6eb0 0x7fd340157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.962+0000 7fd345e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd3400d1450 con 0x7fd3401602e0 2024-09-17T01:45:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.962+0000 7fd345e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd3400d12d0 con 0x7fd3401537c0 2024-09-17T01:45:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.962+0000 7fd345e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd3400d15d0 con 0x7fd3400b6eb0 2024-09-17T01:45:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.962+0000 7fd337e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3401602e0 0x7fd340141b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.962+0000 7fd337e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3401602e0 0x7fd340141b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34180/0 (socket says 172.21.15.42:34180) 2024-09-17T01:45:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.962+0000 7fd337e00640 1 -- 172.21.15.42:0/1656067729 learned_addr learned my addr 172.21.15.42:0/1656067729 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.962+0000 7fd344a00640 1 --2- 172.21.15.42:0/1656067729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3401537c0 0x7fd3401f6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.962+0000 7fd345400640 1 --2- 172.21.15.42:0/1656067729 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3400b6eb0 0x7fd340157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.962+0000 7fd337e00640 1 -- 172.21.15.42:0/1656067729 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3400b6eb0 msgr2=0x7fd340157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.962+0000 7fd337e00640 1 --2- 172.21.15.42:0/1656067729 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3400b6eb0 0x7fd340157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.962+0000 7fd337e00640 1 -- 172.21.15.42:0/1656067729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3401537c0 msgr2=0x7fd3401f6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.962+0000 7fd337e00640 1 --2- 172.21.15.42:0/1656067729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3401537c0 0x7fd3401f6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:12.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.962+0000 7fd337e00640 1 -- 172.21.15.42:0/1656067729 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3401f7180 con 0x7fd3401602e0 2024-09-17T01:45:12.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.963+0000 7fd344a00640 1 --2- 172.21.15.42:0/1656067729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3401537c0 0x7fd3401f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:45:12.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.963+0000 7fd337e00640 1 --2- 172.21.15.42:0/1656067729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3401602e0 0x7fd340141b30 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7fd32800c390 tx=0x7fd32800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:12.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.963+0000 7fd33d600640 1 -- 172.21.15.42:0/1656067729 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd328017070 con 0x7fd3401602e0 2024-09-17T01:45:12.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.963+0000 7fd33d600640 1 -- 172.21.15.42:0/1656067729 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3280053c0 con 0x7fd3401602e0 2024-09-17T01:45:12.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.963+0000 7fd345e00640 1 -- 172.21.15.42:0/1656067729 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3401f7460 con 0x7fd3401602e0 2024-09-17T01:45:12.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.963+0000 7fd33d600640 1 -- 172.21.15.42:0/1656067729 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd328003880 con 0x7fd3401602e0 2024-09-17T01:45:12.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.963+0000 7fd345e00640 1 -- 172.21.15.42:0/1656067729 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3401f3650 con 0x7fd3401602e0 2024-09-17T01:45:12.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.964+0000 7fd345e00640 1 -- 172.21.15.42:0/1656067729 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3400ce3b0 con 0x7fd3401602e0 2024-09-17T01:45:12.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.965+0000 7fd33d600640 1 -- 172.21.15.42:0/1656067729 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd32801a070 con 0x7fd3401602e0 2024-09-17T01:45:12.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.966+0000 7fd33d600640 1 --2- 172.21.15.42:0/1656067729 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd31c078b90 0x7fd31c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:12.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.966+0000 7fd33d600640 1 -- 172.21.15.42:0/1656067729 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5824+0+0 (secure 0 0 0) 0x7fd32809a270 con 0x7fd3401602e0 2024-09-17T01:45:12.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.967+0000 7fd344a00640 1 --2- 172.21.15.42:0/1656067729 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd31c078b90 0x7fd31c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:12.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.968+0000 7fd344a00640 1 --2- 172.21.15.42:0/1656067729 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd31c078b90 0x7fd31c07b0a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fd340070fe0 tx=0x7fd330005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:12.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:12.971+0000 7fd33d600640 1 -- 172.21.15.42:0/1656067729 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd3400ce3b0 con 0x7fd3401602e0 2024-09-17T01:45:13.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.204+0000 7fd345e00640 1 -- 172.21.15.42:0/1656067729 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3401f6f10 con 0x7fd3401602e0 2024-09-17T01:45:13.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.205+0000 7fd33d600640 1 -- 172.21.15.42:0/1656067729 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) ==== 95+0+4407 (secure 0 0 0) 0x7fd3280625c0 con 0x7fd3401602e0 2024-09-17T01:45:13.203 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:45:13.203 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":129,"btime":"2024-09-17T01:45:07:563535+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8872,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3393274334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3393274334},{"type":"v1","addr":"172.21.15.43:6836","nonce":3393274334}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":8875,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2869136532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2869136532},{"type":"v1","addr":"172.21.15.43:6837","nonce":2869136532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120}],"filesystems":[{"mdsmap":{"epoch":129,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:44:06.556661+0000","modified":"2024-09-17T01:45:07.563524+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":163,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9513},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9513":{"gid":9513,"name":"a","rank":0,"incarnation":126,"state":"up:active","state_seq":19,"addr":"172.21.15.42:6834/297557585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":297557585},{"type":"v1","addr":"172.21.15.42:6834","nonce":297557585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9513,"qdb_cluster":[9513]},"id":11}]} 2024-09-17T01:45:13.204 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 129 2024-09-17T01:45:13.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.208+0000 7fd345e00640 1 -- 172.21.15.42:0/1656067729 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd31c078b90 msgr2=0x7fd31c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:13.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.208+0000 7fd345e00640 1 --2- 172.21.15.42:0/1656067729 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd31c078b90 0x7fd31c07b0a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fd340070fe0 tx=0x7fd330005f90 comp rx=0 tx=0).stop 2024-09-17T01:45:13.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.208+0000 7fd345e00640 1 -- 172.21.15.42:0/1656067729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3401602e0 msgr2=0x7fd340141b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:13.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.208+0000 7fd345e00640 1 --2- 172.21.15.42:0/1656067729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3401602e0 0x7fd340141b30 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7fd32800c390 tx=0x7fd32800c850 comp rx=0 tx=0).stop 2024-09-17T01:45:13.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.208+0000 7fd345e00640 1 -- 172.21.15.42:0/1656067729 shutdown_connections 2024-09-17T01:45:13.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.208+0000 7fd345e00640 1 --2- 172.21.15.42:0/1656067729 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd31c078b90 0x7fd31c07b0a0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:13.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.208+0000 7fd345e00640 1 --2- 172.21.15.42:0/1656067729 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3400b6eb0 0x7fd340157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:13.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.208+0000 7fd345e00640 1 --2- 172.21.15.42:0/1656067729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3401602e0 0x7fd340141b30 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:13.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.208+0000 7fd345e00640 1 --2- 172.21.15.42:0/1656067729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3401537c0 0x7fd3401f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:13.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.208+0000 7fd345e00640 1 -- 172.21.15.42:0/1656067729 >> 172.21.15.42:0/1656067729 conn(0x7fd340070360 msgr2=0x7fd34015b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:13.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.208+0000 7fd345e00640 1 -- 172.21.15.42:0/1656067729 shutdown_connections 2024-09-17T01:45:13.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.208+0000 7fd345e00640 1 -- 172.21.15.42:0/1656067729 wait complete. 2024-09-17T01:45:13.228 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:45:13.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.459+0000 7fd3e0a00640 1 -- 172.21.15.42:0/2123380117 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3dc06d430 msgr2=0x7fd3dc06d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:13.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.459+0000 7fd3e0a00640 1 --2- 172.21.15.42:0/2123380117 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3dc06d430 0x7fd3dc06d840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4009830 tx=0x7fd3c402a530 comp rx=0 tx=0).stop 2024-09-17T01:45:13.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.459+0000 7fd3e0a00640 1 -- 172.21.15.42:0/2123380117 shutdown_connections 2024-09-17T01:45:13.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.459+0000 7fd3e0a00640 1 --2- 172.21.15.42:0/2123380117 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3dc06d430 0x7fd3dc06d840 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:13.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.459+0000 7fd3e0a00640 1 --2- 172.21.15.42:0/2123380117 >> v2:172.21.15.43:3300/0 conn(0x7fd3dc15cb80 0x7fd3dc152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:13.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.459+0000 7fd3e0a00640 1 -- 172.21.15.42:0/2123380117 >> 172.21.15.42:0/2123380117 conn(0x7fd3dc0b2930 msgr2=0x7fd3dc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:13.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.459+0000 7fd3e0a00640 1 -- 172.21.15.42:0/2123380117 shutdown_connections 2024-09-17T01:45:13.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.459+0000 7fd3e0a00640 1 -- 172.21.15.42:0/2123380117 wait complete. 2024-09-17T01:45:13.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.461+0000 7fd3e0a00640 1 Processor -- start 2024-09-17T01:45:13.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.461+0000 7fd3e0a00640 1 -- start start 2024-09-17T01:45:13.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.463+0000 7fd3e0a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3dc06d430 0x7fd3dc1f5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:13.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.463+0000 7fd3e0a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3dc15cb80 0x7fd3dc144450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:13.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.463+0000 7fd3e0a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3dc15f480 0x7fd3dc06e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:13.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.463+0000 7fd3e0a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd3dc073820 con 0x7fd3dc06d430 2024-09-17T01:45:13.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.463+0000 7fd3e0a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd3dc0736a0 con 0x7fd3dc15f480 2024-09-17T01:45:13.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.463+0000 7fd3e0a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd3dc0739a0 con 0x7fd3dc15cb80 2024-09-17T01:45:13.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.463+0000 7fd3d9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3dc06d430 0x7fd3dc1f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:13.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.463+0000 7fd3d9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3dc06d430 0x7fd3dc1f5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34182/0 (socket says 172.21.15.42:34182) 2024-09-17T01:45:13.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.463+0000 7fd3d9e00640 1 -- 172.21.15.42:0/4111744897 learned_addr learned my addr 172.21.15.42:0/4111744897 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:13.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.463+0000 7fd3d3e00640 1 --2- 172.21.15.42:0/4111744897 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3dc15cb80 0x7fd3dc144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:13.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.463+0000 7fd3da800640 1 --2- 172.21.15.42:0/4111744897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3dc15f480 0x7fd3dc06e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:13.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.464+0000 7fd3d9e00640 1 -- 172.21.15.42:0/4111744897 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3dc15cb80 msgr2=0x7fd3dc144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:13.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.464+0000 7fd3d9e00640 1 --2- 172.21.15.42:0/4111744897 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3dc15cb80 0x7fd3dc144450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:13.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.464+0000 7fd3d9e00640 1 -- 172.21.15.42:0/4111744897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3dc15f480 msgr2=0x7fd3dc06e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:13.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.464+0000 7fd3d9e00640 1 --2- 172.21.15.42:0/4111744897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3dc15f480 0x7fd3dc06e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:13.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.464+0000 7fd3d9e00640 1 -- 172.21.15.42:0/4111744897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3dc144990 con 0x7fd3dc06d430 2024-09-17T01:45:13.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.464+0000 7fd3d9e00640 1 --2- 172.21.15.42:0/4111744897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3dc06d430 0x7fd3dc1f5840 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc00ea20 tx=0x7fd3cc00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:13.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.464+0000 7fd3d2000640 1 -- 172.21.15.42:0/4111744897 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc00ce40 con 0x7fd3dc06d430 2024-09-17T01:45:13.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.464+0000 7fd3d2000640 1 -- 172.21.15.42:0/4111744897 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3cc004020 con 0x7fd3dc06d430 2024-09-17T01:45:13.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.464+0000 7fd3e0a00640 1 -- 172.21.15.42:0/4111744897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3dc1f60e0 con 0x7fd3dc06d430 2024-09-17T01:45:13.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.464+0000 7fd3d2000640 1 -- 172.21.15.42:0/4111744897 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc004470 con 0x7fd3dc06d430 2024-09-17T01:45:13.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.464+0000 7fd3e0a00640 1 -- 172.21.15.42:0/4111744897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3dc1f66a0 con 0x7fd3dc06d430 2024-09-17T01:45:13.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.465+0000 7fd3e0a00640 1 -- 172.21.15.42:0/4111744897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3dc073e70 con 0x7fd3dc06d430 2024-09-17T01:45:13.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.467+0000 7fd3d2000640 1 -- 172.21.15.42:0/4111744897 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd3cc0035f0 con 0x7fd3dc06d430 2024-09-17T01:45:13.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.468+0000 7fd3d2000640 1 --2- 172.21.15.42:0/4111744897 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd3b8078b90 0x7fd3b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:13.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.468+0000 7fd3d2000640 1 -- 172.21.15.42:0/4111744897 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5824+0+0 (secure 0 0 0) 0x7fd3cc09b770 con 0x7fd3dc06d430 2024-09-17T01:45:13.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.468+0000 7fd3d3e00640 1 --2- 172.21.15.42:0/4111744897 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd3b8078b90 0x7fd3b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:13.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.469+0000 7fd3d3e00640 1 --2- 172.21.15.42:0/4111744897 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd3b8078b90 0x7fd3b807b0a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4034000 tx=0x7fd3c4004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:13.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.472+0000 7fd3d2000640 1 -- 172.21.15.42:0/4111744897 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd3cc063500 con 0x7fd3dc06d430 2024-09-17T01:45:13.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.667+0000 7fd3e0a00640 1 -- 172.21.15.42:0/4111744897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3dc06a170 con 0x7fd3dc06d430 2024-09-17T01:45:13.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.668+0000 7fd3d2000640 1 -- 172.21.15.42:0/4111744897 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) ==== 74+0+16870 (secure 0 0 0) 0x7fd3cc067f30 con 0x7fd3dc06d430 2024-09-17T01:45:13.666 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:45:13.667 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":163,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:45:04.547102+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:44:04.499543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T01:44:05.519952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"23.3a","mappings":[{"from":5,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6835/1557345672":"2024-09-18T01:45:04.547026+0000","172.21.15.42:6833/1557345672":"2024-09-18T01:45:04.547026+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:45:13.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.671+0000 7fd3e0a00640 1 -- 172.21.15.42:0/4111744897 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd3b8078b90 msgr2=0x7fd3b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:13.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.671+0000 7fd3e0a00640 1 --2- 172.21.15.42:0/4111744897 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd3b8078b90 0x7fd3b807b0a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4034000 tx=0x7fd3c4004730 comp rx=0 tx=0).stop 2024-09-17T01:45:13.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.671+0000 7fd3e0a00640 1 -- 172.21.15.42:0/4111744897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3dc06d430 msgr2=0x7fd3dc1f5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:13.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.671+0000 7fd3e0a00640 1 --2- 172.21.15.42:0/4111744897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3dc06d430 0x7fd3dc1f5840 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc00ea20 tx=0x7fd3cc00eee0 comp rx=0 tx=0).stop 2024-09-17T01:45:13.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.671+0000 7fd3e0a00640 1 -- 172.21.15.42:0/4111744897 shutdown_connections 2024-09-17T01:45:13.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.671+0000 7fd3e0a00640 1 --2- 172.21.15.42:0/4111744897 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd3b8078b90 0x7fd3b807b0a0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:13.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.671+0000 7fd3e0a00640 1 --2- 172.21.15.42:0/4111744897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3dc15f480 0x7fd3dc06e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:13.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.671+0000 7fd3e0a00640 1 --2- 172.21.15.42:0/4111744897 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3dc15cb80 0x7fd3dc144450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:13.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.671+0000 7fd3e0a00640 1 --2- 172.21.15.42:0/4111744897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3dc06d430 0x7fd3dc1f5840 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:13.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.671+0000 7fd3e0a00640 1 -- 172.21.15.42:0/4111744897 >> 172.21.15.42:0/4111744897 conn(0x7fd3dc0b2930 msgr2=0x7fd3dc0cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:13.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.671+0000 7fd3e0a00640 1 -- 172.21.15.42:0/4111744897 shutdown_connections 2024-09-17T01:45:13.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.671+0000 7fd3e0a00640 1 -- 172.21.15.42:0/4111744897 wait complete. 2024-09-17T01:45:13.690 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T01:45:13.691 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:45:13.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.919+0000 7fca9dc00640 1 -- 172.21.15.42:0/2740633023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca98142f40 msgr2=0x7fca98072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:13.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.919+0000 7fca9dc00640 1 --2- 172.21.15.42:0/2740633023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca98142f40 0x7fca98072950 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7fca9815aab0 tx=0x7fca8002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:45:13.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.919+0000 7fca9dc00640 1 -- 172.21.15.42:0/2740633023 shutdown_connections 2024-09-17T01:45:13.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.919+0000 7fca9dc00640 1 --2- 172.21.15.42:0/2740633023 >> v2:172.21.15.43:3300/0 conn(0x7fca98072e90 0x7fca980cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:13.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.919+0000 7fca9dc00640 1 --2- 172.21.15.42:0/2740633023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca98142f40 0x7fca98072950 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:13.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.919+0000 7fca9dc00640 1 -- 172.21.15.42:0/2740633023 >> 172.21.15.42:0/2740633023 conn(0x7fca980b2930 msgr2=0x7fca9806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:13.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.919+0000 7fca9dc00640 1 -- 172.21.15.42:0/2740633023 shutdown_connections 2024-09-17T01:45:13.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.919+0000 7fca9dc00640 1 -- 172.21.15.42:0/2740633023 wait complete. 2024-09-17T01:45:13.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.921+0000 7fca9dc00640 1 Processor -- start 2024-09-17T01:45:13.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.922+0000 7fca9dc00640 1 -- start start 2024-09-17T01:45:13.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.923+0000 7fca9dc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca98072e90 0x7fca98140080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:13.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.923+0000 7fca9dc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca980b3550 0x7fca981376b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:13.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.923+0000 7fca9dc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca98142f40 0x7fca98137bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:13.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.923+0000 7fca9dc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fca9806d5b0 con 0x7fca98142f40 2024-09-17T01:45:13.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.923+0000 7fca9dc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fca9806d430 con 0x7fca98072e90 2024-09-17T01:45:13.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.923+0000 7fca9dc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fca9806d730 con 0x7fca980b3550 2024-09-17T01:45:13.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.923+0000 7fca97400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca98142f40 0x7fca98137bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:13.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.923+0000 7fca97400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca98142f40 0x7fca98137bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34204/0 (socket says 172.21.15.42:34204) 2024-09-17T01:45:13.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.923+0000 7fca97400640 1 -- 172.21.15.42:0/3878805781 learned_addr learned my addr 172.21.15.42:0/3878805781 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:13.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.923+0000 7fca96a00640 1 --2- 172.21.15.42:0/3878805781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca98072e90 0x7fca98140080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:13.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.923+0000 7fca8fe00640 1 --2- 172.21.15.42:0/3878805781 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca980b3550 0x7fca981376b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:13.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.924+0000 7fca97400640 1 -- 172.21.15.42:0/3878805781 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca980b3550 msgr2=0x7fca981376b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:13.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.924+0000 7fca97400640 1 --2- 172.21.15.42:0/3878805781 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca980b3550 0x7fca981376b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:13.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.924+0000 7fca97400640 1 -- 172.21.15.42:0/3878805781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca98072e90 msgr2=0x7fca98140080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:13.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.924+0000 7fca97400640 1 --2- 172.21.15.42:0/3878805781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca98072e90 0x7fca98140080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:13.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.924+0000 7fca97400640 1 -- 172.21.15.42:0/3878805781 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca98138130 con 0x7fca98142f40 2024-09-17T01:45:13.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.924+0000 7fca97400640 1 --2- 172.21.15.42:0/3878805781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca98142f40 0x7fca98137bf0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7fca9000ea80 tx=0x7fca9000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:13.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.924+0000 7fca8ea00640 1 -- 172.21.15.42:0/3878805781 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca90004b20 con 0x7fca98142f40 2024-09-17T01:45:13.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.924+0000 7fca8ea00640 1 -- 172.21.15.42:0/3878805781 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca90004ce0 con 0x7fca98142f40 2024-09-17T01:45:13.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.925+0000 7fca9dc00640 1 -- 172.21.15.42:0/3878805781 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca981409f0 con 0x7fca98142f40 2024-09-17T01:45:13.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.925+0000 7fca8ea00640 1 -- 172.21.15.42:0/3878805781 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca90005280 con 0x7fca98142f40 2024-09-17T01:45:13.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.925+0000 7fca9dc00640 1 -- 172.21.15.42:0/3878805781 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca98140fb0 con 0x7fca98142f40 2024-09-17T01:45:13.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.926+0000 7fca9dc00640 1 -- 172.21.15.42:0/3878805781 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca98140760 con 0x7fca98142f40 2024-09-17T01:45:13.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.927+0000 7fca8ea00640 1 -- 172.21.15.42:0/3878805781 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fca90005420 con 0x7fca98142f40 2024-09-17T01:45:13.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.928+0000 7fca8ea00640 1 --2- 172.21.15.42:0/3878805781 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fca74078b90 0x7fca7407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:13.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.928+0000 7fca8ea00640 1 -- 172.21.15.42:0/3878805781 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5824+0+0 (secure 0 0 0) 0x7fca9009b8f0 con 0x7fca98142f40 2024-09-17T01:45:13.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.928+0000 7fca96a00640 1 --2- 172.21.15.42:0/3878805781 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fca74078b90 0x7fca7407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:13.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.929+0000 7fca96a00640 1 --2- 172.21.15.42:0/3878805781 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fca74078b90 0x7fca7407b0a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fca88000f60 tx=0x7fca88009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:13.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:13.932+0000 7fca8ea00640 1 -- 172.21.15.42:0/3878805781 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fca90063680 con 0x7fca98142f40 2024-09-17T01:45:14.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.161+0000 7fca9dc00640 1 -- 172.21.15.42:0/3878805781 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca98076880 con 0x7fca98142f40 2024-09-17T01:45:14.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.162+0000 7fca8ea00640 1 -- 172.21.15.42:0/3878805781 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) ==== 95+0+4407 (secure 0 0 0) 0x7fca98076880 con 0x7fca98142f40 2024-09-17T01:45:14.160 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:45:14.160 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":129,"btime":"2024-09-17T01:45:07:563535+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8872,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3393274334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3393274334},{"type":"v1","addr":"172.21.15.43:6836","nonce":3393274334}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":8875,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2869136532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2869136532},{"type":"v1","addr":"172.21.15.43:6837","nonce":2869136532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120}],"filesystems":[{"mdsmap":{"epoch":129,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:44:06.556661+0000","modified":"2024-09-17T01:45:07.563524+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":163,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9513},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9513":{"gid":9513,"name":"a","rank":0,"incarnation":126,"state":"up:active","state_seq":19,"addr":"172.21.15.42:6834/297557585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":297557585},{"type":"v1","addr":"172.21.15.42:6834","nonce":297557585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9513,"qdb_cluster":[9513]},"id":11}]} 2024-09-17T01:45:14.161 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 129 2024-09-17T01:45:14.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.165+0000 7fca9dc00640 1 -- 172.21.15.42:0/3878805781 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fca74078b90 msgr2=0x7fca7407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:14.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.165+0000 7fca9dc00640 1 --2- 172.21.15.42:0/3878805781 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fca74078b90 0x7fca7407b0a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fca88000f60 tx=0x7fca88009040 comp rx=0 tx=0).stop 2024-09-17T01:45:14.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.165+0000 7fca9dc00640 1 -- 172.21.15.42:0/3878805781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca98142f40 msgr2=0x7fca98137bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:14.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.165+0000 7fca9dc00640 1 --2- 172.21.15.42:0/3878805781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca98142f40 0x7fca98137bf0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7fca9000ea80 tx=0x7fca9000ef40 comp rx=0 tx=0).stop 2024-09-17T01:45:14.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.165+0000 7fca9dc00640 1 -- 172.21.15.42:0/3878805781 shutdown_connections 2024-09-17T01:45:14.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.165+0000 7fca9dc00640 1 --2- 172.21.15.42:0/3878805781 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fca74078b90 0x7fca7407b0a0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:14.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.165+0000 7fca9dc00640 1 --2- 172.21.15.42:0/3878805781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca98142f40 0x7fca98137bf0 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:14.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.165+0000 7fca9dc00640 1 --2- 172.21.15.42:0/3878805781 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fca980b3550 0x7fca981376b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:14.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.165+0000 7fca9dc00640 1 --2- 172.21.15.42:0/3878805781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca98072e90 0x7fca98140080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:14.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.165+0000 7fca9dc00640 1 -- 172.21.15.42:0/3878805781 >> 172.21.15.42:0/3878805781 conn(0x7fca980b2930 msgr2=0x7fca98160440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:14.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.165+0000 7fca9dc00640 1 -- 172.21.15.42:0/3878805781 shutdown_connections 2024-09-17T01:45:14.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.165+0000 7fca9dc00640 1 -- 172.21.15.42:0/3878805781 wait complete. 2024-09-17T01:45:14.186 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:45:14.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.416+0000 7fc30f800640 1 -- 172.21.15.42:0/1838086679 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2ec005150 msgr2=0x7fc2ec00ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:14.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.416+0000 7fc30f800640 1 --2- 172.21.15.42:0/1838086679 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2ec005150 0x7fc2ec00ffd0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7fc300002230 tx=0x7fc2ec005830 comp rx=0 tx=0).stop 2024-09-17T01:45:14.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.416+0000 7fc30f800640 1 -- 172.21.15.42:0/1838086679 shutdown_connections 2024-09-17T01:45:14.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.416+0000 7fc30f800640 1 --2- 172.21.15.42:0/1838086679 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2ec005150 0x7fc2ec00ffd0 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:14.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.416+0000 7fc30f800640 1 -- 172.21.15.42:0/1838086679 >> 172.21.15.42:0/1838086679 conn(0x7fc3080b2930 msgr2=0x7fc30806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:14.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.417+0000 7fc30f800640 1 -- 172.21.15.42:0/1838086679 shutdown_connections 2024-09-17T01:45:14.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.417+0000 7fc30f800640 1 -- 172.21.15.42:0/1838086679 wait complete. 2024-09-17T01:45:14.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.419+0000 7fc30f800640 1 Processor -- start 2024-09-17T01:45:14.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.419+0000 7fc30f800640 1 -- start start 2024-09-17T01:45:14.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.420+0000 7fc30f800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc2ec005150 0x7fc30814fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:14.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.420+0000 7fc30f800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3080ae7c0 0x7fc3080aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:14.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.420+0000 7fc30f800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3080ce6d0 0x7fc3080ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:14.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.420+0000 7fc30f800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc308152890 con 0x7fc3080ce6d0 2024-09-17T01:45:14.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.420+0000 7fc30f800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc308152710 con 0x7fc3080ae7c0 2024-09-17T01:45:14.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.420+0000 7fc30f800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc308152a10 con 0x7fc2ec005150 2024-09-17T01:45:14.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.421+0000 7fc30d800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3080ce6d0 0x7fc3080ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:14.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.421+0000 7fc30d800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3080ce6d0 0x7fc3080ceae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34230/0 (socket says 172.21.15.42:34230) 2024-09-17T01:45:14.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.421+0000 7fc30d800640 1 -- 172.21.15.42:0/3858991550 learned_addr learned my addr 172.21.15.42:0/3858991550 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:14.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.421+0000 7fc30ce00640 1 --2- 172.21.15.42:0/3858991550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc2ec005150 0x7fc30814fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:14.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.421+0000 7fc2ffe00640 1 --2- 172.21.15.42:0/3858991550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3080ae7c0 0x7fc3080aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:14.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.421+0000 7fc30d800640 1 -- 172.21.15.42:0/3858991550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc2ec005150 msgr2=0x7fc30814fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:14.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.421+0000 7fc30d800640 1 --2- 172.21.15.42:0/3858991550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc2ec005150 0x7fc30814fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:14.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.421+0000 7fc30d800640 1 -- 172.21.15.42:0/3858991550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3080ae7c0 msgr2=0x7fc3080aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:14.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.421+0000 7fc30d800640 1 --2- 172.21.15.42:0/3858991550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3080ae7c0 0x7fc3080aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:14.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.421+0000 7fc30d800640 1 -- 172.21.15.42:0/3858991550 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3080cf020 con 0x7fc3080ce6d0 2024-09-17T01:45:14.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.422+0000 7fc30d800640 1 --2- 172.21.15.42:0/3858991550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3080ce6d0 0x7fc3080ceae0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7fc30002b7d0 tx=0x7fc300001740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:14.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.422+0000 7fc305600640 1 -- 172.21.15.42:0/3858991550 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30002bae0 con 0x7fc3080ce6d0 2024-09-17T01:45:14.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.422+0000 7fc305600640 1 -- 172.21.15.42:0/3858991550 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc30003a070 con 0x7fc3080ce6d0 2024-09-17T01:45:14.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.422+0000 7fc30f800640 1 -- 172.21.15.42:0/3858991550 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3080ac3f0 con 0x7fc3080ce6d0 2024-09-17T01:45:14.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.422+0000 7fc305600640 1 -- 172.21.15.42:0/3858991550 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc300003970 con 0x7fc3080ce6d0 2024-09-17T01:45:14.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.422+0000 7fc30f800640 1 -- 172.21.15.42:0/3858991550 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3080ac970 con 0x7fc3080ce6d0 2024-09-17T01:45:14.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.423+0000 7fc30f800640 1 -- 172.21.15.42:0/3858991550 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc30815f890 con 0x7fc3080ce6d0 2024-09-17T01:45:14.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.424+0000 7fc305600640 1 -- 172.21.15.42:0/3858991550 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc30003c020 con 0x7fc3080ce6d0 2024-09-17T01:45:14.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.425+0000 7fc305600640 1 --2- 172.21.15.42:0/3858991550 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc2e4078bc0 0x7fc2e407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:14.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.425+0000 7fc305600640 1 -- 172.21.15.42:0/3858991550 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5824+0+0 (secure 0 0 0) 0x7fc3000ba5d0 con 0x7fc3080ce6d0 2024-09-17T01:45:14.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.426+0000 7fc30ce00640 1 --2- 172.21.15.42:0/3858991550 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc2e4078bc0 0x7fc2e407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:14.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.426+0000 7fc30ce00640 1 --2- 172.21.15.42:0/3858991550 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc2e4078bc0 0x7fc2e407b0d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009bd0 tx=0x7fc2f8005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:14.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.430+0000 7fc305600640 1 -- 172.21.15.42:0/3858991550 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc300045030 con 0x7fc3080ce6d0 2024-09-17T01:45:14.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.661+0000 7fc30f800640 1 -- 172.21.15.42:0/3858991550 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc30806a170 con 0x7fc3080ce6d0 2024-09-17T01:45:14.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.662+0000 7fc305600640 1 -- 172.21.15.42:0/3858991550 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) ==== 95+0+4407 (secure 0 0 0) 0x7fc3080cf020 con 0x7fc3080ce6d0 2024-09-17T01:45:14.660 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:45:14.661 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":129,"btime":"2024-09-17T01:45:07:563535+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8872,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3393274334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3393274334},{"type":"v1","addr":"172.21.15.43:6836","nonce":3393274334}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":8875,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2869136532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2869136532},{"type":"v1","addr":"172.21.15.43:6837","nonce":2869136532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120}],"filesystems":[{"mdsmap":{"epoch":129,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:44:06.556661+0000","modified":"2024-09-17T01:45:07.563524+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":163,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9513},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9513":{"gid":9513,"name":"a","rank":0,"incarnation":126,"state":"up:active","state_seq":19,"addr":"172.21.15.42:6834/297557585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":297557585},{"type":"v1","addr":"172.21.15.42:6834","nonce":297557585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9513,"qdb_cluster":[9513]},"id":11}]} 2024-09-17T01:45:14.661 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 129 2024-09-17T01:45:14.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.664+0000 7fc30f800640 1 -- 172.21.15.42:0/3858991550 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc2e4078bc0 msgr2=0x7fc2e407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:14.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.664+0000 7fc30f800640 1 --2- 172.21.15.42:0/3858991550 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc2e4078bc0 0x7fc2e407b0d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009bd0 tx=0x7fc2f8005f90 comp rx=0 tx=0).stop 2024-09-17T01:45:14.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.664+0000 7fc30f800640 1 -- 172.21.15.42:0/3858991550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3080ce6d0 msgr2=0x7fc3080ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:14.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.664+0000 7fc30f800640 1 --2- 172.21.15.42:0/3858991550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3080ce6d0 0x7fc3080ceae0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7fc30002b7d0 tx=0x7fc300001740 comp rx=0 tx=0).stop 2024-09-17T01:45:14.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.664+0000 7fc30f800640 1 -- 172.21.15.42:0/3858991550 shutdown_connections 2024-09-17T01:45:14.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.664+0000 7fc30f800640 1 --2- 172.21.15.42:0/3858991550 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc2e4078bc0 0x7fc2e407b0d0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:14.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.664+0000 7fc30f800640 1 --2- 172.21.15.42:0/3858991550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3080ae7c0 0x7fc3080aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:14.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.664+0000 7fc30f800640 1 --2- 172.21.15.42:0/3858991550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3080ce6d0 0x7fc3080ceae0 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:14.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.664+0000 7fc30f800640 1 --2- 172.21.15.42:0/3858991550 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc2ec005150 0x7fc30814fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:14.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.664+0000 7fc30f800640 1 -- 172.21.15.42:0/3858991550 >> 172.21.15.42:0/3858991550 conn(0x7fc3080b2930 msgr2=0x7fc3080b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:14.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.664+0000 7fc30f800640 1 -- 172.21.15.42:0/3858991550 shutdown_connections 2024-09-17T01:45:14.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.664+0000 7fc30f800640 1 -- 172.21.15.42:0/3858991550 wait complete. 2024-09-17T01:45:14.687 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:45:14.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.925+0000 7f36b4c00640 1 -- 172.21.15.42:0/2860514441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3694003a00 msgr2=0x7f3694003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:14.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.925+0000 7f36b4c00640 1 --2- 172.21.15.42:0/2860514441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3694003a00 0x7f3694003e70 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009b50 tx=0x7f3694005830 comp rx=0 tx=0).stop 2024-09-17T01:45:14.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.925+0000 7f36ae800640 1 -- 172.21.15.42:0/2860514441 reap_dead start 2024-09-17T01:45:14.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.925+0000 7f36b4c00640 1 -- 172.21.15.42:0/2860514441 shutdown_connections 2024-09-17T01:45:14.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.925+0000 7f36b4c00640 1 -- 172.21.15.42:0/2860514441 >> 172.21.15.42:0/2860514441 conn(0x7f36b00b2930 msgr2=0x7f36b006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:14.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.925+0000 7f36b4c00640 1 -- 172.21.15.42:0/2860514441 shutdown_connections 2024-09-17T01:45:14.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.925+0000 7f36b4c00640 1 -- 172.21.15.42:0/2860514441 wait complete. 2024-09-17T01:45:14.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.927+0000 7f36b4c00640 1 Processor -- start 2024-09-17T01:45:14.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.928+0000 7f36b4c00640 1 -- start start 2024-09-17T01:45:14.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.929+0000 7f36b4c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3694003a00 0x7f36b013ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:14.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.929+0000 7f36b4c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b0159dc0 0x7f36b01f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:14.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.929+0000 7f36b4c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b0140920 0x7f36b013fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:14.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.929+0000 7f36b4c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f36b015d440 con 0x7f36b0140920 2024-09-17T01:45:14.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.929+0000 7f36b4c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f36b015d2c0 con 0x7f36b0159dc0 2024-09-17T01:45:14.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.929+0000 7f36b4c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f36b015d5c0 con 0x7f3694003a00 2024-09-17T01:45:14.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.929+0000 7f36ae800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b0140920 0x7f36b013fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:14.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.929+0000 7f36ae800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b0140920 0x7f36b013fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34250/0 (socket says 172.21.15.42:34250) 2024-09-17T01:45:14.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.929+0000 7f36ae800640 1 -- 172.21.15.42:0/2795419056 learned_addr learned my addr 172.21.15.42:0/2795419056 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:14.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.930+0000 7f36ade00640 1 --2- 172.21.15.42:0/2795419056 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3694003a00 0x7f36b013ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:14.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.930+0000 7f36a5400640 1 --2- 172.21.15.42:0/2795419056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b0159dc0 0x7f36b01f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:14.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.930+0000 7f36ae800640 1 -- 172.21.15.42:0/2795419056 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3694003a00 msgr2=0x7f36b013ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:14.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.930+0000 7f36ae800640 1 --2- 172.21.15.42:0/2795419056 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3694003a00 0x7f36b013ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:14.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.930+0000 7f36ae800640 1 -- 172.21.15.42:0/2795419056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b0159dc0 msgr2=0x7f36b01f5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:14.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.930+0000 7f36ae800640 1 --2- 172.21.15.42:0/2795419056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b0159dc0 0x7f36b01f5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:14.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.930+0000 7f36ae800640 1 -- 172.21.15.42:0/2795419056 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b01f6360 con 0x7f36b0140920 2024-09-17T01:45:14.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.930+0000 7f36ae800640 1 --2- 172.21.15.42:0/2795419056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b0140920 0x7f36b013fbe0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f36b00cf940 tx=0x7f36a800d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:14.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.930+0000 7f36a6a00640 1 -- 172.21.15.42:0/2795419056 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a8003970 con 0x7f36b0140920 2024-09-17T01:45:14.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.930+0000 7f36a6a00640 1 -- 172.21.15.42:0/2795419056 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36a8003b10 con 0x7f36b0140920 2024-09-17T01:45:14.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.931+0000 7f36a6a00640 1 -- 172.21.15.42:0/2795419056 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a8004030 con 0x7f36b0140920 2024-09-17T01:45:14.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.931+0000 7f36b4c00640 1 -- 172.21.15.42:0/2795419056 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36b01f6640 con 0x7f36b0140920 2024-09-17T01:45:14.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.931+0000 7f36b4c00640 1 -- 172.21.15.42:0/2795419056 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36b01f5ff0 con 0x7f36b0140920 2024-09-17T01:45:14.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.932+0000 7f36b4c00640 1 -- 172.21.15.42:0/2795419056 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36b00cf050 con 0x7f36b0140920 2024-09-17T01:45:14.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.933+0000 7f36a6a00640 1 -- 172.21.15.42:0/2795419056 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f36a80041d0 con 0x7f36b0140920 2024-09-17T01:45:14.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.934+0000 7f36a6a00640 1 --2- 172.21.15.42:0/2795419056 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f368c078bc0 0x7f368c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:14.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.935+0000 7f36a6a00640 1 -- 172.21.15.42:0/2795419056 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5824+0+0 (secure 0 0 0) 0x7f36a809bb40 con 0x7f36b0140920 2024-09-17T01:45:14.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.935+0000 7f36ade00640 1 --2- 172.21.15.42:0/2795419056 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f368c078bc0 0x7f368c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:14.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.936+0000 7f36ade00640 1 --2- 172.21.15.42:0/2795419056 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f368c078bc0 0x7f368c07b0d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f36a0035000 tx=0x7f36a002d040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:14.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:14.939+0000 7f36a6a00640 1 -- 172.21.15.42:0/2795419056 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f36a8063840 con 0x7f36b0140920 2024-09-17T01:45:15.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.134+0000 7f36b4c00640 1 -- 172.21.15.42:0/2795419056 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36b006a170 con 0x7f36b0140920 2024-09-17T01:45:15.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.135+0000 7f36a6a00640 1 -- 172.21.15.42:0/2795419056 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) ==== 74+0+16870 (secure 0 0 0) 0x7f36a8068270 con 0x7f36b0140920 2024-09-17T01:45:15.134 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:45:15.134 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":163,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:45:04.547102+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:44:04.499543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T01:44:05.519952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"23.3a","mappings":[{"from":5,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6835/1557345672":"2024-09-18T01:45:04.547026+0000","172.21.15.42:6833/1557345672":"2024-09-18T01:45:04.547026+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:45:15.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.138+0000 7f36b4c00640 1 -- 172.21.15.42:0/2795419056 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f368c078bc0 msgr2=0x7f368c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:15.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.138+0000 7f36b4c00640 1 --2- 172.21.15.42:0/2795419056 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f368c078bc0 0x7f368c07b0d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f36a0035000 tx=0x7f36a002d040 comp rx=0 tx=0).stop 2024-09-17T01:45:15.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.138+0000 7f36b4c00640 1 -- 172.21.15.42:0/2795419056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b0140920 msgr2=0x7f36b013fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:15.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.138+0000 7f36b4c00640 1 --2- 172.21.15.42:0/2795419056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b0140920 0x7f36b013fbe0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f36b00cf940 tx=0x7f36a800d6b0 comp rx=0 tx=0).stop 2024-09-17T01:45:15.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.138+0000 7f36b4c00640 1 -- 172.21.15.42:0/2795419056 shutdown_connections 2024-09-17T01:45:15.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.138+0000 7f36b4c00640 1 --2- 172.21.15.42:0/2795419056 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f368c078bc0 0x7f368c07b0d0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:15.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.138+0000 7f36b4c00640 1 --2- 172.21.15.42:0/2795419056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b0159dc0 0x7f36b01f5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:15.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.138+0000 7f36b4c00640 1 --2- 172.21.15.42:0/2795419056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b0140920 0x7f36b013fbe0 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:15.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.138+0000 7f36b4c00640 1 --2- 172.21.15.42:0/2795419056 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3694003a00 0x7f36b013ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:15.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.138+0000 7f36b4c00640 1 -- 172.21.15.42:0/2795419056 >> 172.21.15.42:0/2795419056 conn(0x7f36b00b2930 msgr2=0x7f36b015f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:15.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.138+0000 7f36b4c00640 1 -- 172.21.15.42:0/2795419056 shutdown_connections 2024-09-17T01:45:15.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.138+0000 7f36b4c00640 1 -- 172.21.15.42:0/2795419056 wait complete. 2024-09-17T01:45:15.158 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T01:45:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.387+0000 7f36be800640 1 -- 172.21.15.42:0/1024985435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b80b3550 msgr2=0x7f36b815cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.387+0000 7f36be800640 1 --2- 172.21.15.42:0/1024985435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b80b3550 0x7f36b815cec0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f36b80704d0 tx=0x7f36a802a4d0 comp rx=0 tx=0).stop 2024-09-17T01:45:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.387+0000 7f36be800640 1 -- 172.21.15.42:0/1024985435 shutdown_connections 2024-09-17T01:45:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.387+0000 7f36be800640 1 --2- 172.21.15.42:0/1024985435 >> v2:172.21.15.43:3300/0 conn(0x7f36b8142f40 0x7f36b8072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.387+0000 7f36be800640 1 --2- 172.21.15.42:0/1024985435 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36b8072e90 0x7f36b80cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.387+0000 7f36be800640 1 --2- 172.21.15.42:0/1024985435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b80b3550 0x7f36b815cec0 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:15.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.387+0000 7f36be800640 1 -- 172.21.15.42:0/1024985435 >> 172.21.15.42:0/1024985435 conn(0x7f36b80b2930 msgr2=0x7f36b806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:15.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.387+0000 7f36be800640 1 -- 172.21.15.42:0/1024985435 shutdown_connections 2024-09-17T01:45:15.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.387+0000 7f36be800640 1 -- 172.21.15.42:0/1024985435 wait complete. 2024-09-17T01:45:15.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.389+0000 7f36be800640 1 Processor -- start 2024-09-17T01:45:15.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.390+0000 7f36be800640 1 -- start start 2024-09-17T01:45:15.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.391+0000 7f36be800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b8072e90 0x7f36b814a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:15.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.391+0000 7f36be800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b80b3550 0x7f36b81f07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:15.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.391+0000 7f36be800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36b8142f40 0x7f36b81f6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:15.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.391+0000 7f36be800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f36b806d430 con 0x7f36b80b3550 2024-09-17T01:45:15.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.391+0000 7f36be800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f36b806d5b0 con 0x7f36b8072e90 2024-09-17T01:45:15.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.391+0000 7f36be800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f36b806d730 con 0x7f36b8142f40 2024-09-17T01:45:15.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.391+0000 7f36afe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b80b3550 0x7f36b81f07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:15.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.391+0000 7f36afe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b80b3550 0x7f36b81f07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:34270/0 (socket says 172.21.15.42:34270) 2024-09-17T01:45:15.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.391+0000 7f36afe00640 1 -- 172.21.15.42:0/76283127 learned_addr learned my addr 172.21.15.42:0/76283127 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:15.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.391+0000 7f36b7400640 1 --2- 172.21.15.42:0/76283127 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b8072e90 0x7f36b814a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:15.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.391+0000 7f36b7e00640 1 --2- 172.21.15.42:0/76283127 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36b8142f40 0x7f36b81f6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:15.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.392+0000 7f36afe00640 1 -- 172.21.15.42:0/76283127 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36b8142f40 msgr2=0x7f36b81f6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:15.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.392+0000 7f36afe00640 1 --2- 172.21.15.42:0/76283127 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36b8142f40 0x7f36b81f6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:15.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.392+0000 7f36afe00640 1 -- 172.21.15.42:0/76283127 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b8072e90 msgr2=0x7f36b814a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:15.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.392+0000 7f36afe00640 1 --2- 172.21.15.42:0/76283127 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b8072e90 0x7f36b814a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:15.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.392+0000 7f36afe00640 1 -- 172.21.15.42:0/76283127 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b815b060 con 0x7f36b80b3550 2024-09-17T01:45:15.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.392+0000 7f36afe00640 1 --2- 172.21.15.42:0/76283127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b80b3550 0x7f36b81f07a0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f36a000c970 tx=0x7f36a000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:15.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.392+0000 7f36af400640 1 -- 172.21.15.42:0/76283127 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a0007b50 con 0x7f36b80b3550 2024-09-17T01:45:15.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.392+0000 7f36af400640 1 -- 172.21.15.42:0/76283127 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36a0007de0 con 0x7f36b80b3550 2024-09-17T01:45:15.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.392+0000 7f36be800640 1 -- 172.21.15.42:0/76283127 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36b815b340 con 0x7f36b80b3550 2024-09-17T01:45:15.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.392+0000 7f36af400640 1 -- 172.21.15.42:0/76283127 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a000f6b0 con 0x7f36b80b3550 2024-09-17T01:45:15.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.392+0000 7f36be800640 1 -- 172.21.15.42:0/76283127 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36b815b900 con 0x7f36b80b3550 2024-09-17T01:45:15.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.393+0000 7f36be800640 1 -- 172.21.15.42:0/76283127 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36b806dc50 con 0x7f36b80b3550 2024-09-17T01:45:15.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.395+0000 7f36af400640 1 -- 172.21.15.42:0/76283127 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f36a000f850 con 0x7f36b80b3550 2024-09-17T01:45:15.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.396+0000 7f36af400640 1 --2- 172.21.15.42:0/76283127 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3694078bc0 0x7f369407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:15.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.396+0000 7f36af400640 1 -- 172.21.15.42:0/76283127 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5824+0+0 (secure 0 0 0) 0x7f36a009b460 con 0x7f36b80b3550 2024-09-17T01:45:15.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.396+0000 7f36b7400640 1 --2- 172.21.15.42:0/76283127 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3694078bc0 0x7f369407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:15.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.397+0000 7f36b7400640 1 --2- 172.21.15.42:0/76283127 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3694078bc0 0x7f369407b0d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f36a8033000 tx=0x7f36a8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:15.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.400+0000 7f36af400640 1 -- 172.21.15.42:0/76283127 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f36a0014030 con 0x7f36b80b3550 2024-09-17T01:45:15.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.630+0000 7f36be800640 1 -- 172.21.15.42:0/76283127 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f36b814d5a0 con 0x7f36b80b3550 2024-09-17T01:45:15.629 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-17T01:45:15.631+0000 7f9961e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:45:15.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.633+0000 7f36af400640 1 -- 172.21.15.42:0/76283127 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v130) ==== 161+0+0 (secure 0 0 0) 0x7f36a0063840 con 0x7f36b80b3550 2024-09-17T01:45:15.631 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T01:45:15.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.635+0000 7f36be800640 1 -- 172.21.15.42:0/76283127 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3694078bc0 msgr2=0x7f369407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:15.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.635+0000 7f36be800640 1 --2- 172.21.15.42:0/76283127 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3694078bc0 0x7f369407b0d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f36a8033000 tx=0x7f36a8004730 comp rx=0 tx=0).stop 2024-09-17T01:45:15.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.635+0000 7f36be800640 1 -- 172.21.15.42:0/76283127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b80b3550 msgr2=0x7f36b81f07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:15.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.635+0000 7f36be800640 1 --2- 172.21.15.42:0/76283127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b80b3550 0x7f36b81f07a0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f36a000c970 tx=0x7f36a000ce30 comp rx=0 tx=0).stop 2024-09-17T01:45:15.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.636+0000 7f36be800640 1 -- 172.21.15.42:0/76283127 shutdown_connections 2024-09-17T01:45:15.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.636+0000 7f36be800640 1 --2- 172.21.15.42:0/76283127 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3694078bc0 0x7f369407b0d0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:15.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.636+0000 7f36be800640 1 --2- 172.21.15.42:0/76283127 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f36b8142f40 0x7f36b81f6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:15.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.636+0000 7f36be800640 1 --2- 172.21.15.42:0/76283127 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36b80b3550 0x7f36b81f07a0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:15.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.636+0000 7f36be800640 1 --2- 172.21.15.42:0/76283127 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b8072e90 0x7f36b814a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:15.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.636+0000 7f36be800640 1 -- 172.21.15.42:0/76283127 >> 172.21.15.42:0/76283127 conn(0x7f36b80b2930 msgr2=0x7f36b815f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:15.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.636+0000 7f36be800640 1 -- 172.21.15.42:0/76283127 shutdown_connections 2024-09-17T01:45:15.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.637+0000 7f36be800640 1 -- 172.21.15.42:0/76283127 wait complete. 2024-09-17T01:45:15.659 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T01:45:15.791 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:45:15.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.904+0000 7fe1b4a00640 1 -- 172.21.15.42:0/412198667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b00ccb90 msgr2=0x7fe1b015c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:15.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.904+0000 7fe1b4a00640 1 --2- 172.21.15.42:0/412198667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b00ccb90 0x7fe1b015c6c0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe198009830 tx=0x7fe19802a530 comp rx=0 tx=0).stop 2024-09-17T01:45:15.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.904+0000 7fe1b4a00640 1 -- 172.21.15.42:0/412198667 shutdown_connections 2024-09-17T01:45:15.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.904+0000 7fe1b4a00640 1 --2- 172.21.15.42:0/412198667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b00ccb90 0x7fe1b015c6c0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:15.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.904+0000 7fe1b4a00640 1 -- 172.21.15.42:0/412198667 >> 172.21.15.42:0/412198667 conn(0x7fe1b006d440 msgr2=0x7fe1b00b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:15.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.905+0000 7fe1b4a00640 1 -- 172.21.15.42:0/412198667 shutdown_connections 2024-09-17T01:45:15.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.905+0000 7fe1b4a00640 1 -- 172.21.15.42:0/412198667 wait complete. 2024-09-17T01:45:15.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.907+0000 7fe1b4a00640 1 Processor -- start 2024-09-17T01:45:15.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.907+0000 7fe1b4a00640 1 -- start start 2024-09-17T01:45:15.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.908+0000 7fe1b4a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b00af910 0x7fe1b0153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:15.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.908+0000 7fe1b4a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1b00b32b0 0x7fe1b01f32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:15.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.908+0000 7fe1b4a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1b00ccb90 0x7fe1b00b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:15.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.908+0000 7fe1b4a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b006e840 con 0x7fe1b00b32b0 2024-09-17T01:45:15.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.908+0000 7fe1b4a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b00b53a0 con 0x7fe1b00af910 2024-09-17T01:45:15.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.908+0000 7fe1b4a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe1b006e9c0 con 0x7fe1b00ccb90 2024-09-17T01:45:15.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.909+0000 7fe1a7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1b00b32b0 0x7fe1b01f32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:15.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.909+0000 7fe1a7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1b00b32b0 0x7fe1b01f32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36684/0 (socket says 172.21.15.42:36684) 2024-09-17T01:45:15.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.909+0000 7fe1a7e00640 1 -- 172.21.15.42:0/3788223487 learned_addr learned my addr 172.21.15.42:0/3788223487 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:15.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.909+0000 7fe1af400640 1 --2- 172.21.15.42:0/3788223487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b00af910 0x7fe1b0153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:15.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.909+0000 7fe1afe00640 1 --2- 172.21.15.42:0/3788223487 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1b00ccb90 0x7fe1b00b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:15.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.909+0000 7fe1a7e00640 1 -- 172.21.15.42:0/3788223487 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1b00ccb90 msgr2=0x7fe1b00b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:15.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.909+0000 7fe1a7e00640 1 --2- 172.21.15.42:0/3788223487 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1b00ccb90 0x7fe1b00b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:15.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.909+0000 7fe1a7e00640 1 -- 172.21.15.42:0/3788223487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b00af910 msgr2=0x7fe1b0153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:15.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.909+0000 7fe1a7e00640 1 --2- 172.21.15.42:0/3788223487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b00af910 0x7fe1b0153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:15.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.909+0000 7fe1a7e00640 1 -- 172.21.15.42:0/3788223487 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b0146910 con 0x7fe1b00b32b0 2024-09-17T01:45:15.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.909+0000 7fe1af400640 1 --2- 172.21.15.42:0/3788223487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b00af910 0x7fe1b0153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:45:15.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.909+0000 7fe1a7e00640 1 --2- 172.21.15.42:0/3788223487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1b00b32b0 0x7fe1b01f32f0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fe198009950 tx=0x7fe198033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:15.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.910+0000 7fe1a7400640 1 -- 172.21.15.42:0/3788223487 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe198031d60 con 0x7fe1b00b32b0 2024-09-17T01:45:15.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.910+0000 7fe1a7400640 1 -- 172.21.15.42:0/3788223487 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe198033e10 con 0x7fe1b00b32b0 2024-09-17T01:45:15.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.910+0000 7fe1a7400640 1 -- 172.21.15.42:0/3788223487 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe198033310 con 0x7fe1b00b32b0 2024-09-17T01:45:15.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.910+0000 7fe1b4a00640 1 -- 172.21.15.42:0/3788223487 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1b00724e0 con 0x7fe1b00b32b0 2024-09-17T01:45:15.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.910+0000 7fe1b4a00640 1 -- 172.21.15.42:0/3788223487 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1b0072aa0 con 0x7fe1b00b32b0 2024-09-17T01:45:15.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.911+0000 7fe1b4a00640 1 -- 172.21.15.42:0/3788223487 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1b01538b0 con 0x7fe1b00b32b0 2024-09-17T01:45:15.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.912+0000 7fe1a7400640 1 -- 172.21.15.42:0/3788223487 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe1980334b0 con 0x7fe1b00b32b0 2024-09-17T01:45:15.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.913+0000 7fe1a7400640 1 --2- 172.21.15.42:0/3788223487 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe18c078bc0 0x7fe18c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:15.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.913+0000 7fe1a7400640 1 -- 172.21.15.42:0/3788223487 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 5910+0+0 (secure 0 0 0) 0x7fe1980bc2e0 con 0x7fe1b00b32b0 2024-09-17T01:45:15.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.913+0000 7fe1af400640 1 --2- 172.21.15.42:0/3788223487 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe18c078bc0 0x7fe18c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:15.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.914+0000 7fe1af400640 1 --2- 172.21.15.42:0/3788223487 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe18c078bc0 0x7fe18c07b0d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0007fd0 tx=0x7fe1a0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:15.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:15.918+0000 7fe1a7400640 1 -- 172.21.15.42:0/3788223487 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe19803f030 con 0x7fe1b00b32b0 2024-09-17T01:45:16.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.149+0000 7fe1b4a00640 1 -- 172.21.15.42:0/3788223487 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe1b015c6c0 con 0x7fe1b00b32b0 2024-09-17T01:45:16.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.635+0000 7fe1a7400640 1 -- 172.21.15.42:0/3788223487 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v131) ==== 104+0+0 (secure 0 0 0) 0x7fe198084640 con 0x7fe1b00b32b0 2024-09-17T01:45:16.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.637+0000 7fe1b4a00640 1 -- 172.21.15.42:0/3788223487 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe18c078bc0 msgr2=0x7fe18c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:16.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.637+0000 7fe1b4a00640 1 --2- 172.21.15.42:0/3788223487 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe18c078bc0 0x7fe18c07b0d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0007fd0 tx=0x7fe1a0009040 comp rx=0 tx=0).stop 2024-09-17T01:45:16.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.637+0000 7fe1b4a00640 1 -- 172.21.15.42:0/3788223487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1b00b32b0 msgr2=0x7fe1b01f32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:16.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.637+0000 7fe1b4a00640 1 --2- 172.21.15.42:0/3788223487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1b00b32b0 0x7fe1b01f32f0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fe198009950 tx=0x7fe198033c20 comp rx=0 tx=0).stop 2024-09-17T01:45:16.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.638+0000 7fe1b4a00640 1 -- 172.21.15.42:0/3788223487 shutdown_connections 2024-09-17T01:45:16.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.638+0000 7fe1b4a00640 1 --2- 172.21.15.42:0/3788223487 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe18c078bc0 0x7fe18c07b0d0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:16.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.638+0000 7fe1b4a00640 1 --2- 172.21.15.42:0/3788223487 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1b00ccb90 0x7fe1b00b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:16.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.638+0000 7fe1b4a00640 1 --2- 172.21.15.42:0/3788223487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1b00b32b0 0x7fe1b01f32f0 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:16.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.638+0000 7fe1b4a00640 1 --2- 172.21.15.42:0/3788223487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1b00af910 0x7fe1b0153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:16.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.638+0000 7fe1b4a00640 1 -- 172.21.15.42:0/3788223487 >> 172.21.15.42:0/3788223487 conn(0x7fe1b006d440 msgr2=0x7fe1b00d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:16.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.638+0000 7fe1b4a00640 1 -- 172.21.15.42:0/3788223487 shutdown_connections 2024-09-17T01:45:16.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.638+0000 7fe1b4a00640 1 -- 172.21.15.42:0/3788223487 wait complete. 2024-09-17T01:45:16.660 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T01:45:16.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.895+0000 7fd024e00640 1 -- 172.21.15.42:0/755757298 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd02006d430 msgr2=0x7fd02015d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:16.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.895+0000 7fd024e00640 1 --2- 172.21.15.42:0/755757298 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd02006d430 0x7fd02015d6a0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7fd0200ca750 tx=0x7fd00802a5f0 comp rx=0 tx=0).stop 2024-09-17T01:45:16.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.895+0000 7fd024e00640 1 -- 172.21.15.42:0/755757298 shutdown_connections 2024-09-17T01:45:16.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.895+0000 7fd024e00640 1 --2- 172.21.15.42:0/755757298 >> v2:172.21.15.43:3300/0 conn(0x7fd0200aebf0 0x7fd0200b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:16.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.895+0000 7fd024e00640 1 --2- 172.21.15.42:0/755757298 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd02006d430 0x7fd02015d6a0 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:16.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.895+0000 7fd024e00640 1 -- 172.21.15.42:0/755757298 >> 172.21.15.42:0/755757298 conn(0x7fd0200b25d0 msgr2=0x7fd0200d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:16.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.895+0000 7fd024e00640 1 -- 172.21.15.42:0/755757298 shutdown_connections 2024-09-17T01:45:16.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.895+0000 7fd024e00640 1 -- 172.21.15.42:0/755757298 wait complete. 2024-09-17T01:45:16.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.898+0000 7fd024e00640 1 Processor -- start 2024-09-17T01:45:16.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.898+0000 7fd024e00640 1 -- start start 2024-09-17T01:45:16.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.899+0000 7fd024e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0200aebf0 0x7fd0200749f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:16.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.899+0000 7fd024e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0200af4f0 0x7fd02014fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:16.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.899+0000 7fd024e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0201f55f0 0x7fd0200c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:16.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.899+0000 7fd024e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd0200b3760 con 0x7fd0200af4f0 2024-09-17T01:45:16.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.899+0000 7fd024e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd0200b35e0 con 0x7fd0201f55f0 2024-09-17T01:45:16.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.899+0000 7fd024e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd0200b38e0 con 0x7fd0200aebf0 2024-09-17T01:45:16.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.899+0000 7fd017e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0200af4f0 0x7fd02014fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:16.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.899+0000 7fd017e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0200af4f0 0x7fd02014fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36698/0 (socket says 172.21.15.42:36698) 2024-09-17T01:45:16.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.899+0000 7fd017e00640 1 -- 172.21.15.42:0/2363272510 learned_addr learned my addr 172.21.15.42:0/2363272510 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:16.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.900+0000 7fd01f400640 1 --2- 172.21.15.42:0/2363272510 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0200aebf0 0x7fd0200749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:16.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.900+0000 7fd01fe00640 1 --2- 172.21.15.42:0/2363272510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0201f55f0 0x7fd0200c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:16.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.900+0000 7fd017e00640 1 -- 172.21.15.42:0/2363272510 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0200aebf0 msgr2=0x7fd0200749f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:16.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.900+0000 7fd017e00640 1 --2- 172.21.15.42:0/2363272510 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0200aebf0 0x7fd0200749f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:16.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.900+0000 7fd017e00640 1 -- 172.21.15.42:0/2363272510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0201f55f0 msgr2=0x7fd0200c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:16.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.900+0000 7fd017e00640 1 --2- 172.21.15.42:0/2363272510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0201f55f0 0x7fd0200c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:16.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.900+0000 7fd017e00640 1 -- 172.21.15.42:0/2363272510 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0201f6120 con 0x7fd0200af4f0 2024-09-17T01:45:16.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.900+0000 7fd017e00640 1 --2- 172.21.15.42:0/2363272510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0200af4f0 0x7fd02014fae0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7fd008034040 tx=0x7fd008003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:16.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.900+0000 7fd017400640 1 -- 172.21.15.42:0/2363272510 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00803e030 con 0x7fd0200af4f0 2024-09-17T01:45:16.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.901+0000 7fd017400640 1 -- 172.21.15.42:0/2363272510 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd008003d10 con 0x7fd0200af4f0 2024-09-17T01:45:16.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.901+0000 7fd017400640 1 -- 172.21.15.42:0/2363272510 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd008035040 con 0x7fd0200af4f0 2024-09-17T01:45:16.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.901+0000 7fd024e00640 1 -- 172.21.15.42:0/2363272510 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0201f6400 con 0x7fd0200af4f0 2024-09-17T01:45:16.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.901+0000 7fd024e00640 1 -- 172.21.15.42:0/2363272510 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0200744d0 con 0x7fd0200af4f0 2024-09-17T01:45:16.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.902+0000 7fd024e00640 1 -- 172.21.15.42:0/2363272510 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0201f5e90 con 0x7fd0200af4f0 2024-09-17T01:45:16.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.903+0000 7fd017400640 1 -- 172.21.15.42:0/2363272510 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd008041030 con 0x7fd0200af4f0 2024-09-17T01:45:16.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.904+0000 7fd017400640 1 --2- 172.21.15.42:0/2363272510 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcffc078b90 0x7fcffc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:16.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.904+0000 7fd017400640 1 -- 172.21.15.42:0/2363272510 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 5910+0+0 (secure 0 0 0) 0x7fd0080bb580 con 0x7fd0200af4f0 2024-09-17T01:45:16.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.905+0000 7fd01f400640 1 --2- 172.21.15.42:0/2363272510 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcffc078b90 0x7fcffc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:16.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.906+0000 7fd01f400640 1 --2- 172.21.15.42:0/2363272510 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcffc078b90 0x7fcffc07b0a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd0200b4ff0 tx=0x7fd010009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:16.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:16.909+0000 7fd017400640 1 -- 172.21.15.42:0/2363272510 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd008083200 con 0x7fd0200af4f0 2024-09-17T01:45:17.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.101+0000 7fd024e00640 1 -- 172.21.15.42:0/2363272510 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd0200b3e00 con 0x7fd0200af4f0 2024-09-17T01:45:17.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.642+0000 7fd017400640 1 -- 172.21.15.42:0/2363272510 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v165) ==== 181+0+0 (secure 0 0 0) 0x7fd008087c30 con 0x7fd0200af4f0 2024-09-17T01:45:17.640 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-09-17T01:45:17.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.645+0000 7fd024e00640 1 -- 172.21.15.42:0/2363272510 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcffc078b90 msgr2=0x7fcffc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:17.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.645+0000 7fd024e00640 1 --2- 172.21.15.42:0/2363272510 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcffc078b90 0x7fcffc07b0a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd0200b4ff0 tx=0x7fd010009040 comp rx=0 tx=0).stop 2024-09-17T01:45:17.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.645+0000 7fd024e00640 1 -- 172.21.15.42:0/2363272510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0200af4f0 msgr2=0x7fd02014fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:17.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.645+0000 7fd024e00640 1 --2- 172.21.15.42:0/2363272510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0200af4f0 0x7fd02014fae0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7fd008034040 tx=0x7fd008003820 comp rx=0 tx=0).stop 2024-09-17T01:45:17.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.646+0000 7fd024e00640 1 -- 172.21.15.42:0/2363272510 shutdown_connections 2024-09-17T01:45:17.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.646+0000 7fd024e00640 1 --2- 172.21.15.42:0/2363272510 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcffc078b90 0x7fcffc07b0a0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:17.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.646+0000 7fd024e00640 1 --2- 172.21.15.42:0/2363272510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0201f55f0 0x7fd0200c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:17.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.646+0000 7fd024e00640 1 --2- 172.21.15.42:0/2363272510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0200af4f0 0x7fd02014fae0 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:17.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.646+0000 7fd024e00640 1 --2- 172.21.15.42:0/2363272510 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd0200aebf0 0x7fd0200749f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:17.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.646+0000 7fd024e00640 1 -- 172.21.15.42:0/2363272510 >> 172.21.15.42:0/2363272510 conn(0x7fd0200b25d0 msgr2=0x7fd0200afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:17.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.646+0000 7fd024e00640 1 -- 172.21.15.42:0/2363272510 shutdown_connections 2024-09-17T01:45:17.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.646+0000 7fd024e00640 1 -- 172.21.15.42:0/2363272510 wait complete. 2024-09-17T01:45:17.674 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T01:45:17.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.908+0000 7f6ad8e00640 1 -- 172.21.15.42:0/3991151143 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ad40cdb20 msgr2=0x7f6ad40cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:17.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.908+0000 7f6ad8e00640 1 --2- 172.21.15.42:0/3991151143 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ad40cdb20 0x7f6ad40cdf30 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40747b0 tx=0x7f6abc02a560 comp rx=0 tx=0).stop 2024-09-17T01:45:17.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.908+0000 7f6ad8e00640 1 -- 172.21.15.42:0/3991151143 shutdown_connections 2024-09-17T01:45:17.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.908+0000 7f6ad8e00640 1 --2- 172.21.15.42:0/3991151143 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ad406d430 0x7f6ad406d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:17.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.908+0000 7f6ad8e00640 1 --2- 172.21.15.42:0/3991151143 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ad40cdb20 0x7f6ad40cdf30 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:17.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.908+0000 7f6ad8e00640 1 --2- 172.21.15.42:0/3991151143 >> v2:172.21.15.43:3300/0 conn(0x7f6ad40b56d0 0x7f6ad40b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:17.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.908+0000 7f6ad8e00640 1 -- 172.21.15.42:0/3991151143 >> 172.21.15.42:0/3991151143 conn(0x7f6ad40b28f0 msgr2=0x7f6ad406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:17.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.909+0000 7f6ad8e00640 1 -- 172.21.15.42:0/3991151143 shutdown_connections 2024-09-17T01:45:17.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.909+0000 7f6ad8e00640 1 -- 172.21.15.42:0/3991151143 wait complete. 2024-09-17T01:45:17.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.911+0000 7f6ad8e00640 1 Processor -- start 2024-09-17T01:45:17.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.911+0000 7f6ad8e00640 1 -- start start 2024-09-17T01:45:17.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.912+0000 7f6ad8e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad406d430 0x7f6ad415c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:17.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.912+0000 7f6ad8e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ad40b56d0 0x7f6ad40b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:17.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.912+0000 7f6ad8e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ad40cdb20 0x7f6ad40b0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:17.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.912+0000 7f6ad8e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad415d350 con 0x7f6ad40cdb20 2024-09-17T01:45:17.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.912+0000 7f6ad8e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad415d1d0 con 0x7f6ad406d430 2024-09-17T01:45:17.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.912+0000 7f6ad8e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad415d4d0 con 0x7f6ad40b56d0 2024-09-17T01:45:17.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.913+0000 7f6ad2800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ad40cdb20 0x7f6ad40b0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:17.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.913+0000 7f6ad2800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ad40cdb20 0x7f6ad40b0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36720/0 (socket says 172.21.15.42:36720) 2024-09-17T01:45:17.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.913+0000 7f6ad2800640 1 -- 172.21.15.42:0/99542053 learned_addr learned my addr 172.21.15.42:0/99542053 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:17.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.913+0000 7f6acbe00640 1 --2- 172.21.15.42:0/99542053 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ad40b56d0 0x7f6ad40b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:17.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.913+0000 7f6ad1e00640 1 --2- 172.21.15.42:0/99542053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad406d430 0x7f6ad415c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:17.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.913+0000 7f6ad2800640 1 -- 172.21.15.42:0/99542053 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ad40b56d0 msgr2=0x7f6ad40b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:17.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.913+0000 7f6ad2800640 1 --2- 172.21.15.42:0/99542053 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ad40b56d0 0x7f6ad40b09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:17.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.913+0000 7f6ad2800640 1 -- 172.21.15.42:0/99542053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad406d430 msgr2=0x7f6ad415c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:17.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.913+0000 7f6ad2800640 1 --2- 172.21.15.42:0/99542053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad406d430 0x7f6ad415c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:17.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.913+0000 7f6ad2800640 1 -- 172.21.15.42:0/99542053 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad41f6490 con 0x7f6ad40cdb20 2024-09-17T01:45:17.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.913+0000 7f6acbe00640 1 --2- 172.21.15.42:0/99542053 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ad40b56d0 0x7f6ad40b09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:45:17.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.914+0000 7f6ad2800640 1 --2- 172.21.15.42:0/99542053 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ad40cdb20 0x7f6ad40b0f30 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f6acc00e960 tx=0x7f6acc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:17.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.914+0000 7f6aca000640 1 -- 172.21.15.42:0/99542053 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc004d20 con 0x7f6ad40cdb20 2024-09-17T01:45:17.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.914+0000 7f6aca000640 1 -- 172.21.15.42:0/99542053 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6acc00cac0 con 0x7f6ad40cdb20 2024-09-17T01:45:17.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.914+0000 7f6ad8e00640 1 -- 172.21.15.42:0/99542053 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad40724e0 con 0x7f6ad40cdb20 2024-09-17T01:45:17.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.914+0000 7f6aca000640 1 -- 172.21.15.42:0/99542053 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc005020 con 0x7f6ad40cdb20 2024-09-17T01:45:17.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.914+0000 7f6ad8e00640 1 -- 172.21.15.42:0/99542053 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad40c59e0 con 0x7f6ad40cdb20 2024-09-17T01:45:17.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.915+0000 7f6ad8e00640 1 -- 172.21.15.42:0/99542053 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad40c5c40 con 0x7f6ad40cdb20 2024-09-17T01:45:17.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.916+0000 7f6aca000640 1 -- 172.21.15.42:0/99542053 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6acc0051c0 con 0x7f6ad40cdb20 2024-09-17T01:45:17.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.917+0000 7f6aca000640 1 --2- 172.21.15.42:0/99542053 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6ab0078b90 0x7f6ab007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:17.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.917+0000 7f6aca000640 1 -- 172.21.15.42:0/99542053 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5472+0+0 (secure 0 0 0) 0x7f6acc09b7d0 con 0x7f6ad40cdb20 2024-09-17T01:45:17.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.918+0000 7f6ad1e00640 1 --2- 172.21.15.42:0/99542053 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6ab0078b90 0x7f6ab007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:17.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.918+0000 7f6ad1e00640 1 --2- 172.21.15.42:0/99542053 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6ab0078b90 0x7f6ab007b0a0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f6ac400bad0 tx=0x7f6ac400b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:17.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:17.921+0000 7f6aca000640 1 -- 172.21.15.42:0/99542053 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6acc016030 con 0x7f6ad40cdb20 2024-09-17T01:45:18.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.116+0000 7f6ad8e00640 1 -- 172.21.15.42:0/99542053 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6ad40af130 con 0x7f6ad40cdb20 2024-09-17T01:45:18.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.644+0000 7f6aca000640 1 -- 172.21.15.42:0/99542053 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v166) ==== 169+0+0 (secure 0 0 0) 0x7f6acc0636c0 con 0x7f6ad40cdb20 2024-09-17T01:45:18.642 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-09-17T01:45:18.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.648+0000 7f6ad8e00640 1 -- 172.21.15.42:0/99542053 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6ab0078b90 msgr2=0x7f6ab007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:18.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.648+0000 7f6ad8e00640 1 --2- 172.21.15.42:0/99542053 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6ab0078b90 0x7f6ab007b0a0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f6ac400bad0 tx=0x7f6ac400b2e0 comp rx=0 tx=0).stop 2024-09-17T01:45:18.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.648+0000 7f6ad8e00640 1 -- 172.21.15.42:0/99542053 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ad40cdb20 msgr2=0x7f6ad40b0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:18.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.648+0000 7f6ad8e00640 1 --2- 172.21.15.42:0/99542053 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ad40cdb20 0x7f6ad40b0f30 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f6acc00e960 tx=0x7f6acc00ee20 comp rx=0 tx=0).stop 2024-09-17T01:45:18.646 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.648+0000 7f6ad8e00640 1 -- 172.21.15.42:0/99542053 shutdown_connections 2024-09-17T01:45:18.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.648+0000 7f6ad8e00640 1 --2- 172.21.15.42:0/99542053 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6ab0078b90 0x7f6ab007b0a0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:18.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.648+0000 7f6ad8e00640 1 --2- 172.21.15.42:0/99542053 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ad40cdb20 0x7f6ad40b0f30 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:18.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.648+0000 7f6ad8e00640 1 --2- 172.21.15.42:0/99542053 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ad40b56d0 0x7f6ad40b09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:18.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.648+0000 7f6ad8e00640 1 --2- 172.21.15.42:0/99542053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad406d430 0x7f6ad415c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:18.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.648+0000 7f6ad8e00640 1 -- 172.21.15.42:0/99542053 >> 172.21.15.42:0/99542053 conn(0x7f6ad40b28f0 msgr2=0x7f6ad406fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:18.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.649+0000 7f6ad8e00640 1 -- 172.21.15.42:0/99542053 shutdown_connections 2024-09-17T01:45:18.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.649+0000 7f6ad8e00640 1 -- 172.21.15.42:0/99542053 wait complete. 2024-09-17T01:45:18.682 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T01:45:18.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.925+0000 7f9790000640 1 -- 172.21.15.42:0/2196830333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f978806d430 msgr2=0x7f978806d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:18.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.925+0000 7f9790000640 1 --2- 172.21.15.42:0/2196830333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f978806d430 0x7f978806d840 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f9774005fd0 tx=0x7f977402a5c0 comp rx=0 tx=0).stop 2024-09-17T01:45:18.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.925+0000 7f9790000640 1 -- 172.21.15.42:0/2196830333 shutdown_connections 2024-09-17T01:45:18.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.925+0000 7f9790000640 1 --2- 172.21.15.42:0/2196830333 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f978815f480 0x7f978815f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:18.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.925+0000 7f9790000640 1 --2- 172.21.15.42:0/2196830333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f978806d430 0x7f978806d840 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:18.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.925+0000 7f9790000640 1 -- 172.21.15.42:0/2196830333 >> 172.21.15.42:0/2196830333 conn(0x7f97880b2930 msgr2=0x7f978806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:18.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.925+0000 7f9790000640 1 -- 172.21.15.42:0/2196830333 shutdown_connections 2024-09-17T01:45:18.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.925+0000 7f9790000640 1 -- 172.21.15.42:0/2196830333 wait complete. 2024-09-17T01:45:18.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.927+0000 7f9790000640 1 Processor -- start 2024-09-17T01:45:18.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.928+0000 7f9790000640 1 -- start start 2024-09-17T01:45:18.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.929+0000 7f9790000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f978806d430 0x7f97881f6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:18.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.929+0000 7f9790000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f978815cb80 0x7f97881556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:18.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.929+0000 7f9790000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f978815f480 0x7f978815e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:18.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.929+0000 7f9790000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9788073820 con 0x7f978815cb80 2024-09-17T01:45:18.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.929+0000 7f9790000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f97880736a0 con 0x7f978806d430 2024-09-17T01:45:18.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.929+0000 7f9790000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f97880739a0 con 0x7f978815f480 2024-09-17T01:45:18.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.929+0000 7f978cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f978815cb80 0x7f97881556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:18.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.929+0000 7f978cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f978815cb80 0x7f97881556c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36742/0 (socket says 172.21.15.42:36742) 2024-09-17T01:45:18.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.929+0000 7f978cc00640 1 -- 172.21.15.42:0/3401951704 learned_addr learned my addr 172.21.15.42:0/3401951704 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:18.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.930+0000 7f978d600640 1 --2- 172.21.15.42:0/3401951704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f978806d430 0x7f97881f6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:18.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.930+0000 7f978e000640 1 --2- 172.21.15.42:0/3401951704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f978815f480 0x7f978815e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:18.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.930+0000 7f978cc00640 1 -- 172.21.15.42:0/3401951704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f978815f480 msgr2=0x7f978815e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:18.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.930+0000 7f978cc00640 1 --2- 172.21.15.42:0/3401951704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f978815f480 0x7f978815e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:18.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.930+0000 7f978cc00640 1 -- 172.21.15.42:0/3401951704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f978806d430 msgr2=0x7f97881f6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:18.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.930+0000 7f978cc00640 1 --2- 172.21.15.42:0/3401951704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f978806d430 0x7f97881f6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:18.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.930+0000 7f978cc00640 1 -- 172.21.15.42:0/3401951704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f978814e5e0 con 0x7f978815cb80 2024-09-17T01:45:18.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.930+0000 7f978d600640 1 --2- 172.21.15.42:0/3401951704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f978806d430 0x7f97881f6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:45:18.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.930+0000 7f978cc00640 1 --2- 172.21.15.42:0/3401951704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f978815cb80 0x7f97881556c0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f9774034040 tx=0x7f97740038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:18.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.930+0000 7f9785600640 1 -- 172.21.15.42:0/3401951704 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977403e030 con 0x7f978815cb80 2024-09-17T01:45:18.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.931+0000 7f9790000640 1 -- 172.21.15.42:0/3401951704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f978814d060 con 0x7f978815cb80 2024-09-17T01:45:18.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.931+0000 7f9785600640 1 -- 172.21.15.42:0/3401951704 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9774003d90 con 0x7f978815cb80 2024-09-17T01:45:18.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.931+0000 7f9785600640 1 -- 172.21.15.42:0/3401951704 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9774035040 con 0x7f978815cb80 2024-09-17T01:45:18.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.931+0000 7f9790000640 1 -- 172.21.15.42:0/3401951704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9788150c70 con 0x7f978815cb80 2024-09-17T01:45:18.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.932+0000 7f9790000640 1 -- 172.21.15.42:0/3401951704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97881506e0 con 0x7f978815cb80 2024-09-17T01:45:18.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.933+0000 7f9785600640 1 -- 172.21.15.42:0/3401951704 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9774041030 con 0x7f978815cb80 2024-09-17T01:45:18.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.934+0000 7f9785600640 1 --2- 172.21.15.42:0/3401951704 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9768078bc0 0x7f976807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:18.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.934+0000 7f9785600640 1 -- 172.21.15.42:0/3401951704 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5029+0+0 (secure 0 0 0) 0x7f97740bb7b0 con 0x7f978815cb80 2024-09-17T01:45:18.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.934+0000 7f978d600640 1 --2- 172.21.15.42:0/3401951704 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9768078bc0 0x7f976807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:18.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.935+0000 7f978d600640 1 --2- 172.21.15.42:0/3401951704 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9768078bc0 0x7f976807b0d0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f977c007fd0 tx=0x7f977c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:18.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:18.938+0000 7f9785600640 1 -- 172.21.15.42:0/3401951704 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9774083d70 con 0x7f978815cb80 2024-09-17T01:45:19.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.157+0000 7f9790000640 1 -- 172.21.15.42:0/3401951704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f9788073ec0 con 0x7f978815cb80 2024-09-17T01:45:19.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.162+0000 7f9785600640 1 -- 172.21.15.42:0/3401951704 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v59) ==== 71+0+0 (secure 0 0 0) 0x7f9774083670 con 0x7f978815cb80 2024-09-17T01:45:19.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.164+0000 7f9790000640 1 -- 172.21.15.42:0/3401951704 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9768078bc0 msgr2=0x7f976807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:19.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.164+0000 7f9790000640 1 --2- 172.21.15.42:0/3401951704 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9768078bc0 0x7f976807b0d0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f977c007fd0 tx=0x7f977c009040 comp rx=0 tx=0).stop 2024-09-17T01:45:19.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.164+0000 7f9790000640 1 -- 172.21.15.42:0/3401951704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f978815cb80 msgr2=0x7f97881556c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:19.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.164+0000 7f9790000640 1 --2- 172.21.15.42:0/3401951704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f978815cb80 0x7f97881556c0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f9774034040 tx=0x7f97740038a0 comp rx=0 tx=0).stop 2024-09-17T01:45:19.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.164+0000 7f9790000640 1 -- 172.21.15.42:0/3401951704 shutdown_connections 2024-09-17T01:45:19.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.164+0000 7f9790000640 1 --2- 172.21.15.42:0/3401951704 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9768078bc0 0x7f976807b0d0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:19.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.164+0000 7f9790000640 1 --2- 172.21.15.42:0/3401951704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f978815f480 0x7f978815e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:19.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.164+0000 7f9790000640 1 --2- 172.21.15.42:0/3401951704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f978815cb80 0x7f97881556c0 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:19.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.164+0000 7f9790000640 1 --2- 172.21.15.42:0/3401951704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f978806d430 0x7f97881f6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:19.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.164+0000 7f9790000640 1 -- 172.21.15.42:0/3401951704 >> 172.21.15.42:0/3401951704 conn(0x7f97880b2930 msgr2=0x7f978806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:19.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.164+0000 7f9790000640 1 -- 172.21.15.42:0/3401951704 shutdown_connections 2024-09-17T01:45:19.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.164+0000 7f9790000640 1 -- 172.21.15.42:0/3401951704 wait complete. 2024-09-17T01:45:19.190 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-09-17T01:45:19.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.418+0000 7f5d91e00640 1 -- 172.21.15.42:0/2021974148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d8c0cec40 msgr2=0x7f5d8c0cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:19.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.418+0000 7f5d91e00640 1 --2- 172.21.15.42:0/2021974148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d8c0cec40 0x7f5d8c0cf050 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f5d84005fd0 tx=0x7f5d8402a970 comp rx=0 tx=0).stop 2024-09-17T01:45:19.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.418+0000 7f5d91e00640 1 -- 172.21.15.42:0/2021974148 shutdown_connections 2024-09-17T01:45:19.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.418+0000 7f5d91e00640 1 --2- 172.21.15.42:0/2021974148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d8c0cec40 0x7f5d8c0cf050 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:19.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.418+0000 7f5d91e00640 1 --2- 172.21.15.42:0/2021974148 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5d8c0b3550 0x7f5d8c15cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:19.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.418+0000 7f5d91e00640 1 -- 172.21.15.42:0/2021974148 >> 172.21.15.42:0/2021974148 conn(0x7f5d8c0b2930 msgr2=0x7f5d8c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:19.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.418+0000 7f5d91e00640 1 -- 172.21.15.42:0/2021974148 shutdown_connections 2024-09-17T01:45:19.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.418+0000 7f5d91e00640 1 -- 172.21.15.42:0/2021974148 wait complete. 2024-09-17T01:45:19.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.420+0000 7f5d91e00640 1 Processor -- start 2024-09-17T01:45:19.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.420+0000 7f5d91e00640 1 -- start start 2024-09-17T01:45:19.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.422+0000 7f5d91e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d8c0b3550 0x7f5d8c133de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:19.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.422+0000 7f5d91e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d8c0cec40 0x7f5d8c134320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:19.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.422+0000 7f5d91e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5d8c142f40 0x7f5d8c132b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:19.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.422+0000 7f5d91e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c06d7c0 con 0x7f5d8c0cec40 2024-09-17T01:45:19.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.422+0000 7f5d91e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c06d640 con 0x7f5d8c0b3550 2024-09-17T01:45:19.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.422+0000 7f5d91e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5d8c06d940 con 0x7f5d8c142f40 2024-09-17T01:45:19.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.422+0000 7f5d82000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d8c0cec40 0x7f5d8c134320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:19.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.422+0000 7f5d82000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d8c0cec40 0x7f5d8c134320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36758/0 (socket says 172.21.15.42:36758) 2024-09-17T01:45:19.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.422+0000 7f5d82000640 1 -- 172.21.15.42:0/2272804690 learned_addr learned my addr 172.21.15.42:0/2272804690 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:19.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.422+0000 7f5d8aa00640 1 --2- 172.21.15.42:0/2272804690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d8c0b3550 0x7f5d8c133de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:19.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.422+0000 7f5d8b400640 1 --2- 172.21.15.42:0/2272804690 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5d8c142f40 0x7f5d8c132b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:19.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.423+0000 7f5d82000640 1 -- 172.21.15.42:0/2272804690 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5d8c142f40 msgr2=0x7f5d8c132b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:19.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.423+0000 7f5d82000640 1 --2- 172.21.15.42:0/2272804690 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5d8c142f40 0x7f5d8c132b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:19.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.423+0000 7f5d82000640 1 -- 172.21.15.42:0/2272804690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d8c0b3550 msgr2=0x7f5d8c133de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:19.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.423+0000 7f5d82000640 1 --2- 172.21.15.42:0/2272804690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d8c0b3550 0x7f5d8c133de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:19.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.423+0000 7f5d82000640 1 -- 172.21.15.42:0/2272804690 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d8c131df0 con 0x7f5d8c0cec40 2024-09-17T01:45:19.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.423+0000 7f5d82000640 1 --2- 172.21.15.42:0/2272804690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d8c0cec40 0x7f5d8c134320 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400b420 tx=0x7f5d7400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:19.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.423+0000 7f5d83e00640 1 -- 172.21.15.42:0/2272804690 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d74011830 con 0x7f5d8c0cec40 2024-09-17T01:45:19.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.423+0000 7f5d83e00640 1 -- 172.21.15.42:0/2272804690 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d74016070 con 0x7f5d8c0cec40 2024-09-17T01:45:19.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.423+0000 7f5d83e00640 1 -- 172.21.15.42:0/2272804690 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d74011d60 con 0x7f5d8c0cec40 2024-09-17T01:45:19.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.423+0000 7f5d91e00640 1 -- 172.21.15.42:0/2272804690 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d8c132060 con 0x7f5d8c0cec40 2024-09-17T01:45:19.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.423+0000 7f5d91e00640 1 -- 172.21.15.42:0/2272804690 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d8c132620 con 0x7f5d8c0cec40 2024-09-17T01:45:19.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.425+0000 7f5d91e00640 1 -- 172.21.15.42:0/2272804690 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d8c15afb0 con 0x7f5d8c0cec40 2024-09-17T01:45:19.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.426+0000 7f5d83e00640 1 -- 172.21.15.42:0/2272804690 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5d7401b460 con 0x7f5d8c0cec40 2024-09-17T01:45:19.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.427+0000 7f5d83e00640 1 --2- 172.21.15.42:0/2272804690 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5d68078bc0 0x7f5d6807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:19.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.427+0000 7f5d83e00640 1 -- 172.21.15.42:0/2272804690 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5029+0+0 (secure 0 0 0) 0x7f5d7409a480 con 0x7f5d8c0cec40 2024-09-17T01:45:19.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.427+0000 7f5d8aa00640 1 --2- 172.21.15.42:0/2272804690 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5d68078bc0 0x7f5d6807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:19.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.428+0000 7f5d8aa00640 1 --2- 172.21.15.42:0/2272804690 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5d68078bc0 0x7f5d6807b0d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c004630 tx=0x7f5d7c00b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:19.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.431+0000 7f5d83e00640 1 -- 172.21.15.42:0/2272804690 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5d74020020 con 0x7f5d8c0cec40 2024-09-17T01:45:19.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:19.697+0000 7f5d91e00640 1 -- 172.21.15.42:0/2272804690 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) -- 0x7f5d8c15cec0 con 0x7f5d8c0cec40 2024-09-17T01:45:20.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.659+0000 7f5d83e00640 1 -- 172.21.15.42:0/2272804690 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v629) ==== 166+0+0 (secure 0 0 0) 0x7f5d74062500 con 0x7f5d8c0cec40 2024-09-17T01:45:20.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.663+0000 7f5d91e00640 1 -- 172.21.15.42:0/2272804690 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5d68078bc0 msgr2=0x7f5d6807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:20.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.663+0000 7f5d91e00640 1 --2- 172.21.15.42:0/2272804690 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5d68078bc0 0x7f5d6807b0d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c004630 tx=0x7f5d7c00b2e0 comp rx=0 tx=0).stop 2024-09-17T01:45:20.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.663+0000 7f5d91e00640 1 -- 172.21.15.42:0/2272804690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d8c0cec40 msgr2=0x7f5d8c134320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.663+0000 7f5d91e00640 1 --2- 172.21.15.42:0/2272804690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d8c0cec40 0x7f5d8c134320 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400b420 tx=0x7f5d7400b8e0 comp rx=0 tx=0).stop 2024-09-17T01:45:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.663+0000 7f5d91e00640 1 -- 172.21.15.42:0/2272804690 shutdown_connections 2024-09-17T01:45:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.663+0000 7f5d91e00640 1 --2- 172.21.15.42:0/2272804690 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5d68078bc0 0x7f5d6807b0d0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.663+0000 7f5d91e00640 1 --2- 172.21.15.42:0/2272804690 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5d8c142f40 0x7f5d8c132b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.663+0000 7f5d91e00640 1 --2- 172.21.15.42:0/2272804690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d8c0cec40 0x7f5d8c134320 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.663+0000 7f5d91e00640 1 --2- 172.21.15.42:0/2272804690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d8c0b3550 0x7f5d8c133de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.663+0000 7f5d91e00640 1 -- 172.21.15.42:0/2272804690 >> 172.21.15.42:0/2272804690 conn(0x7f5d8c0b2930 msgr2=0x7f5d8c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.663+0000 7f5d91e00640 1 -- 172.21.15.42:0/2272804690 shutdown_connections 2024-09-17T01:45:20.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.663+0000 7f5d91e00640 1 -- 172.21.15.42:0/2272804690 wait complete. 2024-09-17T01:45:20.686 INFO:tasks.cephfs_test_runner:test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-17T01:45:20.687 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-17T01:45:20.687 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:45:20.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.922+0000 7f5de4c00640 1 -- 172.21.15.42:0/1967626461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de00b4be0 msgr2=0x7f5de015d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:20.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.922+0000 7f5de4c00640 1 --2- 172.21.15.42:0/1967626461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de00b4be0 0x7f5de015d6b0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0009830 tx=0x7f5dd002a510 comp rx=0 tx=0).stop 2024-09-17T01:45:20.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.922+0000 7f5de4c00640 1 -- 172.21.15.42:0/1967626461 shutdown_connections 2024-09-17T01:45:20.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.922+0000 7f5de4c00640 1 --2- 172.21.15.42:0/1967626461 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de00b4be0 0x7f5de015d6b0 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:20.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.922+0000 7f5de4c00640 1 -- 172.21.15.42:0/1967626461 >> 172.21.15.42:0/1967626461 conn(0x7f5de00b25f0 msgr2=0x7f5de00d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:20.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.922+0000 7f5de4c00640 1 -- 172.21.15.42:0/1967626461 shutdown_connections 2024-09-17T01:45:20.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.922+0000 7f5de4c00640 1 -- 172.21.15.42:0/1967626461 wait complete. 2024-09-17T01:45:20.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.924+0000 7f5de4c00640 1 Processor -- start 2024-09-17T01:45:20.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.924+0000 7f5de4c00640 1 -- start start 2024-09-17T01:45:20.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.926+0000 7f5de4c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5de00b4be0 0x7f5de0150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:20.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.926+0000 7f5de4c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5de00cf7c0 0x7f5de00c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:20.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.926+0000 7f5de4c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de00b02b0 0x7f5de00c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:20.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.926+0000 7f5de4c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5de01535e0 con 0x7f5de00b02b0 2024-09-17T01:45:20.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.926+0000 7f5de4c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5de00b4340 con 0x7f5de00b4be0 2024-09-17T01:45:20.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.926+0000 7f5de4c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5de0153760 con 0x7f5de00cf7c0 2024-09-17T01:45:20.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.926+0000 7f5ddfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de00b02b0 0x7f5de00c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:20.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.926+0000 7f5ddfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de00b02b0 0x7f5de00c9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36768/0 (socket says 172.21.15.42:36768) 2024-09-17T01:45:20.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.926+0000 7f5ddfe00640 1 -- 172.21.15.42:0/3151055939 learned_addr learned my addr 172.21.15.42:0/3151055939 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:20.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.926+0000 7f5ddf400640 1 --2- 172.21.15.42:0/3151055939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5de00b4be0 0x7f5de0150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:20.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.926+0000 7f5dd6a00640 1 --2- 172.21.15.42:0/3151055939 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5de00cf7c0 0x7f5de00c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:20.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.927+0000 7f5ddfe00640 1 -- 172.21.15.42:0/3151055939 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5de00cf7c0 msgr2=0x7f5de00c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:20.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.927+0000 7f5ddfe00640 1 --2- 172.21.15.42:0/3151055939 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5de00cf7c0 0x7f5de00c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:20.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.927+0000 7f5ddfe00640 1 -- 172.21.15.42:0/3151055939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5de00b4be0 msgr2=0x7f5de0150800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:20.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.927+0000 7f5ddfe00640 1 --2- 172.21.15.42:0/3151055939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5de00b4be0 0x7f5de0150800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:20.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.927+0000 7f5ddfe00640 1 -- 172.21.15.42:0/3151055939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de0150d40 con 0x7f5de00b02b0 2024-09-17T01:45:20.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.927+0000 7f5ddfe00640 1 --2- 172.21.15.42:0/3151055939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de00b02b0 0x7f5de00c9960 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800c760 tx=0x7f5dd800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:20.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.927+0000 7f5dd7e00640 1 -- 172.21.15.42:0/3151055939 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8017070 con 0x7f5de00b02b0 2024-09-17T01:45:20.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.927+0000 7f5dd7e00640 1 -- 172.21.15.42:0/3151055939 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5dd800ce10 con 0x7f5de00b02b0 2024-09-17T01:45:20.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.927+0000 7f5de4c00640 1 -- 172.21.15.42:0/3151055939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5de0074e80 con 0x7f5de00b02b0 2024-09-17T01:45:20.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.927+0000 7f5dd7e00640 1 -- 172.21.15.42:0/3151055939 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd80052b0 con 0x7f5de00b02b0 2024-09-17T01:45:20.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.928+0000 7f5de4c00640 1 -- 172.21.15.42:0/3151055939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5de00cbb20 con 0x7f5de00b02b0 2024-09-17T01:45:20.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.929+0000 7f5de4c00640 1 -- 172.21.15.42:0/3151055939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5de00cb630 con 0x7f5de00b02b0 2024-09-17T01:45:20.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.930+0000 7f5dd7e00640 1 -- 172.21.15.42:0/3151055939 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5dd801a070 con 0x7f5de00b02b0 2024-09-17T01:45:20.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.931+0000 7f5dd7e00640 1 --2- 172.21.15.42:0/3151055939 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5dbc078bc0 0x7f5dbc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:20.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.931+0000 7f5dd7e00640 1 -- 172.21.15.42:0/3151055939 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5029+0+0 (secure 0 0 0) 0x7f5dd8099fe0 con 0x7f5de00b02b0 2024-09-17T01:45:20.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.932+0000 7f5ddf400640 1 --2- 172.21.15.42:0/3151055939 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5dbc078bc0 0x7f5dbc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:20.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.932+0000 7f5ddf400640 1 --2- 172.21.15.42:0/3151055939 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5dbc078bc0 0x7f5dbc07b0d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0034000 tx=0x7f5dd0004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:20.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:20.935+0000 7f5dd7e00640 1 -- 172.21.15.42:0/3151055939 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5de0150d40 con 0x7f5de00b02b0 2024-09-17T01:45:21.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.131+0000 7f5de4c00640 1 -- 172.21.15.42:0/3151055939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5de015d6b0 con 0x7f5de00b02b0 2024-09-17T01:45:21.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.131+0000 7f5dd7e00640 1 -- 172.21.15.42:0/3151055939 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) ==== 74+0+13122 (secure 0 0 0) 0x7f5dd8069e20 con 0x7f5de00b02b0 2024-09-17T01:45:21.129 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:45:21.130 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":166,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:45:18.642803+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6834/297557585":"2024-09-18T01:45:15.631947+0000","172.21.15.42:6832/297557585":"2024-09-18T01:45:15.631947+0000","172.21.15.42:6835/1557345672":"2024-09-18T01:45:04.547026+0000","172.21.15.42:6833/1557345672":"2024-09-18T01:45:04.547026+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:45:21.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.134+0000 7f5de4c00640 1 -- 172.21.15.42:0/3151055939 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5dbc078bc0 msgr2=0x7f5dbc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:21.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.134+0000 7f5de4c00640 1 --2- 172.21.15.42:0/3151055939 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5dbc078bc0 0x7f5dbc07b0d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0034000 tx=0x7f5dd0004730 comp rx=0 tx=0).stop 2024-09-17T01:45:21.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.134+0000 7f5de4c00640 1 -- 172.21.15.42:0/3151055939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de00b02b0 msgr2=0x7f5de00c9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:21.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.134+0000 7f5de4c00640 1 --2- 172.21.15.42:0/3151055939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de00b02b0 0x7f5de00c9960 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800c760 tx=0x7f5dd800cc20 comp rx=0 tx=0).stop 2024-09-17T01:45:21.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.134+0000 7f5de4c00640 1 -- 172.21.15.42:0/3151055939 shutdown_connections 2024-09-17T01:45:21.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.134+0000 7f5de4c00640 1 --2- 172.21.15.42:0/3151055939 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5dbc078bc0 0x7f5dbc07b0d0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:21.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.134+0000 7f5de4c00640 1 --2- 172.21.15.42:0/3151055939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5de00b02b0 0x7f5de00c9960 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:21.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.134+0000 7f5de4c00640 1 --2- 172.21.15.42:0/3151055939 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5de00cf7c0 0x7f5de00c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:21.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.134+0000 7f5de4c00640 1 --2- 172.21.15.42:0/3151055939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5de00b4be0 0x7f5de0150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:21.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.134+0000 7f5de4c00640 1 -- 172.21.15.42:0/3151055939 >> 172.21.15.42:0/3151055939 conn(0x7f5de00b25f0 msgr2=0x7f5de0151c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:21.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.134+0000 7f5de4c00640 1 -- 172.21.15.42:0/3151055939 shutdown_connections 2024-09-17T01:45:21.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.134+0000 7f5de4c00640 1 -- 172.21.15.42:0/3151055939 wait complete. 2024-09-17T01:45:21.157 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T01:31:55.004951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T01:45:21.158 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T01:45:21.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.391+0000 7f6acf200640 1 -- 172.21.15.42:0/3524904438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ab4004d40 msgr2=0x7f6ab4005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:21.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.391+0000 7f6acf200640 1 --2- 172.21.15.42:0/3524904438 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ab4004d40 0x7f6ab4005150 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800c470 tx=0x7f6ab4005830 comp rx=0 tx=0).stop 2024-09-17T01:45:21.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.391+0000 7f6ace800640 1 -- 172.21.15.42:0/3524904438 reap_dead start 2024-09-17T01:45:21.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.391+0000 7f6acf200640 1 -- 172.21.15.42:0/3524904438 shutdown_connections 2024-09-17T01:45:21.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.391+0000 7f6acf200640 1 -- 172.21.15.42:0/3524904438 >> 172.21.15.42:0/3524904438 conn(0x7f6ad00d12e0 msgr2=0x7f6ad00d16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.391+0000 7f6acf200640 1 -- 172.21.15.42:0/3524904438 shutdown_connections 2024-09-17T01:45:21.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.391+0000 7f6acf200640 1 -- 172.21.15.42:0/3524904438 wait complete. 2024-09-17T01:45:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.393+0000 7f6acf200640 1 Processor -- start 2024-09-17T01:45:21.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.393+0000 7f6acf200640 1 -- start start 2024-09-17T01:45:21.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.395+0000 7f6acf200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ab4004d40 0x7f6ad00c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:21.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.395+0000 7f6acf200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ad01504d0 0x7f6ad00b2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:21.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.395+0000 7f6acf200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad00b2c80 0x7f6ad014d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:21.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.395+0000 7f6acf200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad0163500 con 0x7f6ab4004d40 2024-09-17T01:45:21.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.395+0000 7f6acf200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad00d0420 con 0x7f6ad00b2c80 2024-09-17T01:45:21.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.395+0000 7f6acf200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad015eb30 con 0x7f6ad01504d0 2024-09-17T01:45:21.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.395+0000 7f6acde00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ab4004d40 0x7f6ad00c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:21.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.395+0000 7f6acde00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ab4004d40 0x7f6ad00c88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36782/0 (socket says 172.21.15.42:36782) 2024-09-17T01:45:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.395+0000 7f6acde00640 1 -- 172.21.15.42:0/676192271 learned_addr learned my addr 172.21.15.42:0/676192271 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.395+0000 7f6ace800640 1 --2- 172.21.15.42:0/676192271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad00b2c80 0x7f6ad014d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.396+0000 7f6ac5400640 1 --2- 172.21.15.42:0/676192271 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ad01504d0 0x7f6ad00b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.396+0000 7f6acde00640 1 -- 172.21.15.42:0/676192271 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ad01504d0 msgr2=0x7f6ad00b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.396+0000 7f6acde00640 1 --2- 172.21.15.42:0/676192271 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ad01504d0 0x7f6ad00b2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.396+0000 7f6acde00640 1 -- 172.21.15.42:0/676192271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad00b2c80 msgr2=0x7f6ad014d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.396+0000 7f6acde00640 1 --2- 172.21.15.42:0/676192271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad00b2c80 0x7f6ad014d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.396+0000 7f6acde00640 1 -- 172.21.15.42:0/676192271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad00c9140 con 0x7f6ab4004d40 2024-09-17T01:45:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.396+0000 7f6ac5400640 1 --2- 172.21.15.42:0/676192271 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ad01504d0 0x7f6ad00b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:45:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.396+0000 7f6acde00640 1 --2- 172.21.15.42:0/676192271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ab4004d40 0x7f6ad00c88f0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0010bf0 tx=0x7f6ac000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.396+0000 7f6ac6a00640 1 -- 172.21.15.42:0/676192271 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0003b70 con 0x7f6ab4004d40 2024-09-17T01:45:21.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.396+0000 7f6ac6a00640 1 -- 172.21.15.42:0/676192271 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ac0003e20 con 0x7f6ab4004d40 2024-09-17T01:45:21.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.396+0000 7f6ac6a00640 1 -- 172.21.15.42:0/676192271 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0004290 con 0x7f6ab4004d40 2024-09-17T01:45:21.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.396+0000 7f6acf200640 1 -- 172.21.15.42:0/676192271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad00c9420 con 0x7f6ab4004d40 2024-09-17T01:45:21.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.396+0000 7f6acf200640 1 -- 172.21.15.42:0/676192271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad00c99e0 con 0x7f6ab4004d40 2024-09-17T01:45:21.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.397+0000 7f6acf200640 1 -- 172.21.15.42:0/676192271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad00b6100 con 0x7f6ab4004d40 2024-09-17T01:45:21.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.399+0000 7f6ac6a00640 1 -- 172.21.15.42:0/676192271 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ac0004430 con 0x7f6ab4004d40 2024-09-17T01:45:21.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.400+0000 7f6ac6a00640 1 --2- 172.21.15.42:0/676192271 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6aac078b90 0x7f6aac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:21.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.400+0000 7f6ac6a00640 1 -- 172.21.15.42:0/676192271 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5029+0+0 (secure 0 0 0) 0x7f6ac009bc50 con 0x7f6ab4004d40 2024-09-17T01:45:21.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.401+0000 7f6ac5400640 1 --2- 172.21.15.42:0/676192271 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6aac078b90 0x7f6aac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:21.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.401+0000 7f6ac5400640 1 --2- 172.21.15.42:0/676192271 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6aac078b90 0x7f6aac07b0a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f6ad015c8a0 tx=0x7f6ab8005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:21.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.404+0000 7f6ac6a00640 1 -- 172.21.15.42:0/676192271 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6ac0064320 con 0x7f6ab4004d40 2024-09-17T01:45:21.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.596+0000 7f6acf200640 1 -- 172.21.15.42:0/676192271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6ad00d51a0 con 0x7f6ab4004d40 2024-09-17T01:45:21.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.597+0000 7f6ac6a00640 1 -- 172.21.15.42:0/676192271 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v166) ==== 93+0+10 (secure 0 0 0) 0x7f6ac0063c20 con 0x7f6ab4004d40 2024-09-17T01:45:21.595 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-09-17T01:45:21.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.599+0000 7f6acf200640 1 -- 172.21.15.42:0/676192271 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6aac078b90 msgr2=0x7f6aac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:21.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.599+0000 7f6acf200640 1 --2- 172.21.15.42:0/676192271 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6aac078b90 0x7f6aac07b0a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f6ad015c8a0 tx=0x7f6ab8005f90 comp rx=0 tx=0).stop 2024-09-17T01:45:21.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.599+0000 7f6acf200640 1 -- 172.21.15.42:0/676192271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ab4004d40 msgr2=0x7f6ad00c88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:21.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.599+0000 7f6acf200640 1 --2- 172.21.15.42:0/676192271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ab4004d40 0x7f6ad00c88f0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0010bf0 tx=0x7f6ac000e720 comp rx=0 tx=0).stop 2024-09-17T01:45:21.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.599+0000 7f6acf200640 1 -- 172.21.15.42:0/676192271 shutdown_connections 2024-09-17T01:45:21.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.599+0000 7f6acf200640 1 --2- 172.21.15.42:0/676192271 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6aac078b90 0x7f6aac07b0a0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:21.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.599+0000 7f6acf200640 1 --2- 172.21.15.42:0/676192271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad00b2c80 0x7f6ad014d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:21.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.599+0000 7f6acf200640 1 --2- 172.21.15.42:0/676192271 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ad01504d0 0x7f6ad00b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:21.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.599+0000 7f6acf200640 1 --2- 172.21.15.42:0/676192271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ab4004d40 0x7f6ad00c88f0 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:21.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.599+0000 7f6acf200640 1 -- 172.21.15.42:0/676192271 >> 172.21.15.42:0/676192271 conn(0x7f6ad00d12e0 msgr2=0x7f6ad00b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:21.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.600+0000 7f6acf200640 1 -- 172.21.15.42:0/676192271 shutdown_connections 2024-09-17T01:45:21.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.600+0000 7f6acf200640 1 -- 172.21.15.42:0/676192271 wait complete. 2024-09-17T01:45:21.612 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:45:21.616 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:45:21.624 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-09-17T01:45:21.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.894+0000 7f4664c00640 1 -- 172.21.15.42:0/616167189 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46600af460 msgr2=0x7f46600ad5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:21.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.895+0000 7f4664c00640 1 --2- 172.21.15.42:0/616167189 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46600af460 0x7f46600ad5c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4658005fd0 tx=0x7f465802a8b0 comp rx=0 tx=0).stop 2024-09-17T01:45:21.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.895+0000 7f4664c00640 1 -- 172.21.15.42:0/616167189 shutdown_connections 2024-09-17T01:45:21.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.895+0000 7f4664c00640 1 --2- 172.21.15.42:0/616167189 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46600af460 0x7f46600ad5c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:21.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.895+0000 7f4664c00640 1 --2- 172.21.15.42:0/616167189 >> v2:172.21.15.43:3300/0 conn(0x7f466006d430 0x7f46600ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:21.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.895+0000 7f4664c00640 1 -- 172.21.15.42:0/616167189 >> 172.21.15.42:0/616167189 conn(0x7f46600b25f0 msgr2=0x7f46600d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:21.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.895+0000 7f4664c00640 1 -- 172.21.15.42:0/616167189 shutdown_connections 2024-09-17T01:45:21.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.895+0000 7f4664c00640 1 -- 172.21.15.42:0/616167189 wait complete. 2024-09-17T01:45:21.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.897+0000 7f4664c00640 1 Processor -- start 2024-09-17T01:45:21.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.897+0000 7f4664c00640 1 -- start start 2024-09-17T01:45:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.899+0000 7f4664c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46600af460 0x7f46600b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.899+0000 7f4664c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46600d0d80 0x7f46601ebd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.899+0000 7f4664c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46601f89d0 0x7f46601f8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.899+0000 7f4664c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f46600adb00 con 0x7f46600af460 2024-09-17T01:45:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.899+0000 7f4664c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f466015ec10 con 0x7f46601f89d0 2024-09-17T01:45:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.899+0000 7f4664c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f46600adc80 con 0x7f46600d0d80 2024-09-17T01:45:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.899+0000 7f465f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46600af460 0x7f46600b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.899+0000 7f465f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46600af460 0x7f46600b46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36794/0 (socket says 172.21.15.42:36794) 2024-09-17T01:45:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.899+0000 7f465f400640 1 -- 172.21.15.42:0/3236391426 learned_addr learned my addr 172.21.15.42:0/3236391426 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:21.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.899+0000 7f465fe00640 1 --2- 172.21.15.42:0/3236391426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46601f89d0 0x7f46601f8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.899+0000 7f4657e00640 1 --2- 172.21.15.42:0/3236391426 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46600d0d80 0x7f46601ebd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.899+0000 7f465f400640 1 -- 172.21.15.42:0/3236391426 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46600d0d80 msgr2=0x7f46601ebd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.899+0000 7f465f400640 1 --2- 172.21.15.42:0/3236391426 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46600d0d80 0x7f46601ebd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.899+0000 7f465f400640 1 -- 172.21.15.42:0/3236391426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46601f89d0 msgr2=0x7f46601f8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.899+0000 7f465f400640 1 --2- 172.21.15.42:0/3236391426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46601f89d0 0x7f46601f8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.899+0000 7f465f400640 1 -- 172.21.15.42:0/3236391426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46601f9320 con 0x7f46600af460 2024-09-17T01:45:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.899+0000 7f4657e00640 1 --2- 172.21.15.42:0/3236391426 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46600d0d80 0x7f46601ebd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:45:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.900+0000 7f465f400640 1 --2- 172.21.15.42:0/3236391426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46600af460 0x7f46600b46e0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f465000c3c0 tx=0x7f465000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.900+0000 7f4657400640 1 -- 172.21.15.42:0/3236391426 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4650017070 con 0x7f46600af460 2024-09-17T01:45:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.900+0000 7f4657400640 1 -- 172.21.15.42:0/3236391426 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46500035f0 con 0x7f46600af460 2024-09-17T01:45:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.900+0000 7f4664c00640 1 -- 172.21.15.42:0/3236391426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f466006ea50 con 0x7f46600af460 2024-09-17T01:45:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.900+0000 7f4657400640 1 -- 172.21.15.42:0/3236391426 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4650003a40 con 0x7f46600af460 2024-09-17T01:45:21.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.900+0000 7f4664c00640 1 -- 172.21.15.42:0/3236391426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f466006f010 con 0x7f46600af460 2024-09-17T01:45:21.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.901+0000 7f4664c00640 1 -- 172.21.15.42:0/3236391426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46600ad080 con 0x7f46600af460 2024-09-17T01:45:21.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.902+0000 7f4657400640 1 -- 172.21.15.42:0/3236391426 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f465001a070 con 0x7f46600af460 2024-09-17T01:45:21.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.903+0000 7f4657400640 1 --2- 172.21.15.42:0/3236391426 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f463c078b90 0x7f463c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:21.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.903+0000 7f4657400640 1 -- 172.21.15.42:0/3236391426 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5029+0+0 (secure 0 0 0) 0x7f4650099d80 con 0x7f46600af460 2024-09-17T01:45:21.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.904+0000 7f4657e00640 1 --2- 172.21.15.42:0/3236391426 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f463c078b90 0x7f463c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:21.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.904+0000 7f4657e00640 1 --2- 172.21.15.42:0/3236391426 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f463c078b90 0x7f463c07b0a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f46600b4db0 tx=0x7f4648009260 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:21.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:21.907+0000 7f4657400640 1 -- 172.21.15.42:0/3236391426 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f46601f9320 con 0x7f46600af460 2024-09-17T01:45:22.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.181+0000 7f4664c00640 1 -- 172.21.15.42:0/3236391426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) -- 0x7f46600cd910 con 0x7f46600af460 2024-09-17T01:45:22.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.666+0000 7f4657400640 1 -- 172.21.15.42:0/3236391426 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v631) ==== 162+0+0 (secure 0 0 0) 0x7f4650062450 con 0x7f46600af460 2024-09-17T01:45:22.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.669+0000 7f4664c00640 1 -- 172.21.15.42:0/3236391426 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f463c078b90 msgr2=0x7f463c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:22.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.669+0000 7f4664c00640 1 --2- 172.21.15.42:0/3236391426 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f463c078b90 0x7f463c07b0a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f46600b4db0 tx=0x7f4648009260 comp rx=0 tx=0).stop 2024-09-17T01:45:22.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.669+0000 7f4664c00640 1 -- 172.21.15.42:0/3236391426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46600af460 msgr2=0x7f46600b46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:22.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.669+0000 7f4664c00640 1 --2- 172.21.15.42:0/3236391426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46600af460 0x7f46600b46e0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f465000c3c0 tx=0x7f465000c880 comp rx=0 tx=0).stop 2024-09-17T01:45:22.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.669+0000 7f4664c00640 1 -- 172.21.15.42:0/3236391426 shutdown_connections 2024-09-17T01:45:22.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.669+0000 7f4664c00640 1 --2- 172.21.15.42:0/3236391426 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f463c078b90 0x7f463c07b0a0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.669+0000 7f4664c00640 1 --2- 172.21.15.42:0/3236391426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46601f89d0 0x7f46601f8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.669+0000 7f4664c00640 1 --2- 172.21.15.42:0/3236391426 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46600d0d80 0x7f46601ebd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.669+0000 7f4664c00640 1 --2- 172.21.15.42:0/3236391426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46600af460 0x7f46600b46e0 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.669+0000 7f4664c00640 1 -- 172.21.15.42:0/3236391426 >> 172.21.15.42:0/3236391426 conn(0x7f46600b25f0 msgr2=0x7f46600cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:22.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.670+0000 7f4664c00640 1 -- 172.21.15.42:0/3236391426 shutdown_connections 2024-09-17T01:45:22.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.670+0000 7f4664c00640 1 -- 172.21.15.42:0/3236391426 wait complete. 2024-09-17T01:45:22.690 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T01:45:22.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.918+0000 7f3a2de00640 1 -- 172.21.15.42:0/2525791029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a28072e00 msgr2=0x7f3a2815bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:22.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.918+0000 7f3a2de00640 1 --2- 172.21.15.42:0/2525791029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a28072e00 0x7f3a2815bc50 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f3a280b5b30 tx=0x7f3a1802a560 comp rx=0 tx=0).stop 2024-09-17T01:45:22.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.918+0000 7f3a2de00640 1 -- 172.21.15.42:0/2525791029 shutdown_connections 2024-09-17T01:45:22.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.918+0000 7f3a2de00640 1 --2- 172.21.15.42:0/2525791029 >> v2:172.21.15.43:3300/0 conn(0x7f3a2815f190 0x7f3a2806fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.918+0000 7f3a2de00640 1 --2- 172.21.15.42:0/2525791029 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3a2806d430 0x7f3a2806d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.918+0000 7f3a2de00640 1 --2- 172.21.15.42:0/2525791029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a28072e00 0x7f3a2815bc50 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.918+0000 7f3a2de00640 1 -- 172.21.15.42:0/2525791029 >> 172.21.15.42:0/2525791029 conn(0x7f3a280b2930 msgr2=0x7f3a2806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:22.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.919+0000 7f3a2de00640 1 -- 172.21.15.42:0/2525791029 shutdown_connections 2024-09-17T01:45:22.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.919+0000 7f3a2de00640 1 -- 172.21.15.42:0/2525791029 wait complete. 2024-09-17T01:45:22.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.921+0000 7f3a2de00640 1 Processor -- start 2024-09-17T01:45:22.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.921+0000 7f3a2de00640 1 -- start start 2024-09-17T01:45:22.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.922+0000 7f3a2de00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3a2806d430 0x7f3a28143d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:22.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.922+0000 7f3a2de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a28072e00 0x7f3a281f6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:22.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.922+0000 7f3a2de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a2815f190 0x7f3a281566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:22.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.922+0000 7f3a2de00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3a280706b0 con 0x7f3a28072e00 2024-09-17T01:45:22.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.922+0000 7f3a2de00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3a28070530 con 0x7f3a2815f190 2024-09-17T01:45:22.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.922+0000 7f3a2de00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3a28151db0 con 0x7f3a2806d430 2024-09-17T01:45:22.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.923+0000 7f3a1fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a28072e00 0x7f3a281f6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:22.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.923+0000 7f3a1fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a28072e00 0x7f3a281f6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36816/0 (socket says 172.21.15.42:36816) 2024-09-17T01:45:22.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.923+0000 7f3a1fe00640 1 -- 172.21.15.42:0/4242637978 learned_addr learned my addr 172.21.15.42:0/4242637978 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:22.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.923+0000 7f3a26a00640 1 --2- 172.21.15.42:0/4242637978 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3a2806d430 0x7f3a28143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:22.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.923+0000 7f3a27400640 1 --2- 172.21.15.42:0/4242637978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a2815f190 0x7f3a281566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:22.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.923+0000 7f3a1fe00640 1 -- 172.21.15.42:0/4242637978 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3a2806d430 msgr2=0x7f3a28143d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:22.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.923+0000 7f3a1fe00640 1 --2- 172.21.15.42:0/4242637978 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3a2806d430 0x7f3a28143d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.923+0000 7f3a1fe00640 1 -- 172.21.15.42:0/4242637978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a2815f190 msgr2=0x7f3a281566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:22.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.923+0000 7f3a1fe00640 1 --2- 172.21.15.42:0/4242637978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a2815f190 0x7f3a281566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.923+0000 7f3a1fe00640 1 -- 172.21.15.42:0/4242637978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a28158a70 con 0x7f3a28072e00 2024-09-17T01:45:22.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.924+0000 7f3a1fe00640 1 --2- 172.21.15.42:0/4242637978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a28072e00 0x7f3a281f6ae0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000c9a0 tx=0x7f3a1000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:22.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.924+0000 7f3a1f400640 1 -- 172.21.15.42:0/4242637978 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a10007bb0 con 0x7f3a28072e00 2024-09-17T01:45:22.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.924+0000 7f3a1f400640 1 -- 172.21.15.42:0/4242637978 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a10007e40 con 0x7f3a28072e00 2024-09-17T01:45:22.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.924+0000 7f3a2de00640 1 -- 172.21.15.42:0/4242637978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a280b5900 con 0x7f3a28072e00 2024-09-17T01:45:22.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.924+0000 7f3a1f400640 1 -- 172.21.15.42:0/4242637978 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1000f690 con 0x7f3a28072e00 2024-09-17T01:45:22.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.924+0000 7f3a2de00640 1 -- 172.21.15.42:0/4242637978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a28144250 con 0x7f3a28072e00 2024-09-17T01:45:22.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.925+0000 7f3a2de00640 1 -- 172.21.15.42:0/4242637978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a2815bc50 con 0x7f3a28072e00 2024-09-17T01:45:22.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.926+0000 7f3a1f400640 1 -- 172.21.15.42:0/4242637978 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3a1000f830 con 0x7f3a28072e00 2024-09-17T01:45:22.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.927+0000 7f3a1f400640 1 --2- 172.21.15.42:0/4242637978 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3a04078b90 0x7f3a0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:22.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.927+0000 7f3a1f400640 1 -- 172.21.15.42:0/4242637978 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5029+0+0 (secure 0 0 0) 0x7f3a1009b230 con 0x7f3a28072e00 2024-09-17T01:45:22.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.928+0000 7f3a26a00640 1 --2- 172.21.15.42:0/4242637978 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3a04078b90 0x7f3a0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:22.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.929+0000 7f3a26a00640 1 --2- 172.21.15.42:0/4242637978 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3a04078b90 0x7f3a0407b0a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f3a18033000 tx=0x7f3a18004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:22.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:22.932+0000 7f3a1f400640 1 -- 172.21.15.42:0/4242637978 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3a10014030 con 0x7f3a28072e00 2024-09-17T01:45:23.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.124+0000 7f3a2de00640 1 -- 172.21.15.42:0/4242637978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f3a2806a170 con 0x7f3a28072e00 2024-09-17T01:45:23.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.125+0000 7f3a1f400640 1 -- 172.21.15.42:0/4242637978 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v59) ==== 59+0+2294 (secure 0 0 0) 0x7f3a100632b0 con 0x7f3a28072e00 2024-09-17T01:45:23.122 INFO:teuthology.orchestra.run.smithi042.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T01:45:23.123 INFO:teuthology.orchestra.run.smithi042.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T01:45:23.123 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced client_mount_timeout 30 2024-09-17T01:45:23.123 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_client 20/20 2024-09-17T01:45:23.123 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_mgr 20/20 2024-09-17T01:45:23.123 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_ms 1/1 2024-09-17T01:45:23.123 INFO:teuthology.orchestra.run.smithi042.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T01:45:23.123 INFO:teuthology.orchestra.run.smithi042.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T01:45:23.123 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3683.959260 2024-09-17T01:45:23.123 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4350.010833 2024-09-17T01:45:23.123 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4316.776055 2024-09-17T01:45:23.123 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3885.595082 2024-09-17T01:45:23.123 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3602.000737 2024-09-17T01:45:23.123 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4883.364748 2024-09-17T01:45:23.124 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3752.484811 2024-09-17T01:45:23.124 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3775.035963 2024-09-17T01:45:23.124 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds 20/20 2024-09-17T01:45:23.124 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T01:45:23.124 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_ms 2/2 2024-09-17T01:45:23.124 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_frag true 2024-09-17T01:45:23.124 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_scatterstat true 2024-09-17T01:45:23.124 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T01:45:23.124 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_verify_scatter true 2024-09-17T01:45:23.124 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T01:45:23.124 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T01:45:23.124 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T01:45:23.124 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced client_mount_timeout 600 2024-09-17T01:45:23.124 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_client 20/20 2024-09-17T01:45:23.125 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_ms 1/1 2024-09-17T01:45:23.125 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T01:45:23.125 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T01:45:23.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.127+0000 7f3a2de00640 1 -- 172.21.15.42:0/4242637978 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3a04078b90 msgr2=0x7f3a0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:23.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.127+0000 7f3a2de00640 1 --2- 172.21.15.42:0/4242637978 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3a04078b90 0x7f3a0407b0a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f3a18033000 tx=0x7f3a18004730 comp rx=0 tx=0).stop 2024-09-17T01:45:23.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.127+0000 7f3a2de00640 1 -- 172.21.15.42:0/4242637978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a28072e00 msgr2=0x7f3a281f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:23.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.127+0000 7f3a2de00640 1 --2- 172.21.15.42:0/4242637978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a28072e00 0x7f3a281f6ae0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000c9a0 tx=0x7f3a1000ce60 comp rx=0 tx=0).stop 2024-09-17T01:45:23.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.127+0000 7f3a2de00640 1 -- 172.21.15.42:0/4242637978 shutdown_connections 2024-09-17T01:45:23.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.127+0000 7f3a2de00640 1 --2- 172.21.15.42:0/4242637978 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3a04078b90 0x7f3a0407b0a0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.127+0000 7f3a2de00640 1 --2- 172.21.15.42:0/4242637978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a2815f190 0x7f3a281566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.127+0000 7f3a2de00640 1 --2- 172.21.15.42:0/4242637978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a28072e00 0x7f3a281f6ae0 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.127+0000 7f3a2de00640 1 --2- 172.21.15.42:0/4242637978 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3a2806d430 0x7f3a28143d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.127+0000 7f3a2de00640 1 -- 172.21.15.42:0/4242637978 >> 172.21.15.42:0/4242637978 conn(0x7f3a280b2930 msgr2=0x7f3a280ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:23.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.127+0000 7f3a2de00640 1 -- 172.21.15.42:0/4242637978 shutdown_connections 2024-09-17T01:45:23.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.127+0000 7f3a2de00640 1 -- 172.21.15.42:0/4242637978 wait complete. 2024-09-17T01:45:23.150 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T01:45:23.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.382+0000 7f23ecc00640 1 -- 172.21.15.42:0/4134410131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23e80af980 msgr2=0x7f23e80ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:23.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.382+0000 7f23ecc00640 1 --2- 172.21.15.42:0/4134410131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23e80af980 0x7f23e80ceb40 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f23d4005fd0 tx=0x7f23d402a5d0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.382+0000 7f23ecc00640 1 -- 172.21.15.42:0/4134410131 shutdown_connections 2024-09-17T01:45:23.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.382+0000 7f23ecc00640 1 --2- 172.21.15.42:0/4134410131 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23e806d430 0x7f23e806d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.382+0000 7f23ecc00640 1 --2- 172.21.15.42:0/4134410131 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23e80af980 0x7f23e80ceb40 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.382+0000 7f23ecc00640 1 -- 172.21.15.42:0/4134410131 >> 172.21.15.42:0/4134410131 conn(0x7f23e80b2930 msgr2=0x7f23e806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:23.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.382+0000 7f23ecc00640 1 -- 172.21.15.42:0/4134410131 shutdown_connections 2024-09-17T01:45:23.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.382+0000 7f23ecc00640 1 -- 172.21.15.42:0/4134410131 wait complete. 2024-09-17T01:45:23.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.384+0000 7f23ecc00640 1 Processor -- start 2024-09-17T01:45:23.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.384+0000 7f23ecc00640 1 -- start start 2024-09-17T01:45:23.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.385+0000 7f23ecc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23e806d430 0x7f23e814c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:23.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.385+0000 7f23ecc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23e80af980 0x7f23e806ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:23.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.386+0000 7f23ecc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23e80b3880 0x7f23e81e6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:23.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.386+0000 7f23ecc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f23e8072ad0 con 0x7f23e80b3880 2024-09-17T01:45:23.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.386+0000 7f23ecc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f23e8072950 con 0x7f23e80af980 2024-09-17T01:45:23.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.386+0000 7f23ecc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f23e8072c50 con 0x7f23e806d430 2024-09-17T01:45:23.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.386+0000 7f23e6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23e80b3880 0x7f23e81e6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:23.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.386+0000 7f23e6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23e80b3880 0x7f23e81e6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36836/0 (socket says 172.21.15.42:36836) 2024-09-17T01:45:23.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.386+0000 7f23e6800640 1 -- 172.21.15.42:0/66527717 learned_addr learned my addr 172.21.15.42:0/66527717 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:23.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.386+0000 7f23e5400640 1 --2- 172.21.15.42:0/66527717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23e80af980 0x7f23e806ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:23.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.386+0000 7f23e5e00640 1 --2- 172.21.15.42:0/66527717 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23e806d430 0x7f23e814c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:23.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.386+0000 7f23e6800640 1 -- 172.21.15.42:0/66527717 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23e806d430 msgr2=0x7f23e814c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:23.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.386+0000 7f23e6800640 1 --2- 172.21.15.42:0/66527717 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23e806d430 0x7f23e814c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.386+0000 7f23e6800640 1 -- 172.21.15.42:0/66527717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23e80af980 msgr2=0x7f23e806ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:23.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.386+0000 7f23e6800640 1 --2- 172.21.15.42:0/66527717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23e80af980 0x7f23e806ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.386+0000 7f23e6800640 1 -- 172.21.15.42:0/66527717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e806f9b0 con 0x7f23e80b3880 2024-09-17T01:45:23.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.386+0000 7f23e5400640 1 --2- 172.21.15.42:0/66527717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23e80af980 0x7f23e806ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:45:23.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.387+0000 7f23e6800640 1 --2- 172.21.15.42:0/66527717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23e80b3880 0x7f23e81e6c50 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f23e000e960 tx=0x7f23e000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:23.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.387+0000 7f23de000640 1 -- 172.21.15.42:0/66527717 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e0004d20 con 0x7f23e80b3880 2024-09-17T01:45:23.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.387+0000 7f23de000640 1 -- 172.21.15.42:0/66527717 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23e000cac0 con 0x7f23e80b3880 2024-09-17T01:45:23.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.387+0000 7f23ecc00640 1 -- 172.21.15.42:0/66527717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e806fc90 con 0x7f23e80b3880 2024-09-17T01:45:23.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.387+0000 7f23de000640 1 -- 172.21.15.42:0/66527717 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e0005020 con 0x7f23e80b3880 2024-09-17T01:45:23.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.387+0000 7f23ecc00640 1 -- 172.21.15.42:0/66527717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e8151550 con 0x7f23e80b3880 2024-09-17T01:45:23.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.388+0000 7f23ecc00640 1 -- 172.21.15.42:0/66527717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e80743e0 con 0x7f23e80b3880 2024-09-17T01:45:23.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.389+0000 7f23de000640 1 -- 172.21.15.42:0/66527717 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f23e00051c0 con 0x7f23e80b3880 2024-09-17T01:45:23.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.391+0000 7f23de000640 1 --2- 172.21.15.42:0/66527717 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f23c8078b90 0x7f23c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:23.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.391+0000 7f23de000640 1 -- 172.21.15.42:0/66527717 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5029+0+0 (secure 0 0 0) 0x7f23e009b420 con 0x7f23e80b3880 2024-09-17T01:45:23.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.391+0000 7f23e5e00640 1 --2- 172.21.15.42:0/66527717 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f23c8078b90 0x7f23c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:23.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.392+0000 7f23e5e00640 1 --2- 172.21.15.42:0/66527717 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f23c8078b90 0x7f23c807b0a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f23e80cfb10 tx=0x7f23d8009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:23.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.396+0000 7f23de000640 1 -- 172.21.15.42:0/66527717 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f23e80743e0 con 0x7f23e80b3880 2024-09-17T01:45:23.586 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.588+0000 7f23ecc00640 1 -- 172.21.15.42:0/66527717 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f23e806d840 con 0x7f23e80b3880 2024-09-17T01:45:23.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.592+0000 7f23de000640 1 -- 172.21.15.42:0/66527717 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v60)=0 v60) ==== 122+0+0 (secure 0 0 0) 0x7f23e0016030 con 0x7f23e80b3880 2024-09-17T01:45:23.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.595+0000 7f23ecc00640 1 -- 172.21.15.42:0/66527717 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f23c8078b90 msgr2=0x7f23c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:23.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.595+0000 7f23ecc00640 1 --2- 172.21.15.42:0/66527717 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f23c8078b90 0x7f23c807b0a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f23e80cfb10 tx=0x7f23d8009040 comp rx=0 tx=0).stop 2024-09-17T01:45:23.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.595+0000 7f23ecc00640 1 -- 172.21.15.42:0/66527717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23e80b3880 msgr2=0x7f23e81e6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:23.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.595+0000 7f23ecc00640 1 --2- 172.21.15.42:0/66527717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23e80b3880 0x7f23e81e6c50 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f23e000e960 tx=0x7f23e000ee20 comp rx=0 tx=0).stop 2024-09-17T01:45:23.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.595+0000 7f23ecc00640 1 -- 172.21.15.42:0/66527717 shutdown_connections 2024-09-17T01:45:23.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.595+0000 7f23ecc00640 1 --2- 172.21.15.42:0/66527717 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f23c8078b90 0x7f23c807b0a0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.595+0000 7f23ecc00640 1 --2- 172.21.15.42:0/66527717 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23e80af980 0x7f23e806ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.595+0000 7f23ecc00640 1 --2- 172.21.15.42:0/66527717 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23e80b3880 0x7f23e81e6c50 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.595+0000 7f23ecc00640 1 --2- 172.21.15.42:0/66527717 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f23e806d430 0x7f23e814c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.595+0000 7f23ecc00640 1 -- 172.21.15.42:0/66527717 >> 172.21.15.42:0/66527717 conn(0x7f23e80b2930 msgr2=0x7f23e815e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:23.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.595+0000 7f23ecc00640 1 -- 172.21.15.42:0/66527717 shutdown_connections 2024-09-17T01:45:23.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:23.595+0000 7f23ecc00640 1 -- 172.21.15.42:0/66527717 wait complete. 2024-09-17T01:45:23.619 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:45:23.619 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:45:23.721 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:45:23.815 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:45:23.815 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:45:23.815 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:45:23.851 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:45:23.851 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:45:23.851 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:45:23.888 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:45:23.888 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:45:23.888 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:45:23.926 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:45:23.926 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:45:23.926 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:45:23.968 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:45:23.968 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T01:45:23.969 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:45:24.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.196+0000 7f8217200640 1 -- 172.21.15.42:0/1515529673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82180cf7c0 msgr2=0x7f821806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:24.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.196+0000 7f8217200640 1 --2- 172.21.15.42:0/1515529673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82180cf7c0 0x7f821806cd20 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f8204009830 tx=0x7f820402a5c0 comp rx=0 tx=0).stop 2024-09-17T01:45:24.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.196+0000 7f8217200640 1 -- 172.21.15.42:0/1515529673 shutdown_connections 2024-09-17T01:45:24.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.196+0000 7f8217200640 1 --2- 172.21.15.42:0/1515529673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82180cf7c0 0x7f821806cd20 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:24.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.196+0000 7f8217200640 1 -- 172.21.15.42:0/1515529673 >> 172.21.15.42:0/1515529673 conn(0x7f82180b25f0 msgr2=0x7f82180d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:24.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.197+0000 7f8217200640 1 -- 172.21.15.42:0/1515529673 shutdown_connections 2024-09-17T01:45:24.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.197+0000 7f8217200640 1 -- 172.21.15.42:0/1515529673 wait complete. 2024-09-17T01:45:24.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.199+0000 7f8217200640 1 Processor -- start 2024-09-17T01:45:24.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.199+0000 7f8217200640 1 -- start start 2024-09-17T01:45:24.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.200+0000 7f8217200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f821806d260 0x7f82180cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:24.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.200+0000 7f8217200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82180b4be0 0x7f82181f9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:24.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.200+0000 7f8217200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82180cf7c0 0x7f82180cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:24.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.200+0000 7f8217200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f82181535e0 con 0x7f821806d260 2024-09-17T01:45:24.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.200+0000 7f8217200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f82180b4340 con 0x7f82180b4be0 2024-09-17T01:45:24.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.200+0000 7f8217200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8218153760 con 0x7f82180cf7c0 2024-09-17T01:45:24.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.201+0000 7f8215e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f821806d260 0x7f82180cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:24.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.201+0000 7f8215e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f821806d260 0x7f82180cb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36848/0 (socket says 172.21.15.42:36848) 2024-09-17T01:45:24.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.201+0000 7f8215e00640 1 -- 172.21.15.42:0/707953251 learned_addr learned my addr 172.21.15.42:0/707953251 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:24.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.201+0000 7f8215400640 1 --2- 172.21.15.42:0/707953251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82180b4be0 0x7f82181f9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:24.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.201+0000 7f8216800640 1 --2- 172.21.15.42:0/707953251 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82180cf7c0 0x7f82180cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:24.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.201+0000 7f8215e00640 1 -- 172.21.15.42:0/707953251 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82180cf7c0 msgr2=0x7f82180cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:24.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.201+0000 7f8215e00640 1 --2- 172.21.15.42:0/707953251 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82180cf7c0 0x7f82180cc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:24.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.201+0000 7f8215e00640 1 -- 172.21.15.42:0/707953251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82180b4be0 msgr2=0x7f82181f9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:24.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.201+0000 7f8215e00640 1 --2- 172.21.15.42:0/707953251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82180b4be0 0x7f82181f9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:24.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.201+0000 7f8215e00640 1 -- 172.21.15.42:0/707953251 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82181f9bd0 con 0x7f821806d260 2024-09-17T01:45:24.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.201+0000 7f8216800640 1 --2- 172.21.15.42:0/707953251 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82180cf7c0 0x7f82180cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:45:24.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.201+0000 7f8215e00640 1 --2- 172.21.15.42:0/707953251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f821806d260 0x7f82180cb0b0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f820800c730 tx=0x7f820800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:24.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.202+0000 7f820e000640 1 -- 172.21.15.42:0/707953251 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8208017070 con 0x7f821806d260 2024-09-17T01:45:24.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.202+0000 7f820e000640 1 -- 172.21.15.42:0/707953251 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8208006890 con 0x7f821806d260 2024-09-17T01:45:24.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.202+0000 7f8217200640 1 -- 172.21.15.42:0/707953251 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82181f5880 con 0x7f821806d260 2024-09-17T01:45:24.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.202+0000 7f820e000640 1 -- 172.21.15.42:0/707953251 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8208006ce0 con 0x7f821806d260 2024-09-17T01:45:24.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.202+0000 7f8217200640 1 -- 172.21.15.42:0/707953251 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82181e59d0 con 0x7f821806d260 2024-09-17T01:45:24.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.203+0000 7f8217200640 1 -- 172.21.15.42:0/707953251 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82181f5690 con 0x7f821806d260 2024-09-17T01:45:24.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.204+0000 7f820e000640 1 -- 172.21.15.42:0/707953251 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f820801a070 con 0x7f821806d260 2024-09-17T01:45:24.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.206+0000 7f820e000640 1 --2- 172.21.15.42:0/707953251 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f81f8078b90 0x7f81f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:24.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.206+0000 7f820e000640 1 -- 172.21.15.42:0/707953251 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5029+0+0 (secure 0 0 0) 0x7f8208099f50 con 0x7f821806d260 2024-09-17T01:45:24.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.206+0000 7f8215400640 1 --2- 172.21.15.42:0/707953251 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f81f8078b90 0x7f81f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:24.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.207+0000 7f8215400640 1 --2- 172.21.15.42:0/707953251 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f81f8078b90 0x7f81f807b0a0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8204034000 tx=0x7f8204004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:24.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.210+0000 7f820e000640 1 -- 172.21.15.42:0/707953251 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f82181f9bd0 con 0x7f821806d260 2024-09-17T01:45:24.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.441+0000 7f8217200640 1 -- 172.21.15.42:0/707953251 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f821806cd20 con 0x7f821806d260 2024-09-17T01:45:24.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.441+0000 7f820e000640 1 -- 172.21.15.42:0/707953251 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 131 v131) ==== 95+0+3090 (secure 0 0 0) 0x7f821806d670 con 0x7f821806d260 2024-09-17T01:45:24.439 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:45:24.440 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":131,"btime":"2024-09-17T01:45:16:634004+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8872,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3393274334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3393274334},{"type":"v1","addr":"172.21.15.43:6836","nonce":3393274334}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":8875,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2869136532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2869136532},{"type":"v1","addr":"172.21.15.43:6837","nonce":2869136532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":120},{"gid":9885,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/2847449399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2847449399},{"type":"v1","addr":"172.21.15.42:6833","nonce":2847449399}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":131}],"filesystems":[]} 2024-09-17T01:45:24.440 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 131 2024-09-17T01:45:24.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.444+0000 7f8217200640 1 -- 172.21.15.42:0/707953251 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f81f8078b90 msgr2=0x7f81f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:24.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.444+0000 7f8217200640 1 --2- 172.21.15.42:0/707953251 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f81f8078b90 0x7f81f807b0a0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8204034000 tx=0x7f8204004730 comp rx=0 tx=0).stop 2024-09-17T01:45:24.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.444+0000 7f8217200640 1 -- 172.21.15.42:0/707953251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f821806d260 msgr2=0x7f82180cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:24.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.444+0000 7f8217200640 1 --2- 172.21.15.42:0/707953251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f821806d260 0x7f82180cb0b0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f820800c730 tx=0x7f820800cbf0 comp rx=0 tx=0).stop 2024-09-17T01:45:24.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.444+0000 7f8217200640 1 -- 172.21.15.42:0/707953251 shutdown_connections 2024-09-17T01:45:24.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.444+0000 7f8217200640 1 --2- 172.21.15.42:0/707953251 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f81f8078b90 0x7f81f807b0a0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:24.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.444+0000 7f8217200640 1 --2- 172.21.15.42:0/707953251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82180b4be0 0x7f82181f9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:24.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.444+0000 7f8217200640 1 --2- 172.21.15.42:0/707953251 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82180cf7c0 0x7f82180cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:24.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.444+0000 7f8217200640 1 --2- 172.21.15.42:0/707953251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f821806d260 0x7f82180cb0b0 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:24.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.444+0000 7f8217200640 1 -- 172.21.15.42:0/707953251 >> 172.21.15.42:0/707953251 conn(0x7f82180b25f0 msgr2=0x7f82180ce880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:24.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.444+0000 7f8217200640 1 -- 172.21.15.42:0/707953251 shutdown_connections 2024-09-17T01:45:24.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:24.444+0000 7f8217200640 1 -- 172.21.15.42:0/707953251 wait complete. 2024-09-17T01:45:24.466 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T01:45:24.466 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T01:45:24.466 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T01:45:24.467 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:45:24.467 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T01:45:24.467 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T01:45:24.467 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T01:45:24.467 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T01:45:24.468 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T01:45:24.468 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:45:24.468 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T01:45:24.468 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T01:45:24.468 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T01:45:24.468 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:45:24.472 INFO:tasks.ceph.mds.c:Started 2024-09-17T01:45:24.472 DEBUG:teuthology.parallel:result is None 2024-09-17T01:45:24.487 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T01:45:24.487 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T01:45:24.494 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T01:45:24.494 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T01:45:24.532 INFO:tasks.ceph.mds.a:Started 2024-09-17T01:45:24.532 DEBUG:teuthology.parallel:result is None 2024-09-17T01:45:24.539 INFO:tasks.ceph.mds.d:Started 2024-09-17T01:45:24.540 DEBUG:teuthology.parallel:result is None 2024-09-17T01:45:24.666 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:45:24.729 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:45:24.742 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-09-17T01:45:25.277 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-17T01:45:30.494 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T01:45:30.494 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T01:45:30.499 INFO:tasks.ceph.mds.b:Started 2024-09-17T01:45:30.499 DEBUG:teuthology.parallel:result is None 2024-09-17T01:45:30.500 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T01:45:30.703 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-09-17T01:45:30.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.742+0000 7f2072200640 1 -- 172.21.15.42:0/1591035304 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f206c0b4be0 msgr2=0x7f206c15d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:30.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.742+0000 7f2072200640 1 --2- 172.21.15.42:0/1591035304 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f206c0b4be0 0x7f206c15d6b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2060009860 tx=0x7f206002a530 comp rx=0 tx=0).stop 2024-09-17T01:45:30.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.742+0000 7f2072200640 1 -- 172.21.15.42:0/1591035304 shutdown_connections 2024-09-17T01:45:30.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.742+0000 7f2072200640 1 --2- 172.21.15.42:0/1591035304 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f206c0b4be0 0x7f206c15d6b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:30.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.742+0000 7f2072200640 1 -- 172.21.15.42:0/1591035304 >> 172.21.15.42:0/1591035304 conn(0x7f206c0b25f0 msgr2=0x7f206c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:30.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.742+0000 7f2072200640 1 -- 172.21.15.42:0/1591035304 shutdown_connections 2024-09-17T01:45:30.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.742+0000 7f2072200640 1 -- 172.21.15.42:0/1591035304 wait complete. 2024-09-17T01:45:30.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.744+0000 7f2072200640 1 Processor -- start 2024-09-17T01:45:30.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.744+0000 7f2072200640 1 -- start start 2024-09-17T01:45:30.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.746+0000 7f2072200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f206c0b4be0 0x7f206c14a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:30.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.746+0000 7f2072200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f206c0cf7c0 0x7f206c15f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:30.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.746+0000 7f2072200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f206c073d30 0x7f206c074140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:30.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.746+0000 7f2072200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f206c153760 con 0x7f206c073d30 2024-09-17T01:45:30.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.746+0000 7f2072200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f206c1535e0 con 0x7f206c0cf7c0 2024-09-17T01:45:30.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.746+0000 7f2072200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f206c1538e0 con 0x7f206c0b4be0 2024-09-17T01:45:30.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.746+0000 7f2071800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f206c073d30 0x7f206c074140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:30.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.746+0000 7f2070e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f206c0b4be0 0x7f206c14a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:30.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.746+0000 7f206be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f206c0cf7c0 0x7f206c15f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:30.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.746+0000 7f2071800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f206c073d30 0x7f206c074140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36788/0 (socket says 172.21.15.42:36788) 2024-09-17T01:45:30.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.746+0000 7f2071800640 1 -- 172.21.15.42:0/361878499 learned_addr learned my addr 172.21.15.42:0/361878499 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:30.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.746+0000 7f2070e00640 1 --2- 172.21.15.42:0/361878499 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f206c0b4be0 0x7f206c14a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:39426/0 (socket says 172.21.15.42:39426) 2024-09-17T01:45:30.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.747+0000 7f2071800640 1 -- 172.21.15.42:0/361878499 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f206c0b4be0 msgr2=0x7f206c14a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:30.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.747+0000 7f2071800640 1 --2- 172.21.15.42:0/361878499 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f206c0b4be0 0x7f206c14a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:30.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.747+0000 7f2071800640 1 -- 172.21.15.42:0/361878499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f206c0cf7c0 msgr2=0x7f206c15f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:30.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.747+0000 7f2071800640 1 --2- 172.21.15.42:0/361878499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f206c0cf7c0 0x7f206c15f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:30.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.747+0000 7f2071800640 1 -- 172.21.15.42:0/361878499 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f206c074680 con 0x7f206c073d30 2024-09-17T01:45:30.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.747+0000 7f2070e00640 1 --2- 172.21.15.42:0/361878499 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f206c0b4be0 0x7f206c14a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:45:30.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.747+0000 7f2071800640 1 --2- 172.21.15.42:0/361878499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f206c073d30 0x7f206c074140 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f206400c760 tx=0x7f206400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:30.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.747+0000 7f2068c00640 1 -- 172.21.15.42:0/361878499 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2064003b70 con 0x7f206c073d30 2024-09-17T01:45:30.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.747+0000 7f2068c00640 1 -- 172.21.15.42:0/361878499 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2064003d50 con 0x7f206c073d30 2024-09-17T01:45:30.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.747+0000 7f2072200640 1 -- 172.21.15.42:0/361878499 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f206c1f92d0 con 0x7f206c073d30 2024-09-17T01:45:30.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.747+0000 7f2068c00640 1 -- 172.21.15.42:0/361878499 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206400aab0 con 0x7f206c073d30 2024-09-17T01:45:30.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.747+0000 7f2072200640 1 -- 172.21.15.42:0/361878499 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f206c1f9890 con 0x7f206c073d30 2024-09-17T01:45:30.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.748+0000 7f2072200640 1 -- 172.21.15.42:0/361878499 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f206c1f9040 con 0x7f206c073d30 2024-09-17T01:45:30.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.750+0000 7f2068c00640 1 -- 172.21.15.42:0/361878499 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f206400ac50 con 0x7f206c073d30 2024-09-17T01:45:30.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.751+0000 7f2068c00640 1 --2- 172.21.15.42:0/361878499 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f204c078b90 0x7f204c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:30.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.751+0000 7f2068c00640 1 -- 172.21.15.42:0/361878499 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5029+0+0 (secure 0 0 0) 0x7f206409a7e0 con 0x7f206c073d30 2024-09-17T01:45:30.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.751+0000 7f2070e00640 1 --2- 172.21.15.42:0/361878499 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f204c078b90 0x7f204c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:30.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.752+0000 7f2070e00640 1 --2- 172.21.15.42:0/361878499 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f204c078b90 0x7f204c07b0a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f2060034000 tx=0x7f2060004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:30.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.755+0000 7f2068c00640 1 -- 172.21.15.42:0/361878499 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f206c074680 con 0x7f206c073d30 2024-09-17T01:45:30.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:30.961+0000 7f2072200640 1 -- 172.21.15.42:0/361878499 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f206c15d6b0 con 0x7f206c073d30 2024-09-17T01:45:31.989 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-17T01:45:32.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:32.710+0000 7f2068c00640 1 -- 172.21.15.42:0/361878499 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v170) ==== 97+0+0 (secure 0 0 0) 0x7f2064062860 con 0x7f206c073d30 2024-09-17T01:45:32.708 INFO:teuthology.orchestra.run.smithi042.stderr: removed all blocklist entries 2024-09-17T01:45:32.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:32.714+0000 7f2072200640 1 -- 172.21.15.42:0/361878499 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f204c078b90 msgr2=0x7f204c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:32.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:32.714+0000 7f2072200640 1 --2- 172.21.15.42:0/361878499 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f204c078b90 0x7f204c07b0a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f2060034000 tx=0x7f2060004730 comp rx=0 tx=0).stop 2024-09-17T01:45:32.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:32.714+0000 7f2072200640 1 -- 172.21.15.42:0/361878499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f206c073d30 msgr2=0x7f206c074140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:32.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:32.714+0000 7f2072200640 1 --2- 172.21.15.42:0/361878499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f206c073d30 0x7f206c074140 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f206400c760 tx=0x7f206400cc20 comp rx=0 tx=0).stop 2024-09-17T01:45:32.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:32.715+0000 7f2072200640 1 -- 172.21.15.42:0/361878499 shutdown_connections 2024-09-17T01:45:32.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:32.715+0000 7f2072200640 1 --2- 172.21.15.42:0/361878499 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f204c078b90 0x7f204c07b0a0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:32.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:32.715+0000 7f2072200640 1 --2- 172.21.15.42:0/361878499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f206c0cf7c0 0x7f206c15f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:32.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:32.715+0000 7f2072200640 1 --2- 172.21.15.42:0/361878499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f206c073d30 0x7f206c074140 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:32.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:32.715+0000 7f2072200640 1 --2- 172.21.15.42:0/361878499 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f206c0b4be0 0x7f206c14a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:32.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:32.715+0000 7f2072200640 1 -- 172.21.15.42:0/361878499 >> 172.21.15.42:0/361878499 conn(0x7f206c0b25f0 msgr2=0x7f206c0c9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:32.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:32.715+0000 7f2072200640 1 -- 172.21.15.42:0/361878499 shutdown_connections 2024-09-17T01:45:32.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:32.715+0000 7f2072200640 1 -- 172.21.15.42:0/361878499 wait complete. 2024-09-17T01:45:32.738 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T01:45:33.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.101+0000 7f31afe00640 1 -- 172.21.15.42:0/3203920304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31a8151c30 msgr2=0x7f31a815bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:33.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.101+0000 7f31afe00640 1 --2- 172.21.15.42:0/3203920304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31a8151c30 0x7f31a815bc50 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f31a0005fd0 tx=0x7f31a002bbc0 comp rx=0 tx=0).stop 2024-09-17T01:45:33.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.101+0000 7f31afe00640 1 -- 172.21.15.42:0/3203920304 shutdown_connections 2024-09-17T01:45:33.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.101+0000 7f31afe00640 1 --2- 172.21.15.42:0/3203920304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31a8151c30 0x7f31a815bc50 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:33.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.101+0000 7f31afe00640 1 -- 172.21.15.42:0/3203920304 >> 172.21.15.42:0/3203920304 conn(0x7f31a80b2930 msgr2=0x7f31a806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:33.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.101+0000 7f31afe00640 1 -- 172.21.15.42:0/3203920304 shutdown_connections 2024-09-17T01:45:33.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.101+0000 7f31afe00640 1 -- 172.21.15.42:0/3203920304 wait complete. 2024-09-17T01:45:33.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.103+0000 7f31afe00640 1 Processor -- start 2024-09-17T01:45:33.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.104+0000 7f31afe00640 1 -- start start 2024-09-17T01:45:33.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.105+0000 7f31afe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31a8072e00 0x7f31a80b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:33.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.105+0000 7f31afe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31a8151c30 0x7f31a8154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:33.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.105+0000 7f31afe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31a81f3610 0x7f31a81f7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:33.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.105+0000 7f31afe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f31a815f310 con 0x7f31a8072e00 2024-09-17T01:45:33.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.105+0000 7f31afe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f31a815f190 con 0x7f31a8151c30 2024-09-17T01:45:33.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.105+0000 7f31afe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f31a815f490 con 0x7f31a81f3610 2024-09-17T01:45:33.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.105+0000 7f31ad400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31a8072e00 0x7f31a80b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:33.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.105+0000 7f31ad400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31a8072e00 0x7f31a80b4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36808/0 (socket says 172.21.15.42:36808) 2024-09-17T01:45:33.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.105+0000 7f31ad400640 1 -- 172.21.15.42:0/116466552 learned_addr learned my addr 172.21.15.42:0/116466552 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:33.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.105+0000 7f31ade00640 1 --2- 172.21.15.42:0/116466552 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31a81f3610 0x7f31a81f7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:33.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.105+0000 7f31aca00640 1 --2- 172.21.15.42:0/116466552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31a8151c30 0x7f31a8154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:33.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.106+0000 7f31ad400640 1 -- 172.21.15.42:0/116466552 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31a81f3610 msgr2=0x7f31a81f7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:33.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.106+0000 7f31ad400640 1 --2- 172.21.15.42:0/116466552 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31a81f3610 0x7f31a81f7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:33.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.106+0000 7f31ad400640 1 -- 172.21.15.42:0/116466552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31a8151c30 msgr2=0x7f31a8154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:33.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.106+0000 7f31ad400640 1 --2- 172.21.15.42:0/116466552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31a8151c30 0x7f31a8154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:33.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.106+0000 7f31ad400640 1 -- 172.21.15.42:0/116466552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a8155a10 con 0x7f31a8072e00 2024-09-17T01:45:33.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.106+0000 7f31ad400640 1 --2- 172.21.15.42:0/116466552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31a8072e00 0x7f31a80b4f20 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f319c00b3f0 tx=0x7f319c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:33.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.106+0000 7f31a5600640 1 -- 172.21.15.42:0/116466552 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319c015020 con 0x7f31a8072e00 2024-09-17T01:45:33.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.106+0000 7f31a5600640 1 -- 172.21.15.42:0/116466552 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f319c011920 con 0x7f31a8072e00 2024-09-17T01:45:33.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.106+0000 7f31a5600640 1 -- 172.21.15.42:0/116466552 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319c011d70 con 0x7f31a8072e00 2024-09-17T01:45:33.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.106+0000 7f31afe00640 1 -- 172.21.15.42:0/116466552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31a8155cf0 con 0x7f31a8072e00 2024-09-17T01:45:33.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.106+0000 7f31afe00640 1 -- 172.21.15.42:0/116466552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31a81561d0 con 0x7f31a8072e00 2024-09-17T01:45:33.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.107+0000 7f31afe00640 1 -- 172.21.15.42:0/116466552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31a80af590 con 0x7f31a8072e00 2024-09-17T01:45:33.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.109+0000 7f31a5600640 1 -- 172.21.15.42:0/116466552 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f319c018020 con 0x7f31a8072e00 2024-09-17T01:45:33.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.110+0000 7f31a5600640 1 --2- 172.21.15.42:0/116466552 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3188078bc0 0x7f318807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:33.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.110+0000 7f31a5600640 1 -- 172.21.15.42:0/116466552 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 4857+0+0 (secure 0 0 0) 0x7f319c09a5f0 con 0x7f31a8072e00 2024-09-17T01:45:33.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.110+0000 7f31aca00640 1 --2- 172.21.15.42:0/116466552 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3188078bc0 0x7f318807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:33.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.111+0000 7f31aca00640 1 --2- 172.21.15.42:0/116466552 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3188078bc0 0x7f318807b0d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f31a8070500 tx=0x7f3194009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:33.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.114+0000 7f31a5600640 1 -- 172.21.15.42:0/116466552 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f31a80af590 con 0x7f31a8072e00 2024-09-17T01:45:33.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.379+0000 7f31afe00640 1 -- 172.21.15.42:0/116466552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f31a815bc50 con 0x7f31a8072e00 2024-09-17T01:45:33.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.379+0000 7f31a5600640 1 -- 172.21.15.42:0/116466552 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v40) ==== 80+0+5304 (secure 0 0 0) 0x7f319c01f030 con 0x7f31a8072e00 2024-09-17T01:45:33.377 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:45:33.377 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:45:33.377 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_dump": [ 2024-09-17T01:45:33.378 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:45:33.378 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.a", 2024-09-17T01:45:33.378 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmyJK4HRAAIC4E4V7p1fqIEfPIICMxZg==", 2024-09-17T01:45:33.378 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:45:33.378 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:45:33.378 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:45:33.378 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:45:33.378 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:45:33.378 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:45:33.378 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:45:33.378 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:45:33.378 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.b", 2024-09-17T01:45:33.379 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmXv3vORAALPrYIM6Vtz0g1pOxVhrUig==", 2024-09-17T01:45:33.379 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:45:33.379 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:45:33.379 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:45:33.379 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:45:33.379 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:45:33.379 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:45:33.379 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:45:33.379 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:45:33.379 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.c", 2024-09-17T01:45:33.379 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmPE7MKxAA9mGG+EO9C3VGVMerOm92+Q==", 2024-09-17T01:45:33.379 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:45:33.379 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:45:33.380 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:45:33.380 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:45:33.380 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:45:33.380 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:45:33.380 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:45:33.380 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:45:33.380 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.d", 2024-09-17T01:45:33.380 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmaOBSDBAATU4tpjM5IMcuvzZFE7N5bQ==", 2024-09-17T01:45:33.380 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:45:33.380 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:45:33.380 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:45:33.380 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:45:33.380 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:45:33.381 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:45:33.381 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:45:33.381 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:45:33.381 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.0", 2024-09-17T01:45:33.381 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDP2+hmEJebExAAAdGEoSzM96ybGT9h7t7OkA==", 2024-09-17T01:45:33.381 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:45:33.381 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:45:33.381 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:45:33.381 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:45:33.381 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:45:33.381 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:45:33.381 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:45:33.381 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.1", 2024-09-17T01:45:33.382 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDS2+hm7dWoMBAAagktrUl0O2/mgKCEfpAstA==", 2024-09-17T01:45:33.382 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:45:33.382 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:45:33.382 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:45:33.382 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:45:33.382 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:45:33.382 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:45:33.382 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:45:33.382 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.2", 2024-09-17T01:45:33.382 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDW2+hmEfSPBBAAPAa6EZt27yUcJSfZyCKheg==", 2024-09-17T01:45:33.382 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:45:33.383 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:45:33.383 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:45:33.383 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:45:33.383 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:45:33.383 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:45:33.383 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:45:33.383 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.3", 2024-09-17T01:45:33.383 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDZ2+hmHQhXFRAAj84g+IKqH6KMP7LjRtFvLw==", 2024-09-17T01:45:33.383 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:45:33.383 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:45:33.383 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:45:33.384 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:45:33.384 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:45:33.384 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:45:33.384 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:45:33.384 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.4", 2024-09-17T01:45:33.384 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDd2+hmaNcMNBAAx1GV/oFdfssMjFWFN5M0VQ==", 2024-09-17T01:45:33.384 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:45:33.384 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:45:33.384 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:45:33.384 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:45:33.384 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:45:33.384 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:45:33.384 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:45:33.385 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.5", 2024-09-17T01:45:33.385 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDh2+hm301NJhAAnSUH5AAvqhPwM7loH6frww==", 2024-09-17T01:45:33.385 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:45:33.385 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:45:33.385 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:45:33.385 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:45:33.385 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:45:33.385 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:45:33.385 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:45:33.385 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.6", 2024-09-17T01:45:33.385 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDk2+hm61WNNRAAbCvVvsUpB4fgt4ja60DRZA==", 2024-09-17T01:45:33.385 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:45:33.386 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:45:33.386 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:45:33.386 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:45:33.386 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:45:33.386 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:45:33.386 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:45:33.386 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.7", 2024-09-17T01:45:33.386 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDo2+hmesiLFhAA29n1eageNvP+lkRyh6gGMw==", 2024-09-17T01:45:33.386 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:45:33.386 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:45:33.386 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:45:33.386 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:45:33.387 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:45:33.387 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:45:33.387 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:45:33.387 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.0", 2024-09-17T01:45:33.387 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA==", 2024-09-17T01:45:33.387 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:45:33.387 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:45:33.387 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow r", 2024-09-17T01:45:33.387 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T01:45:33.387 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:45:33.387 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:45:33.387 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:45:33.387 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.1", 2024-09-17T01:45:33.388 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmZLygLhAABlauZgnidFWvfCCPuBLObg==", 2024-09-17T01:45:33.388 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:45:33.388 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:45:33.388 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:45:33.388 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:45:33.388 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:45:33.388 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:45:33.388 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:45:33.388 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:45:33.388 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.2", 2024-09-17T01:45:33.388 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hm8lnZIxAAN0a2CVMMtu/Nz50OG4a02A==", 2024-09-17T01:45:33.388 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:45:33.389 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:45:33.389 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:45:33.389 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:45:33.389 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:45:33.389 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:45:33.389 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:45:33.389 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:45:33.389 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.3", 2024-09-17T01:45:33.389 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmgXdAORAAM5Uy66I4nnTJ9Vhkn9JoBw==", 2024-09-17T01:45:33.389 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:45:33.389 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:45:33.389 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:45:33.390 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:45:33.390 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:45:33.390 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:45:33.390 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:45:33.390 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:45:33.390 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.admin", 2024-09-17T01:45:33.390 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDL2+hmvCreHBAA4CSAhosssViGqD93U+I7Iw==", 2024-09-17T01:45:33.390 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:45:33.390 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:45:33.390 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:45:33.390 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:45:33.390 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:45:33.390 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:45:33.391 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:45:33.391 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:45:33.391 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.x", 2024-09-17T01:45:33.391 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmYPnlEhAAIcQ11ktWZyMXYdbAONiLog==", 2024-09-17T01:45:33.391 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:45:33.391 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:45:33.391 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:45:33.391 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:45:33.391 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:45:33.391 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:45:33.391 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:45:33.391 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.y", 2024-09-17T01:45:33.391 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmpCZtBxAAp5tXMc6aEq1aOny2LJZAiA==", 2024-09-17T01:45:33.392 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:45:33.392 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:45:33.392 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:45:33.392 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:45:33.392 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:45:33.392 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:45:33.392 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-17T01:45:33.392 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:45:33.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.381+0000 7f31afe00640 1 -- 172.21.15.42:0/116466552 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3188078bc0 msgr2=0x7f318807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:33.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.381+0000 7f31afe00640 1 --2- 172.21.15.42:0/116466552 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3188078bc0 0x7f318807b0d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f31a8070500 tx=0x7f3194009040 comp rx=0 tx=0).stop 2024-09-17T01:45:33.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.381+0000 7f31afe00640 1 -- 172.21.15.42:0/116466552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31a8072e00 msgr2=0x7f31a80b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:33.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.381+0000 7f31afe00640 1 --2- 172.21.15.42:0/116466552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31a8072e00 0x7f31a80b4f20 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f319c00b3f0 tx=0x7f319c00b8b0 comp rx=0 tx=0).stop 2024-09-17T01:45:33.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.382+0000 7f31afe00640 1 -- 172.21.15.42:0/116466552 shutdown_connections 2024-09-17T01:45:33.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.382+0000 7f31afe00640 1 --2- 172.21.15.42:0/116466552 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3188078bc0 0x7f318807b0d0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:33.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.382+0000 7f31afe00640 1 --2- 172.21.15.42:0/116466552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31a8151c30 0x7f31a8154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:33.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.382+0000 7f31afe00640 1 --2- 172.21.15.42:0/116466552 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f31a81f3610 0x7f31a81f7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:33.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.382+0000 7f31afe00640 1 --2- 172.21.15.42:0/116466552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31a8072e00 0x7f31a80b4f20 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:33.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.382+0000 7f31afe00640 1 -- 172.21.15.42:0/116466552 >> 172.21.15.42:0/116466552 conn(0x7f31a80b2930 msgr2=0x7f31a806d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:33.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.382+0000 7f31afe00640 1 -- 172.21.15.42:0/116466552 shutdown_connections 2024-09-17T01:45:33.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.382+0000 7f31afe00640 1 -- 172.21.15.42:0/116466552 wait complete. 2024-09-17T01:45:33.401 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T01:45:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.630+0000 7fd999800640 1 -- 172.21.15.42:0/801588985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9940740f0 msgr2=0x7fd99415f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.630+0000 7fd999800640 1 --2- 172.21.15.42:0/801588985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9940740f0 0x7fd99415f200 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7fd9941638a0 tx=0x7fd98402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:45:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.631+0000 7fd999800640 1 -- 172.21.15.42:0/801588985 shutdown_connections 2024-09-17T01:45:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.631+0000 7fd999800640 1 --2- 172.21.15.42:0/801588985 >> v2:172.21.15.43:3300/0 conn(0x7fd99415f740 0x7fd99406d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.631+0000 7fd999800640 1 --2- 172.21.15.42:0/801588985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9940740f0 0x7fd99415f200 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.631+0000 7fd999800640 1 -- 172.21.15.42:0/801588985 >> 172.21.15.42:0/801588985 conn(0x7fd9940b2930 msgr2=0x7fd99406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.631+0000 7fd999800640 1 -- 172.21.15.42:0/801588985 shutdown_connections 2024-09-17T01:45:33.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.631+0000 7fd999800640 1 -- 172.21.15.42:0/801588985 wait complete. 2024-09-17T01:45:33.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.633+0000 7fd999800640 1 Processor -- start 2024-09-17T01:45:33.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.633+0000 7fd999800640 1 -- start start 2024-09-17T01:45:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.634+0000 7fd999800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9940740f0 0x7fd9941f54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.634+0000 7fd999800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd99415f740 0x7fd99413e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.635+0000 7fd999800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9941f97b0 0x7fd9941f8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.635+0000 7fd999800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd9940cef40 con 0x7fd99415f740 2024-09-17T01:45:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.635+0000 7fd999800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd99406dd20 con 0x7fd9941f97b0 2024-09-17T01:45:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.635+0000 7fd999800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd9940cf0c0 con 0x7fd9940740f0 2024-09-17T01:45:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.635+0000 7fd992000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd99415f740 0x7fd99413e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.635+0000 7fd992a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9940740f0 0x7fd9941f54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.635+0000 7fd992000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd99415f740 0x7fd99413e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36834/0 (socket says 172.21.15.42:36834) 2024-09-17T01:45:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.635+0000 7fd992000640 1 -- 172.21.15.42:0/327492696 learned_addr learned my addr 172.21.15.42:0/327492696 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.635+0000 7fd993400640 1 --2- 172.21.15.42:0/327492696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9941f97b0 0x7fd9941f8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.635+0000 7fd992000640 1 -- 172.21.15.42:0/327492696 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9940740f0 msgr2=0x7fd9941f54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.635+0000 7fd992000640 1 --2- 172.21.15.42:0/327492696 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9940740f0 0x7fd9941f54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.635+0000 7fd992000640 1 -- 172.21.15.42:0/327492696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9941f97b0 msgr2=0x7fd9941f8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.635+0000 7fd992000640 1 --2- 172.21.15.42:0/327492696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9941f97b0 0x7fd9941f8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.635+0000 7fd992000640 1 -- 172.21.15.42:0/327492696 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9941f5ea0 con 0x7fd99415f740 2024-09-17T01:45:33.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.636+0000 7fd992000640 1 --2- 172.21.15.42:0/327492696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd99415f740 0x7fd99413e3f0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7fd98000c3c0 tx=0x7fd98000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:33.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.636+0000 7fd98aa00640 1 -- 172.21.15.42:0/327492696 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd980017070 con 0x7fd99415f740 2024-09-17T01:45:33.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.636+0000 7fd98aa00640 1 -- 172.21.15.42:0/327492696 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9800035f0 con 0x7fd99415f740 2024-09-17T01:45:33.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.636+0000 7fd98aa00640 1 -- 172.21.15.42:0/327492696 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd980003a40 con 0x7fd99415f740 2024-09-17T01:45:33.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.636+0000 7fd999800640 1 -- 172.21.15.42:0/327492696 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9941f6180 con 0x7fd99415f740 2024-09-17T01:45:33.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.636+0000 7fd999800640 1 -- 172.21.15.42:0/327492696 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9940b3560 con 0x7fd99415f740 2024-09-17T01:45:33.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.637+0000 7fd999800640 1 -- 172.21.15.42:0/327492696 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9941f5c10 con 0x7fd99415f740 2024-09-17T01:45:33.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.638+0000 7fd98aa00640 1 -- 172.21.15.42:0/327492696 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd98001a070 con 0x7fd99415f740 2024-09-17T01:45:33.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.639+0000 7fd98aa00640 1 --2- 172.21.15.42:0/327492696 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd974078bc0 0x7fd97407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:33.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.639+0000 7fd98aa00640 1 -- 172.21.15.42:0/327492696 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 4857+0+0 (secure 0 0 0) 0x7fd980099c90 con 0x7fd99415f740 2024-09-17T01:45:33.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.640+0000 7fd992a00640 1 --2- 172.21.15.42:0/327492696 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd974078bc0 0x7fd97407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:33.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.641+0000 7fd992a00640 1 --2- 172.21.15.42:0/327492696 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd974078bc0 0x7fd97407b0d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd984034000 tx=0x7fd984004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:33.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.644+0000 7fd98aa00640 1 -- 172.21.15.42:0/327492696 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd980061d30 con 0x7fd99415f740 2024-09-17T01:45:33.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.840+0000 7fd999800640 1 -- 172.21.15.42:0/327492696 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd994074500 con 0x7fd99415f740 2024-09-17T01:45:33.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.841+0000 7fd98aa00640 1 -- 172.21.15.42:0/327492696 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v170) ==== 84+0+65 (secure 0 0 0) 0x7fd980066760 con 0x7fd99415f740 2024-09-17T01:45:33.839 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:45:33.839 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-09-17T01:45:33.839 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:45:33.839 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-09-17T01:45:33.839 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-09-17T01:45:33.839 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:45:33.839 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-09-17T01:45:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.843+0000 7fd999800640 1 -- 172.21.15.42:0/327492696 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd974078bc0 msgr2=0x7fd97407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.843+0000 7fd999800640 1 --2- 172.21.15.42:0/327492696 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd974078bc0 0x7fd97407b0d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd984034000 tx=0x7fd984004730 comp rx=0 tx=0).stop 2024-09-17T01:45:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.843+0000 7fd999800640 1 -- 172.21.15.42:0/327492696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd99415f740 msgr2=0x7fd99413e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.843+0000 7fd999800640 1 --2- 172.21.15.42:0/327492696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd99415f740 0x7fd99413e3f0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7fd98000c3c0 tx=0x7fd98000c880 comp rx=0 tx=0).stop 2024-09-17T01:45:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.843+0000 7fd999800640 1 -- 172.21.15.42:0/327492696 shutdown_connections 2024-09-17T01:45:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.843+0000 7fd999800640 1 --2- 172.21.15.42:0/327492696 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd974078bc0 0x7fd97407b0d0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.843+0000 7fd999800640 1 --2- 172.21.15.42:0/327492696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9941f97b0 0x7fd9941f8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:33.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.843+0000 7fd999800640 1 --2- 172.21.15.42:0/327492696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd99415f740 0x7fd99413e3f0 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:33.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.843+0000 7fd999800640 1 --2- 172.21.15.42:0/327492696 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd9940740f0 0x7fd9941f54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:33.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.843+0000 7fd999800640 1 -- 172.21.15.42:0/327492696 >> 172.21.15.42:0/327492696 conn(0x7fd9940b2930 msgr2=0x7fd994161b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:33.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.843+0000 7fd999800640 1 -- 172.21.15.42:0/327492696 shutdown_connections 2024-09-17T01:45:33.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:33.843+0000 7fd999800640 1 -- 172.21.15.42:0/327492696 wait complete. 2024-09-17T01:45:33.866 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T01:45:33.866 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T01:45:34.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.099+0000 7f952a400640 1 -- 172.21.15.42:0/3803562335 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9508004800 msgr2=0x7f9508004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:34.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.099+0000 7f952a400640 1 --2- 172.21.15.42:0/3803562335 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9508004800 0x7f9508004c10 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f950c00c290 tx=0x7f9508005830 comp rx=0 tx=0).stop 2024-09-17T01:45:34.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.099+0000 7f9523e00640 1 -- 172.21.15.42:0/3803562335 reap_dead start 2024-09-17T01:45:34.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.099+0000 7f952a400640 1 -- 172.21.15.42:0/3803562335 shutdown_connections 2024-09-17T01:45:34.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.099+0000 7f952a400640 1 -- 172.21.15.42:0/3803562335 >> 172.21.15.42:0/3803562335 conn(0x7f95240b28f0 msgr2=0x7f952406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:34.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.100+0000 7f952a400640 1 -- 172.21.15.42:0/3803562335 shutdown_connections 2024-09-17T01:45:34.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.100+0000 7f952a400640 1 -- 172.21.15.42:0/3803562335 wait complete. 2024-09-17T01:45:34.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.102+0000 7f952a400640 1 Processor -- start 2024-09-17T01:45:34.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.102+0000 7f952a400640 1 -- start start 2024-09-17T01:45:34.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.103+0000 7f952a400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9508004800 0x7f9524141240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:34.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.103+0000 7f952a400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f952413f9c0 0x7f9524073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:34.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.103+0000 7f952a400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95241f57a0 0x7f95241f5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:34.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.103+0000 7f952a400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f95240cdf30 con 0x7f952413f9c0 2024-09-17T01:45:34.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.103+0000 7f952a400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f952406dd50 con 0x7f95241f57a0 2024-09-17T01:45:34.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.103+0000 7f952a400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f95240ce0b0 con 0x7f9508004800 2024-09-17T01:45:34.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.104+0000 7f951be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f952413f9c0 0x7f9524073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:34.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.104+0000 7f951be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f952413f9c0 0x7f9524073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36866/0 (socket says 172.21.15.42:36866) 2024-09-17T01:45:34.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.104+0000 7f951be00640 1 -- 172.21.15.42:0/3396729286 learned_addr learned my addr 172.21.15.42:0/3396729286 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:34.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.104+0000 7f9523400640 1 --2- 172.21.15.42:0/3396729286 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9508004800 0x7f9524141240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:34.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.104+0000 7f9523e00640 1 --2- 172.21.15.42:0/3396729286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95241f57a0 0x7f95241f5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:34.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.104+0000 7f951be00640 1 -- 172.21.15.42:0/3396729286 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9508004800 msgr2=0x7f9524141240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:34.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.104+0000 7f951be00640 1 --2- 172.21.15.42:0/3396729286 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9508004800 0x7f9524141240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:34.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.104+0000 7f951be00640 1 -- 172.21.15.42:0/3396729286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95241f57a0 msgr2=0x7f95241f5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:34.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.104+0000 7f951be00640 1 --2- 172.21.15.42:0/3396729286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95241f57a0 0x7f95241f5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:34.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.104+0000 7f951be00640 1 -- 172.21.15.42:0/3396729286 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95241f60f0 con 0x7f952413f9c0 2024-09-17T01:45:34.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.104+0000 7f951be00640 1 --2- 172.21.15.42:0/3396729286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f952413f9c0 0x7f9524073570 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f950c00c290 tx=0x7f950c006d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:34.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.105+0000 7f951b400640 1 -- 172.21.15.42:0/3396729286 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c031040 con 0x7f952413f9c0 2024-09-17T01:45:34.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.105+0000 7f951b400640 1 -- 172.21.15.42:0/3396729286 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f950c0035f0 con 0x7f952413f9c0 2024-09-17T01:45:34.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.105+0000 7f951b400640 1 -- 172.21.15.42:0/3396729286 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c003a00 con 0x7f952413f9c0 2024-09-17T01:45:34.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.105+0000 7f952a400640 1 -- 172.21.15.42:0/3396729286 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95241f52c0 con 0x7f952413f9c0 2024-09-17T01:45:34.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.105+0000 7f952a400640 1 -- 172.21.15.42:0/3396729286 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95241f9020 con 0x7f952413f9c0 2024-09-17T01:45:34.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.106+0000 7f952a400640 1 -- 172.21.15.42:0/3396729286 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95241f8ab0 con 0x7f952413f9c0 2024-09-17T01:45:34.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.107+0000 7f951b400640 1 -- 172.21.15.42:0/3396729286 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f950c034070 con 0x7f952413f9c0 2024-09-17T01:45:34.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.108+0000 7f951b400640 1 --2- 172.21.15.42:0/3396729286 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9500078b90 0x7f950007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:34.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.108+0000 7f951b400640 1 -- 172.21.15.42:0/3396729286 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 4857+0+0 (secure 0 0 0) 0x7f950c0baa30 con 0x7f952413f9c0 2024-09-17T01:45:34.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.109+0000 7f9523400640 1 --2- 172.21.15.42:0/3396729286 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9500078b90 0x7f950007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:34.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.109+0000 7f9523400640 1 --2- 172.21.15.42:0/3396729286 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9500078b90 0x7f950007b0a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9514009460 tx=0x7f9514005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:34.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.113+0000 7f951b400640 1 -- 172.21.15.42:0/3396729286 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f950c082b60 con 0x7f952413f9c0 2024-09-17T01:45:34.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.309+0000 7f952a400640 1 -- 172.21.15.42:0/3396729286 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9524145b60 con 0x7f952413f9c0 2024-09-17T01:45:34.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.725+0000 7f951b400640 1 -- 172.21.15.42:0/3396729286 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v171) ==== 138+0+0 (secure 0 0 0) 0x7f950c087590 con 0x7f952413f9c0 2024-09-17T01:45:34.723 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-09-17T01:45:34.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.728+0000 7f952a400640 1 -- 172.21.15.42:0/3396729286 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9500078b90 msgr2=0x7f950007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:34.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.728+0000 7f952a400640 1 --2- 172.21.15.42:0/3396729286 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9500078b90 0x7f950007b0a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9514009460 tx=0x7f9514005f90 comp rx=0 tx=0).stop 2024-09-17T01:45:34.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.728+0000 7f952a400640 1 -- 172.21.15.42:0/3396729286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f952413f9c0 msgr2=0x7f9524073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:34.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.728+0000 7f952a400640 1 --2- 172.21.15.42:0/3396729286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f952413f9c0 0x7f9524073570 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f950c00c290 tx=0x7f950c006d70 comp rx=0 tx=0).stop 2024-09-17T01:45:34.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.728+0000 7f952a400640 1 -- 172.21.15.42:0/3396729286 shutdown_connections 2024-09-17T01:45:34.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.728+0000 7f952a400640 1 --2- 172.21.15.42:0/3396729286 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9500078b90 0x7f950007b0a0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:34.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.728+0000 7f952a400640 1 --2- 172.21.15.42:0/3396729286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95241f57a0 0x7f95241f5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:34.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.728+0000 7f952a400640 1 --2- 172.21.15.42:0/3396729286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f952413f9c0 0x7f9524073570 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:34.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.728+0000 7f952a400640 1 --2- 172.21.15.42:0/3396729286 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9508004800 0x7f9524141240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:34.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.728+0000 7f952a400640 1 -- 172.21.15.42:0/3396729286 >> 172.21.15.42:0/3396729286 conn(0x7f95240b28f0 msgr2=0x7f95240af890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:34.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.729+0000 7f952a400640 1 -- 172.21.15.42:0/3396729286 shutdown_connections 2024-09-17T01:45:34.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.729+0000 7f952a400640 1 -- 172.21.15.42:0/3396729286 wait complete. 2024-09-17T01:45:34.757 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T01:45:34.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.994+0000 7f9219c00640 1 -- 172.21.15.42:0/3621107875 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91f8005210 msgr2=0x7f91f800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:34.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.994+0000 7f9219c00640 1 --2- 172.21.15.42:0/3621107875 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91f8005210 0x7f91f800b9c0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f921406ded0 tx=0x7f91f8005830 comp rx=0 tx=0).stop 2024-09-17T01:45:34.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.994+0000 7f9219200640 1 -- 172.21.15.42:0/3621107875 reap_dead start 2024-09-17T01:45:34.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.994+0000 7f9219c00640 1 -- 172.21.15.42:0/3621107875 shutdown_connections 2024-09-17T01:45:34.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.994+0000 7f9219c00640 1 -- 172.21.15.42:0/3621107875 >> 172.21.15.42:0/3621107875 conn(0x7f92140b25f0 msgr2=0x7f92140d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:34.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.995+0000 7f9219c00640 1 -- 172.21.15.42:0/3621107875 shutdown_connections 2024-09-17T01:45:34.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.995+0000 7f9219c00640 1 -- 172.21.15.42:0/3621107875 wait complete. 2024-09-17T01:45:34.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.997+0000 7f9219c00640 1 Processor -- start 2024-09-17T01:45:34.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.997+0000 7f9219c00640 1 -- start start 2024-09-17T01:45:34.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.998+0000 7f9219c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91f8005210 0x7f921415f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:34.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.998+0000 7f9219c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9214073cd0 0x7f921415f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:34.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.998+0000 7f9219c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92141f6c10 0x7f92141f7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:34.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.998+0000 7f9219c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f921406d6a0 con 0x7f92141f6c10 2024-09-17T01:45:34.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.998+0000 7f9219c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f92140b42c0 con 0x7f9214073cd0 2024-09-17T01:45:34.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.998+0000 7f9219c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9214152ed0 con 0x7f91f8005210 2024-09-17T01:45:35.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.999+0000 7f9219200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92141f6c10 0x7f92141f7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:35.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.999+0000 7f9219200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92141f6c10 0x7f92141f7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36884/0 (socket says 172.21.15.42:36884) 2024-09-17T01:45:35.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.999+0000 7f9219200640 1 -- 172.21.15.42:0/2225424182 learned_addr learned my addr 172.21.15.42:0/2225424182 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:35.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.999+0000 7f9213e00640 1 --2- 172.21.15.42:0/2225424182 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91f8005210 0x7f921415f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:35.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.999+0000 7f920be00640 1 --2- 172.21.15.42:0/2225424182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9214073cd0 0x7f921415f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:35.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.999+0000 7f9219200640 1 -- 172.21.15.42:0/2225424182 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91f8005210 msgr2=0x7f921415f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:35.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.999+0000 7f9219200640 1 --2- 172.21.15.42:0/2225424182 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91f8005210 0x7f921415f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:35.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.999+0000 7f9219200640 1 -- 172.21.15.42:0/2225424182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9214073cd0 msgr2=0x7f921415f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:35.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.999+0000 7f9219200640 1 --2- 172.21.15.42:0/2225424182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9214073cd0 0x7f921415f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:35.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.999+0000 7f9219200640 1 -- 172.21.15.42:0/2225424182 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92140743b0 con 0x7f92141f6c10 2024-09-17T01:45:35.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.999+0000 7f920be00640 1 --2- 172.21.15.42:0/2225424182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9214073cd0 0x7f921415f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:45:35.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:34.999+0000 7f9219200640 1 --2- 172.21.15.42:0/2225424182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92141f6c10 0x7f92141f7020 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f920c002230 tx=0x7f920c033c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:35.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.000+0000 7f9210c00640 1 -- 172.21.15.42:0/2225424182 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c009c10 con 0x7f92141f6c10 2024-09-17T01:45:35.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.000+0000 7f9210c00640 1 -- 172.21.15.42:0/2225424182 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f920c03e470 con 0x7f92141f6c10 2024-09-17T01:45:35.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.000+0000 7f9210c00640 1 -- 172.21.15.42:0/2225424182 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c03e8c0 con 0x7f92141f6c10 2024-09-17T01:45:35.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.000+0000 7f9219c00640 1 -- 172.21.15.42:0/2225424182 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9214074690 con 0x7f92141f6c10 2024-09-17T01:45:35.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.000+0000 7f9219c00640 1 -- 172.21.15.42:0/2225424182 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9214074c50 con 0x7f92141f6c10 2024-09-17T01:45:35.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.001+0000 7f9219c00640 1 -- 172.21.15.42:0/2225424182 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f921406cd20 con 0x7f92141f6c10 2024-09-17T01:45:35.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.003+0000 7f9210c00640 1 -- 172.21.15.42:0/2225424182 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f920c046020 con 0x7f92141f6c10 2024-09-17T01:45:35.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.003+0000 7f9210c00640 1 --2- 172.21.15.42:0/2225424182 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f91f0078b90 0x7f91f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:35.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.004+0000 7f9210c00640 1 -- 172.21.15.42:0/2225424182 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5227+0+0 (secure 0 0 0) 0x7f920c0bc280 con 0x7f92141f6c10 2024-09-17T01:45:35.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.004+0000 7f9213e00640 1 --2- 172.21.15.42:0/2225424182 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f91f0078b90 0x7f91f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:35.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.005+0000 7f9213e00640 1 --2- 172.21.15.42:0/2225424182 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f91f0078b90 0x7f91f007b0a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9204001050 tx=0x7f9204006720 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:35.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.007+0000 7f9210c00640 1 -- 172.21.15.42:0/2225424182 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f920c084910 con 0x7f92141f6c10 2024-09-17T01:45:35.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.201+0000 7f9219c00640 1 -- 172.21.15.42:0/2225424182 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f9214074140 con 0x7f92141f6c10 2024-09-17T01:45:35.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.733+0000 7f9210c00640 1 -- 172.21.15.42:0/2225424182 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v172) ==== 170+0+0 (secure 0 0 0) 0x7f920c084210 con 0x7f92141f6c10 2024-09-17T01:45:35.731 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-09-17T01:45:35.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.736+0000 7f9219c00640 1 -- 172.21.15.42:0/2225424182 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f91f0078b90 msgr2=0x7f91f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:35.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.736+0000 7f9219c00640 1 --2- 172.21.15.42:0/2225424182 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f91f0078b90 0x7f91f007b0a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9204001050 tx=0x7f9204006720 comp rx=0 tx=0).stop 2024-09-17T01:45:35.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.736+0000 7f9219c00640 1 -- 172.21.15.42:0/2225424182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92141f6c10 msgr2=0x7f92141f7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:35.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.736+0000 7f9219c00640 1 --2- 172.21.15.42:0/2225424182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92141f6c10 0x7f92141f7020 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f920c002230 tx=0x7f920c033c30 comp rx=0 tx=0).stop 2024-09-17T01:45:35.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.737+0000 7f9219c00640 1 -- 172.21.15.42:0/2225424182 shutdown_connections 2024-09-17T01:45:35.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.737+0000 7f9219c00640 1 --2- 172.21.15.42:0/2225424182 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f91f0078b90 0x7f91f007b0a0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:35.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.737+0000 7f9219c00640 1 --2- 172.21.15.42:0/2225424182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9214073cd0 0x7f921415f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:35.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.737+0000 7f9219c00640 1 --2- 172.21.15.42:0/2225424182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f92141f6c10 0x7f92141f7020 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:35.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.737+0000 7f9219c00640 1 --2- 172.21.15.42:0/2225424182 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91f8005210 0x7f921415f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:35.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.737+0000 7f9219c00640 1 -- 172.21.15.42:0/2225424182 >> 172.21.15.42:0/2225424182 conn(0x7f92140b25f0 msgr2=0x7f92141e8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:35.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.737+0000 7f9219c00640 1 -- 172.21.15.42:0/2225424182 shutdown_connections 2024-09-17T01:45:35.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:35.737+0000 7f9219c00640 1 -- 172.21.15.42:0/2225424182 wait complete. 2024-09-17T01:45:35.778 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T01:45:36.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.011+0000 7ff26e400640 1 -- 172.21.15.42:0/4101068810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2680cf7c0 msgr2=0x7ff26806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:36.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.011+0000 7ff26e400640 1 --2- 172.21.15.42:0/4101068810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2680cf7c0 0x7ff26806cd20 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7ff254009830 tx=0x7ff25402a5c0 comp rx=0 tx=0).stop 2024-09-17T01:45:36.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.011+0000 7ff26e400640 1 -- 172.21.15.42:0/4101068810 shutdown_connections 2024-09-17T01:45:36.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.011+0000 7ff26e400640 1 --2- 172.21.15.42:0/4101068810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2680cf7c0 0x7ff26806cd20 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:36.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.011+0000 7ff26e400640 1 -- 172.21.15.42:0/4101068810 >> 172.21.15.42:0/4101068810 conn(0x7ff2680b25f0 msgr2=0x7ff2680d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:36.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.011+0000 7ff26e400640 1 -- 172.21.15.42:0/4101068810 shutdown_connections 2024-09-17T01:45:36.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.011+0000 7ff26e400640 1 -- 172.21.15.42:0/4101068810 wait complete. 2024-09-17T01:45:36.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.013+0000 7ff26e400640 1 Processor -- start 2024-09-17T01:45:36.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.014+0000 7ff26e400640 1 -- start start 2024-09-17T01:45:36.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.015+0000 7ff26e400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff26806d260 0x7ff2680af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:36.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.015+0000 7ff26e400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2680b4be0 0x7ff2681f9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:36.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.015+0000 7ff26e400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2680cf7c0 0x7ff2680741b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:36.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.015+0000 7ff26e400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff2681535e0 con 0x7ff2680cf7c0 2024-09-17T01:45:36.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.015+0000 7ff26e400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff2680b4340 con 0x7ff26806d260 2024-09-17T01:45:36.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.015+0000 7ff26e400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff268153760 con 0x7ff2680b4be0 2024-09-17T01:45:36.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.015+0000 7ff26da00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2680cf7c0 0x7ff2680741b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:36.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.015+0000 7ff26da00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2680cf7c0 0x7ff2680741b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49430/0 (socket says 172.21.15.42:49430) 2024-09-17T01:45:36.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.015+0000 7ff26da00640 1 -- 172.21.15.42:0/552409126 learned_addr learned my addr 172.21.15.42:0/552409126 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:36.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.016+0000 7ff267e00640 1 --2- 172.21.15.42:0/552409126 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2680b4be0 0x7ff2681f9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:36.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.016+0000 7ff26d000640 1 --2- 172.21.15.42:0/552409126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff26806d260 0x7ff2680af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:36.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.016+0000 7ff26da00640 1 -- 172.21.15.42:0/552409126 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2680b4be0 msgr2=0x7ff2681f9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:36.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.016+0000 7ff26da00640 1 --2- 172.21.15.42:0/552409126 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2680b4be0 0x7ff2681f9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:36.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.016+0000 7ff26da00640 1 -- 172.21.15.42:0/552409126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff26806d260 msgr2=0x7ff2680af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:36.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.016+0000 7ff26da00640 1 --2- 172.21.15.42:0/552409126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff26806d260 0x7ff2680af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:36.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.016+0000 7ff26da00640 1 -- 172.21.15.42:0/552409126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2681e9990 con 0x7ff2680cf7c0 2024-09-17T01:45:36.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.016+0000 7ff26da00640 1 --2- 172.21.15.42:0/552409126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2680cf7c0 0x7ff2680741b0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7ff26000c730 tx=0x7ff26000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:36.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.016+0000 7ff264c00640 1 -- 172.21.15.42:0/552409126 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260003b70 con 0x7ff2680cf7c0 2024-09-17T01:45:36.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.016+0000 7ff264c00640 1 -- 172.21.15.42:0/552409126 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff260003d30 con 0x7ff2680cf7c0 2024-09-17T01:45:36.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.016+0000 7ff264c00640 1 -- 172.21.15.42:0/552409126 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2600052d0 con 0x7ff2680cf7c0 2024-09-17T01:45:36.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.016+0000 7ff26e400640 1 -- 172.21.15.42:0/552409126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2681e9c70 con 0x7ff2680cf7c0 2024-09-17T01:45:36.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.017+0000 7ff26e400640 1 -- 172.21.15.42:0/552409126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2680733e0 con 0x7ff2680cf7c0 2024-09-17T01:45:36.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.018+0000 7ff26e400640 1 -- 172.21.15.42:0/552409126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff26806cd20 con 0x7ff2680cf7c0 2024-09-17T01:45:36.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.019+0000 7ff264c00640 1 -- 172.21.15.42:0/552409126 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff260005680 con 0x7ff2680cf7c0 2024-09-17T01:45:36.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.020+0000 7ff264c00640 1 --2- 172.21.15.42:0/552409126 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff248078bc0 0x7ff24807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:36.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.020+0000 7ff264c00640 1 -- 172.21.15.42:0/552409126 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 5609+0+0 (secure 0 0 0) 0x7ff26009b6f0 con 0x7ff2680cf7c0 2024-09-17T01:45:36.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.021+0000 7ff26d000640 1 --2- 172.21.15.42:0/552409126 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff248078bc0 0x7ff24807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:36.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.022+0000 7ff26d000640 1 --2- 172.21.15.42:0/552409126 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff248078bc0 0x7ff24807b0d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff25c000f60 tx=0x7ff25c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:36.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.024+0000 7ff264c00640 1 -- 172.21.15.42:0/552409126 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff26806d670 con 0x7ff2680cf7c0 2024-09-17T01:45:36.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.257+0000 7ff26e400640 1 -- 172.21.15.42:0/552409126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff2680b0700 con 0x7ff2680cf7c0 2024-09-17T01:45:36.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.735+0000 7ff264c00640 1 -- 172.21.15.42:0/552409126 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 25 v135) ==== 174+0+0 (secure 0 0 0) 0x7ff260063c00 con 0x7ff2680cf7c0 2024-09-17T01:45:36.733 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 24 and data pool 25 2024-09-17T01:45:36.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.739+0000 7ff26e400640 1 -- 172.21.15.42:0/552409126 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff248078bc0 msgr2=0x7ff24807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:36.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.739+0000 7ff26e400640 1 --2- 172.21.15.42:0/552409126 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff248078bc0 0x7ff24807b0d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff25c000f60 tx=0x7ff25c009040 comp rx=0 tx=0).stop 2024-09-17T01:45:36.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.739+0000 7ff26e400640 1 -- 172.21.15.42:0/552409126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2680cf7c0 msgr2=0x7ff2680741b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:36.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.739+0000 7ff26e400640 1 --2- 172.21.15.42:0/552409126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2680cf7c0 0x7ff2680741b0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7ff26000c730 tx=0x7ff26000cbf0 comp rx=0 tx=0).stop 2024-09-17T01:45:36.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.740+0000 7ff26e400640 1 -- 172.21.15.42:0/552409126 shutdown_connections 2024-09-17T01:45:36.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.740+0000 7ff26e400640 1 --2- 172.21.15.42:0/552409126 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff248078bc0 0x7ff24807b0d0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:36.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.740+0000 7ff26e400640 1 --2- 172.21.15.42:0/552409126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2680cf7c0 0x7ff2680741b0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:36.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.740+0000 7ff26e400640 1 --2- 172.21.15.42:0/552409126 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2680b4be0 0x7ff2681f9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:36.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.740+0000 7ff26e400640 1 --2- 172.21.15.42:0/552409126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff26806d260 0x7ff2680af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:36.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.740+0000 7ff26e400640 1 -- 172.21.15.42:0/552409126 >> 172.21.15.42:0/552409126 conn(0x7ff2680b25f0 msgr2=0x7ff2680caa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:36.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.740+0000 7ff26e400640 1 -- 172.21.15.42:0/552409126 shutdown_connections 2024-09-17T01:45:36.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:36.741+0000 7ff26e400640 1 -- 172.21.15.42:0/552409126 wait complete. 2024-09-17T01:45:36.786 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:45:37.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.016+0000 7f3deb200640 1 -- 172.21.15.42:0/2445933651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dec162fa0 msgr2=0x7f3dec15e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:37.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.016+0000 7f3deb200640 1 --2- 172.21.15.42:0/2445933651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dec162fa0 0x7f3dec15e910 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4005fd0 tx=0x7f3dd402a4f0 comp rx=0 tx=0).stop 2024-09-17T01:45:37.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.016+0000 7f3deb200640 1 -- 172.21.15.42:0/2445933651 shutdown_connections 2024-09-17T01:45:37.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.016+0000 7f3deb200640 1 --2- 172.21.15.42:0/2445933651 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3dec0b6030 0x7f3dec0b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:37.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.016+0000 7f3deb200640 1 --2- 172.21.15.42:0/2445933651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dec162fa0 0x7f3dec15e910 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:37.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.016+0000 7f3deb200640 1 --2- 172.21.15.42:0/2445933651 >> v2:172.21.15.43:3300/0 conn(0x7f3dec073340 0x7f3dec0d2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:37.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.016+0000 7f3deb200640 1 -- 172.21.15.42:0/2445933651 >> 172.21.15.42:0/2445933651 conn(0x7f3dec0d1210 msgr2=0x7f3dec0d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:37.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.016+0000 7f3deb200640 1 -- 172.21.15.42:0/2445933651 shutdown_connections 2024-09-17T01:45:37.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.016+0000 7f3deb200640 1 -- 172.21.15.42:0/2445933651 wait complete. 2024-09-17T01:45:37.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.018+0000 7f3deb200640 1 Processor -- start 2024-09-17T01:45:37.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.018+0000 7f3deb200640 1 -- start start 2024-09-17T01:45:37.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.020+0000 7f3deb200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dec073340 0x7f3dec15a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:37.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.020+0000 7f3deb200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dec0b6030 0x7f3dec0c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:37.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.020+0000 7f3deb200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3dec162fa0 0x7f3dec14d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:37.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.020+0000 7f3deb200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3dec15f850 con 0x7f3dec0b6030 2024-09-17T01:45:37.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.020+0000 7f3deb200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3dec15f6d0 con 0x7f3dec073340 2024-09-17T01:45:37.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.020+0000 7f3deb200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3dec15f9d0 con 0x7f3dec162fa0 2024-09-17T01:45:37.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.020+0000 7f3de1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dec0b6030 0x7f3dec0c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:37.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.020+0000 7f3de1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dec0b6030 0x7f3dec0c80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49444/0 (socket says 172.21.15.42:49444) 2024-09-17T01:45:37.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.020+0000 7f3de1400640 1 -- 172.21.15.42:0/3744189299 learned_addr learned my addr 172.21.15.42:0/3744189299 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:37.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.020+0000 7f3de9e00640 1 --2- 172.21.15.42:0/3744189299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dec073340 0x7f3dec15a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:37.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.020+0000 7f3dea800640 1 --2- 172.21.15.42:0/3744189299 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3dec162fa0 0x7f3dec14d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:37.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.020+0000 7f3de1400640 1 -- 172.21.15.42:0/3744189299 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3dec162fa0 msgr2=0x7f3dec14d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:37.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.020+0000 7f3de1400640 1 --2- 172.21.15.42:0/3744189299 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3dec162fa0 0x7f3dec14d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:37.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.020+0000 7f3de1400640 1 -- 172.21.15.42:0/3744189299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dec073340 msgr2=0x7f3dec15a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:37.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.020+0000 7f3de1400640 1 --2- 172.21.15.42:0/3744189299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dec073340 0x7f3dec15a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:37.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.021+0000 7f3de1400640 1 -- 172.21.15.42:0/3744189299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dec0ca640 con 0x7f3dec0b6030 2024-09-17T01:45:37.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.021+0000 7f3de1400640 1 --2- 172.21.15.42:0/3744189299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dec0b6030 0x7f3dec0c80e0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4034040 tx=0x7f3dd4003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:37.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.021+0000 7f3de2a00640 1 -- 172.21.15.42:0/3744189299 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd403e030 con 0x7f3dec0b6030 2024-09-17T01:45:37.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.021+0000 7f3de2a00640 1 -- 172.21.15.42:0/3744189299 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3dd4003e00 con 0x7f3dec0b6030 2024-09-17T01:45:37.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.021+0000 7f3de2a00640 1 -- 172.21.15.42:0/3744189299 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4035040 con 0x7f3dec0b6030 2024-09-17T01:45:37.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.021+0000 7f3deb200640 1 -- 172.21.15.42:0/3744189299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dec0c9da0 con 0x7f3dec0b6030 2024-09-17T01:45:37.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.021+0000 7f3deb200640 1 -- 172.21.15.42:0/3744189299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dec0ca360 con 0x7f3dec0b6030 2024-09-17T01:45:37.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.022+0000 7f3deb200640 1 -- 172.21.15.42:0/3744189299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dec15e910 con 0x7f3dec0b6030 2024-09-17T01:45:37.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.024+0000 7f3de2a00640 1 -- 172.21.15.42:0/3744189299 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3dd4041030 con 0x7f3dec0b6030 2024-09-17T01:45:37.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.025+0000 7f3de2a00640 1 --2- 172.21.15.42:0/3744189299 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3dc8078b90 0x7f3dc807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:37.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.025+0000 7f3de2a00640 1 -- 172.21.15.42:0/3744189299 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 5709+0+0 (secure 0 0 0) 0x7f3dd40bb480 con 0x7f3dec0b6030 2024-09-17T01:45:37.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.025+0000 7f3de9e00640 1 --2- 172.21.15.42:0/3744189299 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3dc8078b90 0x7f3dc807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:37.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.026+0000 7f3de9e00640 1 --2- 172.21.15.42:0/3744189299 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3dc8078b90 0x7f3dc807b0a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc005fd0 tx=0x7f3ddc00a250 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:37.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.030+0000 7f3de2a00640 1 -- 172.21.15.42:0/3744189299 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3dec15e910 con 0x7f3dec0b6030 2024-09-17T01:45:37.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.222+0000 7f3deb200640 1 -- 172.21.15.42:0/3744189299 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3dec0c9b30 con 0x7f3dec0b6030 2024-09-17T01:45:37.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.225+0000 7f3de2a00640 1 -- 172.21.15.42:0/3744189299 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) ==== 74+0+16648 (secure 0 0 0) 0x7f3dd4088e20 con 0x7f3dec0b6030 2024-09-17T01:45:37.223 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:45:37.223 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":173,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:45:36.259159+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:45:34.322650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-17T01:45:35.214870+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:45:37.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.226+0000 7f3deb200640 1 -- 172.21.15.42:0/3744189299 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3dc8078b90 msgr2=0x7f3dc807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:37.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.226+0000 7f3deb200640 1 --2- 172.21.15.42:0/3744189299 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3dc8078b90 0x7f3dc807b0a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc005fd0 tx=0x7f3ddc00a250 comp rx=0 tx=0).stop 2024-09-17T01:45:37.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.226+0000 7f3deb200640 1 -- 172.21.15.42:0/3744189299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dec0b6030 msgr2=0x7f3dec0c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:37.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.226+0000 7f3deb200640 1 --2- 172.21.15.42:0/3744189299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dec0b6030 0x7f3dec0c80e0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4034040 tx=0x7f3dd4003910 comp rx=0 tx=0).stop 2024-09-17T01:45:37.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.226+0000 7f3deb200640 1 -- 172.21.15.42:0/3744189299 shutdown_connections 2024-09-17T01:45:37.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.226+0000 7f3deb200640 1 --2- 172.21.15.42:0/3744189299 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3dc8078b90 0x7f3dc807b0a0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:37.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.226+0000 7f3deb200640 1 --2- 172.21.15.42:0/3744189299 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3dec162fa0 0x7f3dec14d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:37.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.226+0000 7f3deb200640 1 --2- 172.21.15.42:0/3744189299 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dec0b6030 0x7f3dec0c80e0 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:37.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.226+0000 7f3deb200640 1 --2- 172.21.15.42:0/3744189299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dec073340 0x7f3dec15a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:37.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.226+0000 7f3deb200640 1 -- 172.21.15.42:0/3744189299 >> 172.21.15.42:0/3744189299 conn(0x7f3dec0d1210 msgr2=0x7f3dec15df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:37.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.227+0000 7f3deb200640 1 -- 172.21.15.42:0/3744189299 shutdown_connections 2024-09-17T01:45:37.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.227+0000 7f3deb200640 1 -- 172.21.15.42:0/3744189299 wait complete. 2024-09-17T01:45:37.251 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:45:37.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.479+0000 7f6433e00640 1 -- 172.21.15.42:0/2191054964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64340cf7c0 msgr2=0x7f643406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:37.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.479+0000 7f6433e00640 1 --2- 172.21.15.42:0/2191054964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64340cf7c0 0x7f643406cd20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f641c009830 tx=0x7f641c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:45:37.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.479+0000 7f6433e00640 1 -- 172.21.15.42:0/2191054964 shutdown_connections 2024-09-17T01:45:37.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.479+0000 7f6433e00640 1 --2- 172.21.15.42:0/2191054964 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f643406d260 0x7f6434152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:37.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.479+0000 7f6433e00640 1 --2- 172.21.15.42:0/2191054964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64340cf7c0 0x7f643406cd20 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:37.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.479+0000 7f6433e00640 1 -- 172.21.15.42:0/2191054964 >> 172.21.15.42:0/2191054964 conn(0x7f64340b25f0 msgr2=0x7f64340d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:37.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.479+0000 7f6433e00640 1 -- 172.21.15.42:0/2191054964 shutdown_connections 2024-09-17T01:45:37.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.479+0000 7f6433e00640 1 -- 172.21.15.42:0/2191054964 wait complete. 2024-09-17T01:45:37.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.482+0000 7f6433e00640 1 Processor -- start 2024-09-17T01:45:37.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.482+0000 7f6433e00640 1 -- start start 2024-09-17T01:45:37.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.483+0000 7f6433e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f643406d260 0x7f643414c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:37.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.483+0000 7f6433e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f64340b4be0 0x7f643414d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:37.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.483+0000 7f6433e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64340cf7c0 0x7f643414d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:37.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.483+0000 7f6433e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6434153850 con 0x7f64340cf7c0 2024-09-17T01:45:37.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.483+0000 7f6433e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f64341536d0 con 0x7f643406d260 2024-09-17T01:45:37.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.483+0000 7f6433e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f64341539d0 con 0x7f64340b4be0 2024-09-17T01:45:37.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.484+0000 7f6433400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64340cf7c0 0x7f643414d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:37.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.484+0000 7f6433400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64340cf7c0 0x7f643414d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49446/0 (socket says 172.21.15.42:49446) 2024-09-17T01:45:37.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.484+0000 7f6433400640 1 -- 172.21.15.42:0/3621016271 learned_addr learned my addr 172.21.15.42:0/3621016271 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:37.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.484+0000 7f642be00640 1 --2- 172.21.15.42:0/3621016271 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f64340b4be0 0x7f643414d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:37.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.484+0000 7f6432a00640 1 --2- 172.21.15.42:0/3621016271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f643406d260 0x7f643414c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:37.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.484+0000 7f6433400640 1 -- 172.21.15.42:0/3621016271 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f64340b4be0 msgr2=0x7f643414d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:37.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.484+0000 7f6433400640 1 --2- 172.21.15.42:0/3621016271 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f64340b4be0 0x7f643414d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:37.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.484+0000 7f6433400640 1 -- 172.21.15.42:0/3621016271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f643406d260 msgr2=0x7f643414c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:37.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.484+0000 7f6433400640 1 --2- 172.21.15.42:0/3621016271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f643406d260 0x7f643414c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:37.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.484+0000 7f6433400640 1 -- 172.21.15.42:0/3621016271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643414cfa0 con 0x7f64340cf7c0 2024-09-17T01:45:37.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.484+0000 7f642be00640 1 --2- 172.21.15.42:0/3621016271 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f64340b4be0 0x7f643414d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:45:37.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.484+0000 7f6432a00640 1 --2- 172.21.15.42:0/3621016271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f643406d260 0x7f643414c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:45:37.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.484+0000 7f6433400640 1 --2- 172.21.15.42:0/3621016271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64340cf7c0 0x7f643414d790 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f642c00ea40 tx=0x7f642c00ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:37.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.485+0000 7f642aa00640 1 -- 172.21.15.42:0/3621016271 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c00ce40 con 0x7f64340cf7c0 2024-09-17T01:45:37.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.485+0000 7f642aa00640 1 -- 172.21.15.42:0/3621016271 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f642c004c10 con 0x7f64340cf7c0 2024-09-17T01:45:37.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.485+0000 7f642aa00640 1 -- 172.21.15.42:0/3621016271 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c005020 con 0x7f64340cf7c0 2024-09-17T01:45:37.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.485+0000 7f6433e00640 1 -- 172.21.15.42:0/3621016271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6434072cb0 con 0x7f64340cf7c0 2024-09-17T01:45:37.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.485+0000 7f6433e00640 1 -- 172.21.15.42:0/3621016271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6434073270 con 0x7f64340cf7c0 2024-09-17T01:45:37.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.486+0000 7f6433e00640 1 -- 172.21.15.42:0/3621016271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6434152ed0 con 0x7f64340cf7c0 2024-09-17T01:45:37.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.487+0000 7f642aa00640 1 -- 172.21.15.42:0/3621016271 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f642c0051c0 con 0x7f64340cf7c0 2024-09-17T01:45:37.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.489+0000 7f642aa00640 1 --2- 172.21.15.42:0/3621016271 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6410078b90 0x7f641007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:37.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.489+0000 7f642aa00640 1 -- 172.21.15.42:0/3621016271 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 5709+0+0 (secure 0 0 0) 0x7f642c09b9f0 con 0x7f64340cf7c0 2024-09-17T01:45:37.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.489+0000 7f6432a00640 1 --2- 172.21.15.42:0/3621016271 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6410078b90 0x7f641007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:37.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.490+0000 7f6432a00640 1 --2- 172.21.15.42:0/3621016271 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6410078b90 0x7f641007b0a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f6424001eb0 tx=0x7f6424009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:37.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.494+0000 7f642aa00640 1 -- 172.21.15.42:0/3621016271 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f642c063f50 con 0x7f64340cf7c0 2024-09-17T01:45:37.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.688+0000 7f6433e00640 1 -- 172.21.15.42:0/3621016271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f64340afac0 con 0x7f64340cf7c0 2024-09-17T01:45:37.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.689+0000 7f642aa00640 1 -- 172.21.15.42:0/3621016271 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) ==== 74+0+16648 (secure 0 0 0) 0x7f642c063850 con 0x7f64340cf7c0 2024-09-17T01:45:37.689 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:45:37.689 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":173,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:45:36.259159+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:45:34.322650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-17T01:45:35.214870+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:45:37.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.692+0000 7f6433e00640 1 -- 172.21.15.42:0/3621016271 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6410078b90 msgr2=0x7f641007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:37.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.692+0000 7f6433e00640 1 --2- 172.21.15.42:0/3621016271 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6410078b90 0x7f641007b0a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f6424001eb0 tx=0x7f6424009040 comp rx=0 tx=0).stop 2024-09-17T01:45:37.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.692+0000 7f6433e00640 1 -- 172.21.15.42:0/3621016271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64340cf7c0 msgr2=0x7f643414d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:37.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.692+0000 7f6433e00640 1 --2- 172.21.15.42:0/3621016271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64340cf7c0 0x7f643414d790 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f642c00ea40 tx=0x7f642c00ef00 comp rx=0 tx=0).stop 2024-09-17T01:45:37.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.692+0000 7f6433e00640 1 -- 172.21.15.42:0/3621016271 shutdown_connections 2024-09-17T01:45:37.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.692+0000 7f6433e00640 1 --2- 172.21.15.42:0/3621016271 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6410078b90 0x7f641007b0a0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:37.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.692+0000 7f6433e00640 1 --2- 172.21.15.42:0/3621016271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f64340cf7c0 0x7f643414d790 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:37.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.692+0000 7f6433e00640 1 --2- 172.21.15.42:0/3621016271 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f64340b4be0 0x7f643414d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:37.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.692+0000 7f6433e00640 1 --2- 172.21.15.42:0/3621016271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f643406d260 0x7f643414c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:37.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.692+0000 7f6433e00640 1 -- 172.21.15.42:0/3621016271 >> 172.21.15.42:0/3621016271 conn(0x7f64340b25f0 msgr2=0x7f64340afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:37.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.692+0000 7f6433e00640 1 -- 172.21.15.42:0/3621016271 shutdown_connections 2024-09-17T01:45:37.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.692+0000 7f6433e00640 1 -- 172.21.15.42:0/3621016271 wait complete. 2024-09-17T01:45:37.717 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T01:45:37.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.950+0000 7f2f6ac00640 1 -- 172.21.15.42:0/2469521360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f64162520 msgr2=0x7f2f640cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:37.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.950+0000 7f2f6ac00640 1 --2- 172.21.15.42:0/2469521360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f64162520 0x7f2f640cf840 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2f50005fd0 tx=0x7f2f5002a540 comp rx=0 tx=0).stop 2024-09-17T01:45:37.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.951+0000 7f2f6ac00640 1 -- 172.21.15.42:0/2469521360 shutdown_connections 2024-09-17T01:45:37.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.951+0000 7f2f6ac00640 1 --2- 172.21.15.42:0/2469521360 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f640cfd80 0x7f2f640d2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:37.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.951+0000 7f2f6ac00640 1 --2- 172.21.15.42:0/2469521360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f64162520 0x7f2f640cf840 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:37.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.951+0000 7f2f6ac00640 1 -- 172.21.15.42:0/2469521360 >> 172.21.15.42:0/2469521360 conn(0x7f2f64073f20 msgr2=0x7f2f6406cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:37.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.951+0000 7f2f6ac00640 1 -- 172.21.15.42:0/2469521360 shutdown_connections 2024-09-17T01:45:37.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.951+0000 7f2f6ac00640 1 -- 172.21.15.42:0/2469521360 wait complete. 2024-09-17T01:45:37.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.953+0000 7f2f6ac00640 1 Processor -- start 2024-09-17T01:45:37.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.953+0000 7f2f6ac00640 1 -- start start 2024-09-17T01:45:37.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.955+0000 7f2f6ac00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f640cfd80 0x7f2f640cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:37.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.955+0000 7f2f6ac00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f6415fbe0 0x7f2f640cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:37.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.955+0000 7f2f6ac00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f64162520 0x7f2f640b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:37.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.955+0000 7f2f6ac00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2f640d0d00 con 0x7f2f640cfd80 2024-09-17T01:45:37.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.955+0000 7f2f6ac00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2f640d3900 con 0x7f2f64162520 2024-09-17T01:45:37.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.955+0000 7f2f6ac00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2f640d0e80 con 0x7f2f6415fbe0 2024-09-17T01:45:37.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.955+0000 7f2f69800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f640cfd80 0x7f2f640cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:37.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.955+0000 7f2f69800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f640cfd80 0x7f2f640cdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49458/0 (socket says 172.21.15.42:49458) 2024-09-17T01:45:37.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.955+0000 7f2f69800640 1 -- 172.21.15.42:0/213119086 learned_addr learned my addr 172.21.15.42:0/213119086 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:37.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.955+0000 7f2f68e00640 1 --2- 172.21.15.42:0/213119086 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f6415fbe0 0x7f2f640cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:37.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.955+0000 7f2f6a200640 1 --2- 172.21.15.42:0/213119086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f64162520 0x7f2f640b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:37.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.955+0000 7f2f69800640 1 -- 172.21.15.42:0/213119086 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f6415fbe0 msgr2=0x7f2f640cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:37.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.955+0000 7f2f69800640 1 --2- 172.21.15.42:0/213119086 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f6415fbe0 0x7f2f640cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:37.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.955+0000 7f2f69800640 1 -- 172.21.15.42:0/213119086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f64162520 msgr2=0x7f2f640b5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:37.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.955+0000 7f2f69800640 1 --2- 172.21.15.42:0/213119086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f64162520 0x7f2f640b5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:37.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.955+0000 7f2f69800640 1 -- 172.21.15.42:0/213119086 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f641f5c00 con 0x7f2f640cfd80 2024-09-17T01:45:37.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.956+0000 7f2f69800640 1 --2- 172.21.15.42:0/213119086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f640cfd80 0x7f2f640cdaa0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f2f5800c460 tx=0x7f2f5800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:37.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.956+0000 7f2f61600640 1 -- 172.21.15.42:0/213119086 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f58017070 con 0x7f2f640cfd80 2024-09-17T01:45:37.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.956+0000 7f2f61600640 1 -- 172.21.15.42:0/213119086 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f580053e0 con 0x7f2f640cfd80 2024-09-17T01:45:37.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.956+0000 7f2f6ac00640 1 -- 172.21.15.42:0/213119086 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f641f5ee0 con 0x7f2f640cfd80 2024-09-17T01:45:37.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.956+0000 7f2f61600640 1 -- 172.21.15.42:0/213119086 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f58003850 con 0x7f2f640cfd80 2024-09-17T01:45:37.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.956+0000 7f2f6ac00640 1 -- 172.21.15.42:0/213119086 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f640b53e0 con 0x7f2f640cfd80 2024-09-17T01:45:37.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.957+0000 7f2f6ac00640 1 -- 172.21.15.42:0/213119086 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f64076910 con 0x7f2f640cfd80 2024-09-17T01:45:37.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.959+0000 7f2f61600640 1 -- 172.21.15.42:0/213119086 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2f5801a070 con 0x7f2f640cfd80 2024-09-17T01:45:37.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.959+0000 7f2f61600640 1 --2- 172.21.15.42:0/213119086 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f44078b90 0x7f2f4407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:37.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.960+0000 7f2f61600640 1 -- 172.21.15.42:0/213119086 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5709+0+0 (secure 0 0 0) 0x7f2f5809a180 con 0x7f2f640cfd80 2024-09-17T01:45:37.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.960+0000 7f2f68e00640 1 --2- 172.21.15.42:0/213119086 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f44078b90 0x7f2f4407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:37.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.961+0000 7f2f68e00640 1 --2- 172.21.15.42:0/213119086 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f44078b90 0x7f2f4407b0a0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f2f50033000 tx=0x7f2f50004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:37.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:37.964+0000 7f2f61600640 1 -- 172.21.15.42:0/213119086 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2f64076910 con 0x7f2f640cfd80 2024-09-17T01:45:38.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:38.194+0000 7f2f6ac00640 1 -- 172.21.15.42:0/213119086 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2f640d13a0 con 0x7f2f640cfd80 2024-09-17T01:45:38.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:38.758+0000 7f2f61600640 1 -- 172.21.15.42:0/213119086 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v138) ==== 118+0+0 (secure 0 0 0) 0x7f2f58062520 con 0x7f2f640cfd80 2024-09-17T01:45:38.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:38.761+0000 7f2f6ac00640 1 -- 172.21.15.42:0/213119086 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f44078b90 msgr2=0x7f2f4407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:38.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:38.761+0000 7f2f6ac00640 1 --2- 172.21.15.42:0/213119086 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f44078b90 0x7f2f4407b0a0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f2f50033000 tx=0x7f2f50004730 comp rx=0 tx=0).stop 2024-09-17T01:45:38.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:38.761+0000 7f2f6ac00640 1 -- 172.21.15.42:0/213119086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f640cfd80 msgr2=0x7f2f640cdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:38.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:38.761+0000 7f2f6ac00640 1 --2- 172.21.15.42:0/213119086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f640cfd80 0x7f2f640cdaa0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f2f5800c460 tx=0x7f2f5800c920 comp rx=0 tx=0).stop 2024-09-17T01:45:38.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:38.761+0000 7f2f6ac00640 1 -- 172.21.15.42:0/213119086 shutdown_connections 2024-09-17T01:45:38.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:38.761+0000 7f2f6ac00640 1 --2- 172.21.15.42:0/213119086 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f44078b90 0x7f2f4407b0a0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:38.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:38.761+0000 7f2f6ac00640 1 --2- 172.21.15.42:0/213119086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f64162520 0x7f2f640b5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:38.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:38.761+0000 7f2f6ac00640 1 --2- 172.21.15.42:0/213119086 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f6415fbe0 0x7f2f640cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:38.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:38.761+0000 7f2f6ac00640 1 --2- 172.21.15.42:0/213119086 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f640cfd80 0x7f2f640cdaa0 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:38.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:38.761+0000 7f2f6ac00640 1 -- 172.21.15.42:0/213119086 >> 172.21.15.42:0/213119086 conn(0x7f2f64073f20 msgr2=0x7f2f640b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:38.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:38.761+0000 7f2f6ac00640 1 -- 172.21.15.42:0/213119086 shutdown_connections 2024-09-17T01:45:38.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:38.762+0000 7f2f6ac00640 1 -- 172.21.15.42:0/213119086 wait complete. 2024-09-17T01:45:38.789 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T01:45:38.790 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T01:45:39.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.025+0000 7fd394600640 1 -- 172.21.15.42:0/1766719971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd38c142f40 msgr2=0x7fd38c072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:39.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.025+0000 7fd394600640 1 --2- 172.21.15.42:0/1766719971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd38c142f40 0x7fd38c072950 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd378009830 tx=0x7fd37802a480 comp rx=0 tx=0).stop 2024-09-17T01:45:39.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.025+0000 7fd394600640 1 -- 172.21.15.42:0/1766719971 shutdown_connections 2024-09-17T01:45:39.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.025+0000 7fd394600640 1 --2- 172.21.15.42:0/1766719971 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd38c072e90 0x7fd38c0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:39.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.025+0000 7fd394600640 1 --2- 172.21.15.42:0/1766719971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd38c142f40 0x7fd38c072950 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:39.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.025+0000 7fd394600640 1 -- 172.21.15.42:0/1766719971 >> 172.21.15.42:0/1766719971 conn(0x7fd38c0b2930 msgr2=0x7fd38c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:39.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.026+0000 7fd394600640 1 -- 172.21.15.42:0/1766719971 shutdown_connections 2024-09-17T01:45:39.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.026+0000 7fd394600640 1 -- 172.21.15.42:0/1766719971 wait complete. 2024-09-17T01:45:39.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.028+0000 7fd394600640 1 Processor -- start 2024-09-17T01:45:39.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.028+0000 7fd394600640 1 -- start start 2024-09-17T01:45:39.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.029+0000 7fd394600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd38c072e90 0x7fd38c15b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:39.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.029+0000 7fd394600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd38c0b3550 0x7fd38c15bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:39.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.029+0000 7fd394600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd38c142f40 0x7fd38c1f93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:39.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.030+0000 7fd394600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd38c06d640 con 0x7fd38c072e90 2024-09-17T01:45:39.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.030+0000 7fd394600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd38c0cf590 con 0x7fd38c142f40 2024-09-17T01:45:39.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.030+0000 7fd394600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd38c06d7c0 con 0x7fd38c0b3550 2024-09-17T01:45:39.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.030+0000 7fd391c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd38c072e90 0x7fd38c15b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:39.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.030+0000 7fd391c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd38c072e90 0x7fd38c15b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49460/0 (socket says 172.21.15.42:49460) 2024-09-17T01:45:39.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.030+0000 7fd391c00640 1 -- 172.21.15.42:0/2968300919 learned_addr learned my addr 172.21.15.42:0/2968300919 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:39.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.030+0000 7fd392600640 1 --2- 172.21.15.42:0/2968300919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd38c142f40 0x7fd38c1f93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:39.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.030+0000 7fd391200640 1 --2- 172.21.15.42:0/2968300919 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd38c0b3550 0x7fd38c15bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:39.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.030+0000 7fd391c00640 1 -- 172.21.15.42:0/2968300919 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd38c0b3550 msgr2=0x7fd38c15bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:39.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.030+0000 7fd391c00640 1 --2- 172.21.15.42:0/2968300919 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd38c0b3550 0x7fd38c15bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:39.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.030+0000 7fd391c00640 1 -- 172.21.15.42:0/2968300919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd38c142f40 msgr2=0x7fd38c1f93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:39.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.030+0000 7fd391c00640 1 --2- 172.21.15.42:0/2968300919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd38c142f40 0x7fd38c1f93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:39.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.030+0000 7fd391c00640 1 -- 172.21.15.42:0/2968300919 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38c1f5b80 con 0x7fd38c072e90 2024-09-17T01:45:39.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.031+0000 7fd391c00640 1 --2- 172.21.15.42:0/2968300919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd38c072e90 0x7fd38c15b810 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7fd38000c3d0 tx=0x7fd38000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:39.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.031+0000 7fd389600640 1 -- 172.21.15.42:0/2968300919 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd380017070 con 0x7fd38c072e90 2024-09-17T01:45:39.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.031+0000 7fd389600640 1 -- 172.21.15.42:0/2968300919 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3800053c0 con 0x7fd38c072e90 2024-09-17T01:45:39.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.031+0000 7fd389600640 1 -- 172.21.15.42:0/2968300919 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd380003850 con 0x7fd38c072e90 2024-09-17T01:45:39.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.031+0000 7fd394600640 1 -- 172.21.15.42:0/2968300919 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd38c1f5e40 con 0x7fd38c072e90 2024-09-17T01:45:39.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.031+0000 7fd394600640 1 -- 172.21.15.42:0/2968300919 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd38c1f6400 con 0x7fd38c072e90 2024-09-17T01:45:39.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.032+0000 7fd394600640 1 -- 172.21.15.42:0/2968300919 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd38c06dce0 con 0x7fd38c072e90 2024-09-17T01:45:39.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.033+0000 7fd389600640 1 -- 172.21.15.42:0/2968300919 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd38001a070 con 0x7fd38c072e90 2024-09-17T01:45:39.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.034+0000 7fd389600640 1 --2- 172.21.15.42:0/2968300919 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd36c078b90 0x7fd36c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:39.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.034+0000 7fd389600640 1 -- 172.21.15.42:0/2968300919 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5709+0+0 (secure 0 0 0) 0x7fd38009a0f0 con 0x7fd38c072e90 2024-09-17T01:45:39.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.035+0000 7fd391200640 1 --2- 172.21.15.42:0/2968300919 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd36c078b90 0x7fd36c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:39.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.036+0000 7fd391200640 1 --2- 172.21.15.42:0/2968300919 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd36c078b90 0x7fd36c07b0a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd378034000 tx=0x7fd378004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:39.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.039+0000 7fd389600640 1 -- 172.21.15.42:0/2968300919 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd380061e40 con 0x7fd38c072e90 2024-09-17T01:45:39.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.273+0000 7fd394600640 1 -- 172.21.15.42:0/2968300919 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd38c06a170 con 0x7fd38c072e90 2024-09-17T01:45:39.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.764+0000 7fd389600640 1 -- 172.21.15.42:0/2968300919 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v139) ==== 122+0+0 (secure 0 0 0) 0x7fd380066870 con 0x7fd38c072e90 2024-09-17T01:45:39.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.767+0000 7fd394600640 1 -- 172.21.15.42:0/2968300919 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd36c078b90 msgr2=0x7fd36c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:39.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.767+0000 7fd394600640 1 --2- 172.21.15.42:0/2968300919 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd36c078b90 0x7fd36c07b0a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd378034000 tx=0x7fd378004730 comp rx=0 tx=0).stop 2024-09-17T01:45:39.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.767+0000 7fd394600640 1 -- 172.21.15.42:0/2968300919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd38c072e90 msgr2=0x7fd38c15b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:39.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.767+0000 7fd394600640 1 --2- 172.21.15.42:0/2968300919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd38c072e90 0x7fd38c15b810 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7fd38000c3d0 tx=0x7fd38000c890 comp rx=0 tx=0).stop 2024-09-17T01:45:39.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.768+0000 7fd394600640 1 -- 172.21.15.42:0/2968300919 shutdown_connections 2024-09-17T01:45:39.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.768+0000 7fd394600640 1 --2- 172.21.15.42:0/2968300919 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd36c078b90 0x7fd36c07b0a0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:39.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.768+0000 7fd394600640 1 --2- 172.21.15.42:0/2968300919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd38c142f40 0x7fd38c1f93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:39.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.768+0000 7fd394600640 1 --2- 172.21.15.42:0/2968300919 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd38c0b3550 0x7fd38c15bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:39.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.768+0000 7fd394600640 1 --2- 172.21.15.42:0/2968300919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd38c072e90 0x7fd38c15b810 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:39.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.768+0000 7fd394600640 1 -- 172.21.15.42:0/2968300919 >> 172.21.15.42:0/2968300919 conn(0x7fd38c0b2930 msgr2=0x7fd38c15e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:39.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.768+0000 7fd394600640 1 -- 172.21.15.42:0/2968300919 shutdown_connections 2024-09-17T01:45:39.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:39.768+0000 7fd394600640 1 -- 172.21.15.42:0/2968300919 wait complete. 2024-09-17T01:45:39.790 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T01:45:39.790 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:45:40.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.019+0000 7f307a200640 1 -- 172.21.15.42:0/1777358273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3074142f40 msgr2=0x7f3074072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:40.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.019+0000 7f307a200640 1 --2- 172.21.15.42:0/1777358273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3074142f40 0x7f3074072950 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f305c009830 tx=0x7f305c02a480 comp rx=0 tx=0).stop 2024-09-17T01:45:40.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.020+0000 7f307a200640 1 -- 172.21.15.42:0/1777358273 shutdown_connections 2024-09-17T01:45:40.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.020+0000 7f307a200640 1 --2- 172.21.15.42:0/1777358273 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3074072e90 0x7f30740cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:40.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.020+0000 7f307a200640 1 --2- 172.21.15.42:0/1777358273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3074142f40 0x7f3074072950 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:40.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.020+0000 7f307a200640 1 -- 172.21.15.42:0/1777358273 >> 172.21.15.42:0/1777358273 conn(0x7f30740b2930 msgr2=0x7f307406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:40.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.020+0000 7f307a200640 1 -- 172.21.15.42:0/1777358273 shutdown_connections 2024-09-17T01:45:40.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.020+0000 7f307a200640 1 -- 172.21.15.42:0/1777358273 wait complete. 2024-09-17T01:45:40.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.022+0000 7f307a200640 1 Processor -- start 2024-09-17T01:45:40.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.022+0000 7f307a200640 1 -- start start 2024-09-17T01:45:40.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.024+0000 7f307a200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3074072e90 0x7f307413f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:40.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.024+0000 7f307a200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30740b3550 0x7f307406fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:40.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.024+0000 7f307a200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3074142f40 0x7f30741f8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:40.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.024+0000 7f307a200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f307406d640 con 0x7f30740b3550 2024-09-17T01:45:40.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.024+0000 7f307a200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f30740cf590 con 0x7f3074072e90 2024-09-17T01:45:40.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.024+0000 7f307a200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f307406d7c0 con 0x7f3074142f40 2024-09-17T01:45:40.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.024+0000 7f306aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30740b3550 0x7f307406fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:40.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.024+0000 7f306aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30740b3550 0x7f307406fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49472/0 (socket says 172.21.15.42:49472) 2024-09-17T01:45:40.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.024+0000 7f306aa00640 1 -- 172.21.15.42:0/4182650284 learned_addr learned my addr 172.21.15.42:0/4182650284 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:40.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.024+0000 7f3073400640 1 --2- 172.21.15.42:0/4182650284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3074072e90 0x7f307413f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:40.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.024+0000 7f3073e00640 1 --2- 172.21.15.42:0/4182650284 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3074142f40 0x7f30741f8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:40.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.024+0000 7f306aa00640 1 -- 172.21.15.42:0/4182650284 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3074142f40 msgr2=0x7f30741f8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:40.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.024+0000 7f306aa00640 1 --2- 172.21.15.42:0/4182650284 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3074142f40 0x7f30741f8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:40.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.024+0000 7f306aa00640 1 -- 172.21.15.42:0/4182650284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3074072e90 msgr2=0x7f307413f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:40.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.024+0000 7f306aa00640 1 --2- 172.21.15.42:0/4182650284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3074072e90 0x7f307413f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:40.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.025+0000 7f306aa00640 1 -- 172.21.15.42:0/4182650284 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3074155710 con 0x7f30740b3550 2024-09-17T01:45:40.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.025+0000 7f306aa00640 1 --2- 172.21.15.42:0/4182650284 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30740b3550 0x7f307406fb20 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f305c000c00 tx=0x7f305c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:40.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.025+0000 7f306be00640 1 -- 172.21.15.42:0/4182650284 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c005c90 con 0x7f30740b3550 2024-09-17T01:45:40.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.025+0000 7f306be00640 1 -- 172.21.15.42:0/4182650284 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f305c031e50 con 0x7f30740b3550 2024-09-17T01:45:40.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.025+0000 7f307a200640 1 -- 172.21.15.42:0/4182650284 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30741559f0 con 0x7f30740b3550 2024-09-17T01:45:40.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.025+0000 7f306be00640 1 -- 172.21.15.42:0/4182650284 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c0332f0 con 0x7f30740b3550 2024-09-17T01:45:40.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.025+0000 7f307a200640 1 -- 172.21.15.42:0/4182650284 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3074155fb0 con 0x7f30740b3550 2024-09-17T01:45:40.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.026+0000 7f307a200640 1 -- 172.21.15.42:0/4182650284 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f307406dce0 con 0x7f30740b3550 2024-09-17T01:45:40.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.028+0000 7f306be00640 1 -- 172.21.15.42:0/4182650284 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f305c033490 con 0x7f30740b3550 2024-09-17T01:45:40.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.028+0000 7f306be00640 1 --2- 172.21.15.42:0/4182650284 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3050078b90 0x7f305007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:40.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.029+0000 7f306be00640 1 -- 172.21.15.42:0/4182650284 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5709+0+0 (secure 0 0 0) 0x7f305c0bc090 con 0x7f30740b3550 2024-09-17T01:45:40.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.029+0000 7f3073400640 1 --2- 172.21.15.42:0/4182650284 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3050078b90 0x7f305007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:40.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.030+0000 7f3073400640 1 --2- 172.21.15.42:0/4182650284 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3050078b90 0x7f305007b0a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f3064007fd0 tx=0x7f3064001370 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:40.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.033+0000 7f306be00640 1 -- 172.21.15.42:0/4182650284 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f305c03f030 con 0x7f30740b3550 2024-09-17T01:45:40.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.263+0000 7f307a200640 1 -- 172.21.15.42:0/4182650284 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f307406a170 con 0x7f30740b3550 2024-09-17T01:45:40.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.264+0000 7f306be00640 1 -- 172.21.15.42:0/4182650284 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 139 v139) ==== 95+0+5230 (secure 0 0 0) 0x7f305c083de0 con 0x7f30740b3550 2024-09-17T01:45:40.262 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:45:40.263 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":139,"btime":"2024-09-17T01:45:39:760872+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1946373489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1946373489},{"type":"v1","addr":"172.21.15.43:6837","nonce":1946373489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134},{"gid":9280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/1948698658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1948698658},{"type":"v1","addr":"172.21.15.43:6835","nonce":1948698658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":9960,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/908320168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":908320168},{"type":"v1","addr":"172.21.15.42:6833","nonce":908320168}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132}],"filesystems":[{"mdsmap":{"epoch":139,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:45:36.259119+0000","modified":"2024-09-17T01:45:39.275365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9969":{"gid":9969,"name":"a","rank":0,"incarnation":135,"state":"up:active","state_seq":5,"addr":"172.21.15.42:6835/2353432649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":2353432649},{"type":"v1","addr":"172.21.15.42:6835","nonce":2353432649}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9969,"qdb_cluster":[9969]},"id":12}]} 2024-09-17T01:45:40.263 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 139 2024-09-17T01:45:40.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.266+0000 7f307a200640 1 -- 172.21.15.42:0/4182650284 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3050078b90 msgr2=0x7f305007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:40.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.266+0000 7f307a200640 1 --2- 172.21.15.42:0/4182650284 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3050078b90 0x7f305007b0a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f3064007fd0 tx=0x7f3064001370 comp rx=0 tx=0).stop 2024-09-17T01:45:40.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.266+0000 7f307a200640 1 -- 172.21.15.42:0/4182650284 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30740b3550 msgr2=0x7f307406fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:40.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.266+0000 7f307a200640 1 --2- 172.21.15.42:0/4182650284 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30740b3550 0x7f307406fb20 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f305c000c00 tx=0x7f305c033c20 comp rx=0 tx=0).stop 2024-09-17T01:45:40.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.266+0000 7f307a200640 1 -- 172.21.15.42:0/4182650284 shutdown_connections 2024-09-17T01:45:40.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.266+0000 7f307a200640 1 --2- 172.21.15.42:0/4182650284 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3050078b90 0x7f305007b0a0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:40.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.266+0000 7f307a200640 1 --2- 172.21.15.42:0/4182650284 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3074142f40 0x7f30741f8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:40.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.266+0000 7f307a200640 1 --2- 172.21.15.42:0/4182650284 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30740b3550 0x7f307406fb20 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:40.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.266+0000 7f307a200640 1 --2- 172.21.15.42:0/4182650284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3074072e90 0x7f307413f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:40.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.266+0000 7f307a200640 1 -- 172.21.15.42:0/4182650284 >> 172.21.15.42:0/4182650284 conn(0x7f30740b2930 msgr2=0x7f3074073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:40.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.266+0000 7f307a200640 1 -- 172.21.15.42:0/4182650284 shutdown_connections 2024-09-17T01:45:40.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.266+0000 7f307a200640 1 -- 172.21.15.42:0/4182650284 wait complete. 2024-09-17T01:45:40.288 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:45:40.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.515+0000 7f137f200640 1 -- 172.21.15.42:0/3906527741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1364005150 msgr2=0x7f136400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:40.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.515+0000 7f137f200640 1 --2- 172.21.15.42:0/3906527741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1364005150 0x7f136400b9c0 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f13800b4890 tx=0x7f1364005830 comp rx=0 tx=0).stop 2024-09-17T01:45:40.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.515+0000 7f137e800640 1 -- 172.21.15.42:0/3906527741 reap_dead start 2024-09-17T01:45:40.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.516+0000 7f137f200640 1 -- 172.21.15.42:0/3906527741 shutdown_connections 2024-09-17T01:45:40.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.516+0000 7f137f200640 1 -- 172.21.15.42:0/3906527741 >> 172.21.15.42:0/3906527741 conn(0x7f13800b25f0 msgr2=0x7f13800d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:40.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.516+0000 7f137f200640 1 -- 172.21.15.42:0/3906527741 shutdown_connections 2024-09-17T01:45:40.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.516+0000 7f137f200640 1 -- 172.21.15.42:0/3906527741 wait complete. 2024-09-17T01:45:40.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.518+0000 7f137f200640 1 Processor -- start 2024-09-17T01:45:40.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.518+0000 7f137f200640 1 -- start start 2024-09-17T01:45:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.519+0000 7f137f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1364005150 0x7f138014e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.519+0000 7f137f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f138014ffa0 0x7f13801f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.519+0000 7f137f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13801f72e0 0x7f13801f76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.520+0000 7f137f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f138006d0b0 con 0x7f13801f72e0 2024-09-17T01:45:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.520+0000 7f137f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f138006cf30 con 0x7f1364005150 2024-09-17T01:45:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.520+0000 7f137f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f13800cfd70 con 0x7f138014ffa0 2024-09-17T01:45:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.520+0000 7f137e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13801f72e0 0x7f13801f76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.520+0000 7f137e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13801f72e0 0x7f13801f76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49488/0 (socket says 172.21.15.42:49488) 2024-09-17T01:45:40.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.520+0000 7f137e800640 1 -- 172.21.15.42:0/677537886 learned_addr learned my addr 172.21.15.42:0/677537886 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.520+0000 7f137d400640 1 --2- 172.21.15.42:0/677537886 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f138014ffa0 0x7f13801f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.520+0000 7f137de00640 1 --2- 172.21.15.42:0/677537886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1364005150 0x7f138014e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.520+0000 7f137e800640 1 -- 172.21.15.42:0/677537886 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f138014ffa0 msgr2=0x7f13801f6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.520+0000 7f137e800640 1 --2- 172.21.15.42:0/677537886 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f138014ffa0 0x7f13801f6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.520+0000 7f137e800640 1 -- 172.21.15.42:0/677537886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1364005150 msgr2=0x7f138014e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.520+0000 7f137e800640 1 --2- 172.21.15.42:0/677537886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1364005150 0x7f138014e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:40.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.520+0000 7f137e800640 1 -- 172.21.15.42:0/677537886 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13801506b0 con 0x7f13801f72e0 2024-09-17T01:45:40.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.521+0000 7f137e800640 1 --2- 172.21.15.42:0/677537886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13801f72e0 0x7f13801f76f0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f137802b600 tx=0x7f1378001290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:40.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.521+0000 7f1376000640 1 -- 172.21.15.42:0/677537886 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1378001a40 con 0x7f13801f72e0 2024-09-17T01:45:40.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.521+0000 7f1376000640 1 -- 172.21.15.42:0/677537886 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1378001be0 con 0x7f13801f72e0 2024-09-17T01:45:40.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.521+0000 7f1376000640 1 -- 172.21.15.42:0/677537886 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137802bbb0 con 0x7f13801f72e0 2024-09-17T01:45:40.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.521+0000 7f137f200640 1 -- 172.21.15.42:0/677537886 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1380150990 con 0x7f13801f72e0 2024-09-17T01:45:40.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.521+0000 7f137f200640 1 -- 172.21.15.42:0/677537886 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1380150f50 con 0x7f13801f72e0 2024-09-17T01:45:40.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.522+0000 7f137f200640 1 -- 172.21.15.42:0/677537886 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1380153970 con 0x7f13801f72e0 2024-09-17T01:45:40.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.523+0000 7f1376000640 1 -- 172.21.15.42:0/677537886 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1378006030 con 0x7f13801f72e0 2024-09-17T01:45:40.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.524+0000 7f1376000640 1 --2- 172.21.15.42:0/677537886 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1360078bc0 0x7f136007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:40.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.525+0000 7f1376000640 1 -- 172.21.15.42:0/677537886 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5709+0+0 (secure 0 0 0) 0x7f13780ba8d0 con 0x7f13801f72e0 2024-09-17T01:45:40.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.525+0000 7f137de00640 1 --2- 172.21.15.42:0/677537886 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1360078bc0 0x7f136007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:40.524 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.526+0000 7f137de00640 1 --2- 172.21.15.42:0/677537886 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1360078bc0 0x7f136007b0d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f1370009c10 tx=0x7f1370005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:40.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.529+0000 7f1376000640 1 -- 172.21.15.42:0/677537886 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f138015dbf0 con 0x7f13801f72e0 2024-09-17T01:45:40.691 INFO:tasks.ceph.mds.a.smithi042.stderr:2024-09-17T01:45:40.692+0000 7f6911000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:45:40.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.724+0000 7f137f200640 1 -- 172.21.15.42:0/677537886 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1380150440 con 0x7f13801f72e0 2024-09-17T01:45:40.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.725+0000 7f1376000640 1 -- 172.21.15.42:0/677537886 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) ==== 74+0+16635 (secure 0 0 0) 0x7f13780826b0 con 0x7f13801f72e0 2024-09-17T01:45:40.725 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:45:40.725 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":174,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:45:37.747118+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:45:34.322650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-17T01:45:35.214870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:45:40.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.727+0000 7f137f200640 1 -- 172.21.15.42:0/677537886 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1360078bc0 msgr2=0x7f136007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:40.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.727+0000 7f137f200640 1 --2- 172.21.15.42:0/677537886 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1360078bc0 0x7f136007b0d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f1370009c10 tx=0x7f1370005f90 comp rx=0 tx=0).stop 2024-09-17T01:45:40.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.727+0000 7f137f200640 1 -- 172.21.15.42:0/677537886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13801f72e0 msgr2=0x7f13801f76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:40.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.727+0000 7f137f200640 1 --2- 172.21.15.42:0/677537886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13801f72e0 0x7f13801f76f0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f137802b600 tx=0x7f1378001290 comp rx=0 tx=0).stop 2024-09-17T01:45:40.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.727+0000 7f137f200640 1 -- 172.21.15.42:0/677537886 shutdown_connections 2024-09-17T01:45:40.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.727+0000 7f137f200640 1 --2- 172.21.15.42:0/677537886 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1360078bc0 0x7f136007b0d0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:40.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.727+0000 7f137f200640 1 --2- 172.21.15.42:0/677537886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13801f72e0 0x7f13801f76f0 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:40.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.727+0000 7f137f200640 1 --2- 172.21.15.42:0/677537886 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f138014ffa0 0x7f13801f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:40.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.727+0000 7f137f200640 1 --2- 172.21.15.42:0/677537886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1364005150 0x7f138014e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:40.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.727+0000 7f137f200640 1 -- 172.21.15.42:0/677537886 >> 172.21.15.42:0/677537886 conn(0x7f13800b25f0 msgr2=0x7f13800b1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:40.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.728+0000 7f137f200640 1 -- 172.21.15.42:0/677537886 shutdown_connections 2024-09-17T01:45:40.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.728+0000 7f137f200640 1 -- 172.21.15.42:0/677537886 wait complete. 2024-09-17T01:45:40.751 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T01:45:40.752 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:45:40.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.979+0000 7f64a2200640 1 -- 172.21.15.42:0/1657717565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f649c06d430 msgr2=0x7f649c152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:40.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.979+0000 7f64a2200640 1 --2- 172.21.15.42:0/1657717565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f649c06d430 0x7f649c152ed0 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7f6494005fd0 tx=0x7f649402a940 comp rx=0 tx=0).stop 2024-09-17T01:45:40.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.979+0000 7f64a2200640 1 -- 172.21.15.42:0/1657717565 shutdown_connections 2024-09-17T01:45:40.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.979+0000 7f64a2200640 1 --2- 172.21.15.42:0/1657717565 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f649c06d430 0x7f649c152ed0 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:40.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.979+0000 7f64a2200640 1 -- 172.21.15.42:0/1657717565 >> 172.21.15.42:0/1657717565 conn(0x7f649c0b25f0 msgr2=0x7f649c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:40.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.980+0000 7f64a2200640 1 -- 172.21.15.42:0/1657717565 shutdown_connections 2024-09-17T01:45:40.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.980+0000 7f64a2200640 1 -- 172.21.15.42:0/1657717565 wait complete. 2024-09-17T01:45:40.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.982+0000 7f64a2200640 1 Processor -- start 2024-09-17T01:45:40.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.982+0000 7f64a2200640 1 -- start start 2024-09-17T01:45:40.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.983+0000 7f64a2200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f649c0b4be0 0x7f649c072960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:40.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.983+0000 7f64a2200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f649c0cf7c0 0x7f649c0ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:40.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.983+0000 7f64a2200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f649c14dde0 0x7f649c09d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:40.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.983+0000 7f64a2200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f649c153590 con 0x7f649c14dde0 2024-09-17T01:45:40.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.983+0000 7f64a2200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f649c153410 con 0x7f649c0b4be0 2024-09-17T01:45:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.983+0000 7f64a2200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f649c153710 con 0x7f649c0cf7c0 2024-09-17T01:45:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.983+0000 7f64a1800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f649c14dde0 0x7f649c09d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.984+0000 7f64a1800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f649c14dde0 0x7f649c09d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49518/0 (socket says 172.21.15.42:49518) 2024-09-17T01:45:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.984+0000 7f64a1800640 1 -- 172.21.15.42:0/2645090896 learned_addr learned my addr 172.21.15.42:0/2645090896 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.984+0000 7f649be00640 1 --2- 172.21.15.42:0/2645090896 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f649c0cf7c0 0x7f649c0ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.984+0000 7f64a0e00640 1 --2- 172.21.15.42:0/2645090896 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f649c0b4be0 0x7f649c072960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.984+0000 7f64a1800640 1 -- 172.21.15.42:0/2645090896 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f649c0cf7c0 msgr2=0x7f649c0ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.984+0000 7f64a1800640 1 --2- 172.21.15.42:0/2645090896 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f649c0cf7c0 0x7f649c0ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.984+0000 7f64a1800640 1 -- 172.21.15.42:0/2645090896 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f649c0b4be0 msgr2=0x7f649c072960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.984+0000 7f64a1800640 1 --2- 172.21.15.42:0/2645090896 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f649c0b4be0 0x7f649c072960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:40.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.984+0000 7f64a1800640 1 -- 172.21.15.42:0/2645090896 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649c15ff80 con 0x7f649c14dde0 2024-09-17T01:45:40.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.984+0000 7f64a1800640 1 --2- 172.21.15.42:0/2645090896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f649c14dde0 0x7f649c09d920 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f649402af30 tx=0x7f6494031ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:40.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.985+0000 7f6498c00640 1 -- 172.21.15.42:0/2645090896 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649403e070 con 0x7f649c14dde0 2024-09-17T01:45:40.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.985+0000 7f6498c00640 1 -- 172.21.15.42:0/2645090896 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6494004600 con 0x7f649c14dde0 2024-09-17T01:45:40.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.985+0000 7f6498c00640 1 -- 172.21.15.42:0/2645090896 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6494043460 con 0x7f649c14dde0 2024-09-17T01:45:40.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.985+0000 7f64a2200640 1 -- 172.21.15.42:0/2645090896 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f649c0caca0 con 0x7f649c14dde0 2024-09-17T01:45:40.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.985+0000 7f64a2200640 1 -- 172.21.15.42:0/2645090896 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f649c14e6d0 con 0x7f649c14dde0 2024-09-17T01:45:40.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.986+0000 7f64a2200640 1 -- 172.21.15.42:0/2645090896 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f649c152ed0 con 0x7f649c14dde0 2024-09-17T01:45:40.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.987+0000 7f6498c00640 1 -- 172.21.15.42:0/2645090896 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6494043600 con 0x7f649c14dde0 2024-09-17T01:45:40.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.988+0000 7f6498c00640 1 --2- 172.21.15.42:0/2645090896 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f647c078b90 0x7f647c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:40.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.988+0000 7f6498c00640 1 -- 172.21.15.42:0/2645090896 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5709+0+0 (secure 0 0 0) 0x7f64940bc9f0 con 0x7f649c14dde0 2024-09-17T01:45:40.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.989+0000 7f64a0e00640 1 --2- 172.21.15.42:0/2645090896 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f647c078b90 0x7f647c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:40.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.989+0000 7f64a0e00640 1 --2- 172.21.15.42:0/2645090896 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f647c078b90 0x7f647c07b0a0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6490000f60 tx=0x7f6490009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:40.991 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:40.993+0000 7f6498c00640 1 -- 172.21.15.42:0/2645090896 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6494084e20 con 0x7f649c14dde0 2024-09-17T01:45:41.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.182+0000 7f64a2200640 1 -- 172.21.15.42:0/2645090896 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f649c0ae1f0 con 0x7f647c078b90 2024-09-17T01:45:41.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.188+0000 7f6498c00640 1 -- 172.21.15.42:0/2645090896 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239840 (secure 0 0 0) 0x7f649c0ae1f0 con 0x7f647c078b90 2024-09-17T01:45:41.190 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:45:41.191 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:45:41.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.192+0000 7f64a2200640 1 -- 172.21.15.42:0/2645090896 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f647c078b90 msgr2=0x7f647c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:41.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.192+0000 7f64a2200640 1 --2- 172.21.15.42:0/2645090896 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f647c078b90 0x7f647c07b0a0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6490000f60 tx=0x7f6490009040 comp rx=0 tx=0).stop 2024-09-17T01:45:41.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.192+0000 7f64a2200640 1 -- 172.21.15.42:0/2645090896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f649c14dde0 msgr2=0x7f649c09d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:41.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.192+0000 7f64a2200640 1 --2- 172.21.15.42:0/2645090896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f649c14dde0 0x7f649c09d920 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f649402af30 tx=0x7f6494031ea0 comp rx=0 tx=0).stop 2024-09-17T01:45:41.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.192+0000 7f64a2200640 1 -- 172.21.15.42:0/2645090896 shutdown_connections 2024-09-17T01:45:41.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.192+0000 7f64a2200640 1 --2- 172.21.15.42:0/2645090896 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f647c078b90 0x7f647c07b0a0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:41.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.192+0000 7f64a2200640 1 --2- 172.21.15.42:0/2645090896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f649c14dde0 0x7f649c09d920 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:41.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.192+0000 7f64a2200640 1 --2- 172.21.15.42:0/2645090896 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f649c0cf7c0 0x7f649c0ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:41.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.192+0000 7f64a2200640 1 --2- 172.21.15.42:0/2645090896 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f649c0b4be0 0x7f649c072960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:41.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.192+0000 7f64a2200640 1 -- 172.21.15.42:0/2645090896 >> 172.21.15.42:0/2645090896 conn(0x7f649c0b25f0 msgr2=0x7f649c1525a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:41.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.192+0000 7f64a2200640 1 -- 172.21.15.42:0/2645090896 shutdown_connections 2024-09-17T01:45:41.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.192+0000 7f64a2200640 1 -- 172.21.15.42:0/2645090896 wait complete. 2024-09-17T01:45:41.214 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":580,"stamp":"2024-09-17T01:45:39.213601+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":105,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":38,"acting":38,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":411776,"kb_used_data":17868,"kb_used_omap":12,"kb_used_meta":393715,"kb_avail":754562944,"statfs":{"total":773094113280,"available":772672454656,"internally_reserved":0,"allocated":18296832,"data_stored":8708524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":403164724},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.485833"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.283652+0000","last_change":"2024-09-17T01:45:36.768337+0000","last_active":"2024-09-17T01:45:38.283652+0000","last_peered":"2024-09-17T01:45:38.283652+0000","last_clean":"2024-09-17T01:45:38.283652+0000","last_became_active":"2024-09-17T01:45:36.765707+0000","last_became_peered":"2024-09-17T01:45:36.765707+0000","last_unstale":"2024-09-17T01:45:38.283652+0000","last_undegraded":"2024-09-17T01:45:38.283652+0000","last_fullsized":"2024-09-17T01:45:38.283652+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:21:28.464593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.283272+0000","last_change":"2024-09-17T01:45:36.760830+0000","last_active":"2024-09-17T01:45:38.283272+0000","last_peered":"2024-09-17T01:45:38.283272+0000","last_clean":"2024-09-17T01:45:38.283272+0000","last_became_active":"2024-09-17T01:45:36.760489+0000","last_became_peered":"2024-09-17T01:45:36.760489+0000","last_unstale":"2024-09-17T01:45:38.283272+0000","last_undegraded":"2024-09-17T01:45:38.283272+0000","last_fullsized":"2024-09-17T01:45:38.283272+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:21.258222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.283642+0000","last_change":"2024-09-17T01:45:36.766557+0000","last_active":"2024-09-17T01:45:38.283642+0000","last_peered":"2024-09-17T01:45:38.283642+0000","last_clean":"2024-09-17T01:45:38.283642+0000","last_became_active":"2024-09-17T01:45:36.765335+0000","last_became_peered":"2024-09-17T01:45:36.765335+0000","last_unstale":"2024-09-17T01:45:38.283642+0000","last_undegraded":"2024-09-17T01:45:38.283642+0000","last_fullsized":"2024-09-17T01:45:38.283642+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:02.433773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.283300+0000","last_change":"2024-09-17T01:45:36.774884+0000","last_active":"2024-09-17T01:45:38.283300+0000","last_peered":"2024-09-17T01:45:38.283300+0000","last_clean":"2024-09-17T01:45:38.283300+0000","last_became_active":"2024-09-17T01:45:36.774481+0000","last_became_peered":"2024-09-17T01:45:36.774481+0000","last_unstale":"2024-09-17T01:45:38.283300+0000","last_undegraded":"2024-09-17T01:45:38.283300+0000","last_fullsized":"2024-09-17T01:45:38.283300+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:43:18.464626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.283925+0000","last_change":"2024-09-17T01:45:36.766183+0000","last_active":"2024-09-17T01:45:38.283925+0000","last_peered":"2024-09-17T01:45:38.283925+0000","last_clean":"2024-09-17T01:45:38.283925+0000","last_became_active":"2024-09-17T01:45:36.764989+0000","last_became_peered":"2024-09-17T01:45:36.764989+0000","last_unstale":"2024-09-17T01:45:38.283925+0000","last_undegraded":"2024-09-17T01:45:38.283925+0000","last_fullsized":"2024-09-17T01:45:38.283925+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:37:15.034977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"173'4","reported_seq":19,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.283776+0000","last_change":"2024-09-17T01:45:35.757127+0000","last_active":"2024-09-17T01:45:38.283776+0000","last_peered":"2024-09-17T01:45:38.283776+0000","last_clean":"2024-09-17T01:45:38.283776+0000","last_became_active":"2024-09-17T01:45:35.756332+0000","last_became_peered":"2024-09-17T01:45:35.756332+0000","last_unstale":"2024-09-17T01:45:38.283776+0000","last_undegraded":"2024-09-17T01:45:38.283776+0000","last_fullsized":"2024-09-17T01:45:38.283776+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:22:40.835970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:34.718250+0000","last_change":"2024-09-17T01:45:34.718250+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.718250+0000","last_undegraded":"2024-09-17T01:45:34.718250+0000","last_fullsized":"2024-09-17T01:45:34.718250+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:34.718250+0000","last_change":"2024-09-17T01:45:34.718250+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.718250+0000","last_undegraded":"2024-09-17T01:45:34.718250+0000","last_fullsized":"2024-09-17T01:45:34.718250+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:34.718250+0000","last_change":"2024-09-17T01:45:34.718250+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.718250+0000","last_undegraded":"2024-09-17T01:45:34.718250+0000","last_fullsized":"2024-09-17T01:45:34.718250+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:34.718250+0000","last_change":"2024-09-17T01:45:34.718250+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.718250+0000","last_undegraded":"2024-09-17T01:45:34.718250+0000","last_fullsized":"2024-09-17T01:45:34.718250+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:34.718250+0000","last_change":"2024-09-17T01:45:34.718250+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.718250+0000","last_undegraded":"2024-09-17T01:45:34.718250+0000","last_fullsized":"2024-09-17T01:45:34.718250+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-17T01:45:34.732900+0000","last_change":"2024-09-17T01:45:34.732900+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.732900+0000","last_undegraded":"2024-09-17T01:45:34.732900+0000","last_fullsized":"2024-09-17T01:45:34.732900+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.283890+0000","last_change":"2024-09-17T01:45:36.762228+0000","last_active":"2024-09-17T01:45:38.283890+0000","last_peered":"2024-09-17T01:45:38.283890+0000","last_clean":"2024-09-17T01:45:38.283890+0000","last_became_active":"2024-09-17T01:45:36.761348+0000","last_became_peered":"2024-09-17T01:45:36.761348+0000","last_unstale":"2024-09-17T01:45:38.283890+0000","last_undegraded":"2024-09-17T01:45:38.283890+0000","last_fullsized":"2024-09-17T01:45:38.283890+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:00.173917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:34.718250+0000","last_change":"2024-09-17T01:45:34.718250+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.718250+0000","last_undegraded":"2024-09-17T01:45:34.718250+0000","last_fullsized":"2024-09-17T01:45:34.718250+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:34.718250+0000","last_change":"2024-09-17T01:45:34.718250+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.718250+0000","last_undegraded":"2024-09-17T01:45:34.718250+0000","last_fullsized":"2024-09-17T01:45:34.718250+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:34.718250+0000","last_change":"2024-09-17T01:45:34.718250+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.718250+0000","last_undegraded":"2024-09-17T01:45:34.718250+0000","last_fullsized":"2024-09-17T01:45:34.718250+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:34.718250+0000","last_change":"2024-09-17T01:45:34.718250+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.718250+0000","last_undegraded":"2024-09-17T01:45:34.718250+0000","last_fullsized":"2024-09-17T01:45:34.718250+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:34.718250+0000","last_change":"2024-09-17T01:45:34.718250+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.718250+0000","last_undegraded":"2024-09-17T01:45:34.718250+0000","last_fullsized":"2024-09-17T01:45:34.718250+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:34.718250+0000","last_change":"2024-09-17T01:45:34.718250+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.718250+0000","last_undegraded":"2024-09-17T01:45:34.718250+0000","last_fullsized":"2024-09-17T01:45:34.718250+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:34.718250+0000","last_change":"2024-09-17T01:45:34.718250+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.718250+0000","last_undegraded":"2024-09-17T01:45:34.718250+0000","last_fullsized":"2024-09-17T01:45:34.718250+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-17T01:45:34.732379+0000","last_change":"2024-09-17T01:45:34.732379+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.732379+0000","last_undegraded":"2024-09-17T01:45:34.732379+0000","last_fullsized":"2024-09-17T01:45:34.732379+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:34.718250+0000","last_change":"2024-09-17T01:45:34.718250+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.718250+0000","last_undegraded":"2024-09-17T01:45:34.718250+0000","last_fullsized":"2024-09-17T01:45:34.718250+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-17T01:45:34.736949+0000","last_change":"2024-09-17T01:45:34.736949+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.736949+0000","last_undegraded":"2024-09-17T01:45:34.736949+0000","last_fullsized":"2024-09-17T01:45:34.736949+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:34.718250+0000","last_change":"2024-09-17T01:45:34.718250+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.718250+0000","last_undegraded":"2024-09-17T01:45:34.718250+0000","last_fullsized":"2024-09-17T01:45:34.718250+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:34.718250+0000","last_change":"2024-09-17T01:45:34.718250+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.718250+0000","last_undegraded":"2024-09-17T01:45:34.718250+0000","last_fullsized":"2024-09-17T01:45:34.718250+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:34.718250+0000","last_change":"2024-09-17T01:45:34.718250+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.718250+0000","last_undegraded":"2024-09-17T01:45:34.718250+0000","last_fullsized":"2024-09-17T01:45:34.718250+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-17T01:45:34.736330+0000","last_change":"2024-09-17T01:45:34.736330+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.736330+0000","last_undegraded":"2024-09-17T01:45:34.736330+0000","last_fullsized":"2024-09-17T01:45:34.736330+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-17T01:45:34.736417+0000","last_change":"2024-09-17T01:45:34.736417+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.736417+0000","last_undegraded":"2024-09-17T01:45:34.736417+0000","last_fullsized":"2024-09-17T01:45:34.736417+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:34.718250+0000","last_change":"2024-09-17T01:45:34.718250+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.718250+0000","last_undegraded":"2024-09-17T01:45:34.718250+0000","last_fullsized":"2024-09-17T01:45:34.718250+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.283737+0000","last_change":"2024-09-17T01:45:36.761893+0000","last_active":"2024-09-17T01:45:38.283737+0000","last_peered":"2024-09-17T01:45:38.283737+0000","last_clean":"2024-09-17T01:45:38.283737+0000","last_became_active":"2024-09-17T01:45:36.760928+0000","last_became_peered":"2024-09-17T01:45:36.760928+0000","last_unstale":"2024-09-17T01:45:38.283737+0000","last_undegraded":"2024-09-17T01:45:38.283737+0000","last_fullsized":"2024-09-17T01:45:38.283737+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:08.551492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:34.718250+0000","last_change":"2024-09-17T01:45:34.718250+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.718250+0000","last_undegraded":"2024-09-17T01:45:34.718250+0000","last_fullsized":"2024-09-17T01:45:34.718250+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.283880+0000","last_change":"2024-09-17T01:45:36.767168+0000","last_active":"2024-09-17T01:45:38.283880+0000","last_peered":"2024-09-17T01:45:38.283880+0000","last_clean":"2024-09-17T01:45:38.283880+0000","last_became_active":"2024-09-17T01:45:36.763498+0000","last_became_peered":"2024-09-17T01:45:36.763498+0000","last_unstale":"2024-09-17T01:45:38.283880+0000","last_undegraded":"2024-09-17T01:45:38.283880+0000","last_fullsized":"2024-09-17T01:45:38.283880+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:55.626427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.283861+0000","last_change":"2024-09-17T01:45:35.749393+0000","last_active":"2024-09-17T01:45:38.283861+0000","last_peered":"2024-09-17T01:45:38.283861+0000","last_clean":"2024-09-17T01:45:38.283861+0000","last_became_active":"2024-09-17T01:45:35.748844+0000","last_became_peered":"2024-09-17T01:45:35.748844+0000","last_unstale":"2024-09-17T01:45:38.283861+0000","last_undegraded":"2024-09-17T01:45:38.283861+0000","last_fullsized":"2024-09-17T01:45:38.283861+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:39.668512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.283468+0000","last_change":"2024-09-17T01:45:36.756004+0000","last_active":"2024-09-17T01:45:38.283468+0000","last_peered":"2024-09-17T01:45:38.283468+0000","last_clean":"2024-09-17T01:45:38.283468+0000","last_became_active":"2024-09-17T01:45:36.755377+0000","last_became_peered":"2024-09-17T01:45:36.755377+0000","last_unstale":"2024-09-17T01:45:38.283468+0000","last_undegraded":"2024-09-17T01:45:38.283468+0000","last_fullsized":"2024-09-17T01:45:38.283468+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:47.605666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.283866+0000","last_change":"2024-09-17T01:45:35.751547+0000","last_active":"2024-09-17T01:45:38.283866+0000","last_peered":"2024-09-17T01:45:38.283866+0000","last_clean":"2024-09-17T01:45:38.283866+0000","last_became_active":"2024-09-17T01:45:35.750397+0000","last_became_peered":"2024-09-17T01:45:35.750397+0000","last_unstale":"2024-09-17T01:45:38.283866+0000","last_undegraded":"2024-09-17T01:45:38.283866+0000","last_fullsized":"2024-09-17T01:45:38.283866+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:36.702905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:34.718250+0000","last_change":"2024-09-17T01:45:34.718250+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.718250+0000","last_undegraded":"2024-09-17T01:45:34.718250+0000","last_fullsized":"2024-09-17T01:45:34.718250+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:34.718250+0000","last_change":"2024-09-17T01:45:34.718250+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.718250+0000","last_undegraded":"2024-09-17T01:45:34.718250+0000","last_fullsized":"2024-09-17T01:45:34.718250+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:34.718250+0000","last_change":"2024-09-17T01:45:34.718250+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.718250+0000","last_undegraded":"2024-09-17T01:45:34.718250+0000","last_fullsized":"2024-09-17T01:45:34.718250+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:34.718250+0000","last_change":"2024-09-17T01:45:34.718250+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.718250+0000","last_undegraded":"2024-09-17T01:45:34.718250+0000","last_fullsized":"2024-09-17T01:45:34.718250+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":1,"reported_epoch":171,"state":"creating+peering","last_fresh":"2024-09-17T01:45:34.736984+0000","last_change":"2024-09-17T01:45:34.736984+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.736984+0000","last_undegraded":"2024-09-17T01:45:34.736984+0000","last_fullsized":"2024-09-17T01:45:34.736984+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:35.726741+0000","last_change":"2024-09-17T01:45:35.726741+0000","last_active":"2024-09-17T01:45:35.726741+0000","last_peered":"2024-09-17T01:45:35.726741+0000","last_clean":"2024-09-17T01:45:35.726741+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:35.726741+0000","last_undegraded":"2024-09-17T01:45:35.726741+0000","last_fullsized":"2024-09-17T01:45:35.726741+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:45:34.718250+0000","last_change":"2024-09-17T01:45:34.718250+0000","last_active":"2024-09-17T01:45:34.718250+0000","last_peered":"2024-09-17T01:45:34.718250+0000","last_clean":"2024-09-17T01:45:34.718250+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:45:34.718250+0000","last_undegraded":"2024-09-17T01:45:34.718250+0000","last_fullsized":"2024-09-17T01:45:34.718250+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":393,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-17T01:45:33.069056+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:45:33.069056+0000","last_peered":"2024-09-17T01:45:33.069056+0000","last_clean":"2024-09-17T01:45:33.069056+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:45:33.069056+0000","last_undegraded":"2024-09-17T01:45:33.069056+0000","last_fullsized":"2024-09-17T01:45:33.069056+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":1},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":18,"acting":18,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47168,"kb_used_data":2092,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324672,"statfs":{"total":96636764160,"available":96588464128,"internally_reserved":0,"allocated":2142208,"data_stored":942842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509607,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55480,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316360,"statfs":{"total":96636764160,"available":96579952640,"internally_reserved":0,"allocated":2129920,"data_stored":937025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509606,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59636,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312204,"statfs":{"total":96636764160,"available":96575696896,"internally_reserved":0,"allocated":2129920,"data_stored":937025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509607,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51320,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320520,"statfs":{"total":96636764160,"available":96584212480,"internally_reserved":0,"allocated":2129920,"data_stored":937025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509607,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47160,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324680,"statfs":{"total":96636764160,"available":96588472320,"internally_reserved":0,"allocated":2129920,"data_stored":937025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509606,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47736,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324104,"statfs":{"total":96636764160,"available":96587882496,"internally_reserved":0,"allocated":2723840,"data_stored":1527393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509608,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55476,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316364,"statfs":{"total":96636764160,"available":96579956736,"internally_reserved":0,"allocated":2129920,"data_stored":937025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":54655433},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542313,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47800,"kb_used_data":2716,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324040,"statfs":{"total":96636764160,"available":96587816960,"internally_reserved":0,"allocated":2781184,"data_stored":1553164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:45:41.218 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:45:41.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.483+0000 7effd7e00640 1 -- 172.21.15.42:0/2541085750 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effbc004d40 msgr2=0x7effbc005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:41.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.484+0000 7effd7e00640 1 --2- 172.21.15.42:0/2541085750 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effbc004d40 0x7effbc005150 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7effd0005fd0 tx=0x7effbc005830 comp rx=0 tx=0).stop 2024-09-17T01:45:41.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.484+0000 7effd7400640 1 -- 172.21.15.42:0/2541085750 reap_dead start 2024-09-17T01:45:41.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.484+0000 7effd7e00640 1 -- 172.21.15.42:0/2541085750 shutdown_connections 2024-09-17T01:45:41.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.484+0000 7effd7e00640 1 -- 172.21.15.42:0/2541085750 >> 172.21.15.42:0/2541085750 conn(0x7effd8073510 msgr2=0x7effd80b6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:41.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.484+0000 7effd7e00640 1 -- 172.21.15.42:0/2541085750 shutdown_connections 2024-09-17T01:45:41.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.484+0000 7effd7e00640 1 -- 172.21.15.42:0/2541085750 wait complete. 2024-09-17T01:45:41.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.486+0000 7effd7e00640 1 Processor -- start 2024-09-17T01:45:41.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.486+0000 7effd7e00640 1 -- start start 2024-09-17T01:45:41.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.488+0000 7effd7e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effbc004d40 0x7effd8154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:41.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.488+0000 7effd7e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7effd8150820 0x7effd81e6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:41.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.488+0000 7effd7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effd8151780 0x7effd80af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:41.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.488+0000 7effd7e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7effd80b1900 con 0x7effd8151780 2024-09-17T01:45:41.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.488+0000 7effd7e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7effd80b1780 con 0x7effbc004d40 2024-09-17T01:45:41.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.488+0000 7effd7e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7effd80b1a80 con 0x7effd8150820 2024-09-17T01:45:41.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.488+0000 7effd7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effd8151780 0x7effd80af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:41.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.488+0000 7effd6a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effbc004d40 0x7effd8154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:41.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.488+0000 7effd7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effd8151780 0x7effd80af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49528/0 (socket says 172.21.15.42:49528) 2024-09-17T01:45:41.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.488+0000 7effd7400640 1 -- 172.21.15.42:0/3312062132 learned_addr learned my addr 172.21.15.42:0/3312062132 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:41.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.488+0000 7effcfe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7effd8150820 0x7effd81e6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:41.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.488+0000 7effd7400640 1 -- 172.21.15.42:0/3312062132 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7effd8150820 msgr2=0x7effd81e6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:41.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.488+0000 7effd7400640 1 --2- 172.21.15.42:0/3312062132 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7effd8150820 0x7effd81e6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:41.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.488+0000 7effd7400640 1 -- 172.21.15.42:0/3312062132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effbc004d40 msgr2=0x7effd8154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:41.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.488+0000 7effd7400640 1 --2- 172.21.15.42:0/3312062132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effbc004d40 0x7effd8154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:41.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.488+0000 7effd7400640 1 -- 172.21.15.42:0/3312062132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd80ae730 con 0x7effd8151780 2024-09-17T01:45:41.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.489+0000 7effd7400640 1 --2- 172.21.15.42:0/3312062132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effd8151780 0x7effd80af710 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7effd002aea0 tx=0x7effd0033c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:41.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.489+0000 7effcea00640 1 -- 172.21.15.42:0/3312062132 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd0042070 con 0x7effd8151780 2024-09-17T01:45:41.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.489+0000 7effcea00640 1 -- 172.21.15.42:0/3312062132 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7effd0003970 con 0x7effd8151780 2024-09-17T01:45:41.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.489+0000 7effcea00640 1 -- 172.21.15.42:0/3312062132 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd0038040 con 0x7effd8151780 2024-09-17T01:45:41.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.489+0000 7effd7e00640 1 -- 172.21.15.42:0/3312062132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effd8150520 con 0x7effd8151780 2024-09-17T01:45:41.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.489+0000 7effd7e00640 1 -- 172.21.15.42:0/3312062132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effd80aec30 con 0x7effd8151780 2024-09-17T01:45:41.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.490+0000 7effd7e00640 1 -- 172.21.15.42:0/3312062132 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effd815c6d0 con 0x7effd8151780 2024-09-17T01:45:41.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.492+0000 7effcea00640 1 -- 172.21.15.42:0/3312062132 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7effd0004030 con 0x7effd8151780 2024-09-17T01:45:41.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.493+0000 7effcea00640 1 --2- 172.21.15.42:0/3312062132 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7effb4078b90 0x7effb407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:41.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.493+0000 7effcea00640 1 -- 172.21.15.42:0/3312062132 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5709+0+0 (secure 0 0 0) 0x7effd00bb0c0 con 0x7effd8151780 2024-09-17T01:45:41.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.493+0000 7effd6a00640 1 --2- 172.21.15.42:0/3312062132 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7effb4078b90 0x7effb407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:41.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.494+0000 7effd6a00640 1 --2- 172.21.15.42:0/3312062132 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7effb4078b90 0x7effb407b0a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7effc8001160 tx=0x7effc8006040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:41.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.497+0000 7effcea00640 1 -- 172.21.15.42:0/3312062132 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7effd0082eb0 con 0x7effd8151780 2024-09-17T01:45:41.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.687+0000 7effd7e00640 1 -- 172.21.15.42:0/3312062132 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7effd81502d0 con 0x7effb4078b90 2024-09-17T01:45:41.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.693+0000 7effcea00640 1 -- 172.21.15.42:0/3312062132 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252472 (secure 0 0 0) 0x7effd81502d0 con 0x7effb4078b90 2024-09-17T01:45:41.694 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:45:41.695 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:45:41.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.696+0000 7effd7e00640 1 -- 172.21.15.42:0/3312062132 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7effb4078b90 msgr2=0x7effb407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:41.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.696+0000 7effd7e00640 1 --2- 172.21.15.42:0/3312062132 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7effb4078b90 0x7effb407b0a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7effc8001160 tx=0x7effc8006040 comp rx=0 tx=0).stop 2024-09-17T01:45:41.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.696+0000 7effd7e00640 1 -- 172.21.15.42:0/3312062132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effd8151780 msgr2=0x7effd80af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:41.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.696+0000 7effd7e00640 1 --2- 172.21.15.42:0/3312062132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effd8151780 0x7effd80af710 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7effd002aea0 tx=0x7effd0033c10 comp rx=0 tx=0).stop 2024-09-17T01:45:41.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.696+0000 7effd7e00640 1 -- 172.21.15.42:0/3312062132 shutdown_connections 2024-09-17T01:45:41.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.696+0000 7effd7e00640 1 --2- 172.21.15.42:0/3312062132 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7effb4078b90 0x7effb407b0a0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:41.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.696+0000 7effd7e00640 1 --2- 172.21.15.42:0/3312062132 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effd8151780 0x7effd80af710 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:41.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.696+0000 7effd7e00640 1 --2- 172.21.15.42:0/3312062132 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7effd8150820 0x7effd81e6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:41.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.696+0000 7effd7e00640 1 --2- 172.21.15.42:0/3312062132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effbc004d40 0x7effd8154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:41.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.696+0000 7effd7e00640 1 -- 172.21.15.42:0/3312062132 >> 172.21.15.42:0/3312062132 conn(0x7effd8073510 msgr2=0x7effd815a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:41.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.696+0000 7effd7e00640 1 -- 172.21.15.42:0/3312062132 shutdown_connections 2024-09-17T01:45:41.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.696+0000 7effd7e00640 1 -- 172.21.15.42:0/3312062132 wait complete. 2024-09-17T01:45:41.722 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":581,"stamp":"2024-09-17T01:45:41.214120+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":416328,"kb_used_data":18248,"kb_used_omap":12,"kb_used_meta":397875,"kb_avail":754558392,"statfs":{"total":773094113280,"available":772667793408,"internally_reserved":0,"allocated":18685952,"data_stored":8883092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":407424564},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001505"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.970615+0000","last_change":"2024-09-17T01:45:36.752837+0000","last_active":"2024-09-17T01:45:38.970615+0000","last_peered":"2024-09-17T01:45:38.970615+0000","last_clean":"2024-09-17T01:45:38.970615+0000","last_became_active":"2024-09-17T01:45:36.751874+0000","last_became_peered":"2024-09-17T01:45:36.751874+0000","last_unstale":"2024-09-17T01:45:38.970615+0000","last_undegraded":"2024-09-17T01:45:38.970615+0000","last_fullsized":"2024-09-17T01:45:38.970615+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:10.455927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.756125+0000","last_change":"2024-09-17T01:45:36.765077+0000","last_active":"2024-09-17T01:45:37.756125+0000","last_peered":"2024-09-17T01:45:37.756125+0000","last_clean":"2024-09-17T01:45:37.756125+0000","last_became_active":"2024-09-17T01:45:36.764675+0000","last_became_peered":"2024-09-17T01:45:36.764675+0000","last_unstale":"2024-09-17T01:45:37.756125+0000","last_undegraded":"2024-09-17T01:45:37.756125+0000","last_fullsized":"2024-09-17T01:45:37.756125+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:39.771605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.283652+0000","last_change":"2024-09-17T01:45:36.768337+0000","last_active":"2024-09-17T01:45:38.283652+0000","last_peered":"2024-09-17T01:45:38.283652+0000","last_clean":"2024-09-17T01:45:38.283652+0000","last_became_active":"2024-09-17T01:45:36.765707+0000","last_became_peered":"2024-09-17T01:45:36.765707+0000","last_unstale":"2024-09-17T01:45:38.283652+0000","last_undegraded":"2024-09-17T01:45:38.283652+0000","last_fullsized":"2024-09-17T01:45:38.283652+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:21:28.464593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.755714+0000","last_change":"2024-09-17T01:45:36.753926+0000","last_active":"2024-09-17T01:45:37.755714+0000","last_peered":"2024-09-17T01:45:37.755714+0000","last_clean":"2024-09-17T01:45:37.755714+0000","last_became_active":"2024-09-17T01:45:36.753585+0000","last_became_peered":"2024-09-17T01:45:36.753585+0000","last_unstale":"2024-09-17T01:45:37.755714+0000","last_undegraded":"2024-09-17T01:45:37.755714+0000","last_fullsized":"2024-09-17T01:45:37.755714+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:54.104253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.420997+0000","last_change":"2024-09-17T01:45:36.774093+0000","last_active":"2024-09-17T01:45:38.420997+0000","last_peered":"2024-09-17T01:45:38.420997+0000","last_clean":"2024-09-17T01:45:38.420997+0000","last_became_active":"2024-09-17T01:45:36.773727+0000","last_became_peered":"2024-09-17T01:45:36.773727+0000","last_unstale":"2024-09-17T01:45:38.420997+0000","last_undegraded":"2024-09-17T01:45:38.420997+0000","last_fullsized":"2024-09-17T01:45:38.420997+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:29.726279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.756849+0000","last_change":"2024-09-17T01:45:36.758191+0000","last_active":"2024-09-17T01:45:37.756849+0000","last_peered":"2024-09-17T01:45:37.756849+0000","last_clean":"2024-09-17T01:45:37.756849+0000","last_became_active":"2024-09-17T01:45:36.757869+0000","last_became_peered":"2024-09-17T01:45:36.757869+0000","last_unstale":"2024-09-17T01:45:37.756849+0000","last_undegraded":"2024-09-17T01:45:37.756849+0000","last_fullsized":"2024-09-17T01:45:37.756849+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:47.122190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:39.000069+0000","last_change":"2024-09-17T01:45:36.770860+0000","last_active":"2024-09-17T01:45:39.000069+0000","last_peered":"2024-09-17T01:45:39.000069+0000","last_clean":"2024-09-17T01:45:39.000069+0000","last_became_active":"2024-09-17T01:45:36.770556+0000","last_became_peered":"2024-09-17T01:45:36.770556+0000","last_unstale":"2024-09-17T01:45:39.000069+0000","last_undegraded":"2024-09-17T01:45:39.000069+0000","last_fullsized":"2024-09-17T01:45:39.000069+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:21:28.847793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.420690+0000","last_change":"2024-09-17T01:45:36.772988+0000","last_active":"2024-09-17T01:45:38.420690+0000","last_peered":"2024-09-17T01:45:38.420690+0000","last_clean":"2024-09-17T01:45:38.420690+0000","last_became_active":"2024-09-17T01:45:36.769710+0000","last_became_peered":"2024-09-17T01:45:36.769710+0000","last_unstale":"2024-09-17T01:45:38.420690+0000","last_undegraded":"2024-09-17T01:45:38.420690+0000","last_fullsized":"2024-09-17T01:45:38.420690+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:46.988620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.756411+0000","last_change":"2024-09-17T01:45:36.772211+0000","last_active":"2024-09-17T01:45:37.756411+0000","last_peered":"2024-09-17T01:45:37.756411+0000","last_clean":"2024-09-17T01:45:37.756411+0000","last_became_active":"2024-09-17T01:45:36.771906+0000","last_became_peered":"2024-09-17T01:45:36.771906+0000","last_unstale":"2024-09-17T01:45:37.756411+0000","last_undegraded":"2024-09-17T01:45:37.756411+0000","last_fullsized":"2024-09-17T01:45:37.756411+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:29:45.762801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.097312+0000","last_change":"2024-09-17T01:45:36.767953+0000","last_active":"2024-09-17T01:45:38.097312+0000","last_peered":"2024-09-17T01:45:38.097312+0000","last_clean":"2024-09-17T01:45:38.097312+0000","last_became_active":"2024-09-17T01:45:36.767614+0000","last_became_peered":"2024-09-17T01:45:36.767614+0000","last_unstale":"2024-09-17T01:45:38.097312+0000","last_undegraded":"2024-09-17T01:45:38.097312+0000","last_fullsized":"2024-09-17T01:45:38.097312+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:28.005970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.970212+0000","last_change":"2024-09-17T01:45:36.750412+0000","last_active":"2024-09-17T01:45:38.970212+0000","last_peered":"2024-09-17T01:45:38.970212+0000","last_clean":"2024-09-17T01:45:38.970212+0000","last_became_active":"2024-09-17T01:45:36.750098+0000","last_became_peered":"2024-09-17T01:45:36.750098+0000","last_unstale":"2024-09-17T01:45:38.970212+0000","last_undegraded":"2024-09-17T01:45:38.970212+0000","last_fullsized":"2024-09-17T01:45:38.970212+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:16.488550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.757433+0000","last_change":"2024-09-17T01:45:36.770045+0000","last_active":"2024-09-17T01:45:37.757433+0000","last_peered":"2024-09-17T01:45:37.757433+0000","last_clean":"2024-09-17T01:45:37.757433+0000","last_became_active":"2024-09-17T01:45:36.769650+0000","last_became_peered":"2024-09-17T01:45:36.769650+0000","last_unstale":"2024-09-17T01:45:37.757433+0000","last_undegraded":"2024-09-17T01:45:37.757433+0000","last_fullsized":"2024-09-17T01:45:37.757433+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:15.504769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.970256+0000","last_change":"2024-09-17T01:45:36.751933+0000","last_active":"2024-09-17T01:45:38.970256+0000","last_peered":"2024-09-17T01:45:38.970256+0000","last_clean":"2024-09-17T01:45:38.970256+0000","last_became_active":"2024-09-17T01:45:36.751611+0000","last_became_peered":"2024-09-17T01:45:36.751611+0000","last_unstale":"2024-09-17T01:45:38.970256+0000","last_undegraded":"2024-09-17T01:45:38.970256+0000","last_fullsized":"2024-09-17T01:45:38.970256+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:56.986738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.755264+0000","last_change":"2024-09-17T01:45:36.759929+0000","last_active":"2024-09-17T01:45:37.755264+0000","last_peered":"2024-09-17T01:45:37.755264+0000","last_clean":"2024-09-17T01:45:37.755264+0000","last_became_active":"2024-09-17T01:45:36.759223+0000","last_became_peered":"2024-09-17T01:45:36.759223+0000","last_unstale":"2024-09-17T01:45:37.755264+0000","last_undegraded":"2024-09-17T01:45:37.755264+0000","last_fullsized":"2024-09-17T01:45:37.755264+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:52.916092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.970265+0000","last_change":"2024-09-17T01:45:36.750301+0000","last_active":"2024-09-17T01:45:38.970265+0000","last_peered":"2024-09-17T01:45:38.970265+0000","last_clean":"2024-09-17T01:45:38.970265+0000","last_became_active":"2024-09-17T01:45:36.749918+0000","last_became_peered":"2024-09-17T01:45:36.749918+0000","last_unstale":"2024-09-17T01:45:38.970265+0000","last_undegraded":"2024-09-17T01:45:38.970265+0000","last_fullsized":"2024-09-17T01:45:38.970265+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:18:50.763002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.283272+0000","last_change":"2024-09-17T01:45:36.760830+0000","last_active":"2024-09-17T01:45:38.283272+0000","last_peered":"2024-09-17T01:45:38.283272+0000","last_clean":"2024-09-17T01:45:38.283272+0000","last_became_active":"2024-09-17T01:45:36.760489+0000","last_became_peered":"2024-09-17T01:45:36.760489+0000","last_unstale":"2024-09-17T01:45:38.283272+0000","last_undegraded":"2024-09-17T01:45:38.283272+0000","last_fullsized":"2024-09-17T01:45:38.283272+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:21.258222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.757468+0000","last_change":"2024-09-17T01:45:36.750933+0000","last_active":"2024-09-17T01:45:37.757468+0000","last_peered":"2024-09-17T01:45:37.757468+0000","last_clean":"2024-09-17T01:45:37.757468+0000","last_became_active":"2024-09-17T01:45:36.748645+0000","last_became_peered":"2024-09-17T01:45:36.748645+0000","last_unstale":"2024-09-17T01:45:37.757468+0000","last_undegraded":"2024-09-17T01:45:37.757468+0000","last_fullsized":"2024-09-17T01:45:37.757468+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:14.991991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:39.000342+0000","last_change":"2024-09-17T01:45:36.759592+0000","last_active":"2024-09-17T01:45:39.000342+0000","last_peered":"2024-09-17T01:45:39.000342+0000","last_clean":"2024-09-17T01:45:39.000342+0000","last_became_active":"2024-09-17T01:45:36.759134+0000","last_became_peered":"2024-09-17T01:45:36.759134+0000","last_unstale":"2024-09-17T01:45:39.000342+0000","last_undegraded":"2024-09-17T01:45:39.000342+0000","last_fullsized":"2024-09-17T01:45:39.000342+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:37.816905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.283642+0000","last_change":"2024-09-17T01:45:36.766557+0000","last_active":"2024-09-17T01:45:38.283642+0000","last_peered":"2024-09-17T01:45:38.283642+0000","last_clean":"2024-09-17T01:45:38.283642+0000","last_became_active":"2024-09-17T01:45:36.765335+0000","last_became_peered":"2024-09-17T01:45:36.765335+0000","last_unstale":"2024-09-17T01:45:38.283642+0000","last_undegraded":"2024-09-17T01:45:38.283642+0000","last_fullsized":"2024-09-17T01:45:38.283642+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:02.433773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.421377+0000","last_change":"2024-09-17T01:45:36.771802+0000","last_active":"2024-09-17T01:45:38.421377+0000","last_peered":"2024-09-17T01:45:38.421377+0000","last_clean":"2024-09-17T01:45:38.421377+0000","last_became_active":"2024-09-17T01:45:36.771455+0000","last_became_peered":"2024-09-17T01:45:36.771455+0000","last_unstale":"2024-09-17T01:45:38.421377+0000","last_undegraded":"2024-09-17T01:45:38.421377+0000","last_fullsized":"2024-09-17T01:45:38.421377+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:10.117726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.283300+0000","last_change":"2024-09-17T01:45:36.774884+0000","last_active":"2024-09-17T01:45:38.283300+0000","last_peered":"2024-09-17T01:45:38.283300+0000","last_clean":"2024-09-17T01:45:38.283300+0000","last_became_active":"2024-09-17T01:45:36.774481+0000","last_became_peered":"2024-09-17T01:45:36.774481+0000","last_unstale":"2024-09-17T01:45:38.283300+0000","last_undegraded":"2024-09-17T01:45:38.283300+0000","last_fullsized":"2024-09-17T01:45:38.283300+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:43:18.464626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.421189+0000","last_change":"2024-09-17T01:45:36.771106+0000","last_active":"2024-09-17T01:45:38.421189+0000","last_peered":"2024-09-17T01:45:38.421189+0000","last_clean":"2024-09-17T01:45:38.421189+0000","last_became_active":"2024-09-17T01:45:36.770717+0000","last_became_peered":"2024-09-17T01:45:36.770717+0000","last_unstale":"2024-09-17T01:45:38.421189+0000","last_undegraded":"2024-09-17T01:45:38.421189+0000","last_fullsized":"2024-09-17T01:45:38.421189+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:36.618665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.097531+0000","last_change":"2024-09-17T01:45:36.770556+0000","last_active":"2024-09-17T01:45:38.097531+0000","last_peered":"2024-09-17T01:45:38.097531+0000","last_clean":"2024-09-17T01:45:38.097531+0000","last_became_active":"2024-09-17T01:45:36.770197+0000","last_became_peered":"2024-09-17T01:45:36.770197+0000","last_unstale":"2024-09-17T01:45:38.097531+0000","last_undegraded":"2024-09-17T01:45:38.097531+0000","last_fullsized":"2024-09-17T01:45:38.097531+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:19.926500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.420931+0000","last_change":"2024-09-17T01:45:36.781045+0000","last_active":"2024-09-17T01:45:38.420931+0000","last_peered":"2024-09-17T01:45:38.420931+0000","last_clean":"2024-09-17T01:45:38.420931+0000","last_became_active":"2024-09-17T01:45:36.779039+0000","last_became_peered":"2024-09-17T01:45:36.779039+0000","last_unstale":"2024-09-17T01:45:38.420931+0000","last_undegraded":"2024-09-17T01:45:38.420931+0000","last_fullsized":"2024-09-17T01:45:38.420931+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:02.540500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.756707+0000","last_change":"2024-09-17T01:45:36.772765+0000","last_active":"2024-09-17T01:45:37.756707+0000","last_peered":"2024-09-17T01:45:37.756707+0000","last_clean":"2024-09-17T01:45:37.756707+0000","last_became_active":"2024-09-17T01:45:36.769757+0000","last_became_peered":"2024-09-17T01:45:36.769757+0000","last_unstale":"2024-09-17T01:45:37.756707+0000","last_undegraded":"2024-09-17T01:45:37.756707+0000","last_fullsized":"2024-09-17T01:45:37.756707+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:10.564161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.757469+0000","last_change":"2024-09-17T01:45:36.771179+0000","last_active":"2024-09-17T01:45:37.757469+0000","last_peered":"2024-09-17T01:45:37.757469+0000","last_clean":"2024-09-17T01:45:37.757469+0000","last_became_active":"2024-09-17T01:45:36.768917+0000","last_became_peered":"2024-09-17T01:45:36.768917+0000","last_unstale":"2024-09-17T01:45:37.757469+0000","last_undegraded":"2024-09-17T01:45:37.757469+0000","last_fullsized":"2024-09-17T01:45:37.757469+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:32.441530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.283925+0000","last_change":"2024-09-17T01:45:36.766183+0000","last_active":"2024-09-17T01:45:38.283925+0000","last_peered":"2024-09-17T01:45:38.283925+0000","last_clean":"2024-09-17T01:45:38.283925+0000","last_became_active":"2024-09-17T01:45:36.764989+0000","last_became_peered":"2024-09-17T01:45:36.764989+0000","last_unstale":"2024-09-17T01:45:38.283925+0000","last_undegraded":"2024-09-17T01:45:38.283925+0000","last_fullsized":"2024-09-17T01:45:38.283925+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:37:15.034977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.097717+0000","last_change":"2024-09-17T01:45:36.747009+0000","last_active":"2024-09-17T01:45:38.097717+0000","last_peered":"2024-09-17T01:45:38.097717+0000","last_clean":"2024-09-17T01:45:38.097717+0000","last_became_active":"2024-09-17T01:45:36.746598+0000","last_became_peered":"2024-09-17T01:45:36.746598+0000","last_unstale":"2024-09-17T01:45:38.097717+0000","last_undegraded":"2024-09-17T01:45:38.097717+0000","last_fullsized":"2024-09-17T01:45:38.097717+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:23.438952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.757799+0000","last_change":"2024-09-17T01:45:36.770337+0000","last_active":"2024-09-17T01:45:37.757799+0000","last_peered":"2024-09-17T01:45:37.757799+0000","last_clean":"2024-09-17T01:45:37.757799+0000","last_became_active":"2024-09-17T01:45:36.768984+0000","last_became_peered":"2024-09-17T01:45:36.768984+0000","last_unstale":"2024-09-17T01:45:37.757799+0000","last_undegraded":"2024-09-17T01:45:37.757799+0000","last_fullsized":"2024-09-17T01:45:37.757799+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:08.645156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.756970+0000","last_change":"2024-09-17T01:45:36.768304+0000","last_active":"2024-09-17T01:45:37.756970+0000","last_peered":"2024-09-17T01:45:37.756970+0000","last_clean":"2024-09-17T01:45:37.756970+0000","last_became_active":"2024-09-17T01:45:36.767983+0000","last_became_peered":"2024-09-17T01:45:36.767983+0000","last_unstale":"2024-09-17T01:45:37.756970+0000","last_undegraded":"2024-09-17T01:45:37.756970+0000","last_fullsized":"2024-09-17T01:45:37.756970+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:00.708124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.421333+0000","last_change":"2024-09-17T01:45:36.778251+0000","last_active":"2024-09-17T01:45:38.421333+0000","last_peered":"2024-09-17T01:45:38.421333+0000","last_clean":"2024-09-17T01:45:38.421333+0000","last_became_active":"2024-09-17T01:45:36.777870+0000","last_became_peered":"2024-09-17T01:45:36.777870+0000","last_unstale":"2024-09-17T01:45:38.421333+0000","last_undegraded":"2024-09-17T01:45:38.421333+0000","last_fullsized":"2024-09-17T01:45:38.421333+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:12.762752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.421533+0000","last_change":"2024-09-17T01:45:36.768729+0000","last_active":"2024-09-17T01:45:38.421533+0000","last_peered":"2024-09-17T01:45:38.421533+0000","last_clean":"2024-09-17T01:45:38.421533+0000","last_became_active":"2024-09-17T01:45:36.768363+0000","last_became_peered":"2024-09-17T01:45:36.768363+0000","last_unstale":"2024-09-17T01:45:38.421533+0000","last_undegraded":"2024-09-17T01:45:38.421533+0000","last_fullsized":"2024-09-17T01:45:38.421533+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:43:35.534140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.421412+0000","last_change":"2024-09-17T01:45:36.777953+0000","last_active":"2024-09-17T01:45:38.421412+0000","last_peered":"2024-09-17T01:45:38.421412+0000","last_clean":"2024-09-17T01:45:38.421412+0000","last_became_active":"2024-09-17T01:45:36.774195+0000","last_became_peered":"2024-09-17T01:45:36.774195+0000","last_unstale":"2024-09-17T01:45:38.421412+0000","last_undegraded":"2024-09-17T01:45:38.421412+0000","last_fullsized":"2024-09-17T01:45:38.421412+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:10.552778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"173'4","reported_seq":19,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.283776+0000","last_change":"2024-09-17T01:45:35.757127+0000","last_active":"2024-09-17T01:45:38.283776+0000","last_peered":"2024-09-17T01:45:38.283776+0000","last_clean":"2024-09-17T01:45:38.283776+0000","last_became_active":"2024-09-17T01:45:35.756332+0000","last_became_peered":"2024-09-17T01:45:35.756332+0000","last_unstale":"2024-09-17T01:45:38.283776+0000","last_undegraded":"2024-09-17T01:45:38.283776+0000","last_fullsized":"2024-09-17T01:45:38.283776+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:22:40.835970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.097455+0000","last_change":"2024-09-17T01:45:36.761824+0000","last_active":"2024-09-17T01:45:38.097455+0000","last_peered":"2024-09-17T01:45:38.097455+0000","last_clean":"2024-09-17T01:45:38.097455+0000","last_became_active":"2024-09-17T01:45:36.761409+0000","last_became_peered":"2024-09-17T01:45:36.761409+0000","last_unstale":"2024-09-17T01:45:38.097455+0000","last_undegraded":"2024-09-17T01:45:38.097455+0000","last_fullsized":"2024-09-17T01:45:38.097455+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:45.535535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1e","version":"173'1","reported_seq":16,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.757972+0000","last_change":"2024-09-17T01:45:35.757259+0000","last_active":"2024-09-17T01:45:37.757972+0000","last_peered":"2024-09-17T01:45:37.757972+0000","last_clean":"2024-09-17T01:45:37.757972+0000","last_became_active":"2024-09-17T01:45:35.755230+0000","last_became_peered":"2024-09-17T01:45:35.755230+0000","last_unstale":"2024-09-17T01:45:37.757972+0000","last_undegraded":"2024-09-17T01:45:37.757972+0000","last_fullsized":"2024-09-17T01:45:37.757972+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:03.843127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.755814+0000","last_change":"2024-09-17T01:45:36.769266+0000","last_active":"2024-09-17T01:45:37.755814+0000","last_peered":"2024-09-17T01:45:37.755814+0000","last_clean":"2024-09-17T01:45:37.755814+0000","last_became_active":"2024-09-17T01:45:36.768965+0000","last_became_peered":"2024-09-17T01:45:36.768965+0000","last_unstale":"2024-09-17T01:45:37.755814+0000","last_undegraded":"2024-09-17T01:45:37.755814+0000","last_fullsized":"2024-09-17T01:45:37.755814+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:51.542253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"173'2","reported_seq":17,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.421217+0000","last_change":"2024-09-17T01:45:35.766634+0000","last_active":"2024-09-17T01:45:38.421217+0000","last_peered":"2024-09-17T01:45:38.421217+0000","last_clean":"2024-09-17T01:45:38.421217+0000","last_became_active":"2024-09-17T01:45:35.766206+0000","last_became_peered":"2024-09-17T01:45:35.766206+0000","last_unstale":"2024-09-17T01:45:38.421217+0000","last_undegraded":"2024-09-17T01:45:38.421217+0000","last_fullsized":"2024-09-17T01:45:38.421217+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:21:08.109597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.755919+0000","last_change":"2024-09-17T01:45:36.750553+0000","last_active":"2024-09-17T01:45:37.755919+0000","last_peered":"2024-09-17T01:45:37.755919+0000","last_clean":"2024-09-17T01:45:37.755919+0000","last_became_active":"2024-09-17T01:45:36.749401+0000","last_became_peered":"2024-09-17T01:45:36.749401+0000","last_unstale":"2024-09-17T01:45:37.755919+0000","last_undegraded":"2024-09-17T01:45:37.755919+0000","last_fullsized":"2024-09-17T01:45:37.755919+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:10.828870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1c","version":"173'2","reported_seq":17,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.757574+0000","last_change":"2024-09-17T01:45:35.755648+0000","last_active":"2024-09-17T01:45:37.757574+0000","last_peered":"2024-09-17T01:45:37.757574+0000","last_clean":"2024-09-17T01:45:37.757574+0000","last_became_active":"2024-09-17T01:45:35.755199+0000","last_became_peered":"2024-09-17T01:45:35.755199+0000","last_unstale":"2024-09-17T01:45:37.757574+0000","last_undegraded":"2024-09-17T01:45:37.757574+0000","last_fullsized":"2024-09-17T01:45:37.757574+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:00.623405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.757028+0000","last_change":"2024-09-17T01:45:36.754595+0000","last_active":"2024-09-17T01:45:37.757028+0000","last_peered":"2024-09-17T01:45:37.757028+0000","last_clean":"2024-09-17T01:45:37.757028+0000","last_became_active":"2024-09-17T01:45:36.754197+0000","last_became_peered":"2024-09-17T01:45:36.754197+0000","last_unstale":"2024-09-17T01:45:37.757028+0000","last_undegraded":"2024-09-17T01:45:37.757028+0000","last_fullsized":"2024-09-17T01:45:37.757028+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:56.930964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"173'1","reported_seq":16,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.421544+0000","last_change":"2024-09-17T01:45:35.764622+0000","last_active":"2024-09-17T01:45:38.421544+0000","last_peered":"2024-09-17T01:45:38.421544+0000","last_clean":"2024-09-17T01:45:38.421544+0000","last_became_active":"2024-09-17T01:45:35.763406+0000","last_became_peered":"2024-09-17T01:45:35.763406+0000","last_unstale":"2024-09-17T01:45:38.421544+0000","last_undegraded":"2024-09-17T01:45:38.421544+0000","last_fullsized":"2024-09-17T01:45:38.421544+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:47:36.104453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.421306+0000","last_change":"2024-09-17T01:45:36.770776+0000","last_active":"2024-09-17T01:45:38.421306+0000","last_peered":"2024-09-17T01:45:38.421306+0000","last_clean":"2024-09-17T01:45:38.421306+0000","last_became_active":"2024-09-17T01:45:36.770428+0000","last_became_peered":"2024-09-17T01:45:36.770428+0000","last_unstale":"2024-09-17T01:45:38.421306+0000","last_undegraded":"2024-09-17T01:45:38.421306+0000","last_fullsized":"2024-09-17T01:45:38.421306+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:16.745182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"173'1","reported_seq":16,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.420965+0000","last_change":"2024-09-17T01:45:35.760659+0000","last_active":"2024-09-17T01:45:38.420965+0000","last_peered":"2024-09-17T01:45:38.420965+0000","last_clean":"2024-09-17T01:45:38.420965+0000","last_became_active":"2024-09-17T01:45:35.760292+0000","last_became_peered":"2024-09-17T01:45:35.760292+0000","last_unstale":"2024-09-17T01:45:38.420965+0000","last_undegraded":"2024-09-17T01:45:38.420965+0000","last_fullsized":"2024-09-17T01:45:38.420965+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:51.861085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.970162+0000","last_change":"2024-09-17T01:45:36.757979+0000","last_active":"2024-09-17T01:45:38.970162+0000","last_peered":"2024-09-17T01:45:38.970162+0000","last_clean":"2024-09-17T01:45:38.970162+0000","last_became_active":"2024-09-17T01:45:36.757652+0000","last_became_peered":"2024-09-17T01:45:36.757652+0000","last_unstale":"2024-09-17T01:45:38.970162+0000","last_undegraded":"2024-09-17T01:45:38.970162+0000","last_fullsized":"2024-09-17T01:45:38.970162+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:35.868919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.999780+0000","last_change":"2024-09-17T01:45:35.756843+0000","last_active":"2024-09-17T01:45:38.999780+0000","last_peered":"2024-09-17T01:45:38.999780+0000","last_clean":"2024-09-17T01:45:38.999780+0000","last_became_active":"2024-09-17T01:45:35.756472+0000","last_became_peered":"2024-09-17T01:45:35.756472+0000","last_unstale":"2024-09-17T01:45:38.999780+0000","last_undegraded":"2024-09-17T01:45:38.999780+0000","last_fullsized":"2024-09-17T01:45:38.999780+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:33:48.405574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.283890+0000","last_change":"2024-09-17T01:45:36.762228+0000","last_active":"2024-09-17T01:45:38.283890+0000","last_peered":"2024-09-17T01:45:38.283890+0000","last_clean":"2024-09-17T01:45:38.283890+0000","last_became_active":"2024-09-17T01:45:36.761348+0000","last_became_peered":"2024-09-17T01:45:36.761348+0000","last_unstale":"2024-09-17T01:45:38.283890+0000","last_undegraded":"2024-09-17T01:45:38.283890+0000","last_fullsized":"2024-09-17T01:45:38.283890+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:00.173917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.970547+0000","last_change":"2024-09-17T01:45:35.746579+0000","last_active":"2024-09-17T01:45:38.970547+0000","last_peered":"2024-09-17T01:45:38.970547+0000","last_clean":"2024-09-17T01:45:38.970547+0000","last_became_active":"2024-09-17T01:45:35.746230+0000","last_became_peered":"2024-09-17T01:45:35.746230+0000","last_unstale":"2024-09-17T01:45:38.970547+0000","last_undegraded":"2024-09-17T01:45:38.970547+0000","last_fullsized":"2024-09-17T01:45:38.970547+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:03.816368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.097765+0000","last_change":"2024-09-17T01:45:36.763765+0000","last_active":"2024-09-17T01:45:38.097765+0000","last_peered":"2024-09-17T01:45:38.097765+0000","last_clean":"2024-09-17T01:45:38.097765+0000","last_became_active":"2024-09-17T01:45:36.762238+0000","last_became_peered":"2024-09-17T01:45:36.762238+0000","last_unstale":"2024-09-17T01:45:38.097765+0000","last_undegraded":"2024-09-17T01:45:38.097765+0000","last_fullsized":"2024-09-17T01:45:38.097765+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:18:45.547894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.097444+0000","last_change":"2024-09-17T01:45:35.756807+0000","last_active":"2024-09-17T01:45:38.097444+0000","last_peered":"2024-09-17T01:45:38.097444+0000","last_clean":"2024-09-17T01:45:38.097444+0000","last_became_active":"2024-09-17T01:45:35.756252+0000","last_became_peered":"2024-09-17T01:45:35.756252+0000","last_unstale":"2024-09-17T01:45:38.097444+0000","last_undegraded":"2024-09-17T01:45:38.097444+0000","last_fullsized":"2024-09-17T01:45:38.097444+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:02.969240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.757973+0000","last_change":"2024-09-17T01:45:36.771169+0000","last_active":"2024-09-17T01:45:37.757973+0000","last_peered":"2024-09-17T01:45:37.757973+0000","last_clean":"2024-09-17T01:45:37.757973+0000","last_became_active":"2024-09-17T01:45:36.770846+0000","last_became_peered":"2024-09-17T01:45:36.770846+0000","last_unstale":"2024-09-17T01:45:37.757973+0000","last_undegraded":"2024-09-17T01:45:37.757973+0000","last_fullsized":"2024-09-17T01:45:37.757973+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:45.397685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.15","version":"173'3","reported_seq":18,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.421355+0000","last_change":"2024-09-17T01:45:35.765352+0000","last_active":"2024-09-17T01:45:38.421355+0000","last_peered":"2024-09-17T01:45:38.421355+0000","last_clean":"2024-09-17T01:45:38.421355+0000","last_became_active":"2024-09-17T01:45:35.765005+0000","last_became_peered":"2024-09-17T01:45:35.765005+0000","last_unstale":"2024-09-17T01:45:38.421355+0000","last_undegraded":"2024-09-17T01:45:38.421355+0000","last_fullsized":"2024-09-17T01:45:38.421355+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:56:32.314141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.097305+0000","last_change":"2024-09-17T01:45:36.770211+0000","last_active":"2024-09-17T01:45:38.097305+0000","last_peered":"2024-09-17T01:45:38.097305+0000","last_clean":"2024-09-17T01:45:38.097305+0000","last_became_active":"2024-09-17T01:45:36.769790+0000","last_became_peered":"2024-09-17T01:45:36.769790+0000","last_unstale":"2024-09-17T01:45:38.097305+0000","last_undegraded":"2024-09-17T01:45:38.097305+0000","last_fullsized":"2024-09-17T01:45:38.097305+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:12:16.392621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.14","version":"173'6","reported_seq":21,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.421228+0000","last_change":"2024-09-17T01:45:35.763082+0000","last_active":"2024-09-17T01:45:38.421228+0000","last_peered":"2024-09-17T01:45:38.421228+0000","last_clean":"2024-09-17T01:45:38.421228+0000","last_became_active":"2024-09-17T01:45:35.762355+0000","last_became_peered":"2024-09-17T01:45:35.762355+0000","last_unstale":"2024-09-17T01:45:38.421228+0000","last_undegraded":"2024-09-17T01:45:38.421228+0000","last_fullsized":"2024-09-17T01:45:38.421228+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:55.423130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.097157+0000","last_change":"2024-09-17T01:45:36.758375+0000","last_active":"2024-09-17T01:45:38.097157+0000","last_peered":"2024-09-17T01:45:38.097157+0000","last_clean":"2024-09-17T01:45:38.097157+0000","last_became_active":"2024-09-17T01:45:36.755719+0000","last_became_peered":"2024-09-17T01:45:36.755719+0000","last_unstale":"2024-09-17T01:45:38.097157+0000","last_undegraded":"2024-09-17T01:45:38.097157+0000","last_fullsized":"2024-09-17T01:45:38.097157+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:43.040988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.13","version":"173'2","reported_seq":17,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.757773+0000","last_change":"2024-09-17T01:45:35.757006+0000","last_active":"2024-09-17T01:45:37.757773+0000","last_peered":"2024-09-17T01:45:37.757773+0000","last_clean":"2024-09-17T01:45:37.757773+0000","last_became_active":"2024-09-17T01:45:35.756456+0000","last_became_peered":"2024-09-17T01:45:35.756456+0000","last_unstale":"2024-09-17T01:45:37.757773+0000","last_undegraded":"2024-09-17T01:45:37.757773+0000","last_fullsized":"2024-09-17T01:45:37.757773+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:07.153759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:39.000171+0000","last_change":"2024-09-17T01:45:36.770369+0000","last_active":"2024-09-17T01:45:39.000171+0000","last_peered":"2024-09-17T01:45:39.000171+0000","last_clean":"2024-09-17T01:45:39.000171+0000","last_became_active":"2024-09-17T01:45:36.770041+0000","last_became_peered":"2024-09-17T01:45:36.770041+0000","last_unstale":"2024-09-17T01:45:39.000171+0000","last_undegraded":"2024-09-17T01:45:39.000171+0000","last_fullsized":"2024-09-17T01:45:39.000171+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:12.562169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.097057+0000","last_change":"2024-09-17T01:45:35.751470+0000","last_active":"2024-09-17T01:45:38.097057+0000","last_peered":"2024-09-17T01:45:38.097057+0000","last_clean":"2024-09-17T01:45:38.097057+0000","last_became_active":"2024-09-17T01:45:35.751153+0000","last_became_peered":"2024-09-17T01:45:35.751153+0000","last_unstale":"2024-09-17T01:45:38.097057+0000","last_undegraded":"2024-09-17T01:45:38.097057+0000","last_fullsized":"2024-09-17T01:45:38.097057+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:46.794589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.756495+0000","last_change":"2024-09-17T01:45:36.754881+0000","last_active":"2024-09-17T01:45:37.756495+0000","last_peered":"2024-09-17T01:45:37.756495+0000","last_clean":"2024-09-17T01:45:37.756495+0000","last_became_active":"2024-09-17T01:45:36.754524+0000","last_became_peered":"2024-09-17T01:45:36.754524+0000","last_unstale":"2024-09-17T01:45:37.756495+0000","last_undegraded":"2024-09-17T01:45:37.756495+0000","last_fullsized":"2024-09-17T01:45:37.756495+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:10.499253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.421678+0000","last_change":"2024-09-17T01:45:35.763601+0000","last_active":"2024-09-17T01:45:38.421678+0000","last_peered":"2024-09-17T01:45:38.421678+0000","last_clean":"2024-09-17T01:45:38.421678+0000","last_became_active":"2024-09-17T01:45:35.763186+0000","last_became_peered":"2024-09-17T01:45:35.763186+0000","last_unstale":"2024-09-17T01:45:38.421678+0000","last_undegraded":"2024-09-17T01:45:38.421678+0000","last_fullsized":"2024-09-17T01:45:38.421678+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:03.715826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.421466+0000","last_change":"2024-09-17T01:45:36.768489+0000","last_active":"2024-09-17T01:45:38.421466+0000","last_peered":"2024-09-17T01:45:38.421466+0000","last_clean":"2024-09-17T01:45:38.421466+0000","last_became_active":"2024-09-17T01:45:36.768124+0000","last_became_peered":"2024-09-17T01:45:36.768124+0000","last_unstale":"2024-09-17T01:45:38.421466+0000","last_undegraded":"2024-09-17T01:45:38.421466+0000","last_fullsized":"2024-09-17T01:45:38.421466+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:09.078393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.10","version":"173'8","reported_seq":23,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.999848+0000","last_change":"2024-09-17T01:45:35.759787+0000","last_active":"2024-09-17T01:45:38.999848+0000","last_peered":"2024-09-17T01:45:38.999848+0000","last_clean":"2024-09-17T01:45:38.999848+0000","last_became_active":"2024-09-17T01:45:35.759362+0000","last_became_peered":"2024-09-17T01:45:35.759362+0000","last_unstale":"2024-09-17T01:45:38.999848+0000","last_undegraded":"2024-09-17T01:45:38.999848+0000","last_fullsized":"2024-09-17T01:45:38.999848+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:30.865430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.097311+0000","last_change":"2024-09-17T01:45:36.763560+0000","last_active":"2024-09-17T01:45:38.097311+0000","last_peered":"2024-09-17T01:45:38.097311+0000","last_clean":"2024-09-17T01:45:38.097311+0000","last_became_active":"2024-09-17T01:45:36.763237+0000","last_became_peered":"2024-09-17T01:45:36.763237+0000","last_unstale":"2024-09-17T01:45:38.097311+0000","last_undegraded":"2024-09-17T01:45:38.097311+0000","last_fullsized":"2024-09-17T01:45:38.097311+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:19.221868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.f","version":"173'1","reported_seq":16,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.421671+0000","last_change":"2024-09-17T01:45:35.764926+0000","last_active":"2024-09-17T01:45:38.421671+0000","last_peered":"2024-09-17T01:45:38.421671+0000","last_clean":"2024-09-17T01:45:38.421671+0000","last_became_active":"2024-09-17T01:45:35.764595+0000","last_became_peered":"2024-09-17T01:45:35.764595+0000","last_unstale":"2024-09-17T01:45:38.421671+0000","last_undegraded":"2024-09-17T01:45:38.421671+0000","last_fullsized":"2024-09-17T01:45:38.421671+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:13.061734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.758237+0000","last_change":"2024-09-17T01:45:36.772458+0000","last_active":"2024-09-17T01:45:37.758237+0000","last_peered":"2024-09-17T01:45:37.758237+0000","last_clean":"2024-09-17T01:45:37.758237+0000","last_became_active":"2024-09-17T01:45:36.772175+0000","last_became_peered":"2024-09-17T01:45:36.772175+0000","last_unstale":"2024-09-17T01:45:37.758237+0000","last_undegraded":"2024-09-17T01:45:37.758237+0000","last_fullsized":"2024-09-17T01:45:37.758237+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:02.969468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.e","version":"173'2","reported_seq":17,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.757230+0000","last_change":"2024-09-17T01:45:35.762767+0000","last_active":"2024-09-17T01:45:37.757230+0000","last_peered":"2024-09-17T01:45:37.757230+0000","last_clean":"2024-09-17T01:45:37.757230+0000","last_became_active":"2024-09-17T01:45:35.761979+0000","last_became_peered":"2024-09-17T01:45:35.761979+0000","last_unstale":"2024-09-17T01:45:37.757230+0000","last_undegraded":"2024-09-17T01:45:37.757230+0000","last_fullsized":"2024-09-17T01:45:37.757230+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:32:16.024198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.755974+0000","last_change":"2024-09-17T01:45:36.772340+0000","last_active":"2024-09-17T01:45:37.755974+0000","last_peered":"2024-09-17T01:45:37.755974+0000","last_clean":"2024-09-17T01:45:37.755974+0000","last_became_active":"2024-09-17T01:45:36.771997+0000","last_became_peered":"2024-09-17T01:45:36.771997+0000","last_unstale":"2024-09-17T01:45:37.755974+0000","last_undegraded":"2024-09-17T01:45:37.755974+0000","last_fullsized":"2024-09-17T01:45:37.755974+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:05.699079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.d","version":"173'1","reported_seq":16,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.970145+0000","last_change":"2024-09-17T01:45:35.751339+0000","last_active":"2024-09-17T01:45:38.970145+0000","last_peered":"2024-09-17T01:45:38.970145+0000","last_clean":"2024-09-17T01:45:38.970145+0000","last_became_active":"2024-09-17T01:45:35.751014+0000","last_became_peered":"2024-09-17T01:45:35.751014+0000","last_unstale":"2024-09-17T01:45:38.970145+0000","last_undegraded":"2024-09-17T01:45:38.970145+0000","last_fullsized":"2024-09-17T01:45:38.970145+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:46.113700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.757738+0000","last_change":"2024-09-17T01:45:36.768510+0000","last_active":"2024-09-17T01:45:37.757738+0000","last_peered":"2024-09-17T01:45:37.757738+0000","last_clean":"2024-09-17T01:45:37.757738+0000","last_became_active":"2024-09-17T01:45:36.768214+0000","last_became_peered":"2024-09-17T01:45:36.768214+0000","last_unstale":"2024-09-17T01:45:37.757738+0000","last_undegraded":"2024-09-17T01:45:37.757738+0000","last_fullsized":"2024-09-17T01:45:37.757738+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:58.830576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.970371+0000","last_change":"2024-09-17T01:45:35.757485+0000","last_active":"2024-09-17T01:45:38.970371+0000","last_peered":"2024-09-17T01:45:38.970371+0000","last_clean":"2024-09-17T01:45:38.970371+0000","last_became_active":"2024-09-17T01:45:35.757170+0000","last_became_peered":"2024-09-17T01:45:35.757170+0000","last_unstale":"2024-09-17T01:45:38.970371+0000","last_undegraded":"2024-09-17T01:45:38.970371+0000","last_fullsized":"2024-09-17T01:45:38.970371+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:34:40.122211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.757346+0000","last_change":"2024-09-17T01:45:36.767788+0000","last_active":"2024-09-17T01:45:37.757346+0000","last_peered":"2024-09-17T01:45:37.757346+0000","last_clean":"2024-09-17T01:45:37.757346+0000","last_became_active":"2024-09-17T01:45:36.767398+0000","last_became_peered":"2024-09-17T01:45:36.767398+0000","last_unstale":"2024-09-17T01:45:37.757346+0000","last_undegraded":"2024-09-17T01:45:37.757346+0000","last_fullsized":"2024-09-17T01:45:37.757346+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:17.711033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.b","version":"173'2","reported_seq":17,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.421462+0000","last_change":"2024-09-17T01:45:35.765070+0000","last_active":"2024-09-17T01:45:38.421462+0000","last_peered":"2024-09-17T01:45:38.421462+0000","last_clean":"2024-09-17T01:45:38.421462+0000","last_became_active":"2024-09-17T01:45:35.764690+0000","last_became_peered":"2024-09-17T01:45:35.764690+0000","last_unstale":"2024-09-17T01:45:38.421462+0000","last_undegraded":"2024-09-17T01:45:38.421462+0000","last_fullsized":"2024-09-17T01:45:38.421462+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:12.951987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:39.000290+0000","last_change":"2024-09-17T01:45:36.766671+0000","last_active":"2024-09-17T01:45:39.000290+0000","last_peered":"2024-09-17T01:45:39.000290+0000","last_clean":"2024-09-17T01:45:39.000290+0000","last_became_active":"2024-09-17T01:45:36.766216+0000","last_became_peered":"2024-09-17T01:45:36.766216+0000","last_unstale":"2024-09-17T01:45:39.000290+0000","last_undegraded":"2024-09-17T01:45:39.000290+0000","last_fullsized":"2024-09-17T01:45:39.000290+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:17.081560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.757123+0000","last_change":"2024-09-17T01:45:35.757646+0000","last_active":"2024-09-17T01:45:37.757123+0000","last_peered":"2024-09-17T01:45:37.757123+0000","last_clean":"2024-09-17T01:45:37.757123+0000","last_became_active":"2024-09-17T01:45:35.756920+0000","last_became_peered":"2024-09-17T01:45:35.756920+0000","last_unstale":"2024-09-17T01:45:37.757123+0000","last_undegraded":"2024-09-17T01:45:37.757123+0000","last_fullsized":"2024-09-17T01:45:37.757123+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:24.207751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.970403+0000","last_change":"2024-09-17T01:45:36.756697+0000","last_active":"2024-09-17T01:45:38.970403+0000","last_peered":"2024-09-17T01:45:38.970403+0000","last_clean":"2024-09-17T01:45:38.970403+0000","last_became_active":"2024-09-17T01:45:36.756339+0000","last_became_peered":"2024-09-17T01:45:36.756339+0000","last_unstale":"2024-09-17T01:45:38.970403+0000","last_undegraded":"2024-09-17T01:45:38.970403+0000","last_fullsized":"2024-09-17T01:45:38.970403+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:50:01.139625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.756493+0000","last_change":"2024-09-17T01:45:35.754693+0000","last_active":"2024-09-17T01:45:37.756493+0000","last_peered":"2024-09-17T01:45:37.756493+0000","last_clean":"2024-09-17T01:45:37.756493+0000","last_became_active":"2024-09-17T01:45:35.754333+0000","last_became_peered":"2024-09-17T01:45:35.754333+0000","last_unstale":"2024-09-17T01:45:37.756493+0000","last_undegraded":"2024-09-17T01:45:37.756493+0000","last_fullsized":"2024-09-17T01:45:37.756493+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:51:09.613385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.097456+0000","last_change":"2024-09-17T01:45:36.767043+0000","last_active":"2024-09-17T01:45:38.097456+0000","last_peered":"2024-09-17T01:45:38.097456+0000","last_clean":"2024-09-17T01:45:38.097456+0000","last_became_active":"2024-09-17T01:45:36.766354+0000","last_became_peered":"2024-09-17T01:45:36.766354+0000","last_unstale":"2024-09-17T01:45:38.097456+0000","last_undegraded":"2024-09-17T01:45:38.097456+0000","last_fullsized":"2024-09-17T01:45:38.097456+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:20.475185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.970021+0000","last_change":"2024-09-17T01:45:35.755675+0000","last_active":"2024-09-17T01:45:38.970021+0000","last_peered":"2024-09-17T01:45:38.970021+0000","last_clean":"2024-09-17T01:45:38.970021+0000","last_became_active":"2024-09-17T01:45:35.755001+0000","last_became_peered":"2024-09-17T01:45:35.755001+0000","last_unstale":"2024-09-17T01:45:38.970021+0000","last_undegraded":"2024-09-17T01:45:38.970021+0000","last_fullsized":"2024-09-17T01:45:38.970021+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:59.577682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.283737+0000","last_change":"2024-09-17T01:45:36.761893+0000","last_active":"2024-09-17T01:45:38.283737+0000","last_peered":"2024-09-17T01:45:38.283737+0000","last_clean":"2024-09-17T01:45:38.283737+0000","last_became_active":"2024-09-17T01:45:36.760928+0000","last_became_peered":"2024-09-17T01:45:36.760928+0000","last_unstale":"2024-09-17T01:45:38.283737+0000","last_undegraded":"2024-09-17T01:45:38.283737+0000","last_fullsized":"2024-09-17T01:45:38.283737+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:08.551492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.7","version":"173'2","reported_seq":17,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.970652+0000","last_change":"2024-09-17T01:45:35.756793+0000","last_active":"2024-09-17T01:45:38.970652+0000","last_peered":"2024-09-17T01:45:38.970652+0000","last_clean":"2024-09-17T01:45:38.970652+0000","last_became_active":"2024-09-17T01:45:35.755564+0000","last_became_peered":"2024-09-17T01:45:35.755564+0000","last_unstale":"2024-09-17T01:45:38.970652+0000","last_undegraded":"2024-09-17T01:45:38.970652+0000","last_fullsized":"2024-09-17T01:45:38.970652+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:47:27.756583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.283880+0000","last_change":"2024-09-17T01:45:36.767168+0000","last_active":"2024-09-17T01:45:38.283880+0000","last_peered":"2024-09-17T01:45:38.283880+0000","last_clean":"2024-09-17T01:45:38.283880+0000","last_became_active":"2024-09-17T01:45:36.763498+0000","last_became_peered":"2024-09-17T01:45:36.763498+0000","last_unstale":"2024-09-17T01:45:38.283880+0000","last_undegraded":"2024-09-17T01:45:38.283880+0000","last_fullsized":"2024-09-17T01:45:38.283880+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:55.626427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.283861+0000","last_change":"2024-09-17T01:45:35.749393+0000","last_active":"2024-09-17T01:45:38.283861+0000","last_peered":"2024-09-17T01:45:38.283861+0000","last_clean":"2024-09-17T01:45:38.283861+0000","last_became_active":"2024-09-17T01:45:35.748844+0000","last_became_peered":"2024-09-17T01:45:35.748844+0000","last_unstale":"2024-09-17T01:45:38.283861+0000","last_undegraded":"2024-09-17T01:45:38.283861+0000","last_fullsized":"2024-09-17T01:45:38.283861+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:39.668512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.283468+0000","last_change":"2024-09-17T01:45:36.756004+0000","last_active":"2024-09-17T01:45:38.283468+0000","last_peered":"2024-09-17T01:45:38.283468+0000","last_clean":"2024-09-17T01:45:38.283468+0000","last_became_active":"2024-09-17T01:45:36.755377+0000","last_became_peered":"2024-09-17T01:45:36.755377+0000","last_unstale":"2024-09-17T01:45:38.283468+0000","last_undegraded":"2024-09-17T01:45:38.283468+0000","last_fullsized":"2024-09-17T01:45:38.283468+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:47.605666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.283866+0000","last_change":"2024-09-17T01:45:35.751547+0000","last_active":"2024-09-17T01:45:38.283866+0000","last_peered":"2024-09-17T01:45:38.283866+0000","last_clean":"2024-09-17T01:45:38.283866+0000","last_became_active":"2024-09-17T01:45:35.750397+0000","last_became_peered":"2024-09-17T01:45:35.750397+0000","last_unstale":"2024-09-17T01:45:38.283866+0000","last_undegraded":"2024-09-17T01:45:38.283866+0000","last_fullsized":"2024-09-17T01:45:38.283866+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:36.702905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.421063+0000","last_change":"2024-09-17T01:45:36.776611+0000","last_active":"2024-09-17T01:45:38.421063+0000","last_peered":"2024-09-17T01:45:38.421063+0000","last_clean":"2024-09-17T01:45:38.421063+0000","last_became_active":"2024-09-17T01:45:36.776267+0000","last_became_peered":"2024-09-17T01:45:36.776267+0000","last_unstale":"2024-09-17T01:45:38.421063+0000","last_undegraded":"2024-09-17T01:45:38.421063+0000","last_fullsized":"2024-09-17T01:45:38.421063+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:39.751859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.421385+0000","last_change":"2024-09-17T01:45:35.766189+0000","last_active":"2024-09-17T01:45:38.421385+0000","last_peered":"2024-09-17T01:45:38.421385+0000","last_clean":"2024-09-17T01:45:38.421385+0000","last_became_active":"2024-09-17T01:45:35.765484+0000","last_became_peered":"2024-09-17T01:45:35.765484+0000","last_unstale":"2024-09-17T01:45:38.421385+0000","last_undegraded":"2024-09-17T01:45:38.421385+0000","last_fullsized":"2024-09-17T01:45:38.421385+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:01.475082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.755438+0000","last_change":"2024-09-17T01:45:36.756052+0000","last_active":"2024-09-17T01:45:37.755438+0000","last_peered":"2024-09-17T01:45:37.755438+0000","last_clean":"2024-09-17T01:45:37.755438+0000","last_became_active":"2024-09-17T01:45:36.755371+0000","last_became_peered":"2024-09-17T01:45:36.755371+0000","last_unstale":"2024-09-17T01:45:37.755438+0000","last_undegraded":"2024-09-17T01:45:37.755438+0000","last_fullsized":"2024-09-17T01:45:37.755438+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:20.176629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.755671+0000","last_change":"2024-09-17T01:45:35.754984+0000","last_active":"2024-09-17T01:45:37.755671+0000","last_peered":"2024-09-17T01:45:37.755671+0000","last_clean":"2024-09-17T01:45:37.755671+0000","last_became_active":"2024-09-17T01:45:35.754274+0000","last_became_peered":"2024-09-17T01:45:35.754274+0000","last_unstale":"2024-09-17T01:45:37.755671+0000","last_undegraded":"2024-09-17T01:45:37.755671+0000","last_fullsized":"2024-09-17T01:45:37.755671+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:54.977178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.970447+0000","last_change":"2024-09-17T01:45:36.762817+0000","last_active":"2024-09-17T01:45:38.970447+0000","last_peered":"2024-09-17T01:45:38.970447+0000","last_clean":"2024-09-17T01:45:38.970447+0000","last_became_active":"2024-09-17T01:45:36.762464+0000","last_became_peered":"2024-09-17T01:45:36.762464+0000","last_unstale":"2024-09-17T01:45:38.970447+0000","last_undegraded":"2024-09-17T01:45:38.970447+0000","last_fullsized":"2024-09-17T01:45:38.970447+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:29.936322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.755400+0000","last_change":"2024-09-17T01:45:35.762052+0000","last_active":"2024-09-17T01:45:37.755400+0000","last_peered":"2024-09-17T01:45:37.755400+0000","last_clean":"2024-09-17T01:45:37.755400+0000","last_became_active":"2024-09-17T01:45:35.760796+0000","last_became_peered":"2024-09-17T01:45:35.760796+0000","last_unstale":"2024-09-17T01:45:37.755400+0000","last_undegraded":"2024-09-17T01:45:37.755400+0000","last_fullsized":"2024-09-17T01:45:37.755400+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:51.689192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.755287+0000","last_change":"2024-09-17T01:45:36.756227+0000","last_active":"2024-09-17T01:45:37.755287+0000","last_peered":"2024-09-17T01:45:37.755287+0000","last_clean":"2024-09-17T01:45:37.755287+0000","last_became_active":"2024-09-17T01:45:36.755454+0000","last_became_peered":"2024-09-17T01:45:36.755454+0000","last_unstale":"2024-09-17T01:45:37.755287+0000","last_undegraded":"2024-09-17T01:45:37.755287+0000","last_fullsized":"2024-09-17T01:45:37.755287+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:41.539051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.755242+0000","last_change":"2024-09-17T01:45:35.756403+0000","last_active":"2024-09-17T01:45:37.755242+0000","last_peered":"2024-09-17T01:45:37.755242+0000","last_clean":"2024-09-17T01:45:37.755242+0000","last_became_active":"2024-09-17T01:45:35.756100+0000","last_became_peered":"2024-09-17T01:45:35.756100+0000","last_unstale":"2024-09-17T01:45:37.755242+0000","last_undegraded":"2024-09-17T01:45:37.755242+0000","last_fullsized":"2024-09-17T01:45:37.755242+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:37.143960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:38.421642+0000","last_change":"2024-09-17T01:45:36.779122+0000","last_active":"2024-09-17T01:45:38.421642+0000","last_peered":"2024-09-17T01:45:38.421642+0000","last_clean":"2024-09-17T01:45:38.421642+0000","last_became_active":"2024-09-17T01:45:36.773297+0000","last_became_peered":"2024-09-17T01:45:36.773297+0000","last_unstale":"2024-09-17T01:45:38.421642+0000","last_undegraded":"2024-09-17T01:45:38.421642+0000","last_fullsized":"2024-09-17T01:45:38.421642+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:39.099005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.756558+0000","last_change":"2024-09-17T01:45:35.755301+0000","last_active":"2024-09-17T01:45:37.756558+0000","last_peered":"2024-09-17T01:45:37.756558+0000","last_clean":"2024-09-17T01:45:37.756558+0000","last_became_active":"2024-09-17T01:45:35.754856+0000","last_became_peered":"2024-09-17T01:45:35.754856+0000","last_unstale":"2024-09-17T01:45:37.756558+0000","last_undegraded":"2024-09-17T01:45:37.756558+0000","last_fullsized":"2024-09-17T01:45:37.756558+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:51.766839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.756733+0000","last_change":"2024-09-17T01:45:36.764504+0000","last_active":"2024-09-17T01:45:37.756733+0000","last_peered":"2024-09-17T01:45:37.756733+0000","last_clean":"2024-09-17T01:45:37.756733+0000","last_became_active":"2024-09-17T01:45:36.763163+0000","last_became_peered":"2024-09-17T01:45:36.763163+0000","last_unstale":"2024-09-17T01:45:37.756733+0000","last_undegraded":"2024-09-17T01:45:37.756733+0000","last_fullsized":"2024-09-17T01:45:37.756733+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:35.726741+0000","last_clean_scrub_stamp":"2024-09-17T01:45:35.726741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:20.076395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.756494+0000","last_change":"2024-09-17T01:45:35.759868+0000","last_active":"2024-09-17T01:45:37.756494+0000","last_peered":"2024-09-17T01:45:37.756494+0000","last_clean":"2024-09-17T01:45:37.756494+0000","last_became_active":"2024-09-17T01:45:35.759543+0000","last_became_peered":"2024-09-17T01:45:35.759543+0000","last_unstale":"2024-09-17T01:45:37.756494+0000","last_undegraded":"2024-09-17T01:45:37.756494+0000","last_fullsized":"2024-09-17T01:45:37.756494+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:45:34.718250+0000","last_clean_scrub_stamp":"2024-09-17T01:45:34.718250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:59.064637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":401,"reported_epoch":174,"state":"active+clean","last_fresh":"2024-09-17T01:45:37.755109+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:45:37.755109+0000","last_peered":"2024-09-17T01:45:37.755109+0000","last_clean":"2024-09-17T01:45:37.755109+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:45:37.755109+0000","last_undegraded":"2024-09-17T01:45:37.755109+0000","last_fullsized":"2024-09-17T01:45:37.755109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476905,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47212,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324628,"statfs":{"total":96636764160,"available":96588419072,"internally_reserved":0,"allocated":2183168,"data_stored":962262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509608,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55548,"kb_used_data":2148,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316292,"statfs":{"total":96636764160,"available":96579883008,"internally_reserved":0,"allocated":2199552,"data_stored":963916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509607,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59688,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312152,"statfs":{"total":96636764160,"available":96575643648,"internally_reserved":0,"allocated":2183168,"data_stored":962282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509608,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51372,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320468,"statfs":{"total":96636764160,"available":96584159232,"internally_reserved":0,"allocated":2183168,"data_stored":962226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509608,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51384,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320456,"statfs":{"total":96636764160,"available":96584146944,"internally_reserved":0,"allocated":2195456,"data_stored":963874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509607,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47788,"kb_used_data":2708,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324052,"statfs":{"total":96636764160,"available":96587829248,"internally_reserved":0,"allocated":2772992,"data_stored":1552560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509609,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55536,"kb_used_data":2136,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316304,"statfs":{"total":96636764160,"available":96579895296,"internally_reserved":0,"allocated":2187264,"data_stored":962808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":54655433},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542313,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47800,"kb_used_data":2716,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324040,"statfs":{"total":96636764160,"available":96587816960,"internally_reserved":0,"allocated":2781184,"data_stored":1553164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:45:41.727 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T01:45:41.727 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T01:45:41.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.998+0000 7f022cc00640 1 -- 172.21.15.42:0/35726172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02280cf7c0 msgr2=0x7f022806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:41.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.998+0000 7f022cc00640 1 --2- 172.21.15.42:0/35726172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02280cf7c0 0x7f022806cd20 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f0228071cb0 tx=0x7f021002a560 comp rx=0 tx=0).stop 2024-09-17T01:45:41.997 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.998+0000 7f022cc00640 1 -- 172.21.15.42:0/35726172 shutdown_connections 2024-09-17T01:45:41.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.998+0000 7f022cc00640 1 --2- 172.21.15.42:0/35726172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02280cf7c0 0x7f022806cd20 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:41.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.998+0000 7f022cc00640 1 --2- 172.21.15.42:0/35726172 >> v2:172.21.15.43:3300/0 conn(0x7f02280b4be0 0x7f022815d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:41.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.998+0000 7f022cc00640 1 -- 172.21.15.42:0/35726172 >> 172.21.15.42:0/35726172 conn(0x7f02280b25f0 msgr2=0x7f02280d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:41.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.998+0000 7f022cc00640 1 -- 172.21.15.42:0/35726172 shutdown_connections 2024-09-17T01:45:41.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:41.998+0000 7f022cc00640 1 -- 172.21.15.42:0/35726172 wait complete. 2024-09-17T01:45:41.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.000+0000 7f022cc00640 1 Processor -- start 2024-09-17T01:45:41.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.000+0000 7f022cc00640 1 -- start start 2024-09-17T01:45:42.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.002+0000 7f022cc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f022806d260 0x7f0228153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:42.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.002+0000 7f022cc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02280b4be0 0x7f0228072050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:42.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.002+0000 7f022cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02280cf7c0 0x7f022814c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:42.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.002+0000 7f022cc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0228153970 con 0x7f02280cf7c0 2024-09-17T01:45:42.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.002+0000 7f022cc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f02281537f0 con 0x7f022806d260 2024-09-17T01:45:42.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.002+0000 7f022cc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0228153af0 con 0x7f02280b4be0 2024-09-17T01:45:42.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.002+0000 7f0227e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02280cf7c0 0x7f022814c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:42.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.002+0000 7f0227e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02280cf7c0 0x7f022814c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49546/0 (socket says 172.21.15.42:49546) 2024-09-17T01:45:42.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.002+0000 7f0227e00640 1 -- 172.21.15.42:0/319549769 learned_addr learned my addr 172.21.15.42:0/319549769 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:42.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.002+0000 7f0227400640 1 --2- 172.21.15.42:0/319549769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f022806d260 0x7f0228153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:42.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.002+0000 7f021fe00640 1 --2- 172.21.15.42:0/319549769 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02280b4be0 0x7f0228072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:42.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.003+0000 7f0227e00640 1 -- 172.21.15.42:0/319549769 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02280b4be0 msgr2=0x7f0228072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:42.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.003+0000 7f0227e00640 1 --2- 172.21.15.42:0/319549769 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02280b4be0 0x7f0228072050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:42.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.003+0000 7f0227e00640 1 -- 172.21.15.42:0/319549769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f022806d260 msgr2=0x7f0228153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:42.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.003+0000 7f0227e00640 1 --2- 172.21.15.42:0/319549769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f022806d260 0x7f0228153d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:42.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.003+0000 7f0227e00640 1 -- 172.21.15.42:0/319549769 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02280730b0 con 0x7f02280cf7c0 2024-09-17T01:45:42.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.003+0000 7f0227e00640 1 --2- 172.21.15.42:0/319549769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02280cf7c0 0x7f022814c6c0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f022000b9e0 tx=0x7f022000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:42.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.003+0000 7f021f400640 1 -- 172.21.15.42:0/319549769 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0220003b70 con 0x7f02280cf7c0 2024-09-17T01:45:42.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.003+0000 7f021f400640 1 -- 172.21.15.42:0/319549769 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0220003e00 con 0x7f02280cf7c0 2024-09-17T01:45:42.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.003+0000 7f021f400640 1 -- 172.21.15.42:0/319549769 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022000cb80 con 0x7f02280cf7c0 2024-09-17T01:45:42.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.003+0000 7f022cc00640 1 -- 172.21.15.42:0/319549769 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0228072af0 con 0x7f02280cf7c0 2024-09-17T01:45:42.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.003+0000 7f022cc00640 1 -- 172.21.15.42:0/319549769 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0228073ad0 con 0x7f02280cf7c0 2024-09-17T01:45:42.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.004+0000 7f022cc00640 1 -- 172.21.15.42:0/319549769 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f022815d6b0 con 0x7f02280cf7c0 2024-09-17T01:45:42.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.006+0000 7f021f400640 1 -- 172.21.15.42:0/319549769 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0220004000 con 0x7f02280cf7c0 2024-09-17T01:45:42.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.007+0000 7f021f400640 1 --2- 172.21.15.42:0/319549769 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0204078bc0 0x7f020407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:42.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.007+0000 7f021f400640 1 -- 172.21.15.42:0/319549769 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5709+0+0 (secure 0 0 0) 0x7f022009aac0 con 0x7f02280cf7c0 2024-09-17T01:45:42.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.008+0000 7f0227400640 1 --2- 172.21.15.42:0/319549769 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0204078bc0 0x7f020407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:42.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.008+0000 7f0227400640 1 --2- 172.21.15.42:0/319549769 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0204078bc0 0x7f020407b0d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f0218004630 tx=0x7f021800b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:42.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.012+0000 7f021f400640 1 -- 172.21.15.42:0/319549769 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f02280730b0 con 0x7f02280cf7c0 2024-09-17T01:45:42.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.282+0000 7f022cc00640 1 -- 172.21.15.42:0/319549769 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f02280b1a70 con 0x7f02280cf7c0 2024-09-17T01:45:42.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.285+0000 7f021f400640 1 -- 172.21.15.42:0/319549769 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v41) ==== 190+0+147 (secure 0 0 0) 0x7f0220062930 con 0x7f02280cf7c0 2024-09-17T01:45:42.284 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-09-17T01:45:42.284 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA== 2024-09-17T01:45:42.284 INFO:teuthology.orchestra.run.smithi042.stdout: caps mds = "allow" 2024-09-17T01:45:42.284 INFO:teuthology.orchestra.run.smithi042.stdout: caps mon = "allow r" 2024-09-17T01:45:42.284 INFO:teuthology.orchestra.run.smithi042.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T01:45:42.285 INFO:teuthology.orchestra.run.smithi042.stderr:updated caps for client.0 2024-09-17T01:45:42.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.287+0000 7f022cc00640 1 -- 172.21.15.42:0/319549769 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0204078bc0 msgr2=0x7f020407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:42.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.287+0000 7f022cc00640 1 --2- 172.21.15.42:0/319549769 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0204078bc0 0x7f020407b0d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f0218004630 tx=0x7f021800b2e0 comp rx=0 tx=0).stop 2024-09-17T01:45:42.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.287+0000 7f022cc00640 1 -- 172.21.15.42:0/319549769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02280cf7c0 msgr2=0x7f022814c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:42.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.287+0000 7f022cc00640 1 --2- 172.21.15.42:0/319549769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02280cf7c0 0x7f022814c6c0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f022000b9e0 tx=0x7f022000bea0 comp rx=0 tx=0).stop 2024-09-17T01:45:42.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.288+0000 7f022cc00640 1 -- 172.21.15.42:0/319549769 shutdown_connections 2024-09-17T01:45:42.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.288+0000 7f022cc00640 1 --2- 172.21.15.42:0/319549769 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0204078bc0 0x7f020407b0d0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:42.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.288+0000 7f022cc00640 1 --2- 172.21.15.42:0/319549769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02280cf7c0 0x7f022814c6c0 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:42.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.288+0000 7f022cc00640 1 --2- 172.21.15.42:0/319549769 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02280b4be0 0x7f0228072050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:42.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.288+0000 7f022cc00640 1 --2- 172.21.15.42:0/319549769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f022806d260 0x7f0228153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:42.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.288+0000 7f022cc00640 1 -- 172.21.15.42:0/319549769 >> 172.21.15.42:0/319549769 conn(0x7f02280b25f0 msgr2=0x7f02280c9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:42.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.288+0000 7f022cc00640 1 -- 172.21.15.42:0/319549769 shutdown_connections 2024-09-17T01:45:42.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.288+0000 7f022cc00640 1 -- 172.21.15.42:0/319549769 wait complete. 2024-09-17T01:45:42.313 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:45:42.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.541+0000 7fde9d200640 1 -- 172.21.15.42:0/4179444650 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde98142f40 msgr2=0x7fde98072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:42.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.541+0000 7fde9d200640 1 --2- 172.21.15.42:0/4179444650 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde98142f40 0x7fde98072950 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fde84009830 tx=0x7fde8402a480 comp rx=0 tx=0).stop 2024-09-17T01:45:42.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.541+0000 7fde9d200640 1 -- 172.21.15.42:0/4179444650 shutdown_connections 2024-09-17T01:45:42.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.541+0000 7fde9d200640 1 --2- 172.21.15.42:0/4179444650 >> v2:172.21.15.43:3300/0 conn(0x7fde98072e90 0x7fde980cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:42.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.541+0000 7fde9d200640 1 --2- 172.21.15.42:0/4179444650 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde98142f40 0x7fde98072950 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:42.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.541+0000 7fde9d200640 1 -- 172.21.15.42:0/4179444650 >> 172.21.15.42:0/4179444650 conn(0x7fde980b2930 msgr2=0x7fde9806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:42.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.541+0000 7fde9d200640 1 -- 172.21.15.42:0/4179444650 shutdown_connections 2024-09-17T01:45:42.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.541+0000 7fde9d200640 1 -- 172.21.15.42:0/4179444650 wait complete. 2024-09-17T01:45:42.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.543+0000 7fde9d200640 1 Processor -- start 2024-09-17T01:45:42.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.543+0000 7fde9d200640 1 -- start start 2024-09-17T01:45:42.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.545+0000 7fde9d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde98072e90 0x7fde98137b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:42.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.545+0000 7fde9d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde980b3550 0x7fde98142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:42.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.545+0000 7fde9d200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde98142f40 0x7fde981587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:42.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.545+0000 7fde9d200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fde9806d7c0 con 0x7fde98072e90 2024-09-17T01:45:42.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.545+0000 7fde9d200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fde9806d640 con 0x7fde980b3550 2024-09-17T01:45:42.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.545+0000 7fde9d200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fde9806d940 con 0x7fde98142f40 2024-09-17T01:45:42.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.545+0000 7fde95e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde98072e90 0x7fde98137b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:42.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.545+0000 7fde95e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde98072e90 0x7fde98137b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49552/0 (socket says 172.21.15.42:49552) 2024-09-17T01:45:42.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.545+0000 7fde95e00640 1 -- 172.21.15.42:0/2250346697 learned_addr learned my addr 172.21.15.42:0/2250346697 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:42.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.545+0000 7fde95400640 1 --2- 172.21.15.42:0/2250346697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde980b3550 0x7fde98142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:42.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.545+0000 7fde96800640 1 --2- 172.21.15.42:0/2250346697 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde98142f40 0x7fde981587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:42.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.545+0000 7fde95e00640 1 -- 172.21.15.42:0/2250346697 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde98142f40 msgr2=0x7fde981587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:42.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.545+0000 7fde95e00640 1 --2- 172.21.15.42:0/2250346697 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde98142f40 0x7fde981587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:42.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.545+0000 7fde95e00640 1 -- 172.21.15.42:0/2250346697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde980b3550 msgr2=0x7fde98142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:42.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.545+0000 7fde95e00640 1 --2- 172.21.15.42:0/2250346697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde980b3550 0x7fde98142120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:42.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.545+0000 7fde95e00640 1 -- 172.21.15.42:0/2250346697 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde981f5b00 con 0x7fde98072e90 2024-09-17T01:45:42.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.546+0000 7fde95e00640 1 --2- 172.21.15.42:0/2250346697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde98072e90 0x7fde98137b50 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7fde8800c3c0 tx=0x7fde8800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:42.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.546+0000 7fde8e000640 1 -- 172.21.15.42:0/2250346697 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde88017070 con 0x7fde98072e90 2024-09-17T01:45:42.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.546+0000 7fde8e000640 1 -- 172.21.15.42:0/2250346697 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde880053c0 con 0x7fde98072e90 2024-09-17T01:45:42.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.546+0000 7fde9d200640 1 -- 172.21.15.42:0/2250346697 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde981f5dc0 con 0x7fde98072e90 2024-09-17T01:45:42.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.546+0000 7fde8e000640 1 -- 172.21.15.42:0/2250346697 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde88003850 con 0x7fde98072e90 2024-09-17T01:45:42.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.546+0000 7fde9d200640 1 -- 172.21.15.42:0/2250346697 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde981f6380 con 0x7fde98072e90 2024-09-17T01:45:42.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.547+0000 7fde9d200640 1 -- 172.21.15.42:0/2250346697 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde981f6a40 con 0x7fde98072e90 2024-09-17T01:45:42.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.548+0000 7fde8e000640 1 -- 172.21.15.42:0/2250346697 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fde8801a070 con 0x7fde98072e90 2024-09-17T01:45:42.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.549+0000 7fde8e000640 1 --2- 172.21.15.42:0/2250346697 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde78078b90 0x7fde7807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:42.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.549+0000 7fde8e000640 1 -- 172.21.15.42:0/2250346697 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5709+0+0 (secure 0 0 0) 0x7fde8809a0c0 con 0x7fde98072e90 2024-09-17T01:45:42.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.550+0000 7fde95400640 1 --2- 172.21.15.42:0/2250346697 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde78078b90 0x7fde7807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:42.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.551+0000 7fde95400640 1 --2- 172.21.15.42:0/2250346697 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde78078b90 0x7fde7807b0a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fde84034000 tx=0x7fde84004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:42.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.554+0000 7fde8e000640 1 -- 172.21.15.42:0/2250346697 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fde981f6a40 con 0x7fde98072e90 2024-09-17T01:45:42.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.793+0000 7fde9d200640 1 -- 172.21.15.42:0/2250346697 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde980cec40 con 0x7fde98072e90 2024-09-17T01:45:42.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.794+0000 7fde8e000640 1 -- 172.21.15.42:0/2250346697 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 139 v139) ==== 95+0+5230 (secure 0 0 0) 0x7fde880624f0 con 0x7fde98072e90 2024-09-17T01:45:42.793 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:45:42.793 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":139,"btime":"2024-09-17T01:45:39:760872+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1946373489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1946373489},{"type":"v1","addr":"172.21.15.43:6837","nonce":1946373489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134},{"gid":9280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/1948698658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1948698658},{"type":"v1","addr":"172.21.15.43:6835","nonce":1948698658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":9960,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/908320168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":908320168},{"type":"v1","addr":"172.21.15.42:6833","nonce":908320168}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":132}],"filesystems":[{"mdsmap":{"epoch":139,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:45:36.259119+0000","modified":"2024-09-17T01:45:39.275365+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9969":{"gid":9969,"name":"a","rank":0,"incarnation":135,"state":"up:active","state_seq":5,"addr":"172.21.15.42:6835/2353432649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":2353432649},{"type":"v1","addr":"172.21.15.42:6835","nonce":2353432649}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9969,"qdb_cluster":[9969]},"id":12}]} 2024-09-17T01:45:42.793 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 139 2024-09-17T01:45:42.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.797+0000 7fde9d200640 1 -- 172.21.15.42:0/2250346697 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde78078b90 msgr2=0x7fde7807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:42.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.797+0000 7fde9d200640 1 --2- 172.21.15.42:0/2250346697 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde78078b90 0x7fde7807b0a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fde84034000 tx=0x7fde84004730 comp rx=0 tx=0).stop 2024-09-17T01:45:42.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.797+0000 7fde9d200640 1 -- 172.21.15.42:0/2250346697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde98072e90 msgr2=0x7fde98137b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:42.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.797+0000 7fde9d200640 1 --2- 172.21.15.42:0/2250346697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde98072e90 0x7fde98137b50 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7fde8800c3c0 tx=0x7fde8800c880 comp rx=0 tx=0).stop 2024-09-17T01:45:42.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.797+0000 7fde9d200640 1 -- 172.21.15.42:0/2250346697 shutdown_connections 2024-09-17T01:45:42.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.797+0000 7fde9d200640 1 --2- 172.21.15.42:0/2250346697 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fde78078b90 0x7fde7807b0a0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:42.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.797+0000 7fde9d200640 1 --2- 172.21.15.42:0/2250346697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde980b3550 0x7fde98142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:42.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.797+0000 7fde9d200640 1 --2- 172.21.15.42:0/2250346697 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fde98142f40 0x7fde981587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:42.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.797+0000 7fde9d200640 1 --2- 172.21.15.42:0/2250346697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde98072e90 0x7fde98137b50 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:42.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.797+0000 7fde9d200640 1 -- 172.21.15.42:0/2250346697 >> 172.21.15.42:0/2250346697 conn(0x7fde980b2930 msgr2=0x7fde9815f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:42.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.797+0000 7fde9d200640 1 -- 172.21.15.42:0/2250346697 shutdown_connections 2024-09-17T01:45:42.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:42.797+0000 7fde9d200640 1 -- 172.21.15.42:0/2250346697 wait complete. 2024-09-17T01:45:43.223 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 139, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:45:36.259119+0000', 'modified': '2024-09-17T01:45:39.275365+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9969}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9969': {'gid': 9969, 'name': 'a', 'rank': 0, 'incarnation': 135, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.42:6835/2353432649', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6834', 'nonce': 2353432649}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 2353432649}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9969, 'qdb_cluster': [9969]} 2024-09-17T01:45:43.223 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T01:45:43.223 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T01:45:43.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.456+0000 7f711b000640 1 -- 172.21.15.42:0/1858628250 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70fc004000 msgr2=0x7f70fc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:43.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.456+0000 7f711b000640 1 --2- 172.21.15.42:0/1858628250 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f70fc004000 0x7f70fc004800 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f71140723f0 tx=0x7f70fc005830 comp rx=0 tx=0).stop 2024-09-17T01:45:43.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.456+0000 7f711a600640 1 -- 172.21.15.42:0/1858628250 reap_dead start 2024-09-17T01:45:43.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.456+0000 7f711b000640 1 -- 172.21.15.42:0/1858628250 shutdown_connections 2024-09-17T01:45:43.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.456+0000 7f711b000640 1 -- 172.21.15.42:0/1858628250 >> 172.21.15.42:0/1858628250 conn(0x7f711406d890 msgr2=0x7f71140b2330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:43.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.456+0000 7f711b000640 1 -- 172.21.15.42:0/1858628250 shutdown_connections 2024-09-17T01:45:43.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.456+0000 7f711b000640 1 -- 172.21.15.42:0/1858628250 wait complete. 2024-09-17T01:45:43.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.459+0000 7f711b000640 1 Processor -- start 2024-09-17T01:45:43.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.459+0000 7f711b000640 1 -- start start 2024-09-17T01:45:43.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.460+0000 7f711b000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70fc004000 0x7f7114153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:43.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.460+0000 7f711b000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71140d0550 0x7f71140d0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:43.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.460+0000 7f711b000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f711415a630 0x7f711415aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:43.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.460+0000 7f711b000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7114073fc0 con 0x7f71140d0550 2024-09-17T01:45:43.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.460+0000 7f711b000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f711415bd40 con 0x7f70fc004000 2024-09-17T01:45:43.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.460+0000 7f711b000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7114074140 con 0x7f711415a630 2024-09-17T01:45:43.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.461+0000 7f7119200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71140d0550 0x7f71140d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:43.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.461+0000 7f7119200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71140d0550 0x7f71140d0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49560/0 (socket says 172.21.15.42:49560) 2024-09-17T01:45:43.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.461+0000 7f7119200640 1 -- 172.21.15.42:0/1139053029 learned_addr learned my addr 172.21.15.42:0/1139053029 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:43.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.461+0000 7f7119c00640 1 --2- 172.21.15.42:0/1139053029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70fc004000 0x7f7114153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:43.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.461+0000 7f711a600640 1 --2- 172.21.15.42:0/1139053029 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f711415a630 0x7f711415aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:43.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.461+0000 7f7119200640 1 -- 172.21.15.42:0/1139053029 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f711415a630 msgr2=0x7f711415aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:43.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.461+0000 7f7119200640 1 --2- 172.21.15.42:0/1139053029 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f711415a630 0x7f711415aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.461+0000 7f7119200640 1 -- 172.21.15.42:0/1139053029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70fc004000 msgr2=0x7f7114153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:43.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.461+0000 7f7119200640 1 --2- 172.21.15.42:0/1139053029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70fc004000 0x7f7114153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.461+0000 7f7119200640 1 -- 172.21.15.42:0/1139053029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71141f9050 con 0x7f71140d0550 2024-09-17T01:45:43.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.462+0000 7f7119200640 1 --2- 172.21.15.42:0/1139053029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71140d0550 0x7f71140d0960 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f7100009c10 tx=0x7f7100033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:43.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.462+0000 7f7111600640 1 -- 172.21.15.42:0/1139053029 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100038040 con 0x7f71140d0550 2024-09-17T01:45:43.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.462+0000 7f7111600640 1 -- 172.21.15.42:0/1139053029 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7100004020 con 0x7f71140d0550 2024-09-17T01:45:43.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.462+0000 7f7111600640 1 -- 172.21.15.42:0/1139053029 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100004470 con 0x7f71140d0550 2024-09-17T01:45:43.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.462+0000 7f711b000640 1 -- 172.21.15.42:0/1139053029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f711415af80 con 0x7f71140d0550 2024-09-17T01:45:43.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.462+0000 7f711b000640 1 -- 172.21.15.42:0/1139053029 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71141f95a0 con 0x7f71140d0550 2024-09-17T01:45:43.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.465+0000 7f7111600640 1 -- 172.21.15.42:0/1139053029 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7100045020 con 0x7f71140d0550 2024-09-17T01:45:43.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.466+0000 7f7111600640 1 --2- 172.21.15.42:0/1139053029 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f70f4078b90 0x7f70f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:43.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.466+0000 7f7111600640 1 -- 172.21.15.42:0/1139053029 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5709+0+0 (secure 0 0 0) 0x7f71000bb6a0 con 0x7f71140d0550 2024-09-17T01:45:43.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.466+0000 7f7123837740 1 Processor -- start 2024-09-17T01:45:43.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.466+0000 7f7123837740 1 -- start start 2024-09-17T01:45:43.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.466+0000 7f7119c00640 1 --2- 172.21.15.42:0/1139053029 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f70f4078b90 0x7f70f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:43.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.467+0000 7f7119c00640 1 --2- 172.21.15.42:0/1139053029 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f70f4078b90 0x7f70f407b0a0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f71140b0060 tx=0x7f7108006040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:43.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.467+0000 7f7123837740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e451251270 0x55e451621b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:43.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.468+0000 7f7123837740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e4512283b0 0x55e4516220a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:43.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.468+0000 7f7123837740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e451230590 0x55e4515f2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:43.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.468+0000 7f7123837740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e45157b430 con 0x55e451230590 2024-09-17T01:45:43.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.468+0000 7f7123837740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e45156b5d0 con 0x55e451251270 2024-09-17T01:45:43.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.468+0000 7f7123837740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55e45155aa00 con 0x55e4512283b0 2024-09-17T01:45:43.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.468+0000 7f711a600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e451230590 0x55e4515f2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:43.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.468+0000 7f711a600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e451230590 0x55e4515f2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49576/0 (socket says 172.21.15.42:49576) 2024-09-17T01:45:43.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.468+0000 7f711a600640 1 -- 172.21.15.42:0/4057213836 learned_addr learned my addr 172.21.15.42:0/4057213836 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:43.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.468+0000 7f7119c00640 1 --2- 172.21.15.42:0/4057213836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e451251270 0x55e451621b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:43.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.468+0000 7f7119200640 1 --2- 172.21.15.42:0/4057213836 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e4512283b0 0x55e4516220a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:43.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.468+0000 7f711a600640 1 -- 172.21.15.42:0/4057213836 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e4512283b0 msgr2=0x55e4516220a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:45:43.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.468+0000 7f711a600640 1 --2- 172.21.15.42:0/4057213836 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e4512283b0 0x55e4516220a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.468+0000 7f711a600640 1 -- 172.21.15.42:0/4057213836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e451251270 msgr2=0x55e451621b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:45:43.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.468+0000 7f711a600640 1 --2- 172.21.15.42:0/4057213836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e451251270 0x55e451621b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.468+0000 7f711a600640 1 -- 172.21.15.42:0/4057213836 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e451523520 con 0x55e451230590 2024-09-17T01:45:43.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.468+0000 7f7119200640 1 --2- 172.21.15.42:0/4057213836 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e4512283b0 0x55e4516220a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:45:43.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.469+0000 7f711a600640 1 --2- 172.21.15.42:0/4057213836 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e451230590 0x55e4515f2150 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f71140b4e90 tx=0x7f710c0065e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ca91d8d731f1b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:43.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.469+0000 7f7106000640 1 -- 172.21.15.42:0/4057213836 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c011b20 con 0x55e451230590 2024-09-17T01:45:43.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.469+0000 7f7106000640 1 -- 172.21.15.42:0/4057213836 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f710c016070 con 0x55e451230590 2024-09-17T01:45:43.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.469+0000 7f7106000640 1 -- 172.21.15.42:0/4057213836 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c012440 con 0x55e451230590 2024-09-17T01:45:43.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.470+0000 7f7123837740 1 -- 172.21.15.42:0/4057213836 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e451230590 msgr2=0x55e4515f2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:43.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.470+0000 7f7123837740 1 --2- 172.21.15.42:0/4057213836 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e451230590 0x55e4515f2150 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f71140b4e90 tx=0x7f710c0065e0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.470+0000 7f7123837740 1 -- 172.21.15.42:0/4057213836 shutdown_connections 2024-09-17T01:45:43.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.470+0000 7f7123837740 1 --2- 172.21.15.42:0/4057213836 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e451230590 0x55e4515f2150 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.470+0000 7f7123837740 1 --2- 172.21.15.42:0/4057213836 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e4512283b0 0x55e4516220a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.470+0000 7f7123837740 1 --2- 172.21.15.42:0/4057213836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e451251270 0x55e451621b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.470+0000 7f7123837740 1 -- 172.21.15.42:0/4057213836 >> 172.21.15.42:0/4057213836 conn(0x55e4512453c0 msgr2=0x55e4515f7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:43.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.470+0000 7f7123837740 1 -- 172.21.15.42:0/4057213836 shutdown_connections 2024-09-17T01:45:43.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.470+0000 7f7123837740 1 -- 172.21.15.42:0/4057213836 wait complete. 2024-09-17T01:45:43.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.471+0000 7f7123837740 1 -- start start 2024-09-17T01:45:43.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.471+0000 7f7123837740 1 Processor -- start 2024-09-17T01:45:43.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.473+0000 7f7123837740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4512283b0 0x55e45164fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:43.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.473+0000 7f7123837740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e451230590 0x55e45164b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:43.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.473+0000 7f7123837740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e451251270 0x55e45163d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:43.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.473+0000 7f7123837740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e451501330 con 0x55e4512283b0 2024-09-17T01:45:43.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.473+0000 7f7123837740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e45155e810 con 0x55e451251270 2024-09-17T01:45:43.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.473+0000 7f7123837740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55e4512cb620 con 0x55e451230590 2024-09-17T01:45:43.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.473+0000 7f7123837740 10 client.0 _ll_register_callbacks cb 0x55e451506420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:45:43.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.473+0000 7f7119c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4512283b0 0x55e45164fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:43.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.473+0000 7f7119c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4512283b0 0x55e45164fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49580/0 (socket says 172.21.15.42:49580) 2024-09-17T01:45:43.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.473+0000 7f7119c00640 1 -- 172.21.15.42:0/3120869605 learned_addr learned my addr 172.21.15.42:0/3120869605 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:43.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.473+0000 7f7119200640 1 --2- 172.21.15.42:0/3120869605 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e451230590 0x55e45164b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:43.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.473+0000 7f711a600640 1 --2- 172.21.15.42:0/3120869605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e451251270 0x55e45163d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:43.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.473+0000 7f7119c00640 1 -- 172.21.15.42:0/3120869605 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e451230590 msgr2=0x55e45164b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:45:43.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.473+0000 7f7119c00640 1 --2- 172.21.15.42:0/3120869605 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e451230590 0x55e45164b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.473+0000 7f7119c00640 1 -- 172.21.15.42:0/3120869605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e451251270 msgr2=0x55e45163d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:45:43.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.473+0000 7f7119c00640 1 --2- 172.21.15.42:0/3120869605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e451251270 0x55e45163d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.473+0000 7f7119c00640 1 -- 172.21.15.42:0/3120869605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4512bc850 con 0x55e4512283b0 2024-09-17T01:45:43.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.473+0000 7f711a600640 1 --2- 172.21.15.42:0/3120869605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e451251270 0x55e45163d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:45:43.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.474+0000 7f7119c00640 1 --2- 172.21.15.42:0/3120869605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4512283b0 0x55e45164fcb0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f7108011fa0 tx=0x7f711415c160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa5db0f650a71db4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:43.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.474+0000 7f70faa00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:45:43.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.474+0000 7f70faa00640 1 -- 172.21.15.42:0/3120869605 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710801e630 con 0x55e4512283b0 2024-09-17T01:45:43.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.474+0000 7f70faa00640 1 -- 172.21.15.42:0/3120869605 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(174..174 src has 1..174) ==== 5709+0+0 (secure 0 0 0) 0x7f710801e7d0 con 0x55e4512283b0 2024-09-17T01:45:43.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.474+0000 7f7123837740 1 -- 172.21.15.42:0/3120869605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f710c016070 con 0x55e4512283b0 2024-09-17T01:45:43.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.474+0000 7f70faa00640 1 -- 172.21.15.42:0/3120869605 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=139) ==== 24+0+0 (secure 0 0 0) 0x7f710802f050 con 0x55e4512283b0 2024-09-17T01:45:43.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.474+0000 7f7123837740 10 client.10089 fetch_fsmap learned FSMap version 139 2024-09-17T01:45:43.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.474+0000 7f7123837740 1 -- 172.21.15.42:0/3120869605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=139,monmap=2+}) -- 0x55e4513336b0 con 0x55e4512283b0 2024-09-17T01:45:43.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.475+0000 7f70faa00640 1 -- 172.21.15.42:0/3120869605 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f710c016070 con 0x55e4512283b0 2024-09-17T01:45:43.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.475+0000 7f70faa00640 1 -- 172.21.15.42:0/3120869605 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 139) ==== 3502+0+0 (secure 0 0 0) 0x7f7108032020 con 0x55e4512283b0 2024-09-17T01:45:43.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.475+0000 7f7123837740 10 client.10089 fetch_fsmap finished waiting for FSMap version 139 2024-09-17T01:45:43.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.475+0000 7f7123837740 10 client.10089 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T01:45:43.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.475+0000 7f7123837740 20 client.10089 populate_metadata read hostname 'smithi042' 2024-09-17T01:45:43.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.475+0000 7f7123837740 1 --2- 172.21.15.42:0/3120869605 >> [v2:172.21.15.42:6834/2353432649,v1:172.21.15.42:6835/2353432649] conn(0x55e45120fe40 0x55e45161d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:43.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.475+0000 7f7123837740 4 client.10089 mds_command: new command op to 9969 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:45:43.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.475+0000 7f7123837740 1 -- 172.21.15.42:0/3120869605 --> [v2:172.21.15.42:6834/2353432649,v1:172.21.15.42:6835/2353432649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e45156d520 con 0x55e45120fe40 2024-09-17T01:45:43.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.475+0000 7f7119200640 1 --2- 172.21.15.42:0/3120869605 >> [v2:172.21.15.42:6834/2353432649,v1:172.21.15.42:6835/2353432649] conn(0x55e45120fe40 0x55e45161d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:43.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.476+0000 7f7119200640 1 --2- 172.21.15.42:0/3120869605 >> [v2:172.21.15.42:6834/2353432649,v1:172.21.15.42:6835/2353432649] conn(0x55e45120fe40 0x55e45161d750 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f54920eb530fba9 server_cookie=9fba79e118480f12 in_seq=0 out_seq=0 2024-09-17T01:45:43.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.476+0000 7f70faa00640 10 client.10089 ms_handle_connect on v2:172.21.15.42:6834/2353432649 2024-09-17T01:45:43.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.477+0000 7f70faa00640 1 -- 172.21.15.42:0/3120869605 <== mds.0 v2:172.21.15.42:6834/2353432649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e45156d520 con 0x55e45120fe40 2024-09-17T01:45:43.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.477+0000 7f70faa00640 10 client.10089 handle_command_reply: tid=0 2024-09-17T01:45:43.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.477+0000 7f7123837740 1 client.10089 shutdown 2024-09-17T01:45:43.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.477+0000 7f7123837740 1 -- 172.21.15.42:0/3120869605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4512283b0 msgr2=0x55e45164fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:43.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.477+0000 7f7123837740 1 --2- 172.21.15.42:0/3120869605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4512283b0 0x55e45164fcb0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f7108011fa0 tx=0x7f711415c160 comp rx=0 tx=0).stop 2024-09-17T01:45:43.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.477+0000 7f7123837740 1 -- 172.21.15.42:0/3120869605 shutdown_connections 2024-09-17T01:45:43.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.477+0000 7f7123837740 1 --2- 172.21.15.42:0/3120869605 >> [v2:172.21.15.42:6834/2353432649,v1:172.21.15.42:6835/2353432649] conn(0x55e45120fe40 0x55e45161d750 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.477+0000 7f7123837740 1 --2- 172.21.15.42:0/3120869605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e451251270 0x55e45163d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.477+0000 7f7123837740 1 --2- 172.21.15.42:0/3120869605 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e451230590 0x55e45164b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.477+0000 7f70faa00640 0 client.10089 ms_handle_reset on v2:172.21.15.42:6834/2353432649 2024-09-17T01:45:43.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.477+0000 7f7123837740 1 --2- 172.21.15.42:0/3120869605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e4512283b0 0x55e45164fcb0 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.477+0000 7f7123837740 1 -- 172.21.15.42:0/3120869605 >> 172.21.15.42:0/3120869605 conn(0x55e4512453c0 msgr2=0x55e45163f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:43.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.477+0000 7f7123837740 1 -- 172.21.15.42:0/3120869605 shutdown_connections 2024-09-17T01:45:43.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.477+0000 7f7123837740 1 -- 172.21.15.42:0/3120869605 wait complete. 2024-09-17T01:45:43.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.477+0000 7f7123837740 20 client.10089 trim_cache size 0 max 16384 2024-09-17T01:45:43.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.497+0000 7f7123837740 1 Processor -- start 2024-09-17T01:45:43.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.497+0000 7f7123837740 1 -- start start 2024-09-17T01:45:43.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.498+0000 7f7123837740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e4512283b0 0x55e45163d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:43.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.498+0000 7f7123837740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e451230590 0x55e45165f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:43.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.498+0000 7f7123837740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e451251270 0x55e45165fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:43.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.498+0000 7f7123837740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7114073480 con 0x55e451251270 2024-09-17T01:45:43.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.498+0000 7f7123837740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f71141473d0 con 0x55e451230590 2024-09-17T01:45:43.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.498+0000 7f7123837740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7114072e30 con 0x55e4512283b0 2024-09-17T01:45:43.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.499+0000 7f711a600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e451251270 0x55e45165fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:43.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.499+0000 7f711a600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e451251270 0x55e45165fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49590/0 (socket says 172.21.15.42:49590) 2024-09-17T01:45:43.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.499+0000 7f711a600640 1 -- 172.21.15.42:0/4039586711 learned_addr learned my addr 172.21.15.42:0/4039586711 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:43.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.499+0000 7f7119c00640 1 --2- 172.21.15.42:0/4039586711 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e4512283b0 0x55e45163d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:43.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.499+0000 7f7119200640 1 --2- 172.21.15.42:0/4039586711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e451230590 0x55e45165f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:43.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.499+0000 7f711a600640 1 -- 172.21.15.42:0/4039586711 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e4512283b0 msgr2=0x55e45163d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:45:43.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.499+0000 7f711a600640 1 --2- 172.21.15.42:0/4039586711 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e4512283b0 0x55e45163d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.499+0000 7f711a600640 1 -- 172.21.15.42:0/4039586711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e451230590 msgr2=0x55e45165f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:45:43.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.499+0000 7f711a600640 1 --2- 172.21.15.42:0/4039586711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e451230590 0x55e45165f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.499+0000 7f711a600640 1 -- 172.21.15.42:0/4039586711 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e45155ab80 con 0x55e451251270 2024-09-17T01:45:43.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.499+0000 7f7119c00640 1 --2- 172.21.15.42:0/4039586711 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e4512283b0 0x55e45163d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:45:43.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.499+0000 7f7119200640 1 --2- 172.21.15.42:0/4039586711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e451230590 0x55e45165f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:45:43.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.499+0000 7f711a600640 1 --2- 172.21.15.42:0/4039586711 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e451251270 0x55e45165fca0 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f71140705c0 tx=0x7f710c001510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74be5414240c49c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:43.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.500+0000 7f7105600640 1 -- 172.21.15.42:0/4039586711 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c004d20 con 0x55e451251270 2024-09-17T01:45:43.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.500+0000 7f7105600640 1 -- 172.21.15.42:0/4039586711 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f710c016040 con 0x55e451251270 2024-09-17T01:45:43.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.500+0000 7f7105600640 1 -- 172.21.15.42:0/4039586711 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c011920 con 0x55e451251270 2024-09-17T01:45:43.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.500+0000 7f7123837740 1 -- 172.21.15.42:0/4039586711 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e451251270 msgr2=0x55e45165fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:43.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.500+0000 7f7123837740 1 --2- 172.21.15.42:0/4039586711 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e451251270 0x55e45165fca0 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f71140705c0 tx=0x7f710c001510 comp rx=0 tx=0).stop 2024-09-17T01:45:43.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.500+0000 7f7123837740 1 -- 172.21.15.42:0/4039586711 shutdown_connections 2024-09-17T01:45:43.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.500+0000 7f7123837740 1 --2- 172.21.15.42:0/4039586711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e451230590 0x55e45165f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.500+0000 7f7123837740 1 --2- 172.21.15.42:0/4039586711 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e451251270 0x55e45165fca0 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.500+0000 7f7123837740 1 --2- 172.21.15.42:0/4039586711 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e4512283b0 0x55e45163d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.500+0000 7f7123837740 1 -- 172.21.15.42:0/4039586711 >> 172.21.15.42:0/4039586711 conn(0x55e4512453c0 msgr2=0x55e4516377b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:43.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.501+0000 7f7123837740 1 -- 172.21.15.42:0/4039586711 shutdown_connections 2024-09-17T01:45:43.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.501+0000 7f7123837740 1 -- 172.21.15.42:0/4039586711 wait complete. 2024-09-17T01:45:43.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.501+0000 7f7123837740 1 -- start start 2024-09-17T01:45:43.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.502+0000 7f7123837740 1 Processor -- start 2024-09-17T01:45:43.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.503+0000 7f7123837740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4512283b0 0x55e451651c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:43.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.503+0000 7f7123837740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e451230590 0x55e45164c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:43.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.503+0000 7f7123837740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e451251270 0x55e45164c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:43.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.503+0000 7f7123837740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e45161ad50 con 0x55e451251270 2024-09-17T01:45:43.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.503+0000 7f7123837740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e45161e5f0 con 0x55e4512283b0 2024-09-17T01:45:43.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.503+0000 7f7123837740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55e45161b310 con 0x55e451230590 2024-09-17T01:45:43.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.503+0000 7f7123837740 10 client.0 _ll_register_callbacks cb 0x7f7108011c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:45:43.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.503+0000 7f711a600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e451251270 0x55e45164c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:43.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.503+0000 7f711a600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e451251270 0x55e45164c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49596/0 (socket says 172.21.15.42:49596) 2024-09-17T01:45:43.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.503+0000 7f711a600640 1 -- 172.21.15.42:0/71110934 learned_addr learned my addr 172.21.15.42:0/71110934 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:43.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.504+0000 7f7119200640 1 --2- 172.21.15.42:0/71110934 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e451230590 0x55e45164c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:43.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.504+0000 7f7119c00640 1 --2- 172.21.15.42:0/71110934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4512283b0 0x55e451651c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:43.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.504+0000 7f711a600640 1 -- 172.21.15.42:0/71110934 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e451230590 msgr2=0x55e45164c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:45:43.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.504+0000 7f711a600640 1 --2- 172.21.15.42:0/71110934 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e451230590 0x55e45164c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.504+0000 7f711a600640 1 -- 172.21.15.42:0/71110934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4512283b0 msgr2=0x55e451651c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:45:43.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.504+0000 7f711a600640 1 --2- 172.21.15.42:0/71110934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4512283b0 0x55e451651c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.504+0000 7f711a600640 1 -- 172.21.15.42:0/71110934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e451622300 con 0x55e451251270 2024-09-17T01:45:43.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.504+0000 7f711a600640 1 --2- 172.21.15.42:0/71110934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e451251270 0x55e45164c700 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f710c000f80 tx=0x7f710c011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d063bd68c6c4e199 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:43.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.504+0000 7f70faa00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:45:43.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.504+0000 7f70faa00640 1 -- 172.21.15.42:0/71110934 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710c031060 con 0x55e451251270 2024-09-17T01:45:43.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.504+0000 7f70faa00640 1 -- 172.21.15.42:0/71110934 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(174..174 src has 1..174) ==== 5709+0+0 (secure 0 0 0) 0x7f710c012440 con 0x55e451251270 2024-09-17T01:45:43.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.504+0000 7f7123837740 1 -- 172.21.15.42:0/71110934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f710c016040 con 0x55e451251270 2024-09-17T01:45:43.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.505+0000 7f70faa00640 1 -- 172.21.15.42:0/71110934 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=139) ==== 24+0+0 (secure 0 0 0) 0x7f710c037050 con 0x55e451251270 2024-09-17T01:45:43.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.505+0000 7f7123837740 10 client.10095 fetch_fsmap learned FSMap version 139 2024-09-17T01:45:43.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.505+0000 7f7123837740 1 -- 172.21.15.42:0/71110934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=139,monmap=2+}) -- 0x55e451637f00 con 0x55e451251270 2024-09-17T01:45:43.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.505+0000 7f70faa00640 1 -- 172.21.15.42:0/71110934 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f710c016040 con 0x55e451251270 2024-09-17T01:45:43.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.505+0000 7f70faa00640 1 -- 172.21.15.42:0/71110934 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 139) ==== 3502+0+0 (secure 0 0 0) 0x7f710c03a020 con 0x55e451251270 2024-09-17T01:45:43.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.505+0000 7f7123837740 10 client.10095 fetch_fsmap finished waiting for FSMap version 139 2024-09-17T01:45:43.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.505+0000 7f7123837740 10 client.10095 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T01:45:43.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.505+0000 7f7123837740 20 client.10095 populate_metadata read hostname 'smithi042' 2024-09-17T01:45:43.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.505+0000 7f7123837740 1 --2- 172.21.15.42:0/71110934 >> [v2:172.21.15.42:6834/2353432649,v1:172.21.15.42:6835/2353432649] conn(0x55e4516bc690 0x55e4516bf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:43.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.505+0000 7f7123837740 4 client.10095 mds_command: new command op to 9969 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T01:45:43.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.505+0000 7f7123837740 1 -- 172.21.15.42:0/71110934 --> [v2:172.21.15.42:6834/2353432649,v1:172.21.15.42:6835/2353432649] -- command(tid 0: {"prefix": "status"}) -- 0x55e451568fd0 con 0x55e4516bc690 2024-09-17T01:45:43.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.506+0000 7f7119c00640 1 --2- 172.21.15.42:0/71110934 >> [v2:172.21.15.42:6834/2353432649,v1:172.21.15.42:6835/2353432649] conn(0x55e4516bc690 0x55e4516bf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:43.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.506+0000 7f7119c00640 1 --2- 172.21.15.42:0/71110934 >> [v2:172.21.15.42:6834/2353432649,v1:172.21.15.42:6835/2353432649] conn(0x55e4516bc690 0x55e4516bf4b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2b708c7526964ad server_cookie=ea5b3ecdef875413 in_seq=0 out_seq=0 2024-09-17T01:45:43.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.506+0000 7f70faa00640 10 client.10095 ms_handle_connect on v2:172.21.15.42:6834/2353432649 2024-09-17T01:45:43.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.507+0000 7f70faa00640 1 -- 172.21.15.42:0/71110934 <== mds.0 v2:172.21.15.42:6834/2353432649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x55e451568fd0 con 0x55e4516bc690 2024-09-17T01:45:43.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.507+0000 7f70faa00640 10 client.10095 handle_command_reply: tid=0 2024-09-17T01:45:43.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.507+0000 7f7123837740 1 client.10095 shutdown 2024-09-17T01:45:43.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.507+0000 7f7123837740 1 -- 172.21.15.42:0/71110934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e451251270 msgr2=0x55e45164c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:43.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.507+0000 7f7123837740 1 --2- 172.21.15.42:0/71110934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e451251270 0x55e45164c700 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f710c000f80 tx=0x7f710c011db0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.507+0000 7f7123837740 1 -- 172.21.15.42:0/71110934 shutdown_connections 2024-09-17T01:45:43.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.507+0000 7f7123837740 1 --2- 172.21.15.42:0/71110934 >> [v2:172.21.15.42:6834/2353432649,v1:172.21.15.42:6835/2353432649] conn(0x55e4516bc690 0x55e4516bf4b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.507+0000 7f7123837740 1 --2- 172.21.15.42:0/71110934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e451251270 0x55e45164c700 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.507+0000 7f7123837740 1 --2- 172.21.15.42:0/71110934 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e451230590 0x55e45164c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.507+0000 7f7123837740 1 --2- 172.21.15.42:0/71110934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e4512283b0 0x55e451651c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.507+0000 7f70faa00640 0 client.10095 ms_handle_reset on v2:172.21.15.42:6834/2353432649 2024-09-17T01:45:43.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.507+0000 7f7123837740 1 -- 172.21.15.42:0/71110934 >> 172.21.15.42:0/71110934 conn(0x55e4512453c0 msgr2=0x55e4515f79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:43.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.507+0000 7f7123837740 1 -- 172.21.15.42:0/71110934 shutdown_connections 2024-09-17T01:45:43.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.507+0000 7f7123837740 1 -- 172.21.15.42:0/71110934 wait complete. 2024-09-17T01:45:43.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.507+0000 7f7123837740 20 client.10095 trim_cache size 0 max 16384 2024-09-17T01:45:43.510 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:45:43.510 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "fea1c88c-cb05-432f-a745-f9dcbb5f2503", 2024-09-17T01:45:43.510 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-17T01:45:43.510 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 9969, 2024-09-17T01:45:43.510 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-17T01:45:43.510 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-17T01:45:43.511 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-17T01:45:43.511 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 6.7718864480000001, 2024-09-17T01:45:43.511 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 139, 2024-09-17T01:45:43.511 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 174, 2024-09-17T01:45:43.511 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 174, 2024-09-17T01:45:43.511 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 18.772540672000002 2024-09-17T01:45:43.511 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:45:43.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.508+0000 7f711b000640 1 -- 172.21.15.42:0/1139053029 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f70f4078b90 msgr2=0x7f70f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:43.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.508+0000 7f711b000640 1 --2- 172.21.15.42:0/1139053029 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f70f4078b90 0x7f70f407b0a0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f71140b0060 tx=0x7f7108006040 comp rx=0 tx=0).stop 2024-09-17T01:45:43.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.508+0000 7f711b000640 1 -- 172.21.15.42:0/1139053029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71140d0550 msgr2=0x7f71140d0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:43.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.508+0000 7f711b000640 1 --2- 172.21.15.42:0/1139053029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71140d0550 0x7f71140d0960 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f7100009c10 tx=0x7f7100033670 comp rx=0 tx=0).stop 2024-09-17T01:45:43.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.508+0000 7f711b000640 1 -- 172.21.15.42:0/1139053029 shutdown_connections 2024-09-17T01:45:43.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.508+0000 7f711b000640 1 --2- 172.21.15.42:0/1139053029 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f70f4078b90 0x7f70f407b0a0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.508+0000 7f711b000640 1 --2- 172.21.15.42:0/1139053029 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f711415a630 0x7f711415aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.508+0000 7f711b000640 1 --2- 172.21.15.42:0/1139053029 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71140d0550 0x7f71140d0960 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.508+0000 7f711b000640 1 --2- 172.21.15.42:0/1139053029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70fc004000 0x7f7114153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.508+0000 7f711b000640 1 -- 172.21.15.42:0/1139053029 >> 172.21.15.42:0/1139053029 conn(0x7f711406d890 msgr2=0x7f71140b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:43.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.508+0000 7f711b000640 1 -- 172.21.15.42:0/1139053029 shutdown_connections 2024-09-17T01:45:43.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.508+0000 7f711b000640 1 -- 172.21.15.42:0/1139053029 wait complete. 2024-09-17T01:45:43.532 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T01:45:43.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.761+0000 7f0823200640 1 -- 172.21.15.42:0/940606279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f081c0af460 msgr2=0x7f081c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:43.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.761+0000 7f0823200640 1 --2- 172.21.15.42:0/940606279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f081c0af460 0x7f081c06d260 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f081c0b2e60 tx=0x7f080c02a5f0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.761+0000 7f0823200640 1 -- 172.21.15.42:0/940606279 shutdown_connections 2024-09-17T01:45:43.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.761+0000 7f0823200640 1 --2- 172.21.15.42:0/940606279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f081c0af460 0x7f081c06d260 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.761+0000 7f0823200640 1 --2- 172.21.15.42:0/940606279 >> v2:172.21.15.43:3300/0 conn(0x7f081c0d0d80 0x7f081c06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.761+0000 7f0823200640 1 -- 172.21.15.42:0/940606279 >> 172.21.15.42:0/940606279 conn(0x7f081c0b25f0 msgr2=0x7f081c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:43.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.761+0000 7f0823200640 1 -- 172.21.15.42:0/940606279 shutdown_connections 2024-09-17T01:45:43.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.761+0000 7f0823200640 1 -- 172.21.15.42:0/940606279 wait complete. 2024-09-17T01:45:43.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.763+0000 7f0823200640 1 Processor -- start 2024-09-17T01:45:43.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.763+0000 7f0823200640 1 -- start start 2024-09-17T01:45:43.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.765+0000 7f0823200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f081c0af460 0x7f081c1585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:43.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.765+0000 7f0823200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f081c0c9420 0x7f081c15d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:43.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.765+0000 7f0823200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f081c0d0d80 0x7f081c15da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:43.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.765+0000 7f0823200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f081c15eb80 con 0x7f081c0af460 2024-09-17T01:45:43.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.765+0000 7f0823200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f081c15ea00 con 0x7f081c0c9420 2024-09-17T01:45:43.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.765+0000 7f0823200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f081c0c9f40 con 0x7f081c0d0d80 2024-09-17T01:45:43.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.765+0000 7f0821e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f081c0af460 0x7f081c1585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:43.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.765+0000 7f0821e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f081c0af460 0x7f081c1585c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49618/0 (socket says 172.21.15.42:49618) 2024-09-17T01:45:43.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.765+0000 7f0821e00640 1 -- 172.21.15.42:0/337301756 learned_addr learned my addr 172.21.15.42:0/337301756 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:45:43.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.765+0000 7f0821400640 1 --2- 172.21.15.42:0/337301756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f081c0c9420 0x7f081c15d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:43.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.765+0000 7f0822800640 1 --2- 172.21.15.42:0/337301756 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f081c0d0d80 0x7f081c15da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:43.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.765+0000 7f0821e00640 1 -- 172.21.15.42:0/337301756 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f081c0d0d80 msgr2=0x7f081c15da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:43.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.765+0000 7f0821e00640 1 --2- 172.21.15.42:0/337301756 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f081c0d0d80 0x7f081c15da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.765+0000 7f0821e00640 1 -- 172.21.15.42:0/337301756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f081c0c9420 msgr2=0x7f081c15d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:43.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.765+0000 7f0821e00640 1 --2- 172.21.15.42:0/337301756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f081c0c9420 0x7f081c15d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:43.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.765+0000 7f0821e00640 1 -- 172.21.15.42:0/337301756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f081c070220 con 0x7f081c0af460 2024-09-17T01:45:43.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.765+0000 7f0822800640 1 --2- 172.21.15.42:0/337301756 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f081c0d0d80 0x7f081c15da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:45:43.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.766+0000 7f0821400640 1 --2- 172.21.15.42:0/337301756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f081c0c9420 0x7f081c15d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:45:43.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.766+0000 7f0821e00640 1 --2- 172.21.15.42:0/337301756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f081c0af460 0x7f081c1585c0 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f081000d7a0 tx=0x7f081000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:43.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.766+0000 7f0816000640 1 -- 172.21.15.42:0/337301756 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0810017070 con 0x7f081c0af460 2024-09-17T01:45:43.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.766+0000 7f0816000640 1 -- 172.21.15.42:0/337301756 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0810004310 con 0x7f081c0af460 2024-09-17T01:45:43.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.766+0000 7f0816000640 1 -- 172.21.15.42:0/337301756 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0810009c30 con 0x7f081c0af460 2024-09-17T01:45:43.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.766+0000 7f0823200640 1 -- 172.21.15.42:0/337301756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f081c1f8b20 con 0x7f081c0af460 2024-09-17T01:45:43.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.766+0000 7f0823200640 1 -- 172.21.15.42:0/337301756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f081c1f90e0 con 0x7f081c0af460 2024-09-17T01:45:43.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.767+0000 7f0823200640 1 -- 172.21.15.42:0/337301756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f081c0c9830 con 0x7f081c0af460 2024-09-17T01:45:43.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.769+0000 7f0816000640 1 -- 172.21.15.42:0/337301756 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0810005020 con 0x7f081c0af460 2024-09-17T01:45:43.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.770+0000 7f0816000640 1 --2- 172.21.15.42:0/337301756 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0800078bc0 0x7f080007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:43.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.770+0000 7f0816000640 1 -- 172.21.15.42:0/337301756 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5709+0+0 (secure 0 0 0) 0x7f081009b0b0 con 0x7f081c0af460 2024-09-17T01:45:43.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.771+0000 7f0821400640 1 --2- 172.21.15.42:0/337301756 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0800078bc0 0x7f080007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:43.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.771+0000 7f0821400640 1 --2- 172.21.15.42:0/337301756 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0800078bc0 0x7f080007b0d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f080c033000 tx=0x7f080c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:43.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:43.775+0000 7f0816000640 1 -- 172.21.15.42:0/337301756 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0810020020 con 0x7f081c0af460 2024-09-17T01:45:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:44.005+0000 7f0823200640 1 -- 172.21.15.42:0/337301756 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f081c074bc0 con 0x7f081c0af460 2024-09-17T01:45:44.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:44.005+0000 7f0816000640 1 -- 172.21.15.42:0/337301756 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v139) ==== 53+0+73 (secure 0 0 0) 0x7f08100634e0 con 0x7f081c0af460 2024-09-17T01:45:44.005 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T01:45:44.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:44.008+0000 7f0823200640 1 -- 172.21.15.42:0/337301756 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0800078bc0 msgr2=0x7f080007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:44.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:44.008+0000 7f0823200640 1 --2- 172.21.15.42:0/337301756 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0800078bc0 0x7f080007b0d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f080c033000 tx=0x7f080c004730 comp rx=0 tx=0).stop 2024-09-17T01:45:44.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:44.008+0000 7f0823200640 1 -- 172.21.15.42:0/337301756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f081c0af460 msgr2=0x7f081c1585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:44.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:44.008+0000 7f0823200640 1 --2- 172.21.15.42:0/337301756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f081c0af460 0x7f081c1585c0 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f081000d7a0 tx=0x7f081000dc60 comp rx=0 tx=0).stop 2024-09-17T01:45:44.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:44.008+0000 7f0823200640 1 -- 172.21.15.42:0/337301756 shutdown_connections 2024-09-17T01:45:44.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:44.008+0000 7f0823200640 1 --2- 172.21.15.42:0/337301756 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0800078bc0 0x7f080007b0d0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:44.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:44.008+0000 7f0823200640 1 --2- 172.21.15.42:0/337301756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f081c0c9420 0x7f081c15d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:44.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:44.008+0000 7f0823200640 1 --2- 172.21.15.42:0/337301756 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f081c0d0d80 0x7f081c15da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:44.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:44.008+0000 7f0823200640 1 --2- 172.21.15.42:0/337301756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f081c0af460 0x7f081c1585c0 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:44.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:44.008+0000 7f0823200640 1 -- 172.21.15.42:0/337301756 >> 172.21.15.42:0/337301756 conn(0x7f081c0b25f0 msgr2=0x7f081c0b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:44.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:44.008+0000 7f0823200640 1 -- 172.21.15.42:0/337301756 shutdown_connections 2024-09-17T01:45:44.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:44.008+0000 7f0823200640 1 -- 172.21.15.42:0/337301756 wait complete. 2024-09-17T01:45:44.029 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T01:45:44.029 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:45:44.029 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-09-17T01:45:44.030 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T01:45:44.030 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:45:44.030 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T01:45:44.030 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T01:45:44.030 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:45:44.030 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:45:44.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:45:44.030 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-09-17T01:45:44.066 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:45:44.066 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:45:44.066 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:45:44.066 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:45:44.066 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-17T01:45:44.066 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:45:44.066 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:45:44.067 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-09-17T01:45:44.067 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-09-17T01:45:44.067 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:45:44.067 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-09-17T01:45:44.067 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-09-17T01:45:44.067 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:45:44.067 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:45:44.067 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-09-17T01:45:44.067 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-17T01:45:44.067 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 41864sec preferred_lft 41864sec 2024-09-17T01:45:44.067 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-17T01:45:44.067 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:45:44.067 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:45:44.068 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:45:44.068 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-09-17T01:45:44.068 INFO:teuthology.orchestra.run.smithi042.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T01:45:44.068 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T01:45:44.068 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T01:45:44.068 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:45:44.068 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::68d2:2bff:fe2f:191a/64 scope link 2024-09-17T01:45:44.068 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:45:44.068 INFO:teuthology.orchestra.run.smithi042.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:45:44.068 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether e2:73:3e:9b:8a:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:45:44.068 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::e073:3eff:fe9b:8a00/64 scope link 2024-09-17T01:45:44.068 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:45:44.068 INFO:teuthology.orchestra.run.smithi042.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:45:44.069 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T01:45:44.069 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::240b:bfff:feb7:6e5b/64 scope link 2024-09-17T01:45:44.069 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:45:44.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:45:44.069 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:45:44.161 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-17T01:45:44.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:45:44.165 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-09-17T01:45:44.201 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-09-17T01:45:44.201 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:45:44.202 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-17T01:45:44.202 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-17T01:45:44.202 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:45:44.202 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:45:44.202 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:45:44.202 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T01:45:44.202 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T01:45:44.202 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T01:45:44.202 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:45:44.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:45:44.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:45:44.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:45:44.400 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-17T01:45:44.437 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T01:45:44.437 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T01:45:44.437 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:45:44.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:45:44.437 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-09-17T01:45:44.532 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:45:44.533 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T01:45:44.568 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:45:44.569 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:45:44.569 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:45:44.644 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T01:45:44.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:45:44.644 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:45:44.847 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:45:44.847 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:45:44.847 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:45:44.868 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:45:44.868 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:45:44.868 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:45:44.868 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:45:44.868 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:45:44.899 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:45:44.899 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:45:44.899 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:45:44.899 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:45:44.899 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:45:44.899 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-09-17T01:45:44.899 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-09-17T01:45:44.899 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fea1c88c-cb05-432f-a745-f9dcbb5f2503" will pass to kernel 2024-09-17T01:45:44.900 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T01:45:44.900 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-09-17T01:45:44.900 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T01:45:44.900 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T01:45:44.901 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T01:45:44.903 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T01:45:44.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:45:44.903 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:45:44.960 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:45:45.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:45:45.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:45:45.057 INFO:teuthology.orchestra.run.smithi042.stdout:client9406 2024-09-17T01:45:45.057 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:45:45.057 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:45:45.093 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:45:45.093 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:45:45.093 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.0 2024-09-17T01:45:45.093 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:45:45.093 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:45:45.093 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:45:45.094 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:45:45.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:45:45.244 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.244 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.245 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163217 s, 64.2 MB/s 2024-09-17T01:45:45.264 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.265 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.265 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173217 s, 60.5 MB/s 2024-09-17T01:45:45.291 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.291 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.291 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236143 s, 44.4 MB/s 2024-09-17T01:45:45.311 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.311 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.311 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166212 s, 63.1 MB/s 2024-09-17T01:45:45.329 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.329 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.329 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148354 s, 70.7 MB/s 2024-09-17T01:45:45.353 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.353 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.353 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209873 s, 50.0 MB/s 2024-09-17T01:45:45.379 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.379 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.380 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232807 s, 45.0 MB/s 2024-09-17T01:45:45.403 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.403 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.403 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197243 s, 53.2 MB/s 2024-09-17T01:45:45.427 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.427 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.427 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210094 s, 49.9 MB/s 2024-09-17T01:45:45.443 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.444 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.444 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139387 s, 75.2 MB/s 2024-09-17T01:45:45.466 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.466 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.466 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187673 s, 55.9 MB/s 2024-09-17T01:45:45.481 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.481 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.481 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119324 s, 87.9 MB/s 2024-09-17T01:45:45.499 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.499 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.499 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153628 s, 68.3 MB/s 2024-09-17T01:45:45.516 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.516 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.516 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141944 s, 73.9 MB/s 2024-09-17T01:45:45.535 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.535 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.536 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160454 s, 65.4 MB/s 2024-09-17T01:45:45.553 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.553 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.553 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149911 s, 69.9 MB/s 2024-09-17T01:45:45.572 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.572 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.572 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015381 s, 68.2 MB/s 2024-09-17T01:45:45.590 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.590 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.590 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147605 s, 71.0 MB/s 2024-09-17T01:45:45.608 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.608 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.608 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147632 s, 71.0 MB/s 2024-09-17T01:45:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.627 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015657 s, 67.0 MB/s 2024-09-17T01:45:45.645 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.645 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.645 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151005 s, 69.4 MB/s 2024-09-17T01:45:45.664 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.664 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.664 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01525 s, 68.8 MB/s 2024-09-17T01:45:45.681 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.681 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.681 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145046 s, 72.3 MB/s 2024-09-17T01:45:45.702 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.702 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.702 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177755 s, 59.0 MB/s 2024-09-17T01:45:45.733 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.733 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.733 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274768 s, 38.2 MB/s 2024-09-17T01:45:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.752 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158196 s, 66.3 MB/s 2024-09-17T01:45:45.770 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.770 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.770 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150069 s, 69.9 MB/s 2024-09-17T01:45:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.792 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.792 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185215 s, 56.6 MB/s 2024-09-17T01:45:45.813 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.813 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.814 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018511 s, 56.6 MB/s 2024-09-17T01:45:45.831 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.831 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.831 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143341 s, 73.2 MB/s 2024-09-17T01:45:45.849 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.850 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.850 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015481 s, 67.7 MB/s 2024-09-17T01:45:45.867 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.868 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.868 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152617 s, 68.7 MB/s 2024-09-17T01:45:45.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:45:45.877 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:45:45.877 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:45:45.877 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.1 2024-09-17T01:45:45.877 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:45:45.877 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:45:45.877 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:45:45.877 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:45:45.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:45:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191127 s, 54.9 MB/s 2024-09-17T01:45:46.001 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.001 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.001 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148703 s, 70.5 MB/s 2024-09-17T01:45:46.020 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.020 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.020 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154748 s, 67.8 MB/s 2024-09-17T01:45:46.041 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.041 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.041 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179446 s, 58.4 MB/s 2024-09-17T01:45:46.062 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.062 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.063 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182499 s, 57.5 MB/s 2024-09-17T01:45:46.080 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.080 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.080 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141125 s, 74.3 MB/s 2024-09-17T01:45:46.101 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.102 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.102 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183784 s, 57.1 MB/s 2024-09-17T01:45:46.118 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.118 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.118 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136974 s, 76.6 MB/s 2024-09-17T01:45:46.140 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.140 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.140 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188946 s, 55.5 MB/s 2024-09-17T01:45:46.162 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.162 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.162 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183521 s, 57.1 MB/s 2024-09-17T01:45:46.183 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.183 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.183 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183719 s, 57.1 MB/s 2024-09-17T01:45:46.201 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.201 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.201 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148487 s, 70.6 MB/s 2024-09-17T01:45:46.219 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.219 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.219 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141719 s, 74.0 MB/s 2024-09-17T01:45:46.236 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.236 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.236 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140363 s, 74.7 MB/s 2024-09-17T01:45:46.254 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.254 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.254 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147047 s, 71.3 MB/s 2024-09-17T01:45:46.273 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.273 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.273 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162903 s, 64.4 MB/s 2024-09-17T01:45:46.295 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.295 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.295 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185967 s, 56.4 MB/s 2024-09-17T01:45:46.313 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.313 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.313 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149048 s, 70.4 MB/s 2024-09-17T01:45:46.337 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.337 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.338 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214551 s, 48.9 MB/s 2024-09-17T01:45:46.356 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.356 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.356 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152375 s, 68.8 MB/s 2024-09-17T01:45:46.379 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.380 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.380 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02012 s, 52.1 MB/s 2024-09-17T01:45:46.404 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.404 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.404 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211696 s, 49.5 MB/s 2024-09-17T01:45:46.421 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.422 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.422 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014442 s, 72.6 MB/s 2024-09-17T01:45:46.439 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.439 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.439 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144889 s, 72.4 MB/s 2024-09-17T01:45:46.457 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.457 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.457 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149634 s, 70.1 MB/s 2024-09-17T01:45:46.477 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.477 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.477 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169502 s, 61.9 MB/s 2024-09-17T01:45:46.498 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.498 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.498 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178614 s, 58.7 MB/s 2024-09-17T01:45:46.520 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.520 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.520 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195802 s, 53.6 MB/s 2024-09-17T01:45:46.537 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.537 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.537 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134828 s, 77.8 MB/s 2024-09-17T01:45:46.551 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.551 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.551 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113615 s, 92.3 MB/s 2024-09-17T01:45:46.569 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.569 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.569 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145359 s, 72.1 MB/s 2024-09-17T01:45:46.593 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.593 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.593 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211068 s, 49.7 MB/s 2024-09-17T01:45:46.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:45:46.602 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:45:46.602 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:45:46.602 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.2 2024-09-17T01:45:46.602 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:45:46.603 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:45:46.603 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:45:46.603 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:45:46.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:45:46.706 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.706 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.707 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172905 s, 60.6 MB/s 2024-09-17T01:45:46.725 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.725 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.725 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159076 s, 65.9 MB/s 2024-09-17T01:45:46.747 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.748 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.748 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191922 s, 54.6 MB/s 2024-09-17T01:45:46.761 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.761 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.761 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110711 s, 94.7 MB/s 2024-09-17T01:45:46.778 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.778 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.778 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140012 s, 74.9 MB/s 2024-09-17T01:45:46.796 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.796 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.796 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143852 s, 72.9 MB/s 2024-09-17T01:45:46.813 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.813 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.814 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145218 s, 72.2 MB/s 2024-09-17T01:45:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194992 s, 53.8 MB/s 2024-09-17T01:45:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140739 s, 74.5 MB/s 2024-09-17T01:45:46.870 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.871 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.871 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139937 s, 74.9 MB/s 2024-09-17T01:45:46.888 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.888 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.888 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140481 s, 74.6 MB/s 2024-09-17T01:45:46.908 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.908 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.908 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168426 s, 62.3 MB/s 2024-09-17T01:45:46.926 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.926 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.926 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146047 s, 71.8 MB/s 2024-09-17T01:45:46.950 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.950 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.950 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209143 s, 50.1 MB/s 2024-09-17T01:45:46.969 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.969 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.969 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162265 s, 64.6 MB/s 2024-09-17T01:45:46.988 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:46.989 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:46.989 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160419 s, 65.4 MB/s 2024-09-17T01:45:47.007 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.007 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.007 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152369 s, 68.8 MB/s 2024-09-17T01:45:47.030 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.030 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.030 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201473 s, 52.0 MB/s 2024-09-17T01:45:47.051 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.051 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.051 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179871 s, 58.3 MB/s 2024-09-17T01:45:47.069 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.069 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.069 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148267 s, 70.7 MB/s 2024-09-17T01:45:47.085 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.085 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.086 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136058 s, 77.1 MB/s 2024-09-17T01:45:47.107 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.107 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.107 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182853 s, 57.3 MB/s 2024-09-17T01:45:47.124 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.124 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.124 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142196 s, 73.7 MB/s 2024-09-17T01:45:47.143 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.143 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.144 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160005 s, 65.5 MB/s 2024-09-17T01:45:47.164 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.164 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.164 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177502 s, 59.1 MB/s 2024-09-17T01:45:47.185 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.185 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.185 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174324 s, 60.2 MB/s 2024-09-17T01:45:47.202 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.202 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.202 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140823 s, 74.5 MB/s 2024-09-17T01:45:47.225 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.225 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.226 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199006 s, 52.7 MB/s 2024-09-17T01:45:47.244 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.244 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.244 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158162 s, 66.3 MB/s 2024-09-17T01:45:47.264 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.264 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.264 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162486 s, 64.5 MB/s 2024-09-17T01:45:47.285 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.285 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.285 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183954 s, 57.0 MB/s 2024-09-17T01:45:47.303 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.303 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.303 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148787 s, 70.5 MB/s 2024-09-17T01:45:47.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:45:47.312 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:45:47.313 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:45:47.313 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.3 2024-09-17T01:45:47.313 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:45:47.313 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:45:47.313 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:45:47.313 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:45:47.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:45:47.419 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.419 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.419 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193985 s, 54.1 MB/s 2024-09-17T01:45:47.437 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.437 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.437 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146436 s, 71.6 MB/s 2024-09-17T01:45:47.454 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.454 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.454 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139852 s, 75.0 MB/s 2024-09-17T01:45:47.471 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.472 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.472 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143326 s, 73.2 MB/s 2024-09-17T01:45:47.489 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.489 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.489 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146864 s, 71.4 MB/s 2024-09-17T01:45:47.506 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.506 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.507 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139241 s, 75.3 MB/s 2024-09-17T01:45:47.523 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.524 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.524 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139766 s, 75.0 MB/s 2024-09-17T01:45:47.547 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.547 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.547 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01984 s, 52.9 MB/s 2024-09-17T01:45:47.564 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.564 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.564 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145714 s, 72.0 MB/s 2024-09-17T01:45:47.584 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.584 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.584 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165713 s, 63.3 MB/s 2024-09-17T01:45:47.601 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.601 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.602 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140702 s, 74.5 MB/s 2024-09-17T01:45:47.619 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.619 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.619 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142384 s, 73.6 MB/s 2024-09-17T01:45:47.636 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.636 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.636 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014117 s, 74.3 MB/s 2024-09-17T01:45:47.657 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.658 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.658 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181355 s, 57.8 MB/s 2024-09-17T01:45:47.675 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.675 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.675 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147669 s, 71.0 MB/s 2024-09-17T01:45:47.693 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.693 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.693 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142879 s, 73.4 MB/s 2024-09-17T01:45:47.716 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.716 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.717 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186323 s, 56.3 MB/s 2024-09-17T01:45:47.736 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.736 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.737 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018353 s, 57.1 MB/s 2024-09-17T01:45:47.753 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.754 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.754 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141305 s, 74.2 MB/s 2024-09-17T01:45:47.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.771 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014096 s, 74.4 MB/s 2024-09-17T01:45:47.795 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.795 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.795 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209401 s, 50.1 MB/s 2024-09-17T01:45:47.814 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.815 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.815 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162971 s, 64.3 MB/s 2024-09-17T01:45:47.832 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.832 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.832 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139509 s, 75.2 MB/s 2024-09-17T01:45:47.849 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.849 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.849 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138842 s, 75.5 MB/s 2024-09-17T01:45:47.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.866 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142593 s, 73.5 MB/s 2024-09-17T01:45:47.881 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.881 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.881 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116776 s, 89.8 MB/s 2024-09-17T01:45:47.899 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.900 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.900 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157985 s, 66.4 MB/s 2024-09-17T01:45:47.920 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.921 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.921 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175692 s, 59.7 MB/s 2024-09-17T01:45:47.938 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.938 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.938 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145115 s, 72.3 MB/s 2024-09-17T01:45:47.958 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.958 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.958 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166568 s, 63.0 MB/s 2024-09-17T01:45:47.974 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.975 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.975 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136398 s, 76.9 MB/s 2024-09-17T01:45:47.992 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:47.992 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:47.992 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143347 s, 73.1 MB/s 2024-09-17T01:45:47.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:45:48.001 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:45:48.001 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:45:48.001 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.4 2024-09-17T01:45:48.001 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:45:48.001 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:45:48.002 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:45:48.002 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:45:48.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:45:48.105 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.106 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.106 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181248 s, 57.9 MB/s 2024-09-17T01:45:48.124 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.125 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.125 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158013 s, 66.4 MB/s 2024-09-17T01:45:48.140 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.141 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.141 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128405 s, 81.7 MB/s 2024-09-17T01:45:48.158 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.159 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.159 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150632 s, 69.6 MB/s 2024-09-17T01:45:48.176 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.176 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.176 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013786 s, 76.1 MB/s 2024-09-17T01:45:48.193 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.193 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.193 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144751 s, 72.4 MB/s 2024-09-17T01:45:48.211 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.212 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.212 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150606 s, 69.6 MB/s 2024-09-17T01:45:48.228 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.229 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.229 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139842 s, 75.0 MB/s 2024-09-17T01:45:48.250 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.250 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.250 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183581 s, 57.1 MB/s 2024-09-17T01:45:48.269 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.269 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.269 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155544 s, 67.4 MB/s 2024-09-17T01:45:48.288 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.288 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.288 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156418 s, 67.0 MB/s 2024-09-17T01:45:48.305 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.306 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.306 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145997 s, 71.8 MB/s 2024-09-17T01:45:48.325 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.325 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.325 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157182 s, 66.7 MB/s 2024-09-17T01:45:48.342 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.342 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.342 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140328 s, 74.7 MB/s 2024-09-17T01:45:48.361 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.361 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.361 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155965 s, 67.2 MB/s 2024-09-17T01:45:48.382 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.382 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.383 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183366 s, 57.2 MB/s 2024-09-17T01:45:48.399 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.399 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.399 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013815 s, 75.9 MB/s 2024-09-17T01:45:48.418 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.418 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.418 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015637 s, 67.1 MB/s 2024-09-17T01:45:48.438 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.438 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.438 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167504 s, 62.6 MB/s 2024-09-17T01:45:48.455 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.456 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.456 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142665 s, 73.5 MB/s 2024-09-17T01:45:48.472 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.472 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.472 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139006 s, 75.4 MB/s 2024-09-17T01:45:48.495 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.495 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.495 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198417 s, 52.8 MB/s 2024-09-17T01:45:48.514 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.514 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.514 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158969 s, 66.0 MB/s 2024-09-17T01:45:48.536 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.536 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.536 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170174 s, 61.6 MB/s 2024-09-17T01:45:48.553 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.553 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.553 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155472 s, 67.4 MB/s 2024-09-17T01:45:48.570 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.571 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.571 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139727 s, 75.0 MB/s 2024-09-17T01:45:48.586 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.586 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.586 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120154 s, 87.3 MB/s 2024-09-17T01:45:48.604 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.604 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.605 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158153 s, 66.3 MB/s 2024-09-17T01:45:48.623 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.623 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.623 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015129 s, 69.3 MB/s 2024-09-17T01:45:48.644 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.645 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.645 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185598 s, 56.5 MB/s 2024-09-17T01:45:48.662 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.662 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.662 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142229 s, 73.7 MB/s 2024-09-17T01:45:48.681 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.681 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.681 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156721 s, 66.9 MB/s 2024-09-17T01:45:48.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:45:48.690 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:45:48.690 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:45:48.691 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.5 2024-09-17T01:45:48.691 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:45:48.691 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:45:48.691 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:45:48.691 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:45:48.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:45:48.792 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.792 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.792 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156225 s, 67.1 MB/s 2024-09-17T01:45:48.810 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.810 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.810 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143057 s, 73.3 MB/s 2024-09-17T01:45:48.830 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.830 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.830 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166392 s, 63.0 MB/s 2024-09-17T01:45:48.844 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.844 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.844 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115873 s, 90.5 MB/s 2024-09-17T01:45:48.861 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.861 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.861 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136084 s, 77.1 MB/s 2024-09-17T01:45:48.885 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.885 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.885 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210792 s, 49.7 MB/s 2024-09-17T01:45:48.904 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.904 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.904 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154826 s, 67.7 MB/s 2024-09-17T01:45:48.922 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.923 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.923 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155965 s, 67.2 MB/s 2024-09-17T01:45:48.937 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.937 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.937 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116621 s, 89.9 MB/s 2024-09-17T01:45:48.955 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.955 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.955 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148623 s, 70.6 MB/s 2024-09-17T01:45:48.972 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.973 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.973 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145066 s, 72.3 MB/s 2024-09-17T01:45:48.991 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:48.992 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:48.992 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159549 s, 65.7 MB/s 2024-09-17T01:45:49.011 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.011 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.011 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161257 s, 65.0 MB/s 2024-09-17T01:45:49.035 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.035 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.035 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206505 s, 50.8 MB/s 2024-09-17T01:45:49.054 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.054 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.054 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161705 s, 64.8 MB/s 2024-09-17T01:45:49.072 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.072 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.072 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149416 s, 70.2 MB/s 2024-09-17T01:45:49.090 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.090 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.090 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143672 s, 73.0 MB/s 2024-09-17T01:45:49.109 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.109 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.109 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159203 s, 65.9 MB/s 2024-09-17T01:45:49.130 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.130 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.130 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175903 s, 59.6 MB/s 2024-09-17T01:45:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.148 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136856 s, 76.6 MB/s 2024-09-17T01:45:49.163 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.163 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.163 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136431 s, 76.9 MB/s 2024-09-17T01:45:49.181 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.181 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.181 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143202 s, 73.2 MB/s 2024-09-17T01:45:49.197 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.197 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.198 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134745 s, 77.8 MB/s 2024-09-17T01:45:49.215 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.215 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.216 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151661 s, 69.1 MB/s 2024-09-17T01:45:49.238 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.238 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.238 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191266 s, 54.8 MB/s 2024-09-17T01:45:49.256 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.257 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.257 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154898 s, 67.7 MB/s 2024-09-17T01:45:49.274 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.274 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.275 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146518 s, 71.6 MB/s 2024-09-17T01:45:49.292 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.292 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.293 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148591 s, 70.6 MB/s 2024-09-17T01:45:49.311 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.311 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.311 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150915 s, 69.5 MB/s 2024-09-17T01:45:49.331 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.332 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.332 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176194 s, 59.5 MB/s 2024-09-17T01:45:49.348 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.348 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.349 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135667 s, 77.3 MB/s 2024-09-17T01:45:49.365 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.365 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.365 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136214 s, 77.0 MB/s 2024-09-17T01:45:49.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:45:49.374 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:45:49.374 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:45:49.375 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.6 2024-09-17T01:45:49.375 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:45:49.375 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:45:49.375 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:45:49.375 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:45:49.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:45:49.476 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.476 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.476 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152068 s, 69.0 MB/s 2024-09-17T01:45:49.491 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.492 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.492 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120516 s, 87.0 MB/s 2024-09-17T01:45:49.508 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.509 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.509 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138358 s, 75.8 MB/s 2024-09-17T01:45:49.525 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.525 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.526 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137729 s, 76.1 MB/s 2024-09-17T01:45:49.547 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.547 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.547 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186663 s, 56.2 MB/s 2024-09-17T01:45:49.572 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.572 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.572 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214132 s, 49.0 MB/s 2024-09-17T01:45:49.592 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.592 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.592 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166516 s, 63.0 MB/s 2024-09-17T01:45:49.609 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.609 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.609 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144763 s, 72.4 MB/s 2024-09-17T01:45:49.626 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.626 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.627 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137287 s, 76.4 MB/s 2024-09-17T01:45:49.645 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.645 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.645 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156776 s, 66.9 MB/s 2024-09-17T01:45:49.662 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.662 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.663 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137717 s, 76.1 MB/s 2024-09-17T01:45:49.680 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.680 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.680 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139934 s, 74.9 MB/s 2024-09-17T01:45:49.698 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.698 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.698 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154917 s, 67.7 MB/s 2024-09-17T01:45:49.717 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.717 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.717 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151005 s, 69.4 MB/s 2024-09-17T01:45:49.731 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.732 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.732 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115423 s, 90.8 MB/s 2024-09-17T01:45:49.753 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.753 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.753 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187061 s, 56.1 MB/s 2024-09-17T01:45:49.772 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.772 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.772 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147706 s, 71.0 MB/s 2024-09-17T01:45:49.796 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.796 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.796 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205377 s, 51.1 MB/s 2024-09-17T01:45:49.815 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.815 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.815 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152389 s, 68.8 MB/s 2024-09-17T01:45:49.836 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.836 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.836 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175156 s, 59.9 MB/s 2024-09-17T01:45:49.855 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.855 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.855 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016152 s, 64.9 MB/s 2024-09-17T01:45:49.874 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.874 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.874 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157616 s, 66.5 MB/s 2024-09-17T01:45:49.891 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.891 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.891 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138856 s, 75.5 MB/s 2024-09-17T01:45:49.905 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.906 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.906 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111641 s, 93.9 MB/s 2024-09-17T01:45:49.922 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.922 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.923 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138195 s, 75.9 MB/s 2024-09-17T01:45:49.944 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.944 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.945 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178677 s, 58.7 MB/s 2024-09-17T01:45:49.961 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.962 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.962 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144841 s, 72.4 MB/s 2024-09-17T01:45:49.977 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:49.977 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:49.977 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121879 s, 86.0 MB/s 2024-09-17T01:45:49.999 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.000 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.000 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193205 s, 54.3 MB/s 2024-09-17T01:45:50.024 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.024 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.024 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207562 s, 50.5 MB/s 2024-09-17T01:45:50.045 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.045 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.045 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183052 s, 57.3 MB/s 2024-09-17T01:45:50.063 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.063 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.063 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146892 s, 71.4 MB/s 2024-09-17T01:45:50.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:45:50.072 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:45:50.072 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:45:50.072 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.7 2024-09-17T01:45:50.072 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:45:50.072 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:45:50.072 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:45:50.072 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:45:50.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:45:50.172 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.172 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.172 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131927 s, 79.5 MB/s 2024-09-17T01:45:50.190 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.190 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.190 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147519 s, 71.1 MB/s 2024-09-17T01:45:50.207 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.208 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.208 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147705 s, 71.0 MB/s 2024-09-17T01:45:50.228 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.228 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.228 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170979 s, 61.3 MB/s 2024-09-17T01:45:50.245 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.245 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.245 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136931 s, 76.6 MB/s 2024-09-17T01:45:50.263 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.263 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.263 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156805 s, 66.9 MB/s 2024-09-17T01:45:50.281 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.281 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.281 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140672 s, 74.5 MB/s 2024-09-17T01:45:50.298 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.298 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.298 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139934 s, 74.9 MB/s 2024-09-17T01:45:50.320 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.321 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.321 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196031 s, 53.5 MB/s 2024-09-17T01:45:50.338 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.338 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.338 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143427 s, 73.1 MB/s 2024-09-17T01:45:50.357 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.357 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.357 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158613 s, 66.1 MB/s 2024-09-17T01:45:50.378 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.378 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.378 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177543 s, 59.1 MB/s 2024-09-17T01:45:50.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.396 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015271 s, 68.7 MB/s 2024-09-17T01:45:50.415 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.415 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.415 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156695 s, 66.9 MB/s 2024-09-17T01:45:50.436 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.436 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.436 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178186 s, 58.8 MB/s 2024-09-17T01:45:50.453 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.454 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.454 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142755 s, 73.5 MB/s 2024-09-17T01:45:50.471 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.472 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.472 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149202 s, 70.3 MB/s 2024-09-17T01:45:50.489 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.489 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.489 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142092 s, 73.8 MB/s 2024-09-17T01:45:50.505 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.505 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.505 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136102 s, 77.0 MB/s 2024-09-17T01:45:50.524 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.524 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.524 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155439 s, 67.5 MB/s 2024-09-17T01:45:50.542 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.543 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.543 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155932 s, 67.2 MB/s 2024-09-17T01:45:50.560 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.560 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.560 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013889 s, 75.5 MB/s 2024-09-17T01:45:50.578 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.578 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.578 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146284 s, 71.7 MB/s 2024-09-17T01:45:50.595 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.595 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.595 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014799 s, 70.9 MB/s 2024-09-17T01:45:50.616 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.617 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.617 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178169 s, 58.9 MB/s 2024-09-17T01:45:50.635 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.636 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.636 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154963 s, 67.7 MB/s 2024-09-17T01:45:50.652 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.652 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.652 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136293 s, 76.9 MB/s 2024-09-17T01:45:50.668 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.669 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.669 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140589 s, 74.6 MB/s 2024-09-17T01:45:50.686 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.686 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.686 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140229 s, 74.8 MB/s 2024-09-17T01:45:50.703 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.703 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.703 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146604 s, 71.5 MB/s 2024-09-17T01:45:50.721 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.721 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.721 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146462 s, 71.6 MB/s 2024-09-17T01:45:50.738 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.738 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.738 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136714 s, 76.7 MB/s 2024-09-17T01:45:50.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:45:50.747 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:45:50.747 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:45:50.747 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.8 2024-09-17T01:45:50.747 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:45:50.747 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:45:50.747 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:45:50.748 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:45:50.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:45:50.853 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.853 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.853 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161368 s, 65.0 MB/s 2024-09-17T01:45:50.873 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.873 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.873 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166695 s, 62.9 MB/s 2024-09-17T01:45:50.891 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.892 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.892 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156925 s, 66.8 MB/s 2024-09-17T01:45:50.908 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.908 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.908 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013618 s, 77.0 MB/s 2024-09-17T01:45:50.932 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.932 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.932 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203825 s, 51.4 MB/s 2024-09-17T01:45:50.949 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.949 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.950 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141866 s, 73.9 MB/s 2024-09-17T01:45:50.966 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.967 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.967 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137976 s, 76.0 MB/s 2024-09-17T01:45:50.984 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:50.984 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:50.984 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140578 s, 74.6 MB/s 2024-09-17T01:45:51.004 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:51.004 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:51.004 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171866 s, 61.0 MB/s 2024-09-17T01:45:51.023 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:51.023 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:51.023 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159988 s, 65.5 MB/s 2024-09-17T01:45:51.709 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:45:51.714 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:45:51.815 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:51.815 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:51.815 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.788936 s, 1.3 MB/s 2024-09-17T01:45:51.835 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:51.835 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:51.836 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166603 s, 62.9 MB/s 2024-09-17T01:45:51.856 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:51.856 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:51.856 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168714 s, 62.2 MB/s 2024-09-17T01:45:51.873 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:51.873 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:51.873 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129879 s, 80.7 MB/s 2024-09-17T01:45:51.889 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:51.889 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:51.889 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129102 s, 81.2 MB/s 2024-09-17T01:45:51.908 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:51.908 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:51.908 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151509 s, 69.2 MB/s 2024-09-17T01:45:51.924 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:51.924 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:51.925 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127467 s, 82.3 MB/s 2024-09-17T01:45:51.943 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:51.943 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:51.943 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149092 s, 70.3 MB/s 2024-09-17T01:45:51.962 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:51.962 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:51.962 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158591 s, 66.1 MB/s 2024-09-17T01:45:51.983 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:51.983 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:51.983 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172945 s, 60.6 MB/s 2024-09-17T01:45:52.006 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.006 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.006 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191594 s, 54.7 MB/s 2024-09-17T01:45:52.028 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.028 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.028 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189731 s, 55.3 MB/s 2024-09-17T01:45:52.043 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.044 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.044 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117478 s, 89.3 MB/s 2024-09-17T01:45:52.066 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.066 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.066 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187644 s, 55.9 MB/s 2024-09-17T01:45:52.088 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.088 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.088 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179811 s, 58.3 MB/s 2024-09-17T01:45:52.107 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.107 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.107 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015805 s, 66.3 MB/s 2024-09-17T01:45:52.130 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.130 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.130 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190246 s, 55.1 MB/s 2024-09-17T01:45:52.149 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.150 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.150 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158926 s, 66.0 MB/s 2024-09-17T01:45:52.167 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.167 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.167 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140941 s, 74.4 MB/s 2024-09-17T01:45:52.184 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.185 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.185 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140599 s, 74.6 MB/s 2024-09-17T01:45:52.200 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.200 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.200 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119501 s, 87.7 MB/s 2024-09-17T01:45:52.217 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.218 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.218 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144665 s, 72.5 MB/s 2024-09-17T01:45:52.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:45:52.227 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:45:52.227 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:45:52.227 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.9 2024-09-17T01:45:52.227 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:45:52.227 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:45:52.227 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:45:52.227 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:45:52.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:45:52.372 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.373 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.373 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181341 s, 57.8 MB/s 2024-09-17T01:45:52.391 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.391 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.391 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014556 s, 72.0 MB/s 2024-09-17T01:45:52.416 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.416 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.416 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214036 s, 49.0 MB/s 2024-09-17T01:45:52.432 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.432 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.432 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124606 s, 84.2 MB/s 2024-09-17T01:45:52.449 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.449 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.449 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138492 s, 75.7 MB/s 2024-09-17T01:45:52.466 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.466 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.466 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136505 s, 76.8 MB/s 2024-09-17T01:45:52.485 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.485 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.485 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154768 s, 67.8 MB/s 2024-09-17T01:45:52.506 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.507 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.507 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179432 s, 58.4 MB/s 2024-09-17T01:45:52.526 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.526 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.526 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164606 s, 63.7 MB/s 2024-09-17T01:45:52.544 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.544 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.544 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140086 s, 74.9 MB/s 2024-09-17T01:45:52.562 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.562 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.562 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146482 s, 71.6 MB/s 2024-09-17T01:45:52.580 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.581 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.581 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145643 s, 72.0 MB/s 2024-09-17T01:45:52.598 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.598 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.598 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136063 s, 77.1 MB/s 2024-09-17T01:45:52.615 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.616 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.616 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014379 s, 72.9 MB/s 2024-09-17T01:45:52.633 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.633 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.633 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142576 s, 73.5 MB/s 2024-09-17T01:45:52.653 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.653 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.653 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160997 s, 65.1 MB/s 2024-09-17T01:45:52.671 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.671 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.671 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014084 s, 74.5 MB/s 2024-09-17T01:45:52.690 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.690 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.690 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157015 s, 66.8 MB/s 2024-09-17T01:45:52.710 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.710 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.710 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158149 s, 66.3 MB/s 2024-09-17T01:45:52.727 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.728 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.728 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142327 s, 73.7 MB/s 2024-09-17T01:45:52.747 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.747 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.747 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158895 s, 66.0 MB/s 2024-09-17T01:45:52.766 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.766 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.767 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156891 s, 66.8 MB/s 2024-09-17T01:45:52.785 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.785 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.785 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143274 s, 73.2 MB/s 2024-09-17T01:45:52.803 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.803 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.803 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145738 s, 71.9 MB/s 2024-09-17T01:45:52.827 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.827 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.827 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204629 s, 51.2 MB/s 2024-09-17T01:45:52.846 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.846 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.846 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164502 s, 63.7 MB/s 2024-09-17T01:45:52.867 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.867 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.868 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180425 s, 58.1 MB/s 2024-09-17T01:45:52.889 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.889 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.889 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181384 s, 57.8 MB/s 2024-09-17T01:45:52.906 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.906 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.906 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138371 s, 75.8 MB/s 2024-09-17T01:45:52.923 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.923 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.923 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141597 s, 74.1 MB/s 2024-09-17T01:45:52.941 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.941 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.941 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143944 s, 72.8 MB/s 2024-09-17T01:45:52.958 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:52.958 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:52.958 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140234 s, 74.8 MB/s 2024-09-17T01:45:52.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:45:52.967 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:45:52.967 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:45:52.968 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.10 2024-09-17T01:45:52.968 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:45:52.968 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:45:52.968 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:45:52.968 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:45:53.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:45:53.069 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.069 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.069 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015368 s, 68.2 MB/s 2024-09-17T01:45:53.091 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.091 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.091 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190753 s, 55.0 MB/s 2024-09-17T01:45:53.108 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.108 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.108 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143198 s, 73.2 MB/s 2024-09-17T01:45:53.127 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.127 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.127 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157129 s, 66.7 MB/s 2024-09-17T01:45:53.145 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.145 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.145 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014781 s, 70.9 MB/s 2024-09-17T01:45:53.168 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.169 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.169 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206803 s, 50.7 MB/s 2024-09-17T01:45:53.186 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.186 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.187 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150558 s, 69.6 MB/s 2024-09-17T01:45:53.206 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.206 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.206 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164688 s, 63.7 MB/s 2024-09-17T01:45:53.225 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.225 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.226 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162594 s, 64.5 MB/s 2024-09-17T01:45:53.244 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.244 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.244 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156645 s, 66.9 MB/s 2024-09-17T01:45:53.266 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.266 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.266 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182529 s, 57.4 MB/s 2024-09-17T01:45:53.283 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.283 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.283 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139091 s, 75.4 MB/s 2024-09-17T01:45:53.300 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.300 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.300 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014224 s, 73.7 MB/s 2024-09-17T01:45:53.321 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.322 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.322 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180952 s, 57.9 MB/s 2024-09-17T01:45:53.342 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.343 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.343 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179672 s, 58.4 MB/s 2024-09-17T01:45:53.360 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.360 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.360 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146308 s, 71.7 MB/s 2024-09-17T01:45:53.380 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.380 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.380 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160015 s, 65.5 MB/s 2024-09-17T01:45:53.397 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.397 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.397 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139189 s, 75.3 MB/s 2024-09-17T01:45:53.414 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.414 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.414 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014609 s, 71.8 MB/s 2024-09-17T01:45:53.436 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.436 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.436 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182491 s, 57.5 MB/s 2024-09-17T01:45:53.453 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.453 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.453 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140629 s, 74.6 MB/s 2024-09-17T01:45:53.476 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.477 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.477 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201464 s, 52.0 MB/s 2024-09-17T01:45:53.498 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.498 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.498 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018656 s, 56.2 MB/s 2024-09-17T01:45:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.519 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172266 s, 60.9 MB/s 2024-09-17T01:45:53.537 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.537 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.537 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143304 s, 73.2 MB/s 2024-09-17T01:45:53.554 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.554 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.554 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013715 s, 76.5 MB/s 2024-09-17T01:45:53.576 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.576 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.577 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184526 s, 56.8 MB/s 2024-09-17T01:45:53.596 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.596 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.596 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161601 s, 64.9 MB/s 2024-09-17T01:45:53.616 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.617 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.617 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159439 s, 65.8 MB/s 2024-09-17T01:45:53.633 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.633 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.633 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135287 s, 77.5 MB/s 2024-09-17T01:45:53.650 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.650 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.650 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135358 s, 77.5 MB/s 2024-09-17T01:45:53.668 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.668 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.668 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138345 s, 75.8 MB/s 2024-09-17T01:45:53.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:45:53.677 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:45:53.677 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:45:53.677 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.11 2024-09-17T01:45:53.677 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:45:53.677 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:45:53.677 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:45:53.677 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:45:53.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:45:53.778 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.779 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.779 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138538 s, 75.7 MB/s 2024-09-17T01:45:53.800 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.801 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.801 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183889 s, 57.0 MB/s 2024-09-17T01:45:53.819 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.820 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.820 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154178 s, 68.0 MB/s 2024-09-17T01:45:53.837 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.837 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.837 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141911 s, 73.9 MB/s 2024-09-17T01:45:53.855 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.855 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.855 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139564 s, 75.1 MB/s 2024-09-17T01:45:53.874 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.874 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.874 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153962 s, 68.1 MB/s 2024-09-17T01:45:53.892 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.892 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.892 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139293 s, 75.3 MB/s 2024-09-17T01:45:53.914 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.914 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.914 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181323 s, 57.8 MB/s 2024-09-17T01:45:53.931 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.931 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.931 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134217 s, 78.1 MB/s 2024-09-17T01:45:53.949 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.949 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.949 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014346 s, 73.1 MB/s 2024-09-17T01:45:53.967 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.968 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.968 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150445 s, 69.7 MB/s 2024-09-17T01:45:53.985 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:53.985 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:53.985 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142331 s, 73.7 MB/s 2024-09-17T01:45:54.003 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.003 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.003 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141884 s, 73.9 MB/s 2024-09-17T01:45:54.025 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.025 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.025 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178506 s, 58.7 MB/s 2024-09-17T01:45:54.042 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.042 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.042 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137432 s, 76.3 MB/s 2024-09-17T01:45:54.062 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.063 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.063 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167345 s, 62.7 MB/s 2024-09-17T01:45:54.086 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.086 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.086 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020232 s, 51.8 MB/s 2024-09-17T01:45:54.104 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.104 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.104 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148014 s, 70.8 MB/s 2024-09-17T01:45:54.123 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.123 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.123 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149289 s, 70.2 MB/s 2024-09-17T01:45:54.143 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.143 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.143 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159616 s, 65.7 MB/s 2024-09-17T01:45:54.159 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.159 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.159 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124617 s, 84.1 MB/s 2024-09-17T01:45:54.177 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.177 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.177 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143708 s, 73.0 MB/s 2024-09-17T01:45:54.194 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.195 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.195 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142456 s, 73.6 MB/s 2024-09-17T01:45:54.213 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.213 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.213 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149232 s, 70.3 MB/s 2024-09-17T01:45:54.233 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.233 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.233 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159232 s, 65.9 MB/s 2024-09-17T01:45:54.252 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.252 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.252 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156319 s, 67.1 MB/s 2024-09-17T01:45:54.274 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.274 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.274 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183492 s, 57.1 MB/s 2024-09-17T01:45:54.289 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.289 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.289 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110795 s, 94.6 MB/s 2024-09-17T01:45:54.308 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.308 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.308 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154553 s, 67.8 MB/s 2024-09-17T01:45:54.328 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.328 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.328 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166883 s, 62.8 MB/s 2024-09-17T01:45:54.346 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.346 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.346 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014251 s, 73.6 MB/s 2024-09-17T01:45:54.363 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.364 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.364 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139623 s, 75.1 MB/s 2024-09-17T01:45:54.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:45:54.372 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:45:54.373 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:45:54.373 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.12 2024-09-17T01:45:54.373 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:45:54.373 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:45:54.373 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:45:54.373 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:45:54.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:45:54.474 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.474 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.474 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140854 s, 74.4 MB/s 2024-09-17T01:45:54.492 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.492 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.492 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138992 s, 75.4 MB/s 2024-09-17T01:45:54.510 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.510 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.510 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144459 s, 72.6 MB/s 2024-09-17T01:45:54.534 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.534 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.535 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209887 s, 50.0 MB/s 2024-09-17T01:45:54.553 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.553 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.553 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145946 s, 71.8 MB/s 2024-09-17T01:45:54.571 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.571 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.572 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146763 s, 71.4 MB/s 2024-09-17T01:45:54.587 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.587 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.587 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118522 s, 88.5 MB/s 2024-09-17T01:45:54.604 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.604 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.605 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014346 s, 73.1 MB/s 2024-09-17T01:45:54.622 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.622 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.623 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140898 s, 74.4 MB/s 2024-09-17T01:45:54.640 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.640 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.640 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137323 s, 76.4 MB/s 2024-09-17T01:45:54.658 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.658 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.658 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145435 s, 72.1 MB/s 2024-09-17T01:45:54.676 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.676 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.676 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140121 s, 74.8 MB/s 2024-09-17T01:45:54.698 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.698 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.698 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184918 s, 56.7 MB/s 2024-09-17T01:45:54.716 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.717 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.717 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147259 s, 71.2 MB/s 2024-09-17T01:45:54.736 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.736 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.736 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156911 s, 66.8 MB/s 2024-09-17T01:45:54.760 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.760 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.760 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204637 s, 51.2 MB/s 2024-09-17T01:45:54.780 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.781 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.781 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171931 s, 61.0 MB/s 2024-09-17T01:45:54.798 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.798 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.798 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147167 s, 71.3 MB/s 2024-09-17T01:45:54.827 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.827 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.827 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247449 s, 42.4 MB/s 2024-09-17T01:45:54.847 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.847 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.847 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160935 s, 65.2 MB/s 2024-09-17T01:45:54.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.866 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161432 s, 65.0 MB/s 2024-09-17T01:45:54.886 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.886 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.886 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167729 s, 62.5 MB/s 2024-09-17T01:45:54.903 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.903 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.904 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144324 s, 72.7 MB/s 2024-09-17T01:45:54.921 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.921 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.921 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143516 s, 73.1 MB/s 2024-09-17T01:45:54.942 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.943 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.943 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181505 s, 57.8 MB/s 2024-09-17T01:45:54.958 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.958 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.958 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120409 s, 87.1 MB/s 2024-09-17T01:45:54.976 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.976 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.976 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149903 s, 70.0 MB/s 2024-09-17T01:45:54.993 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:54.993 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:54.993 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143408 s, 73.1 MB/s 2024-09-17T01:45:55.011 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.011 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.011 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141066 s, 74.3 MB/s 2024-09-17T01:45:55.028 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.029 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.029 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143467 s, 73.1 MB/s 2024-09-17T01:45:55.045 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.046 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.046 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138788 s, 75.6 MB/s 2024-09-17T01:45:55.064 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.064 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.065 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155387 s, 67.5 MB/s 2024-09-17T01:45:55.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:45:55.073 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:45:55.074 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:45:55.074 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.13 2024-09-17T01:45:55.074 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:45:55.074 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:45:55.074 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:45:55.074 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:45:55.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:45:55.174 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.174 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.174 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01431 s, 73.3 MB/s 2024-09-17T01:45:55.194 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.194 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.194 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166682 s, 62.9 MB/s 2024-09-17T01:45:55.212 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.212 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.212 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152548 s, 68.7 MB/s 2024-09-17T01:45:55.233 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.233 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.233 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180695 s, 58.0 MB/s 2024-09-17T01:45:55.252 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.252 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.253 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161166 s, 65.1 MB/s 2024-09-17T01:45:55.276 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.276 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.276 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183256 s, 57.2 MB/s 2024-09-17T01:45:55.292 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.292 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.292 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154362 s, 67.9 MB/s 2024-09-17T01:45:55.316 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.316 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.316 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202501 s, 51.8 MB/s 2024-09-17T01:45:55.333 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.334 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.334 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145995 s, 71.8 MB/s 2024-09-17T01:45:55.354 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.354 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.355 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174311 s, 60.2 MB/s 2024-09-17T01:45:55.371 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.371 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.371 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136022 s, 77.1 MB/s 2024-09-17T01:45:55.386 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.386 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.386 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118679 s, 88.4 MB/s 2024-09-17T01:45:55.404 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.404 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.404 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155638 s, 67.4 MB/s 2024-09-17T01:45:55.421 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.422 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.422 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141472 s, 74.1 MB/s 2024-09-17T01:45:55.444 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.444 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.444 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190034 s, 55.2 MB/s 2024-09-17T01:45:55.462 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.462 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.462 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155448 s, 67.5 MB/s 2024-09-17T01:45:55.485 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.485 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.485 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188278 s, 55.7 MB/s 2024-09-17T01:45:55.501 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.501 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.501 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139066 s, 75.4 MB/s 2024-09-17T01:45:55.519 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.519 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.519 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143225 s, 73.2 MB/s 2024-09-17T01:45:55.540 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.540 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.540 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181292 s, 57.8 MB/s 2024-09-17T01:45:55.557 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.557 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.557 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137106 s, 76.5 MB/s 2024-09-17T01:45:55.575 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.575 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.575 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143212 s, 73.2 MB/s 2024-09-17T01:45:55.591 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.591 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.591 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133244 s, 78.7 MB/s 2024-09-17T01:45:55.608 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.608 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.609 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138179 s, 75.9 MB/s 2024-09-17T01:45:55.626 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.626 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.626 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142956 s, 73.3 MB/s 2024-09-17T01:45:55.643 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.643 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.644 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144356 s, 72.6 MB/s 2024-09-17T01:45:55.663 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.664 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.664 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168313 s, 62.3 MB/s 2024-09-17T01:45:55.680 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.680 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.680 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137224 s, 76.4 MB/s 2024-09-17T01:45:55.704 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.704 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.704 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204875 s, 51.2 MB/s 2024-09-17T01:45:55.722 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.722 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.722 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147875 s, 70.9 MB/s 2024-09-17T01:45:55.741 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.741 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.741 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159662 s, 65.7 MB/s 2024-09-17T01:45:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.759 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145555 s, 72.0 MB/s 2024-09-17T01:45:55.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:45:55.768 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:45:55.768 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:45:55.768 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.14 2024-09-17T01:45:55.768 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:45:55.768 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:45:55.769 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:45:55.769 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:45:55.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:45:55.871 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.871 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.871 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136388 s, 76.9 MB/s 2024-09-17T01:45:55.889 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.889 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.889 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151458 s, 69.2 MB/s 2024-09-17T01:45:55.913 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.913 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.913 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206067 s, 50.9 MB/s 2024-09-17T01:45:55.930 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.930 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.930 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144137 s, 72.7 MB/s 2024-09-17T01:45:55.953 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.953 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.953 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190087 s, 55.2 MB/s 2024-09-17T01:45:55.970 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.970 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.970 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137311 s, 76.4 MB/s 2024-09-17T01:45:55.987 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:55.987 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:55.987 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138673 s, 75.6 MB/s 2024-09-17T01:45:56.005 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.005 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.005 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154857 s, 67.7 MB/s 2024-09-17T01:45:56.022 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.022 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.023 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141635 s, 74.0 MB/s 2024-09-17T01:45:56.044 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.044 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.044 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186479 s, 56.2 MB/s 2024-09-17T01:45:56.065 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.065 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.065 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176025 s, 59.6 MB/s 2024-09-17T01:45:56.086 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.087 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.087 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01848 s, 56.7 MB/s 2024-09-17T01:45:56.107 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.107 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.107 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175437 s, 59.8 MB/s 2024-09-17T01:45:56.124 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.124 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.124 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141058 s, 74.3 MB/s 2024-09-17T01:45:56.145 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.145 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.145 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175437 s, 59.8 MB/s 2024-09-17T01:45:56.166 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.166 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.166 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174574 s, 60.1 MB/s 2024-09-17T01:45:56.184 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.185 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.185 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153919 s, 68.1 MB/s 2024-09-17T01:45:56.202 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.202 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.202 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141135 s, 74.3 MB/s 2024-09-17T01:45:56.219 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.219 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.219 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136814 s, 76.6 MB/s 2024-09-17T01:45:56.238 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.238 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.238 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157248 s, 66.7 MB/s 2024-09-17T01:45:56.259 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.259 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.259 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174325 s, 60.2 MB/s 2024-09-17T01:45:56.276 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.277 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.277 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147957 s, 70.9 MB/s 2024-09-17T01:45:56.296 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.297 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.297 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146299 s, 71.7 MB/s 2024-09-17T01:45:56.312 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.312 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.312 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142243 s, 73.7 MB/s 2024-09-17T01:45:56.329 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.329 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.329 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139797 s, 75.0 MB/s 2024-09-17T01:45:56.347 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.347 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.347 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146623 s, 71.5 MB/s 2024-09-17T01:45:56.363 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.363 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.363 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131586 s, 79.7 MB/s 2024-09-17T01:45:56.380 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.381 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.381 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142018 s, 73.8 MB/s 2024-09-17T01:45:56.402 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.402 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.402 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179951 s, 58.3 MB/s 2024-09-17T01:45:56.419 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.419 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.420 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145148 s, 72.2 MB/s 2024-09-17T01:45:56.436 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.437 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.437 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141297 s, 74.2 MB/s 2024-09-17T01:45:56.457 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.457 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.457 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017396 s, 60.3 MB/s 2024-09-17T01:45:56.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:45:56.466 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:45:56.467 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:45:56.467 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.15 2024-09-17T01:45:56.467 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:45:56.467 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:45:56.467 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:45:56.467 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:45:56.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:45:56.568 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.568 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.568 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145922 s, 71.9 MB/s 2024-09-17T01:45:56.585 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.585 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.585 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139876 s, 75.0 MB/s 2024-09-17T01:45:56.607 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.608 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.608 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190198 s, 55.1 MB/s 2024-09-17T01:45:56.624 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.624 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.624 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142351 s, 73.7 MB/s 2024-09-17T01:45:56.645 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.645 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.645 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175959 s, 59.6 MB/s 2024-09-17T01:45:56.662 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.663 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.663 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141147 s, 74.3 MB/s 2024-09-17T01:45:56.681 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.682 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.682 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015833 s, 66.2 MB/s 2024-09-17T01:45:56.702 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.702 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.702 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173648 s, 60.4 MB/s 2024-09-17T01:45:56.720 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.721 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.721 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154858 s, 67.7 MB/s 2024-09-17T01:45:56.738 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.738 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.738 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140202 s, 74.8 MB/s 2024-09-17T01:45:56.758 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.759 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.759 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017744 s, 59.1 MB/s 2024-09-17T01:45:56.777 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.777 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.777 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151109 s, 69.4 MB/s 2024-09-17T01:45:56.796 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.796 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.797 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161951 s, 64.7 MB/s 2024-09-17T01:45:56.814 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.814 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.815 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148039 s, 70.8 MB/s 2024-09-17T01:45:56.832 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.832 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.832 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145765 s, 71.9 MB/s 2024-09-17T01:45:56.850 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.851 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.851 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152014 s, 69.0 MB/s 2024-09-17T01:45:56.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.866 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121499 s, 86.3 MB/s 2024-09-17T01:45:56.883 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.883 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.883 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142583 s, 73.5 MB/s 2024-09-17T01:45:56.902 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.902 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.902 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155733 s, 67.3 MB/s 2024-09-17T01:45:56.920 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.920 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.920 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149681 s, 70.1 MB/s 2024-09-17T01:45:56.937 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.937 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.937 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013814 s, 75.9 MB/s 2024-09-17T01:45:56.956 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.956 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.956 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158904 s, 66.0 MB/s 2024-09-17T01:45:56.973 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.974 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.974 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140121 s, 74.8 MB/s 2024-09-17T01:45:56.991 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:56.992 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:56.992 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146421 s, 71.6 MB/s 2024-09-17T01:45:57.008 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.008 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.009 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138292 s, 75.8 MB/s 2024-09-17T01:45:57.029 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.029 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.029 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175272 s, 59.8 MB/s 2024-09-17T01:45:57.047 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.047 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.047 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152148 s, 68.9 MB/s 2024-09-17T01:45:57.064 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.064 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.064 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139077 s, 75.4 MB/s 2024-09-17T01:45:57.082 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.082 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.082 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146777 s, 71.4 MB/s 2024-09-17T01:45:57.097 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.097 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.097 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011524 s, 91.0 MB/s 2024-09-17T01:45:57.112 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.112 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.112 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123933 s, 84.6 MB/s 2024-09-17T01:45:57.129 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.129 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.129 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138956 s, 75.5 MB/s 2024-09-17T01:45:57.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:45:57.138 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:45:57.138 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:45:57.139 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.16 2024-09-17T01:45:57.139 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:45:57.139 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:45:57.139 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:45:57.139 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:45:57.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:45:57.241 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.241 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.241 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166881 s, 62.8 MB/s 2024-09-17T01:45:57.258 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.259 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.259 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138343 s, 75.8 MB/s 2024-09-17T01:45:57.277 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.277 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.277 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152728 s, 68.7 MB/s 2024-09-17T01:45:57.298 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.298 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.298 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179434 s, 58.4 MB/s 2024-09-17T01:45:57.315 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.315 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.315 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139308 s, 75.3 MB/s 2024-09-17T01:45:57.329 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.330 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.330 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113576 s, 92.3 MB/s 2024-09-17T01:45:57.347 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.347 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.347 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142301 s, 73.7 MB/s 2024-09-17T01:45:57.365 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.365 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.365 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150359 s, 69.7 MB/s 2024-09-17T01:45:57.382 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.383 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.383 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144645 s, 72.5 MB/s 2024-09-17T01:45:57.401 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.401 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.401 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150988 s, 69.4 MB/s 2024-09-17T01:45:57.418 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.418 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.418 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143567 s, 73.0 MB/s 2024-09-17T01:45:57.437 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.438 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.438 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161031 s, 65.1 MB/s 2024-09-17T01:45:57.456 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.456 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.456 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149623 s, 70.1 MB/s 2024-09-17T01:45:57.475 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.475 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.475 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155448 s, 67.5 MB/s 2024-09-17T01:45:57.492 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.493 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.493 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145062 s, 72.3 MB/s 2024-09-17T01:45:57.510 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.510 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.510 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141424 s, 74.1 MB/s 2024-09-17T01:45:57.527 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.528 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.528 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144538 s, 72.5 MB/s 2024-09-17T01:45:57.544 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.544 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.544 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136153 s, 77.0 MB/s 2024-09-17T01:45:57.562 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.562 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.562 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142977 s, 73.3 MB/s 2024-09-17T01:45:57.578 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.578 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.578 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131511 s, 79.7 MB/s 2024-09-17T01:45:57.597 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.597 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.598 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160937 s, 65.2 MB/s 2024-09-17T01:45:57.615 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.615 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.615 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142573 s, 73.5 MB/s 2024-09-17T01:45:57.634 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.634 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.635 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166031 s, 63.2 MB/s 2024-09-17T01:45:57.653 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.653 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.653 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151913 s, 69.0 MB/s 2024-09-17T01:45:57.671 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.671 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.671 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152153 s, 68.9 MB/s 2024-09-17T01:45:57.686 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.686 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.686 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117679 s, 89.1 MB/s 2024-09-17T01:45:57.705 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.705 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.705 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160874 s, 65.2 MB/s 2024-09-17T01:45:57.722 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.722 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.723 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140873 s, 74.4 MB/s 2024-09-17T01:45:57.739 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.739 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.739 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135935 s, 77.1 MB/s 2024-09-17T01:45:57.762 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.762 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.762 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197354 s, 53.1 MB/s 2024-09-17T01:45:57.780 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.780 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.780 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144459 s, 72.6 MB/s 2024-09-17T01:45:57.798 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.798 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.798 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154846 s, 67.7 MB/s 2024-09-17T01:45:57.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:45:57.808 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:45:57.808 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:45:57.808 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.17 2024-09-17T01:45:57.808 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:45:57.808 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:45:57.808 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:45:57.808 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:45:57.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:45:57.910 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.911 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.911 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159723 s, 65.6 MB/s 2024-09-17T01:45:57.930 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.930 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.930 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159989 s, 65.5 MB/s 2024-09-17T01:45:57.947 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.947 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.947 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140801 s, 74.5 MB/s 2024-09-17T01:45:57.966 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.966 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.967 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157871 s, 66.4 MB/s 2024-09-17T01:45:57.985 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:57.985 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:57.985 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156289 s, 67.1 MB/s 2024-09-17T01:45:58.002 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.002 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.003 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146494 s, 71.6 MB/s 2024-09-17T01:45:58.019 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.019 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.020 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135622 s, 77.3 MB/s 2024-09-17T01:45:58.038 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.039 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.039 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162356 s, 64.6 MB/s 2024-09-17T01:45:58.058 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.059 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.059 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167328 s, 62.7 MB/s 2024-09-17T01:45:58.077 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.077 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.077 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151231 s, 69.3 MB/s 2024-09-17T01:45:58.095 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.095 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.095 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148568 s, 70.6 MB/s 2024-09-17T01:45:58.112 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.112 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.112 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140887 s, 74.4 MB/s 2024-09-17T01:45:58.133 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.133 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.133 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176387 s, 59.4 MB/s 2024-09-17T01:45:58.151 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.151 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.151 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145013 s, 72.3 MB/s 2024-09-17T01:45:58.168 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.168 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.168 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138915 s, 75.5 MB/s 2024-09-17T01:45:58.186 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.186 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.186 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149658 s, 70.1 MB/s 2024-09-17T01:45:58.204 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.204 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.204 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143813 s, 72.9 MB/s 2024-09-17T01:45:58.222 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.222 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.222 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151411 s, 69.3 MB/s 2024-09-17T01:45:58.243 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.243 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.243 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176707 s, 59.3 MB/s 2024-09-17T01:45:58.260 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.260 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.260 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137691 s, 76.2 MB/s 2024-09-17T01:45:58.277 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.278 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.278 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144397 s, 72.6 MB/s 2024-09-17T01:45:58.295 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.295 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.296 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014668 s, 71.5 MB/s 2024-09-17T01:45:58.315 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.315 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.315 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164858 s, 63.6 MB/s 2024-09-17T01:45:58.334 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.334 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.335 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161853 s, 64.8 MB/s 2024-09-17T01:45:58.355 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.355 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.356 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175955 s, 59.6 MB/s 2024-09-17T01:45:58.373 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.373 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.373 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141861 s, 73.9 MB/s 2024-09-17T01:45:58.391 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.391 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.391 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144324 s, 72.7 MB/s 2024-09-17T01:45:58.409 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.409 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.410 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153767 s, 68.2 MB/s 2024-09-17T01:45:58.425 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.426 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.426 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.012841 s, 81.7 MB/s 2024-09-17T01:45:58.444 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.444 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.445 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015786 s, 66.4 MB/s 2024-09-17T01:45:58.462 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.462 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.462 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142101 s, 73.8 MB/s 2024-09-17T01:45:58.479 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.480 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.480 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144631 s, 72.5 MB/s 2024-09-17T01:45:58.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:45:58.489 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:45:58.489 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:45:58.489 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.18 2024-09-17T01:45:58.489 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:45:58.489 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:45:58.489 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:45:58.489 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:45:58.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:45:58.594 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.594 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.594 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182587 s, 57.4 MB/s 2024-09-17T01:45:58.611 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.611 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.611 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139123 s, 75.4 MB/s 2024-09-17T01:45:58.635 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.635 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.635 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020497 s, 51.2 MB/s 2024-09-17T01:45:58.653 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.654 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.654 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158098 s, 66.3 MB/s 2024-09-17T01:45:58.673 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.673 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.673 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159192 s, 65.9 MB/s 2024-09-17T01:45:58.689 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.690 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.690 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139314 s, 75.3 MB/s 2024-09-17T01:45:58.707 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.707 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.707 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144286 s, 72.7 MB/s 2024-09-17T01:45:58.724 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.724 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.724 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138966 s, 75.5 MB/s 2024-09-17T01:45:58.748 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.749 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.749 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211339 s, 49.6 MB/s 2024-09-17T01:45:58.766 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.766 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.766 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014453 s, 72.6 MB/s 2024-09-17T01:45:58.782 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.783 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.783 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136948 s, 76.6 MB/s 2024-09-17T01:45:58.800 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.801 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.801 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146356 s, 71.6 MB/s 2024-09-17T01:45:58.818 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.818 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.818 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149976 s, 69.9 MB/s 2024-09-17T01:45:58.836 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.836 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.836 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014023 s, 74.8 MB/s 2024-09-17T01:45:58.850 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.851 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.851 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118619 s, 88.4 MB/s 2024-09-17T01:45:58.867 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.867 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.867 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135825 s, 77.2 MB/s 2024-09-17T01:45:58.884 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.884 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.884 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138849 s, 75.5 MB/s 2024-09-17T01:45:58.904 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.904 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.904 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162395 s, 64.6 MB/s 2024-09-17T01:45:58.924 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.924 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.924 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171321 s, 61.2 MB/s 2024-09-17T01:45:58.946 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.946 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.946 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186629 s, 56.2 MB/s 2024-09-17T01:45:58.969 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.970 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.970 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020091 s, 52.2 MB/s 2024-09-17T01:45:58.988 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:58.989 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:58.989 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157743 s, 66.5 MB/s 2024-09-17T01:45:59.007 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.007 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.007 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154874 s, 67.7 MB/s 2024-09-17T01:45:59.031 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.031 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.031 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208572 s, 50.3 MB/s 2024-09-17T01:45:59.048 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.048 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.048 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141921 s, 73.9 MB/s 2024-09-17T01:45:59.069 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.069 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.069 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172678 s, 60.7 MB/s 2024-09-17T01:45:59.087 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.087 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.088 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155745 s, 67.3 MB/s 2024-09-17T01:45:59.108 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.108 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.108 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170912 s, 61.4 MB/s 2024-09-17T01:45:59.126 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.126 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.126 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015053 s, 69.7 MB/s 2024-09-17T01:45:59.144 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.145 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.145 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155265 s, 67.5 MB/s 2024-09-17T01:45:59.162 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.163 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.163 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147371 s, 71.2 MB/s 2024-09-17T01:45:59.184 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.184 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.184 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182226 s, 57.5 MB/s 2024-09-17T01:45:59.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:45:59.193 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:45:59.193 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:45:59.193 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.19 2024-09-17T01:45:59.193 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:45:59.193 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:45:59.193 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:45:59.194 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:45:59.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:45:59.296 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.296 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.296 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163846 s, 64.0 MB/s 2024-09-17T01:45:59.314 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.314 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.314 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144772 s, 72.4 MB/s 2024-09-17T01:45:59.332 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.332 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.332 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152561 s, 68.7 MB/s 2024-09-17T01:45:59.350 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.351 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.351 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151088 s, 69.4 MB/s 2024-09-17T01:45:59.369 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.369 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.369 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149755 s, 70.0 MB/s 2024-09-17T01:45:59.385 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.386 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.386 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136268 s, 76.9 MB/s 2024-09-17T01:45:59.405 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.405 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.405 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165056 s, 63.5 MB/s 2024-09-17T01:45:59.426 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.426 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.427 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180456 s, 58.1 MB/s 2024-09-17T01:45:59.444 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.444 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.444 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144366 s, 72.6 MB/s 2024-09-17T01:45:59.461 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.461 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.461 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138236 s, 75.9 MB/s 2024-09-17T01:45:59.483 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.483 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.483 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188755 s, 55.6 MB/s 2024-09-17T01:45:59.501 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.501 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.501 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150128 s, 69.8 MB/s 2024-09-17T01:45:59.519 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.520 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146918 s, 71.4 MB/s 2024-09-17T01:45:59.541 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.541 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.541 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182463 s, 57.5 MB/s 2024-09-17T01:45:59.558 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.559 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.559 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147491 s, 71.1 MB/s 2024-09-17T01:45:59.576 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.576 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.576 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141877 s, 73.9 MB/s 2024-09-17T01:45:59.592 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.592 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.592 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124413 s, 84.3 MB/s 2024-09-17T01:45:59.614 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.614 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.614 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186886 s, 56.1 MB/s 2024-09-17T01:45:59.631 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.631 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.631 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142672 s, 73.5 MB/s 2024-09-17T01:45:59.649 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.649 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.650 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151323 s, 69.3 MB/s 2024-09-17T01:45:59.669 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.669 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.669 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164117 s, 63.9 MB/s 2024-09-17T01:45:59.687 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.688 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.688 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153609 s, 68.3 MB/s 2024-09-17T01:45:59.705 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.705 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.705 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138492 s, 75.7 MB/s 2024-09-17T01:45:59.722 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.722 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.722 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138455 s, 75.7 MB/s 2024-09-17T01:45:59.740 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.741 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.741 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154119 s, 68.0 MB/s 2024-09-17T01:45:59.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.771 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259562 s, 40.4 MB/s 2024-09-17T01:45:59.788 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.788 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.789 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139945 s, 74.9 MB/s 2024-09-17T01:45:59.806 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.807 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.807 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144086 s, 72.8 MB/s 2024-09-17T01:45:59.826 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.827 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.827 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161385 s, 65.0 MB/s 2024-09-17T01:45:59.845 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.845 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.845 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148072 s, 70.8 MB/s 2024-09-17T01:45:59.867 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.867 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.867 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190385 s, 55.1 MB/s 2024-09-17T01:45:59.889 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:45:59.889 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:45:59.889 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165365 s, 63.4 MB/s 2024-09-17T01:45:59.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:45:59.896 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:45:59.896 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:45:59.896 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.20 2024-09-17T01:45:59.896 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:45:59.896 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:45:59.896 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:45:59.896 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:45:59.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:45:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:46:00.003 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.003 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.003 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205904 s, 50.9 MB/s 2024-09-17T01:46:00.023 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.023 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.023 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168053 s, 62.4 MB/s 2024-09-17T01:46:00.040 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.040 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.040 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140728 s, 74.5 MB/s 2024-09-17T01:46:00.057 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.057 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.057 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141937 s, 73.9 MB/s 2024-09-17T01:46:00.076 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.076 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.076 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158245 s, 66.3 MB/s 2024-09-17T01:46:00.096 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.096 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.096 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165639 s, 63.3 MB/s 2024-09-17T01:46:00.118 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.118 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.118 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190809 s, 55.0 MB/s 2024-09-17T01:46:00.139 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.139 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.139 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175002 s, 59.9 MB/s 2024-09-17T01:46:00.156 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.156 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.156 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139702 s, 75.1 MB/s 2024-09-17T01:46:00.176 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.177 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.177 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175511 s, 59.7 MB/s 2024-09-17T01:46:00.198 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.199 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.199 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01891 s, 55.5 MB/s 2024-09-17T01:46:00.217 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.217 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.217 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153718 s, 68.2 MB/s 2024-09-17T01:46:00.234 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.235 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.235 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142685 s, 73.5 MB/s 2024-09-17T01:46:00.254 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.254 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.254 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161262 s, 65.0 MB/s 2024-09-17T01:46:00.271 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.271 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.271 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141156 s, 74.3 MB/s 2024-09-17T01:46:00.288 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.288 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.288 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137265 s, 76.4 MB/s 2024-09-17T01:46:00.308 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.308 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.308 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165565 s, 63.3 MB/s 2024-09-17T01:46:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.325 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140449 s, 74.7 MB/s 2024-09-17T01:46:00.342 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.342 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.342 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139894 s, 75.0 MB/s 2024-09-17T01:46:00.361 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.361 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.361 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160018 s, 65.5 MB/s 2024-09-17T01:46:00.378 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.378 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.378 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138045 s, 76.0 MB/s 2024-09-17T01:46:00.395 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.395 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.395 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135858 s, 77.2 MB/s 2024-09-17T01:46:00.412 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.412 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.412 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139714 s, 75.1 MB/s 2024-09-17T01:46:00.429 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.429 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.429 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138917 s, 75.5 MB/s 2024-09-17T01:46:00.447 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.447 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.447 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142883 s, 73.4 MB/s 2024-09-17T01:46:00.465 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.465 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.465 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148565 s, 70.6 MB/s 2024-09-17T01:46:00.487 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.487 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.487 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191863 s, 54.7 MB/s 2024-09-17T01:46:00.504 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.504 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.505 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141559 s, 74.1 MB/s 2024-09-17T01:46:00.527 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.527 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.528 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192247 s, 54.5 MB/s 2024-09-17T01:46:00.547 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.548 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.548 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175283 s, 59.8 MB/s 2024-09-17T01:46:00.568 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.568 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.568 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176805 s, 59.3 MB/s 2024-09-17T01:46:00.589 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.589 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.589 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179173 s, 58.5 MB/s 2024-09-17T01:46:00.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:46:00.598 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:46:00.598 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:46:00.599 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.21 2024-09-17T01:46:00.599 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:46:00.599 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:46:00.599 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:46:00.599 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:46:00.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:46:00.705 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.706 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.706 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207799 s, 50.5 MB/s 2024-09-17T01:46:00.728 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.728 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.728 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190409 s, 55.1 MB/s 2024-09-17T01:46:00.746 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.746 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.746 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144952 s, 72.3 MB/s 2024-09-17T01:46:00.766 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.766 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.766 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162573 s, 64.5 MB/s 2024-09-17T01:46:00.789 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.789 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.789 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192222 s, 54.6 MB/s 2024-09-17T01:46:00.807 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.807 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.807 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147815 s, 70.9 MB/s 2024-09-17T01:46:00.825 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.825 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.825 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014088 s, 74.4 MB/s 2024-09-17T01:46:00.848 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.849 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.849 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206735 s, 50.7 MB/s 2024-09-17T01:46:00.867 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.867 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.867 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014734 s, 71.2 MB/s 2024-09-17T01:46:00.885 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.886 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.886 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156696 s, 66.9 MB/s 2024-09-17T01:46:00.904 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.904 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.904 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015236 s, 68.8 MB/s 2024-09-17T01:46:00.922 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.922 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.922 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146283 s, 71.7 MB/s 2024-09-17T01:46:00.939 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.939 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.939 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137997 s, 76.0 MB/s 2024-09-17T01:46:00.956 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.957 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.957 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145891 s, 71.9 MB/s 2024-09-17T01:46:00.975 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.975 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.975 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148366 s, 70.7 MB/s 2024-09-17T01:46:00.993 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:00.993 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:00.993 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147892 s, 70.9 MB/s 2024-09-17T01:46:01.010 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.010 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.010 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140032 s, 74.9 MB/s 2024-09-17T01:46:01.031 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.031 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.031 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179206 s, 58.5 MB/s 2024-09-17T01:46:01.049 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.049 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.049 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143519 s, 73.1 MB/s 2024-09-17T01:46:01.067 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.067 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.067 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151536 s, 69.2 MB/s 2024-09-17T01:46:01.084 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.084 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.084 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140363 s, 74.7 MB/s 2024-09-17T01:46:01.103 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.103 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.103 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156949 s, 66.8 MB/s 2024-09-17T01:46:01.125 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.125 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.125 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185444 s, 56.5 MB/s 2024-09-17T01:46:01.142 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.142 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.143 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143166 s, 73.2 MB/s 2024-09-17T01:46:01.161 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.161 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.161 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153511 s, 68.3 MB/s 2024-09-17T01:46:01.179 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.180 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.180 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01529 s, 68.6 MB/s 2024-09-17T01:46:01.198 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.199 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.199 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157935 s, 66.4 MB/s 2024-09-17T01:46:01.214 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.214 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.214 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124802 s, 84.0 MB/s 2024-09-17T01:46:01.231 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.231 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.231 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136662 s, 76.7 MB/s 2024-09-17T01:46:01.249 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.249 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.249 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145825 s, 71.9 MB/s 2024-09-17T01:46:01.264 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.264 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.265 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128759 s, 81.4 MB/s 2024-09-17T01:46:01.282 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.282 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.282 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145418 s, 72.1 MB/s 2024-09-17T01:46:01.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:46:01.291 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:46:01.291 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:46:01.292 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.22 2024-09-17T01:46:01.292 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:46:01.292 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:46:01.292 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:46:01.292 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:46:01.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:46:01.392 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.392 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.392 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142134 s, 73.8 MB/s 2024-09-17T01:46:01.410 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.410 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.410 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146172 s, 71.7 MB/s 2024-09-17T01:46:01.428 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.429 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.429 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154754 s, 67.8 MB/s 2024-09-17T01:46:01.450 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.450 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.450 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180957 s, 57.9 MB/s 2024-09-17T01:46:01.466 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.467 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.467 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139343 s, 75.3 MB/s 2024-09-17T01:46:01.484 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.484 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.484 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142614 s, 73.5 MB/s 2024-09-17T01:46:01.500 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.500 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.500 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013127 s, 79.9 MB/s 2024-09-17T01:46:01.518 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.518 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.518 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146613 s, 71.5 MB/s 2024-09-17T01:46:01.536 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.536 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.536 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148494 s, 70.6 MB/s 2024-09-17T01:46:01.553 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.554 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.554 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145959 s, 71.8 MB/s 2024-09-17T01:46:01.572 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.572 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.572 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148371 s, 70.7 MB/s 2024-09-17T01:46:01.590 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.590 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.590 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152714 s, 68.7 MB/s 2024-09-17T01:46:01.607 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.607 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.607 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137823 s, 76.1 MB/s 2024-09-17T01:46:01.625 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.625 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.625 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013666 s, 76.7 MB/s 2024-09-17T01:46:01.642 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.642 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.642 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145288 s, 72.2 MB/s 2024-09-17T01:46:01.658 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.659 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.659 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013596 s, 77.1 MB/s 2024-09-17T01:46:01.677 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.677 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.677 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01557 s, 67.3 MB/s 2024-09-17T01:46:01.695 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.695 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.695 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01441 s, 72.8 MB/s 2024-09-17T01:46:01.716 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.717 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.717 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184376 s, 56.9 MB/s 2024-09-17T01:46:01.733 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.733 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.733 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135307 s, 77.5 MB/s 2024-09-17T01:46:01.751 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.751 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.751 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142619 s, 73.5 MB/s 2024-09-17T01:46:01.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.771 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171917 s, 61.0 MB/s 2024-09-17T01:46:01.789 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.790 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.790 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153905 s, 68.1 MB/s 2024-09-17T01:46:01.807 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.807 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.807 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145782 s, 71.9 MB/s 2024-09-17T01:46:01.831 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.831 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.831 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203562 s, 51.5 MB/s 2024-09-17T01:46:01.847 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.848 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.848 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135394 s, 77.4 MB/s 2024-09-17T01:46:01.865 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.865 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.865 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143332 s, 73.2 MB/s 2024-09-17T01:46:01.882 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.882 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.882 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135844 s, 77.2 MB/s 2024-09-17T01:46:01.899 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.899 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.899 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140834 s, 74.5 MB/s 2024-09-17T01:46:01.916 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.917 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.917 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141985 s, 73.9 MB/s 2024-09-17T01:46:01.933 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.933 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.934 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138946 s, 75.5 MB/s 2024-09-17T01:46:01.951 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:01.951 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:01.951 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140524 s, 74.6 MB/s 2024-09-17T01:46:01.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:46:01.960 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:46:01.960 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:46:01.960 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.23 2024-09-17T01:46:01.960 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:46:01.960 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:46:01.960 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:46:01.960 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:46:02.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:46:02.065 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.065 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.065 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188351 s, 55.7 MB/s 2024-09-17T01:46:02.088 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.089 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.089 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206095 s, 50.9 MB/s 2024-09-17T01:46:02.108 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.108 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.108 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168658 s, 62.2 MB/s 2024-09-17T01:46:02.129 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.129 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.130 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180959 s, 57.9 MB/s 2024-09-17T01:46:02.149 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.149 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.149 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163565 s, 64.1 MB/s 2024-09-17T01:46:02.167 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.167 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.168 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150687 s, 69.6 MB/s 2024-09-17T01:46:02.185 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.185 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.185 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140655 s, 74.5 MB/s 2024-09-17T01:46:02.203 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.203 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.203 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148778 s, 70.5 MB/s 2024-09-17T01:46:02.223 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.223 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.223 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172619 s, 60.7 MB/s 2024-09-17T01:46:02.242 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.242 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.242 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015612 s, 67.2 MB/s 2024-09-17T01:46:02.262 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.262 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.262 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167451 s, 62.6 MB/s 2024-09-17T01:46:02.279 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.280 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.280 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144859 s, 72.4 MB/s 2024-09-17T01:46:02.297 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.297 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.297 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141866 s, 73.9 MB/s 2024-09-17T01:46:02.316 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.317 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.317 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167299 s, 62.7 MB/s 2024-09-17T01:46:02.331 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.331 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.331 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116117 s, 90.3 MB/s 2024-09-17T01:46:02.350 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.350 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.350 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155417 s, 67.5 MB/s 2024-09-17T01:46:02.364 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.364 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.364 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110973 s, 94.5 MB/s 2024-09-17T01:46:02.382 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.382 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.383 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151891 s, 69.0 MB/s 2024-09-17T01:46:02.400 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.400 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.400 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139795 s, 75.0 MB/s 2024-09-17T01:46:02.416 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.417 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.417 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135589 s, 77.3 MB/s 2024-09-17T01:46:02.434 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.434 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.435 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139949 s, 74.9 MB/s 2024-09-17T01:46:02.450 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.451 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.451 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140642 s, 74.6 MB/s 2024-09-17T01:46:02.468 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.469 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.469 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146185 s, 71.7 MB/s 2024-09-17T01:46:02.486 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.486 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.486 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141589 s, 74.1 MB/s 2024-09-17T01:46:02.503 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.503 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.503 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014258 s, 73.5 MB/s 2024-09-17T01:46:02.520 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.520 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.520 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138103 s, 75.9 MB/s 2024-09-17T01:46:02.537 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.537 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.537 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144509 s, 72.6 MB/s 2024-09-17T01:46:02.556 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.556 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.557 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159359 s, 65.8 MB/s 2024-09-17T01:46:02.579 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.579 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.579 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192295 s, 54.5 MB/s 2024-09-17T01:46:02.596 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.596 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.596 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138685 s, 75.6 MB/s 2024-09-17T01:46:02.615 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.615 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.615 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158318 s, 66.2 MB/s 2024-09-17T01:46:02.633 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.633 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.633 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146795 s, 71.4 MB/s 2024-09-17T01:46:02.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:46:02.642 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:46:02.642 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:46:02.642 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.24 2024-09-17T01:46:02.642 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:46:02.642 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:46:02.642 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:46:02.642 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:46:02.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:46:02.742 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.742 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.743 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139185 s, 75.3 MB/s 2024-09-17T01:46:02.762 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.762 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.762 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162872 s, 64.4 MB/s 2024-09-17T01:46:02.779 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.779 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.779 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139878 s, 75.0 MB/s 2024-09-17T01:46:02.797 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.797 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.798 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152424 s, 68.8 MB/s 2024-09-17T01:46:02.815 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.815 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.815 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140018 s, 74.9 MB/s 2024-09-17T01:46:02.833 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.834 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.834 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015616 s, 67.1 MB/s 2024-09-17T01:46:02.851 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.851 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.851 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143172 s, 73.2 MB/s 2024-09-17T01:46:02.868 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.868 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.868 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013861 s, 75.6 MB/s 2024-09-17T01:46:02.890 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.890 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.890 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186984 s, 56.1 MB/s 2024-09-17T01:46:02.909 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.909 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.909 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158713 s, 66.1 MB/s 2024-09-17T01:46:02.926 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.926 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.926 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141591 s, 74.1 MB/s 2024-09-17T01:46:02.945 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.945 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.945 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160022 s, 65.5 MB/s 2024-09-17T01:46:02.965 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.965 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.965 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160942 s, 65.2 MB/s 2024-09-17T01:46:02.983 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:02.983 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:02.983 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154534 s, 67.9 MB/s 2024-09-17T01:46:03.000 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.000 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.000 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135592 s, 77.3 MB/s 2024-09-17T01:46:03.017 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.017 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.017 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137384 s, 76.3 MB/s 2024-09-17T01:46:03.036 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.036 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.036 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154417 s, 67.9 MB/s 2024-09-17T01:46:03.054 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.054 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.054 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143393 s, 73.1 MB/s 2024-09-17T01:46:03.071 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.072 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.072 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143781 s, 72.9 MB/s 2024-09-17T01:46:03.089 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.089 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.089 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140693 s, 74.5 MB/s 2024-09-17T01:46:03.105 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.106 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.106 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139276 s, 75.3 MB/s 2024-09-17T01:46:03.123 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.123 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.123 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139085 s, 75.4 MB/s 2024-09-17T01:46:03.140 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.140 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.140 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142643 s, 73.5 MB/s 2024-09-17T01:46:03.163 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.163 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.163 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192341 s, 54.5 MB/s 2024-09-17T01:46:03.180 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.180 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.180 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140082 s, 74.9 MB/s 2024-09-17T01:46:03.197 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.198 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.198 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145392 s, 72.1 MB/s 2024-09-17T01:46:03.217 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.217 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.217 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159173 s, 65.9 MB/s 2024-09-17T01:46:03.233 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.234 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.234 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140108 s, 74.8 MB/s 2024-09-17T01:46:03.251 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.251 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.251 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013745 s, 76.3 MB/s 2024-09-17T01:46:03.268 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.268 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.268 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137753 s, 76.1 MB/s 2024-09-17T01:46:03.285 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.285 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.286 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145518 s, 72.1 MB/s 2024-09-17T01:46:03.307 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.307 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.307 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180664 s, 58.0 MB/s 2024-09-17T01:46:03.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:46:03.316 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:46:03.316 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:46:03.316 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.25 2024-09-17T01:46:03.317 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:46:03.317 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:46:03.317 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:46:03.317 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:46:03.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:46:03.424 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.424 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214636 s, 48.9 MB/s 2024-09-17T01:46:03.444 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.444 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.444 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016534 s, 63.4 MB/s 2024-09-17T01:46:03.462 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.876 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.876 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015226 s, 68.9 MB/s 2024-09-17T01:46:03.878 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.878 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.879 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129125 s, 81.2 MB/s 2024-09-17T01:46:03.879 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.879 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.879 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141397 s, 74.2 MB/s 2024-09-17T01:46:03.879 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.879 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.879 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140242 s, 74.8 MB/s 2024-09-17T01:46:03.879 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.879 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.879 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181234 s, 57.9 MB/s 2024-09-17T01:46:03.879 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.879 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.880 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013959 s, 75.1 MB/s 2024-09-17T01:46:03.880 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.880 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.880 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210923 s, 49.7 MB/s 2024-09-17T01:46:03.880 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.880 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.880 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199465 s, 52.6 MB/s 2024-09-17T01:46:03.880 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.880 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.880 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152103 s, 68.9 MB/s 2024-09-17T01:46:03.880 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.880 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.880 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151614 s, 69.2 MB/s 2024-09-17T01:46:03.881 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.881 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.881 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121305 s, 86.4 MB/s 2024-09-17T01:46:03.881 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.881 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.881 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160646 s, 65.3 MB/s 2024-09-17T01:46:03.881 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.881 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.881 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169761 s, 61.8 MB/s 2024-09-17T01:46:03.881 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.881 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.881 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015149 s, 69.2 MB/s 2024-09-17T01:46:03.882 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.882 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.882 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015785 s, 66.4 MB/s 2024-09-17T01:46:03.882 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.882 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.882 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182571 s, 57.4 MB/s 2024-09-17T01:46:03.882 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.882 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.882 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168185 s, 62.3 MB/s 2024-09-17T01:46:03.882 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.882 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.882 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178764 s, 58.7 MB/s 2024-09-17T01:46:03.882 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.882 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.883 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154171 s, 68.0 MB/s 2024-09-17T01:46:03.883 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.883 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.883 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157983 s, 66.4 MB/s 2024-09-17T01:46:03.883 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.883 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.883 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141149 s, 74.3 MB/s 2024-09-17T01:46:03.883 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.883 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.883 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160551 s, 65.3 MB/s 2024-09-17T01:46:03.888 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.888 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.888 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171546 s, 61.1 MB/s 2024-09-17T01:46:03.906 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.906 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.906 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152206 s, 68.9 MB/s 2024-09-17T01:46:03.924 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.924 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.924 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144121 s, 72.8 MB/s 2024-09-17T01:46:03.941 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.941 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.941 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139756 s, 75.0 MB/s 2024-09-17T01:46:03.961 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.961 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.961 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173594 s, 60.4 MB/s 2024-09-17T01:46:03.984 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:03.984 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:03.984 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199881 s, 52.5 MB/s 2024-09-17T01:46:04.005 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.005 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.005 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176326 s, 59.5 MB/s 2024-09-17T01:46:04.022 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.022 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.022 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140855 s, 74.4 MB/s 2024-09-17T01:46:04.023 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:46:04.031 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:46:04.031 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:46:04.032 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.26 2024-09-17T01:46:04.032 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:46:04.032 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:46:04.032 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:46:04.032 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:46:04.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:46:04.133 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.133 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.133 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148905 s, 70.4 MB/s 2024-09-17T01:46:04.150 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.150 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.150 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134998 s, 77.7 MB/s 2024-09-17T01:46:04.166 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.166 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.166 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127317 s, 82.4 MB/s 2024-09-17T01:46:04.188 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.188 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.188 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190735 s, 55.0 MB/s 2024-09-17T01:46:04.205 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.205 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.205 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014079 s, 74.5 MB/s 2024-09-17T01:46:04.222 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.223 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.223 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144866 s, 72.4 MB/s 2024-09-17T01:46:04.242 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.242 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.242 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161026 s, 65.1 MB/s 2024-09-17T01:46:04.259 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.260 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.260 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143531 s, 73.1 MB/s 2024-09-17T01:46:04.276 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.277 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.277 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136201 s, 77.0 MB/s 2024-09-17T01:46:04.294 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.294 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.294 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145197 s, 72.2 MB/s 2024-09-17T01:46:04.312 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.312 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.312 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148729 s, 70.5 MB/s 2024-09-17T01:46:04.332 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.332 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.332 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163808 s, 64.0 MB/s 2024-09-17T01:46:04.350 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.350 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.351 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149787 s, 70.0 MB/s 2024-09-17T01:46:04.372 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.372 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.372 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185642 s, 56.5 MB/s 2024-09-17T01:46:04.391 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.391 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.391 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158676 s, 66.1 MB/s 2024-09-17T01:46:04.408 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.408 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.408 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139088 s, 75.4 MB/s 2024-09-17T01:46:04.429 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.429 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.429 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176149 s, 59.5 MB/s 2024-09-17T01:46:04.446 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.447 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.447 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145618 s, 72.0 MB/s 2024-09-17T01:46:04.464 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.464 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.464 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143653 s, 73.0 MB/s 2024-09-17T01:46:04.484 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.484 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.484 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165007 s, 63.5 MB/s 2024-09-17T01:46:04.504 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.504 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.504 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014665 s, 71.5 MB/s 2024-09-17T01:46:04.520 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.520 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.520 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147385 s, 71.1 MB/s 2024-09-17T01:46:04.537 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.537 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.537 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143077 s, 73.3 MB/s 2024-09-17T01:46:04.555 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.555 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.555 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147714 s, 71.0 MB/s 2024-09-17T01:46:04.572 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.573 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.573 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142642 s, 73.5 MB/s 2024-09-17T01:46:04.591 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.591 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.591 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015431 s, 68.0 MB/s 2024-09-17T01:46:04.615 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.615 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.615 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202292 s, 51.8 MB/s 2024-09-17T01:46:04.632 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.632 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.632 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140391 s, 74.7 MB/s 2024-09-17T01:46:04.649 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.649 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.649 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135786 s, 77.2 MB/s 2024-09-17T01:46:04.666 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.666 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.666 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141691 s, 74.0 MB/s 2024-09-17T01:46:04.682 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.682 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.682 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128966 s, 81.3 MB/s 2024-09-17T01:46:04.701 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.701 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.701 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157754 s, 66.5 MB/s 2024-09-17T01:46:04.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:46:04.710 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:46:04.711 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:46:04.711 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.27 2024-09-17T01:46:04.711 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:46:04.711 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:46:04.711 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:46:04.711 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:46:04.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:46:04.856 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.856 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.857 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138366 s, 75.8 MB/s 2024-09-17T01:46:04.877 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.877 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.878 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179224 s, 58.5 MB/s 2024-09-17T01:46:04.894 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.894 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.894 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139005 s, 75.4 MB/s 2024-09-17T01:46:04.917 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.917 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.917 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019357 s, 54.2 MB/s 2024-09-17T01:46:04.937 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.938 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.938 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173873 s, 60.3 MB/s 2024-09-17T01:46:04.956 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.956 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.957 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158046 s, 66.3 MB/s 2024-09-17T01:46:04.975 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.975 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.976 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159081 s, 65.9 MB/s 2024-09-17T01:46:04.992 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:04.992 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:04.993 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135329 s, 77.5 MB/s 2024-09-17T01:46:05.009 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.009 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.009 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138301 s, 75.8 MB/s 2024-09-17T01:46:05.028 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.028 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.028 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158283 s, 66.2 MB/s 2024-09-17T01:46:05.046 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.046 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.046 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147287 s, 71.2 MB/s 2024-09-17T01:46:05.063 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.063 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.063 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142481 s, 73.6 MB/s 2024-09-17T01:46:05.083 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.083 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.083 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162554 s, 64.5 MB/s 2024-09-17T01:46:05.099 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.099 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.099 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135409 s, 77.4 MB/s 2024-09-17T01:46:05.117 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.117 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.117 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140584 s, 74.6 MB/s 2024-09-17T01:46:05.134 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.134 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.134 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143678 s, 73.0 MB/s 2024-09-17T01:46:05.155 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.156 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.156 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018033 s, 58.1 MB/s 2024-09-17T01:46:05.174 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.175 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.175 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158252 s, 66.3 MB/s 2024-09-17T01:46:05.191 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.191 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.192 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137798 s, 76.1 MB/s 2024-09-17T01:46:05.213 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.213 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.213 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178494 s, 58.7 MB/s 2024-09-17T01:46:05.229 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.229 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.229 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137471 s, 76.3 MB/s 2024-09-17T01:46:05.250 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.251 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.251 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181902 s, 57.6 MB/s 2024-09-17T01:46:05.268 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.268 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.268 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138012 s, 76.0 MB/s 2024-09-17T01:46:05.286 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.286 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.286 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151477 s, 69.2 MB/s 2024-09-17T01:46:05.303 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.303 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.303 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134836 s, 77.8 MB/s 2024-09-17T01:46:05.320 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.320 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.320 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013039 s, 80.4 MB/s 2024-09-17T01:46:05.336 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.337 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.337 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143408 s, 73.1 MB/s 2024-09-17T01:46:05.358 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.358 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.358 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183627 s, 57.1 MB/s 2024-09-17T01:46:05.375 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.376 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.376 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014028 s, 74.7 MB/s 2024-09-17T01:46:05.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.396 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174721 s, 60.0 MB/s 2024-09-17T01:46:05.414 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.414 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.414 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148131 s, 70.8 MB/s 2024-09-17T01:46:05.431 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.431 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.431 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137261 s, 76.4 MB/s 2024-09-17T01:46:05.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:46:05.440 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:46:05.440 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:46:05.440 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.28 2024-09-17T01:46:05.441 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:46:05.441 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:46:05.441 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:46:05.441 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:46:05.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:46:05.548 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.548 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.548 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206088 s, 50.9 MB/s 2024-09-17T01:46:05.567 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.567 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.567 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160363 s, 65.4 MB/s 2024-09-17T01:46:05.585 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.585 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.585 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147344 s, 71.2 MB/s 2024-09-17T01:46:05.603 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.603 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.603 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145579 s, 72.0 MB/s 2024-09-17T01:46:05.623 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.623 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.623 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01704 s, 61.5 MB/s 2024-09-17T01:46:05.641 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.641 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.641 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153135 s, 68.5 MB/s 2024-09-17T01:46:05.659 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.659 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.659 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145425 s, 72.1 MB/s 2024-09-17T01:46:05.677 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.678 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.678 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154481 s, 67.9 MB/s 2024-09-17T01:46:05.695 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.695 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.695 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140276 s, 74.8 MB/s 2024-09-17T01:46:05.713 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.714 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.714 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154064 s, 68.1 MB/s 2024-09-17T01:46:05.736 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.737 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.737 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196747 s, 53.3 MB/s 2024-09-17T01:46:05.753 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.754 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.754 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141867 s, 73.9 MB/s 2024-09-17T01:46:05.771 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.772 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.772 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146785 s, 71.4 MB/s 2024-09-17T01:46:05.789 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.789 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.789 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143197 s, 73.2 MB/s 2024-09-17T01:46:05.806 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.807 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.807 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141672 s, 74.0 MB/s 2024-09-17T01:46:05.825 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.825 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.825 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148812 s, 70.5 MB/s 2024-09-17T01:46:05.849 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.849 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.849 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207191 s, 50.6 MB/s 2024-09-17T01:46:05.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.866 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138624 s, 75.6 MB/s 2024-09-17T01:46:05.883 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.883 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.883 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143611 s, 73.0 MB/s 2024-09-17T01:46:05.902 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.902 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.902 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155766 s, 67.3 MB/s 2024-09-17T01:46:05.923 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.923 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.923 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180657 s, 58.0 MB/s 2024-09-17T01:46:05.940 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.940 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.941 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141071 s, 74.3 MB/s 2024-09-17T01:46:05.957 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.957 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.957 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01354 s, 77.4 MB/s 2024-09-17T01:46:05.975 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.975 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.975 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149612 s, 70.1 MB/s 2024-09-17T01:46:05.995 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:05.995 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:05.995 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167397 s, 62.6 MB/s 2024-09-17T01:46:06.016 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.016 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.016 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183172 s, 57.2 MB/s 2024-09-17T01:46:06.033 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.033 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.033 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137221 s, 76.4 MB/s 2024-09-17T01:46:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143658 s, 73.0 MB/s 2024-09-17T01:46:06.069 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.070 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.070 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156259 s, 67.1 MB/s 2024-09-17T01:46:06.084 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.084 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.084 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111014 s, 94.5 MB/s 2024-09-17T01:46:06.101 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.101 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.102 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146751 s, 71.5 MB/s 2024-09-17T01:46:06.119 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.119 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.119 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014528 s, 72.2 MB/s 2024-09-17T01:46:06.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:46:06.128 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:46:06.128 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:46:06.128 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.29 2024-09-17T01:46:06.128 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:46:06.128 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:46:06.128 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:46:06.128 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:46:06.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:46:06.231 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.231 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.231 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015621 s, 67.1 MB/s 2024-09-17T01:46:06.249 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.249 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.250 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157495 s, 66.6 MB/s 2024-09-17T01:46:06.272 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.272 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.272 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192321 s, 54.5 MB/s 2024-09-17T01:46:06.290 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.290 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.290 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151904 s, 69.0 MB/s 2024-09-17T01:46:06.309 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.309 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.309 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153581 s, 68.3 MB/s 2024-09-17T01:46:06.327 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.327 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.327 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148435 s, 70.6 MB/s 2024-09-17T01:46:06.347 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.347 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.347 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168931 s, 62.1 MB/s 2024-09-17T01:46:06.364 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.364 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.365 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144613 s, 72.5 MB/s 2024-09-17T01:46:06.382 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.382 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.382 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145378 s, 72.1 MB/s 2024-09-17T01:46:06.399 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.399 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.399 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143565 s, 73.0 MB/s 2024-09-17T01:46:06.420 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.421 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.421 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178711 s, 58.7 MB/s 2024-09-17T01:46:06.438 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.439 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.439 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150303 s, 69.8 MB/s 2024-09-17T01:46:06.457 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.458 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.458 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155451 s, 67.5 MB/s 2024-09-17T01:46:06.475 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.476 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.476 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152426 s, 68.8 MB/s 2024-09-17T01:46:06.493 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.494 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.494 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149083 s, 70.3 MB/s 2024-09-17T01:46:06.514 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.514 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.515 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176511 s, 59.4 MB/s 2024-09-17T01:46:06.533 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.534 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.534 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158108 s, 66.3 MB/s 2024-09-17T01:46:06.552 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.552 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.552 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153586 s, 68.3 MB/s 2024-09-17T01:46:06.570 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.570 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.570 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146582 s, 71.5 MB/s 2024-09-17T01:46:06.592 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.592 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.592 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187479 s, 55.9 MB/s 2024-09-17T01:46:06.610 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.610 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.610 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151339 s, 69.3 MB/s 2024-09-17T01:46:06.625 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.625 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.625 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122443 s, 85.6 MB/s 2024-09-17T01:46:06.643 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.644 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.644 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153647 s, 68.2 MB/s 2024-09-17T01:46:06.662 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.662 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.662 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150078 s, 69.9 MB/s 2024-09-17T01:46:06.679 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.679 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.679 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142972 s, 73.3 MB/s 2024-09-17T01:46:06.694 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.694 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.694 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114772 s, 91.4 MB/s 2024-09-17T01:46:06.714 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.714 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.714 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169121 s, 62.0 MB/s 2024-09-17T01:46:06.731 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.731 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.731 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143217 s, 73.2 MB/s 2024-09-17T01:46:06.749 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.749 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.749 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145729 s, 72.0 MB/s 2024-09-17T01:46:06.772 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.772 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.772 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019676 s, 53.3 MB/s 2024-09-17T01:46:06.786 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.786 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.786 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111746 s, 93.8 MB/s 2024-09-17T01:46:06.802 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.803 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.803 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135322 s, 77.5 MB/s 2024-09-17T01:46:06.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:46:06.812 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:46:06.812 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:46:06.812 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.30 2024-09-17T01:46:06.812 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:46:06.812 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:46:06.812 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:46:06.812 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:46:06.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:46:06.914 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.914 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.914 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159827 s, 65.6 MB/s 2024-09-17T01:46:06.932 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.933 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.933 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152166 s, 68.9 MB/s 2024-09-17T01:46:06.957 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.957 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.957 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184105 s, 57.0 MB/s 2024-09-17T01:46:06.977 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.977 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.977 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020019 s, 52.4 MB/s 2024-09-17T01:46:06.992 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:06.992 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:06.992 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113659 s, 92.3 MB/s 2024-09-17T01:46:07.009 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.009 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.009 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136051 s, 77.1 MB/s 2024-09-17T01:46:07.028 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.028 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.028 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167313 s, 62.7 MB/s 2024-09-17T01:46:07.046 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.046 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.046 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144225 s, 72.7 MB/s 2024-09-17T01:46:07.067 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.067 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.068 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184095 s, 57.0 MB/s 2024-09-17T01:46:07.085 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.085 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.086 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150914 s, 69.5 MB/s 2024-09-17T01:46:07.102 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.102 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.102 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133836 s, 78.3 MB/s 2024-09-17T01:46:07.127 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.127 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.127 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217553 s, 48.2 MB/s 2024-09-17T01:46:07.151 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.151 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.151 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209136 s, 50.1 MB/s 2024-09-17T01:46:07.170 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.170 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.170 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158041 s, 66.3 MB/s 2024-09-17T01:46:07.188 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.188 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.188 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150578 s, 69.6 MB/s 2024-09-17T01:46:07.209 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.209 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.209 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018077 s, 58.0 MB/s 2024-09-17T01:46:07.223 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.223 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.223 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109909 s, 95.4 MB/s 2024-09-17T01:46:07.245 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.245 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.245 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189542 s, 55.3 MB/s 2024-09-17T01:46:07.267 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.267 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.267 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190132 s, 55.2 MB/s 2024-09-17T01:46:07.284 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.284 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.284 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135747 s, 77.2 MB/s 2024-09-17T01:46:07.302 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.302 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.302 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147683 s, 71.0 MB/s 2024-09-17T01:46:07.320 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.320 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.320 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149204 s, 70.3 MB/s 2024-09-17T01:46:07.337 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.338 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.338 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014337 s, 73.1 MB/s 2024-09-17T01:46:07.355 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.355 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.355 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141849 s, 73.9 MB/s 2024-09-17T01:46:07.372 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.373 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.373 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145127 s, 72.3 MB/s 2024-09-17T01:46:07.393 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.393 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.393 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170642 s, 61.4 MB/s 2024-09-17T01:46:07.411 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.411 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.411 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01475 s, 71.1 MB/s 2024-09-17T01:46:07.427 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.427 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.427 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129745 s, 80.8 MB/s 2024-09-17T01:46:07.445 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.445 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.445 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149804 s, 70.0 MB/s 2024-09-17T01:46:07.463 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.463 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.463 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152046 s, 69.0 MB/s 2024-09-17T01:46:07.485 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.485 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.485 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184691 s, 56.8 MB/s 2024-09-17T01:46:07.506 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.506 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.506 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177372 s, 59.1 MB/s 2024-09-17T01:46:07.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:46:07.515 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-17T01:46:07.515 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:46:07.515 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p scrub_control_test_path/dir.31 2024-09-17T01:46:07.515 DEBUG:teuthology.orchestra.run.smithi042:> for ((i = 0; i < 32; i++)); do 2024-09-17T01:46:07.515 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-17T01:46:07.516 DEBUG:teuthology.orchestra.run.smithi042:> done 2024-09-17T01:46:07.516 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:46:07.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:46:07.615 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.615 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.615 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137259 s, 76.4 MB/s 2024-09-17T01:46:07.633 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.633 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.633 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151767 s, 69.1 MB/s 2024-09-17T01:46:07.654 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.654 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.655 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178786 s, 58.6 MB/s 2024-09-17T01:46:07.675 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.675 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.675 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177954 s, 58.9 MB/s 2024-09-17T01:46:07.694 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.694 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.694 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159188 s, 65.9 MB/s 2024-09-17T01:46:07.718 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.718 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.718 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204243 s, 51.3 MB/s 2024-09-17T01:46:07.737 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.737 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.737 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154955 s, 67.7 MB/s 2024-09-17T01:46:07.755 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.755 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.755 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148462 s, 70.6 MB/s 2024-09-17T01:46:07.774 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.775 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.775 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162599 s, 64.5 MB/s 2024-09-17T01:46:07.791 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.792 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.792 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141023 s, 74.4 MB/s 2024-09-17T01:46:07.809 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.809 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.809 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014239 s, 73.6 MB/s 2024-09-17T01:46:07.826 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.826 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.827 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144049 s, 72.8 MB/s 2024-09-17T01:46:07.847 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.847 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.847 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168622 s, 62.2 MB/s 2024-09-17T01:46:07.865 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.866 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.866 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156857 s, 66.8 MB/s 2024-09-17T01:46:07.882 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.882 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.882 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137325 s, 76.4 MB/s 2024-09-17T01:46:07.900 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.900 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.900 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145715 s, 72.0 MB/s 2024-09-17T01:46:07.915 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.915 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.916 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123519 s, 84.9 MB/s 2024-09-17T01:46:07.932 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.933 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.933 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140166 s, 74.8 MB/s 2024-09-17T01:46:07.950 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.950 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.950 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014299 s, 73.3 MB/s 2024-09-17T01:46:07.971 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.971 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.971 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175494 s, 59.7 MB/s 2024-09-17T01:46:07.988 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:07.988 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:07.988 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137634 s, 76.2 MB/s 2024-09-17T01:46:08.006 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:08.006 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:08.006 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147445 s, 71.1 MB/s 2024-09-17T01:46:08.023 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:08.023 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:08.023 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140707 s, 74.5 MB/s 2024-09-17T01:46:08.043 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:08.043 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:08.043 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166237 s, 63.1 MB/s 2024-09-17T01:46:08.064 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:08.065 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:08.065 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183516 s, 57.1 MB/s 2024-09-17T01:46:08.080 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:08.080 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:08.080 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121013 s, 86.7 MB/s 2024-09-17T01:46:08.104 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:08.104 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:08.104 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210313 s, 49.9 MB/s 2024-09-17T01:46:08.122 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:08.123 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:08.123 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015524 s, 67.5 MB/s 2024-09-17T01:46:08.144 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:08.144 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:08.144 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183141 s, 57.3 MB/s 2024-09-17T01:46:08.162 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:08.163 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:08.163 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153811 s, 68.2 MB/s 2024-09-17T01:46:08.180 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:08.181 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:08.181 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150453 s, 69.7 MB/s 2024-09-17T01:46:08.198 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T01:46:08.198 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T01:46:08.198 INFO:teuthology.orchestra.run.smithi042.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143019 s, 73.3 MB/s 2024-09-17T01:46:08.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:46:08.207 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-09-17T01:46:08.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.440+0000 7f8debc00640 1 -- 172.21.15.42:0/3528921819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8de4074500 msgr2=0x7f8de406eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:08.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.440+0000 7f8debc00640 1 --2- 172.21.15.42:0/3528921819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8de4074500 0x7f8de406eec0 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f8de415fed0 tx=0x7f8dd002a540 comp rx=0 tx=0).stop 2024-09-17T01:46:08.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.440+0000 7f8debc00640 1 -- 172.21.15.42:0/3528921819 shutdown_connections 2024-09-17T01:46:08.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.440+0000 7f8debc00640 1 --2- 172.21.15.42:0/3528921819 >> v2:172.21.15.43:3300/0 conn(0x7f8de415f740 0x7f8de406d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:08.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.440+0000 7f8debc00640 1 --2- 172.21.15.42:0/3528921819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8de4074500 0x7f8de406eec0 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:08.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.440+0000 7f8debc00640 1 --2- 172.21.15.42:0/3528921819 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8de40740f0 0x7f8de415f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:08.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.440+0000 7f8debc00640 1 -- 172.21.15.42:0/3528921819 >> 172.21.15.42:0/3528921819 conn(0x7f8de40b2930 msgr2=0x7f8de406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:08.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.440+0000 7f8debc00640 1 -- 172.21.15.42:0/3528921819 shutdown_connections 2024-09-17T01:46:08.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.440+0000 7f8debc00640 1 -- 172.21.15.42:0/3528921819 wait complete. 2024-09-17T01:46:08.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.442+0000 7f8debc00640 1 Processor -- start 2024-09-17T01:46:08.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.443+0000 7f8debc00640 1 -- start start 2024-09-17T01:46:08.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.444+0000 7f8debc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8de40740f0 0x7f8de4146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:08.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.444+0000 7f8debc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8de415f740 0x7f8de41493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:08.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.444+0000 7f8debc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8de40b4640 0x7f8de40b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:08.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.444+0000 7f8debc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8de406dd00 con 0x7f8de40b4640 2024-09-17T01:46:08.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.444+0000 7f8debc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8de406db80 con 0x7f8de40740f0 2024-09-17T01:46:08.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.444+0000 7f8debc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8de40cef40 con 0x7f8de415f740 2024-09-17T01:46:08.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.444+0000 7f8de9c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8de40b4640 0x7f8de40b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:08.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.444+0000 7f8de9c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8de40b4640 0x7f8de40b4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49880/0 (socket says 172.21.15.42:49880) 2024-09-17T01:46:08.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.444+0000 7f8de9c00640 1 -- 172.21.15.42:0/3822009291 learned_addr learned my addr 172.21.15.42:0/3822009291 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:08.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.445+0000 7f8de3e00640 1 --2- 172.21.15.42:0/3822009291 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8de415f740 0x7f8de41493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:08.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.445+0000 7f8de9200640 1 --2- 172.21.15.42:0/3822009291 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8de40740f0 0x7f8de4146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:08.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.445+0000 7f8de9c00640 1 -- 172.21.15.42:0/3822009291 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8de415f740 msgr2=0x7f8de41493f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:08.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.445+0000 7f8de9c00640 1 --2- 172.21.15.42:0/3822009291 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8de415f740 0x7f8de41493f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:08.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.445+0000 7f8de9c00640 1 -- 172.21.15.42:0/3822009291 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8de40740f0 msgr2=0x7f8de4146180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:08.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.445+0000 7f8de9c00640 1 --2- 172.21.15.42:0/3822009291 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8de40740f0 0x7f8de4146180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:08.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.445+0000 7f8de9c00640 1 -- 172.21.15.42:0/3822009291 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de4149930 con 0x7f8de40b4640 2024-09-17T01:46:08.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.445+0000 7f8de9c00640 1 --2- 172.21.15.42:0/3822009291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8de40b4640 0x7f8de40b4a50 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc00ea40 tx=0x7f8ddc00ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:08.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.445+0000 7f8de0c00640 1 -- 172.21.15.42:0/3822009291 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc00ce40 con 0x7f8de40b4640 2024-09-17T01:46:08.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.446+0000 7f8de0c00640 1 -- 172.21.15.42:0/3822009291 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ddc004c10 con 0x7f8de40b4640 2024-09-17T01:46:08.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.446+0000 7f8de0c00640 1 -- 172.21.15.42:0/3822009291 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc005020 con 0x7f8de40b4640 2024-09-17T01:46:08.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.446+0000 7f8debc00640 1 -- 172.21.15.42:0/3822009291 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de40b4f90 con 0x7f8de40b4640 2024-09-17T01:46:08.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.446+0000 7f8debc00640 1 -- 172.21.15.42:0/3822009291 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de41f5de0 con 0x7f8de40b4640 2024-09-17T01:46:08.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.447+0000 7f8debc00640 1 -- 172.21.15.42:0/3822009291 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8de4074500 con 0x7f8de40b4640 2024-09-17T01:46:08.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.448+0000 7f8de0c00640 1 -- 172.21.15.42:0/3822009291 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8ddc0051c0 con 0x7f8de40b4640 2024-09-17T01:46:08.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.449+0000 7f8de0c00640 1 --2- 172.21.15.42:0/3822009291 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8dc4078b90 0x7f8dc407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:08.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.449+0000 7f8de0c00640 1 -- 172.21.15.42:0/3822009291 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7f8ddc09baf0 con 0x7f8de40b4640 2024-09-17T01:46:08.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.450+0000 7f8de9200640 1 --2- 172.21.15.42:0/3822009291 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8dc4078b90 0x7f8dc407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:08.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.450+0000 7f8de9200640 1 --2- 172.21.15.42:0/3822009291 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8dc4078b90 0x7f8dc407b0a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8005fd0 tx=0x7f8dd800b260 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:08.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.453+0000 7f8de0c00640 1 -- 172.21.15.42:0/3822009291 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8de40b4f90 con 0x7f8de40b4640 2024-09-17T01:46:08.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.684+0000 7f8debc00640 1 -- 172.21.15.42:0/3822009291 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7f8de41f5b70 con 0x7f8de40b4640 2024-09-17T01:46:08.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.829+0000 7f8de0c00640 1 -- 172.21.15.42:0/3822009291 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v140) ==== 105+0+0 (secure 0 0 0) 0x7f8de4149930 con 0x7f8de40b4640 2024-09-17T01:46:08.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.832+0000 7f8debc00640 1 -- 172.21.15.42:0/3822009291 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8dc4078b90 msgr2=0x7f8dc407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:08.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.833+0000 7f8debc00640 1 --2- 172.21.15.42:0/3822009291 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8dc4078b90 0x7f8dc407b0a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8005fd0 tx=0x7f8dd800b260 comp rx=0 tx=0).stop 2024-09-17T01:46:08.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.833+0000 7f8debc00640 1 -- 172.21.15.42:0/3822009291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8de40b4640 msgr2=0x7f8de40b4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:08.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.833+0000 7f8debc00640 1 --2- 172.21.15.42:0/3822009291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8de40b4640 0x7f8de40b4a50 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc00ea40 tx=0x7f8ddc00ef00 comp rx=0 tx=0).stop 2024-09-17T01:46:08.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.833+0000 7f8debc00640 1 -- 172.21.15.42:0/3822009291 shutdown_connections 2024-09-17T01:46:08.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.833+0000 7f8debc00640 1 --2- 172.21.15.42:0/3822009291 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8dc4078b90 0x7f8dc407b0a0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:08.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.833+0000 7f8debc00640 1 --2- 172.21.15.42:0/3822009291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8de40b4640 0x7f8de40b4a50 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:08.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.833+0000 7f8debc00640 1 --2- 172.21.15.42:0/3822009291 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8de415f740 0x7f8de41493f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:08.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.833+0000 7f8debc00640 1 --2- 172.21.15.42:0/3822009291 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8de40740f0 0x7f8de4146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:08.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.833+0000 7f8debc00640 1 -- 172.21.15.42:0/3822009291 >> 172.21.15.42:0/3822009291 conn(0x7f8de40b2930 msgr2=0x7f8de4158700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:08.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.833+0000 7f8debc00640 1 -- 172.21.15.42:0/3822009291 shutdown_connections 2024-09-17T01:46:08.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:08.833+0000 7f8debc00640 1 -- 172.21.15.42:0/3822009291 wait complete. 2024-09-17T01:46:08.852 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-09-17T01:46:09.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.084+0000 7f06db400640 1 -- 172.21.15.42:0/2015916605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06d415f480 msgr2=0x7f06d415f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:09.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.084+0000 7f06db400640 1 --2- 172.21.15.42:0/2015916605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06d415f480 0x7f06d415f890 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f06cc005fd0 tx=0x7f06cc02a8d0 comp rx=0 tx=0).stop 2024-09-17T01:46:09.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.084+0000 7f06db400640 1 -- 172.21.15.42:0/2015916605 shutdown_connections 2024-09-17T01:46:09.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.084+0000 7f06db400640 1 --2- 172.21.15.42:0/2015916605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06d415f480 0x7f06d415f890 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:09.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.084+0000 7f06db400640 1 -- 172.21.15.42:0/2015916605 >> 172.21.15.42:0/2015916605 conn(0x7f06d40b2930 msgr2=0x7f06d406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:09.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.084+0000 7f06db400640 1 -- 172.21.15.42:0/2015916605 shutdown_connections 2024-09-17T01:46:09.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.084+0000 7f06db400640 1 -- 172.21.15.42:0/2015916605 wait complete. 2024-09-17T01:46:09.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.087+0000 7f06db400640 1 Processor -- start 2024-09-17T01:46:09.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.087+0000 7f06db400640 1 -- start start 2024-09-17T01:46:09.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.088+0000 7f06db400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06d406d430 0x7f06d40ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:09.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.088+0000 7f06db400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06d415cb80 0x7f06d40cece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:09.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.088+0000 7f06db400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f06d415f480 0x7f06d41f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:09.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.088+0000 7f06db400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f06d4073900 con 0x7f06d415cb80 2024-09-17T01:46:09.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.088+0000 7f06db400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f06d4073780 con 0x7f06d406d430 2024-09-17T01:46:09.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.088+0000 7f06db400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f06d4073a80 con 0x7f06d415f480 2024-09-17T01:46:09.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.088+0000 7f06d3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06d415cb80 0x7f06d40cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:09.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.089+0000 7f06d3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06d415cb80 0x7f06d40cece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49886/0 (socket says 172.21.15.42:49886) 2024-09-17T01:46:09.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.089+0000 7f06d3e00640 1 -- 172.21.15.42:0/86818124 learned_addr learned my addr 172.21.15.42:0/86818124 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:09.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.089+0000 7f06d8a00640 1 --2- 172.21.15.42:0/86818124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06d406d430 0x7f06d40ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:09.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.089+0000 7f06d9400640 1 --2- 172.21.15.42:0/86818124 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f06d415f480 0x7f06d41f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:09.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.089+0000 7f06d3e00640 1 -- 172.21.15.42:0/86818124 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f06d415f480 msgr2=0x7f06d41f63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:09.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.089+0000 7f06d3e00640 1 --2- 172.21.15.42:0/86818124 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f06d415f480 0x7f06d41f63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:09.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.089+0000 7f06d3e00640 1 -- 172.21.15.42:0/86818124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06d406d430 msgr2=0x7f06d40ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:09.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.089+0000 7f06d3e00640 1 --2- 172.21.15.42:0/86818124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06d406d430 0x7f06d40ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:09.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.089+0000 7f06d3e00640 1 -- 172.21.15.42:0/86818124 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d41f99d0 con 0x7f06d415cb80 2024-09-17T01:46:09.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.089+0000 7f06d3e00640 1 --2- 172.21.15.42:0/86818124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06d415cb80 0x7f06d40cece0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f06c000c730 tx=0x7f06c000cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:09.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.089+0000 7f06d0c00640 1 -- 172.21.15.42:0/86818124 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c000a7e0 con 0x7f06d415cb80 2024-09-17T01:46:09.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.090+0000 7f06d0c00640 1 -- 172.21.15.42:0/86818124 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06c0017070 con 0x7f06d415cb80 2024-09-17T01:46:09.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.090+0000 7f06db400640 1 -- 172.21.15.42:0/86818124 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d41f9cb0 con 0x7f06d415cb80 2024-09-17T01:46:09.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.090+0000 7f06d0c00640 1 -- 172.21.15.42:0/86818124 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c000ad10 con 0x7f06d415cb80 2024-09-17T01:46:09.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.090+0000 7f06db400640 1 -- 172.21.15.42:0/86818124 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d41fa270 con 0x7f06d415cb80 2024-09-17T01:46:09.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.091+0000 7f06db400640 1 -- 172.21.15.42:0/86818124 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d415f890 con 0x7f06d415cb80 2024-09-17T01:46:09.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.092+0000 7f06d0c00640 1 -- 172.21.15.42:0/86818124 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f06c001c460 con 0x7f06d415cb80 2024-09-17T01:46:09.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.093+0000 7f06d0c00640 1 --2- 172.21.15.42:0/86818124 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f06b4078bc0 0x7f06b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:09.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.093+0000 7f06d0c00640 1 -- 172.21.15.42:0/86818124 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7f06c009ad70 con 0x7f06d415cb80 2024-09-17T01:46:09.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.094+0000 7f06d8a00640 1 --2- 172.21.15.42:0/86818124 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f06b4078bc0 0x7f06b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:09.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.094+0000 7f06d8a00640 1 --2- 172.21.15.42:0/86818124 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f06b4078bc0 0x7f06b407b0d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f06c8001120 tx=0x7f06c8009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:09.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.097+0000 7f06d0c00640 1 -- 172.21.15.42:0/86818124 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f06d415be20 con 0x7f06d415cb80 2024-09-17T01:46:09.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.336+0000 7f06db400640 1 -- 172.21.15.42:0/86818124 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f06d406a170 con 0x7f06d415cb80 2024-09-17T01:46:09.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.561+0000 7f06d0c00640 1 -- 172.21.15.42:0/86818124 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v141) ==== 121+0+0 (secure 0 0 0) 0x7f06c00629e0 con 0x7f06d415cb80 2024-09-17T01:46:09.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.564+0000 7f06db400640 1 -- 172.21.15.42:0/86818124 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f06b4078bc0 msgr2=0x7f06b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:09.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.564+0000 7f06db400640 1 --2- 172.21.15.42:0/86818124 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f06b4078bc0 0x7f06b407b0d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f06c8001120 tx=0x7f06c8009040 comp rx=0 tx=0).stop 2024-09-17T01:46:09.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.564+0000 7f06db400640 1 -- 172.21.15.42:0/86818124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06d415cb80 msgr2=0x7f06d40cece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:09.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.564+0000 7f06db400640 1 --2- 172.21.15.42:0/86818124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06d415cb80 0x7f06d40cece0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f06c000c730 tx=0x7f06c000cb30 comp rx=0 tx=0).stop 2024-09-17T01:46:09.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.564+0000 7f06db400640 1 -- 172.21.15.42:0/86818124 shutdown_connections 2024-09-17T01:46:09.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.564+0000 7f06db400640 1 --2- 172.21.15.42:0/86818124 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f06b4078bc0 0x7f06b407b0d0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:09.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.564+0000 7f06db400640 1 --2- 172.21.15.42:0/86818124 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f06d415f480 0x7f06d41f63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:09.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.564+0000 7f06db400640 1 --2- 172.21.15.42:0/86818124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06d415cb80 0x7f06d40cece0 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:09.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.564+0000 7f06db400640 1 --2- 172.21.15.42:0/86818124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06d406d430 0x7f06d40ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:09.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.564+0000 7f06db400640 1 -- 172.21.15.42:0/86818124 >> 172.21.15.42:0/86818124 conn(0x7f06d40b2930 msgr2=0x7f06d4152710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:09.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.564+0000 7f06db400640 1 -- 172.21.15.42:0/86818124 shutdown_connections 2024-09-17T01:46:09.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.565+0000 7f06db400640 1 -- 172.21.15.42:0/86818124 wait complete. 2024-09-17T01:46:09.587 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:46:09.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.826+0000 7f42c3400640 1 -- 172.21.15.42:0/3955931672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42a0003a00 msgr2=0x7f42a0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:09.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.826+0000 7f42c3400640 1 --2- 172.21.15.42:0/3955931672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42a0003a00 0x7f42a0003e70 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00c4a0 tx=0x7f42a0005830 comp rx=0 tx=0).stop 2024-09-17T01:46:09.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.826+0000 7f42c1400640 1 -- 172.21.15.42:0/3955931672 reap_dead start 2024-09-17T01:46:09.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.826+0000 7f42c3400640 1 -- 172.21.15.42:0/3955931672 shutdown_connections 2024-09-17T01:46:09.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.826+0000 7f42c3400640 1 -- 172.21.15.42:0/3955931672 >> 172.21.15.42:0/3955931672 conn(0x7f42bc0b2930 msgr2=0x7f42bc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:09.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.826+0000 7f42c3400640 1 -- 172.21.15.42:0/3955931672 shutdown_connections 2024-09-17T01:46:09.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.826+0000 7f42c3400640 1 -- 172.21.15.42:0/3955931672 wait complete. 2024-09-17T01:46:09.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.829+0000 7f42c3400640 1 Processor -- start 2024-09-17T01:46:09.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.829+0000 7f42c3400640 1 -- start start 2024-09-17T01:46:09.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.830+0000 7f42c3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42a0003a00 0x7f42bc14d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:09.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.830+0000 7f42c3400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f42bc1f6cf0 0x7f42bc1f7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:09.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.830+0000 7f42c3400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42bc1f7640 0x7f42bc14f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:09.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.830+0000 7f42c3400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f42bc072440 con 0x7f42a0003a00 2024-09-17T01:46:09.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.830+0000 7f42c3400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f42bc1571a0 con 0x7f42bc1f7640 2024-09-17T01:46:09.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.830+0000 7f42c3400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f42bc0725c0 con 0x7f42bc1f6cf0 2024-09-17T01:46:09.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.830+0000 7f42c0a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42a0003a00 0x7f42bc14d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:09.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.831+0000 7f42c0a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42a0003a00 0x7f42bc14d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49900/0 (socket says 172.21.15.42:49900) 2024-09-17T01:46:09.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.831+0000 7f42c0a00640 1 -- 172.21.15.42:0/625858264 learned_addr learned my addr 172.21.15.42:0/625858264 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:09.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.831+0000 7f42b3e00640 1 --2- 172.21.15.42:0/625858264 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f42bc1f6cf0 0x7f42bc1f7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:09.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.831+0000 7f42c0a00640 1 -- 172.21.15.42:0/625858264 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f42bc1f6cf0 msgr2=0x7f42bc1f7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:09.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.831+0000 7f42c1400640 1 --2- 172.21.15.42:0/625858264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42bc1f7640 0x7f42bc14f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:09.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.831+0000 7f42c0a00640 1 --2- 172.21.15.42:0/625858264 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f42bc1f6cf0 0x7f42bc1f7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:09.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.831+0000 7f42c0a00640 1 -- 172.21.15.42:0/625858264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42bc1f7640 msgr2=0x7f42bc14f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:09.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.831+0000 7f42c0a00640 1 --2- 172.21.15.42:0/625858264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42bc1f7640 0x7f42bc14f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:09.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.831+0000 7f42c0a00640 1 -- 172.21.15.42:0/625858264 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42bc1f3c30 con 0x7f42a0003a00 2024-09-17T01:46:09.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.831+0000 7f42b3e00640 1 --2- 172.21.15.42:0/625858264 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f42bc1f6cf0 0x7f42bc1f7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:09.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.831+0000 7f42c1400640 1 --2- 172.21.15.42:0/625858264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42bc1f7640 0x7f42bc14f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:09.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.831+0000 7f42c0a00640 1 --2- 172.21.15.42:0/625858264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42a0003a00 0x7f42bc14d820 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00c590 tx=0x7f42ac006e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:09.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.832+0000 7f42b9600640 1 -- 172.21.15.42:0/625858264 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac0065b0 con 0x7f42a0003a00 2024-09-17T01:46:09.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.832+0000 7f42b9600640 1 -- 172.21.15.42:0/625858264 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42ac02b660 con 0x7f42a0003a00 2024-09-17T01:46:09.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.832+0000 7f42b9600640 1 -- 172.21.15.42:0/625858264 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac02bab0 con 0x7f42a0003a00 2024-09-17T01:46:09.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.832+0000 7f42c3400640 1 -- 172.21.15.42:0/625858264 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42bc1f3f10 con 0x7f42a0003a00 2024-09-17T01:46:09.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.832+0000 7f42c3400640 1 -- 172.21.15.42:0/625858264 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42bc1f44d0 con 0x7f42a0003a00 2024-09-17T01:46:09.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.833+0000 7f42c3400640 1 -- 172.21.15.42:0/625858264 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42bc06d840 con 0x7f42a0003a00 2024-09-17T01:46:09.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.834+0000 7f42b9600640 1 -- 172.21.15.42:0/625858264 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f42ac047020 con 0x7f42a0003a00 2024-09-17T01:46:09.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.835+0000 7f42b9600640 1 --2- 172.21.15.42:0/625858264 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4298078b90 0x7f429807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:09.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.835+0000 7f42b9600640 1 -- 172.21.15.42:0/625858264 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7f42ac0baef0 con 0x7f42a0003a00 2024-09-17T01:46:09.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.835+0000 7f42b3e00640 1 --2- 172.21.15.42:0/625858264 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4298078b90 0x7f429807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:09.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.836+0000 7f42b3e00640 1 --2- 172.21.15.42:0/625858264 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4298078b90 0x7f429807b0a0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f42a4005940 tx=0x7f42a4005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:09.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:09.840+0000 7f42b9600640 1 -- 172.21.15.42:0/625858264 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f42bc06dd80 con 0x7f42a0003a00 2024-09-17T01:46:10.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.076+0000 7f42c3400640 1 -- 172.21.15.42:0/625858264 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42bc14f410 con 0x7f42a0003a00 2024-09-17T01:46:10.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.076+0000 7f42b9600640 1 -- 172.21.15.42:0/625858264 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 141 v141) ==== 95+0+5236 (secure 0 0 0) 0x7f42ac0831b0 con 0x7f42a0003a00 2024-09-17T01:46:10.074 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:46:10.074 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":141,"btime":"2024-09-17T01:46:09:560403+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1946373489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1946373489},{"type":"v1","addr":"172.21.15.43:6837","nonce":1946373489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134},{"gid":9280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/1948698658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1948698658},{"type":"v1","addr":"172.21.15.43:6835","nonce":1948698658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133}],"filesystems":[{"mdsmap":{"epoch":141,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:45:36.259119+0000","modified":"2024-09-17T01:46:09.560386+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9960":{"gid":9960,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/908320168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":908320168},{"type":"v1","addr":"172.21.15.42:6833","nonce":908320168}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9969":{"gid":9969,"name":"a","rank":0,"incarnation":135,"state":"up:active","state_seq":5,"addr":"172.21.15.42:6835/2353432649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":2353432649},{"type":"v1","addr":"172.21.15.42:6835","nonce":2353432649}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9969,"qdb_cluster":[9969]},"id":12}]} 2024-09-17T01:46:10.075 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 141 2024-09-17T01:46:10.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.079+0000 7f42c3400640 1 -- 172.21.15.42:0/625858264 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4298078b90 msgr2=0x7f429807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:10.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.079+0000 7f42c3400640 1 --2- 172.21.15.42:0/625858264 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4298078b90 0x7f429807b0a0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f42a4005940 tx=0x7f42a4005f90 comp rx=0 tx=0).stop 2024-09-17T01:46:10.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.079+0000 7f42c3400640 1 -- 172.21.15.42:0/625858264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42a0003a00 msgr2=0x7f42bc14d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:10.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.079+0000 7f42c3400640 1 --2- 172.21.15.42:0/625858264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42a0003a00 0x7f42bc14d820 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00c590 tx=0x7f42ac006e20 comp rx=0 tx=0).stop 2024-09-17T01:46:10.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.079+0000 7f42c3400640 1 -- 172.21.15.42:0/625858264 shutdown_connections 2024-09-17T01:46:10.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.079+0000 7f42c3400640 1 --2- 172.21.15.42:0/625858264 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4298078b90 0x7f429807b0a0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.079+0000 7f42c3400640 1 --2- 172.21.15.42:0/625858264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42bc1f7640 0x7f42bc14f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.079+0000 7f42c3400640 1 --2- 172.21.15.42:0/625858264 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f42bc1f6cf0 0x7f42bc1f7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.079+0000 7f42c3400640 1 --2- 172.21.15.42:0/625858264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42a0003a00 0x7f42bc14d820 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.079+0000 7f42c3400640 1 -- 172.21.15.42:0/625858264 >> 172.21.15.42:0/625858264 conn(0x7f42bc0b2930 msgr2=0x7f42bc160aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:10.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.079+0000 7f42c3400640 1 -- 172.21.15.42:0/625858264 shutdown_connections 2024-09-17T01:46:10.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.079+0000 7f42c3400640 1 -- 172.21.15.42:0/625858264 wait complete. 2024-09-17T01:46:10.502 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 141, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-17T01:45:36.259119+0000', 'modified': '2024-09-17T01:46:09.560386+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9969}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9960': {'gid': 9960, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.42:6833/908320168', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6832', 'nonce': 908320168}, {'type': 'v1', 'addr': '172.21.15.42:6833', 'nonce': 908320168}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_9969': {'gid': 9969, 'name': 'a', 'rank': 0, 'incarnation': 135, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.42:6835/2353432649', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6834', 'nonce': 2353432649}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 2353432649}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9969, 'qdb_cluster': [9969]} 2024-09-17T01:46:10.502 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T01:46:10.502 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T01:46:10.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.740+0000 7f8df5600640 1 -- 172.21.15.42:0/2160074208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8df006db50 msgr2=0x7f8df0073df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:10.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.740+0000 7f8df5600640 1 --2- 172.21.15.42:0/2160074208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8df006db50 0x7f8df0073df0 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f8de8005fd0 tx=0x7f8de802a980 comp rx=0 tx=0).stop 2024-09-17T01:46:10.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.740+0000 7f8df5600640 1 -- 172.21.15.42:0/2160074208 shutdown_connections 2024-09-17T01:46:10.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.740+0000 7f8df5600640 1 --2- 172.21.15.42:0/2160074208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8df006db50 0x7f8df0073df0 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.740+0000 7f8df5600640 1 --2- 172.21.15.42:0/2160074208 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8df006f2a0 0x7f8df006d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.740+0000 7f8df5600640 1 -- 172.21.15.42:0/2160074208 >> 172.21.15.42:0/2160074208 conn(0x7f8df00b2930 msgr2=0x7f8df006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:10.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.740+0000 7f8df5600640 1 -- 172.21.15.42:0/2160074208 shutdown_connections 2024-09-17T01:46:10.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.740+0000 7f8df5600640 1 -- 172.21.15.42:0/2160074208 wait complete. 2024-09-17T01:46:10.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.742+0000 7f8df5600640 1 Processor -- start 2024-09-17T01:46:10.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.742+0000 7f8df5600640 1 -- start start 2024-09-17T01:46:10.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.744+0000 7f8df5600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8df006db50 0x7f8df00c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:10.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.744+0000 7f8df5600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8df006ee90 0x7f8df00b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:10.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.744+0000 7f8df5600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8df006f2a0 0x7f8df0147960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:10.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.744+0000 7f8df5600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8df00cef40 con 0x7f8df006f2a0 2024-09-17T01:46:10.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.744+0000 7f8df5600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8df0074680 con 0x7f8df006ee90 2024-09-17T01:46:10.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.744+0000 7f8df5600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8df00cf0c0 con 0x7f8df006db50 2024-09-17T01:46:10.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.744+0000 7f8def400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8df006f2a0 0x7f8df0147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:10.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.744+0000 7f8def400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8df006f2a0 0x7f8df0147960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49918/0 (socket says 172.21.15.42:49918) 2024-09-17T01:46:10.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.744+0000 7f8def400640 1 -- 172.21.15.42:0/3461279722 learned_addr learned my addr 172.21.15.42:0/3461279722 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:10.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.744+0000 7f8de7e00640 1 --2- 172.21.15.42:0/3461279722 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8df006ee90 0x7f8df00b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:10.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.744+0000 7f8deea00640 1 --2- 172.21.15.42:0/3461279722 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8df006db50 0x7f8df00c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:10.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.745+0000 7f8def400640 1 -- 172.21.15.42:0/3461279722 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8df006db50 msgr2=0x7f8df00c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:10.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.745+0000 7f8def400640 1 --2- 172.21.15.42:0/3461279722 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8df006db50 0x7f8df00c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.745+0000 7f8def400640 1 -- 172.21.15.42:0/3461279722 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8df006ee90 msgr2=0x7f8df00b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:10.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.745+0000 7f8def400640 1 --2- 172.21.15.42:0/3461279722 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8df006ee90 0x7f8df00b46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.745+0000 7f8def400640 1 -- 172.21.15.42:0/3461279722 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df01f6b70 con 0x7f8df006f2a0 2024-09-17T01:46:10.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.745+0000 7f8def400640 1 --2- 172.21.15.42:0/3461279722 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8df006f2a0 0x7f8df0147960 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f8de8033040 tx=0x7f8de8003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:10.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.745+0000 7f8de6a00640 1 -- 172.21.15.42:0/3461279722 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de8034040 con 0x7f8df006f2a0 2024-09-17T01:46:10.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.745+0000 7f8de6a00640 1 -- 172.21.15.42:0/3461279722 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8de8004640 con 0x7f8df006f2a0 2024-09-17T01:46:10.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.745+0000 7f8df5600640 1 -- 172.21.15.42:0/3461279722 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8df01f6e50 con 0x7f8df006f2a0 2024-09-17T01:46:10.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.745+0000 7f8de6a00640 1 -- 172.21.15.42:0/3461279722 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de80456e0 con 0x7f8df006f2a0 2024-09-17T01:46:10.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.745+0000 7f8df5600640 1 -- 172.21.15.42:0/3461279722 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8df01f7410 con 0x7f8df006f2a0 2024-09-17T01:46:10.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.749+0000 7f8de6a00640 1 -- 172.21.15.42:0/3461279722 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8de8037020 con 0x7f8df006f2a0 2024-09-17T01:46:10.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.750+0000 7f8de6a00640 1 --2- 172.21.15.42:0/3461279722 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8dcc078b90 0x7f8dcc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:10.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.750+0000 7f8dfc683740 1 Processor -- start 2024-09-17T01:46:10.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.750+0000 7f8de6a00640 1 -- 172.21.15.42:0/3461279722 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7f8de80bc850 con 0x7f8df006f2a0 2024-09-17T01:46:10.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.750+0000 7f8dfc683740 1 -- start start 2024-09-17T01:46:10.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.750+0000 7f8deea00640 1 --2- 172.21.15.42:0/3461279722 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8dcc078b90 0x7f8dcc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:10.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.751+0000 7f8deea00640 1 --2- 172.21.15.42:0/3461279722 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8dcc078b90 0x7f8dcc07b0a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f8de0006fd0 tx=0x7f8de0008040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:10.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.751+0000 7f8dfc683740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6ca3270 0x5578e7073970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:10.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.751+0000 7f8dfc683740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578e6c7a3b0 0x5578e7073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:10.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.751+0000 7f8dfc683740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578e6c82590 0x5578e7043f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:10.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.751+0000 7f8dfc683740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5578e6fcd430 con 0x5578e6ca3270 2024-09-17T01:46:10.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.751+0000 7f8dfc683740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5578e6fbd5d0 con 0x5578e6c7a3b0 2024-09-17T01:46:10.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.751+0000 7f8dfc683740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5578e6faca00 con 0x5578e6c82590 2024-09-17T01:46:10.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.752+0000 7f8deea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6ca3270 0x5578e7073970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:10.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.752+0000 7f8deea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6ca3270 0x5578e7073970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49922/0 (socket says 172.21.15.42:49922) 2024-09-17T01:46:10.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.752+0000 7f8deea00640 1 -- 172.21.15.42:0/498952822 learned_addr learned my addr 172.21.15.42:0/498952822 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:10.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.752+0000 7f8de7e00640 1 --2- 172.21.15.42:0/498952822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578e6c7a3b0 0x5578e7073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:10.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.752+0000 7f8def400640 1 --2- 172.21.15.42:0/498952822 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578e6c82590 0x5578e7043f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:10.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.752+0000 7f8deea00640 1 -- 172.21.15.42:0/498952822 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578e6c82590 msgr2=0x5578e7043f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:10.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.752+0000 7f8deea00640 1 --2- 172.21.15.42:0/498952822 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578e6c82590 0x5578e7043f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.752+0000 7f8deea00640 1 -- 172.21.15.42:0/498952822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578e6c7a3b0 msgr2=0x5578e7073eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:10.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.752+0000 7f8deea00640 1 --2- 172.21.15.42:0/498952822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578e6c7a3b0 0x5578e7073eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.752+0000 7f8deea00640 1 -- 172.21.15.42:0/498952822 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578e6f75520 con 0x5578e6ca3270 2024-09-17T01:46:10.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.753+0000 7f8deea00640 1 --2- 172.21.15.42:0/498952822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6ca3270 0x5578e7073970 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f8de000d830 tx=0x7f8de0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d28e9f09d89f7f5c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:10.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.753+0000 7f8ddf000640 1 -- 172.21.15.42:0/498952822 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de0004020 con 0x5578e6ca3270 2024-09-17T01:46:10.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.753+0000 7f8ddf000640 1 -- 172.21.15.42:0/498952822 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8de00042b0 con 0x5578e6ca3270 2024-09-17T01:46:10.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.753+0000 7f8ddf000640 1 -- 172.21.15.42:0/498952822 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de0014c10 con 0x5578e6ca3270 2024-09-17T01:46:10.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.754+0000 7f8dfc683740 1 -- 172.21.15.42:0/498952822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6ca3270 msgr2=0x5578e7073970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:10.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.754+0000 7f8dfc683740 1 --2- 172.21.15.42:0/498952822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6ca3270 0x5578e7073970 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f8de000d830 tx=0x7f8de0010000 comp rx=0 tx=0).stop 2024-09-17T01:46:10.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.754+0000 7f8dfc683740 1 -- 172.21.15.42:0/498952822 shutdown_connections 2024-09-17T01:46:10.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.754+0000 7f8dfc683740 1 --2- 172.21.15.42:0/498952822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578e6c7a3b0 0x5578e7073eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.754+0000 7f8dfc683740 1 --2- 172.21.15.42:0/498952822 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578e6c82590 0x5578e7043f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.754+0000 7f8dfc683740 1 --2- 172.21.15.42:0/498952822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6ca3270 0x5578e7073970 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.754+0000 7f8dfc683740 1 -- 172.21.15.42:0/498952822 >> 172.21.15.42:0/498952822 conn(0x5578e6c973c0 msgr2=0x5578e7049970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:10.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.754+0000 7f8dfc683740 1 -- 172.21.15.42:0/498952822 shutdown_connections 2024-09-17T01:46:10.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.754+0000 7f8dfc683740 1 -- 172.21.15.42:0/498952822 wait complete. 2024-09-17T01:46:10.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.755+0000 7f8dfc683740 1 -- start start 2024-09-17T01:46:10.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.755+0000 7f8dfc683740 1 Processor -- start 2024-09-17T01:46:10.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.757+0000 7f8dfc683740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6c7a3b0 0x5578e708f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:10.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.757+0000 7f8dfc683740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578e6c82590 0x5578e70896e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:10.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.757+0000 7f8dfc683740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578e6ca3270 0x5578e7069ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:10.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.757+0000 7f8dfc683740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5578e6f53330 con 0x5578e6c7a3b0 2024-09-17T01:46:10.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.757+0000 7f8dfc683740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5578e6fb0810 con 0x5578e6ca3270 2024-09-17T01:46:10.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.757+0000 7f8dfc683740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5578e6d1d620 con 0x5578e6c82590 2024-09-17T01:46:10.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.757+0000 7f8dfc683740 10 client.0 _ll_register_callbacks cb 0x5578e6f58420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:46:10.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.757+0000 7f8deea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6c7a3b0 0x5578e708f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.757+0000 7f8deea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6c7a3b0 0x5578e708f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49938/0 (socket says 172.21.15.42:49938) 2024-09-17T01:46:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.757+0000 7f8deea00640 1 -- 172.21.15.42:0/582779477 learned_addr learned my addr 172.21.15.42:0/582779477 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.757+0000 7f8de7e00640 1 --2- 172.21.15.42:0/582779477 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578e6c82590 0x5578e70896e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.757+0000 7f8def400640 1 --2- 172.21.15.42:0/582779477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578e6ca3270 0x5578e7069ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.757+0000 7f8deea00640 1 -- 172.21.15.42:0/582779477 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578e6c82590 msgr2=0x5578e70896e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.757+0000 7f8deea00640 1 --2- 172.21.15.42:0/582779477 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578e6c82590 0x5578e70896e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.757+0000 7f8deea00640 1 -- 172.21.15.42:0/582779477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578e6ca3270 msgr2=0x5578e7069ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.757+0000 7f8deea00640 1 --2- 172.21.15.42:0/582779477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578e6ca3270 0x5578e7069ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.757+0000 7f8deea00640 1 -- 172.21.15.42:0/582779477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578e6d0e850 con 0x5578e6c7a3b0 2024-09-17T01:46:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.757+0000 7f8def400640 1 --2- 172.21.15.42:0/582779477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578e6ca3270 0x5578e7069ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.758+0000 7f8deea00640 1 --2- 172.21.15.42:0/582779477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6c7a3b0 0x5578e708f130 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f8de0021040 tx=0x7f8de0004130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74ee5903c4c135 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.758+0000 7f8dd3400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:46:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.758+0000 7f8dd3400640 1 -- 172.21.15.42:0/582779477 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de002c020 con 0x5578e6c7a3b0 2024-09-17T01:46:10.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.758+0000 7f8dd3400640 1 -- 172.21.15.42:0/582779477 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7f8de00035f0 con 0x5578e6c7a3b0 2024-09-17T01:46:10.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.758+0000 7f8dfc683740 1 -- 172.21.15.42:0/582779477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8de00042b0 con 0x5578e6c7a3b0 2024-09-17T01:46:10.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.758+0000 7f8dd3400640 1 -- 172.21.15.42:0/582779477 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7f8de0036050 con 0x5578e6c7a3b0 2024-09-17T01:46:10.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.758+0000 7f8dfc683740 10 client.10134 fetch_fsmap learned FSMap version 141 2024-09-17T01:46:10.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.758+0000 7f8dfc683740 1 -- 172.21.15.42:0/582779477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x5578e6d856b0 con 0x5578e6c7a3b0 2024-09-17T01:46:10.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.759+0000 7f8dd3400640 1 -- 172.21.15.42:0/582779477 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8de00042b0 con 0x5578e6c7a3b0 2024-09-17T01:46:10.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.759+0000 7f8dd3400640 1 -- 172.21.15.42:0/582779477 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 141) ==== 3490+0+0 (secure 0 0 0) 0x7f8de0039020 con 0x5578e6c7a3b0 2024-09-17T01:46:10.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.759+0000 7f8dfc683740 10 client.10134 fetch_fsmap finished waiting for FSMap version 141 2024-09-17T01:46:10.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.759+0000 7f8dfc683740 10 client.10134 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T01:46:10.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.759+0000 7f8dfc683740 20 client.10134 populate_metadata read hostname 'smithi042' 2024-09-17T01:46:10.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.759+0000 7f8dfc683740 1 --2- 172.21.15.42:0/582779477 >> [v2:172.21.15.42:6834/2353432649,v1:172.21.15.42:6835/2353432649] conn(0x5578e6c61e40 0x5578e709dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:10.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.759+0000 7f8dfc683740 4 client.10134 mds_command: new command op to 9969 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:46:10.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.759+0000 7f8dfc683740 1 -- 172.21.15.42:0/582779477 --> [v2:172.21.15.42:6834/2353432649,v1:172.21.15.42:6835/2353432649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578e6fbf520 con 0x5578e6c61e40 2024-09-17T01:46:10.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.759+0000 7f8de7e00640 1 --2- 172.21.15.42:0/582779477 >> [v2:172.21.15.42:6834/2353432649,v1:172.21.15.42:6835/2353432649] conn(0x5578e6c61e40 0x5578e709dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:10.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.760+0000 7f8dd3400640 10 client.10134 ms_handle_connect on v2:172.21.15.42:6834/2353432649 2024-09-17T01:46:10.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.760+0000 7f8de7e00640 1 --2- 172.21.15.42:0/582779477 >> [v2:172.21.15.42:6834/2353432649,v1:172.21.15.42:6835/2353432649] conn(0x5578e6c61e40 0x5578e709dd00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f352c5ed3139493b server_cookie=dbdac91f822cb39c in_seq=0 out_seq=0 2024-09-17T01:46:10.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.760+0000 7f8dd3400640 1 -- 172.21.15.42:0/582779477 <== mds.0 v2:172.21.15.42:6834/2353432649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5578e6fbf520 con 0x5578e6c61e40 2024-09-17T01:46:10.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.760+0000 7f8dd3400640 10 client.10134 handle_command_reply: tid=0 2024-09-17T01:46:10.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.761+0000 7f8dfc683740 1 client.10134 shutdown 2024-09-17T01:46:10.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.761+0000 7f8dfc683740 1 -- 172.21.15.42:0/582779477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6c7a3b0 msgr2=0x5578e708f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:10.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.761+0000 7f8dfc683740 1 --2- 172.21.15.42:0/582779477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6c7a3b0 0x5578e708f130 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f8de0021040 tx=0x7f8de0004130 comp rx=0 tx=0).stop 2024-09-17T01:46:10.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.761+0000 7f8dfc683740 1 -- 172.21.15.42:0/582779477 shutdown_connections 2024-09-17T01:46:10.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.761+0000 7f8dfc683740 1 --2- 172.21.15.42:0/582779477 >> [v2:172.21.15.42:6834/2353432649,v1:172.21.15.42:6835/2353432649] conn(0x5578e6c61e40 0x5578e709dd00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.761+0000 7f8dfc683740 1 --2- 172.21.15.42:0/582779477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578e6ca3270 0x5578e7069ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.761+0000 7f8dfc683740 1 --2- 172.21.15.42:0/582779477 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578e6c82590 0x5578e70896e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.761+0000 7f8dfc683740 1 --2- 172.21.15.42:0/582779477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6c7a3b0 0x5578e708f130 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.761+0000 7f8dfc683740 1 -- 172.21.15.42:0/582779477 >> 172.21.15.42:0/582779477 conn(0x5578e6c973c0 msgr2=0x5578e70908c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:10.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.761+0000 7f8dd3400640 0 client.10134 ms_handle_reset on v2:172.21.15.42:6834/2353432649 2024-09-17T01:46:10.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.761+0000 7f8dfc683740 1 -- 172.21.15.42:0/582779477 shutdown_connections 2024-09-17T01:46:10.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.761+0000 7f8dfc683740 1 -- 172.21.15.42:0/582779477 wait complete. 2024-09-17T01:46:10.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.761+0000 7f8dfc683740 20 client.10134 trim_cache size 0 max 16384 2024-09-17T01:46:10.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.781+0000 7f8dfc683740 1 Processor -- start 2024-09-17T01:46:10.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.781+0000 7f8dfc683740 1 -- start start 2024-09-17T01:46:10.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.783+0000 7f8dfc683740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578e6c7a3b0 0x5578e70698f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:10.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.783+0000 7f8dfc683740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6c82590 0x5578e709dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:10.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.783+0000 7f8dfc683740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578e6ca3270 0x5578e709e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:10.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.783+0000 7f8dfc683740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8df0202480 con 0x5578e6c82590 2024-09-17T01:46:10.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.783+0000 7f8dfc683740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8df01f8520 con 0x5578e6ca3270 2024-09-17T01:46:10.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.783+0000 7f8dfc683740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8df01f8b70 con 0x5578e6c7a3b0 2024-09-17T01:46:10.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.783+0000 7f8de7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6c82590 0x5578e709dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:10.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.783+0000 7f8de7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6c82590 0x5578e709dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49940/0 (socket says 172.21.15.42:49940) 2024-09-17T01:46:10.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.783+0000 7f8de7e00640 1 -- 172.21.15.42:0/3718652780 learned_addr learned my addr 172.21.15.42:0/3718652780 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:10.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.783+0000 7f8def400640 1 --2- 172.21.15.42:0/3718652780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578e6ca3270 0x5578e709e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:10.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.783+0000 7f8deea00640 1 --2- 172.21.15.42:0/3718652780 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578e6c7a3b0 0x5578e70698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:10.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.783+0000 7f8de7e00640 1 -- 172.21.15.42:0/3718652780 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578e6c7a3b0 msgr2=0x5578e70698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:10.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.783+0000 7f8de7e00640 1 --2- 172.21.15.42:0/3718652780 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578e6c7a3b0 0x5578e70698f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.783+0000 7f8de7e00640 1 -- 172.21.15.42:0/3718652780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578e6ca3270 msgr2=0x5578e709e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:10.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.783+0000 7f8de7e00640 1 --2- 172.21.15.42:0/3718652780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578e6ca3270 0x5578e709e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.784+0000 7f8de7e00640 1 -- 172.21.15.42:0/3718652780 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578e7071390 con 0x5578e6c82590 2024-09-17T01:46:10.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.784+0000 7f8de7e00640 1 --2- 172.21.15.42:0/3718652780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6c82590 0x5578e709dd00 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f8df00b5960 tx=0x7f8dd8003be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343149864edfcd37 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:10.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.784+0000 7f8dde600640 1 -- 172.21.15.42:0/3718652780 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd800c8e0 con 0x5578e6c82590 2024-09-17T01:46:10.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.784+0000 7f8dde600640 1 -- 172.21.15.42:0/3718652780 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8dd800ca80 con 0x5578e6c82590 2024-09-17T01:46:10.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.784+0000 7f8dde600640 1 -- 172.21.15.42:0/3718652780 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd801c430 con 0x5578e6c82590 2024-09-17T01:46:10.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.785+0000 7f8dfc683740 1 -- 172.21.15.42:0/3718652780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6c82590 msgr2=0x5578e709dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:10.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.785+0000 7f8dfc683740 1 --2- 172.21.15.42:0/3718652780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6c82590 0x5578e709dd00 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f8df00b5960 tx=0x7f8dd8003be0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.785+0000 7f8dfc683740 1 -- 172.21.15.42:0/3718652780 shutdown_connections 2024-09-17T01:46:10.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.785+0000 7f8dfc683740 1 --2- 172.21.15.42:0/3718652780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578e6ca3270 0x5578e709e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.785+0000 7f8dfc683740 1 --2- 172.21.15.42:0/3718652780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6c82590 0x5578e709dd00 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.785+0000 7f8dfc683740 1 --2- 172.21.15.42:0/3718652780 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578e6c7a3b0 0x5578e70698f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.785+0000 7f8dfc683740 1 -- 172.21.15.42:0/3718652780 >> 172.21.15.42:0/3718652780 conn(0x5578e6c973c0 msgr2=0x5578e70455f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:10.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.785+0000 7f8dfc683740 1 -- 172.21.15.42:0/3718652780 shutdown_connections 2024-09-17T01:46:10.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.785+0000 7f8dfc683740 1 -- 172.21.15.42:0/3718652780 wait complete. 2024-09-17T01:46:10.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.786+0000 7f8dfc683740 1 -- start start 2024-09-17T01:46:10.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.786+0000 7f8dfc683740 1 Processor -- start 2024-09-17T01:46:10.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.787+0000 7f8dfc683740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578e6c7a3b0 0x5578e70f4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:10.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.788+0000 7f8dfc683740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6c82590 0x5578e7074080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:10.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.788+0000 7f8dfc683740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578e6ca3270 0x5578e706b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:10.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.788+0000 7f8dfc683740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5578e70a1720 con 0x5578e6c82590 2024-09-17T01:46:10.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.788+0000 7f8dfc683740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5578e706f220 con 0x5578e6c7a3b0 2024-09-17T01:46:10.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.788+0000 7f8dfc683740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5578e706dca0 con 0x5578e6ca3270 2024-09-17T01:46:10.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.788+0000 7f8dfc683740 10 client.0 _ll_register_callbacks cb 0x7f8de000bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:46:10.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.788+0000 7f8de7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6c82590 0x5578e7074080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:10.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.788+0000 7f8de7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6c82590 0x5578e7074080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49954/0 (socket says 172.21.15.42:49954) 2024-09-17T01:46:10.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.788+0000 7f8de7e00640 1 -- 172.21.15.42:0/4023677542 learned_addr learned my addr 172.21.15.42:0/4023677542 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:10.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.788+0000 7f8deea00640 1 --2- 172.21.15.42:0/4023677542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578e6c7a3b0 0x5578e70f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:10.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.788+0000 7f8def400640 1 --2- 172.21.15.42:0/4023677542 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578e6ca3270 0x5578e706b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:10.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.788+0000 7f8de7e00640 1 -- 172.21.15.42:0/4023677542 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578e6ca3270 msgr2=0x5578e706b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:10.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.788+0000 7f8de7e00640 1 --2- 172.21.15.42:0/4023677542 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578e6ca3270 0x5578e706b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.788+0000 7f8de7e00640 1 -- 172.21.15.42:0/4023677542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578e6c7a3b0 msgr2=0x5578e70f4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:10.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.788+0000 7f8de7e00640 1 --2- 172.21.15.42:0/4023677542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578e6c7a3b0 0x5578e70f4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.788+0000 7f8de7e00640 1 -- 172.21.15.42:0/4023677542 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578e709d160 con 0x5578e6c82590 2024-09-17T01:46:10.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.789+0000 7f8de7e00640 1 --2- 172.21.15.42:0/4023677542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6c82590 0x5578e7074080 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8003700 tx=0x7f8dd800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b96870280cec17 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:10.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.789+0000 7f8dd3400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:46:10.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.789+0000 7f8dd3400640 1 -- 172.21.15.42:0/4023677542 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd801f040 con 0x5578e6c82590 2024-09-17T01:46:10.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.789+0000 7f8dd3400640 1 -- 172.21.15.42:0/4023677542 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7f8dd8005220 con 0x5578e6c82590 2024-09-17T01:46:10.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.789+0000 7f8dfc683740 1 -- 172.21.15.42:0/4023677542 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dd800ca80 con 0x5578e6c82590 2024-09-17T01:46:10.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.789+0000 7f8dd3400640 1 -- 172.21.15.42:0/4023677542 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7f8dd8034050 con 0x5578e6c82590 2024-09-17T01:46:10.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.789+0000 7f8dfc683740 10 client.10140 fetch_fsmap learned FSMap version 141 2024-09-17T01:46:10.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.789+0000 7f8dfc683740 1 -- 172.21.15.42:0/4023677542 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x5578e70f5480 con 0x5578e6c82590 2024-09-17T01:46:10.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.789+0000 7f8dd3400640 1 -- 172.21.15.42:0/4023677542 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8dd800ca80 con 0x5578e6c82590 2024-09-17T01:46:10.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.789+0000 7f8dd3400640 1 -- 172.21.15.42:0/4023677542 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 141) ==== 3490+0+0 (secure 0 0 0) 0x7f8dd8037020 con 0x5578e6c82590 2024-09-17T01:46:10.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.789+0000 7f8dfc683740 10 client.10140 fetch_fsmap finished waiting for FSMap version 141 2024-09-17T01:46:10.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.790+0000 7f8dfc683740 10 client.10140 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T01:46:10.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.790+0000 7f8dfc683740 20 client.10140 populate_metadata read hostname 'smithi042' 2024-09-17T01:46:10.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.790+0000 7f8dfc683740 1 --2- 172.21.15.42:0/4023677542 >> [v2:172.21.15.42:6834/2353432649,v1:172.21.15.42:6835/2353432649] conn(0x5578e706b920 0x5578e70715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:10.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.790+0000 7f8dfc683740 4 client.10140 mds_command: new command op to 9969 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T01:46:10.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.790+0000 7f8dfc683740 1 -- 172.21.15.42:0/4023677542 --> [v2:172.21.15.42:6834/2353432649,v1:172.21.15.42:6835/2353432649] -- command(tid 0: {"prefix": "status"}) -- 0x5578e6fbafd0 con 0x5578e706b920 2024-09-17T01:46:10.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.790+0000 7f8deea00640 1 --2- 172.21.15.42:0/4023677542 >> [v2:172.21.15.42:6834/2353432649,v1:172.21.15.42:6835/2353432649] conn(0x5578e706b920 0x5578e70715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:10.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.790+0000 7f8deea00640 1 --2- 172.21.15.42:0/4023677542 >> [v2:172.21.15.42:6834/2353432649,v1:172.21.15.42:6835/2353432649] conn(0x5578e706b920 0x5578e70715a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8195c73c1a419bcf server_cookie=7ad01877fcae40e8 in_seq=0 out_seq=0 2024-09-17T01:46:10.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.790+0000 7f8dd3400640 10 client.10140 ms_handle_connect on v2:172.21.15.42:6834/2353432649 2024-09-17T01:46:10.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.791+0000 7f8dd3400640 1 -- 172.21.15.42:0/4023677542 <== mds.0 v2:172.21.15.42:6834/2353432649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x5578e6fbafd0 con 0x5578e706b920 2024-09-17T01:46:10.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.791+0000 7f8dd3400640 10 client.10140 handle_command_reply: tid=0 2024-09-17T01:46:10.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.791+0000 7f8dfc683740 1 client.10140 shutdown 2024-09-17T01:46:10.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.791+0000 7f8dfc683740 1 -- 172.21.15.42:0/4023677542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6c82590 msgr2=0x5578e7074080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:10.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.791+0000 7f8dfc683740 1 --2- 172.21.15.42:0/4023677542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6c82590 0x5578e7074080 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8003700 tx=0x7f8dd800ce60 comp rx=0 tx=0).stop 2024-09-17T01:46:10.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.791+0000 7f8dfc683740 1 -- 172.21.15.42:0/4023677542 shutdown_connections 2024-09-17T01:46:10.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.791+0000 7f8dfc683740 1 --2- 172.21.15.42:0/4023677542 >> [v2:172.21.15.42:6834/2353432649,v1:172.21.15.42:6835/2353432649] conn(0x5578e706b920 0x5578e70715a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.791+0000 7f8dfc683740 1 --2- 172.21.15.42:0/4023677542 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5578e6ca3270 0x5578e706b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.791+0000 7f8dfc683740 1 --2- 172.21.15.42:0/4023677542 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5578e6c82590 0x5578e7074080 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.791+0000 7f8dd3400640 0 client.10140 ms_handle_reset on v2:172.21.15.42:6834/2353432649 2024-09-17T01:46:10.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.791+0000 7f8dfc683740 1 --2- 172.21.15.42:0/4023677542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5578e6c7a3b0 0x5578e70f4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.791+0000 7f8dfc683740 1 -- 172.21.15.42:0/4023677542 >> 172.21.15.42:0/4023677542 conn(0x5578e6c973c0 msgr2=0x5578e70698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:10.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.791+0000 7f8dfc683740 1 -- 172.21.15.42:0/4023677542 shutdown_connections 2024-09-17T01:46:10.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.791+0000 7f8dfc683740 1 -- 172.21.15.42:0/4023677542 wait complete. 2024-09-17T01:46:10.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.791+0000 7f8dfc683740 20 client.10140 trim_cache size 0 max 16384 2024-09-17T01:46:10.794 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:46:10.794 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "fea1c88c-cb05-432f-a745-f9dcbb5f2503", 2024-09-17T01:46:10.795 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-17T01:46:10.795 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 9969, 2024-09-17T01:46:10.795 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-17T01:46:10.795 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-17T01:46:10.795 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-17T01:46:10.795 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 34.054810580000002, 2024-09-17T01:46:10.795 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 141, 2024-09-17T01:46:10.795 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 176, 2024-09-17T01:46:10.795 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 176, 2024-09-17T01:46:10.795 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 46.055465673999997 2024-09-17T01:46:10.795 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:46:10.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.792+0000 7f8df5600640 1 -- 172.21.15.42:0/3461279722 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8dcc078b90 msgr2=0x7f8dcc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:10.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.792+0000 7f8df5600640 1 --2- 172.21.15.42:0/3461279722 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8dcc078b90 0x7f8dcc07b0a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f8de0006fd0 tx=0x7f8de0008040 comp rx=0 tx=0).stop 2024-09-17T01:46:10.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.792+0000 7f8df5600640 1 -- 172.21.15.42:0/3461279722 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8df006f2a0 msgr2=0x7f8df0147960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:10.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.792+0000 7f8df5600640 1 --2- 172.21.15.42:0/3461279722 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8df006f2a0 0x7f8df0147960 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f8de8033040 tx=0x7f8de8003f90 comp rx=0 tx=0).stop 2024-09-17T01:46:10.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.792+0000 7f8df5600640 1 -- 172.21.15.42:0/3461279722 shutdown_connections 2024-09-17T01:46:10.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.792+0000 7f8df5600640 1 --2- 172.21.15.42:0/3461279722 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8dcc078b90 0x7f8dcc07b0a0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.792+0000 7f8df5600640 1 --2- 172.21.15.42:0/3461279722 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8df006ee90 0x7f8df00b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.792+0000 7f8df5600640 1 --2- 172.21.15.42:0/3461279722 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8df006f2a0 0x7f8df0147960 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.792+0000 7f8df5600640 1 --2- 172.21.15.42:0/3461279722 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8df006db50 0x7f8df00c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:10.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.792+0000 7f8df5600640 1 -- 172.21.15.42:0/3461279722 >> 172.21.15.42:0/3461279722 conn(0x7f8df00b2930 msgr2=0x7f8df0075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:10.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.792+0000 7f8df5600640 1 -- 172.21.15.42:0/3461279722 shutdown_connections 2024-09-17T01:46:10.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:10.792+0000 7f8df5600640 1 -- 172.21.15.42:0/3461279722 wait complete. 2024-09-17T01:46:10.813 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub start /scrub_control_test_path recursive 2024-09-17T01:46:11.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.049+0000 7fb293200640 1 -- 172.21.15.42:0/2320094819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb278005e50 msgr2=0x7fb278006300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.049+0000 7fb293200640 1 --2- 172.21.15.42:0/2320094819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb278005e50 0x7fb278006300 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7fb28c001dc0 tx=0x7fb278006940 comp rx=0 tx=0).stop 2024-09-17T01:46:11.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.049+0000 7fb292800640 1 -- 172.21.15.42:0/2320094819 reap_dead start 2024-09-17T01:46:11.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.049+0000 7fb293200640 1 -- 172.21.15.42:0/2320094819 shutdown_connections 2024-09-17T01:46:11.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.049+0000 7fb293200640 1 -- 172.21.15.42:0/2320094819 >> 172.21.15.42:0/2320094819 conn(0x7fb2940b25d0 msgr2=0x7fb2940d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:11.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.049+0000 7fb293200640 1 -- 172.21.15.42:0/2320094819 shutdown_connections 2024-09-17T01:46:11.048 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.049+0000 7fb293200640 1 -- 172.21.15.42:0/2320094819 wait complete. 2024-09-17T01:46:11.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.051+0000 7fb293200640 1 Processor -- start 2024-09-17T01:46:11.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.052+0000 7fb293200640 1 -- start start 2024-09-17T01:46:11.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.053+0000 7fb293200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb278005e50 0x7fb2941f9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.053+0000 7fb293200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb294150550 0x7fb2941f87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.053+0000 7fb293200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2941f8d00 0x7fb29414aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.053+0000 7fb293200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb29415bd90 con 0x7fb278005e50 2024-09-17T01:46:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.053+0000 7fb293200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb29415bc10 con 0x7fb2941f8d00 2024-09-17T01:46:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.053+0000 7fb293200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb29414b770 con 0x7fb294150550 2024-09-17T01:46:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.053+0000 7fb291e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb278005e50 0x7fb2941f9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.053+0000 7fb291e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb278005e50 0x7fb2941f9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49962/0 (socket says 172.21.15.42:49962) 2024-09-17T01:46:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.053+0000 7fb291e00640 1 -- 172.21.15.42:0/4223469696 learned_addr learned my addr 172.21.15.42:0/4223469696 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.054+0000 7fb289400640 1 --2- 172.21.15.42:0/4223469696 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb294150550 0x7fb2941f87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.054+0000 7fb292800640 1 --2- 172.21.15.42:0/4223469696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2941f8d00 0x7fb29414aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.054+0000 7fb291e00640 1 -- 172.21.15.42:0/4223469696 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb294150550 msgr2=0x7fb2941f87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.054+0000 7fb291e00640 1 --2- 172.21.15.42:0/4223469696 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb294150550 0x7fb2941f87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.054+0000 7fb291e00640 1 -- 172.21.15.42:0/4223469696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2941f8d00 msgr2=0x7fb29414aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.054+0000 7fb291e00640 1 --2- 172.21.15.42:0/4223469696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2941f8d00 0x7fb29414aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.054+0000 7fb291e00640 1 -- 172.21.15.42:0/4223469696 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb294150960 con 0x7fb278005e50 2024-09-17T01:46:11.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.054+0000 7fb292800640 1 --2- 172.21.15.42:0/4223469696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2941f8d00 0x7fb29414aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:11.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.054+0000 7fb289400640 1 --2- 172.21.15.42:0/4223469696 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb294150550 0x7fb2941f87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:11.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.054+0000 7fb291e00640 1 --2- 172.21.15.42:0/4223469696 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb278005e50 0x7fb2941f9180 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7fb284011ae0 tx=0x7fb284009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:11.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.054+0000 7fb28aa00640 1 -- 172.21.15.42:0/4223469696 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28401e070 con 0x7fb278005e50 2024-09-17T01:46:11.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.054+0000 7fb28aa00640 1 -- 172.21.15.42:0/4223469696 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb28400fe70 con 0x7fb278005e50 2024-09-17T01:46:11.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.054+0000 7fb28aa00640 1 -- 172.21.15.42:0/4223469696 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb284004290 con 0x7fb278005e50 2024-09-17T01:46:11.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.054+0000 7fb293200640 1 -- 172.21.15.42:0/4223469696 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb294152460 con 0x7fb278005e50 2024-09-17T01:46:11.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.055+0000 7fb293200640 1 -- 172.21.15.42:0/4223469696 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb29414fd50 con 0x7fb278005e50 2024-09-17T01:46:11.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.057+0000 7fb28aa00640 1 -- 172.21.15.42:0/4223469696 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb284021070 con 0x7fb278005e50 2024-09-17T01:46:11.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.058+0000 7fb28aa00640 1 --2- 172.21.15.42:0/4223469696 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb270078b90 0x7fb27007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.058+0000 7fb28aa00640 1 -- 172.21.15.42:0/4223469696 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7fb28409b840 con 0x7fb278005e50 2024-09-17T01:46:11.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.059+0000 7fb289400640 1 --2- 172.21.15.42:0/4223469696 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb270078b90 0x7fb27007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.059+0000 7fb2a040a740 1 Processor -- start 2024-09-17T01:46:11.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.059+0000 7fb2a040a740 1 -- start start 2024-09-17T01:46:11.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.059+0000 7fb289400640 1 --2- 172.21.15.42:0/4223469696 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb270078b90 0x7fb27007b0a0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fb27c000fb0 tx=0x7fb27c0067a0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:11.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.060+0000 7fb2a040a740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562baf7984d0 0x562bafb872a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.060+0000 7fb2a040a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf76f610 0x562bafb69f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.060+0000 7fb2a040a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562baf7777f0 0x562bafb6a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.060+0000 7fb2a040a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562bafab27d0 con 0x562baf76f610 2024-09-17T01:46:11.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.060+0000 7fb2a040a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562bafaa1c00 con 0x562baf7777f0 2024-09-17T01:46:11.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.060+0000 7fb2a040a740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x562bafaa5a10 con 0x562baf7984d0 2024-09-17T01:46:11.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.061+0000 7fb289400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf76f610 0x562bafb69f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.061+0000 7fb289400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf76f610 0x562bafb69f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49972/0 (socket says 172.21.15.42:49972) 2024-09-17T01:46:11.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.061+0000 7fb289400640 1 -- 172.21.15.42:0/3485883207 learned_addr learned my addr 172.21.15.42:0/3485883207 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:11.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.061+0000 7fb292800640 1 --2- 172.21.15.42:0/3485883207 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562baf7777f0 0x562bafb6a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.061+0000 7fb291e00640 1 --2- 172.21.15.42:0/3485883207 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562baf7984d0 0x562bafb872a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.061+0000 7fb289400640 1 -- 172.21.15.42:0/3485883207 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562baf7984d0 msgr2=0x562bafb872a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.061+0000 7fb289400640 1 --2- 172.21.15.42:0/3485883207 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562baf7984d0 0x562bafb872a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.061+0000 7fb289400640 1 -- 172.21.15.42:0/3485883207 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562baf7777f0 msgr2=0x562bafb6a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.061+0000 7fb289400640 1 --2- 172.21.15.42:0/3485883207 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562baf7777f0 0x562bafb6a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.061+0000 7fb289400640 1 -- 172.21.15.42:0/3485883207 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bafa2fb50 con 0x562baf76f610 2024-09-17T01:46:11.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.061+0000 7fb292800640 1 --2- 172.21.15.42:0/3485883207 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562baf7777f0 0x562bafb6a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:11.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.061+0000 7fb291e00640 1 --2- 172.21.15.42:0/3485883207 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562baf7984d0 0x562bafb872a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:11.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.061+0000 7fb289400640 1 --2- 172.21.15.42:0/3485883207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf76f610 0x562bafb69f70 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7fb27c005bf0 tx=0x7fb27c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=782de4b9b9510f49 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:11.061 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.062+0000 7fb282a00640 1 -- 172.21.15.42:0/3485883207 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c022070 con 0x562baf76f610 2024-09-17T01:46:11.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.062+0000 7fb282a00640 1 -- 172.21.15.42:0/3485883207 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb27c012d40 con 0x562baf76f610 2024-09-17T01:46:11.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.062+0000 7fb282a00640 1 -- 172.21.15.42:0/3485883207 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c016070 con 0x562baf76f610 2024-09-17T01:46:11.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.062+0000 7fb2a040a740 1 -- 172.21.15.42:0/3485883207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf76f610 msgr2=0x562bafb69f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.062+0000 7fb2a040a740 1 --2- 172.21.15.42:0/3485883207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf76f610 0x562bafb69f70 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7fb27c005bf0 tx=0x7fb27c013000 comp rx=0 tx=0).stop 2024-09-17T01:46:11.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.063+0000 7fb2a040a740 1 -- 172.21.15.42:0/3485883207 shutdown_connections 2024-09-17T01:46:11.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.063+0000 7fb2a040a740 1 --2- 172.21.15.42:0/3485883207 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562baf7777f0 0x562bafb6a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.063+0000 7fb2a040a740 1 --2- 172.21.15.42:0/3485883207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf76f610 0x562bafb69f70 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.063+0000 7fb2a040a740 1 --2- 172.21.15.42:0/3485883207 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562baf7984d0 0x562bafb872a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.063+0000 7fb2a040a740 1 -- 172.21.15.42:0/3485883207 >> 172.21.15.42:0/3485883207 conn(0x562baf78c620 msgr2=0x562bafb40190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:11.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.063+0000 7fb2a040a740 1 -- 172.21.15.42:0/3485883207 shutdown_connections 2024-09-17T01:46:11.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.063+0000 7fb2a040a740 1 -- 172.21.15.42:0/3485883207 wait complete. 2024-09-17T01:46:11.062 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.064+0000 7fb2a040a740 1 -- start start 2024-09-17T01:46:11.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.064+0000 7fb2a040a740 1 Processor -- start 2024-09-17T01:46:11.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.066+0000 7fb2a040a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562baf76f610 0x562bafb7e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.066+0000 7fb2a040a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf7777f0 0x562bafb97ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.066+0000 7fb2a040a740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562baf7984d0 0x562bafb3f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.066+0000 7fb2a040a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562baf812880 con 0x562baf7777f0 2024-09-17T01:46:11.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.066+0000 7fb2a040a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562bafa474b0 con 0x562baf76f610 2024-09-17T01:46:11.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.066+0000 7fb2a040a740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x562bafb7d0c0 con 0x562baf7984d0 2024-09-17T01:46:11.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.066+0000 7fb2a040a740 10 client.0 _ll_register_callbacks cb 0x562bafa4d680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:46:11.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.066+0000 7fb289400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf7777f0 0x562bafb97ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.066+0000 7fb289400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf7777f0 0x562bafb97ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49982/0 (socket says 172.21.15.42:49982) 2024-09-17T01:46:11.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.066+0000 7fb289400640 1 -- 172.21.15.42:0/1874162513 learned_addr learned my addr 172.21.15.42:0/1874162513 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:11.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.066+0000 7fb291e00640 1 --2- 172.21.15.42:0/1874162513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562baf76f610 0x562bafb7e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.066+0000 7fb292800640 1 --2- 172.21.15.42:0/1874162513 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562baf7984d0 0x562bafb3f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.066+0000 7fb289400640 1 -- 172.21.15.42:0/1874162513 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562baf7984d0 msgr2=0x562bafb3f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.066+0000 7fb289400640 1 --2- 172.21.15.42:0/1874162513 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562baf7984d0 0x562bafb3f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.066+0000 7fb289400640 1 -- 172.21.15.42:0/1874162513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562baf76f610 msgr2=0x562bafb7e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.066+0000 7fb289400640 1 --2- 172.21.15.42:0/1874162513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562baf76f610 0x562bafb7e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.066+0000 7fb289400640 1 -- 172.21.15.42:0/1874162513 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562baf87c940 con 0x562baf7777f0 2024-09-17T01:46:11.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.067+0000 7fb289400640 1 --2- 172.21.15.42:0/1874162513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf7777f0 0x562bafb97ca0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7fb27c001220 tx=0x7fb27c027680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5eb1d7526411f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:11.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.067+0000 7fb277400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:46:11.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.067+0000 7fb277400640 1 -- 172.21.15.42:0/1874162513 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c016070 con 0x562baf7777f0 2024-09-17T01:46:11.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.067+0000 7fb277400640 1 -- 172.21.15.42:0/1874162513 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7fb27c012b40 con 0x562baf7777f0 2024-09-17T01:46:11.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.067+0000 7fb2a040a740 1 -- 172.21.15.42:0/1874162513 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb27c012d40 con 0x562baf7777f0 2024-09-17T01:46:11.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.067+0000 7fb277400640 1 -- 172.21.15.42:0/1874162513 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7fb27c022050 con 0x562baf7777f0 2024-09-17T01:46:11.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.067+0000 7fb2a040a740 10 client.10152 fetch_fsmap learned FSMap version 141 2024-09-17T01:46:11.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.067+0000 7fb2a040a740 1 -- 172.21.15.42:0/1874162513 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x562baf8dd0d0 con 0x562baf7777f0 2024-09-17T01:46:11.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.068+0000 7fb277400640 1 -- 172.21.15.42:0/1874162513 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb27c012d40 con 0x562baf7777f0 2024-09-17T01:46:11.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.068+0000 7fb277400640 1 -- 172.21.15.42:0/1874162513 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 141) ==== 3490+0+0 (secure 0 0 0) 0x7fb27c01a070 con 0x562baf7777f0 2024-09-17T01:46:11.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.068+0000 7fb2a040a740 10 client.10152 fetch_fsmap finished waiting for FSMap version 141 2024-09-17T01:46:11.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.068+0000 7fb2a040a740 10 client.10152 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:46:11.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.068+0000 7fb2a040a740 20 client.10152 populate_metadata read hostname 'smithi042' 2024-09-17T01:46:11.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.068+0000 7fb2a040a740 1 --2- 172.21.15.42:0/1874162513 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x562baf7572b0 0x562bafb7bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.068+0000 7fb2a040a740 4 client.10152 mds_command: new command op to 9960 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:46:11.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.068+0000 7fb2a040a740 1 -- 172.21.15.42:0/1874162513 --> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562bafab4720 con 0x562baf7572b0 2024-09-17T01:46:11.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.068+0000 7fb291e00640 1 --2- 172.21.15.42:0/1874162513 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x562baf7572b0 0x562bafb7bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.069+0000 7fb291e00640 1 --2- 172.21.15.42:0/1874162513 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x562baf7572b0 0x562bafb7bec0 crc :-1 s=READY pgs=9 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9960 client_cookie=ea736624d2a70a8 server_cookie=83c397efad4bcc6e in_seq=0 out_seq=0 2024-09-17T01:46:11.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.069+0000 7fb277400640 10 client.10152 ms_handle_connect on v2:172.21.15.42:6832/908320168 2024-09-17T01:46:11.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.069+0000 7fb277400640 1 -- 172.21.15.42:0/1874162513 <== mds.9960 v2:172.21.15.42:6832/908320168 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562bafab4720 con 0x562baf7572b0 2024-09-17T01:46:11.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.069+0000 7fb277400640 10 client.10152 handle_command_reply: tid=0 2024-09-17T01:46:11.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.069+0000 7fb2a040a740 1 client.10152 shutdown 2024-09-17T01:46:11.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.070+0000 7fb2a040a740 1 -- 172.21.15.42:0/1874162513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf7777f0 msgr2=0x562bafb97ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.070+0000 7fb2a040a740 1 --2- 172.21.15.42:0/1874162513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf7777f0 0x562bafb97ca0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7fb27c001220 tx=0x7fb27c027680 comp rx=0 tx=0).stop 2024-09-17T01:46:11.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.070+0000 7fb2a040a740 1 -- 172.21.15.42:0/1874162513 shutdown_connections 2024-09-17T01:46:11.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.070+0000 7fb2a040a740 1 --2- 172.21.15.42:0/1874162513 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x562baf7572b0 0x562bafb7bec0 crc :-1 s=READY pgs=9 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.070+0000 7fb2a040a740 1 --2- 172.21.15.42:0/1874162513 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562baf7984d0 0x562bafb3f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.070+0000 7fb2a040a740 1 --2- 172.21.15.42:0/1874162513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf7777f0 0x562bafb97ca0 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.070+0000 7fb2a040a740 1 --2- 172.21.15.42:0/1874162513 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562baf76f610 0x562bafb7e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.070+0000 7fb277400640 0 client.10152 ms_handle_reset on v2:172.21.15.42:6832/908320168 2024-09-17T01:46:11.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.070+0000 7fb2a040a740 1 -- 172.21.15.42:0/1874162513 >> 172.21.15.42:0/1874162513 conn(0x562baf78c620 msgr2=0x562bafb397a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:11.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.070+0000 7fb2a040a740 1 -- 172.21.15.42:0/1874162513 shutdown_connections 2024-09-17T01:46:11.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.070+0000 7fb2a040a740 1 -- 172.21.15.42:0/1874162513 wait complete. 2024-09-17T01:46:11.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.070+0000 7fb2a040a740 20 client.10152 trim_cache size 0 max 16384 2024-09-17T01:46:11.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.089+0000 7fb2a040a740 1 Processor -- start 2024-09-17T01:46:11.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.089+0000 7fb2a040a740 1 -- start start 2024-09-17T01:46:11.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.090+0000 7fb2a040a740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562baf76f610 0x562bafb7e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.090+0000 7fb2a040a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf7777f0 0x562bafb7ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.090+0000 7fb2a040a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562baf7984d0 0x562bafb7bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.090+0000 7fb2a040a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb294202420 con 0x562baf7777f0 2024-09-17T01:46:11.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.090+0000 7fb2a040a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb2941587c0 con 0x562baf7984d0 2024-09-17T01:46:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.090+0000 7fb2a040a740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb2941548d0 con 0x562baf76f610 2024-09-17T01:46:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.091+0000 7fb289400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf7777f0 0x562bafb7ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.091+0000 7fb289400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf7777f0 0x562bafb7ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:49984/0 (socket says 172.21.15.42:49984) 2024-09-17T01:46:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.091+0000 7fb289400640 1 -- 172.21.15.42:0/4134260202 learned_addr learned my addr 172.21.15.42:0/4134260202 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.091+0000 7fb292800640 1 --2- 172.21.15.42:0/4134260202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562baf7984d0 0x562bafb7bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.091+0000 7fb291e00640 1 --2- 172.21.15.42:0/4134260202 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562baf76f610 0x562bafb7e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.091+0000 7fb289400640 1 -- 172.21.15.42:0/4134260202 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562baf76f610 msgr2=0x562bafb7e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.091+0000 7fb289400640 1 --2- 172.21.15.42:0/4134260202 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562baf76f610 0x562bafb7e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.091+0000 7fb289400640 1 -- 172.21.15.42:0/4134260202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562baf7984d0 msgr2=0x562bafb7bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.091+0000 7fb289400640 1 --2- 172.21.15.42:0/4134260202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562baf7984d0 0x562bafb7bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.091+0000 7fb289400640 1 -- 172.21.15.42:0/4134260202 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bafb7d5c0 con 0x562baf7777f0 2024-09-17T01:46:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.091+0000 7fb291e00640 1 --2- 172.21.15.42:0/4134260202 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562baf76f610 0x562bafb7e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:11.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.091+0000 7fb292800640 1 --2- 172.21.15.42:0/4134260202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562baf7984d0 0x562bafb7bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:11.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.091+0000 7fb289400640 1 --2- 172.21.15.42:0/4134260202 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf7777f0 0x562bafb7ec00 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0128d0 tx=0x7fb27c0016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b936fa2cabeb9ff server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:11.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.091+0000 7fb282000640 1 -- 172.21.15.42:0/4134260202 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c040070 con 0x562baf7777f0 2024-09-17T01:46:11.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.092+0000 7fb282000640 1 -- 172.21.15.42:0/4134260202 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb27c012cf0 con 0x562baf7777f0 2024-09-17T01:46:11.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.092+0000 7fb282000640 1 -- 172.21.15.42:0/4134260202 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c016040 con 0x562baf7777f0 2024-09-17T01:46:11.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.092+0000 7fb2a040a740 1 -- 172.21.15.42:0/4134260202 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf7777f0 msgr2=0x562bafb7ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.092+0000 7fb2a040a740 1 --2- 172.21.15.42:0/4134260202 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf7777f0 0x562bafb7ec00 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0128d0 tx=0x7fb27c0016d0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.092+0000 7fb2a040a740 1 -- 172.21.15.42:0/4134260202 shutdown_connections 2024-09-17T01:46:11.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.092+0000 7fb2a040a740 1 --2- 172.21.15.42:0/4134260202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562baf7984d0 0x562bafb7bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.092+0000 7fb2a040a740 1 --2- 172.21.15.42:0/4134260202 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf7777f0 0x562bafb7ec00 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.092+0000 7fb2a040a740 1 --2- 172.21.15.42:0/4134260202 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562baf76f610 0x562bafb7e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.092+0000 7fb2a040a740 1 -- 172.21.15.42:0/4134260202 >> 172.21.15.42:0/4134260202 conn(0x562baf78c620 msgr2=0x562bafb587d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:11.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.092+0000 7fb2a040a740 1 -- 172.21.15.42:0/4134260202 shutdown_connections 2024-09-17T01:46:11.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.092+0000 7fb2a040a740 1 -- 172.21.15.42:0/4134260202 wait complete. 2024-09-17T01:46:11.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.093+0000 7fb2a040a740 1 -- start start 2024-09-17T01:46:11.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.094+0000 7fb2a040a740 1 Processor -- start 2024-09-17T01:46:11.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.095+0000 7fb2a040a740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562baf76f610 0x562bafb978b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.095+0000 7fb2a040a740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf7777f0 0x562bafb663b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.095+0000 7fb2a040a740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562baf7984d0 0x562bafb668f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.095+0000 7fb2a040a740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562bafb58650 con 0x562baf7777f0 2024-09-17T01:46:11.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.095+0000 7fb2a040a740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562bafb7ceb0 con 0x562baf76f610 2024-09-17T01:46:11.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.095+0000 7fb2a040a740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x562bafb7f7e0 con 0x562baf7984d0 2024-09-17T01:46:11.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.095+0000 7fb2a040a740 10 client.0 _ll_register_callbacks cb 0x7fb27c0065a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:46:11.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.095+0000 7fb289400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf7777f0 0x562bafb663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.095+0000 7fb289400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf7777f0 0x562bafb663b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50000/0 (socket says 172.21.15.42:50000) 2024-09-17T01:46:11.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.095+0000 7fb289400640 1 -- 172.21.15.42:0/1510748714 learned_addr learned my addr 172.21.15.42:0/1510748714 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:11.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.096+0000 7fb291e00640 1 --2- 172.21.15.42:0/1510748714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562baf76f610 0x562bafb978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.096+0000 7fb289400640 1 -- 172.21.15.42:0/1510748714 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562baf7984d0 msgr2=0x562bafb668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.096+0000 7fb292800640 1 --2- 172.21.15.42:0/1510748714 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562baf7984d0 0x562bafb668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.096+0000 7fb289400640 1 --2- 172.21.15.42:0/1510748714 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562baf7984d0 0x562bafb668f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.096+0000 7fb289400640 1 -- 172.21.15.42:0/1510748714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562baf76f610 msgr2=0x562bafb978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.096+0000 7fb289400640 1 --2- 172.21.15.42:0/1510748714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562baf76f610 0x562bafb978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.096+0000 7fb289400640 1 -- 172.21.15.42:0/1510748714 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bafb93730 con 0x562baf7777f0 2024-09-17T01:46:11.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.096+0000 7fb292800640 1 --2- 172.21.15.42:0/1510748714 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562baf7984d0 0x562bafb668f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:11.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.096+0000 7fb291e00640 1 --2- 172.21.15.42:0/1510748714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562baf76f610 0x562bafb978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:11.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.096+0000 7fb289400640 1 --2- 172.21.15.42:0/1510748714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf7777f0 0x562bafb663b0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7fb27c001740 tx=0x7fb27c027a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e04465edd55211 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:11.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.096+0000 7fb277400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:46:11.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.096+0000 7fb277400640 1 -- 172.21.15.42:0/1510748714 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c016070 con 0x562baf7777f0 2024-09-17T01:46:11.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.096+0000 7fb277400640 1 -- 172.21.15.42:0/1510748714 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7fb27c0050e0 con 0x562baf7777f0 2024-09-17T01:46:11.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.096+0000 7fb2a040a740 1 -- 172.21.15.42:0/1510748714 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb27c012cf0 con 0x562baf7777f0 2024-09-17T01:46:11.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.097+0000 7fb277400640 1 -- 172.21.15.42:0/1510748714 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7fb27c040070 con 0x562baf7777f0 2024-09-17T01:46:11.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.097+0000 7fb2a040a740 10 client.10158 fetch_fsmap learned FSMap version 141 2024-09-17T01:46:11.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.097+0000 7fb2a040a740 1 -- 172.21.15.42:0/1510748714 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x562baf7e17e0 con 0x562baf7777f0 2024-09-17T01:46:11.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.097+0000 7fb277400640 1 -- 172.21.15.42:0/1510748714 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb27c012cf0 con 0x562baf7777f0 2024-09-17T01:46:11.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.097+0000 7fb277400640 1 -- 172.21.15.42:0/1510748714 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 141) ==== 3490+0+0 (secure 0 0 0) 0x7fb27c050020 con 0x562baf7777f0 2024-09-17T01:46:11.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.097+0000 7fb2a040a740 10 client.10158 fetch_fsmap finished waiting for FSMap version 141 2024-09-17T01:46:11.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.097+0000 7fb2a040a740 10 client.10158 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:46:11.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.097+0000 7fb2a040a740 20 client.10158 populate_metadata read hostname 'smithi042' 2024-09-17T01:46:11.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.097+0000 7fb2a040a740 1 --2- 172.21.15.42:0/1510748714 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x562bafc04980 0x562bafb651c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.097+0000 7fb2a040a740 4 client.10158 mds_command: new command op to 9960 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-17T01:46:11.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.097+0000 7fb2a040a740 1 -- 172.21.15.42:0/1510748714 --> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x562bafab01d0 con 0x562bafc04980 2024-09-17T01:46:11.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.097+0000 7fb291e00640 1 --2- 172.21.15.42:0/1510748714 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x562bafc04980 0x562bafb651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.098+0000 7fb277400640 10 client.10158 ms_handle_connect on v2:172.21.15.42:6832/908320168 2024-09-17T01:46:11.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.098+0000 7fb291e00640 1 --2- 172.21.15.42:0/1510748714 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x562bafc04980 0x562bafb651c0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9960 client_cookie=501f0d8c0ce9e740 server_cookie=bd27d67d904949a4 in_seq=0 out_seq=0 2024-09-17T01:46:11.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.098+0000 7fb277400640 1 -- 172.21.15.42:0/1510748714 <== mds.9960 v2:172.21.15.42:6832/908320168 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x562bafab01d0 con 0x562bafc04980 2024-09-17T01:46:11.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.098+0000 7fb277400640 10 client.10158 handle_command_reply: tid=0 2024-09-17T01:46:11.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.098+0000 7fb2a040a740 1 client.10158 shutdown 2024-09-17T01:46:11.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.098+0000 7fb2a040a740 1 -- 172.21.15.42:0/1510748714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf7777f0 msgr2=0x562bafb663b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.098+0000 7fb2a040a740 1 --2- 172.21.15.42:0/1510748714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf7777f0 0x562bafb663b0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7fb27c001740 tx=0x7fb27c027a70 comp rx=0 tx=0).stop 2024-09-17T01:46:11.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.098+0000 7fb2a040a740 1 -- 172.21.15.42:0/1510748714 shutdown_connections 2024-09-17T01:46:11.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.098+0000 7fb2a040a740 1 --2- 172.21.15.42:0/1510748714 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x562bafc04980 0x562bafb651c0 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.098+0000 7fb2a040a740 1 --2- 172.21.15.42:0/1510748714 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x562baf7984d0 0x562bafb668f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.098+0000 7fb2a040a740 1 --2- 172.21.15.42:0/1510748714 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562baf7777f0 0x562bafb663b0 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.098+0000 7fb277400640 0 client.10158 ms_handle_reset on v2:172.21.15.42:6832/908320168 2024-09-17T01:46:11.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.098+0000 7fb2a040a740 1 --2- 172.21.15.42:0/1510748714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562baf76f610 0x562bafb978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.098+0000 7fb2a040a740 1 -- 172.21.15.42:0/1510748714 >> 172.21.15.42:0/1510748714 conn(0x562baf78c620 msgr2=0x562bafb587d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:11.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.099+0000 7fb2a040a740 1 -- 172.21.15.42:0/1510748714 shutdown_connections 2024-09-17T01:46:11.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.099+0000 7fb2a040a740 1 -- 172.21.15.42:0/1510748714 wait complete. 2024-09-17T01:46:11.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.099+0000 7fb2a040a740 20 client.10158 trim_cache size 0 max 16384 2024-09-17T01:46:11.101 INFO:teuthology.orchestra.run.smithi042.stderr:Error EINVAL: MDS is not active 2024-09-17T01:46:11.112 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T01:46:11.112 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub pause 2024-09-17T01:46:11.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.344+0000 7fc3aec00640 1 -- 172.21.15.42:0/735942048 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3a80cd4a0 msgr2=0x7fc3a815b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.344+0000 7fc3aec00640 1 --2- 172.21.15.42:0/735942048 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3a80cd4a0 0x7fc3a815b6d0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7fc39c005fd0 tx=0x7fc39c02a5d0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.344+0000 7fc3aec00640 1 -- 172.21.15.42:0/735942048 shutdown_connections 2024-09-17T01:46:11.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.344+0000 7fc3aec00640 1 --2- 172.21.15.42:0/735942048 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3a806fb10 0x7fc3a80aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.344+0000 7fc3aec00640 1 --2- 172.21.15.42:0/735942048 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3a80cd4a0 0x7fc3a815b6d0 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.344+0000 7fc3aec00640 1 -- 172.21.15.42:0/735942048 >> 172.21.15.42:0/735942048 conn(0x7fc3a806d440 msgr2=0x7fc3a80b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:11.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.344+0000 7fc3aec00640 1 -- 172.21.15.42:0/735942048 shutdown_connections 2024-09-17T01:46:11.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.344+0000 7fc3aec00640 1 -- 172.21.15.42:0/735942048 wait complete. 2024-09-17T01:46:11.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.346+0000 7fc3aec00640 1 Processor -- start 2024-09-17T01:46:11.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.346+0000 7fc3aec00640 1 -- start start 2024-09-17T01:46:11.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.348+0000 7fc3aec00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3a80ae820 0x7fc3a81f8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.348+0000 7fc3aec00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3a80cd4a0 0x7fc3a8157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.348+0000 7fc3aec00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3a81f5420 0x7fc3a81529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.348+0000 7fc3aec00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a80b4060 con 0x7fc3a81f5420 2024-09-17T01:46:11.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.348+0000 7fc3aec00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a80b3ee0 con 0x7fc3a80cd4a0 2024-09-17T01:46:11.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.348+0000 7fc3aec00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc3a80b41e0 con 0x7fc3a80ae820 2024-09-17T01:46:11.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.348+0000 7fc3ae200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3a81f5420 0x7fc3a81529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.348+0000 7fc3ae200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3a81f5420 0x7fc3a81529b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50012/0 (socket says 172.21.15.42:50012) 2024-09-17T01:46:11.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.348+0000 7fc3ae200640 1 -- 172.21.15.42:0/4261153162 learned_addr learned my addr 172.21.15.42:0/4261153162 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:11.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.348+0000 7fc3ad800640 1 --2- 172.21.15.42:0/4261153162 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3a80ae820 0x7fc3a81f8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.348+0000 7fc3ace00640 1 --2- 172.21.15.42:0/4261153162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3a80cd4a0 0x7fc3a8157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.349+0000 7fc3ae200640 1 -- 172.21.15.42:0/4261153162 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3a80ae820 msgr2=0x7fc3a81f8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.349+0000 7fc3ae200640 1 --2- 172.21.15.42:0/4261153162 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc3a80ae820 0x7fc3a81f8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.349+0000 7fc3ae200640 1 -- 172.21.15.42:0/4261153162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3a80cd4a0 msgr2=0x7fc3a8157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.349+0000 7fc3ae200640 1 --2- 172.21.15.42:0/4261153162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3a80cd4a0 0x7fc3a8157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.349+0000 7fc3ae200640 1 -- 172.21.15.42:0/4261153162 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a81f9210 con 0x7fc3a81f5420 2024-09-17T01:46:11.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.349+0000 7fc3ae200640 1 --2- 172.21.15.42:0/4261153162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3a81f5420 0x7fc3a81529b0 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7fc3a000cac0 tx=0x7fc3a000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:11.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.349+0000 7fc3a5600640 1 -- 172.21.15.42:0/4261153162 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0007df0 con 0x7fc3a81f5420 2024-09-17T01:46:11.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.349+0000 7fc3a5600640 1 -- 172.21.15.42:0/4261153162 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3a000f450 con 0x7fc3a81f5420 2024-09-17T01:46:11.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.349+0000 7fc3aec00640 1 -- 172.21.15.42:0/4261153162 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3a81f94f0 con 0x7fc3a81f5420 2024-09-17T01:46:11.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.349+0000 7fc3a5600640 1 -- 172.21.15.42:0/4261153162 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a000f8c0 con 0x7fc3a81f5420 2024-09-17T01:46:11.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.349+0000 7fc3aec00640 1 -- 172.21.15.42:0/4261153162 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3a81582d0 con 0x7fc3a81f5420 2024-09-17T01:46:11.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.352+0000 7fc3a5600640 1 -- 172.21.15.42:0/4261153162 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc3a000fa60 con 0x7fc3a81f5420 2024-09-17T01:46:11.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.353+0000 7fc3a5600640 1 --2- 172.21.15.42:0/4261153162 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc388078bc0 0x7fc38807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.353+0000 7fc3a5600640 1 -- 172.21.15.42:0/4261153162 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7fc3a009b8c0 con 0x7fc3a81f5420 2024-09-17T01:46:11.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.353+0000 7fc3ad800640 1 --2- 172.21.15.42:0/4261153162 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc388078bc0 0x7fc38807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.353+0000 7fc3b724e740 1 Processor -- start 2024-09-17T01:46:11.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.353+0000 7fc3b724e740 1 -- start start 2024-09-17T01:46:11.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.354+0000 7fc3ad800640 1 --2- 172.21.15.42:0/4261153162 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc388078bc0 0x7fc38807b0d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc39c033000 tx=0x7fc39c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:11.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.355+0000 7fc3b724e740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b1867e70c0 0x55b186bd6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.355+0000 7fc3b724e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1867be200 0x55b186bb91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.355+0000 7fc3b724e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867c63e0 0x55b186bb9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.355+0000 7fc3b724e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b186b019f0 con 0x55b1867c63e0 2024-09-17T01:46:11.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.355+0000 7fc3b724e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b186af0e20 con 0x55b1867be200 2024-09-17T01:46:11.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.355+0000 7fc3b724e740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55b186af4c30 con 0x55b1867e70c0 2024-09-17T01:46:11.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.355+0000 7fc3ae200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867c63e0 0x55b186bb9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.355+0000 7fc3ae200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867c63e0 0x55b186bb9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50024/0 (socket says 172.21.15.42:50024) 2024-09-17T01:46:11.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.355+0000 7fc3ae200640 1 -- 172.21.15.42:0/638750214 learned_addr learned my addr 172.21.15.42:0/638750214 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:11.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.356+0000 7fc3ae200640 1 -- 172.21.15.42:0/638750214 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b1867e70c0 msgr2=0x55b186bd6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.356+0000 7fc3ae200640 1 --2- 172.21.15.42:0/638750214 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b1867e70c0 0x55b186bd6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.356+0000 7fc3ae200640 1 -- 172.21.15.42:0/638750214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1867be200 msgr2=0x55b186bb91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.356+0000 7fc3ae200640 1 --2- 172.21.15.42:0/638750214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1867be200 0x55b186bb91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.356+0000 7fc3ae200640 1 -- 172.21.15.42:0/638750214 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1867e3120 con 0x55b1867c63e0 2024-09-17T01:46:11.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.356+0000 7fc3ae200640 1 --2- 172.21.15.42:0/638750214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867c63e0 0x55b186bb9710 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0060800 tx=0x7fc3a00631e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e13c27c2e43ef1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:11.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.356+0000 7fc39a000640 1 -- 172.21.15.42:0/638750214 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0068070 con 0x55b1867c63e0 2024-09-17T01:46:11.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.356+0000 7fc39a000640 1 -- 172.21.15.42:0/638750214 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3a006cf20 con 0x55b1867c63e0 2024-09-17T01:46:11.355 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.356+0000 7fc39a000640 1 -- 172.21.15.42:0/638750214 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a006ca90 con 0x55b1867c63e0 2024-09-17T01:46:11.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.357+0000 7fc3b724e740 1 -- 172.21.15.42:0/638750214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867c63e0 msgr2=0x55b186bb9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.357+0000 7fc3b724e740 1 --2- 172.21.15.42:0/638750214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867c63e0 0x55b186bb9710 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0060800 tx=0x7fc3a00631e0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.357+0000 7fc3b724e740 1 -- 172.21.15.42:0/638750214 shutdown_connections 2024-09-17T01:46:11.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.357+0000 7fc3b724e740 1 --2- 172.21.15.42:0/638750214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1867be200 0x55b186bb91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.357+0000 7fc3b724e740 1 --2- 172.21.15.42:0/638750214 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867c63e0 0x55b186bb9710 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.357+0000 7fc3b724e740 1 --2- 172.21.15.42:0/638750214 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b1867e70c0 0x55b186bd6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.357+0000 7fc3b724e740 1 -- 172.21.15.42:0/638750214 >> 172.21.15.42:0/638750214 conn(0x55b1867db210 msgr2=0x55b186b8f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:11.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.357+0000 7fc3b724e740 1 -- 172.21.15.42:0/638750214 shutdown_connections 2024-09-17T01:46:11.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.357+0000 7fc3b724e740 1 -- 172.21.15.42:0/638750214 wait complete. 2024-09-17T01:46:11.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.358+0000 7fc3b724e740 1 -- start start 2024-09-17T01:46:11.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.358+0000 7fc3b724e740 1 Processor -- start 2024-09-17T01:46:11.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.360+0000 7fc3b724e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1867be200 0x55b186be6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.360+0000 7fc3b724e740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b1867c63e0 0x55b186bce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.360+0000 7fc3b724e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867e70c0 0x55b186ba78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.360+0000 7fc3b724e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b186861470 con 0x55b1867e70c0 2024-09-17T01:46:11.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.360+0000 7fc3b724e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b186a967d0 con 0x55b1867be200 2024-09-17T01:46:11.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.360+0000 7fc3b724e740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55b186bcf050 con 0x55b1867c63e0 2024-09-17T01:46:11.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.361+0000 7fc3b724e740 10 client.0 _ll_register_callbacks cb 0x55b186a9c7e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:46:11.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.361+0000 7fc3ae200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867e70c0 0x55b186ba78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.361+0000 7fc3ad800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1867be200 0x55b186be6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.361+0000 7fc3ace00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b1867c63e0 0x55b186bce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.361+0000 7fc3ad800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1867be200 0x55b186be6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:47874/0 (socket says 172.21.15.42:47874) 2024-09-17T01:46:11.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.361+0000 7fc3ad800640 1 -- 172.21.15.42:0/1970394827 learned_addr learned my addr 172.21.15.42:0/1970394827 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:11.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.361+0000 7fc3ae200640 1 -- 172.21.15.42:0/1970394827 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b1867c63e0 msgr2=0x55b186bce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.361+0000 7fc3ae200640 1 --2- 172.21.15.42:0/1970394827 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b1867c63e0 0x55b186bce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.361+0000 7fc3ae200640 1 -- 172.21.15.42:0/1970394827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1867be200 msgr2=0x55b186be6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.361+0000 7fc3ae200640 1 --2- 172.21.15.42:0/1970394827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1867be200 0x55b186be6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.361+0000 7fc3ae200640 1 -- 172.21.15.42:0/1970394827 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1868c9500 con 0x55b1867e70c0 2024-09-17T01:46:11.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.362+0000 7fc3ae200640 1 --2- 172.21.15.42:0/1970394827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867e70c0 0x55b186ba78f0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7fc3a000a820 tx=0x7fc3a0010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b57848db02158bf server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:11.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.362+0000 7fc38ea00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:46:11.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.362+0000 7fc38ea00640 1 -- 172.21.15.42:0/1970394827 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a00629f0 con 0x55b1867e70c0 2024-09-17T01:46:11.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.362+0000 7fc38ea00640 1 -- 172.21.15.42:0/1970394827 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7fc3a006a280 con 0x55b1867e70c0 2024-09-17T01:46:11.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.362+0000 7fc3b724e740 1 -- 172.21.15.42:0/1970394827 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3a006cf20 con 0x55b1867e70c0 2024-09-17T01:46:11.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.362+0000 7fc38ea00640 1 -- 172.21.15.42:0/1970394827 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7fc3a0073050 con 0x55b1867e70c0 2024-09-17T01:46:11.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.362+0000 7fc3b724e740 10 client.10173 fetch_fsmap learned FSMap version 141 2024-09-17T01:46:11.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.362+0000 7fc3b724e740 1 -- 172.21.15.42:0/1970394827 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x55b186929c90 con 0x55b1867e70c0 2024-09-17T01:46:11.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.362+0000 7fc38ea00640 1 -- 172.21.15.42:0/1970394827 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3a006cf20 con 0x55b1867e70c0 2024-09-17T01:46:11.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.362+0000 7fc38ea00640 1 -- 172.21.15.42:0/1970394827 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 141) ==== 3490+0+0 (secure 0 0 0) 0x7fc3a0076020 con 0x55b1867e70c0 2024-09-17T01:46:11.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.362+0000 7fc3b724e740 10 client.10173 fetch_fsmap finished waiting for FSMap version 141 2024-09-17T01:46:11.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.362+0000 7fc3b724e740 10 client.10173 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:46:11.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.363+0000 7fc3b724e740 20 client.10173 populate_metadata read hostname 'smithi042' 2024-09-17T01:46:11.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.363+0000 7fc3b724e740 1 --2- 172.21.15.42:0/1970394827 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x55b1867a5ea0 0x55b186bd1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.363+0000 7fc3b724e740 4 client.10173 mds_command: new command op to 9960 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:46:11.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.363+0000 7fc3b724e740 1 -- 172.21.15.42:0/1970394827 --> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b186b03940 con 0x55b1867a5ea0 2024-09-17T01:46:11.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.363+0000 7fc3ad800640 1 --2- 172.21.15.42:0/1970394827 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x55b1867a5ea0 0x55b186bd1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.363+0000 7fc3ad800640 1 --2- 172.21.15.42:0/1970394827 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x55b1867a5ea0 0x55b186bd1ab0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9960 client_cookie=327351f71847cd72 server_cookie=80bf7b733387d7d9 in_seq=0 out_seq=0 2024-09-17T01:46:11.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.363+0000 7fc38ea00640 10 client.10173 ms_handle_connect on v2:172.21.15.42:6832/908320168 2024-09-17T01:46:11.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.364+0000 7fc38ea00640 1 -- 172.21.15.42:0/1970394827 <== mds.9960 v2:172.21.15.42:6832/908320168 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b186b03940 con 0x55b1867a5ea0 2024-09-17T01:46:11.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.364+0000 7fc38ea00640 10 client.10173 handle_command_reply: tid=0 2024-09-17T01:46:11.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.364+0000 7fc3b724e740 1 client.10173 shutdown 2024-09-17T01:46:11.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.364+0000 7fc3b724e740 1 -- 172.21.15.42:0/1970394827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867e70c0 msgr2=0x55b186ba78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.364+0000 7fc3b724e740 1 --2- 172.21.15.42:0/1970394827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867e70c0 0x55b186ba78f0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7fc3a000a820 tx=0x7fc3a0010f90 comp rx=0 tx=0).stop 2024-09-17T01:46:11.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.364+0000 7fc3b724e740 1 -- 172.21.15.42:0/1970394827 shutdown_connections 2024-09-17T01:46:11.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.364+0000 7fc3b724e740 1 --2- 172.21.15.42:0/1970394827 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x55b1867a5ea0 0x55b186bd1ab0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.364+0000 7fc3b724e740 1 --2- 172.21.15.42:0/1970394827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867e70c0 0x55b186ba78f0 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.364+0000 7fc3b724e740 1 --2- 172.21.15.42:0/1970394827 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b1867c63e0 0x55b186bce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.364+0000 7fc3b724e740 1 --2- 172.21.15.42:0/1970394827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1867be200 0x55b186be6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.364+0000 7fc38ea00640 0 client.10173 ms_handle_reset on v2:172.21.15.42:6832/908320168 2024-09-17T01:46:11.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.364+0000 7fc3b724e740 1 -- 172.21.15.42:0/1970394827 >> 172.21.15.42:0/1970394827 conn(0x55b1867db210 msgr2=0x55b186b8f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:11.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.365+0000 7fc3b724e740 1 -- 172.21.15.42:0/1970394827 shutdown_connections 2024-09-17T01:46:11.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.365+0000 7fc3b724e740 1 -- 172.21.15.42:0/1970394827 wait complete. 2024-09-17T01:46:11.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.365+0000 7fc3b724e740 20 client.10173 trim_cache size 0 max 16384 2024-09-17T01:46:11.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.383+0000 7fc3b724e740 1 Processor -- start 2024-09-17T01:46:11.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.384+0000 7fc3b724e740 1 -- start start 2024-09-17T01:46:11.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.385+0000 7fc3b724e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867be200 0x55b186bd2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.385+0000 7fc3b724e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1867c63e0 0x55b186bd34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.385+0000 7fc3b724e740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b1867e70c0 0x55b186bd3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.385+0000 7fc3b724e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a82022a0 con 0x55b1867be200 2024-09-17T01:46:11.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.385+0000 7fc3b724e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81e8c30 con 0x55b1867c63e0 2024-09-17T01:46:11.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.385+0000 7fc3b724e740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc3a8200ca0 con 0x55b1867e70c0 2024-09-17T01:46:11.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.385+0000 7fc3ad800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867be200 0x55b186bd2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.385+0000 7fc3ad800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867be200 0x55b186bd2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50048/0 (socket says 172.21.15.42:50048) 2024-09-17T01:46:11.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.385+0000 7fc3ad800640 1 -- 172.21.15.42:0/1803769861 learned_addr learned my addr 172.21.15.42:0/1803769861 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:11.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.385+0000 7fc3ace00640 1 --2- 172.21.15.42:0/1803769861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1867c63e0 0x55b186bd34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.386+0000 7fc3ae200640 1 --2- 172.21.15.42:0/1803769861 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b1867e70c0 0x55b186bd3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.386+0000 7fc3ad800640 1 -- 172.21.15.42:0/1803769861 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b1867e70c0 msgr2=0x55b186bd3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.386+0000 7fc3ad800640 1 --2- 172.21.15.42:0/1803769861 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b1867e70c0 0x55b186bd3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.386+0000 7fc3ad800640 1 -- 172.21.15.42:0/1803769861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1867c63e0 msgr2=0x55b186bd34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.386+0000 7fc3ad800640 1 --2- 172.21.15.42:0/1803769861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1867c63e0 0x55b186bd34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.386+0000 7fc3ad800640 1 -- 172.21.15.42:0/1803769861 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b186be2c10 con 0x55b1867be200 2024-09-17T01:46:11.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.386+0000 7fc3ace00640 1 --2- 172.21.15.42:0/1803769861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1867c63e0 0x55b186bd34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:11.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.386+0000 7fc3ae200640 1 --2- 172.21.15.42:0/1803769861 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b1867e70c0 0x55b186bd3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:11.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.386+0000 7fc3ad800640 1 --2- 172.21.15.42:0/1803769861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867be200 0x55b186bd2860 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7fc39c0096c0 tx=0x7fc39c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3ff633a379c643c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:11.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.386+0000 7fc399600640 1 -- 172.21.15.42:0/1803769861 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c035040 con 0x55b1867be200 2024-09-17T01:46:11.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.386+0000 7fc399600640 1 -- 172.21.15.42:0/1803769861 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc39c003ac0 con 0x55b1867be200 2024-09-17T01:46:11.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.386+0000 7fc399600640 1 -- 172.21.15.42:0/1803769861 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c0047a0 con 0x55b1867be200 2024-09-17T01:46:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.387+0000 7fc3b724e740 1 -- 172.21.15.42:0/1803769861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867be200 msgr2=0x55b186bd2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.387+0000 7fc3b724e740 1 --2- 172.21.15.42:0/1803769861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867be200 0x55b186bd2860 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7fc39c0096c0 tx=0x7fc39c02a5d0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.387+0000 7fc3b724e740 1 -- 172.21.15.42:0/1803769861 shutdown_connections 2024-09-17T01:46:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.387+0000 7fc3b724e740 1 --2- 172.21.15.42:0/1803769861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1867c63e0 0x55b186bd34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.387+0000 7fc3b724e740 1 --2- 172.21.15.42:0/1803769861 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b1867e70c0 0x55b186bd3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.387+0000 7fc3b724e740 1 --2- 172.21.15.42:0/1803769861 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867be200 0x55b186bd2860 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.387+0000 7fc3b724e740 1 -- 172.21.15.42:0/1803769861 >> 172.21.15.42:0/1803769861 conn(0x55b1867db210 msgr2=0x55b186bb6130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.387+0000 7fc3b724e740 1 -- 172.21.15.42:0/1803769861 shutdown_connections 2024-09-17T01:46:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.387+0000 7fc3b724e740 1 -- 172.21.15.42:0/1803769861 wait complete. 2024-09-17T01:46:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.388+0000 7fc3b724e740 1 -- start start 2024-09-17T01:46:11.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.388+0000 7fc3b724e740 1 Processor -- start 2024-09-17T01:46:11.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.390+0000 7fc3b724e740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867be200 0x55b186bd0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.390+0000 7fc3b724e740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1867c63e0 0x55b186c52950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.390+0000 7fc3b724e740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b1867e70c0 0x55b186bd2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.390+0000 7fc3b724e740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b186ba7e30 con 0x55b1867be200 2024-09-17T01:46:11.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.390+0000 7fc3b724e740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b186861470 con 0x55b1867c63e0 2024-09-17T01:46:11.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.390+0000 7fc3b724e740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55b186bd3290 con 0x55b1867e70c0 2024-09-17T01:46:11.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.390+0000 7fc3b724e740 10 client.0 _ll_register_callbacks cb 0x7fc3a0068140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:46:11.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.390+0000 7fc3ad800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867be200 0x55b186bd0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.390+0000 7fc3ad800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867be200 0x55b186bd0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50064/0 (socket says 172.21.15.42:50064) 2024-09-17T01:46:11.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.390+0000 7fc3ad800640 1 -- 172.21.15.42:0/410979758 learned_addr learned my addr 172.21.15.42:0/410979758 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:11.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.390+0000 7fc3ace00640 1 --2- 172.21.15.42:0/410979758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1867c63e0 0x55b186c52950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.390+0000 7fc3ae200640 1 --2- 172.21.15.42:0/410979758 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b1867e70c0 0x55b186bd2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.390+0000 7fc3ad800640 1 -- 172.21.15.42:0/410979758 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b1867e70c0 msgr2=0x55b186bd2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.390+0000 7fc3ad800640 1 --2- 172.21.15.42:0/410979758 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b1867e70c0 0x55b186bd2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.390+0000 7fc3ad800640 1 -- 172.21.15.42:0/410979758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1867c63e0 msgr2=0x55b186c52950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.390+0000 7fc3ad800640 1 --2- 172.21.15.42:0/410979758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1867c63e0 0x55b186c52950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.390+0000 7fc3ad800640 1 -- 172.21.15.42:0/410979758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1868303d0 con 0x55b1867be200 2024-09-17T01:46:11.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.391+0000 7fc3ad800640 1 --2- 172.21.15.42:0/410979758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867be200 0x55b186bd0230 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7fc39c034040 tx=0x7fc39c003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae94323c4cc55db server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:11.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.391+0000 7fc38ea00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:46:11.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.391+0000 7fc38ea00640 1 -- 172.21.15.42:0/410979758 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c0047a0 con 0x55b1867be200 2024-09-17T01:46:11.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.391+0000 7fc38ea00640 1 -- 172.21.15.42:0/410979758 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7fc39c004940 con 0x55b1867be200 2024-09-17T01:46:11.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.391+0000 7fc3b724e740 1 -- 172.21.15.42:0/410979758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc39c003ac0 con 0x55b1867be200 2024-09-17T01:46:11.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.391+0000 7fc38ea00640 1 -- 172.21.15.42:0/410979758 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7fc39c004b40 con 0x55b1867be200 2024-09-17T01:46:11.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.391+0000 7fc3b724e740 10 client.10179 fetch_fsmap learned FSMap version 141 2024-09-17T01:46:11.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.391+0000 7fc3b724e740 1 -- 172.21.15.42:0/410979758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x55b186b89b10 con 0x55b1867be200 2024-09-17T01:46:11.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.391+0000 7fc38ea00640 1 -- 172.21.15.42:0/410979758 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc39c003ac0 con 0x55b1867be200 2024-09-17T01:46:11.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.392+0000 7fc38ea00640 1 -- 172.21.15.42:0/410979758 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 141) ==== 3490+0+0 (secure 0 0 0) 0x7fc39c04f020 con 0x55b1867be200 2024-09-17T01:46:11.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.392+0000 7fc3b724e740 10 client.10179 fetch_fsmap finished waiting for FSMap version 141 2024-09-17T01:46:11.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.392+0000 7fc3b724e740 10 client.10179 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:46:11.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.392+0000 7fc3b724e740 20 client.10179 populate_metadata read hostname 'smithi042' 2024-09-17T01:46:11.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.392+0000 7fc3b724e740 1 --2- 172.21.15.42:0/410979758 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x55b186ba72e0 0x55b186bf68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.392+0000 7fc3b724e740 4 client.10179 mds_command: new command op to 9960 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-17T01:46:11.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.392+0000 7fc3b724e740 1 -- 172.21.15.42:0/410979758 --> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x55b186b8b350 con 0x55b186ba72e0 2024-09-17T01:46:11.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.392+0000 7fc3ace00640 1 --2- 172.21.15.42:0/410979758 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x55b186ba72e0 0x55b186bf68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.392+0000 7fc3ace00640 1 --2- 172.21.15.42:0/410979758 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x55b186ba72e0 0x55b186bf68a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9960 client_cookie=f3fc00b8fb3aace1 server_cookie=1c4121a97f0dd621 in_seq=0 out_seq=0 2024-09-17T01:46:11.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.392+0000 7fc38ea00640 10 client.10179 ms_handle_connect on v2:172.21.15.42:6832/908320168 2024-09-17T01:46:11.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.393+0000 7fc38ea00640 1 -- 172.21.15.42:0/410979758 <== mds.9960 v2:172.21.15.42:6832/908320168 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55b186b8b350 con 0x55b186ba72e0 2024-09-17T01:46:11.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.393+0000 7fc38ea00640 10 client.10179 handle_command_reply: tid=0 2024-09-17T01:46:11.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.393+0000 7fc3b724e740 1 client.10179 shutdown 2024-09-17T01:46:11.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.393+0000 7fc3b724e740 1 -- 172.21.15.42:0/410979758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867be200 msgr2=0x55b186bd0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.393+0000 7fc3b724e740 1 --2- 172.21.15.42:0/410979758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867be200 0x55b186bd0230 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7fc39c034040 tx=0x7fc39c003eb0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.393+0000 7fc3b724e740 1 -- 172.21.15.42:0/410979758 shutdown_connections 2024-09-17T01:46:11.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.393+0000 7fc3b724e740 1 --2- 172.21.15.42:0/410979758 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x55b186ba72e0 0x55b186bf68a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.393+0000 7fc3b724e740 1 --2- 172.21.15.42:0/410979758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1867c63e0 0x55b186c52950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.393+0000 7fc3b724e740 1 --2- 172.21.15.42:0/410979758 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b1867e70c0 0x55b186bd2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.393+0000 7fc3b724e740 1 --2- 172.21.15.42:0/410979758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1867be200 0x55b186bd0230 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.393+0000 7fc38ea00640 0 client.10179 ms_handle_reset on v2:172.21.15.42:6832/908320168 2024-09-17T01:46:11.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.393+0000 7fc3b724e740 1 -- 172.21.15.42:0/410979758 >> 172.21.15.42:0/410979758 conn(0x55b1867db210 msgr2=0x55b186bb6130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:11.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.393+0000 7fc3b724e740 1 -- 172.21.15.42:0/410979758 shutdown_connections 2024-09-17T01:46:11.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.393+0000 7fc3b724e740 1 -- 172.21.15.42:0/410979758 wait complete. 2024-09-17T01:46:11.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.393+0000 7fc3b724e740 20 client.10179 trim_cache size 0 max 16384 2024-09-17T01:46:11.395 INFO:teuthology.orchestra.run.smithi042.stderr:Error EINVAL: MDS is not active 2024-09-17T01:46:11.404 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T01:46:11.404 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub abort 2024-09-17T01:46:11.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.637+0000 7f5bfbc00640 1 -- 172.21.15.42:0/2726280056 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5bf406ee90 msgr2=0x7f5bf415f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.637+0000 7f5bfbc00640 1 --2- 172.21.15.42:0/2726280056 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5bf406ee90 0x7f5bf415f200 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5be8009860 tx=0x7f5be802a510 comp rx=0 tx=0).stop 2024-09-17T01:46:11.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.637+0000 7f5bfbc00640 1 -- 172.21.15.42:0/2726280056 shutdown_connections 2024-09-17T01:46:11.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.637+0000 7f5bfbc00640 1 --2- 172.21.15.42:0/2726280056 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5bf406ee90 0x7f5bf415f200 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.637+0000 7f5bfbc00640 1 -- 172.21.15.42:0/2726280056 >> 172.21.15.42:0/2726280056 conn(0x7f5bf40b2930 msgr2=0x7f5bf406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:11.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.637+0000 7f5bfbc00640 1 -- 172.21.15.42:0/2726280056 shutdown_connections 2024-09-17T01:46:11.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.637+0000 7f5bfbc00640 1 -- 172.21.15.42:0/2726280056 wait complete. 2024-09-17T01:46:11.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.639+0000 7f5bfbc00640 1 Processor -- start 2024-09-17T01:46:11.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.639+0000 7f5bfbc00640 1 -- start start 2024-09-17T01:46:11.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.640+0000 7f5bfbc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5bf406ee90 0x7f5bf4161740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.641+0000 7f5bfbc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bf406f2a0 0x7f5bf41f9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.641+0000 7f5bfbc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5bf4073df0 0x7f5bf41f95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.641+0000 7f5bfbc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf40cf0c0 con 0x7f5bf406f2a0 2024-09-17T01:46:11.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.641+0000 7f5bfbc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf40cef40 con 0x7f5bf406ee90 2024-09-17T01:46:11.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.641+0000 7f5bfbc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5bf40cf240 con 0x7f5bf4073df0 2024-09-17T01:46:11.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.641+0000 7f5bf3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bf406f2a0 0x7f5bf41f9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.641+0000 7f5bf3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bf406f2a0 0x7f5bf41f9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50074/0 (socket says 172.21.15.42:50074) 2024-09-17T01:46:11.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.641+0000 7f5bf3e00640 1 -- 172.21.15.42:0/3284143997 learned_addr learned my addr 172.21.15.42:0/3284143997 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:11.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.641+0000 7f5bf9200640 1 --2- 172.21.15.42:0/3284143997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5bf406ee90 0x7f5bf4161740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.641+0000 7f5bf9c00640 1 --2- 172.21.15.42:0/3284143997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5bf4073df0 0x7f5bf41f95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.641+0000 7f5bf3e00640 1 -- 172.21.15.42:0/3284143997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5bf4073df0 msgr2=0x7f5bf41f95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.641+0000 7f5bf3e00640 1 --2- 172.21.15.42:0/3284143997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5bf4073df0 0x7f5bf41f95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.641+0000 7f5bf3e00640 1 -- 172.21.15.42:0/3284143997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5bf406ee90 msgr2=0x7f5bf4161740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.641+0000 7f5bf3e00640 1 --2- 172.21.15.42:0/3284143997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5bf406ee90 0x7f5bf4161740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.641+0000 7f5bf3e00640 1 -- 172.21.15.42:0/3284143997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf41599f0 con 0x7f5bf406f2a0 2024-09-17T01:46:11.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.641+0000 7f5bf9c00640 1 --2- 172.21.15.42:0/3284143997 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5bf4073df0 0x7f5bf41f95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:11.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.642+0000 7f5bf3e00640 1 --2- 172.21.15.42:0/3284143997 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bf406f2a0 0x7f5bf41f9060 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f5be000c460 tx=0x7f5be000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:11.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.642+0000 7f5bf0c00640 1 -- 172.21.15.42:0/3284143997 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be00052d0 con 0x7f5bf406f2a0 2024-09-17T01:46:11.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.642+0000 7f5bf0c00640 1 -- 172.21.15.42:0/3284143997 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5be0005490 con 0x7f5bf406f2a0 2024-09-17T01:46:11.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.642+0000 7f5bf0c00640 1 -- 172.21.15.42:0/3284143997 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be0012870 con 0x7f5bf406f2a0 2024-09-17T01:46:11.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.642+0000 7f5bfbc00640 1 -- 172.21.15.42:0/3284143997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf4159cd0 con 0x7f5bf406f2a0 2024-09-17T01:46:11.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.642+0000 7f5bfbc00640 1 -- 172.21.15.42:0/3284143997 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf415a290 con 0x7f5bf406f2a0 2024-09-17T01:46:11.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.644+0000 7f5bf0c00640 1 -- 172.21.15.42:0/3284143997 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5be0012a10 con 0x7f5bf406f2a0 2024-09-17T01:46:11.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.646+0000 7f5bf0c00640 1 --2- 172.21.15.42:0/3284143997 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5bd4078bc0 0x7f5bd407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.646+0000 7f5bf0c00640 1 -- 172.21.15.42:0/3284143997 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7f5be009a770 con 0x7f5bf406f2a0 2024-09-17T01:46:11.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.647+0000 7f5c02c5d740 1 Processor -- start 2024-09-17T01:46:11.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.647+0000 7f5bf9200640 1 --2- 172.21.15.42:0/3284143997 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5bd4078bc0 0x7f5bd407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.647+0000 7f5c02c5d740 1 -- start start 2024-09-17T01:46:11.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.647+0000 7f5bf9200640 1 --2- 172.21.15.42:0/3284143997 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5bd4078bc0 0x7f5bd407b0d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5be8034000 tx=0x7f5be8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:11.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.648+0000 7f5c02c5d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a30747a0c0 0x55a307869350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.648+0000 7f5c02c5d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a307451200 0x55a30784c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.648+0000 7f5c02c5d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a3074593e0 0x55a30784c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.648+0000 7f5c02c5d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a3077949f0 con 0x55a307451200 2024-09-17T01:46:11.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.648+0000 7f5c02c5d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a307783e20 con 0x55a3074593e0 2024-09-17T01:46:11.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.648+0000 7f5c02c5d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55a307787c30 con 0x55a30747a0c0 2024-09-17T01:46:11.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.648+0000 7f5bf3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a307451200 0x55a30784c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.648+0000 7f5bf3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a307451200 0x55a30784c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50080/0 (socket says 172.21.15.42:50080) 2024-09-17T01:46:11.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.648+0000 7f5bf3e00640 1 -- 172.21.15.42:0/3154276786 learned_addr learned my addr 172.21.15.42:0/3154276786 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:11.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.649+0000 7f5bf9200640 1 --2- 172.21.15.42:0/3154276786 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a30747a0c0 0x55a307869350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.649+0000 7f5bf9c00640 1 --2- 172.21.15.42:0/3154276786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a3074593e0 0x55a30784c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.649+0000 7f5bf3e00640 1 -- 172.21.15.42:0/3154276786 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a30747a0c0 msgr2=0x55a307869350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.649+0000 7f5bf3e00640 1 --2- 172.21.15.42:0/3154276786 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a30747a0c0 0x55a307869350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.649+0000 7f5bf3e00640 1 -- 172.21.15.42:0/3154276786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a3074593e0 msgr2=0x55a30784c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.649+0000 7f5bf3e00640 1 --2- 172.21.15.42:0/3154276786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a3074593e0 0x55a30784c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.649+0000 7f5bf3e00640 1 -- 172.21.15.42:0/3154276786 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a307476120 con 0x55a307451200 2024-09-17T01:46:11.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.649+0000 7f5bf3e00640 1 --2- 172.21.15.42:0/3154276786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a307451200 0x55a30784c020 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f5be0098b70 tx=0x7f5be0061fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822b93dfed466e2b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:11.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.649+0000 7f5be5600640 1 -- 172.21.15.42:0/3154276786 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be00624d0 con 0x55a307451200 2024-09-17T01:46:11.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.649+0000 7f5be5600640 1 -- 172.21.15.42:0/3154276786 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5be0066fb0 con 0x55a307451200 2024-09-17T01:46:11.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.649+0000 7f5be5600640 1 -- 172.21.15.42:0/3154276786 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be006be60 con 0x55a307451200 2024-09-17T01:46:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.650+0000 7f5c02c5d740 1 -- 172.21.15.42:0/3154276786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a307451200 msgr2=0x55a30784c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.650+0000 7f5c02c5d740 1 --2- 172.21.15.42:0/3154276786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a307451200 0x55a30784c020 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f5be0098b70 tx=0x7f5be0061fe0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.650+0000 7f5c02c5d740 1 -- 172.21.15.42:0/3154276786 shutdown_connections 2024-09-17T01:46:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.650+0000 7f5c02c5d740 1 --2- 172.21.15.42:0/3154276786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a3074593e0 0x55a30784c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.650+0000 7f5c02c5d740 1 --2- 172.21.15.42:0/3154276786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a307451200 0x55a30784c020 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.650+0000 7f5c02c5d740 1 --2- 172.21.15.42:0/3154276786 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a30747a0c0 0x55a307869350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.650+0000 7f5c02c5d740 1 -- 172.21.15.42:0/3154276786 >> 172.21.15.42:0/3154276786 conn(0x55a30746e210 msgr2=0x55a307822240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.650+0000 7f5c02c5d740 1 -- 172.21.15.42:0/3154276786 shutdown_connections 2024-09-17T01:46:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.650+0000 7f5c02c5d740 1 -- 172.21.15.42:0/3154276786 wait complete. 2024-09-17T01:46:11.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.651+0000 7f5c02c5d740 1 -- start start 2024-09-17T01:46:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.652+0000 7f5c02c5d740 1 Processor -- start 2024-09-17T01:46:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.653+0000 7f5c02c5d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a307451200 0x55a307863060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.653+0000 7f5c02c5d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a3074593e0 0x55a307867b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.653+0000 7f5c02c5d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a30747a0c0 0x55a307821d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.653+0000 7f5c02c5d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a3074f4470 con 0x55a30747a0c0 2024-09-17T01:46:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.653+0000 7f5c02c5d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a3077297d0 con 0x55a3074593e0 2024-09-17T01:46:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.653+0000 7f5c02c5d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55a307863660 con 0x55a307451200 2024-09-17T01:46:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.653+0000 7f5c02c5d740 10 client.0 _ll_register_callbacks cb 0x55a30772f7e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:46:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.653+0000 7f5bf9c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a30747a0c0 0x55a307821d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.653+0000 7f5bf9c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a30747a0c0 0x55a307821d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50084/0 (socket says 172.21.15.42:50084) 2024-09-17T01:46:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.654+0000 7f5bf9c00640 1 -- 172.21.15.42:0/4103901193 learned_addr learned my addr 172.21.15.42:0/4103901193 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.654+0000 7f5bf9200640 1 --2- 172.21.15.42:0/4103901193 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a307451200 0x55a307863060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.654+0000 7f5bf3e00640 1 --2- 172.21.15.42:0/4103901193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a3074593e0 0x55a307867b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.654+0000 7f5bf9c00640 1 -- 172.21.15.42:0/4103901193 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a307451200 msgr2=0x55a307863060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.654+0000 7f5bf9c00640 1 --2- 172.21.15.42:0/4103901193 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a307451200 0x55a307863060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.654+0000 7f5bf9c00640 1 -- 172.21.15.42:0/4103901193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a3074593e0 msgr2=0x55a307867b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.654+0000 7f5bf9c00640 1 --2- 172.21.15.42:0/4103901193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a3074593e0 0x55a307867b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.654+0000 7f5bf9c00640 1 -- 172.21.15.42:0/4103901193 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a30755c500 con 0x55a30747a0c0 2024-09-17T01:46:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.654+0000 7f5bf9c00640 1 --2- 172.21.15.42:0/4103901193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a30747a0c0 0x55a307821d60 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f5bf40afba0 tx=0x7f5bec010ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c0e7de006d0beb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.654+0000 7f5bda000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:46:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.654+0000 7f5bda000640 1 -- 172.21.15.42:0/4103901193 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bec01a030 con 0x55a30747a0c0 2024-09-17T01:46:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.654+0000 7f5bda000640 1 -- 172.21.15.42:0/4103901193 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7f5bec004a40 con 0x55a30747a0c0 2024-09-17T01:46:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.654+0000 7f5c02c5d740 1 -- 172.21.15.42:0/4103901193 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5be0066fb0 con 0x55a30747a0c0 2024-09-17T01:46:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.655+0000 7f5bda000640 1 -- 172.21.15.42:0/4103901193 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7f5bec023050 con 0x55a30747a0c0 2024-09-17T01:46:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.655+0000 7f5c02c5d740 10 client.10191 fetch_fsmap learned FSMap version 141 2024-09-17T01:46:11.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.655+0000 7f5c02c5d740 1 -- 172.21.15.42:0/4103901193 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x55a3075bcc90 con 0x55a30747a0c0 2024-09-17T01:46:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.655+0000 7f5bda000640 1 -- 172.21.15.42:0/4103901193 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5be0066fb0 con 0x55a30747a0c0 2024-09-17T01:46:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.655+0000 7f5bda000640 1 -- 172.21.15.42:0/4103901193 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 141) ==== 3490+0+0 (secure 0 0 0) 0x7f5bec026020 con 0x55a30747a0c0 2024-09-17T01:46:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.655+0000 7f5c02c5d740 10 client.10191 fetch_fsmap finished waiting for FSMap version 141 2024-09-17T01:46:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.655+0000 7f5c02c5d740 10 client.10191 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:46:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.655+0000 7f5c02c5d740 20 client.10191 populate_metadata read hostname 'smithi042' 2024-09-17T01:46:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.655+0000 7f5c02c5d740 1 --2- 172.21.15.42:0/4103901193 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x55a307438ea0 0x55a3078613f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.655+0000 7f5c02c5d740 4 client.10191 mds_command: new command op to 9960 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:46:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.655+0000 7f5c02c5d740 1 -- 172.21.15.42:0/4103901193 --> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a307796940 con 0x55a307438ea0 2024-09-17T01:46:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.656+0000 7f5bf9200640 1 --2- 172.21.15.42:0/4103901193 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x55a307438ea0 0x55a3078613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.656+0000 7f5bf9200640 1 --2- 172.21.15.42:0/4103901193 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x55a307438ea0 0x55a3078613f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9960 client_cookie=c078be1c6c329e02 server_cookie=9bb3259a2e09596a in_seq=0 out_seq=0 2024-09-17T01:46:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.656+0000 7f5bda000640 10 client.10191 ms_handle_connect on v2:172.21.15.42:6832/908320168 2024-09-17T01:46:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.657+0000 7f5bda000640 1 -- 172.21.15.42:0/4103901193 <== mds.9960 v2:172.21.15.42:6832/908320168 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a307796940 con 0x55a307438ea0 2024-09-17T01:46:11.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.657+0000 7f5bda000640 10 client.10191 handle_command_reply: tid=0 2024-09-17T01:46:11.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.657+0000 7f5c02c5d740 1 client.10191 shutdown 2024-09-17T01:46:11.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.657+0000 7f5c02c5d740 1 -- 172.21.15.42:0/4103901193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a30747a0c0 msgr2=0x55a307821d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.657+0000 7f5c02c5d740 1 --2- 172.21.15.42:0/4103901193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a30747a0c0 0x55a307821d60 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f5bf40afba0 tx=0x7f5bec010ae0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.657+0000 7f5c02c5d740 1 -- 172.21.15.42:0/4103901193 shutdown_connections 2024-09-17T01:46:11.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.657+0000 7f5c02c5d740 1 --2- 172.21.15.42:0/4103901193 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x55a307438ea0 0x55a3078613f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.657+0000 7f5c02c5d740 1 --2- 172.21.15.42:0/4103901193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a3074593e0 0x55a307867b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.657+0000 7f5c02c5d740 1 --2- 172.21.15.42:0/4103901193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a30747a0c0 0x55a307821d60 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.657+0000 7f5c02c5d740 1 --2- 172.21.15.42:0/4103901193 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a307451200 0x55a307863060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.657+0000 7f5c02c5d740 1 -- 172.21.15.42:0/4103901193 >> 172.21.15.42:0/4103901193 conn(0x55a30746e210 msgr2=0x55a3078608f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:11.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.657+0000 7f5bda000640 0 client.10191 ms_handle_reset on v2:172.21.15.42:6832/908320168 2024-09-17T01:46:11.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.657+0000 7f5c02c5d740 1 -- 172.21.15.42:0/4103901193 shutdown_connections 2024-09-17T01:46:11.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.657+0000 7f5c02c5d740 1 -- 172.21.15.42:0/4103901193 wait complete. 2024-09-17T01:46:11.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.658+0000 7f5c02c5d740 20 client.10191 trim_cache size 0 max 16384 2024-09-17T01:46:11.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.676+0000 7f5c02c5d740 1 Processor -- start 2024-09-17T01:46:11.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.676+0000 7f5c02c5d740 1 -- start start 2024-09-17T01:46:11.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.677+0000 7f5c02c5d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a307451200 0x55a307869da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.677+0000 7f5c02c5d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a3074593e0 0x55a3078669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.677+0000 7f5c02c5d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a30747a0c0 0x55a307866f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.677+0000 7f5c02c5d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf4202260 con 0x55a307451200 2024-09-17T01:46:11.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.677+0000 7f5c02c5d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf4148ed0 con 0x55a30747a0c0 2024-09-17T01:46:11.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.677+0000 7f5c02c5d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5bf4149520 con 0x55a3074593e0 2024-09-17T01:46:11.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.677+0000 7f5bf9200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a307451200 0x55a307869da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.678+0000 7f5bf9200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a307451200 0x55a307869da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50098/0 (socket says 172.21.15.42:50098) 2024-09-17T01:46:11.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.678+0000 7f5bf9200640 1 -- 172.21.15.42:0/3992744216 learned_addr learned my addr 172.21.15.42:0/3992744216 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:11.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.678+0000 7f5bf3e00640 1 --2- 172.21.15.42:0/3992744216 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a3074593e0 0x55a3078669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.678+0000 7f5bf9c00640 1 --2- 172.21.15.42:0/3992744216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a30747a0c0 0x55a307866f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.678+0000 7f5bf9200640 1 -- 172.21.15.42:0/3992744216 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a3074593e0 msgr2=0x55a3078669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.678+0000 7f5bf9200640 1 --2- 172.21.15.42:0/3992744216 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a3074593e0 0x55a3078669d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.678+0000 7f5bf9200640 1 -- 172.21.15.42:0/3992744216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a30747a0c0 msgr2=0x55a307866f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.678+0000 7f5bf9200640 1 --2- 172.21.15.42:0/3992744216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a30747a0c0 0x55a307866f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.678+0000 7f5bf9200640 1 -- 172.21.15.42:0/3992744216 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3074c33d0 con 0x55a307451200 2024-09-17T01:46:11.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.678+0000 7f5bf9200640 1 --2- 172.21.15.42:0/3992744216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a307451200 0x55a307869da0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f5be8009980 tx=0x7f5be803e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab275bfd9d760c87 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:11.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.678+0000 7f5be4c00640 1 -- 172.21.15.42:0/3992744216 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be8055070 con 0x55a307451200 2024-09-17T01:46:11.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.678+0000 7f5be4c00640 1 -- 172.21.15.42:0/3992744216 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5be8003970 con 0x55a307451200 2024-09-17T01:46:11.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.679+0000 7f5be4c00640 1 -- 172.21.15.42:0/3992744216 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be8003d40 con 0x55a307451200 2024-09-17T01:46:11.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.679+0000 7f5c02c5d740 1 -- 172.21.15.42:0/3992744216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a307451200 msgr2=0x55a307869da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.679+0000 7f5c02c5d740 1 --2- 172.21.15.42:0/3992744216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a307451200 0x55a307869da0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f5be8009980 tx=0x7f5be803e040 comp rx=0 tx=0).stop 2024-09-17T01:46:11.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.679+0000 7f5c02c5d740 1 -- 172.21.15.42:0/3992744216 shutdown_connections 2024-09-17T01:46:11.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.679+0000 7f5c02c5d740 1 --2- 172.21.15.42:0/3992744216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a30747a0c0 0x55a307866f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.679+0000 7f5c02c5d740 1 --2- 172.21.15.42:0/3992744216 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a3074593e0 0x55a3078669d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.679+0000 7f5c02c5d740 1 --2- 172.21.15.42:0/3992744216 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a307451200 0x55a307869da0 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.679+0000 7f5c02c5d740 1 -- 172.21.15.42:0/3992744216 >> 172.21.15.42:0/3992744216 conn(0x55a30746e210 msgr2=0x55a3078230f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:11.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.679+0000 7f5c02c5d740 1 -- 172.21.15.42:0/3992744216 shutdown_connections 2024-09-17T01:46:11.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.679+0000 7f5c02c5d740 1 -- 172.21.15.42:0/3992744216 wait complete. 2024-09-17T01:46:11.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.680+0000 7f5c02c5d740 1 -- start start 2024-09-17T01:46:11.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.681+0000 7f5c02c5d740 1 Processor -- start 2024-09-17T01:46:11.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.682+0000 7f5c02c5d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a307451200 0x55a307866d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.682+0000 7f5c02c5d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a3074593e0 0x55a3078e0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.682+0000 7f5c02c5d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a30747a0c0 0x55a30784c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.682+0000 7f5c02c5d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a30783a9a0 con 0x55a30747a0c0 2024-09-17T01:46:11.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.682+0000 7f5c02c5d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a3078222f0 con 0x55a3074593e0 2024-09-17T01:46:11.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.682+0000 7f5c02c5d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55a307876430 con 0x55a307451200 2024-09-17T01:46:11.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.682+0000 7f5c02c5d740 10 client.0 _ll_register_callbacks cb 0x7f5bec010320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:46:11.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.682+0000 7f5bf9c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a30747a0c0 0x55a30784c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.682+0000 7f5bf9c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a30747a0c0 0x55a30784c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50114/0 (socket says 172.21.15.42:50114) 2024-09-17T01:46:11.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.682+0000 7f5bf9c00640 1 -- 172.21.15.42:0/3663116352 learned_addr learned my addr 172.21.15.42:0/3663116352 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:11.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.683+0000 7f5bf9200640 1 --2- 172.21.15.42:0/3663116352 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a307451200 0x55a307866d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.683+0000 7f5bf3e00640 1 --2- 172.21.15.42:0/3663116352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a3074593e0 0x55a3078e0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.683+0000 7f5bf9c00640 1 -- 172.21.15.42:0/3663116352 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a307451200 msgr2=0x55a307866d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.683+0000 7f5bf9c00640 1 --2- 172.21.15.42:0/3663116352 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a307451200 0x55a307866d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.683+0000 7f5bf9c00640 1 -- 172.21.15.42:0/3663116352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a3074593e0 msgr2=0x55a3078e0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.683+0000 7f5bf9c00640 1 --2- 172.21.15.42:0/3663116352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a3074593e0 0x55a3078e0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.683+0000 7f5bf9c00640 1 -- 172.21.15.42:0/3663116352 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a307867240 con 0x55a30747a0c0 2024-09-17T01:46:11.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.683+0000 7f5bf3e00640 1 --2- 172.21.15.42:0/3663116352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a3074593e0 0x55a3078e0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:11.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.683+0000 7f5bf9c00640 1 --2- 172.21.15.42:0/3663116352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a30747a0c0 0x55a30784c020 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0102f0 tx=0x7f5bec00e1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbc145722c8c106 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:11.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.683+0000 7f5bda000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:46:11.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.683+0000 7f5bda000640 1 -- 172.21.15.42:0/3663116352 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bec02b070 con 0x55a30747a0c0 2024-09-17T01:46:11.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.684+0000 7f5c02c5d740 1 -- 172.21.15.42:0/3663116352 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5be8003970 con 0x55a30747a0c0 2024-09-17T01:46:11.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.684+0000 7f5bda000640 1 -- 172.21.15.42:0/3663116352 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7f5bec0051f0 con 0x55a30747a0c0 2024-09-17T01:46:11.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.684+0000 7f5bda000640 1 -- 172.21.15.42:0/3663116352 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7f5bec01a040 con 0x55a30747a0c0 2024-09-17T01:46:11.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.684+0000 7f5c02c5d740 10 client.10197 fetch_fsmap learned FSMap version 141 2024-09-17T01:46:11.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.684+0000 7f5c02c5d740 1 -- 172.21.15.42:0/3663116352 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x55a307889bf0 con 0x55a30747a0c0 2024-09-17T01:46:11.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.684+0000 7f5bda000640 1 -- 172.21.15.42:0/3663116352 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5be8003970 con 0x55a30747a0c0 2024-09-17T01:46:11.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.684+0000 7f5bda000640 1 -- 172.21.15.42:0/3663116352 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 141) ==== 3490+0+0 (secure 0 0 0) 0x7f5bec026030 con 0x55a30747a0c0 2024-09-17T01:46:11.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.684+0000 7f5c02c5d740 10 client.10197 fetch_fsmap finished waiting for FSMap version 141 2024-09-17T01:46:11.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.684+0000 7f5c02c5d740 10 client.10197 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:46:11.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.684+0000 7f5c02c5d740 20 client.10197 populate_metadata read hostname 'smithi042' 2024-09-17T01:46:11.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.684+0000 7f5c02c5d740 1 --2- 172.21.15.42:0/3663116352 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x55a3078ea360 0x55a307842a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.684+0000 7f5c02c5d740 4 client.10197 mds_command: new command op to 9960 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-17T01:46:11.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.684+0000 7f5c02c5d740 1 -- 172.21.15.42:0/3663116352 --> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x55a30781e1a0 con 0x55a3078ea360 2024-09-17T01:46:11.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.685+0000 7f5bf9200640 1 --2- 172.21.15.42:0/3663116352 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x55a3078ea360 0x55a307842a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.685+0000 7f5bda000640 10 client.10197 ms_handle_connect on v2:172.21.15.42:6832/908320168 2024-09-17T01:46:11.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.685+0000 7f5bf9200640 1 --2- 172.21.15.42:0/3663116352 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x55a3078ea360 0x55a307842a40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9960 client_cookie=9c939da74c5ab512 server_cookie=71b8d38273aaa81e in_seq=0 out_seq=0 2024-09-17T01:46:11.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.685+0000 7f5bda000640 1 -- 172.21.15.42:0/3663116352 <== mds.9960 v2:172.21.15.42:6832/908320168 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55a30781e1a0 con 0x55a3078ea360 2024-09-17T01:46:11.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.685+0000 7f5bda000640 10 client.10197 handle_command_reply: tid=0 2024-09-17T01:46:11.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.685+0000 7f5c02c5d740 1 client.10197 shutdown 2024-09-17T01:46:11.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.686+0000 7f5c02c5d740 1 -- 172.21.15.42:0/3663116352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a30747a0c0 msgr2=0x55a30784c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.686+0000 7f5c02c5d740 1 --2- 172.21.15.42:0/3663116352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a30747a0c0 0x55a30784c020 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0102f0 tx=0x7f5bec00e1c0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.686+0000 7f5c02c5d740 1 -- 172.21.15.42:0/3663116352 shutdown_connections 2024-09-17T01:46:11.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.686+0000 7f5c02c5d740 1 --2- 172.21.15.42:0/3663116352 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x55a3078ea360 0x55a307842a40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.686+0000 7f5c02c5d740 1 --2- 172.21.15.42:0/3663116352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a3074593e0 0x55a3078e0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.686+0000 7f5c02c5d740 1 --2- 172.21.15.42:0/3663116352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a30747a0c0 0x55a30784c020 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.686+0000 7f5c02c5d740 1 --2- 172.21.15.42:0/3663116352 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a307451200 0x55a307866d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.686+0000 7f5bda000640 0 client.10197 ms_handle_reset on v2:172.21.15.42:6832/908320168 2024-09-17T01:46:11.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.686+0000 7f5c02c5d740 1 -- 172.21.15.42:0/3663116352 >> 172.21.15.42:0/3663116352 conn(0x55a30746e210 msgr2=0x55a30781cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:11.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.686+0000 7f5c02c5d740 1 -- 172.21.15.42:0/3663116352 shutdown_connections 2024-09-17T01:46:11.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.686+0000 7f5c02c5d740 1 -- 172.21.15.42:0/3663116352 wait complete. 2024-09-17T01:46:11.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.686+0000 7f5c02c5d740 20 client.10197 trim_cache size 0 max 16384 2024-09-17T01:46:11.688 INFO:teuthology.orchestra.run.smithi042.stderr:Error EINVAL: MDS is not active 2024-09-17T01:46:11.699 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T01:46:11.699 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub resume 2024-09-17T01:46:11.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.931+0000 7f6cfee00640 1 -- 172.21.15.42:0/3507875050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cf815cb40 msgr2=0x7f6cf80cece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.931+0000 7f6cfee00640 1 --2- 172.21.15.42:0/3507875050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cf815cb40 0x7f6cf80cece0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009830 tx=0x7f6cec02a510 comp rx=0 tx=0).stop 2024-09-17T01:46:11.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.931+0000 7f6cfee00640 1 -- 172.21.15.42:0/3507875050 shutdown_connections 2024-09-17T01:46:11.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.931+0000 7f6cfee00640 1 --2- 172.21.15.42:0/3507875050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cf815cb40 0x7f6cf80cece0 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.931+0000 7f6cfee00640 1 -- 172.21.15.42:0/3507875050 >> 172.21.15.42:0/3507875050 conn(0x7f6cf80b40b0 msgr2=0x7f6cf80b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:11.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.931+0000 7f6cfee00640 1 -- 172.21.15.42:0/3507875050 shutdown_connections 2024-09-17T01:46:11.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.931+0000 7f6cfee00640 1 -- 172.21.15.42:0/3507875050 wait complete. 2024-09-17T01:46:11.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.933+0000 7f6cfee00640 1 Processor -- start 2024-09-17T01:46:11.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.933+0000 7f6cfee00640 1 -- start start 2024-09-17T01:46:11.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.935+0000 7f6cfee00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cf80cf220 0x7f6cf814ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.935+0000 7f6cfee00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6cf80d1500 0x7f6cf81f8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.935+0000 7f6cfee00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cf815cb40 0x7f6cf81f9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.935+0000 7f6cfee00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf80ce0e0 con 0x7f6cf815cb40 2024-09-17T01:46:11.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.935+0000 7f6cfee00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf80cdf60 con 0x7f6cf80cf220 2024-09-17T01:46:11.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.935+0000 7f6cfee00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6cf80ce260 con 0x7f6cf80d1500 2024-09-17T01:46:11.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.935+0000 7f6cfe400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cf815cb40 0x7f6cf81f9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.935+0000 7f6cfe400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cf815cb40 0x7f6cf81f9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50120/0 (socket says 172.21.15.42:50120) 2024-09-17T01:46:11.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.935+0000 7f6cfe400640 1 -- 172.21.15.42:0/136386146 learned_addr learned my addr 172.21.15.42:0/136386146 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:11.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.935+0000 7f6cfd000640 1 --2- 172.21.15.42:0/136386146 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6cf80d1500 0x7f6cf81f8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.935+0000 7f6cfda00640 1 --2- 172.21.15.42:0/136386146 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cf80cf220 0x7f6cf814ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.936+0000 7f6cfe400640 1 -- 172.21.15.42:0/136386146 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6cf80d1500 msgr2=0x7f6cf81f8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.936+0000 7f6cfe400640 1 --2- 172.21.15.42:0/136386146 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6cf80d1500 0x7f6cf81f8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.936+0000 7f6cfe400640 1 -- 172.21.15.42:0/136386146 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cf80cf220 msgr2=0x7f6cf814ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.936+0000 7f6cfe400640 1 --2- 172.21.15.42:0/136386146 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cf80cf220 0x7f6cf814ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.936+0000 7f6cfe400640 1 -- 172.21.15.42:0/136386146 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf815f2a0 con 0x7f6cf815cb40 2024-09-17T01:46:11.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.936+0000 7f6cfe400640 1 --2- 172.21.15.42:0/136386146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cf815cb40 0x7f6cf81f9520 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000be60 tx=0x7f6cf000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:11.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.936+0000 7f6cf5600640 1 -- 172.21.15.42:0/136386146 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0019070 con 0x7f6cf815cb40 2024-09-17T01:46:11.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.936+0000 7f6cf5600640 1 -- 172.21.15.42:0/136386146 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cf0014440 con 0x7f6cf815cb40 2024-09-17T01:46:11.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.936+0000 7f6cf5600640 1 -- 172.21.15.42:0/136386146 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf00148d0 con 0x7f6cf815cb40 2024-09-17T01:46:11.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.936+0000 7f6cfee00640 1 -- 172.21.15.42:0/136386146 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf815f580 con 0x7f6cf815cb40 2024-09-17T01:46:11.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.936+0000 7f6cfee00640 1 -- 172.21.15.42:0/136386146 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf815fb40 con 0x7f6cf815cb40 2024-09-17T01:46:11.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.939+0000 7f6cf5600640 1 -- 172.21.15.42:0/136386146 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6cf001c070 con 0x7f6cf815cb40 2024-09-17T01:46:11.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.940+0000 7f6cf5600640 1 --2- 172.21.15.42:0/136386146 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6cd8078b90 0x7f6cd807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.940+0000 7f6cf5600640 1 -- 172.21.15.42:0/136386146 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7f6cf009adb0 con 0x7f6cf815cb40 2024-09-17T01:46:11.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.940+0000 7f6d075fa740 1 Processor -- start 2024-09-17T01:46:11.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.940+0000 7f6cfda00640 1 --2- 172.21.15.42:0/136386146 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6cd8078b90 0x7f6cd807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.940+0000 7f6d075fa740 1 -- start start 2024-09-17T01:46:11.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.941+0000 7f6cfda00640 1 --2- 172.21.15.42:0/136386146 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6cd8078b90 0x7f6cd807b0a0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f6cec034000 tx=0x7f6cec004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:11.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.942+0000 7f6d075fa740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d677e8a390 0x55d678279860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.942+0000 7f6d075fa740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e614d0 0x55d67825c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.942+0000 7f6d075fa740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d677e696b0 0x55d67825ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.942+0000 7f6d075fa740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d678145c10 con 0x55d677e614d0 2024-09-17T01:46:11.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.942+0000 7f6d075fa740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d6781a49f0 con 0x55d677e696b0 2024-09-17T01:46:11.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.942+0000 7f6d075fa740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55d678193e20 con 0x55d677e8a390 2024-09-17T01:46:11.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.942+0000 7f6cfd000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e614d0 0x55d67825c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.942+0000 7f6cfd000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e614d0 0x55d67825c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50136/0 (socket says 172.21.15.42:50136) 2024-09-17T01:46:11.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.942+0000 7f6cfd000640 1 -- 172.21.15.42:0/3027272140 learned_addr learned my addr 172.21.15.42:0/3027272140 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:11.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.942+0000 7f6cfda00640 1 --2- 172.21.15.42:0/3027272140 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d677e8a390 0x55d678279860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.942+0000 7f6cfe400640 1 --2- 172.21.15.42:0/3027272140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d677e696b0 0x55d67825ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.942+0000 7f6cfd000640 1 -- 172.21.15.42:0/3027272140 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d677e8a390 msgr2=0x55d678279860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.942+0000 7f6cfd000640 1 --2- 172.21.15.42:0/3027272140 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d677e8a390 0x55d678279860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.942+0000 7f6cfd000640 1 -- 172.21.15.42:0/3027272140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d677e696b0 msgr2=0x55d67825ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.942+0000 7f6cfd000640 1 --2- 172.21.15.42:0/3027272140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d677e696b0 0x55d67825ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.942+0000 7f6cfd000640 1 -- 172.21.15.42:0/3027272140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d677f6c7d0 con 0x55d677e614d0 2024-09-17T01:46:11.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.942+0000 7f6cfe400640 1 --2- 172.21.15.42:0/3027272140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d677e696b0 0x55d67825ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:11.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.943+0000 7f6cfd000640 1 --2- 172.21.15.42:0/3027272140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e614d0 0x55d67825c530 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40015a0 tx=0x7f6ce4001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae89aa48e5fa0c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:11.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.943+0000 7f6cea000640 1 -- 172.21.15.42:0/3027272140 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4019070 con 0x55d677e614d0 2024-09-17T01:46:11.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.943+0000 7f6cea000640 1 -- 172.21.15.42:0/3027272140 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ce40050d0 con 0x55d677e614d0 2024-09-17T01:46:11.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.943+0000 7f6cea000640 1 -- 172.21.15.42:0/3027272140 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce400e740 con 0x55d677e614d0 2024-09-17T01:46:11.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.944+0000 7f6d075fa740 1 -- 172.21.15.42:0/3027272140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e614d0 msgr2=0x55d67825c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.944+0000 7f6d075fa740 1 --2- 172.21.15.42:0/3027272140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e614d0 0x55d67825c530 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40015a0 tx=0x7f6ce4001a60 comp rx=0 tx=0).stop 2024-09-17T01:46:11.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.944+0000 7f6d075fa740 1 -- 172.21.15.42:0/3027272140 shutdown_connections 2024-09-17T01:46:11.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.944+0000 7f6d075fa740 1 --2- 172.21.15.42:0/3027272140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d677e696b0 0x55d67825ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.944+0000 7f6d075fa740 1 --2- 172.21.15.42:0/3027272140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e614d0 0x55d67825c530 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.944+0000 7f6d075fa740 1 --2- 172.21.15.42:0/3027272140 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d677e8a390 0x55d678279860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.944+0000 7f6d075fa740 1 -- 172.21.15.42:0/3027272140 >> 172.21.15.42:0/3027272140 conn(0x55d677e7e4e0 msgr2=0x55d678232750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:11.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.944+0000 7f6d075fa740 1 -- 172.21.15.42:0/3027272140 shutdown_connections 2024-09-17T01:46:11.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.944+0000 7f6d075fa740 1 -- 172.21.15.42:0/3027272140 wait complete. 2024-09-17T01:46:11.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.945+0000 7f6d075fa740 1 -- start start 2024-09-17T01:46:11.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.945+0000 7f6d075fa740 1 Processor -- start 2024-09-17T01:46:11.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.947+0000 7f6d075fa740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e614d0 0x55d678273670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.947+0000 7f6d075fa740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d677e696b0 0x55d6782893e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.947+0000 7f6d075fa740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d677e8a390 0x55d678289d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.947+0000 7f6d075fa740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d678139790 con 0x55d677e614d0 2024-09-17T01:46:11.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.947+0000 7f6d075fa740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d678197c30 con 0x55d677e696b0 2024-09-17T01:46:11.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.947+0000 7f6d075fa740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55d677f04740 con 0x55d677e8a390 2024-09-17T01:46:11.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.947+0000 7f6d075fa740 10 client.0 _ll_register_callbacks cb 0x55d678149260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:46:11.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.947+0000 7f6cfda00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e614d0 0x55d678273670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.947+0000 7f6cfda00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e614d0 0x55d678273670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50150/0 (socket says 172.21.15.42:50150) 2024-09-17T01:46:11.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.947+0000 7f6cfda00640 1 -- 172.21.15.42:0/966221117 learned_addr learned my addr 172.21.15.42:0/966221117 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:11.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.947+0000 7f6cfd000640 1 --2- 172.21.15.42:0/966221117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d677e696b0 0x55d6782893e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.947+0000 7f6cfe400640 1 --2- 172.21.15.42:0/966221117 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d677e8a390 0x55d678289d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.947+0000 7f6cfda00640 1 -- 172.21.15.42:0/966221117 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d677e8a390 msgr2=0x55d678289d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.947+0000 7f6cfda00640 1 --2- 172.21.15.42:0/966221117 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d677e8a390 0x55d678289d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.947+0000 7f6cfda00640 1 -- 172.21.15.42:0/966221117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d677e696b0 msgr2=0x55d6782893e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.947+0000 7f6cfda00640 1 --2- 172.21.15.42:0/966221117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d677e696b0 0x55d6782893e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.947+0000 7f6cfda00640 1 -- 172.21.15.42:0/966221117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d677ed36a0 con 0x55d677e614d0 2024-09-17T01:46:11.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.948+0000 7f6cfda00640 1 --2- 172.21.15.42:0/966221117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e614d0 0x55d678273670 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f6cec004650 tx=0x7f6cec005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63ed37a74642cc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:11.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.948+0000 7f6cdea00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:46:11.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.948+0000 7f6cdea00640 1 -- 172.21.15.42:0/966221117 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec049220 con 0x55d677e614d0 2024-09-17T01:46:11.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.948+0000 7f6cdea00640 1 -- 172.21.15.42:0/966221117 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7f6cec052b00 con 0x55d677e614d0 2024-09-17T01:46:11.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.948+0000 7f6d075fa740 1 -- 172.21.15.42:0/966221117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ce40050d0 con 0x55d677e614d0 2024-09-17T01:46:11.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.948+0000 7f6cdea00640 1 -- 172.21.15.42:0/966221117 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7f6cec052d00 con 0x55d677e614d0 2024-09-17T01:46:11.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.948+0000 7f6d075fa740 10 client.10212 fetch_fsmap learned FSMap version 141 2024-09-17T01:46:11.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.948+0000 7f6d075fa740 1 -- 172.21.15.42:0/966221117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x55d677fccf60 con 0x55d677e614d0 2024-09-17T01:46:11.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.949+0000 7f6cdea00640 1 -- 172.21.15.42:0/966221117 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ce40050d0 con 0x55d677e614d0 2024-09-17T01:46:11.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.949+0000 7f6cdea00640 1 -- 172.21.15.42:0/966221117 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 141) ==== 3490+0+0 (secure 0 0 0) 0x7f6cec050070 con 0x55d677e614d0 2024-09-17T01:46:11.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.949+0000 7f6d075fa740 10 client.10212 fetch_fsmap finished waiting for FSMap version 141 2024-09-17T01:46:11.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.949+0000 7f6d075fa740 10 client.10212 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:46:11.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.949+0000 7f6d075fa740 20 client.10212 populate_metadata read hostname 'smithi042' 2024-09-17T01:46:11.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.949+0000 7f6d075fa740 1 --2- 172.21.15.42:0/966221117 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x55d677e48f60 0x55d67824a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.949+0000 7f6d075fa740 4 client.10212 mds_command: new command op to 9960 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:46:11.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.949+0000 7f6d075fa740 1 -- 172.21.15.42:0/966221117 --> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6781a6940 con 0x55d677e48f60 2024-09-17T01:46:11.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.949+0000 7f6cfd000640 1 --2- 172.21.15.42:0/966221117 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x55d677e48f60 0x55d67824a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.950+0000 7f6cfd000640 1 --2- 172.21.15.42:0/966221117 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x55d677e48f60 0x55d67824a350 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9960 client_cookie=a030c9b2c553569a server_cookie=bdc9762b73b73af0 in_seq=0 out_seq=0 2024-09-17T01:46:11.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.950+0000 7f6cdea00640 10 client.10212 ms_handle_connect on v2:172.21.15.42:6832/908320168 2024-09-17T01:46:11.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.950+0000 7f6cdea00640 1 -- 172.21.15.42:0/966221117 <== mds.9960 v2:172.21.15.42:6832/908320168 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d6781a6940 con 0x55d677e48f60 2024-09-17T01:46:11.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.950+0000 7f6cdea00640 10 client.10212 handle_command_reply: tid=0 2024-09-17T01:46:11.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.950+0000 7f6d075fa740 1 client.10212 shutdown 2024-09-17T01:46:11.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.951+0000 7f6d075fa740 1 -- 172.21.15.42:0/966221117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e614d0 msgr2=0x55d678273670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.951+0000 7f6d075fa740 1 --2- 172.21.15.42:0/966221117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e614d0 0x55d678273670 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f6cec004650 tx=0x7f6cec005f90 comp rx=0 tx=0).stop 2024-09-17T01:46:11.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.951+0000 7f6d075fa740 1 -- 172.21.15.42:0/966221117 shutdown_connections 2024-09-17T01:46:11.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.951+0000 7f6d075fa740 1 --2- 172.21.15.42:0/966221117 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x55d677e48f60 0x55d67824a350 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.951+0000 7f6d075fa740 1 --2- 172.21.15.42:0/966221117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d677e696b0 0x55d6782893e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.951+0000 7f6d075fa740 1 --2- 172.21.15.42:0/966221117 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d677e8a390 0x55d678289d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.951+0000 7f6d075fa740 1 --2- 172.21.15.42:0/966221117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e614d0 0x55d678273670 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.951+0000 7f6cdea00640 0 client.10212 ms_handle_reset on v2:172.21.15.42:6832/908320168 2024-09-17T01:46:11.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.951+0000 7f6d075fa740 1 -- 172.21.15.42:0/966221117 >> 172.21.15.42:0/966221117 conn(0x55d677e7e4e0 msgr2=0x55d67822b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:11.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.951+0000 7f6d075fa740 1 -- 172.21.15.42:0/966221117 shutdown_connections 2024-09-17T01:46:11.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.951+0000 7f6d075fa740 1 -- 172.21.15.42:0/966221117 wait complete. 2024-09-17T01:46:11.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.951+0000 7f6d075fa740 20 client.10212 trim_cache size 0 max 16384 2024-09-17T01:46:11.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.970+0000 7f6d075fa740 1 Processor -- start 2024-09-17T01:46:11.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.970+0000 7f6d075fa740 1 -- start start 2024-09-17T01:46:11.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.971+0000 7f6d075fa740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d677e614d0 0x55d678233620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.971+0000 7f6d075fa740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e696b0 0x55d678233b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.971+0000 7f6d075fa740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d677e8a390 0x55d67824b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.971+0000 7f6d075fa740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf8202230 con 0x55d677e696b0 2024-09-17T01:46:11.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.971+0000 7f6d075fa740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf80afd70 con 0x55d677e614d0 2024-09-17T01:46:11.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.971+0000 7f6d075fa740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6cf80b03c0 con 0x55d677e8a390 2024-09-17T01:46:11.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.972+0000 7f6cfd000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e696b0 0x55d678233b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.972+0000 7f6cfd000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e696b0 0x55d678233b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50154/0 (socket says 172.21.15.42:50154) 2024-09-17T01:46:11.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.972+0000 7f6cfd000640 1 -- 172.21.15.42:0/1956828453 learned_addr learned my addr 172.21.15.42:0/1956828453 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:11.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.972+0000 7f6cfe400640 1 --2- 172.21.15.42:0/1956828453 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d677e8a390 0x55d67824b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.972+0000 7f6cfda00640 1 --2- 172.21.15.42:0/1956828453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d677e614d0 0x55d678233620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.972+0000 7f6cfd000640 1 -- 172.21.15.42:0/1956828453 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d677e8a390 msgr2=0x55d67824b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.972+0000 7f6cfd000640 1 --2- 172.21.15.42:0/1956828453 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d677e8a390 0x55d67824b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.972+0000 7f6cfd000640 1 -- 172.21.15.42:0/1956828453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d677e614d0 msgr2=0x55d678233620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.972+0000 7f6cfd000640 1 --2- 172.21.15.42:0/1956828453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d677e614d0 0x55d678233620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.972+0000 7f6cfd000640 1 -- 172.21.15.42:0/1956828453 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d677f6aad0 con 0x55d677e696b0 2024-09-17T01:46:11.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.972+0000 7f6cfd000640 1 --2- 172.21.15.42:0/1956828453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e696b0 0x55d678233b60 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400e530 tx=0x7f6ce4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f8254ed4d3949e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:11.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.973+0000 7f6ce9600640 1 -- 172.21.15.42:0/1956828453 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4019040 con 0x55d677e696b0 2024-09-17T01:46:11.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.973+0000 7f6ce9600640 1 -- 172.21.15.42:0/1956828453 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ce400e940 con 0x55d677e696b0 2024-09-17T01:46:11.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.973+0000 7f6ce9600640 1 -- 172.21.15.42:0/1956828453 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce400ed50 con 0x55d677e696b0 2024-09-17T01:46:11.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.974+0000 7f6d075fa740 1 -- 172.21.15.42:0/1956828453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e696b0 msgr2=0x55d678233b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.974+0000 7f6d075fa740 1 --2- 172.21.15.42:0/1956828453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e696b0 0x55d678233b60 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400e530 tx=0x7f6ce4000ed0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.974+0000 7f6d075fa740 1 -- 172.21.15.42:0/1956828453 shutdown_connections 2024-09-17T01:46:11.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.974+0000 7f6d075fa740 1 --2- 172.21.15.42:0/1956828453 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d677e8a390 0x55d67824b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.974+0000 7f6d075fa740 1 --2- 172.21.15.42:0/1956828453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e696b0 0x55d678233b60 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.974+0000 7f6d075fa740 1 --2- 172.21.15.42:0/1956828453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d677e614d0 0x55d678233620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.974+0000 7f6d075fa740 1 -- 172.21.15.42:0/1956828453 >> 172.21.15.42:0/1956828453 conn(0x55d677e7e4e0 msgr2=0x55d678274430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:11.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.974+0000 7f6d075fa740 1 -- 172.21.15.42:0/1956828453 shutdown_connections 2024-09-17T01:46:11.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.974+0000 7f6d075fa740 1 -- 172.21.15.42:0/1956828453 wait complete. 2024-09-17T01:46:11.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.975+0000 7f6d075fa740 1 -- start start 2024-09-17T01:46:11.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.975+0000 7f6d075fa740 1 Processor -- start 2024-09-17T01:46:11.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.976+0000 7f6d075fa740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d677e614d0 0x55d678287250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.976+0000 7f6d075fa740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d677e696b0 0x55d67825c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.976+0000 7f6d075fa740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e8a390 0x55d6782fa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.977+0000 7f6d075fa740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d678273bb0 con 0x55d677e8a390 2024-09-17T01:46:11.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.977+0000 7f6d075fa740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d678287a40 con 0x55d677e696b0 2024-09-17T01:46:11.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.977+0000 7f6d075fa740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55d67826ef60 con 0x55d677e614d0 2024-09-17T01:46:11.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.977+0000 7f6d075fa740 10 client.0 _ll_register_callbacks cb 0x7f6cec0045a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:46:11.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.977+0000 7f6cfe400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e8a390 0x55d6782fa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.977+0000 7f6cfe400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e8a390 0x55d6782fa2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50168/0 (socket says 172.21.15.42:50168) 2024-09-17T01:46:11.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.977+0000 7f6cfe400640 1 -- 172.21.15.42:0/329467399 learned_addr learned my addr 172.21.15.42:0/329467399 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:11.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.977+0000 7f6cfd000640 1 --2- 172.21.15.42:0/329467399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d677e696b0 0x55d67825c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.977+0000 7f6cfda00640 1 --2- 172.21.15.42:0/329467399 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d677e614d0 0x55d678287250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.977+0000 7f6cfe400640 1 -- 172.21.15.42:0/329467399 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d677e614d0 msgr2=0x55d678287250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.977+0000 7f6cfe400640 1 --2- 172.21.15.42:0/329467399 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d677e614d0 0x55d678287250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.977+0000 7f6cfe400640 1 -- 172.21.15.42:0/329467399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d677e696b0 msgr2=0x55d67825c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:11.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.977+0000 7f6cfe400640 1 --2- 172.21.15.42:0/329467399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d677e696b0 0x55d67825c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.977+0000 7f6cfe400640 1 -- 172.21.15.42:0/329467399 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d678278090 con 0x55d677e8a390 2024-09-17T01:46:11.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.977+0000 7f6cfe400640 1 --2- 172.21.15.42:0/329467399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e8a390 0x55d6782fa2d0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0013000 tx=0x7f6cf0063020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e23bb7a3f44a3f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:11.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.977+0000 7f6cdea00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:46:11.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.978+0000 7f6cdea00640 1 -- 172.21.15.42:0/329467399 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf007c020 con 0x55d677e8a390 2024-09-17T01:46:11.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.978+0000 7f6cdea00640 1 -- 172.21.15.42:0/329467399 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7f6cf0078da0 con 0x55d677e8a390 2024-09-17T01:46:11.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.978+0000 7f6d075fa740 1 -- 172.21.15.42:0/329467399 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ce400e940 con 0x55d677e8a390 2024-09-17T01:46:11.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.978+0000 7f6cdea00640 1 -- 172.21.15.42:0/329467399 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=141) ==== 24+0+0 (secure 0 0 0) 0x7f6cf0083050 con 0x55d677e8a390 2024-09-17T01:46:11.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.978+0000 7f6d075fa740 10 client.10218 fetch_fsmap learned FSMap version 141 2024-09-17T01:46:11.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.978+0000 7f6d075fa740 1 -- 172.21.15.42:0/329467399 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=141,monmap=2+}) -- 0x55d67825cd20 con 0x55d677e8a390 2024-09-17T01:46:11.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.978+0000 7f6cdea00640 1 -- 172.21.15.42:0/329467399 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ce400e940 con 0x55d677e8a390 2024-09-17T01:46:11.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.978+0000 7f6cdea00640 1 -- 172.21.15.42:0/329467399 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 141) ==== 3490+0+0 (secure 0 0 0) 0x7f6cf0008030 con 0x55d677e8a390 2024-09-17T01:46:11.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.978+0000 7f6d075fa740 10 client.10218 fetch_fsmap finished waiting for FSMap version 141 2024-09-17T01:46:11.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.978+0000 7f6d075fa740 10 client.10218 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:46:11.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.978+0000 7f6d075fa740 20 client.10218 populate_metadata read hostname 'smithi042' 2024-09-17T01:46:11.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.978+0000 7f6d075fa740 1 --2- 172.21.15.42:0/329467399 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x55d6782e00a0 0x55d678258850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:11.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.978+0000 7f6d075fa740 4 client.10218 mds_command: new command op to 9960 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-17T01:46:11.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.978+0000 7f6d075fa740 1 -- 172.21.15.42:0/329467399 --> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x55d67822e6b0 con 0x55d6782e00a0 2024-09-17T01:46:11.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.979+0000 7f6cfda00640 1 --2- 172.21.15.42:0/329467399 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x55d6782e00a0 0x55d678258850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:11.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.979+0000 7f6cfda00640 1 --2- 172.21.15.42:0/329467399 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x55d6782e00a0 0x55d678258850 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.9960 client_cookie=81095936955cfd28 server_cookie=d6890731224d93b6 in_seq=0 out_seq=0 2024-09-17T01:46:11.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.979+0000 7f6cdea00640 10 client.10218 ms_handle_connect on v2:172.21.15.42:6832/908320168 2024-09-17T01:46:11.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.979+0000 7f6cdea00640 1 -- 172.21.15.42:0/329467399 <== mds.9960 v2:172.21.15.42:6832/908320168 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55d67822e6b0 con 0x55d6782e00a0 2024-09-17T01:46:11.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.979+0000 7f6cdea00640 10 client.10218 handle_command_reply: tid=0 2024-09-17T01:46:11.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.979+0000 7f6d075fa740 1 client.10218 shutdown 2024-09-17T01:46:11.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.980+0000 7f6d075fa740 1 -- 172.21.15.42:0/329467399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e8a390 msgr2=0x55d6782fa2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:11.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.980+0000 7f6d075fa740 1 --2- 172.21.15.42:0/329467399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e8a390 0x55d6782fa2d0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0013000 tx=0x7f6cf0063020 comp rx=0 tx=0).stop 2024-09-17T01:46:11.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.980+0000 7f6d075fa740 1 -- 172.21.15.42:0/329467399 shutdown_connections 2024-09-17T01:46:11.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.980+0000 7f6d075fa740 1 --2- 172.21.15.42:0/329467399 >> [v2:172.21.15.42:6832/908320168,v1:172.21.15.42:6833/908320168] conn(0x55d6782e00a0 0x55d678258850 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.980+0000 7f6d075fa740 1 --2- 172.21.15.42:0/329467399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d677e696b0 0x55d67825c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.980+0000 7f6d075fa740 1 --2- 172.21.15.42:0/329467399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d677e8a390 0x55d6782fa2d0 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.980+0000 7f6d075fa740 1 --2- 172.21.15.42:0/329467399 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d677e614d0 0x55d678287250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:11.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.980+0000 7f6cdea00640 0 client.10218 ms_handle_reset on v2:172.21.15.42:6832/908320168 2024-09-17T01:46:11.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.980+0000 7f6d075fa740 1 -- 172.21.15.42:0/329467399 >> 172.21.15.42:0/329467399 conn(0x55d677e7e4e0 msgr2=0x55d678274430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:11.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.980+0000 7f6d075fa740 1 -- 172.21.15.42:0/329467399 shutdown_connections 2024-09-17T01:46:11.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.980+0000 7f6d075fa740 1 -- 172.21.15.42:0/329467399 wait complete. 2024-09-17T01:46:11.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:11.980+0000 7f6d075fa740 20 client.10218 trim_cache size 0 max 16384 2024-09-17T01:46:11.982 INFO:teuthology.orchestra.run.smithi042.stderr:Error EINVAL: MDS is not active 2024-09-17T01:46:11.992 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T01:46:11.993 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:46:11.993 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:46:12.087 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:46:12.179 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:46:12.179 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:46:12.179 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:46:12.179 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:46:12.215 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:46:12.215 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:46:12.292 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T01:46:12.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.563+0000 7f8489e00640 1 -- 172.21.15.42:0/3102327278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f848415f830 msgr2=0x7f848406e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:12.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.563+0000 7f8489e00640 1 --2- 172.21.15.42:0/3102327278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f848415f830 0x7f848406e950 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f8484071130 tx=0x7f847c02aa30 comp rx=0 tx=0).stop 2024-09-17T01:46:12.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.563+0000 7f8489e00640 1 -- 172.21.15.42:0/3102327278 shutdown_connections 2024-09-17T01:46:12.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.563+0000 7f8489e00640 1 --2- 172.21.15.42:0/3102327278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f848415f830 0x7f848406e950 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:12.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.563+0000 7f8489e00640 1 --2- 172.21.15.42:0/3102327278 >> v2:172.21.15.43:3300/0 conn(0x7f848415b680 0x7f848415fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:12.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.563+0000 7f8489e00640 1 -- 172.21.15.42:0/3102327278 >> 172.21.15.42:0/3102327278 conn(0x7f84840b25f0 msgr2=0x7f84840d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:12.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.563+0000 7f8489e00640 1 -- 172.21.15.42:0/3102327278 shutdown_connections 2024-09-17T01:46:12.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.563+0000 7f8489e00640 1 -- 172.21.15.42:0/3102327278 wait complete. 2024-09-17T01:46:12.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.565+0000 7f8489e00640 1 Processor -- start 2024-09-17T01:46:12.563 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.565+0000 7f8489e00640 1 -- start start 2024-09-17T01:46:12.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.566+0000 7f8489e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84840cafe0 0x7f84840b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:12.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.566+0000 7f8489e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f848415b680 0x7f8484158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:12.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.567+0000 7f8489e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f84841f55a0 0x7f84841f59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:12.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.567+0000 7f8489e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f848406f4d0 con 0x7f84840cafe0 2024-09-17T01:46:12.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.567+0000 7f8489e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f848406f350 con 0x7f848415b680 2024-09-17T01:46:12.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.567+0000 7f8489e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f848406f650 con 0x7f84841f55a0 2024-09-17T01:46:12.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.567+0000 7f8488a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84840cafe0 0x7f84840b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:12.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.567+0000 7f8488a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84840cafe0 0x7f84840b3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50176/0 (socket says 172.21.15.42:50176) 2024-09-17T01:46:12.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.567+0000 7f8488a00640 1 -- 172.21.15.42:0/340146726 learned_addr learned my addr 172.21.15.42:0/340146726 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:12.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.567+0000 7f8483e00640 1 --2- 172.21.15.42:0/340146726 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f848415b680 0x7f8484158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:12.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.567+0000 7f8489400640 1 --2- 172.21.15.42:0/340146726 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f84841f55a0 0x7f84841f59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:12.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.567+0000 7f8488a00640 1 -- 172.21.15.42:0/340146726 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f84841f55a0 msgr2=0x7f84841f59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:12.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.567+0000 7f8488a00640 1 --2- 172.21.15.42:0/340146726 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f84841f55a0 0x7f84841f59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:12.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.567+0000 7f8488a00640 1 -- 172.21.15.42:0/340146726 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f848415b680 msgr2=0x7f8484158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:12.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.567+0000 7f8488a00640 1 --2- 172.21.15.42:0/340146726 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f848415b680 0x7f8484158ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:12.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.567+0000 7f8488a00640 1 -- 172.21.15.42:0/340146726 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f848415e6d0 con 0x7f84840cafe0 2024-09-17T01:46:12.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.567+0000 7f8483e00640 1 --2- 172.21.15.42:0/340146726 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f848415b680 0x7f8484158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:12.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.567+0000 7f8488a00640 1 --2- 172.21.15.42:0/340146726 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84840cafe0 0x7f84840b3cb0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7f847800d6d0 tx=0x7f847800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:12.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.568+0000 7f8480c00640 1 -- 172.21.15.42:0/340146726 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8478017070 con 0x7f84840cafe0 2024-09-17T01:46:12.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.568+0000 7f8480c00640 1 -- 172.21.15.42:0/340146726 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8478005330 con 0x7f84840cafe0 2024-09-17T01:46:12.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.568+0000 7f8480c00640 1 -- 172.21.15.42:0/340146726 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8478009820 con 0x7f84840cafe0 2024-09-17T01:46:12.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.568+0000 7f8489e00640 1 -- 172.21.15.42:0/340146726 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84841f61f0 con 0x7f84840cafe0 2024-09-17T01:46:12.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.568+0000 7f8489e00640 1 -- 172.21.15.42:0/340146726 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84840b34b0 con 0x7f84840cafe0 2024-09-17T01:46:12.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.569+0000 7f8489e00640 1 -- 172.21.15.42:0/340146726 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f848406fb40 con 0x7f84840cafe0 2024-09-17T01:46:12.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.570+0000 7f8480c00640 1 -- 172.21.15.42:0/340146726 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f84780099c0 con 0x7f84840cafe0 2024-09-17T01:46:12.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.571+0000 7f8480c00640 1 --2- 172.21.15.42:0/340146726 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8464078b90 0x7f846407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:12.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.571+0000 7f8480c00640 1 -- 172.21.15.42:0/340146726 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7f847809aec0 con 0x7f84840cafe0 2024-09-17T01:46:12.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.572+0000 7f8483e00640 1 --2- 172.21.15.42:0/340146726 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8464078b90 0x7f846407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:12.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.573+0000 7f8483e00640 1 --2- 172.21.15.42:0/340146726 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8464078b90 0x7f846407b0a0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f8470006fd0 tx=0x7f8470008040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:12.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.576+0000 7f8480c00640 1 -- 172.21.15.42:0/340146726 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8478063290 con 0x7f84840cafe0 2024-09-17T01:46:12.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.784+0000 7f8489e00640 1 -- 172.21.15.42:0/340146726 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f84841e8d70 con 0x7f84840cafe0 2024-09-17T01:46:12.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.784+0000 7f8480c00640 1 -- 172.21.15.42:0/340146726 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v176) ==== 80+0+0 (secure 0 0 0) 0x7f8478062b90 con 0x7f84840cafe0 2024-09-17T01:46:12.782 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-17T01:46:12.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.786+0000 7f8489e00640 1 -- 172.21.15.42:0/340146726 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8464078b90 msgr2=0x7f846407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:12.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.786+0000 7f8489e00640 1 --2- 172.21.15.42:0/340146726 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8464078b90 0x7f846407b0a0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f8470006fd0 tx=0x7f8470008040 comp rx=0 tx=0).stop 2024-09-17T01:46:12.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.787+0000 7f8489e00640 1 -- 172.21.15.42:0/340146726 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84840cafe0 msgr2=0x7f84840b3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:12.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.787+0000 7f8489e00640 1 --2- 172.21.15.42:0/340146726 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84840cafe0 0x7f84840b3cb0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7f847800d6d0 tx=0x7f847800db90 comp rx=0 tx=0).stop 2024-09-17T01:46:12.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.787+0000 7f8489e00640 1 -- 172.21.15.42:0/340146726 shutdown_connections 2024-09-17T01:46:12.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.787+0000 7f8489e00640 1 --2- 172.21.15.42:0/340146726 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8464078b90 0x7f846407b0a0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:12.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.787+0000 7f8489e00640 1 --2- 172.21.15.42:0/340146726 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f848415b680 0x7f8484158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:12.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.787+0000 7f8489e00640 1 --2- 172.21.15.42:0/340146726 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f84841f55a0 0x7f84841f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:12.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.787+0000 7f8489e00640 1 --2- 172.21.15.42:0/340146726 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f84840cafe0 0x7f84840b3cb0 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:12.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.787+0000 7f8489e00640 1 -- 172.21.15.42:0/340146726 >> 172.21.15.42:0/340146726 conn(0x7f84840b25f0 msgr2=0x7f84841e42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:12.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.787+0000 7f8489e00640 1 -- 172.21.15.42:0/340146726 shutdown_connections 2024-09-17T01:46:12.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:12.787+0000 7f8489e00640 1 -- 172.21.15.42:0/340146726 wait complete. 2024-09-17T01:46:12.805 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T01:46:12.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:46:12.806 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T01:46:13.764 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:46:13.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:46:13.765 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T01:46:13.801 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:46:13.802 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:46:13.802 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:46:13.839 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:46:13.839 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:46:13.839 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:46:13.839 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:46:13.877 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:46:13.878 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:46:13.878 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:46:13.878 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:46:13.916 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:46:13.917 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:46:14.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.146+0000 7ff639800640 1 -- 172.21.15.42:0/3544638704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff634142f40 msgr2=0x7ff634072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:14.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.146+0000 7ff639800640 1 --2- 172.21.15.42:0/3544638704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff634142f40 0x7ff634072950 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7ff61c005fd0 tx=0x7ff61c02a5f0 comp rx=0 tx=0).stop 2024-09-17T01:46:14.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.146+0000 7ff639800640 1 -- 172.21.15.42:0/3544638704 shutdown_connections 2024-09-17T01:46:14.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.146+0000 7ff639800640 1 --2- 172.21.15.42:0/3544638704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff634142f40 0x7ff634072950 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:14.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.146+0000 7ff639800640 1 -- 172.21.15.42:0/3544638704 >> 172.21.15.42:0/3544638704 conn(0x7ff6340b2930 msgr2=0x7ff63406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:14.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.146+0000 7ff639800640 1 -- 172.21.15.42:0/3544638704 shutdown_connections 2024-09-17T01:46:14.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.146+0000 7ff639800640 1 -- 172.21.15.42:0/3544638704 wait complete. 2024-09-17T01:46:14.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.149+0000 7ff639800640 1 Processor -- start 2024-09-17T01:46:14.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.149+0000 7ff639800640 1 -- start start 2024-09-17T01:46:14.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.150+0000 7ff639800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff634072e90 0x7ff63413e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:14.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.150+0000 7ff639800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff6340b3550 0x7ff6340ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:14.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.150+0000 7ff639800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff634142f40 0x7ff6340aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:14.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.150+0000 7ff639800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff63406d900 con 0x7ff634142f40 2024-09-17T01:46:14.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.150+0000 7ff639800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff63406d780 con 0x7ff634072e90 2024-09-17T01:46:14.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.150+0000 7ff639800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff63406da80 con 0x7ff6340b3550 2024-09-17T01:46:14.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.150+0000 7ff633400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff634142f40 0x7ff6340aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:14.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.150+0000 7ff633400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff634142f40 0x7ff6340aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50190/0 (socket says 172.21.15.42:50190) 2024-09-17T01:46:14.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.150+0000 7ff633400640 1 -- 172.21.15.42:0/1431996177 learned_addr learned my addr 172.21.15.42:0/1431996177 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:14.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.151+0000 7ff62be00640 1 --2- 172.21.15.42:0/1431996177 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff6340b3550 0x7ff6340ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:14.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.151+0000 7ff632a00640 1 --2- 172.21.15.42:0/1431996177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff634072e90 0x7ff63413e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:14.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.151+0000 7ff633400640 1 -- 172.21.15.42:0/1431996177 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff6340b3550 msgr2=0x7ff6340ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:14.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.151+0000 7ff633400640 1 --2- 172.21.15.42:0/1431996177 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff6340b3550 0x7ff6340ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:14.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.151+0000 7ff633400640 1 -- 172.21.15.42:0/1431996177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff634072e90 msgr2=0x7ff63413e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:14.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.151+0000 7ff633400640 1 --2- 172.21.15.42:0/1431996177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff634072e90 0x7ff63413e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:14.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.151+0000 7ff633400640 1 -- 172.21.15.42:0/1431996177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6341f6f60 con 0x7ff634142f40 2024-09-17T01:46:14.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.151+0000 7ff633400640 1 --2- 172.21.15.42:0/1431996177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff634142f40 0x7ff6340aede0 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7ff62c00c730 tx=0x7ff62c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:14.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.151+0000 7ff62aa00640 1 -- 172.21.15.42:0/1431996177 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62c003b70 con 0x7ff634142f40 2024-09-17T01:46:14.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.152+0000 7ff62aa00640 1 -- 172.21.15.42:0/1431996177 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff62c003d10 con 0x7ff634142f40 2024-09-17T01:46:14.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.152+0000 7ff62aa00640 1 -- 172.21.15.42:0/1431996177 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62c00aab0 con 0x7ff634142f40 2024-09-17T01:46:14.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.152+0000 7ff639800640 1 -- 172.21.15.42:0/1431996177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff63406f340 con 0x7ff634142f40 2024-09-17T01:46:14.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.152+0000 7ff639800640 1 -- 172.21.15.42:0/1431996177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6341f62b0 con 0x7ff634142f40 2024-09-17T01:46:14.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.153+0000 7ff639800640 1 -- 172.21.15.42:0/1431996177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff63406a170 con 0x7ff634142f40 2024-09-17T01:46:14.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.155+0000 7ff62aa00640 1 -- 172.21.15.42:0/1431996177 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff62c00ac50 con 0x7ff634142f40 2024-09-17T01:46:14.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.156+0000 7ff62aa00640 1 --2- 172.21.15.42:0/1431996177 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff610078b90 0x7ff61007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:14.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.156+0000 7ff62aa00640 1 -- 172.21.15.42:0/1431996177 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7ff62c09aaa0 con 0x7ff634142f40 2024-09-17T01:46:14.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.156+0000 7ff632a00640 1 --2- 172.21.15.42:0/1431996177 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff610078b90 0x7ff61007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:14.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.157+0000 7ff632a00640 1 --2- 172.21.15.42:0/1431996177 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff610078b90 0x7ff61007b0a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7ff624001720 tx=0x7ff624009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:14.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.160+0000 7ff62aa00640 1 -- 172.21.15.42:0/1431996177 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff62c062820 con 0x7ff634142f40 2024-09-17T01:46:14.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.394+0000 7ff639800640 1 -- 172.21.15.42:0/1431996177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff63415edf0 con 0x7ff634142f40 2024-09-17T01:46:14.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.395+0000 7ff62aa00640 1 -- 172.21.15.42:0/1431996177 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 141 v141) ==== 95+0+5236 (secure 0 0 0) 0x7ff62c067250 con 0x7ff634142f40 2024-09-17T01:46:14.393 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:46:14.393 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":141,"btime":"2024-09-17T01:46:09:560403+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1946373489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1946373489},{"type":"v1","addr":"172.21.15.43:6837","nonce":1946373489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134},{"gid":9280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/1948698658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1948698658},{"type":"v1","addr":"172.21.15.43:6835","nonce":1948698658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133}],"filesystems":[{"mdsmap":{"epoch":141,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:45:36.259119+0000","modified":"2024-09-17T01:46:09.560386+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9960":{"gid":9960,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/908320168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":908320168},{"type":"v1","addr":"172.21.15.42:6833","nonce":908320168}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9969":{"gid":9969,"name":"a","rank":0,"incarnation":135,"state":"up:active","state_seq":5,"addr":"172.21.15.42:6835/2353432649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":2353432649},{"type":"v1","addr":"172.21.15.42:6835","nonce":2353432649}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9969,"qdb_cluster":[9969]},"id":12}]} 2024-09-17T01:46:14.393 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 141 2024-09-17T01:46:14.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.397+0000 7ff639800640 1 -- 172.21.15.42:0/1431996177 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff610078b90 msgr2=0x7ff61007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:14.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.397+0000 7ff639800640 1 --2- 172.21.15.42:0/1431996177 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff610078b90 0x7ff61007b0a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7ff624001720 tx=0x7ff624009040 comp rx=0 tx=0).stop 2024-09-17T01:46:14.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.398+0000 7ff639800640 1 -- 172.21.15.42:0/1431996177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff634142f40 msgr2=0x7ff6340aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:14.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.398+0000 7ff639800640 1 --2- 172.21.15.42:0/1431996177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff634142f40 0x7ff6340aede0 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7ff62c00c730 tx=0x7ff62c00cbf0 comp rx=0 tx=0).stop 2024-09-17T01:46:14.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.398+0000 7ff639800640 1 -- 172.21.15.42:0/1431996177 shutdown_connections 2024-09-17T01:46:14.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.398+0000 7ff639800640 1 --2- 172.21.15.42:0/1431996177 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff610078b90 0x7ff61007b0a0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:14.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.398+0000 7ff639800640 1 --2- 172.21.15.42:0/1431996177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff634142f40 0x7ff6340aede0 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:14.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.398+0000 7ff639800640 1 --2- 172.21.15.42:0/1431996177 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff6340b3550 0x7ff6340ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:14.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.398+0000 7ff639800640 1 --2- 172.21.15.42:0/1431996177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff634072e90 0x7ff63413e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:14.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.398+0000 7ff639800640 1 -- 172.21.15.42:0/1431996177 >> 172.21.15.42:0/1431996177 conn(0x7ff6340b2930 msgr2=0x7ff63415f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:14.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.398+0000 7ff639800640 1 -- 172.21.15.42:0/1431996177 shutdown_connections 2024-09-17T01:46:14.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.398+0000 7ff639800640 1 -- 172.21.15.42:0/1431996177 wait complete. 2024-09-17T01:46:14.422 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:46:14.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.651+0000 7f8b4e000640 1 -- 172.21.15.42:0/2675499831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b480d0e10 msgr2=0x7f8b480d1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:14.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.651+0000 7f8b4e000640 1 --2- 172.21.15.42:0/2675499831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b480d0e10 0x7f8b480d1220 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f8b340098e0 tx=0x7f8b3402a5c0 comp rx=0 tx=0).stop 2024-09-17T01:46:14.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.652+0000 7f8b4e000640 1 -- 172.21.15.42:0/2675499831 shutdown_connections 2024-09-17T01:46:14.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.652+0000 7f8b4e000640 1 --2- 172.21.15.42:0/2675499831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b480d0e10 0x7f8b480d1220 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:14.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.652+0000 7f8b4e000640 1 --2- 172.21.15.42:0/2675499831 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8b480cfba0 0x7f8b480b9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:14.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.652+0000 7f8b4e000640 1 -- 172.21.15.42:0/2675499831 >> 172.21.15.42:0/2675499831 conn(0x7f8b480b6140 msgr2=0x7f8b480b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:14.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.652+0000 7f8b4e000640 1 -- 172.21.15.42:0/2675499831 shutdown_connections 2024-09-17T01:46:14.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.652+0000 7f8b4e000640 1 -- 172.21.15.42:0/2675499831 wait complete. 2024-09-17T01:46:14.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.654+0000 7f8b4e000640 1 Processor -- start 2024-09-17T01:46:14.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.654+0000 7f8b4e000640 1 -- start start 2024-09-17T01:46:14.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.656+0000 7f8b4e000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8b480cfba0 0x7f8b481f9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:14.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.656+0000 7f8b4e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b480d0e10 0x7f8b480ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:14.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.656+0000 7f8b4e000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b48162500 0x7f8b480b5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:14.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.656+0000 7f8b4e000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8b480b31e0 con 0x7f8b480d0e10 2024-09-17T01:46:14.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.656+0000 7f8b4e000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8b480b3060 con 0x7f8b48162500 2024-09-17T01:46:14.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.656+0000 7f8b4e000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8b480b3360 con 0x7f8b480cfba0 2024-09-17T01:46:14.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.656+0000 7f8b47e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b480d0e10 0x7f8b480ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:14.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.656+0000 7f8b47e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b480d0e10 0x7f8b480ccb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50204/0 (socket says 172.21.15.42:50204) 2024-09-17T01:46:14.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.656+0000 7f8b47e00640 1 -- 172.21.15.42:0/1076817274 learned_addr learned my addr 172.21.15.42:0/1076817274 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:14.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.656+0000 7f8b4cc00640 1 --2- 172.21.15.42:0/1076817274 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8b480cfba0 0x7f8b481f9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:14.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.656+0000 7f8b4d600640 1 --2- 172.21.15.42:0/1076817274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b48162500 0x7f8b480b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:14.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.656+0000 7f8b47e00640 1 -- 172.21.15.42:0/1076817274 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8b480cfba0 msgr2=0x7f8b481f9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:14.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.656+0000 7f8b47e00640 1 --2- 172.21.15.42:0/1076817274 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8b480cfba0 0x7f8b481f9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:14.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.656+0000 7f8b47e00640 1 -- 172.21.15.42:0/1076817274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b48162500 msgr2=0x7f8b480b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:14.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.656+0000 7f8b47e00640 1 --2- 172.21.15.42:0/1076817274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b48162500 0x7f8b480b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:14.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.656+0000 7f8b47e00640 1 -- 172.21.15.42:0/1076817274 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b481f5dc0 con 0x7f8b480d0e10 2024-09-17T01:46:14.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.657+0000 7f8b47e00640 1 --2- 172.21.15.42:0/1076817274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b480d0e10 0x7f8b480ccb60 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f8b3402abb0 tx=0x7f8b340052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:14.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.657+0000 7f8b44c00640 1 -- 172.21.15.42:0/1076817274 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3403f070 con 0x7f8b480d0e10 2024-09-17T01:46:14.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.657+0000 7f8b44c00640 1 -- 172.21.15.42:0/1076817274 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b34004340 con 0x7f8b480d0e10 2024-09-17T01:46:14.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.657+0000 7f8b44c00640 1 -- 172.21.15.42:0/1076817274 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b34005cf0 con 0x7f8b480d0e10 2024-09-17T01:46:14.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.657+0000 7f8b4e000640 1 -- 172.21.15.42:0/1076817274 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b481f60a0 con 0x7f8b480d0e10 2024-09-17T01:46:14.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.657+0000 7f8b4e000640 1 -- 172.21.15.42:0/1076817274 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b481f8e00 con 0x7f8b480d0e10 2024-09-17T01:46:14.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.658+0000 7f8b4e000640 1 -- 172.21.15.42:0/1076817274 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b481f5b30 con 0x7f8b480d0e10 2024-09-17T01:46:14.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.659+0000 7f8b44c00640 1 -- 172.21.15.42:0/1076817274 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b34042070 con 0x7f8b480d0e10 2024-09-17T01:46:14.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.660+0000 7f8b44c00640 1 --2- 172.21.15.42:0/1076817274 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b28078b90 0x7f8b2807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:14.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.661+0000 7f8b44c00640 1 -- 172.21.15.42:0/1076817274 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7f8b340bbc00 con 0x7f8b480d0e10 2024-09-17T01:46:14.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.661+0000 7f8b4cc00640 1 --2- 172.21.15.42:0/1076817274 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b28078b90 0x7f8b2807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:14.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.662+0000 7f8b4cc00640 1 --2- 172.21.15.42:0/1076817274 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b28078b90 0x7f8b2807b0a0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c004630 tx=0x7f8b3c00b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:14.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.665+0000 7f8b44c00640 1 -- 172.21.15.42:0/1076817274 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8b34031770 con 0x7f8b480d0e10 2024-09-17T01:46:14.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.900+0000 7f8b4e000640 1 -- 172.21.15.42:0/1076817274 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b480b9f90 con 0x7f8b480d0e10 2024-09-17T01:46:14.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.901+0000 7f8b44c00640 1 -- 172.21.15.42:0/1076817274 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 141 v141) ==== 95+0+5236 (secure 0 0 0) 0x7f8b34083980 con 0x7f8b480d0e10 2024-09-17T01:46:14.899 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:46:14.899 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":141,"btime":"2024-09-17T01:46:09:560403+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1946373489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1946373489},{"type":"v1","addr":"172.21.15.43:6837","nonce":1946373489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134},{"gid":9280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/1948698658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1948698658},{"type":"v1","addr":"172.21.15.43:6835","nonce":1948698658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133}],"filesystems":[{"mdsmap":{"epoch":141,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:45:36.259119+0000","modified":"2024-09-17T01:46:09.560386+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9960":{"gid":9960,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/908320168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":908320168},{"type":"v1","addr":"172.21.15.42:6833","nonce":908320168}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9969":{"gid":9969,"name":"a","rank":0,"incarnation":135,"state":"up:active","state_seq":5,"addr":"172.21.15.42:6835/2353432649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":2353432649},{"type":"v1","addr":"172.21.15.42:6835","nonce":2353432649}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9969,"qdb_cluster":[9969]},"id":12}]} 2024-09-17T01:46:14.899 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 141 2024-09-17T01:46:14.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.903+0000 7f8b4e000640 1 -- 172.21.15.42:0/1076817274 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b28078b90 msgr2=0x7f8b2807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:14.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.903+0000 7f8b4e000640 1 --2- 172.21.15.42:0/1076817274 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b28078b90 0x7f8b2807b0a0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c004630 tx=0x7f8b3c00b2e0 comp rx=0 tx=0).stop 2024-09-17T01:46:14.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.903+0000 7f8b4e000640 1 -- 172.21.15.42:0/1076817274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b480d0e10 msgr2=0x7f8b480ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:14.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.903+0000 7f8b4e000640 1 --2- 172.21.15.42:0/1076817274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b480d0e10 0x7f8b480ccb60 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f8b3402abb0 tx=0x7f8b340052f0 comp rx=0 tx=0).stop 2024-09-17T01:46:14.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.903+0000 7f8b4e000640 1 -- 172.21.15.42:0/1076817274 shutdown_connections 2024-09-17T01:46:14.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.903+0000 7f8b4e000640 1 --2- 172.21.15.42:0/1076817274 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b28078b90 0x7f8b2807b0a0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:14.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.903+0000 7f8b4e000640 1 --2- 172.21.15.42:0/1076817274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b48162500 0x7f8b480b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:14.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.903+0000 7f8b4e000640 1 --2- 172.21.15.42:0/1076817274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b480d0e10 0x7f8b480ccb60 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:14.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.903+0000 7f8b4e000640 1 --2- 172.21.15.42:0/1076817274 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8b480cfba0 0x7f8b481f9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:14.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.903+0000 7f8b4e000640 1 -- 172.21.15.42:0/1076817274 >> 172.21.15.42:0/1076817274 conn(0x7f8b480b6140 msgr2=0x7f8b4815bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:14.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.903+0000 7f8b4e000640 1 -- 172.21.15.42:0/1076817274 shutdown_connections 2024-09-17T01:46:14.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:14.903+0000 7f8b4e000640 1 -- 172.21.15.42:0/1076817274 wait complete. 2024-09-17T01:46:14.927 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:46:15.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.157+0000 7fed4ae00640 1 -- 172.21.15.42:0/1207022325 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed2c004210 msgr2=0x7fed2c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:15.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.157+0000 7fed4ae00640 1 --2- 172.21.15.42:0/1207022325 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed2c004210 0x7fed2c004800 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fed30001830 tx=0x7fed2c005830 comp rx=0 tx=0).stop 2024-09-17T01:46:15.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.157+0000 7fed4a400640 1 -- 172.21.15.42:0/1207022325 reap_dead start 2024-09-17T01:46:15.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.158+0000 7fed4ae00640 1 -- 172.21.15.42:0/1207022325 shutdown_connections 2024-09-17T01:46:15.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.158+0000 7fed4ae00640 1 -- 172.21.15.42:0/1207022325 >> 172.21.15.42:0/1207022325 conn(0x7fed440b25f0 msgr2=0x7fed440d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:15.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.158+0000 7fed4ae00640 1 -- 172.21.15.42:0/1207022325 shutdown_connections 2024-09-17T01:46:15.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.158+0000 7fed4ae00640 1 -- 172.21.15.42:0/1207022325 wait complete. 2024-09-17T01:46:15.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.160+0000 7fed4ae00640 1 Processor -- start 2024-09-17T01:46:15.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.160+0000 7fed4ae00640 1 -- start start 2024-09-17T01:46:15.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.161+0000 7fed4ae00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed2c004210 0x7fed440ae560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:15.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.161+0000 7fed4ae00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed440ad080 0x7fed441f3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:15.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.162+0000 7fed4ae00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed4415fc20 0x7fed441510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:15.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.162+0000 7fed4ae00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fed4415d6b0 con 0x7fed4415fc20 2024-09-17T01:46:15.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.162+0000 7fed4ae00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fed440b4310 con 0x7fed440ad080 2024-09-17T01:46:15.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.162+0000 7fed4ae00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fed4415d830 con 0x7fed2c004210 2024-09-17T01:46:15.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.162+0000 7fed4a400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed4415fc20 0x7fed441510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:15.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.162+0000 7fed4a400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed4415fc20 0x7fed441510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50222/0 (socket says 172.21.15.42:50222) 2024-09-17T01:46:15.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.162+0000 7fed4a400640 1 -- 172.21.15.42:0/2624589862 learned_addr learned my addr 172.21.15.42:0/2624589862 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:15.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.162+0000 7fed49a00640 1 --2- 172.21.15.42:0/2624589862 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed2c004210 0x7fed440ae560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:15.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.162+0000 7fed49000640 1 --2- 172.21.15.42:0/2624589862 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed440ad080 0x7fed441f3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:15.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.162+0000 7fed4a400640 1 -- 172.21.15.42:0/2624589862 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed2c004210 msgr2=0x7fed440ae560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:15.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.162+0000 7fed4a400640 1 --2- 172.21.15.42:0/2624589862 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed2c004210 0x7fed440ae560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:15.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.162+0000 7fed4a400640 1 -- 172.21.15.42:0/2624589862 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed440ad080 msgr2=0x7fed441f3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:15.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.162+0000 7fed4a400640 1 --2- 172.21.15.42:0/2624589862 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed440ad080 0x7fed441f3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:15.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.162+0000 7fed4a400640 1 -- 172.21.15.42:0/2624589862 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed441f4240 con 0x7fed4415fc20 2024-09-17T01:46:15.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.162+0000 7fed49a00640 1 --2- 172.21.15.42:0/2624589862 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed2c004210 0x7fed440ae560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:15.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.162+0000 7fed49000640 1 --2- 172.21.15.42:0/2624589862 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed440ad080 0x7fed441f3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:15.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.163+0000 7fed4a400640 1 --2- 172.21.15.42:0/2624589862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed4415fc20 0x7fed441510a0 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fed3c001350 tx=0x7fed3c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:15.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.163+0000 7fed41600640 1 -- 172.21.15.42:0/2624589862 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c00cc20 con 0x7fed4415fc20 2024-09-17T01:46:15.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.163+0000 7fed41600640 1 -- 172.21.15.42:0/2624589862 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed3c017070 con 0x7fed4415fc20 2024-09-17T01:46:15.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.163+0000 7fed4ae00640 1 -- 172.21.15.42:0/2624589862 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed440ad860 con 0x7fed4415fc20 2024-09-17T01:46:15.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.163+0000 7fed41600640 1 -- 172.21.15.42:0/2624589862 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c0116c0 con 0x7fed4415fc20 2024-09-17T01:46:15.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.163+0000 7fed4ae00640 1 -- 172.21.15.42:0/2624589862 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed441f3500 con 0x7fed4415fc20 2024-09-17T01:46:15.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.164+0000 7fed4ae00640 1 -- 172.21.15.42:0/2624589862 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed440ad5d0 con 0x7fed4415fc20 2024-09-17T01:46:15.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.165+0000 7fed41600640 1 -- 172.21.15.42:0/2624589862 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fed3c011860 con 0x7fed4415fc20 2024-09-17T01:46:15.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.166+0000 7fed41600640 1 --2- 172.21.15.42:0/2624589862 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fed24078bc0 0x7fed2407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:15.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.166+0000 7fed41600640 1 -- 172.21.15.42:0/2624589862 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7fed3c09b2d0 con 0x7fed4415fc20 2024-09-17T01:46:15.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.167+0000 7fed49a00640 1 --2- 172.21.15.42:0/2624589862 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fed24078bc0 0x7fed2407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:15.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.167+0000 7fed49a00640 1 --2- 172.21.15.42:0/2624589862 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fed24078bc0 0x7fed2407b0d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fed380095f0 tx=0x7fed38005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:15.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.171+0000 7fed41600640 1 -- 172.21.15.42:0/2624589862 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fed4415dbf0 con 0x7fed4415fc20 2024-09-17T01:46:15.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.366+0000 7fed4ae00640 1 -- 172.21.15.42:0/2624589862 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed44153750 con 0x7fed4415fc20 2024-09-17T01:46:15.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.367+0000 7fed41600640 1 -- 172.21.15.42:0/2624589862 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) ==== 74+0+16841 (secure 0 0 0) 0x7fed3c0636a0 con 0x7fed4415fc20 2024-09-17T01:46:15.365 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:46:15.365 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":176,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:45:51.799298+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:45:34.322650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-17T01:45:35.214870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"25.11","mappings":[{"from":7,"to":3}]},{"pgid":"25.29","mappings":[{"from":7,"to":4}]},{"pgid":"25.3c","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:46:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.369+0000 7fed4ae00640 1 -- 172.21.15.42:0/2624589862 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fed24078bc0 msgr2=0x7fed2407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.369+0000 7fed4ae00640 1 --2- 172.21.15.42:0/2624589862 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fed24078bc0 0x7fed2407b0d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fed380095f0 tx=0x7fed38005f90 comp rx=0 tx=0).stop 2024-09-17T01:46:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.369+0000 7fed4ae00640 1 -- 172.21.15.42:0/2624589862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed4415fc20 msgr2=0x7fed441510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:15.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.369+0000 7fed4ae00640 1 --2- 172.21.15.42:0/2624589862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed4415fc20 0x7fed441510a0 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fed3c001350 tx=0x7fed3c00ed30 comp rx=0 tx=0).stop 2024-09-17T01:46:15.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.369+0000 7fed4ae00640 1 -- 172.21.15.42:0/2624589862 shutdown_connections 2024-09-17T01:46:15.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.369+0000 7fed4ae00640 1 --2- 172.21.15.42:0/2624589862 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fed24078bc0 0x7fed2407b0d0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:15.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.369+0000 7fed4ae00640 1 --2- 172.21.15.42:0/2624589862 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fed440ad080 0x7fed441f3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:15.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.369+0000 7fed4ae00640 1 --2- 172.21.15.42:0/2624589862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed4415fc20 0x7fed441510a0 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:15.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.369+0000 7fed4ae00640 1 --2- 172.21.15.42:0/2624589862 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fed2c004210 0x7fed440ae560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:15.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.369+0000 7fed4ae00640 1 -- 172.21.15.42:0/2624589862 >> 172.21.15.42:0/2624589862 conn(0x7fed440b25f0 msgr2=0x7fed4414cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:15.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.370+0000 7fed4ae00640 1 -- 172.21.15.42:0/2624589862 shutdown_connections 2024-09-17T01:46:15.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.370+0000 7fed4ae00640 1 -- 172.21.15.42:0/2624589862 wait complete. 2024-09-17T01:46:15.391 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T01:46:15.391 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:46:15.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.621+0000 7fb1f7200640 1 -- 172.21.15.42:0/635954472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1f00b4be0 msgr2=0x7fb1f015d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:15.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.621+0000 7fb1f7200640 1 --2- 172.21.15.42:0/635954472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1f00b4be0 0x7fb1f015d6b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4009830 tx=0x7fb1e402a5b0 comp rx=0 tx=0).stop 2024-09-17T01:46:15.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.621+0000 7fb1f7200640 1 -- 172.21.15.42:0/635954472 shutdown_connections 2024-09-17T01:46:15.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.621+0000 7fb1f7200640 1 --2- 172.21.15.42:0/635954472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1f00b4be0 0x7fb1f015d6b0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:15.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.621+0000 7fb1f7200640 1 -- 172.21.15.42:0/635954472 >> 172.21.15.42:0/635954472 conn(0x7fb1f00b25f0 msgr2=0x7fb1f00d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:15.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.621+0000 7fb1f7200640 1 -- 172.21.15.42:0/635954472 shutdown_connections 2024-09-17T01:46:15.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.621+0000 7fb1f7200640 1 -- 172.21.15.42:0/635954472 wait complete. 2024-09-17T01:46:15.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.623+0000 7fb1f7200640 1 Processor -- start 2024-09-17T01:46:15.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.623+0000 7fb1f7200640 1 -- start start 2024-09-17T01:46:15.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.625+0000 7fb1f7200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1f00b4be0 0x7fb1f01f5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:15.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.625+0000 7fb1f7200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1f00cf7c0 0x7fb1f01f8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:15.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.625+0000 7fb1f7200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1f0152c10 0x7fb1f01f9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:15.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.625+0000 7fb1f7200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f01535e0 con 0x7fb1f00cf7c0 2024-09-17T01:46:15.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.625+0000 7fb1f7200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f00b4340 con 0x7fb1f0152c10 2024-09-17T01:46:15.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.625+0000 7fb1f7200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f0153760 con 0x7fb1f00b4be0 2024-09-17T01:46:15.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.625+0000 7fb1f5400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1f00cf7c0 0x7fb1f01f8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:15.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.625+0000 7fb1f5400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1f00cf7c0 0x7fb1f01f8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:50232/0 (socket says 172.21.15.42:50232) 2024-09-17T01:46:15.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.625+0000 7fb1f5400640 1 -- 172.21.15.42:0/2064433836 learned_addr learned my addr 172.21.15.42:0/2064433836 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:15.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.625+0000 7fb1f5e00640 1 --2- 172.21.15.42:0/2064433836 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1f00b4be0 0x7fb1f01f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:15.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.625+0000 7fb1f6800640 1 --2- 172.21.15.42:0/2064433836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1f0152c10 0x7fb1f01f9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:15.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.626+0000 7fb1f5400640 1 -- 172.21.15.42:0/2064433836 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1f00b4be0 msgr2=0x7fb1f01f5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:15.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.626+0000 7fb1f5400640 1 --2- 172.21.15.42:0/2064433836 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1f00b4be0 0x7fb1f01f5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:15.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.626+0000 7fb1f5400640 1 -- 172.21.15.42:0/2064433836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1f0152c10 msgr2=0x7fb1f01f9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:15.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.626+0000 7fb1f5400640 1 --2- 172.21.15.42:0/2064433836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1f0152c10 0x7fb1f01f9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:15.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.626+0000 7fb1f5400640 1 -- 172.21.15.42:0/2064433836 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f01e7090 con 0x7fb1f00cf7c0 2024-09-17T01:46:15.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.626+0000 7fb1f5400640 1 --2- 172.21.15.42:0/2064433836 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1f00cf7c0 0x7fb1f01f8f40 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000c730 tx=0x7fb1e000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:15.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.626+0000 7fb1ea000640 1 -- 172.21.15.42:0/2064433836 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0017070 con 0x7fb1f00cf7c0 2024-09-17T01:46:15.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.626+0000 7fb1ea000640 1 -- 172.21.15.42:0/2064433836 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1e0006890 con 0x7fb1f00cf7c0 2024-09-17T01:46:15.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.626+0000 7fb1f7200640 1 -- 172.21.15.42:0/2064433836 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f01e6b10 con 0x7fb1f00cf7c0 2024-09-17T01:46:15.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.626+0000 7fb1ea000640 1 -- 172.21.15.42:0/2064433836 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0006ce0 con 0x7fb1f00cf7c0 2024-09-17T01:46:15.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.626+0000 7fb1f7200640 1 -- 172.21.15.42:0/2064433836 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1f01e6db0 con 0x7fb1f00cf7c0 2024-09-17T01:46:15.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.627+0000 7fb1f7200640 1 -- 172.21.15.42:0/2064433836 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1f015d6b0 con 0x7fb1f00cf7c0 2024-09-17T01:46:15.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.629+0000 7fb1ea000640 1 -- 172.21.15.42:0/2064433836 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb1e001a070 con 0x7fb1f00cf7c0 2024-09-17T01:46:15.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.630+0000 7fb1ea000640 1 --2- 172.21.15.42:0/2064433836 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb1d4078b90 0x7fb1d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:15.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.630+0000 7fb1ea000640 1 -- 172.21.15.42:0/2064433836 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7fb1e009a2e0 con 0x7fb1f00cf7c0 2024-09-17T01:46:15.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.630+0000 7fb1f5e00640 1 --2- 172.21.15.42:0/2064433836 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb1d4078b90 0x7fb1d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:15.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.631+0000 7fb1f5e00640 1 --2- 172.21.15.42:0/2064433836 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb1d4078b90 0x7fb1d407b0a0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4034000 tx=0x7fb1e4004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:15.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.635+0000 7fb1ea000640 1 -- 172.21.15.42:0/2064433836 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb1f015dbf0 con 0x7fb1f00cf7c0 2024-09-17T01:46:15.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.868+0000 7fb1f7200640 1 -- 172.21.15.42:0/2064433836 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1f015fd80 con 0x7fb1f00cf7c0 2024-09-17T01:46:15.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.869+0000 7fb1ea000640 1 -- 172.21.15.42:0/2064433836 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 141 v141) ==== 95+0+5236 (secure 0 0 0) 0x7fb1e0061fe0 con 0x7fb1f00cf7c0 2024-09-17T01:46:15.867 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:46:15.867 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":141,"btime":"2024-09-17T01:46:09:560403+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1946373489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1946373489},{"type":"v1","addr":"172.21.15.43:6837","nonce":1946373489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134},{"gid":9280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/1948698658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1948698658},{"type":"v1","addr":"172.21.15.43:6835","nonce":1948698658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133}],"filesystems":[{"mdsmap":{"epoch":141,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:45:36.259119+0000","modified":"2024-09-17T01:46:09.560386+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9960":{"gid":9960,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/908320168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":908320168},{"type":"v1","addr":"172.21.15.42:6833","nonce":908320168}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9969":{"gid":9969,"name":"a","rank":0,"incarnation":135,"state":"up:active","state_seq":5,"addr":"172.21.15.42:6835/2353432649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":2353432649},{"type":"v1","addr":"172.21.15.42:6835","nonce":2353432649}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9969,"qdb_cluster":[9969]},"id":12}]} 2024-09-17T01:46:15.868 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 141 2024-09-17T01:46:15.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.872+0000 7fb1f7200640 1 -- 172.21.15.42:0/2064433836 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb1d4078b90 msgr2=0x7fb1d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:15.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.872+0000 7fb1f7200640 1 --2- 172.21.15.42:0/2064433836 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb1d4078b90 0x7fb1d407b0a0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4034000 tx=0x7fb1e4004730 comp rx=0 tx=0).stop 2024-09-17T01:46:15.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.872+0000 7fb1f7200640 1 -- 172.21.15.42:0/2064433836 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1f00cf7c0 msgr2=0x7fb1f01f8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:15.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.872+0000 7fb1f7200640 1 --2- 172.21.15.42:0/2064433836 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1f00cf7c0 0x7fb1f01f8f40 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000c730 tx=0x7fb1e000cbf0 comp rx=0 tx=0).stop 2024-09-17T01:46:15.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.872+0000 7fb1f7200640 1 -- 172.21.15.42:0/2064433836 shutdown_connections 2024-09-17T01:46:15.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.872+0000 7fb1f7200640 1 --2- 172.21.15.42:0/2064433836 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb1d4078b90 0x7fb1d407b0a0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:15.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.872+0000 7fb1f7200640 1 --2- 172.21.15.42:0/2064433836 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1f0152c10 0x7fb1f01f9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:15.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.872+0000 7fb1f7200640 1 --2- 172.21.15.42:0/2064433836 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1f00cf7c0 0x7fb1f01f8f40 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:15.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.872+0000 7fb1f7200640 1 --2- 172.21.15.42:0/2064433836 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1f00b4be0 0x7fb1f01f5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:15.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.872+0000 7fb1f7200640 1 -- 172.21.15.42:0/2064433836 >> 172.21.15.42:0/2064433836 conn(0x7fb1f00b25f0 msgr2=0x7fb1f01eae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:15.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.872+0000 7fb1f7200640 1 -- 172.21.15.42:0/2064433836 shutdown_connections 2024-09-17T01:46:15.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:15.872+0000 7fb1f7200640 1 -- 172.21.15.42:0/2064433836 wait complete. 2024-09-17T01:46:15.895 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:46:16.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.125+0000 7fc136800640 1 -- 172.21.15.42:0/1624332156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc118003c10 msgr2=0x7fc118004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:16.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.125+0000 7fc136800640 1 --2- 172.21.15.42:0/1624332156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc118003c10 0x7fc118004060 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7fc124001830 tx=0x7fc118005830 comp rx=0 tx=0).stop 2024-09-17T01:46:16.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.125+0000 7fc135e00640 1 -- 172.21.15.42:0/1624332156 reap_dead start 2024-09-17T01:46:16.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.125+0000 7fc136800640 1 -- 172.21.15.42:0/1624332156 shutdown_connections 2024-09-17T01:46:16.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.125+0000 7fc136800640 1 -- 172.21.15.42:0/1624332156 >> 172.21.15.42:0/1624332156 conn(0x7fc1300b25f0 msgr2=0x7fc1300d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:16.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.125+0000 7fc136800640 1 -- 172.21.15.42:0/1624332156 shutdown_connections 2024-09-17T01:46:16.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.125+0000 7fc136800640 1 -- 172.21.15.42:0/1624332156 wait complete. 2024-09-17T01:46:16.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.127+0000 7fc136800640 1 Processor -- start 2024-09-17T01:46:16.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.127+0000 7fc136800640 1 -- start start 2024-09-17T01:46:16.127 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.129+0000 7fc136800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc118003c10 0x7fc1301f73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:16.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.129+0000 7fc136800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc1301f4160 0x7fc1301f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:16.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.129+0000 7fc136800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1301f3c00 0x7fc130073b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:16.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.129+0000 7fc136800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc13006cd20 con 0x7fc1301f3c00 2024-09-17T01:46:16.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.129+0000 7fc136800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc1300b42f0 con 0x7fc118003c10 2024-09-17T01:46:16.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.129+0000 7fc136800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc13006cea0 con 0x7fc1301f4160 2024-09-17T01:46:16.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.129+0000 7fc135e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1301f3c00 0x7fc130073b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:16.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.129+0000 7fc135e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1301f3c00 0x7fc130073b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48194/0 (socket says 172.21.15.42:48194) 2024-09-17T01:46:16.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.129+0000 7fc135e00640 1 -- 172.21.15.42:0/1422712288 learned_addr learned my addr 172.21.15.42:0/1422712288 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:16.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.129+0000 7fc135400640 1 --2- 172.21.15.42:0/1422712288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc118003c10 0x7fc1301f73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:16.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.129+0000 7fc134a00640 1 --2- 172.21.15.42:0/1422712288 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc1301f4160 0x7fc1301f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:16.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.130+0000 7fc135e00640 1 -- 172.21.15.42:0/1422712288 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc1301f4160 msgr2=0x7fc1301f36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:16.128 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.130+0000 7fc135e00640 1 --2- 172.21.15.42:0/1422712288 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc1301f4160 0x7fc1301f36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:16.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.130+0000 7fc135e00640 1 -- 172.21.15.42:0/1422712288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc118003c10 msgr2=0x7fc1301f73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:16.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.130+0000 7fc135e00640 1 --2- 172.21.15.42:0/1422712288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc118003c10 0x7fc1301f73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:16.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.130+0000 7fc135e00640 1 -- 172.21.15.42:0/1422712288 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc130074c00 con 0x7fc1301f3c00 2024-09-17T01:46:16.129 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.130+0000 7fc135e00640 1 --2- 172.21.15.42:0/1422712288 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1301f3c00 0x7fc130073b80 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7fc1300b4890 tx=0x7fc128006790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:16.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.130+0000 7fc12d600640 1 -- 172.21.15.42:0/1422712288 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1280068c0 con 0x7fc1301f3c00 2024-09-17T01:46:16.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.130+0000 7fc12d600640 1 -- 172.21.15.42:0/1422712288 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc12800ead0 con 0x7fc1301f3c00 2024-09-17T01:46:16.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.130+0000 7fc12d600640 1 -- 172.21.15.42:0/1422712288 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128011460 con 0x7fc1301f3c00 2024-09-17T01:46:16.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.130+0000 7fc136800640 1 -- 172.21.15.42:0/1422712288 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1300ca010 con 0x7fc1301f3c00 2024-09-17T01:46:16.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.130+0000 7fc136800640 1 -- 172.21.15.42:0/1422712288 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1300730a0 con 0x7fc1301f3c00 2024-09-17T01:46:16.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.132+0000 7fc136800640 1 -- 172.21.15.42:0/1422712288 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1300c9d70 con 0x7fc1301f3c00 2024-09-17T01:46:16.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.133+0000 7fc12d600640 1 -- 172.21.15.42:0/1422712288 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc128019020 con 0x7fc1301f3c00 2024-09-17T01:46:16.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.134+0000 7fc12d600640 1 --2- 172.21.15.42:0/1422712288 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc110078b90 0x7fc11007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:16.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.134+0000 7fc12d600640 1 -- 172.21.15.42:0/1422712288 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7fc12809aec0 con 0x7fc1301f3c00 2024-09-17T01:46:16.132 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.134+0000 7fc135400640 1 --2- 172.21.15.42:0/1422712288 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc110078b90 0x7fc11007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:16.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.135+0000 7fc135400640 1 --2- 172.21.15.42:0/1422712288 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc110078b90 0x7fc11007b0a0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fc124032000 tx=0x7fc124001360 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:16.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.138+0000 7fc12d600640 1 -- 172.21.15.42:0/1422712288 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc1300c9d70 con 0x7fc1301f3c00 2024-09-17T01:46:16.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.369+0000 7fc136800640 1 -- 172.21.15.42:0/1422712288 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc130153750 con 0x7fc1301f3c00 2024-09-17T01:46:16.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.370+0000 7fc12d600640 1 -- 172.21.15.42:0/1422712288 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 141 v141) ==== 95+0+5236 (secure 0 0 0) 0x7fc128020020 con 0x7fc1301f3c00 2024-09-17T01:46:16.370 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:46:16.370 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":141,"btime":"2024-09-17T01:46:09:560403+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1946373489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1946373489},{"type":"v1","addr":"172.21.15.43:6837","nonce":1946373489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134},{"gid":9280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/1948698658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1948698658},{"type":"v1","addr":"172.21.15.43:6835","nonce":1948698658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133}],"filesystems":[{"mdsmap":{"epoch":141,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:45:36.259119+0000","modified":"2024-09-17T01:46:09.560386+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9969},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9960":{"gid":9960,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.42:6833/908320168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":908320168},{"type":"v1","addr":"172.21.15.42:6833","nonce":908320168}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_9969":{"gid":9969,"name":"a","rank":0,"incarnation":135,"state":"up:active","state_seq":5,"addr":"172.21.15.42:6835/2353432649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":2353432649},{"type":"v1","addr":"172.21.15.42:6835","nonce":2353432649}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9969,"qdb_cluster":[9969]},"id":12}]} 2024-09-17T01:46:16.371 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 141 2024-09-17T01:46:16.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.372+0000 7fc136800640 1 -- 172.21.15.42:0/1422712288 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc110078b90 msgr2=0x7fc11007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:16.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.372+0000 7fc136800640 1 --2- 172.21.15.42:0/1422712288 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc110078b90 0x7fc11007b0a0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fc124032000 tx=0x7fc124001360 comp rx=0 tx=0).stop 2024-09-17T01:46:16.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.372+0000 7fc136800640 1 -- 172.21.15.42:0/1422712288 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1301f3c00 msgr2=0x7fc130073b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:16.371 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.372+0000 7fc136800640 1 --2- 172.21.15.42:0/1422712288 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1301f3c00 0x7fc130073b80 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7fc1300b4890 tx=0x7fc128006790 comp rx=0 tx=0).stop 2024-09-17T01:46:16.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.372+0000 7fc136800640 1 -- 172.21.15.42:0/1422712288 shutdown_connections 2024-09-17T01:46:16.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.372+0000 7fc136800640 1 --2- 172.21.15.42:0/1422712288 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc110078b90 0x7fc11007b0a0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:16.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.372+0000 7fc136800640 1 --2- 172.21.15.42:0/1422712288 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1301f3c00 0x7fc130073b80 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:16.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.372+0000 7fc136800640 1 --2- 172.21.15.42:0/1422712288 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc1301f4160 0x7fc1301f36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:16.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.372+0000 7fc136800640 1 --2- 172.21.15.42:0/1422712288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc118003c10 0x7fc1301f73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:16.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.372+0000 7fc136800640 1 -- 172.21.15.42:0/1422712288 >> 172.21.15.42:0/1422712288 conn(0x7fc1300b25f0 msgr2=0x7fc13015f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:16.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.373+0000 7fc136800640 1 -- 172.21.15.42:0/1422712288 shutdown_connections 2024-09-17T01:46:16.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.373+0000 7fc136800640 1 -- 172.21.15.42:0/1422712288 wait complete. 2024-09-17T01:46:16.393 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:46:16.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.622+0000 7fa9af200640 1 -- 172.21.15.42:0/2074258527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9a8142f40 msgr2=0x7fa9a8072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:16.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.622+0000 7fa9af200640 1 --2- 172.21.15.42:0/2074258527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9a8142f40 0x7fa9a8072950 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8071ef0 tx=0x7fa99002a4d0 comp rx=0 tx=0).stop 2024-09-17T01:46:16.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.622+0000 7fa9af200640 1 -- 172.21.15.42:0/2074258527 shutdown_connections 2024-09-17T01:46:16.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.622+0000 7fa9af200640 1 --2- 172.21.15.42:0/2074258527 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa9a8072e90 0x7fa9a80cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:16.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.622+0000 7fa9af200640 1 --2- 172.21.15.42:0/2074258527 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9a8142f40 0x7fa9a8072950 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:16.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.622+0000 7fa9af200640 1 --2- 172.21.15.42:0/2074258527 >> v2:172.21.15.43:3300/0 conn(0x7fa9a80b3550 0x7fa9a815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:16.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.622+0000 7fa9af200640 1 -- 172.21.15.42:0/2074258527 >> 172.21.15.42:0/2074258527 conn(0x7fa9a80b2930 msgr2=0x7fa9a806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:16.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.623+0000 7fa9af200640 1 -- 172.21.15.42:0/2074258527 shutdown_connections 2024-09-17T01:46:16.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.623+0000 7fa9af200640 1 -- 172.21.15.42:0/2074258527 wait complete. 2024-09-17T01:46:16.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.625+0000 7fa9af200640 1 Processor -- start 2024-09-17T01:46:16.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.625+0000 7fa9af200640 1 -- start start 2024-09-17T01:46:16.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.626+0000 7fa9af200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9a8072e90 0x7fa9a81e62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:16.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.626+0000 7fa9af200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9a80b3550 0x7fa9a814ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:16.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.626+0000 7fa9af200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa9a8142f40 0x7fa9a81f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:16.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.626+0000 7fa9af200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a806d430 con 0x7fa9a8072e90 2024-09-17T01:46:16.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.626+0000 7fa9af200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a806d5b0 con 0x7fa9a80b3550 2024-09-17T01:46:16.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.626+0000 7fa9af200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa9a806d730 con 0x7fa9a8142f40 2024-09-17T01:46:16.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.627+0000 7fa9a7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9a8072e90 0x7fa9a81e62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:16.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.627+0000 7fa9a7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9a8072e90 0x7fa9a81e62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48204/0 (socket says 172.21.15.42:48204) 2024-09-17T01:46:16.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.627+0000 7fa9a7e00640 1 -- 172.21.15.42:0/639888904 learned_addr learned my addr 172.21.15.42:0/639888904 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:16.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.627+0000 7fa99f400640 1 --2- 172.21.15.42:0/639888904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9a80b3550 0x7fa9a814ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:16.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.627+0000 7fa9ad200640 1 --2- 172.21.15.42:0/639888904 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa9a8142f40 0x7fa9a81f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:16.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.627+0000 7fa9a7e00640 1 -- 172.21.15.42:0/639888904 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa9a8142f40 msgr2=0x7fa9a81f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:16.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.627+0000 7fa9a7e00640 1 --2- 172.21.15.42:0/639888904 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa9a8142f40 0x7fa9a81f6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:16.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.627+0000 7fa9a7e00640 1 -- 172.21.15.42:0/639888904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9a80b3550 msgr2=0x7fa9a814ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:16.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.627+0000 7fa9a7e00640 1 --2- 172.21.15.42:0/639888904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9a80b3550 0x7fa9a814ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:16.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.627+0000 7fa9a7e00640 1 -- 172.21.15.42:0/639888904 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a81f5db0 con 0x7fa9a8072e90 2024-09-17T01:46:16.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.627+0000 7fa99f400640 1 --2- 172.21.15.42:0/639888904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9a80b3550 0x7fa9a814ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:16.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.627+0000 7fa9a7e00640 1 --2- 172.21.15.42:0/639888904 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9a8072e90 0x7fa9a81e62f0 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7fa99800d7a0 tx=0x7fa99800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:16.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.627+0000 7fa9a4c00640 1 -- 172.21.15.42:0/639888904 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa998017070 con 0x7fa9a8072e90 2024-09-17T01:46:16.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.628+0000 7fa9a4c00640 1 -- 172.21.15.42:0/639888904 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa998004310 con 0x7fa9a8072e90 2024-09-17T01:46:16.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.628+0000 7fa9a4c00640 1 -- 172.21.15.42:0/639888904 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa998009c30 con 0x7fa9a8072e90 2024-09-17T01:46:16.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.628+0000 7fa9af200640 1 -- 172.21.15.42:0/639888904 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a8141920 con 0x7fa9a8072e90 2024-09-17T01:46:16.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.628+0000 7fa9af200640 1 -- 172.21.15.42:0/639888904 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9a81f6070 con 0x7fa9a8072e90 2024-09-17T01:46:16.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.629+0000 7fa9af200640 1 -- 172.21.15.42:0/639888904 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9a8076880 con 0x7fa9a8072e90 2024-09-17T01:46:16.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.630+0000 7fa9a4c00640 1 -- 172.21.15.42:0/639888904 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa998005020 con 0x7fa9a8072e90 2024-09-17T01:46:16.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.631+0000 7fa9a4c00640 1 --2- 172.21.15.42:0/639888904 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa984078b90 0x7fa98407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:16.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.631+0000 7fa9a4c00640 1 -- 172.21.15.42:0/639888904 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7fa99809b110 con 0x7fa9a8072e90 2024-09-17T01:46:16.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.631+0000 7fa99f400640 1 --2- 172.21.15.42:0/639888904 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa984078b90 0x7fa98407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:16.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.632+0000 7fa99f400640 1 --2- 172.21.15.42:0/639888904 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa984078b90 0x7fa98407b0a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa990033000 tx=0x7fa990004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:16.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.636+0000 7fa9a4c00640 1 -- 172.21.15.42:0/639888904 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa9a8076880 con 0x7fa9a8072e90 2024-09-17T01:46:16.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.837+0000 7fa9af200640 1 -- 172.21.15.42:0/639888904 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa9a806dc50 con 0x7fa9a8072e90 2024-09-17T01:46:16.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.838+0000 7fa9a4c00640 1 -- 172.21.15.42:0/639888904 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) ==== 74+0+16841 (secure 0 0 0) 0x7fa998020020 con 0x7fa9a8072e90 2024-09-17T01:46:16.836 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:46:16.836 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":176,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:45:51.799298+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:45:34.322650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-17T01:45:35.214870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"25.11","mappings":[{"from":7,"to":3}]},{"pgid":"25.29","mappings":[{"from":7,"to":4}]},{"pgid":"25.3c","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:46:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.840+0000 7fa9af200640 1 -- 172.21.15.42:0/639888904 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa984078b90 msgr2=0x7fa98407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.840+0000 7fa9af200640 1 --2- 172.21.15.42:0/639888904 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa984078b90 0x7fa98407b0a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa990033000 tx=0x7fa990004730 comp rx=0 tx=0).stop 2024-09-17T01:46:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.840+0000 7fa9af200640 1 -- 172.21.15.42:0/639888904 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9a8072e90 msgr2=0x7fa9a81e62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.840+0000 7fa9af200640 1 --2- 172.21.15.42:0/639888904 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9a8072e90 0x7fa9a81e62f0 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7fa99800d7a0 tx=0x7fa99800dc60 comp rx=0 tx=0).stop 2024-09-17T01:46:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.841+0000 7fa9af200640 1 -- 172.21.15.42:0/639888904 shutdown_connections 2024-09-17T01:46:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.841+0000 7fa9af200640 1 --2- 172.21.15.42:0/639888904 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa984078b90 0x7fa98407b0a0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.841+0000 7fa9af200640 1 --2- 172.21.15.42:0/639888904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9a80b3550 0x7fa9a814ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.841+0000 7fa9af200640 1 --2- 172.21.15.42:0/639888904 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa9a8142f40 0x7fa9a81f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.841+0000 7fa9af200640 1 --2- 172.21.15.42:0/639888904 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9a8072e90 0x7fa9a81e62f0 unknown :-1 s=CLOSED pgs=2072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.841+0000 7fa9af200640 1 -- 172.21.15.42:0/639888904 >> 172.21.15.42:0/639888904 conn(0x7fa9a80b2930 msgr2=0x7fa9a815ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.841+0000 7fa9af200640 1 -- 172.21.15.42:0/639888904 shutdown_connections 2024-09-17T01:46:16.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:16.841+0000 7fa9af200640 1 -- 172.21.15.42:0/639888904 wait complete. 2024-09-17T01:46:16.861 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T01:46:17.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.092+0000 7f7e2ce00640 1 -- 172.21.15.42:0/459297760 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2806d430 msgr2=0x7f7e2806d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:17.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.092+0000 7f7e2ce00640 1 --2- 172.21.15.42:0/459297760 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2806d430 0x7f7e2806d840 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f7e20009830 tx=0x7f7e2002a4b0 comp rx=0 tx=0).stop 2024-09-17T01:46:17.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.092+0000 7f7e2ce00640 1 -- 172.21.15.42:0/459297760 shutdown_connections 2024-09-17T01:46:17.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.092+0000 7f7e2ce00640 1 --2- 172.21.15.42:0/459297760 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2806d430 0x7f7e2806d840 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:17.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.092+0000 7f7e2ce00640 1 --2- 172.21.15.42:0/459297760 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e280b3880 0x7f7e280af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:17.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.092+0000 7f7e2ce00640 1 -- 172.21.15.42:0/459297760 >> 172.21.15.42:0/459297760 conn(0x7f7e280b2930 msgr2=0x7f7e2806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:17.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.092+0000 7f7e2ce00640 1 -- 172.21.15.42:0/459297760 shutdown_connections 2024-09-17T01:46:17.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.092+0000 7f7e2ce00640 1 -- 172.21.15.42:0/459297760 wait complete. 2024-09-17T01:46:17.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.094+0000 7f7e2ce00640 1 Processor -- start 2024-09-17T01:46:17.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.095+0000 7f7e2ce00640 1 -- start start 2024-09-17T01:46:17.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.096+0000 7f7e2ce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2806d430 0x7f7e281f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:17.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.096+0000 7f7e2ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e280b3880 0x7f7e28155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:17.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.096+0000 7f7e2ce00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e2815cfc0 0x7f7e28158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:17.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.096+0000 7f7e2ce00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7e28072ad0 con 0x7f7e280b3880 2024-09-17T01:46:17.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.096+0000 7f7e2ce00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7e28072950 con 0x7f7e2806d430 2024-09-17T01:46:17.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.096+0000 7f7e2ce00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7e28072c50 con 0x7f7e2815cfc0 2024-09-17T01:46:17.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.096+0000 7f7e1d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e280b3880 0x7f7e28155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:17.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.096+0000 7f7e1d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e280b3880 0x7f7e28155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48216/0 (socket says 172.21.15.42:48216) 2024-09-17T01:46:17.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.096+0000 7f7e1d400640 1 -- 172.21.15.42:0/1177237869 learned_addr learned my addr 172.21.15.42:0/1177237869 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:17.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.097+0000 7f7e26800640 1 --2- 172.21.15.42:0/1177237869 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e2815cfc0 0x7f7e28158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:17.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.097+0000 7f7e25e00640 1 --2- 172.21.15.42:0/1177237869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2806d430 0x7f7e281f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:17.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.097+0000 7f7e1d400640 1 -- 172.21.15.42:0/1177237869 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e2815cfc0 msgr2=0x7f7e28158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:17.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.097+0000 7f7e1d400640 1 --2- 172.21.15.42:0/1177237869 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e2815cfc0 0x7f7e28158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:17.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.097+0000 7f7e1d400640 1 -- 172.21.15.42:0/1177237869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2806d430 msgr2=0x7f7e281f6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:17.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.097+0000 7f7e1d400640 1 --2- 172.21.15.42:0/1177237869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2806d430 0x7f7e281f6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:17.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.097+0000 7f7e1d400640 1 -- 172.21.15.42:0/1177237869 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e28155190 con 0x7f7e280b3880 2024-09-17T01:46:17.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.097+0000 7f7e25e00640 1 --2- 172.21.15.42:0/1177237869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2806d430 0x7f7e281f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:17.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.097+0000 7f7e1d400640 1 --2- 172.21.15.42:0/1177237869 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e280b3880 0x7f7e28155e30 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000c450 tx=0x7f7e1000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:17.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.097+0000 7f7e1ea00640 1 -- 172.21.15.42:0/1177237869 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e10016020 con 0x7f7e280b3880 2024-09-17T01:46:17.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.097+0000 7f7e1ea00640 1 -- 172.21.15.42:0/1177237869 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e10012920 con 0x7f7e280b3880 2024-09-17T01:46:17.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.097+0000 7f7e1ea00640 1 -- 172.21.15.42:0/1177237869 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e10012d70 con 0x7f7e280b3880 2024-09-17T01:46:17.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.097+0000 7f7e2ce00640 1 -- 172.21.15.42:0/1177237869 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e281540f0 con 0x7f7e280b3880 2024-09-17T01:46:17.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.098+0000 7f7e2ce00640 1 -- 172.21.15.42:0/1177237869 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e281546b0 con 0x7f7e280b3880 2024-09-17T01:46:17.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.099+0000 7f7e2ce00640 1 -- 172.21.15.42:0/1177237869 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e281f6bf0 con 0x7f7e280b3880 2024-09-17T01:46:17.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.100+0000 7f7e1ea00640 1 -- 172.21.15.42:0/1177237869 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7e10019020 con 0x7f7e280b3880 2024-09-17T01:46:17.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.101+0000 7f7e1ea00640 1 --2- 172.21.15.42:0/1177237869 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7e04078b90 0x7f7e0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:17.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.102+0000 7f7e1ea00640 1 -- 172.21.15.42:0/1177237869 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5796+0+0 (secure 0 0 0) 0x7f7e1009ab90 con 0x7f7e280b3880 2024-09-17T01:46:17.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.102+0000 7f7e25e00640 1 --2- 172.21.15.42:0/1177237869 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7e04078b90 0x7f7e0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:17.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.103+0000 7f7e25e00640 1 --2- 172.21.15.42:0/1177237869 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7e04078b90 0x7f7e0407b0a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7e18005fd0 tx=0x7f7e18009500 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:17.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.106+0000 7f7e1ea00640 1 -- 172.21.15.42:0/1177237869 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7e10020030 con 0x7f7e280b3880 2024-09-17T01:46:17.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.335+0000 7f7e2ce00640 1 -- 172.21.15.42:0/1177237869 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7e2806d840 con 0x7f7e280b3880 2024-09-17T01:46:17.334 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-17T01:46:17.336+0000 7f9961e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:46:17.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.338+0000 7f7e1ea00640 1 -- 172.21.15.42:0/1177237869 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v142) ==== 161+0+0 (secure 0 0 0) 0x7f7e10062f60 con 0x7f7e280b3880 2024-09-17T01:46:17.336 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T01:46:17.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.342+0000 7f7e2ce00640 1 -- 172.21.15.42:0/1177237869 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7e04078b90 msgr2=0x7f7e0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:17.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.342+0000 7f7e2ce00640 1 --2- 172.21.15.42:0/1177237869 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7e04078b90 0x7f7e0407b0a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7e18005fd0 tx=0x7f7e18009500 comp rx=0 tx=0).stop 2024-09-17T01:46:17.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.342+0000 7f7e2ce00640 1 -- 172.21.15.42:0/1177237869 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e280b3880 msgr2=0x7f7e28155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:17.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.342+0000 7f7e2ce00640 1 --2- 172.21.15.42:0/1177237869 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e280b3880 0x7f7e28155e30 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000c450 tx=0x7f7e1000c910 comp rx=0 tx=0).stop 2024-09-17T01:46:17.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.342+0000 7f7e2ce00640 1 -- 172.21.15.42:0/1177237869 shutdown_connections 2024-09-17T01:46:17.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.342+0000 7f7e2ce00640 1 --2- 172.21.15.42:0/1177237869 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7e04078b90 0x7f7e0407b0a0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:17.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.342+0000 7f7e2ce00640 1 --2- 172.21.15.42:0/1177237869 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7e2815cfc0 0x7f7e28158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:17.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.342+0000 7f7e2ce00640 1 --2- 172.21.15.42:0/1177237869 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7e280b3880 0x7f7e28155e30 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:17.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.342+0000 7f7e2ce00640 1 --2- 172.21.15.42:0/1177237869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e2806d430 0x7f7e281f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:17.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.342+0000 7f7e2ce00640 1 -- 172.21.15.42:0/1177237869 >> 172.21.15.42:0/1177237869 conn(0x7f7e280b2930 msgr2=0x7f7e2806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:17.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.342+0000 7f7e2ce00640 1 -- 172.21.15.42:0/1177237869 shutdown_connections 2024-09-17T01:46:17.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.342+0000 7f7e2ce00640 1 -- 172.21.15.42:0/1177237869 wait complete. 2024-09-17T01:46:17.363 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T01:46:17.482 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:46:17.489 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:46:17.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.600+0000 7fccb7a00640 1 -- 172.21.15.42:0/465756884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc98004800 msgr2=0x7fcc98004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:17.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.600+0000 7fccb7a00640 1 --2- 172.21.15.42:0/465756884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc98004800 0x7fcc98004c10 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00c310 tx=0x7fcc98005830 comp rx=0 tx=0).stop 2024-09-17T01:46:17.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.600+0000 7fccb5a00640 1 -- 172.21.15.42:0/465756884 reap_dead start 2024-09-17T01:46:17.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.600+0000 7fccb7a00640 1 -- 172.21.15.42:0/465756884 shutdown_connections 2024-09-17T01:46:17.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.600+0000 7fccb7a00640 1 -- 172.21.15.42:0/465756884 >> 172.21.15.42:0/465756884 conn(0x7fccb00b2930 msgr2=0x7fccb006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:17.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.600+0000 7fccb7a00640 1 -- 172.21.15.42:0/465756884 shutdown_connections 2024-09-17T01:46:17.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.601+0000 7fccb7a00640 1 -- 172.21.15.42:0/465756884 wait complete. 2024-09-17T01:46:17.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.603+0000 7fccb7a00640 1 Processor -- start 2024-09-17T01:46:17.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.603+0000 7fccb7a00640 1 -- start start 2024-09-17T01:46:17.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.604+0000 7fccb7a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc98004800 0x7fccb01f9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:17.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.604+0000 7fccb7a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fccb00ab110 0x7fccb014c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:17.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.604+0000 7fccb7a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccb00aa490 0x7fccb00aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:17.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.604+0000 7fccb7a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fccb00cf3e0 con 0x7fcc98004800 2024-09-17T01:46:17.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.604+0000 7fccb7a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fccb00cf260 con 0x7fccb00aa490 2024-09-17T01:46:17.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.604+0000 7fccb7a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fccb00cf560 con 0x7fccb00ab110 2024-09-17T01:46:17.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.605+0000 7fccb5000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc98004800 0x7fccb01f9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:17.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.605+0000 7fccb5000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc98004800 0x7fccb01f9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48270/0 (socket says 172.21.15.42:48270) 2024-09-17T01:46:17.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.605+0000 7fccb5000640 1 -- 172.21.15.42:0/3434846467 learned_addr learned my addr 172.21.15.42:0/3434846467 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:17.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.605+0000 7fccafe00640 1 --2- 172.21.15.42:0/3434846467 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fccb00ab110 0x7fccb014c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:17.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.605+0000 7fccb5a00640 1 --2- 172.21.15.42:0/3434846467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccb00aa490 0x7fccb00aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:17.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.605+0000 7fccb5000640 1 -- 172.21.15.42:0/3434846467 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fccb00ab110 msgr2=0x7fccb014c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:17.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.605+0000 7fccb5000640 1 --2- 172.21.15.42:0/3434846467 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fccb00ab110 0x7fccb014c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:17.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.605+0000 7fccb5000640 1 -- 172.21.15.42:0/3434846467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccb00aa490 msgr2=0x7fccb00aa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:17.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.605+0000 7fccb5000640 1 --2- 172.21.15.42:0/3434846467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccb00aa490 0x7fccb00aa8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:17.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.605+0000 7fccb5000640 1 -- 172.21.15.42:0/3434846467 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb006eb80 con 0x7fcc98004800 2024-09-17T01:46:17.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.605+0000 7fccafe00640 1 --2- 172.21.15.42:0/3434846467 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fccb00ab110 0x7fccb014c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:17.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.605+0000 7fccb5a00640 1 --2- 172.21.15.42:0/3434846467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccb00aa490 0x7fccb00aa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:17.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.605+0000 7fccb5000640 1 --2- 172.21.15.42:0/3434846467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc98004800 0x7fccb01f9050 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7fcca4011ae0 tx=0x7fcca4009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:17.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.606+0000 7fccacc00640 1 -- 172.21.15.42:0/3434846467 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca401e070 con 0x7fcc98004800 2024-09-17T01:46:17.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.606+0000 7fccacc00640 1 -- 172.21.15.42:0/3434846467 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcca400fe70 con 0x7fcc98004800 2024-09-17T01:46:17.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.606+0000 7fccacc00640 1 -- 172.21.15.42:0/3434846467 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca4004290 con 0x7fcc98004800 2024-09-17T01:46:17.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.606+0000 7fccb7a00640 1 -- 172.21.15.42:0/3434846467 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb00aade0 con 0x7fcc98004800 2024-09-17T01:46:17.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.606+0000 7fccb7a00640 1 -- 172.21.15.42:0/3434846467 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb01f9bf0 con 0x7fcc98004800 2024-09-17T01:46:17.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.607+0000 7fccb7a00640 1 -- 172.21.15.42:0/3434846467 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccb015d2a0 con 0x7fcc98004800 2024-09-17T01:46:17.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.608+0000 7fccacc00640 1 -- 172.21.15.42:0/3434846467 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcca4021070 con 0x7fcc98004800 2024-09-17T01:46:17.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.609+0000 7fccacc00640 1 --2- 172.21.15.42:0/3434846467 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcc90078b90 0x7fcc9007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:17.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.609+0000 7fccacc00640 1 -- 172.21.15.42:0/3434846467 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 5882+0+0 (secure 0 0 0) 0x7fcca409b7b0 con 0x7fcc98004800 2024-09-17T01:46:17.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.610+0000 7fccafe00640 1 --2- 172.21.15.42:0/3434846467 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcc90078b90 0x7fcc9007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:17.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.611+0000 7fccafe00640 1 --2- 172.21.15.42:0/3434846467 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcc90078b90 0x7fcc9007b0a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c033000 tx=0x7fcc9c0019f0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:17.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.614+0000 7fccacc00640 1 -- 172.21.15.42:0/3434846467 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fccb00aade0 con 0x7fcc98004800 2024-09-17T01:46:17.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:17.846+0000 7fccb7a00640 1 -- 172.21.15.42:0/3434846467 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fccb006a170 con 0x7fcc98004800 2024-09-17T01:46:18.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.341+0000 7fccacc00640 1 -- 172.21.15.42:0/3434846467 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v143) ==== 104+0+0 (secure 0 0 0) 0x7fcca40636d0 con 0x7fcc98004800 2024-09-17T01:46:18.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.343+0000 7fccb7a00640 1 -- 172.21.15.42:0/3434846467 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcc90078b90 msgr2=0x7fcc9007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:18.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.343+0000 7fccb7a00640 1 --2- 172.21.15.42:0/3434846467 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcc90078b90 0x7fcc9007b0a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c033000 tx=0x7fcc9c0019f0 comp rx=0 tx=0).stop 2024-09-17T01:46:18.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.343+0000 7fccb7a00640 1 -- 172.21.15.42:0/3434846467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc98004800 msgr2=0x7fccb01f9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:18.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.343+0000 7fccb7a00640 1 --2- 172.21.15.42:0/3434846467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc98004800 0x7fccb01f9050 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7fcca4011ae0 tx=0x7fcca4009e90 comp rx=0 tx=0).stop 2024-09-17T01:46:18.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.343+0000 7fccb7a00640 1 -- 172.21.15.42:0/3434846467 shutdown_connections 2024-09-17T01:46:18.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.343+0000 7fccb7a00640 1 --2- 172.21.15.42:0/3434846467 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcc90078b90 0x7fcc9007b0a0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:18.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.343+0000 7fccb7a00640 1 --2- 172.21.15.42:0/3434846467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccb00aa490 0x7fccb00aa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:18.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.343+0000 7fccb7a00640 1 --2- 172.21.15.42:0/3434846467 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fccb00ab110 0x7fccb014c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:18.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.343+0000 7fccb7a00640 1 --2- 172.21.15.42:0/3434846467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc98004800 0x7fccb01f9050 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:18.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.344+0000 7fccb7a00640 1 -- 172.21.15.42:0/3434846467 >> 172.21.15.42:0/3434846467 conn(0x7fccb00b2930 msgr2=0x7fccb006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:18.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.344+0000 7fccb7a00640 1 -- 172.21.15.42:0/3434846467 shutdown_connections 2024-09-17T01:46:18.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.344+0000 7fccb7a00640 1 -- 172.21.15.42:0/3434846467 wait complete. 2024-09-17T01:46:18.373 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T01:46:18.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.609+0000 7fe19fe00640 1 -- 172.21.15.42:0/311724529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1a00aebf0 msgr2=0x7fe1a006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:18.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.609+0000 7fe19fe00640 1 --2- 172.21.15.42:0/311724529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1a00aebf0 0x7fe1a006cd20 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7fe188005fd0 tx=0x7fe18802a5d0 comp rx=0 tx=0).stop 2024-09-17T01:46:18.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.609+0000 7fe19fe00640 1 -- 172.21.15.42:0/311724529 shutdown_connections 2024-09-17T01:46:18.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.609+0000 7fe19fe00640 1 --2- 172.21.15.42:0/311724529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1a00aebf0 0x7fe1a006cd20 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:18.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.609+0000 7fe19fe00640 1 --2- 172.21.15.42:0/311724529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1a00af4f0 0x7fe1a015d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:18.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.609+0000 7fe19fe00640 1 -- 172.21.15.42:0/311724529 >> 172.21.15.42:0/311724529 conn(0x7fe1a00b25d0 msgr2=0x7fe1a00d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:18.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.609+0000 7fe19fe00640 1 -- 172.21.15.42:0/311724529 shutdown_connections 2024-09-17T01:46:18.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.609+0000 7fe19fe00640 1 -- 172.21.15.42:0/311724529 wait complete. 2024-09-17T01:46:18.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.611+0000 7fe19fe00640 1 Processor -- start 2024-09-17T01:46:18.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.612+0000 7fe19fe00640 1 -- start start 2024-09-17T01:46:18.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.613+0000 7fe19fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1a006d260 0x7fe1a01f9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:18.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.613+0000 7fe19fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1a00aebf0 0x7fe1a015eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:18.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.613+0000 7fe19fe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1a00af4f0 0x7fe1a015f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:18.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.613+0000 7fe19fe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a0160aa0 con 0x7fe1a00aebf0 2024-09-17T01:46:18.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.613+0000 7fe19fe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a0160920 con 0x7fe1a006d260 2024-09-17T01:46:18.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.613+0000 7fe19fe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe1a0160c20 con 0x7fe1a00af4f0 2024-09-17T01:46:18.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.613+0000 7fe197e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1a00aebf0 0x7fe1a015eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:18.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.613+0000 7fe197e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1a00aebf0 0x7fe1a015eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48282/0 (socket says 172.21.15.42:48282) 2024-09-17T01:46:18.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.613+0000 7fe197e00640 1 -- 172.21.15.42:0/1482189580 learned_addr learned my addr 172.21.15.42:0/1482189580 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:18.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.614+0000 7fe19ea00640 1 --2- 172.21.15.42:0/1482189580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1a006d260 0x7fe1a01f9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:18.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.614+0000 7fe19f400640 1 --2- 172.21.15.42:0/1482189580 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1a00af4f0 0x7fe1a015f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:18.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.614+0000 7fe197e00640 1 -- 172.21.15.42:0/1482189580 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1a00af4f0 msgr2=0x7fe1a015f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:18.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.614+0000 7fe197e00640 1 --2- 172.21.15.42:0/1482189580 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1a00af4f0 0x7fe1a015f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:18.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.614+0000 7fe197e00640 1 -- 172.21.15.42:0/1482189580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1a006d260 msgr2=0x7fe1a01f9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:18.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.614+0000 7fe197e00640 1 --2- 172.21.15.42:0/1482189580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1a006d260 0x7fe1a01f9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:18.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.614+0000 7fe197e00640 1 -- 172.21.15.42:0/1482189580 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a0072f00 con 0x7fe1a00aebf0 2024-09-17T01:46:18.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.614+0000 7fe19f400640 1 --2- 172.21.15.42:0/1482189580 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1a00af4f0 0x7fe1a015f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:18.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.614+0000 7fe197e00640 1 --2- 172.21.15.42:0/1482189580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1a00aebf0 0x7fe1a015eda0 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7fe188034040 tx=0x7fe1880038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:18.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.615+0000 7fe196a00640 1 -- 172.21.15.42:0/1482189580 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18803e030 con 0x7fe1a00aebf0 2024-09-17T01:46:18.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.615+0000 7fe196a00640 1 -- 172.21.15.42:0/1482189580 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe188003ca0 con 0x7fe1a00aebf0 2024-09-17T01:46:18.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.615+0000 7fe19fe00640 1 -- 172.21.15.42:0/1482189580 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a0072140 con 0x7fe1a00aebf0 2024-09-17T01:46:18.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.615+0000 7fe196a00640 1 -- 172.21.15.42:0/1482189580 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe188035040 con 0x7fe1a00aebf0 2024-09-17T01:46:18.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.615+0000 7fe19fe00640 1 -- 172.21.15.42:0/1482189580 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a0072700 con 0x7fe1a00aebf0 2024-09-17T01:46:18.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.616+0000 7fe19fe00640 1 -- 172.21.15.42:0/1482189580 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a0074e40 con 0x7fe1a00aebf0 2024-09-17T01:46:18.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.617+0000 7fe196a00640 1 -- 172.21.15.42:0/1482189580 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe188041030 con 0x7fe1a00aebf0 2024-09-17T01:46:18.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.618+0000 7fe196a00640 1 --2- 172.21.15.42:0/1482189580 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe17c078bc0 0x7fe17c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:18.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.618+0000 7fe196a00640 1 -- 172.21.15.42:0/1482189580 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 5882+0+0 (secure 0 0 0) 0x7fe1880bb3c0 con 0x7fe1a00aebf0 2024-09-17T01:46:18.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.619+0000 7fe19ea00640 1 --2- 172.21.15.42:0/1482189580 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe17c078bc0 0x7fe17c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:18.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.620+0000 7fe19ea00640 1 --2- 172.21.15.42:0/1482189580 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe17c078bc0 0x7fe17c07b0d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00b4ff0 tx=0x7fe19000b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:18.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.623+0000 7fe196a00640 1 -- 172.21.15.42:0/1482189580 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe188082fe0 con 0x7fe1a00aebf0 2024-09-17T01:46:18.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:18.819+0000 7fe19fe00640 1 -- 172.21.15.42:0/1482189580 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe1a0074bb0 con 0x7fe1a00aebf0 2024-09-17T01:46:19.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.343+0000 7fe196a00640 1 -- 172.21.15.42:0/1482189580 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v178) ==== 181+0+0 (secure 0 0 0) 0x7fe188087a10 con 0x7fe1a00aebf0 2024-09-17T01:46:19.341 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-09-17T01:46:19.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.346+0000 7fe19fe00640 1 -- 172.21.15.42:0/1482189580 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe17c078bc0 msgr2=0x7fe17c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:19.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.346+0000 7fe19fe00640 1 --2- 172.21.15.42:0/1482189580 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe17c078bc0 0x7fe17c07b0d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00b4ff0 tx=0x7fe19000b2e0 comp rx=0 tx=0).stop 2024-09-17T01:46:19.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.346+0000 7fe19fe00640 1 -- 172.21.15.42:0/1482189580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1a00aebf0 msgr2=0x7fe1a015eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:19.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.346+0000 7fe19fe00640 1 --2- 172.21.15.42:0/1482189580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1a00aebf0 0x7fe1a015eda0 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7fe188034040 tx=0x7fe1880038a0 comp rx=0 tx=0).stop 2024-09-17T01:46:19.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.347+0000 7fe19fe00640 1 -- 172.21.15.42:0/1482189580 shutdown_connections 2024-09-17T01:46:19.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.347+0000 7fe19fe00640 1 --2- 172.21.15.42:0/1482189580 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe17c078bc0 0x7fe17c07b0d0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:19.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.347+0000 7fe19fe00640 1 --2- 172.21.15.42:0/1482189580 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe1a00af4f0 0x7fe1a015f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:19.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.347+0000 7fe19fe00640 1 --2- 172.21.15.42:0/1482189580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1a00aebf0 0x7fe1a015eda0 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:19.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.347+0000 7fe19fe00640 1 --2- 172.21.15.42:0/1482189580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe1a006d260 0x7fe1a01f9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:19.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.347+0000 7fe19fe00640 1 -- 172.21.15.42:0/1482189580 >> 172.21.15.42:0/1482189580 conn(0x7fe1a00b25d0 msgr2=0x7fe1a015c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:19.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.347+0000 7fe19fe00640 1 -- 172.21.15.42:0/1482189580 shutdown_connections 2024-09-17T01:46:19.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.347+0000 7fe19fe00640 1 -- 172.21.15.42:0/1482189580 wait complete. 2024-09-17T01:46:19.374 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T01:46:19.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.615+0000 7f8583e00640 1 -- 172.21.15.42:0/709045484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85840aebf0 msgr2=0x7f858406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:19.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.615+0000 7f8583e00640 1 --2- 172.21.15.42:0/709045484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85840aebf0 0x7f858406cd20 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8570009830 tx=0x7f857002a510 comp rx=0 tx=0).stop 2024-09-17T01:46:19.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.615+0000 7f8583e00640 1 -- 172.21.15.42:0/709045484 shutdown_connections 2024-09-17T01:46:19.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.615+0000 7f8583e00640 1 --2- 172.21.15.42:0/709045484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85840aebf0 0x7f858406cd20 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:19.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.615+0000 7f8583e00640 1 --2- 172.21.15.42:0/709045484 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f85840af4f0 0x7f858415d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:19.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.615+0000 7f8583e00640 1 -- 172.21.15.42:0/709045484 >> 172.21.15.42:0/709045484 conn(0x7f85840b25d0 msgr2=0x7f85840d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:19.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.615+0000 7f8583e00640 1 -- 172.21.15.42:0/709045484 shutdown_connections 2024-09-17T01:46:19.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.615+0000 7f8583e00640 1 -- 172.21.15.42:0/709045484 wait complete. 2024-09-17T01:46:19.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.617+0000 7f8583e00640 1 Processor -- start 2024-09-17T01:46:19.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.618+0000 7f8583e00640 1 -- start start 2024-09-17T01:46:19.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.619+0000 7f8583e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f858406d260 0x7f85840748f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:19.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.619+0000 7f8583e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f85840aebf0 0x7f85841f7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:19.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.619+0000 7f8583e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85840af4f0 0x7f858406f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:19.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.619+0000 7f8583e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8584160aa0 con 0x7f85840af4f0 2024-09-17T01:46:19.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.619+0000 7f8583e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8584160920 con 0x7f858406d260 2024-09-17T01:46:19.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.619+0000 7f8583e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8584160c20 con 0x7f85840aebf0 2024-09-17T01:46:19.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.619+0000 7f8583400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85840af4f0 0x7f858406f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:19.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.619+0000 7f8583400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85840af4f0 0x7f858406f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48296/0 (socket says 172.21.15.42:48296) 2024-09-17T01:46:19.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.619+0000 7f8583400640 1 -- 172.21.15.42:0/165559687 learned_addr learned my addr 172.21.15.42:0/165559687 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.620+0000 7f8582000640 1 --2- 172.21.15.42:0/165559687 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f85840aebf0 0x7f85841f7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.620+0000 7f8582a00640 1 --2- 172.21.15.42:0/165559687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f858406d260 0x7f85840748f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.620+0000 7f8583400640 1 -- 172.21.15.42:0/165559687 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f85840aebf0 msgr2=0x7f85841f7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.620+0000 7f8583400640 1 --2- 172.21.15.42:0/165559687 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f85840aebf0 0x7f85841f7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.620+0000 7f8583400640 1 -- 172.21.15.42:0/165559687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f858406d260 msgr2=0x7f85840748f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.620+0000 7f8583400640 1 --2- 172.21.15.42:0/165559687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f858406d260 0x7f85840748f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.620+0000 7f8583400640 1 -- 172.21.15.42:0/165559687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85841f3ba0 con 0x7f85840af4f0 2024-09-17T01:46:19.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.620+0000 7f8583400640 1 --2- 172.21.15.42:0/165559687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85840af4f0 0x7f858406f380 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f857c00caa0 tx=0x7f857c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.620+0000 7f857aa00640 1 -- 172.21.15.42:0/165559687 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c016020 con 0x7f85840af4f0 2024-09-17T01:46:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.621+0000 7f857aa00640 1 -- 172.21.15.42:0/165559687 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f857c00acf0 con 0x7f85840af4f0 2024-09-17T01:46:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.621+0000 7f8583e00640 1 -- 172.21.15.42:0/165559687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85841f3e80 con 0x7f85840af4f0 2024-09-17T01:46:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.621+0000 7f857aa00640 1 -- 172.21.15.42:0/165559687 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c012680 con 0x7f85840af4f0 2024-09-17T01:46:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.621+0000 7f8583e00640 1 -- 172.21.15.42:0/165559687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85841f4440 con 0x7f85840af4f0 2024-09-17T01:46:19.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.622+0000 7f8583e00640 1 -- 172.21.15.42:0/165559687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f858406cd20 con 0x7f85840af4f0 2024-09-17T01:46:19.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.623+0000 7f857aa00640 1 -- 172.21.15.42:0/165559687 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f857c019020 con 0x7f85840af4f0 2024-09-17T01:46:19.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.624+0000 7f857aa00640 1 --2- 172.21.15.42:0/165559687 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8564078b90 0x7f856407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:19.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.624+0000 7f857aa00640 1 -- 172.21.15.42:0/165559687 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 5444+0+0 (secure 0 0 0) 0x7f857c09af10 con 0x7f85840af4f0 2024-09-17T01:46:19.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.624+0000 7f8582a00640 1 --2- 172.21.15.42:0/165559687 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8564078b90 0x7f856407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:19.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.625+0000 7f8582a00640 1 --2- 172.21.15.42:0/165559687 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8564078b90 0x7f856407b0a0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f85740095f0 tx=0x7f8574005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:19.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.628+0000 7f857aa00640 1 -- 172.21.15.42:0/165559687 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f857c020030 con 0x7f85840af4f0 2024-09-17T01:46:19.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:19.823+0000 7f8583e00640 1 -- 172.21.15.42:0/165559687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f85840b0cc0 con 0x7f85840af4f0 2024-09-17T01:46:20.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.345+0000 7f857aa00640 1 -- 172.21.15.42:0/165559687 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v179) ==== 169+0+0 (secure 0 0 0) 0x7f858406d670 con 0x7f85840af4f0 2024-09-17T01:46:20.343 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-09-17T01:46:20.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.349+0000 7f8583e00640 1 -- 172.21.15.42:0/165559687 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8564078b90 msgr2=0x7f856407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:20.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.349+0000 7f8583e00640 1 --2- 172.21.15.42:0/165559687 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8564078b90 0x7f856407b0a0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f85740095f0 tx=0x7f8574005f90 comp rx=0 tx=0).stop 2024-09-17T01:46:20.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.349+0000 7f8583e00640 1 -- 172.21.15.42:0/165559687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85840af4f0 msgr2=0x7f858406f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:20.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.349+0000 7f8583e00640 1 --2- 172.21.15.42:0/165559687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85840af4f0 0x7f858406f380 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f857c00caa0 tx=0x7f857c00cf60 comp rx=0 tx=0).stop 2024-09-17T01:46:20.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.350+0000 7f8583e00640 1 -- 172.21.15.42:0/165559687 shutdown_connections 2024-09-17T01:46:20.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.350+0000 7f8583e00640 1 --2- 172.21.15.42:0/165559687 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8564078b90 0x7f856407b0a0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:20.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.350+0000 7f8583e00640 1 --2- 172.21.15.42:0/165559687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85840af4f0 0x7f858406f380 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:20.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.350+0000 7f8583e00640 1 --2- 172.21.15.42:0/165559687 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f85840aebf0 0x7f85841f7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:20.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.350+0000 7f8583e00640 1 --2- 172.21.15.42:0/165559687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f858406d260 0x7f85840748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:20.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.350+0000 7f8583e00640 1 -- 172.21.15.42:0/165559687 >> 172.21.15.42:0/165559687 conn(0x7f85840b25d0 msgr2=0x7f85840ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:20.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.350+0000 7f8583e00640 1 -- 172.21.15.42:0/165559687 shutdown_connections 2024-09-17T01:46:20.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.350+0000 7f8583e00640 1 -- 172.21.15.42:0/165559687 wait complete. 2024-09-17T01:46:20.390 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T01:46:20.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.624+0000 7f65d5e00640 1 -- 172.21.15.42:0/3229358578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65d0142f40 msgr2=0x7f65d0072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:20.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.624+0000 7f65d5e00640 1 --2- 172.21.15.42:0/3229358578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65d0142f40 0x7f65d0072950 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f65b8005fd0 tx=0x7f65b802a540 comp rx=0 tx=0).stop 2024-09-17T01:46:20.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.624+0000 7f65d5e00640 1 -- 172.21.15.42:0/3229358578 shutdown_connections 2024-09-17T01:46:20.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.624+0000 7f65d5e00640 1 --2- 172.21.15.42:0/3229358578 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65d0072e90 0x7f65d00cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:20.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.624+0000 7f65d5e00640 1 --2- 172.21.15.42:0/3229358578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65d0142f40 0x7f65d0072950 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:20.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.624+0000 7f65d5e00640 1 -- 172.21.15.42:0/3229358578 >> 172.21.15.42:0/3229358578 conn(0x7f65d00b2930 msgr2=0x7f65d006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:20.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.624+0000 7f65d5e00640 1 -- 172.21.15.42:0/3229358578 shutdown_connections 2024-09-17T01:46:20.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.624+0000 7f65d5e00640 1 -- 172.21.15.42:0/3229358578 wait complete. 2024-09-17T01:46:20.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.626+0000 7f65d5e00640 1 Processor -- start 2024-09-17T01:46:20.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.626+0000 7f65d5e00640 1 -- start start 2024-09-17T01:46:20.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.628+0000 7f65d5e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65d0072e90 0x7f65d0137820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:20.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.628+0000 7f65d5e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65d00b3550 0x7f65d00ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:20.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.628+0000 7f65d5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65d0142f40 0x7f65d00aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:20.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.628+0000 7f65d5e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f65d006d640 con 0x7f65d0142f40 2024-09-17T01:46:20.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.628+0000 7f65d5e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f65d00cf590 con 0x7f65d0072e90 2024-09-17T01:46:20.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.628+0000 7f65d5e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f65d006d7c0 con 0x7f65d00b3550 2024-09-17T01:46:20.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.628+0000 7f65cf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65d0142f40 0x7f65d00aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:20.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.628+0000 7f65cf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65d0142f40 0x7f65d00aee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48302/0 (socket says 172.21.15.42:48302) 2024-09-17T01:46:20.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.628+0000 7f65c7e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65d00b3550 0x7f65d00ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:20.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.628+0000 7f65cf400640 1 -- 172.21.15.42:0/3272221960 learned_addr learned my addr 172.21.15.42:0/3272221960 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:20.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.628+0000 7f65cea00640 1 --2- 172.21.15.42:0/3272221960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65d0072e90 0x7f65d0137820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:20.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.629+0000 7f65cf400640 1 -- 172.21.15.42:0/3272221960 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65d00b3550 msgr2=0x7f65d00ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:20.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.629+0000 7f65cf400640 1 --2- 172.21.15.42:0/3272221960 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65d00b3550 0x7f65d00ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:20.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.629+0000 7f65cf400640 1 -- 172.21.15.42:0/3272221960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65d0072e90 msgr2=0x7f65d0137820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:20.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.629+0000 7f65cf400640 1 --2- 172.21.15.42:0/3272221960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65d0072e90 0x7f65d0137820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:20.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.629+0000 7f65cf400640 1 -- 172.21.15.42:0/3272221960 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d01586a0 con 0x7f65d0142f40 2024-09-17T01:46:20.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.629+0000 7f65c7e00640 1 --2- 172.21.15.42:0/3272221960 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65d00b3550 0x7f65d00ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:46:20.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.629+0000 7f65cf400640 1 --2- 172.21.15.42:0/3272221960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65d0142f40 0x7f65d00aee10 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f65c800ebf0 tx=0x7f65c800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:20.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.629+0000 7f65c7400640 1 -- 172.21.15.42:0/3272221960 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c8010630 con 0x7f65d0142f40 2024-09-17T01:46:20.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.629+0000 7f65c7400640 1 -- 172.21.15.42:0/3272221960 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65c80107d0 con 0x7f65d0142f40 2024-09-17T01:46:20.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.629+0000 7f65d5e00640 1 -- 172.21.15.42:0/3272221960 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d0158980 con 0x7f65d0142f40 2024-09-17T01:46:20.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.629+0000 7f65c7400640 1 -- 172.21.15.42:0/3272221960 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c8010c20 con 0x7f65d0142f40 2024-09-17T01:46:20.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.629+0000 7f65d5e00640 1 -- 172.21.15.42:0/3272221960 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d01fa0f0 con 0x7f65d0142f40 2024-09-17T01:46:20.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.630+0000 7f65d5e00640 1 -- 172.21.15.42:0/3272221960 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65d0140b20 con 0x7f65d0142f40 2024-09-17T01:46:20.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.632+0000 7f65c7400640 1 -- 172.21.15.42:0/3272221960 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f65c8021440 con 0x7f65d0142f40 2024-09-17T01:46:20.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.633+0000 7f65c7400640 1 --2- 172.21.15.42:0/3272221960 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f65ac078bc0 0x7f65ac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:20.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.633+0000 7f65c7400640 1 -- 172.21.15.42:0/3272221960 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7f65c809b830 con 0x7f65d0142f40 2024-09-17T01:46:20.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.633+0000 7f65cea00640 1 --2- 172.21.15.42:0/3272221960 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f65ac078bc0 0x7f65ac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:20.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.634+0000 7f65cea00640 1 --2- 172.21.15.42:0/3272221960 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f65ac078bc0 0x7f65ac07b0d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f65c0001720 tx=0x7f65c0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:20.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.637+0000 7f65c7400640 1 -- 172.21.15.42:0/3272221960 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f65c8063910 con 0x7f65d0142f40 2024-09-17T01:46:20.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.832+0000 7f65d5e00640 1 -- 172.21.15.42:0/3272221960 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f65d01f9e60 con 0x7f65d0142f40 2024-09-17T01:46:20.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.837+0000 7f65c7400640 1 -- 172.21.15.42:0/3272221960 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v61) ==== 71+0+0 (secure 0 0 0) 0x7f65c8068340 con 0x7f65d0142f40 2024-09-17T01:46:20.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.840+0000 7f65d5e00640 1 -- 172.21.15.42:0/3272221960 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f65ac078bc0 msgr2=0x7f65ac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:20.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.840+0000 7f65d5e00640 1 --2- 172.21.15.42:0/3272221960 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f65ac078bc0 0x7f65ac07b0d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f65c0001720 tx=0x7f65c0009040 comp rx=0 tx=0).stop 2024-09-17T01:46:20.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.840+0000 7f65d5e00640 1 -- 172.21.15.42:0/3272221960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65d0142f40 msgr2=0x7f65d00aee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:20.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.840+0000 7f65d5e00640 1 --2- 172.21.15.42:0/3272221960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65d0142f40 0x7f65d00aee10 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f65c800ebf0 tx=0x7f65c800c6a0 comp rx=0 tx=0).stop 2024-09-17T01:46:20.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.840+0000 7f65d5e00640 1 -- 172.21.15.42:0/3272221960 shutdown_connections 2024-09-17T01:46:20.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.840+0000 7f65d5e00640 1 --2- 172.21.15.42:0/3272221960 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f65ac078bc0 0x7f65ac07b0d0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:20.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.840+0000 7f65d5e00640 1 --2- 172.21.15.42:0/3272221960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65d0142f40 0x7f65d00aee10 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:20.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.840+0000 7f65d5e00640 1 --2- 172.21.15.42:0/3272221960 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65d00b3550 0x7f65d00ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:20.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.840+0000 7f65d5e00640 1 --2- 172.21.15.42:0/3272221960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f65d0072e90 0x7f65d0137820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:20.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.840+0000 7f65d5e00640 1 -- 172.21.15.42:0/3272221960 >> 172.21.15.42:0/3272221960 conn(0x7f65d00b2930 msgr2=0x7f65d015e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:20.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.840+0000 7f65d5e00640 1 -- 172.21.15.42:0/3272221960 shutdown_connections 2024-09-17T01:46:20.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:20.840+0000 7f65d5e00640 1 -- 172.21.15.42:0/3272221960 wait complete. 2024-09-17T01:46:20.865 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-09-17T01:46:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.099+0000 7f9cad000640 1 -- 172.21.15.42:0/3273646230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ca8072e00 msgr2=0x7f9ca815bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.099+0000 7f9cad000640 1 --2- 172.21.15.42:0/3273646230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ca8072e00 0x7f9ca815bc50 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f9c98005fd0 tx=0x7f9c9802a5d0 comp rx=0 tx=0).stop 2024-09-17T01:46:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.099+0000 7f9cad000640 1 -- 172.21.15.42:0/3273646230 shutdown_connections 2024-09-17T01:46:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.099+0000 7f9cad000640 1 --2- 172.21.15.42:0/3273646230 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ca815f190 0x7f9ca806fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.099+0000 7f9cad000640 1 --2- 172.21.15.42:0/3273646230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ca8072e00 0x7f9ca815bc50 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.099+0000 7f9cad000640 1 -- 172.21.15.42:0/3273646230 >> 172.21.15.42:0/3273646230 conn(0x7f9ca80b2930 msgr2=0x7f9ca806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.099+0000 7f9cad000640 1 -- 172.21.15.42:0/3273646230 shutdown_connections 2024-09-17T01:46:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.099+0000 7f9cad000640 1 -- 172.21.15.42:0/3273646230 wait complete. 2024-09-17T01:46:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.102+0000 7f9cad000640 1 Processor -- start 2024-09-17T01:46:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.102+0000 7f9cad000640 1 -- start start 2024-09-17T01:46:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.103+0000 7f9cad000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ca806d430 0x7f9ca8150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.103+0000 7f9cad000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ca8072e00 0x7f9ca8149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.103+0000 7f9cad000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ca815f190 0x7f9ca8154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.103+0000 7f9cad000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca8151520 con 0x7f9ca8072e00 2024-09-17T01:46:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.103+0000 7f9cad000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca8070740 con 0x7f9ca815f190 2024-09-17T01:46:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.103+0000 7f9cad000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9ca81516a0 con 0x7f9ca806d430 2024-09-17T01:46:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.103+0000 7f9ca5400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ca8072e00 0x7f9ca8149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.103+0000 7f9ca5400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ca8072e00 0x7f9ca8149580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48318/0 (socket says 172.21.15.42:48318) 2024-09-17T01:46:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.103+0000 7f9ca5400640 1 -- 172.21.15.42:0/128950618 learned_addr learned my addr 172.21.15.42:0/128950618 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.104+0000 7f9ca5e00640 1 --2- 172.21.15.42:0/128950618 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ca806d430 0x7f9ca8150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.104+0000 7f9ca6800640 1 --2- 172.21.15.42:0/128950618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ca815f190 0x7f9ca8154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.104+0000 7f9ca5400640 1 -- 172.21.15.42:0/128950618 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ca806d430 msgr2=0x7f9ca8150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.104+0000 7f9ca5400640 1 --2- 172.21.15.42:0/128950618 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ca806d430 0x7f9ca8150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.104+0000 7f9ca5400640 1 -- 172.21.15.42:0/128950618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ca815f190 msgr2=0x7f9ca8154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.104+0000 7f9ca5400640 1 --2- 172.21.15.42:0/128950618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ca815f190 0x7f9ca8154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.104+0000 7f9ca5400640 1 -- 172.21.15.42:0/128950618 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca81512f0 con 0x7f9ca8072e00 2024-09-17T01:46:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.104+0000 7f9ca5400640 1 --2- 172.21.15.42:0/128950618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ca8072e00 0x7f9ca8149580 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f9c9400d680 tx=0x7f9c9400db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:21.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.105+0000 7f9c9e000640 1 -- 172.21.15.42:0/128950618 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c94017070 con 0x7f9ca8072e00 2024-09-17T01:46:21.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.105+0000 7f9c9e000640 1 -- 172.21.15.42:0/128950618 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c94005310 con 0x7f9ca8072e00 2024-09-17T01:46:21.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.105+0000 7f9c9e000640 1 -- 172.21.15.42:0/128950618 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c94009820 con 0x7f9ca8072e00 2024-09-17T01:46:21.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.105+0000 7f9cad000640 1 -- 172.21.15.42:0/128950618 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca814f150 con 0x7f9ca8072e00 2024-09-17T01:46:21.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.105+0000 7f9cad000640 1 -- 172.21.15.42:0/128950618 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca814dcb0 con 0x7f9ca8072e00 2024-09-17T01:46:21.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.106+0000 7f9cad000640 1 -- 172.21.15.42:0/128950618 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ca815bc50 con 0x7f9ca8072e00 2024-09-17T01:46:21.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.107+0000 7f9c9e000640 1 -- 172.21.15.42:0/128950618 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9c940099c0 con 0x7f9ca8072e00 2024-09-17T01:46:21.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.108+0000 7f9c9e000640 1 --2- 172.21.15.42:0/128950618 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9c88078b90 0x7f9c8807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:21.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.108+0000 7f9c9e000640 1 -- 172.21.15.42:0/128950618 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7f9c9409aa40 con 0x7f9ca8072e00 2024-09-17T01:46:21.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.109+0000 7f9ca5e00640 1 --2- 172.21.15.42:0/128950618 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9c88078b90 0x7f9c8807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:21.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.109+0000 7f9ca5e00640 1 --2- 172.21.15.42:0/128950618 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9c88078b90 0x7f9c8807b0a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f9c98033000 tx=0x7f9c98004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:21.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.113+0000 7f9c9e000640 1 -- 172.21.15.42:0/128950618 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9c94062b20 con 0x7f9ca8072e00 2024-09-17T01:46:21.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:21.399+0000 7f9cad000640 1 -- 172.21.15.42:0/128950618 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) -- 0x7f9ca806a170 con 0x7f9ca8072e00 2024-09-17T01:46:21.824 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:46:21.828 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:46:22.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.356+0000 7f9c9e000640 1 -- 172.21.15.42:0/128950618 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v675) ==== 159+0+0 (secure 0 0 0) 0x7f9c94067550 con 0x7f9ca8072e00 2024-09-17T01:46:22.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.359+0000 7f9cad000640 1 -- 172.21.15.42:0/128950618 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9c88078b90 msgr2=0x7f9c8807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:22.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.359+0000 7f9cad000640 1 --2- 172.21.15.42:0/128950618 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9c88078b90 0x7f9c8807b0a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f9c98033000 tx=0x7f9c98004730 comp rx=0 tx=0).stop 2024-09-17T01:46:22.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.359+0000 7f9cad000640 1 -- 172.21.15.42:0/128950618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ca8072e00 msgr2=0x7f9ca8149580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:22.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.359+0000 7f9cad000640 1 --2- 172.21.15.42:0/128950618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ca8072e00 0x7f9ca8149580 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f9c9400d680 tx=0x7f9c9400db40 comp rx=0 tx=0).stop 2024-09-17T01:46:22.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.359+0000 7f9cad000640 1 -- 172.21.15.42:0/128950618 shutdown_connections 2024-09-17T01:46:22.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.359+0000 7f9cad000640 1 --2- 172.21.15.42:0/128950618 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9c88078b90 0x7f9c8807b0a0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:22.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.359+0000 7f9cad000640 1 --2- 172.21.15.42:0/128950618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ca815f190 0x7f9ca8154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:22.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.359+0000 7f9cad000640 1 --2- 172.21.15.42:0/128950618 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ca8072e00 0x7f9ca8149580 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:22.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.359+0000 7f9cad000640 1 --2- 172.21.15.42:0/128950618 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9ca806d430 0x7f9ca8150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:22.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.359+0000 7f9cad000640 1 -- 172.21.15.42:0/128950618 >> 172.21.15.42:0/128950618 conn(0x7f9ca80b2930 msgr2=0x7f9ca80b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:22.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.359+0000 7f9cad000640 1 -- 172.21.15.42:0/128950618 shutdown_connections 2024-09-17T01:46:22.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.359+0000 7f9cad000640 1 -- 172.21.15.42:0/128950618 wait complete. 2024-09-17T01:46:22.382 INFO:tasks.cephfs_test_runner:test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-17T01:46:22.383 INFO:tasks.cephfs_test_runner:Starting test: test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-17T01:46:22.383 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:46:22.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.616+0000 7f93c7c00640 1 -- 172.21.15.42:0/831596410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93a8003c10 msgr2=0x7f93a8004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:22.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.616+0000 7f93c7c00640 1 --2- 172.21.15.42:0/831596410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93a8003c10 0x7f93a8004060 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f93b400c4a0 tx=0x7f93a8005830 comp rx=0 tx=0).stop 2024-09-17T01:46:22.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.616+0000 7f93c5c00640 1 -- 172.21.15.42:0/831596410 reap_dead start 2024-09-17T01:46:22.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.616+0000 7f93c7c00640 1 -- 172.21.15.42:0/831596410 shutdown_connections 2024-09-17T01:46:22.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.616+0000 7f93c7c00640 1 -- 172.21.15.42:0/831596410 >> 172.21.15.42:0/831596410 conn(0x7f93c00b2930 msgr2=0x7f93c006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:22.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.616+0000 7f93c7c00640 1 -- 172.21.15.42:0/831596410 shutdown_connections 2024-09-17T01:46:22.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.616+0000 7f93c7c00640 1 -- 172.21.15.42:0/831596410 wait complete. 2024-09-17T01:46:22.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.618+0000 7f93c7c00640 1 Processor -- start 2024-09-17T01:46:22.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.618+0000 7f93c7c00640 1 -- start start 2024-09-17T01:46:22.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.620+0000 7f93c7c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93a8003c10 0x7f93c00abc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:22.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.620+0000 7f93c7c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f93c0149c90 0x7f93c00ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:22.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.620+0000 7f93c7c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93c00cd3e0 0x7f93c00cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:22.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.620+0000 7f93c7c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f93c0073450 con 0x7f93c00cd3e0 2024-09-17T01:46:22.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.620+0000 7f93c7c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f93c015fe50 con 0x7f93a8003c10 2024-09-17T01:46:22.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.620+0000 7f93c7c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f93c00735d0 con 0x7f93c0149c90 2024-09-17T01:46:22.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.620+0000 7f93c5c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93c00cd3e0 0x7f93c00cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:22.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.620+0000 7f93c5c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93c00cd3e0 0x7f93c00cae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48340/0 (socket says 172.21.15.42:48340) 2024-09-17T01:46:22.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.620+0000 7f93c5c00640 1 -- 172.21.15.42:0/2249418235 learned_addr learned my addr 172.21.15.42:0/2249418235 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:22.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.620+0000 7f93bfe00640 1 --2- 172.21.15.42:0/2249418235 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f93c0149c90 0x7f93c00ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:22.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.620+0000 7f93c5200640 1 --2- 172.21.15.42:0/2249418235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93a8003c10 0x7f93c00abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:22.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.620+0000 7f93c5c00640 1 -- 172.21.15.42:0/2249418235 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f93c0149c90 msgr2=0x7f93c00ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:22.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.620+0000 7f93c5c00640 1 --2- 172.21.15.42:0/2249418235 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f93c0149c90 0x7f93c00ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:22.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.620+0000 7f93c5c00640 1 -- 172.21.15.42:0/2249418235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93a8003c10 msgr2=0x7f93c00abc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.620+0000 7f93c5c00640 1 --2- 172.21.15.42:0/2249418235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93a8003c10 0x7f93c00abc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.620+0000 7f93c5c00640 1 -- 172.21.15.42:0/2249418235 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c00cd7f0 con 0x7f93c00cd3e0 2024-09-17T01:46:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.621+0000 7f93c5200640 1 --2- 172.21.15.42:0/2249418235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93a8003c10 0x7f93c00abc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.621+0000 7f93bfe00640 1 --2- 172.21.15.42:0/2249418235 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f93c0149c90 0x7f93c00ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.621+0000 7f93c5c00640 1 --2- 172.21.15.42:0/2249418235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93c00cd3e0 0x7f93c00cae80 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7f93b8005fd0 tx=0x7f93b800fe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.621+0000 7f93bcc00640 1 -- 172.21.15.42:0/2249418235 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b8003e40 con 0x7f93c00cd3e0 2024-09-17T01:46:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.621+0000 7f93bcc00640 1 -- 172.21.15.42:0/2249418235 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93b8017070 con 0x7f93c00cd3e0 2024-09-17T01:46:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.621+0000 7f93bcc00640 1 -- 172.21.15.42:0/2249418235 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b8004e30 con 0x7f93c00cd3e0 2024-09-17T01:46:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.621+0000 7f93c7c00640 1 -- 172.21.15.42:0/2249418235 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93c01f9d80 con 0x7f93c00cd3e0 2024-09-17T01:46:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.621+0000 7f93c7c00640 1 -- 172.21.15.42:0/2249418235 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93c01f92a0 con 0x7f93c00cd3e0 2024-09-17T01:46:22.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.622+0000 7f93c7c00640 1 -- 172.21.15.42:0/2249418235 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93c0073b30 con 0x7f93c00cd3e0 2024-09-17T01:46:22.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.623+0000 7f93bcc00640 1 -- 172.21.15.42:0/2249418235 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f93b800d900 con 0x7f93c00cd3e0 2024-09-17T01:46:22.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.624+0000 7f93bcc00640 1 --2- 172.21.15.42:0/2249418235 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f93a0078bc0 0x7f93a007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:22.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.625+0000 7f93bcc00640 1 -- 172.21.15.42:0/2249418235 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7f93b809af00 con 0x7f93c00cd3e0 2024-09-17T01:46:22.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.625+0000 7f93c5200640 1 --2- 172.21.15.42:0/2249418235 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f93a0078bc0 0x7f93a007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:22.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.626+0000 7f93c5200640 1 --2- 172.21.15.42:0/2249418235 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f93a0078bc0 0x7f93a007b0d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f93b4033000 tx=0x7f93b402d070 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:22.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.629+0000 7f93bcc00640 1 -- 172.21.15.42:0/2249418235 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f93c00cd7f0 con 0x7f93c00cd3e0 2024-09-17T01:46:22.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.823+0000 7f93c7c00640 1 -- 172.21.15.42:0/2249418235 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93c00ac300 con 0x7f93c00cd3e0 2024-09-17T01:46:22.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.824+0000 7f93bcc00640 1 -- 172.21.15.42:0/2249418235 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) ==== 74+0+12994 (secure 0 0 0) 0x7f93b8062fe0 con 0x7f93c00cd3e0 2024-09-17T01:46:22.822 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:46:22.822 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":179,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:46:20.343740+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6835/2353432649":"2024-09-18T01:46:17.336848+0000","172.21.15.42:6834/2353432649":"2024-09-18T01:46:17.336848+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:46:22.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.826+0000 7f93c7c00640 1 -- 172.21.15.42:0/2249418235 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f93a0078bc0 msgr2=0x7f93a007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:22.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.826+0000 7f93c7c00640 1 --2- 172.21.15.42:0/2249418235 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f93a0078bc0 0x7f93a007b0d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f93b4033000 tx=0x7f93b402d070 comp rx=0 tx=0).stop 2024-09-17T01:46:22.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.826+0000 7f93c7c00640 1 -- 172.21.15.42:0/2249418235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93c00cd3e0 msgr2=0x7f93c00cae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:22.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.826+0000 7f93c7c00640 1 --2- 172.21.15.42:0/2249418235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93c00cd3e0 0x7f93c00cae80 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7f93b8005fd0 tx=0x7f93b800fe60 comp rx=0 tx=0).stop 2024-09-17T01:46:22.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.826+0000 7f93c7c00640 1 -- 172.21.15.42:0/2249418235 shutdown_connections 2024-09-17T01:46:22.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.826+0000 7f93c7c00640 1 --2- 172.21.15.42:0/2249418235 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f93a0078bc0 0x7f93a007b0d0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:22.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.826+0000 7f93c7c00640 1 --2- 172.21.15.42:0/2249418235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93c00cd3e0 0x7f93c00cae80 unknown :-1 s=CLOSED pgs=2091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:22.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.826+0000 7f93c7c00640 1 --2- 172.21.15.42:0/2249418235 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f93c0149c90 0x7f93c00ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:22.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.826+0000 7f93c7c00640 1 --2- 172.21.15.42:0/2249418235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93a8003c10 0x7f93c00abc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:22.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.826+0000 7f93c7c00640 1 -- 172.21.15.42:0/2249418235 >> 172.21.15.42:0/2249418235 conn(0x7f93c00b2930 msgr2=0x7f93c00b51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:22.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.826+0000 7f93c7c00640 1 -- 172.21.15.42:0/2249418235 shutdown_connections 2024-09-17T01:46:22.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:22.826+0000 7f93c7c00640 1 -- 172.21.15.42:0/2249418235 wait complete. 2024-09-17T01:46:22.848 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T01:31:55.004951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T01:46:22.848 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T01:46:23.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.081+0000 7f297e600640 1 -- 172.21.15.42:0/1806716887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2978160630 msgr2=0x7f297815cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:23.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.081+0000 7f297e600640 1 --2- 172.21.15.42:0/1806716887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2978160630 0x7f297815cb00 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f29780b4d30 tx=0x7f297002a980 comp rx=0 tx=0).stop 2024-09-17T01:46:23.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.081+0000 7f297e600640 1 -- 172.21.15.42:0/1806716887 shutdown_connections 2024-09-17T01:46:23.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.081+0000 7f297e600640 1 --2- 172.21.15.42:0/1806716887 >> v2:172.21.15.43:3300/0 conn(0x7f2978074b20 0x7f29781600f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:23.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.081+0000 7f297e600640 1 --2- 172.21.15.42:0/1806716887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2978160630 0x7f297815cb00 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:23.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.081+0000 7f297e600640 1 --2- 172.21.15.42:0/1806716887 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2978156ba0 0x7f29780745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:23.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.081+0000 7f297e600640 1 -- 172.21.15.42:0/1806716887 >> 172.21.15.42:0/1806716887 conn(0x7f29780b27a0 msgr2=0x7f29780d0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:23.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.081+0000 7f297e600640 1 -- 172.21.15.42:0/1806716887 shutdown_connections 2024-09-17T01:46:23.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.081+0000 7f297e600640 1 -- 172.21.15.42:0/1806716887 wait complete. 2024-09-17T01:46:23.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.084+0000 7f297e600640 1 Processor -- start 2024-09-17T01:46:23.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.084+0000 7f297e600640 1 -- start start 2024-09-17T01:46:23.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.085+0000 7f297e600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2978074b20 0x7f29780cd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:23.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.085+0000 7f297e600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2978156ba0 0x7f29780cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:23.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.085+0000 7f297e600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2978160630 0x7f29780ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:23.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.085+0000 7f297e600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f297815d040 con 0x7f2978074b20 2024-09-17T01:46:23.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.085+0000 7f297e600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f297815de20 con 0x7f2978160630 2024-09-17T01:46:23.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.085+0000 7f297e600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f297815d1c0 con 0x7f2978156ba0 2024-09-17T01:46:23.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.085+0000 7f297d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2978074b20 0x7f29780cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:23.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.085+0000 7f297d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2978074b20 0x7f29780cd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48358/0 (socket says 172.21.15.42:48358) 2024-09-17T01:46:23.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.085+0000 7f297d200640 1 -- 172.21.15.42:0/536927772 learned_addr learned my addr 172.21.15.42:0/536927772 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:23.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.086+0000 7f297d200640 1 -- 172.21.15.42:0/536927772 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2978156ba0 msgr2=0x7f29780cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:23.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.086+0000 7f297d200640 1 --2- 172.21.15.42:0/536927772 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2978156ba0 0x7f29780cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:23.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.086+0000 7f297d200640 1 -- 172.21.15.42:0/536927772 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2978160630 msgr2=0x7f29780ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:23.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.086+0000 7f297dc00640 1 --2- 172.21.15.42:0/536927772 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2978160630 0x7f29780ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:23.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.086+0000 7f297d200640 1 --2- 172.21.15.42:0/536927772 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2978160630 0x7f29780ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:23.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.086+0000 7f297d200640 1 -- 172.21.15.42:0/536927772 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29780cea20 con 0x7f2978074b20 2024-09-17T01:46:23.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.086+0000 7f297d200640 1 --2- 172.21.15.42:0/536927772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2978074b20 0x7f29780cd970 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f296c00e7f0 tx=0x7f296c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:23.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.086+0000 7f2974c00640 1 -- 172.21.15.42:0/536927772 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f296c00ccc0 con 0x7f2978074b20 2024-09-17T01:46:23.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.087+0000 7f2974c00640 1 -- 172.21.15.42:0/536927772 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f296c00ce80 con 0x7f2978074b20 2024-09-17T01:46:23.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.087+0000 7f2974c00640 1 -- 172.21.15.42:0/536927772 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f296c005280 con 0x7f2978074b20 2024-09-17T01:46:23.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.087+0000 7f297e600640 1 -- 172.21.15.42:0/536927772 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29780ced00 con 0x7f2978074b20 2024-09-17T01:46:23.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.087+0000 7f297e600640 1 -- 172.21.15.42:0/536927772 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29780cf2c0 con 0x7f2978074b20 2024-09-17T01:46:23.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.088+0000 7f297e600640 1 -- 172.21.15.42:0/536927772 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f297815d670 con 0x7f2978074b20 2024-09-17T01:46:23.087 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.089+0000 7f2974c00640 1 -- 172.21.15.42:0/536927772 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f296c005420 con 0x7f2978074b20 2024-09-17T01:46:23.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.091+0000 7f2974c00640 1 --2- 172.21.15.42:0/536927772 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2958078b90 0x7f295807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:23.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.091+0000 7f2974c00640 1 -- 172.21.15.42:0/536927772 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7f296c09b430 con 0x7f2978074b20 2024-09-17T01:46:23.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.091+0000 7f2977e00640 1 --2- 172.21.15.42:0/536927772 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2958078b90 0x7f295807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:23.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.092+0000 7f2977e00640 1 --2- 172.21.15.42:0/536927772 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2958078b90 0x7f295807b0a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f29780b4c80 tx=0x7f2964005db0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:23.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.095+0000 7f2974c00640 1 -- 172.21.15.42:0/536927772 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f296c063ae0 con 0x7f2978074b20 2024-09-17T01:46:23.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.289+0000 7f297e600640 1 -- 172.21.15.42:0/536927772 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2978156190 con 0x7f2978074b20 2024-09-17T01:46:23.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.290+0000 7f2974c00640 1 -- 172.21.15.42:0/536927772 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v179) ==== 93+0+10 (secure 0 0 0) 0x7f296c06c020 con 0x7f2978074b20 2024-09-17T01:46:23.288 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-09-17T01:46:23.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.292+0000 7f297e600640 1 -- 172.21.15.42:0/536927772 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2958078b90 msgr2=0x7f295807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:23.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.292+0000 7f297e600640 1 --2- 172.21.15.42:0/536927772 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2958078b90 0x7f295807b0a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f29780b4c80 tx=0x7f2964005db0 comp rx=0 tx=0).stop 2024-09-17T01:46:23.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.292+0000 7f297e600640 1 -- 172.21.15.42:0/536927772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2978074b20 msgr2=0x7f29780cd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:23.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.292+0000 7f297e600640 1 --2- 172.21.15.42:0/536927772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2978074b20 0x7f29780cd970 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f296c00e7f0 tx=0x7f296c00ecb0 comp rx=0 tx=0).stop 2024-09-17T01:46:23.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.292+0000 7f297e600640 1 -- 172.21.15.42:0/536927772 shutdown_connections 2024-09-17T01:46:23.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.292+0000 7f297e600640 1 --2- 172.21.15.42:0/536927772 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2958078b90 0x7f295807b0a0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:23.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.292+0000 7f297e600640 1 --2- 172.21.15.42:0/536927772 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2978160630 0x7f29780ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:23.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.292+0000 7f297e600640 1 --2- 172.21.15.42:0/536927772 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2978156ba0 0x7f29780cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:23.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.292+0000 7f297e600640 1 --2- 172.21.15.42:0/536927772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2978074b20 0x7f29780cd970 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:23.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.292+0000 7f297e600640 1 -- 172.21.15.42:0/536927772 >> 172.21.15.42:0/536927772 conn(0x7f29780b27a0 msgr2=0x7f29780ad6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:23.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.292+0000 7f297e600640 1 -- 172.21.15.42:0/536927772 shutdown_connections 2024-09-17T01:46:23.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.292+0000 7f297e600640 1 -- 172.21.15.42:0/536927772 wait complete. 2024-09-17T01:46:23.313 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2024-09-17T01:46:23.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.544+0000 7fd8d7800640 1 -- 172.21.15.42:0/2120051437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8d00cec40 msgr2=0x7fd8d00cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:23.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.544+0000 7fd8d7800640 1 --2- 172.21.15.42:0/2120051437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8d00cec40 0x7fd8d00cf050 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8005fd0 tx=0x7fd8c802aa10 comp rx=0 tx=0).stop 2024-09-17T01:46:23.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.545+0000 7fd8d7800640 1 -- 172.21.15.42:0/2120051437 shutdown_connections 2024-09-17T01:46:23.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.545+0000 7fd8d7800640 1 --2- 172.21.15.42:0/2120051437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8d00cec40 0x7fd8d00cf050 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:23.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.545+0000 7fd8d7800640 1 --2- 172.21.15.42:0/2120051437 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd8d00b3550 0x7fd8d015cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:23.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.545+0000 7fd8d7800640 1 -- 172.21.15.42:0/2120051437 >> 172.21.15.42:0/2120051437 conn(0x7fd8d00b2930 msgr2=0x7fd8d006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:23.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.545+0000 7fd8d7800640 1 -- 172.21.15.42:0/2120051437 shutdown_connections 2024-09-17T01:46:23.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.545+0000 7fd8d7800640 1 -- 172.21.15.42:0/2120051437 wait complete. 2024-09-17T01:46:23.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.547+0000 7fd8d7800640 1 Processor -- start 2024-09-17T01:46:23.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.547+0000 7fd8d7800640 1 -- start start 2024-09-17T01:46:23.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.548+0000 7fd8d7800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd8d00b3550 0x7fd8d01f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:23.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.548+0000 7fd8d7800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8d00cec40 0x7fd8d01f6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:23.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.548+0000 7fd8d7800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8d0142f40 0x7fd8d00ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:23.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.548+0000 7fd8d7800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d006d7c0 con 0x7fd8d0142f40 2024-09-17T01:46:23.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.548+0000 7fd8d7800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d006d640 con 0x7fd8d00cec40 2024-09-17T01:46:23.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.548+0000 7fd8d7800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd8d006d940 con 0x7fd8d00b3550 2024-09-17T01:46:23.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.549+0000 7fd8d5800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8d0142f40 0x7fd8d00ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:23.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.549+0000 7fd8d5800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8d0142f40 0x7fd8d00ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48386/0 (socket says 172.21.15.42:48386) 2024-09-17T01:46:23.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.549+0000 7fd8d5800640 1 -- 172.21.15.42:0/140845067 learned_addr learned my addr 172.21.15.42:0/140845067 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:23.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.549+0000 7fd8d4e00640 1 --2- 172.21.15.42:0/140845067 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd8d00b3550 0x7fd8d01f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:23.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.549+0000 7fd8cfe00640 1 --2- 172.21.15.42:0/140845067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8d00cec40 0x7fd8d01f6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:23.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.549+0000 7fd8d5800640 1 -- 172.21.15.42:0/140845067 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd8d00b3550 msgr2=0x7fd8d01f5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:23.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.549+0000 7fd8d5800640 1 --2- 172.21.15.42:0/140845067 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd8d00b3550 0x7fd8d01f5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:23.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.549+0000 7fd8d5800640 1 -- 172.21.15.42:0/140845067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8d00cec40 msgr2=0x7fd8d01f6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:23.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.549+0000 7fd8d5800640 1 --2- 172.21.15.42:0/140845067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8d00cec40 0x7fd8d01f6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:23.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.549+0000 7fd8d5800640 1 -- 172.21.15.42:0/140845067 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d01f6a70 con 0x7fd8d0142f40 2024-09-17T01:46:23.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.550+0000 7fd8d5800640 1 --2- 172.21.15.42:0/140845067 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8d0142f40 0x7fd8d00ae8d0 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8009d90 tx=0x7fd8c8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:23.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.550+0000 7fd8ccc00640 1 -- 172.21.15.42:0/140845067 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8033050 con 0x7fd8d0142f40 2024-09-17T01:46:23.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.550+0000 7fd8ccc00640 1 -- 172.21.15.42:0/140845067 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8c8004450 con 0x7fd8d0142f40 2024-09-17T01:46:23.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.550+0000 7fd8ccc00640 1 -- 172.21.15.42:0/140845067 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8004860 con 0x7fd8d0142f40 2024-09-17T01:46:23.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.550+0000 7fd8d7800640 1 -- 172.21.15.42:0/140845067 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d006e930 con 0x7fd8d0142f40 2024-09-17T01:46:23.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.550+0000 7fd8d7800640 1 -- 172.21.15.42:0/140845067 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d006eef0 con 0x7fd8d0142f40 2024-09-17T01:46:23.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.551+0000 7fd8d7800640 1 -- 172.21.15.42:0/140845067 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8d006e6a0 con 0x7fd8d0142f40 2024-09-17T01:46:23.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.552+0000 7fd8ccc00640 1 -- 172.21.15.42:0/140845067 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd8c8036070 con 0x7fd8d0142f40 2024-09-17T01:46:23.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.553+0000 7fd8ccc00640 1 --2- 172.21.15.42:0/140845067 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd8b0078b90 0x7fd8b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:23.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.553+0000 7fd8ccc00640 1 -- 172.21.15.42:0/140845067 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7fd8c80bbca0 con 0x7fd8d0142f40 2024-09-17T01:46:23.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.554+0000 7fd8d4e00640 1 --2- 172.21.15.42:0/140845067 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd8b0078b90 0x7fd8b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:23.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.555+0000 7fd8d4e00640 1 --2- 172.21.15.42:0/140845067 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd8b0078b90 0x7fd8b007b0a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4009b30 tx=0x7fd8c4005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:23.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.558+0000 7fd8ccc00640 1 -- 172.21.15.42:0/140845067 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd8d01f6a70 con 0x7fd8d0142f40 2024-09-17T01:46:23.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:23.828+0000 7fd8d7800640 1 -- 172.21.15.42:0/140845067 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) -- 0x7fd8d015cec0 con 0x7fd8d0142f40 2024-09-17T01:46:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.365+0000 7fd8ccc00640 1 -- 172.21.15.42:0/140845067 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v677) ==== 143+0+0 (secure 0 0 0) 0x7fd8c8083d80 con 0x7fd8d0142f40 2024-09-17T01:46:24.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.368+0000 7fd8d7800640 1 -- 172.21.15.42:0/140845067 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd8b0078b90 msgr2=0x7fd8b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:24.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.368+0000 7fd8d7800640 1 --2- 172.21.15.42:0/140845067 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd8b0078b90 0x7fd8b007b0a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4009b30 tx=0x7fd8c4005f90 comp rx=0 tx=0).stop 2024-09-17T01:46:24.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.368+0000 7fd8d7800640 1 -- 172.21.15.42:0/140845067 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8d0142f40 msgr2=0x7fd8d00ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:24.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.368+0000 7fd8d7800640 1 --2- 172.21.15.42:0/140845067 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8d0142f40 0x7fd8d00ae8d0 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8009d90 tx=0x7fd8c8003f10 comp rx=0 tx=0).stop 2024-09-17T01:46:24.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.368+0000 7fd8d7800640 1 -- 172.21.15.42:0/140845067 shutdown_connections 2024-09-17T01:46:24.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.368+0000 7fd8d7800640 1 --2- 172.21.15.42:0/140845067 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd8b0078b90 0x7fd8b007b0a0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:24.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.368+0000 7fd8d7800640 1 --2- 172.21.15.42:0/140845067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8d00cec40 0x7fd8d01f6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:24.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.368+0000 7fd8d7800640 1 --2- 172.21.15.42:0/140845067 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8d0142f40 0x7fd8d00ae8d0 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:24.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.368+0000 7fd8d7800640 1 --2- 172.21.15.42:0/140845067 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd8d00b3550 0x7fd8d01f5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:24.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.368+0000 7fd8d7800640 1 -- 172.21.15.42:0/140845067 >> 172.21.15.42:0/140845067 conn(0x7fd8d00b2930 msgr2=0x7fd8d0072950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:24.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.369+0000 7fd8d7800640 1 -- 172.21.15.42:0/140845067 shutdown_connections 2024-09-17T01:46:24.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.369+0000 7fd8d7800640 1 -- 172.21.15.42:0/140845067 wait complete. 2024-09-17T01:46:24.397 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T01:46:24.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.630+0000 7f33a5c00640 1 -- 172.21.15.42:0/1667853780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33a00cfd80 msgr2=0x7f33a00d2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:24.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.630+0000 7f33a5c00640 1 --2- 172.21.15.42:0/1667853780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33a00cfd80 0x7f33a00d2fc0 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7f3398005fd0 tx=0x7f339802aa10 comp rx=0 tx=0).stop 2024-09-17T01:46:24.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.630+0000 7f33a5c00640 1 -- 172.21.15.42:0/1667853780 shutdown_connections 2024-09-17T01:46:24.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.630+0000 7f33a5c00640 1 --2- 172.21.15.42:0/1667853780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33a00cfd80 0x7f33a00d2fc0 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:24.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.630+0000 7f33a5c00640 1 --2- 172.21.15.42:0/1667853780 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f33a0162520 0x7f33a00cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:24.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.630+0000 7f33a5c00640 1 -- 172.21.15.42:0/1667853780 >> 172.21.15.42:0/1667853780 conn(0x7f33a0073f20 msgr2=0x7f33a006cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:24.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.630+0000 7f33a5c00640 1 -- 172.21.15.42:0/1667853780 shutdown_connections 2024-09-17T01:46:24.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.630+0000 7f33a5c00640 1 -- 172.21.15.42:0/1667853780 wait complete. 2024-09-17T01:46:24.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.632+0000 7f33a5c00640 1 Processor -- start 2024-09-17T01:46:24.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.632+0000 7f33a5c00640 1 -- start start 2024-09-17T01:46:24.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.634+0000 7f33a5c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33a00cfd80 0x7f33a00ce000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:24.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.634+0000 7f33a5c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33a015fbe0 0x7f33a01f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:24.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.634+0000 7f33a5c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f33a0162520 0x7f33a0150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:24.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.634+0000 7f33a5c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f33a00d0d00 con 0x7f33a00cfd80 2024-09-17T01:46:24.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.634+0000 7f33a5c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f33a00d3900 con 0x7f33a015fbe0 2024-09-17T01:46:24.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.634+0000 7f33a5c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f33a00d0e80 con 0x7f33a0162520 2024-09-17T01:46:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.634+0000 7f339fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33a00cfd80 0x7f33a00ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.634+0000 7f339fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33a00cfd80 0x7f33a00ce000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48396/0 (socket says 172.21.15.42:48396) 2024-09-17T01:46:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.634+0000 7f339fe00640 1 -- 172.21.15.42:0/2695201177 learned_addr learned my addr 172.21.15.42:0/2695201177 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.634+0000 7f33a5200640 1 --2- 172.21.15.42:0/2695201177 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f33a0162520 0x7f33a0150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.634+0000 7f3397e00640 1 --2- 172.21.15.42:0/2695201177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33a015fbe0 0x7f33a01f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.634+0000 7f339fe00640 1 -- 172.21.15.42:0/2695201177 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f33a0162520 msgr2=0x7f33a0150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.634+0000 7f339fe00640 1 --2- 172.21.15.42:0/2695201177 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f33a0162520 0x7f33a0150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.634+0000 7f339fe00640 1 -- 172.21.15.42:0/2695201177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33a015fbe0 msgr2=0x7f33a01f56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.634+0000 7f339fe00640 1 --2- 172.21.15.42:0/2695201177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33a015fbe0 0x7f33a01f56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.634+0000 7f339fe00640 1 -- 172.21.15.42:0/2695201177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a00b52e0 con 0x7f33a00cfd80 2024-09-17T01:46:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.634+0000 7f33a5200640 1 --2- 172.21.15.42:0/2695201177 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f33a0162520 0x7f33a0150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:24.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.634+0000 7f3397e00640 1 --2- 172.21.15.42:0/2695201177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33a015fbe0 0x7f33a01f56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:24.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.635+0000 7f339fe00640 1 --2- 172.21.15.42:0/2695201177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33a00cfd80 0x7f33a00ce000 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f339000c3d0 tx=0x7f339000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:24.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.635+0000 7f339cc00640 1 -- 172.21.15.42:0/2695201177 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3390017070 con 0x7f33a00cfd80 2024-09-17T01:46:24.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.635+0000 7f339cc00640 1 -- 172.21.15.42:0/2695201177 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33900053c0 con 0x7f33a00cfd80 2024-09-17T01:46:24.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.635+0000 7f33a5c00640 1 -- 172.21.15.42:0/2695201177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a00b5580 con 0x7f33a00cfd80 2024-09-17T01:46:24.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.635+0000 7f339cc00640 1 -- 172.21.15.42:0/2695201177 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3390003850 con 0x7f33a00cfd80 2024-09-17T01:46:24.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.635+0000 7f33a5c00640 1 -- 172.21.15.42:0/2695201177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a00b5b40 con 0x7f33a00cfd80 2024-09-17T01:46:24.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.636+0000 7f33a5c00640 1 -- 172.21.15.42:0/2695201177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a006d130 con 0x7f33a00cfd80 2024-09-17T01:46:24.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.638+0000 7f339cc00640 1 -- 172.21.15.42:0/2695201177 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f339001a070 con 0x7f33a00cfd80 2024-09-17T01:46:24.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.638+0000 7f339cc00640 1 --2- 172.21.15.42:0/2695201177 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f337c078b90 0x7f337c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:24.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.639+0000 7f339cc00640 1 -- 172.21.15.42:0/2695201177 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7f3390099dc0 con 0x7f33a00cfd80 2024-09-17T01:46:24.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.639+0000 7f3397e00640 1 --2- 172.21.15.42:0/2695201177 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f337c078b90 0x7f337c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:24.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.640+0000 7f3397e00640 1 --2- 172.21.15.42:0/2695201177 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f337c078b90 0x7f337c07b0a0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f33a00cbb40 tx=0x7f3388005ef0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:24.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.643+0000 7f339cc00640 1 -- 172.21.15.42:0/2695201177 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f33900624f0 con 0x7f33a00cfd80 2024-09-17T01:46:24.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.839+0000 7f33a5c00640 1 -- 172.21.15.42:0/2695201177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f33a0150ec0 con 0x7f33a00cfd80 2024-09-17T01:46:24.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.840+0000 7f339cc00640 1 -- 172.21.15.42:0/2695201177 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v61) ==== 59+0+2294 (secure 0 0 0) 0x7f3390061df0 con 0x7f33a00cfd80 2024-09-17T01:46:24.838 INFO:teuthology.orchestra.run.smithi042.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T01:46:24.838 INFO:teuthology.orchestra.run.smithi042.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T01:46:24.838 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced client_mount_timeout 30 2024-09-17T01:46:24.838 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_client 20/20 2024-09-17T01:46:24.838 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_mgr 20/20 2024-09-17T01:46:24.838 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_ms 1/1 2024-09-17T01:46:24.838 INFO:teuthology.orchestra.run.smithi042.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T01:46:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T01:46:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3683.959260 2024-09-17T01:46:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4350.010833 2024-09-17T01:46:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4316.776055 2024-09-17T01:46:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3885.595082 2024-09-17T01:46:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3602.000737 2024-09-17T01:46:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4883.364748 2024-09-17T01:46:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3752.484811 2024-09-17T01:46:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3775.035963 2024-09-17T01:46:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds 20/20 2024-09-17T01:46:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T01:46:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_ms 2/2 2024-09-17T01:46:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_frag true 2024-09-17T01:46:24.840 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_scatterstat true 2024-09-17T01:46:24.840 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T01:46:24.840 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_verify_scatter true 2024-09-17T01:46:24.840 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T01:46:24.840 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T01:46:24.840 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T01:46:24.840 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced client_mount_timeout 600 2024-09-17T01:46:24.840 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_client 20/20 2024-09-17T01:46:24.840 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_ms 1/1 2024-09-17T01:46:24.840 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T01:46:24.840 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T01:46:24.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.842+0000 7f33a5c00640 1 -- 172.21.15.42:0/2695201177 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f337c078b90 msgr2=0x7f337c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:24.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.842+0000 7f33a5c00640 1 --2- 172.21.15.42:0/2695201177 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f337c078b90 0x7f337c07b0a0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f33a00cbb40 tx=0x7f3388005ef0 comp rx=0 tx=0).stop 2024-09-17T01:46:24.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.842+0000 7f33a5c00640 1 -- 172.21.15.42:0/2695201177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33a00cfd80 msgr2=0x7f33a00ce000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:24.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.842+0000 7f33a5c00640 1 --2- 172.21.15.42:0/2695201177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33a00cfd80 0x7f33a00ce000 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f339000c3d0 tx=0x7f339000c890 comp rx=0 tx=0).stop 2024-09-17T01:46:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.842+0000 7f33a5c00640 1 -- 172.21.15.42:0/2695201177 shutdown_connections 2024-09-17T01:46:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.842+0000 7f33a5c00640 1 --2- 172.21.15.42:0/2695201177 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f337c078b90 0x7f337c07b0a0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.842+0000 7f33a5c00640 1 --2- 172.21.15.42:0/2695201177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33a015fbe0 0x7f33a01f56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.842+0000 7f33a5c00640 1 --2- 172.21.15.42:0/2695201177 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f33a0162520 0x7f33a0150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.842+0000 7f33a5c00640 1 --2- 172.21.15.42:0/2695201177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f33a00cfd80 0x7f33a00ce000 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.842+0000 7f33a5c00640 1 -- 172.21.15.42:0/2695201177 >> 172.21.15.42:0/2695201177 conn(0x7f33a0073f20 msgr2=0x7f33a00b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.842+0000 7f33a5c00640 1 -- 172.21.15.42:0/2695201177 shutdown_connections 2024-09-17T01:46:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:24.842+0000 7f33a5c00640 1 -- 172.21.15.42:0/2695201177 wait complete. 2024-09-17T01:46:24.868 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T01:46:25.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.101+0000 7f2df6200640 1 -- 172.21.15.42:0/3262259349 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dd4003a00 msgr2=0x7f2dd4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:25.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.101+0000 7f2df6200640 1 --2- 172.21.15.42:0/3262259349 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dd4003a00 0x7f2dd4003e70 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009d20 tx=0x7f2dd4005830 comp rx=0 tx=0).stop 2024-09-17T01:46:25.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.101+0000 7f2defe00640 1 -- 172.21.15.42:0/3262259349 reap_dead start 2024-09-17T01:46:25.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.102+0000 7f2df6200640 1 -- 172.21.15.42:0/3262259349 shutdown_connections 2024-09-17T01:46:25.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.102+0000 7f2df6200640 1 -- 172.21.15.42:0/3262259349 >> 172.21.15.42:0/3262259349 conn(0x7f2df00b2930 msgr2=0x7f2df006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:25.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.102+0000 7f2df6200640 1 -- 172.21.15.42:0/3262259349 shutdown_connections 2024-09-17T01:46:25.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.102+0000 7f2df6200640 1 -- 172.21.15.42:0/3262259349 wait complete. 2024-09-17T01:46:25.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.104+0000 7f2df6200640 1 Processor -- start 2024-09-17T01:46:25.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.104+0000 7f2df6200640 1 -- start start 2024-09-17T01:46:25.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.105+0000 7f2df6200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dd4003a00 0x7f2df0144630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:25.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.105+0000 7f2df6200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2df0152a60 0x7f2df01f8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:25.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.105+0000 7f2df6200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2df01f9390 0x7f2df01f97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:25.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.106+0000 7f2df6200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2df0072440 con 0x7f2dd4003a00 2024-09-17T01:46:25.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.106+0000 7f2df6200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2df01571a0 con 0x7f2df0152a60 2024-09-17T01:46:25.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.106+0000 7f2df6200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2df00725c0 con 0x7f2df01f9390 2024-09-17T01:46:25.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.106+0000 7f2def400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dd4003a00 0x7f2df0144630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:25.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.106+0000 7f2def400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dd4003a00 0x7f2df0144630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48408/0 (socket says 172.21.15.42:48408) 2024-09-17T01:46:25.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.106+0000 7f2def400640 1 -- 172.21.15.42:0/420191885 learned_addr learned my addr 172.21.15.42:0/420191885 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:25.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.106+0000 7f2de7e00640 1 --2- 172.21.15.42:0/420191885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2df0152a60 0x7f2df01f8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:25.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.106+0000 7f2defe00640 1 --2- 172.21.15.42:0/420191885 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2df01f9390 0x7f2df01f97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:25.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.106+0000 7f2def400640 1 -- 172.21.15.42:0/420191885 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2df01f9390 msgr2=0x7f2df01f97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:25.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.106+0000 7f2def400640 1 --2- 172.21.15.42:0/420191885 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2df01f9390 0x7f2df01f97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:25.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.106+0000 7f2def400640 1 -- 172.21.15.42:0/420191885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2df0152a60 msgr2=0x7f2df01f8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:25.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.106+0000 7f2def400640 1 --2- 172.21.15.42:0/420191885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2df0152a60 0x7f2df01f8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:25.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.106+0000 7f2def400640 1 -- 172.21.15.42:0/420191885 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df0144b70 con 0x7f2dd4003a00 2024-09-17T01:46:25.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.106+0000 7f2de7e00640 1 --2- 172.21.15.42:0/420191885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2df0152a60 0x7f2df01f8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:25.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.107+0000 7f2def400640 1 --2- 172.21.15.42:0/420191885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dd4003a00 0x7f2df0144630 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009e10 tx=0x7f2de0003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:25.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.107+0000 7f2de7400640 1 -- 172.21.15.42:0/420191885 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de0041070 con 0x7f2dd4003a00 2024-09-17T01:46:25.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.107+0000 7f2de7400640 1 -- 172.21.15.42:0/420191885 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2de002be30 con 0x7f2dd4003a00 2024-09-17T01:46:25.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.107+0000 7f2de7400640 1 -- 172.21.15.42:0/420191885 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de0003d10 con 0x7f2dd4003a00 2024-09-17T01:46:25.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.107+0000 7f2df6200640 1 -- 172.21.15.42:0/420191885 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2df0154f90 con 0x7f2dd4003a00 2024-09-17T01:46:25.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.107+0000 7f2df6200640 1 -- 172.21.15.42:0/420191885 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2df0155550 con 0x7f2dd4003a00 2024-09-17T01:46:25.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.108+0000 7f2df6200640 1 -- 172.21.15.42:0/420191885 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2df015d950 con 0x7f2dd4003a00 2024-09-17T01:46:25.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.109+0000 7f2de7400640 1 -- 172.21.15.42:0/420191885 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2de0044070 con 0x7f2dd4003a00 2024-09-17T01:46:25.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.110+0000 7f2de7400640 1 --2- 172.21.15.42:0/420191885 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2dcc078b90 0x7f2dcc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:25.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.110+0000 7f2de7400640 1 -- 172.21.15.42:0/420191885 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7f2de00bbd50 con 0x7f2dd4003a00 2024-09-17T01:46:25.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.111+0000 7f2de7e00640 1 --2- 172.21.15.42:0/420191885 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2dcc078b90 0x7f2dcc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:25.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.112+0000 7f2de7e00640 1 --2- 172.21.15.42:0/420191885 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2dcc078b90 0x7f2dcc07b0a0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f2df015cb90 tx=0x7f2dd8005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:25.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.115+0000 7f2de7400640 1 -- 172.21.15.42:0/420191885 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2de0083e30 con 0x7f2dd4003a00 2024-09-17T01:46:25.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.310+0000 7f2df6200640 1 -- 172.21.15.42:0/420191885 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f2df006a170 con 0x7f2dd4003a00 2024-09-17T01:46:25.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.315+0000 7f2de7400640 1 -- 172.21.15.42:0/420191885 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v62)=0 v62) ==== 122+0+0 (secure 0 0 0) 0x7f2de0088860 con 0x7f2dd4003a00 2024-09-17T01:46:25.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.317+0000 7f2df6200640 1 -- 172.21.15.42:0/420191885 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2dcc078b90 msgr2=0x7f2dcc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:25.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.317+0000 7f2df6200640 1 --2- 172.21.15.42:0/420191885 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2dcc078b90 0x7f2dcc07b0a0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f2df015cb90 tx=0x7f2dd8005f90 comp rx=0 tx=0).stop 2024-09-17T01:46:25.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.317+0000 7f2df6200640 1 -- 172.21.15.42:0/420191885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dd4003a00 msgr2=0x7f2df0144630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:25.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.317+0000 7f2df6200640 1 --2- 172.21.15.42:0/420191885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dd4003a00 0x7f2df0144630 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009e10 tx=0x7f2de0003820 comp rx=0 tx=0).stop 2024-09-17T01:46:25.315 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.317+0000 7f2df6200640 1 -- 172.21.15.42:0/420191885 shutdown_connections 2024-09-17T01:46:25.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.317+0000 7f2df6200640 1 --2- 172.21.15.42:0/420191885 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2dcc078b90 0x7f2dcc07b0a0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:25.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.317+0000 7f2df6200640 1 --2- 172.21.15.42:0/420191885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2df0152a60 0x7f2df01f8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:25.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.317+0000 7f2df6200640 1 --2- 172.21.15.42:0/420191885 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2df01f9390 0x7f2df01f97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:25.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.317+0000 7f2df6200640 1 --2- 172.21.15.42:0/420191885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dd4003a00 0x7f2df0144630 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:25.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.317+0000 7f2df6200640 1 -- 172.21.15.42:0/420191885 >> 172.21.15.42:0/420191885 conn(0x7f2df00b2930 msgr2=0x7f2df015ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:25.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.317+0000 7f2df6200640 1 -- 172.21.15.42:0/420191885 shutdown_connections 2024-09-17T01:46:25.316 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.317+0000 7f2df6200640 1 -- 172.21.15.42:0/420191885 wait complete. 2024-09-17T01:46:25.338 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:46:25.339 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:46:25.432 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:46:25.527 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:46:25.527 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:46:25.528 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:46:25.563 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:46:25.564 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:46:25.564 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:46:25.601 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:46:25.601 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:46:25.601 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:46:25.639 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:46:25.639 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:46:25.639 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:46:25.676 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:46:25.677 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T01:46:25.677 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:46:25.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.908+0000 7f8ff3e00640 1 -- 172.21.15.42:0/3869474355 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ff40b4be0 msgr2=0x7f8ff415d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:25.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.908+0000 7f8ff3e00640 1 --2- 172.21.15.42:0/3869474355 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ff40b4be0 0x7f8ff415d6b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4009830 tx=0x7f8fe402a4b0 comp rx=0 tx=0).stop 2024-09-17T01:46:25.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.908+0000 7f8ff3e00640 1 -- 172.21.15.42:0/3869474355 shutdown_connections 2024-09-17T01:46:25.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.908+0000 7f8ff3e00640 1 --2- 172.21.15.42:0/3869474355 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8ff40cf7c0 0x7f8ff406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:25.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.908+0000 7f8ff3e00640 1 --2- 172.21.15.42:0/3869474355 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ff40b4be0 0x7f8ff415d6b0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:25.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.908+0000 7f8ff3e00640 1 -- 172.21.15.42:0/3869474355 >> 172.21.15.42:0/3869474355 conn(0x7f8ff40b25f0 msgr2=0x7f8ff40d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:25.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.909+0000 7f8ff3e00640 1 -- 172.21.15.42:0/3869474355 shutdown_connections 2024-09-17T01:46:25.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.909+0000 7f8ff3e00640 1 -- 172.21.15.42:0/3869474355 wait complete. 2024-09-17T01:46:25.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.911+0000 7f8ff3e00640 1 Processor -- start 2024-09-17T01:46:25.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.911+0000 7f8ff3e00640 1 -- start start 2024-09-17T01:46:25.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.912+0000 7f8ff3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ff406d260 0x7f8ff40749f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:25.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.912+0000 7f8ff3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ff40b4be0 0x7f8ff4149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:25.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.913+0000 7f8ff3e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8ff40cf7c0 0x7f8ff4072a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:25.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.913+0000 7f8ff3e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff4153970 con 0x7f8ff406d260 2024-09-17T01:46:25.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.913+0000 7f8ff3e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff41537f0 con 0x7f8ff40b4be0 2024-09-17T01:46:25.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.913+0000 7f8ff3e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff4153af0 con 0x7f8ff40cf7c0 2024-09-17T01:46:25.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.913+0000 7f8ff2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ff406d260 0x7f8ff40749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:25.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.913+0000 7f8ff2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ff406d260 0x7f8ff40749f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:53966/0 (socket says 172.21.15.42:53966) 2024-09-17T01:46:25.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.913+0000 7f8ff2a00640 1 -- 172.21.15.42:0/909534151 learned_addr learned my addr 172.21.15.42:0/909534151 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:25.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.913+0000 7f8fea000640 1 --2- 172.21.15.42:0/909534151 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ff40b4be0 0x7f8ff4149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:25.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.913+0000 7f8ff3400640 1 --2- 172.21.15.42:0/909534151 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8ff40cf7c0 0x7f8ff4072a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:25.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.913+0000 7f8ff2a00640 1 -- 172.21.15.42:0/909534151 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8ff40cf7c0 msgr2=0x7f8ff4072a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:25.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.913+0000 7f8ff2a00640 1 --2- 172.21.15.42:0/909534151 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8ff40cf7c0 0x7f8ff4072a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:25.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.913+0000 7f8ff2a00640 1 -- 172.21.15.42:0/909534151 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ff40b4be0 msgr2=0x7f8ff4149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:25.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.913+0000 7f8ff2a00640 1 --2- 172.21.15.42:0/909534151 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ff40b4be0 0x7f8ff4149790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:25.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.913+0000 7f8ff2a00640 1 -- 172.21.15.42:0/909534151 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff415e7e0 con 0x7f8ff406d260 2024-09-17T01:46:25.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.914+0000 7f8ff2a00640 1 --2- 172.21.15.42:0/909534151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ff406d260 0x7f8ff40749f0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f8fe402aaa0 tx=0x7f8fe4030650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:25.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.914+0000 7f8febe00640 1 -- 172.21.15.42:0/909534151 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe403f070 con 0x7f8ff406d260 2024-09-17T01:46:25.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.914+0000 7f8febe00640 1 -- 172.21.15.42:0/909534151 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8fe4030d60 con 0x7f8ff406d260 2024-09-17T01:46:25.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.914+0000 7f8febe00640 1 -- 172.21.15.42:0/909534151 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4004280 con 0x7f8ff406d260 2024-09-17T01:46:25.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.914+0000 7f8ff3e00640 1 -- 172.21.15.42:0/909534151 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff415ece0 con 0x7f8ff406d260 2024-09-17T01:46:25.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.914+0000 7f8ff3e00640 1 -- 172.21.15.42:0/909534151 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff415f2a0 con 0x7f8ff406d260 2024-09-17T01:46:25.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.915+0000 7f8ff3e00640 1 -- 172.21.15.42:0/909534151 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ff415d6b0 con 0x7f8ff406d260 2024-09-17T01:46:25.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.916+0000 7f8febe00640 1 -- 172.21.15.42:0/909534151 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8fe40035f0 con 0x7f8ff406d260 2024-09-17T01:46:25.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.917+0000 7f8febe00640 1 --2- 172.21.15.42:0/909534151 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8fd0078b90 0x7f8fd007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:25.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.917+0000 7f8febe00640 1 -- 172.21.15.42:0/909534151 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7f8fe40bbab0 con 0x7f8ff406d260 2024-09-17T01:46:25.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.918+0000 7f8fea000640 1 --2- 172.21.15.42:0/909534151 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8fd0078b90 0x7f8fd007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:25.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.918+0000 7f8fea000640 1 --2- 172.21.15.42:0/909534151 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8fd0078b90 0x7f8fd007b0a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8ff406d1e0 tx=0x7f8fdc005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:25.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:25.922+0000 7f8febe00640 1 -- 172.21.15.42:0/909534151 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8fe4083b00 con 0x7f8ff406d260 2024-09-17T01:46:26.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.154+0000 7f8ff3e00640 1 -- 172.21.15.42:0/909534151 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ff40d0360 con 0x7f8ff406d260 2024-09-17T01:46:26.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.155+0000 7f8febe00640 1 -- 172.21.15.42:0/909534151 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 143 v143) ==== 95+0+3915 (secure 0 0 0) 0x7f8fe4088530 con 0x7f8ff406d260 2024-09-17T01:46:26.153 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:46:26.153 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":143,"btime":"2024-09-17T01:46:18:339214+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8246,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1946373489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1946373489},{"type":"v1","addr":"172.21.15.43:6837","nonce":1946373489}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":134},{"gid":9280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/1948698658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1948698658},{"type":"v1","addr":"172.21.15.43:6835","nonce":1948698658}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":133},{"gid":10278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/378308820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":378308820},{"type":"v1","addr":"172.21.15.42:6833","nonce":378308820}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":143},{"gid":10281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3614923314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":3614923314},{"type":"v1","addr":"172.21.15.42:6835","nonce":3614923314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":143}],"filesystems":[]} 2024-09-17T01:46:26.153 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 143 2024-09-17T01:46:26.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.157+0000 7f8ff3e00640 1 -- 172.21.15.42:0/909534151 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8fd0078b90 msgr2=0x7f8fd007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:26.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.157+0000 7f8ff3e00640 1 --2- 172.21.15.42:0/909534151 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8fd0078b90 0x7f8fd007b0a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8ff406d1e0 tx=0x7f8fdc005f90 comp rx=0 tx=0).stop 2024-09-17T01:46:26.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.157+0000 7f8ff3e00640 1 -- 172.21.15.42:0/909534151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ff406d260 msgr2=0x7f8ff40749f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:26.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.157+0000 7f8ff3e00640 1 --2- 172.21.15.42:0/909534151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ff406d260 0x7f8ff40749f0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f8fe402aaa0 tx=0x7f8fe4030650 comp rx=0 tx=0).stop 2024-09-17T01:46:26.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.157+0000 7f8ff3e00640 1 -- 172.21.15.42:0/909534151 shutdown_connections 2024-09-17T01:46:26.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.157+0000 7f8ff3e00640 1 --2- 172.21.15.42:0/909534151 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8fd0078b90 0x7f8fd007b0a0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.157+0000 7f8ff3e00640 1 --2- 172.21.15.42:0/909534151 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ff40b4be0 0x7f8ff4149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.157+0000 7f8ff3e00640 1 --2- 172.21.15.42:0/909534151 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8ff40cf7c0 0x7f8ff4072a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.157+0000 7f8ff3e00640 1 --2- 172.21.15.42:0/909534151 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ff406d260 0x7f8ff40749f0 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.157+0000 7f8ff3e00640 1 -- 172.21.15.42:0/909534151 >> 172.21.15.42:0/909534151 conn(0x7f8ff40b25f0 msgr2=0x7f8ff40ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:26.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.157+0000 7f8ff3e00640 1 -- 172.21.15.42:0/909534151 shutdown_connections 2024-09-17T01:46:26.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.157+0000 7f8ff3e00640 1 -- 172.21.15.42:0/909534151 wait complete. 2024-09-17T01:46:26.177 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T01:46:26.177 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T01:46:26.178 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T01:46:26.178 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:46:26.178 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T01:46:26.178 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T01:46:26.178 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T01:46:26.178 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:46:26.178 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T01:46:26.179 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T01:46:26.179 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T01:46:26.179 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:46:26.179 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T01:46:26.179 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T01:46:26.179 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T01:46:26.179 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:46:26.203 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T01:46:26.203 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T01:46:26.204 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T01:46:26.204 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T01:46:26.209 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T01:46:26.210 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T01:46:26.210 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T01:46:26.211 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T01:46:26.247 INFO:tasks.ceph.mds.a:Started 2024-09-17T01:46:26.247 DEBUG:teuthology.parallel:result is None 2024-09-17T01:46:26.249 INFO:tasks.ceph.mds.c:Started 2024-09-17T01:46:26.249 DEBUG:teuthology.parallel:result is None 2024-09-17T01:46:26.254 INFO:tasks.ceph.mds.b:Started 2024-09-17T01:46:26.254 DEBUG:teuthology.parallel:result is None 2024-09-17T01:46:26.256 INFO:tasks.ceph.mds.d:Started 2024-09-17T01:46:26.256 DEBUG:teuthology.parallel:result is None 2024-09-17T01:46:26.256 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T01:46:26.446 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:46:26.446 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:46:26.460 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-09-17T01:46:26.461 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-09-17T01:46:26.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.499+0000 7fb55b200640 1 -- 172.21.15.42:0/1570637994 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb540003a50 msgr2=0x7fb540003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:26.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.499+0000 7fb55b200640 1 --2- 172.21.15.42:0/1570637994 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb540003a50 0x7fb540003ec0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0016c0 tx=0x7fb540005830 comp rx=0 tx=0).stop 2024-09-17T01:46:26.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.499+0000 7fb55b200640 1 -- 172.21.15.42:0/1570637994 shutdown_connections 2024-09-17T01:46:26.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.499+0000 7fb55b200640 1 --2- 172.21.15.42:0/1570637994 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb540003a50 0x7fb540003ec0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.499+0000 7fb55b200640 1 -- 172.21.15.42:0/1570637994 >> 172.21.15.42:0/1570637994 conn(0x7fb55c0b25f0 msgr2=0x7fb55c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:26.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.499+0000 7fb55b200640 1 -- 172.21.15.42:0/1570637994 shutdown_connections 2024-09-17T01:46:26.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.499+0000 7fb55b200640 1 -- 172.21.15.42:0/1570637994 wait complete. 2024-09-17T01:46:26.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.502+0000 7fb55b200640 1 Processor -- start 2024-09-17T01:46:26.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.502+0000 7fb55b200640 1 -- start start 2024-09-17T01:46:26.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.503+0000 7fb55b200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb540003a50 0x7fb55c150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:26.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.503+0000 7fb55b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb55c0ae200 0x7fb55c0ae610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:26.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.503+0000 7fb55b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb55c140930 0x7fb55c140d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:26.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.503+0000 7fb55b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c15dbd0 con 0x7fb55c0ae200 2024-09-17T01:46:26.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.503+0000 7fb55b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c15da50 con 0x7fb55c140930 2024-09-17T01:46:26.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.503+0000 7fb55b200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb55c06cd20 con 0x7fb540003a50 2024-09-17T01:46:26.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.504+0000 7fb551400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb55c0ae200 0x7fb55c0ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:26.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.504+0000 7fb551400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb55c0ae200 0x7fb55c0ae610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54032/0 (socket says 172.21.15.42:54032) 2024-09-17T01:46:26.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.504+0000 7fb551400640 1 -- 172.21.15.42:0/2092720100 learned_addr learned my addr 172.21.15.42:0/2092720100 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:26.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.504+0000 7fb55a800640 1 --2- 172.21.15.42:0/2092720100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb55c140930 0x7fb55c140d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:26.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.504+0000 7fb551400640 1 -- 172.21.15.42:0/2092720100 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb540003a50 msgr2=0x7fb55c150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:26.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.504+0000 7fb559e00640 1 --2- 172.21.15.42:0/2092720100 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb540003a50 0x7fb55c150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:26.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.504+0000 7fb551400640 1 --2- 172.21.15.42:0/2092720100 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb540003a50 0x7fb55c150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.504+0000 7fb551400640 1 -- 172.21.15.42:0/2092720100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb55c140930 msgr2=0x7fb55c140d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:26.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.504+0000 7fb551400640 1 --2- 172.21.15.42:0/2092720100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb55c140930 0x7fb55c140d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.504+0000 7fb551400640 1 -- 172.21.15.42:0/2092720100 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55c0aeb50 con 0x7fb55c0ae200 2024-09-17T01:46:26.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.504+0000 7fb55a800640 1 --2- 172.21.15.42:0/2092720100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb55c140930 0x7fb55c140d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:26.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.504+0000 7fb559e00640 1 --2- 172.21.15.42:0/2092720100 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb540003a50 0x7fb55c150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:26.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.504+0000 7fb551400640 1 --2- 172.21.15.42:0/2092720100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb55c0ae200 0x7fb55c0ae610 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7fb544006630 tx=0x7fb5440039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:26.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.505+0000 7fb552a00640 1 -- 172.21.15.42:0/2092720100 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb544015070 con 0x7fb55c0ae200 2024-09-17T01:46:26.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.505+0000 7fb552a00640 1 -- 172.21.15.42:0/2092720100 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5440119c0 con 0x7fb55c0ae200 2024-09-17T01:46:26.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.505+0000 7fb552a00640 1 -- 172.21.15.42:0/2092720100 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb544011e10 con 0x7fb55c0ae200 2024-09-17T01:46:26.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.505+0000 7fb55b200640 1 -- 172.21.15.42:0/2092720100 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb55c141280 con 0x7fb55c0ae200 2024-09-17T01:46:26.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.505+0000 7fb55b200640 1 -- 172.21.15.42:0/2092720100 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb55c141810 con 0x7fb55c0ae200 2024-09-17T01:46:26.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.506+0000 7fb55b200640 1 -- 172.21.15.42:0/2092720100 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb55c06d280 con 0x7fb55c0ae200 2024-09-17T01:46:26.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.507+0000 7fb552a00640 1 -- 172.21.15.42:0/2092720100 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb544018070 con 0x7fb55c0ae200 2024-09-17T01:46:26.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.508+0000 7fb552a00640 1 --2- 172.21.15.42:0/2092720100 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb538078b90 0x7fb53807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:26.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.508+0000 7fb552a00640 1 -- 172.21.15.42:0/2092720100 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 4943+0+0 (secure 0 0 0) 0x7fb54409b870 con 0x7fb55c0ae200 2024-09-17T01:46:26.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.509+0000 7fb559e00640 1 --2- 172.21.15.42:0/2092720100 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb538078b90 0x7fb53807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:26.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.510+0000 7fb559e00640 1 --2- 172.21.15.42:0/2092720100 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb538078b90 0x7fb53807b0a0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fb54c032000 tx=0x7fb54c001190 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:26.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.513+0000 7fb552a00640 1 -- 172.21.15.42:0/2092720100 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb55c0aeb50 con 0x7fb55c0ae200 2024-09-17T01:46:26.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:26.717+0000 7fb55b200640 1 -- 172.21.15.42:0/2092720100 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fb55c0b3800 con 0x7fb55c0ae200 2024-09-17T01:46:27.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.386+0000 7fb552a00640 1 -- 172.21.15.42:0/2092720100 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v181) ==== 97+0+0 (secure 0 0 0) 0x7fb544063fb0 con 0x7fb55c0ae200 2024-09-17T01:46:27.385 INFO:teuthology.orchestra.run.smithi042.stderr: removed all blocklist entries 2024-09-17T01:46:27.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.390+0000 7fb55b200640 1 -- 172.21.15.42:0/2092720100 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb538078b90 msgr2=0x7fb53807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:27.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.390+0000 7fb55b200640 1 --2- 172.21.15.42:0/2092720100 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb538078b90 0x7fb53807b0a0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fb54c032000 tx=0x7fb54c001190 comp rx=0 tx=0).stop 2024-09-17T01:46:27.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.390+0000 7fb55b200640 1 -- 172.21.15.42:0/2092720100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb55c0ae200 msgr2=0x7fb55c0ae610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:27.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.390+0000 7fb55b200640 1 --2- 172.21.15.42:0/2092720100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb55c0ae200 0x7fb55c0ae610 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7fb544006630 tx=0x7fb5440039c0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.390+0000 7fb55b200640 1 -- 172.21.15.42:0/2092720100 shutdown_connections 2024-09-17T01:46:27.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.390+0000 7fb55b200640 1 --2- 172.21.15.42:0/2092720100 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb538078b90 0x7fb53807b0a0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.390+0000 7fb55b200640 1 --2- 172.21.15.42:0/2092720100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb55c140930 0x7fb55c140d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.390+0000 7fb55b200640 1 --2- 172.21.15.42:0/2092720100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb55c0ae200 0x7fb55c0ae610 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.390+0000 7fb55b200640 1 --2- 172.21.15.42:0/2092720100 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb540003a50 0x7fb55c150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.390+0000 7fb55b200640 1 -- 172.21.15.42:0/2092720100 >> 172.21.15.42:0/2092720100 conn(0x7fb55c0b25f0 msgr2=0x7fb55c0b4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:27.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.390+0000 7fb55b200640 1 -- 172.21.15.42:0/2092720100 shutdown_connections 2024-09-17T01:46:27.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.390+0000 7fb55b200640 1 -- 172.21.15.42:0/2092720100 wait complete. 2024-09-17T01:46:27.417 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T01:46:27.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.652+0000 7ff2dbe00640 1 -- 172.21.15.42:0/2239614885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2c0004000 msgr2=0x7ff2c0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:27.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.652+0000 7ff2dbe00640 1 --2- 172.21.15.42:0/2239614885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2c0004000 0x7ff2c0004800 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40016c0 tx=0x7ff2c0005830 comp rx=0 tx=0).stop 2024-09-17T01:46:27.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.652+0000 7ff2db400640 1 -- 172.21.15.42:0/2239614885 reap_dead start 2024-09-17T01:46:27.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.652+0000 7ff2dbe00640 1 -- 172.21.15.42:0/2239614885 shutdown_connections 2024-09-17T01:46:27.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.652+0000 7ff2dbe00640 1 -- 172.21.15.42:0/2239614885 >> 172.21.15.42:0/2239614885 conn(0x7ff2dc0b25f0 msgr2=0x7ff2dc0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:27.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.652+0000 7ff2dbe00640 1 -- 172.21.15.42:0/2239614885 shutdown_connections 2024-09-17T01:46:27.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.652+0000 7ff2dbe00640 1 -- 172.21.15.42:0/2239614885 wait complete. 2024-09-17T01:46:27.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.654+0000 7ff2dbe00640 1 Processor -- start 2024-09-17T01:46:27.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.654+0000 7ff2dbe00640 1 -- start start 2024-09-17T01:46:27.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.656+0000 7ff2dbe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2c0004000 0x7ff2dc0aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.656+0000 7ff2dbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2dc0740d0 0x7ff2dc15ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.656+0000 7ff2dbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2dc0744e0 0x7ff2dc15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.656+0000 7ff2dbe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc06f1e0 con 0x7ff2dc0744e0 2024-09-17T01:46:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.656+0000 7ff2dbe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc06f060 con 0x7ff2dc0740d0 2024-09-17T01:46:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.656+0000 7ff2dbe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff2dc06f360 con 0x7ff2c0004000 2024-09-17T01:46:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.656+0000 7ff2db400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2dc0744e0 0x7ff2dc15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.656+0000 7ff2db400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2dc0744e0 0x7ff2dc15e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54050/0 (socket says 172.21.15.42:54050) 2024-09-17T01:46:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.656+0000 7ff2db400640 1 -- 172.21.15.42:0/991189857 learned_addr learned my addr 172.21.15.42:0/991189857 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.656+0000 7ff2d3e00640 1 --2- 172.21.15.42:0/991189857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2dc0740d0 0x7ff2dc15ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.656+0000 7ff2daa00640 1 --2- 172.21.15.42:0/991189857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2c0004000 0x7ff2dc0aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.657+0000 7ff2db400640 1 -- 172.21.15.42:0/991189857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2c0004000 msgr2=0x7ff2dc0aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:27.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.657+0000 7ff2db400640 1 --2- 172.21.15.42:0/991189857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2c0004000 0x7ff2dc0aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.657+0000 7ff2db400640 1 -- 172.21.15.42:0/991189857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2dc0740d0 msgr2=0x7ff2dc15ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.657+0000 7ff2db400640 1 --2- 172.21.15.42:0/991189857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2dc0740d0 0x7ff2dc15ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.657+0000 7ff2db400640 1 -- 172.21.15.42:0/991189857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2dc1f5030 con 0x7ff2dc0744e0 2024-09-17T01:46:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.657+0000 7ff2db400640 1 --2- 172.21.15.42:0/991189857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2dc0744e0 0x7ff2dc15e2f0 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4006fd0 tx=0x7ff2d4006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:27.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.657+0000 7ff2d3400640 1 -- 172.21.15.42:0/991189857 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d400fa80 con 0x7ff2dc0744e0 2024-09-17T01:46:27.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.657+0000 7ff2d3400640 1 -- 172.21.15.42:0/991189857 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2d4017070 con 0x7ff2dc0744e0 2024-09-17T01:46:27.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.657+0000 7ff2d3400640 1 -- 172.21.15.42:0/991189857 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4011430 con 0x7ff2dc0744e0 2024-09-17T01:46:27.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.657+0000 7ff2dbe00640 1 -- 172.21.15.42:0/991189857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2dc0af0a0 con 0x7ff2dc0744e0 2024-09-17T01:46:27.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.657+0000 7ff2dbe00640 1 -- 172.21.15.42:0/991189857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2dc1f8de0 con 0x7ff2dc0744e0 2024-09-17T01:46:27.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.658+0000 7ff2dbe00640 1 -- 172.21.15.42:0/991189857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2dc06f8c0 con 0x7ff2dc0744e0 2024-09-17T01:46:27.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.660+0000 7ff2d3400640 1 -- 172.21.15.42:0/991189857 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff2d40115d0 con 0x7ff2dc0744e0 2024-09-17T01:46:27.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.661+0000 7ff2d3400640 1 --2- 172.21.15.42:0/991189857 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff2b8078b90 0x7ff2b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:27.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.661+0000 7ff2d3400640 1 -- 172.21.15.42:0/991189857 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 4857+0+0 (secure 0 0 0) 0x7ff2d409b1d0 con 0x7ff2dc0744e0 2024-09-17T01:46:27.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.661+0000 7ff2daa00640 1 --2- 172.21.15.42:0/991189857 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff2b8078b90 0x7ff2b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:27.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.662+0000 7ff2daa00640 1 --2- 172.21.15.42:0/991189857 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff2b8078b90 0x7ff2b807b0a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc009c50 tx=0x7ff2cc005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:27.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.665+0000 7ff2d3400640 1 -- 172.21.15.42:0/991189857 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff2dc1f5030 con 0x7ff2dc0744e0 2024-09-17T01:46:27.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.929+0000 7ff2dbe00640 1 -- 172.21.15.42:0/991189857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ff2dc0b3140 con 0x7ff2dc0744e0 2024-09-17T01:46:27.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.929+0000 7ff2d3400640 1 -- 172.21.15.42:0/991189857 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v41) ==== 80+0+5304 (secure 0 0 0) 0x7ff2d40638c0 con 0x7ff2dc0744e0 2024-09-17T01:46:27.927 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:46:27.928 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:46:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_dump": [ 2024-09-17T01:46:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:46:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.a", 2024-09-17T01:46:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmyJK4HRAAIC4E4V7p1fqIEfPIICMxZg==", 2024-09-17T01:46:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:46:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:46:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:46:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:46:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:46:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:46:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:46:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:46:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.b", 2024-09-17T01:46:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmXv3vORAALPrYIM6Vtz0g1pOxVhrUig==", 2024-09-17T01:46:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:46:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:46:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:46:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:46:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:46:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:46:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:46:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:46:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.c", 2024-09-17T01:46:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmPE7MKxAA9mGG+EO9C3VGVMerOm92+Q==", 2024-09-17T01:46:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:46:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:46:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:46:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:46:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:46:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:46:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:46:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:46:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.d", 2024-09-17T01:46:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmaOBSDBAATU4tpjM5IMcuvzZFE7N5bQ==", 2024-09-17T01:46:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:46:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:46:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:46:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:46:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:46:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:46:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:46:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:46:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.0", 2024-09-17T01:46:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDP2+hmEJebExAAAdGEoSzM96ybGT9h7t7OkA==", 2024-09-17T01:46:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:46:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:46:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:46:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:46:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:46:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:46:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:46:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.1", 2024-09-17T01:46:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDS2+hm7dWoMBAAagktrUl0O2/mgKCEfpAstA==", 2024-09-17T01:46:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:46:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:46:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:46:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:46:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:46:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:46:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:46:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.2", 2024-09-17T01:46:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDW2+hmEfSPBBAAPAa6EZt27yUcJSfZyCKheg==", 2024-09-17T01:46:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:46:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:46:27.933 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:46:27.933 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:46:27.933 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:46:27.933 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:46:27.933 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:46:27.933 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.3", 2024-09-17T01:46:27.933 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDZ2+hmHQhXFRAAj84g+IKqH6KMP7LjRtFvLw==", 2024-09-17T01:46:27.933 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:46:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:46:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:46:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:46:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:46:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:46:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:46:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.4", 2024-09-17T01:46:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDd2+hmaNcMNBAAx1GV/oFdfssMjFWFN5M0VQ==", 2024-09-17T01:46:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:46:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:46:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:46:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:46:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:46:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:46:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:46:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.5", 2024-09-17T01:46:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDh2+hm301NJhAAnSUH5AAvqhPwM7loH6frww==", 2024-09-17T01:46:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:46:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:46:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:46:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:46:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:46:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:46:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:46:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.6", 2024-09-17T01:46:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDk2+hm61WNNRAAbCvVvsUpB4fgt4ja60DRZA==", 2024-09-17T01:46:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:46:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:46:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:46:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:46:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:46:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:46:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:46:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.7", 2024-09-17T01:46:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDo2+hmesiLFhAA29n1eageNvP+lkRyh6gGMw==", 2024-09-17T01:46:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:46:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:46:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:46:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:46:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:46:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:46:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:46:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.0", 2024-09-17T01:46:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA==", 2024-09-17T01:46:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:46:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:46:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow r", 2024-09-17T01:46:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T01:46:27.938 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:46:27.938 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:46:27.938 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:46:27.938 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.1", 2024-09-17T01:46:27.938 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmZLygLhAABlauZgnidFWvfCCPuBLObg==", 2024-09-17T01:46:27.938 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:46:27.938 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:46:27.938 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:46:27.938 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:46:27.938 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:46:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:46:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:46:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:46:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.2", 2024-09-17T01:46:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hm8lnZIxAAN0a2CVMMtu/Nz50OG4a02A==", 2024-09-17T01:46:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:46:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:46:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:46:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:46:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:46:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:46:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:46:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:46:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.3", 2024-09-17T01:46:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmgXdAORAAM5Uy66I4nnTJ9Vhkn9JoBw==", 2024-09-17T01:46:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:46:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:46:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:46:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:46:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:46:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:46:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:46:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:46:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.admin", 2024-09-17T01:46:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDL2+hmvCreHBAA4CSAhosssViGqD93U+I7Iw==", 2024-09-17T01:46:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:46:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:46:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:46:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:46:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:46:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:46:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:46:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:46:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.x", 2024-09-17T01:46:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmYPnlEhAAIcQ11ktWZyMXYdbAONiLog==", 2024-09-17T01:46:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:46:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:46:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:46:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:46:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:46:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:46:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:46:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.y", 2024-09-17T01:46:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmpCZtBxAAp5tXMc6aEq1aOny2LJZAiA==", 2024-09-17T01:46:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:46:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:46:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:46:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:46:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:46:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:46:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-17T01:46:27.942 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:46:27.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.932+0000 7ff2dbe00640 1 -- 172.21.15.42:0/991189857 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff2b8078b90 msgr2=0x7ff2b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:27.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.932+0000 7ff2dbe00640 1 --2- 172.21.15.42:0/991189857 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff2b8078b90 0x7ff2b807b0a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc009c50 tx=0x7ff2cc005f90 comp rx=0 tx=0).stop 2024-09-17T01:46:27.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.932+0000 7ff2dbe00640 1 -- 172.21.15.42:0/991189857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2dc0744e0 msgr2=0x7ff2dc15e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:27.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.932+0000 7ff2dbe00640 1 --2- 172.21.15.42:0/991189857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2dc0744e0 0x7ff2dc15e2f0 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4006fd0 tx=0x7ff2d4006660 comp rx=0 tx=0).stop 2024-09-17T01:46:27.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.932+0000 7ff2dbe00640 1 -- 172.21.15.42:0/991189857 shutdown_connections 2024-09-17T01:46:27.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.932+0000 7ff2dbe00640 1 --2- 172.21.15.42:0/991189857 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff2b8078b90 0x7ff2b807b0a0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.932+0000 7ff2dbe00640 1 --2- 172.21.15.42:0/991189857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff2dc0740d0 0x7ff2dc15ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.932+0000 7ff2dbe00640 1 --2- 172.21.15.42:0/991189857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2dc0744e0 0x7ff2dc15e2f0 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.932+0000 7ff2dbe00640 1 --2- 172.21.15.42:0/991189857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff2c0004000 0x7ff2dc0aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.932+0000 7ff2dbe00640 1 -- 172.21.15.42:0/991189857 >> 172.21.15.42:0/991189857 conn(0x7ff2dc0b25f0 msgr2=0x7ff2dc0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:27.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.932+0000 7ff2dbe00640 1 -- 172.21.15.42:0/991189857 shutdown_connections 2024-09-17T01:46:27.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:27.932+0000 7ff2dbe00640 1 -- 172.21.15.42:0/991189857 wait complete. 2024-09-17T01:46:27.955 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T01:46:28.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.188+0000 7fe9ebe00640 1 -- 172.21.15.42:0/2035080084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9d0003a00 msgr2=0x7fe9d0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:28.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.188+0000 7fe9ebe00640 1 --2- 172.21.15.42:0/2035080084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9d0003a00 0x7fe9d0003e70 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009b50 tx=0x7fe9d0005830 comp rx=0 tx=0).stop 2024-09-17T01:46:28.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.188+0000 7fe9eb400640 1 -- 172.21.15.42:0/2035080084 reap_dead start 2024-09-17T01:46:28.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.188+0000 7fe9ebe00640 1 -- 172.21.15.42:0/2035080084 shutdown_connections 2024-09-17T01:46:28.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.188+0000 7fe9ebe00640 1 -- 172.21.15.42:0/2035080084 >> 172.21.15.42:0/2035080084 conn(0x7fe9ec0cd4c0 msgr2=0x7fe9ec0cd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:28.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.188+0000 7fe9ebe00640 1 -- 172.21.15.42:0/2035080084 shutdown_connections 2024-09-17T01:46:28.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.188+0000 7fe9ebe00640 1 -- 172.21.15.42:0/2035080084 wait complete. 2024-09-17T01:46:28.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.190+0000 7fe9ebe00640 1 Processor -- start 2024-09-17T01:46:28.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.191+0000 7fe9ebe00640 1 -- start start 2024-09-17T01:46:28.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.192+0000 7fe9ebe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9d0003a00 0x7fe9ec149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:28.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.192+0000 7fe9ebe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe9ec142360 0x7fe9ec1f8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:28.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.192+0000 7fe9ebe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9ec142770 0x7fe9ec1f9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:28.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.192+0000 7fe9ebe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec0734d0 con 0x7fe9d0003a00 2024-09-17T01:46:28.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.192+0000 7fe9ebe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec0d03c0 con 0x7fe9ec142770 2024-09-17T01:46:28.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.192+0000 7fe9ebe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ec073650 con 0x7fe9ec142360 2024-09-17T01:46:28.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.192+0000 7fe9eaa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9d0003a00 0x7fe9ec149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:28.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.192+0000 7fe9eaa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9d0003a00 0x7fe9ec149840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54060/0 (socket says 172.21.15.42:54060) 2024-09-17T01:46:28.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.192+0000 7fe9eaa00640 1 -- 172.21.15.42:0/1686824088 learned_addr learned my addr 172.21.15.42:0/1686824088 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:28.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.193+0000 7fe9e3e00640 1 --2- 172.21.15.42:0/1686824088 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe9ec142360 0x7fe9ec1f8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:28.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.193+0000 7fe9eb400640 1 --2- 172.21.15.42:0/1686824088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9ec142770 0x7fe9ec1f9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:28.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.193+0000 7fe9eaa00640 1 -- 172.21.15.42:0/1686824088 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe9ec142360 msgr2=0x7fe9ec1f8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:28.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.193+0000 7fe9eaa00640 1 --2- 172.21.15.42:0/1686824088 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe9ec142360 0x7fe9ec1f8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:28.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.193+0000 7fe9eaa00640 1 -- 172.21.15.42:0/1686824088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9ec142770 msgr2=0x7fe9ec1f9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:28.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.193+0000 7fe9eaa00640 1 --2- 172.21.15.42:0/1686824088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9ec142770 0x7fe9ec1f9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:28.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.193+0000 7fe9eaa00640 1 -- 172.21.15.42:0/1686824088 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ec0b3eb0 con 0x7fe9d0003a00 2024-09-17T01:46:28.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.193+0000 7fe9e3e00640 1 --2- 172.21.15.42:0/1686824088 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe9ec142360 0x7fe9ec1f8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:28.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.193+0000 7fe9eb400640 1 --2- 172.21.15.42:0/1686824088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9ec142770 0x7fe9ec1f9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:28.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.193+0000 7fe9eaa00640 1 --2- 172.21.15.42:0/1686824088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9d0003a00 0x7fe9ec149840 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc02bfd0 tx=0x7fe9dc033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:28.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.193+0000 7fe9e2a00640 1 -- 172.21.15.42:0/1686824088 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc038050 con 0x7fe9d0003a00 2024-09-17T01:46:28.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.193+0000 7fe9e2a00640 1 -- 172.21.15.42:0/1686824088 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9dc039040 con 0x7fe9d0003a00 2024-09-17T01:46:28.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.194+0000 7fe9ebe00640 1 -- 172.21.15.42:0/1686824088 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9ec0b4190 con 0x7fe9d0003a00 2024-09-17T01:46:28.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.194+0000 7fe9e2a00640 1 -- 172.21.15.42:0/1686824088 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc033c50 con 0x7fe9d0003a00 2024-09-17T01:46:28.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.194+0000 7fe9ebe00640 1 -- 172.21.15.42:0/1686824088 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9ec0b4750 con 0x7fe9d0003a00 2024-09-17T01:46:28.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.195+0000 7fe9ebe00640 1 -- 172.21.15.42:0/1686824088 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9ec162550 con 0x7fe9d0003a00 2024-09-17T01:46:28.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.196+0000 7fe9e2a00640 1 -- 172.21.15.42:0/1686824088 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe9dc046020 con 0x7fe9d0003a00 2024-09-17T01:46:28.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.197+0000 7fe9e2a00640 1 --2- 172.21.15.42:0/1686824088 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe9c8078b90 0x7fe9c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:28.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.197+0000 7fe9e2a00640 1 -- 172.21.15.42:0/1686824088 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 4857+0+0 (secure 0 0 0) 0x7fe9dc0bbf30 con 0x7fe9d0003a00 2024-09-17T01:46:28.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.197+0000 7fe9e3e00640 1 --2- 172.21.15.42:0/1686824088 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe9c8078b90 0x7fe9c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:28.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.198+0000 7fe9e3e00640 1 --2- 172.21.15.42:0/1686824088 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe9c8078b90 0x7fe9c807b0a0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec1f8b80 tx=0x7fe9d4005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:28.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.200+0000 7fe9e2a00640 1 -- 172.21.15.42:0/1686824088 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe9dc0ecd90 con 0x7fe9d0003a00 2024-09-17T01:46:28.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.399+0000 7fe9ebe00640 1 -- 172.21.15.42:0/1686824088 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe9ec0ccf10 con 0x7fe9d0003a00 2024-09-17T01:46:28.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.399+0000 7fe9e2a00640 1 -- 172.21.15.42:0/1686824088 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v183) ==== 84+0+65 (secure 0 0 0) 0x7fe9dc04d020 con 0x7fe9d0003a00 2024-09-17T01:46:28.397 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:46:28.397 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-09-17T01:46:28.397 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:46:28.397 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-09-17T01:46:28.397 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-09-17T01:46:28.397 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:46:28.398 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-09-17T01:46:28.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.401+0000 7fe9ebe00640 1 -- 172.21.15.42:0/1686824088 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe9c8078b90 msgr2=0x7fe9c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:28.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.401+0000 7fe9ebe00640 1 --2- 172.21.15.42:0/1686824088 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe9c8078b90 0x7fe9c807b0a0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec1f8b80 tx=0x7fe9d4005f90 comp rx=0 tx=0).stop 2024-09-17T01:46:28.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.401+0000 7fe9ebe00640 1 -- 172.21.15.42:0/1686824088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9d0003a00 msgr2=0x7fe9ec149840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:28.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.401+0000 7fe9ebe00640 1 --2- 172.21.15.42:0/1686824088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9d0003a00 0x7fe9ec149840 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc02bfd0 tx=0x7fe9dc033670 comp rx=0 tx=0).stop 2024-09-17T01:46:28.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.401+0000 7fe9ebe00640 1 -- 172.21.15.42:0/1686824088 shutdown_connections 2024-09-17T01:46:28.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.401+0000 7fe9ebe00640 1 --2- 172.21.15.42:0/1686824088 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe9c8078b90 0x7fe9c807b0a0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:28.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.401+0000 7fe9ebe00640 1 --2- 172.21.15.42:0/1686824088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9ec142770 0x7fe9ec1f9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:28.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.401+0000 7fe9ebe00640 1 --2- 172.21.15.42:0/1686824088 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe9ec142360 0x7fe9ec1f8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:28.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.401+0000 7fe9ebe00640 1 --2- 172.21.15.42:0/1686824088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe9d0003a00 0x7fe9ec149840 unknown :-1 s=CLOSED pgs=2117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:28.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.401+0000 7fe9ebe00640 1 -- 172.21.15.42:0/1686824088 >> 172.21.15.42:0/1686824088 conn(0x7fe9ec0cd4c0 msgr2=0x7fe9ec06eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:28.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.402+0000 7fe9ebe00640 1 -- 172.21.15.42:0/1686824088 shutdown_connections 2024-09-17T01:46:28.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.402+0000 7fe9ebe00640 1 -- 172.21.15.42:0/1686824088 wait complete. 2024-09-17T01:46:28.426 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T01:46:28.427 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T01:46:28.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.661+0000 7f1cf6200640 1 -- 172.21.15.42:0/4039332820 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cd80039e0 msgr2=0x7f1cd8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:28.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.661+0000 7f1cf6200640 1 --2- 172.21.15.42:0/4039332820 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cd80039e0 0x7f1cd8003e10 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400c4d0 tx=0x7f1cd8005830 comp rx=0 tx=0).stop 2024-09-17T01:46:28.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.661+0000 7f1cf5800640 1 -- 172.21.15.42:0/4039332820 reap_dead start 2024-09-17T01:46:28.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.661+0000 7f1cf6200640 1 -- 172.21.15.42:0/4039332820 shutdown_connections 2024-09-17T01:46:28.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.661+0000 7f1cf6200640 1 -- 172.21.15.42:0/4039332820 >> 172.21.15.42:0/4039332820 conn(0x7f1cf006cf00 msgr2=0x7f1cf006d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:28.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.661+0000 7f1cf6200640 1 -- 172.21.15.42:0/4039332820 shutdown_connections 2024-09-17T01:46:28.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.661+0000 7f1cf6200640 1 -- 172.21.15.42:0/4039332820 wait complete. 2024-09-17T01:46:28.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.663+0000 7f1cf6200640 1 Processor -- start 2024-09-17T01:46:28.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.663+0000 7f1cf6200640 1 -- start start 2024-09-17T01:46:28.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.665+0000 7f1cf6200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cd80039e0 0x7f1cf015a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:28.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.665+0000 7f1cf6200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cf015a560 0x7f1cf01f4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:28.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.665+0000 7f1cf6200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1cf01f53d0 0x7f1cf01f7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.665+0000 7f1cf6200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf00d17d0 con 0x7f1cd80039e0 2024-09-17T01:46:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.665+0000 7f1cf6200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf0162ab0 con 0x7f1cf015a560 2024-09-17T01:46:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.665+0000 7f1cf6200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1cf00d1950 con 0x7f1cf01f53d0 2024-09-17T01:46:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.665+0000 7f1cf4e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cd80039e0 0x7f1cf015a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.665+0000 7f1cf4e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cd80039e0 0x7f1cf015a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54074/0 (socket says 172.21.15.42:54074) 2024-09-17T01:46:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.665+0000 7f1cf4e00640 1 -- 172.21.15.42:0/3478568966 learned_addr learned my addr 172.21.15.42:0/3478568966 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.665+0000 7f1cf5800640 1 --2- 172.21.15.42:0/3478568966 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1cf01f53d0 0x7f1cf01f7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.665+0000 7f1cefe00640 1 --2- 172.21.15.42:0/3478568966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cf015a560 0x7f1cf01f4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.665+0000 7f1cf4e00640 1 -- 172.21.15.42:0/3478568966 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1cf01f53d0 msgr2=0x7f1cf01f7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.665+0000 7f1cf4e00640 1 --2- 172.21.15.42:0/3478568966 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1cf01f53d0 0x7f1cf01f7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.665+0000 7f1cf4e00640 1 -- 172.21.15.42:0/3478568966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cf015a560 msgr2=0x7f1cf01f4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:28.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.665+0000 7f1cf4e00640 1 --2- 172.21.15.42:0/3478568966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cf015a560 0x7f1cf01f4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:28.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.665+0000 7f1cf4e00640 1 -- 172.21.15.42:0/3478568966 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf015a970 con 0x7f1cd80039e0 2024-09-17T01:46:28.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.665+0000 7f1cefe00640 1 --2- 172.21.15.42:0/3478568966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cf015a560 0x7f1cf01f4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:28.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.666+0000 7f1cf4e00640 1 --2- 172.21.15.42:0/3478568966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cd80039e0 0x7f1cf015a020 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400c5f0 tx=0x7f1ce4006290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:28.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.666+0000 7f1cecc00640 1 -- 172.21.15.42:0/3478568966 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4042070 con 0x7f1cd80039e0 2024-09-17T01:46:28.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.666+0000 7f1cecc00640 1 -- 172.21.15.42:0/3478568966 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ce402b670 con 0x7f1cd80039e0 2024-09-17T01:46:28.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.666+0000 7f1cf6200640 1 -- 172.21.15.42:0/3478568966 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cf01f6d10 con 0x7f1cd80039e0 2024-09-17T01:46:28.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.666+0000 7f1cecc00640 1 -- 172.21.15.42:0/3478568966 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4039070 con 0x7f1cd80039e0 2024-09-17T01:46:28.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.666+0000 7f1cf6200640 1 -- 172.21.15.42:0/3478568966 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cf01f72d0 con 0x7f1cd80039e0 2024-09-17T01:46:28.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.667+0000 7f1cf6200640 1 -- 172.21.15.42:0/3478568966 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cf00d3f50 con 0x7f1cd80039e0 2024-09-17T01:46:28.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.668+0000 7f1cecc00640 1 -- 172.21.15.42:0/3478568966 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1ce4045070 con 0x7f1cd80039e0 2024-09-17T01:46:28.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.670+0000 7f1cecc00640 1 --2- 172.21.15.42:0/3478568966 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1cd0078b90 0x7f1cd007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:28.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.670+0000 7f1cecc00640 1 -- 172.21.15.42:0/3478568966 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 4857+0+0 (secure 0 0 0) 0x7f1ce40ba520 con 0x7f1cd80039e0 2024-09-17T01:46:28.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.670+0000 7f1cefe00640 1 --2- 172.21.15.42:0/3478568966 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1cd0078b90 0x7f1cd007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:28.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.671+0000 7f1cefe00640 1 --2- 172.21.15.42:0/3478568966 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1cd0078b90 0x7f1cd007b0a0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f1cf01598b0 tx=0x7f1cdc005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:28.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.674+0000 7f1cecc00640 1 -- 172.21.15.42:0/3478568966 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1cf015a970 con 0x7f1cd80039e0 2024-09-17T01:46:28.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:28.866+0000 7f1cf6200640 1 -- 172.21.15.42:0/3478568966 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1cf00b6b80 con 0x7f1cd80039e0 2024-09-17T01:46:29.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.390+0000 7f1cecc00640 1 -- 172.21.15.42:0/3478568966 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v184) ==== 138+0+0 (secure 0 0 0) 0x7f1cf00d1d10 con 0x7f1cd80039e0 2024-09-17T01:46:29.389 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-09-17T01:46:29.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.393+0000 7f1cf6200640 1 -- 172.21.15.42:0/3478568966 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1cd0078b90 msgr2=0x7f1cd007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:29.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.393+0000 7f1cf6200640 1 --2- 172.21.15.42:0/3478568966 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1cd0078b90 0x7f1cd007b0a0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f1cf01598b0 tx=0x7f1cdc005f90 comp rx=0 tx=0).stop 2024-09-17T01:46:29.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.393+0000 7f1cf6200640 1 -- 172.21.15.42:0/3478568966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cd80039e0 msgr2=0x7f1cf015a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:29.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.393+0000 7f1cf6200640 1 --2- 172.21.15.42:0/3478568966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cd80039e0 0x7f1cf015a020 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400c5f0 tx=0x7f1ce4006290 comp rx=0 tx=0).stop 2024-09-17T01:46:29.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.394+0000 7f1cf6200640 1 -- 172.21.15.42:0/3478568966 shutdown_connections 2024-09-17T01:46:29.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.394+0000 7f1cf6200640 1 --2- 172.21.15.42:0/3478568966 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1cd0078b90 0x7f1cd007b0a0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:29.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.394+0000 7f1cf6200640 1 --2- 172.21.15.42:0/3478568966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cf015a560 0x7f1cf01f4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:29.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.394+0000 7f1cf6200640 1 --2- 172.21.15.42:0/3478568966 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1cf01f53d0 0x7f1cf01f7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:29.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.394+0000 7f1cf6200640 1 --2- 172.21.15.42:0/3478568966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cd80039e0 0x7f1cf015a020 unknown :-1 s=CLOSED pgs=2120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:29.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.394+0000 7f1cf6200640 1 -- 172.21.15.42:0/3478568966 >> 172.21.15.42:0/3478568966 conn(0x7f1cf006cf00 msgr2=0x7f1cf00b7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:29.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.394+0000 7f1cf6200640 1 -- 172.21.15.42:0/3478568966 shutdown_connections 2024-09-17T01:46:29.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.394+0000 7f1cf6200640 1 -- 172.21.15.42:0/3478568966 wait complete. 2024-09-17T01:46:29.427 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T01:46:29.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.665+0000 7fdbe3e00640 1 -- 172.21.15.42:0/1404410187 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbe40b4be0 msgr2=0x7fdbe415d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:29.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.665+0000 7fdbe3e00640 1 --2- 172.21.15.42:0/1404410187 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbe40b4be0 0x7fdbe415d6b0 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7fdbe406deb0 tx=0x7fdbd402a560 comp rx=0 tx=0).stop 2024-09-17T01:46:29.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.666+0000 7fdbe3e00640 1 -- 172.21.15.42:0/1404410187 shutdown_connections 2024-09-17T01:46:29.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.666+0000 7fdbe3e00640 1 --2- 172.21.15.42:0/1404410187 >> v2:172.21.15.43:3300/0 conn(0x7fdbe406d430 0x7fdbe4152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:29.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.666+0000 7fdbe3e00640 1 --2- 172.21.15.42:0/1404410187 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbe40b4be0 0x7fdbe415d6b0 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:29.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.666+0000 7fdbe3e00640 1 -- 172.21.15.42:0/1404410187 >> 172.21.15.42:0/1404410187 conn(0x7fdbe40b25f0 msgr2=0x7fdbe40d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:29.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.666+0000 7fdbe3e00640 1 -- 172.21.15.42:0/1404410187 shutdown_connections 2024-09-17T01:46:29.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.666+0000 7fdbe3e00640 1 -- 172.21.15.42:0/1404410187 wait complete. 2024-09-17T01:46:29.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.668+0000 7fdbe3e00640 1 Processor -- start 2024-09-17T01:46:29.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.668+0000 7fdbe3e00640 1 -- start start 2024-09-17T01:46:29.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.669+0000 7fdbe3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbe40b4be0 0x7fdbe414f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:29.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.670+0000 7fdbe3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdbe40cf7c0 0x7fdbe41e5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:29.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.670+0000 7fdbe3e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdbe4151d60 0x7fdbe41e6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:29.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.670+0000 7fdbe3e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe41537a0 con 0x7fdbe40b4be0 2024-09-17T01:46:29.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.670+0000 7fdbe3e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe4153620 con 0x7fdbe40cf7c0 2024-09-17T01:46:29.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.670+0000 7fdbe3e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe4153920 con 0x7fdbe4151d60 2024-09-17T01:46:29.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.670+0000 7fdbe2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbe40b4be0 0x7fdbe414f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:29.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.670+0000 7fdbe2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbe40b4be0 0x7fdbe414f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54088/0 (socket says 172.21.15.42:54088) 2024-09-17T01:46:29.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.670+0000 7fdbe2a00640 1 -- 172.21.15.42:0/566178387 learned_addr learned my addr 172.21.15.42:0/566178387 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:29.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.670+0000 7fdbe3400640 1 --2- 172.21.15.42:0/566178387 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdbe4151d60 0x7fdbe41e6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:29.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.670+0000 7fdbe2000640 1 --2- 172.21.15.42:0/566178387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdbe40cf7c0 0x7fdbe41e5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:29.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.670+0000 7fdbe2a00640 1 -- 172.21.15.42:0/566178387 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdbe4151d60 msgr2=0x7fdbe41e6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:29.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.670+0000 7fdbe2a00640 1 --2- 172.21.15.42:0/566178387 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdbe4151d60 0x7fdbe41e6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:29.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.670+0000 7fdbe2a00640 1 -- 172.21.15.42:0/566178387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdbe40cf7c0 msgr2=0x7fdbe41e5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:29.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.670+0000 7fdbe2a00640 1 --2- 172.21.15.42:0/566178387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdbe40cf7c0 0x7fdbe41e5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:29.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.670+0000 7fdbe2a00640 1 -- 172.21.15.42:0/566178387 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe40af250 con 0x7fdbe40b4be0 2024-09-17T01:46:29.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.671+0000 7fdbe2a00640 1 --2- 172.21.15.42:0/566178387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbe40b4be0 0x7fdbe414f4a0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4034040 tx=0x7fdbd40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:29.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.671+0000 7fdbdaa00640 1 -- 172.21.15.42:0/566178387 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd403e030 con 0x7fdbe40b4be0 2024-09-17T01:46:29.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.671+0000 7fdbdaa00640 1 -- 172.21.15.42:0/566178387 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbd40047a0 con 0x7fdbe40b4be0 2024-09-17T01:46:29.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.671+0000 7fdbe3e00640 1 -- 172.21.15.42:0/566178387 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe40ca800 con 0x7fdbe40b4be0 2024-09-17T01:46:29.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.671+0000 7fdbdaa00640 1 -- 172.21.15.42:0/566178387 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4035040 con 0x7fdbe40b4be0 2024-09-17T01:46:29.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.671+0000 7fdbe3e00640 1 -- 172.21.15.42:0/566178387 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe40cadc0 con 0x7fdbe40b4be0 2024-09-17T01:46:29.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.672+0000 7fdbe3e00640 1 -- 172.21.15.42:0/566178387 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbe4152ed0 con 0x7fdbe40b4be0 2024-09-17T01:46:29.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.674+0000 7fdbdaa00640 1 -- 172.21.15.42:0/566178387 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdbd4041030 con 0x7fdbe40b4be0 2024-09-17T01:46:29.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.675+0000 7fdbdaa00640 1 --2- 172.21.15.42:0/566178387 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdbc4078bc0 0x7fdbc407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:29.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.675+0000 7fdbdaa00640 1 -- 172.21.15.42:0/566178387 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 5227+0+0 (secure 0 0 0) 0x7fdbd40bb420 con 0x7fdbe40b4be0 2024-09-17T01:46:29.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.675+0000 7fdbe2000640 1 --2- 172.21.15.42:0/566178387 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdbc4078bc0 0x7fdbc407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:29.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.676+0000 7fdbe2000640 1 --2- 172.21.15.42:0/566178387 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdbc4078bc0 0x7fdbc407b0d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0006fd0 tx=0x7fdbd0008040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:29.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.680+0000 7fdbdaa00640 1 -- 172.21.15.42:0/566178387 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdbe415dbf0 con 0x7fdbe40b4be0 2024-09-17T01:46:29.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:29.877+0000 7fdbe3e00640 1 -- 172.21.15.42:0/566178387 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fdbe41eabd0 con 0x7fdbe40b4be0 2024-09-17T01:46:30.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.394+0000 7fdbdaa00640 1 -- 172.21.15.42:0/566178387 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v185) ==== 170+0+0 (secure 0 0 0) 0x7fdbd4083a30 con 0x7fdbe40b4be0 2024-09-17T01:46:30.392 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-09-17T01:46:30.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.397+0000 7fdbe3e00640 1 -- 172.21.15.42:0/566178387 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdbc4078bc0 msgr2=0x7fdbc407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:30.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.397+0000 7fdbe3e00640 1 --2- 172.21.15.42:0/566178387 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdbc4078bc0 0x7fdbc407b0d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0006fd0 tx=0x7fdbd0008040 comp rx=0 tx=0).stop 2024-09-17T01:46:30.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.397+0000 7fdbe3e00640 1 -- 172.21.15.42:0/566178387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbe40b4be0 msgr2=0x7fdbe414f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:30.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.397+0000 7fdbe3e00640 1 --2- 172.21.15.42:0/566178387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbe40b4be0 0x7fdbe414f4a0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4034040 tx=0x7fdbd40039e0 comp rx=0 tx=0).stop 2024-09-17T01:46:30.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.398+0000 7fdbe3e00640 1 -- 172.21.15.42:0/566178387 shutdown_connections 2024-09-17T01:46:30.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.398+0000 7fdbe3e00640 1 --2- 172.21.15.42:0/566178387 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdbc4078bc0 0x7fdbc407b0d0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:30.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.398+0000 7fdbe3e00640 1 --2- 172.21.15.42:0/566178387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdbe40cf7c0 0x7fdbe41e5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:30.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.398+0000 7fdbe3e00640 1 --2- 172.21.15.42:0/566178387 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdbe4151d60 0x7fdbe41e6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:30.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.398+0000 7fdbe3e00640 1 --2- 172.21.15.42:0/566178387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbe40b4be0 0x7fdbe414f4a0 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:30.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.398+0000 7fdbe3e00640 1 -- 172.21.15.42:0/566178387 >> 172.21.15.42:0/566178387 conn(0x7fdbe40b25f0 msgr2=0x7fdbe4152630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:30.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.398+0000 7fdbe3e00640 1 -- 172.21.15.42:0/566178387 shutdown_connections 2024-09-17T01:46:30.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.398+0000 7fdbe3e00640 1 -- 172.21.15.42:0/566178387 wait complete. 2024-09-17T01:46:30.437 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T01:46:30.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.672+0000 7f389d200640 1 -- 172.21.15.42:0/1093073523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3898142f40 msgr2=0x7f3898072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:30.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.672+0000 7f389d200640 1 --2- 172.21.15.42:0/1093073523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3898142f40 0x7f3898072950 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7f3880005fd0 tx=0x7f388002a540 comp rx=0 tx=0).stop 2024-09-17T01:46:30.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.672+0000 7f389d200640 1 -- 172.21.15.42:0/1093073523 shutdown_connections 2024-09-17T01:46:30.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.672+0000 7f389d200640 1 --2- 172.21.15.42:0/1093073523 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3898072e90 0x7f38980cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:30.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.672+0000 7f389d200640 1 --2- 172.21.15.42:0/1093073523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3898142f40 0x7f3898072950 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:30.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.672+0000 7f389d200640 1 -- 172.21.15.42:0/1093073523 >> 172.21.15.42:0/1093073523 conn(0x7f38980b2930 msgr2=0x7f389806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:30.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.672+0000 7f389d200640 1 -- 172.21.15.42:0/1093073523 shutdown_connections 2024-09-17T01:46:30.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.672+0000 7f389d200640 1 -- 172.21.15.42:0/1093073523 wait complete. 2024-09-17T01:46:30.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.675+0000 7f389d200640 1 Processor -- start 2024-09-17T01:46:30.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.675+0000 7f389d200640 1 -- start start 2024-09-17T01:46:30.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.676+0000 7f389d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3898072e90 0x7f389814aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:30.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.676+0000 7f389d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38980b3550 0x7f38980b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:30.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.676+0000 7f389d200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3898142f40 0x7f38980b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:30.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.676+0000 7f389d200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f389806d640 con 0x7f3898072e90 2024-09-17T01:46:30.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.676+0000 7f389d200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f38980cf590 con 0x7f38980b3550 2024-09-17T01:46:30.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.676+0000 7f389d200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f389806d7c0 con 0x7f3898142f40 2024-09-17T01:46:30.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.677+0000 7f3895e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3898072e90 0x7f389814aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:30.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.677+0000 7f3895e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3898072e90 0x7f389814aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54100/0 (socket says 172.21.15.42:54100) 2024-09-17T01:46:30.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.677+0000 7f3895e00640 1 -- 172.21.15.42:0/3664478722 learned_addr learned my addr 172.21.15.42:0/3664478722 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:30.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.677+0000 7f3896800640 1 --2- 172.21.15.42:0/3664478722 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3898142f40 0x7f38980b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:30.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.677+0000 7f388fe00640 1 --2- 172.21.15.42:0/3664478722 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38980b3550 0x7f38980b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:30.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.677+0000 7f3895e00640 1 -- 172.21.15.42:0/3664478722 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3898142f40 msgr2=0x7f38980b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:30.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.677+0000 7f3895e00640 1 --2- 172.21.15.42:0/3664478722 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3898142f40 0x7f38980b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:30.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.677+0000 7f3895e00640 1 -- 172.21.15.42:0/3664478722 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38980b3550 msgr2=0x7f38980b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:30.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.677+0000 7f3895e00640 1 --2- 172.21.15.42:0/3664478722 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38980b3550 0x7f38980b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:30.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.677+0000 7f3895e00640 1 -- 172.21.15.42:0/3664478722 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38980ae610 con 0x7f3898072e90 2024-09-17T01:46:30.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.677+0000 7f3895e00640 1 --2- 172.21.15.42:0/3664478722 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3898072e90 0x7f389814aa00 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f388800c3c0 tx=0x7f388800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:30.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.677+0000 7f388e000640 1 -- 172.21.15.42:0/3664478722 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888017070 con 0x7f3898072e90 2024-09-17T01:46:30.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.678+0000 7f388e000640 1 -- 172.21.15.42:0/3664478722 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38880035f0 con 0x7f3898072e90 2024-09-17T01:46:30.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.678+0000 7f388e000640 1 -- 172.21.15.42:0/3664478722 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888003a80 con 0x7f3898072e90 2024-09-17T01:46:30.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.678+0000 7f389d200640 1 -- 172.21.15.42:0/3664478722 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f389814cee0 con 0x7f3898072e90 2024-09-17T01:46:30.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.678+0000 7f389d200640 1 -- 172.21.15.42:0/3664478722 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f389814d4a0 con 0x7f3898072e90 2024-09-17T01:46:30.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.679+0000 7f389d200640 1 -- 172.21.15.42:0/3664478722 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f389814af90 con 0x7f3898072e90 2024-09-17T01:46:30.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.680+0000 7f388e000640 1 -- 172.21.15.42:0/3664478722 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f388801a070 con 0x7f3898072e90 2024-09-17T01:46:30.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.681+0000 7f388e000640 1 --2- 172.21.15.42:0/3664478722 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3874078b90 0x7f387407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:30.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.681+0000 7f388e000640 1 -- 172.21.15.42:0/3664478722 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5609+0+0 (secure 0 0 0) 0x7f388809a090 con 0x7f3898072e90 2024-09-17T01:46:30.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.682+0000 7f388fe00640 1 --2- 172.21.15.42:0/3664478722 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3874078b90 0x7f387407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:30.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.683+0000 7f388fe00640 1 --2- 172.21.15.42:0/3664478722 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3874078b90 0x7f387407b0a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f3880033000 tx=0x7f3880004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:30.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.686+0000 7f388e000640 1 -- 172.21.15.42:0/3664478722 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3888062490 con 0x7f3898072e90 2024-09-17T01:46:30.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:30.921+0000 7f389d200640 1 -- 172.21.15.42:0/3664478722 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f389814c9f0 con 0x7f3898072e90 2024-09-17T01:46:31.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.416+0000 7f388e000640 1 -- 172.21.15.42:0/3664478722 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 26 and data pool 27 v146) ==== 174+0+0 (secure 0 0 0) 0x7f3888061d90 con 0x7f3898072e90 2024-09-17T01:46:31.414 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 26 and data pool 27 2024-09-17T01:46:31.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.421+0000 7f389d200640 1 -- 172.21.15.42:0/3664478722 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3874078b90 msgr2=0x7f387407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:31.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.421+0000 7f389d200640 1 --2- 172.21.15.42:0/3664478722 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3874078b90 0x7f387407b0a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f3880033000 tx=0x7f3880004730 comp rx=0 tx=0).stop 2024-09-17T01:46:31.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.421+0000 7f389d200640 1 -- 172.21.15.42:0/3664478722 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3898072e90 msgr2=0x7f389814aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:31.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.421+0000 7f389d200640 1 --2- 172.21.15.42:0/3664478722 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3898072e90 0x7f389814aa00 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f388800c3c0 tx=0x7f388800c880 comp rx=0 tx=0).stop 2024-09-17T01:46:31.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.423+0000 7f389d200640 1 -- 172.21.15.42:0/3664478722 shutdown_connections 2024-09-17T01:46:31.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.423+0000 7f389d200640 1 --2- 172.21.15.42:0/3664478722 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3874078b90 0x7f387407b0a0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:31.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.423+0000 7f389d200640 1 --2- 172.21.15.42:0/3664478722 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38980b3550 0x7f38980b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:31.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.423+0000 7f389d200640 1 --2- 172.21.15.42:0/3664478722 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3898142f40 0x7f38980b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:31.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.423+0000 7f389d200640 1 --2- 172.21.15.42:0/3664478722 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3898072e90 0x7f389814aa00 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:31.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.423+0000 7f389d200640 1 -- 172.21.15.42:0/3664478722 >> 172.21.15.42:0/3664478722 conn(0x7f38980b2930 msgr2=0x7f3898073600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:31.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.424+0000 7f389d200640 1 -- 172.21.15.42:0/3664478722 shutdown_connections 2024-09-17T01:46:31.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.424+0000 7f389d200640 1 -- 172.21.15.42:0/3664478722 wait complete. 2024-09-17T01:46:31.465 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:46:31.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.695+0000 7fe637e00640 1 -- 172.21.15.42:0/2349269780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe630142f40 msgr2=0x7fe630072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:31.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.695+0000 7fe637e00640 1 --2- 172.21.15.42:0/2349269780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe630142f40 0x7fe630072950 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009830 tx=0x7fe61c02a480 comp rx=0 tx=0).stop 2024-09-17T01:46:31.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.696+0000 7fe637e00640 1 -- 172.21.15.42:0/2349269780 shutdown_connections 2024-09-17T01:46:31.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.696+0000 7fe637e00640 1 --2- 172.21.15.42:0/2349269780 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe630142f40 0x7fe630072950 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:31.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.696+0000 7fe637e00640 1 --2- 172.21.15.42:0/2349269780 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe6300b3550 0x7fe63015cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:31.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.696+0000 7fe637e00640 1 -- 172.21.15.42:0/2349269780 >> 172.21.15.42:0/2349269780 conn(0x7fe6300b2930 msgr2=0x7fe63006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:31.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.696+0000 7fe637e00640 1 -- 172.21.15.42:0/2349269780 shutdown_connections 2024-09-17T01:46:31.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.696+0000 7fe637e00640 1 -- 172.21.15.42:0/2349269780 wait complete. 2024-09-17T01:46:31.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.698+0000 7fe637e00640 1 Processor -- start 2024-09-17T01:46:31.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.698+0000 7fe637e00640 1 -- start start 2024-09-17T01:46:31.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.699+0000 7fe637e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe630072e90 0x7fe63014ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:31.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.699+0000 7fe637e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe6300b3550 0x7fe6300ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:31.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.699+0000 7fe637e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe630142f40 0x7fe6300aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:31.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.700+0000 7fe637e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe63006d7c0 con 0x7fe630072e90 2024-09-17T01:46:31.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.700+0000 7fe637e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe63006d640 con 0x7fe630142f40 2024-09-17T01:46:31.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.700+0000 7fe637e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe63006d940 con 0x7fe6300b3550 2024-09-17T01:46:31.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.700+0000 7fe635400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe630072e90 0x7fe63014ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:31.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.700+0000 7fe635400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe630072e90 0x7fe63014ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54106/0 (socket says 172.21.15.42:54106) 2024-09-17T01:46:31.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.700+0000 7fe635400640 1 -- 172.21.15.42:0/1515855009 learned_addr learned my addr 172.21.15.42:0/1515855009 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:31.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.700+0000 7fe634a00640 1 --2- 172.21.15.42:0/1515855009 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe6300b3550 0x7fe6300ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:31.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.700+0000 7fe635e00640 1 --2- 172.21.15.42:0/1515855009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe630142f40 0x7fe6300aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:31.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.700+0000 7fe635400640 1 -- 172.21.15.42:0/1515855009 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe6300b3550 msgr2=0x7fe6300ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:31.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.700+0000 7fe635400640 1 --2- 172.21.15.42:0/1515855009 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe6300b3550 0x7fe6300ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:31.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.700+0000 7fe635400640 1 -- 172.21.15.42:0/1515855009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe630142f40 msgr2=0x7fe6300aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:31.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.700+0000 7fe635400640 1 --2- 172.21.15.42:0/1515855009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe630142f40 0x7fe6300aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:31.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.700+0000 7fe635400640 1 -- 172.21.15.42:0/1515855009 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6300740f0 con 0x7fe630072e90 2024-09-17T01:46:31.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.701+0000 7fe635400640 1 --2- 172.21.15.42:0/1515855009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe630072e90 0x7fe63014ec50 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7fe62400e9f0 tx=0x7fe62400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:31.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.701+0000 7fe62d600640 1 -- 172.21.15.42:0/1515855009 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62400cd80 con 0x7fe630072e90 2024-09-17T01:46:31.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.701+0000 7fe62d600640 1 -- 172.21.15.42:0/1515855009 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe624004020 con 0x7fe630072e90 2024-09-17T01:46:31.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.701+0000 7fe62d600640 1 -- 172.21.15.42:0/1515855009 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe624004470 con 0x7fe630072e90 2024-09-17T01:46:31.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.701+0000 7fe637e00640 1 -- 172.21.15.42:0/1515855009 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe63006e360 con 0x7fe630072e90 2024-09-17T01:46:31.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.701+0000 7fe637e00640 1 -- 172.21.15.42:0/1515855009 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe63006e600 con 0x7fe630072e90 2024-09-17T01:46:31.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.702+0000 7fe637e00640 1 -- 172.21.15.42:0/1515855009 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe63015cec0 con 0x7fe630072e90 2024-09-17T01:46:31.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.703+0000 7fe62d600640 1 -- 172.21.15.42:0/1515855009 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe6240035f0 con 0x7fe630072e90 2024-09-17T01:46:31.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.704+0000 7fe62d600640 1 --2- 172.21.15.42:0/1515855009 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe610078b90 0x7fe61007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:31.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.705+0000 7fe62d600640 1 -- 172.21.15.42:0/1515855009 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 5709+0+0 (secure 0 0 0) 0x7fe62409b6d0 con 0x7fe630072e90 2024-09-17T01:46:31.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.705+0000 7fe634a00640 1 --2- 172.21.15.42:0/1515855009 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe610078b90 0x7fe61007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:31.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.706+0000 7fe634a00640 1 --2- 172.21.15.42:0/1515855009 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe610078b90 0x7fe61007b0a0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe61c034000 tx=0x7fe61c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:31.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.709+0000 7fe62d600640 1 -- 172.21.15.42:0/1515855009 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe6240633a0 con 0x7fe630072e90 2024-09-17T01:46:31.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.904+0000 7fe637e00640 1 -- 172.21.15.42:0/1515855009 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6300742f0 con 0x7fe630072e90 2024-09-17T01:46:31.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.905+0000 7fe62d600640 1 -- 172.21.15.42:0/1515855009 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) ==== 74+0+16640 (secure 0 0 0) 0x7fe624067dd0 con 0x7fe630072e90 2024-09-17T01:46:31.903 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:46:31.903 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":186,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:46:30.922713+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:46:28.879952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-17T01:46:29.890485+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:46:31.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.907+0000 7fe637e00640 1 -- 172.21.15.42:0/1515855009 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe610078b90 msgr2=0x7fe61007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:31.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.907+0000 7fe637e00640 1 --2- 172.21.15.42:0/1515855009 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe610078b90 0x7fe61007b0a0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe61c034000 tx=0x7fe61c004730 comp rx=0 tx=0).stop 2024-09-17T01:46:31.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.907+0000 7fe637e00640 1 -- 172.21.15.42:0/1515855009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe630072e90 msgr2=0x7fe63014ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:31.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.907+0000 7fe637e00640 1 --2- 172.21.15.42:0/1515855009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe630072e90 0x7fe63014ec50 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7fe62400e9f0 tx=0x7fe62400eeb0 comp rx=0 tx=0).stop 2024-09-17T01:46:31.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.907+0000 7fe637e00640 1 -- 172.21.15.42:0/1515855009 shutdown_connections 2024-09-17T01:46:31.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.907+0000 7fe637e00640 1 --2- 172.21.15.42:0/1515855009 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe610078b90 0x7fe61007b0a0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:31.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.907+0000 7fe637e00640 1 --2- 172.21.15.42:0/1515855009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe630142f40 0x7fe6300aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:31.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.907+0000 7fe637e00640 1 --2- 172.21.15.42:0/1515855009 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe6300b3550 0x7fe6300ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:31.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.907+0000 7fe637e00640 1 --2- 172.21.15.42:0/1515855009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe630072e90 0x7fe63014ec50 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:31.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.907+0000 7fe637e00640 1 -- 172.21.15.42:0/1515855009 >> 172.21.15.42:0/1515855009 conn(0x7fe6300b2930 msgr2=0x7fe63015b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:31.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.908+0000 7fe637e00640 1 -- 172.21.15.42:0/1515855009 shutdown_connections 2024-09-17T01:46:31.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:31.908+0000 7fe637e00640 1 -- 172.21.15.42:0/1515855009 wait complete. 2024-09-17T01:46:31.929 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:46:32.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.158+0000 7fbd3f000640 1 -- 172.21.15.42:0/409035070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd380b3550 msgr2=0x7fbd3815cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:32.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.158+0000 7fbd3f000640 1 --2- 172.21.15.42:0/409035070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd380b3550 0x7fbd3815cec0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7fbd3815aab0 tx=0x7fbd2802a580 comp rx=0 tx=0).stop 2024-09-17T01:46:32.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.158+0000 7fbd3f000640 1 -- 172.21.15.42:0/409035070 shutdown_connections 2024-09-17T01:46:32.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.158+0000 7fbd3f000640 1 --2- 172.21.15.42:0/409035070 >> v2:172.21.15.43:3300/0 conn(0x7fbd380cec40 0x7fbd380cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:32.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.158+0000 7fbd3f000640 1 --2- 172.21.15.42:0/409035070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd380b3550 0x7fbd3815cec0 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:32.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.158+0000 7fbd3f000640 1 -- 172.21.15.42:0/409035070 >> 172.21.15.42:0/409035070 conn(0x7fbd380b2930 msgr2=0x7fbd3806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:32.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.158+0000 7fbd3f000640 1 -- 172.21.15.42:0/409035070 shutdown_connections 2024-09-17T01:46:32.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.158+0000 7fbd3f000640 1 -- 172.21.15.42:0/409035070 wait complete. 2024-09-17T01:46:32.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.160+0000 7fbd3f000640 1 Processor -- start 2024-09-17T01:46:32.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.161+0000 7fbd3f000640 1 -- start start 2024-09-17T01:46:32.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.162+0000 7fbd3f000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd380b3550 0x7fbd381f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:32.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.162+0000 7fbd3f000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd380cec40 0x7fbd3813f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:32.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.162+0000 7fbd3f000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd38142f40 0x7fbd38153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:32.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.162+0000 7fbd3f000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3806d7c0 con 0x7fbd38142f40 2024-09-17T01:46:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.162+0000 7fbd3f000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3806d640 con 0x7fbd380b3550 2024-09-17T01:46:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.162+0000 7fbd3f000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbd3806d940 con 0x7fbd380cec40 2024-09-17T01:46:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.162+0000 7fbd3d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd38142f40 0x7fbd38153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.162+0000 7fbd3d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd38142f40 0x7fbd38153c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54122/0 (socket says 172.21.15.42:54122) 2024-09-17T01:46:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.162+0000 7fbd3d000640 1 -- 172.21.15.42:0/596879038 learned_addr learned my addr 172.21.15.42:0/596879038 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.162+0000 7fbd37e00640 1 --2- 172.21.15.42:0/596879038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd380b3550 0x7fbd381f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.162+0000 7fbd2f400640 1 --2- 172.21.15.42:0/596879038 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd380cec40 0x7fbd3813f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.163+0000 7fbd3d000640 1 -- 172.21.15.42:0/596879038 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd380cec40 msgr2=0x7fbd3813f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.163+0000 7fbd3d000640 1 --2- 172.21.15.42:0/596879038 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd380cec40 0x7fbd3813f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.163+0000 7fbd3d000640 1 -- 172.21.15.42:0/596879038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd380b3550 msgr2=0x7fbd381f5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.163+0000 7fbd3d000640 1 --2- 172.21.15.42:0/596879038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd380b3550 0x7fbd381f5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.163+0000 7fbd3d000640 1 -- 172.21.15.42:0/596879038 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd380c5430 con 0x7fbd38142f40 2024-09-17T01:46:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.163+0000 7fbd3d000640 1 --2- 172.21.15.42:0/596879038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd38142f40 0x7fbd38153c00 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000e990 tx=0x7fbd3000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:32.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.163+0000 7fbd34c00640 1 -- 172.21.15.42:0/596879038 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd30004d20 con 0x7fbd38142f40 2024-09-17T01:46:32.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.163+0000 7fbd34c00640 1 -- 172.21.15.42:0/596879038 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd3000cb00 con 0x7fbd38142f40 2024-09-17T01:46:32.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.163+0000 7fbd34c00640 1 -- 172.21.15.42:0/596879038 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd30005020 con 0x7fbd38142f40 2024-09-17T01:46:32.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.163+0000 7fbd3f000640 1 -- 172.21.15.42:0/596879038 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd380c7350 con 0x7fbd38142f40 2024-09-17T01:46:32.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.164+0000 7fbd3f000640 1 -- 172.21.15.42:0/596879038 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd380c59d0 con 0x7fbd38142f40 2024-09-17T01:46:32.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.165+0000 7fbd3f000640 1 -- 172.21.15.42:0/596879038 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd3815cec0 con 0x7fbd38142f40 2024-09-17T01:46:32.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.166+0000 7fbd34c00640 1 -- 172.21.15.42:0/596879038 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbd300051c0 con 0x7fbd38142f40 2024-09-17T01:46:32.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.167+0000 7fbd34c00640 1 --2- 172.21.15.42:0/596879038 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd14078bc0 0x7fbd1407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:32.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.167+0000 7fbd34c00640 1 -- 172.21.15.42:0/596879038 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 5709+0+0 (secure 0 0 0) 0x7fbd3009ba30 con 0x7fbd38142f40 2024-09-17T01:46:32.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.168+0000 7fbd37e00640 1 --2- 172.21.15.42:0/596879038 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd14078bc0 0x7fbd1407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:32.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.168+0000 7fbd37e00640 1 --2- 172.21.15.42:0/596879038 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd14078bc0 0x7fbd1407b0d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fbd28033000 tx=0x7fbd28004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:32.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.170+0000 7fbd34c00640 1 -- 172.21.15.42:0/596879038 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbd30016030 con 0x7fbd38142f40 2024-09-17T01:46:32.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.363+0000 7fbd3f000640 1 -- 172.21.15.42:0/596879038 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd3806a170 con 0x7fbd38142f40 2024-09-17T01:46:32.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.364+0000 7fbd34c00640 1 -- 172.21.15.42:0/596879038 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) ==== 74+0+16640 (secure 0 0 0) 0x7fbd30063800 con 0x7fbd38142f40 2024-09-17T01:46:32.362 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:46:32.362 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":186,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:46:30.922713+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:46:28.879952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-17T01:46:29.890485+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:46:32.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.366+0000 7fbd3f000640 1 -- 172.21.15.42:0/596879038 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd14078bc0 msgr2=0x7fbd1407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:32.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.366+0000 7fbd3f000640 1 --2- 172.21.15.42:0/596879038 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd14078bc0 0x7fbd1407b0d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fbd28033000 tx=0x7fbd28004730 comp rx=0 tx=0).stop 2024-09-17T01:46:32.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.366+0000 7fbd3f000640 1 -- 172.21.15.42:0/596879038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd38142f40 msgr2=0x7fbd38153c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:32.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.366+0000 7fbd3f000640 1 --2- 172.21.15.42:0/596879038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd38142f40 0x7fbd38153c00 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000e990 tx=0x7fbd3000ee50 comp rx=0 tx=0).stop 2024-09-17T01:46:32.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.366+0000 7fbd3f000640 1 -- 172.21.15.42:0/596879038 shutdown_connections 2024-09-17T01:46:32.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.366+0000 7fbd3f000640 1 --2- 172.21.15.42:0/596879038 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd14078bc0 0x7fbd1407b0d0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:32.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.366+0000 7fbd3f000640 1 --2- 172.21.15.42:0/596879038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd38142f40 0x7fbd38153c00 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:32.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.366+0000 7fbd3f000640 1 --2- 172.21.15.42:0/596879038 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd380cec40 0x7fbd3813f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:32.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.366+0000 7fbd3f000640 1 --2- 172.21.15.42:0/596879038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd380b3550 0x7fbd381f5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:32.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.366+0000 7fbd3f000640 1 -- 172.21.15.42:0/596879038 >> 172.21.15.42:0/596879038 conn(0x7fbd380b2930 msgr2=0x7fbd380af5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:32.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.367+0000 7fbd3f000640 1 -- 172.21.15.42:0/596879038 shutdown_connections 2024-09-17T01:46:32.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.367+0000 7fbd3f000640 1 -- 172.21.15.42:0/596879038 wait complete. 2024-09-17T01:46:32.391 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T01:46:32.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.628+0000 7f7289e00640 1 -- 172.21.15.42:0/2745409497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f726c003a00 msgr2=0x7f726c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:32.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.628+0000 7f7289e00640 1 --2- 172.21.15.42:0/2745409497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f726c003a00 0x7f726c003e70 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7f7278009b50 tx=0x7f726c005830 comp rx=0 tx=0).stop 2024-09-17T01:46:32.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.628+0000 7f7289400640 1 -- 172.21.15.42:0/2745409497 reap_dead start 2024-09-17T01:46:32.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.628+0000 7f7289e00640 1 -- 172.21.15.42:0/2745409497 shutdown_connections 2024-09-17T01:46:32.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.628+0000 7f7289e00640 1 -- 172.21.15.42:0/2745409497 >> 172.21.15.42:0/2745409497 conn(0x7f72840734a0 msgr2=0x7f72840b61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:32.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.628+0000 7f7289e00640 1 -- 172.21.15.42:0/2745409497 shutdown_connections 2024-09-17T01:46:32.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.628+0000 7f7289e00640 1 -- 172.21.15.42:0/2745409497 wait complete. 2024-09-17T01:46:32.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.631+0000 7f7289e00640 1 Processor -- start 2024-09-17T01:46:32.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.631+0000 7f7289e00640 1 -- start start 2024-09-17T01:46:32.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.632+0000 7f7289e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f726c003a00 0x7f72840d1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:32.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.632+0000 7f7289e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72841f4e10 0x7f72841578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:32.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.632+0000 7f7289e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72841f4190 0x7f72841f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:32.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.632+0000 7f7289e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f728415fe50 con 0x7f72841f4e10 2024-09-17T01:46:32.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.632+0000 7f7289e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f728415fcd0 con 0x7f726c003a00 2024-09-17T01:46:32.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.632+0000 7f7289e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f728415ccb0 con 0x7f72841f4190 2024-09-17T01:46:32.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.632+0000 7f7283e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72841f4e10 0x7f72841578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:32.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.632+0000 7f7283e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72841f4e10 0x7f72841578e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54130/0 (socket says 172.21.15.42:54130) 2024-09-17T01:46:32.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.632+0000 7f7283e00640 1 -- 172.21.15.42:0/4196506704 learned_addr learned my addr 172.21.15.42:0/4196506704 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:32.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.633+0000 7f7288a00640 1 --2- 172.21.15.42:0/4196506704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f726c003a00 0x7f72840d1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:32.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.633+0000 7f7289400640 1 --2- 172.21.15.42:0/4196506704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72841f4190 0x7f72841f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:32.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.633+0000 7f7283e00640 1 -- 172.21.15.42:0/4196506704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72841f4190 msgr2=0x7f72841f45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:32.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.633+0000 7f7283e00640 1 --2- 172.21.15.42:0/4196506704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72841f4190 0x7f72841f45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:32.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.633+0000 7f7283e00640 1 -- 172.21.15.42:0/4196506704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f726c003a00 msgr2=0x7f72840d1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:32.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.633+0000 7f7283e00640 1 --2- 172.21.15.42:0/4196506704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f726c003a00 0x7f72840d1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:32.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.633+0000 7f7283e00640 1 -- 172.21.15.42:0/4196506704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72841f4ae0 con 0x7f72841f4e10 2024-09-17T01:46:32.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.633+0000 7f7283e00640 1 --2- 172.21.15.42:0/4196506704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72841f4e10 0x7f72841578e0 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f7270011ae0 tx=0x7f7270011ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:32.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.634+0000 7f7280c00640 1 -- 172.21.15.42:0/4196506704 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727000fe70 con 0x7f72841f4e10 2024-09-17T01:46:32.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.634+0000 7f7280c00640 1 -- 172.21.15.42:0/4196506704 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7270004050 con 0x7f72841f4e10 2024-09-17T01:46:32.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.634+0000 7f7280c00640 1 -- 172.21.15.42:0/4196506704 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7270004480 con 0x7f72841f4e10 2024-09-17T01:46:32.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.634+0000 7f7289e00640 1 -- 172.21.15.42:0/4196506704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72840cd9f0 con 0x7f72841f4e10 2024-09-17T01:46:32.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.634+0000 7f7289e00640 1 -- 172.21.15.42:0/4196506704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72840d06a0 con 0x7f72841f4e10 2024-09-17T01:46:32.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.635+0000 7f7289e00640 1 -- 172.21.15.42:0/4196506704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72840cd760 con 0x7f72841f4e10 2024-09-17T01:46:32.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.636+0000 7f7280c00640 1 -- 172.21.15.42:0/4196506704 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f72700035f0 con 0x7f72841f4e10 2024-09-17T01:46:32.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.637+0000 7f7280c00640 1 --2- 172.21.15.42:0/4196506704 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7264078b90 0x7f726407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:32.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.637+0000 7f7280c00640 1 -- 172.21.15.42:0/4196506704 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f727009bd10 con 0x7f72841f4e10 2024-09-17T01:46:32.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.638+0000 7f7288a00640 1 --2- 172.21.15.42:0/4196506704 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7264078b90 0x7f726407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:32.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.638+0000 7f7288a00640 1 --2- 172.21.15.42:0/4196506704 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7264078b90 0x7f726407b0a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f7278009b50 tx=0x7f727802d040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:32.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.642+0000 7f7280c00640 1 -- 172.21.15.42:0/4196506704 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f72841f4ae0 con 0x7f72841f4e10 2024-09-17T01:46:32.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:32.876+0000 7f7289e00640 1 -- 172.21.15.42:0/4196506704 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7284157ec0 con 0x7f72841f4e10 2024-09-17T01:46:33.390 INFO:tasks.ceph.mds.b.smithi043.stderr:2024-09-17T01:46:33.392+0000 7f9e7cc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:46:33.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.428+0000 7f7280c00640 1 -- 172.21.15.42:0/4196506704 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v149) ==== 118+0+0 (secure 0 0 0) 0x7f7270063c20 con 0x7f72841f4e10 2024-09-17T01:46:33.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.431+0000 7f7289e00640 1 -- 172.21.15.42:0/4196506704 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7264078b90 msgr2=0x7f726407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:33.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.431+0000 7f7289e00640 1 --2- 172.21.15.42:0/4196506704 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7264078b90 0x7f726407b0a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f7278009b50 tx=0x7f727802d040 comp rx=0 tx=0).stop 2024-09-17T01:46:33.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.431+0000 7f7289e00640 1 -- 172.21.15.42:0/4196506704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72841f4e10 msgr2=0x7f72841578e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:33.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.431+0000 7f7289e00640 1 --2- 172.21.15.42:0/4196506704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72841f4e10 0x7f72841578e0 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f7270011ae0 tx=0x7f7270011ee0 comp rx=0 tx=0).stop 2024-09-17T01:46:33.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.431+0000 7f7289e00640 1 -- 172.21.15.42:0/4196506704 shutdown_connections 2024-09-17T01:46:33.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.431+0000 7f7289e00640 1 --2- 172.21.15.42:0/4196506704 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7264078b90 0x7f726407b0a0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:33.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.431+0000 7f7289e00640 1 --2- 172.21.15.42:0/4196506704 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f72841f4190 0x7f72841f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:33.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.431+0000 7f7289e00640 1 --2- 172.21.15.42:0/4196506704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72841f4e10 0x7f72841578e0 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:33.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.431+0000 7f7289e00640 1 --2- 172.21.15.42:0/4196506704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f726c003a00 0x7f72840d1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:33.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.431+0000 7f7289e00640 1 -- 172.21.15.42:0/4196506704 >> 172.21.15.42:0/4196506704 conn(0x7f72840734a0 msgr2=0x7f728415b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:33.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.431+0000 7f7289e00640 1 -- 172.21.15.42:0/4196506704 shutdown_connections 2024-09-17T01:46:33.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.431+0000 7f7289e00640 1 -- 172.21.15.42:0/4196506704 wait complete. 2024-09-17T01:46:33.456 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T01:46:33.456 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T01:46:33.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.691+0000 7f0270c00640 1 -- 172.21.15.42:0/2217306426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f026c06d430 msgr2=0x7f026c152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:33.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.691+0000 7f0270c00640 1 --2- 172.21.15.42:0/2217306426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f026c06d430 0x7f026c152ed0 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f0264005fd0 tx=0x7f026402ab40 comp rx=0 tx=0).stop 2024-09-17T01:46:33.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.691+0000 7f0270c00640 1 -- 172.21.15.42:0/2217306426 shutdown_connections 2024-09-17T01:46:33.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.691+0000 7f0270c00640 1 --2- 172.21.15.42:0/2217306426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f026c06d430 0x7f026c152ed0 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:33.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.691+0000 7f0270c00640 1 -- 172.21.15.42:0/2217306426 >> 172.21.15.42:0/2217306426 conn(0x7f026c0b25f0 msgr2=0x7f026c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:33.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.691+0000 7f0270c00640 1 -- 172.21.15.42:0/2217306426 shutdown_connections 2024-09-17T01:46:33.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.691+0000 7f0270c00640 1 -- 172.21.15.42:0/2217306426 wait complete. 2024-09-17T01:46:33.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.693+0000 7f0270c00640 1 Processor -- start 2024-09-17T01:46:33.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.694+0000 7f0270c00640 1 -- start start 2024-09-17T01:46:33.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.695+0000 7f0270c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f026c0b4be0 0x7f026c1f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:33.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.695+0000 7f0270c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f026c0cf7c0 0x7f026c152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:33.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.695+0000 7f0270c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f026c0ca760 0x7f026c0cab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:33.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.695+0000 7f0270c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f026c153620 con 0x7f026c0b4be0 2024-09-17T01:46:33.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.695+0000 7f0270c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f026c0b4380 con 0x7f026c0cf7c0 2024-09-17T01:46:33.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.695+0000 7f0270c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f026c1537a0 con 0x7f026c0ca760 2024-09-17T01:46:33.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.695+0000 7f026b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f026c0b4be0 0x7f026c1f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:33.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.695+0000 7f026b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f026c0b4be0 0x7f026c1f5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54142/0 (socket says 172.21.15.42:54142) 2024-09-17T01:46:33.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.695+0000 7f026b400640 1 -- 172.21.15.42:0/2482559031 learned_addr learned my addr 172.21.15.42:0/2482559031 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:33.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.696+0000 7f0263e00640 1 --2- 172.21.15.42:0/2482559031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f026c0cf7c0 0x7f026c152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:33.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.696+0000 7f026be00640 1 --2- 172.21.15.42:0/2482559031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f026c0ca760 0x7f026c0cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:33.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.696+0000 7f026b400640 1 -- 172.21.15.42:0/2482559031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f026c0ca760 msgr2=0x7f026c0cab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:33.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.696+0000 7f026b400640 1 --2- 172.21.15.42:0/2482559031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f026c0ca760 0x7f026c0cab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:33.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.696+0000 7f026b400640 1 -- 172.21.15.42:0/2482559031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f026c0cf7c0 msgr2=0x7f026c152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:33.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.696+0000 7f026b400640 1 --2- 172.21.15.42:0/2482559031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f026c0cf7c0 0x7f026c152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:33.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.696+0000 7f026b400640 1 -- 172.21.15.42:0/2482559031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f026c0cb0b0 con 0x7f026c0b4be0 2024-09-17T01:46:33.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.696+0000 7f026be00640 1 --2- 172.21.15.42:0/2482559031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f026c0ca760 0x7f026c0cab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:33.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.696+0000 7f026b400640 1 --2- 172.21.15.42:0/2482559031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f026c0b4be0 0x7f026c1f5d80 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7f025c00c430 tx=0x7f025c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:33.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.696+0000 7f0263400640 1 -- 172.21.15.42:0/2482559031 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c017070 con 0x7f026c0b4be0 2024-09-17T01:46:33.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.697+0000 7f0263400640 1 -- 172.21.15.42:0/2482559031 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f025c0053c0 con 0x7f026c0b4be0 2024-09-17T01:46:33.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.697+0000 7f0270c00640 1 -- 172.21.15.42:0/2482559031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f026c1f6430 con 0x7f026c0b4be0 2024-09-17T01:46:33.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.697+0000 7f0263400640 1 -- 172.21.15.42:0/2482559031 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c003850 con 0x7f026c0b4be0 2024-09-17T01:46:33.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.697+0000 7f0270c00640 1 -- 172.21.15.42:0/2482559031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f026c154230 con 0x7f026c0b4be0 2024-09-17T01:46:33.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.698+0000 7f0270c00640 1 -- 172.21.15.42:0/2482559031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f026c15c740 con 0x7f026c0b4be0 2024-09-17T01:46:33.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.699+0000 7f0263400640 1 -- 172.21.15.42:0/2482559031 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f025c01a070 con 0x7f026c0b4be0 2024-09-17T01:46:33.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.700+0000 7f0263400640 1 --2- 172.21.15.42:0/2482559031 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0248078b90 0x7f024807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:33.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.700+0000 7f0263400640 1 -- 172.21.15.42:0/2482559031 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f025c09a180 con 0x7f026c0b4be0 2024-09-17T01:46:33.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.701+0000 7f0263e00640 1 --2- 172.21.15.42:0/2482559031 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0248078b90 0x7f024807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:33.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.701+0000 7f0263e00640 1 --2- 172.21.15.42:0/2482559031 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0248078b90 0x7f024807b0a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f026c0d0450 tx=0x7f0254009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:33.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.705+0000 7f0263400640 1 -- 172.21.15.42:0/2482559031 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f026c0cb0b0 con 0x7f026c0b4be0 2024-09-17T01:46:33.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:33.937+0000 7f0270c00640 1 -- 172.21.15.42:0/2482559031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f026c0d0480 con 0x7f026c0b4be0 2024-09-17T01:46:34.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.430+0000 7f0263400640 1 -- 172.21.15.42:0/2482559031 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v150) ==== 122+0+0 (secure 0 0 0) 0x7f025c061ee0 con 0x7f026c0b4be0 2024-09-17T01:46:34.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.433+0000 7f0270c00640 1 -- 172.21.15.42:0/2482559031 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0248078b90 msgr2=0x7f024807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:34.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.433+0000 7f0270c00640 1 --2- 172.21.15.42:0/2482559031 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0248078b90 0x7f024807b0a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f026c0d0450 tx=0x7f0254009040 comp rx=0 tx=0).stop 2024-09-17T01:46:34.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.433+0000 7f0270c00640 1 -- 172.21.15.42:0/2482559031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f026c0b4be0 msgr2=0x7f026c1f5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:34.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.433+0000 7f0270c00640 1 --2- 172.21.15.42:0/2482559031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f026c0b4be0 0x7f026c1f5d80 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7f025c00c430 tx=0x7f025c00c8f0 comp rx=0 tx=0).stop 2024-09-17T01:46:34.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.433+0000 7f0270c00640 1 -- 172.21.15.42:0/2482559031 shutdown_connections 2024-09-17T01:46:34.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.433+0000 7f0270c00640 1 --2- 172.21.15.42:0/2482559031 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0248078b90 0x7f024807b0a0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:34.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.433+0000 7f0270c00640 1 --2- 172.21.15.42:0/2482559031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f026c0cf7c0 0x7f026c152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:34.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.433+0000 7f0270c00640 1 --2- 172.21.15.42:0/2482559031 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f026c0ca760 0x7f026c0cab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:34.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.433+0000 7f0270c00640 1 --2- 172.21.15.42:0/2482559031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f026c0b4be0 0x7f026c1f5d80 unknown :-1 s=CLOSED pgs=2135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:34.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.433+0000 7f0270c00640 1 -- 172.21.15.42:0/2482559031 >> 172.21.15.42:0/2482559031 conn(0x7f026c0b25f0 msgr2=0x7f026c0ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:34.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.433+0000 7f0270c00640 1 -- 172.21.15.42:0/2482559031 shutdown_connections 2024-09-17T01:46:34.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.433+0000 7f0270c00640 1 -- 172.21.15.42:0/2482559031 wait complete. 2024-09-17T01:46:34.462 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T01:46:34.463 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:46:34.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.694+0000 7fc6caa00640 1 -- 172.21.15.42:0/2695679660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6c40b4be0 msgr2=0x7fc6c415d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:34.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.694+0000 7fc6caa00640 1 --2- 172.21.15.42:0/2695679660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6c40b4be0 0x7fc6c415d6b0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8009830 tx=0x7fc6b802a510 comp rx=0 tx=0).stop 2024-09-17T01:46:34.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.694+0000 7fc6caa00640 1 -- 172.21.15.42:0/2695679660 shutdown_connections 2024-09-17T01:46:34.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.694+0000 7fc6caa00640 1 --2- 172.21.15.42:0/2695679660 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6c40cf7c0 0x7fc6c406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:34.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.694+0000 7fc6caa00640 1 --2- 172.21.15.42:0/2695679660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6c40b4be0 0x7fc6c415d6b0 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:34.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.694+0000 7fc6caa00640 1 -- 172.21.15.42:0/2695679660 >> 172.21.15.42:0/2695679660 conn(0x7fc6c40b25f0 msgr2=0x7fc6c40d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:34.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.694+0000 7fc6caa00640 1 -- 172.21.15.42:0/2695679660 shutdown_connections 2024-09-17T01:46:34.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.694+0000 7fc6caa00640 1 -- 172.21.15.42:0/2695679660 wait complete. 2024-09-17T01:46:34.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.697+0000 7fc6caa00640 1 Processor -- start 2024-09-17T01:46:34.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.697+0000 7fc6caa00640 1 -- start start 2024-09-17T01:46:34.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.698+0000 7fc6caa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6c406d260 0x7fc6c41461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:34.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.698+0000 7fc6caa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6c40b4be0 0x7fc6c4072050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:34.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.698+0000 7fc6caa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6c40cf7c0 0x7fc6c4072590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:34.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.698+0000 7fc6caa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c41537f0 con 0x7fc6c40cf7c0 2024-09-17T01:46:34.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.698+0000 7fc6caa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c40cfdc0 con 0x7fc6c406d260 2024-09-17T01:46:34.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.698+0000 7fc6caa00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc6c4153970 con 0x7fc6c40b4be0 2024-09-17T01:46:34.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.698+0000 7fc6ca000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6c40cf7c0 0x7fc6c4072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:34.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.698+0000 7fc6ca000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6c40cf7c0 0x7fc6c4072590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54150/0 (socket says 172.21.15.42:54150) 2024-09-17T01:46:34.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.698+0000 7fc6c9600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6c406d260 0x7fc6c41461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:34.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.699+0000 7fc6ca000640 1 -- 172.21.15.42:0/3211058634 learned_addr learned my addr 172.21.15.42:0/3211058634 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:34.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.699+0000 7fc6c8c00640 1 --2- 172.21.15.42:0/3211058634 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6c40b4be0 0x7fc6c4072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:34.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.699+0000 7fc6ca000640 1 -- 172.21.15.42:0/3211058634 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6c40b4be0 msgr2=0x7fc6c4072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:34.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.699+0000 7fc6ca000640 1 --2- 172.21.15.42:0/3211058634 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6c40b4be0 0x7fc6c4072050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:34.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.699+0000 7fc6ca000640 1 -- 172.21.15.42:0/3211058634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6c406d260 msgr2=0x7fc6c41461f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:34.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.699+0000 7fc6ca000640 1 --2- 172.21.15.42:0/3211058634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6c406d260 0x7fc6c41461f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:34.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.699+0000 7fc6ca000640 1 -- 172.21.15.42:0/3211058634 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c415ef70 con 0x7fc6c40cf7c0 2024-09-17T01:46:34.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.699+0000 7fc6ca000640 1 --2- 172.21.15.42:0/3211058634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6c40cf7c0 0x7fc6c4072590 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00c730 tx=0x7fc6bc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:34.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.699+0000 7fc6c1600640 1 -- 172.21.15.42:0/3211058634 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc017070 con 0x7fc6c40cf7c0 2024-09-17T01:46:34.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.699+0000 7fc6c1600640 1 -- 172.21.15.42:0/3211058634 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6bc003c60 con 0x7fc6c40cf7c0 2024-09-17T01:46:34.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.700+0000 7fc6c1600640 1 -- 172.21.15.42:0/3211058634 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc0052d0 con 0x7fc6c40cf7c0 2024-09-17T01:46:34.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.700+0000 7fc6caa00640 1 -- 172.21.15.42:0/3211058634 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c415f250 con 0x7fc6c40cf7c0 2024-09-17T01:46:34.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.700+0000 7fc6caa00640 1 -- 172.21.15.42:0/3211058634 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c415f810 con 0x7fc6c40cf7c0 2024-09-17T01:46:34.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.701+0000 7fc6caa00640 1 -- 172.21.15.42:0/3211058634 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c415d6b0 con 0x7fc6c40cf7c0 2024-09-17T01:46:34.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.702+0000 7fc6c1600640 1 -- 172.21.15.42:0/3211058634 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc6bc01a070 con 0x7fc6c40cf7c0 2024-09-17T01:46:34.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.703+0000 7fc6c1600640 1 --2- 172.21.15.42:0/3211058634 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc6a4078b90 0x7fc6a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:34.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.704+0000 7fc6c1600640 1 -- 172.21.15.42:0/3211058634 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7fc6bc09a500 con 0x7fc6c40cf7c0 2024-09-17T01:46:34.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.704+0000 7fc6c9600640 1 --2- 172.21.15.42:0/3211058634 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc6a4078b90 0x7fc6a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:34.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.705+0000 7fc6c9600640 1 --2- 172.21.15.42:0/3211058634 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc6a4078b90 0x7fc6a407b0a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8034000 tx=0x7fc6b8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:34.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.708+0000 7fc6c1600640 1 -- 172.21.15.42:0/3211058634 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc6c415dbf0 con 0x7fc6c40cf7c0 2024-09-17T01:46:34.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.946+0000 7fc6caa00640 1 -- 172.21.15.42:0/3211058634 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6c40b0720 con 0x7fc6c40cf7c0 2024-09-17T01:46:34.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.947+0000 7fc6c1600640 1 -- 172.21.15.42:0/3211058634 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 150 v150) ==== 95+0+5240 (secure 0 0 0) 0x7fc6bc062250 con 0x7fc6c40cf7c0 2024-09-17T01:46:34.945 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:46:34.945 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":150,"btime":"2024-09-17T01:46:34:429037+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8549,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4165093647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4165093647},{"type":"v1","addr":"172.21.15.43:6836","nonce":4165093647}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145},{"gid":10353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/4260984866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":4260984866},{"type":"v1","addr":"172.21.15.42:6834","nonce":4260984866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":10356,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2804168804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":2804168804},{"type":"v1","addr":"172.21.15.42:6835","nonce":2804168804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145}],"filesystems":[{"mdsmap":{"epoch":150,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:46:30.922674+0000","modified":"2024-09-17T01:46:33.938360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10371":{"gid":10371,"name":"b","rank":0,"incarnation":146,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/1477091047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1477091047},{"type":"v1","addr":"172.21.15.43:6837","nonce":1477091047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10371,"qdb_cluster":[10371]},"id":13}]} 2024-09-17T01:46:34.945 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 150 2024-09-17T01:46:34.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.950+0000 7fc6caa00640 1 -- 172.21.15.42:0/3211058634 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc6a4078b90 msgr2=0x7fc6a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:34.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.950+0000 7fc6caa00640 1 --2- 172.21.15.42:0/3211058634 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc6a4078b90 0x7fc6a407b0a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8034000 tx=0x7fc6b8004730 comp rx=0 tx=0).stop 2024-09-17T01:46:34.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.950+0000 7fc6caa00640 1 -- 172.21.15.42:0/3211058634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6c40cf7c0 msgr2=0x7fc6c4072590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:34.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.950+0000 7fc6caa00640 1 --2- 172.21.15.42:0/3211058634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6c40cf7c0 0x7fc6c4072590 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00c730 tx=0x7fc6bc00cbf0 comp rx=0 tx=0).stop 2024-09-17T01:46:34.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.950+0000 7fc6caa00640 1 -- 172.21.15.42:0/3211058634 shutdown_connections 2024-09-17T01:46:34.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.950+0000 7fc6caa00640 1 --2- 172.21.15.42:0/3211058634 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc6a4078b90 0x7fc6a407b0a0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:34.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.950+0000 7fc6caa00640 1 --2- 172.21.15.42:0/3211058634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6c40cf7c0 0x7fc6c4072590 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:34.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.950+0000 7fc6caa00640 1 --2- 172.21.15.42:0/3211058634 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6c40b4be0 0x7fc6c4072050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:34.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.950+0000 7fc6caa00640 1 --2- 172.21.15.42:0/3211058634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6c406d260 0x7fc6c41461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:34.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.950+0000 7fc6caa00640 1 -- 172.21.15.42:0/3211058634 >> 172.21.15.42:0/3211058634 conn(0x7fc6c40b25f0 msgr2=0x7fc6c40c9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:34.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.950+0000 7fc6caa00640 1 -- 172.21.15.42:0/3211058634 shutdown_connections 2024-09-17T01:46:34.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:34.950+0000 7fc6caa00640 1 -- 172.21.15.42:0/3211058634 wait complete. 2024-09-17T01:46:34.970 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:46:35.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.200+0000 7f30bfa00640 1 -- 172.21.15.42:0/2066336079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30b80b5100 msgr2=0x7f30b815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:35.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.200+0000 7f30bfa00640 1 --2- 172.21.15.42:0/2066336079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30b80b5100 0x7f30b815d950 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f30a8009830 tx=0x7f30a802a530 comp rx=0 tx=0).stop 2024-09-17T01:46:35.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.200+0000 7f30bfa00640 1 -- 172.21.15.42:0/2066336079 shutdown_connections 2024-09-17T01:46:35.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.200+0000 7f30bfa00640 1 --2- 172.21.15.42:0/2066336079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30b80b5100 0x7f30b815d950 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:35.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.200+0000 7f30bfa00640 1 -- 172.21.15.42:0/2066336079 >> 172.21.15.42:0/2066336079 conn(0x7f30b80b2930 msgr2=0x7f30b806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:35.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.200+0000 7f30bfa00640 1 -- 172.21.15.42:0/2066336079 shutdown_connections 2024-09-17T01:46:35.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.200+0000 7f30bfa00640 1 -- 172.21.15.42:0/2066336079 wait complete. 2024-09-17T01:46:35.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.202+0000 7f30bfa00640 1 Processor -- start 2024-09-17T01:46:35.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.202+0000 7f30bfa00640 1 -- start start 2024-09-17T01:46:35.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.204+0000 7f30bfa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30b806d430 0x7f30b8152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:35.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.204+0000 7f30bfa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f30b80b5100 0x7f30b81f7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.204+0000 7f30bfa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30b80cef70 0x7f30b81f77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.204+0000 7f30bfa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f30b8073bd0 con 0x7f30b80cef70 2024-09-17T01:46:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.204+0000 7f30bfa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f30b8073a50 con 0x7f30b806d430 2024-09-17T01:46:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.204+0000 7f30bfa00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f30b8073d50 con 0x7f30b80b5100 2024-09-17T01:46:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.204+0000 7f30bda00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30b80cef70 0x7f30b81f77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.204+0000 7f30bda00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30b80cef70 0x7f30b81f77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54166/0 (socket says 172.21.15.42:54166) 2024-09-17T01:46:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.204+0000 7f30bda00640 1 -- 172.21.15.42:0/911302056 learned_addr learned my addr 172.21.15.42:0/911302056 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.204+0000 7f30bd000640 1 --2- 172.21.15.42:0/911302056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30b806d430 0x7f30b8152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.204+0000 7f30afe00640 1 --2- 172.21.15.42:0/911302056 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f30b80b5100 0x7f30b81f7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.204+0000 7f30bda00640 1 -- 172.21.15.42:0/911302056 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f30b80b5100 msgr2=0x7f30b81f7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.204+0000 7f30bda00640 1 --2- 172.21.15.42:0/911302056 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f30b80b5100 0x7f30b81f7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.204+0000 7f30bda00640 1 -- 172.21.15.42:0/911302056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30b806d430 msgr2=0x7f30b8152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:35.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.204+0000 7f30bda00640 1 --2- 172.21.15.42:0/911302056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30b806d430 0x7f30b8152a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:35.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.204+0000 7f30bda00640 1 -- 172.21.15.42:0/911302056 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b8152f60 con 0x7f30b80cef70 2024-09-17T01:46:35.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.204+0000 7f30afe00640 1 --2- 172.21.15.42:0/911302056 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f30b80b5100 0x7f30b81f7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:35.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.205+0000 7f30bda00640 1 --2- 172.21.15.42:0/911302056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30b80cef70 0x7f30b81f77a0 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7f30b000caa0 tx=0x7f30b000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:35.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.205+0000 7f30b5600640 1 -- 172.21.15.42:0/911302056 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b0016020 con 0x7f30b80cef70 2024-09-17T01:46:35.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.205+0000 7f30b5600640 1 -- 172.21.15.42:0/911302056 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30b000ad10 con 0x7f30b80cef70 2024-09-17T01:46:35.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.205+0000 7f30b5600640 1 -- 172.21.15.42:0/911302056 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b0012680 con 0x7f30b80cef70 2024-09-17T01:46:35.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.205+0000 7f30bfa00640 1 -- 172.21.15.42:0/911302056 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b8159c70 con 0x7f30b80cef70 2024-09-17T01:46:35.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.205+0000 7f30bfa00640 1 -- 172.21.15.42:0/911302056 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b815a230 con 0x7f30b80cef70 2024-09-17T01:46:35.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.206+0000 7f30bfa00640 1 -- 172.21.15.42:0/911302056 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b81599e0 con 0x7f30b80cef70 2024-09-17T01:46:35.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.208+0000 7f30b5600640 1 -- 172.21.15.42:0/911302056 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f30b0019020 con 0x7f30b80cef70 2024-09-17T01:46:35.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.208+0000 7f30b5600640 1 --2- 172.21.15.42:0/911302056 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3094078b90 0x7f309407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:35.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.209+0000 7f30b5600640 1 -- 172.21.15.42:0/911302056 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f30b009af00 con 0x7f30b80cef70 2024-09-17T01:46:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.209+0000 7f30bd000640 1 --2- 172.21.15.42:0/911302056 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3094078b90 0x7f309407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:35.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.210+0000 7f30bd000640 1 --2- 172.21.15.42:0/911302056 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3094078b90 0x7f309407b0a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f30a8034000 tx=0x7f30a8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:35.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.213+0000 7f30b5600640 1 -- 172.21.15.42:0/911302056 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f30b0020030 con 0x7f30b80cef70 2024-09-17T01:46:35.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.409+0000 7f30bfa00640 1 -- 172.21.15.42:0/911302056 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30b815d950 con 0x7f30b80cef70 2024-09-17T01:46:35.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.411+0000 7f30b5600640 1 -- 172.21.15.42:0/911302056 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) ==== 74+0+16627 (secure 0 0 0) 0x7f30b8152f60 con 0x7f30b80cef70 2024-09-17T01:46:35.409 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:46:35.410 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":187,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:46:32.416648+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:46:28.879952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-17T01:46:29.890485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:46:35.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.413+0000 7f30bfa00640 1 -- 172.21.15.42:0/911302056 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3094078b90 msgr2=0x7f309407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:35.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.413+0000 7f30bfa00640 1 --2- 172.21.15.42:0/911302056 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3094078b90 0x7f309407b0a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f30a8034000 tx=0x7f30a8004730 comp rx=0 tx=0).stop 2024-09-17T01:46:35.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.413+0000 7f30bfa00640 1 -- 172.21.15.42:0/911302056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30b80cef70 msgr2=0x7f30b81f77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:35.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.413+0000 7f30bfa00640 1 --2- 172.21.15.42:0/911302056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30b80cef70 0x7f30b81f77a0 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7f30b000caa0 tx=0x7f30b000cf60 comp rx=0 tx=0).stop 2024-09-17T01:46:35.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.413+0000 7f30bfa00640 1 -- 172.21.15.42:0/911302056 shutdown_connections 2024-09-17T01:46:35.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.413+0000 7f30bfa00640 1 --2- 172.21.15.42:0/911302056 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3094078b90 0x7f309407b0a0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:35.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.413+0000 7f30bfa00640 1 --2- 172.21.15.42:0/911302056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30b80cef70 0x7f30b81f77a0 unknown :-1 s=CLOSED pgs=2140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:35.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.413+0000 7f30bfa00640 1 --2- 172.21.15.42:0/911302056 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f30b80b5100 0x7f30b81f7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:35.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.413+0000 7f30bfa00640 1 --2- 172.21.15.42:0/911302056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30b806d430 0x7f30b8152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:35.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.413+0000 7f30bfa00640 1 -- 172.21.15.42:0/911302056 >> 172.21.15.42:0/911302056 conn(0x7f30b80b2930 msgr2=0x7f30b80ccf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:35.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.413+0000 7f30bfa00640 1 -- 172.21.15.42:0/911302056 shutdown_connections 2024-09-17T01:46:35.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.413+0000 7f30bfa00640 1 -- 172.21.15.42:0/911302056 wait complete. 2024-09-17T01:46:35.434 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T01:46:35.434 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:46:35.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.664+0000 7f6ce1c00640 1 -- 172.21.15.42:0/1840685117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cdc142f40 msgr2=0x7f6cdc072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:35.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.664+0000 7f6ce1c00640 1 --2- 172.21.15.42:0/1840685117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cdc142f40 0x7f6cdc072950 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4005fd0 tx=0x7f6cc402a540 comp rx=0 tx=0).stop 2024-09-17T01:46:35.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.664+0000 7f6ce1c00640 1 -- 172.21.15.42:0/1840685117 shutdown_connections 2024-09-17T01:46:35.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.664+0000 7f6ce1c00640 1 --2- 172.21.15.42:0/1840685117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cdc142f40 0x7f6cdc072950 unknown :-1 s=CLOSED pgs=2141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:35.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.664+0000 7f6ce1c00640 1 --2- 172.21.15.42:0/1840685117 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6cdc0b3550 0x7f6cdc15cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:35.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.664+0000 7f6ce1c00640 1 -- 172.21.15.42:0/1840685117 >> 172.21.15.42:0/1840685117 conn(0x7f6cdc0b2930 msgr2=0x7f6cdc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:35.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.664+0000 7f6ce1c00640 1 -- 172.21.15.42:0/1840685117 shutdown_connections 2024-09-17T01:46:35.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.664+0000 7f6ce1c00640 1 -- 172.21.15.42:0/1840685117 wait complete. 2024-09-17T01:46:35.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.666+0000 7f6ce1c00640 1 Processor -- start 2024-09-17T01:46:35.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.666+0000 7f6ce1c00640 1 -- start start 2024-09-17T01:46:35.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.668+0000 7f6ce1c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cdc072e90 0x7f6cdc159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:35.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.668+0000 7f6ce1c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cdc0b3550 0x7f6cdc1f6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:35.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.668+0000 7f6ce1c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6cdc142f40 0x7f6cdc1f7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:35.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.668+0000 7f6ce1c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc06d7c0 con 0x7f6cdc072e90 2024-09-17T01:46:35.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.668+0000 7f6ce1c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc06d640 con 0x7f6cdc0b3550 2024-09-17T01:46:35.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.668+0000 7f6ce1c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6cdc06d940 con 0x7f6cdc142f40 2024-09-17T01:46:35.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.668+0000 7f6cdaa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cdc072e90 0x7f6cdc159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:35.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.668+0000 7f6cdaa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cdc072e90 0x7f6cdc159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54184/0 (socket says 172.21.15.42:54184) 2024-09-17T01:46:35.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.668+0000 7f6cdaa00640 1 -- 172.21.15.42:0/3390294474 learned_addr learned my addr 172.21.15.42:0/3390294474 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:35.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.668+0000 7f6cd2000640 1 --2- 172.21.15.42:0/3390294474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cdc0b3550 0x7f6cdc1f6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:35.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.668+0000 7f6cdb400640 1 --2- 172.21.15.42:0/3390294474 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6cdc142f40 0x7f6cdc1f7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:35.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.669+0000 7f6cdaa00640 1 -- 172.21.15.42:0/3390294474 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6cdc142f40 msgr2=0x7f6cdc1f7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:35.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.669+0000 7f6cdaa00640 1 --2- 172.21.15.42:0/3390294474 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6cdc142f40 0x7f6cdc1f7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:35.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.669+0000 7f6cdaa00640 1 -- 172.21.15.42:0/3390294474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cdc0b3550 msgr2=0x7f6cdc1f6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:35.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.669+0000 7f6cdaa00640 1 --2- 172.21.15.42:0/3390294474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cdc0b3550 0x7f6cdc1f6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:35.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.669+0000 7f6cdaa00640 1 -- 172.21.15.42:0/3390294474 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cdc13e5e0 con 0x7f6cdc072e90 2024-09-17T01:46:35.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.669+0000 7f6cd2000640 1 --2- 172.21.15.42:0/3390294474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cdc0b3550 0x7f6cdc1f6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:35.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.669+0000 7f6cdaa00640 1 --2- 172.21.15.42:0/3390294474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cdc072e90 0x7f6cdc159780 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00d740 tx=0x7f6ccc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:35.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.669+0000 7f6cd3400640 1 -- 172.21.15.42:0/3390294474 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc017070 con 0x7f6cdc072e90 2024-09-17T01:46:35.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.669+0000 7f6cd3400640 1 -- 172.21.15.42:0/3390294474 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ccc009ab0 con 0x7f6cdc072e90 2024-09-17T01:46:35.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.669+0000 7f6cd3400640 1 -- 172.21.15.42:0/3390294474 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc010460 con 0x7f6cdc072e90 2024-09-17T01:46:35.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.669+0000 7f6ce1c00640 1 -- 172.21.15.42:0/3390294474 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cdc1f7d20 con 0x7f6cdc072e90 2024-09-17T01:46:35.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.669+0000 7f6ce1c00640 1 -- 172.21.15.42:0/3390294474 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cdc141a50 con 0x7f6cdc072e90 2024-09-17T01:46:35.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.670+0000 7f6ce1c00640 1 -- 172.21.15.42:0/3390294474 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cdc06a3f0 con 0x7f6cdc072e90 2024-09-17T01:46:35.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.672+0000 7f6cd3400640 1 -- 172.21.15.42:0/3390294474 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ccc01a070 con 0x7f6cdc072e90 2024-09-17T01:46:35.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.673+0000 7f6cd3400640 1 --2- 172.21.15.42:0/3390294474 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6cb8078b90 0x7f6cb807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:35.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.674+0000 7f6cd3400640 1 -- 172.21.15.42:0/3390294474 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f6ccc09aea0 con 0x7f6cdc072e90 2024-09-17T01:46:35.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.674+0000 7f6cd2000640 1 --2- 172.21.15.42:0/3390294474 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6cb8078b90 0x7f6cb807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:35.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.675+0000 7f6cd2000640 1 --2- 172.21.15.42:0/3390294474 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6cb8078b90 0x7f6cb807b0a0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4033000 tx=0x7f6cc4004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:35.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.678+0000 7f6cd3400640 1 -- 172.21.15.42:0/3390294474 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6cdc06a3f0 con 0x7f6cdc072e90 2024-09-17T01:46:35.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.868+0000 7f6ce1c00640 1 -- 172.21.15.42:0/3390294474 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6cdc15cec0 con 0x7f6cb8078b90 2024-09-17T01:46:35.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.873+0000 7f6cd3400640 1 -- 172.21.15.42:0/3390294474 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252131 (secure 0 0 0) 0x7f6cdc15cec0 con 0x7f6cb8078b90 2024-09-17T01:46:35.874 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:46:35.876 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:46:35.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.877+0000 7f6ce1c00640 1 -- 172.21.15.42:0/3390294474 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6cb8078b90 msgr2=0x7f6cb807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:35.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.877+0000 7f6ce1c00640 1 --2- 172.21.15.42:0/3390294474 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6cb8078b90 0x7f6cb807b0a0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4033000 tx=0x7f6cc4004730 comp rx=0 tx=0).stop 2024-09-17T01:46:35.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.878+0000 7f6ce1c00640 1 -- 172.21.15.42:0/3390294474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cdc072e90 msgr2=0x7f6cdc159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:35.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.878+0000 7f6ce1c00640 1 --2- 172.21.15.42:0/3390294474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cdc072e90 0x7f6cdc159780 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00d740 tx=0x7f6ccc00dc00 comp rx=0 tx=0).stop 2024-09-17T01:46:35.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.878+0000 7f6ce1c00640 1 -- 172.21.15.42:0/3390294474 shutdown_connections 2024-09-17T01:46:35.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.878+0000 7f6ce1c00640 1 --2- 172.21.15.42:0/3390294474 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6cb8078b90 0x7f6cb807b0a0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:35.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.878+0000 7f6ce1c00640 1 --2- 172.21.15.42:0/3390294474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cdc0b3550 0x7f6cdc1f6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:35.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.878+0000 7f6ce1c00640 1 --2- 172.21.15.42:0/3390294474 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6cdc142f40 0x7f6cdc1f7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:35.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.878+0000 7f6ce1c00640 1 --2- 172.21.15.42:0/3390294474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cdc072e90 0x7f6cdc159780 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:35.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.878+0000 7f6ce1c00640 1 -- 172.21.15.42:0/3390294474 >> 172.21.15.42:0/3390294474 conn(0x7f6cdc0b2930 msgr2=0x7f6cdc15f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:35.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.878+0000 7f6ce1c00640 1 -- 172.21.15.42:0/3390294474 shutdown_connections 2024-09-17T01:46:35.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:35.878+0000 7f6ce1c00640 1 -- 172.21.15.42:0/3390294474 wait complete. 2024-09-17T01:46:35.902 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":621,"stamp":"2024-09-17T01:46:35.228790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591132,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":134,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":435584,"kb_used_data":19504,"kb_used_omap":12,"kb_used_meta":415859,"kb_avail":754539136,"statfs":{"total":773094113280,"available":772648075264,"internally_reserved":0,"allocated":19972096,"data_stored":9466186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":425840180},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":764,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.836029"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777205+0000","last_change":"2024-09-17T01:46:31.449114+0000","last_active":"2024-09-17T01:46:32.777205+0000","last_peered":"2024-09-17T01:46:32.777205+0000","last_clean":"2024-09-17T01:46:32.777205+0000","last_became_active":"2024-09-17T01:46:31.444897+0000","last_became_peered":"2024-09-17T01:46:31.444897+0000","last_unstale":"2024-09-17T01:46:32.777205+0000","last_undegraded":"2024-09-17T01:46:32.777205+0000","last_fullsized":"2024-09-17T01:46:32.777205+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:10.122631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425679+0000","last_change":"2024-09-17T01:46:31.424827+0000","last_active":"2024-09-17T01:46:32.425679+0000","last_peered":"2024-09-17T01:46:32.425679+0000","last_clean":"2024-09-17T01:46:32.425679+0000","last_became_active":"2024-09-17T01:46:31.424256+0000","last_became_peered":"2024-09-17T01:46:31.424256+0000","last_unstale":"2024-09-17T01:46:32.425679+0000","last_undegraded":"2024-09-17T01:46:32.425679+0000","last_fullsized":"2024-09-17T01:46:32.425679+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:16.070389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428308+0000","last_change":"2024-09-17T01:46:31.440514+0000","last_active":"2024-09-17T01:46:32.428308+0000","last_peered":"2024-09-17T01:46:32.428308+0000","last_clean":"2024-09-17T01:46:32.428308+0000","last_became_active":"2024-09-17T01:46:31.439579+0000","last_became_peered":"2024-09-17T01:46:31.439579+0000","last_unstale":"2024-09-17T01:46:32.428308+0000","last_undegraded":"2024-09-17T01:46:32.428308+0000","last_fullsized":"2024-09-17T01:46:32.428308+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:43.542003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776158+0000","last_change":"2024-09-17T01:46:31.434326+0000","last_active":"2024-09-17T01:46:32.776158+0000","last_peered":"2024-09-17T01:46:32.776158+0000","last_clean":"2024-09-17T01:46:32.776158+0000","last_became_active":"2024-09-17T01:46:31.434028+0000","last_became_peered":"2024-09-17T01:46:31.434028+0000","last_unstale":"2024-09-17T01:46:32.776158+0000","last_undegraded":"2024-09-17T01:46:32.776158+0000","last_fullsized":"2024-09-17T01:46:32.776158+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:36.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428626+0000","last_change":"2024-09-17T01:46:31.444693+0000","last_active":"2024-09-17T01:46:32.428626+0000","last_peered":"2024-09-17T01:46:32.428626+0000","last_clean":"2024-09-17T01:46:32.428626+0000","last_became_active":"2024-09-17T01:46:31.444143+0000","last_became_peered":"2024-09-17T01:46:31.444143+0000","last_unstale":"2024-09-17T01:46:32.428626+0000","last_undegraded":"2024-09-17T01:46:32.428626+0000","last_fullsized":"2024-09-17T01:46:32.428626+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:19:45.427741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777290+0000","last_change":"2024-09-17T01:46:31.439648+0000","last_active":"2024-09-17T01:46:32.777290+0000","last_peered":"2024-09-17T01:46:32.777290+0000","last_clean":"2024-09-17T01:46:32.777290+0000","last_became_active":"2024-09-17T01:46:31.439317+0000","last_became_peered":"2024-09-17T01:46:31.439317+0000","last_unstale":"2024-09-17T01:46:32.777290+0000","last_undegraded":"2024-09-17T01:46:32.777290+0000","last_fullsized":"2024-09-17T01:46:32.777290+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:29.867513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776468+0000","last_change":"2024-09-17T01:46:31.446698+0000","last_active":"2024-09-17T01:46:32.776468+0000","last_peered":"2024-09-17T01:46:32.776468+0000","last_clean":"2024-09-17T01:46:32.776468+0000","last_became_active":"2024-09-17T01:46:31.446416+0000","last_became_peered":"2024-09-17T01:46:31.446416+0000","last_unstale":"2024-09-17T01:46:32.776468+0000","last_undegraded":"2024-09-17T01:46:32.776468+0000","last_fullsized":"2024-09-17T01:46:32.776468+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:32.837724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426360+0000","last_change":"2024-09-17T01:46:31.426666+0000","last_active":"2024-09-17T01:46:32.426360+0000","last_peered":"2024-09-17T01:46:32.426360+0000","last_clean":"2024-09-17T01:46:32.426360+0000","last_became_active":"2024-09-17T01:46:31.426352+0000","last_became_peered":"2024-09-17T01:46:31.426352+0000","last_unstale":"2024-09-17T01:46:32.426360+0000","last_undegraded":"2024-09-17T01:46:32.426360+0000","last_fullsized":"2024-09-17T01:46:32.426360+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:04.991154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2024-09-17T01:46:30.407450+0000","last_change":"2024-09-17T01:46:30.407450+0000","last_active":"2024-09-17T01:46:30.391480+0000","last_peered":"2024-09-17T01:46:30.391480+0000","last_clean":"2024-09-17T01:46:30.391480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:46:30.407450+0000","last_undegraded":"2024-09-17T01:46:30.407450+0000","last_fullsized":"2024-09-17T01:46:30.407450+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428433+0000","last_change":"2024-09-17T01:46:31.438389+0000","last_active":"2024-09-17T01:46:32.428433+0000","last_peered":"2024-09-17T01:46:32.428433+0000","last_clean":"2024-09-17T01:46:32.428433+0000","last_became_active":"2024-09-17T01:46:31.437275+0000","last_became_peered":"2024-09-17T01:46:31.437275+0000","last_unstale":"2024-09-17T01:46:32.428433+0000","last_undegraded":"2024-09-17T01:46:32.428433+0000","last_fullsized":"2024-09-17T01:46:32.428433+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:12:42.193215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777056+0000","last_change":"2024-09-17T01:46:31.441613+0000","last_active":"2024-09-17T01:46:32.777056+0000","last_peered":"2024-09-17T01:46:32.777056+0000","last_clean":"2024-09-17T01:46:32.777056+0000","last_became_active":"2024-09-17T01:46:31.440235+0000","last_became_peered":"2024-09-17T01:46:31.440235+0000","last_unstale":"2024-09-17T01:46:32.777056+0000","last_undegraded":"2024-09-17T01:46:32.777056+0000","last_fullsized":"2024-09-17T01:46:32.777056+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:32.524306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775618+0000","last_change":"2024-09-17T01:46:31.416960+0000","last_active":"2024-09-17T01:46:32.775618+0000","last_peered":"2024-09-17T01:46:32.775618+0000","last_clean":"2024-09-17T01:46:32.775618+0000","last_became_active":"2024-09-17T01:46:31.416577+0000","last_became_peered":"2024-09-17T01:46:31.416577+0000","last_unstale":"2024-09-17T01:46:32.775618+0000","last_undegraded":"2024-09-17T01:46:32.775618+0000","last_fullsized":"2024-09-17T01:46:32.775618+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:52:25.962925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775387+0000","last_change":"2024-09-17T01:46:31.428536+0000","last_active":"2024-09-17T01:46:32.775387+0000","last_peered":"2024-09-17T01:46:32.775387+0000","last_clean":"2024-09-17T01:46:32.775387+0000","last_became_active":"2024-09-17T01:46:31.425769+0000","last_became_peered":"2024-09-17T01:46:31.425769+0000","last_unstale":"2024-09-17T01:46:32.775387+0000","last_undegraded":"2024-09-17T01:46:32.775387+0000","last_fullsized":"2024-09-17T01:46:32.775387+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:22:23.512532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775774+0000","last_change":"2024-09-17T01:46:31.427311+0000","last_active":"2024-09-17T01:46:32.775774+0000","last_peered":"2024-09-17T01:46:32.775774+0000","last_clean":"2024-09-17T01:46:32.775774+0000","last_became_active":"2024-09-17T01:46:31.426922+0000","last_became_peered":"2024-09-17T01:46:31.426922+0000","last_unstale":"2024-09-17T01:46:32.775774+0000","last_undegraded":"2024-09-17T01:46:32.775774+0000","last_fullsized":"2024-09-17T01:46:32.775774+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:28.913481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776459+0000","last_change":"2024-09-17T01:46:31.445995+0000","last_active":"2024-09-17T01:46:32.776459+0000","last_peered":"2024-09-17T01:46:32.776459+0000","last_clean":"2024-09-17T01:46:32.776459+0000","last_became_active":"2024-09-17T01:46:31.442444+0000","last_became_peered":"2024-09-17T01:46:31.442444+0000","last_unstale":"2024-09-17T01:46:32.776459+0000","last_undegraded":"2024-09-17T01:46:32.776459+0000","last_fullsized":"2024-09-17T01:46:32.776459+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:27.316162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776447+0000","last_change":"2024-09-17T01:46:31.432472+0000","last_active":"2024-09-17T01:46:32.776447+0000","last_peered":"2024-09-17T01:46:32.776447+0000","last_clean":"2024-09-17T01:46:32.776447+0000","last_became_active":"2024-09-17T01:46:31.431958+0000","last_became_peered":"2024-09-17T01:46:31.431958+0000","last_unstale":"2024-09-17T01:46:32.776447+0000","last_undegraded":"2024-09-17T01:46:32.776447+0000","last_fullsized":"2024-09-17T01:46:32.776447+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:44.766306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777329+0000","last_change":"2024-09-17T01:46:31.444639+0000","last_active":"2024-09-17T01:46:32.777329+0000","last_peered":"2024-09-17T01:46:32.777329+0000","last_clean":"2024-09-17T01:46:32.777329+0000","last_became_active":"2024-09-17T01:46:31.442591+0000","last_became_peered":"2024-09-17T01:46:31.442591+0000","last_unstale":"2024-09-17T01:46:32.777329+0000","last_undegraded":"2024-09-17T01:46:32.777329+0000","last_fullsized":"2024-09-17T01:46:32.777329+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:11.846706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428771+0000","last_change":"2024-09-17T01:46:31.434660+0000","last_active":"2024-09-17T01:46:32.428771+0000","last_peered":"2024-09-17T01:46:32.428771+0000","last_clean":"2024-09-17T01:46:32.428771+0000","last_became_active":"2024-09-17T01:46:31.434321+0000","last_became_peered":"2024-09-17T01:46:31.434321+0000","last_unstale":"2024-09-17T01:46:32.428771+0000","last_undegraded":"2024-09-17T01:46:32.428771+0000","last_fullsized":"2024-09-17T01:46:32.428771+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:11.153289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.429127+0000","last_change":"2024-09-17T01:46:31.439946+0000","last_active":"2024-09-17T01:46:32.429127+0000","last_peered":"2024-09-17T01:46:32.429127+0000","last_clean":"2024-09-17T01:46:32.429127+0000","last_became_active":"2024-09-17T01:46:31.439546+0000","last_became_peered":"2024-09-17T01:46:31.439546+0000","last_unstale":"2024-09-17T01:46:32.429127+0000","last_undegraded":"2024-09-17T01:46:32.429127+0000","last_fullsized":"2024-09-17T01:46:32.429127+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:05.120666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428283+0000","last_change":"2024-09-17T01:46:31.437213+0000","last_active":"2024-09-17T01:46:32.428283+0000","last_peered":"2024-09-17T01:46:32.428283+0000","last_clean":"2024-09-17T01:46:32.428283+0000","last_became_active":"2024-09-17T01:46:31.436423+0000","last_became_peered":"2024-09-17T01:46:31.436423+0000","last_unstale":"2024-09-17T01:46:32.428283+0000","last_undegraded":"2024-09-17T01:46:32.428283+0000","last_fullsized":"2024-09-17T01:46:32.428283+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:27.109581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776147+0000","last_change":"2024-09-17T01:46:31.427386+0000","last_active":"2024-09-17T01:46:32.776147+0000","last_peered":"2024-09-17T01:46:32.776147+0000","last_clean":"2024-09-17T01:46:32.776147+0000","last_became_active":"2024-09-17T01:46:31.425405+0000","last_became_peered":"2024-09-17T01:46:31.425405+0000","last_unstale":"2024-09-17T01:46:32.776147+0000","last_undegraded":"2024-09-17T01:46:32.776147+0000","last_fullsized":"2024-09-17T01:46:32.776147+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:43.277654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425441+0000","last_change":"2024-09-17T01:46:31.436812+0000","last_active":"2024-09-17T01:46:32.425441+0000","last_peered":"2024-09-17T01:46:32.425441+0000","last_clean":"2024-09-17T01:46:32.425441+0000","last_became_active":"2024-09-17T01:46:31.436297+0000","last_became_peered":"2024-09-17T01:46:31.436297+0000","last_unstale":"2024-09-17T01:46:32.425441+0000","last_undegraded":"2024-09-17T01:46:32.425441+0000","last_fullsized":"2024-09-17T01:46:32.425441+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:32:19.529698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775436+0000","last_change":"2024-09-17T01:46:31.423114+0000","last_active":"2024-09-17T01:46:32.775436+0000","last_peered":"2024-09-17T01:46:32.775436+0000","last_clean":"2024-09-17T01:46:32.775436+0000","last_became_active":"2024-09-17T01:46:31.422795+0000","last_became_peered":"2024-09-17T01:46:31.422795+0000","last_unstale":"2024-09-17T01:46:32.775436+0000","last_undegraded":"2024-09-17T01:46:32.775436+0000","last_fullsized":"2024-09-17T01:46:32.775436+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:07.226908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2024-09-17T01:46:30.407363+0000","last_change":"2024-09-17T01:46:30.407363+0000","last_active":"2024-09-17T01:46:30.391480+0000","last_peered":"2024-09-17T01:46:30.391480+0000","last_clean":"2024-09-17T01:46:30.391480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:46:30.407363+0000","last_undegraded":"2024-09-17T01:46:30.407363+0000","last_fullsized":"2024-09-17T01:46:30.407363+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776072+0000","last_change":"2024-09-17T01:46:31.446218+0000","last_active":"2024-09-17T01:46:32.776072+0000","last_peered":"2024-09-17T01:46:32.776072+0000","last_clean":"2024-09-17T01:46:32.776072+0000","last_became_active":"2024-09-17T01:46:31.445885+0000","last_became_peered":"2024-09-17T01:46:31.445885+0000","last_unstale":"2024-09-17T01:46:32.776072+0000","last_undegraded":"2024-09-17T01:46:32.776072+0000","last_fullsized":"2024-09-17T01:46:32.776072+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:06.717241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427501+0000","last_change":"2024-09-17T01:46:31.426677+0000","last_active":"2024-09-17T01:46:32.427501+0000","last_peered":"2024-09-17T01:46:32.427501+0000","last_clean":"2024-09-17T01:46:32.427501+0000","last_became_active":"2024-09-17T01:46:31.425517+0000","last_became_peered":"2024-09-17T01:46:31.425517+0000","last_unstale":"2024-09-17T01:46:32.427501+0000","last_undegraded":"2024-09-17T01:46:32.427501+0000","last_fullsized":"2024-09-17T01:46:32.427501+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:31.981218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775884+0000","last_change":"2024-09-17T01:46:31.425570+0000","last_active":"2024-09-17T01:46:32.775884+0000","last_peered":"2024-09-17T01:46:32.775884+0000","last_clean":"2024-09-17T01:46:32.775884+0000","last_became_active":"2024-09-17T01:46:31.425256+0000","last_became_peered":"2024-09-17T01:46:31.425256+0000","last_unstale":"2024-09-17T01:46:32.775884+0000","last_undegraded":"2024-09-17T01:46:32.775884+0000","last_fullsized":"2024-09-17T01:46:32.775884+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:40.200273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427198+0000","last_change":"2024-09-17T01:46:31.422013+0000","last_active":"2024-09-17T01:46:32.427198+0000","last_peered":"2024-09-17T01:46:32.427198+0000","last_clean":"2024-09-17T01:46:32.427198+0000","last_became_active":"2024-09-17T01:46:31.421574+0000","last_became_peered":"2024-09-17T01:46:31.421574+0000","last_unstale":"2024-09-17T01:46:32.427198+0000","last_undegraded":"2024-09-17T01:46:32.427198+0000","last_fullsized":"2024-09-17T01:46:32.427198+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:13.432651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425439+0000","last_change":"2024-09-17T01:46:31.426049+0000","last_active":"2024-09-17T01:46:32.425439+0000","last_peered":"2024-09-17T01:46:32.425439+0000","last_clean":"2024-09-17T01:46:32.425439+0000","last_became_active":"2024-09-17T01:46:31.425700+0000","last_became_peered":"2024-09-17T01:46:31.425700+0000","last_unstale":"2024-09-17T01:46:32.425439+0000","last_undegraded":"2024-09-17T01:46:32.425439+0000","last_fullsized":"2024-09-17T01:46:32.425439+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:15.961268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775828+0000","last_change":"2024-09-17T01:46:31.445360+0000","last_active":"2024-09-17T01:46:32.775828+0000","last_peered":"2024-09-17T01:46:32.775828+0000","last_clean":"2024-09-17T01:46:32.775828+0000","last_became_active":"2024-09-17T01:46:31.445034+0000","last_became_peered":"2024-09-17T01:46:31.445034+0000","last_unstale":"2024-09-17T01:46:32.775828+0000","last_undegraded":"2024-09-17T01:46:32.775828+0000","last_fullsized":"2024-09-17T01:46:32.775828+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:18.585792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426826+0000","last_change":"2024-09-17T01:46:31.436801+0000","last_active":"2024-09-17T01:46:32.426826+0000","last_peered":"2024-09-17T01:46:32.426826+0000","last_clean":"2024-09-17T01:46:32.426826+0000","last_became_active":"2024-09-17T01:46:31.436442+0000","last_became_peered":"2024-09-17T01:46:31.436442+0000","last_unstale":"2024-09-17T01:46:32.426826+0000","last_undegraded":"2024-09-17T01:46:32.426826+0000","last_fullsized":"2024-09-17T01:46:32.426826+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:29.158716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776024+0000","last_change":"2024-09-17T01:46:31.435302+0000","last_active":"2024-09-17T01:46:32.776024+0000","last_peered":"2024-09-17T01:46:32.776024+0000","last_clean":"2024-09-17T01:46:32.776024+0000","last_became_active":"2024-09-17T01:46:31.435007+0000","last_became_peered":"2024-09-17T01:46:31.435007+0000","last_unstale":"2024-09-17T01:46:32.776024+0000","last_undegraded":"2024-09-17T01:46:32.776024+0000","last_fullsized":"2024-09-17T01:46:32.776024+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:06.685153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776762+0000","last_change":"2024-09-17T01:46:31.422309+0000","last_active":"2024-09-17T01:46:32.776762+0000","last_peered":"2024-09-17T01:46:32.776762+0000","last_clean":"2024-09-17T01:46:32.776762+0000","last_became_active":"2024-09-17T01:46:31.421687+0000","last_became_peered":"2024-09-17T01:46:31.421687+0000","last_unstale":"2024-09-17T01:46:32.776762+0000","last_undegraded":"2024-09-17T01:46:32.776762+0000","last_fullsized":"2024-09-17T01:46:32.776762+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:23.754735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1f","version":"186'4","reported_seq":19,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776472+0000","last_change":"2024-09-17T01:46:30.421999+0000","last_active":"2024-09-17T01:46:32.776472+0000","last_peered":"2024-09-17T01:46:32.776472+0000","last_clean":"2024-09-17T01:46:32.776472+0000","last_became_active":"2024-09-17T01:46:30.421444+0000","last_became_peered":"2024-09-17T01:46:30.421444+0000","last_unstale":"2024-09-17T01:46:32.776472+0000","last_undegraded":"2024-09-17T01:46:32.776472+0000","last_fullsized":"2024-09-17T01:46:32.776472+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:19:33.239539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776314+0000","last_change":"2024-09-17T01:46:31.436431+0000","last_active":"2024-09-17T01:46:32.776314+0000","last_peered":"2024-09-17T01:46:32.776314+0000","last_clean":"2024-09-17T01:46:32.776314+0000","last_became_active":"2024-09-17T01:46:31.436098+0000","last_became_peered":"2024-09-17T01:46:31.436098+0000","last_unstale":"2024-09-17T01:46:32.776314+0000","last_undegraded":"2024-09-17T01:46:32.776314+0000","last_fullsized":"2024-09-17T01:46:32.776314+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:10.579523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1e","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425770+0000","last_change":"2024-09-17T01:46:30.414291+0000","last_active":"2024-09-17T01:46:32.425770+0000","last_peered":"2024-09-17T01:46:32.425770+0000","last_clean":"2024-09-17T01:46:32.425770+0000","last_became_active":"2024-09-17T01:46:30.413782+0000","last_became_peered":"2024-09-17T01:46:30.413782+0000","last_unstale":"2024-09-17T01:46:32.425770+0000","last_undegraded":"2024-09-17T01:46:32.425770+0000","last_fullsized":"2024-09-17T01:46:32.425770+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:04.480361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428927+0000","last_change":"2024-09-17T01:46:31.435399+0000","last_active":"2024-09-17T01:46:32.428927+0000","last_peered":"2024-09-17T01:46:32.428927+0000","last_clean":"2024-09-17T01:46:32.428927+0000","last_became_active":"2024-09-17T01:46:31.434992+0000","last_became_peered":"2024-09-17T01:46:31.434992+0000","last_unstale":"2024-09-17T01:46:32.428927+0000","last_undegraded":"2024-09-17T01:46:32.428927+0000","last_fullsized":"2024-09-17T01:46:32.428927+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:50:55.804363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"186'2","reported_seq":17,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427047+0000","last_change":"2024-09-17T01:46:30.417874+0000","last_active":"2024-09-17T01:46:32.427047+0000","last_peered":"2024-09-17T01:46:32.427047+0000","last_clean":"2024-09-17T01:46:32.427047+0000","last_became_active":"2024-09-17T01:46:30.416190+0000","last_became_peered":"2024-09-17T01:46:30.416190+0000","last_unstale":"2024-09-17T01:46:32.427047+0000","last_undegraded":"2024-09-17T01:46:32.427047+0000","last_fullsized":"2024-09-17T01:46:32.427047+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:02.232021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428642+0000","last_change":"2024-09-17T01:46:31.443348+0000","last_active":"2024-09-17T01:46:32.428642+0000","last_peered":"2024-09-17T01:46:32.428642+0000","last_clean":"2024-09-17T01:46:32.428642+0000","last_became_active":"2024-09-17T01:46:31.439978+0000","last_became_peered":"2024-09-17T01:46:31.439978+0000","last_unstale":"2024-09-17T01:46:32.428642+0000","last_undegraded":"2024-09-17T01:46:32.428642+0000","last_fullsized":"2024-09-17T01:46:32.428642+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:30.533657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1c","version":"186'2","reported_seq":17,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776234+0000","last_change":"2024-09-17T01:46:30.419634+0000","last_active":"2024-09-17T01:46:32.776234+0000","last_peered":"2024-09-17T01:46:32.776234+0000","last_clean":"2024-09-17T01:46:32.776234+0000","last_became_active":"2024-09-17T01:46:30.419304+0000","last_became_peered":"2024-09-17T01:46:30.419304+0000","last_unstale":"2024-09-17T01:46:32.776234+0000","last_undegraded":"2024-09-17T01:46:32.776234+0000","last_fullsized":"2024-09-17T01:46:32.776234+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:05.285011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775650+0000","last_change":"2024-09-17T01:46:31.440666+0000","last_active":"2024-09-17T01:46:32.775650+0000","last_peered":"2024-09-17T01:46:32.775650+0000","last_clean":"2024-09-17T01:46:32.775650+0000","last_became_active":"2024-09-17T01:46:31.439118+0000","last_became_peered":"2024-09-17T01:46:31.439118+0000","last_unstale":"2024-09-17T01:46:32.775650+0000","last_undegraded":"2024-09-17T01:46:32.775650+0000","last_fullsized":"2024-09-17T01:46:32.775650+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:11.746299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777424+0000","last_change":"2024-09-17T01:46:30.424178+0000","last_active":"2024-09-17T01:46:32.777424+0000","last_peered":"2024-09-17T01:46:32.777424+0000","last_clean":"2024-09-17T01:46:32.777424+0000","last_became_active":"2024-09-17T01:46:30.423653+0000","last_became_peered":"2024-09-17T01:46:30.423653+0000","last_unstale":"2024-09-17T01:46:32.777424+0000","last_undegraded":"2024-09-17T01:46:32.777424+0000","last_fullsized":"2024-09-17T01:46:32.777424+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:01:57.156162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776415+0000","last_change":"2024-09-17T01:46:31.428613+0000","last_active":"2024-09-17T01:46:32.776415+0000","last_peered":"2024-09-17T01:46:32.776415+0000","last_clean":"2024-09-17T01:46:32.776415+0000","last_became_active":"2024-09-17T01:46:31.428070+0000","last_became_peered":"2024-09-17T01:46:31.428070+0000","last_unstale":"2024-09-17T01:46:32.776415+0000","last_undegraded":"2024-09-17T01:46:32.776415+0000","last_fullsized":"2024-09-17T01:46:32.776415+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:02.001662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426445+0000","last_change":"2024-09-17T01:46:30.419541+0000","last_active":"2024-09-17T01:46:32.426445+0000","last_peered":"2024-09-17T01:46:32.426445+0000","last_clean":"2024-09-17T01:46:32.426445+0000","last_became_active":"2024-09-17T01:46:30.417201+0000","last_became_peered":"2024-09-17T01:46:30.417201+0000","last_unstale":"2024-09-17T01:46:32.426445+0000","last_undegraded":"2024-09-17T01:46:32.426445+0000","last_fullsized":"2024-09-17T01:46:32.426445+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:53.835043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2024-09-17T01:46:30.406938+0000","last_change":"2024-09-17T01:46:30.406938+0000","last_active":"2024-09-17T01:46:30.391480+0000","last_peered":"2024-09-17T01:46:30.391480+0000","last_clean":"2024-09-17T01:46:30.391480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:46:30.406938+0000","last_undegraded":"2024-09-17T01:46:30.406938+0000","last_fullsized":"2024-09-17T01:46:30.406938+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775314+0000","last_change":"2024-09-17T01:46:30.425424+0000","last_active":"2024-09-17T01:46:32.775314+0000","last_peered":"2024-09-17T01:46:32.775314+0000","last_clean":"2024-09-17T01:46:32.775314+0000","last_became_active":"2024-09-17T01:46:30.424776+0000","last_became_peered":"2024-09-17T01:46:30.424776+0000","last_unstale":"2024-09-17T01:46:32.775314+0000","last_undegraded":"2024-09-17T01:46:32.775314+0000","last_fullsized":"2024-09-17T01:46:32.775314+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:00.655765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776220+0000","last_change":"2024-09-17T01:46:31.445355+0000","last_active":"2024-09-17T01:46:32.776220+0000","last_peered":"2024-09-17T01:46:32.776220+0000","last_clean":"2024-09-17T01:46:32.776220+0000","last_became_active":"2024-09-17T01:46:31.445006+0000","last_became_peered":"2024-09-17T01:46:31.445006+0000","last_unstale":"2024-09-17T01:46:32.776220+0000","last_undegraded":"2024-09-17T01:46:32.776220+0000","last_fullsized":"2024-09-17T01:46:32.776220+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:00:48.418812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428717+0000","last_change":"2024-09-17T01:46:30.425233+0000","last_active":"2024-09-17T01:46:32.428717+0000","last_peered":"2024-09-17T01:46:32.428717+0000","last_clean":"2024-09-17T01:46:32.428717+0000","last_became_active":"2024-09-17T01:46:30.424688+0000","last_became_peered":"2024-09-17T01:46:30.424688+0000","last_unstale":"2024-09-17T01:46:32.428717+0000","last_undegraded":"2024-09-17T01:46:32.428717+0000","last_fullsized":"2024-09-17T01:46:32.428717+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:22.747644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775921+0000","last_change":"2024-09-17T01:46:31.433934+0000","last_active":"2024-09-17T01:46:32.775921+0000","last_peered":"2024-09-17T01:46:32.775921+0000","last_clean":"2024-09-17T01:46:32.775921+0000","last_became_active":"2024-09-17T01:46:31.433582+0000","last_became_peered":"2024-09-17T01:46:31.433582+0000","last_unstale":"2024-09-17T01:46:32.775921+0000","last_undegraded":"2024-09-17T01:46:32.775921+0000","last_fullsized":"2024-09-17T01:46:32.775921+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:12:49.719869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776319+0000","last_change":"2024-09-17T01:46:30.424629+0000","last_active":"2024-09-17T01:46:32.776319+0000","last_peered":"2024-09-17T01:46:32.776319+0000","last_clean":"2024-09-17T01:46:32.776319+0000","last_became_active":"2024-09-17T01:46:30.424304+0000","last_became_peered":"2024-09-17T01:46:30.424304+0000","last_unstale":"2024-09-17T01:46:32.776319+0000","last_undegraded":"2024-09-17T01:46:32.776319+0000","last_fullsized":"2024-09-17T01:46:32.776319+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:56:10.352036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2024-09-17T01:46:30.406859+0000","last_change":"2024-09-17T01:46:30.406859+0000","last_active":"2024-09-17T01:46:30.391480+0000","last_peered":"2024-09-17T01:46:30.391480+0000","last_clean":"2024-09-17T01:46:30.391480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:46:30.406859+0000","last_undegraded":"2024-09-17T01:46:30.406859+0000","last_fullsized":"2024-09-17T01:46:30.406859+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.15","version":"186'3","reported_seq":18,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427149+0000","last_change":"2024-09-17T01:46:30.422242+0000","last_active":"2024-09-17T01:46:32.427149+0000","last_peered":"2024-09-17T01:46:32.427149+0000","last_clean":"2024-09-17T01:46:32.427149+0000","last_became_active":"2024-09-17T01:46:30.421844+0000","last_became_peered":"2024-09-17T01:46:30.421844+0000","last_unstale":"2024-09-17T01:46:32.427149+0000","last_undegraded":"2024-09-17T01:46:32.427149+0000","last_fullsized":"2024-09-17T01:46:32.427149+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:12.309630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426956+0000","last_change":"2024-09-17T01:46:31.428578+0000","last_active":"2024-09-17T01:46:32.426956+0000","last_peered":"2024-09-17T01:46:32.426956+0000","last_clean":"2024-09-17T01:46:32.426956+0000","last_became_active":"2024-09-17T01:46:31.428252+0000","last_became_peered":"2024-09-17T01:46:31.428252+0000","last_unstale":"2024-09-17T01:46:32.426956+0000","last_undegraded":"2024-09-17T01:46:32.426956+0000","last_fullsized":"2024-09-17T01:46:32.426956+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:59:35.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T01:46:30.425094+0000","last_change":"2024-09-17T01:46:30.422374+0000","last_active":"2024-09-17T01:46:30.425094+0000","last_peered":"2024-09-17T01:46:30.425094+0000","last_clean":"2024-09-17T01:46:30.425094+0000","last_became_active":"2024-09-17T01:46:30.421910+0000","last_became_peered":"2024-09-17T01:46:30.421910+0000","last_unstale":"2024-09-17T01:46:30.425094+0000","last_undegraded":"2024-09-17T01:46:30.425094+0000","last_fullsized":"2024-09-17T01:46:30.425094+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:45.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776007+0000","last_change":"2024-09-17T01:46:31.443892+0000","last_active":"2024-09-17T01:46:32.776007+0000","last_peered":"2024-09-17T01:46:32.776007+0000","last_clean":"2024-09-17T01:46:32.776007+0000","last_became_active":"2024-09-17T01:46:31.441114+0000","last_became_peered":"2024-09-17T01:46:31.441114+0000","last_unstale":"2024-09-17T01:46:32.776007+0000","last_undegraded":"2024-09-17T01:46:32.776007+0000","last_fullsized":"2024-09-17T01:46:32.776007+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:43.533425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T01:46:30.425676+0000","last_change":"2024-09-17T01:46:30.423710+0000","last_active":"2024-09-17T01:46:30.425676+0000","last_peered":"2024-09-17T01:46:30.425676+0000","last_clean":"2024-09-17T01:46:30.425676+0000","last_became_active":"2024-09-17T01:46:30.423408+0000","last_became_peered":"2024-09-17T01:46:30.423408+0000","last_unstale":"2024-09-17T01:46:30.425676+0000","last_undegraded":"2024-09-17T01:46:30.425676+0000","last_fullsized":"2024-09-17T01:46:30.425676+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:45.318504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428962+0000","last_change":"2024-09-17T01:46:31.442692+0000","last_active":"2024-09-17T01:46:32.428962+0000","last_peered":"2024-09-17T01:46:32.428962+0000","last_clean":"2024-09-17T01:46:32.428962+0000","last_became_active":"2024-09-17T01:46:31.437975+0000","last_became_peered":"2024-09-17T01:46:31.437975+0000","last_unstale":"2024-09-17T01:46:32.428962+0000","last_undegraded":"2024-09-17T01:46:32.428962+0000","last_fullsized":"2024-09-17T01:46:32.428962+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:24.601060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425179+0000","last_change":"2024-09-17T01:46:30.417522+0000","last_active":"2024-09-17T01:46:32.425179+0000","last_peered":"2024-09-17T01:46:32.425179+0000","last_clean":"2024-09-17T01:46:32.425179+0000","last_became_active":"2024-09-17T01:46:30.417209+0000","last_became_peered":"2024-09-17T01:46:30.417209+0000","last_unstale":"2024-09-17T01:46:32.425179+0000","last_undegraded":"2024-09-17T01:46:32.425179+0000","last_fullsized":"2024-09-17T01:46:32.425179+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:15.260440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427083+0000","last_change":"2024-09-17T01:46:31.434934+0000","last_active":"2024-09-17T01:46:32.427083+0000","last_peered":"2024-09-17T01:46:32.427083+0000","last_clean":"2024-09-17T01:46:32.427083+0000","last_became_active":"2024-09-17T01:46:31.434566+0000","last_became_peered":"2024-09-17T01:46:31.434566+0000","last_unstale":"2024-09-17T01:46:32.427083+0000","last_undegraded":"2024-09-17T01:46:32.427083+0000","last_fullsized":"2024-09-17T01:46:32.427083+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:47.607553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426560+0000","last_change":"2024-09-17T01:46:30.404274+0000","last_active":"2024-09-17T01:46:32.426560+0000","last_peered":"2024-09-17T01:46:32.426560+0000","last_clean":"2024-09-17T01:46:32.426560+0000","last_became_active":"2024-09-17T01:46:30.403501+0000","last_became_peered":"2024-09-17T01:46:30.403501+0000","last_unstale":"2024-09-17T01:46:32.426560+0000","last_undegraded":"2024-09-17T01:46:32.426560+0000","last_fullsized":"2024-09-17T01:46:32.426560+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:51.012757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777176+0000","last_change":"2024-09-17T01:46:31.436778+0000","last_active":"2024-09-17T01:46:32.777176+0000","last_peered":"2024-09-17T01:46:32.777176+0000","last_clean":"2024-09-17T01:46:32.777176+0000","last_became_active":"2024-09-17T01:46:31.436441+0000","last_became_peered":"2024-09-17T01:46:31.436441+0000","last_unstale":"2024-09-17T01:46:32.777176+0000","last_undegraded":"2024-09-17T01:46:32.777176+0000","last_fullsized":"2024-09-17T01:46:32.777176+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:54.967884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.10","version":"186'8","reported_seq":23,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426761+0000","last_change":"2024-09-17T01:46:30.414504+0000","last_active":"2024-09-17T01:46:32.426761+0000","last_peered":"2024-09-17T01:46:32.426761+0000","last_clean":"2024-09-17T01:46:32.426761+0000","last_became_active":"2024-09-17T01:46:30.414064+0000","last_became_peered":"2024-09-17T01:46:30.414064+0000","last_unstale":"2024-09-17T01:46:32.426761+0000","last_undegraded":"2024-09-17T01:46:32.426761+0000","last_fullsized":"2024-09-17T01:46:32.426761+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:16.932888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776776+0000","last_change":"2024-09-17T01:46:31.420586+0000","last_active":"2024-09-17T01:46:32.776776+0000","last_peered":"2024-09-17T01:46:32.776776+0000","last_clean":"2024-09-17T01:46:32.776776+0000","last_became_active":"2024-09-17T01:46:31.420292+0000","last_became_peered":"2024-09-17T01:46:31.420292+0000","last_unstale":"2024-09-17T01:46:32.776776+0000","last_undegraded":"2024-09-17T01:46:32.776776+0000","last_fullsized":"2024-09-17T01:46:32.776776+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:19:40.212633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.f","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777536+0000","last_change":"2024-09-17T01:46:30.424539+0000","last_active":"2024-09-17T01:46:32.777536+0000","last_peered":"2024-09-17T01:46:32.777536+0000","last_clean":"2024-09-17T01:46:32.777536+0000","last_became_active":"2024-09-17T01:46:30.424219+0000","last_became_peered":"2024-09-17T01:46:30.424219+0000","last_unstale":"2024-09-17T01:46:32.777536+0000","last_undegraded":"2024-09-17T01:46:32.777536+0000","last_fullsized":"2024-09-17T01:46:32.777536+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:10.664092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776865+0000","last_change":"2024-09-17T01:46:31.440377+0000","last_active":"2024-09-17T01:46:32.776865+0000","last_peered":"2024-09-17T01:46:32.776865+0000","last_clean":"2024-09-17T01:46:32.776865+0000","last_became_active":"2024-09-17T01:46:31.439915+0000","last_became_peered":"2024-09-17T01:46:31.439915+0000","last_unstale":"2024-09-17T01:46:32.776865+0000","last_undegraded":"2024-09-17T01:46:32.776865+0000","last_fullsized":"2024-09-17T01:46:32.776865+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:33.599429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T01:46:30.422832+0000","last_change":"2024-09-17T01:46:30.419672+0000","last_active":"2024-09-17T01:46:30.422832+0000","last_peered":"2024-09-17T01:46:30.422832+0000","last_clean":"2024-09-17T01:46:30.422832+0000","last_became_active":"2024-09-17T01:46:30.417927+0000","last_became_peered":"2024-09-17T01:46:30.417927+0000","last_unstale":"2024-09-17T01:46:30.422832+0000","last_undegraded":"2024-09-17T01:46:30.422832+0000","last_fullsized":"2024-09-17T01:46:30.422832+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:38:28.341220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428806+0000","last_change":"2024-09-17T01:46:31.437719+0000","last_active":"2024-09-17T01:46:32.428806+0000","last_peered":"2024-09-17T01:46:32.428806+0000","last_clean":"2024-09-17T01:46:32.428806+0000","last_became_active":"2024-09-17T01:46:31.436896+0000","last_became_peered":"2024-09-17T01:46:31.436896+0000","last_unstale":"2024-09-17T01:46:32.428806+0000","last_undegraded":"2024-09-17T01:46:32.428806+0000","last_fullsized":"2024-09-17T01:46:32.428806+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:51.651477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.d","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776068+0000","last_change":"2024-09-17T01:46:30.417554+0000","last_active":"2024-09-17T01:46:32.776068+0000","last_peered":"2024-09-17T01:46:32.776068+0000","last_clean":"2024-09-17T01:46:32.776068+0000","last_became_active":"2024-09-17T01:46:30.416047+0000","last_became_peered":"2024-09-17T01:46:30.416047+0000","last_unstale":"2024-09-17T01:46:32.776068+0000","last_undegraded":"2024-09-17T01:46:32.776068+0000","last_fullsized":"2024-09-17T01:46:32.776068+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:48:22.422721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776996+0000","last_change":"2024-09-17T01:46:31.432802+0000","last_active":"2024-09-17T01:46:32.776996+0000","last_peered":"2024-09-17T01:46:32.776996+0000","last_clean":"2024-09-17T01:46:32.776996+0000","last_became_active":"2024-09-17T01:46:31.431642+0000","last_became_peered":"2024-09-17T01:46:31.431642+0000","last_unstale":"2024-09-17T01:46:32.776996+0000","last_undegraded":"2024-09-17T01:46:32.776996+0000","last_fullsized":"2024-09-17T01:46:32.776996+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:08.595846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776725+0000","last_change":"2024-09-17T01:46:30.422016+0000","last_active":"2024-09-17T01:46:32.776725+0000","last_peered":"2024-09-17T01:46:32.776725+0000","last_clean":"2024-09-17T01:46:32.776725+0000","last_became_active":"2024-09-17T01:46:30.421643+0000","last_became_peered":"2024-09-17T01:46:30.421643+0000","last_unstale":"2024-09-17T01:46:32.776725+0000","last_undegraded":"2024-09-17T01:46:32.776725+0000","last_fullsized":"2024-09-17T01:46:32.776725+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:22.199090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428012+0000","last_change":"2024-09-17T01:46:31.433043+0000","last_active":"2024-09-17T01:46:32.428012+0000","last_peered":"2024-09-17T01:46:32.428012+0000","last_clean":"2024-09-17T01:46:32.428012+0000","last_became_active":"2024-09-17T01:46:31.432720+0000","last_became_peered":"2024-09-17T01:46:31.432720+0000","last_unstale":"2024-09-17T01:46:32.428012+0000","last_undegraded":"2024-09-17T01:46:32.428012+0000","last_fullsized":"2024-09-17T01:46:32.428012+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:57:32.671300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.b","version":"186'2","reported_seq":17,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775602+0000","last_change":"2024-09-17T01:46:30.405350+0000","last_active":"2024-09-17T01:46:32.775602+0000","last_peered":"2024-09-17T01:46:32.775602+0000","last_clean":"2024-09-17T01:46:32.775602+0000","last_became_active":"2024-09-17T01:46:30.404996+0000","last_became_peered":"2024-09-17T01:46:30.404996+0000","last_unstale":"2024-09-17T01:46:32.775602+0000","last_undegraded":"2024-09-17T01:46:32.775602+0000","last_fullsized":"2024-09-17T01:46:32.775602+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:58.482506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777051+0000","last_change":"2024-09-17T01:46:31.442677+0000","last_active":"2024-09-17T01:46:32.777051+0000","last_peered":"2024-09-17T01:46:32.777051+0000","last_clean":"2024-09-17T01:46:32.777051+0000","last_became_active":"2024-09-17T01:46:31.442347+0000","last_became_peered":"2024-09-17T01:46:31.442347+0000","last_unstale":"2024-09-17T01:46:32.777051+0000","last_undegraded":"2024-09-17T01:46:32.777051+0000","last_fullsized":"2024-09-17T01:46:32.777051+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:19.562731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426379+0000","last_change":"2024-09-17T01:46:30.412325+0000","last_active":"2024-09-17T01:46:32.426379+0000","last_peered":"2024-09-17T01:46:32.426379+0000","last_clean":"2024-09-17T01:46:32.426379+0000","last_became_active":"2024-09-17T01:46:30.412047+0000","last_became_peered":"2024-09-17T01:46:30.412047+0000","last_unstale":"2024-09-17T01:46:32.426379+0000","last_undegraded":"2024-09-17T01:46:32.426379+0000","last_fullsized":"2024-09-17T01:46:32.426379+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:54.073456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775239+0000","last_change":"2024-09-17T01:46:31.432167+0000","last_active":"2024-09-17T01:46:32.775239+0000","last_peered":"2024-09-17T01:46:32.775239+0000","last_clean":"2024-09-17T01:46:32.775239+0000","last_became_active":"2024-09-17T01:46:31.431789+0000","last_became_peered":"2024-09-17T01:46:31.431789+0000","last_unstale":"2024-09-17T01:46:32.775239+0000","last_undegraded":"2024-09-17T01:46:32.775239+0000","last_fullsized":"2024-09-17T01:46:32.775239+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:21.650118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426921+0000","last_change":"2024-09-17T01:46:30.427238+0000","last_active":"2024-09-17T01:46:32.426921+0000","last_peered":"2024-09-17T01:46:32.426921+0000","last_clean":"2024-09-17T01:46:32.426921+0000","last_became_active":"2024-09-17T01:46:30.426611+0000","last_became_peered":"2024-09-17T01:46:30.426611+0000","last_unstale":"2024-09-17T01:46:32.426921+0000","last_undegraded":"2024-09-17T01:46:32.426921+0000","last_fullsized":"2024-09-17T01:46:32.426921+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:15.611305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775673+0000","last_change":"2024-09-17T01:46:31.419791+0000","last_active":"2024-09-17T01:46:32.775673+0000","last_peered":"2024-09-17T01:46:32.775673+0000","last_clean":"2024-09-17T01:46:32.775673+0000","last_became_active":"2024-09-17T01:46:31.419473+0000","last_became_peered":"2024-09-17T01:46:31.419473+0000","last_unstale":"2024-09-17T01:46:32.775673+0000","last_undegraded":"2024-09-17T01:46:32.775673+0000","last_fullsized":"2024-09-17T01:46:32.775673+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:32.481643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426899+0000","last_change":"2024-09-17T01:46:30.420644+0000","last_active":"2024-09-17T01:46:32.426899+0000","last_peered":"2024-09-17T01:46:32.426899+0000","last_clean":"2024-09-17T01:46:32.426899+0000","last_became_active":"2024-09-17T01:46:30.420307+0000","last_became_peered":"2024-09-17T01:46:30.420307+0000","last_unstale":"2024-09-17T01:46:32.426899+0000","last_undegraded":"2024-09-17T01:46:32.426899+0000","last_fullsized":"2024-09-17T01:46:32.426899+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:00.872803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777003+0000","last_change":"2024-09-17T01:46:31.444744+0000","last_active":"2024-09-17T01:46:32.777003+0000","last_peered":"2024-09-17T01:46:32.777003+0000","last_clean":"2024-09-17T01:46:32.777003+0000","last_became_active":"2024-09-17T01:46:31.444375+0000","last_became_peered":"2024-09-17T01:46:31.444375+0000","last_unstale":"2024-09-17T01:46:32.777003+0000","last_undegraded":"2024-09-17T01:46:32.777003+0000","last_fullsized":"2024-09-17T01:46:32.777003+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:43.584917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.7","version":"186'2","reported_seq":17,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427390+0000","last_change":"2024-09-17T01:46:30.425299+0000","last_active":"2024-09-17T01:46:32.427390+0000","last_peered":"2024-09-17T01:46:32.427390+0000","last_clean":"2024-09-17T01:46:32.427390+0000","last_became_active":"2024-09-17T01:46:30.424946+0000","last_became_peered":"2024-09-17T01:46:30.424946+0000","last_unstale":"2024-09-17T01:46:32.427390+0000","last_undegraded":"2024-09-17T01:46:32.427390+0000","last_fullsized":"2024-09-17T01:46:32.427390+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:28.876800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777440+0000","last_change":"2024-09-17T01:46:31.442936+0000","last_active":"2024-09-17T01:46:32.777440+0000","last_peered":"2024-09-17T01:46:32.777440+0000","last_clean":"2024-09-17T01:46:32.777440+0000","last_became_active":"2024-09-17T01:46:31.441624+0000","last_became_peered":"2024-09-17T01:46:31.441624+0000","last_unstale":"2024-09-17T01:46:32.777440+0000","last_undegraded":"2024-09-17T01:46:32.777440+0000","last_fullsized":"2024-09-17T01:46:32.777440+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:32.363557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.6","version":"187'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425796+0000","last_change":"2024-09-17T01:46:30.412132+0000","last_active":"2024-09-17T01:46:32.425796+0000","last_peered":"2024-09-17T01:46:32.425796+0000","last_clean":"2024-09-17T01:46:32.425796+0000","last_became_active":"2024-09-17T01:46:30.411804+0000","last_became_peered":"2024-09-17T01:46:30.411804+0000","last_unstale":"2024-09-17T01:46:32.425796+0000","last_undegraded":"2024-09-17T01:46:32.425796+0000","last_fullsized":"2024-09-17T01:46:32.425796+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:25.842168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425575+0000","last_change":"2024-09-17T01:46:31.429507+0000","last_active":"2024-09-17T01:46:32.425575+0000","last_peered":"2024-09-17T01:46:32.425575+0000","last_clean":"2024-09-17T01:46:32.425575+0000","last_became_active":"2024-09-17T01:46:31.425532+0000","last_became_peered":"2024-09-17T01:46:31.425532+0000","last_unstale":"2024-09-17T01:46:32.425575+0000","last_undegraded":"2024-09-17T01:46:32.425575+0000","last_fullsized":"2024-09-17T01:46:32.425575+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:18.372344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777250+0000","last_change":"2024-09-17T01:46:30.418076+0000","last_active":"2024-09-17T01:46:32.777250+0000","last_peered":"2024-09-17T01:46:32.777250+0000","last_clean":"2024-09-17T01:46:32.777250+0000","last_became_active":"2024-09-17T01:46:30.417242+0000","last_became_peered":"2024-09-17T01:46:30.417242+0000","last_unstale":"2024-09-17T01:46:32.777250+0000","last_undegraded":"2024-09-17T01:46:32.777250+0000","last_fullsized":"2024-09-17T01:46:32.777250+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:33.506264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776177+0000","last_change":"2024-09-17T01:46:31.445495+0000","last_active":"2024-09-17T01:46:32.776177+0000","last_peered":"2024-09-17T01:46:32.776177+0000","last_clean":"2024-09-17T01:46:32.776177+0000","last_became_active":"2024-09-17T01:46:31.444572+0000","last_became_peered":"2024-09-17T01:46:31.444572+0000","last_unstale":"2024-09-17T01:46:32.776177+0000","last_undegraded":"2024-09-17T01:46:32.776177+0000","last_fullsized":"2024-09-17T01:46:32.776177+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:16.618396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776893+0000","last_change":"2024-09-17T01:46:30.422029+0000","last_active":"2024-09-17T01:46:32.776893+0000","last_peered":"2024-09-17T01:46:32.776893+0000","last_clean":"2024-09-17T01:46:32.776893+0000","last_became_active":"2024-09-17T01:46:30.421681+0000","last_became_peered":"2024-09-17T01:46:30.421681+0000","last_unstale":"2024-09-17T01:46:32.776893+0000","last_undegraded":"2024-09-17T01:46:32.776893+0000","last_fullsized":"2024-09-17T01:46:32.776893+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:09.520044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777330+0000","last_change":"2024-09-17T01:46:31.439442+0000","last_active":"2024-09-17T01:46:32.777330+0000","last_peered":"2024-09-17T01:46:32.777330+0000","last_clean":"2024-09-17T01:46:32.777330+0000","last_became_active":"2024-09-17T01:46:31.438915+0000","last_became_peered":"2024-09-17T01:46:31.438915+0000","last_unstale":"2024-09-17T01:46:32.777330+0000","last_undegraded":"2024-09-17T01:46:32.777330+0000","last_fullsized":"2024-09-17T01:46:32.777330+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:27.999899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775727+0000","last_change":"2024-09-17T01:46:30.419847+0000","last_active":"2024-09-17T01:46:32.775727+0000","last_peered":"2024-09-17T01:46:32.775727+0000","last_clean":"2024-09-17T01:46:32.775727+0000","last_became_active":"2024-09-17T01:46:30.419467+0000","last_became_peered":"2024-09-17T01:46:30.419467+0000","last_unstale":"2024-09-17T01:46:32.775727+0000","last_undegraded":"2024-09-17T01:46:32.775727+0000","last_fullsized":"2024-09-17T01:46:32.775727+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:38.792786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425447+0000","last_change":"2024-09-17T01:46:31.437996+0000","last_active":"2024-09-17T01:46:32.425447+0000","last_peered":"2024-09-17T01:46:32.425447+0000","last_clean":"2024-09-17T01:46:32.425447+0000","last_became_active":"2024-09-17T01:46:31.437135+0000","last_became_peered":"2024-09-17T01:46:31.437135+0000","last_unstale":"2024-09-17T01:46:32.425447+0000","last_undegraded":"2024-09-17T01:46:32.425447+0000","last_fullsized":"2024-09-17T01:46:32.425447+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:46.620491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428203+0000","last_change":"2024-09-17T01:46:30.426320+0000","last_active":"2024-09-17T01:46:32.428203+0000","last_peered":"2024-09-17T01:46:32.428203+0000","last_clean":"2024-09-17T01:46:32.428203+0000","last_became_active":"2024-09-17T01:46:30.425888+0000","last_became_peered":"2024-09-17T01:46:30.425888+0000","last_unstale":"2024-09-17T01:46:32.428203+0000","last_undegraded":"2024-09-17T01:46:32.428203+0000","last_fullsized":"2024-09-17T01:46:32.428203+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:42.270562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426663+0000","last_change":"2024-09-17T01:46:31.425903+0000","last_active":"2024-09-17T01:46:32.426663+0000","last_peered":"2024-09-17T01:46:32.426663+0000","last_clean":"2024-09-17T01:46:32.426663+0000","last_became_active":"2024-09-17T01:46:31.425503+0000","last_became_peered":"2024-09-17T01:46:31.425503+0000","last_unstale":"2024-09-17T01:46:32.426663+0000","last_undegraded":"2024-09-17T01:46:32.426663+0000","last_fullsized":"2024-09-17T01:46:32.426663+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:56.275736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775493+0000","last_change":"2024-09-17T01:46:30.422496+0000","last_active":"2024-09-17T01:46:32.775493+0000","last_peered":"2024-09-17T01:46:32.775493+0000","last_clean":"2024-09-17T01:46:32.775493+0000","last_became_active":"2024-09-17T01:46:30.422122+0000","last_became_peered":"2024-09-17T01:46:30.422122+0000","last_unstale":"2024-09-17T01:46:32.775493+0000","last_undegraded":"2024-09-17T01:46:32.775493+0000","last_fullsized":"2024-09-17T01:46:32.775493+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:23.170746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775911+0000","last_change":"2024-09-17T01:46:31.420520+0000","last_active":"2024-09-17T01:46:32.775911+0000","last_peered":"2024-09-17T01:46:32.775911+0000","last_clean":"2024-09-17T01:46:32.775911+0000","last_became_active":"2024-09-17T01:46:31.420133+0000","last_became_peered":"2024-09-17T01:46:31.420133+0000","last_unstale":"2024-09-17T01:46:32.775911+0000","last_undegraded":"2024-09-17T01:46:32.775911+0000","last_fullsized":"2024-09-17T01:46:32.775911+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:04.257713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775432+0000","last_change":"2024-09-17T01:46:30.426020+0000","last_active":"2024-09-17T01:46:32.775432+0000","last_peered":"2024-09-17T01:46:32.775432+0000","last_clean":"2024-09-17T01:46:32.775432+0000","last_became_active":"2024-09-17T01:46:30.425079+0000","last_became_peered":"2024-09-17T01:46:30.425079+0000","last_unstale":"2024-09-17T01:46:32.775432+0000","last_undegraded":"2024-09-17T01:46:32.775432+0000","last_fullsized":"2024-09-17T01:46:32.775432+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:42.283883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428011+0000","last_change":"2024-09-17T01:46:31.444278+0000","last_active":"2024-09-17T01:46:32.428011+0000","last_peered":"2024-09-17T01:46:32.428011+0000","last_clean":"2024-09-17T01:46:32.428011+0000","last_became_active":"2024-09-17T01:46:31.443518+0000","last_became_peered":"2024-09-17T01:46:31.443518+0000","last_unstale":"2024-09-17T01:46:32.428011+0000","last_undegraded":"2024-09-17T01:46:32.428011+0000","last_fullsized":"2024-09-17T01:46:32.428011+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:28.913481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1b","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425512+0000","last_change":"2024-09-17T01:46:30.412509+0000","last_active":"2024-09-17T01:46:32.425512+0000","last_peered":"2024-09-17T01:46:32.425512+0000","last_clean":"2024-09-17T01:46:32.425512+0000","last_became_active":"2024-09-17T01:46:30.412226+0000","last_became_peered":"2024-09-17T01:46:30.412226+0000","last_unstale":"2024-09-17T01:46:32.425512+0000","last_undegraded":"2024-09-17T01:46:32.425512+0000","last_fullsized":"2024-09-17T01:46:32.425512+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:49.989646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":427,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775556+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:46:32.775556+0000","last_peered":"2024-09-17T01:46:32.775556+0000","last_clean":"2024-09-17T01:46:32.775556+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:46:32.775556+0000","last_undegraded":"2024-09-17T01:46:32.775556+0000","last_fullsized":"2024-09-17T01:46:32.775556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":764,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476915,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47340,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324500,"statfs":{"total":96636764160,"available":96588288000,"internally_reserved":0,"allocated":2310144,"data_stored":1018362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509619,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55700,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316140,"statfs":{"total":96636764160,"available":96579727360,"internally_reserved":0,"allocated":2351104,"data_stored":1037734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509618,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47372,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324468,"statfs":{"total":96636764160,"available":96588255232,"internally_reserved":0,"allocated":2351104,"data_stored":1037782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509619,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51540,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320300,"statfs":{"total":96636764160,"available":96583987200,"internally_reserved":0,"allocated":2351104,"data_stored":1037802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509619,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69532,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302308,"statfs":{"total":96636764160,"available":96565563392,"internally_reserved":0,"allocated":2359296,"data_stored":1039324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509618,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52116,"kb_used_data":2872,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319724,"statfs":{"total":96636764160,"available":96583397376,"internally_reserved":0,"allocated":2940928,"data_stored":1628080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509620,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59860,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311980,"statfs":{"total":96636764160,"available":96575467520,"internally_reserved":0,"allocated":2351104,"data_stored":1038294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":58915273},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542324,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52124,"kb_used_data":2888,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319716,"statfs":{"total":96636764160,"available":96583389184,"internally_reserved":0,"allocated":2957312,"data_stored":1628808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:46:35.907 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:46:36.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.172+0000 7f4cdbe00640 1 -- 172.21.15.42:0/1200127391 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4cdc0750b0 msgr2=0x7f4cdc0b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:36.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.172+0000 7f4cdbe00640 1 --2- 172.21.15.42:0/1200127391 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4cdc0750b0 0x7f4cdc0b14f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4005fd0 tx=0x7f4cd402a780 comp rx=0 tx=0).stop 2024-09-17T01:46:36.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.172+0000 7f4cdbe00640 1 -- 172.21.15.42:0/1200127391 shutdown_connections 2024-09-17T01:46:36.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.172+0000 7f4cdbe00640 1 --2- 172.21.15.42:0/1200127391 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4cdc0750b0 0x7f4cdc0b14f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:36.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.172+0000 7f4cdbe00640 1 --2- 172.21.15.42:0/1200127391 >> v2:172.21.15.43:3300/0 conn(0x7f4cdc06d640 0x7f4cdc15c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:36.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.172+0000 7f4cdbe00640 1 -- 172.21.15.42:0/1200127391 >> 172.21.15.42:0/1200127391 conn(0x7f4cdc073510 msgr2=0x7f4cdc0b6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:36.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.172+0000 7f4cdbe00640 1 -- 172.21.15.42:0/1200127391 shutdown_connections 2024-09-17T01:46:36.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.172+0000 7f4cdbe00640 1 -- 172.21.15.42:0/1200127391 wait complete. 2024-09-17T01:46:36.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.175+0000 7f4cdbe00640 1 Processor -- start 2024-09-17T01:46:36.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.175+0000 7f4cdbe00640 1 -- start start 2024-09-17T01:46:36.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.176+0000 7f4cdbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cdc0750b0 0x7f4cdc0ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:36.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.176+0000 7f4cdbe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4cdc0cd660 0x7f4cdc1eade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:36.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.176+0000 7f4cdbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cdc157690 0x7f4cdc15e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:36.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.176+0000 7f4cdbe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4cdc0b1ee0 con 0x7f4cdc157690 2024-09-17T01:46:36.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.176+0000 7f4cdbe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4cdc0b1d60 con 0x7f4cdc0750b0 2024-09-17T01:46:36.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.176+0000 7f4cdbe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4cdc0b2060 con 0x7f4cdc0cd660 2024-09-17T01:46:36.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.176+0000 7f4cdb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cdc157690 0x7f4cdc15e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:36.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.176+0000 7f4cdb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cdc157690 0x7f4cdc15e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46088/0 (socket says 172.21.15.42:46088) 2024-09-17T01:46:36.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.176+0000 7f4cdb400640 1 -- 172.21.15.42:0/3693178289 learned_addr learned my addr 172.21.15.42:0/3693178289 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:36.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.177+0000 7f4cdaa00640 1 --2- 172.21.15.42:0/3693178289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cdc0750b0 0x7f4cdc0ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:36.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.177+0000 7f4cd3e00640 1 --2- 172.21.15.42:0/3693178289 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4cdc0cd660 0x7f4cdc1eade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:36.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.177+0000 7f4cdb400640 1 -- 172.21.15.42:0/3693178289 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4cdc0cd660 msgr2=0x7f4cdc1eade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:36.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.177+0000 7f4cdb400640 1 --2- 172.21.15.42:0/3693178289 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4cdc0cd660 0x7f4cdc1eade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:36.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.177+0000 7f4cdb400640 1 -- 172.21.15.42:0/3693178289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cdc0750b0 msgr2=0x7f4cdc0ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:36.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.177+0000 7f4cdb400640 1 --2- 172.21.15.42:0/3693178289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cdc0750b0 0x7f4cdc0ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:36.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.177+0000 7f4cdb400640 1 -- 172.21.15.42:0/3693178289 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cdc1eb320 con 0x7f4cdc157690 2024-09-17T01:46:36.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.177+0000 7f4cdb400640 1 --2- 172.21.15.42:0/3693178289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cdc157690 0x7f4cdc15e690 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009cd0 tx=0x7f4cd4003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:36.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.178+0000 7f4cd2a00640 1 -- 172.21.15.42:0/3693178289 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4040070 con 0x7f4cdc157690 2024-09-17T01:46:36.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.178+0000 7f4cd2a00640 1 -- 172.21.15.42:0/3693178289 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cd4004560 con 0x7f4cdc157690 2024-09-17T01:46:36.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.178+0000 7f4cd2a00640 1 -- 172.21.15.42:0/3693178289 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4003e10 con 0x7f4cdc157690 2024-09-17T01:46:36.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.178+0000 7f4cdbe00640 1 -- 172.21.15.42:0/3693178289 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cdc0d1c00 con 0x7f4cdc157690 2024-09-17T01:46:36.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.178+0000 7f4cdbe00640 1 -- 172.21.15.42:0/3693178289 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cdc145530 con 0x7f4cdc157690 2024-09-17T01:46:36.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.179+0000 7f4cdbe00640 1 -- 172.21.15.42:0/3693178289 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cdc0b2580 con 0x7f4cdc157690 2024-09-17T01:46:36.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.180+0000 7f4cd2a00640 1 -- 172.21.15.42:0/3693178289 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4cd4043070 con 0x7f4cdc157690 2024-09-17T01:46:36.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.181+0000 7f4cd2a00640 1 --2- 172.21.15.42:0/3693178289 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4cb8078b90 0x7f4cb807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:36.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.181+0000 7f4cd2a00640 1 -- 172.21.15.42:0/3693178289 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f4cd40bbea0 con 0x7f4cdc157690 2024-09-17T01:46:36.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.182+0000 7f4cdaa00640 1 --2- 172.21.15.42:0/3693178289 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4cb8078b90 0x7f4cb807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:36.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.183+0000 7f4cdaa00640 1 --2- 172.21.15.42:0/3693178289 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4cb8078b90 0x7f4cb807b0a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc007fd0 tx=0x7f4ccc001370 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:36.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.186+0000 7f4cd2a00640 1 -- 172.21.15.42:0/3693178289 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4cd4083c80 con 0x7f4cdc157690 2024-09-17T01:46:36.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.374+0000 7f4cdbe00640 1 -- 172.21.15.42:0/3693178289 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4cdc0cd230 con 0x7f4cb8078b90 2024-09-17T01:46:36.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.380+0000 7f4cd2a00640 1 -- 172.21.15.42:0/3693178289 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252131 (secure 0 0 0) 0x7f4cdc0cd230 con 0x7f4cb8078b90 2024-09-17T01:46:36.381 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:46:36.382 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:46:36.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.383+0000 7f4cdbe00640 1 -- 172.21.15.42:0/3693178289 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4cb8078b90 msgr2=0x7f4cb807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:36.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.383+0000 7f4cdbe00640 1 --2- 172.21.15.42:0/3693178289 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4cb8078b90 0x7f4cb807b0a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc007fd0 tx=0x7f4ccc001370 comp rx=0 tx=0).stop 2024-09-17T01:46:36.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.383+0000 7f4cdbe00640 1 -- 172.21.15.42:0/3693178289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cdc157690 msgr2=0x7f4cdc15e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:36.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.383+0000 7f4cdbe00640 1 --2- 172.21.15.42:0/3693178289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cdc157690 0x7f4cdc15e690 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009cd0 tx=0x7f4cd4003c20 comp rx=0 tx=0).stop 2024-09-17T01:46:36.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.384+0000 7f4cdbe00640 1 -- 172.21.15.42:0/3693178289 shutdown_connections 2024-09-17T01:46:36.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.384+0000 7f4cdbe00640 1 --2- 172.21.15.42:0/3693178289 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4cb8078b90 0x7f4cb807b0a0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:36.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.384+0000 7f4cdbe00640 1 --2- 172.21.15.42:0/3693178289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cdc157690 0x7f4cdc15e690 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:36.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.384+0000 7f4cdbe00640 1 --2- 172.21.15.42:0/3693178289 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4cdc0cd660 0x7f4cdc1eade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:36.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.384+0000 7f4cdbe00640 1 --2- 172.21.15.42:0/3693178289 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cdc0750b0 0x7f4cdc0ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:36.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.384+0000 7f4cdbe00640 1 -- 172.21.15.42:0/3693178289 >> 172.21.15.42:0/3693178289 conn(0x7f4cdc073510 msgr2=0x7f4cdc1583a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:36.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.384+0000 7f4cdbe00640 1 -- 172.21.15.42:0/3693178289 shutdown_connections 2024-09-17T01:46:36.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.384+0000 7f4cdbe00640 1 -- 172.21.15.42:0/3693178289 wait complete. 2024-09-17T01:46:36.408 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":621,"stamp":"2024-09-17T01:46:35.228790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591132,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":134,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":435584,"kb_used_data":19504,"kb_used_omap":12,"kb_used_meta":415859,"kb_avail":754539136,"statfs":{"total":773094113280,"available":772648075264,"internally_reserved":0,"allocated":19972096,"data_stored":9466186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":425840180},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":764,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.836029"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777205+0000","last_change":"2024-09-17T01:46:31.449114+0000","last_active":"2024-09-17T01:46:32.777205+0000","last_peered":"2024-09-17T01:46:32.777205+0000","last_clean":"2024-09-17T01:46:32.777205+0000","last_became_active":"2024-09-17T01:46:31.444897+0000","last_became_peered":"2024-09-17T01:46:31.444897+0000","last_unstale":"2024-09-17T01:46:32.777205+0000","last_undegraded":"2024-09-17T01:46:32.777205+0000","last_fullsized":"2024-09-17T01:46:32.777205+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:10.122631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425679+0000","last_change":"2024-09-17T01:46:31.424827+0000","last_active":"2024-09-17T01:46:32.425679+0000","last_peered":"2024-09-17T01:46:32.425679+0000","last_clean":"2024-09-17T01:46:32.425679+0000","last_became_active":"2024-09-17T01:46:31.424256+0000","last_became_peered":"2024-09-17T01:46:31.424256+0000","last_unstale":"2024-09-17T01:46:32.425679+0000","last_undegraded":"2024-09-17T01:46:32.425679+0000","last_fullsized":"2024-09-17T01:46:32.425679+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:16.070389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428308+0000","last_change":"2024-09-17T01:46:31.440514+0000","last_active":"2024-09-17T01:46:32.428308+0000","last_peered":"2024-09-17T01:46:32.428308+0000","last_clean":"2024-09-17T01:46:32.428308+0000","last_became_active":"2024-09-17T01:46:31.439579+0000","last_became_peered":"2024-09-17T01:46:31.439579+0000","last_unstale":"2024-09-17T01:46:32.428308+0000","last_undegraded":"2024-09-17T01:46:32.428308+0000","last_fullsized":"2024-09-17T01:46:32.428308+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:43.542003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776158+0000","last_change":"2024-09-17T01:46:31.434326+0000","last_active":"2024-09-17T01:46:32.776158+0000","last_peered":"2024-09-17T01:46:32.776158+0000","last_clean":"2024-09-17T01:46:32.776158+0000","last_became_active":"2024-09-17T01:46:31.434028+0000","last_became_peered":"2024-09-17T01:46:31.434028+0000","last_unstale":"2024-09-17T01:46:32.776158+0000","last_undegraded":"2024-09-17T01:46:32.776158+0000","last_fullsized":"2024-09-17T01:46:32.776158+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:36.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428626+0000","last_change":"2024-09-17T01:46:31.444693+0000","last_active":"2024-09-17T01:46:32.428626+0000","last_peered":"2024-09-17T01:46:32.428626+0000","last_clean":"2024-09-17T01:46:32.428626+0000","last_became_active":"2024-09-17T01:46:31.444143+0000","last_became_peered":"2024-09-17T01:46:31.444143+0000","last_unstale":"2024-09-17T01:46:32.428626+0000","last_undegraded":"2024-09-17T01:46:32.428626+0000","last_fullsized":"2024-09-17T01:46:32.428626+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:19:45.427741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777290+0000","last_change":"2024-09-17T01:46:31.439648+0000","last_active":"2024-09-17T01:46:32.777290+0000","last_peered":"2024-09-17T01:46:32.777290+0000","last_clean":"2024-09-17T01:46:32.777290+0000","last_became_active":"2024-09-17T01:46:31.439317+0000","last_became_peered":"2024-09-17T01:46:31.439317+0000","last_unstale":"2024-09-17T01:46:32.777290+0000","last_undegraded":"2024-09-17T01:46:32.777290+0000","last_fullsized":"2024-09-17T01:46:32.777290+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:29.867513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776468+0000","last_change":"2024-09-17T01:46:31.446698+0000","last_active":"2024-09-17T01:46:32.776468+0000","last_peered":"2024-09-17T01:46:32.776468+0000","last_clean":"2024-09-17T01:46:32.776468+0000","last_became_active":"2024-09-17T01:46:31.446416+0000","last_became_peered":"2024-09-17T01:46:31.446416+0000","last_unstale":"2024-09-17T01:46:32.776468+0000","last_undegraded":"2024-09-17T01:46:32.776468+0000","last_fullsized":"2024-09-17T01:46:32.776468+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:32.837724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426360+0000","last_change":"2024-09-17T01:46:31.426666+0000","last_active":"2024-09-17T01:46:32.426360+0000","last_peered":"2024-09-17T01:46:32.426360+0000","last_clean":"2024-09-17T01:46:32.426360+0000","last_became_active":"2024-09-17T01:46:31.426352+0000","last_became_peered":"2024-09-17T01:46:31.426352+0000","last_unstale":"2024-09-17T01:46:32.426360+0000","last_undegraded":"2024-09-17T01:46:32.426360+0000","last_fullsized":"2024-09-17T01:46:32.426360+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:04.991154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2024-09-17T01:46:30.407450+0000","last_change":"2024-09-17T01:46:30.407450+0000","last_active":"2024-09-17T01:46:30.391480+0000","last_peered":"2024-09-17T01:46:30.391480+0000","last_clean":"2024-09-17T01:46:30.391480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:46:30.407450+0000","last_undegraded":"2024-09-17T01:46:30.407450+0000","last_fullsized":"2024-09-17T01:46:30.407450+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428433+0000","last_change":"2024-09-17T01:46:31.438389+0000","last_active":"2024-09-17T01:46:32.428433+0000","last_peered":"2024-09-17T01:46:32.428433+0000","last_clean":"2024-09-17T01:46:32.428433+0000","last_became_active":"2024-09-17T01:46:31.437275+0000","last_became_peered":"2024-09-17T01:46:31.437275+0000","last_unstale":"2024-09-17T01:46:32.428433+0000","last_undegraded":"2024-09-17T01:46:32.428433+0000","last_fullsized":"2024-09-17T01:46:32.428433+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:12:42.193215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777056+0000","last_change":"2024-09-17T01:46:31.441613+0000","last_active":"2024-09-17T01:46:32.777056+0000","last_peered":"2024-09-17T01:46:32.777056+0000","last_clean":"2024-09-17T01:46:32.777056+0000","last_became_active":"2024-09-17T01:46:31.440235+0000","last_became_peered":"2024-09-17T01:46:31.440235+0000","last_unstale":"2024-09-17T01:46:32.777056+0000","last_undegraded":"2024-09-17T01:46:32.777056+0000","last_fullsized":"2024-09-17T01:46:32.777056+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:32.524306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775618+0000","last_change":"2024-09-17T01:46:31.416960+0000","last_active":"2024-09-17T01:46:32.775618+0000","last_peered":"2024-09-17T01:46:32.775618+0000","last_clean":"2024-09-17T01:46:32.775618+0000","last_became_active":"2024-09-17T01:46:31.416577+0000","last_became_peered":"2024-09-17T01:46:31.416577+0000","last_unstale":"2024-09-17T01:46:32.775618+0000","last_undegraded":"2024-09-17T01:46:32.775618+0000","last_fullsized":"2024-09-17T01:46:32.775618+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:52:25.962925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775387+0000","last_change":"2024-09-17T01:46:31.428536+0000","last_active":"2024-09-17T01:46:32.775387+0000","last_peered":"2024-09-17T01:46:32.775387+0000","last_clean":"2024-09-17T01:46:32.775387+0000","last_became_active":"2024-09-17T01:46:31.425769+0000","last_became_peered":"2024-09-17T01:46:31.425769+0000","last_unstale":"2024-09-17T01:46:32.775387+0000","last_undegraded":"2024-09-17T01:46:32.775387+0000","last_fullsized":"2024-09-17T01:46:32.775387+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:22:23.512532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775774+0000","last_change":"2024-09-17T01:46:31.427311+0000","last_active":"2024-09-17T01:46:32.775774+0000","last_peered":"2024-09-17T01:46:32.775774+0000","last_clean":"2024-09-17T01:46:32.775774+0000","last_became_active":"2024-09-17T01:46:31.426922+0000","last_became_peered":"2024-09-17T01:46:31.426922+0000","last_unstale":"2024-09-17T01:46:32.775774+0000","last_undegraded":"2024-09-17T01:46:32.775774+0000","last_fullsized":"2024-09-17T01:46:32.775774+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:28.913481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776459+0000","last_change":"2024-09-17T01:46:31.445995+0000","last_active":"2024-09-17T01:46:32.776459+0000","last_peered":"2024-09-17T01:46:32.776459+0000","last_clean":"2024-09-17T01:46:32.776459+0000","last_became_active":"2024-09-17T01:46:31.442444+0000","last_became_peered":"2024-09-17T01:46:31.442444+0000","last_unstale":"2024-09-17T01:46:32.776459+0000","last_undegraded":"2024-09-17T01:46:32.776459+0000","last_fullsized":"2024-09-17T01:46:32.776459+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:27.316162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776447+0000","last_change":"2024-09-17T01:46:31.432472+0000","last_active":"2024-09-17T01:46:32.776447+0000","last_peered":"2024-09-17T01:46:32.776447+0000","last_clean":"2024-09-17T01:46:32.776447+0000","last_became_active":"2024-09-17T01:46:31.431958+0000","last_became_peered":"2024-09-17T01:46:31.431958+0000","last_unstale":"2024-09-17T01:46:32.776447+0000","last_undegraded":"2024-09-17T01:46:32.776447+0000","last_fullsized":"2024-09-17T01:46:32.776447+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:44.766306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777329+0000","last_change":"2024-09-17T01:46:31.444639+0000","last_active":"2024-09-17T01:46:32.777329+0000","last_peered":"2024-09-17T01:46:32.777329+0000","last_clean":"2024-09-17T01:46:32.777329+0000","last_became_active":"2024-09-17T01:46:31.442591+0000","last_became_peered":"2024-09-17T01:46:31.442591+0000","last_unstale":"2024-09-17T01:46:32.777329+0000","last_undegraded":"2024-09-17T01:46:32.777329+0000","last_fullsized":"2024-09-17T01:46:32.777329+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:11.846706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428771+0000","last_change":"2024-09-17T01:46:31.434660+0000","last_active":"2024-09-17T01:46:32.428771+0000","last_peered":"2024-09-17T01:46:32.428771+0000","last_clean":"2024-09-17T01:46:32.428771+0000","last_became_active":"2024-09-17T01:46:31.434321+0000","last_became_peered":"2024-09-17T01:46:31.434321+0000","last_unstale":"2024-09-17T01:46:32.428771+0000","last_undegraded":"2024-09-17T01:46:32.428771+0000","last_fullsized":"2024-09-17T01:46:32.428771+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:11.153289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.429127+0000","last_change":"2024-09-17T01:46:31.439946+0000","last_active":"2024-09-17T01:46:32.429127+0000","last_peered":"2024-09-17T01:46:32.429127+0000","last_clean":"2024-09-17T01:46:32.429127+0000","last_became_active":"2024-09-17T01:46:31.439546+0000","last_became_peered":"2024-09-17T01:46:31.439546+0000","last_unstale":"2024-09-17T01:46:32.429127+0000","last_undegraded":"2024-09-17T01:46:32.429127+0000","last_fullsized":"2024-09-17T01:46:32.429127+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:05.120666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428283+0000","last_change":"2024-09-17T01:46:31.437213+0000","last_active":"2024-09-17T01:46:32.428283+0000","last_peered":"2024-09-17T01:46:32.428283+0000","last_clean":"2024-09-17T01:46:32.428283+0000","last_became_active":"2024-09-17T01:46:31.436423+0000","last_became_peered":"2024-09-17T01:46:31.436423+0000","last_unstale":"2024-09-17T01:46:32.428283+0000","last_undegraded":"2024-09-17T01:46:32.428283+0000","last_fullsized":"2024-09-17T01:46:32.428283+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:27.109581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776147+0000","last_change":"2024-09-17T01:46:31.427386+0000","last_active":"2024-09-17T01:46:32.776147+0000","last_peered":"2024-09-17T01:46:32.776147+0000","last_clean":"2024-09-17T01:46:32.776147+0000","last_became_active":"2024-09-17T01:46:31.425405+0000","last_became_peered":"2024-09-17T01:46:31.425405+0000","last_unstale":"2024-09-17T01:46:32.776147+0000","last_undegraded":"2024-09-17T01:46:32.776147+0000","last_fullsized":"2024-09-17T01:46:32.776147+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:43.277654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425441+0000","last_change":"2024-09-17T01:46:31.436812+0000","last_active":"2024-09-17T01:46:32.425441+0000","last_peered":"2024-09-17T01:46:32.425441+0000","last_clean":"2024-09-17T01:46:32.425441+0000","last_became_active":"2024-09-17T01:46:31.436297+0000","last_became_peered":"2024-09-17T01:46:31.436297+0000","last_unstale":"2024-09-17T01:46:32.425441+0000","last_undegraded":"2024-09-17T01:46:32.425441+0000","last_fullsized":"2024-09-17T01:46:32.425441+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:32:19.529698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775436+0000","last_change":"2024-09-17T01:46:31.423114+0000","last_active":"2024-09-17T01:46:32.775436+0000","last_peered":"2024-09-17T01:46:32.775436+0000","last_clean":"2024-09-17T01:46:32.775436+0000","last_became_active":"2024-09-17T01:46:31.422795+0000","last_became_peered":"2024-09-17T01:46:31.422795+0000","last_unstale":"2024-09-17T01:46:32.775436+0000","last_undegraded":"2024-09-17T01:46:32.775436+0000","last_fullsized":"2024-09-17T01:46:32.775436+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:07.226908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2024-09-17T01:46:30.407363+0000","last_change":"2024-09-17T01:46:30.407363+0000","last_active":"2024-09-17T01:46:30.391480+0000","last_peered":"2024-09-17T01:46:30.391480+0000","last_clean":"2024-09-17T01:46:30.391480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:46:30.407363+0000","last_undegraded":"2024-09-17T01:46:30.407363+0000","last_fullsized":"2024-09-17T01:46:30.407363+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776072+0000","last_change":"2024-09-17T01:46:31.446218+0000","last_active":"2024-09-17T01:46:32.776072+0000","last_peered":"2024-09-17T01:46:32.776072+0000","last_clean":"2024-09-17T01:46:32.776072+0000","last_became_active":"2024-09-17T01:46:31.445885+0000","last_became_peered":"2024-09-17T01:46:31.445885+0000","last_unstale":"2024-09-17T01:46:32.776072+0000","last_undegraded":"2024-09-17T01:46:32.776072+0000","last_fullsized":"2024-09-17T01:46:32.776072+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:06.717241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427501+0000","last_change":"2024-09-17T01:46:31.426677+0000","last_active":"2024-09-17T01:46:32.427501+0000","last_peered":"2024-09-17T01:46:32.427501+0000","last_clean":"2024-09-17T01:46:32.427501+0000","last_became_active":"2024-09-17T01:46:31.425517+0000","last_became_peered":"2024-09-17T01:46:31.425517+0000","last_unstale":"2024-09-17T01:46:32.427501+0000","last_undegraded":"2024-09-17T01:46:32.427501+0000","last_fullsized":"2024-09-17T01:46:32.427501+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:31.981218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775884+0000","last_change":"2024-09-17T01:46:31.425570+0000","last_active":"2024-09-17T01:46:32.775884+0000","last_peered":"2024-09-17T01:46:32.775884+0000","last_clean":"2024-09-17T01:46:32.775884+0000","last_became_active":"2024-09-17T01:46:31.425256+0000","last_became_peered":"2024-09-17T01:46:31.425256+0000","last_unstale":"2024-09-17T01:46:32.775884+0000","last_undegraded":"2024-09-17T01:46:32.775884+0000","last_fullsized":"2024-09-17T01:46:32.775884+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:40.200273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427198+0000","last_change":"2024-09-17T01:46:31.422013+0000","last_active":"2024-09-17T01:46:32.427198+0000","last_peered":"2024-09-17T01:46:32.427198+0000","last_clean":"2024-09-17T01:46:32.427198+0000","last_became_active":"2024-09-17T01:46:31.421574+0000","last_became_peered":"2024-09-17T01:46:31.421574+0000","last_unstale":"2024-09-17T01:46:32.427198+0000","last_undegraded":"2024-09-17T01:46:32.427198+0000","last_fullsized":"2024-09-17T01:46:32.427198+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:13.432651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425439+0000","last_change":"2024-09-17T01:46:31.426049+0000","last_active":"2024-09-17T01:46:32.425439+0000","last_peered":"2024-09-17T01:46:32.425439+0000","last_clean":"2024-09-17T01:46:32.425439+0000","last_became_active":"2024-09-17T01:46:31.425700+0000","last_became_peered":"2024-09-17T01:46:31.425700+0000","last_unstale":"2024-09-17T01:46:32.425439+0000","last_undegraded":"2024-09-17T01:46:32.425439+0000","last_fullsized":"2024-09-17T01:46:32.425439+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:15.961268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775828+0000","last_change":"2024-09-17T01:46:31.445360+0000","last_active":"2024-09-17T01:46:32.775828+0000","last_peered":"2024-09-17T01:46:32.775828+0000","last_clean":"2024-09-17T01:46:32.775828+0000","last_became_active":"2024-09-17T01:46:31.445034+0000","last_became_peered":"2024-09-17T01:46:31.445034+0000","last_unstale":"2024-09-17T01:46:32.775828+0000","last_undegraded":"2024-09-17T01:46:32.775828+0000","last_fullsized":"2024-09-17T01:46:32.775828+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:18.585792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426826+0000","last_change":"2024-09-17T01:46:31.436801+0000","last_active":"2024-09-17T01:46:32.426826+0000","last_peered":"2024-09-17T01:46:32.426826+0000","last_clean":"2024-09-17T01:46:32.426826+0000","last_became_active":"2024-09-17T01:46:31.436442+0000","last_became_peered":"2024-09-17T01:46:31.436442+0000","last_unstale":"2024-09-17T01:46:32.426826+0000","last_undegraded":"2024-09-17T01:46:32.426826+0000","last_fullsized":"2024-09-17T01:46:32.426826+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:29.158716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776024+0000","last_change":"2024-09-17T01:46:31.435302+0000","last_active":"2024-09-17T01:46:32.776024+0000","last_peered":"2024-09-17T01:46:32.776024+0000","last_clean":"2024-09-17T01:46:32.776024+0000","last_became_active":"2024-09-17T01:46:31.435007+0000","last_became_peered":"2024-09-17T01:46:31.435007+0000","last_unstale":"2024-09-17T01:46:32.776024+0000","last_undegraded":"2024-09-17T01:46:32.776024+0000","last_fullsized":"2024-09-17T01:46:32.776024+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:06.685153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776762+0000","last_change":"2024-09-17T01:46:31.422309+0000","last_active":"2024-09-17T01:46:32.776762+0000","last_peered":"2024-09-17T01:46:32.776762+0000","last_clean":"2024-09-17T01:46:32.776762+0000","last_became_active":"2024-09-17T01:46:31.421687+0000","last_became_peered":"2024-09-17T01:46:31.421687+0000","last_unstale":"2024-09-17T01:46:32.776762+0000","last_undegraded":"2024-09-17T01:46:32.776762+0000","last_fullsized":"2024-09-17T01:46:32.776762+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:23.754735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1f","version":"186'4","reported_seq":19,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776472+0000","last_change":"2024-09-17T01:46:30.421999+0000","last_active":"2024-09-17T01:46:32.776472+0000","last_peered":"2024-09-17T01:46:32.776472+0000","last_clean":"2024-09-17T01:46:32.776472+0000","last_became_active":"2024-09-17T01:46:30.421444+0000","last_became_peered":"2024-09-17T01:46:30.421444+0000","last_unstale":"2024-09-17T01:46:32.776472+0000","last_undegraded":"2024-09-17T01:46:32.776472+0000","last_fullsized":"2024-09-17T01:46:32.776472+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:19:33.239539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776314+0000","last_change":"2024-09-17T01:46:31.436431+0000","last_active":"2024-09-17T01:46:32.776314+0000","last_peered":"2024-09-17T01:46:32.776314+0000","last_clean":"2024-09-17T01:46:32.776314+0000","last_became_active":"2024-09-17T01:46:31.436098+0000","last_became_peered":"2024-09-17T01:46:31.436098+0000","last_unstale":"2024-09-17T01:46:32.776314+0000","last_undegraded":"2024-09-17T01:46:32.776314+0000","last_fullsized":"2024-09-17T01:46:32.776314+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:10.579523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1e","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425770+0000","last_change":"2024-09-17T01:46:30.414291+0000","last_active":"2024-09-17T01:46:32.425770+0000","last_peered":"2024-09-17T01:46:32.425770+0000","last_clean":"2024-09-17T01:46:32.425770+0000","last_became_active":"2024-09-17T01:46:30.413782+0000","last_became_peered":"2024-09-17T01:46:30.413782+0000","last_unstale":"2024-09-17T01:46:32.425770+0000","last_undegraded":"2024-09-17T01:46:32.425770+0000","last_fullsized":"2024-09-17T01:46:32.425770+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:04.480361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428927+0000","last_change":"2024-09-17T01:46:31.435399+0000","last_active":"2024-09-17T01:46:32.428927+0000","last_peered":"2024-09-17T01:46:32.428927+0000","last_clean":"2024-09-17T01:46:32.428927+0000","last_became_active":"2024-09-17T01:46:31.434992+0000","last_became_peered":"2024-09-17T01:46:31.434992+0000","last_unstale":"2024-09-17T01:46:32.428927+0000","last_undegraded":"2024-09-17T01:46:32.428927+0000","last_fullsized":"2024-09-17T01:46:32.428927+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:50:55.804363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"186'2","reported_seq":17,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427047+0000","last_change":"2024-09-17T01:46:30.417874+0000","last_active":"2024-09-17T01:46:32.427047+0000","last_peered":"2024-09-17T01:46:32.427047+0000","last_clean":"2024-09-17T01:46:32.427047+0000","last_became_active":"2024-09-17T01:46:30.416190+0000","last_became_peered":"2024-09-17T01:46:30.416190+0000","last_unstale":"2024-09-17T01:46:32.427047+0000","last_undegraded":"2024-09-17T01:46:32.427047+0000","last_fullsized":"2024-09-17T01:46:32.427047+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:02.232021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428642+0000","last_change":"2024-09-17T01:46:31.443348+0000","last_active":"2024-09-17T01:46:32.428642+0000","last_peered":"2024-09-17T01:46:32.428642+0000","last_clean":"2024-09-17T01:46:32.428642+0000","last_became_active":"2024-09-17T01:46:31.439978+0000","last_became_peered":"2024-09-17T01:46:31.439978+0000","last_unstale":"2024-09-17T01:46:32.428642+0000","last_undegraded":"2024-09-17T01:46:32.428642+0000","last_fullsized":"2024-09-17T01:46:32.428642+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:30.533657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1c","version":"186'2","reported_seq":17,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776234+0000","last_change":"2024-09-17T01:46:30.419634+0000","last_active":"2024-09-17T01:46:32.776234+0000","last_peered":"2024-09-17T01:46:32.776234+0000","last_clean":"2024-09-17T01:46:32.776234+0000","last_became_active":"2024-09-17T01:46:30.419304+0000","last_became_peered":"2024-09-17T01:46:30.419304+0000","last_unstale":"2024-09-17T01:46:32.776234+0000","last_undegraded":"2024-09-17T01:46:32.776234+0000","last_fullsized":"2024-09-17T01:46:32.776234+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:05.285011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775650+0000","last_change":"2024-09-17T01:46:31.440666+0000","last_active":"2024-09-17T01:46:32.775650+0000","last_peered":"2024-09-17T01:46:32.775650+0000","last_clean":"2024-09-17T01:46:32.775650+0000","last_became_active":"2024-09-17T01:46:31.439118+0000","last_became_peered":"2024-09-17T01:46:31.439118+0000","last_unstale":"2024-09-17T01:46:32.775650+0000","last_undegraded":"2024-09-17T01:46:32.775650+0000","last_fullsized":"2024-09-17T01:46:32.775650+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:11.746299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777424+0000","last_change":"2024-09-17T01:46:30.424178+0000","last_active":"2024-09-17T01:46:32.777424+0000","last_peered":"2024-09-17T01:46:32.777424+0000","last_clean":"2024-09-17T01:46:32.777424+0000","last_became_active":"2024-09-17T01:46:30.423653+0000","last_became_peered":"2024-09-17T01:46:30.423653+0000","last_unstale":"2024-09-17T01:46:32.777424+0000","last_undegraded":"2024-09-17T01:46:32.777424+0000","last_fullsized":"2024-09-17T01:46:32.777424+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:01:57.156162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776415+0000","last_change":"2024-09-17T01:46:31.428613+0000","last_active":"2024-09-17T01:46:32.776415+0000","last_peered":"2024-09-17T01:46:32.776415+0000","last_clean":"2024-09-17T01:46:32.776415+0000","last_became_active":"2024-09-17T01:46:31.428070+0000","last_became_peered":"2024-09-17T01:46:31.428070+0000","last_unstale":"2024-09-17T01:46:32.776415+0000","last_undegraded":"2024-09-17T01:46:32.776415+0000","last_fullsized":"2024-09-17T01:46:32.776415+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:02.001662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426445+0000","last_change":"2024-09-17T01:46:30.419541+0000","last_active":"2024-09-17T01:46:32.426445+0000","last_peered":"2024-09-17T01:46:32.426445+0000","last_clean":"2024-09-17T01:46:32.426445+0000","last_became_active":"2024-09-17T01:46:30.417201+0000","last_became_peered":"2024-09-17T01:46:30.417201+0000","last_unstale":"2024-09-17T01:46:32.426445+0000","last_undegraded":"2024-09-17T01:46:32.426445+0000","last_fullsized":"2024-09-17T01:46:32.426445+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:53.835043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2024-09-17T01:46:30.406938+0000","last_change":"2024-09-17T01:46:30.406938+0000","last_active":"2024-09-17T01:46:30.391480+0000","last_peered":"2024-09-17T01:46:30.391480+0000","last_clean":"2024-09-17T01:46:30.391480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:46:30.406938+0000","last_undegraded":"2024-09-17T01:46:30.406938+0000","last_fullsized":"2024-09-17T01:46:30.406938+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775314+0000","last_change":"2024-09-17T01:46:30.425424+0000","last_active":"2024-09-17T01:46:32.775314+0000","last_peered":"2024-09-17T01:46:32.775314+0000","last_clean":"2024-09-17T01:46:32.775314+0000","last_became_active":"2024-09-17T01:46:30.424776+0000","last_became_peered":"2024-09-17T01:46:30.424776+0000","last_unstale":"2024-09-17T01:46:32.775314+0000","last_undegraded":"2024-09-17T01:46:32.775314+0000","last_fullsized":"2024-09-17T01:46:32.775314+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:00.655765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776220+0000","last_change":"2024-09-17T01:46:31.445355+0000","last_active":"2024-09-17T01:46:32.776220+0000","last_peered":"2024-09-17T01:46:32.776220+0000","last_clean":"2024-09-17T01:46:32.776220+0000","last_became_active":"2024-09-17T01:46:31.445006+0000","last_became_peered":"2024-09-17T01:46:31.445006+0000","last_unstale":"2024-09-17T01:46:32.776220+0000","last_undegraded":"2024-09-17T01:46:32.776220+0000","last_fullsized":"2024-09-17T01:46:32.776220+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:00:48.418812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428717+0000","last_change":"2024-09-17T01:46:30.425233+0000","last_active":"2024-09-17T01:46:32.428717+0000","last_peered":"2024-09-17T01:46:32.428717+0000","last_clean":"2024-09-17T01:46:32.428717+0000","last_became_active":"2024-09-17T01:46:30.424688+0000","last_became_peered":"2024-09-17T01:46:30.424688+0000","last_unstale":"2024-09-17T01:46:32.428717+0000","last_undegraded":"2024-09-17T01:46:32.428717+0000","last_fullsized":"2024-09-17T01:46:32.428717+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:22.747644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775921+0000","last_change":"2024-09-17T01:46:31.433934+0000","last_active":"2024-09-17T01:46:32.775921+0000","last_peered":"2024-09-17T01:46:32.775921+0000","last_clean":"2024-09-17T01:46:32.775921+0000","last_became_active":"2024-09-17T01:46:31.433582+0000","last_became_peered":"2024-09-17T01:46:31.433582+0000","last_unstale":"2024-09-17T01:46:32.775921+0000","last_undegraded":"2024-09-17T01:46:32.775921+0000","last_fullsized":"2024-09-17T01:46:32.775921+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:12:49.719869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776319+0000","last_change":"2024-09-17T01:46:30.424629+0000","last_active":"2024-09-17T01:46:32.776319+0000","last_peered":"2024-09-17T01:46:32.776319+0000","last_clean":"2024-09-17T01:46:32.776319+0000","last_became_active":"2024-09-17T01:46:30.424304+0000","last_became_peered":"2024-09-17T01:46:30.424304+0000","last_unstale":"2024-09-17T01:46:32.776319+0000","last_undegraded":"2024-09-17T01:46:32.776319+0000","last_fullsized":"2024-09-17T01:46:32.776319+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:56:10.352036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2024-09-17T01:46:30.406859+0000","last_change":"2024-09-17T01:46:30.406859+0000","last_active":"2024-09-17T01:46:30.391480+0000","last_peered":"2024-09-17T01:46:30.391480+0000","last_clean":"2024-09-17T01:46:30.391480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:46:30.406859+0000","last_undegraded":"2024-09-17T01:46:30.406859+0000","last_fullsized":"2024-09-17T01:46:30.406859+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.15","version":"186'3","reported_seq":18,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427149+0000","last_change":"2024-09-17T01:46:30.422242+0000","last_active":"2024-09-17T01:46:32.427149+0000","last_peered":"2024-09-17T01:46:32.427149+0000","last_clean":"2024-09-17T01:46:32.427149+0000","last_became_active":"2024-09-17T01:46:30.421844+0000","last_became_peered":"2024-09-17T01:46:30.421844+0000","last_unstale":"2024-09-17T01:46:32.427149+0000","last_undegraded":"2024-09-17T01:46:32.427149+0000","last_fullsized":"2024-09-17T01:46:32.427149+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:12.309630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426956+0000","last_change":"2024-09-17T01:46:31.428578+0000","last_active":"2024-09-17T01:46:32.426956+0000","last_peered":"2024-09-17T01:46:32.426956+0000","last_clean":"2024-09-17T01:46:32.426956+0000","last_became_active":"2024-09-17T01:46:31.428252+0000","last_became_peered":"2024-09-17T01:46:31.428252+0000","last_unstale":"2024-09-17T01:46:32.426956+0000","last_undegraded":"2024-09-17T01:46:32.426956+0000","last_fullsized":"2024-09-17T01:46:32.426956+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:59:35.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T01:46:30.425094+0000","last_change":"2024-09-17T01:46:30.422374+0000","last_active":"2024-09-17T01:46:30.425094+0000","last_peered":"2024-09-17T01:46:30.425094+0000","last_clean":"2024-09-17T01:46:30.425094+0000","last_became_active":"2024-09-17T01:46:30.421910+0000","last_became_peered":"2024-09-17T01:46:30.421910+0000","last_unstale":"2024-09-17T01:46:30.425094+0000","last_undegraded":"2024-09-17T01:46:30.425094+0000","last_fullsized":"2024-09-17T01:46:30.425094+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:45.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776007+0000","last_change":"2024-09-17T01:46:31.443892+0000","last_active":"2024-09-17T01:46:32.776007+0000","last_peered":"2024-09-17T01:46:32.776007+0000","last_clean":"2024-09-17T01:46:32.776007+0000","last_became_active":"2024-09-17T01:46:31.441114+0000","last_became_peered":"2024-09-17T01:46:31.441114+0000","last_unstale":"2024-09-17T01:46:32.776007+0000","last_undegraded":"2024-09-17T01:46:32.776007+0000","last_fullsized":"2024-09-17T01:46:32.776007+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:43.533425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T01:46:30.425676+0000","last_change":"2024-09-17T01:46:30.423710+0000","last_active":"2024-09-17T01:46:30.425676+0000","last_peered":"2024-09-17T01:46:30.425676+0000","last_clean":"2024-09-17T01:46:30.425676+0000","last_became_active":"2024-09-17T01:46:30.423408+0000","last_became_peered":"2024-09-17T01:46:30.423408+0000","last_unstale":"2024-09-17T01:46:30.425676+0000","last_undegraded":"2024-09-17T01:46:30.425676+0000","last_fullsized":"2024-09-17T01:46:30.425676+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:45.318504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428962+0000","last_change":"2024-09-17T01:46:31.442692+0000","last_active":"2024-09-17T01:46:32.428962+0000","last_peered":"2024-09-17T01:46:32.428962+0000","last_clean":"2024-09-17T01:46:32.428962+0000","last_became_active":"2024-09-17T01:46:31.437975+0000","last_became_peered":"2024-09-17T01:46:31.437975+0000","last_unstale":"2024-09-17T01:46:32.428962+0000","last_undegraded":"2024-09-17T01:46:32.428962+0000","last_fullsized":"2024-09-17T01:46:32.428962+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:24.601060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425179+0000","last_change":"2024-09-17T01:46:30.417522+0000","last_active":"2024-09-17T01:46:32.425179+0000","last_peered":"2024-09-17T01:46:32.425179+0000","last_clean":"2024-09-17T01:46:32.425179+0000","last_became_active":"2024-09-17T01:46:30.417209+0000","last_became_peered":"2024-09-17T01:46:30.417209+0000","last_unstale":"2024-09-17T01:46:32.425179+0000","last_undegraded":"2024-09-17T01:46:32.425179+0000","last_fullsized":"2024-09-17T01:46:32.425179+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:15.260440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427083+0000","last_change":"2024-09-17T01:46:31.434934+0000","last_active":"2024-09-17T01:46:32.427083+0000","last_peered":"2024-09-17T01:46:32.427083+0000","last_clean":"2024-09-17T01:46:32.427083+0000","last_became_active":"2024-09-17T01:46:31.434566+0000","last_became_peered":"2024-09-17T01:46:31.434566+0000","last_unstale":"2024-09-17T01:46:32.427083+0000","last_undegraded":"2024-09-17T01:46:32.427083+0000","last_fullsized":"2024-09-17T01:46:32.427083+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:47.607553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426560+0000","last_change":"2024-09-17T01:46:30.404274+0000","last_active":"2024-09-17T01:46:32.426560+0000","last_peered":"2024-09-17T01:46:32.426560+0000","last_clean":"2024-09-17T01:46:32.426560+0000","last_became_active":"2024-09-17T01:46:30.403501+0000","last_became_peered":"2024-09-17T01:46:30.403501+0000","last_unstale":"2024-09-17T01:46:32.426560+0000","last_undegraded":"2024-09-17T01:46:32.426560+0000","last_fullsized":"2024-09-17T01:46:32.426560+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:51.012757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777176+0000","last_change":"2024-09-17T01:46:31.436778+0000","last_active":"2024-09-17T01:46:32.777176+0000","last_peered":"2024-09-17T01:46:32.777176+0000","last_clean":"2024-09-17T01:46:32.777176+0000","last_became_active":"2024-09-17T01:46:31.436441+0000","last_became_peered":"2024-09-17T01:46:31.436441+0000","last_unstale":"2024-09-17T01:46:32.777176+0000","last_undegraded":"2024-09-17T01:46:32.777176+0000","last_fullsized":"2024-09-17T01:46:32.777176+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:54.967884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.10","version":"186'8","reported_seq":23,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426761+0000","last_change":"2024-09-17T01:46:30.414504+0000","last_active":"2024-09-17T01:46:32.426761+0000","last_peered":"2024-09-17T01:46:32.426761+0000","last_clean":"2024-09-17T01:46:32.426761+0000","last_became_active":"2024-09-17T01:46:30.414064+0000","last_became_peered":"2024-09-17T01:46:30.414064+0000","last_unstale":"2024-09-17T01:46:32.426761+0000","last_undegraded":"2024-09-17T01:46:32.426761+0000","last_fullsized":"2024-09-17T01:46:32.426761+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:16.932888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776776+0000","last_change":"2024-09-17T01:46:31.420586+0000","last_active":"2024-09-17T01:46:32.776776+0000","last_peered":"2024-09-17T01:46:32.776776+0000","last_clean":"2024-09-17T01:46:32.776776+0000","last_became_active":"2024-09-17T01:46:31.420292+0000","last_became_peered":"2024-09-17T01:46:31.420292+0000","last_unstale":"2024-09-17T01:46:32.776776+0000","last_undegraded":"2024-09-17T01:46:32.776776+0000","last_fullsized":"2024-09-17T01:46:32.776776+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:19:40.212633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.f","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777536+0000","last_change":"2024-09-17T01:46:30.424539+0000","last_active":"2024-09-17T01:46:32.777536+0000","last_peered":"2024-09-17T01:46:32.777536+0000","last_clean":"2024-09-17T01:46:32.777536+0000","last_became_active":"2024-09-17T01:46:30.424219+0000","last_became_peered":"2024-09-17T01:46:30.424219+0000","last_unstale":"2024-09-17T01:46:32.777536+0000","last_undegraded":"2024-09-17T01:46:32.777536+0000","last_fullsized":"2024-09-17T01:46:32.777536+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:10.664092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776865+0000","last_change":"2024-09-17T01:46:31.440377+0000","last_active":"2024-09-17T01:46:32.776865+0000","last_peered":"2024-09-17T01:46:32.776865+0000","last_clean":"2024-09-17T01:46:32.776865+0000","last_became_active":"2024-09-17T01:46:31.439915+0000","last_became_peered":"2024-09-17T01:46:31.439915+0000","last_unstale":"2024-09-17T01:46:32.776865+0000","last_undegraded":"2024-09-17T01:46:32.776865+0000","last_fullsized":"2024-09-17T01:46:32.776865+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:33.599429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T01:46:30.422832+0000","last_change":"2024-09-17T01:46:30.419672+0000","last_active":"2024-09-17T01:46:30.422832+0000","last_peered":"2024-09-17T01:46:30.422832+0000","last_clean":"2024-09-17T01:46:30.422832+0000","last_became_active":"2024-09-17T01:46:30.417927+0000","last_became_peered":"2024-09-17T01:46:30.417927+0000","last_unstale":"2024-09-17T01:46:30.422832+0000","last_undegraded":"2024-09-17T01:46:30.422832+0000","last_fullsized":"2024-09-17T01:46:30.422832+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:38:28.341220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428806+0000","last_change":"2024-09-17T01:46:31.437719+0000","last_active":"2024-09-17T01:46:32.428806+0000","last_peered":"2024-09-17T01:46:32.428806+0000","last_clean":"2024-09-17T01:46:32.428806+0000","last_became_active":"2024-09-17T01:46:31.436896+0000","last_became_peered":"2024-09-17T01:46:31.436896+0000","last_unstale":"2024-09-17T01:46:32.428806+0000","last_undegraded":"2024-09-17T01:46:32.428806+0000","last_fullsized":"2024-09-17T01:46:32.428806+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:51.651477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.d","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776068+0000","last_change":"2024-09-17T01:46:30.417554+0000","last_active":"2024-09-17T01:46:32.776068+0000","last_peered":"2024-09-17T01:46:32.776068+0000","last_clean":"2024-09-17T01:46:32.776068+0000","last_became_active":"2024-09-17T01:46:30.416047+0000","last_became_peered":"2024-09-17T01:46:30.416047+0000","last_unstale":"2024-09-17T01:46:32.776068+0000","last_undegraded":"2024-09-17T01:46:32.776068+0000","last_fullsized":"2024-09-17T01:46:32.776068+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:48:22.422721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776996+0000","last_change":"2024-09-17T01:46:31.432802+0000","last_active":"2024-09-17T01:46:32.776996+0000","last_peered":"2024-09-17T01:46:32.776996+0000","last_clean":"2024-09-17T01:46:32.776996+0000","last_became_active":"2024-09-17T01:46:31.431642+0000","last_became_peered":"2024-09-17T01:46:31.431642+0000","last_unstale":"2024-09-17T01:46:32.776996+0000","last_undegraded":"2024-09-17T01:46:32.776996+0000","last_fullsized":"2024-09-17T01:46:32.776996+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:08.595846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776725+0000","last_change":"2024-09-17T01:46:30.422016+0000","last_active":"2024-09-17T01:46:32.776725+0000","last_peered":"2024-09-17T01:46:32.776725+0000","last_clean":"2024-09-17T01:46:32.776725+0000","last_became_active":"2024-09-17T01:46:30.421643+0000","last_became_peered":"2024-09-17T01:46:30.421643+0000","last_unstale":"2024-09-17T01:46:32.776725+0000","last_undegraded":"2024-09-17T01:46:32.776725+0000","last_fullsized":"2024-09-17T01:46:32.776725+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:22.199090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428012+0000","last_change":"2024-09-17T01:46:31.433043+0000","last_active":"2024-09-17T01:46:32.428012+0000","last_peered":"2024-09-17T01:46:32.428012+0000","last_clean":"2024-09-17T01:46:32.428012+0000","last_became_active":"2024-09-17T01:46:31.432720+0000","last_became_peered":"2024-09-17T01:46:31.432720+0000","last_unstale":"2024-09-17T01:46:32.428012+0000","last_undegraded":"2024-09-17T01:46:32.428012+0000","last_fullsized":"2024-09-17T01:46:32.428012+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:57:32.671300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.b","version":"186'2","reported_seq":17,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775602+0000","last_change":"2024-09-17T01:46:30.405350+0000","last_active":"2024-09-17T01:46:32.775602+0000","last_peered":"2024-09-17T01:46:32.775602+0000","last_clean":"2024-09-17T01:46:32.775602+0000","last_became_active":"2024-09-17T01:46:30.404996+0000","last_became_peered":"2024-09-17T01:46:30.404996+0000","last_unstale":"2024-09-17T01:46:32.775602+0000","last_undegraded":"2024-09-17T01:46:32.775602+0000","last_fullsized":"2024-09-17T01:46:32.775602+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:58.482506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777051+0000","last_change":"2024-09-17T01:46:31.442677+0000","last_active":"2024-09-17T01:46:32.777051+0000","last_peered":"2024-09-17T01:46:32.777051+0000","last_clean":"2024-09-17T01:46:32.777051+0000","last_became_active":"2024-09-17T01:46:31.442347+0000","last_became_peered":"2024-09-17T01:46:31.442347+0000","last_unstale":"2024-09-17T01:46:32.777051+0000","last_undegraded":"2024-09-17T01:46:32.777051+0000","last_fullsized":"2024-09-17T01:46:32.777051+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:19.562731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426379+0000","last_change":"2024-09-17T01:46:30.412325+0000","last_active":"2024-09-17T01:46:32.426379+0000","last_peered":"2024-09-17T01:46:32.426379+0000","last_clean":"2024-09-17T01:46:32.426379+0000","last_became_active":"2024-09-17T01:46:30.412047+0000","last_became_peered":"2024-09-17T01:46:30.412047+0000","last_unstale":"2024-09-17T01:46:32.426379+0000","last_undegraded":"2024-09-17T01:46:32.426379+0000","last_fullsized":"2024-09-17T01:46:32.426379+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:54.073456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775239+0000","last_change":"2024-09-17T01:46:31.432167+0000","last_active":"2024-09-17T01:46:32.775239+0000","last_peered":"2024-09-17T01:46:32.775239+0000","last_clean":"2024-09-17T01:46:32.775239+0000","last_became_active":"2024-09-17T01:46:31.431789+0000","last_became_peered":"2024-09-17T01:46:31.431789+0000","last_unstale":"2024-09-17T01:46:32.775239+0000","last_undegraded":"2024-09-17T01:46:32.775239+0000","last_fullsized":"2024-09-17T01:46:32.775239+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:21.650118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426921+0000","last_change":"2024-09-17T01:46:30.427238+0000","last_active":"2024-09-17T01:46:32.426921+0000","last_peered":"2024-09-17T01:46:32.426921+0000","last_clean":"2024-09-17T01:46:32.426921+0000","last_became_active":"2024-09-17T01:46:30.426611+0000","last_became_peered":"2024-09-17T01:46:30.426611+0000","last_unstale":"2024-09-17T01:46:32.426921+0000","last_undegraded":"2024-09-17T01:46:32.426921+0000","last_fullsized":"2024-09-17T01:46:32.426921+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:15.611305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775673+0000","last_change":"2024-09-17T01:46:31.419791+0000","last_active":"2024-09-17T01:46:32.775673+0000","last_peered":"2024-09-17T01:46:32.775673+0000","last_clean":"2024-09-17T01:46:32.775673+0000","last_became_active":"2024-09-17T01:46:31.419473+0000","last_became_peered":"2024-09-17T01:46:31.419473+0000","last_unstale":"2024-09-17T01:46:32.775673+0000","last_undegraded":"2024-09-17T01:46:32.775673+0000","last_fullsized":"2024-09-17T01:46:32.775673+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:32.481643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426899+0000","last_change":"2024-09-17T01:46:30.420644+0000","last_active":"2024-09-17T01:46:32.426899+0000","last_peered":"2024-09-17T01:46:32.426899+0000","last_clean":"2024-09-17T01:46:32.426899+0000","last_became_active":"2024-09-17T01:46:30.420307+0000","last_became_peered":"2024-09-17T01:46:30.420307+0000","last_unstale":"2024-09-17T01:46:32.426899+0000","last_undegraded":"2024-09-17T01:46:32.426899+0000","last_fullsized":"2024-09-17T01:46:32.426899+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:00.872803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777003+0000","last_change":"2024-09-17T01:46:31.444744+0000","last_active":"2024-09-17T01:46:32.777003+0000","last_peered":"2024-09-17T01:46:32.777003+0000","last_clean":"2024-09-17T01:46:32.777003+0000","last_became_active":"2024-09-17T01:46:31.444375+0000","last_became_peered":"2024-09-17T01:46:31.444375+0000","last_unstale":"2024-09-17T01:46:32.777003+0000","last_undegraded":"2024-09-17T01:46:32.777003+0000","last_fullsized":"2024-09-17T01:46:32.777003+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:43.584917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.7","version":"186'2","reported_seq":17,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427390+0000","last_change":"2024-09-17T01:46:30.425299+0000","last_active":"2024-09-17T01:46:32.427390+0000","last_peered":"2024-09-17T01:46:32.427390+0000","last_clean":"2024-09-17T01:46:32.427390+0000","last_became_active":"2024-09-17T01:46:30.424946+0000","last_became_peered":"2024-09-17T01:46:30.424946+0000","last_unstale":"2024-09-17T01:46:32.427390+0000","last_undegraded":"2024-09-17T01:46:32.427390+0000","last_fullsized":"2024-09-17T01:46:32.427390+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:28.876800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777440+0000","last_change":"2024-09-17T01:46:31.442936+0000","last_active":"2024-09-17T01:46:32.777440+0000","last_peered":"2024-09-17T01:46:32.777440+0000","last_clean":"2024-09-17T01:46:32.777440+0000","last_became_active":"2024-09-17T01:46:31.441624+0000","last_became_peered":"2024-09-17T01:46:31.441624+0000","last_unstale":"2024-09-17T01:46:32.777440+0000","last_undegraded":"2024-09-17T01:46:32.777440+0000","last_fullsized":"2024-09-17T01:46:32.777440+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:32.363557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.6","version":"187'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425796+0000","last_change":"2024-09-17T01:46:30.412132+0000","last_active":"2024-09-17T01:46:32.425796+0000","last_peered":"2024-09-17T01:46:32.425796+0000","last_clean":"2024-09-17T01:46:32.425796+0000","last_became_active":"2024-09-17T01:46:30.411804+0000","last_became_peered":"2024-09-17T01:46:30.411804+0000","last_unstale":"2024-09-17T01:46:32.425796+0000","last_undegraded":"2024-09-17T01:46:32.425796+0000","last_fullsized":"2024-09-17T01:46:32.425796+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:25.842168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425575+0000","last_change":"2024-09-17T01:46:31.429507+0000","last_active":"2024-09-17T01:46:32.425575+0000","last_peered":"2024-09-17T01:46:32.425575+0000","last_clean":"2024-09-17T01:46:32.425575+0000","last_became_active":"2024-09-17T01:46:31.425532+0000","last_became_peered":"2024-09-17T01:46:31.425532+0000","last_unstale":"2024-09-17T01:46:32.425575+0000","last_undegraded":"2024-09-17T01:46:32.425575+0000","last_fullsized":"2024-09-17T01:46:32.425575+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:18.372344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777250+0000","last_change":"2024-09-17T01:46:30.418076+0000","last_active":"2024-09-17T01:46:32.777250+0000","last_peered":"2024-09-17T01:46:32.777250+0000","last_clean":"2024-09-17T01:46:32.777250+0000","last_became_active":"2024-09-17T01:46:30.417242+0000","last_became_peered":"2024-09-17T01:46:30.417242+0000","last_unstale":"2024-09-17T01:46:32.777250+0000","last_undegraded":"2024-09-17T01:46:32.777250+0000","last_fullsized":"2024-09-17T01:46:32.777250+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:33.506264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776177+0000","last_change":"2024-09-17T01:46:31.445495+0000","last_active":"2024-09-17T01:46:32.776177+0000","last_peered":"2024-09-17T01:46:32.776177+0000","last_clean":"2024-09-17T01:46:32.776177+0000","last_became_active":"2024-09-17T01:46:31.444572+0000","last_became_peered":"2024-09-17T01:46:31.444572+0000","last_unstale":"2024-09-17T01:46:32.776177+0000","last_undegraded":"2024-09-17T01:46:32.776177+0000","last_fullsized":"2024-09-17T01:46:32.776177+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:16.618396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776893+0000","last_change":"2024-09-17T01:46:30.422029+0000","last_active":"2024-09-17T01:46:32.776893+0000","last_peered":"2024-09-17T01:46:32.776893+0000","last_clean":"2024-09-17T01:46:32.776893+0000","last_became_active":"2024-09-17T01:46:30.421681+0000","last_became_peered":"2024-09-17T01:46:30.421681+0000","last_unstale":"2024-09-17T01:46:32.776893+0000","last_undegraded":"2024-09-17T01:46:32.776893+0000","last_fullsized":"2024-09-17T01:46:32.776893+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:09.520044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777330+0000","last_change":"2024-09-17T01:46:31.439442+0000","last_active":"2024-09-17T01:46:32.777330+0000","last_peered":"2024-09-17T01:46:32.777330+0000","last_clean":"2024-09-17T01:46:32.777330+0000","last_became_active":"2024-09-17T01:46:31.438915+0000","last_became_peered":"2024-09-17T01:46:31.438915+0000","last_unstale":"2024-09-17T01:46:32.777330+0000","last_undegraded":"2024-09-17T01:46:32.777330+0000","last_fullsized":"2024-09-17T01:46:32.777330+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:27.999899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775727+0000","last_change":"2024-09-17T01:46:30.419847+0000","last_active":"2024-09-17T01:46:32.775727+0000","last_peered":"2024-09-17T01:46:32.775727+0000","last_clean":"2024-09-17T01:46:32.775727+0000","last_became_active":"2024-09-17T01:46:30.419467+0000","last_became_peered":"2024-09-17T01:46:30.419467+0000","last_unstale":"2024-09-17T01:46:32.775727+0000","last_undegraded":"2024-09-17T01:46:32.775727+0000","last_fullsized":"2024-09-17T01:46:32.775727+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:38.792786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425447+0000","last_change":"2024-09-17T01:46:31.437996+0000","last_active":"2024-09-17T01:46:32.425447+0000","last_peered":"2024-09-17T01:46:32.425447+0000","last_clean":"2024-09-17T01:46:32.425447+0000","last_became_active":"2024-09-17T01:46:31.437135+0000","last_became_peered":"2024-09-17T01:46:31.437135+0000","last_unstale":"2024-09-17T01:46:32.425447+0000","last_undegraded":"2024-09-17T01:46:32.425447+0000","last_fullsized":"2024-09-17T01:46:32.425447+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:46.620491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428203+0000","last_change":"2024-09-17T01:46:30.426320+0000","last_active":"2024-09-17T01:46:32.428203+0000","last_peered":"2024-09-17T01:46:32.428203+0000","last_clean":"2024-09-17T01:46:32.428203+0000","last_became_active":"2024-09-17T01:46:30.425888+0000","last_became_peered":"2024-09-17T01:46:30.425888+0000","last_unstale":"2024-09-17T01:46:32.428203+0000","last_undegraded":"2024-09-17T01:46:32.428203+0000","last_fullsized":"2024-09-17T01:46:32.428203+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:42.270562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426663+0000","last_change":"2024-09-17T01:46:31.425903+0000","last_active":"2024-09-17T01:46:32.426663+0000","last_peered":"2024-09-17T01:46:32.426663+0000","last_clean":"2024-09-17T01:46:32.426663+0000","last_became_active":"2024-09-17T01:46:31.425503+0000","last_became_peered":"2024-09-17T01:46:31.425503+0000","last_unstale":"2024-09-17T01:46:32.426663+0000","last_undegraded":"2024-09-17T01:46:32.426663+0000","last_fullsized":"2024-09-17T01:46:32.426663+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:56.275736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775493+0000","last_change":"2024-09-17T01:46:30.422496+0000","last_active":"2024-09-17T01:46:32.775493+0000","last_peered":"2024-09-17T01:46:32.775493+0000","last_clean":"2024-09-17T01:46:32.775493+0000","last_became_active":"2024-09-17T01:46:30.422122+0000","last_became_peered":"2024-09-17T01:46:30.422122+0000","last_unstale":"2024-09-17T01:46:32.775493+0000","last_undegraded":"2024-09-17T01:46:32.775493+0000","last_fullsized":"2024-09-17T01:46:32.775493+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:23.170746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775911+0000","last_change":"2024-09-17T01:46:31.420520+0000","last_active":"2024-09-17T01:46:32.775911+0000","last_peered":"2024-09-17T01:46:32.775911+0000","last_clean":"2024-09-17T01:46:32.775911+0000","last_became_active":"2024-09-17T01:46:31.420133+0000","last_became_peered":"2024-09-17T01:46:31.420133+0000","last_unstale":"2024-09-17T01:46:32.775911+0000","last_undegraded":"2024-09-17T01:46:32.775911+0000","last_fullsized":"2024-09-17T01:46:32.775911+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:04.257713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775432+0000","last_change":"2024-09-17T01:46:30.426020+0000","last_active":"2024-09-17T01:46:32.775432+0000","last_peered":"2024-09-17T01:46:32.775432+0000","last_clean":"2024-09-17T01:46:32.775432+0000","last_became_active":"2024-09-17T01:46:30.425079+0000","last_became_peered":"2024-09-17T01:46:30.425079+0000","last_unstale":"2024-09-17T01:46:32.775432+0000","last_undegraded":"2024-09-17T01:46:32.775432+0000","last_fullsized":"2024-09-17T01:46:32.775432+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:42.283883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428011+0000","last_change":"2024-09-17T01:46:31.444278+0000","last_active":"2024-09-17T01:46:32.428011+0000","last_peered":"2024-09-17T01:46:32.428011+0000","last_clean":"2024-09-17T01:46:32.428011+0000","last_became_active":"2024-09-17T01:46:31.443518+0000","last_became_peered":"2024-09-17T01:46:31.443518+0000","last_unstale":"2024-09-17T01:46:32.428011+0000","last_undegraded":"2024-09-17T01:46:32.428011+0000","last_fullsized":"2024-09-17T01:46:32.428011+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:28.913481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1b","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425512+0000","last_change":"2024-09-17T01:46:30.412509+0000","last_active":"2024-09-17T01:46:32.425512+0000","last_peered":"2024-09-17T01:46:32.425512+0000","last_clean":"2024-09-17T01:46:32.425512+0000","last_became_active":"2024-09-17T01:46:30.412226+0000","last_became_peered":"2024-09-17T01:46:30.412226+0000","last_unstale":"2024-09-17T01:46:32.425512+0000","last_undegraded":"2024-09-17T01:46:32.425512+0000","last_fullsized":"2024-09-17T01:46:32.425512+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:49.989646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":427,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775556+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:46:32.775556+0000","last_peered":"2024-09-17T01:46:32.775556+0000","last_clean":"2024-09-17T01:46:32.775556+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:46:32.775556+0000","last_undegraded":"2024-09-17T01:46:32.775556+0000","last_fullsized":"2024-09-17T01:46:32.775556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":764,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476915,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47340,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324500,"statfs":{"total":96636764160,"available":96588288000,"internally_reserved":0,"allocated":2310144,"data_stored":1018362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509619,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55700,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316140,"statfs":{"total":96636764160,"available":96579727360,"internally_reserved":0,"allocated":2351104,"data_stored":1037734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509618,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47372,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324468,"statfs":{"total":96636764160,"available":96588255232,"internally_reserved":0,"allocated":2351104,"data_stored":1037782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509619,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51540,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320300,"statfs":{"total":96636764160,"available":96583987200,"internally_reserved":0,"allocated":2351104,"data_stored":1037802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509619,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69532,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302308,"statfs":{"total":96636764160,"available":96565563392,"internally_reserved":0,"allocated":2359296,"data_stored":1039324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509618,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52116,"kb_used_data":2872,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319724,"statfs":{"total":96636764160,"available":96583397376,"internally_reserved":0,"allocated":2940928,"data_stored":1628080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509620,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59860,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311980,"statfs":{"total":96636764160,"available":96575467520,"internally_reserved":0,"allocated":2351104,"data_stored":1038294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":58915273},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542324,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52124,"kb_used_data":2888,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319716,"statfs":{"total":96636764160,"available":96583389184,"internally_reserved":0,"allocated":2957312,"data_stored":1628808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:46:36.413 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:46:36.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.680+0000 7f6c3f000640 1 -- 172.21.15.42:0/3700319706 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c38142f40 msgr2=0x7f6c38072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:36.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.680+0000 7f6c3f000640 1 --2- 172.21.15.42:0/3700319706 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c38142f40 0x7f6c38072950 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009830 tx=0x7f6c2002a520 comp rx=0 tx=0).stop 2024-09-17T01:46:36.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.680+0000 7f6c3f000640 1 -- 172.21.15.42:0/3700319706 shutdown_connections 2024-09-17T01:46:36.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.680+0000 7f6c3f000640 1 --2- 172.21.15.42:0/3700319706 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c38142f40 0x7f6c38072950 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:36.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.680+0000 7f6c3f000640 1 -- 172.21.15.42:0/3700319706 >> 172.21.15.42:0/3700319706 conn(0x7f6c380b2930 msgr2=0x7f6c3806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:36.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.680+0000 7f6c3f000640 1 -- 172.21.15.42:0/3700319706 shutdown_connections 2024-09-17T01:46:36.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.680+0000 7f6c3f000640 1 -- 172.21.15.42:0/3700319706 wait complete. 2024-09-17T01:46:36.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.682+0000 7f6c3f000640 1 Processor -- start 2024-09-17T01:46:36.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.682+0000 7f6c3f000640 1 -- start start 2024-09-17T01:46:36.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.683+0000 7f6c3f000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c38072e90 0x7f6c3813ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:36.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.683+0000 7f6c3f000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6c380b3550 0x7f6c38156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:36.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.684+0000 7f6c3f000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c38142f40 0x7f6c38159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:36.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.684+0000 7f6c3f000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3806d900 con 0x7f6c38072e90 2024-09-17T01:46:36.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.684+0000 7f6c3f000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3806d780 con 0x7f6c38142f40 2024-09-17T01:46:36.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.684+0000 7f6c3f000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6c3806da80 con 0x7f6c380b3550 2024-09-17T01:46:36.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.684+0000 7f6c37e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c38072e90 0x7f6c3813ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:36.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.684+0000 7f6c37e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c38072e90 0x7f6c3813ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46094/0 (socket says 172.21.15.42:46094) 2024-09-17T01:46:36.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.684+0000 7f6c37e00640 1 -- 172.21.15.42:0/3552666676 learned_addr learned my addr 172.21.15.42:0/3552666676 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:36.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.684+0000 7f6c2f400640 1 --2- 172.21.15.42:0/3552666676 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6c380b3550 0x7f6c38156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:36.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.684+0000 7f6c3d000640 1 --2- 172.21.15.42:0/3552666676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c38142f40 0x7f6c38159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:36.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.684+0000 7f6c37e00640 1 -- 172.21.15.42:0/3552666676 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6c380b3550 msgr2=0x7f6c38156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:36.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.684+0000 7f6c37e00640 1 --2- 172.21.15.42:0/3552666676 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6c380b3550 0x7f6c38156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:36.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.684+0000 7f6c37e00640 1 -- 172.21.15.42:0/3552666676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c38142f40 msgr2=0x7f6c38159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:36.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.684+0000 7f6c37e00640 1 --2- 172.21.15.42:0/3552666676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c38142f40 0x7f6c38159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:36.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.684+0000 7f6c37e00640 1 -- 172.21.15.42:0/3552666676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c38159660 con 0x7f6c38072e90 2024-09-17T01:46:36.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.685+0000 7f6c37e00640 1 --2- 172.21.15.42:0/3552666676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c38072e90 0x7f6c3813ed50 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800c430 tx=0x7f6c2800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:36.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.685+0000 7f6c34c00640 1 -- 172.21.15.42:0/3552666676 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c28017070 con 0x7f6c38072e90 2024-09-17T01:46:36.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.685+0000 7f6c34c00640 1 -- 172.21.15.42:0/3552666676 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c280053c0 con 0x7f6c38072e90 2024-09-17T01:46:36.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.685+0000 7f6c34c00640 1 -- 172.21.15.42:0/3552666676 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c28003850 con 0x7f6c38072e90 2024-09-17T01:46:36.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.685+0000 7f6c3f000640 1 -- 172.21.15.42:0/3552666676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c38158a50 con 0x7f6c38072e90 2024-09-17T01:46:36.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.685+0000 7f6c3f000640 1 -- 172.21.15.42:0/3552666676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c38159010 con 0x7f6c38072e90 2024-09-17T01:46:36.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.686+0000 7f6c3f000640 1 -- 172.21.15.42:0/3552666676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c3806a170 con 0x7f6c38072e90 2024-09-17T01:46:36.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.687+0000 7f6c34c00640 1 -- 172.21.15.42:0/3552666676 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6c2801a070 con 0x7f6c38072e90 2024-09-17T01:46:36.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.688+0000 7f6c34c00640 1 --2- 172.21.15.42:0/3552666676 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6c14078bc0 0x7f6c1407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:36.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.688+0000 7f6c34c00640 1 -- 172.21.15.42:0/3552666676 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f6c2809a110 con 0x7f6c38072e90 2024-09-17T01:46:36.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.689+0000 7f6c2f400640 1 --2- 172.21.15.42:0/3552666676 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6c14078bc0 0x7f6c1407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:36.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.689+0000 7f6c2f400640 1 --2- 172.21.15.42:0/3552666676 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6c14078bc0 0x7f6c1407b0d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f6c20034000 tx=0x7f6c20004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:36.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.693+0000 7f6c34c00640 1 -- 172.21.15.42:0/3552666676 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6c28061e60 con 0x7f6c38072e90 2024-09-17T01:46:36.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.885+0000 7f6c3f000640 1 -- 172.21.15.42:0/3552666676 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6c38073fb0 con 0x7f6c14078bc0 2024-09-17T01:46:36.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.890+0000 7f6c34c00640 1 -- 172.21.15.42:0/3552666676 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252131 (secure 0 0 0) 0x7f6c38073fb0 con 0x7f6c14078bc0 2024-09-17T01:46:36.894 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:46:36.896 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:46:36.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.895+0000 7f6c3f000640 1 -- 172.21.15.42:0/3552666676 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6c14078bc0 msgr2=0x7f6c1407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:36.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.895+0000 7f6c3f000640 1 --2- 172.21.15.42:0/3552666676 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6c14078bc0 0x7f6c1407b0d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f6c20034000 tx=0x7f6c20004730 comp rx=0 tx=0).stop 2024-09-17T01:46:36.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.895+0000 7f6c3f000640 1 -- 172.21.15.42:0/3552666676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c38072e90 msgr2=0x7f6c3813ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:36.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.895+0000 7f6c3f000640 1 --2- 172.21.15.42:0/3552666676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c38072e90 0x7f6c3813ed50 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800c430 tx=0x7f6c2800c8f0 comp rx=0 tx=0).stop 2024-09-17T01:46:36.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.895+0000 7f6c3f000640 1 -- 172.21.15.42:0/3552666676 shutdown_connections 2024-09-17T01:46:36.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.895+0000 7f6c3f000640 1 --2- 172.21.15.42:0/3552666676 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6c14078bc0 0x7f6c1407b0d0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:36.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.895+0000 7f6c3f000640 1 --2- 172.21.15.42:0/3552666676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c38142f40 0x7f6c38159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:36.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.895+0000 7f6c3f000640 1 --2- 172.21.15.42:0/3552666676 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6c380b3550 0x7f6c38156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:36.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.895+0000 7f6c3f000640 1 --2- 172.21.15.42:0/3552666676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c38072e90 0x7f6c3813ed50 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:36.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.895+0000 7f6c3f000640 1 -- 172.21.15.42:0/3552666676 >> 172.21.15.42:0/3552666676 conn(0x7f6c380b2930 msgr2=0x7f6c38073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:36.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.895+0000 7f6c3f000640 1 -- 172.21.15.42:0/3552666676 shutdown_connections 2024-09-17T01:46:36.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:36.895+0000 7f6c3f000640 1 -- 172.21.15.42:0/3552666676 wait complete. 2024-09-17T01:46:36.916 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":621,"stamp":"2024-09-17T01:46:35.228790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591132,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":134,"num_write_kb":1632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":435584,"kb_used_data":19504,"kb_used_omap":12,"kb_used_meta":415859,"kb_avail":754539136,"statfs":{"total":773094113280,"available":772648075264,"internally_reserved":0,"allocated":19972096,"data_stored":9466186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":425840180},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":764,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.836029"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777205+0000","last_change":"2024-09-17T01:46:31.449114+0000","last_active":"2024-09-17T01:46:32.777205+0000","last_peered":"2024-09-17T01:46:32.777205+0000","last_clean":"2024-09-17T01:46:32.777205+0000","last_became_active":"2024-09-17T01:46:31.444897+0000","last_became_peered":"2024-09-17T01:46:31.444897+0000","last_unstale":"2024-09-17T01:46:32.777205+0000","last_undegraded":"2024-09-17T01:46:32.777205+0000","last_fullsized":"2024-09-17T01:46:32.777205+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:10.122631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425679+0000","last_change":"2024-09-17T01:46:31.424827+0000","last_active":"2024-09-17T01:46:32.425679+0000","last_peered":"2024-09-17T01:46:32.425679+0000","last_clean":"2024-09-17T01:46:32.425679+0000","last_became_active":"2024-09-17T01:46:31.424256+0000","last_became_peered":"2024-09-17T01:46:31.424256+0000","last_unstale":"2024-09-17T01:46:32.425679+0000","last_undegraded":"2024-09-17T01:46:32.425679+0000","last_fullsized":"2024-09-17T01:46:32.425679+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:16.070389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428308+0000","last_change":"2024-09-17T01:46:31.440514+0000","last_active":"2024-09-17T01:46:32.428308+0000","last_peered":"2024-09-17T01:46:32.428308+0000","last_clean":"2024-09-17T01:46:32.428308+0000","last_became_active":"2024-09-17T01:46:31.439579+0000","last_became_peered":"2024-09-17T01:46:31.439579+0000","last_unstale":"2024-09-17T01:46:32.428308+0000","last_undegraded":"2024-09-17T01:46:32.428308+0000","last_fullsized":"2024-09-17T01:46:32.428308+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:43.542003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776158+0000","last_change":"2024-09-17T01:46:31.434326+0000","last_active":"2024-09-17T01:46:32.776158+0000","last_peered":"2024-09-17T01:46:32.776158+0000","last_clean":"2024-09-17T01:46:32.776158+0000","last_became_active":"2024-09-17T01:46:31.434028+0000","last_became_peered":"2024-09-17T01:46:31.434028+0000","last_unstale":"2024-09-17T01:46:32.776158+0000","last_undegraded":"2024-09-17T01:46:32.776158+0000","last_fullsized":"2024-09-17T01:46:32.776158+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:36.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428626+0000","last_change":"2024-09-17T01:46:31.444693+0000","last_active":"2024-09-17T01:46:32.428626+0000","last_peered":"2024-09-17T01:46:32.428626+0000","last_clean":"2024-09-17T01:46:32.428626+0000","last_became_active":"2024-09-17T01:46:31.444143+0000","last_became_peered":"2024-09-17T01:46:31.444143+0000","last_unstale":"2024-09-17T01:46:32.428626+0000","last_undegraded":"2024-09-17T01:46:32.428626+0000","last_fullsized":"2024-09-17T01:46:32.428626+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:19:45.427741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777290+0000","last_change":"2024-09-17T01:46:31.439648+0000","last_active":"2024-09-17T01:46:32.777290+0000","last_peered":"2024-09-17T01:46:32.777290+0000","last_clean":"2024-09-17T01:46:32.777290+0000","last_became_active":"2024-09-17T01:46:31.439317+0000","last_became_peered":"2024-09-17T01:46:31.439317+0000","last_unstale":"2024-09-17T01:46:32.777290+0000","last_undegraded":"2024-09-17T01:46:32.777290+0000","last_fullsized":"2024-09-17T01:46:32.777290+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:29.867513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776468+0000","last_change":"2024-09-17T01:46:31.446698+0000","last_active":"2024-09-17T01:46:32.776468+0000","last_peered":"2024-09-17T01:46:32.776468+0000","last_clean":"2024-09-17T01:46:32.776468+0000","last_became_active":"2024-09-17T01:46:31.446416+0000","last_became_peered":"2024-09-17T01:46:31.446416+0000","last_unstale":"2024-09-17T01:46:32.776468+0000","last_undegraded":"2024-09-17T01:46:32.776468+0000","last_fullsized":"2024-09-17T01:46:32.776468+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:32.837724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426360+0000","last_change":"2024-09-17T01:46:31.426666+0000","last_active":"2024-09-17T01:46:32.426360+0000","last_peered":"2024-09-17T01:46:32.426360+0000","last_clean":"2024-09-17T01:46:32.426360+0000","last_became_active":"2024-09-17T01:46:31.426352+0000","last_became_peered":"2024-09-17T01:46:31.426352+0000","last_unstale":"2024-09-17T01:46:32.426360+0000","last_undegraded":"2024-09-17T01:46:32.426360+0000","last_fullsized":"2024-09-17T01:46:32.426360+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:04.991154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2024-09-17T01:46:30.407450+0000","last_change":"2024-09-17T01:46:30.407450+0000","last_active":"2024-09-17T01:46:30.391480+0000","last_peered":"2024-09-17T01:46:30.391480+0000","last_clean":"2024-09-17T01:46:30.391480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:46:30.407450+0000","last_undegraded":"2024-09-17T01:46:30.407450+0000","last_fullsized":"2024-09-17T01:46:30.407450+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428433+0000","last_change":"2024-09-17T01:46:31.438389+0000","last_active":"2024-09-17T01:46:32.428433+0000","last_peered":"2024-09-17T01:46:32.428433+0000","last_clean":"2024-09-17T01:46:32.428433+0000","last_became_active":"2024-09-17T01:46:31.437275+0000","last_became_peered":"2024-09-17T01:46:31.437275+0000","last_unstale":"2024-09-17T01:46:32.428433+0000","last_undegraded":"2024-09-17T01:46:32.428433+0000","last_fullsized":"2024-09-17T01:46:32.428433+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:12:42.193215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777056+0000","last_change":"2024-09-17T01:46:31.441613+0000","last_active":"2024-09-17T01:46:32.777056+0000","last_peered":"2024-09-17T01:46:32.777056+0000","last_clean":"2024-09-17T01:46:32.777056+0000","last_became_active":"2024-09-17T01:46:31.440235+0000","last_became_peered":"2024-09-17T01:46:31.440235+0000","last_unstale":"2024-09-17T01:46:32.777056+0000","last_undegraded":"2024-09-17T01:46:32.777056+0000","last_fullsized":"2024-09-17T01:46:32.777056+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:32.524306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775618+0000","last_change":"2024-09-17T01:46:31.416960+0000","last_active":"2024-09-17T01:46:32.775618+0000","last_peered":"2024-09-17T01:46:32.775618+0000","last_clean":"2024-09-17T01:46:32.775618+0000","last_became_active":"2024-09-17T01:46:31.416577+0000","last_became_peered":"2024-09-17T01:46:31.416577+0000","last_unstale":"2024-09-17T01:46:32.775618+0000","last_undegraded":"2024-09-17T01:46:32.775618+0000","last_fullsized":"2024-09-17T01:46:32.775618+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:52:25.962925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775387+0000","last_change":"2024-09-17T01:46:31.428536+0000","last_active":"2024-09-17T01:46:32.775387+0000","last_peered":"2024-09-17T01:46:32.775387+0000","last_clean":"2024-09-17T01:46:32.775387+0000","last_became_active":"2024-09-17T01:46:31.425769+0000","last_became_peered":"2024-09-17T01:46:31.425769+0000","last_unstale":"2024-09-17T01:46:32.775387+0000","last_undegraded":"2024-09-17T01:46:32.775387+0000","last_fullsized":"2024-09-17T01:46:32.775387+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:22:23.512532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775774+0000","last_change":"2024-09-17T01:46:31.427311+0000","last_active":"2024-09-17T01:46:32.775774+0000","last_peered":"2024-09-17T01:46:32.775774+0000","last_clean":"2024-09-17T01:46:32.775774+0000","last_became_active":"2024-09-17T01:46:31.426922+0000","last_became_peered":"2024-09-17T01:46:31.426922+0000","last_unstale":"2024-09-17T01:46:32.775774+0000","last_undegraded":"2024-09-17T01:46:32.775774+0000","last_fullsized":"2024-09-17T01:46:32.775774+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:28.913481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776459+0000","last_change":"2024-09-17T01:46:31.445995+0000","last_active":"2024-09-17T01:46:32.776459+0000","last_peered":"2024-09-17T01:46:32.776459+0000","last_clean":"2024-09-17T01:46:32.776459+0000","last_became_active":"2024-09-17T01:46:31.442444+0000","last_became_peered":"2024-09-17T01:46:31.442444+0000","last_unstale":"2024-09-17T01:46:32.776459+0000","last_undegraded":"2024-09-17T01:46:32.776459+0000","last_fullsized":"2024-09-17T01:46:32.776459+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:27.316162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776447+0000","last_change":"2024-09-17T01:46:31.432472+0000","last_active":"2024-09-17T01:46:32.776447+0000","last_peered":"2024-09-17T01:46:32.776447+0000","last_clean":"2024-09-17T01:46:32.776447+0000","last_became_active":"2024-09-17T01:46:31.431958+0000","last_became_peered":"2024-09-17T01:46:31.431958+0000","last_unstale":"2024-09-17T01:46:32.776447+0000","last_undegraded":"2024-09-17T01:46:32.776447+0000","last_fullsized":"2024-09-17T01:46:32.776447+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:44.766306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777329+0000","last_change":"2024-09-17T01:46:31.444639+0000","last_active":"2024-09-17T01:46:32.777329+0000","last_peered":"2024-09-17T01:46:32.777329+0000","last_clean":"2024-09-17T01:46:32.777329+0000","last_became_active":"2024-09-17T01:46:31.442591+0000","last_became_peered":"2024-09-17T01:46:31.442591+0000","last_unstale":"2024-09-17T01:46:32.777329+0000","last_undegraded":"2024-09-17T01:46:32.777329+0000","last_fullsized":"2024-09-17T01:46:32.777329+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:11.846706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428771+0000","last_change":"2024-09-17T01:46:31.434660+0000","last_active":"2024-09-17T01:46:32.428771+0000","last_peered":"2024-09-17T01:46:32.428771+0000","last_clean":"2024-09-17T01:46:32.428771+0000","last_became_active":"2024-09-17T01:46:31.434321+0000","last_became_peered":"2024-09-17T01:46:31.434321+0000","last_unstale":"2024-09-17T01:46:32.428771+0000","last_undegraded":"2024-09-17T01:46:32.428771+0000","last_fullsized":"2024-09-17T01:46:32.428771+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:11.153289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.429127+0000","last_change":"2024-09-17T01:46:31.439946+0000","last_active":"2024-09-17T01:46:32.429127+0000","last_peered":"2024-09-17T01:46:32.429127+0000","last_clean":"2024-09-17T01:46:32.429127+0000","last_became_active":"2024-09-17T01:46:31.439546+0000","last_became_peered":"2024-09-17T01:46:31.439546+0000","last_unstale":"2024-09-17T01:46:32.429127+0000","last_undegraded":"2024-09-17T01:46:32.429127+0000","last_fullsized":"2024-09-17T01:46:32.429127+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:05.120666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428283+0000","last_change":"2024-09-17T01:46:31.437213+0000","last_active":"2024-09-17T01:46:32.428283+0000","last_peered":"2024-09-17T01:46:32.428283+0000","last_clean":"2024-09-17T01:46:32.428283+0000","last_became_active":"2024-09-17T01:46:31.436423+0000","last_became_peered":"2024-09-17T01:46:31.436423+0000","last_unstale":"2024-09-17T01:46:32.428283+0000","last_undegraded":"2024-09-17T01:46:32.428283+0000","last_fullsized":"2024-09-17T01:46:32.428283+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:27.109581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776147+0000","last_change":"2024-09-17T01:46:31.427386+0000","last_active":"2024-09-17T01:46:32.776147+0000","last_peered":"2024-09-17T01:46:32.776147+0000","last_clean":"2024-09-17T01:46:32.776147+0000","last_became_active":"2024-09-17T01:46:31.425405+0000","last_became_peered":"2024-09-17T01:46:31.425405+0000","last_unstale":"2024-09-17T01:46:32.776147+0000","last_undegraded":"2024-09-17T01:46:32.776147+0000","last_fullsized":"2024-09-17T01:46:32.776147+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:43.277654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425441+0000","last_change":"2024-09-17T01:46:31.436812+0000","last_active":"2024-09-17T01:46:32.425441+0000","last_peered":"2024-09-17T01:46:32.425441+0000","last_clean":"2024-09-17T01:46:32.425441+0000","last_became_active":"2024-09-17T01:46:31.436297+0000","last_became_peered":"2024-09-17T01:46:31.436297+0000","last_unstale":"2024-09-17T01:46:32.425441+0000","last_undegraded":"2024-09-17T01:46:32.425441+0000","last_fullsized":"2024-09-17T01:46:32.425441+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:32:19.529698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775436+0000","last_change":"2024-09-17T01:46:31.423114+0000","last_active":"2024-09-17T01:46:32.775436+0000","last_peered":"2024-09-17T01:46:32.775436+0000","last_clean":"2024-09-17T01:46:32.775436+0000","last_became_active":"2024-09-17T01:46:31.422795+0000","last_became_peered":"2024-09-17T01:46:31.422795+0000","last_unstale":"2024-09-17T01:46:32.775436+0000","last_undegraded":"2024-09-17T01:46:32.775436+0000","last_fullsized":"2024-09-17T01:46:32.775436+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:07.226908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2024-09-17T01:46:30.407363+0000","last_change":"2024-09-17T01:46:30.407363+0000","last_active":"2024-09-17T01:46:30.391480+0000","last_peered":"2024-09-17T01:46:30.391480+0000","last_clean":"2024-09-17T01:46:30.391480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:46:30.407363+0000","last_undegraded":"2024-09-17T01:46:30.407363+0000","last_fullsized":"2024-09-17T01:46:30.407363+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776072+0000","last_change":"2024-09-17T01:46:31.446218+0000","last_active":"2024-09-17T01:46:32.776072+0000","last_peered":"2024-09-17T01:46:32.776072+0000","last_clean":"2024-09-17T01:46:32.776072+0000","last_became_active":"2024-09-17T01:46:31.445885+0000","last_became_peered":"2024-09-17T01:46:31.445885+0000","last_unstale":"2024-09-17T01:46:32.776072+0000","last_undegraded":"2024-09-17T01:46:32.776072+0000","last_fullsized":"2024-09-17T01:46:32.776072+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:06.717241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427501+0000","last_change":"2024-09-17T01:46:31.426677+0000","last_active":"2024-09-17T01:46:32.427501+0000","last_peered":"2024-09-17T01:46:32.427501+0000","last_clean":"2024-09-17T01:46:32.427501+0000","last_became_active":"2024-09-17T01:46:31.425517+0000","last_became_peered":"2024-09-17T01:46:31.425517+0000","last_unstale":"2024-09-17T01:46:32.427501+0000","last_undegraded":"2024-09-17T01:46:32.427501+0000","last_fullsized":"2024-09-17T01:46:32.427501+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:31.981218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775884+0000","last_change":"2024-09-17T01:46:31.425570+0000","last_active":"2024-09-17T01:46:32.775884+0000","last_peered":"2024-09-17T01:46:32.775884+0000","last_clean":"2024-09-17T01:46:32.775884+0000","last_became_active":"2024-09-17T01:46:31.425256+0000","last_became_peered":"2024-09-17T01:46:31.425256+0000","last_unstale":"2024-09-17T01:46:32.775884+0000","last_undegraded":"2024-09-17T01:46:32.775884+0000","last_fullsized":"2024-09-17T01:46:32.775884+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:40.200273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427198+0000","last_change":"2024-09-17T01:46:31.422013+0000","last_active":"2024-09-17T01:46:32.427198+0000","last_peered":"2024-09-17T01:46:32.427198+0000","last_clean":"2024-09-17T01:46:32.427198+0000","last_became_active":"2024-09-17T01:46:31.421574+0000","last_became_peered":"2024-09-17T01:46:31.421574+0000","last_unstale":"2024-09-17T01:46:32.427198+0000","last_undegraded":"2024-09-17T01:46:32.427198+0000","last_fullsized":"2024-09-17T01:46:32.427198+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:13.432651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425439+0000","last_change":"2024-09-17T01:46:31.426049+0000","last_active":"2024-09-17T01:46:32.425439+0000","last_peered":"2024-09-17T01:46:32.425439+0000","last_clean":"2024-09-17T01:46:32.425439+0000","last_became_active":"2024-09-17T01:46:31.425700+0000","last_became_peered":"2024-09-17T01:46:31.425700+0000","last_unstale":"2024-09-17T01:46:32.425439+0000","last_undegraded":"2024-09-17T01:46:32.425439+0000","last_fullsized":"2024-09-17T01:46:32.425439+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:15.961268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775828+0000","last_change":"2024-09-17T01:46:31.445360+0000","last_active":"2024-09-17T01:46:32.775828+0000","last_peered":"2024-09-17T01:46:32.775828+0000","last_clean":"2024-09-17T01:46:32.775828+0000","last_became_active":"2024-09-17T01:46:31.445034+0000","last_became_peered":"2024-09-17T01:46:31.445034+0000","last_unstale":"2024-09-17T01:46:32.775828+0000","last_undegraded":"2024-09-17T01:46:32.775828+0000","last_fullsized":"2024-09-17T01:46:32.775828+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:18.585792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426826+0000","last_change":"2024-09-17T01:46:31.436801+0000","last_active":"2024-09-17T01:46:32.426826+0000","last_peered":"2024-09-17T01:46:32.426826+0000","last_clean":"2024-09-17T01:46:32.426826+0000","last_became_active":"2024-09-17T01:46:31.436442+0000","last_became_peered":"2024-09-17T01:46:31.436442+0000","last_unstale":"2024-09-17T01:46:32.426826+0000","last_undegraded":"2024-09-17T01:46:32.426826+0000","last_fullsized":"2024-09-17T01:46:32.426826+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:29.158716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776024+0000","last_change":"2024-09-17T01:46:31.435302+0000","last_active":"2024-09-17T01:46:32.776024+0000","last_peered":"2024-09-17T01:46:32.776024+0000","last_clean":"2024-09-17T01:46:32.776024+0000","last_became_active":"2024-09-17T01:46:31.435007+0000","last_became_peered":"2024-09-17T01:46:31.435007+0000","last_unstale":"2024-09-17T01:46:32.776024+0000","last_undegraded":"2024-09-17T01:46:32.776024+0000","last_fullsized":"2024-09-17T01:46:32.776024+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:06.685153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776762+0000","last_change":"2024-09-17T01:46:31.422309+0000","last_active":"2024-09-17T01:46:32.776762+0000","last_peered":"2024-09-17T01:46:32.776762+0000","last_clean":"2024-09-17T01:46:32.776762+0000","last_became_active":"2024-09-17T01:46:31.421687+0000","last_became_peered":"2024-09-17T01:46:31.421687+0000","last_unstale":"2024-09-17T01:46:32.776762+0000","last_undegraded":"2024-09-17T01:46:32.776762+0000","last_fullsized":"2024-09-17T01:46:32.776762+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:23.754735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1f","version":"186'4","reported_seq":19,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776472+0000","last_change":"2024-09-17T01:46:30.421999+0000","last_active":"2024-09-17T01:46:32.776472+0000","last_peered":"2024-09-17T01:46:32.776472+0000","last_clean":"2024-09-17T01:46:32.776472+0000","last_became_active":"2024-09-17T01:46:30.421444+0000","last_became_peered":"2024-09-17T01:46:30.421444+0000","last_unstale":"2024-09-17T01:46:32.776472+0000","last_undegraded":"2024-09-17T01:46:32.776472+0000","last_fullsized":"2024-09-17T01:46:32.776472+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:19:33.239539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776314+0000","last_change":"2024-09-17T01:46:31.436431+0000","last_active":"2024-09-17T01:46:32.776314+0000","last_peered":"2024-09-17T01:46:32.776314+0000","last_clean":"2024-09-17T01:46:32.776314+0000","last_became_active":"2024-09-17T01:46:31.436098+0000","last_became_peered":"2024-09-17T01:46:31.436098+0000","last_unstale":"2024-09-17T01:46:32.776314+0000","last_undegraded":"2024-09-17T01:46:32.776314+0000","last_fullsized":"2024-09-17T01:46:32.776314+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:10.579523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1e","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425770+0000","last_change":"2024-09-17T01:46:30.414291+0000","last_active":"2024-09-17T01:46:32.425770+0000","last_peered":"2024-09-17T01:46:32.425770+0000","last_clean":"2024-09-17T01:46:32.425770+0000","last_became_active":"2024-09-17T01:46:30.413782+0000","last_became_peered":"2024-09-17T01:46:30.413782+0000","last_unstale":"2024-09-17T01:46:32.425770+0000","last_undegraded":"2024-09-17T01:46:32.425770+0000","last_fullsized":"2024-09-17T01:46:32.425770+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:04.480361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428927+0000","last_change":"2024-09-17T01:46:31.435399+0000","last_active":"2024-09-17T01:46:32.428927+0000","last_peered":"2024-09-17T01:46:32.428927+0000","last_clean":"2024-09-17T01:46:32.428927+0000","last_became_active":"2024-09-17T01:46:31.434992+0000","last_became_peered":"2024-09-17T01:46:31.434992+0000","last_unstale":"2024-09-17T01:46:32.428927+0000","last_undegraded":"2024-09-17T01:46:32.428927+0000","last_fullsized":"2024-09-17T01:46:32.428927+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:50:55.804363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"186'2","reported_seq":17,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427047+0000","last_change":"2024-09-17T01:46:30.417874+0000","last_active":"2024-09-17T01:46:32.427047+0000","last_peered":"2024-09-17T01:46:32.427047+0000","last_clean":"2024-09-17T01:46:32.427047+0000","last_became_active":"2024-09-17T01:46:30.416190+0000","last_became_peered":"2024-09-17T01:46:30.416190+0000","last_unstale":"2024-09-17T01:46:32.427047+0000","last_undegraded":"2024-09-17T01:46:32.427047+0000","last_fullsized":"2024-09-17T01:46:32.427047+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:02.232021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428642+0000","last_change":"2024-09-17T01:46:31.443348+0000","last_active":"2024-09-17T01:46:32.428642+0000","last_peered":"2024-09-17T01:46:32.428642+0000","last_clean":"2024-09-17T01:46:32.428642+0000","last_became_active":"2024-09-17T01:46:31.439978+0000","last_became_peered":"2024-09-17T01:46:31.439978+0000","last_unstale":"2024-09-17T01:46:32.428642+0000","last_undegraded":"2024-09-17T01:46:32.428642+0000","last_fullsized":"2024-09-17T01:46:32.428642+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:30.533657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1c","version":"186'2","reported_seq":17,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776234+0000","last_change":"2024-09-17T01:46:30.419634+0000","last_active":"2024-09-17T01:46:32.776234+0000","last_peered":"2024-09-17T01:46:32.776234+0000","last_clean":"2024-09-17T01:46:32.776234+0000","last_became_active":"2024-09-17T01:46:30.419304+0000","last_became_peered":"2024-09-17T01:46:30.419304+0000","last_unstale":"2024-09-17T01:46:32.776234+0000","last_undegraded":"2024-09-17T01:46:32.776234+0000","last_fullsized":"2024-09-17T01:46:32.776234+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:05.285011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775650+0000","last_change":"2024-09-17T01:46:31.440666+0000","last_active":"2024-09-17T01:46:32.775650+0000","last_peered":"2024-09-17T01:46:32.775650+0000","last_clean":"2024-09-17T01:46:32.775650+0000","last_became_active":"2024-09-17T01:46:31.439118+0000","last_became_peered":"2024-09-17T01:46:31.439118+0000","last_unstale":"2024-09-17T01:46:32.775650+0000","last_undegraded":"2024-09-17T01:46:32.775650+0000","last_fullsized":"2024-09-17T01:46:32.775650+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:11.746299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777424+0000","last_change":"2024-09-17T01:46:30.424178+0000","last_active":"2024-09-17T01:46:32.777424+0000","last_peered":"2024-09-17T01:46:32.777424+0000","last_clean":"2024-09-17T01:46:32.777424+0000","last_became_active":"2024-09-17T01:46:30.423653+0000","last_became_peered":"2024-09-17T01:46:30.423653+0000","last_unstale":"2024-09-17T01:46:32.777424+0000","last_undegraded":"2024-09-17T01:46:32.777424+0000","last_fullsized":"2024-09-17T01:46:32.777424+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:01:57.156162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776415+0000","last_change":"2024-09-17T01:46:31.428613+0000","last_active":"2024-09-17T01:46:32.776415+0000","last_peered":"2024-09-17T01:46:32.776415+0000","last_clean":"2024-09-17T01:46:32.776415+0000","last_became_active":"2024-09-17T01:46:31.428070+0000","last_became_peered":"2024-09-17T01:46:31.428070+0000","last_unstale":"2024-09-17T01:46:32.776415+0000","last_undegraded":"2024-09-17T01:46:32.776415+0000","last_fullsized":"2024-09-17T01:46:32.776415+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:02.001662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426445+0000","last_change":"2024-09-17T01:46:30.419541+0000","last_active":"2024-09-17T01:46:32.426445+0000","last_peered":"2024-09-17T01:46:32.426445+0000","last_clean":"2024-09-17T01:46:32.426445+0000","last_became_active":"2024-09-17T01:46:30.417201+0000","last_became_peered":"2024-09-17T01:46:30.417201+0000","last_unstale":"2024-09-17T01:46:32.426445+0000","last_undegraded":"2024-09-17T01:46:32.426445+0000","last_fullsized":"2024-09-17T01:46:32.426445+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:53.835043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2024-09-17T01:46:30.406938+0000","last_change":"2024-09-17T01:46:30.406938+0000","last_active":"2024-09-17T01:46:30.391480+0000","last_peered":"2024-09-17T01:46:30.391480+0000","last_clean":"2024-09-17T01:46:30.391480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:46:30.406938+0000","last_undegraded":"2024-09-17T01:46:30.406938+0000","last_fullsized":"2024-09-17T01:46:30.406938+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775314+0000","last_change":"2024-09-17T01:46:30.425424+0000","last_active":"2024-09-17T01:46:32.775314+0000","last_peered":"2024-09-17T01:46:32.775314+0000","last_clean":"2024-09-17T01:46:32.775314+0000","last_became_active":"2024-09-17T01:46:30.424776+0000","last_became_peered":"2024-09-17T01:46:30.424776+0000","last_unstale":"2024-09-17T01:46:32.775314+0000","last_undegraded":"2024-09-17T01:46:32.775314+0000","last_fullsized":"2024-09-17T01:46:32.775314+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:00.655765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776220+0000","last_change":"2024-09-17T01:46:31.445355+0000","last_active":"2024-09-17T01:46:32.776220+0000","last_peered":"2024-09-17T01:46:32.776220+0000","last_clean":"2024-09-17T01:46:32.776220+0000","last_became_active":"2024-09-17T01:46:31.445006+0000","last_became_peered":"2024-09-17T01:46:31.445006+0000","last_unstale":"2024-09-17T01:46:32.776220+0000","last_undegraded":"2024-09-17T01:46:32.776220+0000","last_fullsized":"2024-09-17T01:46:32.776220+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:00:48.418812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428717+0000","last_change":"2024-09-17T01:46:30.425233+0000","last_active":"2024-09-17T01:46:32.428717+0000","last_peered":"2024-09-17T01:46:32.428717+0000","last_clean":"2024-09-17T01:46:32.428717+0000","last_became_active":"2024-09-17T01:46:30.424688+0000","last_became_peered":"2024-09-17T01:46:30.424688+0000","last_unstale":"2024-09-17T01:46:32.428717+0000","last_undegraded":"2024-09-17T01:46:32.428717+0000","last_fullsized":"2024-09-17T01:46:32.428717+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:22.747644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775921+0000","last_change":"2024-09-17T01:46:31.433934+0000","last_active":"2024-09-17T01:46:32.775921+0000","last_peered":"2024-09-17T01:46:32.775921+0000","last_clean":"2024-09-17T01:46:32.775921+0000","last_became_active":"2024-09-17T01:46:31.433582+0000","last_became_peered":"2024-09-17T01:46:31.433582+0000","last_unstale":"2024-09-17T01:46:32.775921+0000","last_undegraded":"2024-09-17T01:46:32.775921+0000","last_fullsized":"2024-09-17T01:46:32.775921+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:12:49.719869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776319+0000","last_change":"2024-09-17T01:46:30.424629+0000","last_active":"2024-09-17T01:46:32.776319+0000","last_peered":"2024-09-17T01:46:32.776319+0000","last_clean":"2024-09-17T01:46:32.776319+0000","last_became_active":"2024-09-17T01:46:30.424304+0000","last_became_peered":"2024-09-17T01:46:30.424304+0000","last_unstale":"2024-09-17T01:46:32.776319+0000","last_undegraded":"2024-09-17T01:46:32.776319+0000","last_fullsized":"2024-09-17T01:46:32.776319+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:56:10.352036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2024-09-17T01:46:30.406859+0000","last_change":"2024-09-17T01:46:30.406859+0000","last_active":"2024-09-17T01:46:30.391480+0000","last_peered":"2024-09-17T01:46:30.391480+0000","last_clean":"2024-09-17T01:46:30.391480+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:46:30.406859+0000","last_undegraded":"2024-09-17T01:46:30.406859+0000","last_fullsized":"2024-09-17T01:46:30.406859+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.15","version":"186'3","reported_seq":18,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427149+0000","last_change":"2024-09-17T01:46:30.422242+0000","last_active":"2024-09-17T01:46:32.427149+0000","last_peered":"2024-09-17T01:46:32.427149+0000","last_clean":"2024-09-17T01:46:32.427149+0000","last_became_active":"2024-09-17T01:46:30.421844+0000","last_became_peered":"2024-09-17T01:46:30.421844+0000","last_unstale":"2024-09-17T01:46:32.427149+0000","last_undegraded":"2024-09-17T01:46:32.427149+0000","last_fullsized":"2024-09-17T01:46:32.427149+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:12.309630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426956+0000","last_change":"2024-09-17T01:46:31.428578+0000","last_active":"2024-09-17T01:46:32.426956+0000","last_peered":"2024-09-17T01:46:32.426956+0000","last_clean":"2024-09-17T01:46:32.426956+0000","last_became_active":"2024-09-17T01:46:31.428252+0000","last_became_peered":"2024-09-17T01:46:31.428252+0000","last_unstale":"2024-09-17T01:46:32.426956+0000","last_undegraded":"2024-09-17T01:46:32.426956+0000","last_fullsized":"2024-09-17T01:46:32.426956+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:59:35.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T01:46:30.425094+0000","last_change":"2024-09-17T01:46:30.422374+0000","last_active":"2024-09-17T01:46:30.425094+0000","last_peered":"2024-09-17T01:46:30.425094+0000","last_clean":"2024-09-17T01:46:30.425094+0000","last_became_active":"2024-09-17T01:46:30.421910+0000","last_became_peered":"2024-09-17T01:46:30.421910+0000","last_unstale":"2024-09-17T01:46:30.425094+0000","last_undegraded":"2024-09-17T01:46:30.425094+0000","last_fullsized":"2024-09-17T01:46:30.425094+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:45.655278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776007+0000","last_change":"2024-09-17T01:46:31.443892+0000","last_active":"2024-09-17T01:46:32.776007+0000","last_peered":"2024-09-17T01:46:32.776007+0000","last_clean":"2024-09-17T01:46:32.776007+0000","last_became_active":"2024-09-17T01:46:31.441114+0000","last_became_peered":"2024-09-17T01:46:31.441114+0000","last_unstale":"2024-09-17T01:46:32.776007+0000","last_undegraded":"2024-09-17T01:46:32.776007+0000","last_fullsized":"2024-09-17T01:46:32.776007+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:43.533425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T01:46:30.425676+0000","last_change":"2024-09-17T01:46:30.423710+0000","last_active":"2024-09-17T01:46:30.425676+0000","last_peered":"2024-09-17T01:46:30.425676+0000","last_clean":"2024-09-17T01:46:30.425676+0000","last_became_active":"2024-09-17T01:46:30.423408+0000","last_became_peered":"2024-09-17T01:46:30.423408+0000","last_unstale":"2024-09-17T01:46:30.425676+0000","last_undegraded":"2024-09-17T01:46:30.425676+0000","last_fullsized":"2024-09-17T01:46:30.425676+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:45.318504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428962+0000","last_change":"2024-09-17T01:46:31.442692+0000","last_active":"2024-09-17T01:46:32.428962+0000","last_peered":"2024-09-17T01:46:32.428962+0000","last_clean":"2024-09-17T01:46:32.428962+0000","last_became_active":"2024-09-17T01:46:31.437975+0000","last_became_peered":"2024-09-17T01:46:31.437975+0000","last_unstale":"2024-09-17T01:46:32.428962+0000","last_undegraded":"2024-09-17T01:46:32.428962+0000","last_fullsized":"2024-09-17T01:46:32.428962+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:24.601060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425179+0000","last_change":"2024-09-17T01:46:30.417522+0000","last_active":"2024-09-17T01:46:32.425179+0000","last_peered":"2024-09-17T01:46:32.425179+0000","last_clean":"2024-09-17T01:46:32.425179+0000","last_became_active":"2024-09-17T01:46:30.417209+0000","last_became_peered":"2024-09-17T01:46:30.417209+0000","last_unstale":"2024-09-17T01:46:32.425179+0000","last_undegraded":"2024-09-17T01:46:32.425179+0000","last_fullsized":"2024-09-17T01:46:32.425179+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:15.260440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427083+0000","last_change":"2024-09-17T01:46:31.434934+0000","last_active":"2024-09-17T01:46:32.427083+0000","last_peered":"2024-09-17T01:46:32.427083+0000","last_clean":"2024-09-17T01:46:32.427083+0000","last_became_active":"2024-09-17T01:46:31.434566+0000","last_became_peered":"2024-09-17T01:46:31.434566+0000","last_unstale":"2024-09-17T01:46:32.427083+0000","last_undegraded":"2024-09-17T01:46:32.427083+0000","last_fullsized":"2024-09-17T01:46:32.427083+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:47.607553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426560+0000","last_change":"2024-09-17T01:46:30.404274+0000","last_active":"2024-09-17T01:46:32.426560+0000","last_peered":"2024-09-17T01:46:32.426560+0000","last_clean":"2024-09-17T01:46:32.426560+0000","last_became_active":"2024-09-17T01:46:30.403501+0000","last_became_peered":"2024-09-17T01:46:30.403501+0000","last_unstale":"2024-09-17T01:46:32.426560+0000","last_undegraded":"2024-09-17T01:46:32.426560+0000","last_fullsized":"2024-09-17T01:46:32.426560+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:51.012757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777176+0000","last_change":"2024-09-17T01:46:31.436778+0000","last_active":"2024-09-17T01:46:32.777176+0000","last_peered":"2024-09-17T01:46:32.777176+0000","last_clean":"2024-09-17T01:46:32.777176+0000","last_became_active":"2024-09-17T01:46:31.436441+0000","last_became_peered":"2024-09-17T01:46:31.436441+0000","last_unstale":"2024-09-17T01:46:32.777176+0000","last_undegraded":"2024-09-17T01:46:32.777176+0000","last_fullsized":"2024-09-17T01:46:32.777176+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:54.967884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.10","version":"186'8","reported_seq":23,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426761+0000","last_change":"2024-09-17T01:46:30.414504+0000","last_active":"2024-09-17T01:46:32.426761+0000","last_peered":"2024-09-17T01:46:32.426761+0000","last_clean":"2024-09-17T01:46:32.426761+0000","last_became_active":"2024-09-17T01:46:30.414064+0000","last_became_peered":"2024-09-17T01:46:30.414064+0000","last_unstale":"2024-09-17T01:46:32.426761+0000","last_undegraded":"2024-09-17T01:46:32.426761+0000","last_fullsized":"2024-09-17T01:46:32.426761+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:16.932888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776776+0000","last_change":"2024-09-17T01:46:31.420586+0000","last_active":"2024-09-17T01:46:32.776776+0000","last_peered":"2024-09-17T01:46:32.776776+0000","last_clean":"2024-09-17T01:46:32.776776+0000","last_became_active":"2024-09-17T01:46:31.420292+0000","last_became_peered":"2024-09-17T01:46:31.420292+0000","last_unstale":"2024-09-17T01:46:32.776776+0000","last_undegraded":"2024-09-17T01:46:32.776776+0000","last_fullsized":"2024-09-17T01:46:32.776776+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:19:40.212633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.f","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777536+0000","last_change":"2024-09-17T01:46:30.424539+0000","last_active":"2024-09-17T01:46:32.777536+0000","last_peered":"2024-09-17T01:46:32.777536+0000","last_clean":"2024-09-17T01:46:32.777536+0000","last_became_active":"2024-09-17T01:46:30.424219+0000","last_became_peered":"2024-09-17T01:46:30.424219+0000","last_unstale":"2024-09-17T01:46:32.777536+0000","last_undegraded":"2024-09-17T01:46:32.777536+0000","last_fullsized":"2024-09-17T01:46:32.777536+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:10.664092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776865+0000","last_change":"2024-09-17T01:46:31.440377+0000","last_active":"2024-09-17T01:46:32.776865+0000","last_peered":"2024-09-17T01:46:32.776865+0000","last_clean":"2024-09-17T01:46:32.776865+0000","last_became_active":"2024-09-17T01:46:31.439915+0000","last_became_peered":"2024-09-17T01:46:31.439915+0000","last_unstale":"2024-09-17T01:46:32.776865+0000","last_undegraded":"2024-09-17T01:46:32.776865+0000","last_fullsized":"2024-09-17T01:46:32.776865+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:33.599429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T01:46:30.422832+0000","last_change":"2024-09-17T01:46:30.419672+0000","last_active":"2024-09-17T01:46:30.422832+0000","last_peered":"2024-09-17T01:46:30.422832+0000","last_clean":"2024-09-17T01:46:30.422832+0000","last_became_active":"2024-09-17T01:46:30.417927+0000","last_became_peered":"2024-09-17T01:46:30.417927+0000","last_unstale":"2024-09-17T01:46:30.422832+0000","last_undegraded":"2024-09-17T01:46:30.422832+0000","last_fullsized":"2024-09-17T01:46:30.422832+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:38:28.341220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428806+0000","last_change":"2024-09-17T01:46:31.437719+0000","last_active":"2024-09-17T01:46:32.428806+0000","last_peered":"2024-09-17T01:46:32.428806+0000","last_clean":"2024-09-17T01:46:32.428806+0000","last_became_active":"2024-09-17T01:46:31.436896+0000","last_became_peered":"2024-09-17T01:46:31.436896+0000","last_unstale":"2024-09-17T01:46:32.428806+0000","last_undegraded":"2024-09-17T01:46:32.428806+0000","last_fullsized":"2024-09-17T01:46:32.428806+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:51.651477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.d","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776068+0000","last_change":"2024-09-17T01:46:30.417554+0000","last_active":"2024-09-17T01:46:32.776068+0000","last_peered":"2024-09-17T01:46:32.776068+0000","last_clean":"2024-09-17T01:46:32.776068+0000","last_became_active":"2024-09-17T01:46:30.416047+0000","last_became_peered":"2024-09-17T01:46:30.416047+0000","last_unstale":"2024-09-17T01:46:32.776068+0000","last_undegraded":"2024-09-17T01:46:32.776068+0000","last_fullsized":"2024-09-17T01:46:32.776068+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:48:22.422721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776996+0000","last_change":"2024-09-17T01:46:31.432802+0000","last_active":"2024-09-17T01:46:32.776996+0000","last_peered":"2024-09-17T01:46:32.776996+0000","last_clean":"2024-09-17T01:46:32.776996+0000","last_became_active":"2024-09-17T01:46:31.431642+0000","last_became_peered":"2024-09-17T01:46:31.431642+0000","last_unstale":"2024-09-17T01:46:32.776996+0000","last_undegraded":"2024-09-17T01:46:32.776996+0000","last_fullsized":"2024-09-17T01:46:32.776996+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:08.595846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776725+0000","last_change":"2024-09-17T01:46:30.422016+0000","last_active":"2024-09-17T01:46:32.776725+0000","last_peered":"2024-09-17T01:46:32.776725+0000","last_clean":"2024-09-17T01:46:32.776725+0000","last_became_active":"2024-09-17T01:46:30.421643+0000","last_became_peered":"2024-09-17T01:46:30.421643+0000","last_unstale":"2024-09-17T01:46:32.776725+0000","last_undegraded":"2024-09-17T01:46:32.776725+0000","last_fullsized":"2024-09-17T01:46:32.776725+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:22.199090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428012+0000","last_change":"2024-09-17T01:46:31.433043+0000","last_active":"2024-09-17T01:46:32.428012+0000","last_peered":"2024-09-17T01:46:32.428012+0000","last_clean":"2024-09-17T01:46:32.428012+0000","last_became_active":"2024-09-17T01:46:31.432720+0000","last_became_peered":"2024-09-17T01:46:31.432720+0000","last_unstale":"2024-09-17T01:46:32.428012+0000","last_undegraded":"2024-09-17T01:46:32.428012+0000","last_fullsized":"2024-09-17T01:46:32.428012+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:57:32.671300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.b","version":"186'2","reported_seq":17,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775602+0000","last_change":"2024-09-17T01:46:30.405350+0000","last_active":"2024-09-17T01:46:32.775602+0000","last_peered":"2024-09-17T01:46:32.775602+0000","last_clean":"2024-09-17T01:46:32.775602+0000","last_became_active":"2024-09-17T01:46:30.404996+0000","last_became_peered":"2024-09-17T01:46:30.404996+0000","last_unstale":"2024-09-17T01:46:32.775602+0000","last_undegraded":"2024-09-17T01:46:32.775602+0000","last_fullsized":"2024-09-17T01:46:32.775602+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:58.482506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777051+0000","last_change":"2024-09-17T01:46:31.442677+0000","last_active":"2024-09-17T01:46:32.777051+0000","last_peered":"2024-09-17T01:46:32.777051+0000","last_clean":"2024-09-17T01:46:32.777051+0000","last_became_active":"2024-09-17T01:46:31.442347+0000","last_became_peered":"2024-09-17T01:46:31.442347+0000","last_unstale":"2024-09-17T01:46:32.777051+0000","last_undegraded":"2024-09-17T01:46:32.777051+0000","last_fullsized":"2024-09-17T01:46:32.777051+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:19.562731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426379+0000","last_change":"2024-09-17T01:46:30.412325+0000","last_active":"2024-09-17T01:46:32.426379+0000","last_peered":"2024-09-17T01:46:32.426379+0000","last_clean":"2024-09-17T01:46:32.426379+0000","last_became_active":"2024-09-17T01:46:30.412047+0000","last_became_peered":"2024-09-17T01:46:30.412047+0000","last_unstale":"2024-09-17T01:46:32.426379+0000","last_undegraded":"2024-09-17T01:46:32.426379+0000","last_fullsized":"2024-09-17T01:46:32.426379+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:54.073456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775239+0000","last_change":"2024-09-17T01:46:31.432167+0000","last_active":"2024-09-17T01:46:32.775239+0000","last_peered":"2024-09-17T01:46:32.775239+0000","last_clean":"2024-09-17T01:46:32.775239+0000","last_became_active":"2024-09-17T01:46:31.431789+0000","last_became_peered":"2024-09-17T01:46:31.431789+0000","last_unstale":"2024-09-17T01:46:32.775239+0000","last_undegraded":"2024-09-17T01:46:32.775239+0000","last_fullsized":"2024-09-17T01:46:32.775239+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:21.650118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426921+0000","last_change":"2024-09-17T01:46:30.427238+0000","last_active":"2024-09-17T01:46:32.426921+0000","last_peered":"2024-09-17T01:46:32.426921+0000","last_clean":"2024-09-17T01:46:32.426921+0000","last_became_active":"2024-09-17T01:46:30.426611+0000","last_became_peered":"2024-09-17T01:46:30.426611+0000","last_unstale":"2024-09-17T01:46:32.426921+0000","last_undegraded":"2024-09-17T01:46:32.426921+0000","last_fullsized":"2024-09-17T01:46:32.426921+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:15.611305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775673+0000","last_change":"2024-09-17T01:46:31.419791+0000","last_active":"2024-09-17T01:46:32.775673+0000","last_peered":"2024-09-17T01:46:32.775673+0000","last_clean":"2024-09-17T01:46:32.775673+0000","last_became_active":"2024-09-17T01:46:31.419473+0000","last_became_peered":"2024-09-17T01:46:31.419473+0000","last_unstale":"2024-09-17T01:46:32.775673+0000","last_undegraded":"2024-09-17T01:46:32.775673+0000","last_fullsized":"2024-09-17T01:46:32.775673+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:32.481643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426899+0000","last_change":"2024-09-17T01:46:30.420644+0000","last_active":"2024-09-17T01:46:32.426899+0000","last_peered":"2024-09-17T01:46:32.426899+0000","last_clean":"2024-09-17T01:46:32.426899+0000","last_became_active":"2024-09-17T01:46:30.420307+0000","last_became_peered":"2024-09-17T01:46:30.420307+0000","last_unstale":"2024-09-17T01:46:32.426899+0000","last_undegraded":"2024-09-17T01:46:32.426899+0000","last_fullsized":"2024-09-17T01:46:32.426899+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:00.872803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777003+0000","last_change":"2024-09-17T01:46:31.444744+0000","last_active":"2024-09-17T01:46:32.777003+0000","last_peered":"2024-09-17T01:46:32.777003+0000","last_clean":"2024-09-17T01:46:32.777003+0000","last_became_active":"2024-09-17T01:46:31.444375+0000","last_became_peered":"2024-09-17T01:46:31.444375+0000","last_unstale":"2024-09-17T01:46:32.777003+0000","last_undegraded":"2024-09-17T01:46:32.777003+0000","last_fullsized":"2024-09-17T01:46:32.777003+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:43.584917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.7","version":"186'2","reported_seq":17,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427390+0000","last_change":"2024-09-17T01:46:30.425299+0000","last_active":"2024-09-17T01:46:32.427390+0000","last_peered":"2024-09-17T01:46:32.427390+0000","last_clean":"2024-09-17T01:46:32.427390+0000","last_became_active":"2024-09-17T01:46:30.424946+0000","last_became_peered":"2024-09-17T01:46:30.424946+0000","last_unstale":"2024-09-17T01:46:32.427390+0000","last_undegraded":"2024-09-17T01:46:32.427390+0000","last_fullsized":"2024-09-17T01:46:32.427390+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:28.876800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777440+0000","last_change":"2024-09-17T01:46:31.442936+0000","last_active":"2024-09-17T01:46:32.777440+0000","last_peered":"2024-09-17T01:46:32.777440+0000","last_clean":"2024-09-17T01:46:32.777440+0000","last_became_active":"2024-09-17T01:46:31.441624+0000","last_became_peered":"2024-09-17T01:46:31.441624+0000","last_unstale":"2024-09-17T01:46:32.777440+0000","last_undegraded":"2024-09-17T01:46:32.777440+0000","last_fullsized":"2024-09-17T01:46:32.777440+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:32.363557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.6","version":"187'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425796+0000","last_change":"2024-09-17T01:46:30.412132+0000","last_active":"2024-09-17T01:46:32.425796+0000","last_peered":"2024-09-17T01:46:32.425796+0000","last_clean":"2024-09-17T01:46:32.425796+0000","last_became_active":"2024-09-17T01:46:30.411804+0000","last_became_peered":"2024-09-17T01:46:30.411804+0000","last_unstale":"2024-09-17T01:46:32.425796+0000","last_undegraded":"2024-09-17T01:46:32.425796+0000","last_fullsized":"2024-09-17T01:46:32.425796+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:25.842168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425575+0000","last_change":"2024-09-17T01:46:31.429507+0000","last_active":"2024-09-17T01:46:32.425575+0000","last_peered":"2024-09-17T01:46:32.425575+0000","last_clean":"2024-09-17T01:46:32.425575+0000","last_became_active":"2024-09-17T01:46:31.425532+0000","last_became_peered":"2024-09-17T01:46:31.425532+0000","last_unstale":"2024-09-17T01:46:32.425575+0000","last_undegraded":"2024-09-17T01:46:32.425575+0000","last_fullsized":"2024-09-17T01:46:32.425575+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:18.372344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777250+0000","last_change":"2024-09-17T01:46:30.418076+0000","last_active":"2024-09-17T01:46:32.777250+0000","last_peered":"2024-09-17T01:46:32.777250+0000","last_clean":"2024-09-17T01:46:32.777250+0000","last_became_active":"2024-09-17T01:46:30.417242+0000","last_became_peered":"2024-09-17T01:46:30.417242+0000","last_unstale":"2024-09-17T01:46:32.777250+0000","last_undegraded":"2024-09-17T01:46:32.777250+0000","last_fullsized":"2024-09-17T01:46:32.777250+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:33.506264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776177+0000","last_change":"2024-09-17T01:46:31.445495+0000","last_active":"2024-09-17T01:46:32.776177+0000","last_peered":"2024-09-17T01:46:32.776177+0000","last_clean":"2024-09-17T01:46:32.776177+0000","last_became_active":"2024-09-17T01:46:31.444572+0000","last_became_peered":"2024-09-17T01:46:31.444572+0000","last_unstale":"2024-09-17T01:46:32.776177+0000","last_undegraded":"2024-09-17T01:46:32.776177+0000","last_fullsized":"2024-09-17T01:46:32.776177+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:16.618396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776893+0000","last_change":"2024-09-17T01:46:30.422029+0000","last_active":"2024-09-17T01:46:32.776893+0000","last_peered":"2024-09-17T01:46:32.776893+0000","last_clean":"2024-09-17T01:46:32.776893+0000","last_became_active":"2024-09-17T01:46:30.421681+0000","last_became_peered":"2024-09-17T01:46:30.421681+0000","last_unstale":"2024-09-17T01:46:32.776893+0000","last_undegraded":"2024-09-17T01:46:32.776893+0000","last_fullsized":"2024-09-17T01:46:32.776893+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:09.520044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777330+0000","last_change":"2024-09-17T01:46:31.439442+0000","last_active":"2024-09-17T01:46:32.777330+0000","last_peered":"2024-09-17T01:46:32.777330+0000","last_clean":"2024-09-17T01:46:32.777330+0000","last_became_active":"2024-09-17T01:46:31.438915+0000","last_became_peered":"2024-09-17T01:46:31.438915+0000","last_unstale":"2024-09-17T01:46:32.777330+0000","last_undegraded":"2024-09-17T01:46:32.777330+0000","last_fullsized":"2024-09-17T01:46:32.777330+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:27.999899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775727+0000","last_change":"2024-09-17T01:46:30.419847+0000","last_active":"2024-09-17T01:46:32.775727+0000","last_peered":"2024-09-17T01:46:32.775727+0000","last_clean":"2024-09-17T01:46:32.775727+0000","last_became_active":"2024-09-17T01:46:30.419467+0000","last_became_peered":"2024-09-17T01:46:30.419467+0000","last_unstale":"2024-09-17T01:46:32.775727+0000","last_undegraded":"2024-09-17T01:46:32.775727+0000","last_fullsized":"2024-09-17T01:46:32.775727+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:38.792786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425447+0000","last_change":"2024-09-17T01:46:31.437996+0000","last_active":"2024-09-17T01:46:32.425447+0000","last_peered":"2024-09-17T01:46:32.425447+0000","last_clean":"2024-09-17T01:46:32.425447+0000","last_became_active":"2024-09-17T01:46:31.437135+0000","last_became_peered":"2024-09-17T01:46:31.437135+0000","last_unstale":"2024-09-17T01:46:32.425447+0000","last_undegraded":"2024-09-17T01:46:32.425447+0000","last_fullsized":"2024-09-17T01:46:32.425447+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:46.620491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428203+0000","last_change":"2024-09-17T01:46:30.426320+0000","last_active":"2024-09-17T01:46:32.428203+0000","last_peered":"2024-09-17T01:46:32.428203+0000","last_clean":"2024-09-17T01:46:32.428203+0000","last_became_active":"2024-09-17T01:46:30.425888+0000","last_became_peered":"2024-09-17T01:46:30.425888+0000","last_unstale":"2024-09-17T01:46:32.428203+0000","last_undegraded":"2024-09-17T01:46:32.428203+0000","last_fullsized":"2024-09-17T01:46:32.428203+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:42.270562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426663+0000","last_change":"2024-09-17T01:46:31.425903+0000","last_active":"2024-09-17T01:46:32.426663+0000","last_peered":"2024-09-17T01:46:32.426663+0000","last_clean":"2024-09-17T01:46:32.426663+0000","last_became_active":"2024-09-17T01:46:31.425503+0000","last_became_peered":"2024-09-17T01:46:31.425503+0000","last_unstale":"2024-09-17T01:46:32.426663+0000","last_undegraded":"2024-09-17T01:46:32.426663+0000","last_fullsized":"2024-09-17T01:46:32.426663+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:56.275736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775493+0000","last_change":"2024-09-17T01:46:30.422496+0000","last_active":"2024-09-17T01:46:32.775493+0000","last_peered":"2024-09-17T01:46:32.775493+0000","last_clean":"2024-09-17T01:46:32.775493+0000","last_became_active":"2024-09-17T01:46:30.422122+0000","last_became_peered":"2024-09-17T01:46:30.422122+0000","last_unstale":"2024-09-17T01:46:32.775493+0000","last_undegraded":"2024-09-17T01:46:32.775493+0000","last_fullsized":"2024-09-17T01:46:32.775493+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:23.170746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775911+0000","last_change":"2024-09-17T01:46:31.420520+0000","last_active":"2024-09-17T01:46:32.775911+0000","last_peered":"2024-09-17T01:46:32.775911+0000","last_clean":"2024-09-17T01:46:32.775911+0000","last_became_active":"2024-09-17T01:46:31.420133+0000","last_became_peered":"2024-09-17T01:46:31.420133+0000","last_unstale":"2024-09-17T01:46:32.775911+0000","last_undegraded":"2024-09-17T01:46:32.775911+0000","last_fullsized":"2024-09-17T01:46:32.775911+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:04.257713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775432+0000","last_change":"2024-09-17T01:46:30.426020+0000","last_active":"2024-09-17T01:46:32.775432+0000","last_peered":"2024-09-17T01:46:32.775432+0000","last_clean":"2024-09-17T01:46:32.775432+0000","last_became_active":"2024-09-17T01:46:30.425079+0000","last_became_peered":"2024-09-17T01:46:30.425079+0000","last_unstale":"2024-09-17T01:46:32.775432+0000","last_undegraded":"2024-09-17T01:46:32.775432+0000","last_fullsized":"2024-09-17T01:46:32.775432+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:42.283883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428011+0000","last_change":"2024-09-17T01:46:31.444278+0000","last_active":"2024-09-17T01:46:32.428011+0000","last_peered":"2024-09-17T01:46:32.428011+0000","last_clean":"2024-09-17T01:46:32.428011+0000","last_became_active":"2024-09-17T01:46:31.443518+0000","last_became_peered":"2024-09-17T01:46:31.443518+0000","last_unstale":"2024-09-17T01:46:32.428011+0000","last_undegraded":"2024-09-17T01:46:32.428011+0000","last_fullsized":"2024-09-17T01:46:32.428011+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:28.913481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1b","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425512+0000","last_change":"2024-09-17T01:46:30.412509+0000","last_active":"2024-09-17T01:46:32.425512+0000","last_peered":"2024-09-17T01:46:32.425512+0000","last_clean":"2024-09-17T01:46:32.425512+0000","last_became_active":"2024-09-17T01:46:30.412226+0000","last_became_peered":"2024-09-17T01:46:30.412226+0000","last_unstale":"2024-09-17T01:46:32.425512+0000","last_undegraded":"2024-09-17T01:46:32.425512+0000","last_fullsized":"2024-09-17T01:46:32.425512+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:49.989646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":427,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775556+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:46:32.775556+0000","last_peered":"2024-09-17T01:46:32.775556+0000","last_clean":"2024-09-17T01:46:32.775556+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:46:32.775556+0000","last_undegraded":"2024-09-17T01:46:32.775556+0000","last_fullsized":"2024-09-17T01:46:32.775556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":764,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476915,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47340,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324500,"statfs":{"total":96636764160,"available":96588288000,"internally_reserved":0,"allocated":2310144,"data_stored":1018362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509619,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55700,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316140,"statfs":{"total":96636764160,"available":96579727360,"internally_reserved":0,"allocated":2351104,"data_stored":1037734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509618,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47372,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324468,"statfs":{"total":96636764160,"available":96588255232,"internally_reserved":0,"allocated":2351104,"data_stored":1037782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509619,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51540,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320300,"statfs":{"total":96636764160,"available":96583987200,"internally_reserved":0,"allocated":2351104,"data_stored":1037802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509619,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69532,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302308,"statfs":{"total":96636764160,"available":96565563392,"internally_reserved":0,"allocated":2359296,"data_stored":1039324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509618,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52116,"kb_used_data":2872,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319724,"statfs":{"total":96636764160,"available":96583397376,"internally_reserved":0,"allocated":2940928,"data_stored":1628080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509620,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59860,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311980,"statfs":{"total":96636764160,"available":96575467520,"internally_reserved":0,"allocated":2351104,"data_stored":1038294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":58915273},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542324,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52124,"kb_used_data":2888,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319716,"statfs":{"total":96636764160,"available":96583389184,"internally_reserved":0,"allocated":2957312,"data_stored":1628808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:46:36.920 INFO:tasks.ceph.ceph_manager.ceph:PG 27.37 is not active+clean 2024-09-17T01:46:36.920 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 185, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:46:30.407450+0000', 'last_change': '2024-09-17T01:46:30.407450+0000', 'last_active': '2024-09-17T01:46:30.391480+0000', 'last_peered': '2024-09-17T01:46:30.391480+0000', 'last_clean': '2024-09-17T01:46:30.391480+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:46:30.407450+0000', 'last_undegraded': '2024-09-17T01:46:30.407450+0000', 'last_fullsized': '2024-09-17T01:46:30.407450+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:46:30.391480+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:46:30.391480+0000', 'last_clean_scrub_stamp': '2024-09-17T01:46:30.391480+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T01:46:36.921 INFO:tasks.ceph.ceph_manager.ceph:PG 27.28 is not active+clean 2024-09-17T01:46:36.921 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 185, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:46:30.407363+0000', 'last_change': '2024-09-17T01:46:30.407363+0000', 'last_active': '2024-09-17T01:46:30.391480+0000', 'last_peered': '2024-09-17T01:46:30.391480+0000', 'last_clean': '2024-09-17T01:46:30.391480+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:46:30.407363+0000', 'last_undegraded': '2024-09-17T01:46:30.407363+0000', 'last_fullsized': '2024-09-17T01:46:30.407363+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:46:30.391480+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:46:30.391480+0000', 'last_clean_scrub_stamp': '2024-09-17T01:46:30.391480+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T01:46:36.921 INFO:tasks.ceph.ceph_manager.ceph:PG 27.19 is not active+clean 2024-09-17T01:46:36.921 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 185, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:46:30.406938+0000', 'last_change': '2024-09-17T01:46:30.406938+0000', 'last_active': '2024-09-17T01:46:30.391480+0000', 'last_peered': '2024-09-17T01:46:30.391480+0000', 'last_clean': '2024-09-17T01:46:30.391480+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:46:30.406938+0000', 'last_undegraded': '2024-09-17T01:46:30.406938+0000', 'last_fullsized': '2024-09-17T01:46:30.406938+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:46:30.391480+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:46:30.391480+0000', 'last_clean_scrub_stamp': '2024-09-17T01:46:30.391480+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T01:46:36.921 INFO:tasks.ceph.ceph_manager.ceph:PG 27.14 is not active+clean 2024-09-17T01:46:36.921 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 185, 'state': 'creating+peering', 'last_fresh': '2024-09-17T01:46:30.406859+0000', 'last_change': '2024-09-17T01:46:30.406859+0000', 'last_active': '2024-09-17T01:46:30.391480+0000', 'last_peered': '2024-09-17T01:46:30.391480+0000', 'last_clean': '2024-09-17T01:46:30.391480+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T01:46:30.406859+0000', 'last_undegraded': '2024-09-17T01:46:30.406859+0000', 'last_fullsized': '2024-09-17T01:46:30.406859+0000', 'mapping_epoch': 185, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 185, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T01:46:30.391480+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T01:46:30.391480+0000', 'last_clean_scrub_stamp': '2024-09-17T01:46:30.391480+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T01:46:36.922 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:46:37.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.185+0000 7fb869000640 1 -- 172.21.15.42:0/3082148169 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb86406f2a0 msgr2=0x7fb86406d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:37.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.185+0000 7fb869000640 1 --2- 172.21.15.42:0/3082148169 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb86406f2a0 0x7fb86406d610 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7fb84c005fd0 tx=0x7fb84c02a540 comp rx=0 tx=0).stop 2024-09-17T01:46:37.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.185+0000 7fb869000640 1 -- 172.21.15.42:0/3082148169 shutdown_connections 2024-09-17T01:46:37.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.185+0000 7fb869000640 1 --2- 172.21.15.42:0/3082148169 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb86406f2a0 0x7fb86406d610 unknown :-1 s=CLOSED pgs=2146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:37.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.185+0000 7fb869000640 1 --2- 172.21.15.42:0/3082148169 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb86406ee90 0x7fb86415f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:37.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.185+0000 7fb869000640 1 -- 172.21.15.42:0/3082148169 >> 172.21.15.42:0/3082148169 conn(0x7fb8640b2930 msgr2=0x7fb86406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:37.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.186+0000 7fb869000640 1 -- 172.21.15.42:0/3082148169 shutdown_connections 2024-09-17T01:46:37.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.186+0000 7fb869000640 1 -- 172.21.15.42:0/3082148169 wait complete. 2024-09-17T01:46:37.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.188+0000 7fb869000640 1 Processor -- start 2024-09-17T01:46:37.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.188+0000 7fb869000640 1 -- start start 2024-09-17T01:46:37.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.189+0000 7fb869000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb86406db50 0x7fb8641e96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:37.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.189+0000 7fb869000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb86406ee90 0x7fb8641e8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:37.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.189+0000 7fb869000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb86406f2a0 0x7fb8641429d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:37.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.189+0000 7fb869000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb8640cef40 con 0x7fb86406db50 2024-09-17T01:46:37.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.189+0000 7fb869000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb864074750 con 0x7fb86406f2a0 2024-09-17T01:46:37.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.189+0000 7fb869000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb8640cf0c0 con 0x7fb86406ee90 2024-09-17T01:46:37.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.190+0000 7fb861e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb86406db50 0x7fb8641e96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:37.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.190+0000 7fb861e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb86406db50 0x7fb8641e96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46106/0 (socket says 172.21.15.42:46106) 2024-09-17T01:46:37.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.190+0000 7fb861e00640 1 -- 172.21.15.42:0/2052987697 learned_addr learned my addr 172.21.15.42:0/2052987697 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:37.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.190+0000 7fb85be00640 1 --2- 172.21.15.42:0/2052987697 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb86406ee90 0x7fb8641e8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:37.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.190+0000 7fb862800640 1 --2- 172.21.15.42:0/2052987697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb86406f2a0 0x7fb8641429d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:37.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.190+0000 7fb861e00640 1 -- 172.21.15.42:0/2052987697 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb86406ee90 msgr2=0x7fb8641e8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:37.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.190+0000 7fb861e00640 1 --2- 172.21.15.42:0/2052987697 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb86406ee90 0x7fb8641e8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:37.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.190+0000 7fb861e00640 1 -- 172.21.15.42:0/2052987697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb86406f2a0 msgr2=0x7fb8641429d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:37.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.190+0000 7fb861e00640 1 --2- 172.21.15.42:0/2052987697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb86406f2a0 0x7fb8641429d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:37.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.190+0000 7fb861e00640 1 -- 172.21.15.42:0/2052987697 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8641432b0 con 0x7fb86406db50 2024-09-17T01:46:37.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.190+0000 7fb85be00640 1 --2- 172.21.15.42:0/2052987697 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb86406ee90 0x7fb8641e8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:37.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.190+0000 7fb862800640 1 --2- 172.21.15.42:0/2052987697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb86406f2a0 0x7fb8641429d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:37.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.190+0000 7fb861e00640 1 --2- 172.21.15.42:0/2052987697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb86406db50 0x7fb8641e96b0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7fb85400d750 tx=0x7fb85400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:37.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.191+0000 7fb85a000640 1 -- 172.21.15.42:0/2052987697 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb854017070 con 0x7fb86406db50 2024-09-17T01:46:37.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.191+0000 7fb85a000640 1 -- 172.21.15.42:0/2052987697 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb854004310 con 0x7fb86406db50 2024-09-17T01:46:37.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.191+0000 7fb85a000640 1 -- 172.21.15.42:0/2052987697 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85400de60 con 0x7fb86406db50 2024-09-17T01:46:37.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.191+0000 7fb869000640 1 -- 172.21.15.42:0/2052987697 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8641e9440 con 0x7fb86406db50 2024-09-17T01:46:37.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.191+0000 7fb869000640 1 -- 172.21.15.42:0/2052987697 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb864143a00 con 0x7fb86406db50 2024-09-17T01:46:37.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.192+0000 7fb869000640 1 -- 172.21.15.42:0/2052987697 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb864076790 con 0x7fb86406db50 2024-09-17T01:46:37.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.193+0000 7fb85a000640 1 -- 172.21.15.42:0/2052987697 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb854009c30 con 0x7fb86406db50 2024-09-17T01:46:37.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.195+0000 7fb85a000640 1 --2- 172.21.15.42:0/2052987697 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb840078b90 0x7fb84007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:37.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.195+0000 7fb85a000640 1 -- 172.21.15.42:0/2052987697 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7fb85409b250 con 0x7fb86406db50 2024-09-17T01:46:37.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.195+0000 7fb85be00640 1 --2- 172.21.15.42:0/2052987697 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb840078b90 0x7fb84007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:37.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.196+0000 7fb85be00640 1 --2- 172.21.15.42:0/2052987697 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb840078b90 0x7fb84007b0a0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fb84c033000 tx=0x7fb84c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:37.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.200+0000 7fb85a000640 1 -- 172.21.15.42:0/2052987697 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb864076790 con 0x7fb86406db50 2024-09-17T01:46:37.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.473+0000 7fb869000640 1 -- 172.21.15.42:0/2052987697 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb86415f200 con 0x7fb86406db50 2024-09-17T01:46:37.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.474+0000 7fb85a000640 1 -- 172.21.15.42:0/2052987697 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1480 (secure 0 0 0) 0x7fb854020020 con 0x7fb86406db50 2024-09-17T01:46:37.472 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:46:37.472 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":898,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":187,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":446095360,"bytes_avail":772648017920,"bytes_total":773094113280,"write_bytes_sec":2098,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":150,"btime":"2024-09-17T01:46:34:429037+0000","id":13,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":13,"rank":0,"name":"b","status":"up:active","gid":10371}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":33,"modified":"2024-09-17T01:46:27.226864+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:46:37.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.476+0000 7fb869000640 1 -- 172.21.15.42:0/2052987697 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb840078b90 msgr2=0x7fb84007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:37.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.476+0000 7fb869000640 1 --2- 172.21.15.42:0/2052987697 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb840078b90 0x7fb84007b0a0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fb84c033000 tx=0x7fb84c004730 comp rx=0 tx=0).stop 2024-09-17T01:46:37.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.476+0000 7fb869000640 1 -- 172.21.15.42:0/2052987697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb86406db50 msgr2=0x7fb8641e96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:37.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.476+0000 7fb869000640 1 --2- 172.21.15.42:0/2052987697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb86406db50 0x7fb8641e96b0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7fb85400d750 tx=0x7fb85400dc10 comp rx=0 tx=0).stop 2024-09-17T01:46:37.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.476+0000 7fb869000640 1 -- 172.21.15.42:0/2052987697 shutdown_connections 2024-09-17T01:46:37.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.476+0000 7fb869000640 1 --2- 172.21.15.42:0/2052987697 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb840078b90 0x7fb84007b0a0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:37.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.476+0000 7fb869000640 1 --2- 172.21.15.42:0/2052987697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb86406f2a0 0x7fb8641429d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:37.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.476+0000 7fb869000640 1 --2- 172.21.15.42:0/2052987697 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb86406ee90 0x7fb8641e8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:37.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.476+0000 7fb869000640 1 --2- 172.21.15.42:0/2052987697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb86406db50 0x7fb8641e96b0 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:37.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.476+0000 7fb869000640 1 -- 172.21.15.42:0/2052987697 >> 172.21.15.42:0/2052987697 conn(0x7fb8640b2930 msgr2=0x7fb86406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:37.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.477+0000 7fb869000640 1 -- 172.21.15.42:0/2052987697 shutdown_connections 2024-09-17T01:46:37.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.477+0000 7fb869000640 1 -- 172.21.15.42:0/2052987697 wait complete. 2024-09-17T01:46:37.501 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T01:46:37.501 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:46:37.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.731+0000 7f6adc800640 1 -- 172.21.15.42:0/169755686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ad4072e90 msgr2=0x7f6ad40cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:37.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.731+0000 7f6adc800640 1 --2- 172.21.15.42:0/169755686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ad4072e90 0x7f6ad40cec40 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40704d0 tx=0x7f6ad002a820 comp rx=0 tx=0).stop 2024-09-17T01:46:37.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.731+0000 7f6adc800640 1 -- 172.21.15.42:0/169755686 shutdown_connections 2024-09-17T01:46:37.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.731+0000 7f6adc800640 1 --2- 172.21.15.42:0/169755686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ad4072e90 0x7f6ad40cec40 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:37.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.731+0000 7f6adc800640 1 --2- 172.21.15.42:0/169755686 >> v2:172.21.15.43:3300/0 conn(0x7f6ad4142f40 0x7f6ad4072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:37.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.731+0000 7f6adc800640 1 -- 172.21.15.42:0/169755686 >> 172.21.15.42:0/169755686 conn(0x7f6ad40b2930 msgr2=0x7f6ad406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:37.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.732+0000 7f6adc800640 1 -- 172.21.15.42:0/169755686 shutdown_connections 2024-09-17T01:46:37.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.732+0000 7f6adc800640 1 -- 172.21.15.42:0/169755686 wait complete. 2024-09-17T01:46:37.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.734+0000 7f6adc800640 1 Processor -- start 2024-09-17T01:46:37.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.734+0000 7f6adc800640 1 -- start start 2024-09-17T01:46:37.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.735+0000 7f6adc800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad4072e90 0x7f6ad413ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:37.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.735+0000 7f6adc800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ad40b3550 0x7f6ad40ae300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:37.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.735+0000 7f6adc800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ad4142f40 0x7f6ad40ae840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:37.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.735+0000 7f6adc800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad406d5b0 con 0x7f6ad4142f40 2024-09-17T01:46:37.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.735+0000 7f6adc800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad406d430 con 0x7f6ad4072e90 2024-09-17T01:46:37.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.735+0000 7f6adc800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad406d730 con 0x7f6ad40b3550 2024-09-17T01:46:37.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.736+0000 7f6ada800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ad4142f40 0x7f6ad40ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:37.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.736+0000 7f6ada800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ad4142f40 0x7f6ad40ae840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46120/0 (socket says 172.21.15.42:46120) 2024-09-17T01:46:37.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.736+0000 7f6ada800640 1 -- 172.21.15.42:0/2177593504 learned_addr learned my addr 172.21.15.42:0/2177593504 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:37.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.736+0000 7f6ad9400640 1 --2- 172.21.15.42:0/2177593504 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ad40b3550 0x7f6ad40ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:37.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.736+0000 7f6ad9e00640 1 --2- 172.21.15.42:0/2177593504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad4072e90 0x7f6ad413ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:37.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.736+0000 7f6ada800640 1 -- 172.21.15.42:0/2177593504 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ad40b3550 msgr2=0x7f6ad40ae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:37.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.736+0000 7f6ada800640 1 --2- 172.21.15.42:0/2177593504 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ad40b3550 0x7f6ad40ae300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:37.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.736+0000 7f6ada800640 1 -- 172.21.15.42:0/2177593504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad4072e90 msgr2=0x7f6ad413ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:37.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.736+0000 7f6ada800640 1 --2- 172.21.15.42:0/2177593504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad4072e90 0x7f6ad413ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:37.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.736+0000 7f6ada800640 1 -- 172.21.15.42:0/2177593504 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad40ac6d0 con 0x7f6ad4142f40 2024-09-17T01:46:37.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.736+0000 7f6ad9e00640 1 --2- 172.21.15.42:0/2177593504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad4072e90 0x7f6ad413ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:37.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.736+0000 7f6ada800640 1 --2- 172.21.15.42:0/2177593504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ad4142f40 0x7f6ad40ae840 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009ca0 tx=0x7f6ad0032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:37.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.737+0000 7f6ace000640 1 -- 172.21.15.42:0/2177593504 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0037040 con 0x7f6ad4142f40 2024-09-17T01:46:37.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.737+0000 7f6ace000640 1 -- 172.21.15.42:0/2177593504 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ad0042070 con 0x7f6ad4142f40 2024-09-17T01:46:37.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.737+0000 7f6ace000640 1 -- 172.21.15.42:0/2177593504 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0003e60 con 0x7f6ad4142f40 2024-09-17T01:46:37.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.737+0000 7f6adc800640 1 -- 172.21.15.42:0/2177593504 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad40acc90 con 0x7f6ad4142f40 2024-09-17T01:46:37.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.737+0000 7f6adc800640 1 -- 172.21.15.42:0/2177593504 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad40ac9b0 con 0x7f6ad4142f40 2024-09-17T01:46:37.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.738+0000 7f6adc800640 1 -- 172.21.15.42:0/2177593504 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad40b43a0 con 0x7f6ad4142f40 2024-09-17T01:46:37.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.739+0000 7f6ace000640 1 -- 172.21.15.42:0/2177593504 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ad00042a0 con 0x7f6ad4142f40 2024-09-17T01:46:37.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.740+0000 7f6ace000640 1 --2- 172.21.15.42:0/2177593504 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6ab8078b90 0x7f6ab807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:37.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.740+0000 7f6ace000640 1 -- 172.21.15.42:0/2177593504 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f6ad00bba00 con 0x7f6ad4142f40 2024-09-17T01:46:37.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.741+0000 7f6ad9e00640 1 --2- 172.21.15.42:0/2177593504 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6ab8078b90 0x7f6ab807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:37.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.741+0000 7f6ad9e00640 1 --2- 172.21.15.42:0/2177593504 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6ab8078b90 0x7f6ab807b0a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8007a50 tx=0x7f6ac8009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:37.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.745+0000 7f6ace000640 1 -- 172.21.15.42:0/2177593504 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6ad40b43a0 con 0x7f6ad4142f40 2024-09-17T01:46:37.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.938+0000 7f6adc800640 1 -- 172.21.15.42:0/2177593504 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ad406a3f0 con 0x7f6ab8078b90 2024-09-17T01:46:37.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.943+0000 7f6ace000640 1 -- 172.21.15.42:0/2177593504 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252481 (secure 0 0 0) 0x7f6ad406a3f0 con 0x7f6ab8078b90 2024-09-17T01:46:37.943 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:46:37.945 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:46:37.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.947+0000 7f6adc800640 1 -- 172.21.15.42:0/2177593504 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6ab8078b90 msgr2=0x7f6ab807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:37.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.947+0000 7f6adc800640 1 --2- 172.21.15.42:0/2177593504 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6ab8078b90 0x7f6ab807b0a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8007a50 tx=0x7f6ac8009040 comp rx=0 tx=0).stop 2024-09-17T01:46:37.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.947+0000 7f6adc800640 1 -- 172.21.15.42:0/2177593504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ad4142f40 msgr2=0x7f6ad40ae840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:37.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.947+0000 7f6adc800640 1 --2- 172.21.15.42:0/2177593504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ad4142f40 0x7f6ad40ae840 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009ca0 tx=0x7f6ad0032c60 comp rx=0 tx=0).stop 2024-09-17T01:46:37.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.947+0000 7f6adc800640 1 -- 172.21.15.42:0/2177593504 shutdown_connections 2024-09-17T01:46:37.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.947+0000 7f6adc800640 1 --2- 172.21.15.42:0/2177593504 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6ab8078b90 0x7f6ab807b0a0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:37.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.947+0000 7f6adc800640 1 --2- 172.21.15.42:0/2177593504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ad4142f40 0x7f6ad40ae840 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:37.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.947+0000 7f6adc800640 1 --2- 172.21.15.42:0/2177593504 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6ad40b3550 0x7f6ad40ae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:37.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.947+0000 7f6adc800640 1 --2- 172.21.15.42:0/2177593504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad4072e90 0x7f6ad413ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:37.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.947+0000 7f6adc800640 1 -- 172.21.15.42:0/2177593504 >> 172.21.15.42:0/2177593504 conn(0x7f6ad40b2930 msgr2=0x7f6ad415ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:37.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.947+0000 7f6adc800640 1 -- 172.21.15.42:0/2177593504 shutdown_connections 2024-09-17T01:46:37.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:37.947+0000 7f6adc800640 1 -- 172.21.15.42:0/2177593504 wait complete. 2024-09-17T01:46:37.968 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":622,"stamp":"2024-09-17T01:46:37.229609+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":435640,"kb_used_data":19560,"kb_used_omap":12,"kb_used_meta":415859,"kb_avail":754539080,"statfs":{"total":773094113280,"available":772648017920,"internally_reserved":0,"allocated":20029440,"data_stored":9487252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":425840180},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.833048"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777205+0000","last_change":"2024-09-17T01:46:31.449114+0000","last_active":"2024-09-17T01:46:32.777205+0000","last_peered":"2024-09-17T01:46:32.777205+0000","last_clean":"2024-09-17T01:46:32.777205+0000","last_became_active":"2024-09-17T01:46:31.444897+0000","last_became_peered":"2024-09-17T01:46:31.444897+0000","last_unstale":"2024-09-17T01:46:32.777205+0000","last_undegraded":"2024-09-17T01:46:32.777205+0000","last_fullsized":"2024-09-17T01:46:32.777205+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:10.122631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425679+0000","last_change":"2024-09-17T01:46:31.424827+0000","last_active":"2024-09-17T01:46:32.425679+0000","last_peered":"2024-09-17T01:46:32.425679+0000","last_clean":"2024-09-17T01:46:32.425679+0000","last_became_active":"2024-09-17T01:46:31.424256+0000","last_became_peered":"2024-09-17T01:46:31.424256+0000","last_unstale":"2024-09-17T01:46:32.425679+0000","last_undegraded":"2024-09-17T01:46:32.425679+0000","last_fullsized":"2024-09-17T01:46:32.425679+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:16.070389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428308+0000","last_change":"2024-09-17T01:46:31.440514+0000","last_active":"2024-09-17T01:46:32.428308+0000","last_peered":"2024-09-17T01:46:32.428308+0000","last_clean":"2024-09-17T01:46:32.428308+0000","last_became_active":"2024-09-17T01:46:31.439579+0000","last_became_peered":"2024-09-17T01:46:31.439579+0000","last_unstale":"2024-09-17T01:46:32.428308+0000","last_undegraded":"2024-09-17T01:46:32.428308+0000","last_fullsized":"2024-09-17T01:46:32.428308+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:43.542003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776158+0000","last_change":"2024-09-17T01:46:31.434326+0000","last_active":"2024-09-17T01:46:32.776158+0000","last_peered":"2024-09-17T01:46:32.776158+0000","last_clean":"2024-09-17T01:46:32.776158+0000","last_became_active":"2024-09-17T01:46:31.434028+0000","last_became_peered":"2024-09-17T01:46:31.434028+0000","last_unstale":"2024-09-17T01:46:32.776158+0000","last_undegraded":"2024-09-17T01:46:32.776158+0000","last_fullsized":"2024-09-17T01:46:32.776158+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:36.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428626+0000","last_change":"2024-09-17T01:46:31.444693+0000","last_active":"2024-09-17T01:46:32.428626+0000","last_peered":"2024-09-17T01:46:32.428626+0000","last_clean":"2024-09-17T01:46:32.428626+0000","last_became_active":"2024-09-17T01:46:31.444143+0000","last_became_peered":"2024-09-17T01:46:31.444143+0000","last_unstale":"2024-09-17T01:46:32.428626+0000","last_undegraded":"2024-09-17T01:46:32.428626+0000","last_fullsized":"2024-09-17T01:46:32.428626+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:19:45.427741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777290+0000","last_change":"2024-09-17T01:46:31.439648+0000","last_active":"2024-09-17T01:46:32.777290+0000","last_peered":"2024-09-17T01:46:32.777290+0000","last_clean":"2024-09-17T01:46:32.777290+0000","last_became_active":"2024-09-17T01:46:31.439317+0000","last_became_peered":"2024-09-17T01:46:31.439317+0000","last_unstale":"2024-09-17T01:46:32.777290+0000","last_undegraded":"2024-09-17T01:46:32.777290+0000","last_fullsized":"2024-09-17T01:46:32.777290+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:29.867513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776468+0000","last_change":"2024-09-17T01:46:31.446698+0000","last_active":"2024-09-17T01:46:32.776468+0000","last_peered":"2024-09-17T01:46:32.776468+0000","last_clean":"2024-09-17T01:46:32.776468+0000","last_became_active":"2024-09-17T01:46:31.446416+0000","last_became_peered":"2024-09-17T01:46:31.446416+0000","last_unstale":"2024-09-17T01:46:32.776468+0000","last_undegraded":"2024-09-17T01:46:32.776468+0000","last_fullsized":"2024-09-17T01:46:32.776468+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:32.837724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426360+0000","last_change":"2024-09-17T01:46:31.426666+0000","last_active":"2024-09-17T01:46:32.426360+0000","last_peered":"2024-09-17T01:46:32.426360+0000","last_clean":"2024-09-17T01:46:32.426360+0000","last_became_active":"2024-09-17T01:46:31.426352+0000","last_became_peered":"2024-09-17T01:46:31.426352+0000","last_unstale":"2024-09-17T01:46:32.426360+0000","last_undegraded":"2024-09-17T01:46:32.426360+0000","last_fullsized":"2024-09-17T01:46:32.426360+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:04.991154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.438892+0000","last_change":"2024-09-17T01:46:31.431902+0000","last_active":"2024-09-17T01:46:32.438892+0000","last_peered":"2024-09-17T01:46:32.438892+0000","last_clean":"2024-09-17T01:46:32.438892+0000","last_became_active":"2024-09-17T01:46:31.431538+0000","last_became_peered":"2024-09-17T01:46:31.431538+0000","last_unstale":"2024-09-17T01:46:32.438892+0000","last_undegraded":"2024-09-17T01:46:32.438892+0000","last_fullsized":"2024-09-17T01:46:32.438892+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:27.806016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428433+0000","last_change":"2024-09-17T01:46:31.438389+0000","last_active":"2024-09-17T01:46:32.428433+0000","last_peered":"2024-09-17T01:46:32.428433+0000","last_clean":"2024-09-17T01:46:32.428433+0000","last_became_active":"2024-09-17T01:46:31.437275+0000","last_became_peered":"2024-09-17T01:46:31.437275+0000","last_unstale":"2024-09-17T01:46:32.428433+0000","last_undegraded":"2024-09-17T01:46:32.428433+0000","last_fullsized":"2024-09-17T01:46:32.428433+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:12:42.193215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777056+0000","last_change":"2024-09-17T01:46:31.441613+0000","last_active":"2024-09-17T01:46:32.777056+0000","last_peered":"2024-09-17T01:46:32.777056+0000","last_clean":"2024-09-17T01:46:32.777056+0000","last_became_active":"2024-09-17T01:46:31.440235+0000","last_became_peered":"2024-09-17T01:46:31.440235+0000","last_unstale":"2024-09-17T01:46:32.777056+0000","last_undegraded":"2024-09-17T01:46:32.777056+0000","last_fullsized":"2024-09-17T01:46:32.777056+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:32.524306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775618+0000","last_change":"2024-09-17T01:46:31.416960+0000","last_active":"2024-09-17T01:46:32.775618+0000","last_peered":"2024-09-17T01:46:32.775618+0000","last_clean":"2024-09-17T01:46:32.775618+0000","last_became_active":"2024-09-17T01:46:31.416577+0000","last_became_peered":"2024-09-17T01:46:31.416577+0000","last_unstale":"2024-09-17T01:46:32.775618+0000","last_undegraded":"2024-09-17T01:46:32.775618+0000","last_fullsized":"2024-09-17T01:46:32.775618+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:52:25.962925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775387+0000","last_change":"2024-09-17T01:46:31.428536+0000","last_active":"2024-09-17T01:46:32.775387+0000","last_peered":"2024-09-17T01:46:32.775387+0000","last_clean":"2024-09-17T01:46:32.775387+0000","last_became_active":"2024-09-17T01:46:31.425769+0000","last_became_peered":"2024-09-17T01:46:31.425769+0000","last_unstale":"2024-09-17T01:46:32.775387+0000","last_undegraded":"2024-09-17T01:46:32.775387+0000","last_fullsized":"2024-09-17T01:46:32.775387+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:22:23.512532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775774+0000","last_change":"2024-09-17T01:46:31.427311+0000","last_active":"2024-09-17T01:46:32.775774+0000","last_peered":"2024-09-17T01:46:32.775774+0000","last_clean":"2024-09-17T01:46:32.775774+0000","last_became_active":"2024-09-17T01:46:31.426922+0000","last_became_peered":"2024-09-17T01:46:31.426922+0000","last_unstale":"2024-09-17T01:46:32.775774+0000","last_undegraded":"2024-09-17T01:46:32.775774+0000","last_fullsized":"2024-09-17T01:46:32.775774+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:28.913481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776459+0000","last_change":"2024-09-17T01:46:31.445995+0000","last_active":"2024-09-17T01:46:32.776459+0000","last_peered":"2024-09-17T01:46:32.776459+0000","last_clean":"2024-09-17T01:46:32.776459+0000","last_became_active":"2024-09-17T01:46:31.442444+0000","last_became_peered":"2024-09-17T01:46:31.442444+0000","last_unstale":"2024-09-17T01:46:32.776459+0000","last_undegraded":"2024-09-17T01:46:32.776459+0000","last_fullsized":"2024-09-17T01:46:32.776459+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:27.316162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776447+0000","last_change":"2024-09-17T01:46:31.432472+0000","last_active":"2024-09-17T01:46:32.776447+0000","last_peered":"2024-09-17T01:46:32.776447+0000","last_clean":"2024-09-17T01:46:32.776447+0000","last_became_active":"2024-09-17T01:46:31.431958+0000","last_became_peered":"2024-09-17T01:46:31.431958+0000","last_unstale":"2024-09-17T01:46:32.776447+0000","last_undegraded":"2024-09-17T01:46:32.776447+0000","last_fullsized":"2024-09-17T01:46:32.776447+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:44.766306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777329+0000","last_change":"2024-09-17T01:46:31.444639+0000","last_active":"2024-09-17T01:46:32.777329+0000","last_peered":"2024-09-17T01:46:32.777329+0000","last_clean":"2024-09-17T01:46:32.777329+0000","last_became_active":"2024-09-17T01:46:31.442591+0000","last_became_peered":"2024-09-17T01:46:31.442591+0000","last_unstale":"2024-09-17T01:46:32.777329+0000","last_undegraded":"2024-09-17T01:46:32.777329+0000","last_fullsized":"2024-09-17T01:46:32.777329+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:11.846706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428771+0000","last_change":"2024-09-17T01:46:31.434660+0000","last_active":"2024-09-17T01:46:32.428771+0000","last_peered":"2024-09-17T01:46:32.428771+0000","last_clean":"2024-09-17T01:46:32.428771+0000","last_became_active":"2024-09-17T01:46:31.434321+0000","last_became_peered":"2024-09-17T01:46:31.434321+0000","last_unstale":"2024-09-17T01:46:32.428771+0000","last_undegraded":"2024-09-17T01:46:32.428771+0000","last_fullsized":"2024-09-17T01:46:32.428771+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:11.153289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.429127+0000","last_change":"2024-09-17T01:46:31.439946+0000","last_active":"2024-09-17T01:46:32.429127+0000","last_peered":"2024-09-17T01:46:32.429127+0000","last_clean":"2024-09-17T01:46:32.429127+0000","last_became_active":"2024-09-17T01:46:31.439546+0000","last_became_peered":"2024-09-17T01:46:31.439546+0000","last_unstale":"2024-09-17T01:46:32.429127+0000","last_undegraded":"2024-09-17T01:46:32.429127+0000","last_fullsized":"2024-09-17T01:46:32.429127+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:05.120666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428283+0000","last_change":"2024-09-17T01:46:31.437213+0000","last_active":"2024-09-17T01:46:32.428283+0000","last_peered":"2024-09-17T01:46:32.428283+0000","last_clean":"2024-09-17T01:46:32.428283+0000","last_became_active":"2024-09-17T01:46:31.436423+0000","last_became_peered":"2024-09-17T01:46:31.436423+0000","last_unstale":"2024-09-17T01:46:32.428283+0000","last_undegraded":"2024-09-17T01:46:32.428283+0000","last_fullsized":"2024-09-17T01:46:32.428283+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:27.109581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776147+0000","last_change":"2024-09-17T01:46:31.427386+0000","last_active":"2024-09-17T01:46:32.776147+0000","last_peered":"2024-09-17T01:46:32.776147+0000","last_clean":"2024-09-17T01:46:32.776147+0000","last_became_active":"2024-09-17T01:46:31.425405+0000","last_became_peered":"2024-09-17T01:46:31.425405+0000","last_unstale":"2024-09-17T01:46:32.776147+0000","last_undegraded":"2024-09-17T01:46:32.776147+0000","last_fullsized":"2024-09-17T01:46:32.776147+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:43.277654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425441+0000","last_change":"2024-09-17T01:46:31.436812+0000","last_active":"2024-09-17T01:46:32.425441+0000","last_peered":"2024-09-17T01:46:32.425441+0000","last_clean":"2024-09-17T01:46:32.425441+0000","last_became_active":"2024-09-17T01:46:31.436297+0000","last_became_peered":"2024-09-17T01:46:31.436297+0000","last_unstale":"2024-09-17T01:46:32.425441+0000","last_undegraded":"2024-09-17T01:46:32.425441+0000","last_fullsized":"2024-09-17T01:46:32.425441+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:32:19.529698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775436+0000","last_change":"2024-09-17T01:46:31.423114+0000","last_active":"2024-09-17T01:46:32.775436+0000","last_peered":"2024-09-17T01:46:32.775436+0000","last_clean":"2024-09-17T01:46:32.775436+0000","last_became_active":"2024-09-17T01:46:31.422795+0000","last_became_peered":"2024-09-17T01:46:31.422795+0000","last_unstale":"2024-09-17T01:46:32.775436+0000","last_undegraded":"2024-09-17T01:46:32.775436+0000","last_fullsized":"2024-09-17T01:46:32.775436+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:07.226908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.438480+0000","last_change":"2024-09-17T01:46:31.434522+0000","last_active":"2024-09-17T01:46:32.438480+0000","last_peered":"2024-09-17T01:46:32.438480+0000","last_clean":"2024-09-17T01:46:32.438480+0000","last_became_active":"2024-09-17T01:46:31.432582+0000","last_became_peered":"2024-09-17T01:46:31.432582+0000","last_unstale":"2024-09-17T01:46:32.438480+0000","last_undegraded":"2024-09-17T01:46:32.438480+0000","last_fullsized":"2024-09-17T01:46:32.438480+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:39.833717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776072+0000","last_change":"2024-09-17T01:46:31.446218+0000","last_active":"2024-09-17T01:46:32.776072+0000","last_peered":"2024-09-17T01:46:32.776072+0000","last_clean":"2024-09-17T01:46:32.776072+0000","last_became_active":"2024-09-17T01:46:31.445885+0000","last_became_peered":"2024-09-17T01:46:31.445885+0000","last_unstale":"2024-09-17T01:46:32.776072+0000","last_undegraded":"2024-09-17T01:46:32.776072+0000","last_fullsized":"2024-09-17T01:46:32.776072+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:06.717241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427501+0000","last_change":"2024-09-17T01:46:31.426677+0000","last_active":"2024-09-17T01:46:32.427501+0000","last_peered":"2024-09-17T01:46:32.427501+0000","last_clean":"2024-09-17T01:46:32.427501+0000","last_became_active":"2024-09-17T01:46:31.425517+0000","last_became_peered":"2024-09-17T01:46:31.425517+0000","last_unstale":"2024-09-17T01:46:32.427501+0000","last_undegraded":"2024-09-17T01:46:32.427501+0000","last_fullsized":"2024-09-17T01:46:32.427501+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:31.981218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775884+0000","last_change":"2024-09-17T01:46:31.425570+0000","last_active":"2024-09-17T01:46:32.775884+0000","last_peered":"2024-09-17T01:46:32.775884+0000","last_clean":"2024-09-17T01:46:32.775884+0000","last_became_active":"2024-09-17T01:46:31.425256+0000","last_became_peered":"2024-09-17T01:46:31.425256+0000","last_unstale":"2024-09-17T01:46:32.775884+0000","last_undegraded":"2024-09-17T01:46:32.775884+0000","last_fullsized":"2024-09-17T01:46:32.775884+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:40.200273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427198+0000","last_change":"2024-09-17T01:46:31.422013+0000","last_active":"2024-09-17T01:46:32.427198+0000","last_peered":"2024-09-17T01:46:32.427198+0000","last_clean":"2024-09-17T01:46:32.427198+0000","last_became_active":"2024-09-17T01:46:31.421574+0000","last_became_peered":"2024-09-17T01:46:31.421574+0000","last_unstale":"2024-09-17T01:46:32.427198+0000","last_undegraded":"2024-09-17T01:46:32.427198+0000","last_fullsized":"2024-09-17T01:46:32.427198+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:13.432651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425439+0000","last_change":"2024-09-17T01:46:31.426049+0000","last_active":"2024-09-17T01:46:32.425439+0000","last_peered":"2024-09-17T01:46:32.425439+0000","last_clean":"2024-09-17T01:46:32.425439+0000","last_became_active":"2024-09-17T01:46:31.425700+0000","last_became_peered":"2024-09-17T01:46:31.425700+0000","last_unstale":"2024-09-17T01:46:32.425439+0000","last_undegraded":"2024-09-17T01:46:32.425439+0000","last_fullsized":"2024-09-17T01:46:32.425439+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:15.961268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775828+0000","last_change":"2024-09-17T01:46:31.445360+0000","last_active":"2024-09-17T01:46:32.775828+0000","last_peered":"2024-09-17T01:46:32.775828+0000","last_clean":"2024-09-17T01:46:32.775828+0000","last_became_active":"2024-09-17T01:46:31.445034+0000","last_became_peered":"2024-09-17T01:46:31.445034+0000","last_unstale":"2024-09-17T01:46:32.775828+0000","last_undegraded":"2024-09-17T01:46:32.775828+0000","last_fullsized":"2024-09-17T01:46:32.775828+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:18.585792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426826+0000","last_change":"2024-09-17T01:46:31.436801+0000","last_active":"2024-09-17T01:46:32.426826+0000","last_peered":"2024-09-17T01:46:32.426826+0000","last_clean":"2024-09-17T01:46:32.426826+0000","last_became_active":"2024-09-17T01:46:31.436442+0000","last_became_peered":"2024-09-17T01:46:31.436442+0000","last_unstale":"2024-09-17T01:46:32.426826+0000","last_undegraded":"2024-09-17T01:46:32.426826+0000","last_fullsized":"2024-09-17T01:46:32.426826+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:29.158716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776024+0000","last_change":"2024-09-17T01:46:31.435302+0000","last_active":"2024-09-17T01:46:32.776024+0000","last_peered":"2024-09-17T01:46:32.776024+0000","last_clean":"2024-09-17T01:46:32.776024+0000","last_became_active":"2024-09-17T01:46:31.435007+0000","last_became_peered":"2024-09-17T01:46:31.435007+0000","last_unstale":"2024-09-17T01:46:32.776024+0000","last_undegraded":"2024-09-17T01:46:32.776024+0000","last_fullsized":"2024-09-17T01:46:32.776024+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:06.685153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776762+0000","last_change":"2024-09-17T01:46:31.422309+0000","last_active":"2024-09-17T01:46:32.776762+0000","last_peered":"2024-09-17T01:46:32.776762+0000","last_clean":"2024-09-17T01:46:32.776762+0000","last_became_active":"2024-09-17T01:46:31.421687+0000","last_became_peered":"2024-09-17T01:46:31.421687+0000","last_unstale":"2024-09-17T01:46:32.776762+0000","last_undegraded":"2024-09-17T01:46:32.776762+0000","last_fullsized":"2024-09-17T01:46:32.776762+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:23.754735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1f","version":"186'4","reported_seq":19,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776472+0000","last_change":"2024-09-17T01:46:30.421999+0000","last_active":"2024-09-17T01:46:32.776472+0000","last_peered":"2024-09-17T01:46:32.776472+0000","last_clean":"2024-09-17T01:46:32.776472+0000","last_became_active":"2024-09-17T01:46:30.421444+0000","last_became_peered":"2024-09-17T01:46:30.421444+0000","last_unstale":"2024-09-17T01:46:32.776472+0000","last_undegraded":"2024-09-17T01:46:32.776472+0000","last_fullsized":"2024-09-17T01:46:32.776472+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:19:33.239539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776314+0000","last_change":"2024-09-17T01:46:31.436431+0000","last_active":"2024-09-17T01:46:32.776314+0000","last_peered":"2024-09-17T01:46:32.776314+0000","last_clean":"2024-09-17T01:46:32.776314+0000","last_became_active":"2024-09-17T01:46:31.436098+0000","last_became_peered":"2024-09-17T01:46:31.436098+0000","last_unstale":"2024-09-17T01:46:32.776314+0000","last_undegraded":"2024-09-17T01:46:32.776314+0000","last_fullsized":"2024-09-17T01:46:32.776314+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:10.579523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1e","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425770+0000","last_change":"2024-09-17T01:46:30.414291+0000","last_active":"2024-09-17T01:46:32.425770+0000","last_peered":"2024-09-17T01:46:32.425770+0000","last_clean":"2024-09-17T01:46:32.425770+0000","last_became_active":"2024-09-17T01:46:30.413782+0000","last_became_peered":"2024-09-17T01:46:30.413782+0000","last_unstale":"2024-09-17T01:46:32.425770+0000","last_undegraded":"2024-09-17T01:46:32.425770+0000","last_fullsized":"2024-09-17T01:46:32.425770+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:04.480361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428927+0000","last_change":"2024-09-17T01:46:31.435399+0000","last_active":"2024-09-17T01:46:32.428927+0000","last_peered":"2024-09-17T01:46:32.428927+0000","last_clean":"2024-09-17T01:46:32.428927+0000","last_became_active":"2024-09-17T01:46:31.434992+0000","last_became_peered":"2024-09-17T01:46:31.434992+0000","last_unstale":"2024-09-17T01:46:32.428927+0000","last_undegraded":"2024-09-17T01:46:32.428927+0000","last_fullsized":"2024-09-17T01:46:32.428927+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:50:55.804363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"186'2","reported_seq":17,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427047+0000","last_change":"2024-09-17T01:46:30.417874+0000","last_active":"2024-09-17T01:46:32.427047+0000","last_peered":"2024-09-17T01:46:32.427047+0000","last_clean":"2024-09-17T01:46:32.427047+0000","last_became_active":"2024-09-17T01:46:30.416190+0000","last_became_peered":"2024-09-17T01:46:30.416190+0000","last_unstale":"2024-09-17T01:46:32.427047+0000","last_undegraded":"2024-09-17T01:46:32.427047+0000","last_fullsized":"2024-09-17T01:46:32.427047+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:02.232021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428642+0000","last_change":"2024-09-17T01:46:31.443348+0000","last_active":"2024-09-17T01:46:32.428642+0000","last_peered":"2024-09-17T01:46:32.428642+0000","last_clean":"2024-09-17T01:46:32.428642+0000","last_became_active":"2024-09-17T01:46:31.439978+0000","last_became_peered":"2024-09-17T01:46:31.439978+0000","last_unstale":"2024-09-17T01:46:32.428642+0000","last_undegraded":"2024-09-17T01:46:32.428642+0000","last_fullsized":"2024-09-17T01:46:32.428642+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:30.533657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1c","version":"186'2","reported_seq":17,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776234+0000","last_change":"2024-09-17T01:46:30.419634+0000","last_active":"2024-09-17T01:46:32.776234+0000","last_peered":"2024-09-17T01:46:32.776234+0000","last_clean":"2024-09-17T01:46:32.776234+0000","last_became_active":"2024-09-17T01:46:30.419304+0000","last_became_peered":"2024-09-17T01:46:30.419304+0000","last_unstale":"2024-09-17T01:46:32.776234+0000","last_undegraded":"2024-09-17T01:46:32.776234+0000","last_fullsized":"2024-09-17T01:46:32.776234+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:05.285011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775650+0000","last_change":"2024-09-17T01:46:31.440666+0000","last_active":"2024-09-17T01:46:32.775650+0000","last_peered":"2024-09-17T01:46:32.775650+0000","last_clean":"2024-09-17T01:46:32.775650+0000","last_became_active":"2024-09-17T01:46:31.439118+0000","last_became_peered":"2024-09-17T01:46:31.439118+0000","last_unstale":"2024-09-17T01:46:32.775650+0000","last_undegraded":"2024-09-17T01:46:32.775650+0000","last_fullsized":"2024-09-17T01:46:32.775650+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:11.746299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777424+0000","last_change":"2024-09-17T01:46:30.424178+0000","last_active":"2024-09-17T01:46:32.777424+0000","last_peered":"2024-09-17T01:46:32.777424+0000","last_clean":"2024-09-17T01:46:32.777424+0000","last_became_active":"2024-09-17T01:46:30.423653+0000","last_became_peered":"2024-09-17T01:46:30.423653+0000","last_unstale":"2024-09-17T01:46:32.777424+0000","last_undegraded":"2024-09-17T01:46:32.777424+0000","last_fullsized":"2024-09-17T01:46:32.777424+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:01:57.156162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776415+0000","last_change":"2024-09-17T01:46:31.428613+0000","last_active":"2024-09-17T01:46:32.776415+0000","last_peered":"2024-09-17T01:46:32.776415+0000","last_clean":"2024-09-17T01:46:32.776415+0000","last_became_active":"2024-09-17T01:46:31.428070+0000","last_became_peered":"2024-09-17T01:46:31.428070+0000","last_unstale":"2024-09-17T01:46:32.776415+0000","last_undegraded":"2024-09-17T01:46:32.776415+0000","last_fullsized":"2024-09-17T01:46:32.776415+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:02.001662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426445+0000","last_change":"2024-09-17T01:46:30.419541+0000","last_active":"2024-09-17T01:46:32.426445+0000","last_peered":"2024-09-17T01:46:32.426445+0000","last_clean":"2024-09-17T01:46:32.426445+0000","last_became_active":"2024-09-17T01:46:30.417201+0000","last_became_peered":"2024-09-17T01:46:30.417201+0000","last_unstale":"2024-09-17T01:46:32.426445+0000","last_undegraded":"2024-09-17T01:46:32.426445+0000","last_fullsized":"2024-09-17T01:46:32.426445+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:53.835043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.438463+0000","last_change":"2024-09-17T01:46:31.435104+0000","last_active":"2024-09-17T01:46:32.438463+0000","last_peered":"2024-09-17T01:46:32.438463+0000","last_clean":"2024-09-17T01:46:32.438463+0000","last_became_active":"2024-09-17T01:46:31.434699+0000","last_became_peered":"2024-09-17T01:46:31.434699+0000","last_unstale":"2024-09-17T01:46:32.438463+0000","last_undegraded":"2024-09-17T01:46:32.438463+0000","last_fullsized":"2024-09-17T01:46:32.438463+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:47.650146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775314+0000","last_change":"2024-09-17T01:46:30.425424+0000","last_active":"2024-09-17T01:46:32.775314+0000","last_peered":"2024-09-17T01:46:32.775314+0000","last_clean":"2024-09-17T01:46:32.775314+0000","last_became_active":"2024-09-17T01:46:30.424776+0000","last_became_peered":"2024-09-17T01:46:30.424776+0000","last_unstale":"2024-09-17T01:46:32.775314+0000","last_undegraded":"2024-09-17T01:46:32.775314+0000","last_fullsized":"2024-09-17T01:46:32.775314+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:00.655765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776220+0000","last_change":"2024-09-17T01:46:31.445355+0000","last_active":"2024-09-17T01:46:32.776220+0000","last_peered":"2024-09-17T01:46:32.776220+0000","last_clean":"2024-09-17T01:46:32.776220+0000","last_became_active":"2024-09-17T01:46:31.445006+0000","last_became_peered":"2024-09-17T01:46:31.445006+0000","last_unstale":"2024-09-17T01:46:32.776220+0000","last_undegraded":"2024-09-17T01:46:32.776220+0000","last_fullsized":"2024-09-17T01:46:32.776220+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:00:48.418812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428717+0000","last_change":"2024-09-17T01:46:30.425233+0000","last_active":"2024-09-17T01:46:32.428717+0000","last_peered":"2024-09-17T01:46:32.428717+0000","last_clean":"2024-09-17T01:46:32.428717+0000","last_became_active":"2024-09-17T01:46:30.424688+0000","last_became_peered":"2024-09-17T01:46:30.424688+0000","last_unstale":"2024-09-17T01:46:32.428717+0000","last_undegraded":"2024-09-17T01:46:32.428717+0000","last_fullsized":"2024-09-17T01:46:32.428717+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:22.747644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775921+0000","last_change":"2024-09-17T01:46:31.433934+0000","last_active":"2024-09-17T01:46:32.775921+0000","last_peered":"2024-09-17T01:46:32.775921+0000","last_clean":"2024-09-17T01:46:32.775921+0000","last_became_active":"2024-09-17T01:46:31.433582+0000","last_became_peered":"2024-09-17T01:46:31.433582+0000","last_unstale":"2024-09-17T01:46:32.775921+0000","last_undegraded":"2024-09-17T01:46:32.775921+0000","last_fullsized":"2024-09-17T01:46:32.775921+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:12:49.719869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776319+0000","last_change":"2024-09-17T01:46:30.424629+0000","last_active":"2024-09-17T01:46:32.776319+0000","last_peered":"2024-09-17T01:46:32.776319+0000","last_clean":"2024-09-17T01:46:32.776319+0000","last_became_active":"2024-09-17T01:46:30.424304+0000","last_became_peered":"2024-09-17T01:46:30.424304+0000","last_unstale":"2024-09-17T01:46:32.776319+0000","last_undegraded":"2024-09-17T01:46:32.776319+0000","last_fullsized":"2024-09-17T01:46:32.776319+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:56:10.352036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.438685+0000","last_change":"2024-09-17T01:46:31.434138+0000","last_active":"2024-09-17T01:46:32.438685+0000","last_peered":"2024-09-17T01:46:32.438685+0000","last_clean":"2024-09-17T01:46:32.438685+0000","last_became_active":"2024-09-17T01:46:31.433033+0000","last_became_peered":"2024-09-17T01:46:31.433033+0000","last_unstale":"2024-09-17T01:46:32.438685+0000","last_undegraded":"2024-09-17T01:46:32.438685+0000","last_fullsized":"2024-09-17T01:46:32.438685+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:29.387003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.15","version":"186'3","reported_seq":18,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427149+0000","last_change":"2024-09-17T01:46:30.422242+0000","last_active":"2024-09-17T01:46:32.427149+0000","last_peered":"2024-09-17T01:46:32.427149+0000","last_clean":"2024-09-17T01:46:32.427149+0000","last_became_active":"2024-09-17T01:46:30.421844+0000","last_became_peered":"2024-09-17T01:46:30.421844+0000","last_unstale":"2024-09-17T01:46:32.427149+0000","last_undegraded":"2024-09-17T01:46:32.427149+0000","last_fullsized":"2024-09-17T01:46:32.427149+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:12.309630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426956+0000","last_change":"2024-09-17T01:46:31.428578+0000","last_active":"2024-09-17T01:46:32.426956+0000","last_peered":"2024-09-17T01:46:32.426956+0000","last_clean":"2024-09-17T01:46:32.426956+0000","last_became_active":"2024-09-17T01:46:31.428252+0000","last_became_peered":"2024-09-17T01:46:31.428252+0000","last_unstale":"2024-09-17T01:46:32.426956+0000","last_undegraded":"2024-09-17T01:46:32.426956+0000","last_fullsized":"2024-09-17T01:46:32.426956+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:59:35.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"186'6","reported_seq":21,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.438708+0000","last_change":"2024-09-17T01:46:30.422374+0000","last_active":"2024-09-17T01:46:32.438708+0000","last_peered":"2024-09-17T01:46:32.438708+0000","last_clean":"2024-09-17T01:46:32.438708+0000","last_became_active":"2024-09-17T01:46:30.421910+0000","last_became_peered":"2024-09-17T01:46:30.421910+0000","last_unstale":"2024-09-17T01:46:32.438708+0000","last_undegraded":"2024-09-17T01:46:32.438708+0000","last_fullsized":"2024-09-17T01:46:32.438708+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:33:54.169338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776007+0000","last_change":"2024-09-17T01:46:31.443892+0000","last_active":"2024-09-17T01:46:32.776007+0000","last_peered":"2024-09-17T01:46:32.776007+0000","last_clean":"2024-09-17T01:46:32.776007+0000","last_became_active":"2024-09-17T01:46:31.441114+0000","last_became_peered":"2024-09-17T01:46:31.441114+0000","last_unstale":"2024-09-17T01:46:32.776007+0000","last_undegraded":"2024-09-17T01:46:32.776007+0000","last_fullsized":"2024-09-17T01:46:32.776007+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:43.533425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.13","version":"186'2","reported_seq":17,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.438522+0000","last_change":"2024-09-17T01:46:30.423710+0000","last_active":"2024-09-17T01:46:32.438522+0000","last_peered":"2024-09-17T01:46:32.438522+0000","last_clean":"2024-09-17T01:46:32.438522+0000","last_became_active":"2024-09-17T01:46:30.423408+0000","last_became_peered":"2024-09-17T01:46:30.423408+0000","last_unstale":"2024-09-17T01:46:32.438522+0000","last_undegraded":"2024-09-17T01:46:32.438522+0000","last_fullsized":"2024-09-17T01:46:32.438522+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:51:21.497368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428962+0000","last_change":"2024-09-17T01:46:31.442692+0000","last_active":"2024-09-17T01:46:32.428962+0000","last_peered":"2024-09-17T01:46:32.428962+0000","last_clean":"2024-09-17T01:46:32.428962+0000","last_became_active":"2024-09-17T01:46:31.437975+0000","last_became_peered":"2024-09-17T01:46:31.437975+0000","last_unstale":"2024-09-17T01:46:32.428962+0000","last_undegraded":"2024-09-17T01:46:32.428962+0000","last_fullsized":"2024-09-17T01:46:32.428962+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:24.601060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425179+0000","last_change":"2024-09-17T01:46:30.417522+0000","last_active":"2024-09-17T01:46:32.425179+0000","last_peered":"2024-09-17T01:46:32.425179+0000","last_clean":"2024-09-17T01:46:32.425179+0000","last_became_active":"2024-09-17T01:46:30.417209+0000","last_became_peered":"2024-09-17T01:46:30.417209+0000","last_unstale":"2024-09-17T01:46:32.425179+0000","last_undegraded":"2024-09-17T01:46:32.425179+0000","last_fullsized":"2024-09-17T01:46:32.425179+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:15.260440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427083+0000","last_change":"2024-09-17T01:46:31.434934+0000","last_active":"2024-09-17T01:46:32.427083+0000","last_peered":"2024-09-17T01:46:32.427083+0000","last_clean":"2024-09-17T01:46:32.427083+0000","last_became_active":"2024-09-17T01:46:31.434566+0000","last_became_peered":"2024-09-17T01:46:31.434566+0000","last_unstale":"2024-09-17T01:46:32.427083+0000","last_undegraded":"2024-09-17T01:46:32.427083+0000","last_fullsized":"2024-09-17T01:46:32.427083+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:47.607553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426560+0000","last_change":"2024-09-17T01:46:30.404274+0000","last_active":"2024-09-17T01:46:32.426560+0000","last_peered":"2024-09-17T01:46:32.426560+0000","last_clean":"2024-09-17T01:46:32.426560+0000","last_became_active":"2024-09-17T01:46:30.403501+0000","last_became_peered":"2024-09-17T01:46:30.403501+0000","last_unstale":"2024-09-17T01:46:32.426560+0000","last_undegraded":"2024-09-17T01:46:32.426560+0000","last_fullsized":"2024-09-17T01:46:32.426560+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:51.012757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777176+0000","last_change":"2024-09-17T01:46:31.436778+0000","last_active":"2024-09-17T01:46:32.777176+0000","last_peered":"2024-09-17T01:46:32.777176+0000","last_clean":"2024-09-17T01:46:32.777176+0000","last_became_active":"2024-09-17T01:46:31.436441+0000","last_became_peered":"2024-09-17T01:46:31.436441+0000","last_unstale":"2024-09-17T01:46:32.777176+0000","last_undegraded":"2024-09-17T01:46:32.777176+0000","last_fullsized":"2024-09-17T01:46:32.777176+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:54.967884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.10","version":"186'8","reported_seq":23,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426761+0000","last_change":"2024-09-17T01:46:30.414504+0000","last_active":"2024-09-17T01:46:32.426761+0000","last_peered":"2024-09-17T01:46:32.426761+0000","last_clean":"2024-09-17T01:46:32.426761+0000","last_became_active":"2024-09-17T01:46:30.414064+0000","last_became_peered":"2024-09-17T01:46:30.414064+0000","last_unstale":"2024-09-17T01:46:32.426761+0000","last_undegraded":"2024-09-17T01:46:32.426761+0000","last_fullsized":"2024-09-17T01:46:32.426761+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:16.932888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776776+0000","last_change":"2024-09-17T01:46:31.420586+0000","last_active":"2024-09-17T01:46:32.776776+0000","last_peered":"2024-09-17T01:46:32.776776+0000","last_clean":"2024-09-17T01:46:32.776776+0000","last_became_active":"2024-09-17T01:46:31.420292+0000","last_became_peered":"2024-09-17T01:46:31.420292+0000","last_unstale":"2024-09-17T01:46:32.776776+0000","last_undegraded":"2024-09-17T01:46:32.776776+0000","last_fullsized":"2024-09-17T01:46:32.776776+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:19:40.212633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.f","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777536+0000","last_change":"2024-09-17T01:46:30.424539+0000","last_active":"2024-09-17T01:46:32.777536+0000","last_peered":"2024-09-17T01:46:32.777536+0000","last_clean":"2024-09-17T01:46:32.777536+0000","last_became_active":"2024-09-17T01:46:30.424219+0000","last_became_peered":"2024-09-17T01:46:30.424219+0000","last_unstale":"2024-09-17T01:46:32.777536+0000","last_undegraded":"2024-09-17T01:46:32.777536+0000","last_fullsized":"2024-09-17T01:46:32.777536+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:10.664092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776865+0000","last_change":"2024-09-17T01:46:31.440377+0000","last_active":"2024-09-17T01:46:32.776865+0000","last_peered":"2024-09-17T01:46:32.776865+0000","last_clean":"2024-09-17T01:46:32.776865+0000","last_became_active":"2024-09-17T01:46:31.439915+0000","last_became_peered":"2024-09-17T01:46:31.439915+0000","last_unstale":"2024-09-17T01:46:32.776865+0000","last_undegraded":"2024-09-17T01:46:32.776865+0000","last_fullsized":"2024-09-17T01:46:32.776865+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:33.599429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.e","version":"186'2","reported_seq":17,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.438764+0000","last_change":"2024-09-17T01:46:30.419672+0000","last_active":"2024-09-17T01:46:32.438764+0000","last_peered":"2024-09-17T01:46:32.438764+0000","last_clean":"2024-09-17T01:46:32.438764+0000","last_became_active":"2024-09-17T01:46:30.417927+0000","last_became_peered":"2024-09-17T01:46:30.417927+0000","last_unstale":"2024-09-17T01:46:32.438764+0000","last_undegraded":"2024-09-17T01:46:32.438764+0000","last_fullsized":"2024-09-17T01:46:32.438764+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:31.537991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428806+0000","last_change":"2024-09-17T01:46:31.437719+0000","last_active":"2024-09-17T01:46:32.428806+0000","last_peered":"2024-09-17T01:46:32.428806+0000","last_clean":"2024-09-17T01:46:32.428806+0000","last_became_active":"2024-09-17T01:46:31.436896+0000","last_became_peered":"2024-09-17T01:46:31.436896+0000","last_unstale":"2024-09-17T01:46:32.428806+0000","last_undegraded":"2024-09-17T01:46:32.428806+0000","last_fullsized":"2024-09-17T01:46:32.428806+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:51.651477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.d","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776068+0000","last_change":"2024-09-17T01:46:30.417554+0000","last_active":"2024-09-17T01:46:32.776068+0000","last_peered":"2024-09-17T01:46:32.776068+0000","last_clean":"2024-09-17T01:46:32.776068+0000","last_became_active":"2024-09-17T01:46:30.416047+0000","last_became_peered":"2024-09-17T01:46:30.416047+0000","last_unstale":"2024-09-17T01:46:32.776068+0000","last_undegraded":"2024-09-17T01:46:32.776068+0000","last_fullsized":"2024-09-17T01:46:32.776068+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:48:22.422721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776996+0000","last_change":"2024-09-17T01:46:31.432802+0000","last_active":"2024-09-17T01:46:32.776996+0000","last_peered":"2024-09-17T01:46:32.776996+0000","last_clean":"2024-09-17T01:46:32.776996+0000","last_became_active":"2024-09-17T01:46:31.431642+0000","last_became_peered":"2024-09-17T01:46:31.431642+0000","last_unstale":"2024-09-17T01:46:32.776996+0000","last_undegraded":"2024-09-17T01:46:32.776996+0000","last_fullsized":"2024-09-17T01:46:32.776996+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:08.595846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776725+0000","last_change":"2024-09-17T01:46:30.422016+0000","last_active":"2024-09-17T01:46:32.776725+0000","last_peered":"2024-09-17T01:46:32.776725+0000","last_clean":"2024-09-17T01:46:32.776725+0000","last_became_active":"2024-09-17T01:46:30.421643+0000","last_became_peered":"2024-09-17T01:46:30.421643+0000","last_unstale":"2024-09-17T01:46:32.776725+0000","last_undegraded":"2024-09-17T01:46:32.776725+0000","last_fullsized":"2024-09-17T01:46:32.776725+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:22.199090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428012+0000","last_change":"2024-09-17T01:46:31.433043+0000","last_active":"2024-09-17T01:46:32.428012+0000","last_peered":"2024-09-17T01:46:32.428012+0000","last_clean":"2024-09-17T01:46:32.428012+0000","last_became_active":"2024-09-17T01:46:31.432720+0000","last_became_peered":"2024-09-17T01:46:31.432720+0000","last_unstale":"2024-09-17T01:46:32.428012+0000","last_undegraded":"2024-09-17T01:46:32.428012+0000","last_fullsized":"2024-09-17T01:46:32.428012+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:57:32.671300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.b","version":"186'2","reported_seq":17,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775602+0000","last_change":"2024-09-17T01:46:30.405350+0000","last_active":"2024-09-17T01:46:32.775602+0000","last_peered":"2024-09-17T01:46:32.775602+0000","last_clean":"2024-09-17T01:46:32.775602+0000","last_became_active":"2024-09-17T01:46:30.404996+0000","last_became_peered":"2024-09-17T01:46:30.404996+0000","last_unstale":"2024-09-17T01:46:32.775602+0000","last_undegraded":"2024-09-17T01:46:32.775602+0000","last_fullsized":"2024-09-17T01:46:32.775602+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:58.482506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777051+0000","last_change":"2024-09-17T01:46:31.442677+0000","last_active":"2024-09-17T01:46:32.777051+0000","last_peered":"2024-09-17T01:46:32.777051+0000","last_clean":"2024-09-17T01:46:32.777051+0000","last_became_active":"2024-09-17T01:46:31.442347+0000","last_became_peered":"2024-09-17T01:46:31.442347+0000","last_unstale":"2024-09-17T01:46:32.777051+0000","last_undegraded":"2024-09-17T01:46:32.777051+0000","last_fullsized":"2024-09-17T01:46:32.777051+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:19.562731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426379+0000","last_change":"2024-09-17T01:46:30.412325+0000","last_active":"2024-09-17T01:46:32.426379+0000","last_peered":"2024-09-17T01:46:32.426379+0000","last_clean":"2024-09-17T01:46:32.426379+0000","last_became_active":"2024-09-17T01:46:30.412047+0000","last_became_peered":"2024-09-17T01:46:30.412047+0000","last_unstale":"2024-09-17T01:46:32.426379+0000","last_undegraded":"2024-09-17T01:46:32.426379+0000","last_fullsized":"2024-09-17T01:46:32.426379+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:54.073456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775239+0000","last_change":"2024-09-17T01:46:31.432167+0000","last_active":"2024-09-17T01:46:32.775239+0000","last_peered":"2024-09-17T01:46:32.775239+0000","last_clean":"2024-09-17T01:46:32.775239+0000","last_became_active":"2024-09-17T01:46:31.431789+0000","last_became_peered":"2024-09-17T01:46:31.431789+0000","last_unstale":"2024-09-17T01:46:32.775239+0000","last_undegraded":"2024-09-17T01:46:32.775239+0000","last_fullsized":"2024-09-17T01:46:32.775239+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:21.650118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426921+0000","last_change":"2024-09-17T01:46:30.427238+0000","last_active":"2024-09-17T01:46:32.426921+0000","last_peered":"2024-09-17T01:46:32.426921+0000","last_clean":"2024-09-17T01:46:32.426921+0000","last_became_active":"2024-09-17T01:46:30.426611+0000","last_became_peered":"2024-09-17T01:46:30.426611+0000","last_unstale":"2024-09-17T01:46:32.426921+0000","last_undegraded":"2024-09-17T01:46:32.426921+0000","last_fullsized":"2024-09-17T01:46:32.426921+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:15.611305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775673+0000","last_change":"2024-09-17T01:46:31.419791+0000","last_active":"2024-09-17T01:46:32.775673+0000","last_peered":"2024-09-17T01:46:32.775673+0000","last_clean":"2024-09-17T01:46:32.775673+0000","last_became_active":"2024-09-17T01:46:31.419473+0000","last_became_peered":"2024-09-17T01:46:31.419473+0000","last_unstale":"2024-09-17T01:46:32.775673+0000","last_undegraded":"2024-09-17T01:46:32.775673+0000","last_fullsized":"2024-09-17T01:46:32.775673+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:32.481643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426899+0000","last_change":"2024-09-17T01:46:30.420644+0000","last_active":"2024-09-17T01:46:32.426899+0000","last_peered":"2024-09-17T01:46:32.426899+0000","last_clean":"2024-09-17T01:46:32.426899+0000","last_became_active":"2024-09-17T01:46:30.420307+0000","last_became_peered":"2024-09-17T01:46:30.420307+0000","last_unstale":"2024-09-17T01:46:32.426899+0000","last_undegraded":"2024-09-17T01:46:32.426899+0000","last_fullsized":"2024-09-17T01:46:32.426899+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:00.872803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777003+0000","last_change":"2024-09-17T01:46:31.444744+0000","last_active":"2024-09-17T01:46:32.777003+0000","last_peered":"2024-09-17T01:46:32.777003+0000","last_clean":"2024-09-17T01:46:32.777003+0000","last_became_active":"2024-09-17T01:46:31.444375+0000","last_became_peered":"2024-09-17T01:46:31.444375+0000","last_unstale":"2024-09-17T01:46:32.777003+0000","last_undegraded":"2024-09-17T01:46:32.777003+0000","last_fullsized":"2024-09-17T01:46:32.777003+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:43.584917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.7","version":"186'2","reported_seq":17,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427390+0000","last_change":"2024-09-17T01:46:30.425299+0000","last_active":"2024-09-17T01:46:32.427390+0000","last_peered":"2024-09-17T01:46:32.427390+0000","last_clean":"2024-09-17T01:46:32.427390+0000","last_became_active":"2024-09-17T01:46:30.424946+0000","last_became_peered":"2024-09-17T01:46:30.424946+0000","last_unstale":"2024-09-17T01:46:32.427390+0000","last_undegraded":"2024-09-17T01:46:32.427390+0000","last_fullsized":"2024-09-17T01:46:32.427390+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:28.876800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777440+0000","last_change":"2024-09-17T01:46:31.442936+0000","last_active":"2024-09-17T01:46:32.777440+0000","last_peered":"2024-09-17T01:46:32.777440+0000","last_clean":"2024-09-17T01:46:32.777440+0000","last_became_active":"2024-09-17T01:46:31.441624+0000","last_became_peered":"2024-09-17T01:46:31.441624+0000","last_unstale":"2024-09-17T01:46:32.777440+0000","last_undegraded":"2024-09-17T01:46:32.777440+0000","last_fullsized":"2024-09-17T01:46:32.777440+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:32.363557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.6","version":"187'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425796+0000","last_change":"2024-09-17T01:46:30.412132+0000","last_active":"2024-09-17T01:46:32.425796+0000","last_peered":"2024-09-17T01:46:32.425796+0000","last_clean":"2024-09-17T01:46:32.425796+0000","last_became_active":"2024-09-17T01:46:30.411804+0000","last_became_peered":"2024-09-17T01:46:30.411804+0000","last_unstale":"2024-09-17T01:46:32.425796+0000","last_undegraded":"2024-09-17T01:46:32.425796+0000","last_fullsized":"2024-09-17T01:46:32.425796+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:25.842168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425575+0000","last_change":"2024-09-17T01:46:31.429507+0000","last_active":"2024-09-17T01:46:32.425575+0000","last_peered":"2024-09-17T01:46:32.425575+0000","last_clean":"2024-09-17T01:46:32.425575+0000","last_became_active":"2024-09-17T01:46:31.425532+0000","last_became_peered":"2024-09-17T01:46:31.425532+0000","last_unstale":"2024-09-17T01:46:32.425575+0000","last_undegraded":"2024-09-17T01:46:32.425575+0000","last_fullsized":"2024-09-17T01:46:32.425575+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:18.372344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777250+0000","last_change":"2024-09-17T01:46:30.418076+0000","last_active":"2024-09-17T01:46:32.777250+0000","last_peered":"2024-09-17T01:46:32.777250+0000","last_clean":"2024-09-17T01:46:32.777250+0000","last_became_active":"2024-09-17T01:46:30.417242+0000","last_became_peered":"2024-09-17T01:46:30.417242+0000","last_unstale":"2024-09-17T01:46:32.777250+0000","last_undegraded":"2024-09-17T01:46:32.777250+0000","last_fullsized":"2024-09-17T01:46:32.777250+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:33.506264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776177+0000","last_change":"2024-09-17T01:46:31.445495+0000","last_active":"2024-09-17T01:46:32.776177+0000","last_peered":"2024-09-17T01:46:32.776177+0000","last_clean":"2024-09-17T01:46:32.776177+0000","last_became_active":"2024-09-17T01:46:31.444572+0000","last_became_peered":"2024-09-17T01:46:31.444572+0000","last_unstale":"2024-09-17T01:46:32.776177+0000","last_undegraded":"2024-09-17T01:46:32.776177+0000","last_fullsized":"2024-09-17T01:46:32.776177+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:16.618396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776893+0000","last_change":"2024-09-17T01:46:30.422029+0000","last_active":"2024-09-17T01:46:32.776893+0000","last_peered":"2024-09-17T01:46:32.776893+0000","last_clean":"2024-09-17T01:46:32.776893+0000","last_became_active":"2024-09-17T01:46:30.421681+0000","last_became_peered":"2024-09-17T01:46:30.421681+0000","last_unstale":"2024-09-17T01:46:32.776893+0000","last_undegraded":"2024-09-17T01:46:32.776893+0000","last_fullsized":"2024-09-17T01:46:32.776893+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:09.520044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777330+0000","last_change":"2024-09-17T01:46:31.439442+0000","last_active":"2024-09-17T01:46:32.777330+0000","last_peered":"2024-09-17T01:46:32.777330+0000","last_clean":"2024-09-17T01:46:32.777330+0000","last_became_active":"2024-09-17T01:46:31.438915+0000","last_became_peered":"2024-09-17T01:46:31.438915+0000","last_unstale":"2024-09-17T01:46:32.777330+0000","last_undegraded":"2024-09-17T01:46:32.777330+0000","last_fullsized":"2024-09-17T01:46:32.777330+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:27.999899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775727+0000","last_change":"2024-09-17T01:46:30.419847+0000","last_active":"2024-09-17T01:46:32.775727+0000","last_peered":"2024-09-17T01:46:32.775727+0000","last_clean":"2024-09-17T01:46:32.775727+0000","last_became_active":"2024-09-17T01:46:30.419467+0000","last_became_peered":"2024-09-17T01:46:30.419467+0000","last_unstale":"2024-09-17T01:46:32.775727+0000","last_undegraded":"2024-09-17T01:46:32.775727+0000","last_fullsized":"2024-09-17T01:46:32.775727+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:38.792786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425447+0000","last_change":"2024-09-17T01:46:31.437996+0000","last_active":"2024-09-17T01:46:32.425447+0000","last_peered":"2024-09-17T01:46:32.425447+0000","last_clean":"2024-09-17T01:46:32.425447+0000","last_became_active":"2024-09-17T01:46:31.437135+0000","last_became_peered":"2024-09-17T01:46:31.437135+0000","last_unstale":"2024-09-17T01:46:32.425447+0000","last_undegraded":"2024-09-17T01:46:32.425447+0000","last_fullsized":"2024-09-17T01:46:32.425447+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:46.620491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428203+0000","last_change":"2024-09-17T01:46:30.426320+0000","last_active":"2024-09-17T01:46:32.428203+0000","last_peered":"2024-09-17T01:46:32.428203+0000","last_clean":"2024-09-17T01:46:32.428203+0000","last_became_active":"2024-09-17T01:46:30.425888+0000","last_became_peered":"2024-09-17T01:46:30.425888+0000","last_unstale":"2024-09-17T01:46:32.428203+0000","last_undegraded":"2024-09-17T01:46:32.428203+0000","last_fullsized":"2024-09-17T01:46:32.428203+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:42.270562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426663+0000","last_change":"2024-09-17T01:46:31.425903+0000","last_active":"2024-09-17T01:46:32.426663+0000","last_peered":"2024-09-17T01:46:32.426663+0000","last_clean":"2024-09-17T01:46:32.426663+0000","last_became_active":"2024-09-17T01:46:31.425503+0000","last_became_peered":"2024-09-17T01:46:31.425503+0000","last_unstale":"2024-09-17T01:46:32.426663+0000","last_undegraded":"2024-09-17T01:46:32.426663+0000","last_fullsized":"2024-09-17T01:46:32.426663+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:56.275736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775493+0000","last_change":"2024-09-17T01:46:30.422496+0000","last_active":"2024-09-17T01:46:32.775493+0000","last_peered":"2024-09-17T01:46:32.775493+0000","last_clean":"2024-09-17T01:46:32.775493+0000","last_became_active":"2024-09-17T01:46:30.422122+0000","last_became_peered":"2024-09-17T01:46:30.422122+0000","last_unstale":"2024-09-17T01:46:32.775493+0000","last_undegraded":"2024-09-17T01:46:32.775493+0000","last_fullsized":"2024-09-17T01:46:32.775493+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:23.170746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775911+0000","last_change":"2024-09-17T01:46:31.420520+0000","last_active":"2024-09-17T01:46:32.775911+0000","last_peered":"2024-09-17T01:46:32.775911+0000","last_clean":"2024-09-17T01:46:32.775911+0000","last_became_active":"2024-09-17T01:46:31.420133+0000","last_became_peered":"2024-09-17T01:46:31.420133+0000","last_unstale":"2024-09-17T01:46:32.775911+0000","last_undegraded":"2024-09-17T01:46:32.775911+0000","last_fullsized":"2024-09-17T01:46:32.775911+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:04.257713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775432+0000","last_change":"2024-09-17T01:46:30.426020+0000","last_active":"2024-09-17T01:46:32.775432+0000","last_peered":"2024-09-17T01:46:32.775432+0000","last_clean":"2024-09-17T01:46:32.775432+0000","last_became_active":"2024-09-17T01:46:30.425079+0000","last_became_peered":"2024-09-17T01:46:30.425079+0000","last_unstale":"2024-09-17T01:46:32.775432+0000","last_undegraded":"2024-09-17T01:46:32.775432+0000","last_fullsized":"2024-09-17T01:46:32.775432+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:42.283883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428011+0000","last_change":"2024-09-17T01:46:31.444278+0000","last_active":"2024-09-17T01:46:32.428011+0000","last_peered":"2024-09-17T01:46:32.428011+0000","last_clean":"2024-09-17T01:46:32.428011+0000","last_became_active":"2024-09-17T01:46:31.443518+0000","last_became_peered":"2024-09-17T01:46:31.443518+0000","last_unstale":"2024-09-17T01:46:32.428011+0000","last_undegraded":"2024-09-17T01:46:32.428011+0000","last_fullsized":"2024-09-17T01:46:32.428011+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:28.913481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1b","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425512+0000","last_change":"2024-09-17T01:46:30.412509+0000","last_active":"2024-09-17T01:46:32.425512+0000","last_peered":"2024-09-17T01:46:32.425512+0000","last_clean":"2024-09-17T01:46:32.425512+0000","last_became_active":"2024-09-17T01:46:30.412226+0000","last_became_peered":"2024-09-17T01:46:30.412226+0000","last_unstale":"2024-09-17T01:46:32.425512+0000","last_undegraded":"2024-09-17T01:46:32.425512+0000","last_fullsized":"2024-09-17T01:46:32.425512+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:49.989646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":427,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775556+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:46:32.775556+0000","last_peered":"2024-09-17T01:46:32.775556+0000","last_clean":"2024-09-17T01:46:32.775556+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:46:32.775556+0000","last_undegraded":"2024-09-17T01:46:32.775556+0000","last_fullsized":"2024-09-17T01:46:32.775556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476916,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47396,"kb_used_data":2312,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324444,"statfs":{"total":96636764160,"available":96588230656,"internally_reserved":0,"allocated":2367488,"data_stored":1039428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509619,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55700,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316140,"statfs":{"total":96636764160,"available":96579727360,"internally_reserved":0,"allocated":2351104,"data_stored":1037734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509618,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47372,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324468,"statfs":{"total":96636764160,"available":96588255232,"internally_reserved":0,"allocated":2351104,"data_stored":1037782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509619,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51540,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320300,"statfs":{"total":96636764160,"available":96583987200,"internally_reserved":0,"allocated":2351104,"data_stored":1037802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509619,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69532,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302308,"statfs":{"total":96636764160,"available":96565563392,"internally_reserved":0,"allocated":2359296,"data_stored":1039324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509618,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52116,"kb_used_data":2872,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319724,"statfs":{"total":96636764160,"available":96583397376,"internally_reserved":0,"allocated":2940928,"data_stored":1628080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509620,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59860,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311980,"statfs":{"total":96636764160,"available":96575467520,"internally_reserved":0,"allocated":2351104,"data_stored":1038294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":58915273},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542324,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52124,"kb_used_data":2888,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319716,"statfs":{"total":96636764160,"available":96583389184,"internally_reserved":0,"allocated":2957312,"data_stored":1628808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:46:40.972 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:46:41.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.215+0000 7f5b68c00640 1 -- 172.21.15.42:0/4013333391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b48004d90 msgr2=0x7f5b48005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:41.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.215+0000 7f5b68c00640 1 --2- 172.21.15.42:0/4013333391 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b48004d90 0x7f5b48005220 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f5b640d0e20 tx=0x7f5b48005830 comp rx=0 tx=0).stop 2024-09-17T01:46:41.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.215+0000 7f5b63e00640 1 -- 172.21.15.42:0/4013333391 reap_dead start 2024-09-17T01:46:41.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.215+0000 7f5b68c00640 1 -- 172.21.15.42:0/4013333391 shutdown_connections 2024-09-17T01:46:41.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.215+0000 7f5b68c00640 1 -- 172.21.15.42:0/4013333391 >> 172.21.15.42:0/4013333391 conn(0x7f5b640b25f0 msgr2=0x7f5b640d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:41.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.215+0000 7f5b68c00640 1 -- 172.21.15.42:0/4013333391 shutdown_connections 2024-09-17T01:46:41.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.215+0000 7f5b68c00640 1 -- 172.21.15.42:0/4013333391 wait complete. 2024-09-17T01:46:41.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.217+0000 7f5b68c00640 1 Processor -- start 2024-09-17T01:46:41.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.217+0000 7f5b68c00640 1 -- start start 2024-09-17T01:46:41.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.219+0000 7f5b68c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5b6414ae50 0x7f5b6414b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:41.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.219+0000 7f5b68c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b6414bb00 0x7f5b6415e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:41.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.219+0000 7f5b68c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b6415e710 0x7f5b640c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:41.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.219+0000 7f5b68c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6415d6b0 con 0x7f5b6414bb00 2024-09-17T01:46:41.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.219+0000 7f5b68c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5b640b4340 con 0x7f5b6415e710 2024-09-17T01:46:41.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.219+0000 7f5b68c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5b6415d830 con 0x7f5b6414ae50 2024-09-17T01:46:41.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.219+0000 7f5b5be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b6414bb00 0x7f5b6415e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:41.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.219+0000 7f5b5be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b6414bb00 0x7f5b6415e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46134/0 (socket says 172.21.15.42:46134) 2024-09-17T01:46:41.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.219+0000 7f5b5be00640 1 -- 172.21.15.42:0/2174987254 learned_addr learned my addr 172.21.15.42:0/2174987254 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:41.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.219+0000 7f5b63400640 1 --2- 172.21.15.42:0/2174987254 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5b6414ae50 0x7f5b6414b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:41.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.219+0000 7f5b63e00640 1 --2- 172.21.15.42:0/2174987254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b6415e710 0x7f5b640c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:41.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.219+0000 7f5b5be00640 1 -- 172.21.15.42:0/2174987254 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5b6414ae50 msgr2=0x7f5b6414b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:41.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.219+0000 7f5b5be00640 1 --2- 172.21.15.42:0/2174987254 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5b6414ae50 0x7f5b6414b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:41.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.219+0000 7f5b5be00640 1 -- 172.21.15.42:0/2174987254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b6415e710 msgr2=0x7f5b640c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:41.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.219+0000 7f5b5be00640 1 --2- 172.21.15.42:0/2174987254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b6415e710 0x7f5b640c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:41.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.219+0000 7f5b5be00640 1 -- 172.21.15.42:0/2174987254 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b6415eb20 con 0x7f5b6414bb00 2024-09-17T01:46:41.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.220+0000 7f5b5be00640 1 --2- 172.21.15.42:0/2174987254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b6414bb00 0x7f5b6415e1d0 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c004d90 tx=0x7f5b4c001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:41.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.220+0000 7f5b5b400640 1 -- 172.21.15.42:0/2174987254 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c0107d0 con 0x7f5b6414bb00 2024-09-17T01:46:41.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.220+0000 7f5b5b400640 1 -- 172.21.15.42:0/2174987254 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b4c010a80 con 0x7f5b6414bb00 2024-09-17T01:46:41.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.220+0000 7f5b68c00640 1 -- 172.21.15.42:0/2174987254 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b641e4ec0 con 0x7f5b6414bb00 2024-09-17T01:46:41.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.220+0000 7f5b5b400640 1 -- 172.21.15.42:0/2174987254 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c011460 con 0x7f5b6414bb00 2024-09-17T01:46:41.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.220+0000 7f5b68c00640 1 -- 172.21.15.42:0/2174987254 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b640cb3a0 con 0x7f5b6414bb00 2024-09-17T01:46:41.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.221+0000 7f5b68c00640 1 -- 172.21.15.42:0/2174987254 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b641537f0 con 0x7f5b6414bb00 2024-09-17T01:46:41.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.222+0000 7f5b5b400640 1 -- 172.21.15.42:0/2174987254 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5b4c011600 con 0x7f5b6414bb00 2024-09-17T01:46:41.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.223+0000 7f5b5b400640 1 --2- 172.21.15.42:0/2174987254 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5b40078b90 0x7f5b4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:41.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.224+0000 7f5b5b400640 1 -- 172.21.15.42:0/2174987254 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f5b4c09b750 con 0x7f5b6414bb00 2024-09-17T01:46:41.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.224+0000 7f5b63400640 1 --2- 172.21.15.42:0/2174987254 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5b40078b90 0x7f5b4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:41.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.225+0000 7f5b63400640 1 --2- 172.21.15.42:0/2174987254 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5b40078b90 0x7f5b4007b0a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f5b640767b0 tx=0x7f5b54005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:41.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.228+0000 7f5b5b400640 1 -- 172.21.15.42:0/2174987254 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5b6415eb20 con 0x7f5b6414bb00 2024-09-17T01:46:41.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.417+0000 7f5b68c00640 1 -- 172.21.15.42:0/2174987254 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5b640cedd0 con 0x7f5b40078b90 2024-09-17T01:46:41.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.422+0000 7f5b5b400640 1 -- 172.21.15.42:0/2174987254 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252370 (secure 0 0 0) 0x7f5b640cedd0 con 0x7f5b40078b90 2024-09-17T01:46:41.423 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:46:41.424 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:46:41.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.426+0000 7f5b68c00640 1 -- 172.21.15.42:0/2174987254 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5b40078b90 msgr2=0x7f5b4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:41.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.426+0000 7f5b68c00640 1 --2- 172.21.15.42:0/2174987254 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5b40078b90 0x7f5b4007b0a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f5b640767b0 tx=0x7f5b54005f90 comp rx=0 tx=0).stop 2024-09-17T01:46:41.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.426+0000 7f5b68c00640 1 -- 172.21.15.42:0/2174987254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b6414bb00 msgr2=0x7f5b6415e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:41.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.426+0000 7f5b68c00640 1 --2- 172.21.15.42:0/2174987254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b6414bb00 0x7f5b6415e1d0 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c004d90 tx=0x7f5b4c001800 comp rx=0 tx=0).stop 2024-09-17T01:46:41.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.426+0000 7f5b68c00640 1 -- 172.21.15.42:0/2174987254 shutdown_connections 2024-09-17T01:46:41.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.426+0000 7f5b68c00640 1 --2- 172.21.15.42:0/2174987254 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5b40078b90 0x7f5b4007b0a0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:41.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.426+0000 7f5b68c00640 1 --2- 172.21.15.42:0/2174987254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b6415e710 0x7f5b640c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:41.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.426+0000 7f5b68c00640 1 --2- 172.21.15.42:0/2174987254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b6414bb00 0x7f5b6415e1d0 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:41.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.426+0000 7f5b68c00640 1 --2- 172.21.15.42:0/2174987254 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5b6414ae50 0x7f5b6414b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:41.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.426+0000 7f5b68c00640 1 -- 172.21.15.42:0/2174987254 >> 172.21.15.42:0/2174987254 conn(0x7f5b640b25f0 msgr2=0x7f5b6409db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:41.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.426+0000 7f5b68c00640 1 -- 172.21.15.42:0/2174987254 shutdown_connections 2024-09-17T01:46:41.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.426+0000 7f5b68c00640 1 -- 172.21.15.42:0/2174987254 wait complete. 2024-09-17T01:46:41.451 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":624,"stamp":"2024-09-17T01:46:41.230658+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":435640,"kb_used_data":19560,"kb_used_omap":12,"kb_used_meta":415859,"kb_avail":754539080,"statfs":{"total":773094113280,"available":772648017920,"internally_reserved":0,"allocated":20029440,"data_stored":9487252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":425840180},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.821256"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777205+0000","last_change":"2024-09-17T01:46:31.449114+0000","last_active":"2024-09-17T01:46:32.777205+0000","last_peered":"2024-09-17T01:46:32.777205+0000","last_clean":"2024-09-17T01:46:32.777205+0000","last_became_active":"2024-09-17T01:46:31.444897+0000","last_became_peered":"2024-09-17T01:46:31.444897+0000","last_unstale":"2024-09-17T01:46:32.777205+0000","last_undegraded":"2024-09-17T01:46:32.777205+0000","last_fullsized":"2024-09-17T01:46:32.777205+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:10.122631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425679+0000","last_change":"2024-09-17T01:46:31.424827+0000","last_active":"2024-09-17T01:46:32.425679+0000","last_peered":"2024-09-17T01:46:32.425679+0000","last_clean":"2024-09-17T01:46:32.425679+0000","last_became_active":"2024-09-17T01:46:31.424256+0000","last_became_peered":"2024-09-17T01:46:31.424256+0000","last_unstale":"2024-09-17T01:46:32.425679+0000","last_undegraded":"2024-09-17T01:46:32.425679+0000","last_fullsized":"2024-09-17T01:46:32.425679+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:16.070389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428308+0000","last_change":"2024-09-17T01:46:31.440514+0000","last_active":"2024-09-17T01:46:32.428308+0000","last_peered":"2024-09-17T01:46:32.428308+0000","last_clean":"2024-09-17T01:46:32.428308+0000","last_became_active":"2024-09-17T01:46:31.439579+0000","last_became_peered":"2024-09-17T01:46:31.439579+0000","last_unstale":"2024-09-17T01:46:32.428308+0000","last_undegraded":"2024-09-17T01:46:32.428308+0000","last_fullsized":"2024-09-17T01:46:32.428308+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:43.542003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776158+0000","last_change":"2024-09-17T01:46:31.434326+0000","last_active":"2024-09-17T01:46:32.776158+0000","last_peered":"2024-09-17T01:46:32.776158+0000","last_clean":"2024-09-17T01:46:32.776158+0000","last_became_active":"2024-09-17T01:46:31.434028+0000","last_became_peered":"2024-09-17T01:46:31.434028+0000","last_unstale":"2024-09-17T01:46:32.776158+0000","last_undegraded":"2024-09-17T01:46:32.776158+0000","last_fullsized":"2024-09-17T01:46:32.776158+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:36.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428626+0000","last_change":"2024-09-17T01:46:31.444693+0000","last_active":"2024-09-17T01:46:32.428626+0000","last_peered":"2024-09-17T01:46:32.428626+0000","last_clean":"2024-09-17T01:46:32.428626+0000","last_became_active":"2024-09-17T01:46:31.444143+0000","last_became_peered":"2024-09-17T01:46:31.444143+0000","last_unstale":"2024-09-17T01:46:32.428626+0000","last_undegraded":"2024-09-17T01:46:32.428626+0000","last_fullsized":"2024-09-17T01:46:32.428626+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:19:45.427741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777290+0000","last_change":"2024-09-17T01:46:31.439648+0000","last_active":"2024-09-17T01:46:32.777290+0000","last_peered":"2024-09-17T01:46:32.777290+0000","last_clean":"2024-09-17T01:46:32.777290+0000","last_became_active":"2024-09-17T01:46:31.439317+0000","last_became_peered":"2024-09-17T01:46:31.439317+0000","last_unstale":"2024-09-17T01:46:32.777290+0000","last_undegraded":"2024-09-17T01:46:32.777290+0000","last_fullsized":"2024-09-17T01:46:32.777290+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:29.867513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776468+0000","last_change":"2024-09-17T01:46:31.446698+0000","last_active":"2024-09-17T01:46:32.776468+0000","last_peered":"2024-09-17T01:46:32.776468+0000","last_clean":"2024-09-17T01:46:32.776468+0000","last_became_active":"2024-09-17T01:46:31.446416+0000","last_became_peered":"2024-09-17T01:46:31.446416+0000","last_unstale":"2024-09-17T01:46:32.776468+0000","last_undegraded":"2024-09-17T01:46:32.776468+0000","last_fullsized":"2024-09-17T01:46:32.776468+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:32.837724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426360+0000","last_change":"2024-09-17T01:46:31.426666+0000","last_active":"2024-09-17T01:46:32.426360+0000","last_peered":"2024-09-17T01:46:32.426360+0000","last_clean":"2024-09-17T01:46:32.426360+0000","last_became_active":"2024-09-17T01:46:31.426352+0000","last_became_peered":"2024-09-17T01:46:31.426352+0000","last_unstale":"2024-09-17T01:46:32.426360+0000","last_undegraded":"2024-09-17T01:46:32.426360+0000","last_fullsized":"2024-09-17T01:46:32.426360+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:04.991154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.438892+0000","last_change":"2024-09-17T01:46:31.431902+0000","last_active":"2024-09-17T01:46:32.438892+0000","last_peered":"2024-09-17T01:46:32.438892+0000","last_clean":"2024-09-17T01:46:32.438892+0000","last_became_active":"2024-09-17T01:46:31.431538+0000","last_became_peered":"2024-09-17T01:46:31.431538+0000","last_unstale":"2024-09-17T01:46:32.438892+0000","last_undegraded":"2024-09-17T01:46:32.438892+0000","last_fullsized":"2024-09-17T01:46:32.438892+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:27.806016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428433+0000","last_change":"2024-09-17T01:46:31.438389+0000","last_active":"2024-09-17T01:46:32.428433+0000","last_peered":"2024-09-17T01:46:32.428433+0000","last_clean":"2024-09-17T01:46:32.428433+0000","last_became_active":"2024-09-17T01:46:31.437275+0000","last_became_peered":"2024-09-17T01:46:31.437275+0000","last_unstale":"2024-09-17T01:46:32.428433+0000","last_undegraded":"2024-09-17T01:46:32.428433+0000","last_fullsized":"2024-09-17T01:46:32.428433+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:12:42.193215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777056+0000","last_change":"2024-09-17T01:46:31.441613+0000","last_active":"2024-09-17T01:46:32.777056+0000","last_peered":"2024-09-17T01:46:32.777056+0000","last_clean":"2024-09-17T01:46:32.777056+0000","last_became_active":"2024-09-17T01:46:31.440235+0000","last_became_peered":"2024-09-17T01:46:31.440235+0000","last_unstale":"2024-09-17T01:46:32.777056+0000","last_undegraded":"2024-09-17T01:46:32.777056+0000","last_fullsized":"2024-09-17T01:46:32.777056+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:32.524306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775618+0000","last_change":"2024-09-17T01:46:31.416960+0000","last_active":"2024-09-17T01:46:32.775618+0000","last_peered":"2024-09-17T01:46:32.775618+0000","last_clean":"2024-09-17T01:46:32.775618+0000","last_became_active":"2024-09-17T01:46:31.416577+0000","last_became_peered":"2024-09-17T01:46:31.416577+0000","last_unstale":"2024-09-17T01:46:32.775618+0000","last_undegraded":"2024-09-17T01:46:32.775618+0000","last_fullsized":"2024-09-17T01:46:32.775618+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:52:25.962925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775387+0000","last_change":"2024-09-17T01:46:31.428536+0000","last_active":"2024-09-17T01:46:32.775387+0000","last_peered":"2024-09-17T01:46:32.775387+0000","last_clean":"2024-09-17T01:46:32.775387+0000","last_became_active":"2024-09-17T01:46:31.425769+0000","last_became_peered":"2024-09-17T01:46:31.425769+0000","last_unstale":"2024-09-17T01:46:32.775387+0000","last_undegraded":"2024-09-17T01:46:32.775387+0000","last_fullsized":"2024-09-17T01:46:32.775387+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:22:23.512532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775774+0000","last_change":"2024-09-17T01:46:31.427311+0000","last_active":"2024-09-17T01:46:32.775774+0000","last_peered":"2024-09-17T01:46:32.775774+0000","last_clean":"2024-09-17T01:46:32.775774+0000","last_became_active":"2024-09-17T01:46:31.426922+0000","last_became_peered":"2024-09-17T01:46:31.426922+0000","last_unstale":"2024-09-17T01:46:32.775774+0000","last_undegraded":"2024-09-17T01:46:32.775774+0000","last_fullsized":"2024-09-17T01:46:32.775774+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:28.913481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776459+0000","last_change":"2024-09-17T01:46:31.445995+0000","last_active":"2024-09-17T01:46:32.776459+0000","last_peered":"2024-09-17T01:46:32.776459+0000","last_clean":"2024-09-17T01:46:32.776459+0000","last_became_active":"2024-09-17T01:46:31.442444+0000","last_became_peered":"2024-09-17T01:46:31.442444+0000","last_unstale":"2024-09-17T01:46:32.776459+0000","last_undegraded":"2024-09-17T01:46:32.776459+0000","last_fullsized":"2024-09-17T01:46:32.776459+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:27.316162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776447+0000","last_change":"2024-09-17T01:46:31.432472+0000","last_active":"2024-09-17T01:46:32.776447+0000","last_peered":"2024-09-17T01:46:32.776447+0000","last_clean":"2024-09-17T01:46:32.776447+0000","last_became_active":"2024-09-17T01:46:31.431958+0000","last_became_peered":"2024-09-17T01:46:31.431958+0000","last_unstale":"2024-09-17T01:46:32.776447+0000","last_undegraded":"2024-09-17T01:46:32.776447+0000","last_fullsized":"2024-09-17T01:46:32.776447+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:44.766306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777329+0000","last_change":"2024-09-17T01:46:31.444639+0000","last_active":"2024-09-17T01:46:32.777329+0000","last_peered":"2024-09-17T01:46:32.777329+0000","last_clean":"2024-09-17T01:46:32.777329+0000","last_became_active":"2024-09-17T01:46:31.442591+0000","last_became_peered":"2024-09-17T01:46:31.442591+0000","last_unstale":"2024-09-17T01:46:32.777329+0000","last_undegraded":"2024-09-17T01:46:32.777329+0000","last_fullsized":"2024-09-17T01:46:32.777329+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:11.846706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428771+0000","last_change":"2024-09-17T01:46:31.434660+0000","last_active":"2024-09-17T01:46:32.428771+0000","last_peered":"2024-09-17T01:46:32.428771+0000","last_clean":"2024-09-17T01:46:32.428771+0000","last_became_active":"2024-09-17T01:46:31.434321+0000","last_became_peered":"2024-09-17T01:46:31.434321+0000","last_unstale":"2024-09-17T01:46:32.428771+0000","last_undegraded":"2024-09-17T01:46:32.428771+0000","last_fullsized":"2024-09-17T01:46:32.428771+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:11.153289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.429127+0000","last_change":"2024-09-17T01:46:31.439946+0000","last_active":"2024-09-17T01:46:32.429127+0000","last_peered":"2024-09-17T01:46:32.429127+0000","last_clean":"2024-09-17T01:46:32.429127+0000","last_became_active":"2024-09-17T01:46:31.439546+0000","last_became_peered":"2024-09-17T01:46:31.439546+0000","last_unstale":"2024-09-17T01:46:32.429127+0000","last_undegraded":"2024-09-17T01:46:32.429127+0000","last_fullsized":"2024-09-17T01:46:32.429127+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:05.120666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428283+0000","last_change":"2024-09-17T01:46:31.437213+0000","last_active":"2024-09-17T01:46:32.428283+0000","last_peered":"2024-09-17T01:46:32.428283+0000","last_clean":"2024-09-17T01:46:32.428283+0000","last_became_active":"2024-09-17T01:46:31.436423+0000","last_became_peered":"2024-09-17T01:46:31.436423+0000","last_unstale":"2024-09-17T01:46:32.428283+0000","last_undegraded":"2024-09-17T01:46:32.428283+0000","last_fullsized":"2024-09-17T01:46:32.428283+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:27.109581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776147+0000","last_change":"2024-09-17T01:46:31.427386+0000","last_active":"2024-09-17T01:46:32.776147+0000","last_peered":"2024-09-17T01:46:32.776147+0000","last_clean":"2024-09-17T01:46:32.776147+0000","last_became_active":"2024-09-17T01:46:31.425405+0000","last_became_peered":"2024-09-17T01:46:31.425405+0000","last_unstale":"2024-09-17T01:46:32.776147+0000","last_undegraded":"2024-09-17T01:46:32.776147+0000","last_fullsized":"2024-09-17T01:46:32.776147+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:43.277654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425441+0000","last_change":"2024-09-17T01:46:31.436812+0000","last_active":"2024-09-17T01:46:32.425441+0000","last_peered":"2024-09-17T01:46:32.425441+0000","last_clean":"2024-09-17T01:46:32.425441+0000","last_became_active":"2024-09-17T01:46:31.436297+0000","last_became_peered":"2024-09-17T01:46:31.436297+0000","last_unstale":"2024-09-17T01:46:32.425441+0000","last_undegraded":"2024-09-17T01:46:32.425441+0000","last_fullsized":"2024-09-17T01:46:32.425441+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:32:19.529698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775436+0000","last_change":"2024-09-17T01:46:31.423114+0000","last_active":"2024-09-17T01:46:32.775436+0000","last_peered":"2024-09-17T01:46:32.775436+0000","last_clean":"2024-09-17T01:46:32.775436+0000","last_became_active":"2024-09-17T01:46:31.422795+0000","last_became_peered":"2024-09-17T01:46:31.422795+0000","last_unstale":"2024-09-17T01:46:32.775436+0000","last_undegraded":"2024-09-17T01:46:32.775436+0000","last_fullsized":"2024-09-17T01:46:32.775436+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:07.226908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.438480+0000","last_change":"2024-09-17T01:46:31.434522+0000","last_active":"2024-09-17T01:46:32.438480+0000","last_peered":"2024-09-17T01:46:32.438480+0000","last_clean":"2024-09-17T01:46:32.438480+0000","last_became_active":"2024-09-17T01:46:31.432582+0000","last_became_peered":"2024-09-17T01:46:31.432582+0000","last_unstale":"2024-09-17T01:46:32.438480+0000","last_undegraded":"2024-09-17T01:46:32.438480+0000","last_fullsized":"2024-09-17T01:46:32.438480+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:39.833717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776072+0000","last_change":"2024-09-17T01:46:31.446218+0000","last_active":"2024-09-17T01:46:32.776072+0000","last_peered":"2024-09-17T01:46:32.776072+0000","last_clean":"2024-09-17T01:46:32.776072+0000","last_became_active":"2024-09-17T01:46:31.445885+0000","last_became_peered":"2024-09-17T01:46:31.445885+0000","last_unstale":"2024-09-17T01:46:32.776072+0000","last_undegraded":"2024-09-17T01:46:32.776072+0000","last_fullsized":"2024-09-17T01:46:32.776072+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:06.717241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427501+0000","last_change":"2024-09-17T01:46:31.426677+0000","last_active":"2024-09-17T01:46:32.427501+0000","last_peered":"2024-09-17T01:46:32.427501+0000","last_clean":"2024-09-17T01:46:32.427501+0000","last_became_active":"2024-09-17T01:46:31.425517+0000","last_became_peered":"2024-09-17T01:46:31.425517+0000","last_unstale":"2024-09-17T01:46:32.427501+0000","last_undegraded":"2024-09-17T01:46:32.427501+0000","last_fullsized":"2024-09-17T01:46:32.427501+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:31.981218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775884+0000","last_change":"2024-09-17T01:46:31.425570+0000","last_active":"2024-09-17T01:46:32.775884+0000","last_peered":"2024-09-17T01:46:32.775884+0000","last_clean":"2024-09-17T01:46:32.775884+0000","last_became_active":"2024-09-17T01:46:31.425256+0000","last_became_peered":"2024-09-17T01:46:31.425256+0000","last_unstale":"2024-09-17T01:46:32.775884+0000","last_undegraded":"2024-09-17T01:46:32.775884+0000","last_fullsized":"2024-09-17T01:46:32.775884+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:40.200273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427198+0000","last_change":"2024-09-17T01:46:31.422013+0000","last_active":"2024-09-17T01:46:32.427198+0000","last_peered":"2024-09-17T01:46:32.427198+0000","last_clean":"2024-09-17T01:46:32.427198+0000","last_became_active":"2024-09-17T01:46:31.421574+0000","last_became_peered":"2024-09-17T01:46:31.421574+0000","last_unstale":"2024-09-17T01:46:32.427198+0000","last_undegraded":"2024-09-17T01:46:32.427198+0000","last_fullsized":"2024-09-17T01:46:32.427198+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:13.432651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425439+0000","last_change":"2024-09-17T01:46:31.426049+0000","last_active":"2024-09-17T01:46:32.425439+0000","last_peered":"2024-09-17T01:46:32.425439+0000","last_clean":"2024-09-17T01:46:32.425439+0000","last_became_active":"2024-09-17T01:46:31.425700+0000","last_became_peered":"2024-09-17T01:46:31.425700+0000","last_unstale":"2024-09-17T01:46:32.425439+0000","last_undegraded":"2024-09-17T01:46:32.425439+0000","last_fullsized":"2024-09-17T01:46:32.425439+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:15.961268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775828+0000","last_change":"2024-09-17T01:46:31.445360+0000","last_active":"2024-09-17T01:46:32.775828+0000","last_peered":"2024-09-17T01:46:32.775828+0000","last_clean":"2024-09-17T01:46:32.775828+0000","last_became_active":"2024-09-17T01:46:31.445034+0000","last_became_peered":"2024-09-17T01:46:31.445034+0000","last_unstale":"2024-09-17T01:46:32.775828+0000","last_undegraded":"2024-09-17T01:46:32.775828+0000","last_fullsized":"2024-09-17T01:46:32.775828+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:18.585792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426826+0000","last_change":"2024-09-17T01:46:31.436801+0000","last_active":"2024-09-17T01:46:32.426826+0000","last_peered":"2024-09-17T01:46:32.426826+0000","last_clean":"2024-09-17T01:46:32.426826+0000","last_became_active":"2024-09-17T01:46:31.436442+0000","last_became_peered":"2024-09-17T01:46:31.436442+0000","last_unstale":"2024-09-17T01:46:32.426826+0000","last_undegraded":"2024-09-17T01:46:32.426826+0000","last_fullsized":"2024-09-17T01:46:32.426826+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:29.158716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776024+0000","last_change":"2024-09-17T01:46:31.435302+0000","last_active":"2024-09-17T01:46:32.776024+0000","last_peered":"2024-09-17T01:46:32.776024+0000","last_clean":"2024-09-17T01:46:32.776024+0000","last_became_active":"2024-09-17T01:46:31.435007+0000","last_became_peered":"2024-09-17T01:46:31.435007+0000","last_unstale":"2024-09-17T01:46:32.776024+0000","last_undegraded":"2024-09-17T01:46:32.776024+0000","last_fullsized":"2024-09-17T01:46:32.776024+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:06.685153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776762+0000","last_change":"2024-09-17T01:46:31.422309+0000","last_active":"2024-09-17T01:46:32.776762+0000","last_peered":"2024-09-17T01:46:32.776762+0000","last_clean":"2024-09-17T01:46:32.776762+0000","last_became_active":"2024-09-17T01:46:31.421687+0000","last_became_peered":"2024-09-17T01:46:31.421687+0000","last_unstale":"2024-09-17T01:46:32.776762+0000","last_undegraded":"2024-09-17T01:46:32.776762+0000","last_fullsized":"2024-09-17T01:46:32.776762+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:23.754735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1f","version":"186'4","reported_seq":19,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776472+0000","last_change":"2024-09-17T01:46:30.421999+0000","last_active":"2024-09-17T01:46:32.776472+0000","last_peered":"2024-09-17T01:46:32.776472+0000","last_clean":"2024-09-17T01:46:32.776472+0000","last_became_active":"2024-09-17T01:46:30.421444+0000","last_became_peered":"2024-09-17T01:46:30.421444+0000","last_unstale":"2024-09-17T01:46:32.776472+0000","last_undegraded":"2024-09-17T01:46:32.776472+0000","last_fullsized":"2024-09-17T01:46:32.776472+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:19:33.239539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776314+0000","last_change":"2024-09-17T01:46:31.436431+0000","last_active":"2024-09-17T01:46:32.776314+0000","last_peered":"2024-09-17T01:46:32.776314+0000","last_clean":"2024-09-17T01:46:32.776314+0000","last_became_active":"2024-09-17T01:46:31.436098+0000","last_became_peered":"2024-09-17T01:46:31.436098+0000","last_unstale":"2024-09-17T01:46:32.776314+0000","last_undegraded":"2024-09-17T01:46:32.776314+0000","last_fullsized":"2024-09-17T01:46:32.776314+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:10.579523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1e","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425770+0000","last_change":"2024-09-17T01:46:30.414291+0000","last_active":"2024-09-17T01:46:32.425770+0000","last_peered":"2024-09-17T01:46:32.425770+0000","last_clean":"2024-09-17T01:46:32.425770+0000","last_became_active":"2024-09-17T01:46:30.413782+0000","last_became_peered":"2024-09-17T01:46:30.413782+0000","last_unstale":"2024-09-17T01:46:32.425770+0000","last_undegraded":"2024-09-17T01:46:32.425770+0000","last_fullsized":"2024-09-17T01:46:32.425770+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:04.480361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428927+0000","last_change":"2024-09-17T01:46:31.435399+0000","last_active":"2024-09-17T01:46:32.428927+0000","last_peered":"2024-09-17T01:46:32.428927+0000","last_clean":"2024-09-17T01:46:32.428927+0000","last_became_active":"2024-09-17T01:46:31.434992+0000","last_became_peered":"2024-09-17T01:46:31.434992+0000","last_unstale":"2024-09-17T01:46:32.428927+0000","last_undegraded":"2024-09-17T01:46:32.428927+0000","last_fullsized":"2024-09-17T01:46:32.428927+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:50:55.804363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"186'2","reported_seq":17,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427047+0000","last_change":"2024-09-17T01:46:30.417874+0000","last_active":"2024-09-17T01:46:32.427047+0000","last_peered":"2024-09-17T01:46:32.427047+0000","last_clean":"2024-09-17T01:46:32.427047+0000","last_became_active":"2024-09-17T01:46:30.416190+0000","last_became_peered":"2024-09-17T01:46:30.416190+0000","last_unstale":"2024-09-17T01:46:32.427047+0000","last_undegraded":"2024-09-17T01:46:32.427047+0000","last_fullsized":"2024-09-17T01:46:32.427047+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:02.232021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428642+0000","last_change":"2024-09-17T01:46:31.443348+0000","last_active":"2024-09-17T01:46:32.428642+0000","last_peered":"2024-09-17T01:46:32.428642+0000","last_clean":"2024-09-17T01:46:32.428642+0000","last_became_active":"2024-09-17T01:46:31.439978+0000","last_became_peered":"2024-09-17T01:46:31.439978+0000","last_unstale":"2024-09-17T01:46:32.428642+0000","last_undegraded":"2024-09-17T01:46:32.428642+0000","last_fullsized":"2024-09-17T01:46:32.428642+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:30.533657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1c","version":"186'2","reported_seq":17,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776234+0000","last_change":"2024-09-17T01:46:30.419634+0000","last_active":"2024-09-17T01:46:32.776234+0000","last_peered":"2024-09-17T01:46:32.776234+0000","last_clean":"2024-09-17T01:46:32.776234+0000","last_became_active":"2024-09-17T01:46:30.419304+0000","last_became_peered":"2024-09-17T01:46:30.419304+0000","last_unstale":"2024-09-17T01:46:32.776234+0000","last_undegraded":"2024-09-17T01:46:32.776234+0000","last_fullsized":"2024-09-17T01:46:32.776234+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:05.285011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775650+0000","last_change":"2024-09-17T01:46:31.440666+0000","last_active":"2024-09-17T01:46:32.775650+0000","last_peered":"2024-09-17T01:46:32.775650+0000","last_clean":"2024-09-17T01:46:32.775650+0000","last_became_active":"2024-09-17T01:46:31.439118+0000","last_became_peered":"2024-09-17T01:46:31.439118+0000","last_unstale":"2024-09-17T01:46:32.775650+0000","last_undegraded":"2024-09-17T01:46:32.775650+0000","last_fullsized":"2024-09-17T01:46:32.775650+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:11.746299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777424+0000","last_change":"2024-09-17T01:46:30.424178+0000","last_active":"2024-09-17T01:46:32.777424+0000","last_peered":"2024-09-17T01:46:32.777424+0000","last_clean":"2024-09-17T01:46:32.777424+0000","last_became_active":"2024-09-17T01:46:30.423653+0000","last_became_peered":"2024-09-17T01:46:30.423653+0000","last_unstale":"2024-09-17T01:46:32.777424+0000","last_undegraded":"2024-09-17T01:46:32.777424+0000","last_fullsized":"2024-09-17T01:46:32.777424+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:01:57.156162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776415+0000","last_change":"2024-09-17T01:46:31.428613+0000","last_active":"2024-09-17T01:46:32.776415+0000","last_peered":"2024-09-17T01:46:32.776415+0000","last_clean":"2024-09-17T01:46:32.776415+0000","last_became_active":"2024-09-17T01:46:31.428070+0000","last_became_peered":"2024-09-17T01:46:31.428070+0000","last_unstale":"2024-09-17T01:46:32.776415+0000","last_undegraded":"2024-09-17T01:46:32.776415+0000","last_fullsized":"2024-09-17T01:46:32.776415+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:02.001662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426445+0000","last_change":"2024-09-17T01:46:30.419541+0000","last_active":"2024-09-17T01:46:32.426445+0000","last_peered":"2024-09-17T01:46:32.426445+0000","last_clean":"2024-09-17T01:46:32.426445+0000","last_became_active":"2024-09-17T01:46:30.417201+0000","last_became_peered":"2024-09-17T01:46:30.417201+0000","last_unstale":"2024-09-17T01:46:32.426445+0000","last_undegraded":"2024-09-17T01:46:32.426445+0000","last_fullsized":"2024-09-17T01:46:32.426445+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:53.835043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.438463+0000","last_change":"2024-09-17T01:46:31.435104+0000","last_active":"2024-09-17T01:46:32.438463+0000","last_peered":"2024-09-17T01:46:32.438463+0000","last_clean":"2024-09-17T01:46:32.438463+0000","last_became_active":"2024-09-17T01:46:31.434699+0000","last_became_peered":"2024-09-17T01:46:31.434699+0000","last_unstale":"2024-09-17T01:46:32.438463+0000","last_undegraded":"2024-09-17T01:46:32.438463+0000","last_fullsized":"2024-09-17T01:46:32.438463+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:47.650146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775314+0000","last_change":"2024-09-17T01:46:30.425424+0000","last_active":"2024-09-17T01:46:32.775314+0000","last_peered":"2024-09-17T01:46:32.775314+0000","last_clean":"2024-09-17T01:46:32.775314+0000","last_became_active":"2024-09-17T01:46:30.424776+0000","last_became_peered":"2024-09-17T01:46:30.424776+0000","last_unstale":"2024-09-17T01:46:32.775314+0000","last_undegraded":"2024-09-17T01:46:32.775314+0000","last_fullsized":"2024-09-17T01:46:32.775314+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:00.655765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776220+0000","last_change":"2024-09-17T01:46:31.445355+0000","last_active":"2024-09-17T01:46:32.776220+0000","last_peered":"2024-09-17T01:46:32.776220+0000","last_clean":"2024-09-17T01:46:32.776220+0000","last_became_active":"2024-09-17T01:46:31.445006+0000","last_became_peered":"2024-09-17T01:46:31.445006+0000","last_unstale":"2024-09-17T01:46:32.776220+0000","last_undegraded":"2024-09-17T01:46:32.776220+0000","last_fullsized":"2024-09-17T01:46:32.776220+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:00:48.418812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428717+0000","last_change":"2024-09-17T01:46:30.425233+0000","last_active":"2024-09-17T01:46:32.428717+0000","last_peered":"2024-09-17T01:46:32.428717+0000","last_clean":"2024-09-17T01:46:32.428717+0000","last_became_active":"2024-09-17T01:46:30.424688+0000","last_became_peered":"2024-09-17T01:46:30.424688+0000","last_unstale":"2024-09-17T01:46:32.428717+0000","last_undegraded":"2024-09-17T01:46:32.428717+0000","last_fullsized":"2024-09-17T01:46:32.428717+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:22.747644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775921+0000","last_change":"2024-09-17T01:46:31.433934+0000","last_active":"2024-09-17T01:46:32.775921+0000","last_peered":"2024-09-17T01:46:32.775921+0000","last_clean":"2024-09-17T01:46:32.775921+0000","last_became_active":"2024-09-17T01:46:31.433582+0000","last_became_peered":"2024-09-17T01:46:31.433582+0000","last_unstale":"2024-09-17T01:46:32.775921+0000","last_undegraded":"2024-09-17T01:46:32.775921+0000","last_fullsized":"2024-09-17T01:46:32.775921+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:12:49.719869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776319+0000","last_change":"2024-09-17T01:46:30.424629+0000","last_active":"2024-09-17T01:46:32.776319+0000","last_peered":"2024-09-17T01:46:32.776319+0000","last_clean":"2024-09-17T01:46:32.776319+0000","last_became_active":"2024-09-17T01:46:30.424304+0000","last_became_peered":"2024-09-17T01:46:30.424304+0000","last_unstale":"2024-09-17T01:46:32.776319+0000","last_undegraded":"2024-09-17T01:46:32.776319+0000","last_fullsized":"2024-09-17T01:46:32.776319+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:56:10.352036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.438685+0000","last_change":"2024-09-17T01:46:31.434138+0000","last_active":"2024-09-17T01:46:32.438685+0000","last_peered":"2024-09-17T01:46:32.438685+0000","last_clean":"2024-09-17T01:46:32.438685+0000","last_became_active":"2024-09-17T01:46:31.433033+0000","last_became_peered":"2024-09-17T01:46:31.433033+0000","last_unstale":"2024-09-17T01:46:32.438685+0000","last_undegraded":"2024-09-17T01:46:32.438685+0000","last_fullsized":"2024-09-17T01:46:32.438685+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:29.387003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.15","version":"186'3","reported_seq":18,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427149+0000","last_change":"2024-09-17T01:46:30.422242+0000","last_active":"2024-09-17T01:46:32.427149+0000","last_peered":"2024-09-17T01:46:32.427149+0000","last_clean":"2024-09-17T01:46:32.427149+0000","last_became_active":"2024-09-17T01:46:30.421844+0000","last_became_peered":"2024-09-17T01:46:30.421844+0000","last_unstale":"2024-09-17T01:46:32.427149+0000","last_undegraded":"2024-09-17T01:46:32.427149+0000","last_fullsized":"2024-09-17T01:46:32.427149+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:12.309630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426956+0000","last_change":"2024-09-17T01:46:31.428578+0000","last_active":"2024-09-17T01:46:32.426956+0000","last_peered":"2024-09-17T01:46:32.426956+0000","last_clean":"2024-09-17T01:46:32.426956+0000","last_became_active":"2024-09-17T01:46:31.428252+0000","last_became_peered":"2024-09-17T01:46:31.428252+0000","last_unstale":"2024-09-17T01:46:32.426956+0000","last_undegraded":"2024-09-17T01:46:32.426956+0000","last_fullsized":"2024-09-17T01:46:32.426956+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:59:35.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"186'6","reported_seq":21,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.438708+0000","last_change":"2024-09-17T01:46:30.422374+0000","last_active":"2024-09-17T01:46:32.438708+0000","last_peered":"2024-09-17T01:46:32.438708+0000","last_clean":"2024-09-17T01:46:32.438708+0000","last_became_active":"2024-09-17T01:46:30.421910+0000","last_became_peered":"2024-09-17T01:46:30.421910+0000","last_unstale":"2024-09-17T01:46:32.438708+0000","last_undegraded":"2024-09-17T01:46:32.438708+0000","last_fullsized":"2024-09-17T01:46:32.438708+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:33:54.169338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776007+0000","last_change":"2024-09-17T01:46:31.443892+0000","last_active":"2024-09-17T01:46:32.776007+0000","last_peered":"2024-09-17T01:46:32.776007+0000","last_clean":"2024-09-17T01:46:32.776007+0000","last_became_active":"2024-09-17T01:46:31.441114+0000","last_became_peered":"2024-09-17T01:46:31.441114+0000","last_unstale":"2024-09-17T01:46:32.776007+0000","last_undegraded":"2024-09-17T01:46:32.776007+0000","last_fullsized":"2024-09-17T01:46:32.776007+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:43.533425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.13","version":"186'2","reported_seq":17,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.438522+0000","last_change":"2024-09-17T01:46:30.423710+0000","last_active":"2024-09-17T01:46:32.438522+0000","last_peered":"2024-09-17T01:46:32.438522+0000","last_clean":"2024-09-17T01:46:32.438522+0000","last_became_active":"2024-09-17T01:46:30.423408+0000","last_became_peered":"2024-09-17T01:46:30.423408+0000","last_unstale":"2024-09-17T01:46:32.438522+0000","last_undegraded":"2024-09-17T01:46:32.438522+0000","last_fullsized":"2024-09-17T01:46:32.438522+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:51:21.497368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428962+0000","last_change":"2024-09-17T01:46:31.442692+0000","last_active":"2024-09-17T01:46:32.428962+0000","last_peered":"2024-09-17T01:46:32.428962+0000","last_clean":"2024-09-17T01:46:32.428962+0000","last_became_active":"2024-09-17T01:46:31.437975+0000","last_became_peered":"2024-09-17T01:46:31.437975+0000","last_unstale":"2024-09-17T01:46:32.428962+0000","last_undegraded":"2024-09-17T01:46:32.428962+0000","last_fullsized":"2024-09-17T01:46:32.428962+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:24.601060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425179+0000","last_change":"2024-09-17T01:46:30.417522+0000","last_active":"2024-09-17T01:46:32.425179+0000","last_peered":"2024-09-17T01:46:32.425179+0000","last_clean":"2024-09-17T01:46:32.425179+0000","last_became_active":"2024-09-17T01:46:30.417209+0000","last_became_peered":"2024-09-17T01:46:30.417209+0000","last_unstale":"2024-09-17T01:46:32.425179+0000","last_undegraded":"2024-09-17T01:46:32.425179+0000","last_fullsized":"2024-09-17T01:46:32.425179+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:15.260440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427083+0000","last_change":"2024-09-17T01:46:31.434934+0000","last_active":"2024-09-17T01:46:32.427083+0000","last_peered":"2024-09-17T01:46:32.427083+0000","last_clean":"2024-09-17T01:46:32.427083+0000","last_became_active":"2024-09-17T01:46:31.434566+0000","last_became_peered":"2024-09-17T01:46:31.434566+0000","last_unstale":"2024-09-17T01:46:32.427083+0000","last_undegraded":"2024-09-17T01:46:32.427083+0000","last_fullsized":"2024-09-17T01:46:32.427083+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:47.607553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426560+0000","last_change":"2024-09-17T01:46:30.404274+0000","last_active":"2024-09-17T01:46:32.426560+0000","last_peered":"2024-09-17T01:46:32.426560+0000","last_clean":"2024-09-17T01:46:32.426560+0000","last_became_active":"2024-09-17T01:46:30.403501+0000","last_became_peered":"2024-09-17T01:46:30.403501+0000","last_unstale":"2024-09-17T01:46:32.426560+0000","last_undegraded":"2024-09-17T01:46:32.426560+0000","last_fullsized":"2024-09-17T01:46:32.426560+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:51.012757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777176+0000","last_change":"2024-09-17T01:46:31.436778+0000","last_active":"2024-09-17T01:46:32.777176+0000","last_peered":"2024-09-17T01:46:32.777176+0000","last_clean":"2024-09-17T01:46:32.777176+0000","last_became_active":"2024-09-17T01:46:31.436441+0000","last_became_peered":"2024-09-17T01:46:31.436441+0000","last_unstale":"2024-09-17T01:46:32.777176+0000","last_undegraded":"2024-09-17T01:46:32.777176+0000","last_fullsized":"2024-09-17T01:46:32.777176+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:54.967884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.10","version":"186'8","reported_seq":23,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426761+0000","last_change":"2024-09-17T01:46:30.414504+0000","last_active":"2024-09-17T01:46:32.426761+0000","last_peered":"2024-09-17T01:46:32.426761+0000","last_clean":"2024-09-17T01:46:32.426761+0000","last_became_active":"2024-09-17T01:46:30.414064+0000","last_became_peered":"2024-09-17T01:46:30.414064+0000","last_unstale":"2024-09-17T01:46:32.426761+0000","last_undegraded":"2024-09-17T01:46:32.426761+0000","last_fullsized":"2024-09-17T01:46:32.426761+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:16.932888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776776+0000","last_change":"2024-09-17T01:46:31.420586+0000","last_active":"2024-09-17T01:46:32.776776+0000","last_peered":"2024-09-17T01:46:32.776776+0000","last_clean":"2024-09-17T01:46:32.776776+0000","last_became_active":"2024-09-17T01:46:31.420292+0000","last_became_peered":"2024-09-17T01:46:31.420292+0000","last_unstale":"2024-09-17T01:46:32.776776+0000","last_undegraded":"2024-09-17T01:46:32.776776+0000","last_fullsized":"2024-09-17T01:46:32.776776+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:19:40.212633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.f","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777536+0000","last_change":"2024-09-17T01:46:30.424539+0000","last_active":"2024-09-17T01:46:32.777536+0000","last_peered":"2024-09-17T01:46:32.777536+0000","last_clean":"2024-09-17T01:46:32.777536+0000","last_became_active":"2024-09-17T01:46:30.424219+0000","last_became_peered":"2024-09-17T01:46:30.424219+0000","last_unstale":"2024-09-17T01:46:32.777536+0000","last_undegraded":"2024-09-17T01:46:32.777536+0000","last_fullsized":"2024-09-17T01:46:32.777536+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:10.664092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776865+0000","last_change":"2024-09-17T01:46:31.440377+0000","last_active":"2024-09-17T01:46:32.776865+0000","last_peered":"2024-09-17T01:46:32.776865+0000","last_clean":"2024-09-17T01:46:32.776865+0000","last_became_active":"2024-09-17T01:46:31.439915+0000","last_became_peered":"2024-09-17T01:46:31.439915+0000","last_unstale":"2024-09-17T01:46:32.776865+0000","last_undegraded":"2024-09-17T01:46:32.776865+0000","last_fullsized":"2024-09-17T01:46:32.776865+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:33.599429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.e","version":"186'2","reported_seq":17,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.438764+0000","last_change":"2024-09-17T01:46:30.419672+0000","last_active":"2024-09-17T01:46:32.438764+0000","last_peered":"2024-09-17T01:46:32.438764+0000","last_clean":"2024-09-17T01:46:32.438764+0000","last_became_active":"2024-09-17T01:46:30.417927+0000","last_became_peered":"2024-09-17T01:46:30.417927+0000","last_unstale":"2024-09-17T01:46:32.438764+0000","last_undegraded":"2024-09-17T01:46:32.438764+0000","last_fullsized":"2024-09-17T01:46:32.438764+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:31.537991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428806+0000","last_change":"2024-09-17T01:46:31.437719+0000","last_active":"2024-09-17T01:46:32.428806+0000","last_peered":"2024-09-17T01:46:32.428806+0000","last_clean":"2024-09-17T01:46:32.428806+0000","last_became_active":"2024-09-17T01:46:31.436896+0000","last_became_peered":"2024-09-17T01:46:31.436896+0000","last_unstale":"2024-09-17T01:46:32.428806+0000","last_undegraded":"2024-09-17T01:46:32.428806+0000","last_fullsized":"2024-09-17T01:46:32.428806+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:51.651477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.d","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776068+0000","last_change":"2024-09-17T01:46:30.417554+0000","last_active":"2024-09-17T01:46:32.776068+0000","last_peered":"2024-09-17T01:46:32.776068+0000","last_clean":"2024-09-17T01:46:32.776068+0000","last_became_active":"2024-09-17T01:46:30.416047+0000","last_became_peered":"2024-09-17T01:46:30.416047+0000","last_unstale":"2024-09-17T01:46:32.776068+0000","last_undegraded":"2024-09-17T01:46:32.776068+0000","last_fullsized":"2024-09-17T01:46:32.776068+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:48:22.422721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776996+0000","last_change":"2024-09-17T01:46:31.432802+0000","last_active":"2024-09-17T01:46:32.776996+0000","last_peered":"2024-09-17T01:46:32.776996+0000","last_clean":"2024-09-17T01:46:32.776996+0000","last_became_active":"2024-09-17T01:46:31.431642+0000","last_became_peered":"2024-09-17T01:46:31.431642+0000","last_unstale":"2024-09-17T01:46:32.776996+0000","last_undegraded":"2024-09-17T01:46:32.776996+0000","last_fullsized":"2024-09-17T01:46:32.776996+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:08.595846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776725+0000","last_change":"2024-09-17T01:46:30.422016+0000","last_active":"2024-09-17T01:46:32.776725+0000","last_peered":"2024-09-17T01:46:32.776725+0000","last_clean":"2024-09-17T01:46:32.776725+0000","last_became_active":"2024-09-17T01:46:30.421643+0000","last_became_peered":"2024-09-17T01:46:30.421643+0000","last_unstale":"2024-09-17T01:46:32.776725+0000","last_undegraded":"2024-09-17T01:46:32.776725+0000","last_fullsized":"2024-09-17T01:46:32.776725+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:22.199090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428012+0000","last_change":"2024-09-17T01:46:31.433043+0000","last_active":"2024-09-17T01:46:32.428012+0000","last_peered":"2024-09-17T01:46:32.428012+0000","last_clean":"2024-09-17T01:46:32.428012+0000","last_became_active":"2024-09-17T01:46:31.432720+0000","last_became_peered":"2024-09-17T01:46:31.432720+0000","last_unstale":"2024-09-17T01:46:32.428012+0000","last_undegraded":"2024-09-17T01:46:32.428012+0000","last_fullsized":"2024-09-17T01:46:32.428012+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:57:32.671300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.b","version":"186'2","reported_seq":17,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775602+0000","last_change":"2024-09-17T01:46:30.405350+0000","last_active":"2024-09-17T01:46:32.775602+0000","last_peered":"2024-09-17T01:46:32.775602+0000","last_clean":"2024-09-17T01:46:32.775602+0000","last_became_active":"2024-09-17T01:46:30.404996+0000","last_became_peered":"2024-09-17T01:46:30.404996+0000","last_unstale":"2024-09-17T01:46:32.775602+0000","last_undegraded":"2024-09-17T01:46:32.775602+0000","last_fullsized":"2024-09-17T01:46:32.775602+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:58.482506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777051+0000","last_change":"2024-09-17T01:46:31.442677+0000","last_active":"2024-09-17T01:46:32.777051+0000","last_peered":"2024-09-17T01:46:32.777051+0000","last_clean":"2024-09-17T01:46:32.777051+0000","last_became_active":"2024-09-17T01:46:31.442347+0000","last_became_peered":"2024-09-17T01:46:31.442347+0000","last_unstale":"2024-09-17T01:46:32.777051+0000","last_undegraded":"2024-09-17T01:46:32.777051+0000","last_fullsized":"2024-09-17T01:46:32.777051+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:19.562731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426379+0000","last_change":"2024-09-17T01:46:30.412325+0000","last_active":"2024-09-17T01:46:32.426379+0000","last_peered":"2024-09-17T01:46:32.426379+0000","last_clean":"2024-09-17T01:46:32.426379+0000","last_became_active":"2024-09-17T01:46:30.412047+0000","last_became_peered":"2024-09-17T01:46:30.412047+0000","last_unstale":"2024-09-17T01:46:32.426379+0000","last_undegraded":"2024-09-17T01:46:32.426379+0000","last_fullsized":"2024-09-17T01:46:32.426379+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:54.073456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775239+0000","last_change":"2024-09-17T01:46:31.432167+0000","last_active":"2024-09-17T01:46:32.775239+0000","last_peered":"2024-09-17T01:46:32.775239+0000","last_clean":"2024-09-17T01:46:32.775239+0000","last_became_active":"2024-09-17T01:46:31.431789+0000","last_became_peered":"2024-09-17T01:46:31.431789+0000","last_unstale":"2024-09-17T01:46:32.775239+0000","last_undegraded":"2024-09-17T01:46:32.775239+0000","last_fullsized":"2024-09-17T01:46:32.775239+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:21.650118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426921+0000","last_change":"2024-09-17T01:46:30.427238+0000","last_active":"2024-09-17T01:46:32.426921+0000","last_peered":"2024-09-17T01:46:32.426921+0000","last_clean":"2024-09-17T01:46:32.426921+0000","last_became_active":"2024-09-17T01:46:30.426611+0000","last_became_peered":"2024-09-17T01:46:30.426611+0000","last_unstale":"2024-09-17T01:46:32.426921+0000","last_undegraded":"2024-09-17T01:46:32.426921+0000","last_fullsized":"2024-09-17T01:46:32.426921+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:15.611305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775673+0000","last_change":"2024-09-17T01:46:31.419791+0000","last_active":"2024-09-17T01:46:32.775673+0000","last_peered":"2024-09-17T01:46:32.775673+0000","last_clean":"2024-09-17T01:46:32.775673+0000","last_became_active":"2024-09-17T01:46:31.419473+0000","last_became_peered":"2024-09-17T01:46:31.419473+0000","last_unstale":"2024-09-17T01:46:32.775673+0000","last_undegraded":"2024-09-17T01:46:32.775673+0000","last_fullsized":"2024-09-17T01:46:32.775673+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:32.481643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426899+0000","last_change":"2024-09-17T01:46:30.420644+0000","last_active":"2024-09-17T01:46:32.426899+0000","last_peered":"2024-09-17T01:46:32.426899+0000","last_clean":"2024-09-17T01:46:32.426899+0000","last_became_active":"2024-09-17T01:46:30.420307+0000","last_became_peered":"2024-09-17T01:46:30.420307+0000","last_unstale":"2024-09-17T01:46:32.426899+0000","last_undegraded":"2024-09-17T01:46:32.426899+0000","last_fullsized":"2024-09-17T01:46:32.426899+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:00.872803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777003+0000","last_change":"2024-09-17T01:46:31.444744+0000","last_active":"2024-09-17T01:46:32.777003+0000","last_peered":"2024-09-17T01:46:32.777003+0000","last_clean":"2024-09-17T01:46:32.777003+0000","last_became_active":"2024-09-17T01:46:31.444375+0000","last_became_peered":"2024-09-17T01:46:31.444375+0000","last_unstale":"2024-09-17T01:46:32.777003+0000","last_undegraded":"2024-09-17T01:46:32.777003+0000","last_fullsized":"2024-09-17T01:46:32.777003+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:43.584917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.7","version":"186'2","reported_seq":17,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.427390+0000","last_change":"2024-09-17T01:46:30.425299+0000","last_active":"2024-09-17T01:46:32.427390+0000","last_peered":"2024-09-17T01:46:32.427390+0000","last_clean":"2024-09-17T01:46:32.427390+0000","last_became_active":"2024-09-17T01:46:30.424946+0000","last_became_peered":"2024-09-17T01:46:30.424946+0000","last_unstale":"2024-09-17T01:46:32.427390+0000","last_undegraded":"2024-09-17T01:46:32.427390+0000","last_fullsized":"2024-09-17T01:46:32.427390+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:28.876800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777440+0000","last_change":"2024-09-17T01:46:31.442936+0000","last_active":"2024-09-17T01:46:32.777440+0000","last_peered":"2024-09-17T01:46:32.777440+0000","last_clean":"2024-09-17T01:46:32.777440+0000","last_became_active":"2024-09-17T01:46:31.441624+0000","last_became_peered":"2024-09-17T01:46:31.441624+0000","last_unstale":"2024-09-17T01:46:32.777440+0000","last_undegraded":"2024-09-17T01:46:32.777440+0000","last_fullsized":"2024-09-17T01:46:32.777440+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:32.363557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.6","version":"187'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425796+0000","last_change":"2024-09-17T01:46:30.412132+0000","last_active":"2024-09-17T01:46:32.425796+0000","last_peered":"2024-09-17T01:46:32.425796+0000","last_clean":"2024-09-17T01:46:32.425796+0000","last_became_active":"2024-09-17T01:46:30.411804+0000","last_became_peered":"2024-09-17T01:46:30.411804+0000","last_unstale":"2024-09-17T01:46:32.425796+0000","last_undegraded":"2024-09-17T01:46:32.425796+0000","last_fullsized":"2024-09-17T01:46:32.425796+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:25.842168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425575+0000","last_change":"2024-09-17T01:46:31.429507+0000","last_active":"2024-09-17T01:46:32.425575+0000","last_peered":"2024-09-17T01:46:32.425575+0000","last_clean":"2024-09-17T01:46:32.425575+0000","last_became_active":"2024-09-17T01:46:31.425532+0000","last_became_peered":"2024-09-17T01:46:31.425532+0000","last_unstale":"2024-09-17T01:46:32.425575+0000","last_undegraded":"2024-09-17T01:46:32.425575+0000","last_fullsized":"2024-09-17T01:46:32.425575+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:18.372344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777250+0000","last_change":"2024-09-17T01:46:30.418076+0000","last_active":"2024-09-17T01:46:32.777250+0000","last_peered":"2024-09-17T01:46:32.777250+0000","last_clean":"2024-09-17T01:46:32.777250+0000","last_became_active":"2024-09-17T01:46:30.417242+0000","last_became_peered":"2024-09-17T01:46:30.417242+0000","last_unstale":"2024-09-17T01:46:32.777250+0000","last_undegraded":"2024-09-17T01:46:32.777250+0000","last_fullsized":"2024-09-17T01:46:32.777250+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:33.506264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776177+0000","last_change":"2024-09-17T01:46:31.445495+0000","last_active":"2024-09-17T01:46:32.776177+0000","last_peered":"2024-09-17T01:46:32.776177+0000","last_clean":"2024-09-17T01:46:32.776177+0000","last_became_active":"2024-09-17T01:46:31.444572+0000","last_became_peered":"2024-09-17T01:46:31.444572+0000","last_unstale":"2024-09-17T01:46:32.776177+0000","last_undegraded":"2024-09-17T01:46:32.776177+0000","last_fullsized":"2024-09-17T01:46:32.776177+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:16.618396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.776893+0000","last_change":"2024-09-17T01:46:30.422029+0000","last_active":"2024-09-17T01:46:32.776893+0000","last_peered":"2024-09-17T01:46:32.776893+0000","last_clean":"2024-09-17T01:46:32.776893+0000","last_became_active":"2024-09-17T01:46:30.421681+0000","last_became_peered":"2024-09-17T01:46:30.421681+0000","last_unstale":"2024-09-17T01:46:32.776893+0000","last_undegraded":"2024-09-17T01:46:32.776893+0000","last_fullsized":"2024-09-17T01:46:32.776893+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:09.520044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.777330+0000","last_change":"2024-09-17T01:46:31.439442+0000","last_active":"2024-09-17T01:46:32.777330+0000","last_peered":"2024-09-17T01:46:32.777330+0000","last_clean":"2024-09-17T01:46:32.777330+0000","last_became_active":"2024-09-17T01:46:31.438915+0000","last_became_peered":"2024-09-17T01:46:31.438915+0000","last_unstale":"2024-09-17T01:46:32.777330+0000","last_undegraded":"2024-09-17T01:46:32.777330+0000","last_fullsized":"2024-09-17T01:46:32.777330+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:27.999899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775727+0000","last_change":"2024-09-17T01:46:30.419847+0000","last_active":"2024-09-17T01:46:32.775727+0000","last_peered":"2024-09-17T01:46:32.775727+0000","last_clean":"2024-09-17T01:46:32.775727+0000","last_became_active":"2024-09-17T01:46:30.419467+0000","last_became_peered":"2024-09-17T01:46:30.419467+0000","last_unstale":"2024-09-17T01:46:32.775727+0000","last_undegraded":"2024-09-17T01:46:32.775727+0000","last_fullsized":"2024-09-17T01:46:32.775727+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:38.792786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425447+0000","last_change":"2024-09-17T01:46:31.437996+0000","last_active":"2024-09-17T01:46:32.425447+0000","last_peered":"2024-09-17T01:46:32.425447+0000","last_clean":"2024-09-17T01:46:32.425447+0000","last_became_active":"2024-09-17T01:46:31.437135+0000","last_became_peered":"2024-09-17T01:46:31.437135+0000","last_unstale":"2024-09-17T01:46:32.425447+0000","last_undegraded":"2024-09-17T01:46:32.425447+0000","last_fullsized":"2024-09-17T01:46:32.425447+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:46.620491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428203+0000","last_change":"2024-09-17T01:46:30.426320+0000","last_active":"2024-09-17T01:46:32.428203+0000","last_peered":"2024-09-17T01:46:32.428203+0000","last_clean":"2024-09-17T01:46:32.428203+0000","last_became_active":"2024-09-17T01:46:30.425888+0000","last_became_peered":"2024-09-17T01:46:30.425888+0000","last_unstale":"2024-09-17T01:46:32.428203+0000","last_undegraded":"2024-09-17T01:46:32.428203+0000","last_fullsized":"2024-09-17T01:46:32.428203+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:42.270562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.426663+0000","last_change":"2024-09-17T01:46:31.425903+0000","last_active":"2024-09-17T01:46:32.426663+0000","last_peered":"2024-09-17T01:46:32.426663+0000","last_clean":"2024-09-17T01:46:32.426663+0000","last_became_active":"2024-09-17T01:46:31.425503+0000","last_became_peered":"2024-09-17T01:46:31.425503+0000","last_unstale":"2024-09-17T01:46:32.426663+0000","last_undegraded":"2024-09-17T01:46:32.426663+0000","last_fullsized":"2024-09-17T01:46:32.426663+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:56.275736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775493+0000","last_change":"2024-09-17T01:46:30.422496+0000","last_active":"2024-09-17T01:46:32.775493+0000","last_peered":"2024-09-17T01:46:32.775493+0000","last_clean":"2024-09-17T01:46:32.775493+0000","last_became_active":"2024-09-17T01:46:30.422122+0000","last_became_peered":"2024-09-17T01:46:30.422122+0000","last_unstale":"2024-09-17T01:46:32.775493+0000","last_undegraded":"2024-09-17T01:46:32.775493+0000","last_fullsized":"2024-09-17T01:46:32.775493+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:23.170746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775911+0000","last_change":"2024-09-17T01:46:31.420520+0000","last_active":"2024-09-17T01:46:32.775911+0000","last_peered":"2024-09-17T01:46:32.775911+0000","last_clean":"2024-09-17T01:46:32.775911+0000","last_became_active":"2024-09-17T01:46:31.420133+0000","last_became_peered":"2024-09-17T01:46:31.420133+0000","last_unstale":"2024-09-17T01:46:32.775911+0000","last_undegraded":"2024-09-17T01:46:32.775911+0000","last_fullsized":"2024-09-17T01:46:32.775911+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:04.257713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":15,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775432+0000","last_change":"2024-09-17T01:46:30.426020+0000","last_active":"2024-09-17T01:46:32.775432+0000","last_peered":"2024-09-17T01:46:32.775432+0000","last_clean":"2024-09-17T01:46:32.775432+0000","last_became_active":"2024-09-17T01:46:30.425079+0000","last_became_peered":"2024-09-17T01:46:30.425079+0000","last_unstale":"2024-09-17T01:46:32.775432+0000","last_undegraded":"2024-09-17T01:46:32.775432+0000","last_fullsized":"2024-09-17T01:46:32.775432+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:42.283883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":13,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.428011+0000","last_change":"2024-09-17T01:46:31.444278+0000","last_active":"2024-09-17T01:46:32.428011+0000","last_peered":"2024-09-17T01:46:32.428011+0000","last_clean":"2024-09-17T01:46:32.428011+0000","last_became_active":"2024-09-17T01:46:31.443518+0000","last_became_peered":"2024-09-17T01:46:31.443518+0000","last_unstale":"2024-09-17T01:46:32.428011+0000","last_undegraded":"2024-09-17T01:46:32.428011+0000","last_fullsized":"2024-09-17T01:46:32.428011+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:30.391480+0000","last_clean_scrub_stamp":"2024-09-17T01:46:30.391480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:28.913481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1b","version":"186'1","reported_seq":16,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.425512+0000","last_change":"2024-09-17T01:46:30.412509+0000","last_active":"2024-09-17T01:46:32.425512+0000","last_peered":"2024-09-17T01:46:32.425512+0000","last_clean":"2024-09-17T01:46:32.425512+0000","last_became_active":"2024-09-17T01:46:30.412226+0000","last_became_peered":"2024-09-17T01:46:30.412226+0000","last_unstale":"2024-09-17T01:46:32.425512+0000","last_undegraded":"2024-09-17T01:46:32.425512+0000","last_fullsized":"2024-09-17T01:46:32.425512+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:46:29.384388+0000","last_clean_scrub_stamp":"2024-09-17T01:46:29.384388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:49.989646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":427,"reported_epoch":187,"state":"active+clean","last_fresh":"2024-09-17T01:46:32.775556+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:46:32.775556+0000","last_peered":"2024-09-17T01:46:32.775556+0000","last_clean":"2024-09-17T01:46:32.775556+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:46:32.775556+0000","last_undegraded":"2024-09-17T01:46:32.775556+0000","last_fullsized":"2024-09-17T01:46:32.775556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476917,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47396,"kb_used_data":2312,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324444,"statfs":{"total":96636764160,"available":96588230656,"internally_reserved":0,"allocated":2367488,"data_stored":1039428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509620,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55700,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316140,"statfs":{"total":96636764160,"available":96579727360,"internally_reserved":0,"allocated":2351104,"data_stored":1037734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509619,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47372,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324468,"statfs":{"total":96636764160,"available":96588255232,"internally_reserved":0,"allocated":2351104,"data_stored":1037782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509620,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51540,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320300,"statfs":{"total":96636764160,"available":96583987200,"internally_reserved":0,"allocated":2351104,"data_stored":1037802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509620,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69532,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302308,"statfs":{"total":96636764160,"available":96565563392,"internally_reserved":0,"allocated":2359296,"data_stored":1039324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509619,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52116,"kb_used_data":2872,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319724,"statfs":{"total":96636764160,"available":96583397376,"internally_reserved":0,"allocated":2940928,"data_stored":1628080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509621,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59860,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311980,"statfs":{"total":96636764160,"available":96575467520,"internally_reserved":0,"allocated":2351104,"data_stored":1038294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":58915273},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542325,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52124,"kb_used_data":2888,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319716,"statfs":{"total":96636764160,"available":96583389184,"internally_reserved":0,"allocated":2957312,"data_stored":1628808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:46:41.455 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T01:46:41.455 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T01:46:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.730+0000 7f0703e00640 1 -- 172.21.15.42:0/2994261972 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06e8004800 msgr2=0x7f06e8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.730+0000 7f0703e00640 1 --2- 172.21.15.42:0/2994261972 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06e8004800 0x7f06e8004c10 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f06f000c470 tx=0x7f06e8005830 comp rx=0 tx=0).stop 2024-09-17T01:46:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.730+0000 7f0703400640 1 -- 172.21.15.42:0/2994261972 reap_dead start 2024-09-17T01:46:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.731+0000 7f0703e00640 1 -- 172.21.15.42:0/2994261972 shutdown_connections 2024-09-17T01:46:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.731+0000 7f0703e00640 1 -- 172.21.15.42:0/2994261972 >> 172.21.15.42:0/2994261972 conn(0x7f07040b25f0 msgr2=0x7f07040d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.731+0000 7f0703e00640 1 -- 172.21.15.42:0/2994261972 shutdown_connections 2024-09-17T01:46:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.731+0000 7f0703e00640 1 -- 172.21.15.42:0/2994261972 wait complete. 2024-09-17T01:46:41.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.733+0000 7f0703e00640 1 Processor -- start 2024-09-17T01:46:41.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.733+0000 7f0703e00640 1 -- start start 2024-09-17T01:46:41.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.735+0000 7f0703e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06e8004800 0x7f0704149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:41.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.735+0000 7f0703e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0704072290 0x7f07040cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:41.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.735+0000 7f0703e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07040726a0 0x7f07040b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:41.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.735+0000 7f0703e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0704152ed0 con 0x7f06e8004800 2024-09-17T01:46:41.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.735+0000 7f0703e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f070406d640 con 0x7f07040726a0 2024-09-17T01:46:41.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.735+0000 7f0703e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0704153050 con 0x7f0704072290 2024-09-17T01:46:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.735+0000 7f0702a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06e8004800 0x7f0704149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.735+0000 7f0702a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06e8004800 0x7f0704149940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46144/0 (socket says 172.21.15.42:46144) 2024-09-17T01:46:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.735+0000 7f0702a00640 1 -- 172.21.15.42:0/2243160453 learned_addr learned my addr 172.21.15.42:0/2243160453 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.735+0000 7f0702000640 1 --2- 172.21.15.42:0/2243160453 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0704072290 0x7f07040cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.735+0000 7f0703400640 1 --2- 172.21.15.42:0/2243160453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07040726a0 0x7f07040b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.735+0000 7f0702a00640 1 -- 172.21.15.42:0/2243160453 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0704072290 msgr2=0x7f07040cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.735+0000 7f0702a00640 1 --2- 172.21.15.42:0/2243160453 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0704072290 0x7f07040cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.735+0000 7f0702a00640 1 -- 172.21.15.42:0/2243160453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07040726a0 msgr2=0x7f07040b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.735+0000 7f0702a00640 1 --2- 172.21.15.42:0/2243160453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07040726a0 0x7f07040b30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.735+0000 7f0702a00640 1 -- 172.21.15.42:0/2243160453 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07040ca620 con 0x7f06e8004800 2024-09-17T01:46:41.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.736+0000 7f0702a00640 1 --2- 172.21.15.42:0/2243160453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06e8004800 0x7f0704149940 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f06f4011b50 tx=0x7f06f400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:41.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.736+0000 7f06faa00640 1 -- 172.21.15.42:0/2243160453 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f401e070 con 0x7f06e8004800 2024-09-17T01:46:41.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.736+0000 7f06faa00640 1 -- 172.21.15.42:0/2243160453 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06f400e7c0 con 0x7f06e8004800 2024-09-17T01:46:41.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.736+0000 7f06faa00640 1 -- 172.21.15.42:0/2243160453 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f400ebb0 con 0x7f06e8004800 2024-09-17T01:46:41.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.736+0000 7f0703e00640 1 -- 172.21.15.42:0/2243160453 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07040ca900 con 0x7f06e8004800 2024-09-17T01:46:41.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.736+0000 7f0703e00640 1 -- 172.21.15.42:0/2243160453 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07040caec0 con 0x7f06e8004800 2024-09-17T01:46:41.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.737+0000 7f0703e00640 1 -- 172.21.15.42:0/2243160453 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f070415d6b0 con 0x7f06e8004800 2024-09-17T01:46:41.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.739+0000 7f06faa00640 1 -- 172.21.15.42:0/2243160453 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f06f4021070 con 0x7f06e8004800 2024-09-17T01:46:41.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.740+0000 7f06faa00640 1 --2- 172.21.15.42:0/2243160453 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f06e4078b90 0x7f06e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:41.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.740+0000 7f06faa00640 1 -- 172.21.15.42:0/2243160453 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f06f409bd50 con 0x7f06e8004800 2024-09-17T01:46:41.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.740+0000 7f0702000640 1 --2- 172.21.15.42:0/2243160453 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f06e4078b90 0x7f06e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:41.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.741+0000 7f0702000640 1 --2- 172.21.15.42:0/2243160453 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f06e4078b90 0x7f06e407b0a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f06f000c470 tx=0x7f070415cc30 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:41.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:41.744+0000 7f06faa00640 1 -- 172.21.15.42:0/2243160453 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f06f4063bc0 con 0x7f06e8004800 2024-09-17T01:46:42.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.012+0000 7f0703e00640 1 -- 172.21.15.42:0/2243160453 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f0704072b00 con 0x7f06e8004800 2024-09-17T01:46:42.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.016+0000 7f06faa00640 1 -- 172.21.15.42:0/2243160453 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v42) ==== 190+0+147 (secure 0 0 0) 0x7f06f40685f0 con 0x7f06e8004800 2024-09-17T01:46:42.017 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-09-17T01:46:42.017 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA== 2024-09-17T01:46:42.017 INFO:teuthology.orchestra.run.smithi042.stdout: caps mds = "allow" 2024-09-17T01:46:42.017 INFO:teuthology.orchestra.run.smithi042.stdout: caps mon = "allow r" 2024-09-17T01:46:42.017 INFO:teuthology.orchestra.run.smithi042.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T01:46:42.018 INFO:teuthology.orchestra.run.smithi042.stderr:updated caps for client.0 2024-09-17T01:46:42.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.019+0000 7f0703e00640 1 -- 172.21.15.42:0/2243160453 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f06e4078b90 msgr2=0x7f06e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:42.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.019+0000 7f0703e00640 1 --2- 172.21.15.42:0/2243160453 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f06e4078b90 0x7f06e407b0a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f06f000c470 tx=0x7f070415cc30 comp rx=0 tx=0).stop 2024-09-17T01:46:42.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.019+0000 7f0703e00640 1 -- 172.21.15.42:0/2243160453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06e8004800 msgr2=0x7f0704149940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:42.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.019+0000 7f0703e00640 1 --2- 172.21.15.42:0/2243160453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06e8004800 0x7f0704149940 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f06f4011b50 tx=0x7f06f400f790 comp rx=0 tx=0).stop 2024-09-17T01:46:42.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.019+0000 7f0703e00640 1 -- 172.21.15.42:0/2243160453 shutdown_connections 2024-09-17T01:46:42.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.019+0000 7f0703e00640 1 --2- 172.21.15.42:0/2243160453 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f06e4078b90 0x7f06e407b0a0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:42.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.019+0000 7f0703e00640 1 --2- 172.21.15.42:0/2243160453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07040726a0 0x7f07040b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:42.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.019+0000 7f0703e00640 1 --2- 172.21.15.42:0/2243160453 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0704072290 0x7f07040cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:42.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.019+0000 7f0703e00640 1 --2- 172.21.15.42:0/2243160453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06e8004800 0x7f0704149940 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:42.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.019+0000 7f0703e00640 1 -- 172.21.15.42:0/2243160453 >> 172.21.15.42:0/2243160453 conn(0x7f07040b25f0 msgr2=0x7f0704150bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:42.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.020+0000 7f0703e00640 1 -- 172.21.15.42:0/2243160453 shutdown_connections 2024-09-17T01:46:42.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.020+0000 7f0703e00640 1 -- 172.21.15.42:0/2243160453 wait complete. 2024-09-17T01:46:42.044 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:46:42.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.273+0000 7f4665000640 1 -- 172.21.15.42:0/974338413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46600cf230 msgr2=0x7f46600cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:42.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.273+0000 7f4665000640 1 --2- 172.21.15.42:0/974338413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46600cf230 0x7f46600cf640 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f46600b2e60 tx=0x7f464802a5f0 comp rx=0 tx=0).stop 2024-09-17T01:46:42.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.273+0000 7f4665000640 1 -- 172.21.15.42:0/974338413 shutdown_connections 2024-09-17T01:46:42.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.273+0000 7f4665000640 1 --2- 172.21.15.42:0/974338413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46600cf230 0x7f46600cf640 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:42.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.273+0000 7f4665000640 1 --2- 172.21.15.42:0/974338413 >> v2:172.21.15.43:3300/0 conn(0x7f466006cd20 0x7f466006d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:42.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.273+0000 7f4665000640 1 -- 172.21.15.42:0/974338413 >> 172.21.15.42:0/974338413 conn(0x7f46600b25f0 msgr2=0x7f46600d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:42.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.273+0000 7f4665000640 1 -- 172.21.15.42:0/974338413 shutdown_connections 2024-09-17T01:46:42.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.273+0000 7f4665000640 1 -- 172.21.15.42:0/974338413 wait complete. 2024-09-17T01:46:42.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.275+0000 7f4665000640 1 Processor -- start 2024-09-17T01:46:42.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.275+0000 7f4665000640 1 -- start start 2024-09-17T01:46:42.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.277+0000 7f4665000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f466006cd20 0x7f46600c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:42.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.277+0000 7f4665000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46600cf230 0x7f46600aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:42.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.277+0000 7f4665000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f466015e3c0 0x7f466015e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:42.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.277+0000 7f4665000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4660155120 con 0x7f46600cf230 2024-09-17T01:46:42.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.277+0000 7f4665000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f46600cfb80 con 0x7f466006cd20 2024-09-17T01:46:42.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.277+0000 7f4665000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f46601552a0 con 0x7f466015e3c0 2024-09-17T01:46:42.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.277+0000 7f4657e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46600cf230 0x7f46600aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:42.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.277+0000 7f4657e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46600cf230 0x7f46600aecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46154/0 (socket says 172.21.15.42:46154) 2024-09-17T01:46:42.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.277+0000 7f4657e00640 1 -- 172.21.15.42:0/1988159975 learned_addr learned my addr 172.21.15.42:0/1988159975 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:42.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.277+0000 7f465f400640 1 --2- 172.21.15.42:0/1988159975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f466006cd20 0x7f46600c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:42.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.277+0000 7f465fe00640 1 --2- 172.21.15.42:0/1988159975 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f466015e3c0 0x7f466015e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:42.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.278+0000 7f4657e00640 1 -- 172.21.15.42:0/1988159975 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f466015e3c0 msgr2=0x7f466015e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:42.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.278+0000 7f4657e00640 1 --2- 172.21.15.42:0/1988159975 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f466015e3c0 0x7f466015e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:42.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.278+0000 7f4657e00640 1 -- 172.21.15.42:0/1988159975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f466006cd20 msgr2=0x7f46600c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:42.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.278+0000 7f4657e00640 1 --2- 172.21.15.42:0/1988159975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f466006cd20 0x7f46600c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:42.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.278+0000 7f4657e00640 1 -- 172.21.15.42:0/1988159975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46601f5520 con 0x7f46600cf230 2024-09-17T01:46:42.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.278+0000 7f4657e00640 1 --2- 172.21.15.42:0/1988159975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46600cf230 0x7f46600aecd0 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f4648034040 tx=0x7f4648003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:42.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.278+0000 7f4657400640 1 -- 172.21.15.42:0/1988159975 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464803e030 con 0x7f46600cf230 2024-09-17T01:46:42.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.278+0000 7f4657400640 1 -- 172.21.15.42:0/1988159975 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4648003e00 con 0x7f46600cf230 2024-09-17T01:46:42.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.278+0000 7f4657400640 1 -- 172.21.15.42:0/1988159975 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4648035040 con 0x7f46600cf230 2024-09-17T01:46:42.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.278+0000 7f4665000640 1 -- 172.21.15.42:0/1988159975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46601f5800 con 0x7f46600cf230 2024-09-17T01:46:42.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.278+0000 7f4665000640 1 -- 172.21.15.42:0/1988159975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46601f5dc0 con 0x7f46600cf230 2024-09-17T01:46:42.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.279+0000 7f4665000640 1 -- 172.21.15.42:0/1988159975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4660150160 con 0x7f46600cf230 2024-09-17T01:46:42.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.281+0000 7f4657400640 1 -- 172.21.15.42:0/1988159975 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4648041030 con 0x7f46600cf230 2024-09-17T01:46:42.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.282+0000 7f4657400640 1 --2- 172.21.15.42:0/1988159975 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f463c078b90 0x7f463c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:42.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.282+0000 7f4657400640 1 -- 172.21.15.42:0/1988159975 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f46480bb4d0 con 0x7f46600cf230 2024-09-17T01:46:42.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.282+0000 7f465f400640 1 --2- 172.21.15.42:0/1988159975 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f463c078b90 0x7f463c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:42.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.283+0000 7f465f400640 1 --2- 172.21.15.42:0/1988159975 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f463c078b90 0x7f463c07b0a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f4650004630 tx=0x7f465000b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:42.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.286+0000 7f4657400640 1 -- 172.21.15.42:0/1988159975 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f46480832b0 con 0x7f46600cf230 2024-09-17T01:46:42.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.517+0000 7f4665000640 1 -- 172.21.15.42:0/1988159975 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f466006d130 con 0x7f46600cf230 2024-09-17T01:46:42.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.518+0000 7f4657400640 1 -- 172.21.15.42:0/1988159975 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 150 v150) ==== 95+0+5240 (secure 0 0 0) 0x7f4648087ce0 con 0x7f46600cf230 2024-09-17T01:46:42.516 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:46:42.516 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":150,"btime":"2024-09-17T01:46:34:429037+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8549,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4165093647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4165093647},{"type":"v1","addr":"172.21.15.43:6836","nonce":4165093647}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145},{"gid":10353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/4260984866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":4260984866},{"type":"v1","addr":"172.21.15.42:6834","nonce":4260984866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":10356,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2804168804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":2804168804},{"type":"v1","addr":"172.21.15.42:6835","nonce":2804168804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145}],"filesystems":[{"mdsmap":{"epoch":150,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:46:30.922674+0000","modified":"2024-09-17T01:46:33.938360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10371":{"gid":10371,"name":"b","rank":0,"incarnation":146,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/1477091047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1477091047},{"type":"v1","addr":"172.21.15.43:6837","nonce":1477091047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10371,"qdb_cluster":[10371]},"id":13}]} 2024-09-17T01:46:42.516 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 150 2024-09-17T01:46:42.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.520+0000 7f4665000640 1 -- 172.21.15.42:0/1988159975 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f463c078b90 msgr2=0x7f463c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:42.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.520+0000 7f4665000640 1 --2- 172.21.15.42:0/1988159975 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f463c078b90 0x7f463c07b0a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f4650004630 tx=0x7f465000b2e0 comp rx=0 tx=0).stop 2024-09-17T01:46:42.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.520+0000 7f4665000640 1 -- 172.21.15.42:0/1988159975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46600cf230 msgr2=0x7f46600aecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:42.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.520+0000 7f4665000640 1 --2- 172.21.15.42:0/1988159975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46600cf230 0x7f46600aecd0 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f4648034040 tx=0x7f4648003910 comp rx=0 tx=0).stop 2024-09-17T01:46:42.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.520+0000 7f4665000640 1 -- 172.21.15.42:0/1988159975 shutdown_connections 2024-09-17T01:46:42.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.520+0000 7f4665000640 1 --2- 172.21.15.42:0/1988159975 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f463c078b90 0x7f463c07b0a0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:42.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.520+0000 7f4665000640 1 --2- 172.21.15.42:0/1988159975 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f466015e3c0 0x7f466015e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:42.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.520+0000 7f4665000640 1 --2- 172.21.15.42:0/1988159975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46600cf230 0x7f46600aecd0 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:42.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.520+0000 7f4665000640 1 --2- 172.21.15.42:0/1988159975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f466006cd20 0x7f46600c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:42.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.520+0000 7f4665000640 1 -- 172.21.15.42:0/1988159975 >> 172.21.15.42:0/1988159975 conn(0x7f46600b25f0 msgr2=0x7f466015d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:42.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.520+0000 7f4665000640 1 -- 172.21.15.42:0/1988159975 shutdown_connections 2024-09-17T01:46:42.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:42.520+0000 7f4665000640 1 -- 172.21.15.42:0/1988159975 wait complete. 2024-09-17T01:46:42.947 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 150, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:46:30.922674+0000', 'modified': '2024-09-17T01:46:33.938360+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10371}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10371': {'gid': 10371, 'name': 'b', 'rank': 0, 'incarnation': 146, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.43:6837/1477091047', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 1477091047}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 1477091047}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [27], 'metadata_pool': 26, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10371, 'qdb_cluster': [10371]} 2024-09-17T01:46:42.947 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T01:46:42.947 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-17T01:46:43.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.179+0000 7f9711400640 1 -- 172.21.15.42:0/3496746564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96f00051c0 msgr2=0x7f96f000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:43.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.179+0000 7f9711400640 1 --2- 172.21.15.42:0/3496746564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96f00051c0 0x7f96f000b9c0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f970400c770 tx=0x7f96f0005830 comp rx=0 tx=0).stop 2024-09-17T01:46:43.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.179+0000 7f9711400640 1 -- 172.21.15.42:0/3496746564 shutdown_connections 2024-09-17T01:46:43.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.179+0000 7f9711400640 1 --2- 172.21.15.42:0/3496746564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96f00051c0 0x7f96f000b9c0 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.179+0000 7f9711400640 1 -- 172.21.15.42:0/3496746564 >> 172.21.15.42:0/3496746564 conn(0x7f970c0b25f0 msgr2=0x7f970c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:43.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.179+0000 7f9711400640 1 -- 172.21.15.42:0/3496746564 shutdown_connections 2024-09-17T01:46:43.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.179+0000 7f9711400640 1 -- 172.21.15.42:0/3496746564 wait complete. 2024-09-17T01:46:43.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.181+0000 7f9711400640 1 Processor -- start 2024-09-17T01:46:43.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.181+0000 7f9711400640 1 -- start start 2024-09-17T01:46:43.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.183+0000 7f9711400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f96f00051c0 0x7f970c072340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:43.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.183+0000 7f9711400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f970c072880 0x7f970c1f6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:43.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.183+0000 7f9711400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f970c1f6c90 0x7f970c1f70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:43.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.183+0000 7f9711400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f970c15da40 con 0x7f970c1f6c90 2024-09-17T01:46:43.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.183+0000 7f9711400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f970c15d8c0 con 0x7f970c072880 2024-09-17T01:46:43.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.183+0000 7f9711400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f970c06cd20 con 0x7f96f00051c0 2024-09-17T01:46:43.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.183+0000 7f9710a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f970c1f6c90 0x7f970c1f70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:43.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.183+0000 7f9710a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f970c1f6c90 0x7f970c1f70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46168/0 (socket says 172.21.15.42:46168) 2024-09-17T01:46:43.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.183+0000 7f9710a00640 1 -- 172.21.15.42:0/3418715460 learned_addr learned my addr 172.21.15.42:0/3418715460 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:43.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.183+0000 7f970be00640 1 --2- 172.21.15.42:0/3418715460 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f96f00051c0 0x7f970c072340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:43.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.183+0000 7f9703e00640 1 --2- 172.21.15.42:0/3418715460 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f970c072880 0x7f970c1f6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:43.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.183+0000 7f9710a00640 1 -- 172.21.15.42:0/3418715460 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f96f00051c0 msgr2=0x7f970c072340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:43.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.183+0000 7f9710a00640 1 --2- 172.21.15.42:0/3418715460 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f96f00051c0 0x7f970c072340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.183+0000 7f9710a00640 1 -- 172.21.15.42:0/3418715460 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f970c072880 msgr2=0x7f970c1f6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:43.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.183+0000 7f9710a00640 1 --2- 172.21.15.42:0/3418715460 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f970c072880 0x7f970c1f6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.183+0000 7f9710a00640 1 -- 172.21.15.42:0/3418715460 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970c1f75e0 con 0x7f970c1f6c90 2024-09-17T01:46:43.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.184+0000 7f9710a00640 1 --2- 172.21.15.42:0/3418715460 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f970c1f6c90 0x7f970c1f70a0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f970402b5f0 tx=0x7f9704003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:43.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.184+0000 7f9708c00640 1 -- 172.21.15.42:0/3418715460 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9704039070 con 0x7f970c1f6c90 2024-09-17T01:46:43.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.184+0000 7f9708c00640 1 -- 172.21.15.42:0/3418715460 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f970402ba30 con 0x7f970c1f6c90 2024-09-17T01:46:43.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.184+0000 7f9708c00640 1 -- 172.21.15.42:0/3418715460 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97040060d0 con 0x7f970c1f6c90 2024-09-17T01:46:43.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.184+0000 7f9711400640 1 -- 172.21.15.42:0/3418715460 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f970c073070 con 0x7f970c1f6c90 2024-09-17T01:46:43.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.184+0000 7f9711400640 1 -- 172.21.15.42:0/3418715460 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f970c073630 con 0x7f970c1f6c90 2024-09-17T01:46:43.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.187+0000 7f9708c00640 1 -- 172.21.15.42:0/3418715460 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f970403c070 con 0x7f970c1f6c90 2024-09-17T01:46:43.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.188+0000 7f9708c00640 1 --2- 172.21.15.42:0/3418715460 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f96e8078bc0 0x7f96e807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:43.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.188+0000 7f9708c00640 1 -- 172.21.15.42:0/3418715460 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f97040ba4f0 con 0x7f970c1f6c90 2024-09-17T01:46:43.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.188+0000 7f9719c38740 1 Processor -- start 2024-09-17T01:46:43.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.188+0000 7f970be00640 1 --2- 172.21.15.42:0/3418715460 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f96e8078bc0 0x7f96e807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:43.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.188+0000 7f9719c38740 1 -- start start 2024-09-17T01:46:43.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.189+0000 7f970be00640 1 --2- 172.21.15.42:0/3418715460 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f96e8078bc0 0x7f96e807b0d0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f96fc009bd0 tx=0x7f96fc005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:43.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.190+0000 7f9719c38740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f768270 0x557a9fb38b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:43.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.190+0000 7f9719c38740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557a9f73f3b0 0x557a9fb390a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:43.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.190+0000 7f9719c38740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a9f747590 0x557a9fb09150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:43.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.190+0000 7f9719c38740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557a9fa92430 con 0x557a9f768270 2024-09-17T01:46:43.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.190+0000 7f9719c38740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557a9fa825d0 con 0x557a9f747590 2024-09-17T01:46:43.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.190+0000 7f9719c38740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x557a9fa71a00 con 0x557a9f73f3b0 2024-09-17T01:46:43.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.190+0000 7f970be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f768270 0x557a9fb38b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:43.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.190+0000 7f970be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f768270 0x557a9fb38b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46176/0 (socket says 172.21.15.42:46176) 2024-09-17T01:46:43.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.190+0000 7f970be00640 1 -- 172.21.15.42:0/1179010769 learned_addr learned my addr 172.21.15.42:0/1179010769 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:43.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.190+0000 7f9703e00640 1 --2- 172.21.15.42:0/1179010769 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557a9f73f3b0 0x557a9fb390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:43.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.190+0000 7f9710a00640 1 --2- 172.21.15.42:0/1179010769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a9f747590 0x557a9fb09150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:43.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.190+0000 7f970be00640 1 -- 172.21.15.42:0/1179010769 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557a9f73f3b0 msgr2=0x557a9fb390a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:43.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.190+0000 7f970be00640 1 --2- 172.21.15.42:0/1179010769 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557a9f73f3b0 0x557a9fb390a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.190+0000 7f970be00640 1 -- 172.21.15.42:0/1179010769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a9f747590 msgr2=0x557a9fb09150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:43.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.190+0000 7f970be00640 1 --2- 172.21.15.42:0/1179010769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a9f747590 0x557a9fb09150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.190+0000 7f970be00640 1 -- 172.21.15.42:0/1179010769 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a9fa3a520 con 0x557a9f768270 2024-09-17T01:46:43.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.191+0000 7f970be00640 1 --2- 172.21.15.42:0/1179010769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f768270 0x557a9fb38b60 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f96fc0096d0 tx=0x7f96fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa04dcc6c26e72d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:43.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.191+0000 7f96fbe00640 1 -- 172.21.15.42:0/1179010769 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96fc003b70 con 0x557a9f768270 2024-09-17T01:46:43.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.191+0000 7f96fbe00640 1 -- 172.21.15.42:0/1179010769 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96fc003d10 con 0x557a9f768270 2024-09-17T01:46:43.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.191+0000 7f96fbe00640 1 -- 172.21.15.42:0/1179010769 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96fc005280 con 0x557a9f768270 2024-09-17T01:46:43.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.192+0000 7f9719c38740 1 -- 172.21.15.42:0/1179010769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f768270 msgr2=0x557a9fb38b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:43.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.192+0000 7f9719c38740 1 --2- 172.21.15.42:0/1179010769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f768270 0x557a9fb38b60 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f96fc0096d0 tx=0x7f96fc017000 comp rx=0 tx=0).stop 2024-09-17T01:46:43.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.192+0000 7f9719c38740 1 -- 172.21.15.42:0/1179010769 shutdown_connections 2024-09-17T01:46:43.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.192+0000 7f9719c38740 1 --2- 172.21.15.42:0/1179010769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a9f747590 0x557a9fb09150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.192+0000 7f9719c38740 1 --2- 172.21.15.42:0/1179010769 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557a9f73f3b0 0x557a9fb390a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.192+0000 7f9719c38740 1 --2- 172.21.15.42:0/1179010769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f768270 0x557a9fb38b60 unknown :-1 s=CLOSED pgs=2162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.192+0000 7f9719c38740 1 -- 172.21.15.42:0/1179010769 >> 172.21.15.42:0/1179010769 conn(0x557a9f75c3c0 msgr2=0x557a9fb0eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:43.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.192+0000 7f9719c38740 1 -- 172.21.15.42:0/1179010769 shutdown_connections 2024-09-17T01:46:43.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.192+0000 7f9719c38740 1 -- 172.21.15.42:0/1179010769 wait complete. 2024-09-17T01:46:43.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.193+0000 7f9719c38740 1 -- start start 2024-09-17T01:46:43.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.193+0000 7f9719c38740 1 Processor -- start 2024-09-17T01:46:43.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.195+0000 7f9719c38740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a9f73f3b0 0x557a9fb34db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:43.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.195+0000 7f9719c38740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557a9f747590 0x557a9fb63140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:43.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.195+0000 7f9719c38740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f768270 0x557a9fb311b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:43.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.195+0000 7f9719c38740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557a9fa18330 con 0x557a9f768270 2024-09-17T01:46:43.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.195+0000 7f9719c38740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557a9fa75810 con 0x557a9f73f3b0 2024-09-17T01:46:43.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.195+0000 7f9719c38740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x557a9f7e2620 con 0x557a9f747590 2024-09-17T01:46:43.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.195+0000 7f9719c38740 10 client.0 _ll_register_callbacks cb 0x557a9fa1d420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:46:43.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.195+0000 7f9710a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f768270 0x557a9fb311b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:43.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.195+0000 7f9710a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f768270 0x557a9fb311b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46182/0 (socket says 172.21.15.42:46182) 2024-09-17T01:46:43.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.195+0000 7f9710a00640 1 -- 172.21.15.42:0/3682597150 learned_addr learned my addr 172.21.15.42:0/3682597150 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:43.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.195+0000 7f9703e00640 1 --2- 172.21.15.42:0/3682597150 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557a9f747590 0x557a9fb63140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:43.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.195+0000 7f970be00640 1 --2- 172.21.15.42:0/3682597150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a9f73f3b0 0x557a9fb34db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:43.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.196+0000 7f9710a00640 1 -- 172.21.15.42:0/3682597150 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557a9f747590 msgr2=0x557a9fb63140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:43.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.196+0000 7f9710a00640 1 --2- 172.21.15.42:0/3682597150 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557a9f747590 0x557a9fb63140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.196+0000 7f9710a00640 1 -- 172.21.15.42:0/3682597150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a9f73f3b0 msgr2=0x557a9fb34db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:43.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.196+0000 7f9710a00640 1 --2- 172.21.15.42:0/3682597150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a9f73f3b0 0x557a9fb34db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.196+0000 7f9710a00640 1 -- 172.21.15.42:0/3682597150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a9f7d3850 con 0x557a9f768270 2024-09-17T01:46:43.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.196+0000 7f9710a00640 1 --2- 172.21.15.42:0/3682597150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f768270 0x557a9fb311b0 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f9704000f80 tx=0x7f970407e270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc09c570fadf4772 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:43.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.196+0000 7f96f8c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:46:43.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.196+0000 7f96f8c00640 1 -- 172.21.15.42:0/3682597150 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9704043040 con 0x557a9f768270 2024-09-17T01:46:43.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.196+0000 7f96f8c00640 1 -- 172.21.15.42:0/3682597150 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f970407dc50 con 0x557a9f768270 2024-09-17T01:46:43.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.196+0000 7f9719c38740 1 -- 172.21.15.42:0/3682597150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96fc003d10 con 0x557a9f768270 2024-09-17T01:46:43.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.197+0000 7f96f8c00640 1 -- 172.21.15.42:0/3682597150 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) ==== 24+0+0 (secure 0 0 0) 0x7f9704081e10 con 0x557a9f768270 2024-09-17T01:46:43.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.197+0000 7f9719c38740 10 client.10512 fetch_fsmap learned FSMap version 150 2024-09-17T01:46:43.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.197+0000 7f9719c38740 1 -- 172.21.15.42:0/3682597150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) -- 0x557a9f84a6b0 con 0x557a9f768270 2024-09-17T01:46:43.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.197+0000 7f96f8c00640 1 -- 172.21.15.42:0/3682597150 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96fc003d10 con 0x557a9f768270 2024-09-17T01:46:43.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.197+0000 7f96f8c00640 1 -- 172.21.15.42:0/3682597150 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 150) ==== 3502+0+0 (secure 0 0 0) 0x7f9704080fd0 con 0x557a9f768270 2024-09-17T01:46:43.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.197+0000 7f9719c38740 10 client.10512 fetch_fsmap finished waiting for FSMap version 150 2024-09-17T01:46:43.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.197+0000 7f9719c38740 10 client.10512 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T01:46:43.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.197+0000 7f9719c38740 20 client.10512 populate_metadata read hostname 'smithi042' 2024-09-17T01:46:43.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.197+0000 7f9719c38740 1 --2- 172.21.15.42:0/3682597150 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x557a9f726e40 0x557a9fb65f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:43.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.197+0000 7f9719c38740 4 client.10512 mds_command: new command op to 10371 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:46:43.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.197+0000 7f9719c38740 1 -- 172.21.15.42:0/3682597150 --> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a9fa84520 con 0x557a9f726e40 2024-09-17T01:46:43.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.197+0000 7f970be00640 1 --2- 172.21.15.42:0/3682597150 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x557a9f726e40 0x557a9fb65f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:43.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.198+0000 7f970be00640 1 --2- 172.21.15.42:0/3682597150 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x557a9f726e40 0x557a9fb65f90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=123d40d49de1cf49 server_cookie=c8453c1ed1ca5a3b in_seq=0 out_seq=0 2024-09-17T01:46:43.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.198+0000 7f96f8c00640 10 client.10512 ms_handle_connect on v2:172.21.15.43:6835/1477091047 2024-09-17T01:46:43.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.199+0000 7f96f8c00640 1 -- 172.21.15.42:0/3682597150 <== mds.0 v2:172.21.15.43:6835/1477091047 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557a9fa84520 con 0x557a9f726e40 2024-09-17T01:46:43.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.199+0000 7f96f8c00640 10 client.10512 handle_command_reply: tid=0 2024-09-17T01:46:43.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.199+0000 7f9719c38740 1 client.10512 shutdown 2024-09-17T01:46:43.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.200+0000 7f9719c38740 1 -- 172.21.15.42:0/3682597150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f768270 msgr2=0x557a9fb311b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:43.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.200+0000 7f9719c38740 1 --2- 172.21.15.42:0/3682597150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f768270 0x557a9fb311b0 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f9704000f80 tx=0x7f970407e270 comp rx=0 tx=0).stop 2024-09-17T01:46:43.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.200+0000 7f9719c38740 1 -- 172.21.15.42:0/3682597150 shutdown_connections 2024-09-17T01:46:43.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.200+0000 7f9719c38740 1 --2- 172.21.15.42:0/3682597150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f768270 0x557a9fb311b0 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.200+0000 7f9719c38740 1 --2- 172.21.15.42:0/3682597150 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557a9f747590 0x557a9fb63140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.200+0000 7f9719c38740 1 --2- 172.21.15.42:0/3682597150 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x557a9f726e40 0x557a9fb65f90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.200+0000 7f9719c38740 1 --2- 172.21.15.42:0/3682597150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a9f73f3b0 0x557a9fb34db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.200+0000 7f96f8c00640 0 client.10512 ms_handle_reset on v2:172.21.15.43:6835/1477091047 2024-09-17T01:46:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.200+0000 7f9719c38740 1 -- 172.21.15.42:0/3682597150 >> 172.21.15.42:0/3682597150 conn(0x557a9f75c3c0 msgr2=0x557a9fb38b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.200+0000 7f9719c38740 1 -- 172.21.15.42:0/3682597150 shutdown_connections 2024-09-17T01:46:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.200+0000 7f9719c38740 1 -- 172.21.15.42:0/3682597150 wait complete. 2024-09-17T01:46:43.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.200+0000 7f9719c38740 20 client.10512 trim_cache size 0 max 16384 2024-09-17T01:46:43.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.220+0000 7f9719c38740 1 Processor -- start 2024-09-17T01:46:43.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.220+0000 7f9719c38740 1 -- start start 2024-09-17T01:46:43.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.221+0000 7f9719c38740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f73f3b0 0x557a9fb0b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:43.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.221+0000 7f9719c38740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557a9f747590 0x557a9fb56830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:43.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.221+0000 7f9719c38740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a9f768270 0x557a9fb61fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:43.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.221+0000 7f9719c38740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f970c201120 con 0x557a9f73f3b0 2024-09-17T01:46:43.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.221+0000 7f9719c38740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f970c1f8e70 con 0x557a9f768270 2024-09-17T01:46:43.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.221+0000 7f9719c38740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f970c200b60 con 0x557a9f747590 2024-09-17T01:46:43.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.221+0000 7f970be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f73f3b0 0x557a9fb0b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:43.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.221+0000 7f970be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f73f3b0 0x557a9fb0b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46194/0 (socket says 172.21.15.42:46194) 2024-09-17T01:46:43.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.221+0000 7f970be00640 1 -- 172.21.15.42:0/3962729775 learned_addr learned my addr 172.21.15.42:0/3962729775 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:43.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.222+0000 7f9710a00640 1 --2- 172.21.15.42:0/3962729775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a9f768270 0x557a9fb61fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:43.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.222+0000 7f9703e00640 1 --2- 172.21.15.42:0/3962729775 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557a9f747590 0x557a9fb56830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:43.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.222+0000 7f970be00640 1 -- 172.21.15.42:0/3962729775 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557a9f747590 msgr2=0x557a9fb56830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:43.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.222+0000 7f970be00640 1 --2- 172.21.15.42:0/3962729775 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557a9f747590 0x557a9fb56830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.222+0000 7f970be00640 1 -- 172.21.15.42:0/3962729775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a9f768270 msgr2=0x557a9fb61fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:43.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.222+0000 7f970be00640 1 --2- 172.21.15.42:0/3962729775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a9f768270 0x557a9fb61fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.222+0000 7f970be00640 1 -- 172.21.15.42:0/3962729775 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a9fb0e350 con 0x557a9f73f3b0 2024-09-17T01:46:43.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.222+0000 7f9710a00640 1 --2- 172.21.15.42:0/3962729775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a9f768270 0x557a9fb61fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:43.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.222+0000 7f9703e00640 1 --2- 172.21.15.42:0/3962729775 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557a9f747590 0x557a9fb56830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:43.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.222+0000 7f970be00640 1 --2- 172.21.15.42:0/3962729775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f73f3b0 0x557a9fb0b430 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f96fc012a40 tx=0x7f96fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0c689ec9216480 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:43.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.222+0000 7f96fb400640 1 -- 172.21.15.42:0/3962729775 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96fc02d040 con 0x557a9f73f3b0 2024-09-17T01:46:43.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.222+0000 7f96fb400640 1 -- 172.21.15.42:0/3962729775 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96fc003cf0 con 0x557a9f73f3b0 2024-09-17T01:46:43.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.222+0000 7f96fb400640 1 -- 172.21.15.42:0/3962729775 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96fc01e6b0 con 0x557a9f73f3b0 2024-09-17T01:46:43.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.223+0000 7f9719c38740 1 -- 172.21.15.42:0/3962729775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f73f3b0 msgr2=0x557a9fb0b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:43.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.223+0000 7f9719c38740 1 --2- 172.21.15.42:0/3962729775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f73f3b0 0x557a9fb0b430 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f96fc012a40 tx=0x7f96fc004730 comp rx=0 tx=0).stop 2024-09-17T01:46:43.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.223+0000 7f9719c38740 1 -- 172.21.15.42:0/3962729775 shutdown_connections 2024-09-17T01:46:43.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.223+0000 7f9719c38740 1 --2- 172.21.15.42:0/3962729775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a9f768270 0x557a9fb61fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.223+0000 7f9719c38740 1 --2- 172.21.15.42:0/3962729775 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557a9f747590 0x557a9fb56830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.223+0000 7f9719c38740 1 --2- 172.21.15.42:0/3962729775 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f73f3b0 0x557a9fb0b430 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.223+0000 7f9719c38740 1 -- 172.21.15.42:0/3962729775 >> 172.21.15.42:0/3962729775 conn(0x557a9f75c3c0 msgr2=0x557a9fb0c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:43.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.223+0000 7f9719c38740 1 -- 172.21.15.42:0/3962729775 shutdown_connections 2024-09-17T01:46:43.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.223+0000 7f9719c38740 1 -- 172.21.15.42:0/3962729775 wait complete. 2024-09-17T01:46:43.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.224+0000 7f9719c38740 1 -- start start 2024-09-17T01:46:43.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.224+0000 7f9719c38740 1 Processor -- start 2024-09-17T01:46:43.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.226+0000 7f9719c38740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a9f73f3b0 0x557a9fb30980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:43.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.226+0000 7f9719c38740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557a9f747590 0x557a9fb4ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:43.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.226+0000 7f9719c38740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f768270 0x557a9fb33950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:43.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.226+0000 7f9719c38740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557a9fb62cc0 con 0x557a9f768270 2024-09-17T01:46:43.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.226+0000 7f9719c38740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557a9fa18330 con 0x557a9f73f3b0 2024-09-17T01:46:43.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.226+0000 7f9719c38740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x557a9fb32750 con 0x557a9f747590 2024-09-17T01:46:43.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.226+0000 7f9719c38740 10 client.0 _ll_register_callbacks cb 0x7f970407e1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:46:43.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.226+0000 7f9710a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f768270 0x557a9fb33950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:43.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.226+0000 7f9710a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f768270 0x557a9fb33950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46200/0 (socket says 172.21.15.42:46200) 2024-09-17T01:46:43.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.226+0000 7f9710a00640 1 -- 172.21.15.42:0/514097290 learned_addr learned my addr 172.21.15.42:0/514097290 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:43.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.226+0000 7f970be00640 1 --2- 172.21.15.42:0/514097290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a9f73f3b0 0x557a9fb30980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:43.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.226+0000 7f9703e00640 1 --2- 172.21.15.42:0/514097290 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557a9f747590 0x557a9fb4ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:43.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.227+0000 7f9710a00640 1 -- 172.21.15.42:0/514097290 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557a9f747590 msgr2=0x557a9fb4ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:43.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.227+0000 7f9710a00640 1 --2- 172.21.15.42:0/514097290 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557a9f747590 0x557a9fb4ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.227+0000 7f9710a00640 1 -- 172.21.15.42:0/514097290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a9f73f3b0 msgr2=0x557a9fb30980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:43.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.227+0000 7f9710a00640 1 --2- 172.21.15.42:0/514097290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a9f73f3b0 0x557a9fb30980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.227+0000 7f9710a00640 1 -- 172.21.15.42:0/514097290 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a9fb4b600 con 0x557a9f768270 2024-09-17T01:46:43.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.227+0000 7f9710a00640 1 --2- 172.21.15.42:0/514097290 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f768270 0x557a9fb33950 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f970407f570 tx=0x7f97040819a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef39d08fbc737f80 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:43.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.227+0000 7f96f8c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:46:43.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.227+0000 7f96f8c00640 1 -- 172.21.15.42:0/514097290 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97040ac020 con 0x557a9f768270 2024-09-17T01:46:43.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.227+0000 7f96f8c00640 1 -- 172.21.15.42:0/514097290 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f970409dd90 con 0x557a9f768270 2024-09-17T01:46:43.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.227+0000 7f9719c38740 1 -- 172.21.15.42:0/514097290 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96fc003cf0 con 0x557a9f768270 2024-09-17T01:46:43.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.227+0000 7f96f8c00640 1 -- 172.21.15.42:0/514097290 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) ==== 24+0+0 (secure 0 0 0) 0x7f9704043040 con 0x557a9f768270 2024-09-17T01:46:43.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.227+0000 7f9719c38740 10 client.10518 fetch_fsmap learned FSMap version 150 2024-09-17T01:46:43.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.227+0000 7f9719c38740 1 -- 172.21.15.42:0/514097290 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) -- 0x557a9fb4b600 con 0x557a9f768270 2024-09-17T01:46:43.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.228+0000 7f96f8c00640 1 -- 172.21.15.42:0/514097290 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96fc003cf0 con 0x557a9f768270 2024-09-17T01:46:43.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.228+0000 7f96f8c00640 1 -- 172.21.15.42:0/514097290 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 150) ==== 3502+0+0 (secure 0 0 0) 0x7f9704087ec0 con 0x557a9f768270 2024-09-17T01:46:43.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.228+0000 7f9719c38740 10 client.10518 fetch_fsmap finished waiting for FSMap version 150 2024-09-17T01:46:43.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.228+0000 7f9719c38740 10 client.10518 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T01:46:43.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.228+0000 7f9719c38740 20 client.10518 populate_metadata read hostname 'smithi042' 2024-09-17T01:46:43.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.228+0000 7f9719c38740 1 --2- 172.21.15.42:0/514097290 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x557a9fbd67b0 0x557a9fbd6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:43.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.228+0000 7f9719c38740 4 client.10518 mds_command: new command op to 10371 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T01:46:43.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.228+0000 7f9719c38740 1 -- 172.21.15.42:0/514097290 --> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] -- command(tid 0: {"prefix": "status"}) -- 0x557a9fa7ffd0 con 0x557a9fbd67b0 2024-09-17T01:46:43.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.228+0000 7f970be00640 1 --2- 172.21.15.42:0/514097290 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x557a9fbd67b0 0x557a9fbd6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:43.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.229+0000 7f970be00640 1 --2- 172.21.15.42:0/514097290 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x557a9fbd67b0 0x557a9fbd6bc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=442dbc141c77e650 server_cookie=6bcba29c5d14cd8e in_seq=0 out_seq=0 2024-09-17T01:46:43.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.229+0000 7f96f8c00640 10 client.10518 ms_handle_connect on v2:172.21.15.43:6835/1477091047 2024-09-17T01:46:43.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.229+0000 7f96f8c00640 1 -- 172.21.15.42:0/514097290 <== mds.0 v2:172.21.15.43:6835/1477091047 1 ==== command_reply(tid 0: 0 ) ==== 8+0+329 (crc 0 0 0) 0x557a9fa7ffd0 con 0x557a9fbd67b0 2024-09-17T01:46:43.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.229+0000 7f96f8c00640 10 client.10518 handle_command_reply: tid=0 2024-09-17T01:46:43.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.229+0000 7f9719c38740 1 client.10518 shutdown 2024-09-17T01:46:43.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.229+0000 7f9719c38740 1 -- 172.21.15.42:0/514097290 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f768270 msgr2=0x557a9fb33950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:43.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.229+0000 7f9719c38740 1 --2- 172.21.15.42:0/514097290 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f768270 0x557a9fb33950 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f970407f570 tx=0x7f97040819a0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.230+0000 7f9719c38740 1 -- 172.21.15.42:0/514097290 shutdown_connections 2024-09-17T01:46:43.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.230+0000 7f9719c38740 1 --2- 172.21.15.42:0/514097290 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557a9f768270 0x557a9fb33950 unknown :-1 s=CLOSED pgs=2165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.230+0000 7f9719c38740 1 --2- 172.21.15.42:0/514097290 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x557a9f747590 0x557a9fb4ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.230+0000 7f9719c38740 1 --2- 172.21.15.42:0/514097290 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x557a9fbd67b0 0x557a9fbd6bc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.230+0000 7f9719c38740 1 --2- 172.21.15.42:0/514097290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557a9f73f3b0 0x557a9fb30980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.230+0000 7f9719c38740 1 -- 172.21.15.42:0/514097290 >> 172.21.15.42:0/514097290 conn(0x557a9f75c3c0 msgr2=0x557a9fb56eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:43.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.230+0000 7f96f8c00640 0 client.10518 ms_handle_reset on v2:172.21.15.43:6835/1477091047 2024-09-17T01:46:43.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.230+0000 7f9719c38740 1 -- 172.21.15.42:0/514097290 shutdown_connections 2024-09-17T01:46:43.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.230+0000 7f9719c38740 1 -- 172.21.15.42:0/514097290 wait complete. 2024-09-17T01:46:43.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.230+0000 7f9719c38740 20 client.10518 trim_cache size 0 max 16384 2024-09-17T01:46:43.232 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:46:43.232 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "fea1c88c-cb05-432f-a745-f9dcbb5f2503", 2024-09-17T01:46:43.232 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-17T01:46:43.232 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 10371, 2024-09-17T01:46:43.232 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-17T01:46:43.232 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-17T01:46:43.232 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-17T01:46:43.232 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 11.812094262, 2024-09-17T01:46:43.232 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 150, 2024-09-17T01:46:43.232 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 187, 2024-09-17T01:46:43.232 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 187, 2024-09-17T01:46:43.232 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 16.762164478999999 2024-09-17T01:46:43.233 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:46:43.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.230+0000 7f9711400640 1 -- 172.21.15.42:0/3418715460 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f96e8078bc0 msgr2=0x7f96e807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:43.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.230+0000 7f9711400640 1 --2- 172.21.15.42:0/3418715460 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f96e8078bc0 0x7f96e807b0d0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f96fc009bd0 tx=0x7f96fc005f90 comp rx=0 tx=0).stop 2024-09-17T01:46:43.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.230+0000 7f9711400640 1 -- 172.21.15.42:0/3418715460 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f970c1f6c90 msgr2=0x7f970c1f70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:43.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.230+0000 7f9711400640 1 --2- 172.21.15.42:0/3418715460 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f970c1f6c90 0x7f970c1f70a0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f970402b5f0 tx=0x7f9704003970 comp rx=0 tx=0).stop 2024-09-17T01:46:43.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.231+0000 7f9711400640 1 -- 172.21.15.42:0/3418715460 shutdown_connections 2024-09-17T01:46:43.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.231+0000 7f9711400640 1 --2- 172.21.15.42:0/3418715460 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f96e8078bc0 0x7f96e807b0d0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.231+0000 7f9711400640 1 --2- 172.21.15.42:0/3418715460 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f970c072880 0x7f970c1f6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.231+0000 7f9711400640 1 --2- 172.21.15.42:0/3418715460 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f970c1f6c90 0x7f970c1f70a0 unknown :-1 s=CLOSED pgs=2161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.231+0000 7f9711400640 1 --2- 172.21.15.42:0/3418715460 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f96f00051c0 0x7f970c072340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.231+0000 7f9711400640 1 -- 172.21.15.42:0/3418715460 >> 172.21.15.42:0/3418715460 conn(0x7f970c0b25f0 msgr2=0x7f970c15fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:43.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.231+0000 7f9711400640 1 -- 172.21.15.42:0/3418715460 shutdown_connections 2024-09-17T01:46:43.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.231+0000 7f9711400640 1 -- 172.21.15.42:0/3418715460 wait complete. 2024-09-17T01:46:43.253 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T01:46:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.484+0000 7f51f9800640 1 -- 172.21.15.42:0/2664127824 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51f40b3550 msgr2=0x7f51f415cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.484+0000 7f51f9800640 1 --2- 172.21.15.42:0/2664127824 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51f40b3550 0x7f51f415cec0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f51e4005fd0 tx=0x7f51e402a540 comp rx=0 tx=0).stop 2024-09-17T01:46:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.484+0000 7f51f9800640 1 -- 172.21.15.42:0/2664127824 shutdown_connections 2024-09-17T01:46:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.484+0000 7f51f9800640 1 --2- 172.21.15.42:0/2664127824 >> v2:172.21.15.43:3300/0 conn(0x7f51f40cec40 0x7f51f40cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.484+0000 7f51f9800640 1 --2- 172.21.15.42:0/2664127824 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51f40b3550 0x7f51f415cec0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.484+0000 7f51f9800640 1 -- 172.21.15.42:0/2664127824 >> 172.21.15.42:0/2664127824 conn(0x7f51f40b2930 msgr2=0x7f51f406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.484+0000 7f51f9800640 1 -- 172.21.15.42:0/2664127824 shutdown_connections 2024-09-17T01:46:43.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.484+0000 7f51f9800640 1 -- 172.21.15.42:0/2664127824 wait complete. 2024-09-17T01:46:43.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.486+0000 7f51f9800640 1 Processor -- start 2024-09-17T01:46:43.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.486+0000 7f51f9800640 1 -- start start 2024-09-17T01:46:43.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.488+0000 7f51f9800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f40b3550 0x7f51f40ab030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:43.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.488+0000 7f51f9800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51f40cec40 0x7f51f40ab570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:43.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.488+0000 7f51f9800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f4142f40 0x7f51f40cc250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:43.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.488+0000 7f51f9800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f51f406d7c0 con 0x7f51f4142f40 2024-09-17T01:46:43.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.488+0000 7f51f9800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f51f406d640 con 0x7f51f40b3550 2024-09-17T01:46:43.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.488+0000 7f51f9800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f51f406d940 con 0x7f51f40cec40 2024-09-17T01:46:43.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.488+0000 7f51f3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f4142f40 0x7f51f40cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:43.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.488+0000 7f51f2a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f40b3550 0x7f51f40ab030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:43.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.488+0000 7f51f2a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f40b3550 0x7f51f40ab030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:40776/0 (socket says 172.21.15.42:40776) 2024-09-17T01:46:43.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.488+0000 7f51f2a00640 1 -- 172.21.15.42:0/668000850 learned_addr learned my addr 172.21.15.42:0/668000850 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:43.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.488+0000 7f51ebe00640 1 --2- 172.21.15.42:0/668000850 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51f40cec40 0x7f51f40ab570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:43.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.488+0000 7f51f3400640 1 -- 172.21.15.42:0/668000850 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51f40cec40 msgr2=0x7f51f40ab570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:43.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.488+0000 7f51f3400640 1 --2- 172.21.15.42:0/668000850 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51f40cec40 0x7f51f40ab570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.488+0000 7f51f3400640 1 -- 172.21.15.42:0/668000850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f40b3550 msgr2=0x7f51f40ab030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:43.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.488+0000 7f51f3400640 1 --2- 172.21.15.42:0/668000850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f40b3550 0x7f51f40ab030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.488+0000 7f51f3400640 1 -- 172.21.15.42:0/668000850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f40abdf0 con 0x7f51f4142f40 2024-09-17T01:46:43.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.488+0000 7f51f2a00640 1 --2- 172.21.15.42:0/668000850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f40b3550 0x7f51f40ab030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:46:43.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.489+0000 7f51f3400640 1 --2- 172.21.15.42:0/668000850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f4142f40 0x7f51f40cc250 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f51ec00e9b0 tx=0x7f51ec00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:43.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.489+0000 7f51eaa00640 1 -- 172.21.15.42:0/668000850 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec004d20 con 0x7f51f4142f40 2024-09-17T01:46:43.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.489+0000 7f51eaa00640 1 -- 172.21.15.42:0/668000850 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51ec00cb20 con 0x7f51f4142f40 2024-09-17T01:46:43.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.489+0000 7f51eaa00640 1 -- 172.21.15.42:0/668000850 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec005020 con 0x7f51f4142f40 2024-09-17T01:46:43.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.489+0000 7f51f9800640 1 -- 172.21.15.42:0/668000850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51f40ac0d0 con 0x7f51f4142f40 2024-09-17T01:46:43.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.489+0000 7f51f9800640 1 -- 172.21.15.42:0/668000850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51f40ac690 con 0x7f51f4142f40 2024-09-17T01:46:43.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.490+0000 7f51f9800640 1 -- 172.21.15.42:0/668000850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51f415cec0 con 0x7f51f4142f40 2024-09-17T01:46:43.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.492+0000 7f51eaa00640 1 -- 172.21.15.42:0/668000850 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f51ec0051c0 con 0x7f51f4142f40 2024-09-17T01:46:43.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.492+0000 7f51eaa00640 1 --2- 172.21.15.42:0/668000850 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f51d0078b90 0x7f51d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:43.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.493+0000 7f51eaa00640 1 -- 172.21.15.42:0/668000850 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f51ec09b990 con 0x7f51f4142f40 2024-09-17T01:46:43.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.493+0000 7f51f2a00640 1 --2- 172.21.15.42:0/668000850 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f51d0078b90 0x7f51d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:43.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.494+0000 7f51f2a00640 1 --2- 172.21.15.42:0/668000850 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f51d0078b90 0x7f51d007b0a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f51e4009230 tx=0x7f51e4004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:43.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.497+0000 7f51eaa00640 1 -- 172.21.15.42:0/668000850 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f51ec063770 con 0x7f51f4142f40 2024-09-17T01:46:43.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.731+0000 7f51f9800640 1 -- 172.21.15.42:0/668000850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f51f40abb80 con 0x7f51f4142f40 2024-09-17T01:46:43.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.731+0000 7f51eaa00640 1 -- 172.21.15.42:0/668000850 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v150) ==== 53+0+73 (secure 0 0 0) 0x7f51ec0681a0 con 0x7f51f4142f40 2024-09-17T01:46:43.729 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T01:46:43.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.734+0000 7f51f9800640 1 -- 172.21.15.42:0/668000850 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f51d0078b90 msgr2=0x7f51d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:43.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.734+0000 7f51f9800640 1 --2- 172.21.15.42:0/668000850 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f51d0078b90 0x7f51d007b0a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f51e4009230 tx=0x7f51e4004730 comp rx=0 tx=0).stop 2024-09-17T01:46:43.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.734+0000 7f51f9800640 1 -- 172.21.15.42:0/668000850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f4142f40 msgr2=0x7f51f40cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:43.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.734+0000 7f51f9800640 1 --2- 172.21.15.42:0/668000850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f4142f40 0x7f51f40cc250 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f51ec00e9b0 tx=0x7f51ec00ee70 comp rx=0 tx=0).stop 2024-09-17T01:46:43.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.734+0000 7f51f9800640 1 -- 172.21.15.42:0/668000850 shutdown_connections 2024-09-17T01:46:43.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.734+0000 7f51f9800640 1 --2- 172.21.15.42:0/668000850 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f51d0078b90 0x7f51d007b0a0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.734+0000 7f51f9800640 1 --2- 172.21.15.42:0/668000850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f51f4142f40 0x7f51f40cc250 unknown :-1 s=CLOSED pgs=2166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.734+0000 7f51f9800640 1 --2- 172.21.15.42:0/668000850 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f51f40cec40 0x7f51f40ab570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.734+0000 7f51f9800640 1 --2- 172.21.15.42:0/668000850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f40b3550 0x7f51f40ab030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:43.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.734+0000 7f51f9800640 1 -- 172.21.15.42:0/668000850 >> 172.21.15.42:0/668000850 conn(0x7f51f40b2930 msgr2=0x7f51f415ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:43.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.734+0000 7f51f9800640 1 -- 172.21.15.42:0/668000850 shutdown_connections 2024-09-17T01:46:43.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:43.734+0000 7f51f9800640 1 -- 172.21.15.42:0/668000850 wait complete. 2024-09-17T01:46:43.754 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T01:46:43.754 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:46:43.754 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-09-17T01:46:43.754 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T01:46:43.754 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:46:43.754 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T01:46:43.755 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T01:46:43.755 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:46:43.755 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:46:43.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:46:43.755 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-09-17T01:46:43.791 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:46:43.791 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:46:43.791 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:46:43.792 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:46:43.792 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-17T01:46:43.792 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:46:43.792 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:46:43.792 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-09-17T01:46:43.792 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-09-17T01:46:43.792 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:46:43.792 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-09-17T01:46:43.792 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-09-17T01:46:43.792 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:46:43.792 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:46:43.792 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-09-17T01:46:43.792 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-17T01:46:43.793 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 41804sec preferred_lft 41804sec 2024-09-17T01:46:43.793 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-17T01:46:43.793 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:46:43.793 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:46:43.793 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:46:43.793 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-09-17T01:46:43.793 INFO:teuthology.orchestra.run.smithi042.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T01:46:43.793 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T01:46:43.793 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T01:46:43.793 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:46:43.793 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::68d2:2bff:fe2f:191a/64 scope link 2024-09-17T01:46:43.794 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:46:43.794 INFO:teuthology.orchestra.run.smithi042.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:46:43.794 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether e2:73:3e:9b:8a:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:46:43.794 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::e073:3eff:fe9b:8a00/64 scope link 2024-09-17T01:46:43.794 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:46:43.794 INFO:teuthology.orchestra.run.smithi042.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:46:43.794 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T01:46:43.794 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::240b:bfff:feb7:6e5b/64 scope link 2024-09-17T01:46:43.794 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:46:43.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:46:43.795 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:46:43.885 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-17T01:46:43.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:46:43.889 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-09-17T01:46:43.924 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-09-17T01:46:43.924 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:46:43.924 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-17T01:46:43.924 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-17T01:46:43.924 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:46:43.925 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:46:43.925 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:46:43.925 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T01:46:43.925 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T01:46:43.925 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T01:46:43.925 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:46:44.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:46:44.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:46:44.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:46:44.124 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-17T01:46:44.160 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T01:46:44.160 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T01:46:44.161 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:46:44.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:46:44.161 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-09-17T01:46:44.257 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:46:44.257 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T01:46:44.292 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:46:44.292 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:46:44.292 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:46:44.367 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T01:46:44.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:46:44.368 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:46:44.567 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:46:44.680 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:46:44.681 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:46:44.683 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:46:44.684 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:46:44.684 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:46:44.685 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:46:44.685 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:46:44.685 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:46:44.685 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:46:44.686 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:46:44.686 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:46:44.686 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:46:44.688 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-09-17T01:46:44.688 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-09-17T01:46:44.688 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fea1c88c-cb05-432f-a745-f9dcbb5f2503" will pass to kernel 2024-09-17T01:46:44.688 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T01:46:44.689 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-09-17T01:46:44.689 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T01:46:44.689 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T01:46:44.689 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T01:46:44.690 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T01:46:44.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:46:44.690 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:46:44.749 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:46:44.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:46:44.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:46:44.850 INFO:teuthology.orchestra.run.smithi042.stdout:client10524 2024-09-17T01:46:44.850 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:46:44.850 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:46:44.886 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 damage ls 2024-09-17T01:46:45.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.159+0000 7f50bcc00640 1 -- 172.21.15.42:0/704919572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50b80b32b0 msgr2=0x7f50b80b36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:45.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.159+0000 7f50bcc00640 1 --2- 172.21.15.42:0/704919572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50b80b32b0 0x7f50b80b36c0 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f50b80703e0 tx=0x7f50b002a980 comp rx=0 tx=0).stop 2024-09-17T01:46:45.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.159+0000 7f50bcc00640 1 -- 172.21.15.42:0/704919572 shutdown_connections 2024-09-17T01:46:45.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.159+0000 7f50bcc00640 1 --2- 172.21.15.42:0/704919572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50b80b32b0 0x7f50b80b36c0 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.159+0000 7f50bcc00640 1 --2- 172.21.15.42:0/704919572 >> v2:172.21.15.43:3300/0 conn(0x7f50b80af910 0x7f50b80ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.159+0000 7f50bcc00640 1 -- 172.21.15.42:0/704919572 >> 172.21.15.42:0/704919572 conn(0x7f50b806d440 msgr2=0x7f50b80b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:45.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.159+0000 7f50bcc00640 1 -- 172.21.15.42:0/704919572 shutdown_connections 2024-09-17T01:46:45.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.159+0000 7f50bcc00640 1 -- 172.21.15.42:0/704919572 wait complete. 2024-09-17T01:46:45.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.161+0000 7f50bcc00640 1 Processor -- start 2024-09-17T01:46:45.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.161+0000 7f50bcc00640 1 -- start start 2024-09-17T01:46:45.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.163+0000 7f50bcc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50b80af910 0x7f50b80cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.163+0000 7f50bcc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50b80b32b0 0x7f50b814a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.163+0000 7f50bcc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50b815c6c0 0x7f50b815ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.163+0000 7f50bcc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f50b806e680 con 0x7f50b80b32b0 2024-09-17T01:46:45.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.163+0000 7f50bcc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f50b806e500 con 0x7f50b80af910 2024-09-17T01:46:45.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.163+0000 7f50bcc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f50b806e800 con 0x7f50b815c6c0 2024-09-17T01:46:45.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.163+0000 7f50aea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50b80b32b0 0x7f50b814a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.163+0000 7f50aea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50b80b32b0 0x7f50b814a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46228/0 (socket says 172.21.15.42:46228) 2024-09-17T01:46:45.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.163+0000 7f50aea00640 1 -- 172.21.15.42:0/3317042568 learned_addr learned my addr 172.21.15.42:0/3317042568 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:45.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.164+0000 7f50b7e00640 1 --2- 172.21.15.42:0/3317042568 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50b815c6c0 0x7f50b815ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.164+0000 7f50b7400640 1 --2- 172.21.15.42:0/3317042568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50b80af910 0x7f50b80cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.164+0000 7f50aea00640 1 -- 172.21.15.42:0/3317042568 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50b815c6c0 msgr2=0x7f50b815ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:45.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.164+0000 7f50aea00640 1 --2- 172.21.15.42:0/3317042568 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50b815c6c0 0x7f50b815ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.164+0000 7f50aea00640 1 -- 172.21.15.42:0/3317042568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50b80af910 msgr2=0x7f50b80cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:45.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.164+0000 7f50aea00640 1 --2- 172.21.15.42:0/3317042568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50b80af910 0x7f50b80cbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.164+0000 7f50aea00640 1 -- 172.21.15.42:0/3317042568 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b80cc2a0 con 0x7f50b80b32b0 2024-09-17T01:46:45.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.164+0000 7f50b7e00640 1 --2- 172.21.15.42:0/3317042568 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50b815c6c0 0x7f50b815ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:45.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.164+0000 7f50aea00640 1 --2- 172.21.15.42:0/3317042568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50b80b32b0 0x7f50b814a780 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f50a000b3e0 tx=0x7f50a000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:45.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.164+0000 7f50afe00640 1 -- 172.21.15.42:0/3317042568 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a0015020 con 0x7f50b80b32b0 2024-09-17T01:46:45.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.165+0000 7f50afe00640 1 -- 172.21.15.42:0/3317042568 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50a0011920 con 0x7f50b80b32b0 2024-09-17T01:46:45.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.165+0000 7f50bcc00640 1 -- 172.21.15.42:0/3317042568 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50b814acc0 con 0x7f50b80b32b0 2024-09-17T01:46:45.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.165+0000 7f50afe00640 1 -- 172.21.15.42:0/3317042568 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a0011d70 con 0x7f50b80b32b0 2024-09-17T01:46:45.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.165+0000 7f50bcc00640 1 -- 172.21.15.42:0/3317042568 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50b80ae230 con 0x7f50b80b32b0 2024-09-17T01:46:45.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.168+0000 7f50afe00640 1 -- 172.21.15.42:0/3317042568 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f50a0018020 con 0x7f50b80b32b0 2024-09-17T01:46:45.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.169+0000 7f50afe00640 1 --2- 172.21.15.42:0/3317042568 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5094078b90 0x7f509407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.169+0000 7f50c51f7740 1 Processor -- start 2024-09-17T01:46:45.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.169+0000 7f50afe00640 1 -- 172.21.15.42:0/3317042568 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f50a009ad20 con 0x7f50b80b32b0 2024-09-17T01:46:45.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.169+0000 7f50c51f7740 1 -- start start 2024-09-17T01:46:45.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.169+0000 7f50b7400640 1 --2- 172.21.15.42:0/3317042568 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5094078b90 0x7f509407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.170+0000 7f50b7400640 1 --2- 172.21.15.42:0/3317042568 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5094078b90 0x7f509407b0a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f50a8005fd0 tx=0x7f50a8005850 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:45.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.170+0000 7f50c51f7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a8946390 0x5638a8d35280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.170+0000 7f50c51f7740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638a891d4d0 0x5638a8d17f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.170+0000 7f50c51f7740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638a89256b0 0x5638a8d18490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.170+0000 7f50c51f7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5638a8c606f0 con 0x5638a8946390 2024-09-17T01:46:45.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.170+0000 7f50c51f7740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5638a8c4fb20 con 0x5638a891d4d0 2024-09-17T01:46:45.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.170+0000 7f50c51f7740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5638a8c53930 con 0x5638a89256b0 2024-09-17T01:46:45.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.171+0000 7f50b7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a8946390 0x5638a8d35280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.171+0000 7f50b7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a8946390 0x5638a8d35280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46242/0 (socket says 172.21.15.42:46242) 2024-09-17T01:46:45.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.171+0000 7f50b7400640 1 -- 172.21.15.42:0/893065286 learned_addr learned my addr 172.21.15.42:0/893065286 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:45.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.171+0000 7f50aea00640 1 --2- 172.21.15.42:0/893065286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638a891d4d0 0x5638a8d17f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.171+0000 7f50b7e00640 1 --2- 172.21.15.42:0/893065286 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638a89256b0 0x5638a8d18490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.171+0000 7f50b7400640 1 -- 172.21.15.42:0/893065286 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638a89256b0 msgr2=0x5638a8d18490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:45.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.171+0000 7f50b7400640 1 --2- 172.21.15.42:0/893065286 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638a89256b0 0x5638a8d18490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.171+0000 7f50b7400640 1 -- 172.21.15.42:0/893065286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638a891d4d0 msgr2=0x5638a8d17f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:45.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.171+0000 7f50b7400640 1 --2- 172.21.15.42:0/893065286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638a891d4d0 0x5638a8d17f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.171+0000 7f50b7400640 1 -- 172.21.15.42:0/893065286 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638a89b1970 con 0x5638a8946390 2024-09-17T01:46:45.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.171+0000 7f50b7e00640 1 --2- 172.21.15.42:0/893065286 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638a89256b0 0x5638a8d18490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:45.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.171+0000 7f50aea00640 1 --2- 172.21.15.42:0/893065286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638a891d4d0 0x5638a8d17f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:45.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.171+0000 7f50b7400640 1 --2- 172.21.15.42:0/893065286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a8946390 0x5638a8d35280 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f50a800fe40 tx=0x7f50a8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab5bea779199270 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:45.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.172+0000 7f50a7400640 1 -- 172.21.15.42:0/893065286 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a8022070 con 0x5638a8946390 2024-09-17T01:46:45.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.172+0000 7f50a7400640 1 -- 172.21.15.42:0/893065286 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50a801e650 con 0x5638a8946390 2024-09-17T01:46:45.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.172+0000 7f50a7400640 1 -- 172.21.15.42:0/893065286 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a801ea60 con 0x5638a8946390 2024-09-17T01:46:45.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.172+0000 7f50c51f7740 1 -- 172.21.15.42:0/893065286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a8946390 msgr2=0x5638a8d35280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:45.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.172+0000 7f50c51f7740 1 --2- 172.21.15.42:0/893065286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a8946390 0x5638a8d35280 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f50a800fe40 tx=0x7f50a8012000 comp rx=0 tx=0).stop 2024-09-17T01:46:45.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.172+0000 7f50c51f7740 1 -- 172.21.15.42:0/893065286 shutdown_connections 2024-09-17T01:46:45.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.172+0000 7f50c51f7740 1 --2- 172.21.15.42:0/893065286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638a891d4d0 0x5638a8d17f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.172+0000 7f50c51f7740 1 --2- 172.21.15.42:0/893065286 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638a89256b0 0x5638a8d18490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.172+0000 7f50c51f7740 1 --2- 172.21.15.42:0/893065286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a8946390 0x5638a8d35280 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.172+0000 7f50c51f7740 1 -- 172.21.15.42:0/893065286 >> 172.21.15.42:0/893065286 conn(0x5638a893a4e0 msgr2=0x5638a8cee170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:45.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.173+0000 7f50c51f7740 1 -- 172.21.15.42:0/893065286 shutdown_connections 2024-09-17T01:46:45.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.173+0000 7f50c51f7740 1 -- 172.21.15.42:0/893065286 wait complete. 2024-09-17T01:46:45.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.174+0000 7f50c51f7740 1 -- start start 2024-09-17T01:46:45.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.174+0000 7f50c51f7740 1 Processor -- start 2024-09-17T01:46:45.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.175+0000 7f50c51f7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a891d4d0 0x5638a8d12220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.175+0000 7f50c51f7740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638a89256b0 0x5638a8d06b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.175+0000 7f50c51f7740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638a8946390 0x5638a8d2c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.175+0000 7f50c51f7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5638a89c0740 con 0x5638a891d4d0 2024-09-17T01:46:45.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.175+0000 7f50c51f7740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5638a8bf6290 con 0x5638a89256b0 2024-09-17T01:46:45.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.175+0000 7f50c51f7740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5638a8d15100 con 0x5638a8946390 2024-09-17T01:46:45.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.175+0000 7f50c51f7740 10 client.0 _ll_register_callbacks cb 0x5638a8bd31e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:46:45.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.175+0000 7f50b7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a891d4d0 0x5638a8d12220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.175+0000 7f50b7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a891d4d0 0x5638a8d12220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46256/0 (socket says 172.21.15.42:46256) 2024-09-17T01:46:45.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.176+0000 7f50b7400640 1 -- 172.21.15.42:0/3989103259 learned_addr learned my addr 172.21.15.42:0/3989103259 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:45.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.176+0000 7f50b7e00640 1 --2- 172.21.15.42:0/3989103259 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638a8946390 0x5638a8d2c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.176+0000 7f50aea00640 1 --2- 172.21.15.42:0/3989103259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638a89256b0 0x5638a8d06b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.176+0000 7f50b7400640 1 -- 172.21.15.42:0/3989103259 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638a8946390 msgr2=0x5638a8d2c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:45.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.176+0000 7f50b7400640 1 --2- 172.21.15.42:0/3989103259 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638a8946390 0x5638a8d2c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.176+0000 7f50b7400640 1 -- 172.21.15.42:0/3989103259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638a89256b0 msgr2=0x5638a8d06b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:45.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.176+0000 7f50b7400640 1 --2- 172.21.15.42:0/3989103259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638a89256b0 0x5638a8d06b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.176+0000 7f50b7400640 1 -- 172.21.15.42:0/3989103259 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638a8a287d0 con 0x5638a891d4d0 2024-09-17T01:46:45.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.176+0000 7f50b7400640 1 --2- 172.21.15.42:0/3989103259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a891d4d0 0x5638a8d12220 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f50a800fde0 tx=0x7f50a800fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952657323bb670a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:45.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.176+0000 7f509be00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:46:45.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.177+0000 7f509be00640 1 -- 172.21.15.42:0/3989103259 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a8035060 con 0x5638a891d4d0 2024-09-17T01:46:45.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.177+0000 7f509be00640 1 -- 172.21.15.42:0/3989103259 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f50a801e450 con 0x5638a891d4d0 2024-09-17T01:46:45.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.177+0000 7f50c51f7740 1 -- 172.21.15.42:0/3989103259 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50a801e650 con 0x5638a891d4d0 2024-09-17T01:46:45.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.177+0000 7f509be00640 1 -- 172.21.15.42:0/3989103259 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) ==== 24+0+0 (secure 0 0 0) 0x7f50a803b050 con 0x5638a891d4d0 2024-09-17T01:46:45.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.177+0000 7f50c51f7740 10 client.10536 fetch_fsmap learned FSMap version 150 2024-09-17T01:46:45.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.177+0000 7f50c51f7740 1 -- 172.21.15.42:0/3989103259 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) -- 0x5638a8d14e40 con 0x5638a891d4d0 2024-09-17T01:46:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.177+0000 7f509be00640 1 -- 172.21.15.42:0/3989103259 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50a801e650 con 0x5638a891d4d0 2024-09-17T01:46:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.177+0000 7f509be00640 1 -- 172.21.15.42:0/3989103259 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 150) ==== 3502+0+0 (secure 0 0 0) 0x7f50a803e020 con 0x5638a891d4d0 2024-09-17T01:46:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.177+0000 7f50c51f7740 10 client.10536 fetch_fsmap finished waiting for FSMap version 150 2024-09-17T01:46:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.177+0000 7f50c51f7740 10 client.10536 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.b 2024-09-17T01:46:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.177+0000 7f50c51f7740 20 client.10536 populate_metadata read hostname 'smithi042' 2024-09-17T01:46:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.177+0000 7f50c51f7740 1 --2- 172.21.15.42:0/3989103259 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x5638a8904f60 0x5638a8d10280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.177+0000 7f50c51f7740 4 client.10536 mds_command: new command op to 10371 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:46:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.177+0000 7f50c51f7740 1 -- 172.21.15.42:0/3989103259 --> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638a8c62640 con 0x5638a8904f60 2024-09-17T01:46:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.178+0000 7f50aea00640 1 --2- 172.21.15.42:0/3989103259 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x5638a8904f60 0x5638a8d10280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.178+0000 7f50aea00640 1 --2- 172.21.15.42:0/3989103259 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x5638a8904f60 0x5638a8d10280 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=487dda2e5b07ec40 server_cookie=42eb90f963489e37 in_seq=0 out_seq=0 2024-09-17T01:46:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.178+0000 7f509be00640 10 client.10536 ms_handle_connect on v2:172.21.15.43:6835/1477091047 2024-09-17T01:46:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.179+0000 7f509be00640 1 -- 172.21.15.42:0/3989103259 <== mds.0 v2:172.21.15.43:6835/1477091047 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5638a8c62640 con 0x5638a8904f60 2024-09-17T01:46:45.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.179+0000 7f509be00640 10 client.10536 handle_command_reply: tid=0 2024-09-17T01:46:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.179+0000 7f50c51f7740 1 client.10536 shutdown 2024-09-17T01:46:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.179+0000 7f50c51f7740 1 -- 172.21.15.42:0/3989103259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a891d4d0 msgr2=0x5638a8d12220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.180+0000 7f50c51f7740 1 --2- 172.21.15.42:0/3989103259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a891d4d0 0x5638a8d12220 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f50a800fde0 tx=0x7f50a800fc10 comp rx=0 tx=0).stop 2024-09-17T01:46:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.180+0000 7f50c51f7740 1 -- 172.21.15.42:0/3989103259 shutdown_connections 2024-09-17T01:46:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.180+0000 7f50c51f7740 1 --2- 172.21.15.42:0/3989103259 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x5638a8904f60 0x5638a8d10280 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.180+0000 7f50c51f7740 1 --2- 172.21.15.42:0/3989103259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638a89256b0 0x5638a8d06b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.180+0000 7f50c51f7740 1 --2- 172.21.15.42:0/3989103259 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638a8946390 0x5638a8d2c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.180+0000 7f50c51f7740 1 --2- 172.21.15.42:0/3989103259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a891d4d0 0x5638a8d12220 unknown :-1 s=CLOSED pgs=2171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.180+0000 7f509be00640 0 client.10536 ms_handle_reset on v2:172.21.15.43:6835/1477091047 2024-09-17T01:46:45.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.180+0000 7f50c51f7740 1 -- 172.21.15.42:0/3989103259 >> 172.21.15.42:0/3989103259 conn(0x5638a893a4e0 msgr2=0x5638a8ce72a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:45.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.180+0000 7f50c51f7740 1 -- 172.21.15.42:0/3989103259 shutdown_connections 2024-09-17T01:46:45.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.180+0000 7f50c51f7740 1 -- 172.21.15.42:0/3989103259 wait complete. 2024-09-17T01:46:45.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.180+0000 7f50c51f7740 20 client.10536 trim_cache size 0 max 16384 2024-09-17T01:46:45.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.194+0000 7f50c51f7740 1 Processor -- start 2024-09-17T01:46:45.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.194+0000 7f50c51f7740 1 -- start start 2024-09-17T01:46:45.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.196+0000 7f50c51f7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a891d4d0 0x5638a8d41a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.196+0000 7f50c51f7740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638a89256b0 0x5638a8d2b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.196+0000 7f50c51f7740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638a8946390 0x5638a8d17f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.196+0000 7f50c51f7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f50b82021f0 con 0x5638a891d4d0 2024-09-17T01:46:45.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.196+0000 7f50c51f7740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f50b8201200 con 0x5638a89256b0 2024-09-17T01:46:45.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.196+0000 7f50c51f7740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f50b8073830 con 0x5638a8946390 2024-09-17T01:46:45.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.196+0000 7f50b7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a891d4d0 0x5638a8d41a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.196+0000 7f50b7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a891d4d0 0x5638a8d41a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46266/0 (socket says 172.21.15.42:46266) 2024-09-17T01:46:45.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.196+0000 7f50b7400640 1 -- 172.21.15.42:0/4191613744 learned_addr learned my addr 172.21.15.42:0/4191613744 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:45.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.196+0000 7f50aea00640 1 --2- 172.21.15.42:0/4191613744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638a89256b0 0x5638a8d2b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.196+0000 7f50b7e00640 1 --2- 172.21.15.42:0/4191613744 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638a8946390 0x5638a8d17f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.196+0000 7f50b7400640 1 -- 172.21.15.42:0/4191613744 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638a8946390 msgr2=0x5638a8d17f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:45.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.196+0000 7f50b7400640 1 --2- 172.21.15.42:0/4191613744 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638a8946390 0x5638a8d17f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.196+0000 7f50b7400640 1 -- 172.21.15.42:0/4191613744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638a89256b0 msgr2=0x5638a8d2b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:45.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.196+0000 7f50b7400640 1 --2- 172.21.15.42:0/4191613744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638a89256b0 0x5638a8d2b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.196+0000 7f50b7400640 1 -- 172.21.15.42:0/4191613744 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638a8d179b0 con 0x5638a891d4d0 2024-09-17T01:46:45.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.196+0000 7f50b7e00640 1 --2- 172.21.15.42:0/4191613744 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638a8946390 0x5638a8d17f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:45.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.196+0000 7f50b7400640 1 --2- 172.21.15.42:0/4191613744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a891d4d0 0x5638a8d41a00 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f50a8020f90 tx=0x7f50a8020fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1aa1264c2957191 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:45.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.197+0000 7f50a6a00640 1 -- 172.21.15.42:0/4191613744 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a802b020 con 0x5638a891d4d0 2024-09-17T01:46:45.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.197+0000 7f50a6a00640 1 -- 172.21.15.42:0/4191613744 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50a8020120 con 0x5638a891d4d0 2024-09-17T01:46:45.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.197+0000 7f50a6a00640 1 -- 172.21.15.42:0/4191613744 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a8015040 con 0x5638a891d4d0 2024-09-17T01:46:45.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.197+0000 7f50c51f7740 1 -- 172.21.15.42:0/4191613744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a891d4d0 msgr2=0x5638a8d41a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:45.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.197+0000 7f50c51f7740 1 --2- 172.21.15.42:0/4191613744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a891d4d0 0x5638a8d41a00 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f50a8020f90 tx=0x7f50a8020fc0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.198+0000 7f50c51f7740 1 -- 172.21.15.42:0/4191613744 shutdown_connections 2024-09-17T01:46:45.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.198+0000 7f50c51f7740 1 --2- 172.21.15.42:0/4191613744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638a89256b0 0x5638a8d2b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.198+0000 7f50c51f7740 1 --2- 172.21.15.42:0/4191613744 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638a8946390 0x5638a8d17f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.198+0000 7f50c51f7740 1 --2- 172.21.15.42:0/4191613744 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a891d4d0 0x5638a8d41a00 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.198+0000 7f50c51f7740 1 -- 172.21.15.42:0/4191613744 >> 172.21.15.42:0/4191613744 conn(0x5638a893a4e0 msgr2=0x5638a8ce39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:45.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.198+0000 7f50c51f7740 1 -- 172.21.15.42:0/4191613744 shutdown_connections 2024-09-17T01:46:45.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.198+0000 7f50c51f7740 1 -- 172.21.15.42:0/4191613744 wait complete. 2024-09-17T01:46:45.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.199+0000 7f50c51f7740 1 -- start start 2024-09-17T01:46:45.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.199+0000 7f50c51f7740 1 Processor -- start 2024-09-17T01:46:45.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.200+0000 7f50c51f7740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638a891d4d0 0x5638a8d0ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.200+0000 7f50c51f7740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638a89256b0 0x5638a8da9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.200+0000 7f50c51f7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a8946390 0x5638a8d17f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.200+0000 7f50c51f7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5638a8d13060 con 0x5638a8946390 2024-09-17T01:46:45.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.200+0000 7f50c51f7740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f50b8073e80 con 0x5638a891d4d0 2024-09-17T01:46:45.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.200+0000 7f50c51f7740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5638a8db32f0 con 0x5638a89256b0 2024-09-17T01:46:45.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.200+0000 7f50c51f7740 10 client.0 _ll_register_callbacks cb 0x7f50a800fd10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:46:45.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.201+0000 7f50b7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a8946390 0x5638a8d17f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.201+0000 7f50b7400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638a891d4d0 0x5638a8d0ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.201+0000 7f50b7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a8946390 0x5638a8d17f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46282/0 (socket says 172.21.15.42:46282) 2024-09-17T01:46:45.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.201+0000 7f50b7e00640 1 -- 172.21.15.42:0/3188982422 learned_addr learned my addr 172.21.15.42:0/3188982422 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:45.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.201+0000 7f50aea00640 1 --2- 172.21.15.42:0/3188982422 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638a89256b0 0x5638a8da9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.201+0000 7f50b7e00640 1 -- 172.21.15.42:0/3188982422 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638a89256b0 msgr2=0x5638a8da9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:45.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.201+0000 7f50b7e00640 1 --2- 172.21.15.42:0/3188982422 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638a89256b0 0x5638a8da9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.201+0000 7f50b7e00640 1 -- 172.21.15.42:0/3188982422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638a891d4d0 msgr2=0x5638a8d0ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:45.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.201+0000 7f50b7e00640 1 --2- 172.21.15.42:0/3188982422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638a891d4d0 0x5638a8d0ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.201+0000 7f50b7e00640 1 -- 172.21.15.42:0/3188982422 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638a8da99c0 con 0x5638a8946390 2024-09-17T01:46:45.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.202+0000 7f50b7e00640 1 --2- 172.21.15.42:0/3188982422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a8946390 0x5638a8d17f50 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009d60 tx=0x7f50b0030f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69829bae556cbec4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:45.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.202+0000 7f509be00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:46:45.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.202+0000 7f509be00640 1 -- 172.21.15.42:0/3188982422 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b004a060 con 0x5638a8946390 2024-09-17T01:46:45.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.202+0000 7f509be00640 1 -- 172.21.15.42:0/3188982422 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f50b0004040 con 0x5638a8946390 2024-09-17T01:46:45.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.202+0000 7f50c51f7740 1 -- 172.21.15.42:0/3188982422 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50a8020120 con 0x5638a8946390 2024-09-17T01:46:45.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.202+0000 7f509be00640 1 -- 172.21.15.42:0/3188982422 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) ==== 24+0+0 (secure 0 0 0) 0x7f50b0050050 con 0x5638a8946390 2024-09-17T01:46:45.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.202+0000 7f50c51f7740 10 client.10542 fetch_fsmap learned FSMap version 150 2024-09-17T01:46:45.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.202+0000 7f50c51f7740 1 -- 172.21.15.42:0/3188982422 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) -- 0x5638a8d06530 con 0x5638a8946390 2024-09-17T01:46:45.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.202+0000 7f509be00640 1 -- 172.21.15.42:0/3188982422 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50a8020120 con 0x5638a8946390 2024-09-17T01:46:45.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.202+0000 7f509be00640 1 -- 172.21.15.42:0/3188982422 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 150) ==== 3502+0+0 (secure 0 0 0) 0x7f50b0053020 con 0x5638a8946390 2024-09-17T01:46:45.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.202+0000 7f50c51f7740 10 client.10542 fetch_fsmap finished waiting for FSMap version 150 2024-09-17T01:46:45.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.202+0000 7f50c51f7740 10 client.10542 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.b 2024-09-17T01:46:45.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.202+0000 7f50c51f7740 20 client.10542 populate_metadata read hostname 'smithi042' 2024-09-17T01:46:45.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.203+0000 7f50c51f7740 1 --2- 172.21.15.42:0/3188982422 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x5638a8db2b50 0x5638a8d18490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.203+0000 7f50c51f7740 4 client.10542 mds_command: new command op to 10371 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-17T01:46:45.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.203+0000 7f50c51f7740 1 -- 172.21.15.42:0/3188982422 --> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5638a8c5e0f0 con 0x5638a8db2b50 2024-09-17T01:46:45.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.203+0000 7f50b7400640 1 --2- 172.21.15.42:0/3188982422 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x5638a8db2b50 0x5638a8d18490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.203+0000 7f50b7400640 1 --2- 172.21.15.42:0/3188982422 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x5638a8db2b50 0x5638a8d18490 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dfe6fe11ecd7e93 server_cookie=35143ca532e2f216 in_seq=0 out_seq=0 2024-09-17T01:46:45.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.203+0000 7f509be00640 10 client.10542 ms_handle_connect on v2:172.21.15.43:6835/1477091047 2024-09-17T01:46:45.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.204+0000 7f509be00640 1 -- 172.21.15.42:0/3188982422 <== mds.0 v2:172.21.15.43:6835/1477091047 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5638a8c5e0f0 con 0x5638a8db2b50 2024-09-17T01:46:45.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.204+0000 7f509be00640 10 client.10542 handle_command_reply: tid=0 2024-09-17T01:46:45.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.204+0000 7f50c51f7740 1 client.10542 shutdown 2024-09-17T01:46:45.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.204+0000 7f50c51f7740 1 -- 172.21.15.42:0/3188982422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a8946390 msgr2=0x5638a8d17f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:45.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.204+0000 7f50c51f7740 1 --2- 172.21.15.42:0/3188982422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a8946390 0x5638a8d17f50 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009d60 tx=0x7f50b0030f20 comp rx=0 tx=0).stop 2024-09-17T01:46:45.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.204+0000 7f50c51f7740 1 -- 172.21.15.42:0/3188982422 shutdown_connections 2024-09-17T01:46:45.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.204+0000 7f50c51f7740 1 --2- 172.21.15.42:0/3188982422 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5638a8946390 0x5638a8d17f50 unknown :-1 s=CLOSED pgs=2173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.204+0000 7f50c51f7740 1 --2- 172.21.15.42:0/3188982422 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5638a89256b0 0x5638a8da9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.204+0000 7f50c51f7740 1 --2- 172.21.15.42:0/3188982422 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x5638a8db2b50 0x5638a8d18490 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.204+0000 7f50c51f7740 1 --2- 172.21.15.42:0/3188982422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638a891d4d0 0x5638a8d0ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.204+0000 7f509be00640 0 client.10542 ms_handle_reset on v2:172.21.15.43:6835/1477091047 2024-09-17T01:46:45.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.204+0000 7f50c51f7740 1 -- 172.21.15.42:0/3188982422 >> 172.21.15.42:0/3188982422 conn(0x5638a893a4e0 msgr2=0x5638a8d2ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:45.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.204+0000 7f50c51f7740 1 -- 172.21.15.42:0/3188982422 shutdown_connections 2024-09-17T01:46:45.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.204+0000 7f50c51f7740 1 -- 172.21.15.42:0/3188982422 wait complete. 2024-09-17T01:46:45.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.204+0000 7f50c51f7740 20 client.10542 trim_cache size 0 max 16384 2024-09-17T01:46:45.205 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-17T01:46:45.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.205+0000 7f50bcc00640 1 -- 172.21.15.42:0/3317042568 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5094078b90 msgr2=0x7f509407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:45.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.205+0000 7f50bcc00640 1 --2- 172.21.15.42:0/3317042568 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5094078b90 0x7f509407b0a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f50a8005fd0 tx=0x7f50a8005850 comp rx=0 tx=0).stop 2024-09-17T01:46:45.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.205+0000 7f50bcc00640 1 -- 172.21.15.42:0/3317042568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50b80b32b0 msgr2=0x7f50b814a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:45.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.205+0000 7f50bcc00640 1 --2- 172.21.15.42:0/3317042568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50b80b32b0 0x7f50b814a780 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f50a000b3e0 tx=0x7f50a000b8a0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.205+0000 7f50bcc00640 1 -- 172.21.15.42:0/3317042568 shutdown_connections 2024-09-17T01:46:45.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.205+0000 7f50bcc00640 1 --2- 172.21.15.42:0/3317042568 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5094078b90 0x7f509407b0a0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.205+0000 7f50bcc00640 1 --2- 172.21.15.42:0/3317042568 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50b815c6c0 0x7f50b815ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.205+0000 7f50bcc00640 1 --2- 172.21.15.42:0/3317042568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50b80b32b0 0x7f50b814a780 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.205+0000 7f50bcc00640 1 --2- 172.21.15.42:0/3317042568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50b80af910 0x7f50b80cbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.205+0000 7f50bcc00640 1 -- 172.21.15.42:0/3317042568 >> 172.21.15.42:0/3317042568 conn(0x7f50b806d440 msgr2=0x7f50b8157340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:45.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.206+0000 7f50bcc00640 1 -- 172.21.15.42:0/3317042568 shutdown_connections 2024-09-17T01:46:45.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.206+0000 7f50bcc00640 1 -- 172.21.15.42:0/3317042568 wait complete. 2024-09-17T01:46:45.225 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T01:46:45.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.455+0000 7f3ccfe00640 1 -- 172.21.15.42:0/2969924246 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cd015f830 msgr2=0x7f3cd006e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:45.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.455+0000 7f3ccfe00640 1 --2- 172.21.15.42:0/2969924246 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cd015f830 0x7f3cd006e950 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0071130 tx=0x7f3cc802a8b0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.455+0000 7f3ccfe00640 1 -- 172.21.15.42:0/2969924246 shutdown_connections 2024-09-17T01:46:45.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.455+0000 7f3ccfe00640 1 --2- 172.21.15.42:0/2969924246 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cd015f830 0x7f3cd006e950 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.455+0000 7f3ccfe00640 1 --2- 172.21.15.42:0/2969924246 >> v2:172.21.15.43:3300/0 conn(0x7f3cd015b680 0x7f3cd015fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.455+0000 7f3ccfe00640 1 -- 172.21.15.42:0/2969924246 >> 172.21.15.42:0/2969924246 conn(0x7f3cd00b25f0 msgr2=0x7f3cd00d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:45.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.455+0000 7f3ccfe00640 1 -- 172.21.15.42:0/2969924246 shutdown_connections 2024-09-17T01:46:45.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.455+0000 7f3ccfe00640 1 -- 172.21.15.42:0/2969924246 wait complete. 2024-09-17T01:46:45.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.458+0000 7f3ccfe00640 1 Processor -- start 2024-09-17T01:46:45.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.458+0000 7f3ccfe00640 1 -- start start 2024-09-17T01:46:45.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.460+0000 7f3ccfe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cd00cafe0 0x7f3cd0148e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.460+0000 7f3ccfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cd015b680 0x7f3cd009dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.461+0000 7f3ccfe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cd00ce1d0 0x7f3cd00ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.461+0000 7f3ccfe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd006f490 con 0x7f3cd015b680 2024-09-17T01:46:45.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.461+0000 7f3ccfe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd006f310 con 0x7f3cd00ce1d0 2024-09-17T01:46:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.461+0000 7f3ccfe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3cd006f610 con 0x7f3cd00cafe0 2024-09-17T01:46:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.461+0000 7f3cc6000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cd015b680 0x7f3cd009dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.461+0000 7f3cc6000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cd015b680 0x7f3cd009dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46308/0 (socket says 172.21.15.42:46308) 2024-09-17T01:46:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.461+0000 7f3cc6000640 1 -- 172.21.15.42:0/1656246411 learned_addr learned my addr 172.21.15.42:0/1656246411 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.461+0000 7f3ccea00640 1 --2- 172.21.15.42:0/1656246411 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cd00cafe0 0x7f3cd0148e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.461+0000 7f3ccf400640 1 --2- 172.21.15.42:0/1656246411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cd00ce1d0 0x7f3cd00ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.461+0000 7f3cc6000640 1 -- 172.21.15.42:0/1656246411 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cd00cafe0 msgr2=0x7f3cd0148e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.461+0000 7f3cc6000640 1 --2- 172.21.15.42:0/1656246411 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cd00cafe0 0x7f3cd0148e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.461+0000 7f3cc6000640 1 -- 172.21.15.42:0/1656246411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cd00ce1d0 msgr2=0x7f3cd00ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.461+0000 7f3cc6000640 1 --2- 172.21.15.42:0/1656246411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cd00ce1d0 0x7f3cd00ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.461+0000 7f3cc6000640 1 -- 172.21.15.42:0/1656246411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd00ceb20 con 0x7f3cd015b680 2024-09-17T01:46:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.461+0000 7f3ccea00640 1 --2- 172.21.15.42:0/1656246411 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cd00cafe0 0x7f3cd0148e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:45.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.461+0000 7f3ccf400640 1 --2- 172.21.15.42:0/1656246411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cd00ce1d0 0x7f3cd00ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:45.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.462+0000 7f3cc6000640 1 --2- 172.21.15.42:0/1656246411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cd015b680 0x7f3cd009dbf0 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800c3f0 tx=0x7f3cb800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:45.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.462+0000 7f3cc7400640 1 -- 172.21.15.42:0/1656246411 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8017070 con 0x7f3cd015b680 2024-09-17T01:46:45.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.462+0000 7f3cc7400640 1 -- 172.21.15.42:0/1656246411 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cb80035f0 con 0x7f3cd015b680 2024-09-17T01:46:45.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.462+0000 7f3cc7400640 1 -- 172.21.15.42:0/1656246411 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8003a40 con 0x7f3cd015b680 2024-09-17T01:46:45.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.462+0000 7f3ccfe00640 1 -- 172.21.15.42:0/1656246411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd0073df0 con 0x7f3cd015b680 2024-09-17T01:46:45.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.462+0000 7f3ccfe00640 1 -- 172.21.15.42:0/1656246411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd014bb80 con 0x7f3cd015b680 2024-09-17T01:46:45.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.463+0000 7f3ccfe00640 1 -- 172.21.15.42:0/1656246411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cd006fac0 con 0x7f3cd015b680 2024-09-17T01:46:45.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.465+0000 7f3cc7400640 1 -- 172.21.15.42:0/1656246411 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3cb801a070 con 0x7f3cd015b680 2024-09-17T01:46:45.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.465+0000 7f3cc7400640 1 --2- 172.21.15.42:0/1656246411 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3cac078bc0 0x7f3cac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.466+0000 7f3cc7400640 1 -- 172.21.15.42:0/1656246411 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f3cb809a0b0 con 0x7f3cd015b680 2024-09-17T01:46:45.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.466+0000 7f3ccea00640 1 --2- 172.21.15.42:0/1656246411 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3cac078bc0 0x7f3cac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.467+0000 7f3ccea00640 1 --2- 172.21.15.42:0/1656246411 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3cac078bc0 0x7f3cac07b0d0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0005fd0 tx=0x7f3cc000f360 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:45.468 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.470+0000 7f3cc7400640 1 -- 172.21.15.42:0/1656246411 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3cd00ceb20 con 0x7f3cd015b680 2024-09-17T01:46:45.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.705+0000 7f3ccfe00640 1 -- 172.21.15.42:0/1656246411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3cd0149370 con 0x7f3cd015b680 2024-09-17T01:46:45.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.705+0000 7f3cc7400640 1 -- 172.21.15.42:0/1656246411 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f3cb8062570 con 0x7f3cd015b680 2024-09-17T01:46:45.703 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:46:45.703 INFO:teuthology.orchestra.run.smithi042.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T01:46:45.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.707+0000 7f3ccfe00640 1 -- 172.21.15.42:0/1656246411 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3cac078bc0 msgr2=0x7f3cac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:45.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.707+0000 7f3ccfe00640 1 --2- 172.21.15.42:0/1656246411 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3cac078bc0 0x7f3cac07b0d0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0005fd0 tx=0x7f3cc000f360 comp rx=0 tx=0).stop 2024-09-17T01:46:45.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.707+0000 7f3ccfe00640 1 -- 172.21.15.42:0/1656246411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cd015b680 msgr2=0x7f3cd009dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:45.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.707+0000 7f3ccfe00640 1 --2- 172.21.15.42:0/1656246411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cd015b680 0x7f3cd009dbf0 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800c3f0 tx=0x7f3cb800c8b0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.708+0000 7f3ccfe00640 1 -- 172.21.15.42:0/1656246411 shutdown_connections 2024-09-17T01:46:45.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.708+0000 7f3ccfe00640 1 --2- 172.21.15.42:0/1656246411 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3cac078bc0 0x7f3cac07b0d0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.708+0000 7f3ccfe00640 1 --2- 172.21.15.42:0/1656246411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3cd00ce1d0 0x7f3cd00ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.708+0000 7f3ccfe00640 1 --2- 172.21.15.42:0/1656246411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cd015b680 0x7f3cd009dbf0 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.708+0000 7f3ccfe00640 1 --2- 172.21.15.42:0/1656246411 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3cd00cafe0 0x7f3cd0148e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.708+0000 7f3ccfe00640 1 -- 172.21.15.42:0/1656246411 >> 172.21.15.42:0/1656246411 conn(0x7f3cd00b25f0 msgr2=0x7f3cd006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:45.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.708+0000 7f3ccfe00640 1 -- 172.21.15.42:0/1656246411 shutdown_connections 2024-09-17T01:46:45.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.708+0000 7f3ccfe00640 1 -- 172.21.15.42:0/1656246411 wait complete. 2024-09-17T01:46:45.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:46:45.729 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub start '~mdsdir' recursive 2024-09-17T01:46:45.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.963+0000 7fbe6e400640 1 -- 172.21.15.42:0/605831161 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbe6806d430 msgr2=0x7fbe6806d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:45.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.963+0000 7fbe6e400640 1 --2- 172.21.15.42:0/605831161 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbe6806d430 0x7fbe6806d840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbe60005fd0 tx=0x7fbe6002aaa0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.964+0000 7fbe6e400640 1 -- 172.21.15.42:0/605831161 shutdown_connections 2024-09-17T01:46:45.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.964+0000 7fbe6e400640 1 --2- 172.21.15.42:0/605831161 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbe6806d430 0x7fbe6806d840 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.964+0000 7fbe6e400640 1 --2- 172.21.15.42:0/605831161 >> v2:172.21.15.43:3300/0 conn(0x7fbe680cdb20 0x7fbe680cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.964+0000 7fbe6e400640 1 -- 172.21.15.42:0/605831161 >> 172.21.15.42:0/605831161 conn(0x7fbe680b28f0 msgr2=0x7fbe6806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:45.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.964+0000 7fbe6e400640 1 -- 172.21.15.42:0/605831161 shutdown_connections 2024-09-17T01:46:45.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.964+0000 7fbe6e400640 1 -- 172.21.15.42:0/605831161 wait complete. 2024-09-17T01:46:45.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.966+0000 7fbe6e400640 1 Processor -- start 2024-09-17T01:46:45.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.966+0000 7fbe6e400640 1 -- start start 2024-09-17T01:46:45.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.968+0000 7fbe6e400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe6806d430 0x7fbe680aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.968+0000 7fbe6e400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe680b56d0 0x7fbe68141cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.968+0000 7fbe6e400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbe680cdb20 0x7fbe680ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.968+0000 7fbe6e400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6815d560 con 0x7fbe6806d430 2024-09-17T01:46:45.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.968+0000 7fbe6e400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6815d3e0 con 0x7fbe680b56d0 2024-09-17T01:46:45.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.968+0000 7fbe6e400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbe6815d6e0 con 0x7fbe680cdb20 2024-09-17T01:46:45.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.968+0000 7fbe67400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe6806d430 0x7fbe680aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.968+0000 7fbe67400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe6806d430 0x7fbe680aef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59034/0 (socket says 172.21.15.42:59034) 2024-09-17T01:46:45.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.968+0000 7fbe67400640 1 -- 172.21.15.42:0/53089104 learned_addr learned my addr 172.21.15.42:0/53089104 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:45.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.968+0000 7fbe67e00640 1 --2- 172.21.15.42:0/53089104 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbe680cdb20 0x7fbe680ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.968+0000 7fbe5fe00640 1 --2- 172.21.15.42:0/53089104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe680b56d0 0x7fbe68141cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.968+0000 7fbe67400640 1 -- 172.21.15.42:0/53089104 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbe680cdb20 msgr2=0x7fbe680ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.968+0000 7fbe67400640 1 --2- 172.21.15.42:0/53089104 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbe680cdb20 0x7fbe680ccfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.968+0000 7fbe67400640 1 -- 172.21.15.42:0/53089104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe680b56d0 msgr2=0x7fbe68141cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.968+0000 7fbe67400640 1 --2- 172.21.15.42:0/53089104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe680b56d0 0x7fbe68141cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.968+0000 7fbe67400640 1 -- 172.21.15.42:0/53089104 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe681f6d20 con 0x7fbe6806d430 2024-09-17T01:46:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.968+0000 7fbe67e00640 1 --2- 172.21.15.42:0/53089104 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbe680cdb20 0x7fbe680ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.968+0000 7fbe5fe00640 1 --2- 172.21.15.42:0/53089104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe680b56d0 0x7fbe68141cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.969+0000 7fbe67400640 1 --2- 172.21.15.42:0/53089104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe6806d430 0x7fbe680aef10 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7fbe5800c430 tx=0x7fbe5800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.969+0000 7fbe5f400640 1 -- 172.21.15.42:0/53089104 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe58017070 con 0x7fbe6806d430 2024-09-17T01:46:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.969+0000 7fbe5f400640 1 -- 172.21.15.42:0/53089104 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe580053e0 con 0x7fbe6806d430 2024-09-17T01:46:45.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.969+0000 7fbe5f400640 1 -- 172.21.15.42:0/53089104 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe58003850 con 0x7fbe6806d430 2024-09-17T01:46:45.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.969+0000 7fbe6e400640 1 -- 172.21.15.42:0/53089104 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe681f6fc0 con 0x7fbe6806d430 2024-09-17T01:46:45.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.969+0000 7fbe6e400640 1 -- 172.21.15.42:0/53089104 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe681f7580 con 0x7fbe6806d430 2024-09-17T01:46:45.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.972+0000 7fbe5f400640 1 -- 172.21.15.42:0/53089104 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbe5801a070 con 0x7fbe6806d430 2024-09-17T01:46:45.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.974+0000 7fbe5f400640 1 --2- 172.21.15.42:0/53089104 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbe44078bc0 0x7fbe4407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.974+0000 7fbe7561d740 1 Processor -- start 2024-09-17T01:46:45.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.974+0000 7fbe5f400640 1 -- 172.21.15.42:0/53089104 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7fbe5809a1a0 con 0x7fbe6806d430 2024-09-17T01:46:45.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.974+0000 7fbe7561d740 1 -- start start 2024-09-17T01:46:45.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.974+0000 7fbe5fe00640 1 --2- 172.21.15.42:0/53089104 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbe44078bc0 0x7fbe4407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.975+0000 7fbe5fe00640 1 --2- 172.21.15.42:0/53089104 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbe44078bc0 0x7fbe4407b0d0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fbe680ae490 tx=0x7fbe50005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:45.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.975+0000 7fbe7561d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556567b3a5b0 0x556567f269a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.975+0000 7fbe7561d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556567b116f0 0x556567efb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.975+0000 7fbe7561d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b198d0 0x556567efbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.976+0000 7fbe7561d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556567e54970 con 0x556567b198d0 2024-09-17T01:46:45.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.976+0000 7fbe7561d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556567e43da0 con 0x556567b116f0 2024-09-17T01:46:45.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.976+0000 7fbe7561d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x556567e47bb0 con 0x556567b3a5b0 2024-09-17T01:46:45.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.976+0000 7fbe67e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b198d0 0x556567efbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.976+0000 7fbe67e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b198d0 0x556567efbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59038/0 (socket says 172.21.15.42:59038) 2024-09-17T01:46:45.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.976+0000 7fbe67e00640 1 -- 172.21.15.42:0/1694018668 learned_addr learned my addr 172.21.15.42:0/1694018668 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:45.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.976+0000 7fbe67400640 1 --2- 172.21.15.42:0/1694018668 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556567b3a5b0 0x556567f269a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.976+0000 7fbe5fe00640 1 --2- 172.21.15.42:0/1694018668 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556567b116f0 0x556567efb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.976+0000 7fbe67e00640 1 -- 172.21.15.42:0/1694018668 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556567b3a5b0 msgr2=0x556567f269a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:45.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.976+0000 7fbe67e00640 1 --2- 172.21.15.42:0/1694018668 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556567b3a5b0 0x556567f269a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.976+0000 7fbe67e00640 1 -- 172.21.15.42:0/1694018668 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556567b116f0 msgr2=0x556567efb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:45.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.976+0000 7fbe67e00640 1 --2- 172.21.15.42:0/1694018668 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556567b116f0 0x556567efb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.976+0000 7fbe67e00640 1 -- 172.21.15.42:0/1694018668 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556567c1ea20 con 0x556567b198d0 2024-09-17T01:46:45.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.977+0000 7fbe67e00640 1 --2- 172.21.15.42:0/1694018668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b198d0 0x556567efbd30 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7fbe6002b090 tx=0x7fbe60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a70a439c89b90ba server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.977+0000 7fbe57e00640 1 -- 172.21.15.42:0/1694018668 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe60044070 con 0x556567b198d0 2024-09-17T01:46:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.977+0000 7fbe57e00640 1 -- 172.21.15.42:0/1694018668 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe6002e760 con 0x556567b198d0 2024-09-17T01:46:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.977+0000 7fbe57e00640 1 -- 172.21.15.42:0/1694018668 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6002ed50 con 0x556567b198d0 2024-09-17T01:46:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.978+0000 7fbe7561d740 1 -- 172.21.15.42:0/1694018668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b198d0 msgr2=0x556567efbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.978+0000 7fbe7561d740 1 --2- 172.21.15.42:0/1694018668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b198d0 0x556567efbd30 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7fbe6002b090 tx=0x7fbe60004a40 comp rx=0 tx=0).stop 2024-09-17T01:46:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.978+0000 7fbe7561d740 1 -- 172.21.15.42:0/1694018668 shutdown_connections 2024-09-17T01:46:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.978+0000 7fbe7561d740 1 --2- 172.21.15.42:0/1694018668 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556567b116f0 0x556567efb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.978+0000 7fbe7561d740 1 --2- 172.21.15.42:0/1694018668 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b198d0 0x556567efbd30 unknown :-1 s=CLOSED pgs=2178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.978+0000 7fbe7561d740 1 --2- 172.21.15.42:0/1694018668 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556567b3a5b0 0x556567f269a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.978+0000 7fbe7561d740 1 -- 172.21.15.42:0/1694018668 >> 172.21.15.42:0/1694018668 conn(0x556567b2e700 msgr2=0x556567ee1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.978+0000 7fbe7561d740 1 -- 172.21.15.42:0/1694018668 shutdown_connections 2024-09-17T01:46:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.978+0000 7fbe7561d740 1 -- 172.21.15.42:0/1694018668 wait complete. 2024-09-17T01:46:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.979+0000 7fbe7561d740 1 -- start start 2024-09-17T01:46:45.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.979+0000 7fbe7561d740 1 Processor -- start 2024-09-17T01:46:45.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.981+0000 7fbe7561d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b116f0 0x556567f0c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.981+0000 7fbe7561d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556567b198d0 0x556567ee6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.981+0000 7fbe7561d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556567b3a5b0 0x556567ee7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.981+0000 7fbe7561d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556567bb4960 con 0x556567b116f0 2024-09-17T01:46:45.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.981+0000 7fbe7561d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556567de9780 con 0x556567b3a5b0 2024-09-17T01:46:45.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.981+0000 7fbe7561d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x556567f235a0 con 0x556567b198d0 2024-09-17T01:46:45.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.981+0000 7fbe7561d740 10 client.0 _ll_register_callbacks cb 0x556567e404b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:46:45.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.981+0000 7fbe67400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b116f0 0x556567f0c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.981+0000 7fbe67400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b116f0 0x556567f0c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59048/0 (socket says 172.21.15.42:59048) 2024-09-17T01:46:45.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.981+0000 7fbe67400640 1 -- 172.21.15.42:0/1895128129 learned_addr learned my addr 172.21.15.42:0/1895128129 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:45.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.981+0000 7fbe5fe00640 1 --2- 172.21.15.42:0/1895128129 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556567b198d0 0x556567ee6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.981+0000 7fbe67e00640 1 --2- 172.21.15.42:0/1895128129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556567b3a5b0 0x556567ee7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.982+0000 7fbe67400640 1 -- 172.21.15.42:0/1895128129 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556567b198d0 msgr2=0x556567ee6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:45.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.982+0000 7fbe67400640 1 --2- 172.21.15.42:0/1895128129 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556567b198d0 0x556567ee6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.982+0000 7fbe67400640 1 -- 172.21.15.42:0/1895128129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556567b3a5b0 msgr2=0x556567ee7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:45.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.982+0000 7fbe67400640 1 --2- 172.21.15.42:0/1895128129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556567b3a5b0 0x556567ee7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.982+0000 7fbe67400640 1 -- 172.21.15.42:0/1895128129 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556567b838c0 con 0x556567b116f0 2024-09-17T01:46:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.982+0000 7fbe5fe00640 1 --2- 172.21.15.42:0/1895128129 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556567b198d0 0x556567ee6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.982+0000 7fbe67400640 1 --2- 172.21.15.42:0/1895128129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b116f0 0x556567f0c320 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7fbe58098630 tx=0x7fbe580616e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9d6fb43fac181e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.982+0000 7fbe54c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:46:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.982+0000 7fbe54c00640 1 -- 172.21.15.42:0/1895128129 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe58064040 con 0x556567b116f0 2024-09-17T01:46:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.982+0000 7fbe54c00640 1 -- 172.21.15.42:0/1895128129 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7fbe58088210 con 0x556567b116f0 2024-09-17T01:46:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.982+0000 7fbe7561d740 1 -- 172.21.15.42:0/1895128129 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe6002e760 con 0x556567b116f0 2024-09-17T01:46:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.982+0000 7fbe54c00640 1 -- 172.21.15.42:0/1895128129 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) ==== 24+0+0 (secure 0 0 0) 0x7fbe58082050 con 0x556567b116f0 2024-09-17T01:46:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.982+0000 7fbe7561d740 10 client.10560 fetch_fsmap learned FSMap version 150 2024-09-17T01:46:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.983+0000 7fbe7561d740 1 -- 172.21.15.42:0/1895128129 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) -- 0x556567c7f1b0 con 0x556567b116f0 2024-09-17T01:46:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.983+0000 7fbe54c00640 1 -- 172.21.15.42:0/1895128129 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe6002e760 con 0x556567b116f0 2024-09-17T01:46:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.983+0000 7fbe54c00640 1 -- 172.21.15.42:0/1895128129 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 150) ==== 3502+0+0 (secure 0 0 0) 0x7fbe580610a0 con 0x556567b116f0 2024-09-17T01:46:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.983+0000 7fbe7561d740 10 client.10560 fetch_fsmap finished waiting for FSMap version 150 2024-09-17T01:46:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.983+0000 7fbe7561d740 10 client.10560 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.b 2024-09-17T01:46:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.983+0000 7fbe7561d740 20 client.10560 populate_metadata read hostname 'smithi042' 2024-09-17T01:46:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.983+0000 7fbe7561d740 1 --2- 172.21.15.42:0/1895128129 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x556567af9180 0x556567ee3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.983+0000 7fbe7561d740 4 client.10560 mds_command: new command op to 10371 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:46:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.983+0000 7fbe7561d740 1 -- 172.21.15.42:0/1895128129 --> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556567e568c0 con 0x556567af9180 2024-09-17T01:46:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.983+0000 7fbe5fe00640 1 --2- 172.21.15.42:0/1895128129 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x556567af9180 0x556567ee3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:45.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.984+0000 7fbe5fe00640 1 --2- 172.21.15.42:0/1895128129 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x556567af9180 0x556567ee3ea0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8034b71488eeb87a server_cookie=ca081f350e54840b in_seq=0 out_seq=0 2024-09-17T01:46:45.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.984+0000 7fbe54c00640 10 client.10560 ms_handle_connect on v2:172.21.15.43:6835/1477091047 2024-09-17T01:46:45.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.985+0000 7fbe54c00640 1 -- 172.21.15.42:0/1895128129 <== mds.0 v2:172.21.15.43:6835/1477091047 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556567e568c0 con 0x556567af9180 2024-09-17T01:46:45.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.985+0000 7fbe54c00640 10 client.10560 handle_command_reply: tid=0 2024-09-17T01:46:45.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.985+0000 7fbe7561d740 1 client.10560 shutdown 2024-09-17T01:46:45.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.985+0000 7fbe7561d740 1 -- 172.21.15.42:0/1895128129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b116f0 msgr2=0x556567f0c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:45.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.985+0000 7fbe7561d740 1 --2- 172.21.15.42:0/1895128129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b116f0 0x556567f0c320 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7fbe58098630 tx=0x7fbe580616e0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.986+0000 7fbe7561d740 1 -- 172.21.15.42:0/1895128129 shutdown_connections 2024-09-17T01:46:45.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.986+0000 7fbe7561d740 1 --2- 172.21.15.42:0/1895128129 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x556567af9180 0x556567ee3ea0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.986+0000 7fbe7561d740 1 --2- 172.21.15.42:0/1895128129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556567b3a5b0 0x556567ee7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.986+0000 7fbe7561d740 1 --2- 172.21.15.42:0/1895128129 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556567b198d0 0x556567ee6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.986+0000 7fbe54c00640 0 client.10560 ms_handle_reset on v2:172.21.15.43:6835/1477091047 2024-09-17T01:46:45.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.986+0000 7fbe7561d740 1 --2- 172.21.15.42:0/1895128129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b116f0 0x556567f0c320 unknown :-1 s=CLOSED pgs=2179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:45.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.986+0000 7fbe7561d740 1 -- 172.21.15.42:0/1895128129 >> 172.21.15.42:0/1895128129 conn(0x556567b2e700 msgr2=0x556567edc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:45.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.986+0000 7fbe7561d740 1 -- 172.21.15.42:0/1895128129 shutdown_connections 2024-09-17T01:46:45.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.986+0000 7fbe7561d740 1 -- 172.21.15.42:0/1895128129 wait complete. 2024-09-17T01:46:45.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:45.986+0000 7fbe7561d740 20 client.10560 trim_cache size 0 max 16384 2024-09-17T01:46:46.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.005+0000 7fbe7561d740 1 Processor -- start 2024-09-17T01:46:46.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.005+0000 7fbe7561d740 1 -- start start 2024-09-17T01:46:46.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.006+0000 7fbe7561d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556567b116f0 0x556567efb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.006+0000 7fbe7561d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b198d0 0x556567f49720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.006+0000 7fbe7561d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556567b3a5b0 0x556567f49c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.006+0000 7fbe7561d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbe681fff50 con 0x556567b198d0 2024-09-17T01:46:46.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.006+0000 7fbe7561d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbe681ff0b0 con 0x556567b3a5b0 2024-09-17T01:46:46.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.006+0000 7fbe7561d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbe680ad3b0 con 0x556567b116f0 2024-09-17T01:46:46.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.006+0000 7fbe5fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b198d0 0x556567f49720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.006+0000 7fbe5fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b198d0 0x556567f49720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59050/0 (socket says 172.21.15.42:59050) 2024-09-17T01:46:46.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.006+0000 7fbe5fe00640 1 -- 172.21.15.42:0/4252626568 learned_addr learned my addr 172.21.15.42:0/4252626568 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:46.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.007+0000 7fbe67e00640 1 --2- 172.21.15.42:0/4252626568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556567b3a5b0 0x556567f49c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.007+0000 7fbe67400640 1 --2- 172.21.15.42:0/4252626568 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556567b116f0 0x556567efb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.007+0000 7fbe5fe00640 1 -- 172.21.15.42:0/4252626568 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556567b116f0 msgr2=0x556567efb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:46.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.007+0000 7fbe5fe00640 1 --2- 172.21.15.42:0/4252626568 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556567b116f0 0x556567efb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.007+0000 7fbe5fe00640 1 -- 172.21.15.42:0/4252626568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556567b3a5b0 msgr2=0x556567f49c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:46.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.007+0000 7fbe5fe00640 1 --2- 172.21.15.42:0/4252626568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556567b3a5b0 0x556567f49c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.007+0000 7fbe5fe00640 1 -- 172.21.15.42:0/4252626568 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556567c1cd20 con 0x556567b198d0 2024-09-17T01:46:46.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.007+0000 7fbe5fe00640 1 --2- 172.21.15.42:0/4252626568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b198d0 0x556567f49720 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x556567ee2ad0 tx=0x7fbe50016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3e5522e3974edb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:46.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.007+0000 7fbe57400640 1 -- 172.21.15.42:0/4252626568 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5002d070 con 0x556567b198d0 2024-09-17T01:46:46.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.007+0000 7fbe57400640 1 -- 172.21.15.42:0/4252626568 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe50020630 con 0x556567b198d0 2024-09-17T01:46:46.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.007+0000 7fbe57400640 1 -- 172.21.15.42:0/4252626568 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe50020a80 con 0x556567b198d0 2024-09-17T01:46:46.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.008+0000 7fbe7561d740 1 -- 172.21.15.42:0/4252626568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b198d0 msgr2=0x556567f49720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:46.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.008+0000 7fbe7561d740 1 --2- 172.21.15.42:0/4252626568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b198d0 0x556567f49720 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x556567ee2ad0 tx=0x7fbe50016000 comp rx=0 tx=0).stop 2024-09-17T01:46:46.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.008+0000 7fbe7561d740 1 -- 172.21.15.42:0/4252626568 shutdown_connections 2024-09-17T01:46:46.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.008+0000 7fbe7561d740 1 --2- 172.21.15.42:0/4252626568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556567b3a5b0 0x556567f49c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.008+0000 7fbe7561d740 1 --2- 172.21.15.42:0/4252626568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b198d0 0x556567f49720 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.008+0000 7fbe7561d740 1 --2- 172.21.15.42:0/4252626568 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556567b116f0 0x556567efb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.008+0000 7fbe7561d740 1 -- 172.21.15.42:0/4252626568 >> 172.21.15.42:0/4252626568 conn(0x556567b2e700 msgr2=0x556567ee1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:46.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.008+0000 7fbe7561d740 1 -- 172.21.15.42:0/4252626568 shutdown_connections 2024-09-17T01:46:46.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.008+0000 7fbe7561d740 1 -- 172.21.15.42:0/4252626568 wait complete. 2024-09-17T01:46:46.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.009+0000 7fbe7561d740 1 -- start start 2024-09-17T01:46:46.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.009+0000 7fbe7561d740 1 Processor -- start 2024-09-17T01:46:46.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.011+0000 7fbe7561d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b116f0 0x556567faa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.011+0000 7fbe7561d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556567b198d0 0x556567faed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.011+0000 7fbe7561d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556567b3a5b0 0x556567f2d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.011+0000 7fbe7561d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556567ee1ef0 con 0x556567b116f0 2024-09-17T01:46:46.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.011+0000 7fbe7561d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbe680c61f0 con 0x556567b198d0 2024-09-17T01:46:46.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.011+0000 7fbe7561d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x556567ee5eb0 con 0x556567b3a5b0 2024-09-17T01:46:46.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.011+0000 7fbe7561d740 10 client.0 _ll_register_callbacks cb 0x7fbe5800c380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:46:46.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.011+0000 7fbe67400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b116f0 0x556567faa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.011+0000 7fbe67400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b116f0 0x556567faa880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59056/0 (socket says 172.21.15.42:59056) 2024-09-17T01:46:46.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.011+0000 7fbe67400640 1 -- 172.21.15.42:0/3864528090 learned_addr learned my addr 172.21.15.42:0/3864528090 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:46.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.012+0000 7fbe5fe00640 1 --2- 172.21.15.42:0/3864528090 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556567b198d0 0x556567faed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.012+0000 7fbe67e00640 1 --2- 172.21.15.42:0/3864528090 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556567b3a5b0 0x556567f2d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.012+0000 7fbe67400640 1 -- 172.21.15.42:0/3864528090 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556567b3a5b0 msgr2=0x556567f2d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:46.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.012+0000 7fbe67400640 1 --2- 172.21.15.42:0/3864528090 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556567b3a5b0 0x556567f2d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.012+0000 7fbe67400640 1 -- 172.21.15.42:0/3864528090 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556567b198d0 msgr2=0x556567faed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:46.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.012+0000 7fbe67400640 1 --2- 172.21.15.42:0/3864528090 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556567b198d0 0x556567faed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.012+0000 7fbe67400640 1 -- 172.21.15.42:0/3864528090 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556567faf2d0 con 0x556567b116f0 2024-09-17T01:46:46.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.012+0000 7fbe5fe00640 1 --2- 172.21.15.42:0/3864528090 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556567b198d0 0x556567faed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:46.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.012+0000 7fbe67e00640 1 --2- 172.21.15.42:0/3864528090 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556567b3a5b0 0x556567f2d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:46.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.012+0000 7fbe67400640 1 --2- 172.21.15.42:0/3864528090 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b116f0 0x556567faa880 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7fbe58061b40 tx=0x7fbe58061e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285a492f5d8ce146 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:46.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.012+0000 7fbe54c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:46:46.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.012+0000 7fbe54c00640 1 -- 172.21.15.42:0/3864528090 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe58064040 con 0x556567b116f0 2024-09-17T01:46:46.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.012+0000 7fbe54c00640 1 -- 172.21.15.42:0/3864528090 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7fbe5805d790 con 0x556567b116f0 2024-09-17T01:46:46.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.012+0000 7fbe7561d740 1 -- 172.21.15.42:0/3864528090 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe50020630 con 0x556567b116f0 2024-09-17T01:46:46.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.012+0000 7fbe54c00640 1 -- 172.21.15.42:0/3864528090 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) ==== 24+0+0 (secure 0 0 0) 0x7fbe58061790 con 0x556567b116f0 2024-09-17T01:46:46.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.012+0000 7fbe7561d740 10 client.10566 fetch_fsmap learned FSMap version 150 2024-09-17T01:46:46.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.012+0000 7fbe7561d740 1 -- 172.21.15.42:0/3864528090 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) -- 0x556567ee71f0 con 0x556567b116f0 2024-09-17T01:46:46.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.013+0000 7fbe54c00640 1 -- 172.21.15.42:0/3864528090 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe50020630 con 0x556567b116f0 2024-09-17T01:46:46.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.013+0000 7fbe54c00640 1 -- 172.21.15.42:0/3864528090 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 150) ==== 3502+0+0 (secure 0 0 0) 0x7fbe5806bab0 con 0x556567b116f0 2024-09-17T01:46:46.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.013+0000 7fbe7561d740 10 client.10566 fetch_fsmap finished waiting for FSMap version 150 2024-09-17T01:46:46.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.013+0000 7fbe7561d740 10 client.10566 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.b 2024-09-17T01:46:46.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.013+0000 7fbe7561d740 20 client.10566 populate_metadata read hostname 'smithi042' 2024-09-17T01:46:46.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.013+0000 7fbe7561d740 1 --2- 172.21.15.42:0/3864528090 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x556567f1ee10 0x556567f1f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.013+0000 7fbe7561d740 4 client.10566 mds_command: new command op to 10371 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-09-17T01:46:46.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.013+0000 7fbe7561d740 1 -- 172.21.15.42:0/3864528090 --> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) -- 0x556567e52370 con 0x556567f1ee10 2024-09-17T01:46:46.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.013+0000 7fbe5fe00640 1 --2- 172.21.15.42:0/3864528090 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x556567f1ee10 0x556567f1f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.014+0000 7fbe5fe00640 1 --2- 172.21.15.42:0/3864528090 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x556567f1ee10 0x556567f1f220 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=713dc63a584cf8d0 server_cookie=a0fb6fffb300d0ac in_seq=0 out_seq=0 2024-09-17T01:46:46.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.014+0000 7fbe54c00640 10 client.10566 ms_handle_connect on v2:172.21.15.43:6835/1477091047 2024-09-17T01:46:46.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.015+0000 7fbe54c00640 1 -- 172.21.15.42:0/3864528090 <== mds.0 v2:172.21.15.43:6835/1477091047 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556567e52370 con 0x556567f1ee10 2024-09-17T01:46:46.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.015+0000 7fbe54c00640 10 client.10566 handle_command_reply: tid=0 2024-09-17T01:46:46.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.015+0000 7fbe7561d740 1 client.10566 shutdown 2024-09-17T01:46:46.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.015+0000 7fbe7561d740 1 -- 172.21.15.42:0/3864528090 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b116f0 msgr2=0x556567faa880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:46.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.015+0000 7fbe7561d740 1 --2- 172.21.15.42:0/3864528090 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b116f0 0x556567faa880 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7fbe58061b40 tx=0x7fbe58061e40 comp rx=0 tx=0).stop 2024-09-17T01:46:46.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.015+0000 7fbe7561d740 1 -- 172.21.15.42:0/3864528090 shutdown_connections 2024-09-17T01:46:46.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.015+0000 7fbe7561d740 1 --2- 172.21.15.42:0/3864528090 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x556567f1ee10 0x556567f1f220 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.015+0000 7fbe7561d740 1 --2- 172.21.15.42:0/3864528090 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556567b198d0 0x556567faed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.015+0000 7fbe7561d740 1 --2- 172.21.15.42:0/3864528090 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556567b3a5b0 0x556567f2d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.015+0000 7fbe7561d740 1 --2- 172.21.15.42:0/3864528090 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556567b116f0 0x556567faa880 unknown :-1 s=CLOSED pgs=2181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.015+0000 7fbe7561d740 1 -- 172.21.15.42:0/3864528090 >> 172.21.15.42:0/3864528090 conn(0x556567b2e700 msgr2=0x556567f2df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:46.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.015+0000 7fbe54c00640 0 client.10566 ms_handle_reset on v2:172.21.15.43:6835/1477091047 2024-09-17T01:46:46.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.015+0000 7fbe7561d740 1 -- 172.21.15.42:0/3864528090 shutdown_connections 2024-09-17T01:46:46.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.015+0000 7fbe7561d740 1 -- 172.21.15.42:0/3864528090 wait complete. 2024-09-17T01:46:46.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.015+0000 7fbe7561d740 20 client.10566 trim_cache size 0 max 16384 2024-09-17T01:46:46.017 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:46:46.018 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-17T01:46:46.018 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "2dd447bb-fd64-4382-bc9e-fa971df9a7fa", 2024-09-17T01:46:46.018 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-17T01:46:46.018 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:46:46.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.016+0000 7fbe6e400640 1 -- 172.21.15.42:0/53089104 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbe44078bc0 msgr2=0x7fbe4407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:46.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.016+0000 7fbe6e400640 1 --2- 172.21.15.42:0/53089104 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbe44078bc0 0x7fbe4407b0d0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fbe680ae490 tx=0x7fbe50005f90 comp rx=0 tx=0).stop 2024-09-17T01:46:46.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.016+0000 7fbe6e400640 1 -- 172.21.15.42:0/53089104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe6806d430 msgr2=0x7fbe680aef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:46.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.016+0000 7fbe6e400640 1 --2- 172.21.15.42:0/53089104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe6806d430 0x7fbe680aef10 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7fbe5800c430 tx=0x7fbe5800c8f0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.016+0000 7fbe6e400640 1 -- 172.21.15.42:0/53089104 shutdown_connections 2024-09-17T01:46:46.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.016+0000 7fbe6e400640 1 --2- 172.21.15.42:0/53089104 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbe44078bc0 0x7fbe4407b0d0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.016+0000 7fbe6e400640 1 --2- 172.21.15.42:0/53089104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe680b56d0 0x7fbe68141cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.016+0000 7fbe6e400640 1 --2- 172.21.15.42:0/53089104 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbe680cdb20 0x7fbe680ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.016+0000 7fbe6e400640 1 --2- 172.21.15.42:0/53089104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe6806d430 0x7fbe680aef10 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.016+0000 7fbe6e400640 1 -- 172.21.15.42:0/53089104 >> 172.21.15.42:0/53089104 conn(0x7fbe680b28f0 msgr2=0x7fbe6806fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:46.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.016+0000 7fbe6e400640 1 -- 172.21.15.42:0/53089104 shutdown_connections 2024-09-17T01:46:46.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.016+0000 7fbe6e400640 1 -- 172.21.15.42:0/53089104 wait complete. 2024-09-17T01:46:46.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:46:46.039 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub status 2024-09-17T01:46:46.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.270+0000 7f8b75e00640 1 -- 172.21.15.42:0/1236669886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b700af910 msgr2=0x7f8b700ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:46.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.270+0000 7f8b75e00640 1 --2- 172.21.15.42:0/1236669886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b700af910 0x7f8b700ccb90 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7f8b64005fd0 tx=0x7f8b6402a540 comp rx=0 tx=0).stop 2024-09-17T01:46:46.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.270+0000 7f8b75e00640 1 -- 172.21.15.42:0/1236669886 shutdown_connections 2024-09-17T01:46:46.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.270+0000 7f8b75e00640 1 --2- 172.21.15.42:0/1236669886 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8b700b32b0 0x7f8b700b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.270+0000 7f8b75e00640 1 --2- 172.21.15.42:0/1236669886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b700af910 0x7f8b700ccb90 unknown :-1 s=CLOSED pgs=2182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.270+0000 7f8b75e00640 1 -- 172.21.15.42:0/1236669886 >> 172.21.15.42:0/1236669886 conn(0x7f8b7006d440 msgr2=0x7f8b700b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:46.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.270+0000 7f8b75e00640 1 -- 172.21.15.42:0/1236669886 shutdown_connections 2024-09-17T01:46:46.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.270+0000 7f8b75e00640 1 -- 172.21.15.42:0/1236669886 wait complete. 2024-09-17T01:46:46.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.272+0000 7f8b75e00640 1 Processor -- start 2024-09-17T01:46:46.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.272+0000 7f8b75e00640 1 -- start start 2024-09-17T01:46:46.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.274+0000 7f8b75e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b700af910 0x7f8b7009d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.274+0000 7f8b75e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b700b32b0 0x7f8b70150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.274+0000 7f8b75e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8b7015c6c0 0x7f8b7009aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.274+0000 7f8b75e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7006e680 con 0x7f8b700af910 2024-09-17T01:46:46.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.274+0000 7f8b75e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7006e500 con 0x7f8b700b32b0 2024-09-17T01:46:46.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.274+0000 7f8b75e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8b7006e800 con 0x7f8b7015c6c0 2024-09-17T01:46:46.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.274+0000 7f8b74a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b700af910 0x7f8b7009d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.274+0000 7f8b74a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b700af910 0x7f8b7009d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59078/0 (socket says 172.21.15.42:59078) 2024-09-17T01:46:46.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.274+0000 7f8b74a00640 1 -- 172.21.15.42:0/2322397270 learned_addr learned my addr 172.21.15.42:0/2322397270 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:46.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.274+0000 7f8b6fe00640 1 --2- 172.21.15.42:0/2322397270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b700b32b0 0x7f8b70150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.274+0000 7f8b75400640 1 --2- 172.21.15.42:0/2322397270 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8b7015c6c0 0x7f8b7009aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.275+0000 7f8b74a00640 1 -- 172.21.15.42:0/2322397270 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8b7015c6c0 msgr2=0x7f8b7009aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:46.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.275+0000 7f8b74a00640 1 --2- 172.21.15.42:0/2322397270 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8b7015c6c0 0x7f8b7009aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.275+0000 7f8b74a00640 1 -- 172.21.15.42:0/2322397270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b700b32b0 msgr2=0x7f8b70150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:46.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.275+0000 7f8b74a00640 1 --2- 172.21.15.42:0/2322397270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b700b32b0 0x7f8b70150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.275+0000 7f8b74a00640 1 -- 172.21.15.42:0/2322397270 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b7009e260 con 0x7f8b700af910 2024-09-17T01:46:46.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.275+0000 7f8b74a00640 1 --2- 172.21.15.42:0/2322397270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b700af910 0x7f8b7009d9e0 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f8b64034040 tx=0x7f8b640038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:46.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.275+0000 7f8b6cc00640 1 -- 172.21.15.42:0/2322397270 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6403e030 con 0x7f8b700af910 2024-09-17T01:46:46.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.275+0000 7f8b6cc00640 1 -- 172.21.15.42:0/2322397270 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b64003d90 con 0x7f8b700af910 2024-09-17T01:46:46.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.275+0000 7f8b6cc00640 1 -- 172.21.15.42:0/2322397270 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b64035040 con 0x7f8b700af910 2024-09-17T01:46:46.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.275+0000 7f8b75e00640 1 -- 172.21.15.42:0/2322397270 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b7015f250 con 0x7f8b700af910 2024-09-17T01:46:46.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.275+0000 7f8b75e00640 1 -- 172.21.15.42:0/2322397270 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b7015f810 con 0x7f8b700af910 2024-09-17T01:46:46.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.278+0000 7f8b6cc00640 1 -- 172.21.15.42:0/2322397270 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b64041030 con 0x7f8b700af910 2024-09-17T01:46:46.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.280+0000 7f8b6cc00640 1 --2- 172.21.15.42:0/2322397270 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b50078b90 0x7f8b5007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.280+0000 7f8b6cc00640 1 -- 172.21.15.42:0/2322397270 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f8b640bb5b0 con 0x7f8b700af910 2024-09-17T01:46:46.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.280+0000 7f8b7e3c1740 1 Processor -- start 2024-09-17T01:46:46.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.280+0000 7f8b6fe00640 1 --2- 172.21.15.42:0/2322397270 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b50078b90 0x7f8b5007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.280+0000 7f8b7e3c1740 1 -- start start 2024-09-17T01:46:46.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.281+0000 7f8b6fe00640 1 --2- 172.21.15.42:0/2322397270 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b50078b90 0x7f8b5007b0a0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f8b7009a6f0 tx=0x7f8b5c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:46.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.282+0000 7f8b7e3c1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d46390 0x561325134730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.282+0000 7f8b7e3c1740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561324d1d4d0 0x561325117400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.282+0000 7f8b7e3c1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561324d256b0 0x561325117940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.282+0000 7f8b7e3c1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56132504d1c0 con 0x561324d46390 2024-09-17T01:46:46.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.282+0000 7f8b7e3c1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561325060870 con 0x561324d256b0 2024-09-17T01:46:46.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.282+0000 7f8b7e3c1740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56132504fca0 con 0x561324d1d4d0 2024-09-17T01:46:46.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.282+0000 7f8b74a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d46390 0x561325134730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.282+0000 7f8b74a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d46390 0x561325134730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59084/0 (socket says 172.21.15.42:59084) 2024-09-17T01:46:46.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.282+0000 7f8b74a00640 1 -- 172.21.15.42:0/3251721408 learned_addr learned my addr 172.21.15.42:0/3251721408 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:46.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.282+0000 7f8b6fe00640 1 --2- 172.21.15.42:0/3251721408 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561324d1d4d0 0x561325117400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.283+0000 7f8b74a00640 1 -- 172.21.15.42:0/3251721408 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561324d1d4d0 msgr2=0x561325117400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:46.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.283+0000 7f8b74a00640 1 --2- 172.21.15.42:0/3251721408 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561324d1d4d0 0x561325117400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.283+0000 7f8b75400640 1 --2- 172.21.15.42:0/3251721408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561324d256b0 0x561325117940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.283+0000 7f8b74a00640 1 -- 172.21.15.42:0/3251721408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561324d256b0 msgr2=0x561325117940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:46.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.283+0000 7f8b74a00640 1 --2- 172.21.15.42:0/3251721408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561324d256b0 0x561325117940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.283+0000 7f8b74a00640 1 -- 172.21.15.42:0/3251721408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561324e287d0 con 0x561324d46390 2024-09-17T01:46:46.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.283+0000 7f8b6fe00640 1 --2- 172.21.15.42:0/3251721408 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561324d1d4d0 0x561325117400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:46.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.283+0000 7f8b75400640 1 --2- 172.21.15.42:0/3251721408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561324d256b0 0x561325117940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:46.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.283+0000 7f8b74a00640 1 --2- 172.21.15.42:0/3251721408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d46390 0x561325134730 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7f8b64083150 tx=0x7f8b64009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1edfcb057195e81 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:46.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.283+0000 7f8b61200640 1 -- 172.21.15.42:0/3251721408 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b64048030 con 0x561324d46390 2024-09-17T01:46:46.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.283+0000 7f8b61200640 1 -- 172.21.15.42:0/3251721408 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b64083250 con 0x561324d46390 2024-09-17T01:46:46.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.283+0000 7f8b61200640 1 -- 172.21.15.42:0/3251721408 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6408c9e0 con 0x561324d46390 2024-09-17T01:46:46.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.284+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/3251721408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d46390 msgr2=0x561325134730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:46.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.284+0000 7f8b7e3c1740 1 --2- 172.21.15.42:0/3251721408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d46390 0x561325134730 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7f8b64083150 tx=0x7f8b64009260 comp rx=0 tx=0).stop 2024-09-17T01:46:46.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.284+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/3251721408 shutdown_connections 2024-09-17T01:46:46.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.284+0000 7f8b7e3c1740 1 --2- 172.21.15.42:0/3251721408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561324d256b0 0x561325117940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.284+0000 7f8b7e3c1740 1 --2- 172.21.15.42:0/3251721408 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561324d1d4d0 0x561325117400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.284+0000 7f8b7e3c1740 1 --2- 172.21.15.42:0/3251721408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d46390 0x561325134730 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.284+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/3251721408 >> 172.21.15.42:0/3251721408 conn(0x561324d3a4e0 msgr2=0x5613250ed620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:46.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.284+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/3251721408 shutdown_connections 2024-09-17T01:46:46.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.284+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/3251721408 wait complete. 2024-09-17T01:46:46.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.285+0000 7f8b7e3c1740 1 -- start start 2024-09-17T01:46:46.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.285+0000 7f8b7e3c1740 1 Processor -- start 2024-09-17T01:46:46.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.287+0000 7f8b7e3c1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d1d4d0 0x56132512c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.287+0000 7f8b7e3c1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561324d256b0 0x561325105760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.287+0000 7f8b7e3c1740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561324d46390 0x561325130580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.287+0000 7f8b7e3c1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561324ff6410 con 0x561324d1d4d0 2024-09-17T01:46:46.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.287+0000 7f8b7e3c1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561325053ab0 con 0x561324d256b0 2024-09-17T01:46:46.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.287+0000 7f8b7e3c1740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x561324dc0740 con 0x561324d46390 2024-09-17T01:46:46.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.287+0000 7f8b7e3c1740 10 client.0 _ll_register_callbacks cb 0x561324fd3360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:46:46.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.287+0000 7f8b74a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d1d4d0 0x56132512c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.287+0000 7f8b74a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d1d4d0 0x56132512c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59100/0 (socket says 172.21.15.42:59100) 2024-09-17T01:46:46.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.287+0000 7f8b74a00640 1 -- 172.21.15.42:0/1817302173 learned_addr learned my addr 172.21.15.42:0/1817302173 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:46.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.287+0000 7f8b75400640 1 --2- 172.21.15.42:0/1817302173 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561324d46390 0x561325130580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.287+0000 7f8b6fe00640 1 --2- 172.21.15.42:0/1817302173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561324d256b0 0x561325105760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.287+0000 7f8b74a00640 1 -- 172.21.15.42:0/1817302173 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561324d46390 msgr2=0x561325130580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:46.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.287+0000 7f8b74a00640 1 --2- 172.21.15.42:0/1817302173 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561324d46390 0x561325130580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.287+0000 7f8b74a00640 1 -- 172.21.15.42:0/1817302173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561324d256b0 msgr2=0x561325105760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:46.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.287+0000 7f8b74a00640 1 --2- 172.21.15.42:0/1817302173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561324d256b0 0x561325105760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.287+0000 7f8b74a00640 1 -- 172.21.15.42:0/1817302173 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561324db1970 con 0x561324d1d4d0 2024-09-17T01:46:46.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.287+0000 7f8b75400640 1 --2- 172.21.15.42:0/1817302173 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561324d46390 0x561325130580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:46.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.288+0000 7f8b74a00640 1 --2- 172.21.15.42:0/1817302173 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d1d4d0 0x56132512c7d0 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7f8b640a7040 tx=0x7f8b6408ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5aae099d4562ffe server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:46.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.288+0000 7f8b55600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:46:46.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.288+0000 7f8b55600640 1 -- 172.21.15.42:0/1817302173 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b64048040 con 0x561324d1d4d0 2024-09-17T01:46:46.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.288+0000 7f8b55600640 1 -- 172.21.15.42:0/1817302173 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f8b6406ada0 con 0x561324d1d4d0 2024-09-17T01:46:46.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.288+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/1817302173 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b64083250 con 0x561324d1d4d0 2024-09-17T01:46:46.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.288+0000 7f8b55600640 1 -- 172.21.15.42:0/1817302173 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) ==== 24+0+0 (secure 0 0 0) 0x7f8b64087d30 con 0x561324d1d4d0 2024-09-17T01:46:46.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.288+0000 7f8b7e3c1740 10 client.10578 fetch_fsmap learned FSMap version 150 2024-09-17T01:46:46.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.288+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/1817302173 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) -- 0x561324d8f6a0 con 0x561324d1d4d0 2024-09-17T01:46:46.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.288+0000 7f8b55600640 1 -- 172.21.15.42:0/1817302173 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b64083250 con 0x561324d1d4d0 2024-09-17T01:46:46.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.289+0000 7f8b55600640 1 -- 172.21.15.42:0/1817302173 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 150) ==== 3502+0+0 (secure 0 0 0) 0x7f8b640bb0c0 con 0x561324d1d4d0 2024-09-17T01:46:46.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.289+0000 7f8b7e3c1740 10 client.10578 fetch_fsmap finished waiting for FSMap version 150 2024-09-17T01:46:46.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.289+0000 7f8b7e3c1740 10 client.10578 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.b 2024-09-17T01:46:46.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.289+0000 7f8b7e3c1740 20 client.10578 populate_metadata read hostname 'smithi042' 2024-09-17T01:46:46.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.289+0000 7f8b7e3c1740 1 --2- 172.21.15.42:0/1817302173 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x561324d04f60 0x561325144730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.289+0000 7f8b7e3c1740 4 client.10578 mds_command: new command op to 10371 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:46:46.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.289+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/1817302173 --> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613250627c0 con 0x561324d04f60 2024-09-17T01:46:46.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.289+0000 7f8b6fe00640 1 --2- 172.21.15.42:0/1817302173 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x561324d04f60 0x561325144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.290+0000 7f8b6fe00640 1 --2- 172.21.15.42:0/1817302173 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x561324d04f60 0x561325144730 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cddce6d58c11a02 server_cookie=18ecbaac57f49695 in_seq=0 out_seq=0 2024-09-17T01:46:46.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.290+0000 7f8b55600640 10 client.10578 ms_handle_connect on v2:172.21.15.43:6835/1477091047 2024-09-17T01:46:46.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.291+0000 7f8b55600640 1 -- 172.21.15.42:0/1817302173 <== mds.0 v2:172.21.15.43:6835/1477091047 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5613250627c0 con 0x561324d04f60 2024-09-17T01:46:46.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.291+0000 7f8b55600640 10 client.10578 handle_command_reply: tid=0 2024-09-17T01:46:46.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.291+0000 7f8b7e3c1740 1 client.10578 shutdown 2024-09-17T01:46:46.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.291+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/1817302173 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d1d4d0 msgr2=0x56132512c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:46.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.291+0000 7f8b7e3c1740 1 --2- 172.21.15.42:0/1817302173 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d1d4d0 0x56132512c7d0 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7f8b640a7040 tx=0x7f8b6408ca90 comp rx=0 tx=0).stop 2024-09-17T01:46:46.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.291+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/1817302173 shutdown_connections 2024-09-17T01:46:46.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.291+0000 7f8b7e3c1740 1 --2- 172.21.15.42:0/1817302173 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x561324d04f60 0x561325144730 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.291+0000 7f8b7e3c1740 1 --2- 172.21.15.42:0/1817302173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561324d256b0 0x561325105760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.291+0000 7f8b7e3c1740 1 --2- 172.21.15.42:0/1817302173 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561324d46390 0x561325130580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.291+0000 7f8b7e3c1740 1 --2- 172.21.15.42:0/1817302173 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d1d4d0 0x56132512c7d0 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.291+0000 7f8b55600640 0 client.10578 ms_handle_reset on v2:172.21.15.43:6835/1477091047 2024-09-17T01:46:46.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.291+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/1817302173 >> 172.21.15.42:0/1817302173 conn(0x561324d3a4e0 msgr2=0x561325106bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:46.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.292+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/1817302173 shutdown_connections 2024-09-17T01:46:46.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.292+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/1817302173 wait complete. 2024-09-17T01:46:46.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.292+0000 7f8b7e3c1740 20 client.10578 trim_cache size 0 max 16384 2024-09-17T01:46:46.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.310+0000 7f8b7e3c1740 1 Processor -- start 2024-09-17T01:46:46.308 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.310+0000 7f8b7e3c1740 1 -- start start 2024-09-17T01:46:46.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.312+0000 7f8b7e3c1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561324d1d4d0 0x5613250ee4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.312+0000 7f8b7e3c1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d256b0 0x561325155000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.312+0000 7f8b7e3c1740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561324d46390 0x561325155540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.312+0000 7f8b7e3c1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8b70200060 con 0x561324d256b0 2024-09-17T01:46:46.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.312+0000 7f8b7e3c1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8b701f7d60 con 0x561324d1d4d0 2024-09-17T01:46:46.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.312+0000 7f8b7e3c1740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8b701f70c0 con 0x561324d46390 2024-09-17T01:46:46.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.312+0000 7f8b6fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d256b0 0x561325155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.312+0000 7f8b6fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d256b0 0x561325155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59108/0 (socket says 172.21.15.42:59108) 2024-09-17T01:46:46.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.312+0000 7f8b6fe00640 1 -- 172.21.15.42:0/2956922860 learned_addr learned my addr 172.21.15.42:0/2956922860 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:46.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.312+0000 7f8b74a00640 1 --2- 172.21.15.42:0/2956922860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561324d1d4d0 0x5613250ee4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.312+0000 7f8b75400640 1 --2- 172.21.15.42:0/2956922860 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561324d46390 0x561325155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.312+0000 7f8b6fe00640 1 -- 172.21.15.42:0/2956922860 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561324d46390 msgr2=0x561325155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:46.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.312+0000 7f8b6fe00640 1 --2- 172.21.15.42:0/2956922860 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561324d46390 0x561325155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.312+0000 7f8b6fe00640 1 -- 172.21.15.42:0/2956922860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561324d1d4d0 msgr2=0x5613250ee4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:46.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.312+0000 7f8b6fe00640 1 --2- 172.21.15.42:0/2956922860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561324d1d4d0 0x5613250ee4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.312+0000 7f8b6fe00640 1 -- 172.21.15.42:0/2956922860 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613250eeec0 con 0x561324d256b0 2024-09-17T01:46:46.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.312+0000 7f8b75400640 1 --2- 172.21.15.42:0/2956922860 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561324d46390 0x561325155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:46.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.313+0000 7f8b6fe00640 1 --2- 172.21.15.42:0/2956922860 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d256b0 0x561325155000 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7f8b70072240 tx=0x7f8b5c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c06b8646a4d088a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:46.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.313+0000 7f8b57e00640 1 -- 172.21.15.42:0/2956922860 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c02b430 con 0x561324d256b0 2024-09-17T01:46:46.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.313+0000 7f8b57e00640 1 -- 172.21.15.42:0/2956922860 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b5c02b5d0 con 0x561324d256b0 2024-09-17T01:46:46.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.313+0000 7f8b57e00640 1 -- 172.21.15.42:0/2956922860 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c02b820 con 0x561324d256b0 2024-09-17T01:46:46.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.314+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/2956922860 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d256b0 msgr2=0x561325155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:46.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.314+0000 7f8b7e3c1740 1 --2- 172.21.15.42:0/2956922860 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d256b0 0x561325155000 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7f8b70072240 tx=0x7f8b5c012000 comp rx=0 tx=0).stop 2024-09-17T01:46:46.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.314+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/2956922860 shutdown_connections 2024-09-17T01:46:46.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.314+0000 7f8b7e3c1740 1 --2- 172.21.15.42:0/2956922860 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561324d46390 0x561325155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.314+0000 7f8b7e3c1740 1 --2- 172.21.15.42:0/2956922860 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d256b0 0x561325155000 unknown :-1 s=CLOSED pgs=2186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.314+0000 7f8b7e3c1740 1 --2- 172.21.15.42:0/2956922860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561324d1d4d0 0x5613250ee4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.314+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/2956922860 >> 172.21.15.42:0/2956922860 conn(0x561324d3a4e0 msgr2=0x561325131df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:46.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.314+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/2956922860 shutdown_connections 2024-09-17T01:46:46.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.314+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/2956922860 wait complete. 2024-09-17T01:46:46.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.315+0000 7f8b7e3c1740 1 -- start start 2024-09-17T01:46:46.314 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.315+0000 7f8b7e3c1740 1 Processor -- start 2024-09-17T01:46:46.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.316+0000 7f8b7e3c1740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561324d1d4d0 0x5613251b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.316+0000 7f8b7e3c1740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d256b0 0x561325154590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.316+0000 7f8b7e3c1740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561324d46390 0x561325116280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.316+0000 7f8b7e3c1740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5613250ed9e0 con 0x561324d256b0 2024-09-17T01:46:46.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.316+0000 7f8b7e3c1740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8b701f7710 con 0x561324d46390 2024-09-17T01:46:46.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.316+0000 7f8b7e3c1740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x561325055f50 con 0x561324d1d4d0 2024-09-17T01:46:46.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.317+0000 7f8b7e3c1740 10 client.0 _ll_register_callbacks cb 0x7f8b64083020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:46:46.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.317+0000 7f8b6fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d256b0 0x561325154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.317+0000 7f8b6fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d256b0 0x561325154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59110/0 (socket says 172.21.15.42:59110) 2024-09-17T01:46:46.317 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.317+0000 7f8b6fe00640 1 -- 172.21.15.42:0/3508386448 learned_addr learned my addr 172.21.15.42:0/3508386448 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:46:46.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.317+0000 7f8b75400640 1 --2- 172.21.15.42:0/3508386448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561324d46390 0x561325116280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.317+0000 7f8b74a00640 1 --2- 172.21.15.42:0/3508386448 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561324d1d4d0 0x5613251b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.317+0000 7f8b6fe00640 1 -- 172.21.15.42:0/3508386448 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561324d1d4d0 msgr2=0x5613251b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:46.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.317+0000 7f8b6fe00640 1 --2- 172.21.15.42:0/3508386448 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561324d1d4d0 0x5613251b59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.317+0000 7f8b6fe00640 1 -- 172.21.15.42:0/3508386448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561324d46390 msgr2=0x561325116280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:46:46.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.317+0000 7f8b6fe00640 1 --2- 172.21.15.42:0/3508386448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561324d46390 0x561325116280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.317+0000 7f8b6fe00640 1 -- 172.21.15.42:0/3508386448 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613251b5ef0 con 0x561324d256b0 2024-09-17T01:46:46.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.318+0000 7f8b6fe00640 1 --2- 172.21.15.42:0/3508386448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d256b0 0x561325154590 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c003e50 tx=0x7f8b5c02ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f462e1933e22aab server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:46.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.318+0000 7f8b55600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:46:46.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.318+0000 7f8b55600640 1 -- 172.21.15.42:0/3508386448 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c02b430 con 0x561324d256b0 2024-09-17T01:46:46.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.318+0000 7f8b55600640 1 -- 172.21.15.42:0/3508386448 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f8b5c034aa0 con 0x561324d256b0 2024-09-17T01:46:46.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.318+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/3508386448 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b5c02b5d0 con 0x561324d256b0 2024-09-17T01:46:46.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.318+0000 7f8b55600640 1 -- 172.21.15.42:0/3508386448 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) ==== 24+0+0 (secure 0 0 0) 0x7f8b5c034ce0 con 0x561324d256b0 2024-09-17T01:46:46.318 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.318+0000 7f8b7e3c1740 10 client.10584 fetch_fsmap learned FSMap version 150 2024-09-17T01:46:46.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.318+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/3508386448 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) -- 0x561325144cb0 con 0x561324d256b0 2024-09-17T01:46:46.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.318+0000 7f8b55600640 1 -- 172.21.15.42:0/3508386448 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b5c02b5d0 con 0x561324d256b0 2024-09-17T01:46:46.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.319+0000 7f8b55600640 1 -- 172.21.15.42:0/3508386448 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 150) ==== 3502+0+0 (secure 0 0 0) 0x7f8b5c00e660 con 0x561324d256b0 2024-09-17T01:46:46.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.319+0000 7f8b7e3c1740 10 client.10584 fetch_fsmap finished waiting for FSMap version 150 2024-09-17T01:46:46.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.319+0000 7f8b7e3c1740 10 client.10584 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.b 2024-09-17T01:46:46.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.319+0000 7f8b7e3c1740 20 client.10584 populate_metadata read hostname 'smithi042' 2024-09-17T01:46:46.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.319+0000 7f8b7e3c1740 1 --2- 172.21.15.42:0/3508386448 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x56132510e1e0 0x56132510e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:46.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.319+0000 7f8b7e3c1740 4 client.10584 mds_command: new command op to 10371 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:46:46.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.319+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/3508386448 --> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561325132bf0 con 0x56132510e1e0 2024-09-17T01:46:46.319 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.319+0000 7f8b74a00640 1 --2- 172.21.15.42:0/3508386448 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x56132510e1e0 0x56132510e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:46.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.320+0000 7f8b74a00640 1 --2- 172.21.15.42:0/3508386448 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x56132510e1e0 0x56132510e5f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=371f614c7ddd0174 server_cookie=de0ce85a4aa4edeb in_seq=0 out_seq=0 2024-09-17T01:46:46.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.320+0000 7f8b55600640 10 client.10584 ms_handle_connect on v2:172.21.15.43:6835/1477091047 2024-09-17T01:46:46.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.320+0000 7f8b55600640 1 -- 172.21.15.42:0/3508386448 <== mds.0 v2:172.21.15.43:6835/1477091047 1 ==== command_reply(tid 0: 0 ) ==== 8+0+574 (crc 0 0 0) 0x561325132bf0 con 0x56132510e1e0 2024-09-17T01:46:46.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.320+0000 7f8b55600640 10 client.10584 handle_command_reply: tid=0 2024-09-17T01:46:46.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.320+0000 7f8b7e3c1740 1 client.10584 shutdown 2024-09-17T01:46:46.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.320+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/3508386448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d256b0 msgr2=0x561325154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:46.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.320+0000 7f8b7e3c1740 1 --2- 172.21.15.42:0/3508386448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d256b0 0x561325154590 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c003e50 tx=0x7f8b5c02ca40 comp rx=0 tx=0).stop 2024-09-17T01:46:46.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.320+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/3508386448 shutdown_connections 2024-09-17T01:46:46.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.320+0000 7f8b7e3c1740 1 --2- 172.21.15.42:0/3508386448 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x56132510e1e0 0x56132510e5f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.320+0000 7f8b7e3c1740 1 --2- 172.21.15.42:0/3508386448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561324d46390 0x561325116280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.320+0000 7f8b7e3c1740 1 --2- 172.21.15.42:0/3508386448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561324d256b0 0x561325154590 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.320+0000 7f8b55600640 0 client.10584 ms_handle_reset on v2:172.21.15.43:6835/1477091047 2024-09-17T01:46:46.321 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.320+0000 7f8b7e3c1740 1 --2- 172.21.15.42:0/3508386448 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x561324d1d4d0 0x5613251b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.320+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/3508386448 >> 172.21.15.42:0/3508386448 conn(0x561324d3a4e0 msgr2=0x561325130480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:46.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.320+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/3508386448 shutdown_connections 2024-09-17T01:46:46.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.321+0000 7f8b7e3c1740 1 -- 172.21.15.42:0/3508386448 wait complete. 2024-09-17T01:46:46.322 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.321+0000 7f8b7e3c1740 20 client.10584 trim_cache size 0 max 16384 2024-09-17T01:46:46.322 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:46:46.322 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T01:46:46.322 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-09-17T01:46:46.322 INFO:teuthology.orchestra.run.smithi042.stdout: "2dd447bb-fd64-4382-bc9e-fa971df9a7fa": { 2024-09-17T01:46:46.322 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "~mds0", 2024-09-17T01:46:46.322 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "2dd447bb-fd64-4382-bc9e-fa971df9a7fa", 2024-09-17T01:46:46.323 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive" 2024-09-17T01:46:46.323 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:46:46.323 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:46:46.323 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_stats": { 2024-09-17T01:46:46.323 INFO:teuthology.orchestra.run.smithi042.stdout: "2dd447bb-fd64-4382-bc9e-fa971df9a7fa": { 2024-09-17T01:46:46.323 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:46:46.014451+0000", 2024-09-17T01:46:46.323 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "~mdsdir", 2024-09-17T01:46:46.323 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:46:46.323 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:46:46.323 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:46:46.323 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:46:46.323 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:46:46.323 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:46:46.323 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:46:46.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.321+0000 7f8b75e00640 1 -- 172.21.15.42:0/2322397270 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b50078b90 msgr2=0x7f8b5007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:46.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.321+0000 7f8b75e00640 1 --2- 172.21.15.42:0/2322397270 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b50078b90 0x7f8b5007b0a0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f8b7009a6f0 tx=0x7f8b5c009040 comp rx=0 tx=0).stop 2024-09-17T01:46:46.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.321+0000 7f8b75e00640 1 -- 172.21.15.42:0/2322397270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b700af910 msgr2=0x7f8b7009d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:46.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.321+0000 7f8b75e00640 1 --2- 172.21.15.42:0/2322397270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b700af910 0x7f8b7009d9e0 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f8b64034040 tx=0x7f8b640038a0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.321+0000 7f8b75e00640 1 -- 172.21.15.42:0/2322397270 shutdown_connections 2024-09-17T01:46:46.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.321+0000 7f8b75e00640 1 --2- 172.21.15.42:0/2322397270 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8b50078b90 0x7f8b5007b0a0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.321+0000 7f8b75e00640 1 --2- 172.21.15.42:0/2322397270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b700b32b0 0x7f8b70150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.321+0000 7f8b75e00640 1 --2- 172.21.15.42:0/2322397270 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8b7015c6c0 0x7f8b7009aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.321+0000 7f8b75e00640 1 --2- 172.21.15.42:0/2322397270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b700af910 0x7f8b7009d9e0 unknown :-1 s=CLOSED pgs=2183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:46.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.321+0000 7f8b75e00640 1 -- 172.21.15.42:0/2322397270 >> 172.21.15.42:0/2322397270 conn(0x7f8b7006d440 msgr2=0x7f8b7006f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:46.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.322+0000 7f8b75e00640 1 -- 172.21.15.42:0/2322397270 shutdown_connections 2024-09-17T01:46:46.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:46:46.322+0000 7f8b75e00640 1 -- 172.21.15.42:0/2322397270 wait complete. 2024-09-17T01:46:46.346 INFO:tasks.cephfs.filesystem:scrub status for tag:2dd447bb-fd64-4382-bc9e-fa971df9a7fa - {'path': '~mds0', 'tag': '2dd447bb-fd64-4382-bc9e-fa971df9a7fa', 'options': 'recursive'} 2024-09-17T01:46:51.937 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:46:51.942 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:47:16.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:47:16.349 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub status 2024-09-17T01:47:16.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.590+0000 7f6fa9400640 1 -- 172.21.15.42:0/1234364813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fa40b3550 msgr2=0x7f6fa415cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:16.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.591+0000 7f6fa9400640 1 --2- 172.21.15.42:0/1234364813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fa40b3550 0x7f6fa415cec0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009830 tx=0x7f6f9402a480 comp rx=0 tx=0).stop 2024-09-17T01:47:16.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.591+0000 7f6fa9400640 1 -- 172.21.15.42:0/1234364813 shutdown_connections 2024-09-17T01:47:16.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.591+0000 7f6fa9400640 1 --2- 172.21.15.42:0/1234364813 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6fa4142f40 0x7f6fa4072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.591+0000 7f6fa9400640 1 --2- 172.21.15.42:0/1234364813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fa40b3550 0x7f6fa415cec0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.591+0000 7f6fa9400640 1 -- 172.21.15.42:0/1234364813 >> 172.21.15.42:0/1234364813 conn(0x7f6fa40b2930 msgr2=0x7f6fa406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:16.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.591+0000 7f6fa9400640 1 -- 172.21.15.42:0/1234364813 shutdown_connections 2024-09-17T01:47:16.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.591+0000 7f6fa9400640 1 -- 172.21.15.42:0/1234364813 wait complete. 2024-09-17T01:47:16.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.593+0000 7f6fa9400640 1 Processor -- start 2024-09-17T01:47:16.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.593+0000 7f6fa9400640 1 -- start start 2024-09-17T01:47:16.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.594+0000 7f6fa9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6fa4072e90 0x7f6fa413ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.594+0000 7f6fa9400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fa40b3550 0x7f6fa406eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.594+0000 7f6fa9400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6fa4142f40 0x7f6fa4140bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.594+0000 7f6fa9400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa406d7c0 con 0x7f6fa4072e90 2024-09-17T01:47:16.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.594+0000 7f6fa9400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa406d640 con 0x7f6fa40b3550 2024-09-17T01:47:16.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.594+0000 7f6fa9400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6fa406d940 con 0x7f6fa4142f40 2024-09-17T01:47:16.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.595+0000 7f6fa2800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6fa4072e90 0x7f6fa413ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.595+0000 7f6fa2800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6fa4072e90 0x7f6fa413ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55478/0 (socket says 172.21.15.42:55478) 2024-09-17T01:47:16.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.595+0000 7f6fa2800640 1 -- 172.21.15.42:0/1680399851 learned_addr learned my addr 172.21.15.42:0/1680399851 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:16.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.595+0000 7f6f99e00640 1 --2- 172.21.15.42:0/1680399851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fa40b3550 0x7f6fa406eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.595+0000 7f6fa3200640 1 --2- 172.21.15.42:0/1680399851 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6fa4142f40 0x7f6fa4140bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.595+0000 7f6fa2800640 1 -- 172.21.15.42:0/1680399851 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6fa4142f40 msgr2=0x7f6fa4140bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:16.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.595+0000 7f6fa2800640 1 --2- 172.21.15.42:0/1680399851 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6fa4142f40 0x7f6fa4140bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.595+0000 7f6fa2800640 1 -- 172.21.15.42:0/1680399851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fa40b3550 msgr2=0x7f6fa406eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:16.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.595+0000 7f6fa2800640 1 --2- 172.21.15.42:0/1680399851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fa40b3550 0x7f6fa406eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.595+0000 7f6fa2800640 1 -- 172.21.15.42:0/1680399851 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa4158c90 con 0x7f6fa4072e90 2024-09-17T01:47:16.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.595+0000 7f6f99e00640 1 --2- 172.21.15.42:0/1680399851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fa40b3550 0x7f6fa406eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:47:16.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.596+0000 7f6fa2800640 1 --2- 172.21.15.42:0/1680399851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6fa4072e90 0x7f6fa413ec30 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009950 tx=0x7f6f94033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:16.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.596+0000 7f6f9b400640 1 -- 172.21.15.42:0/1680399851 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94031d60 con 0x7f6fa4072e90 2024-09-17T01:47:16.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.596+0000 7f6f9b400640 1 -- 172.21.15.42:0/1680399851 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f94033e50 con 0x7f6fa4072e90 2024-09-17T01:47:16.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.596+0000 7f6fa9400640 1 -- 172.21.15.42:0/1680399851 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa4158f00 con 0x7f6fa4072e90 2024-09-17T01:47:16.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.596+0000 7f6f9b400640 1 -- 172.21.15.42:0/1680399851 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94033310 con 0x7f6fa4072e90 2024-09-17T01:47:16.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.596+0000 7f6fa9400640 1 -- 172.21.15.42:0/1680399851 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa41594c0 con 0x7f6fa4072e90 2024-09-17T01:47:16.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.598+0000 7f6f9b400640 1 -- 172.21.15.42:0/1680399851 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6f940334b0 con 0x7f6fa4072e90 2024-09-17T01:47:16.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.599+0000 7f6f9b400640 1 --2- 172.21.15.42:0/1680399851 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6f80078b90 0x7f6f8007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.599+0000 7f6f9b400640 1 -- 172.21.15.42:0/1680399851 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5767+0+0 (secure 0 0 0) 0x7f6f940bc210 con 0x7f6fa4072e90 2024-09-17T01:47:16.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.600+0000 7f6f99e00640 1 --2- 172.21.15.42:0/1680399851 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6f80078b90 0x7f6f8007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.600+0000 7f6fb05ff740 1 Processor -- start 2024-09-17T01:47:16.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.600+0000 7f6fb05ff740 1 -- start start 2024-09-17T01:47:16.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.601+0000 7f6f99e00640 1 --2- 172.21.15.42:0/1680399851 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6f80078b90 0x7f6f8007b0a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4074c00 tx=0x7f6f8c005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:16.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.601+0000 7f6fb05ff740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f54d835390 0x55f54dc23550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.601+0000 7f6fb05ff740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f54d80c4d0 0x55f54dc06220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.601+0000 7f6fb05ff740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d8146b0 0x55f54dc06760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.601+0000 7f6fb05ff740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f54db3c1c0 con 0x55f54d8146b0 2024-09-17T01:47:16.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.601+0000 7f6fb05ff740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f54db4f870 con 0x55f54d80c4d0 2024-09-17T01:47:16.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.601+0000 7f6fb05ff740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55f54db3eca0 con 0x55f54d835390 2024-09-17T01:47:16.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.602+0000 7f6fa3200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d8146b0 0x55f54dc06760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.602+0000 7f6fa3200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d8146b0 0x55f54dc06760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55482/0 (socket says 172.21.15.42:55482) 2024-09-17T01:47:16.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.602+0000 7f6fa3200640 1 -- 172.21.15.42:0/4010265415 learned_addr learned my addr 172.21.15.42:0/4010265415 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:16.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.602+0000 7f6f99e00640 1 --2- 172.21.15.42:0/4010265415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f54d80c4d0 0x55f54dc06220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.602+0000 7f6fa2800640 1 --2- 172.21.15.42:0/4010265415 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f54d835390 0x55f54dc23550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.602+0000 7f6fa3200640 1 -- 172.21.15.42:0/4010265415 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f54d835390 msgr2=0x55f54dc23550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:16.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.602+0000 7f6fa3200640 1 --2- 172.21.15.42:0/4010265415 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f54d835390 0x55f54dc23550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.602+0000 7f6fa3200640 1 -- 172.21.15.42:0/4010265415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f54d80c4d0 msgr2=0x55f54dc06220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:16.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.602+0000 7f6fa3200640 1 --2- 172.21.15.42:0/4010265415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f54d80c4d0 0x55f54dc06220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.602+0000 7f6fa3200640 1 -- 172.21.15.42:0/4010265415 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f54d9177d0 con 0x55f54d8146b0 2024-09-17T01:47:16.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.602+0000 7f6f99e00640 1 --2- 172.21.15.42:0/4010265415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f54d80c4d0 0x55f54dc06220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:47:16.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.602+0000 7f6fa3200640 1 --2- 172.21.15.42:0/4010265415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d8146b0 0x55f54dc06760 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c002060 tx=0x7f6f9c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179bc7b58a39f4d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:16.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.603+0000 7f6f93000640 1 -- 172.21.15.42:0/4010265415 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c014480 con 0x55f54d8146b0 2024-09-17T01:47:16.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.603+0000 7f6f93000640 1 -- 172.21.15.42:0/4010265415 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f9c019070 con 0x55f54d8146b0 2024-09-17T01:47:16.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.603+0000 7f6f93000640 1 -- 172.21.15.42:0/4010265415 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c014970 con 0x55f54d8146b0 2024-09-17T01:47:16.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.603+0000 7f6fb05ff740 1 -- 172.21.15.42:0/4010265415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d8146b0 msgr2=0x55f54dc06760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:16.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.603+0000 7f6fb05ff740 1 --2- 172.21.15.42:0/4010265415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d8146b0 0x55f54dc06760 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c002060 tx=0x7f6f9c00e530 comp rx=0 tx=0).stop 2024-09-17T01:47:16.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.603+0000 7f6fb05ff740 1 -- 172.21.15.42:0/4010265415 shutdown_connections 2024-09-17T01:47:16.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.603+0000 7f6fb05ff740 1 --2- 172.21.15.42:0/4010265415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f54d80c4d0 0x55f54dc06220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.603+0000 7f6fb05ff740 1 --2- 172.21.15.42:0/4010265415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d8146b0 0x55f54dc06760 unknown :-1 s=CLOSED pgs=2189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.603+0000 7f6fb05ff740 1 --2- 172.21.15.42:0/4010265415 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f54d835390 0x55f54dc23550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.603+0000 7f6fb05ff740 1 -- 172.21.15.42:0/4010265415 >> 172.21.15.42:0/4010265415 conn(0x55f54d8294e0 msgr2=0x55f54dbdc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:16.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.604+0000 7f6fb05ff740 1 -- 172.21.15.42:0/4010265415 shutdown_connections 2024-09-17T01:47:16.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.604+0000 7f6fb05ff740 1 -- 172.21.15.42:0/4010265415 wait complete. 2024-09-17T01:47:16.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.605+0000 7f6fb05ff740 1 -- start start 2024-09-17T01:47:16.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.605+0000 7f6fb05ff740 1 Processor -- start 2024-09-17T01:47:16.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.606+0000 7f6fb05ff740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f54d80c4d0 0x55f54dbf4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.606+0000 7f6fb05ff740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d8146b0 0x55f54dc17d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.606+0000 7f6fb05ff740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f54d835390 0x55f54dc19350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.607+0000 7f6fb05ff740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f54dae5410 con 0x55f54d8146b0 2024-09-17T01:47:16.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.607+0000 7f6fb05ff740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f54db42ab0 con 0x55f54d835390 2024-09-17T01:47:16.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.607+0000 7f6fb05ff740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55f54d8af740 con 0x55f54d80c4d0 2024-09-17T01:47:16.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.607+0000 7f6fb05ff740 10 client.0 _ll_register_callbacks cb 0x55f54dac2360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:47:16.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.607+0000 7f6f99e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d8146b0 0x55f54dc17d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.607+0000 7f6f99e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d8146b0 0x55f54dc17d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55490/0 (socket says 172.21.15.42:55490) 2024-09-17T01:47:16.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.607+0000 7f6f99e00640 1 -- 172.21.15.42:0/4126196070 learned_addr learned my addr 172.21.15.42:0/4126196070 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:16.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.607+0000 7f6fa3200640 1 --2- 172.21.15.42:0/4126196070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f54d835390 0x55f54dc19350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.607+0000 7f6fa2800640 1 --2- 172.21.15.42:0/4126196070 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f54d80c4d0 0x55f54dbf4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.607+0000 7f6f99e00640 1 -- 172.21.15.42:0/4126196070 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f54d80c4d0 msgr2=0x55f54dbf4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:16.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.607+0000 7f6f99e00640 1 --2- 172.21.15.42:0/4126196070 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f54d80c4d0 0x55f54dbf4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.607+0000 7f6f99e00640 1 -- 172.21.15.42:0/4126196070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f54d835390 msgr2=0x55f54dc19350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:16.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.607+0000 7f6f99e00640 1 --2- 172.21.15.42:0/4126196070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f54d835390 0x55f54dc19350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.607+0000 7f6f99e00640 1 -- 172.21.15.42:0/4126196070 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f54d8a0970 con 0x55f54d8146b0 2024-09-17T01:47:16.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.607+0000 7f6fa3200640 1 --2- 172.21.15.42:0/4126196070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f54d835390 0x55f54dc19350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:47:16.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.607+0000 7f6fa2800640 1 --2- 172.21.15.42:0/4126196070 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f54d80c4d0 0x55f54dbf4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:47:16.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.607+0000 7f6f99e00640 1 --2- 172.21.15.42:0/4126196070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d8146b0 0x55f54dc17d50 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c012900 tx=0x7f6f8c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70ac2534a90641e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:16.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.607+0000 7f6f87400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:47:16.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.608+0000 7f6f87400640 1 -- 172.21.15.42:0/4126196070 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c01fd50 con 0x55f54d8146b0 2024-09-17T01:47:16.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.608+0000 7f6f87400640 1 -- 172.21.15.42:0/4126196070 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 5767+0+0 (secure 0 0 0) 0x7f6f8c029470 con 0x55f54d8146b0 2024-09-17T01:47:16.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.608+0000 7f6fb05ff740 1 -- 172.21.15.42:0/4126196070 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f9c019070 con 0x55f54d8146b0 2024-09-17T01:47:16.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.608+0000 7f6f87400640 1 -- 172.21.15.42:0/4126196070 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) ==== 24+0+0 (secure 0 0 0) 0x7f6f8c029670 con 0x55f54d8146b0 2024-09-17T01:47:16.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.608+0000 7f6fb05ff740 10 client.10593 fetch_fsmap learned FSMap version 150 2024-09-17T01:47:16.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.608+0000 7f6fb05ff740 1 -- 172.21.15.42:0/4126196070 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) -- 0x55f54d87e6a0 con 0x55f54d8146b0 2024-09-17T01:47:16.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.608+0000 7f6f87400640 1 -- 172.21.15.42:0/4126196070 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f9c019070 con 0x55f54d8146b0 2024-09-17T01:47:16.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.608+0000 7f6f87400640 1 -- 172.21.15.42:0/4126196070 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 150) ==== 3502+0+0 (secure 0 0 0) 0x7f6f8c034080 con 0x55f54d8146b0 2024-09-17T01:47:16.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.608+0000 7f6fb05ff740 10 client.10593 fetch_fsmap finished waiting for FSMap version 150 2024-09-17T01:47:16.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.608+0000 7f6fb05ff740 10 client.10593 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.b 2024-09-17T01:47:16.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.608+0000 7f6fb05ff740 20 client.10593 populate_metadata read hostname 'smithi042' 2024-09-17T01:47:16.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.608+0000 7f6fb05ff740 1 --2- 172.21.15.42:0/4126196070 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x55f54d7f3f60 0x55f54dbdb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.609+0000 7f6fb05ff740 4 client.10593 mds_command: new command op to 10371 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:47:16.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.609+0000 7f6fb05ff740 1 -- 172.21.15.42:0/4126196070 --> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f54db517c0 con 0x55f54d7f3f60 2024-09-17T01:47:16.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.609+0000 7f6fa2800640 1 --2- 172.21.15.42:0/4126196070 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x55f54d7f3f60 0x55f54dbdb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.610+0000 7f6fa2800640 1 --2- 172.21.15.42:0/4126196070 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x55f54d7f3f60 0x55f54dbdb7e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b825645a5d2c1bbd server_cookie=391df388d6483e7d in_seq=0 out_seq=0 2024-09-17T01:47:16.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.610+0000 7f6f87400640 10 client.10593 ms_handle_connect on v2:172.21.15.43:6835/1477091047 2024-09-17T01:47:16.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.610+0000 7f6f87400640 1 -- 172.21.15.42:0/4126196070 <== mds.0 v2:172.21.15.43:6835/1477091047 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f54db517c0 con 0x55f54d7f3f60 2024-09-17T01:47:16.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.611+0000 7f6f87400640 10 client.10593 handle_command_reply: tid=0 2024-09-17T01:47:16.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.611+0000 7f6fb05ff740 1 client.10593 shutdown 2024-09-17T01:47:16.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.611+0000 7f6fb05ff740 1 -- 172.21.15.42:0/4126196070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d8146b0 msgr2=0x55f54dc17d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:16.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.611+0000 7f6fb05ff740 1 --2- 172.21.15.42:0/4126196070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d8146b0 0x55f54dc17d50 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c012900 tx=0x7f6f8c004730 comp rx=0 tx=0).stop 2024-09-17T01:47:16.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.611+0000 7f6fb05ff740 1 -- 172.21.15.42:0/4126196070 shutdown_connections 2024-09-17T01:47:16.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.611+0000 7f6fb05ff740 1 --2- 172.21.15.42:0/4126196070 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x55f54d7f3f60 0x55f54dbdb7e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.611+0000 7f6fb05ff740 1 --2- 172.21.15.42:0/4126196070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f54d835390 0x55f54dc19350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.611+0000 7f6fb05ff740 1 --2- 172.21.15.42:0/4126196070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d8146b0 0x55f54dc17d50 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.611+0000 7f6f87400640 0 client.10593 ms_handle_reset on v2:172.21.15.43:6835/1477091047 2024-09-17T01:47:16.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.611+0000 7f6fb05ff740 1 --2- 172.21.15.42:0/4126196070 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f54d80c4d0 0x55f54dbf4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.611+0000 7f6fb05ff740 1 -- 172.21.15.42:0/4126196070 >> 172.21.15.42:0/4126196070 conn(0x55f54d8294e0 msgr2=0x55f54dc03110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:16.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.611+0000 7f6fb05ff740 1 -- 172.21.15.42:0/4126196070 shutdown_connections 2024-09-17T01:47:16.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.611+0000 7f6fb05ff740 1 -- 172.21.15.42:0/4126196070 wait complete. 2024-09-17T01:47:16.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.611+0000 7f6fb05ff740 20 client.10593 trim_cache size 0 max 16384 2024-09-17T01:47:16.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.630+0000 7f6fb05ff740 1 Processor -- start 2024-09-17T01:47:16.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.630+0000 7f6fb05ff740 1 -- start start 2024-09-17T01:47:16.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.631+0000 7f6fb05ff740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f54d80c4d0 0x55f54dc17a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.631+0000 7f6fb05ff740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d8146b0 0x55f54dc30500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.631+0000 7f6fb05ff740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f54d835390 0x55f54dc30a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.631+0000 7f6fb05ff740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f54dbdc980 con 0x55f54d8146b0 2024-09-17T01:47:16.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.631+0000 7f6fb05ff740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f54dbd8810 con 0x55f54d80c4d0 2024-09-17T01:47:16.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.631+0000 7f6fb05ff740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6fa4202480 con 0x55f54d835390 2024-09-17T01:47:16.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.632+0000 7f6f99e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d8146b0 0x55f54dc30500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.632+0000 7f6f99e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d8146b0 0x55f54dc30500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55500/0 (socket says 172.21.15.42:55500) 2024-09-17T01:47:16.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.632+0000 7f6f99e00640 1 -- 172.21.15.42:0/1289717122 learned_addr learned my addr 172.21.15.42:0/1289717122 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:16.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.632+0000 7f6fa3200640 1 --2- 172.21.15.42:0/1289717122 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f54d835390 0x55f54dc30a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.632+0000 7f6fa2800640 1 --2- 172.21.15.42:0/1289717122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f54d80c4d0 0x55f54dc17a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.632+0000 7f6f99e00640 1 -- 172.21.15.42:0/1289717122 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f54d835390 msgr2=0x55f54dc30a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:16.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.632+0000 7f6f99e00640 1 --2- 172.21.15.42:0/1289717122 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f54d835390 0x55f54dc30a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.632+0000 7f6f99e00640 1 -- 172.21.15.42:0/1289717122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f54d80c4d0 msgr2=0x55f54dc17a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:16.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.632+0000 7f6f99e00640 1 --2- 172.21.15.42:0/1289717122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f54d80c4d0 0x55f54dc17a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.632+0000 7f6f99e00640 1 -- 172.21.15.42:0/1289717122 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f54db44f50 con 0x55f54d8146b0 2024-09-17T01:47:16.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.632+0000 7f6fa3200640 1 --2- 172.21.15.42:0/1289717122 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f54d835390 0x55f54dc30a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:47:16.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.632+0000 7f6fa2800640 1 --2- 172.21.15.42:0/1289717122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f54d80c4d0 0x55f54dc17a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:47:16.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.632+0000 7f6f99e00640 1 --2- 172.21.15.42:0/1289717122 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d8146b0 0x55f54dc30500 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c01f810 tx=0x7f6f8c01f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e851629ccd13d48 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:16.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.633+0000 7f6f92600640 1 -- 172.21.15.42:0/1289717122 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c01fb50 con 0x55f54d8146b0 2024-09-17T01:47:16.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.633+0000 7f6f92600640 1 -- 172.21.15.42:0/1289717122 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f8c024070 con 0x55f54d8146b0 2024-09-17T01:47:16.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.633+0000 7f6f92600640 1 -- 172.21.15.42:0/1289717122 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c029a50 con 0x55f54d8146b0 2024-09-17T01:47:16.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.633+0000 7f6fb05ff740 1 -- 172.21.15.42:0/1289717122 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d8146b0 msgr2=0x55f54dc30500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:16.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.633+0000 7f6fb05ff740 1 --2- 172.21.15.42:0/1289717122 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d8146b0 0x55f54dc30500 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c01f810 tx=0x7f6f8c01f840 comp rx=0 tx=0).stop 2024-09-17T01:47:16.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.634+0000 7f6fb05ff740 1 -- 172.21.15.42:0/1289717122 shutdown_connections 2024-09-17T01:47:16.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.634+0000 7f6fb05ff740 1 --2- 172.21.15.42:0/1289717122 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f54d835390 0x55f54dc30a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.634+0000 7f6fb05ff740 1 --2- 172.21.15.42:0/1289717122 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d8146b0 0x55f54dc30500 unknown :-1 s=CLOSED pgs=2191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.634+0000 7f6fb05ff740 1 --2- 172.21.15.42:0/1289717122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f54d80c4d0 0x55f54dc17a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.634+0000 7f6fb05ff740 1 -- 172.21.15.42:0/1289717122 >> 172.21.15.42:0/1289717122 conn(0x55f54d8294e0 msgr2=0x55f54dbf4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:16.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.634+0000 7f6fb05ff740 1 -- 172.21.15.42:0/1289717122 shutdown_connections 2024-09-17T01:47:16.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.634+0000 7f6fb05ff740 1 -- 172.21.15.42:0/1289717122 wait complete. 2024-09-17T01:47:16.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.635+0000 7f6fb05ff740 1 -- start start 2024-09-17T01:47:16.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.635+0000 7f6fb05ff740 1 Processor -- start 2024-09-17T01:47:16.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.636+0000 7f6fb05ff740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f54d80c4d0 0x55f54dca45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.636+0000 7f6fb05ff740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f54d8146b0 0x55f54dbdd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.636+0000 7f6fb05ff740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d835390 0x55f54dbdb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.636+0000 7f6fb05ff740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa4158510 con 0x55f54d835390 2024-09-17T01:47:16.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.636+0000 7f6fb05ff740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa4201580 con 0x55f54d8146b0 2024-09-17T01:47:16.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.636+0000 7f6fb05ff740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6fa41f9b20 con 0x55f54d80c4d0 2024-09-17T01:47:16.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.636+0000 7f6fb05ff740 10 client.0 _ll_register_callbacks cb 0x7f6f8c0097f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:47:16.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.636+0000 7f6fa3200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d835390 0x55f54dbdb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.636+0000 7f6fa3200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d835390 0x55f54dbdb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55506/0 (socket says 172.21.15.42:55506) 2024-09-17T01:47:16.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.637+0000 7f6fa3200640 1 -- 172.21.15.42:0/1522164494 learned_addr learned my addr 172.21.15.42:0/1522164494 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:16.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.637+0000 7f6f99e00640 1 --2- 172.21.15.42:0/1522164494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f54d8146b0 0x55f54dbdd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.637+0000 7f6fa2800640 1 --2- 172.21.15.42:0/1522164494 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f54d80c4d0 0x55f54dca45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.637+0000 7f6fa3200640 1 -- 172.21.15.42:0/1522164494 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f54d80c4d0 msgr2=0x55f54dca45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:16.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.637+0000 7f6fa3200640 1 --2- 172.21.15.42:0/1522164494 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f54d80c4d0 0x55f54dca45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.637+0000 7f6fa3200640 1 -- 172.21.15.42:0/1522164494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f54d8146b0 msgr2=0x55f54dbdd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:16.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.637+0000 7f6fa3200640 1 --2- 172.21.15.42:0/1522164494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f54d8146b0 0x55f54dbdd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.637+0000 7f6fa3200640 1 -- 172.21.15.42:0/1522164494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f54dc44770 con 0x55f54d835390 2024-09-17T01:47:16.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.637+0000 7f6fa3200640 1 --2- 172.21.15.42:0/1522164494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d835390 0x55f54dbdb0c0 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c000f80 tx=0x7f6f9c004c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a2fdc8f0fcebb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:16.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.637+0000 7f6f87400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:47:16.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.638+0000 7f6f87400640 1 -- 172.21.15.42:0/1522164494 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c014910 con 0x55f54d835390 2024-09-17T01:47:16.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.638+0000 7f6f87400640 1 -- 172.21.15.42:0/1522164494 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 5767+0+0 (secure 0 0 0) 0x7f6f9c014ab0 con 0x55f54d835390 2024-09-17T01:47:16.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.638+0000 7f6fb05ff740 1 -- 172.21.15.42:0/1522164494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f8c024070 con 0x55f54d835390 2024-09-17T01:47:16.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.638+0000 7f6f87400640 1 -- 172.21.15.42:0/1522164494 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) ==== 24+0+0 (secure 0 0 0) 0x7f6f9c030050 con 0x55f54d835390 2024-09-17T01:47:16.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.638+0000 7f6fb05ff740 10 client.10599 fetch_fsmap learned FSMap version 150 2024-09-17T01:47:16.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.638+0000 7f6fb05ff740 1 -- 172.21.15.42:0/1522164494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) -- 0x55f54dc20ab0 con 0x55f54d835390 2024-09-17T01:47:16.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.638+0000 7f6f87400640 1 -- 172.21.15.42:0/1522164494 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f8c024070 con 0x55f54d835390 2024-09-17T01:47:16.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.638+0000 7f6f87400640 1 -- 172.21.15.42:0/1522164494 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 150) ==== 3502+0+0 (secure 0 0 0) 0x7f6f9c033020 con 0x55f54d835390 2024-09-17T01:47:16.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.638+0000 7f6fb05ff740 10 client.10599 fetch_fsmap finished waiting for FSMap version 150 2024-09-17T01:47:16.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.638+0000 7f6fb05ff740 10 client.10599 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.b 2024-09-17T01:47:16.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.638+0000 7f6fb05ff740 20 client.10599 populate_metadata read hostname 'smithi042' 2024-09-17T01:47:16.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.638+0000 7f6fb05ff740 1 --2- 172.21.15.42:0/1522164494 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x55f54dc240b0 0x55f54dbdb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.638+0000 7f6fb05ff740 4 client.10599 mds_command: new command op to 10371 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:47:16.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.638+0000 7f6fb05ff740 1 -- 172.21.15.42:0/1522164494 --> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f54db4d270 con 0x55f54dc240b0 2024-09-17T01:47:16.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.639+0000 7f6fa2800640 1 --2- 172.21.15.42:0/1522164494 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x55f54dc240b0 0x55f54dbdb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.639+0000 7f6fa2800640 1 --2- 172.21.15.42:0/1522164494 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x55f54dc240b0 0x55f54dbdb600 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a2c08f679520d6f server_cookie=cd2949476e73f3b in_seq=0 out_seq=0 2024-09-17T01:47:16.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.639+0000 7f6f87400640 10 client.10599 ms_handle_connect on v2:172.21.15.43:6835/1477091047 2024-09-17T01:47:16.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.640+0000 7f6f87400640 1 -- 172.21.15.42:0/1522164494 <== mds.0 v2:172.21.15.43:6835/1477091047 1 ==== command_reply(tid 0: 0 ) ==== 8+0+380 (crc 0 0 0) 0x55f54db4d270 con 0x55f54dc240b0 2024-09-17T01:47:16.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.640+0000 7f6f87400640 10 client.10599 handle_command_reply: tid=0 2024-09-17T01:47:16.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.640+0000 7f6fb05ff740 1 client.10599 shutdown 2024-09-17T01:47:16.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.640+0000 7f6fb05ff740 1 -- 172.21.15.42:0/1522164494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d835390 msgr2=0x55f54dbdb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:16.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.640+0000 7f6fb05ff740 1 --2- 172.21.15.42:0/1522164494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d835390 0x55f54dbdb0c0 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c000f80 tx=0x7f6f9c004c40 comp rx=0 tx=0).stop 2024-09-17T01:47:16.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.640+0000 7f6fb05ff740 1 -- 172.21.15.42:0/1522164494 shutdown_connections 2024-09-17T01:47:16.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.640+0000 7f6fb05ff740 1 --2- 172.21.15.42:0/1522164494 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x55f54dc240b0 0x55f54dbdb600 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.640+0000 7f6fb05ff740 1 --2- 172.21.15.42:0/1522164494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f54d8146b0 0x55f54dbdd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.640+0000 7f6fb05ff740 1 --2- 172.21.15.42:0/1522164494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f54d835390 0x55f54dbdb0c0 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.640+0000 7f6fb05ff740 1 --2- 172.21.15.42:0/1522164494 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f54d80c4d0 0x55f54dca45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.640+0000 7f6f87400640 0 client.10599 ms_handle_reset on v2:172.21.15.43:6835/1477091047 2024-09-17T01:47:16.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.640+0000 7f6fb05ff740 1 -- 172.21.15.42:0/1522164494 >> 172.21.15.42:0/1522164494 conn(0x55f54d8294e0 msgr2=0x55f54dc19120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:16.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.640+0000 7f6fb05ff740 1 -- 172.21.15.42:0/1522164494 shutdown_connections 2024-09-17T01:47:16.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.640+0000 7f6fb05ff740 1 -- 172.21.15.42:0/1522164494 wait complete. 2024-09-17T01:47:16.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.640+0000 7f6fb05ff740 20 client.10599 trim_cache size 0 max 16384 2024-09-17T01:47:16.646 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:47:16.646 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-09-17T01:47:16.646 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {}, 2024-09-17T01:47:16.646 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_stats": { 2024-09-17T01:47:16.646 INFO:teuthology.orchestra.run.smithi042.stdout: "2dd447bb-fd64-4382-bc9e-fa971df9a7fa": { 2024-09-17T01:47:16.646 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:46:46.014451+0000", 2024-09-17T01:47:16.646 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "~mdsdir", 2024-09-17T01:47:16.646 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:47:16.646 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:47:16.647 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:47:16.647 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:47:16.647 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:16.647 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:16.647 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:47:16.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.641+0000 7f6fa9400640 1 -- 172.21.15.42:0/1680399851 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6f80078b90 msgr2=0x7f6f8007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:16.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.641+0000 7f6fa9400640 1 --2- 172.21.15.42:0/1680399851 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6f80078b90 0x7f6f8007b0a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4074c00 tx=0x7f6f8c005f90 comp rx=0 tx=0).stop 2024-09-17T01:47:16.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.641+0000 7f6fa9400640 1 -- 172.21.15.42:0/1680399851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6fa4072e90 msgr2=0x7f6fa413ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:16.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.641+0000 7f6fa9400640 1 --2- 172.21.15.42:0/1680399851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6fa4072e90 0x7f6fa413ec30 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009950 tx=0x7f6f94033ba0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.641+0000 7f6fa9400640 1 -- 172.21.15.42:0/1680399851 shutdown_connections 2024-09-17T01:47:16.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.641+0000 7f6fa9400640 1 --2- 172.21.15.42:0/1680399851 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6f80078b90 0x7f6f8007b0a0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.641+0000 7f6fa9400640 1 --2- 172.21.15.42:0/1680399851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fa40b3550 0x7f6fa406eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.641+0000 7f6fa9400640 1 --2- 172.21.15.42:0/1680399851 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6fa4142f40 0x7f6fa4140bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.641+0000 7f6fa9400640 1 --2- 172.21.15.42:0/1680399851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6fa4072e90 0x7f6fa413ec30 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.641+0000 7f6fa9400640 1 -- 172.21.15.42:0/1680399851 >> 172.21.15.42:0/1680399851 conn(0x7f6fa40b2930 msgr2=0x7f6fa415aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:16.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.641+0000 7f6fa9400640 1 -- 172.21.15.42:0/1680399851 shutdown_connections 2024-09-17T01:47:16.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.641+0000 7f6fa9400640 1 -- 172.21.15.42:0/1680399851 wait complete. 2024-09-17T01:47:16.665 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T01:47:16.665 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 damage ls 2024-09-17T01:47:16.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.895+0000 7f0b9e000640 1 -- 172.21.15.42:0/3782784814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b9806ee90 msgr2=0x7f0b9815f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:16.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.895+0000 7f0b9e000640 1 --2- 172.21.15.42:0/3782784814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b9806ee90 0x7f0b9815f200 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f0b98072240 tx=0x7f0b8802aa30 comp rx=0 tx=0).stop 2024-09-17T01:47:16.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.896+0000 7f0b9e000640 1 -- 172.21.15.42:0/3782784814 shutdown_connections 2024-09-17T01:47:16.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.896+0000 7f0b9e000640 1 --2- 172.21.15.42:0/3782784814 >> v2:172.21.15.43:3300/0 conn(0x7f0b9806f2a0 0x7f0b9806d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.896+0000 7f0b9e000640 1 --2- 172.21.15.42:0/3782784814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b9806ee90 0x7f0b9815f200 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.896+0000 7f0b9e000640 1 -- 172.21.15.42:0/3782784814 >> 172.21.15.42:0/3782784814 conn(0x7f0b980b2930 msgr2=0x7f0b9806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:16.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.896+0000 7f0b9e000640 1 -- 172.21.15.42:0/3782784814 shutdown_connections 2024-09-17T01:47:16.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.896+0000 7f0b9e000640 1 -- 172.21.15.42:0/3782784814 wait complete. 2024-09-17T01:47:16.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.898+0000 7f0b9e000640 1 Processor -- start 2024-09-17T01:47:16.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.898+0000 7f0b9e000640 1 -- start start 2024-09-17T01:47:16.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.900+0000 7f0b9e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b9806db50 0x7f0b98152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.900+0000 7f0b9e000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b9806ee90 0x7f0b98147d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.900+0000 7f0b9e000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b9806f2a0 0x7f0b980b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.900+0000 7f0b9e000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0b980cef40 con 0x7f0b9806db50 2024-09-17T01:47:16.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.900+0000 7f0b9e000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0b98074750 con 0x7f0b9806ee90 2024-09-17T01:47:16.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.900+0000 7f0b9e000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0b980cf0c0 con 0x7f0b9806f2a0 2024-09-17T01:47:16.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.900+0000 7f0b97400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b9806db50 0x7f0b98152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.900+0000 7f0b97400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b9806db50 0x7f0b98152bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55518/0 (socket says 172.21.15.42:55518) 2024-09-17T01:47:16.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.900+0000 7f0b97400640 1 -- 172.21.15.42:0/2336414598 learned_addr learned my addr 172.21.15.42:0/2336414598 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:16.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.900+0000 7f0b97e00640 1 --2- 172.21.15.42:0/2336414598 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b9806f2a0 0x7f0b980b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.900+0000 7f0b8ea00640 1 --2- 172.21.15.42:0/2336414598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b9806ee90 0x7f0b98147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.900+0000 7f0b97400640 1 -- 172.21.15.42:0/2336414598 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b9806f2a0 msgr2=0x7f0b980b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:16.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.900+0000 7f0b97400640 1 --2- 172.21.15.42:0/2336414598 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b9806f2a0 0x7f0b980b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.900+0000 7f0b97400640 1 -- 172.21.15.42:0/2336414598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b9806ee90 msgr2=0x7f0b98147d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:16.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.900+0000 7f0b97400640 1 --2- 172.21.15.42:0/2336414598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b9806ee90 0x7f0b98147d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.900+0000 7f0b97400640 1 -- 172.21.15.42:0/2336414598 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b980b5850 con 0x7f0b9806db50 2024-09-17T01:47:16.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.900+0000 7f0b97e00640 1 --2- 172.21.15.42:0/2336414598 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b9806f2a0 0x7f0b980b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:47:16.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.900+0000 7f0b8ea00640 1 --2- 172.21.15.42:0/2336414598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b9806ee90 0x7f0b98147d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:47:16.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.901+0000 7f0b97400640 1 --2- 172.21.15.42:0/2336414598 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b9806db50 0x7f0b98152bc0 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7f0b8802b020 tx=0x7f0b88003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:16.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.901+0000 7f0b8fe00640 1 -- 172.21.15.42:0/2336414598 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b88033050 con 0x7f0b9806db50 2024-09-17T01:47:16.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.901+0000 7f0b8fe00640 1 -- 172.21.15.42:0/2336414598 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b880044f0 con 0x7f0b9806db50 2024-09-17T01:47:16.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.901+0000 7f0b8fe00640 1 -- 172.21.15.42:0/2336414598 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b88038450 con 0x7f0b9806db50 2024-09-17T01:47:16.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.901+0000 7f0b9e000640 1 -- 172.21.15.42:0/2336414598 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b980b4a00 con 0x7f0b9806db50 2024-09-17T01:47:16.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.901+0000 7f0b9e000640 1 -- 172.21.15.42:0/2336414598 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b981523c0 con 0x7f0b9806db50 2024-09-17T01:47:16.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.904+0000 7f0b8fe00640 1 -- 172.21.15.42:0/2336414598 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0b88036070 con 0x7f0b9806db50 2024-09-17T01:47:16.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.905+0000 7f0b8fe00640 1 --2- 172.21.15.42:0/2336414598 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0b74078b90 0x7f0b7407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.905+0000 7f0b8fe00640 1 -- 172.21.15.42:0/2336414598 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5767+0+0 (secure 0 0 0) 0x7f0b880bc350 con 0x7f0b9806db50 2024-09-17T01:47:16.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.906+0000 7f0b8ea00640 1 --2- 172.21.15.42:0/2336414598 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0b74078b90 0x7f0b7407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.906+0000 7f0ba507b740 1 Processor -- start 2024-09-17T01:47:16.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.906+0000 7f0ba507b740 1 -- start start 2024-09-17T01:47:16.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.906+0000 7f0b8ea00640 1 --2- 172.21.15.42:0/2336414598 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0b74078b90 0x7f0b7407b0a0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f0b980b14b0 tx=0x7f0b80005db0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:16.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.907+0000 7f0ba507b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f19b1ca390 0x55f19b5b6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.907+0000 7f0ba507b740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f19b1a14d0 0x55f19b58b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.907+0000 7f0ba507b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1a96b0 0x55f19b58b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.907+0000 7f0ba507b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f19b4e46f0 con 0x55f19b1a96b0 2024-09-17T01:47:16.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.907+0000 7f0ba507b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f19b4d3b20 con 0x55f19b1ca390 2024-09-17T01:47:16.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.907+0000 7f0ba507b740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55f19b4d7930 con 0x55f19b1a14d0 2024-09-17T01:47:16.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.908+0000 7f0b97e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1a96b0 0x55f19b58b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.908+0000 7f0b97e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1a96b0 0x55f19b58b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55520/0 (socket says 172.21.15.42:55520) 2024-09-17T01:47:16.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.908+0000 7f0b97e00640 1 -- 172.21.15.42:0/3386152590 learned_addr learned my addr 172.21.15.42:0/3386152590 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:16.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.908+0000 7f0b8ea00640 1 --2- 172.21.15.42:0/3386152590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f19b1a14d0 0x55f19b58b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.908+0000 7f0b97400640 1 --2- 172.21.15.42:0/3386152590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f19b1ca390 0x55f19b5b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.908+0000 7f0b97e00640 1 -- 172.21.15.42:0/3386152590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f19b1a14d0 msgr2=0x55f19b58b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:16.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.908+0000 7f0b97e00640 1 --2- 172.21.15.42:0/3386152590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f19b1a14d0 0x55f19b58b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.908+0000 7f0b97e00640 1 -- 172.21.15.42:0/3386152590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f19b1ca390 msgr2=0x55f19b5b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:16.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.908+0000 7f0b97e00640 1 --2- 172.21.15.42:0/3386152590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f19b1ca390 0x55f19b5b6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.908+0000 7f0b97e00640 1 -- 172.21.15.42:0/3386152590 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f19b235970 con 0x55f19b1a96b0 2024-09-17T01:47:16.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.909+0000 7f0b97e00640 1 --2- 172.21.15.42:0/3386152590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1a96b0 0x55f19b58b690 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7f0b90001690 tx=0x7f0b90001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177fc76e2dfd8b33 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:16.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.909+0000 7f0b87400640 1 -- 172.21.15.42:0/3386152590 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b90018070 con 0x55f19b1a96b0 2024-09-17T01:47:16.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.909+0000 7f0b87400640 1 -- 172.21.15.42:0/3386152590 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b90007030 con 0x55f19b1a96b0 2024-09-17T01:47:16.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.909+0000 7f0b87400640 1 -- 172.21.15.42:0/3386152590 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b90007400 con 0x55f19b1a96b0 2024-09-17T01:47:16.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.910+0000 7f0ba507b740 1 -- 172.21.15.42:0/3386152590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1a96b0 msgr2=0x55f19b58b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:16.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.910+0000 7f0ba507b740 1 --2- 172.21.15.42:0/3386152590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1a96b0 0x55f19b58b690 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7f0b90001690 tx=0x7f0b90001b50 comp rx=0 tx=0).stop 2024-09-17T01:47:16.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.910+0000 7f0ba507b740 1 -- 172.21.15.42:0/3386152590 shutdown_connections 2024-09-17T01:47:16.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.910+0000 7f0ba507b740 1 --2- 172.21.15.42:0/3386152590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1a96b0 0x55f19b58b690 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.910+0000 7f0ba507b740 1 --2- 172.21.15.42:0/3386152590 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f19b1a14d0 0x55f19b58b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.910+0000 7f0ba507b740 1 --2- 172.21.15.42:0/3386152590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f19b1ca390 0x55f19b5b6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.910+0000 7f0ba507b740 1 -- 172.21.15.42:0/3386152590 >> 172.21.15.42:0/3386152590 conn(0x55f19b1be4e0 msgr2=0x55f19b5715f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:16.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.910+0000 7f0ba507b740 1 -- 172.21.15.42:0/3386152590 shutdown_connections 2024-09-17T01:47:16.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.910+0000 7f0ba507b740 1 -- 172.21.15.42:0/3386152590 wait complete. 2024-09-17T01:47:16.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.911+0000 7f0ba507b740 1 -- start start 2024-09-17T01:47:16.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.911+0000 7f0ba507b740 1 Processor -- start 2024-09-17T01:47:16.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.913+0000 7f0ba507b740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f19b1a14d0 0x55f19b59bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.913+0000 7f0ba507b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f19b1a96b0 0x55f19b5992e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.913+0000 7f0ba507b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1ca390 0x55f19b5b2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.913+0000 7f0ba507b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f19b244740 con 0x55f19b1ca390 2024-09-17T01:47:16.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.913+0000 7f0ba507b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f19b47a290 con 0x55f19b1a96b0 2024-09-17T01:47:16.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.913+0000 7f0ba507b740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55f19b5c6210 con 0x55f19b1a14d0 2024-09-17T01:47:16.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.913+0000 7f0ba507b740 10 client.0 _ll_register_callbacks cb 0x55f19b4571e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:47:16.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.913+0000 7f0b97e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1ca390 0x55f19b5b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.913+0000 7f0b97e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1ca390 0x55f19b5b2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55536/0 (socket says 172.21.15.42:55536) 2024-09-17T01:47:16.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.913+0000 7f0b97e00640 1 -- 172.21.15.42:0/1554034429 learned_addr learned my addr 172.21.15.42:0/1554034429 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:16.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.913+0000 7f0b97400640 1 --2- 172.21.15.42:0/1554034429 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f19b1a14d0 0x55f19b59bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.913+0000 7f0b8ea00640 1 --2- 172.21.15.42:0/1554034429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f19b1a96b0 0x55f19b5992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.913+0000 7f0b97e00640 1 -- 172.21.15.42:0/1554034429 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f19b1a14d0 msgr2=0x55f19b59bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:16.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.913+0000 7f0b97e00640 1 --2- 172.21.15.42:0/1554034429 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f19b1a14d0 0x55f19b59bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.913+0000 7f0b97e00640 1 -- 172.21.15.42:0/1554034429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f19b1a96b0 msgr2=0x55f19b5992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:16.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.913+0000 7f0b97e00640 1 --2- 172.21.15.42:0/1554034429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f19b1a96b0 0x55f19b5992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.913+0000 7f0b97e00640 1 -- 172.21.15.42:0/1554034429 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f19b2ac7d0 con 0x55f19b1ca390 2024-09-17T01:47:16.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.914+0000 7f0b97e00640 1 --2- 172.21.15.42:0/1554034429 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1ca390 0x55f19b5b2690 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7f0b90007490 tx=0x7f0b900074c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29fa04df12c433e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:16.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.914+0000 7f0b7be00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:47:16.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.914+0000 7f0b7be00640 1 -- 172.21.15.42:0/1554034429 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b90021020 con 0x55f19b1ca390 2024-09-17T01:47:16.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.914+0000 7f0ba507b740 1 -- 172.21.15.42:0/1554034429 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b90007030 con 0x55f19b1ca390 2024-09-17T01:47:16.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.914+0000 7f0b7be00640 1 -- 172.21.15.42:0/1554034429 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 5767+0+0 (secure 0 0 0) 0x7f0b900067d0 con 0x55f19b1ca390 2024-09-17T01:47:16.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.914+0000 7f0b7be00640 1 -- 172.21.15.42:0/1554034429 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) ==== 24+0+0 (secure 0 0 0) 0x7f0b9002b050 con 0x55f19b1ca390 2024-09-17T01:47:16.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.914+0000 7f0ba507b740 10 client.10611 fetch_fsmap learned FSMap version 150 2024-09-17T01:47:16.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.914+0000 7f0ba507b740 1 -- 172.21.15.42:0/1554034429 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) -- 0x55f19b5c8d50 con 0x55f19b1ca390 2024-09-17T01:47:16.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.915+0000 7f0b7be00640 1 -- 172.21.15.42:0/1554034429 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b90007030 con 0x55f19b1ca390 2024-09-17T01:47:16.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.915+0000 7f0b7be00640 1 -- 172.21.15.42:0/1554034429 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 150) ==== 3502+0+0 (secure 0 0 0) 0x7f0b9002e020 con 0x55f19b1ca390 2024-09-17T01:47:16.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.915+0000 7f0ba507b740 10 client.10611 fetch_fsmap finished waiting for FSMap version 150 2024-09-17T01:47:16.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.915+0000 7f0ba507b740 10 client.10611 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.b 2024-09-17T01:47:16.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.915+0000 7f0ba507b740 20 client.10611 populate_metadata read hostname 'smithi042' 2024-09-17T01:47:16.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.915+0000 7f0ba507b740 1 --2- 172.21.15.42:0/1554034429 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x55f19b188f60 0x55f19b5c5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.915+0000 7f0ba507b740 4 client.10611 mds_command: new command op to 10371 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:47:16.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.915+0000 7f0ba507b740 1 -- 172.21.15.42:0/1554034429 --> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f19b4e6640 con 0x55f19b188f60 2024-09-17T01:47:16.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.915+0000 7f0b97400640 1 --2- 172.21.15.42:0/1554034429 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x55f19b188f60 0x55f19b5c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.916+0000 7f0b97400640 1 --2- 172.21.15.42:0/1554034429 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x55f19b188f60 0x55f19b5c5230 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad5fbd391b839c81 server_cookie=7a87641a335e4517 in_seq=0 out_seq=0 2024-09-17T01:47:16.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.916+0000 7f0b7be00640 10 client.10611 ms_handle_connect on v2:172.21.15.43:6835/1477091047 2024-09-17T01:47:16.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.917+0000 7f0b7be00640 1 -- 172.21.15.42:0/1554034429 <== mds.0 v2:172.21.15.43:6835/1477091047 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f19b4e6640 con 0x55f19b188f60 2024-09-17T01:47:16.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.917+0000 7f0b7be00640 10 client.10611 handle_command_reply: tid=0 2024-09-17T01:47:16.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.917+0000 7f0ba507b740 1 client.10611 shutdown 2024-09-17T01:47:16.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.917+0000 7f0ba507b740 1 -- 172.21.15.42:0/1554034429 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1ca390 msgr2=0x55f19b5b2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:16.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.917+0000 7f0ba507b740 1 --2- 172.21.15.42:0/1554034429 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1ca390 0x55f19b5b2690 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7f0b90007490 tx=0x7f0b900074c0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.917+0000 7f0ba507b740 1 -- 172.21.15.42:0/1554034429 shutdown_connections 2024-09-17T01:47:16.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.917+0000 7f0ba507b740 1 --2- 172.21.15.42:0/1554034429 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x55f19b188f60 0x55f19b5c5230 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.917+0000 7f0ba507b740 1 --2- 172.21.15.42:0/1554034429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f19b1a96b0 0x55f19b5992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.917+0000 7f0ba507b740 1 --2- 172.21.15.42:0/1554034429 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1ca390 0x55f19b5b2690 unknown :-1 s=CLOSED pgs=2196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.917+0000 7f0b7be00640 0 client.10611 ms_handle_reset on v2:172.21.15.43:6835/1477091047 2024-09-17T01:47:16.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.917+0000 7f0ba507b740 1 --2- 172.21.15.42:0/1554034429 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f19b1a14d0 0x55f19b59bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.917+0000 7f0ba507b740 1 -- 172.21.15.42:0/1554034429 >> 172.21.15.42:0/1554034429 conn(0x55f19b1be4e0 msgr2=0x55f19b58b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:16.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.917+0000 7f0ba507b740 1 -- 172.21.15.42:0/1554034429 shutdown_connections 2024-09-17T01:47:16.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.917+0000 7f0ba507b740 1 -- 172.21.15.42:0/1554034429 wait complete. 2024-09-17T01:47:16.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.917+0000 7f0ba507b740 20 client.10611 trim_cache size 0 max 16384 2024-09-17T01:47:16.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.932+0000 7f0ba507b740 1 Processor -- start 2024-09-17T01:47:16.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.932+0000 7f0ba507b740 1 -- start start 2024-09-17T01:47:16.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.933+0000 7f0ba507b740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f19b1a14d0 0x55f19b56aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.933+0000 7f0ba507b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1a96b0 0x55f19b56b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.933+0000 7f0ba507b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f19b1ca390 0x55f19b5b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.933+0000 7f0ba507b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0b98202510 con 0x55f19b1a96b0 2024-09-17T01:47:16.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.933+0000 7f0ba507b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0b98201550 con 0x55f19b1ca390 2024-09-17T01:47:16.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.933+0000 7f0ba507b740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0b981f6960 con 0x55f19b1a14d0 2024-09-17T01:47:16.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.933+0000 7f0b8ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1a96b0 0x55f19b56b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.934+0000 7f0b8ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1a96b0 0x55f19b56b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55546/0 (socket says 172.21.15.42:55546) 2024-09-17T01:47:16.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.934+0000 7f0b8ea00640 1 -- 172.21.15.42:0/2442724504 learned_addr learned my addr 172.21.15.42:0/2442724504 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:16.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.934+0000 7f0b97400640 1 --2- 172.21.15.42:0/2442724504 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f19b1a14d0 0x55f19b56aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.934+0000 7f0b97e00640 1 --2- 172.21.15.42:0/2442724504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f19b1ca390 0x55f19b5b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.934+0000 7f0b8ea00640 1 -- 172.21.15.42:0/2442724504 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f19b1a14d0 msgr2=0x55f19b56aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:16.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.934+0000 7f0b8ea00640 1 --2- 172.21.15.42:0/2442724504 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f19b1a14d0 0x55f19b56aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.934+0000 7f0b8ea00640 1 -- 172.21.15.42:0/2442724504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f19b1ca390 msgr2=0x55f19b5b64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:16.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.934+0000 7f0b8ea00640 1 --2- 172.21.15.42:0/2442724504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f19b1ca390 0x55f19b5b64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.934+0000 7f0b8ea00640 1 -- 172.21.15.42:0/2442724504 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f19b56e150 con 0x55f19b1a96b0 2024-09-17T01:47:16.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.934+0000 7f0b8ea00640 1 --2- 172.21.15.42:0/2442724504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1a96b0 0x55f19b56b1e0 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000f010 tx=0x7f0b80011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08af78944d9fe97 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:16.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.934+0000 7f0b86a00640 1 -- 172.21.15.42:0/2442724504 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8001f6b0 con 0x55f19b1a96b0 2024-09-17T01:47:16.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.934+0000 7f0b86a00640 1 -- 172.21.15.42:0/2442724504 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b80017050 con 0x55f19b1a96b0 2024-09-17T01:47:16.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.935+0000 7f0b86a00640 1 -- 172.21.15.42:0/2442724504 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8001fba0 con 0x55f19b1a96b0 2024-09-17T01:47:16.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.935+0000 7f0ba507b740 1 -- 172.21.15.42:0/2442724504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1a96b0 msgr2=0x55f19b56b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:16.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.935+0000 7f0ba507b740 1 --2- 172.21.15.42:0/2442724504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1a96b0 0x55f19b56b1e0 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000f010 tx=0x7f0b80011000 comp rx=0 tx=0).stop 2024-09-17T01:47:16.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.935+0000 7f0ba507b740 1 -- 172.21.15.42:0/2442724504 shutdown_connections 2024-09-17T01:47:16.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.935+0000 7f0ba507b740 1 --2- 172.21.15.42:0/2442724504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f19b1ca390 0x55f19b5b64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.935+0000 7f0ba507b740 1 --2- 172.21.15.42:0/2442724504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1a96b0 0x55f19b56b1e0 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.935+0000 7f0ba507b740 1 --2- 172.21.15.42:0/2442724504 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f19b1a14d0 0x55f19b56aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.935+0000 7f0ba507b740 1 -- 172.21.15.42:0/2442724504 >> 172.21.15.42:0/2442724504 conn(0x55f19b1be4e0 msgr2=0x55f19b56bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:16.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.935+0000 7f0ba507b740 1 -- 172.21.15.42:0/2442724504 shutdown_connections 2024-09-17T01:47:16.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.935+0000 7f0ba507b740 1 -- 172.21.15.42:0/2442724504 wait complete. 2024-09-17T01:47:16.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.936+0000 7f0ba507b740 1 -- start start 2024-09-17T01:47:16.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.936+0000 7f0ba507b740 1 Processor -- start 2024-09-17T01:47:16.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.938+0000 7f0ba507b740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1a14d0 0x55f19b5d9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.938+0000 7f0ba507b740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f19b1a96b0 0x55f19b628b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.938+0000 7f0ba507b740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f19b1ca390 0x55f19b589280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.938+0000 7f0ba507b740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f19b56b020 con 0x55f19b1a14d0 2024-09-17T01:47:16.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.938+0000 7f0ba507b740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0b980b40b0 con 0x55f19b1a96b0 2024-09-17T01:47:16.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.938+0000 7f0ba507b740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55f19b62b5d0 con 0x55f19b1ca390 2024-09-17T01:47:16.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.938+0000 7f0ba507b740 10 client.0 _ll_register_callbacks cb 0x7f0b90016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:47:16.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.938+0000 7f0b97400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1a14d0 0x55f19b5d9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.938+0000 7f0b97400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1a14d0 0x55f19b5d9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55550/0 (socket says 172.21.15.42:55550) 2024-09-17T01:47:16.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.938+0000 7f0b97400640 1 -- 172.21.15.42:0/1217546326 learned_addr learned my addr 172.21.15.42:0/1217546326 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:16.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.938+0000 7f0b97e00640 1 --2- 172.21.15.42:0/1217546326 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f19b1ca390 0x55f19b589280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.938+0000 7f0b8ea00640 1 --2- 172.21.15.42:0/1217546326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f19b1a96b0 0x55f19b628b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.939+0000 7f0b97400640 1 -- 172.21.15.42:0/1217546326 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f19b1ca390 msgr2=0x55f19b589280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:16.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.939+0000 7f0b97400640 1 --2- 172.21.15.42:0/1217546326 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f19b1ca390 0x55f19b589280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.939+0000 7f0b97400640 1 -- 172.21.15.42:0/1217546326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f19b1a96b0 msgr2=0x55f19b628b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:16.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.939+0000 7f0b97400640 1 --2- 172.21.15.42:0/1217546326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f19b1a96b0 0x55f19b628b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.939+0000 7f0b97400640 1 -- 172.21.15.42:0/1217546326 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f19b56ea60 con 0x55f19b1a14d0 2024-09-17T01:47:16.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.939+0000 7f0b97e00640 1 --2- 172.21.15.42:0/1217546326 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f19b1ca390 0x55f19b589280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:47:16.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.939+0000 7f0b8ea00640 1 --2- 172.21.15.42:0/1217546326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f19b1a96b0 0x55f19b628b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:47:16.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.939+0000 7f0b97400640 1 --2- 172.21.15.42:0/1217546326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1a14d0 0x55f19b5d9610 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f0b88083d40 tx=0x7f0b8802aa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de8757c19510bd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:16.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.939+0000 7f0b7be00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:47:16.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.939+0000 7f0b7be00640 1 -- 172.21.15.42:0/1217546326 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b88084740 con 0x55f19b1a14d0 2024-09-17T01:47:16.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.939+0000 7f0b7be00640 1 -- 172.21.15.42:0/1217546326 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(189..189 src has 1..189) ==== 5767+0+0 (secure 0 0 0) 0x7f0b88037c10 con 0x55f19b1a14d0 2024-09-17T01:47:16.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.939+0000 7f0ba507b740 1 -- 172.21.15.42:0/1217546326 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b80017050 con 0x55f19b1a14d0 2024-09-17T01:47:16.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.939+0000 7f0b7be00640 1 -- 172.21.15.42:0/1217546326 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) ==== 24+0+0 (secure 0 0 0) 0x7f0b880a3050 con 0x55f19b1a14d0 2024-09-17T01:47:16.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.939+0000 7f0ba507b740 10 client.10617 fetch_fsmap learned FSMap version 150 2024-09-17T01:47:16.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.939+0000 7f0ba507b740 1 -- 172.21.15.42:0/1217546326 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) -- 0x55f19b62b370 con 0x55f19b1a14d0 2024-09-17T01:47:16.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.940+0000 7f0b7be00640 1 -- 172.21.15.42:0/1217546326 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b80017050 con 0x55f19b1a14d0 2024-09-17T01:47:16.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.940+0000 7f0b7be00640 1 -- 172.21.15.42:0/1217546326 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 150) ==== 3502+0+0 (secure 0 0 0) 0x7f0b88040070 con 0x55f19b1a14d0 2024-09-17T01:47:16.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.940+0000 7f0ba507b740 10 client.10617 fetch_fsmap finished waiting for FSMap version 150 2024-09-17T01:47:16.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.940+0000 7f0ba507b740 10 client.10617 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.b 2024-09-17T01:47:16.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.940+0000 7f0ba507b740 20 client.10617 populate_metadata read hostname 'smithi042' 2024-09-17T01:47:16.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.940+0000 7f0ba507b740 1 --2- 172.21.15.42:0/1217546326 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x55f19b5897c0 0x55f19b63f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:16.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.940+0000 7f0ba507b740 4 client.10617 mds_command: new command op to 10371 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-17T01:47:16.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.940+0000 7f0ba507b740 1 -- 172.21.15.42:0/1217546326 --> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f19b4e20f0 con 0x55f19b5897c0 2024-09-17T01:47:16.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.940+0000 7f0b8ea00640 1 --2- 172.21.15.42:0/1217546326 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x55f19b5897c0 0x55f19b63f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:16.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.941+0000 7f0b8ea00640 1 --2- 172.21.15.42:0/1217546326 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x55f19b5897c0 0x55f19b63f9c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc1dc3b1dbc219ba server_cookie=6157b6af05d807ae in_seq=0 out_seq=0 2024-09-17T01:47:16.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.941+0000 7f0b7be00640 10 client.10617 ms_handle_connect on v2:172.21.15.43:6835/1477091047 2024-09-17T01:47:16.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.941+0000 7f0b7be00640 1 -- 172.21.15.42:0/1217546326 <== mds.0 v2:172.21.15.43:6835/1477091047 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f19b4e20f0 con 0x55f19b5897c0 2024-09-17T01:47:16.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.941+0000 7f0b7be00640 10 client.10617 handle_command_reply: tid=0 2024-09-17T01:47:16.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.941+0000 7f0ba507b740 1 client.10617 shutdown 2024-09-17T01:47:16.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.941+0000 7f0ba507b740 1 -- 172.21.15.42:0/1217546326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1a14d0 msgr2=0x55f19b5d9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:16.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.941+0000 7f0ba507b740 1 --2- 172.21.15.42:0/1217546326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1a14d0 0x55f19b5d9610 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f0b88083d40 tx=0x7f0b8802aa30 comp rx=0 tx=0).stop 2024-09-17T01:47:16.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.941+0000 7f0ba507b740 1 -- 172.21.15.42:0/1217546326 shutdown_connections 2024-09-17T01:47:16.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.941+0000 7f0ba507b740 1 --2- 172.21.15.42:0/1217546326 >> [v2:172.21.15.43:6835/1477091047,v1:172.21.15.43:6837/1477091047] conn(0x55f19b5897c0 0x55f19b63f9c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.942+0000 7f0ba507b740 1 --2- 172.21.15.42:0/1217546326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f19b1a96b0 0x55f19b628b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.942+0000 7f0ba507b740 1 --2- 172.21.15.42:0/1217546326 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f19b1ca390 0x55f19b589280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.942+0000 7f0ba507b740 1 --2- 172.21.15.42:0/1217546326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f19b1a14d0 0x55f19b5d9610 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.942+0000 7f0b7be00640 0 client.10617 ms_handle_reset on v2:172.21.15.43:6835/1477091047 2024-09-17T01:47:16.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.942+0000 7f0ba507b740 1 -- 172.21.15.42:0/1217546326 >> 172.21.15.42:0/1217546326 conn(0x55f19b1be4e0 msgr2=0x55f19b56bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:16.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.942+0000 7f0ba507b740 1 -- 172.21.15.42:0/1217546326 shutdown_connections 2024-09-17T01:47:16.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.942+0000 7f0ba507b740 1 -- 172.21.15.42:0/1217546326 wait complete. 2024-09-17T01:47:16.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.942+0000 7f0ba507b740 20 client.10617 trim_cache size 0 max 16384 2024-09-17T01:47:16.943 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-17T01:47:16.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.942+0000 7f0b9e000640 1 -- 172.21.15.42:0/2336414598 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0b74078b90 msgr2=0x7f0b7407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:16.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.942+0000 7f0b9e000640 1 --2- 172.21.15.42:0/2336414598 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0b74078b90 0x7f0b7407b0a0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f0b980b14b0 tx=0x7f0b80005db0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.942+0000 7f0b9e000640 1 -- 172.21.15.42:0/2336414598 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b9806db50 msgr2=0x7f0b98152bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:16.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.942+0000 7f0b9e000640 1 --2- 172.21.15.42:0/2336414598 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b9806db50 0x7f0b98152bc0 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7f0b8802b020 tx=0x7f0b88003f10 comp rx=0 tx=0).stop 2024-09-17T01:47:16.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.943+0000 7f0b9e000640 1 -- 172.21.15.42:0/2336414598 shutdown_connections 2024-09-17T01:47:16.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.943+0000 7f0b9e000640 1 --2- 172.21.15.42:0/2336414598 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0b74078b90 0x7f0b7407b0a0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.943+0000 7f0b9e000640 1 --2- 172.21.15.42:0/2336414598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b9806ee90 0x7f0b98147d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.943+0000 7f0b9e000640 1 --2- 172.21.15.42:0/2336414598 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b9806f2a0 0x7f0b980b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.943+0000 7f0b9e000640 1 --2- 172.21.15.42:0/2336414598 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b9806db50 0x7f0b98152bc0 unknown :-1 s=CLOSED pgs=2194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:16.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.943+0000 7f0b9e000640 1 -- 172.21.15.42:0/2336414598 >> 172.21.15.42:0/2336414598 conn(0x7f0b980b2930 msgr2=0x7f0b981615d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:16.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.943+0000 7f0b9e000640 1 -- 172.21.15.42:0/2336414598 shutdown_connections 2024-09-17T01:47:16.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:16.943+0000 7f0b9e000640 1 -- 172.21.15.42:0/2336414598 wait complete. 2024-09-17T01:47:16.966 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T01:47:17.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.193+0000 7fb5ed000640 1 -- 172.21.15.42:0/4184504379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5e806d430 msgr2=0x7fb5e806d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:17.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.193+0000 7fb5ed000640 1 --2- 172.21.15.42:0/4184504379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5e806d430 0x7fb5e806d840 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0005fd0 tx=0x7fb5e002aaa0 comp rx=0 tx=0).stop 2024-09-17T01:47:17.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.193+0000 7fb5ed000640 1 -- 172.21.15.42:0/4184504379 shutdown_connections 2024-09-17T01:47:17.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.193+0000 7fb5ed000640 1 --2- 172.21.15.42:0/4184504379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5e806d430 0x7fb5e806d840 unknown :-1 s=CLOSED pgs=2199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:17.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.193+0000 7fb5ed000640 1 --2- 172.21.15.42:0/4184504379 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5e80b3880 0x7fb5e80af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:17.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.193+0000 7fb5ed000640 1 -- 172.21.15.42:0/4184504379 >> 172.21.15.42:0/4184504379 conn(0x7fb5e80b2930 msgr2=0x7fb5e806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:17.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.193+0000 7fb5ed000640 1 -- 172.21.15.42:0/4184504379 shutdown_connections 2024-09-17T01:47:17.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.194+0000 7fb5ed000640 1 -- 172.21.15.42:0/4184504379 wait complete. 2024-09-17T01:47:17.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.196+0000 7fb5ed000640 1 Processor -- start 2024-09-17T01:47:17.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.196+0000 7fb5ed000640 1 -- start start 2024-09-17T01:47:17.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.197+0000 7fb5ed000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5e806d430 0x7fb5e8158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:17.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.197+0000 7fb5ed000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5e80b3880 0x7fb5e8146ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:17.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.197+0000 7fb5ed000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5e815cfc0 0x7fb5e80ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:17.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.197+0000 7fb5ed000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e8072ad0 con 0x7fb5e806d430 2024-09-17T01:47:17.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.197+0000 7fb5ed000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e8072950 con 0x7fb5e815cfc0 2024-09-17T01:47:17.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.197+0000 7fb5ed000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb5e8072c50 con 0x7fb5e80b3880 2024-09-17T01:47:17.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.198+0000 7fb5e5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5e806d430 0x7fb5e8158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:17.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.198+0000 7fb5e5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5e806d430 0x7fb5e8158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55574/0 (socket says 172.21.15.42:55574) 2024-09-17T01:47:17.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.198+0000 7fb5e5e00640 1 -- 172.21.15.42:0/2596659688 learned_addr learned my addr 172.21.15.42:0/2596659688 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:17.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.198+0000 7fb5dfe00640 1 --2- 172.21.15.42:0/2596659688 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5e80b3880 0x7fb5e8146ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:17.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.198+0000 7fb5e6800640 1 --2- 172.21.15.42:0/2596659688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5e815cfc0 0x7fb5e80ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:17.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.198+0000 7fb5e5e00640 1 -- 172.21.15.42:0/2596659688 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5e80b3880 msgr2=0x7fb5e8146ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:17.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.198+0000 7fb5e5e00640 1 --2- 172.21.15.42:0/2596659688 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5e80b3880 0x7fb5e8146ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:17.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.198+0000 7fb5e5e00640 1 -- 172.21.15.42:0/2596659688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5e815cfc0 msgr2=0x7fb5e80ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:17.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.198+0000 7fb5e5e00640 1 --2- 172.21.15.42:0/2596659688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5e815cfc0 0x7fb5e80ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:17.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.198+0000 7fb5e5e00640 1 -- 172.21.15.42:0/2596659688 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e81561e0 con 0x7fb5e806d430 2024-09-17T01:47:17.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.199+0000 7fb5e5e00640 1 --2- 172.21.15.42:0/2596659688 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5e806d430 0x7fb5e8158900 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800d700 tx=0x7fb5d800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:17.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.199+0000 7fb5de000640 1 -- 172.21.15.42:0/2596659688 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8017070 con 0x7fb5e806d430 2024-09-17T01:47:17.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.199+0000 7fb5de000640 1 -- 172.21.15.42:0/2596659688 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5d8005310 con 0x7fb5e806d430 2024-09-17T01:47:17.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.199+0000 7fb5de000640 1 -- 172.21.15.42:0/2596659688 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8009820 con 0x7fb5e806d430 2024-09-17T01:47:17.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.199+0000 7fb5ed000640 1 -- 172.21.15.42:0/2596659688 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e81f63a0 con 0x7fb5e806d430 2024-09-17T01:47:17.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.199+0000 7fb5ed000640 1 -- 172.21.15.42:0/2596659688 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e81f6960 con 0x7fb5e806d430 2024-09-17T01:47:17.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.200+0000 7fb5ed000640 1 -- 172.21.15.42:0/2596659688 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e80706d0 con 0x7fb5e806d430 2024-09-17T01:47:17.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.201+0000 7fb5de000640 1 -- 172.21.15.42:0/2596659688 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb5d80099c0 con 0x7fb5e806d430 2024-09-17T01:47:17.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.203+0000 7fb5de000640 1 --2- 172.21.15.42:0/2596659688 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb5c4078bc0 0x7fb5c407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:17.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.203+0000 7fb5de000640 1 -- 172.21.15.42:0/2596659688 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5767+0+0 (secure 0 0 0) 0x7fb5d809ad80 con 0x7fb5e806d430 2024-09-17T01:47:17.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.204+0000 7fb5dfe00640 1 --2- 172.21.15.42:0/2596659688 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb5c4078bc0 0x7fb5c407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:17.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.204+0000 7fb5dfe00640 1 --2- 172.21.15.42:0/2596659688 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb5c4078bc0 0x7fb5c407b0d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80b1d50 tx=0x7fb5d0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:17.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.208+0000 7fb5de000640 1 -- 172.21.15.42:0/2596659688 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb5e80706d0 con 0x7fb5e806d430 2024-09-17T01:47:17.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.441+0000 7fb5ed000640 1 -- 172.21.15.42:0/2596659688 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb5e81563b0 con 0x7fb5e806d430 2024-09-17T01:47:17.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.441+0000 7fb5de000640 1 -- 172.21.15.42:0/2596659688 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fb5d8062b20 con 0x7fb5e806d430 2024-09-17T01:47:17.439 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:17.439 INFO:teuthology.orchestra.run.smithi042.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T01:47:17.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.443+0000 7fb5ed000640 1 -- 172.21.15.42:0/2596659688 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb5c4078bc0 msgr2=0x7fb5c407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:17.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.443+0000 7fb5ed000640 1 --2- 172.21.15.42:0/2596659688 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb5c4078bc0 0x7fb5c407b0d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80b1d50 tx=0x7fb5d0009040 comp rx=0 tx=0).stop 2024-09-17T01:47:17.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.443+0000 7fb5ed000640 1 -- 172.21.15.42:0/2596659688 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5e806d430 msgr2=0x7fb5e8158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:17.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.443+0000 7fb5ed000640 1 --2- 172.21.15.42:0/2596659688 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5e806d430 0x7fb5e8158900 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800d700 tx=0x7fb5d800dbc0 comp rx=0 tx=0).stop 2024-09-17T01:47:17.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.444+0000 7fb5ed000640 1 -- 172.21.15.42:0/2596659688 shutdown_connections 2024-09-17T01:47:17.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.444+0000 7fb5ed000640 1 --2- 172.21.15.42:0/2596659688 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb5c4078bc0 0x7fb5c407b0d0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:17.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.444+0000 7fb5ed000640 1 --2- 172.21.15.42:0/2596659688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5e815cfc0 0x7fb5e80ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:17.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.444+0000 7fb5ed000640 1 --2- 172.21.15.42:0/2596659688 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5e80b3880 0x7fb5e8146ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:17.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.444+0000 7fb5ed000640 1 --2- 172.21.15.42:0/2596659688 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5e806d430 0x7fb5e8158900 unknown :-1 s=CLOSED pgs=2200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:17.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.444+0000 7fb5ed000640 1 -- 172.21.15.42:0/2596659688 >> 172.21.15.42:0/2596659688 conn(0x7fb5e80b2930 msgr2=0x7fb5e81606e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:17.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.444+0000 7fb5ed000640 1 -- 172.21.15.42:0/2596659688 shutdown_connections 2024-09-17T01:47:17.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:17.444+0000 7fb5ed000640 1 -- 172.21.15.42:0/2596659688 wait complete. 2024-09-17T01:47:17.468 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:47:17.468 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:47:17.556 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:47:17.654 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:47:17.654 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:47:17.654 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:47:17.654 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:47:17.690 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:47:17.690 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:47:17.766 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T01:47:18.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.036+0000 7fee1b600640 1 -- 172.21.15.42:0/655346437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee140ce850 msgr2=0x7fee1415bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:18.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.036+0000 7fee1b600640 1 --2- 172.21.15.42:0/655346437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee140ce850 0x7fee1415bcc0 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7fee14071ef0 tx=0x7fee0c02aac0 comp rx=0 tx=0).stop 2024-09-17T01:47:18.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.036+0000 7fee1b600640 1 -- 172.21.15.42:0/655346437 shutdown_connections 2024-09-17T01:47:18.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.036+0000 7fee1b600640 1 --2- 172.21.15.42:0/655346437 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee140ce850 0x7fee1415bcc0 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:18.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.036+0000 7fee1b600640 1 --2- 172.21.15.42:0/655346437 >> v2:172.21.15.43:3300/0 conn(0x7fee1406f410 0x7fee140ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:18.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.036+0000 7fee1b600640 1 -- 172.21.15.42:0/655346437 >> 172.21.15.42:0/655346437 conn(0x7fee140b2930 msgr2=0x7fee1406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:18.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.036+0000 7fee1b600640 1 -- 172.21.15.42:0/655346437 shutdown_connections 2024-09-17T01:47:18.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.036+0000 7fee1b600640 1 -- 172.21.15.42:0/655346437 wait complete. 2024-09-17T01:47:18.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.038+0000 7fee1b600640 1 Processor -- start 2024-09-17T01:47:18.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.039+0000 7fee1b600640 1 -- start start 2024-09-17T01:47:18.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.040+0000 7fee1b600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee1406f410 0x7fee141504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:18.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.040+0000 7fee1b600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fee1406f820 0x7fee1414dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:18.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.040+0000 7fee1b600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee140ce850 0x7fee14156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:18.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.040+0000 7fee1b600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fee140afb00 con 0x7fee140ce850 2024-09-17T01:47:18.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.040+0000 7fee1b600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fee140af980 con 0x7fee1406f410 2024-09-17T01:47:18.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.040+0000 7fee1b600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fee1415c200 con 0x7fee1406f820 2024-09-17T01:47:18.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.040+0000 7fee19600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee140ce850 0x7fee14156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:18.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.040+0000 7fee19600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee140ce850 0x7fee14156a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55582/0 (socket says 172.21.15.42:55582) 2024-09-17T01:47:18.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.040+0000 7fee19600640 1 -- 172.21.15.42:0/2507276080 learned_addr learned my addr 172.21.15.42:0/2507276080 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:18.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.041+0000 7fee18c00640 1 --2- 172.21.15.42:0/2507276080 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee1406f410 0x7fee141504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:18.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.041+0000 7fee13e00640 1 --2- 172.21.15.42:0/2507276080 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fee1406f820 0x7fee1414dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:18.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.041+0000 7fee19600640 1 -- 172.21.15.42:0/2507276080 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fee1406f820 msgr2=0x7fee1414dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:18.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.041+0000 7fee19600640 1 --2- 172.21.15.42:0/2507276080 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fee1406f820 0x7fee1414dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:18.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.041+0000 7fee19600640 1 -- 172.21.15.42:0/2507276080 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee1406f410 msgr2=0x7fee141504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:18.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.041+0000 7fee19600640 1 --2- 172.21.15.42:0/2507276080 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee1406f410 0x7fee141504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:18.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.041+0000 7fee19600640 1 -- 172.21.15.42:0/2507276080 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee14154eb0 con 0x7fee140ce850 2024-09-17T01:47:18.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.041+0000 7fee13e00640 1 --2- 172.21.15.42:0/2507276080 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fee1406f820 0x7fee1414dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:47:18.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.041+0000 7fee19600640 1 --2- 172.21.15.42:0/2507276080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee140ce850 0x7fee14156a30 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7fee0c009d60 tx=0x7fee0c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:18.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.041+0000 7fee10c00640 1 -- 172.21.15.42:0/2507276080 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c044070 con 0x7fee140ce850 2024-09-17T01:47:18.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.041+0000 7fee10c00640 1 -- 172.21.15.42:0/2507276080 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee0c004250 con 0x7fee140ce850 2024-09-17T01:47:18.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.041+0000 7fee10c00640 1 -- 172.21.15.42:0/2507276080 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c004680 con 0x7fee140ce850 2024-09-17T01:47:18.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.041+0000 7fee1b600640 1 -- 172.21.15.42:0/2507276080 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee14155c70 con 0x7fee140ce850 2024-09-17T01:47:18.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.041+0000 7fee1b600640 1 -- 172.21.15.42:0/2507276080 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee14156230 con 0x7fee140ce850 2024-09-17T01:47:18.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.043+0000 7fee1b600640 1 -- 172.21.15.42:0/2507276080 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee140ce310 con 0x7fee140ce850 2024-09-17T01:47:18.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.044+0000 7fee10c00640 1 -- 172.21.15.42:0/2507276080 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fee0c036400 con 0x7fee140ce850 2024-09-17T01:47:18.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.045+0000 7fee10c00640 1 --2- 172.21.15.42:0/2507276080 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fedf4078bc0 0x7fedf407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:18.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.045+0000 7fee10c00640 1 -- 172.21.15.42:0/2507276080 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5767+0+0 (secure 0 0 0) 0x7fee0c0bb490 con 0x7fee140ce850 2024-09-17T01:47:18.043 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.046+0000 7fee18c00640 1 --2- 172.21.15.42:0/2507276080 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fedf4078bc0 0x7fedf407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:18.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.046+0000 7fee18c00640 1 --2- 172.21.15.42:0/2507276080 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fedf4078bc0 0x7fedf407b0d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fee08005fd0 tx=0x7fee08005850 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:18.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.049+0000 7fee10c00640 1 -- 172.21.15.42:0/2507276080 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fee0c032030 con 0x7fee140ce850 2024-09-17T01:47:18.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.255+0000 7fee1b600640 1 -- 172.21.15.42:0/2507276080 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fee1406a170 con 0x7fee140ce850 2024-09-17T01:47:18.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.255+0000 7fee10c00640 1 -- 172.21.15.42:0/2507276080 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v189) ==== 80+0+0 (secure 0 0 0) 0x7fee0c004820 con 0x7fee140ce850 2024-09-17T01:47:18.253 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-17T01:47:18.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.258+0000 7fee1b600640 1 -- 172.21.15.42:0/2507276080 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fedf4078bc0 msgr2=0x7fedf407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:18.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.258+0000 7fee1b600640 1 --2- 172.21.15.42:0/2507276080 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fedf4078bc0 0x7fedf407b0d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fee08005fd0 tx=0x7fee08005850 comp rx=0 tx=0).stop 2024-09-17T01:47:18.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.258+0000 7fee1b600640 1 -- 172.21.15.42:0/2507276080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee140ce850 msgr2=0x7fee14156a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:18.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.258+0000 7fee1b600640 1 --2- 172.21.15.42:0/2507276080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee140ce850 0x7fee14156a30 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7fee0c009d60 tx=0x7fee0c003f10 comp rx=0 tx=0).stop 2024-09-17T01:47:18.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.258+0000 7fee1b600640 1 -- 172.21.15.42:0/2507276080 shutdown_connections 2024-09-17T01:47:18.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.258+0000 7fee1b600640 1 --2- 172.21.15.42:0/2507276080 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fedf4078bc0 0x7fedf407b0d0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:18.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.258+0000 7fee1b600640 1 --2- 172.21.15.42:0/2507276080 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee140ce850 0x7fee14156a30 unknown :-1 s=CLOSED pgs=2202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:18.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.258+0000 7fee1b600640 1 --2- 172.21.15.42:0/2507276080 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fee1406f820 0x7fee1414dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:18.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.258+0000 7fee1b600640 1 --2- 172.21.15.42:0/2507276080 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee1406f410 0x7fee141504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:18.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.258+0000 7fee1b600640 1 -- 172.21.15.42:0/2507276080 >> 172.21.15.42:0/2507276080 conn(0x7fee140b2930 msgr2=0x7fee1415dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:18.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.258+0000 7fee1b600640 1 -- 172.21.15.42:0/2507276080 shutdown_connections 2024-09-17T01:47:18.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.258+0000 7fee1b600640 1 -- 172.21.15.42:0/2507276080 wait complete. 2024-09-17T01:47:18.279 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T01:47:18.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:47:18.279 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T01:47:18.342 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:47:18.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:47:18.342 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T01:47:18.378 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:47:18.378 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:47:18.379 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:47:18.420 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:47:18.421 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:47:18.421 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:47:18.421 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:47:18.457 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:47:18.457 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:47:18.457 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:47:18.457 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:47:18.500 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:47:18.500 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:47:18.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.730+0000 7f3828800640 1 -- 172.21.15.42:0/2426474175 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f382015cec0 msgr2=0x7f382015d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:18.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.730+0000 7f3828800640 1 --2- 172.21.15.42:0/2426474175 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f382015cec0 0x7f382015d2d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3814009860 tx=0x7f381402a530 comp rx=0 tx=0).stop 2024-09-17T01:47:18.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.730+0000 7f3828800640 1 -- 172.21.15.42:0/2426474175 shutdown_connections 2024-09-17T01:47:18.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.730+0000 7f3828800640 1 --2- 172.21.15.42:0/2426474175 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f382015cec0 0x7f382015d2d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:18.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.730+0000 7f3828800640 1 -- 172.21.15.42:0/2426474175 >> 172.21.15.42:0/2426474175 conn(0x7f38200b2930 msgr2=0x7f382006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:18.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.730+0000 7f3828800640 1 -- 172.21.15.42:0/2426474175 shutdown_connections 2024-09-17T01:47:18.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.730+0000 7f3828800640 1 -- 172.21.15.42:0/2426474175 wait complete. 2024-09-17T01:47:18.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.732+0000 7f3828800640 1 Processor -- start 2024-09-17T01:47:18.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.732+0000 7f3828800640 1 -- start start 2024-09-17T01:47:18.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.734+0000 7f3828800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38200cecb0 0x7f3820159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:18.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.734+0000 7f3828800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38200cf0c0 0x7f382015a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:18.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.734+0000 7f3828800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f382015cec0 0x7f38201f6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:18.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.734+0000 7f3828800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f38200b37e0 con 0x7f38200cecb0 2024-09-17T01:47:18.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.734+0000 7f3828800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f38200741c0 con 0x7f38200cf0c0 2024-09-17T01:47:18.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.734+0000 7f3828800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f382006db40 con 0x7f382015cec0 2024-09-17T01:47:18.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.734+0000 7f3825e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38200cecb0 0x7f3820159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:18.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.734+0000 7f3825e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38200cecb0 0x7f3820159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55590/0 (socket says 172.21.15.42:55590) 2024-09-17T01:47:18.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.734+0000 7f3825e00640 1 -- 172.21.15.42:0/2620634273 learned_addr learned my addr 172.21.15.42:0/2620634273 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:18.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.734+0000 7f3826800640 1 --2- 172.21.15.42:0/2620634273 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f382015cec0 0x7f38201f6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:18.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.734+0000 7f3825400640 1 --2- 172.21.15.42:0/2620634273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38200cf0c0 0x7f382015a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:18.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.734+0000 7f3825e00640 1 -- 172.21.15.42:0/2620634273 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f382015cec0 msgr2=0x7f38201f6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:18.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.734+0000 7f3825e00640 1 --2- 172.21.15.42:0/2620634273 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f382015cec0 0x7f38201f6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:18.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.734+0000 7f3825e00640 1 -- 172.21.15.42:0/2620634273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38200cf0c0 msgr2=0x7f382015a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:18.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.734+0000 7f3825e00640 1 --2- 172.21.15.42:0/2620634273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38200cf0c0 0x7f382015a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:18.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.734+0000 7f3825e00640 1 -- 172.21.15.42:0/2620634273 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38201594e0 con 0x7f38200cecb0 2024-09-17T01:47:18.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.735+0000 7f3825e00640 1 --2- 172.21.15.42:0/2620634273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38200cecb0 0x7f3820159dc0 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f381402ab20 tx=0x7f3814030650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:18.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.735+0000 7f381a000640 1 -- 172.21.15.42:0/2620634273 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381403f070 con 0x7f38200cecb0 2024-09-17T01:47:18.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.735+0000 7f381a000640 1 -- 172.21.15.42:0/2620634273 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3814030d60 con 0x7f38200cecb0 2024-09-17T01:47:18.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.735+0000 7f381a000640 1 -- 172.21.15.42:0/2620634273 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3814004280 con 0x7f38200cecb0 2024-09-17T01:47:18.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.735+0000 7f3828800640 1 -- 172.21.15.42:0/2620634273 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38200ada40 con 0x7f38200cecb0 2024-09-17T01:47:18.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.735+0000 7f3828800640 1 -- 172.21.15.42:0/2620634273 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38200ae000 con 0x7f38200cecb0 2024-09-17T01:47:18.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.736+0000 7f3828800640 1 -- 172.21.15.42:0/2620634273 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f382015d2d0 con 0x7f38200cecb0 2024-09-17T01:47:18.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.738+0000 7f381a000640 1 -- 172.21.15.42:0/2620634273 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f38140035f0 con 0x7f38200cecb0 2024-09-17T01:47:18.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.739+0000 7f381a000640 1 --2- 172.21.15.42:0/2620634273 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3804078b90 0x7f380407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:18.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.739+0000 7f381a000640 1 -- 172.21.15.42:0/2620634273 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5767+0+0 (secure 0 0 0) 0x7f38140bbd20 con 0x7f38200cecb0 2024-09-17T01:47:18.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.739+0000 7f3825400640 1 --2- 172.21.15.42:0/2620634273 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3804078b90 0x7f380407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:18.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.740+0000 7f3825400640 1 --2- 172.21.15.42:0/2620634273 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3804078b90 0x7f380407b0a0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f3810001220 tx=0x7f3810001750 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:18.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.743+0000 7f381a000640 1 -- 172.21.15.42:0/2620634273 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3814083ac0 con 0x7f38200cecb0 2024-09-17T01:47:18.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.973+0000 7f3828800640 1 -- 172.21.15.42:0/2620634273 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f382006a170 con 0x7f38200cecb0 2024-09-17T01:47:18.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.973+0000 7f381a000640 1 -- 172.21.15.42:0/2620634273 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 150 v150) ==== 95+0+5240 (secure 0 0 0) 0x7f38140884f0 con 0x7f38200cecb0 2024-09-17T01:47:18.971 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:18.971 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":150,"btime":"2024-09-17T01:46:34:429037+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8549,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4165093647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4165093647},{"type":"v1","addr":"172.21.15.43:6836","nonce":4165093647}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145},{"gid":10353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/4260984866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":4260984866},{"type":"v1","addr":"172.21.15.42:6834","nonce":4260984866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":10356,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2804168804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":2804168804},{"type":"v1","addr":"172.21.15.42:6835","nonce":2804168804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145}],"filesystems":[{"mdsmap":{"epoch":150,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:46:30.922674+0000","modified":"2024-09-17T01:46:33.938360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10371":{"gid":10371,"name":"b","rank":0,"incarnation":146,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/1477091047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1477091047},{"type":"v1","addr":"172.21.15.43:6837","nonce":1477091047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10371,"qdb_cluster":[10371]},"id":13}]} 2024-09-17T01:47:18.972 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 150 2024-09-17T01:47:18.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.976+0000 7f3828800640 1 -- 172.21.15.42:0/2620634273 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3804078b90 msgr2=0x7f380407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:18.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.976+0000 7f3828800640 1 --2- 172.21.15.42:0/2620634273 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3804078b90 0x7f380407b0a0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f3810001220 tx=0x7f3810001750 comp rx=0 tx=0).stop 2024-09-17T01:47:18.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.976+0000 7f3828800640 1 -- 172.21.15.42:0/2620634273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38200cecb0 msgr2=0x7f3820159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:18.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.976+0000 7f3828800640 1 --2- 172.21.15.42:0/2620634273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38200cecb0 0x7f3820159dc0 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f381402ab20 tx=0x7f3814030650 comp rx=0 tx=0).stop 2024-09-17T01:47:18.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.976+0000 7f3828800640 1 -- 172.21.15.42:0/2620634273 shutdown_connections 2024-09-17T01:47:18.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.976+0000 7f3828800640 1 --2- 172.21.15.42:0/2620634273 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3804078b90 0x7f380407b0a0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:18.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.976+0000 7f3828800640 1 --2- 172.21.15.42:0/2620634273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38200cf0c0 0x7f382015a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:18.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.976+0000 7f3828800640 1 --2- 172.21.15.42:0/2620634273 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f382015cec0 0x7f38201f6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:18.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.976+0000 7f3828800640 1 --2- 172.21.15.42:0/2620634273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38200cecb0 0x7f3820159dc0 unknown :-1 s=CLOSED pgs=2204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:18.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.976+0000 7f3828800640 1 -- 172.21.15.42:0/2620634273 >> 172.21.15.42:0/2620634273 conn(0x7f38200b2930 msgr2=0x7f382015e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:18.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.976+0000 7f3828800640 1 -- 172.21.15.42:0/2620634273 shutdown_connections 2024-09-17T01:47:18.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:18.976+0000 7f3828800640 1 -- 172.21.15.42:0/2620634273 wait complete. 2024-09-17T01:47:18.996 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:47:19.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.225+0000 7f5fe1200640 1 -- 172.21.15.42:0/3063326992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fdc06d260 msgr2=0x7f5fdc152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:19.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.225+0000 7f5fe1200640 1 --2- 172.21.15.42:0/3063326992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fdc06d260 0x7f5fdc152ed0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc071cb0 tx=0x7f5fd402aa10 comp rx=0 tx=0).stop 2024-09-17T01:47:19.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.225+0000 7f5fe1200640 1 -- 172.21.15.42:0/3063326992 shutdown_connections 2024-09-17T01:47:19.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.225+0000 7f5fe1200640 1 --2- 172.21.15.42:0/3063326992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fdc06d260 0x7f5fdc152ed0 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:19.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.225+0000 7f5fe1200640 1 --2- 172.21.15.42:0/3063326992 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5fdc0cf7c0 0x7f5fdc06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:19.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.225+0000 7f5fe1200640 1 --2- 172.21.15.42:0/3063326992 >> v2:172.21.15.43:3300/0 conn(0x7f5fdc0b4be0 0x7f5fdc15d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:19.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.225+0000 7f5fe1200640 1 -- 172.21.15.42:0/3063326992 >> 172.21.15.42:0/3063326992 conn(0x7f5fdc0b25f0 msgr2=0x7f5fdc0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:19.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.225+0000 7f5fe1200640 1 -- 172.21.15.42:0/3063326992 shutdown_connections 2024-09-17T01:47:19.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.225+0000 7f5fe1200640 1 -- 172.21.15.42:0/3063326992 wait complete. 2024-09-17T01:47:19.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.228+0000 7f5fe1200640 1 Processor -- start 2024-09-17T01:47:19.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.228+0000 7f5fe1200640 1 -- start start 2024-09-17T01:47:19.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.229+0000 7f5fe1200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5fdc06d260 0x7f5fdc147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:19.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.229+0000 7f5fe1200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fdc0b4be0 0x7f5fdc146470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:19.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.229+0000 7f5fe1200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fdc0cf7c0 0x7f5fdc1469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:19.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.229+0000 7f5fe1200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5fdc1537a0 con 0x7f5fdc0cf7c0 2024-09-17T01:47:19.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.229+0000 7f5fe1200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5fdc153620 con 0x7f5fdc0b4be0 2024-09-17T01:47:19.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.229+0000 7f5fe1200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5fdc153920 con 0x7f5fdc06d260 2024-09-17T01:47:19.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.230+0000 7f5fdbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fdc0cf7c0 0x7f5fdc1469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:19.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.230+0000 7f5fdbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fdc0cf7c0 0x7f5fdc1469b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55608/0 (socket says 172.21.15.42:55608) 2024-09-17T01:47:19.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.230+0000 7f5fdbe00640 1 -- 172.21.15.42:0/3622592865 learned_addr learned my addr 172.21.15.42:0/3622592865 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:19.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.230+0000 7f5fd3e00640 1 --2- 172.21.15.42:0/3622592865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fdc0b4be0 0x7f5fdc146470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:19.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.230+0000 7f5fdb400640 1 --2- 172.21.15.42:0/3622592865 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5fdc06d260 0x7f5fdc147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:19.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.230+0000 7f5fdbe00640 1 -- 172.21.15.42:0/3622592865 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5fdc06d260 msgr2=0x7f5fdc147050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:19.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.230+0000 7f5fdbe00640 1 --2- 172.21.15.42:0/3622592865 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5fdc06d260 0x7f5fdc147050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:19.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.230+0000 7f5fdbe00640 1 -- 172.21.15.42:0/3622592865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fdc0b4be0 msgr2=0x7f5fdc146470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:19.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.230+0000 7f5fdbe00640 1 --2- 172.21.15.42:0/3622592865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fdc0b4be0 0x7f5fdc146470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:19.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.230+0000 7f5fdbe00640 1 -- 172.21.15.42:0/3622592865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fdc074d80 con 0x7f5fdc0cf7c0 2024-09-17T01:47:19.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.230+0000 7f5fd3e00640 1 --2- 172.21.15.42:0/3622592865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fdc0b4be0 0x7f5fdc146470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:47:19.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.230+0000 7f5fdbe00640 1 --2- 172.21.15.42:0/3622592865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fdc0cf7c0 0x7f5fdc1469b0 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4009d60 tx=0x7f5fd4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:19.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.231+0000 7f5fd3400640 1 -- 172.21.15.42:0/3622592865 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd4033050 con 0x7f5fdc0cf7c0 2024-09-17T01:47:19.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.231+0000 7f5fd3400640 1 -- 172.21.15.42:0/3622592865 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fd4004450 con 0x7f5fdc0cf7c0 2024-09-17T01:47:19.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.231+0000 7f5fd3400640 1 -- 172.21.15.42:0/3622592865 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd4038450 con 0x7f5fdc0cf7c0 2024-09-17T01:47:19.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.231+0000 7f5fe1200640 1 -- 172.21.15.42:0/3622592865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fdc144630 con 0x7f5fdc0cf7c0 2024-09-17T01:47:19.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.231+0000 7f5fe1200640 1 -- 172.21.15.42:0/3622592865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fdc144bf0 con 0x7f5fdc0cf7c0 2024-09-17T01:47:19.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.232+0000 7f5fe1200640 1 -- 172.21.15.42:0/3622592865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fdc074af0 con 0x7f5fdc0cf7c0 2024-09-17T01:47:19.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.233+0000 7f5fd3400640 1 -- 172.21.15.42:0/3622592865 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5fd4036070 con 0x7f5fdc0cf7c0 2024-09-17T01:47:19.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.234+0000 7f5fd3400640 1 --2- 172.21.15.42:0/3622592865 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5fb8078bc0 0x7f5fb807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:19.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.234+0000 7f5fd3400640 1 -- 172.21.15.42:0/3622592865 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5767+0+0 (secure 0 0 0) 0x7f5fd40bc0f0 con 0x7f5fdc0cf7c0 2024-09-17T01:47:19.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.235+0000 7f5fdb400640 1 --2- 172.21.15.42:0/3622592865 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5fb8078bc0 0x7f5fb807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:19.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.235+0000 7f5fdb400640 1 --2- 172.21.15.42:0/3622592865 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5fb8078bc0 0x7f5fb807b0d0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc009a40 tx=0x7f5fcc005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:19.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.239+0000 7f5fd3400640 1 -- 172.21.15.42:0/3622592865 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5fd40844f0 con 0x7f5fdc0cf7c0 2024-09-17T01:47:19.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.476+0000 7f5fe1200640 1 -- 172.21.15.42:0/3622592865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5fdc15d6b0 con 0x7f5fdc0cf7c0 2024-09-17T01:47:19.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.477+0000 7f5fd3400640 1 -- 172.21.15.42:0/3622592865 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 150 v150) ==== 95+0+5240 (secure 0 0 0) 0x7f5fd4083df0 con 0x7f5fdc0cf7c0 2024-09-17T01:47:19.475 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:19.475 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":150,"btime":"2024-09-17T01:46:34:429037+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8549,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4165093647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4165093647},{"type":"v1","addr":"172.21.15.43:6836","nonce":4165093647}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145},{"gid":10353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/4260984866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":4260984866},{"type":"v1","addr":"172.21.15.42:6834","nonce":4260984866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":10356,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2804168804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":2804168804},{"type":"v1","addr":"172.21.15.42:6835","nonce":2804168804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145}],"filesystems":[{"mdsmap":{"epoch":150,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:46:30.922674+0000","modified":"2024-09-17T01:46:33.938360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10371":{"gid":10371,"name":"b","rank":0,"incarnation":146,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/1477091047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1477091047},{"type":"v1","addr":"172.21.15.43:6837","nonce":1477091047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10371,"qdb_cluster":[10371]},"id":13}]} 2024-09-17T01:47:19.475 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 150 2024-09-17T01:47:19.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.479+0000 7f5fe1200640 1 -- 172.21.15.42:0/3622592865 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5fb8078bc0 msgr2=0x7f5fb807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:19.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.479+0000 7f5fe1200640 1 --2- 172.21.15.42:0/3622592865 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5fb8078bc0 0x7f5fb807b0d0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc009a40 tx=0x7f5fcc005f90 comp rx=0 tx=0).stop 2024-09-17T01:47:19.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.479+0000 7f5fe1200640 1 -- 172.21.15.42:0/3622592865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fdc0cf7c0 msgr2=0x7f5fdc1469b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:19.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.479+0000 7f5fe1200640 1 --2- 172.21.15.42:0/3622592865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fdc0cf7c0 0x7f5fdc1469b0 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4009d60 tx=0x7f5fd4003f10 comp rx=0 tx=0).stop 2024-09-17T01:47:19.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.479+0000 7f5fe1200640 1 -- 172.21.15.42:0/3622592865 shutdown_connections 2024-09-17T01:47:19.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.479+0000 7f5fe1200640 1 --2- 172.21.15.42:0/3622592865 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5fb8078bc0 0x7f5fb807b0d0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:19.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.479+0000 7f5fe1200640 1 --2- 172.21.15.42:0/3622592865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fdc0b4be0 0x7f5fdc146470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:19.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.479+0000 7f5fe1200640 1 --2- 172.21.15.42:0/3622592865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5fdc0cf7c0 0x7f5fdc1469b0 unknown :-1 s=CLOSED pgs=2206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:19.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.479+0000 7f5fe1200640 1 --2- 172.21.15.42:0/3622592865 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5fdc06d260 0x7f5fdc147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:19.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.479+0000 7f5fe1200640 1 -- 172.21.15.42:0/3622592865 >> 172.21.15.42:0/3622592865 conn(0x7f5fdc0b25f0 msgr2=0x7f5fdc0b1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:19.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.480+0000 7f5fe1200640 1 -- 172.21.15.42:0/3622592865 shutdown_connections 2024-09-17T01:47:19.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.480+0000 7f5fe1200640 1 -- 172.21.15.42:0/3622592865 wait complete. 2024-09-17T01:47:19.505 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:47:19.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.735+0000 7f8227200640 1 -- 172.21.15.42:0/1738858935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f822806cd20 msgr2=0x7f822806d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:19.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.735+0000 7f8227200640 1 --2- 172.21.15.42:0/1738858935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f822806cd20 0x7f822806d130 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f8218005fd0 tx=0x7f821802a5c0 comp rx=0 tx=0).stop 2024-09-17T01:47:19.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.735+0000 7f8227200640 1 -- 172.21.15.42:0/1738858935 shutdown_connections 2024-09-17T01:47:19.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.735+0000 7f8227200640 1 --2- 172.21.15.42:0/1738858935 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f82280cf230 0x7f82280cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:19.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.735+0000 7f8227200640 1 --2- 172.21.15.42:0/1738858935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f822806cd20 0x7f822806d130 unknown :-1 s=CLOSED pgs=2207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:19.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.735+0000 7f8227200640 1 -- 172.21.15.42:0/1738858935 >> 172.21.15.42:0/1738858935 conn(0x7f82280b25f0 msgr2=0x7f82280d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:19.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.735+0000 7f8227200640 1 -- 172.21.15.42:0/1738858935 shutdown_connections 2024-09-17T01:47:19.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.735+0000 7f8227200640 1 -- 172.21.15.42:0/1738858935 wait complete. 2024-09-17T01:47:19.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.737+0000 7f8227200640 1 Processor -- start 2024-09-17T01:47:19.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.738+0000 7f8227200640 1 -- start start 2024-09-17T01:47:19.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.739+0000 7f8227200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f822806cd20 0x7f822809d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:19.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.739+0000 7f8227200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82280cf230 0x7f8228151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:19.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.739+0000 7f8227200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f822815e3c0 0x7f8228151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:19.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.739+0000 7f8227200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8228155120 con 0x7f822815e3c0 2024-09-17T01:47:19.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.739+0000 7f8227200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f82280b41c0 con 0x7f82280cf230 2024-09-17T01:47:19.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.739+0000 7f8227200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f82281552a0 con 0x7f822806cd20 2024-09-17T01:47:19.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.739+0000 7f8226800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f822815e3c0 0x7f8228151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:19.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.739+0000 7f8226800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f822815e3c0 0x7f8228151980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55640/0 (socket says 172.21.15.42:55640) 2024-09-17T01:47:19.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.739+0000 7f8226800640 1 -- 172.21.15.42:0/3313889574 learned_addr learned my addr 172.21.15.42:0/3313889574 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:19.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.739+0000 7f821fe00640 1 --2- 172.21.15.42:0/3313889574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82280cf230 0x7f8228151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:19.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.739+0000 7f8225e00640 1 --2- 172.21.15.42:0/3313889574 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f822806cd20 0x7f822809d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:19.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.740+0000 7f8226800640 1 -- 172.21.15.42:0/3313889574 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f822806cd20 msgr2=0x7f822809d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:19.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.740+0000 7f8226800640 1 --2- 172.21.15.42:0/3313889574 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f822806cd20 0x7f822809d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:19.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.740+0000 7f8226800640 1 -- 172.21.15.42:0/3313889574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82280cf230 msgr2=0x7f8228151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:19.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.740+0000 7f8226800640 1 --2- 172.21.15.42:0/3313889574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82280cf230 0x7f8228151440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:19.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.740+0000 7f8226800640 1 -- 172.21.15.42:0/3313889574 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82281f33a0 con 0x7f822815e3c0 2024-09-17T01:47:19.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.740+0000 7f8226800640 1 --2- 172.21.15.42:0/3313889574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f822815e3c0 0x7f8228151980 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f822000c760 tx=0x7f822000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:19.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.740+0000 7f821e000640 1 -- 172.21.15.42:0/3313889574 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8220003b70 con 0x7f822815e3c0 2024-09-17T01:47:19.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.740+0000 7f821e000640 1 -- 172.21.15.42:0/3313889574 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8220003d10 con 0x7f822815e3c0 2024-09-17T01:47:19.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.740+0000 7f821e000640 1 -- 172.21.15.42:0/3313889574 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8220005330 con 0x7f822815e3c0 2024-09-17T01:47:19.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.740+0000 7f8227200640 1 -- 172.21.15.42:0/3313889574 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f822809dd40 con 0x7f822815e3c0 2024-09-17T01:47:19.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.740+0000 7f8227200640 1 -- 172.21.15.42:0/3313889574 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82281524f0 con 0x7f822815e3c0 2024-09-17T01:47:19.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.741+0000 7f8227200640 1 -- 172.21.15.42:0/3313889574 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82281f3610 con 0x7f822815e3c0 2024-09-17T01:47:19.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.743+0000 7f821e000640 1 -- 172.21.15.42:0/3313889574 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f82200054d0 con 0x7f822815e3c0 2024-09-17T01:47:19.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.744+0000 7f821e000640 1 --2- 172.21.15.42:0/3313889574 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8204078b90 0x7f820407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:19.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.744+0000 7f821e000640 1 -- 172.21.15.42:0/3313889574 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5767+0+0 (secure 0 0 0) 0x7f822009aaf0 con 0x7f822815e3c0 2024-09-17T01:47:19.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.744+0000 7f8225e00640 1 --2- 172.21.15.42:0/3313889574 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8204078b90 0x7f820407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:19.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.745+0000 7f8225e00640 1 --2- 172.21.15.42:0/3313889574 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8204078b90 0x7f820407b0a0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f8218033000 tx=0x7f8218004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:19.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.749+0000 7f821e000640 1 -- 172.21.15.42:0/3313889574 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f822806d670 con 0x7f822815e3c0 2024-09-17T01:47:19.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.944+0000 7f8227200640 1 -- 172.21.15.42:0/3313889574 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f82280af5d0 con 0x7f822815e3c0 2024-09-17T01:47:19.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.945+0000 7f821e000640 1 -- 172.21.15.42:0/3313889574 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) ==== 74+0+16781 (secure 0 0 0) 0x7f8220062800 con 0x7f822815e3c0 2024-09-17T01:47:19.943 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:19.944 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":189,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:46:52.494208+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:46:28.879952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-17T01:46:29.890485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"27.1c","mappings":[{"from":7,"to":6}]},{"pgid":"27.3b","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:47:19.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.947+0000 7f8227200640 1 -- 172.21.15.42:0/3313889574 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8204078b90 msgr2=0x7f820407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:19.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.947+0000 7f8227200640 1 --2- 172.21.15.42:0/3313889574 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8204078b90 0x7f820407b0a0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f8218033000 tx=0x7f8218004730 comp rx=0 tx=0).stop 2024-09-17T01:47:19.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.947+0000 7f8227200640 1 -- 172.21.15.42:0/3313889574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f822815e3c0 msgr2=0x7f8228151980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:19.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.947+0000 7f8227200640 1 --2- 172.21.15.42:0/3313889574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f822815e3c0 0x7f8228151980 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f822000c760 tx=0x7f822000cb60 comp rx=0 tx=0).stop 2024-09-17T01:47:19.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.948+0000 7f8227200640 1 -- 172.21.15.42:0/3313889574 shutdown_connections 2024-09-17T01:47:19.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.948+0000 7f8227200640 1 --2- 172.21.15.42:0/3313889574 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8204078b90 0x7f820407b0a0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:19.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.948+0000 7f8227200640 1 --2- 172.21.15.42:0/3313889574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82280cf230 0x7f8228151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:19.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.948+0000 7f8227200640 1 --2- 172.21.15.42:0/3313889574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f822815e3c0 0x7f8228151980 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:19.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.948+0000 7f8227200640 1 --2- 172.21.15.42:0/3313889574 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f822806cd20 0x7f822809d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:19.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.948+0000 7f8227200640 1 -- 172.21.15.42:0/3313889574 >> 172.21.15.42:0/3313889574 conn(0x7f82280b25f0 msgr2=0x7f822815d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:19.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.948+0000 7f8227200640 1 -- 172.21.15.42:0/3313889574 shutdown_connections 2024-09-17T01:47:19.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:19.948+0000 7f8227200640 1 -- 172.21.15.42:0/3313889574 wait complete. 2024-09-17T01:47:19.968 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T01:47:19.968 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:47:20.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.198+0000 7fd07ce00640 1 -- 172.21.15.42:0/994559071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd05c003c10 msgr2=0x7fd05c004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:20.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.198+0000 7fd07ce00640 1 --2- 172.21.15.42:0/994559071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd05c003c10 0x7fd05c004060 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7fd06800c3c0 tx=0x7fd05c005830 comp rx=0 tx=0).stop 2024-09-17T01:47:20.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.198+0000 7fd077e00640 1 -- 172.21.15.42:0/994559071 reap_dead start 2024-09-17T01:47:20.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.198+0000 7fd07ce00640 1 -- 172.21.15.42:0/994559071 shutdown_connections 2024-09-17T01:47:20.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.198+0000 7fd07ce00640 1 -- 172.21.15.42:0/994559071 >> 172.21.15.42:0/994559071 conn(0x7fd0780d1210 msgr2=0x7fd0780d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:20.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.198+0000 7fd07ce00640 1 -- 172.21.15.42:0/994559071 shutdown_connections 2024-09-17T01:47:20.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.198+0000 7fd07ce00640 1 -- 172.21.15.42:0/994559071 wait complete. 2024-09-17T01:47:20.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.200+0000 7fd07ce00640 1 Processor -- start 2024-09-17T01:47:20.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.200+0000 7fd07ce00640 1 -- start start 2024-09-17T01:47:20.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.202+0000 7fd07ce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd05c003c10 0x7fd0780cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:20.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.202+0000 7fd07ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd07815a5e0 0x7fd07814b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:20.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.202+0000 7fd07ce00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd07814ba80 0x7fd0781e85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:20.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.202+0000 7fd07ce00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd07815f640 con 0x7fd07815a5e0 2024-09-17T01:47:20.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.202+0000 7fd07ce00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd07815f4c0 con 0x7fd05c003c10 2024-09-17T01:47:20.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.202+0000 7fd07ce00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd07815f7c0 con 0x7fd07814ba80 2024-09-17T01:47:20.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.202+0000 7fd06ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd07815a5e0 0x7fd07814b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:20.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.202+0000 7fd06ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd07815a5e0 0x7fd07814b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55668/0 (socket says 172.21.15.42:55668) 2024-09-17T01:47:20.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.202+0000 7fd06ea00640 1 -- 172.21.15.42:0/1661588169 learned_addr learned my addr 172.21.15.42:0/1661588169 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:20.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.202+0000 7fd077400640 1 --2- 172.21.15.42:0/1661588169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd05c003c10 0x7fd0780cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:20.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.202+0000 7fd077e00640 1 --2- 172.21.15.42:0/1661588169 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd07814ba80 0x7fd0781e85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:20.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.203+0000 7fd06ea00640 1 -- 172.21.15.42:0/1661588169 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd07814ba80 msgr2=0x7fd0781e85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:20.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.203+0000 7fd06ea00640 1 --2- 172.21.15.42:0/1661588169 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd07814ba80 0x7fd0781e85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:20.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.203+0000 7fd06ea00640 1 -- 172.21.15.42:0/1661588169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd05c003c10 msgr2=0x7fd0780cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:20.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.203+0000 7fd06ea00640 1 --2- 172.21.15.42:0/1661588169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd05c003c10 0x7fd0780cf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:20.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.203+0000 7fd06ea00640 1 -- 172.21.15.42:0/1661588169 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0780ca8e0 con 0x7fd07815a5e0 2024-09-17T01:47:20.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.203+0000 7fd077e00640 1 --2- 172.21.15.42:0/1661588169 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd07814ba80 0x7fd0781e85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:47:20.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.203+0000 7fd06ea00640 1 --2- 172.21.15.42:0/1661588169 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd07815a5e0 0x7fd07814b540 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7fd060006650 tx=0x7fd060001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:20.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.203+0000 7fd06fe00640 1 -- 172.21.15.42:0/1661588169 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd060011700 con 0x7fd07815a5e0 2024-09-17T01:47:20.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.203+0000 7fd06fe00640 1 -- 172.21.15.42:0/1661588169 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd060016020 con 0x7fd07815a5e0 2024-09-17T01:47:20.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.203+0000 7fd07ce00640 1 -- 172.21.15.42:0/1661588169 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0780cab80 con 0x7fd07815a5e0 2024-09-17T01:47:20.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.203+0000 7fd06fe00640 1 -- 172.21.15.42:0/1661588169 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd060011b00 con 0x7fd07815a5e0 2024-09-17T01:47:20.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.203+0000 7fd07ce00640 1 -- 172.21.15.42:0/1661588169 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd07814ac80 con 0x7fd07815a5e0 2024-09-17T01:47:20.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.204+0000 7fd07ce00640 1 -- 172.21.15.42:0/1661588169 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd078149500 con 0x7fd07815a5e0 2024-09-17T01:47:20.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.206+0000 7fd06fe00640 1 -- 172.21.15.42:0/1661588169 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd060011ca0 con 0x7fd07815a5e0 2024-09-17T01:47:20.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.207+0000 7fd06fe00640 1 --2- 172.21.15.42:0/1661588169 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd054078b90 0x7fd05407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:20.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.207+0000 7fd06fe00640 1 -- 172.21.15.42:0/1661588169 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5767+0+0 (secure 0 0 0) 0x7fd06009b9a0 con 0x7fd07815a5e0 2024-09-17T01:47:20.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.207+0000 7fd077400640 1 --2- 172.21.15.42:0/1661588169 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd054078b90 0x7fd05407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:20.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.208+0000 7fd077400640 1 --2- 172.21.15.42:0/1661588169 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd054078b90 0x7fd05407b0a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd068033000 tx=0x7fd06802d070 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:20.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.211+0000 7fd06fe00640 1 -- 172.21.15.42:0/1661588169 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd078149500 con 0x7fd07815a5e0 2024-09-17T01:47:20.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.444+0000 7fd07ce00640 1 -- 172.21.15.42:0/1661588169 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0780b77a0 con 0x7fd07815a5e0 2024-09-17T01:47:20.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.444+0000 7fd06fe00640 1 -- 172.21.15.42:0/1661588169 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 150 v150) ==== 95+0+5240 (secure 0 0 0) 0x7fd0780b77a0 con 0x7fd07815a5e0 2024-09-17T01:47:20.442 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:20.442 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":150,"btime":"2024-09-17T01:46:34:429037+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8549,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4165093647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4165093647},{"type":"v1","addr":"172.21.15.43:6836","nonce":4165093647}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145},{"gid":10353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/4260984866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":4260984866},{"type":"v1","addr":"172.21.15.42:6834","nonce":4260984866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":10356,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2804168804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":2804168804},{"type":"v1","addr":"172.21.15.42:6835","nonce":2804168804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145}],"filesystems":[{"mdsmap":{"epoch":150,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:46:30.922674+0000","modified":"2024-09-17T01:46:33.938360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10371":{"gid":10371,"name":"b","rank":0,"incarnation":146,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/1477091047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1477091047},{"type":"v1","addr":"172.21.15.43:6837","nonce":1477091047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10371,"qdb_cluster":[10371]},"id":13}]} 2024-09-17T01:47:20.443 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 150 2024-09-17T01:47:20.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.447+0000 7fd07ce00640 1 -- 172.21.15.42:0/1661588169 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd054078b90 msgr2=0x7fd05407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:20.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.447+0000 7fd07ce00640 1 --2- 172.21.15.42:0/1661588169 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd054078b90 0x7fd05407b0a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd068033000 tx=0x7fd06802d070 comp rx=0 tx=0).stop 2024-09-17T01:47:20.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.447+0000 7fd07ce00640 1 -- 172.21.15.42:0/1661588169 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd07815a5e0 msgr2=0x7fd07814b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:20.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.447+0000 7fd07ce00640 1 --2- 172.21.15.42:0/1661588169 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd07815a5e0 0x7fd07814b540 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7fd060006650 tx=0x7fd060001800 comp rx=0 tx=0).stop 2024-09-17T01:47:20.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.447+0000 7fd07ce00640 1 -- 172.21.15.42:0/1661588169 shutdown_connections 2024-09-17T01:47:20.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.447+0000 7fd07ce00640 1 --2- 172.21.15.42:0/1661588169 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd054078b90 0x7fd05407b0a0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:20.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.447+0000 7fd07ce00640 1 --2- 172.21.15.42:0/1661588169 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd07814ba80 0x7fd0781e85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:20.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.447+0000 7fd07ce00640 1 --2- 172.21.15.42:0/1661588169 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd07815a5e0 0x7fd07814b540 unknown :-1 s=CLOSED pgs=2211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:20.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.447+0000 7fd07ce00640 1 --2- 172.21.15.42:0/1661588169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd05c003c10 0x7fd0780cf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:20.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.447+0000 7fd07ce00640 1 -- 172.21.15.42:0/1661588169 >> 172.21.15.42:0/1661588169 conn(0x7fd0780d1210 msgr2=0x7fd07815b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:20.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.447+0000 7fd07ce00640 1 -- 172.21.15.42:0/1661588169 shutdown_connections 2024-09-17T01:47:20.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.447+0000 7fd07ce00640 1 -- 172.21.15.42:0/1661588169 wait complete. 2024-09-17T01:47:20.467 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:47:20.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.699+0000 7fce40a00640 1 -- 172.21.15.42:0/3182780869 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce20004040 msgr2=0x7fce20004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:20.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.699+0000 7fce40a00640 1 --2- 172.21.15.42:0/3182780869 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce20004040 0x7fce20004800 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7fce3c0cf8f0 tx=0x7fce20005830 comp rx=0 tx=0).stop 2024-09-17T01:47:20.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.699+0000 7fce3a800640 1 -- 172.21.15.42:0/3182780869 reap_dead start 2024-09-17T01:47:20.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.699+0000 7fce40a00640 1 -- 172.21.15.42:0/3182780869 shutdown_connections 2024-09-17T01:47:20.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.699+0000 7fce40a00640 1 -- 172.21.15.42:0/3182780869 >> 172.21.15.42:0/3182780869 conn(0x7fce3c0b2930 msgr2=0x7fce3c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:20.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.699+0000 7fce40a00640 1 -- 172.21.15.42:0/3182780869 shutdown_connections 2024-09-17T01:47:20.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.699+0000 7fce40a00640 1 -- 172.21.15.42:0/3182780869 wait complete. 2024-09-17T01:47:20.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.702+0000 7fce40a00640 1 Processor -- start 2024-09-17T01:47:20.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.702+0000 7fce40a00640 1 -- start start 2024-09-17T01:47:20.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.703+0000 7fce40a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce20004040 0x7fce3c13e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:20.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.703+0000 7fce40a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce3c1f70f0 0x7fce3c15e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:20.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.703+0000 7fce40a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce3c1f7500 0x7fce3c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:20.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.703+0000 7fce40a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c06dbd0 con 0x7fce3c1f70f0 2024-09-17T01:47:20.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.703+0000 7fce40a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c06da50 con 0x7fce3c1f7500 2024-09-17T01:47:20.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.703+0000 7fce40a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fce3c073450 con 0x7fce20004040 2024-09-17T01:47:20.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.703+0000 7fce33e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce3c1f70f0 0x7fce3c15e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:20.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.704+0000 7fce33e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce3c1f70f0 0x7fce3c15e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55692/0 (socket says 172.21.15.42:55692) 2024-09-17T01:47:20.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.704+0000 7fce33e00640 1 -- 172.21.15.42:0/3142414785 learned_addr learned my addr 172.21.15.42:0/3142414785 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:20.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.704+0000 7fce33e00640 1 -- 172.21.15.42:0/3142414785 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce20004040 msgr2=0x7fce3c13e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:20.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.704+0000 7fce39e00640 1 --2- 172.21.15.42:0/3142414785 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce20004040 0x7fce3c13e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:20.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.704+0000 7fce3a800640 1 --2- 172.21.15.42:0/3142414785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce3c1f7500 0x7fce3c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:20.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.704+0000 7fce33e00640 1 --2- 172.21.15.42:0/3142414785 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce20004040 0x7fce3c13e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:20.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.704+0000 7fce33e00640 1 -- 172.21.15.42:0/3142414785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce3c1f7500 msgr2=0x7fce3c15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:20.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.704+0000 7fce33e00640 1 --2- 172.21.15.42:0/3142414785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce3c1f7500 0x7fce3c15e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:20.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.704+0000 7fce33e00640 1 -- 172.21.15.42:0/3142414785 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3c1520e0 con 0x7fce3c1f70f0 2024-09-17T01:47:20.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.704+0000 7fce39e00640 1 --2- 172.21.15.42:0/3142414785 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce20004040 0x7fce3c13e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:47:20.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.704+0000 7fce33e00640 1 --2- 172.21.15.42:0/3142414785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce3c1f70f0 0x7fce3c15e010 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7fce24000c00 tx=0x7fce24033650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:20.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.705+0000 7fce32000640 1 -- 172.21.15.42:0/3142414785 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce24038040 con 0x7fce3c1f70f0 2024-09-17T01:47:20.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.705+0000 7fce32000640 1 -- 172.21.15.42:0/3142414785 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce24041070 con 0x7fce3c1f70f0 2024-09-17T01:47:20.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.705+0000 7fce32000640 1 -- 172.21.15.42:0/3142414785 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce24033d70 con 0x7fce3c1f70f0 2024-09-17T01:47:20.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.705+0000 7fce40a00640 1 -- 172.21.15.42:0/3142414785 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce3c13e9f0 con 0x7fce3c1f70f0 2024-09-17T01:47:20.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.705+0000 7fce40a00640 1 -- 172.21.15.42:0/3142414785 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce3c1f7f40 con 0x7fce3c1f70f0 2024-09-17T01:47:20.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.706+0000 7fce40a00640 1 -- 172.21.15.42:0/3142414785 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce3c050f60 con 0x7fce3c1f70f0 2024-09-17T01:47:20.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.707+0000 7fce32000640 1 -- 172.21.15.42:0/3142414785 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fce2402b830 con 0x7fce3c1f70f0 2024-09-17T01:47:20.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.708+0000 7fce32000640 1 --2- 172.21.15.42:0/3142414785 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fce18078b90 0x7fce1807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:20.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.708+0000 7fce32000640 1 -- 172.21.15.42:0/3142414785 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5767+0+0 (secure 0 0 0) 0x7fce240bb770 con 0x7fce3c1f70f0 2024-09-17T01:47:20.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.708+0000 7fce39e00640 1 --2- 172.21.15.42:0/3142414785 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fce18078b90 0x7fce1807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:20.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.709+0000 7fce39e00640 1 --2- 172.21.15.42:0/3142414785 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fce18078b90 0x7fce1807b0a0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fce2c009b10 tx=0x7fce2c005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:20.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.712+0000 7fce32000640 1 -- 172.21.15.42:0/3142414785 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fce3c050f60 con 0x7fce3c1f70f0 2024-09-17T01:47:20.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.942+0000 7fce40a00640 1 -- 172.21.15.42:0/3142414785 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce3c06a3f0 con 0x7fce3c1f70f0 2024-09-17T01:47:20.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.943+0000 7fce32000640 1 -- 172.21.15.42:0/3142414785 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 150 v150) ==== 95+0+5240 (secure 0 0 0) 0x7fce3c06a3f0 con 0x7fce3c1f70f0 2024-09-17T01:47:20.941 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:20.941 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":150,"btime":"2024-09-17T01:46:34:429037+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8549,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4165093647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4165093647},{"type":"v1","addr":"172.21.15.43:6836","nonce":4165093647}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145},{"gid":10353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/4260984866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":4260984866},{"type":"v1","addr":"172.21.15.42:6834","nonce":4260984866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":10356,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2804168804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":2804168804},{"type":"v1","addr":"172.21.15.42:6835","nonce":2804168804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145}],"filesystems":[{"mdsmap":{"epoch":150,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:46:30.922674+0000","modified":"2024-09-17T01:46:33.938360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10371},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10371":{"gid":10371,"name":"b","rank":0,"incarnation":146,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/1477091047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1477091047},{"type":"v1","addr":"172.21.15.43:6837","nonce":1477091047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10371,"qdb_cluster":[10371]},"id":13}]} 2024-09-17T01:47:20.941 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 150 2024-09-17T01:47:20.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.945+0000 7fce40a00640 1 -- 172.21.15.42:0/3142414785 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fce18078b90 msgr2=0x7fce1807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:20.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.945+0000 7fce40a00640 1 --2- 172.21.15.42:0/3142414785 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fce18078b90 0x7fce1807b0a0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fce2c009b10 tx=0x7fce2c005f90 comp rx=0 tx=0).stop 2024-09-17T01:47:20.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.945+0000 7fce40a00640 1 -- 172.21.15.42:0/3142414785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce3c1f70f0 msgr2=0x7fce3c15e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:20.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.945+0000 7fce40a00640 1 --2- 172.21.15.42:0/3142414785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce3c1f70f0 0x7fce3c15e010 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7fce24000c00 tx=0x7fce24033650 comp rx=0 tx=0).stop 2024-09-17T01:47:20.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.945+0000 7fce40a00640 1 -- 172.21.15.42:0/3142414785 shutdown_connections 2024-09-17T01:47:20.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.945+0000 7fce40a00640 1 --2- 172.21.15.42:0/3142414785 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fce18078b90 0x7fce1807b0a0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:20.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.945+0000 7fce40a00640 1 --2- 172.21.15.42:0/3142414785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce3c1f7500 0x7fce3c15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:20.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.945+0000 7fce40a00640 1 --2- 172.21.15.42:0/3142414785 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fce3c1f70f0 0x7fce3c15e010 unknown :-1 s=CLOSED pgs=2214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:20.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.945+0000 7fce40a00640 1 --2- 172.21.15.42:0/3142414785 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fce20004040 0x7fce3c13e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:20.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.945+0000 7fce40a00640 1 -- 172.21.15.42:0/3142414785 >> 172.21.15.42:0/3142414785 conn(0x7fce3c0b2930 msgr2=0x7fce3c0cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:20.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.945+0000 7fce40a00640 1 -- 172.21.15.42:0/3142414785 shutdown_connections 2024-09-17T01:47:20.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:20.945+0000 7fce40a00640 1 -- 172.21.15.42:0/3142414785 wait complete. 2024-09-17T01:47:20.970 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:47:21.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.199+0000 7fb51f200640 1 -- 172.21.15.42:0/1736352351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb52015b680 msgr2=0x7fb52015fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:21.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.199+0000 7fb51f200640 1 --2- 172.21.15.42:0/1736352351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb52015b680 0x7fb52015fcc0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fb510009830 tx=0x7fb51002a5c0 comp rx=0 tx=0).stop 2024-09-17T01:47:21.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.199+0000 7fb51f200640 1 -- 172.21.15.42:0/1736352351 shutdown_connections 2024-09-17T01:47:21.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.199+0000 7fb51f200640 1 --2- 172.21.15.42:0/1736352351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb52015b680 0x7fb52015fcc0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:21.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.199+0000 7fb51f200640 1 -- 172.21.15.42:0/1736352351 >> 172.21.15.42:0/1736352351 conn(0x7fb5200b25f0 msgr2=0x7fb5200d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:21.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.199+0000 7fb51f200640 1 -- 172.21.15.42:0/1736352351 shutdown_connections 2024-09-17T01:47:21.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.199+0000 7fb51f200640 1 -- 172.21.15.42:0/1736352351 wait complete. 2024-09-17T01:47:21.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.201+0000 7fb51f200640 1 Processor -- start 2024-09-17T01:47:21.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.201+0000 7fb51f200640 1 -- start start 2024-09-17T01:47:21.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.203+0000 7fb51f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5200cafe0 0x7fb520155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:21.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.203+0000 7fb51f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb52015b680 0x7fb5200ca870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:21.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.203+0000 7fb51f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5200ce600 0x7fb5200cea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:21.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.203+0000 7fb51f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb52006f640 con 0x7fb52015b680 2024-09-17T01:47:21.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.203+0000 7fb51f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb52006f4c0 con 0x7fb5200cafe0 2024-09-17T01:47:21.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.203+0000 7fb51f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb52006f7c0 con 0x7fb5200ce600 2024-09-17T01:47:21.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.203+0000 7fb517e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb52015b680 0x7fb5200ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:21.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.203+0000 7fb517e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb52015b680 0x7fb5200ca870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55696/0 (socket says 172.21.15.42:55696) 2024-09-17T01:47:21.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.203+0000 7fb517e00640 1 -- 172.21.15.42:0/482940351 learned_addr learned my addr 172.21.15.42:0/482940351 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:21.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.203+0000 7fb51de00640 1 --2- 172.21.15.42:0/482940351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5200cafe0 0x7fb520155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:21.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.203+0000 7fb51e800640 1 --2- 172.21.15.42:0/482940351 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5200ce600 0x7fb5200cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:21.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.204+0000 7fb517e00640 1 -- 172.21.15.42:0/482940351 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5200ce600 msgr2=0x7fb5200cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:21.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.204+0000 7fb517e00640 1 --2- 172.21.15.42:0/482940351 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5200ce600 0x7fb5200cea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:21.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.204+0000 7fb517e00640 1 -- 172.21.15.42:0/482940351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5200cafe0 msgr2=0x7fb520155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:21.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.204+0000 7fb517e00640 1 --2- 172.21.15.42:0/482940351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5200cafe0 0x7fb520155160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:21.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.204+0000 7fb517e00640 1 -- 172.21.15.42:0/482940351 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5200cadb0 con 0x7fb52015b680 2024-09-17T01:47:21.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.204+0000 7fb51e800640 1 --2- 172.21.15.42:0/482940351 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5200ce600 0x7fb5200cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:47:21.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.204+0000 7fb517e00640 1 --2- 172.21.15.42:0/482940351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb52015b680 0x7fb5200ca870 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7fb508001220 tx=0x7fb50800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:21.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.204+0000 7fb516000640 1 -- 172.21.15.42:0/482940351 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508011790 con 0x7fb52015b680 2024-09-17T01:47:21.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.204+0000 7fb516000640 1 -- 172.21.15.42:0/482940351 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb508017070 con 0x7fb52015b680 2024-09-17T01:47:21.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.204+0000 7fb51f200640 1 -- 172.21.15.42:0/482940351 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5200cef50 con 0x7fb52015b680 2024-09-17T01:47:21.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.204+0000 7fb516000640 1 -- 172.21.15.42:0/482940351 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508011cc0 con 0x7fb52015b680 2024-09-17T01:47:21.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.204+0000 7fb51f200640 1 -- 172.21.15.42:0/482940351 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb520155e20 con 0x7fb52015b680 2024-09-17T01:47:21.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.205+0000 7fb51f200640 1 -- 172.21.15.42:0/482940351 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5201558b0 con 0x7fb52015b680 2024-09-17T01:47:21.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.207+0000 7fb516000640 1 -- 172.21.15.42:0/482940351 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb50801c460 con 0x7fb52015b680 2024-09-17T01:47:21.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.208+0000 7fb516000640 1 --2- 172.21.15.42:0/482940351 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb4fc078b90 0x7fb4fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:21.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.208+0000 7fb516000640 1 -- 172.21.15.42:0/482940351 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5767+0+0 (secure 0 0 0) 0x7fb50809ab70 con 0x7fb52015b680 2024-09-17T01:47:21.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.208+0000 7fb51de00640 1 --2- 172.21.15.42:0/482940351 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb4fc078b90 0x7fb4fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:21.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.209+0000 7fb51de00640 1 --2- 172.21.15.42:0/482940351 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb4fc078b90 0x7fb4fc07b0a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fb510034000 tx=0x7fb510004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:21.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.212+0000 7fb516000640 1 -- 172.21.15.42:0/482940351 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb508062f60 con 0x7fb52015b680 2024-09-17T01:47:21.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.408+0000 7fb51f200640 1 -- 172.21.15.42:0/482940351 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb520154c40 con 0x7fb52015b680 2024-09-17T01:47:21.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.410+0000 7fb516000640 1 -- 172.21.15.42:0/482940351 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) ==== 74+0+16781 (secure 0 0 0) 0x7fb508062860 con 0x7fb52015b680 2024-09-17T01:47:21.408 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:21.408 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":189,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:46:52.494208+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:46:28.879952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-17T01:46:29.890485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"27.1c","mappings":[{"from":7,"to":6}]},{"pgid":"27.3b","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:47:21.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.412+0000 7fb51f200640 1 -- 172.21.15.42:0/482940351 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb4fc078b90 msgr2=0x7fb4fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:21.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.412+0000 7fb51f200640 1 --2- 172.21.15.42:0/482940351 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb4fc078b90 0x7fb4fc07b0a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fb510034000 tx=0x7fb510004730 comp rx=0 tx=0).stop 2024-09-17T01:47:21.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.412+0000 7fb51f200640 1 -- 172.21.15.42:0/482940351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb52015b680 msgr2=0x7fb5200ca870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:21.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.412+0000 7fb51f200640 1 --2- 172.21.15.42:0/482940351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb52015b680 0x7fb5200ca870 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7fb508001220 tx=0x7fb50800c890 comp rx=0 tx=0).stop 2024-09-17T01:47:21.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.412+0000 7fb51f200640 1 -- 172.21.15.42:0/482940351 shutdown_connections 2024-09-17T01:47:21.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.412+0000 7fb51f200640 1 --2- 172.21.15.42:0/482940351 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb4fc078b90 0x7fb4fc07b0a0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:21.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.412+0000 7fb51f200640 1 --2- 172.21.15.42:0/482940351 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb5200ce600 0x7fb5200cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:21.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.412+0000 7fb51f200640 1 --2- 172.21.15.42:0/482940351 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb52015b680 0x7fb5200ca870 unknown :-1 s=CLOSED pgs=2216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:21.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.412+0000 7fb51f200640 1 --2- 172.21.15.42:0/482940351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb5200cafe0 0x7fb520155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:21.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.412+0000 7fb51f200640 1 -- 172.21.15.42:0/482940351 >> 172.21.15.42:0/482940351 conn(0x7fb5200b25f0 msgr2=0x7fb520157c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:21.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.412+0000 7fb51f200640 1 -- 172.21.15.42:0/482940351 shutdown_connections 2024-09-17T01:47:21.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.412+0000 7fb51f200640 1 -- 172.21.15.42:0/482940351 wait complete. 2024-09-17T01:47:21.433 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T01:47:21.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.667+0000 7fa0e3000640 1 -- 172.21.15.42:0/681549257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0dc06f2a0 msgr2=0x7fa0dc06d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:21.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.667+0000 7fa0e3000640 1 --2- 172.21.15.42:0/681549257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0dc06f2a0 0x7fa0dc06d610 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc071370 tx=0x7fa0c402a4d0 comp rx=0 tx=0).stop 2024-09-17T01:47:21.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.667+0000 7fa0e3000640 1 -- 172.21.15.42:0/681549257 shutdown_connections 2024-09-17T01:47:21.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.667+0000 7fa0e3000640 1 --2- 172.21.15.42:0/681549257 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0dc06db50 0x7fa0dc073df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:21.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.667+0000 7fa0e3000640 1 --2- 172.21.15.42:0/681549257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0dc06f2a0 0x7fa0dc06d610 unknown :-1 s=CLOSED pgs=2217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:21.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.667+0000 7fa0e3000640 1 --2- 172.21.15.42:0/681549257 >> v2:172.21.15.43:3300/0 conn(0x7fa0dc06ee90 0x7fa0dc15f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:21.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.667+0000 7fa0e3000640 1 -- 172.21.15.42:0/681549257 >> 172.21.15.42:0/681549257 conn(0x7fa0dc0b2930 msgr2=0x7fa0dc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:21.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.667+0000 7fa0e3000640 1 -- 172.21.15.42:0/681549257 shutdown_connections 2024-09-17T01:47:21.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.667+0000 7fa0e3000640 1 -- 172.21.15.42:0/681549257 wait complete. 2024-09-17T01:47:21.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.670+0000 7fa0e3000640 1 Processor -- start 2024-09-17T01:47:21.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.670+0000 7fa0e3000640 1 -- start start 2024-09-17T01:47:21.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.671+0000 7fa0e3000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0dc06db50 0x7fa0dc1f9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:21.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.671+0000 7fa0e3000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0dc06ee90 0x7fa0dc14e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:21.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.671+0000 7fa0e3000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0dc06f2a0 0x7fa0dc152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:21.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.671+0000 7fa0e3000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa0dc0746c0 con 0x7fa0dc06ee90 2024-09-17T01:47:21.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.671+0000 7fa0e3000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa0dc074540 con 0x7fa0dc06db50 2024-09-17T01:47:21.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.671+0000 7fa0e3000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa0dc0cef40 con 0x7fa0dc06f2a0 2024-09-17T01:47:21.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.671+0000 7fa0d3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0dc06ee90 0x7fa0dc14e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:21.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.671+0000 7fa0d3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0dc06ee90 0x7fa0dc14e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55708/0 (socket says 172.21.15.42:55708) 2024-09-17T01:47:21.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.671+0000 7fa0d3400640 1 -- 172.21.15.42:0/3468729761 learned_addr learned my addr 172.21.15.42:0/3468729761 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:21.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.672+0000 7fa0dbe00640 1 --2- 172.21.15.42:0/3468729761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0dc06db50 0x7fa0dc1f9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:21.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.672+0000 7fa0e1000640 1 --2- 172.21.15.42:0/3468729761 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0dc06f2a0 0x7fa0dc152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:21.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.672+0000 7fa0d3400640 1 -- 172.21.15.42:0/3468729761 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0dc06f2a0 msgr2=0x7fa0dc152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:21.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.672+0000 7fa0d3400640 1 --2- 172.21.15.42:0/3468729761 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0dc06f2a0 0x7fa0dc152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:21.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.672+0000 7fa0d3400640 1 -- 172.21.15.42:0/3468729761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0dc06db50 msgr2=0x7fa0dc1f9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:21.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.672+0000 7fa0d3400640 1 --2- 172.21.15.42:0/3468729761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0dc06db50 0x7fa0dc1f9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:21.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.672+0000 7fa0d3400640 1 -- 172.21.15.42:0/3468729761 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0dc1f9cb0 con 0x7fa0dc06ee90 2024-09-17T01:47:21.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.672+0000 7fa0d3400640 1 --2- 172.21.15.42:0/3468729761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0dc06ee90 0x7fa0dc14e290 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40099c0 tx=0x7fa0c40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:21.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.672+0000 7fa0d8c00640 1 -- 172.21.15.42:0/3468729761 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c403e030 con 0x7fa0dc06ee90 2024-09-17T01:47:21.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.673+0000 7fa0d8c00640 1 -- 172.21.15.42:0/3468729761 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0c4003ca0 con 0x7fa0dc06ee90 2024-09-17T01:47:21.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.673+0000 7fa0d8c00640 1 -- 172.21.15.42:0/3468729761 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4035040 con 0x7fa0dc06ee90 2024-09-17T01:47:21.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.673+0000 7fa0e3000640 1 -- 172.21.15.42:0/3468729761 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0dc0740a0 con 0x7fa0dc06ee90 2024-09-17T01:47:21.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.673+0000 7fa0e3000640 1 -- 172.21.15.42:0/3468729761 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0dc15d950 con 0x7fa0dc06ee90 2024-09-17T01:47:21.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.674+0000 7fa0e3000640 1 -- 172.21.15.42:0/3468729761 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0dc15f200 con 0x7fa0dc06ee90 2024-09-17T01:47:21.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.675+0000 7fa0d8c00640 1 -- 172.21.15.42:0/3468729761 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa0c4041030 con 0x7fa0dc06ee90 2024-09-17T01:47:21.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.677+0000 7fa0d8c00640 1 --2- 172.21.15.42:0/3468729761 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa0b8078bc0 0x7fa0b807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:21.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.677+0000 7fa0d8c00640 1 -- 172.21.15.42:0/3468729761 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5767+0+0 (secure 0 0 0) 0x7fa0c40bb480 con 0x7fa0dc06ee90 2024-09-17T01:47:21.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.677+0000 7fa0dbe00640 1 --2- 172.21.15.42:0/3468729761 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa0b8078bc0 0x7fa0b807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:21.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.678+0000 7fa0dbe00640 1 --2- 172.21.15.42:0/3468729761 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa0b8078bc0 0x7fa0b807b0d0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc009ac0 tx=0x7fa0cc005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:21.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.681+0000 7fa0d8c00640 1 -- 172.21.15.42:0/3468729761 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa0dc1f9cb0 con 0x7fa0dc06ee90 2024-09-17T01:47:21.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.917+0000 7fa0e3000640 1 -- 172.21.15.42:0/3468729761 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa0dc15d400 con 0x7fa0dc06ee90 2024-09-17T01:47:21.915 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-17T01:47:21.917+0000 7f9961e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:47:21.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.919+0000 7fa0d8c00640 1 -- 172.21.15.42:0/3468729761 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v151) ==== 161+0+0 (secure 0 0 0) 0x7fa0c4083870 con 0x7fa0dc06ee90 2024-09-17T01:47:21.918 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T01:47:21.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.923+0000 7fa0e3000640 1 -- 172.21.15.42:0/3468729761 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa0b8078bc0 msgr2=0x7fa0b807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:21.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.923+0000 7fa0e3000640 1 --2- 172.21.15.42:0/3468729761 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa0b8078bc0 0x7fa0b807b0d0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc009ac0 tx=0x7fa0cc005f90 comp rx=0 tx=0).stop 2024-09-17T01:47:21.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.923+0000 7fa0e3000640 1 -- 172.21.15.42:0/3468729761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0dc06ee90 msgr2=0x7fa0dc14e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:21.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.923+0000 7fa0e3000640 1 --2- 172.21.15.42:0/3468729761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0dc06ee90 0x7fa0dc14e290 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40099c0 tx=0x7fa0c40038a0 comp rx=0 tx=0).stop 2024-09-17T01:47:21.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.923+0000 7fa0e3000640 1 -- 172.21.15.42:0/3468729761 shutdown_connections 2024-09-17T01:47:21.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.923+0000 7fa0e3000640 1 --2- 172.21.15.42:0/3468729761 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa0b8078bc0 0x7fa0b807b0d0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:21.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.923+0000 7fa0e3000640 1 --2- 172.21.15.42:0/3468729761 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0dc06f2a0 0x7fa0dc152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:21.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.923+0000 7fa0e3000640 1 --2- 172.21.15.42:0/3468729761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0dc06ee90 0x7fa0dc14e290 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:21.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.923+0000 7fa0e3000640 1 --2- 172.21.15.42:0/3468729761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0dc06db50 0x7fa0dc1f9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:21.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.923+0000 7fa0e3000640 1 -- 172.21.15.42:0/3468729761 >> 172.21.15.42:0/3468729761 conn(0x7fa0dc0b2930 msgr2=0x7fa0dc0b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:21.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.923+0000 7fa0e3000640 1 -- 172.21.15.42:0/3468729761 shutdown_connections 2024-09-17T01:47:21.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:21.923+0000 7fa0e3000640 1 -- 172.21.15.42:0/3468729761 wait complete. 2024-09-17T01:47:21.930 INFO:tasks.ceph.mds.b.smithi043.stderr: -3962> 2024-09-17T01:46:33.392+0000 7f9e7cc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:47:21.945 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T01:47:22.042 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:47:22.046 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:47:22.058 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-09-17T01:47:22.174 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.176+0000 7f883ac00640 1 -- 172.21.15.42:0/2193890606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8834142f40 msgr2=0x7f8834072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:22.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.176+0000 7f883ac00640 1 --2- 172.21.15.42:0/2193890606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8834142f40 0x7f8834072950 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f8834071ef0 tx=0x7f882002a560 comp rx=0 tx=0).stop 2024-09-17T01:47:22.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.176+0000 7f883ac00640 1 -- 172.21.15.42:0/2193890606 shutdown_connections 2024-09-17T01:47:22.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.176+0000 7f883ac00640 1 --2- 172.21.15.42:0/2193890606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8834142f40 0x7f8834072950 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:22.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.176+0000 7f883ac00640 1 --2- 172.21.15.42:0/2193890606 >> v2:172.21.15.43:3300/0 conn(0x7f88340b3550 0x7f883415cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:22.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.176+0000 7f883ac00640 1 -- 172.21.15.42:0/2193890606 >> 172.21.15.42:0/2193890606 conn(0x7f88340b2930 msgr2=0x7f883406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:22.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.176+0000 7f883ac00640 1 -- 172.21.15.42:0/2193890606 shutdown_connections 2024-09-17T01:47:22.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.176+0000 7f883ac00640 1 -- 172.21.15.42:0/2193890606 wait complete. 2024-09-17T01:47:22.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.178+0000 7f883ac00640 1 Processor -- start 2024-09-17T01:47:22.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.178+0000 7f883ac00640 1 -- start start 2024-09-17T01:47:22.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.180+0000 7f883ac00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8834072e90 0x7f883413e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:22.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.180+0000 7f883ac00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88340b3550 0x7f88341e62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:22.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.180+0000 7f883ac00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8834142f40 0x7f88341e6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:22.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.180+0000 7f883ac00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f883406d5b0 con 0x7f8834142f40 2024-09-17T01:47:22.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.180+0000 7f883ac00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f883406d430 con 0x7f88340b3550 2024-09-17T01:47:22.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.180+0000 7f883ac00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f883406d730 con 0x7f8834072e90 2024-09-17T01:47:22.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.180+0000 7f8838c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8834142f40 0x7f88341e6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:22.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.180+0000 7f8833400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88340b3550 0x7f88341e62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:22.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.180+0000 7f8833e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8834072e90 0x7f883413e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:22.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.180+0000 7f8833400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88340b3550 0x7f88341e62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:41264/0 (socket says 172.21.15.42:41264) 2024-09-17T01:47:22.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.180+0000 7f8838c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8834142f40 0x7f88341e6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55734/0 (socket says 172.21.15.42:55734) 2024-09-17T01:47:22.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.180+0000 7f8838c00640 1 -- 172.21.15.42:0/2743615082 learned_addr learned my addr 172.21.15.42:0/2743615082 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:22.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.180+0000 7f8838c00640 1 -- 172.21.15.42:0/2743615082 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8834072e90 msgr2=0x7f883413e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:22.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.180+0000 7f8838c00640 1 --2- 172.21.15.42:0/2743615082 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8834072e90 0x7f883413e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:22.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.180+0000 7f8838c00640 1 -- 172.21.15.42:0/2743615082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88340b3550 msgr2=0x7f88341e62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:22.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.180+0000 7f8838c00640 1 --2- 172.21.15.42:0/2743615082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88340b3550 0x7f88341e62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:22.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.180+0000 7f8838c00640 1 -- 172.21.15.42:0/2743615082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f883413f150 con 0x7f8834142f40 2024-09-17T01:47:22.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.181+0000 7f8838c00640 1 --2- 172.21.15.42:0/2743615082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8834142f40 0x7f88341e6830 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7f882c00c730 tx=0x7f882c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:22.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.181+0000 7f882be00640 1 -- 172.21.15.42:0/2743615082 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c003b70 con 0x7f8834142f40 2024-09-17T01:47:22.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.181+0000 7f882be00640 1 -- 172.21.15.42:0/2743615082 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f882c003d10 con 0x7f8834142f40 2024-09-17T01:47:22.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.181+0000 7f882be00640 1 -- 172.21.15.42:0/2743615082 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c00aab0 con 0x7f8834142f40 2024-09-17T01:47:22.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.181+0000 7f883ac00640 1 -- 172.21.15.42:0/2743615082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8834140020 con 0x7f8834142f40 2024-09-17T01:47:22.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.181+0000 7f883ac00640 1 -- 172.21.15.42:0/2743615082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88341405e0 con 0x7f8834142f40 2024-09-17T01:47:22.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.182+0000 7f883ac00640 1 -- 172.21.15.42:0/2743615082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f883406dbe0 con 0x7f8834142f40 2024-09-17T01:47:22.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.184+0000 7f882be00640 1 -- 172.21.15.42:0/2743615082 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f882c00ac50 con 0x7f8834142f40 2024-09-17T01:47:22.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.185+0000 7f882be00640 1 --2- 172.21.15.42:0/2743615082 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8814078b90 0x7f881407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:22.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.185+0000 7f882be00640 1 -- 172.21.15.42:0/2743615082 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 5853+0+0 (secure 0 0 0) 0x7f882c09aa60 con 0x7f8834142f40 2024-09-17T01:47:22.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.185+0000 7f8833e00640 1 --2- 172.21.15.42:0/2743615082 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8814078b90 0x7f881407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:22.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.186+0000 7f8833e00640 1 --2- 172.21.15.42:0/2743615082 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8814078b90 0x7f881407b0a0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f8824009b30 tx=0x7f8824005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:22.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.189+0000 7f882be00640 1 -- 172.21.15.42:0/2743615082 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f882c0627b0 con 0x7f8834142f40 2024-09-17T01:47:22.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.422+0000 7f883ac00640 1 -- 172.21.15.42:0/2743615082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f883406a170 con 0x7f8834142f40 2024-09-17T01:47:22.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.921+0000 7f882be00640 1 -- 172.21.15.42:0/2743615082 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v152) ==== 104+0+0 (secure 0 0 0) 0x7f882c0671e0 con 0x7f8834142f40 2024-09-17T01:47:22.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.924+0000 7f883ac00640 1 -- 172.21.15.42:0/2743615082 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8814078b90 msgr2=0x7f881407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:22.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.924+0000 7f883ac00640 1 --2- 172.21.15.42:0/2743615082 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8814078b90 0x7f881407b0a0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f8824009b30 tx=0x7f8824005f90 comp rx=0 tx=0).stop 2024-09-17T01:47:22.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.924+0000 7f883ac00640 1 -- 172.21.15.42:0/2743615082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8834142f40 msgr2=0x7f88341e6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:22.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.924+0000 7f883ac00640 1 --2- 172.21.15.42:0/2743615082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8834142f40 0x7f88341e6830 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7f882c00c730 tx=0x7f882c00cbf0 comp rx=0 tx=0).stop 2024-09-17T01:47:22.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.924+0000 7f883ac00640 1 -- 172.21.15.42:0/2743615082 shutdown_connections 2024-09-17T01:47:22.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.924+0000 7f883ac00640 1 --2- 172.21.15.42:0/2743615082 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8814078b90 0x7f881407b0a0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:22.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.924+0000 7f883ac00640 1 --2- 172.21.15.42:0/2743615082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88340b3550 0x7f88341e62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:22.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.924+0000 7f883ac00640 1 --2- 172.21.15.42:0/2743615082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8834142f40 0x7f88341e6830 unknown :-1 s=CLOSED pgs=2221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:22.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.924+0000 7f883ac00640 1 --2- 172.21.15.42:0/2743615082 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8834072e90 0x7f883413e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:22.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.924+0000 7f883ac00640 1 -- 172.21.15.42:0/2743615082 >> 172.21.15.42:0/2743615082 conn(0x7f88340b2930 msgr2=0x7f8834073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:22.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.924+0000 7f883ac00640 1 -- 172.21.15.42:0/2743615082 shutdown_connections 2024-09-17T01:47:22.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:22.924+0000 7f883ac00640 1 -- 172.21.15.42:0/2743615082 wait complete. 2024-09-17T01:47:22.948 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T01:47:23.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.182+0000 7f9557e00640 1 -- 172.21.15.42:0/3988435201 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95580af4f0 msgr2=0x7f955815d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:23.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.182+0000 7f9557e00640 1 --2- 172.21.15.42:0/3988435201 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95580af4f0 0x7f955815d6a0 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f95580719b0 tx=0x7f954802a530 comp rx=0 tx=0).stop 2024-09-17T01:47:23.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.182+0000 7f9557e00640 1 -- 172.21.15.42:0/3988435201 shutdown_connections 2024-09-17T01:47:23.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.182+0000 7f9557e00640 1 --2- 172.21.15.42:0/3988435201 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f955806d430 0x7f95580b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:23.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.182+0000 7f9557e00640 1 --2- 172.21.15.42:0/3988435201 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95580af4f0 0x7f955815d6a0 unknown :-1 s=CLOSED pgs=2222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:23.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.182+0000 7f9557e00640 1 -- 172.21.15.42:0/3988435201 >> 172.21.15.42:0/3988435201 conn(0x7f95580b25d0 msgr2=0x7f95580d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:23.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.182+0000 7f9557e00640 1 -- 172.21.15.42:0/3988435201 shutdown_connections 2024-09-17T01:47:23.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.182+0000 7f9557e00640 1 -- 172.21.15.42:0/3988435201 wait complete. 2024-09-17T01:47:23.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.184+0000 7f9557e00640 1 Processor -- start 2024-09-17T01:47:23.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.184+0000 7f9557e00640 1 -- start start 2024-09-17T01:47:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.186+0000 7f9557e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95580aebf0 0x7f95581f2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.186+0000 7f9557e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f95580af4f0 0x7f95580c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.186+0000 7f9557e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9558154fa0 0x7f95581553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.186+0000 7f9557e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f95580b3970 con 0x7f95580aebf0 2024-09-17T01:47:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.186+0000 7f9557e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f95580b37f0 con 0x7f9558154fa0 2024-09-17T01:47:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.186+0000 7f9557e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f95580b3af0 con 0x7f95580af4f0 2024-09-17T01:47:23.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.186+0000 7f9556a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95580aebf0 0x7f95581f2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:23.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.186+0000 7f9556a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95580aebf0 0x7f95581f2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55752/0 (socket says 172.21.15.42:55752) 2024-09-17T01:47:23.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.186+0000 7f9556a00640 1 -- 172.21.15.42:0/1705013045 learned_addr learned my addr 172.21.15.42:0/1705013045 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:23.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.186+0000 7f954fe00640 1 --2- 172.21.15.42:0/1705013045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f95580af4f0 0x7f95580c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:23.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.186+0000 7f9557400640 1 --2- 172.21.15.42:0/1705013045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9558154fa0 0x7f95581553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:23.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.186+0000 7f9556a00640 1 -- 172.21.15.42:0/1705013045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f95580af4f0 msgr2=0x7f95580c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:23.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.186+0000 7f9556a00640 1 --2- 172.21.15.42:0/1705013045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f95580af4f0 0x7f95580c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:23.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.187+0000 7f9556a00640 1 -- 172.21.15.42:0/1705013045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9558154fa0 msgr2=0x7f95581553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:23.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.187+0000 7f9556a00640 1 --2- 172.21.15.42:0/1705013045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9558154fa0 0x7f95581553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:23.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.187+0000 7f9556a00640 1 -- 172.21.15.42:0/1705013045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95581558f0 con 0x7f95580aebf0 2024-09-17T01:47:23.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.187+0000 7f9556a00640 1 --2- 172.21.15.42:0/1705013045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95580aebf0 0x7f95581f2f70 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f9548034040 tx=0x7f95480039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:23.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.187+0000 7f954ea00640 1 -- 172.21.15.42:0/1705013045 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954803e030 con 0x7f95580aebf0 2024-09-17T01:47:23.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.187+0000 7f954ea00640 1 -- 172.21.15.42:0/1705013045 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95480047a0 con 0x7f95580aebf0 2024-09-17T01:47:23.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.187+0000 7f9557e00640 1 -- 172.21.15.42:0/1705013045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9558073120 con 0x7f95580aebf0 2024-09-17T01:47:23.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.187+0000 7f954ea00640 1 -- 172.21.15.42:0/1705013045 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9548035040 con 0x7f95580aebf0 2024-09-17T01:47:23.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.187+0000 7f9557e00640 1 -- 172.21.15.42:0/1705013045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95580736e0 con 0x7f95580aebf0 2024-09-17T01:47:23.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.188+0000 7f9557e00640 1 -- 172.21.15.42:0/1705013045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95580b30a0 con 0x7f95580aebf0 2024-09-17T01:47:23.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.190+0000 7f954ea00640 1 -- 172.21.15.42:0/1705013045 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9548041030 con 0x7f95580aebf0 2024-09-17T01:47:23.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.191+0000 7f954ea00640 1 --2- 172.21.15.42:0/1705013045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9534078b90 0x7f953407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:23.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.191+0000 7f954ea00640 1 -- 172.21.15.42:0/1705013045 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 5853+0+0 (secure 0 0 0) 0x7f95480bb6c0 con 0x7f95580aebf0 2024-09-17T01:47:23.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.192+0000 7f954fe00640 1 --2- 172.21.15.42:0/1705013045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9534078b90 0x7f953407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:23.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.192+0000 7f954fe00640 1 --2- 172.21.15.42:0/1705013045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9534078b90 0x7f953407b0a0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f9540006fd0 tx=0x7f9540008040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:23.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.196+0000 7f954ea00640 1 -- 172.21.15.42:0/1705013045 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f95581558f0 con 0x7f95580aebf0 2024-09-17T01:47:23.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.391+0000 7f9557e00640 1 -- 172.21.15.42:0/1705013045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f95580ae6d0 con 0x7f95580aebf0 2024-09-17T01:47:23.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.927+0000 7f954ea00640 1 -- 172.21.15.42:0/1705013045 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v191) ==== 181+0+0 (secure 0 0 0) 0x7f9548083a60 con 0x7f95580aebf0 2024-09-17T01:47:23.925 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-09-17T01:47:23.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.931+0000 7f9557e00640 1 -- 172.21.15.42:0/1705013045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9534078b90 msgr2=0x7f953407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:23.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.931+0000 7f9557e00640 1 --2- 172.21.15.42:0/1705013045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9534078b90 0x7f953407b0a0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f9540006fd0 tx=0x7f9540008040 comp rx=0 tx=0).stop 2024-09-17T01:47:23.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.931+0000 7f9557e00640 1 -- 172.21.15.42:0/1705013045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95580aebf0 msgr2=0x7f95581f2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:23.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.931+0000 7f9557e00640 1 --2- 172.21.15.42:0/1705013045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95580aebf0 0x7f95581f2f70 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f9548034040 tx=0x7f95480039e0 comp rx=0 tx=0).stop 2024-09-17T01:47:23.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.931+0000 7f9557e00640 1 -- 172.21.15.42:0/1705013045 shutdown_connections 2024-09-17T01:47:23.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.931+0000 7f9557e00640 1 --2- 172.21.15.42:0/1705013045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9534078b90 0x7f953407b0a0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:23.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.931+0000 7f9557e00640 1 --2- 172.21.15.42:0/1705013045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9558154fa0 0x7f95581553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:23.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.931+0000 7f9557e00640 1 --2- 172.21.15.42:0/1705013045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f95580af4f0 0x7f95580c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:23.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.931+0000 7f9557e00640 1 --2- 172.21.15.42:0/1705013045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95580aebf0 0x7f95581f2f70 unknown :-1 s=CLOSED pgs=2223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:23.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.931+0000 7f9557e00640 1 -- 172.21.15.42:0/1705013045 >> 172.21.15.42:0/1705013045 conn(0x7f95580b25d0 msgr2=0x7f95580b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:23.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.931+0000 7f9557e00640 1 -- 172.21.15.42:0/1705013045 shutdown_connections 2024-09-17T01:47:23.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:23.931+0000 7f9557e00640 1 -- 172.21.15.42:0/1705013045 wait complete. 2024-09-17T01:47:23.960 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T01:47:24.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.195+0000 7fb915e00640 1 -- 172.21.15.42:0/979647887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9100af4f0 msgr2=0x7fb91015d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:24.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.195+0000 7fb915e00640 1 --2- 172.21.15.42:0/979647887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9100af4f0 0x7fb91015d6a0 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7fb91006df00 tx=0x7fb90402a530 comp rx=0 tx=0).stop 2024-09-17T01:47:24.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.196+0000 7fb915e00640 1 -- 172.21.15.42:0/979647887 shutdown_connections 2024-09-17T01:47:24.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.196+0000 7fb915e00640 1 --2- 172.21.15.42:0/979647887 >> v2:172.21.15.43:3300/0 conn(0x7fb91006d430 0x7fb9100b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:24.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.196+0000 7fb915e00640 1 --2- 172.21.15.42:0/979647887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9100af4f0 0x7fb91015d6a0 unknown :-1 s=CLOSED pgs=2225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:24.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.196+0000 7fb915e00640 1 -- 172.21.15.42:0/979647887 >> 172.21.15.42:0/979647887 conn(0x7fb9100b25d0 msgr2=0x7fb9100d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:24.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.196+0000 7fb915e00640 1 -- 172.21.15.42:0/979647887 shutdown_connections 2024-09-17T01:47:24.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.196+0000 7fb915e00640 1 -- 172.21.15.42:0/979647887 wait complete. 2024-09-17T01:47:24.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.198+0000 7fb915e00640 1 Processor -- start 2024-09-17T01:47:24.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.198+0000 7fb915e00640 1 -- start start 2024-09-17T01:47:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.199+0000 7fb915e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9100aebf0 0x7fb91014b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.199+0000 7fb915e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb9100af4f0 0x7fb9100cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.199+0000 7fb915e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb910154710 0x7fb9100cf630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.199+0000 7fb915e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb9100b3970 con 0x7fb9100aebf0 2024-09-17T01:47:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.199+0000 7fb915e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb9100b37f0 con 0x7fb910154710 2024-09-17T01:47:24.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.200+0000 7fb915e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb9100b3af0 con 0x7fb9100af4f0 2024-09-17T01:47:24.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.200+0000 7fb914a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9100aebf0 0x7fb91014b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:24.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.200+0000 7fb914a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9100aebf0 0x7fb91014b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55762/0 (socket says 172.21.15.42:55762) 2024-09-17T01:47:24.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.200+0000 7fb914a00640 1 -- 172.21.15.42:0/2110246206 learned_addr learned my addr 172.21.15.42:0/2110246206 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:24.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.200+0000 7fb915400640 1 --2- 172.21.15.42:0/2110246206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb910154710 0x7fb9100cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:24.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.200+0000 7fb90fe00640 1 --2- 172.21.15.42:0/2110246206 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb9100af4f0 0x7fb9100cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:24.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.200+0000 7fb914a00640 1 -- 172.21.15.42:0/2110246206 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb9100af4f0 msgr2=0x7fb9100cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:24.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.200+0000 7fb914a00640 1 --2- 172.21.15.42:0/2110246206 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb9100af4f0 0x7fb9100cf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:24.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.200+0000 7fb914a00640 1 -- 172.21.15.42:0/2110246206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb910154710 msgr2=0x7fb9100cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:24.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.200+0000 7fb914a00640 1 --2- 172.21.15.42:0/2110246206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb910154710 0x7fb9100cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:24.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.200+0000 7fb914a00640 1 -- 172.21.15.42:0/2110246206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb910072610 con 0x7fb9100aebf0 2024-09-17T01:47:24.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.200+0000 7fb915400640 1 --2- 172.21.15.42:0/2110246206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb910154710 0x7fb9100cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:47:24.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.200+0000 7fb90fe00640 1 --2- 172.21.15.42:0/2110246206 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb9100af4f0 0x7fb9100cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:47:24.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.201+0000 7fb914a00640 1 --2- 172.21.15.42:0/2110246206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9100aebf0 0x7fb91014b710 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7fb90402ab20 tx=0x7fb904033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:24.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.201+0000 7fb90cc00640 1 -- 172.21.15.42:0/2110246206 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb904031d60 con 0x7fb9100aebf0 2024-09-17T01:47:24.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.201+0000 7fb90cc00640 1 -- 172.21.15.42:0/2110246206 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb904033e10 con 0x7fb9100aebf0 2024-09-17T01:47:24.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.201+0000 7fb915e00640 1 -- 172.21.15.42:0/2110246206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9100728f0 con 0x7fb9100aebf0 2024-09-17T01:47:24.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.201+0000 7fb90cc00640 1 -- 172.21.15.42:0/2110246206 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb904005260 con 0x7fb9100aebf0 2024-09-17T01:47:24.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.201+0000 7fb915e00640 1 -- 172.21.15.42:0/2110246206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb910072eb0 con 0x7fb9100aebf0 2024-09-17T01:47:24.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.202+0000 7fb915e00640 1 -- 172.21.15.42:0/2110246206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9100b30a0 con 0x7fb9100aebf0 2024-09-17T01:47:24.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.203+0000 7fb90cc00640 1 -- 172.21.15.42:0/2110246206 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb904005400 con 0x7fb9100aebf0 2024-09-17T01:47:24.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.204+0000 7fb90cc00640 1 --2- 172.21.15.42:0/2110246206 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb8f0078b90 0x7fb8f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:24.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.204+0000 7fb90cc00640 1 -- 172.21.15.42:0/2110246206 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5415+0+0 (secure 0 0 0) 0x7fb9040bbe70 con 0x7fb9100aebf0 2024-09-17T01:47:24.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.205+0000 7fb90fe00640 1 --2- 172.21.15.42:0/2110246206 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb8f0078b90 0x7fb8f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:24.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.205+0000 7fb90fe00640 1 --2- 172.21.15.42:0/2110246206 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb8f0078b90 0x7fb8f007b0a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc000f60 tx=0x7fb8fc009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:24.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.209+0000 7fb90cc00640 1 -- 172.21.15.42:0/2110246206 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb90403f030 con 0x7fb9100aebf0 2024-09-17T01:47:24.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.405+0000 7fb915e00640 1 -- 172.21.15.42:0/2110246206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb9100cebd0 con 0x7fb9100aebf0 2024-09-17T01:47:24.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.935+0000 7fb90cc00640 1 -- 172.21.15.42:0/2110246206 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v192) ==== 169+0+0 (secure 0 0 0) 0x7fb904005d00 con 0x7fb9100aebf0 2024-09-17T01:47:24.933 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-09-17T01:47:24.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.939+0000 7fb915e00640 1 -- 172.21.15.42:0/2110246206 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb8f0078b90 msgr2=0x7fb8f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:24.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.939+0000 7fb915e00640 1 --2- 172.21.15.42:0/2110246206 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb8f0078b90 0x7fb8f007b0a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc000f60 tx=0x7fb8fc009040 comp rx=0 tx=0).stop 2024-09-17T01:47:24.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.939+0000 7fb915e00640 1 -- 172.21.15.42:0/2110246206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9100aebf0 msgr2=0x7fb91014b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:24.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.939+0000 7fb915e00640 1 --2- 172.21.15.42:0/2110246206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9100aebf0 0x7fb91014b710 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7fb90402ab20 tx=0x7fb904033c20 comp rx=0 tx=0).stop 2024-09-17T01:47:24.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.939+0000 7fb915e00640 1 -- 172.21.15.42:0/2110246206 shutdown_connections 2024-09-17T01:47:24.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.939+0000 7fb915e00640 1 --2- 172.21.15.42:0/2110246206 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb8f0078b90 0x7fb8f007b0a0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:24.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.939+0000 7fb915e00640 1 --2- 172.21.15.42:0/2110246206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb910154710 0x7fb9100cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:24.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.939+0000 7fb915e00640 1 --2- 172.21.15.42:0/2110246206 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb9100af4f0 0x7fb9100cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:24.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.939+0000 7fb915e00640 1 --2- 172.21.15.42:0/2110246206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9100aebf0 0x7fb91014b710 secure :-1 s=CLOSED pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7fb90402ab20 tx=0x7fb904033c20 comp rx=0 tx=0).stop 2024-09-17T01:47:24.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.939+0000 7fb915e00640 1 -- 172.21.15.42:0/2110246206 >> 172.21.15.42:0/2110246206 conn(0x7fb9100b25d0 msgr2=0x7fb9100b04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:24.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.942+0000 7fb915e00640 1 -- 172.21.15.42:0/2110246206 shutdown_connections 2024-09-17T01:47:24.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:24.943+0000 7fb915e00640 1 -- 172.21.15.42:0/2110246206 wait complete. 2024-09-17T01:47:24.971 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T01:47:25.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.205+0000 7fdd24400640 1 -- 172.21.15.42:0/2967522724 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd1c142f40 msgr2=0x7fdd1c072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:25.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.205+0000 7fdd24400640 1 --2- 172.21.15.42:0/2967522724 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd1c142f40 0x7fdd1c072950 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7fdd08005fd0 tx=0x7fdd0802a5f0 comp rx=0 tx=0).stop 2024-09-17T01:47:25.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.205+0000 7fdd24400640 1 -- 172.21.15.42:0/2967522724 shutdown_connections 2024-09-17T01:47:25.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.205+0000 7fdd24400640 1 --2- 172.21.15.42:0/2967522724 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd1c142f40 0x7fdd1c072950 unknown :-1 s=CLOSED pgs=2228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:25.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.205+0000 7fdd24400640 1 -- 172.21.15.42:0/2967522724 >> 172.21.15.42:0/2967522724 conn(0x7fdd1c0b2930 msgr2=0x7fdd1c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:25.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.206+0000 7fdd24400640 1 -- 172.21.15.42:0/2967522724 shutdown_connections 2024-09-17T01:47:25.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.206+0000 7fdd24400640 1 -- 172.21.15.42:0/2967522724 wait complete. 2024-09-17T01:47:25.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.208+0000 7fdd24400640 1 Processor -- start 2024-09-17T01:47:25.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.208+0000 7fdd24400640 1 -- start start 2024-09-17T01:47:25.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.209+0000 7fdd24400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd1c072e90 0x7fdd1c1f3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:25.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.209+0000 7fdd24400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd1c0b3550 0x7fdd1c151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:25.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.209+0000 7fdd24400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd1c142f40 0x7fdd1c13c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:25.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.209+0000 7fdd24400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1c06d900 con 0x7fdd1c142f40 2024-09-17T01:47:25.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.209+0000 7fdd24400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1c06d780 con 0x7fdd1c072e90 2024-09-17T01:47:25.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.209+0000 7fdd24400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fdd1c06da80 con 0x7fdd1c0b3550 2024-09-17T01:47:25.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.210+0000 7fdd22400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd1c142f40 0x7fdd1c13c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:25.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.210+0000 7fdd22400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd1c142f40 0x7fdd1c13c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55766/0 (socket says 172.21.15.42:55766) 2024-09-17T01:47:25.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.210+0000 7fdd22400640 1 -- 172.21.15.42:0/4078968037 learned_addr learned my addr 172.21.15.42:0/4078968037 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:25.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.210+0000 7fdd21a00640 1 --2- 172.21.15.42:0/4078968037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd1c072e90 0x7fdd1c1f3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:25.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.210+0000 7fdd21000640 1 --2- 172.21.15.42:0/4078968037 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd1c0b3550 0x7fdd1c151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:25.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.210+0000 7fdd22400640 1 -- 172.21.15.42:0/4078968037 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd1c0b3550 msgr2=0x7fdd1c151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:25.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.210+0000 7fdd22400640 1 --2- 172.21.15.42:0/4078968037 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd1c0b3550 0x7fdd1c151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:25.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.210+0000 7fdd22400640 1 -- 172.21.15.42:0/4078968037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd1c072e90 msgr2=0x7fdd1c1f3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:25.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.210+0000 7fdd22400640 1 --2- 172.21.15.42:0/4078968037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd1c072e90 0x7fdd1c1f3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:25.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.210+0000 7fdd22400640 1 -- 172.21.15.42:0/4078968037 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd1c1f40d0 con 0x7fdd1c142f40 2024-09-17T01:47:25.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.210+0000 7fdd22400640 1 --2- 172.21.15.42:0/4078968037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd1c142f40 0x7fdd1c13c5b0 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7fdd1400c730 tx=0x7fdd1400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:25.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.211+0000 7fdd19600640 1 -- 172.21.15.42:0/4078968037 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd14003b70 con 0x7fdd1c142f40 2024-09-17T01:47:25.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.211+0000 7fdd19600640 1 -- 172.21.15.42:0/4078968037 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd14003d10 con 0x7fdd1c142f40 2024-09-17T01:47:25.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.211+0000 7fdd19600640 1 -- 172.21.15.42:0/4078968037 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1400aab0 con 0x7fdd1c142f40 2024-09-17T01:47:25.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.211+0000 7fdd24400640 1 -- 172.21.15.42:0/4078968037 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd1c1f43b0 con 0x7fdd1c142f40 2024-09-17T01:47:25.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.211+0000 7fdd24400640 1 -- 172.21.15.42:0/4078968037 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd1c1f4970 con 0x7fdd1c142f40 2024-09-17T01:47:25.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.212+0000 7fdd24400640 1 -- 172.21.15.42:0/4078968037 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd1c152450 con 0x7fdd1c142f40 2024-09-17T01:47:25.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.213+0000 7fdd19600640 1 -- 172.21.15.42:0/4078968037 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdd1400ac50 con 0x7fdd1c142f40 2024-09-17T01:47:25.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.214+0000 7fdd19600640 1 --2- 172.21.15.42:0/4078968037 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdcfc078b90 0x7fdcfc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:25.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.214+0000 7fdd19600640 1 -- 172.21.15.42:0/4078968037 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 4943+0+0 (secure 0 0 0) 0x7fdd1409a900 con 0x7fdd1c142f40 2024-09-17T01:47:25.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.215+0000 7fdd21a00640 1 --2- 172.21.15.42:0/4078968037 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdcfc078b90 0x7fdcfc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:25.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.215+0000 7fdd21a00640 1 --2- 172.21.15.42:0/4078968037 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdcfc078b90 0x7fdcfc07b0a0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fdd10000f60 tx=0x7fdd10009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:25.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.219+0000 7fdd19600640 1 -- 172.21.15.42:0/4078968037 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdd14062fa0 con 0x7fdd1c142f40 2024-09-17T01:47:25.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.414+0000 7fdd24400640 1 -- 172.21.15.42:0/4078968037 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fdd1c06a170 con 0x7fdd1c142f40 2024-09-17T01:47:25.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.418+0000 7fdd19600640 1 -- 172.21.15.42:0/4078968037 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v63) ==== 71+0+0 (secure 0 0 0) 0x7fdd140628a0 con 0x7fdd1c142f40 2024-09-17T01:47:25.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.420+0000 7fdd24400640 1 -- 172.21.15.42:0/4078968037 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdcfc078b90 msgr2=0x7fdcfc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:25.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.421+0000 7fdd24400640 1 --2- 172.21.15.42:0/4078968037 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdcfc078b90 0x7fdcfc07b0a0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fdd10000f60 tx=0x7fdd10009040 comp rx=0 tx=0).stop 2024-09-17T01:47:25.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.421+0000 7fdd24400640 1 -- 172.21.15.42:0/4078968037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd1c142f40 msgr2=0x7fdd1c13c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:25.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.421+0000 7fdd24400640 1 --2- 172.21.15.42:0/4078968037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd1c142f40 0x7fdd1c13c5b0 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7fdd1400c730 tx=0x7fdd1400cbf0 comp rx=0 tx=0).stop 2024-09-17T01:47:25.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.421+0000 7fdd24400640 1 -- 172.21.15.42:0/4078968037 shutdown_connections 2024-09-17T01:47:25.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.421+0000 7fdd24400640 1 --2- 172.21.15.42:0/4078968037 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdcfc078b90 0x7fdcfc07b0a0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:25.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.421+0000 7fdd24400640 1 --2- 172.21.15.42:0/4078968037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd1c142f40 0x7fdd1c13c5b0 unknown :-1 s=CLOSED pgs=2229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:25.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.421+0000 7fdd24400640 1 --2- 172.21.15.42:0/4078968037 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdd1c0b3550 0x7fdd1c151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:25.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.421+0000 7fdd24400640 1 --2- 172.21.15.42:0/4078968037 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd1c072e90 0x7fdd1c1f3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:25.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.421+0000 7fdd24400640 1 -- 172.21.15.42:0/4078968037 >> 172.21.15.42:0/4078968037 conn(0x7fdd1c0b2930 msgr2=0x7fdd1c0cd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:25.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.421+0000 7fdd24400640 1 -- 172.21.15.42:0/4078968037 shutdown_connections 2024-09-17T01:47:25.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.421+0000 7fdd24400640 1 -- 172.21.15.42:0/4078968037 wait complete. 2024-09-17T01:47:25.445 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2024-09-17T01:47:25.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.674+0000 7f7759200640 1 -- 172.21.15.42:0/1317015543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7738004800 msgr2=0x7f7738004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:25.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.674+0000 7f7759200640 1 --2- 172.21.15.42:0/1317015543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7738004800 0x7f7738004c10 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7f7740006f90 tx=0x7f7738005830 comp rx=0 tx=0).stop 2024-09-17T01:47:25.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.675+0000 7f7759200640 1 -- 172.21.15.42:0/1317015543 shutdown_connections 2024-09-17T01:47:25.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.675+0000 7f7759200640 1 --2- 172.21.15.42:0/1317015543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7738004800 0x7f7738004c10 unknown :-1 s=CLOSED pgs=2231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:25.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.675+0000 7f7759200640 1 -- 172.21.15.42:0/1317015543 >> 172.21.15.42:0/1317015543 conn(0x7f77540b2930 msgr2=0x7f775406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:25.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.675+0000 7f7759200640 1 -- 172.21.15.42:0/1317015543 shutdown_connections 2024-09-17T01:47:25.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.675+0000 7f7759200640 1 -- 172.21.15.42:0/1317015543 wait complete. 2024-09-17T01:47:25.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.677+0000 7f7759200640 1 Processor -- start 2024-09-17T01:47:25.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.677+0000 7f7759200640 1 -- start start 2024-09-17T01:47:25.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.678+0000 7f7759200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7738004800 0x7f77540c7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:25.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.679+0000 7f7759200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77541f4d00 0x7f775414faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:25.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.679+0000 7f7759200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77541f5110 0x7f775414daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:25.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.679+0000 7f7759200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f77540747a0 con 0x7f7738004800 2024-09-17T01:47:25.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.679+0000 7f7759200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7754074620 con 0x7f77541f5110 2024-09-17T01:47:25.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.679+0000 7f7759200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f775415f200 con 0x7f77541f4d00 2024-09-17T01:47:25.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.679+0000 7f7751e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7738004800 0x7f77540c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.679+0000 7f7751e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7738004800 0x7f77540c7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55778/0 (socket says 172.21.15.42:55778) 2024-09-17T01:47:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.679+0000 7f7751e00640 1 -- 172.21.15.42:0/1878395897 learned_addr learned my addr 172.21.15.42:0/1878395897 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.679+0000 7f7751400640 1 --2- 172.21.15.42:0/1878395897 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77541f4d00 0x7f775414faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.679+0000 7f7752800640 1 --2- 172.21.15.42:0/1878395897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77541f5110 0x7f775414daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.679+0000 7f7751e00640 1 -- 172.21.15.42:0/1878395897 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77541f4d00 msgr2=0x7f775414faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.679+0000 7f7751e00640 1 --2- 172.21.15.42:0/1878395897 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77541f4d00 0x7f775414faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.679+0000 7f7751e00640 1 -- 172.21.15.42:0/1878395897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77541f5110 msgr2=0x7f775414daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.679+0000 7f7751e00640 1 --2- 172.21.15.42:0/1878395897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77541f5110 0x7f775414daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.679+0000 7f7751e00640 1 -- 172.21.15.42:0/1878395897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7754153e70 con 0x7f7738004800 2024-09-17T01:47:25.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.680+0000 7f7751e00640 1 --2- 172.21.15.42:0/1878395897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7738004800 0x7f77540c7000 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7f7744011a10 tx=0x7f7744011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:25.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.680+0000 7f774a000640 1 -- 172.21.15.42:0/1878395897 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774401e070 con 0x7f7738004800 2024-09-17T01:47:25.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.680+0000 7f774a000640 1 -- 172.21.15.42:0/1878395897 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7744004460 con 0x7f7738004800 2024-09-17T01:47:25.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.680+0000 7f774a000640 1 -- 172.21.15.42:0/1878395897 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774400fc00 con 0x7f7738004800 2024-09-17T01:47:25.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.680+0000 7f7759200640 1 -- 172.21.15.42:0/1878395897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7754150710 con 0x7f7738004800 2024-09-17T01:47:25.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.680+0000 7f7759200640 1 -- 172.21.15.42:0/1878395897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77540c6800 con 0x7f7738004800 2024-09-17T01:47:25.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.681+0000 7f7759200640 1 -- 172.21.15.42:0/1878395897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7754070190 con 0x7f7738004800 2024-09-17T01:47:25.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.682+0000 7f774a000640 1 -- 172.21.15.42:0/1878395897 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7744021070 con 0x7f7738004800 2024-09-17T01:47:25.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.683+0000 7f774a000640 1 --2- 172.21.15.42:0/1878395897 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7734078b90 0x7f773407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:25.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.683+0000 7f774a000640 1 -- 172.21.15.42:0/1878395897 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 4943+0+0 (secure 0 0 0) 0x7f774409b460 con 0x7f7738004800 2024-09-17T01:47:25.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.684+0000 7f7751400640 1 --2- 172.21.15.42:0/1878395897 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7734078b90 0x7f773407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:25.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.685+0000 7f7751400640 1 --2- 172.21.15.42:0/1878395897 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7734078b90 0x7f773407b0a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f7740033000 tx=0x7f775415fdb0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:25.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.688+0000 7f774a000640 1 -- 172.21.15.42:0/1878395897 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7754070190 con 0x7f7738004800 2024-09-17T01:47:25.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:25.957+0000 7f7759200640 1 -- 172.21.15.42:0/1878395897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) -- 0x7f775415f760 con 0x7f7738004800 2024-09-17T01:47:26.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:26.944+0000 7f774a000640 1 -- 172.21.15.42:0/1878395897 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v724) ==== 140+0+0 (secure 0 0 0) 0x7f7754153e70 con 0x7f7738004800 2024-09-17T01:47:26.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:26.948+0000 7f7759200640 1 -- 172.21.15.42:0/1878395897 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7734078b90 msgr2=0x7f773407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:26.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:26.948+0000 7f7759200640 1 --2- 172.21.15.42:0/1878395897 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7734078b90 0x7f773407b0a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f7740033000 tx=0x7f775415fdb0 comp rx=0 tx=0).stop 2024-09-17T01:47:26.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:26.948+0000 7f7759200640 1 -- 172.21.15.42:0/1878395897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7738004800 msgr2=0x7f77540c7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:26.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:26.948+0000 7f7759200640 1 --2- 172.21.15.42:0/1878395897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7738004800 0x7f77540c7000 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7f7744011a10 tx=0x7f7744011ed0 comp rx=0 tx=0).stop 2024-09-17T01:47:26.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:26.948+0000 7f7759200640 1 -- 172.21.15.42:0/1878395897 shutdown_connections 2024-09-17T01:47:26.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:26.948+0000 7f7759200640 1 --2- 172.21.15.42:0/1878395897 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7734078b90 0x7f773407b0a0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:26.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:26.948+0000 7f7759200640 1 --2- 172.21.15.42:0/1878395897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77541f5110 0x7f775414daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:26.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:26.948+0000 7f7759200640 1 --2- 172.21.15.42:0/1878395897 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77541f4d00 0x7f775414faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:26.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:26.948+0000 7f7759200640 1 --2- 172.21.15.42:0/1878395897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7738004800 0x7f77540c7000 unknown :-1 s=CLOSED pgs=2232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:26.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:26.948+0000 7f7759200640 1 -- 172.21.15.42:0/1878395897 >> 172.21.15.42:0/1878395897 conn(0x7f77540b2930 msgr2=0x7f775415e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:26.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:26.948+0000 7f7759200640 1 -- 172.21.15.42:0/1878395897 shutdown_connections 2024-09-17T01:47:26.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:26.948+0000 7f7759200640 1 -- 172.21.15.42:0/1878395897 wait complete. 2024-09-17T01:47:26.972 INFO:tasks.cephfs_test_runner:test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-09-17T01:47:26.972 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-17T01:47:26.972 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:47:27.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.206+0000 7f0aaaa00640 1 -- 172.21.15.42:0/1221861901 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0aa4073df0 msgr2=0x7f0aa4074200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:27.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.206+0000 7f0aaaa00640 1 --2- 172.21.15.42:0/1221861901 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0aa4073df0 0x7f0aa4074200 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c005fd0 tx=0x7f0a9c02a820 comp rx=0 tx=0).stop 2024-09-17T01:47:27.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.206+0000 7f0aaaa00640 1 -- 172.21.15.42:0/1221861901 shutdown_connections 2024-09-17T01:47:27.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.206+0000 7f0aaaa00640 1 --2- 172.21.15.42:0/1221861901 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0aa4073df0 0x7f0aa4074200 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:27.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.206+0000 7f0aaaa00640 1 --2- 172.21.15.42:0/1221861901 >> v2:172.21.15.43:3300/0 conn(0x7f0aa406ee90 0x7f0aa415f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:27.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.206+0000 7f0aaaa00640 1 -- 172.21.15.42:0/1221861901 >> 172.21.15.42:0/1221861901 conn(0x7f0aa40b2930 msgr2=0x7f0aa406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:27.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.206+0000 7f0aaaa00640 1 -- 172.21.15.42:0/1221861901 shutdown_connections 2024-09-17T01:47:27.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.206+0000 7f0aaaa00640 1 -- 172.21.15.42:0/1221861901 wait complete. 2024-09-17T01:47:27.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.208+0000 7f0aaaa00640 1 Processor -- start 2024-09-17T01:47:27.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.208+0000 7f0aaaa00640 1 -- start start 2024-09-17T01:47:27.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.210+0000 7f0aaaa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0aa406ee90 0x7f0aa41f6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:27.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.210+0000 7f0aaaa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0aa406f2a0 0x7f0aa40b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:27.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.210+0000 7f0aaaa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0aa4073df0 0x7f0aa40b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:27.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.210+0000 7f0aaaa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa40cef40 con 0x7f0aa406ee90 2024-09-17T01:47:27.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.210+0000 7f0aaaa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa4162ae0 con 0x7f0aa406f2a0 2024-09-17T01:47:27.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.210+0000 7f0aaaa00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0aa40cf0c0 con 0x7f0aa4073df0 2024-09-17T01:47:27.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.210+0000 7f0aa3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0aa406ee90 0x7f0aa41f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:27.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.210+0000 7f0aa3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0aa406ee90 0x7f0aa41f6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45560/0 (socket says 172.21.15.42:45560) 2024-09-17T01:47:27.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.210+0000 7f0aa3e00640 1 -- 172.21.15.42:0/153077463 learned_addr learned my addr 172.21.15.42:0/153077463 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:27.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.210+0000 7f0aa8a00640 1 --2- 172.21.15.42:0/153077463 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0aa4073df0 0x7f0aa40b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:27.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.210+0000 7f0aa3400640 1 --2- 172.21.15.42:0/153077463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0aa406f2a0 0x7f0aa40b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:27.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.211+0000 7f0aa3e00640 1 -- 172.21.15.42:0/153077463 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0aa4073df0 msgr2=0x7f0aa40b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:27.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.211+0000 7f0aa3e00640 1 --2- 172.21.15.42:0/153077463 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0aa4073df0 0x7f0aa40b16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:27.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.211+0000 7f0aa3e00640 1 -- 172.21.15.42:0/153077463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0aa406f2a0 msgr2=0x7f0aa40b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:27.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.211+0000 7f0aa3e00640 1 --2- 172.21.15.42:0/153077463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0aa406f2a0 0x7f0aa40b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:27.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.211+0000 7f0aa3e00640 1 -- 172.21.15.42:0/153077463 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa41483e0 con 0x7f0aa406ee90 2024-09-17T01:47:27.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.211+0000 7f0aa3e00640 1 --2- 172.21.15.42:0/153077463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0aa406ee90 0x7f0aa41f6500 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400e790 tx=0x7f0a9400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:27.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.211+0000 7f0a9be00640 1 -- 172.21.15.42:0/153077463 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9400eea0 con 0x7f0aa406ee90 2024-09-17T01:47:27.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.211+0000 7f0aaaa00640 1 -- 172.21.15.42:0/153077463 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aa41f9260 con 0x7f0aa406ee90 2024-09-17T01:47:27.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.211+0000 7f0a9be00640 1 -- 172.21.15.42:0/153077463 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a9400cdb0 con 0x7f0aa406ee90 2024-09-17T01:47:27.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.211+0000 7f0a9be00640 1 -- 172.21.15.42:0/153077463 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a94010690 con 0x7f0aa406ee90 2024-09-17T01:47:27.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.211+0000 7f0aaaa00640 1 -- 172.21.15.42:0/153077463 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aa41f9820 con 0x7f0aa406ee90 2024-09-17T01:47:27.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.212+0000 7f0aaaa00640 1 -- 172.21.15.42:0/153077463 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aa41485b0 con 0x7f0aa406ee90 2024-09-17T01:47:27.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.214+0000 7f0a9be00640 1 -- 172.21.15.42:0/153077463 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0a94010830 con 0x7f0aa406ee90 2024-09-17T01:47:27.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.215+0000 7f0a9be00640 1 --2- 172.21.15.42:0/153077463 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0a84078bc0 0x7f0a8407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:27.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.215+0000 7f0a9be00640 1 -- 172.21.15.42:0/153077463 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 4943+0+0 (secure 0 0 0) 0x7f0a9409b4f0 con 0x7f0aa406ee90 2024-09-17T01:47:27.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.215+0000 7f0aa3400640 1 --2- 172.21.15.42:0/153077463 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0a84078bc0 0x7f0a8407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:27.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.216+0000 7f0aa3400640 1 --2- 172.21.15.42:0/153077463 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0a84078bc0 0x7f0a8407b0d0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f0a90007d60 tx=0x7f0a90007cf0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:27.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.219+0000 7f0a9be00640 1 -- 172.21.15.42:0/153077463 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0a940634c0 con 0x7f0aa406ee90 2024-09-17T01:47:27.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.418+0000 7f0aaaa00640 1 -- 172.21.15.42:0/153077463 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0aa415f200 con 0x7f0aa406ee90 2024-09-17T01:47:27.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.419+0000 7f0a9be00640 1 -- 172.21.15.42:0/153077463 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) ==== 74+0+12994 (secure 0 0 0) 0x7f0a94067ef0 con 0x7f0aa406ee90 2024-09-17T01:47:27.417 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:27.418 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":192,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:47:24.934719+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":188,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6837/1477091047":"2024-09-18T01:47:21.918365+0000","172.21.15.43:6835/1477091047":"2024-09-18T01:47:21.918365+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:47:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.421+0000 7f0aaaa00640 1 -- 172.21.15.42:0/153077463 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0a84078bc0 msgr2=0x7f0a8407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.421+0000 7f0aaaa00640 1 --2- 172.21.15.42:0/153077463 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0a84078bc0 0x7f0a8407b0d0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f0a90007d60 tx=0x7f0a90007cf0 comp rx=0 tx=0).stop 2024-09-17T01:47:27.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.421+0000 7f0aaaa00640 1 -- 172.21.15.42:0/153077463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0aa406ee90 msgr2=0x7f0aa41f6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:27.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.421+0000 7f0aaaa00640 1 --2- 172.21.15.42:0/153077463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0aa406ee90 0x7f0aa41f6500 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400e790 tx=0x7f0a9400ec50 comp rx=0 tx=0).stop 2024-09-17T01:47:27.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.421+0000 7f0aaaa00640 1 -- 172.21.15.42:0/153077463 shutdown_connections 2024-09-17T01:47:27.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.421+0000 7f0aaaa00640 1 --2- 172.21.15.42:0/153077463 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0a84078bc0 0x7f0a8407b0d0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:27.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.421+0000 7f0aaaa00640 1 --2- 172.21.15.42:0/153077463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0aa406f2a0 0x7f0aa40b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:27.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.421+0000 7f0aaaa00640 1 --2- 172.21.15.42:0/153077463 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0aa4073df0 0x7f0aa40b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:27.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.421+0000 7f0aaaa00640 1 --2- 172.21.15.42:0/153077463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0aa406ee90 0x7f0aa41f6500 unknown :-1 s=CLOSED pgs=2233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:27.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.421+0000 7f0aaaa00640 1 -- 172.21.15.42:0/153077463 >> 172.21.15.42:0/153077463 conn(0x7f0aa40b2930 msgr2=0x7f0aa415e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:27.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.422+0000 7f0aaaa00640 1 -- 172.21.15.42:0/153077463 shutdown_connections 2024-09-17T01:47:27.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.422+0000 7f0aaaa00640 1 -- 172.21.15.42:0/153077463 wait complete. 2024-09-17T01:47:27.444 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T01:31:55.004951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T01:47:27.444 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T01:47:27.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.678+0000 7f631f000640 1 -- 172.21.15.42:0/3351783093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63180cec40 msgr2=0x7f63180cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:27.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.678+0000 7f631f000640 1 --2- 172.21.15.42:0/3351783093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63180cec40 0x7f63180cf050 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7f6318071ef0 tx=0x7f631002aa30 comp rx=0 tx=0).stop 2024-09-17T01:47:27.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.678+0000 7f631f000640 1 -- 172.21.15.42:0/3351783093 shutdown_connections 2024-09-17T01:47:27.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.678+0000 7f631f000640 1 --2- 172.21.15.42:0/3351783093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63180cec40 0x7f63180cf050 unknown :-1 s=CLOSED pgs=2234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:27.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.678+0000 7f631f000640 1 --2- 172.21.15.42:0/3351783093 >> v2:172.21.15.43:3300/0 conn(0x7f63180b3550 0x7f631815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:27.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.678+0000 7f631f000640 1 -- 172.21.15.42:0/3351783093 >> 172.21.15.42:0/3351783093 conn(0x7f63180b2930 msgr2=0x7f631806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:27.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.679+0000 7f631f000640 1 -- 172.21.15.42:0/3351783093 shutdown_connections 2024-09-17T01:47:27.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.679+0000 7f631f000640 1 -- 172.21.15.42:0/3351783093 wait complete. 2024-09-17T01:47:27.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.681+0000 7f631f000640 1 Processor -- start 2024-09-17T01:47:27.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.681+0000 7f631f000640 1 -- start start 2024-09-17T01:47:27.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.682+0000 7f631f000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f63180b3550 0x7f63180abb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:27.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.682+0000 7f631f000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63180cec40 0x7f63181f3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:27.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.682+0000 7f631f000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6318142f40 0x7f63181f6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:27.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.682+0000 7f631f000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f631806d7c0 con 0x7f6318142f40 2024-09-17T01:47:27.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.682+0000 7f631f000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f631806d640 con 0x7f63180cec40 2024-09-17T01:47:27.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.682+0000 7f631f000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f631806d940 con 0x7f63180b3550 2024-09-17T01:47:27.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.683+0000 7f631d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6318142f40 0x7f63181f6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:27.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.683+0000 7f6317e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f63180b3550 0x7f63180abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:27.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.683+0000 7f631d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6318142f40 0x7f63181f6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45582/0 (socket says 172.21.15.42:45582) 2024-09-17T01:47:27.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.683+0000 7f631d000640 1 -- 172.21.15.42:0/3537580005 learned_addr learned my addr 172.21.15.42:0/3537580005 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:27.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.683+0000 7f630f400640 1 --2- 172.21.15.42:0/3537580005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63180cec40 0x7f63181f3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:27.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.683+0000 7f631d000640 1 -- 172.21.15.42:0/3537580005 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f63180b3550 msgr2=0x7f63180abb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:27.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.683+0000 7f631d000640 1 --2- 172.21.15.42:0/3537580005 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f63180b3550 0x7f63180abb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:27.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.683+0000 7f631d000640 1 -- 172.21.15.42:0/3537580005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63180cec40 msgr2=0x7f63181f3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:27.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.683+0000 7f631d000640 1 --2- 172.21.15.42:0/3537580005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63180cec40 0x7f63181f3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:27.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.683+0000 7f631d000640 1 -- 172.21.15.42:0/3537580005 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63181f4450 con 0x7f6318142f40 2024-09-17T01:47:27.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.683+0000 7f631d000640 1 --2- 172.21.15.42:0/3537580005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6318142f40 0x7f63181f6a80 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f6310005fd0 tx=0x7f6310003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:27.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.684+0000 7f6314c00640 1 -- 172.21.15.42:0/3537580005 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6310033050 con 0x7f6318142f40 2024-09-17T01:47:27.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.684+0000 7f6314c00640 1 -- 172.21.15.42:0/3537580005 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6310004540 con 0x7f6318142f40 2024-09-17T01:47:27.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.684+0000 7f6314c00640 1 -- 172.21.15.42:0/3537580005 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6310038450 con 0x7f6318142f40 2024-09-17T01:47:27.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.684+0000 7f631f000640 1 -- 172.21.15.42:0/3537580005 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63180aaab0 con 0x7f6318142f40 2024-09-17T01:47:27.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.684+0000 7f631f000640 1 -- 172.21.15.42:0/3537580005 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63180ab070 con 0x7f6318142f40 2024-09-17T01:47:27.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.685+0000 7f631f000640 1 -- 172.21.15.42:0/3537580005 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63180aa820 con 0x7f6318142f40 2024-09-17T01:47:27.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.686+0000 7f6314c00640 1 -- 172.21.15.42:0/3537580005 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6310036070 con 0x7f6318142f40 2024-09-17T01:47:27.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.687+0000 7f6314c00640 1 --2- 172.21.15.42:0/3537580005 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f62f4078bc0 0x7f62f407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:27.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.687+0000 7f6314c00640 1 -- 172.21.15.42:0/3537580005 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 4943+0+0 (secure 0 0 0) 0x7f63100bbcf0 con 0x7f6318142f40 2024-09-17T01:47:27.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.688+0000 7f6317e00640 1 --2- 172.21.15.42:0/3537580005 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f62f4078bc0 0x7f62f407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:27.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.688+0000 7f6317e00640 1 --2- 172.21.15.42:0/3537580005 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f62f4078bc0 0x7f62f407b0d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f6308009b30 tx=0x7f6308005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:27.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.691+0000 7f6314c00640 1 -- 172.21.15.42:0/3537580005 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f63181f4450 con 0x7f6318142f40 2024-09-17T01:47:27.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.886+0000 7f631f000640 1 -- 172.21.15.42:0/3537580005 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f631806a170 con 0x7f6318142f40 2024-09-17T01:47:27.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.886+0000 7f6314c00640 1 -- 172.21.15.42:0/3537580005 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v192) ==== 93+0+10 (secure 0 0 0) 0x7f6310083d40 con 0x7f6318142f40 2024-09-17T01:47:27.884 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-09-17T01:47:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.889+0000 7f631f000640 1 -- 172.21.15.42:0/3537580005 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f62f4078bc0 msgr2=0x7f62f407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.889+0000 7f631f000640 1 --2- 172.21.15.42:0/3537580005 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f62f4078bc0 0x7f62f407b0d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f6308009b30 tx=0x7f6308005f90 comp rx=0 tx=0).stop 2024-09-17T01:47:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.889+0000 7f631f000640 1 -- 172.21.15.42:0/3537580005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6318142f40 msgr2=0x7f63181f6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.889+0000 7f631f000640 1 --2- 172.21.15.42:0/3537580005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6318142f40 0x7f63181f6a80 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f6310005fd0 tx=0x7f6310003f90 comp rx=0 tx=0).stop 2024-09-17T01:47:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.889+0000 7f631f000640 1 -- 172.21.15.42:0/3537580005 shutdown_connections 2024-09-17T01:47:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.889+0000 7f631f000640 1 --2- 172.21.15.42:0/3537580005 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f62f4078bc0 0x7f62f407b0d0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.889+0000 7f631f000640 1 --2- 172.21.15.42:0/3537580005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63180cec40 0x7f63181f3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.889+0000 7f631f000640 1 --2- 172.21.15.42:0/3537580005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6318142f40 0x7f63181f6a80 unknown :-1 s=CLOSED pgs=2235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.889+0000 7f631f000640 1 --2- 172.21.15.42:0/3537580005 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f63180b3550 0x7f63180abb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:27.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.889+0000 7f631f000640 1 -- 172.21.15.42:0/3537580005 >> 172.21.15.42:0/3537580005 conn(0x7f63180b2930 msgr2=0x7f631815f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:27.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.889+0000 7f631f000640 1 -- 172.21.15.42:0/3537580005 shutdown_connections 2024-09-17T01:47:27.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:27.889+0000 7f631f000640 1 -- 172.21.15.42:0/3537580005 wait complete. 2024-09-17T01:47:27.912 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2024-09-17T01:47:28.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.142+0000 7f638ba00640 1 -- 172.21.15.42:0/2467027026 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6384142f40 msgr2=0x7f6384072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:28.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.142+0000 7f638ba00640 1 --2- 172.21.15.42:0/2467027026 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6384142f40 0x7f6384072950 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7f638415aab0 tx=0x7f637002a560 comp rx=0 tx=0).stop 2024-09-17T01:47:28.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.143+0000 7f638ba00640 1 -- 172.21.15.42:0/2467027026 shutdown_connections 2024-09-17T01:47:28.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.143+0000 7f638ba00640 1 --2- 172.21.15.42:0/2467027026 >> v2:172.21.15.43:3300/0 conn(0x7f6384072e90 0x7f63840cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:28.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.143+0000 7f638ba00640 1 --2- 172.21.15.42:0/2467027026 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6384142f40 0x7f6384072950 unknown :-1 s=CLOSED pgs=2236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:28.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.143+0000 7f638ba00640 1 -- 172.21.15.42:0/2467027026 >> 172.21.15.42:0/2467027026 conn(0x7f63840b2930 msgr2=0x7f638406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:28.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.143+0000 7f638ba00640 1 -- 172.21.15.42:0/2467027026 shutdown_connections 2024-09-17T01:47:28.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.143+0000 7f638ba00640 1 -- 172.21.15.42:0/2467027026 wait complete. 2024-09-17T01:47:28.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.145+0000 7f638ba00640 1 Processor -- start 2024-09-17T01:47:28.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.145+0000 7f638ba00640 1 -- start start 2024-09-17T01:47:28.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.146+0000 7f638ba00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6384072e90 0x7f63841f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:28.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.146+0000 7f638ba00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63840b3550 0x7f638413ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:28.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.146+0000 7f638ba00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6384142f40 0x7f63841f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:28.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.146+0000 7f638ba00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f638406d5b0 con 0x7f63840b3550 2024-09-17T01:47:28.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.146+0000 7f638ba00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f638406d430 con 0x7f6384142f40 2024-09-17T01:47:28.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.146+0000 7f638ba00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f638406d730 con 0x7f6384072e90 2024-09-17T01:47:28.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.147+0000 7f6383e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63840b3550 0x7f638413ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:28.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.147+0000 7f6383e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63840b3550 0x7f638413ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45596/0 (socket says 172.21.15.42:45596) 2024-09-17T01:47:28.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.147+0000 7f6383e00640 1 -- 172.21.15.42:0/2815249455 learned_addr learned my addr 172.21.15.42:0/2815249455 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:28.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.147+0000 7f6389000640 1 --2- 172.21.15.42:0/2815249455 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6384072e90 0x7f63841f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:28.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.147+0000 7f6389a00640 1 --2- 172.21.15.42:0/2815249455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6384142f40 0x7f63841f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:28.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.147+0000 7f6383e00640 1 -- 172.21.15.42:0/2815249455 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6384072e90 msgr2=0x7f63841f5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:28.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.147+0000 7f6383e00640 1 --2- 172.21.15.42:0/2815249455 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6384072e90 0x7f63841f5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:28.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.147+0000 7f6383e00640 1 -- 172.21.15.42:0/2815249455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6384142f40 msgr2=0x7f63841f89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:28.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.147+0000 7f6383e00640 1 --2- 172.21.15.42:0/2815249455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6384142f40 0x7f63841f89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:28.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.147+0000 7f6383e00640 1 -- 172.21.15.42:0/2815249455 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f638413f200 con 0x7f63840b3550 2024-09-17T01:47:28.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.147+0000 7f6389a00640 1 --2- 172.21.15.42:0/2815249455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6384142f40 0x7f63841f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:47:28.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.148+0000 7f6383e00640 1 --2- 172.21.15.42:0/2815249455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63840b3550 0x7f638413ecc0 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7f6370034040 tx=0x7f6370003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:28.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.148+0000 7f6380c00640 1 -- 172.21.15.42:0/2815249455 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637003e030 con 0x7f63840b3550 2024-09-17T01:47:28.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.148+0000 7f6380c00640 1 -- 172.21.15.42:0/2815249455 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6370003e00 con 0x7f63840b3550 2024-09-17T01:47:28.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.148+0000 7f638ba00640 1 -- 172.21.15.42:0/2815249455 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f638415b600 con 0x7f63840b3550 2024-09-17T01:47:28.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.148+0000 7f6380c00640 1 -- 172.21.15.42:0/2815249455 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6370035040 con 0x7f63840b3550 2024-09-17T01:47:28.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.148+0000 7f638ba00640 1 -- 172.21.15.42:0/2815249455 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63841f9820 con 0x7f63840b3550 2024-09-17T01:47:28.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.149+0000 7f638ba00640 1 -- 172.21.15.42:0/2815249455 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63841f92b0 con 0x7f63840b3550 2024-09-17T01:47:28.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.150+0000 7f6380c00640 1 -- 172.21.15.42:0/2815249455 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6370041030 con 0x7f63840b3550 2024-09-17T01:47:28.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.151+0000 7f6380c00640 1 --2- 172.21.15.42:0/2815249455 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6364078bc0 0x7f636407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:28.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.151+0000 7f6380c00640 1 -- 172.21.15.42:0/2815249455 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 4943+0+0 (secure 0 0 0) 0x7f63700bb1d0 con 0x7f63840b3550 2024-09-17T01:47:28.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.152+0000 7f6389000640 1 --2- 172.21.15.42:0/2815249455 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6364078bc0 0x7f636407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:28.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.153+0000 7f6389000640 1 --2- 172.21.15.42:0/2815249455 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6364078bc0 0x7f636407b0d0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f6378001720 tx=0x7f6378009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:28.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.156+0000 7f6380c00640 1 -- 172.21.15.42:0/2815249455 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f63700832b0 con 0x7f63840b3550 2024-09-17T01:47:28.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.422+0000 7f638ba00640 1 -- 172.21.15.42:0/2815249455 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) -- 0x7f638406dc50 con 0x7f63840b3550 2024-09-17T01:47:28.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.953+0000 7f6380c00640 1 -- 172.21.15.42:0/2815249455 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v726) ==== 136+0+0 (secure 0 0 0) 0x7f6370087ce0 con 0x7f63840b3550 2024-09-17T01:47:28.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.955+0000 7f638ba00640 1 -- 172.21.15.42:0/2815249455 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6364078bc0 msgr2=0x7f636407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:28.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.955+0000 7f638ba00640 1 --2- 172.21.15.42:0/2815249455 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6364078bc0 0x7f636407b0d0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f6378001720 tx=0x7f6378009040 comp rx=0 tx=0).stop 2024-09-17T01:47:28.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.955+0000 7f638ba00640 1 -- 172.21.15.42:0/2815249455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63840b3550 msgr2=0x7f638413ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:28.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.955+0000 7f638ba00640 1 --2- 172.21.15.42:0/2815249455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63840b3550 0x7f638413ecc0 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7f6370034040 tx=0x7f6370003910 comp rx=0 tx=0).stop 2024-09-17T01:47:28.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.955+0000 7f638ba00640 1 -- 172.21.15.42:0/2815249455 shutdown_connections 2024-09-17T01:47:28.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.956+0000 7f638ba00640 1 --2- 172.21.15.42:0/2815249455 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6364078bc0 0x7f636407b0d0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:28.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.956+0000 7f638ba00640 1 --2- 172.21.15.42:0/2815249455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6384142f40 0x7f63841f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:28.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.956+0000 7f638ba00640 1 --2- 172.21.15.42:0/2815249455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f63840b3550 0x7f638413ecc0 unknown :-1 s=CLOSED pgs=2237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:28.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.956+0000 7f638ba00640 1 --2- 172.21.15.42:0/2815249455 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6384072e90 0x7f63841f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:28.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.956+0000 7f638ba00640 1 -- 172.21.15.42:0/2815249455 >> 172.21.15.42:0/2815249455 conn(0x7f63840b2930 msgr2=0x7f6384073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:28.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.956+0000 7f638ba00640 1 -- 172.21.15.42:0/2815249455 shutdown_connections 2024-09-17T01:47:28.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:28.956+0000 7f638ba00640 1 -- 172.21.15.42:0/2815249455 wait complete. 2024-09-17T01:47:28.978 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T01:47:29.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.210+0000 7fe21ae00640 1 -- 172.21.15.42:0/636630591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2140cf7c0 msgr2=0x7fe21406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:29.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.210+0000 7fe21ae00640 1 --2- 172.21.15.42:0/636630591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2140cf7c0 0x7fe21406cd20 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7fe214071cb0 tx=0x7fe20002a560 comp rx=0 tx=0).stop 2024-09-17T01:47:29.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.210+0000 7fe21ae00640 1 -- 172.21.15.42:0/636630591 shutdown_connections 2024-09-17T01:47:29.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.210+0000 7fe21ae00640 1 --2- 172.21.15.42:0/636630591 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe21406d260 0x7fe214152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:29.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.210+0000 7fe21ae00640 1 --2- 172.21.15.42:0/636630591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe2140cf7c0 0x7fe21406cd20 unknown :-1 s=CLOSED pgs=2238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:29.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.210+0000 7fe21ae00640 1 --2- 172.21.15.42:0/636630591 >> v2:172.21.15.43:3300/0 conn(0x7fe2140b4be0 0x7fe21415d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:29.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.210+0000 7fe21ae00640 1 -- 172.21.15.42:0/636630591 >> 172.21.15.42:0/636630591 conn(0x7fe2140b25f0 msgr2=0x7fe2140d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:29.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.210+0000 7fe21ae00640 1 -- 172.21.15.42:0/636630591 shutdown_connections 2024-09-17T01:47:29.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.210+0000 7fe21ae00640 1 -- 172.21.15.42:0/636630591 wait complete. 2024-09-17T01:47:29.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.212+0000 7fe21ae00640 1 Processor -- start 2024-09-17T01:47:29.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.212+0000 7fe21ae00640 1 -- start start 2024-09-17T01:47:29.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.214+0000 7fe21ae00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe21406d260 0x7fe2140aea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:29.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.214+0000 7fe21ae00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe2140b4be0 0x7fe21415fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:29.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.214+0000 7fe21ae00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe2140cf7c0 0x7fe21409dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:29.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.214+0000 7fe21ae00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe2141537a0 con 0x7fe21406d260 2024-09-17T01:47:29.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.214+0000 7fe21ae00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe214153620 con 0x7fe2140cf7c0 2024-09-17T01:47:29.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.214+0000 7fe21ae00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe214153920 con 0x7fe2140b4be0 2024-09-17T01:47:29.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.214+0000 7fe219a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe21406d260 0x7fe2140aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:29.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.214+0000 7fe219a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe21406d260 0x7fe2140aea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45616/0 (socket says 172.21.15.42:45616) 2024-09-17T01:47:29.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.214+0000 7fe219a00640 1 -- 172.21.15.42:0/2739579678 learned_addr learned my addr 172.21.15.42:0/2739579678 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:29.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.214+0000 7fe219000640 1 --2- 172.21.15.42:0/2739579678 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe2140b4be0 0x7fe21415fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:29.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.214+0000 7fe21a400640 1 --2- 172.21.15.42:0/2739579678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe2140cf7c0 0x7fe21409dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:29.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.214+0000 7fe219a00640 1 -- 172.21.15.42:0/2739579678 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe2140b4be0 msgr2=0x7fe21415fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:29.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.215+0000 7fe219a00640 1 --2- 172.21.15.42:0/2739579678 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe2140b4be0 0x7fe21415fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:29.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.215+0000 7fe219a00640 1 -- 172.21.15.42:0/2739579678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe2140cf7c0 msgr2=0x7fe21409dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:29.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.215+0000 7fe219a00640 1 --2- 172.21.15.42:0/2739579678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe2140cf7c0 0x7fe21409dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:29.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.215+0000 7fe219a00640 1 -- 172.21.15.42:0/2739579678 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe214073340 con 0x7fe21406d260 2024-09-17T01:47:29.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.215+0000 7fe219a00640 1 --2- 172.21.15.42:0/2739579678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe21406d260 0x7fe2140aea90 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7fe20800e7c0 tx=0x7fe20800ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:29.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.215+0000 7fe211600640 1 -- 172.21.15.42:0/2739579678 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20800cab0 con 0x7fe21406d260 2024-09-17T01:47:29.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.215+0000 7fe211600640 1 -- 172.21.15.42:0/2739579678 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe20800cd40 con 0x7fe21406d260 2024-09-17T01:47:29.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.215+0000 7fe211600640 1 -- 172.21.15.42:0/2739579678 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe208010690 con 0x7fe21406d260 2024-09-17T01:47:29.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.215+0000 7fe21ae00640 1 -- 172.21.15.42:0/2739579678 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe21415f0c0 con 0x7fe21406d260 2024-09-17T01:47:29.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.215+0000 7fe21ae00640 1 -- 172.21.15.42:0/2739579678 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe21415f680 con 0x7fe21406d260 2024-09-17T01:47:29.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.216+0000 7fe21ae00640 1 -- 172.21.15.42:0/2739579678 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe21415d6b0 con 0x7fe21406d260 2024-09-17T01:47:29.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.218+0000 7fe211600640 1 -- 172.21.15.42:0/2739579678 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe208010830 con 0x7fe21406d260 2024-09-17T01:47:29.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.219+0000 7fe211600640 1 --2- 172.21.15.42:0/2739579678 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe1f4078b90 0x7fe1f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:29.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.219+0000 7fe211600640 1 -- 172.21.15.42:0/2739579678 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 4943+0+0 (secure 0 0 0) 0x7fe20809b3e0 con 0x7fe21406d260 2024-09-17T01:47:29.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.219+0000 7fe219000640 1 --2- 172.21.15.42:0/2739579678 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe1f4078b90 0x7fe1f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:29.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.220+0000 7fe219000640 1 --2- 172.21.15.42:0/2739579678 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe1f4078b90 0x7fe1f407b0a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fe200033000 tx=0x7fe200004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:29.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.223+0000 7fe211600640 1 -- 172.21.15.42:0/2739579678 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe208063430 con 0x7fe21406d260 2024-09-17T01:47:29.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.419+0000 7fe21ae00640 1 -- 172.21.15.42:0/2739579678 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fe214069870 con 0x7fe21406d260 2024-09-17T01:47:29.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.419+0000 7fe211600640 1 -- 172.21.15.42:0/2739579678 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v63) ==== 59+0+2294 (secure 0 0 0) 0x7fe208067e60 con 0x7fe21406d260 2024-09-17T01:47:29.417 INFO:teuthology.orchestra.run.smithi042.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T01:47:29.417 INFO:teuthology.orchestra.run.smithi042.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T01:47:29.418 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced client_mount_timeout 30 2024-09-17T01:47:29.418 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_client 20/20 2024-09-17T01:47:29.418 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_mgr 20/20 2024-09-17T01:47:29.418 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_ms 1/1 2024-09-17T01:47:29.418 INFO:teuthology.orchestra.run.smithi042.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T01:47:29.418 INFO:teuthology.orchestra.run.smithi042.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T01:47:29.418 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3683.959260 2024-09-17T01:47:29.418 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4350.010833 2024-09-17T01:47:29.418 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4316.776055 2024-09-17T01:47:29.418 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3885.595082 2024-09-17T01:47:29.418 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3602.000737 2024-09-17T01:47:29.418 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4883.364748 2024-09-17T01:47:29.418 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3752.484811 2024-09-17T01:47:29.419 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3775.035963 2024-09-17T01:47:29.419 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds 20/20 2024-09-17T01:47:29.419 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T01:47:29.419 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_ms 2/2 2024-09-17T01:47:29.419 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_frag true 2024-09-17T01:47:29.419 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_scatterstat true 2024-09-17T01:47:29.419 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T01:47:29.419 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_verify_scatter true 2024-09-17T01:47:29.419 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T01:47:29.419 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T01:47:29.419 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T01:47:29.419 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced client_mount_timeout 600 2024-09-17T01:47:29.419 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_client 20/20 2024-09-17T01:47:29.420 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_ms 1/1 2024-09-17T01:47:29.420 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T01:47:29.420 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T01:47:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.422+0000 7fe21ae00640 1 -- 172.21.15.42:0/2739579678 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe1f4078b90 msgr2=0x7fe1f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.422+0000 7fe21ae00640 1 --2- 172.21.15.42:0/2739579678 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe1f4078b90 0x7fe1f407b0a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fe200033000 tx=0x7fe200004730 comp rx=0 tx=0).stop 2024-09-17T01:47:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.422+0000 7fe21ae00640 1 -- 172.21.15.42:0/2739579678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe21406d260 msgr2=0x7fe2140aea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.422+0000 7fe21ae00640 1 --2- 172.21.15.42:0/2739579678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe21406d260 0x7fe2140aea90 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7fe20800e7c0 tx=0x7fe20800ebc0 comp rx=0 tx=0).stop 2024-09-17T01:47:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.422+0000 7fe21ae00640 1 -- 172.21.15.42:0/2739579678 shutdown_connections 2024-09-17T01:47:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.422+0000 7fe21ae00640 1 --2- 172.21.15.42:0/2739579678 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe1f4078b90 0x7fe1f407b0a0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.422+0000 7fe21ae00640 1 --2- 172.21.15.42:0/2739579678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe2140cf7c0 0x7fe21409dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.422+0000 7fe21ae00640 1 --2- 172.21.15.42:0/2739579678 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe2140b4be0 0x7fe21415fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:29.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.422+0000 7fe21ae00640 1 --2- 172.21.15.42:0/2739579678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe21406d260 0x7fe2140aea90 unknown :-1 s=CLOSED pgs=2239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:29.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.422+0000 7fe21ae00640 1 -- 172.21.15.42:0/2739579678 >> 172.21.15.42:0/2739579678 conn(0x7fe2140b25f0 msgr2=0x7fe2140d00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:29.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.422+0000 7fe21ae00640 1 -- 172.21.15.42:0/2739579678 shutdown_connections 2024-09-17T01:47:29.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.422+0000 7fe21ae00640 1 -- 172.21.15.42:0/2739579678 wait complete. 2024-09-17T01:47:29.441 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T01:47:29.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.674+0000 7f50e9600640 1 -- 172.21.15.42:0/1881322719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50e4142f40 msgr2=0x7f50e4072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:29.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.674+0000 7f50e9600640 1 --2- 172.21.15.42:0/1881322719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50e4142f40 0x7f50e4072950 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7f50e4071ef0 tx=0x7f50d002a4d0 comp rx=0 tx=0).stop 2024-09-17T01:47:29.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.675+0000 7f50e9600640 1 -- 172.21.15.42:0/1881322719 shutdown_connections 2024-09-17T01:47:29.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.675+0000 7f50e9600640 1 --2- 172.21.15.42:0/1881322719 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50e4142f40 0x7f50e4072950 unknown :-1 s=CLOSED pgs=2240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:29.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.675+0000 7f50e9600640 1 --2- 172.21.15.42:0/1881322719 >> v2:172.21.15.43:3300/0 conn(0x7f50e40b3550 0x7f50e415cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:29.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.675+0000 7f50e9600640 1 -- 172.21.15.42:0/1881322719 >> 172.21.15.42:0/1881322719 conn(0x7f50e40b2930 msgr2=0x7f50e406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:29.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.675+0000 7f50e9600640 1 -- 172.21.15.42:0/1881322719 shutdown_connections 2024-09-17T01:47:29.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.675+0000 7f50e9600640 1 -- 172.21.15.42:0/1881322719 wait complete. 2024-09-17T01:47:29.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.677+0000 7f50e9600640 1 Processor -- start 2024-09-17T01:47:29.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.677+0000 7f50e9600640 1 -- start start 2024-09-17T01:47:29.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.678+0000 7f50e9600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50e4072e90 0x7f50e413ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:29.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.678+0000 7f50e9600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50e40b3550 0x7f50e4141d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:29.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.678+0000 7f50e9600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50e4142f40 0x7f50e4140af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:29.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.678+0000 7f50e9600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f50e406d5b0 con 0x7f50e4142f40 2024-09-17T01:47:29.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.678+0000 7f50e9600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f50e406d430 con 0x7f50e4072e90 2024-09-17T01:47:29.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.678+0000 7f50e9600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f50e406d730 con 0x7f50e40b3550 2024-09-17T01:47:29.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.679+0000 7f50e3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50e4142f40 0x7f50e4140af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:29.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.679+0000 7f50e3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50e4142f40 0x7f50e4140af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45634/0 (socket says 172.21.15.42:45634) 2024-09-17T01:47:29.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.679+0000 7f50e3400640 1 -- 172.21.15.42:0/4194057177 learned_addr learned my addr 172.21.15.42:0/4194057177 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:29.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.679+0000 7f50e2000640 1 --2- 172.21.15.42:0/4194057177 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50e40b3550 0x7f50e4141d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:29.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.679+0000 7f50e2a00640 1 --2- 172.21.15.42:0/4194057177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50e4072e90 0x7f50e413ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:29.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.679+0000 7f50e3400640 1 -- 172.21.15.42:0/4194057177 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50e40b3550 msgr2=0x7f50e4141d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:29.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.679+0000 7f50e3400640 1 --2- 172.21.15.42:0/4194057177 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50e40b3550 0x7f50e4141d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:29.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.679+0000 7f50e3400640 1 -- 172.21.15.42:0/4194057177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50e4072e90 msgr2=0x7f50e413ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:29.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.679+0000 7f50e3400640 1 --2- 172.21.15.42:0/4194057177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50e4072e90 0x7f50e413ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:29.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.679+0000 7f50e3400640 1 -- 172.21.15.42:0/4194057177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e413f200 con 0x7f50e4142f40 2024-09-17T01:47:29.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.680+0000 7f50e3400640 1 --2- 172.21.15.42:0/4194057177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50e4142f40 0x7f50e4140af0 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00b9a0 tx=0x7f50dc00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:29.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.680+0000 7f50daa00640 1 -- 172.21.15.42:0/4194057177 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc019070 con 0x7f50e4142f40 2024-09-17T01:47:29.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.680+0000 7f50daa00640 1 -- 172.21.15.42:0/4194057177 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50dc00cc90 con 0x7f50e4142f40 2024-09-17T01:47:29.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.680+0000 7f50daa00640 1 -- 172.21.15.42:0/4194057177 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc0146a0 con 0x7f50e4142f40 2024-09-17T01:47:29.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.680+0000 7f50e9600640 1 -- 172.21.15.42:0/4194057177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e4142260 con 0x7f50e4142f40 2024-09-17T01:47:29.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.680+0000 7f50e9600640 1 -- 172.21.15.42:0/4194057177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e41e6bb0 con 0x7f50e4142f40 2024-09-17T01:47:29.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.681+0000 7f50e9600640 1 -- 172.21.15.42:0/4194057177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e41e6640 con 0x7f50e4142f40 2024-09-17T01:47:29.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.682+0000 7f50daa00640 1 -- 172.21.15.42:0/4194057177 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f50dc01c070 con 0x7f50e4142f40 2024-09-17T01:47:29.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.683+0000 7f50daa00640 1 --2- 172.21.15.42:0/4194057177 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f50c4078bc0 0x7f50c407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:29.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.683+0000 7f50daa00640 1 -- 172.21.15.42:0/4194057177 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 4943+0+0 (secure 0 0 0) 0x7f50dc09a7e0 con 0x7f50e4142f40 2024-09-17T01:47:29.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.684+0000 7f50e2a00640 1 --2- 172.21.15.42:0/4194057177 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f50c4078bc0 0x7f50c407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:29.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.684+0000 7f50e2a00640 1 --2- 172.21.15.42:0/4194057177 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f50c4078bc0 0x7f50c407b0d0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f50d4005fd0 tx=0x7f50d400a250 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:29.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.688+0000 7f50daa00640 1 -- 172.21.15.42:0/4194057177 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f50e413f200 con 0x7f50e4142f40 2024-09-17T01:47:29.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.883+0000 7f50e9600640 1 -- 172.21.15.42:0/4194057177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f50e41e75b0 con 0x7f50e4142f40 2024-09-17T01:47:29.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.887+0000 7f50daa00640 1 -- 172.21.15.42:0/4194057177 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v64)=0 v64) ==== 122+0+0 (secure 0 0 0) 0x7f50dc062830 con 0x7f50e4142f40 2024-09-17T01:47:29.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.890+0000 7f50e9600640 1 -- 172.21.15.42:0/4194057177 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f50c4078bc0 msgr2=0x7f50c407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:29.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.890+0000 7f50e9600640 1 --2- 172.21.15.42:0/4194057177 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f50c4078bc0 0x7f50c407b0d0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f50d4005fd0 tx=0x7f50d400a250 comp rx=0 tx=0).stop 2024-09-17T01:47:29.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.890+0000 7f50e9600640 1 -- 172.21.15.42:0/4194057177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50e4142f40 msgr2=0x7f50e4140af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:29.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.890+0000 7f50e9600640 1 --2- 172.21.15.42:0/4194057177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50e4142f40 0x7f50e4140af0 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00b9a0 tx=0x7f50dc00be60 comp rx=0 tx=0).stop 2024-09-17T01:47:29.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.890+0000 7f50e9600640 1 -- 172.21.15.42:0/4194057177 shutdown_connections 2024-09-17T01:47:29.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.890+0000 7f50e9600640 1 --2- 172.21.15.42:0/4194057177 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f50c4078bc0 0x7f50c407b0d0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:29.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.890+0000 7f50e9600640 1 --2- 172.21.15.42:0/4194057177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50e4142f40 0x7f50e4140af0 unknown :-1 s=CLOSED pgs=2241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:29.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.890+0000 7f50e9600640 1 --2- 172.21.15.42:0/4194057177 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50e40b3550 0x7f50e4141d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:29.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.890+0000 7f50e9600640 1 --2- 172.21.15.42:0/4194057177 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50e4072e90 0x7f50e413ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:29.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.890+0000 7f50e9600640 1 -- 172.21.15.42:0/4194057177 >> 172.21.15.42:0/4194057177 conn(0x7f50e40b2930 msgr2=0x7f50e4075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:29.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.890+0000 7f50e9600640 1 -- 172.21.15.42:0/4194057177 shutdown_connections 2024-09-17T01:47:29.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:29.890+0000 7f50e9600640 1 -- 172.21.15.42:0/4194057177 wait complete. 2024-09-17T01:47:29.913 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:47:29.914 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:47:30.010 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:47:30.101 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:47:30.101 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:47:30.101 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:47:30.137 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:47:30.137 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:47:30.137 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:47:30.175 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:47:30.175 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:47:30.175 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:47:30.212 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:47:30.213 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:47:30.213 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:47:30.252 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:47:30.252 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T01:47:30.252 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:47:30.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.483+0000 7f5207e00640 1 -- 172.21.15.42:0/4092019878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f520806d640 msgr2=0x7f520815c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:30.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.483+0000 7f5207e00640 1 --2- 172.21.15.42:0/4092019878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f520806d640 0x7f520815c6d0 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f52080b2e00 tx=0x7f51f002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:47:30.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.483+0000 7f5207e00640 1 -- 172.21.15.42:0/4092019878 shutdown_connections 2024-09-17T01:47:30.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.483+0000 7f5207e00640 1 --2- 172.21.15.42:0/4092019878 >> v2:172.21.15.43:3300/0 conn(0x7f52080750b0 0x7f52080b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:30.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.483+0000 7f5207e00640 1 --2- 172.21.15.42:0/4092019878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f520806d640 0x7f520815c6d0 unknown :-1 s=CLOSED pgs=2243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:30.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.483+0000 7f5207e00640 1 -- 172.21.15.42:0/4092019878 >> 172.21.15.42:0/4092019878 conn(0x7f5208073510 msgr2=0x7f52080b6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:30.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.483+0000 7f5207e00640 1 -- 172.21.15.42:0/4092019878 shutdown_connections 2024-09-17T01:47:30.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.483+0000 7f5207e00640 1 -- 172.21.15.42:0/4092019878 wait complete. 2024-09-17T01:47:30.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.485+0000 7f5207e00640 1 Processor -- start 2024-09-17T01:47:30.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.485+0000 7f5207e00640 1 -- start start 2024-09-17T01:47:30.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.487+0000 7f5207e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52080750b0 0x7f520814e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:30.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.487+0000 7f5207e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52080cd660 0x7f5208152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:30.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.487+0000 7f5207e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f520814eb00 0x7f520815f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:30.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.487+0000 7f5207e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f52080b1ed0 con 0x7f520814eb00 2024-09-17T01:47:30.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.487+0000 7f5207e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f52080b1d50 con 0x7f52080cd660 2024-09-17T01:47:30.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.487+0000 7f5207e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f52080b2050 con 0x7f52080750b0 2024-09-17T01:47:30.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.487+0000 7f5207400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f520814eb00 0x7f520815f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:30.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.487+0000 7f5207400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f520814eb00 0x7f520815f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45650/0 (socket says 172.21.15.42:45650) 2024-09-17T01:47:30.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.487+0000 7f5207400640 1 -- 172.21.15.42:0/547576994 learned_addr learned my addr 172.21.15.42:0/547576994 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:30.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.487+0000 7f51ffe00640 1 --2- 172.21.15.42:0/547576994 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52080cd660 0x7f5208152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:30.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.487+0000 7f5206a00640 1 --2- 172.21.15.42:0/547576994 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52080750b0 0x7f520814e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:30.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.487+0000 7f5207400640 1 -- 172.21.15.42:0/547576994 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52080750b0 msgr2=0x7f520814e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:30.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.487+0000 7f5207400640 1 --2- 172.21.15.42:0/547576994 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52080750b0 0x7f520814e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:30.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.487+0000 7f5207400640 1 -- 172.21.15.42:0/547576994 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52080cd660 msgr2=0x7f5208152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:30.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.487+0000 7f5207400640 1 --2- 172.21.15.42:0/547576994 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52080cd660 0x7f5208152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:30.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.487+0000 7f5207400640 1 -- 172.21.15.42:0/547576994 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f520815d6f0 con 0x7f520814eb00 2024-09-17T01:47:30.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.488+0000 7f5207400640 1 --2- 172.21.15.42:0/547576994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f520814eb00 0x7f520815f520 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f520000d9e0 tx=0x7f520000dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:30.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.488+0000 7f51fea00640 1 -- 172.21.15.42:0/547576994 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5200017070 con 0x7f520814eb00 2024-09-17T01:47:30.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.488+0000 7f51fea00640 1 -- 172.21.15.42:0/547576994 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f520000be50 con 0x7f520814eb00 2024-09-17T01:47:30.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.488+0000 7f5207e00640 1 -- 172.21.15.42:0/547576994 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f520815d9d0 con 0x7f520814eb00 2024-09-17T01:47:30.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.488+0000 7f51fea00640 1 -- 172.21.15.42:0/547576994 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52000106c0 con 0x7f520814eb00 2024-09-17T01:47:30.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.488+0000 7f5207e00640 1 -- 172.21.15.42:0/547576994 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f520814e800 con 0x7f520814eb00 2024-09-17T01:47:30.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.489+0000 7f5207e00640 1 -- 172.21.15.42:0/547576994 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52080b2570 con 0x7f520814eb00 2024-09-17T01:47:30.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.491+0000 7f51fea00640 1 -- 172.21.15.42:0/547576994 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f520001a070 con 0x7f520814eb00 2024-09-17T01:47:30.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.491+0000 7f51fea00640 1 --2- 172.21.15.42:0/547576994 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f51e4078bc0 0x7f51e407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:30.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.492+0000 7f51fea00640 1 -- 172.21.15.42:0/547576994 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 4943+0+0 (secure 0 0 0) 0x7f520009ad20 con 0x7f520814eb00 2024-09-17T01:47:30.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.492+0000 7f5206a00640 1 --2- 172.21.15.42:0/547576994 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f51e4078bc0 0x7f51e407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:30.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.493+0000 7f5206a00640 1 --2- 172.21.15.42:0/547576994 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f51e4078bc0 0x7f51e407b0d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f51f8007fd0 tx=0x7f51f8001370 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:30.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.496+0000 7f51fea00640 1 -- 172.21.15.42:0/547576994 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5200062e90 con 0x7f520814eb00 2024-09-17T01:47:30.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.729+0000 7f5207e00640 1 -- 172.21.15.42:0/547576994 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5208153480 con 0x7f520814eb00 2024-09-17T01:47:30.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.730+0000 7f51fea00640 1 -- 172.21.15.42:0/547576994 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 152 v152) ==== 95+0+3918 (secure 0 0 0) 0x7f52000678c0 con 0x7f520814eb00 2024-09-17T01:47:30.728 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:30.728 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":152,"btime":"2024-09-17T01:47:22:920605+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8549,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4165093647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4165093647},{"type":"v1","addr":"172.21.15.43:6836","nonce":4165093647}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145},{"gid":8774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2731951525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2731951525},{"type":"v1","addr":"172.21.15.43:6837","nonce":2731951525}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":152},{"gid":10353,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/4260984866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":4260984866},{"type":"v1","addr":"172.21.15.42:6834","nonce":4260984866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":144},{"gid":10356,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2804168804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":2804168804},{"type":"v1","addr":"172.21.15.42:6835","nonce":2804168804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":145}],"filesystems":[]} 2024-09-17T01:47:30.728 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 152 2024-09-17T01:47:30.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.732+0000 7f5207e00640 1 -- 172.21.15.42:0/547576994 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f51e4078bc0 msgr2=0x7f51e407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:30.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.732+0000 7f5207e00640 1 --2- 172.21.15.42:0/547576994 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f51e4078bc0 0x7f51e407b0d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f51f8007fd0 tx=0x7f51f8001370 comp rx=0 tx=0).stop 2024-09-17T01:47:30.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.732+0000 7f5207e00640 1 -- 172.21.15.42:0/547576994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f520814eb00 msgr2=0x7f520815f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:30.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.732+0000 7f5207e00640 1 --2- 172.21.15.42:0/547576994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f520814eb00 0x7f520815f520 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f520000d9e0 tx=0x7f520000dea0 comp rx=0 tx=0).stop 2024-09-17T01:47:30.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.732+0000 7f5207e00640 1 -- 172.21.15.42:0/547576994 shutdown_connections 2024-09-17T01:47:30.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.732+0000 7f5207e00640 1 --2- 172.21.15.42:0/547576994 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f51e4078bc0 0x7f51e407b0d0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:30.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.732+0000 7f5207e00640 1 --2- 172.21.15.42:0/547576994 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52080cd660 0x7f5208152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:30.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.732+0000 7f5207e00640 1 --2- 172.21.15.42:0/547576994 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f520814eb00 0x7f520815f520 unknown :-1 s=CLOSED pgs=2244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:30.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.732+0000 7f5207e00640 1 --2- 172.21.15.42:0/547576994 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52080750b0 0x7f520814e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:30.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.732+0000 7f5207e00640 1 -- 172.21.15.42:0/547576994 >> 172.21.15.42:0/547576994 conn(0x7f5208073510 msgr2=0x7f52081582c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:30.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.733+0000 7f5207e00640 1 -- 172.21.15.42:0/547576994 shutdown_connections 2024-09-17T01:47:30.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:30.733+0000 7f5207e00640 1 -- 172.21.15.42:0/547576994 wait complete. 2024-09-17T01:47:30.753 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T01:47:30.754 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T01:47:30.754 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T01:47:30.754 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:47:30.754 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T01:47:30.754 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T01:47:30.754 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T01:47:30.755 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:47:30.755 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T01:47:30.755 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T01:47:30.755 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T01:47:30.755 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:47:30.755 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T01:47:30.756 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T01:47:30.756 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T01:47:30.756 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:47:30.785 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T01:47:30.785 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T01:47:30.786 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T01:47:30.786 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T01:47:30.787 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T01:47:30.787 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T01:47:30.788 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T01:47:30.788 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T01:47:30.830 INFO:tasks.ceph.mds.c:Started 2024-09-17T01:47:30.830 DEBUG:teuthology.parallel:result is None 2024-09-17T01:47:30.833 INFO:tasks.ceph.mds.a:Started 2024-09-17T01:47:30.833 DEBUG:teuthology.parallel:result is None 2024-09-17T01:47:30.833 INFO:tasks.ceph.mds.b:Started 2024-09-17T01:47:30.834 DEBUG:teuthology.parallel:result is None 2024-09-17T01:47:30.834 INFO:tasks.ceph.mds.d:Started 2024-09-17T01:47:30.834 DEBUG:teuthology.parallel:result is None 2024-09-17T01:47:30.835 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T01:47:31.029 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:47:31.030 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:47:31.036 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-09-17T01:47:31.038 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-09-17T01:47:31.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.073+0000 7f09c1400640 1 -- 172.21.15.42:0/774048165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09bc0b30a0 msgr2=0x7f09bc0b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:31.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.073+0000 7f09c1400640 1 --2- 172.21.15.42:0/774048165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09bc0b30a0 0x7f09bc0b34b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f09b4005fd0 tx=0x7f09b402aa80 comp rx=0 tx=0).stop 2024-09-17T01:47:31.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.073+0000 7f09c1400640 1 -- 172.21.15.42:0/774048165 shutdown_connections 2024-09-17T01:47:31.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.073+0000 7f09c1400640 1 --2- 172.21.15.42:0/774048165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09bc0b30a0 0x7f09bc0b34b0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.073+0000 7f09c1400640 1 --2- 172.21.15.42:0/774048165 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f09bc0cf230 0x7f09bc0cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.073+0000 7f09c1400640 1 -- 172.21.15.42:0/774048165 >> 172.21.15.42:0/774048165 conn(0x7f09bc0b25f0 msgr2=0x7f09bc0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:31.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.073+0000 7f09c1400640 1 -- 172.21.15.42:0/774048165 shutdown_connections 2024-09-17T01:47:31.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.073+0000 7f09c1400640 1 -- 172.21.15.42:0/774048165 wait complete. 2024-09-17T01:47:31.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.075+0000 7f09c1400640 1 Processor -- start 2024-09-17T01:47:31.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.075+0000 7f09c1400640 1 -- start start 2024-09-17T01:47:31.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.077+0000 7f09c1400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09bc06cd20 0x7f09bc0c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:31.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.077+0000 7f09c1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09bc0b30a0 0x7f09bc14b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:31.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.077+0000 7f09c1400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f09bc0cf230 0x7f09bc14bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:31.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.077+0000 7f09c1400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc070470 con 0x7f09bc0b30a0 2024-09-17T01:47:31.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.077+0000 7f09c1400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc0702f0 con 0x7f09bc06cd20 2024-09-17T01:47:31.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.077+0000 7f09c1400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f09bc0b39f0 con 0x7f09bc0cf230 2024-09-17T01:47:31.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.077+0000 7f09bb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09bc0b30a0 0x7f09bc14b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:31.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.077+0000 7f09bb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09bc0b30a0 0x7f09bc14b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45688/0 (socket says 172.21.15.42:45688) 2024-09-17T01:47:31.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.077+0000 7f09bb400640 1 -- 172.21.15.42:0/2779714679 learned_addr learned my addr 172.21.15.42:0/2779714679 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:31.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.077+0000 7f09bbe00640 1 --2- 172.21.15.42:0/2779714679 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09bc06cd20 0x7f09bc0c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:31.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.077+0000 7f09c0a00640 1 --2- 172.21.15.42:0/2779714679 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f09bc0cf230 0x7f09bc14bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:31.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.078+0000 7f09bb400640 1 -- 172.21.15.42:0/2779714679 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f09bc0cf230 msgr2=0x7f09bc14bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:31.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.078+0000 7f09bb400640 1 --2- 172.21.15.42:0/2779714679 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f09bc0cf230 0x7f09bc14bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.078+0000 7f09bb400640 1 -- 172.21.15.42:0/2779714679 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09bc06cd20 msgr2=0x7f09bc0c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:31.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.078+0000 7f09bb400640 1 --2- 172.21.15.42:0/2779714679 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09bc06cd20 0x7f09bc0c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.078+0000 7f09bb400640 1 -- 172.21.15.42:0/2779714679 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09bc1f8d10 con 0x7f09bc0b30a0 2024-09-17T01:47:31.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.078+0000 7f09bb400640 1 --2- 172.21.15.42:0/2779714679 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09bc0b30a0 0x7f09bc14b760 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7f09a800e790 tx=0x7f09a800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:31.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.078+0000 7f09b3e00640 1 -- 172.21.15.42:0/2779714679 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a800eea0 con 0x7f09bc0b30a0 2024-09-17T01:47:31.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.078+0000 7f09b3e00640 1 -- 172.21.15.42:0/2779714679 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09a800cdb0 con 0x7f09bc0b30a0 2024-09-17T01:47:31.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.078+0000 7f09b3e00640 1 -- 172.21.15.42:0/2779714679 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a8010690 con 0x7f09bc0b30a0 2024-09-17T01:47:31.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.078+0000 7f09c1400640 1 -- 172.21.15.42:0/2779714679 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09bc1f9a90 con 0x7f09bc0b30a0 2024-09-17T01:47:31.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.078+0000 7f09c1400640 1 -- 172.21.15.42:0/2779714679 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09bc1f9290 con 0x7f09bc0b30a0 2024-09-17T01:47:31.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.080+0000 7f09c1400640 1 -- 172.21.15.42:0/2779714679 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09bc15cf30 con 0x7f09bc0b30a0 2024-09-17T01:47:31.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.081+0000 7f09b3e00640 1 -- 172.21.15.42:0/2779714679 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f09a8010830 con 0x7f09bc0b30a0 2024-09-17T01:47:31.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.082+0000 7f09b3e00640 1 --2- 172.21.15.42:0/2779714679 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f099c078bc0 0x7f099c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:31.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.082+0000 7f09b3e00640 1 -- 172.21.15.42:0/2779714679 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 4943+0+0 (secure 0 0 0) 0x7f09a809b3e0 con 0x7f09bc0b30a0 2024-09-17T01:47:31.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.082+0000 7f09bbe00640 1 --2- 172.21.15.42:0/2779714679 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f099c078bc0 0x7f099c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:31.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.083+0000 7f09bbe00640 1 --2- 172.21.15.42:0/2779714679 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f099c078bc0 0x7f099c07b0d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f09ac000f60 tx=0x7f09ac009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:31.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.086+0000 7f09b3e00640 1 -- 172.21.15.42:0/2779714679 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f09a80634c0 con 0x7f09bc0b30a0 2024-09-17T01:47:31.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.293+0000 7f09c1400640 1 -- 172.21.15.42:0/2779714679 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f09bc0b3f10 con 0x7f09bc0b30a0 2024-09-17T01:47:31.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.973+0000 7f09b3e00640 1 -- 172.21.15.42:0/2779714679 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v194) ==== 97+0+0 (secure 0 0 0) 0x7f09a8067ef0 con 0x7f09bc0b30a0 2024-09-17T01:47:31.971 INFO:teuthology.orchestra.run.smithi042.stderr: removed all blocklist entries 2024-09-17T01:47:31.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.977+0000 7f09c1400640 1 -- 172.21.15.42:0/2779714679 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f099c078bc0 msgr2=0x7f099c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:31.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.977+0000 7f09c1400640 1 --2- 172.21.15.42:0/2779714679 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f099c078bc0 0x7f099c07b0d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f09ac000f60 tx=0x7f09ac009040 comp rx=0 tx=0).stop 2024-09-17T01:47:31.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.977+0000 7f09c1400640 1 -- 172.21.15.42:0/2779714679 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09bc0b30a0 msgr2=0x7f09bc14b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:31.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.977+0000 7f09c1400640 1 --2- 172.21.15.42:0/2779714679 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09bc0b30a0 0x7f09bc14b760 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7f09a800e790 tx=0x7f09a800ec50 comp rx=0 tx=0).stop 2024-09-17T01:47:31.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.977+0000 7f09c1400640 1 -- 172.21.15.42:0/2779714679 shutdown_connections 2024-09-17T01:47:31.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.977+0000 7f09c1400640 1 --2- 172.21.15.42:0/2779714679 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f099c078bc0 0x7f099c07b0d0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.977+0000 7f09c1400640 1 --2- 172.21.15.42:0/2779714679 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f09bc0cf230 0x7f09bc14bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.977+0000 7f09c1400640 1 --2- 172.21.15.42:0/2779714679 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09bc0b30a0 0x7f09bc14b760 unknown :-1 s=CLOSED pgs=2251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.977+0000 7f09c1400640 1 --2- 172.21.15.42:0/2779714679 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09bc06cd20 0x7f09bc0c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.977+0000 7f09c1400640 1 -- 172.21.15.42:0/2779714679 >> 172.21.15.42:0/2779714679 conn(0x7f09bc0b25f0 msgr2=0x7f09bc075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:31.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.977+0000 7f09c1400640 1 -- 172.21.15.42:0/2779714679 shutdown_connections 2024-09-17T01:47:31.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:31.978+0000 7f09c1400640 1 -- 172.21.15.42:0/2779714679 wait complete. 2024-09-17T01:47:32.008 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T01:47:32.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.240+0000 7fbcda200640 1 -- 172.21.15.42:0/2837421905 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcd40d2d80 msgr2=0x7fbcd40b8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:32.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.240+0000 7fbcda200640 1 --2- 172.21.15.42:0/2837421905 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcd40d2d80 0x7fbcd40b8280 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7fbccc005fd0 tx=0x7fbccc02a8b0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.240+0000 7fbcda200640 1 -- 172.21.15.42:0/2837421905 shutdown_connections 2024-09-17T01:47:32.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.240+0000 7fbcda200640 1 --2- 172.21.15.42:0/2837421905 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcd40d2d80 0x7fbcd40b8280 unknown :-1 s=CLOSED pgs=2253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.240+0000 7fbcda200640 1 --2- 172.21.15.42:0/2837421905 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcd40d1a80 0x7fbcd40d2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.240+0000 7fbcda200640 1 -- 172.21.15.42:0/2837421905 >> 172.21.15.42:0/2837421905 conn(0x7fbcd406cf00 msgr2=0x7fbcd406d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:32.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.240+0000 7fbcda200640 1 -- 172.21.15.42:0/2837421905 shutdown_connections 2024-09-17T01:47:32.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.240+0000 7fbcda200640 1 -- 172.21.15.42:0/2837421905 wait complete. 2024-09-17T01:47:32.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.242+0000 7fbcda200640 1 Processor -- start 2024-09-17T01:47:32.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.242+0000 7fbcda200640 1 -- start start 2024-09-17T01:47:32.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.243+0000 7fbcda200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcd40d2d80 0x7fbcd41f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:32.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.244+0000 7fbcda200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcd415ea80 0x7fbcd415fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:32.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.244+0000 7fbcda200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcd40cc6d0 0x7fbcd4160130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:32.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.244+0000 7fbcda200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd40b8e20 con 0x7fbcd415ea80 2024-09-17T01:47:32.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.244+0000 7fbcda200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd40b8ca0 con 0x7fbcd40cc6d0 2024-09-17T01:47:32.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.244+0000 7fbcda200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbcd40b8fa0 con 0x7fbcd40d2d80 2024-09-17T01:47:32.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.244+0000 7fbcd3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcd415ea80 0x7fbcd415fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:32.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.244+0000 7fbcd3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcd415ea80 0x7fbcd415fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45702/0 (socket says 172.21.15.42:45702) 2024-09-17T01:47:32.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.244+0000 7fbcd3e00640 1 -- 172.21.15.42:0/851885570 learned_addr learned my addr 172.21.15.42:0/851885570 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:32.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.244+0000 7fbcd9800640 1 --2- 172.21.15.42:0/851885570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcd40cc6d0 0x7fbcd4160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:32.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.244+0000 7fbcd8e00640 1 --2- 172.21.15.42:0/851885570 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcd40d2d80 0x7fbcd41f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:32.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.244+0000 7fbcd3e00640 1 -- 172.21.15.42:0/851885570 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcd40d2d80 msgr2=0x7fbcd41f5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:32.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.244+0000 7fbcd3e00640 1 --2- 172.21.15.42:0/851885570 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcd40d2d80 0x7fbcd41f5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.244+0000 7fbcd3e00640 1 -- 172.21.15.42:0/851885570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcd40cc6d0 msgr2=0x7fbcd4160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:32.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.244+0000 7fbcd3e00640 1 --2- 172.21.15.42:0/851885570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcd40cc6d0 0x7fbcd4160130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.244+0000 7fbcd3e00640 1 -- 172.21.15.42:0/851885570 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd40ccc00 con 0x7fbcd415ea80 2024-09-17T01:47:32.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.245+0000 7fbcd3e00640 1 --2- 172.21.15.42:0/851885570 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcd415ea80 0x7fbcd415fbf0 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7fbcc000d680 tx=0x7fbcc000db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:32.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.245+0000 7fbcd0c00640 1 -- 172.21.15.42:0/851885570 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0017070 con 0x7fbcd415ea80 2024-09-17T01:47:32.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.245+0000 7fbcd0c00640 1 -- 172.21.15.42:0/851885570 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcc0009b10 con 0x7fbcd415ea80 2024-09-17T01:47:32.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.245+0000 7fbcda200640 1 -- 172.21.15.42:0/851885570 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd40ccee0 con 0x7fbcd415ea80 2024-09-17T01:47:32.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.245+0000 7fbcd0c00640 1 -- 172.21.15.42:0/851885570 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0010460 con 0x7fbcd415ea80 2024-09-17T01:47:32.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.245+0000 7fbcda200640 1 -- 172.21.15.42:0/851885570 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcd40cd4a0 con 0x7fbcd415ea80 2024-09-17T01:47:32.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.246+0000 7fbcda200640 1 -- 172.21.15.42:0/851885570 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcd40b9520 con 0x7fbcd415ea80 2024-09-17T01:47:32.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.247+0000 7fbcd0c00640 1 -- 172.21.15.42:0/851885570 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbcc001a070 con 0x7fbcd415ea80 2024-09-17T01:47:32.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.248+0000 7fbcd0c00640 1 --2- 172.21.15.42:0/851885570 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbcb4078b90 0x7fbcb407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:32.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.248+0000 7fbcd0c00640 1 -- 172.21.15.42:0/851885570 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 4857+0+0 (secure 0 0 0) 0x7fbcc009abd0 con 0x7fbcd415ea80 2024-09-17T01:47:32.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.249+0000 7fbcd8e00640 1 --2- 172.21.15.42:0/851885570 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbcb4078b90 0x7fbcb407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:32.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.250+0000 7fbcd8e00640 1 --2- 172.21.15.42:0/851885570 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbcb4078b90 0x7fbcb407b0a0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8000f60 tx=0x7fbcc8009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:32.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.253+0000 7fbcd0c00640 1 -- 172.21.15.42:0/851885570 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbcc0062c70 con 0x7fbcd415ea80 2024-09-17T01:47:32.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.519+0000 7fbcda200640 1 -- 172.21.15.42:0/851885570 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fbcd40b9bd0 con 0x7fbcd415ea80 2024-09-17T01:47:32.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.520+0000 7fbcd0c00640 1 -- 172.21.15.42:0/851885570 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v42) ==== 80+0+5304 (secure 0 0 0) 0x7fbcc00676a0 con 0x7fbcd415ea80 2024-09-17T01:47:32.518 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:32.518 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:47:32.518 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_dump": [ 2024-09-17T01:47:32.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:47:32.518 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.a", 2024-09-17T01:47:32.518 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmyJK4HRAAIC4E4V7p1fqIEfPIICMxZg==", 2024-09-17T01:47:32.518 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:47:32.519 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:47:32.519 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:47:32.519 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:47:32.519 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:47:32.519 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:32.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:47:32.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:47:32.519 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.b", 2024-09-17T01:47:32.519 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmXv3vORAALPrYIM6Vtz0g1pOxVhrUig==", 2024-09-17T01:47:32.519 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:47:32.519 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:47:32.519 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:47:32.519 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:47:32.520 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:47:32.520 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:32.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:47:32.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:47:32.520 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.c", 2024-09-17T01:47:32.520 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmPE7MKxAA9mGG+EO9C3VGVMerOm92+Q==", 2024-09-17T01:47:32.520 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:47:32.520 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:47:32.520 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:47:32.520 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:47:32.520 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:47:32.520 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:32.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:47:32.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:47:32.521 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.d", 2024-09-17T01:47:32.521 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmaOBSDBAATU4tpjM5IMcuvzZFE7N5bQ==", 2024-09-17T01:47:32.521 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:47:32.521 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:47:32.521 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:47:32.521 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:47:32.521 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:47:32.521 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:32.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:47:32.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:47:32.521 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.0", 2024-09-17T01:47:32.522 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDP2+hmEJebExAAAdGEoSzM96ybGT9h7t7OkA==", 2024-09-17T01:47:32.522 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:47:32.522 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:47:32.522 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:47:32.522 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:47:32.522 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:32.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:47:32.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:47:32.522 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.1", 2024-09-17T01:47:32.522 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDS2+hm7dWoMBAAagktrUl0O2/mgKCEfpAstA==", 2024-09-17T01:47:32.522 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:47:32.522 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:47:32.522 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:47:32.522 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:47:32.523 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:32.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:47:32.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:47:32.523 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.2", 2024-09-17T01:47:32.523 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDW2+hmEfSPBBAAPAa6EZt27yUcJSfZyCKheg==", 2024-09-17T01:47:32.523 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:47:32.523 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:47:32.523 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:47:32.523 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:47:32.523 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:32.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:47:32.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:47:32.523 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.3", 2024-09-17T01:47:32.524 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDZ2+hmHQhXFRAAj84g+IKqH6KMP7LjRtFvLw==", 2024-09-17T01:47:32.524 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:47:32.524 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:47:32.524 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:47:32.524 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:47:32.524 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:32.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:47:32.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:47:32.524 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.4", 2024-09-17T01:47:32.524 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDd2+hmaNcMNBAAx1GV/oFdfssMjFWFN5M0VQ==", 2024-09-17T01:47:32.524 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:47:32.524 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:47:32.524 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:47:32.525 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:47:32.525 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:32.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:47:32.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:47:32.525 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.5", 2024-09-17T01:47:32.525 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDh2+hm301NJhAAnSUH5AAvqhPwM7loH6frww==", 2024-09-17T01:47:32.525 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:47:32.525 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:47:32.525 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:47:32.525 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:47:32.525 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:32.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:47:32.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:47:32.526 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.6", 2024-09-17T01:47:32.526 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDk2+hm61WNNRAAbCvVvsUpB4fgt4ja60DRZA==", 2024-09-17T01:47:32.526 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:47:32.526 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:47:32.526 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:47:32.526 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:47:32.526 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:32.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:47:32.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:47:32.526 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.7", 2024-09-17T01:47:32.526 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDo2+hmesiLFhAA29n1eageNvP+lkRyh6gGMw==", 2024-09-17T01:47:32.526 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:47:32.526 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:47:32.527 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:47:32.527 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:47:32.527 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:32.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:47:32.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:47:32.527 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.0", 2024-09-17T01:47:32.527 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA==", 2024-09-17T01:47:32.527 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:47:32.527 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:47:32.527 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow r", 2024-09-17T01:47:32.527 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T01:47:32.527 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:32.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:47:32.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:47:32.528 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.1", 2024-09-17T01:47:32.528 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmZLygLhAABlauZgnidFWvfCCPuBLObg==", 2024-09-17T01:47:32.528 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:47:32.528 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:47:32.528 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:47:32.528 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:47:32.528 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:47:32.528 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:32.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:47:32.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:47:32.528 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.2", 2024-09-17T01:47:32.529 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hm8lnZIxAAN0a2CVMMtu/Nz50OG4a02A==", 2024-09-17T01:47:32.529 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:47:32.529 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:47:32.529 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:47:32.529 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:47:32.529 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:47:32.529 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:32.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:47:32.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:47:32.529 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.3", 2024-09-17T01:47:32.529 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmgXdAORAAM5Uy66I4nnTJ9Vhkn9JoBw==", 2024-09-17T01:47:32.529 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:47:32.529 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:47:32.530 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:47:32.530 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:47:32.530 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:47:32.530 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:32.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:47:32.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:47:32.530 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.admin", 2024-09-17T01:47:32.530 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDL2+hmvCreHBAA4CSAhosssViGqD93U+I7Iw==", 2024-09-17T01:47:32.530 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:47:32.530 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:47:32.530 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:47:32.530 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:47:32.530 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:47:32.531 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:32.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:47:32.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:47:32.531 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.x", 2024-09-17T01:47:32.531 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmYPnlEhAAIcQ11ktWZyMXYdbAONiLog==", 2024-09-17T01:47:32.531 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:47:32.531 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:47:32.531 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:47:32.531 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:47:32.531 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:32.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:47:32.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:47:32.531 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.y", 2024-09-17T01:47:32.532 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmpCZtBxAAp5tXMc6aEq1aOny2LJZAiA==", 2024-09-17T01:47:32.532 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:47:32.532 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:47:32.532 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:47:32.532 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:47:32.532 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:32.532 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:32.532 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-17T01:47:32.532 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:47:32.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.522+0000 7fbcda200640 1 -- 172.21.15.42:0/851885570 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbcb4078b90 msgr2=0x7fbcb407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:32.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.522+0000 7fbcda200640 1 --2- 172.21.15.42:0/851885570 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbcb4078b90 0x7fbcb407b0a0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8000f60 tx=0x7fbcc8009040 comp rx=0 tx=0).stop 2024-09-17T01:47:32.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.522+0000 7fbcda200640 1 -- 172.21.15.42:0/851885570 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcd415ea80 msgr2=0x7fbcd415fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:32.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.522+0000 7fbcda200640 1 --2- 172.21.15.42:0/851885570 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcd415ea80 0x7fbcd415fbf0 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7fbcc000d680 tx=0x7fbcc000db40 comp rx=0 tx=0).stop 2024-09-17T01:47:32.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.522+0000 7fbcda200640 1 -- 172.21.15.42:0/851885570 shutdown_connections 2024-09-17T01:47:32.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.522+0000 7fbcda200640 1 --2- 172.21.15.42:0/851885570 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbcb4078b90 0x7fbcb407b0a0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.522+0000 7fbcda200640 1 --2- 172.21.15.42:0/851885570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcd40cc6d0 0x7fbcd4160130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.522+0000 7fbcda200640 1 --2- 172.21.15.42:0/851885570 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcd415ea80 0x7fbcd415fbf0 unknown :-1 s=CLOSED pgs=2254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.522+0000 7fbcda200640 1 --2- 172.21.15.42:0/851885570 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcd40d2d80 0x7fbcd41f5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.522+0000 7fbcda200640 1 -- 172.21.15.42:0/851885570 >> 172.21.15.42:0/851885570 conn(0x7fbcd406cf00 msgr2=0x7fbcd415dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:32.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.522+0000 7fbcda200640 1 -- 172.21.15.42:0/851885570 shutdown_connections 2024-09-17T01:47:32.534 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.522+0000 7fbcda200640 1 -- 172.21.15.42:0/851885570 wait complete. 2024-09-17T01:47:32.543 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T01:47:32.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.773+0000 7f573b800640 1 -- 172.21.15.42:0/139665758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f571c004800 msgr2=0x7f571c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:32.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.773+0000 7f573b800640 1 --2- 172.21.15.42:0/139665758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f571c004800 0x7f571c004c10 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7f5734069d40 tx=0x7f571c005830 comp rx=0 tx=0).stop 2024-09-17T01:47:32.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.774+0000 7f573b800640 1 -- 172.21.15.42:0/139665758 shutdown_connections 2024-09-17T01:47:32.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.774+0000 7f573b800640 1 --2- 172.21.15.42:0/139665758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f571c004800 0x7f571c004c10 unknown :-1 s=CLOSED pgs=2256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.774+0000 7f573b800640 1 -- 172.21.15.42:0/139665758 >> 172.21.15.42:0/139665758 conn(0x7f57340746c0 msgr2=0x7f573406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:32.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.774+0000 7f573b800640 1 -- 172.21.15.42:0/139665758 shutdown_connections 2024-09-17T01:47:32.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.774+0000 7f573b800640 1 -- 172.21.15.42:0/139665758 wait complete. 2024-09-17T01:47:32.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.776+0000 7f573b800640 1 Processor -- start 2024-09-17T01:47:32.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.776+0000 7f573b800640 1 -- start start 2024-09-17T01:47:32.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.777+0000 7f573b800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f571c004800 0x7f57340ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:32.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.777+0000 7f573b800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f573413fbe0 0x7f5734150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:32.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.778+0000 7f573b800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f573413fff0 0x7f5734151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:32.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.778+0000 7f573b800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f573415ceb0 con 0x7f573413fbe0 2024-09-17T01:47:32.776 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.778+0000 7f573b800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f573415cd30 con 0x7f571c004800 2024-09-17T01:47:32.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.778+0000 7f573b800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f573415d030 con 0x7f573413fff0 2024-09-17T01:47:32.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.778+0000 7f5733e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f573413fbe0 0x7f5734150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:32.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.778+0000 7f5733e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f573413fbe0 0x7f5734150b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45706/0 (socket says 172.21.15.42:45706) 2024-09-17T01:47:32.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.778+0000 7f5733e00640 1 -- 172.21.15.42:0/2781371284 learned_addr learned my addr 172.21.15.42:0/2781371284 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:32.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.778+0000 7f5738e00640 1 --2- 172.21.15.42:0/2781371284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f571c004800 0x7f57340ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:32.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.778+0000 7f5739800640 1 --2- 172.21.15.42:0/2781371284 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f573413fff0 0x7f5734151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:32.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.778+0000 7f5733e00640 1 -- 172.21.15.42:0/2781371284 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f573413fff0 msgr2=0x7f5734151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:32.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.778+0000 7f5733e00640 1 --2- 172.21.15.42:0/2781371284 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f573413fff0 0x7f5734151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.778+0000 7f5733e00640 1 -- 172.21.15.42:0/2781371284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f571c004800 msgr2=0x7f57340ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:32.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.778+0000 7f5733e00640 1 --2- 172.21.15.42:0/2781371284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f571c004800 0x7f57340ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.778+0000 7f5733e00640 1 -- 172.21.15.42:0/2781371284 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57341f6e70 con 0x7f573413fbe0 2024-09-17T01:47:32.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.778+0000 7f5738e00640 1 --2- 172.21.15.42:0/2781371284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f571c004800 0x7f57340ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:47:32.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.778+0000 7f5739800640 1 --2- 172.21.15.42:0/2781371284 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f573413fff0 0x7f5734151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:47:32.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.779+0000 7f5733e00640 1 --2- 172.21.15.42:0/2781371284 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f573413fbe0 0x7f5734150b30 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7f572000c6d0 tx=0x7f5720006290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:32.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.779+0000 7f5730c00640 1 -- 172.21.15.42:0/2781371284 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5720001230 con 0x7f573413fbe0 2024-09-17T01:47:32.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.779+0000 7f5730c00640 1 -- 172.21.15.42:0/2781371284 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f572003a070 con 0x7f573413fbe0 2024-09-17T01:47:32.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.779+0000 7f5730c00640 1 -- 172.21.15.42:0/2781371284 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5720003960 con 0x7f573413fbe0 2024-09-17T01:47:32.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.779+0000 7f573b800640 1 -- 172.21.15.42:0/2781371284 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57341f7150 con 0x7f573413fbe0 2024-09-17T01:47:32.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.779+0000 7f573b800640 1 -- 172.21.15.42:0/2781371284 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57341f7710 con 0x7f573413fbe0 2024-09-17T01:47:32.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.780+0000 7f573b800640 1 -- 172.21.15.42:0/2781371284 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57340aed90 con 0x7f573413fbe0 2024-09-17T01:47:32.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.782+0000 7f5730c00640 1 -- 172.21.15.42:0/2781371284 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5720046020 con 0x7f573413fbe0 2024-09-17T01:47:32.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.782+0000 7f5730c00640 1 --2- 172.21.15.42:0/2781371284 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5714078bc0 0x7f571407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:32.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.783+0000 7f5730c00640 1 -- 172.21.15.42:0/2781371284 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 4857+0+0 (secure 0 0 0) 0x7f57200ba9f0 con 0x7f573413fbe0 2024-09-17T01:47:32.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.783+0000 7f5738e00640 1 --2- 172.21.15.42:0/2781371284 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5714078bc0 0x7f571407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:32.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.784+0000 7f5738e00640 1 --2- 172.21.15.42:0/2781371284 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5714078bc0 0x7f571407b0d0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f5734077840 tx=0x7f5728006ba0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:32.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.787+0000 7f5730c00640 1 -- 172.21.15.42:0/2781371284 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5734069690 con 0x7f573413fbe0 2024-09-17T01:47:32.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.985+0000 7f573b800640 1 -- 172.21.15.42:0/2781371284 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f57340b5060 con 0x7f573413fbe0 2024-09-17T01:47:32.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.985+0000 7f5730c00640 1 -- 172.21.15.42:0/2781371284 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v196) ==== 84+0+65 (secure 0 0 0) 0x7f5720083170 con 0x7f573413fbe0 2024-09-17T01:47:32.983 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:32.984 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-09-17T01:47:32.984 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:47:32.984 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-09-17T01:47:32.984 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-09-17T01:47:32.984 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:32.984 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-09-17T01:47:32.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.988+0000 7f573b800640 1 -- 172.21.15.42:0/2781371284 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5714078bc0 msgr2=0x7f571407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:32.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.988+0000 7f573b800640 1 --2- 172.21.15.42:0/2781371284 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5714078bc0 0x7f571407b0d0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f5734077840 tx=0x7f5728006ba0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.988+0000 7f573b800640 1 -- 172.21.15.42:0/2781371284 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f573413fbe0 msgr2=0x7f5734150b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:32.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.988+0000 7f573b800640 1 --2- 172.21.15.42:0/2781371284 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f573413fbe0 0x7f5734150b30 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7f572000c6d0 tx=0x7f5720006290 comp rx=0 tx=0).stop 2024-09-17T01:47:32.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.988+0000 7f573b800640 1 -- 172.21.15.42:0/2781371284 shutdown_connections 2024-09-17T01:47:32.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.988+0000 7f573b800640 1 --2- 172.21.15.42:0/2781371284 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5714078bc0 0x7f571407b0d0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.988+0000 7f573b800640 1 --2- 172.21.15.42:0/2781371284 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f573413fff0 0x7f5734151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.988+0000 7f573b800640 1 --2- 172.21.15.42:0/2781371284 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f573413fbe0 0x7f5734150b30 unknown :-1 s=CLOSED pgs=2257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.988+0000 7f573b800640 1 --2- 172.21.15.42:0/2781371284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f571c004800 0x7f57340ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.988+0000 7f573b800640 1 -- 172.21.15.42:0/2781371284 >> 172.21.15.42:0/2781371284 conn(0x7f57340746c0 msgr2=0x7f5734152060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:32.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.988+0000 7f573b800640 1 -- 172.21.15.42:0/2781371284 shutdown_connections 2024-09-17T01:47:32.987 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:32.988+0000 7f573b800640 1 -- 172.21.15.42:0/2781371284 wait complete. 2024-09-17T01:47:33.012 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T01:47:33.012 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T01:47:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.245+0000 7f1bbb200640 1 -- 172.21.15.42:0/3459272858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bbc0aebf0 msgr2=0x7f1bbc06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.245+0000 7f1bbb200640 1 --2- 172.21.15.42:0/3459272858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bbc0aebf0 0x7f1bbc06cd20 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc0719b0 tx=0x7f1ba802a530 comp rx=0 tx=0).stop 2024-09-17T01:47:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.245+0000 7f1bbb200640 1 -- 172.21.15.42:0/3459272858 shutdown_connections 2024-09-17T01:47:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.245+0000 7f1bbb200640 1 --2- 172.21.15.42:0/3459272858 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bbc0aebf0 0x7f1bbc06cd20 unknown :-1 s=CLOSED pgs=2259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.245+0000 7f1bbb200640 1 --2- 172.21.15.42:0/3459272858 >> v2:172.21.15.43:3300/0 conn(0x7f1bbc0af4f0 0x7f1bbc15d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.245+0000 7f1bbb200640 1 -- 172.21.15.42:0/3459272858 >> 172.21.15.42:0/3459272858 conn(0x7f1bbc0b25d0 msgr2=0x7f1bbc0d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.245+0000 7f1bbb200640 1 -- 172.21.15.42:0/3459272858 shutdown_connections 2024-09-17T01:47:33.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.245+0000 7f1bbb200640 1 -- 172.21.15.42:0/3459272858 wait complete. 2024-09-17T01:47:33.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.248+0000 7f1bbb200640 1 Processor -- start 2024-09-17T01:47:33.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.248+0000 7f1bbb200640 1 -- start start 2024-09-17T01:47:33.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.249+0000 7f1bbb200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bbc06d260 0x7f1bbc14c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:33.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.249+0000 7f1bbb200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bbc0aebf0 0x7f1bbc15b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:33.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.249+0000 7f1bbb200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bbc0af4f0 0x7f1bbc15bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:33.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.249+0000 7f1bbb200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1bbc160920 con 0x7f1bbc0af4f0 2024-09-17T01:47:33.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.249+0000 7f1bbb200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1bbc0cca50 con 0x7f1bbc0aebf0 2024-09-17T01:47:33.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.249+0000 7f1bbb200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1bbc160aa0 con 0x7f1bbc06d260 2024-09-17T01:47:33.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.249+0000 7f1bba800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bbc0af4f0 0x7f1bbc15bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:33.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.250+0000 7f1bba800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bbc0af4f0 0x7f1bbc15bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45720/0 (socket says 172.21.15.42:45720) 2024-09-17T01:47:33.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.250+0000 7f1bba800640 1 -- 172.21.15.42:0/253327666 learned_addr learned my addr 172.21.15.42:0/253327666 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:33.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.250+0000 7f1bb9e00640 1 --2- 172.21.15.42:0/253327666 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bbc06d260 0x7f1bbc14c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:33.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.250+0000 7f1bb9400640 1 --2- 172.21.15.42:0/253327666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bbc0aebf0 0x7f1bbc15b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:33.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.250+0000 7f1bba800640 1 -- 172.21.15.42:0/253327666 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bbc06d260 msgr2=0x7f1bbc14c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:33.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.250+0000 7f1bba800640 1 --2- 172.21.15.42:0/253327666 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bbc06d260 0x7f1bbc14c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:33.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.250+0000 7f1bba800640 1 -- 172.21.15.42:0/253327666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bbc0aebf0 msgr2=0x7f1bbc15b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:33.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.250+0000 7f1bba800640 1 --2- 172.21.15.42:0/253327666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bbc0aebf0 0x7f1bbc15b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:33.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.250+0000 7f1bba800640 1 -- 172.21.15.42:0/253327666 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bbc14ccf0 con 0x7f1bbc0af4f0 2024-09-17T01:47:33.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.250+0000 7f1bb9e00640 1 --2- 172.21.15.42:0/253327666 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bbc06d260 0x7f1bbc14c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:47:33.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.250+0000 7f1bb9400640 1 --2- 172.21.15.42:0/253327666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bbc0aebf0 0x7f1bbc15b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:47:33.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.250+0000 7f1bba800640 1 --2- 172.21.15.42:0/253327666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bbc0af4f0 0x7f1bbc15bba0 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400c6f0 tx=0x7f1bb400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:33.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.250+0000 7f1bb2000640 1 -- 172.21.15.42:0/253327666 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4017070 con 0x7f1bbc0af4f0 2024-09-17T01:47:33.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.251+0000 7f1bb2000640 1 -- 172.21.15.42:0/253327666 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bb4003c90 con 0x7f1bbc0af4f0 2024-09-17T01:47:33.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.251+0000 7f1bb2000640 1 -- 172.21.15.42:0/253327666 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4003e60 con 0x7f1bbc0af4f0 2024-09-17T01:47:33.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.251+0000 7f1bbb200640 1 -- 172.21.15.42:0/253327666 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bbc1f8f60 con 0x7f1bbc0af4f0 2024-09-17T01:47:33.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.251+0000 7f1bbb200640 1 -- 172.21.15.42:0/253327666 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bbc1f9520 con 0x7f1bbc0af4f0 2024-09-17T01:47:33.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.252+0000 7f1bbb200640 1 -- 172.21.15.42:0/253327666 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bbc074d90 con 0x7f1bbc0af4f0 2024-09-17T01:47:33.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.253+0000 7f1bb2000640 1 -- 172.21.15.42:0/253327666 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1bb401a070 con 0x7f1bbc0af4f0 2024-09-17T01:47:33.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.254+0000 7f1bb2000640 1 --2- 172.21.15.42:0/253327666 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b9c078b90 0x7f1b9c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:33.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.255+0000 7f1bb2000640 1 -- 172.21.15.42:0/253327666 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 4857+0+0 (secure 0 0 0) 0x7f1bb409a0c0 con 0x7f1bbc0af4f0 2024-09-17T01:47:33.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.255+0000 7f1bb9e00640 1 --2- 172.21.15.42:0/253327666 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b9c078b90 0x7f1b9c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:33.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.256+0000 7f1bb9e00640 1 --2- 172.21.15.42:0/253327666 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b9c078b90 0x7f1b9c07b0a0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc0b4ff0 tx=0x7f1bac005dd0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:33.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.259+0000 7f1bb2000640 1 -- 172.21.15.42:0/253327666 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1bbc06d670 con 0x7f1bbc0af4f0 2024-09-17T01:47:33.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.455+0000 7f1bbb200640 1 -- 172.21.15.42:0/253327666 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1bbc160fc0 con 0x7f1bbc0af4f0 2024-09-17T01:47:33.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.977+0000 7f1bb2000640 1 -- 172.21.15.42:0/253327666 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v197) ==== 138+0+0 (secure 0 0 0) 0x7f1bb40627b0 con 0x7f1bbc0af4f0 2024-09-17T01:47:33.975 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-09-17T01:47:33.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.980+0000 7f1bbb200640 1 -- 172.21.15.42:0/253327666 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b9c078b90 msgr2=0x7f1b9c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:33.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.981+0000 7f1bbb200640 1 --2- 172.21.15.42:0/253327666 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b9c078b90 0x7f1b9c07b0a0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc0b4ff0 tx=0x7f1bac005dd0 comp rx=0 tx=0).stop 2024-09-17T01:47:33.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.981+0000 7f1bbb200640 1 -- 172.21.15.42:0/253327666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bbc0af4f0 msgr2=0x7f1bbc15bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:33.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.981+0000 7f1bbb200640 1 --2- 172.21.15.42:0/253327666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bbc0af4f0 0x7f1bbc15bba0 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400c6f0 tx=0x7f1bb400cbb0 comp rx=0 tx=0).stop 2024-09-17T01:47:33.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.981+0000 7f1bbb200640 1 -- 172.21.15.42:0/253327666 shutdown_connections 2024-09-17T01:47:33.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.981+0000 7f1bbb200640 1 --2- 172.21.15.42:0/253327666 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1b9c078b90 0x7f1b9c07b0a0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:33.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.981+0000 7f1bbb200640 1 --2- 172.21.15.42:0/253327666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bbc0aebf0 0x7f1bbc15b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:33.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.981+0000 7f1bbb200640 1 --2- 172.21.15.42:0/253327666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bbc0af4f0 0x7f1bbc15bba0 unknown :-1 s=CLOSED pgs=2260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:33.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.981+0000 7f1bbb200640 1 --2- 172.21.15.42:0/253327666 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bbc06d260 0x7f1bbc14c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:33.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.981+0000 7f1bbb200640 1 -- 172.21.15.42:0/253327666 >> 172.21.15.42:0/253327666 conn(0x7f1bbc0b25d0 msgr2=0x7f1bbc0afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:33.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.981+0000 7f1bbb200640 1 -- 172.21.15.42:0/253327666 shutdown_connections 2024-09-17T01:47:33.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:33.981+0000 7f1bbb200640 1 -- 172.21.15.42:0/253327666 wait complete. 2024-09-17T01:47:34.007 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T01:47:34.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.246+0000 7f44fe600640 1 -- 172.21.15.42:0/3000912111 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44f815cec0 msgr2=0x7f44f815d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:34.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.246+0000 7f44fe600640 1 --2- 172.21.15.42:0/3000912111 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44f815cec0 0x7f44f815d2d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f44e8005fd0 tx=0x7f44e802a5d0 comp rx=0 tx=0).stop 2024-09-17T01:47:34.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.246+0000 7f44fe600640 1 -- 172.21.15.42:0/3000912111 shutdown_connections 2024-09-17T01:47:34.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.246+0000 7f44fe600640 1 --2- 172.21.15.42:0/3000912111 >> v2:172.21.15.43:3300/0 conn(0x7f44f80cf0c0 0x7f44f806d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:34.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.246+0000 7f44fe600640 1 --2- 172.21.15.42:0/3000912111 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44f815cec0 0x7f44f815d2d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:34.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.246+0000 7f44fe600640 1 -- 172.21.15.42:0/3000912111 >> 172.21.15.42:0/3000912111 conn(0x7f44f80b2930 msgr2=0x7f44f806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:34.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.246+0000 7f44fe600640 1 -- 172.21.15.42:0/3000912111 shutdown_connections 2024-09-17T01:47:34.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.246+0000 7f44fe600640 1 -- 172.21.15.42:0/3000912111 wait complete. 2024-09-17T01:47:34.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.248+0000 7f44fe600640 1 Processor -- start 2024-09-17T01:47:34.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.249+0000 7f44fe600640 1 -- start start 2024-09-17T01:47:34.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.250+0000 7f44fe600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f80cecb0 0x7f44f8150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:34.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.250+0000 7f44fe600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44f80cf0c0 0x7f44f81541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:34.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.250+0000 7f44fe600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44f815cec0 0x7f44f80ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:34.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.250+0000 7f44fe600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f44f8074130 con 0x7f44f80cecb0 2024-09-17T01:47:34.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.250+0000 7f44fe600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f44f8073fb0 con 0x7f44f80cf0c0 2024-09-17T01:47:34.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.250+0000 7f44fe600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f44f806d970 con 0x7f44f815cec0 2024-09-17T01:47:34.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.250+0000 7f44f7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f80cecb0 0x7f44f8150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:34.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.250+0000 7f44f7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f80cecb0 0x7f44f8150ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45726/0 (socket says 172.21.15.42:45726) 2024-09-17T01:47:34.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.250+0000 7f44f7400640 1 -- 172.21.15.42:0/3052534543 learned_addr learned my addr 172.21.15.42:0/3052534543 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:34.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.251+0000 7f44efe00640 1 --2- 172.21.15.42:0/3052534543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44f80cf0c0 0x7f44f81541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:34.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.251+0000 7f44f7e00640 1 --2- 172.21.15.42:0/3052534543 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44f815cec0 0x7f44f80ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:34.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.251+0000 7f44f7400640 1 -- 172.21.15.42:0/3052534543 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44f815cec0 msgr2=0x7f44f80ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:34.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.251+0000 7f44f7400640 1 --2- 172.21.15.42:0/3052534543 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44f815cec0 0x7f44f80ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:34.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.251+0000 7f44f7400640 1 -- 172.21.15.42:0/3052534543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44f80cf0c0 msgr2=0x7f44f81541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:34.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.251+0000 7f44f7400640 1 --2- 172.21.15.42:0/3052534543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44f80cf0c0 0x7f44f81541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:34.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.251+0000 7f44f7400640 1 -- 172.21.15.42:0/3052534543 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f806e1c0 con 0x7f44f80cecb0 2024-09-17T01:47:34.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.251+0000 7f44efe00640 1 --2- 172.21.15.42:0/3052534543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44f80cf0c0 0x7f44f81541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:47:34.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.251+0000 7f44f7400640 1 --2- 172.21.15.42:0/3052534543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f80cecb0 0x7f44f8150ab0 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7f44e8006010 tx=0x7f44e80035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:34.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.252+0000 7f44ef400640 1 -- 172.21.15.42:0/3052534543 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e803e030 con 0x7f44f80cecb0 2024-09-17T01:47:34.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.252+0000 7f44ef400640 1 -- 172.21.15.42:0/3052534543 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44e8003ae0 con 0x7f44f80cecb0 2024-09-17T01:47:34.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.252+0000 7f44ef400640 1 -- 172.21.15.42:0/3052534543 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8035040 con 0x7f44f80cecb0 2024-09-17T01:47:34.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.252+0000 7f44fe600640 1 -- 172.21.15.42:0/3052534543 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f8153670 con 0x7f44f80cecb0 2024-09-17T01:47:34.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.252+0000 7f44fe600640 1 -- 172.21.15.42:0/3052534543 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f806e480 con 0x7f44f80cecb0 2024-09-17T01:47:34.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.253+0000 7f44fe600640 1 -- 172.21.15.42:0/3052534543 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f806d430 con 0x7f44f80cecb0 2024-09-17T01:47:34.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.254+0000 7f44ef400640 1 -- 172.21.15.42:0/3052534543 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f44e8041030 con 0x7f44f80cecb0 2024-09-17T01:47:34.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.255+0000 7f44ef400640 1 --2- 172.21.15.42:0/3052534543 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f44d4078b90 0x7f44d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:34.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.255+0000 7f44ef400640 1 -- 172.21.15.42:0/3052534543 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(197..197 src has 1..197) ==== 5227+0+0 (secure 0 0 0) 0x7f44e80bb070 con 0x7f44f80cecb0 2024-09-17T01:47:34.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.255+0000 7f44efe00640 1 --2- 172.21.15.42:0/3052534543 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f44d4078b90 0x7f44d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:34.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.256+0000 7f44efe00640 1 --2- 172.21.15.42:0/3052534543 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f44d4078b90 0x7f44d407b0a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f44f815c980 tx=0x7f44e0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:34.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.260+0000 7f44ef400640 1 -- 172.21.15.42:0/3052534543 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f44e8083680 con 0x7f44f80cecb0 2024-09-17T01:47:34.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.455+0000 7f44fe600640 1 -- 172.21.15.42:0/3052534543 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f44f806a170 con 0x7f44f80cecb0 2024-09-17T01:47:34.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.980+0000 7f44ef400640 1 -- 172.21.15.42:0/3052534543 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v198) ==== 170+0+0 (secure 0 0 0) 0x7f44e8082f80 con 0x7f44f80cecb0 2024-09-17T01:47:34.978 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-09-17T01:47:34.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.983+0000 7f44fe600640 1 -- 172.21.15.42:0/3052534543 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f44d4078b90 msgr2=0x7f44d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:34.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.983+0000 7f44fe600640 1 --2- 172.21.15.42:0/3052534543 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f44d4078b90 0x7f44d407b0a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f44f815c980 tx=0x7f44e0009040 comp rx=0 tx=0).stop 2024-09-17T01:47:34.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.983+0000 7f44fe600640 1 -- 172.21.15.42:0/3052534543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f80cecb0 msgr2=0x7f44f8150ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:34.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.983+0000 7f44fe600640 1 --2- 172.21.15.42:0/3052534543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f80cecb0 0x7f44f8150ab0 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7f44e8006010 tx=0x7f44e80035f0 comp rx=0 tx=0).stop 2024-09-17T01:47:34.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.983+0000 7f44fe600640 1 -- 172.21.15.42:0/3052534543 shutdown_connections 2024-09-17T01:47:34.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.983+0000 7f44fe600640 1 --2- 172.21.15.42:0/3052534543 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f44d4078b90 0x7f44d407b0a0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:34.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.983+0000 7f44fe600640 1 --2- 172.21.15.42:0/3052534543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44f80cf0c0 0x7f44f81541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:34.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.983+0000 7f44fe600640 1 --2- 172.21.15.42:0/3052534543 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44f815cec0 0x7f44f80ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:34.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.983+0000 7f44fe600640 1 --2- 172.21.15.42:0/3052534543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f80cecb0 0x7f44f8150ab0 unknown :-1 s=CLOSED pgs=2261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:34.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.983+0000 7f44fe600640 1 -- 172.21.15.42:0/3052534543 >> 172.21.15.42:0/3052534543 conn(0x7f44f80b2930 msgr2=0x7f44f80b1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:34.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.983+0000 7f44fe600640 1 -- 172.21.15.42:0/3052534543 shutdown_connections 2024-09-17T01:47:34.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:34.983+0000 7f44fe600640 1 -- 172.21.15.42:0/3052534543 wait complete. 2024-09-17T01:47:35.026 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T01:47:35.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.260+0000 7f2f94400640 1 -- 172.21.15.42:0/667620255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f8c0d02b0 msgr2=0x7f2f8c0cd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:35.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.260+0000 7f2f94400640 1 --2- 172.21.15.42:0/667620255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f8c0d02b0 0x7f2f8c0cd9f0 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c071830 tx=0x7f2f7802a520 comp rx=0 tx=0).stop 2024-09-17T01:47:35.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.261+0000 7f2f94400640 1 -- 172.21.15.42:0/667620255 shutdown_connections 2024-09-17T01:47:35.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.261+0000 7f2f94400640 1 --2- 172.21.15.42:0/667620255 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f8c0cdf30 0x7f2f8c15ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:35.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.261+0000 7f2f94400640 1 --2- 172.21.15.42:0/667620255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f8c0d02b0 0x7f2f8c0cd9f0 unknown :-1 s=CLOSED pgs=2262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:35.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.261+0000 7f2f94400640 1 -- 172.21.15.42:0/667620255 >> 172.21.15.42:0/667620255 conn(0x7f2f8c06d350 msgr2=0x7f2f8c0b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:35.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.261+0000 7f2f94400640 1 -- 172.21.15.42:0/667620255 shutdown_connections 2024-09-17T01:47:35.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.261+0000 7f2f94400640 1 -- 172.21.15.42:0/667620255 wait complete. 2024-09-17T01:47:35.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.263+0000 7f2f94400640 1 Processor -- start 2024-09-17T01:47:35.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.263+0000 7f2f94400640 1 -- start start 2024-09-17T01:47:35.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.265+0000 7f2f94400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f8c0cdf30 0x7f2f8c15ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:35.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.265+0000 7f2f94400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f8c0d02b0 0x7f2f8c1569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:35.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.265+0000 7f2f94400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f8c1462b0 0x7f2f8c13a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:35.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.265+0000 7f2f94400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8c15d730 con 0x7f2f8c0d02b0 2024-09-17T01:47:35.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.265+0000 7f2f94400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8c15d5b0 con 0x7f2f8c0cdf30 2024-09-17T01:47:35.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.265+0000 7f2f94400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2f8c15d8b0 con 0x7f2f8c1462b0 2024-09-17T01:47:35.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.265+0000 7f2f91000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f8c0d02b0 0x7f2f8c1569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:35.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.265+0000 7f2f91000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f8c0d02b0 0x7f2f8c1569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45748/0 (socket says 172.21.15.42:45748) 2024-09-17T01:47:35.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.265+0000 7f2f91000640 1 -- 172.21.15.42:0/225869393 learned_addr learned my addr 172.21.15.42:0/225869393 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:35.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.265+0000 7f2f91a00640 1 --2- 172.21.15.42:0/225869393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f8c0cdf30 0x7f2f8c15ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:35.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.265+0000 7f2f92400640 1 --2- 172.21.15.42:0/225869393 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f8c1462b0 0x7f2f8c13a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:35.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.265+0000 7f2f91000640 1 -- 172.21.15.42:0/225869393 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f8c1462b0 msgr2=0x7f2f8c13a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:35.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.265+0000 7f2f91000640 1 --2- 172.21.15.42:0/225869393 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f8c1462b0 0x7f2f8c13a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:35.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.265+0000 7f2f91000640 1 -- 172.21.15.42:0/225869393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f8c0cdf30 msgr2=0x7f2f8c15ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:35.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.265+0000 7f2f91000640 1 --2- 172.21.15.42:0/225869393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f8c0cdf30 0x7f2f8c15ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:35.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.265+0000 7f2f91000640 1 -- 172.21.15.42:0/225869393 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f8c1551c0 con 0x7f2f8c0d02b0 2024-09-17T01:47:35.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.265+0000 7f2f92400640 1 --2- 172.21.15.42:0/225869393 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f8c1462b0 0x7f2f8c13a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:47:35.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.266+0000 7f2f91000640 1 --2- 172.21.15.42:0/225869393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f8c0d02b0 0x7f2f8c1569a0 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7f2f780099c0 tx=0x7f2f78004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:35.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.266+0000 7f2f89600640 1 -- 172.21.15.42:0/225869393 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7803e030 con 0x7f2f8c0d02b0 2024-09-17T01:47:35.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.266+0000 7f2f89600640 1 -- 172.21.15.42:0/225869393 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f780035f0 con 0x7f2f8c0d02b0 2024-09-17T01:47:35.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.266+0000 7f2f94400640 1 -- 172.21.15.42:0/225869393 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f8c141b90 con 0x7f2f8c0d02b0 2024-09-17T01:47:35.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.266+0000 7f2f89600640 1 -- 172.21.15.42:0/225869393 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f78035040 con 0x7f2f8c0d02b0 2024-09-17T01:47:35.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.266+0000 7f2f94400640 1 -- 172.21.15.42:0/225869393 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f8c142150 con 0x7f2f8c0d02b0 2024-09-17T01:47:35.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.267+0000 7f2f94400640 1 -- 172.21.15.42:0/225869393 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f8c15ce60 con 0x7f2f8c0d02b0 2024-09-17T01:47:35.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.269+0000 7f2f89600640 1 -- 172.21.15.42:0/225869393 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2f78041030 con 0x7f2f8c0d02b0 2024-09-17T01:47:35.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.271+0000 7f2f89600640 1 --2- 172.21.15.42:0/225869393 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f6c078bc0 0x7f2f6c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:35.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.271+0000 7f2f89600640 1 -- 172.21.15.42:0/225869393 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(198..198 src has 1..198) ==== 5609+0+0 (secure 0 0 0) 0x7f2f780bb980 con 0x7f2f8c0d02b0 2024-09-17T01:47:35.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.271+0000 7f2f91a00640 1 --2- 172.21.15.42:0/225869393 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f6c078bc0 0x7f2f6c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:35.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.272+0000 7f2f91a00640 1 --2- 172.21.15.42:0/225869393 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f6c078bc0 0x7f2f6c07b0d0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f2f80006fd0 tx=0x7f2f80009060 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:35.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.275+0000 7f2f89600640 1 -- 172.21.15.42:0/225869393 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2f8c1551c0 con 0x7f2f8c0d02b0 2024-09-17T01:47:35.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:35.509+0000 7f2f94400640 1 -- 172.21.15.42:0/225869393 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2f8c06f1d0 con 0x7f2f8c0d02b0 2024-09-17T01:47:36.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.005+0000 7f2f89600640 1 -- 172.21.15.42:0/225869393 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 28 and data pool 29 v155) ==== 174+0+0 (secure 0 0 0) 0x7f2f780837b0 con 0x7f2f8c0d02b0 2024-09-17T01:47:36.003 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 28 and data pool 29 2024-09-17T01:47:36.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.017+0000 7f2f94400640 1 -- 172.21.15.42:0/225869393 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f6c078bc0 msgr2=0x7f2f6c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:36.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.017+0000 7f2f94400640 1 --2- 172.21.15.42:0/225869393 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f6c078bc0 0x7f2f6c07b0d0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f2f80006fd0 tx=0x7f2f80009060 comp rx=0 tx=0).stop 2024-09-17T01:47:36.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.017+0000 7f2f94400640 1 -- 172.21.15.42:0/225869393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f8c0d02b0 msgr2=0x7f2f8c1569a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:36.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.017+0000 7f2f94400640 1 --2- 172.21.15.42:0/225869393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f8c0d02b0 0x7f2f8c1569a0 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7f2f780099c0 tx=0x7f2f78004c80 comp rx=0 tx=0).stop 2024-09-17T01:47:36.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.017+0000 7f2f94400640 1 -- 172.21.15.42:0/225869393 shutdown_connections 2024-09-17T01:47:36.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.017+0000 7f2f94400640 1 --2- 172.21.15.42:0/225869393 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f6c078bc0 0x7f2f6c07b0d0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:36.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.017+0000 7f2f94400640 1 --2- 172.21.15.42:0/225869393 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f8c1462b0 0x7f2f8c13a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:36.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.017+0000 7f2f94400640 1 --2- 172.21.15.42:0/225869393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f8c0d02b0 0x7f2f8c1569a0 unknown :-1 s=CLOSED pgs=2263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:36.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.017+0000 7f2f94400640 1 --2- 172.21.15.42:0/225869393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f8c0cdf30 0x7f2f8c15ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:36.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.017+0000 7f2f94400640 1 -- 172.21.15.42:0/225869393 >> 172.21.15.42:0/225869393 conn(0x7f2f8c06d350 msgr2=0x7f2f8c06f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:36.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.018+0000 7f2f94400640 1 -- 172.21.15.42:0/225869393 shutdown_connections 2024-09-17T01:47:36.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.018+0000 7f2f94400640 1 -- 172.21.15.42:0/225869393 wait complete. 2024-09-17T01:47:36.055 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:47:36.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.285+0000 7f0c46a00640 1 -- 172.21.15.42:0/3048631468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c400cf230 msgr2=0x7f0c400cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:36.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.285+0000 7f0c46a00640 1 --2- 172.21.15.42:0/3048631468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c400cf230 0x7f0c400cf640 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c005fd0 tx=0x7f0c2c02a5c0 comp rx=0 tx=0).stop 2024-09-17T01:47:36.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.285+0000 7f0c46a00640 1 -- 172.21.15.42:0/3048631468 shutdown_connections 2024-09-17T01:47:36.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.285+0000 7f0c46a00640 1 --2- 172.21.15.42:0/3048631468 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0c400b30a0 0x7f0c400b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:36.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.285+0000 7f0c46a00640 1 --2- 172.21.15.42:0/3048631468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c400cf230 0x7f0c400cf640 unknown :-1 s=CLOSED pgs=2264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:36.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.285+0000 7f0c46a00640 1 -- 172.21.15.42:0/3048631468 >> 172.21.15.42:0/3048631468 conn(0x7f0c400b25f0 msgr2=0x7f0c400d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:36.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.286+0000 7f0c46a00640 1 -- 172.21.15.42:0/3048631468 shutdown_connections 2024-09-17T01:47:36.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.286+0000 7f0c46a00640 1 -- 172.21.15.42:0/3048631468 wait complete. 2024-09-17T01:47:36.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.288+0000 7f0c46a00640 1 Processor -- start 2024-09-17T01:47:36.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.288+0000 7f0c46a00640 1 -- start start 2024-09-17T01:47:36.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.289+0000 7f0c46a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c4006cd20 0x7f0c40155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:36.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.289+0000 7f0c46a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0c400b30a0 0x7f0c401532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:36.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.289+0000 7f0c46a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c400cf230 0x7f0c4015d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:36.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.289+0000 7f0c46a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0c40070470 con 0x7f0c400cf230 2024-09-17T01:47:36.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.289+0000 7f0c46a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0c400702f0 con 0x7f0c4006cd20 2024-09-17T01:47:36.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.289+0000 7f0c46a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0c400b39f0 con 0x7f0c400b30a0 2024-09-17T01:47:36.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.290+0000 7f0c46000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c400cf230 0x7f0c4015d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:36.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.290+0000 7f0c46000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c400cf230 0x7f0c4015d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52278/0 (socket says 172.21.15.42:52278) 2024-09-17T01:47:36.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.290+0000 7f0c46000640 1 -- 172.21.15.42:0/1309183005 learned_addr learned my addr 172.21.15.42:0/1309183005 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:36.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.290+0000 7f0c44c00640 1 --2- 172.21.15.42:0/1309183005 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0c400b30a0 0x7f0c401532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:36.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.290+0000 7f0c45600640 1 --2- 172.21.15.42:0/1309183005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c4006cd20 0x7f0c40155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:36.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.290+0000 7f0c46000640 1 -- 172.21.15.42:0/1309183005 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0c400b30a0 msgr2=0x7f0c401532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:36.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.290+0000 7f0c46000640 1 --2- 172.21.15.42:0/1309183005 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0c400b30a0 0x7f0c401532f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:36.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.290+0000 7f0c46000640 1 -- 172.21.15.42:0/1309183005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c4006cd20 msgr2=0x7f0c40155330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:36.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.290+0000 7f0c46000640 1 --2- 172.21.15.42:0/1309183005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c4006cd20 0x7f0c40155330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:36.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.290+0000 7f0c46000640 1 -- 172.21.15.42:0/1309183005 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c40142950 con 0x7f0c400cf230 2024-09-17T01:47:36.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.291+0000 7f0c46000640 1 --2- 172.21.15.42:0/1309183005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c400cf230 0x7f0c4015d9c0 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7f0c3800e960 tx=0x7f0c3800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:36.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.291+0000 7f0c3d600640 1 -- 172.21.15.42:0/1309183005 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c38004d20 con 0x7f0c400cf230 2024-09-17T01:47:36.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.291+0000 7f0c3d600640 1 -- 172.21.15.42:0/1309183005 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c3800cac0 con 0x7f0c400cf230 2024-09-17T01:47:36.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.291+0000 7f0c46a00640 1 -- 172.21.15.42:0/1309183005 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c40142c30 con 0x7f0c400cf230 2024-09-17T01:47:36.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.291+0000 7f0c3d600640 1 -- 172.21.15.42:0/1309183005 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c38005020 con 0x7f0c400cf230 2024-09-17T01:47:36.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.291+0000 7f0c46a00640 1 -- 172.21.15.42:0/1309183005 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c401431f0 con 0x7f0c400cf230 2024-09-17T01:47:36.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.292+0000 7f0c46a00640 1 -- 172.21.15.42:0/1309183005 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c40143630 con 0x7f0c400cf230 2024-09-17T01:47:36.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.293+0000 7f0c3d600640 1 -- 172.21.15.42:0/1309183005 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0c380051c0 con 0x7f0c400cf230 2024-09-17T01:47:36.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.294+0000 7f0c3d600640 1 --2- 172.21.15.42:0/1309183005 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0c20078b90 0x7f0c2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:36.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.294+0000 7f0c3d600640 1 -- 172.21.15.42:0/1309183005 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7f0c3809b530 con 0x7f0c400cf230 2024-09-17T01:47:36.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.295+0000 7f0c45600640 1 --2- 172.21.15.42:0/1309183005 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0c20078b90 0x7f0c2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:36.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.296+0000 7f0c45600640 1 --2- 172.21.15.42:0/1309183005 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0c20078b90 0x7f0c2007b0a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f0c34001720 tx=0x7f0c34009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:36.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.299+0000 7f0c3d600640 1 -- 172.21.15.42:0/1309183005 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0c38016030 con 0x7f0c400cf230 2024-09-17T01:47:36.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.497+0000 7f0c46a00640 1 -- 172.21.15.42:0/1309183005 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c400b3f40 con 0x7f0c400cf230 2024-09-17T01:47:36.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.499+0000 7f0c3d600640 1 -- 172.21.15.42:0/1309183005 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v199) ==== 74+0+16708 (secure 0 0 0) 0x7f0c38063310 con 0x7f0c400cf230 2024-09-17T01:47:36.497 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:36.497 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":199,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:47:35.510961+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:47:33.468675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-17T01:47:34.468959+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:47:36.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.501+0000 7f0c46a00640 1 -- 172.21.15.42:0/1309183005 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0c20078b90 msgr2=0x7f0c2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:36.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.501+0000 7f0c46a00640 1 --2- 172.21.15.42:0/1309183005 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0c20078b90 0x7f0c2007b0a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f0c34001720 tx=0x7f0c34009040 comp rx=0 tx=0).stop 2024-09-17T01:47:36.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.501+0000 7f0c46a00640 1 -- 172.21.15.42:0/1309183005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c400cf230 msgr2=0x7f0c4015d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:36.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.501+0000 7f0c46a00640 1 --2- 172.21.15.42:0/1309183005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c400cf230 0x7f0c4015d9c0 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7f0c3800e960 tx=0x7f0c3800ee20 comp rx=0 tx=0).stop 2024-09-17T01:47:36.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.501+0000 7f0c46a00640 1 -- 172.21.15.42:0/1309183005 shutdown_connections 2024-09-17T01:47:36.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.501+0000 7f0c46a00640 1 --2- 172.21.15.42:0/1309183005 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0c20078b90 0x7f0c2007b0a0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:36.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.501+0000 7f0c46a00640 1 --2- 172.21.15.42:0/1309183005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c400cf230 0x7f0c4015d9c0 unknown :-1 s=CLOSED pgs=2265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:36.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.501+0000 7f0c46a00640 1 --2- 172.21.15.42:0/1309183005 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0c400b30a0 0x7f0c401532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:36.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.501+0000 7f0c46a00640 1 --2- 172.21.15.42:0/1309183005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0c4006cd20 0x7f0c40155330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:36.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.501+0000 7f0c46a00640 1 -- 172.21.15.42:0/1309183005 >> 172.21.15.42:0/1309183005 conn(0x7f0c400b25f0 msgr2=0x7f0c4006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:36.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.501+0000 7f0c46a00640 1 -- 172.21.15.42:0/1309183005 shutdown_connections 2024-09-17T01:47:36.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.501+0000 7f0c46a00640 1 -- 172.21.15.42:0/1309183005 wait complete. 2024-09-17T01:47:36.525 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:47:36.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.756+0000 7ff1c9400640 1 -- 172.21.15.42:0/2193583888 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1c40d0e10 msgr2=0x7ff1c40d1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:36.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.756+0000 7ff1c9400640 1 --2- 172.21.15.42:0/2193583888 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1c40d0e10 0x7ff1c40d1220 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac009820 tx=0x7ff1ac02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:47:36.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.756+0000 7ff1c9400640 1 -- 172.21.15.42:0/2193583888 shutdown_connections 2024-09-17T01:47:36.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.756+0000 7ff1c9400640 1 --2- 172.21.15.42:0/2193583888 >> v2:172.21.15.43:3300/0 conn(0x7ff1c4162500 0x7ff1c4162910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:36.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.756+0000 7ff1c9400640 1 --2- 172.21.15.42:0/2193583888 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1c40d0e10 0x7ff1c40d1220 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:36.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.756+0000 7ff1c9400640 1 -- 172.21.15.42:0/2193583888 >> 172.21.15.42:0/2193583888 conn(0x7ff1c40b6140 msgr2=0x7ff1c40b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:36.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.756+0000 7ff1c9400640 1 -- 172.21.15.42:0/2193583888 shutdown_connections 2024-09-17T01:47:36.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.756+0000 7ff1c9400640 1 -- 172.21.15.42:0/2193583888 wait complete. 2024-09-17T01:47:36.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.759+0000 7ff1c9400640 1 Processor -- start 2024-09-17T01:47:36.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.759+0000 7ff1c9400640 1 -- start start 2024-09-17T01:47:36.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.760+0000 7ff1c9400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1c40cfba0 0x7ff1c4151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:36.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.760+0000 7ff1c9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1c40d0e10 0x7ff1c40ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:36.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.760+0000 7ff1c9400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1c4162500 0x7ff1c41f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:36.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.760+0000 7ff1c9400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c40b31e0 con 0x7ff1c40d0e10 2024-09-17T01:47:36.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.760+0000 7ff1c9400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c40b3060 con 0x7ff1c4162500 2024-09-17T01:47:36.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.760+0000 7ff1c9400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c40b3360 con 0x7ff1c40cfba0 2024-09-17T01:47:36.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.760+0000 7ff1bbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1c40d0e10 0x7ff1c40ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:36.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.760+0000 7ff1bbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1c40d0e10 0x7ff1c40ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52282/0 (socket says 172.21.15.42:52282) 2024-09-17T01:47:36.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.760+0000 7ff1bbe00640 1 -- 172.21.15.42:0/353983533 learned_addr learned my addr 172.21.15.42:0/353983533 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:36.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.761+0000 7ff1c8a00640 1 --2- 172.21.15.42:0/353983533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1c4162500 0x7ff1c41f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:36.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.761+0000 7ff1c3e00640 1 --2- 172.21.15.42:0/353983533 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1c40cfba0 0x7ff1c4151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:36.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.761+0000 7ff1bbe00640 1 -- 172.21.15.42:0/353983533 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1c40cfba0 msgr2=0x7ff1c4151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:36.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.761+0000 7ff1bbe00640 1 --2- 172.21.15.42:0/353983533 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1c40cfba0 0x7ff1c4151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:36.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.761+0000 7ff1bbe00640 1 -- 172.21.15.42:0/353983533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1c4162500 msgr2=0x7ff1c41f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:36.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.761+0000 7ff1bbe00640 1 --2- 172.21.15.42:0/353983533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1c4162500 0x7ff1c41f5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:36.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.761+0000 7ff1bbe00640 1 -- 172.21.15.42:0/353983533 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c40cd750 con 0x7ff1c40d0e10 2024-09-17T01:47:36.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.761+0000 7ff1c8a00640 1 --2- 172.21.15.42:0/353983533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1c4162500 0x7ff1c41f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:47:36.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.761+0000 7ff1bbe00640 1 --2- 172.21.15.42:0/353983533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1c40d0e10 0x7ff1c40ce7f0 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac02aa90 tx=0x7ff1ac003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:36.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.761+0000 7ff1c0c00640 1 -- 172.21.15.42:0/353983533 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac03f070 con 0x7ff1c40d0e10 2024-09-17T01:47:36.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.761+0000 7ff1c0c00640 1 -- 172.21.15.42:0/353983533 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1ac0049b0 con 0x7ff1c40d0e10 2024-09-17T01:47:36.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.761+0000 7ff1c9400640 1 -- 172.21.15.42:0/353983533 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c40cda30 con 0x7ff1c40d0e10 2024-09-17T01:47:36.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.761+0000 7ff1c0c00640 1 -- 172.21.15.42:0/353983533 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac004e00 con 0x7ff1c40d0e10 2024-09-17T01:47:36.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.762+0000 7ff1c9400640 1 -- 172.21.15.42:0/353983533 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c40cdff0 con 0x7ff1c40d0e10 2024-09-17T01:47:36.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.763+0000 7ff1c9400640 1 -- 172.21.15.42:0/353983533 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1c40b76d0 con 0x7ff1c40d0e10 2024-09-17T01:47:36.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.764+0000 7ff1c0c00640 1 -- 172.21.15.42:0/353983533 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff1ac042070 con 0x7ff1c40d0e10 2024-09-17T01:47:36.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.765+0000 7ff1c0c00640 1 --2- 172.21.15.42:0/353983533 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff1a0078bc0 0x7ff1a007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:36.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.765+0000 7ff1c0c00640 1 -- 172.21.15.42:0/353983533 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 5709+0+0 (secure 0 0 0) 0x7ff1ac0bbb30 con 0x7ff1c40d0e10 2024-09-17T01:47:36.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.765+0000 7ff1c3e00640 1 --2- 172.21.15.42:0/353983533 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff1a0078bc0 0x7ff1a007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:36.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.766+0000 7ff1c3e00640 1 --2- 172.21.15.42:0/353983533 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff1a0078bc0 0x7ff1a007b0d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4001eb0 tx=0x7ff1b4009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:36.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.769+0000 7ff1c0c00640 1 -- 172.21.15.42:0/353983533 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff1c40b76d0 con 0x7ff1c40d0e10 2024-09-17T01:47:36.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.967+0000 7ff1c9400640 1 -- 172.21.15.42:0/353983533 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1c40b3840 con 0x7ff1c40d0e10 2024-09-17T01:47:36.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.969+0000 7ff1c0c00640 1 -- 172.21.15.42:0/353983533 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v199) ==== 74+0+16708 (secure 0 0 0) 0x7ff1ac083f70 con 0x7ff1c40d0e10 2024-09-17T01:47:36.967 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:36.967 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":199,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:47:35.510961+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:47:33.468675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-17T01:47:34.468959+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:47:36.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.971+0000 7ff1c9400640 1 -- 172.21.15.42:0/353983533 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff1a0078bc0 msgr2=0x7ff1a007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:36.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.971+0000 7ff1c9400640 1 --2- 172.21.15.42:0/353983533 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff1a0078bc0 0x7ff1a007b0d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4001eb0 tx=0x7ff1b4009040 comp rx=0 tx=0).stop 2024-09-17T01:47:36.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.971+0000 7ff1c9400640 1 -- 172.21.15.42:0/353983533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1c40d0e10 msgr2=0x7ff1c40ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:36.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.971+0000 7ff1c9400640 1 --2- 172.21.15.42:0/353983533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1c40d0e10 0x7ff1c40ce7f0 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac02aa90 tx=0x7ff1ac003c10 comp rx=0 tx=0).stop 2024-09-17T01:47:36.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.971+0000 7ff1c9400640 1 -- 172.21.15.42:0/353983533 shutdown_connections 2024-09-17T01:47:36.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.971+0000 7ff1c9400640 1 --2- 172.21.15.42:0/353983533 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff1a0078bc0 0x7ff1a007b0d0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:36.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.971+0000 7ff1c9400640 1 --2- 172.21.15.42:0/353983533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1c4162500 0x7ff1c41f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:36.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.971+0000 7ff1c9400640 1 --2- 172.21.15.42:0/353983533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1c40d0e10 0x7ff1c40ce7f0 unknown :-1 s=CLOSED pgs=2267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:36.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.971+0000 7ff1c9400640 1 --2- 172.21.15.42:0/353983533 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff1c40cfba0 0x7ff1c4151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:36.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.971+0000 7ff1c9400640 1 -- 172.21.15.42:0/353983533 >> 172.21.15.42:0/353983533 conn(0x7ff1c40b6140 msgr2=0x7ff1c415ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:36.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.971+0000 7ff1c9400640 1 -- 172.21.15.42:0/353983533 shutdown_connections 2024-09-17T01:47:36.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:36.971+0000 7ff1c9400640 1 -- 172.21.15.42:0/353983533 wait complete. 2024-09-17T01:47:36.991 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T01:47:37.226 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.228+0000 7fbdc2c00640 1 -- 172.21.15.42:0/2666941164 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbdbc0b3550 msgr2=0x7fbdbc15cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:37.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.228+0000 7fbdc2c00640 1 --2- 172.21.15.42:0/2666941164 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbdbc0b3550 0x7fbdbc15cec0 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0b3110 tx=0x7fbdac02a4d0 comp rx=0 tx=0).stop 2024-09-17T01:47:37.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.228+0000 7fbdc2c00640 1 -- 172.21.15.42:0/2666941164 shutdown_connections 2024-09-17T01:47:37.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.228+0000 7fbdc2c00640 1 --2- 172.21.15.42:0/2666941164 >> v2:172.21.15.43:3300/0 conn(0x7fbdbc072e90 0x7fbdbc0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:37.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.228+0000 7fbdc2c00640 1 --2- 172.21.15.42:0/2666941164 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbdbc142f40 0x7fbdbc072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:37.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.228+0000 7fbdc2c00640 1 --2- 172.21.15.42:0/2666941164 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbdbc0b3550 0x7fbdbc15cec0 unknown :-1 s=CLOSED pgs=2268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:37.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.228+0000 7fbdc2c00640 1 -- 172.21.15.42:0/2666941164 >> 172.21.15.42:0/2666941164 conn(0x7fbdbc0b2930 msgr2=0x7fbdbc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:37.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.228+0000 7fbdc2c00640 1 -- 172.21.15.42:0/2666941164 shutdown_connections 2024-09-17T01:47:37.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.228+0000 7fbdc2c00640 1 -- 172.21.15.42:0/2666941164 wait complete. 2024-09-17T01:47:37.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.231+0000 7fbdc2c00640 1 Processor -- start 2024-09-17T01:47:37.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.231+0000 7fbdc2c00640 1 -- start start 2024-09-17T01:47:37.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.232+0000 7fbdc2c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdbc072e90 0x7fbdbc1f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:37.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.232+0000 7fbdc2c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbdbc0b3550 0x7fbdbc1575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:37.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.232+0000 7fbdc2c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbdbc142f40 0x7fbdbc06ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:37.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.232+0000 7fbdc2c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc06d430 con 0x7fbdbc0b3550 2024-09-17T01:47:37.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.232+0000 7fbdc2c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc0cf4d0 con 0x7fbdbc072e90 2024-09-17T01:47:37.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.232+0000 7fbdc2c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbdbc06d5b0 con 0x7fbdbc142f40 2024-09-17T01:47:37.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.233+0000 7fbdb3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbdbc0b3550 0x7fbdbc1575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:37.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.233+0000 7fbdb3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbdbc0b3550 0x7fbdbc1575a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52300/0 (socket says 172.21.15.42:52300) 2024-09-17T01:47:37.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.233+0000 7fbdb3400640 1 -- 172.21.15.42:0/4173341833 learned_addr learned my addr 172.21.15.42:0/4173341833 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:37.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.233+0000 7fbdbbe00640 1 --2- 172.21.15.42:0/4173341833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdbc072e90 0x7fbdbc1f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:37.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.233+0000 7fbdc0c00640 1 --2- 172.21.15.42:0/4173341833 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbdbc142f40 0x7fbdbc06ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:37.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.233+0000 7fbdb3400640 1 -- 172.21.15.42:0/4173341833 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbdbc142f40 msgr2=0x7fbdbc06ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:37.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.233+0000 7fbdb3400640 1 --2- 172.21.15.42:0/4173341833 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbdbc142f40 0x7fbdbc06ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:37.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.233+0000 7fbdb3400640 1 -- 172.21.15.42:0/4173341833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdbc072e90 msgr2=0x7fbdbc1f5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:37.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.233+0000 7fbdb3400640 1 --2- 172.21.15.42:0/4173341833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdbc072e90 0x7fbdbc1f5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:37.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.233+0000 7fbdb3400640 1 -- 172.21.15.42:0/4173341833 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdbc06f110 con 0x7fbdbc0b3550 2024-09-17T01:47:37.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.233+0000 7fbdbbe00640 1 --2- 172.21.15.42:0/4173341833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdbc072e90 0x7fbdbc1f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:47:37.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.233+0000 7fbdb3400640 1 --2- 172.21.15.42:0/4173341833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbdbc0b3550 0x7fbdbc1575a0 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7fbda400e7f0 tx=0x7fbda400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:37.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.234+0000 7fbdb8c00640 1 -- 172.21.15.42:0/4173341833 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda400ccc0 con 0x7fbdbc0b3550 2024-09-17T01:47:37.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.234+0000 7fbdb8c00640 1 -- 172.21.15.42:0/4173341833 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbda400ce80 con 0x7fbdbc0b3550 2024-09-17T01:47:37.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.234+0000 7fbdb8c00640 1 -- 172.21.15.42:0/4173341833 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda4005280 con 0x7fbdbc0b3550 2024-09-17T01:47:37.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.234+0000 7fbdc2c00640 1 -- 172.21.15.42:0/4173341833 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdbc157cd0 con 0x7fbdbc0b3550 2024-09-17T01:47:37.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.234+0000 7fbdc2c00640 1 -- 172.21.15.42:0/4173341833 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdbc06e3d0 con 0x7fbdbc0b3550 2024-09-17T01:47:37.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.235+0000 7fbdc2c00640 1 -- 172.21.15.42:0/4173341833 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdbc1581f0 con 0x7fbdbc0b3550 2024-09-17T01:47:37.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.236+0000 7fbdb8c00640 1 -- 172.21.15.42:0/4173341833 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbda4005420 con 0x7fbdbc0b3550 2024-09-17T01:47:37.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.237+0000 7fbdb8c00640 1 --2- 172.21.15.42:0/4173341833 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd98078bc0 0x7fbd9807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:37.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.237+0000 7fbdb8c00640 1 -- 172.21.15.42:0/4173341833 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5709+0+0 (secure 0 0 0) 0x7fbda409b710 con 0x7fbdbc0b3550 2024-09-17T01:47:37.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.238+0000 7fbdbbe00640 1 --2- 172.21.15.42:0/4173341833 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd98078bc0 0x7fbd9807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:37.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.239+0000 7fbdbbe00640 1 --2- 172.21.15.42:0/4173341833 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd98078bc0 0x7fbd9807b0d0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fbdac033000 tx=0x7fbdac004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:37.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.242+0000 7fbdb8c00640 1 -- 172.21.15.42:0/4173341833 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbda4063ab0 con 0x7fbdbc0b3550 2024-09-17T01:47:37.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:37.473+0000 7fbdc2c00640 1 -- 172.21.15.42:0/4173341833 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fbdbc06e1c0 con 0x7fbdbc0b3550 2024-09-17T01:47:38.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.015+0000 7fbdb8c00640 1 -- 172.21.15.42:0/4173341833 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v158) ==== 118+0+0 (secure 0 0 0) 0x7fbda40633b0 con 0x7fbdbc0b3550 2024-09-17T01:47:38.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.018+0000 7fbdc2c00640 1 -- 172.21.15.42:0/4173341833 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd98078bc0 msgr2=0x7fbd9807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:38.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.018+0000 7fbdc2c00640 1 --2- 172.21.15.42:0/4173341833 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd98078bc0 0x7fbd9807b0d0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fbdac033000 tx=0x7fbdac004730 comp rx=0 tx=0).stop 2024-09-17T01:47:38.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.018+0000 7fbdc2c00640 1 -- 172.21.15.42:0/4173341833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbdbc0b3550 msgr2=0x7fbdbc1575a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:38.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.018+0000 7fbdc2c00640 1 --2- 172.21.15.42:0/4173341833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbdbc0b3550 0x7fbdbc1575a0 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7fbda400e7f0 tx=0x7fbda400ecb0 comp rx=0 tx=0).stop 2024-09-17T01:47:38.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.018+0000 7fbdc2c00640 1 -- 172.21.15.42:0/4173341833 shutdown_connections 2024-09-17T01:47:38.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.018+0000 7fbdc2c00640 1 --2- 172.21.15.42:0/4173341833 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd98078bc0 0x7fbd9807b0d0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:38.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.018+0000 7fbdc2c00640 1 --2- 172.21.15.42:0/4173341833 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbdbc142f40 0x7fbdbc06ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:38.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.018+0000 7fbdc2c00640 1 --2- 172.21.15.42:0/4173341833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbdbc0b3550 0x7fbdbc1575a0 unknown :-1 s=CLOSED pgs=2269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:38.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.018+0000 7fbdc2c00640 1 --2- 172.21.15.42:0/4173341833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdbc072e90 0x7fbdbc1f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:38.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.018+0000 7fbdc2c00640 1 -- 172.21.15.42:0/4173341833 >> 172.21.15.42:0/4173341833 conn(0x7fbdbc0b2930 msgr2=0x7fbdbc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:38.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.018+0000 7fbdc2c00640 1 -- 172.21.15.42:0/4173341833 shutdown_connections 2024-09-17T01:47:38.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.018+0000 7fbdc2c00640 1 -- 172.21.15.42:0/4173341833 wait complete. 2024-09-17T01:47:38.045 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T01:47:38.045 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T01:47:38.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.279+0000 7f40f2e00640 1 -- 172.21.15.42:0/4221943153 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40d4004800 msgr2=0x7f40d4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:38.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.279+0000 7f40f2e00640 1 --2- 172.21.15.42:0/4221943153 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40d4004800 0x7f40d4004c10 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009b50 tx=0x7f40d4005830 comp rx=0 tx=0).stop 2024-09-17T01:47:38.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.279+0000 7f40f2400640 1 -- 172.21.15.42:0/4221943153 reap_dead start 2024-09-17T01:47:38.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.279+0000 7f40f2e00640 1 -- 172.21.15.42:0/4221943153 shutdown_connections 2024-09-17T01:47:38.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.279+0000 7f40f2e00640 1 -- 172.21.15.42:0/4221943153 >> 172.21.15.42:0/4221943153 conn(0x7f40ec0b25f0 msgr2=0x7f40ec0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:38.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.279+0000 7f40f2e00640 1 -- 172.21.15.42:0/4221943153 shutdown_connections 2024-09-17T01:47:38.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.279+0000 7f40f2e00640 1 -- 172.21.15.42:0/4221943153 wait complete. 2024-09-17T01:47:38.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.281+0000 7f40f2e00640 1 Processor -- start 2024-09-17T01:47:38.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.281+0000 7f40f2e00640 1 -- start start 2024-09-17T01:47:38.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.283+0000 7f40f2e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f40d4004800 0x7f40ec1459f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:38.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.283+0000 7f40f2e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40ec1f48c0 0x7f40ec141e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:38.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.283+0000 7f40f2e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40ec142370 0x7f40ec0aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:38.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.283+0000 7f40f2e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec06cd20 con 0x7f40ec1f48c0 2024-09-17T01:47:38.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.283+0000 7f40f2e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec06cea0 con 0x7f40ec142370 2024-09-17T01:47:38.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.283+0000 7f40f2e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f40ec06d020 con 0x7f40d4004800 2024-09-17T01:47:38.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.283+0000 7f40f1000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40ec1f48c0 0x7f40ec141e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:38.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.283+0000 7f40f1000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40ec1f48c0 0x7f40ec141e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52314/0 (socket says 172.21.15.42:52314) 2024-09-17T01:47:38.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.283+0000 7f40f1000640 1 -- 172.21.15.42:0/3936777669 learned_addr learned my addr 172.21.15.42:0/3936777669 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:38.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.283+0000 7f40f1a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f40d4004800 0x7f40ec1459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:38.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.283+0000 7f40f2400640 1 --2- 172.21.15.42:0/3936777669 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40ec142370 0x7f40ec0aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:38.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.284+0000 7f40f1000640 1 -- 172.21.15.42:0/3936777669 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f40d4004800 msgr2=0x7f40ec1459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:38.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.284+0000 7f40f1000640 1 --2- 172.21.15.42:0/3936777669 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f40d4004800 0x7f40ec1459f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:38.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.284+0000 7f40f1000640 1 -- 172.21.15.42:0/3936777669 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40ec142370 msgr2=0x7f40ec0aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:38.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.284+0000 7f40f1000640 1 --2- 172.21.15.42:0/3936777669 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40ec142370 0x7f40ec0aead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:38.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.284+0000 7f40f1000640 1 -- 172.21.15.42:0/3936777669 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40ec142b40 con 0x7f40ec1f48c0 2024-09-17T01:47:38.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.284+0000 7f40f1000640 1 --2- 172.21.15.42:0/3936777669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40ec1f48c0 0x7f40ec141e30 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009a70 tx=0x7f40d8033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:38.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.284+0000 7f40e9600640 1 -- 172.21.15.42:0/3936777669 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8043070 con 0x7f40ec1f48c0 2024-09-17T01:47:38.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.284+0000 7f40e9600640 1 -- 172.21.15.42:0/3936777669 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40d8004320 con 0x7f40ec1f48c0 2024-09-17T01:47:38.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.284+0000 7f40e9600640 1 -- 172.21.15.42:0/3936777669 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8038040 con 0x7f40ec1f48c0 2024-09-17T01:47:38.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.284+0000 7f40f2e00640 1 -- 172.21.15.42:0/3936777669 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40ec1f3de0 con 0x7f40ec1f48c0 2024-09-17T01:47:38.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.284+0000 7f40f2e00640 1 -- 172.21.15.42:0/3936777669 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40ec145f30 con 0x7f40ec1f48c0 2024-09-17T01:47:38.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.286+0000 7f40f2e00640 1 -- 172.21.15.42:0/3936777669 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40ec1f3bd0 con 0x7f40ec1f48c0 2024-09-17T01:47:38.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.287+0000 7f40e9600640 1 -- 172.21.15.42:0/3936777669 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f40d8046070 con 0x7f40ec1f48c0 2024-09-17T01:47:38.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.288+0000 7f40e9600640 1 --2- 172.21.15.42:0/3936777669 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f40cc078b90 0x7f40cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:38.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.288+0000 7f40e9600640 1 -- 172.21.15.42:0/3936777669 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5709+0+0 (secure 0 0 0) 0x7f40d80bb300 con 0x7f40ec1f48c0 2024-09-17T01:47:38.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.288+0000 7f40f1a00640 1 --2- 172.21.15.42:0/3936777669 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f40cc078b90 0x7f40cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:38.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.289+0000 7f40f1a00640 1 --2- 172.21.15.42:0/3936777669 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f40cc078b90 0x7f40cc07b0a0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f40e0000fb0 tx=0x7f40e00068d0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:38.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.292+0000 7f40e9600640 1 -- 172.21.15.42:0/3936777669 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f40d80830e0 con 0x7f40ec1f48c0 2024-09-17T01:47:38.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:38.525+0000 7f40f2e00640 1 -- 172.21.15.42:0/3936777669 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f40ec153960 con 0x7f40ec1f48c0 2024-09-17T01:47:39.015 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.017+0000 7f40e9600640 1 -- 172.21.15.42:0/3936777669 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v159) ==== 122+0+0 (secure 0 0 0) 0x7f40d8087b10 con 0x7f40ec1f48c0 2024-09-17T01:47:39.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.020+0000 7f40f2e00640 1 -- 172.21.15.42:0/3936777669 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f40cc078b90 msgr2=0x7f40cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:39.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.020+0000 7f40f2e00640 1 --2- 172.21.15.42:0/3936777669 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f40cc078b90 0x7f40cc07b0a0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f40e0000fb0 tx=0x7f40e00068d0 comp rx=0 tx=0).stop 2024-09-17T01:47:39.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.020+0000 7f40f2e00640 1 -- 172.21.15.42:0/3936777669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40ec1f48c0 msgr2=0x7f40ec141e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:39.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.020+0000 7f40f2e00640 1 --2- 172.21.15.42:0/3936777669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40ec1f48c0 0x7f40ec141e30 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009a70 tx=0x7f40d8033670 comp rx=0 tx=0).stop 2024-09-17T01:47:39.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.020+0000 7f40f2e00640 1 -- 172.21.15.42:0/3936777669 shutdown_connections 2024-09-17T01:47:39.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.020+0000 7f40f2e00640 1 --2- 172.21.15.42:0/3936777669 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f40cc078b90 0x7f40cc07b0a0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:39.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.020+0000 7f40f2e00640 1 --2- 172.21.15.42:0/3936777669 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40ec142370 0x7f40ec0aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:39.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.020+0000 7f40f2e00640 1 --2- 172.21.15.42:0/3936777669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40ec1f48c0 0x7f40ec141e30 unknown :-1 s=CLOSED pgs=2272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:39.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.020+0000 7f40f2e00640 1 --2- 172.21.15.42:0/3936777669 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f40d4004800 0x7f40ec1459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:39.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.020+0000 7f40f2e00640 1 -- 172.21.15.42:0/3936777669 >> 172.21.15.42:0/3936777669 conn(0x7f40ec0b25f0 msgr2=0x7f40ec0ad9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:39.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.020+0000 7f40f2e00640 1 -- 172.21.15.42:0/3936777669 shutdown_connections 2024-09-17T01:47:39.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.020+0000 7f40f2e00640 1 -- 172.21.15.42:0/3936777669 wait complete. 2024-09-17T01:47:39.042 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T01:47:39.043 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:47:39.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.272+0000 7f2a98a00640 1 -- 172.21.15.42:0/213746611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a94069450 msgr2=0x7f2a94074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:39.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.272+0000 7f2a98a00640 1 --2- 172.21.15.42:0/213746611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a94069450 0x7f2a94074a00 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7f2a940738b0 tx=0x7f2a8c02a8b0 comp rx=0 tx=0).stop 2024-09-17T01:47:39.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.273+0000 7f2a98a00640 1 -- 172.21.15.42:0/213746611 shutdown_connections 2024-09-17T01:47:39.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.273+0000 7f2a98a00640 1 --2- 172.21.15.42:0/213746611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a94069450 0x7f2a94074a00 unknown :-1 s=CLOSED pgs=2274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:39.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.273+0000 7f2a98a00640 1 --2- 172.21.15.42:0/213746611 >> v2:172.21.15.43:3300/0 conn(0x7f2a9415a2a0 0x7f2a9415d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:39.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.273+0000 7f2a98a00640 1 -- 172.21.15.42:0/213746611 >> 172.21.15.42:0/213746611 conn(0x7f2a940734a0 msgr2=0x7f2a940b61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:39.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.273+0000 7f2a98a00640 1 -- 172.21.15.42:0/213746611 shutdown_connections 2024-09-17T01:47:39.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.273+0000 7f2a98a00640 1 -- 172.21.15.42:0/213746611 wait complete. 2024-09-17T01:47:39.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.275+0000 7f2a98a00640 1 Processor -- start 2024-09-17T01:47:39.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.275+0000 7f2a98a00640 1 -- start start 2024-09-17T01:47:39.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.276+0000 7f2a98a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a940b14a0 0x7f2a9414f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:39.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.276+0000 7f2a98a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a9415a2a0 0x7f2a94160110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:39.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.276+0000 7f2a98a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a94160c90 0x7f2a9415a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:39.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.276+0000 7f2a98a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2a940b1ac0 con 0x7f2a940b14a0 2024-09-17T01:47:39.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.276+0000 7f2a98a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2a94069bd0 con 0x7f2a94160c90 2024-09-17T01:47:39.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.276+0000 7f2a98a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2a94074f40 con 0x7f2a9415a2a0 2024-09-17T01:47:39.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.277+0000 7f2a92800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a940b14a0 0x7f2a9414f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:39.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.277+0000 7f2a92800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a940b14a0 0x7f2a9414f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52318/0 (socket says 172.21.15.42:52318) 2024-09-17T01:47:39.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.277+0000 7f2a92800640 1 -- 172.21.15.42:0/2923886582 learned_addr learned my addr 172.21.15.42:0/2923886582 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:39.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.277+0000 7f2a93200640 1 --2- 172.21.15.42:0/2923886582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a94160c90 0x7f2a9415a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:39.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.277+0000 7f2a91e00640 1 --2- 172.21.15.42:0/2923886582 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a9415a2a0 0x7f2a94160110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:39.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.277+0000 7f2a92800640 1 -- 172.21.15.42:0/2923886582 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a9415a2a0 msgr2=0x7f2a94160110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:39.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.277+0000 7f2a92800640 1 --2- 172.21.15.42:0/2923886582 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a9415a2a0 0x7f2a94160110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:39.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.277+0000 7f2a92800640 1 -- 172.21.15.42:0/2923886582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a94160c90 msgr2=0x7f2a9415a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:39.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.277+0000 7f2a92800640 1 --2- 172.21.15.42:0/2923886582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a94160c90 0x7f2a9415a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:39.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.277+0000 7f2a92800640 1 -- 172.21.15.42:0/2923886582 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9415f6a0 con 0x7f2a940b14a0 2024-09-17T01:47:39.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.277+0000 7f2a93200640 1 --2- 172.21.15.42:0/2923886582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a94160c90 0x7f2a9415a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:47:39.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.277+0000 7f2a91e00640 1 --2- 172.21.15.42:0/2923886582 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a9415a2a0 0x7f2a94160110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:47:39.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.277+0000 7f2a92800640 1 --2- 172.21.15.42:0/2923886582 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a940b14a0 0x7f2a9414f480 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400e790 tx=0x7f2a8400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:39.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.278+0000 7f2a8aa00640 1 -- 172.21.15.42:0/2923886582 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8400eea0 con 0x7f2a940b14a0 2024-09-17T01:47:39.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.278+0000 7f2a8aa00640 1 -- 172.21.15.42:0/2923886582 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a8400cdb0 con 0x7f2a940b14a0 2024-09-17T01:47:39.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.278+0000 7f2a8aa00640 1 -- 172.21.15.42:0/2923886582 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a84010690 con 0x7f2a940b14a0 2024-09-17T01:47:39.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.278+0000 7f2a98a00640 1 -- 172.21.15.42:0/2923886582 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a941583a0 con 0x7f2a940b14a0 2024-09-17T01:47:39.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.278+0000 7f2a98a00640 1 -- 172.21.15.42:0/2923886582 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a941610a0 con 0x7f2a940b14a0 2024-09-17T01:47:39.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.279+0000 7f2a98a00640 1 -- 172.21.15.42:0/2923886582 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a940754a0 con 0x7f2a940b14a0 2024-09-17T01:47:39.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.280+0000 7f2a8aa00640 1 -- 172.21.15.42:0/2923886582 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2a84010830 con 0x7f2a940b14a0 2024-09-17T01:47:39.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.281+0000 7f2a8aa00640 1 --2- 172.21.15.42:0/2923886582 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2a74078b90 0x7f2a7407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:39.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.281+0000 7f2a8aa00640 1 -- 172.21.15.42:0/2923886582 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5709+0+0 (secure 0 0 0) 0x7f2a8409b700 con 0x7f2a940b14a0 2024-09-17T01:47:39.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.282+0000 7f2a91e00640 1 --2- 172.21.15.42:0/2923886582 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2a74078b90 0x7f2a7407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:39.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.283+0000 7f2a91e00640 1 --2- 172.21.15.42:0/2923886582 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2a74078b90 0x7f2a7407b0a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f2a9415c8a0 tx=0x7f2a80009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:39.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.286+0000 7f2a8aa00640 1 -- 172.21.15.42:0/2923886582 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2a84063bd0 con 0x7f2a940b14a0 2024-09-17T01:47:39.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.520+0000 7f2a98a00640 1 -- 172.21.15.42:0/2923886582 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a9415d9f0 con 0x7f2a940b14a0 2024-09-17T01:47:39.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.520+0000 7f2a8aa00640 1 -- 172.21.15.42:0/2923886582 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 159 v159) ==== 95+0+5231 (secure 0 0 0) 0x7f2a840634d0 con 0x7f2a940b14a0 2024-09-17T01:47:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:39.519 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":159,"btime":"2024-09-17T01:47:39:016238+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3701245274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3701245274},{"type":"v1","addr":"172.21.15.43:6837","nonce":3701245274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10021,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/8838410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":8838410},{"type":"v1","addr":"172.21.15.42:6834","nonce":8838410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3981236009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3981236009},{"type":"v1","addr":"172.21.15.43:6836","nonce":3981236009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154}],"filesystems":[{"mdsmap":{"epoch":159,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:47:35.510920+0000","modified":"2024-09-17T01:47:38.527136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10776":{"gid":10776,"name":"c","rank":0,"incarnation":155,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3836210591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3836210591},{"type":"v1","addr":"172.21.15.42:6835","nonce":3836210591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10776,"qdb_cluster":[10776]},"id":14}]} 2024-09-17T01:47:39.519 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 159 2024-09-17T01:47:39.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.523+0000 7f2a98a00640 1 -- 172.21.15.42:0/2923886582 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2a74078b90 msgr2=0x7f2a7407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:39.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.523+0000 7f2a98a00640 1 --2- 172.21.15.42:0/2923886582 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2a74078b90 0x7f2a7407b0a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f2a9415c8a0 tx=0x7f2a80009040 comp rx=0 tx=0).stop 2024-09-17T01:47:39.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.523+0000 7f2a98a00640 1 -- 172.21.15.42:0/2923886582 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a940b14a0 msgr2=0x7f2a9414f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:39.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.523+0000 7f2a98a00640 1 --2- 172.21.15.42:0/2923886582 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a940b14a0 0x7f2a9414f480 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400e790 tx=0x7f2a8400ec50 comp rx=0 tx=0).stop 2024-09-17T01:47:39.521 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.523+0000 7f2a98a00640 1 -- 172.21.15.42:0/2923886582 shutdown_connections 2024-09-17T01:47:39.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.523+0000 7f2a98a00640 1 --2- 172.21.15.42:0/2923886582 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2a74078b90 0x7f2a7407b0a0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:39.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.523+0000 7f2a98a00640 1 --2- 172.21.15.42:0/2923886582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2a94160c90 0x7f2a9415a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:39.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.523+0000 7f2a98a00640 1 --2- 172.21.15.42:0/2923886582 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2a9415a2a0 0x7f2a94160110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:39.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.523+0000 7f2a98a00640 1 --2- 172.21.15.42:0/2923886582 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2a940b14a0 0x7f2a9414f480 unknown :-1 s=CLOSED pgs=2275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:39.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.523+0000 7f2a98a00640 1 -- 172.21.15.42:0/2923886582 >> 172.21.15.42:0/2923886582 conn(0x7f2a940734a0 msgr2=0x7f2a940b61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:39.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.523+0000 7f2a98a00640 1 -- 172.21.15.42:0/2923886582 shutdown_connections 2024-09-17T01:47:39.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.523+0000 7f2a98a00640 1 -- 172.21.15.42:0/2923886582 wait complete. 2024-09-17T01:47:39.544 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:47:39.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.775+0000 7f6b21200640 1 -- 172.21.15.42:0/1628291886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b000051a0 msgr2=0x7f6b0000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:39.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.775+0000 7f6b21200640 1 --2- 172.21.15.42:0/1628291886 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b000051a0 0x7f6b0000b9c0 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7f6b14005fd0 tx=0x7f6b00005830 comp rx=0 tx=0).stop 2024-09-17T01:47:39.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.775+0000 7f6b1be00640 1 -- 172.21.15.42:0/1628291886 reap_dead start 2024-09-17T01:47:39.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.775+0000 7f6b21200640 1 -- 172.21.15.42:0/1628291886 shutdown_connections 2024-09-17T01:47:39.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.775+0000 7f6b21200640 1 -- 172.21.15.42:0/1628291886 >> 172.21.15.42:0/1628291886 conn(0x7f6b1c0b25f0 msgr2=0x7f6b1c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:39.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.775+0000 7f6b21200640 1 -- 172.21.15.42:0/1628291886 shutdown_connections 2024-09-17T01:47:39.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.775+0000 7f6b21200640 1 -- 172.21.15.42:0/1628291886 wait complete. 2024-09-17T01:47:39.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.777+0000 7f6b21200640 1 Processor -- start 2024-09-17T01:47:39.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.778+0000 7f6b21200640 1 -- start start 2024-09-17T01:47:39.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.779+0000 7f6b21200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b000051a0 0x7f6b1c074c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:39.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.779+0000 7f6b21200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b1c13c460 0x7f6b1c14d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:39.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.779+0000 7f6b21200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b1c0cbad0 0x7f6b1c0cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:39.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.779+0000 7f6b21200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6b1c06d650 con 0x7f6b1c13c460 2024-09-17T01:47:39.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.779+0000 7f6b21200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6b1c0b42c0 con 0x7f6b000051a0 2024-09-17T01:47:39.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.779+0000 7f6b21200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6b1c152ed0 con 0x7f6b1c0cbad0 2024-09-17T01:47:39.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.779+0000 7f6b13e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b1c13c460 0x7f6b1c14d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:39.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.779+0000 7f6b13e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b1c13c460 0x7f6b1c14d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52328/0 (socket says 172.21.15.42:52328) 2024-09-17T01:47:39.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.779+0000 7f6b13e00640 1 -- 172.21.15.42:0/1320608772 learned_addr learned my addr 172.21.15.42:0/1320608772 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:39.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.780+0000 7f6b1b400640 1 --2- 172.21.15.42:0/1320608772 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b000051a0 0x7f6b1c074c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:39.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.780+0000 7f6b1be00640 1 --2- 172.21.15.42:0/1320608772 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b1c0cbad0 0x7f6b1c0cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:39.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.780+0000 7f6b13e00640 1 -- 172.21.15.42:0/1320608772 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b1c0cbad0 msgr2=0x7f6b1c0cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:39.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.780+0000 7f6b13e00640 1 --2- 172.21.15.42:0/1320608772 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b1c0cbad0 0x7f6b1c0cbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:39.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.780+0000 7f6b13e00640 1 -- 172.21.15.42:0/1320608772 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b000051a0 msgr2=0x7f6b1c074c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:39.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.780+0000 7f6b13e00640 1 --2- 172.21.15.42:0/1320608772 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b000051a0 0x7f6b1c074c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:39.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.780+0000 7f6b13e00640 1 -- 172.21.15.42:0/1320608772 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b1c0cb310 con 0x7f6b1c13c460 2024-09-17T01:47:39.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.780+0000 7f6b1b400640 1 --2- 172.21.15.42:0/1320608772 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b000051a0 0x7f6b1c074c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:47:39.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.780+0000 7f6b1be00640 1 --2- 172.21.15.42:0/1320608772 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b1c0cbad0 0x7f6b1c0cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:47:39.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.780+0000 7f6b13e00640 1 --2- 172.21.15.42:0/1320608772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b1c13c460 0x7f6b1c14d4a0 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7f6b04006450 tx=0x7f6b040039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:39.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.780+0000 7f6b13400640 1 -- 172.21.15.42:0/1320608772 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b04015070 con 0x7f6b1c13c460 2024-09-17T01:47:39.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.780+0000 7f6b13400640 1 -- 172.21.15.42:0/1320608772 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b04011900 con 0x7f6b1c13c460 2024-09-17T01:47:39.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.780+0000 7f6b13400640 1 -- 172.21.15.42:0/1320608772 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b04011d50 con 0x7f6b1c13c460 2024-09-17T01:47:39.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.780+0000 7f6b21200640 1 -- 172.21.15.42:0/1320608772 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b1c13c870 con 0x7f6b1c13c460 2024-09-17T01:47:39.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.780+0000 7f6b21200640 1 -- 172.21.15.42:0/1320608772 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b1c1502e0 con 0x7f6b1c13c460 2024-09-17T01:47:39.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.782+0000 7f6b21200640 1 -- 172.21.15.42:0/1320608772 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b1c0cb140 con 0x7f6b1c13c460 2024-09-17T01:47:39.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.783+0000 7f6b13400640 1 -- 172.21.15.42:0/1320608772 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6b04018070 con 0x7f6b1c13c460 2024-09-17T01:47:39.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.784+0000 7f6b13400640 1 --2- 172.21.15.42:0/1320608772 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6af8078bc0 0x7f6af807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:39.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.784+0000 7f6b13400640 1 -- 172.21.15.42:0/1320608772 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5709+0+0 (secure 0 0 0) 0x7f6b0409bab0 con 0x7f6b1c13c460 2024-09-17T01:47:39.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.784+0000 7f6b1b400640 1 --2- 172.21.15.42:0/1320608772 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6af8078bc0 0x7f6af807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:39.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.785+0000 7f6b1b400640 1 --2- 172.21.15.42:0/1320608772 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6af8078bc0 0x7f6af807b0d0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c006510 tx=0x7f6b0c006b10 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:39.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.788+0000 7f6b13400640 1 -- 172.21.15.42:0/1320608772 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6b04063ef0 con 0x7f6b1c13c460 2024-09-17T01:47:39.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.985+0000 7f6b21200640 1 -- 172.21.15.42:0/1320608772 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b1c06cd20 con 0x7f6b1c13c460 2024-09-17T01:47:39.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.987+0000 7f6b13400640 1 -- 172.21.15.42:0/1320608772 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v200) ==== 74+0+16695 (secure 0 0 0) 0x7f6b040637f0 con 0x7f6b1c13c460 2024-09-17T01:47:39.985 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:39.985 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":200,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:47:36.994980+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:47:33.468675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-17T01:47:34.468959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:47:39.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.989+0000 7f6b21200640 1 -- 172.21.15.42:0/1320608772 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6af8078bc0 msgr2=0x7f6af807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:39.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.989+0000 7f6b21200640 1 --2- 172.21.15.42:0/1320608772 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6af8078bc0 0x7f6af807b0d0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c006510 tx=0x7f6b0c006b10 comp rx=0 tx=0).stop 2024-09-17T01:47:39.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.989+0000 7f6b21200640 1 -- 172.21.15.42:0/1320608772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b1c13c460 msgr2=0x7f6b1c14d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:39.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.989+0000 7f6b21200640 1 --2- 172.21.15.42:0/1320608772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b1c13c460 0x7f6b1c14d4a0 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7f6b04006450 tx=0x7f6b040039c0 comp rx=0 tx=0).stop 2024-09-17T01:47:39.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.989+0000 7f6b21200640 1 -- 172.21.15.42:0/1320608772 shutdown_connections 2024-09-17T01:47:39.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.989+0000 7f6b21200640 1 --2- 172.21.15.42:0/1320608772 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6af8078bc0 0x7f6af807b0d0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:39.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.989+0000 7f6b21200640 1 --2- 172.21.15.42:0/1320608772 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b1c0cbad0 0x7f6b1c0cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:39.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.989+0000 7f6b21200640 1 --2- 172.21.15.42:0/1320608772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b1c13c460 0x7f6b1c14d4a0 unknown :-1 s=CLOSED pgs=2278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:39.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.989+0000 7f6b21200640 1 --2- 172.21.15.42:0/1320608772 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b000051a0 0x7f6b1c074c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:39.988 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.989+0000 7f6b21200640 1 -- 172.21.15.42:0/1320608772 >> 172.21.15.42:0/1320608772 conn(0x7f6b1c0b25f0 msgr2=0x7f6b1c0ad460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:39.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.989+0000 7f6b21200640 1 -- 172.21.15.42:0/1320608772 shutdown_connections 2024-09-17T01:47:39.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:39.989+0000 7f6b21200640 1 -- 172.21.15.42:0/1320608772 wait complete. 2024-09-17T01:47:40.014 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T01:47:40.014 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:47:40.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.244+0000 7f5868e00640 1 -- 172.21.15.42:0/4053299165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58640cf7c0 msgr2=0x7f586406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:40.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.244+0000 7f5868e00640 1 --2- 172.21.15.42:0/4053299165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58640cf7c0 0x7f586406cd20 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7f586406deb0 tx=0x7f584c02a5f0 comp rx=0 tx=0).stop 2024-09-17T01:47:40.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.244+0000 7f5868e00640 1 -- 172.21.15.42:0/4053299165 shutdown_connections 2024-09-17T01:47:40.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.244+0000 7f5868e00640 1 --2- 172.21.15.42:0/4053299165 >> v2:172.21.15.43:3300/0 conn(0x7f586406d260 0x7f5864152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:40.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.244+0000 7f5868e00640 1 --2- 172.21.15.42:0/4053299165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58640cf7c0 0x7f586406cd20 unknown :-1 s=CLOSED pgs=2280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:40.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.244+0000 7f5868e00640 1 -- 172.21.15.42:0/4053299165 >> 172.21.15.42:0/4053299165 conn(0x7f58640b25f0 msgr2=0x7f58640d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:40.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.244+0000 7f5868e00640 1 -- 172.21.15.42:0/4053299165 shutdown_connections 2024-09-17T01:47:40.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.244+0000 7f5868e00640 1 -- 172.21.15.42:0/4053299165 wait complete. 2024-09-17T01:47:40.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.247+0000 7f5868e00640 1 Processor -- start 2024-09-17T01:47:40.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.247+0000 7f5868e00640 1 -- start start 2024-09-17T01:47:40.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.248+0000 7f5868e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f586406d260 0x7f5864149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:40.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.248+0000 7f5868e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58640b4be0 0x7f5864155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:40.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.248+0000 7f5868e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f58640cf7c0 0x7f58640ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:40.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.248+0000 7f5868e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f58641537a0 con 0x7f586406d260 2024-09-17T01:47:40.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.248+0000 7f5868e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5864153620 con 0x7f58640b4be0 2024-09-17T01:47:40.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.248+0000 7f5868e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5864153920 con 0x7f58640cf7c0 2024-09-17T01:47:40.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.248+0000 7f5863400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f586406d260 0x7f5864149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:40.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.248+0000 7f5863400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f586406d260 0x7f5864149560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52348/0 (socket says 172.21.15.42:52348) 2024-09-17T01:47:40.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.248+0000 7f5863400640 1 -- 172.21.15.42:0/929858260 learned_addr learned my addr 172.21.15.42:0/929858260 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:40.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.249+0000 7f585be00640 1 --2- 172.21.15.42:0/929858260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58640b4be0 0x7f5864155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:40.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.249+0000 7f5863e00640 1 --2- 172.21.15.42:0/929858260 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f58640cf7c0 0x7f58640ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:40.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.249+0000 7f5863400640 1 -- 172.21.15.42:0/929858260 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f58640cf7c0 msgr2=0x7f58640ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:40.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.249+0000 7f5863400640 1 --2- 172.21.15.42:0/929858260 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f58640cf7c0 0x7f58640ae6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:40.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.249+0000 7f5863400640 1 -- 172.21.15.42:0/929858260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58640b4be0 msgr2=0x7f5864155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:40.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.249+0000 7f5863400640 1 --2- 172.21.15.42:0/929858260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58640b4be0 0x7f5864155220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:40.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.249+0000 7f5863400640 1 -- 172.21.15.42:0/929858260 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58641f5cb0 con 0x7f586406d260 2024-09-17T01:47:40.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.249+0000 7f5863400640 1 --2- 172.21.15.42:0/929858260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f586406d260 0x7f5864149560 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7f585400c3c0 tx=0x7f585400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:40.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.249+0000 7f585b400640 1 -- 172.21.15.42:0/929858260 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5854017070 con 0x7f586406d260 2024-09-17T01:47:40.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.249+0000 7f585b400640 1 -- 172.21.15.42:0/929858260 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58540035f0 con 0x7f586406d260 2024-09-17T01:47:40.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.249+0000 7f5868e00640 1 -- 172.21.15.42:0/929858260 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58641f5f90 con 0x7f586406d260 2024-09-17T01:47:40.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.249+0000 7f585b400640 1 -- 172.21.15.42:0/929858260 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5854003a80 con 0x7f586406d260 2024-09-17T01:47:40.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.250+0000 7f5868e00640 1 -- 172.21.15.42:0/929858260 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58641f6550 con 0x7f586406d260 2024-09-17T01:47:40.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.251+0000 7f5868e00640 1 -- 172.21.15.42:0/929858260 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5864152ed0 con 0x7f586406d260 2024-09-17T01:47:40.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.252+0000 7f585b400640 1 -- 172.21.15.42:0/929858260 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f585401a070 con 0x7f586406d260 2024-09-17T01:47:40.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.253+0000 7f585b400640 1 --2- 172.21.15.42:0/929858260 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5840078b90 0x7f584007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:40.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.253+0000 7f585b400640 1 -- 172.21.15.42:0/929858260 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5709+0+0 (secure 0 0 0) 0x7f585409a0f0 con 0x7f586406d260 2024-09-17T01:47:40.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.253+0000 7f585be00640 1 --2- 172.21.15.42:0/929858260 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5840078b90 0x7f584007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:40.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.254+0000 7f585be00640 1 --2- 172.21.15.42:0/929858260 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5840078b90 0x7f584007b0a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f584c033000 tx=0x7f584c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:40.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.257+0000 7f585b400640 1 -- 172.21.15.42:0/929858260 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f586406d670 con 0x7f586406d260 2024-09-17T01:47:40.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.445+0000 7f5868e00640 1 -- 172.21.15.42:0/929858260 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f58641f5a30 con 0x7f5840078b90 2024-09-17T01:47:40.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.451+0000 7f585b400640 1 -- 172.21.15.42:0/929858260 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242444 (secure 0 0 0) 0x7f584c004040 con 0x7f5840078b90 2024-09-17T01:47:40.452 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:40.453 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:47:40.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.455+0000 7f5868e00640 1 -- 172.21.15.42:0/929858260 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5840078b90 msgr2=0x7f584007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:40.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.455+0000 7f5868e00640 1 --2- 172.21.15.42:0/929858260 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5840078b90 0x7f584007b0a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f584c033000 tx=0x7f584c004730 comp rx=0 tx=0).stop 2024-09-17T01:47:40.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.455+0000 7f5868e00640 1 -- 172.21.15.42:0/929858260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f586406d260 msgr2=0x7f5864149560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:40.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.455+0000 7f5868e00640 1 --2- 172.21.15.42:0/929858260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f586406d260 0x7f5864149560 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7f585400c3c0 tx=0x7f585400c880 comp rx=0 tx=0).stop 2024-09-17T01:47:40.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.455+0000 7f5868e00640 1 -- 172.21.15.42:0/929858260 shutdown_connections 2024-09-17T01:47:40.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.455+0000 7f5868e00640 1 --2- 172.21.15.42:0/929858260 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5840078b90 0x7f584007b0a0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:40.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.455+0000 7f5868e00640 1 --2- 172.21.15.42:0/929858260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58640b4be0 0x7f5864155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:40.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.455+0000 7f5868e00640 1 --2- 172.21.15.42:0/929858260 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f58640cf7c0 0x7f58640ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:40.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.455+0000 7f5868e00640 1 --2- 172.21.15.42:0/929858260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f586406d260 0x7f5864149560 unknown :-1 s=CLOSED pgs=2281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:40.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.455+0000 7f5868e00640 1 -- 172.21.15.42:0/929858260 >> 172.21.15.42:0/929858260 conn(0x7f58640b25f0 msgr2=0x7f58640ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:40.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.456+0000 7f5868e00640 1 -- 172.21.15.42:0/929858260 shutdown_connections 2024-09-17T01:47:40.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.456+0000 7f5868e00640 1 -- 172.21.15.42:0/929858260 wait complete. 2024-09-17T01:47:40.478 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":666,"stamp":"2024-09-17T01:47:39.247625+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":113,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":98,"acting":98,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":436616,"kb_used_data":20572,"kb_used_omap":12,"kb_used_meta":415859,"kb_avail":754538104,"statfs":{"total":773094113280,"available":772647018496,"internally_reserved":0,"allocated":21065728,"data_stored":9951986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":425840180},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.268776"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":1,"reported_epoch":198,"state":"creating+peering","last_fresh":"2024-09-17T01:47:34.998821+0000","last_change":"2024-09-17T01:47:34.998821+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.998821+0000","last_undegraded":"2024-09-17T01:47:34.998821+0000","last_fullsized":"2024-09-17T01:47:34.998821+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":1,"reported_epoch":198,"state":"creating+peering","last_fresh":"2024-09-17T01:47:34.997078+0000","last_change":"2024-09-17T01:47:34.997078+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.997078+0000","last_undegraded":"2024-09-17T01:47:34.997078+0000","last_fullsized":"2024-09-17T01:47:34.997078+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027218+0000","last_change":"2024-09-17T01:47:36.027786+0000","last_active":"2024-09-17T01:47:37.027218+0000","last_peered":"2024-09-17T01:47:37.027218+0000","last_clean":"2024-09-17T01:47:37.027218+0000","last_became_active":"2024-09-17T01:47:36.027311+0000","last_became_peered":"2024-09-17T01:47:36.027311+0000","last_unstale":"2024-09-17T01:47:37.027218+0000","last_undegraded":"2024-09-17T01:47:37.027218+0000","last_fullsized":"2024-09-17T01:47:37.027218+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:41.527675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027027+0000","last_change":"2024-09-17T01:47:36.023252+0000","last_active":"2024-09-17T01:47:37.027027+0000","last_peered":"2024-09-17T01:47:37.027027+0000","last_clean":"2024-09-17T01:47:37.027027+0000","last_became_active":"2024-09-17T01:47:36.022317+0000","last_became_peered":"2024-09-17T01:47:36.022317+0000","last_unstale":"2024-09-17T01:47:37.027027+0000","last_undegraded":"2024-09-17T01:47:37.027027+0000","last_fullsized":"2024-09-17T01:47:37.027027+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:15.810411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027246+0000","last_change":"2024-09-17T01:47:36.029064+0000","last_active":"2024-09-17T01:47:37.027246+0000","last_peered":"2024-09-17T01:47:37.027246+0000","last_clean":"2024-09-17T01:47:37.027246+0000","last_became_active":"2024-09-17T01:47:36.028613+0000","last_became_peered":"2024-09-17T01:47:36.028613+0000","last_unstale":"2024-09-17T01:47:37.027246+0000","last_undegraded":"2024-09-17T01:47:37.027246+0000","last_fullsized":"2024-09-17T01:47:37.027246+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:09.498750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":1,"reported_epoch":198,"state":"creating+peering","last_fresh":"2024-09-17T01:47:34.996508+0000","last_change":"2024-09-17T01:47:34.996508+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.996508+0000","last_undegraded":"2024-09-17T01:47:34.996508+0000","last_fullsized":"2024-09-17T01:47:34.996508+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.026945+0000","last_change":"2024-09-17T01:47:36.023965+0000","last_active":"2024-09-17T01:47:37.026945+0000","last_peered":"2024-09-17T01:47:37.026945+0000","last_clean":"2024-09-17T01:47:37.026945+0000","last_became_active":"2024-09-17T01:47:36.023148+0000","last_became_peered":"2024-09-17T01:47:36.023148+0000","last_unstale":"2024-09-17T01:47:37.026945+0000","last_undegraded":"2024-09-17T01:47:37.026945+0000","last_fullsized":"2024-09-17T01:47:37.026945+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:50.320950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.985674+0000","last_change":"2024-09-17T01:47:33.985674+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.985674+0000","last_undegraded":"2024-09-17T01:47:33.985674+0000","last_fullsized":"2024-09-17T01:47:33.985674+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.989986+0000","last_change":"2024-09-17T01:47:33.989986+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.989986+0000","last_undegraded":"2024-09-17T01:47:33.989986+0000","last_fullsized":"2024-09-17T01:47:33.989986+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":1,"reported_epoch":198,"state":"creating+peering","last_fresh":"2024-09-17T01:47:34.994387+0000","last_change":"2024-09-17T01:47:34.994387+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.994387+0000","last_undegraded":"2024-09-17T01:47:34.994387+0000","last_fullsized":"2024-09-17T01:47:34.994387+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.984871+0000","last_change":"2024-09-17T01:47:33.984871+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.984871+0000","last_undegraded":"2024-09-17T01:47:33.984871+0000","last_fullsized":"2024-09-17T01:47:33.984871+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.985170+0000","last_change":"2024-09-17T01:47:33.985170+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.985170+0000","last_undegraded":"2024-09-17T01:47:33.985170+0000","last_fullsized":"2024-09-17T01:47:33.985170+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.988053+0000","last_change":"2024-09-17T01:47:33.988053+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.988053+0000","last_undegraded":"2024-09-17T01:47:33.988053+0000","last_fullsized":"2024-09-17T01:47:33.988053+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T01:47:35.002235+0000","last_change":"2024-09-17T01:47:34.996555+0000","last_active":"2024-09-17T01:47:35.002235+0000","last_peered":"2024-09-17T01:47:35.002235+0000","last_clean":"2024-09-17T01:47:35.002235+0000","last_became_active":"2024-09-17T01:47:34.996193+0000","last_became_peered":"2024-09-17T01:47:34.996193+0000","last_unstale":"2024-09-17T01:47:35.002235+0000","last_undegraded":"2024-09-17T01:47:35.002235+0000","last_fullsized":"2024-09-17T01:47:35.002235+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:51.198589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.026608+0000","last_change":"2024-09-17T01:47:34.999663+0000","last_active":"2024-09-17T01:47:37.026608+0000","last_peered":"2024-09-17T01:47:37.026608+0000","last_clean":"2024-09-17T01:47:37.026608+0000","last_became_active":"2024-09-17T01:47:34.999310+0000","last_became_peered":"2024-09-17T01:47:34.999310+0000","last_unstale":"2024-09-17T01:47:37.026608+0000","last_undegraded":"2024-09-17T01:47:37.026608+0000","last_fullsized":"2024-09-17T01:47:37.026608+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:29.080659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.989987+0000","last_change":"2024-09-17T01:47:33.989987+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.989987+0000","last_undegraded":"2024-09-17T01:47:33.989987+0000","last_fullsized":"2024-09-17T01:47:33.989987+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.985490+0000","last_change":"2024-09-17T01:47:33.985490+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.985490+0000","last_undegraded":"2024-09-17T01:47:33.985490+0000","last_fullsized":"2024-09-17T01:47:33.985490+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.981497+0000","last_change":"2024-09-17T01:47:33.981497+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.981497+0000","last_undegraded":"2024-09-17T01:47:33.981497+0000","last_fullsized":"2024-09-17T01:47:33.981497+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.14","version":"199'6","reported_seq":21,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.026977+0000","last_change":"2024-09-17T01:47:35.002429+0000","last_active":"2024-09-17T01:47:37.026977+0000","last_peered":"2024-09-17T01:47:37.026977+0000","last_clean":"2024-09-17T01:47:37.026977+0000","last_became_active":"2024-09-17T01:47:35.002120+0000","last_became_peered":"2024-09-17T01:47:35.002120+0000","last_unstale":"2024-09-17T01:47:37.026977+0000","last_undegraded":"2024-09-17T01:47:37.026977+0000","last_fullsized":"2024-09-17T01:47:37.026977+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:11.320142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.981820+0000","last_change":"2024-09-17T01:47:33.981820+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.981820+0000","last_undegraded":"2024-09-17T01:47:33.981820+0000","last_fullsized":"2024-09-17T01:47:33.981820+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.987606+0000","last_change":"2024-09-17T01:47:33.987606+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.987606+0000","last_undegraded":"2024-09-17T01:47:33.987606+0000","last_fullsized":"2024-09-17T01:47:33.987606+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":1,"reported_epoch":198,"state":"creating+peering","last_fresh":"2024-09-17T01:47:34.992027+0000","last_change":"2024-09-17T01:47:34.992027+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.992027+0000","last_undegraded":"2024-09-17T01:47:34.992027+0000","last_fullsized":"2024-09-17T01:47:34.992027+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.985703+0000","last_change":"2024-09-17T01:47:33.985703+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.985703+0000","last_undegraded":"2024-09-17T01:47:33.985703+0000","last_fullsized":"2024-09-17T01:47:33.985703+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.986918+0000","last_change":"2024-09-17T01:47:33.986918+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.986918+0000","last_undegraded":"2024-09-17T01:47:33.986918+0000","last_fullsized":"2024-09-17T01:47:33.986918+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.988269+0000","last_change":"2024-09-17T01:47:33.988269+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.988269+0000","last_undegraded":"2024-09-17T01:47:33.988269+0000","last_fullsized":"2024-09-17T01:47:33.988269+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027228+0000","last_change":"2024-09-17T01:47:36.035887+0000","last_active":"2024-09-17T01:47:37.027228+0000","last_peered":"2024-09-17T01:47:37.027228+0000","last_clean":"2024-09-17T01:47:37.027228+0000","last_became_active":"2024-09-17T01:47:36.034244+0000","last_became_peered":"2024-09-17T01:47:36.034244+0000","last_unstale":"2024-09-17T01:47:37.027228+0000","last_undegraded":"2024-09-17T01:47:37.027228+0000","last_fullsized":"2024-09-17T01:47:37.027228+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:55.140647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.e","version":"199'2","reported_seq":17,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027301+0000","last_change":"2024-09-17T01:47:35.007881+0000","last_active":"2024-09-17T01:47:37.027301+0000","last_peered":"2024-09-17T01:47:37.027301+0000","last_clean":"2024-09-17T01:47:37.027301+0000","last_became_active":"2024-09-17T01:47:35.006640+0000","last_became_peered":"2024-09-17T01:47:35.006640+0000","last_unstale":"2024-09-17T01:47:37.027301+0000","last_undegraded":"2024-09-17T01:47:37.027301+0000","last_fullsized":"2024-09-17T01:47:37.027301+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:06.636568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.989667+0000","last_change":"2024-09-17T01:47:33.989667+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.989667+0000","last_undegraded":"2024-09-17T01:47:33.989667+0000","last_fullsized":"2024-09-17T01:47:33.989667+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":1,"reported_epoch":198,"state":"creating+peering","last_fresh":"2024-09-17T01:47:34.991845+0000","last_change":"2024-09-17T01:47:34.991845+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.991845+0000","last_undegraded":"2024-09-17T01:47:34.991845+0000","last_fullsized":"2024-09-17T01:47:34.991845+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.985264+0000","last_change":"2024-09-17T01:47:33.985264+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.985264+0000","last_undegraded":"2024-09-17T01:47:33.985264+0000","last_fullsized":"2024-09-17T01:47:33.985264+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027186+0000","last_change":"2024-09-17T01:47:36.013751+0000","last_active":"2024-09-17T01:47:37.027186+0000","last_peered":"2024-09-17T01:47:37.027186+0000","last_clean":"2024-09-17T01:47:37.027186+0000","last_became_active":"2024-09-17T01:47:36.012914+0000","last_became_peered":"2024-09-17T01:47:36.012914+0000","last_unstale":"2024-09-17T01:47:37.027186+0000","last_undegraded":"2024-09-17T01:47:37.027186+0000","last_fullsized":"2024-09-17T01:47:37.027186+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:18.276994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.989422+0000","last_change":"2024-09-17T01:47:33.989422+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.989422+0000","last_undegraded":"2024-09-17T01:47:33.989422+0000","last_fullsized":"2024-09-17T01:47:33.989422+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":1,"reported_epoch":198,"state":"creating+peering","last_fresh":"2024-09-17T01:47:34.992655+0000","last_change":"2024-09-17T01:47:34.992655+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.992655+0000","last_undegraded":"2024-09-17T01:47:34.992655+0000","last_fullsized":"2024-09-17T01:47:34.992655+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.984638+0000","last_change":"2024-09-17T01:47:33.984638+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.984638+0000","last_undegraded":"2024-09-17T01:47:33.984638+0000","last_fullsized":"2024-09-17T01:47:33.984638+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.984636+0000","last_change":"2024-09-17T01:47:33.984636+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.984636+0000","last_undegraded":"2024-09-17T01:47:33.984636+0000","last_fullsized":"2024-09-17T01:47:33.984636+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.985357+0000","last_change":"2024-09-17T01:47:33.985357+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.985357+0000","last_undegraded":"2024-09-17T01:47:33.985357+0000","last_fullsized":"2024-09-17T01:47:33.985357+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027113+0000","last_change":"2024-09-17T01:47:36.022826+0000","last_active":"2024-09-17T01:47:37.027113+0000","last_peered":"2024-09-17T01:47:37.027113+0000","last_clean":"2024-09-17T01:47:37.027113+0000","last_became_active":"2024-09-17T01:47:36.022162+0000","last_became_peered":"2024-09-17T01:47:36.022162+0000","last_unstale":"2024-09-17T01:47:37.027113+0000","last_undegraded":"2024-09-17T01:47:37.027113+0000","last_fullsized":"2024-09-17T01:47:37.027113+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:40.708195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"199'2","reported_seq":17,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.026987+0000","last_change":"2024-09-17T01:47:35.008037+0000","last_active":"2024-09-17T01:47:37.026987+0000","last_peered":"2024-09-17T01:47:37.026987+0000","last_clean":"2024-09-17T01:47:37.026987+0000","last_became_active":"2024-09-17T01:47:35.007539+0000","last_became_peered":"2024-09-17T01:47:35.007539+0000","last_unstale":"2024-09-17T01:47:37.026987+0000","last_undegraded":"2024-09-17T01:47:37.026987+0000","last_fullsized":"2024-09-17T01:47:37.026987+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:02.783632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.989429+0000","last_change":"2024-09-17T01:47:33.989429+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.989429+0000","last_undegraded":"2024-09-17T01:47:33.989429+0000","last_fullsized":"2024-09-17T01:47:33.989429+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T01:47:35.005584+0000","last_change":"2024-09-17T01:47:35.000829+0000","last_active":"2024-09-17T01:47:35.005584+0000","last_peered":"2024-09-17T01:47:35.005584+0000","last_clean":"2024-09-17T01:47:35.005584+0000","last_became_active":"2024-09-17T01:47:35.000499+0000","last_became_peered":"2024-09-17T01:47:35.000499+0000","last_unstale":"2024-09-17T01:47:35.005584+0000","last_undegraded":"2024-09-17T01:47:35.005584+0000","last_fullsized":"2024-09-17T01:47:35.005584+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:40.712175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.984703+0000","last_change":"2024-09-17T01:47:33.984703+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.984703+0000","last_undegraded":"2024-09-17T01:47:33.984703+0000","last_fullsized":"2024-09-17T01:47:33.984703+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.985899+0000","last_change":"2024-09-17T01:47:33.985899+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.985899+0000","last_undegraded":"2024-09-17T01:47:33.985899+0000","last_fullsized":"2024-09-17T01:47:33.985899+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.987093+0000","last_change":"2024-09-17T01:47:33.987093+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.987093+0000","last_undegraded":"2024-09-17T01:47:33.987093+0000","last_fullsized":"2024-09-17T01:47:33.987093+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.981184+0000","last_change":"2024-09-17T01:47:33.981184+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.981184+0000","last_undegraded":"2024-09-17T01:47:33.981184+0000","last_fullsized":"2024-09-17T01:47:33.981184+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":1,"reported_epoch":198,"state":"creating+peering","last_fresh":"2024-09-17T01:47:34.991927+0000","last_change":"2024-09-17T01:47:34.991927+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.991927+0000","last_undegraded":"2024-09-17T01:47:34.991927+0000","last_fullsized":"2024-09-17T01:47:34.991927+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.988028+0000","last_change":"2024-09-17T01:47:33.988028+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.988028+0000","last_undegraded":"2024-09-17T01:47:33.988028+0000","last_fullsized":"2024-09-17T01:47:33.988028+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":1,"reported_epoch":198,"state":"creating+peering","last_fresh":"2024-09-17T01:47:34.993734+0000","last_change":"2024-09-17T01:47:34.993734+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.993734+0000","last_undegraded":"2024-09-17T01:47:34.993734+0000","last_fullsized":"2024-09-17T01:47:34.993734+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.990140+0000","last_change":"2024-09-17T01:47:33.990140+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.990140+0000","last_undegraded":"2024-09-17T01:47:33.990140+0000","last_fullsized":"2024-09-17T01:47:33.990140+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":446,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-17T01:47:33.990745+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:47:33.990745+0000","last_peered":"2024-09-17T01:47:33.990745+0000","last_clean":"2024-09-17T01:47:33.990745+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:47:33.990745+0000","last_undegraded":"2024-09-17T01:47:33.990745+0000","last_fullsized":"2024-09-17T01:47:33.990745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":2},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47512,"kb_used_data":2432,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324328,"statfs":{"total":96636764160,"available":96588111872,"internally_reserved":0,"allocated":2490368,"data_stored":1099995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509631,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55808,"kb_used_data":2408,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316032,"statfs":{"total":96636764160,"available":96579616768,"internally_reserved":0,"allocated":2465792,"data_stored":1087903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509630,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47496,"kb_used_data":2420,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324344,"statfs":{"total":96636764160,"available":96588128256,"internally_reserved":0,"allocated":2478080,"data_stored":1093720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509631,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51656,"kb_used_data":2420,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320184,"statfs":{"total":96636764160,"available":96583868416,"internally_reserved":0,"allocated":2478080,"data_stored":1093720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509631,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69640,"kb_used_data":2420,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302200,"statfs":{"total":96636764160,"available":96565452800,"internally_reserved":0,"allocated":2478080,"data_stored":1093720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509630,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52236,"kb_used_data":3000,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319604,"statfs":{"total":96636764160,"available":96583274496,"internally_reserved":0,"allocated":3072000,"data_stored":1684088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509632,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59976,"kb_used_data":2420,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311864,"statfs":{"total":96636764160,"available":96575348736,"internally_reserved":0,"allocated":2478080,"data_stored":1093720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":58915273},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542337,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52292,"kb_used_data":3052,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319548,"statfs":{"total":96636764160,"available":96583217152,"internally_reserved":0,"allocated":3125248,"data_stored":1705120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:47:40.483 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:47:40.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.749+0000 7f8360a00640 1 -- 172.21.15.42:0/2629813337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f835c142f40 msgr2=0x7f835c072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:40.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.749+0000 7f8360a00640 1 --2- 172.21.15.42:0/2629813337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f835c142f40 0x7f835c072950 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7f8344009830 tx=0x7f834402a480 comp rx=0 tx=0).stop 2024-09-17T01:47:40.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.749+0000 7f8360a00640 1 -- 172.21.15.42:0/2629813337 shutdown_connections 2024-09-17T01:47:40.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.749+0000 7f8360a00640 1 --2- 172.21.15.42:0/2629813337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f835c142f40 0x7f835c072950 unknown :-1 s=CLOSED pgs=2283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:40.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.749+0000 7f8360a00640 1 -- 172.21.15.42:0/2629813337 >> 172.21.15.42:0/2629813337 conn(0x7f835c0b2930 msgr2=0x7f835c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:40.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.749+0000 7f8360a00640 1 -- 172.21.15.42:0/2629813337 shutdown_connections 2024-09-17T01:47:40.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.749+0000 7f8360a00640 1 -- 172.21.15.42:0/2629813337 wait complete. 2024-09-17T01:47:40.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.751+0000 7f8360a00640 1 Processor -- start 2024-09-17T01:47:40.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.752+0000 7f8360a00640 1 -- start start 2024-09-17T01:47:40.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.753+0000 7f8360a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f835c072e90 0x7f835c1597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:40.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.753+0000 7f8360a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f835c0b3550 0x7f835c13c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:40.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.753+0000 7f8360a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f835c142f40 0x7f835c15bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:40.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.753+0000 7f8360a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f835c06d900 con 0x7f835c0b3550 2024-09-17T01:47:40.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.753+0000 7f8360a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f835c06d780 con 0x7f835c142f40 2024-09-17T01:47:40.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.753+0000 7f8360a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f835c06da80 con 0x7f835c072e90 2024-09-17T01:47:40.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.753+0000 7f8351400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f835c0b3550 0x7f835c13c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:40.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.753+0000 7f8351400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f835c0b3550 0x7f835c13c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52370/0 (socket says 172.21.15.42:52370) 2024-09-17T01:47:40.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.753+0000 7f8351400640 1 -- 172.21.15.42:0/1084526389 learned_addr learned my addr 172.21.15.42:0/1084526389 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:40.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.753+0000 7f8359e00640 1 --2- 172.21.15.42:0/1084526389 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f835c072e90 0x7f835c1597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:40.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.753+0000 7f835a800640 1 --2- 172.21.15.42:0/1084526389 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f835c142f40 0x7f835c15bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:40.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.754+0000 7f8351400640 1 -- 172.21.15.42:0/1084526389 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f835c072e90 msgr2=0x7f835c1597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:40.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.754+0000 7f8351400640 1 --2- 172.21.15.42:0/1084526389 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f835c072e90 0x7f835c1597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:40.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.754+0000 7f8351400640 1 -- 172.21.15.42:0/1084526389 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f835c142f40 msgr2=0x7f835c15bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:40.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.754+0000 7f8351400640 1 --2- 172.21.15.42:0/1084526389 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f835c142f40 0x7f835c15bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:40.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.754+0000 7f8351400640 1 -- 172.21.15.42:0/1084526389 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f835c1534e0 con 0x7f835c0b3550 2024-09-17T01:47:40.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.754+0000 7f8351400640 1 --2- 172.21.15.42:0/1084526389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f835c0b3550 0x7f835c13c170 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7f8344009920 tx=0x7f8344033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:40.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.754+0000 7f8352a00640 1 -- 172.21.15.42:0/1084526389 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8344031d60 con 0x7f835c0b3550 2024-09-17T01:47:40.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.754+0000 7f8352a00640 1 -- 172.21.15.42:0/1084526389 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8344033e10 con 0x7f835c0b3550 2024-09-17T01:47:40.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.754+0000 7f8360a00640 1 -- 172.21.15.42:0/1084526389 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f835c1537c0 con 0x7f835c0b3550 2024-09-17T01:47:40.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.754+0000 7f8352a00640 1 -- 172.21.15.42:0/1084526389 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83440332f0 con 0x7f835c0b3550 2024-09-17T01:47:40.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.755+0000 7f8360a00640 1 -- 172.21.15.42:0/1084526389 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f835c153d80 con 0x7f835c0b3550 2024-09-17T01:47:40.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.756+0000 7f8360a00640 1 -- 172.21.15.42:0/1084526389 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f835c155320 con 0x7f835c0b3550 2024-09-17T01:47:40.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.757+0000 7f8352a00640 1 -- 172.21.15.42:0/1084526389 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8344033490 con 0x7f835c0b3550 2024-09-17T01:47:40.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.757+0000 7f8352a00640 1 --2- 172.21.15.42:0/1084526389 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8338078b90 0x7f833807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:40.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.758+0000 7f8352a00640 1 -- 172.21.15.42:0/1084526389 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5709+0+0 (secure 0 0 0) 0x7f83440bc0c0 con 0x7f835c0b3550 2024-09-17T01:47:40.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.758+0000 7f8359e00640 1 --2- 172.21.15.42:0/1084526389 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8338078b90 0x7f833807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:40.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.759+0000 7f8359e00640 1 --2- 172.21.15.42:0/1084526389 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8338078b90 0x7f833807b0a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f834c006fd0 tx=0x7f834c009060 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:40.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.762+0000 7f8352a00640 1 -- 172.21.15.42:0/1084526389 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f834403f030 con 0x7f835c0b3550 2024-09-17T01:47:40.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.955+0000 7f8360a00640 1 -- 172.21.15.42:0/1084526389 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f835c153290 con 0x7f8338078b90 2024-09-17T01:47:40.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.960+0000 7f8352a00640 1 -- 172.21.15.42:0/1084526389 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242444 (secure 0 0 0) 0x7f835c153290 con 0x7f8338078b90 2024-09-17T01:47:40.959 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:40.962 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:47:40.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.964+0000 7f8360a00640 1 -- 172.21.15.42:0/1084526389 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8338078b90 msgr2=0x7f833807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:40.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.964+0000 7f8360a00640 1 --2- 172.21.15.42:0/1084526389 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8338078b90 0x7f833807b0a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f834c006fd0 tx=0x7f834c009060 comp rx=0 tx=0).stop 2024-09-17T01:47:40.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.964+0000 7f8360a00640 1 -- 172.21.15.42:0/1084526389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f835c0b3550 msgr2=0x7f835c13c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:40.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.964+0000 7f8360a00640 1 --2- 172.21.15.42:0/1084526389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f835c0b3550 0x7f835c13c170 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7f8344009920 tx=0x7f8344033c20 comp rx=0 tx=0).stop 2024-09-17T01:47:40.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.964+0000 7f8360a00640 1 -- 172.21.15.42:0/1084526389 shutdown_connections 2024-09-17T01:47:40.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.964+0000 7f8360a00640 1 --2- 172.21.15.42:0/1084526389 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8338078b90 0x7f833807b0a0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:40.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.964+0000 7f8360a00640 1 --2- 172.21.15.42:0/1084526389 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f835c142f40 0x7f835c15bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:40.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.964+0000 7f8360a00640 1 --2- 172.21.15.42:0/1084526389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f835c0b3550 0x7f835c13c170 unknown :-1 s=CLOSED pgs=2284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:40.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.964+0000 7f8360a00640 1 --2- 172.21.15.42:0/1084526389 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f835c072e90 0x7f835c1597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:40.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.964+0000 7f8360a00640 1 -- 172.21.15.42:0/1084526389 >> 172.21.15.42:0/1084526389 conn(0x7f835c0b2930 msgr2=0x7f835c0af770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:40.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.964+0000 7f8360a00640 1 -- 172.21.15.42:0/1084526389 shutdown_connections 2024-09-17T01:47:40.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:40.965+0000 7f8360a00640 1 -- 172.21.15.42:0/1084526389 wait complete. 2024-09-17T01:47:40.985 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":666,"stamp":"2024-09-17T01:47:39.247625+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":113,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":98,"acting":98,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":436616,"kb_used_data":20572,"kb_used_omap":12,"kb_used_meta":415859,"kb_avail":754538104,"statfs":{"total":773094113280,"available":772647018496,"internally_reserved":0,"allocated":21065728,"data_stored":9951986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":425840180},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.268776"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":1,"reported_epoch":198,"state":"creating+peering","last_fresh":"2024-09-17T01:47:34.998821+0000","last_change":"2024-09-17T01:47:34.998821+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.998821+0000","last_undegraded":"2024-09-17T01:47:34.998821+0000","last_fullsized":"2024-09-17T01:47:34.998821+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":1,"reported_epoch":198,"state":"creating+peering","last_fresh":"2024-09-17T01:47:34.997078+0000","last_change":"2024-09-17T01:47:34.997078+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.997078+0000","last_undegraded":"2024-09-17T01:47:34.997078+0000","last_fullsized":"2024-09-17T01:47:34.997078+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027218+0000","last_change":"2024-09-17T01:47:36.027786+0000","last_active":"2024-09-17T01:47:37.027218+0000","last_peered":"2024-09-17T01:47:37.027218+0000","last_clean":"2024-09-17T01:47:37.027218+0000","last_became_active":"2024-09-17T01:47:36.027311+0000","last_became_peered":"2024-09-17T01:47:36.027311+0000","last_unstale":"2024-09-17T01:47:37.027218+0000","last_undegraded":"2024-09-17T01:47:37.027218+0000","last_fullsized":"2024-09-17T01:47:37.027218+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:41.527675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027027+0000","last_change":"2024-09-17T01:47:36.023252+0000","last_active":"2024-09-17T01:47:37.027027+0000","last_peered":"2024-09-17T01:47:37.027027+0000","last_clean":"2024-09-17T01:47:37.027027+0000","last_became_active":"2024-09-17T01:47:36.022317+0000","last_became_peered":"2024-09-17T01:47:36.022317+0000","last_unstale":"2024-09-17T01:47:37.027027+0000","last_undegraded":"2024-09-17T01:47:37.027027+0000","last_fullsized":"2024-09-17T01:47:37.027027+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:15.810411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027246+0000","last_change":"2024-09-17T01:47:36.029064+0000","last_active":"2024-09-17T01:47:37.027246+0000","last_peered":"2024-09-17T01:47:37.027246+0000","last_clean":"2024-09-17T01:47:37.027246+0000","last_became_active":"2024-09-17T01:47:36.028613+0000","last_became_peered":"2024-09-17T01:47:36.028613+0000","last_unstale":"2024-09-17T01:47:37.027246+0000","last_undegraded":"2024-09-17T01:47:37.027246+0000","last_fullsized":"2024-09-17T01:47:37.027246+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:09.498750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":1,"reported_epoch":198,"state":"creating+peering","last_fresh":"2024-09-17T01:47:34.996508+0000","last_change":"2024-09-17T01:47:34.996508+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.996508+0000","last_undegraded":"2024-09-17T01:47:34.996508+0000","last_fullsized":"2024-09-17T01:47:34.996508+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.026945+0000","last_change":"2024-09-17T01:47:36.023965+0000","last_active":"2024-09-17T01:47:37.026945+0000","last_peered":"2024-09-17T01:47:37.026945+0000","last_clean":"2024-09-17T01:47:37.026945+0000","last_became_active":"2024-09-17T01:47:36.023148+0000","last_became_peered":"2024-09-17T01:47:36.023148+0000","last_unstale":"2024-09-17T01:47:37.026945+0000","last_undegraded":"2024-09-17T01:47:37.026945+0000","last_fullsized":"2024-09-17T01:47:37.026945+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:50.320950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.985674+0000","last_change":"2024-09-17T01:47:33.985674+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.985674+0000","last_undegraded":"2024-09-17T01:47:33.985674+0000","last_fullsized":"2024-09-17T01:47:33.985674+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.989986+0000","last_change":"2024-09-17T01:47:33.989986+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.989986+0000","last_undegraded":"2024-09-17T01:47:33.989986+0000","last_fullsized":"2024-09-17T01:47:33.989986+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":1,"reported_epoch":198,"state":"creating+peering","last_fresh":"2024-09-17T01:47:34.994387+0000","last_change":"2024-09-17T01:47:34.994387+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.994387+0000","last_undegraded":"2024-09-17T01:47:34.994387+0000","last_fullsized":"2024-09-17T01:47:34.994387+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.984871+0000","last_change":"2024-09-17T01:47:33.984871+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.984871+0000","last_undegraded":"2024-09-17T01:47:33.984871+0000","last_fullsized":"2024-09-17T01:47:33.984871+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.985170+0000","last_change":"2024-09-17T01:47:33.985170+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.985170+0000","last_undegraded":"2024-09-17T01:47:33.985170+0000","last_fullsized":"2024-09-17T01:47:33.985170+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.988053+0000","last_change":"2024-09-17T01:47:33.988053+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.988053+0000","last_undegraded":"2024-09-17T01:47:33.988053+0000","last_fullsized":"2024-09-17T01:47:33.988053+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T01:47:35.002235+0000","last_change":"2024-09-17T01:47:34.996555+0000","last_active":"2024-09-17T01:47:35.002235+0000","last_peered":"2024-09-17T01:47:35.002235+0000","last_clean":"2024-09-17T01:47:35.002235+0000","last_became_active":"2024-09-17T01:47:34.996193+0000","last_became_peered":"2024-09-17T01:47:34.996193+0000","last_unstale":"2024-09-17T01:47:35.002235+0000","last_undegraded":"2024-09-17T01:47:35.002235+0000","last_fullsized":"2024-09-17T01:47:35.002235+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:51.198589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.026608+0000","last_change":"2024-09-17T01:47:34.999663+0000","last_active":"2024-09-17T01:47:37.026608+0000","last_peered":"2024-09-17T01:47:37.026608+0000","last_clean":"2024-09-17T01:47:37.026608+0000","last_became_active":"2024-09-17T01:47:34.999310+0000","last_became_peered":"2024-09-17T01:47:34.999310+0000","last_unstale":"2024-09-17T01:47:37.026608+0000","last_undegraded":"2024-09-17T01:47:37.026608+0000","last_fullsized":"2024-09-17T01:47:37.026608+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:29.080659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.989987+0000","last_change":"2024-09-17T01:47:33.989987+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.989987+0000","last_undegraded":"2024-09-17T01:47:33.989987+0000","last_fullsized":"2024-09-17T01:47:33.989987+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.985490+0000","last_change":"2024-09-17T01:47:33.985490+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.985490+0000","last_undegraded":"2024-09-17T01:47:33.985490+0000","last_fullsized":"2024-09-17T01:47:33.985490+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.981497+0000","last_change":"2024-09-17T01:47:33.981497+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.981497+0000","last_undegraded":"2024-09-17T01:47:33.981497+0000","last_fullsized":"2024-09-17T01:47:33.981497+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.14","version":"199'6","reported_seq":21,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.026977+0000","last_change":"2024-09-17T01:47:35.002429+0000","last_active":"2024-09-17T01:47:37.026977+0000","last_peered":"2024-09-17T01:47:37.026977+0000","last_clean":"2024-09-17T01:47:37.026977+0000","last_became_active":"2024-09-17T01:47:35.002120+0000","last_became_peered":"2024-09-17T01:47:35.002120+0000","last_unstale":"2024-09-17T01:47:37.026977+0000","last_undegraded":"2024-09-17T01:47:37.026977+0000","last_fullsized":"2024-09-17T01:47:37.026977+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:11.320142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.981820+0000","last_change":"2024-09-17T01:47:33.981820+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.981820+0000","last_undegraded":"2024-09-17T01:47:33.981820+0000","last_fullsized":"2024-09-17T01:47:33.981820+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.987606+0000","last_change":"2024-09-17T01:47:33.987606+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.987606+0000","last_undegraded":"2024-09-17T01:47:33.987606+0000","last_fullsized":"2024-09-17T01:47:33.987606+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":1,"reported_epoch":198,"state":"creating+peering","last_fresh":"2024-09-17T01:47:34.992027+0000","last_change":"2024-09-17T01:47:34.992027+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.992027+0000","last_undegraded":"2024-09-17T01:47:34.992027+0000","last_fullsized":"2024-09-17T01:47:34.992027+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.985703+0000","last_change":"2024-09-17T01:47:33.985703+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.985703+0000","last_undegraded":"2024-09-17T01:47:33.985703+0000","last_fullsized":"2024-09-17T01:47:33.985703+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.986918+0000","last_change":"2024-09-17T01:47:33.986918+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.986918+0000","last_undegraded":"2024-09-17T01:47:33.986918+0000","last_fullsized":"2024-09-17T01:47:33.986918+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.988269+0000","last_change":"2024-09-17T01:47:33.988269+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.988269+0000","last_undegraded":"2024-09-17T01:47:33.988269+0000","last_fullsized":"2024-09-17T01:47:33.988269+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027228+0000","last_change":"2024-09-17T01:47:36.035887+0000","last_active":"2024-09-17T01:47:37.027228+0000","last_peered":"2024-09-17T01:47:37.027228+0000","last_clean":"2024-09-17T01:47:37.027228+0000","last_became_active":"2024-09-17T01:47:36.034244+0000","last_became_peered":"2024-09-17T01:47:36.034244+0000","last_unstale":"2024-09-17T01:47:37.027228+0000","last_undegraded":"2024-09-17T01:47:37.027228+0000","last_fullsized":"2024-09-17T01:47:37.027228+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:55.140647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.e","version":"199'2","reported_seq":17,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027301+0000","last_change":"2024-09-17T01:47:35.007881+0000","last_active":"2024-09-17T01:47:37.027301+0000","last_peered":"2024-09-17T01:47:37.027301+0000","last_clean":"2024-09-17T01:47:37.027301+0000","last_became_active":"2024-09-17T01:47:35.006640+0000","last_became_peered":"2024-09-17T01:47:35.006640+0000","last_unstale":"2024-09-17T01:47:37.027301+0000","last_undegraded":"2024-09-17T01:47:37.027301+0000","last_fullsized":"2024-09-17T01:47:37.027301+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:06.636568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.989667+0000","last_change":"2024-09-17T01:47:33.989667+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.989667+0000","last_undegraded":"2024-09-17T01:47:33.989667+0000","last_fullsized":"2024-09-17T01:47:33.989667+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":1,"reported_epoch":198,"state":"creating+peering","last_fresh":"2024-09-17T01:47:34.991845+0000","last_change":"2024-09-17T01:47:34.991845+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.991845+0000","last_undegraded":"2024-09-17T01:47:34.991845+0000","last_fullsized":"2024-09-17T01:47:34.991845+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.985264+0000","last_change":"2024-09-17T01:47:33.985264+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.985264+0000","last_undegraded":"2024-09-17T01:47:33.985264+0000","last_fullsized":"2024-09-17T01:47:33.985264+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027186+0000","last_change":"2024-09-17T01:47:36.013751+0000","last_active":"2024-09-17T01:47:37.027186+0000","last_peered":"2024-09-17T01:47:37.027186+0000","last_clean":"2024-09-17T01:47:37.027186+0000","last_became_active":"2024-09-17T01:47:36.012914+0000","last_became_peered":"2024-09-17T01:47:36.012914+0000","last_unstale":"2024-09-17T01:47:37.027186+0000","last_undegraded":"2024-09-17T01:47:37.027186+0000","last_fullsized":"2024-09-17T01:47:37.027186+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:18.276994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.989422+0000","last_change":"2024-09-17T01:47:33.989422+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.989422+0000","last_undegraded":"2024-09-17T01:47:33.989422+0000","last_fullsized":"2024-09-17T01:47:33.989422+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":1,"reported_epoch":198,"state":"creating+peering","last_fresh":"2024-09-17T01:47:34.992655+0000","last_change":"2024-09-17T01:47:34.992655+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.992655+0000","last_undegraded":"2024-09-17T01:47:34.992655+0000","last_fullsized":"2024-09-17T01:47:34.992655+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.984638+0000","last_change":"2024-09-17T01:47:33.984638+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.984638+0000","last_undegraded":"2024-09-17T01:47:33.984638+0000","last_fullsized":"2024-09-17T01:47:33.984638+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.984636+0000","last_change":"2024-09-17T01:47:33.984636+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.984636+0000","last_undegraded":"2024-09-17T01:47:33.984636+0000","last_fullsized":"2024-09-17T01:47:33.984636+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.985357+0000","last_change":"2024-09-17T01:47:33.985357+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.985357+0000","last_undegraded":"2024-09-17T01:47:33.985357+0000","last_fullsized":"2024-09-17T01:47:33.985357+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027113+0000","last_change":"2024-09-17T01:47:36.022826+0000","last_active":"2024-09-17T01:47:37.027113+0000","last_peered":"2024-09-17T01:47:37.027113+0000","last_clean":"2024-09-17T01:47:37.027113+0000","last_became_active":"2024-09-17T01:47:36.022162+0000","last_became_peered":"2024-09-17T01:47:36.022162+0000","last_unstale":"2024-09-17T01:47:37.027113+0000","last_undegraded":"2024-09-17T01:47:37.027113+0000","last_fullsized":"2024-09-17T01:47:37.027113+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:40.708195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"199'2","reported_seq":17,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.026987+0000","last_change":"2024-09-17T01:47:35.008037+0000","last_active":"2024-09-17T01:47:37.026987+0000","last_peered":"2024-09-17T01:47:37.026987+0000","last_clean":"2024-09-17T01:47:37.026987+0000","last_became_active":"2024-09-17T01:47:35.007539+0000","last_became_peered":"2024-09-17T01:47:35.007539+0000","last_unstale":"2024-09-17T01:47:37.026987+0000","last_undegraded":"2024-09-17T01:47:37.026987+0000","last_fullsized":"2024-09-17T01:47:37.026987+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:02.783632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.989429+0000","last_change":"2024-09-17T01:47:33.989429+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.989429+0000","last_undegraded":"2024-09-17T01:47:33.989429+0000","last_fullsized":"2024-09-17T01:47:33.989429+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":10,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-17T01:47:35.005584+0000","last_change":"2024-09-17T01:47:35.000829+0000","last_active":"2024-09-17T01:47:35.005584+0000","last_peered":"2024-09-17T01:47:35.005584+0000","last_clean":"2024-09-17T01:47:35.005584+0000","last_became_active":"2024-09-17T01:47:35.000499+0000","last_became_peered":"2024-09-17T01:47:35.000499+0000","last_unstale":"2024-09-17T01:47:35.005584+0000","last_undegraded":"2024-09-17T01:47:35.005584+0000","last_fullsized":"2024-09-17T01:47:35.005584+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:40.712175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.984703+0000","last_change":"2024-09-17T01:47:33.984703+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.984703+0000","last_undegraded":"2024-09-17T01:47:33.984703+0000","last_fullsized":"2024-09-17T01:47:33.984703+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.985899+0000","last_change":"2024-09-17T01:47:33.985899+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.985899+0000","last_undegraded":"2024-09-17T01:47:33.985899+0000","last_fullsized":"2024-09-17T01:47:33.985899+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.987093+0000","last_change":"2024-09-17T01:47:33.987093+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.987093+0000","last_undegraded":"2024-09-17T01:47:33.987093+0000","last_fullsized":"2024-09-17T01:47:33.987093+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:47:34.977594+0000","last_change":"2024-09-17T01:47:34.977594+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.977594+0000","last_undegraded":"2024-09-17T01:47:34.977594+0000","last_fullsized":"2024-09-17T01:47:34.977594+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.981184+0000","last_change":"2024-09-17T01:47:33.981184+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.981184+0000","last_undegraded":"2024-09-17T01:47:33.981184+0000","last_fullsized":"2024-09-17T01:47:33.981184+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":1,"reported_epoch":198,"state":"creating+peering","last_fresh":"2024-09-17T01:47:34.991927+0000","last_change":"2024-09-17T01:47:34.991927+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.991927+0000","last_undegraded":"2024-09-17T01:47:34.991927+0000","last_fullsized":"2024-09-17T01:47:34.991927+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.988028+0000","last_change":"2024-09-17T01:47:33.988028+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.988028+0000","last_undegraded":"2024-09-17T01:47:33.988028+0000","last_fullsized":"2024-09-17T01:47:33.988028+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":1,"reported_epoch":198,"state":"creating+peering","last_fresh":"2024-09-17T01:47:34.993734+0000","last_change":"2024-09-17T01:47:34.993734+0000","last_active":"2024-09-17T01:47:34.977594+0000","last_peered":"2024-09-17T01:47:34.977594+0000","last_clean":"2024-09-17T01:47:34.977594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:34.993734+0000","last_undegraded":"2024-09-17T01:47:34.993734+0000","last_fullsized":"2024-09-17T01:47:34.993734+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":1,"reported_epoch":197,"state":"creating+peering","last_fresh":"2024-09-17T01:47:33.990140+0000","last_change":"2024-09-17T01:47:33.990140+0000","last_active":"2024-09-17T01:47:33.971110+0000","last_peered":"2024-09-17T01:47:33.971110+0000","last_clean":"2024-09-17T01:47:33.971110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:47:33.990140+0000","last_undegraded":"2024-09-17T01:47:33.990140+0000","last_fullsized":"2024-09-17T01:47:33.990140+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":446,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-17T01:47:33.990745+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:47:33.990745+0000","last_peered":"2024-09-17T01:47:33.990745+0000","last_clean":"2024-09-17T01:47:33.990745+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:47:33.990745+0000","last_undegraded":"2024-09-17T01:47:33.990745+0000","last_fullsized":"2024-09-17T01:47:33.990745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":2},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47512,"kb_used_data":2432,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324328,"statfs":{"total":96636764160,"available":96588111872,"internally_reserved":0,"allocated":2490368,"data_stored":1099995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509631,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55808,"kb_used_data":2408,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316032,"statfs":{"total":96636764160,"available":96579616768,"internally_reserved":0,"allocated":2465792,"data_stored":1087903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509630,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47496,"kb_used_data":2420,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324344,"statfs":{"total":96636764160,"available":96588128256,"internally_reserved":0,"allocated":2478080,"data_stored":1093720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509631,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51656,"kb_used_data":2420,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320184,"statfs":{"total":96636764160,"available":96583868416,"internally_reserved":0,"allocated":2478080,"data_stored":1093720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509631,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69640,"kb_used_data":2420,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302200,"statfs":{"total":96636764160,"available":96565452800,"internally_reserved":0,"allocated":2478080,"data_stored":1093720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509630,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52236,"kb_used_data":3000,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319604,"statfs":{"total":96636764160,"available":96583274496,"internally_reserved":0,"allocated":3072000,"data_stored":1684088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509632,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59976,"kb_used_data":2420,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311864,"statfs":{"total":96636764160,"available":96575348736,"internally_reserved":0,"allocated":2478080,"data_stored":1093720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":58915273},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542337,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52292,"kb_used_data":3052,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319548,"statfs":{"total":96636764160,"available":96583217152,"internally_reserved":0,"allocated":3125248,"data_stored":1705120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:47:40.989 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:47:41.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.258+0000 7f43d4a00640 1 -- 172.21.15.42:0/2190338693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43b4003a00 msgr2=0x7f43b4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:41.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.258+0000 7f43d4a00640 1 --2- 172.21.15.42:0/2190338693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43b4003a00 0x7f43b4003e70 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009b50 tx=0x7f43b4005830 comp rx=0 tx=0).stop 2024-09-17T01:47:41.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.258+0000 7f43cf200640 1 -- 172.21.15.42:0/2190338693 reap_dead start 2024-09-17T01:47:41.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.258+0000 7f43d4a00640 1 -- 172.21.15.42:0/2190338693 shutdown_connections 2024-09-17T01:47:41.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.258+0000 7f43d4a00640 1 -- 172.21.15.42:0/2190338693 >> 172.21.15.42:0/2190338693 conn(0x7f43d00b25f0 msgr2=0x7f43d00d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:41.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.258+0000 7f43d4a00640 1 -- 172.21.15.42:0/2190338693 shutdown_connections 2024-09-17T01:47:41.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.258+0000 7f43d4a00640 1 -- 172.21.15.42:0/2190338693 wait complete. 2024-09-17T01:47:41.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.260+0000 7f43d4a00640 1 Processor -- start 2024-09-17T01:47:41.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.260+0000 7f43d4a00640 1 -- start start 2024-09-17T01:47:41.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.262+0000 7f43d4a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43b4003a00 0x7f43d009de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:41.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.262+0000 7f43d4a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f43d0149730 0x7f43d00c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:41.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.262+0000 7f43d4a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43d00c9960 0x7f43d00ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:41.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.262+0000 7f43d4a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f43d0152ed0 con 0x7f43d00c9960 2024-09-17T01:47:41.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.262+0000 7f43d4a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f43d006d640 con 0x7f43b4003a00 2024-09-17T01:47:41.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.262+0000 7f43d4a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f43d0153050 con 0x7f43d0149730 2024-09-17T01:47:41.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.262+0000 7f43cf200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43d00c9960 0x7f43d00ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:41.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.262+0000 7f43cf200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43d00c9960 0x7f43d00ca760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52390/0 (socket says 172.21.15.42:52390) 2024-09-17T01:47:41.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.262+0000 7f43cf200640 1 -- 172.21.15.42:0/3283189894 learned_addr learned my addr 172.21.15.42:0/3283189894 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:41.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.262+0000 7f43ce800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43b4003a00 0x7f43d009de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:41.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.262+0000 7f43c7e00640 1 --2- 172.21.15.42:0/3283189894 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f43d0149730 0x7f43d00c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:41.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.263+0000 7f43cf200640 1 -- 172.21.15.42:0/3283189894 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f43d0149730 msgr2=0x7f43d00c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:41.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.263+0000 7f43cf200640 1 --2- 172.21.15.42:0/3283189894 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f43d0149730 0x7f43d00c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:41.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.263+0000 7f43cf200640 1 -- 172.21.15.42:0/3283189894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43b4003a00 msgr2=0x7f43d009de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:41.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.263+0000 7f43cf200640 1 --2- 172.21.15.42:0/3283189894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43b4003a00 0x7f43d009de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:41.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.263+0000 7f43cf200640 1 -- 172.21.15.42:0/3283189894 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d00c9d70 con 0x7f43d00c9960 2024-09-17T01:47:41.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.263+0000 7f43ce800640 1 --2- 172.21.15.42:0/3283189894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43b4003a00 0x7f43d009de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:47:41.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.263+0000 7f43cf200640 1 --2- 172.21.15.42:0/3283189894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43d00c9960 0x7f43d00ca760 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 crypto rx=0x7f43c8005fd0 tx=0x7f43c8010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:41.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.263+0000 7f43c6a00640 1 -- 172.21.15.42:0/3283189894 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c800ee20 con 0x7f43d00c9960 2024-09-17T01:47:41.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.263+0000 7f43c6a00640 1 -- 172.21.15.42:0/3283189894 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43c8015070 con 0x7f43d00c9960 2024-09-17T01:47:41.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.263+0000 7f43c6a00640 1 -- 172.21.15.42:0/3283189894 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c8003d00 con 0x7f43d00c9960 2024-09-17T01:47:41.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.263+0000 7f43d4a00640 1 -- 172.21.15.42:0/3283189894 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43d014c590 con 0x7f43d00c9960 2024-09-17T01:47:41.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.263+0000 7f43d4a00640 1 -- 172.21.15.42:0/3283189894 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43d014cb50 con 0x7f43d00c9960 2024-09-17T01:47:41.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.264+0000 7f43d4a00640 1 -- 172.21.15.42:0/3283189894 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43d015d6b0 con 0x7f43d00c9960 2024-09-17T01:47:41.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.266+0000 7f43c6a00640 1 -- 172.21.15.42:0/3283189894 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f43c8004030 con 0x7f43d00c9960 2024-09-17T01:47:41.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.267+0000 7f43c6a00640 1 --2- 172.21.15.42:0/3283189894 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f43ac078b90 0x7f43ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:41.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.267+0000 7f43c6a00640 1 -- 172.21.15.42:0/3283189894 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5709+0+0 (secure 0 0 0) 0x7f43c809b5d0 con 0x7f43d00c9960 2024-09-17T01:47:41.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.267+0000 7f43ce800640 1 --2- 172.21.15.42:0/3283189894 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f43ac078b90 0x7f43ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:41.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.268+0000 7f43ce800640 1 --2- 172.21.15.42:0/3283189894 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f43ac078b90 0x7f43ac07b0a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f43c0035000 tx=0x7f43c002d040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:41.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.271+0000 7f43c6a00640 1 -- 172.21.15.42:0/3283189894 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f43d00c9d70 con 0x7f43d00c9960 2024-09-17T01:47:41.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.463+0000 7f43d4a00640 1 -- 172.21.15.42:0/3283189894 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f43d0152b20 con 0x7f43ac078b90 2024-09-17T01:47:41.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.469+0000 7f43c6a00640 1 -- 172.21.15.42:0/3283189894 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252481 (secure 0 0 0) 0x7f43d0152b20 con 0x7f43ac078b90 2024-09-17T01:47:41.471 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:41.472 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:47:41.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.473+0000 7f43d4a00640 1 -- 172.21.15.42:0/3283189894 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f43ac078b90 msgr2=0x7f43ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:41.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.473+0000 7f43d4a00640 1 --2- 172.21.15.42:0/3283189894 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f43ac078b90 0x7f43ac07b0a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f43c0035000 tx=0x7f43c002d040 comp rx=0 tx=0).stop 2024-09-17T01:47:41.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.473+0000 7f43d4a00640 1 -- 172.21.15.42:0/3283189894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43d00c9960 msgr2=0x7f43d00ca760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:41.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.473+0000 7f43d4a00640 1 --2- 172.21.15.42:0/3283189894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43d00c9960 0x7f43d00ca760 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 crypto rx=0x7f43c8005fd0 tx=0x7f43c8010e80 comp rx=0 tx=0).stop 2024-09-17T01:47:41.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.473+0000 7f43d4a00640 1 -- 172.21.15.42:0/3283189894 shutdown_connections 2024-09-17T01:47:41.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.473+0000 7f43d4a00640 1 --2- 172.21.15.42:0/3283189894 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f43ac078b90 0x7f43ac07b0a0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:41.474 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.473+0000 7f43d4a00640 1 --2- 172.21.15.42:0/3283189894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43d00c9960 0x7f43d00ca760 unknown :-1 s=CLOSED pgs=2287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:41.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.473+0000 7f43d4a00640 1 --2- 172.21.15.42:0/3283189894 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f43d0149730 0x7f43d00c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:41.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.473+0000 7f43d4a00640 1 --2- 172.21.15.42:0/3283189894 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43b4003a00 0x7f43d009de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:41.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.473+0000 7f43d4a00640 1 -- 172.21.15.42:0/3283189894 >> 172.21.15.42:0/3283189894 conn(0x7f43d00b25f0 msgr2=0x7f43d0150fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:41.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.473+0000 7f43d4a00640 1 -- 172.21.15.42:0/3283189894 shutdown_connections 2024-09-17T01:47:41.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.473+0000 7f43d4a00640 1 -- 172.21.15.42:0/3283189894 wait complete. 2024-09-17T01:47:41.494 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":667,"stamp":"2024-09-17T01:47:41.248190+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":436912,"kb_used_data":20872,"kb_used_omap":12,"kb_used_meta":415859,"kb_avail":754537808,"statfs":{"total":773094113280,"available":772646715392,"internally_reserved":0,"allocated":21372928,"data_stored":10090116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":425840180},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.266155"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000743+0000","last_change":"2024-09-17T01:47:36.013882+0000","last_active":"2024-09-17T01:47:37.000743+0000","last_peered":"2024-09-17T01:47:37.000743+0000","last_clean":"2024-09-17T01:47:37.000743+0000","last_became_active":"2024-09-17T01:47:36.013578+0000","last_became_peered":"2024-09-17T01:47:36.013578+0000","last_unstale":"2024-09-17T01:47:37.000743+0000","last_undegraded":"2024-09-17T01:47:37.000743+0000","last_fullsized":"2024-09-17T01:47:37.000743+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:36.234339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152688+0000","last_change":"2024-09-17T01:47:36.034685+0000","last_active":"2024-09-17T01:47:37.152688+0000","last_peered":"2024-09-17T01:47:37.152688+0000","last_clean":"2024-09-17T01:47:37.152688+0000","last_became_active":"2024-09-17T01:47:36.030145+0000","last_became_peered":"2024-09-17T01:47:36.030145+0000","last_unstale":"2024-09-17T01:47:37.152688+0000","last_undegraded":"2024-09-17T01:47:37.152688+0000","last_fullsized":"2024-09-17T01:47:37.152688+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:09.577267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152499+0000","last_change":"2024-09-17T01:47:36.019883+0000","last_active":"2024-09-17T01:47:37.152499+0000","last_peered":"2024-09-17T01:47:37.152499+0000","last_clean":"2024-09-17T01:47:37.152499+0000","last_became_active":"2024-09-17T01:47:36.019574+0000","last_became_peered":"2024-09-17T01:47:36.019574+0000","last_unstale":"2024-09-17T01:47:37.152499+0000","last_undegraded":"2024-09-17T01:47:37.152499+0000","last_fullsized":"2024-09-17T01:47:37.152499+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:20.853645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001547+0000","last_change":"2024-09-17T01:47:36.008580+0000","last_active":"2024-09-17T01:47:37.001547+0000","last_peered":"2024-09-17T01:47:37.001547+0000","last_clean":"2024-09-17T01:47:37.001547+0000","last_became_active":"2024-09-17T01:47:36.007880+0000","last_became_peered":"2024-09-17T01:47:36.007880+0000","last_unstale":"2024-09-17T01:47:37.001547+0000","last_undegraded":"2024-09-17T01:47:37.001547+0000","last_fullsized":"2024-09-17T01:47:37.001547+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:39.331109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000392+0000","last_change":"2024-09-17T01:47:36.018758+0000","last_active":"2024-09-17T01:47:37.000392+0000","last_peered":"2024-09-17T01:47:37.000392+0000","last_clean":"2024-09-17T01:47:37.000392+0000","last_became_active":"2024-09-17T01:47:36.018420+0000","last_became_peered":"2024-09-17T01:47:36.018420+0000","last_unstale":"2024-09-17T01:47:37.000392+0000","last_undegraded":"2024-09-17T01:47:37.000392+0000","last_fullsized":"2024-09-17T01:47:37.000392+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:23.469329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151844+0000","last_change":"2024-09-17T01:47:36.029635+0000","last_active":"2024-09-17T01:47:37.151844+0000","last_peered":"2024-09-17T01:47:37.151844+0000","last_clean":"2024-09-17T01:47:37.151844+0000","last_became_active":"2024-09-17T01:47:36.028833+0000","last_became_peered":"2024-09-17T01:47:36.028833+0000","last_unstale":"2024-09-17T01:47:37.151844+0000","last_undegraded":"2024-09-17T01:47:37.151844+0000","last_fullsized":"2024-09-17T01:47:37.151844+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:08.153607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151034+0000","last_change":"2024-09-17T01:47:36.015851+0000","last_active":"2024-09-17T01:47:37.151034+0000","last_peered":"2024-09-17T01:47:37.151034+0000","last_clean":"2024-09-17T01:47:37.151034+0000","last_became_active":"2024-09-17T01:47:36.015545+0000","last_became_peered":"2024-09-17T01:47:36.015545+0000","last_unstale":"2024-09-17T01:47:37.151034+0000","last_undegraded":"2024-09-17T01:47:37.151034+0000","last_fullsized":"2024-09-17T01:47:37.151034+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:22.526093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001282+0000","last_change":"2024-09-17T01:47:36.014686+0000","last_active":"2024-09-17T01:47:37.001282+0000","last_peered":"2024-09-17T01:47:37.001282+0000","last_clean":"2024-09-17T01:47:37.001282+0000","last_became_active":"2024-09-17T01:47:36.012351+0000","last_became_peered":"2024-09-17T01:47:36.012351+0000","last_unstale":"2024-09-17T01:47:37.001282+0000","last_undegraded":"2024-09-17T01:47:37.001282+0000","last_fullsized":"2024-09-17T01:47:37.001282+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:22:12.658086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151530+0000","last_change":"2024-09-17T01:47:36.028094+0000","last_active":"2024-09-17T01:47:37.151530+0000","last_peered":"2024-09-17T01:47:37.151530+0000","last_clean":"2024-09-17T01:47:37.151530+0000","last_became_active":"2024-09-17T01:47:36.027777+0000","last_became_peered":"2024-09-17T01:47:36.027777+0000","last_unstale":"2024-09-17T01:47:37.151530+0000","last_undegraded":"2024-09-17T01:47:37.151530+0000","last_fullsized":"2024-09-17T01:47:37.151530+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:17:00.239100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001305+0000","last_change":"2024-09-17T01:47:36.018027+0000","last_active":"2024-09-17T01:47:37.001305+0000","last_peered":"2024-09-17T01:47:37.001305+0000","last_clean":"2024-09-17T01:47:37.001305+0000","last_became_active":"2024-09-17T01:47:36.017347+0000","last_became_peered":"2024-09-17T01:47:36.017347+0000","last_unstale":"2024-09-17T01:47:37.001305+0000","last_undegraded":"2024-09-17T01:47:37.001305+0000","last_fullsized":"2024-09-17T01:47:37.001305+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:09.444067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152742+0000","last_change":"2024-09-17T01:47:36.034343+0000","last_active":"2024-09-17T01:47:37.152742+0000","last_peered":"2024-09-17T01:47:37.152742+0000","last_clean":"2024-09-17T01:47:37.152742+0000","last_became_active":"2024-09-17T01:47:36.026493+0000","last_became_peered":"2024-09-17T01:47:36.026493+0000","last_unstale":"2024-09-17T01:47:37.152742+0000","last_undegraded":"2024-09-17T01:47:37.152742+0000","last_fullsized":"2024-09-17T01:47:37.152742+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:00.861850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.153324+0000","last_change":"2024-09-17T01:47:36.017169+0000","last_active":"2024-09-17T01:47:37.153324+0000","last_peered":"2024-09-17T01:47:37.153324+0000","last_clean":"2024-09-17T01:47:37.153324+0000","last_became_active":"2024-09-17T01:47:36.016869+0000","last_became_peered":"2024-09-17T01:47:36.016869+0000","last_unstale":"2024-09-17T01:47:37.153324+0000","last_undegraded":"2024-09-17T01:47:37.153324+0000","last_fullsized":"2024-09-17T01:47:37.153324+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:09.444067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999712+0000","last_change":"2024-09-17T01:47:36.013822+0000","last_active":"2024-09-17T01:47:36.999712+0000","last_peered":"2024-09-17T01:47:36.999712+0000","last_clean":"2024-09-17T01:47:36.999712+0000","last_became_active":"2024-09-17T01:47:36.013426+0000","last_became_peered":"2024-09-17T01:47:36.013426+0000","last_unstale":"2024-09-17T01:47:36.999712+0000","last_undegraded":"2024-09-17T01:47:36.999712+0000","last_fullsized":"2024-09-17T01:47:36.999712+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:56.911080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151673+0000","last_change":"2024-09-17T01:47:36.014797+0000","last_active":"2024-09-17T01:47:37.151673+0000","last_peered":"2024-09-17T01:47:37.151673+0000","last_clean":"2024-09-17T01:47:37.151673+0000","last_became_active":"2024-09-17T01:47:36.014494+0000","last_became_peered":"2024-09-17T01:47:36.014494+0000","last_unstale":"2024-09-17T01:47:37.151673+0000","last_undegraded":"2024-09-17T01:47:37.151673+0000","last_fullsized":"2024-09-17T01:47:37.151673+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:47:34.470006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151691+0000","last_change":"2024-09-17T01:47:36.020290+0000","last_active":"2024-09-17T01:47:37.151691+0000","last_peered":"2024-09-17T01:47:37.151691+0000","last_clean":"2024-09-17T01:47:37.151691+0000","last_became_active":"2024-09-17T01:47:36.019511+0000","last_became_peered":"2024-09-17T01:47:36.019511+0000","last_unstale":"2024-09-17T01:47:37.151691+0000","last_undegraded":"2024-09-17T01:47:37.151691+0000","last_fullsized":"2024-09-17T01:47:37.151691+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:41.467333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151267+0000","last_change":"2024-09-17T01:47:36.023298+0000","last_active":"2024-09-17T01:47:37.151267+0000","last_peered":"2024-09-17T01:47:37.151267+0000","last_clean":"2024-09-17T01:47:37.151267+0000","last_became_active":"2024-09-17T01:47:36.022864+0000","last_became_peered":"2024-09-17T01:47:36.022864+0000","last_unstale":"2024-09-17T01:47:37.151267+0000","last_undegraded":"2024-09-17T01:47:37.151267+0000","last_fullsized":"2024-09-17T01:47:37.151267+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:36.823475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000776+0000","last_change":"2024-09-17T01:47:36.013172+0000","last_active":"2024-09-17T01:47:37.000776+0000","last_peered":"2024-09-17T01:47:37.000776+0000","last_clean":"2024-09-17T01:47:37.000776+0000","last_became_active":"2024-09-17T01:47:36.012831+0000","last_became_peered":"2024-09-17T01:47:36.012831+0000","last_unstale":"2024-09-17T01:47:37.000776+0000","last_undegraded":"2024-09-17T01:47:37.000776+0000","last_fullsized":"2024-09-17T01:47:37.000776+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:28.673161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027218+0000","last_change":"2024-09-17T01:47:36.027786+0000","last_active":"2024-09-17T01:47:37.027218+0000","last_peered":"2024-09-17T01:47:37.027218+0000","last_clean":"2024-09-17T01:47:37.027218+0000","last_became_active":"2024-09-17T01:47:36.027311+0000","last_became_peered":"2024-09-17T01:47:36.027311+0000","last_unstale":"2024-09-17T01:47:37.027218+0000","last_undegraded":"2024-09-17T01:47:37.027218+0000","last_fullsized":"2024-09-17T01:47:37.027218+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:41.527675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152142+0000","last_change":"2024-09-17T01:47:36.021267+0000","last_active":"2024-09-17T01:47:37.152142+0000","last_peered":"2024-09-17T01:47:37.152142+0000","last_clean":"2024-09-17T01:47:37.152142+0000","last_became_active":"2024-09-17T01:47:36.020837+0000","last_became_peered":"2024-09-17T01:47:36.020837+0000","last_unstale":"2024-09-17T01:47:37.152142+0000","last_undegraded":"2024-09-17T01:47:37.152142+0000","last_fullsized":"2024-09-17T01:47:37.152142+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:05.922664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027027+0000","last_change":"2024-09-17T01:47:36.023252+0000","last_active":"2024-09-17T01:47:37.027027+0000","last_peered":"2024-09-17T01:47:37.027027+0000","last_clean":"2024-09-17T01:47:37.027027+0000","last_became_active":"2024-09-17T01:47:36.022317+0000","last_became_peered":"2024-09-17T01:47:36.022317+0000","last_unstale":"2024-09-17T01:47:37.027027+0000","last_undegraded":"2024-09-17T01:47:37.027027+0000","last_fullsized":"2024-09-17T01:47:37.027027+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:15.810411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027246+0000","last_change":"2024-09-17T01:47:36.029064+0000","last_active":"2024-09-17T01:47:37.027246+0000","last_peered":"2024-09-17T01:47:37.027246+0000","last_clean":"2024-09-17T01:47:37.027246+0000","last_became_active":"2024-09-17T01:47:36.028613+0000","last_became_peered":"2024-09-17T01:47:36.028613+0000","last_unstale":"2024-09-17T01:47:37.027246+0000","last_undegraded":"2024-09-17T01:47:37.027246+0000","last_fullsized":"2024-09-17T01:47:37.027246+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:09.498750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151862+0000","last_change":"2024-09-17T01:47:36.030555+0000","last_active":"2024-09-17T01:47:37.151862+0000","last_peered":"2024-09-17T01:47:37.151862+0000","last_clean":"2024-09-17T01:47:37.151862+0000","last_became_active":"2024-09-17T01:47:36.030260+0000","last_became_peered":"2024-09-17T01:47:36.030260+0000","last_unstale":"2024-09-17T01:47:37.151862+0000","last_undegraded":"2024-09-17T01:47:37.151862+0000","last_fullsized":"2024-09-17T01:47:37.151862+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:43.922683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999299+0000","last_change":"2024-09-17T01:47:36.026322+0000","last_active":"2024-09-17T01:47:36.999299+0000","last_peered":"2024-09-17T01:47:36.999299+0000","last_clean":"2024-09-17T01:47:36.999299+0000","last_became_active":"2024-09-17T01:47:36.026011+0000","last_became_peered":"2024-09-17T01:47:36.026011+0000","last_unstale":"2024-09-17T01:47:36.999299+0000","last_undegraded":"2024-09-17T01:47:36.999299+0000","last_fullsized":"2024-09-17T01:47:36.999299+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:34.690718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000626+0000","last_change":"2024-09-17T01:47:36.011441+0000","last_active":"2024-09-17T01:47:37.000626+0000","last_peered":"2024-09-17T01:47:37.000626+0000","last_clean":"2024-09-17T01:47:37.000626+0000","last_became_active":"2024-09-17T01:47:36.008550+0000","last_became_peered":"2024-09-17T01:47:36.008550+0000","last_unstale":"2024-09-17T01:47:37.000626+0000","last_undegraded":"2024-09-17T01:47:37.000626+0000","last_fullsized":"2024-09-17T01:47:37.000626+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:39.038834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152436+0000","last_change":"2024-09-17T01:47:36.034508+0000","last_active":"2024-09-17T01:47:37.152436+0000","last_peered":"2024-09-17T01:47:37.152436+0000","last_clean":"2024-09-17T01:47:37.152436+0000","last_became_active":"2024-09-17T01:47:36.027035+0000","last_became_peered":"2024-09-17T01:47:36.027035+0000","last_unstale":"2024-09-17T01:47:37.152436+0000","last_undegraded":"2024-09-17T01:47:37.152436+0000","last_fullsized":"2024-09-17T01:47:37.152436+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:40.343277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152216+0000","last_change":"2024-09-17T01:47:36.035038+0000","last_active":"2024-09-17T01:47:37.152216+0000","last_peered":"2024-09-17T01:47:37.152216+0000","last_clean":"2024-09-17T01:47:37.152216+0000","last_became_active":"2024-09-17T01:47:36.034208+0000","last_became_peered":"2024-09-17T01:47:36.034208+0000","last_unstale":"2024-09-17T01:47:37.152216+0000","last_undegraded":"2024-09-17T01:47:37.152216+0000","last_fullsized":"2024-09-17T01:47:37.152216+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:21.980207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152627+0000","last_change":"2024-09-17T01:47:36.035010+0000","last_active":"2024-09-17T01:47:37.152627+0000","last_peered":"2024-09-17T01:47:37.152627+0000","last_clean":"2024-09-17T01:47:37.152627+0000","last_became_active":"2024-09-17T01:47:36.026693+0000","last_became_peered":"2024-09-17T01:47:36.026693+0000","last_unstale":"2024-09-17T01:47:37.152627+0000","last_undegraded":"2024-09-17T01:47:37.152627+0000","last_fullsized":"2024-09-17T01:47:37.152627+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:10.746690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000568+0000","last_change":"2024-09-17T01:47:36.015852+0000","last_active":"2024-09-17T01:47:37.000568+0000","last_peered":"2024-09-17T01:47:37.000568+0000","last_clean":"2024-09-17T01:47:37.000568+0000","last_became_active":"2024-09-17T01:47:36.015505+0000","last_became_peered":"2024-09-17T01:47:36.015505+0000","last_unstale":"2024-09-17T01:47:37.000568+0000","last_undegraded":"2024-09-17T01:47:37.000568+0000","last_fullsized":"2024-09-17T01:47:37.000568+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:55.582852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152265+0000","last_change":"2024-09-17T01:47:36.028347+0000","last_active":"2024-09-17T01:47:37.152265+0000","last_peered":"2024-09-17T01:47:37.152265+0000","last_clean":"2024-09-17T01:47:37.152265+0000","last_became_active":"2024-09-17T01:47:36.028038+0000","last_became_peered":"2024-09-17T01:47:36.028038+0000","last_unstale":"2024-09-17T01:47:37.152265+0000","last_undegraded":"2024-09-17T01:47:37.152265+0000","last_fullsized":"2024-09-17T01:47:37.152265+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:03.911616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.153010+0000","last_change":"2024-09-17T01:47:36.019539+0000","last_active":"2024-09-17T01:47:37.153010+0000","last_peered":"2024-09-17T01:47:37.153010+0000","last_clean":"2024-09-17T01:47:37.153010+0000","last_became_active":"2024-09-17T01:47:36.018394+0000","last_became_peered":"2024-09-17T01:47:36.018394+0000","last_unstale":"2024-09-17T01:47:37.153010+0000","last_undegraded":"2024-09-17T01:47:37.153010+0000","last_fullsized":"2024-09-17T01:47:37.153010+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:51:17.387170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.026945+0000","last_change":"2024-09-17T01:47:36.023965+0000","last_active":"2024-09-17T01:47:37.026945+0000","last_peered":"2024-09-17T01:47:37.026945+0000","last_clean":"2024-09-17T01:47:37.026945+0000","last_became_active":"2024-09-17T01:47:36.023148+0000","last_became_peered":"2024-09-17T01:47:36.023148+0000","last_unstale":"2024-09-17T01:47:37.026945+0000","last_undegraded":"2024-09-17T01:47:37.026945+0000","last_fullsized":"2024-09-17T01:47:37.026945+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:50.320950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000620+0000","last_change":"2024-09-17T01:47:36.017887+0000","last_active":"2024-09-17T01:47:37.000620+0000","last_peered":"2024-09-17T01:47:37.000620+0000","last_clean":"2024-09-17T01:47:37.000620+0000","last_became_active":"2024-09-17T01:47:36.015123+0000","last_became_peered":"2024-09-17T01:47:36.015123+0000","last_unstale":"2024-09-17T01:47:37.000620+0000","last_undegraded":"2024-09-17T01:47:37.000620+0000","last_fullsized":"2024-09-17T01:47:37.000620+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:10.073566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152939+0000","last_change":"2024-09-17T01:47:36.017272+0000","last_active":"2024-09-17T01:47:37.152939+0000","last_peered":"2024-09-17T01:47:37.152939+0000","last_clean":"2024-09-17T01:47:37.152939+0000","last_became_active":"2024-09-17T01:47:36.016956+0000","last_became_peered":"2024-09-17T01:47:36.016956+0000","last_unstale":"2024-09-17T01:47:37.152939+0000","last_undegraded":"2024-09-17T01:47:37.152939+0000","last_fullsized":"2024-09-17T01:47:37.152939+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:00:39.743352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1f","version":"199'4","reported_seq":19,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152162+0000","last_change":"2024-09-17T01:47:35.005307+0000","last_active":"2024-09-17T01:47:37.152162+0000","last_peered":"2024-09-17T01:47:37.152162+0000","last_clean":"2024-09-17T01:47:37.152162+0000","last_became_active":"2024-09-17T01:47:35.004930+0000","last_became_peered":"2024-09-17T01:47:35.004930+0000","last_unstale":"2024-09-17T01:47:37.152162+0000","last_undegraded":"2024-09-17T01:47:37.152162+0000","last_fullsized":"2024-09-17T01:47:37.152162+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:08.570784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152336+0000","last_change":"2024-09-17T01:47:36.030285+0000","last_active":"2024-09-17T01:47:37.152336+0000","last_peered":"2024-09-17T01:47:37.152336+0000","last_clean":"2024-09-17T01:47:37.152336+0000","last_became_active":"2024-09-17T01:47:36.029689+0000","last_became_peered":"2024-09-17T01:47:36.029689+0000","last_unstale":"2024-09-17T01:47:37.152336+0000","last_undegraded":"2024-09-17T01:47:37.152336+0000","last_fullsized":"2024-09-17T01:47:37.152336+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:26.644307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"199'1","reported_seq":16,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000304+0000","last_change":"2024-09-17T01:47:34.997816+0000","last_active":"2024-09-17T01:47:37.000304+0000","last_peered":"2024-09-17T01:47:37.000304+0000","last_clean":"2024-09-17T01:47:37.000304+0000","last_became_active":"2024-09-17T01:47:34.997504+0000","last_became_peered":"2024-09-17T01:47:34.997504+0000","last_unstale":"2024-09-17T01:47:37.000304+0000","last_undegraded":"2024-09-17T01:47:37.000304+0000","last_fullsized":"2024-09-17T01:47:37.000304+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:50:11.530947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151844+0000","last_change":"2024-09-17T01:47:36.014977+0000","last_active":"2024-09-17T01:47:37.151844+0000","last_peered":"2024-09-17T01:47:37.151844+0000","last_clean":"2024-09-17T01:47:37.151844+0000","last_became_active":"2024-09-17T01:47:36.014207+0000","last_became_peered":"2024-09-17T01:47:36.014207+0000","last_unstale":"2024-09-17T01:47:37.151844+0000","last_undegraded":"2024-09-17T01:47:37.151844+0000","last_fullsized":"2024-09-17T01:47:37.151844+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:36.234339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1c","version":"199'2","reported_seq":17,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.153484+0000","last_change":"2024-09-17T01:47:34.999793+0000","last_active":"2024-09-17T01:47:37.153484+0000","last_peered":"2024-09-17T01:47:37.153484+0000","last_clean":"2024-09-17T01:47:37.153484+0000","last_became_active":"2024-09-17T01:47:34.999466+0000","last_became_peered":"2024-09-17T01:47:34.999466+0000","last_unstale":"2024-09-17T01:47:37.153484+0000","last_undegraded":"2024-09-17T01:47:37.153484+0000","last_fullsized":"2024-09-17T01:47:37.153484+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:45.137637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151879+0000","last_change":"2024-09-17T01:47:36.034879+0000","last_active":"2024-09-17T01:47:37.151879+0000","last_peered":"2024-09-17T01:47:37.151879+0000","last_clean":"2024-09-17T01:47:37.151879+0000","last_became_active":"2024-09-17T01:47:36.029648+0000","last_became_peered":"2024-09-17T01:47:36.029648+0000","last_unstale":"2024-09-17T01:47:37.151879+0000","last_undegraded":"2024-09-17T01:47:37.151879+0000","last_fullsized":"2024-09-17T01:47:37.151879+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:17.902835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1b","version":"199'1","reported_seq":16,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001307+0000","last_change":"2024-09-17T01:47:35.001332+0000","last_active":"2024-09-17T01:47:37.001307+0000","last_peered":"2024-09-17T01:47:37.001307+0000","last_clean":"2024-09-17T01:47:37.001307+0000","last_became_active":"2024-09-17T01:47:35.000978+0000","last_became_peered":"2024-09-17T01:47:35.000978+0000","last_unstale":"2024-09-17T01:47:37.001307+0000","last_undegraded":"2024-09-17T01:47:37.001307+0000","last_fullsized":"2024-09-17T01:47:37.001307+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:25.637823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151804+0000","last_change":"2024-09-17T01:47:36.030160+0000","last_active":"2024-09-17T01:47:37.151804+0000","last_peered":"2024-09-17T01:47:37.151804+0000","last_clean":"2024-09-17T01:47:37.151804+0000","last_became_active":"2024-09-17T01:47:36.029783+0000","last_became_peered":"2024-09-17T01:47:36.029783+0000","last_unstale":"2024-09-17T01:47:37.151804+0000","last_undegraded":"2024-09-17T01:47:37.151804+0000","last_fullsized":"2024-09-17T01:47:37.151804+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:10.717752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1a","version":"199'1","reported_seq":16,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999838+0000","last_change":"2024-09-17T01:47:35.014399+0000","last_active":"2024-09-17T01:47:36.999838+0000","last_peered":"2024-09-17T01:47:36.999838+0000","last_clean":"2024-09-17T01:47:36.999838+0000","last_became_active":"2024-09-17T01:47:35.014095+0000","last_became_peered":"2024-09-17T01:47:35.014095+0000","last_unstale":"2024-09-17T01:47:36.999838+0000","last_undegraded":"2024-09-17T01:47:36.999838+0000","last_fullsized":"2024-09-17T01:47:36.999838+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:51.198589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151622+0000","last_change":"2024-09-17T01:47:36.023755+0000","last_active":"2024-09-17T01:47:37.151622+0000","last_peered":"2024-09-17T01:47:37.151622+0000","last_clean":"2024-09-17T01:47:37.151622+0000","last_became_active":"2024-09-17T01:47:36.023278+0000","last_became_peered":"2024-09-17T01:47:36.023278+0000","last_unstale":"2024-09-17T01:47:37.151622+0000","last_undegraded":"2024-09-17T01:47:37.151622+0000","last_fullsized":"2024-09-17T01:47:37.151622+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:34:08.578343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151251+0000","last_change":"2024-09-17T01:47:34.996555+0000","last_active":"2024-09-17T01:47:37.151251+0000","last_peered":"2024-09-17T01:47:37.151251+0000","last_clean":"2024-09-17T01:47:37.151251+0000","last_became_active":"2024-09-17T01:47:34.996193+0000","last_became_peered":"2024-09-17T01:47:34.996193+0000","last_unstale":"2024-09-17T01:47:37.151251+0000","last_undegraded":"2024-09-17T01:47:37.151251+0000","last_fullsized":"2024-09-17T01:47:37.151251+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:18.012845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999378+0000","last_change":"2024-09-17T01:47:36.025791+0000","last_active":"2024-09-17T01:47:36.999378+0000","last_peered":"2024-09-17T01:47:36.999378+0000","last_clean":"2024-09-17T01:47:36.999378+0000","last_became_active":"2024-09-17T01:47:36.020837+0000","last_became_peered":"2024-09-17T01:47:36.020837+0000","last_unstale":"2024-09-17T01:47:36.999378+0000","last_undegraded":"2024-09-17T01:47:36.999378+0000","last_fullsized":"2024-09-17T01:47:36.999378+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:11.950647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.026608+0000","last_change":"2024-09-17T01:47:34.999663+0000","last_active":"2024-09-17T01:47:37.026608+0000","last_peered":"2024-09-17T01:47:37.026608+0000","last_clean":"2024-09-17T01:47:37.026608+0000","last_became_active":"2024-09-17T01:47:34.999310+0000","last_became_peered":"2024-09-17T01:47:34.999310+0000","last_unstale":"2024-09-17T01:47:37.026608+0000","last_undegraded":"2024-09-17T01:47:37.026608+0000","last_fullsized":"2024-09-17T01:47:37.026608+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:29.080659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.153581+0000","last_change":"2024-09-17T01:47:36.018854+0000","last_active":"2024-09-17T01:47:37.153581+0000","last_peered":"2024-09-17T01:47:37.153581+0000","last_clean":"2024-09-17T01:47:37.153581+0000","last_became_active":"2024-09-17T01:47:36.018537+0000","last_became_peered":"2024-09-17T01:47:36.018537+0000","last_unstale":"2024-09-17T01:47:37.153581+0000","last_undegraded":"2024-09-17T01:47:37.153581+0000","last_fullsized":"2024-09-17T01:47:37.153581+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:37.713412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000829+0000","last_change":"2024-09-17T01:47:35.012451+0000","last_active":"2024-09-17T01:47:37.000829+0000","last_peered":"2024-09-17T01:47:37.000829+0000","last_clean":"2024-09-17T01:47:37.000829+0000","last_became_active":"2024-09-17T01:47:35.012143+0000","last_became_peered":"2024-09-17T01:47:35.012143+0000","last_unstale":"2024-09-17T01:47:37.000829+0000","last_undegraded":"2024-09-17T01:47:37.000829+0000","last_fullsized":"2024-09-17T01:47:37.000829+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:47:29.395131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152584+0000","last_change":"2024-09-17T01:47:36.031889+0000","last_active":"2024-09-17T01:47:37.152584+0000","last_peered":"2024-09-17T01:47:37.152584+0000","last_clean":"2024-09-17T01:47:37.152584+0000","last_became_active":"2024-09-17T01:47:36.026270+0000","last_became_peered":"2024-09-17T01:47:36.026270+0000","last_unstale":"2024-09-17T01:47:37.152584+0000","last_undegraded":"2024-09-17T01:47:37.152584+0000","last_fullsized":"2024-09-17T01:47:37.152584+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:38:18.052479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001555+0000","last_change":"2024-09-17T01:47:35.001060+0000","last_active":"2024-09-17T01:47:37.001555+0000","last_peered":"2024-09-17T01:47:37.001555+0000","last_clean":"2024-09-17T01:47:37.001555+0000","last_became_active":"2024-09-17T01:47:35.000714+0000","last_became_peered":"2024-09-17T01:47:35.000714+0000","last_unstale":"2024-09-17T01:47:37.001555+0000","last_undegraded":"2024-09-17T01:47:37.001555+0000","last_fullsized":"2024-09-17T01:47:37.001555+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:40.476091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.153518+0000","last_change":"2024-09-17T01:47:36.010206+0000","last_active":"2024-09-17T01:47:37.153518+0000","last_peered":"2024-09-17T01:47:37.153518+0000","last_clean":"2024-09-17T01:47:37.153518+0000","last_became_active":"2024-09-17T01:47:36.009887+0000","last_became_peered":"2024-09-17T01:47:36.009887+0000","last_unstale":"2024-09-17T01:47:37.153518+0000","last_undegraded":"2024-09-17T01:47:37.153518+0000","last_fullsized":"2024-09-17T01:47:37.153518+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:14:33.651917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"199'3","reported_seq":18,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000846+0000","last_change":"2024-09-17T01:47:35.000275+0000","last_active":"2024-09-17T01:47:37.000846+0000","last_peered":"2024-09-17T01:47:37.000846+0000","last_clean":"2024-09-17T01:47:37.000846+0000","last_became_active":"2024-09-17T01:47:34.999955+0000","last_became_peered":"2024-09-17T01:47:34.999955+0000","last_unstale":"2024-09-17T01:47:37.000846+0000","last_undegraded":"2024-09-17T01:47:37.000846+0000","last_fullsized":"2024-09-17T01:47:37.000846+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:06.818743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.153399+0000","last_change":"2024-09-17T01:47:36.025624+0000","last_active":"2024-09-17T01:47:37.153399+0000","last_peered":"2024-09-17T01:47:37.153399+0000","last_clean":"2024-09-17T01:47:37.153399+0000","last_became_active":"2024-09-17T01:47:36.018304+0000","last_became_peered":"2024-09-17T01:47:36.018304+0000","last_unstale":"2024-09-17T01:47:37.153399+0000","last_undegraded":"2024-09-17T01:47:37.153399+0000","last_fullsized":"2024-09-17T01:47:37.153399+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:39.331109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.14","version":"199'6","reported_seq":21,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.026977+0000","last_change":"2024-09-17T01:47:35.002429+0000","last_active":"2024-09-17T01:47:37.026977+0000","last_peered":"2024-09-17T01:47:37.026977+0000","last_clean":"2024-09-17T01:47:37.026977+0000","last_became_active":"2024-09-17T01:47:35.002120+0000","last_became_peered":"2024-09-17T01:47:35.002120+0000","last_unstale":"2024-09-17T01:47:37.026977+0000","last_undegraded":"2024-09-17T01:47:37.026977+0000","last_fullsized":"2024-09-17T01:47:37.026977+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:11.320142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152275+0000","last_change":"2024-09-17T01:47:36.020636+0000","last_active":"2024-09-17T01:47:37.152275+0000","last_peered":"2024-09-17T01:47:37.152275+0000","last_clean":"2024-09-17T01:47:37.152275+0000","last_became_active":"2024-09-17T01:47:36.019460+0000","last_became_peered":"2024-09-17T01:47:36.019460+0000","last_unstale":"2024-09-17T01:47:37.152275+0000","last_undegraded":"2024-09-17T01:47:37.152275+0000","last_fullsized":"2024-09-17T01:47:37.152275+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:30.347852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.13","version":"199'2","reported_seq":17,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001367+0000","last_change":"2024-09-17T01:47:34.999727+0000","last_active":"2024-09-17T01:47:37.001367+0000","last_peered":"2024-09-17T01:47:37.001367+0000","last_clean":"2024-09-17T01:47:37.001367+0000","last_became_active":"2024-09-17T01:47:34.999370+0000","last_became_peered":"2024-09-17T01:47:34.999370+0000","last_unstale":"2024-09-17T01:47:37.001367+0000","last_undegraded":"2024-09-17T01:47:37.001367+0000","last_fullsized":"2024-09-17T01:47:37.001367+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:05.459525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152957+0000","last_change":"2024-09-17T01:47:36.004620+0000","last_active":"2024-09-17T01:47:37.152957+0000","last_peered":"2024-09-17T01:47:37.152957+0000","last_clean":"2024-09-17T01:47:37.152957+0000","last_became_active":"2024-09-17T01:47:36.003931+0000","last_became_peered":"2024-09-17T01:47:36.003931+0000","last_unstale":"2024-09-17T01:47:37.152957+0000","last_undegraded":"2024-09-17T01:47:37.152957+0000","last_fullsized":"2024-09-17T01:47:37.152957+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:39.038834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151998+0000","last_change":"2024-09-17T01:47:35.011640+0000","last_active":"2024-09-17T01:47:37.151998+0000","last_peered":"2024-09-17T01:47:37.151998+0000","last_clean":"2024-09-17T01:47:37.151998+0000","last_became_active":"2024-09-17T01:47:35.011312+0000","last_became_peered":"2024-09-17T01:47:35.011312+0000","last_unstale":"2024-09-17T01:47:37.151998+0000","last_undegraded":"2024-09-17T01:47:37.151998+0000","last_fullsized":"2024-09-17T01:47:37.151998+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:38:17.045996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151528+0000","last_change":"2024-09-17T01:47:36.027515+0000","last_active":"2024-09-17T01:47:37.151528+0000","last_peered":"2024-09-17T01:47:37.151528+0000","last_clean":"2024-09-17T01:47:37.151528+0000","last_became_active":"2024-09-17T01:47:36.027048+0000","last_became_peered":"2024-09-17T01:47:36.027048+0000","last_unstale":"2024-09-17T01:47:37.151528+0000","last_undegraded":"2024-09-17T01:47:37.151528+0000","last_fullsized":"2024-09-17T01:47:37.151528+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:04.802097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151512+0000","last_change":"2024-09-17T01:47:35.006578+0000","last_active":"2024-09-17T01:47:37.151512+0000","last_peered":"2024-09-17T01:47:37.151512+0000","last_clean":"2024-09-17T01:47:37.151512+0000","last_became_active":"2024-09-17T01:47:35.006232+0000","last_became_peered":"2024-09-17T01:47:35.006232+0000","last_unstale":"2024-09-17T01:47:37.151512+0000","last_undegraded":"2024-09-17T01:47:37.151512+0000","last_fullsized":"2024-09-17T01:47:37.151512+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:19.847162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151531+0000","last_change":"2024-09-17T01:47:36.013600+0000","last_active":"2024-09-17T01:47:37.151531+0000","last_peered":"2024-09-17T01:47:37.151531+0000","last_clean":"2024-09-17T01:47:37.151531+0000","last_became_active":"2024-09-17T01:47:36.013214+0000","last_became_peered":"2024-09-17T01:47:36.013214+0000","last_unstale":"2024-09-17T01:47:37.151531+0000","last_undegraded":"2024-09-17T01:47:37.151531+0000","last_fullsized":"2024-09-17T01:47:37.151531+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:06.466009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.10","version":"199'8","reported_seq":23,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151512+0000","last_change":"2024-09-17T01:47:35.011656+0000","last_active":"2024-09-17T01:47:37.151512+0000","last_peered":"2024-09-17T01:47:37.151512+0000","last_clean":"2024-09-17T01:47:37.151512+0000","last_became_active":"2024-09-17T01:47:35.011339+0000","last_became_peered":"2024-09-17T01:47:35.011339+0000","last_unstale":"2024-09-17T01:47:37.151512+0000","last_undegraded":"2024-09-17T01:47:37.151512+0000","last_fullsized":"2024-09-17T01:47:37.151512+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:20.775303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001607+0000","last_change":"2024-09-17T01:47:36.010515+0000","last_active":"2024-09-17T01:47:37.001607+0000","last_peered":"2024-09-17T01:47:37.001607+0000","last_clean":"2024-09-17T01:47:37.001607+0000","last_became_active":"2024-09-17T01:47:36.006346+0000","last_became_peered":"2024-09-17T01:47:36.006346+0000","last_unstale":"2024-09-17T01:47:37.001607+0000","last_undegraded":"2024-09-17T01:47:37.001607+0000","last_fullsized":"2024-09-17T01:47:37.001607+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:14:33.651917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"199'1","reported_seq":16,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000831+0000","last_change":"2024-09-17T01:47:35.005515+0000","last_active":"2024-09-17T01:47:37.000831+0000","last_peered":"2024-09-17T01:47:37.000831+0000","last_clean":"2024-09-17T01:47:37.000831+0000","last_became_active":"2024-09-17T01:47:35.005193+0000","last_became_peered":"2024-09-17T01:47:35.005193+0000","last_unstale":"2024-09-17T01:47:37.000831+0000","last_undegraded":"2024-09-17T01:47:37.000831+0000","last_fullsized":"2024-09-17T01:47:37.000831+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:39.205972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027228+0000","last_change":"2024-09-17T01:47:36.035887+0000","last_active":"2024-09-17T01:47:37.027228+0000","last_peered":"2024-09-17T01:47:37.027228+0000","last_clean":"2024-09-17T01:47:37.027228+0000","last_became_active":"2024-09-17T01:47:36.034244+0000","last_became_peered":"2024-09-17T01:47:36.034244+0000","last_unstale":"2024-09-17T01:47:37.027228+0000","last_undegraded":"2024-09-17T01:47:37.027228+0000","last_fullsized":"2024-09-17T01:47:37.027228+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:55.140647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.e","version":"199'2","reported_seq":17,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027301+0000","last_change":"2024-09-17T01:47:35.007881+0000","last_active":"2024-09-17T01:47:37.027301+0000","last_peered":"2024-09-17T01:47:37.027301+0000","last_clean":"2024-09-17T01:47:37.027301+0000","last_became_active":"2024-09-17T01:47:35.006640+0000","last_became_peered":"2024-09-17T01:47:35.006640+0000","last_unstale":"2024-09-17T01:47:37.027301+0000","last_undegraded":"2024-09-17T01:47:37.027301+0000","last_fullsized":"2024-09-17T01:47:37.027301+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:06.636568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152210+0000","last_change":"2024-09-17T01:47:36.020929+0000","last_active":"2024-09-17T01:47:37.152210+0000","last_peered":"2024-09-17T01:47:37.152210+0000","last_clean":"2024-09-17T01:47:37.152210+0000","last_became_active":"2024-09-17T01:47:36.020478+0000","last_became_peered":"2024-09-17T01:47:36.020478+0000","last_unstale":"2024-09-17T01:47:37.152210+0000","last_undegraded":"2024-09-17T01:47:37.152210+0000","last_fullsized":"2024-09-17T01:47:37.152210+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:06.022490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.d","version":"199'1","reported_seq":16,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000098+0000","last_change":"2024-09-17T01:47:35.008871+0000","last_active":"2024-09-17T01:47:37.000098+0000","last_peered":"2024-09-17T01:47:37.000098+0000","last_clean":"2024-09-17T01:47:37.000098+0000","last_became_active":"2024-09-17T01:47:35.008185+0000","last_became_peered":"2024-09-17T01:47:35.008185+0000","last_unstale":"2024-09-17T01:47:37.000098+0000","last_undegraded":"2024-09-17T01:47:37.000098+0000","last_fullsized":"2024-09-17T01:47:37.000098+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:40.712175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152081+0000","last_change":"2024-09-17T01:47:36.015300+0000","last_active":"2024-09-17T01:47:37.152081+0000","last_peered":"2024-09-17T01:47:37.152081+0000","last_clean":"2024-09-17T01:47:37.152081+0000","last_became_active":"2024-09-17T01:47:36.014660+0000","last_became_peered":"2024-09-17T01:47:36.014660+0000","last_unstale":"2024-09-17T01:47:37.152081+0000","last_undegraded":"2024-09-17T01:47:37.152081+0000","last_fullsized":"2024-09-17T01:47:37.152081+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:46.748101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001431+0000","last_change":"2024-09-17T01:47:34.993962+0000","last_active":"2024-09-17T01:47:37.001431+0000","last_peered":"2024-09-17T01:47:37.001431+0000","last_clean":"2024-09-17T01:47:37.001431+0000","last_became_active":"2024-09-17T01:47:34.992169+0000","last_became_peered":"2024-09-17T01:47:34.992169+0000","last_unstale":"2024-09-17T01:47:37.001431+0000","last_undegraded":"2024-09-17T01:47:37.001431+0000","last_fullsized":"2024-09-17T01:47:37.001431+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:12.898352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027186+0000","last_change":"2024-09-17T01:47:36.013751+0000","last_active":"2024-09-17T01:47:37.027186+0000","last_peered":"2024-09-17T01:47:37.027186+0000","last_clean":"2024-09-17T01:47:37.027186+0000","last_became_active":"2024-09-17T01:47:36.012914+0000","last_became_peered":"2024-09-17T01:47:36.012914+0000","last_unstale":"2024-09-17T01:47:37.027186+0000","last_undegraded":"2024-09-17T01:47:37.027186+0000","last_fullsized":"2024-09-17T01:47:37.027186+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:18.276994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.b","version":"199'2","reported_seq":17,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999801+0000","last_change":"2024-09-17T01:47:35.011932+0000","last_active":"2024-09-17T01:47:36.999801+0000","last_peered":"2024-09-17T01:47:36.999801+0000","last_clean":"2024-09-17T01:47:36.999801+0000","last_became_active":"2024-09-17T01:47:35.011558+0000","last_became_peered":"2024-09-17T01:47:35.011558+0000","last_unstale":"2024-09-17T01:47:36.999801+0000","last_undegraded":"2024-09-17T01:47:36.999801+0000","last_fullsized":"2024-09-17T01:47:36.999801+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:12.724138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151934+0000","last_change":"2024-09-17T01:47:36.028346+0000","last_active":"2024-09-17T01:47:37.151934+0000","last_peered":"2024-09-17T01:47:37.151934+0000","last_clean":"2024-09-17T01:47:37.151934+0000","last_became_active":"2024-09-17T01:47:36.027814+0000","last_became_peered":"2024-09-17T01:47:36.027814+0000","last_unstale":"2024-09-17T01:47:37.151934+0000","last_undegraded":"2024-09-17T01:47:37.151934+0000","last_fullsized":"2024-09-17T01:47:37.151934+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:28.673161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152818+0000","last_change":"2024-09-17T01:47:34.994104+0000","last_active":"2024-09-17T01:47:37.152818+0000","last_peered":"2024-09-17T01:47:37.152818+0000","last_clean":"2024-09-17T01:47:37.152818+0000","last_became_active":"2024-09-17T01:47:34.993125+0000","last_became_peered":"2024-09-17T01:47:34.993125+0000","last_unstale":"2024-09-17T01:47:37.152818+0000","last_undegraded":"2024-09-17T01:47:37.152818+0000","last_fullsized":"2024-09-17T01:47:37.152818+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:38.505908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000251+0000","last_change":"2024-09-17T01:47:36.014232+0000","last_active":"2024-09-17T01:47:37.000251+0000","last_peered":"2024-09-17T01:47:37.000251+0000","last_clean":"2024-09-17T01:47:37.000251+0000","last_became_active":"2024-09-17T01:47:36.011929+0000","last_became_peered":"2024-09-17T01:47:36.011929+0000","last_unstale":"2024-09-17T01:47:37.000251+0000","last_undegraded":"2024-09-17T01:47:37.000251+0000","last_fullsized":"2024-09-17T01:47:37.000251+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:09.266220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151181+0000","last_change":"2024-09-17T01:47:35.011539+0000","last_active":"2024-09-17T01:47:37.151181+0000","last_peered":"2024-09-17T01:47:37.151181+0000","last_clean":"2024-09-17T01:47:37.151181+0000","last_became_active":"2024-09-17T01:47:35.011146+0000","last_became_peered":"2024-09-17T01:47:35.011146+0000","last_unstale":"2024-09-17T01:47:37.151181+0000","last_undegraded":"2024-09-17T01:47:37.151181+0000","last_fullsized":"2024-09-17T01:47:37.151181+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:36.250930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001015+0000","last_change":"2024-09-17T01:47:36.013423+0000","last_active":"2024-09-17T01:47:37.001015+0000","last_peered":"2024-09-17T01:47:37.001015+0000","last_clean":"2024-09-17T01:47:37.001015+0000","last_became_active":"2024-09-17T01:47:36.013122+0000","last_became_peered":"2024-09-17T01:47:36.013122+0000","last_unstale":"2024-09-17T01:47:37.001015+0000","last_undegraded":"2024-09-17T01:47:37.001015+0000","last_fullsized":"2024-09-17T01:47:37.001015+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:16.636984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151636+0000","last_change":"2024-09-17T01:47:35.010985+0000","last_active":"2024-09-17T01:47:37.151636+0000","last_peered":"2024-09-17T01:47:37.151636+0000","last_clean":"2024-09-17T01:47:37.151636+0000","last_became_active":"2024-09-17T01:47:35.010635+0000","last_became_peered":"2024-09-17T01:47:35.010635+0000","last_unstale":"2024-09-17T01:47:37.151636+0000","last_undegraded":"2024-09-17T01:47:37.151636+0000","last_fullsized":"2024-09-17T01:47:37.151636+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:47.121633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027113+0000","last_change":"2024-09-17T01:47:36.022826+0000","last_active":"2024-09-17T01:47:37.027113+0000","last_peered":"2024-09-17T01:47:37.027113+0000","last_clean":"2024-09-17T01:47:37.027113+0000","last_became_active":"2024-09-17T01:47:36.022162+0000","last_became_peered":"2024-09-17T01:47:36.022162+0000","last_unstale":"2024-09-17T01:47:37.027113+0000","last_undegraded":"2024-09-17T01:47:37.027113+0000","last_fullsized":"2024-09-17T01:47:37.027113+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:40.708195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"199'2","reported_seq":17,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.026987+0000","last_change":"2024-09-17T01:47:35.008037+0000","last_active":"2024-09-17T01:47:37.026987+0000","last_peered":"2024-09-17T01:47:37.026987+0000","last_clean":"2024-09-17T01:47:37.026987+0000","last_became_active":"2024-09-17T01:47:35.007539+0000","last_became_peered":"2024-09-17T01:47:35.007539+0000","last_unstale":"2024-09-17T01:47:37.026987+0000","last_undegraded":"2024-09-17T01:47:37.026987+0000","last_fullsized":"2024-09-17T01:47:37.026987+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:02.783632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000634+0000","last_change":"2024-09-17T01:47:36.018759+0000","last_active":"2024-09-17T01:47:37.000634+0000","last_peered":"2024-09-17T01:47:37.000634+0000","last_clean":"2024-09-17T01:47:37.000634+0000","last_became_active":"2024-09-17T01:47:36.018449+0000","last_became_peered":"2024-09-17T01:47:36.018449+0000","last_unstale":"2024-09-17T01:47:37.000634+0000","last_undegraded":"2024-09-17T01:47:37.000634+0000","last_fullsized":"2024-09-17T01:47:37.000634+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:10.509746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.6","version":"200'1","reported_seq":16,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000467+0000","last_change":"2024-09-17T01:47:35.008019+0000","last_active":"2024-09-17T01:47:37.000467+0000","last_peered":"2024-09-17T01:47:37.000467+0000","last_clean":"2024-09-17T01:47:37.000467+0000","last_became_active":"2024-09-17T01:47:35.007699+0000","last_became_peered":"2024-09-17T01:47:35.007699+0000","last_unstale":"2024-09-17T01:47:37.000467+0000","last_undegraded":"2024-09-17T01:47:37.000467+0000","last_fullsized":"2024-09-17T01:47:37.000467+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:46.547217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000058+0000","last_change":"2024-09-17T01:47:36.016021+0000","last_active":"2024-09-17T01:47:37.000058+0000","last_peered":"2024-09-17T01:47:37.000058+0000","last_clean":"2024-09-17T01:47:37.000058+0000","last_became_active":"2024-09-17T01:47:36.015717+0000","last_became_peered":"2024-09-17T01:47:36.015717+0000","last_unstale":"2024-09-17T01:47:37.000058+0000","last_undegraded":"2024-09-17T01:47:37.000058+0000","last_fullsized":"2024-09-17T01:47:37.000058+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:04.802097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152350+0000","last_change":"2024-09-17T01:47:35.000829+0000","last_active":"2024-09-17T01:47:37.152350+0000","last_peered":"2024-09-17T01:47:37.152350+0000","last_clean":"2024-09-17T01:47:37.152350+0000","last_became_active":"2024-09-17T01:47:35.000499+0000","last_became_peered":"2024-09-17T01:47:35.000499+0000","last_unstale":"2024-09-17T01:47:37.152350+0000","last_undegraded":"2024-09-17T01:47:37.152350+0000","last_fullsized":"2024-09-17T01:47:37.152350+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:07.688589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001169+0000","last_change":"2024-09-17T01:47:36.018476+0000","last_active":"2024-09-17T01:47:37.001169+0000","last_peered":"2024-09-17T01:47:37.001169+0000","last_clean":"2024-09-17T01:47:37.001169+0000","last_became_active":"2024-09-17T01:47:36.017796+0000","last_became_peered":"2024-09-17T01:47:36.017796+0000","last_unstale":"2024-09-17T01:47:37.001169+0000","last_undegraded":"2024-09-17T01:47:37.001169+0000","last_fullsized":"2024-09-17T01:47:37.001169+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:51:17.387170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152121+0000","last_change":"2024-09-17T01:47:35.013150+0000","last_active":"2024-09-17T01:47:37.152121+0000","last_peered":"2024-09-17T01:47:37.152121+0000","last_clean":"2024-09-17T01:47:37.152121+0000","last_became_active":"2024-09-17T01:47:35.012633+0000","last_became_peered":"2024-09-17T01:47:35.012633+0000","last_unstale":"2024-09-17T01:47:37.152121+0000","last_undegraded":"2024-09-17T01:47:37.152121+0000","last_fullsized":"2024-09-17T01:47:37.152121+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:13:45.772845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999735+0000","last_change":"2024-09-17T01:47:36.020528+0000","last_active":"2024-09-17T01:47:36.999735+0000","last_peered":"2024-09-17T01:47:36.999735+0000","last_clean":"2024-09-17T01:47:36.999735+0000","last_became_active":"2024-09-17T01:47:36.020204+0000","last_became_peered":"2024-09-17T01:47:36.020204+0000","last_unstale":"2024-09-17T01:47:36.999735+0000","last_undegraded":"2024-09-17T01:47:36.999735+0000","last_fullsized":"2024-09-17T01:47:36.999735+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:53.498055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152366+0000","last_change":"2024-09-17T01:47:35.013573+0000","last_active":"2024-09-17T01:47:37.152366+0000","last_peered":"2024-09-17T01:47:37.152366+0000","last_clean":"2024-09-17T01:47:37.152366+0000","last_became_active":"2024-09-17T01:47:35.012649+0000","last_became_peered":"2024-09-17T01:47:35.012649+0000","last_unstale":"2024-09-17T01:47:37.152366+0000","last_undegraded":"2024-09-17T01:47:37.152366+0000","last_fullsized":"2024-09-17T01:47:37.152366+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:30.689211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999714+0000","last_change":"2024-09-17T01:47:36.027127+0000","last_active":"2024-09-17T01:47:36.999714+0000","last_peered":"2024-09-17T01:47:36.999714+0000","last_clean":"2024-09-17T01:47:36.999714+0000","last_became_active":"2024-09-17T01:47:36.026829+0000","last_became_peered":"2024-09-17T01:47:36.026829+0000","last_unstale":"2024-09-17T01:47:36.999714+0000","last_undegraded":"2024-09-17T01:47:36.999714+0000","last_fullsized":"2024-09-17T01:47:36.999714+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:49.510484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152209+0000","last_change":"2024-09-17T01:47:35.004537+0000","last_active":"2024-09-17T01:47:37.152209+0000","last_peered":"2024-09-17T01:47:37.152209+0000","last_clean":"2024-09-17T01:47:37.152209+0000","last_became_active":"2024-09-17T01:47:35.003997+0000","last_became_peered":"2024-09-17T01:47:35.003997+0000","last_unstale":"2024-09-17T01:47:37.152209+0000","last_undegraded":"2024-09-17T01:47:37.152209+0000","last_fullsized":"2024-09-17T01:47:37.152209+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:09.740206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151577+0000","last_change":"2024-09-17T01:47:36.034733+0000","last_active":"2024-09-17T01:47:37.151577+0000","last_peered":"2024-09-17T01:47:37.151577+0000","last_clean":"2024-09-17T01:47:37.151577+0000","last_became_active":"2024-09-17T01:47:36.029170+0000","last_became_peered":"2024-09-17T01:47:36.029170+0000","last_unstale":"2024-09-17T01:47:37.151577+0000","last_undegraded":"2024-09-17T01:47:37.151577+0000","last_fullsized":"2024-09-17T01:47:37.151577+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:07.825226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001117+0000","last_change":"2024-09-17T01:47:35.013384+0000","last_active":"2024-09-17T01:47:37.001117+0000","last_peered":"2024-09-17T01:47:37.001117+0000","last_clean":"2024-09-17T01:47:37.001117+0000","last_became_active":"2024-09-17T01:47:35.012957+0000","last_became_peered":"2024-09-17T01:47:35.012957+0000","last_unstale":"2024-09-17T01:47:37.001117+0000","last_undegraded":"2024-09-17T01:47:37.001117+0000","last_fullsized":"2024-09-17T01:47:37.001117+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:20.495786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151071+0000","last_change":"2024-09-17T01:47:36.002457+0000","last_active":"2024-09-17T01:47:37.151071+0000","last_peered":"2024-09-17T01:47:37.151071+0000","last_clean":"2024-09-17T01:47:37.151071+0000","last_became_active":"2024-09-17T01:47:36.001952+0000","last_became_peered":"2024-09-17T01:47:36.001952+0000","last_unstale":"2024-09-17T01:47:37.151071+0000","last_undegraded":"2024-09-17T01:47:37.151071+0000","last_fullsized":"2024-09-17T01:47:37.151071+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:56.911080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999239+0000","last_change":"2024-09-17T01:47:35.007484+0000","last_active":"2024-09-17T01:47:36.999239+0000","last_peered":"2024-09-17T01:47:36.999239+0000","last_clean":"2024-09-17T01:47:36.999239+0000","last_became_active":"2024-09-17T01:47:35.007199+0000","last_became_peered":"2024-09-17T01:47:35.007199+0000","last_unstale":"2024-09-17T01:47:36.999239+0000","last_undegraded":"2024-09-17T01:47:36.999239+0000","last_fullsized":"2024-09-17T01:47:36.999239+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:11.734174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151338+0000","last_change":"2024-09-17T01:47:36.011259+0000","last_active":"2024-09-17T01:47:37.151338+0000","last_peered":"2024-09-17T01:47:37.151338+0000","last_clean":"2024-09-17T01:47:37.151338+0000","last_became_active":"2024-09-17T01:47:36.010945+0000","last_became_peered":"2024-09-17T01:47:36.010945+0000","last_unstale":"2024-09-17T01:47:37.151338+0000","last_undegraded":"2024-09-17T01:47:37.151338+0000","last_fullsized":"2024-09-17T01:47:37.151338+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:53.498055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"199'2","reported_seq":17,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000185+0000","last_change":"2024-09-17T01:47:35.015450+0000","last_active":"2024-09-17T01:47:37.000185+0000","last_peered":"2024-09-17T01:47:37.000185+0000","last_clean":"2024-09-17T01:47:37.000185+0000","last_became_active":"2024-09-17T01:47:35.014969+0000","last_became_peered":"2024-09-17T01:47:35.014969+0000","last_unstale":"2024-09-17T01:47:37.000185+0000","last_undegraded":"2024-09-17T01:47:37.000185+0000","last_fullsized":"2024-09-17T01:47:37.000185+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:20.939219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":452,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999267+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:47:36.999267+0000","last_peered":"2024-09-17T01:47:36.999267+0000","last_clean":"2024-09-17T01:47:36.999267+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:47:36.999267+0000","last_undegraded":"2024-09-17T01:47:36.999267+0000","last_fullsized":"2024-09-17T01:47:36.999267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476929,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47536,"kb_used_data":2460,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324304,"statfs":{"total":96636764160,"available":96588087296,"internally_reserved":0,"allocated":2519040,"data_stored":1113104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509632,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55860,"kb_used_data":2464,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315980,"statfs":{"total":96636764160,"available":96579563520,"internally_reserved":0,"allocated":2523136,"data_stored":1113742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509631,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47548,"kb_used_data":2468,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324292,"statfs":{"total":96636764160,"available":96588075008,"internally_reserved":0,"allocated":2527232,"data_stored":1113216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509632,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51704,"kb_used_data":2468,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320136,"statfs":{"total":96636764160,"available":96583819264,"internally_reserved":0,"allocated":2527232,"data_stored":1114682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509632,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69676,"kb_used_data":2456,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302164,"statfs":{"total":96636764160,"available":96565415936,"internally_reserved":0,"allocated":2514944,"data_stored":1113070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509631,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52284,"kb_used_data":3048,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319556,"statfs":{"total":96636764160,"available":96583225344,"internally_reserved":0,"allocated":3121152,"data_stored":1704112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509633,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60012,"kb_used_data":2456,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311828,"statfs":{"total":96636764160,"available":96575311872,"internally_reserved":0,"allocated":2514944,"data_stored":1113070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":58915273},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542337,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52292,"kb_used_data":3052,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319548,"statfs":{"total":96636764160,"available":96583217152,"internally_reserved":0,"allocated":3125248,"data_stored":1705120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:47:41.498 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:47:41.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.760+0000 7f1bf2200640 1 -- 172.21.15.42:0/4074454760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bec0cf230 msgr2=0x7f1bec0cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:41.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.760+0000 7f1bf2200640 1 --2- 172.21.15.42:0/4074454760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bec0cf230 0x7f1bec0cf640 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7f1bec0b2e60 tx=0x7f1bd802a5f0 comp rx=0 tx=0).stop 2024-09-17T01:47:41.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.761+0000 7f1bf2200640 1 -- 172.21.15.42:0/4074454760 shutdown_connections 2024-09-17T01:47:41.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.761+0000 7f1bf2200640 1 --2- 172.21.15.42:0/4074454760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bec0cf230 0x7f1bec0cf640 unknown :-1 s=CLOSED pgs=2288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:41.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.761+0000 7f1bf2200640 1 --2- 172.21.15.42:0/4074454760 >> v2:172.21.15.43:3300/0 conn(0x7f1bec06cd20 0x7f1bec06d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:41.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.761+0000 7f1bf2200640 1 -- 172.21.15.42:0/4074454760 >> 172.21.15.42:0/4074454760 conn(0x7f1bec0b25f0 msgr2=0x7f1bec0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:41.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.761+0000 7f1bf2200640 1 -- 172.21.15.42:0/4074454760 shutdown_connections 2024-09-17T01:47:41.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.761+0000 7f1bf2200640 1 -- 172.21.15.42:0/4074454760 wait complete. 2024-09-17T01:47:41.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.763+0000 7f1bf2200640 1 Processor -- start 2024-09-17T01:47:41.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.763+0000 7f1bf2200640 1 -- start start 2024-09-17T01:47:41.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.764+0000 7f1bf2200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bec06cd20 0x7f1bec1545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:41.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.764+0000 7f1bf2200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bec0cf230 0x7f1bec09a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:41.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.765+0000 7f1bf2200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bec15e3c0 0x7f1bec15bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:41.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.765+0000 7f1bf2200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec155120 con 0x7f1bec06cd20 2024-09-17T01:47:41.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.765+0000 7f1bf2200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec0cfb80 con 0x7f1bec15e3c0 2024-09-17T01:47:41.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.765+0000 7f1bf2200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1bec1552a0 con 0x7f1bec0cf230 2024-09-17T01:47:41.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.765+0000 7f1bf0e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bec06cd20 0x7f1bec1545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:41.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.765+0000 7f1bf0e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bec06cd20 0x7f1bec1545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52400/0 (socket says 172.21.15.42:52400) 2024-09-17T01:47:41.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.765+0000 7f1bf0e00640 1 -- 172.21.15.42:0/403031436 learned_addr learned my addr 172.21.15.42:0/403031436 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:41.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.765+0000 7f1bebe00640 1 --2- 172.21.15.42:0/403031436 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bec0cf230 0x7f1bec09a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:41.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.765+0000 7f1bf1800640 1 --2- 172.21.15.42:0/403031436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bec15e3c0 0x7f1bec15bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:41.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.765+0000 7f1bf0e00640 1 -- 172.21.15.42:0/403031436 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bec0cf230 msgr2=0x7f1bec09a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:41.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.765+0000 7f1bf0e00640 1 --2- 172.21.15.42:0/403031436 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bec0cf230 0x7f1bec09a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:41.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.765+0000 7f1bf0e00640 1 -- 172.21.15.42:0/403031436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bec15e3c0 msgr2=0x7f1bec15bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:41.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.765+0000 7f1bf0e00640 1 --2- 172.21.15.42:0/403031436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bec15e3c0 0x7f1bec15bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:41.765 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.765+0000 7f1bf0e00640 1 -- 172.21.15.42:0/403031436 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bec09d120 con 0x7f1bec06cd20 2024-09-17T01:47:41.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.766+0000 7f1bf0e00640 1 --2- 172.21.15.42:0/403031436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bec06cd20 0x7f1bec1545a0 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7f1be000e7c0 tx=0x7f1be000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:41.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.766+0000 7f1be8c00640 1 -- 172.21.15.42:0/403031436 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be000ccc0 con 0x7f1bec06cd20 2024-09-17T01:47:41.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.766+0000 7f1be8c00640 1 -- 172.21.15.42:0/403031436 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1be0010430 con 0x7f1bec06cd20 2024-09-17T01:47:41.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.766+0000 7f1be8c00640 1 -- 172.21.15.42:0/403031436 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be0010860 con 0x7f1bec06cd20 2024-09-17T01:47:41.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.766+0000 7f1bf2200640 1 -- 172.21.15.42:0/403031436 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bec09d400 con 0x7f1bec06cd20 2024-09-17T01:47:41.766 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.766+0000 7f1bf2200640 1 -- 172.21.15.42:0/403031436 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bec09d9c0 con 0x7f1bec06cd20 2024-09-17T01:47:41.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.767+0000 7f1bf2200640 1 -- 172.21.15.42:0/403031436 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bec06d130 con 0x7f1bec06cd20 2024-09-17T01:47:41.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.768+0000 7f1be8c00640 1 -- 172.21.15.42:0/403031436 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1be0010a00 con 0x7f1bec06cd20 2024-09-17T01:47:41.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.770+0000 7f1be8c00640 1 --2- 172.21.15.42:0/403031436 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1bcc078bc0 0x7f1bcc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:41.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.770+0000 7f1be8c00640 1 -- 172.21.15.42:0/403031436 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5709+0+0 (secure 0 0 0) 0x7f1be009b770 con 0x7f1bec06cd20 2024-09-17T01:47:41.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.771+0000 7f1bebe00640 1 --2- 172.21.15.42:0/403031436 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1bcc078bc0 0x7f1bcc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:41.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.771+0000 7f1bebe00640 1 --2- 172.21.15.42:0/403031436 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1bcc078bc0 0x7f1bcc07b0d0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8033000 tx=0x7f1bd8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:41.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:41.775+0000 7f1be8c00640 1 -- 172.21.15.42:0/403031436 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1be00634c0 con 0x7f1bec06cd20 2024-09-17T01:47:41.977 INFO:tasks.ceph.mds.c.smithi042.stderr:2024-09-17T01:47:41.978+0000 7f989fa00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:47:42.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.042+0000 7f1bf2200640 1 -- 172.21.15.42:0/403031436 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f1bec15dd80 con 0x7f1bec06cd20 2024-09-17T01:47:42.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.042+0000 7f1be8c00640 1 -- 172.21.15.42:0/403031436 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1966 (secure 0 0 0) 0x7f1be0067ef0 con 0x7f1bec06cd20 2024-09-17T01:47:42.041 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:42.041 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":962,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":200,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":447397888,"bytes_avail":772646715392,"bytes_total":773094113280,"write_bytes_sec":2287,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":159,"btime":"2024-09-17T01:47:39:016238+0000","id":14,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":14,"rank":0,"name":"c","status":"up:active","gid":10776}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":34,"modified":"2024-09-17T01:47:29.245278+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:47:42.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.044+0000 7f1bf2200640 1 -- 172.21.15.42:0/403031436 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1bcc078bc0 msgr2=0x7f1bcc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:42.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.044+0000 7f1bf2200640 1 --2- 172.21.15.42:0/403031436 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1bcc078bc0 0x7f1bcc07b0d0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8033000 tx=0x7f1bd8004730 comp rx=0 tx=0).stop 2024-09-17T01:47:42.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.044+0000 7f1bf2200640 1 -- 172.21.15.42:0/403031436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bec06cd20 msgr2=0x7f1bec1545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:42.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.044+0000 7f1bf2200640 1 --2- 172.21.15.42:0/403031436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bec06cd20 0x7f1bec1545a0 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7f1be000e7c0 tx=0x7f1be000ec80 comp rx=0 tx=0).stop 2024-09-17T01:47:42.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.044+0000 7f1bf2200640 1 -- 172.21.15.42:0/403031436 shutdown_connections 2024-09-17T01:47:42.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.044+0000 7f1bf2200640 1 --2- 172.21.15.42:0/403031436 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1bcc078bc0 0x7f1bcc07b0d0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:42.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.044+0000 7f1bf2200640 1 --2- 172.21.15.42:0/403031436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bec15e3c0 0x7f1bec15bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:42.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.044+0000 7f1bf2200640 1 --2- 172.21.15.42:0/403031436 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1bec0cf230 0x7f1bec09a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:42.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.044+0000 7f1bf2200640 1 --2- 172.21.15.42:0/403031436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1bec06cd20 0x7f1bec1545a0 unknown :-1 s=CLOSED pgs=2289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:42.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.044+0000 7f1bf2200640 1 -- 172.21.15.42:0/403031436 >> 172.21.15.42:0/403031436 conn(0x7f1bec0b25f0 msgr2=0x7f1bec06ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:42.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.045+0000 7f1bf2200640 1 -- 172.21.15.42:0/403031436 shutdown_connections 2024-09-17T01:47:42.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.045+0000 7f1bf2200640 1 -- 172.21.15.42:0/403031436 wait complete. 2024-09-17T01:47:42.070 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T01:47:42.070 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:47:42.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.298+0000 7f2f5be00640 1 -- 172.21.15.42:0/2921353006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f5c0b4be0 msgr2=0x7f2f5c15d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:42.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.298+0000 7f2f5be00640 1 --2- 172.21.15.42:0/2921353006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f5c0b4be0 0x7f2f5c15d6b0 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c005fd0 tx=0x7f2f4c02a5d0 comp rx=0 tx=0).stop 2024-09-17T01:47:42.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.298+0000 7f2f5be00640 1 -- 172.21.15.42:0/2921353006 shutdown_connections 2024-09-17T01:47:42.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.298+0000 7f2f5be00640 1 --2- 172.21.15.42:0/2921353006 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f5c0cf7c0 0x7f2f5c06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:42.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.298+0000 7f2f5be00640 1 --2- 172.21.15.42:0/2921353006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f5c0b4be0 0x7f2f5c15d6b0 unknown :-1 s=CLOSED pgs=2290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:42.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.298+0000 7f2f5be00640 1 -- 172.21.15.42:0/2921353006 >> 172.21.15.42:0/2921353006 conn(0x7f2f5c0b25f0 msgr2=0x7f2f5c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:42.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.298+0000 7f2f5be00640 1 -- 172.21.15.42:0/2921353006 shutdown_connections 2024-09-17T01:47:42.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.298+0000 7f2f5be00640 1 -- 172.21.15.42:0/2921353006 wait complete. 2024-09-17T01:47:42.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.300+0000 7f2f5be00640 1 Processor -- start 2024-09-17T01:47:42.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.300+0000 7f2f5be00640 1 -- start start 2024-09-17T01:47:42.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.302+0000 7f2f5be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f5c06d260 0x7f2f5c151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:42.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.302+0000 7f2f5be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f5c0b4be0 0x7f2f5c14e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:42.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.302+0000 7f2f5be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f5c0cf7c0 0x7f2f5c14fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:42.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.302+0000 7f2f5be00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c153970 con 0x7f2f5c06d260 2024-09-17T01:47:42.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.302+0000 7f2f5be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c1537f0 con 0x7f2f5c0cf7c0 2024-09-17T01:47:42.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.302+0000 7f2f5be00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2f5c153af0 con 0x7f2f5c0b4be0 2024-09-17T01:47:42.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.302+0000 7f2f5aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f5c06d260 0x7f2f5c151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:42.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.302+0000 7f2f5aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f5c06d260 0x7f2f5c151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52412/0 (socket says 172.21.15.42:52412) 2024-09-17T01:47:42.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.302+0000 7f2f5aa00640 1 -- 172.21.15.42:0/21429753 learned_addr learned my addr 172.21.15.42:0/21429753 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:42.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.302+0000 7f2f5a000640 1 --2- 172.21.15.42:0/21429753 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f5c0b4be0 0x7f2f5c14e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:42.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.302+0000 7f2f5b400640 1 --2- 172.21.15.42:0/21429753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f5c0cf7c0 0x7f2f5c14fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:42.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.303+0000 7f2f5aa00640 1 -- 172.21.15.42:0/21429753 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f5c0b4be0 msgr2=0x7f2f5c14e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:42.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.303+0000 7f2f5aa00640 1 --2- 172.21.15.42:0/21429753 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f5c0b4be0 0x7f2f5c14e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:42.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.303+0000 7f2f5aa00640 1 -- 172.21.15.42:0/21429753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f5c0cf7c0 msgr2=0x7f2f5c14fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:42.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.303+0000 7f2f5aa00640 1 --2- 172.21.15.42:0/21429753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f5c0cf7c0 0x7f2f5c14fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:42.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.303+0000 7f2f5aa00640 1 -- 172.21.15.42:0/21429753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c1f90e0 con 0x7f2f5c06d260 2024-09-17T01:47:42.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.303+0000 7f2f5b400640 1 --2- 172.21.15.42:0/21429753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f5c0cf7c0 0x7f2f5c14fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:47:42.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.303+0000 7f2f5aa00640 1 --2- 172.21.15.42:0/21429753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f5c06d260 0x7f2f5c151470 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c034040 tx=0x7f2f4c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:42.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.303+0000 7f2f52a00640 1 -- 172.21.15.42:0/21429753 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c03e030 con 0x7f2f5c06d260 2024-09-17T01:47:42.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.303+0000 7f2f52a00640 1 -- 172.21.15.42:0/21429753 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f4c003ca0 con 0x7f2f5c06d260 2024-09-17T01:47:42.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.303+0000 7f2f5be00640 1 -- 172.21.15.42:0/21429753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5c1f93c0 con 0x7f2f5c06d260 2024-09-17T01:47:42.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.303+0000 7f2f52a00640 1 -- 172.21.15.42:0/21429753 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c035040 con 0x7f2f5c06d260 2024-09-17T01:47:42.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.303+0000 7f2f5be00640 1 -- 172.21.15.42:0/21429753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f5c1f9980 con 0x7f2f5c06d260 2024-09-17T01:47:42.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.305+0000 7f2f5be00640 1 -- 172.21.15.42:0/21429753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f5c15d6b0 con 0x7f2f5c06d260 2024-09-17T01:47:42.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.306+0000 7f2f52a00640 1 -- 172.21.15.42:0/21429753 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2f4c041030 con 0x7f2f5c06d260 2024-09-17T01:47:42.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.306+0000 7f2f52a00640 1 --2- 172.21.15.42:0/21429753 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f3c078b90 0x7f2f3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:42.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.307+0000 7f2f52a00640 1 -- 172.21.15.42:0/21429753 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5709+0+0 (secure 0 0 0) 0x7f2f4c0bb480 con 0x7f2f5c06d260 2024-09-17T01:47:42.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.307+0000 7f2f5a000640 1 --2- 172.21.15.42:0/21429753 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f3c078b90 0x7f2f3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:42.307 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.308+0000 7f2f5a000640 1 --2- 172.21.15.42:0/21429753 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f3c078b90 0x7f2f3c07b0a0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2f48005fd0 tx=0x7f2f48005850 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:42.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.311+0000 7f2f52a00640 1 -- 172.21.15.42:0/21429753 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2f4c083820 con 0x7f2f5c06d260 2024-09-17T01:47:42.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.502+0000 7f2f5be00640 1 -- 172.21.15.42:0/21429753 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2f5c1519b0 con 0x7f2f3c078b90 2024-09-17T01:47:42.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.507+0000 7f2f52a00640 1 -- 172.21.15.42:0/21429753 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252481 (secure 0 0 0) 0x7f2f5c1519b0 con 0x7f2f3c078b90 2024-09-17T01:47:42.510 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:42.511 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:47:42.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.511+0000 7f2f5be00640 1 -- 172.21.15.42:0/21429753 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f3c078b90 msgr2=0x7f2f3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.511+0000 7f2f5be00640 1 --2- 172.21.15.42:0/21429753 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f3c078b90 0x7f2f3c07b0a0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2f48005fd0 tx=0x7f2f48005850 comp rx=0 tx=0).stop 2024-09-17T01:47:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.511+0000 7f2f5be00640 1 -- 172.21.15.42:0/21429753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f5c06d260 msgr2=0x7f2f5c151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.511+0000 7f2f5be00640 1 --2- 172.21.15.42:0/21429753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f5c06d260 0x7f2f5c151470 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c034040 tx=0x7f2f4c0038a0 comp rx=0 tx=0).stop 2024-09-17T01:47:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.511+0000 7f2f5be00640 1 -- 172.21.15.42:0/21429753 shutdown_connections 2024-09-17T01:47:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.511+0000 7f2f5be00640 1 --2- 172.21.15.42:0/21429753 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2f3c078b90 0x7f2f3c07b0a0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.511+0000 7f2f5be00640 1 --2- 172.21.15.42:0/21429753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f5c0cf7c0 0x7f2f5c14fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.511+0000 7f2f5be00640 1 --2- 172.21.15.42:0/21429753 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2f5c0b4be0 0x7f2f5c14e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.511+0000 7f2f5be00640 1 --2- 172.21.15.42:0/21429753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f5c06d260 0x7f2f5c151470 unknown :-1 s=CLOSED pgs=2291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.511+0000 7f2f5be00640 1 -- 172.21.15.42:0/21429753 >> 172.21.15.42:0/21429753 conn(0x7f2f5c0b25f0 msgr2=0x7f2f5c0b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.512+0000 7f2f5be00640 1 -- 172.21.15.42:0/21429753 shutdown_connections 2024-09-17T01:47:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:42.512+0000 7f2f5be00640 1 -- 172.21.15.42:0/21429753 wait complete. 2024-09-17T01:47:42.532 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":667,"stamp":"2024-09-17T01:47:41.248190+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":436912,"kb_used_data":20872,"kb_used_omap":12,"kb_used_meta":415859,"kb_avail":754537808,"statfs":{"total":773094113280,"available":772646715392,"internally_reserved":0,"allocated":21372928,"data_stored":10090116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":425840180},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.266155"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000743+0000","last_change":"2024-09-17T01:47:36.013882+0000","last_active":"2024-09-17T01:47:37.000743+0000","last_peered":"2024-09-17T01:47:37.000743+0000","last_clean":"2024-09-17T01:47:37.000743+0000","last_became_active":"2024-09-17T01:47:36.013578+0000","last_became_peered":"2024-09-17T01:47:36.013578+0000","last_unstale":"2024-09-17T01:47:37.000743+0000","last_undegraded":"2024-09-17T01:47:37.000743+0000","last_fullsized":"2024-09-17T01:47:37.000743+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:36.234339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152688+0000","last_change":"2024-09-17T01:47:36.034685+0000","last_active":"2024-09-17T01:47:37.152688+0000","last_peered":"2024-09-17T01:47:37.152688+0000","last_clean":"2024-09-17T01:47:37.152688+0000","last_became_active":"2024-09-17T01:47:36.030145+0000","last_became_peered":"2024-09-17T01:47:36.030145+0000","last_unstale":"2024-09-17T01:47:37.152688+0000","last_undegraded":"2024-09-17T01:47:37.152688+0000","last_fullsized":"2024-09-17T01:47:37.152688+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:09.577267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152499+0000","last_change":"2024-09-17T01:47:36.019883+0000","last_active":"2024-09-17T01:47:37.152499+0000","last_peered":"2024-09-17T01:47:37.152499+0000","last_clean":"2024-09-17T01:47:37.152499+0000","last_became_active":"2024-09-17T01:47:36.019574+0000","last_became_peered":"2024-09-17T01:47:36.019574+0000","last_unstale":"2024-09-17T01:47:37.152499+0000","last_undegraded":"2024-09-17T01:47:37.152499+0000","last_fullsized":"2024-09-17T01:47:37.152499+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:20.853645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001547+0000","last_change":"2024-09-17T01:47:36.008580+0000","last_active":"2024-09-17T01:47:37.001547+0000","last_peered":"2024-09-17T01:47:37.001547+0000","last_clean":"2024-09-17T01:47:37.001547+0000","last_became_active":"2024-09-17T01:47:36.007880+0000","last_became_peered":"2024-09-17T01:47:36.007880+0000","last_unstale":"2024-09-17T01:47:37.001547+0000","last_undegraded":"2024-09-17T01:47:37.001547+0000","last_fullsized":"2024-09-17T01:47:37.001547+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:39.331109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000392+0000","last_change":"2024-09-17T01:47:36.018758+0000","last_active":"2024-09-17T01:47:37.000392+0000","last_peered":"2024-09-17T01:47:37.000392+0000","last_clean":"2024-09-17T01:47:37.000392+0000","last_became_active":"2024-09-17T01:47:36.018420+0000","last_became_peered":"2024-09-17T01:47:36.018420+0000","last_unstale":"2024-09-17T01:47:37.000392+0000","last_undegraded":"2024-09-17T01:47:37.000392+0000","last_fullsized":"2024-09-17T01:47:37.000392+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:23.469329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151844+0000","last_change":"2024-09-17T01:47:36.029635+0000","last_active":"2024-09-17T01:47:37.151844+0000","last_peered":"2024-09-17T01:47:37.151844+0000","last_clean":"2024-09-17T01:47:37.151844+0000","last_became_active":"2024-09-17T01:47:36.028833+0000","last_became_peered":"2024-09-17T01:47:36.028833+0000","last_unstale":"2024-09-17T01:47:37.151844+0000","last_undegraded":"2024-09-17T01:47:37.151844+0000","last_fullsized":"2024-09-17T01:47:37.151844+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:08.153607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151034+0000","last_change":"2024-09-17T01:47:36.015851+0000","last_active":"2024-09-17T01:47:37.151034+0000","last_peered":"2024-09-17T01:47:37.151034+0000","last_clean":"2024-09-17T01:47:37.151034+0000","last_became_active":"2024-09-17T01:47:36.015545+0000","last_became_peered":"2024-09-17T01:47:36.015545+0000","last_unstale":"2024-09-17T01:47:37.151034+0000","last_undegraded":"2024-09-17T01:47:37.151034+0000","last_fullsized":"2024-09-17T01:47:37.151034+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:22.526093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001282+0000","last_change":"2024-09-17T01:47:36.014686+0000","last_active":"2024-09-17T01:47:37.001282+0000","last_peered":"2024-09-17T01:47:37.001282+0000","last_clean":"2024-09-17T01:47:37.001282+0000","last_became_active":"2024-09-17T01:47:36.012351+0000","last_became_peered":"2024-09-17T01:47:36.012351+0000","last_unstale":"2024-09-17T01:47:37.001282+0000","last_undegraded":"2024-09-17T01:47:37.001282+0000","last_fullsized":"2024-09-17T01:47:37.001282+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:22:12.658086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151530+0000","last_change":"2024-09-17T01:47:36.028094+0000","last_active":"2024-09-17T01:47:37.151530+0000","last_peered":"2024-09-17T01:47:37.151530+0000","last_clean":"2024-09-17T01:47:37.151530+0000","last_became_active":"2024-09-17T01:47:36.027777+0000","last_became_peered":"2024-09-17T01:47:36.027777+0000","last_unstale":"2024-09-17T01:47:37.151530+0000","last_undegraded":"2024-09-17T01:47:37.151530+0000","last_fullsized":"2024-09-17T01:47:37.151530+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:17:00.239100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001305+0000","last_change":"2024-09-17T01:47:36.018027+0000","last_active":"2024-09-17T01:47:37.001305+0000","last_peered":"2024-09-17T01:47:37.001305+0000","last_clean":"2024-09-17T01:47:37.001305+0000","last_became_active":"2024-09-17T01:47:36.017347+0000","last_became_peered":"2024-09-17T01:47:36.017347+0000","last_unstale":"2024-09-17T01:47:37.001305+0000","last_undegraded":"2024-09-17T01:47:37.001305+0000","last_fullsized":"2024-09-17T01:47:37.001305+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:09.444067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152742+0000","last_change":"2024-09-17T01:47:36.034343+0000","last_active":"2024-09-17T01:47:37.152742+0000","last_peered":"2024-09-17T01:47:37.152742+0000","last_clean":"2024-09-17T01:47:37.152742+0000","last_became_active":"2024-09-17T01:47:36.026493+0000","last_became_peered":"2024-09-17T01:47:36.026493+0000","last_unstale":"2024-09-17T01:47:37.152742+0000","last_undegraded":"2024-09-17T01:47:37.152742+0000","last_fullsized":"2024-09-17T01:47:37.152742+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:00.861850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.153324+0000","last_change":"2024-09-17T01:47:36.017169+0000","last_active":"2024-09-17T01:47:37.153324+0000","last_peered":"2024-09-17T01:47:37.153324+0000","last_clean":"2024-09-17T01:47:37.153324+0000","last_became_active":"2024-09-17T01:47:36.016869+0000","last_became_peered":"2024-09-17T01:47:36.016869+0000","last_unstale":"2024-09-17T01:47:37.153324+0000","last_undegraded":"2024-09-17T01:47:37.153324+0000","last_fullsized":"2024-09-17T01:47:37.153324+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:09.444067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999712+0000","last_change":"2024-09-17T01:47:36.013822+0000","last_active":"2024-09-17T01:47:36.999712+0000","last_peered":"2024-09-17T01:47:36.999712+0000","last_clean":"2024-09-17T01:47:36.999712+0000","last_became_active":"2024-09-17T01:47:36.013426+0000","last_became_peered":"2024-09-17T01:47:36.013426+0000","last_unstale":"2024-09-17T01:47:36.999712+0000","last_undegraded":"2024-09-17T01:47:36.999712+0000","last_fullsized":"2024-09-17T01:47:36.999712+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:56.911080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151673+0000","last_change":"2024-09-17T01:47:36.014797+0000","last_active":"2024-09-17T01:47:37.151673+0000","last_peered":"2024-09-17T01:47:37.151673+0000","last_clean":"2024-09-17T01:47:37.151673+0000","last_became_active":"2024-09-17T01:47:36.014494+0000","last_became_peered":"2024-09-17T01:47:36.014494+0000","last_unstale":"2024-09-17T01:47:37.151673+0000","last_undegraded":"2024-09-17T01:47:37.151673+0000","last_fullsized":"2024-09-17T01:47:37.151673+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:47:34.470006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151691+0000","last_change":"2024-09-17T01:47:36.020290+0000","last_active":"2024-09-17T01:47:37.151691+0000","last_peered":"2024-09-17T01:47:37.151691+0000","last_clean":"2024-09-17T01:47:37.151691+0000","last_became_active":"2024-09-17T01:47:36.019511+0000","last_became_peered":"2024-09-17T01:47:36.019511+0000","last_unstale":"2024-09-17T01:47:37.151691+0000","last_undegraded":"2024-09-17T01:47:37.151691+0000","last_fullsized":"2024-09-17T01:47:37.151691+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:41.467333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151267+0000","last_change":"2024-09-17T01:47:36.023298+0000","last_active":"2024-09-17T01:47:37.151267+0000","last_peered":"2024-09-17T01:47:37.151267+0000","last_clean":"2024-09-17T01:47:37.151267+0000","last_became_active":"2024-09-17T01:47:36.022864+0000","last_became_peered":"2024-09-17T01:47:36.022864+0000","last_unstale":"2024-09-17T01:47:37.151267+0000","last_undegraded":"2024-09-17T01:47:37.151267+0000","last_fullsized":"2024-09-17T01:47:37.151267+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:36.823475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000776+0000","last_change":"2024-09-17T01:47:36.013172+0000","last_active":"2024-09-17T01:47:37.000776+0000","last_peered":"2024-09-17T01:47:37.000776+0000","last_clean":"2024-09-17T01:47:37.000776+0000","last_became_active":"2024-09-17T01:47:36.012831+0000","last_became_peered":"2024-09-17T01:47:36.012831+0000","last_unstale":"2024-09-17T01:47:37.000776+0000","last_undegraded":"2024-09-17T01:47:37.000776+0000","last_fullsized":"2024-09-17T01:47:37.000776+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:28.673161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027218+0000","last_change":"2024-09-17T01:47:36.027786+0000","last_active":"2024-09-17T01:47:37.027218+0000","last_peered":"2024-09-17T01:47:37.027218+0000","last_clean":"2024-09-17T01:47:37.027218+0000","last_became_active":"2024-09-17T01:47:36.027311+0000","last_became_peered":"2024-09-17T01:47:36.027311+0000","last_unstale":"2024-09-17T01:47:37.027218+0000","last_undegraded":"2024-09-17T01:47:37.027218+0000","last_fullsized":"2024-09-17T01:47:37.027218+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:41.527675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152142+0000","last_change":"2024-09-17T01:47:36.021267+0000","last_active":"2024-09-17T01:47:37.152142+0000","last_peered":"2024-09-17T01:47:37.152142+0000","last_clean":"2024-09-17T01:47:37.152142+0000","last_became_active":"2024-09-17T01:47:36.020837+0000","last_became_peered":"2024-09-17T01:47:36.020837+0000","last_unstale":"2024-09-17T01:47:37.152142+0000","last_undegraded":"2024-09-17T01:47:37.152142+0000","last_fullsized":"2024-09-17T01:47:37.152142+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:05.922664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027027+0000","last_change":"2024-09-17T01:47:36.023252+0000","last_active":"2024-09-17T01:47:37.027027+0000","last_peered":"2024-09-17T01:47:37.027027+0000","last_clean":"2024-09-17T01:47:37.027027+0000","last_became_active":"2024-09-17T01:47:36.022317+0000","last_became_peered":"2024-09-17T01:47:36.022317+0000","last_unstale":"2024-09-17T01:47:37.027027+0000","last_undegraded":"2024-09-17T01:47:37.027027+0000","last_fullsized":"2024-09-17T01:47:37.027027+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:15.810411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027246+0000","last_change":"2024-09-17T01:47:36.029064+0000","last_active":"2024-09-17T01:47:37.027246+0000","last_peered":"2024-09-17T01:47:37.027246+0000","last_clean":"2024-09-17T01:47:37.027246+0000","last_became_active":"2024-09-17T01:47:36.028613+0000","last_became_peered":"2024-09-17T01:47:36.028613+0000","last_unstale":"2024-09-17T01:47:37.027246+0000","last_undegraded":"2024-09-17T01:47:37.027246+0000","last_fullsized":"2024-09-17T01:47:37.027246+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:09.498750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151862+0000","last_change":"2024-09-17T01:47:36.030555+0000","last_active":"2024-09-17T01:47:37.151862+0000","last_peered":"2024-09-17T01:47:37.151862+0000","last_clean":"2024-09-17T01:47:37.151862+0000","last_became_active":"2024-09-17T01:47:36.030260+0000","last_became_peered":"2024-09-17T01:47:36.030260+0000","last_unstale":"2024-09-17T01:47:37.151862+0000","last_undegraded":"2024-09-17T01:47:37.151862+0000","last_fullsized":"2024-09-17T01:47:37.151862+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:43.922683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999299+0000","last_change":"2024-09-17T01:47:36.026322+0000","last_active":"2024-09-17T01:47:36.999299+0000","last_peered":"2024-09-17T01:47:36.999299+0000","last_clean":"2024-09-17T01:47:36.999299+0000","last_became_active":"2024-09-17T01:47:36.026011+0000","last_became_peered":"2024-09-17T01:47:36.026011+0000","last_unstale":"2024-09-17T01:47:36.999299+0000","last_undegraded":"2024-09-17T01:47:36.999299+0000","last_fullsized":"2024-09-17T01:47:36.999299+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:34.690718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000626+0000","last_change":"2024-09-17T01:47:36.011441+0000","last_active":"2024-09-17T01:47:37.000626+0000","last_peered":"2024-09-17T01:47:37.000626+0000","last_clean":"2024-09-17T01:47:37.000626+0000","last_became_active":"2024-09-17T01:47:36.008550+0000","last_became_peered":"2024-09-17T01:47:36.008550+0000","last_unstale":"2024-09-17T01:47:37.000626+0000","last_undegraded":"2024-09-17T01:47:37.000626+0000","last_fullsized":"2024-09-17T01:47:37.000626+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:39.038834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152436+0000","last_change":"2024-09-17T01:47:36.034508+0000","last_active":"2024-09-17T01:47:37.152436+0000","last_peered":"2024-09-17T01:47:37.152436+0000","last_clean":"2024-09-17T01:47:37.152436+0000","last_became_active":"2024-09-17T01:47:36.027035+0000","last_became_peered":"2024-09-17T01:47:36.027035+0000","last_unstale":"2024-09-17T01:47:37.152436+0000","last_undegraded":"2024-09-17T01:47:37.152436+0000","last_fullsized":"2024-09-17T01:47:37.152436+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:40.343277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152216+0000","last_change":"2024-09-17T01:47:36.035038+0000","last_active":"2024-09-17T01:47:37.152216+0000","last_peered":"2024-09-17T01:47:37.152216+0000","last_clean":"2024-09-17T01:47:37.152216+0000","last_became_active":"2024-09-17T01:47:36.034208+0000","last_became_peered":"2024-09-17T01:47:36.034208+0000","last_unstale":"2024-09-17T01:47:37.152216+0000","last_undegraded":"2024-09-17T01:47:37.152216+0000","last_fullsized":"2024-09-17T01:47:37.152216+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:21.980207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152627+0000","last_change":"2024-09-17T01:47:36.035010+0000","last_active":"2024-09-17T01:47:37.152627+0000","last_peered":"2024-09-17T01:47:37.152627+0000","last_clean":"2024-09-17T01:47:37.152627+0000","last_became_active":"2024-09-17T01:47:36.026693+0000","last_became_peered":"2024-09-17T01:47:36.026693+0000","last_unstale":"2024-09-17T01:47:37.152627+0000","last_undegraded":"2024-09-17T01:47:37.152627+0000","last_fullsized":"2024-09-17T01:47:37.152627+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:10.746690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000568+0000","last_change":"2024-09-17T01:47:36.015852+0000","last_active":"2024-09-17T01:47:37.000568+0000","last_peered":"2024-09-17T01:47:37.000568+0000","last_clean":"2024-09-17T01:47:37.000568+0000","last_became_active":"2024-09-17T01:47:36.015505+0000","last_became_peered":"2024-09-17T01:47:36.015505+0000","last_unstale":"2024-09-17T01:47:37.000568+0000","last_undegraded":"2024-09-17T01:47:37.000568+0000","last_fullsized":"2024-09-17T01:47:37.000568+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:55.582852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152265+0000","last_change":"2024-09-17T01:47:36.028347+0000","last_active":"2024-09-17T01:47:37.152265+0000","last_peered":"2024-09-17T01:47:37.152265+0000","last_clean":"2024-09-17T01:47:37.152265+0000","last_became_active":"2024-09-17T01:47:36.028038+0000","last_became_peered":"2024-09-17T01:47:36.028038+0000","last_unstale":"2024-09-17T01:47:37.152265+0000","last_undegraded":"2024-09-17T01:47:37.152265+0000","last_fullsized":"2024-09-17T01:47:37.152265+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:03.911616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.153010+0000","last_change":"2024-09-17T01:47:36.019539+0000","last_active":"2024-09-17T01:47:37.153010+0000","last_peered":"2024-09-17T01:47:37.153010+0000","last_clean":"2024-09-17T01:47:37.153010+0000","last_became_active":"2024-09-17T01:47:36.018394+0000","last_became_peered":"2024-09-17T01:47:36.018394+0000","last_unstale":"2024-09-17T01:47:37.153010+0000","last_undegraded":"2024-09-17T01:47:37.153010+0000","last_fullsized":"2024-09-17T01:47:37.153010+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:51:17.387170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.026945+0000","last_change":"2024-09-17T01:47:36.023965+0000","last_active":"2024-09-17T01:47:37.026945+0000","last_peered":"2024-09-17T01:47:37.026945+0000","last_clean":"2024-09-17T01:47:37.026945+0000","last_became_active":"2024-09-17T01:47:36.023148+0000","last_became_peered":"2024-09-17T01:47:36.023148+0000","last_unstale":"2024-09-17T01:47:37.026945+0000","last_undegraded":"2024-09-17T01:47:37.026945+0000","last_fullsized":"2024-09-17T01:47:37.026945+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:50.320950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000620+0000","last_change":"2024-09-17T01:47:36.017887+0000","last_active":"2024-09-17T01:47:37.000620+0000","last_peered":"2024-09-17T01:47:37.000620+0000","last_clean":"2024-09-17T01:47:37.000620+0000","last_became_active":"2024-09-17T01:47:36.015123+0000","last_became_peered":"2024-09-17T01:47:36.015123+0000","last_unstale":"2024-09-17T01:47:37.000620+0000","last_undegraded":"2024-09-17T01:47:37.000620+0000","last_fullsized":"2024-09-17T01:47:37.000620+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:10.073566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152939+0000","last_change":"2024-09-17T01:47:36.017272+0000","last_active":"2024-09-17T01:47:37.152939+0000","last_peered":"2024-09-17T01:47:37.152939+0000","last_clean":"2024-09-17T01:47:37.152939+0000","last_became_active":"2024-09-17T01:47:36.016956+0000","last_became_peered":"2024-09-17T01:47:36.016956+0000","last_unstale":"2024-09-17T01:47:37.152939+0000","last_undegraded":"2024-09-17T01:47:37.152939+0000","last_fullsized":"2024-09-17T01:47:37.152939+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:00:39.743352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1f","version":"199'4","reported_seq":19,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152162+0000","last_change":"2024-09-17T01:47:35.005307+0000","last_active":"2024-09-17T01:47:37.152162+0000","last_peered":"2024-09-17T01:47:37.152162+0000","last_clean":"2024-09-17T01:47:37.152162+0000","last_became_active":"2024-09-17T01:47:35.004930+0000","last_became_peered":"2024-09-17T01:47:35.004930+0000","last_unstale":"2024-09-17T01:47:37.152162+0000","last_undegraded":"2024-09-17T01:47:37.152162+0000","last_fullsized":"2024-09-17T01:47:37.152162+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:08.570784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152336+0000","last_change":"2024-09-17T01:47:36.030285+0000","last_active":"2024-09-17T01:47:37.152336+0000","last_peered":"2024-09-17T01:47:37.152336+0000","last_clean":"2024-09-17T01:47:37.152336+0000","last_became_active":"2024-09-17T01:47:36.029689+0000","last_became_peered":"2024-09-17T01:47:36.029689+0000","last_unstale":"2024-09-17T01:47:37.152336+0000","last_undegraded":"2024-09-17T01:47:37.152336+0000","last_fullsized":"2024-09-17T01:47:37.152336+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:26.644307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"199'1","reported_seq":16,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000304+0000","last_change":"2024-09-17T01:47:34.997816+0000","last_active":"2024-09-17T01:47:37.000304+0000","last_peered":"2024-09-17T01:47:37.000304+0000","last_clean":"2024-09-17T01:47:37.000304+0000","last_became_active":"2024-09-17T01:47:34.997504+0000","last_became_peered":"2024-09-17T01:47:34.997504+0000","last_unstale":"2024-09-17T01:47:37.000304+0000","last_undegraded":"2024-09-17T01:47:37.000304+0000","last_fullsized":"2024-09-17T01:47:37.000304+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:50:11.530947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151844+0000","last_change":"2024-09-17T01:47:36.014977+0000","last_active":"2024-09-17T01:47:37.151844+0000","last_peered":"2024-09-17T01:47:37.151844+0000","last_clean":"2024-09-17T01:47:37.151844+0000","last_became_active":"2024-09-17T01:47:36.014207+0000","last_became_peered":"2024-09-17T01:47:36.014207+0000","last_unstale":"2024-09-17T01:47:37.151844+0000","last_undegraded":"2024-09-17T01:47:37.151844+0000","last_fullsized":"2024-09-17T01:47:37.151844+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:36.234339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1c","version":"199'2","reported_seq":17,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.153484+0000","last_change":"2024-09-17T01:47:34.999793+0000","last_active":"2024-09-17T01:47:37.153484+0000","last_peered":"2024-09-17T01:47:37.153484+0000","last_clean":"2024-09-17T01:47:37.153484+0000","last_became_active":"2024-09-17T01:47:34.999466+0000","last_became_peered":"2024-09-17T01:47:34.999466+0000","last_unstale":"2024-09-17T01:47:37.153484+0000","last_undegraded":"2024-09-17T01:47:37.153484+0000","last_fullsized":"2024-09-17T01:47:37.153484+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:45.137637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151879+0000","last_change":"2024-09-17T01:47:36.034879+0000","last_active":"2024-09-17T01:47:37.151879+0000","last_peered":"2024-09-17T01:47:37.151879+0000","last_clean":"2024-09-17T01:47:37.151879+0000","last_became_active":"2024-09-17T01:47:36.029648+0000","last_became_peered":"2024-09-17T01:47:36.029648+0000","last_unstale":"2024-09-17T01:47:37.151879+0000","last_undegraded":"2024-09-17T01:47:37.151879+0000","last_fullsized":"2024-09-17T01:47:37.151879+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:17.902835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1b","version":"199'1","reported_seq":16,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001307+0000","last_change":"2024-09-17T01:47:35.001332+0000","last_active":"2024-09-17T01:47:37.001307+0000","last_peered":"2024-09-17T01:47:37.001307+0000","last_clean":"2024-09-17T01:47:37.001307+0000","last_became_active":"2024-09-17T01:47:35.000978+0000","last_became_peered":"2024-09-17T01:47:35.000978+0000","last_unstale":"2024-09-17T01:47:37.001307+0000","last_undegraded":"2024-09-17T01:47:37.001307+0000","last_fullsized":"2024-09-17T01:47:37.001307+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:25.637823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151804+0000","last_change":"2024-09-17T01:47:36.030160+0000","last_active":"2024-09-17T01:47:37.151804+0000","last_peered":"2024-09-17T01:47:37.151804+0000","last_clean":"2024-09-17T01:47:37.151804+0000","last_became_active":"2024-09-17T01:47:36.029783+0000","last_became_peered":"2024-09-17T01:47:36.029783+0000","last_unstale":"2024-09-17T01:47:37.151804+0000","last_undegraded":"2024-09-17T01:47:37.151804+0000","last_fullsized":"2024-09-17T01:47:37.151804+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:10.717752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1a","version":"199'1","reported_seq":16,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999838+0000","last_change":"2024-09-17T01:47:35.014399+0000","last_active":"2024-09-17T01:47:36.999838+0000","last_peered":"2024-09-17T01:47:36.999838+0000","last_clean":"2024-09-17T01:47:36.999838+0000","last_became_active":"2024-09-17T01:47:35.014095+0000","last_became_peered":"2024-09-17T01:47:35.014095+0000","last_unstale":"2024-09-17T01:47:36.999838+0000","last_undegraded":"2024-09-17T01:47:36.999838+0000","last_fullsized":"2024-09-17T01:47:36.999838+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:51.198589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151622+0000","last_change":"2024-09-17T01:47:36.023755+0000","last_active":"2024-09-17T01:47:37.151622+0000","last_peered":"2024-09-17T01:47:37.151622+0000","last_clean":"2024-09-17T01:47:37.151622+0000","last_became_active":"2024-09-17T01:47:36.023278+0000","last_became_peered":"2024-09-17T01:47:36.023278+0000","last_unstale":"2024-09-17T01:47:37.151622+0000","last_undegraded":"2024-09-17T01:47:37.151622+0000","last_fullsized":"2024-09-17T01:47:37.151622+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:34:08.578343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151251+0000","last_change":"2024-09-17T01:47:34.996555+0000","last_active":"2024-09-17T01:47:37.151251+0000","last_peered":"2024-09-17T01:47:37.151251+0000","last_clean":"2024-09-17T01:47:37.151251+0000","last_became_active":"2024-09-17T01:47:34.996193+0000","last_became_peered":"2024-09-17T01:47:34.996193+0000","last_unstale":"2024-09-17T01:47:37.151251+0000","last_undegraded":"2024-09-17T01:47:37.151251+0000","last_fullsized":"2024-09-17T01:47:37.151251+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:18.012845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999378+0000","last_change":"2024-09-17T01:47:36.025791+0000","last_active":"2024-09-17T01:47:36.999378+0000","last_peered":"2024-09-17T01:47:36.999378+0000","last_clean":"2024-09-17T01:47:36.999378+0000","last_became_active":"2024-09-17T01:47:36.020837+0000","last_became_peered":"2024-09-17T01:47:36.020837+0000","last_unstale":"2024-09-17T01:47:36.999378+0000","last_undegraded":"2024-09-17T01:47:36.999378+0000","last_fullsized":"2024-09-17T01:47:36.999378+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:11.950647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.026608+0000","last_change":"2024-09-17T01:47:34.999663+0000","last_active":"2024-09-17T01:47:37.026608+0000","last_peered":"2024-09-17T01:47:37.026608+0000","last_clean":"2024-09-17T01:47:37.026608+0000","last_became_active":"2024-09-17T01:47:34.999310+0000","last_became_peered":"2024-09-17T01:47:34.999310+0000","last_unstale":"2024-09-17T01:47:37.026608+0000","last_undegraded":"2024-09-17T01:47:37.026608+0000","last_fullsized":"2024-09-17T01:47:37.026608+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:29.080659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.153581+0000","last_change":"2024-09-17T01:47:36.018854+0000","last_active":"2024-09-17T01:47:37.153581+0000","last_peered":"2024-09-17T01:47:37.153581+0000","last_clean":"2024-09-17T01:47:37.153581+0000","last_became_active":"2024-09-17T01:47:36.018537+0000","last_became_peered":"2024-09-17T01:47:36.018537+0000","last_unstale":"2024-09-17T01:47:37.153581+0000","last_undegraded":"2024-09-17T01:47:37.153581+0000","last_fullsized":"2024-09-17T01:47:37.153581+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:37.713412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000829+0000","last_change":"2024-09-17T01:47:35.012451+0000","last_active":"2024-09-17T01:47:37.000829+0000","last_peered":"2024-09-17T01:47:37.000829+0000","last_clean":"2024-09-17T01:47:37.000829+0000","last_became_active":"2024-09-17T01:47:35.012143+0000","last_became_peered":"2024-09-17T01:47:35.012143+0000","last_unstale":"2024-09-17T01:47:37.000829+0000","last_undegraded":"2024-09-17T01:47:37.000829+0000","last_fullsized":"2024-09-17T01:47:37.000829+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:47:29.395131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152584+0000","last_change":"2024-09-17T01:47:36.031889+0000","last_active":"2024-09-17T01:47:37.152584+0000","last_peered":"2024-09-17T01:47:37.152584+0000","last_clean":"2024-09-17T01:47:37.152584+0000","last_became_active":"2024-09-17T01:47:36.026270+0000","last_became_peered":"2024-09-17T01:47:36.026270+0000","last_unstale":"2024-09-17T01:47:37.152584+0000","last_undegraded":"2024-09-17T01:47:37.152584+0000","last_fullsized":"2024-09-17T01:47:37.152584+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:38:18.052479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001555+0000","last_change":"2024-09-17T01:47:35.001060+0000","last_active":"2024-09-17T01:47:37.001555+0000","last_peered":"2024-09-17T01:47:37.001555+0000","last_clean":"2024-09-17T01:47:37.001555+0000","last_became_active":"2024-09-17T01:47:35.000714+0000","last_became_peered":"2024-09-17T01:47:35.000714+0000","last_unstale":"2024-09-17T01:47:37.001555+0000","last_undegraded":"2024-09-17T01:47:37.001555+0000","last_fullsized":"2024-09-17T01:47:37.001555+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:40.476091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.153518+0000","last_change":"2024-09-17T01:47:36.010206+0000","last_active":"2024-09-17T01:47:37.153518+0000","last_peered":"2024-09-17T01:47:37.153518+0000","last_clean":"2024-09-17T01:47:37.153518+0000","last_became_active":"2024-09-17T01:47:36.009887+0000","last_became_peered":"2024-09-17T01:47:36.009887+0000","last_unstale":"2024-09-17T01:47:37.153518+0000","last_undegraded":"2024-09-17T01:47:37.153518+0000","last_fullsized":"2024-09-17T01:47:37.153518+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:14:33.651917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"199'3","reported_seq":18,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000846+0000","last_change":"2024-09-17T01:47:35.000275+0000","last_active":"2024-09-17T01:47:37.000846+0000","last_peered":"2024-09-17T01:47:37.000846+0000","last_clean":"2024-09-17T01:47:37.000846+0000","last_became_active":"2024-09-17T01:47:34.999955+0000","last_became_peered":"2024-09-17T01:47:34.999955+0000","last_unstale":"2024-09-17T01:47:37.000846+0000","last_undegraded":"2024-09-17T01:47:37.000846+0000","last_fullsized":"2024-09-17T01:47:37.000846+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:06.818743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.153399+0000","last_change":"2024-09-17T01:47:36.025624+0000","last_active":"2024-09-17T01:47:37.153399+0000","last_peered":"2024-09-17T01:47:37.153399+0000","last_clean":"2024-09-17T01:47:37.153399+0000","last_became_active":"2024-09-17T01:47:36.018304+0000","last_became_peered":"2024-09-17T01:47:36.018304+0000","last_unstale":"2024-09-17T01:47:37.153399+0000","last_undegraded":"2024-09-17T01:47:37.153399+0000","last_fullsized":"2024-09-17T01:47:37.153399+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:39.331109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.14","version":"199'6","reported_seq":21,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.026977+0000","last_change":"2024-09-17T01:47:35.002429+0000","last_active":"2024-09-17T01:47:37.026977+0000","last_peered":"2024-09-17T01:47:37.026977+0000","last_clean":"2024-09-17T01:47:37.026977+0000","last_became_active":"2024-09-17T01:47:35.002120+0000","last_became_peered":"2024-09-17T01:47:35.002120+0000","last_unstale":"2024-09-17T01:47:37.026977+0000","last_undegraded":"2024-09-17T01:47:37.026977+0000","last_fullsized":"2024-09-17T01:47:37.026977+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:11.320142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152275+0000","last_change":"2024-09-17T01:47:36.020636+0000","last_active":"2024-09-17T01:47:37.152275+0000","last_peered":"2024-09-17T01:47:37.152275+0000","last_clean":"2024-09-17T01:47:37.152275+0000","last_became_active":"2024-09-17T01:47:36.019460+0000","last_became_peered":"2024-09-17T01:47:36.019460+0000","last_unstale":"2024-09-17T01:47:37.152275+0000","last_undegraded":"2024-09-17T01:47:37.152275+0000","last_fullsized":"2024-09-17T01:47:37.152275+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:30.347852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.13","version":"199'2","reported_seq":17,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001367+0000","last_change":"2024-09-17T01:47:34.999727+0000","last_active":"2024-09-17T01:47:37.001367+0000","last_peered":"2024-09-17T01:47:37.001367+0000","last_clean":"2024-09-17T01:47:37.001367+0000","last_became_active":"2024-09-17T01:47:34.999370+0000","last_became_peered":"2024-09-17T01:47:34.999370+0000","last_unstale":"2024-09-17T01:47:37.001367+0000","last_undegraded":"2024-09-17T01:47:37.001367+0000","last_fullsized":"2024-09-17T01:47:37.001367+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:05.459525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152957+0000","last_change":"2024-09-17T01:47:36.004620+0000","last_active":"2024-09-17T01:47:37.152957+0000","last_peered":"2024-09-17T01:47:37.152957+0000","last_clean":"2024-09-17T01:47:37.152957+0000","last_became_active":"2024-09-17T01:47:36.003931+0000","last_became_peered":"2024-09-17T01:47:36.003931+0000","last_unstale":"2024-09-17T01:47:37.152957+0000","last_undegraded":"2024-09-17T01:47:37.152957+0000","last_fullsized":"2024-09-17T01:47:37.152957+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:39.038834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151998+0000","last_change":"2024-09-17T01:47:35.011640+0000","last_active":"2024-09-17T01:47:37.151998+0000","last_peered":"2024-09-17T01:47:37.151998+0000","last_clean":"2024-09-17T01:47:37.151998+0000","last_became_active":"2024-09-17T01:47:35.011312+0000","last_became_peered":"2024-09-17T01:47:35.011312+0000","last_unstale":"2024-09-17T01:47:37.151998+0000","last_undegraded":"2024-09-17T01:47:37.151998+0000","last_fullsized":"2024-09-17T01:47:37.151998+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:38:17.045996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151528+0000","last_change":"2024-09-17T01:47:36.027515+0000","last_active":"2024-09-17T01:47:37.151528+0000","last_peered":"2024-09-17T01:47:37.151528+0000","last_clean":"2024-09-17T01:47:37.151528+0000","last_became_active":"2024-09-17T01:47:36.027048+0000","last_became_peered":"2024-09-17T01:47:36.027048+0000","last_unstale":"2024-09-17T01:47:37.151528+0000","last_undegraded":"2024-09-17T01:47:37.151528+0000","last_fullsized":"2024-09-17T01:47:37.151528+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:04.802097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151512+0000","last_change":"2024-09-17T01:47:35.006578+0000","last_active":"2024-09-17T01:47:37.151512+0000","last_peered":"2024-09-17T01:47:37.151512+0000","last_clean":"2024-09-17T01:47:37.151512+0000","last_became_active":"2024-09-17T01:47:35.006232+0000","last_became_peered":"2024-09-17T01:47:35.006232+0000","last_unstale":"2024-09-17T01:47:37.151512+0000","last_undegraded":"2024-09-17T01:47:37.151512+0000","last_fullsized":"2024-09-17T01:47:37.151512+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:19.847162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151531+0000","last_change":"2024-09-17T01:47:36.013600+0000","last_active":"2024-09-17T01:47:37.151531+0000","last_peered":"2024-09-17T01:47:37.151531+0000","last_clean":"2024-09-17T01:47:37.151531+0000","last_became_active":"2024-09-17T01:47:36.013214+0000","last_became_peered":"2024-09-17T01:47:36.013214+0000","last_unstale":"2024-09-17T01:47:37.151531+0000","last_undegraded":"2024-09-17T01:47:37.151531+0000","last_fullsized":"2024-09-17T01:47:37.151531+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:06.466009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.10","version":"199'8","reported_seq":23,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151512+0000","last_change":"2024-09-17T01:47:35.011656+0000","last_active":"2024-09-17T01:47:37.151512+0000","last_peered":"2024-09-17T01:47:37.151512+0000","last_clean":"2024-09-17T01:47:37.151512+0000","last_became_active":"2024-09-17T01:47:35.011339+0000","last_became_peered":"2024-09-17T01:47:35.011339+0000","last_unstale":"2024-09-17T01:47:37.151512+0000","last_undegraded":"2024-09-17T01:47:37.151512+0000","last_fullsized":"2024-09-17T01:47:37.151512+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:20.775303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001607+0000","last_change":"2024-09-17T01:47:36.010515+0000","last_active":"2024-09-17T01:47:37.001607+0000","last_peered":"2024-09-17T01:47:37.001607+0000","last_clean":"2024-09-17T01:47:37.001607+0000","last_became_active":"2024-09-17T01:47:36.006346+0000","last_became_peered":"2024-09-17T01:47:36.006346+0000","last_unstale":"2024-09-17T01:47:37.001607+0000","last_undegraded":"2024-09-17T01:47:37.001607+0000","last_fullsized":"2024-09-17T01:47:37.001607+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:14:33.651917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"199'1","reported_seq":16,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000831+0000","last_change":"2024-09-17T01:47:35.005515+0000","last_active":"2024-09-17T01:47:37.000831+0000","last_peered":"2024-09-17T01:47:37.000831+0000","last_clean":"2024-09-17T01:47:37.000831+0000","last_became_active":"2024-09-17T01:47:35.005193+0000","last_became_peered":"2024-09-17T01:47:35.005193+0000","last_unstale":"2024-09-17T01:47:37.000831+0000","last_undegraded":"2024-09-17T01:47:37.000831+0000","last_fullsized":"2024-09-17T01:47:37.000831+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:39.205972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027228+0000","last_change":"2024-09-17T01:47:36.035887+0000","last_active":"2024-09-17T01:47:37.027228+0000","last_peered":"2024-09-17T01:47:37.027228+0000","last_clean":"2024-09-17T01:47:37.027228+0000","last_became_active":"2024-09-17T01:47:36.034244+0000","last_became_peered":"2024-09-17T01:47:36.034244+0000","last_unstale":"2024-09-17T01:47:37.027228+0000","last_undegraded":"2024-09-17T01:47:37.027228+0000","last_fullsized":"2024-09-17T01:47:37.027228+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:55.140647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.e","version":"199'2","reported_seq":17,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027301+0000","last_change":"2024-09-17T01:47:35.007881+0000","last_active":"2024-09-17T01:47:37.027301+0000","last_peered":"2024-09-17T01:47:37.027301+0000","last_clean":"2024-09-17T01:47:37.027301+0000","last_became_active":"2024-09-17T01:47:35.006640+0000","last_became_peered":"2024-09-17T01:47:35.006640+0000","last_unstale":"2024-09-17T01:47:37.027301+0000","last_undegraded":"2024-09-17T01:47:37.027301+0000","last_fullsized":"2024-09-17T01:47:37.027301+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:06.636568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152210+0000","last_change":"2024-09-17T01:47:36.020929+0000","last_active":"2024-09-17T01:47:37.152210+0000","last_peered":"2024-09-17T01:47:37.152210+0000","last_clean":"2024-09-17T01:47:37.152210+0000","last_became_active":"2024-09-17T01:47:36.020478+0000","last_became_peered":"2024-09-17T01:47:36.020478+0000","last_unstale":"2024-09-17T01:47:37.152210+0000","last_undegraded":"2024-09-17T01:47:37.152210+0000","last_fullsized":"2024-09-17T01:47:37.152210+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:06.022490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.d","version":"199'1","reported_seq":16,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000098+0000","last_change":"2024-09-17T01:47:35.008871+0000","last_active":"2024-09-17T01:47:37.000098+0000","last_peered":"2024-09-17T01:47:37.000098+0000","last_clean":"2024-09-17T01:47:37.000098+0000","last_became_active":"2024-09-17T01:47:35.008185+0000","last_became_peered":"2024-09-17T01:47:35.008185+0000","last_unstale":"2024-09-17T01:47:37.000098+0000","last_undegraded":"2024-09-17T01:47:37.000098+0000","last_fullsized":"2024-09-17T01:47:37.000098+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:40.712175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152081+0000","last_change":"2024-09-17T01:47:36.015300+0000","last_active":"2024-09-17T01:47:37.152081+0000","last_peered":"2024-09-17T01:47:37.152081+0000","last_clean":"2024-09-17T01:47:37.152081+0000","last_became_active":"2024-09-17T01:47:36.014660+0000","last_became_peered":"2024-09-17T01:47:36.014660+0000","last_unstale":"2024-09-17T01:47:37.152081+0000","last_undegraded":"2024-09-17T01:47:37.152081+0000","last_fullsized":"2024-09-17T01:47:37.152081+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:46.748101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001431+0000","last_change":"2024-09-17T01:47:34.993962+0000","last_active":"2024-09-17T01:47:37.001431+0000","last_peered":"2024-09-17T01:47:37.001431+0000","last_clean":"2024-09-17T01:47:37.001431+0000","last_became_active":"2024-09-17T01:47:34.992169+0000","last_became_peered":"2024-09-17T01:47:34.992169+0000","last_unstale":"2024-09-17T01:47:37.001431+0000","last_undegraded":"2024-09-17T01:47:37.001431+0000","last_fullsized":"2024-09-17T01:47:37.001431+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:12.898352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027186+0000","last_change":"2024-09-17T01:47:36.013751+0000","last_active":"2024-09-17T01:47:37.027186+0000","last_peered":"2024-09-17T01:47:37.027186+0000","last_clean":"2024-09-17T01:47:37.027186+0000","last_became_active":"2024-09-17T01:47:36.012914+0000","last_became_peered":"2024-09-17T01:47:36.012914+0000","last_unstale":"2024-09-17T01:47:37.027186+0000","last_undegraded":"2024-09-17T01:47:37.027186+0000","last_fullsized":"2024-09-17T01:47:37.027186+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:18.276994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.b","version":"199'2","reported_seq":17,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999801+0000","last_change":"2024-09-17T01:47:35.011932+0000","last_active":"2024-09-17T01:47:36.999801+0000","last_peered":"2024-09-17T01:47:36.999801+0000","last_clean":"2024-09-17T01:47:36.999801+0000","last_became_active":"2024-09-17T01:47:35.011558+0000","last_became_peered":"2024-09-17T01:47:35.011558+0000","last_unstale":"2024-09-17T01:47:36.999801+0000","last_undegraded":"2024-09-17T01:47:36.999801+0000","last_fullsized":"2024-09-17T01:47:36.999801+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:12.724138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151934+0000","last_change":"2024-09-17T01:47:36.028346+0000","last_active":"2024-09-17T01:47:37.151934+0000","last_peered":"2024-09-17T01:47:37.151934+0000","last_clean":"2024-09-17T01:47:37.151934+0000","last_became_active":"2024-09-17T01:47:36.027814+0000","last_became_peered":"2024-09-17T01:47:36.027814+0000","last_unstale":"2024-09-17T01:47:37.151934+0000","last_undegraded":"2024-09-17T01:47:37.151934+0000","last_fullsized":"2024-09-17T01:47:37.151934+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:28.673161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152818+0000","last_change":"2024-09-17T01:47:34.994104+0000","last_active":"2024-09-17T01:47:37.152818+0000","last_peered":"2024-09-17T01:47:37.152818+0000","last_clean":"2024-09-17T01:47:37.152818+0000","last_became_active":"2024-09-17T01:47:34.993125+0000","last_became_peered":"2024-09-17T01:47:34.993125+0000","last_unstale":"2024-09-17T01:47:37.152818+0000","last_undegraded":"2024-09-17T01:47:37.152818+0000","last_fullsized":"2024-09-17T01:47:37.152818+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:38.505908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000251+0000","last_change":"2024-09-17T01:47:36.014232+0000","last_active":"2024-09-17T01:47:37.000251+0000","last_peered":"2024-09-17T01:47:37.000251+0000","last_clean":"2024-09-17T01:47:37.000251+0000","last_became_active":"2024-09-17T01:47:36.011929+0000","last_became_peered":"2024-09-17T01:47:36.011929+0000","last_unstale":"2024-09-17T01:47:37.000251+0000","last_undegraded":"2024-09-17T01:47:37.000251+0000","last_fullsized":"2024-09-17T01:47:37.000251+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:09.266220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151181+0000","last_change":"2024-09-17T01:47:35.011539+0000","last_active":"2024-09-17T01:47:37.151181+0000","last_peered":"2024-09-17T01:47:37.151181+0000","last_clean":"2024-09-17T01:47:37.151181+0000","last_became_active":"2024-09-17T01:47:35.011146+0000","last_became_peered":"2024-09-17T01:47:35.011146+0000","last_unstale":"2024-09-17T01:47:37.151181+0000","last_undegraded":"2024-09-17T01:47:37.151181+0000","last_fullsized":"2024-09-17T01:47:37.151181+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:36.250930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001015+0000","last_change":"2024-09-17T01:47:36.013423+0000","last_active":"2024-09-17T01:47:37.001015+0000","last_peered":"2024-09-17T01:47:37.001015+0000","last_clean":"2024-09-17T01:47:37.001015+0000","last_became_active":"2024-09-17T01:47:36.013122+0000","last_became_peered":"2024-09-17T01:47:36.013122+0000","last_unstale":"2024-09-17T01:47:37.001015+0000","last_undegraded":"2024-09-17T01:47:37.001015+0000","last_fullsized":"2024-09-17T01:47:37.001015+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:16.636984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151636+0000","last_change":"2024-09-17T01:47:35.010985+0000","last_active":"2024-09-17T01:47:37.151636+0000","last_peered":"2024-09-17T01:47:37.151636+0000","last_clean":"2024-09-17T01:47:37.151636+0000","last_became_active":"2024-09-17T01:47:35.010635+0000","last_became_peered":"2024-09-17T01:47:35.010635+0000","last_unstale":"2024-09-17T01:47:37.151636+0000","last_undegraded":"2024-09-17T01:47:37.151636+0000","last_fullsized":"2024-09-17T01:47:37.151636+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:47.121633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027113+0000","last_change":"2024-09-17T01:47:36.022826+0000","last_active":"2024-09-17T01:47:37.027113+0000","last_peered":"2024-09-17T01:47:37.027113+0000","last_clean":"2024-09-17T01:47:37.027113+0000","last_became_active":"2024-09-17T01:47:36.022162+0000","last_became_peered":"2024-09-17T01:47:36.022162+0000","last_unstale":"2024-09-17T01:47:37.027113+0000","last_undegraded":"2024-09-17T01:47:37.027113+0000","last_fullsized":"2024-09-17T01:47:37.027113+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:40.708195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"199'2","reported_seq":17,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.026987+0000","last_change":"2024-09-17T01:47:35.008037+0000","last_active":"2024-09-17T01:47:37.026987+0000","last_peered":"2024-09-17T01:47:37.026987+0000","last_clean":"2024-09-17T01:47:37.026987+0000","last_became_active":"2024-09-17T01:47:35.007539+0000","last_became_peered":"2024-09-17T01:47:35.007539+0000","last_unstale":"2024-09-17T01:47:37.026987+0000","last_undegraded":"2024-09-17T01:47:37.026987+0000","last_fullsized":"2024-09-17T01:47:37.026987+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:02.783632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000634+0000","last_change":"2024-09-17T01:47:36.018759+0000","last_active":"2024-09-17T01:47:37.000634+0000","last_peered":"2024-09-17T01:47:37.000634+0000","last_clean":"2024-09-17T01:47:37.000634+0000","last_became_active":"2024-09-17T01:47:36.018449+0000","last_became_peered":"2024-09-17T01:47:36.018449+0000","last_unstale":"2024-09-17T01:47:37.000634+0000","last_undegraded":"2024-09-17T01:47:37.000634+0000","last_fullsized":"2024-09-17T01:47:37.000634+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:10.509746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.6","version":"200'1","reported_seq":16,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000467+0000","last_change":"2024-09-17T01:47:35.008019+0000","last_active":"2024-09-17T01:47:37.000467+0000","last_peered":"2024-09-17T01:47:37.000467+0000","last_clean":"2024-09-17T01:47:37.000467+0000","last_became_active":"2024-09-17T01:47:35.007699+0000","last_became_peered":"2024-09-17T01:47:35.007699+0000","last_unstale":"2024-09-17T01:47:37.000467+0000","last_undegraded":"2024-09-17T01:47:37.000467+0000","last_fullsized":"2024-09-17T01:47:37.000467+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:46.547217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000058+0000","last_change":"2024-09-17T01:47:36.016021+0000","last_active":"2024-09-17T01:47:37.000058+0000","last_peered":"2024-09-17T01:47:37.000058+0000","last_clean":"2024-09-17T01:47:37.000058+0000","last_became_active":"2024-09-17T01:47:36.015717+0000","last_became_peered":"2024-09-17T01:47:36.015717+0000","last_unstale":"2024-09-17T01:47:37.000058+0000","last_undegraded":"2024-09-17T01:47:37.000058+0000","last_fullsized":"2024-09-17T01:47:37.000058+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:04.802097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152350+0000","last_change":"2024-09-17T01:47:35.000829+0000","last_active":"2024-09-17T01:47:37.152350+0000","last_peered":"2024-09-17T01:47:37.152350+0000","last_clean":"2024-09-17T01:47:37.152350+0000","last_became_active":"2024-09-17T01:47:35.000499+0000","last_became_peered":"2024-09-17T01:47:35.000499+0000","last_unstale":"2024-09-17T01:47:37.152350+0000","last_undegraded":"2024-09-17T01:47:37.152350+0000","last_fullsized":"2024-09-17T01:47:37.152350+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:07.688589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001169+0000","last_change":"2024-09-17T01:47:36.018476+0000","last_active":"2024-09-17T01:47:37.001169+0000","last_peered":"2024-09-17T01:47:37.001169+0000","last_clean":"2024-09-17T01:47:37.001169+0000","last_became_active":"2024-09-17T01:47:36.017796+0000","last_became_peered":"2024-09-17T01:47:36.017796+0000","last_unstale":"2024-09-17T01:47:37.001169+0000","last_undegraded":"2024-09-17T01:47:37.001169+0000","last_fullsized":"2024-09-17T01:47:37.001169+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:51:17.387170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152121+0000","last_change":"2024-09-17T01:47:35.013150+0000","last_active":"2024-09-17T01:47:37.152121+0000","last_peered":"2024-09-17T01:47:37.152121+0000","last_clean":"2024-09-17T01:47:37.152121+0000","last_became_active":"2024-09-17T01:47:35.012633+0000","last_became_peered":"2024-09-17T01:47:35.012633+0000","last_unstale":"2024-09-17T01:47:37.152121+0000","last_undegraded":"2024-09-17T01:47:37.152121+0000","last_fullsized":"2024-09-17T01:47:37.152121+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:13:45.772845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999735+0000","last_change":"2024-09-17T01:47:36.020528+0000","last_active":"2024-09-17T01:47:36.999735+0000","last_peered":"2024-09-17T01:47:36.999735+0000","last_clean":"2024-09-17T01:47:36.999735+0000","last_became_active":"2024-09-17T01:47:36.020204+0000","last_became_peered":"2024-09-17T01:47:36.020204+0000","last_unstale":"2024-09-17T01:47:36.999735+0000","last_undegraded":"2024-09-17T01:47:36.999735+0000","last_fullsized":"2024-09-17T01:47:36.999735+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:53.498055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152366+0000","last_change":"2024-09-17T01:47:35.013573+0000","last_active":"2024-09-17T01:47:37.152366+0000","last_peered":"2024-09-17T01:47:37.152366+0000","last_clean":"2024-09-17T01:47:37.152366+0000","last_became_active":"2024-09-17T01:47:35.012649+0000","last_became_peered":"2024-09-17T01:47:35.012649+0000","last_unstale":"2024-09-17T01:47:37.152366+0000","last_undegraded":"2024-09-17T01:47:37.152366+0000","last_fullsized":"2024-09-17T01:47:37.152366+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:30.689211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999714+0000","last_change":"2024-09-17T01:47:36.027127+0000","last_active":"2024-09-17T01:47:36.999714+0000","last_peered":"2024-09-17T01:47:36.999714+0000","last_clean":"2024-09-17T01:47:36.999714+0000","last_became_active":"2024-09-17T01:47:36.026829+0000","last_became_peered":"2024-09-17T01:47:36.026829+0000","last_unstale":"2024-09-17T01:47:36.999714+0000","last_undegraded":"2024-09-17T01:47:36.999714+0000","last_fullsized":"2024-09-17T01:47:36.999714+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:49.510484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152209+0000","last_change":"2024-09-17T01:47:35.004537+0000","last_active":"2024-09-17T01:47:37.152209+0000","last_peered":"2024-09-17T01:47:37.152209+0000","last_clean":"2024-09-17T01:47:37.152209+0000","last_became_active":"2024-09-17T01:47:35.003997+0000","last_became_peered":"2024-09-17T01:47:35.003997+0000","last_unstale":"2024-09-17T01:47:37.152209+0000","last_undegraded":"2024-09-17T01:47:37.152209+0000","last_fullsized":"2024-09-17T01:47:37.152209+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:09.740206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151577+0000","last_change":"2024-09-17T01:47:36.034733+0000","last_active":"2024-09-17T01:47:37.151577+0000","last_peered":"2024-09-17T01:47:37.151577+0000","last_clean":"2024-09-17T01:47:37.151577+0000","last_became_active":"2024-09-17T01:47:36.029170+0000","last_became_peered":"2024-09-17T01:47:36.029170+0000","last_unstale":"2024-09-17T01:47:37.151577+0000","last_undegraded":"2024-09-17T01:47:37.151577+0000","last_fullsized":"2024-09-17T01:47:37.151577+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:07.825226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001117+0000","last_change":"2024-09-17T01:47:35.013384+0000","last_active":"2024-09-17T01:47:37.001117+0000","last_peered":"2024-09-17T01:47:37.001117+0000","last_clean":"2024-09-17T01:47:37.001117+0000","last_became_active":"2024-09-17T01:47:35.012957+0000","last_became_peered":"2024-09-17T01:47:35.012957+0000","last_unstale":"2024-09-17T01:47:37.001117+0000","last_undegraded":"2024-09-17T01:47:37.001117+0000","last_fullsized":"2024-09-17T01:47:37.001117+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:20.495786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151071+0000","last_change":"2024-09-17T01:47:36.002457+0000","last_active":"2024-09-17T01:47:37.151071+0000","last_peered":"2024-09-17T01:47:37.151071+0000","last_clean":"2024-09-17T01:47:37.151071+0000","last_became_active":"2024-09-17T01:47:36.001952+0000","last_became_peered":"2024-09-17T01:47:36.001952+0000","last_unstale":"2024-09-17T01:47:37.151071+0000","last_undegraded":"2024-09-17T01:47:37.151071+0000","last_fullsized":"2024-09-17T01:47:37.151071+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:56.911080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999239+0000","last_change":"2024-09-17T01:47:35.007484+0000","last_active":"2024-09-17T01:47:36.999239+0000","last_peered":"2024-09-17T01:47:36.999239+0000","last_clean":"2024-09-17T01:47:36.999239+0000","last_became_active":"2024-09-17T01:47:35.007199+0000","last_became_peered":"2024-09-17T01:47:35.007199+0000","last_unstale":"2024-09-17T01:47:36.999239+0000","last_undegraded":"2024-09-17T01:47:36.999239+0000","last_fullsized":"2024-09-17T01:47:36.999239+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:11.734174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151338+0000","last_change":"2024-09-17T01:47:36.011259+0000","last_active":"2024-09-17T01:47:37.151338+0000","last_peered":"2024-09-17T01:47:37.151338+0000","last_clean":"2024-09-17T01:47:37.151338+0000","last_became_active":"2024-09-17T01:47:36.010945+0000","last_became_peered":"2024-09-17T01:47:36.010945+0000","last_unstale":"2024-09-17T01:47:37.151338+0000","last_undegraded":"2024-09-17T01:47:37.151338+0000","last_fullsized":"2024-09-17T01:47:37.151338+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:53.498055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"199'2","reported_seq":17,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000185+0000","last_change":"2024-09-17T01:47:35.015450+0000","last_active":"2024-09-17T01:47:37.000185+0000","last_peered":"2024-09-17T01:47:37.000185+0000","last_clean":"2024-09-17T01:47:37.000185+0000","last_became_active":"2024-09-17T01:47:35.014969+0000","last_became_peered":"2024-09-17T01:47:35.014969+0000","last_unstale":"2024-09-17T01:47:37.000185+0000","last_undegraded":"2024-09-17T01:47:37.000185+0000","last_fullsized":"2024-09-17T01:47:37.000185+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:20.939219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":452,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999267+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:47:36.999267+0000","last_peered":"2024-09-17T01:47:36.999267+0000","last_clean":"2024-09-17T01:47:36.999267+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:47:36.999267+0000","last_undegraded":"2024-09-17T01:47:36.999267+0000","last_fullsized":"2024-09-17T01:47:36.999267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476929,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47536,"kb_used_data":2460,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324304,"statfs":{"total":96636764160,"available":96588087296,"internally_reserved":0,"allocated":2519040,"data_stored":1113104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509632,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55860,"kb_used_data":2464,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315980,"statfs":{"total":96636764160,"available":96579563520,"internally_reserved":0,"allocated":2523136,"data_stored":1113742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509631,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47548,"kb_used_data":2468,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324292,"statfs":{"total":96636764160,"available":96588075008,"internally_reserved":0,"allocated":2527232,"data_stored":1113216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509632,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51704,"kb_used_data":2468,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320136,"statfs":{"total":96636764160,"available":96583819264,"internally_reserved":0,"allocated":2527232,"data_stored":1114682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509632,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69676,"kb_used_data":2456,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302164,"statfs":{"total":96636764160,"available":96565415936,"internally_reserved":0,"allocated":2514944,"data_stored":1113070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509631,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52284,"kb_used_data":3048,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319556,"statfs":{"total":96636764160,"available":96583225344,"internally_reserved":0,"allocated":3121152,"data_stored":1704112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509633,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60012,"kb_used_data":2456,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311828,"statfs":{"total":96636764160,"available":96575311872,"internally_reserved":0,"allocated":2514944,"data_stored":1113070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":58915273},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542337,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52292,"kb_used_data":3052,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319548,"statfs":{"total":96636764160,"available":96583217152,"internally_reserved":0,"allocated":3125248,"data_stored":1705120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:47:45.540 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:47:45.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.781+0000 7fcfdf200640 1 -- 172.21.15.42:0/3828603386 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfc4004000 msgr2=0x7fcfc4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:45.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.781+0000 7fcfdf200640 1 --2- 172.21.15.42:0/3828603386 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfc4004000 0x7fcfc4004800 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00b7850 tx=0x7fcfc4005830 comp rx=0 tx=0).stop 2024-09-17T01:47:45.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.782+0000 7fcfde800640 1 -- 172.21.15.42:0/3828603386 reap_dead start 2024-09-17T01:47:45.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.782+0000 7fcfdf200640 1 -- 172.21.15.42:0/3828603386 shutdown_connections 2024-09-17T01:47:45.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.782+0000 7fcfdf200640 1 -- 172.21.15.42:0/3828603386 >> 172.21.15.42:0/3828603386 conn(0x7fcfe006cf00 msgr2=0x7fcfe006d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:45.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.782+0000 7fcfdf200640 1 -- 172.21.15.42:0/3828603386 shutdown_connections 2024-09-17T01:47:45.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.782+0000 7fcfdf200640 1 -- 172.21.15.42:0/3828603386 wait complete. 2024-09-17T01:47:45.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.784+0000 7fcfdf200640 1 Processor -- start 2024-09-17T01:47:45.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.784+0000 7fcfdf200640 1 -- start start 2024-09-17T01:47:45.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.786+0000 7fcfdf200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfc4004000 0x7fcfe00b6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:45.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.786+0000 7fcfdf200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcfe014a1e0 0x7fcfe00aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:45.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.786+0000 7fcfdf200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfe015b680 0x7fcfe015ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:45.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.786+0000 7fcfdf200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe00b8b10 con 0x7fcfe015b680 2024-09-17T01:47:45.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.786+0000 7fcfdf200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe00b8990 con 0x7fcfc4004000 2024-09-17T01:47:45.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.786+0000 7fcfdf200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fcfe00b8c90 con 0x7fcfe014a1e0 2024-09-17T01:47:45.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.786+0000 7fcfde800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfe015b680 0x7fcfe015ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:45.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.786+0000 7fcfde800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfe015b680 0x7fcfe015ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52426/0 (socket says 172.21.15.42:52426) 2024-09-17T01:47:45.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.786+0000 7fcfde800640 1 -- 172.21.15.42:0/2956497206 learned_addr learned my addr 172.21.15.42:0/2956497206 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:45.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.786+0000 7fcfdde00640 1 --2- 172.21.15.42:0/2956497206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfc4004000 0x7fcfe00b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:45.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.786+0000 7fcfd7e00640 1 --2- 172.21.15.42:0/2956497206 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcfe014a1e0 0x7fcfe00aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:45.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.786+0000 7fcfde800640 1 -- 172.21.15.42:0/2956497206 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcfe014a1e0 msgr2=0x7fcfe00aaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.786+0000 7fcfde800640 1 --2- 172.21.15.42:0/2956497206 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcfe014a1e0 0x7fcfe00aaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.786+0000 7fcfde800640 1 -- 172.21.15.42:0/2956497206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfc4004000 msgr2=0x7fcfe00b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.786+0000 7fcfde800640 1 --2- 172.21.15.42:0/2956497206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfc4004000 0x7fcfe00b6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.786+0000 7fcfde800640 1 -- 172.21.15.42:0/2956497206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe015a5e0 con 0x7fcfe015b680 2024-09-17T01:47:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.787+0000 7fcfde800640 1 --2- 172.21.15.42:0/2956497206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfe015b680 0x7fcfe015ba90 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7fcfe006a8a0 tx=0x7fcfd8006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.787+0000 7fcfd6000640 1 -- 172.21.15.42:0/2956497206 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd800fa80 con 0x7fcfe015b680 2024-09-17T01:47:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.787+0000 7fcfd6000640 1 -- 172.21.15.42:0/2956497206 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfd801a070 con 0x7fcfe015b680 2024-09-17T01:47:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.787+0000 7fcfdf200640 1 -- 172.21.15.42:0/2956497206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfe015a8c0 con 0x7fcfe015b680 2024-09-17T01:47:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.787+0000 7fcfd6000640 1 -- 172.21.15.42:0/2956497206 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8011430 con 0x7fcfe015b680 2024-09-17T01:47:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.787+0000 7fcfdf200640 1 -- 172.21.15.42:0/2956497206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfe015ae80 con 0x7fcfe015b680 2024-09-17T01:47:45.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.788+0000 7fcfdf200640 1 -- 172.21.15.42:0/2956497206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfe015a350 con 0x7fcfe015b680 2024-09-17T01:47:45.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.789+0000 7fcfd6000640 1 -- 172.21.15.42:0/2956497206 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcfd80115d0 con 0x7fcfe015b680 2024-09-17T01:47:45.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.790+0000 7fcfd6000640 1 --2- 172.21.15.42:0/2956497206 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcfbc078b90 0x7fcfbc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:45.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.791+0000 7fcfd6000640 1 -- 172.21.15.42:0/2956497206 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5709+0+0 (secure 0 0 0) 0x7fcfd809b130 con 0x7fcfe015b680 2024-09-17T01:47:45.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.791+0000 7fcfdde00640 1 --2- 172.21.15.42:0/2956497206 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcfbc078b90 0x7fcfbc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:45.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.792+0000 7fcfdde00640 1 --2- 172.21.15.42:0/2956497206 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcfbc078b90 0x7fcfbc07b0a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0009b90 tx=0x7fcfd0005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:45.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.795+0000 7fcfd6000640 1 -- 172.21.15.42:0/2956497206 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcfe00d3360 con 0x7fcfe015b680 2024-09-17T01:47:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.985+0000 7fcfdf200640 1 -- 172.21.15.42:0/2956497206 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcfe00b91f0 con 0x7fcfbc078b90 2024-09-17T01:47:45.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.990+0000 7fcfd6000640 1 -- 172.21.15.42:0/2956497206 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252393 (secure 0 0 0) 0x7fcfe00b91f0 con 0x7fcfbc078b90 2024-09-17T01:47:45.992 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:45.993 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:47:45.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.994+0000 7fcfdf200640 1 -- 172.21.15.42:0/2956497206 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcfbc078b90 msgr2=0x7fcfbc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:45.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.994+0000 7fcfdf200640 1 --2- 172.21.15.42:0/2956497206 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcfbc078b90 0x7fcfbc07b0a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0009b90 tx=0x7fcfd0005f90 comp rx=0 tx=0).stop 2024-09-17T01:47:45.995 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.994+0000 7fcfdf200640 1 -- 172.21.15.42:0/2956497206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfe015b680 msgr2=0x7fcfe015ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:45.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.994+0000 7fcfdf200640 1 --2- 172.21.15.42:0/2956497206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfe015b680 0x7fcfe015ba90 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7fcfe006a8a0 tx=0x7fcfd8006720 comp rx=0 tx=0).stop 2024-09-17T01:47:45.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.994+0000 7fcfdf200640 1 -- 172.21.15.42:0/2956497206 shutdown_connections 2024-09-17T01:47:45.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.994+0000 7fcfdf200640 1 --2- 172.21.15.42:0/2956497206 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcfbc078b90 0x7fcfbc07b0a0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:45.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.994+0000 7fcfdf200640 1 --2- 172.21.15.42:0/2956497206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfe015b680 0x7fcfe015ba90 unknown :-1 s=CLOSED pgs=2294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:45.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.994+0000 7fcfdf200640 1 --2- 172.21.15.42:0/2956497206 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcfe014a1e0 0x7fcfe00aaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:45.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.994+0000 7fcfdf200640 1 --2- 172.21.15.42:0/2956497206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfc4004000 0x7fcfe00b6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:45.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.994+0000 7fcfdf200640 1 -- 172.21.15.42:0/2956497206 >> 172.21.15.42:0/2956497206 conn(0x7fcfe006cf00 msgr2=0x7fcfe00cd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:45.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.994+0000 7fcfdf200640 1 -- 172.21.15.42:0/2956497206 shutdown_connections 2024-09-17T01:47:45.996 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:45.994+0000 7fcfdf200640 1 -- 172.21.15.42:0/2956497206 wait complete. 2024-09-17T01:47:46.016 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":669,"stamp":"2024-09-17T01:47:45.249383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":436912,"kb_used_data":20872,"kb_used_omap":12,"kb_used_meta":415859,"kb_avail":754537808,"statfs":{"total":773094113280,"available":772646715392,"internally_reserved":0,"allocated":21372928,"data_stored":10090116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":425840180},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.252783"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000743+0000","last_change":"2024-09-17T01:47:36.013882+0000","last_active":"2024-09-17T01:47:37.000743+0000","last_peered":"2024-09-17T01:47:37.000743+0000","last_clean":"2024-09-17T01:47:37.000743+0000","last_became_active":"2024-09-17T01:47:36.013578+0000","last_became_peered":"2024-09-17T01:47:36.013578+0000","last_unstale":"2024-09-17T01:47:37.000743+0000","last_undegraded":"2024-09-17T01:47:37.000743+0000","last_fullsized":"2024-09-17T01:47:37.000743+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:36.234339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152688+0000","last_change":"2024-09-17T01:47:36.034685+0000","last_active":"2024-09-17T01:47:37.152688+0000","last_peered":"2024-09-17T01:47:37.152688+0000","last_clean":"2024-09-17T01:47:37.152688+0000","last_became_active":"2024-09-17T01:47:36.030145+0000","last_became_peered":"2024-09-17T01:47:36.030145+0000","last_unstale":"2024-09-17T01:47:37.152688+0000","last_undegraded":"2024-09-17T01:47:37.152688+0000","last_fullsized":"2024-09-17T01:47:37.152688+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:09.577267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152499+0000","last_change":"2024-09-17T01:47:36.019883+0000","last_active":"2024-09-17T01:47:37.152499+0000","last_peered":"2024-09-17T01:47:37.152499+0000","last_clean":"2024-09-17T01:47:37.152499+0000","last_became_active":"2024-09-17T01:47:36.019574+0000","last_became_peered":"2024-09-17T01:47:36.019574+0000","last_unstale":"2024-09-17T01:47:37.152499+0000","last_undegraded":"2024-09-17T01:47:37.152499+0000","last_fullsized":"2024-09-17T01:47:37.152499+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:20.853645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001547+0000","last_change":"2024-09-17T01:47:36.008580+0000","last_active":"2024-09-17T01:47:37.001547+0000","last_peered":"2024-09-17T01:47:37.001547+0000","last_clean":"2024-09-17T01:47:37.001547+0000","last_became_active":"2024-09-17T01:47:36.007880+0000","last_became_peered":"2024-09-17T01:47:36.007880+0000","last_unstale":"2024-09-17T01:47:37.001547+0000","last_undegraded":"2024-09-17T01:47:37.001547+0000","last_fullsized":"2024-09-17T01:47:37.001547+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:39.331109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000392+0000","last_change":"2024-09-17T01:47:36.018758+0000","last_active":"2024-09-17T01:47:37.000392+0000","last_peered":"2024-09-17T01:47:37.000392+0000","last_clean":"2024-09-17T01:47:37.000392+0000","last_became_active":"2024-09-17T01:47:36.018420+0000","last_became_peered":"2024-09-17T01:47:36.018420+0000","last_unstale":"2024-09-17T01:47:37.000392+0000","last_undegraded":"2024-09-17T01:47:37.000392+0000","last_fullsized":"2024-09-17T01:47:37.000392+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:23.469329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151844+0000","last_change":"2024-09-17T01:47:36.029635+0000","last_active":"2024-09-17T01:47:37.151844+0000","last_peered":"2024-09-17T01:47:37.151844+0000","last_clean":"2024-09-17T01:47:37.151844+0000","last_became_active":"2024-09-17T01:47:36.028833+0000","last_became_peered":"2024-09-17T01:47:36.028833+0000","last_unstale":"2024-09-17T01:47:37.151844+0000","last_undegraded":"2024-09-17T01:47:37.151844+0000","last_fullsized":"2024-09-17T01:47:37.151844+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:08.153607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151034+0000","last_change":"2024-09-17T01:47:36.015851+0000","last_active":"2024-09-17T01:47:37.151034+0000","last_peered":"2024-09-17T01:47:37.151034+0000","last_clean":"2024-09-17T01:47:37.151034+0000","last_became_active":"2024-09-17T01:47:36.015545+0000","last_became_peered":"2024-09-17T01:47:36.015545+0000","last_unstale":"2024-09-17T01:47:37.151034+0000","last_undegraded":"2024-09-17T01:47:37.151034+0000","last_fullsized":"2024-09-17T01:47:37.151034+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:22.526093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001282+0000","last_change":"2024-09-17T01:47:36.014686+0000","last_active":"2024-09-17T01:47:37.001282+0000","last_peered":"2024-09-17T01:47:37.001282+0000","last_clean":"2024-09-17T01:47:37.001282+0000","last_became_active":"2024-09-17T01:47:36.012351+0000","last_became_peered":"2024-09-17T01:47:36.012351+0000","last_unstale":"2024-09-17T01:47:37.001282+0000","last_undegraded":"2024-09-17T01:47:37.001282+0000","last_fullsized":"2024-09-17T01:47:37.001282+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:22:12.658086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151530+0000","last_change":"2024-09-17T01:47:36.028094+0000","last_active":"2024-09-17T01:47:37.151530+0000","last_peered":"2024-09-17T01:47:37.151530+0000","last_clean":"2024-09-17T01:47:37.151530+0000","last_became_active":"2024-09-17T01:47:36.027777+0000","last_became_peered":"2024-09-17T01:47:36.027777+0000","last_unstale":"2024-09-17T01:47:37.151530+0000","last_undegraded":"2024-09-17T01:47:37.151530+0000","last_fullsized":"2024-09-17T01:47:37.151530+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:17:00.239100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001305+0000","last_change":"2024-09-17T01:47:36.018027+0000","last_active":"2024-09-17T01:47:37.001305+0000","last_peered":"2024-09-17T01:47:37.001305+0000","last_clean":"2024-09-17T01:47:37.001305+0000","last_became_active":"2024-09-17T01:47:36.017347+0000","last_became_peered":"2024-09-17T01:47:36.017347+0000","last_unstale":"2024-09-17T01:47:37.001305+0000","last_undegraded":"2024-09-17T01:47:37.001305+0000","last_fullsized":"2024-09-17T01:47:37.001305+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:09.444067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152742+0000","last_change":"2024-09-17T01:47:36.034343+0000","last_active":"2024-09-17T01:47:37.152742+0000","last_peered":"2024-09-17T01:47:37.152742+0000","last_clean":"2024-09-17T01:47:37.152742+0000","last_became_active":"2024-09-17T01:47:36.026493+0000","last_became_peered":"2024-09-17T01:47:36.026493+0000","last_unstale":"2024-09-17T01:47:37.152742+0000","last_undegraded":"2024-09-17T01:47:37.152742+0000","last_fullsized":"2024-09-17T01:47:37.152742+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:36:00.861850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.153324+0000","last_change":"2024-09-17T01:47:36.017169+0000","last_active":"2024-09-17T01:47:37.153324+0000","last_peered":"2024-09-17T01:47:37.153324+0000","last_clean":"2024-09-17T01:47:37.153324+0000","last_became_active":"2024-09-17T01:47:36.016869+0000","last_became_peered":"2024-09-17T01:47:36.016869+0000","last_unstale":"2024-09-17T01:47:37.153324+0000","last_undegraded":"2024-09-17T01:47:37.153324+0000","last_fullsized":"2024-09-17T01:47:37.153324+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:09.444067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999712+0000","last_change":"2024-09-17T01:47:36.013822+0000","last_active":"2024-09-17T01:47:36.999712+0000","last_peered":"2024-09-17T01:47:36.999712+0000","last_clean":"2024-09-17T01:47:36.999712+0000","last_became_active":"2024-09-17T01:47:36.013426+0000","last_became_peered":"2024-09-17T01:47:36.013426+0000","last_unstale":"2024-09-17T01:47:36.999712+0000","last_undegraded":"2024-09-17T01:47:36.999712+0000","last_fullsized":"2024-09-17T01:47:36.999712+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:56.911080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151673+0000","last_change":"2024-09-17T01:47:36.014797+0000","last_active":"2024-09-17T01:47:37.151673+0000","last_peered":"2024-09-17T01:47:37.151673+0000","last_clean":"2024-09-17T01:47:37.151673+0000","last_became_active":"2024-09-17T01:47:36.014494+0000","last_became_peered":"2024-09-17T01:47:36.014494+0000","last_unstale":"2024-09-17T01:47:37.151673+0000","last_undegraded":"2024-09-17T01:47:37.151673+0000","last_fullsized":"2024-09-17T01:47:37.151673+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:47:34.470006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151691+0000","last_change":"2024-09-17T01:47:36.020290+0000","last_active":"2024-09-17T01:47:37.151691+0000","last_peered":"2024-09-17T01:47:37.151691+0000","last_clean":"2024-09-17T01:47:37.151691+0000","last_became_active":"2024-09-17T01:47:36.019511+0000","last_became_peered":"2024-09-17T01:47:36.019511+0000","last_unstale":"2024-09-17T01:47:37.151691+0000","last_undegraded":"2024-09-17T01:47:37.151691+0000","last_fullsized":"2024-09-17T01:47:37.151691+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:41.467333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151267+0000","last_change":"2024-09-17T01:47:36.023298+0000","last_active":"2024-09-17T01:47:37.151267+0000","last_peered":"2024-09-17T01:47:37.151267+0000","last_clean":"2024-09-17T01:47:37.151267+0000","last_became_active":"2024-09-17T01:47:36.022864+0000","last_became_peered":"2024-09-17T01:47:36.022864+0000","last_unstale":"2024-09-17T01:47:37.151267+0000","last_undegraded":"2024-09-17T01:47:37.151267+0000","last_fullsized":"2024-09-17T01:47:37.151267+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:36.823475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000776+0000","last_change":"2024-09-17T01:47:36.013172+0000","last_active":"2024-09-17T01:47:37.000776+0000","last_peered":"2024-09-17T01:47:37.000776+0000","last_clean":"2024-09-17T01:47:37.000776+0000","last_became_active":"2024-09-17T01:47:36.012831+0000","last_became_peered":"2024-09-17T01:47:36.012831+0000","last_unstale":"2024-09-17T01:47:37.000776+0000","last_undegraded":"2024-09-17T01:47:37.000776+0000","last_fullsized":"2024-09-17T01:47:37.000776+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:28.673161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027218+0000","last_change":"2024-09-17T01:47:36.027786+0000","last_active":"2024-09-17T01:47:37.027218+0000","last_peered":"2024-09-17T01:47:37.027218+0000","last_clean":"2024-09-17T01:47:37.027218+0000","last_became_active":"2024-09-17T01:47:36.027311+0000","last_became_peered":"2024-09-17T01:47:36.027311+0000","last_unstale":"2024-09-17T01:47:37.027218+0000","last_undegraded":"2024-09-17T01:47:37.027218+0000","last_fullsized":"2024-09-17T01:47:37.027218+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:41.527675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152142+0000","last_change":"2024-09-17T01:47:36.021267+0000","last_active":"2024-09-17T01:47:37.152142+0000","last_peered":"2024-09-17T01:47:37.152142+0000","last_clean":"2024-09-17T01:47:37.152142+0000","last_became_active":"2024-09-17T01:47:36.020837+0000","last_became_peered":"2024-09-17T01:47:36.020837+0000","last_unstale":"2024-09-17T01:47:37.152142+0000","last_undegraded":"2024-09-17T01:47:37.152142+0000","last_fullsized":"2024-09-17T01:47:37.152142+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:05.922664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027027+0000","last_change":"2024-09-17T01:47:36.023252+0000","last_active":"2024-09-17T01:47:37.027027+0000","last_peered":"2024-09-17T01:47:37.027027+0000","last_clean":"2024-09-17T01:47:37.027027+0000","last_became_active":"2024-09-17T01:47:36.022317+0000","last_became_peered":"2024-09-17T01:47:36.022317+0000","last_unstale":"2024-09-17T01:47:37.027027+0000","last_undegraded":"2024-09-17T01:47:37.027027+0000","last_fullsized":"2024-09-17T01:47:37.027027+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:15.810411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027246+0000","last_change":"2024-09-17T01:47:36.029064+0000","last_active":"2024-09-17T01:47:37.027246+0000","last_peered":"2024-09-17T01:47:37.027246+0000","last_clean":"2024-09-17T01:47:37.027246+0000","last_became_active":"2024-09-17T01:47:36.028613+0000","last_became_peered":"2024-09-17T01:47:36.028613+0000","last_unstale":"2024-09-17T01:47:37.027246+0000","last_undegraded":"2024-09-17T01:47:37.027246+0000","last_fullsized":"2024-09-17T01:47:37.027246+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:09.498750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151862+0000","last_change":"2024-09-17T01:47:36.030555+0000","last_active":"2024-09-17T01:47:37.151862+0000","last_peered":"2024-09-17T01:47:37.151862+0000","last_clean":"2024-09-17T01:47:37.151862+0000","last_became_active":"2024-09-17T01:47:36.030260+0000","last_became_peered":"2024-09-17T01:47:36.030260+0000","last_unstale":"2024-09-17T01:47:37.151862+0000","last_undegraded":"2024-09-17T01:47:37.151862+0000","last_fullsized":"2024-09-17T01:47:37.151862+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:43.922683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999299+0000","last_change":"2024-09-17T01:47:36.026322+0000","last_active":"2024-09-17T01:47:36.999299+0000","last_peered":"2024-09-17T01:47:36.999299+0000","last_clean":"2024-09-17T01:47:36.999299+0000","last_became_active":"2024-09-17T01:47:36.026011+0000","last_became_peered":"2024-09-17T01:47:36.026011+0000","last_unstale":"2024-09-17T01:47:36.999299+0000","last_undegraded":"2024-09-17T01:47:36.999299+0000","last_fullsized":"2024-09-17T01:47:36.999299+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:34.690718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000626+0000","last_change":"2024-09-17T01:47:36.011441+0000","last_active":"2024-09-17T01:47:37.000626+0000","last_peered":"2024-09-17T01:47:37.000626+0000","last_clean":"2024-09-17T01:47:37.000626+0000","last_became_active":"2024-09-17T01:47:36.008550+0000","last_became_peered":"2024-09-17T01:47:36.008550+0000","last_unstale":"2024-09-17T01:47:37.000626+0000","last_undegraded":"2024-09-17T01:47:37.000626+0000","last_fullsized":"2024-09-17T01:47:37.000626+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:39.038834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152436+0000","last_change":"2024-09-17T01:47:36.034508+0000","last_active":"2024-09-17T01:47:37.152436+0000","last_peered":"2024-09-17T01:47:37.152436+0000","last_clean":"2024-09-17T01:47:37.152436+0000","last_became_active":"2024-09-17T01:47:36.027035+0000","last_became_peered":"2024-09-17T01:47:36.027035+0000","last_unstale":"2024-09-17T01:47:37.152436+0000","last_undegraded":"2024-09-17T01:47:37.152436+0000","last_fullsized":"2024-09-17T01:47:37.152436+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:40.343277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152216+0000","last_change":"2024-09-17T01:47:36.035038+0000","last_active":"2024-09-17T01:47:37.152216+0000","last_peered":"2024-09-17T01:47:37.152216+0000","last_clean":"2024-09-17T01:47:37.152216+0000","last_became_active":"2024-09-17T01:47:36.034208+0000","last_became_peered":"2024-09-17T01:47:36.034208+0000","last_unstale":"2024-09-17T01:47:37.152216+0000","last_undegraded":"2024-09-17T01:47:37.152216+0000","last_fullsized":"2024-09-17T01:47:37.152216+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:21.980207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152627+0000","last_change":"2024-09-17T01:47:36.035010+0000","last_active":"2024-09-17T01:47:37.152627+0000","last_peered":"2024-09-17T01:47:37.152627+0000","last_clean":"2024-09-17T01:47:37.152627+0000","last_became_active":"2024-09-17T01:47:36.026693+0000","last_became_peered":"2024-09-17T01:47:36.026693+0000","last_unstale":"2024-09-17T01:47:37.152627+0000","last_undegraded":"2024-09-17T01:47:37.152627+0000","last_fullsized":"2024-09-17T01:47:37.152627+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:10.746690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000568+0000","last_change":"2024-09-17T01:47:36.015852+0000","last_active":"2024-09-17T01:47:37.000568+0000","last_peered":"2024-09-17T01:47:37.000568+0000","last_clean":"2024-09-17T01:47:37.000568+0000","last_became_active":"2024-09-17T01:47:36.015505+0000","last_became_peered":"2024-09-17T01:47:36.015505+0000","last_unstale":"2024-09-17T01:47:37.000568+0000","last_undegraded":"2024-09-17T01:47:37.000568+0000","last_fullsized":"2024-09-17T01:47:37.000568+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:55.582852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152265+0000","last_change":"2024-09-17T01:47:36.028347+0000","last_active":"2024-09-17T01:47:37.152265+0000","last_peered":"2024-09-17T01:47:37.152265+0000","last_clean":"2024-09-17T01:47:37.152265+0000","last_became_active":"2024-09-17T01:47:36.028038+0000","last_became_peered":"2024-09-17T01:47:36.028038+0000","last_unstale":"2024-09-17T01:47:37.152265+0000","last_undegraded":"2024-09-17T01:47:37.152265+0000","last_fullsized":"2024-09-17T01:47:37.152265+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:03.911616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.153010+0000","last_change":"2024-09-17T01:47:36.019539+0000","last_active":"2024-09-17T01:47:37.153010+0000","last_peered":"2024-09-17T01:47:37.153010+0000","last_clean":"2024-09-17T01:47:37.153010+0000","last_became_active":"2024-09-17T01:47:36.018394+0000","last_became_peered":"2024-09-17T01:47:36.018394+0000","last_unstale":"2024-09-17T01:47:37.153010+0000","last_undegraded":"2024-09-17T01:47:37.153010+0000","last_fullsized":"2024-09-17T01:47:37.153010+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:51:17.387170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.026945+0000","last_change":"2024-09-17T01:47:36.023965+0000","last_active":"2024-09-17T01:47:37.026945+0000","last_peered":"2024-09-17T01:47:37.026945+0000","last_clean":"2024-09-17T01:47:37.026945+0000","last_became_active":"2024-09-17T01:47:36.023148+0000","last_became_peered":"2024-09-17T01:47:36.023148+0000","last_unstale":"2024-09-17T01:47:37.026945+0000","last_undegraded":"2024-09-17T01:47:37.026945+0000","last_fullsized":"2024-09-17T01:47:37.026945+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:50.320950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000620+0000","last_change":"2024-09-17T01:47:36.017887+0000","last_active":"2024-09-17T01:47:37.000620+0000","last_peered":"2024-09-17T01:47:37.000620+0000","last_clean":"2024-09-17T01:47:37.000620+0000","last_became_active":"2024-09-17T01:47:36.015123+0000","last_became_peered":"2024-09-17T01:47:36.015123+0000","last_unstale":"2024-09-17T01:47:37.000620+0000","last_undegraded":"2024-09-17T01:47:37.000620+0000","last_fullsized":"2024-09-17T01:47:37.000620+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:10.073566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152939+0000","last_change":"2024-09-17T01:47:36.017272+0000","last_active":"2024-09-17T01:47:37.152939+0000","last_peered":"2024-09-17T01:47:37.152939+0000","last_clean":"2024-09-17T01:47:37.152939+0000","last_became_active":"2024-09-17T01:47:36.016956+0000","last_became_peered":"2024-09-17T01:47:36.016956+0000","last_unstale":"2024-09-17T01:47:37.152939+0000","last_undegraded":"2024-09-17T01:47:37.152939+0000","last_fullsized":"2024-09-17T01:47:37.152939+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:00:39.743352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1f","version":"199'4","reported_seq":19,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152162+0000","last_change":"2024-09-17T01:47:35.005307+0000","last_active":"2024-09-17T01:47:37.152162+0000","last_peered":"2024-09-17T01:47:37.152162+0000","last_clean":"2024-09-17T01:47:37.152162+0000","last_became_active":"2024-09-17T01:47:35.004930+0000","last_became_peered":"2024-09-17T01:47:35.004930+0000","last_unstale":"2024-09-17T01:47:37.152162+0000","last_undegraded":"2024-09-17T01:47:37.152162+0000","last_fullsized":"2024-09-17T01:47:37.152162+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:08.570784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152336+0000","last_change":"2024-09-17T01:47:36.030285+0000","last_active":"2024-09-17T01:47:37.152336+0000","last_peered":"2024-09-17T01:47:37.152336+0000","last_clean":"2024-09-17T01:47:37.152336+0000","last_became_active":"2024-09-17T01:47:36.029689+0000","last_became_peered":"2024-09-17T01:47:36.029689+0000","last_unstale":"2024-09-17T01:47:37.152336+0000","last_undegraded":"2024-09-17T01:47:37.152336+0000","last_fullsized":"2024-09-17T01:47:37.152336+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:26.644307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"199'1","reported_seq":16,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000304+0000","last_change":"2024-09-17T01:47:34.997816+0000","last_active":"2024-09-17T01:47:37.000304+0000","last_peered":"2024-09-17T01:47:37.000304+0000","last_clean":"2024-09-17T01:47:37.000304+0000","last_became_active":"2024-09-17T01:47:34.997504+0000","last_became_peered":"2024-09-17T01:47:34.997504+0000","last_unstale":"2024-09-17T01:47:37.000304+0000","last_undegraded":"2024-09-17T01:47:37.000304+0000","last_fullsized":"2024-09-17T01:47:37.000304+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:50:11.530947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151844+0000","last_change":"2024-09-17T01:47:36.014977+0000","last_active":"2024-09-17T01:47:37.151844+0000","last_peered":"2024-09-17T01:47:37.151844+0000","last_clean":"2024-09-17T01:47:37.151844+0000","last_became_active":"2024-09-17T01:47:36.014207+0000","last_became_peered":"2024-09-17T01:47:36.014207+0000","last_unstale":"2024-09-17T01:47:37.151844+0000","last_undegraded":"2024-09-17T01:47:37.151844+0000","last_fullsized":"2024-09-17T01:47:37.151844+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:36.234339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1c","version":"199'2","reported_seq":17,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.153484+0000","last_change":"2024-09-17T01:47:34.999793+0000","last_active":"2024-09-17T01:47:37.153484+0000","last_peered":"2024-09-17T01:47:37.153484+0000","last_clean":"2024-09-17T01:47:37.153484+0000","last_became_active":"2024-09-17T01:47:34.999466+0000","last_became_peered":"2024-09-17T01:47:34.999466+0000","last_unstale":"2024-09-17T01:47:37.153484+0000","last_undegraded":"2024-09-17T01:47:37.153484+0000","last_fullsized":"2024-09-17T01:47:37.153484+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:45.137637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151879+0000","last_change":"2024-09-17T01:47:36.034879+0000","last_active":"2024-09-17T01:47:37.151879+0000","last_peered":"2024-09-17T01:47:37.151879+0000","last_clean":"2024-09-17T01:47:37.151879+0000","last_became_active":"2024-09-17T01:47:36.029648+0000","last_became_peered":"2024-09-17T01:47:36.029648+0000","last_unstale":"2024-09-17T01:47:37.151879+0000","last_undegraded":"2024-09-17T01:47:37.151879+0000","last_fullsized":"2024-09-17T01:47:37.151879+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:17.902835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1b","version":"199'1","reported_seq":16,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001307+0000","last_change":"2024-09-17T01:47:35.001332+0000","last_active":"2024-09-17T01:47:37.001307+0000","last_peered":"2024-09-17T01:47:37.001307+0000","last_clean":"2024-09-17T01:47:37.001307+0000","last_became_active":"2024-09-17T01:47:35.000978+0000","last_became_peered":"2024-09-17T01:47:35.000978+0000","last_unstale":"2024-09-17T01:47:37.001307+0000","last_undegraded":"2024-09-17T01:47:37.001307+0000","last_fullsized":"2024-09-17T01:47:37.001307+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:25.637823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151804+0000","last_change":"2024-09-17T01:47:36.030160+0000","last_active":"2024-09-17T01:47:37.151804+0000","last_peered":"2024-09-17T01:47:37.151804+0000","last_clean":"2024-09-17T01:47:37.151804+0000","last_became_active":"2024-09-17T01:47:36.029783+0000","last_became_peered":"2024-09-17T01:47:36.029783+0000","last_unstale":"2024-09-17T01:47:37.151804+0000","last_undegraded":"2024-09-17T01:47:37.151804+0000","last_fullsized":"2024-09-17T01:47:37.151804+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:10.717752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1a","version":"199'1","reported_seq":16,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999838+0000","last_change":"2024-09-17T01:47:35.014399+0000","last_active":"2024-09-17T01:47:36.999838+0000","last_peered":"2024-09-17T01:47:36.999838+0000","last_clean":"2024-09-17T01:47:36.999838+0000","last_became_active":"2024-09-17T01:47:35.014095+0000","last_became_peered":"2024-09-17T01:47:35.014095+0000","last_unstale":"2024-09-17T01:47:36.999838+0000","last_undegraded":"2024-09-17T01:47:36.999838+0000","last_fullsized":"2024-09-17T01:47:36.999838+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:51.198589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151622+0000","last_change":"2024-09-17T01:47:36.023755+0000","last_active":"2024-09-17T01:47:37.151622+0000","last_peered":"2024-09-17T01:47:37.151622+0000","last_clean":"2024-09-17T01:47:37.151622+0000","last_became_active":"2024-09-17T01:47:36.023278+0000","last_became_peered":"2024-09-17T01:47:36.023278+0000","last_unstale":"2024-09-17T01:47:37.151622+0000","last_undegraded":"2024-09-17T01:47:37.151622+0000","last_fullsized":"2024-09-17T01:47:37.151622+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:34:08.578343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151251+0000","last_change":"2024-09-17T01:47:34.996555+0000","last_active":"2024-09-17T01:47:37.151251+0000","last_peered":"2024-09-17T01:47:37.151251+0000","last_clean":"2024-09-17T01:47:37.151251+0000","last_became_active":"2024-09-17T01:47:34.996193+0000","last_became_peered":"2024-09-17T01:47:34.996193+0000","last_unstale":"2024-09-17T01:47:37.151251+0000","last_undegraded":"2024-09-17T01:47:37.151251+0000","last_fullsized":"2024-09-17T01:47:37.151251+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:18.012845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999378+0000","last_change":"2024-09-17T01:47:36.025791+0000","last_active":"2024-09-17T01:47:36.999378+0000","last_peered":"2024-09-17T01:47:36.999378+0000","last_clean":"2024-09-17T01:47:36.999378+0000","last_became_active":"2024-09-17T01:47:36.020837+0000","last_became_peered":"2024-09-17T01:47:36.020837+0000","last_unstale":"2024-09-17T01:47:36.999378+0000","last_undegraded":"2024-09-17T01:47:36.999378+0000","last_fullsized":"2024-09-17T01:47:36.999378+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:11.950647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.026608+0000","last_change":"2024-09-17T01:47:34.999663+0000","last_active":"2024-09-17T01:47:37.026608+0000","last_peered":"2024-09-17T01:47:37.026608+0000","last_clean":"2024-09-17T01:47:37.026608+0000","last_became_active":"2024-09-17T01:47:34.999310+0000","last_became_peered":"2024-09-17T01:47:34.999310+0000","last_unstale":"2024-09-17T01:47:37.026608+0000","last_undegraded":"2024-09-17T01:47:37.026608+0000","last_fullsized":"2024-09-17T01:47:37.026608+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:29.080659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.153581+0000","last_change":"2024-09-17T01:47:36.018854+0000","last_active":"2024-09-17T01:47:37.153581+0000","last_peered":"2024-09-17T01:47:37.153581+0000","last_clean":"2024-09-17T01:47:37.153581+0000","last_became_active":"2024-09-17T01:47:36.018537+0000","last_became_peered":"2024-09-17T01:47:36.018537+0000","last_unstale":"2024-09-17T01:47:37.153581+0000","last_undegraded":"2024-09-17T01:47:37.153581+0000","last_fullsized":"2024-09-17T01:47:37.153581+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:37.713412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000829+0000","last_change":"2024-09-17T01:47:35.012451+0000","last_active":"2024-09-17T01:47:37.000829+0000","last_peered":"2024-09-17T01:47:37.000829+0000","last_clean":"2024-09-17T01:47:37.000829+0000","last_became_active":"2024-09-17T01:47:35.012143+0000","last_became_peered":"2024-09-17T01:47:35.012143+0000","last_unstale":"2024-09-17T01:47:37.000829+0000","last_undegraded":"2024-09-17T01:47:37.000829+0000","last_fullsized":"2024-09-17T01:47:37.000829+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:47:29.395131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152584+0000","last_change":"2024-09-17T01:47:36.031889+0000","last_active":"2024-09-17T01:47:37.152584+0000","last_peered":"2024-09-17T01:47:37.152584+0000","last_clean":"2024-09-17T01:47:37.152584+0000","last_became_active":"2024-09-17T01:47:36.026270+0000","last_became_peered":"2024-09-17T01:47:36.026270+0000","last_unstale":"2024-09-17T01:47:37.152584+0000","last_undegraded":"2024-09-17T01:47:37.152584+0000","last_fullsized":"2024-09-17T01:47:37.152584+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:38:18.052479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001555+0000","last_change":"2024-09-17T01:47:35.001060+0000","last_active":"2024-09-17T01:47:37.001555+0000","last_peered":"2024-09-17T01:47:37.001555+0000","last_clean":"2024-09-17T01:47:37.001555+0000","last_became_active":"2024-09-17T01:47:35.000714+0000","last_became_peered":"2024-09-17T01:47:35.000714+0000","last_unstale":"2024-09-17T01:47:37.001555+0000","last_undegraded":"2024-09-17T01:47:37.001555+0000","last_fullsized":"2024-09-17T01:47:37.001555+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:40.476091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.153518+0000","last_change":"2024-09-17T01:47:36.010206+0000","last_active":"2024-09-17T01:47:37.153518+0000","last_peered":"2024-09-17T01:47:37.153518+0000","last_clean":"2024-09-17T01:47:37.153518+0000","last_became_active":"2024-09-17T01:47:36.009887+0000","last_became_peered":"2024-09-17T01:47:36.009887+0000","last_unstale":"2024-09-17T01:47:37.153518+0000","last_undegraded":"2024-09-17T01:47:37.153518+0000","last_fullsized":"2024-09-17T01:47:37.153518+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:14:33.651917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"199'3","reported_seq":18,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000846+0000","last_change":"2024-09-17T01:47:35.000275+0000","last_active":"2024-09-17T01:47:37.000846+0000","last_peered":"2024-09-17T01:47:37.000846+0000","last_clean":"2024-09-17T01:47:37.000846+0000","last_became_active":"2024-09-17T01:47:34.999955+0000","last_became_peered":"2024-09-17T01:47:34.999955+0000","last_unstale":"2024-09-17T01:47:37.000846+0000","last_undegraded":"2024-09-17T01:47:37.000846+0000","last_fullsized":"2024-09-17T01:47:37.000846+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:06.818743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.153399+0000","last_change":"2024-09-17T01:47:36.025624+0000","last_active":"2024-09-17T01:47:37.153399+0000","last_peered":"2024-09-17T01:47:37.153399+0000","last_clean":"2024-09-17T01:47:37.153399+0000","last_became_active":"2024-09-17T01:47:36.018304+0000","last_became_peered":"2024-09-17T01:47:36.018304+0000","last_unstale":"2024-09-17T01:47:37.153399+0000","last_undegraded":"2024-09-17T01:47:37.153399+0000","last_fullsized":"2024-09-17T01:47:37.153399+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:39.331109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.14","version":"199'6","reported_seq":21,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.026977+0000","last_change":"2024-09-17T01:47:35.002429+0000","last_active":"2024-09-17T01:47:37.026977+0000","last_peered":"2024-09-17T01:47:37.026977+0000","last_clean":"2024-09-17T01:47:37.026977+0000","last_became_active":"2024-09-17T01:47:35.002120+0000","last_became_peered":"2024-09-17T01:47:35.002120+0000","last_unstale":"2024-09-17T01:47:37.026977+0000","last_undegraded":"2024-09-17T01:47:37.026977+0000","last_fullsized":"2024-09-17T01:47:37.026977+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:11.320142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152275+0000","last_change":"2024-09-17T01:47:36.020636+0000","last_active":"2024-09-17T01:47:37.152275+0000","last_peered":"2024-09-17T01:47:37.152275+0000","last_clean":"2024-09-17T01:47:37.152275+0000","last_became_active":"2024-09-17T01:47:36.019460+0000","last_became_peered":"2024-09-17T01:47:36.019460+0000","last_unstale":"2024-09-17T01:47:37.152275+0000","last_undegraded":"2024-09-17T01:47:37.152275+0000","last_fullsized":"2024-09-17T01:47:37.152275+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:30.347852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.13","version":"199'2","reported_seq":17,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001367+0000","last_change":"2024-09-17T01:47:34.999727+0000","last_active":"2024-09-17T01:47:37.001367+0000","last_peered":"2024-09-17T01:47:37.001367+0000","last_clean":"2024-09-17T01:47:37.001367+0000","last_became_active":"2024-09-17T01:47:34.999370+0000","last_became_peered":"2024-09-17T01:47:34.999370+0000","last_unstale":"2024-09-17T01:47:37.001367+0000","last_undegraded":"2024-09-17T01:47:37.001367+0000","last_fullsized":"2024-09-17T01:47:37.001367+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:05.459525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152957+0000","last_change":"2024-09-17T01:47:36.004620+0000","last_active":"2024-09-17T01:47:37.152957+0000","last_peered":"2024-09-17T01:47:37.152957+0000","last_clean":"2024-09-17T01:47:37.152957+0000","last_became_active":"2024-09-17T01:47:36.003931+0000","last_became_peered":"2024-09-17T01:47:36.003931+0000","last_unstale":"2024-09-17T01:47:37.152957+0000","last_undegraded":"2024-09-17T01:47:37.152957+0000","last_fullsized":"2024-09-17T01:47:37.152957+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:39.038834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151998+0000","last_change":"2024-09-17T01:47:35.011640+0000","last_active":"2024-09-17T01:47:37.151998+0000","last_peered":"2024-09-17T01:47:37.151998+0000","last_clean":"2024-09-17T01:47:37.151998+0000","last_became_active":"2024-09-17T01:47:35.011312+0000","last_became_peered":"2024-09-17T01:47:35.011312+0000","last_unstale":"2024-09-17T01:47:37.151998+0000","last_undegraded":"2024-09-17T01:47:37.151998+0000","last_fullsized":"2024-09-17T01:47:37.151998+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:38:17.045996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151528+0000","last_change":"2024-09-17T01:47:36.027515+0000","last_active":"2024-09-17T01:47:37.151528+0000","last_peered":"2024-09-17T01:47:37.151528+0000","last_clean":"2024-09-17T01:47:37.151528+0000","last_became_active":"2024-09-17T01:47:36.027048+0000","last_became_peered":"2024-09-17T01:47:36.027048+0000","last_unstale":"2024-09-17T01:47:37.151528+0000","last_undegraded":"2024-09-17T01:47:37.151528+0000","last_fullsized":"2024-09-17T01:47:37.151528+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:04.802097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151512+0000","last_change":"2024-09-17T01:47:35.006578+0000","last_active":"2024-09-17T01:47:37.151512+0000","last_peered":"2024-09-17T01:47:37.151512+0000","last_clean":"2024-09-17T01:47:37.151512+0000","last_became_active":"2024-09-17T01:47:35.006232+0000","last_became_peered":"2024-09-17T01:47:35.006232+0000","last_unstale":"2024-09-17T01:47:37.151512+0000","last_undegraded":"2024-09-17T01:47:37.151512+0000","last_fullsized":"2024-09-17T01:47:37.151512+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:19.847162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151531+0000","last_change":"2024-09-17T01:47:36.013600+0000","last_active":"2024-09-17T01:47:37.151531+0000","last_peered":"2024-09-17T01:47:37.151531+0000","last_clean":"2024-09-17T01:47:37.151531+0000","last_became_active":"2024-09-17T01:47:36.013214+0000","last_became_peered":"2024-09-17T01:47:36.013214+0000","last_unstale":"2024-09-17T01:47:37.151531+0000","last_undegraded":"2024-09-17T01:47:37.151531+0000","last_fullsized":"2024-09-17T01:47:37.151531+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:06.466009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.10","version":"199'8","reported_seq":23,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151512+0000","last_change":"2024-09-17T01:47:35.011656+0000","last_active":"2024-09-17T01:47:37.151512+0000","last_peered":"2024-09-17T01:47:37.151512+0000","last_clean":"2024-09-17T01:47:37.151512+0000","last_became_active":"2024-09-17T01:47:35.011339+0000","last_became_peered":"2024-09-17T01:47:35.011339+0000","last_unstale":"2024-09-17T01:47:37.151512+0000","last_undegraded":"2024-09-17T01:47:37.151512+0000","last_fullsized":"2024-09-17T01:47:37.151512+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:20.775303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001607+0000","last_change":"2024-09-17T01:47:36.010515+0000","last_active":"2024-09-17T01:47:37.001607+0000","last_peered":"2024-09-17T01:47:37.001607+0000","last_clean":"2024-09-17T01:47:37.001607+0000","last_became_active":"2024-09-17T01:47:36.006346+0000","last_became_peered":"2024-09-17T01:47:36.006346+0000","last_unstale":"2024-09-17T01:47:37.001607+0000","last_undegraded":"2024-09-17T01:47:37.001607+0000","last_fullsized":"2024-09-17T01:47:37.001607+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:14:33.651917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"199'1","reported_seq":16,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000831+0000","last_change":"2024-09-17T01:47:35.005515+0000","last_active":"2024-09-17T01:47:37.000831+0000","last_peered":"2024-09-17T01:47:37.000831+0000","last_clean":"2024-09-17T01:47:37.000831+0000","last_became_active":"2024-09-17T01:47:35.005193+0000","last_became_peered":"2024-09-17T01:47:35.005193+0000","last_unstale":"2024-09-17T01:47:37.000831+0000","last_undegraded":"2024-09-17T01:47:37.000831+0000","last_fullsized":"2024-09-17T01:47:37.000831+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:39.205972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027228+0000","last_change":"2024-09-17T01:47:36.035887+0000","last_active":"2024-09-17T01:47:37.027228+0000","last_peered":"2024-09-17T01:47:37.027228+0000","last_clean":"2024-09-17T01:47:37.027228+0000","last_became_active":"2024-09-17T01:47:36.034244+0000","last_became_peered":"2024-09-17T01:47:36.034244+0000","last_unstale":"2024-09-17T01:47:37.027228+0000","last_undegraded":"2024-09-17T01:47:37.027228+0000","last_fullsized":"2024-09-17T01:47:37.027228+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:55.140647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.e","version":"199'2","reported_seq":17,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027301+0000","last_change":"2024-09-17T01:47:35.007881+0000","last_active":"2024-09-17T01:47:37.027301+0000","last_peered":"2024-09-17T01:47:37.027301+0000","last_clean":"2024-09-17T01:47:37.027301+0000","last_became_active":"2024-09-17T01:47:35.006640+0000","last_became_peered":"2024-09-17T01:47:35.006640+0000","last_unstale":"2024-09-17T01:47:37.027301+0000","last_undegraded":"2024-09-17T01:47:37.027301+0000","last_fullsized":"2024-09-17T01:47:37.027301+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:06.636568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152210+0000","last_change":"2024-09-17T01:47:36.020929+0000","last_active":"2024-09-17T01:47:37.152210+0000","last_peered":"2024-09-17T01:47:37.152210+0000","last_clean":"2024-09-17T01:47:37.152210+0000","last_became_active":"2024-09-17T01:47:36.020478+0000","last_became_peered":"2024-09-17T01:47:36.020478+0000","last_unstale":"2024-09-17T01:47:37.152210+0000","last_undegraded":"2024-09-17T01:47:37.152210+0000","last_fullsized":"2024-09-17T01:47:37.152210+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:06.022490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.d","version":"199'1","reported_seq":16,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000098+0000","last_change":"2024-09-17T01:47:35.008871+0000","last_active":"2024-09-17T01:47:37.000098+0000","last_peered":"2024-09-17T01:47:37.000098+0000","last_clean":"2024-09-17T01:47:37.000098+0000","last_became_active":"2024-09-17T01:47:35.008185+0000","last_became_peered":"2024-09-17T01:47:35.008185+0000","last_unstale":"2024-09-17T01:47:37.000098+0000","last_undegraded":"2024-09-17T01:47:37.000098+0000","last_fullsized":"2024-09-17T01:47:37.000098+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:40.712175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152081+0000","last_change":"2024-09-17T01:47:36.015300+0000","last_active":"2024-09-17T01:47:37.152081+0000","last_peered":"2024-09-17T01:47:37.152081+0000","last_clean":"2024-09-17T01:47:37.152081+0000","last_became_active":"2024-09-17T01:47:36.014660+0000","last_became_peered":"2024-09-17T01:47:36.014660+0000","last_unstale":"2024-09-17T01:47:37.152081+0000","last_undegraded":"2024-09-17T01:47:37.152081+0000","last_fullsized":"2024-09-17T01:47:37.152081+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:46.748101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001431+0000","last_change":"2024-09-17T01:47:34.993962+0000","last_active":"2024-09-17T01:47:37.001431+0000","last_peered":"2024-09-17T01:47:37.001431+0000","last_clean":"2024-09-17T01:47:37.001431+0000","last_became_active":"2024-09-17T01:47:34.992169+0000","last_became_peered":"2024-09-17T01:47:34.992169+0000","last_unstale":"2024-09-17T01:47:37.001431+0000","last_undegraded":"2024-09-17T01:47:37.001431+0000","last_fullsized":"2024-09-17T01:47:37.001431+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:12.898352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027186+0000","last_change":"2024-09-17T01:47:36.013751+0000","last_active":"2024-09-17T01:47:37.027186+0000","last_peered":"2024-09-17T01:47:37.027186+0000","last_clean":"2024-09-17T01:47:37.027186+0000","last_became_active":"2024-09-17T01:47:36.012914+0000","last_became_peered":"2024-09-17T01:47:36.012914+0000","last_unstale":"2024-09-17T01:47:37.027186+0000","last_undegraded":"2024-09-17T01:47:37.027186+0000","last_fullsized":"2024-09-17T01:47:37.027186+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:18.276994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.b","version":"199'2","reported_seq":17,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999801+0000","last_change":"2024-09-17T01:47:35.011932+0000","last_active":"2024-09-17T01:47:36.999801+0000","last_peered":"2024-09-17T01:47:36.999801+0000","last_clean":"2024-09-17T01:47:36.999801+0000","last_became_active":"2024-09-17T01:47:35.011558+0000","last_became_peered":"2024-09-17T01:47:35.011558+0000","last_unstale":"2024-09-17T01:47:36.999801+0000","last_undegraded":"2024-09-17T01:47:36.999801+0000","last_fullsized":"2024-09-17T01:47:36.999801+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:12.724138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151934+0000","last_change":"2024-09-17T01:47:36.028346+0000","last_active":"2024-09-17T01:47:37.151934+0000","last_peered":"2024-09-17T01:47:37.151934+0000","last_clean":"2024-09-17T01:47:37.151934+0000","last_became_active":"2024-09-17T01:47:36.027814+0000","last_became_peered":"2024-09-17T01:47:36.027814+0000","last_unstale":"2024-09-17T01:47:37.151934+0000","last_undegraded":"2024-09-17T01:47:37.151934+0000","last_fullsized":"2024-09-17T01:47:37.151934+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:28.673161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152818+0000","last_change":"2024-09-17T01:47:34.994104+0000","last_active":"2024-09-17T01:47:37.152818+0000","last_peered":"2024-09-17T01:47:37.152818+0000","last_clean":"2024-09-17T01:47:37.152818+0000","last_became_active":"2024-09-17T01:47:34.993125+0000","last_became_peered":"2024-09-17T01:47:34.993125+0000","last_unstale":"2024-09-17T01:47:37.152818+0000","last_undegraded":"2024-09-17T01:47:37.152818+0000","last_fullsized":"2024-09-17T01:47:37.152818+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:38.505908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000251+0000","last_change":"2024-09-17T01:47:36.014232+0000","last_active":"2024-09-17T01:47:37.000251+0000","last_peered":"2024-09-17T01:47:37.000251+0000","last_clean":"2024-09-17T01:47:37.000251+0000","last_became_active":"2024-09-17T01:47:36.011929+0000","last_became_peered":"2024-09-17T01:47:36.011929+0000","last_unstale":"2024-09-17T01:47:37.000251+0000","last_undegraded":"2024-09-17T01:47:37.000251+0000","last_fullsized":"2024-09-17T01:47:37.000251+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:09.266220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151181+0000","last_change":"2024-09-17T01:47:35.011539+0000","last_active":"2024-09-17T01:47:37.151181+0000","last_peered":"2024-09-17T01:47:37.151181+0000","last_clean":"2024-09-17T01:47:37.151181+0000","last_became_active":"2024-09-17T01:47:35.011146+0000","last_became_peered":"2024-09-17T01:47:35.011146+0000","last_unstale":"2024-09-17T01:47:37.151181+0000","last_undegraded":"2024-09-17T01:47:37.151181+0000","last_fullsized":"2024-09-17T01:47:37.151181+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:58:36.250930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001015+0000","last_change":"2024-09-17T01:47:36.013423+0000","last_active":"2024-09-17T01:47:37.001015+0000","last_peered":"2024-09-17T01:47:37.001015+0000","last_clean":"2024-09-17T01:47:37.001015+0000","last_became_active":"2024-09-17T01:47:36.013122+0000","last_became_peered":"2024-09-17T01:47:36.013122+0000","last_unstale":"2024-09-17T01:47:37.001015+0000","last_undegraded":"2024-09-17T01:47:37.001015+0000","last_fullsized":"2024-09-17T01:47:37.001015+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:16.636984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151636+0000","last_change":"2024-09-17T01:47:35.010985+0000","last_active":"2024-09-17T01:47:37.151636+0000","last_peered":"2024-09-17T01:47:37.151636+0000","last_clean":"2024-09-17T01:47:37.151636+0000","last_became_active":"2024-09-17T01:47:35.010635+0000","last_became_peered":"2024-09-17T01:47:35.010635+0000","last_unstale":"2024-09-17T01:47:37.151636+0000","last_undegraded":"2024-09-17T01:47:37.151636+0000","last_fullsized":"2024-09-17T01:47:37.151636+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:47.121633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.027113+0000","last_change":"2024-09-17T01:47:36.022826+0000","last_active":"2024-09-17T01:47:37.027113+0000","last_peered":"2024-09-17T01:47:37.027113+0000","last_clean":"2024-09-17T01:47:37.027113+0000","last_became_active":"2024-09-17T01:47:36.022162+0000","last_became_peered":"2024-09-17T01:47:36.022162+0000","last_unstale":"2024-09-17T01:47:37.027113+0000","last_undegraded":"2024-09-17T01:47:37.027113+0000","last_fullsized":"2024-09-17T01:47:37.027113+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:40.708195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"199'2","reported_seq":17,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.026987+0000","last_change":"2024-09-17T01:47:35.008037+0000","last_active":"2024-09-17T01:47:37.026987+0000","last_peered":"2024-09-17T01:47:37.026987+0000","last_clean":"2024-09-17T01:47:37.026987+0000","last_became_active":"2024-09-17T01:47:35.007539+0000","last_became_peered":"2024-09-17T01:47:35.007539+0000","last_unstale":"2024-09-17T01:47:37.026987+0000","last_undegraded":"2024-09-17T01:47:37.026987+0000","last_fullsized":"2024-09-17T01:47:37.026987+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:49:02.783632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000634+0000","last_change":"2024-09-17T01:47:36.018759+0000","last_active":"2024-09-17T01:47:37.000634+0000","last_peered":"2024-09-17T01:47:37.000634+0000","last_clean":"2024-09-17T01:47:37.000634+0000","last_became_active":"2024-09-17T01:47:36.018449+0000","last_became_peered":"2024-09-17T01:47:36.018449+0000","last_unstale":"2024-09-17T01:47:37.000634+0000","last_undegraded":"2024-09-17T01:47:37.000634+0000","last_fullsized":"2024-09-17T01:47:37.000634+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:10.509746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.6","version":"200'1","reported_seq":16,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000467+0000","last_change":"2024-09-17T01:47:35.008019+0000","last_active":"2024-09-17T01:47:37.000467+0000","last_peered":"2024-09-17T01:47:37.000467+0000","last_clean":"2024-09-17T01:47:37.000467+0000","last_became_active":"2024-09-17T01:47:35.007699+0000","last_became_peered":"2024-09-17T01:47:35.007699+0000","last_unstale":"2024-09-17T01:47:37.000467+0000","last_undegraded":"2024-09-17T01:47:37.000467+0000","last_fullsized":"2024-09-17T01:47:37.000467+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:46.547217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000058+0000","last_change":"2024-09-17T01:47:36.016021+0000","last_active":"2024-09-17T01:47:37.000058+0000","last_peered":"2024-09-17T01:47:37.000058+0000","last_clean":"2024-09-17T01:47:37.000058+0000","last_became_active":"2024-09-17T01:47:36.015717+0000","last_became_peered":"2024-09-17T01:47:36.015717+0000","last_unstale":"2024-09-17T01:47:37.000058+0000","last_undegraded":"2024-09-17T01:47:37.000058+0000","last_fullsized":"2024-09-17T01:47:37.000058+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:04.802097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152350+0000","last_change":"2024-09-17T01:47:35.000829+0000","last_active":"2024-09-17T01:47:37.152350+0000","last_peered":"2024-09-17T01:47:37.152350+0000","last_clean":"2024-09-17T01:47:37.152350+0000","last_became_active":"2024-09-17T01:47:35.000499+0000","last_became_peered":"2024-09-17T01:47:35.000499+0000","last_unstale":"2024-09-17T01:47:37.152350+0000","last_undegraded":"2024-09-17T01:47:37.152350+0000","last_fullsized":"2024-09-17T01:47:37.152350+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:07.688589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001169+0000","last_change":"2024-09-17T01:47:36.018476+0000","last_active":"2024-09-17T01:47:37.001169+0000","last_peered":"2024-09-17T01:47:37.001169+0000","last_clean":"2024-09-17T01:47:37.001169+0000","last_became_active":"2024-09-17T01:47:36.017796+0000","last_became_peered":"2024-09-17T01:47:36.017796+0000","last_unstale":"2024-09-17T01:47:37.001169+0000","last_undegraded":"2024-09-17T01:47:37.001169+0000","last_fullsized":"2024-09-17T01:47:37.001169+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:51:17.387170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152121+0000","last_change":"2024-09-17T01:47:35.013150+0000","last_active":"2024-09-17T01:47:37.152121+0000","last_peered":"2024-09-17T01:47:37.152121+0000","last_clean":"2024-09-17T01:47:37.152121+0000","last_became_active":"2024-09-17T01:47:35.012633+0000","last_became_peered":"2024-09-17T01:47:35.012633+0000","last_unstale":"2024-09-17T01:47:37.152121+0000","last_undegraded":"2024-09-17T01:47:37.152121+0000","last_fullsized":"2024-09-17T01:47:37.152121+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:13:45.772845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999735+0000","last_change":"2024-09-17T01:47:36.020528+0000","last_active":"2024-09-17T01:47:36.999735+0000","last_peered":"2024-09-17T01:47:36.999735+0000","last_clean":"2024-09-17T01:47:36.999735+0000","last_became_active":"2024-09-17T01:47:36.020204+0000","last_became_peered":"2024-09-17T01:47:36.020204+0000","last_unstale":"2024-09-17T01:47:36.999735+0000","last_undegraded":"2024-09-17T01:47:36.999735+0000","last_fullsized":"2024-09-17T01:47:36.999735+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:53.498055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152366+0000","last_change":"2024-09-17T01:47:35.013573+0000","last_active":"2024-09-17T01:47:37.152366+0000","last_peered":"2024-09-17T01:47:37.152366+0000","last_clean":"2024-09-17T01:47:37.152366+0000","last_became_active":"2024-09-17T01:47:35.012649+0000","last_became_peered":"2024-09-17T01:47:35.012649+0000","last_unstale":"2024-09-17T01:47:37.152366+0000","last_undegraded":"2024-09-17T01:47:37.152366+0000","last_fullsized":"2024-09-17T01:47:37.152366+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:30.689211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999714+0000","last_change":"2024-09-17T01:47:36.027127+0000","last_active":"2024-09-17T01:47:36.999714+0000","last_peered":"2024-09-17T01:47:36.999714+0000","last_clean":"2024-09-17T01:47:36.999714+0000","last_became_active":"2024-09-17T01:47:36.026829+0000","last_became_peered":"2024-09-17T01:47:36.026829+0000","last_unstale":"2024-09-17T01:47:36.999714+0000","last_undegraded":"2024-09-17T01:47:36.999714+0000","last_fullsized":"2024-09-17T01:47:36.999714+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:49.510484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.152209+0000","last_change":"2024-09-17T01:47:35.004537+0000","last_active":"2024-09-17T01:47:37.152209+0000","last_peered":"2024-09-17T01:47:37.152209+0000","last_clean":"2024-09-17T01:47:37.152209+0000","last_became_active":"2024-09-17T01:47:35.003997+0000","last_became_peered":"2024-09-17T01:47:35.003997+0000","last_unstale":"2024-09-17T01:47:37.152209+0000","last_undegraded":"2024-09-17T01:47:37.152209+0000","last_fullsized":"2024-09-17T01:47:37.152209+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:09.740206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151577+0000","last_change":"2024-09-17T01:47:36.034733+0000","last_active":"2024-09-17T01:47:37.151577+0000","last_peered":"2024-09-17T01:47:37.151577+0000","last_clean":"2024-09-17T01:47:37.151577+0000","last_became_active":"2024-09-17T01:47:36.029170+0000","last_became_peered":"2024-09-17T01:47:36.029170+0000","last_unstale":"2024-09-17T01:47:37.151577+0000","last_undegraded":"2024-09-17T01:47:37.151577+0000","last_fullsized":"2024-09-17T01:47:37.151577+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:07.825226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.001117+0000","last_change":"2024-09-17T01:47:35.013384+0000","last_active":"2024-09-17T01:47:37.001117+0000","last_peered":"2024-09-17T01:47:37.001117+0000","last_clean":"2024-09-17T01:47:37.001117+0000","last_became_active":"2024-09-17T01:47:35.012957+0000","last_became_peered":"2024-09-17T01:47:35.012957+0000","last_unstale":"2024-09-17T01:47:37.001117+0000","last_undegraded":"2024-09-17T01:47:37.001117+0000","last_fullsized":"2024-09-17T01:47:37.001117+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:20.495786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151071+0000","last_change":"2024-09-17T01:47:36.002457+0000","last_active":"2024-09-17T01:47:37.151071+0000","last_peered":"2024-09-17T01:47:37.151071+0000","last_clean":"2024-09-17T01:47:37.151071+0000","last_became_active":"2024-09-17T01:47:36.001952+0000","last_became_peered":"2024-09-17T01:47:36.001952+0000","last_unstale":"2024-09-17T01:47:37.151071+0000","last_undegraded":"2024-09-17T01:47:37.151071+0000","last_fullsized":"2024-09-17T01:47:37.151071+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:56.911080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":15,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999239+0000","last_change":"2024-09-17T01:47:35.007484+0000","last_active":"2024-09-17T01:47:36.999239+0000","last_peered":"2024-09-17T01:47:36.999239+0000","last_clean":"2024-09-17T01:47:36.999239+0000","last_became_active":"2024-09-17T01:47:35.007199+0000","last_became_peered":"2024-09-17T01:47:35.007199+0000","last_unstale":"2024-09-17T01:47:36.999239+0000","last_undegraded":"2024-09-17T01:47:36.999239+0000","last_fullsized":"2024-09-17T01:47:36.999239+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:11.734174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":13,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.151338+0000","last_change":"2024-09-17T01:47:36.011259+0000","last_active":"2024-09-17T01:47:37.151338+0000","last_peered":"2024-09-17T01:47:37.151338+0000","last_clean":"2024-09-17T01:47:37.151338+0000","last_became_active":"2024-09-17T01:47:36.010945+0000","last_became_peered":"2024-09-17T01:47:36.010945+0000","last_unstale":"2024-09-17T01:47:37.151338+0000","last_undegraded":"2024-09-17T01:47:37.151338+0000","last_fullsized":"2024-09-17T01:47:37.151338+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:34.977594+0000","last_clean_scrub_stamp":"2024-09-17T01:47:34.977594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:53.498055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"199'2","reported_seq":17,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:37.000185+0000","last_change":"2024-09-17T01:47:35.015450+0000","last_active":"2024-09-17T01:47:37.000185+0000","last_peered":"2024-09-17T01:47:37.000185+0000","last_clean":"2024-09-17T01:47:37.000185+0000","last_became_active":"2024-09-17T01:47:35.014969+0000","last_became_peered":"2024-09-17T01:47:35.014969+0000","last_unstale":"2024-09-17T01:47:37.000185+0000","last_undegraded":"2024-09-17T01:47:37.000185+0000","last_fullsized":"2024-09-17T01:47:37.000185+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:47:33.971110+0000","last_clean_scrub_stamp":"2024-09-17T01:47:33.971110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:20.939219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":452,"reported_epoch":200,"state":"active+clean","last_fresh":"2024-09-17T01:47:36.999267+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:47:36.999267+0000","last_peered":"2024-09-17T01:47:36.999267+0000","last_clean":"2024-09-17T01:47:36.999267+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:47:36.999267+0000","last_undegraded":"2024-09-17T01:47:36.999267+0000","last_fullsized":"2024-09-17T01:47:36.999267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476929,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47536,"kb_used_data":2460,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324304,"statfs":{"total":96636764160,"available":96588087296,"internally_reserved":0,"allocated":2519040,"data_stored":1113104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509633,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55860,"kb_used_data":2464,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315980,"statfs":{"total":96636764160,"available":96579563520,"internally_reserved":0,"allocated":2523136,"data_stored":1113742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509632,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47548,"kb_used_data":2468,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324292,"statfs":{"total":96636764160,"available":96588075008,"internally_reserved":0,"allocated":2527232,"data_stored":1113216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509633,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51704,"kb_used_data":2468,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320136,"statfs":{"total":96636764160,"available":96583819264,"internally_reserved":0,"allocated":2527232,"data_stored":1114682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509633,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69676,"kb_used_data":2456,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94302164,"statfs":{"total":96636764160,"available":96565415936,"internally_reserved":0,"allocated":2514944,"data_stored":1113070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509632,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52284,"kb_used_data":3048,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319556,"statfs":{"total":96636764160,"available":96583225344,"internally_reserved":0,"allocated":3121152,"data_stored":1704112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509634,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60012,"kb_used_data":2456,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311828,"statfs":{"total":96636764160,"available":96575311872,"internally_reserved":0,"allocated":2514944,"data_stored":1113070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":58915273},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542338,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52292,"kb_used_data":3052,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319548,"statfs":{"total":96636764160,"available":96583217152,"internally_reserved":0,"allocated":3125248,"data_stored":1705120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:47:46.020 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T01:47:46.020 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T01:47:46.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.291+0000 7f44bb000640 1 -- 172.21.15.42:0/1493340363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44b40b3550 msgr2=0x7f44b415cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:46.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.291+0000 7f44bb000640 1 --2- 172.21.15.42:0/1493340363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44b40b3550 0x7f44b415cec0 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7f44a4005fd0 tx=0x7f44a402a540 comp rx=0 tx=0).stop 2024-09-17T01:47:46.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.291+0000 7f44bb000640 1 -- 172.21.15.42:0/1493340363 shutdown_connections 2024-09-17T01:47:46.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.291+0000 7f44bb000640 1 --2- 172.21.15.42:0/1493340363 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44b4142f40 0x7f44b4072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:46.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.291+0000 7f44bb000640 1 --2- 172.21.15.42:0/1493340363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44b40b3550 0x7f44b415cec0 unknown :-1 s=CLOSED pgs=2295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:46.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.291+0000 7f44bb000640 1 -- 172.21.15.42:0/1493340363 >> 172.21.15.42:0/1493340363 conn(0x7f44b40b2930 msgr2=0x7f44b406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:46.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.291+0000 7f44bb000640 1 -- 172.21.15.42:0/1493340363 shutdown_connections 2024-09-17T01:47:46.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.291+0000 7f44bb000640 1 -- 172.21.15.42:0/1493340363 wait complete. 2024-09-17T01:47:46.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.293+0000 7f44bb000640 1 Processor -- start 2024-09-17T01:47:46.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.294+0000 7f44bb000640 1 -- start start 2024-09-17T01:47:46.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.295+0000 7f44bb000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44b4072e90 0x7f44b40ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:46.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.295+0000 7f44bb000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44b40b3550 0x7f44b40aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:46.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.295+0000 7f44bb000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44b4142f40 0x7f44b41f9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:46.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.295+0000 7f44bb000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f44b406d7c0 con 0x7f44b4072e90 2024-09-17T01:47:46.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.295+0000 7f44bb000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f44b406d640 con 0x7f44b40b3550 2024-09-17T01:47:46.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.295+0000 7f44bb000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f44b406d940 con 0x7f44b4142f40 2024-09-17T01:47:46.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.295+0000 7f44b3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44b4072e90 0x7f44b40ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:46.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.295+0000 7f44b3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44b4072e90 0x7f44b40ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36564/0 (socket says 172.21.15.42:36564) 2024-09-17T01:47:46.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.295+0000 7f44b3e00640 1 -- 172.21.15.42:0/2088790137 learned_addr learned my addr 172.21.15.42:0/2088790137 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:46.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.295+0000 7f44abe00640 1 --2- 172.21.15.42:0/2088790137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44b40b3550 0x7f44b40aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:46.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.295+0000 7f44b9000640 1 --2- 172.21.15.42:0/2088790137 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44b4142f40 0x7f44b41f9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:46.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.296+0000 7f44b3e00640 1 -- 172.21.15.42:0/2088790137 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44b4142f40 msgr2=0x7f44b41f9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:46.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.296+0000 7f44b3e00640 1 --2- 172.21.15.42:0/2088790137 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44b4142f40 0x7f44b41f9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:46.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.296+0000 7f44b3e00640 1 -- 172.21.15.42:0/2088790137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44b40b3550 msgr2=0x7f44b40aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:46.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.296+0000 7f44b3e00640 1 --2- 172.21.15.42:0/2088790137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44b40b3550 0x7f44b40aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:46.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.296+0000 7f44b3e00640 1 -- 172.21.15.42:0/2088790137 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b406eec0 con 0x7f44b4072e90 2024-09-17T01:47:46.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.296+0000 7f44b3e00640 1 --2- 172.21.15.42:0/2088790137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44b4072e90 0x7f44b40ae8a0 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7f44a4034040 tx=0x7f44a40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:46.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.296+0000 7f44b0c00640 1 -- 172.21.15.42:0/2088790137 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a403e030 con 0x7f44b4072e90 2024-09-17T01:47:46.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.296+0000 7f44b0c00640 1 -- 172.21.15.42:0/2088790137 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44a4003d90 con 0x7f44b4072e90 2024-09-17T01:47:46.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.296+0000 7f44bb000640 1 -- 172.21.15.42:0/2088790137 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44b406f1a0 con 0x7f44b4072e90 2024-09-17T01:47:46.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.296+0000 7f44b0c00640 1 -- 172.21.15.42:0/2088790137 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a4035040 con 0x7f44b4072e90 2024-09-17T01:47:46.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.297+0000 7f44bb000640 1 -- 172.21.15.42:0/2088790137 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44b406f760 con 0x7f44b4072e90 2024-09-17T01:47:46.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.298+0000 7f44bb000640 1 -- 172.21.15.42:0/2088790137 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44b40744a0 con 0x7f44b4072e90 2024-09-17T01:47:46.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.299+0000 7f44b0c00640 1 -- 172.21.15.42:0/2088790137 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f44a4041030 con 0x7f44b4072e90 2024-09-17T01:47:46.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.300+0000 7f44b0c00640 1 --2- 172.21.15.42:0/2088790137 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4490078b90 0x7f449007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:46.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.300+0000 7f44b0c00640 1 -- 172.21.15.42:0/2088790137 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5709+0+0 (secure 0 0 0) 0x7f44a40bb7d0 con 0x7f44b4072e90 2024-09-17T01:47:46.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.301+0000 7f44abe00640 1 --2- 172.21.15.42:0/2088790137 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4490078b90 0x7f449007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:46.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.301+0000 7f44abe00640 1 --2- 172.21.15.42:0/2088790137 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4490078b90 0x7f449007b0a0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f44b415f350 tx=0x7f449c005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:46.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.305+0000 7f44b0c00640 1 -- 172.21.15.42:0/2088790137 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f44b40744a0 con 0x7f44b4072e90 2024-09-17T01:47:46.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.575+0000 7f44bb000640 1 -- 172.21.15.42:0/2088790137 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f44b415cec0 con 0x7f44b4072e90 2024-09-17T01:47:46.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.578+0000 7f44b0c00640 1 -- 172.21.15.42:0/2088790137 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v44) ==== 190+0+147 (secure 0 0 0) 0x7f44a4083530 con 0x7f44b4072e90 2024-09-17T01:47:46.577 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-09-17T01:47:46.578 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA== 2024-09-17T01:47:46.578 INFO:teuthology.orchestra.run.smithi042.stdout: caps mds = "allow" 2024-09-17T01:47:46.578 INFO:teuthology.orchestra.run.smithi042.stdout: caps mon = "allow r" 2024-09-17T01:47:46.578 INFO:teuthology.orchestra.run.smithi042.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T01:47:46.578 INFO:teuthology.orchestra.run.smithi042.stderr:updated caps for client.0 2024-09-17T01:47:46.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.581+0000 7f44bb000640 1 -- 172.21.15.42:0/2088790137 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4490078b90 msgr2=0x7f449007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:46.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.581+0000 7f44bb000640 1 --2- 172.21.15.42:0/2088790137 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4490078b90 0x7f449007b0a0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f44b415f350 tx=0x7f449c005f90 comp rx=0 tx=0).stop 2024-09-17T01:47:46.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.581+0000 7f44bb000640 1 -- 172.21.15.42:0/2088790137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44b4072e90 msgr2=0x7f44b40ae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:46.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.581+0000 7f44bb000640 1 --2- 172.21.15.42:0/2088790137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44b4072e90 0x7f44b40ae8a0 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7f44a4034040 tx=0x7f44a40038a0 comp rx=0 tx=0).stop 2024-09-17T01:47:46.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.581+0000 7f44bb000640 1 -- 172.21.15.42:0/2088790137 shutdown_connections 2024-09-17T01:47:46.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.581+0000 7f44bb000640 1 --2- 172.21.15.42:0/2088790137 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4490078b90 0x7f449007b0a0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:46.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.581+0000 7f44bb000640 1 --2- 172.21.15.42:0/2088790137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44b40b3550 0x7f44b40aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:46.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.581+0000 7f44bb000640 1 --2- 172.21.15.42:0/2088790137 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44b4142f40 0x7f44b41f9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:46.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.581+0000 7f44bb000640 1 --2- 172.21.15.42:0/2088790137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44b4072e90 0x7f44b40ae8a0 unknown :-1 s=CLOSED pgs=2296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:46.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.581+0000 7f44bb000640 1 -- 172.21.15.42:0/2088790137 >> 172.21.15.42:0/2088790137 conn(0x7f44b40b2930 msgr2=0x7f44b415f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:46.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.582+0000 7f44bb000640 1 -- 172.21.15.42:0/2088790137 shutdown_connections 2024-09-17T01:47:46.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.582+0000 7f44bb000640 1 -- 172.21.15.42:0/2088790137 wait complete. 2024-09-17T01:47:46.603 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:47:46.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.832+0000 7f45cfe00640 1 -- 172.21.15.42:0/2421305857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45d00d2d80 msgr2=0x7f45d00b8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:46.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.832+0000 7f45cfe00640 1 --2- 172.21.15.42:0/2421305857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45d00d2d80 0x7f45d00b8280 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7f45d0162480 tx=0x7f45c802aac0 comp rx=0 tx=0).stop 2024-09-17T01:47:46.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.832+0000 7f45cfe00640 1 -- 172.21.15.42:0/2421305857 shutdown_connections 2024-09-17T01:47:46.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.832+0000 7f45cfe00640 1 --2- 172.21.15.42:0/2421305857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45d00d2d80 0x7f45d00b8280 unknown :-1 s=CLOSED pgs=2297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:46.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.832+0000 7f45cfe00640 1 --2- 172.21.15.42:0/2421305857 >> v2:172.21.15.43:3300/0 conn(0x7f45d00d1a80 0x7f45d00d2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:46.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.832+0000 7f45cfe00640 1 -- 172.21.15.42:0/2421305857 >> 172.21.15.42:0/2421305857 conn(0x7f45d006cf00 msgr2=0x7f45d006d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:46.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.832+0000 7f45cfe00640 1 -- 172.21.15.42:0/2421305857 shutdown_connections 2024-09-17T01:47:46.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.832+0000 7f45cfe00640 1 -- 172.21.15.42:0/2421305857 wait complete. 2024-09-17T01:47:46.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.834+0000 7f45cfe00640 1 Processor -- start 2024-09-17T01:47:46.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.834+0000 7f45cfe00640 1 -- start start 2024-09-17T01:47:46.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.836+0000 7f45cfe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45d00d2d80 0x7f45d00b6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:46.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.836+0000 7f45cfe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f45d015ea80 0x7f45d01566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.836+0000 7f45cfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45d0153f30 0x7f45d0156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.836+0000 7f45cfe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f45d00b8da0 con 0x7f45d0153f30 2024-09-17T01:47:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.836+0000 7f45cfe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f45d00b8c20 con 0x7f45d00d2d80 2024-09-17T01:47:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.836+0000 7f45cfe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f45d00b8f20 con 0x7f45d015ea80 2024-09-17T01:47:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.836+0000 7f45cf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45d0153f30 0x7f45d0156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.836+0000 7f45cf400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45d0153f30 0x7f45d0156be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36568/0 (socket says 172.21.15.42:36568) 2024-09-17T01:47:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.836+0000 7f45cf400640 1 -- 172.21.15.42:0/3554413637 learned_addr learned my addr 172.21.15.42:0/3554413637 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.836+0000 7f45cea00640 1 --2- 172.21.15.42:0/3554413637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45d00d2d80 0x7f45d00b6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.836+0000 7f45c7e00640 1 --2- 172.21.15.42:0/3554413637 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f45d015ea80 0x7f45d01566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.837+0000 7f45cf400640 1 -- 172.21.15.42:0/3554413637 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f45d015ea80 msgr2=0x7f45d01566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.837+0000 7f45cf400640 1 --2- 172.21.15.42:0/3554413637 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f45d015ea80 0x7f45d01566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:46.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.837+0000 7f45cf400640 1 -- 172.21.15.42:0/3554413637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45d00d2d80 msgr2=0x7f45d00b6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:46.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.837+0000 7f45cf400640 1 --2- 172.21.15.42:0/3554413637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45d00d2d80 0x7f45d00b6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:46.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.837+0000 7f45cf400640 1 -- 172.21.15.42:0/3554413637 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d0149650 con 0x7f45d0153f30 2024-09-17T01:47:46.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.837+0000 7f45cf400640 1 --2- 172.21.15.42:0/3554413637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45d0153f30 0x7f45d0156be0 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7f45c8009d60 tx=0x7f45c8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:46.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.837+0000 7f45c6a00640 1 -- 172.21.15.42:0/3554413637 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c8044070 con 0x7f45d0153f30 2024-09-17T01:47:46.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.837+0000 7f45c6a00640 1 -- 172.21.15.42:0/3554413637 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f45c8004250 con 0x7f45d0153f30 2024-09-17T01:47:46.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.837+0000 7f45c6a00640 1 -- 172.21.15.42:0/3554413637 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c8004680 con 0x7f45d0153f30 2024-09-17T01:47:46.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.837+0000 7f45cfe00640 1 -- 172.21.15.42:0/3554413637 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d0149930 con 0x7f45d0153f30 2024-09-17T01:47:46.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.837+0000 7f45cfe00640 1 -- 172.21.15.42:0/3554413637 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d0149ef0 con 0x7f45d0153f30 2024-09-17T01:47:46.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.838+0000 7f45cfe00640 1 -- 172.21.15.42:0/3554413637 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45d00b9440 con 0x7f45d0153f30 2024-09-17T01:47:46.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.840+0000 7f45c6a00640 1 -- 172.21.15.42:0/3554413637 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f45c8036400 con 0x7f45d0153f30 2024-09-17T01:47:46.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.841+0000 7f45c6a00640 1 --2- 172.21.15.42:0/3554413637 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f45ac078b90 0x7f45ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:46.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.841+0000 7f45c6a00640 1 -- 172.21.15.42:0/3554413637 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5709+0+0 (secure 0 0 0) 0x7f45c80bb480 con 0x7f45d0153f30 2024-09-17T01:47:46.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.841+0000 7f45cea00640 1 --2- 172.21.15.42:0/3554413637 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f45ac078b90 0x7f45ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:46.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.842+0000 7f45cea00640 1 --2- 172.21.15.42:0/3554413637 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f45ac078b90 0x7f45ac07b0a0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f45c0001720 tx=0x7f45c0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:46.844 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:46.845+0000 7f45c6a00640 1 -- 172.21.15.42:0/3554413637 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f45c8032030 con 0x7f45d0153f30 2024-09-17T01:47:47.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.079+0000 7f45cfe00640 1 -- 172.21.15.42:0/3554413637 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45d0161990 con 0x7f45d0153f30 2024-09-17T01:47:47.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.080+0000 7f45c6a00640 1 -- 172.21.15.42:0/3554413637 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 159 v159) ==== 95+0+5231 (secure 0 0 0) 0x7f45c8004820 con 0x7f45d0153f30 2024-09-17T01:47:47.079 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:47.079 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":159,"btime":"2024-09-17T01:47:39:016238+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3701245274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3701245274},{"type":"v1","addr":"172.21.15.43:6837","nonce":3701245274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10021,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/8838410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":8838410},{"type":"v1","addr":"172.21.15.42:6834","nonce":8838410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3981236009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3981236009},{"type":"v1","addr":"172.21.15.43:6836","nonce":3981236009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154}],"filesystems":[{"mdsmap":{"epoch":159,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:47:35.510920+0000","modified":"2024-09-17T01:47:38.527136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10776":{"gid":10776,"name":"c","rank":0,"incarnation":155,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3836210591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3836210591},{"type":"v1","addr":"172.21.15.42:6835","nonce":3836210591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10776,"qdb_cluster":[10776]},"id":14}]} 2024-09-17T01:47:47.079 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 159 2024-09-17T01:47:47.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.082+0000 7f45cfe00640 1 -- 172.21.15.42:0/3554413637 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f45ac078b90 msgr2=0x7f45ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:47.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.082+0000 7f45cfe00640 1 --2- 172.21.15.42:0/3554413637 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f45ac078b90 0x7f45ac07b0a0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f45c0001720 tx=0x7f45c0009040 comp rx=0 tx=0).stop 2024-09-17T01:47:47.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.082+0000 7f45cfe00640 1 -- 172.21.15.42:0/3554413637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45d0153f30 msgr2=0x7f45d0156be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:47.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.082+0000 7f45cfe00640 1 --2- 172.21.15.42:0/3554413637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45d0153f30 0x7f45d0156be0 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7f45c8009d60 tx=0x7f45c8003f10 comp rx=0 tx=0).stop 2024-09-17T01:47:47.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.082+0000 7f45cfe00640 1 -- 172.21.15.42:0/3554413637 shutdown_connections 2024-09-17T01:47:47.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.082+0000 7f45cfe00640 1 --2- 172.21.15.42:0/3554413637 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f45ac078b90 0x7f45ac07b0a0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.082+0000 7f45cfe00640 1 --2- 172.21.15.42:0/3554413637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f45d0153f30 0x7f45d0156be0 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.082+0000 7f45cfe00640 1 --2- 172.21.15.42:0/3554413637 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f45d015ea80 0x7f45d01566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.082+0000 7f45cfe00640 1 --2- 172.21.15.42:0/3554413637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45d00d2d80 0x7f45d00b6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.082+0000 7f45cfe00640 1 -- 172.21.15.42:0/3554413637 >> 172.21.15.42:0/3554413637 conn(0x7f45d006cf00 msgr2=0x7f45d00d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:47.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.082+0000 7f45cfe00640 1 -- 172.21.15.42:0/3554413637 shutdown_connections 2024-09-17T01:47:47.083 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.083+0000 7f45cfe00640 1 -- 172.21.15.42:0/3554413637 wait complete. 2024-09-17T01:47:47.508 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 159, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:47:35.510920+0000', 'modified': '2024-09-17T01:47:38.527136+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10776}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10776': {'gid': 10776, 'name': 'c', 'rank': 0, 'incarnation': 155, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.42:6835/3836210591', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6832', 'nonce': 3836210591}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 3836210591}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [29], 'metadata_pool': 28, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10776, 'qdb_cluster': [10776]} 2024-09-17T01:47:47.509 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T01:47:47.509 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T01:47:47.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.741+0000 7f6bb2c00640 1 -- 172.21.15.42:0/3282556656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b94003c10 msgr2=0x7f6b94004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:47.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.741+0000 7f6bb2c00640 1 --2- 172.21.15.42:0/3282556656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b94003c10 0x7f6b94004060 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0001830 tx=0x7f6b94005830 comp rx=0 tx=0).stop 2024-09-17T01:47:47.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.741+0000 7f6bb2200640 1 -- 172.21.15.42:0/3282556656 reap_dead start 2024-09-17T01:47:47.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.741+0000 7f6bb2c00640 1 -- 172.21.15.42:0/3282556656 shutdown_connections 2024-09-17T01:47:47.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.741+0000 7f6bb2c00640 1 -- 172.21.15.42:0/3282556656 >> 172.21.15.42:0/3282556656 conn(0x7f6bac0d1210 msgr2=0x7f6bac0d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:47.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.741+0000 7f6bb2c00640 1 -- 172.21.15.42:0/3282556656 shutdown_connections 2024-09-17T01:47:47.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.741+0000 7f6bb2c00640 1 -- 172.21.15.42:0/3282556656 wait complete. 2024-09-17T01:47:47.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.743+0000 7f6bb2c00640 1 Processor -- start 2024-09-17T01:47:47.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.743+0000 7f6bb2c00640 1 -- start start 2024-09-17T01:47:47.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.745+0000 7f6bb2c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b94003c10 0x7f6bac0cf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:47.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.745+0000 7f6bb2c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bac0ca960 0x7f6bac0b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:47.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.745+0000 7f6bb2c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bac1f6680 0x7f6bac1f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:47.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.745+0000 7f6bb2c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac15f4c0 con 0x7f6bac0ca960 2024-09-17T01:47:47.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.745+0000 7f6bb2c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac0b67c0 con 0x7f6bac1f6680 2024-09-17T01:47:47.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.745+0000 7f6bb2c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6bac15f640 con 0x7f6b94003c10 2024-09-17T01:47:47.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.745+0000 7f6bb0e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bac0ca960 0x7f6bac0b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:47.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.745+0000 7f6bb0e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bac0ca960 0x7f6bac0b8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36590/0 (socket says 172.21.15.42:36590) 2024-09-17T01:47:47.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.745+0000 7f6bb0e00640 1 -- 172.21.15.42:0/2891052047 learned_addr learned my addr 172.21.15.42:0/2891052047 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.745+0000 7f6bb1800640 1 --2- 172.21.15.42:0/2891052047 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b94003c10 0x7f6bac0cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.746+0000 7f6bb0e00640 1 -- 172.21.15.42:0/2891052047 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b94003c10 msgr2=0x7f6bac0cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.746+0000 7f6bb0e00640 1 --2- 172.21.15.42:0/2891052047 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b94003c10 0x7f6bac0cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.746+0000 7f6bb0e00640 1 -- 172.21.15.42:0/2891052047 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bac1f6680 msgr2=0x7f6bac1f6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.746+0000 7f6bb2200640 1 --2- 172.21.15.42:0/2891052047 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bac1f6680 0x7f6bac1f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.746+0000 7f6bb0e00640 1 --2- 172.21.15.42:0/2891052047 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bac1f6680 0x7f6bac1f6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.746+0000 7f6bb0e00640 1 -- 172.21.15.42:0/2891052047 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bac0ce0f0 con 0x7f6bac0ca960 2024-09-17T01:47:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.746+0000 7f6bb2200640 1 --2- 172.21.15.42:0/2891052047 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bac1f6680 0x7f6bac1f6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:47:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.746+0000 7f6bb0e00640 1 --2- 172.21.15.42:0/2891052047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bac0ca960 0x7f6bac0b8d90 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7f6b98001a00 tx=0x7f6b98003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.746+0000 7f6ba9600640 1 -- 172.21.15.42:0/2891052047 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9800f7e0 con 0x7f6bac0ca960 2024-09-17T01:47:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.746+0000 7f6ba9600640 1 -- 172.21.15.42:0/2891052047 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b98016020 con 0x7f6bac0ca960 2024-09-17T01:47:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.746+0000 7f6ba9600640 1 -- 172.21.15.42:0/2891052047 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9800fc40 con 0x7f6bac0ca960 2024-09-17T01:47:47.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.746+0000 7f6bb2c00640 1 -- 172.21.15.42:0/2891052047 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bac0b92d0 con 0x7f6bac0ca960 2024-09-17T01:47:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.746+0000 7f6bb2c00640 1 -- 172.21.15.42:0/2891052047 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bac0ce670 con 0x7f6bac0ca960 2024-09-17T01:47:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.749+0000 7f6ba9600640 1 -- 172.21.15.42:0/2891052047 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6b98011430 con 0x7f6bac0ca960 2024-09-17T01:47:47.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.750+0000 7f6ba9600640 1 --2- 172.21.15.42:0/2891052047 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6b8c078bc0 0x7f6b8c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:47.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.750+0000 7f6ba9600640 1 -- 172.21.15.42:0/2891052047 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5709+0+0 (secure 0 0 0) 0x7f6b9809ba40 con 0x7f6bac0ca960 2024-09-17T01:47:47.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.750+0000 7f6bb1800640 1 --2- 172.21.15.42:0/2891052047 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6b8c078bc0 0x7f6b8c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:47.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.750+0000 7f6bbb27c740 1 Processor -- start 2024-09-17T01:47:47.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.750+0000 7f6bbb27c740 1 -- start start 2024-09-17T01:47:47.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.751+0000 7f6bb1800640 1 --2- 172.21.15.42:0/2891052047 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6b8c078bc0 0x7f6b8c07b0d0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0032000 tx=0x7f6ba0001360 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:47.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.752+0000 7f6bbb27c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065d7270 0x558e069a7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:47.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.752+0000 7f6bbb27c740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558e065ae3b0 0x558e069a80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:47.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.752+0000 7f6bbb27c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558e065b6590 0x558e06978150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:47.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.752+0000 7f6bbb27c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558e06901430 con 0x558e065d7270 2024-09-17T01:47:47.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.752+0000 7f6bbb27c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558e068f15d0 con 0x558e065b6590 2024-09-17T01:47:47.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.752+0000 7f6bbb27c740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558e068e0a00 con 0x558e065ae3b0 2024-09-17T01:47:47.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.752+0000 7f6bb1800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065d7270 0x558e069a7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:47.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.752+0000 7f6bb1800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065d7270 0x558e069a7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36606/0 (socket says 172.21.15.42:36606) 2024-09-17T01:47:47.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.752+0000 7f6bb1800640 1 -- 172.21.15.42:0/1398302189 learned_addr learned my addr 172.21.15.42:0/1398302189 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:47.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.752+0000 7f6bb2200640 1 --2- 172.21.15.42:0/1398302189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558e065b6590 0x558e06978150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:47.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.752+0000 7f6bb0e00640 1 --2- 172.21.15.42:0/1398302189 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558e065ae3b0 0x558e069a80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:47.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.753+0000 7f6bb1800640 1 -- 172.21.15.42:0/1398302189 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558e065ae3b0 msgr2=0x558e069a80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:47.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.753+0000 7f6bb1800640 1 --2- 172.21.15.42:0/1398302189 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558e065ae3b0 0x558e069a80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.753+0000 7f6bb1800640 1 -- 172.21.15.42:0/1398302189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558e065b6590 msgr2=0x558e06978150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:47.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.753+0000 7f6bb1800640 1 --2- 172.21.15.42:0/1398302189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558e065b6590 0x558e06978150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.753+0000 7f6bb1800640 1 -- 172.21.15.42:0/1398302189 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e068a9520 con 0x558e065d7270 2024-09-17T01:47:47.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.753+0000 7f6bb2200640 1 --2- 172.21.15.42:0/1398302189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558e065b6590 0x558e06978150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:47:47.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.753+0000 7f6bb1800640 1 --2- 172.21.15.42:0/1398302189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065d7270 0x558e069a7b60 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7f6ba002aa50 tx=0x7f6ba003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d138c6ea88a4ea server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:47.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.753+0000 7f6b9e000640 1 -- 172.21.15.42:0/1398302189 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0050070 con 0x558e065d7270 2024-09-17T01:47:47.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.753+0000 7f6b9e000640 1 -- 172.21.15.42:0/1398302189 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ba0046050 con 0x558e065d7270 2024-09-17T01:47:47.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.753+0000 7f6b9e000640 1 -- 172.21.15.42:0/1398302189 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba00337d0 con 0x558e065d7270 2024-09-17T01:47:47.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.754+0000 7f6bbb27c740 1 -- 172.21.15.42:0/1398302189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065d7270 msgr2=0x558e069a7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:47.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.754+0000 7f6bbb27c740 1 --2- 172.21.15.42:0/1398302189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065d7270 0x558e069a7b60 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7f6ba002aa50 tx=0x7f6ba003d000 comp rx=0 tx=0).stop 2024-09-17T01:47:47.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.754+0000 7f6bbb27c740 1 -- 172.21.15.42:0/1398302189 shutdown_connections 2024-09-17T01:47:47.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.754+0000 7f6bbb27c740 1 --2- 172.21.15.42:0/1398302189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558e065b6590 0x558e06978150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.754+0000 7f6bbb27c740 1 --2- 172.21.15.42:0/1398302189 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558e065ae3b0 0x558e069a80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.754+0000 7f6bbb27c740 1 --2- 172.21.15.42:0/1398302189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065d7270 0x558e069a7b60 unknown :-1 s=CLOSED pgs=2302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.754+0000 7f6bbb27c740 1 -- 172.21.15.42:0/1398302189 >> 172.21.15.42:0/1398302189 conn(0x558e065cb3c0 msgr2=0x558e0697db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:47.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.754+0000 7f6bbb27c740 1 -- 172.21.15.42:0/1398302189 shutdown_connections 2024-09-17T01:47:47.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.754+0000 7f6bbb27c740 1 -- 172.21.15.42:0/1398302189 wait complete. 2024-09-17T01:47:47.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.755+0000 7f6bbb27c740 1 -- start start 2024-09-17T01:47:47.756 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.755+0000 7f6bbb27c740 1 Processor -- start 2024-09-17T01:47:47.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.757+0000 7f6bbb27c740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558e065ae3b0 0x558e069d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:47.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.757+0000 7f6bbb27c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558e065b6590 0x558e0699fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:47.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.757+0000 7f6bbb27c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065d7270 0x558e069bb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:47.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.757+0000 7f6bbb27c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558e06887330 con 0x558e065d7270 2024-09-17T01:47:47.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.757+0000 7f6bbb27c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558e068e4810 con 0x558e065b6590 2024-09-17T01:47:47.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.757+0000 7f6bbb27c740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558e06651620 con 0x558e065ae3b0 2024-09-17T01:47:47.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.757+0000 7f6bbb27c740 10 client.0 _ll_register_callbacks cb 0x558e0688c420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:47:47.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.757+0000 7f6bb2200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065d7270 0x558e069bb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:47.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.757+0000 7f6bb2200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065d7270 0x558e069bb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36610/0 (socket says 172.21.15.42:36610) 2024-09-17T01:47:47.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.757+0000 7f6bb2200640 1 -- 172.21.15.42:0/1147088279 learned_addr learned my addr 172.21.15.42:0/1147088279 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:47.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.758+0000 7f6bb1800640 1 --2- 172.21.15.42:0/1147088279 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558e065ae3b0 0x558e069d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:47.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.758+0000 7f6bb0e00640 1 --2- 172.21.15.42:0/1147088279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558e065b6590 0x558e0699fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:47.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.758+0000 7f6bb2200640 1 -- 172.21.15.42:0/1147088279 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558e065ae3b0 msgr2=0x558e069d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:47.759 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.758+0000 7f6bb2200640 1 --2- 172.21.15.42:0/1147088279 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558e065ae3b0 0x558e069d15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.758+0000 7f6bb2200640 1 -- 172.21.15.42:0/1147088279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558e065b6590 msgr2=0x558e0699fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:47.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.758+0000 7f6bb2200640 1 --2- 172.21.15.42:0/1147088279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558e065b6590 0x558e0699fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.758+0000 7f6bb2200640 1 -- 172.21.15.42:0/1147088279 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e06642850 con 0x558e065d7270 2024-09-17T01:47:47.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.758+0000 7f6bb2200640 1 --2- 172.21.15.42:0/1147088279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065d7270 0x558e069bb200 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4005fd0 tx=0x7f6ba4004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68f17dc9e95528 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:47.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.758+0000 7f6b92a00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:47:47.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.758+0000 7f6b92a00640 1 -- 172.21.15.42:0/1147088279 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4012720 con 0x558e065d7270 2024-09-17T01:47:47.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.758+0000 7f6b92a00640 1 -- 172.21.15.42:0/1147088279 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(200..200 src has 1..200) ==== 5709+0+0 (secure 0 0 0) 0x7f6ba401dad0 con 0x558e065d7270 2024-09-17T01:47:47.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.758+0000 7f6bbb27c740 1 -- 172.21.15.42:0/1147088279 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ba0046050 con 0x558e065d7270 2024-09-17T01:47:47.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.758+0000 7f6b92a00640 1 -- 172.21.15.42:0/1147088279 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=159) ==== 24+0+0 (secure 0 0 0) 0x7f6ba401dcd0 con 0x558e065d7270 2024-09-17T01:47:47.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.758+0000 7f6bbb27c740 10 client.10923 fetch_fsmap learned FSMap version 159 2024-09-17T01:47:47.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.759+0000 7f6bbb27c740 1 -- 172.21.15.42:0/1147088279 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=159,monmap=2+}) -- 0x558e066b96b0 con 0x558e065d7270 2024-09-17T01:47:47.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.759+0000 7f6b92a00640 1 -- 172.21.15.42:0/1147088279 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ba0046050 con 0x558e065d7270 2024-09-17T01:47:47.760 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.759+0000 7f6b92a00640 1 -- 172.21.15.42:0/1147088279 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 159) ==== 3502+0+0 (secure 0 0 0) 0x7f6ba40128c0 con 0x558e065d7270 2024-09-17T01:47:47.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.759+0000 7f6bbb27c740 10 client.10923 fetch_fsmap finished waiting for FSMap version 159 2024-09-17T01:47:47.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.759+0000 7f6bbb27c740 10 client.10923 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:47:47.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.759+0000 7f6bbb27c740 20 client.10923 populate_metadata read hostname 'smithi042' 2024-09-17T01:47:47.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.759+0000 7f6bbb27c740 1 --2- 172.21.15.42:0/1147088279 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x558e06595e40 0x558e069df5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:47.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.759+0000 7f6bbb27c740 4 client.10923 mds_command: new command op to 10776 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:47:47.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.759+0000 7f6bbb27c740 1 -- 172.21.15.42:0/1147088279 --> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e068f3520 con 0x558e06595e40 2024-09-17T01:47:47.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.759+0000 7f6bb1800640 1 --2- 172.21.15.42:0/1147088279 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x558e06595e40 0x558e069df5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:47.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.760+0000 7f6bb1800640 1 --2- 172.21.15.42:0/1147088279 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x558e06595e40 0x558e069df5a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=702bfb2aee3f56bc server_cookie=1f038f71496eecc6 in_seq=0 out_seq=0 2024-09-17T01:47:47.761 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.760+0000 7f6b92a00640 10 client.10923 ms_handle_connect on v2:172.21.15.42:6832/3836210591 2024-09-17T01:47:47.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.761+0000 7f6b92a00640 1 -- 172.21.15.42:0/1147088279 <== mds.0 v2:172.21.15.42:6832/3836210591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558e068f3520 con 0x558e06595e40 2024-09-17T01:47:47.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.761+0000 7f6b92a00640 10 client.10923 handle_command_reply: tid=0 2024-09-17T01:47:47.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.761+0000 7f6bbb27c740 1 client.10923 shutdown 2024-09-17T01:47:47.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.761+0000 7f6bbb27c740 1 -- 172.21.15.42:0/1147088279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065d7270 msgr2=0x558e069bb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:47.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.761+0000 7f6bbb27c740 1 --2- 172.21.15.42:0/1147088279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065d7270 0x558e069bb200 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4005fd0 tx=0x7f6ba4004410 comp rx=0 tx=0).stop 2024-09-17T01:47:47.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.761+0000 7f6bbb27c740 1 -- 172.21.15.42:0/1147088279 shutdown_connections 2024-09-17T01:47:47.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.761+0000 7f6bbb27c740 1 --2- 172.21.15.42:0/1147088279 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x558e06595e40 0x558e069df5a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.761+0000 7f6bbb27c740 1 --2- 172.21.15.42:0/1147088279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558e065b6590 0x558e0699fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.761+0000 7f6bbb27c740 1 --2- 172.21.15.42:0/1147088279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065d7270 0x558e069bb200 unknown :-1 s=CLOSED pgs=2303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.761+0000 7f6bbb27c740 1 --2- 172.21.15.42:0/1147088279 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558e065ae3b0 0x558e069d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.761+0000 7f6b92a00640 0 client.10923 ms_handle_reset on v2:172.21.15.42:6832/3836210591 2024-09-17T01:47:47.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.761+0000 7f6bbb27c740 1 -- 172.21.15.42:0/1147088279 >> 172.21.15.42:0/1147088279 conn(0x558e065cb3c0 msgr2=0x558e069c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:47.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.762+0000 7f6bbb27c740 1 -- 172.21.15.42:0/1147088279 shutdown_connections 2024-09-17T01:47:47.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.762+0000 7f6bbb27c740 1 -- 172.21.15.42:0/1147088279 wait complete. 2024-09-17T01:47:47.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.762+0000 7f6bbb27c740 20 client.10923 trim_cache size 0 max 16384 2024-09-17T01:47:47.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.781+0000 7f6bbb27c740 1 Processor -- start 2024-09-17T01:47:47.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.781+0000 7f6bbb27c740 1 -- start start 2024-09-17T01:47:47.781 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.782+0000 7f6bbb27c740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558e065ae3b0 0x558e069b93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:47.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.782+0000 7f6bbb27c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558e065b6590 0x558e069c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:47.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.782+0000 7f6bbb27c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065d7270 0x558e069c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:47.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.782+0000 7f6bbb27c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac1f9460 con 0x558e065d7270 2024-09-17T01:47:47.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.782+0000 7f6bbb27c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6bac150e00 con 0x558e065b6590 2024-09-17T01:47:47.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.782+0000 7f6bbb27c740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6bac1f8e10 con 0x558e065ae3b0 2024-09-17T01:47:47.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.783+0000 7f6bb2200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065d7270 0x558e069c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:47.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.783+0000 7f6bb2200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065d7270 0x558e069c66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36616/0 (socket says 172.21.15.42:36616) 2024-09-17T01:47:47.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.783+0000 7f6bb2200640 1 -- 172.21.15.42:0/228297342 learned_addr learned my addr 172.21.15.42:0/228297342 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:47.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.783+0000 7f6bb0e00640 1 --2- 172.21.15.42:0/228297342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558e065b6590 0x558e069c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:47.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.783+0000 7f6bb1800640 1 --2- 172.21.15.42:0/228297342 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558e065ae3b0 0x558e069b93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:47.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.783+0000 7f6bb2200640 1 -- 172.21.15.42:0/228297342 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558e065ae3b0 msgr2=0x558e069b93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:47.784 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.783+0000 7f6bb2200640 1 --2- 172.21.15.42:0/228297342 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558e065ae3b0 0x558e069b93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.783+0000 7f6bb2200640 1 -- 172.21.15.42:0/228297342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558e065b6590 msgr2=0x558e069c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:47.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.783+0000 7f6bb2200640 1 --2- 172.21.15.42:0/228297342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558e065b6590 0x558e069c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.783+0000 7f6bb2200640 1 -- 172.21.15.42:0/228297342 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e0697e840 con 0x558e065d7270 2024-09-17T01:47:47.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.783+0000 7f6bb2200640 1 --2- 172.21.15.42:0/228297342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065d7270 0x558e069c66f0 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7f6ba401df80 tx=0x7f6ba4012720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2bfbff7aaabd82c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:47.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.784+0000 7f6b9d600640 1 -- 172.21.15.42:0/228297342 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba40128c0 con 0x558e065d7270 2024-09-17T01:47:47.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.784+0000 7f6b9d600640 1 -- 172.21.15.42:0/228297342 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ba4004ab0 con 0x558e065d7270 2024-09-17T01:47:47.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.784+0000 7f6b9d600640 1 -- 172.21.15.42:0/228297342 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4005020 con 0x558e065d7270 2024-09-17T01:47:47.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.784+0000 7f6bbb27c740 1 -- 172.21.15.42:0/228297342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065d7270 msgr2=0x558e069c66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:47.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.784+0000 7f6bbb27c740 1 --2- 172.21.15.42:0/228297342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065d7270 0x558e069c66f0 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7f6ba401df80 tx=0x7f6ba4012720 comp rx=0 tx=0).stop 2024-09-17T01:47:47.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.784+0000 7f6bbb27c740 1 -- 172.21.15.42:0/228297342 shutdown_connections 2024-09-17T01:47:47.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.784+0000 7f6bbb27c740 1 --2- 172.21.15.42:0/228297342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558e065b6590 0x558e069c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.785 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.784+0000 7f6bbb27c740 1 --2- 172.21.15.42:0/228297342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065d7270 0x558e069c66f0 unknown :-1 s=CLOSED pgs=2304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.784+0000 7f6bbb27c740 1 --2- 172.21.15.42:0/228297342 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558e065ae3b0 0x558e069b93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.784+0000 7f6bbb27c740 1 -- 172.21.15.42:0/228297342 >> 172.21.15.42:0/228297342 conn(0x558e065cb3c0 msgr2=0x558e069736c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:47.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.785+0000 7f6bbb27c740 1 -- 172.21.15.42:0/228297342 shutdown_connections 2024-09-17T01:47:47.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.785+0000 7f6bbb27c740 1 -- 172.21.15.42:0/228297342 wait complete. 2024-09-17T01:47:47.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.785+0000 7f6bbb27c740 1 -- start start 2024-09-17T01:47:47.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.786+0000 7f6bbb27c740 1 Processor -- start 2024-09-17T01:47:47.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.787+0000 7f6bbb27c740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065ae3b0 0x558e06a28820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:47.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.787+0000 7f6bbb27c740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558e065b6590 0x558e069a6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:47.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.787+0000 7f6bbb27c740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558e065d7270 0x558e06978e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:47.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.787+0000 7f6bbb27c740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558e0698f880 con 0x558e065ae3b0 2024-09-17T01:47:47.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.787+0000 7f6bbb27c740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558e069baa00 con 0x558e065d7270 2024-09-17T01:47:47.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.787+0000 7f6bbb27c740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558e069a54e0 con 0x558e065b6590 2024-09-17T01:47:47.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.787+0000 7f6bbb27c740 10 client.0 _ll_register_callbacks cb 0x7f6ba4003ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:47:47.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.787+0000 7f6bb1800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065ae3b0 0x558e06a28820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:47.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.787+0000 7f6bb1800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065ae3b0 0x558e06a28820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36618/0 (socket says 172.21.15.42:36618) 2024-09-17T01:47:47.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.787+0000 7f6bb1800640 1 -- 172.21.15.42:0/4085747353 learned_addr learned my addr 172.21.15.42:0/4085747353 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:47.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.788+0000 7f6bb2200640 1 --2- 172.21.15.42:0/4085747353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558e065d7270 0x558e06978e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:47.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.788+0000 7f6bb0e00640 1 --2- 172.21.15.42:0/4085747353 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558e065b6590 0x558e069a6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:47.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.788+0000 7f6bb1800640 1 -- 172.21.15.42:0/4085747353 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558e065b6590 msgr2=0x558e069a6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:47.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.788+0000 7f6bb1800640 1 --2- 172.21.15.42:0/4085747353 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558e065b6590 0x558e069a6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.788+0000 7f6bb1800640 1 -- 172.21.15.42:0/4085747353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558e065d7270 msgr2=0x558e06978e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:47.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.788+0000 7f6bb1800640 1 --2- 172.21.15.42:0/4085747353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558e065d7270 0x558e06978e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.788+0000 7f6bb1800640 1 -- 172.21.15.42:0/4085747353 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e0697cc20 con 0x558e065ae3b0 2024-09-17T01:47:47.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.788+0000 7f6bb2200640 1 --2- 172.21.15.42:0/4085747353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558e065d7270 0x558e06978e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:47:47.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.788+0000 7f6bb0e00640 1 --2- 172.21.15.42:0/4085747353 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558e065b6590 0x558e069a6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:47:47.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.788+0000 7f6bb1800640 1 --2- 172.21.15.42:0/4085747353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065ae3b0 0x558e06a28820 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0006a30 tx=0x7f6ba0006400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00341100b3ec05c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:47.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.788+0000 7f6b92a00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:47:47.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.788+0000 7f6b92a00640 1 -- 172.21.15.42:0/4085747353 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0065060 con 0x558e065ae3b0 2024-09-17T01:47:47.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.788+0000 7f6bbb27c740 1 -- 172.21.15.42:0/4085747353 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ba4004ab0 con 0x558e065ae3b0 2024-09-17T01:47:47.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.788+0000 7f6b92a00640 1 -- 172.21.15.42:0/4085747353 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(200..200 src has 1..200) ==== 5709+0+0 (secure 0 0 0) 0x7f6ba0033770 con 0x558e065ae3b0 2024-09-17T01:47:47.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.789+0000 7f6b92a00640 1 -- 172.21.15.42:0/4085747353 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=159) ==== 24+0+0 (secure 0 0 0) 0x7f6ba006b050 con 0x558e065ae3b0 2024-09-17T01:47:47.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.789+0000 7f6bbb27c740 10 client.10929 fetch_fsmap learned FSMap version 159 2024-09-17T01:47:47.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.789+0000 7f6bbb27c740 1 -- 172.21.15.42:0/4085747353 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=159,monmap=2+}) -- 0x558e06a439d0 con 0x558e065ae3b0 2024-09-17T01:47:47.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.789+0000 7f6b92a00640 1 -- 172.21.15.42:0/4085747353 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ba4004ab0 con 0x558e065ae3b0 2024-09-17T01:47:47.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.789+0000 7f6b92a00640 1 -- 172.21.15.42:0/4085747353 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 159) ==== 3502+0+0 (secure 0 0 0) 0x7f6ba006e020 con 0x558e065ae3b0 2024-09-17T01:47:47.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.789+0000 7f6bbb27c740 10 client.10929 fetch_fsmap finished waiting for FSMap version 159 2024-09-17T01:47:47.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.789+0000 7f6bbb27c740 10 client.10929 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T01:47:47.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.789+0000 7f6bbb27c740 20 client.10929 populate_metadata read hostname 'smithi042' 2024-09-17T01:47:47.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.789+0000 7f6bbb27c740 1 --2- 172.21.15.42:0/4085747353 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x558e069a10a0 0x558e069a54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:47.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.789+0000 7f6bbb27c740 4 client.10929 mds_command: new command op to 10776 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T01:47:47.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.789+0000 7f6bbb27c740 1 -- 172.21.15.42:0/4085747353 --> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] -- command(tid 0: {"prefix": "status"}) -- 0x558e0699ef40 con 0x558e069a10a0 2024-09-17T01:47:47.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.789+0000 7f6bb0e00640 1 --2- 172.21.15.42:0/4085747353 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x558e069a10a0 0x558e069a54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:47.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.790+0000 7f6bb0e00640 1 --2- 172.21.15.42:0/4085747353 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x558e069a10a0 0x558e069a54e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=654479484fdc96ee server_cookie=50525c2d5cfb46a4 in_seq=0 out_seq=0 2024-09-17T01:47:47.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.790+0000 7f6b92a00640 10 client.10929 ms_handle_connect on v2:172.21.15.42:6832/3836210591 2024-09-17T01:47:47.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.790+0000 7f6b92a00640 1 -- 172.21.15.42:0/4085747353 <== mds.0 v2:172.21.15.42:6832/3836210591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+335 (crc 0 0 0) 0x558e0699ef40 con 0x558e069a10a0 2024-09-17T01:47:47.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.790+0000 7f6b92a00640 10 client.10929 handle_command_reply: tid=0 2024-09-17T01:47:47.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.790+0000 7f6bbb27c740 1 client.10929 shutdown 2024-09-17T01:47:47.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.790+0000 7f6bbb27c740 1 -- 172.21.15.42:0/4085747353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065ae3b0 msgr2=0x558e06a28820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:47.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.790+0000 7f6bbb27c740 1 --2- 172.21.15.42:0/4085747353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065ae3b0 0x558e06a28820 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0006a30 tx=0x7f6ba0006400 comp rx=0 tx=0).stop 2024-09-17T01:47:47.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.790+0000 7f6bbb27c740 1 -- 172.21.15.42:0/4085747353 shutdown_connections 2024-09-17T01:47:47.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.790+0000 7f6bbb27c740 1 --2- 172.21.15.42:0/4085747353 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x558e069a10a0 0x558e069a54e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.790+0000 7f6bbb27c740 1 --2- 172.21.15.42:0/4085747353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558e065d7270 0x558e06978e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.790+0000 7f6bbb27c740 1 --2- 172.21.15.42:0/4085747353 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558e065b6590 0x558e069a6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.790+0000 7f6b92a00640 0 client.10929 ms_handle_reset on v2:172.21.15.42:6832/3836210591 2024-09-17T01:47:47.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.790+0000 7f6bbb27c740 1 --2- 172.21.15.42:0/4085747353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558e065ae3b0 0x558e06a28820 unknown :-1 s=CLOSED pgs=2305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.790+0000 7f6bbb27c740 1 -- 172.21.15.42:0/4085747353 >> 172.21.15.42:0/4085747353 conn(0x558e065cb3c0 msgr2=0x558e069b93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:47.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.791+0000 7f6bbb27c740 1 -- 172.21.15.42:0/4085747353 shutdown_connections 2024-09-17T01:47:47.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.791+0000 7f6bbb27c740 1 -- 172.21.15.42:0/4085747353 wait complete. 2024-09-17T01:47:47.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.791+0000 7f6bbb27c740 20 client.10929 trim_cache size 0 max 16384 2024-09-17T01:47:47.794 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:47:47.794 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "fea1c88c-cb05-432f-a745-f9dcbb5f2503", 2024-09-17T01:47:47.795 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-17T01:47:47.795 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 10776, 2024-09-17T01:47:47.795 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-17T01:47:47.795 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-17T01:47:47.795 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-17T01:47:47.795 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 11.784885854000001, 2024-09-17T01:47:47.795 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 159, 2024-09-17T01:47:47.795 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 200, 2024-09-17T01:47:47.795 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 200, 2024-09-17T01:47:47.795 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 16.753745596000002 2024-09-17T01:47:47.795 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:47:47.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.791+0000 7f6bb2c00640 1 -- 172.21.15.42:0/2891052047 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6b8c078bc0 msgr2=0x7f6b8c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:47.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.791+0000 7f6bb2c00640 1 --2- 172.21.15.42:0/2891052047 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6b8c078bc0 0x7f6b8c07b0d0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0032000 tx=0x7f6ba0001360 comp rx=0 tx=0).stop 2024-09-17T01:47:47.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.791+0000 7f6bb2c00640 1 -- 172.21.15.42:0/2891052047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bac0ca960 msgr2=0x7f6bac0b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:47.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.791+0000 7f6bb2c00640 1 --2- 172.21.15.42:0/2891052047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bac0ca960 0x7f6bac0b8d90 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7f6b98001a00 tx=0x7f6b98003a80 comp rx=0 tx=0).stop 2024-09-17T01:47:47.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.792+0000 7f6bb2c00640 1 -- 172.21.15.42:0/2891052047 shutdown_connections 2024-09-17T01:47:47.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.792+0000 7f6bb2c00640 1 --2- 172.21.15.42:0/2891052047 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6b8c078bc0 0x7f6b8c07b0d0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.792+0000 7f6bb2c00640 1 --2- 172.21.15.42:0/2891052047 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bac1f6680 0x7f6bac1f6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.792+0000 7f6bb2c00640 1 --2- 172.21.15.42:0/2891052047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bac0ca960 0x7f6bac0b8d90 unknown :-1 s=CLOSED pgs=2301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.792+0000 7f6bb2c00640 1 --2- 172.21.15.42:0/2891052047 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b94003c10 0x7f6bac0cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:47.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.792+0000 7f6bb2c00640 1 -- 172.21.15.42:0/2891052047 >> 172.21.15.42:0/2891052047 conn(0x7f6bac0d1210 msgr2=0x7f6bac0b52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:47.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.792+0000 7f6bb2c00640 1 -- 172.21.15.42:0/2891052047 shutdown_connections 2024-09-17T01:47:47.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:47.792+0000 7f6bb2c00640 1 -- 172.21.15.42:0/2891052047 wait complete. 2024-09-17T01:47:47.817 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T01:47:48.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.046+0000 7f6bf8a00640 1 -- 172.21.15.42:0/2490421842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bf4162fa0 msgr2=0x7f6bf415e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:48.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.046+0000 7f6bf8a00640 1 --2- 172.21.15.42:0/2490421842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bf4162fa0 0x7f6bf415e910 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc005fd0 tx=0x7f6bdc02a540 comp rx=0 tx=0).stop 2024-09-17T01:47:48.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.046+0000 7f6bf8a00640 1 -- 172.21.15.42:0/2490421842 shutdown_connections 2024-09-17T01:47:48.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.046+0000 7f6bf8a00640 1 --2- 172.21.15.42:0/2490421842 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bf4162fa0 0x7f6bf415e910 unknown :-1 s=CLOSED pgs=2306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:48.045 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.046+0000 7f6bf8a00640 1 --2- 172.21.15.42:0/2490421842 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6bf4073340 0x7f6bf40d2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:48.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.046+0000 7f6bf8a00640 1 -- 172.21.15.42:0/2490421842 >> 172.21.15.42:0/2490421842 conn(0x7f6bf40d1210 msgr2=0x7f6bf40d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:48.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.046+0000 7f6bf8a00640 1 -- 172.21.15.42:0/2490421842 shutdown_connections 2024-09-17T01:47:48.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.046+0000 7f6bf8a00640 1 -- 172.21.15.42:0/2490421842 wait complete. 2024-09-17T01:47:48.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.048+0000 7f6bf8a00640 1 Processor -- start 2024-09-17T01:47:48.047 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.048+0000 7f6bf8a00640 1 -- start start 2024-09-17T01:47:48.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.050+0000 7f6bf8a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6bf4073340 0x7f6bf414d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:48.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.050+0000 7f6bf8a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bf40b6030 0x7f6bf40cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:48.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.050+0000 7f6bf8a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bf4162fa0 0x7f6bf4161660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:48.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.050+0000 7f6bf8a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf415f880 con 0x7f6bf40b6030 2024-09-17T01:47:48.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.050+0000 7f6bf8a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf415f700 con 0x7f6bf4162fa0 2024-09-17T01:47:48.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.050+0000 7f6bf8a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6bf415fa00 con 0x7f6bf4073340 2024-09-17T01:47:48.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.050+0000 7f6bebe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bf40b6030 0x7f6bf40cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:48.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.050+0000 7f6bebe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bf40b6030 0x7f6bf40cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36628/0 (socket says 172.21.15.42:36628) 2024-09-17T01:47:48.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.050+0000 7f6bebe00640 1 -- 172.21.15.42:0/2274490488 learned_addr learned my addr 172.21.15.42:0/2274490488 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:48.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.050+0000 7f6bf2800640 1 --2- 172.21.15.42:0/2274490488 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6bf4073340 0x7f6bf414d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:48.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.050+0000 7f6bf3200640 1 --2- 172.21.15.42:0/2274490488 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bf4162fa0 0x7f6bf4161660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:48.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.050+0000 7f6bebe00640 1 -- 172.21.15.42:0/2274490488 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6bf4073340 msgr2=0x7f6bf414d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:48.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.050+0000 7f6bebe00640 1 --2- 172.21.15.42:0/2274490488 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6bf4073340 0x7f6bf414d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:48.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.050+0000 7f6bebe00640 1 -- 172.21.15.42:0/2274490488 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bf4162fa0 msgr2=0x7f6bf4161660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:48.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.050+0000 7f6bebe00640 1 --2- 172.21.15.42:0/2274490488 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bf4162fa0 0x7f6bf4161660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:48.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.050+0000 7f6bebe00640 1 -- 172.21.15.42:0/2274490488 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf414d970 con 0x7f6bf40b6030 2024-09-17T01:47:48.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.050+0000 7f6bf3200640 1 --2- 172.21.15.42:0/2274490488 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bf4162fa0 0x7f6bf4161660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:47:48.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.051+0000 7f6bebe00640 1 --2- 172.21.15.42:0/2274490488 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bf40b6030 0x7f6bf40cfa40 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc034040 tx=0x7f6bdc0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:48.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.051+0000 7f6beaa00640 1 -- 172.21.15.42:0/2274490488 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc03e030 con 0x7f6bf40b6030 2024-09-17T01:47:48.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.051+0000 7f6beaa00640 1 -- 172.21.15.42:0/2274490488 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6bdc003d90 con 0x7f6bf40b6030 2024-09-17T01:47:48.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.051+0000 7f6beaa00640 1 -- 172.21.15.42:0/2274490488 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc035040 con 0x7f6bf40b6030 2024-09-17T01:47:48.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.051+0000 7f6bf8a00640 1 -- 172.21.15.42:0/2274490488 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bf414dc50 con 0x7f6bf40b6030 2024-09-17T01:47:48.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.051+0000 7f6bf8a00640 1 -- 172.21.15.42:0/2274490488 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bf414e210 con 0x7f6bf40b6030 2024-09-17T01:47:48.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.052+0000 7f6bf8a00640 1 -- 172.21.15.42:0/2274490488 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bf415feb0 con 0x7f6bf40b6030 2024-09-17T01:47:48.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.053+0000 7f6beaa00640 1 -- 172.21.15.42:0/2274490488 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6bdc041030 con 0x7f6bf40b6030 2024-09-17T01:47:48.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.054+0000 7f6beaa00640 1 --2- 172.21.15.42:0/2274490488 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6bd0078b90 0x7f6bd007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:48.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.054+0000 7f6beaa00640 1 -- 172.21.15.42:0/2274490488 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5709+0+0 (secure 0 0 0) 0x7f6bdc0bb960 con 0x7f6bf40b6030 2024-09-17T01:47:48.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.055+0000 7f6bf2800640 1 --2- 172.21.15.42:0/2274490488 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6bd0078b90 0x7f6bd007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:48.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.056+0000 7f6bf2800640 1 --2- 172.21.15.42:0/2274490488 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6bd0078b90 0x7f6bd007b0a0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f6be4005fd0 tx=0x7f6be4005850 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:48.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.059+0000 7f6beaa00640 1 -- 172.21.15.42:0/2274490488 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6bdc083d00 con 0x7f6bf40b6030 2024-09-17T01:47:48.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.291+0000 7f6bf8a00640 1 -- 172.21.15.42:0/2274490488 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6bf415ebd0 con 0x7f6bf40b6030 2024-09-17T01:47:48.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.292+0000 7f6beaa00640 1 -- 172.21.15.42:0/2274490488 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v159) ==== 53+0+73 (secure 0 0 0) 0x7f6bdc083600 con 0x7f6bf40b6030 2024-09-17T01:47:48.291 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T01:47:48.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.294+0000 7f6bf8a00640 1 -- 172.21.15.42:0/2274490488 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6bd0078b90 msgr2=0x7f6bd007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:48.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.294+0000 7f6bf8a00640 1 --2- 172.21.15.42:0/2274490488 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6bd0078b90 0x7f6bd007b0a0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f6be4005fd0 tx=0x7f6be4005850 comp rx=0 tx=0).stop 2024-09-17T01:47:48.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.294+0000 7f6bf8a00640 1 -- 172.21.15.42:0/2274490488 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bf40b6030 msgr2=0x7f6bf40cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:48.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.294+0000 7f6bf8a00640 1 --2- 172.21.15.42:0/2274490488 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bf40b6030 0x7f6bf40cfa40 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc034040 tx=0x7f6bdc0038a0 comp rx=0 tx=0).stop 2024-09-17T01:47:48.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.294+0000 7f6bf8a00640 1 -- 172.21.15.42:0/2274490488 shutdown_connections 2024-09-17T01:47:48.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.294+0000 7f6bf8a00640 1 --2- 172.21.15.42:0/2274490488 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6bd0078b90 0x7f6bd007b0a0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:48.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.294+0000 7f6bf8a00640 1 --2- 172.21.15.42:0/2274490488 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bf4162fa0 0x7f6bf4161660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:48.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.294+0000 7f6bf8a00640 1 --2- 172.21.15.42:0/2274490488 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6bf40b6030 0x7f6bf40cfa40 unknown :-1 s=CLOSED pgs=2307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:48.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.294+0000 7f6bf8a00640 1 --2- 172.21.15.42:0/2274490488 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6bf4073340 0x7f6bf414d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:48.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.294+0000 7f6bf8a00640 1 -- 172.21.15.42:0/2274490488 >> 172.21.15.42:0/2274490488 conn(0x7f6bf40d1210 msgr2=0x7f6bf40d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:48.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.294+0000 7f6bf8a00640 1 -- 172.21.15.42:0/2274490488 shutdown_connections 2024-09-17T01:47:48.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48.294+0000 7f6bf8a00640 1 -- 172.21.15.42:0/2274490488 wait complete. 2024-09-17T01:47:48.315 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T01:47:48.315 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:47:48.316 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-09-17T01:47:48.316 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T01:47:48.316 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:47:48.316 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T01:47:48.316 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T01:47:48.316 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:47:48.316 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:47:48.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:47:48.316 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-09-17T01:47:48.352 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:47:48.352 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:47:48.352 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:47:48.352 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:47:48.352 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-17T01:47:48.353 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:47:48.353 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:47:48.353 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-09-17T01:47:48.353 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-09-17T01:47:48.353 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:47:48.353 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-09-17T01:47:48.353 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-09-17T01:47:48.353 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:47:48.353 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:47:48.353 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-09-17T01:47:48.353 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-17T01:47:48.353 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 41739sec preferred_lft 41739sec 2024-09-17T01:47:48.353 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-17T01:47:48.354 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:47:48.354 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:47:48.354 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:47:48.354 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-09-17T01:47:48.354 INFO:teuthology.orchestra.run.smithi042.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T01:47:48.354 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T01:47:48.354 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T01:47:48.354 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:47:48.354 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::68d2:2bff:fe2f:191a/64 scope link 2024-09-17T01:47:48.354 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:47:48.354 INFO:teuthology.orchestra.run.smithi042.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:47:48.354 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether e2:73:3e:9b:8a:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:47:48.354 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::e073:3eff:fe9b:8a00/64 scope link 2024-09-17T01:47:48.355 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:47:48.355 INFO:teuthology.orchestra.run.smithi042.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:47:48.355 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T01:47:48.355 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::240b:bfff:feb7:6e5b/64 scope link 2024-09-17T01:47:48.355 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:47:48.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:47:48.355 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:47:48.446 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-17T01:47:48.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:47:48.449 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-09-17T01:47:48.485 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-09-17T01:47:48.485 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:47:48.485 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-17T01:47:48.485 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-17T01:47:48.485 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:47:48.486 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:47:48.486 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:47:48.486 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T01:47:48.486 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T01:47:48.486 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T01:47:48.486 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:47:48.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:47:48.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:47:48.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:47:48.685 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-17T01:47:48.720 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T01:47:48.721 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T01:47:48.721 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:47:48.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:47:48.721 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-09-17T01:47:48.817 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:47:48.817 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T01:47:48.852 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:47:48.853 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:47:48.853 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:47:48.927 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T01:47:48.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:47:48.928 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:47:49.125 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:47:49.125 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:47:49.125 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:47:49.145 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:47:49.146 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:47:49.146 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:47:49.146 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:47:49.146 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:47:49.177 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:47:49.178 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:47:49.178 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:47:49.178 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:47:49.178 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:47:49.178 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-09-17T01:47:49.178 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-09-17T01:47:49.178 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fea1c88c-cb05-432f-a745-f9dcbb5f2503" will pass to kernel 2024-09-17T01:47:49.179 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T01:47:49.179 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-09-17T01:47:49.179 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T01:47:49.180 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T01:47:49.180 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T01:47:49.182 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T01:47:49.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:47:49.183 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:47:49.239 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:47:49.320 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:47:49.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:47:49.336 INFO:teuthology.orchestra.run.smithi042.stdout:client10159 2024-09-17T01:47:49.337 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:47:49.337 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:47:49.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:47:49.373 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-17T01:47:49.455 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:47:49.455 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:47:49.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:47:49.530 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=subdir/sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-09-17T01:47:49.693 INFO:teuthology.orchestra.run.smithi042.stderr:6+0 records in 2024-09-17T01:47:49.693 INFO:teuthology.orchestra.run.smithi042.stderr:6+0 records out 2024-09-17T01:47:49.693 INFO:teuthology.orchestra.run.smithi042.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0852611 s, 73.8 MB/s 2024-09-17T01:47:49.695 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T01:47:49.699 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T01:47:49.794 INFO:teuthology.orchestra.run.smithi042.stdout:[global] 2024-09-17T01:47:49.794 INFO:teuthology.orchestra.run.smithi042.stdout: chdir = "" 2024-09-17T01:47:49.795 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T01:47:49.795 INFO:teuthology.orchestra.run.smithi042.stdout: auth supported = cephx 2024-09-17T01:47:49.795 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.795 INFO:teuthology.orchestra.run.smithi042.stdout: filestore xattr use omap = true 2024-09-17T01:47:49.795 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.795 INFO:teuthology.orchestra.run.smithi042.stdout: mon clock drift allowed = 1.000 2024-09-17T01:47:49.795 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.795 INFO:teuthology.orchestra.run.smithi042.stdout: osd crush chooseleaf type = 0 2024-09-17T01:47:49.795 INFO:teuthology.orchestra.run.smithi042.stdout: auth debug = true 2024-09-17T01:47:49.795 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.795 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on old message = true 2024-09-17T01:47:49.795 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on bug = true 2024-09-17T01:47:49.796 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.796 INFO:teuthology.orchestra.run.smithi042.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T01:47:49.796 INFO:teuthology.orchestra.run.smithi042.stdout: mon pg warn max object skew = 0 2024-09-17T01:47:49.796 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.796 INFO:teuthology.orchestra.run.smithi042.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T01:47:49.796 INFO:teuthology.orchestra.run.smithi042.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T01:47:49.796 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.796 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default size = 2 2024-09-17T01:47:49.796 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.796 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow primary affinity = true 2024-09-17T01:47:49.796 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow pg remap = true 2024-09-17T01:47:49.796 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on legacy crush tunables = false 2024-09-17T01:47:49.797 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on crush straw calc version zero = false 2024-09-17T01:47:49.797 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on no sortbitwise = false 2024-09-17T01:47:49.797 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on osd down out interval zero = false 2024-09-17T01:47:49.797 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on too few osds = false 2024-09-17T01:47:49.797 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T01:47:49.797 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T01:47:49.797 INFO:teuthology.orchestra.run.smithi042.stdout: mon_allow_pool_size_one = true 2024-09-17T01:47:49.797 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.797 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T01:47:49.797 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.797 INFO:teuthology.orchestra.run.smithi042.stdout: osd default data pool replay window = 5 2024-09-17T01:47:49.797 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.797 INFO:teuthology.orchestra.run.smithi042.stdout: mon allow pool delete = true 2024-09-17T01:47:49.798 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.798 INFO:teuthology.orchestra.run.smithi042.stdout: mon cluster log file level = debug 2024-09-17T01:47:49.798 INFO:teuthology.orchestra.run.smithi042.stdout: debug asserts on shutdown = true 2024-09-17T01:47:49.798 INFO:teuthology.orchestra.run.smithi042.stdout: mon health detail to clog = false 2024-09-17T01:47:49.798 INFO:teuthology.orchestra.run.smithi042.stdout: mon host = "172.21.15.42,172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790]" 2024-09-17T01:47:49.798 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on skipped message = False 2024-09-17T01:47:49.798 INFO:teuthology.orchestra.run.smithi042.stdout: fsid = fea1c88c-cb05-432f-a745-f9dcbb5f2503 2024-09-17T01:47:49.798 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.798 INFO:teuthology.orchestra.run.smithi042.stdout:[osd] 2024-09-17T01:47:49.798 INFO:teuthology.orchestra.run.smithi042.stdout: osd journal size = 100 2024-09-17T01:47:49.798 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.798 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub load threshold = 5.0 2024-09-17T01:47:49.798 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub max interval = 600 2024-09-17T01:47:49.799 INFO:teuthology.orchestra.run.smithi042.stdout: osd mclock profile = high_recovery_ops 2024-09-17T01:47:49.799 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.799 INFO:teuthology.orchestra.run.smithi042.stdout: osd recover clone overlap = true 2024-09-17T01:47:49.799 INFO:teuthology.orchestra.run.smithi042.stdout: osd recovery max chunk = 1048576 2024-09-17T01:47:49.799 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.799 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug shutdown = true 2024-09-17T01:47:49.799 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug op order = true 2024-09-17T01:47:49.799 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug verify stray on activate = true 2024-09-17T01:47:49.800 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug trim objects = true 2024-09-17T01:47:49.800 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.800 INFO:teuthology.orchestra.run.smithi042.stdout: osd open classes on start = true 2024-09-17T01:47:49.800 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug pg log writeout = true 2024-09-17T01:47:49.800 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.800 INFO:teuthology.orchestra.run.smithi042.stdout: osd deep scrub update digest min age = 30 2024-09-17T01:47:49.800 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.800 INFO:teuthology.orchestra.run.smithi042.stdout: osd map max advance = 10 2024-09-17T01:47:49.800 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.800 INFO:teuthology.orchestra.run.smithi042.stdout: journal zero on create = true 2024-09-17T01:47:49.800 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.800 INFO:teuthology.orchestra.run.smithi042.stdout: filestore ondisk finisher threads = 3 2024-09-17T01:47:49.800 INFO:teuthology.orchestra.run.smithi042.stdout: filestore apply finisher threads = 3 2024-09-17T01:47:49.801 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.801 INFO:teuthology.orchestra.run.smithi042.stdout: bdev debug aio = true 2024-09-17T01:47:49.801 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug misdirected ops = true 2024-09-17T01:47:49.801 INFO:teuthology.orchestra.run.smithi042.stdout: bdev async discard = True 2024-09-17T01:47:49.801 INFO:teuthology.orchestra.run.smithi042.stdout: bdev enable discard = True 2024-09-17T01:47:49.801 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore allocator = bitmap 2024-09-17T01:47:49.801 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore block size = 96636764160 2024-09-17T01:47:49.801 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore fsck on mount = True 2024-09-17T01:47:49.801 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluefs = 1/20 2024-09-17T01:47:49.802 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluestore = 1/20 2024-09-17T01:47:49.802 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-17T01:47:49.802 INFO:teuthology.orchestra.run.smithi042.stdout: debug osd = 20 2024-09-17T01:47:49.802 INFO:teuthology.orchestra.run.smithi042.stdout: debug rocksdb = 4/10 2024-09-17T01:47:49.802 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T01:47:49.802 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd full ratio = 0.9 2024-09-17T01:47:49.802 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd nearfull ratio = 0.8 2024-09-17T01:47:49.802 INFO:teuthology.orchestra.run.smithi042.stdout: osd failsafe full ratio = 0.95 2024-09-17T01:47:49.802 INFO:teuthology.orchestra.run.smithi042.stdout: osd objectstore = bluestore 2024-09-17T01:47:49.802 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.802 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr] 2024-09-17T01:47:49.802 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-17T01:47:49.802 INFO:teuthology.orchestra.run.smithi042.stdout: debug mgr = 20 2024-09-17T01:47:49.802 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-09-17T01:47:49.803 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-09-17T01:47:49.803 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:47:49.803 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:47:49.803 INFO:teuthology.orchestra.run.smithi042.stdout: mgr/telemetry/nag = false 2024-09-17T01:47:49.803 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.803 INFO:teuthology.orchestra.run.smithi042.stdout:[mon] 2024-09-17T01:47:49.803 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-17T01:47:49.803 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-09-17T01:47:49.804 INFO:teuthology.orchestra.run.smithi042.stdout: debug paxos = 20 2024-09-17T01:47:49.804 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-09-17T01:47:49.804 INFO:teuthology.orchestra.run.smithi042.stdout: mon data avail warn = 5 2024-09-17T01:47:49.804 INFO:teuthology.orchestra.run.smithi042.stdout: mon mgr mkfs grace = 240 2024-09-17T01:47:49.804 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:47:49.804 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd reporter subtree level = osd 2024-09-17T01:47:49.804 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd prime pg temp = true 2024-09-17T01:47:49.804 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:47:49.804 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.804 INFO:teuthology.orchestra.run.smithi042.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T01:47:49.804 INFO:teuthology.orchestra.run.smithi042.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T01:47:49.805 INFO:teuthology.orchestra.run.smithi042.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T01:47:49.805 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.805 INFO:teuthology.orchestra.run.smithi042.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T01:47:49.805 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T01:47:49.805 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T01:47:49.805 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.805 INFO:teuthology.orchestra.run.smithi042.stdout: # 1m isn't quite enough 2024-09-17T01:47:49.805 INFO:teuthology.orchestra.run.smithi042.stdout: mon_down_mkfs_grace = 2m 2024-09-17T01:47:49.805 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.805 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_filestore_osds = false 2024-09-17T01:47:49.805 INFO:teuthology.orchestra.run.smithi042.stdout: mon down mkfs grace = 300 2024-09-17T01:47:49.805 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.806 INFO:teuthology.orchestra.run.smithi042.stdout:[client] 2024-09-17T01:47:49.806 INFO:teuthology.orchestra.run.smithi042.stdout: rgw cache enabled = true 2024-09-17T01:47:49.806 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable ops log = true 2024-09-17T01:47:49.806 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable usage log = true 2024-09-17T01:47:49.806 INFO:teuthology.orchestra.run.smithi042.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T01:47:49.806 INFO:teuthology.orchestra.run.smithi042.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T01:47:49.806 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = "" 2024-09-17T01:47:49.806 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.a] 2024-09-17T01:47:49.806 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.b] 2024-09-17T01:47:49.806 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.c] 2024-09-17T01:47:49.806 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.a] 2024-09-17T01:47:49.806 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.c] 2024-09-17T01:47:49.806 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.b] 2024-09-17T01:47:49.807 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.d] 2024-09-17T01:47:49.807 INFO:teuthology.orchestra.run.smithi042.stdout:[mds] 2024-09-17T01:47:49.807 INFO:teuthology.orchestra.run.smithi042.stdout: mds cache max size = 1000 2024-09-17T01:47:49.807 INFO:teuthology.orchestra.run.smithi042.stdout: mds log max segments = 1 2024-09-17T01:47:49.807 INFO:teuthology.orchestra.run.smithi042.stdout: mds verify scatter = False 2024-09-17T01:47:49.807 INFO:teuthology.orchestra.run.smithi043.stdout:[global] 2024-09-17T01:47:49.807 INFO:teuthology.orchestra.run.smithi043.stdout: chdir = "" 2024-09-17T01:47:49.807 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T01:47:49.807 INFO:teuthology.orchestra.run.smithi043.stdout: auth supported = cephx 2024-09-17T01:47:49.807 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.808 INFO:teuthology.orchestra.run.smithi043.stdout: filestore xattr use omap = true 2024-09-17T01:47:49.808 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.808 INFO:teuthology.orchestra.run.smithi043.stdout: mon clock drift allowed = 1.000 2024-09-17T01:47:49.808 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.808 INFO:teuthology.orchestra.run.smithi043.stdout: osd crush chooseleaf type = 0 2024-09-17T01:47:49.808 INFO:teuthology.orchestra.run.smithi043.stdout: auth debug = true 2024-09-17T01:47:49.808 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.808 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on old message = true 2024-09-17T01:47:49.808 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on bug = true 2024-09-17T01:47:49.808 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.808 INFO:teuthology.orchestra.run.smithi043.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T01:47:49.809 INFO:teuthology.orchestra.run.smithi043.stdout: mon pg warn max object skew = 0 2024-09-17T01:47:49.809 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.809 INFO:teuthology.orchestra.run.smithi043.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T01:47:49.809 INFO:teuthology.orchestra.run.smithi043.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T01:47:49.809 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.809 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default size = 2 2024-09-17T01:47:49.809 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.809 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow primary affinity = true 2024-09-17T01:47:49.809 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow pg remap = true 2024-09-17T01:47:49.809 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on legacy crush tunables = false 2024-09-17T01:47:49.809 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on crush straw calc version zero = false 2024-09-17T01:47:49.809 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on no sortbitwise = false 2024-09-17T01:47:49.809 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on osd down out interval zero = false 2024-09-17T01:47:49.810 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on too few osds = false 2024-09-17T01:47:49.810 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T01:47:49.810 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T01:47:49.810 INFO:teuthology.orchestra.run.smithi043.stdout: mon_allow_pool_size_one = true 2024-09-17T01:47:49.810 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.810 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T01:47:49.810 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.810 INFO:teuthology.orchestra.run.smithi043.stdout: osd default data pool replay window = 5 2024-09-17T01:47:49.810 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.811 INFO:teuthology.orchestra.run.smithi043.stdout: mon allow pool delete = true 2024-09-17T01:47:49.811 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.811 INFO:teuthology.orchestra.run.smithi043.stdout: mon cluster log file level = debug 2024-09-17T01:47:49.811 INFO:teuthology.orchestra.run.smithi043.stdout: debug asserts on shutdown = true 2024-09-17T01:47:49.811 INFO:teuthology.orchestra.run.smithi043.stdout: mon health detail to clog = false 2024-09-17T01:47:49.811 INFO:teuthology.orchestra.run.smithi043.stdout: mon host = "172.21.15.42,172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790]" 2024-09-17T01:47:49.811 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on skipped message = False 2024-09-17T01:47:49.811 INFO:teuthology.orchestra.run.smithi043.stdout: fsid = fea1c88c-cb05-432f-a745-f9dcbb5f2503 2024-09-17T01:47:49.811 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.811 INFO:teuthology.orchestra.run.smithi043.stdout:[osd] 2024-09-17T01:47:49.811 INFO:teuthology.orchestra.run.smithi043.stdout: osd journal size = 100 2024-09-17T01:47:49.811 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.812 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub load threshold = 5.0 2024-09-17T01:47:49.812 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub max interval = 600 2024-09-17T01:47:49.812 INFO:teuthology.orchestra.run.smithi043.stdout: osd mclock profile = high_recovery_ops 2024-09-17T01:47:49.812 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.812 INFO:teuthology.orchestra.run.smithi043.stdout: osd recover clone overlap = true 2024-09-17T01:47:49.812 INFO:teuthology.orchestra.run.smithi043.stdout: osd recovery max chunk = 1048576 2024-09-17T01:47:49.812 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.812 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug shutdown = true 2024-09-17T01:47:49.812 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug op order = true 2024-09-17T01:47:49.812 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug verify stray on activate = true 2024-09-17T01:47:49.812 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug trim objects = true 2024-09-17T01:47:49.812 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.813 INFO:teuthology.orchestra.run.smithi043.stdout: osd open classes on start = true 2024-09-17T01:47:49.813 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug pg log writeout = true 2024-09-17T01:47:49.813 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.813 INFO:teuthology.orchestra.run.smithi043.stdout: osd deep scrub update digest min age = 30 2024-09-17T01:47:49.813 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.813 INFO:teuthology.orchestra.run.smithi043.stdout: osd map max advance = 10 2024-09-17T01:47:49.813 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.813 INFO:teuthology.orchestra.run.smithi043.stdout: journal zero on create = true 2024-09-17T01:47:49.813 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.813 INFO:teuthology.orchestra.run.smithi043.stdout: filestore ondisk finisher threads = 3 2024-09-17T01:47:49.813 INFO:teuthology.orchestra.run.smithi043.stdout: filestore apply finisher threads = 3 2024-09-17T01:47:49.813 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.813 INFO:teuthology.orchestra.run.smithi043.stdout: bdev debug aio = true 2024-09-17T01:47:49.814 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug misdirected ops = true 2024-09-17T01:47:49.814 INFO:teuthology.orchestra.run.smithi043.stdout: bdev async discard = True 2024-09-17T01:47:49.814 INFO:teuthology.orchestra.run.smithi043.stdout: bdev enable discard = True 2024-09-17T01:47:49.814 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore allocator = bitmap 2024-09-17T01:47:49.814 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore block size = 96636764160 2024-09-17T01:47:49.814 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore fsck on mount = True 2024-09-17T01:47:49.814 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluefs = 1/20 2024-09-17T01:47:49.814 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluestore = 1/20 2024-09-17T01:47:49.814 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-17T01:47:49.814 INFO:teuthology.orchestra.run.smithi043.stdout: debug osd = 20 2024-09-17T01:47:49.814 INFO:teuthology.orchestra.run.smithi043.stdout: debug rocksdb = 4/10 2024-09-17T01:47:49.814 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T01:47:49.814 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd full ratio = 0.9 2024-09-17T01:47:49.814 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd nearfull ratio = 0.8 2024-09-17T01:47:49.815 INFO:teuthology.orchestra.run.smithi043.stdout: osd failsafe full ratio = 0.95 2024-09-17T01:47:49.815 INFO:teuthology.orchestra.run.smithi043.stdout: osd objectstore = bluestore 2024-09-17T01:47:49.815 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.815 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr] 2024-09-17T01:47:49.815 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-17T01:47:49.815 INFO:teuthology.orchestra.run.smithi043.stdout: debug mgr = 20 2024-09-17T01:47:49.815 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-09-17T01:47:49.815 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-09-17T01:47:49.815 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:47:49.815 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:47:49.815 INFO:teuthology.orchestra.run.smithi043.stdout: mgr/telemetry/nag = false 2024-09-17T01:47:49.815 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.815 INFO:teuthology.orchestra.run.smithi043.stdout:[mon] 2024-09-17T01:47:49.816 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-17T01:47:49.816 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-09-17T01:47:49.816 INFO:teuthology.orchestra.run.smithi043.stdout: debug paxos = 20 2024-09-17T01:47:49.816 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-09-17T01:47:49.816 INFO:teuthology.orchestra.run.smithi043.stdout: mon data avail warn = 5 2024-09-17T01:47:49.816 INFO:teuthology.orchestra.run.smithi043.stdout: mon mgr mkfs grace = 240 2024-09-17T01:47:49.816 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:47:49.816 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd reporter subtree level = osd 2024-09-17T01:47:49.816 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd prime pg temp = true 2024-09-17T01:47:49.816 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:47:49.817 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.817 INFO:teuthology.orchestra.run.smithi043.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T01:47:49.817 INFO:teuthology.orchestra.run.smithi043.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T01:47:49.817 INFO:teuthology.orchestra.run.smithi043.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T01:47:49.817 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.817 INFO:teuthology.orchestra.run.smithi043.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T01:47:49.817 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T01:47:49.817 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T01:47:49.817 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.817 INFO:teuthology.orchestra.run.smithi043.stdout: # 1m isn't quite enough 2024-09-17T01:47:49.817 INFO:teuthology.orchestra.run.smithi043.stdout: mon_down_mkfs_grace = 2m 2024-09-17T01:47:49.817 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.817 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_filestore_osds = false 2024-09-17T01:47:49.817 INFO:teuthology.orchestra.run.smithi043.stdout: mon down mkfs grace = 300 2024-09-17T01:47:49.818 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.818 INFO:teuthology.orchestra.run.smithi043.stdout:[client] 2024-09-17T01:47:49.818 INFO:teuthology.orchestra.run.smithi043.stdout: rgw cache enabled = true 2024-09-17T01:47:49.818 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable ops log = true 2024-09-17T01:47:49.818 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable usage log = true 2024-09-17T01:47:49.818 INFO:teuthology.orchestra.run.smithi043.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T01:47:49.818 INFO:teuthology.orchestra.run.smithi043.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T01:47:49.818 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = "" 2024-09-17T01:47:49.818 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.a] 2024-09-17T01:47:49.818 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.b] 2024-09-17T01:47:49.818 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.c] 2024-09-17T01:47:49.818 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a] 2024-09-17T01:47:49.818 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.c] 2024-09-17T01:47:49.818 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.b] 2024-09-17T01:47:49.819 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.d] 2024-09-17T01:47:49.819 INFO:teuthology.orchestra.run.smithi043.stdout:[mds] 2024-09-17T01:47:49.819 INFO:teuthology.orchestra.run.smithi043.stdout: mds cache max size = 1000 2024-09-17T01:47:49.819 INFO:teuthology.orchestra.run.smithi043.stdout: mds log max segments = 1 2024-09-17T01:47:49.819 INFO:teuthology.orchestra.run.smithi043.stdout: mds verify scatter = False 2024-09-17T01:47:49.832 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T01:47:49.837 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T01:47:49.932 INFO:teuthology.orchestra.run.smithi042.stdout:[global] 2024-09-17T01:47:49.932 INFO:teuthology.orchestra.run.smithi042.stdout: chdir = "" 2024-09-17T01:47:49.932 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T01:47:49.932 INFO:teuthology.orchestra.run.smithi042.stdout: auth supported = cephx 2024-09-17T01:47:49.932 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.932 INFO:teuthology.orchestra.run.smithi042.stdout: filestore xattr use omap = true 2024-09-17T01:47:49.932 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.932 INFO:teuthology.orchestra.run.smithi042.stdout: mon clock drift allowed = 1.000 2024-09-17T01:47:49.933 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.933 INFO:teuthology.orchestra.run.smithi042.stdout: osd crush chooseleaf type = 0 2024-09-17T01:47:49.933 INFO:teuthology.orchestra.run.smithi042.stdout: auth debug = true 2024-09-17T01:47:49.933 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.933 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on old message = true 2024-09-17T01:47:49.933 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on bug = true 2024-09-17T01:47:49.933 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.933 INFO:teuthology.orchestra.run.smithi042.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T01:47:49.933 INFO:teuthology.orchestra.run.smithi042.stdout: mon pg warn max object skew = 0 2024-09-17T01:47:49.933 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.933 INFO:teuthology.orchestra.run.smithi042.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T01:47:49.933 INFO:teuthology.orchestra.run.smithi042.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T01:47:49.933 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.934 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default size = 2 2024-09-17T01:47:49.934 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.934 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow primary affinity = true 2024-09-17T01:47:49.934 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow pg remap = true 2024-09-17T01:47:49.934 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on legacy crush tunables = false 2024-09-17T01:47:49.934 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on crush straw calc version zero = false 2024-09-17T01:47:49.934 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on no sortbitwise = false 2024-09-17T01:47:49.934 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on osd down out interval zero = false 2024-09-17T01:47:49.934 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on too few osds = false 2024-09-17T01:47:49.934 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T01:47:49.934 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T01:47:49.934 INFO:teuthology.orchestra.run.smithi042.stdout: mon_allow_pool_size_one = true 2024-09-17T01:47:49.934 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.934 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T01:47:49.935 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.935 INFO:teuthology.orchestra.run.smithi042.stdout: osd default data pool replay window = 5 2024-09-17T01:47:49.935 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.935 INFO:teuthology.orchestra.run.smithi042.stdout: mon allow pool delete = true 2024-09-17T01:47:49.935 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.935 INFO:teuthology.orchestra.run.smithi042.stdout: mon cluster log file level = debug 2024-09-17T01:47:49.935 INFO:teuthology.orchestra.run.smithi042.stdout: debug asserts on shutdown = true 2024-09-17T01:47:49.935 INFO:teuthology.orchestra.run.smithi042.stdout: mon health detail to clog = false 2024-09-17T01:47:49.935 INFO:teuthology.orchestra.run.smithi042.stdout: mon host = "172.21.15.42,172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790]" 2024-09-17T01:47:49.935 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on skipped message = False 2024-09-17T01:47:49.935 INFO:teuthology.orchestra.run.smithi042.stdout: fsid = fea1c88c-cb05-432f-a745-f9dcbb5f2503 2024-09-17T01:47:49.935 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.936 INFO:teuthology.orchestra.run.smithi042.stdout:[osd] 2024-09-17T01:47:49.936 INFO:teuthology.orchestra.run.smithi042.stdout: osd journal size = 100 2024-09-17T01:47:49.936 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.936 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub load threshold = 5.0 2024-09-17T01:47:49.936 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub max interval = 600 2024-09-17T01:47:49.936 INFO:teuthology.orchestra.run.smithi042.stdout: osd mclock profile = high_recovery_ops 2024-09-17T01:47:49.936 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.936 INFO:teuthology.orchestra.run.smithi042.stdout: osd recover clone overlap = true 2024-09-17T01:47:49.936 INFO:teuthology.orchestra.run.smithi042.stdout: osd recovery max chunk = 1048576 2024-09-17T01:47:49.936 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.936 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug shutdown = true 2024-09-17T01:47:49.936 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug op order = true 2024-09-17T01:47:49.936 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug verify stray on activate = true 2024-09-17T01:47:49.937 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug trim objects = true 2024-09-17T01:47:49.937 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.937 INFO:teuthology.orchestra.run.smithi042.stdout: osd open classes on start = true 2024-09-17T01:47:49.937 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug pg log writeout = true 2024-09-17T01:47:49.937 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.937 INFO:teuthology.orchestra.run.smithi042.stdout: osd deep scrub update digest min age = 30 2024-09-17T01:47:49.937 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.937 INFO:teuthology.orchestra.run.smithi042.stdout: osd map max advance = 10 2024-09-17T01:47:49.937 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.937 INFO:teuthology.orchestra.run.smithi042.stdout: journal zero on create = true 2024-09-17T01:47:49.938 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.938 INFO:teuthology.orchestra.run.smithi042.stdout: filestore ondisk finisher threads = 3 2024-09-17T01:47:49.938 INFO:teuthology.orchestra.run.smithi042.stdout: filestore apply finisher threads = 3 2024-09-17T01:47:49.938 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.938 INFO:teuthology.orchestra.run.smithi042.stdout: bdev debug aio = true 2024-09-17T01:47:49.938 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug misdirected ops = true 2024-09-17T01:47:49.938 INFO:teuthology.orchestra.run.smithi042.stdout: bdev async discard = True 2024-09-17T01:47:49.938 INFO:teuthology.orchestra.run.smithi042.stdout: bdev enable discard = True 2024-09-17T01:47:49.938 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore allocator = bitmap 2024-09-17T01:47:49.938 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore block size = 96636764160 2024-09-17T01:47:49.938 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore fsck on mount = True 2024-09-17T01:47:49.938 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluefs = 1/20 2024-09-17T01:47:49.939 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluestore = 1/20 2024-09-17T01:47:49.939 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-17T01:47:49.939 INFO:teuthology.orchestra.run.smithi042.stdout: debug osd = 20 2024-09-17T01:47:49.939 INFO:teuthology.orchestra.run.smithi042.stdout: debug rocksdb = 4/10 2024-09-17T01:47:49.939 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T01:47:49.939 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd full ratio = 0.9 2024-09-17T01:47:49.939 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd nearfull ratio = 0.8 2024-09-17T01:47:49.939 INFO:teuthology.orchestra.run.smithi042.stdout: osd failsafe full ratio = 0.95 2024-09-17T01:47:49.940 INFO:teuthology.orchestra.run.smithi042.stdout: osd objectstore = bluestore 2024-09-17T01:47:49.940 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.940 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr] 2024-09-17T01:47:49.940 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-17T01:47:49.940 INFO:teuthology.orchestra.run.smithi042.stdout: debug mgr = 20 2024-09-17T01:47:49.940 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-09-17T01:47:49.940 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-09-17T01:47:49.940 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:47:49.940 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:47:49.940 INFO:teuthology.orchestra.run.smithi042.stdout: mgr/telemetry/nag = false 2024-09-17T01:47:49.940 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.940 INFO:teuthology.orchestra.run.smithi042.stdout:[mon] 2024-09-17T01:47:49.941 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-17T01:47:49.941 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-09-17T01:47:49.941 INFO:teuthology.orchestra.run.smithi042.stdout: debug paxos = 20 2024-09-17T01:47:49.941 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-09-17T01:47:49.941 INFO:teuthology.orchestra.run.smithi042.stdout: mon data avail warn = 5 2024-09-17T01:47:49.941 INFO:teuthology.orchestra.run.smithi042.stdout: mon mgr mkfs grace = 240 2024-09-17T01:47:49.941 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:47:49.941 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd reporter subtree level = osd 2024-09-17T01:47:49.941 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd prime pg temp = true 2024-09-17T01:47:49.941 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:47:49.941 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.941 INFO:teuthology.orchestra.run.smithi042.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T01:47:49.941 INFO:teuthology.orchestra.run.smithi042.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T01:47:49.941 INFO:teuthology.orchestra.run.smithi042.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T01:47:49.942 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.942 INFO:teuthology.orchestra.run.smithi042.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T01:47:49.942 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T01:47:49.942 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T01:47:49.942 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.942 INFO:teuthology.orchestra.run.smithi042.stdout: # 1m isn't quite enough 2024-09-17T01:47:49.942 INFO:teuthology.orchestra.run.smithi042.stdout: mon_down_mkfs_grace = 2m 2024-09-17T01:47:49.942 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.942 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_filestore_osds = false 2024-09-17T01:47:49.942 INFO:teuthology.orchestra.run.smithi042.stdout: mon down mkfs grace = 300 2024-09-17T01:47:49.942 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:49.942 INFO:teuthology.orchestra.run.smithi042.stdout:[client] 2024-09-17T01:47:49.943 INFO:teuthology.orchestra.run.smithi042.stdout: rgw cache enabled = true 2024-09-17T01:47:49.943 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable ops log = true 2024-09-17T01:47:49.943 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable usage log = true 2024-09-17T01:47:49.943 INFO:teuthology.orchestra.run.smithi042.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T01:47:49.943 INFO:teuthology.orchestra.run.smithi042.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T01:47:49.943 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = "" 2024-09-17T01:47:49.943 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.a] 2024-09-17T01:47:49.943 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.b] 2024-09-17T01:47:49.943 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.c] 2024-09-17T01:47:49.943 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.a] 2024-09-17T01:47:49.944 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.c] 2024-09-17T01:47:49.944 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.b] 2024-09-17T01:47:49.944 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.d] 2024-09-17T01:47:49.944 INFO:teuthology.orchestra.run.smithi042.stdout:[mds] 2024-09-17T01:47:49.944 INFO:teuthology.orchestra.run.smithi042.stdout: mds cache max size = 1000 2024-09-17T01:47:49.944 INFO:teuthology.orchestra.run.smithi042.stdout: mds log max segments = 1 2024-09-17T01:47:49.944 INFO:teuthology.orchestra.run.smithi042.stdout: mds verify scatter = False 2024-09-17T01:47:49.944 INFO:teuthology.orchestra.run.smithi042.stdout: mds debug scatterstat = False 2024-09-17T01:47:49.944 INFO:teuthology.orchestra.run.smithi043.stdout:[global] 2024-09-17T01:47:49.945 INFO:teuthology.orchestra.run.smithi043.stdout: chdir = "" 2024-09-17T01:47:49.945 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T01:47:49.945 INFO:teuthology.orchestra.run.smithi043.stdout: auth supported = cephx 2024-09-17T01:47:49.945 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.945 INFO:teuthology.orchestra.run.smithi043.stdout: filestore xattr use omap = true 2024-09-17T01:47:49.945 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.945 INFO:teuthology.orchestra.run.smithi043.stdout: mon clock drift allowed = 1.000 2024-09-17T01:47:49.945 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.945 INFO:teuthology.orchestra.run.smithi043.stdout: osd crush chooseleaf type = 0 2024-09-17T01:47:49.945 INFO:teuthology.orchestra.run.smithi043.stdout: auth debug = true 2024-09-17T01:47:49.945 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.946 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on old message = true 2024-09-17T01:47:49.946 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on bug = true 2024-09-17T01:47:49.946 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.946 INFO:teuthology.orchestra.run.smithi043.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T01:47:49.946 INFO:teuthology.orchestra.run.smithi043.stdout: mon pg warn max object skew = 0 2024-09-17T01:47:49.946 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.946 INFO:teuthology.orchestra.run.smithi043.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T01:47:49.946 INFO:teuthology.orchestra.run.smithi043.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T01:47:49.946 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.946 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default size = 2 2024-09-17T01:47:49.946 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.946 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow primary affinity = true 2024-09-17T01:47:49.946 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow pg remap = true 2024-09-17T01:47:49.946 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on legacy crush tunables = false 2024-09-17T01:47:49.947 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on crush straw calc version zero = false 2024-09-17T01:47:49.947 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on no sortbitwise = false 2024-09-17T01:47:49.947 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on osd down out interval zero = false 2024-09-17T01:47:49.947 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on too few osds = false 2024-09-17T01:47:49.947 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T01:47:49.947 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T01:47:49.947 INFO:teuthology.orchestra.run.smithi043.stdout: mon_allow_pool_size_one = true 2024-09-17T01:47:49.947 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.947 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T01:47:49.947 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.948 INFO:teuthology.orchestra.run.smithi043.stdout: osd default data pool replay window = 5 2024-09-17T01:47:49.948 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.948 INFO:teuthology.orchestra.run.smithi043.stdout: mon allow pool delete = true 2024-09-17T01:47:49.948 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.949 INFO:teuthology.orchestra.run.smithi043.stdout: mon cluster log file level = debug 2024-09-17T01:47:49.949 INFO:teuthology.orchestra.run.smithi043.stdout: debug asserts on shutdown = true 2024-09-17T01:47:49.949 INFO:teuthology.orchestra.run.smithi043.stdout: mon health detail to clog = false 2024-09-17T01:47:49.949 INFO:teuthology.orchestra.run.smithi043.stdout: mon host = "172.21.15.42,172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790]" 2024-09-17T01:47:49.949 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on skipped message = False 2024-09-17T01:47:49.949 INFO:teuthology.orchestra.run.smithi043.stdout: fsid = fea1c88c-cb05-432f-a745-f9dcbb5f2503 2024-09-17T01:47:49.949 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.950 INFO:teuthology.orchestra.run.smithi043.stdout:[osd] 2024-09-17T01:47:49.950 INFO:teuthology.orchestra.run.smithi043.stdout: osd journal size = 100 2024-09-17T01:47:49.950 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.950 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub load threshold = 5.0 2024-09-17T01:47:49.950 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub max interval = 600 2024-09-17T01:47:49.950 INFO:teuthology.orchestra.run.smithi043.stdout: osd mclock profile = high_recovery_ops 2024-09-17T01:47:49.950 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.950 INFO:teuthology.orchestra.run.smithi043.stdout: osd recover clone overlap = true 2024-09-17T01:47:49.951 INFO:teuthology.orchestra.run.smithi043.stdout: osd recovery max chunk = 1048576 2024-09-17T01:47:49.951 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.951 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug shutdown = true 2024-09-17T01:47:49.951 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug op order = true 2024-09-17T01:47:49.951 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug verify stray on activate = true 2024-09-17T01:47:49.951 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug trim objects = true 2024-09-17T01:47:49.952 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.952 INFO:teuthology.orchestra.run.smithi043.stdout: osd open classes on start = true 2024-09-17T01:47:49.952 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug pg log writeout = true 2024-09-17T01:47:49.952 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.952 INFO:teuthology.orchestra.run.smithi043.stdout: osd deep scrub update digest min age = 30 2024-09-17T01:47:49.952 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.953 INFO:teuthology.orchestra.run.smithi043.stdout: osd map max advance = 10 2024-09-17T01:47:49.953 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.953 INFO:teuthology.orchestra.run.smithi043.stdout: journal zero on create = true 2024-09-17T01:47:49.953 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.953 INFO:teuthology.orchestra.run.smithi043.stdout: filestore ondisk finisher threads = 3 2024-09-17T01:47:49.953 INFO:teuthology.orchestra.run.smithi043.stdout: filestore apply finisher threads = 3 2024-09-17T01:47:49.954 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.954 INFO:teuthology.orchestra.run.smithi043.stdout: bdev debug aio = true 2024-09-17T01:47:49.954 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug misdirected ops = true 2024-09-17T01:47:49.954 INFO:teuthology.orchestra.run.smithi043.stdout: bdev async discard = True 2024-09-17T01:47:49.954 INFO:teuthology.orchestra.run.smithi043.stdout: bdev enable discard = True 2024-09-17T01:47:49.954 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore allocator = bitmap 2024-09-17T01:47:49.954 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore block size = 96636764160 2024-09-17T01:47:49.954 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore fsck on mount = True 2024-09-17T01:47:49.955 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluefs = 1/20 2024-09-17T01:47:49.955 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluestore = 1/20 2024-09-17T01:47:49.955 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-17T01:47:49.955 INFO:teuthology.orchestra.run.smithi043.stdout: debug osd = 20 2024-09-17T01:47:49.955 INFO:teuthology.orchestra.run.smithi043.stdout: debug rocksdb = 4/10 2024-09-17T01:47:49.955 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T01:47:49.955 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd full ratio = 0.9 2024-09-17T01:47:49.956 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd nearfull ratio = 0.8 2024-09-17T01:47:49.956 INFO:teuthology.orchestra.run.smithi043.stdout: osd failsafe full ratio = 0.95 2024-09-17T01:47:49.956 INFO:teuthology.orchestra.run.smithi043.stdout: osd objectstore = bluestore 2024-09-17T01:47:49.956 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.956 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr] 2024-09-17T01:47:49.956 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-17T01:47:49.957 INFO:teuthology.orchestra.run.smithi043.stdout: debug mgr = 20 2024-09-17T01:47:49.957 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-09-17T01:47:49.957 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-09-17T01:47:49.957 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:47:49.957 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:47:49.957 INFO:teuthology.orchestra.run.smithi043.stdout: mgr/telemetry/nag = false 2024-09-17T01:47:49.957 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.958 INFO:teuthology.orchestra.run.smithi043.stdout:[mon] 2024-09-17T01:47:49.958 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-17T01:47:49.958 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-09-17T01:47:49.958 INFO:teuthology.orchestra.run.smithi043.stdout: debug paxos = 20 2024-09-17T01:47:49.958 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-09-17T01:47:49.958 INFO:teuthology.orchestra.run.smithi043.stdout: mon data avail warn = 5 2024-09-17T01:47:49.958 INFO:teuthology.orchestra.run.smithi043.stdout: mon mgr mkfs grace = 240 2024-09-17T01:47:49.959 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:47:49.959 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd reporter subtree level = osd 2024-09-17T01:47:49.959 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd prime pg temp = true 2024-09-17T01:47:49.959 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:47:49.959 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.959 INFO:teuthology.orchestra.run.smithi043.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T01:47:49.960 INFO:teuthology.orchestra.run.smithi043.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T01:47:49.960 INFO:teuthology.orchestra.run.smithi043.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T01:47:49.960 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.960 INFO:teuthology.orchestra.run.smithi043.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T01:47:49.960 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T01:47:49.960 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T01:47:49.961 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.961 INFO:teuthology.orchestra.run.smithi043.stdout: # 1m isn't quite enough 2024-09-17T01:47:49.961 INFO:teuthology.orchestra.run.smithi043.stdout: mon_down_mkfs_grace = 2m 2024-09-17T01:47:49.961 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.961 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_filestore_osds = false 2024-09-17T01:47:49.961 INFO:teuthology.orchestra.run.smithi043.stdout: mon down mkfs grace = 300 2024-09-17T01:47:49.961 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:47:49.962 INFO:teuthology.orchestra.run.smithi043.stdout:[client] 2024-09-17T01:47:49.962 INFO:teuthology.orchestra.run.smithi043.stdout: rgw cache enabled = true 2024-09-17T01:47:49.962 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable ops log = true 2024-09-17T01:47:49.962 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable usage log = true 2024-09-17T01:47:49.962 INFO:teuthology.orchestra.run.smithi043.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T01:47:49.962 INFO:teuthology.orchestra.run.smithi043.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T01:47:49.962 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = "" 2024-09-17T01:47:49.963 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.a] 2024-09-17T01:47:49.963 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.b] 2024-09-17T01:47:49.963 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.c] 2024-09-17T01:47:49.963 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a] 2024-09-17T01:47:49.963 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.c] 2024-09-17T01:47:49.963 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.b] 2024-09-17T01:47:49.964 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.d] 2024-09-17T01:47:49.964 INFO:teuthology.orchestra.run.smithi043.stdout:[mds] 2024-09-17T01:47:49.964 INFO:teuthology.orchestra.run.smithi043.stdout: mds cache max size = 1000 2024-09-17T01:47:49.964 INFO:teuthology.orchestra.run.smithi043.stdout: mds log max segments = 1 2024-09-17T01:47:49.964 INFO:teuthology.orchestra.run.smithi043.stdout: mds verify scatter = False 2024-09-17T01:47:49.964 INFO:teuthology.orchestra.run.smithi043.stdout: mds debug scatterstat = False 2024-09-17T01:47:49.967 DEBUG:teuthology.orchestra.run.smithi042:> stdin-killer -- python3 -c ' 2024-09-17T01:47:49.967 DEBUG:teuthology.orchestra.run.smithi042:> import os 2024-09-17T01:47:49.967 DEBUG:teuthology.orchestra.run.smithi042:> import stat 2024-09-17T01:47:49.967 DEBUG:teuthology.orchestra.run.smithi042:> import json 2024-09-17T01:47:49.967 DEBUG:teuthology.orchestra.run.smithi042:> import sys 2024-09-17T01:47:49.968 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:47:49.968 DEBUG:teuthology.orchestra.run.smithi042:> try: 2024-09-17T01:47:49.968 DEBUG:teuthology.orchestra.run.smithi042:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-09-17T01:47:49.968 DEBUG:teuthology.orchestra.run.smithi042:> except OSError as e: 2024-09-17T01:47:49.968 DEBUG:teuthology.orchestra.run.smithi042:> sys.exit(e.errno) 2024-09-17T01:47:49.968 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:47:49.969 DEBUG:teuthology.orchestra.run.smithi042:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-17T01:47:49.969 DEBUG:teuthology.orchestra.run.smithi042:> print(json.dumps( 2024-09-17T01:47:49.969 DEBUG:teuthology.orchestra.run.smithi042:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-17T01:47:49.969 DEBUG:teuthology.orchestra.run.smithi042:> indent=2)) 2024-09-17T01:47:49.969 DEBUG:teuthology.orchestra.run.smithi042:> ' 2024-09-17T01:47:50.072 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:47:50.072 INFO:teuthology.orchestra.run.smithi042.stdout: "st_mode": 33188, 2024-09-17T01:47:50.072 INFO:teuthology.orchestra.run.smithi042.stdout: "st_ino": 1099511627777, 2024-09-17T01:47:50.072 INFO:teuthology.orchestra.run.smithi042.stdout: "st_dev": 43, 2024-09-17T01:47:50.072 INFO:teuthology.orchestra.run.smithi042.stdout: "st_nlink": 1, 2024-09-17T01:47:50.072 INFO:teuthology.orchestra.run.smithi042.stdout: "st_uid": 1000, 2024-09-17T01:47:50.072 INFO:teuthology.orchestra.run.smithi042.stdout: "st_gid": 1333, 2024-09-17T01:47:50.072 INFO:teuthology.orchestra.run.smithi042.stdout: "st_size": 6291456, 2024-09-17T01:47:50.072 INFO:teuthology.orchestra.run.smithi042.stdout: "st_atime": 1726537669.607934, 2024-09-17T01:47:50.073 INFO:teuthology.orchestra.run.smithi042.stdout: "st_mtime": 1726537669.6429336, 2024-09-17T01:47:50.073 INFO:teuthology.orchestra.run.smithi042.stdout: "st_ctime": 1726537669.6429336 2024-09-17T01:47:50.073 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:47:50.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:47:50.084 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:47:50.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.353+0000 7f8d06e00640 1 -- 172.21.15.42:0/2894035420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d0015dcf0 msgr2=0x7f8d00072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:50.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.353+0000 7f8d06e00640 1 --2- 172.21.15.42:0/2894035420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d0015dcf0 0x7f8d00072b60 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0005fd0 tx=0x7f8cf002a5d0 comp rx=0 tx=0).stop 2024-09-17T01:47:50.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.353+0000 7f8d06e00640 1 -- 172.21.15.42:0/2894035420 shutdown_connections 2024-09-17T01:47:50.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.353+0000 7f8d06e00640 1 --2- 172.21.15.42:0/2894035420 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d000cdd30 0x7f8d00160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:50.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.353+0000 7f8d06e00640 1 --2- 172.21.15.42:0/2894035420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d0015dcf0 0x7f8d00072b60 unknown :-1 s=CLOSED pgs=2309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:50.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.353+0000 7f8d06e00640 1 -- 172.21.15.42:0/2894035420 >> 172.21.15.42:0/2894035420 conn(0x7f8d0006d1b0 msgr2=0x7f8d0006d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:50.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.353+0000 7f8d06e00640 1 -- 172.21.15.42:0/2894035420 shutdown_connections 2024-09-17T01:47:50.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.353+0000 7f8d06e00640 1 -- 172.21.15.42:0/2894035420 wait complete. 2024-09-17T01:47:50.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.356+0000 7f8d06e00640 1 Processor -- start 2024-09-17T01:47:50.354 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.356+0000 7f8d06e00640 1 -- start start 2024-09-17T01:47:50.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.357+0000 7f8d06e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d0015dcf0 0x7f8d000aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:50.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.357+0000 7f8d06e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d00160790 0x7f8d00158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:50.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.357+0000 7f8d06e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d00144270 0x7f8d001e7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:50.356 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.357+0000 7f8d06e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8d0006ee40 con 0x7f8d0015dcf0 2024-09-17T01:47:50.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.357+0000 7f8d06e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8d0006ecc0 con 0x7f8d00144270 2024-09-17T01:47:50.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.357+0000 7f8d06e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8d0006efc0 con 0x7f8d00160790 2024-09-17T01:47:50.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.357+0000 7f8cffe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d0015dcf0 0x7f8d000aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:50.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.358+0000 7f8cffe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d0015dcf0 0x7f8d000aeb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36652/0 (socket says 172.21.15.42:36652) 2024-09-17T01:47:50.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.358+0000 7f8cffe00640 1 -- 172.21.15.42:0/1896771703 learned_addr learned my addr 172.21.15.42:0/1896771703 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:50.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.358+0000 7f8cf7e00640 1 --2- 172.21.15.42:0/1896771703 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d00160790 0x7f8d00158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:50.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.358+0000 7f8d04e00640 1 --2- 172.21.15.42:0/1896771703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d00144270 0x7f8d001e7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:50.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.358+0000 7f8cffe00640 1 -- 172.21.15.42:0/1896771703 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d00160790 msgr2=0x7f8d00158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:50.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.358+0000 7f8cffe00640 1 --2- 172.21.15.42:0/1896771703 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d00160790 0x7f8d00158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:50.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.358+0000 7f8cffe00640 1 -- 172.21.15.42:0/1896771703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d00144270 msgr2=0x7f8d001e7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:50.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.358+0000 7f8cffe00640 1 --2- 172.21.15.42:0/1896771703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d00144270 0x7f8d001e7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:50.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.358+0000 7f8cffe00640 1 -- 172.21.15.42:0/1896771703 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d0015a210 con 0x7f8d0015dcf0 2024-09-17T01:47:50.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.358+0000 7f8cffe00640 1 --2- 172.21.15.42:0/1896771703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d0015dcf0 0x7f8d000aeb70 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0006010 tx=0x7f8cf00035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:50.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.359+0000 7f8cfcc00640 1 -- 172.21.15.42:0/1896771703 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf003e030 con 0x7f8d0015dcf0 2024-09-17T01:47:50.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.359+0000 7f8cfcc00640 1 -- 172.21.15.42:0/1896771703 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8cf0003ae0 con 0x7f8d0015dcf0 2024-09-17T01:47:50.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.359+0000 7f8cfcc00640 1 -- 172.21.15.42:0/1896771703 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0035040 con 0x7f8d0015dcf0 2024-09-17T01:47:50.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.359+0000 7f8d06e00640 1 -- 172.21.15.42:0/1896771703 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d00159770 con 0x7f8d0015dcf0 2024-09-17T01:47:50.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.359+0000 7f8d06e00640 1 -- 172.21.15.42:0/1896771703 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d000af0b0 con 0x7f8d0015dcf0 2024-09-17T01:47:50.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.360+0000 7f8d06e00640 1 -- 172.21.15.42:0/1896771703 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d001446d0 con 0x7f8d0015dcf0 2024-09-17T01:47:50.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.361+0000 7f8cfcc00640 1 -- 172.21.15.42:0/1896771703 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8cf0041030 con 0x7f8d0015dcf0 2024-09-17T01:47:50.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.362+0000 7f8cfcc00640 1 --2- 172.21.15.42:0/1896771703 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8cdc078b90 0x7f8cdc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:50.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.362+0000 7f8cfcc00640 1 -- 172.21.15.42:0/1896771703 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5709+0+0 (secure 0 0 0) 0x7f8cf00bb0c0 con 0x7f8d0015dcf0 2024-09-17T01:47:50.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.363+0000 7f8cf7e00640 1 --2- 172.21.15.42:0/1896771703 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8cdc078b90 0x7f8cdc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:50.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.363+0000 7f8cf7e00640 1 --2- 172.21.15.42:0/1896771703 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8cdc078b90 0x7f8cdc07b0a0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f8d001466b0 tx=0x7f8ce8009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:50.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.367+0000 7f8cfcc00640 1 -- 172.21.15.42:0/1896771703 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8d001446d0 con 0x7f8d0015dcf0 2024-09-17T01:47:50.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.598+0000 7f8d06e00640 1 -- 172.21.15.42:0/1896771703 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d0006f4e0 con 0x7f8d0015dcf0 2024-09-17T01:47:50.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.598+0000 7f8cfcc00640 1 -- 172.21.15.42:0/1896771703 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 159 v159) ==== 95+0+5231 (secure 0 0 0) 0x7f8cf0082f30 con 0x7f8d0015dcf0 2024-09-17T01:47:50.598 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:47:50.598 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":159,"btime":"2024-09-17T01:47:39:016238+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3701245274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3701245274},{"type":"v1","addr":"172.21.15.43:6837","nonce":3701245274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10021,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/8838410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":8838410},{"type":"v1","addr":"172.21.15.42:6834","nonce":8838410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3981236009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3981236009},{"type":"v1","addr":"172.21.15.43:6836","nonce":3981236009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154}],"filesystems":[{"mdsmap":{"epoch":159,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:47:35.510920+0000","modified":"2024-09-17T01:47:38.527136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10776":{"gid":10776,"name":"c","rank":0,"incarnation":155,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3836210591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3836210591},{"type":"v1","addr":"172.21.15.42:6835","nonce":3836210591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10776,"qdb_cluster":[10776]},"id":14}]} 2024-09-17T01:47:50.598 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 159 2024-09-17T01:47:50.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.601+0000 7f8d06e00640 1 -- 172.21.15.42:0/1896771703 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8cdc078b90 msgr2=0x7f8cdc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:50.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.601+0000 7f8d06e00640 1 --2- 172.21.15.42:0/1896771703 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8cdc078b90 0x7f8cdc07b0a0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f8d001466b0 tx=0x7f8ce8009040 comp rx=0 tx=0).stop 2024-09-17T01:47:50.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.601+0000 7f8d06e00640 1 -- 172.21.15.42:0/1896771703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d0015dcf0 msgr2=0x7f8d000aeb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:50.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.601+0000 7f8d06e00640 1 --2- 172.21.15.42:0/1896771703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d0015dcf0 0x7f8d000aeb70 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0006010 tx=0x7f8cf00035f0 comp rx=0 tx=0).stop 2024-09-17T01:47:50.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.601+0000 7f8d06e00640 1 -- 172.21.15.42:0/1896771703 shutdown_connections 2024-09-17T01:47:50.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.601+0000 7f8d06e00640 1 --2- 172.21.15.42:0/1896771703 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8cdc078b90 0x7f8cdc07b0a0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:50.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.601+0000 7f8d06e00640 1 --2- 172.21.15.42:0/1896771703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d00144270 0x7f8d001e7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:50.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.601+0000 7f8d06e00640 1 --2- 172.21.15.42:0/1896771703 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8d00160790 0x7f8d00158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:50.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.601+0000 7f8d06e00640 1 --2- 172.21.15.42:0/1896771703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d0015dcf0 0x7f8d000aeb70 unknown :-1 s=CLOSED pgs=2310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:50.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.601+0000 7f8d06e00640 1 -- 172.21.15.42:0/1896771703 >> 172.21.15.42:0/1896771703 conn(0x7f8d0006d1b0 msgr2=0x7f8d000ce580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:50.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.601+0000 7f8d06e00640 1 -- 172.21.15.42:0/1896771703 shutdown_connections 2024-09-17T01:47:50.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:50.601+0000 7f8d06e00640 1 -- 172.21.15.42:0/1896771703 wait complete. 2024-09-17T01:47:50.622 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-17T01:47:50.877 INFO:teuthology.orchestra.run.smithi042.stdout:{"message":"","return_code":0} 2024-09-17T01:47:50.877 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-17T01:47:50.878 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent '' 2024-09-17T01:47:51.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.025+0000 7f37d4fd3f40 1 Processor -- start 2024-09-17T01:47:51.024 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.025+0000 7f37d4fd3f40 1 -- start start 2024-09-17T01:47:51.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.026+0000 7f37d4fd3f40 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa2a186640 0x55aa2a1cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.026+0000 7f37d4fd3f40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa2a1b59b0 0x55aa2a2438e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.026+0000 7f37d4fd3f40 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa2a25d380 0x55aa2a1cc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.026+0000 7f37d4fd3f40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55aa2a1856f0 con 0x55aa2a1b59b0 2024-09-17T01:47:51.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.026+0000 7f37d4fd3f40 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55aa2a0d4c60 con 0x55aa2a186640 2024-09-17T01:47:51.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.026+0000 7f37d4fd3f40 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55aa2a1b5dc0 con 0x55aa2a25d380 2024-09-17T01:47:51.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.027+0000 7f37cd800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa2a1b59b0 0x55aa2a2438e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.027+0000 7f37cd800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa2a1b59b0 0x55aa2a2438e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36666/0 (socket says 172.21.15.42:36666) 2024-09-17T01:47:51.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.027+0000 7f37cd800640 1 -- 172.21.15.42:0/3733615034 learned_addr learned my addr 172.21.15.42:0/3733615034 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:51.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.027+0000 7f37ce200640 1 --2- 172.21.15.42:0/3733615034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa2a186640 0x55aa2a1cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.027+0000 7f37cec00640 1 --2- 172.21.15.42:0/3733615034 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa2a25d380 0x55aa2a1cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.027+0000 7f37cd800640 1 -- 172.21.15.42:0/3733615034 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa2a25d380 msgr2=0x55aa2a1cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:51.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.027+0000 7f37cd800640 1 --2- 172.21.15.42:0/3733615034 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa2a25d380 0x55aa2a1cc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.027+0000 7f37cd800640 1 -- 172.21.15.42:0/3733615034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa2a186640 msgr2=0x55aa2a1cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:51.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.027+0000 7f37cd800640 1 --2- 172.21.15.42:0/3733615034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa2a186640 0x55aa2a1cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.027 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.027+0000 7f37cd800640 1 -- 172.21.15.42:0/3733615034 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa2a0acf10 con 0x55aa2a1b59b0 2024-09-17T01:47:51.028 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.027+0000 7f37cd800640 1 --2- 172.21.15.42:0/3733615034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa2a1b59b0 0x55aa2a2438e0 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f37bc046580 tx=0x7f37bc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57075839ea79d86 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:51.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.028+0000 7f37c7e00640 1 -- 172.21.15.42:0/3733615034 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc04db70 con 0x55aa2a1b59b0 2024-09-17T01:47:51.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.028+0000 7f37c7e00640 1 -- 172.21.15.42:0/3733615034 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37bc04dd10 con 0x55aa2a1b59b0 2024-09-17T01:47:51.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.028+0000 7f37c7e00640 1 -- 172.21.15.42:0/3733615034 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc0566d0 con 0x55aa2a1b59b0 2024-09-17T01:47:51.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.028+0000 7f37d4fd3f40 1 -- 172.21.15.42:0/3733615034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa2a1b59b0 msgr2=0x55aa2a2438e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:51.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.028+0000 7f37d4fd3f40 1 --2- 172.21.15.42:0/3733615034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa2a1b59b0 0x55aa2a2438e0 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f37bc046580 tx=0x7f37bc002fb0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.028+0000 7f37d4fd3f40 1 -- 172.21.15.42:0/3733615034 shutdown_connections 2024-09-17T01:47:51.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.028+0000 7f37d4fd3f40 1 --2- 172.21.15.42:0/3733615034 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa2a25d380 0x55aa2a1cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.028+0000 7f37d4fd3f40 1 --2- 172.21.15.42:0/3733615034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa2a1b59b0 0x55aa2a2438e0 unknown :-1 s=CLOSED pgs=2312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.028+0000 7f37d4fd3f40 1 --2- 172.21.15.42:0/3733615034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa2a186640 0x55aa2a1cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.028+0000 7f37d4fd3f40 1 -- 172.21.15.42:0/3733615034 >> 172.21.15.42:0/3733615034 conn(0x55aa2a0a5ac0 msgr2=0x55aa2a25f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:51.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.029+0000 7f37d4fd3f40 1 -- 172.21.15.42:0/3733615034 shutdown_connections 2024-09-17T01:47:51.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.029+0000 7f37d4fd3f40 1 -- 172.21.15.42:0/3733615034 wait complete. 2024-09-17T01:47:51.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.030+0000 7f37d4fd3f40 1 Processor -- start 2024-09-17T01:47:51.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.030+0000 7f37d4fd3f40 1 -- start start 2024-09-17T01:47:51.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.031+0000 7f37d4fd3f40 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa2a186640 0x55aa2a25b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.031+0000 7f37d4fd3f40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa2a1b59b0 0x55aa2a1ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.031+0000 7f37d4fd3f40 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa2a25d380 0x55aa2a1cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.031+0000 7f37d4fd3f40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55aa2a188d90 con 0x55aa2a1b59b0 2024-09-17T01:47:51.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.031+0000 7f37d4fd3f40 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55aa2a1cc3b0 con 0x55aa2a186640 2024-09-17T01:47:51.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.031+0000 7f37d4fd3f40 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55aa2a2f71a0 con 0x55aa2a25d380 2024-09-17T01:47:51.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.031+0000 7f37cd800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa2a1b59b0 0x55aa2a1ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.031+0000 7f37cd800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa2a1b59b0 0x55aa2a1ce240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36668/0 (socket says 172.21.15.42:36668) 2024-09-17T01:47:51.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.031+0000 7f37cd800640 1 -- 172.21.15.42:0/3067793529 learned_addr learned my addr 172.21.15.42:0/3067793529 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:51.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.032+0000 7f37ce200640 1 --2- 172.21.15.42:0/3067793529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa2a186640 0x55aa2a25b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.032+0000 7f37cec00640 1 --2- 172.21.15.42:0/3067793529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa2a25d380 0x55aa2a1cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.032+0000 7f37cd800640 1 -- 172.21.15.42:0/3067793529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa2a25d380 msgr2=0x55aa2a1cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:51.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.032+0000 7f37cd800640 1 --2- 172.21.15.42:0/3067793529 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55aa2a25d380 0x55aa2a1cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.032+0000 7f37cd800640 1 -- 172.21.15.42:0/3067793529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa2a186640 msgr2=0x55aa2a25b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:51.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.032+0000 7f37cd800640 1 --2- 172.21.15.42:0/3067793529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa2a186640 0x55aa2a25b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.032+0000 7f37cd800640 1 -- 172.21.15.42:0/3067793529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa2a25bc00 con 0x55aa2a1b59b0 2024-09-17T01:47:51.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.032+0000 7f37cd800640 1 --2- 172.21.15.42:0/3067793529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa2a1b59b0 0x55aa2a1ce240 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f37bc025e50 tx=0x7f37bc04d910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:51.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.033+0000 7f37c6a00640 1 -- 172.21.15.42:0/3067793529 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc0575c0 con 0x55aa2a1b59b0 2024-09-17T01:47:51.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.033+0000 7f37c6a00640 1 -- 172.21.15.42:0/3067793529 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37bc070070 con 0x55aa2a1b59b0 2024-09-17T01:47:51.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.033+0000 7f37d4fd3f40 1 -- 172.21.15.42:0/3067793529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aa2a240520 con 0x55aa2a1b59b0 2024-09-17T01:47:51.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.033+0000 7f37c6a00640 1 -- 172.21.15.42:0/3067793529 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc057b10 con 0x55aa2a1b59b0 2024-09-17T01:47:51.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.033+0000 7f37d4fd3f40 1 -- 172.21.15.42:0/3067793529 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa2a1b34e0 con 0x55aa2a1b59b0 2024-09-17T01:47:51.033 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.035+0000 7f37c6a00640 1 -- 172.21.15.42:0/3067793529 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f37bc06a070 con 0x55aa2a1b59b0 2024-09-17T01:47:51.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.036+0000 7f37c6a00640 1 --2- 172.21.15.42:0/3067793529 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f37b00775a0 0x7f37b0079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.036+0000 7f37c6a00640 1 -- 172.21.15.42:0/3067793529 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5709+0+0 (secure 0 0 0) 0x7f37bc0def50 con 0x55aa2a1b59b0 2024-09-17T01:47:51.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.036+0000 7f37d4fd3f40 1 --2- 172.21.15.42:0/3067793529 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x55aa2a240920 0x55aa2a3000b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.036+0000 7f37d4fd3f40 1 -- 172.21.15.42:0/3067793529 --> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] -- osd_op(unknown.0.0:1 29.7 29:e2e07930:::10000000001.00000000:head [setxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e200) -- 0x55aa2a1cf100 con 0x55aa2a240920 2024-09-17T01:47:51.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.036+0000 7f37ce200640 1 --2- 172.21.15.42:0/3067793529 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f37b00775a0 0x7f37b0079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.036+0000 7f37cec00640 1 --2- 172.21.15.42:0/3067793529 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x55aa2a240920 0x55aa2a3000b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.037+0000 7f37ce200640 1 --2- 172.21.15.42:0/3067793529 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f37b00775a0 0x7f37b0079ab0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f37c000c700 tx=0x7f37c000f040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:51.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.037+0000 7f37cec00640 1 --2- 172.21.15.42:0/3067793529 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x55aa2a240920 0x55aa2a3000b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:51.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.038+0000 7f37cec00640 1 -- 172.21.15.42:0/3067793529 <== osd.1 v2:172.21.15.42:6824/4073532812 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr] v200'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f37c8003040 con 0x55aa2a240920 2024-09-17T01:47:51.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.038+0000 7f37d4fd3f40 1 -- 172.21.15.42:0/3067793529 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x55aa2a240920 msgr2=0x55aa2a3000b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:51.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.038+0000 7f37d4fd3f40 1 --2- 172.21.15.42:0/3067793529 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x55aa2a240920 0x55aa2a3000b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.039+0000 7f37d4fd3f40 1 -- 172.21.15.42:0/3067793529 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f37b00775a0 msgr2=0x7f37b0079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:51.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.039+0000 7f37d4fd3f40 1 --2- 172.21.15.42:0/3067793529 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f37b00775a0 0x7f37b0079ab0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f37c000c700 tx=0x7f37c000f040 comp rx=0 tx=0).stop 2024-09-17T01:47:51.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.039+0000 7f37d4fd3f40 1 -- 172.21.15.42:0/3067793529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa2a1b59b0 msgr2=0x55aa2a1ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:51.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.039+0000 7f37d4fd3f40 1 --2- 172.21.15.42:0/3067793529 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55aa2a1b59b0 0x55aa2a1ce240 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f37bc025e50 tx=0x7f37bc04d910 comp rx=0 tx=0).stop 2024-09-17T01:47:51.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.039+0000 7f37cec00640 1 -- 172.21.15.42:0/3067793529 reap_dead start 2024-09-17T01:47:51.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.039+0000 7f37d4fd3f40 1 -- 172.21.15.42:0/3067793529 shutdown_connections 2024-09-17T01:47:51.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.039+0000 7f37d4fd3f40 1 -- 172.21.15.42:0/3067793529 >> 172.21.15.42:0/3067793529 conn(0x55aa2a0a5ac0 msgr2=0x55aa2a1cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:51.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.039+0000 7f37d4fd3f40 1 -- 172.21.15.42:0/3067793529 shutdown_connections 2024-09-17T01:47:51.039 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.039+0000 7f37d4fd3f40 1 -- 172.21.15.42:0/3067793529 wait complete. 2024-09-17T01:47:51.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:47:51.052 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub start / recursive,repair 2024-09-17T01:47:51.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.287+0000 7ff983200640 1 -- 172.21.15.42:0/1236107860 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff984145a70 msgr2=0x7ff9840afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:51.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.287+0000 7ff983200640 1 --2- 172.21.15.42:0/1236107860 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff984145a70 0x7ff9840afb90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009c10 tx=0x7ff97c02a8c0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.287+0000 7ff983200640 1 -- 172.21.15.42:0/1236107860 shutdown_connections 2024-09-17T01:47:51.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.287+0000 7ff983200640 1 --2- 172.21.15.42:0/1236107860 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff984145a70 0x7ff9840afb90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.287+0000 7ff983200640 1 -- 172.21.15.42:0/1236107860 >> 172.21.15.42:0/1236107860 conn(0x7ff98406cfa0 msgr2=0x7ff98406d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:51.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.287+0000 7ff983200640 1 -- 172.21.15.42:0/1236107860 shutdown_connections 2024-09-17T01:47:51.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.287+0000 7ff983200640 1 -- 172.21.15.42:0/1236107860 wait complete. 2024-09-17T01:47:51.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.289+0000 7ff983200640 1 Processor -- start 2024-09-17T01:47:51.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.290+0000 7ff983200640 1 -- start start 2024-09-17T01:47:51.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.291+0000 7ff983200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9840cd860 0x7ff98415b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.291+0000 7ff983200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff984145a70 0x7ff98413de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.291+0000 7ff983200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff98415b820 0x7ff9841f7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.291+0000 7ff983200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff984073b20 con 0x7ff98415b820 2024-09-17T01:47:51.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.291+0000 7ff983200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff9840739a0 con 0x7ff9840cd860 2024-09-17T01:47:51.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.291+0000 7ff983200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff984073ca0 con 0x7ff984145a70 2024-09-17T01:47:51.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.291+0000 7ff982800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff98415b820 0x7ff9841f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.291+0000 7ff982800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff98415b820 0x7ff9841f7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36682/0 (socket says 172.21.15.42:36682) 2024-09-17T01:47:51.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.291+0000 7ff982800640 1 -- 172.21.15.42:0/48673000 learned_addr learned my addr 172.21.15.42:0/48673000 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:51.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.292+0000 7ff981e00640 1 --2- 172.21.15.42:0/48673000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9840cd860 0x7ff98415b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.292+0000 7ff97be00640 1 --2- 172.21.15.42:0/48673000 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff984145a70 0x7ff98413de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.292+0000 7ff982800640 1 -- 172.21.15.42:0/48673000 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff984145a70 msgr2=0x7ff98413de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:51.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.292+0000 7ff982800640 1 --2- 172.21.15.42:0/48673000 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff984145a70 0x7ff98413de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.292+0000 7ff982800640 1 -- 172.21.15.42:0/48673000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9840cd860 msgr2=0x7ff98415b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:51.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.292+0000 7ff982800640 1 --2- 172.21.15.42:0/48673000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9840cd860 0x7ff98415b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.292+0000 7ff982800640 1 -- 172.21.15.42:0/48673000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98413e380 con 0x7ff98415b820 2024-09-17T01:47:51.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.292+0000 7ff97be00640 1 --2- 172.21.15.42:0/48673000 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff984145a70 0x7ff98413de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:47:51.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.292+0000 7ff982800640 1 --2- 172.21.15.42:0/48673000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff98415b820 0x7ff9841f7520 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7ff97c02aeb0 tx=0x7ff97c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:51.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.292+0000 7ff97a000640 1 -- 172.21.15.42:0/48673000 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c031b60 con 0x7ff98415b820 2024-09-17T01:47:51.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.292+0000 7ff97a000640 1 -- 172.21.15.42:0/48673000 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff97c031df0 con 0x7ff98415b820 2024-09-17T01:47:51.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.292+0000 7ff983200640 1 -- 172.21.15.42:0/48673000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff984140d20 con 0x7ff98415b820 2024-09-17T01:47:51.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.292+0000 7ff97a000640 1 -- 172.21.15.42:0/48673000 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c033330 con 0x7ff98415b820 2024-09-17T01:47:51.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.293+0000 7ff983200640 1 -- 172.21.15.42:0/48673000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff98413e590 con 0x7ff98415b820 2024-09-17T01:47:51.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.295+0000 7ff97a000640 1 -- 172.21.15.42:0/48673000 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff97c0334d0 con 0x7ff98415b820 2024-09-17T01:47:51.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.297+0000 7ff97a000640 1 --2- 172.21.15.42:0/48673000 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff960078b90 0x7ff96007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.297+0000 7ff97a000640 1 -- 172.21.15.42:0/48673000 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(200..200 src has 1..200) ==== 5709+0+0 (secure 0 0 0) 0x7ff97c0bc290 con 0x7ff98415b820 2024-09-17T01:47:51.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.297+0000 7ff981e00640 1 --2- 172.21.15.42:0/48673000 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff960078b90 0x7ff96007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.297+0000 7ff990015740 1 Processor -- start 2024-09-17T01:47:51.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.297+0000 7ff990015740 1 -- start start 2024-09-17T01:47:51.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.298+0000 7ff981e00640 1 --2- 172.21.15.42:0/48673000 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff960078b90 0x7ff96007b0a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7ff9740046b0 tx=0x7ff974009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:51.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.299+0000 7ff990015740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556aaaef1410 0x556aab2b3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.299+0000 7ff990015740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aaaec8550 0x556aab2def00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.299+0000 7ff990015740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaed0730 0x556aab2bff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.299+0000 7ff990015740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556aab20bf40 con 0x556aaaed0730 2024-09-17T01:47:51.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.299+0000 7ff990015740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556aab1fb370 con 0x556aaaec8550 2024-09-17T01:47:51.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.299+0000 7ff990015740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x556aab1ff180 con 0x556aaaef1410 2024-09-17T01:47:51.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.299+0000 7ff982800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaed0730 0x556aab2bff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.299+0000 7ff981e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556aaaef1410 0x556aab2b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.299+0000 7ff982800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaed0730 0x556aab2bff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36686/0 (socket says 172.21.15.42:36686) 2024-09-17T01:47:51.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.299+0000 7ff982800640 1 -- 172.21.15.42:0/1338446462 learned_addr learned my addr 172.21.15.42:0/1338446462 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:51.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.299+0000 7ff97be00640 1 --2- 172.21.15.42:0/1338446462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aaaec8550 0x556aab2def00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.300+0000 7ff982800640 1 -- 172.21.15.42:0/1338446462 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556aaaef1410 msgr2=0x556aab2b3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:51.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.300+0000 7ff982800640 1 --2- 172.21.15.42:0/1338446462 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556aaaef1410 0x556aab2b3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.300+0000 7ff982800640 1 -- 172.21.15.42:0/1338446462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aaaec8550 msgr2=0x556aab2def00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:51.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.300+0000 7ff982800640 1 --2- 172.21.15.42:0/1338446462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aaaec8550 0x556aab2def00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.300+0000 7ff982800640 1 -- 172.21.15.42:0/1338446462 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aaaeed470 con 0x556aaaed0730 2024-09-17T01:47:51.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.300+0000 7ff982800640 1 --2- 172.21.15.42:0/1338446462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaed0730 0x556aab2bff60 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7ff97c083990 tx=0x7ff97c083730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a34c62fb4ac46d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:51.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.300+0000 7ff972a00640 1 -- 172.21.15.42:0/1338446462 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c009280 con 0x556aaaed0730 2024-09-17T01:47:51.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.300+0000 7ff972a00640 1 -- 172.21.15.42:0/1338446462 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff97c0846c0 con 0x556aaaed0730 2024-09-17T01:47:51.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.300+0000 7ff972a00640 1 -- 172.21.15.42:0/1338446462 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c031780 con 0x556aaaed0730 2024-09-17T01:47:51.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.301+0000 7ff990015740 1 -- 172.21.15.42:0/1338446462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaed0730 msgr2=0x556aab2bff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:51.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.301+0000 7ff990015740 1 --2- 172.21.15.42:0/1338446462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaed0730 0x556aab2bff60 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7ff97c083990 tx=0x7ff97c083730 comp rx=0 tx=0).stop 2024-09-17T01:47:51.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.301+0000 7ff990015740 1 -- 172.21.15.42:0/1338446462 shutdown_connections 2024-09-17T01:47:51.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.301+0000 7ff990015740 1 --2- 172.21.15.42:0/1338446462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aaaec8550 0x556aab2def00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.301+0000 7ff990015740 1 --2- 172.21.15.42:0/1338446462 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaed0730 0x556aab2bff60 unknown :-1 s=CLOSED pgs=2316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.301+0000 7ff990015740 1 --2- 172.21.15.42:0/1338446462 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556aaaef1410 0x556aab2b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.301+0000 7ff990015740 1 -- 172.21.15.42:0/1338446462 >> 172.21.15.42:0/1338446462 conn(0x556aaaee5560 msgr2=0x556aab299250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:51.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.301+0000 7ff990015740 1 -- 172.21.15.42:0/1338446462 shutdown_connections 2024-09-17T01:47:51.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.301+0000 7ff990015740 1 -- 172.21.15.42:0/1338446462 wait complete. 2024-09-17T01:47:51.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.302+0000 7ff990015740 1 -- start start 2024-09-17T01:47:51.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.302+0000 7ff990015740 1 Processor -- start 2024-09-17T01:47:51.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.304+0000 7ff990015740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aaaec8550 0x556aab2f1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.304+0000 7ff990015740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaed0730 0x556aab2d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.304+0000 7ff990015740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556aaaef1410 0x556aab2d5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.304+0000 7ff990015740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556aaaf6b7c0 con 0x556aaaed0730 2024-09-17T01:47:51.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.304+0000 7ff990015740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556aab1a0ae0 con 0x556aaaec8550 2024-09-17T01:47:51.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.304+0000 7ff990015740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x556aab2b2610 con 0x556aaaef1410 2024-09-17T01:47:51.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.304+0000 7ff990015740 10 client.0 _ll_register_callbacks cb 0x556aab1b05b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:47:51.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.304+0000 7ff97be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaed0730 0x556aab2d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.304+0000 7ff97be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaed0730 0x556aab2d59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36688/0 (socket says 172.21.15.42:36688) 2024-09-17T01:47:51.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.304+0000 7ff97be00640 1 -- 172.21.15.42:0/4066252420 learned_addr learned my addr 172.21.15.42:0/4066252420 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:51.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.304+0000 7ff982800640 1 --2- 172.21.15.42:0/4066252420 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556aaaef1410 0x556aab2d5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.304+0000 7ff981e00640 1 --2- 172.21.15.42:0/4066252420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aaaec8550 0x556aab2f1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.305+0000 7ff97be00640 1 -- 172.21.15.42:0/4066252420 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556aaaef1410 msgr2=0x556aab2d5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:51.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.305+0000 7ff97be00640 1 --2- 172.21.15.42:0/4066252420 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556aaaef1410 0x556aab2d5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.305+0000 7ff97be00640 1 -- 172.21.15.42:0/4066252420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aaaec8550 msgr2=0x556aab2f1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:51.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.305+0000 7ff97be00640 1 --2- 172.21.15.42:0/4066252420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aaaec8550 0x556aab2f1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.305+0000 7ff97be00640 1 -- 172.21.15.42:0/4066252420 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aaafd17e0 con 0x556aaaed0730 2024-09-17T01:47:51.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.305+0000 7ff981e00640 1 --2- 172.21.15.42:0/4066252420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aaaec8550 0x556aab2f1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:47:51.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.305+0000 7ff97be00640 1 --2- 172.21.15.42:0/4066252420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaed0730 0x556aab2d59a0 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7ff96c001e50 tx=0x7ff96c0106d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cddba00a6465062f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:51.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.305+0000 7ff967400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:47:51.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.305+0000 7ff967400640 1 -- 172.21.15.42:0/4066252420 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c010ea0 con 0x556aaaed0730 2024-09-17T01:47:51.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.305+0000 7ff990015740 1 -- 172.21.15.42:0/4066252420 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff97c0846c0 con 0x556aaaed0730 2024-09-17T01:47:51.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.305+0000 7ff967400640 1 -- 172.21.15.42:0/4066252420 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(200..200 src has 1..200) ==== 5709+0+0 (secure 0 0 0) 0x7ff96c0035f0 con 0x556aaaed0730 2024-09-17T01:47:51.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.305+0000 7ff967400640 1 -- 172.21.15.42:0/4066252420 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=159) ==== 24+0+0 (secure 0 0 0) 0x7ff96c021050 con 0x556aaaed0730 2024-09-17T01:47:51.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.306+0000 7ff990015740 10 client.10965 fetch_fsmap learned FSMap version 159 2024-09-17T01:47:51.306 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.306+0000 7ff990015740 1 -- 172.21.15.42:0/4066252420 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=159,monmap=2+}) -- 0x556aab031f70 con 0x556aaaed0730 2024-09-17T01:47:51.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.306+0000 7ff967400640 1 -- 172.21.15.42:0/4066252420 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff97c0846c0 con 0x556aaaed0730 2024-09-17T01:47:51.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.306+0000 7ff967400640 1 -- 172.21.15.42:0/4066252420 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 159) ==== 3502+0+0 (secure 0 0 0) 0x7ff96c024020 con 0x556aaaed0730 2024-09-17T01:47:51.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.306+0000 7ff990015740 10 client.10965 fetch_fsmap finished waiting for FSMap version 159 2024-09-17T01:47:51.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.306+0000 7ff990015740 10 client.10965 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-17T01:47:51.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.306+0000 7ff990015740 20 client.10965 populate_metadata read hostname 'smithi042' 2024-09-17T01:47:51.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.306+0000 7ff990015740 1 --2- 172.21.15.42:0/4066252420 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x556aaaeb01f0 0x556aab2d9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.306+0000 7ff990015740 4 client.10965 mds_command: new command op to 10776 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:47:51.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.306+0000 7ff990015740 1 -- 172.21.15.42:0/4066252420 --> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556aab20de90 con 0x556aaaeb01f0 2024-09-17T01:47:51.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.306+0000 7ff981e00640 1 --2- 172.21.15.42:0/4066252420 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x556aaaeb01f0 0x556aab2d9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.307+0000 7ff981e00640 1 --2- 172.21.15.42:0/4066252420 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x556aaaeb01f0 0x556aab2d9bd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4002159f11abe537 server_cookie=8932fe9dc10a8a4d in_seq=0 out_seq=0 2024-09-17T01:47:51.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.307+0000 7ff967400640 10 client.10965 ms_handle_connect on v2:172.21.15.42:6832/3836210591 2024-09-17T01:47:51.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.308+0000 7ff967400640 1 -- 172.21.15.42:0/4066252420 <== mds.0 v2:172.21.15.42:6832/3836210591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556aab20de90 con 0x556aaaeb01f0 2024-09-17T01:47:51.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.308+0000 7ff967400640 10 client.10965 handle_command_reply: tid=0 2024-09-17T01:47:51.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.308+0000 7ff990015740 1 client.10965 shutdown 2024-09-17T01:47:51.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.308+0000 7ff990015740 1 -- 172.21.15.42:0/4066252420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaed0730 msgr2=0x556aab2d59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:51.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.308+0000 7ff990015740 1 --2- 172.21.15.42:0/4066252420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaed0730 0x556aab2d59a0 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7ff96c001e50 tx=0x7ff96c0106d0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.308+0000 7ff990015740 1 -- 172.21.15.42:0/4066252420 shutdown_connections 2024-09-17T01:47:51.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.308+0000 7ff990015740 1 --2- 172.21.15.42:0/4066252420 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x556aaaeb01f0 0x556aab2d9bd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.308+0000 7ff990015740 1 --2- 172.21.15.42:0/4066252420 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556aaaef1410 0x556aab2d5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.308+0000 7ff990015740 1 --2- 172.21.15.42:0/4066252420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaed0730 0x556aab2d59a0 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.308+0000 7ff990015740 1 --2- 172.21.15.42:0/4066252420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aaaec8550 0x556aab2f1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.308+0000 7ff967400640 0 client.10965 ms_handle_reset on v2:172.21.15.42:6832/3836210591 2024-09-17T01:47:51.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.308+0000 7ff990015740 1 -- 172.21.15.42:0/4066252420 >> 172.21.15.42:0/4066252420 conn(0x556aaaee5560 msgr2=0x556aab2b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:51.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.308+0000 7ff990015740 1 -- 172.21.15.42:0/4066252420 shutdown_connections 2024-09-17T01:47:51.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.308+0000 7ff990015740 1 -- 172.21.15.42:0/4066252420 wait complete. 2024-09-17T01:47:51.311 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.309+0000 7ff990015740 20 client.10965 trim_cache size 0 max 16384 2024-09-17T01:47:51.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.328+0000 7ff990015740 1 Processor -- start 2024-09-17T01:47:51.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.328+0000 7ff990015740 1 -- start start 2024-09-17T01:47:51.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.329+0000 7ff990015740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaec8550 0x556aab292870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.329+0000 7ff990015740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aaaed0730 0x556aab2b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.329+0000 7ff990015740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556aaaef1410 0x556aab2b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.329+0000 7ff990015740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff9841fdf30 con 0x556aaaec8550 2024-09-17T01:47:51.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.329+0000 7ff990015740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff9840b4980 con 0x556aaaed0730 2024-09-17T01:47:51.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.329+0000 7ff990015740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff9840aac60 con 0x556aaaef1410 2024-09-17T01:47:51.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.329+0000 7ff981e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaec8550 0x556aab292870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.330+0000 7ff981e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaec8550 0x556aab292870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36692/0 (socket says 172.21.15.42:36692) 2024-09-17T01:47:51.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.330+0000 7ff981e00640 1 -- 172.21.15.42:0/1770506225 learned_addr learned my addr 172.21.15.42:0/1770506225 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:51.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.330+0000 7ff981e00640 1 -- 172.21.15.42:0/1770506225 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556aaaef1410 msgr2=0x556aab2b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:51.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.330+0000 7ff981e00640 1 --2- 172.21.15.42:0/1770506225 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556aaaef1410 0x556aab2b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.330+0000 7ff981e00640 1 -- 172.21.15.42:0/1770506225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aaaed0730 msgr2=0x556aab2b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:51.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.330+0000 7ff981e00640 1 --2- 172.21.15.42:0/1770506225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aaaed0730 0x556aab2b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.330+0000 7ff981e00640 1 -- 172.21.15.42:0/1770506225 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aaaf3a720 con 0x556aaaec8550 2024-09-17T01:47:51.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.330+0000 7ff981e00640 1 --2- 172.21.15.42:0/1770506225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaec8550 0x556aab292870 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x556aab2db250 tx=0x7ff974001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d5e2026e7b54b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:51.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.330+0000 7ff972000640 1 -- 172.21.15.42:0/1770506225 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974015bd0 con 0x556aaaec8550 2024-09-17T01:47:51.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.330+0000 7ff972000640 1 -- 172.21.15.42:0/1770506225 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff974024620 con 0x556aaaec8550 2024-09-17T01:47:51.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.330+0000 7ff972000640 1 -- 172.21.15.42:0/1770506225 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974015e60 con 0x556aaaec8550 2024-09-17T01:47:51.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.331+0000 7ff990015740 1 -- 172.21.15.42:0/1770506225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaec8550 msgr2=0x556aab292870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:51.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.331+0000 7ff990015740 1 --2- 172.21.15.42:0/1770506225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaec8550 0x556aab292870 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x556aab2db250 tx=0x7ff974001e70 comp rx=0 tx=0).stop 2024-09-17T01:47:51.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.331+0000 7ff990015740 1 -- 172.21.15.42:0/1770506225 shutdown_connections 2024-09-17T01:47:51.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.331+0000 7ff990015740 1 --2- 172.21.15.42:0/1770506225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aaaed0730 0x556aab2b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.331+0000 7ff990015740 1 --2- 172.21.15.42:0/1770506225 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556aaaef1410 0x556aab2b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.331+0000 7ff990015740 1 --2- 172.21.15.42:0/1770506225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaec8550 0x556aab292870 unknown :-1 s=CLOSED pgs=2318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.331+0000 7ff990015740 1 -- 172.21.15.42:0/1770506225 >> 172.21.15.42:0/1770506225 conn(0x556aaaee5560 msgr2=0x556aab2f1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:51.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.331+0000 7ff990015740 1 -- 172.21.15.42:0/1770506225 shutdown_connections 2024-09-17T01:47:51.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.331+0000 7ff990015740 1 -- 172.21.15.42:0/1770506225 wait complete. 2024-09-17T01:47:51.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.332+0000 7ff990015740 1 -- start start 2024-09-17T01:47:51.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.332+0000 7ff990015740 1 Processor -- start 2024-09-17T01:47:51.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.334+0000 7ff990015740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaec8550 0x556aab35c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.334+0000 7ff990015740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556aaaed0730 0x556aab2b9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.334+0000 7ff990015740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aaaef1410 0x556aab297350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.334+0000 7ff990015740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556aab2952d0 con 0x556aaaec8550 2024-09-17T01:47:51.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.334+0000 7ff990015740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff984141e60 con 0x556aaaef1410 2024-09-17T01:47:51.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.334+0000 7ff990015740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x556aab2d4670 con 0x556aaaed0730 2024-09-17T01:47:51.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.334+0000 7ff990015740 10 client.0 _ll_register_callbacks cb 0x7ff96c007c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:47:51.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.334+0000 7ff981e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaec8550 0x556aab35c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.334+0000 7ff981e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaec8550 0x556aab35c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36702/0 (socket says 172.21.15.42:36702) 2024-09-17T01:47:51.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.334+0000 7ff981e00640 1 -- 172.21.15.42:0/2267324107 learned_addr learned my addr 172.21.15.42:0/2267324107 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:51.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.335+0000 7ff981e00640 1 -- 172.21.15.42:0/2267324107 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556aaaed0730 msgr2=0x556aab2b9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:51.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.335+0000 7ff982800640 1 --2- 172.21.15.42:0/2267324107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aaaef1410 0x556aab297350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.335+0000 7ff97be00640 1 --2- 172.21.15.42:0/2267324107 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556aaaed0730 0x556aab2b9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.335+0000 7ff981e00640 1 --2- 172.21.15.42:0/2267324107 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556aaaed0730 0x556aab2b9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.335+0000 7ff981e00640 1 -- 172.21.15.42:0/2267324107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aaaef1410 msgr2=0x556aab297350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:51.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.335+0000 7ff981e00640 1 --2- 172.21.15.42:0/2267324107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aaaef1410 0x556aab297350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.335+0000 7ff981e00640 1 -- 172.21.15.42:0/2267324107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aab305930 con 0x556aaaec8550 2024-09-17T01:47:51.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.335+0000 7ff982800640 1 --2- 172.21.15.42:0/2267324107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aaaef1410 0x556aab297350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:47:51.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.335+0000 7ff97be00640 1 --2- 172.21.15.42:0/2267324107 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556aaaed0730 0x556aab2b9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:47:51.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.335+0000 7ff981e00640 1 --2- 172.21.15.42:0/2267324107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaec8550 0x556aab35c730 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7ff974007c70 tx=0x7ff974024a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1afe1dcbd6b45e4f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:51.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.335+0000 7ff967400640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:47:51.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.335+0000 7ff967400640 1 -- 172.21.15.42:0/2267324107 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97402e070 con 0x556aaaec8550 2024-09-17T01:47:51.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.335+0000 7ff967400640 1 -- 172.21.15.42:0/2267324107 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(200..200 src has 1..200) ==== 5709+0+0 (secure 0 0 0) 0x7ff9740170b0 con 0x556aaaec8550 2024-09-17T01:47:51.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.335+0000 7ff990015740 1 -- 172.21.15.42:0/2267324107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff974024620 con 0x556aaaec8550 2024-09-17T01:47:51.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.335+0000 7ff967400640 1 -- 172.21.15.42:0/2267324107 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=159) ==== 24+0+0 (secure 0 0 0) 0x7ff974015e60 con 0x556aaaec8550 2024-09-17T01:47:51.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.336+0000 7ff990015740 10 client.10971 fetch_fsmap learned FSMap version 159 2024-09-17T01:47:51.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.336+0000 7ff990015740 1 -- 172.21.15.42:0/2267324107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=159,monmap=2+}) -- 0x556aab2ba200 con 0x556aaaec8550 2024-09-17T01:47:51.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.336+0000 7ff967400640 1 -- 172.21.15.42:0/2267324107 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff974024620 con 0x556aaaec8550 2024-09-17T01:47:51.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.336+0000 7ff967400640 1 -- 172.21.15.42:0/2267324107 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 159) ==== 3502+0+0 (secure 0 0 0) 0x7ff97403f080 con 0x556aaaec8550 2024-09-17T01:47:51.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.336+0000 7ff990015740 10 client.10971 fetch_fsmap finished waiting for FSMap version 159 2024-09-17T01:47:51.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.336+0000 7ff990015740 10 client.10971 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-17T01:47:51.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.336+0000 7ff990015740 20 client.10971 populate_metadata read hostname 'smithi042' 2024-09-17T01:47:51.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.336+0000 7ff990015740 1 --2- 172.21.15.42:0/2267324107 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x556aab2d5c30 0x556aab2b2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.336+0000 7ff990015740 4 client.10971 mds_command: new command op to 10776 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2024-09-17T01:47:51.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.336+0000 7ff990015740 1 -- 172.21.15.42:0/2267324107 --> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) -- 0x556aab209940 con 0x556aab2d5c30 2024-09-17T01:47:51.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.336+0000 7ff97be00640 1 --2- 172.21.15.42:0/2267324107 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x556aab2d5c30 0x556aab2b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.339 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.337+0000 7ff97be00640 1 --2- 172.21.15.42:0/2267324107 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x556aab2d5c30 0x556aab2b2480 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e555b524267b85c8 server_cookie=e9d3c63875a9f7d1 in_seq=0 out_seq=0 2024-09-17T01:47:51.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.337+0000 7ff967400640 10 client.10971 ms_handle_connect on v2:172.21.15.42:6832/3836210591 2024-09-17T01:47:51.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.338+0000 7ff967400640 1 -- 172.21.15.42:0/2267324107 <== mds.0 v2:172.21.15.42:6832/3836210591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556aab209940 con 0x556aab2d5c30 2024-09-17T01:47:51.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.338+0000 7ff967400640 10 client.10971 handle_command_reply: tid=0 2024-09-17T01:47:51.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.338+0000 7ff990015740 1 client.10971 shutdown 2024-09-17T01:47:51.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.338+0000 7ff990015740 1 -- 172.21.15.42:0/2267324107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaec8550 msgr2=0x556aab35c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:51.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.338+0000 7ff990015740 1 --2- 172.21.15.42:0/2267324107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaec8550 0x556aab35c730 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7ff974007c70 tx=0x7ff974024a00 comp rx=0 tx=0).stop 2024-09-17T01:47:51.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.338+0000 7ff990015740 1 -- 172.21.15.42:0/2267324107 shutdown_connections 2024-09-17T01:47:51.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.338+0000 7ff990015740 1 --2- 172.21.15.42:0/2267324107 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x556aab2d5c30 0x556aab2b2480 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.338+0000 7ff990015740 1 --2- 172.21.15.42:0/2267324107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556aaaef1410 0x556aab297350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.338+0000 7ff990015740 1 --2- 172.21.15.42:0/2267324107 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x556aaaed0730 0x556aab2b9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.338+0000 7ff990015740 1 --2- 172.21.15.42:0/2267324107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556aaaec8550 0x556aab35c730 unknown :-1 s=CLOSED pgs=2319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.338+0000 7ff967400640 0 client.10971 ms_handle_reset on v2:172.21.15.42:6832/3836210591 2024-09-17T01:47:51.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.338+0000 7ff990015740 1 -- 172.21.15.42:0/2267324107 >> 172.21.15.42:0/2267324107 conn(0x556aaaee5560 msgr2=0x556aab294540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:51.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.339+0000 7ff990015740 1 -- 172.21.15.42:0/2267324107 shutdown_connections 2024-09-17T01:47:51.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.339+0000 7ff990015740 1 -- 172.21.15.42:0/2267324107 wait complete. 2024-09-17T01:47:51.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.339+0000 7ff990015740 20 client.10971 trim_cache size 0 max 16384 2024-09-17T01:47:51.341 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:47:51.341 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-17T01:47:51.341 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "ea90eb79-0b7c-4955-8fc1-03979dbe7849", 2024-09-17T01:47:51.341 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-17T01:47:51.341 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:47:51.342 INFO:tasks.ceph.mds.c.smithi042.stderr:2024-09-17T01:47:51.339+0000 7f989aa00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 pv8 ap=4 DIRTYPARENT s=5242880 n(v0 rc2024-09-17T01:47:49.637933+0000 b5242880 1=1+0)->n(v0 rc2024-09-17T01:47:49.642933+0000 b6291456 1=1+0) (iauth excl) (ifile lock->excl w=1) (ixattr excl) (iquiesce lock w=1) cr={10159=0-12582912@1} caps={10159=pAsxLsXsxFcb/pAsxXsxFxwb@5},l=10159 | ptrwaiter=1 request=1 lock=3 caps=1 dirtyparent=1 dirty=0 waiter=1 authpin=1 scrubqueue=0 0x56405f11a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(29)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-17T01:47:51.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.339+0000 7ff983200640 1 -- 172.21.15.42:0/48673000 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff960078b90 msgr2=0x7ff96007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:51.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.339+0000 7ff983200640 1 --2- 172.21.15.42:0/48673000 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff960078b90 0x7ff96007b0a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7ff9740046b0 tx=0x7ff974009040 comp rx=0 tx=0).stop 2024-09-17T01:47:51.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.339+0000 7ff983200640 1 -- 172.21.15.42:0/48673000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff98415b820 msgr2=0x7ff9841f7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:51.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.339+0000 7ff983200640 1 --2- 172.21.15.42:0/48673000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff98415b820 0x7ff9841f7520 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7ff97c02aeb0 tx=0x7ff97c003ba0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.340+0000 7ff983200640 1 -- 172.21.15.42:0/48673000 shutdown_connections 2024-09-17T01:47:51.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.340+0000 7ff983200640 1 --2- 172.21.15.42:0/48673000 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff960078b90 0x7ff96007b0a0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.340+0000 7ff983200640 1 --2- 172.21.15.42:0/48673000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff98415b820 0x7ff9841f7520 unknown :-1 s=CLOSED pgs=2315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.340+0000 7ff983200640 1 --2- 172.21.15.42:0/48673000 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff984145a70 0x7ff98413de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.340+0000 7ff983200640 1 --2- 172.21.15.42:0/48673000 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9840cd860 0x7ff98415b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.340+0000 7ff983200640 1 -- 172.21.15.42:0/48673000 >> 172.21.15.42:0/48673000 conn(0x7ff98406cfa0 msgr2=0x7ff98415f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:51.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.340+0000 7ff983200640 1 -- 172.21.15.42:0/48673000 shutdown_connections 2024-09-17T01:47:51.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.340+0000 7ff983200640 1 -- 172.21.15.42:0/48673000 wait complete. 2024-09-17T01:47:51.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:47:51.364 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub status 2024-09-17T01:47:51.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.596+0000 7ff66de00640 1 -- 172.21.15.42:0/1132427642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6680b2bb0 msgr2=0x7ff668160520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:51.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.596+0000 7ff66de00640 1 --2- 172.21.15.42:0/1132427642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6680b2bb0 0x7ff668160520 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7ff668071f30 tx=0x7ff65402a570 comp rx=0 tx=0).stop 2024-09-17T01:47:51.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.597+0000 7ff66de00640 1 -- 172.21.15.42:0/1132427642 shutdown_connections 2024-09-17T01:47:51.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.597+0000 7ff66de00640 1 --2- 172.21.15.42:0/1132427642 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff668160a60 0x7ff66815cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.597+0000 7ff66de00640 1 --2- 172.21.15.42:0/1132427642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6680b2bb0 0x7ff668160520 unknown :-1 s=CLOSED pgs=2320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.597+0000 7ff66de00640 1 --2- 172.21.15.42:0/1132427642 >> v2:172.21.15.43:3300/0 conn(0x7ff668161210 0x7ff6680afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.597+0000 7ff66de00640 1 -- 172.21.15.42:0/1132427642 >> 172.21.15.42:0/1132427642 conn(0x7ff66806d3f0 msgr2=0x7ff6680b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:51.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.597+0000 7ff66de00640 1 -- 172.21.15.42:0/1132427642 shutdown_connections 2024-09-17T01:47:51.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.597+0000 7ff66de00640 1 -- 172.21.15.42:0/1132427642 wait complete. 2024-09-17T01:47:51.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.599+0000 7ff66de00640 1 Processor -- start 2024-09-17T01:47:51.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.600+0000 7ff66de00640 1 -- start start 2024-09-17T01:47:51.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.602+0000 7ff66de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6680b2bb0 0x7ff6680ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.602+0000 7ff66de00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff668160a60 0x7ff6680aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.602+0000 7ff66de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff668161210 0x7ff6681f8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.602+0000 7ff66de00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff66815d5a0 con 0x7ff6680b2bb0 2024-09-17T01:47:51.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.602+0000 7ff66de00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff66815d420 con 0x7ff668161210 2024-09-17T01:47:51.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.602+0000 7ff66de00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff66815d720 con 0x7ff668160a60 2024-09-17T01:47:51.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.603+0000 7ff66ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6680b2bb0 0x7ff6680ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.603+0000 7ff667e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff668160a60 0x7ff6680aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.603+0000 7ff667e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff668160a60 0x7ff6680aedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:45886/0 (socket says 172.21.15.42:45886) 2024-09-17T01:47:51.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.603+0000 7ff667e00640 1 -- 172.21.15.42:0/1540813573 learned_addr learned my addr 172.21.15.42:0/1540813573 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:51.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.603+0000 7ff66d400640 1 --2- 172.21.15.42:0/1540813573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff668161210 0x7ff6681f8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.603+0000 7ff667e00640 1 -- 172.21.15.42:0/1540813573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff668161210 msgr2=0x7ff6681f8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:51.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.603+0000 7ff667e00640 1 --2- 172.21.15.42:0/1540813573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff668161210 0x7ff6681f8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.603+0000 7ff667e00640 1 -- 172.21.15.42:0/1540813573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6680b2bb0 msgr2=0x7ff6680ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:51.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.603+0000 7ff667e00640 1 --2- 172.21.15.42:0/1540813573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6680b2bb0 0x7ff6680ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.603+0000 7ff667e00640 1 -- 172.21.15.42:0/1540813573 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff668151b10 con 0x7ff668160a60 2024-09-17T01:47:51.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.603+0000 7ff66d400640 1 --2- 172.21.15.42:0/1540813573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff668161210 0x7ff6681f8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:47:51.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.604+0000 7ff667e00640 1 --2- 172.21.15.42:0/1540813573 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff668160a60 0x7ff6680aedd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff654006010 tx=0x7ff654005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:51.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.605+0000 7ff664c00640 1 -- 172.21.15.42:0/1540813573 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65403e030 con 0x7ff668160a60 2024-09-17T01:47:51.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.605+0000 7ff664c00640 1 -- 172.21.15.42:0/1540813573 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff654003c30 con 0x7ff668160a60 2024-09-17T01:47:51.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.605+0000 7ff664c00640 1 -- 172.21.15.42:0/1540813573 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff654035040 con 0x7ff668160a60 2024-09-17T01:47:51.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.605+0000 7ff66de00640 1 -- 172.21.15.42:0/1540813573 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6681f5810 con 0x7ff668160a60 2024-09-17T01:47:51.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.605+0000 7ff66de00640 1 -- 172.21.15.42:0/1540813573 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6681f5dd0 con 0x7ff668160a60 2024-09-17T01:47:51.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.609+0000 7ff664c00640 1 -- 172.21.15.42:0/1540813573 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff654041030 con 0x7ff668160a60 2024-09-17T01:47:51.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.610+0000 7ff664c00640 1 --2- 172.21.15.42:0/1540813573 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff648078bc0 0x7ff64807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.610+0000 7ff6765dd740 1 Processor -- start 2024-09-17T01:47:51.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.610+0000 7ff664c00640 1 -- 172.21.15.42:0/1540813573 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(201..201 src has 1..201) ==== 5854+0+0 (secure 0 0 0) 0x7ff6540bb400 con 0x7ff668160a60 2024-09-17T01:47:51.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.610+0000 7ff6765dd740 1 -- start start 2024-09-17T01:47:51.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.610+0000 7ff66ca00640 1 --2- 172.21.15.42:0/1540813573 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff648078bc0 0x7ff64807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.611+0000 7ff66ca00640 1 --2- 172.21.15.42:0/1540813573 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff648078bc0 0x7ff64807b0d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff65c009ab0 tx=0x7ff65c005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:51.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.612+0000 7ff6765dd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560d1ff81390 0x560d2036f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.612+0000 7ff6765dd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff584d0 0x560d20352400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.612+0000 7ff6765dd740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560d1ff606b0 0x560d20352940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.612+0000 7ff6765dd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560d202881c0 con 0x560d1ff584d0 2024-09-17T01:47:51.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.612+0000 7ff6765dd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560d2029b870 con 0x560d1ff81390 2024-09-17T01:47:51.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.612+0000 7ff6765dd740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x560d2028aca0 con 0x560d1ff606b0 2024-09-17T01:47:51.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.612+0000 7ff667e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff584d0 0x560d20352400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.612+0000 7ff667e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff584d0 0x560d20352400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36730/0 (socket says 172.21.15.42:36730) 2024-09-17T01:47:51.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.612+0000 7ff667e00640 1 -- 172.21.15.42:0/4265235092 learned_addr learned my addr 172.21.15.42:0/4265235092 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:51.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.612+0000 7ff66ca00640 1 --2- 172.21.15.42:0/4265235092 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560d1ff81390 0x560d2036f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.612+0000 7ff66d400640 1 --2- 172.21.15.42:0/4265235092 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560d1ff606b0 0x560d20352940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.612+0000 7ff667e00640 1 -- 172.21.15.42:0/4265235092 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560d1ff606b0 msgr2=0x560d20352940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:51.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.612+0000 7ff667e00640 1 --2- 172.21.15.42:0/4265235092 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560d1ff606b0 0x560d20352940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.612+0000 7ff667e00640 1 -- 172.21.15.42:0/4265235092 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560d1ff81390 msgr2=0x560d2036f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:51.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.612+0000 7ff667e00640 1 --2- 172.21.15.42:0/4265235092 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560d1ff81390 0x560d2036f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.612+0000 7ff667e00640 1 -- 172.21.15.42:0/4265235092 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d200637d0 con 0x560d1ff584d0 2024-09-17T01:47:51.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.612+0000 7ff66d400640 1 --2- 172.21.15.42:0/4265235092 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560d1ff606b0 0x560d20352940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:47:51.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.613+0000 7ff667e00640 1 --2- 172.21.15.42:0/4265235092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff584d0 0x560d20352400 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7ff654082fa0 tx=0x7ff654082aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f942f91d52fd506 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:51.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.613+0000 7ff659200640 1 -- 172.21.15.42:0/4265235092 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff654048070 con 0x560d1ff584d0 2024-09-17T01:47:51.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.613+0000 7ff659200640 1 -- 172.21.15.42:0/4265235092 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff654083150 con 0x560d1ff584d0 2024-09-17T01:47:51.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.613+0000 7ff659200640 1 -- 172.21.15.42:0/4265235092 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff654087b80 con 0x560d1ff584d0 2024-09-17T01:47:51.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.614+0000 7ff6765dd740 1 -- 172.21.15.42:0/4265235092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff584d0 msgr2=0x560d20352400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:51.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.614+0000 7ff6765dd740 1 --2- 172.21.15.42:0/4265235092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff584d0 0x560d20352400 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7ff654082fa0 tx=0x7ff654082aa0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.614+0000 7ff6765dd740 1 -- 172.21.15.42:0/4265235092 shutdown_connections 2024-09-17T01:47:51.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.614+0000 7ff6765dd740 1 --2- 172.21.15.42:0/4265235092 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560d1ff606b0 0x560d20352940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.614+0000 7ff6765dd740 1 --2- 172.21.15.42:0/4265235092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff584d0 0x560d20352400 unknown :-1 s=CLOSED pgs=2321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.614+0000 7ff6765dd740 1 --2- 172.21.15.42:0/4265235092 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560d1ff81390 0x560d2036f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.614+0000 7ff6765dd740 1 -- 172.21.15.42:0/4265235092 >> 172.21.15.42:0/4265235092 conn(0x560d1ff754e0 msgr2=0x560d20328620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:51.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.614+0000 7ff6765dd740 1 -- 172.21.15.42:0/4265235092 shutdown_connections 2024-09-17T01:47:51.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.614+0000 7ff6765dd740 1 -- 172.21.15.42:0/4265235092 wait complete. 2024-09-17T01:47:51.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.615+0000 7ff6765dd740 1 -- start start 2024-09-17T01:47:51.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.615+0000 7ff6765dd740 1 Processor -- start 2024-09-17T01:47:51.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.617+0000 7ff6765dd740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560d1ff584d0 0x560d20366770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.617+0000 7ff6765dd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560d1ff606b0 0x560d203803a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.617+0000 7ff6765dd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff81390 0x560d20340640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.617+0000 7ff6765dd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560d20231410 con 0x560d1ff81390 2024-09-17T01:47:51.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.617+0000 7ff6765dd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560d2028eab0 con 0x560d1ff606b0 2024-09-17T01:47:51.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.617+0000 7ff6765dd740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x560d1fffb740 con 0x560d1ff584d0 2024-09-17T01:47:51.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.617+0000 7ff6765dd740 10 client.0 _ll_register_callbacks cb 0x560d2020e360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:47:51.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.617+0000 7ff66d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff81390 0x560d20340640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.617+0000 7ff66d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff81390 0x560d20340640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36742/0 (socket says 172.21.15.42:36742) 2024-09-17T01:47:51.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.617+0000 7ff66d400640 1 -- 172.21.15.42:0/4092676279 learned_addr learned my addr 172.21.15.42:0/4092676279 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:51.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.617+0000 7ff667e00640 1 --2- 172.21.15.42:0/4092676279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560d1ff606b0 0x560d203803a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.617+0000 7ff66ca00640 1 --2- 172.21.15.42:0/4092676279 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560d1ff584d0 0x560d20366770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.617+0000 7ff66d400640 1 -- 172.21.15.42:0/4092676279 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560d1ff584d0 msgr2=0x560d20366770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:51.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.617+0000 7ff66d400640 1 --2- 172.21.15.42:0/4092676279 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560d1ff584d0 0x560d20366770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.618+0000 7ff66d400640 1 -- 172.21.15.42:0/4092676279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560d1ff606b0 msgr2=0x560d203803a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:51.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.618+0000 7ff66d400640 1 --2- 172.21.15.42:0/4092676279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560d1ff606b0 0x560d203803a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.618+0000 7ff66d400640 1 -- 172.21.15.42:0/4092676279 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d1ffec970 con 0x560d1ff81390 2024-09-17T01:47:51.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.618+0000 7ff66d400640 1 --2- 172.21.15.42:0/4092676279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff81390 0x560d20340640 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7ff660005fd0 tx=0x7ff660012cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deee6c9bf282ae41 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:51.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.618+0000 7ff64d600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:47:51.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.618+0000 7ff64d600640 1 -- 172.21.15.42:0/4092676279 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff660010e80 con 0x560d1ff81390 2024-09-17T01:47:51.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.618+0000 7ff64d600640 1 -- 172.21.15.42:0/4092676279 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(201..201 src has 1..201) ==== 5854+0+0 (secure 0 0 0) 0x7ff660004b20 con 0x560d1ff81390 2024-09-17T01:47:51.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.618+0000 7ff6765dd740 1 -- 172.21.15.42:0/4092676279 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff654083150 con 0x560d1ff81390 2024-09-17T01:47:51.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.618+0000 7ff64d600640 1 -- 172.21.15.42:0/4092676279 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=159) ==== 24+0+0 (secure 0 0 0) 0x7ff66001c440 con 0x560d1ff81390 2024-09-17T01:47:51.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.618+0000 7ff6765dd740 10 client.10983 fetch_fsmap learned FSMap version 159 2024-09-17T01:47:51.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.618+0000 7ff6765dd740 1 -- 172.21.15.42:0/4092676279 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=159,monmap=2+}) -- 0x560d1ffca6a0 con 0x560d1ff81390 2024-09-17T01:47:51.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.619+0000 7ff64d600640 1 -- 172.21.15.42:0/4092676279 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff654083150 con 0x560d1ff81390 2024-09-17T01:47:51.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.619+0000 7ff64d600640 1 -- 172.21.15.42:0/4092676279 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 159) ==== 3502+0+0 (secure 0 0 0) 0x7ff660027080 con 0x560d1ff81390 2024-09-17T01:47:51.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.619+0000 7ff6765dd740 10 client.10983 fetch_fsmap finished waiting for FSMap version 159 2024-09-17T01:47:51.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.619+0000 7ff6765dd740 10 client.10983 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-17T01:47:51.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.619+0000 7ff6765dd740 20 client.10983 populate_metadata read hostname 'smithi042' 2024-09-17T01:47:51.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.619+0000 7ff6765dd740 1 --2- 172.21.15.42:0/4092676279 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x560d1ff3ff60 0x560d20328060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.619+0000 7ff6765dd740 4 client.10983 mds_command: new command op to 10776 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:47:51.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.619+0000 7ff6765dd740 1 -- 172.21.15.42:0/4092676279 --> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d2029d7c0 con 0x560d1ff3ff60 2024-09-17T01:47:51.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.619+0000 7ff66ca00640 1 --2- 172.21.15.42:0/4092676279 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x560d1ff3ff60 0x560d20328060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.620+0000 7ff66ca00640 1 --2- 172.21.15.42:0/4092676279 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x560d1ff3ff60 0x560d20328060 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2ac34fee4e8e53d server_cookie=64b50fc143680055 in_seq=0 out_seq=0 2024-09-17T01:47:51.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.620+0000 7ff64d600640 10 client.10983 ms_handle_connect on v2:172.21.15.42:6832/3836210591 2024-09-17T01:47:51.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.620+0000 7ff64d600640 1 -- 172.21.15.42:0/4092676279 <== mds.0 v2:172.21.15.42:6832/3836210591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d2029d7c0 con 0x560d1ff3ff60 2024-09-17T01:47:51.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.620+0000 7ff64d600640 10 client.10983 handle_command_reply: tid=0 2024-09-17T01:47:51.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.621+0000 7ff6765dd740 1 client.10983 shutdown 2024-09-17T01:47:51.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.621+0000 7ff6765dd740 1 -- 172.21.15.42:0/4092676279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff81390 msgr2=0x560d20340640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:51.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.621+0000 7ff6765dd740 1 --2- 172.21.15.42:0/4092676279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff81390 0x560d20340640 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7ff660005fd0 tx=0x7ff660012cd0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.621+0000 7ff6765dd740 1 -- 172.21.15.42:0/4092676279 shutdown_connections 2024-09-17T01:47:51.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.621+0000 7ff6765dd740 1 --2- 172.21.15.42:0/4092676279 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x560d1ff3ff60 0x560d20328060 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.621+0000 7ff6765dd740 1 --2- 172.21.15.42:0/4092676279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560d1ff606b0 0x560d203803a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.621+0000 7ff6765dd740 1 --2- 172.21.15.42:0/4092676279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff81390 0x560d20340640 unknown :-1 s=CLOSED pgs=2322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.621+0000 7ff6765dd740 1 --2- 172.21.15.42:0/4092676279 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560d1ff584d0 0x560d20366770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.621+0000 7ff6765dd740 1 -- 172.21.15.42:0/4092676279 >> 172.21.15.42:0/4092676279 conn(0x560d1ff754e0 msgr2=0x560d20329600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:51.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.621+0000 7ff64d600640 0 client.10983 ms_handle_reset on v2:172.21.15.42:6832/3836210591 2024-09-17T01:47:51.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.621+0000 7ff6765dd740 1 -- 172.21.15.42:0/4092676279 shutdown_connections 2024-09-17T01:47:51.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.621+0000 7ff6765dd740 1 -- 172.21.15.42:0/4092676279 wait complete. 2024-09-17T01:47:51.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.621+0000 7ff6765dd740 20 client.10983 trim_cache size 0 max 16384 2024-09-17T01:47:51.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.640+0000 7ff6765dd740 1 Processor -- start 2024-09-17T01:47:51.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.640+0000 7ff6765dd740 1 -- start start 2024-09-17T01:47:51.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.641+0000 7ff6765dd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff584d0 0x560d20329910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.641 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.641+0000 7ff6765dd740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560d1ff606b0 0x560d20366180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.642+0000 7ff6765dd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560d1ff81390 0x560d203666c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.642+0000 7ff6765dd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff668202440 con 0x560d1ff584d0 2024-09-17T01:47:51.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.642+0000 7ff6765dd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff668201480 con 0x560d1ff81390 2024-09-17T01:47:51.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.642+0000 7ff6765dd740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff6681419d0 con 0x560d1ff606b0 2024-09-17T01:47:51.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.642+0000 7ff66ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff584d0 0x560d20329910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.642+0000 7ff66ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff584d0 0x560d20329910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36758/0 (socket says 172.21.15.42:36758) 2024-09-17T01:47:51.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.642+0000 7ff66ca00640 1 -- 172.21.15.42:0/841683604 learned_addr learned my addr 172.21.15.42:0/841683604 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:51.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.642+0000 7ff667e00640 1 --2- 172.21.15.42:0/841683604 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560d1ff606b0 0x560d20366180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.642+0000 7ff66d400640 1 --2- 172.21.15.42:0/841683604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560d1ff81390 0x560d203666c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.642+0000 7ff66ca00640 1 -- 172.21.15.42:0/841683604 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560d1ff606b0 msgr2=0x560d20366180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:51.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.642+0000 7ff66ca00640 1 --2- 172.21.15.42:0/841683604 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560d1ff606b0 0x560d20366180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.642+0000 7ff66ca00640 1 -- 172.21.15.42:0/841683604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560d1ff81390 msgr2=0x560d203666c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:51.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.642+0000 7ff66ca00640 1 --2- 172.21.15.42:0/841683604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560d1ff81390 0x560d203666c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.642+0000 7ff66ca00640 1 -- 172.21.15.42:0/841683604 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d2036e7b0 con 0x560d1ff584d0 2024-09-17T01:47:51.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.642+0000 7ff66ca00640 1 --2- 172.21.15.42:0/841683604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff584d0 0x560d20329910 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x560d20340dc0 tx=0x7ff65c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6637e1ec24f6c4d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:51.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.643+0000 7ff64fe00640 1 -- 172.21.15.42:0/841683604 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c004420 con 0x560d1ff584d0 2024-09-17T01:47:51.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.643+0000 7ff64fe00640 1 -- 172.21.15.42:0/841683604 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff65c029420 con 0x560d1ff584d0 2024-09-17T01:47:51.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.643+0000 7ff64fe00640 1 -- 172.21.15.42:0/841683604 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c029830 con 0x560d1ff584d0 2024-09-17T01:47:51.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.643+0000 7ff6765dd740 1 -- 172.21.15.42:0/841683604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff584d0 msgr2=0x560d20329910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:51.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.643+0000 7ff6765dd740 1 --2- 172.21.15.42:0/841683604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff584d0 0x560d20329910 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x560d20340dc0 tx=0x7ff65c014000 comp rx=0 tx=0).stop 2024-09-17T01:47:51.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.643+0000 7ff6765dd740 1 -- 172.21.15.42:0/841683604 shutdown_connections 2024-09-17T01:47:51.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.643+0000 7ff6765dd740 1 --2- 172.21.15.42:0/841683604 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560d1ff81390 0x560d203666c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.643+0000 7ff6765dd740 1 --2- 172.21.15.42:0/841683604 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560d1ff606b0 0x560d20366180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.643+0000 7ff6765dd740 1 --2- 172.21.15.42:0/841683604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff584d0 0x560d20329910 unknown :-1 s=CLOSED pgs=2323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.643+0000 7ff6765dd740 1 -- 172.21.15.42:0/841683604 >> 172.21.15.42:0/841683604 conn(0x560d1ff754e0 msgr2=0x560d2036df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:51.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.644+0000 7ff6765dd740 1 -- 172.21.15.42:0/841683604 shutdown_connections 2024-09-17T01:47:51.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.644+0000 7ff6765dd740 1 -- 172.21.15.42:0/841683604 wait complete. 2024-09-17T01:47:51.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.644+0000 7ff6765dd740 1 -- start start 2024-09-17T01:47:51.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.645+0000 7ff6765dd740 1 Processor -- start 2024-09-17T01:47:51.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.646+0000 7ff6765dd740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560d1ff584d0 0x560d203ebce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.646+0000 7ff6765dd740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff606b0 0x560d20340170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.646+0000 7ff6765dd740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560d1ff81390 0x560d203406b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.646+0000 7ff6765dd740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff668200ff0 con 0x560d1ff606b0 2024-09-17T01:47:51.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.646+0000 7ff6765dd740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560d203ec8f0 con 0x560d1ff584d0 2024-09-17T01:47:51.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.646+0000 7ff6765dd740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x560d20352e70 con 0x560d1ff81390 2024-09-17T01:47:51.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.646+0000 7ff6765dd740 10 client.0 _ll_register_callbacks cb 0x7ff660009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:47:51.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.646+0000 7ff667e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff606b0 0x560d20340170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.647+0000 7ff667e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff606b0 0x560d20340170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:36760/0 (socket says 172.21.15.42:36760) 2024-09-17T01:47:51.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.647+0000 7ff667e00640 1 -- 172.21.15.42:0/2642786883 learned_addr learned my addr 172.21.15.42:0/2642786883 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:47:51.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.647+0000 7ff66ca00640 1 --2- 172.21.15.42:0/2642786883 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560d1ff584d0 0x560d203ebce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.647+0000 7ff66d400640 1 --2- 172.21.15.42:0/2642786883 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560d1ff81390 0x560d203406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.647+0000 7ff667e00640 1 -- 172.21.15.42:0/2642786883 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560d1ff81390 msgr2=0x560d203406b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:51.652 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.647+0000 7ff667e00640 1 --2- 172.21.15.42:0/2642786883 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560d1ff81390 0x560d203406b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.647+0000 7ff667e00640 1 -- 172.21.15.42:0/2642786883 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560d1ff584d0 msgr2=0x560d203ebce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:47:51.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.647+0000 7ff667e00640 1 --2- 172.21.15.42:0/2642786883 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560d1ff584d0 0x560d203ebce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.647+0000 7ff667e00640 1 -- 172.21.15.42:0/2642786883 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d20363a30 con 0x560d1ff606b0 2024-09-17T01:47:51.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.647+0000 7ff667e00640 1 --2- 172.21.15.42:0/2642786883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff606b0 0x560d20340170 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7ff654087040 tx=0x7ff6540bb300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a6179cf418d65a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:51.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.647+0000 7ff64d600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:47:51.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.647+0000 7ff64d600640 1 -- 172.21.15.42:0/2642786883 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff654048040 con 0x560d1ff606b0 2024-09-17T01:47:51.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.647+0000 7ff64d600640 1 -- 172.21.15.42:0/2642786883 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(201..201 src has 1..201) ==== 5854+0+0 (secure 0 0 0) 0x7ff6540a93e0 con 0x560d1ff606b0 2024-09-17T01:47:51.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.647+0000 7ff6765dd740 1 -- 172.21.15.42:0/2642786883 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff65c029420 con 0x560d1ff606b0 2024-09-17T01:47:51.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.648+0000 7ff64d600640 1 -- 172.21.15.42:0/2642786883 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=159) ==== 24+0+0 (secure 0 0 0) 0x7ff6540a5050 con 0x560d1ff606b0 2024-09-17T01:47:51.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.648+0000 7ff6765dd740 10 client.10989 fetch_fsmap learned FSMap version 159 2024-09-17T01:47:51.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.648+0000 7ff6765dd740 1 -- 172.21.15.42:0/2642786883 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=159,monmap=2+}) -- 0x560d203ec220 con 0x560d1ff606b0 2024-09-17T01:47:51.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.648+0000 7ff64d600640 1 -- 172.21.15.42:0/2642786883 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff65c029420 con 0x560d1ff606b0 2024-09-17T01:47:51.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.648+0000 7ff64d600640 1 -- 172.21.15.42:0/2642786883 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 159) ==== 3502+0+0 (secure 0 0 0) 0x7ff65408c5a0 con 0x560d1ff606b0 2024-09-17T01:47:51.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.648+0000 7ff6765dd740 10 client.10989 fetch_fsmap finished waiting for FSMap version 159 2024-09-17T01:47:51.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.648+0000 7ff6765dd740 10 client.10989 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-17T01:47:51.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.648+0000 7ff6765dd740 20 client.10989 populate_metadata read hostname 'smithi042' 2024-09-17T01:47:51.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.648+0000 7ff6765dd740 1 --2- 172.21.15.42:0/2642786883 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x560d20364600 0x560d203efbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:51.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.648+0000 7ff6765dd740 4 client.10989 mds_command: new command op to 10776 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:47:51.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.648+0000 7ff6765dd740 1 -- 172.21.15.42:0/2642786883 --> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560d20299270 con 0x560d20364600 2024-09-17T01:47:51.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.648+0000 7ff66ca00640 1 --2- 172.21.15.42:0/2642786883 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x560d20364600 0x560d203efbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:51.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.649+0000 7ff66ca00640 1 --2- 172.21.15.42:0/2642786883 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x560d20364600 0x560d203efbe0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b96a2a0fec392401 server_cookie=24ea85642e0d6412 in_seq=0 out_seq=0 2024-09-17T01:47:51.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.649+0000 7ff64d600640 10 client.10989 ms_handle_connect on v2:172.21.15.42:6832/3836210591 2024-09-17T01:47:51.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.649+0000 7ff64d600640 1 -- 172.21.15.42:0/2642786883 <== mds.0 v2:172.21.15.42:6832/3836210591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+571 (crc 0 0 0) 0x560d20299270 con 0x560d20364600 2024-09-17T01:47:51.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.649+0000 7ff64d600640 10 client.10989 handle_command_reply: tid=0 2024-09-17T01:47:51.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.649+0000 7ff6765dd740 1 client.10989 shutdown 2024-09-17T01:47:51.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.649+0000 7ff6765dd740 1 -- 172.21.15.42:0/2642786883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff606b0 msgr2=0x560d20340170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:51.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.649+0000 7ff6765dd740 1 --2- 172.21.15.42:0/2642786883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff606b0 0x560d20340170 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7ff654087040 tx=0x7ff6540bb300 comp rx=0 tx=0).stop 2024-09-17T01:47:51.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.649+0000 7ff6765dd740 1 -- 172.21.15.42:0/2642786883 shutdown_connections 2024-09-17T01:47:51.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.649+0000 7ff6765dd740 1 --2- 172.21.15.42:0/2642786883 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x560d20364600 0x560d203efbe0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.649+0000 7ff6765dd740 1 --2- 172.21.15.42:0/2642786883 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x560d1ff81390 0x560d203406b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.649+0000 7ff6765dd740 1 --2- 172.21.15.42:0/2642786883 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560d1ff606b0 0x560d20340170 unknown :-1 s=CLOSED pgs=2324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.649+0000 7ff6765dd740 1 --2- 172.21.15.42:0/2642786883 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560d1ff584d0 0x560d203ebce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.649+0000 7ff6765dd740 1 -- 172.21.15.42:0/2642786883 >> 172.21.15.42:0/2642786883 conn(0x560d1ff754e0 msgr2=0x560d20369f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:51.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.649+0000 7ff64d600640 0 client.10989 ms_handle_reset on v2:172.21.15.42:6832/3836210591 2024-09-17T01:47:51.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.650+0000 7ff6765dd740 1 -- 172.21.15.42:0/2642786883 shutdown_connections 2024-09-17T01:47:51.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.650+0000 7ff6765dd740 1 -- 172.21.15.42:0/2642786883 wait complete. 2024-09-17T01:47:51.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.650+0000 7ff6765dd740 20 client.10989 trim_cache size 0 max 16384 2024-09-17T01:47:51.660 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:47:51.660 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T01:47:51.661 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-09-17T01:47:51.661 INFO:teuthology.orchestra.run.smithi042.stdout: "ea90eb79-0b7c-4955-8fc1-03979dbe7849": { 2024-09-17T01:47:51.661 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-17T01:47:51.661 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "ea90eb79-0b7c-4955-8fc1-03979dbe7849", 2024-09-17T01:47:51.661 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive,repair" 2024-09-17T01:47:51.661 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:51.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:47:51.662 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_stats": { 2024-09-17T01:47:51.662 INFO:teuthology.orchestra.run.smithi042.stdout: "ea90eb79-0b7c-4955-8fc1-03979dbe7849": { 2024-09-17T01:47:51.662 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:47:51.337919+0000", 2024-09-17T01:47:51.662 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-17T01:47:51.662 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:47:51.662 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:47:51.663 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:47:51.663 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:47:51.663 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:51.663 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:47:51.663 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:47:51.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.650+0000 7ff66de00640 1 -- 172.21.15.42:0/1540813573 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff648078bc0 msgr2=0x7ff64807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:51.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.650+0000 7ff66de00640 1 --2- 172.21.15.42:0/1540813573 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff648078bc0 0x7ff64807b0d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff65c009ab0 tx=0x7ff65c005f90 comp rx=0 tx=0).stop 2024-09-17T01:47:51.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.650+0000 7ff66de00640 1 -- 172.21.15.42:0/1540813573 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff668160a60 msgr2=0x7ff6680aedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:51.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.650+0000 7ff66de00640 1 --2- 172.21.15.42:0/1540813573 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff668160a60 0x7ff6680aedd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff654006010 tx=0x7ff654005e80 comp rx=0 tx=0).stop 2024-09-17T01:47:51.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.650+0000 7ff66de00640 1 -- 172.21.15.42:0/1540813573 shutdown_connections 2024-09-17T01:47:51.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.650+0000 7ff66de00640 1 --2- 172.21.15.42:0/1540813573 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff648078bc0 0x7ff64807b0d0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.650+0000 7ff66de00640 1 --2- 172.21.15.42:0/1540813573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff668161210 0x7ff6681f8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.650+0000 7ff66de00640 1 --2- 172.21.15.42:0/1540813573 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff668160a60 0x7ff6680aedd0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.650+0000 7ff66de00640 1 --2- 172.21.15.42:0/1540813573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6680b2bb0 0x7ff6680ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:51.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.651+0000 7ff66de00640 1 -- 172.21.15.42:0/1540813573 >> 172.21.15.42:0/1540813573 conn(0x7ff66806d3f0 msgr2=0x7ff66815de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:51.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.651+0000 7ff66de00640 1 -- 172.21.15.42:0/1540813573 shutdown_connections 2024-09-17T01:47:51.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:47:51.651+0000 7ff66de00640 1 -- 172.21.15.42:0/1540813573 wait complete. 2024-09-17T01:47:51.671 INFO:tasks.cephfs.filesystem:scrub status for tag:ea90eb79-0b7c-4955-8fc1-03979dbe7849 - {'path': '/', 'tag': 'ea90eb79-0b7c-4955-8fc1-03979dbe7849', 'options': 'recursive,repair'} 2024-09-17T01:47:52.131 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:47:52.136 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:48:21.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:48:21.673 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub status 2024-09-17T01:48:21.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.916+0000 7f4feea00640 1 -- 172.21.15.42:0/2875760650 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fe80cdcf0 msgr2=0x7f4fe80cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:21.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.916+0000 7f4feea00640 1 --2- 172.21.15.42:0/2875760650 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fe80cdcf0 0x7f4fe80cef80 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc005fd0 tx=0x7f4fdc02a5f0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.916+0000 7f4feea00640 1 -- 172.21.15.42:0/2875760650 shutdown_connections 2024-09-17T01:48:21.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.916+0000 7f4feea00640 1 --2- 172.21.15.42:0/2875760650 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fe80cdcf0 0x7f4fe80cef80 unknown :-1 s=CLOSED pgs=2326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.916+0000 7f4feea00640 1 -- 172.21.15.42:0/2875760650 >> 172.21.15.42:0/2875760650 conn(0x7f4fe80b4180 msgr2=0x7f4fe80b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:21.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.916+0000 7f4feea00640 1 -- 172.21.15.42:0/2875760650 shutdown_connections 2024-09-17T01:48:21.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.916+0000 7f4feea00640 1 -- 172.21.15.42:0/2875760650 wait complete. 2024-09-17T01:48:21.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.918+0000 7f4feea00640 1 Processor -- start 2024-09-17T01:48:21.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.919+0000 7f4feea00640 1 -- start start 2024-09-17T01:48:21.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.920+0000 7f4feea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fe80cdcf0 0x7f4fe81e1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:21.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.920+0000 7f4feea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fe80cf4c0 0x7f4fe809dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:21.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.920+0000 7f4feea00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4fe80d08d0 0x7f4fe81f7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:21.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.920+0000 7f4feea00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe80b2e30 con 0x7f4fe80cf4c0 2024-09-17T01:48:21.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.920+0000 7f4feea00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe80b80c0 con 0x7f4fe80cdcf0 2024-09-17T01:48:21.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.920+0000 7f4feea00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4fe80b2fb0 con 0x7f4fe80d08d0 2024-09-17T01:48:21.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.920+0000 7f4fecc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fe80cf4c0 0x7f4fe809dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:21.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.920+0000 7f4fecc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fe80cf4c0 0x7f4fe809dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59316/0 (socket says 172.21.15.42:59316) 2024-09-17T01:48:21.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.920+0000 7f4fecc00640 1 -- 172.21.15.42:0/2549899830 learned_addr learned my addr 172.21.15.42:0/2549899830 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:21.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.920+0000 7f4fed600640 1 --2- 172.21.15.42:0/2549899830 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fe80cdcf0 0x7f4fe81e1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:21.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.921+0000 7f4fee000640 1 --2- 172.21.15.42:0/2549899830 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4fe80d08d0 0x7f4fe81f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:21.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.921+0000 7f4fecc00640 1 -- 172.21.15.42:0/2549899830 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4fe80d08d0 msgr2=0x7f4fe81f7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:21.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.921+0000 7f4fecc00640 1 --2- 172.21.15.42:0/2549899830 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4fe80d08d0 0x7f4fe81f7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.921+0000 7f4fecc00640 1 -- 172.21.15.42:0/2549899830 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fe80cdcf0 msgr2=0x7f4fe81e1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:21.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.921+0000 7f4fecc00640 1 --2- 172.21.15.42:0/2549899830 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fe80cdcf0 0x7f4fe81e1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.921+0000 7f4fecc00640 1 -- 172.21.15.42:0/2549899830 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe809e270 con 0x7f4fe80cf4c0 2024-09-17T01:48:21.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.921+0000 7f4fed600640 1 --2- 172.21.15.42:0/2549899830 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fe80cdcf0 0x7f4fe81e1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:21.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.921+0000 7f4fecc00640 1 --2- 172.21.15.42:0/2549899830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fe80cf4c0 0x7f4fe809dd30 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400c370 tx=0x7f4fd400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:21.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.921+0000 7f4fe5600640 1 -- 172.21.15.42:0/2549899830 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4017070 con 0x7f4fe80cf4c0 2024-09-17T01:48:21.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.921+0000 7f4fe5600640 1 -- 172.21.15.42:0/2549899830 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fd40035f0 con 0x7f4fe80cf4c0 2024-09-17T01:48:21.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.921+0000 7f4fe5600640 1 -- 172.21.15.42:0/2549899830 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4003a40 con 0x7f4fe80cf4c0 2024-09-17T01:48:21.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.921+0000 7f4feea00640 1 -- 172.21.15.42:0/2549899830 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fe80a04b0 con 0x7f4fe80cf4c0 2024-09-17T01:48:21.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.921+0000 7f4feea00640 1 -- 172.21.15.42:0/2549899830 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fe80a01d0 con 0x7f4fe80cf4c0 2024-09-17T01:48:21.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.924+0000 7f4fe5600640 1 -- 172.21.15.42:0/2549899830 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4fd401a070 con 0x7f4fe80cf4c0 2024-09-17T01:48:21.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.925+0000 7f4fe5600640 1 --2- 172.21.15.42:0/2549899830 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4fc8078b90 0x7f4fc807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:21.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.925+0000 7f4fe5600640 1 -- 172.21.15.42:0/2549899830 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 5854+0+0 (secure 0 0 0) 0x7f4fd409a080 con 0x7f4fe80cf4c0 2024-09-17T01:48:21.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.925+0000 7f4fed600640 1 --2- 172.21.15.42:0/2549899830 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4fc8078b90 0x7f4fc807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:21.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.925+0000 7f4ff7090740 1 Processor -- start 2024-09-17T01:48:21.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.925+0000 7f4ff7090740 1 -- start start 2024-09-17T01:48:21.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.926+0000 7f4fed600640 1 --2- 172.21.15.42:0/2549899830 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4fc8078b90 0x7f4fc807b0a0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc033000 tx=0x7f4fdc004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:21.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.927+0000 7f4ff7090740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e1542bf390 0x55e154680740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:21.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.927+0000 7f4ff7090740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542964d0 0x55e1546ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:21.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.927+0000 7f4ff7090740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e15429e6b0 0x55e15468d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:21.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.927+0000 7f4ff7090740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e1545c61c0 con 0x55e1542964d0 2024-09-17T01:48:21.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.927+0000 7f4ff7090740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e1545d9870 con 0x55e15429e6b0 2024-09-17T01:48:21.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.927+0000 7f4ff7090740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55e1545c8ca0 con 0x55e1542bf390 2024-09-17T01:48:21.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.927+0000 7f4fecc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542964d0 0x55e1546ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:21.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.927+0000 7f4fecc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542964d0 0x55e1546ac2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59322/0 (socket says 172.21.15.42:59322) 2024-09-17T01:48:21.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.927+0000 7f4fecc00640 1 -- 172.21.15.42:0/4099402981 learned_addr learned my addr 172.21.15.42:0/4099402981 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:21.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.928+0000 7f4fed600640 1 --2- 172.21.15.42:0/4099402981 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e1542bf390 0x55e154680740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:21.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.928+0000 7f4fee000640 1 --2- 172.21.15.42:0/4099402981 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e15429e6b0 0x55e15468d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:21.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.928+0000 7f4fecc00640 1 -- 172.21.15.42:0/4099402981 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e1542bf390 msgr2=0x55e154680740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:21.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.928+0000 7f4fecc00640 1 --2- 172.21.15.42:0/4099402981 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e1542bf390 0x55e154680740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.928+0000 7f4fecc00640 1 -- 172.21.15.42:0/4099402981 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e15429e6b0 msgr2=0x55e15468d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:21.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.928+0000 7f4fecc00640 1 --2- 172.21.15.42:0/4099402981 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e15429e6b0 0x55e15468d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.928+0000 7f4fecc00640 1 -- 172.21.15.42:0/4099402981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1543a17d0 con 0x55e1542964d0 2024-09-17T01:48:21.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.928+0000 7f4fed600640 1 --2- 172.21.15.42:0/4099402981 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e1542bf390 0x55e154680740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:21.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.928+0000 7f4fee000640 1 --2- 172.21.15.42:0/4099402981 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e15429e6b0 0x55e15468d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:21.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.928+0000 7f4fecc00640 1 --2- 172.21.15.42:0/4099402981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542964d0 0x55e1546ac2d0 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4098450 tx=0x7f4fd4061520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4a5a8457d0bc05 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:21.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.928+0000 7f4fd9c00640 1 -- 172.21.15.42:0/4099402981 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4088020 con 0x55e1542964d0 2024-09-17T01:48:21.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.928+0000 7f4fd9c00640 1 -- 172.21.15.42:0/4099402981 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fd4061db0 con 0x55e1542964d0 2024-09-17T01:48:21.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.928+0000 7f4fd9c00640 1 -- 172.21.15.42:0/4099402981 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd406b4b0 con 0x55e1542964d0 2024-09-17T01:48:21.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.929+0000 7f4ff7090740 1 -- 172.21.15.42:0/4099402981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542964d0 msgr2=0x55e1546ac2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:21.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.929+0000 7f4ff7090740 1 --2- 172.21.15.42:0/4099402981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542964d0 0x55e1546ac2d0 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4098450 tx=0x7f4fd4061520 comp rx=0 tx=0).stop 2024-09-17T01:48:21.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.929+0000 7f4ff7090740 1 -- 172.21.15.42:0/4099402981 shutdown_connections 2024-09-17T01:48:21.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.929+0000 7f4ff7090740 1 --2- 172.21.15.42:0/4099402981 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e15429e6b0 0x55e15468d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.929+0000 7f4ff7090740 1 --2- 172.21.15.42:0/4099402981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542964d0 0x55e1546ac2d0 unknown :-1 s=CLOSED pgs=2328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.929+0000 7f4ff7090740 1 --2- 172.21.15.42:0/4099402981 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e1542bf390 0x55e154680740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.929+0000 7f4ff7090740 1 -- 172.21.15.42:0/4099402981 >> 172.21.15.42:0/4099402981 conn(0x55e1542b34e0 msgr2=0x55e154666620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:21.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.929+0000 7f4ff7090740 1 -- 172.21.15.42:0/4099402981 shutdown_connections 2024-09-17T01:48:21.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.929+0000 7f4ff7090740 1 -- 172.21.15.42:0/4099402981 wait complete. 2024-09-17T01:48:21.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.930+0000 7f4ff7090740 1 -- start start 2024-09-17T01:48:21.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.930+0000 7f4ff7090740 1 Processor -- start 2024-09-17T01:48:21.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.932+0000 7f4ff7090740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542964d0 0x55e154679070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:21.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.932+0000 7f4ff7090740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e15429e6b0 0x55e1546924d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:21.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.932+0000 7f4ff7090740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e1542bf390 0x55e1546c2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:21.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.932+0000 7f4ff7090740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e15456f410 con 0x55e1542964d0 2024-09-17T01:48:21.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.932+0000 7f4ff7090740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e1545ccab0 con 0x55e15429e6b0 2024-09-17T01:48:21.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.932+0000 7f4ff7090740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55e154339740 con 0x55e1542bf390 2024-09-17T01:48:21.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.932+0000 7f4ff7090740 10 client.0 _ll_register_callbacks cb 0x55e15454c360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:48:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.932+0000 7f4fed600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542964d0 0x55e154679070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.932+0000 7f4fed600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542964d0 0x55e154679070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59334/0 (socket says 172.21.15.42:59334) 2024-09-17T01:48:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.932+0000 7f4fed600640 1 -- 172.21.15.42:0/4292752619 learned_addr learned my addr 172.21.15.42:0/4292752619 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.933+0000 7f4fee000640 1 --2- 172.21.15.42:0/4292752619 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e1542bf390 0x55e1546c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.933+0000 7f4fecc00640 1 --2- 172.21.15.42:0/4292752619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e15429e6b0 0x55e1546924d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.933+0000 7f4fed600640 1 -- 172.21.15.42:0/4292752619 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e1542bf390 msgr2=0x55e1546c2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.933+0000 7f4fed600640 1 --2- 172.21.15.42:0/4292752619 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e1542bf390 0x55e1546c2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.933+0000 7f4fed600640 1 -- 172.21.15.42:0/4292752619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e15429e6b0 msgr2=0x55e1546924d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.933+0000 7f4fed600640 1 --2- 172.21.15.42:0/4292752619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e15429e6b0 0x55e1546924d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.933+0000 7f4fed600640 1 -- 172.21.15.42:0/4292752619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e15432a970 con 0x55e1542964d0 2024-09-17T01:48:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.933+0000 7f4fed600640 1 --2- 172.21.15.42:0/4292752619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542964d0 0x55e154679070 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009850 tx=0x7f4fdc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249098558fc07205 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.933+0000 7f4fce000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:48:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.933+0000 7f4fce000640 1 -- 172.21.15.42:0/4292752619 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc035040 con 0x55e1542964d0 2024-09-17T01:48:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.933+0000 7f4fce000640 1 -- 172.21.15.42:0/4292752619 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(202..202 src has 1..202) ==== 5854+0+0 (secure 0 0 0) 0x7f4fdc004bb0 con 0x55e1542964d0 2024-09-17T01:48:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.933+0000 7f4ff7090740 1 -- 172.21.15.42:0/4292752619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fd4061db0 con 0x55e1542964d0 2024-09-17T01:48:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.934+0000 7f4fce000640 1 -- 172.21.15.42:0/4292752619 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=159) ==== 24+0+0 (secure 0 0 0) 0x7f4fdc056050 con 0x55e1542964d0 2024-09-17T01:48:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.934+0000 7f4ff7090740 10 client.11004 fetch_fsmap learned FSMap version 159 2024-09-17T01:48:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.934+0000 7f4ff7090740 1 -- 172.21.15.42:0/4292752619 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=159,monmap=2+}) -- 0x55e1543086a0 con 0x55e1542964d0 2024-09-17T01:48:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.934+0000 7f4fce000640 1 -- 172.21.15.42:0/4292752619 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fd4061db0 con 0x55e1542964d0 2024-09-17T01:48:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.934+0000 7f4fce000640 1 -- 172.21.15.42:0/4292752619 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 159) ==== 3502+0+0 (secure 0 0 0) 0x7f4fdc059020 con 0x55e1542964d0 2024-09-17T01:48:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.934+0000 7f4ff7090740 10 client.11004 fetch_fsmap finished waiting for FSMap version 159 2024-09-17T01:48:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.934+0000 7f4ff7090740 10 client.11004 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-17T01:48:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.934+0000 7f4ff7090740 20 client.11004 populate_metadata read hostname 'smithi042' 2024-09-17T01:48:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.934+0000 7f4ff7090740 1 --2- 172.21.15.42:0/4292752619 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x55e15427df60 0x55e1546c2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.934+0000 7f4ff7090740 4 client.11004 mds_command: new command op to 10776 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:48:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.934+0000 7f4ff7090740 1 -- 172.21.15.42:0/4292752619 --> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1545db7c0 con 0x55e15427df60 2024-09-17T01:48:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.934+0000 7f4fecc00640 1 --2- 172.21.15.42:0/4292752619 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x55e15427df60 0x55e1546c2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.935+0000 7f4fecc00640 1 --2- 172.21.15.42:0/4292752619 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x55e15427df60 0x55e1546c2a40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d88296a968dc7d1 server_cookie=5472ddd8b0bb88f3 in_seq=0 out_seq=0 2024-09-17T01:48:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.935+0000 7f4fce000640 10 client.11004 ms_handle_connect on v2:172.21.15.42:6832/3836210591 2024-09-17T01:48:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.936+0000 7f4fce000640 1 -- 172.21.15.42:0/4292752619 <== mds.0 v2:172.21.15.42:6832/3836210591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e1545db7c0 con 0x55e15427df60 2024-09-17T01:48:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.936+0000 7f4fce000640 10 client.11004 handle_command_reply: tid=0 2024-09-17T01:48:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.936+0000 7f4ff7090740 1 client.11004 shutdown 2024-09-17T01:48:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.936+0000 7f4ff7090740 1 -- 172.21.15.42:0/4292752619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542964d0 msgr2=0x55e154679070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.936+0000 7f4ff7090740 1 --2- 172.21.15.42:0/4292752619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542964d0 0x55e154679070 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009850 tx=0x7f4fdc009260 comp rx=0 tx=0).stop 2024-09-17T01:48:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.936+0000 7f4ff7090740 1 -- 172.21.15.42:0/4292752619 shutdown_connections 2024-09-17T01:48:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.936+0000 7f4ff7090740 1 --2- 172.21.15.42:0/4292752619 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x55e15427df60 0x55e1546c2a40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.936+0000 7f4ff7090740 1 --2- 172.21.15.42:0/4292752619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e15429e6b0 0x55e1546924d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.936+0000 7f4ff7090740 1 --2- 172.21.15.42:0/4292752619 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e1542bf390 0x55e1546c2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.936+0000 7f4ff7090740 1 --2- 172.21.15.42:0/4292752619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542964d0 0x55e154679070 unknown :-1 s=CLOSED pgs=2329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.936+0000 7f4ff7090740 1 -- 172.21.15.42:0/4292752619 >> 172.21.15.42:0/4292752619 conn(0x55e1542b34e0 msgr2=0x55e15468d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.936+0000 7f4fce000640 0 client.11004 ms_handle_reset on v2:172.21.15.42:6832/3836210591 2024-09-17T01:48:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.936+0000 7f4ff7090740 1 -- 172.21.15.42:0/4292752619 shutdown_connections 2024-09-17T01:48:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.936+0000 7f4ff7090740 1 -- 172.21.15.42:0/4292752619 wait complete. 2024-09-17T01:48:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.936+0000 7f4ff7090740 20 client.11004 trim_cache size 0 max 16384 2024-09-17T01:48:21.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.955+0000 7f4ff7090740 1 Processor -- start 2024-09-17T01:48:21.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.955+0000 7f4ff7090740 1 -- start start 2024-09-17T01:48:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.956+0000 7f4ff7090740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542b34e0 0x55e1546674f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.956+0000 7f4ff7090740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e1542964d0 0x55e1546d39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.956+0000 7f4ff7090740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e15429e6b0 0x55e1546d3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.956+0000 7f4ff7090740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe81e63a0 con 0x55e1542b34e0 2024-09-17T01:48:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.956+0000 7f4ff7090740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe806ee10 con 0x55e1542964d0 2024-09-17T01:48:21.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.956+0000 7f4ff7090740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4fe806e170 con 0x55e15429e6b0 2024-09-17T01:48:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.957+0000 7f4fed600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542b34e0 0x55e1546674f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.957+0000 7f4fed600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542b34e0 0x55e1546674f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59342/0 (socket says 172.21.15.42:59342) 2024-09-17T01:48:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.957+0000 7f4fed600640 1 -- 172.21.15.42:0/1060492839 learned_addr learned my addr 172.21.15.42:0/1060492839 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.957+0000 7f4fed600640 1 -- 172.21.15.42:0/1060492839 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e15429e6b0 msgr2=0x55e1546d3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.957+0000 7f4fed600640 1 --2- 172.21.15.42:0/1060492839 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e15429e6b0 0x55e1546d3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.957+0000 7f4fecc00640 1 --2- 172.21.15.42:0/1060492839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e1542964d0 0x55e1546d39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.957+0000 7f4fed600640 1 -- 172.21.15.42:0/1060492839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e1542964d0 msgr2=0x55e1546d39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.957+0000 7f4fed600640 1 --2- 172.21.15.42:0/1060492839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e1542964d0 0x55e1546d39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.957+0000 7f4fed600640 1 -- 172.21.15.42:0/1060492839 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e154661830 con 0x55e1542b34e0 2024-09-17T01:48:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.957+0000 7f4fecc00640 1 --2- 172.21.15.42:0/1060492839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e1542964d0 0x55e1546d39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:48:21.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.958+0000 7f4fed600640 1 --2- 172.21.15.42:0/1060492839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542b34e0 0x55e1546674f0 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc004620 tx=0x7f4fdc004000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a054436176eac22 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.958+0000 7f4fd9200640 1 -- 172.21.15.42:0/1060492839 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc004bb0 con 0x55e1542b34e0 2024-09-17T01:48:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.958+0000 7f4fd9200640 1 -- 172.21.15.42:0/1060492839 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fdc04e070 con 0x55e1542b34e0 2024-09-17T01:48:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.958+0000 7f4fd9200640 1 -- 172.21.15.42:0/1060492839 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc03c6e0 con 0x55e1542b34e0 2024-09-17T01:48:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.959+0000 7f4ff7090740 1 -- 172.21.15.42:0/1060492839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542b34e0 msgr2=0x55e1546674f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.959+0000 7f4ff7090740 1 --2- 172.21.15.42:0/1060492839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542b34e0 0x55e1546674f0 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc004620 tx=0x7f4fdc004000 comp rx=0 tx=0).stop 2024-09-17T01:48:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.959+0000 7f4ff7090740 1 -- 172.21.15.42:0/1060492839 shutdown_connections 2024-09-17T01:48:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.959+0000 7f4ff7090740 1 --2- 172.21.15.42:0/1060492839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e1542964d0 0x55e1546d39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.959+0000 7f4ff7090740 1 --2- 172.21.15.42:0/1060492839 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e15429e6b0 0x55e1546d3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.959+0000 7f4ff7090740 1 --2- 172.21.15.42:0/1060492839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542b34e0 0x55e1546674f0 unknown :-1 s=CLOSED pgs=2330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.959+0000 7f4ff7090740 1 -- 172.21.15.42:0/1060492839 >> 172.21.15.42:0/1060492839 conn(0x55e154694300 msgr2=0x55e1546915c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:21.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.959+0000 7f4ff7090740 1 -- 172.21.15.42:0/1060492839 shutdown_connections 2024-09-17T01:48:21.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.959+0000 7f4ff7090740 1 -- 172.21.15.42:0/1060492839 wait complete. 2024-09-17T01:48:21.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.960+0000 7f4ff7090740 1 -- start start 2024-09-17T01:48:21.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.960+0000 7f4ff7090740 1 Processor -- start 2024-09-17T01:48:21.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.961+0000 7f4ff7090740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542964d0 0x55e1546a7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:21.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.961+0000 7f4ff7090740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e15429e6b0 0x55e15472f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:21.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.961+0000 7f4ff7090740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e1542b34e0 0x55e154667680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:21.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.961+0000 7f4ff7090740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e15467feb0 con 0x55e1542964d0 2024-09-17T01:48:21.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.961+0000 7f4ff7090740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe806e7c0 con 0x55e1542b34e0 2024-09-17T01:48:21.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.961+0000 7f4ff7090740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55e1546a80e0 con 0x55e15429e6b0 2024-09-17T01:48:21.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.961+0000 7f4ff7090740 10 client.0 _ll_register_callbacks cb 0x7f4fdc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:48:21.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.962+0000 7f4fed600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542964d0 0x55e1546a7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:21.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.962+0000 7f4fed600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542964d0 0x55e1546a7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59354/0 (socket says 172.21.15.42:59354) 2024-09-17T01:48:21.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.962+0000 7f4fed600640 1 -- 172.21.15.42:0/2214709633 learned_addr learned my addr 172.21.15.42:0/2214709633 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:21.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.962+0000 7f4fecc00640 1 --2- 172.21.15.42:0/2214709633 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e15429e6b0 0x55e15472f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:21.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.962+0000 7f4fee000640 1 --2- 172.21.15.42:0/2214709633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e1542b34e0 0x55e154667680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:21.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.962+0000 7f4fed600640 1 -- 172.21.15.42:0/2214709633 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e15429e6b0 msgr2=0x55e15472f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:21.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.962+0000 7f4fed600640 1 --2- 172.21.15.42:0/2214709633 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e15429e6b0 0x55e15472f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.962+0000 7f4fed600640 1 -- 172.21.15.42:0/2214709633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e1542b34e0 msgr2=0x55e154667680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.962+0000 7f4fed600640 1 --2- 172.21.15.42:0/2214709633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e1542b34e0 0x55e154667680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.962+0000 7f4fed600640 1 -- 172.21.15.42:0/2214709633 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e154667bc0 con 0x55e1542964d0 2024-09-17T01:48:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.962+0000 7f4fecc00640 1 --2- 172.21.15.42:0/2214709633 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e15429e6b0 0x55e15472f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.962+0000 7f4fee000640 1 --2- 172.21.15.42:0/2214709633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e1542b34e0 0x55e154667680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.962+0000 7f4fed600640 1 --2- 172.21.15.42:0/2214709633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542964d0 0x55e1546a7890 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc006010 tx=0x7f4fdc03c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9ba19692acfc4d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.962+0000 7f4fce000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:48:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.963+0000 7f4fce000640 1 -- 172.21.15.42:0/2214709633 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc03ccf0 con 0x55e1542964d0 2024-09-17T01:48:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.963+0000 7f4fce000640 1 -- 172.21.15.42:0/2214709633 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(202..202 src has 1..202) ==== 5854+0+0 (secure 0 0 0) 0x7f4fdc049440 con 0x55e1542964d0 2024-09-17T01:48:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.963+0000 7f4ff7090740 1 -- 172.21.15.42:0/2214709633 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fdc04e070 con 0x55e1542964d0 2024-09-17T01:48:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.963+0000 7f4fce000640 1 -- 172.21.15.42:0/2214709633 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=159) ==== 24+0+0 (secure 0 0 0) 0x7f4fdc049640 con 0x55e1542964d0 2024-09-17T01:48:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.963+0000 7f4ff7090740 10 client.11010 fetch_fsmap learned FSMap version 159 2024-09-17T01:48:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.963+0000 7f4ff7090740 1 -- 172.21.15.42:0/2214709633 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=159,monmap=2+}) -- 0x55e1546c9b00 con 0x55e1542964d0 2024-09-17T01:48:21.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.963+0000 7f4fce000640 1 -- 172.21.15.42:0/2214709633 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fdc04e070 con 0x55e1542964d0 2024-09-17T01:48:21.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.963+0000 7f4fce000640 1 -- 172.21.15.42:0/2214709633 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 159) ==== 3502+0+0 (secure 0 0 0) 0x7f4fdc072020 con 0x55e1542964d0 2024-09-17T01:48:21.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.963+0000 7f4ff7090740 10 client.11010 fetch_fsmap finished waiting for FSMap version 159 2024-09-17T01:48:21.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.963+0000 7f4ff7090740 10 client.11010 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-17T01:48:21.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.963+0000 7f4ff7090740 20 client.11010 populate_metadata read hostname 'smithi042' 2024-09-17T01:48:21.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.963+0000 7f4ff7090740 1 --2- 172.21.15.42:0/2214709633 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x55e1542533a0 0x55e15467db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:21.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.963+0000 7f4ff7090740 4 client.11010 mds_command: new command op to 10776 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:48:21.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.963+0000 7f4ff7090740 1 -- 172.21.15.42:0/2214709633 --> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e1545d7270 con 0x55e1542533a0 2024-09-17T01:48:21.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.964+0000 7f4fecc00640 1 --2- 172.21.15.42:0/2214709633 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x55e1542533a0 0x55e15467db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:21.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.964+0000 7f4fecc00640 1 --2- 172.21.15.42:0/2214709633 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x55e1542533a0 0x55e15467db90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9f589ace671258a server_cookie=8ed50918cd3eca48 in_seq=0 out_seq=0 2024-09-17T01:48:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.964+0000 7f4fce000640 10 client.11010 ms_handle_connect on v2:172.21.15.42:6832/3836210591 2024-09-17T01:48:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.965+0000 7f4fce000640 1 -- 172.21.15.42:0/2214709633 <== mds.0 v2:172.21.15.42:6832/3836210591 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x55e1545d7270 con 0x55e1542533a0 2024-09-17T01:48:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.965+0000 7f4fce000640 10 client.11010 handle_command_reply: tid=0 2024-09-17T01:48:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.965+0000 7f4ff7090740 1 client.11010 shutdown 2024-09-17T01:48:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.965+0000 7f4ff7090740 1 -- 172.21.15.42:0/2214709633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542964d0 msgr2=0x55e1546a7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.965+0000 7f4ff7090740 1 --2- 172.21.15.42:0/2214709633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542964d0 0x55e1546a7890 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc006010 tx=0x7f4fdc03c6f0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.965+0000 7f4ff7090740 1 -- 172.21.15.42:0/2214709633 shutdown_connections 2024-09-17T01:48:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.965+0000 7f4ff7090740 1 --2- 172.21.15.42:0/2214709633 >> [v2:172.21.15.42:6832/3836210591,v1:172.21.15.42:6835/3836210591] conn(0x55e1542533a0 0x55e15467db90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.965+0000 7f4ff7090740 1 --2- 172.21.15.42:0/2214709633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e1542b34e0 0x55e154667680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.965+0000 7f4ff7090740 1 --2- 172.21.15.42:0/2214709633 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e15429e6b0 0x55e15472f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.965+0000 7f4ff7090740 1 --2- 172.21.15.42:0/2214709633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e1542964d0 0x55e1546a7890 unknown :-1 s=CLOSED pgs=2331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.965+0000 7f4fce000640 0 client.11010 ms_handle_reset on v2:172.21.15.42:6832/3836210591 2024-09-17T01:48:21.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.965+0000 7f4ff7090740 1 -- 172.21.15.42:0/2214709633 >> 172.21.15.42:0/2214709633 conn(0x55e154694300 msgr2=0x55e1546a5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:21.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.965+0000 7f4ff7090740 1 -- 172.21.15.42:0/2214709633 shutdown_connections 2024-09-17T01:48:21.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.965+0000 7f4ff7090740 1 -- 172.21.15.42:0/2214709633 wait complete. 2024-09-17T01:48:21.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.965+0000 7f4ff7090740 20 client.11010 trim_cache size 0 max 16384 2024-09-17T01:48:21.967 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:48:21.967 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-09-17T01:48:21.967 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {}, 2024-09-17T01:48:21.967 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_stats": { 2024-09-17T01:48:21.967 INFO:teuthology.orchestra.run.smithi042.stdout: "ea90eb79-0b7c-4955-8fc1-03979dbe7849": { 2024-09-17T01:48:21.967 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:47:51.337919+0000", 2024-09-17T01:48:21.968 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-17T01:48:21.968 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:48:21.968 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:48:21.968 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:48:21.968 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:48:21.968 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:48:21.968 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:48:21.968 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:48:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.966+0000 7f4feea00640 1 -- 172.21.15.42:0/2549899830 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4fc8078b90 msgr2=0x7f4fc807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.966+0000 7f4feea00640 1 --2- 172.21.15.42:0/2549899830 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4fc8078b90 0x7f4fc807b0a0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc033000 tx=0x7f4fdc004730 comp rx=0 tx=0).stop 2024-09-17T01:48:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.966+0000 7f4feea00640 1 -- 172.21.15.42:0/2549899830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fe80cf4c0 msgr2=0x7f4fe809dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.966+0000 7f4feea00640 1 --2- 172.21.15.42:0/2549899830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fe80cf4c0 0x7f4fe809dd30 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400c370 tx=0x7f4fd400c830 comp rx=0 tx=0).stop 2024-09-17T01:48:21.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.966+0000 7f4feea00640 1 -- 172.21.15.42:0/2549899830 shutdown_connections 2024-09-17T01:48:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.966+0000 7f4feea00640 1 --2- 172.21.15.42:0/2549899830 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4fc8078b90 0x7f4fc807b0a0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.966+0000 7f4feea00640 1 --2- 172.21.15.42:0/2549899830 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4fe80d08d0 0x7f4fe81f7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.966+0000 7f4feea00640 1 --2- 172.21.15.42:0/2549899830 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4fe80cf4c0 0x7f4fe809dd30 unknown :-1 s=CLOSED pgs=2327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.966+0000 7f4feea00640 1 --2- 172.21.15.42:0/2549899830 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4fe80cdcf0 0x7f4fe81e1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.966+0000 7f4feea00640 1 -- 172.21.15.42:0/2549899830 >> 172.21.15.42:0/2549899830 conn(0x7f4fe80b4180 msgr2=0x7f4fe81e4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.966+0000 7f4feea00640 1 -- 172.21.15.42:0/2549899830 shutdown_connections 2024-09-17T01:48:21.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:21.966+0000 7f4feea00640 1 -- 172.21.15.42:0/2549899830 wait complete. 2024-09-17T01:48:21.989 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T01:48:21.990 DEBUG:teuthology.orchestra.run.smithi042:> stdin-killer -- python3 -c ' 2024-09-17T01:48:21.990 DEBUG:teuthology.orchestra.run.smithi042:> import os 2024-09-17T01:48:21.990 DEBUG:teuthology.orchestra.run.smithi042:> import stat 2024-09-17T01:48:21.990 DEBUG:teuthology.orchestra.run.smithi042:> import json 2024-09-17T01:48:21.990 DEBUG:teuthology.orchestra.run.smithi042:> import sys 2024-09-17T01:48:21.990 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:48:21.990 DEBUG:teuthology.orchestra.run.smithi042:> try: 2024-09-17T01:48:21.990 DEBUG:teuthology.orchestra.run.smithi042:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-09-17T01:48:21.990 DEBUG:teuthology.orchestra.run.smithi042:> except OSError as e: 2024-09-17T01:48:21.991 DEBUG:teuthology.orchestra.run.smithi042:> sys.exit(e.errno) 2024-09-17T01:48:21.991 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:48:21.991 DEBUG:teuthology.orchestra.run.smithi042:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-17T01:48:21.991 DEBUG:teuthology.orchestra.run.smithi042:> print(json.dumps( 2024-09-17T01:48:21.991 DEBUG:teuthology.orchestra.run.smithi042:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-17T01:48:21.991 DEBUG:teuthology.orchestra.run.smithi042:> indent=2)) 2024-09-17T01:48:21.991 DEBUG:teuthology.orchestra.run.smithi042:> ' 2024-09-17T01:48:22.094 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:48:22.094 INFO:teuthology.orchestra.run.smithi042.stdout: "st_mode": 33188, 2024-09-17T01:48:22.094 INFO:teuthology.orchestra.run.smithi042.stdout: "st_ino": 1099511627777, 2024-09-17T01:48:22.094 INFO:teuthology.orchestra.run.smithi042.stdout: "st_dev": 43, 2024-09-17T01:48:22.095 INFO:teuthology.orchestra.run.smithi042.stdout: "st_nlink": 1, 2024-09-17T01:48:22.095 INFO:teuthology.orchestra.run.smithi042.stdout: "st_uid": 1000, 2024-09-17T01:48:22.095 INFO:teuthology.orchestra.run.smithi042.stdout: "st_gid": 1333, 2024-09-17T01:48:22.095 INFO:teuthology.orchestra.run.smithi042.stdout: "st_size": 6291456, 2024-09-17T01:48:22.095 INFO:teuthology.orchestra.run.smithi042.stdout: "st_atime": 1726537669.607934, 2024-09-17T01:48:22.095 INFO:teuthology.orchestra.run.smithi042.stdout: "st_mtime": 1726537669.6429336, 2024-09-17T01:48:22.095 INFO:teuthology.orchestra.run.smithi042.stdout: "st_ctime": 1726537669.6429336 2024-09-17T01:48:22.095 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:48:22.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:48:22.106 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:48:22.237 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:48:22.242 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:48:22.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.378+0000 7f9e9c600640 1 -- 172.21.15.42:0/4077108439 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e7c003c30 msgr2=0x7f9e7c004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:22.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.378+0000 7f9e9c600640 1 --2- 172.21.15.42:0/4077108439 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e7c003c30 0x7f9e7c004080 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7f9e88006f80 tx=0x7f9e7c005830 comp rx=0 tx=0).stop 2024-09-17T01:48:22.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.379+0000 7f9e9c600640 1 -- 172.21.15.42:0/4077108439 shutdown_connections 2024-09-17T01:48:22.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.379+0000 7f9e9c600640 1 --2- 172.21.15.42:0/4077108439 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e7c003c30 0x7f9e7c004080 unknown :-1 s=CLOSED pgs=2333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:22.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.379+0000 7f9e9c600640 1 -- 172.21.15.42:0/4077108439 >> 172.21.15.42:0/4077108439 conn(0x7f9e9406d1b0 msgr2=0x7f9e9406d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:22.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.379+0000 7f9e9c600640 1 -- 172.21.15.42:0/4077108439 shutdown_connections 2024-09-17T01:48:22.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.379+0000 7f9e9c600640 1 -- 172.21.15.42:0/4077108439 wait complete. 2024-09-17T01:48:22.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.381+0000 7f9e9c600640 1 Processor -- start 2024-09-17T01:48:22.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.381+0000 7f9e9c600640 1 -- start start 2024-09-17T01:48:22.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.382+0000 7f9e9c600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e7c003c30 0x7f9e94153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:22.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.382+0000 7f9e9c600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e94135b40 0x7f9e941588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:22.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.383+0000 7f9e9c600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e94158e10 0x7f9e941f6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:22.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.383+0000 7f9e9c600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9e94160b70 con 0x7f9e94135b40 2024-09-17T01:48:22.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.383+0000 7f9e9c600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9e941609f0 con 0x7f9e94158e10 2024-09-17T01:48:22.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.383+0000 7f9e9c600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9e94160cf0 con 0x7f9e7c003c30 2024-09-17T01:48:22.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.383+0000 7f9e99200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e94135b40 0x7f9e941588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:22.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.383+0000 7f9e99200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e94135b40 0x7f9e941588d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59370/0 (socket says 172.21.15.42:59370) 2024-09-17T01:48:22.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.383+0000 7f9e99200640 1 -- 172.21.15.42:0/607018045 learned_addr learned my addr 172.21.15.42:0/607018045 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:22.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.383+0000 7f9e99c00640 1 --2- 172.21.15.42:0/607018045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e7c003c30 0x7f9e94153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:22.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.383+0000 7f9e9a600640 1 --2- 172.21.15.42:0/607018045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e94158e10 0x7f9e941f6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:22.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.383+0000 7f9e99200640 1 -- 172.21.15.42:0/607018045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e7c003c30 msgr2=0x7f9e94153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:22.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.383+0000 7f9e99200640 1 --2- 172.21.15.42:0/607018045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e7c003c30 0x7f9e94153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:22.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.383+0000 7f9e99200640 1 -- 172.21.15.42:0/607018045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e94158e10 msgr2=0x7f9e941f6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:22.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.383+0000 7f9e99200640 1 --2- 172.21.15.42:0/607018045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e94158e10 0x7f9e941f6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:22.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.383+0000 7f9e99200640 1 -- 172.21.15.42:0/607018045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9413bf10 con 0x7f9e94135b40 2024-09-17T01:48:22.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.384+0000 7f9e99200640 1 --2- 172.21.15.42:0/607018045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e94135b40 0x7f9e941588d0 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f9e80004c50 tx=0x7f9e80001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:22.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.384+0000 7f9e91600640 1 -- 172.21.15.42:0/607018045 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e80015020 con 0x7f9e94135b40 2024-09-17T01:48:22.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.384+0000 7f9e91600640 1 -- 172.21.15.42:0/607018045 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e800119a0 con 0x7f9e94135b40 2024-09-17T01:48:22.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.384+0000 7f9e9c600640 1 -- 172.21.15.42:0/607018045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e941583d0 con 0x7f9e94135b40 2024-09-17T01:48:22.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.384+0000 7f9e91600640 1 -- 172.21.15.42:0/607018045 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e80011df0 con 0x7f9e94135b40 2024-09-17T01:48:22.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.384+0000 7f9e9c600640 1 -- 172.21.15.42:0/607018045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e940aa9b0 con 0x7f9e94135b40 2024-09-17T01:48:22.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.385+0000 7f9e9c600640 1 -- 172.21.15.42:0/607018045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e940cd620 con 0x7f9e94135b40 2024-09-17T01:48:22.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.386+0000 7f9e91600640 1 -- 172.21.15.42:0/607018045 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9e80018020 con 0x7f9e94135b40 2024-09-17T01:48:22.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.387+0000 7f9e91600640 1 --2- 172.21.15.42:0/607018045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e74078bc0 0x7f9e7407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:22.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.387+0000 7f9e91600640 1 -- 172.21.15.42:0/607018045 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 5854+0+0 (secure 0 0 0) 0x7f9e8009b740 con 0x7f9e94135b40 2024-09-17T01:48:22.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.388+0000 7f9e99c00640 1 --2- 172.21.15.42:0/607018045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e74078bc0 0x7f9e7407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:22.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.389+0000 7f9e99c00640 1 --2- 172.21.15.42:0/607018045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e74078bc0 0x7f9e7407b0d0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f9e88033000 tx=0x7f9e8802d000 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:22.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.392+0000 7f9e91600640 1 -- 172.21.15.42:0/607018045 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9e8001f020 con 0x7f9e94135b40 2024-09-17T01:48:22.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.620+0000 7f9e9c600640 1 -- 172.21.15.42:0/607018045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e9415a180 con 0x7f9e94135b40 2024-09-17T01:48:22.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.620+0000 7f9e91600640 1 -- 172.21.15.42:0/607018045 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 159 v159) ==== 95+0+5231 (secure 0 0 0) 0x7f9e8006c020 con 0x7f9e94135b40 2024-09-17T01:48:22.618 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:48:22.618 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":159,"btime":"2024-09-17T01:47:39:016238+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3701245274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3701245274},{"type":"v1","addr":"172.21.15.43:6837","nonce":3701245274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10021,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/8838410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":8838410},{"type":"v1","addr":"172.21.15.42:6834","nonce":8838410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3981236009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3981236009},{"type":"v1","addr":"172.21.15.43:6836","nonce":3981236009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154}],"filesystems":[{"mdsmap":{"epoch":159,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:47:35.510920+0000","modified":"2024-09-17T01:47:38.527136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10776":{"gid":10776,"name":"c","rank":0,"incarnation":155,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3836210591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3836210591},{"type":"v1","addr":"172.21.15.42:6835","nonce":3836210591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10776,"qdb_cluster":[10776]},"id":14}]} 2024-09-17T01:48:22.619 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 159 2024-09-17T01:48:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.623+0000 7f9e9c600640 1 -- 172.21.15.42:0/607018045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e74078bc0 msgr2=0x7f9e7407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.623+0000 7f9e9c600640 1 --2- 172.21.15.42:0/607018045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e74078bc0 0x7f9e7407b0d0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f9e88033000 tx=0x7f9e8802d000 comp rx=0 tx=0).stop 2024-09-17T01:48:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.623+0000 7f9e9c600640 1 -- 172.21.15.42:0/607018045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e94135b40 msgr2=0x7f9e941588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.623+0000 7f9e9c600640 1 --2- 172.21.15.42:0/607018045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e94135b40 0x7f9e941588d0 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f9e80004c50 tx=0x7f9e80001800 comp rx=0 tx=0).stop 2024-09-17T01:48:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.623+0000 7f9e9c600640 1 -- 172.21.15.42:0/607018045 shutdown_connections 2024-09-17T01:48:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.623+0000 7f9e9c600640 1 --2- 172.21.15.42:0/607018045 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e74078bc0 0x7f9e7407b0d0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.623+0000 7f9e9c600640 1 --2- 172.21.15.42:0/607018045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e94158e10 0x7f9e941f6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:22.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.623+0000 7f9e9c600640 1 --2- 172.21.15.42:0/607018045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e94135b40 0x7f9e941588d0 unknown :-1 s=CLOSED pgs=2334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:22.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.623+0000 7f9e9c600640 1 --2- 172.21.15.42:0/607018045 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e7c003c30 0x7f9e94153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:22.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.623+0000 7f9e9c600640 1 -- 172.21.15.42:0/607018045 >> 172.21.15.42:0/607018045 conn(0x7f9e9406d1b0 msgr2=0x7f9e94146100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:22.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.623+0000 7f9e9c600640 1 -- 172.21.15.42:0/607018045 shutdown_connections 2024-09-17T01:48:22.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:22.623+0000 7f9e9c600640 1 -- 172.21.15.42:0/607018045 wait complete. 2024-09-17T01:48:22.647 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-17T01:48:22.946 INFO:teuthology.orchestra.run.smithi042.stdout:{"message":"","return_code":0} 2024-09-17T01:48:22.946 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-17T01:48:22.946 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-09-17T01:48:23.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.094+0000 7efd245d3f40 1 Processor -- start 2024-09-17T01:48:23.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.094+0000 7efd245d3f40 1 -- start start 2024-09-17T01:48:23.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.096+0000 7efd245d3f40 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7121e4860 0x55d7122bc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:23.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.096+0000 7efd245d3f40 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d71222bc20 0x55d7121e5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:23.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.096+0000 7efd245d3f40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d71222d340 0x55d7121e6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:23.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.096+0000 7efd245d3f40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d712135c60 con 0x55d71222d340 2024-09-17T01:48:23.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.096+0000 7efd245d3f40 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d7121941d0 con 0x55d71222bc20 2024-09-17T01:48:23.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.096+0000 7efd245d3f40 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55d71222cb40 con 0x55d7121e4860 2024-09-17T01:48:23.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.096+0000 7efd1e200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d71222d340 0x55d7121e6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:23.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.096+0000 7efd1e200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d71222d340 0x55d7121e6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59380/0 (socket says 172.21.15.42:59380) 2024-09-17T01:48:23.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.096+0000 7efd1e200640 1 -- 172.21.15.42:0/207827234 learned_addr learned my addr 172.21.15.42:0/207827234 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:23.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.096+0000 7efd1ce00640 1 --2- 172.21.15.42:0/207827234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d71222bc20 0x55d7121e5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:23.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.096+0000 7efd1d800640 1 --2- 172.21.15.42:0/207827234 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7121e4860 0x55d7122bc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:23.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.096+0000 7efd1e200640 1 -- 172.21.15.42:0/207827234 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7121e4860 msgr2=0x55d7122bc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:23.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.096+0000 7efd1e200640 1 --2- 172.21.15.42:0/207827234 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7121e4860 0x55d7122bc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:23.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.096+0000 7efd1e200640 1 -- 172.21.15.42:0/207827234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d71222bc20 msgr2=0x55d7121e5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:23.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.096+0000 7efd1e200640 1 --2- 172.21.15.42:0/207827234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d71222bc20 0x55d7121e5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:23.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.096+0000 7efd1e200640 1 -- 172.21.15.42:0/207827234 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7121e7670 con 0x55d71222d340 2024-09-17T01:48:23.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.096+0000 7efd1d800640 1 --2- 172.21.15.42:0/207827234 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7121e4860 0x55d7122bc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:23.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.097+0000 7efd1e200640 1 --2- 172.21.15.42:0/207827234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d71222d340 0x55d7121e6130 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7efd18046410 tx=0x7efd18003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89acafdf29ec4c39 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:23.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.097+0000 7efd17400640 1 -- 172.21.15.42:0/207827234 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd18064030 con 0x55d71222d340 2024-09-17T01:48:23.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.097+0000 7efd17400640 1 -- 172.21.15.42:0/207827234 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd18004020 con 0x55d71222d340 2024-09-17T01:48:23.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.097+0000 7efd17400640 1 -- 172.21.15.42:0/207827234 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd18004250 con 0x55d71222d340 2024-09-17T01:48:23.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.098+0000 7efd245d3f40 1 -- 172.21.15.42:0/207827234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d71222d340 msgr2=0x55d7121e6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:23.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.098+0000 7efd245d3f40 1 --2- 172.21.15.42:0/207827234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d71222d340 0x55d7121e6130 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7efd18046410 tx=0x7efd18003330 comp rx=0 tx=0).stop 2024-09-17T01:48:23.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.098+0000 7efd245d3f40 1 -- 172.21.15.42:0/207827234 shutdown_connections 2024-09-17T01:48:23.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.098+0000 7efd245d3f40 1 --2- 172.21.15.42:0/207827234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d71222bc20 0x55d7121e5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:23.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.098+0000 7efd245d3f40 1 --2- 172.21.15.42:0/207827234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d71222d340 0x55d7121e6130 unknown :-1 s=CLOSED pgs=2337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:23.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.098+0000 7efd245d3f40 1 --2- 172.21.15.42:0/207827234 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7121e4860 0x55d7122bc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:23.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.098+0000 7efd245d3f40 1 -- 172.21.15.42:0/207827234 >> 172.21.15.42:0/207827234 conn(0x55d712106ac0 msgr2=0x55d712215a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:23.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.098+0000 7efd245d3f40 1 -- 172.21.15.42:0/207827234 shutdown_connections 2024-09-17T01:48:23.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.098+0000 7efd245d3f40 1 -- 172.21.15.42:0/207827234 wait complete. 2024-09-17T01:48:23.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.099+0000 7efd245d3f40 1 Processor -- start 2024-09-17T01:48:23.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.099+0000 7efd245d3f40 1 -- start start 2024-09-17T01:48:23.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.100+0000 7efd245d3f40 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7121e4860 0x55d71222f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:23.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.100+0000 7efd245d3f40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d71222bc20 0x55d71222fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:23.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.100+0000 7efd245d3f40 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d71222d340 0x55d7121e7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:23.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.100+0000 7efd245d3f40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d7122bcce0 con 0x55d71222bc20 2024-09-17T01:48:23.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.100+0000 7efd245d3f40 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d7122c04d0 con 0x55d71222d340 2024-09-17T01:48:23.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.100+0000 7efd245d3f40 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55d7122bcfe0 con 0x55d7121e4860 2024-09-17T01:48:23.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.101+0000 7efd1ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d71222bc20 0x55d71222fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:23.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.101+0000 7efd1ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d71222bc20 0x55d71222fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59386/0 (socket says 172.21.15.42:59386) 2024-09-17T01:48:23.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.101+0000 7efd1ce00640 1 -- 172.21.15.42:0/2806814104 learned_addr learned my addr 172.21.15.42:0/2806814104 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:23.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.101+0000 7efd1d800640 1 --2- 172.21.15.42:0/2806814104 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7121e4860 0x55d71222f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:23.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.101+0000 7efd1e200640 1 --2- 172.21.15.42:0/2806814104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d71222d340 0x55d7121e7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:23.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.101+0000 7efd1ce00640 1 -- 172.21.15.42:0/2806814104 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7121e4860 msgr2=0x55d71222f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:23.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.101+0000 7efd1ce00640 1 --2- 172.21.15.42:0/2806814104 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55d7121e4860 0x55d71222f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:23.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.101+0000 7efd1ce00640 1 -- 172.21.15.42:0/2806814104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d71222d340 msgr2=0x55d7121e7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:23.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.101+0000 7efd1ce00640 1 --2- 172.21.15.42:0/2806814104 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d71222d340 0x55d7121e7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:23.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.101+0000 7efd1ce00640 1 -- 172.21.15.42:0/2806814104 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d712299710 con 0x55d71222bc20 2024-09-17T01:48:23.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.101+0000 7efd1ce00640 1 --2- 172.21.15.42:0/2806814104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d71222bc20 0x55d71222fe00 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7efd0c0086f0 tx=0x7efd0c0087e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:23.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.102+0000 7efd16000640 1 -- 172.21.15.42:0/2806814104 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c00a850 con 0x55d71222bc20 2024-09-17T01:48:23.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.102+0000 7efd16000640 1 -- 172.21.15.42:0/2806814104 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd0c00a9f0 con 0x55d71222bc20 2024-09-17T01:48:23.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.102+0000 7efd16000640 1 -- 172.21.15.42:0/2806814104 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c00ae20 con 0x55d71222bc20 2024-09-17T01:48:23.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.102+0000 7efd245d3f40 1 -- 172.21.15.42:0/2806814104 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7122a5c90 con 0x55d71222bc20 2024-09-17T01:48:23.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.102+0000 7efd245d3f40 1 -- 172.21.15.42:0/2806814104 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7122b9ca0 con 0x55d71222bc20 2024-09-17T01:48:23.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.104+0000 7efd16000640 1 -- 172.21.15.42:0/2806814104 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efd0c016430 con 0x55d71222bc20 2024-09-17T01:48:23.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.105+0000 7efd16000640 1 --2- 172.21.15.42:0/2806814104 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efd00077570 0x7efd00079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:23.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.105+0000 7efd16000640 1 -- 172.21.15.42:0/2806814104 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 5854+0+0 (secure 0 0 0) 0x7efd0c09a310 con 0x55d71222bc20 2024-09-17T01:48:23.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.106+0000 7efd1d800640 1 --2- 172.21.15.42:0/2806814104 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efd00077570 0x7efd00079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:23.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.106+0000 7efd245d3f40 1 --2- 172.21.15.42:0/2806814104 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x55d712299980 0x55d7121e8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:23.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.106+0000 7efd245d3f40 1 -- 172.21.15.42:0/2806814104 --> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] -- osd_op(unknown.0.0:1 29.7 29:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e202) -- 0x55d712361240 con 0x55d712299980 2024-09-17T01:48:23.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.106+0000 7efd1e200640 1 --2- 172.21.15.42:0/2806814104 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x55d712299980 0x55d7121e8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:23.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.106+0000 7efd1d800640 1 --2- 172.21.15.42:0/2806814104 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efd00077570 0x7efd00079a80 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7efd100104d0 tx=0x7efd10002720 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:23.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.106+0000 7efd1e200640 1 --2- 172.21.15.42:0/2806814104 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x55d712299980 0x55d7121e8570 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:23.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.107+0000 7efd1e200640 1 -- 172.21.15.42:0/2806814104 <== osd.1 v2:172.21.15.42:6824/4073532812 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv5 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7efd1800b040 con 0x55d712299980 2024-09-17T01:48:23.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.107+0000 7efd245d3f40 1 -- 172.21.15.42:0/2806814104 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x55d712299980 msgr2=0x55d7121e8570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:23.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.107+0000 7efd245d3f40 1 --2- 172.21.15.42:0/2806814104 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x55d712299980 0x55d7121e8570 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:23.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.107+0000 7efd245d3f40 1 -- 172.21.15.42:0/2806814104 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efd00077570 msgr2=0x7efd00079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:23.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.107+0000 7efd245d3f40 1 --2- 172.21.15.42:0/2806814104 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efd00077570 0x7efd00079a80 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7efd100104d0 tx=0x7efd10002720 comp rx=0 tx=0).stop 2024-09-17T01:48:23.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.107+0000 7efd245d3f40 1 -- 172.21.15.42:0/2806814104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d71222bc20 msgr2=0x55d71222fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:23.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.107+0000 7efd245d3f40 1 --2- 172.21.15.42:0/2806814104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d71222bc20 0x55d71222fe00 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7efd0c0086f0 tx=0x7efd0c0087e0 comp rx=0 tx=0).stop 2024-09-17T01:48:23.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.107+0000 7efd1e200640 1 -- 172.21.15.42:0/2806814104 reap_dead start 2024-09-17T01:48:23.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.107+0000 7efd245d3f40 1 -- 172.21.15.42:0/2806814104 shutdown_connections 2024-09-17T01:48:23.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.107+0000 7efd245d3f40 1 -- 172.21.15.42:0/2806814104 >> 172.21.15.42:0/2806814104 conn(0x55d712106ac0 msgr2=0x55d712215a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:23.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.107+0000 7efd245d3f40 1 -- 172.21.15.42:0/2806814104 shutdown_connections 2024-09-17T01:48:23.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.107+0000 7efd245d3f40 1 -- 172.21.15.42:0/2806814104 wait complete. 2024-09-17T01:48:23.119 INFO:teuthology.orchestra.run.smithi042.stdout:Ysixmegssubdir  2024-09-17T01:48:23.119 DEBUG:teuthology.orchestra.run.smithi042:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-09-17T01:48:23.309 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:48:23.309 INFO:teuthology.orchestra.run.smithi042.stdout: "ino": 1099511627777, 2024-09-17T01:48:23.309 INFO:teuthology.orchestra.run.smithi042.stdout: "ancestors": [ 2024-09-17T01:48:23.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:48:23.309 INFO:teuthology.orchestra.run.smithi042.stdout: "dirino": 1099511627776, 2024-09-17T01:48:23.310 INFO:teuthology.orchestra.run.smithi042.stdout: "dname": "sixmegs", 2024-09-17T01:48:23.310 INFO:teuthology.orchestra.run.smithi042.stdout: "version": 8 2024-09-17T01:48:23.310 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:48:23.310 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:48:23.310 INFO:teuthology.orchestra.run.smithi042.stdout: "dirino": 1, 2024-09-17T01:48:23.310 INFO:teuthology.orchestra.run.smithi042.stdout: "dname": "subdir", 2024-09-17T01:48:23.310 INFO:teuthology.orchestra.run.smithi042.stdout: "version": 11 2024-09-17T01:48:23.310 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:48:23.310 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-09-17T01:48:23.310 INFO:teuthology.orchestra.run.smithi042.stdout: "pool": 29, 2024-09-17T01:48:23.310 INFO:teuthology.orchestra.run.smithi042.stdout: "old_pools": [] 2024-09-17T01:48:23.310 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:48:23.311 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:48:23.367 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:48:23.367 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:48:23.460 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:48:23.548 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:48:23.548 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:48:23.549 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:48:23.549 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:48:23.585 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:48:23.585 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:48:23.660 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T01:48:23.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.932+0000 7faf74c00640 1 -- 172.21.15.42:0/115689588 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf54005320 msgr2=0x7faf5400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:23.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.932+0000 7faf74c00640 1 --2- 172.21.15.42:0/115689588 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf54005320 0x7faf5400b9c0 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7faf700b4d10 tx=0x7faf54005830 comp rx=0 tx=0).stop 2024-09-17T01:48:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.932+0000 7faf6fe00640 1 -- 172.21.15.42:0/115689588 reap_dead start 2024-09-17T01:48:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.932+0000 7faf74c00640 1 -- 172.21.15.42:0/115689588 shutdown_connections 2024-09-17T01:48:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.932+0000 7faf74c00640 1 -- 172.21.15.42:0/115689588 >> 172.21.15.42:0/115689588 conn(0x7faf7006d3f0 msgr2=0x7faf700b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.932+0000 7faf74c00640 1 -- 172.21.15.42:0/115689588 shutdown_connections 2024-09-17T01:48:23.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.932+0000 7faf74c00640 1 -- 172.21.15.42:0/115689588 wait complete. 2024-09-17T01:48:23.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.934+0000 7faf74c00640 1 Processor -- start 2024-09-17T01:48:23.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.935+0000 7faf74c00640 1 -- start start 2024-09-17T01:48:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.936+0000 7faf74c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf54005320 0x7faf70159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.936+0000 7faf74c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf700b0d10 0x7faf701588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.936+0000 7faf74c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faf701f4a60 0x7faf701f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.936+0000 7faf74c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faf700b55e0 con 0x7faf700b0d10 2024-09-17T01:48:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.936+0000 7faf74c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faf700b5760 con 0x7faf54005320 2024-09-17T01:48:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.936+0000 7faf74c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7faf700b58e0 con 0x7faf701f4a60 2024-09-17T01:48:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.936+0000 7faf67e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf700b0d10 0x7faf701588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.936+0000 7faf67e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf700b0d10 0x7faf701588b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59408/0 (socket says 172.21.15.42:59408) 2024-09-17T01:48:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.936+0000 7faf67e00640 1 -- 172.21.15.42:0/2418310110 learned_addr learned my addr 172.21.15.42:0/2418310110 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.936+0000 7faf6fe00640 1 --2- 172.21.15.42:0/2418310110 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faf701f4a60 0x7faf701f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:23.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.936+0000 7faf6f400640 1 --2- 172.21.15.42:0/2418310110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf54005320 0x7faf70159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:23.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.937+0000 7faf67e00640 1 -- 172.21.15.42:0/2418310110 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faf701f4a60 msgr2=0x7faf701f4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:23.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.937+0000 7faf67e00640 1 --2- 172.21.15.42:0/2418310110 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faf701f4a60 0x7faf701f4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:23.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.937+0000 7faf67e00640 1 -- 172.21.15.42:0/2418310110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf54005320 msgr2=0x7faf70159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:23.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.937+0000 7faf67e00640 1 --2- 172.21.15.42:0/2418310110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf54005320 0x7faf70159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:23.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.937+0000 7faf67e00640 1 -- 172.21.15.42:0/2418310110 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf70159050 con 0x7faf700b0d10 2024-09-17T01:48:23.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.937+0000 7faf6f400640 1 --2- 172.21.15.42:0/2418310110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf54005320 0x7faf70159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:23.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.937+0000 7faf67e00640 1 --2- 172.21.15.42:0/2418310110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf700b0d10 0x7faf701588b0 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7faf58006660 tx=0x7faf580039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:23.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.937+0000 7faf67400640 1 -- 172.21.15.42:0/2418310110 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf58015070 con 0x7faf700b0d10 2024-09-17T01:48:23.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.937+0000 7faf67400640 1 -- 172.21.15.42:0/2418310110 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf58011900 con 0x7faf700b0d10 2024-09-17T01:48:23.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.937+0000 7faf74c00640 1 -- 172.21.15.42:0/2418310110 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf70159330 con 0x7faf700b0d10 2024-09-17T01:48:23.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.937+0000 7faf67400640 1 -- 172.21.15.42:0/2418310110 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf58011d50 con 0x7faf700b0d10 2024-09-17T01:48:23.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.937+0000 7faf74c00640 1 -- 172.21.15.42:0/2418310110 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf700b0510 con 0x7faf700b0d10 2024-09-17T01:48:23.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.939+0000 7faf74c00640 1 -- 172.21.15.42:0/2418310110 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf70073d00 con 0x7faf700b0d10 2024-09-17T01:48:23.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.940+0000 7faf67400640 1 -- 172.21.15.42:0/2418310110 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faf58018070 con 0x7faf700b0d10 2024-09-17T01:48:23.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.941+0000 7faf67400640 1 --2- 172.21.15.42:0/2418310110 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faf4c078b90 0x7faf4c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:23.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.941+0000 7faf67400640 1 -- 172.21.15.42:0/2418310110 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 5854+0+0 (secure 0 0 0) 0x7faf5809bba0 con 0x7faf700b0d10 2024-09-17T01:48:23.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.941+0000 7faf6f400640 1 --2- 172.21.15.42:0/2418310110 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faf4c078b90 0x7faf4c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:23.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.942+0000 7faf6f400640 1 --2- 172.21.15.42:0/2418310110 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faf4c078b90 0x7faf4c07b0a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7faf60000c00 tx=0x7faf60006b10 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:23.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:23.946+0000 7faf67400640 1 -- 172.21.15.42:0/2418310110 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faf58063900 con 0x7faf700b0d10 2024-09-17T01:48:24.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.158+0000 7faf74c00640 1 -- 172.21.15.42:0/2418310110 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7faf700aea10 con 0x7faf700b0d10 2024-09-17T01:48:24.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.159+0000 7faf67400640 1 -- 172.21.15.42:0/2418310110 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v202) ==== 80+0+0 (secure 0 0 0) 0x7faf58068330 con 0x7faf700b0d10 2024-09-17T01:48:24.157 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-17T01:48:24.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.161+0000 7faf74c00640 1 -- 172.21.15.42:0/2418310110 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faf4c078b90 msgr2=0x7faf4c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:24.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.161+0000 7faf74c00640 1 --2- 172.21.15.42:0/2418310110 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faf4c078b90 0x7faf4c07b0a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7faf60000c00 tx=0x7faf60006b10 comp rx=0 tx=0).stop 2024-09-17T01:48:24.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.161+0000 7faf74c00640 1 -- 172.21.15.42:0/2418310110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf700b0d10 msgr2=0x7faf701588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:24.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.161+0000 7faf74c00640 1 --2- 172.21.15.42:0/2418310110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf700b0d10 0x7faf701588b0 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7faf58006660 tx=0x7faf580039c0 comp rx=0 tx=0).stop 2024-09-17T01:48:24.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.161+0000 7faf74c00640 1 -- 172.21.15.42:0/2418310110 shutdown_connections 2024-09-17T01:48:24.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.161+0000 7faf74c00640 1 --2- 172.21.15.42:0/2418310110 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faf4c078b90 0x7faf4c07b0a0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:24.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.161+0000 7faf74c00640 1 --2- 172.21.15.42:0/2418310110 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faf701f4a60 0x7faf701f4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:24.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.161+0000 7faf74c00640 1 --2- 172.21.15.42:0/2418310110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faf700b0d10 0x7faf701588b0 unknown :-1 s=CLOSED pgs=2341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:24.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.161+0000 7faf74c00640 1 --2- 172.21.15.42:0/2418310110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf54005320 0x7faf70159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:24.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.161+0000 7faf74c00640 1 -- 172.21.15.42:0/2418310110 >> 172.21.15.42:0/2418310110 conn(0x7faf7006d3f0 msgr2=0x7faf7015b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:24.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.161+0000 7faf74c00640 1 -- 172.21.15.42:0/2418310110 shutdown_connections 2024-09-17T01:48:24.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.161+0000 7faf74c00640 1 -- 172.21.15.42:0/2418310110 wait complete. 2024-09-17T01:48:24.185 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T01:48:24.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:48:24.185 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T01:48:24.295 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:48:24.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:48:24.295 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T01:48:24.340 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:48:24.340 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:48:24.340 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:48:24.378 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:48:24.378 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:48:24.378 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:48:24.379 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:48:24.416 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:48:24.416 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:48:24.416 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:48:24.416 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:48:24.455 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:48:24.455 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:48:24.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.687+0000 7fcfafe00640 1 -- 172.21.15.42:0/3276384555 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb00afb00 msgr2=0x7fcfb0073d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:24.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.687+0000 7fcfafe00640 1 --2- 172.21.15.42:0/3276384555 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb00afb00 0x7fcfb0073d00 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7fcfb00b36a0 tx=0x7fcfa002a5d0 comp rx=0 tx=0).stop 2024-09-17T01:48:24.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.687+0000 7fcfafe00640 1 -- 172.21.15.42:0/3276384555 shutdown_connections 2024-09-17T01:48:24.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.687+0000 7fcfafe00640 1 --2- 172.21.15.42:0/3276384555 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcfb00b51d0 0x7fcfb00b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:24.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.687+0000 7fcfafe00640 1 --2- 172.21.15.42:0/3276384555 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb00afb00 0x7fcfb0073d00 unknown :-1 s=CLOSED pgs=2343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:24.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.687+0000 7fcfafe00640 1 -- 172.21.15.42:0/3276384555 >> 172.21.15.42:0/3276384555 conn(0x7fcfb006d3f0 msgr2=0x7fcfb00b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:24.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.687+0000 7fcfafe00640 1 -- 172.21.15.42:0/3276384555 shutdown_connections 2024-09-17T01:48:24.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.687+0000 7fcfafe00640 1 -- 172.21.15.42:0/3276384555 wait complete. 2024-09-17T01:48:24.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.690+0000 7fcfafe00640 1 Processor -- start 2024-09-17T01:48:24.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.690+0000 7fcfafe00640 1 -- start start 2024-09-17T01:48:24.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.691+0000 7fcfafe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb00afb00 0x7fcfb01f9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:24.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.691+0000 7fcfafe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfb00b51d0 0x7fcfb01efb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:24.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.691+0000 7fcfafe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcfb01605c0 0x7fcfb015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:24.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.691+0000 7fcfafe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb00ce4f0 con 0x7fcfb00afb00 2024-09-17T01:48:24.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.691+0000 7fcfafe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb00ce370 con 0x7fcfb00b51d0 2024-09-17T01:48:24.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.691+0000 7fcfafe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fcfb00ce670 con 0x7fcfb01605c0 2024-09-17T01:48:24.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.691+0000 7fcfaea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb00afb00 0x7fcfb01f9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:24.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.691+0000 7fcfaea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb00afb00 0x7fcfb01f9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59432/0 (socket says 172.21.15.42:59432) 2024-09-17T01:48:24.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.691+0000 7fcfaea00640 1 -- 172.21.15.42:0/1631126239 learned_addr learned my addr 172.21.15.42:0/1631126239 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:24.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.692+0000 7fcfa7e00640 1 --2- 172.21.15.42:0/1631126239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfb00b51d0 0x7fcfb01efb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:24.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.692+0000 7fcfaf400640 1 --2- 172.21.15.42:0/1631126239 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcfb01605c0 0x7fcfb015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:24.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.692+0000 7fcfaea00640 1 -- 172.21.15.42:0/1631126239 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcfb01605c0 msgr2=0x7fcfb015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:24.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.692+0000 7fcfaea00640 1 --2- 172.21.15.42:0/1631126239 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcfb01605c0 0x7fcfb015f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:24.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.692+0000 7fcfaea00640 1 -- 172.21.15.42:0/1631126239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfb00b51d0 msgr2=0x7fcfb01efb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:24.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.692+0000 7fcfaea00640 1 --2- 172.21.15.42:0/1631126239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfb00b51d0 0x7fcfb01efb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:24.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.692+0000 7fcfaea00640 1 -- 172.21.15.42:0/1631126239 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb01f5c90 con 0x7fcfb00afb00 2024-09-17T01:48:24.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.692+0000 7fcfaea00640 1 --2- 172.21.15.42:0/1631126239 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb00afb00 0x7fcfb01f9ca0 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00099c0 tx=0x7fcfa0003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:24.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.693+0000 7fcfa6a00640 1 -- 172.21.15.42:0/1631126239 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa003e030 con 0x7fcfb00afb00 2024-09-17T01:48:24.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.693+0000 7fcfa6a00640 1 -- 172.21.15.42:0/1631126239 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfa0003c20 con 0x7fcfb00afb00 2024-09-17T01:48:24.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.693+0000 7fcfa6a00640 1 -- 172.21.15.42:0/1631126239 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0035040 con 0x7fcfb00afb00 2024-09-17T01:48:24.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.693+0000 7fcfafe00640 1 -- 172.21.15.42:0/1631126239 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfb01f5f00 con 0x7fcfb00afb00 2024-09-17T01:48:24.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.693+0000 7fcfafe00640 1 -- 172.21.15.42:0/1631126239 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfb01f64c0 con 0x7fcfb00afb00 2024-09-17T01:48:24.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.694+0000 7fcfafe00640 1 -- 172.21.15.42:0/1631126239 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfb0073d00 con 0x7fcfb00afb00 2024-09-17T01:48:24.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.695+0000 7fcfa6a00640 1 -- 172.21.15.42:0/1631126239 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcfa0041030 con 0x7fcfb00afb00 2024-09-17T01:48:24.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.696+0000 7fcfa6a00640 1 --2- 172.21.15.42:0/1631126239 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcf8c078b90 0x7fcf8c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:24.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.696+0000 7fcfa6a00640 1 -- 172.21.15.42:0/1631126239 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 5854+0+0 (secure 0 0 0) 0x7fcfa00bb2a0 con 0x7fcfb00afb00 2024-09-17T01:48:24.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.696+0000 7fcfa7e00640 1 --2- 172.21.15.42:0/1631126239 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcf8c078b90 0x7fcf8c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:24.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.697+0000 7fcfa7e00640 1 --2- 172.21.15.42:0/1631126239 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcf8c078b90 0x7fcf8c07b0a0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fcfb015a740 tx=0x7fcf98005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:24.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.701+0000 7fcfa6a00640 1 -- 172.21.15.42:0/1631126239 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcfa0082ff0 con 0x7fcfb00afb00 2024-09-17T01:48:24.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.930+0000 7fcfafe00640 1 -- 172.21.15.42:0/1631126239 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcfb015d0e0 con 0x7fcfb00afb00 2024-09-17T01:48:24.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.930+0000 7fcfa6a00640 1 -- 172.21.15.42:0/1631126239 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 159 v159) ==== 95+0+5231 (secure 0 0 0) 0x7fcfa0087a20 con 0x7fcfb00afb00 2024-09-17T01:48:24.928 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:48:24.929 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":159,"btime":"2024-09-17T01:47:39:016238+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3701245274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3701245274},{"type":"v1","addr":"172.21.15.43:6837","nonce":3701245274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10021,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/8838410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":8838410},{"type":"v1","addr":"172.21.15.42:6834","nonce":8838410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3981236009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3981236009},{"type":"v1","addr":"172.21.15.43:6836","nonce":3981236009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154}],"filesystems":[{"mdsmap":{"epoch":159,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:47:35.510920+0000","modified":"2024-09-17T01:47:38.527136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10776":{"gid":10776,"name":"c","rank":0,"incarnation":155,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3836210591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3836210591},{"type":"v1","addr":"172.21.15.42:6835","nonce":3836210591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10776,"qdb_cluster":[10776]},"id":14}]} 2024-09-17T01:48:24.929 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 159 2024-09-17T01:48:24.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.933+0000 7fcfafe00640 1 -- 172.21.15.42:0/1631126239 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcf8c078b90 msgr2=0x7fcf8c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:24.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.933+0000 7fcfafe00640 1 --2- 172.21.15.42:0/1631126239 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcf8c078b90 0x7fcf8c07b0a0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fcfb015a740 tx=0x7fcf98005f90 comp rx=0 tx=0).stop 2024-09-17T01:48:24.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.933+0000 7fcfafe00640 1 -- 172.21.15.42:0/1631126239 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb00afb00 msgr2=0x7fcfb01f9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:24.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.933+0000 7fcfafe00640 1 --2- 172.21.15.42:0/1631126239 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb00afb00 0x7fcfb01f9ca0 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00099c0 tx=0x7fcfa0003820 comp rx=0 tx=0).stop 2024-09-17T01:48:24.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.933+0000 7fcfafe00640 1 -- 172.21.15.42:0/1631126239 shutdown_connections 2024-09-17T01:48:24.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.933+0000 7fcfafe00640 1 --2- 172.21.15.42:0/1631126239 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcf8c078b90 0x7fcf8c07b0a0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:24.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.933+0000 7fcfafe00640 1 --2- 172.21.15.42:0/1631126239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfb00b51d0 0x7fcfb01efb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:24.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.933+0000 7fcfafe00640 1 --2- 172.21.15.42:0/1631126239 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcfb01605c0 0x7fcfb015f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:24.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.933+0000 7fcfafe00640 1 --2- 172.21.15.42:0/1631126239 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb00afb00 0x7fcfb01f9ca0 unknown :-1 s=CLOSED pgs=2344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:24.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.933+0000 7fcfafe00640 1 -- 172.21.15.42:0/1631126239 >> 172.21.15.42:0/1631126239 conn(0x7fcfb006d3f0 msgr2=0x7fcfb015ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:24.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.933+0000 7fcfafe00640 1 -- 172.21.15.42:0/1631126239 shutdown_connections 2024-09-17T01:48:24.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:24.933+0000 7fcfafe00640 1 -- 172.21.15.42:0/1631126239 wait complete. 2024-09-17T01:48:24.953 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:48:25.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.183+0000 7f7a8f200640 1 -- 172.21.15.42:0/2959558427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a6c0039e0 msgr2=0x7f7a6c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:25.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.183+0000 7f7a8f200640 1 --2- 172.21.15.42:0/2959558427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a6c0039e0 0x7f7a6c003e30 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 crypto rx=0x7f7a78009b50 tx=0x7f7a6c005830 comp rx=0 tx=0).stop 2024-09-17T01:48:25.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.183+0000 7f7a8d200640 1 -- 172.21.15.42:0/2959558427 reap_dead start 2024-09-17T01:48:25.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.183+0000 7f7a8f200640 1 -- 172.21.15.42:0/2959558427 shutdown_connections 2024-09-17T01:48:25.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.183+0000 7f7a8f200640 1 -- 172.21.15.42:0/2959558427 >> 172.21.15.42:0/2959558427 conn(0x7f7a8806d1b0 msgr2=0x7f7a8806d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:25.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.183+0000 7f7a8f200640 1 -- 172.21.15.42:0/2959558427 shutdown_connections 2024-09-17T01:48:25.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.183+0000 7f7a8f200640 1 -- 172.21.15.42:0/2959558427 wait complete. 2024-09-17T01:48:25.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.186+0000 7f7a8f200640 1 Processor -- start 2024-09-17T01:48:25.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.186+0000 7f7a8f200640 1 -- start start 2024-09-17T01:48:25.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.187+0000 7f7a8f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7a6c0039e0 0x7f7a88144f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:25.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.187+0000 7f7a8f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a880acbb0 0x7f7a880acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:25.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.187+0000 7f7a8f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a880aea90 0x7f7a880aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:25.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.187+0000 7f7a8f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7a88072840 con 0x7f7a880acbb0 2024-09-17T01:48:25.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.187+0000 7f7a8f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7a880726c0 con 0x7f7a880aea90 2024-09-17T01:48:25.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.187+0000 7f7a8f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7a880cd6c0 con 0x7f7a6c0039e0 2024-09-17T01:48:25.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.187+0000 7f7a7fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a880acbb0 0x7f7a880acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:25.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.188+0000 7f7a7fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a880acbb0 0x7f7a880acfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59450/0 (socket says 172.21.15.42:59450) 2024-09-17T01:48:25.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.188+0000 7f7a7fe00640 1 -- 172.21.15.42:0/3123044440 learned_addr learned my addr 172.21.15.42:0/3123044440 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:25.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.188+0000 7f7a87e00640 1 --2- 172.21.15.42:0/3123044440 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7a6c0039e0 0x7f7a88144f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:25.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.188+0000 7f7a8d200640 1 --2- 172.21.15.42:0/3123044440 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a880aea90 0x7f7a880aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:25.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.188+0000 7f7a7fe00640 1 -- 172.21.15.42:0/3123044440 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7a6c0039e0 msgr2=0x7f7a88144f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:25.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.188+0000 7f7a7fe00640 1 --2- 172.21.15.42:0/3123044440 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7a6c0039e0 0x7f7a88144f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:25.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.188+0000 7f7a7fe00640 1 -- 172.21.15.42:0/3123044440 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a880aea90 msgr2=0x7f7a880aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:25.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.188+0000 7f7a7fe00640 1 --2- 172.21.15.42:0/3123044440 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a880aea90 0x7f7a880aeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:25.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.188+0000 7f7a7fe00640 1 -- 172.21.15.42:0/3123044440 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a880af3e0 con 0x7f7a880acbb0 2024-09-17T01:48:25.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.188+0000 7f7a8d200640 1 --2- 172.21.15.42:0/3123044440 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a880aea90 0x7f7a880aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:25.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.188+0000 7f7a7fe00640 1 --2- 172.21.15.42:0/3123044440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a880acbb0 0x7f7a880acfc0 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7f7a70003e80 tx=0x7f7a70001730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:25.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.188+0000 7f7a84c00640 1 -- 172.21.15.42:0/3123044440 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a70015070 con 0x7f7a880acbb0 2024-09-17T01:48:25.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.189+0000 7f7a84c00640 1 -- 172.21.15.42:0/3123044440 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a70011860 con 0x7f7a880acbb0 2024-09-17T01:48:25.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.189+0000 7f7a84c00640 1 -- 172.21.15.42:0/3123044440 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a70011cb0 con 0x7f7a880acbb0 2024-09-17T01:48:25.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.189+0000 7f7a8f200640 1 -- 172.21.15.42:0/3123044440 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a881f9d90 con 0x7f7a880acbb0 2024-09-17T01:48:25.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.189+0000 7f7a8f200640 1 -- 172.21.15.42:0/3123044440 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a881f5d80 con 0x7f7a880acbb0 2024-09-17T01:48:25.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.190+0000 7f7a8f200640 1 -- 172.21.15.42:0/3123044440 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a88051030 con 0x7f7a880acbb0 2024-09-17T01:48:25.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.191+0000 7f7a84c00640 1 -- 172.21.15.42:0/3123044440 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7a70018070 con 0x7f7a880acbb0 2024-09-17T01:48:25.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.192+0000 7f7a84c00640 1 --2- 172.21.15.42:0/3123044440 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7a64078b90 0x7f7a6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:25.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.192+0000 7f7a84c00640 1 -- 172.21.15.42:0/3123044440 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 5854+0+0 (secure 0 0 0) 0x7f7a7009bb00 con 0x7f7a880acbb0 2024-09-17T01:48:25.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.193+0000 7f7a87e00640 1 --2- 172.21.15.42:0/3123044440 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7a64078b90 0x7f7a6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:25.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.193+0000 7f7a87e00640 1 --2- 172.21.15.42:0/3123044440 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7a64078b90 0x7f7a6407b0a0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f7a78035000 tx=0x7f7a7802d040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:25.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.197+0000 7f7a84c00640 1 -- 172.21.15.42:0/3123044440 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7a88051030 con 0x7f7a880acbb0 2024-09-17T01:48:25.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.426+0000 7f7a8f200640 1 -- 172.21.15.42:0/3123044440 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a880ad520 con 0x7f7a880acbb0 2024-09-17T01:48:25.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.426+0000 7f7a84c00640 1 -- 172.21.15.42:0/3123044440 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 159 v159) ==== 95+0+5231 (secure 0 0 0) 0x7f7a7009be20 con 0x7f7a880acbb0 2024-09-17T01:48:25.425 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:48:25.425 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":159,"btime":"2024-09-17T01:47:39:016238+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3701245274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3701245274},{"type":"v1","addr":"172.21.15.43:6837","nonce":3701245274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10021,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/8838410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":8838410},{"type":"v1","addr":"172.21.15.42:6834","nonce":8838410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3981236009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3981236009},{"type":"v1","addr":"172.21.15.43:6836","nonce":3981236009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154}],"filesystems":[{"mdsmap":{"epoch":159,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:47:35.510920+0000","modified":"2024-09-17T01:47:38.527136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10776":{"gid":10776,"name":"c","rank":0,"incarnation":155,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3836210591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3836210591},{"type":"v1","addr":"172.21.15.42:6835","nonce":3836210591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10776,"qdb_cluster":[10776]},"id":14}]} 2024-09-17T01:48:25.425 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 159 2024-09-17T01:48:25.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.429+0000 7f7a8f200640 1 -- 172.21.15.42:0/3123044440 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7a64078b90 msgr2=0x7f7a6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:25.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.429+0000 7f7a8f200640 1 --2- 172.21.15.42:0/3123044440 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7a64078b90 0x7f7a6407b0a0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f7a78035000 tx=0x7f7a7802d040 comp rx=0 tx=0).stop 2024-09-17T01:48:25.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.429+0000 7f7a8f200640 1 -- 172.21.15.42:0/3123044440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a880acbb0 msgr2=0x7f7a880acfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:25.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.429+0000 7f7a8f200640 1 --2- 172.21.15.42:0/3123044440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a880acbb0 0x7f7a880acfc0 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7f7a70003e80 tx=0x7f7a70001730 comp rx=0 tx=0).stop 2024-09-17T01:48:25.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.429+0000 7f7a8f200640 1 -- 172.21.15.42:0/3123044440 shutdown_connections 2024-09-17T01:48:25.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.429+0000 7f7a8f200640 1 --2- 172.21.15.42:0/3123044440 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7a64078b90 0x7f7a6407b0a0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:25.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.429+0000 7f7a8f200640 1 --2- 172.21.15.42:0/3123044440 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a880aea90 0x7f7a880aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:25.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.429+0000 7f7a8f200640 1 --2- 172.21.15.42:0/3123044440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7a880acbb0 0x7f7a880acfc0 unknown :-1 s=CLOSED pgs=2347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:25.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.429+0000 7f7a8f200640 1 --2- 172.21.15.42:0/3123044440 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7a6c0039e0 0x7f7a88144f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:25.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.429+0000 7f7a8f200640 1 -- 172.21.15.42:0/3123044440 >> 172.21.15.42:0/3123044440 conn(0x7f7a8806d1b0 msgr2=0x7f7a880b4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:25.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.429+0000 7f7a8f200640 1 -- 172.21.15.42:0/3123044440 shutdown_connections 2024-09-17T01:48:25.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.429+0000 7f7a8f200640 1 -- 172.21.15.42:0/3123044440 wait complete. 2024-09-17T01:48:25.449 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:48:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.679+0000 7f4140e00640 1 -- 172.21.15.42:0/3964773511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4120004800 msgr2=0x7f4120004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.679+0000 7f4140e00640 1 --2- 172.21.15.42:0/3964773511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4120004800 0x7f4120004c10 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 crypto rx=0x7f4124009b50 tx=0x7f4120005830 comp rx=0 tx=0).stop 2024-09-17T01:48:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.679+0000 7f4140e00640 1 -- 172.21.15.42:0/3964773511 shutdown_connections 2024-09-17T01:48:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.679+0000 7f4140e00640 1 --2- 172.21.15.42:0/3964773511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4120004800 0x7f4120004c10 unknown :-1 s=CLOSED pgs=2349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.679+0000 7f4140e00640 1 -- 172.21.15.42:0/3964773511 >> 172.21.15.42:0/3964773511 conn(0x7f413c06d3f0 msgr2=0x7f413c0b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.679+0000 7f4140e00640 1 -- 172.21.15.42:0/3964773511 shutdown_connections 2024-09-17T01:48:25.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.679+0000 7f4140e00640 1 -- 172.21.15.42:0/3964773511 wait complete. 2024-09-17T01:48:25.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.682+0000 7f4140e00640 1 Processor -- start 2024-09-17T01:48:25.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.682+0000 7f4140e00640 1 -- start start 2024-09-17T01:48:25.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.683+0000 7f4140e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4120004800 0x7f413c15a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:25.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.683+0000 7f4140e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f413c1503c0 0x7f413c1f6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:25.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.683+0000 7f4140e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f413c1f7390 0x7f413c14e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:25.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.684+0000 7f4140e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f413c0b5970 con 0x7f4120004800 2024-09-17T01:48:25.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.684+0000 7f4140e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f413c0b57f0 con 0x7f413c1503c0 2024-09-17T01:48:25.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.684+0000 7f4140e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f413c073d00 con 0x7f413c1f7390 2024-09-17T01:48:25.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.684+0000 7f413b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4120004800 0x7f413c15a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:25.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.684+0000 7f413b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4120004800 0x7f413c15a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59472/0 (socket says 172.21.15.42:59472) 2024-09-17T01:48:25.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.684+0000 7f413b400640 1 -- 172.21.15.42:0/2024373025 learned_addr learned my addr 172.21.15.42:0/2024373025 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:25.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.684+0000 7f4132a00640 1 --2- 172.21.15.42:0/2024373025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f413c1503c0 0x7f413c1f6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:25.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.684+0000 7f413be00640 1 --2- 172.21.15.42:0/2024373025 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f413c1f7390 0x7f413c14e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:25.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.684+0000 7f413b400640 1 -- 172.21.15.42:0/2024373025 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f413c1f7390 msgr2=0x7f413c14e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:25.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.684+0000 7f413b400640 1 --2- 172.21.15.42:0/2024373025 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f413c1f7390 0x7f413c14e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:25.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.684+0000 7f413b400640 1 -- 172.21.15.42:0/2024373025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f413c1503c0 msgr2=0x7f413c1f6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:25.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.684+0000 7f413b400640 1 --2- 172.21.15.42:0/2024373025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f413c1503c0 0x7f413c1f6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:25.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.684+0000 7f413b400640 1 -- 172.21.15.42:0/2024373025 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413c1f77a0 con 0x7f4120004800 2024-09-17T01:48:25.684 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.685+0000 7f413b400640 1 --2- 172.21.15.42:0/2024373025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4120004800 0x7f413c15a260 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7f412c003ed0 tx=0x7f412c001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:25.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.686+0000 7f4133e00640 1 -- 172.21.15.42:0/2024373025 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c011640 con 0x7f4120004800 2024-09-17T01:48:25.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.686+0000 7f4133e00640 1 -- 172.21.15.42:0/2024373025 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f412c016020 con 0x7f4120004800 2024-09-17T01:48:25.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.686+0000 7f4133e00640 1 -- 172.21.15.42:0/2024373025 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c011a60 con 0x7f4120004800 2024-09-17T01:48:25.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.686+0000 7f4140e00640 1 -- 172.21.15.42:0/2024373025 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f413c151110 con 0x7f4120004800 2024-09-17T01:48:25.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.686+0000 7f4140e00640 1 -- 172.21.15.42:0/2024373025 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f413c1516d0 con 0x7f4120004800 2024-09-17T01:48:25.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.688+0000 7f4140e00640 1 -- 172.21.15.42:0/2024373025 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f413c0766b0 con 0x7f4120004800 2024-09-17T01:48:25.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.689+0000 7f4133e00640 1 -- 172.21.15.42:0/2024373025 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f412c011c00 con 0x7f4120004800 2024-09-17T01:48:25.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.690+0000 7f4133e00640 1 --2- 172.21.15.42:0/2024373025 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4118078bc0 0x7f411807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:25.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.690+0000 7f4133e00640 1 -- 172.21.15.42:0/2024373025 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 5854+0+0 (secure 0 0 0) 0x7f412c09b800 con 0x7f4120004800 2024-09-17T01:48:25.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.690+0000 7f4132a00640 1 --2- 172.21.15.42:0/2024373025 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4118078bc0 0x7f411807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:25.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.691+0000 7f4132a00640 1 --2- 172.21.15.42:0/2024373025 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4118078bc0 0x7f411807b0d0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f4124035000 tx=0x7f41240046c0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:25.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.696+0000 7f4133e00640 1 -- 172.21.15.42:0/2024373025 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f412c020020 con 0x7f4120004800 2024-09-17T01:48:25.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.893+0000 7f4140e00640 1 -- 172.21.15.42:0/2024373025 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f413c0741f0 con 0x7f4120004800 2024-09-17T01:48:25.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.894+0000 7f4133e00640 1 -- 172.21.15.42:0/2024373025 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v202) ==== 74+0+16937 (secure 0 0 0) 0x7f413c1f77a0 con 0x7f4120004800 2024-09-17T01:48:25.892 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:48:25.892 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":202,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:47:52.600115+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:47:33.468675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-17T01:47:34.468959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"29.15","mappings":[{"from":1,"to":4}]},{"pgid":"29.16","mappings":[{"from":1,"to":6}]},{"pgid":"29.1d","mappings":[{"from":1,"to":4}]},{"pgid":"29.2b","mappings":[{"from":1,"to":6}]},{"pgid":"29.2f","mappings":[{"from":1,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:48:25.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.896+0000 7f4140e00640 1 -- 172.21.15.42:0/2024373025 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4118078bc0 msgr2=0x7f411807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:25.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.896+0000 7f4140e00640 1 --2- 172.21.15.42:0/2024373025 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4118078bc0 0x7f411807b0d0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f4124035000 tx=0x7f41240046c0 comp rx=0 tx=0).stop 2024-09-17T01:48:25.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.896+0000 7f4140e00640 1 -- 172.21.15.42:0/2024373025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4120004800 msgr2=0x7f413c15a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:25.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.896+0000 7f4140e00640 1 --2- 172.21.15.42:0/2024373025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4120004800 0x7f413c15a260 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7f412c003ed0 tx=0x7f412c001630 comp rx=0 tx=0).stop 2024-09-17T01:48:25.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.896+0000 7f4140e00640 1 -- 172.21.15.42:0/2024373025 shutdown_connections 2024-09-17T01:48:25.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.896+0000 7f4140e00640 1 --2- 172.21.15.42:0/2024373025 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4118078bc0 0x7f411807b0d0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:25.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.896+0000 7f4140e00640 1 --2- 172.21.15.42:0/2024373025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f413c1503c0 0x7f413c1f6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:25.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.896+0000 7f4140e00640 1 --2- 172.21.15.42:0/2024373025 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f413c1f7390 0x7f413c14e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:25.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.896+0000 7f4140e00640 1 --2- 172.21.15.42:0/2024373025 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4120004800 0x7f413c15a260 unknown :-1 s=CLOSED pgs=2350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:25.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.896+0000 7f4140e00640 1 -- 172.21.15.42:0/2024373025 >> 172.21.15.42:0/2024373025 conn(0x7f413c06d3f0 msgr2=0x7f413c15c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:25.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.896+0000 7f4140e00640 1 -- 172.21.15.42:0/2024373025 shutdown_connections 2024-09-17T01:48:25.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:25.896+0000 7f4140e00640 1 -- 172.21.15.42:0/2024373025 wait complete. 2024-09-17T01:48:25.916 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T01:48:25.917 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:48:26.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.148+0000 7f88d5200640 1 -- 172.21.15.42:0/2631567089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88d00afb00 msgr2=0x7f88d0073d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:26.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.148+0000 7f88d5200640 1 --2- 172.21.15.42:0/2631567089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88d00afb00 0x7f88d0073d00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f88c0005fd0 tx=0x7f88c002a5d0 comp rx=0 tx=0).stop 2024-09-17T01:48:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.148+0000 7f88d5200640 1 -- 172.21.15.42:0/2631567089 shutdown_connections 2024-09-17T01:48:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.148+0000 7f88d5200640 1 --2- 172.21.15.42:0/2631567089 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f88d0160cd0 0x7f88d00b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.148+0000 7f88d5200640 1 --2- 172.21.15.42:0/2631567089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88d00afb00 0x7f88d0073d00 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.148+0000 7f88d5200640 1 -- 172.21.15.42:0/2631567089 >> 172.21.15.42:0/2631567089 conn(0x7f88d006d3f0 msgr2=0x7f88d00b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.148+0000 7f88d5200640 1 -- 172.21.15.42:0/2631567089 shutdown_connections 2024-09-17T01:48:26.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.148+0000 7f88d5200640 1 -- 172.21.15.42:0/2631567089 wait complete. 2024-09-17T01:48:26.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.150+0000 7f88d5200640 1 Processor -- start 2024-09-17T01:48:26.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.151+0000 7f88d5200640 1 -- start start 2024-09-17T01:48:26.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.152+0000 7f88d5200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88d00afb00 0x7f88d0154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:26.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.152+0000 7f88d5200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f88d00b51d0 0x7f88d015f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:26.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.152+0000 7f88d5200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88d015f7c0 0x7f88d0151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:26.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.152+0000 7f88d5200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f88d00ce4f0 con 0x7f88d015f7c0 2024-09-17T01:48:26.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.152+0000 7f88d5200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f88d00ce370 con 0x7f88d00afb00 2024-09-17T01:48:26.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.152+0000 7f88d5200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f88d00ce670 con 0x7f88d00b51d0 2024-09-17T01:48:26.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.152+0000 7f88cfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88d015f7c0 0x7f88d0151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:26.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.152+0000 7f88cfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88d015f7c0 0x7f88d0151c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44166/0 (socket says 172.21.15.42:44166) 2024-09-17T01:48:26.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.152+0000 7f88cfe00640 1 -- 172.21.15.42:0/2881801482 learned_addr learned my addr 172.21.15.42:0/2881801482 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:26.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.153+0000 7f88cf400640 1 --2- 172.21.15.42:0/2881801482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88d00afb00 0x7f88d0154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:26.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.153+0000 7f88cea00640 1 --2- 172.21.15.42:0/2881801482 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f88d00b51d0 0x7f88d015f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:26.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.153+0000 7f88cfe00640 1 -- 172.21.15.42:0/2881801482 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f88d00b51d0 msgr2=0x7f88d015f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:26.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.153+0000 7f88cfe00640 1 --2- 172.21.15.42:0/2881801482 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f88d00b51d0 0x7f88d015f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:26.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.153+0000 7f88cfe00640 1 -- 172.21.15.42:0/2881801482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88d00afb00 msgr2=0x7f88d0154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:26.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.153+0000 7f88cfe00640 1 --2- 172.21.15.42:0/2881801482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88d00afb00 0x7f88d0154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:26.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.153+0000 7f88cfe00640 1 -- 172.21.15.42:0/2881801482 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d00b22a0 con 0x7f88d015f7c0 2024-09-17T01:48:26.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.153+0000 7f88cf400640 1 --2- 172.21.15.42:0/2881801482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88d00afb00 0x7f88d0154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:26.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.153+0000 7f88cfe00640 1 --2- 172.21.15.42:0/2881801482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88d015f7c0 0x7f88d0151c00 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 crypto rx=0x7f88c800ec50 tx=0x7f88c800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:26.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.153+0000 7f88c7400640 1 -- 172.21.15.42:0/2881801482 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8003b70 con 0x7f88d015f7c0 2024-09-17T01:48:26.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.154+0000 7f88c7400640 1 -- 172.21.15.42:0/2881801482 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88c8003d10 con 0x7f88d015f7c0 2024-09-17T01:48:26.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.154+0000 7f88c7400640 1 -- 172.21.15.42:0/2881801482 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8004280 con 0x7f88d015f7c0 2024-09-17T01:48:26.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.154+0000 7f88d5200640 1 -- 172.21.15.42:0/2881801482 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d01f52f0 con 0x7f88d015f7c0 2024-09-17T01:48:26.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.154+0000 7f88d5200640 1 -- 172.21.15.42:0/2881801482 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d01f58b0 con 0x7f88d015f7c0 2024-09-17T01:48:26.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.155+0000 7f88d5200640 1 -- 172.21.15.42:0/2881801482 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88d0073d00 con 0x7f88d015f7c0 2024-09-17T01:48:26.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.156+0000 7f88c7400640 1 -- 172.21.15.42:0/2881801482 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f88c8004420 con 0x7f88d015f7c0 2024-09-17T01:48:26.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.157+0000 7f88c7400640 1 --2- 172.21.15.42:0/2881801482 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f88b0078b90 0x7f88b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:26.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.157+0000 7f88c7400640 1 -- 172.21.15.42:0/2881801482 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 5854+0+0 (secure 0 0 0) 0x7f88c809bca0 con 0x7f88d015f7c0 2024-09-17T01:48:26.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.158+0000 7f88cf400640 1 --2- 172.21.15.42:0/2881801482 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f88b0078b90 0x7f88b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:26.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.158+0000 7f88cf400640 1 --2- 172.21.15.42:0/2881801482 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f88b0078b90 0x7f88b007b0a0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f88c0033000 tx=0x7f88c0004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:26.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.161+0000 7f88c7400640 1 -- 172.21.15.42:0/2881801482 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f88c8064040 con 0x7f88d015f7c0 2024-09-17T01:48:26.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.393+0000 7f88d5200640 1 -- 172.21.15.42:0/2881801482 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88d00b2030 con 0x7f88d015f7c0 2024-09-17T01:48:26.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.394+0000 7f88c7400640 1 -- 172.21.15.42:0/2881801482 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 159 v159) ==== 95+0+5231 (secure 0 0 0) 0x7f88c8063940 con 0x7f88d015f7c0 2024-09-17T01:48:26.392 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:48:26.392 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":159,"btime":"2024-09-17T01:47:39:016238+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3701245274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3701245274},{"type":"v1","addr":"172.21.15.43:6837","nonce":3701245274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10021,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/8838410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":8838410},{"type":"v1","addr":"172.21.15.42:6834","nonce":8838410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3981236009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3981236009},{"type":"v1","addr":"172.21.15.43:6836","nonce":3981236009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154}],"filesystems":[{"mdsmap":{"epoch":159,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:47:35.510920+0000","modified":"2024-09-17T01:47:38.527136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10776":{"gid":10776,"name":"c","rank":0,"incarnation":155,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3836210591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3836210591},{"type":"v1","addr":"172.21.15.42:6835","nonce":3836210591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10776,"qdb_cluster":[10776]},"id":14}]} 2024-09-17T01:48:26.392 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 159 2024-09-17T01:48:26.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.396+0000 7f88d5200640 1 -- 172.21.15.42:0/2881801482 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f88b0078b90 msgr2=0x7f88b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:26.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.396+0000 7f88d5200640 1 --2- 172.21.15.42:0/2881801482 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f88b0078b90 0x7f88b007b0a0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f88c0033000 tx=0x7f88c0004730 comp rx=0 tx=0).stop 2024-09-17T01:48:26.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.396+0000 7f88d5200640 1 -- 172.21.15.42:0/2881801482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88d015f7c0 msgr2=0x7f88d0151c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:26.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.396+0000 7f88d5200640 1 --2- 172.21.15.42:0/2881801482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88d015f7c0 0x7f88d0151c00 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 crypto rx=0x7f88c800ec50 tx=0x7f88c800c6a0 comp rx=0 tx=0).stop 2024-09-17T01:48:26.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.397+0000 7f88d5200640 1 -- 172.21.15.42:0/2881801482 shutdown_connections 2024-09-17T01:48:26.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.397+0000 7f88d5200640 1 --2- 172.21.15.42:0/2881801482 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f88b0078b90 0x7f88b007b0a0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:26.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.397+0000 7f88d5200640 1 --2- 172.21.15.42:0/2881801482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88d015f7c0 0x7f88d0151c00 unknown :-1 s=CLOSED pgs=2351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:26.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.397+0000 7f88d5200640 1 --2- 172.21.15.42:0/2881801482 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f88d00b51d0 0x7f88d015f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:26.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.397+0000 7f88d5200640 1 --2- 172.21.15.42:0/2881801482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88d00afb00 0x7f88d0154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:26.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.397+0000 7f88d5200640 1 -- 172.21.15.42:0/2881801482 >> 172.21.15.42:0/2881801482 conn(0x7f88d006d3f0 msgr2=0x7f88d015c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:26.395 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.397+0000 7f88d5200640 1 -- 172.21.15.42:0/2881801482 shutdown_connections 2024-09-17T01:48:26.396 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.397+0000 7f88d5200640 1 -- 172.21.15.42:0/2881801482 wait complete. 2024-09-17T01:48:26.421 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:48:26.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.650+0000 7fe006000640 1 -- 172.21.15.42:0/3429085171 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0000b51d0 msgr2=0x7fe0000b55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:26.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.650+0000 7fe006000640 1 --2- 172.21.15.42:0/3429085171 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0000b51d0 0x7fe0000b55e0 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7fe0000b36a0 tx=0x7fdfec02a5d0 comp rx=0 tx=0).stop 2024-09-17T01:48:26.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.650+0000 7fe006000640 1 -- 172.21.15.42:0/3429085171 shutdown_connections 2024-09-17T01:48:26.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.650+0000 7fe006000640 1 --2- 172.21.15.42:0/3429085171 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0000b51d0 0x7fe0000b55e0 unknown :-1 s=CLOSED pgs=2353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:26.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.650+0000 7fe006000640 1 --2- 172.21.15.42:0/3429085171 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0000afb00 0x7fe000073d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:26.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.650+0000 7fe006000640 1 -- 172.21.15.42:0/3429085171 >> 172.21.15.42:0/3429085171 conn(0x7fe00006d3f0 msgr2=0x7fe0000b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:26.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.650+0000 7fe006000640 1 -- 172.21.15.42:0/3429085171 shutdown_connections 2024-09-17T01:48:26.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.650+0000 7fe006000640 1 -- 172.21.15.42:0/3429085171 wait complete. 2024-09-17T01:48:26.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.653+0000 7fe006000640 1 Processor -- start 2024-09-17T01:48:26.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.653+0000 7fe006000640 1 -- start start 2024-09-17T01:48:26.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.654+0000 7fe006000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0000afb00 0x7fe000154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:26.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.654+0000 7fe006000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0000b51d0 0x7fe0001f8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:26.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.654+0000 7fe006000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0001605c0 0x7fe0001f9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:26.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.654+0000 7fe006000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe0000ce4f0 con 0x7fe0000afb00 2024-09-17T01:48:26.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.654+0000 7fe006000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe0000ce370 con 0x7fe0001605c0 2024-09-17T01:48:26.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.654+0000 7fe006000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe0000ce670 con 0x7fe0000b51d0 2024-09-17T01:48:26.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.654+0000 7fe004c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0000afb00 0x7fe000154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:26.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.654+0000 7fe004c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0000afb00 0x7fe000154450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44182/0 (socket says 172.21.15.42:44182) 2024-09-17T01:48:26.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.654+0000 7fe004c00640 1 -- 172.21.15.42:0/811706857 learned_addr learned my addr 172.21.15.42:0/811706857 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:26.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.655+0000 7fdfffe00640 1 --2- 172.21.15.42:0/811706857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0000b51d0 0x7fe0001f8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:26.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.655+0000 7fe005600640 1 --2- 172.21.15.42:0/811706857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0001605c0 0x7fe0001f9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:26.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.655+0000 7fe004c00640 1 -- 172.21.15.42:0/811706857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0000b51d0 msgr2=0x7fe0001f8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:26.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.655+0000 7fe004c00640 1 --2- 172.21.15.42:0/811706857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0000b51d0 0x7fe0001f8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:26.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.655+0000 7fe004c00640 1 -- 172.21.15.42:0/811706857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0001605c0 msgr2=0x7fe0001f9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:26.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.655+0000 7fe004c00640 1 --2- 172.21.15.42:0/811706857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0001605c0 0x7fe0001f9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:26.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.655+0000 7fe004c00640 1 -- 172.21.15.42:0/811706857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0000b22b0 con 0x7fe0000afb00 2024-09-17T01:48:26.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.655+0000 7fe005600640 1 --2- 172.21.15.42:0/811706857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0001605c0 0x7fe0001f9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:48:26.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.655+0000 7fe004c00640 1 --2- 172.21.15.42:0/811706857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0000afb00 0x7fe000154450 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7fdff400d770 tx=0x7fdff400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:26.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.655+0000 7fdffcc00640 1 -- 172.21.15.42:0/811706857 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff4017070 con 0x7fe0000afb00 2024-09-17T01:48:26.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.655+0000 7fdffcc00640 1 -- 172.21.15.42:0/811706857 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdff4009d20 con 0x7fe0000afb00 2024-09-17T01:48:26.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.655+0000 7fdffcc00640 1 -- 172.21.15.42:0/811706857 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff40106c0 con 0x7fe0000afb00 2024-09-17T01:48:26.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.655+0000 7fe006000640 1 -- 172.21.15.42:0/811706857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0000b2590 con 0x7fe0000afb00 2024-09-17T01:48:26.655 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.656+0000 7fe006000640 1 -- 172.21.15.42:0/811706857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe000157b10 con 0x7fe0000afb00 2024-09-17T01:48:26.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.657+0000 7fe006000640 1 -- 172.21.15.42:0/811706857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe000073d00 con 0x7fe0000afb00 2024-09-17T01:48:26.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.658+0000 7fdffcc00640 1 -- 172.21.15.42:0/811706857 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdff401a070 con 0x7fe0000afb00 2024-09-17T01:48:26.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.659+0000 7fdffcc00640 1 --2- 172.21.15.42:0/811706857 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdfe0078b90 0x7fdfe007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:26.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.659+0000 7fdffcc00640 1 -- 172.21.15.42:0/811706857 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 5854+0+0 (secure 0 0 0) 0x7fdff409aff0 con 0x7fe0000afb00 2024-09-17T01:48:26.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.659+0000 7fdfffe00640 1 --2- 172.21.15.42:0/811706857 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdfe0078b90 0x7fdfe007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:26.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.660+0000 7fdfffe00640 1 --2- 172.21.15.42:0/811706857 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdfe0078b90 0x7fdfe007b0a0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fdfec033000 tx=0x7fdfec004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:26.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.663+0000 7fdffcc00640 1 -- 172.21.15.42:0/811706857 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdff40632a0 con 0x7fe0000afb00 2024-09-17T01:48:26.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.896+0000 7fe006000640 1 -- 172.21.15.42:0/811706857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0000b2760 con 0x7fe0000afb00 2024-09-17T01:48:26.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.896+0000 7fdffcc00640 1 -- 172.21.15.42:0/811706857 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 159 v159) ==== 95+0+5231 (secure 0 0 0) 0x7fdff4062ba0 con 0x7fe0000afb00 2024-09-17T01:48:26.894 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:48:26.895 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":159,"btime":"2024-09-17T01:47:39:016238+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3701245274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3701245274},{"type":"v1","addr":"172.21.15.43:6837","nonce":3701245274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10021,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/8838410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":8838410},{"type":"v1","addr":"172.21.15.42:6834","nonce":8838410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3981236009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3981236009},{"type":"v1","addr":"172.21.15.43:6836","nonce":3981236009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154}],"filesystems":[{"mdsmap":{"epoch":159,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:47:35.510920+0000","modified":"2024-09-17T01:47:38.527136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10776":{"gid":10776,"name":"c","rank":0,"incarnation":155,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/3836210591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3836210591},{"type":"v1","addr":"172.21.15.42:6835","nonce":3836210591}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10776,"qdb_cluster":[10776]},"id":14}]} 2024-09-17T01:48:26.895 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 159 2024-09-17T01:48:26.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.899+0000 7fe006000640 1 -- 172.21.15.42:0/811706857 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdfe0078b90 msgr2=0x7fdfe007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:26.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.899+0000 7fe006000640 1 --2- 172.21.15.42:0/811706857 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdfe0078b90 0x7fdfe007b0a0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fdfec033000 tx=0x7fdfec004730 comp rx=0 tx=0).stop 2024-09-17T01:48:26.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.899+0000 7fe006000640 1 -- 172.21.15.42:0/811706857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0000afb00 msgr2=0x7fe000154450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:26.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.899+0000 7fe006000640 1 --2- 172.21.15.42:0/811706857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0000afb00 0x7fe000154450 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7fdff400d770 tx=0x7fdff400dc30 comp rx=0 tx=0).stop 2024-09-17T01:48:26.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.899+0000 7fe006000640 1 -- 172.21.15.42:0/811706857 shutdown_connections 2024-09-17T01:48:26.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.899+0000 7fe006000640 1 --2- 172.21.15.42:0/811706857 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdfe0078b90 0x7fdfe007b0a0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:26.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.899+0000 7fe006000640 1 --2- 172.21.15.42:0/811706857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0001605c0 0x7fe0001f9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:26.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.899+0000 7fe006000640 1 --2- 172.21.15.42:0/811706857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0000b51d0 0x7fe0001f8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:26.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.899+0000 7fe006000640 1 --2- 172.21.15.42:0/811706857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0000afb00 0x7fe000154450 unknown :-1 s=CLOSED pgs=2354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:26.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.899+0000 7fe006000640 1 -- 172.21.15.42:0/811706857 >> 172.21.15.42:0/811706857 conn(0x7fe00006d3f0 msgr2=0x7fe000075cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:26.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.899+0000 7fe006000640 1 -- 172.21.15.42:0/811706857 shutdown_connections 2024-09-17T01:48:26.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:26.899+0000 7fe006000640 1 -- 172.21.15.42:0/811706857 wait complete. 2024-09-17T01:48:26.925 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:48:27.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.154+0000 7fe222c00640 1 -- 172.21.15.42:0/3338085574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe21c0b51d0 msgr2=0x7fe21c0b55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:27.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.154+0000 7fe222c00640 1 --2- 172.21.15.42:0/3338085574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe21c0b51d0 0x7fe21c0b55e0 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 crypto rx=0x7fe21c072860 tx=0x7fe20802a580 comp rx=0 tx=0).stop 2024-09-17T01:48:27.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.154+0000 7fe222c00640 1 -- 172.21.15.42:0/3338085574 shutdown_connections 2024-09-17T01:48:27.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.154+0000 7fe222c00640 1 --2- 172.21.15.42:0/3338085574 >> v2:172.21.15.43:3300/0 conn(0x7fe21c1605c0 0x7fe21c1609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.154+0000 7fe222c00640 1 --2- 172.21.15.42:0/3338085574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe21c0b51d0 0x7fe21c0b55e0 unknown :-1 s=CLOSED pgs=2356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.154+0000 7fe222c00640 1 -- 172.21.15.42:0/3338085574 >> 172.21.15.42:0/3338085574 conn(0x7fe21c06d3f0 msgr2=0x7fe21c0b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:27.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.154+0000 7fe222c00640 1 -- 172.21.15.42:0/3338085574 shutdown_connections 2024-09-17T01:48:27.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.154+0000 7fe222c00640 1 -- 172.21.15.42:0/3338085574 wait complete. 2024-09-17T01:48:27.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.156+0000 7fe222c00640 1 Processor -- start 2024-09-17T01:48:27.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.156+0000 7fe222c00640 1 -- start start 2024-09-17T01:48:27.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.158+0000 7fe222c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe21c0afb00 0x7fe21c0cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:27.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.158+0000 7fe222c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe21c0b51d0 0x7fe21c0abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:27.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.158+0000 7fe222c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe21c1605c0 0x7fe21c0ac3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:27.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.158+0000 7fe222c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c0ce4f0 con 0x7fe21c0afb00 2024-09-17T01:48:27.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.158+0000 7fe222c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c0ce370 con 0x7fe21c1605c0 2024-09-17T01:48:27.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.158+0000 7fe222c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe21c0ce670 con 0x7fe21c0b51d0 2024-09-17T01:48:27.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.158+0000 7fe221800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe21c0afb00 0x7fe21c0cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:27.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.158+0000 7fe221800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe21c0afb00 0x7fe21c0cbf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44206/0 (socket says 172.21.15.42:44206) 2024-09-17T01:48:27.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.158+0000 7fe221800640 1 -- 172.21.15.42:0/693170355 learned_addr learned my addr 172.21.15.42:0/693170355 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:27.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.158+0000 7fe220e00640 1 --2- 172.21.15.42:0/693170355 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe21c0b51d0 0x7fe21c0abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:27.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.158+0000 7fe222200640 1 --2- 172.21.15.42:0/693170355 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe21c1605c0 0x7fe21c0ac3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:27.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.159+0000 7fe221800640 1 -- 172.21.15.42:0/693170355 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe21c0b51d0 msgr2=0x7fe21c0abeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:27.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.159+0000 7fe221800640 1 --2- 172.21.15.42:0/693170355 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe21c0b51d0 0x7fe21c0abeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.159+0000 7fe221800640 1 -- 172.21.15.42:0/693170355 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe21c1605c0 msgr2=0x7fe21c0ac3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:27.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.159+0000 7fe221800640 1 --2- 172.21.15.42:0/693170355 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe21c1605c0 0x7fe21c0ac3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.159+0000 7fe221800640 1 -- 172.21.15.42:0/693170355 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21c15a680 con 0x7fe21c0afb00 2024-09-17T01:48:27.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.159+0000 7fe221800640 1 --2- 172.21.15.42:0/693170355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe21c0afb00 0x7fe21c0cbf80 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7fe21000c3a0 tx=0x7fe21000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:27.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.159+0000 7fe219600640 1 -- 172.21.15.42:0/693170355 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe210017070 con 0x7fe21c0afb00 2024-09-17T01:48:27.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.159+0000 7fe219600640 1 -- 172.21.15.42:0/693170355 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2100053c0 con 0x7fe21c0afb00 2024-09-17T01:48:27.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.159+0000 7fe219600640 1 -- 172.21.15.42:0/693170355 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe210003850 con 0x7fe21c0afb00 2024-09-17T01:48:27.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.159+0000 7fe222c00640 1 -- 172.21.15.42:0/693170355 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe21c0ab3f0 con 0x7fe21c0afb00 2024-09-17T01:48:27.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.159+0000 7fe222c00640 1 -- 172.21.15.42:0/693170355 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe21c0ab9b0 con 0x7fe21c0afb00 2024-09-17T01:48:27.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.160+0000 7fe222c00640 1 -- 172.21.15.42:0/693170355 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe21c0b55e0 con 0x7fe21c0afb00 2024-09-17T01:48:27.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.162+0000 7fe219600640 1 -- 172.21.15.42:0/693170355 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe21001a070 con 0x7fe21c0afb00 2024-09-17T01:48:27.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.163+0000 7fe219600640 1 --2- 172.21.15.42:0/693170355 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe1fc078b90 0x7fe1fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:27.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.163+0000 7fe219600640 1 -- 172.21.15.42:0/693170355 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 5854+0+0 (secure 0 0 0) 0x7fe21009a0e0 con 0x7fe21c0afb00 2024-09-17T01:48:27.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.163+0000 7fe220e00640 1 --2- 172.21.15.42:0/693170355 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe1fc078b90 0x7fe1fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:27.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.164+0000 7fe220e00640 1 --2- 172.21.15.42:0/693170355 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe1fc078b90 0x7fe1fc07b0a0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fe208033000 tx=0x7fe208004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:27.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.167+0000 7fe219600640 1 -- 172.21.15.42:0/693170355 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe21c160f10 con 0x7fe21c0afb00 2024-09-17T01:48:27.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.364+0000 7fe222c00640 1 -- 172.21.15.42:0/693170355 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe21c15fea0 con 0x7fe21c0afb00 2024-09-17T01:48:27.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.365+0000 7fe219600640 1 -- 172.21.15.42:0/693170355 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v202) ==== 74+0+16937 (secure 0 0 0) 0x7fe210061e40 con 0x7fe21c0afb00 2024-09-17T01:48:27.363 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:48:27.363 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":202,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:47:52.600115+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:47:33.468675+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-17T01:47:34.468959+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"29.15","mappings":[{"from":1,"to":4}]},{"pgid":"29.16","mappings":[{"from":1,"to":6}]},{"pgid":"29.1d","mappings":[{"from":1,"to":4}]},{"pgid":"29.2b","mappings":[{"from":1,"to":6}]},{"pgid":"29.2f","mappings":[{"from":1,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:48:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.367+0000 7fe222c00640 1 -- 172.21.15.42:0/693170355 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe1fc078b90 msgr2=0x7fe1fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.367+0000 7fe222c00640 1 --2- 172.21.15.42:0/693170355 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe1fc078b90 0x7fe1fc07b0a0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fe208033000 tx=0x7fe208004730 comp rx=0 tx=0).stop 2024-09-17T01:48:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.367+0000 7fe222c00640 1 -- 172.21.15.42:0/693170355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe21c0afb00 msgr2=0x7fe21c0cbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.367+0000 7fe222c00640 1 --2- 172.21.15.42:0/693170355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe21c0afb00 0x7fe21c0cbf80 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7fe21000c3a0 tx=0x7fe21000c860 comp rx=0 tx=0).stop 2024-09-17T01:48:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.368+0000 7fe222c00640 1 -- 172.21.15.42:0/693170355 shutdown_connections 2024-09-17T01:48:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.368+0000 7fe222c00640 1 --2- 172.21.15.42:0/693170355 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe1fc078b90 0x7fe1fc07b0a0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.368+0000 7fe222c00640 1 --2- 172.21.15.42:0/693170355 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe21c1605c0 0x7fe21c0ac3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.368+0000 7fe222c00640 1 --2- 172.21.15.42:0/693170355 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe21c0b51d0 0x7fe21c0abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.368+0000 7fe222c00640 1 --2- 172.21.15.42:0/693170355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe21c0afb00 0x7fe21c0cbf80 unknown :-1 s=CLOSED pgs=2357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.368+0000 7fe222c00640 1 -- 172.21.15.42:0/693170355 >> 172.21.15.42:0/693170355 conn(0x7fe21c06d3f0 msgr2=0x7fe21c15b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.368+0000 7fe222c00640 1 -- 172.21.15.42:0/693170355 shutdown_connections 2024-09-17T01:48:27.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.368+0000 7fe222c00640 1 -- 172.21.15.42:0/693170355 wait complete. 2024-09-17T01:48:27.390 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T01:48:27.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.621+0000 7fd8e2200640 1 -- 172.21.15.42:0/382978838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8dc0cf480 msgr2=0x7fd8dc0cf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:27.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.621+0000 7fd8e2200640 1 --2- 172.21.15.42:0/382978838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8dc0cf480 0x7fd8dc0cf890 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc06dc80 tx=0x7fd8d402aa30 comp rx=0 tx=0).stop 2024-09-17T01:48:27.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.621+0000 7fd8e2200640 1 -- 172.21.15.42:0/382978838 shutdown_connections 2024-09-17T01:48:27.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.621+0000 7fd8e2200640 1 --2- 172.21.15.42:0/382978838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8dc0cf480 0x7fd8dc0cf890 unknown :-1 s=CLOSED pgs=2358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.621+0000 7fd8e2200640 1 --2- 172.21.15.42:0/382978838 >> v2:172.21.15.43:3300/0 conn(0x7fd8dc15c9f0 0x7fd8dc06f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.621+0000 7fd8e2200640 1 -- 172.21.15.42:0/382978838 >> 172.21.15.42:0/382978838 conn(0x7fd8dc06d3f0 msgr2=0x7fd8dc0b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:27.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.621+0000 7fd8e2200640 1 -- 172.21.15.42:0/382978838 shutdown_connections 2024-09-17T01:48:27.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.621+0000 7fd8e2200640 1 -- 172.21.15.42:0/382978838 wait complete. 2024-09-17T01:48:27.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.623+0000 7fd8e2200640 1 Processor -- start 2024-09-17T01:48:27.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.624+0000 7fd8e2200640 1 -- start start 2024-09-17T01:48:27.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.625+0000 7fd8e2200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd8dc0cf480 0x7fd8dc148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:27.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.625+0000 7fd8e2200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8dc15c9f0 0x7fd8dc0c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:27.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.625+0000 7fd8e2200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8dc15fe40 0x7fd8dc0c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:27.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.625+0000 7fd8e2200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd8dc0b4180 con 0x7fd8dc15c9f0 2024-09-17T01:48:27.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.625+0000 7fd8e2200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd8dc0b4000 con 0x7fd8dc15fe40 2024-09-17T01:48:27.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.625+0000 7fd8e2200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd8dc0b4300 con 0x7fd8dc0cf480 2024-09-17T01:48:27.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.625+0000 7fd8dbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8dc15c9f0 0x7fd8dc0c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:27.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.625+0000 7fd8dbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8dc15c9f0 0x7fd8dc0c7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44226/0 (socket says 172.21.15.42:44226) 2024-09-17T01:48:27.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.625+0000 7fd8dbe00640 1 -- 172.21.15.42:0/3179181040 learned_addr learned my addr 172.21.15.42:0/3179181040 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:27.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.626+0000 7fd8e0e00640 1 --2- 172.21.15.42:0/3179181040 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd8dc0cf480 0x7fd8dc148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:27.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.626+0000 7fd8e1800640 1 --2- 172.21.15.42:0/3179181040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8dc15fe40 0x7fd8dc0c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:27.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.626+0000 7fd8dbe00640 1 -- 172.21.15.42:0/3179181040 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd8dc0cf480 msgr2=0x7fd8dc148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:27.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.626+0000 7fd8dbe00640 1 --2- 172.21.15.42:0/3179181040 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd8dc0cf480 0x7fd8dc148b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.626+0000 7fd8dbe00640 1 -- 172.21.15.42:0/3179181040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8dc15fe40 msgr2=0x7fd8dc0c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:27.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.626+0000 7fd8dbe00640 1 --2- 172.21.15.42:0/3179181040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8dc15fe40 0x7fd8dc0c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.626+0000 7fd8dbe00640 1 -- 172.21.15.42:0/3179181040 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8dc0c5530 con 0x7fd8dc15c9f0 2024-09-17T01:48:27.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.626+0000 7fd8dbe00640 1 --2- 172.21.15.42:0/3179181040 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8dc15c9f0 0x7fd8dc0c7b10 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 crypto rx=0x7fd8c800c430 tx=0x7fd8c800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:27.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.626+0000 7fd8d8c00640 1 -- 172.21.15.42:0/3179181040 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8017070 con 0x7fd8dc15c9f0 2024-09-17T01:48:27.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.626+0000 7fd8d8c00640 1 -- 172.21.15.42:0/3179181040 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8c80053c0 con 0x7fd8dc15c9f0 2024-09-17T01:48:27.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.626+0000 7fd8d8c00640 1 -- 172.21.15.42:0/3179181040 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8003850 con 0x7fd8dc15c9f0 2024-09-17T01:48:27.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.627+0000 7fd8e2200640 1 -- 172.21.15.42:0/3179181040 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8dc0ceb30 con 0x7fd8dc15c9f0 2024-09-17T01:48:27.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.627+0000 7fd8e2200640 1 -- 172.21.15.42:0/3179181040 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8dc0c57a0 con 0x7fd8dc15c9f0 2024-09-17T01:48:27.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.628+0000 7fd8e2200640 1 -- 172.21.15.42:0/3179181040 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8dc0cf890 con 0x7fd8dc15c9f0 2024-09-17T01:48:27.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.629+0000 7fd8d8c00640 1 -- 172.21.15.42:0/3179181040 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd8c801a070 con 0x7fd8dc15c9f0 2024-09-17T01:48:27.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.630+0000 7fd8d8c00640 1 --2- 172.21.15.42:0/3179181040 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd8bc078b90 0x7fd8bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:27.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.630+0000 7fd8d8c00640 1 -- 172.21.15.42:0/3179181040 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 5854+0+0 (secure 0 0 0) 0x7fd8c809a2b0 con 0x7fd8dc15c9f0 2024-09-17T01:48:27.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.631+0000 7fd8e0e00640 1 --2- 172.21.15.42:0/3179181040 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd8bc078b90 0x7fd8bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:27.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.631+0000 7fd8e0e00640 1 --2- 172.21.15.42:0/3179181040 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd8bc078b90 0x7fd8bc07b0a0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0005fd0 tx=0x7fd8d0005c50 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:27.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.635+0000 7fd8d8c00640 1 -- 172.21.15.42:0/3179181040 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd8dc0cfdd0 con 0x7fd8dc15c9f0 2024-09-17T01:48:27.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.869+0000 7fd8e2200640 1 -- 172.21.15.42:0/3179181040 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd8dc0b1fc0 con 0x7fd8dc15c9f0 2024-09-17T01:48:27.867 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-17T01:48:27.870+0000 7f9961e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:48:27.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.872+0000 7fd8d8c00640 1 -- 172.21.15.42:0/3179181040 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v160) ==== 161+0+0 (secure 0 0 0) 0x7fd8c80625c0 con 0x7fd8dc15c9f0 2024-09-17T01:48:27.870 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T01:48:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.875+0000 7fd8e2200640 1 -- 172.21.15.42:0/3179181040 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd8bc078b90 msgr2=0x7fd8bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.875+0000 7fd8e2200640 1 --2- 172.21.15.42:0/3179181040 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd8bc078b90 0x7fd8bc07b0a0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0005fd0 tx=0x7fd8d0005c50 comp rx=0 tx=0).stop 2024-09-17T01:48:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.875+0000 7fd8e2200640 1 -- 172.21.15.42:0/3179181040 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8dc15c9f0 msgr2=0x7fd8dc0c7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:27.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.875+0000 7fd8e2200640 1 --2- 172.21.15.42:0/3179181040 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8dc15c9f0 0x7fd8dc0c7b10 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 crypto rx=0x7fd8c800c430 tx=0x7fd8c800c8f0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.876+0000 7fd8e2200640 1 -- 172.21.15.42:0/3179181040 shutdown_connections 2024-09-17T01:48:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.876+0000 7fd8e2200640 1 --2- 172.21.15.42:0/3179181040 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd8bc078b90 0x7fd8bc07b0a0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.876+0000 7fd8e2200640 1 --2- 172.21.15.42:0/3179181040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8dc15fe40 0x7fd8dc0c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.876+0000 7fd8e2200640 1 --2- 172.21.15.42:0/3179181040 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd8dc15c9f0 0x7fd8dc0c7b10 unknown :-1 s=CLOSED pgs=2359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.876+0000 7fd8e2200640 1 --2- 172.21.15.42:0/3179181040 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd8dc0cf480 0x7fd8dc148b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:27.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.876+0000 7fd8e2200640 1 -- 172.21.15.42:0/3179181040 >> 172.21.15.42:0/3179181040 conn(0x7fd8dc06d3f0 msgr2=0x7fd8dc0ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:27.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.876+0000 7fd8e2200640 1 -- 172.21.15.42:0/3179181040 shutdown_connections 2024-09-17T01:48:27.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:27.876+0000 7fd8e2200640 1 -- 172.21.15.42:0/3179181040 wait complete. 2024-09-17T01:48:27.884 INFO:tasks.ceph.mds.c.smithi042.stderr: -7583> 2024-09-17T01:47:41.978+0000 7f989fa00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:48:27.889 INFO:tasks.ceph.mds.c.smithi042.stderr: -4017> 2024-09-17T01:47:51.339+0000 7f989aa00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 pv8 ap=4 DIRTYPARENT s=5242880 n(v0 rc2024-09-17T01:47:49.637933+0000 b5242880 1=1+0)->n(v0 rc2024-09-17T01:47:49.642933+0000 b6291456 1=1+0) (iauth excl) (ifile lock->excl w=1) (ixattr excl) (iquiesce lock w=1) cr={10159=0-12582912@1} caps={10159=pAsxLsXsxFcb/pAsxXsxFxwb@5},l=10159 | ptrwaiter=1 request=1 lock=3 caps=1 dirtyparent=1 dirty=0 waiter=1 authpin=1 scrubqueue=0 0x56405f11a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(29)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-17T01:48:27.902 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T01:48:28.008 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:48:28.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.136+0000 7fc653e00640 1 -- 172.21.15.42:0/3172339401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6541605c0 msgr2=0x7fc6541609d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:28.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.136+0000 7fc653e00640 1 --2- 172.21.15.42:0/3172339401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6541605c0 0x7fc6541609d0 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7fc65406dd60 tx=0x7fc64c02aa10 comp rx=0 tx=0).stop 2024-09-17T01:48:28.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.136+0000 7fc653e00640 1 -- 172.21.15.42:0/3172339401 shutdown_connections 2024-09-17T01:48:28.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.136+0000 7fc653e00640 1 --2- 172.21.15.42:0/3172339401 >> v2:172.21.15.43:3300/0 conn(0x7fc6540b51d0 0x7fc6540b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:28.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.136+0000 7fc653e00640 1 --2- 172.21.15.42:0/3172339401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6541605c0 0x7fc6541609d0 unknown :-1 s=CLOSED pgs=2362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:28.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.136+0000 7fc653e00640 1 --2- 172.21.15.42:0/3172339401 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6540afb00 0x7fc654073d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:28.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.136+0000 7fc653e00640 1 -- 172.21.15.42:0/3172339401 >> 172.21.15.42:0/3172339401 conn(0x7fc65406d3f0 msgr2=0x7fc6540b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:28.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.136+0000 7fc653e00640 1 -- 172.21.15.42:0/3172339401 shutdown_connections 2024-09-17T01:48:28.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.136+0000 7fc653e00640 1 -- 172.21.15.42:0/3172339401 wait complete. 2024-09-17T01:48:28.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.139+0000 7fc653e00640 1 Processor -- start 2024-09-17T01:48:28.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.139+0000 7fc653e00640 1 -- start start 2024-09-17T01:48:28.140 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.140+0000 7fc653e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6540afb00 0x7fc65415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:28.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.140+0000 7fc653e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6540b51d0 0x7fc6541f7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:28.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.140+0000 7fc653e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6541605c0 0x7fc6541438b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:28.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.140+0000 7fc653e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc65415cf70 con 0x7fc6540b51d0 2024-09-17T01:48:28.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.140+0000 7fc653e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc654161440 con 0x7fc6540afb00 2024-09-17T01:48:28.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.140+0000 7fc653e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc65415d0f0 con 0x7fc6541605c0 2024-09-17T01:48:28.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.140+0000 7fc64be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6540b51d0 0x7fc6541f7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:28.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.141+0000 7fc64be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6540b51d0 0x7fc6541f7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44268/0 (socket says 172.21.15.42:44268) 2024-09-17T01:48:28.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.141+0000 7fc64be00640 1 -- 172.21.15.42:0/1869435799 learned_addr learned my addr 172.21.15.42:0/1869435799 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:28.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.141+0000 7fc653400640 1 --2- 172.21.15.42:0/1869435799 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6541605c0 0x7fc6541438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:28.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.141+0000 7fc652a00640 1 --2- 172.21.15.42:0/1869435799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6540afb00 0x7fc65415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:28.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.141+0000 7fc64be00640 1 -- 172.21.15.42:0/1869435799 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6541605c0 msgr2=0x7fc6541438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:28.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.141+0000 7fc64be00640 1 --2- 172.21.15.42:0/1869435799 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6541605c0 0x7fc6541438b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:28.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.141+0000 7fc64be00640 1 -- 172.21.15.42:0/1869435799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6540afb00 msgr2=0x7fc65415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:28.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.141+0000 7fc64be00640 1 --2- 172.21.15.42:0/1869435799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6540afb00 0x7fc65415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:28.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.141+0000 7fc64be00640 1 -- 172.21.15.42:0/1869435799 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6541f7820 con 0x7fc6540b51d0 2024-09-17T01:48:28.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.141+0000 7fc64be00640 1 --2- 172.21.15.42:0/1869435799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6540b51d0 0x7fc6541f7080 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00e790 tx=0x7fc63c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:28.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.142+0000 7fc64aa00640 1 -- 172.21.15.42:0/1869435799 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63c00eea0 con 0x7fc6540b51d0 2024-09-17T01:48:28.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.142+0000 7fc64aa00640 1 -- 172.21.15.42:0/1869435799 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc63c00cdb0 con 0x7fc6540b51d0 2024-09-17T01:48:28.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.142+0000 7fc653e00640 1 -- 172.21.15.42:0/1869435799 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6541f7b00 con 0x7fc6540b51d0 2024-09-17T01:48:28.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.142+0000 7fc64aa00640 1 -- 172.21.15.42:0/1869435799 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63c010690 con 0x7fc6540b51d0 2024-09-17T01:48:28.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.142+0000 7fc653e00640 1 -- 172.21.15.42:0/1869435799 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6540aa690 con 0x7fc6540b51d0 2024-09-17T01:48:28.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.143+0000 7fc653e00640 1 -- 172.21.15.42:0/1869435799 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6540aa480 con 0x7fc6540b51d0 2024-09-17T01:48:28.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.144+0000 7fc64aa00640 1 -- 172.21.15.42:0/1869435799 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc63c010830 con 0x7fc6540b51d0 2024-09-17T01:48:28.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.145+0000 7fc64aa00640 1 --2- 172.21.15.42:0/1869435799 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc630078b90 0x7fc63007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:28.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.145+0000 7fc64aa00640 1 -- 172.21.15.42:0/1869435799 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(203..203 src has 1..203) ==== 5940+0+0 (secure 0 0 0) 0x7fc63c09b890 con 0x7fc6540b51d0 2024-09-17T01:48:28.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.145+0000 7fc652a00640 1 --2- 172.21.15.42:0/1869435799 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc630078b90 0x7fc63007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:28.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.146+0000 7fc652a00640 1 --2- 172.21.15.42:0/1869435799 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc630078b90 0x7fc63007b0a0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fc644009a40 tx=0x7fc644005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:28.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.149+0000 7fc64aa00640 1 -- 172.21.15.42:0/1869435799 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc63c063bd0 con 0x7fc6540b51d0 2024-09-17T01:48:28.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.381+0000 7fc653e00640 1 -- 172.21.15.42:0/1869435799 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc6540b55e0 con 0x7fc6540b51d0 2024-09-17T01:48:28.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.874+0000 7fc64aa00640 1 -- 172.21.15.42:0/1869435799 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v161) ==== 104+0+0 (secure 0 0 0) 0x7fc63c0634d0 con 0x7fc6540b51d0 2024-09-17T01:48:28.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.876+0000 7fc653e00640 1 -- 172.21.15.42:0/1869435799 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc630078b90 msgr2=0x7fc63007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:28.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.876+0000 7fc653e00640 1 --2- 172.21.15.42:0/1869435799 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc630078b90 0x7fc63007b0a0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fc644009a40 tx=0x7fc644005f90 comp rx=0 tx=0).stop 2024-09-17T01:48:28.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.877+0000 7fc653e00640 1 -- 172.21.15.42:0/1869435799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6540b51d0 msgr2=0x7fc6541f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:28.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.877+0000 7fc653e00640 1 --2- 172.21.15.42:0/1869435799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6540b51d0 0x7fc6541f7080 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00e790 tx=0x7fc63c00ec50 comp rx=0 tx=0).stop 2024-09-17T01:48:28.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.877+0000 7fc653e00640 1 -- 172.21.15.42:0/1869435799 shutdown_connections 2024-09-17T01:48:28.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.877+0000 7fc653e00640 1 --2- 172.21.15.42:0/1869435799 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc630078b90 0x7fc63007b0a0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:28.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.877+0000 7fc653e00640 1 --2- 172.21.15.42:0/1869435799 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc6541605c0 0x7fc6541438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:28.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.877+0000 7fc653e00640 1 --2- 172.21.15.42:0/1869435799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6540b51d0 0x7fc6541f7080 unknown :-1 s=CLOSED pgs=2363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:28.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.877+0000 7fc653e00640 1 --2- 172.21.15.42:0/1869435799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6540afb00 0x7fc65415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:28.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.877+0000 7fc653e00640 1 -- 172.21.15.42:0/1869435799 >> 172.21.15.42:0/1869435799 conn(0x7fc65406d3f0 msgr2=0x7fc65415b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:28.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.877+0000 7fc653e00640 1 -- 172.21.15.42:0/1869435799 shutdown_connections 2024-09-17T01:48:28.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:28.877+0000 7fc653e00640 1 -- 172.21.15.42:0/1869435799 wait complete. 2024-09-17T01:48:28.900 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T01:48:29.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.137+0000 7f9c24a00640 1 -- 172.21.15.42:0/2957415704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c200703d0 msgr2=0x7f9c201592f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:29.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.137+0000 7f9c24a00640 1 --2- 172.21.15.42:0/2957415704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c200703d0 0x7f9c201592f0 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 crypto rx=0x7f9c2015c380 tx=0x7f9c1802a8d0 comp rx=0 tx=0).stop 2024-09-17T01:48:29.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.137+0000 7f9c24a00640 1 -- 172.21.15.42:0/2957415704 shutdown_connections 2024-09-17T01:48:29.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.137+0000 7f9c24a00640 1 --2- 172.21.15.42:0/2957415704 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c200703d0 0x7f9c201592f0 unknown :-1 s=CLOSED pgs=2365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:29.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.137+0000 7f9c24a00640 1 -- 172.21.15.42:0/2957415704 >> 172.21.15.42:0/2957415704 conn(0x7f9c2006cfa0 msgr2=0x7f9c2006d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:29.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.137+0000 7f9c24a00640 1 -- 172.21.15.42:0/2957415704 shutdown_connections 2024-09-17T01:48:29.136 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.137+0000 7f9c24a00640 1 -- 172.21.15.42:0/2957415704 wait complete. 2024-09-17T01:48:29.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.140+0000 7f9c24a00640 1 Processor -- start 2024-09-17T01:48:29.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.140+0000 7f9c24a00640 1 -- start start 2024-09-17T01:48:29.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.141+0000 7f9c24a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c200b61f0 0x7f9c200ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:29.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.141+0000 7f9c24a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c2015fd10 0x7f9c200aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:29.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.141+0000 7f9c24a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c20156540 0x7f9c201f8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:29.141 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.141+0000 7f9c24a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9c200ceca0 con 0x7f9c2015fd10 2024-09-17T01:48:29.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.141+0000 7f9c24a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9c200ceb20 con 0x7f9c20156540 2024-09-17T01:48:29.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.141+0000 7f9c24a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9c200cee20 con 0x7f9c200b61f0 2024-09-17T01:48:29.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.141+0000 7f9c17e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c2015fd10 0x7f9c200aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:29.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.142+0000 7f9c17e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c2015fd10 0x7f9c200aedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44290/0 (socket says 172.21.15.42:44290) 2024-09-17T01:48:29.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.142+0000 7f9c17e00640 1 -- 172.21.15.42:0/1280617016 learned_addr learned my addr 172.21.15.42:0/1280617016 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:29.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.142+0000 7f9c1fe00640 1 --2- 172.21.15.42:0/1280617016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c20156540 0x7f9c201f8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:29.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.142+0000 7f9c1f400640 1 --2- 172.21.15.42:0/1280617016 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c200b61f0 0x7f9c200ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:29.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.142+0000 7f9c17e00640 1 -- 172.21.15.42:0/1280617016 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c200b61f0 msgr2=0x7f9c200ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:29.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.142+0000 7f9c17e00640 1 --2- 172.21.15.42:0/1280617016 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c200b61f0 0x7f9c200ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:29.142 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.142+0000 7f9c17e00640 1 -- 172.21.15.42:0/1280617016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c20156540 msgr2=0x7f9c201f8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:29.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.142+0000 7f9c17e00640 1 --2- 172.21.15.42:0/1280617016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c20156540 0x7f9c201f8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:29.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.142+0000 7f9c17e00640 1 -- 172.21.15.42:0/1280617016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c201f5660 con 0x7f9c2015fd10 2024-09-17T01:48:29.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.142+0000 7f9c1f400640 1 --2- 172.21.15.42:0/1280617016 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c200b61f0 0x7f9c200ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:29.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.142+0000 7f9c17e00640 1 --2- 172.21.15.42:0/1280617016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c2015fd10 0x7f9c200aedd0 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7f9c0800b420 tx=0x7f9c0800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:29.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.143+0000 7f9c17400640 1 -- 172.21.15.42:0/1280617016 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c08011830 con 0x7f9c2015fd10 2024-09-17T01:48:29.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.143+0000 7f9c17400640 1 -- 172.21.15.42:0/1280617016 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c08016070 con 0x7f9c2015fd10 2024-09-17T01:48:29.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.143+0000 7f9c17400640 1 -- 172.21.15.42:0/1280617016 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c08011d60 con 0x7f9c2015fd10 2024-09-17T01:48:29.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.143+0000 7f9c24a00640 1 -- 172.21.15.42:0/1280617016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c201f5940 con 0x7f9c2015fd10 2024-09-17T01:48:29.143 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.143+0000 7f9c24a00640 1 -- 172.21.15.42:0/1280617016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c201f5f00 con 0x7f9c2015fd10 2024-09-17T01:48:29.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.144+0000 7f9c24a00640 1 -- 172.21.15.42:0/1280617016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c201592f0 con 0x7f9c2015fd10 2024-09-17T01:48:29.144 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.145+0000 7f9c17400640 1 -- 172.21.15.42:0/1280617016 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9c0801b460 con 0x7f9c2015fd10 2024-09-17T01:48:29.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.146+0000 7f9c17400640 1 --2- 172.21.15.42:0/1280617016 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9bfc078b90 0x7f9bfc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:29.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.146+0000 7f9c17400640 1 -- 172.21.15.42:0/1280617016 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(203..203 src has 1..203) ==== 5940+0+0 (secure 0 0 0) 0x7f9c0809a900 con 0x7f9c2015fd10 2024-09-17T01:48:29.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.147+0000 7f9c1f400640 1 --2- 172.21.15.42:0/1280617016 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9bfc078b90 0x7f9bfc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:29.145 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.147+0000 7f9c1f400640 1 --2- 172.21.15.42:0/1280617016 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9bfc078b90 0x7f9bfc07b0a0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f9c10000f60 tx=0x7f9c10009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:29.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.150+0000 7f9c17400640 1 -- 172.21.15.42:0/1280617016 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9c08020020 con 0x7f9c2015fd10 2024-09-17T01:48:29.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.342+0000 7f9c24a00640 1 -- 172.21.15.42:0/1280617016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9c20073390 con 0x7f9c2015fd10 2024-09-17T01:48:29.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.880+0000 7f9c17400640 1 -- 172.21.15.42:0/1280617016 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v204) ==== 181+0+0 (secure 0 0 0) 0x7f9c08069070 con 0x7f9c2015fd10 2024-09-17T01:48:29.878 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-09-17T01:48:29.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.884+0000 7f9c24a00640 1 -- 172.21.15.42:0/1280617016 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9bfc078b90 msgr2=0x7f9bfc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:29.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.884+0000 7f9c24a00640 1 --2- 172.21.15.42:0/1280617016 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9bfc078b90 0x7f9bfc07b0a0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f9c10000f60 tx=0x7f9c10009040 comp rx=0 tx=0).stop 2024-09-17T01:48:29.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.884+0000 7f9c24a00640 1 -- 172.21.15.42:0/1280617016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c2015fd10 msgr2=0x7f9c200aedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:29.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.884+0000 7f9c24a00640 1 --2- 172.21.15.42:0/1280617016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c2015fd10 0x7f9c200aedd0 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7f9c0800b420 tx=0x7f9c0800b8e0 comp rx=0 tx=0).stop 2024-09-17T01:48:29.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.885+0000 7f9c24a00640 1 -- 172.21.15.42:0/1280617016 shutdown_connections 2024-09-17T01:48:29.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.885+0000 7f9c24a00640 1 --2- 172.21.15.42:0/1280617016 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9bfc078b90 0x7f9bfc07b0a0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:29.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.885+0000 7f9c24a00640 1 --2- 172.21.15.42:0/1280617016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c20156540 0x7f9c201f8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:29.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.885+0000 7f9c24a00640 1 --2- 172.21.15.42:0/1280617016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9c2015fd10 0x7f9c200aedd0 unknown :-1 s=CLOSED pgs=2366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:29.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.885+0000 7f9c24a00640 1 --2- 172.21.15.42:0/1280617016 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9c200b61f0 0x7f9c200ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:29.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.885+0000 7f9c24a00640 1 -- 172.21.15.42:0/1280617016 >> 172.21.15.42:0/1280617016 conn(0x7f9c2006cfa0 msgr2=0x7f9c20158060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:29.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.885+0000 7f9c24a00640 1 -- 172.21.15.42:0/1280617016 shutdown_connections 2024-09-17T01:48:29.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:29.885+0000 7f9c24a00640 1 -- 172.21.15.42:0/1280617016 wait complete. 2024-09-17T01:48:29.911 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T01:48:30.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.148+0000 7f9a73e00640 1 -- 172.21.15.42:0/101720065 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a740d04a0 msgr2=0x7f9a740703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:30.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.148+0000 7f9a73e00640 1 --2- 172.21.15.42:0/101720065 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a740d04a0 0x7f9a740703c0 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c005fd0 tx=0x7f9a6c02a8b0 comp rx=0 tx=0).stop 2024-09-17T01:48:30.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.148+0000 7f9a73e00640 1 -- 172.21.15.42:0/101720065 shutdown_connections 2024-09-17T01:48:30.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.148+0000 7f9a73e00640 1 --2- 172.21.15.42:0/101720065 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a740d04a0 0x7f9a740703c0 unknown :-1 s=CLOSED pgs=2368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:30.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.148+0000 7f9a73e00640 1 --2- 172.21.15.42:0/101720065 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9a740d0090 0x7f9a7406fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:30.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.148+0000 7f9a73e00640 1 -- 172.21.15.42:0/101720065 >> 172.21.15.42:0/101720065 conn(0x7f9a740b2ca0 msgr2=0x7f9a740b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:30.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.148+0000 7f9a73e00640 1 -- 172.21.15.42:0/101720065 shutdown_connections 2024-09-17T01:48:30.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.148+0000 7f9a73e00640 1 -- 172.21.15.42:0/101720065 wait complete. 2024-09-17T01:48:30.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.150+0000 7f9a73e00640 1 Processor -- start 2024-09-17T01:48:30.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.151+0000 7f9a73e00640 1 -- start start 2024-09-17T01:48:30.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.152+0000 7f9a73e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9a740b6ae0 0x7f9a741f8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:30.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.152+0000 7f9a73e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a740d0090 0x7f9a7415c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:30.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.152+0000 7f9a73e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a740d04a0 0x7f9a740ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:30.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.152+0000 7f9a73e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9a74074300 con 0x7f9a740d0090 2024-09-17T01:48:30.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.152+0000 7f9a73e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9a74074180 con 0x7f9a740d04a0 2024-09-17T01:48:30.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.152+0000 7f9a73e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9a74074480 con 0x7f9a740b6ae0 2024-09-17T01:48:30.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.152+0000 7f9a6be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a740d0090 0x7f9a7415c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:30.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.152+0000 7f9a6be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a740d0090 0x7f9a7415c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44300/0 (socket says 172.21.15.42:44300) 2024-09-17T01:48:30.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.152+0000 7f9a6be00640 1 -- 172.21.15.42:0/3575894293 learned_addr learned my addr 172.21.15.42:0/3575894293 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:30.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.153+0000 7f9a6be00640 1 -- 172.21.15.42:0/3575894293 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9a740b6ae0 msgr2=0x7f9a741f8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:30.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.153+0000 7f9a72a00640 1 --2- 172.21.15.42:0/3575894293 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9a740b6ae0 0x7f9a741f8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:30.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.153+0000 7f9a73400640 1 --2- 172.21.15.42:0/3575894293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a740d04a0 0x7f9a740ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:30.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.153+0000 7f9a6be00640 1 --2- 172.21.15.42:0/3575894293 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9a740b6ae0 0x7f9a741f8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:30.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.153+0000 7f9a6be00640 1 -- 172.21.15.42:0/3575894293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a740d04a0 msgr2=0x7f9a740ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:30.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.153+0000 7f9a6be00640 1 --2- 172.21.15.42:0/3575894293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a740d04a0 0x7f9a740ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:30.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.153+0000 7f9a6be00640 1 -- 172.21.15.42:0/3575894293 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a741f96e0 con 0x7f9a740d0090 2024-09-17T01:48:30.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.153+0000 7f9a72a00640 1 --2- 172.21.15.42:0/3575894293 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9a740b6ae0 0x7f9a741f8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:48:30.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.153+0000 7f9a6be00640 1 --2- 172.21.15.42:0/3575894293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a740d0090 0x7f9a7415c700 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00d6a0 tx=0x7f9a5c00db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:30.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.153+0000 7f9a6aa00640 1 -- 172.21.15.42:0/3575894293 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c017070 con 0x7f9a740d0090 2024-09-17T01:48:30.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.153+0000 7f9a6aa00640 1 -- 172.21.15.42:0/3575894293 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a5c009b10 con 0x7f9a740d0090 2024-09-17T01:48:30.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.153+0000 7f9a73e00640 1 -- 172.21.15.42:0/3575894293 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a741f99c0 con 0x7f9a740d0090 2024-09-17T01:48:30.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.153+0000 7f9a6aa00640 1 -- 172.21.15.42:0/3575894293 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c010460 con 0x7f9a740d0090 2024-09-17T01:48:30.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.154+0000 7f9a73e00640 1 -- 172.21.15.42:0/3575894293 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a741f9ca0 con 0x7f9a740d0090 2024-09-17T01:48:30.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.155+0000 7f9a73e00640 1 -- 172.21.15.42:0/3575894293 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a740749a0 con 0x7f9a740d0090 2024-09-17T01:48:30.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.156+0000 7f9a6aa00640 1 -- 172.21.15.42:0/3575894293 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9a5c01a070 con 0x7f9a740d0090 2024-09-17T01:48:30.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.157+0000 7f9a6aa00640 1 --2- 172.21.15.42:0/3575894293 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9a50078bc0 0x7f9a5007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:30.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.157+0000 7f9a6aa00640 1 -- 172.21.15.42:0/3575894293 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 5502+0+0 (secure 0 0 0) 0x7f9a5c09aef0 con 0x7f9a740d0090 2024-09-17T01:48:30.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.157+0000 7f9a72a00640 1 --2- 172.21.15.42:0/3575894293 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9a50078bc0 0x7f9a5007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:30.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.158+0000 7f9a72a00640 1 --2- 172.21.15.42:0/3575894293 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9a50078bc0 0x7f9a5007b0d0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f9a64001220 tx=0x7f9a64009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:30.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.161+0000 7f9a6aa00640 1 -- 172.21.15.42:0/3575894293 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9a5c063360 con 0x7f9a740d0090 2024-09-17T01:48:30.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.353+0000 7f9a73e00640 1 -- 172.21.15.42:0/3575894293 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9a741f9470 con 0x7f9a740d0090 2024-09-17T01:48:30.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.887+0000 7f9a6aa00640 1 -- 172.21.15.42:0/3575894293 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v205) ==== 169+0+0 (secure 0 0 0) 0x7f9a5c062c60 con 0x7f9a740d0090 2024-09-17T01:48:30.885 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-09-17T01:48:30.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.891+0000 7f9a73e00640 1 -- 172.21.15.42:0/3575894293 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9a50078bc0 msgr2=0x7f9a5007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:30.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.891+0000 7f9a73e00640 1 --2- 172.21.15.42:0/3575894293 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9a50078bc0 0x7f9a5007b0d0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f9a64001220 tx=0x7f9a64009040 comp rx=0 tx=0).stop 2024-09-17T01:48:30.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.891+0000 7f9a73e00640 1 -- 172.21.15.42:0/3575894293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a740d0090 msgr2=0x7f9a7415c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:30.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.891+0000 7f9a73e00640 1 --2- 172.21.15.42:0/3575894293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a740d0090 0x7f9a7415c700 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00d6a0 tx=0x7f9a5c00db60 comp rx=0 tx=0).stop 2024-09-17T01:48:30.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.891+0000 7f9a73e00640 1 -- 172.21.15.42:0/3575894293 shutdown_connections 2024-09-17T01:48:30.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.891+0000 7f9a73e00640 1 --2- 172.21.15.42:0/3575894293 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9a50078bc0 0x7f9a5007b0d0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:30.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.891+0000 7f9a73e00640 1 --2- 172.21.15.42:0/3575894293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a740d04a0 0x7f9a740ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:30.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.892+0000 7f9a73e00640 1 --2- 172.21.15.42:0/3575894293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a740d0090 0x7f9a7415c700 unknown :-1 s=CLOSED pgs=2369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:30.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.892+0000 7f9a73e00640 1 --2- 172.21.15.42:0/3575894293 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9a740b6ae0 0x7f9a741f8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:30.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.892+0000 7f9a73e00640 1 -- 172.21.15.42:0/3575894293 >> 172.21.15.42:0/3575894293 conn(0x7f9a740b2ca0 msgr2=0x7f9a74159cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:30.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.892+0000 7f9a73e00640 1 -- 172.21.15.42:0/3575894293 shutdown_connections 2024-09-17T01:48:30.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:30.892+0000 7f9a73e00640 1 -- 172.21.15.42:0/3575894293 wait complete. 2024-09-17T01:48:30.919 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T01:48:31.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.149+0000 7f8ef2e00640 1 -- 172.21.15.42:0/2030909577 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ed0004d40 msgr2=0x7f8ed0005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:31.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.149+0000 7f8ef2e00640 1 --2- 172.21.15.42:0/2030909577 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ed0004d40 0x7f8ed0005150 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4002230 tx=0x7f8ed0005830 comp rx=0 tx=0).stop 2024-09-17T01:48:31.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.149+0000 7f8ef0e00640 1 -- 172.21.15.42:0/2030909577 reap_dead start 2024-09-17T01:48:31.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.149+0000 7f8ef2e00640 1 -- 172.21.15.42:0/2030909577 shutdown_connections 2024-09-17T01:48:31.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.149+0000 7f8ef2e00640 1 -- 172.21.15.42:0/2030909577 >> 172.21.15.42:0/2030909577 conn(0x7f8eec06d1b0 msgr2=0x7f8eec06d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:31.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.149+0000 7f8ef2e00640 1 -- 172.21.15.42:0/2030909577 shutdown_connections 2024-09-17T01:48:31.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.149+0000 7f8ef2e00640 1 -- 172.21.15.42:0/2030909577 wait complete. 2024-09-17T01:48:31.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.151+0000 7f8ef2e00640 1 Processor -- start 2024-09-17T01:48:31.149 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.152+0000 7f8ef2e00640 1 -- start start 2024-09-17T01:48:31.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.153+0000 7f8ef2e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8ed0004d40 0x7f8eec154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:31.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.153+0000 7f8ef2e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eec156310 0x7f8eec0ce760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:31.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.153+0000 7f8ef2e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eec0ceca0 0x7f8eec157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:31.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.153+0000 7f8ef2e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8eec0cdeb0 con 0x7f8eec156310 2024-09-17T01:48:31.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.153+0000 7f8ef2e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8eec0cdd30 con 0x7f8eec0ceca0 2024-09-17T01:48:31.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.153+0000 7f8ef2e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8eec073220 con 0x7f8ed0004d40 2024-09-17T01:48:31.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.153+0000 7f8ee3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eec156310 0x7f8eec0ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:31.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.153+0000 7f8ee3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eec156310 0x7f8eec0ce760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44322/0 (socket says 172.21.15.42:44322) 2024-09-17T01:48:31.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.153+0000 7f8ee3e00640 1 -- 172.21.15.42:0/1598654929 learned_addr learned my addr 172.21.15.42:0/1598654929 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:31.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.154+0000 7f8eebe00640 1 --2- 172.21.15.42:0/1598654929 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8ed0004d40 0x7f8eec154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:31.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.154+0000 7f8ef0e00640 1 --2- 172.21.15.42:0/1598654929 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eec0ceca0 0x7f8eec157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:31.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.154+0000 7f8ee3e00640 1 -- 172.21.15.42:0/1598654929 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8ed0004d40 msgr2=0x7f8eec154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:31.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.154+0000 7f8ee3e00640 1 --2- 172.21.15.42:0/1598654929 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8ed0004d40 0x7f8eec154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:31.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.154+0000 7f8ee3e00640 1 -- 172.21.15.42:0/1598654929 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eec0ceca0 msgr2=0x7f8eec157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:31.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.154+0000 7f8ee3e00640 1 --2- 172.21.15.42:0/1598654929 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eec0ceca0 0x7f8eec157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:31.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.154+0000 7f8ee3e00640 1 -- 172.21.15.42:0/1598654929 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eec1f9070 con 0x7f8eec156310 2024-09-17T01:48:31.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.154+0000 7f8ee3e00640 1 --2- 172.21.15.42:0/1598654929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eec156310 0x7f8eec0ce760 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4011ae0 tx=0x7f8ed4009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:31.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.154+0000 7f8ee8c00640 1 -- 172.21.15.42:0/1598654929 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed401e070 con 0x7f8eec156310 2024-09-17T01:48:31.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.154+0000 7f8ee8c00640 1 -- 172.21.15.42:0/1598654929 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ed400fe70 con 0x7f8eec156310 2024-09-17T01:48:31.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.154+0000 7f8ee8c00640 1 -- 172.21.15.42:0/1598654929 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4004290 con 0x7f8eec156310 2024-09-17T01:48:31.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.154+0000 7f8ef2e00640 1 -- 172.21.15.42:0/1598654929 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eec1f9350 con 0x7f8eec156310 2024-09-17T01:48:31.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.155+0000 7f8ef2e00640 1 -- 172.21.15.42:0/1598654929 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eec1f9910 con 0x7f8eec156310 2024-09-17T01:48:31.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.155+0000 7f8ef2e00640 1 -- 172.21.15.42:0/1598654929 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eec1f8de0 con 0x7f8eec156310 2024-09-17T01:48:31.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.157+0000 7f8ee8c00640 1 -- 172.21.15.42:0/1598654929 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8ed4021070 con 0x7f8eec156310 2024-09-17T01:48:31.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.158+0000 7f8ee8c00640 1 --2- 172.21.15.42:0/1598654929 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ec8078b90 0x7f8ec807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:31.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.158+0000 7f8ee8c00640 1 -- 172.21.15.42:0/1598654929 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 4943+0+0 (secure 0 0 0) 0x7f8ed409b590 con 0x7f8eec156310 2024-09-17T01:48:31.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.158+0000 7f8eebe00640 1 --2- 172.21.15.42:0/1598654929 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ec8078b90 0x7f8ec807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:31.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.159+0000 7f8eebe00640 1 --2- 172.21.15.42:0/1598654929 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ec8078b90 0x7f8ec807b0a0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f8edc009c10 tx=0x7f8edc005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:31.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.162+0000 7f8ee8c00640 1 -- 172.21.15.42:0/1598654929 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8ed40636a0 con 0x7f8eec156310 2024-09-17T01:48:31.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.358+0000 7f8ef2e00640 1 -- 172.21.15.42:0/1598654929 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f8eec06fd50 con 0x7f8eec156310 2024-09-17T01:48:31.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.363+0000 7f8ee8c00640 1 -- 172.21.15.42:0/1598654929 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v65) ==== 71+0+0 (secure 0 0 0) 0x7f8ed40680d0 con 0x7f8eec156310 2024-09-17T01:48:31.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.366+0000 7f8ef2e00640 1 -- 172.21.15.42:0/1598654929 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ec8078b90 msgr2=0x7f8ec807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:31.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.366+0000 7f8ef2e00640 1 --2- 172.21.15.42:0/1598654929 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ec8078b90 0x7f8ec807b0a0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f8edc009c10 tx=0x7f8edc005f90 comp rx=0 tx=0).stop 2024-09-17T01:48:31.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.366+0000 7f8ef2e00640 1 -- 172.21.15.42:0/1598654929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eec156310 msgr2=0x7f8eec0ce760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:31.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.366+0000 7f8ef2e00640 1 --2- 172.21.15.42:0/1598654929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eec156310 0x7f8eec0ce760 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4011ae0 tx=0x7f8ed4009e90 comp rx=0 tx=0).stop 2024-09-17T01:48:31.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.366+0000 7f8ef2e00640 1 -- 172.21.15.42:0/1598654929 shutdown_connections 2024-09-17T01:48:31.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.366+0000 7f8ef2e00640 1 --2- 172.21.15.42:0/1598654929 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ec8078b90 0x7f8ec807b0a0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:31.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.366+0000 7f8ef2e00640 1 --2- 172.21.15.42:0/1598654929 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8eec0ceca0 0x7f8eec157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:31.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.366+0000 7f8ef2e00640 1 --2- 172.21.15.42:0/1598654929 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8eec156310 0x7f8eec0ce760 unknown :-1 s=CLOSED pgs=2372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:31.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.366+0000 7f8ef2e00640 1 --2- 172.21.15.42:0/1598654929 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8ed0004d40 0x7f8eec154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:31.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.366+0000 7f8ef2e00640 1 -- 172.21.15.42:0/1598654929 >> 172.21.15.42:0/1598654929 conn(0x7f8eec06d1b0 msgr2=0x7f8eec075f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:31.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.366+0000 7f8ef2e00640 1 -- 172.21.15.42:0/1598654929 shutdown_connections 2024-09-17T01:48:31.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.366+0000 7f8ef2e00640 1 -- 172.21.15.42:0/1598654929 wait complete. 2024-09-17T01:48:31.386 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2024-09-17T01:48:31.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.615+0000 7f506ca00640 1 -- 172.21.15.42:0/2125613406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50680cddd0 msgr2=0x7f5068160c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:31.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.615+0000 7f506ca00640 1 --2- 172.21.15.42:0/2125613406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50680cddd0 0x7f5068160c40 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7f5050005fd0 tx=0x7f505002a540 comp rx=0 tx=0).stop 2024-09-17T01:48:31.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.615+0000 7f506ca00640 1 -- 172.21.15.42:0/2125613406 shutdown_connections 2024-09-17T01:48:31.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.615+0000 7f506ca00640 1 --2- 172.21.15.42:0/2125613406 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5068161180 0x7f506806eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:31.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.615+0000 7f506ca00640 1 --2- 172.21.15.42:0/2125613406 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50680cddd0 0x7f5068160c40 unknown :-1 s=CLOSED pgs=2373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:31.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.615+0000 7f506ca00640 1 -- 172.21.15.42:0/2125613406 >> 172.21.15.42:0/2125613406 conn(0x7f506806d1b0 msgr2=0x7f506806d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:31.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.615+0000 7f506ca00640 1 -- 172.21.15.42:0/2125613406 shutdown_connections 2024-09-17T01:48:31.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.615+0000 7f506ca00640 1 -- 172.21.15.42:0/2125613406 wait complete. 2024-09-17T01:48:31.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.617+0000 7f506ca00640 1 Processor -- start 2024-09-17T01:48:31.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.618+0000 7f506ca00640 1 -- start start 2024-09-17T01:48:31.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.619+0000 7f506ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f506815dd50 0x7f50680ad810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:31.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.619+0000 7f506ca00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5068161180 0x7f50680b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:31.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.619+0000 7f506ca00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50680b1930 0x7f50680b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:31.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.619+0000 7f506ca00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5068072800 con 0x7f506815dd50 2024-09-17T01:48:31.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.619+0000 7f506ca00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f50681617a0 con 0x7f5068161180 2024-09-17T01:48:31.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.619+0000 7f506ca00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f506806f020 con 0x7f50680b1930 2024-09-17T01:48:31.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.619+0000 7f5065e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f506815dd50 0x7f50680ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:31.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.619+0000 7f5065e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f506815dd50 0x7f50680ad810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44328/0 (socket says 172.21.15.42:44328) 2024-09-17T01:48:31.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.619+0000 7f5065e00640 1 -- 172.21.15.42:0/1984784841 learned_addr learned my addr 172.21.15.42:0/1984784841 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:31.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.620+0000 7f505d400640 1 --2- 172.21.15.42:0/1984784841 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5068161180 0x7f50680b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:31.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.620+0000 7f5066800640 1 --2- 172.21.15.42:0/1984784841 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50680b1930 0x7f50680b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:31.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.620+0000 7f5065e00640 1 -- 172.21.15.42:0/1984784841 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50680b1930 msgr2=0x7f50680b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:31.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.620+0000 7f5065e00640 1 --2- 172.21.15.42:0/1984784841 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50680b1930 0x7f50680b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:31.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.620+0000 7f5065e00640 1 -- 172.21.15.42:0/1984784841 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5068161180 msgr2=0x7f50680b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:31.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.620+0000 7f5065e00640 1 --2- 172.21.15.42:0/1984784841 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5068161180 0x7f50680b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:31.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.620+0000 7f5065e00640 1 -- 172.21.15.42:0/1984784841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5068138a10 con 0x7f506815dd50 2024-09-17T01:48:31.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.620+0000 7f5065e00640 1 --2- 172.21.15.42:0/1984784841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f506815dd50 0x7f50680ad810 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7f505800b3f0 tx=0x7f505800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:31.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.620+0000 7f505ea00640 1 -- 172.21.15.42:0/1984784841 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5058015020 con 0x7f506815dd50 2024-09-17T01:48:31.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.620+0000 7f505ea00640 1 -- 172.21.15.42:0/1984784841 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5058011920 con 0x7f506815dd50 2024-09-17T01:48:31.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.620+0000 7f505ea00640 1 -- 172.21.15.42:0/1984784841 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5058011d70 con 0x7f506815dd50 2024-09-17T01:48:31.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.620+0000 7f506ca00640 1 -- 172.21.15.42:0/1984784841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50680b24a0 con 0x7f506815dd50 2024-09-17T01:48:31.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.621+0000 7f506ca00640 1 -- 172.21.15.42:0/1984784841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50680b2740 con 0x7f506815dd50 2024-09-17T01:48:31.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.622+0000 7f506ca00640 1 -- 172.21.15.42:0/1984784841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f506806f4b0 con 0x7f506815dd50 2024-09-17T01:48:31.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.623+0000 7f505ea00640 1 -- 172.21.15.42:0/1984784841 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5058018020 con 0x7f506815dd50 2024-09-17T01:48:31.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.624+0000 7f505ea00640 1 --2- 172.21.15.42:0/1984784841 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5044078b90 0x7f504407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:31.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.624+0000 7f505ea00640 1 -- 172.21.15.42:0/1984784841 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 4943+0+0 (secure 0 0 0) 0x7f505809a820 con 0x7f506815dd50 2024-09-17T01:48:31.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.624+0000 7f505d400640 1 --2- 172.21.15.42:0/1984784841 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5044078b90 0x7f504407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:31.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.625+0000 7f505d400640 1 --2- 172.21.15.42:0/1984784841 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5044078b90 0x7f504407b0a0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f5050033000 tx=0x7f5050004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:31.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.628+0000 7f505ea00640 1 -- 172.21.15.42:0/1984784841 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f505801f030 con 0x7f506815dd50 2024-09-17T01:48:31.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:31.895+0000 7f506ca00640 1 -- 172.21.15.42:0/1984784841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) -- 0x7f5068154110 con 0x7f506815dd50 2024-09-17T01:48:32.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:32.894+0000 7f505ea00640 1 -- 172.21.15.42:0/1984784841 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v773) ==== 133+0+0 (secure 0 0 0) 0x7f5058062ed0 con 0x7f506815dd50 2024-09-17T01:48:32.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:32.897+0000 7f506ca00640 1 -- 172.21.15.42:0/1984784841 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5044078b90 msgr2=0x7f504407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:32.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:32.897+0000 7f506ca00640 1 --2- 172.21.15.42:0/1984784841 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5044078b90 0x7f504407b0a0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f5050033000 tx=0x7f5050004730 comp rx=0 tx=0).stop 2024-09-17T01:48:32.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:32.897+0000 7f506ca00640 1 -- 172.21.15.42:0/1984784841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f506815dd50 msgr2=0x7f50680ad810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:32.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:32.897+0000 7f506ca00640 1 --2- 172.21.15.42:0/1984784841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f506815dd50 0x7f50680ad810 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7f505800b3f0 tx=0x7f505800b8b0 comp rx=0 tx=0).stop 2024-09-17T01:48:32.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:32.897+0000 7f506ca00640 1 -- 172.21.15.42:0/1984784841 shutdown_connections 2024-09-17T01:48:32.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:32.897+0000 7f506ca00640 1 --2- 172.21.15.42:0/1984784841 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5044078b90 0x7f504407b0a0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:32.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:32.897+0000 7f506ca00640 1 --2- 172.21.15.42:0/1984784841 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5068161180 0x7f50680b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:32.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:32.897+0000 7f506ca00640 1 --2- 172.21.15.42:0/1984784841 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f50680b1930 0x7f50680b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:32.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:32.897+0000 7f506ca00640 1 --2- 172.21.15.42:0/1984784841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f506815dd50 0x7f50680ad810 unknown :-1 s=CLOSED pgs=2374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:32.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:32.897+0000 7f506ca00640 1 -- 172.21.15.42:0/1984784841 >> 172.21.15.42:0/1984784841 conn(0x7f506806d1b0 msgr2=0x7f506806d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:32.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:32.898+0000 7f506ca00640 1 -- 172.21.15.42:0/1984784841 shutdown_connections 2024-09-17T01:48:32.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:32.898+0000 7f506ca00640 1 -- 172.21.15.42:0/1984784841 wait complete. 2024-09-17T01:48:32.925 INFO:tasks.cephfs_test_runner:test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-09-17T01:48:32.926 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace_for_new_files (tasks.cephfs.test_scrub.TestScrub) 2024-09-17T01:48:32.926 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:48:33.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.162+0000 7f2c91800640 1 -- 172.21.15.42:0/351469671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c700039e0 msgr2=0x7f2c70003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:33.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.162+0000 7f2c91800640 1 --2- 172.21.15.42:0/351469671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c700039e0 0x7f2c70003e10 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c009b50 tx=0x7f2c70005830 comp rx=0 tx=0).stop 2024-09-17T01:48:33.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.162+0000 7f2c90e00640 1 -- 172.21.15.42:0/351469671 reap_dead start 2024-09-17T01:48:33.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.162+0000 7f2c91800640 1 -- 172.21.15.42:0/351469671 shutdown_connections 2024-09-17T01:48:33.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.162+0000 7f2c91800640 1 -- 172.21.15.42:0/351469671 >> 172.21.15.42:0/351469671 conn(0x7f2c8c06d3f0 msgr2=0x7f2c8c0b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:33.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.162+0000 7f2c91800640 1 -- 172.21.15.42:0/351469671 shutdown_connections 2024-09-17T01:48:33.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.162+0000 7f2c91800640 1 -- 172.21.15.42:0/351469671 wait complete. 2024-09-17T01:48:33.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.164+0000 7f2c91800640 1 Processor -- start 2024-09-17T01:48:33.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.164+0000 7f2c91800640 1 -- start start 2024-09-17T01:48:33.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.166+0000 7f2c91800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c700039e0 0x7f2c8c14be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:33.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.166+0000 7f2c91800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c8c14c460 0x7f2c8c0b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:33.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.166+0000 7f2c91800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c8c0b19e0 0x7f2c8c1f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:33.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.166+0000 7f2c91800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c0b55e0 con 0x7f2c8c0b19e0 2024-09-17T01:48:33.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.166+0000 7f2c91800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c0cfd50 con 0x7f2c700039e0 2024-09-17T01:48:33.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.166+0000 7f2c91800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2c8c0b5760 con 0x7f2c8c14c460 2024-09-17T01:48:33.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.166+0000 7f2c90e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c8c0b19e0 0x7f2c8c1f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:33.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.166+0000 7f2c90e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c8c0b19e0 0x7f2c8c1f30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44358/0 (socket says 172.21.15.42:44358) 2024-09-17T01:48:33.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.166+0000 7f2c90e00640 1 -- 172.21.15.42:0/2619308823 learned_addr learned my addr 172.21.15.42:0/2619308823 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:33.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.166+0000 7f2c8be00640 1 --2- 172.21.15.42:0/2619308823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c700039e0 0x7f2c8c14be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:33.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.166+0000 7f2c83e00640 1 --2- 172.21.15.42:0/2619308823 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c8c14c460 0x7f2c8c0b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:33.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.167+0000 7f2c90e00640 1 -- 172.21.15.42:0/2619308823 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c8c14c460 msgr2=0x7f2c8c0b14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:33.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.167+0000 7f2c90e00640 1 --2- 172.21.15.42:0/2619308823 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c8c14c460 0x7f2c8c0b14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:33.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.167+0000 7f2c90e00640 1 -- 172.21.15.42:0/2619308823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c700039e0 msgr2=0x7f2c8c14be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:33.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.167+0000 7f2c90e00640 1 --2- 172.21.15.42:0/2619308823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c700039e0 0x7f2c8c14be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:33.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.167+0000 7f2c90e00640 1 -- 172.21.15.42:0/2619308823 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c8c14fef0 con 0x7f2c8c0b19e0 2024-09-17T01:48:33.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.167+0000 7f2c83e00640 1 --2- 172.21.15.42:0/2619308823 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c8c14c460 0x7f2c8c0b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:33.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.167+0000 7f2c8be00640 1 --2- 172.21.15.42:0/2619308823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c700039e0 0x7f2c8c14be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:33.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.167+0000 7f2c90e00640 1 --2- 172.21.15.42:0/2619308823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c8c0b19e0 0x7f2c8c1f30a0 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 crypto rx=0x7f2c70004780 tx=0x7f2c840064f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:33.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.167+0000 7f2c88c00640 1 -- 172.21.15.42:0/2619308823 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8400f920 con 0x7f2c8c0b19e0 2024-09-17T01:48:33.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.167+0000 7f2c88c00640 1 -- 172.21.15.42:0/2619308823 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c84017070 con 0x7f2c8c0b19e0 2024-09-17T01:48:33.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.167+0000 7f2c91800640 1 -- 172.21.15.42:0/2619308823 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c8c1f6d90 con 0x7f2c8c0b19e0 2024-09-17T01:48:33.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.167+0000 7f2c88c00640 1 -- 172.21.15.42:0/2619308823 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8400fd20 con 0x7f2c8c0b19e0 2024-09-17T01:48:33.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.167+0000 7f2c91800640 1 -- 172.21.15.42:0/2619308823 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c8c1f7030 con 0x7f2c8c0b19e0 2024-09-17T01:48:33.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.168+0000 7f2c91800640 1 -- 172.21.15.42:0/2619308823 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c8c073de0 con 0x7f2c8c0b19e0 2024-09-17T01:48:33.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.171+0000 7f2c88c00640 1 -- 172.21.15.42:0/2619308823 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2c8401c460 con 0x7f2c8c0b19e0 2024-09-17T01:48:33.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.172+0000 7f2c88c00640 1 --2- 172.21.15.42:0/2619308823 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2c68078bc0 0x7f2c6807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:33.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.172+0000 7f2c88c00640 1 -- 172.21.15.42:0/2619308823 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 4943+0+0 (secure 0 0 0) 0x7f2c8409bc60 con 0x7f2c8c0b19e0 2024-09-17T01:48:33.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.172+0000 7f2c8be00640 1 --2- 172.21.15.42:0/2619308823 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2c68078bc0 0x7f2c6807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:33.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.173+0000 7f2c8be00640 1 --2- 172.21.15.42:0/2619308823 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2c68078bc0 0x7f2c6807b0d0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c035000 tx=0x7f2c7c02d040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:33.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.175+0000 7f2c88c00640 1 -- 172.21.15.42:0/2619308823 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2c84064410 con 0x7f2c8c0b19e0 2024-09-17T01:48:33.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.371+0000 7f2c91800640 1 -- 172.21.15.42:0/2619308823 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c8c1f2e00 con 0x7f2c8c0b19e0 2024-09-17T01:48:33.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.372+0000 7f2c88c00640 1 -- 172.21.15.42:0/2619308823 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v205) ==== 74+0+12994 (secure 0 0 0) 0x7f2c84063d10 con 0x7f2c8c0b19e0 2024-09-17T01:48:33.370 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:48:33.370 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":205,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:48:30.881286+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6835/3836210591":"2024-09-18T01:48:27.870784+0000","172.21.15.42:6832/3836210591":"2024-09-18T01:48:27.870784+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:48:33.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.375+0000 7f2c91800640 1 -- 172.21.15.42:0/2619308823 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2c68078bc0 msgr2=0x7f2c6807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:33.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.375+0000 7f2c91800640 1 --2- 172.21.15.42:0/2619308823 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2c68078bc0 0x7f2c6807b0d0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c035000 tx=0x7f2c7c02d040 comp rx=0 tx=0).stop 2024-09-17T01:48:33.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.375+0000 7f2c91800640 1 -- 172.21.15.42:0/2619308823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c8c0b19e0 msgr2=0x7f2c8c1f30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:33.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.375+0000 7f2c91800640 1 --2- 172.21.15.42:0/2619308823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c8c0b19e0 0x7f2c8c1f30a0 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 crypto rx=0x7f2c70004780 tx=0x7f2c840064f0 comp rx=0 tx=0).stop 2024-09-17T01:48:33.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.375+0000 7f2c91800640 1 -- 172.21.15.42:0/2619308823 shutdown_connections 2024-09-17T01:48:33.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.375+0000 7f2c91800640 1 --2- 172.21.15.42:0/2619308823 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2c68078bc0 0x7f2c6807b0d0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:33.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.375+0000 7f2c91800640 1 --2- 172.21.15.42:0/2619308823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c8c0b19e0 0x7f2c8c1f30a0 unknown :-1 s=CLOSED pgs=2377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:33.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.375+0000 7f2c91800640 1 --2- 172.21.15.42:0/2619308823 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2c8c14c460 0x7f2c8c0b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:33.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.375+0000 7f2c91800640 1 --2- 172.21.15.42:0/2619308823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c700039e0 0x7f2c8c14be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:33.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.375+0000 7f2c91800640 1 -- 172.21.15.42:0/2619308823 >> 172.21.15.42:0/2619308823 conn(0x7f2c8c06d3f0 msgr2=0x7f2c8c072b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:33.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.375+0000 7f2c91800640 1 -- 172.21.15.42:0/2619308823 shutdown_connections 2024-09-17T01:48:33.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.375+0000 7f2c91800640 1 -- 172.21.15.42:0/2619308823 wait complete. 2024-09-17T01:48:33.396 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T01:31:55.004951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T01:48:33.396 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T01:48:33.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.630+0000 7f4041400640 1 -- 172.21.15.42:0/2830391575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f403c15fb30 msgr2=0x7f403c0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:33.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.630+0000 7f4041400640 1 --2- 172.21.15.42:0/2830391575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f403c15fb30 0x7f403c0d0f20 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 crypto rx=0x7f403c0d0c70 tx=0x7f402402a5f0 comp rx=0 tx=0).stop 2024-09-17T01:48:33.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.630+0000 7f4041400640 1 -- 172.21.15.42:0/2830391575 shutdown_connections 2024-09-17T01:48:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.630+0000 7f4041400640 1 --2- 172.21.15.42:0/2830391575 >> v2:172.21.15.43:3300/0 conn(0x7f403c0d1460 0x7f403c0b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.630+0000 7f4041400640 1 --2- 172.21.15.42:0/2830391575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f403c15fb30 0x7f403c0d0f20 unknown :-1 s=CLOSED pgs=2378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.630+0000 7f4041400640 1 -- 172.21.15.42:0/2830391575 >> 172.21.15.42:0/2830391575 conn(0x7f403c073dd0 msgr2=0x7f403c0b6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.630+0000 7f4041400640 1 -- 172.21.15.42:0/2830391575 shutdown_connections 2024-09-17T01:48:33.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.630+0000 7f4041400640 1 -- 172.21.15.42:0/2830391575 wait complete. 2024-09-17T01:48:33.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.632+0000 7f4041400640 1 Processor -- start 2024-09-17T01:48:33.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.632+0000 7f4041400640 1 -- start start 2024-09-17T01:48:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.634+0000 7f4041400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f403c0ba340 0x7f403c0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.634+0000 7f4041400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f403c0d1460 0x7f403c0cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:33.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.634+0000 7f4041400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f403c15fb30 0x7f403c0cd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.634+0000 7f4041400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f403c0cf370 con 0x7f403c15fb30 2024-09-17T01:48:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.634+0000 7f4041400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f403c0cf1f0 con 0x7f403c0ba340 2024-09-17T01:48:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.634+0000 7f4041400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f403c0b3710 con 0x7f403c0d1460 2024-09-17T01:48:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.634+0000 7f4040a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f403c15fb30 0x7f403c0cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.634+0000 7f4040a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f403c15fb30 0x7f403c0cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44372/0 (socket says 172.21.15.42:44372) 2024-09-17T01:48:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.634+0000 7f4040a00640 1 -- 172.21.15.42:0/832167189 learned_addr learned my addr 172.21.15.42:0/832167189 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.634+0000 7f403be00640 1 --2- 172.21.15.42:0/832167189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f403c0ba340 0x7f403c0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.634+0000 7f4033e00640 1 --2- 172.21.15.42:0/832167189 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f403c0d1460 0x7f403c0cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.635+0000 7f4040a00640 1 -- 172.21.15.42:0/832167189 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f403c0d1460 msgr2=0x7f403c0cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.635+0000 7f4040a00640 1 --2- 172.21.15.42:0/832167189 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f403c0d1460 0x7f403c0cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.635+0000 7f4040a00640 1 -- 172.21.15.42:0/832167189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f403c0ba340 msgr2=0x7f403c0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.635+0000 7f4040a00640 1 --2- 172.21.15.42:0/832167189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f403c0ba340 0x7f403c0cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:33.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.635+0000 7f4040a00640 1 -- 172.21.15.42:0/832167189 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403c0ca140 con 0x7f403c15fb30 2024-09-17T01:48:33.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.635+0000 7f4033e00640 1 --2- 172.21.15.42:0/832167189 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f403c0d1460 0x7f403c0cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:48:33.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.635+0000 7f4040a00640 1 --2- 172.21.15.42:0/832167189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f403c15fb30 0x7f403c0cd930 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7f403400d9a0 tx=0x7f403400de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:33.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.635+0000 7f4038c00640 1 -- 172.21.15.42:0/832167189 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4034017070 con 0x7f403c15fb30 2024-09-17T01:48:33.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.635+0000 7f4038c00640 1 -- 172.21.15.42:0/832167189 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f403400be00 con 0x7f403c15fb30 2024-09-17T01:48:33.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.635+0000 7f4041400640 1 -- 172.21.15.42:0/832167189 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f403c0ca420 con 0x7f403c15fb30 2024-09-17T01:48:33.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.635+0000 7f4038c00640 1 -- 172.21.15.42:0/832167189 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4034003bd0 con 0x7f403c15fb30 2024-09-17T01:48:33.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.635+0000 7f4041400640 1 -- 172.21.15.42:0/832167189 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f403c0cc990 con 0x7f403c15fb30 2024-09-17T01:48:33.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.636+0000 7f4041400640 1 -- 172.21.15.42:0/832167189 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f403c0b3ba0 con 0x7f403c15fb30 2024-09-17T01:48:33.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.637+0000 7f4038c00640 1 -- 172.21.15.42:0/832167189 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4034010460 con 0x7f403c15fb30 2024-09-17T01:48:33.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.638+0000 7f4038c00640 1 --2- 172.21.15.42:0/832167189 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4018078bc0 0x7f401807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:33.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.638+0000 7f4038c00640 1 -- 172.21.15.42:0/832167189 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 4943+0+0 (secure 0 0 0) 0x7f403409add0 con 0x7f403c15fb30 2024-09-17T01:48:33.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.639+0000 7f403be00640 1 --2- 172.21.15.42:0/832167189 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4018078bc0 0x7f401807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:33.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.640+0000 7f403be00640 1 --2- 172.21.15.42:0/832167189 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4018078bc0 0x7f401807b0d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f402c0015e0 tx=0x7f402c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:33.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.643+0000 7f4038c00640 1 -- 172.21.15.42:0/832167189 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4034063590 con 0x7f403c15fb30 2024-09-17T01:48:33.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.838+0000 7f4041400640 1 -- 172.21.15.42:0/832167189 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f403c0d3f80 con 0x7f403c15fb30 2024-09-17T01:48:33.837 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.839+0000 7f4038c00640 1 -- 172.21.15.42:0/832167189 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v205) ==== 93+0+10 (secure 0 0 0) 0x7f4034062e90 con 0x7f403c15fb30 2024-09-17T01:48:33.837 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-09-17T01:48:33.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.842+0000 7f4041400640 1 -- 172.21.15.42:0/832167189 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4018078bc0 msgr2=0x7f401807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:33.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.842+0000 7f4041400640 1 --2- 172.21.15.42:0/832167189 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4018078bc0 0x7f401807b0d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f402c0015e0 tx=0x7f402c009040 comp rx=0 tx=0).stop 2024-09-17T01:48:33.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.842+0000 7f4041400640 1 -- 172.21.15.42:0/832167189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f403c15fb30 msgr2=0x7f403c0cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:33.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.842+0000 7f4041400640 1 --2- 172.21.15.42:0/832167189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f403c15fb30 0x7f403c0cd930 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7f403400d9a0 tx=0x7f403400de60 comp rx=0 tx=0).stop 2024-09-17T01:48:33.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.842+0000 7f4041400640 1 -- 172.21.15.42:0/832167189 shutdown_connections 2024-09-17T01:48:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.842+0000 7f4041400640 1 --2- 172.21.15.42:0/832167189 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4018078bc0 0x7f401807b0d0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.842+0000 7f4041400640 1 --2- 172.21.15.42:0/832167189 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f403c15fb30 0x7f403c0cd930 unknown :-1 s=CLOSED pgs=2379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.842+0000 7f4041400640 1 --2- 172.21.15.42:0/832167189 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f403c0d1460 0x7f403c0cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.842+0000 7f4041400640 1 --2- 172.21.15.42:0/832167189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f403c0ba340 0x7f403c0cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.842+0000 7f4041400640 1 -- 172.21.15.42:0/832167189 >> 172.21.15.42:0/832167189 conn(0x7f403c073dd0 msgr2=0x7f403c1621f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.842+0000 7f4041400640 1 -- 172.21.15.42:0/832167189 shutdown_connections 2024-09-17T01:48:33.841 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:33.842+0000 7f4041400640 1 -- 172.21.15.42:0/832167189 wait complete. 2024-09-17T01:48:33.862 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files' 2024-09-17T01:48:34.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.092+0000 7f3fc9000640 1 -- 172.21.15.42:0/2758427174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fc40af970 msgr2=0x7f3fc4073ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:34.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.092+0000 7f3fc9000640 1 --2- 172.21.15.42:0/2758427174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fc40af970 0x7f3fc4073ba0 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4009830 tx=0x7f3fb402a510 comp rx=0 tx=0).stop 2024-09-17T01:48:34.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.092+0000 7f3fc9000640 1 -- 172.21.15.42:0/2758427174 shutdown_connections 2024-09-17T01:48:34.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.092+0000 7f3fc9000640 1 --2- 172.21.15.42:0/2758427174 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3fc40b3520 0x7f3fc40b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:34.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.092+0000 7f3fc9000640 1 --2- 172.21.15.42:0/2758427174 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fc40af970 0x7f3fc4073ba0 unknown :-1 s=CLOSED pgs=2381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:34.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.092+0000 7f3fc9000640 1 -- 172.21.15.42:0/2758427174 >> 172.21.15.42:0/2758427174 conn(0x7f3fc406d3f0 msgr2=0x7f3fc40b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:34.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.093+0000 7f3fc9000640 1 -- 172.21.15.42:0/2758427174 shutdown_connections 2024-09-17T01:48:34.091 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.093+0000 7f3fc9000640 1 -- 172.21.15.42:0/2758427174 wait complete. 2024-09-17T01:48:34.092 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.095+0000 7f3fc9000640 1 Processor -- start 2024-09-17T01:48:34.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.095+0000 7f3fc9000640 1 -- start start 2024-09-17T01:48:34.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.096+0000 7f3fc9000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fc40af970 0x7f3fc4154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:34.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.096+0000 7f3fc9000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3fc40b3520 0x7f3fc4154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:34.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.096+0000 7f3fc9000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fc4160500 0x7f3fc41f8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:34.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.096+0000 7f3fc9000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc40ce700 con 0x7f3fc4160500 2024-09-17T01:48:34.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.096+0000 7f3fc9000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc40ce580 con 0x7f3fc40af970 2024-09-17T01:48:34.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.096+0000 7f3fc9000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3fc40ce880 con 0x7f3fc40b3520 2024-09-17T01:48:34.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.097+0000 7f3fc3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fc4160500 0x7f3fc41f8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:34.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.097+0000 7f3fc3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fc4160500 0x7f3fc41f8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44388/0 (socket says 172.21.15.42:44388) 2024-09-17T01:48:34.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.097+0000 7f3fc3e00640 1 -- 172.21.15.42:0/3372325047 learned_addr learned my addr 172.21.15.42:0/3372325047 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:34.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.097+0000 7f3fbbe00640 1 --2- 172.21.15.42:0/3372325047 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3fc40b3520 0x7f3fc4154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:34.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.097+0000 7f3fc3400640 1 --2- 172.21.15.42:0/3372325047 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fc40af970 0x7f3fc4154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:34.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.097+0000 7f3fc3e00640 1 -- 172.21.15.42:0/3372325047 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3fc40b3520 msgr2=0x7f3fc4154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:34.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.097+0000 7f3fc3e00640 1 --2- 172.21.15.42:0/3372325047 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3fc40b3520 0x7f3fc4154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:34.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.097+0000 7f3fc3e00640 1 -- 172.21.15.42:0/3372325047 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fc40af970 msgr2=0x7f3fc4154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:34.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.097+0000 7f3fc3e00640 1 --2- 172.21.15.42:0/3372325047 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fc40af970 0x7f3fc4154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:34.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.097+0000 7f3fc3e00640 1 -- 172.21.15.42:0/3372325047 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc406f0f0 con 0x7f3fc4160500 2024-09-17T01:48:34.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.097+0000 7f3fc3e00640 1 --2- 172.21.15.42:0/3372325047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fc4160500 0x7f3fc41f8b20 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00cad0 tx=0x7f3fbc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:34.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.098+0000 7f3fbb400640 1 -- 172.21.15.42:0/3372325047 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc016020 con 0x7f3fc4160500 2024-09-17T01:48:34.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.098+0000 7f3fbb400640 1 -- 172.21.15.42:0/3372325047 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fbc00ad20 con 0x7f3fc4160500 2024-09-17T01:48:34.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.098+0000 7f3fbb400640 1 -- 172.21.15.42:0/3372325047 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc012680 con 0x7f3fc4160500 2024-09-17T01:48:34.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.098+0000 7f3fc9000640 1 -- 172.21.15.42:0/3372325047 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fc406e330 con 0x7f3fc4160500 2024-09-17T01:48:34.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.098+0000 7f3fc9000640 1 -- 172.21.15.42:0/3372325047 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fc406e8f0 con 0x7f3fc4160500 2024-09-17T01:48:34.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.099+0000 7f3fc9000640 1 -- 172.21.15.42:0/3372325047 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fc406fe20 con 0x7f3fc4160500 2024-09-17T01:48:34.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.100+0000 7f3fbb400640 1 -- 172.21.15.42:0/3372325047 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3fbc019020 con 0x7f3fc4160500 2024-09-17T01:48:34.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.101+0000 7f3fbb400640 1 --2- 172.21.15.42:0/3372325047 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3fa0078b90 0x7f3fa007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:34.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.101+0000 7f3fbb400640 1 -- 172.21.15.42:0/3372325047 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 4943+0+0 (secure 0 0 0) 0x7f3fbc09afc0 con 0x7f3fc4160500 2024-09-17T01:48:34.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.101+0000 7f3fc3400640 1 --2- 172.21.15.42:0/3372325047 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3fa0078b90 0x7f3fa007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:34.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.102+0000 7f3fc3400640 1 --2- 172.21.15.42:0/3372325047 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3fa0078b90 0x7f3fa007b0a0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4034000 tx=0x7f3fb4004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:34.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.106+0000 7f3fbb400640 1 -- 172.21.15.42:0/3372325047 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3fbc020020 con 0x7f3fc4160500 2024-09-17T01:48:34.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.376+0000 7f3fc9000640 1 -- 172.21.15.42:0/3372325047 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]} v 0) -- 0x7f3fc4073ba0 con 0x7f3fc4160500 2024-09-17T01:48:34.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.902+0000 7f3fbb400640 1 -- 172.21.15.42:0/3372325047 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]}]=0 v775) ==== 150+0+0 (secure 0 0 0) 0x7f3fbc0636f0 con 0x7f3fc4160500 2024-09-17T01:48:34.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.905+0000 7f3fc9000640 1 -- 172.21.15.42:0/3372325047 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3fa0078b90 msgr2=0x7f3fa007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:34.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.905+0000 7f3fc9000640 1 --2- 172.21.15.42:0/3372325047 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3fa0078b90 0x7f3fa007b0a0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4034000 tx=0x7f3fb4004730 comp rx=0 tx=0).stop 2024-09-17T01:48:34.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.905+0000 7f3fc9000640 1 -- 172.21.15.42:0/3372325047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fc4160500 msgr2=0x7f3fc41f8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:34.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.905+0000 7f3fc9000640 1 --2- 172.21.15.42:0/3372325047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fc4160500 0x7f3fc41f8b20 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00cad0 tx=0x7f3fbc00cf90 comp rx=0 tx=0).stop 2024-09-17T01:48:34.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.906+0000 7f3fc9000640 1 -- 172.21.15.42:0/3372325047 shutdown_connections 2024-09-17T01:48:34.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.906+0000 7f3fc9000640 1 --2- 172.21.15.42:0/3372325047 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3fa0078b90 0x7f3fa007b0a0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:34.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.906+0000 7f3fc9000640 1 --2- 172.21.15.42:0/3372325047 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fc4160500 0x7f3fc41f8b20 unknown :-1 s=CLOSED pgs=2382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:34.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.906+0000 7f3fc9000640 1 --2- 172.21.15.42:0/3372325047 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3fc40b3520 0x7f3fc4154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:34.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.906+0000 7f3fc9000640 1 --2- 172.21.15.42:0/3372325047 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fc40af970 0x7f3fc4154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:34.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.906+0000 7f3fc9000640 1 -- 172.21.15.42:0/3372325047 >> 172.21.15.42:0/3372325047 conn(0x7f3fc406d3f0 msgr2=0x7f3fc415f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:34.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.906+0000 7f3fc9000640 1 -- 172.21.15.42:0/3372325047 shutdown_connections 2024-09-17T01:48:34.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:34.906+0000 7f3fc9000640 1 -- 172.21.15.42:0/3372325047 wait complete. 2024-09-17T01:48:34.928 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T01:48:35.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.158+0000 7f6100600640 1 -- 172.21.15.42:0/2836479754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60f8073760 msgr2=0x7f60f80cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:35.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.158+0000 7f6100600640 1 --2- 172.21.15.42:0/2836479754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60f8073760 0x7f60f80cd620 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 crypto rx=0x7f60f0005fd0 tx=0x7f60f002a8b0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.158+0000 7f6100600640 1 -- 172.21.15.42:0/2836479754 shutdown_connections 2024-09-17T01:48:35.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.158+0000 7f6100600640 1 --2- 172.21.15.42:0/2836479754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60f8073760 0x7f60f80cd620 unknown :-1 s=CLOSED pgs=2384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.158+0000 7f6100600640 1 --2- 172.21.15.42:0/2836479754 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f60f806fd50 0x7f60f8073220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.158+0000 7f6100600640 1 -- 172.21.15.42:0/2836479754 >> 172.21.15.42:0/2836479754 conn(0x7f60f806d1b0 msgr2=0x7f60f806d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:35.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.158+0000 7f6100600640 1 -- 172.21.15.42:0/2836479754 shutdown_connections 2024-09-17T01:48:35.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.158+0000 7f6100600640 1 -- 172.21.15.42:0/2836479754 wait complete. 2024-09-17T01:48:35.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.160+0000 7f6100600640 1 Processor -- start 2024-09-17T01:48:35.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.160+0000 7f6100600640 1 -- start start 2024-09-17T01:48:35.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.162+0000 7f6100600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f60f806fd50 0x7f60f813bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:35.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.162+0000 7f6100600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60f8073760 0x7f60f81e42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:35.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.162+0000 7f6100600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60f815c040 0x7f60f814cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:35.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.162+0000 7f6100600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f60f80cdf20 con 0x7f60f815c040 2024-09-17T01:48:35.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.162+0000 7f6100600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f60f80cdda0 con 0x7f60f8073760 2024-09-17T01:48:35.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.162+0000 7f6100600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f60f806ede0 con 0x7f60f806fd50 2024-09-17T01:48:35.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.162+0000 7f60fe600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60f815c040 0x7f60f814cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:35.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.162+0000 7f60fe600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60f815c040 0x7f60f814cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44412/0 (socket says 172.21.15.42:44412) 2024-09-17T01:48:35.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.162+0000 7f60fe600640 1 -- 172.21.15.42:0/2430138321 learned_addr learned my addr 172.21.15.42:0/2430138321 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:35.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.162+0000 7f60fdc00640 1 --2- 172.21.15.42:0/2430138321 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f60f806fd50 0x7f60f813bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:35.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.162+0000 7f60fd200640 1 --2- 172.21.15.42:0/2430138321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60f8073760 0x7f60f81e42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:35.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.163+0000 7f60fe600640 1 -- 172.21.15.42:0/2430138321 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f60f806fd50 msgr2=0x7f60f813bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:35.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.163+0000 7f60fe600640 1 --2- 172.21.15.42:0/2430138321 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f60f806fd50 0x7f60f813bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.163+0000 7f60fe600640 1 -- 172.21.15.42:0/2430138321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60f8073760 msgr2=0x7f60f81e42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:35.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.163+0000 7f60fe600640 1 --2- 172.21.15.42:0/2430138321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60f8073760 0x7f60f81e42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.163+0000 7f60fe600640 1 -- 172.21.15.42:0/2430138321 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f81f93b0 con 0x7f60f815c040 2024-09-17T01:48:35.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.163+0000 7f60fe600640 1 --2- 172.21.15.42:0/2430138321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60f815c040 0x7f60f814cff0 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 crypto rx=0x7f60f002aea0 tx=0x7f60f00316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:35.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.163+0000 7f60f5600640 1 -- 172.21.15.42:0/2430138321 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f0031990 con 0x7f60f815c040 2024-09-17T01:48:35.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.163+0000 7f60f5600640 1 -- 172.21.15.42:0/2430138321 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60f0031c20 con 0x7f60f815c040 2024-09-17T01:48:35.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.163+0000 7f60f5600640 1 -- 172.21.15.42:0/2430138321 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f0033070 con 0x7f60f815c040 2024-09-17T01:48:35.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.163+0000 7f6100600640 1 -- 172.21.15.42:0/2430138321 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60f81f9690 con 0x7f60f815c040 2024-09-17T01:48:35.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.164+0000 7f6100600640 1 -- 172.21.15.42:0/2430138321 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60f81f9c50 con 0x7f60f815c040 2024-09-17T01:48:35.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.165+0000 7f6100600640 1 -- 172.21.15.42:0/2430138321 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60f8076860 con 0x7f60f815c040 2024-09-17T01:48:35.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.167+0000 7f60f5600640 1 -- 172.21.15.42:0/2430138321 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f60f0033210 con 0x7f60f815c040 2024-09-17T01:48:35.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.168+0000 7f60f5600640 1 --2- 172.21.15.42:0/2430138321 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f60d8078bb0 0x7f60d807b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:35.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.168+0000 7f60f5600640 1 -- 172.21.15.42:0/2430138321 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 4943+0+0 (secure 0 0 0) 0x7f60f00bc190 con 0x7f60f815c040 2024-09-17T01:48:35.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.169+0000 7f60fdc00640 1 --2- 172.21.15.42:0/2430138321 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f60d8078bb0 0x7f60d807b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:35.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.169+0000 7f60fdc00640 1 --2- 172.21.15.42:0/2430138321 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f60d8078bb0 0x7f60d807b0c0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f60ec007fd0 tx=0x7f60ec001370 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:35.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.172+0000 7f60f5600640 1 -- 172.21.15.42:0/2430138321 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f60f8076860 con 0x7f60f815c040 2024-09-17T01:48:35.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.368+0000 7f6100600640 1 -- 172.21.15.42:0/2430138321 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f60f8073220 con 0x7f60f815c040 2024-09-17T01:48:35.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.368+0000 7f60f5600640 1 -- 172.21.15.42:0/2430138321 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v65) ==== 59+0+2294 (secure 0 0 0) 0x7f60f004a020 con 0x7f60f815c040 2024-09-17T01:48:35.366 INFO:teuthology.orchestra.run.smithi042.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T01:48:35.366 INFO:teuthology.orchestra.run.smithi042.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T01:48:35.367 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced client_mount_timeout 30 2024-09-17T01:48:35.367 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_client 20/20 2024-09-17T01:48:35.367 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_mgr 20/20 2024-09-17T01:48:35.367 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_ms 1/1 2024-09-17T01:48:35.367 INFO:teuthology.orchestra.run.smithi042.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T01:48:35.367 INFO:teuthology.orchestra.run.smithi042.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T01:48:35.367 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3683.959260 2024-09-17T01:48:35.367 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4350.010833 2024-09-17T01:48:35.367 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4316.776055 2024-09-17T01:48:35.367 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3885.595082 2024-09-17T01:48:35.367 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3602.000737 2024-09-17T01:48:35.367 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4883.364748 2024-09-17T01:48:35.367 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3752.484811 2024-09-17T01:48:35.368 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3775.035963 2024-09-17T01:48:35.368 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds 20/20 2024-09-17T01:48:35.368 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T01:48:35.368 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_ms 2/2 2024-09-17T01:48:35.368 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_frag true 2024-09-17T01:48:35.368 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_scatterstat true 2024-09-17T01:48:35.368 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T01:48:35.368 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_verify_scatter true 2024-09-17T01:48:35.368 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T01:48:35.368 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T01:48:35.368 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T01:48:35.368 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced client_mount_timeout 600 2024-09-17T01:48:35.368 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_client 20/20 2024-09-17T01:48:35.369 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_ms 1/1 2024-09-17T01:48:35.369 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T01:48:35.369 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T01:48:35.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.371+0000 7f6100600640 1 -- 172.21.15.42:0/2430138321 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f60d8078bb0 msgr2=0x7f60d807b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:35.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.371+0000 7f6100600640 1 --2- 172.21.15.42:0/2430138321 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f60d8078bb0 0x7f60d807b0c0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f60ec007fd0 tx=0x7f60ec001370 comp rx=0 tx=0).stop 2024-09-17T01:48:35.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.371+0000 7f6100600640 1 -- 172.21.15.42:0/2430138321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60f815c040 msgr2=0x7f60f814cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:35.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.371+0000 7f6100600640 1 --2- 172.21.15.42:0/2430138321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60f815c040 0x7f60f814cff0 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 crypto rx=0x7f60f002aea0 tx=0x7f60f00316d0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.371+0000 7f6100600640 1 -- 172.21.15.42:0/2430138321 shutdown_connections 2024-09-17T01:48:35.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.371+0000 7f6100600640 1 --2- 172.21.15.42:0/2430138321 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f60d8078bb0 0x7f60d807b0c0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.371+0000 7f6100600640 1 --2- 172.21.15.42:0/2430138321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60f8073760 0x7f60f81e42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.371+0000 7f6100600640 1 --2- 172.21.15.42:0/2430138321 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60f815c040 0x7f60f814cff0 unknown :-1 s=CLOSED pgs=2385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.371+0000 7f6100600640 1 --2- 172.21.15.42:0/2430138321 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f60f806fd50 0x7f60f813bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.371+0000 7f6100600640 1 -- 172.21.15.42:0/2430138321 >> 172.21.15.42:0/2430138321 conn(0x7f60f806d1b0 msgr2=0x7f60f8155cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:35.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.371+0000 7f6100600640 1 -- 172.21.15.42:0/2430138321 shutdown_connections 2024-09-17T01:48:35.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.371+0000 7f6100600640 1 -- 172.21.15.42:0/2430138321 wait complete. 2024-09-17T01:48:35.393 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T01:48:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.625+0000 7f0ffda00640 1 -- 172.21.15.42:0/2113826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ff81605c0 msgr2=0x7f0ff81609d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.625+0000 7f0ffda00640 1 --2- 172.21.15.42:0/2113826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ff81605c0 0x7f0ff81609d0 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8072250 tx=0x7f0ff002a820 comp rx=0 tx=0).stop 2024-09-17T01:48:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.626+0000 7f0ffda00640 1 -- 172.21.15.42:0/2113826 shutdown_connections 2024-09-17T01:48:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.626+0000 7f0ffda00640 1 --2- 172.21.15.42:0/2113826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ff81605c0 0x7f0ff81609d0 unknown :-1 s=CLOSED pgs=2387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.626+0000 7f0ffda00640 1 --2- 172.21.15.42:0/2113826 >> v2:172.21.15.43:3300/0 conn(0x7f0ff80b51d0 0x7f0ff80b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.626+0000 7f0ffda00640 1 -- 172.21.15.42:0/2113826 >> 172.21.15.42:0/2113826 conn(0x7f0ff806d3f0 msgr2=0x7f0ff80b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.626+0000 7f0ffda00640 1 -- 172.21.15.42:0/2113826 shutdown_connections 2024-09-17T01:48:35.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.626+0000 7f0ffda00640 1 -- 172.21.15.42:0/2113826 wait complete. 2024-09-17T01:48:35.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.628+0000 7f0ffda00640 1 Processor -- start 2024-09-17T01:48:35.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.628+0000 7f0ffda00640 1 -- start start 2024-09-17T01:48:35.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.629+0000 7f0ffda00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0ff80afb00 0x7f0ff81590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:35.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.629+0000 7f0ffda00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ff80b51d0 0x7f0ff815a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:35.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.629+0000 7f0ffda00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ff81605c0 0x7f0ff806f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:35.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.630+0000 7f0ffda00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff80ce4f0 con 0x7f0ff81605c0 2024-09-17T01:48:35.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.630+0000 7f0ffda00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff80ce370 con 0x7f0ff80b51d0 2024-09-17T01:48:35.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.630+0000 7f0ffda00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff80ce670 con 0x7f0ff80afb00 2024-09-17T01:48:35.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.630+0000 7f0ffd000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ff81605c0 0x7f0ff806f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:35.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.630+0000 7f0ffd000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ff81605c0 0x7f0ff806f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:44432/0 (socket says 172.21.15.42:44432) 2024-09-17T01:48:35.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.630+0000 7f0ffd000640 1 -- 172.21.15.42:0/3526516703 learned_addr learned my addr 172.21.15.42:0/3526516703 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:35.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.630+0000 7f0ff7400640 1 --2- 172.21.15.42:0/3526516703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ff80b51d0 0x7f0ff815a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:35.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.630+0000 7f0ff7e00640 1 --2- 172.21.15.42:0/3526516703 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0ff80afb00 0x7f0ff81590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:35.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.630+0000 7f0ffd000640 1 -- 172.21.15.42:0/3526516703 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0ff80afb00 msgr2=0x7f0ff81590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:35.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.630+0000 7f0ffd000640 1 --2- 172.21.15.42:0/3526516703 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0ff80afb00 0x7f0ff81590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.630+0000 7f0ffd000640 1 -- 172.21.15.42:0/3526516703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ff80b51d0 msgr2=0x7f0ff815a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:35.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.630+0000 7f0ffd000640 1 --2- 172.21.15.42:0/3526516703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ff80b51d0 0x7f0ff815a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.630+0000 7f0ffd000640 1 -- 172.21.15.42:0/3526516703 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff8159600 con 0x7f0ff81605c0 2024-09-17T01:48:35.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.630+0000 7f0ff7e00640 1 --2- 172.21.15.42:0/3526516703 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0ff80afb00 0x7f0ff81590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:35.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.631+0000 7f0ffd000640 1 --2- 172.21.15.42:0/3526516703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ff81605c0 0x7f0ff806f5f0 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7f0ff002ae10 tx=0x7f0ff0032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:35.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.631+0000 7f0fefe00640 1 -- 172.21.15.42:0/3526516703 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0037040 con 0x7f0ff81605c0 2024-09-17T01:48:35.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.631+0000 7f0fefe00640 1 -- 172.21.15.42:0/3526516703 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ff0042070 con 0x7f0ff81605c0 2024-09-17T01:48:35.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.631+0000 7f0ffda00640 1 -- 172.21.15.42:0/3526516703 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ff80c56e0 con 0x7f0ff81605c0 2024-09-17T01:48:35.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.631+0000 7f0fefe00640 1 -- 172.21.15.42:0/3526516703 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0003e60 con 0x7f0ff81605c0 2024-09-17T01:48:35.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.631+0000 7f0ffda00640 1 -- 172.21.15.42:0/3526516703 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ff81588c0 con 0x7f0ff81605c0 2024-09-17T01:48:35.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.632+0000 7f0ffda00640 1 -- 172.21.15.42:0/3526516703 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ff80b55e0 con 0x7f0ff81605c0 2024-09-17T01:48:35.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.633+0000 7f0fefe00640 1 -- 172.21.15.42:0/3526516703 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0ff00042a0 con 0x7f0ff81605c0 2024-09-17T01:48:35.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.634+0000 7f0fefe00640 1 --2- 172.21.15.42:0/3526516703 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0fd8078bc0 0x7f0fd807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:35.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.634+0000 7f0fefe00640 1 -- 172.21.15.42:0/3526516703 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 4943+0+0 (secure 0 0 0) 0x7f0ff00bb810 con 0x7f0ff81605c0 2024-09-17T01:48:35.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.635+0000 7f0ff7e00640 1 --2- 172.21.15.42:0/3526516703 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0fd8078bc0 0x7f0fd807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:35.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.636+0000 7f0ff7e00640 1 --2- 172.21.15.42:0/3526516703 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0fd8078bc0 0x7f0fd807b0d0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80013f0 tx=0x7f0fe8009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:35.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.639+0000 7f0fefe00640 1 -- 172.21.15.42:0/3526516703 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0ff0083eb0 con 0x7f0ff81605c0 2024-09-17T01:48:35.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.834+0000 7f0ffda00640 1 -- 172.21.15.42:0/3526516703 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0ff80c5c00 con 0x7f0ff81605c0 2024-09-17T01:48:35.836 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.839+0000 7f0fefe00640 1 -- 172.21.15.42:0/3526516703 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v66)=0 v66) ==== 122+0+0 (secure 0 0 0) 0x7f0ff00837b0 con 0x7f0ff81605c0 2024-09-17T01:48:35.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.841+0000 7f0ffda00640 1 -- 172.21.15.42:0/3526516703 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0fd8078bc0 msgr2=0x7f0fd807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:35.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.841+0000 7f0ffda00640 1 --2- 172.21.15.42:0/3526516703 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0fd8078bc0 0x7f0fd807b0d0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80013f0 tx=0x7f0fe8009040 comp rx=0 tx=0).stop 2024-09-17T01:48:35.839 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.841+0000 7f0ffda00640 1 -- 172.21.15.42:0/3526516703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ff81605c0 msgr2=0x7f0ff806f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:35.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.841+0000 7f0ffda00640 1 --2- 172.21.15.42:0/3526516703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ff81605c0 0x7f0ff806f5f0 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7f0ff002ae10 tx=0x7f0ff0032d10 comp rx=0 tx=0).stop 2024-09-17T01:48:35.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.841+0000 7f0ffda00640 1 -- 172.21.15.42:0/3526516703 shutdown_connections 2024-09-17T01:48:35.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.841+0000 7f0ffda00640 1 --2- 172.21.15.42:0/3526516703 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0fd8078bc0 0x7f0fd807b0d0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.841+0000 7f0ffda00640 1 --2- 172.21.15.42:0/3526516703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ff80b51d0 0x7f0ff815a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.841+0000 7f0ffda00640 1 --2- 172.21.15.42:0/3526516703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ff81605c0 0x7f0ff806f5f0 unknown :-1 s=CLOSED pgs=2388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.841+0000 7f0ffda00640 1 --2- 172.21.15.42:0/3526516703 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0ff80afb00 0x7f0ff81590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.841+0000 7f0ffda00640 1 -- 172.21.15.42:0/3526516703 >> 172.21.15.42:0/3526516703 conn(0x7f0ff806d3f0 msgr2=0x7f0ff80cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:35.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.841+0000 7f0ffda00640 1 -- 172.21.15.42:0/3526516703 shutdown_connections 2024-09-17T01:48:35.840 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:35.841+0000 7f0ffda00640 1 -- 172.21.15.42:0/3526516703 wait complete. 2024-09-17T01:48:35.862 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:48:35.863 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:48:35.946 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:48:36.043 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:48:36.043 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:48:36.043 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:48:36.079 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:48:36.079 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:48:36.079 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:48:36.117 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:48:36.117 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:48:36.117 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:48:36.154 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:48:36.154 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:48:36.154 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:48:36.193 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:48:36.193 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T01:48:36.193 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:48:36.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.421+0000 7f91e8a00640 1 -- 172.21.15.42:0/1784855448 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91e415c7b0 msgr2=0x7f91e415efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:36.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.421+0000 7f91e8a00640 1 --2- 172.21.15.42:0/1784855448 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91e415c7b0 0x7f91e415efd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009860 tx=0x7f91d402a510 comp rx=0 tx=0).stop 2024-09-17T01:48:36.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.421+0000 7f91e8a00640 1 -- 172.21.15.42:0/1784855448 shutdown_connections 2024-09-17T01:48:36.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.421+0000 7f91e8a00640 1 --2- 172.21.15.42:0/1784855448 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91e415c7b0 0x7f91e415efd0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.421+0000 7f91e8a00640 1 -- 172.21.15.42:0/1784855448 >> 172.21.15.42:0/1784855448 conn(0x7f91e4073de0 msgr2=0x7f91e406cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:36.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.422+0000 7f91e8a00640 1 -- 172.21.15.42:0/1784855448 shutdown_connections 2024-09-17T01:48:36.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.422+0000 7f91e8a00640 1 -- 172.21.15.42:0/1784855448 wait complete. 2024-09-17T01:48:36.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.424+0000 7f91e8a00640 1 Processor -- start 2024-09-17T01:48:36.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.424+0000 7f91e8a00640 1 -- start start 2024-09-17T01:48:36.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.425+0000 7f91e8a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91e40d2830 0x7f91e4159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:36.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.425+0000 7f91e8a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91e415c7b0 0x7f91e40c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:36.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.425+0000 7f91e8a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91e415f510 0x7f91e40ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:36.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.426+0000 7f91e8a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f91e40d2c40 con 0x7f91e415f510 2024-09-17T01:48:36.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.426+0000 7f91e8a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f91e40d1aa0 con 0x7f91e415c7b0 2024-09-17T01:48:36.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.426+0000 7f91e8a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f91e40d2dc0 con 0x7f91e40d2830 2024-09-17T01:48:36.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.426+0000 7f91e3200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91e415f510 0x7f91e40ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:36.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.426+0000 7f91e3200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91e415f510 0x7f91e40ccdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59372/0 (socket says 172.21.15.42:59372) 2024-09-17T01:48:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.426+0000 7f91e3200640 1 -- 172.21.15.42:0/743866293 learned_addr learned my addr 172.21.15.42:0/743866293 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.426+0000 7f91e2800640 1 --2- 172.21.15.42:0/743866293 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91e40d2830 0x7f91e4159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.426+0000 7f91d9e00640 1 --2- 172.21.15.42:0/743866293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91e415c7b0 0x7f91e40c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.426+0000 7f91e3200640 1 -- 172.21.15.42:0/743866293 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91e40d2830 msgr2=0x7f91e4159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.426+0000 7f91e3200640 1 --2- 172.21.15.42:0/743866293 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91e40d2830 0x7f91e4159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.426+0000 7f91e3200640 1 -- 172.21.15.42:0/743866293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91e415c7b0 msgr2=0x7f91e40c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.426+0000 7f91e3200640 1 --2- 172.21.15.42:0/743866293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91e415c7b0 0x7f91e40c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.426+0000 7f91e3200640 1 -- 172.21.15.42:0/743866293 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e40ce610 con 0x7f91e415f510 2024-09-17T01:48:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.427+0000 7f91e3200640 1 --2- 172.21.15.42:0/743866293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91e415f510 0x7f91e40ccdf0 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00cb40 tx=0x7f91dc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.427+0000 7f91db400640 1 -- 172.21.15.42:0/743866293 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc016020 con 0x7f91e415f510 2024-09-17T01:48:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.427+0000 7f91db400640 1 -- 172.21.15.42:0/743866293 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91dc00adb0 con 0x7f91e415f510 2024-09-17T01:48:36.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.427+0000 7f91e8a00640 1 -- 172.21.15.42:0/743866293 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e40b6dc0 con 0x7f91e415f510 2024-09-17T01:48:36.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.427+0000 7f91db400640 1 -- 172.21.15.42:0/743866293 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc012680 con 0x7f91e415f510 2024-09-17T01:48:36.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.427+0000 7f91e8a00640 1 -- 172.21.15.42:0/743866293 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e40cde10 con 0x7f91e415f510 2024-09-17T01:48:36.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.428+0000 7f91e8a00640 1 -- 172.21.15.42:0/743866293 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e415efd0 con 0x7f91e415f510 2024-09-17T01:48:36.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.429+0000 7f91db400640 1 -- 172.21.15.42:0/743866293 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f91dc019020 con 0x7f91e415f510 2024-09-17T01:48:36.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.430+0000 7f91db400640 1 --2- 172.21.15.42:0/743866293 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f91c0078bc0 0x7f91c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:36.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.430+0000 7f91db400640 1 -- 172.21.15.42:0/743866293 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 4943+0+0 (secure 0 0 0) 0x7f91dc09af90 con 0x7f91e415f510 2024-09-17T01:48:36.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.431+0000 7f91e2800640 1 --2- 172.21.15.42:0/743866293 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f91c0078bc0 0x7f91c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:36.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.432+0000 7f91e2800640 1 --2- 172.21.15.42:0/743866293 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f91c0078bc0 0x7f91c007b0d0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f91d4034000 tx=0x7f91d4004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:36.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.435+0000 7f91db400640 1 -- 172.21.15.42:0/743866293 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f91dc020020 con 0x7f91e415f510 2024-09-17T01:48:36.663 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.666+0000 7f91e8a00640 1 -- 172.21.15.42:0/743866293 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91e40d1210 con 0x7f91e415f510 2024-09-17T01:48:36.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.666+0000 7f91db400640 1 -- 172.21.15.42:0/743866293 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 161 v161) ==== 95+0+3910 (secure 0 0 0) 0x7f91dc062fe0 con 0x7f91e415f510 2024-09-17T01:48:36.664 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:48:36.664 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":161,"btime":"2024-09-17T01:48:28:872906+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3701245274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3701245274},{"type":"v1","addr":"172.21.15.43:6837","nonce":3701245274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10021,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/8838410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":8838410},{"type":"v1","addr":"172.21.15.42:6834","nonce":8838410}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":10027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3981236009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3981236009},{"type":"v1","addr":"172.21.15.43:6836","nonce":3981236009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":154},{"gid":11085,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/4097749018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":4097749018},{"type":"v1","addr":"172.21.15.42:6835","nonce":4097749018}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":161}],"filesystems":[]} 2024-09-17T01:48:36.665 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 161 2024-09-17T01:48:36.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.668+0000 7f91e8a00640 1 -- 172.21.15.42:0/743866293 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f91c0078bc0 msgr2=0x7f91c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:36.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.669+0000 7f91e8a00640 1 --2- 172.21.15.42:0/743866293 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f91c0078bc0 0x7f91c007b0d0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f91d4034000 tx=0x7f91d4004730 comp rx=0 tx=0).stop 2024-09-17T01:48:36.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.669+0000 7f91e8a00640 1 -- 172.21.15.42:0/743866293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91e415f510 msgr2=0x7f91e40ccdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:36.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.669+0000 7f91e8a00640 1 --2- 172.21.15.42:0/743866293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91e415f510 0x7f91e40ccdf0 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00cb40 tx=0x7f91dc00a060 comp rx=0 tx=0).stop 2024-09-17T01:48:36.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.669+0000 7f91e8a00640 1 -- 172.21.15.42:0/743866293 shutdown_connections 2024-09-17T01:48:36.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.669+0000 7f91e8a00640 1 --2- 172.21.15.42:0/743866293 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f91c0078bc0 0x7f91c007b0d0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.669+0000 7f91e8a00640 1 --2- 172.21.15.42:0/743866293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91e415c7b0 0x7f91e40c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.669+0000 7f91e8a00640 1 --2- 172.21.15.42:0/743866293 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f91e415f510 0x7f91e40ccdf0 unknown :-1 s=CLOSED pgs=2390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.669+0000 7f91e8a00640 1 --2- 172.21.15.42:0/743866293 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f91e40d2830 0x7f91e4159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.669+0000 7f91e8a00640 1 -- 172.21.15.42:0/743866293 >> 172.21.15.42:0/743866293 conn(0x7f91e4073de0 msgr2=0x7f91e415bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:36.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.669+0000 7f91e8a00640 1 -- 172.21.15.42:0/743866293 shutdown_connections 2024-09-17T01:48:36.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:36.669+0000 7f91e8a00640 1 -- 172.21.15.42:0/743866293 wait complete. 2024-09-17T01:48:36.693 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T01:48:36.694 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T01:48:36.694 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T01:48:36.694 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:48:36.694 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T01:48:36.694 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T01:48:36.695 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T01:48:36.695 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:48:36.695 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T01:48:36.695 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T01:48:36.695 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T01:48:36.695 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:48:36.695 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T01:48:36.696 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T01:48:36.696 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T01:48:36.696 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:48:36.720 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T01:48:36.720 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T01:48:36.721 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T01:48:36.721 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T01:48:36.722 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T01:48:36.723 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T01:48:36.723 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T01:48:36.723 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T01:48:36.765 INFO:tasks.ceph.mds.a:Started 2024-09-17T01:48:36.765 DEBUG:teuthology.parallel:result is None 2024-09-17T01:48:36.768 INFO:tasks.ceph.mds.c:Started 2024-09-17T01:48:36.768 INFO:tasks.ceph.mds.b:Started 2024-09-17T01:48:36.768 DEBUG:teuthology.parallel:result is None 2024-09-17T01:48:36.768 DEBUG:teuthology.parallel:result is None 2024-09-17T01:48:36.770 INFO:tasks.ceph.mds.d:Started 2024-09-17T01:48:36.770 DEBUG:teuthology.parallel:result is None 2024-09-17T01:48:36.770 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T01:48:36.967 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:48:36.968 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:48:36.972 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-09-17T01:48:36.973 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-09-17T01:48:37.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.012+0000 7f9b44000640 1 -- 172.21.15.42:0/2380781271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b3c15f5b0 msgr2=0x7f9b3c15f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:37.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.012+0000 7f9b44000640 1 --2- 172.21.15.42:0/2380781271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b3c15f5b0 0x7f9b3c15f9c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f9b34005fd0 tx=0x7f9b3402aa90 comp rx=0 tx=0).stop 2024-09-17T01:48:37.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.012+0000 7f9b44000640 1 -- 172.21.15.42:0/2380781271 shutdown_connections 2024-09-17T01:48:37.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.012+0000 7f9b44000640 1 --2- 172.21.15.42:0/2380781271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b3c15f5b0 0x7f9b3c15f9c0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:37.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.012+0000 7f9b44000640 1 --2- 172.21.15.42:0/2380781271 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9b3c0d0060 0x7f9b3c0b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:37.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.012+0000 7f9b44000640 1 -- 172.21.15.42:0/2380781271 >> 172.21.15.42:0/2380781271 conn(0x7f9b3c0cd540 msgr2=0x7f9b3c0cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:37.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.012+0000 7f9b44000640 1 -- 172.21.15.42:0/2380781271 shutdown_connections 2024-09-17T01:48:37.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.012+0000 7f9b44000640 1 -- 172.21.15.42:0/2380781271 wait complete. 2024-09-17T01:48:37.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.015+0000 7f9b44000640 1 Processor -- start 2024-09-17T01:48:37.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.015+0000 7f9b44000640 1 -- start start 2024-09-17T01:48:37.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.016+0000 7f9b44000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b3c15ca80 0x7f9b3c13c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:37.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.016+0000 7f9b44000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b3c15f5b0 0x7f9b3c13c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:37.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.016+0000 7f9b44000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9b3c14df80 0x7f9b3c0b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:37.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.016+0000 7f9b44000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c071320 con 0x7f9b3c15f5b0 2024-09-17T01:48:37.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.016+0000 7f9b44000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c074780 con 0x7f9b3c15ca80 2024-09-17T01:48:37.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.016+0000 7f9b44000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9b3c0714a0 con 0x7f9b3c14df80 2024-09-17T01:48:37.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.017+0000 7f9b40c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b3c15f5b0 0x7f9b3c13c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:37.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.017+0000 7f9b40c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b3c15f5b0 0x7f9b3c13c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59424/0 (socket says 172.21.15.42:59424) 2024-09-17T01:48:37.016 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.017+0000 7f9b40c00640 1 -- 172.21.15.42:0/2181362114 learned_addr learned my addr 172.21.15.42:0/2181362114 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:37.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.017+0000 7f9b41600640 1 --2- 172.21.15.42:0/2181362114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b3c15ca80 0x7f9b3c13c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:37.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.017+0000 7f9b42000640 1 --2- 172.21.15.42:0/2181362114 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9b3c14df80 0x7f9b3c0b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:37.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.017+0000 7f9b41600640 1 -- 172.21.15.42:0/2181362114 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9b3c14df80 msgr2=0x7f9b3c0b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:37.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.017+0000 7f9b41600640 1 --2- 172.21.15.42:0/2181362114 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9b3c14df80 0x7f9b3c0b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:37.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.017+0000 7f9b41600640 1 -- 172.21.15.42:0/2181362114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b3c15f5b0 msgr2=0x7f9b3c13c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:37.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.017+0000 7f9b41600640 1 --2- 172.21.15.42:0/2181362114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b3c15f5b0 0x7f9b3c13c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:37.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.017+0000 7f9b41600640 1 -- 172.21.15.42:0/2181362114 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3c151620 con 0x7f9b3c15ca80 2024-09-17T01:48:37.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.017+0000 7f9b40c00640 1 --2- 172.21.15.42:0/2181362114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b3c15f5b0 0x7f9b3c13c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:48:37.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.017+0000 7f9b41600640 1 --2- 172.21.15.42:0/2181362114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b3c15ca80 0x7f9b3c13c340 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000c420 tx=0x7f9b3000c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:37.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.018+0000 7f9b39600640 1 -- 172.21.15.42:0/2181362114 <== mon.1 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b30017070 con 0x7f9b3c15ca80 2024-09-17T01:48:37.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.018+0000 7f9b39600640 1 -- 172.21.15.42:0/2181362114 <== mon.1 v2:172.21.15.43:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b300035f0 con 0x7f9b3c15ca80 2024-09-17T01:48:37.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.018+0000 7f9b39600640 1 -- 172.21.15.42:0/2181362114 <== mon.1 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b30003a40 con 0x7f9b3c15ca80 2024-09-17T01:48:37.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.018+0000 7f9b44000640 1 -- 172.21.15.42:0/2181362114 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b3c1518f0 con 0x7f9b3c15ca80 2024-09-17T01:48:37.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.018+0000 7f9b44000640 1 -- 172.21.15.42:0/2181362114 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b3c139f30 con 0x7f9b3c15ca80 2024-09-17T01:48:37.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.019+0000 7f9b44000640 1 -- 172.21.15.42:0/2181362114 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b3c151e10 con 0x7f9b3c15ca80 2024-09-17T01:48:37.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.020+0000 7f9b39600640 1 -- 172.21.15.42:0/2181362114 <== mon.1 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9b3001a070 con 0x7f9b3c15ca80 2024-09-17T01:48:37.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.021+0000 7f9b39600640 1 --2- 172.21.15.42:0/2181362114 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9b1c078bc0 0x7f9b1c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:37.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.021+0000 7f9b39600640 1 -- 172.21.15.42:0/2181362114 <== mon.1 v2:172.21.15.43:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 4943+0+0 (secure 0 0 0) 0x7f9b30099cf0 con 0x7f9b3c15ca80 2024-09-17T01:48:37.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.021+0000 7f9b40c00640 1 --2- 172.21.15.42:0/2181362114 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9b1c078bc0 0x7f9b1c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:37.020 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.022+0000 7f9b40c00640 1 --2- 172.21.15.42:0/2181362114 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9b1c078bc0 0x7f9b1c07b0d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c1688f0 tx=0x7f9b28005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:37.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.026+0000 7f9b39600640 1 -- 172.21.15.42:0/2181362114 <== mon.1 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9b30061e00 con 0x7f9b3c15ca80 2024-09-17T01:48:37.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.233+0000 7f9b44000640 1 -- 172.21.15.42:0/2181362114 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f9b3c0b5710 con 0x7f9b3c15ca80 2024-09-17T01:48:37.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.926+0000 7f9b39600640 1 -- 172.21.15.42:0/2181362114 <== mon.1 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v207) ==== 97+0+0 (secure 0 0 0) 0x7f9b30066830 con 0x7f9b3c15ca80 2024-09-17T01:48:37.924 INFO:teuthology.orchestra.run.smithi042.stderr: removed all blocklist entries 2024-09-17T01:48:37.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.930+0000 7f9b44000640 1 -- 172.21.15.42:0/2181362114 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9b1c078bc0 msgr2=0x7f9b1c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:37.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.930+0000 7f9b44000640 1 --2- 172.21.15.42:0/2181362114 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9b1c078bc0 0x7f9b1c07b0d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c1688f0 tx=0x7f9b28005f90 comp rx=0 tx=0).stop 2024-09-17T01:48:37.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.930+0000 7f9b44000640 1 -- 172.21.15.42:0/2181362114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b3c15ca80 msgr2=0x7f9b3c13c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:37.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.930+0000 7f9b44000640 1 --2- 172.21.15.42:0/2181362114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b3c15ca80 0x7f9b3c13c340 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000c420 tx=0x7f9b3000c820 comp rx=0 tx=0).stop 2024-09-17T01:48:37.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.930+0000 7f9b44000640 1 -- 172.21.15.42:0/2181362114 shutdown_connections 2024-09-17T01:48:37.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.930+0000 7f9b44000640 1 --2- 172.21.15.42:0/2181362114 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9b1c078bc0 0x7f9b1c07b0d0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:37.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.930+0000 7f9b44000640 1 --2- 172.21.15.42:0/2181362114 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9b3c14df80 0x7f9b3c0b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:37.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.930+0000 7f9b44000640 1 --2- 172.21.15.42:0/2181362114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b3c15f5b0 0x7f9b3c13c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:37.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.930+0000 7f9b44000640 1 --2- 172.21.15.42:0/2181362114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b3c15ca80 0x7f9b3c13c340 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:37.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.930+0000 7f9b44000640 1 -- 172.21.15.42:0/2181362114 >> 172.21.15.42:0/2181362114 conn(0x7f9b3c0cd540 msgr2=0x7f9b3c073980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:37.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.930+0000 7f9b44000640 1 -- 172.21.15.42:0/2181362114 shutdown_connections 2024-09-17T01:48:37.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:37.930+0000 7f9b44000640 1 -- 172.21.15.42:0/2181362114 wait complete. 2024-09-17T01:48:37.953 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T01:48:38.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.182+0000 7fcca2400640 1 -- 172.21.15.42:0/1983409713 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc9c152980 msgr2=0x7fcc9c073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:38.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.182+0000 7fcca2400640 1 --2- 172.21.15.42:0/1983409713 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc9c152980 0x7fcc9c073220 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7fcc84005fd0 tx=0x7fcc8402a620 comp rx=0 tx=0).stop 2024-09-17T01:48:38.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.182+0000 7fcca2400640 1 -- 172.21.15.42:0/1983409713 shutdown_connections 2024-09-17T01:48:38.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.182+0000 7fcca2400640 1 --2- 172.21.15.42:0/1983409713 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc9c152980 0x7fcc9c073220 unknown :-1 s=CLOSED pgs=2400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.182+0000 7fcca2400640 1 --2- 172.21.15.42:0/1983409713 >> v2:172.21.15.43:3300/0 conn(0x7fcc9c15c040 0x7fcc9c06fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.182+0000 7fcca2400640 1 -- 172.21.15.42:0/1983409713 >> 172.21.15.42:0/1983409713 conn(0x7fcc9c06d1b0 msgr2=0x7fcc9c06d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:38.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.182+0000 7fcca2400640 1 -- 172.21.15.42:0/1983409713 shutdown_connections 2024-09-17T01:48:38.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.182+0000 7fcca2400640 1 -- 172.21.15.42:0/1983409713 wait complete. 2024-09-17T01:48:38.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.184+0000 7fcca2400640 1 Processor -- start 2024-09-17T01:48:38.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.185+0000 7fcca2400640 1 -- start start 2024-09-17T01:48:38.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.186+0000 7fcca2400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc9c073760 0x7fcc9c142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:38.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.186+0000 7fcca2400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcc9c152980 0x7fcc9c1f7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:38.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.186+0000 7fcca2400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc9c15c040 0x7fcc9c0cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:38.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.186+0000 7fcca2400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9c152f00 con 0x7fcc9c15c040 2024-09-17T01:48:38.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.186+0000 7fcca2400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9c0cdf40 con 0x7fcc9c073760 2024-09-17T01:48:38.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.186+0000 7fcca2400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fcc9c06ede0 con 0x7fcc9c152980 2024-09-17T01:48:38.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.186+0000 7fcc9be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc9c15c040 0x7fcc9c0cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:38.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.186+0000 7fcc9be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc9c15c040 0x7fcc9c0cbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59446/0 (socket says 172.21.15.42:59446) 2024-09-17T01:48:38.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.186+0000 7fcc9be00640 1 -- 172.21.15.42:0/4180906134 learned_addr learned my addr 172.21.15.42:0/4180906134 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:38.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.187+0000 7fcc9b400640 1 --2- 172.21.15.42:0/4180906134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc9c073760 0x7fcc9c142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:38.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.187+0000 7fcc93e00640 1 --2- 172.21.15.42:0/4180906134 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcc9c152980 0x7fcc9c1f7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:38.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.187+0000 7fcc9be00640 1 -- 172.21.15.42:0/4180906134 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcc9c152980 msgr2=0x7fcc9c1f7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:38.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.187+0000 7fcc9be00640 1 --2- 172.21.15.42:0/4180906134 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcc9c152980 0x7fcc9c1f7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.187+0000 7fcc9be00640 1 -- 172.21.15.42:0/4180906134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc9c073760 msgr2=0x7fcc9c142d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:38.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.187+0000 7fcc9be00640 1 --2- 172.21.15.42:0/4180906134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc9c073760 0x7fcc9c142d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.187+0000 7fcc9be00640 1 -- 172.21.15.42:0/4180906134 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc9c143280 con 0x7fcc9c15c040 2024-09-17T01:48:38.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.187+0000 7fcc9b400640 1 --2- 172.21.15.42:0/4180906134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc9c073760 0x7fcc9c142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:38.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.187+0000 7fcc9be00640 1 --2- 172.21.15.42:0/4180906134 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc9c15c040 0x7fcc9c0cbb10 secure :-1 s=READY pgs=2401 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400c6e0 tx=0x7fcc9400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:38.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.187+0000 7fcc93400640 1 -- 172.21.15.42:0/4180906134 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc94003b70 con 0x7fcc9c15c040 2024-09-17T01:48:38.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.187+0000 7fcc93400640 1 -- 172.21.15.42:0/4180906134 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc94003d30 con 0x7fcc9c15c040 2024-09-17T01:48:38.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.187+0000 7fcc93400640 1 -- 172.21.15.42:0/4180906134 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc94005330 con 0x7fcc9c15c040 2024-09-17T01:48:38.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.187+0000 7fcca2400640 1 -- 172.21.15.42:0/4180906134 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc9c1f7c20 con 0x7fcc9c15c040 2024-09-17T01:48:38.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.188+0000 7fcca2400640 1 -- 172.21.15.42:0/4180906134 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc9c0c58f0 con 0x7fcc9c15c040 2024-09-17T01:48:38.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.189+0000 7fcca2400640 1 -- 172.21.15.42:0/4180906134 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc9c072de0 con 0x7fcc9c15c040 2024-09-17T01:48:38.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.191+0000 7fcc93400640 1 -- 172.21.15.42:0/4180906134 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcc940054d0 con 0x7fcc9c15c040 2024-09-17T01:48:38.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.193+0000 7fcc93400640 1 --2- 172.21.15.42:0/4180906134 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcc78078b90 0x7fcc7807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:38.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.193+0000 7fcc93400640 1 -- 172.21.15.42:0/4180906134 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4857+0+0 (secure 0 0 0) 0x7fcc9409a720 con 0x7fcc9c15c040 2024-09-17T01:48:38.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.193+0000 7fcc9b400640 1 --2- 172.21.15.42:0/4180906134 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcc78078b90 0x7fcc7807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:38.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.194+0000 7fcc9b400640 1 --2- 172.21.15.42:0/4180906134 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcc78078b90 0x7fcc7807b0a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c009b80 tx=0x7fcc8c005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:38.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.197+0000 7fcc93400640 1 -- 172.21.15.42:0/4180906134 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcc94062f40 con 0x7fcc9c15c040 2024-09-17T01:48:38.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.460+0000 7fcca2400640 1 -- 172.21.15.42:0/4180906134 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fcc9c1f79b0 con 0x7fcc9c15c040 2024-09-17T01:48:38.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.461+0000 7fcc93400640 1 -- 172.21.15.42:0/4180906134 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v44) ==== 80+0+5304 (secure 0 0 0) 0x7fcc94062840 con 0x7fcc9c15c040 2024-09-17T01:48:38.459 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:48:38.459 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:48:38.459 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_dump": [ 2024-09-17T01:48:38.459 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:48:38.459 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.a", 2024-09-17T01:48:38.459 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmyJK4HRAAIC4E4V7p1fqIEfPIICMxZg==", 2024-09-17T01:48:38.460 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:48:38.460 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:48:38.460 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:48:38.460 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:48:38.460 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:48:38.460 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:48:38.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:48:38.460 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:48:38.460 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.b", 2024-09-17T01:48:38.460 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmXv3vORAALPrYIM6Vtz0g1pOxVhrUig==", 2024-09-17T01:48:38.460 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:48:38.460 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:48:38.461 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:48:38.461 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:48:38.461 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:48:38.461 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:48:38.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:48:38.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:48:38.461 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.c", 2024-09-17T01:48:38.461 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmPE7MKxAA9mGG+EO9C3VGVMerOm92+Q==", 2024-09-17T01:48:38.461 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:48:38.461 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:48:38.461 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:48:38.461 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:48:38.461 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:48:38.462 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:48:38.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:48:38.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:48:38.462 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.d", 2024-09-17T01:48:38.462 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmaOBSDBAATU4tpjM5IMcuvzZFE7N5bQ==", 2024-09-17T01:48:38.462 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:48:38.462 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:48:38.462 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:48:38.462 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:48:38.462 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:48:38.462 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:48:38.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:48:38.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:48:38.463 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.0", 2024-09-17T01:48:38.463 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDP2+hmEJebExAAAdGEoSzM96ybGT9h7t7OkA==", 2024-09-17T01:48:38.463 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:48:38.463 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:48:38.463 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:48:38.463 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:48:38.463 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:48:38.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:48:38.463 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:48:38.463 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.1", 2024-09-17T01:48:38.463 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDS2+hm7dWoMBAAagktrUl0O2/mgKCEfpAstA==", 2024-09-17T01:48:38.463 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:48:38.464 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:48:38.464 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:48:38.464 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:48:38.464 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:48:38.464 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:48:38.464 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:48:38.464 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.2", 2024-09-17T01:48:38.464 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDW2+hmEfSPBBAAPAa6EZt27yUcJSfZyCKheg==", 2024-09-17T01:48:38.464 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:48:38.464 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:48:38.464 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:48:38.464 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:48:38.465 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:48:38.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:48:38.465 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:48:38.465 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.3", 2024-09-17T01:48:38.465 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDZ2+hmHQhXFRAAj84g+IKqH6KMP7LjRtFvLw==", 2024-09-17T01:48:38.465 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:48:38.465 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:48:38.465 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:48:38.465 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:48:38.465 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:48:38.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:48:38.465 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:48:38.465 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.4", 2024-09-17T01:48:38.466 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDd2+hmaNcMNBAAx1GV/oFdfssMjFWFN5M0VQ==", 2024-09-17T01:48:38.466 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:48:38.466 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:48:38.466 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:48:38.466 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:48:38.466 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:48:38.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:48:38.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:48:38.466 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.5", 2024-09-17T01:48:38.466 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDh2+hm301NJhAAnSUH5AAvqhPwM7loH6frww==", 2024-09-17T01:48:38.466 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:48:38.467 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:48:38.467 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:48:38.467 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:48:38.467 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:48:38.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:48:38.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:48:38.467 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.6", 2024-09-17T01:48:38.467 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDk2+hm61WNNRAAbCvVvsUpB4fgt4ja60DRZA==", 2024-09-17T01:48:38.467 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:48:38.467 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:48:38.468 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:48:38.468 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:48:38.468 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:48:38.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:48:38.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:48:38.468 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.7", 2024-09-17T01:48:38.468 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDo2+hmesiLFhAA29n1eageNvP+lkRyh6gGMw==", 2024-09-17T01:48:38.469 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:48:38.469 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:48:38.469 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:48:38.469 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:48:38.469 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:48:38.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:48:38.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:48:38.469 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.0", 2024-09-17T01:48:38.469 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA==", 2024-09-17T01:48:38.469 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:48:38.469 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:48:38.469 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow r", 2024-09-17T01:48:38.469 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T01:48:38.470 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:48:38.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:48:38.470 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:48:38.470 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.1", 2024-09-17T01:48:38.470 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmZLygLhAABlauZgnidFWvfCCPuBLObg==", 2024-09-17T01:48:38.470 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:48:38.470 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:48:38.470 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:48:38.470 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:48:38.470 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:48:38.470 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:48:38.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:48:38.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:48:38.471 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.2", 2024-09-17T01:48:38.471 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hm8lnZIxAAN0a2CVMMtu/Nz50OG4a02A==", 2024-09-17T01:48:38.471 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:48:38.471 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:48:38.471 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:48:38.471 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:48:38.471 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:48:38.471 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:48:38.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:48:38.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:48:38.472 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.3", 2024-09-17T01:48:38.472 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmgXdAORAAM5Uy66I4nnTJ9Vhkn9JoBw==", 2024-09-17T01:48:38.472 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:48:38.472 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:48:38.472 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:48:38.472 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:48:38.472 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:48:38.472 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:48:38.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:48:38.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:48:38.472 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.admin", 2024-09-17T01:48:38.473 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDL2+hmvCreHBAA4CSAhosssViGqD93U+I7Iw==", 2024-09-17T01:48:38.473 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:48:38.473 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:48:38.473 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:48:38.473 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:48:38.473 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:48:38.473 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:48:38.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:48:38.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:48:38.474 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.x", 2024-09-17T01:48:38.474 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmYPnlEhAAIcQ11ktWZyMXYdbAONiLog==", 2024-09-17T01:48:38.474 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:48:38.474 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:48:38.474 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:48:38.474 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:48:38.474 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:48:38.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:48:38.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:48:38.474 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.y", 2024-09-17T01:48:38.474 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmpCZtBxAAp5tXMc6aEq1aOny2LJZAiA==", 2024-09-17T01:48:38.474 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:48:38.474 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:48:38.475 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:48:38.475 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:48:38.475 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:48:38.475 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:48:38.475 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-17T01:48:38.475 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:48:38.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.463+0000 7fcca2400640 1 -- 172.21.15.42:0/4180906134 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcc78078b90 msgr2=0x7fcc7807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:38.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.463+0000 7fcca2400640 1 --2- 172.21.15.42:0/4180906134 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcc78078b90 0x7fcc7807b0a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c009b80 tx=0x7fcc8c005f90 comp rx=0 tx=0).stop 2024-09-17T01:48:38.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.463+0000 7fcca2400640 1 -- 172.21.15.42:0/4180906134 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc9c15c040 msgr2=0x7fcc9c0cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:38.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.463+0000 7fcca2400640 1 --2- 172.21.15.42:0/4180906134 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc9c15c040 0x7fcc9c0cbb10 secure :-1 s=READY pgs=2401 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400c6e0 tx=0x7fcc9400cba0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.463+0000 7fcca2400640 1 -- 172.21.15.42:0/4180906134 shutdown_connections 2024-09-17T01:48:38.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.463+0000 7fcca2400640 1 --2- 172.21.15.42:0/4180906134 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fcc78078b90 0x7fcc7807b0a0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.463+0000 7fcca2400640 1 --2- 172.21.15.42:0/4180906134 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc9c15c040 0x7fcc9c0cbb10 unknown :-1 s=CLOSED pgs=2401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.463+0000 7fcca2400640 1 --2- 172.21.15.42:0/4180906134 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fcc9c152980 0x7fcc9c1f7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.463+0000 7fcca2400640 1 --2- 172.21.15.42:0/4180906134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc9c073760 0x7fcc9c142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.463+0000 7fcca2400640 1 -- 172.21.15.42:0/4180906134 >> 172.21.15.42:0/4180906134 conn(0x7fcc9c06d1b0 msgr2=0x7fcc9c15b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:38.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.463+0000 7fcca2400640 1 -- 172.21.15.42:0/4180906134 shutdown_connections 2024-09-17T01:48:38.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.463+0000 7fcca2400640 1 -- 172.21.15.42:0/4180906134 wait complete. 2024-09-17T01:48:38.483 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T01:48:38.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.714+0000 7fc324e00640 1 -- 172.21.15.42:0/475069942 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc320151cf0 msgr2=0x7fc32015bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:38.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.714+0000 7fc324e00640 1 --2- 172.21.15.42:0/475069942 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc320151cf0 0x7fc32015bb10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc308009830 tx=0x7fc30802a510 comp rx=0 tx=0).stop 2024-09-17T01:48:38.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.715+0000 7fc324e00640 1 -- 172.21.15.42:0/475069942 shutdown_connections 2024-09-17T01:48:38.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.715+0000 7fc324e00640 1 --2- 172.21.15.42:0/475069942 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc320151cf0 0x7fc32015bb10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.715+0000 7fc324e00640 1 --2- 172.21.15.42:0/475069942 >> v2:172.21.15.43:3300/0 conn(0x7fc3200b41b0 0x7fc32015e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.715+0000 7fc324e00640 1 -- 172.21.15.42:0/475069942 >> 172.21.15.42:0/475069942 conn(0x7fc32006d1b0 msgr2=0x7fc32006d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:38.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.715+0000 7fc324e00640 1 -- 172.21.15.42:0/475069942 shutdown_connections 2024-09-17T01:48:38.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.715+0000 7fc324e00640 1 -- 172.21.15.42:0/475069942 wait complete. 2024-09-17T01:48:38.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.717+0000 7fc324e00640 1 Processor -- start 2024-09-17T01:48:38.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.717+0000 7fc324e00640 1 -- start start 2024-09-17T01:48:38.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.718+0000 7fc324e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3200b41b0 0x7fc3201f4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:38.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.718+0000 7fc324e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc320151cf0 0x7fc320146af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:38.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.718+0000 7fc324e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc32015c050 0x7fc3201524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:38.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.718+0000 7fc324e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc320070930 con 0x7fc32015c050 2024-09-17T01:48:38.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.718+0000 7fc324e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc3200707b0 con 0x7fc3200b41b0 2024-09-17T01:48:38.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.718+0000 7fc324e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc3200cd770 con 0x7fc320151cf0 2024-09-17T01:48:38.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.719+0000 7fc31e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc32015c050 0x7fc3201524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:38.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.719+0000 7fc31e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc32015c050 0x7fc3201524b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59456/0 (socket says 172.21.15.42:59456) 2024-09-17T01:48:38.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.719+0000 7fc31e800640 1 -- 172.21.15.42:0/3545335258 learned_addr learned my addr 172.21.15.42:0/3545335258 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:38.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.719+0000 7fc317e00640 1 --2- 172.21.15.42:0/3545335258 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc320151cf0 0x7fc320146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:38.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.719+0000 7fc31de00640 1 --2- 172.21.15.42:0/3545335258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3200b41b0 0x7fc3201f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:38.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.719+0000 7fc31e800640 1 -- 172.21.15.42:0/3545335258 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc320151cf0 msgr2=0x7fc320146af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:38.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.719+0000 7fc31e800640 1 --2- 172.21.15.42:0/3545335258 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc320151cf0 0x7fc320146af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.719+0000 7fc31e800640 1 -- 172.21.15.42:0/3545335258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3200b41b0 msgr2=0x7fc3201f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:38.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.719+0000 7fc31e800640 1 --2- 172.21.15.42:0/3545335258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3200b41b0 0x7fc3201f4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.719+0000 7fc31e800640 1 -- 172.21.15.42:0/3545335258 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc320151290 con 0x7fc32015c050 2024-09-17T01:48:38.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.720+0000 7fc31e800640 1 --2- 172.21.15.42:0/3545335258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc32015c050 0x7fc3201524b0 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7fc31800caa0 tx=0x7fc31800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:38.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.720+0000 7fc316000640 1 -- 172.21.15.42:0/3545335258 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc318016020 con 0x7fc32015c050 2024-09-17T01:48:38.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.720+0000 7fc316000640 1 -- 172.21.15.42:0/3545335258 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc31800acf0 con 0x7fc32015c050 2024-09-17T01:48:38.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.720+0000 7fc324e00640 1 -- 172.21.15.42:0/3545335258 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3201f5220 con 0x7fc32015c050 2024-09-17T01:48:38.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.720+0000 7fc316000640 1 -- 172.21.15.42:0/3545335258 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc318012680 con 0x7fc32015c050 2024-09-17T01:48:38.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.720+0000 7fc324e00640 1 -- 172.21.15.42:0/3545335258 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc320154cd0 con 0x7fc32015c050 2024-09-17T01:48:38.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.721+0000 7fc324e00640 1 -- 172.21.15.42:0/3545335258 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc32015e980 con 0x7fc32015c050 2024-09-17T01:48:38.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.722+0000 7fc316000640 1 -- 172.21.15.42:0/3545335258 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc318019020 con 0x7fc32015c050 2024-09-17T01:48:38.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.723+0000 7fc316000640 1 --2- 172.21.15.42:0/3545335258 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc2fc078b90 0x7fc2fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:38.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.723+0000 7fc316000640 1 -- 172.21.15.42:0/3545335258 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4857+0+0 (secure 0 0 0) 0x7fc31809af00 con 0x7fc32015c050 2024-09-17T01:48:38.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.724+0000 7fc31de00640 1 --2- 172.21.15.42:0/3545335258 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc2fc078b90 0x7fc2fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:38.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.725+0000 7fc31de00640 1 --2- 172.21.15.42:0/3545335258 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc2fc078b90 0x7fc2fc07b0a0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fc3100095f0 tx=0x7fc310005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:38.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.728+0000 7fc316000640 1 -- 172.21.15.42:0/3545335258 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc318020020 con 0x7fc32015c050 2024-09-17T01:48:38.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.923+0000 7fc324e00640 1 -- 172.21.15.42:0/3545335258 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc32015d140 con 0x7fc32015c050 2024-09-17T01:48:38.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.924+0000 7fc316000640 1 -- 172.21.15.42:0/3545335258 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v209) ==== 84+0+65 (secure 0 0 0) 0x7fc32015b390 con 0x7fc32015c050 2024-09-17T01:48:38.922 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:48:38.922 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-09-17T01:48:38.922 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:48:38.922 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-09-17T01:48:38.922 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-09-17T01:48:38.922 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:48:38.922 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-09-17T01:48:38.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.926+0000 7fc324e00640 1 -- 172.21.15.42:0/3545335258 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc2fc078b90 msgr2=0x7fc2fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:38.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.926+0000 7fc324e00640 1 --2- 172.21.15.42:0/3545335258 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc2fc078b90 0x7fc2fc07b0a0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fc3100095f0 tx=0x7fc310005f90 comp rx=0 tx=0).stop 2024-09-17T01:48:38.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.926+0000 7fc324e00640 1 -- 172.21.15.42:0/3545335258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc32015c050 msgr2=0x7fc3201524b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:38.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.926+0000 7fc324e00640 1 --2- 172.21.15.42:0/3545335258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc32015c050 0x7fc3201524b0 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7fc31800caa0 tx=0x7fc31800cf60 comp rx=0 tx=0).stop 2024-09-17T01:48:38.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.926+0000 7fc324e00640 1 -- 172.21.15.42:0/3545335258 shutdown_connections 2024-09-17T01:48:38.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.926+0000 7fc324e00640 1 --2- 172.21.15.42:0/3545335258 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc2fc078b90 0x7fc2fc07b0a0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.926+0000 7fc324e00640 1 --2- 172.21.15.42:0/3545335258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc32015c050 0x7fc3201524b0 unknown :-1 s=CLOSED pgs=2402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.926+0000 7fc324e00640 1 --2- 172.21.15.42:0/3545335258 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc320151cf0 0x7fc320146af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.926+0000 7fc324e00640 1 --2- 172.21.15.42:0/3545335258 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3200b41b0 0x7fc3201f4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:38.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.926+0000 7fc324e00640 1 -- 172.21.15.42:0/3545335258 >> 172.21.15.42:0/3545335258 conn(0x7fc32006d1b0 msgr2=0x7fc32015dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:38.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.926+0000 7fc324e00640 1 -- 172.21.15.42:0/3545335258 shutdown_connections 2024-09-17T01:48:38.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:38.926+0000 7fc324e00640 1 -- 172.21.15.42:0/3545335258 wait complete. 2024-09-17T01:48:38.951 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T01:48:38.951 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T01:48:39.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.185+0000 7f469f000640 1 -- 172.21.15.42:0/1884040331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46980cf7d0 msgr2=0x7f46980cfbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:39.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.185+0000 7f469f000640 1 --2- 172.21.15.42:0/1884040331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46980cf7d0 0x7f46980cfbe0 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 crypto rx=0x7f4680009830 tx=0x7f468002a530 comp rx=0 tx=0).stop 2024-09-17T01:48:39.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.186+0000 7f469f000640 1 -- 172.21.15.42:0/1884040331 shutdown_connections 2024-09-17T01:48:39.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.186+0000 7f469f000640 1 --2- 172.21.15.42:0/1884040331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46980cf7d0 0x7f46980cfbe0 unknown :-1 s=CLOSED pgs=2404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:39.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.186+0000 7f469f000640 1 -- 172.21.15.42:0/1884040331 >> 172.21.15.42:0/1884040331 conn(0x7f469806d420 msgr2=0x7f46980b2430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:39.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.186+0000 7f469f000640 1 -- 172.21.15.42:0/1884040331 shutdown_connections 2024-09-17T01:48:39.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.186+0000 7f469f000640 1 -- 172.21.15.42:0/1884040331 wait complete. 2024-09-17T01:48:39.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.188+0000 7f469f000640 1 Processor -- start 2024-09-17T01:48:39.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.188+0000 7f469f000640 1 -- start start 2024-09-17T01:48:39.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.189+0000 7f469f000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46980b3a40 0x7f469814b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:39.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.189+0000 7f469f000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46980cf7d0 0x7f4698151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:39.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.189+0000 7f469f000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46981608a0 0x7f46981524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:39.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.189+0000 7f469f000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f469806fd10 con 0x7f46981608a0 2024-09-17T01:48:39.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.189+0000 7f469f000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f469806fb90 con 0x7f46980b3a40 2024-09-17T01:48:39.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.189+0000 7f469f000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f469806fe90 con 0x7f46980cf7d0 2024-09-17T01:48:39.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.190+0000 7f469d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46981608a0 0x7f46981524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:39.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.190+0000 7f469d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46981608a0 0x7f46981524b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59486/0 (socket says 172.21.15.42:59486) 2024-09-17T01:48:39.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.190+0000 7f469d000640 1 -- 172.21.15.42:0/47316595 learned_addr learned my addr 172.21.15.42:0/47316595 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:39.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.190+0000 7f468fe00640 1 --2- 172.21.15.42:0/47316595 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46980cf7d0 0x7f4698151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:39.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.190+0000 7f4697e00640 1 --2- 172.21.15.42:0/47316595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46980b3a40 0x7f469814b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:39.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.190+0000 7f469d000640 1 -- 172.21.15.42:0/47316595 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46980cf7d0 msgr2=0x7f4698151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:39.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.190+0000 7f469d000640 1 --2- 172.21.15.42:0/47316595 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46980cf7d0 0x7f4698151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:39.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.190+0000 7f469d000640 1 -- 172.21.15.42:0/47316595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46980b3a40 msgr2=0x7f469814b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:39.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.190+0000 7f469d000640 1 --2- 172.21.15.42:0/47316595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46980b3a40 0x7f469814b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:39.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.190+0000 7f469d000640 1 -- 172.21.15.42:0/47316595 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4698152cd0 con 0x7f46981608a0 2024-09-17T01:48:39.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.191+0000 7f469d000640 1 --2- 172.21.15.42:0/47316595 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46981608a0 0x7f46981524b0 secure :-1 s=READY pgs=2405 cs=0 l=1 rev1=1 crypto rx=0x7f469000c700 tx=0x7f469000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:39.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.191+0000 7f4694c00640 1 -- 172.21.15.42:0/47316595 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4690003b70 con 0x7f46981608a0 2024-09-17T01:48:39.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.191+0000 7f4694c00640 1 -- 172.21.15.42:0/47316595 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4690003d10 con 0x7f46981608a0 2024-09-17T01:48:39.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.191+0000 7f4694c00640 1 -- 172.21.15.42:0/47316595 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469000aab0 con 0x7f46981608a0 2024-09-17T01:48:39.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.191+0000 7f469f000640 1 -- 172.21.15.42:0/47316595 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f469814d6c0 con 0x7f46981608a0 2024-09-17T01:48:39.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.191+0000 7f469f000640 1 -- 172.21.15.42:0/47316595 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f469814dc80 con 0x7f46981608a0 2024-09-17T01:48:39.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.192+0000 7f469f000640 1 -- 172.21.15.42:0/47316595 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4698070340 con 0x7f46981608a0 2024-09-17T01:48:39.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.193+0000 7f4694c00640 1 -- 172.21.15.42:0/47316595 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f469000ac50 con 0x7f46981608a0 2024-09-17T01:48:39.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.194+0000 7f4694c00640 1 --2- 172.21.15.42:0/47316595 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4674078b90 0x7f467407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:39.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.194+0000 7f4694c00640 1 -- 172.21.15.42:0/47316595 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4857+0+0 (secure 0 0 0) 0x7f469009a730 con 0x7f46981608a0 2024-09-17T01:48:39.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.195+0000 7f4697e00640 1 --2- 172.21.15.42:0/47316595 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4674078b90 0x7f467407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:39.193 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.195+0000 7f4697e00640 1 --2- 172.21.15.42:0/47316595 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4674078b90 0x7f467407b0a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f4688000f60 tx=0x7f4688009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:39.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.199+0000 7f4694c00640 1 -- 172.21.15.42:0/47316595 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4690062f40 con 0x7f46981608a0 2024-09-17T01:48:39.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.394+0000 7f469f000640 1 -- 172.21.15.42:0/47316595 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f469815f170 con 0x7f46981608a0 2024-09-17T01:48:39.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.931+0000 7f4694c00640 1 -- 172.21.15.42:0/47316595 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v210) ==== 138+0+0 (secure 0 0 0) 0x7f4690062840 con 0x7f46981608a0 2024-09-17T01:48:39.929 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-09-17T01:48:39.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.934+0000 7f469f000640 1 -- 172.21.15.42:0/47316595 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4674078b90 msgr2=0x7f467407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:39.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.934+0000 7f469f000640 1 --2- 172.21.15.42:0/47316595 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4674078b90 0x7f467407b0a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f4688000f60 tx=0x7f4688009040 comp rx=0 tx=0).stop 2024-09-17T01:48:39.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.934+0000 7f469f000640 1 -- 172.21.15.42:0/47316595 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46981608a0 msgr2=0x7f46981524b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:39.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.934+0000 7f469f000640 1 --2- 172.21.15.42:0/47316595 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46981608a0 0x7f46981524b0 secure :-1 s=READY pgs=2405 cs=0 l=1 rev1=1 crypto rx=0x7f469000c700 tx=0x7f469000cbc0 comp rx=0 tx=0).stop 2024-09-17T01:48:39.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.934+0000 7f469f000640 1 -- 172.21.15.42:0/47316595 shutdown_connections 2024-09-17T01:48:39.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.934+0000 7f469f000640 1 --2- 172.21.15.42:0/47316595 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4674078b90 0x7f467407b0a0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:39.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.934+0000 7f469f000640 1 --2- 172.21.15.42:0/47316595 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f46981608a0 0x7f46981524b0 unknown :-1 s=CLOSED pgs=2405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:39.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.934+0000 7f469f000640 1 --2- 172.21.15.42:0/47316595 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f46980cf7d0 0x7f4698151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:39.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.934+0000 7f469f000640 1 --2- 172.21.15.42:0/47316595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46980b3a40 0x7f469814b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:39.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.934+0000 7f469f000640 1 -- 172.21.15.42:0/47316595 >> 172.21.15.42:0/47316595 conn(0x7f469806d420 msgr2=0x7f4698150650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:39.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.935+0000 7f469f000640 1 -- 172.21.15.42:0/47316595 shutdown_connections 2024-09-17T01:48:39.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:39.935+0000 7f469f000640 1 -- 172.21.15.42:0/47316595 wait complete. 2024-09-17T01:48:39.960 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T01:48:40.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.197+0000 7f0cc6000640 1 -- 172.21.15.42:0/1041396612 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0cc00b51d0 msgr2=0x7f0cc00b55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:40.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.197+0000 7f0cc6000640 1 --2- 172.21.15.42:0/1041396612 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0cc00b51d0 0x7f0cc00b55e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0cac009830 tx=0x7f0cac02a480 comp rx=0 tx=0).stop 2024-09-17T01:48:40.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.197+0000 7f0cc6000640 1 -- 172.21.15.42:0/1041396612 shutdown_connections 2024-09-17T01:48:40.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.197+0000 7f0cc6000640 1 --2- 172.21.15.42:0/1041396612 >> v2:172.21.15.43:3300/0 conn(0x7f0cc01605c0 0x7f0cc01609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:40.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.197+0000 7f0cc6000640 1 --2- 172.21.15.42:0/1041396612 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0cc00b51d0 0x7f0cc00b55e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:40.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.197+0000 7f0cc6000640 1 -- 172.21.15.42:0/1041396612 >> 172.21.15.42:0/1041396612 conn(0x7f0cc006d3f0 msgr2=0x7f0cc00b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:40.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.197+0000 7f0cc6000640 1 -- 172.21.15.42:0/1041396612 shutdown_connections 2024-09-17T01:48:40.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.197+0000 7f0cc6000640 1 -- 172.21.15.42:0/1041396612 wait complete. 2024-09-17T01:48:40.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.199+0000 7f0cc6000640 1 Processor -- start 2024-09-17T01:48:40.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.200+0000 7f0cc6000640 1 -- start start 2024-09-17T01:48:40.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.201+0000 7f0cc6000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0cc00afb00 0x7f0cc013bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:40.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.201+0000 7f0cc6000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0cc00b51d0 0x7f0cc01f7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:40.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.201+0000 7f0cc6000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0cc01605c0 0x7f0cc01f77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:40.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.201+0000 7f0cc6000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc00ce4f0 con 0x7f0cc00afb00 2024-09-17T01:48:40.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.201+0000 7f0cc6000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc00ce370 con 0x7f0cc00b51d0 2024-09-17T01:48:40.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.201+0000 7f0cc6000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc00ce670 con 0x7f0cc01605c0 2024-09-17T01:48:40.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.201+0000 7f0cc4c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0cc00afb00 0x7f0cc013bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:40.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.201+0000 7f0cc4c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0cc00afb00 0x7f0cc013bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59488/0 (socket says 172.21.15.42:59488) 2024-09-17T01:48:40.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.201+0000 7f0cc4c00640 1 -- 172.21.15.42:0/2783701488 learned_addr learned my addr 172.21.15.42:0/2783701488 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:40.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.201+0000 7f0cbfe00640 1 --2- 172.21.15.42:0/2783701488 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0cc00b51d0 0x7f0cc01f7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:40.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.202+0000 7f0cc5600640 1 --2- 172.21.15.42:0/2783701488 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0cc01605c0 0x7f0cc01f77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:40.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.202+0000 7f0cc4c00640 1 -- 172.21.15.42:0/2783701488 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0cc01605c0 msgr2=0x7f0cc01f77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:40.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.202+0000 7f0cc4c00640 1 --2- 172.21.15.42:0/2783701488 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0cc01605c0 0x7f0cc01f77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:40.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.202+0000 7f0cc4c00640 1 -- 172.21.15.42:0/2783701488 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0cc00b51d0 msgr2=0x7f0cc01f7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:40.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.202+0000 7f0cc4c00640 1 --2- 172.21.15.42:0/2783701488 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0cc00b51d0 0x7f0cc01f7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:40.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.202+0000 7f0cc4c00640 1 -- 172.21.15.42:0/2783701488 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc00ab3c0 con 0x7f0cc00afb00 2024-09-17T01:48:40.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.202+0000 7f0cc4c00640 1 --2- 172.21.15.42:0/2783701488 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0cc00afb00 0x7f0cc013bc80 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400c730 tx=0x7f0cb400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:40.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.202+0000 7f0cbcc00640 1 -- 172.21.15.42:0/2783701488 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4016020 con 0x7f0cc00afb00 2024-09-17T01:48:40.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.203+0000 7f0cbcc00640 1 -- 172.21.15.42:0/2783701488 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0cb400a950 con 0x7f0cc00afb00 2024-09-17T01:48:40.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.203+0000 7f0cc6000640 1 -- 172.21.15.42:0/2783701488 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cc00ab660 con 0x7f0cc00afb00 2024-09-17T01:48:40.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.203+0000 7f0cbcc00640 1 -- 172.21.15.42:0/2783701488 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb400ada0 con 0x7f0cc00afb00 2024-09-17T01:48:40.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.203+0000 7f0cc6000640 1 -- 172.21.15.42:0/2783701488 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cc00ad1c0 con 0x7f0cc00afb00 2024-09-17T01:48:40.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.204+0000 7f0cc6000640 1 -- 172.21.15.42:0/2783701488 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cc015a750 con 0x7f0cc00afb00 2024-09-17T01:48:40.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.205+0000 7f0cbcc00640 1 -- 172.21.15.42:0/2783701488 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0cb4019020 con 0x7f0cc00afb00 2024-09-17T01:48:40.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.206+0000 7f0cbcc00640 1 --2- 172.21.15.42:0/2783701488 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0ca0078b90 0x7f0ca007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:40.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.206+0000 7f0cbcc00640 1 -- 172.21.15.42:0/2783701488 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 5227+0+0 (secure 0 0 0) 0x7f0cb409a940 con 0x7f0cc00afb00 2024-09-17T01:48:40.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.207+0000 7f0cbfe00640 1 --2- 172.21.15.42:0/2783701488 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0ca0078b90 0x7f0ca007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:40.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.208+0000 7f0cbfe00640 1 --2- 172.21.15.42:0/2783701488 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0ca0078b90 0x7f0ca007b0a0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f0cac034000 tx=0x7f0cac004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:40.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.211+0000 7f0cbcc00640 1 -- 172.21.15.42:0/2783701488 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0cc015a750 con 0x7f0cc00afb00 2024-09-17T01:48:40.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.406+0000 7f0cc6000640 1 -- 172.21.15.42:0/2783701488 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0cc00b55e0 con 0x7f0cc00afb00 2024-09-17T01:48:40.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.939+0000 7f0cbcc00640 1 -- 172.21.15.42:0/2783701488 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v211) ==== 170+0+0 (secure 0 0 0) 0x7f0cb4020020 con 0x7f0cc00afb00 2024-09-17T01:48:40.937 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-09-17T01:48:40.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.944+0000 7f0cc6000640 1 -- 172.21.15.42:0/2783701488 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0ca0078b90 msgr2=0x7f0ca007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:40.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.944+0000 7f0cc6000640 1 --2- 172.21.15.42:0/2783701488 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0ca0078b90 0x7f0ca007b0a0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f0cac034000 tx=0x7f0cac004730 comp rx=0 tx=0).stop 2024-09-17T01:48:40.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.944+0000 7f0cc6000640 1 -- 172.21.15.42:0/2783701488 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0cc00afb00 msgr2=0x7f0cc013bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:40.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.944+0000 7f0cc6000640 1 --2- 172.21.15.42:0/2783701488 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0cc00afb00 0x7f0cc013bc80 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400c730 tx=0x7f0cb400cbf0 comp rx=0 tx=0).stop 2024-09-17T01:48:40.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.944+0000 7f0cc6000640 1 -- 172.21.15.42:0/2783701488 shutdown_connections 2024-09-17T01:48:40.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.944+0000 7f0cc6000640 1 --2- 172.21.15.42:0/2783701488 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0ca0078b90 0x7f0ca007b0a0 secure :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f0cac034000 tx=0x7f0cac004730 comp rx=0 tx=0).stop 2024-09-17T01:48:40.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.944+0000 7f0cc6000640 1 --2- 172.21.15.42:0/2783701488 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0cc00b51d0 0x7f0cc01f7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:40.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.944+0000 7f0cc6000640 1 --2- 172.21.15.42:0/2783701488 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0cc01605c0 0x7f0cc01f77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:40.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.944+0000 7f0cc6000640 1 --2- 172.21.15.42:0/2783701488 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0cc00afb00 0x7f0cc013bc80 secure :-1 s=CLOSED pgs=2407 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400c730 tx=0x7f0cb400cbf0 comp rx=0 tx=0).stop 2024-09-17T01:48:40.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.944+0000 7f0cc6000640 1 -- 172.21.15.42:0/2783701488 >> 172.21.15.42:0/2783701488 conn(0x7f0cc006d3f0 msgr2=0x7f0cc015b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:40.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.945+0000 7f0cc6000640 1 -- 172.21.15.42:0/2783701488 shutdown_connections 2024-09-17T01:48:40.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:40.947+0000 7f0cc6000640 1 -- 172.21.15.42:0/2783701488 wait complete. 2024-09-17T01:48:40.981 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T01:48:41.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.214+0000 7f16e3e00640 1 -- 172.21.15.42:0/3474530344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16e4071040 msgr2=0x7f16e40ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:41.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.214+0000 7f16e3e00640 1 --2- 172.21.15.42:0/3474530344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16e4071040 0x7f16e40ce020 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7f16d4005fd0 tx=0x7f16d402a670 comp rx=0 tx=0).stop 2024-09-17T01:48:41.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.214+0000 7f16e3e00640 1 -- 172.21.15.42:0/3474530344 shutdown_connections 2024-09-17T01:48:41.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.214+0000 7f16e3e00640 1 --2- 172.21.15.42:0/3474530344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16e4071040 0x7f16e40ce020 unknown :-1 s=CLOSED pgs=2409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:41.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.214+0000 7f16e3e00640 1 -- 172.21.15.42:0/3474530344 >> 172.21.15.42:0/3474530344 conn(0x7f16e40d1580 msgr2=0x7f16e40d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:41.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.214+0000 7f16e3e00640 1 -- 172.21.15.42:0/3474530344 shutdown_connections 2024-09-17T01:48:41.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.214+0000 7f16e3e00640 1 -- 172.21.15.42:0/3474530344 wait complete. 2024-09-17T01:48:41.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.216+0000 7f16e3e00640 1 Processor -- start 2024-09-17T01:48:41.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.216+0000 7f16e3e00640 1 -- start start 2024-09-17T01:48:41.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.218+0000 7f16e3e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16e4071040 0x7f16e415e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:41.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.218+0000 7f16e3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16e415ca30 0x7f16e41537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:41.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.218+0000 7f16e3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16e415e6e0 0x7f16e4153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:41.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.218+0000 7f16e3e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f16e406ff10 con 0x7f16e415ca30 2024-09-17T01:48:41.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.218+0000 7f16e3e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f16e406fd90 con 0x7f16e415e6e0 2024-09-17T01:48:41.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.218+0000 7f16e3e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f16e4070090 con 0x7f16e4071040 2024-09-17T01:48:41.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.218+0000 7f16da000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16e415ca30 0x7f16e41537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:41.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.218+0000 7f16da000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16e415ca30 0x7f16e41537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59500/0 (socket says 172.21.15.42:59500) 2024-09-17T01:48:41.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.218+0000 7f16da000640 1 -- 172.21.15.42:0/3742808651 learned_addr learned my addr 172.21.15.42:0/3742808651 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:41.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.218+0000 7f16e2a00640 1 --2- 172.21.15.42:0/3742808651 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16e4071040 0x7f16e415e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:41.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.218+0000 7f16e3400640 1 --2- 172.21.15.42:0/3742808651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16e415e6e0 0x7f16e4153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:41.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.219+0000 7f16da000640 1 -- 172.21.15.42:0/3742808651 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16e4071040 msgr2=0x7f16e415e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:41.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.219+0000 7f16da000640 1 --2- 172.21.15.42:0/3742808651 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16e4071040 0x7f16e415e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:41.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.219+0000 7f16da000640 1 -- 172.21.15.42:0/3742808651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16e415e6e0 msgr2=0x7f16e4153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:41.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.219+0000 7f16da000640 1 --2- 172.21.15.42:0/3742808651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16e415e6e0 0x7f16e4153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:41.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.219+0000 7f16da000640 1 -- 172.21.15.42:0/3742808651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e41f6990 con 0x7f16e415ca30 2024-09-17T01:48:41.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.219+0000 7f16da000640 1 --2- 172.21.15.42:0/3742808651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16e415ca30 0x7f16e41537c0 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 crypto rx=0x7f16cc00c400 tx=0x7f16cc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:41.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.219+0000 7f16db400640 1 -- 172.21.15.42:0/3742808651 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16cc017070 con 0x7f16e415ca30 2024-09-17T01:48:41.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.219+0000 7f16e3e00640 1 -- 172.21.15.42:0/3742808651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e41f6c30 con 0x7f16e415ca30 2024-09-17T01:48:41.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.219+0000 7f16db400640 1 -- 172.21.15.42:0/3742808651 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16cc0053c0 con 0x7f16e415ca30 2024-09-17T01:48:41.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.219+0000 7f16db400640 1 -- 172.21.15.42:0/3742808651 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16cc003850 con 0x7f16e415ca30 2024-09-17T01:48:41.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.219+0000 7f16e3e00640 1 -- 172.21.15.42:0/3742808651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e41f71f0 con 0x7f16e415ca30 2024-09-17T01:48:41.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.221+0000 7f16e3e00640 1 -- 172.21.15.42:0/3742808651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16e40ce020 con 0x7f16e415ca30 2024-09-17T01:48:41.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.222+0000 7f16db400640 1 -- 172.21.15.42:0/3742808651 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f16cc01a070 con 0x7f16e415ca30 2024-09-17T01:48:41.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.223+0000 7f16db400640 1 --2- 172.21.15.42:0/3742808651 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f16c0078bc0 0x7f16c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:41.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.223+0000 7f16db400640 1 -- 172.21.15.42:0/3742808651 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 5609+0+0 (secure 0 0 0) 0x7f16cc09a4c0 con 0x7f16e415ca30 2024-09-17T01:48:41.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.224+0000 7f16e2a00640 1 --2- 172.21.15.42:0/3742808651 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f16c0078bc0 0x7f16c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:41.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.225+0000 7f16e2a00640 1 --2- 172.21.15.42:0/3742808651 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f16c0078bc0 0x7f16c007b0d0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f16d4033000 tx=0x7f16d4004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:41.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.227+0000 7f16db400640 1 -- 172.21.15.42:0/3742808651 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f16cc021020 con 0x7f16e415ca30 2024-09-17T01:48:41.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.458+0000 7f16e3e00640 1 -- 172.21.15.42:0/3742808651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f16e415eca0 con 0x7f16e415ca30 2024-09-17T01:48:41.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.941+0000 7f16db400640 1 -- 172.21.15.42:0/3742808651 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 30 and data pool 31 v164) ==== 174+0+0 (secure 0 0 0) 0x7f16cc062300 con 0x7f16e415ca30 2024-09-17T01:48:41.939 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 30 and data pool 31 2024-09-17T01:48:41.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.945+0000 7f16e3e00640 1 -- 172.21.15.42:0/3742808651 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f16c0078bc0 msgr2=0x7f16c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:41.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.945+0000 7f16e3e00640 1 --2- 172.21.15.42:0/3742808651 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f16c0078bc0 0x7f16c007b0d0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f16d4033000 tx=0x7f16d4004730 comp rx=0 tx=0).stop 2024-09-17T01:48:41.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.945+0000 7f16e3e00640 1 -- 172.21.15.42:0/3742808651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16e415ca30 msgr2=0x7f16e41537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:41.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.945+0000 7f16e3e00640 1 --2- 172.21.15.42:0/3742808651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16e415ca30 0x7f16e41537c0 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 crypto rx=0x7f16cc00c400 tx=0x7f16cc00c8c0 comp rx=0 tx=0).stop 2024-09-17T01:48:41.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.945+0000 7f16e3e00640 1 -- 172.21.15.42:0/3742808651 shutdown_connections 2024-09-17T01:48:41.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.945+0000 7f16e3e00640 1 --2- 172.21.15.42:0/3742808651 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f16c0078bc0 0x7f16c007b0d0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:41.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.945+0000 7f16e3e00640 1 --2- 172.21.15.42:0/3742808651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16e415e6e0 0x7f16e4153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:41.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.945+0000 7f16e3e00640 1 --2- 172.21.15.42:0/3742808651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f16e415ca30 0x7f16e41537c0 unknown :-1 s=CLOSED pgs=2410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:41.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.945+0000 7f16e3e00640 1 --2- 172.21.15.42:0/3742808651 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f16e4071040 0x7f16e415e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:41.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.945+0000 7f16e3e00640 1 -- 172.21.15.42:0/3742808651 >> 172.21.15.42:0/3742808651 conn(0x7f16e40d1580 msgr2=0x7f16e415bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:41.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.945+0000 7f16e3e00640 1 -- 172.21.15.42:0/3742808651 shutdown_connections 2024-09-17T01:48:41.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:41.946+0000 7f16e3e00640 1 -- 172.21.15.42:0/3742808651 wait complete. 2024-09-17T01:48:41.988 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:48:42.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.216+0000 7efd76000640 1 -- 172.21.15.42:0/2393347418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd70070d70 msgr2=0x7efd700731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:42.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.216+0000 7efd76000640 1 --2- 172.21.15.42:0/2393347418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd70070d70 0x7efd700731e0 secure :-1 s=READY pgs=2411 cs=0 l=1 rev1=1 crypto rx=0x7efd64005fd0 tx=0x7efd6402a540 comp rx=0 tx=0).stop 2024-09-17T01:48:42.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.217+0000 7efd76000640 1 -- 172.21.15.42:0/2393347418 shutdown_connections 2024-09-17T01:48:42.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.217+0000 7efd76000640 1 --2- 172.21.15.42:0/2393347418 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efd700cceb0 0x7efd701603b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:42.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.217+0000 7efd76000640 1 --2- 172.21.15.42:0/2393347418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd70070d70 0x7efd700731e0 unknown :-1 s=CLOSED pgs=2411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:42.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.217+0000 7efd76000640 1 -- 172.21.15.42:0/2393347418 >> 172.21.15.42:0/2393347418 conn(0x7efd700b2430 msgr2=0x7efd700b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:42.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.217+0000 7efd76000640 1 -- 172.21.15.42:0/2393347418 shutdown_connections 2024-09-17T01:48:42.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.217+0000 7efd76000640 1 -- 172.21.15.42:0/2393347418 wait complete. 2024-09-17T01:48:42.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.219+0000 7efd76000640 1 Processor -- start 2024-09-17T01:48:42.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.219+0000 7efd76000640 1 -- start start 2024-09-17T01:48:42.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.221+0000 7efd76000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efd70070d70 0x7efd701f8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:42.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.221+0000 7efd76000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd700cceb0 0x7efd700c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:42.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.221+0000 7efd76000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd701f6480 0x7efd701e71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:42.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.221+0000 7efd76000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7efd7015d4d0 con 0x7efd701f6480 2024-09-17T01:48:42.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.221+0000 7efd76000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7efd70160c50 con 0x7efd700cceb0 2024-09-17T01:48:42.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.221+0000 7efd76000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7efd7015d650 con 0x7efd70070d70 2024-09-17T01:48:42.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.221+0000 7efd75600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd701f6480 0x7efd701e71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:42.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.221+0000 7efd75600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd701f6480 0x7efd701e71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59508/0 (socket says 172.21.15.42:59508) 2024-09-17T01:48:42.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.221+0000 7efd74c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efd70070d70 0x7efd701f8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:42.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.221+0000 7efd75600640 1 -- 172.21.15.42:0/3368244428 learned_addr learned my addr 172.21.15.42:0/3368244428 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:42.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.221+0000 7efd6fe00640 1 --2- 172.21.15.42:0/3368244428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd700cceb0 0x7efd700c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:42.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.221+0000 7efd75600640 1 -- 172.21.15.42:0/3368244428 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efd70070d70 msgr2=0x7efd701f8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:42.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.221+0000 7efd75600640 1 --2- 172.21.15.42:0/3368244428 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efd70070d70 0x7efd701f8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:42.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.221+0000 7efd75600640 1 -- 172.21.15.42:0/3368244428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd700cceb0 msgr2=0x7efd700c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:42.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.221+0000 7efd75600640 1 --2- 172.21.15.42:0/3368244428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd700cceb0 0x7efd700c6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:42.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.221+0000 7efd75600640 1 -- 172.21.15.42:0/3368244428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd700b3b70 con 0x7efd701f6480 2024-09-17T01:48:42.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.222+0000 7efd75600640 1 --2- 172.21.15.42:0/3368244428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd701f6480 0x7efd701e71b0 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7efd6800c6f0 tx=0x7efd6800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:42.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.222+0000 7efd6cc00640 1 -- 172.21.15.42:0/3368244428 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd68003970 con 0x7efd701f6480 2024-09-17T01:48:42.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.222+0000 7efd6cc00640 1 -- 172.21.15.42:0/3368244428 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd68003b10 con 0x7efd701f6480 2024-09-17T01:48:42.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.222+0000 7efd6cc00640 1 -- 172.21.15.42:0/3368244428 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6800a850 con 0x7efd701f6480 2024-09-17T01:48:42.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.222+0000 7efd76000640 1 -- 172.21.15.42:0/3368244428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd700b3e50 con 0x7efd701f6480 2024-09-17T01:48:42.221 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.222+0000 7efd76000640 1 -- 172.21.15.42:0/3368244428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd700b4410 con 0x7efd701f6480 2024-09-17T01:48:42.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.223+0000 7efd76000640 1 -- 172.21.15.42:0/3368244428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd7015db70 con 0x7efd701f6480 2024-09-17T01:48:42.222 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.224+0000 7efd6cc00640 1 -- 172.21.15.42:0/3368244428 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efd6800a9f0 con 0x7efd701f6480 2024-09-17T01:48:42.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.225+0000 7efd6cc00640 1 --2- 172.21.15.42:0/3368244428 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efd50078b90 0x7efd5007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:42.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.226+0000 7efd6cc00640 1 -- 172.21.15.42:0/3368244428 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 5709+0+0 (secure 0 0 0) 0x7efd6809a9b0 con 0x7efd701f6480 2024-09-17T01:48:42.223 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.226+0000 7efd74c00640 1 --2- 172.21.15.42:0/3368244428 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efd50078b90 0x7efd5007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:42.224 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.227+0000 7efd74c00640 1 --2- 172.21.15.42:0/3368244428 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efd50078b90 0x7efd5007b0a0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7efd64033000 tx=0x7efd64004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:42.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.230+0000 7efd6cc00640 1 -- 172.21.15.42:0/3368244428 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efd68062790 con 0x7efd701f6480 2024-09-17T01:48:42.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.427+0000 7efd76000640 1 -- 172.21.15.42:0/3368244428 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd70050f60 con 0x7efd701f6480 2024-09-17T01:48:42.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.428+0000 7efd6cc00640 1 -- 172.21.15.42:0/3368244428 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v212) ==== 74+0+16640 (secure 0 0 0) 0x7efd680671c0 con 0x7efd701f6480 2024-09-17T01:48:42.427 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:48:42.427 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":212,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:48:41.459273+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:48:39.408110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"cephfs_data","create_time":"2024-09-17T01:48:40.420221+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:48:42.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.431+0000 7efd76000640 1 -- 172.21.15.42:0/3368244428 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efd50078b90 msgr2=0x7efd5007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:42.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.431+0000 7efd76000640 1 --2- 172.21.15.42:0/3368244428 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efd50078b90 0x7efd5007b0a0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7efd64033000 tx=0x7efd64004730 comp rx=0 tx=0).stop 2024-09-17T01:48:42.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.431+0000 7efd76000640 1 -- 172.21.15.42:0/3368244428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd701f6480 msgr2=0x7efd701e71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:42.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.431+0000 7efd76000640 1 --2- 172.21.15.42:0/3368244428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd701f6480 0x7efd701e71b0 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7efd6800c6f0 tx=0x7efd6800cbb0 comp rx=0 tx=0).stop 2024-09-17T01:48:42.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.431+0000 7efd76000640 1 -- 172.21.15.42:0/3368244428 shutdown_connections 2024-09-17T01:48:42.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.431+0000 7efd76000640 1 --2- 172.21.15.42:0/3368244428 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efd50078b90 0x7efd5007b0a0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:42.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.431+0000 7efd76000640 1 --2- 172.21.15.42:0/3368244428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efd700cceb0 0x7efd700c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:42.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.431+0000 7efd76000640 1 --2- 172.21.15.42:0/3368244428 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd701f6480 0x7efd701e71b0 unknown :-1 s=CLOSED pgs=2412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:42.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.431+0000 7efd76000640 1 --2- 172.21.15.42:0/3368244428 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7efd70070d70 0x7efd701f8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:42.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.431+0000 7efd76000640 1 -- 172.21.15.42:0/3368244428 >> 172.21.15.42:0/3368244428 conn(0x7efd700b2430 msgr2=0x7efd70153530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:42.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.431+0000 7efd76000640 1 -- 172.21.15.42:0/3368244428 shutdown_connections 2024-09-17T01:48:42.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.432+0000 7efd76000640 1 -- 172.21.15.42:0/3368244428 wait complete. 2024-09-17T01:48:42.457 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:48:42.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.690+0000 7f03e5000640 1 -- 172.21.15.42:0/4151955235 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f03e0074170 msgr2=0x7f03e0074580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:42.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.690+0000 7f03e5000640 1 --2- 172.21.15.42:0/4151955235 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f03e0074170 0x7f03e0074580 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f03c8009830 tx=0x7f03c802a480 comp rx=0 tx=0).stop 2024-09-17T01:48:42.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.690+0000 7f03e5000640 1 -- 172.21.15.42:0/4151955235 shutdown_connections 2024-09-17T01:48:42.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.690+0000 7f03e5000640 1 --2- 172.21.15.42:0/4151955235 >> v2:172.21.15.43:3300/0 conn(0x7f03e00cf900 0x7f03e00cfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:42.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.690+0000 7f03e5000640 1 --2- 172.21.15.42:0/4151955235 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f03e0074170 0x7f03e0074580 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:42.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.690+0000 7f03e5000640 1 -- 172.21.15.42:0/4151955235 >> 172.21.15.42:0/4151955235 conn(0x7f03e00b2430 msgr2=0x7f03e00b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:42.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.690+0000 7f03e5000640 1 -- 172.21.15.42:0/4151955235 shutdown_connections 2024-09-17T01:48:42.689 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.690+0000 7f03e5000640 1 -- 172.21.15.42:0/4151955235 wait complete. 2024-09-17T01:48:42.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.692+0000 7f03e5000640 1 Processor -- start 2024-09-17T01:48:42.690 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.692+0000 7f03e5000640 1 -- start start 2024-09-17T01:48:42.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.694+0000 7f03e5000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03e0074170 0x7f03e01f9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:42.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.694+0000 7f03e5000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03e00cf900 0x7f03e0148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:42.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.694+0000 7f03e5000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f03e0155c10 0x7f03e0145930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:42.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.694+0000 7f03e5000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f03e015cb10 con 0x7f03e0074170 2024-09-17T01:48:42.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.694+0000 7f03e5000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f03e015c990 con 0x7f03e00cf900 2024-09-17T01:48:42.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.694+0000 7f03e5000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f03e00d0250 con 0x7f03e0155c10 2024-09-17T01:48:42.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.694+0000 7f03df400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03e0074170 0x7f03e01f9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:42.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.694+0000 7f03df400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03e0074170 0x7f03e01f9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59510/0 (socket says 172.21.15.42:59510) 2024-09-17T01:48:42.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.694+0000 7f03df400640 1 -- 172.21.15.42:0/1856783758 learned_addr learned my addr 172.21.15.42:0/1856783758 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:42.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.694+0000 7f03d7e00640 1 --2- 172.21.15.42:0/1856783758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03e00cf900 0x7f03e0148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:42.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.694+0000 7f03dfe00640 1 --2- 172.21.15.42:0/1856783758 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f03e0155c10 0x7f03e0145930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:42.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.695+0000 7f03df400640 1 -- 172.21.15.42:0/1856783758 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f03e0155c10 msgr2=0x7f03e0145930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:42.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.695+0000 7f03df400640 1 --2- 172.21.15.42:0/1856783758 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f03e0155c10 0x7f03e0145930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:42.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.695+0000 7f03df400640 1 -- 172.21.15.42:0/1856783758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03e00cf900 msgr2=0x7f03e0148e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:42.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.695+0000 7f03df400640 1 --2- 172.21.15.42:0/1856783758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03e00cf900 0x7f03e0148e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:42.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.695+0000 7f03df400640 1 -- 172.21.15.42:0/1856783758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03e00aee20 con 0x7f03e0074170 2024-09-17T01:48:42.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.695+0000 7f03df400640 1 --2- 172.21.15.42:0/1856783758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03e0074170 0x7f03e01f9820 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 crypto rx=0x7f03d000c3c0 tx=0x7f03d000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:42.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.695+0000 7f03d7400640 1 -- 172.21.15.42:0/1856783758 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d0017070 con 0x7f03e0074170 2024-09-17T01:48:42.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.695+0000 7f03d7400640 1 -- 172.21.15.42:0/1856783758 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03d00035f0 con 0x7f03e0074170 2024-09-17T01:48:42.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.695+0000 7f03e5000640 1 -- 172.21.15.42:0/1856783758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03e0148360 con 0x7f03e0074170 2024-09-17T01:48:42.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.695+0000 7f03d7400640 1 -- 172.21.15.42:0/1856783758 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d0003a80 con 0x7f03e0074170 2024-09-17T01:48:42.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.695+0000 7f03e5000640 1 -- 172.21.15.42:0/1856783758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03e00af3b0 con 0x7f03e0074170 2024-09-17T01:48:42.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.697+0000 7f03e5000640 1 -- 172.21.15.42:0/1856783758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03e00cfd10 con 0x7f03e0074170 2024-09-17T01:48:42.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.698+0000 7f03d7400640 1 -- 172.21.15.42:0/1856783758 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f03d001a070 con 0x7f03e0074170 2024-09-17T01:48:42.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.699+0000 7f03d7400640 1 --2- 172.21.15.42:0/1856783758 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f03bc078b90 0x7f03bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:42.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.699+0000 7f03d7400640 1 -- 172.21.15.42:0/1856783758 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(212..212 src has 1..212) ==== 5709+0+0 (secure 0 0 0) 0x7f03d009a060 con 0x7f03e0074170 2024-09-17T01:48:42.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.699+0000 7f03d7e00640 1 --2- 172.21.15.42:0/1856783758 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f03bc078b90 0x7f03bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:42.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.700+0000 7f03d7e00640 1 --2- 172.21.15.42:0/1856783758 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f03bc078b90 0x7f03bc07b0a0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f03c8034000 tx=0x7f03c8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:42.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.703+0000 7f03d7400640 1 -- 172.21.15.42:0/1856783758 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f03d0061dd0 con 0x7f03e0074170 2024-09-17T01:48:42.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.899+0000 7f03e5000640 1 -- 172.21.15.42:0/1856783758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03e0050f60 con 0x7f03e0074170 2024-09-17T01:48:42.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.900+0000 7f03d7400640 1 -- 172.21.15.42:0/1856783758 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v212) ==== 74+0+16640 (secure 0 0 0) 0x7f03d0066800 con 0x7f03e0074170 2024-09-17T01:48:42.898 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:48:42.899 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":212,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:48:41.459273+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:48:39.408110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"cephfs_data","create_time":"2024-09-17T01:48:40.420221+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:48:42.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.903+0000 7f03e5000640 1 -- 172.21.15.42:0/1856783758 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f03bc078b90 msgr2=0x7f03bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:42.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.903+0000 7f03e5000640 1 --2- 172.21.15.42:0/1856783758 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f03bc078b90 0x7f03bc07b0a0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f03c8034000 tx=0x7f03c8004730 comp rx=0 tx=0).stop 2024-09-17T01:48:42.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.903+0000 7f03e5000640 1 -- 172.21.15.42:0/1856783758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03e0074170 msgr2=0x7f03e01f9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:42.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.903+0000 7f03e5000640 1 --2- 172.21.15.42:0/1856783758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03e0074170 0x7f03e01f9820 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 crypto rx=0x7f03d000c3c0 tx=0x7f03d000c880 comp rx=0 tx=0).stop 2024-09-17T01:48:42.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.903+0000 7f03e5000640 1 -- 172.21.15.42:0/1856783758 shutdown_connections 2024-09-17T01:48:42.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.903+0000 7f03e5000640 1 --2- 172.21.15.42:0/1856783758 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f03bc078b90 0x7f03bc07b0a0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:42.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.903+0000 7f03e5000640 1 --2- 172.21.15.42:0/1856783758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03e00cf900 0x7f03e0148e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:42.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.903+0000 7f03e5000640 1 --2- 172.21.15.42:0/1856783758 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f03e0155c10 0x7f03e0145930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:42.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.903+0000 7f03e5000640 1 --2- 172.21.15.42:0/1856783758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f03e0074170 0x7f03e01f9820 unknown :-1 s=CLOSED pgs=2413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:42.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.903+0000 7f03e5000640 1 -- 172.21.15.42:0/1856783758 >> 172.21.15.42:0/1856783758 conn(0x7f03e00b2430 msgr2=0x7f03e0074580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:42.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.903+0000 7f03e5000640 1 -- 172.21.15.42:0/1856783758 shutdown_connections 2024-09-17T01:48:42.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:42.903+0000 7f03e5000640 1 -- 172.21.15.42:0/1856783758 wait complete. 2024-09-17T01:48:42.927 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T01:48:43.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.162+0000 7f6f17e00640 1 -- 172.21.15.42:0/1795977839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f180cf480 msgr2=0x7f6f180cf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:43.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.162+0000 7f6f17e00640 1 --2- 172.21.15.42:0/1795977839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f180cf480 0x7f6f180cf890 secure :-1 s=READY pgs=2414 cs=0 l=1 rev1=1 crypto rx=0x7f6f1806dc80 tx=0x7f6f1002aa30 comp rx=0 tx=0).stop 2024-09-17T01:48:43.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.162+0000 7f6f17e00640 1 -- 172.21.15.42:0/1795977839 shutdown_connections 2024-09-17T01:48:43.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.162+0000 7f6f17e00640 1 --2- 172.21.15.42:0/1795977839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f180cf480 0x7f6f180cf890 unknown :-1 s=CLOSED pgs=2414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:43.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.162+0000 7f6f17e00640 1 --2- 172.21.15.42:0/1795977839 >> v2:172.21.15.43:3300/0 conn(0x7f6f1815c9f0 0x7f6f1806f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:43.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.162+0000 7f6f17e00640 1 -- 172.21.15.42:0/1795977839 >> 172.21.15.42:0/1795977839 conn(0x7f6f1806d3f0 msgr2=0x7f6f180b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:43.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.162+0000 7f6f17e00640 1 -- 172.21.15.42:0/1795977839 shutdown_connections 2024-09-17T01:48:43.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.162+0000 7f6f17e00640 1 -- 172.21.15.42:0/1795977839 wait complete. 2024-09-17T01:48:43.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.164+0000 7f6f17e00640 1 Processor -- start 2024-09-17T01:48:43.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.165+0000 7f6f17e00640 1 -- start start 2024-09-17T01:48:43.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.166+0000 7f6f17e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f180cf480 0x7f6f180cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:43.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.166+0000 7f6f17e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1815c9f0 0x7f6f181f5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:43.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.166+0000 7f6f17e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f1815fe40 0x7f6f180ae960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:43.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.166+0000 7f6f17e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6f180b4180 con 0x7f6f1815c9f0 2024-09-17T01:48:43.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.166+0000 7f6f17e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6f180b4000 con 0x7f6f180cf480 2024-09-17T01:48:43.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.166+0000 7f6f17e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6f180b4300 con 0x7f6f1815fe40 2024-09-17T01:48:43.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.166+0000 7f6f0e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1815c9f0 0x7f6f181f5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:43.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.166+0000 7f6f0e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1815c9f0 0x7f6f181f5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59524/0 (socket says 172.21.15.42:59524) 2024-09-17T01:48:43.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.166+0000 7f6f0e000640 1 -- 172.21.15.42:0/3336968718 learned_addr learned my addr 172.21.15.42:0/3336968718 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:43.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.166+0000 7f6f16a00640 1 --2- 172.21.15.42:0/3336968718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f180cf480 0x7f6f180cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:43.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.167+0000 7f6f17400640 1 --2- 172.21.15.42:0/3336968718 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f1815fe40 0x7f6f180ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:43.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.167+0000 7f6f0e000640 1 -- 172.21.15.42:0/3336968718 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f1815fe40 msgr2=0x7f6f180ae960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:43.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.167+0000 7f6f0e000640 1 --2- 172.21.15.42:0/3336968718 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f1815fe40 0x7f6f180ae960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:43.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.167+0000 7f6f0e000640 1 -- 172.21.15.42:0/3336968718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f180cf480 msgr2=0x7f6f180cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:43.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.167+0000 7f6f0e000640 1 --2- 172.21.15.42:0/3336968718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f180cf480 0x7f6f180cbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:43.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.167+0000 7f6f0e000640 1 -- 172.21.15.42:0/3336968718 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1814e320 con 0x7f6f1815c9f0 2024-09-17T01:48:43.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.167+0000 7f6f16a00640 1 --2- 172.21.15.42:0/3336968718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f180cf480 0x7f6f180cbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:43.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.167+0000 7f6f0e000640 1 --2- 172.21.15.42:0/3336968718 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1815c9f0 0x7f6f181f5a60 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000c400 tx=0x7f6f0000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:43.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.167+0000 7f6f0f400640 1 -- 172.21.15.42:0/3336968718 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f00017070 con 0x7f6f1815c9f0 2024-09-17T01:48:43.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.167+0000 7f6f0f400640 1 -- 172.21.15.42:0/3336968718 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f000053c0 con 0x7f6f1815c9f0 2024-09-17T01:48:43.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.167+0000 7f6f0f400640 1 -- 172.21.15.42:0/3336968718 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f00003850 con 0x7f6f1815c9f0 2024-09-17T01:48:43.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.167+0000 7f6f17e00640 1 -- 172.21.15.42:0/3336968718 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f181f6710 con 0x7f6f1815c9f0 2024-09-17T01:48:43.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.167+0000 7f6f17e00640 1 -- 172.21.15.42:0/3336968718 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f181f94a0 con 0x7f6f1815c9f0 2024-09-17T01:48:43.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.168+0000 7f6f17e00640 1 -- 172.21.15.42:0/3336968718 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f180cf890 con 0x7f6f1815c9f0 2024-09-17T01:48:43.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.170+0000 7f6f0f400640 1 -- 172.21.15.42:0/3336968718 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6f0001a070 con 0x7f6f1815c9f0 2024-09-17T01:48:43.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.171+0000 7f6f0f400640 1 --2- 172.21.15.42:0/3336968718 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6ef4078b90 0x7f6ef407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:43.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.171+0000 7f6f0f400640 1 -- 172.21.15.42:0/3336968718 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(213..213 src has 1..213) ==== 5709+0+0 (secure 0 0 0) 0x7f6f0009a0c0 con 0x7f6f1815c9f0 2024-09-17T01:48:43.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.171+0000 7f6f16a00640 1 --2- 172.21.15.42:0/3336968718 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6ef4078b90 0x7f6ef407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:43.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.172+0000 7f6f16a00640 1 --2- 172.21.15.42:0/3336968718 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6ef4078b90 0x7f6ef407b0a0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f6f08005fd0 tx=0x7f6f0800f360 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:43.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.175+0000 7f6f0f400640 1 -- 172.21.15.42:0/3336968718 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6f1814e320 con 0x7f6f1815c9f0 2024-09-17T01:48:43.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.407+0000 7f6f17e00640 1 -- 172.21.15.42:0/3336968718 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6f181f64a0 con 0x7f6f1815c9f0 2024-09-17T01:48:43.933 INFO:tasks.ceph.mds.b.smithi043.stderr:2024-09-17T01:48:43.935+0000 7f5d02e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:48:43.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.967+0000 7f6f0f400640 1 -- 172.21.15.42:0/3336968718 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v167) ==== 118+0+0 (secure 0 0 0) 0x7f6f180cfdd0 con 0x7f6f1815c9f0 2024-09-17T01:48:43.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.970+0000 7f6f17e00640 1 -- 172.21.15.42:0/3336968718 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6ef4078b90 msgr2=0x7f6ef407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:43.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.970+0000 7f6f17e00640 1 --2- 172.21.15.42:0/3336968718 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6ef4078b90 0x7f6ef407b0a0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f6f08005fd0 tx=0x7f6f0800f360 comp rx=0 tx=0).stop 2024-09-17T01:48:43.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.970+0000 7f6f17e00640 1 -- 172.21.15.42:0/3336968718 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1815c9f0 msgr2=0x7f6f181f5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:43.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.970+0000 7f6f17e00640 1 --2- 172.21.15.42:0/3336968718 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1815c9f0 0x7f6f181f5a60 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000c400 tx=0x7f6f0000c8c0 comp rx=0 tx=0).stop 2024-09-17T01:48:43.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.970+0000 7f6f17e00640 1 -- 172.21.15.42:0/3336968718 shutdown_connections 2024-09-17T01:48:43.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.970+0000 7f6f17e00640 1 --2- 172.21.15.42:0/3336968718 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6ef4078b90 0x7f6ef407b0a0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:43.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.970+0000 7f6f17e00640 1 --2- 172.21.15.42:0/3336968718 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f1815fe40 0x7f6f180ae960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:43.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.970+0000 7f6f17e00640 1 --2- 172.21.15.42:0/3336968718 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f1815c9f0 0x7f6f181f5a60 unknown :-1 s=CLOSED pgs=2415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:43.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.970+0000 7f6f17e00640 1 --2- 172.21.15.42:0/3336968718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f180cf480 0x7f6f180cbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:43.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.970+0000 7f6f17e00640 1 -- 172.21.15.42:0/3336968718 >> 172.21.15.42:0/3336968718 conn(0x7f6f1806d3f0 msgr2=0x7f6f180b5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:43.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.971+0000 7f6f17e00640 1 -- 172.21.15.42:0/3336968718 shutdown_connections 2024-09-17T01:48:43.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:43.971+0000 7f6f17e00640 1 -- 172.21.15.42:0/3336968718 wait complete. 2024-09-17T01:48:43.998 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T01:48:43.998 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T01:48:44.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.233+0000 7f17b2400640 1 -- 172.21.15.42:0/3594033263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17ac0709b0 msgr2=0x7f17ac0b4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:44.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.233+0000 7f17b2400640 1 --2- 172.21.15.42:0/3594033263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17ac0709b0 0x7f17ac0b4630 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f17a4005fd0 tx=0x7f17a402a7a0 comp rx=0 tx=0).stop 2024-09-17T01:48:44.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.233+0000 7f17b2400640 1 -- 172.21.15.42:0/3594033263 shutdown_connections 2024-09-17T01:48:44.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.233+0000 7f17b2400640 1 --2- 172.21.15.42:0/3594033263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17ac0709b0 0x7f17ac0b4630 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:44.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.233+0000 7f17b2400640 1 --2- 172.21.15.42:0/3594033263 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17ac0b58c0 0x7f17ac15b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:44.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.233+0000 7f17b2400640 1 -- 172.21.15.42:0/3594033263 >> 172.21.15.42:0/3594033263 conn(0x7f17ac0d1580 msgr2=0x7f17ac0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:44.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.233+0000 7f17b2400640 1 -- 172.21.15.42:0/3594033263 shutdown_connections 2024-09-17T01:48:44.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.233+0000 7f17b2400640 1 -- 172.21.15.42:0/3594033263 wait complete. 2024-09-17T01:48:44.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.235+0000 7f17b2400640 1 Processor -- start 2024-09-17T01:48:44.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.236+0000 7f17b2400640 1 -- start start 2024-09-17T01:48:44.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.237+0000 7f17b2400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17ac0709b0 0x7f17ac14f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:44.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.237+0000 7f17b2400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17ac0ce6f0 0x7f17ac159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:44.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.237+0000 7f17b2400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17ac159d80 0x7f17ac068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:44.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.237+0000 7f17b2400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac06dd20 con 0x7f17ac0ce6f0 2024-09-17T01:48:44.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.237+0000 7f17b2400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac06dba0 con 0x7f17ac159d80 2024-09-17T01:48:44.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.237+0000 7f17b2400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f17ac06dea0 con 0x7f17ac0709b0 2024-09-17T01:48:44.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.237+0000 7f17abe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17ac0ce6f0 0x7f17ac159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:44.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.237+0000 7f17abe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17ac0ce6f0 0x7f17ac159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59530/0 (socket says 172.21.15.42:59530) 2024-09-17T01:48:44.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.237+0000 7f17abe00640 1 -- 172.21.15.42:0/3010698257 learned_addr learned my addr 172.21.15.42:0/3010698257 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:44.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.238+0000 7f17b1a00640 1 --2- 172.21.15.42:0/3010698257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17ac159d80 0x7f17ac068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:44.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.238+0000 7f17b1000640 1 --2- 172.21.15.42:0/3010698257 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17ac0709b0 0x7f17ac14f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:44.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.238+0000 7f17abe00640 1 -- 172.21.15.42:0/3010698257 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17ac0709b0 msgr2=0x7f17ac14f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:44.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.238+0000 7f17abe00640 1 --2- 172.21.15.42:0/3010698257 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17ac0709b0 0x7f17ac14f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:44.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.238+0000 7f17abe00640 1 -- 172.21.15.42:0/3010698257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17ac159d80 msgr2=0x7f17ac068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:44.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.238+0000 7f17abe00640 1 --2- 172.21.15.42:0/3010698257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17ac159d80 0x7f17ac068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:44.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.238+0000 7f17abe00640 1 -- 172.21.15.42:0/3010698257 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ac0b04e0 con 0x7f17ac0ce6f0 2024-09-17T01:48:44.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.238+0000 7f17abe00640 1 --2- 172.21.15.42:0/3010698257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17ac0ce6f0 0x7f17ac159840 secure :-1 s=READY pgs=2417 cs=0 l=1 rev1=1 crypto rx=0x7f179800e9f0 tx=0x7f179800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.238+0000 7f17a8c00640 1 -- 172.21.15.42:0/3010698257 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179800cd80 con 0x7f17ac0ce6f0 2024-09-17T01:48:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.238+0000 7f17a8c00640 1 -- 172.21.15.42:0/3010698257 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1798004020 con 0x7f17ac0ce6f0 2024-09-17T01:48:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.238+0000 7f17a8c00640 1 -- 172.21.15.42:0/3010698257 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1798004470 con 0x7f17ac0ce6f0 2024-09-17T01:48:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.238+0000 7f17b2400640 1 -- 172.21.15.42:0/3010698257 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17ac0af440 con 0x7f17ac0ce6f0 2024-09-17T01:48:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.239+0000 7f17b2400640 1 -- 172.21.15.42:0/3010698257 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17ac0afa00 con 0x7f17ac0ce6f0 2024-09-17T01:48:44.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.240+0000 7f17b2400640 1 -- 172.21.15.42:0/3010698257 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17ac06e370 con 0x7f17ac0ce6f0 2024-09-17T01:48:44.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.241+0000 7f17a8c00640 1 -- 172.21.15.42:0/3010698257 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f17980035f0 con 0x7f17ac0ce6f0 2024-09-17T01:48:44.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.242+0000 7f17a8c00640 1 --2- 172.21.15.42:0/3010698257 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f178c078b90 0x7f178c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:44.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.242+0000 7f17a8c00640 1 -- 172.21.15.42:0/3010698257 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(213..213 src has 1..213) ==== 5709+0+0 (secure 0 0 0) 0x7f179809b770 con 0x7f17ac0ce6f0 2024-09-17T01:48:44.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.242+0000 7f17b1000640 1 --2- 172.21.15.42:0/3010698257 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f178c078b90 0x7f178c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:44.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.243+0000 7f17b1000640 1 --2- 172.21.15.42:0/3010698257 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f178c078b90 0x7f178c07b0a0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f17a0001eb0 tx=0x7f17a0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:44.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.246+0000 7f17a8c00640 1 -- 172.21.15.42:0/3010698257 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1798063b10 con 0x7f17ac0ce6f0 2024-09-17T01:48:44.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.477+0000 7f17b2400640 1 -- 172.21.15.42:0/3010698257 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f17ac155630 con 0x7f17ac0ce6f0 2024-09-17T01:48:44.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.969+0000 7f17a8c00640 1 -- 172.21.15.42:0/3010698257 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v168) ==== 122+0+0 (secure 0 0 0) 0x7f1798063410 con 0x7f17ac0ce6f0 2024-09-17T01:48:44.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.972+0000 7f17b2400640 1 -- 172.21.15.42:0/3010698257 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f178c078b90 msgr2=0x7f178c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:44.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.972+0000 7f17b2400640 1 --2- 172.21.15.42:0/3010698257 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f178c078b90 0x7f178c07b0a0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f17a0001eb0 tx=0x7f17a0009040 comp rx=0 tx=0).stop 2024-09-17T01:48:44.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.972+0000 7f17b2400640 1 -- 172.21.15.42:0/3010698257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17ac0ce6f0 msgr2=0x7f17ac159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:44.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.972+0000 7f17b2400640 1 --2- 172.21.15.42:0/3010698257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17ac0ce6f0 0x7f17ac159840 secure :-1 s=READY pgs=2417 cs=0 l=1 rev1=1 crypto rx=0x7f179800e9f0 tx=0x7f179800eeb0 comp rx=0 tx=0).stop 2024-09-17T01:48:44.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.972+0000 7f17b2400640 1 -- 172.21.15.42:0/3010698257 shutdown_connections 2024-09-17T01:48:44.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.972+0000 7f17b2400640 1 --2- 172.21.15.42:0/3010698257 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f178c078b90 0x7f178c07b0a0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:44.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.972+0000 7f17b2400640 1 --2- 172.21.15.42:0/3010698257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17ac159d80 0x7f17ac068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:44.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.972+0000 7f17b2400640 1 --2- 172.21.15.42:0/3010698257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17ac0ce6f0 0x7f17ac159840 unknown :-1 s=CLOSED pgs=2417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:44.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.972+0000 7f17b2400640 1 --2- 172.21.15.42:0/3010698257 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f17ac0709b0 0x7f17ac14f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:44.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.972+0000 7f17b2400640 1 -- 172.21.15.42:0/3010698257 >> 172.21.15.42:0/3010698257 conn(0x7f17ac0d1580 msgr2=0x7f17ac0698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:44.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.972+0000 7f17b2400640 1 -- 172.21.15.42:0/3010698257 shutdown_connections 2024-09-17T01:48:44.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:44.972+0000 7f17b2400640 1 -- 172.21.15.42:0/3010698257 wait complete. 2024-09-17T01:48:45.000 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T01:48:45.000 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:48:45.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.230+0000 7f8575600640 1 -- 172.21.15.42:0/1696188703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8554004800 msgr2=0x7f8554004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:45.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.230+0000 7f8575600640 1 --2- 172.21.15.42:0/1696188703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8554004800 0x7f8554004c10 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7f85580016c0 tx=0x7f8554005830 comp rx=0 tx=0).stop 2024-09-17T01:48:45.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.230+0000 7f8575600640 1 -- 172.21.15.42:0/1696188703 shutdown_connections 2024-09-17T01:48:45.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.230+0000 7f8575600640 1 --2- 172.21.15.42:0/1696188703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8554004800 0x7f8554004c10 unknown :-1 s=CLOSED pgs=2419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.230+0000 7f8575600640 1 -- 172.21.15.42:0/1696188703 >> 172.21.15.42:0/1696188703 conn(0x7f857006d3f0 msgr2=0x7f85700b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:45.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.230+0000 7f8575600640 1 -- 172.21.15.42:0/1696188703 shutdown_connections 2024-09-17T01:48:45.229 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.231+0000 7f8575600640 1 -- 172.21.15.42:0/1696188703 wait complete. 2024-09-17T01:48:45.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.233+0000 7f8575600640 1 Processor -- start 2024-09-17T01:48:45.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.233+0000 7f8575600640 1 -- start start 2024-09-17T01:48:45.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.234+0000 7f8575600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8554004800 0x7f85701f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:45.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.234+0000 7f8575600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f85700b0190 0x7f85700b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:45.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.234+0000 7f8575600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85700b0ae0 0x7f8570142af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:45.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.234+0000 7f8575600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f857006e200 con 0x7f8554004800 2024-09-17T01:48:45.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.234+0000 7f8575600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f857006fca0 con 0x7f85700b0ae0 2024-09-17T01:48:45.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.234+0000 7f8575600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f857006e380 con 0x7f85700b0190 2024-09-17T01:48:45.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.235+0000 7f856fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8554004800 0x7f85701f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:45.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.235+0000 7f856fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8554004800 0x7f85701f4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59558/0 (socket says 172.21.15.42:59558) 2024-09-17T01:48:45.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.235+0000 7f856fe00640 1 -- 172.21.15.42:0/3604090038 learned_addr learned my addr 172.21.15.42:0/3604090038 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:45.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.235+0000 7f8567400640 1 --2- 172.21.15.42:0/3604090038 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f85700b0190 0x7f85700b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:45.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.235+0000 7f8574c00640 1 --2- 172.21.15.42:0/3604090038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85700b0ae0 0x7f8570142af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:45.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.235+0000 7f856fe00640 1 -- 172.21.15.42:0/3604090038 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f85700b0190 msgr2=0x7f85700b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:45.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.235+0000 7f856fe00640 1 --2- 172.21.15.42:0/3604090038 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f85700b0190 0x7f85700b05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.235+0000 7f856fe00640 1 -- 172.21.15.42:0/3604090038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85700b0ae0 msgr2=0x7f8570142af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:45.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.235+0000 7f856fe00640 1 --2- 172.21.15.42:0/3604090038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85700b0ae0 0x7f8570142af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.235+0000 7f856fe00640 1 -- 172.21.15.42:0/3604090038 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85701e6dc0 con 0x7f8554004800 2024-09-17T01:48:45.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.235+0000 7f856fe00640 1 --2- 172.21.15.42:0/3604090038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8554004800 0x7f85701f4fa0 secure :-1 s=READY pgs=2420 cs=0 l=1 rev1=1 crypto rx=0x7f8560011ae0 tx=0x7f8560009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:45.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.235+0000 7f856cc00640 1 -- 172.21.15.42:0/3604090038 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856000fcb0 con 0x7f8554004800 2024-09-17T01:48:45.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.236+0000 7f856cc00640 1 -- 172.21.15.42:0/3604090038 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f856000fe50 con 0x7f8554004800 2024-09-17T01:48:45.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.236+0000 7f856cc00640 1 -- 172.21.15.42:0/3604090038 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560004280 con 0x7f8554004800 2024-09-17T01:48:45.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.236+0000 7f8575600640 1 -- 172.21.15.42:0/3604090038 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85700b1240 con 0x7f8554004800 2024-09-17T01:48:45.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.236+0000 7f8575600640 1 -- 172.21.15.42:0/3604090038 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85700b1800 con 0x7f8554004800 2024-09-17T01:48:45.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.237+0000 7f8575600640 1 -- 172.21.15.42:0/3604090038 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f857006e890 con 0x7f8554004800 2024-09-17T01:48:45.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.238+0000 7f856cc00640 1 -- 172.21.15.42:0/3604090038 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f85600035f0 con 0x7f8554004800 2024-09-17T01:48:45.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.239+0000 7f856cc00640 1 --2- 172.21.15.42:0/3604090038 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f854c078bc0 0x7f854c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:45.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.239+0000 7f856cc00640 1 -- 172.21.15.42:0/3604090038 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(213..213 src has 1..213) ==== 5709+0+0 (secure 0 0 0) 0x7f856009b7d0 con 0x7f8554004800 2024-09-17T01:48:45.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.240+0000 7f8567400640 1 --2- 172.21.15.42:0/3604090038 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f854c078bc0 0x7f854c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:45.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.241+0000 7f8567400640 1 --2- 172.21.15.42:0/3604090038 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f854c078bc0 0x7f854c07b0d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f8558032000 tx=0x7f8558001190 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:45.241 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.244+0000 7f856cc00640 1 -- 172.21.15.42:0/3604090038 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8560063ca0 con 0x7f8554004800 2024-09-17T01:48:45.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.477+0000 7f8575600640 1 -- 172.21.15.42:0/3604090038 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85700b5760 con 0x7f8554004800 2024-09-17T01:48:45.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.478+0000 7f856cc00640 1 -- 172.21.15.42:0/3604090038 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 168 v168) ==== 95+0+5238 (secure 0 0 0) 0x7f85600635a0 con 0x7f8554004800 2024-09-17T01:48:45.476 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:48:45.476 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":168,"btime":"2024-09-17T01:48:44:968283+0000","default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/2828763381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2828763381},{"type":"v1","addr":"172.21.15.42:6834","nonce":2828763381}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":162},{"gid":10357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2652584517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2652584517},{"type":"v1","addr":"172.21.15.43:6837","nonce":2652584517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":163},{"gid":11190,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3512646002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3512646002},{"type":"v1","addr":"172.21.15.42:6835","nonce":3512646002}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":163}],"filesystems":[{"mdsmap":{"epoch":168,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:48:41.459234+0000","modified":"2024-09-17T01:48:44.478983+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11193":{"gid":11193,"name":"b","rank":0,"incarnation":164,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6836/777529944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":777529944},{"type":"v1","addr":"172.21.15.43:6836","nonce":777529944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11193,"qdb_cluster":[11193]},"id":15}]} 2024-09-17T01:48:45.476 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 168 2024-09-17T01:48:45.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.480+0000 7f8575600640 1 -- 172.21.15.42:0/3604090038 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f854c078bc0 msgr2=0x7f854c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:45.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.480+0000 7f8575600640 1 --2- 172.21.15.42:0/3604090038 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f854c078bc0 0x7f854c07b0d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f8558032000 tx=0x7f8558001190 comp rx=0 tx=0).stop 2024-09-17T01:48:45.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.480+0000 7f8575600640 1 -- 172.21.15.42:0/3604090038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8554004800 msgr2=0x7f85701f4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:45.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.480+0000 7f8575600640 1 --2- 172.21.15.42:0/3604090038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8554004800 0x7f85701f4fa0 secure :-1 s=READY pgs=2420 cs=0 l=1 rev1=1 crypto rx=0x7f8560011ae0 tx=0x7f8560009f10 comp rx=0 tx=0).stop 2024-09-17T01:48:45.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.480+0000 7f8575600640 1 -- 172.21.15.42:0/3604090038 shutdown_connections 2024-09-17T01:48:45.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.480+0000 7f8575600640 1 --2- 172.21.15.42:0/3604090038 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f854c078bc0 0x7f854c07b0d0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.480+0000 7f8575600640 1 --2- 172.21.15.42:0/3604090038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85700b0ae0 0x7f8570142af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.480+0000 7f8575600640 1 --2- 172.21.15.42:0/3604090038 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f85700b0190 0x7f85700b05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.480+0000 7f8575600640 1 --2- 172.21.15.42:0/3604090038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8554004800 0x7f85701f4fa0 unknown :-1 s=CLOSED pgs=2420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.480+0000 7f8575600640 1 -- 172.21.15.42:0/3604090038 >> 172.21.15.42:0/3604090038 conn(0x7f857006d3f0 msgr2=0x7f85700b4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:45.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.480+0000 7f8575600640 1 -- 172.21.15.42:0/3604090038 shutdown_connections 2024-09-17T01:48:45.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.480+0000 7f8575600640 1 -- 172.21.15.42:0/3604090038 wait complete. 2024-09-17T01:48:45.505 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:48:45.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.734+0000 7fbe01200640 1 -- 172.21.15.42:0/249072554 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdfc160c30 msgr2=0x7fbdfc0ced80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:45.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.734+0000 7fbe01200640 1 --2- 172.21.15.42:0/249072554 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdfc160c30 0x7fbdfc0ced80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4005fd0 tx=0x7fbdf402a8a0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.735+0000 7fbe01200640 1 -- 172.21.15.42:0/249072554 shutdown_connections 2024-09-17T01:48:45.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.735+0000 7fbe01200640 1 --2- 172.21.15.42:0/249072554 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdfc160c30 0x7fbdfc0ced80 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.735+0000 7fbe01200640 1 --2- 172.21.15.42:0/249072554 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbdfc161210 0x7fbdfc0afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.735+0000 7fbe01200640 1 -- 172.21.15.42:0/249072554 >> 172.21.15.42:0/249072554 conn(0x7fbdfc06d3f0 msgr2=0x7fbdfc0b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:45.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.735+0000 7fbe01200640 1 -- 172.21.15.42:0/249072554 shutdown_connections 2024-09-17T01:48:45.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.735+0000 7fbe01200640 1 -- 172.21.15.42:0/249072554 wait complete. 2024-09-17T01:48:45.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.737+0000 7fbe01200640 1 Processor -- start 2024-09-17T01:48:45.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.737+0000 7fbe01200640 1 -- start start 2024-09-17T01:48:45.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.738+0000 7fbe01200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbdfc0b2bb0 0x7fbdfc143cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:45.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.738+0000 7fbe01200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdfc161210 0x7fbdfc1fdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:45.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.738+0000 7fbe01200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbdfc1fe160 0x7fbdfc15f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:45.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.739+0000 7fbe01200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbdfc0cf4d0 con 0x7fbdfc1fe160 2024-09-17T01:48:45.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.739+0000 7fbe01200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbdfc0b3160 con 0x7fbdfc161210 2024-09-17T01:48:45.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.739+0000 7fbe01200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbdfc0cf650 con 0x7fbdfc0b2bb0 2024-09-17T01:48:45.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.739+0000 7fbdfbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbdfc1fe160 0x7fbdfc15f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:45.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.739+0000 7fbdfbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbdfc1fe160 0x7fbdfc15f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59564/0 (socket says 172.21.15.42:59564) 2024-09-17T01:48:45.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.739+0000 7fbdfbe00640 1 -- 172.21.15.42:0/1816636209 learned_addr learned my addr 172.21.15.42:0/1816636209 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:45.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.739+0000 7fbdfb400640 1 --2- 172.21.15.42:0/1816636209 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbdfc0b2bb0 0x7fbdfc143cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:45.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.739+0000 7fbdf2a00640 1 --2- 172.21.15.42:0/1816636209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdfc161210 0x7fbdfc1fdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:45.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.739+0000 7fbdfbe00640 1 -- 172.21.15.42:0/1816636209 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbdfc0b2bb0 msgr2=0x7fbdfc143cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:45.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.739+0000 7fbdfbe00640 1 --2- 172.21.15.42:0/1816636209 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbdfc0b2bb0 0x7fbdfc143cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.739+0000 7fbdfbe00640 1 -- 172.21.15.42:0/1816636209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdfc161210 msgr2=0x7fbdfc1fdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:45.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.739+0000 7fbdfbe00640 1 --2- 172.21.15.42:0/1816636209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdfc161210 0x7fbdfc1fdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.739+0000 7fbdfbe00640 1 -- 172.21.15.42:0/1816636209 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdfc13f4b0 con 0x7fbdfc1fe160 2024-09-17T01:48:45.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.740+0000 7fbdfbe00640 1 --2- 172.21.15.42:0/1816636209 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbdfc1fe160 0x7fbdfc15f210 secure :-1 s=READY pgs=2422 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009cd0 tx=0x7fbdf4032db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:45.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.740+0000 7fbdf3e00640 1 -- 172.21.15.42:0/1816636209 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4041070 con 0x7fbdfc1fe160 2024-09-17T01:48:45.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.740+0000 7fbdf3e00640 1 -- 172.21.15.42:0/1816636209 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbdf4004450 con 0x7fbdfc1fe160 2024-09-17T01:48:45.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.740+0000 7fbe01200640 1 -- 172.21.15.42:0/1816636209 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdfc1fa3a0 con 0x7fbdfc1fe160 2024-09-17T01:48:45.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.740+0000 7fbdf3e00640 1 -- 172.21.15.42:0/1816636209 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4031430 con 0x7fbdfc1fe160 2024-09-17T01:48:45.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.740+0000 7fbe01200640 1 -- 172.21.15.42:0/1816636209 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdfc1fa960 con 0x7fbdfc1fe160 2024-09-17T01:48:45.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.741+0000 7fbe01200640 1 -- 172.21.15.42:0/1816636209 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdfc146230 con 0x7fbdfc1fe160 2024-09-17T01:48:45.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.742+0000 7fbdf3e00640 1 -- 172.21.15.42:0/1816636209 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbdf4044070 con 0x7fbdfc1fe160 2024-09-17T01:48:45.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.743+0000 7fbdf3e00640 1 --2- 172.21.15.42:0/1816636209 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbdd8078b90 0x7fbdd807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:45.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.744+0000 7fbdf3e00640 1 -- 172.21.15.42:0/1816636209 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(213..213 src has 1..213) ==== 5709+0+0 (secure 0 0 0) 0x7fbdf402e020 con 0x7fbdfc1fe160 2024-09-17T01:48:45.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.744+0000 7fbdfb400640 1 --2- 172.21.15.42:0/1816636209 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbdd8078b90 0x7fbdd807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.745+0000 7fbdfb400640 1 --2- 172.21.15.42:0/1816636209 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbdd8078b90 0x7fbdd807b0a0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009b30 tx=0x7fbdec005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:45.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.748+0000 7fbdf3e00640 1 -- 172.21.15.42:0/1816636209 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbdfc146230 con 0x7fbdfc1fe160 2024-09-17T01:48:45.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.942+0000 7fbe01200640 1 -- 172.21.15.42:0/1816636209 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbdfc0cfbe0 con 0x7fbdfc1fe160 2024-09-17T01:48:45.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.943+0000 7fbdf3e00640 1 -- 172.21.15.42:0/1816636209 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v213) ==== 74+0+16627 (secure 0 0 0) 0x7fbdf404b020 con 0x7fbdfc1fe160 2024-09-17T01:48:45.941 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:48:45.941 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":213,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:48:42.955744+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:48:39.408110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"cephfs_data","create_time":"2024-09-17T01:48:40.420221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"213","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:48:45.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.945+0000 7fbe01200640 1 -- 172.21.15.42:0/1816636209 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbdd8078b90 msgr2=0x7fbdd807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.945+0000 7fbe01200640 1 --2- 172.21.15.42:0/1816636209 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbdd8078b90 0x7fbdd807b0a0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009b30 tx=0x7fbdec005f90 comp rx=0 tx=0).stop 2024-09-17T01:48:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.945+0000 7fbe01200640 1 -- 172.21.15.42:0/1816636209 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbdfc1fe160 msgr2=0x7fbdfc15f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.945+0000 7fbe01200640 1 --2- 172.21.15.42:0/1816636209 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbdfc1fe160 0x7fbdfc15f210 secure :-1 s=READY pgs=2422 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009cd0 tx=0x7fbdf4032db0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.945+0000 7fbe01200640 1 -- 172.21.15.42:0/1816636209 shutdown_connections 2024-09-17T01:48:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.945+0000 7fbe01200640 1 --2- 172.21.15.42:0/1816636209 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbdd8078b90 0x7fbdd807b0a0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.945+0000 7fbe01200640 1 --2- 172.21.15.42:0/1816636209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdfc161210 0x7fbdfc1fdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.945+0000 7fbe01200640 1 --2- 172.21.15.42:0/1816636209 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbdfc1fe160 0x7fbdfc15f210 unknown :-1 s=CLOSED pgs=2422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.945+0000 7fbe01200640 1 --2- 172.21.15.42:0/1816636209 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbdfc0b2bb0 0x7fbdfc143cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.945+0000 7fbe01200640 1 -- 172.21.15.42:0/1816636209 >> 172.21.15.42:0/1816636209 conn(0x7fbdfc06d3f0 msgr2=0x7fbdfc15d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.946+0000 7fbe01200640 1 -- 172.21.15.42:0/1816636209 shutdown_connections 2024-09-17T01:48:45.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:45.946+0000 7fbe01200640 1 -- 172.21.15.42:0/1816636209 wait complete. 2024-09-17T01:48:45.966 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T01:48:45.966 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:48:46.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.198+0000 7f67c8a00640 1 -- 172.21.15.42:0/2205784251 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f67c415dcf0 msgr2=0x7f67c4072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:46.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.198+0000 7f67c8a00640 1 --2- 172.21.15.42:0/2205784251 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f67c415dcf0 0x7f67c4072b60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f67b4009860 tx=0x7f67b402a5a0 comp rx=0 tx=0).stop 2024-09-17T01:48:46.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.198+0000 7f67c8a00640 1 -- 172.21.15.42:0/2205784251 shutdown_connections 2024-09-17T01:48:46.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.198+0000 7f67c8a00640 1 --2- 172.21.15.42:0/2205784251 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f67c415dcf0 0x7f67c4072b60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:46.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.198+0000 7f67c8a00640 1 -- 172.21.15.42:0/2205784251 >> 172.21.15.42:0/2205784251 conn(0x7f67c406d1b0 msgr2=0x7f67c406d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:46.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.198+0000 7f67c8a00640 1 -- 172.21.15.42:0/2205784251 shutdown_connections 2024-09-17T01:48:46.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.198+0000 7f67c8a00640 1 -- 172.21.15.42:0/2205784251 wait complete. 2024-09-17T01:48:46.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.200+0000 7f67c8a00640 1 Processor -- start 2024-09-17T01:48:46.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.200+0000 7f67c8a00640 1 -- start start 2024-09-17T01:48:46.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.201+0000 7f67c8a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67c415dcf0 0x7f67c41eb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:46.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.201+0000 7f67c8a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f67c4160790 0x7f67c4145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:46.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.201+0000 7f67c8a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67c41f5a30 0x7f67c41e7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:46.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.201+0000 7f67c8a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f67c406f0d0 con 0x7f67c41f5a30 2024-09-17T01:48:46.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.201+0000 7f67c8a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f67c41610b0 con 0x7f67c415dcf0 2024-09-17T01:48:46.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.201+0000 7f67c8a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f67c406f250 con 0x7f67c4160790 2024-09-17T01:48:46.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.202+0000 7f67c2800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67c41f5a30 0x7f67c41e7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:46.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.202+0000 7f67c2800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67c41f5a30 0x7f67c41e7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45718/0 (socket says 172.21.15.42:45718) 2024-09-17T01:48:46.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.202+0000 7f67c2800640 1 -- 172.21.15.42:0/2343142039 learned_addr learned my addr 172.21.15.42:0/2343142039 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:46.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.202+0000 7f67c1e00640 1 --2- 172.21.15.42:0/2343142039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67c415dcf0 0x7f67c41eb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:46.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.202+0000 7f67b9400640 1 --2- 172.21.15.42:0/2343142039 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f67c4160790 0x7f67c4145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:46.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.202+0000 7f67c2800640 1 -- 172.21.15.42:0/2343142039 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f67c4160790 msgr2=0x7f67c4145ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:46.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.202+0000 7f67c2800640 1 --2- 172.21.15.42:0/2343142039 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f67c4160790 0x7f67c4145ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:46.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.202+0000 7f67c2800640 1 -- 172.21.15.42:0/2343142039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67c415dcf0 msgr2=0x7f67c41eb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:46.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.202+0000 7f67c2800640 1 --2- 172.21.15.42:0/2343142039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67c415dcf0 0x7f67c41eb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:46.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.202+0000 7f67c2800640 1 -- 172.21.15.42:0/2343142039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c41ea3f0 con 0x7f67c41f5a30 2024-09-17T01:48:46.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.203+0000 7f67c2800640 1 --2- 172.21.15.42:0/2343142039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67c41f5a30 0x7f67c41e7620 secure :-1 s=READY pgs=2424 cs=0 l=1 rev1=1 crypto rx=0x7f67bc00cab0 tx=0x7f67bc00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:46.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.203+0000 7f67baa00640 1 -- 172.21.15.42:0/2343142039 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67bc016020 con 0x7f67c41f5a30 2024-09-17T01:48:46.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.203+0000 7f67baa00640 1 -- 172.21.15.42:0/2343142039 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67bc00ad40 con 0x7f67c41f5a30 2024-09-17T01:48:46.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.203+0000 7f67baa00640 1 -- 172.21.15.42:0/2343142039 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67bc012680 con 0x7f67c41f5a30 2024-09-17T01:48:46.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.203+0000 7f67c8a00640 1 -- 172.21.15.42:0/2343142039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67c41ea6b0 con 0x7f67c41f5a30 2024-09-17T01:48:46.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.203+0000 7f67c8a00640 1 -- 172.21.15.42:0/2343142039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67c41eac70 con 0x7f67c41f5a30 2024-09-17T01:48:46.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.204+0000 7f67c8a00640 1 -- 172.21.15.42:0/2343142039 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67c41602a0 con 0x7f67c41f5a30 2024-09-17T01:48:46.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.205+0000 7f67baa00640 1 -- 172.21.15.42:0/2343142039 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f67bc019020 con 0x7f67c41f5a30 2024-09-17T01:48:46.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.207+0000 7f67baa00640 1 --2- 172.21.15.42:0/2343142039 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f67a0078bc0 0x7f67a007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:46.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.207+0000 7f67baa00640 1 -- 172.21.15.42:0/2343142039 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(213..213 src has 1..213) ==== 5709+0+0 (secure 0 0 0) 0x7f67bc09b260 con 0x7f67c41f5a30 2024-09-17T01:48:46.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.207+0000 7f67c1e00640 1 --2- 172.21.15.42:0/2343142039 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f67a0078bc0 0x7f67a007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:46.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.208+0000 7f67c1e00640 1 --2- 172.21.15.42:0/2343142039 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f67a0078bc0 0x7f67a007b0d0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f67b4034000 tx=0x7f67b4004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:46.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.211+0000 7f67baa00640 1 -- 172.21.15.42:0/2343142039 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f67c41602a0 con 0x7f67c41f5a30 2024-09-17T01:48:46.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.402+0000 7f67c8a00640 1 -- 172.21.15.42:0/2343142039 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f67c40cece0 con 0x7f67a0078bc0 2024-09-17T01:48:46.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.408+0000 7f67baa00640 1 -- 172.21.15.42:0/2343142039 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250975 (secure 0 0 0) 0x7f67c40cece0 con 0x7f67a0078bc0 2024-09-17T01:48:46.409 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:48:46.410 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:48:46.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.412+0000 7f67c8a00640 1 -- 172.21.15.42:0/2343142039 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f67a0078bc0 msgr2=0x7f67a007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:46.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.412+0000 7f67c8a00640 1 --2- 172.21.15.42:0/2343142039 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f67a0078bc0 0x7f67a007b0d0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f67b4034000 tx=0x7f67b4004730 comp rx=0 tx=0).stop 2024-09-17T01:48:46.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.412+0000 7f67c8a00640 1 -- 172.21.15.42:0/2343142039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67c41f5a30 msgr2=0x7f67c41e7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:46.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.412+0000 7f67c8a00640 1 --2- 172.21.15.42:0/2343142039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67c41f5a30 0x7f67c41e7620 secure :-1 s=READY pgs=2424 cs=0 l=1 rev1=1 crypto rx=0x7f67bc00cab0 tx=0x7f67bc00cf70 comp rx=0 tx=0).stop 2024-09-17T01:48:46.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.412+0000 7f67c8a00640 1 -- 172.21.15.42:0/2343142039 shutdown_connections 2024-09-17T01:48:46.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.412+0000 7f67c8a00640 1 --2- 172.21.15.42:0/2343142039 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f67a0078bc0 0x7f67a007b0d0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:46.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.412+0000 7f67c8a00640 1 --2- 172.21.15.42:0/2343142039 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67c41f5a30 0x7f67c41e7620 unknown :-1 s=CLOSED pgs=2424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:46.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.412+0000 7f67c8a00640 1 --2- 172.21.15.42:0/2343142039 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f67c4160790 0x7f67c4145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:46.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.412+0000 7f67c8a00640 1 --2- 172.21.15.42:0/2343142039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67c415dcf0 0x7f67c41eb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:46.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.412+0000 7f67c8a00640 1 -- 172.21.15.42:0/2343142039 >> 172.21.15.42:0/2343142039 conn(0x7f67c406d1b0 msgr2=0x7f67c406e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:46.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.413+0000 7f67c8a00640 1 -- 172.21.15.42:0/2343142039 shutdown_connections 2024-09-17T01:48:46.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.413+0000 7f67c8a00640 1 -- 172.21.15.42:0/2343142039 wait complete. 2024-09-17T01:48:46.433 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":712,"stamp":"2024-09-17T01:48:45.267372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":438160,"kb_used_data":22120,"kb_used_omap":12,"kb_used_meta":415859,"kb_avail":754536560,"statfs":{"total":773094113280,"available":772645437440,"internally_reserved":0,"allocated":22650880,"data_stored":10664976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":425840180},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.334003"},"pg_stats":[{"pgid":"31.3f","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450608+0000","last_change":"2024-09-17T01:48:41.988421+0000","last_active":"2024-09-17T01:48:43.450608+0000","last_peered":"2024-09-17T01:48:43.450608+0000","last_clean":"2024-09-17T01:48:43.450608+0000","last_became_active":"2024-09-17T01:48:41.988099+0000","last_became_peered":"2024-09-17T01:48:41.988099+0000","last_unstale":"2024-09-17T01:48:43.450608+0000","last_undegraded":"2024-09-17T01:48:43.450608+0000","last_fullsized":"2024-09-17T01:48:43.450608+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:10.721737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.3e","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.967821+0000","last_change":"2024-09-17T01:48:41.965330+0000","last_active":"2024-09-17T01:48:41.967821+0000","last_peered":"2024-09-17T01:48:41.967821+0000","last_clean":"2024-09-17T01:48:41.967821+0000","last_became_active":"2024-09-17T01:48:41.964988+0000","last_became_peered":"2024-09-17T01:48:41.964988+0000","last_unstale":"2024-09-17T01:48:41.967821+0000","last_undegraded":"2024-09-17T01:48:41.967821+0000","last_fullsized":"2024-09-17T01:48:41.967821+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:50:47.522773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.3d","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450523+0000","last_change":"2024-09-17T01:48:41.992476+0000","last_active":"2024-09-17T01:48:43.450523+0000","last_peered":"2024-09-17T01:48:43.450523+0000","last_clean":"2024-09-17T01:48:43.450523+0000","last_became_active":"2024-09-17T01:48:41.992130+0000","last_became_peered":"2024-09-17T01:48:41.992130+0000","last_unstale":"2024-09-17T01:48:43.450523+0000","last_undegraded":"2024-09-17T01:48:43.450523+0000","last_fullsized":"2024-09-17T01:48:43.450523+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:15:15.143150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.3c","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966650+0000","last_change":"2024-09-17T01:48:41.969707+0000","last_active":"2024-09-17T01:48:42.966650+0000","last_peered":"2024-09-17T01:48:42.966650+0000","last_clean":"2024-09-17T01:48:42.966650+0000","last_became_active":"2024-09-17T01:48:41.967489+0000","last_became_peered":"2024-09-17T01:48:41.967489+0000","last_unstale":"2024-09-17T01:48:42.966650+0000","last_undegraded":"2024-09-17T01:48:42.966650+0000","last_fullsized":"2024-09-17T01:48:42.966650+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:22.342311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.3b","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964633+0000","last_change":"2024-09-17T01:48:41.956894+0000","last_active":"2024-09-17T01:48:42.964633+0000","last_peered":"2024-09-17T01:48:42.964633+0000","last_clean":"2024-09-17T01:48:42.964633+0000","last_became_active":"2024-09-17T01:48:41.956533+0000","last_became_peered":"2024-09-17T01:48:41.956533+0000","last_unstale":"2024-09-17T01:48:42.964633+0000","last_undegraded":"2024-09-17T01:48:42.964633+0000","last_fullsized":"2024-09-17T01:48:42.964633+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:43.230899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.3a","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450111+0000","last_change":"2024-09-17T01:48:41.989695+0000","last_active":"2024-09-17T01:48:43.450111+0000","last_peered":"2024-09-17T01:48:43.450111+0000","last_clean":"2024-09-17T01:48:43.450111+0000","last_became_active":"2024-09-17T01:48:41.988985+0000","last_became_peered":"2024-09-17T01:48:41.988985+0000","last_unstale":"2024-09-17T01:48:43.450111+0000","last_undegraded":"2024-09-17T01:48:43.450111+0000","last_fullsized":"2024-09-17T01:48:43.450111+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:56:47.447939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.39","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393200+0000","last_change":"2024-09-17T01:48:41.963394+0000","last_active":"2024-09-17T01:48:43.393200+0000","last_peered":"2024-09-17T01:48:43.393200+0000","last_clean":"2024-09-17T01:48:43.393200+0000","last_became_active":"2024-09-17T01:48:41.963064+0000","last_became_peered":"2024-09-17T01:48:41.963064+0000","last_unstale":"2024-09-17T01:48:43.393200+0000","last_undegraded":"2024-09-17T01:48:43.393200+0000","last_fullsized":"2024-09-17T01:48:43.393200+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:50.099904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.38","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964389+0000","last_change":"2024-09-17T01:48:41.963873+0000","last_active":"2024-09-17T01:48:42.964389+0000","last_peered":"2024-09-17T01:48:42.964389+0000","last_clean":"2024-09-17T01:48:42.964389+0000","last_became_active":"2024-09-17T01:48:41.960583+0000","last_became_peered":"2024-09-17T01:48:41.960583+0000","last_unstale":"2024-09-17T01:48:42.964389+0000","last_undegraded":"2024-09-17T01:48:42.964389+0000","last_fullsized":"2024-09-17T01:48:42.964389+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:31.451012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:48:40.932243+0000","last_change":"2024-09-17T01:48:40.932243+0000","last_active":"2024-09-17T01:48:40.932243+0000","last_peered":"2024-09-17T01:48:40.932243+0000","last_clean":"2024-09-17T01:48:40.932243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:48:40.932243+0000","last_undegraded":"2024-09-17T01:48:40.932243+0000","last_fullsized":"2024-09-17T01:48:40.932243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.36","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393240+0000","last_change":"2024-09-17T01:48:41.963101+0000","last_active":"2024-09-17T01:48:43.393240+0000","last_peered":"2024-09-17T01:48:43.393240+0000","last_clean":"2024-09-17T01:48:43.393240+0000","last_became_active":"2024-09-17T01:48:41.961668+0000","last_became_peered":"2024-09-17T01:48:41.961668+0000","last_unstale":"2024-09-17T01:48:43.393240+0000","last_undegraded":"2024-09-17T01:48:43.393240+0000","last_fullsized":"2024-09-17T01:48:43.393240+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:30.142847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.35","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967097+0000","last_change":"2024-09-17T01:48:41.992165+0000","last_active":"2024-09-17T01:48:42.967097+0000","last_peered":"2024-09-17T01:48:42.967097+0000","last_clean":"2024-09-17T01:48:42.967097+0000","last_became_active":"2024-09-17T01:48:41.991821+0000","last_became_peered":"2024-09-17T01:48:41.991821+0000","last_unstale":"2024-09-17T01:48:42.967097+0000","last_undegraded":"2024-09-17T01:48:42.967097+0000","last_fullsized":"2024-09-17T01:48:42.967097+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:26.331280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.34","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393530+0000","last_change":"2024-09-17T01:48:41.973919+0000","last_active":"2024-09-17T01:48:43.393530+0000","last_peered":"2024-09-17T01:48:43.393530+0000","last_clean":"2024-09-17T01:48:43.393530+0000","last_became_active":"2024-09-17T01:48:41.973559+0000","last_became_peered":"2024-09-17T01:48:41.973559+0000","last_unstale":"2024-09-17T01:48:43.393530+0000","last_undegraded":"2024-09-17T01:48:43.393530+0000","last_fullsized":"2024-09-17T01:48:43.393530+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:45.600564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:48:40.932243+0000","last_change":"2024-09-17T01:48:40.932243+0000","last_active":"2024-09-17T01:48:40.932243+0000","last_peered":"2024-09-17T01:48:40.932243+0000","last_clean":"2024-09-17T01:48:40.932243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:48:40.932243+0000","last_undegraded":"2024-09-17T01:48:40.932243+0000","last_fullsized":"2024-09-17T01:48:40.932243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.32","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966149+0000","last_change":"2024-09-17T01:48:41.977401+0000","last_active":"2024-09-17T01:48:42.966149+0000","last_peered":"2024-09-17T01:48:42.966149+0000","last_clean":"2024-09-17T01:48:42.966149+0000","last_became_active":"2024-09-17T01:48:41.974556+0000","last_became_peered":"2024-09-17T01:48:41.974556+0000","last_unstale":"2024-09-17T01:48:42.966149+0000","last_undegraded":"2024-09-17T01:48:42.966149+0000","last_fullsized":"2024-09-17T01:48:42.966149+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:55.867060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.31","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965569+0000","last_change":"2024-09-17T01:48:41.975123+0000","last_active":"2024-09-17T01:48:42.965569+0000","last_peered":"2024-09-17T01:48:42.965569+0000","last_clean":"2024-09-17T01:48:42.965569+0000","last_became_active":"2024-09-17T01:48:41.974673+0000","last_became_peered":"2024-09-17T01:48:41.974673+0000","last_unstale":"2024-09-17T01:48:42.965569+0000","last_undegraded":"2024-09-17T01:48:42.965569+0000","last_fullsized":"2024-09-17T01:48:42.965569+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:17:36.339225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.30","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.971370+0000","last_change":"2024-09-17T01:48:41.965693+0000","last_active":"2024-09-17T01:48:41.971370+0000","last_peered":"2024-09-17T01:48:41.971370+0000","last_clean":"2024-09-17T01:48:41.971370+0000","last_became_active":"2024-09-17T01:48:41.962372+0000","last_became_peered":"2024-09-17T01:48:41.962372+0000","last_unstale":"2024-09-17T01:48:41.971370+0000","last_undegraded":"2024-09-17T01:48:41.971370+0000","last_fullsized":"2024-09-17T01:48:41.971370+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:44.587490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.2f","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393403+0000","last_change":"2024-09-17T01:48:41.976694+0000","last_active":"2024-09-17T01:48:43.393403+0000","last_peered":"2024-09-17T01:48:43.393403+0000","last_clean":"2024-09-17T01:48:43.393403+0000","last_became_active":"2024-09-17T01:48:41.974656+0000","last_became_peered":"2024-09-17T01:48:41.974656+0000","last_unstale":"2024-09-17T01:48:43.393403+0000","last_undegraded":"2024-09-17T01:48:43.393403+0000","last_fullsized":"2024-09-17T01:48:43.393403+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:02.926819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2e","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462080+0000","last_change":"2024-09-17T01:48:41.980564+0000","last_active":"2024-09-17T01:48:44.462080+0000","last_peered":"2024-09-17T01:48:44.462080+0000","last_clean":"2024-09-17T01:48:44.462080+0000","last_became_active":"2024-09-17T01:48:41.980245+0000","last_became_peered":"2024-09-17T01:48:41.980245+0000","last_unstale":"2024-09-17T01:48:44.462080+0000","last_undegraded":"2024-09-17T01:48:44.462080+0000","last_fullsized":"2024-09-17T01:48:44.462080+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:43.668061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:48:40.932243+0000","last_change":"2024-09-17T01:48:40.932243+0000","last_active":"2024-09-17T01:48:40.932243+0000","last_peered":"2024-09-17T01:48:40.932243+0000","last_clean":"2024-09-17T01:48:40.932243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:48:40.932243+0000","last_undegraded":"2024-09-17T01:48:40.932243+0000","last_fullsized":"2024-09-17T01:48:40.932243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.2c","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.976096+0000","last_change":"2024-09-17T01:48:41.969173+0000","last_active":"2024-09-17T01:48:41.976096+0000","last_peered":"2024-09-17T01:48:41.976096+0000","last_clean":"2024-09-17T01:48:41.976096+0000","last_became_active":"2024-09-17T01:48:41.968166+0000","last_became_peered":"2024-09-17T01:48:41.968166+0000","last_unstale":"2024-09-17T01:48:41.976096+0000","last_undegraded":"2024-09-17T01:48:41.976096+0000","last_fullsized":"2024-09-17T01:48:41.976096+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:08.105937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.2b","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964761+0000","last_change":"2024-09-17T01:48:41.954636+0000","last_active":"2024-09-17T01:48:42.964761+0000","last_peered":"2024-09-17T01:48:42.964761+0000","last_clean":"2024-09-17T01:48:42.964761+0000","last_became_active":"2024-09-17T01:48:41.953894+0000","last_became_peered":"2024-09-17T01:48:41.953894+0000","last_unstale":"2024-09-17T01:48:42.964761+0000","last_undegraded":"2024-09-17T01:48:42.964761+0000","last_fullsized":"2024-09-17T01:48:42.964761+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:36.329548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:48:40.932243+0000","last_change":"2024-09-17T01:48:40.932243+0000","last_active":"2024-09-17T01:48:40.932243+0000","last_peered":"2024-09-17T01:48:40.932243+0000","last_clean":"2024-09-17T01:48:40.932243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:48:40.932243+0000","last_undegraded":"2024-09-17T01:48:40.932243+0000","last_fullsized":"2024-09-17T01:48:40.932243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:48:40.932243+0000","last_change":"2024-09-17T01:48:40.932243+0000","last_active":"2024-09-17T01:48:40.932243+0000","last_peered":"2024-09-17T01:48:40.932243+0000","last_clean":"2024-09-17T01:48:40.932243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:48:40.932243+0000","last_undegraded":"2024-09-17T01:48:40.932243+0000","last_fullsized":"2024-09-17T01:48:40.932243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.28","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965934+0000","last_change":"2024-09-17T01:48:41.971698+0000","last_active":"2024-09-17T01:48:42.965934+0000","last_peered":"2024-09-17T01:48:42.965934+0000","last_clean":"2024-09-17T01:48:42.965934+0000","last_became_active":"2024-09-17T01:48:41.970716+0000","last_became_peered":"2024-09-17T01:48:41.970716+0000","last_unstale":"2024-09-17T01:48:42.965934+0000","last_undegraded":"2024-09-17T01:48:42.965934+0000","last_fullsized":"2024-09-17T01:48:42.965934+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:55.100537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.27","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967261+0000","last_change":"2024-09-17T01:48:41.961465+0000","last_active":"2024-09-17T01:48:42.967261+0000","last_peered":"2024-09-17T01:48:42.967261+0000","last_clean":"2024-09-17T01:48:42.967261+0000","last_became_active":"2024-09-17T01:48:41.961094+0000","last_became_peered":"2024-09-17T01:48:41.961094+0000","last_unstale":"2024-09-17T01:48:42.967261+0000","last_undegraded":"2024-09-17T01:48:42.967261+0000","last_fullsized":"2024-09-17T01:48:42.967261+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:41.337984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.26","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965081+0000","last_change":"2024-09-17T01:48:41.976001+0000","last_active":"2024-09-17T01:48:42.965081+0000","last_peered":"2024-09-17T01:48:42.965081+0000","last_clean":"2024-09-17T01:48:42.965081+0000","last_became_active":"2024-09-17T01:48:41.975224+0000","last_became_peered":"2024-09-17T01:48:41.975224+0000","last_unstale":"2024-09-17T01:48:42.965081+0000","last_undegraded":"2024-09-17T01:48:42.965081+0000","last_fullsized":"2024-09-17T01:48:42.965081+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:54.362773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.25","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.964284+0000","last_change":"2024-09-17T01:48:41.962212+0000","last_active":"2024-09-17T01:48:41.964284+0000","last_peered":"2024-09-17T01:48:41.964284+0000","last_clean":"2024-09-17T01:48:41.964284+0000","last_became_active":"2024-09-17T01:48:41.957215+0000","last_became_peered":"2024-09-17T01:48:41.957215+0000","last_unstale":"2024-09-17T01:48:41.964284+0000","last_undegraded":"2024-09-17T01:48:41.964284+0000","last_fullsized":"2024-09-17T01:48:41.964284+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:36.289610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.24","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966653+0000","last_change":"2024-09-17T01:48:41.960227+0000","last_active":"2024-09-17T01:48:42.966653+0000","last_peered":"2024-09-17T01:48:42.966653+0000","last_clean":"2024-09-17T01:48:42.966653+0000","last_became_active":"2024-09-17T01:48:41.959863+0000","last_became_peered":"2024-09-17T01:48:41.959863+0000","last_unstale":"2024-09-17T01:48:42.966653+0000","last_undegraded":"2024-09-17T01:48:42.966653+0000","last_fullsized":"2024-09-17T01:48:42.966653+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:47.101431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.23","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966478+0000","last_change":"2024-09-17T01:48:41.983228+0000","last_active":"2024-09-17T01:48:42.966478+0000","last_peered":"2024-09-17T01:48:42.966478+0000","last_clean":"2024-09-17T01:48:42.966478+0000","last_became_active":"2024-09-17T01:48:41.982832+0000","last_became_peered":"2024-09-17T01:48:41.982832+0000","last_unstale":"2024-09-17T01:48:42.966478+0000","last_undegraded":"2024-09-17T01:48:42.966478+0000","last_fullsized":"2024-09-17T01:48:42.966478+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:53.868153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:48:40.932243+0000","last_change":"2024-09-17T01:48:40.932243+0000","last_active":"2024-09-17T01:48:40.932243+0000","last_peered":"2024-09-17T01:48:40.932243+0000","last_clean":"2024-09-17T01:48:40.932243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:48:40.932243+0000","last_undegraded":"2024-09-17T01:48:40.932243+0000","last_fullsized":"2024-09-17T01:48:40.932243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.21","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965991+0000","last_change":"2024-09-17T01:48:41.973589+0000","last_active":"2024-09-17T01:48:42.965991+0000","last_peered":"2024-09-17T01:48:42.965991+0000","last_clean":"2024-09-17T01:48:42.965991+0000","last_became_active":"2024-09-17T01:48:41.973257+0000","last_became_peered":"2024-09-17T01:48:41.973257+0000","last_unstale":"2024-09-17T01:48:42.965991+0000","last_undegraded":"2024-09-17T01:48:42.965991+0000","last_fullsized":"2024-09-17T01:48:42.965991+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:00.927500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.20","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.971402+0000","last_change":"2024-09-17T01:48:41.966916+0000","last_active":"2024-09-17T01:48:41.971402+0000","last_peered":"2024-09-17T01:48:41.971402+0000","last_clean":"2024-09-17T01:48:41.971402+0000","last_became_active":"2024-09-17T01:48:41.962328+0000","last_became_peered":"2024-09-17T01:48:41.962328+0000","last_unstale":"2024-09-17T01:48:41.971402+0000","last_undegraded":"2024-09-17T01:48:41.971402+0000","last_fullsized":"2024-09-17T01:48:41.971402+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:00:44.537741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1f","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462071+0000","last_change":"2024-09-17T01:48:41.987044+0000","last_active":"2024-09-17T01:48:44.462071+0000","last_peered":"2024-09-17T01:48:44.462071+0000","last_clean":"2024-09-17T01:48:44.462071+0000","last_became_active":"2024-09-17T01:48:41.986685+0000","last_became_peered":"2024-09-17T01:48:41.986685+0000","last_unstale":"2024-09-17T01:48:44.462071+0000","last_undegraded":"2024-09-17T01:48:44.462071+0000","last_fullsized":"2024-09-17T01:48:44.462071+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:15:39.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1e","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966212+0000","last_change":"2024-09-17T01:48:40.958584+0000","last_active":"2024-09-17T01:48:42.966212+0000","last_peered":"2024-09-17T01:48:42.966212+0000","last_clean":"2024-09-17T01:48:42.966212+0000","last_became_active":"2024-09-17T01:48:40.958270+0000","last_became_peered":"2024-09-17T01:48:40.958270+0000","last_unstale":"2024-09-17T01:48:42.966212+0000","last_undegraded":"2024-09-17T01:48:42.966212+0000","last_fullsized":"2024-09-17T01:48:42.966212+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:43.311074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1c","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967106+0000","last_change":"2024-09-17T01:48:41.991844+0000","last_active":"2024-09-17T01:48:42.967106+0000","last_peered":"2024-09-17T01:48:42.967106+0000","last_clean":"2024-09-17T01:48:42.967106+0000","last_became_active":"2024-09-17T01:48:41.991218+0000","last_became_peered":"2024-09-17T01:48:41.991218+0000","last_unstale":"2024-09-17T01:48:42.967106+0000","last_undegraded":"2024-09-17T01:48:42.967106+0000","last_fullsized":"2024-09-17T01:48:42.967106+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:36.622860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1d","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450551+0000","last_change":"2024-09-17T01:48:40.970298+0000","last_active":"2024-09-17T01:48:43.450551+0000","last_peered":"2024-09-17T01:48:43.450551+0000","last_clean":"2024-09-17T01:48:43.450551+0000","last_became_active":"2024-09-17T01:48:40.969934+0000","last_became_peered":"2024-09-17T01:48:40.969934+0000","last_unstale":"2024-09-17T01:48:43.450551+0000","last_undegraded":"2024-09-17T01:48:43.450551+0000","last_fullsized":"2024-09-17T01:48:43.450551+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:06.666716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:48:40.932243+0000","last_change":"2024-09-17T01:48:40.932243+0000","last_active":"2024-09-17T01:48:40.932243+0000","last_peered":"2024-09-17T01:48:40.932243+0000","last_clean":"2024-09-17T01:48:40.932243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:48:40.932243+0000","last_undegraded":"2024-09-17T01:48:40.932243+0000","last_fullsized":"2024-09-17T01:48:40.932243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.1c","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461822+0000","last_change":"2024-09-17T01:48:40.963737+0000","last_active":"2024-09-17T01:48:44.461822+0000","last_peered":"2024-09-17T01:48:44.461822+0000","last_clean":"2024-09-17T01:48:44.461822+0000","last_became_active":"2024-09-17T01:48:40.963409+0000","last_became_peered":"2024-09-17T01:48:40.963409+0000","last_unstale":"2024-09-17T01:48:44.461822+0000","last_undegraded":"2024-09-17T01:48:44.461822+0000","last_fullsized":"2024-09-17T01:48:44.461822+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:07.992373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.1a","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461547+0000","last_change":"2024-09-17T01:48:41.967809+0000","last_active":"2024-09-17T01:48:44.461547+0000","last_peered":"2024-09-17T01:48:44.461547+0000","last_clean":"2024-09-17T01:48:44.461547+0000","last_became_active":"2024-09-17T01:48:41.967471+0000","last_became_peered":"2024-09-17T01:48:41.967471+0000","last_unstale":"2024-09-17T01:48:44.461547+0000","last_undegraded":"2024-09-17T01:48:44.461547+0000","last_fullsized":"2024-09-17T01:48:44.461547+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:15.398716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1b","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462083+0000","last_change":"2024-09-17T01:48:40.965537+0000","last_active":"2024-09-17T01:48:44.462083+0000","last_peered":"2024-09-17T01:48:44.462083+0000","last_clean":"2024-09-17T01:48:44.462083+0000","last_became_active":"2024-09-17T01:48:40.965186+0000","last_became_peered":"2024-09-17T01:48:40.965186+0000","last_unstale":"2024-09-17T01:48:44.462083+0000","last_undegraded":"2024-09-17T01:48:44.462083+0000","last_fullsized":"2024-09-17T01:48:44.462083+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:02.660884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.1b","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966082+0000","last_change":"2024-09-17T01:48:41.973058+0000","last_active":"2024-09-17T01:48:42.966082+0000","last_peered":"2024-09-17T01:48:42.966082+0000","last_clean":"2024-09-17T01:48:42.966082+0000","last_became_active":"2024-09-17T01:48:41.972705+0000","last_became_peered":"2024-09-17T01:48:41.972705+0000","last_unstale":"2024-09-17T01:48:42.966082+0000","last_undegraded":"2024-09-17T01:48:42.966082+0000","last_fullsized":"2024-09-17T01:48:42.966082+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:00.679343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1a","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461608+0000","last_change":"2024-09-17T01:48:40.963571+0000","last_active":"2024-09-17T01:48:44.461608+0000","last_peered":"2024-09-17T01:48:44.461608+0000","last_clean":"2024-09-17T01:48:44.461608+0000","last_became_active":"2024-09-17T01:48:40.963225+0000","last_became_peered":"2024-09-17T01:48:40.963225+0000","last_unstale":"2024-09-17T01:48:44.461608+0000","last_undegraded":"2024-09-17T01:48:44.461608+0000","last_fullsized":"2024-09-17T01:48:44.461608+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:17.264437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966022+0000","last_change":"2024-09-17T01:48:41.961255+0000","last_active":"2024-09-17T01:48:42.966022+0000","last_peered":"2024-09-17T01:48:42.966022+0000","last_clean":"2024-09-17T01:48:42.966022+0000","last_became_active":"2024-09-17T01:48:41.960894+0000","last_became_peered":"2024-09-17T01:48:41.960894+0000","last_unstale":"2024-09-17T01:48:42.966022+0000","last_undegraded":"2024-09-17T01:48:42.966022+0000","last_fullsized":"2024-09-17T01:48:42.966022+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:02:46.006988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965064+0000","last_change":"2024-09-17T01:48:40.963230+0000","last_active":"2024-09-17T01:48:42.965064+0000","last_peered":"2024-09-17T01:48:42.965064+0000","last_clean":"2024-09-17T01:48:42.965064+0000","last_became_active":"2024-09-17T01:48:40.962869+0000","last_became_peered":"2024-09-17T01:48:40.962869+0000","last_unstale":"2024-09-17T01:48:42.965064+0000","last_undegraded":"2024-09-17T01:48:42.965064+0000","last_fullsized":"2024-09-17T01:48:42.965064+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:31.161425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965805+0000","last_change":"2024-09-17T01:48:41.961510+0000","last_active":"2024-09-17T01:48:42.965805+0000","last_peered":"2024-09-17T01:48:42.965805+0000","last_clean":"2024-09-17T01:48:42.965805+0000","last_became_active":"2024-09-17T01:48:41.961149+0000","last_became_peered":"2024-09-17T01:48:41.961149+0000","last_unstale":"2024-09-17T01:48:42.965805+0000","last_undegraded":"2024-09-17T01:48:42.965805+0000","last_fullsized":"2024-09-17T01:48:42.965805+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:42.543461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.460990+0000","last_change":"2024-09-17T01:48:40.960363+0000","last_active":"2024-09-17T01:48:44.460990+0000","last_peered":"2024-09-17T01:48:44.460990+0000","last_clean":"2024-09-17T01:48:44.460990+0000","last_became_active":"2024-09-17T01:48:40.960030+0000","last_became_peered":"2024-09-17T01:48:40.960030+0000","last_unstale":"2024-09-17T01:48:44.460990+0000","last_undegraded":"2024-09-17T01:48:44.460990+0000","last_fullsized":"2024-09-17T01:48:44.460990+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:39.323864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967273+0000","last_change":"2024-09-17T01:48:41.960180+0000","last_active":"2024-09-17T01:48:42.967273+0000","last_peered":"2024-09-17T01:48:42.967273+0000","last_clean":"2024-09-17T01:48:42.967273+0000","last_became_active":"2024-09-17T01:48:41.959822+0000","last_became_peered":"2024-09-17T01:48:41.959822+0000","last_unstale":"2024-09-17T01:48:42.967273+0000","last_undegraded":"2024-09-17T01:48:42.967273+0000","last_fullsized":"2024-09-17T01:48:42.967273+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:15.702177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966259+0000","last_change":"2024-09-17T01:48:40.959777+0000","last_active":"2024-09-17T01:48:42.966259+0000","last_peered":"2024-09-17T01:48:42.966259+0000","last_clean":"2024-09-17T01:48:42.966259+0000","last_became_active":"2024-09-17T01:48:40.959450+0000","last_became_peered":"2024-09-17T01:48:40.959450+0000","last_unstale":"2024-09-17T01:48:42.966259+0000","last_undegraded":"2024-09-17T01:48:42.966259+0000","last_fullsized":"2024-09-17T01:48:42.966259+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:07.992373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462212+0000","last_change":"2024-09-17T01:48:41.966187+0000","last_active":"2024-09-17T01:48:44.462212+0000","last_peered":"2024-09-17T01:48:44.462212+0000","last_clean":"2024-09-17T01:48:44.462212+0000","last_became_active":"2024-09-17T01:48:41.965878+0000","last_became_peered":"2024-09-17T01:48:41.965878+0000","last_unstale":"2024-09-17T01:48:44.462212+0000","last_undegraded":"2024-09-17T01:48:44.462212+0000","last_fullsized":"2024-09-17T01:48:44.462212+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:24.225979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967188+0000","last_change":"2024-09-17T01:48:40.960473+0000","last_active":"2024-09-17T01:48:42.967188+0000","last_peered":"2024-09-17T01:48:42.967188+0000","last_clean":"2024-09-17T01:48:42.967188+0000","last_became_active":"2024-09-17T01:48:40.960115+0000","last_became_peered":"2024-09-17T01:48:40.960115+0000","last_unstale":"2024-09-17T01:48:42.967188+0000","last_undegraded":"2024-09-17T01:48:42.967188+0000","last_fullsized":"2024-09-17T01:48:42.967188+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:06:29.569198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.14","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.992000+0000","last_change":"2024-09-17T01:48:41.990381+0000","last_active":"2024-09-17T01:48:41.992000+0000","last_peered":"2024-09-17T01:48:41.992000+0000","last_clean":"2024-09-17T01:48:41.992000+0000","last_became_active":"2024-09-17T01:48:41.989915+0000","last_became_peered":"2024-09-17T01:48:41.989915+0000","last_unstale":"2024-09-17T01:48:41.992000+0000","last_undegraded":"2024-09-17T01:48:41.992000+0000","last_fullsized":"2024-09-17T01:48:41.992000+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:36.937033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.15","version":"212'3","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.986091+0000","last_change":"2024-09-17T01:48:40.960038+0000","last_active":"2024-09-17T01:48:41.986091+0000","last_peered":"2024-09-17T01:48:41.986091+0000","last_clean":"2024-09-17T01:48:41.986091+0000","last_became_active":"2024-09-17T01:48:40.959680+0000","last_became_peered":"2024-09-17T01:48:40.959680+0000","last_unstale":"2024-09-17T01:48:41.986091+0000","last_undegraded":"2024-09-17T01:48:41.986091+0000","last_fullsized":"2024-09-17T01:48:41.986091+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:11.499994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.15","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964632+0000","last_change":"2024-09-17T01:48:41.958372+0000","last_active":"2024-09-17T01:48:42.964632+0000","last_peered":"2024-09-17T01:48:42.964632+0000","last_clean":"2024-09-17T01:48:42.964632+0000","last_became_active":"2024-09-17T01:48:41.958067+0000","last_became_peered":"2024-09-17T01:48:41.958067+0000","last_unstale":"2024-09-17T01:48:42.964632+0000","last_undegraded":"2024-09-17T01:48:42.964632+0000","last_fullsized":"2024-09-17T01:48:42.964632+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:02.967349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.14","version":"212'6","reported_seq":21,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450276+0000","last_change":"2024-09-17T01:48:40.969037+0000","last_active":"2024-09-17T01:48:43.450276+0000","last_peered":"2024-09-17T01:48:43.450276+0000","last_clean":"2024-09-17T01:48:43.450276+0000","last_became_active":"2024-09-17T01:48:40.968663+0000","last_became_peered":"2024-09-17T01:48:40.968663+0000","last_unstale":"2024-09-17T01:48:43.450276+0000","last_undegraded":"2024-09-17T01:48:43.450276+0000","last_fullsized":"2024-09-17T01:48:43.450276+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:36.157770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965788+0000","last_change":"2024-09-17T01:48:41.974194+0000","last_active":"2024-09-17T01:48:42.965788+0000","last_peered":"2024-09-17T01:48:42.965788+0000","last_clean":"2024-09-17T01:48:42.965788+0000","last_became_active":"2024-09-17T01:48:41.972690+0000","last_became_peered":"2024-09-17T01:48:41.972690+0000","last_unstale":"2024-09-17T01:48:42.965788+0000","last_undegraded":"2024-09-17T01:48:42.965788+0000","last_fullsized":"2024-09-17T01:48:42.965788+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:53.619025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.13","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450234+0000","last_change":"2024-09-17T01:48:40.964396+0000","last_active":"2024-09-17T01:48:43.450234+0000","last_peered":"2024-09-17T01:48:43.450234+0000","last_clean":"2024-09-17T01:48:43.450234+0000","last_became_active":"2024-09-17T01:48:40.964058+0000","last_became_peered":"2024-09-17T01:48:40.964058+0000","last_unstale":"2024-09-17T01:48:43.450234+0000","last_undegraded":"2024-09-17T01:48:43.450234+0000","last_fullsized":"2024-09-17T01:48:43.450234+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:43.677360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:48:40.932243+0000","last_change":"2024-09-17T01:48:40.932243+0000","last_active":"2024-09-17T01:48:40.932243+0000","last_peered":"2024-09-17T01:48:40.932243+0000","last_clean":"2024-09-17T01:48:40.932243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:48:40.932243+0000","last_undegraded":"2024-09-17T01:48:40.932243+0000","last_fullsized":"2024-09-17T01:48:40.932243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966052+0000","last_change":"2024-09-17T01:48:40.958069+0000","last_active":"2024-09-17T01:48:42.966052+0000","last_peered":"2024-09-17T01:48:42.966052+0000","last_clean":"2024-09-17T01:48:42.966052+0000","last_became_active":"2024-09-17T01:48:40.956114+0000","last_became_peered":"2024-09-17T01:48:40.956114+0000","last_unstale":"2024-09-17T01:48:42.966052+0000","last_undegraded":"2024-09-17T01:48:42.966052+0000","last_fullsized":"2024-09-17T01:48:42.966052+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:25.002380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.10","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461069+0000","last_change":"2024-09-17T01:48:41.975846+0000","last_active":"2024-09-17T01:48:44.461069+0000","last_peered":"2024-09-17T01:48:44.461069+0000","last_clean":"2024-09-17T01:48:44.461069+0000","last_became_active":"2024-09-17T01:48:41.975443+0000","last_became_peered":"2024-09-17T01:48:41.975443+0000","last_unstale":"2024-09-17T01:48:44.461069+0000","last_undegraded":"2024-09-17T01:48:44.461069+0000","last_fullsized":"2024-09-17T01:48:44.461069+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:52:23.341819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965173+0000","last_change":"2024-09-17T01:48:40.962362+0000","last_active":"2024-09-17T01:48:42.965173+0000","last_peered":"2024-09-17T01:48:42.965173+0000","last_clean":"2024-09-17T01:48:42.965173+0000","last_became_active":"2024-09-17T01:48:40.961975+0000","last_became_peered":"2024-09-17T01:48:40.961975+0000","last_unstale":"2024-09-17T01:48:42.965173+0000","last_undegraded":"2024-09-17T01:48:42.965173+0000","last_fullsized":"2024-09-17T01:48:42.965173+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:17.865320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965577+0000","last_change":"2024-09-17T01:48:41.975201+0000","last_active":"2024-09-17T01:48:42.965577+0000","last_peered":"2024-09-17T01:48:42.965577+0000","last_clean":"2024-09-17T01:48:42.965577+0000","last_became_active":"2024-09-17T01:48:41.974581+0000","last_became_peered":"2024-09-17T01:48:41.974581+0000","last_unstale":"2024-09-17T01:48:42.965577+0000","last_undegraded":"2024-09-17T01:48:42.965577+0000","last_fullsized":"2024-09-17T01:48:42.965577+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:20.028457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.10","version":"212'8","reported_seq":21,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.988351+0000","last_change":"2024-09-17T01:48:40.962920+0000","last_active":"2024-09-17T01:48:41.988351+0000","last_peered":"2024-09-17T01:48:41.988351+0000","last_clean":"2024-09-17T01:48:41.988351+0000","last_became_active":"2024-09-17T01:48:40.962230+0000","last_became_peered":"2024-09-17T01:48:40.962230+0000","last_unstale":"2024-09-17T01:48:41.988351+0000","last_undegraded":"2024-09-17T01:48:41.988351+0000","last_fullsized":"2024-09-17T01:48:41.988351+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:43.167939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.e","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462192+0000","last_change":"2024-09-17T01:48:41.967242+0000","last_active":"2024-09-17T01:48:44.462192+0000","last_peered":"2024-09-17T01:48:44.462192+0000","last_clean":"2024-09-17T01:48:44.462192+0000","last_became_active":"2024-09-17T01:48:41.966892+0000","last_became_peered":"2024-09-17T01:48:41.966892+0000","last_unstale":"2024-09-17T01:48:44.462192+0000","last_undegraded":"2024-09-17T01:48:44.462192+0000","last_fullsized":"2024-09-17T01:48:44.462192+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:29.649430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.f","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966375+0000","last_change":"2024-09-17T01:48:40.958540+0000","last_active":"2024-09-17T01:48:42.966375+0000","last_peered":"2024-09-17T01:48:42.966375+0000","last_clean":"2024-09-17T01:48:42.966375+0000","last_became_active":"2024-09-17T01:48:40.958209+0000","last_became_peered":"2024-09-17T01:48:40.958209+0000","last_unstale":"2024-09-17T01:48:42.966375+0000","last_undegraded":"2024-09-17T01:48:42.966375+0000","last_fullsized":"2024-09-17T01:48:42.966375+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:02.660884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.f","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.975961+0000","last_change":"2024-09-17T01:48:41.968961+0000","last_active":"2024-09-17T01:48:41.975961+0000","last_peered":"2024-09-17T01:48:41.975961+0000","last_clean":"2024-09-17T01:48:41.975961+0000","last_became_active":"2024-09-17T01:48:41.968609+0000","last_became_peered":"2024-09-17T01:48:41.968609+0000","last_unstale":"2024-09-17T01:48:41.975961+0000","last_undegraded":"2024-09-17T01:48:41.975961+0000","last_fullsized":"2024-09-17T01:48:41.975961+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:00.830194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.e","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967385+0000","last_change":"2024-09-17T01:48:40.958112+0000","last_active":"2024-09-17T01:48:42.967385+0000","last_peered":"2024-09-17T01:48:42.967385+0000","last_clean":"2024-09-17T01:48:42.967385+0000","last_became_active":"2024-09-17T01:48:40.957765+0000","last_became_peered":"2024-09-17T01:48:40.957765+0000","last_unstale":"2024-09-17T01:48:42.967385+0000","last_undegraded":"2024-09-17T01:48:42.967385+0000","last_fullsized":"2024-09-17T01:48:42.967385+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:33.429311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966144+0000","last_change":"2024-09-17T01:48:41.962826+0000","last_active":"2024-09-17T01:48:42.966144+0000","last_peered":"2024-09-17T01:48:42.966144+0000","last_clean":"2024-09-17T01:48:42.966144+0000","last_became_active":"2024-09-17T01:48:41.962494+0000","last_became_peered":"2024-09-17T01:48:41.962494+0000","last_unstale":"2024-09-17T01:48:42.966144+0000","last_undegraded":"2024-09-17T01:48:42.966144+0000","last_fullsized":"2024-09-17T01:48:42.966144+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:37.163100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.d","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966115+0000","last_change":"2024-09-17T01:48:40.960604+0000","last_active":"2024-09-17T01:48:42.966115+0000","last_peered":"2024-09-17T01:48:42.966115+0000","last_clean":"2024-09-17T01:48:42.966115+0000","last_became_active":"2024-09-17T01:48:40.960047+0000","last_became_peered":"2024-09-17T01:48:40.960047+0000","last_unstale":"2024-09-17T01:48:42.966115+0000","last_undegraded":"2024-09-17T01:48:42.966115+0000","last_fullsized":"2024-09-17T01:48:42.966115+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:01.691297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.d","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393460+0000","last_change":"2024-09-17T01:48:41.961193+0000","last_active":"2024-09-17T01:48:43.393460+0000","last_peered":"2024-09-17T01:48:43.393460+0000","last_clean":"2024-09-17T01:48:43.393460+0000","last_became_active":"2024-09-17T01:48:41.960675+0000","last_became_peered":"2024-09-17T01:48:41.960675+0000","last_unstale":"2024-09-17T01:48:43.393460+0000","last_undegraded":"2024-09-17T01:48:43.393460+0000","last_fullsized":"2024-09-17T01:48:43.393460+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:45:20.974258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966870+0000","last_change":"2024-09-17T01:48:40.969612+0000","last_active":"2024-09-17T01:48:42.966870+0000","last_peered":"2024-09-17T01:48:42.966870+0000","last_clean":"2024-09-17T01:48:42.966870+0000","last_became_active":"2024-09-17T01:48:40.969131+0000","last_became_peered":"2024-09-17T01:48:40.969131+0000","last_unstale":"2024-09-17T01:48:42.966870+0000","last_undegraded":"2024-09-17T01:48:42.966870+0000","last_fullsized":"2024-09-17T01:48:42.966870+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:06.914057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:48:40.932243+0000","last_change":"2024-09-17T01:48:40.932243+0000","last_active":"2024-09-17T01:48:40.932243+0000","last_peered":"2024-09-17T01:48:40.932243+0000","last_clean":"2024-09-17T01:48:40.932243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:48:40.932243+0000","last_undegraded":"2024-09-17T01:48:40.932243+0000","last_fullsized":"2024-09-17T01:48:40.932243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.b","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966523+0000","last_change":"2024-09-17T01:48:40.954645+0000","last_active":"2024-09-17T01:48:42.966523+0000","last_peered":"2024-09-17T01:48:42.966523+0000","last_clean":"2024-09-17T01:48:42.966523+0000","last_became_active":"2024-09-17T01:48:40.954314+0000","last_became_peered":"2024-09-17T01:48:40.954314+0000","last_unstale":"2024-09-17T01:48:42.966523+0000","last_undegraded":"2024-09-17T01:48:42.966523+0000","last_fullsized":"2024-09-17T01:48:42.966523+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:03.890846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.b","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966366+0000","last_change":"2024-09-17T01:48:41.962675+0000","last_active":"2024-09-17T01:48:42.966366+0000","last_peered":"2024-09-17T01:48:42.966366+0000","last_clean":"2024-09-17T01:48:42.966366+0000","last_became_active":"2024-09-17T01:48:41.960185+0000","last_became_peered":"2024-09-17T01:48:41.960185+0000","last_unstale":"2024-09-17T01:48:42.966366+0000","last_undegraded":"2024-09-17T01:48:42.966366+0000","last_fullsized":"2024-09-17T01:48:42.966366+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:53.273110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966188+0000","last_change":"2024-09-17T01:48:40.957409+0000","last_active":"2024-09-17T01:48:42.966188+0000","last_peered":"2024-09-17T01:48:42.966188+0000","last_clean":"2024-09-17T01:48:42.966188+0000","last_became_active":"2024-09-17T01:48:40.957076+0000","last_became_peered":"2024-09-17T01:48:40.957076+0000","last_unstale":"2024-09-17T01:48:42.966188+0000","last_undegraded":"2024-09-17T01:48:42.966188+0000","last_fullsized":"2024-09-17T01:48:42.966188+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:09.169291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.460832+0000","last_change":"2024-09-17T01:48:41.972315+0000","last_active":"2024-09-17T01:48:44.460832+0000","last_peered":"2024-09-17T01:48:44.460832+0000","last_clean":"2024-09-17T01:48:44.460832+0000","last_became_active":"2024-09-17T01:48:41.964814+0000","last_became_peered":"2024-09-17T01:48:41.964814+0000","last_unstale":"2024-09-17T01:48:44.460832+0000","last_undegraded":"2024-09-17T01:48:44.460832+0000","last_fullsized":"2024-09-17T01:48:44.460832+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:44.993483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393202+0000","last_change":"2024-09-17T01:48:40.960091+0000","last_active":"2024-09-17T01:48:43.393202+0000","last_peered":"2024-09-17T01:48:43.393202+0000","last_clean":"2024-09-17T01:48:43.393202+0000","last_became_active":"2024-09-17T01:48:40.959708+0000","last_became_peered":"2024-09-17T01:48:40.959708+0000","last_unstale":"2024-09-17T01:48:43.393202+0000","last_undegraded":"2024-09-17T01:48:43.393202+0000","last_fullsized":"2024-09-17T01:48:43.393202+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:14.069903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965102+0000","last_change":"2024-09-17T01:48:41.954668+0000","last_active":"2024-09-17T01:48:42.965102+0000","last_peered":"2024-09-17T01:48:42.965102+0000","last_clean":"2024-09-17T01:48:42.965102+0000","last_became_active":"2024-09-17T01:48:41.953453+0000","last_became_peered":"2024-09-17T01:48:41.953453+0000","last_unstale":"2024-09-17T01:48:42.965102+0000","last_undegraded":"2024-09-17T01:48:42.965102+0000","last_fullsized":"2024-09-17T01:48:42.965102+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:56.732819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393455+0000","last_change":"2024-09-17T01:48:40.954364+0000","last_active":"2024-09-17T01:48:43.393455+0000","last_peered":"2024-09-17T01:48:43.393455+0000","last_clean":"2024-09-17T01:48:43.393455+0000","last_became_active":"2024-09-17T01:48:40.952633+0000","last_became_peered":"2024-09-17T01:48:40.952633+0000","last_unstale":"2024-09-17T01:48:43.393455+0000","last_undegraded":"2024-09-17T01:48:43.393455+0000","last_fullsized":"2024-09-17T01:48:43.393455+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:14.968860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966306+0000","last_change":"2024-09-17T01:48:41.980321+0000","last_active":"2024-09-17T01:48:42.966306+0000","last_peered":"2024-09-17T01:48:42.966306+0000","last_clean":"2024-09-17T01:48:42.966306+0000","last_became_active":"2024-09-17T01:48:41.979988+0000","last_became_peered":"2024-09-17T01:48:41.979988+0000","last_unstale":"2024-09-17T01:48:42.966306+0000","last_undegraded":"2024-09-17T01:48:42.966306+0000","last_fullsized":"2024-09-17T01:48:42.966306+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:44.682690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.7","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967542+0000","last_change":"2024-09-17T01:48:40.968513+0000","last_active":"2024-09-17T01:48:42.967542+0000","last_peered":"2024-09-17T01:48:42.967542+0000","last_clean":"2024-09-17T01:48:42.967542+0000","last_became_active":"2024-09-17T01:48:40.968147+0000","last_became_peered":"2024-09-17T01:48:40.968147+0000","last_unstale":"2024-09-17T01:48:42.967542+0000","last_undegraded":"2024-09-17T01:48:42.967542+0000","last_fullsized":"2024-09-17T01:48:42.967542+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:50.333573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.7","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450551+0000","last_change":"2024-09-17T01:48:41.995352+0000","last_active":"2024-09-17T01:48:43.450551+0000","last_peered":"2024-09-17T01:48:43.450551+0000","last_clean":"2024-09-17T01:48:43.450551+0000","last_became_active":"2024-09-17T01:48:41.995020+0000","last_became_peered":"2024-09-17T01:48:41.995020+0000","last_unstale":"2024-09-17T01:48:43.450551+0000","last_undegraded":"2024-09-17T01:48:43.450551+0000","last_fullsized":"2024-09-17T01:48:43.450551+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:15.035889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-17T01:48:39.938589+0000","last_change":"2024-09-17T01:48:39.938589+0000","last_active":"2024-09-17T01:48:39.926912+0000","last_peered":"2024-09-17T01:48:39.926912+0000","last_clean":"2024-09-17T01:48:39.926912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:48:39.938589+0000","last_undegraded":"2024-09-17T01:48:39.938589+0000","last_fullsized":"2024-09-17T01:48:39.938589+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461879+0000","last_change":"2024-09-17T01:48:41.987120+0000","last_active":"2024-09-17T01:48:44.461879+0000","last_peered":"2024-09-17T01:48:44.461879+0000","last_clean":"2024-09-17T01:48:44.461879+0000","last_became_active":"2024-09-17T01:48:41.986788+0000","last_became_peered":"2024-09-17T01:48:41.986788+0000","last_unstale":"2024-09-17T01:48:44.461879+0000","last_undegraded":"2024-09-17T01:48:44.461879+0000","last_fullsized":"2024-09-17T01:48:44.461879+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:45.285758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964804+0000","last_change":"2024-09-17T01:48:40.964922+0000","last_active":"2024-09-17T01:48:42.964804+0000","last_peered":"2024-09-17T01:48:42.964804+0000","last_clean":"2024-09-17T01:48:42.964804+0000","last_became_active":"2024-09-17T01:48:40.964564+0000","last_became_peered":"2024-09-17T01:48:40.964564+0000","last_unstale":"2024-09-17T01:48:42.964804+0000","last_undegraded":"2024-09-17T01:48:42.964804+0000","last_fullsized":"2024-09-17T01:48:42.964804+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:17.144236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966915+0000","last_change":"2024-09-17T01:48:41.983739+0000","last_active":"2024-09-17T01:48:42.966915+0000","last_peered":"2024-09-17T01:48:42.966915+0000","last_clean":"2024-09-17T01:48:42.966915+0000","last_became_active":"2024-09-17T01:48:41.983417+0000","last_became_peered":"2024-09-17T01:48:41.983417+0000","last_unstale":"2024-09-17T01:48:42.966915+0000","last_undegraded":"2024-09-17T01:48:42.966915+0000","last_fullsized":"2024-09-17T01:48:42.966915+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:25.410155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967262+0000","last_change":"2024-09-17T01:48:40.961630+0000","last_active":"2024-09-17T01:48:42.967262+0000","last_peered":"2024-09-17T01:48:42.967262+0000","last_clean":"2024-09-17T01:48:42.967262+0000","last_became_active":"2024-09-17T01:48:40.960243+0000","last_became_peered":"2024-09-17T01:48:40.960243+0000","last_unstale":"2024-09-17T01:48:42.967262+0000","last_undegraded":"2024-09-17T01:48:42.967262+0000","last_fullsized":"2024-09-17T01:48:42.967262+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:02.136066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:48:40.932243+0000","last_change":"2024-09-17T01:48:40.932243+0000","last_active":"2024-09-17T01:48:40.932243+0000","last_peered":"2024-09-17T01:48:40.932243+0000","last_clean":"2024-09-17T01:48:40.932243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:48:40.932243+0000","last_undegraded":"2024-09-17T01:48:40.932243+0000","last_fullsized":"2024-09-17T01:48:40.932243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965967+0000","last_change":"2024-09-17T01:48:40.956231+0000","last_active":"2024-09-17T01:48:42.965967+0000","last_peered":"2024-09-17T01:48:42.965967+0000","last_clean":"2024-09-17T01:48:42.965967+0000","last_became_active":"2024-09-17T01:48:40.955414+0000","last_became_peered":"2024-09-17T01:48:40.955414+0000","last_unstale":"2024-09-17T01:48:42.965967+0000","last_undegraded":"2024-09-17T01:48:42.965967+0000","last_fullsized":"2024-09-17T01:48:42.965967+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:39.323864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964920+0000","last_change":"2024-09-17T01:48:41.968153+0000","last_active":"2024-09-17T01:48:42.964920+0000","last_peered":"2024-09-17T01:48:42.964920+0000","last_clean":"2024-09-17T01:48:42.964920+0000","last_became_active":"2024-09-17T01:48:41.967605+0000","last_became_peered":"2024-09-17T01:48:41.967605+0000","last_unstale":"2024-09-17T01:48:42.964920+0000","last_undegraded":"2024-09-17T01:48:42.964920+0000","last_fullsized":"2024-09-17T01:48:42.964920+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:16.656430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461708+0000","last_change":"2024-09-17T01:48:40.961888+0000","last_active":"2024-09-17T01:48:44.461708+0000","last_peered":"2024-09-17T01:48:44.461708+0000","last_clean":"2024-09-17T01:48:44.461708+0000","last_became_active":"2024-09-17T01:48:40.960057+0000","last_became_peered":"2024-09-17T01:48:40.960057+0000","last_unstale":"2024-09-17T01:48:44.461708+0000","last_undegraded":"2024-09-17T01:48:44.461708+0000","last_fullsized":"2024-09-17T01:48:44.461708+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:01.691297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393545+0000","last_change":"2024-09-17T01:48:41.964119+0000","last_active":"2024-09-17T01:48:43.393545+0000","last_peered":"2024-09-17T01:48:43.393545+0000","last_clean":"2024-09-17T01:48:43.393545+0000","last_became_active":"2024-09-17T01:48:41.963688+0000","last_became_peered":"2024-09-17T01:48:41.963688+0000","last_unstale":"2024-09-17T01:48:43.393545+0000","last_undegraded":"2024-09-17T01:48:43.393545+0000","last_fullsized":"2024-09-17T01:48:43.393545+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:26:24.176532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.449918+0000","last_change":"2024-09-17T01:48:40.970410+0000","last_active":"2024-09-17T01:48:43.449918+0000","last_peered":"2024-09-17T01:48:43.449918+0000","last_clean":"2024-09-17T01:48:43.449918+0000","last_became_active":"2024-09-17T01:48:40.969725+0000","last_became_peered":"2024-09-17T01:48:40.969725+0000","last_unstale":"2024-09-17T01:48:43.449918+0000","last_undegraded":"2024-09-17T01:48:43.449918+0000","last_fullsized":"2024-09-17T01:48:43.449918+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:59.674013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450122+0000","last_change":"2024-09-17T01:48:41.987710+0000","last_active":"2024-09-17T01:48:43.450122+0000","last_peered":"2024-09-17T01:48:43.450122+0000","last_clean":"2024-09-17T01:48:43.450122+0000","last_became_active":"2024-09-17T01:48:41.983328+0000","last_became_peered":"2024-09-17T01:48:41.983328+0000","last_unstale":"2024-09-17T01:48:43.450122+0000","last_undegraded":"2024-09-17T01:48:43.450122+0000","last_fullsized":"2024-09-17T01:48:43.450122+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:19.736187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.956387+0000","last_change":"2024-09-17T01:48:40.963242+0000","last_active":"2024-09-17T01:48:41.956387+0000","last_peered":"2024-09-17T01:48:41.956387+0000","last_clean":"2024-09-17T01:48:41.956387+0000","last_became_active":"2024-09-17T01:48:40.962603+0000","last_became_peered":"2024-09-17T01:48:40.962603+0000","last_unstale":"2024-09-17T01:48:41.956387+0000","last_undegraded":"2024-09-17T01:48:41.956387+0000","last_fullsized":"2024-09-17T01:48:41.956387+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:04:09.145533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1e","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393421+0000","last_change":"2024-09-17T01:48:41.959892+0000","last_active":"2024-09-17T01:48:43.393421+0000","last_peered":"2024-09-17T01:48:43.393421+0000","last_clean":"2024-09-17T01:48:43.393421+0000","last_became_active":"2024-09-17T01:48:41.959602+0000","last_became_peered":"2024-09-17T01:48:41.959602+0000","last_unstale":"2024-09-17T01:48:43.393421+0000","last_undegraded":"2024-09-17T01:48:43.393421+0000","last_fullsized":"2024-09-17T01:48:43.393421+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:20.244068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.1f","version":"212'4","reported_seq":19,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450730+0000","last_change":"2024-09-17T01:48:40.970365+0000","last_active":"2024-09-17T01:48:43.450730+0000","last_peered":"2024-09-17T01:48:43.450730+0000","last_clean":"2024-09-17T01:48:43.450730+0000","last_became_active":"2024-09-17T01:48:40.969386+0000","last_became_peered":"2024-09-17T01:48:40.969386+0000","last_unstale":"2024-09-17T01:48:43.450730+0000","last_undegraded":"2024-09-17T01:48:43.450730+0000","last_fullsized":"2024-09-17T01:48:43.450730+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:05.396682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":478,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964191+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:48:42.964191+0000","last_peered":"2024-09-17T01:48:42.964191+0000","last_clean":"2024-09-17T01:48:42.964191+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:48:42.964191+0000","last_undegraded":"2024-09-17T01:48:42.964191+0000","last_fullsized":"2024-09-17T01:48:42.964191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":31,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":30,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476941,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47660,"kb_used_data":2584,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324180,"statfs":{"total":96636764160,"available":96587960320,"internally_reserved":0,"allocated":2646016,"data_stored":1169580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509645,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56036,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315804,"statfs":{"total":96636764160,"available":96579383296,"internally_reserved":0,"allocated":2703360,"data_stored":1191158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509644,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47688,"kb_used_data":2612,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324152,"statfs":{"total":96636764160,"available":96587931648,"internally_reserved":0,"allocated":2674688,"data_stored":1182720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509645,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51860,"kb_used_data":2624,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319980,"statfs":{"total":96636764160,"available":96583659520,"internally_reserved":0,"allocated":2686976,"data_stored":1188952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509645,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69852,"kb_used_data":2632,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94301988,"statfs":{"total":96636764160,"available":96565235712,"internally_reserved":0,"allocated":2695168,"data_stored":1190542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509644,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52440,"kb_used_data":3204,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319400,"statfs":{"total":96636764160,"available":96583065600,"internally_reserved":0,"allocated":3280896,"data_stored":1779880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509646,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60184,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311656,"statfs":{"total":96636764160,"available":96575135744,"internally_reserved":0,"allocated":2691072,"data_stored":1189022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":58915273},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542350,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52440,"kb_used_data":3196,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319400,"statfs":{"total":96636764160,"available":96583065600,"internally_reserved":0,"allocated":3272704,"data_stored":1773122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:48:46.440 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:48:46.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.701+0000 7f939fa00640 1 -- 172.21.15.42:0/1154403914 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f939815d270 msgr2=0x7f939815d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:46.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.701+0000 7f939fa00640 1 --2- 172.21.15.42:0/1154403914 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f939815d270 0x7f939815d680 secure :-1 s=READY pgs=2425 cs=0 l=1 rev1=1 crypto rx=0x7f9390005fd0 tx=0x7f939002aa00 comp rx=0 tx=0).stop 2024-09-17T01:48:46.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.701+0000 7f939fa00640 1 -- 172.21.15.42:0/1154403914 shutdown_connections 2024-09-17T01:48:46.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.701+0000 7f939fa00640 1 --2- 172.21.15.42:0/1154403914 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f939815d270 0x7f939815d680 unknown :-1 s=CLOSED pgs=2425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:46.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.701+0000 7f939fa00640 1 --2- 172.21.15.42:0/1154403914 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f93980cde30 0x7f93980ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:46.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.701+0000 7f939fa00640 1 -- 172.21.15.42:0/1154403914 >> 172.21.15.42:0/1154403914 conn(0x7f939806d1b0 msgr2=0x7f939806d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:46.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.701+0000 7f939fa00640 1 -- 172.21.15.42:0/1154403914 shutdown_connections 2024-09-17T01:48:46.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.701+0000 7f939fa00640 1 -- 172.21.15.42:0/1154403914 wait complete. 2024-09-17T01:48:46.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.703+0000 7f939fa00640 1 Processor -- start 2024-09-17T01:48:46.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.703+0000 7f939fa00640 1 -- start start 2024-09-17T01:48:46.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.705+0000 7f939fa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93980cf200 0x7f93981f5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:46.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.705+0000 7f939fa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f939815d270 0x7f93980b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:46.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.705+0000 7f939fa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f93981f9050 0x7f93981e66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:46.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.705+0000 7f939fa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f939806ef30 con 0x7f93980cf200 2024-09-17T01:48:46.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.705+0000 7f939fa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f939806edb0 con 0x7f939815d270 2024-09-17T01:48:46.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.705+0000 7f939fa00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f939806f0b0 con 0x7f93981f9050 2024-09-17T01:48:46.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.705+0000 7f939d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93980cf200 0x7f93981f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:46.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.705+0000 7f939d000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93980cf200 0x7f93981f5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45738/0 (socket says 172.21.15.42:45738) 2024-09-17T01:48:46.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.705+0000 7f939d000640 1 -- 172.21.15.42:0/1295256521 learned_addr learned my addr 172.21.15.42:0/1295256521 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:46.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.706+0000 7f9397e00640 1 --2- 172.21.15.42:0/1295256521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f939815d270 0x7f93980b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:46.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.706+0000 7f939d000640 1 -- 172.21.15.42:0/1295256521 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f93981f9050 msgr2=0x7f93981e66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:46.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.706+0000 7f939d000640 1 --2- 172.21.15.42:0/1295256521 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f93981f9050 0x7f93981e66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:46.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.706+0000 7f939d000640 1 -- 172.21.15.42:0/1295256521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f939815d270 msgr2=0x7f93980b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:46.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.706+0000 7f939d000640 1 --2- 172.21.15.42:0/1295256521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f939815d270 0x7f93980b4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:46.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.706+0000 7f939d000640 1 -- 172.21.15.42:0/1295256521 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93980b5520 con 0x7f93980cf200 2024-09-17T01:48:46.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.706+0000 7f9397e00640 1 --2- 172.21.15.42:0/1295256521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f939815d270 0x7f93980b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:48:46.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.706+0000 7f939d000640 1 --2- 172.21.15.42:0/1295256521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93980cf200 0x7f93981f5420 secure :-1 s=READY pgs=2426 cs=0 l=1 rev1=1 crypto rx=0x7f938c00c370 tx=0x7f938c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:46.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.706+0000 7f9394c00640 1 -- 172.21.15.42:0/1295256521 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c0052d0 con 0x7f93980cf200 2024-09-17T01:48:46.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.706+0000 7f9394c00640 1 -- 172.21.15.42:0/1295256521 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f938c007020 con 0x7f93980cf200 2024-09-17T01:48:46.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.706+0000 7f9394c00640 1 -- 172.21.15.42:0/1295256521 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c007470 con 0x7f93980cf200 2024-09-17T01:48:46.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.706+0000 7f939fa00640 1 -- 172.21.15.42:0/1295256521 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93981f9af0 con 0x7f93980cf200 2024-09-17T01:48:46.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.706+0000 7f939fa00640 1 -- 172.21.15.42:0/1295256521 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93980b47e0 con 0x7f93980cf200 2024-09-17T01:48:46.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.707+0000 7f939fa00640 1 -- 172.21.15.42:0/1295256521 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93980b45d0 con 0x7f93980cf200 2024-09-17T01:48:46.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.708+0000 7f9394c00640 1 -- 172.21.15.42:0/1295256521 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f938c0067d0 con 0x7f93980cf200 2024-09-17T01:48:46.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.710+0000 7f9394c00640 1 --2- 172.21.15.42:0/1295256521 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9378078bc0 0x7f937807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:46.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.710+0000 7f9394c00640 1 -- 172.21.15.42:0/1295256521 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(213..213 src has 1..213) ==== 5709+0+0 (secure 0 0 0) 0x7f938c09a300 con 0x7f93980cf200 2024-09-17T01:48:46.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.710+0000 7f9397e00640 1 --2- 172.21.15.42:0/1295256521 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9378078bc0 0x7f937807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:46.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.711+0000 7f9397e00640 1 --2- 172.21.15.42:0/1295256521 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9378078bc0 0x7f937807b0d0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f9384005fd0 tx=0x7f9384005d40 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:46.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.715+0000 7f9394c00640 1 -- 172.21.15.42:0/1295256521 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f938c062620 con 0x7f93980cf200 2024-09-17T01:48:46.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.905+0000 7f939fa00640 1 -- 172.21.15.42:0/1295256521 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f939806f560 con 0x7f9378078bc0 2024-09-17T01:48:46.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.911+0000 7f9394c00640 1 -- 172.21.15.42:0/1295256521 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250975 (secure 0 0 0) 0x7f939806f560 con 0x7f9378078bc0 2024-09-17T01:48:46.911 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:48:46.912 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:48:46.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.914+0000 7f939fa00640 1 -- 172.21.15.42:0/1295256521 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9378078bc0 msgr2=0x7f937807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:46.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.914+0000 7f939fa00640 1 --2- 172.21.15.42:0/1295256521 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9378078bc0 0x7f937807b0d0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f9384005fd0 tx=0x7f9384005d40 comp rx=0 tx=0).stop 2024-09-17T01:48:46.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.914+0000 7f939fa00640 1 -- 172.21.15.42:0/1295256521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93980cf200 msgr2=0x7f93981f5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:46.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.914+0000 7f939fa00640 1 --2- 172.21.15.42:0/1295256521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93980cf200 0x7f93981f5420 secure :-1 s=READY pgs=2426 cs=0 l=1 rev1=1 crypto rx=0x7f938c00c370 tx=0x7f938c00c830 comp rx=0 tx=0).stop 2024-09-17T01:48:46.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.914+0000 7f939fa00640 1 -- 172.21.15.42:0/1295256521 shutdown_connections 2024-09-17T01:48:46.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.914+0000 7f939fa00640 1 --2- 172.21.15.42:0/1295256521 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9378078bc0 0x7f937807b0d0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:46.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.914+0000 7f939fa00640 1 --2- 172.21.15.42:0/1295256521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f939815d270 0x7f93980b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:46.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.914+0000 7f939fa00640 1 --2- 172.21.15.42:0/1295256521 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f93981f9050 0x7f93981e66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:46.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.914+0000 7f939fa00640 1 --2- 172.21.15.42:0/1295256521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93980cf200 0x7f93981f5420 unknown :-1 s=CLOSED pgs=2426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:46.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.914+0000 7f939fa00640 1 -- 172.21.15.42:0/1295256521 >> 172.21.15.42:0/1295256521 conn(0x7f939806d1b0 msgr2=0x7f939815c360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:46.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.915+0000 7f939fa00640 1 -- 172.21.15.42:0/1295256521 shutdown_connections 2024-09-17T01:48:46.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:46.915+0000 7f939fa00640 1 -- 172.21.15.42:0/1295256521 wait complete. 2024-09-17T01:48:46.934 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":712,"stamp":"2024-09-17T01:48:45.267372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":438160,"kb_used_data":22120,"kb_used_omap":12,"kb_used_meta":415859,"kb_avail":754536560,"statfs":{"total":773094113280,"available":772645437440,"internally_reserved":0,"allocated":22650880,"data_stored":10664976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":425840180},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.334003"},"pg_stats":[{"pgid":"31.3f","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450608+0000","last_change":"2024-09-17T01:48:41.988421+0000","last_active":"2024-09-17T01:48:43.450608+0000","last_peered":"2024-09-17T01:48:43.450608+0000","last_clean":"2024-09-17T01:48:43.450608+0000","last_became_active":"2024-09-17T01:48:41.988099+0000","last_became_peered":"2024-09-17T01:48:41.988099+0000","last_unstale":"2024-09-17T01:48:43.450608+0000","last_undegraded":"2024-09-17T01:48:43.450608+0000","last_fullsized":"2024-09-17T01:48:43.450608+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:10.721737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.3e","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.967821+0000","last_change":"2024-09-17T01:48:41.965330+0000","last_active":"2024-09-17T01:48:41.967821+0000","last_peered":"2024-09-17T01:48:41.967821+0000","last_clean":"2024-09-17T01:48:41.967821+0000","last_became_active":"2024-09-17T01:48:41.964988+0000","last_became_peered":"2024-09-17T01:48:41.964988+0000","last_unstale":"2024-09-17T01:48:41.967821+0000","last_undegraded":"2024-09-17T01:48:41.967821+0000","last_fullsized":"2024-09-17T01:48:41.967821+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:50:47.522773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.3d","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450523+0000","last_change":"2024-09-17T01:48:41.992476+0000","last_active":"2024-09-17T01:48:43.450523+0000","last_peered":"2024-09-17T01:48:43.450523+0000","last_clean":"2024-09-17T01:48:43.450523+0000","last_became_active":"2024-09-17T01:48:41.992130+0000","last_became_peered":"2024-09-17T01:48:41.992130+0000","last_unstale":"2024-09-17T01:48:43.450523+0000","last_undegraded":"2024-09-17T01:48:43.450523+0000","last_fullsized":"2024-09-17T01:48:43.450523+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:15:15.143150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.3c","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966650+0000","last_change":"2024-09-17T01:48:41.969707+0000","last_active":"2024-09-17T01:48:42.966650+0000","last_peered":"2024-09-17T01:48:42.966650+0000","last_clean":"2024-09-17T01:48:42.966650+0000","last_became_active":"2024-09-17T01:48:41.967489+0000","last_became_peered":"2024-09-17T01:48:41.967489+0000","last_unstale":"2024-09-17T01:48:42.966650+0000","last_undegraded":"2024-09-17T01:48:42.966650+0000","last_fullsized":"2024-09-17T01:48:42.966650+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:22.342311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.3b","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964633+0000","last_change":"2024-09-17T01:48:41.956894+0000","last_active":"2024-09-17T01:48:42.964633+0000","last_peered":"2024-09-17T01:48:42.964633+0000","last_clean":"2024-09-17T01:48:42.964633+0000","last_became_active":"2024-09-17T01:48:41.956533+0000","last_became_peered":"2024-09-17T01:48:41.956533+0000","last_unstale":"2024-09-17T01:48:42.964633+0000","last_undegraded":"2024-09-17T01:48:42.964633+0000","last_fullsized":"2024-09-17T01:48:42.964633+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:43.230899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.3a","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450111+0000","last_change":"2024-09-17T01:48:41.989695+0000","last_active":"2024-09-17T01:48:43.450111+0000","last_peered":"2024-09-17T01:48:43.450111+0000","last_clean":"2024-09-17T01:48:43.450111+0000","last_became_active":"2024-09-17T01:48:41.988985+0000","last_became_peered":"2024-09-17T01:48:41.988985+0000","last_unstale":"2024-09-17T01:48:43.450111+0000","last_undegraded":"2024-09-17T01:48:43.450111+0000","last_fullsized":"2024-09-17T01:48:43.450111+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:56:47.447939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.39","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393200+0000","last_change":"2024-09-17T01:48:41.963394+0000","last_active":"2024-09-17T01:48:43.393200+0000","last_peered":"2024-09-17T01:48:43.393200+0000","last_clean":"2024-09-17T01:48:43.393200+0000","last_became_active":"2024-09-17T01:48:41.963064+0000","last_became_peered":"2024-09-17T01:48:41.963064+0000","last_unstale":"2024-09-17T01:48:43.393200+0000","last_undegraded":"2024-09-17T01:48:43.393200+0000","last_fullsized":"2024-09-17T01:48:43.393200+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:50.099904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.38","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964389+0000","last_change":"2024-09-17T01:48:41.963873+0000","last_active":"2024-09-17T01:48:42.964389+0000","last_peered":"2024-09-17T01:48:42.964389+0000","last_clean":"2024-09-17T01:48:42.964389+0000","last_became_active":"2024-09-17T01:48:41.960583+0000","last_became_peered":"2024-09-17T01:48:41.960583+0000","last_unstale":"2024-09-17T01:48:42.964389+0000","last_undegraded":"2024-09-17T01:48:42.964389+0000","last_fullsized":"2024-09-17T01:48:42.964389+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:31.451012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:48:40.932243+0000","last_change":"2024-09-17T01:48:40.932243+0000","last_active":"2024-09-17T01:48:40.932243+0000","last_peered":"2024-09-17T01:48:40.932243+0000","last_clean":"2024-09-17T01:48:40.932243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:48:40.932243+0000","last_undegraded":"2024-09-17T01:48:40.932243+0000","last_fullsized":"2024-09-17T01:48:40.932243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.36","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393240+0000","last_change":"2024-09-17T01:48:41.963101+0000","last_active":"2024-09-17T01:48:43.393240+0000","last_peered":"2024-09-17T01:48:43.393240+0000","last_clean":"2024-09-17T01:48:43.393240+0000","last_became_active":"2024-09-17T01:48:41.961668+0000","last_became_peered":"2024-09-17T01:48:41.961668+0000","last_unstale":"2024-09-17T01:48:43.393240+0000","last_undegraded":"2024-09-17T01:48:43.393240+0000","last_fullsized":"2024-09-17T01:48:43.393240+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:30.142847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.35","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967097+0000","last_change":"2024-09-17T01:48:41.992165+0000","last_active":"2024-09-17T01:48:42.967097+0000","last_peered":"2024-09-17T01:48:42.967097+0000","last_clean":"2024-09-17T01:48:42.967097+0000","last_became_active":"2024-09-17T01:48:41.991821+0000","last_became_peered":"2024-09-17T01:48:41.991821+0000","last_unstale":"2024-09-17T01:48:42.967097+0000","last_undegraded":"2024-09-17T01:48:42.967097+0000","last_fullsized":"2024-09-17T01:48:42.967097+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:26.331280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.34","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393530+0000","last_change":"2024-09-17T01:48:41.973919+0000","last_active":"2024-09-17T01:48:43.393530+0000","last_peered":"2024-09-17T01:48:43.393530+0000","last_clean":"2024-09-17T01:48:43.393530+0000","last_became_active":"2024-09-17T01:48:41.973559+0000","last_became_peered":"2024-09-17T01:48:41.973559+0000","last_unstale":"2024-09-17T01:48:43.393530+0000","last_undegraded":"2024-09-17T01:48:43.393530+0000","last_fullsized":"2024-09-17T01:48:43.393530+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:45.600564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:48:40.932243+0000","last_change":"2024-09-17T01:48:40.932243+0000","last_active":"2024-09-17T01:48:40.932243+0000","last_peered":"2024-09-17T01:48:40.932243+0000","last_clean":"2024-09-17T01:48:40.932243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:48:40.932243+0000","last_undegraded":"2024-09-17T01:48:40.932243+0000","last_fullsized":"2024-09-17T01:48:40.932243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.32","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966149+0000","last_change":"2024-09-17T01:48:41.977401+0000","last_active":"2024-09-17T01:48:42.966149+0000","last_peered":"2024-09-17T01:48:42.966149+0000","last_clean":"2024-09-17T01:48:42.966149+0000","last_became_active":"2024-09-17T01:48:41.974556+0000","last_became_peered":"2024-09-17T01:48:41.974556+0000","last_unstale":"2024-09-17T01:48:42.966149+0000","last_undegraded":"2024-09-17T01:48:42.966149+0000","last_fullsized":"2024-09-17T01:48:42.966149+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:55.867060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.31","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965569+0000","last_change":"2024-09-17T01:48:41.975123+0000","last_active":"2024-09-17T01:48:42.965569+0000","last_peered":"2024-09-17T01:48:42.965569+0000","last_clean":"2024-09-17T01:48:42.965569+0000","last_became_active":"2024-09-17T01:48:41.974673+0000","last_became_peered":"2024-09-17T01:48:41.974673+0000","last_unstale":"2024-09-17T01:48:42.965569+0000","last_undegraded":"2024-09-17T01:48:42.965569+0000","last_fullsized":"2024-09-17T01:48:42.965569+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:17:36.339225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.30","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.971370+0000","last_change":"2024-09-17T01:48:41.965693+0000","last_active":"2024-09-17T01:48:41.971370+0000","last_peered":"2024-09-17T01:48:41.971370+0000","last_clean":"2024-09-17T01:48:41.971370+0000","last_became_active":"2024-09-17T01:48:41.962372+0000","last_became_peered":"2024-09-17T01:48:41.962372+0000","last_unstale":"2024-09-17T01:48:41.971370+0000","last_undegraded":"2024-09-17T01:48:41.971370+0000","last_fullsized":"2024-09-17T01:48:41.971370+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:44.587490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.2f","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393403+0000","last_change":"2024-09-17T01:48:41.976694+0000","last_active":"2024-09-17T01:48:43.393403+0000","last_peered":"2024-09-17T01:48:43.393403+0000","last_clean":"2024-09-17T01:48:43.393403+0000","last_became_active":"2024-09-17T01:48:41.974656+0000","last_became_peered":"2024-09-17T01:48:41.974656+0000","last_unstale":"2024-09-17T01:48:43.393403+0000","last_undegraded":"2024-09-17T01:48:43.393403+0000","last_fullsized":"2024-09-17T01:48:43.393403+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:02.926819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2e","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462080+0000","last_change":"2024-09-17T01:48:41.980564+0000","last_active":"2024-09-17T01:48:44.462080+0000","last_peered":"2024-09-17T01:48:44.462080+0000","last_clean":"2024-09-17T01:48:44.462080+0000","last_became_active":"2024-09-17T01:48:41.980245+0000","last_became_peered":"2024-09-17T01:48:41.980245+0000","last_unstale":"2024-09-17T01:48:44.462080+0000","last_undegraded":"2024-09-17T01:48:44.462080+0000","last_fullsized":"2024-09-17T01:48:44.462080+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:43.668061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:48:40.932243+0000","last_change":"2024-09-17T01:48:40.932243+0000","last_active":"2024-09-17T01:48:40.932243+0000","last_peered":"2024-09-17T01:48:40.932243+0000","last_clean":"2024-09-17T01:48:40.932243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:48:40.932243+0000","last_undegraded":"2024-09-17T01:48:40.932243+0000","last_fullsized":"2024-09-17T01:48:40.932243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.2c","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.976096+0000","last_change":"2024-09-17T01:48:41.969173+0000","last_active":"2024-09-17T01:48:41.976096+0000","last_peered":"2024-09-17T01:48:41.976096+0000","last_clean":"2024-09-17T01:48:41.976096+0000","last_became_active":"2024-09-17T01:48:41.968166+0000","last_became_peered":"2024-09-17T01:48:41.968166+0000","last_unstale":"2024-09-17T01:48:41.976096+0000","last_undegraded":"2024-09-17T01:48:41.976096+0000","last_fullsized":"2024-09-17T01:48:41.976096+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:08.105937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.2b","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964761+0000","last_change":"2024-09-17T01:48:41.954636+0000","last_active":"2024-09-17T01:48:42.964761+0000","last_peered":"2024-09-17T01:48:42.964761+0000","last_clean":"2024-09-17T01:48:42.964761+0000","last_became_active":"2024-09-17T01:48:41.953894+0000","last_became_peered":"2024-09-17T01:48:41.953894+0000","last_unstale":"2024-09-17T01:48:42.964761+0000","last_undegraded":"2024-09-17T01:48:42.964761+0000","last_fullsized":"2024-09-17T01:48:42.964761+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:36.329548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:48:40.932243+0000","last_change":"2024-09-17T01:48:40.932243+0000","last_active":"2024-09-17T01:48:40.932243+0000","last_peered":"2024-09-17T01:48:40.932243+0000","last_clean":"2024-09-17T01:48:40.932243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:48:40.932243+0000","last_undegraded":"2024-09-17T01:48:40.932243+0000","last_fullsized":"2024-09-17T01:48:40.932243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:48:40.932243+0000","last_change":"2024-09-17T01:48:40.932243+0000","last_active":"2024-09-17T01:48:40.932243+0000","last_peered":"2024-09-17T01:48:40.932243+0000","last_clean":"2024-09-17T01:48:40.932243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:48:40.932243+0000","last_undegraded":"2024-09-17T01:48:40.932243+0000","last_fullsized":"2024-09-17T01:48:40.932243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.28","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965934+0000","last_change":"2024-09-17T01:48:41.971698+0000","last_active":"2024-09-17T01:48:42.965934+0000","last_peered":"2024-09-17T01:48:42.965934+0000","last_clean":"2024-09-17T01:48:42.965934+0000","last_became_active":"2024-09-17T01:48:41.970716+0000","last_became_peered":"2024-09-17T01:48:41.970716+0000","last_unstale":"2024-09-17T01:48:42.965934+0000","last_undegraded":"2024-09-17T01:48:42.965934+0000","last_fullsized":"2024-09-17T01:48:42.965934+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:55.100537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.27","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967261+0000","last_change":"2024-09-17T01:48:41.961465+0000","last_active":"2024-09-17T01:48:42.967261+0000","last_peered":"2024-09-17T01:48:42.967261+0000","last_clean":"2024-09-17T01:48:42.967261+0000","last_became_active":"2024-09-17T01:48:41.961094+0000","last_became_peered":"2024-09-17T01:48:41.961094+0000","last_unstale":"2024-09-17T01:48:42.967261+0000","last_undegraded":"2024-09-17T01:48:42.967261+0000","last_fullsized":"2024-09-17T01:48:42.967261+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:41.337984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.26","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965081+0000","last_change":"2024-09-17T01:48:41.976001+0000","last_active":"2024-09-17T01:48:42.965081+0000","last_peered":"2024-09-17T01:48:42.965081+0000","last_clean":"2024-09-17T01:48:42.965081+0000","last_became_active":"2024-09-17T01:48:41.975224+0000","last_became_peered":"2024-09-17T01:48:41.975224+0000","last_unstale":"2024-09-17T01:48:42.965081+0000","last_undegraded":"2024-09-17T01:48:42.965081+0000","last_fullsized":"2024-09-17T01:48:42.965081+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:54.362773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.25","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.964284+0000","last_change":"2024-09-17T01:48:41.962212+0000","last_active":"2024-09-17T01:48:41.964284+0000","last_peered":"2024-09-17T01:48:41.964284+0000","last_clean":"2024-09-17T01:48:41.964284+0000","last_became_active":"2024-09-17T01:48:41.957215+0000","last_became_peered":"2024-09-17T01:48:41.957215+0000","last_unstale":"2024-09-17T01:48:41.964284+0000","last_undegraded":"2024-09-17T01:48:41.964284+0000","last_fullsized":"2024-09-17T01:48:41.964284+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:36.289610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.24","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966653+0000","last_change":"2024-09-17T01:48:41.960227+0000","last_active":"2024-09-17T01:48:42.966653+0000","last_peered":"2024-09-17T01:48:42.966653+0000","last_clean":"2024-09-17T01:48:42.966653+0000","last_became_active":"2024-09-17T01:48:41.959863+0000","last_became_peered":"2024-09-17T01:48:41.959863+0000","last_unstale":"2024-09-17T01:48:42.966653+0000","last_undegraded":"2024-09-17T01:48:42.966653+0000","last_fullsized":"2024-09-17T01:48:42.966653+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:47.101431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.23","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966478+0000","last_change":"2024-09-17T01:48:41.983228+0000","last_active":"2024-09-17T01:48:42.966478+0000","last_peered":"2024-09-17T01:48:42.966478+0000","last_clean":"2024-09-17T01:48:42.966478+0000","last_became_active":"2024-09-17T01:48:41.982832+0000","last_became_peered":"2024-09-17T01:48:41.982832+0000","last_unstale":"2024-09-17T01:48:42.966478+0000","last_undegraded":"2024-09-17T01:48:42.966478+0000","last_fullsized":"2024-09-17T01:48:42.966478+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:53.868153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:48:40.932243+0000","last_change":"2024-09-17T01:48:40.932243+0000","last_active":"2024-09-17T01:48:40.932243+0000","last_peered":"2024-09-17T01:48:40.932243+0000","last_clean":"2024-09-17T01:48:40.932243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:48:40.932243+0000","last_undegraded":"2024-09-17T01:48:40.932243+0000","last_fullsized":"2024-09-17T01:48:40.932243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"31.21","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965991+0000","last_change":"2024-09-17T01:48:41.973589+0000","last_active":"2024-09-17T01:48:42.965991+0000","last_peered":"2024-09-17T01:48:42.965991+0000","last_clean":"2024-09-17T01:48:42.965991+0000","last_became_active":"2024-09-17T01:48:41.973257+0000","last_became_peered":"2024-09-17T01:48:41.973257+0000","last_unstale":"2024-09-17T01:48:42.965991+0000","last_undegraded":"2024-09-17T01:48:42.965991+0000","last_fullsized":"2024-09-17T01:48:42.965991+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:00.927500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.20","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.971402+0000","last_change":"2024-09-17T01:48:41.966916+0000","last_active":"2024-09-17T01:48:41.971402+0000","last_peered":"2024-09-17T01:48:41.971402+0000","last_clean":"2024-09-17T01:48:41.971402+0000","last_became_active":"2024-09-17T01:48:41.962328+0000","last_became_peered":"2024-09-17T01:48:41.962328+0000","last_unstale":"2024-09-17T01:48:41.971402+0000","last_undegraded":"2024-09-17T01:48:41.971402+0000","last_fullsized":"2024-09-17T01:48:41.971402+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:00:44.537741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1f","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462071+0000","last_change":"2024-09-17T01:48:41.987044+0000","last_active":"2024-09-17T01:48:44.462071+0000","last_peered":"2024-09-17T01:48:44.462071+0000","last_clean":"2024-09-17T01:48:44.462071+0000","last_became_active":"2024-09-17T01:48:41.986685+0000","last_became_peered":"2024-09-17T01:48:41.986685+0000","last_unstale":"2024-09-17T01:48:44.462071+0000","last_undegraded":"2024-09-17T01:48:44.462071+0000","last_fullsized":"2024-09-17T01:48:44.462071+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:15:39.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1e","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966212+0000","last_change":"2024-09-17T01:48:40.958584+0000","last_active":"2024-09-17T01:48:42.966212+0000","last_peered":"2024-09-17T01:48:42.966212+0000","last_clean":"2024-09-17T01:48:42.966212+0000","last_became_active":"2024-09-17T01:48:40.958270+0000","last_became_peered":"2024-09-17T01:48:40.958270+0000","last_unstale":"2024-09-17T01:48:42.966212+0000","last_undegraded":"2024-09-17T01:48:42.966212+0000","last_fullsized":"2024-09-17T01:48:42.966212+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:43.311074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1c","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967106+0000","last_change":"2024-09-17T01:48:41.991844+0000","last_active":"2024-09-17T01:48:42.967106+0000","last_peered":"2024-09-17T01:48:42.967106+0000","last_clean":"2024-09-17T01:48:42.967106+0000","last_became_active":"2024-09-17T01:48:41.991218+0000","last_became_peered":"2024-09-17T01:48:41.991218+0000","last_unstale":"2024-09-17T01:48:42.967106+0000","last_undegraded":"2024-09-17T01:48:42.967106+0000","last_fullsized":"2024-09-17T01:48:42.967106+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:36.622860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1d","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450551+0000","last_change":"2024-09-17T01:48:40.970298+0000","last_active":"2024-09-17T01:48:43.450551+0000","last_peered":"2024-09-17T01:48:43.450551+0000","last_clean":"2024-09-17T01:48:43.450551+0000","last_became_active":"2024-09-17T01:48:40.969934+0000","last_became_peered":"2024-09-17T01:48:40.969934+0000","last_unstale":"2024-09-17T01:48:43.450551+0000","last_undegraded":"2024-09-17T01:48:43.450551+0000","last_fullsized":"2024-09-17T01:48:43.450551+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:06.666716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:48:40.932243+0000","last_change":"2024-09-17T01:48:40.932243+0000","last_active":"2024-09-17T01:48:40.932243+0000","last_peered":"2024-09-17T01:48:40.932243+0000","last_clean":"2024-09-17T01:48:40.932243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:48:40.932243+0000","last_undegraded":"2024-09-17T01:48:40.932243+0000","last_fullsized":"2024-09-17T01:48:40.932243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.1c","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461822+0000","last_change":"2024-09-17T01:48:40.963737+0000","last_active":"2024-09-17T01:48:44.461822+0000","last_peered":"2024-09-17T01:48:44.461822+0000","last_clean":"2024-09-17T01:48:44.461822+0000","last_became_active":"2024-09-17T01:48:40.963409+0000","last_became_peered":"2024-09-17T01:48:40.963409+0000","last_unstale":"2024-09-17T01:48:44.461822+0000","last_undegraded":"2024-09-17T01:48:44.461822+0000","last_fullsized":"2024-09-17T01:48:44.461822+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:07.992373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.1a","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461547+0000","last_change":"2024-09-17T01:48:41.967809+0000","last_active":"2024-09-17T01:48:44.461547+0000","last_peered":"2024-09-17T01:48:44.461547+0000","last_clean":"2024-09-17T01:48:44.461547+0000","last_became_active":"2024-09-17T01:48:41.967471+0000","last_became_peered":"2024-09-17T01:48:41.967471+0000","last_unstale":"2024-09-17T01:48:44.461547+0000","last_undegraded":"2024-09-17T01:48:44.461547+0000","last_fullsized":"2024-09-17T01:48:44.461547+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:15.398716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1b","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462083+0000","last_change":"2024-09-17T01:48:40.965537+0000","last_active":"2024-09-17T01:48:44.462083+0000","last_peered":"2024-09-17T01:48:44.462083+0000","last_clean":"2024-09-17T01:48:44.462083+0000","last_became_active":"2024-09-17T01:48:40.965186+0000","last_became_peered":"2024-09-17T01:48:40.965186+0000","last_unstale":"2024-09-17T01:48:44.462083+0000","last_undegraded":"2024-09-17T01:48:44.462083+0000","last_fullsized":"2024-09-17T01:48:44.462083+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:02.660884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.1b","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966082+0000","last_change":"2024-09-17T01:48:41.973058+0000","last_active":"2024-09-17T01:48:42.966082+0000","last_peered":"2024-09-17T01:48:42.966082+0000","last_clean":"2024-09-17T01:48:42.966082+0000","last_became_active":"2024-09-17T01:48:41.972705+0000","last_became_peered":"2024-09-17T01:48:41.972705+0000","last_unstale":"2024-09-17T01:48:42.966082+0000","last_undegraded":"2024-09-17T01:48:42.966082+0000","last_fullsized":"2024-09-17T01:48:42.966082+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:00.679343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1a","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461608+0000","last_change":"2024-09-17T01:48:40.963571+0000","last_active":"2024-09-17T01:48:44.461608+0000","last_peered":"2024-09-17T01:48:44.461608+0000","last_clean":"2024-09-17T01:48:44.461608+0000","last_became_active":"2024-09-17T01:48:40.963225+0000","last_became_peered":"2024-09-17T01:48:40.963225+0000","last_unstale":"2024-09-17T01:48:44.461608+0000","last_undegraded":"2024-09-17T01:48:44.461608+0000","last_fullsized":"2024-09-17T01:48:44.461608+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:17.264437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966022+0000","last_change":"2024-09-17T01:48:41.961255+0000","last_active":"2024-09-17T01:48:42.966022+0000","last_peered":"2024-09-17T01:48:42.966022+0000","last_clean":"2024-09-17T01:48:42.966022+0000","last_became_active":"2024-09-17T01:48:41.960894+0000","last_became_peered":"2024-09-17T01:48:41.960894+0000","last_unstale":"2024-09-17T01:48:42.966022+0000","last_undegraded":"2024-09-17T01:48:42.966022+0000","last_fullsized":"2024-09-17T01:48:42.966022+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:02:46.006988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965064+0000","last_change":"2024-09-17T01:48:40.963230+0000","last_active":"2024-09-17T01:48:42.965064+0000","last_peered":"2024-09-17T01:48:42.965064+0000","last_clean":"2024-09-17T01:48:42.965064+0000","last_became_active":"2024-09-17T01:48:40.962869+0000","last_became_peered":"2024-09-17T01:48:40.962869+0000","last_unstale":"2024-09-17T01:48:42.965064+0000","last_undegraded":"2024-09-17T01:48:42.965064+0000","last_fullsized":"2024-09-17T01:48:42.965064+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:31.161425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965805+0000","last_change":"2024-09-17T01:48:41.961510+0000","last_active":"2024-09-17T01:48:42.965805+0000","last_peered":"2024-09-17T01:48:42.965805+0000","last_clean":"2024-09-17T01:48:42.965805+0000","last_became_active":"2024-09-17T01:48:41.961149+0000","last_became_peered":"2024-09-17T01:48:41.961149+0000","last_unstale":"2024-09-17T01:48:42.965805+0000","last_undegraded":"2024-09-17T01:48:42.965805+0000","last_fullsized":"2024-09-17T01:48:42.965805+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:42.543461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.460990+0000","last_change":"2024-09-17T01:48:40.960363+0000","last_active":"2024-09-17T01:48:44.460990+0000","last_peered":"2024-09-17T01:48:44.460990+0000","last_clean":"2024-09-17T01:48:44.460990+0000","last_became_active":"2024-09-17T01:48:40.960030+0000","last_became_peered":"2024-09-17T01:48:40.960030+0000","last_unstale":"2024-09-17T01:48:44.460990+0000","last_undegraded":"2024-09-17T01:48:44.460990+0000","last_fullsized":"2024-09-17T01:48:44.460990+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:39.323864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967273+0000","last_change":"2024-09-17T01:48:41.960180+0000","last_active":"2024-09-17T01:48:42.967273+0000","last_peered":"2024-09-17T01:48:42.967273+0000","last_clean":"2024-09-17T01:48:42.967273+0000","last_became_active":"2024-09-17T01:48:41.959822+0000","last_became_peered":"2024-09-17T01:48:41.959822+0000","last_unstale":"2024-09-17T01:48:42.967273+0000","last_undegraded":"2024-09-17T01:48:42.967273+0000","last_fullsized":"2024-09-17T01:48:42.967273+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:15.702177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966259+0000","last_change":"2024-09-17T01:48:40.959777+0000","last_active":"2024-09-17T01:48:42.966259+0000","last_peered":"2024-09-17T01:48:42.966259+0000","last_clean":"2024-09-17T01:48:42.966259+0000","last_became_active":"2024-09-17T01:48:40.959450+0000","last_became_peered":"2024-09-17T01:48:40.959450+0000","last_unstale":"2024-09-17T01:48:42.966259+0000","last_undegraded":"2024-09-17T01:48:42.966259+0000","last_fullsized":"2024-09-17T01:48:42.966259+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:07.992373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462212+0000","last_change":"2024-09-17T01:48:41.966187+0000","last_active":"2024-09-17T01:48:44.462212+0000","last_peered":"2024-09-17T01:48:44.462212+0000","last_clean":"2024-09-17T01:48:44.462212+0000","last_became_active":"2024-09-17T01:48:41.965878+0000","last_became_peered":"2024-09-17T01:48:41.965878+0000","last_unstale":"2024-09-17T01:48:44.462212+0000","last_undegraded":"2024-09-17T01:48:44.462212+0000","last_fullsized":"2024-09-17T01:48:44.462212+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:24.225979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967188+0000","last_change":"2024-09-17T01:48:40.960473+0000","last_active":"2024-09-17T01:48:42.967188+0000","last_peered":"2024-09-17T01:48:42.967188+0000","last_clean":"2024-09-17T01:48:42.967188+0000","last_became_active":"2024-09-17T01:48:40.960115+0000","last_became_peered":"2024-09-17T01:48:40.960115+0000","last_unstale":"2024-09-17T01:48:42.967188+0000","last_undegraded":"2024-09-17T01:48:42.967188+0000","last_fullsized":"2024-09-17T01:48:42.967188+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:06:29.569198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.14","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.992000+0000","last_change":"2024-09-17T01:48:41.990381+0000","last_active":"2024-09-17T01:48:41.992000+0000","last_peered":"2024-09-17T01:48:41.992000+0000","last_clean":"2024-09-17T01:48:41.992000+0000","last_became_active":"2024-09-17T01:48:41.989915+0000","last_became_peered":"2024-09-17T01:48:41.989915+0000","last_unstale":"2024-09-17T01:48:41.992000+0000","last_undegraded":"2024-09-17T01:48:41.992000+0000","last_fullsized":"2024-09-17T01:48:41.992000+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:36.937033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.15","version":"212'3","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.986091+0000","last_change":"2024-09-17T01:48:40.960038+0000","last_active":"2024-09-17T01:48:41.986091+0000","last_peered":"2024-09-17T01:48:41.986091+0000","last_clean":"2024-09-17T01:48:41.986091+0000","last_became_active":"2024-09-17T01:48:40.959680+0000","last_became_peered":"2024-09-17T01:48:40.959680+0000","last_unstale":"2024-09-17T01:48:41.986091+0000","last_undegraded":"2024-09-17T01:48:41.986091+0000","last_fullsized":"2024-09-17T01:48:41.986091+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:11.499994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.15","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964632+0000","last_change":"2024-09-17T01:48:41.958372+0000","last_active":"2024-09-17T01:48:42.964632+0000","last_peered":"2024-09-17T01:48:42.964632+0000","last_clean":"2024-09-17T01:48:42.964632+0000","last_became_active":"2024-09-17T01:48:41.958067+0000","last_became_peered":"2024-09-17T01:48:41.958067+0000","last_unstale":"2024-09-17T01:48:42.964632+0000","last_undegraded":"2024-09-17T01:48:42.964632+0000","last_fullsized":"2024-09-17T01:48:42.964632+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:02.967349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.14","version":"212'6","reported_seq":21,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450276+0000","last_change":"2024-09-17T01:48:40.969037+0000","last_active":"2024-09-17T01:48:43.450276+0000","last_peered":"2024-09-17T01:48:43.450276+0000","last_clean":"2024-09-17T01:48:43.450276+0000","last_became_active":"2024-09-17T01:48:40.968663+0000","last_became_peered":"2024-09-17T01:48:40.968663+0000","last_unstale":"2024-09-17T01:48:43.450276+0000","last_undegraded":"2024-09-17T01:48:43.450276+0000","last_fullsized":"2024-09-17T01:48:43.450276+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:36.157770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965788+0000","last_change":"2024-09-17T01:48:41.974194+0000","last_active":"2024-09-17T01:48:42.965788+0000","last_peered":"2024-09-17T01:48:42.965788+0000","last_clean":"2024-09-17T01:48:42.965788+0000","last_became_active":"2024-09-17T01:48:41.972690+0000","last_became_peered":"2024-09-17T01:48:41.972690+0000","last_unstale":"2024-09-17T01:48:42.965788+0000","last_undegraded":"2024-09-17T01:48:42.965788+0000","last_fullsized":"2024-09-17T01:48:42.965788+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:53.619025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.13","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450234+0000","last_change":"2024-09-17T01:48:40.964396+0000","last_active":"2024-09-17T01:48:43.450234+0000","last_peered":"2024-09-17T01:48:43.450234+0000","last_clean":"2024-09-17T01:48:43.450234+0000","last_became_active":"2024-09-17T01:48:40.964058+0000","last_became_peered":"2024-09-17T01:48:40.964058+0000","last_unstale":"2024-09-17T01:48:43.450234+0000","last_undegraded":"2024-09-17T01:48:43.450234+0000","last_fullsized":"2024-09-17T01:48:43.450234+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:43.677360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:48:40.932243+0000","last_change":"2024-09-17T01:48:40.932243+0000","last_active":"2024-09-17T01:48:40.932243+0000","last_peered":"2024-09-17T01:48:40.932243+0000","last_clean":"2024-09-17T01:48:40.932243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:48:40.932243+0000","last_undegraded":"2024-09-17T01:48:40.932243+0000","last_fullsized":"2024-09-17T01:48:40.932243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966052+0000","last_change":"2024-09-17T01:48:40.958069+0000","last_active":"2024-09-17T01:48:42.966052+0000","last_peered":"2024-09-17T01:48:42.966052+0000","last_clean":"2024-09-17T01:48:42.966052+0000","last_became_active":"2024-09-17T01:48:40.956114+0000","last_became_peered":"2024-09-17T01:48:40.956114+0000","last_unstale":"2024-09-17T01:48:42.966052+0000","last_undegraded":"2024-09-17T01:48:42.966052+0000","last_fullsized":"2024-09-17T01:48:42.966052+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:25.002380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.10","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461069+0000","last_change":"2024-09-17T01:48:41.975846+0000","last_active":"2024-09-17T01:48:44.461069+0000","last_peered":"2024-09-17T01:48:44.461069+0000","last_clean":"2024-09-17T01:48:44.461069+0000","last_became_active":"2024-09-17T01:48:41.975443+0000","last_became_peered":"2024-09-17T01:48:41.975443+0000","last_unstale":"2024-09-17T01:48:44.461069+0000","last_undegraded":"2024-09-17T01:48:44.461069+0000","last_fullsized":"2024-09-17T01:48:44.461069+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:52:23.341819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965173+0000","last_change":"2024-09-17T01:48:40.962362+0000","last_active":"2024-09-17T01:48:42.965173+0000","last_peered":"2024-09-17T01:48:42.965173+0000","last_clean":"2024-09-17T01:48:42.965173+0000","last_became_active":"2024-09-17T01:48:40.961975+0000","last_became_peered":"2024-09-17T01:48:40.961975+0000","last_unstale":"2024-09-17T01:48:42.965173+0000","last_undegraded":"2024-09-17T01:48:42.965173+0000","last_fullsized":"2024-09-17T01:48:42.965173+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:17.865320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965577+0000","last_change":"2024-09-17T01:48:41.975201+0000","last_active":"2024-09-17T01:48:42.965577+0000","last_peered":"2024-09-17T01:48:42.965577+0000","last_clean":"2024-09-17T01:48:42.965577+0000","last_became_active":"2024-09-17T01:48:41.974581+0000","last_became_peered":"2024-09-17T01:48:41.974581+0000","last_unstale":"2024-09-17T01:48:42.965577+0000","last_undegraded":"2024-09-17T01:48:42.965577+0000","last_fullsized":"2024-09-17T01:48:42.965577+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:20.028457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.10","version":"212'8","reported_seq":21,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.988351+0000","last_change":"2024-09-17T01:48:40.962920+0000","last_active":"2024-09-17T01:48:41.988351+0000","last_peered":"2024-09-17T01:48:41.988351+0000","last_clean":"2024-09-17T01:48:41.988351+0000","last_became_active":"2024-09-17T01:48:40.962230+0000","last_became_peered":"2024-09-17T01:48:40.962230+0000","last_unstale":"2024-09-17T01:48:41.988351+0000","last_undegraded":"2024-09-17T01:48:41.988351+0000","last_fullsized":"2024-09-17T01:48:41.988351+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:43.167939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.e","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462192+0000","last_change":"2024-09-17T01:48:41.967242+0000","last_active":"2024-09-17T01:48:44.462192+0000","last_peered":"2024-09-17T01:48:44.462192+0000","last_clean":"2024-09-17T01:48:44.462192+0000","last_became_active":"2024-09-17T01:48:41.966892+0000","last_became_peered":"2024-09-17T01:48:41.966892+0000","last_unstale":"2024-09-17T01:48:44.462192+0000","last_undegraded":"2024-09-17T01:48:44.462192+0000","last_fullsized":"2024-09-17T01:48:44.462192+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:29.649430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.f","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966375+0000","last_change":"2024-09-17T01:48:40.958540+0000","last_active":"2024-09-17T01:48:42.966375+0000","last_peered":"2024-09-17T01:48:42.966375+0000","last_clean":"2024-09-17T01:48:42.966375+0000","last_became_active":"2024-09-17T01:48:40.958209+0000","last_became_peered":"2024-09-17T01:48:40.958209+0000","last_unstale":"2024-09-17T01:48:42.966375+0000","last_undegraded":"2024-09-17T01:48:42.966375+0000","last_fullsized":"2024-09-17T01:48:42.966375+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:02.660884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.f","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.975961+0000","last_change":"2024-09-17T01:48:41.968961+0000","last_active":"2024-09-17T01:48:41.975961+0000","last_peered":"2024-09-17T01:48:41.975961+0000","last_clean":"2024-09-17T01:48:41.975961+0000","last_became_active":"2024-09-17T01:48:41.968609+0000","last_became_peered":"2024-09-17T01:48:41.968609+0000","last_unstale":"2024-09-17T01:48:41.975961+0000","last_undegraded":"2024-09-17T01:48:41.975961+0000","last_fullsized":"2024-09-17T01:48:41.975961+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:00.830194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.e","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967385+0000","last_change":"2024-09-17T01:48:40.958112+0000","last_active":"2024-09-17T01:48:42.967385+0000","last_peered":"2024-09-17T01:48:42.967385+0000","last_clean":"2024-09-17T01:48:42.967385+0000","last_became_active":"2024-09-17T01:48:40.957765+0000","last_became_peered":"2024-09-17T01:48:40.957765+0000","last_unstale":"2024-09-17T01:48:42.967385+0000","last_undegraded":"2024-09-17T01:48:42.967385+0000","last_fullsized":"2024-09-17T01:48:42.967385+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:33.429311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966144+0000","last_change":"2024-09-17T01:48:41.962826+0000","last_active":"2024-09-17T01:48:42.966144+0000","last_peered":"2024-09-17T01:48:42.966144+0000","last_clean":"2024-09-17T01:48:42.966144+0000","last_became_active":"2024-09-17T01:48:41.962494+0000","last_became_peered":"2024-09-17T01:48:41.962494+0000","last_unstale":"2024-09-17T01:48:42.966144+0000","last_undegraded":"2024-09-17T01:48:42.966144+0000","last_fullsized":"2024-09-17T01:48:42.966144+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:37.163100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.d","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966115+0000","last_change":"2024-09-17T01:48:40.960604+0000","last_active":"2024-09-17T01:48:42.966115+0000","last_peered":"2024-09-17T01:48:42.966115+0000","last_clean":"2024-09-17T01:48:42.966115+0000","last_became_active":"2024-09-17T01:48:40.960047+0000","last_became_peered":"2024-09-17T01:48:40.960047+0000","last_unstale":"2024-09-17T01:48:42.966115+0000","last_undegraded":"2024-09-17T01:48:42.966115+0000","last_fullsized":"2024-09-17T01:48:42.966115+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:01.691297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.d","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393460+0000","last_change":"2024-09-17T01:48:41.961193+0000","last_active":"2024-09-17T01:48:43.393460+0000","last_peered":"2024-09-17T01:48:43.393460+0000","last_clean":"2024-09-17T01:48:43.393460+0000","last_became_active":"2024-09-17T01:48:41.960675+0000","last_became_peered":"2024-09-17T01:48:41.960675+0000","last_unstale":"2024-09-17T01:48:43.393460+0000","last_undegraded":"2024-09-17T01:48:43.393460+0000","last_fullsized":"2024-09-17T01:48:43.393460+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:45:20.974258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966870+0000","last_change":"2024-09-17T01:48:40.969612+0000","last_active":"2024-09-17T01:48:42.966870+0000","last_peered":"2024-09-17T01:48:42.966870+0000","last_clean":"2024-09-17T01:48:42.966870+0000","last_became_active":"2024-09-17T01:48:40.969131+0000","last_became_peered":"2024-09-17T01:48:40.969131+0000","last_unstale":"2024-09-17T01:48:42.966870+0000","last_undegraded":"2024-09-17T01:48:42.966870+0000","last_fullsized":"2024-09-17T01:48:42.966870+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:06.914057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:48:40.932243+0000","last_change":"2024-09-17T01:48:40.932243+0000","last_active":"2024-09-17T01:48:40.932243+0000","last_peered":"2024-09-17T01:48:40.932243+0000","last_clean":"2024-09-17T01:48:40.932243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:48:40.932243+0000","last_undegraded":"2024-09-17T01:48:40.932243+0000","last_fullsized":"2024-09-17T01:48:40.932243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.b","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966523+0000","last_change":"2024-09-17T01:48:40.954645+0000","last_active":"2024-09-17T01:48:42.966523+0000","last_peered":"2024-09-17T01:48:42.966523+0000","last_clean":"2024-09-17T01:48:42.966523+0000","last_became_active":"2024-09-17T01:48:40.954314+0000","last_became_peered":"2024-09-17T01:48:40.954314+0000","last_unstale":"2024-09-17T01:48:42.966523+0000","last_undegraded":"2024-09-17T01:48:42.966523+0000","last_fullsized":"2024-09-17T01:48:42.966523+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:03.890846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.b","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966366+0000","last_change":"2024-09-17T01:48:41.962675+0000","last_active":"2024-09-17T01:48:42.966366+0000","last_peered":"2024-09-17T01:48:42.966366+0000","last_clean":"2024-09-17T01:48:42.966366+0000","last_became_active":"2024-09-17T01:48:41.960185+0000","last_became_peered":"2024-09-17T01:48:41.960185+0000","last_unstale":"2024-09-17T01:48:42.966366+0000","last_undegraded":"2024-09-17T01:48:42.966366+0000","last_fullsized":"2024-09-17T01:48:42.966366+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:53.273110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966188+0000","last_change":"2024-09-17T01:48:40.957409+0000","last_active":"2024-09-17T01:48:42.966188+0000","last_peered":"2024-09-17T01:48:42.966188+0000","last_clean":"2024-09-17T01:48:42.966188+0000","last_became_active":"2024-09-17T01:48:40.957076+0000","last_became_peered":"2024-09-17T01:48:40.957076+0000","last_unstale":"2024-09-17T01:48:42.966188+0000","last_undegraded":"2024-09-17T01:48:42.966188+0000","last_fullsized":"2024-09-17T01:48:42.966188+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:09.169291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.460832+0000","last_change":"2024-09-17T01:48:41.972315+0000","last_active":"2024-09-17T01:48:44.460832+0000","last_peered":"2024-09-17T01:48:44.460832+0000","last_clean":"2024-09-17T01:48:44.460832+0000","last_became_active":"2024-09-17T01:48:41.964814+0000","last_became_peered":"2024-09-17T01:48:41.964814+0000","last_unstale":"2024-09-17T01:48:44.460832+0000","last_undegraded":"2024-09-17T01:48:44.460832+0000","last_fullsized":"2024-09-17T01:48:44.460832+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:44.993483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393202+0000","last_change":"2024-09-17T01:48:40.960091+0000","last_active":"2024-09-17T01:48:43.393202+0000","last_peered":"2024-09-17T01:48:43.393202+0000","last_clean":"2024-09-17T01:48:43.393202+0000","last_became_active":"2024-09-17T01:48:40.959708+0000","last_became_peered":"2024-09-17T01:48:40.959708+0000","last_unstale":"2024-09-17T01:48:43.393202+0000","last_undegraded":"2024-09-17T01:48:43.393202+0000","last_fullsized":"2024-09-17T01:48:43.393202+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:14.069903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965102+0000","last_change":"2024-09-17T01:48:41.954668+0000","last_active":"2024-09-17T01:48:42.965102+0000","last_peered":"2024-09-17T01:48:42.965102+0000","last_clean":"2024-09-17T01:48:42.965102+0000","last_became_active":"2024-09-17T01:48:41.953453+0000","last_became_peered":"2024-09-17T01:48:41.953453+0000","last_unstale":"2024-09-17T01:48:42.965102+0000","last_undegraded":"2024-09-17T01:48:42.965102+0000","last_fullsized":"2024-09-17T01:48:42.965102+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:56.732819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393455+0000","last_change":"2024-09-17T01:48:40.954364+0000","last_active":"2024-09-17T01:48:43.393455+0000","last_peered":"2024-09-17T01:48:43.393455+0000","last_clean":"2024-09-17T01:48:43.393455+0000","last_became_active":"2024-09-17T01:48:40.952633+0000","last_became_peered":"2024-09-17T01:48:40.952633+0000","last_unstale":"2024-09-17T01:48:43.393455+0000","last_undegraded":"2024-09-17T01:48:43.393455+0000","last_fullsized":"2024-09-17T01:48:43.393455+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:14.968860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966306+0000","last_change":"2024-09-17T01:48:41.980321+0000","last_active":"2024-09-17T01:48:42.966306+0000","last_peered":"2024-09-17T01:48:42.966306+0000","last_clean":"2024-09-17T01:48:42.966306+0000","last_became_active":"2024-09-17T01:48:41.979988+0000","last_became_peered":"2024-09-17T01:48:41.979988+0000","last_unstale":"2024-09-17T01:48:42.966306+0000","last_undegraded":"2024-09-17T01:48:42.966306+0000","last_fullsized":"2024-09-17T01:48:42.966306+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:44.682690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.7","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967542+0000","last_change":"2024-09-17T01:48:40.968513+0000","last_active":"2024-09-17T01:48:42.967542+0000","last_peered":"2024-09-17T01:48:42.967542+0000","last_clean":"2024-09-17T01:48:42.967542+0000","last_became_active":"2024-09-17T01:48:40.968147+0000","last_became_peered":"2024-09-17T01:48:40.968147+0000","last_unstale":"2024-09-17T01:48:42.967542+0000","last_undegraded":"2024-09-17T01:48:42.967542+0000","last_fullsized":"2024-09-17T01:48:42.967542+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:50.333573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.7","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450551+0000","last_change":"2024-09-17T01:48:41.995352+0000","last_active":"2024-09-17T01:48:43.450551+0000","last_peered":"2024-09-17T01:48:43.450551+0000","last_clean":"2024-09-17T01:48:43.450551+0000","last_became_active":"2024-09-17T01:48:41.995020+0000","last_became_peered":"2024-09-17T01:48:41.995020+0000","last_unstale":"2024-09-17T01:48:43.450551+0000","last_undegraded":"2024-09-17T01:48:43.450551+0000","last_fullsized":"2024-09-17T01:48:43.450551+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:15.035889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.6","version":"0'0","reported_seq":1,"reported_epoch":210,"state":"creating+peering","last_fresh":"2024-09-17T01:48:39.938589+0000","last_change":"2024-09-17T01:48:39.938589+0000","last_active":"2024-09-17T01:48:39.926912+0000","last_peered":"2024-09-17T01:48:39.926912+0000","last_clean":"2024-09-17T01:48:39.926912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:48:39.938589+0000","last_undegraded":"2024-09-17T01:48:39.938589+0000","last_fullsized":"2024-09-17T01:48:39.938589+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461879+0000","last_change":"2024-09-17T01:48:41.987120+0000","last_active":"2024-09-17T01:48:44.461879+0000","last_peered":"2024-09-17T01:48:44.461879+0000","last_clean":"2024-09-17T01:48:44.461879+0000","last_became_active":"2024-09-17T01:48:41.986788+0000","last_became_peered":"2024-09-17T01:48:41.986788+0000","last_unstale":"2024-09-17T01:48:44.461879+0000","last_undegraded":"2024-09-17T01:48:44.461879+0000","last_fullsized":"2024-09-17T01:48:44.461879+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:45.285758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964804+0000","last_change":"2024-09-17T01:48:40.964922+0000","last_active":"2024-09-17T01:48:42.964804+0000","last_peered":"2024-09-17T01:48:42.964804+0000","last_clean":"2024-09-17T01:48:42.964804+0000","last_became_active":"2024-09-17T01:48:40.964564+0000","last_became_peered":"2024-09-17T01:48:40.964564+0000","last_unstale":"2024-09-17T01:48:42.964804+0000","last_undegraded":"2024-09-17T01:48:42.964804+0000","last_fullsized":"2024-09-17T01:48:42.964804+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:17.144236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966915+0000","last_change":"2024-09-17T01:48:41.983739+0000","last_active":"2024-09-17T01:48:42.966915+0000","last_peered":"2024-09-17T01:48:42.966915+0000","last_clean":"2024-09-17T01:48:42.966915+0000","last_became_active":"2024-09-17T01:48:41.983417+0000","last_became_peered":"2024-09-17T01:48:41.983417+0000","last_unstale":"2024-09-17T01:48:42.966915+0000","last_undegraded":"2024-09-17T01:48:42.966915+0000","last_fullsized":"2024-09-17T01:48:42.966915+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:25.410155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967262+0000","last_change":"2024-09-17T01:48:40.961630+0000","last_active":"2024-09-17T01:48:42.967262+0000","last_peered":"2024-09-17T01:48:42.967262+0000","last_clean":"2024-09-17T01:48:42.967262+0000","last_became_active":"2024-09-17T01:48:40.960243+0000","last_became_peered":"2024-09-17T01:48:40.960243+0000","last_unstale":"2024-09-17T01:48:42.967262+0000","last_undegraded":"2024-09-17T01:48:42.967262+0000","last_fullsized":"2024-09-17T01:48:42.967262+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:02.136066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:48:40.932243+0000","last_change":"2024-09-17T01:48:40.932243+0000","last_active":"2024-09-17T01:48:40.932243+0000","last_peered":"2024-09-17T01:48:40.932243+0000","last_clean":"2024-09-17T01:48:40.932243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:48:40.932243+0000","last_undegraded":"2024-09-17T01:48:40.932243+0000","last_fullsized":"2024-09-17T01:48:40.932243+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965967+0000","last_change":"2024-09-17T01:48:40.956231+0000","last_active":"2024-09-17T01:48:42.965967+0000","last_peered":"2024-09-17T01:48:42.965967+0000","last_clean":"2024-09-17T01:48:42.965967+0000","last_became_active":"2024-09-17T01:48:40.955414+0000","last_became_peered":"2024-09-17T01:48:40.955414+0000","last_unstale":"2024-09-17T01:48:42.965967+0000","last_undegraded":"2024-09-17T01:48:42.965967+0000","last_fullsized":"2024-09-17T01:48:42.965967+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:39.323864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964920+0000","last_change":"2024-09-17T01:48:41.968153+0000","last_active":"2024-09-17T01:48:42.964920+0000","last_peered":"2024-09-17T01:48:42.964920+0000","last_clean":"2024-09-17T01:48:42.964920+0000","last_became_active":"2024-09-17T01:48:41.967605+0000","last_became_peered":"2024-09-17T01:48:41.967605+0000","last_unstale":"2024-09-17T01:48:42.964920+0000","last_undegraded":"2024-09-17T01:48:42.964920+0000","last_fullsized":"2024-09-17T01:48:42.964920+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:16.656430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461708+0000","last_change":"2024-09-17T01:48:40.961888+0000","last_active":"2024-09-17T01:48:44.461708+0000","last_peered":"2024-09-17T01:48:44.461708+0000","last_clean":"2024-09-17T01:48:44.461708+0000","last_became_active":"2024-09-17T01:48:40.960057+0000","last_became_peered":"2024-09-17T01:48:40.960057+0000","last_unstale":"2024-09-17T01:48:44.461708+0000","last_undegraded":"2024-09-17T01:48:44.461708+0000","last_fullsized":"2024-09-17T01:48:44.461708+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:01.691297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393545+0000","last_change":"2024-09-17T01:48:41.964119+0000","last_active":"2024-09-17T01:48:43.393545+0000","last_peered":"2024-09-17T01:48:43.393545+0000","last_clean":"2024-09-17T01:48:43.393545+0000","last_became_active":"2024-09-17T01:48:41.963688+0000","last_became_peered":"2024-09-17T01:48:41.963688+0000","last_unstale":"2024-09-17T01:48:43.393545+0000","last_undegraded":"2024-09-17T01:48:43.393545+0000","last_fullsized":"2024-09-17T01:48:43.393545+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:26:24.176532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.449918+0000","last_change":"2024-09-17T01:48:40.970410+0000","last_active":"2024-09-17T01:48:43.449918+0000","last_peered":"2024-09-17T01:48:43.449918+0000","last_clean":"2024-09-17T01:48:43.449918+0000","last_became_active":"2024-09-17T01:48:40.969725+0000","last_became_peered":"2024-09-17T01:48:40.969725+0000","last_unstale":"2024-09-17T01:48:43.449918+0000","last_undegraded":"2024-09-17T01:48:43.449918+0000","last_fullsized":"2024-09-17T01:48:43.449918+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:59.674013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450122+0000","last_change":"2024-09-17T01:48:41.987710+0000","last_active":"2024-09-17T01:48:43.450122+0000","last_peered":"2024-09-17T01:48:43.450122+0000","last_clean":"2024-09-17T01:48:43.450122+0000","last_became_active":"2024-09-17T01:48:41.983328+0000","last_became_peered":"2024-09-17T01:48:41.983328+0000","last_unstale":"2024-09-17T01:48:43.450122+0000","last_undegraded":"2024-09-17T01:48:43.450122+0000","last_fullsized":"2024-09-17T01:48:43.450122+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:19.736187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.956387+0000","last_change":"2024-09-17T01:48:40.963242+0000","last_active":"2024-09-17T01:48:41.956387+0000","last_peered":"2024-09-17T01:48:41.956387+0000","last_clean":"2024-09-17T01:48:41.956387+0000","last_became_active":"2024-09-17T01:48:40.962603+0000","last_became_peered":"2024-09-17T01:48:40.962603+0000","last_unstale":"2024-09-17T01:48:41.956387+0000","last_undegraded":"2024-09-17T01:48:41.956387+0000","last_fullsized":"2024-09-17T01:48:41.956387+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:04:09.145533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1e","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393421+0000","last_change":"2024-09-17T01:48:41.959892+0000","last_active":"2024-09-17T01:48:43.393421+0000","last_peered":"2024-09-17T01:48:43.393421+0000","last_clean":"2024-09-17T01:48:43.393421+0000","last_became_active":"2024-09-17T01:48:41.959602+0000","last_became_peered":"2024-09-17T01:48:41.959602+0000","last_unstale":"2024-09-17T01:48:43.393421+0000","last_undegraded":"2024-09-17T01:48:43.393421+0000","last_fullsized":"2024-09-17T01:48:43.393421+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:20.244068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.1f","version":"212'4","reported_seq":19,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450730+0000","last_change":"2024-09-17T01:48:40.970365+0000","last_active":"2024-09-17T01:48:43.450730+0000","last_peered":"2024-09-17T01:48:43.450730+0000","last_clean":"2024-09-17T01:48:43.450730+0000","last_became_active":"2024-09-17T01:48:40.969386+0000","last_became_peered":"2024-09-17T01:48:40.969386+0000","last_unstale":"2024-09-17T01:48:43.450730+0000","last_undegraded":"2024-09-17T01:48:43.450730+0000","last_fullsized":"2024-09-17T01:48:43.450730+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:05.396682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":478,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964191+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:48:42.964191+0000","last_peered":"2024-09-17T01:48:42.964191+0000","last_clean":"2024-09-17T01:48:42.964191+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:48:42.964191+0000","last_undegraded":"2024-09-17T01:48:42.964191+0000","last_fullsized":"2024-09-17T01:48:42.964191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":31,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":7},{"poolid":30,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476941,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47660,"kb_used_data":2584,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324180,"statfs":{"total":96636764160,"available":96587960320,"internally_reserved":0,"allocated":2646016,"data_stored":1169580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509645,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56036,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315804,"statfs":{"total":96636764160,"available":96579383296,"internally_reserved":0,"allocated":2703360,"data_stored":1191158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509644,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47688,"kb_used_data":2612,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324152,"statfs":{"total":96636764160,"available":96587931648,"internally_reserved":0,"allocated":2674688,"data_stored":1182720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509645,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51860,"kb_used_data":2624,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319980,"statfs":{"total":96636764160,"available":96583659520,"internally_reserved":0,"allocated":2686976,"data_stored":1188952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509645,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69852,"kb_used_data":2632,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94301988,"statfs":{"total":96636764160,"available":96565235712,"internally_reserved":0,"allocated":2695168,"data_stored":1190542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509644,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52440,"kb_used_data":3204,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319400,"statfs":{"total":96636764160,"available":96583065600,"internally_reserved":0,"allocated":3280896,"data_stored":1779880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509646,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60184,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311656,"statfs":{"total":96636764160,"available":96575135744,"internally_reserved":0,"allocated":2691072,"data_stored":1189022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":58915273},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542350,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52440,"kb_used_data":3196,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319400,"statfs":{"total":96636764160,"available":96583065600,"internally_reserved":0,"allocated":3272704,"data_stored":1773122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:48:46.938 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:48:47.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.204+0000 7eff67600640 1 -- 172.21.15.42:0/636804809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff600cddd0 msgr2=0x7eff60160c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:47.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.204+0000 7eff67600640 1 --2- 172.21.15.42:0/636804809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff600cddd0 0x7eff60160c40 secure :-1 s=READY pgs=2427 cs=0 l=1 rev1=1 crypto rx=0x7eff48005fd0 tx=0x7eff4802a5d0 comp rx=0 tx=0).stop 2024-09-17T01:48:47.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.205+0000 7eff67600640 1 -- 172.21.15.42:0/636804809 shutdown_connections 2024-09-17T01:48:47.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.205+0000 7eff67600640 1 --2- 172.21.15.42:0/636804809 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7eff60161180 0x7eff6006eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:47.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.205+0000 7eff67600640 1 --2- 172.21.15.42:0/636804809 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff600cddd0 0x7eff60160c40 unknown :-1 s=CLOSED pgs=2427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:47.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.205+0000 7eff67600640 1 -- 172.21.15.42:0/636804809 >> 172.21.15.42:0/636804809 conn(0x7eff6006d1b0 msgr2=0x7eff6006d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:47.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.205+0000 7eff67600640 1 -- 172.21.15.42:0/636804809 shutdown_connections 2024-09-17T01:48:47.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.205+0000 7eff67600640 1 -- 172.21.15.42:0/636804809 wait complete. 2024-09-17T01:48:47.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.207+0000 7eff67600640 1 Processor -- start 2024-09-17T01:48:47.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.207+0000 7eff67600640 1 -- start start 2024-09-17T01:48:47.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.208+0000 7eff67600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff6015dd50 0x7eff6013de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:47.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.208+0000 7eff67600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff60161180 0x7eff600aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:47.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.209+0000 7eff67600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7eff601450e0 0x7eff600aa9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:47.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.209+0000 7eff67600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7eff60072800 con 0x7eff60161180 2024-09-17T01:48:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.209+0000 7eff67600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7eff601617a0 con 0x7eff6015dd50 2024-09-17T01:48:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.209+0000 7eff67600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7eff6006f020 con 0x7eff601450e0 2024-09-17T01:48:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.209+0000 7eff57e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff60161180 0x7eff600aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.209+0000 7eff57e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff60161180 0x7eff600aa480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45748/0 (socket says 172.21.15.42:45748) 2024-09-17T01:48:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.209+0000 7eff57e00640 1 -- 172.21.15.42:0/1220056441 learned_addr learned my addr 172.21.15.42:0/1220056441 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.209+0000 7eff64c00640 1 --2- 172.21.15.42:0/1220056441 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff6015dd50 0x7eff6013de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.209+0000 7eff65600640 1 --2- 172.21.15.42:0/1220056441 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7eff601450e0 0x7eff600aa9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.209+0000 7eff57e00640 1 -- 172.21.15.42:0/1220056441 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7eff601450e0 msgr2=0x7eff600aa9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.209+0000 7eff57e00640 1 --2- 172.21.15.42:0/1220056441 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7eff601450e0 0x7eff600aa9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.209+0000 7eff57e00640 1 -- 172.21.15.42:0/1220056441 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff6015dd50 msgr2=0x7eff6013de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.209+0000 7eff57e00640 1 --2- 172.21.15.42:0/1220056441 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff6015dd50 0x7eff6013de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:47.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.209+0000 7eff57e00640 1 -- 172.21.15.42:0/1220056441 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff600aedb0 con 0x7eff60161180 2024-09-17T01:48:47.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.210+0000 7eff57e00640 1 --2- 172.21.15.42:0/1220056441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff60161180 0x7eff600aa480 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 crypto rx=0x7eff48000c00 tx=0x7eff480035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:47.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.210+0000 7eff5d600640 1 -- 172.21.15.42:0/1220056441 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4803e030 con 0x7eff60161180 2024-09-17T01:48:47.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.210+0000 7eff5d600640 1 -- 172.21.15.42:0/1220056441 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff48003ae0 con 0x7eff60161180 2024-09-17T01:48:47.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.210+0000 7eff5d600640 1 -- 172.21.15.42:0/1220056441 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff48035040 con 0x7eff60161180 2024-09-17T01:48:47.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.210+0000 7eff67600640 1 -- 172.21.15.42:0/1220056441 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff600af090 con 0x7eff60161180 2024-09-17T01:48:47.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.210+0000 7eff67600640 1 -- 172.21.15.42:0/1220056441 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff600ab1f0 con 0x7eff60161180 2024-09-17T01:48:47.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.211+0000 7eff67600640 1 -- 172.21.15.42:0/1220056441 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff6006f4b0 con 0x7eff60161180 2024-09-17T01:48:47.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.212+0000 7eff5d600640 1 -- 172.21.15.42:0/1220056441 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7eff48041030 con 0x7eff60161180 2024-09-17T01:48:47.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.213+0000 7eff5d600640 1 --2- 172.21.15.42:0/1220056441 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7eff3c078b90 0x7eff3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:47.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.213+0000 7eff5d600640 1 -- 172.21.15.42:0/1220056441 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(213..213 src has 1..213) ==== 5709+0+0 (secure 0 0 0) 0x7eff480bb0c0 con 0x7eff60161180 2024-09-17T01:48:47.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.214+0000 7eff64c00640 1 --2- 172.21.15.42:0/1220056441 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7eff3c078b90 0x7eff3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:47.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.214+0000 7eff64c00640 1 --2- 172.21.15.42:0/1220056441 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7eff3c078b90 0x7eff3c07b0a0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7eff600d0590 tx=0x7eff50009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:47.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.218+0000 7eff5d600640 1 -- 172.21.15.42:0/1220056441 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7eff48082ea0 con 0x7eff60161180 2024-09-17T01:48:47.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.409+0000 7eff67600640 1 -- 172.21.15.42:0/1220056441 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7eff600aeb60 con 0x7eff3c078b90 2024-09-17T01:48:47.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.414+0000 7eff5d600640 1 -- 172.21.15.42:0/1220056441 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252484 (secure 0 0 0) 0x7eff600aeb60 con 0x7eff3c078b90 2024-09-17T01:48:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:48:47.416 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:48:47.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.419+0000 7eff67600640 1 -- 172.21.15.42:0/1220056441 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7eff3c078b90 msgr2=0x7eff3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:47.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.419+0000 7eff67600640 1 --2- 172.21.15.42:0/1220056441 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7eff3c078b90 0x7eff3c07b0a0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7eff600d0590 tx=0x7eff50009040 comp rx=0 tx=0).stop 2024-09-17T01:48:47.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.419+0000 7eff67600640 1 -- 172.21.15.42:0/1220056441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff60161180 msgr2=0x7eff600aa480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:47.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.419+0000 7eff67600640 1 --2- 172.21.15.42:0/1220056441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff60161180 0x7eff600aa480 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 crypto rx=0x7eff48000c00 tx=0x7eff480035f0 comp rx=0 tx=0).stop 2024-09-17T01:48:47.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.419+0000 7eff67600640 1 -- 172.21.15.42:0/1220056441 shutdown_connections 2024-09-17T01:48:47.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.419+0000 7eff67600640 1 --2- 172.21.15.42:0/1220056441 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7eff3c078b90 0x7eff3c07b0a0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:47.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.419+0000 7eff67600640 1 --2- 172.21.15.42:0/1220056441 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7eff601450e0 0x7eff600aa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:47.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.419+0000 7eff67600640 1 --2- 172.21.15.42:0/1220056441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff60161180 0x7eff600aa480 unknown :-1 s=CLOSED pgs=2428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:47.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.419+0000 7eff67600640 1 --2- 172.21.15.42:0/1220056441 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff6015dd50 0x7eff6013de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:47.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.419+0000 7eff67600640 1 -- 172.21.15.42:0/1220056441 >> 172.21.15.42:0/1220056441 conn(0x7eff6006d1b0 msgr2=0x7eff600cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:47.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.419+0000 7eff67600640 1 -- 172.21.15.42:0/1220056441 shutdown_connections 2024-09-17T01:48:47.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.419+0000 7eff67600640 1 -- 172.21.15.42:0/1220056441 wait complete. 2024-09-17T01:48:47.440 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":713,"stamp":"2024-09-17T01:48:47.268013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":438200,"kb_used_data":22160,"kb_used_omap":12,"kb_used_meta":415859,"kb_avail":754536520,"statfs":{"total":773094113280,"available":772645396480,"internally_reserved":0,"allocated":22691840,"data_stored":10684396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":425840180},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.326492"},"pg_stats":[{"pgid":"31.3f","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450608+0000","last_change":"2024-09-17T01:48:41.988421+0000","last_active":"2024-09-17T01:48:43.450608+0000","last_peered":"2024-09-17T01:48:43.450608+0000","last_clean":"2024-09-17T01:48:43.450608+0000","last_became_active":"2024-09-17T01:48:41.988099+0000","last_became_peered":"2024-09-17T01:48:41.988099+0000","last_unstale":"2024-09-17T01:48:43.450608+0000","last_undegraded":"2024-09-17T01:48:43.450608+0000","last_fullsized":"2024-09-17T01:48:43.450608+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:10.721737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.3e","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.967821+0000","last_change":"2024-09-17T01:48:41.965330+0000","last_active":"2024-09-17T01:48:41.967821+0000","last_peered":"2024-09-17T01:48:41.967821+0000","last_clean":"2024-09-17T01:48:41.967821+0000","last_became_active":"2024-09-17T01:48:41.964988+0000","last_became_peered":"2024-09-17T01:48:41.964988+0000","last_unstale":"2024-09-17T01:48:41.967821+0000","last_undegraded":"2024-09-17T01:48:41.967821+0000","last_fullsized":"2024-09-17T01:48:41.967821+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:50:47.522773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.3d","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450523+0000","last_change":"2024-09-17T01:48:41.992476+0000","last_active":"2024-09-17T01:48:43.450523+0000","last_peered":"2024-09-17T01:48:43.450523+0000","last_clean":"2024-09-17T01:48:43.450523+0000","last_became_active":"2024-09-17T01:48:41.992130+0000","last_became_peered":"2024-09-17T01:48:41.992130+0000","last_unstale":"2024-09-17T01:48:43.450523+0000","last_undegraded":"2024-09-17T01:48:43.450523+0000","last_fullsized":"2024-09-17T01:48:43.450523+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:15:15.143150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.3c","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966650+0000","last_change":"2024-09-17T01:48:41.969707+0000","last_active":"2024-09-17T01:48:42.966650+0000","last_peered":"2024-09-17T01:48:42.966650+0000","last_clean":"2024-09-17T01:48:42.966650+0000","last_became_active":"2024-09-17T01:48:41.967489+0000","last_became_peered":"2024-09-17T01:48:41.967489+0000","last_unstale":"2024-09-17T01:48:42.966650+0000","last_undegraded":"2024-09-17T01:48:42.966650+0000","last_fullsized":"2024-09-17T01:48:42.966650+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:22.342311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.3b","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964633+0000","last_change":"2024-09-17T01:48:41.956894+0000","last_active":"2024-09-17T01:48:42.964633+0000","last_peered":"2024-09-17T01:48:42.964633+0000","last_clean":"2024-09-17T01:48:42.964633+0000","last_became_active":"2024-09-17T01:48:41.956533+0000","last_became_peered":"2024-09-17T01:48:41.956533+0000","last_unstale":"2024-09-17T01:48:42.964633+0000","last_undegraded":"2024-09-17T01:48:42.964633+0000","last_fullsized":"2024-09-17T01:48:42.964633+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:43.230899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.3a","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450111+0000","last_change":"2024-09-17T01:48:41.989695+0000","last_active":"2024-09-17T01:48:43.450111+0000","last_peered":"2024-09-17T01:48:43.450111+0000","last_clean":"2024-09-17T01:48:43.450111+0000","last_became_active":"2024-09-17T01:48:41.988985+0000","last_became_peered":"2024-09-17T01:48:41.988985+0000","last_unstale":"2024-09-17T01:48:43.450111+0000","last_undegraded":"2024-09-17T01:48:43.450111+0000","last_fullsized":"2024-09-17T01:48:43.450111+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:56:47.447939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.39","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393200+0000","last_change":"2024-09-17T01:48:41.963394+0000","last_active":"2024-09-17T01:48:43.393200+0000","last_peered":"2024-09-17T01:48:43.393200+0000","last_clean":"2024-09-17T01:48:43.393200+0000","last_became_active":"2024-09-17T01:48:41.963064+0000","last_became_peered":"2024-09-17T01:48:41.963064+0000","last_unstale":"2024-09-17T01:48:43.393200+0000","last_undegraded":"2024-09-17T01:48:43.393200+0000","last_fullsized":"2024-09-17T01:48:43.393200+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:50.099904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.38","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964389+0000","last_change":"2024-09-17T01:48:41.963873+0000","last_active":"2024-09-17T01:48:42.964389+0000","last_peered":"2024-09-17T01:48:42.964389+0000","last_clean":"2024-09-17T01:48:42.964389+0000","last_became_active":"2024-09-17T01:48:41.960583+0000","last_became_peered":"2024-09-17T01:48:41.960583+0000","last_unstale":"2024-09-17T01:48:42.964389+0000","last_undegraded":"2024-09-17T01:48:42.964389+0000","last_fullsized":"2024-09-17T01:48:42.964389+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:31.451012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.37","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959932+0000","last_change":"2024-09-17T01:48:41.987057+0000","last_active":"2024-09-17T01:48:43.959932+0000","last_peered":"2024-09-17T01:48:43.959932+0000","last_clean":"2024-09-17T01:48:43.959932+0000","last_became_active":"2024-09-17T01:48:41.986705+0000","last_became_peered":"2024-09-17T01:48:41.986705+0000","last_unstale":"2024-09-17T01:48:43.959932+0000","last_undegraded":"2024-09-17T01:48:43.959932+0000","last_fullsized":"2024-09-17T01:48:43.959932+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:08.089510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.36","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393240+0000","last_change":"2024-09-17T01:48:41.963101+0000","last_active":"2024-09-17T01:48:43.393240+0000","last_peered":"2024-09-17T01:48:43.393240+0000","last_clean":"2024-09-17T01:48:43.393240+0000","last_became_active":"2024-09-17T01:48:41.961668+0000","last_became_peered":"2024-09-17T01:48:41.961668+0000","last_unstale":"2024-09-17T01:48:43.393240+0000","last_undegraded":"2024-09-17T01:48:43.393240+0000","last_fullsized":"2024-09-17T01:48:43.393240+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:30.142847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.35","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967097+0000","last_change":"2024-09-17T01:48:41.992165+0000","last_active":"2024-09-17T01:48:42.967097+0000","last_peered":"2024-09-17T01:48:42.967097+0000","last_clean":"2024-09-17T01:48:42.967097+0000","last_became_active":"2024-09-17T01:48:41.991821+0000","last_became_peered":"2024-09-17T01:48:41.991821+0000","last_unstale":"2024-09-17T01:48:42.967097+0000","last_undegraded":"2024-09-17T01:48:42.967097+0000","last_fullsized":"2024-09-17T01:48:42.967097+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:26.331280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.34","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393530+0000","last_change":"2024-09-17T01:48:41.973919+0000","last_active":"2024-09-17T01:48:43.393530+0000","last_peered":"2024-09-17T01:48:43.393530+0000","last_clean":"2024-09-17T01:48:43.393530+0000","last_became_active":"2024-09-17T01:48:41.973559+0000","last_became_peered":"2024-09-17T01:48:41.973559+0000","last_unstale":"2024-09-17T01:48:43.393530+0000","last_undegraded":"2024-09-17T01:48:43.393530+0000","last_fullsized":"2024-09-17T01:48:43.393530+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:45.600564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.33","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959533+0000","last_change":"2024-09-17T01:48:41.980332+0000","last_active":"2024-09-17T01:48:43.959533+0000","last_peered":"2024-09-17T01:48:43.959533+0000","last_clean":"2024-09-17T01:48:43.959533+0000","last_became_active":"2024-09-17T01:48:41.979993+0000","last_became_peered":"2024-09-17T01:48:41.979993+0000","last_unstale":"2024-09-17T01:48:43.959533+0000","last_undegraded":"2024-09-17T01:48:43.959533+0000","last_fullsized":"2024-09-17T01:48:43.959533+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:28.765107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.32","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966149+0000","last_change":"2024-09-17T01:48:41.977401+0000","last_active":"2024-09-17T01:48:42.966149+0000","last_peered":"2024-09-17T01:48:42.966149+0000","last_clean":"2024-09-17T01:48:42.966149+0000","last_became_active":"2024-09-17T01:48:41.974556+0000","last_became_peered":"2024-09-17T01:48:41.974556+0000","last_unstale":"2024-09-17T01:48:42.966149+0000","last_undegraded":"2024-09-17T01:48:42.966149+0000","last_fullsized":"2024-09-17T01:48:42.966149+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:55.867060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.31","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965569+0000","last_change":"2024-09-17T01:48:41.975123+0000","last_active":"2024-09-17T01:48:42.965569+0000","last_peered":"2024-09-17T01:48:42.965569+0000","last_clean":"2024-09-17T01:48:42.965569+0000","last_became_active":"2024-09-17T01:48:41.974673+0000","last_became_peered":"2024-09-17T01:48:41.974673+0000","last_unstale":"2024-09-17T01:48:42.965569+0000","last_undegraded":"2024-09-17T01:48:42.965569+0000","last_fullsized":"2024-09-17T01:48:42.965569+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:17:36.339225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.30","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.971370+0000","last_change":"2024-09-17T01:48:41.965693+0000","last_active":"2024-09-17T01:48:41.971370+0000","last_peered":"2024-09-17T01:48:41.971370+0000","last_clean":"2024-09-17T01:48:41.971370+0000","last_became_active":"2024-09-17T01:48:41.962372+0000","last_became_peered":"2024-09-17T01:48:41.962372+0000","last_unstale":"2024-09-17T01:48:41.971370+0000","last_undegraded":"2024-09-17T01:48:41.971370+0000","last_fullsized":"2024-09-17T01:48:41.971370+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:44.587490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.2f","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393403+0000","last_change":"2024-09-17T01:48:41.976694+0000","last_active":"2024-09-17T01:48:43.393403+0000","last_peered":"2024-09-17T01:48:43.393403+0000","last_clean":"2024-09-17T01:48:43.393403+0000","last_became_active":"2024-09-17T01:48:41.974656+0000","last_became_peered":"2024-09-17T01:48:41.974656+0000","last_unstale":"2024-09-17T01:48:43.393403+0000","last_undegraded":"2024-09-17T01:48:43.393403+0000","last_fullsized":"2024-09-17T01:48:43.393403+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:02.926819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2e","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462080+0000","last_change":"2024-09-17T01:48:41.980564+0000","last_active":"2024-09-17T01:48:44.462080+0000","last_peered":"2024-09-17T01:48:44.462080+0000","last_clean":"2024-09-17T01:48:44.462080+0000","last_became_active":"2024-09-17T01:48:41.980245+0000","last_became_peered":"2024-09-17T01:48:41.980245+0000","last_unstale":"2024-09-17T01:48:44.462080+0000","last_undegraded":"2024-09-17T01:48:44.462080+0000","last_fullsized":"2024-09-17T01:48:44.462080+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:43.668061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.2d","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959709+0000","last_change":"2024-09-17T01:48:41.986560+0000","last_active":"2024-09-17T01:48:43.959709+0000","last_peered":"2024-09-17T01:48:43.959709+0000","last_clean":"2024-09-17T01:48:43.959709+0000","last_became_active":"2024-09-17T01:48:41.986238+0000","last_became_peered":"2024-09-17T01:48:41.986238+0000","last_unstale":"2024-09-17T01:48:43.959709+0000","last_undegraded":"2024-09-17T01:48:43.959709+0000","last_fullsized":"2024-09-17T01:48:43.959709+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:41:07.890922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.2c","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.976096+0000","last_change":"2024-09-17T01:48:41.969173+0000","last_active":"2024-09-17T01:48:41.976096+0000","last_peered":"2024-09-17T01:48:41.976096+0000","last_clean":"2024-09-17T01:48:41.976096+0000","last_became_active":"2024-09-17T01:48:41.968166+0000","last_became_peered":"2024-09-17T01:48:41.968166+0000","last_unstale":"2024-09-17T01:48:41.976096+0000","last_undegraded":"2024-09-17T01:48:41.976096+0000","last_fullsized":"2024-09-17T01:48:41.976096+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:08.105937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.2b","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964761+0000","last_change":"2024-09-17T01:48:41.954636+0000","last_active":"2024-09-17T01:48:42.964761+0000","last_peered":"2024-09-17T01:48:42.964761+0000","last_clean":"2024-09-17T01:48:42.964761+0000","last_became_active":"2024-09-17T01:48:41.953894+0000","last_became_peered":"2024-09-17T01:48:41.953894+0000","last_unstale":"2024-09-17T01:48:42.964761+0000","last_undegraded":"2024-09-17T01:48:42.964761+0000","last_fullsized":"2024-09-17T01:48:42.964761+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:36.329548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.2a","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959388+0000","last_change":"2024-09-17T01:48:41.966183+0000","last_active":"2024-09-17T01:48:43.959388+0000","last_peered":"2024-09-17T01:48:43.959388+0000","last_clean":"2024-09-17T01:48:43.959388+0000","last_became_active":"2024-09-17T01:48:41.964659+0000","last_became_peered":"2024-09-17T01:48:41.964659+0000","last_unstale":"2024-09-17T01:48:43.959388+0000","last_undegraded":"2024-09-17T01:48:43.959388+0000","last_fullsized":"2024-09-17T01:48:43.959388+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:43.230899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.29","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959378+0000","last_change":"2024-09-17T01:48:41.967881+0000","last_active":"2024-09-17T01:48:43.959378+0000","last_peered":"2024-09-17T01:48:43.959378+0000","last_clean":"2024-09-17T01:48:43.959378+0000","last_became_active":"2024-09-17T01:48:41.967418+0000","last_became_peered":"2024-09-17T01:48:41.967418+0000","last_unstale":"2024-09-17T01:48:43.959378+0000","last_undegraded":"2024-09-17T01:48:43.959378+0000","last_fullsized":"2024-09-17T01:48:43.959378+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:16.304885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.28","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965934+0000","last_change":"2024-09-17T01:48:41.971698+0000","last_active":"2024-09-17T01:48:42.965934+0000","last_peered":"2024-09-17T01:48:42.965934+0000","last_clean":"2024-09-17T01:48:42.965934+0000","last_became_active":"2024-09-17T01:48:41.970716+0000","last_became_peered":"2024-09-17T01:48:41.970716+0000","last_unstale":"2024-09-17T01:48:42.965934+0000","last_undegraded":"2024-09-17T01:48:42.965934+0000","last_fullsized":"2024-09-17T01:48:42.965934+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:55.100537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.27","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967261+0000","last_change":"2024-09-17T01:48:41.961465+0000","last_active":"2024-09-17T01:48:42.967261+0000","last_peered":"2024-09-17T01:48:42.967261+0000","last_clean":"2024-09-17T01:48:42.967261+0000","last_became_active":"2024-09-17T01:48:41.961094+0000","last_became_peered":"2024-09-17T01:48:41.961094+0000","last_unstale":"2024-09-17T01:48:42.967261+0000","last_undegraded":"2024-09-17T01:48:42.967261+0000","last_fullsized":"2024-09-17T01:48:42.967261+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:41.337984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.26","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965081+0000","last_change":"2024-09-17T01:48:41.976001+0000","last_active":"2024-09-17T01:48:42.965081+0000","last_peered":"2024-09-17T01:48:42.965081+0000","last_clean":"2024-09-17T01:48:42.965081+0000","last_became_active":"2024-09-17T01:48:41.975224+0000","last_became_peered":"2024-09-17T01:48:41.975224+0000","last_unstale":"2024-09-17T01:48:42.965081+0000","last_undegraded":"2024-09-17T01:48:42.965081+0000","last_fullsized":"2024-09-17T01:48:42.965081+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:54.362773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.25","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.964284+0000","last_change":"2024-09-17T01:48:41.962212+0000","last_active":"2024-09-17T01:48:41.964284+0000","last_peered":"2024-09-17T01:48:41.964284+0000","last_clean":"2024-09-17T01:48:41.964284+0000","last_became_active":"2024-09-17T01:48:41.957215+0000","last_became_peered":"2024-09-17T01:48:41.957215+0000","last_unstale":"2024-09-17T01:48:41.964284+0000","last_undegraded":"2024-09-17T01:48:41.964284+0000","last_fullsized":"2024-09-17T01:48:41.964284+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:36.289610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.24","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966653+0000","last_change":"2024-09-17T01:48:41.960227+0000","last_active":"2024-09-17T01:48:42.966653+0000","last_peered":"2024-09-17T01:48:42.966653+0000","last_clean":"2024-09-17T01:48:42.966653+0000","last_became_active":"2024-09-17T01:48:41.959863+0000","last_became_peered":"2024-09-17T01:48:41.959863+0000","last_unstale":"2024-09-17T01:48:42.966653+0000","last_undegraded":"2024-09-17T01:48:42.966653+0000","last_fullsized":"2024-09-17T01:48:42.966653+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:47.101431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.23","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966478+0000","last_change":"2024-09-17T01:48:41.983228+0000","last_active":"2024-09-17T01:48:42.966478+0000","last_peered":"2024-09-17T01:48:42.966478+0000","last_clean":"2024-09-17T01:48:42.966478+0000","last_became_active":"2024-09-17T01:48:41.982832+0000","last_became_peered":"2024-09-17T01:48:41.982832+0000","last_unstale":"2024-09-17T01:48:42.966478+0000","last_undegraded":"2024-09-17T01:48:42.966478+0000","last_fullsized":"2024-09-17T01:48:42.966478+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:53.868153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.22","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959412+0000","last_change":"2024-09-17T01:48:41.963496+0000","last_active":"2024-09-17T01:48:43.959412+0000","last_peered":"2024-09-17T01:48:43.959412+0000","last_clean":"2024-09-17T01:48:43.959412+0000","last_became_active":"2024-09-17T01:48:41.958645+0000","last_became_peered":"2024-09-17T01:48:41.958645+0000","last_unstale":"2024-09-17T01:48:43.959412+0000","last_undegraded":"2024-09-17T01:48:43.959412+0000","last_fullsized":"2024-09-17T01:48:43.959412+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:40:50.683423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.21","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965991+0000","last_change":"2024-09-17T01:48:41.973589+0000","last_active":"2024-09-17T01:48:42.965991+0000","last_peered":"2024-09-17T01:48:42.965991+0000","last_clean":"2024-09-17T01:48:42.965991+0000","last_became_active":"2024-09-17T01:48:41.973257+0000","last_became_peered":"2024-09-17T01:48:41.973257+0000","last_unstale":"2024-09-17T01:48:42.965991+0000","last_undegraded":"2024-09-17T01:48:42.965991+0000","last_fullsized":"2024-09-17T01:48:42.965991+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:00.927500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.20","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.971402+0000","last_change":"2024-09-17T01:48:41.966916+0000","last_active":"2024-09-17T01:48:41.971402+0000","last_peered":"2024-09-17T01:48:41.971402+0000","last_clean":"2024-09-17T01:48:41.971402+0000","last_became_active":"2024-09-17T01:48:41.962328+0000","last_became_peered":"2024-09-17T01:48:41.962328+0000","last_unstale":"2024-09-17T01:48:41.971402+0000","last_undegraded":"2024-09-17T01:48:41.971402+0000","last_fullsized":"2024-09-17T01:48:41.971402+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:00:44.537741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1f","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462071+0000","last_change":"2024-09-17T01:48:41.987044+0000","last_active":"2024-09-17T01:48:44.462071+0000","last_peered":"2024-09-17T01:48:44.462071+0000","last_clean":"2024-09-17T01:48:44.462071+0000","last_became_active":"2024-09-17T01:48:41.986685+0000","last_became_peered":"2024-09-17T01:48:41.986685+0000","last_unstale":"2024-09-17T01:48:44.462071+0000","last_undegraded":"2024-09-17T01:48:44.462071+0000","last_fullsized":"2024-09-17T01:48:44.462071+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:15:39.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1e","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966212+0000","last_change":"2024-09-17T01:48:40.958584+0000","last_active":"2024-09-17T01:48:42.966212+0000","last_peered":"2024-09-17T01:48:42.966212+0000","last_clean":"2024-09-17T01:48:42.966212+0000","last_became_active":"2024-09-17T01:48:40.958270+0000","last_became_peered":"2024-09-17T01:48:40.958270+0000","last_unstale":"2024-09-17T01:48:42.966212+0000","last_undegraded":"2024-09-17T01:48:42.966212+0000","last_fullsized":"2024-09-17T01:48:42.966212+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:43.311074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1c","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967106+0000","last_change":"2024-09-17T01:48:41.991844+0000","last_active":"2024-09-17T01:48:42.967106+0000","last_peered":"2024-09-17T01:48:42.967106+0000","last_clean":"2024-09-17T01:48:42.967106+0000","last_became_active":"2024-09-17T01:48:41.991218+0000","last_became_peered":"2024-09-17T01:48:41.991218+0000","last_unstale":"2024-09-17T01:48:42.967106+0000","last_undegraded":"2024-09-17T01:48:42.967106+0000","last_fullsized":"2024-09-17T01:48:42.967106+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:36.622860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1d","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450551+0000","last_change":"2024-09-17T01:48:40.970298+0000","last_active":"2024-09-17T01:48:43.450551+0000","last_peered":"2024-09-17T01:48:43.450551+0000","last_clean":"2024-09-17T01:48:43.450551+0000","last_became_active":"2024-09-17T01:48:40.969934+0000","last_became_peered":"2024-09-17T01:48:40.969934+0000","last_unstale":"2024-09-17T01:48:43.450551+0000","last_undegraded":"2024-09-17T01:48:43.450551+0000","last_fullsized":"2024-09-17T01:48:43.450551+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:06.666716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959878+0000","last_change":"2024-09-17T01:48:41.986546+0000","last_active":"2024-09-17T01:48:43.959878+0000","last_peered":"2024-09-17T01:48:43.959878+0000","last_clean":"2024-09-17T01:48:43.959878+0000","last_became_active":"2024-09-17T01:48:41.986211+0000","last_became_peered":"2024-09-17T01:48:41.986211+0000","last_unstale":"2024-09-17T01:48:43.959878+0000","last_undegraded":"2024-09-17T01:48:43.959878+0000","last_fullsized":"2024-09-17T01:48:43.959878+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:39.567639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1c","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461822+0000","last_change":"2024-09-17T01:48:40.963737+0000","last_active":"2024-09-17T01:48:44.461822+0000","last_peered":"2024-09-17T01:48:44.461822+0000","last_clean":"2024-09-17T01:48:44.461822+0000","last_became_active":"2024-09-17T01:48:40.963409+0000","last_became_peered":"2024-09-17T01:48:40.963409+0000","last_unstale":"2024-09-17T01:48:44.461822+0000","last_undegraded":"2024-09-17T01:48:44.461822+0000","last_fullsized":"2024-09-17T01:48:44.461822+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:07.992373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.1a","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461547+0000","last_change":"2024-09-17T01:48:41.967809+0000","last_active":"2024-09-17T01:48:44.461547+0000","last_peered":"2024-09-17T01:48:44.461547+0000","last_clean":"2024-09-17T01:48:44.461547+0000","last_became_active":"2024-09-17T01:48:41.967471+0000","last_became_peered":"2024-09-17T01:48:41.967471+0000","last_unstale":"2024-09-17T01:48:44.461547+0000","last_undegraded":"2024-09-17T01:48:44.461547+0000","last_fullsized":"2024-09-17T01:48:44.461547+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:15.398716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1b","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462083+0000","last_change":"2024-09-17T01:48:40.965537+0000","last_active":"2024-09-17T01:48:44.462083+0000","last_peered":"2024-09-17T01:48:44.462083+0000","last_clean":"2024-09-17T01:48:44.462083+0000","last_became_active":"2024-09-17T01:48:40.965186+0000","last_became_peered":"2024-09-17T01:48:40.965186+0000","last_unstale":"2024-09-17T01:48:44.462083+0000","last_undegraded":"2024-09-17T01:48:44.462083+0000","last_fullsized":"2024-09-17T01:48:44.462083+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:02.660884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.1b","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966082+0000","last_change":"2024-09-17T01:48:41.973058+0000","last_active":"2024-09-17T01:48:42.966082+0000","last_peered":"2024-09-17T01:48:42.966082+0000","last_clean":"2024-09-17T01:48:42.966082+0000","last_became_active":"2024-09-17T01:48:41.972705+0000","last_became_peered":"2024-09-17T01:48:41.972705+0000","last_unstale":"2024-09-17T01:48:42.966082+0000","last_undegraded":"2024-09-17T01:48:42.966082+0000","last_fullsized":"2024-09-17T01:48:42.966082+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:00.679343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1a","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461608+0000","last_change":"2024-09-17T01:48:40.963571+0000","last_active":"2024-09-17T01:48:44.461608+0000","last_peered":"2024-09-17T01:48:44.461608+0000","last_clean":"2024-09-17T01:48:44.461608+0000","last_became_active":"2024-09-17T01:48:40.963225+0000","last_became_peered":"2024-09-17T01:48:40.963225+0000","last_unstale":"2024-09-17T01:48:44.461608+0000","last_undegraded":"2024-09-17T01:48:44.461608+0000","last_fullsized":"2024-09-17T01:48:44.461608+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:17.264437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966022+0000","last_change":"2024-09-17T01:48:41.961255+0000","last_active":"2024-09-17T01:48:42.966022+0000","last_peered":"2024-09-17T01:48:42.966022+0000","last_clean":"2024-09-17T01:48:42.966022+0000","last_became_active":"2024-09-17T01:48:41.960894+0000","last_became_peered":"2024-09-17T01:48:41.960894+0000","last_unstale":"2024-09-17T01:48:42.966022+0000","last_undegraded":"2024-09-17T01:48:42.966022+0000","last_fullsized":"2024-09-17T01:48:42.966022+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:02:46.006988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965064+0000","last_change":"2024-09-17T01:48:40.963230+0000","last_active":"2024-09-17T01:48:42.965064+0000","last_peered":"2024-09-17T01:48:42.965064+0000","last_clean":"2024-09-17T01:48:42.965064+0000","last_became_active":"2024-09-17T01:48:40.962869+0000","last_became_peered":"2024-09-17T01:48:40.962869+0000","last_unstale":"2024-09-17T01:48:42.965064+0000","last_undegraded":"2024-09-17T01:48:42.965064+0000","last_fullsized":"2024-09-17T01:48:42.965064+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:31.161425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965805+0000","last_change":"2024-09-17T01:48:41.961510+0000","last_active":"2024-09-17T01:48:42.965805+0000","last_peered":"2024-09-17T01:48:42.965805+0000","last_clean":"2024-09-17T01:48:42.965805+0000","last_became_active":"2024-09-17T01:48:41.961149+0000","last_became_peered":"2024-09-17T01:48:41.961149+0000","last_unstale":"2024-09-17T01:48:42.965805+0000","last_undegraded":"2024-09-17T01:48:42.965805+0000","last_fullsized":"2024-09-17T01:48:42.965805+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:42.543461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.460990+0000","last_change":"2024-09-17T01:48:40.960363+0000","last_active":"2024-09-17T01:48:44.460990+0000","last_peered":"2024-09-17T01:48:44.460990+0000","last_clean":"2024-09-17T01:48:44.460990+0000","last_became_active":"2024-09-17T01:48:40.960030+0000","last_became_peered":"2024-09-17T01:48:40.960030+0000","last_unstale":"2024-09-17T01:48:44.460990+0000","last_undegraded":"2024-09-17T01:48:44.460990+0000","last_fullsized":"2024-09-17T01:48:44.460990+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:39.323864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967273+0000","last_change":"2024-09-17T01:48:41.960180+0000","last_active":"2024-09-17T01:48:42.967273+0000","last_peered":"2024-09-17T01:48:42.967273+0000","last_clean":"2024-09-17T01:48:42.967273+0000","last_became_active":"2024-09-17T01:48:41.959822+0000","last_became_peered":"2024-09-17T01:48:41.959822+0000","last_unstale":"2024-09-17T01:48:42.967273+0000","last_undegraded":"2024-09-17T01:48:42.967273+0000","last_fullsized":"2024-09-17T01:48:42.967273+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:15.702177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966259+0000","last_change":"2024-09-17T01:48:40.959777+0000","last_active":"2024-09-17T01:48:42.966259+0000","last_peered":"2024-09-17T01:48:42.966259+0000","last_clean":"2024-09-17T01:48:42.966259+0000","last_became_active":"2024-09-17T01:48:40.959450+0000","last_became_peered":"2024-09-17T01:48:40.959450+0000","last_unstale":"2024-09-17T01:48:42.966259+0000","last_undegraded":"2024-09-17T01:48:42.966259+0000","last_fullsized":"2024-09-17T01:48:42.966259+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:07.992373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462212+0000","last_change":"2024-09-17T01:48:41.966187+0000","last_active":"2024-09-17T01:48:44.462212+0000","last_peered":"2024-09-17T01:48:44.462212+0000","last_clean":"2024-09-17T01:48:44.462212+0000","last_became_active":"2024-09-17T01:48:41.965878+0000","last_became_peered":"2024-09-17T01:48:41.965878+0000","last_unstale":"2024-09-17T01:48:44.462212+0000","last_undegraded":"2024-09-17T01:48:44.462212+0000","last_fullsized":"2024-09-17T01:48:44.462212+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:24.225979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967188+0000","last_change":"2024-09-17T01:48:40.960473+0000","last_active":"2024-09-17T01:48:42.967188+0000","last_peered":"2024-09-17T01:48:42.967188+0000","last_clean":"2024-09-17T01:48:42.967188+0000","last_became_active":"2024-09-17T01:48:40.960115+0000","last_became_peered":"2024-09-17T01:48:40.960115+0000","last_unstale":"2024-09-17T01:48:42.967188+0000","last_undegraded":"2024-09-17T01:48:42.967188+0000","last_fullsized":"2024-09-17T01:48:42.967188+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:06:29.569198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.14","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.992000+0000","last_change":"2024-09-17T01:48:41.990381+0000","last_active":"2024-09-17T01:48:41.992000+0000","last_peered":"2024-09-17T01:48:41.992000+0000","last_clean":"2024-09-17T01:48:41.992000+0000","last_became_active":"2024-09-17T01:48:41.989915+0000","last_became_peered":"2024-09-17T01:48:41.989915+0000","last_unstale":"2024-09-17T01:48:41.992000+0000","last_undegraded":"2024-09-17T01:48:41.992000+0000","last_fullsized":"2024-09-17T01:48:41.992000+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:36.937033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.15","version":"212'3","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.986091+0000","last_change":"2024-09-17T01:48:40.960038+0000","last_active":"2024-09-17T01:48:41.986091+0000","last_peered":"2024-09-17T01:48:41.986091+0000","last_clean":"2024-09-17T01:48:41.986091+0000","last_became_active":"2024-09-17T01:48:40.959680+0000","last_became_peered":"2024-09-17T01:48:40.959680+0000","last_unstale":"2024-09-17T01:48:41.986091+0000","last_undegraded":"2024-09-17T01:48:41.986091+0000","last_fullsized":"2024-09-17T01:48:41.986091+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:11.499994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.15","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964632+0000","last_change":"2024-09-17T01:48:41.958372+0000","last_active":"2024-09-17T01:48:42.964632+0000","last_peered":"2024-09-17T01:48:42.964632+0000","last_clean":"2024-09-17T01:48:42.964632+0000","last_became_active":"2024-09-17T01:48:41.958067+0000","last_became_peered":"2024-09-17T01:48:41.958067+0000","last_unstale":"2024-09-17T01:48:42.964632+0000","last_undegraded":"2024-09-17T01:48:42.964632+0000","last_fullsized":"2024-09-17T01:48:42.964632+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:02.967349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.14","version":"212'6","reported_seq":21,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450276+0000","last_change":"2024-09-17T01:48:40.969037+0000","last_active":"2024-09-17T01:48:43.450276+0000","last_peered":"2024-09-17T01:48:43.450276+0000","last_clean":"2024-09-17T01:48:43.450276+0000","last_became_active":"2024-09-17T01:48:40.968663+0000","last_became_peered":"2024-09-17T01:48:40.968663+0000","last_unstale":"2024-09-17T01:48:43.450276+0000","last_undegraded":"2024-09-17T01:48:43.450276+0000","last_fullsized":"2024-09-17T01:48:43.450276+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:36.157770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965788+0000","last_change":"2024-09-17T01:48:41.974194+0000","last_active":"2024-09-17T01:48:42.965788+0000","last_peered":"2024-09-17T01:48:42.965788+0000","last_clean":"2024-09-17T01:48:42.965788+0000","last_became_active":"2024-09-17T01:48:41.972690+0000","last_became_peered":"2024-09-17T01:48:41.972690+0000","last_unstale":"2024-09-17T01:48:42.965788+0000","last_undegraded":"2024-09-17T01:48:42.965788+0000","last_fullsized":"2024-09-17T01:48:42.965788+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:53.619025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.13","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450234+0000","last_change":"2024-09-17T01:48:40.964396+0000","last_active":"2024-09-17T01:48:43.450234+0000","last_peered":"2024-09-17T01:48:43.450234+0000","last_clean":"2024-09-17T01:48:43.450234+0000","last_became_active":"2024-09-17T01:48:40.964058+0000","last_became_peered":"2024-09-17T01:48:40.964058+0000","last_unstale":"2024-09-17T01:48:43.450234+0000","last_undegraded":"2024-09-17T01:48:43.450234+0000","last_fullsized":"2024-09-17T01:48:43.450234+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:43.677360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.13","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959516+0000","last_change":"2024-09-17T01:48:41.962451+0000","last_active":"2024-09-17T01:48:43.959516+0000","last_peered":"2024-09-17T01:48:43.959516+0000","last_clean":"2024-09-17T01:48:43.959516+0000","last_became_active":"2024-09-17T01:48:41.962113+0000","last_became_peered":"2024-09-17T01:48:41.962113+0000","last_unstale":"2024-09-17T01:48:43.959516+0000","last_undegraded":"2024-09-17T01:48:43.959516+0000","last_fullsized":"2024-09-17T01:48:43.959516+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:30.290603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966052+0000","last_change":"2024-09-17T01:48:40.958069+0000","last_active":"2024-09-17T01:48:42.966052+0000","last_peered":"2024-09-17T01:48:42.966052+0000","last_clean":"2024-09-17T01:48:42.966052+0000","last_became_active":"2024-09-17T01:48:40.956114+0000","last_became_peered":"2024-09-17T01:48:40.956114+0000","last_unstale":"2024-09-17T01:48:42.966052+0000","last_undegraded":"2024-09-17T01:48:42.966052+0000","last_fullsized":"2024-09-17T01:48:42.966052+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:25.002380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.10","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461069+0000","last_change":"2024-09-17T01:48:41.975846+0000","last_active":"2024-09-17T01:48:44.461069+0000","last_peered":"2024-09-17T01:48:44.461069+0000","last_clean":"2024-09-17T01:48:44.461069+0000","last_became_active":"2024-09-17T01:48:41.975443+0000","last_became_peered":"2024-09-17T01:48:41.975443+0000","last_unstale":"2024-09-17T01:48:44.461069+0000","last_undegraded":"2024-09-17T01:48:44.461069+0000","last_fullsized":"2024-09-17T01:48:44.461069+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:52:23.341819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965173+0000","last_change":"2024-09-17T01:48:40.962362+0000","last_active":"2024-09-17T01:48:42.965173+0000","last_peered":"2024-09-17T01:48:42.965173+0000","last_clean":"2024-09-17T01:48:42.965173+0000","last_became_active":"2024-09-17T01:48:40.961975+0000","last_became_peered":"2024-09-17T01:48:40.961975+0000","last_unstale":"2024-09-17T01:48:42.965173+0000","last_undegraded":"2024-09-17T01:48:42.965173+0000","last_fullsized":"2024-09-17T01:48:42.965173+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:17.865320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965577+0000","last_change":"2024-09-17T01:48:41.975201+0000","last_active":"2024-09-17T01:48:42.965577+0000","last_peered":"2024-09-17T01:48:42.965577+0000","last_clean":"2024-09-17T01:48:42.965577+0000","last_became_active":"2024-09-17T01:48:41.974581+0000","last_became_peered":"2024-09-17T01:48:41.974581+0000","last_unstale":"2024-09-17T01:48:42.965577+0000","last_undegraded":"2024-09-17T01:48:42.965577+0000","last_fullsized":"2024-09-17T01:48:42.965577+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:20.028457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.10","version":"212'8","reported_seq":21,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.988351+0000","last_change":"2024-09-17T01:48:40.962920+0000","last_active":"2024-09-17T01:48:41.988351+0000","last_peered":"2024-09-17T01:48:41.988351+0000","last_clean":"2024-09-17T01:48:41.988351+0000","last_became_active":"2024-09-17T01:48:40.962230+0000","last_became_peered":"2024-09-17T01:48:40.962230+0000","last_unstale":"2024-09-17T01:48:41.988351+0000","last_undegraded":"2024-09-17T01:48:41.988351+0000","last_fullsized":"2024-09-17T01:48:41.988351+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:43.167939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.e","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462192+0000","last_change":"2024-09-17T01:48:41.967242+0000","last_active":"2024-09-17T01:48:44.462192+0000","last_peered":"2024-09-17T01:48:44.462192+0000","last_clean":"2024-09-17T01:48:44.462192+0000","last_became_active":"2024-09-17T01:48:41.966892+0000","last_became_peered":"2024-09-17T01:48:41.966892+0000","last_unstale":"2024-09-17T01:48:44.462192+0000","last_undegraded":"2024-09-17T01:48:44.462192+0000","last_fullsized":"2024-09-17T01:48:44.462192+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:29.649430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.f","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966375+0000","last_change":"2024-09-17T01:48:40.958540+0000","last_active":"2024-09-17T01:48:42.966375+0000","last_peered":"2024-09-17T01:48:42.966375+0000","last_clean":"2024-09-17T01:48:42.966375+0000","last_became_active":"2024-09-17T01:48:40.958209+0000","last_became_peered":"2024-09-17T01:48:40.958209+0000","last_unstale":"2024-09-17T01:48:42.966375+0000","last_undegraded":"2024-09-17T01:48:42.966375+0000","last_fullsized":"2024-09-17T01:48:42.966375+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:02.660884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.f","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.975961+0000","last_change":"2024-09-17T01:48:41.968961+0000","last_active":"2024-09-17T01:48:41.975961+0000","last_peered":"2024-09-17T01:48:41.975961+0000","last_clean":"2024-09-17T01:48:41.975961+0000","last_became_active":"2024-09-17T01:48:41.968609+0000","last_became_peered":"2024-09-17T01:48:41.968609+0000","last_unstale":"2024-09-17T01:48:41.975961+0000","last_undegraded":"2024-09-17T01:48:41.975961+0000","last_fullsized":"2024-09-17T01:48:41.975961+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:00.830194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.e","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967385+0000","last_change":"2024-09-17T01:48:40.958112+0000","last_active":"2024-09-17T01:48:42.967385+0000","last_peered":"2024-09-17T01:48:42.967385+0000","last_clean":"2024-09-17T01:48:42.967385+0000","last_became_active":"2024-09-17T01:48:40.957765+0000","last_became_peered":"2024-09-17T01:48:40.957765+0000","last_unstale":"2024-09-17T01:48:42.967385+0000","last_undegraded":"2024-09-17T01:48:42.967385+0000","last_fullsized":"2024-09-17T01:48:42.967385+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:33.429311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966144+0000","last_change":"2024-09-17T01:48:41.962826+0000","last_active":"2024-09-17T01:48:42.966144+0000","last_peered":"2024-09-17T01:48:42.966144+0000","last_clean":"2024-09-17T01:48:42.966144+0000","last_became_active":"2024-09-17T01:48:41.962494+0000","last_became_peered":"2024-09-17T01:48:41.962494+0000","last_unstale":"2024-09-17T01:48:42.966144+0000","last_undegraded":"2024-09-17T01:48:42.966144+0000","last_fullsized":"2024-09-17T01:48:42.966144+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:37.163100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.d","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966115+0000","last_change":"2024-09-17T01:48:40.960604+0000","last_active":"2024-09-17T01:48:42.966115+0000","last_peered":"2024-09-17T01:48:42.966115+0000","last_clean":"2024-09-17T01:48:42.966115+0000","last_became_active":"2024-09-17T01:48:40.960047+0000","last_became_peered":"2024-09-17T01:48:40.960047+0000","last_unstale":"2024-09-17T01:48:42.966115+0000","last_undegraded":"2024-09-17T01:48:42.966115+0000","last_fullsized":"2024-09-17T01:48:42.966115+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:01.691297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.d","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393460+0000","last_change":"2024-09-17T01:48:41.961193+0000","last_active":"2024-09-17T01:48:43.393460+0000","last_peered":"2024-09-17T01:48:43.393460+0000","last_clean":"2024-09-17T01:48:43.393460+0000","last_became_active":"2024-09-17T01:48:41.960675+0000","last_became_peered":"2024-09-17T01:48:41.960675+0000","last_unstale":"2024-09-17T01:48:43.393460+0000","last_undegraded":"2024-09-17T01:48:43.393460+0000","last_fullsized":"2024-09-17T01:48:43.393460+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:45:20.974258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966870+0000","last_change":"2024-09-17T01:48:40.969612+0000","last_active":"2024-09-17T01:48:42.966870+0000","last_peered":"2024-09-17T01:48:42.966870+0000","last_clean":"2024-09-17T01:48:42.966870+0000","last_became_active":"2024-09-17T01:48:40.969131+0000","last_became_peered":"2024-09-17T01:48:40.969131+0000","last_unstale":"2024-09-17T01:48:42.966870+0000","last_undegraded":"2024-09-17T01:48:42.966870+0000","last_fullsized":"2024-09-17T01:48:42.966870+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:06.914057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959737+0000","last_change":"2024-09-17T01:48:41.980525+0000","last_active":"2024-09-17T01:48:43.959737+0000","last_peered":"2024-09-17T01:48:43.959737+0000","last_clean":"2024-09-17T01:48:43.959737+0000","last_became_active":"2024-09-17T01:48:41.979833+0000","last_became_peered":"2024-09-17T01:48:41.979833+0000","last_unstale":"2024-09-17T01:48:43.959737+0000","last_undegraded":"2024-09-17T01:48:43.959737+0000","last_fullsized":"2024-09-17T01:48:43.959737+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:03:32.301181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.b","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966523+0000","last_change":"2024-09-17T01:48:40.954645+0000","last_active":"2024-09-17T01:48:42.966523+0000","last_peered":"2024-09-17T01:48:42.966523+0000","last_clean":"2024-09-17T01:48:42.966523+0000","last_became_active":"2024-09-17T01:48:40.954314+0000","last_became_peered":"2024-09-17T01:48:40.954314+0000","last_unstale":"2024-09-17T01:48:42.966523+0000","last_undegraded":"2024-09-17T01:48:42.966523+0000","last_fullsized":"2024-09-17T01:48:42.966523+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:03.890846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.b","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966366+0000","last_change":"2024-09-17T01:48:41.962675+0000","last_active":"2024-09-17T01:48:42.966366+0000","last_peered":"2024-09-17T01:48:42.966366+0000","last_clean":"2024-09-17T01:48:42.966366+0000","last_became_active":"2024-09-17T01:48:41.960185+0000","last_became_peered":"2024-09-17T01:48:41.960185+0000","last_unstale":"2024-09-17T01:48:42.966366+0000","last_undegraded":"2024-09-17T01:48:42.966366+0000","last_fullsized":"2024-09-17T01:48:42.966366+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:53.273110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966188+0000","last_change":"2024-09-17T01:48:40.957409+0000","last_active":"2024-09-17T01:48:42.966188+0000","last_peered":"2024-09-17T01:48:42.966188+0000","last_clean":"2024-09-17T01:48:42.966188+0000","last_became_active":"2024-09-17T01:48:40.957076+0000","last_became_peered":"2024-09-17T01:48:40.957076+0000","last_unstale":"2024-09-17T01:48:42.966188+0000","last_undegraded":"2024-09-17T01:48:42.966188+0000","last_fullsized":"2024-09-17T01:48:42.966188+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:09.169291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.460832+0000","last_change":"2024-09-17T01:48:41.972315+0000","last_active":"2024-09-17T01:48:44.460832+0000","last_peered":"2024-09-17T01:48:44.460832+0000","last_clean":"2024-09-17T01:48:44.460832+0000","last_became_active":"2024-09-17T01:48:41.964814+0000","last_became_peered":"2024-09-17T01:48:41.964814+0000","last_unstale":"2024-09-17T01:48:44.460832+0000","last_undegraded":"2024-09-17T01:48:44.460832+0000","last_fullsized":"2024-09-17T01:48:44.460832+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:44.993483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393202+0000","last_change":"2024-09-17T01:48:40.960091+0000","last_active":"2024-09-17T01:48:43.393202+0000","last_peered":"2024-09-17T01:48:43.393202+0000","last_clean":"2024-09-17T01:48:43.393202+0000","last_became_active":"2024-09-17T01:48:40.959708+0000","last_became_peered":"2024-09-17T01:48:40.959708+0000","last_unstale":"2024-09-17T01:48:43.393202+0000","last_undegraded":"2024-09-17T01:48:43.393202+0000","last_fullsized":"2024-09-17T01:48:43.393202+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:14.069903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965102+0000","last_change":"2024-09-17T01:48:41.954668+0000","last_active":"2024-09-17T01:48:42.965102+0000","last_peered":"2024-09-17T01:48:42.965102+0000","last_clean":"2024-09-17T01:48:42.965102+0000","last_became_active":"2024-09-17T01:48:41.953453+0000","last_became_peered":"2024-09-17T01:48:41.953453+0000","last_unstale":"2024-09-17T01:48:42.965102+0000","last_undegraded":"2024-09-17T01:48:42.965102+0000","last_fullsized":"2024-09-17T01:48:42.965102+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:56.732819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393455+0000","last_change":"2024-09-17T01:48:40.954364+0000","last_active":"2024-09-17T01:48:43.393455+0000","last_peered":"2024-09-17T01:48:43.393455+0000","last_clean":"2024-09-17T01:48:43.393455+0000","last_became_active":"2024-09-17T01:48:40.952633+0000","last_became_peered":"2024-09-17T01:48:40.952633+0000","last_unstale":"2024-09-17T01:48:43.393455+0000","last_undegraded":"2024-09-17T01:48:43.393455+0000","last_fullsized":"2024-09-17T01:48:43.393455+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:14.968860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966306+0000","last_change":"2024-09-17T01:48:41.980321+0000","last_active":"2024-09-17T01:48:42.966306+0000","last_peered":"2024-09-17T01:48:42.966306+0000","last_clean":"2024-09-17T01:48:42.966306+0000","last_became_active":"2024-09-17T01:48:41.979988+0000","last_became_peered":"2024-09-17T01:48:41.979988+0000","last_unstale":"2024-09-17T01:48:42.966306+0000","last_undegraded":"2024-09-17T01:48:42.966306+0000","last_fullsized":"2024-09-17T01:48:42.966306+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:44.682690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.7","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967542+0000","last_change":"2024-09-17T01:48:40.968513+0000","last_active":"2024-09-17T01:48:42.967542+0000","last_peered":"2024-09-17T01:48:42.967542+0000","last_clean":"2024-09-17T01:48:42.967542+0000","last_became_active":"2024-09-17T01:48:40.968147+0000","last_became_peered":"2024-09-17T01:48:40.968147+0000","last_unstale":"2024-09-17T01:48:42.967542+0000","last_undegraded":"2024-09-17T01:48:42.967542+0000","last_fullsized":"2024-09-17T01:48:42.967542+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:50.333573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.7","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450551+0000","last_change":"2024-09-17T01:48:41.995352+0000","last_active":"2024-09-17T01:48:43.450551+0000","last_peered":"2024-09-17T01:48:43.450551+0000","last_clean":"2024-09-17T01:48:43.450551+0000","last_became_active":"2024-09-17T01:48:41.995020+0000","last_became_peered":"2024-09-17T01:48:41.995020+0000","last_unstale":"2024-09-17T01:48:43.450551+0000","last_undegraded":"2024-09-17T01:48:43.450551+0000","last_fullsized":"2024-09-17T01:48:43.450551+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:15.035889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.6","version":"213'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959711+0000","last_change":"2024-09-17T01:48:40.967945+0000","last_active":"2024-09-17T01:48:43.959711+0000","last_peered":"2024-09-17T01:48:43.959711+0000","last_clean":"2024-09-17T01:48:43.959711+0000","last_became_active":"2024-09-17T01:48:40.967538+0000","last_became_peered":"2024-09-17T01:48:40.967538+0000","last_unstale":"2024-09-17T01:48:43.959711+0000","last_undegraded":"2024-09-17T01:48:43.959711+0000","last_fullsized":"2024-09-17T01:48:43.959711+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:03.999082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461879+0000","last_change":"2024-09-17T01:48:41.987120+0000","last_active":"2024-09-17T01:48:44.461879+0000","last_peered":"2024-09-17T01:48:44.461879+0000","last_clean":"2024-09-17T01:48:44.461879+0000","last_became_active":"2024-09-17T01:48:41.986788+0000","last_became_peered":"2024-09-17T01:48:41.986788+0000","last_unstale":"2024-09-17T01:48:44.461879+0000","last_undegraded":"2024-09-17T01:48:44.461879+0000","last_fullsized":"2024-09-17T01:48:44.461879+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:45.285758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964804+0000","last_change":"2024-09-17T01:48:40.964922+0000","last_active":"2024-09-17T01:48:42.964804+0000","last_peered":"2024-09-17T01:48:42.964804+0000","last_clean":"2024-09-17T01:48:42.964804+0000","last_became_active":"2024-09-17T01:48:40.964564+0000","last_became_peered":"2024-09-17T01:48:40.964564+0000","last_unstale":"2024-09-17T01:48:42.964804+0000","last_undegraded":"2024-09-17T01:48:42.964804+0000","last_fullsized":"2024-09-17T01:48:42.964804+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:17.144236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966915+0000","last_change":"2024-09-17T01:48:41.983739+0000","last_active":"2024-09-17T01:48:42.966915+0000","last_peered":"2024-09-17T01:48:42.966915+0000","last_clean":"2024-09-17T01:48:42.966915+0000","last_became_active":"2024-09-17T01:48:41.983417+0000","last_became_peered":"2024-09-17T01:48:41.983417+0000","last_unstale":"2024-09-17T01:48:42.966915+0000","last_undegraded":"2024-09-17T01:48:42.966915+0000","last_fullsized":"2024-09-17T01:48:42.966915+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:25.410155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967262+0000","last_change":"2024-09-17T01:48:40.961630+0000","last_active":"2024-09-17T01:48:42.967262+0000","last_peered":"2024-09-17T01:48:42.967262+0000","last_clean":"2024-09-17T01:48:42.967262+0000","last_became_active":"2024-09-17T01:48:40.960243+0000","last_became_peered":"2024-09-17T01:48:40.960243+0000","last_unstale":"2024-09-17T01:48:42.967262+0000","last_undegraded":"2024-09-17T01:48:42.967262+0000","last_fullsized":"2024-09-17T01:48:42.967262+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:02.136066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959855+0000","last_change":"2024-09-17T01:48:41.965904+0000","last_active":"2024-09-17T01:48:43.959855+0000","last_peered":"2024-09-17T01:48:43.959855+0000","last_clean":"2024-09-17T01:48:43.959855+0000","last_became_active":"2024-09-17T01:48:41.965593+0000","last_became_peered":"2024-09-17T01:48:41.965593+0000","last_unstale":"2024-09-17T01:48:43.959855+0000","last_undegraded":"2024-09-17T01:48:43.959855+0000","last_fullsized":"2024-09-17T01:48:43.959855+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:33.950142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965967+0000","last_change":"2024-09-17T01:48:40.956231+0000","last_active":"2024-09-17T01:48:42.965967+0000","last_peered":"2024-09-17T01:48:42.965967+0000","last_clean":"2024-09-17T01:48:42.965967+0000","last_became_active":"2024-09-17T01:48:40.955414+0000","last_became_peered":"2024-09-17T01:48:40.955414+0000","last_unstale":"2024-09-17T01:48:42.965967+0000","last_undegraded":"2024-09-17T01:48:42.965967+0000","last_fullsized":"2024-09-17T01:48:42.965967+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:39.323864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964920+0000","last_change":"2024-09-17T01:48:41.968153+0000","last_active":"2024-09-17T01:48:42.964920+0000","last_peered":"2024-09-17T01:48:42.964920+0000","last_clean":"2024-09-17T01:48:42.964920+0000","last_became_active":"2024-09-17T01:48:41.967605+0000","last_became_peered":"2024-09-17T01:48:41.967605+0000","last_unstale":"2024-09-17T01:48:42.964920+0000","last_undegraded":"2024-09-17T01:48:42.964920+0000","last_fullsized":"2024-09-17T01:48:42.964920+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:16.656430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461708+0000","last_change":"2024-09-17T01:48:40.961888+0000","last_active":"2024-09-17T01:48:44.461708+0000","last_peered":"2024-09-17T01:48:44.461708+0000","last_clean":"2024-09-17T01:48:44.461708+0000","last_became_active":"2024-09-17T01:48:40.960057+0000","last_became_peered":"2024-09-17T01:48:40.960057+0000","last_unstale":"2024-09-17T01:48:44.461708+0000","last_undegraded":"2024-09-17T01:48:44.461708+0000","last_fullsized":"2024-09-17T01:48:44.461708+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:01.691297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393545+0000","last_change":"2024-09-17T01:48:41.964119+0000","last_active":"2024-09-17T01:48:43.393545+0000","last_peered":"2024-09-17T01:48:43.393545+0000","last_clean":"2024-09-17T01:48:43.393545+0000","last_became_active":"2024-09-17T01:48:41.963688+0000","last_became_peered":"2024-09-17T01:48:41.963688+0000","last_unstale":"2024-09-17T01:48:43.393545+0000","last_undegraded":"2024-09-17T01:48:43.393545+0000","last_fullsized":"2024-09-17T01:48:43.393545+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:26:24.176532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.449918+0000","last_change":"2024-09-17T01:48:40.970410+0000","last_active":"2024-09-17T01:48:43.449918+0000","last_peered":"2024-09-17T01:48:43.449918+0000","last_clean":"2024-09-17T01:48:43.449918+0000","last_became_active":"2024-09-17T01:48:40.969725+0000","last_became_peered":"2024-09-17T01:48:40.969725+0000","last_unstale":"2024-09-17T01:48:43.449918+0000","last_undegraded":"2024-09-17T01:48:43.449918+0000","last_fullsized":"2024-09-17T01:48:43.449918+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:59.674013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450122+0000","last_change":"2024-09-17T01:48:41.987710+0000","last_active":"2024-09-17T01:48:43.450122+0000","last_peered":"2024-09-17T01:48:43.450122+0000","last_clean":"2024-09-17T01:48:43.450122+0000","last_became_active":"2024-09-17T01:48:41.983328+0000","last_became_peered":"2024-09-17T01:48:41.983328+0000","last_unstale":"2024-09-17T01:48:43.450122+0000","last_undegraded":"2024-09-17T01:48:43.450122+0000","last_fullsized":"2024-09-17T01:48:43.450122+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:19.736187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.956387+0000","last_change":"2024-09-17T01:48:40.963242+0000","last_active":"2024-09-17T01:48:41.956387+0000","last_peered":"2024-09-17T01:48:41.956387+0000","last_clean":"2024-09-17T01:48:41.956387+0000","last_became_active":"2024-09-17T01:48:40.962603+0000","last_became_peered":"2024-09-17T01:48:40.962603+0000","last_unstale":"2024-09-17T01:48:41.956387+0000","last_undegraded":"2024-09-17T01:48:41.956387+0000","last_fullsized":"2024-09-17T01:48:41.956387+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:04:09.145533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1e","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393421+0000","last_change":"2024-09-17T01:48:41.959892+0000","last_active":"2024-09-17T01:48:43.393421+0000","last_peered":"2024-09-17T01:48:43.393421+0000","last_clean":"2024-09-17T01:48:43.393421+0000","last_became_active":"2024-09-17T01:48:41.959602+0000","last_became_peered":"2024-09-17T01:48:41.959602+0000","last_unstale":"2024-09-17T01:48:43.393421+0000","last_undegraded":"2024-09-17T01:48:43.393421+0000","last_fullsized":"2024-09-17T01:48:43.393421+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:20.244068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.1f","version":"212'4","reported_seq":19,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450730+0000","last_change":"2024-09-17T01:48:40.970365+0000","last_active":"2024-09-17T01:48:43.450730+0000","last_peered":"2024-09-17T01:48:43.450730+0000","last_clean":"2024-09-17T01:48:43.450730+0000","last_became_active":"2024-09-17T01:48:40.969386+0000","last_became_peered":"2024-09-17T01:48:40.969386+0000","last_unstale":"2024-09-17T01:48:43.450730+0000","last_undegraded":"2024-09-17T01:48:43.450730+0000","last_fullsized":"2024-09-17T01:48:43.450730+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:05.396682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":478,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964191+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:48:42.964191+0000","last_peered":"2024-09-17T01:48:42.964191+0000","last_clean":"2024-09-17T01:48:42.964191+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:48:42.964191+0000","last_undegraded":"2024-09-17T01:48:42.964191+0000","last_fullsized":"2024-09-17T01:48:42.964191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":31,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":30,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476942,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47700,"kb_used_data":2624,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324140,"statfs":{"total":96636764160,"available":96587919360,"internally_reserved":0,"allocated":2686976,"data_stored":1189000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509645,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56036,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315804,"statfs":{"total":96636764160,"available":96579383296,"internally_reserved":0,"allocated":2703360,"data_stored":1191158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509644,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47688,"kb_used_data":2612,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324152,"statfs":{"total":96636764160,"available":96587931648,"internally_reserved":0,"allocated":2674688,"data_stored":1182720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509645,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51860,"kb_used_data":2624,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319980,"statfs":{"total":96636764160,"available":96583659520,"internally_reserved":0,"allocated":2686976,"data_stored":1188952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509645,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69852,"kb_used_data":2632,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94301988,"statfs":{"total":96636764160,"available":96565235712,"internally_reserved":0,"allocated":2695168,"data_stored":1190542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509644,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52440,"kb_used_data":3204,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319400,"statfs":{"total":96636764160,"available":96583065600,"internally_reserved":0,"allocated":3280896,"data_stored":1779880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509646,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60184,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311656,"statfs":{"total":96636764160,"available":96575135744,"internally_reserved":0,"allocated":2691072,"data_stored":1189022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":58915273},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542350,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52440,"kb_used_data":3196,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319400,"statfs":{"total":96636764160,"available":96583065600,"internally_reserved":0,"allocated":3272704,"data_stored":1773122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:48:47.444 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T01:48:47.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.709+0000 7fa545200640 1 -- 172.21.15.42:0/2230231502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa524005350 msgr2=0x7fa52400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:47.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.709+0000 7fa545200640 1 --2- 172.21.15.42:0/2230231502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa524005350 0x7fa52400b9c0 secure :-1 s=READY pgs=2430 cs=0 l=1 rev1=1 crypto rx=0x7fa538001d90 tx=0x7fa524005830 comp rx=0 tx=0).stop 2024-09-17T01:48:47.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.709+0000 7fa545200640 1 -- 172.21.15.42:0/2230231502 shutdown_connections 2024-09-17T01:48:47.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.709+0000 7fa545200640 1 --2- 172.21.15.42:0/2230231502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa524005350 0x7fa52400b9c0 unknown :-1 s=CLOSED pgs=2430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:47.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.709+0000 7fa545200640 1 -- 172.21.15.42:0/2230231502 >> 172.21.15.42:0/2230231502 conn(0x7fa54006d1b0 msgr2=0x7fa54006d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:47.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.710+0000 7fa545200640 1 -- 172.21.15.42:0/2230231502 shutdown_connections 2024-09-17T01:48:47.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.710+0000 7fa545200640 1 -- 172.21.15.42:0/2230231502 wait complete. 2024-09-17T01:48:47.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.712+0000 7fa545200640 1 Processor -- start 2024-09-17T01:48:47.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.712+0000 7fa545200640 1 -- start start 2024-09-17T01:48:47.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.713+0000 7fa545200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa524005350 0x7fa5401f77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:47.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.713+0000 7fa545200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa540155fd0 0x7fa54013de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:47.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.713+0000 7fa545200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa540157b10 0x7fa540157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:47.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.713+0000 7fa545200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa5400735b0 con 0x7fa540155fd0 2024-09-17T01:48:47.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.713+0000 7fa545200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa540073430 con 0x7fa524005350 2024-09-17T01:48:47.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.713+0000 7fa545200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa540152980 con 0x7fa540157b10 2024-09-17T01:48:47.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.714+0000 7fa537e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa540155fd0 0x7fa54013de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:47.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.714+0000 7fa537e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa540155fd0 0x7fa54013de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45774/0 (socket says 172.21.15.42:45774) 2024-09-17T01:48:47.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.714+0000 7fa537e00640 1 -- 172.21.15.42:0/749440957 learned_addr learned my addr 172.21.15.42:0/749440957 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:47.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.714+0000 7fa53de00640 1 --2- 172.21.15.42:0/749440957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa524005350 0x7fa5401f77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:47.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.714+0000 7fa53e800640 1 --2- 172.21.15.42:0/749440957 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa540157b10 0x7fa540157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:47.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.714+0000 7fa537e00640 1 -- 172.21.15.42:0/749440957 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa540157b10 msgr2=0x7fa540157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:47.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.714+0000 7fa537e00640 1 --2- 172.21.15.42:0/749440957 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa540157b10 0x7fa540157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:47.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.714+0000 7fa537e00640 1 -- 172.21.15.42:0/749440957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa524005350 msgr2=0x7fa5401f77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:47.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.714+0000 7fa537e00640 1 --2- 172.21.15.42:0/749440957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa524005350 0x7fa5401f77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:47.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.714+0000 7fa537e00640 1 -- 172.21.15.42:0/749440957 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa54013ea20 con 0x7fa540155fd0 2024-09-17T01:48:47.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.714+0000 7fa53e800640 1 --2- 172.21.15.42:0/749440957 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa540157b10 0x7fa540157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:47.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.714+0000 7fa537e00640 1 --2- 172.21.15.42:0/749440957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa540155fd0 0x7fa54013de40 secure :-1 s=READY pgs=2431 cs=0 l=1 rev1=1 crypto rx=0x7fa528011a80 tx=0x7fa528011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:47.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.715+0000 7fa536000640 1 -- 172.21.15.42:0/749440957 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52800fe40 con 0x7fa540155fd0 2024-09-17T01:48:47.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.715+0000 7fa536000640 1 -- 172.21.15.42:0/749440957 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa528016070 con 0x7fa540155fd0 2024-09-17T01:48:47.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.715+0000 7fa536000640 1 -- 172.21.15.42:0/749440957 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa528012760 con 0x7fa540155fd0 2024-09-17T01:48:47.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.715+0000 7fa545200640 1 -- 172.21.15.42:0/749440957 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa54013ed00 con 0x7fa540155fd0 2024-09-17T01:48:47.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.715+0000 7fa545200640 1 -- 172.21.15.42:0/749440957 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5401f6fc0 con 0x7fa540155fd0 2024-09-17T01:48:47.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.716+0000 7fa545200640 1 -- 172.21.15.42:0/749440957 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa54013e790 con 0x7fa540155fd0 2024-09-17T01:48:47.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.717+0000 7fa536000640 1 -- 172.21.15.42:0/749440957 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa528018030 con 0x7fa540155fd0 2024-09-17T01:48:47.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.719+0000 7fa536000640 1 --2- 172.21.15.42:0/749440957 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa51c078b90 0x7fa51c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:47.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.719+0000 7fa536000640 1 -- 172.21.15.42:0/749440957 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(213..213 src has 1..213) ==== 5709+0+0 (secure 0 0 0) 0x7fa52809b640 con 0x7fa540155fd0 2024-09-17T01:48:47.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.719+0000 7fa53de00640 1 --2- 172.21.15.42:0/749440957 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa51c078b90 0x7fa51c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:47.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.720+0000 7fa53de00640 1 --2- 172.21.15.42:0/749440957 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa51c078b90 0x7fa51c07b0a0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa530001860 tx=0x7fa530006040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:47.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.723+0000 7fa536000640 1 -- 172.21.15.42:0/749440957 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa528063420 con 0x7fa540155fd0 2024-09-17T01:48:47.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.991+0000 7fa545200640 1 -- 172.21.15.42:0/749440957 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa5400cd620 con 0x7fa540155fd0 2024-09-17T01:48:47.989 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.991+0000 7fa536000640 1 -- 172.21.15.42:0/749440957 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1223 (secure 0 0 0) 0x7fa528067e50 con 0x7fa540155fd0 2024-09-17T01:48:47.990 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:48:47.990 INFO:teuthology.orchestra.run.smithi042.stdout:{"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1028,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":213,"num_osds":8,"num_up_osds":8,"osd_up_since":1726536715,"num_in_osds":8,"osd_in_since":1726536704,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":448716800,"bytes_avail":772645396480,"bytes_total":773094113280,"write_bytes_sec":2266,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":168,"btime":"2024-09-17T01:48:44:968283+0000","id":15,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":15,"rank":0,"name":"b","status":"up:active","gid":11193}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":39,"modified":"2024-09-17T01:48:33.264561+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T01:48:47.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.994+0000 7fa545200640 1 -- 172.21.15.42:0/749440957 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa51c078b90 msgr2=0x7fa51c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:47.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.994+0000 7fa545200640 1 --2- 172.21.15.42:0/749440957 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa51c078b90 0x7fa51c07b0a0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa530001860 tx=0x7fa530006040 comp rx=0 tx=0).stop 2024-09-17T01:48:47.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.994+0000 7fa545200640 1 -- 172.21.15.42:0/749440957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa540155fd0 msgr2=0x7fa54013de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:47.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.994+0000 7fa545200640 1 --2- 172.21.15.42:0/749440957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa540155fd0 0x7fa54013de40 secure :-1 s=READY pgs=2431 cs=0 l=1 rev1=1 crypto rx=0x7fa528011a80 tx=0x7fa528011f40 comp rx=0 tx=0).stop 2024-09-17T01:48:47.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.994+0000 7fa545200640 1 -- 172.21.15.42:0/749440957 shutdown_connections 2024-09-17T01:48:47.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.994+0000 7fa545200640 1 --2- 172.21.15.42:0/749440957 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa51c078b90 0x7fa51c07b0a0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:47.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.994+0000 7fa545200640 1 --2- 172.21.15.42:0/749440957 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa540157b10 0x7fa540157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:47.992 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.994+0000 7fa545200640 1 --2- 172.21.15.42:0/749440957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa540155fd0 0x7fa54013de40 unknown :-1 s=CLOSED pgs=2431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:47.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.994+0000 7fa545200640 1 --2- 172.21.15.42:0/749440957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa524005350 0x7fa5401f77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:47.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.994+0000 7fa545200640 1 -- 172.21.15.42:0/749440957 >> 172.21.15.42:0/749440957 conn(0x7fa54006d1b0 msgr2=0x7fa54015d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:47.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.994+0000 7fa545200640 1 -- 172.21.15.42:0/749440957 shutdown_connections 2024-09-17T01:48:47.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:47.994+0000 7fa545200640 1 -- 172.21.15.42:0/749440957 wait complete. 2024-09-17T01:48:48.014 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T01:48:48.015 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:48:48.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.245+0000 7f9e8ea00640 1 -- 172.21.15.42:0/733274744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e88069410 msgr2=0x7f9e8806f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:48.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.245+0000 7f9e8ea00640 1 --2- 172.21.15.42:0/733274744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e88069410 0x7f9e8806f470 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f9e80005fd0 tx=0x7f9e8002a8a0 comp rx=0 tx=0).stop 2024-09-17T01:48:48.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.245+0000 7f9e8ea00640 1 -- 172.21.15.42:0/733274744 shutdown_connections 2024-09-17T01:48:48.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.245+0000 7f9e8ea00640 1 --2- 172.21.15.42:0/733274744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e88069410 0x7f9e8806f470 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:48.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.245+0000 7f9e8ea00640 1 --2- 172.21.15.42:0/733274744 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e88071040 0x7f9e880ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:48.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.245+0000 7f9e8ea00640 1 -- 172.21.15.42:0/733274744 >> 172.21.15.42:0/733274744 conn(0x7f9e880d1580 msgr2=0x7f9e880d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:48.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.245+0000 7f9e8ea00640 1 -- 172.21.15.42:0/733274744 shutdown_connections 2024-09-17T01:48:48.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.246+0000 7f9e8ea00640 1 -- 172.21.15.42:0/733274744 wait complete. 2024-09-17T01:48:48.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.248+0000 7f9e8ea00640 1 Processor -- start 2024-09-17T01:48:48.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.248+0000 7f9e8ea00640 1 -- start start 2024-09-17T01:48:48.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.249+0000 7f9e8ea00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e88071040 0x7f9e880cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:48.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.249+0000 7f9e8ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e8815ca30 0x7f9e8814ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:48.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.249+0000 7f9e8ea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e8814ae80 0x7f9e8814b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:48.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.249+0000 7f9e8ea00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8806fb30 con 0x7f9e8815ca30 2024-09-17T01:48:48.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.249+0000 7f9e8ea00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8806f9b0 con 0x7f9e8814ae80 2024-09-17T01:48:48.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.249+0000 7f9e8ea00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9e8806fcb0 con 0x7f9e88071040 2024-09-17T01:48:48.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.250+0000 7f9e8cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e8815ca30 0x7f9e8814ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:48.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.250+0000 7f9e8cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e8815ca30 0x7f9e8814ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45782/0 (socket says 172.21.15.42:45782) 2024-09-17T01:48:48.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.250+0000 7f9e8cc00640 1 -- 172.21.15.42:0/3648620941 learned_addr learned my addr 172.21.15.42:0/3648620941 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:48.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.250+0000 7f9e8d600640 1 --2- 172.21.15.42:0/3648620941 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e88071040 0x7f9e880cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:48.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.250+0000 7f9e8e000640 1 --2- 172.21.15.42:0/3648620941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e8814ae80 0x7f9e8814b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:48.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.250+0000 7f9e8cc00640 1 -- 172.21.15.42:0/3648620941 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e88071040 msgr2=0x7f9e880cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:48.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.250+0000 7f9e8cc00640 1 --2- 172.21.15.42:0/3648620941 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e88071040 0x7f9e880cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:48.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.250+0000 7f9e8cc00640 1 -- 172.21.15.42:0/3648620941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e8814ae80 msgr2=0x7f9e8814b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:48.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.250+0000 7f9e8cc00640 1 --2- 172.21.15.42:0/3648620941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e8814ae80 0x7f9e8814b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:48.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.250+0000 7f9e8cc00640 1 -- 172.21.15.42:0/3648620941 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8814b7d0 con 0x7f9e8815ca30 2024-09-17T01:48:48.249 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.250+0000 7f9e8cc00640 1 --2- 172.21.15.42:0/3648620941 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e8815ca30 0x7f9e8814ba20 secure :-1 s=READY pgs=2432 cs=0 l=1 rev1=1 crypto rx=0x7f9e7400c3d0 tx=0x7f9e7400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:48.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.251+0000 7f9e85600640 1 -- 172.21.15.42:0/3648620941 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e74011790 con 0x7f9e8815ca30 2024-09-17T01:48:48.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.251+0000 7f9e85600640 1 -- 172.21.15.42:0/3648620941 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e74017070 con 0x7f9e8815ca30 2024-09-17T01:48:48.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.251+0000 7f9e8ea00640 1 -- 172.21.15.42:0/3648620941 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e880abf50 con 0x7f9e8815ca30 2024-09-17T01:48:48.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.251+0000 7f9e85600640 1 -- 172.21.15.42:0/3648620941 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e74011cc0 con 0x7f9e8815ca30 2024-09-17T01:48:48.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.251+0000 7f9e8ea00640 1 -- 172.21.15.42:0/3648620941 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e88148f20 con 0x7f9e8815ca30 2024-09-17T01:48:48.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.252+0000 7f9e8ea00640 1 -- 172.21.15.42:0/3648620941 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e880747d0 con 0x7f9e8815ca30 2024-09-17T01:48:48.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.253+0000 7f9e85600640 1 -- 172.21.15.42:0/3648620941 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9e7401c460 con 0x7f9e8815ca30 2024-09-17T01:48:48.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.254+0000 7f9e85600640 1 --2- 172.21.15.42:0/3648620941 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e68078b90 0x7f9e6807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:48.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.254+0000 7f9e85600640 1 -- 172.21.15.42:0/3648620941 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(213..213 src has 1..213) ==== 5709+0+0 (secure 0 0 0) 0x7f9e7409aa70 con 0x7f9e8815ca30 2024-09-17T01:48:48.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.255+0000 7f9e8d600640 1 --2- 172.21.15.42:0/3648620941 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e68078b90 0x7f9e6807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:48.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.255+0000 7f9e8d600640 1 --2- 172.21.15.42:0/3648620941 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e68078b90 0x7f9e6807b0a0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c0095f0 tx=0x7f9e7c005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:48.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.259+0000 7f9e85600640 1 -- 172.21.15.42:0/3648620941 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9e880747d0 con 0x7f9e8815ca30 2024-09-17T01:48:48.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.450+0000 7f9e8ea00640 1 -- 172.21.15.42:0/3648620941 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9e88070160 con 0x7f9e68078b90 2024-09-17T01:48:48.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.456+0000 7f9e85600640 1 -- 172.21.15.42:0/3648620941 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252484 (secure 0 0 0) 0x7f9e88070160 con 0x7f9e68078b90 2024-09-17T01:48:48.456 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:48:48.457 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:48:48.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.459+0000 7f9e8ea00640 1 -- 172.21.15.42:0/3648620941 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e68078b90 msgr2=0x7f9e6807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:48.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.459+0000 7f9e8ea00640 1 --2- 172.21.15.42:0/3648620941 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e68078b90 0x7f9e6807b0a0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c0095f0 tx=0x7f9e7c005f90 comp rx=0 tx=0).stop 2024-09-17T01:48:48.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.459+0000 7f9e8ea00640 1 -- 172.21.15.42:0/3648620941 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e8815ca30 msgr2=0x7f9e8814ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:48.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.459+0000 7f9e8ea00640 1 --2- 172.21.15.42:0/3648620941 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e8815ca30 0x7f9e8814ba20 secure :-1 s=READY pgs=2432 cs=0 l=1 rev1=1 crypto rx=0x7f9e7400c3d0 tx=0x7f9e7400c890 comp rx=0 tx=0).stop 2024-09-17T01:48:48.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.459+0000 7f9e8ea00640 1 -- 172.21.15.42:0/3648620941 shutdown_connections 2024-09-17T01:48:48.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.459+0000 7f9e8ea00640 1 --2- 172.21.15.42:0/3648620941 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9e68078b90 0x7f9e6807b0a0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:48.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.459+0000 7f9e8ea00640 1 --2- 172.21.15.42:0/3648620941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e8814ae80 0x7f9e8814b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:48.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.459+0000 7f9e8ea00640 1 --2- 172.21.15.42:0/3648620941 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e8815ca30 0x7f9e8814ba20 unknown :-1 s=CLOSED pgs=2432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:48.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.459+0000 7f9e8ea00640 1 --2- 172.21.15.42:0/3648620941 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e88071040 0x7f9e880cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:48.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.460+0000 7f9e8ea00640 1 -- 172.21.15.42:0/3648620941 >> 172.21.15.42:0/3648620941 conn(0x7f9e880d1580 msgr2=0x7f9e880b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:48.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.460+0000 7f9e8ea00640 1 -- 172.21.15.42:0/3648620941 shutdown_connections 2024-09-17T01:48:48.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:48.460+0000 7f9e8ea00640 1 -- 172.21.15.42:0/3648620941 wait complete. 2024-09-17T01:48:48.480 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":713,"stamp":"2024-09-17T01:48:47.268013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":438200,"kb_used_data":22160,"kb_used_omap":12,"kb_used_meta":415859,"kb_avail":754536520,"statfs":{"total":773094113280,"available":772645396480,"internally_reserved":0,"allocated":22691840,"data_stored":10684396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":425840180},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.326492"},"pg_stats":[{"pgid":"31.3f","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450608+0000","last_change":"2024-09-17T01:48:41.988421+0000","last_active":"2024-09-17T01:48:43.450608+0000","last_peered":"2024-09-17T01:48:43.450608+0000","last_clean":"2024-09-17T01:48:43.450608+0000","last_became_active":"2024-09-17T01:48:41.988099+0000","last_became_peered":"2024-09-17T01:48:41.988099+0000","last_unstale":"2024-09-17T01:48:43.450608+0000","last_undegraded":"2024-09-17T01:48:43.450608+0000","last_fullsized":"2024-09-17T01:48:43.450608+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:10.721737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.3e","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.967821+0000","last_change":"2024-09-17T01:48:41.965330+0000","last_active":"2024-09-17T01:48:41.967821+0000","last_peered":"2024-09-17T01:48:41.967821+0000","last_clean":"2024-09-17T01:48:41.967821+0000","last_became_active":"2024-09-17T01:48:41.964988+0000","last_became_peered":"2024-09-17T01:48:41.964988+0000","last_unstale":"2024-09-17T01:48:41.967821+0000","last_undegraded":"2024-09-17T01:48:41.967821+0000","last_fullsized":"2024-09-17T01:48:41.967821+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:50:47.522773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.3d","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450523+0000","last_change":"2024-09-17T01:48:41.992476+0000","last_active":"2024-09-17T01:48:43.450523+0000","last_peered":"2024-09-17T01:48:43.450523+0000","last_clean":"2024-09-17T01:48:43.450523+0000","last_became_active":"2024-09-17T01:48:41.992130+0000","last_became_peered":"2024-09-17T01:48:41.992130+0000","last_unstale":"2024-09-17T01:48:43.450523+0000","last_undegraded":"2024-09-17T01:48:43.450523+0000","last_fullsized":"2024-09-17T01:48:43.450523+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:15:15.143150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.3c","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966650+0000","last_change":"2024-09-17T01:48:41.969707+0000","last_active":"2024-09-17T01:48:42.966650+0000","last_peered":"2024-09-17T01:48:42.966650+0000","last_clean":"2024-09-17T01:48:42.966650+0000","last_became_active":"2024-09-17T01:48:41.967489+0000","last_became_peered":"2024-09-17T01:48:41.967489+0000","last_unstale":"2024-09-17T01:48:42.966650+0000","last_undegraded":"2024-09-17T01:48:42.966650+0000","last_fullsized":"2024-09-17T01:48:42.966650+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:22.342311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.3b","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964633+0000","last_change":"2024-09-17T01:48:41.956894+0000","last_active":"2024-09-17T01:48:42.964633+0000","last_peered":"2024-09-17T01:48:42.964633+0000","last_clean":"2024-09-17T01:48:42.964633+0000","last_became_active":"2024-09-17T01:48:41.956533+0000","last_became_peered":"2024-09-17T01:48:41.956533+0000","last_unstale":"2024-09-17T01:48:42.964633+0000","last_undegraded":"2024-09-17T01:48:42.964633+0000","last_fullsized":"2024-09-17T01:48:42.964633+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:43.230899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.3a","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450111+0000","last_change":"2024-09-17T01:48:41.989695+0000","last_active":"2024-09-17T01:48:43.450111+0000","last_peered":"2024-09-17T01:48:43.450111+0000","last_clean":"2024-09-17T01:48:43.450111+0000","last_became_active":"2024-09-17T01:48:41.988985+0000","last_became_peered":"2024-09-17T01:48:41.988985+0000","last_unstale":"2024-09-17T01:48:43.450111+0000","last_undegraded":"2024-09-17T01:48:43.450111+0000","last_fullsized":"2024-09-17T01:48:43.450111+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:56:47.447939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.39","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393200+0000","last_change":"2024-09-17T01:48:41.963394+0000","last_active":"2024-09-17T01:48:43.393200+0000","last_peered":"2024-09-17T01:48:43.393200+0000","last_clean":"2024-09-17T01:48:43.393200+0000","last_became_active":"2024-09-17T01:48:41.963064+0000","last_became_peered":"2024-09-17T01:48:41.963064+0000","last_unstale":"2024-09-17T01:48:43.393200+0000","last_undegraded":"2024-09-17T01:48:43.393200+0000","last_fullsized":"2024-09-17T01:48:43.393200+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:50.099904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.38","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964389+0000","last_change":"2024-09-17T01:48:41.963873+0000","last_active":"2024-09-17T01:48:42.964389+0000","last_peered":"2024-09-17T01:48:42.964389+0000","last_clean":"2024-09-17T01:48:42.964389+0000","last_became_active":"2024-09-17T01:48:41.960583+0000","last_became_peered":"2024-09-17T01:48:41.960583+0000","last_unstale":"2024-09-17T01:48:42.964389+0000","last_undegraded":"2024-09-17T01:48:42.964389+0000","last_fullsized":"2024-09-17T01:48:42.964389+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:31.451012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.37","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959932+0000","last_change":"2024-09-17T01:48:41.987057+0000","last_active":"2024-09-17T01:48:43.959932+0000","last_peered":"2024-09-17T01:48:43.959932+0000","last_clean":"2024-09-17T01:48:43.959932+0000","last_became_active":"2024-09-17T01:48:41.986705+0000","last_became_peered":"2024-09-17T01:48:41.986705+0000","last_unstale":"2024-09-17T01:48:43.959932+0000","last_undegraded":"2024-09-17T01:48:43.959932+0000","last_fullsized":"2024-09-17T01:48:43.959932+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:08.089510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.36","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393240+0000","last_change":"2024-09-17T01:48:41.963101+0000","last_active":"2024-09-17T01:48:43.393240+0000","last_peered":"2024-09-17T01:48:43.393240+0000","last_clean":"2024-09-17T01:48:43.393240+0000","last_became_active":"2024-09-17T01:48:41.961668+0000","last_became_peered":"2024-09-17T01:48:41.961668+0000","last_unstale":"2024-09-17T01:48:43.393240+0000","last_undegraded":"2024-09-17T01:48:43.393240+0000","last_fullsized":"2024-09-17T01:48:43.393240+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:30.142847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.35","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967097+0000","last_change":"2024-09-17T01:48:41.992165+0000","last_active":"2024-09-17T01:48:42.967097+0000","last_peered":"2024-09-17T01:48:42.967097+0000","last_clean":"2024-09-17T01:48:42.967097+0000","last_became_active":"2024-09-17T01:48:41.991821+0000","last_became_peered":"2024-09-17T01:48:41.991821+0000","last_unstale":"2024-09-17T01:48:42.967097+0000","last_undegraded":"2024-09-17T01:48:42.967097+0000","last_fullsized":"2024-09-17T01:48:42.967097+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:26.331280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.34","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393530+0000","last_change":"2024-09-17T01:48:41.973919+0000","last_active":"2024-09-17T01:48:43.393530+0000","last_peered":"2024-09-17T01:48:43.393530+0000","last_clean":"2024-09-17T01:48:43.393530+0000","last_became_active":"2024-09-17T01:48:41.973559+0000","last_became_peered":"2024-09-17T01:48:41.973559+0000","last_unstale":"2024-09-17T01:48:43.393530+0000","last_undegraded":"2024-09-17T01:48:43.393530+0000","last_fullsized":"2024-09-17T01:48:43.393530+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:45.600564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.33","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959533+0000","last_change":"2024-09-17T01:48:41.980332+0000","last_active":"2024-09-17T01:48:43.959533+0000","last_peered":"2024-09-17T01:48:43.959533+0000","last_clean":"2024-09-17T01:48:43.959533+0000","last_became_active":"2024-09-17T01:48:41.979993+0000","last_became_peered":"2024-09-17T01:48:41.979993+0000","last_unstale":"2024-09-17T01:48:43.959533+0000","last_undegraded":"2024-09-17T01:48:43.959533+0000","last_fullsized":"2024-09-17T01:48:43.959533+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:28.765107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.32","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966149+0000","last_change":"2024-09-17T01:48:41.977401+0000","last_active":"2024-09-17T01:48:42.966149+0000","last_peered":"2024-09-17T01:48:42.966149+0000","last_clean":"2024-09-17T01:48:42.966149+0000","last_became_active":"2024-09-17T01:48:41.974556+0000","last_became_peered":"2024-09-17T01:48:41.974556+0000","last_unstale":"2024-09-17T01:48:42.966149+0000","last_undegraded":"2024-09-17T01:48:42.966149+0000","last_fullsized":"2024-09-17T01:48:42.966149+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:55.867060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.31","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965569+0000","last_change":"2024-09-17T01:48:41.975123+0000","last_active":"2024-09-17T01:48:42.965569+0000","last_peered":"2024-09-17T01:48:42.965569+0000","last_clean":"2024-09-17T01:48:42.965569+0000","last_became_active":"2024-09-17T01:48:41.974673+0000","last_became_peered":"2024-09-17T01:48:41.974673+0000","last_unstale":"2024-09-17T01:48:42.965569+0000","last_undegraded":"2024-09-17T01:48:42.965569+0000","last_fullsized":"2024-09-17T01:48:42.965569+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:17:36.339225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.30","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.971370+0000","last_change":"2024-09-17T01:48:41.965693+0000","last_active":"2024-09-17T01:48:41.971370+0000","last_peered":"2024-09-17T01:48:41.971370+0000","last_clean":"2024-09-17T01:48:41.971370+0000","last_became_active":"2024-09-17T01:48:41.962372+0000","last_became_peered":"2024-09-17T01:48:41.962372+0000","last_unstale":"2024-09-17T01:48:41.971370+0000","last_undegraded":"2024-09-17T01:48:41.971370+0000","last_fullsized":"2024-09-17T01:48:41.971370+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:44.587490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.2f","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393403+0000","last_change":"2024-09-17T01:48:41.976694+0000","last_active":"2024-09-17T01:48:43.393403+0000","last_peered":"2024-09-17T01:48:43.393403+0000","last_clean":"2024-09-17T01:48:43.393403+0000","last_became_active":"2024-09-17T01:48:41.974656+0000","last_became_peered":"2024-09-17T01:48:41.974656+0000","last_unstale":"2024-09-17T01:48:43.393403+0000","last_undegraded":"2024-09-17T01:48:43.393403+0000","last_fullsized":"2024-09-17T01:48:43.393403+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:02.926819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2e","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462080+0000","last_change":"2024-09-17T01:48:41.980564+0000","last_active":"2024-09-17T01:48:44.462080+0000","last_peered":"2024-09-17T01:48:44.462080+0000","last_clean":"2024-09-17T01:48:44.462080+0000","last_became_active":"2024-09-17T01:48:41.980245+0000","last_became_peered":"2024-09-17T01:48:41.980245+0000","last_unstale":"2024-09-17T01:48:44.462080+0000","last_undegraded":"2024-09-17T01:48:44.462080+0000","last_fullsized":"2024-09-17T01:48:44.462080+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:43.668061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.2d","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959709+0000","last_change":"2024-09-17T01:48:41.986560+0000","last_active":"2024-09-17T01:48:43.959709+0000","last_peered":"2024-09-17T01:48:43.959709+0000","last_clean":"2024-09-17T01:48:43.959709+0000","last_became_active":"2024-09-17T01:48:41.986238+0000","last_became_peered":"2024-09-17T01:48:41.986238+0000","last_unstale":"2024-09-17T01:48:43.959709+0000","last_undegraded":"2024-09-17T01:48:43.959709+0000","last_fullsized":"2024-09-17T01:48:43.959709+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:41:07.890922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.2c","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.976096+0000","last_change":"2024-09-17T01:48:41.969173+0000","last_active":"2024-09-17T01:48:41.976096+0000","last_peered":"2024-09-17T01:48:41.976096+0000","last_clean":"2024-09-17T01:48:41.976096+0000","last_became_active":"2024-09-17T01:48:41.968166+0000","last_became_peered":"2024-09-17T01:48:41.968166+0000","last_unstale":"2024-09-17T01:48:41.976096+0000","last_undegraded":"2024-09-17T01:48:41.976096+0000","last_fullsized":"2024-09-17T01:48:41.976096+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:08.105937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.2b","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964761+0000","last_change":"2024-09-17T01:48:41.954636+0000","last_active":"2024-09-17T01:48:42.964761+0000","last_peered":"2024-09-17T01:48:42.964761+0000","last_clean":"2024-09-17T01:48:42.964761+0000","last_became_active":"2024-09-17T01:48:41.953894+0000","last_became_peered":"2024-09-17T01:48:41.953894+0000","last_unstale":"2024-09-17T01:48:42.964761+0000","last_undegraded":"2024-09-17T01:48:42.964761+0000","last_fullsized":"2024-09-17T01:48:42.964761+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:36.329548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.2a","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959388+0000","last_change":"2024-09-17T01:48:41.966183+0000","last_active":"2024-09-17T01:48:43.959388+0000","last_peered":"2024-09-17T01:48:43.959388+0000","last_clean":"2024-09-17T01:48:43.959388+0000","last_became_active":"2024-09-17T01:48:41.964659+0000","last_became_peered":"2024-09-17T01:48:41.964659+0000","last_unstale":"2024-09-17T01:48:43.959388+0000","last_undegraded":"2024-09-17T01:48:43.959388+0000","last_fullsized":"2024-09-17T01:48:43.959388+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:43.230899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.29","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959378+0000","last_change":"2024-09-17T01:48:41.967881+0000","last_active":"2024-09-17T01:48:43.959378+0000","last_peered":"2024-09-17T01:48:43.959378+0000","last_clean":"2024-09-17T01:48:43.959378+0000","last_became_active":"2024-09-17T01:48:41.967418+0000","last_became_peered":"2024-09-17T01:48:41.967418+0000","last_unstale":"2024-09-17T01:48:43.959378+0000","last_undegraded":"2024-09-17T01:48:43.959378+0000","last_fullsized":"2024-09-17T01:48:43.959378+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:16.304885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.28","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965934+0000","last_change":"2024-09-17T01:48:41.971698+0000","last_active":"2024-09-17T01:48:42.965934+0000","last_peered":"2024-09-17T01:48:42.965934+0000","last_clean":"2024-09-17T01:48:42.965934+0000","last_became_active":"2024-09-17T01:48:41.970716+0000","last_became_peered":"2024-09-17T01:48:41.970716+0000","last_unstale":"2024-09-17T01:48:42.965934+0000","last_undegraded":"2024-09-17T01:48:42.965934+0000","last_fullsized":"2024-09-17T01:48:42.965934+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:55.100537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.27","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967261+0000","last_change":"2024-09-17T01:48:41.961465+0000","last_active":"2024-09-17T01:48:42.967261+0000","last_peered":"2024-09-17T01:48:42.967261+0000","last_clean":"2024-09-17T01:48:42.967261+0000","last_became_active":"2024-09-17T01:48:41.961094+0000","last_became_peered":"2024-09-17T01:48:41.961094+0000","last_unstale":"2024-09-17T01:48:42.967261+0000","last_undegraded":"2024-09-17T01:48:42.967261+0000","last_fullsized":"2024-09-17T01:48:42.967261+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:41.337984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.26","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965081+0000","last_change":"2024-09-17T01:48:41.976001+0000","last_active":"2024-09-17T01:48:42.965081+0000","last_peered":"2024-09-17T01:48:42.965081+0000","last_clean":"2024-09-17T01:48:42.965081+0000","last_became_active":"2024-09-17T01:48:41.975224+0000","last_became_peered":"2024-09-17T01:48:41.975224+0000","last_unstale":"2024-09-17T01:48:42.965081+0000","last_undegraded":"2024-09-17T01:48:42.965081+0000","last_fullsized":"2024-09-17T01:48:42.965081+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:54.362773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.25","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.964284+0000","last_change":"2024-09-17T01:48:41.962212+0000","last_active":"2024-09-17T01:48:41.964284+0000","last_peered":"2024-09-17T01:48:41.964284+0000","last_clean":"2024-09-17T01:48:41.964284+0000","last_became_active":"2024-09-17T01:48:41.957215+0000","last_became_peered":"2024-09-17T01:48:41.957215+0000","last_unstale":"2024-09-17T01:48:41.964284+0000","last_undegraded":"2024-09-17T01:48:41.964284+0000","last_fullsized":"2024-09-17T01:48:41.964284+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:36.289610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.24","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966653+0000","last_change":"2024-09-17T01:48:41.960227+0000","last_active":"2024-09-17T01:48:42.966653+0000","last_peered":"2024-09-17T01:48:42.966653+0000","last_clean":"2024-09-17T01:48:42.966653+0000","last_became_active":"2024-09-17T01:48:41.959863+0000","last_became_peered":"2024-09-17T01:48:41.959863+0000","last_unstale":"2024-09-17T01:48:42.966653+0000","last_undegraded":"2024-09-17T01:48:42.966653+0000","last_fullsized":"2024-09-17T01:48:42.966653+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:47.101431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.23","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966478+0000","last_change":"2024-09-17T01:48:41.983228+0000","last_active":"2024-09-17T01:48:42.966478+0000","last_peered":"2024-09-17T01:48:42.966478+0000","last_clean":"2024-09-17T01:48:42.966478+0000","last_became_active":"2024-09-17T01:48:41.982832+0000","last_became_peered":"2024-09-17T01:48:41.982832+0000","last_unstale":"2024-09-17T01:48:42.966478+0000","last_undegraded":"2024-09-17T01:48:42.966478+0000","last_fullsized":"2024-09-17T01:48:42.966478+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:53.868153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.22","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959412+0000","last_change":"2024-09-17T01:48:41.963496+0000","last_active":"2024-09-17T01:48:43.959412+0000","last_peered":"2024-09-17T01:48:43.959412+0000","last_clean":"2024-09-17T01:48:43.959412+0000","last_became_active":"2024-09-17T01:48:41.958645+0000","last_became_peered":"2024-09-17T01:48:41.958645+0000","last_unstale":"2024-09-17T01:48:43.959412+0000","last_undegraded":"2024-09-17T01:48:43.959412+0000","last_fullsized":"2024-09-17T01:48:43.959412+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:40:50.683423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.21","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965991+0000","last_change":"2024-09-17T01:48:41.973589+0000","last_active":"2024-09-17T01:48:42.965991+0000","last_peered":"2024-09-17T01:48:42.965991+0000","last_clean":"2024-09-17T01:48:42.965991+0000","last_became_active":"2024-09-17T01:48:41.973257+0000","last_became_peered":"2024-09-17T01:48:41.973257+0000","last_unstale":"2024-09-17T01:48:42.965991+0000","last_undegraded":"2024-09-17T01:48:42.965991+0000","last_fullsized":"2024-09-17T01:48:42.965991+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:00.927500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.20","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.971402+0000","last_change":"2024-09-17T01:48:41.966916+0000","last_active":"2024-09-17T01:48:41.971402+0000","last_peered":"2024-09-17T01:48:41.971402+0000","last_clean":"2024-09-17T01:48:41.971402+0000","last_became_active":"2024-09-17T01:48:41.962328+0000","last_became_peered":"2024-09-17T01:48:41.962328+0000","last_unstale":"2024-09-17T01:48:41.971402+0000","last_undegraded":"2024-09-17T01:48:41.971402+0000","last_fullsized":"2024-09-17T01:48:41.971402+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:00:44.537741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1f","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462071+0000","last_change":"2024-09-17T01:48:41.987044+0000","last_active":"2024-09-17T01:48:44.462071+0000","last_peered":"2024-09-17T01:48:44.462071+0000","last_clean":"2024-09-17T01:48:44.462071+0000","last_became_active":"2024-09-17T01:48:41.986685+0000","last_became_peered":"2024-09-17T01:48:41.986685+0000","last_unstale":"2024-09-17T01:48:44.462071+0000","last_undegraded":"2024-09-17T01:48:44.462071+0000","last_fullsized":"2024-09-17T01:48:44.462071+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:15:39.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1e","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966212+0000","last_change":"2024-09-17T01:48:40.958584+0000","last_active":"2024-09-17T01:48:42.966212+0000","last_peered":"2024-09-17T01:48:42.966212+0000","last_clean":"2024-09-17T01:48:42.966212+0000","last_became_active":"2024-09-17T01:48:40.958270+0000","last_became_peered":"2024-09-17T01:48:40.958270+0000","last_unstale":"2024-09-17T01:48:42.966212+0000","last_undegraded":"2024-09-17T01:48:42.966212+0000","last_fullsized":"2024-09-17T01:48:42.966212+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:43.311074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1c","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967106+0000","last_change":"2024-09-17T01:48:41.991844+0000","last_active":"2024-09-17T01:48:42.967106+0000","last_peered":"2024-09-17T01:48:42.967106+0000","last_clean":"2024-09-17T01:48:42.967106+0000","last_became_active":"2024-09-17T01:48:41.991218+0000","last_became_peered":"2024-09-17T01:48:41.991218+0000","last_unstale":"2024-09-17T01:48:42.967106+0000","last_undegraded":"2024-09-17T01:48:42.967106+0000","last_fullsized":"2024-09-17T01:48:42.967106+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:36.622860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1d","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450551+0000","last_change":"2024-09-17T01:48:40.970298+0000","last_active":"2024-09-17T01:48:43.450551+0000","last_peered":"2024-09-17T01:48:43.450551+0000","last_clean":"2024-09-17T01:48:43.450551+0000","last_became_active":"2024-09-17T01:48:40.969934+0000","last_became_peered":"2024-09-17T01:48:40.969934+0000","last_unstale":"2024-09-17T01:48:43.450551+0000","last_undegraded":"2024-09-17T01:48:43.450551+0000","last_fullsized":"2024-09-17T01:48:43.450551+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:06.666716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959878+0000","last_change":"2024-09-17T01:48:41.986546+0000","last_active":"2024-09-17T01:48:43.959878+0000","last_peered":"2024-09-17T01:48:43.959878+0000","last_clean":"2024-09-17T01:48:43.959878+0000","last_became_active":"2024-09-17T01:48:41.986211+0000","last_became_peered":"2024-09-17T01:48:41.986211+0000","last_unstale":"2024-09-17T01:48:43.959878+0000","last_undegraded":"2024-09-17T01:48:43.959878+0000","last_fullsized":"2024-09-17T01:48:43.959878+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:39.567639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1c","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461822+0000","last_change":"2024-09-17T01:48:40.963737+0000","last_active":"2024-09-17T01:48:44.461822+0000","last_peered":"2024-09-17T01:48:44.461822+0000","last_clean":"2024-09-17T01:48:44.461822+0000","last_became_active":"2024-09-17T01:48:40.963409+0000","last_became_peered":"2024-09-17T01:48:40.963409+0000","last_unstale":"2024-09-17T01:48:44.461822+0000","last_undegraded":"2024-09-17T01:48:44.461822+0000","last_fullsized":"2024-09-17T01:48:44.461822+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:07.992373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.1a","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461547+0000","last_change":"2024-09-17T01:48:41.967809+0000","last_active":"2024-09-17T01:48:44.461547+0000","last_peered":"2024-09-17T01:48:44.461547+0000","last_clean":"2024-09-17T01:48:44.461547+0000","last_became_active":"2024-09-17T01:48:41.967471+0000","last_became_peered":"2024-09-17T01:48:41.967471+0000","last_unstale":"2024-09-17T01:48:44.461547+0000","last_undegraded":"2024-09-17T01:48:44.461547+0000","last_fullsized":"2024-09-17T01:48:44.461547+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:15.398716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1b","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462083+0000","last_change":"2024-09-17T01:48:40.965537+0000","last_active":"2024-09-17T01:48:44.462083+0000","last_peered":"2024-09-17T01:48:44.462083+0000","last_clean":"2024-09-17T01:48:44.462083+0000","last_became_active":"2024-09-17T01:48:40.965186+0000","last_became_peered":"2024-09-17T01:48:40.965186+0000","last_unstale":"2024-09-17T01:48:44.462083+0000","last_undegraded":"2024-09-17T01:48:44.462083+0000","last_fullsized":"2024-09-17T01:48:44.462083+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:02.660884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.1b","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966082+0000","last_change":"2024-09-17T01:48:41.973058+0000","last_active":"2024-09-17T01:48:42.966082+0000","last_peered":"2024-09-17T01:48:42.966082+0000","last_clean":"2024-09-17T01:48:42.966082+0000","last_became_active":"2024-09-17T01:48:41.972705+0000","last_became_peered":"2024-09-17T01:48:41.972705+0000","last_unstale":"2024-09-17T01:48:42.966082+0000","last_undegraded":"2024-09-17T01:48:42.966082+0000","last_fullsized":"2024-09-17T01:48:42.966082+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:00.679343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1a","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461608+0000","last_change":"2024-09-17T01:48:40.963571+0000","last_active":"2024-09-17T01:48:44.461608+0000","last_peered":"2024-09-17T01:48:44.461608+0000","last_clean":"2024-09-17T01:48:44.461608+0000","last_became_active":"2024-09-17T01:48:40.963225+0000","last_became_peered":"2024-09-17T01:48:40.963225+0000","last_unstale":"2024-09-17T01:48:44.461608+0000","last_undegraded":"2024-09-17T01:48:44.461608+0000","last_fullsized":"2024-09-17T01:48:44.461608+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:17.264437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966022+0000","last_change":"2024-09-17T01:48:41.961255+0000","last_active":"2024-09-17T01:48:42.966022+0000","last_peered":"2024-09-17T01:48:42.966022+0000","last_clean":"2024-09-17T01:48:42.966022+0000","last_became_active":"2024-09-17T01:48:41.960894+0000","last_became_peered":"2024-09-17T01:48:41.960894+0000","last_unstale":"2024-09-17T01:48:42.966022+0000","last_undegraded":"2024-09-17T01:48:42.966022+0000","last_fullsized":"2024-09-17T01:48:42.966022+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:02:46.006988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965064+0000","last_change":"2024-09-17T01:48:40.963230+0000","last_active":"2024-09-17T01:48:42.965064+0000","last_peered":"2024-09-17T01:48:42.965064+0000","last_clean":"2024-09-17T01:48:42.965064+0000","last_became_active":"2024-09-17T01:48:40.962869+0000","last_became_peered":"2024-09-17T01:48:40.962869+0000","last_unstale":"2024-09-17T01:48:42.965064+0000","last_undegraded":"2024-09-17T01:48:42.965064+0000","last_fullsized":"2024-09-17T01:48:42.965064+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:31.161425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965805+0000","last_change":"2024-09-17T01:48:41.961510+0000","last_active":"2024-09-17T01:48:42.965805+0000","last_peered":"2024-09-17T01:48:42.965805+0000","last_clean":"2024-09-17T01:48:42.965805+0000","last_became_active":"2024-09-17T01:48:41.961149+0000","last_became_peered":"2024-09-17T01:48:41.961149+0000","last_unstale":"2024-09-17T01:48:42.965805+0000","last_undegraded":"2024-09-17T01:48:42.965805+0000","last_fullsized":"2024-09-17T01:48:42.965805+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:42.543461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.460990+0000","last_change":"2024-09-17T01:48:40.960363+0000","last_active":"2024-09-17T01:48:44.460990+0000","last_peered":"2024-09-17T01:48:44.460990+0000","last_clean":"2024-09-17T01:48:44.460990+0000","last_became_active":"2024-09-17T01:48:40.960030+0000","last_became_peered":"2024-09-17T01:48:40.960030+0000","last_unstale":"2024-09-17T01:48:44.460990+0000","last_undegraded":"2024-09-17T01:48:44.460990+0000","last_fullsized":"2024-09-17T01:48:44.460990+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:39.323864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967273+0000","last_change":"2024-09-17T01:48:41.960180+0000","last_active":"2024-09-17T01:48:42.967273+0000","last_peered":"2024-09-17T01:48:42.967273+0000","last_clean":"2024-09-17T01:48:42.967273+0000","last_became_active":"2024-09-17T01:48:41.959822+0000","last_became_peered":"2024-09-17T01:48:41.959822+0000","last_unstale":"2024-09-17T01:48:42.967273+0000","last_undegraded":"2024-09-17T01:48:42.967273+0000","last_fullsized":"2024-09-17T01:48:42.967273+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:15.702177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966259+0000","last_change":"2024-09-17T01:48:40.959777+0000","last_active":"2024-09-17T01:48:42.966259+0000","last_peered":"2024-09-17T01:48:42.966259+0000","last_clean":"2024-09-17T01:48:42.966259+0000","last_became_active":"2024-09-17T01:48:40.959450+0000","last_became_peered":"2024-09-17T01:48:40.959450+0000","last_unstale":"2024-09-17T01:48:42.966259+0000","last_undegraded":"2024-09-17T01:48:42.966259+0000","last_fullsized":"2024-09-17T01:48:42.966259+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:07.992373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462212+0000","last_change":"2024-09-17T01:48:41.966187+0000","last_active":"2024-09-17T01:48:44.462212+0000","last_peered":"2024-09-17T01:48:44.462212+0000","last_clean":"2024-09-17T01:48:44.462212+0000","last_became_active":"2024-09-17T01:48:41.965878+0000","last_became_peered":"2024-09-17T01:48:41.965878+0000","last_unstale":"2024-09-17T01:48:44.462212+0000","last_undegraded":"2024-09-17T01:48:44.462212+0000","last_fullsized":"2024-09-17T01:48:44.462212+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:24.225979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967188+0000","last_change":"2024-09-17T01:48:40.960473+0000","last_active":"2024-09-17T01:48:42.967188+0000","last_peered":"2024-09-17T01:48:42.967188+0000","last_clean":"2024-09-17T01:48:42.967188+0000","last_became_active":"2024-09-17T01:48:40.960115+0000","last_became_peered":"2024-09-17T01:48:40.960115+0000","last_unstale":"2024-09-17T01:48:42.967188+0000","last_undegraded":"2024-09-17T01:48:42.967188+0000","last_fullsized":"2024-09-17T01:48:42.967188+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:06:29.569198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.14","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.992000+0000","last_change":"2024-09-17T01:48:41.990381+0000","last_active":"2024-09-17T01:48:41.992000+0000","last_peered":"2024-09-17T01:48:41.992000+0000","last_clean":"2024-09-17T01:48:41.992000+0000","last_became_active":"2024-09-17T01:48:41.989915+0000","last_became_peered":"2024-09-17T01:48:41.989915+0000","last_unstale":"2024-09-17T01:48:41.992000+0000","last_undegraded":"2024-09-17T01:48:41.992000+0000","last_fullsized":"2024-09-17T01:48:41.992000+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:36.937033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.15","version":"212'3","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.986091+0000","last_change":"2024-09-17T01:48:40.960038+0000","last_active":"2024-09-17T01:48:41.986091+0000","last_peered":"2024-09-17T01:48:41.986091+0000","last_clean":"2024-09-17T01:48:41.986091+0000","last_became_active":"2024-09-17T01:48:40.959680+0000","last_became_peered":"2024-09-17T01:48:40.959680+0000","last_unstale":"2024-09-17T01:48:41.986091+0000","last_undegraded":"2024-09-17T01:48:41.986091+0000","last_fullsized":"2024-09-17T01:48:41.986091+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:11.499994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.15","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964632+0000","last_change":"2024-09-17T01:48:41.958372+0000","last_active":"2024-09-17T01:48:42.964632+0000","last_peered":"2024-09-17T01:48:42.964632+0000","last_clean":"2024-09-17T01:48:42.964632+0000","last_became_active":"2024-09-17T01:48:41.958067+0000","last_became_peered":"2024-09-17T01:48:41.958067+0000","last_unstale":"2024-09-17T01:48:42.964632+0000","last_undegraded":"2024-09-17T01:48:42.964632+0000","last_fullsized":"2024-09-17T01:48:42.964632+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:02.967349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.14","version":"212'6","reported_seq":21,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450276+0000","last_change":"2024-09-17T01:48:40.969037+0000","last_active":"2024-09-17T01:48:43.450276+0000","last_peered":"2024-09-17T01:48:43.450276+0000","last_clean":"2024-09-17T01:48:43.450276+0000","last_became_active":"2024-09-17T01:48:40.968663+0000","last_became_peered":"2024-09-17T01:48:40.968663+0000","last_unstale":"2024-09-17T01:48:43.450276+0000","last_undegraded":"2024-09-17T01:48:43.450276+0000","last_fullsized":"2024-09-17T01:48:43.450276+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:36.157770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965788+0000","last_change":"2024-09-17T01:48:41.974194+0000","last_active":"2024-09-17T01:48:42.965788+0000","last_peered":"2024-09-17T01:48:42.965788+0000","last_clean":"2024-09-17T01:48:42.965788+0000","last_became_active":"2024-09-17T01:48:41.972690+0000","last_became_peered":"2024-09-17T01:48:41.972690+0000","last_unstale":"2024-09-17T01:48:42.965788+0000","last_undegraded":"2024-09-17T01:48:42.965788+0000","last_fullsized":"2024-09-17T01:48:42.965788+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:53.619025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.13","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450234+0000","last_change":"2024-09-17T01:48:40.964396+0000","last_active":"2024-09-17T01:48:43.450234+0000","last_peered":"2024-09-17T01:48:43.450234+0000","last_clean":"2024-09-17T01:48:43.450234+0000","last_became_active":"2024-09-17T01:48:40.964058+0000","last_became_peered":"2024-09-17T01:48:40.964058+0000","last_unstale":"2024-09-17T01:48:43.450234+0000","last_undegraded":"2024-09-17T01:48:43.450234+0000","last_fullsized":"2024-09-17T01:48:43.450234+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:43.677360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.13","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959516+0000","last_change":"2024-09-17T01:48:41.962451+0000","last_active":"2024-09-17T01:48:43.959516+0000","last_peered":"2024-09-17T01:48:43.959516+0000","last_clean":"2024-09-17T01:48:43.959516+0000","last_became_active":"2024-09-17T01:48:41.962113+0000","last_became_peered":"2024-09-17T01:48:41.962113+0000","last_unstale":"2024-09-17T01:48:43.959516+0000","last_undegraded":"2024-09-17T01:48:43.959516+0000","last_fullsized":"2024-09-17T01:48:43.959516+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:30.290603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966052+0000","last_change":"2024-09-17T01:48:40.958069+0000","last_active":"2024-09-17T01:48:42.966052+0000","last_peered":"2024-09-17T01:48:42.966052+0000","last_clean":"2024-09-17T01:48:42.966052+0000","last_became_active":"2024-09-17T01:48:40.956114+0000","last_became_peered":"2024-09-17T01:48:40.956114+0000","last_unstale":"2024-09-17T01:48:42.966052+0000","last_undegraded":"2024-09-17T01:48:42.966052+0000","last_fullsized":"2024-09-17T01:48:42.966052+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:25.002380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.10","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461069+0000","last_change":"2024-09-17T01:48:41.975846+0000","last_active":"2024-09-17T01:48:44.461069+0000","last_peered":"2024-09-17T01:48:44.461069+0000","last_clean":"2024-09-17T01:48:44.461069+0000","last_became_active":"2024-09-17T01:48:41.975443+0000","last_became_peered":"2024-09-17T01:48:41.975443+0000","last_unstale":"2024-09-17T01:48:44.461069+0000","last_undegraded":"2024-09-17T01:48:44.461069+0000","last_fullsized":"2024-09-17T01:48:44.461069+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:52:23.341819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965173+0000","last_change":"2024-09-17T01:48:40.962362+0000","last_active":"2024-09-17T01:48:42.965173+0000","last_peered":"2024-09-17T01:48:42.965173+0000","last_clean":"2024-09-17T01:48:42.965173+0000","last_became_active":"2024-09-17T01:48:40.961975+0000","last_became_peered":"2024-09-17T01:48:40.961975+0000","last_unstale":"2024-09-17T01:48:42.965173+0000","last_undegraded":"2024-09-17T01:48:42.965173+0000","last_fullsized":"2024-09-17T01:48:42.965173+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:17.865320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965577+0000","last_change":"2024-09-17T01:48:41.975201+0000","last_active":"2024-09-17T01:48:42.965577+0000","last_peered":"2024-09-17T01:48:42.965577+0000","last_clean":"2024-09-17T01:48:42.965577+0000","last_became_active":"2024-09-17T01:48:41.974581+0000","last_became_peered":"2024-09-17T01:48:41.974581+0000","last_unstale":"2024-09-17T01:48:42.965577+0000","last_undegraded":"2024-09-17T01:48:42.965577+0000","last_fullsized":"2024-09-17T01:48:42.965577+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:20.028457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.10","version":"212'8","reported_seq":21,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.988351+0000","last_change":"2024-09-17T01:48:40.962920+0000","last_active":"2024-09-17T01:48:41.988351+0000","last_peered":"2024-09-17T01:48:41.988351+0000","last_clean":"2024-09-17T01:48:41.988351+0000","last_became_active":"2024-09-17T01:48:40.962230+0000","last_became_peered":"2024-09-17T01:48:40.962230+0000","last_unstale":"2024-09-17T01:48:41.988351+0000","last_undegraded":"2024-09-17T01:48:41.988351+0000","last_fullsized":"2024-09-17T01:48:41.988351+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:43.167939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.e","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462192+0000","last_change":"2024-09-17T01:48:41.967242+0000","last_active":"2024-09-17T01:48:44.462192+0000","last_peered":"2024-09-17T01:48:44.462192+0000","last_clean":"2024-09-17T01:48:44.462192+0000","last_became_active":"2024-09-17T01:48:41.966892+0000","last_became_peered":"2024-09-17T01:48:41.966892+0000","last_unstale":"2024-09-17T01:48:44.462192+0000","last_undegraded":"2024-09-17T01:48:44.462192+0000","last_fullsized":"2024-09-17T01:48:44.462192+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:29.649430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.f","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966375+0000","last_change":"2024-09-17T01:48:40.958540+0000","last_active":"2024-09-17T01:48:42.966375+0000","last_peered":"2024-09-17T01:48:42.966375+0000","last_clean":"2024-09-17T01:48:42.966375+0000","last_became_active":"2024-09-17T01:48:40.958209+0000","last_became_peered":"2024-09-17T01:48:40.958209+0000","last_unstale":"2024-09-17T01:48:42.966375+0000","last_undegraded":"2024-09-17T01:48:42.966375+0000","last_fullsized":"2024-09-17T01:48:42.966375+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:02.660884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.f","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.975961+0000","last_change":"2024-09-17T01:48:41.968961+0000","last_active":"2024-09-17T01:48:41.975961+0000","last_peered":"2024-09-17T01:48:41.975961+0000","last_clean":"2024-09-17T01:48:41.975961+0000","last_became_active":"2024-09-17T01:48:41.968609+0000","last_became_peered":"2024-09-17T01:48:41.968609+0000","last_unstale":"2024-09-17T01:48:41.975961+0000","last_undegraded":"2024-09-17T01:48:41.975961+0000","last_fullsized":"2024-09-17T01:48:41.975961+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:00.830194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.e","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967385+0000","last_change":"2024-09-17T01:48:40.958112+0000","last_active":"2024-09-17T01:48:42.967385+0000","last_peered":"2024-09-17T01:48:42.967385+0000","last_clean":"2024-09-17T01:48:42.967385+0000","last_became_active":"2024-09-17T01:48:40.957765+0000","last_became_peered":"2024-09-17T01:48:40.957765+0000","last_unstale":"2024-09-17T01:48:42.967385+0000","last_undegraded":"2024-09-17T01:48:42.967385+0000","last_fullsized":"2024-09-17T01:48:42.967385+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:33.429311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966144+0000","last_change":"2024-09-17T01:48:41.962826+0000","last_active":"2024-09-17T01:48:42.966144+0000","last_peered":"2024-09-17T01:48:42.966144+0000","last_clean":"2024-09-17T01:48:42.966144+0000","last_became_active":"2024-09-17T01:48:41.962494+0000","last_became_peered":"2024-09-17T01:48:41.962494+0000","last_unstale":"2024-09-17T01:48:42.966144+0000","last_undegraded":"2024-09-17T01:48:42.966144+0000","last_fullsized":"2024-09-17T01:48:42.966144+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:37.163100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.d","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966115+0000","last_change":"2024-09-17T01:48:40.960604+0000","last_active":"2024-09-17T01:48:42.966115+0000","last_peered":"2024-09-17T01:48:42.966115+0000","last_clean":"2024-09-17T01:48:42.966115+0000","last_became_active":"2024-09-17T01:48:40.960047+0000","last_became_peered":"2024-09-17T01:48:40.960047+0000","last_unstale":"2024-09-17T01:48:42.966115+0000","last_undegraded":"2024-09-17T01:48:42.966115+0000","last_fullsized":"2024-09-17T01:48:42.966115+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:01.691297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.d","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393460+0000","last_change":"2024-09-17T01:48:41.961193+0000","last_active":"2024-09-17T01:48:43.393460+0000","last_peered":"2024-09-17T01:48:43.393460+0000","last_clean":"2024-09-17T01:48:43.393460+0000","last_became_active":"2024-09-17T01:48:41.960675+0000","last_became_peered":"2024-09-17T01:48:41.960675+0000","last_unstale":"2024-09-17T01:48:43.393460+0000","last_undegraded":"2024-09-17T01:48:43.393460+0000","last_fullsized":"2024-09-17T01:48:43.393460+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:45:20.974258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966870+0000","last_change":"2024-09-17T01:48:40.969612+0000","last_active":"2024-09-17T01:48:42.966870+0000","last_peered":"2024-09-17T01:48:42.966870+0000","last_clean":"2024-09-17T01:48:42.966870+0000","last_became_active":"2024-09-17T01:48:40.969131+0000","last_became_peered":"2024-09-17T01:48:40.969131+0000","last_unstale":"2024-09-17T01:48:42.966870+0000","last_undegraded":"2024-09-17T01:48:42.966870+0000","last_fullsized":"2024-09-17T01:48:42.966870+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:06.914057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959737+0000","last_change":"2024-09-17T01:48:41.980525+0000","last_active":"2024-09-17T01:48:43.959737+0000","last_peered":"2024-09-17T01:48:43.959737+0000","last_clean":"2024-09-17T01:48:43.959737+0000","last_became_active":"2024-09-17T01:48:41.979833+0000","last_became_peered":"2024-09-17T01:48:41.979833+0000","last_unstale":"2024-09-17T01:48:43.959737+0000","last_undegraded":"2024-09-17T01:48:43.959737+0000","last_fullsized":"2024-09-17T01:48:43.959737+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:03:32.301181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.b","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966523+0000","last_change":"2024-09-17T01:48:40.954645+0000","last_active":"2024-09-17T01:48:42.966523+0000","last_peered":"2024-09-17T01:48:42.966523+0000","last_clean":"2024-09-17T01:48:42.966523+0000","last_became_active":"2024-09-17T01:48:40.954314+0000","last_became_peered":"2024-09-17T01:48:40.954314+0000","last_unstale":"2024-09-17T01:48:42.966523+0000","last_undegraded":"2024-09-17T01:48:42.966523+0000","last_fullsized":"2024-09-17T01:48:42.966523+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:03.890846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.b","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966366+0000","last_change":"2024-09-17T01:48:41.962675+0000","last_active":"2024-09-17T01:48:42.966366+0000","last_peered":"2024-09-17T01:48:42.966366+0000","last_clean":"2024-09-17T01:48:42.966366+0000","last_became_active":"2024-09-17T01:48:41.960185+0000","last_became_peered":"2024-09-17T01:48:41.960185+0000","last_unstale":"2024-09-17T01:48:42.966366+0000","last_undegraded":"2024-09-17T01:48:42.966366+0000","last_fullsized":"2024-09-17T01:48:42.966366+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:53.273110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966188+0000","last_change":"2024-09-17T01:48:40.957409+0000","last_active":"2024-09-17T01:48:42.966188+0000","last_peered":"2024-09-17T01:48:42.966188+0000","last_clean":"2024-09-17T01:48:42.966188+0000","last_became_active":"2024-09-17T01:48:40.957076+0000","last_became_peered":"2024-09-17T01:48:40.957076+0000","last_unstale":"2024-09-17T01:48:42.966188+0000","last_undegraded":"2024-09-17T01:48:42.966188+0000","last_fullsized":"2024-09-17T01:48:42.966188+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:09.169291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.460832+0000","last_change":"2024-09-17T01:48:41.972315+0000","last_active":"2024-09-17T01:48:44.460832+0000","last_peered":"2024-09-17T01:48:44.460832+0000","last_clean":"2024-09-17T01:48:44.460832+0000","last_became_active":"2024-09-17T01:48:41.964814+0000","last_became_peered":"2024-09-17T01:48:41.964814+0000","last_unstale":"2024-09-17T01:48:44.460832+0000","last_undegraded":"2024-09-17T01:48:44.460832+0000","last_fullsized":"2024-09-17T01:48:44.460832+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:44.993483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393202+0000","last_change":"2024-09-17T01:48:40.960091+0000","last_active":"2024-09-17T01:48:43.393202+0000","last_peered":"2024-09-17T01:48:43.393202+0000","last_clean":"2024-09-17T01:48:43.393202+0000","last_became_active":"2024-09-17T01:48:40.959708+0000","last_became_peered":"2024-09-17T01:48:40.959708+0000","last_unstale":"2024-09-17T01:48:43.393202+0000","last_undegraded":"2024-09-17T01:48:43.393202+0000","last_fullsized":"2024-09-17T01:48:43.393202+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:14.069903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965102+0000","last_change":"2024-09-17T01:48:41.954668+0000","last_active":"2024-09-17T01:48:42.965102+0000","last_peered":"2024-09-17T01:48:42.965102+0000","last_clean":"2024-09-17T01:48:42.965102+0000","last_became_active":"2024-09-17T01:48:41.953453+0000","last_became_peered":"2024-09-17T01:48:41.953453+0000","last_unstale":"2024-09-17T01:48:42.965102+0000","last_undegraded":"2024-09-17T01:48:42.965102+0000","last_fullsized":"2024-09-17T01:48:42.965102+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:56.732819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393455+0000","last_change":"2024-09-17T01:48:40.954364+0000","last_active":"2024-09-17T01:48:43.393455+0000","last_peered":"2024-09-17T01:48:43.393455+0000","last_clean":"2024-09-17T01:48:43.393455+0000","last_became_active":"2024-09-17T01:48:40.952633+0000","last_became_peered":"2024-09-17T01:48:40.952633+0000","last_unstale":"2024-09-17T01:48:43.393455+0000","last_undegraded":"2024-09-17T01:48:43.393455+0000","last_fullsized":"2024-09-17T01:48:43.393455+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:14.968860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966306+0000","last_change":"2024-09-17T01:48:41.980321+0000","last_active":"2024-09-17T01:48:42.966306+0000","last_peered":"2024-09-17T01:48:42.966306+0000","last_clean":"2024-09-17T01:48:42.966306+0000","last_became_active":"2024-09-17T01:48:41.979988+0000","last_became_peered":"2024-09-17T01:48:41.979988+0000","last_unstale":"2024-09-17T01:48:42.966306+0000","last_undegraded":"2024-09-17T01:48:42.966306+0000","last_fullsized":"2024-09-17T01:48:42.966306+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:44.682690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.7","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967542+0000","last_change":"2024-09-17T01:48:40.968513+0000","last_active":"2024-09-17T01:48:42.967542+0000","last_peered":"2024-09-17T01:48:42.967542+0000","last_clean":"2024-09-17T01:48:42.967542+0000","last_became_active":"2024-09-17T01:48:40.968147+0000","last_became_peered":"2024-09-17T01:48:40.968147+0000","last_unstale":"2024-09-17T01:48:42.967542+0000","last_undegraded":"2024-09-17T01:48:42.967542+0000","last_fullsized":"2024-09-17T01:48:42.967542+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:50.333573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.7","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450551+0000","last_change":"2024-09-17T01:48:41.995352+0000","last_active":"2024-09-17T01:48:43.450551+0000","last_peered":"2024-09-17T01:48:43.450551+0000","last_clean":"2024-09-17T01:48:43.450551+0000","last_became_active":"2024-09-17T01:48:41.995020+0000","last_became_peered":"2024-09-17T01:48:41.995020+0000","last_unstale":"2024-09-17T01:48:43.450551+0000","last_undegraded":"2024-09-17T01:48:43.450551+0000","last_fullsized":"2024-09-17T01:48:43.450551+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:15.035889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.6","version":"213'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959711+0000","last_change":"2024-09-17T01:48:40.967945+0000","last_active":"2024-09-17T01:48:43.959711+0000","last_peered":"2024-09-17T01:48:43.959711+0000","last_clean":"2024-09-17T01:48:43.959711+0000","last_became_active":"2024-09-17T01:48:40.967538+0000","last_became_peered":"2024-09-17T01:48:40.967538+0000","last_unstale":"2024-09-17T01:48:43.959711+0000","last_undegraded":"2024-09-17T01:48:43.959711+0000","last_fullsized":"2024-09-17T01:48:43.959711+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:03.999082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461879+0000","last_change":"2024-09-17T01:48:41.987120+0000","last_active":"2024-09-17T01:48:44.461879+0000","last_peered":"2024-09-17T01:48:44.461879+0000","last_clean":"2024-09-17T01:48:44.461879+0000","last_became_active":"2024-09-17T01:48:41.986788+0000","last_became_peered":"2024-09-17T01:48:41.986788+0000","last_unstale":"2024-09-17T01:48:44.461879+0000","last_undegraded":"2024-09-17T01:48:44.461879+0000","last_fullsized":"2024-09-17T01:48:44.461879+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:45.285758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964804+0000","last_change":"2024-09-17T01:48:40.964922+0000","last_active":"2024-09-17T01:48:42.964804+0000","last_peered":"2024-09-17T01:48:42.964804+0000","last_clean":"2024-09-17T01:48:42.964804+0000","last_became_active":"2024-09-17T01:48:40.964564+0000","last_became_peered":"2024-09-17T01:48:40.964564+0000","last_unstale":"2024-09-17T01:48:42.964804+0000","last_undegraded":"2024-09-17T01:48:42.964804+0000","last_fullsized":"2024-09-17T01:48:42.964804+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:17.144236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966915+0000","last_change":"2024-09-17T01:48:41.983739+0000","last_active":"2024-09-17T01:48:42.966915+0000","last_peered":"2024-09-17T01:48:42.966915+0000","last_clean":"2024-09-17T01:48:42.966915+0000","last_became_active":"2024-09-17T01:48:41.983417+0000","last_became_peered":"2024-09-17T01:48:41.983417+0000","last_unstale":"2024-09-17T01:48:42.966915+0000","last_undegraded":"2024-09-17T01:48:42.966915+0000","last_fullsized":"2024-09-17T01:48:42.966915+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:25.410155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967262+0000","last_change":"2024-09-17T01:48:40.961630+0000","last_active":"2024-09-17T01:48:42.967262+0000","last_peered":"2024-09-17T01:48:42.967262+0000","last_clean":"2024-09-17T01:48:42.967262+0000","last_became_active":"2024-09-17T01:48:40.960243+0000","last_became_peered":"2024-09-17T01:48:40.960243+0000","last_unstale":"2024-09-17T01:48:42.967262+0000","last_undegraded":"2024-09-17T01:48:42.967262+0000","last_fullsized":"2024-09-17T01:48:42.967262+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:02.136066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959855+0000","last_change":"2024-09-17T01:48:41.965904+0000","last_active":"2024-09-17T01:48:43.959855+0000","last_peered":"2024-09-17T01:48:43.959855+0000","last_clean":"2024-09-17T01:48:43.959855+0000","last_became_active":"2024-09-17T01:48:41.965593+0000","last_became_peered":"2024-09-17T01:48:41.965593+0000","last_unstale":"2024-09-17T01:48:43.959855+0000","last_undegraded":"2024-09-17T01:48:43.959855+0000","last_fullsized":"2024-09-17T01:48:43.959855+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:33.950142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965967+0000","last_change":"2024-09-17T01:48:40.956231+0000","last_active":"2024-09-17T01:48:42.965967+0000","last_peered":"2024-09-17T01:48:42.965967+0000","last_clean":"2024-09-17T01:48:42.965967+0000","last_became_active":"2024-09-17T01:48:40.955414+0000","last_became_peered":"2024-09-17T01:48:40.955414+0000","last_unstale":"2024-09-17T01:48:42.965967+0000","last_undegraded":"2024-09-17T01:48:42.965967+0000","last_fullsized":"2024-09-17T01:48:42.965967+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:39.323864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964920+0000","last_change":"2024-09-17T01:48:41.968153+0000","last_active":"2024-09-17T01:48:42.964920+0000","last_peered":"2024-09-17T01:48:42.964920+0000","last_clean":"2024-09-17T01:48:42.964920+0000","last_became_active":"2024-09-17T01:48:41.967605+0000","last_became_peered":"2024-09-17T01:48:41.967605+0000","last_unstale":"2024-09-17T01:48:42.964920+0000","last_undegraded":"2024-09-17T01:48:42.964920+0000","last_fullsized":"2024-09-17T01:48:42.964920+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:16.656430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461708+0000","last_change":"2024-09-17T01:48:40.961888+0000","last_active":"2024-09-17T01:48:44.461708+0000","last_peered":"2024-09-17T01:48:44.461708+0000","last_clean":"2024-09-17T01:48:44.461708+0000","last_became_active":"2024-09-17T01:48:40.960057+0000","last_became_peered":"2024-09-17T01:48:40.960057+0000","last_unstale":"2024-09-17T01:48:44.461708+0000","last_undegraded":"2024-09-17T01:48:44.461708+0000","last_fullsized":"2024-09-17T01:48:44.461708+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:01.691297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393545+0000","last_change":"2024-09-17T01:48:41.964119+0000","last_active":"2024-09-17T01:48:43.393545+0000","last_peered":"2024-09-17T01:48:43.393545+0000","last_clean":"2024-09-17T01:48:43.393545+0000","last_became_active":"2024-09-17T01:48:41.963688+0000","last_became_peered":"2024-09-17T01:48:41.963688+0000","last_unstale":"2024-09-17T01:48:43.393545+0000","last_undegraded":"2024-09-17T01:48:43.393545+0000","last_fullsized":"2024-09-17T01:48:43.393545+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:26:24.176532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.449918+0000","last_change":"2024-09-17T01:48:40.970410+0000","last_active":"2024-09-17T01:48:43.449918+0000","last_peered":"2024-09-17T01:48:43.449918+0000","last_clean":"2024-09-17T01:48:43.449918+0000","last_became_active":"2024-09-17T01:48:40.969725+0000","last_became_peered":"2024-09-17T01:48:40.969725+0000","last_unstale":"2024-09-17T01:48:43.449918+0000","last_undegraded":"2024-09-17T01:48:43.449918+0000","last_fullsized":"2024-09-17T01:48:43.449918+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:59.674013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450122+0000","last_change":"2024-09-17T01:48:41.987710+0000","last_active":"2024-09-17T01:48:43.450122+0000","last_peered":"2024-09-17T01:48:43.450122+0000","last_clean":"2024-09-17T01:48:43.450122+0000","last_became_active":"2024-09-17T01:48:41.983328+0000","last_became_peered":"2024-09-17T01:48:41.983328+0000","last_unstale":"2024-09-17T01:48:43.450122+0000","last_undegraded":"2024-09-17T01:48:43.450122+0000","last_fullsized":"2024-09-17T01:48:43.450122+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:19.736187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-09-17T01:48:41.956387+0000","last_change":"2024-09-17T01:48:40.963242+0000","last_active":"2024-09-17T01:48:41.956387+0000","last_peered":"2024-09-17T01:48:41.956387+0000","last_clean":"2024-09-17T01:48:41.956387+0000","last_became_active":"2024-09-17T01:48:40.962603+0000","last_became_peered":"2024-09-17T01:48:40.962603+0000","last_unstale":"2024-09-17T01:48:41.956387+0000","last_undegraded":"2024-09-17T01:48:41.956387+0000","last_fullsized":"2024-09-17T01:48:41.956387+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:04:09.145533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1e","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393421+0000","last_change":"2024-09-17T01:48:41.959892+0000","last_active":"2024-09-17T01:48:43.393421+0000","last_peered":"2024-09-17T01:48:43.393421+0000","last_clean":"2024-09-17T01:48:43.393421+0000","last_became_active":"2024-09-17T01:48:41.959602+0000","last_became_peered":"2024-09-17T01:48:41.959602+0000","last_unstale":"2024-09-17T01:48:43.393421+0000","last_undegraded":"2024-09-17T01:48:43.393421+0000","last_fullsized":"2024-09-17T01:48:43.393421+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:20.244068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.1f","version":"212'4","reported_seq":19,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450730+0000","last_change":"2024-09-17T01:48:40.970365+0000","last_active":"2024-09-17T01:48:43.450730+0000","last_peered":"2024-09-17T01:48:43.450730+0000","last_clean":"2024-09-17T01:48:43.450730+0000","last_became_active":"2024-09-17T01:48:40.969386+0000","last_became_peered":"2024-09-17T01:48:40.969386+0000","last_unstale":"2024-09-17T01:48:43.450730+0000","last_undegraded":"2024-09-17T01:48:43.450730+0000","last_fullsized":"2024-09-17T01:48:43.450730+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:05.396682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":478,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964191+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:48:42.964191+0000","last_peered":"2024-09-17T01:48:42.964191+0000","last_clean":"2024-09-17T01:48:42.964191+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:48:42.964191+0000","last_undegraded":"2024-09-17T01:48:42.964191+0000","last_fullsized":"2024-09-17T01:48:42.964191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":31,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":30,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476942,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47700,"kb_used_data":2624,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324140,"statfs":{"total":96636764160,"available":96587919360,"internally_reserved":0,"allocated":2686976,"data_stored":1189000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509645,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56036,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315804,"statfs":{"total":96636764160,"available":96579383296,"internally_reserved":0,"allocated":2703360,"data_stored":1191158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509644,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47688,"kb_used_data":2612,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324152,"statfs":{"total":96636764160,"available":96587931648,"internally_reserved":0,"allocated":2674688,"data_stored":1182720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509645,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51860,"kb_used_data":2624,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319980,"statfs":{"total":96636764160,"available":96583659520,"internally_reserved":0,"allocated":2686976,"data_stored":1188952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509645,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69852,"kb_used_data":2632,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94301988,"statfs":{"total":96636764160,"available":96565235712,"internally_reserved":0,"allocated":2695168,"data_stored":1190542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509644,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52440,"kb_used_data":3204,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319400,"statfs":{"total":96636764160,"available":96583065600,"internally_reserved":0,"allocated":3280896,"data_stored":1779880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509646,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60184,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311656,"statfs":{"total":96636764160,"available":96575135744,"internally_reserved":0,"allocated":2691072,"data_stored":1189022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":58915273},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542350,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52440,"kb_used_data":3196,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319400,"statfs":{"total":96636764160,"available":96583065600,"internally_reserved":0,"allocated":3272704,"data_stored":1773122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:48:51.484 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:48:51.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.724+0000 7ff935200640 1 -- 172.21.15.42:0/120523499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9300cd720 msgr2=0x7ff9300cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:51.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.724+0000 7ff935200640 1 --2- 172.21.15.42:0/120523499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9300cd720 0x7ff9300cdb30 secure :-1 s=READY pgs=2433 cs=0 l=1 rev1=1 crypto rx=0x7ff930071df0 tx=0x7ff91802a4d0 comp rx=0 tx=0).stop 2024-09-17T01:48:51.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.724+0000 7ff935200640 1 -- 172.21.15.42:0/120523499 shutdown_connections 2024-09-17T01:48:51.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.724+0000 7ff935200640 1 --2- 172.21.15.42:0/120523499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9300cd720 0x7ff9300cdb30 unknown :-1 s=CLOSED pgs=2433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:51.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.724+0000 7ff935200640 1 --2- 172.21.15.42:0/120523499 >> v2:172.21.15.43:3300/0 conn(0x7ff9300cf200 0x7ff9300ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:51.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.724+0000 7ff935200640 1 -- 172.21.15.42:0/120523499 >> 172.21.15.42:0/120523499 conn(0x7ff93006d1b0 msgr2=0x7ff93006d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:51.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.724+0000 7ff935200640 1 -- 172.21.15.42:0/120523499 shutdown_connections 2024-09-17T01:48:51.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.725+0000 7ff935200640 1 -- 172.21.15.42:0/120523499 wait complete. 2024-09-17T01:48:51.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.727+0000 7ff935200640 1 Processor -- start 2024-09-17T01:48:51.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.727+0000 7ff935200640 1 -- start start 2024-09-17T01:48:51.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.728+0000 7ff935200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9300cd720 0x7ff930148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:51.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.728+0000 7ff935200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9300cf200 0x7ff9301e70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:51.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.728+0000 7ff935200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff93015d270 0x7ff9300b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:51.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.728+0000 7ff935200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff93006ef80 con 0x7ff9300cf200 2024-09-17T01:48:51.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.728+0000 7ff935200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff93006ee00 con 0x7ff93015d270 2024-09-17T01:48:51.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.728+0000 7ff935200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff93006f100 con 0x7ff9300cd720 2024-09-17T01:48:51.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.728+0000 7ff927e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9300cf200 0x7ff9301e70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:51.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.729+0000 7ff927e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9300cf200 0x7ff9301e70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45808/0 (socket says 172.21.15.42:45808) 2024-09-17T01:48:51.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.729+0000 7ff927e00640 1 -- 172.21.15.42:0/1680958130 learned_addr learned my addr 172.21.15.42:0/1680958130 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:51.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.729+0000 7ff92e800640 1 --2- 172.21.15.42:0/1680958130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff93015d270 0x7ff9300b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:51.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.729+0000 7ff92de00640 1 --2- 172.21.15.42:0/1680958130 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9300cd720 0x7ff930148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:51.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.729+0000 7ff927e00640 1 -- 172.21.15.42:0/1680958130 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9300cd720 msgr2=0x7ff930148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:51.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.729+0000 7ff927e00640 1 --2- 172.21.15.42:0/1680958130 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9300cd720 0x7ff930148050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:51.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.729+0000 7ff927e00640 1 -- 172.21.15.42:0/1680958130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff93015d270 msgr2=0x7ff9300b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:51.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.729+0000 7ff927e00640 1 --2- 172.21.15.42:0/1680958130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff93015d270 0x7ff9300b13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:51.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.729+0000 7ff927e00640 1 -- 172.21.15.42:0/1680958130 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff930148590 con 0x7ff9300cf200 2024-09-17T01:48:51.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.729+0000 7ff92e800640 1 --2- 172.21.15.42:0/1680958130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff93015d270 0x7ff9300b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:51.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.729+0000 7ff927e00640 1 --2- 172.21.15.42:0/1680958130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9300cf200 0x7ff9301e70e0 secure :-1 s=READY pgs=2434 cs=0 l=1 rev1=1 crypto rx=0x7ff9180099c0 tx=0x7ff9180039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:51.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.729+0000 7ff926000640 1 -- 172.21.15.42:0/1680958130 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91803e030 con 0x7ff9300cf200 2024-09-17T01:48:51.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.729+0000 7ff926000640 1 -- 172.21.15.42:0/1680958130 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9180047a0 con 0x7ff9300cf200 2024-09-17T01:48:51.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.730+0000 7ff926000640 1 -- 172.21.15.42:0/1680958130 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff918035040 con 0x7ff9300cf200 2024-09-17T01:48:51.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.730+0000 7ff935200640 1 -- 172.21.15.42:0/1680958130 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9301f78d0 con 0x7ff9300cf200 2024-09-17T01:48:51.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.730+0000 7ff935200640 1 -- 172.21.15.42:0/1680958130 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9301f8020 con 0x7ff9300cf200 2024-09-17T01:48:51.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.731+0000 7ff935200640 1 -- 172.21.15.42:0/1680958130 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff93006f5b0 con 0x7ff9300cf200 2024-09-17T01:48:51.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.732+0000 7ff926000640 1 -- 172.21.15.42:0/1680958130 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff918041030 con 0x7ff9300cf200 2024-09-17T01:48:51.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.733+0000 7ff926000640 1 --2- 172.21.15.42:0/1680958130 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff90c078b90 0x7ff90c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:51.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.734+0000 7ff926000640 1 -- 172.21.15.42:0/1680958130 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(213..213 src has 1..213) ==== 5709+0+0 (secure 0 0 0) 0x7ff9180bb400 con 0x7ff9300cf200 2024-09-17T01:48:51.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.734+0000 7ff92de00640 1 --2- 172.21.15.42:0/1680958130 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff90c078b90 0x7ff90c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:51.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.735+0000 7ff92de00640 1 --2- 172.21.15.42:0/1680958130 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff90c078b90 0x7ff90c07b0a0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7ff920005fd0 tx=0x7ff920005850 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:51.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.738+0000 7ff926000640 1 -- 172.21.15.42:0/1680958130 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff930148590 con 0x7ff9300cf200 2024-09-17T01:48:51.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.929+0000 7ff935200640 1 -- 172.21.15.42:0/1680958130 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff9301f7aa0 con 0x7ff90c078b90 2024-09-17T01:48:51.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.934+0000 7ff926000640 1 -- 172.21.15.42:0/1680958130 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252398 (secure 0 0 0) 0x7ff9301f7aa0 con 0x7ff90c078b90 2024-09-17T01:48:51.935 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:48:51.937 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:48:51.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.938+0000 7ff935200640 1 -- 172.21.15.42:0/1680958130 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff90c078b90 msgr2=0x7ff90c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:51.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.938+0000 7ff935200640 1 --2- 172.21.15.42:0/1680958130 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff90c078b90 0x7ff90c07b0a0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7ff920005fd0 tx=0x7ff920005850 comp rx=0 tx=0).stop 2024-09-17T01:48:51.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.938+0000 7ff935200640 1 -- 172.21.15.42:0/1680958130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9300cf200 msgr2=0x7ff9301e70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:51.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.938+0000 7ff935200640 1 --2- 172.21.15.42:0/1680958130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9300cf200 0x7ff9301e70e0 secure :-1 s=READY pgs=2434 cs=0 l=1 rev1=1 crypto rx=0x7ff9180099c0 tx=0x7ff9180039e0 comp rx=0 tx=0).stop 2024-09-17T01:48:51.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.938+0000 7ff935200640 1 -- 172.21.15.42:0/1680958130 shutdown_connections 2024-09-17T01:48:51.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.938+0000 7ff935200640 1 --2- 172.21.15.42:0/1680958130 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff90c078b90 0x7ff90c07b0a0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:51.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.938+0000 7ff935200640 1 --2- 172.21.15.42:0/1680958130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff93015d270 0x7ff9300b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:51.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.938+0000 7ff935200640 1 --2- 172.21.15.42:0/1680958130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9300cf200 0x7ff9301e70e0 unknown :-1 s=CLOSED pgs=2434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:51.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.938+0000 7ff935200640 1 --2- 172.21.15.42:0/1680958130 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9300cd720 0x7ff930148050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:51.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.938+0000 7ff935200640 1 -- 172.21.15.42:0/1680958130 >> 172.21.15.42:0/1680958130 conn(0x7ff93006d1b0 msgr2=0x7ff9300b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:51.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.938+0000 7ff935200640 1 -- 172.21.15.42:0/1680958130 shutdown_connections 2024-09-17T01:48:51.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:51.938+0000 7ff935200640 1 -- 172.21.15.42:0/1680958130 wait complete. 2024-09-17T01:48:51.963 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":715,"stamp":"2024-09-17T01:48:51.269372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":438220,"kb_used_data":22184,"kb_used_omap":12,"kb_used_meta":415859,"kb_avail":754536500,"statfs":{"total":773094113280,"available":772645376000,"internally_reserved":0,"allocated":22716416,"data_stored":10696996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":425840180},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.324306"},"pg_stats":[{"pgid":"31.3f","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450608+0000","last_change":"2024-09-17T01:48:41.988421+0000","last_active":"2024-09-17T01:48:43.450608+0000","last_peered":"2024-09-17T01:48:43.450608+0000","last_clean":"2024-09-17T01:48:43.450608+0000","last_became_active":"2024-09-17T01:48:41.988099+0000","last_became_peered":"2024-09-17T01:48:41.988099+0000","last_unstale":"2024-09-17T01:48:43.450608+0000","last_undegraded":"2024-09-17T01:48:43.450608+0000","last_fullsized":"2024-09-17T01:48:43.450608+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:10.721737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.3e","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.460855+0000","last_change":"2024-09-17T01:48:41.965330+0000","last_active":"2024-09-17T01:48:44.460855+0000","last_peered":"2024-09-17T01:48:44.460855+0000","last_clean":"2024-09-17T01:48:44.460855+0000","last_became_active":"2024-09-17T01:48:41.964988+0000","last_became_peered":"2024-09-17T01:48:41.964988+0000","last_unstale":"2024-09-17T01:48:44.460855+0000","last_undegraded":"2024-09-17T01:48:44.460855+0000","last_fullsized":"2024-09-17T01:48:44.460855+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:49.910904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.3d","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450523+0000","last_change":"2024-09-17T01:48:41.992476+0000","last_active":"2024-09-17T01:48:43.450523+0000","last_peered":"2024-09-17T01:48:43.450523+0000","last_clean":"2024-09-17T01:48:43.450523+0000","last_became_active":"2024-09-17T01:48:41.992130+0000","last_became_peered":"2024-09-17T01:48:41.992130+0000","last_unstale":"2024-09-17T01:48:43.450523+0000","last_undegraded":"2024-09-17T01:48:43.450523+0000","last_fullsized":"2024-09-17T01:48:43.450523+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:15:15.143150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.3c","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966650+0000","last_change":"2024-09-17T01:48:41.969707+0000","last_active":"2024-09-17T01:48:42.966650+0000","last_peered":"2024-09-17T01:48:42.966650+0000","last_clean":"2024-09-17T01:48:42.966650+0000","last_became_active":"2024-09-17T01:48:41.967489+0000","last_became_peered":"2024-09-17T01:48:41.967489+0000","last_unstale":"2024-09-17T01:48:42.966650+0000","last_undegraded":"2024-09-17T01:48:42.966650+0000","last_fullsized":"2024-09-17T01:48:42.966650+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:22.342311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.3b","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964633+0000","last_change":"2024-09-17T01:48:41.956894+0000","last_active":"2024-09-17T01:48:42.964633+0000","last_peered":"2024-09-17T01:48:42.964633+0000","last_clean":"2024-09-17T01:48:42.964633+0000","last_became_active":"2024-09-17T01:48:41.956533+0000","last_became_peered":"2024-09-17T01:48:41.956533+0000","last_unstale":"2024-09-17T01:48:42.964633+0000","last_undegraded":"2024-09-17T01:48:42.964633+0000","last_fullsized":"2024-09-17T01:48:42.964633+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:43.230899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.3a","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450111+0000","last_change":"2024-09-17T01:48:41.989695+0000","last_active":"2024-09-17T01:48:43.450111+0000","last_peered":"2024-09-17T01:48:43.450111+0000","last_clean":"2024-09-17T01:48:43.450111+0000","last_became_active":"2024-09-17T01:48:41.988985+0000","last_became_peered":"2024-09-17T01:48:41.988985+0000","last_unstale":"2024-09-17T01:48:43.450111+0000","last_undegraded":"2024-09-17T01:48:43.450111+0000","last_fullsized":"2024-09-17T01:48:43.450111+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:56:47.447939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.39","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393200+0000","last_change":"2024-09-17T01:48:41.963394+0000","last_active":"2024-09-17T01:48:43.393200+0000","last_peered":"2024-09-17T01:48:43.393200+0000","last_clean":"2024-09-17T01:48:43.393200+0000","last_became_active":"2024-09-17T01:48:41.963064+0000","last_became_peered":"2024-09-17T01:48:41.963064+0000","last_unstale":"2024-09-17T01:48:43.393200+0000","last_undegraded":"2024-09-17T01:48:43.393200+0000","last_fullsized":"2024-09-17T01:48:43.393200+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:50.099904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.38","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964389+0000","last_change":"2024-09-17T01:48:41.963873+0000","last_active":"2024-09-17T01:48:42.964389+0000","last_peered":"2024-09-17T01:48:42.964389+0000","last_clean":"2024-09-17T01:48:42.964389+0000","last_became_active":"2024-09-17T01:48:41.960583+0000","last_became_peered":"2024-09-17T01:48:41.960583+0000","last_unstale":"2024-09-17T01:48:42.964389+0000","last_undegraded":"2024-09-17T01:48:42.964389+0000","last_fullsized":"2024-09-17T01:48:42.964389+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:31.451012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.37","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959932+0000","last_change":"2024-09-17T01:48:41.987057+0000","last_active":"2024-09-17T01:48:43.959932+0000","last_peered":"2024-09-17T01:48:43.959932+0000","last_clean":"2024-09-17T01:48:43.959932+0000","last_became_active":"2024-09-17T01:48:41.986705+0000","last_became_peered":"2024-09-17T01:48:41.986705+0000","last_unstale":"2024-09-17T01:48:43.959932+0000","last_undegraded":"2024-09-17T01:48:43.959932+0000","last_fullsized":"2024-09-17T01:48:43.959932+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:08.089510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.36","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393240+0000","last_change":"2024-09-17T01:48:41.963101+0000","last_active":"2024-09-17T01:48:43.393240+0000","last_peered":"2024-09-17T01:48:43.393240+0000","last_clean":"2024-09-17T01:48:43.393240+0000","last_became_active":"2024-09-17T01:48:41.961668+0000","last_became_peered":"2024-09-17T01:48:41.961668+0000","last_unstale":"2024-09-17T01:48:43.393240+0000","last_undegraded":"2024-09-17T01:48:43.393240+0000","last_fullsized":"2024-09-17T01:48:43.393240+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:30.142847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.35","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967097+0000","last_change":"2024-09-17T01:48:41.992165+0000","last_active":"2024-09-17T01:48:42.967097+0000","last_peered":"2024-09-17T01:48:42.967097+0000","last_clean":"2024-09-17T01:48:42.967097+0000","last_became_active":"2024-09-17T01:48:41.991821+0000","last_became_peered":"2024-09-17T01:48:41.991821+0000","last_unstale":"2024-09-17T01:48:42.967097+0000","last_undegraded":"2024-09-17T01:48:42.967097+0000","last_fullsized":"2024-09-17T01:48:42.967097+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:26.331280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.34","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393530+0000","last_change":"2024-09-17T01:48:41.973919+0000","last_active":"2024-09-17T01:48:43.393530+0000","last_peered":"2024-09-17T01:48:43.393530+0000","last_clean":"2024-09-17T01:48:43.393530+0000","last_became_active":"2024-09-17T01:48:41.973559+0000","last_became_peered":"2024-09-17T01:48:41.973559+0000","last_unstale":"2024-09-17T01:48:43.393530+0000","last_undegraded":"2024-09-17T01:48:43.393530+0000","last_fullsized":"2024-09-17T01:48:43.393530+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:45.600564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.33","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959533+0000","last_change":"2024-09-17T01:48:41.980332+0000","last_active":"2024-09-17T01:48:43.959533+0000","last_peered":"2024-09-17T01:48:43.959533+0000","last_clean":"2024-09-17T01:48:43.959533+0000","last_became_active":"2024-09-17T01:48:41.979993+0000","last_became_peered":"2024-09-17T01:48:41.979993+0000","last_unstale":"2024-09-17T01:48:43.959533+0000","last_undegraded":"2024-09-17T01:48:43.959533+0000","last_fullsized":"2024-09-17T01:48:43.959533+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:28.765107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.32","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966149+0000","last_change":"2024-09-17T01:48:41.977401+0000","last_active":"2024-09-17T01:48:42.966149+0000","last_peered":"2024-09-17T01:48:42.966149+0000","last_clean":"2024-09-17T01:48:42.966149+0000","last_became_active":"2024-09-17T01:48:41.974556+0000","last_became_peered":"2024-09-17T01:48:41.974556+0000","last_unstale":"2024-09-17T01:48:42.966149+0000","last_undegraded":"2024-09-17T01:48:42.966149+0000","last_fullsized":"2024-09-17T01:48:42.966149+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:55.867060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.31","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965569+0000","last_change":"2024-09-17T01:48:41.975123+0000","last_active":"2024-09-17T01:48:42.965569+0000","last_peered":"2024-09-17T01:48:42.965569+0000","last_clean":"2024-09-17T01:48:42.965569+0000","last_became_active":"2024-09-17T01:48:41.974673+0000","last_became_peered":"2024-09-17T01:48:41.974673+0000","last_unstale":"2024-09-17T01:48:42.965569+0000","last_undegraded":"2024-09-17T01:48:42.965569+0000","last_fullsized":"2024-09-17T01:48:42.965569+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:17:36.339225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.30","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.460460+0000","last_change":"2024-09-17T01:48:41.965693+0000","last_active":"2024-09-17T01:48:44.460460+0000","last_peered":"2024-09-17T01:48:44.460460+0000","last_clean":"2024-09-17T01:48:44.460460+0000","last_became_active":"2024-09-17T01:48:41.962372+0000","last_became_peered":"2024-09-17T01:48:41.962372+0000","last_unstale":"2024-09-17T01:48:44.460460+0000","last_undegraded":"2024-09-17T01:48:44.460460+0000","last_fullsized":"2024-09-17T01:48:44.460460+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:18.199826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.2f","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393403+0000","last_change":"2024-09-17T01:48:41.976694+0000","last_active":"2024-09-17T01:48:43.393403+0000","last_peered":"2024-09-17T01:48:43.393403+0000","last_clean":"2024-09-17T01:48:43.393403+0000","last_became_active":"2024-09-17T01:48:41.974656+0000","last_became_peered":"2024-09-17T01:48:41.974656+0000","last_unstale":"2024-09-17T01:48:43.393403+0000","last_undegraded":"2024-09-17T01:48:43.393403+0000","last_fullsized":"2024-09-17T01:48:43.393403+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:02.926819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2e","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462080+0000","last_change":"2024-09-17T01:48:41.980564+0000","last_active":"2024-09-17T01:48:44.462080+0000","last_peered":"2024-09-17T01:48:44.462080+0000","last_clean":"2024-09-17T01:48:44.462080+0000","last_became_active":"2024-09-17T01:48:41.980245+0000","last_became_peered":"2024-09-17T01:48:41.980245+0000","last_unstale":"2024-09-17T01:48:44.462080+0000","last_undegraded":"2024-09-17T01:48:44.462080+0000","last_fullsized":"2024-09-17T01:48:44.462080+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:43.668061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.2d","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959709+0000","last_change":"2024-09-17T01:48:41.986560+0000","last_active":"2024-09-17T01:48:43.959709+0000","last_peered":"2024-09-17T01:48:43.959709+0000","last_clean":"2024-09-17T01:48:43.959709+0000","last_became_active":"2024-09-17T01:48:41.986238+0000","last_became_peered":"2024-09-17T01:48:41.986238+0000","last_unstale":"2024-09-17T01:48:43.959709+0000","last_undegraded":"2024-09-17T01:48:43.959709+0000","last_fullsized":"2024-09-17T01:48:43.959709+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:41:07.890922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.2c","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461412+0000","last_change":"2024-09-17T01:48:41.969173+0000","last_active":"2024-09-17T01:48:44.461412+0000","last_peered":"2024-09-17T01:48:44.461412+0000","last_clean":"2024-09-17T01:48:44.461412+0000","last_became_active":"2024-09-17T01:48:41.968166+0000","last_became_peered":"2024-09-17T01:48:41.968166+0000","last_unstale":"2024-09-17T01:48:44.461412+0000","last_undegraded":"2024-09-17T01:48:44.461412+0000","last_fullsized":"2024-09-17T01:48:44.461412+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:24.231351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.2b","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964761+0000","last_change":"2024-09-17T01:48:41.954636+0000","last_active":"2024-09-17T01:48:42.964761+0000","last_peered":"2024-09-17T01:48:42.964761+0000","last_clean":"2024-09-17T01:48:42.964761+0000","last_became_active":"2024-09-17T01:48:41.953894+0000","last_became_peered":"2024-09-17T01:48:41.953894+0000","last_unstale":"2024-09-17T01:48:42.964761+0000","last_undegraded":"2024-09-17T01:48:42.964761+0000","last_fullsized":"2024-09-17T01:48:42.964761+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:36.329548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.2a","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959388+0000","last_change":"2024-09-17T01:48:41.966183+0000","last_active":"2024-09-17T01:48:43.959388+0000","last_peered":"2024-09-17T01:48:43.959388+0000","last_clean":"2024-09-17T01:48:43.959388+0000","last_became_active":"2024-09-17T01:48:41.964659+0000","last_became_peered":"2024-09-17T01:48:41.964659+0000","last_unstale":"2024-09-17T01:48:43.959388+0000","last_undegraded":"2024-09-17T01:48:43.959388+0000","last_fullsized":"2024-09-17T01:48:43.959388+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:43.230899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.29","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959378+0000","last_change":"2024-09-17T01:48:41.967881+0000","last_active":"2024-09-17T01:48:43.959378+0000","last_peered":"2024-09-17T01:48:43.959378+0000","last_clean":"2024-09-17T01:48:43.959378+0000","last_became_active":"2024-09-17T01:48:41.967418+0000","last_became_peered":"2024-09-17T01:48:41.967418+0000","last_unstale":"2024-09-17T01:48:43.959378+0000","last_undegraded":"2024-09-17T01:48:43.959378+0000","last_fullsized":"2024-09-17T01:48:43.959378+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:16.304885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.28","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965934+0000","last_change":"2024-09-17T01:48:41.971698+0000","last_active":"2024-09-17T01:48:42.965934+0000","last_peered":"2024-09-17T01:48:42.965934+0000","last_clean":"2024-09-17T01:48:42.965934+0000","last_became_active":"2024-09-17T01:48:41.970716+0000","last_became_peered":"2024-09-17T01:48:41.970716+0000","last_unstale":"2024-09-17T01:48:42.965934+0000","last_undegraded":"2024-09-17T01:48:42.965934+0000","last_fullsized":"2024-09-17T01:48:42.965934+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:55.100537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.27","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967261+0000","last_change":"2024-09-17T01:48:41.961465+0000","last_active":"2024-09-17T01:48:42.967261+0000","last_peered":"2024-09-17T01:48:42.967261+0000","last_clean":"2024-09-17T01:48:42.967261+0000","last_became_active":"2024-09-17T01:48:41.961094+0000","last_became_peered":"2024-09-17T01:48:41.961094+0000","last_unstale":"2024-09-17T01:48:42.967261+0000","last_undegraded":"2024-09-17T01:48:42.967261+0000","last_fullsized":"2024-09-17T01:48:42.967261+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:41.337984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.26","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965081+0000","last_change":"2024-09-17T01:48:41.976001+0000","last_active":"2024-09-17T01:48:42.965081+0000","last_peered":"2024-09-17T01:48:42.965081+0000","last_clean":"2024-09-17T01:48:42.965081+0000","last_became_active":"2024-09-17T01:48:41.975224+0000","last_became_peered":"2024-09-17T01:48:41.975224+0000","last_unstale":"2024-09-17T01:48:42.965081+0000","last_undegraded":"2024-09-17T01:48:42.965081+0000","last_fullsized":"2024-09-17T01:48:42.965081+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:54.362773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.25","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.460907+0000","last_change":"2024-09-17T01:48:41.962212+0000","last_active":"2024-09-17T01:48:44.460907+0000","last_peered":"2024-09-17T01:48:44.460907+0000","last_clean":"2024-09-17T01:48:44.460907+0000","last_became_active":"2024-09-17T01:48:41.957215+0000","last_became_peered":"2024-09-17T01:48:41.957215+0000","last_unstale":"2024-09-17T01:48:44.460907+0000","last_undegraded":"2024-09-17T01:48:44.460907+0000","last_fullsized":"2024-09-17T01:48:44.460907+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:53.891058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.24","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966653+0000","last_change":"2024-09-17T01:48:41.960227+0000","last_active":"2024-09-17T01:48:42.966653+0000","last_peered":"2024-09-17T01:48:42.966653+0000","last_clean":"2024-09-17T01:48:42.966653+0000","last_became_active":"2024-09-17T01:48:41.959863+0000","last_became_peered":"2024-09-17T01:48:41.959863+0000","last_unstale":"2024-09-17T01:48:42.966653+0000","last_undegraded":"2024-09-17T01:48:42.966653+0000","last_fullsized":"2024-09-17T01:48:42.966653+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:47.101431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.23","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966478+0000","last_change":"2024-09-17T01:48:41.983228+0000","last_active":"2024-09-17T01:48:42.966478+0000","last_peered":"2024-09-17T01:48:42.966478+0000","last_clean":"2024-09-17T01:48:42.966478+0000","last_became_active":"2024-09-17T01:48:41.982832+0000","last_became_peered":"2024-09-17T01:48:41.982832+0000","last_unstale":"2024-09-17T01:48:42.966478+0000","last_undegraded":"2024-09-17T01:48:42.966478+0000","last_fullsized":"2024-09-17T01:48:42.966478+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:53.868153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.22","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959412+0000","last_change":"2024-09-17T01:48:41.963496+0000","last_active":"2024-09-17T01:48:43.959412+0000","last_peered":"2024-09-17T01:48:43.959412+0000","last_clean":"2024-09-17T01:48:43.959412+0000","last_became_active":"2024-09-17T01:48:41.958645+0000","last_became_peered":"2024-09-17T01:48:41.958645+0000","last_unstale":"2024-09-17T01:48:43.959412+0000","last_undegraded":"2024-09-17T01:48:43.959412+0000","last_fullsized":"2024-09-17T01:48:43.959412+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:40:50.683423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.21","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965991+0000","last_change":"2024-09-17T01:48:41.973589+0000","last_active":"2024-09-17T01:48:42.965991+0000","last_peered":"2024-09-17T01:48:42.965991+0000","last_clean":"2024-09-17T01:48:42.965991+0000","last_became_active":"2024-09-17T01:48:41.973257+0000","last_became_peered":"2024-09-17T01:48:41.973257+0000","last_unstale":"2024-09-17T01:48:42.965991+0000","last_undegraded":"2024-09-17T01:48:42.965991+0000","last_fullsized":"2024-09-17T01:48:42.965991+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:00.927500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.20","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461096+0000","last_change":"2024-09-17T01:48:41.966916+0000","last_active":"2024-09-17T01:48:44.461096+0000","last_peered":"2024-09-17T01:48:44.461096+0000","last_clean":"2024-09-17T01:48:44.461096+0000","last_became_active":"2024-09-17T01:48:41.962328+0000","last_became_peered":"2024-09-17T01:48:41.962328+0000","last_unstale":"2024-09-17T01:48:44.461096+0000","last_undegraded":"2024-09-17T01:48:44.461096+0000","last_fullsized":"2024-09-17T01:48:44.461096+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:30.005459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1f","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462071+0000","last_change":"2024-09-17T01:48:41.987044+0000","last_active":"2024-09-17T01:48:44.462071+0000","last_peered":"2024-09-17T01:48:44.462071+0000","last_clean":"2024-09-17T01:48:44.462071+0000","last_became_active":"2024-09-17T01:48:41.986685+0000","last_became_peered":"2024-09-17T01:48:41.986685+0000","last_unstale":"2024-09-17T01:48:44.462071+0000","last_undegraded":"2024-09-17T01:48:44.462071+0000","last_fullsized":"2024-09-17T01:48:44.462071+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:15:39.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1e","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966212+0000","last_change":"2024-09-17T01:48:40.958584+0000","last_active":"2024-09-17T01:48:42.966212+0000","last_peered":"2024-09-17T01:48:42.966212+0000","last_clean":"2024-09-17T01:48:42.966212+0000","last_became_active":"2024-09-17T01:48:40.958270+0000","last_became_peered":"2024-09-17T01:48:40.958270+0000","last_unstale":"2024-09-17T01:48:42.966212+0000","last_undegraded":"2024-09-17T01:48:42.966212+0000","last_fullsized":"2024-09-17T01:48:42.966212+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:43.311074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1c","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967106+0000","last_change":"2024-09-17T01:48:41.991844+0000","last_active":"2024-09-17T01:48:42.967106+0000","last_peered":"2024-09-17T01:48:42.967106+0000","last_clean":"2024-09-17T01:48:42.967106+0000","last_became_active":"2024-09-17T01:48:41.991218+0000","last_became_peered":"2024-09-17T01:48:41.991218+0000","last_unstale":"2024-09-17T01:48:42.967106+0000","last_undegraded":"2024-09-17T01:48:42.967106+0000","last_fullsized":"2024-09-17T01:48:42.967106+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:36.622860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.1d","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450551+0000","last_change":"2024-09-17T01:48:40.970298+0000","last_active":"2024-09-17T01:48:43.450551+0000","last_peered":"2024-09-17T01:48:43.450551+0000","last_clean":"2024-09-17T01:48:43.450551+0000","last_became_active":"2024-09-17T01:48:40.969934+0000","last_became_peered":"2024-09-17T01:48:40.969934+0000","last_unstale":"2024-09-17T01:48:43.450551+0000","last_undegraded":"2024-09-17T01:48:43.450551+0000","last_fullsized":"2024-09-17T01:48:43.450551+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:06.666716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959878+0000","last_change":"2024-09-17T01:48:41.986546+0000","last_active":"2024-09-17T01:48:43.959878+0000","last_peered":"2024-09-17T01:48:43.959878+0000","last_clean":"2024-09-17T01:48:43.959878+0000","last_became_active":"2024-09-17T01:48:41.986211+0000","last_became_peered":"2024-09-17T01:48:41.986211+0000","last_unstale":"2024-09-17T01:48:43.959878+0000","last_undegraded":"2024-09-17T01:48:43.959878+0000","last_fullsized":"2024-09-17T01:48:43.959878+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:39.567639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.1c","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461822+0000","last_change":"2024-09-17T01:48:40.963737+0000","last_active":"2024-09-17T01:48:44.461822+0000","last_peered":"2024-09-17T01:48:44.461822+0000","last_clean":"2024-09-17T01:48:44.461822+0000","last_became_active":"2024-09-17T01:48:40.963409+0000","last_became_peered":"2024-09-17T01:48:40.963409+0000","last_unstale":"2024-09-17T01:48:44.461822+0000","last_undegraded":"2024-09-17T01:48:44.461822+0000","last_fullsized":"2024-09-17T01:48:44.461822+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:07.992373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.1a","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461547+0000","last_change":"2024-09-17T01:48:41.967809+0000","last_active":"2024-09-17T01:48:44.461547+0000","last_peered":"2024-09-17T01:48:44.461547+0000","last_clean":"2024-09-17T01:48:44.461547+0000","last_became_active":"2024-09-17T01:48:41.967471+0000","last_became_peered":"2024-09-17T01:48:41.967471+0000","last_unstale":"2024-09-17T01:48:44.461547+0000","last_undegraded":"2024-09-17T01:48:44.461547+0000","last_fullsized":"2024-09-17T01:48:44.461547+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:15.398716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.1b","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462083+0000","last_change":"2024-09-17T01:48:40.965537+0000","last_active":"2024-09-17T01:48:44.462083+0000","last_peered":"2024-09-17T01:48:44.462083+0000","last_clean":"2024-09-17T01:48:44.462083+0000","last_became_active":"2024-09-17T01:48:40.965186+0000","last_became_peered":"2024-09-17T01:48:40.965186+0000","last_unstale":"2024-09-17T01:48:44.462083+0000","last_undegraded":"2024-09-17T01:48:44.462083+0000","last_fullsized":"2024-09-17T01:48:44.462083+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:02.660884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.1b","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966082+0000","last_change":"2024-09-17T01:48:41.973058+0000","last_active":"2024-09-17T01:48:42.966082+0000","last_peered":"2024-09-17T01:48:42.966082+0000","last_clean":"2024-09-17T01:48:42.966082+0000","last_became_active":"2024-09-17T01:48:41.972705+0000","last_became_peered":"2024-09-17T01:48:41.972705+0000","last_unstale":"2024-09-17T01:48:42.966082+0000","last_undegraded":"2024-09-17T01:48:42.966082+0000","last_fullsized":"2024-09-17T01:48:42.966082+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:00.679343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.1a","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461608+0000","last_change":"2024-09-17T01:48:40.963571+0000","last_active":"2024-09-17T01:48:44.461608+0000","last_peered":"2024-09-17T01:48:44.461608+0000","last_clean":"2024-09-17T01:48:44.461608+0000","last_became_active":"2024-09-17T01:48:40.963225+0000","last_became_peered":"2024-09-17T01:48:40.963225+0000","last_unstale":"2024-09-17T01:48:44.461608+0000","last_undegraded":"2024-09-17T01:48:44.461608+0000","last_fullsized":"2024-09-17T01:48:44.461608+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:17.264437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966022+0000","last_change":"2024-09-17T01:48:41.961255+0000","last_active":"2024-09-17T01:48:42.966022+0000","last_peered":"2024-09-17T01:48:42.966022+0000","last_clean":"2024-09-17T01:48:42.966022+0000","last_became_active":"2024-09-17T01:48:41.960894+0000","last_became_peered":"2024-09-17T01:48:41.960894+0000","last_unstale":"2024-09-17T01:48:42.966022+0000","last_undegraded":"2024-09-17T01:48:42.966022+0000","last_fullsized":"2024-09-17T01:48:42.966022+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:02:46.006988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.19","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965064+0000","last_change":"2024-09-17T01:48:40.963230+0000","last_active":"2024-09-17T01:48:42.965064+0000","last_peered":"2024-09-17T01:48:42.965064+0000","last_clean":"2024-09-17T01:48:42.965064+0000","last_became_active":"2024-09-17T01:48:40.962869+0000","last_became_peered":"2024-09-17T01:48:40.962869+0000","last_unstale":"2024-09-17T01:48:42.965064+0000","last_undegraded":"2024-09-17T01:48:42.965064+0000","last_fullsized":"2024-09-17T01:48:42.965064+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:31.161425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965805+0000","last_change":"2024-09-17T01:48:41.961510+0000","last_active":"2024-09-17T01:48:42.965805+0000","last_peered":"2024-09-17T01:48:42.965805+0000","last_clean":"2024-09-17T01:48:42.965805+0000","last_became_active":"2024-09-17T01:48:41.961149+0000","last_became_peered":"2024-09-17T01:48:41.961149+0000","last_unstale":"2024-09-17T01:48:42.965805+0000","last_undegraded":"2024-09-17T01:48:42.965805+0000","last_fullsized":"2024-09-17T01:48:42.965805+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:42.543461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.18","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.460990+0000","last_change":"2024-09-17T01:48:40.960363+0000","last_active":"2024-09-17T01:48:44.460990+0000","last_peered":"2024-09-17T01:48:44.460990+0000","last_clean":"2024-09-17T01:48:44.460990+0000","last_became_active":"2024-09-17T01:48:40.960030+0000","last_became_peered":"2024-09-17T01:48:40.960030+0000","last_unstale":"2024-09-17T01:48:44.460990+0000","last_undegraded":"2024-09-17T01:48:44.460990+0000","last_fullsized":"2024-09-17T01:48:44.460990+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:39.323864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967273+0000","last_change":"2024-09-17T01:48:41.960180+0000","last_active":"2024-09-17T01:48:42.967273+0000","last_peered":"2024-09-17T01:48:42.967273+0000","last_clean":"2024-09-17T01:48:42.967273+0000","last_became_active":"2024-09-17T01:48:41.959822+0000","last_became_peered":"2024-09-17T01:48:41.959822+0000","last_unstale":"2024-09-17T01:48:42.967273+0000","last_undegraded":"2024-09-17T01:48:42.967273+0000","last_fullsized":"2024-09-17T01:48:42.967273+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:15.702177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.17","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966259+0000","last_change":"2024-09-17T01:48:40.959777+0000","last_active":"2024-09-17T01:48:42.966259+0000","last_peered":"2024-09-17T01:48:42.966259+0000","last_clean":"2024-09-17T01:48:42.966259+0000","last_became_active":"2024-09-17T01:48:40.959450+0000","last_became_peered":"2024-09-17T01:48:40.959450+0000","last_unstale":"2024-09-17T01:48:42.966259+0000","last_undegraded":"2024-09-17T01:48:42.966259+0000","last_fullsized":"2024-09-17T01:48:42.966259+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:07.992373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462212+0000","last_change":"2024-09-17T01:48:41.966187+0000","last_active":"2024-09-17T01:48:44.462212+0000","last_peered":"2024-09-17T01:48:44.462212+0000","last_clean":"2024-09-17T01:48:44.462212+0000","last_became_active":"2024-09-17T01:48:41.965878+0000","last_became_peered":"2024-09-17T01:48:41.965878+0000","last_unstale":"2024-09-17T01:48:44.462212+0000","last_undegraded":"2024-09-17T01:48:44.462212+0000","last_fullsized":"2024-09-17T01:48:44.462212+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:24.225979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.16","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967188+0000","last_change":"2024-09-17T01:48:40.960473+0000","last_active":"2024-09-17T01:48:42.967188+0000","last_peered":"2024-09-17T01:48:42.967188+0000","last_clean":"2024-09-17T01:48:42.967188+0000","last_became_active":"2024-09-17T01:48:40.960115+0000","last_became_peered":"2024-09-17T01:48:40.960115+0000","last_unstale":"2024-09-17T01:48:42.967188+0000","last_undegraded":"2024-09-17T01:48:42.967188+0000","last_fullsized":"2024-09-17T01:48:42.967188+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:06:29.569198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.14","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.460898+0000","last_change":"2024-09-17T01:48:41.990381+0000","last_active":"2024-09-17T01:48:44.460898+0000","last_peered":"2024-09-17T01:48:44.460898+0000","last_clean":"2024-09-17T01:48:44.460898+0000","last_became_active":"2024-09-17T01:48:41.989915+0000","last_became_peered":"2024-09-17T01:48:41.989915+0000","last_unstale":"2024-09-17T01:48:44.460898+0000","last_undegraded":"2024-09-17T01:48:44.460898+0000","last_fullsized":"2024-09-17T01:48:44.460898+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:42.776672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.15","version":"212'3","reported_seq":18,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461220+0000","last_change":"2024-09-17T01:48:40.960038+0000","last_active":"2024-09-17T01:48:44.461220+0000","last_peered":"2024-09-17T01:48:44.461220+0000","last_clean":"2024-09-17T01:48:44.461220+0000","last_became_active":"2024-09-17T01:48:40.959680+0000","last_became_peered":"2024-09-17T01:48:40.959680+0000","last_unstale":"2024-09-17T01:48:44.461220+0000","last_undegraded":"2024-09-17T01:48:44.461220+0000","last_fullsized":"2024-09-17T01:48:44.461220+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:11.499994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.15","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964632+0000","last_change":"2024-09-17T01:48:41.958372+0000","last_active":"2024-09-17T01:48:42.964632+0000","last_peered":"2024-09-17T01:48:42.964632+0000","last_clean":"2024-09-17T01:48:42.964632+0000","last_became_active":"2024-09-17T01:48:41.958067+0000","last_became_peered":"2024-09-17T01:48:41.958067+0000","last_unstale":"2024-09-17T01:48:42.964632+0000","last_undegraded":"2024-09-17T01:48:42.964632+0000","last_fullsized":"2024-09-17T01:48:42.964632+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:02.967349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.14","version":"212'6","reported_seq":21,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450276+0000","last_change":"2024-09-17T01:48:40.969037+0000","last_active":"2024-09-17T01:48:43.450276+0000","last_peered":"2024-09-17T01:48:43.450276+0000","last_clean":"2024-09-17T01:48:43.450276+0000","last_became_active":"2024-09-17T01:48:40.968663+0000","last_became_peered":"2024-09-17T01:48:40.968663+0000","last_unstale":"2024-09-17T01:48:43.450276+0000","last_undegraded":"2024-09-17T01:48:43.450276+0000","last_fullsized":"2024-09-17T01:48:43.450276+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:36.157770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965788+0000","last_change":"2024-09-17T01:48:41.974194+0000","last_active":"2024-09-17T01:48:42.965788+0000","last_peered":"2024-09-17T01:48:42.965788+0000","last_clean":"2024-09-17T01:48:42.965788+0000","last_became_active":"2024-09-17T01:48:41.972690+0000","last_became_peered":"2024-09-17T01:48:41.972690+0000","last_unstale":"2024-09-17T01:48:42.965788+0000","last_undegraded":"2024-09-17T01:48:42.965788+0000","last_fullsized":"2024-09-17T01:48:42.965788+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:53.619025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.13","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450234+0000","last_change":"2024-09-17T01:48:40.964396+0000","last_active":"2024-09-17T01:48:43.450234+0000","last_peered":"2024-09-17T01:48:43.450234+0000","last_clean":"2024-09-17T01:48:43.450234+0000","last_became_active":"2024-09-17T01:48:40.964058+0000","last_became_peered":"2024-09-17T01:48:40.964058+0000","last_unstale":"2024-09-17T01:48:43.450234+0000","last_undegraded":"2024-09-17T01:48:43.450234+0000","last_fullsized":"2024-09-17T01:48:43.450234+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:43.677360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.13","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959516+0000","last_change":"2024-09-17T01:48:41.962451+0000","last_active":"2024-09-17T01:48:43.959516+0000","last_peered":"2024-09-17T01:48:43.959516+0000","last_clean":"2024-09-17T01:48:43.959516+0000","last_became_active":"2024-09-17T01:48:41.962113+0000","last_became_peered":"2024-09-17T01:48:41.962113+0000","last_unstale":"2024-09-17T01:48:43.959516+0000","last_undegraded":"2024-09-17T01:48:43.959516+0000","last_fullsized":"2024-09-17T01:48:43.959516+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:30.290603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.12","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966052+0000","last_change":"2024-09-17T01:48:40.958069+0000","last_active":"2024-09-17T01:48:42.966052+0000","last_peered":"2024-09-17T01:48:42.966052+0000","last_clean":"2024-09-17T01:48:42.966052+0000","last_became_active":"2024-09-17T01:48:40.956114+0000","last_became_peered":"2024-09-17T01:48:40.956114+0000","last_unstale":"2024-09-17T01:48:42.966052+0000","last_undegraded":"2024-09-17T01:48:42.966052+0000","last_fullsized":"2024-09-17T01:48:42.966052+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:25.002380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.10","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461069+0000","last_change":"2024-09-17T01:48:41.975846+0000","last_active":"2024-09-17T01:48:44.461069+0000","last_peered":"2024-09-17T01:48:44.461069+0000","last_clean":"2024-09-17T01:48:44.461069+0000","last_became_active":"2024-09-17T01:48:41.975443+0000","last_became_peered":"2024-09-17T01:48:41.975443+0000","last_unstale":"2024-09-17T01:48:44.461069+0000","last_undegraded":"2024-09-17T01:48:44.461069+0000","last_fullsized":"2024-09-17T01:48:44.461069+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:52:23.341819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.11","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965173+0000","last_change":"2024-09-17T01:48:40.962362+0000","last_active":"2024-09-17T01:48:42.965173+0000","last_peered":"2024-09-17T01:48:42.965173+0000","last_clean":"2024-09-17T01:48:42.965173+0000","last_became_active":"2024-09-17T01:48:40.961975+0000","last_became_peered":"2024-09-17T01:48:40.961975+0000","last_unstale":"2024-09-17T01:48:42.965173+0000","last_undegraded":"2024-09-17T01:48:42.965173+0000","last_fullsized":"2024-09-17T01:48:42.965173+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:17.865320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965577+0000","last_change":"2024-09-17T01:48:41.975201+0000","last_active":"2024-09-17T01:48:42.965577+0000","last_peered":"2024-09-17T01:48:42.965577+0000","last_clean":"2024-09-17T01:48:42.965577+0000","last_became_active":"2024-09-17T01:48:41.974581+0000","last_became_peered":"2024-09-17T01:48:41.974581+0000","last_unstale":"2024-09-17T01:48:42.965577+0000","last_undegraded":"2024-09-17T01:48:42.965577+0000","last_fullsized":"2024-09-17T01:48:42.965577+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:20.028457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.10","version":"212'8","reported_seq":23,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461314+0000","last_change":"2024-09-17T01:48:40.962920+0000","last_active":"2024-09-17T01:48:44.461314+0000","last_peered":"2024-09-17T01:48:44.461314+0000","last_clean":"2024-09-17T01:48:44.461314+0000","last_became_active":"2024-09-17T01:48:40.962230+0000","last_became_peered":"2024-09-17T01:48:40.962230+0000","last_unstale":"2024-09-17T01:48:44.461314+0000","last_undegraded":"2024-09-17T01:48:44.461314+0000","last_fullsized":"2024-09-17T01:48:44.461314+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:43.167939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.e","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.462192+0000","last_change":"2024-09-17T01:48:41.967242+0000","last_active":"2024-09-17T01:48:44.462192+0000","last_peered":"2024-09-17T01:48:44.462192+0000","last_clean":"2024-09-17T01:48:44.462192+0000","last_became_active":"2024-09-17T01:48:41.966892+0000","last_became_peered":"2024-09-17T01:48:41.966892+0000","last_unstale":"2024-09-17T01:48:44.462192+0000","last_undegraded":"2024-09-17T01:48:44.462192+0000","last_fullsized":"2024-09-17T01:48:44.462192+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:29.649430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.f","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966375+0000","last_change":"2024-09-17T01:48:40.958540+0000","last_active":"2024-09-17T01:48:42.966375+0000","last_peered":"2024-09-17T01:48:42.966375+0000","last_clean":"2024-09-17T01:48:42.966375+0000","last_became_active":"2024-09-17T01:48:40.958209+0000","last_became_peered":"2024-09-17T01:48:40.958209+0000","last_unstale":"2024-09-17T01:48:42.966375+0000","last_undegraded":"2024-09-17T01:48:42.966375+0000","last_fullsized":"2024-09-17T01:48:42.966375+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:02.660884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.f","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461532+0000","last_change":"2024-09-17T01:48:41.968961+0000","last_active":"2024-09-17T01:48:44.461532+0000","last_peered":"2024-09-17T01:48:44.461532+0000","last_clean":"2024-09-17T01:48:44.461532+0000","last_became_active":"2024-09-17T01:48:41.968609+0000","last_became_peered":"2024-09-17T01:48:41.968609+0000","last_unstale":"2024-09-17T01:48:44.461532+0000","last_undegraded":"2024-09-17T01:48:44.461532+0000","last_fullsized":"2024-09-17T01:48:44.461532+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:05.836222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"30.e","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967385+0000","last_change":"2024-09-17T01:48:40.958112+0000","last_active":"2024-09-17T01:48:42.967385+0000","last_peered":"2024-09-17T01:48:42.967385+0000","last_clean":"2024-09-17T01:48:42.967385+0000","last_became_active":"2024-09-17T01:48:40.957765+0000","last_became_peered":"2024-09-17T01:48:40.957765+0000","last_unstale":"2024-09-17T01:48:42.967385+0000","last_undegraded":"2024-09-17T01:48:42.967385+0000","last_fullsized":"2024-09-17T01:48:42.967385+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:33.429311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966144+0000","last_change":"2024-09-17T01:48:41.962826+0000","last_active":"2024-09-17T01:48:42.966144+0000","last_peered":"2024-09-17T01:48:42.966144+0000","last_clean":"2024-09-17T01:48:42.966144+0000","last_became_active":"2024-09-17T01:48:41.962494+0000","last_became_peered":"2024-09-17T01:48:41.962494+0000","last_unstale":"2024-09-17T01:48:42.966144+0000","last_undegraded":"2024-09-17T01:48:42.966144+0000","last_fullsized":"2024-09-17T01:48:42.966144+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:37.163100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.d","version":"212'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966115+0000","last_change":"2024-09-17T01:48:40.960604+0000","last_active":"2024-09-17T01:48:42.966115+0000","last_peered":"2024-09-17T01:48:42.966115+0000","last_clean":"2024-09-17T01:48:42.966115+0000","last_became_active":"2024-09-17T01:48:40.960047+0000","last_became_peered":"2024-09-17T01:48:40.960047+0000","last_unstale":"2024-09-17T01:48:42.966115+0000","last_undegraded":"2024-09-17T01:48:42.966115+0000","last_fullsized":"2024-09-17T01:48:42.966115+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:01.691297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.d","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393460+0000","last_change":"2024-09-17T01:48:41.961193+0000","last_active":"2024-09-17T01:48:43.393460+0000","last_peered":"2024-09-17T01:48:43.393460+0000","last_clean":"2024-09-17T01:48:43.393460+0000","last_became_active":"2024-09-17T01:48:41.960675+0000","last_became_peered":"2024-09-17T01:48:41.960675+0000","last_unstale":"2024-09-17T01:48:43.393460+0000","last_undegraded":"2024-09-17T01:48:43.393460+0000","last_fullsized":"2024-09-17T01:48:43.393460+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:45:20.974258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.c","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966870+0000","last_change":"2024-09-17T01:48:40.969612+0000","last_active":"2024-09-17T01:48:42.966870+0000","last_peered":"2024-09-17T01:48:42.966870+0000","last_clean":"2024-09-17T01:48:42.966870+0000","last_became_active":"2024-09-17T01:48:40.969131+0000","last_became_peered":"2024-09-17T01:48:40.969131+0000","last_unstale":"2024-09-17T01:48:42.966870+0000","last_undegraded":"2024-09-17T01:48:42.966870+0000","last_fullsized":"2024-09-17T01:48:42.966870+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:06.914057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959737+0000","last_change":"2024-09-17T01:48:41.980525+0000","last_active":"2024-09-17T01:48:43.959737+0000","last_peered":"2024-09-17T01:48:43.959737+0000","last_clean":"2024-09-17T01:48:43.959737+0000","last_became_active":"2024-09-17T01:48:41.979833+0000","last_became_peered":"2024-09-17T01:48:41.979833+0000","last_unstale":"2024-09-17T01:48:43.959737+0000","last_undegraded":"2024-09-17T01:48:43.959737+0000","last_fullsized":"2024-09-17T01:48:43.959737+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:03:32.301181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.b","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966523+0000","last_change":"2024-09-17T01:48:40.954645+0000","last_active":"2024-09-17T01:48:42.966523+0000","last_peered":"2024-09-17T01:48:42.966523+0000","last_clean":"2024-09-17T01:48:42.966523+0000","last_became_active":"2024-09-17T01:48:40.954314+0000","last_became_peered":"2024-09-17T01:48:40.954314+0000","last_unstale":"2024-09-17T01:48:42.966523+0000","last_undegraded":"2024-09-17T01:48:42.966523+0000","last_fullsized":"2024-09-17T01:48:42.966523+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:03.890846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.b","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966366+0000","last_change":"2024-09-17T01:48:41.962675+0000","last_active":"2024-09-17T01:48:42.966366+0000","last_peered":"2024-09-17T01:48:42.966366+0000","last_clean":"2024-09-17T01:48:42.966366+0000","last_became_active":"2024-09-17T01:48:41.960185+0000","last_became_peered":"2024-09-17T01:48:41.960185+0000","last_unstale":"2024-09-17T01:48:42.966366+0000","last_undegraded":"2024-09-17T01:48:42.966366+0000","last_fullsized":"2024-09-17T01:48:42.966366+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:53.273110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.a","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966188+0000","last_change":"2024-09-17T01:48:40.957409+0000","last_active":"2024-09-17T01:48:42.966188+0000","last_peered":"2024-09-17T01:48:42.966188+0000","last_clean":"2024-09-17T01:48:42.966188+0000","last_became_active":"2024-09-17T01:48:40.957076+0000","last_became_peered":"2024-09-17T01:48:40.957076+0000","last_unstale":"2024-09-17T01:48:42.966188+0000","last_undegraded":"2024-09-17T01:48:42.966188+0000","last_fullsized":"2024-09-17T01:48:42.966188+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:09.169291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.460832+0000","last_change":"2024-09-17T01:48:41.972315+0000","last_active":"2024-09-17T01:48:44.460832+0000","last_peered":"2024-09-17T01:48:44.460832+0000","last_clean":"2024-09-17T01:48:44.460832+0000","last_became_active":"2024-09-17T01:48:41.964814+0000","last_became_peered":"2024-09-17T01:48:41.964814+0000","last_unstale":"2024-09-17T01:48:44.460832+0000","last_undegraded":"2024-09-17T01:48:44.460832+0000","last_fullsized":"2024-09-17T01:48:44.460832+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:44.993483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.9","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393202+0000","last_change":"2024-09-17T01:48:40.960091+0000","last_active":"2024-09-17T01:48:43.393202+0000","last_peered":"2024-09-17T01:48:43.393202+0000","last_clean":"2024-09-17T01:48:43.393202+0000","last_became_active":"2024-09-17T01:48:40.959708+0000","last_became_peered":"2024-09-17T01:48:40.959708+0000","last_unstale":"2024-09-17T01:48:43.393202+0000","last_undegraded":"2024-09-17T01:48:43.393202+0000","last_fullsized":"2024-09-17T01:48:43.393202+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:14.069903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965102+0000","last_change":"2024-09-17T01:48:41.954668+0000","last_active":"2024-09-17T01:48:42.965102+0000","last_peered":"2024-09-17T01:48:42.965102+0000","last_clean":"2024-09-17T01:48:42.965102+0000","last_became_active":"2024-09-17T01:48:41.953453+0000","last_became_peered":"2024-09-17T01:48:41.953453+0000","last_unstale":"2024-09-17T01:48:42.965102+0000","last_undegraded":"2024-09-17T01:48:42.965102+0000","last_fullsized":"2024-09-17T01:48:42.965102+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:56.732819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.8","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393455+0000","last_change":"2024-09-17T01:48:40.954364+0000","last_active":"2024-09-17T01:48:43.393455+0000","last_peered":"2024-09-17T01:48:43.393455+0000","last_clean":"2024-09-17T01:48:43.393455+0000","last_became_active":"2024-09-17T01:48:40.952633+0000","last_became_peered":"2024-09-17T01:48:40.952633+0000","last_unstale":"2024-09-17T01:48:43.393455+0000","last_undegraded":"2024-09-17T01:48:43.393455+0000","last_fullsized":"2024-09-17T01:48:43.393455+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:14.968860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966306+0000","last_change":"2024-09-17T01:48:41.980321+0000","last_active":"2024-09-17T01:48:42.966306+0000","last_peered":"2024-09-17T01:48:42.966306+0000","last_clean":"2024-09-17T01:48:42.966306+0000","last_became_active":"2024-09-17T01:48:41.979988+0000","last_became_peered":"2024-09-17T01:48:41.979988+0000","last_unstale":"2024-09-17T01:48:42.966306+0000","last_undegraded":"2024-09-17T01:48:42.966306+0000","last_fullsized":"2024-09-17T01:48:42.966306+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:44.682690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"30.7","version":"212'2","reported_seq":17,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967542+0000","last_change":"2024-09-17T01:48:40.968513+0000","last_active":"2024-09-17T01:48:42.967542+0000","last_peered":"2024-09-17T01:48:42.967542+0000","last_clean":"2024-09-17T01:48:42.967542+0000","last_became_active":"2024-09-17T01:48:40.968147+0000","last_became_peered":"2024-09-17T01:48:40.968147+0000","last_unstale":"2024-09-17T01:48:42.967542+0000","last_undegraded":"2024-09-17T01:48:42.967542+0000","last_fullsized":"2024-09-17T01:48:42.967542+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:50.333573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.7","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450551+0000","last_change":"2024-09-17T01:48:41.995352+0000","last_active":"2024-09-17T01:48:43.450551+0000","last_peered":"2024-09-17T01:48:43.450551+0000","last_clean":"2024-09-17T01:48:43.450551+0000","last_became_active":"2024-09-17T01:48:41.995020+0000","last_became_peered":"2024-09-17T01:48:41.995020+0000","last_unstale":"2024-09-17T01:48:43.450551+0000","last_undegraded":"2024-09-17T01:48:43.450551+0000","last_fullsized":"2024-09-17T01:48:43.450551+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:15.035889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.6","version":"213'1","reported_seq":16,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959711+0000","last_change":"2024-09-17T01:48:40.967945+0000","last_active":"2024-09-17T01:48:43.959711+0000","last_peered":"2024-09-17T01:48:43.959711+0000","last_clean":"2024-09-17T01:48:43.959711+0000","last_became_active":"2024-09-17T01:48:40.967538+0000","last_became_peered":"2024-09-17T01:48:40.967538+0000","last_unstale":"2024-09-17T01:48:43.959711+0000","last_undegraded":"2024-09-17T01:48:43.959711+0000","last_fullsized":"2024-09-17T01:48:43.959711+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:03.999082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461879+0000","last_change":"2024-09-17T01:48:41.987120+0000","last_active":"2024-09-17T01:48:44.461879+0000","last_peered":"2024-09-17T01:48:44.461879+0000","last_clean":"2024-09-17T01:48:44.461879+0000","last_became_active":"2024-09-17T01:48:41.986788+0000","last_became_peered":"2024-09-17T01:48:41.986788+0000","last_unstale":"2024-09-17T01:48:44.461879+0000","last_undegraded":"2024-09-17T01:48:44.461879+0000","last_fullsized":"2024-09-17T01:48:44.461879+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:45.285758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"30.5","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964804+0000","last_change":"2024-09-17T01:48:40.964922+0000","last_active":"2024-09-17T01:48:42.964804+0000","last_peered":"2024-09-17T01:48:42.964804+0000","last_clean":"2024-09-17T01:48:42.964804+0000","last_became_active":"2024-09-17T01:48:40.964564+0000","last_became_peered":"2024-09-17T01:48:40.964564+0000","last_unstale":"2024-09-17T01:48:42.964804+0000","last_undegraded":"2024-09-17T01:48:42.964804+0000","last_fullsized":"2024-09-17T01:48:42.964804+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:17.144236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.966915+0000","last_change":"2024-09-17T01:48:41.983739+0000","last_active":"2024-09-17T01:48:42.966915+0000","last_peered":"2024-09-17T01:48:42.966915+0000","last_clean":"2024-09-17T01:48:42.966915+0000","last_became_active":"2024-09-17T01:48:41.983417+0000","last_became_peered":"2024-09-17T01:48:41.983417+0000","last_unstale":"2024-09-17T01:48:42.966915+0000","last_undegraded":"2024-09-17T01:48:42.966915+0000","last_fullsized":"2024-09-17T01:48:42.966915+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:25.410155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"30.4","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.967262+0000","last_change":"2024-09-17T01:48:40.961630+0000","last_active":"2024-09-17T01:48:42.967262+0000","last_peered":"2024-09-17T01:48:42.967262+0000","last_clean":"2024-09-17T01:48:42.967262+0000","last_became_active":"2024-09-17T01:48:40.960243+0000","last_became_peered":"2024-09-17T01:48:40.960243+0000","last_unstale":"2024-09-17T01:48:42.967262+0000","last_undegraded":"2024-09-17T01:48:42.967262+0000","last_fullsized":"2024-09-17T01:48:42.967262+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:02.136066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.959855+0000","last_change":"2024-09-17T01:48:41.965904+0000","last_active":"2024-09-17T01:48:43.959855+0000","last_peered":"2024-09-17T01:48:43.959855+0000","last_clean":"2024-09-17T01:48:43.959855+0000","last_became_active":"2024-09-17T01:48:41.965593+0000","last_became_peered":"2024-09-17T01:48:41.965593+0000","last_unstale":"2024-09-17T01:48:43.959855+0000","last_undegraded":"2024-09-17T01:48:43.959855+0000","last_fullsized":"2024-09-17T01:48:43.959855+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:33.950142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"30.3","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.965967+0000","last_change":"2024-09-17T01:48:40.956231+0000","last_active":"2024-09-17T01:48:42.965967+0000","last_peered":"2024-09-17T01:48:42.965967+0000","last_clean":"2024-09-17T01:48:42.965967+0000","last_became_active":"2024-09-17T01:48:40.955414+0000","last_became_peered":"2024-09-17T01:48:40.955414+0000","last_unstale":"2024-09-17T01:48:42.965967+0000","last_undegraded":"2024-09-17T01:48:42.965967+0000","last_fullsized":"2024-09-17T01:48:42.965967+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:39.323864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964920+0000","last_change":"2024-09-17T01:48:41.968153+0000","last_active":"2024-09-17T01:48:42.964920+0000","last_peered":"2024-09-17T01:48:42.964920+0000","last_clean":"2024-09-17T01:48:42.964920+0000","last_became_active":"2024-09-17T01:48:41.967605+0000","last_became_peered":"2024-09-17T01:48:41.967605+0000","last_unstale":"2024-09-17T01:48:42.964920+0000","last_undegraded":"2024-09-17T01:48:42.964920+0000","last_fullsized":"2024-09-17T01:48:42.964920+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:16.656430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"30.2","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461708+0000","last_change":"2024-09-17T01:48:40.961888+0000","last_active":"2024-09-17T01:48:44.461708+0000","last_peered":"2024-09-17T01:48:44.461708+0000","last_clean":"2024-09-17T01:48:44.461708+0000","last_became_active":"2024-09-17T01:48:40.960057+0000","last_became_peered":"2024-09-17T01:48:40.960057+0000","last_unstale":"2024-09-17T01:48:44.461708+0000","last_undegraded":"2024-09-17T01:48:44.461708+0000","last_fullsized":"2024-09-17T01:48:44.461708+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:01.691297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393545+0000","last_change":"2024-09-17T01:48:41.964119+0000","last_active":"2024-09-17T01:48:43.393545+0000","last_peered":"2024-09-17T01:48:43.393545+0000","last_clean":"2024-09-17T01:48:43.393545+0000","last_became_active":"2024-09-17T01:48:41.963688+0000","last_became_peered":"2024-09-17T01:48:41.963688+0000","last_unstale":"2024-09-17T01:48:43.393545+0000","last_undegraded":"2024-09-17T01:48:43.393545+0000","last_fullsized":"2024-09-17T01:48:43.393545+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:26:24.176532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.1","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.449918+0000","last_change":"2024-09-17T01:48:40.970410+0000","last_active":"2024-09-17T01:48:43.449918+0000","last_peered":"2024-09-17T01:48:43.449918+0000","last_clean":"2024-09-17T01:48:43.449918+0000","last_became_active":"2024-09-17T01:48:40.969725+0000","last_became_peered":"2024-09-17T01:48:40.969725+0000","last_unstale":"2024-09-17T01:48:43.449918+0000","last_undegraded":"2024-09-17T01:48:43.449918+0000","last_fullsized":"2024-09-17T01:48:43.449918+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:59.674013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450122+0000","last_change":"2024-09-17T01:48:41.987710+0000","last_active":"2024-09-17T01:48:43.450122+0000","last_peered":"2024-09-17T01:48:43.450122+0000","last_clean":"2024-09-17T01:48:43.450122+0000","last_became_active":"2024-09-17T01:48:41.983328+0000","last_became_peered":"2024-09-17T01:48:41.983328+0000","last_unstale":"2024-09-17T01:48:43.450122+0000","last_undegraded":"2024-09-17T01:48:43.450122+0000","last_fullsized":"2024-09-17T01:48:43.450122+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:19.736187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"30.0","version":"0'0","reported_seq":15,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:44.461323+0000","last_change":"2024-09-17T01:48:40.963242+0000","last_active":"2024-09-17T01:48:44.461323+0000","last_peered":"2024-09-17T01:48:44.461323+0000","last_clean":"2024-09-17T01:48:44.461323+0000","last_became_active":"2024-09-17T01:48:40.962603+0000","last_became_peered":"2024-09-17T01:48:40.962603+0000","last_unstale":"2024-09-17T01:48:44.461323+0000","last_undegraded":"2024-09-17T01:48:44.461323+0000","last_fullsized":"2024-09-17T01:48:44.461323+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:04:09.145533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1e","version":"0'0","reported_seq":13,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.393421+0000","last_change":"2024-09-17T01:48:41.959892+0000","last_active":"2024-09-17T01:48:43.393421+0000","last_peered":"2024-09-17T01:48:43.393421+0000","last_clean":"2024-09-17T01:48:43.393421+0000","last_became_active":"2024-09-17T01:48:41.959602+0000","last_became_peered":"2024-09-17T01:48:41.959602+0000","last_unstale":"2024-09-17T01:48:43.393421+0000","last_undegraded":"2024-09-17T01:48:43.393421+0000","last_fullsized":"2024-09-17T01:48:43.393421+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:40.932243+0000","last_clean_scrub_stamp":"2024-09-17T01:48:40.932243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:20.244068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"30.1f","version":"212'4","reported_seq":19,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:43.450730+0000","last_change":"2024-09-17T01:48:40.970365+0000","last_active":"2024-09-17T01:48:43.450730+0000","last_peered":"2024-09-17T01:48:43.450730+0000","last_clean":"2024-09-17T01:48:43.450730+0000","last_became_active":"2024-09-17T01:48:40.969386+0000","last_became_peered":"2024-09-17T01:48:40.969386+0000","last_unstale":"2024-09-17T01:48:43.450730+0000","last_undegraded":"2024-09-17T01:48:43.450730+0000","last_fullsized":"2024-09-17T01:48:43.450730+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:48:39.926912+0000","last_clean_scrub_stamp":"2024-09-17T01:48:39.926912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:05.396682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":478,"reported_epoch":213,"state":"active+clean","last_fresh":"2024-09-17T01:48:42.964191+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:48:42.964191+0000","last_peered":"2024-09-17T01:48:42.964191+0000","last_clean":"2024-09-17T01:48:42.964191+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:48:42.964191+0000","last_undegraded":"2024-09-17T01:48:42.964191+0000","last_fullsized":"2024-09-17T01:48:42.964191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":31,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":30,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476943,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47700,"kb_used_data":2624,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324140,"statfs":{"total":96636764160,"available":96587919360,"internally_reserved":0,"allocated":2686976,"data_stored":1189000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509646,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56036,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315804,"statfs":{"total":96636764160,"available":96579383296,"internally_reserved":0,"allocated":2703360,"data_stored":1191158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509645,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47704,"kb_used_data":2624,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324136,"statfs":{"total":96636764160,"available":96587915264,"internally_reserved":0,"allocated":2686976,"data_stored":1189020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509646,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51860,"kb_used_data":2624,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319980,"statfs":{"total":96636764160,"available":96583659520,"internally_reserved":0,"allocated":2686976,"data_stored":1188952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509646,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69852,"kb_used_data":2632,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94301988,"statfs":{"total":96636764160,"available":96565235712,"internally_reserved":0,"allocated":2695168,"data_stored":1190542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509645,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52440,"kb_used_data":3204,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319400,"statfs":{"total":96636764160,"available":96583065600,"internally_reserved":0,"allocated":3280896,"data_stored":1779880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509647,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60184,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311656,"statfs":{"total":96636764160,"available":96575135744,"internally_reserved":0,"allocated":2691072,"data_stored":1189022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":58915273},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542351,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52444,"kb_used_data":3208,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319396,"statfs":{"total":96636764160,"available":96583061504,"internally_reserved":0,"allocated":3284992,"data_stored":1779422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":30,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:48:51.970 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T01:48:51.971 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T01:48:52.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.247+0000 7f5513c00640 1 -- 172.21.15.42:0/401768496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54f4003c30 msgr2=0x7f54f4004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:52.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.247+0000 7f5513c00640 1 --2- 172.21.15.42:0/401768496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54f4003c30 0x7f54f4004080 secure :-1 s=READY pgs=2436 cs=0 l=1 rev1=1 crypto rx=0x7f5500009b20 tx=0x7f54f4005830 comp rx=0 tx=0).stop 2024-09-17T01:48:52.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.247+0000 7f5513c00640 1 -- 172.21.15.42:0/401768496 shutdown_connections 2024-09-17T01:48:52.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.247+0000 7f5513c00640 1 --2- 172.21.15.42:0/401768496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54f4003c30 0x7f54f4004080 unknown :-1 s=CLOSED pgs=2436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:52.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.247+0000 7f5513c00640 1 -- 172.21.15.42:0/401768496 >> 172.21.15.42:0/401768496 conn(0x7f550c06d1b0 msgr2=0x7f550c06d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:52.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.247+0000 7f5513c00640 1 -- 172.21.15.42:0/401768496 shutdown_connections 2024-09-17T01:48:52.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.247+0000 7f5513c00640 1 -- 172.21.15.42:0/401768496 wait complete. 2024-09-17T01:48:52.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.249+0000 7f5513c00640 1 Processor -- start 2024-09-17T01:48:52.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.249+0000 7f5513c00640 1 -- start start 2024-09-17T01:48:52.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.251+0000 7f5513c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f54f4003c30 0x7f550c1f63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:52.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.251+0000 7f5513c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f550c0b52f0 0x7f550c1f8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:52.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.251+0000 7f5513c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f550c0b3e30 0x7f550c0b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:52.250 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.251+0000 7f5513c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f550c160ba0 con 0x7f550c0b52f0 2024-09-17T01:48:52.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.251+0000 7f5513c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f550c072fe0 con 0x7f550c0b3e30 2024-09-17T01:48:52.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.251+0000 7f5513c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f550c160d20 con 0x7f54f4003c30 2024-09-17T01:48:52.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.251+0000 7f550be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f550c0b52f0 0x7f550c1f8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:52.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.251+0000 7f550be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f550c0b52f0 0x7f550c1f8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45834/0 (socket says 172.21.15.42:45834) 2024-09-17T01:48:52.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.251+0000 7f550be00640 1 -- 172.21.15.42:0/2817156458 learned_addr learned my addr 172.21.15.42:0/2817156458 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:52.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.251+0000 7f5511200640 1 --2- 172.21.15.42:0/2817156458 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f54f4003c30 0x7f550c1f63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:52.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.251+0000 7f5511c00640 1 --2- 172.21.15.42:0/2817156458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f550c0b3e30 0x7f550c0b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:52.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.251+0000 7f550be00640 1 -- 172.21.15.42:0/2817156458 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f54f4003c30 msgr2=0x7f550c1f63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:52.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.251+0000 7f550be00640 1 --2- 172.21.15.42:0/2817156458 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f54f4003c30 0x7f550c1f63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:52.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.251+0000 7f550be00640 1 -- 172.21.15.42:0/2817156458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f550c0b3e30 msgr2=0x7f550c0b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:52.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.251+0000 7f550be00640 1 --2- 172.21.15.42:0/2817156458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f550c0b3e30 0x7f550c0b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:52.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.251+0000 7f550be00640 1 -- 172.21.15.42:0/2817156458 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f550c1f9990 con 0x7f550c0b52f0 2024-09-17T01:48:52.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.251+0000 7f5511c00640 1 --2- 172.21.15.42:0/2817156458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f550c0b3e30 0x7f550c0b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:52.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.252+0000 7f550be00640 1 --2- 172.21.15.42:0/2817156458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f550c0b52f0 0x7f550c1f8db0 secure :-1 s=READY pgs=2437 cs=0 l=1 rev1=1 crypto rx=0x7f54f8004c70 tx=0x7f54f8001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:52.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.252+0000 7f5508c00640 1 -- 172.21.15.42:0/2817156458 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f8015020 con 0x7f550c0b52f0 2024-09-17T01:48:52.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.252+0000 7f5508c00640 1 -- 172.21.15.42:0/2817156458 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54f8011960 con 0x7f550c0b52f0 2024-09-17T01:48:52.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.252+0000 7f5508c00640 1 -- 172.21.15.42:0/2817156458 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f8011d90 con 0x7f550c0b52f0 2024-09-17T01:48:52.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.252+0000 7f5513c00640 1 -- 172.21.15.42:0/2817156458 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f550c1f9c70 con 0x7f550c0b52f0 2024-09-17T01:48:52.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.252+0000 7f5513c00640 1 -- 172.21.15.42:0/2817156458 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f550c1f5bb0 con 0x7f550c0b52f0 2024-09-17T01:48:52.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.253+0000 7f5513c00640 1 -- 172.21.15.42:0/2817156458 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f550c0cd620 con 0x7f550c0b52f0 2024-09-17T01:48:52.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.254+0000 7f5508c00640 1 -- 172.21.15.42:0/2817156458 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f54f8018020 con 0x7f550c0b52f0 2024-09-17T01:48:52.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.255+0000 7f5508c00640 1 --2- 172.21.15.42:0/2817156458 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f54ec078b90 0x7f54ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:52.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.255+0000 7f5508c00640 1 -- 172.21.15.42:0/2817156458 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5912+0+0 (secure 0 0 0) 0x7f54f809b8d0 con 0x7f550c0b52f0 2024-09-17T01:48:52.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.256+0000 7f5511200640 1 --2- 172.21.15.42:0/2817156458 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f54ec078b90 0x7f54ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:52.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.257+0000 7f5511200640 1 --2- 172.21.15.42:0/2817156458 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f54ec078b90 0x7f54ec07b0a0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f5500035000 tx=0x7f55000046c0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:52.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.260+0000 7f5508c00640 1 -- 172.21.15.42:0/2817156458 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f54f801f020 con 0x7f550c0b52f0 2024-09-17T01:48:52.362 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:48:52.366 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:48:52.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.528+0000 7f5513c00640 1 -- 172.21.15.42:0/2817156458 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f550c1e85e0 con 0x7f550c0b52f0 2024-09-17T01:48:52.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.531+0000 7f5508c00640 1 -- 172.21.15.42:0/2817156458 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v45) ==== 190+0+147 (secure 0 0 0) 0x7f54f8063ba0 con 0x7f550c0b52f0 2024-09-17T01:48:52.529 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-09-17T01:48:52.529 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA== 2024-09-17T01:48:52.529 INFO:teuthology.orchestra.run.smithi042.stdout: caps mds = "allow" 2024-09-17T01:48:52.529 INFO:teuthology.orchestra.run.smithi042.stdout: caps mon = "allow r" 2024-09-17T01:48:52.529 INFO:teuthology.orchestra.run.smithi042.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T01:48:52.530 INFO:teuthology.orchestra.run.smithi042.stderr:updated caps for client.0 2024-09-17T01:48:52.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.533+0000 7f5513c00640 1 -- 172.21.15.42:0/2817156458 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f54ec078b90 msgr2=0x7f54ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:52.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.533+0000 7f5513c00640 1 --2- 172.21.15.42:0/2817156458 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f54ec078b90 0x7f54ec07b0a0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f5500035000 tx=0x7f55000046c0 comp rx=0 tx=0).stop 2024-09-17T01:48:52.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.533+0000 7f5513c00640 1 -- 172.21.15.42:0/2817156458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f550c0b52f0 msgr2=0x7f550c1f8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:52.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.533+0000 7f5513c00640 1 --2- 172.21.15.42:0/2817156458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f550c0b52f0 0x7f550c1f8db0 secure :-1 s=READY pgs=2437 cs=0 l=1 rev1=1 crypto rx=0x7f54f8004c70 tx=0x7f54f8001800 comp rx=0 tx=0).stop 2024-09-17T01:48:52.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.534+0000 7f5513c00640 1 -- 172.21.15.42:0/2817156458 shutdown_connections 2024-09-17T01:48:52.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.534+0000 7f5513c00640 1 --2- 172.21.15.42:0/2817156458 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f54ec078b90 0x7f54ec07b0a0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:52.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.534+0000 7f5513c00640 1 --2- 172.21.15.42:0/2817156458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f550c0b3e30 0x7f550c0b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:52.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.534+0000 7f5513c00640 1 --2- 172.21.15.42:0/2817156458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f550c0b52f0 0x7f550c1f8db0 unknown :-1 s=CLOSED pgs=2437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:52.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.534+0000 7f5513c00640 1 --2- 172.21.15.42:0/2817156458 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f54f4003c30 0x7f550c1f63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:52.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.534+0000 7f5513c00640 1 -- 172.21.15.42:0/2817156458 >> 172.21.15.42:0/2817156458 conn(0x7f550c06d1b0 msgr2=0x7f550c144ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:52.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.534+0000 7f5513c00640 1 -- 172.21.15.42:0/2817156458 shutdown_connections 2024-09-17T01:48:52.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.534+0000 7f5513c00640 1 -- 172.21.15.42:0/2817156458 wait complete. 2024-09-17T01:48:52.554 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:48:52.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.783+0000 7f4cfcc00640 1 -- 172.21.15.42:0/4146710862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cf806f930 msgr2=0x7f4cf80cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:52.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.783+0000 7f4cfcc00640 1 --2- 172.21.15.42:0/4146710862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cf806f930 0x7f4cf80cf480 secure :-1 s=READY pgs=2439 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0009830 tx=0x7f4ce002a5b0 comp rx=0 tx=0).stop 2024-09-17T01:48:52.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.783+0000 7f4cfcc00640 1 -- 172.21.15.42:0/4146710862 shutdown_connections 2024-09-17T01:48:52.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.783+0000 7f4cfcc00640 1 --2- 172.21.15.42:0/4146710862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cf806f930 0x7f4cf80cf480 unknown :-1 s=CLOSED pgs=2439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:52.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.783+0000 7f4cfcc00640 1 -- 172.21.15.42:0/4146710862 >> 172.21.15.42:0/4146710862 conn(0x7f4cf806d3f0 msgr2=0x7f4cf80b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:52.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.783+0000 7f4cfcc00640 1 -- 172.21.15.42:0/4146710862 shutdown_connections 2024-09-17T01:48:52.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.783+0000 7f4cfcc00640 1 -- 172.21.15.42:0/4146710862 wait complete. 2024-09-17T01:48:52.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.785+0000 7f4cfcc00640 1 Processor -- start 2024-09-17T01:48:52.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.785+0000 7f4cfcc00640 1 -- start start 2024-09-17T01:48:52.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.787+0000 7f4cfcc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cf806f930 0x7f4cf8151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:52.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.787+0000 7f4cfcc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4cf80cf9c0 0x7f4cf8148900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:52.787 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.787+0000 7f4cfcc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cf815c9c0 0x7f4cf815f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:52.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.787+0000 7f4cfcc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf80b4890 con 0x7f4cf815c9c0 2024-09-17T01:48:52.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.787+0000 7f4cfcc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf80b4710 con 0x7f4cf806f930 2024-09-17T01:48:52.788 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.787+0000 7f4cfcc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf80b4a10 con 0x7f4cf80cf9c0 2024-09-17T01:48:52.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.787+0000 7f4cf7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cf815c9c0 0x7f4cf815f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:52.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.787+0000 7f4cf7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cf815c9c0 0x7f4cf815f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45842/0 (socket says 172.21.15.42:45842) 2024-09-17T01:48:52.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.787+0000 7f4cf7e00640 1 -- 172.21.15.42:0/2217571040 learned_addr learned my addr 172.21.15.42:0/2217571040 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:52.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.787+0000 7f4cf7400640 1 --2- 172.21.15.42:0/2217571040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cf806f930 0x7f4cf8151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.787+0000 7f4cefe00640 1 --2- 172.21.15.42:0/2217571040 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4cf80cf9c0 0x7f4cf8148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.788+0000 7f4cf7e00640 1 -- 172.21.15.42:0/2217571040 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4cf80cf9c0 msgr2=0x7f4cf8148900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.788+0000 7f4cf7e00640 1 --2- 172.21.15.42:0/2217571040 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4cf80cf9c0 0x7f4cf8148900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.788+0000 7f4cf7e00640 1 -- 172.21.15.42:0/2217571040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cf806f930 msgr2=0x7f4cf8151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.788+0000 7f4cf7e00640 1 --2- 172.21.15.42:0/2217571040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cf806f930 0x7f4cf8151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.788+0000 7f4cf7e00640 1 -- 172.21.15.42:0/2217571040 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf80ac610 con 0x7f4cf815c9c0 2024-09-17T01:48:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.788+0000 7f4cf7400640 1 --2- 172.21.15.42:0/2217571040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cf806f930 0x7f4cf8151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.788+0000 7f4cf7e00640 1 --2- 172.21.15.42:0/2217571040 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cf815c9c0 0x7f4cf815f090 secure :-1 s=READY pgs=2440 cs=0 l=1 rev1=1 crypto rx=0x7f4cf000cae0 tx=0x7f4cf000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.788+0000 7f4cef400640 1 -- 172.21.15.42:0/2217571040 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0016020 con 0x7f4cf815c9c0 2024-09-17T01:48:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.788+0000 7f4cef400640 1 -- 172.21.15.42:0/2217571040 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cf000ad30 con 0x7f4cf815c9c0 2024-09-17T01:48:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.788+0000 7f4cfcc00640 1 -- 172.21.15.42:0/2217571040 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf8148e40 con 0x7f4cf815c9c0 2024-09-17T01:48:52.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.788+0000 7f4cef400640 1 -- 172.21.15.42:0/2217571040 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0012680 con 0x7f4cf815c9c0 2024-09-17T01:48:52.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.788+0000 7f4cfcc00640 1 -- 172.21.15.42:0/2217571040 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cf80acbd0 con 0x7f4cf815c9c0 2024-09-17T01:48:52.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.790+0000 7f4cfcc00640 1 -- 172.21.15.42:0/2217571040 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cf80cf480 con 0x7f4cf815c9c0 2024-09-17T01:48:52.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.791+0000 7f4cef400640 1 -- 172.21.15.42:0/2217571040 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4cf0019020 con 0x7f4cf815c9c0 2024-09-17T01:48:52.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.792+0000 7f4cef400640 1 --2- 172.21.15.42:0/2217571040 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4cd4078b90 0x7f4cd407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:52.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.792+0000 7f4cef400640 1 -- 172.21.15.42:0/2217571040 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 5912+0+0 (secure 0 0 0) 0x7f4cf009b530 con 0x7f4cf815c9c0 2024-09-17T01:48:52.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.792+0000 7f4cf7400640 1 --2- 172.21.15.42:0/2217571040 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4cd4078b90 0x7f4cd407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:52.793 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.793+0000 7f4cf7400640 1 --2- 172.21.15.42:0/2217571040 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4cd4078b90 0x7f4cd407b0a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8007fd0 tx=0x7f4ce8009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:52.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:52.796+0000 7f4cef400640 1 -- 172.21.15.42:0/2217571040 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4cf0020020 con 0x7f4cf815c9c0 2024-09-17T01:48:53.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.033+0000 7f4cfcc00640 1 -- 172.21.15.42:0/2217571040 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4cf80b4e70 con 0x7f4cf815c9c0 2024-09-17T01:48:53.032 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.034+0000 7f4cef400640 1 -- 172.21.15.42:0/2217571040 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 168 v168) ==== 95+0+5238 (secure 0 0 0) 0x7f4cf0063800 con 0x7f4cf815c9c0 2024-09-17T01:48:53.032 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:48:53.032 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":168,"btime":"2024-09-17T01:48:44:968283+0000","default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/2828763381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2828763381},{"type":"v1","addr":"172.21.15.42:6834","nonce":2828763381}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":162},{"gid":10357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2652584517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2652584517},{"type":"v1","addr":"172.21.15.43:6837","nonce":2652584517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":163},{"gid":11190,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3512646002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3512646002},{"type":"v1","addr":"172.21.15.42:6835","nonce":3512646002}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":163}],"filesystems":[{"mdsmap":{"epoch":168,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:48:41.459234+0000","modified":"2024-09-17T01:48:44.478983+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11193":{"gid":11193,"name":"b","rank":0,"incarnation":164,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6836/777529944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":777529944},{"type":"v1","addr":"172.21.15.43:6836","nonce":777529944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11193,"qdb_cluster":[11193]},"id":15}]} 2024-09-17T01:48:53.033 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 168 2024-09-17T01:48:53.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.036+0000 7f4cfcc00640 1 -- 172.21.15.42:0/2217571040 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4cd4078b90 msgr2=0x7f4cd407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:53.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.036+0000 7f4cfcc00640 1 --2- 172.21.15.42:0/2217571040 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4cd4078b90 0x7f4cd407b0a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8007fd0 tx=0x7f4ce8009040 comp rx=0 tx=0).stop 2024-09-17T01:48:53.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.036+0000 7f4cfcc00640 1 -- 172.21.15.42:0/2217571040 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cf815c9c0 msgr2=0x7f4cf815f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:53.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.036+0000 7f4cfcc00640 1 --2- 172.21.15.42:0/2217571040 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cf815c9c0 0x7f4cf815f090 secure :-1 s=READY pgs=2440 cs=0 l=1 rev1=1 crypto rx=0x7f4cf000cae0 tx=0x7f4cf000a060 comp rx=0 tx=0).stop 2024-09-17T01:48:53.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.037+0000 7f4cfcc00640 1 -- 172.21.15.42:0/2217571040 shutdown_connections 2024-09-17T01:48:53.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.037+0000 7f4cfcc00640 1 --2- 172.21.15.42:0/2217571040 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4cd4078b90 0x7f4cd407b0a0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.037+0000 7f4cfcc00640 1 --2- 172.21.15.42:0/2217571040 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4cf815c9c0 0x7f4cf815f090 unknown :-1 s=CLOSED pgs=2440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.037+0000 7f4cfcc00640 1 --2- 172.21.15.42:0/2217571040 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4cf80cf9c0 0x7f4cf8148900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.037+0000 7f4cfcc00640 1 --2- 172.21.15.42:0/2217571040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cf806f930 0x7f4cf8151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.037+0000 7f4cfcc00640 1 -- 172.21.15.42:0/2217571040 >> 172.21.15.42:0/2217571040 conn(0x7f4cf806d3f0 msgr2=0x7f4cf80b3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:53.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.037+0000 7f4cfcc00640 1 -- 172.21.15.42:0/2217571040 shutdown_connections 2024-09-17T01:48:53.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.037+0000 7f4cfcc00640 1 -- 172.21.15.42:0/2217571040 wait complete. 2024-09-17T01:48:53.464 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 168, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:48:41.459234+0000', 'modified': '2024-09-17T01:48:44.478983+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11193': {'gid': 11193, 'name': 'b', 'rank': 0, 'incarnation': 164, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.43:6836/777529944', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 777529944}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 777529944}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [31], 'metadata_pool': 30, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 11193, 'qdb_cluster': [11193]} 2024-09-17T01:48:53.465 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T01:48:53.465 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-17T01:48:53.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.698+0000 7f2108e00640 1 -- 172.21.15.42:0/3716173002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2104162890 msgr2=0x7f210415fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:53.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.698+0000 7f2108e00640 1 --2- 172.21.15.42:0/3716173002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2104162890 0x7f210415fbb0 secure :-1 s=READY pgs=2441 cs=0 l=1 rev1=1 crypto rx=0x7f20ec005fd0 tx=0x7f20ec02a540 comp rx=0 tx=0).stop 2024-09-17T01:48:53.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.699+0000 7f2108e00640 1 -- 172.21.15.42:0/3716173002 shutdown_connections 2024-09-17T01:48:53.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.699+0000 7f2108e00640 1 --2- 172.21.15.42:0/3716173002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2104162890 0x7f210415fbb0 unknown :-1 s=CLOSED pgs=2441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.699+0000 7f2108e00640 1 --2- 172.21.15.42:0/3716173002 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f21040b6300 0x7f210415c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.699+0000 7f2108e00640 1 -- 172.21.15.42:0/3716173002 >> 172.21.15.42:0/3716173002 conn(0x7f2104073c60 msgr2=0x7f210406cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:53.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.699+0000 7f2108e00640 1 -- 172.21.15.42:0/3716173002 shutdown_connections 2024-09-17T01:48:53.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.699+0000 7f2108e00640 1 -- 172.21.15.42:0/3716173002 wait complete. 2024-09-17T01:48:53.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.701+0000 7f2108e00640 1 Processor -- start 2024-09-17T01:48:53.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.701+0000 7f2108e00640 1 -- start start 2024-09-17T01:48:53.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.702+0000 7f2108e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21040b6300 0x7f21041f8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:53.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.702+0000 7f2108e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2104162890 0x7f21041f9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:53.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.702+0000 7f2108e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2104162ca0 0x7f210415a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:53.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.702+0000 7f2108e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f21040cf510 con 0x7f21040b6300 2024-09-17T01:48:53.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.703+0000 7f2108e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f21040cf390 con 0x7f2104162890 2024-09-17T01:48:53.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.703+0000 7f2108e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f21040cf690 con 0x7f2104162ca0 2024-09-17T01:48:53.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.703+0000 7f2103400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21040b6300 0x7f21041f8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:53.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.703+0000 7f2103400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21040b6300 0x7f21041f8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45868/0 (socket says 172.21.15.42:45868) 2024-09-17T01:48:53.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.703+0000 7f2103400640 1 -- 172.21.15.42:0/2093929539 learned_addr learned my addr 172.21.15.42:0/2093929539 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:53.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.703+0000 7f20fbe00640 1 --2- 172.21.15.42:0/2093929539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2104162890 0x7f21041f9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:53.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.703+0000 7f2103e00640 1 --2- 172.21.15.42:0/2093929539 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2104162ca0 0x7f210415a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:53.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.703+0000 7f2103400640 1 -- 172.21.15.42:0/2093929539 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2104162ca0 msgr2=0x7f210415a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:53.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.703+0000 7f2103400640 1 --2- 172.21.15.42:0/2093929539 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2104162ca0 0x7f210415a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.703+0000 7f2103400640 1 -- 172.21.15.42:0/2093929539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2104162890 msgr2=0x7f21041f9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:53.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.703+0000 7f2103400640 1 --2- 172.21.15.42:0/2093929539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2104162890 0x7f21041f9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.703+0000 7f2103400640 1 -- 172.21.15.42:0/2093929539 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21040ce550 con 0x7f21040b6300 2024-09-17T01:48:53.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.704+0000 7f2103400640 1 --2- 172.21.15.42:0/2093929539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21040b6300 0x7f21041f8c70 secure :-1 s=READY pgs=2442 cs=0 l=1 rev1=1 crypto rx=0x7f20f400d770 tx=0x7f20f400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:53.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.704+0000 7f20fb400640 1 -- 172.21.15.42:0/2093929539 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f4017070 con 0x7f21040b6300 2024-09-17T01:48:53.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.704+0000 7f20fb400640 1 -- 172.21.15.42:0/2093929539 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20f4009d20 con 0x7f21040b6300 2024-09-17T01:48:53.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.704+0000 7f20fb400640 1 -- 172.21.15.42:0/2093929539 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f40106c0 con 0x7f21040b6300 2024-09-17T01:48:53.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.704+0000 7f2108e00640 1 -- 172.21.15.42:0/2093929539 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21040ce830 con 0x7f21040b6300 2024-09-17T01:48:53.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.704+0000 7f2108e00640 1 -- 172.21.15.42:0/2093929539 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21040cedf0 con 0x7f21040b6300 2024-09-17T01:48:53.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.707+0000 7f20fb400640 1 -- 172.21.15.42:0/2093929539 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f20f401a070 con 0x7f21040b6300 2024-09-17T01:48:53.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.707+0000 7f20fb400640 1 --2- 172.21.15.42:0/2093929539 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f20e0078b90 0x7f20e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:53.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.708+0000 7f20fb400640 1 -- 172.21.15.42:0/2093929539 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(215..215 src has 1..215) ==== 5912+0+0 (secure 0 0 0) 0x7f20f409afd0 con 0x7f21040b6300 2024-09-17T01:48:53.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.708+0000 7f21114b4740 1 Processor -- start 2024-09-17T01:48:53.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.708+0000 7f21114b4740 1 -- start start 2024-09-17T01:48:53.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.708+0000 7f20fbe00640 1 --2- 172.21.15.42:0/2093929539 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f20e0078b90 0x7f20e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:53.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.709+0000 7f20fbe00640 1 --2- 172.21.15.42:0/2093929539 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f20e0078b90 0x7f20e007b0a0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f20ec033000 tx=0x7f20ec004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:53.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.710+0000 7f21114b4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210e5270 0x55ef214b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:53.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.710+0000 7f21114b4740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ef210bc3b0 0x55ef214b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:53.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.710+0000 7f21114b4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef210c4590 0x55ef21486150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:53.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.710+0000 7f21114b4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ef2140f430 con 0x55ef210e5270 2024-09-17T01:48:53.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.710+0000 7f21114b4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ef213ff5d0 con 0x55ef210c4590 2024-09-17T01:48:53.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.710+0000 7f21114b4740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55ef213eea00 con 0x55ef210bc3b0 2024-09-17T01:48:53.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.710+0000 7f2103400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210e5270 0x55ef214b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:53.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.710+0000 7f2103400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210e5270 0x55ef214b5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45870/0 (socket says 172.21.15.42:45870) 2024-09-17T01:48:53.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.710+0000 7f2103400640 1 -- 172.21.15.42:0/2082035804 learned_addr learned my addr 172.21.15.42:0/2082035804 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:53.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.710+0000 7f2103e00640 1 --2- 172.21.15.42:0/2082035804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef210c4590 0x55ef21486150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:53.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.710+0000 7f20fbe00640 1 --2- 172.21.15.42:0/2082035804 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ef210bc3b0 0x55ef214b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:53.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.711+0000 7f2103400640 1 -- 172.21.15.42:0/2082035804 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ef210bc3b0 msgr2=0x55ef214b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:53.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.711+0000 7f2103400640 1 --2- 172.21.15.42:0/2082035804 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ef210bc3b0 0x55ef214b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.711+0000 7f2103400640 1 -- 172.21.15.42:0/2082035804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef210c4590 msgr2=0x55ef21486150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:53.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.711+0000 7f2103400640 1 --2- 172.21.15.42:0/2082035804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef210c4590 0x55ef21486150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.711+0000 7f2103400640 1 -- 172.21.15.42:0/2082035804 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef213b7520 con 0x55ef210e5270 2024-09-17T01:48:53.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.711+0000 7f2103e00640 1 --2- 172.21.15.42:0/2082035804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef210c4590 0x55ef21486150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:53.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.711+0000 7f2103400640 1 --2- 172.21.15.42:0/2082035804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210e5270 0x55ef214b5b60 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7f20f4062be0 tx=0x7f20f40626d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3c4ce3c4c9b42e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:53.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.711+0000 7f20f3e00640 1 -- 172.21.15.42:0/2082035804 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f4021040 con 0x55ef210e5270 2024-09-17T01:48:53.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.711+0000 7f20f3e00640 1 -- 172.21.15.42:0/2082035804 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20f4062c50 con 0x55ef210e5270 2024-09-17T01:48:53.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.711+0000 7f20f3e00640 1 -- 172.21.15.42:0/2082035804 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f40620b0 con 0x55ef210e5270 2024-09-17T01:48:53.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.712+0000 7f21114b4740 1 -- 172.21.15.42:0/2082035804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210e5270 msgr2=0x55ef214b5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:53.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.712+0000 7f21114b4740 1 --2- 172.21.15.42:0/2082035804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210e5270 0x55ef214b5b60 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7f20f4062be0 tx=0x7f20f40626d0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.712+0000 7f21114b4740 1 -- 172.21.15.42:0/2082035804 shutdown_connections 2024-09-17T01:48:53.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.712+0000 7f21114b4740 1 --2- 172.21.15.42:0/2082035804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef210c4590 0x55ef21486150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.712+0000 7f21114b4740 1 --2- 172.21.15.42:0/2082035804 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ef210bc3b0 0x55ef214b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.712+0000 7f21114b4740 1 --2- 172.21.15.42:0/2082035804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210e5270 0x55ef214b5b60 unknown :-1 s=CLOSED pgs=2443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.712+0000 7f21114b4740 1 -- 172.21.15.42:0/2082035804 >> 172.21.15.42:0/2082035804 conn(0x55ef210d93c0 msgr2=0x55ef2148bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:53.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.712+0000 7f21114b4740 1 -- 172.21.15.42:0/2082035804 shutdown_connections 2024-09-17T01:48:53.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.712+0000 7f21114b4740 1 -- 172.21.15.42:0/2082035804 wait complete. 2024-09-17T01:48:53.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.713+0000 7f21114b4740 1 -- start start 2024-09-17T01:48:53.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.713+0000 7f21114b4740 1 Processor -- start 2024-09-17T01:48:53.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.715+0000 7f21114b4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef210bc3b0 0x55ef214e0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:53.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.715+0000 7f21114b4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210c4590 0x55ef214c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:53.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.715+0000 7f21114b4740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ef210e5270 0x55ef21486e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:53.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.715+0000 7f21114b4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ef21395330 con 0x55ef210c4590 2024-09-17T01:48:53.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.715+0000 7f21114b4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ef213f2810 con 0x55ef210bc3b0 2024-09-17T01:48:53.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.715+0000 7f21114b4740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55ef2115f620 con 0x55ef210e5270 2024-09-17T01:48:53.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.715+0000 7f21114b4740 10 client.0 _ll_register_callbacks cb 0x55ef2139a420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:48:53.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.715+0000 7f20fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210c4590 0x55ef214c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:53.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.715+0000 7f20fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210c4590 0x55ef214c9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45884/0 (socket says 172.21.15.42:45884) 2024-09-17T01:48:53.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.715+0000 7f20fbe00640 1 -- 172.21.15.42:0/4132919347 learned_addr learned my addr 172.21.15.42:0/4132919347 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:53.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.716+0000 7f2103400640 1 --2- 172.21.15.42:0/4132919347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef210bc3b0 0x55ef214e0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:53.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.716+0000 7f2103e00640 1 --2- 172.21.15.42:0/4132919347 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ef210e5270 0x55ef21486e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:53.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.716+0000 7f20fbe00640 1 -- 172.21.15.42:0/4132919347 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ef210e5270 msgr2=0x55ef21486e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:53.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.716+0000 7f20fbe00640 1 --2- 172.21.15.42:0/4132919347 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ef210e5270 0x55ef21486e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.716+0000 7f20fbe00640 1 -- 172.21.15.42:0/4132919347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef210bc3b0 msgr2=0x55ef214e0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:53.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.716+0000 7f20fbe00640 1 --2- 172.21.15.42:0/4132919347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef210bc3b0 0x55ef214e0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.716+0000 7f20fbe00640 1 -- 172.21.15.42:0/4132919347 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef21150850 con 0x55ef210c4590 2024-09-17T01:48:53.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.716+0000 7f20fbe00640 1 --2- 172.21.15.42:0/4132919347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210c4590 0x55ef214c9cc0 secure :-1 s=READY pgs=2444 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009230 tx=0x7f20ec009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a96c374759ad2c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:53.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.716+0000 7f20f0c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:48:53.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.717+0000 7f20f0c00640 1 -- 172.21.15.42:0/4132919347 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec04d070 con 0x55ef210c4590 2024-09-17T01:48:53.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.717+0000 7f21114b4740 1 -- 172.21.15.42:0/4132919347 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20f4062c50 con 0x55ef210c4590 2024-09-17T01:48:53.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.717+0000 7f20f0c00640 1 -- 172.21.15.42:0/4132919347 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(215..215 src has 1..215) ==== 5912+0+0 (secure 0 0 0) 0x7f20ec003d50 con 0x55ef210c4590 2024-09-17T01:48:53.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.717+0000 7f20f0c00640 1 -- 172.21.15.42:0/4132919347 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=168) ==== 24+0+0 (secure 0 0 0) 0x7f20ec058050 con 0x55ef210c4590 2024-09-17T01:48:53.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.717+0000 7f21114b4740 10 client.11328 fetch_fsmap learned FSMap version 168 2024-09-17T01:48:53.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.717+0000 7f21114b4740 1 -- 172.21.15.42:0/4132919347 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=168,monmap=2+}) -- 0x55ef211c76b0 con 0x55ef210c4590 2024-09-17T01:48:53.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.717+0000 7f20f0c00640 1 -- 172.21.15.42:0/4132919347 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20f4062c50 con 0x55ef210c4590 2024-09-17T01:48:53.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.717+0000 7f20f0c00640 1 -- 172.21.15.42:0/4132919347 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 168) ==== 3502+0+0 (secure 0 0 0) 0x7f20ec05b020 con 0x55ef210c4590 2024-09-17T01:48:53.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.717+0000 7f21114b4740 10 client.11328 fetch_fsmap finished waiting for FSMap version 168 2024-09-17T01:48:53.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.717+0000 7f21114b4740 10 client.11328 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T01:48:53.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.717+0000 7f21114b4740 20 client.11328 populate_metadata read hostname 'smithi042' 2024-09-17T01:48:53.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.717+0000 7f21114b4740 1 --2- 172.21.15.42:0/4132919347 >> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] conn(0x55ef210a3e40 0x55ef214e3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:53.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.717+0000 7f21114b4740 4 client.11328 mds_command: new command op to 11193 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:48:53.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.717+0000 7f21114b4740 1 -- 172.21.15.42:0/4132919347 --> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef21401520 con 0x55ef210a3e40 2024-09-17T01:48:53.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.718+0000 7f2103400640 1 --2- 172.21.15.42:0/4132919347 >> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] conn(0x55ef210a3e40 0x55ef214e3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:53.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.719+0000 7f2103400640 1 --2- 172.21.15.42:0/4132919347 >> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] conn(0x55ef210a3e40 0x55ef214e3780 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff40ea9c00d57d0e server_cookie=cbd93b46162355d2 in_seq=0 out_seq=0 2024-09-17T01:48:53.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.719+0000 7f20f0c00640 10 client.11328 ms_handle_connect on v2:172.21.15.43:6835/777529944 2024-09-17T01:48:53.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.720+0000 7f20f0c00640 1 -- 172.21.15.42:0/4132919347 <== mds.0 v2:172.21.15.43:6835/777529944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ef21401520 con 0x55ef210a3e40 2024-09-17T01:48:53.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.720+0000 7f20f0c00640 10 client.11328 handle_command_reply: tid=0 2024-09-17T01:48:53.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.720+0000 7f21114b4740 1 client.11328 shutdown 2024-09-17T01:48:53.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.720+0000 7f21114b4740 1 -- 172.21.15.42:0/4132919347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210c4590 msgr2=0x55ef214c9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:53.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.720+0000 7f21114b4740 1 --2- 172.21.15.42:0/4132919347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210c4590 0x55ef214c9cc0 secure :-1 s=READY pgs=2444 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009230 tx=0x7f20ec009260 comp rx=0 tx=0).stop 2024-09-17T01:48:53.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.720+0000 7f21114b4740 1 -- 172.21.15.42:0/4132919347 shutdown_connections 2024-09-17T01:48:53.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.720+0000 7f21114b4740 1 --2- 172.21.15.42:0/4132919347 >> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] conn(0x55ef210a3e40 0x55ef214e3780 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.720+0000 7f21114b4740 1 --2- 172.21.15.42:0/4132919347 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ef210e5270 0x55ef21486e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.720+0000 7f21114b4740 1 --2- 172.21.15.42:0/4132919347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210c4590 0x55ef214c9cc0 unknown :-1 s=CLOSED pgs=2444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.720+0000 7f21114b4740 1 --2- 172.21.15.42:0/4132919347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef210bc3b0 0x55ef214e0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.720+0000 7f20f0c00640 0 client.11328 ms_handle_reset on v2:172.21.15.43:6835/777529944 2024-09-17T01:48:53.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.720+0000 7f21114b4740 1 -- 172.21.15.42:0/4132919347 >> 172.21.15.42:0/4132919347 conn(0x55ef210d93c0 msgr2=0x55ef214ad070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:53.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.720+0000 7f21114b4740 1 -- 172.21.15.42:0/4132919347 shutdown_connections 2024-09-17T01:48:53.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.720+0000 7f21114b4740 1 -- 172.21.15.42:0/4132919347 wait complete. 2024-09-17T01:48:53.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.721+0000 7f21114b4740 20 client.11328 trim_cache size 0 max 16384 2024-09-17T01:48:53.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.740+0000 7f21114b4740 1 Processor -- start 2024-09-17T01:48:53.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.740+0000 7f21114b4740 1 -- start start 2024-09-17T01:48:53.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.741+0000 7f21114b4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef210bc3b0 0x55ef214deeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:53.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.741+0000 7f21114b4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210c4590 0x55ef214df3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:53.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.741+0000 7f21114b4740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ef210e5270 0x55ef214f38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:53.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.741+0000 7f21114b4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2104201700 con 0x55ef210c4590 2024-09-17T01:48:53.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.741+0000 7f21114b4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f21040c8f80 con 0x55ef210bc3b0 2024-09-17T01:48:53.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.741+0000 7f21114b4740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f210414c740 con 0x55ef210e5270 2024-09-17T01:48:53.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.741+0000 7f20fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210c4590 0x55ef214df3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:53.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.741+0000 7f20fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210c4590 0x55ef214df3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45894/0 (socket says 172.21.15.42:45894) 2024-09-17T01:48:53.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.741+0000 7f20fbe00640 1 -- 172.21.15.42:0/1040161175 learned_addr learned my addr 172.21.15.42:0/1040161175 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:53.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.742+0000 7f2103400640 1 --2- 172.21.15.42:0/1040161175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef210bc3b0 0x55ef214deeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:53.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.742+0000 7f2103e00640 1 --2- 172.21.15.42:0/1040161175 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ef210e5270 0x55ef214f38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:53.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.742+0000 7f20fbe00640 1 -- 172.21.15.42:0/1040161175 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ef210e5270 msgr2=0x55ef214f38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:53.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.742+0000 7f20fbe00640 1 --2- 172.21.15.42:0/1040161175 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ef210e5270 0x55ef214f38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.742+0000 7f20fbe00640 1 -- 172.21.15.42:0/1040161175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef210bc3b0 msgr2=0x55ef214deeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:53.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.742+0000 7f20fbe00640 1 --2- 172.21.15.42:0/1040161175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef210bc3b0 0x55ef214deeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.742+0000 7f20fbe00640 1 -- 172.21.15.42:0/1040161175 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef2148ac20 con 0x55ef210c4590 2024-09-17T01:48:53.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.742+0000 7f20fbe00640 1 --2- 172.21.15.42:0/1040161175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210c4590 0x55ef214df3f0 secure :-1 s=READY pgs=2445 cs=0 l=1 rev1=1 crypto rx=0x7f20ec034040 tx=0x7f20ec003fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985cbaf5fe7c54f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:53.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.742+0000 7f20f3400640 1 -- 172.21.15.42:0/1040161175 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec061070 con 0x55ef210c4590 2024-09-17T01:48:53.742 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.742+0000 7f20f3400640 1 -- 172.21.15.42:0/1040161175 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20ec004ca0 con 0x55ef210c4590 2024-09-17T01:48:53.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.742+0000 7f20f3400640 1 -- 172.21.15.42:0/1040161175 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec04d070 con 0x55ef210c4590 2024-09-17T01:48:53.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.743+0000 7f21114b4740 1 -- 172.21.15.42:0/1040161175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210c4590 msgr2=0x55ef214df3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:53.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.743+0000 7f21114b4740 1 --2- 172.21.15.42:0/1040161175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210c4590 0x55ef214df3f0 secure :-1 s=READY pgs=2445 cs=0 l=1 rev1=1 crypto rx=0x7f20ec034040 tx=0x7f20ec003fa0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.743+0000 7f21114b4740 1 -- 172.21.15.42:0/1040161175 shutdown_connections 2024-09-17T01:48:53.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.743+0000 7f21114b4740 1 --2- 172.21.15.42:0/1040161175 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ef210e5270 0x55ef214f38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.743+0000 7f21114b4740 1 --2- 172.21.15.42:0/1040161175 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210c4590 0x55ef214df3f0 unknown :-1 s=CLOSED pgs=2445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.743+0000 7f21114b4740 1 --2- 172.21.15.42:0/1040161175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef210bc3b0 0x55ef214deeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.743+0000 7f21114b4740 1 -- 172.21.15.42:0/1040161175 >> 172.21.15.42:0/1040161175 conn(0x55ef210d93c0 msgr2=0x55ef214d34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:53.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.743+0000 7f21114b4740 1 -- 172.21.15.42:0/1040161175 shutdown_connections 2024-09-17T01:48:53.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.743+0000 7f21114b4740 1 -- 172.21.15.42:0/1040161175 wait complete. 2024-09-17T01:48:53.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.744+0000 7f21114b4740 1 -- start start 2024-09-17T01:48:53.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.744+0000 7f21114b4740 1 Processor -- start 2024-09-17T01:48:53.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.746+0000 7f21114b4740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210bc3b0 0x55ef2154f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:53.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.746+0000 7f21114b4740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ef210c4590 0x55ef214deeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:53.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.746+0000 7f21114b4740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef210e5270 0x55ef214df3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:53.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.746+0000 7f21114b4740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ef214ca200 con 0x55ef210bc3b0 2024-09-17T01:48:53.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.746+0000 7f21114b4740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ef214af840 con 0x55ef210e5270 2024-09-17T01:48:53.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.746+0000 7f21114b4740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55ef214ae410 con 0x55ef210c4590 2024-09-17T01:48:53.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.746+0000 7f21114b4740 10 client.0 _ll_register_callbacks cb 0x7f20ec004110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:48:53.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.746+0000 7f2103400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210bc3b0 0x55ef2154f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:53.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.746+0000 7f2103400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210bc3b0 0x55ef2154f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45896/0 (socket says 172.21.15.42:45896) 2024-09-17T01:48:53.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.746+0000 7f2103400640 1 -- 172.21.15.42:0/1875270252 learned_addr learned my addr 172.21.15.42:0/1875270252 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:53.746 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.746+0000 7f20fbe00640 1 --2- 172.21.15.42:0/1875270252 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ef210c4590 0x55ef214deeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:53.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.746+0000 7f2103e00640 1 --2- 172.21.15.42:0/1875270252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef210e5270 0x55ef214df3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:53.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.747+0000 7f2103400640 1 -- 172.21.15.42:0/1875270252 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ef210c4590 msgr2=0x55ef214deeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:53.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.747+0000 7f2103400640 1 --2- 172.21.15.42:0/1875270252 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ef210c4590 0x55ef214deeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.747+0000 7f2103400640 1 -- 172.21.15.42:0/1875270252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef210e5270 msgr2=0x55ef214df3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:53.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.747+0000 7f2103400640 1 --2- 172.21.15.42:0/1875270252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef210e5270 0x55ef214df3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.747+0000 7f2103400640 1 -- 172.21.15.42:0/1875270252 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef2148c840 con 0x55ef210bc3b0 2024-09-17T01:48:53.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.747+0000 7f20fbe00640 1 --2- 172.21.15.42:0/1875270252 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ef210c4590 0x55ef214deeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:53.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.747+0000 7f2103400640 1 --2- 172.21.15.42:0/1875270252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210bc3b0 0x55ef2154f9e0 secure :-1 s=READY pgs=2446 cs=0 l=1 rev1=1 crypto rx=0x7f20f405f1d0 tx=0x7f20f4099260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9431b3cf45638c09 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:53.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.747+0000 7f20f0c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:48:53.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.747+0000 7f20f0c00640 1 -- 172.21.15.42:0/1875270252 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f4021070 con 0x55ef210bc3b0 2024-09-17T01:48:53.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.747+0000 7f20f0c00640 1 -- 172.21.15.42:0/1875270252 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(215..215 src has 1..215) ==== 5912+0+0 (secure 0 0 0) 0x7f20f404e180 con 0x55ef210bc3b0 2024-09-17T01:48:53.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.747+0000 7f21114b4740 1 -- 172.21.15.42:0/1875270252 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20ec004ca0 con 0x55ef210bc3b0 2024-09-17T01:48:53.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.747+0000 7f20f0c00640 1 -- 172.21.15.42:0/1875270252 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=168) ==== 24+0+0 (secure 0 0 0) 0x7f20f406c5c0 con 0x55ef210bc3b0 2024-09-17T01:48:53.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.747+0000 7f21114b4740 10 client.11334 fetch_fsmap learned FSMap version 168 2024-09-17T01:48:53.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.747+0000 7f21114b4740 1 -- 172.21.15.42:0/1875270252 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=168,monmap=2+}) -- 0x55ef214f42e0 con 0x55ef210bc3b0 2024-09-17T01:48:53.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.748+0000 7f20f0c00640 1 -- 172.21.15.42:0/1875270252 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20ec004ca0 con 0x55ef210bc3b0 2024-09-17T01:48:53.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.748+0000 7f20f0c00640 1 -- 172.21.15.42:0/1875270252 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 168) ==== 3502+0+0 (secure 0 0 0) 0x7f20f405e5a0 con 0x55ef210bc3b0 2024-09-17T01:48:53.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.748+0000 7f21114b4740 10 client.11334 fetch_fsmap finished waiting for FSMap version 168 2024-09-17T01:48:53.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.748+0000 7f21114b4740 10 client.11334 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T01:48:53.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.748+0000 7f21114b4740 20 client.11334 populate_metadata read hostname 'smithi042' 2024-09-17T01:48:53.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.748+0000 7f21114b4740 1 --2- 172.21.15.42:0/1875270252 >> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] conn(0x55ef21553e90 0x55ef215542a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:53.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.748+0000 7f21114b4740 4 client.11334 mds_command: new command op to 11193 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T01:48:53.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.748+0000 7f21114b4740 1 -- 172.21.15.42:0/1875270252 --> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] -- command(tid 0: {"prefix": "status"}) -- 0x55ef213fcfd0 con 0x55ef21553e90 2024-09-17T01:48:53.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.748+0000 7f20fbe00640 1 --2- 172.21.15.42:0/1875270252 >> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] conn(0x55ef21553e90 0x55ef215542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:53.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.749+0000 7f20fbe00640 1 --2- 172.21.15.42:0/1875270252 >> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] conn(0x55ef21553e90 0x55ef215542a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfb4ce04afb39267 server_cookie=ffa84df70690086c in_seq=0 out_seq=0 2024-09-17T01:48:53.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.749+0000 7f20f0c00640 10 client.11334 ms_handle_connect on v2:172.21.15.43:6835/777529944 2024-09-17T01:48:53.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.750+0000 7f20f0c00640 1 -- 172.21.15.42:0/1875270252 <== mds.0 v2:172.21.15.43:6835/777529944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x55ef213fcfd0 con 0x55ef21553e90 2024-09-17T01:48:53.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.750+0000 7f20f0c00640 10 client.11334 handle_command_reply: tid=0 2024-09-17T01:48:53.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.750+0000 7f21114b4740 1 client.11334 shutdown 2024-09-17T01:48:53.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.750+0000 7f21114b4740 1 -- 172.21.15.42:0/1875270252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210bc3b0 msgr2=0x55ef2154f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:53.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.750+0000 7f21114b4740 1 --2- 172.21.15.42:0/1875270252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210bc3b0 0x55ef2154f9e0 secure :-1 s=READY pgs=2446 cs=0 l=1 rev1=1 crypto rx=0x7f20f405f1d0 tx=0x7f20f4099260 comp rx=0 tx=0).stop 2024-09-17T01:48:53.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.750+0000 7f21114b4740 1 -- 172.21.15.42:0/1875270252 shutdown_connections 2024-09-17T01:48:53.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.750+0000 7f21114b4740 1 --2- 172.21.15.42:0/1875270252 >> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] conn(0x55ef21553e90 0x55ef215542a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.750+0000 7f21114b4740 1 --2- 172.21.15.42:0/1875270252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ef210e5270 0x55ef214df3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.750+0000 7f21114b4740 1 --2- 172.21.15.42:0/1875270252 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ef210c4590 0x55ef214deeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.750+0000 7f20f0c00640 0 client.11334 ms_handle_reset on v2:172.21.15.43:6835/777529944 2024-09-17T01:48:53.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.750+0000 7f21114b4740 1 --2- 172.21.15.42:0/1875270252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef210bc3b0 0x55ef2154f9e0 unknown :-1 s=CLOSED pgs=2446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.750+0000 7f21114b4740 1 -- 172.21.15.42:0/1875270252 >> 172.21.15.42:0/1875270252 conn(0x55ef210d93c0 msgr2=0x55ef214dfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:53.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.750+0000 7f21114b4740 1 -- 172.21.15.42:0/1875270252 shutdown_connections 2024-09-17T01:48:53.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.750+0000 7f21114b4740 1 -- 172.21.15.42:0/1875270252 wait complete. 2024-09-17T01:48:53.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.750+0000 7f21114b4740 20 client.11334 trim_cache size 0 max 16384 2024-09-17T01:48:53.751 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:48:53.751 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "fea1c88c-cb05-432f-a745-f9dcbb5f2503", 2024-09-17T01:48:53.752 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-17T01:48:53.752 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 11193, 2024-09-17T01:48:53.752 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-17T01:48:53.752 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-17T01:48:53.752 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-17T01:48:53.752 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 11.807201936, 2024-09-17T01:48:53.752 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 168, 2024-09-17T01:48:53.752 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 215, 2024-09-17T01:48:53.752 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 213, 2024-09-17T01:48:53.752 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 16.770416677 2024-09-17T01:48:53.752 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:48:53.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.751+0000 7f2108e00640 1 -- 172.21.15.42:0/2093929539 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f20e0078b90 msgr2=0x7f20e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:53.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.751+0000 7f2108e00640 1 --2- 172.21.15.42:0/2093929539 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f20e0078b90 0x7f20e007b0a0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f20ec033000 tx=0x7f20ec004730 comp rx=0 tx=0).stop 2024-09-17T01:48:53.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.751+0000 7f2108e00640 1 -- 172.21.15.42:0/2093929539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21040b6300 msgr2=0x7f21041f8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:53.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.751+0000 7f2108e00640 1 --2- 172.21.15.42:0/2093929539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21040b6300 0x7f21041f8c70 secure :-1 s=READY pgs=2442 cs=0 l=1 rev1=1 crypto rx=0x7f20f400d770 tx=0x7f20f400dc30 comp rx=0 tx=0).stop 2024-09-17T01:48:53.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.751+0000 7f2108e00640 1 -- 172.21.15.42:0/2093929539 shutdown_connections 2024-09-17T01:48:53.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.751+0000 7f2108e00640 1 --2- 172.21.15.42:0/2093929539 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f20e0078b90 0x7f20e007b0a0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.751+0000 7f2108e00640 1 --2- 172.21.15.42:0/2093929539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2104162890 0x7f21041f9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.751+0000 7f2108e00640 1 --2- 172.21.15.42:0/2093929539 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2104162ca0 0x7f210415a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.751+0000 7f2108e00640 1 --2- 172.21.15.42:0/2093929539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f21040b6300 0x7f21041f8c70 unknown :-1 s=CLOSED pgs=2442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.751+0000 7f2108e00640 1 -- 172.21.15.42:0/2093929539 >> 172.21.15.42:0/2093929539 conn(0x7f2104073c60 msgr2=0x7f210415e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:53.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.751+0000 7f2108e00640 1 -- 172.21.15.42:0/2093929539 shutdown_connections 2024-09-17T01:48:53.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.751+0000 7f2108e00640 1 -- 172.21.15.42:0/2093929539 wait complete. 2024-09-17T01:48:53.770 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T01:48:53.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.999+0000 7f136ce00640 1 -- 172.21.15.42:0/3827487628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f134c005270 msgr2=0x7f134c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:53.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.999+0000 7f136ce00640 1 --2- 172.21.15.42:0/3827487628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f134c005270 0x7f134c00b9c0 secure :-1 s=READY pgs=2448 cs=0 l=1 rev1=1 crypto rx=0x7f136000c640 tx=0x7f134c005830 comp rx=0 tx=0).stop 2024-09-17T01:48:53.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.999+0000 7f136ce00640 1 -- 172.21.15.42:0/3827487628 shutdown_connections 2024-09-17T01:48:53.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.999+0000 7f136ce00640 1 --2- 172.21.15.42:0/3827487628 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f134c005270 0x7f134c00b9c0 unknown :-1 s=CLOSED pgs=2448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:53.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.999+0000 7f136ce00640 1 -- 172.21.15.42:0/3827487628 >> 172.21.15.42:0/3827487628 conn(0x7f136806d1b0 msgr2=0x7f136806d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:53.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.999+0000 7f136ce00640 1 -- 172.21.15.42:0/3827487628 shutdown_connections 2024-09-17T01:48:53.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:53.999+0000 7f136ce00640 1 -- 172.21.15.42:0/3827487628 wait complete. 2024-09-17T01:48:53.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.002+0000 7f136ce00640 1 Processor -- start 2024-09-17T01:48:53.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.002+0000 7f136ce00640 1 -- start start 2024-09-17T01:48:54.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.003+0000 7f136ce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f134c005270 0x7f136815c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:54.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.003+0000 7f136ce00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1368158250 0x7f13681f6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:54.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.003+0000 7f136ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13681f6c60 0x7f13680aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:54.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.003+0000 7f136ce00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1368160ba0 con 0x7f13681f6c60 2024-09-17T01:48:54.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.003+0000 7f136ce00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1368072fe0 con 0x7f134c005270 2024-09-17T01:48:54.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.003+0000 7f136ce00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1368160d20 con 0x7f1368158250 2024-09-17T01:48:54.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.004+0000 7f1366800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13681f6c60 0x7f13680aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:54.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.004+0000 7f1366800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13681f6c60 0x7f13680aebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45914/0 (socket says 172.21.15.42:45914) 2024-09-17T01:48:54.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.004+0000 7f1366800640 1 -- 172.21.15.42:0/2296617310 learned_addr learned my addr 172.21.15.42:0/2296617310 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:54.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.004+0000 7f1365e00640 1 --2- 172.21.15.42:0/2296617310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f134c005270 0x7f136815c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:54.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.004+0000 7f1365400640 1 --2- 172.21.15.42:0/2296617310 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1368158250 0x7f13681f6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:54.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.004+0000 7f1366800640 1 -- 172.21.15.42:0/2296617310 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1368158250 msgr2=0x7f13681f6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:54.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.004+0000 7f1366800640 1 --2- 172.21.15.42:0/2296617310 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1368158250 0x7f13681f6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:54.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.004+0000 7f1366800640 1 -- 172.21.15.42:0/2296617310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f134c005270 msgr2=0x7f136815c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:54.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.004+0000 7f1366800640 1 --2- 172.21.15.42:0/2296617310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f134c005270 0x7f136815c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:54.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.004+0000 7f1366800640 1 -- 172.21.15.42:0/2296617310 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13681f7070 con 0x7f13681f6c60 2024-09-17T01:48:54.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.004+0000 7f1366800640 1 --2- 172.21.15.42:0/2296617310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13681f6c60 0x7f13680aebd0 secure :-1 s=READY pgs=2449 cs=0 l=1 rev1=1 crypto rx=0x7f136002b460 tx=0x7f1360004980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:54.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.005+0000 7f135e000640 1 -- 172.21.15.42:0/2296617310 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136002b7b0 con 0x7f13681f6c60 2024-09-17T01:48:54.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.005+0000 7f135e000640 1 -- 172.21.15.42:0/2296617310 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f136002b950 con 0x7f13681f6c60 2024-09-17T01:48:54.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.005+0000 7f135e000640 1 -- 172.21.15.42:0/2296617310 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136002bda0 con 0x7f13681f6c60 2024-09-17T01:48:54.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.005+0000 7f136ce00640 1 -- 172.21.15.42:0/2296617310 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13681589c0 con 0x7f13681f6c60 2024-09-17T01:48:54.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.005+0000 7f136ce00640 1 -- 172.21.15.42:0/2296617310 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1368158f80 con 0x7f13681f6c60 2024-09-17T01:48:54.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.006+0000 7f136ce00640 1 -- 172.21.15.42:0/2296617310 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13680cd620 con 0x7f13681f6c60 2024-09-17T01:48:54.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.007+0000 7f135e000640 1 -- 172.21.15.42:0/2296617310 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1360006070 con 0x7f13681f6c60 2024-09-17T01:48:54.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.008+0000 7f135e000640 1 --2- 172.21.15.42:0/2296617310 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1348078b90 0x7f134807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:54.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.008+0000 7f135e000640 1 -- 172.21.15.42:0/2296617310 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(215..215 src has 1..215) ==== 5912+0+0 (secure 0 0 0) 0x7f13600ba860 con 0x7f13681f6c60 2024-09-17T01:48:54.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.009+0000 7f1365e00640 1 --2- 172.21.15.42:0/2296617310 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1348078b90 0x7f134807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:54.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.010+0000 7f1365e00640 1 --2- 172.21.15.42:0/2296617310 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1348078b90 0x7f134807b0a0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f13680afd20 tx=0x7f1358005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:54.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.013+0000 7f135e000640 1 -- 172.21.15.42:0/2296617310 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f13681f7070 con 0x7f13681f6c60 2024-09-17T01:48:54.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.246+0000 7f136ce00640 1 -- 172.21.15.42:0/2296617310 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1368158750 con 0x7f13681f6c60 2024-09-17T01:48:54.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.246+0000 7f135e000640 1 -- 172.21.15.42:0/2296617310 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v168) ==== 53+0+73 (secure 0 0 0) 0x7f1360082570 con 0x7f13681f6c60 2024-09-17T01:48:54.244 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T01:48:54.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.249+0000 7f136ce00640 1 -- 172.21.15.42:0/2296617310 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1348078b90 msgr2=0x7f134807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:54.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.249+0000 7f136ce00640 1 --2- 172.21.15.42:0/2296617310 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1348078b90 0x7f134807b0a0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f13680afd20 tx=0x7f1358005f90 comp rx=0 tx=0).stop 2024-09-17T01:48:54.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.249+0000 7f136ce00640 1 -- 172.21.15.42:0/2296617310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13681f6c60 msgr2=0x7f13680aebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:54.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.249+0000 7f136ce00640 1 --2- 172.21.15.42:0/2296617310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13681f6c60 0x7f13680aebd0 secure :-1 s=READY pgs=2449 cs=0 l=1 rev1=1 crypto rx=0x7f136002b460 tx=0x7f1360004980 comp rx=0 tx=0).stop 2024-09-17T01:48:54.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.249+0000 7f136ce00640 1 -- 172.21.15.42:0/2296617310 shutdown_connections 2024-09-17T01:48:54.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.249+0000 7f136ce00640 1 --2- 172.21.15.42:0/2296617310 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1348078b90 0x7f134807b0a0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:54.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.249+0000 7f136ce00640 1 --2- 172.21.15.42:0/2296617310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13681f6c60 0x7f13680aebd0 unknown :-1 s=CLOSED pgs=2449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:54.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.249+0000 7f136ce00640 1 --2- 172.21.15.42:0/2296617310 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1368158250 0x7f13681f6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:54.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.249+0000 7f136ce00640 1 --2- 172.21.15.42:0/2296617310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f134c005270 0x7f136815c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:54.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.249+0000 7f136ce00640 1 -- 172.21.15.42:0/2296617310 >> 172.21.15.42:0/2296617310 conn(0x7f136806d1b0 msgr2=0x7f1368156d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:54.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.249+0000 7f136ce00640 1 -- 172.21.15.42:0/2296617310 shutdown_connections 2024-09-17T01:48:54.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54.249+0000 7f136ce00640 1 -- 172.21.15.42:0/2296617310 wait complete. 2024-09-17T01:48:54.269 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T01:48:54.270 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:48:54.270 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-09-17T01:48:54.270 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T01:48:54.270 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:48:54.270 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T01:48:54.270 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T01:48:54.270 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:48:54.270 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:48:54.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:48:54.271 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-09-17T01:48:54.307 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:48:54.307 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:48:54.307 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:48:54.307 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:48:54.307 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-17T01:48:54.307 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:48:54.307 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:48:54.307 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-09-17T01:48:54.308 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-09-17T01:48:54.308 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:48:54.308 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-09-17T01:48:54.308 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-09-17T01:48:54.308 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:48:54.308 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:48:54.308 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-09-17T01:48:54.308 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-17T01:48:54.308 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 41673sec preferred_lft 41673sec 2024-09-17T01:48:54.308 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-17T01:48:54.308 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:48:54.309 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:48:54.309 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:48:54.309 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-09-17T01:48:54.309 INFO:teuthology.orchestra.run.smithi042.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T01:48:54.309 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T01:48:54.309 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T01:48:54.309 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:48:54.309 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::68d2:2bff:fe2f:191a/64 scope link 2024-09-17T01:48:54.309 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:48:54.309 INFO:teuthology.orchestra.run.smithi042.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:48:54.309 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether e2:73:3e:9b:8a:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:48:54.309 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::e073:3eff:fe9b:8a00/64 scope link 2024-09-17T01:48:54.310 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:48:54.310 INFO:teuthology.orchestra.run.smithi042.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:48:54.310 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T01:48:54.310 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::240b:bfff:feb7:6e5b/64 scope link 2024-09-17T01:48:54.310 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:48:54.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:48:54.310 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:48:54.401 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-17T01:48:54.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:48:54.404 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-09-17T01:48:54.440 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-09-17T01:48:54.440 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:48:54.441 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-17T01:48:54.441 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-17T01:48:54.441 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:48:54.441 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:48:54.441 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:48:54.441 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T01:48:54.441 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T01:48:54.441 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T01:48:54.441 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:48:54.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:48:54.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:48:54.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:48:54.639 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-17T01:48:54.674 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T01:48:54.675 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T01:48:54.675 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:48:54.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:48:54.675 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-09-17T01:48:54.771 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:48:54.771 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T01:48:54.806 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:48:54.806 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:48:54.806 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:48:54.882 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T01:48:54.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:48:54.883 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:48:55.081 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:48:55.081 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:48:55.081 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:48:55.101 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:48:55.102 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:48:55.102 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:48:55.102 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:48:55.102 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:48:55.135 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:48:55.135 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:48:55.135 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:48:55.135 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:48:55.135 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:48:55.136 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-09-17T01:48:55.136 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-09-17T01:48:55.136 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fea1c88c-cb05-432f-a745-f9dcbb5f2503" will pass to kernel 2024-09-17T01:48:55.137 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T01:48:55.137 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-09-17T01:48:55.137 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T01:48:55.137 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T01:48:55.137 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T01:48:55.140 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T01:48:55.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:48:55.140 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:48:55.197 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:48:55.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:48:55.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:48:55.296 INFO:teuthology.orchestra.run.smithi042.stdout:client9218 2024-09-17T01:48:55.296 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:48:55.296 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:48:55.332 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:48:55.332 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:48:55.408 DEBUG:teuthology.orchestra.run.smithi042:> stdin-killer -- python3 -c ' 2024-09-17T01:48:55.408 DEBUG:teuthology.orchestra.run.smithi042:> import os 2024-09-17T01:48:55.408 DEBUG:teuthology.orchestra.run.smithi042:> import uuid 2024-09-17T01:48:55.408 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:48:55.408 DEBUG:teuthology.orchestra.run.smithi042:> n = 1000 2024-09-17T01:48:55.408 DEBUG:teuthology.orchestra.run.smithi042:> create_hard_links = False 2024-09-17T01:48:55.408 DEBUG:teuthology.orchestra.run.smithi042:> if 0 > 0: 2024-09-17T01:48:55.408 DEBUG:teuthology.orchestra.run.smithi042:> create_hard_links = True 2024-09-17T01:48:55.408 DEBUG:teuthology.orchestra.run.smithi042:> path = "/home/ubuntu/cephtest/mnt.0/scrub-new-files/file" 2024-09-17T01:48:55.408 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:48:55.408 DEBUG:teuthology.orchestra.run.smithi042:> dpath = os.path.dirname(path) 2024-09-17T01:48:55.408 DEBUG:teuthology.orchestra.run.smithi042:> fnameprefix = os.path.basename(path) 2024-09-17T01:48:55.408 DEBUG:teuthology.orchestra.run.smithi042:> os.makedirs(dpath, exist_ok=True) 2024-09-17T01:48:55.409 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:48:55.409 DEBUG:teuthology.orchestra.run.smithi042:> try: 2024-09-17T01:48:55.409 DEBUG:teuthology.orchestra.run.smithi042:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-17T01:48:55.409 DEBUG:teuthology.orchestra.run.smithi042:> 2024-09-17T01:48:55.409 DEBUG:teuthology.orchestra.run.smithi042:> for i in range(n): 2024-09-17T01:48:55.409 DEBUG:teuthology.orchestra.run.smithi042:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-17T01:48:55.409 DEBUG:teuthology.orchestra.run.smithi042:> with open(fpath, '"'"'w'"'"') as f: 2024-09-17T01:48:55.409 DEBUG:teuthology.orchestra.run.smithi042:> f.write(f"{i}") 2024-09-17T01:48:55.409 DEBUG:teuthology.orchestra.run.smithi042:> if False: 2024-09-17T01:48:55.409 DEBUG:teuthology.orchestra.run.smithi042:> f.flush() 2024-09-17T01:48:55.409 DEBUG:teuthology.orchestra.run.smithi042:> os.fsync(f.fileno()) 2024-09-17T01:48:55.409 DEBUG:teuthology.orchestra.run.smithi042:> if False: 2024-09-17T01:48:55.409 DEBUG:teuthology.orchestra.run.smithi042:> os.unlink(fpath) 2024-09-17T01:48:55.409 DEBUG:teuthology.orchestra.run.smithi042:> if False: 2024-09-17T01:48:55.409 DEBUG:teuthology.orchestra.run.smithi042:> os.fsync(dirfd) 2024-09-17T01:48:55.410 DEBUG:teuthology.orchestra.run.smithi042:> if create_hard_links: 2024-09-17T01:48:55.410 DEBUG:teuthology.orchestra.run.smithi042:> for j in range(0): 2024-09-17T01:48:55.410 DEBUG:teuthology.orchestra.run.smithi042:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-17T01:48:55.410 DEBUG:teuthology.orchestra.run.smithi042:> if False: 2024-09-17T01:48:55.410 DEBUG:teuthology.orchestra.run.smithi042:> os.fsync(dirfd) 2024-09-17T01:48:55.410 DEBUG:teuthology.orchestra.run.smithi042:> finally: 2024-09-17T01:48:55.410 DEBUG:teuthology.orchestra.run.smithi042:> os.close(dirfd) 2024-09-17T01:48:55.410 DEBUG:teuthology.orchestra.run.smithi042:> ' 2024-09-17T01:48:56.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:48:56.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:48:56.790 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.15:0 scrub status 2024-09-17T01:48:57.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.065+0000 7f434cc00640 1 -- 172.21.15.42:0/164781534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43480cf480 msgr2=0x7f43480cf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:57.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.065+0000 7f434cc00640 1 --2- 172.21.15.42:0/164781534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43480cf480 0x7f43480cf890 secure :-1 s=READY pgs=2450 cs=0 l=1 rev1=1 crypto rx=0x7f43480cffb0 tx=0x7f434002a980 comp rx=0 tx=0).stop 2024-09-17T01:48:57.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.065+0000 7f434cc00640 1 -- 172.21.15.42:0/164781534 shutdown_connections 2024-09-17T01:48:57.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.065+0000 7f434cc00640 1 --2- 172.21.15.42:0/164781534 >> v2:172.21.15.43:3300/0 conn(0x7f434815fe40 0x7f4348152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.065+0000 7f434cc00640 1 --2- 172.21.15.42:0/164781534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43480cf480 0x7f43480cf890 unknown :-1 s=CLOSED pgs=2450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.065+0000 7f434cc00640 1 --2- 172.21.15.42:0/164781534 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f434815c9f0 0x7f434806f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.065+0000 7f434cc00640 1 -- 172.21.15.42:0/164781534 >> 172.21.15.42:0/164781534 conn(0x7f434806d3f0 msgr2=0x7f43480b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:57.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.065+0000 7f434cc00640 1 -- 172.21.15.42:0/164781534 shutdown_connections 2024-09-17T01:48:57.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.065+0000 7f434cc00640 1 -- 172.21.15.42:0/164781534 wait complete. 2024-09-17T01:48:57.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.068+0000 7f434cc00640 1 Processor -- start 2024-09-17T01:48:57.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.069+0000 7f434cc00640 1 -- start start 2024-09-17T01:48:57.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.071+0000 7f434cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43480cf480 0x7f43481456a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.071+0000 7f434cc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f434815c9f0 0x7f4348145e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.071+0000 7f434cc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f434815fe40 0x7f43481463a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.071+0000 7f434cc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4348152ce0 con 0x7f43480cf480 2024-09-17T01:48:57.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.071+0000 7f434cc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4348073f40 con 0x7f434815fe40 2024-09-17T01:48:57.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.071+0000 7f434cc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f434806e200 con 0x7f434815c9f0 2024-09-17T01:48:57.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.071+0000 7f4347400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43480cf480 0x7f43481456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.071+0000 7f4347400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43480cf480 0x7f43481456a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51822/0 (socket says 172.21.15.42:51822) 2024-09-17T01:48:57.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.071+0000 7f4347400640 1 -- 172.21.15.42:0/2768995324 learned_addr learned my addr 172.21.15.42:0/2768995324 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:57.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.071+0000 7f433ea00640 1 --2- 172.21.15.42:0/2768995324 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f434815c9f0 0x7f4348145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.071+0000 7f4347e00640 1 --2- 172.21.15.42:0/2768995324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f434815fe40 0x7f43481463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.072+0000 7f4347400640 1 -- 172.21.15.42:0/2768995324 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f434815c9f0 msgr2=0x7f4348145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:57.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.072+0000 7f4347400640 1 --2- 172.21.15.42:0/2768995324 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f434815c9f0 0x7f4348145e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.072+0000 7f4347400640 1 -- 172.21.15.42:0/2768995324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f434815fe40 msgr2=0x7f43481463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:57.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.072+0000 7f4347400640 1 --2- 172.21.15.42:0/2768995324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f434815fe40 0x7f43481463a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.072+0000 7f4347400640 1 -- 172.21.15.42:0/2768995324 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43480c6c10 con 0x7f43480cf480 2024-09-17T01:48:57.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.072+0000 7f4347e00640 1 --2- 172.21.15.42:0/2768995324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f434815fe40 0x7f43481463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:57.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.072+0000 7f4347400640 1 --2- 172.21.15.42:0/2768995324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43480cf480 0x7f43481456a0 secure :-1 s=READY pgs=2451 cs=0 l=1 rev1=1 crypto rx=0x7f433800e790 tx=0x7f433800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:57.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.072+0000 7f433fe00640 1 -- 172.21.15.42:0/2768995324 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433800eea0 con 0x7f43480cf480 2024-09-17T01:48:57.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.072+0000 7f433fe00640 1 -- 172.21.15.42:0/2768995324 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f433800cdb0 con 0x7f43480cf480 2024-09-17T01:48:57.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.072+0000 7f433fe00640 1 -- 172.21.15.42:0/2768995324 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338010690 con 0x7f43480cf480 2024-09-17T01:48:57.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.072+0000 7f434cc00640 1 -- 172.21.15.42:0/2768995324 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43480c6ef0 con 0x7f43480cf480 2024-09-17T01:48:57.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.072+0000 7f434cc00640 1 -- 172.21.15.42:0/2768995324 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43480c74b0 con 0x7f43480cf480 2024-09-17T01:48:57.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.075+0000 7f433fe00640 1 -- 172.21.15.42:0/2768995324 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4338010830 con 0x7f43480cf480 2024-09-17T01:48:57.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.076+0000 7f433fe00640 1 --2- 172.21.15.42:0/2768995324 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4324078b90 0x7f432407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.076+0000 7f433fe00640 1 -- 172.21.15.42:0/2768995324 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(215..215 src has 1..215) ==== 5912+0+0 (secure 0 0 0) 0x7f433809b7f0 con 0x7f43480cf480 2024-09-17T01:48:57.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.076+0000 7f4355206740 1 Processor -- start 2024-09-17T01:48:57.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.076+0000 7f433ea00640 1 --2- 172.21.15.42:0/2768995324 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4324078b90 0x7f432407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.076+0000 7f4355206740 1 -- start start 2024-09-17T01:48:57.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.077+0000 7f433ea00640 1 --2- 172.21.15.42:0/2768995324 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4324078b90 0x7f432407b0a0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f434815be50 tx=0x7f4330005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:57.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.078+0000 7f4355206740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295cca390 0x5642960b8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.078+0000 7f4355206740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564295ca14d0 0x56429609b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.078+0000 7f4355206740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564295ca96b0 0x56429609b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.078+0000 7f4355206740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564295fd11c0 con 0x564295cca390 2024-09-17T01:48:57.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.078+0000 7f4355206740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564295fe4870 con 0x564295ca14d0 2024-09-17T01:48:57.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.078+0000 7f4355206740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x564295fd3ca0 con 0x564295ca96b0 2024-09-17T01:48:57.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.078+0000 7f4347400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295cca390 0x5642960b8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.078+0000 7f4347400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295cca390 0x5642960b8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51834/0 (socket says 172.21.15.42:51834) 2024-09-17T01:48:57.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.078+0000 7f4347400640 1 -- 172.21.15.42:0/1179121180 learned_addr learned my addr 172.21.15.42:0/1179121180 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:57.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.078+0000 7f433ea00640 1 --2- 172.21.15.42:0/1179121180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564295ca14d0 0x56429609b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.079+0000 7f4347e00640 1 --2- 172.21.15.42:0/1179121180 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564295ca96b0 0x56429609b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.079+0000 7f4347400640 1 -- 172.21.15.42:0/1179121180 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564295ca96b0 msgr2=0x56429609b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:57.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.079+0000 7f4347400640 1 --2- 172.21.15.42:0/1179121180 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564295ca96b0 0x56429609b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.079+0000 7f4347400640 1 -- 172.21.15.42:0/1179121180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564295ca14d0 msgr2=0x56429609b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:57.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.079+0000 7f4347400640 1 --2- 172.21.15.42:0/1179121180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564295ca14d0 0x56429609b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.079+0000 7f4347400640 1 -- 172.21.15.42:0/1179121180 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564295dac7d0 con 0x564295cca390 2024-09-17T01:48:57.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.079+0000 7f4347400640 1 --2- 172.21.15.42:0/1179121180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295cca390 0x5642960b8730 secure :-1 s=READY pgs=2452 cs=0 l=1 rev1=1 crypto rx=0x7f4338063400 tx=0x7f4338063350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e825f09105157d2d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:57.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.079+0000 7f4337400640 1 -- 172.21.15.42:0/1179121180 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433806cde0 con 0x564295cca390 2024-09-17T01:48:57.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.079+0000 7f4337400640 1 -- 172.21.15.42:0/1179121180 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4338085bc0 con 0x564295cca390 2024-09-17T01:48:57.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.079+0000 7f4337400640 1 -- 172.21.15.42:0/1179121180 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43380626d0 con 0x564295cca390 2024-09-17T01:48:57.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.080+0000 7f4355206740 1 -- 172.21.15.42:0/1179121180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295cca390 msgr2=0x5642960b8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:57.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.080+0000 7f4355206740 1 --2- 172.21.15.42:0/1179121180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295cca390 0x5642960b8730 secure :-1 s=READY pgs=2452 cs=0 l=1 rev1=1 crypto rx=0x7f4338063400 tx=0x7f4338063350 comp rx=0 tx=0).stop 2024-09-17T01:48:57.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.080+0000 7f4355206740 1 -- 172.21.15.42:0/1179121180 shutdown_connections 2024-09-17T01:48:57.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.080+0000 7f4355206740 1 --2- 172.21.15.42:0/1179121180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564295ca14d0 0x56429609b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.080+0000 7f4355206740 1 --2- 172.21.15.42:0/1179121180 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564295ca96b0 0x56429609b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.080+0000 7f4355206740 1 --2- 172.21.15.42:0/1179121180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295cca390 0x5642960b8730 unknown :-1 s=CLOSED pgs=2452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.080+0000 7f4355206740 1 -- 172.21.15.42:0/1179121180 >> 172.21.15.42:0/1179121180 conn(0x564295cbe4e0 msgr2=0x564296071620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:57.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.080+0000 7f4355206740 1 -- 172.21.15.42:0/1179121180 shutdown_connections 2024-09-17T01:48:57.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.080+0000 7f4355206740 1 -- 172.21.15.42:0/1179121180 wait complete. 2024-09-17T01:48:57.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.081+0000 7f4355206740 1 -- start start 2024-09-17T01:48:57.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.082+0000 7f4355206740 1 Processor -- start 2024-09-17T01:48:57.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.083+0000 7f4355206740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564295ca14d0 0x564296098160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.083+0000 7f4355206740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295ca96b0 0x564296096ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.083+0000 7f4355206740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564295cca390 0x564296097010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.083+0000 7f4355206740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564295f7a410 con 0x564295ca96b0 2024-09-17T01:48:57.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.083+0000 7f4355206740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564295fd7ab0 con 0x564295cca390 2024-09-17T01:48:57.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.083+0000 7f4355206740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x564295d44740 con 0x564295ca14d0 2024-09-17T01:48:57.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.083+0000 7f4355206740 10 client.0 _ll_register_callbacks cb 0x564295f57360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:48:57.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.083+0000 7f433ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295ca96b0 0x564296096ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.083+0000 7f4347400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564295ca14d0 0x564296098160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.083+0000 7f433ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295ca96b0 0x564296096ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51840/0 (socket says 172.21.15.42:51840) 2024-09-17T01:48:57.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.083+0000 7f433ea00640 1 -- 172.21.15.42:0/3837140833 learned_addr learned my addr 172.21.15.42:0/3837140833 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:57.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.084+0000 7f4347e00640 1 --2- 172.21.15.42:0/3837140833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564295cca390 0x564296097010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.084+0000 7f433ea00640 1 -- 172.21.15.42:0/3837140833 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564295ca14d0 msgr2=0x564296098160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:57.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.084+0000 7f433ea00640 1 --2- 172.21.15.42:0/3837140833 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564295ca14d0 0x564296098160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.084+0000 7f433ea00640 1 -- 172.21.15.42:0/3837140833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564295cca390 msgr2=0x564296097010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:57.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.084+0000 7f433ea00640 1 --2- 172.21.15.42:0/3837140833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564295cca390 0x564296097010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.084+0000 7f433ea00640 1 -- 172.21.15.42:0/3837140833 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564295d35970 con 0x564295ca96b0 2024-09-17T01:48:57.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.084+0000 7f433ea00640 1 --2- 172.21.15.42:0/3837140833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295ca96b0 0x564296096ad0 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 crypto rx=0x7f43300044c0 tx=0x7f4330004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc965b4d744cc8a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:57.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.084+0000 7f432be00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:48:57.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.084+0000 7f432be00640 1 -- 172.21.15.42:0/3837140833 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4330005220 con 0x564295ca96b0 2024-09-17T01:48:57.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.085+0000 7f432be00640 1 -- 172.21.15.42:0/3837140833 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(215..215 src has 1..215) ==== 5912+0+0 (secure 0 0 0) 0x7f43300053c0 con 0x564295ca96b0 2024-09-17T01:48:57.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.085+0000 7f4355206740 1 -- 172.21.15.42:0/3837140833 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4338085bc0 con 0x564295ca96b0 2024-09-17T01:48:57.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.085+0000 7f432be00640 1 -- 172.21.15.42:0/3837140833 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=168) ==== 24+0+0 (secure 0 0 0) 0x7f433002f050 con 0x564295ca96b0 2024-09-17T01:48:57.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.085+0000 7f4355206740 10 client.11352 fetch_fsmap learned FSMap version 168 2024-09-17T01:48:57.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.085+0000 7f4355206740 1 -- 172.21.15.42:0/3837140833 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=168,monmap=2+}) -- 0x564295d136a0 con 0x564295ca96b0 2024-09-17T01:48:57.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.085+0000 7f432be00640 1 -- 172.21.15.42:0/3837140833 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4338085bc0 con 0x564295ca96b0 2024-09-17T01:48:57.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.085+0000 7f432be00640 1 -- 172.21.15.42:0/3837140833 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 168) ==== 3502+0+0 (secure 0 0 0) 0x7f4330026030 con 0x564295ca96b0 2024-09-17T01:48:57.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.085+0000 7f4355206740 10 client.11352 fetch_fsmap finished waiting for FSMap version 168 2024-09-17T01:48:57.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.085+0000 7f4355206740 10 client.11352 resolve_mds: resolved 15:0 to role '15:0' aka daemon mds.b 2024-09-17T01:48:57.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.085+0000 7f4355206740 20 client.11352 populate_metadata read hostname 'smithi042' 2024-09-17T01:48:57.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.085+0000 7f4355206740 1 --2- 172.21.15.42:0/3837140833 >> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] conn(0x564295c88f60 0x5642960c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.085+0000 7f4355206740 4 client.11352 mds_command: new command op to 11193 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:48:57.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.085+0000 7f4355206740 1 -- 172.21.15.42:0/3837140833 --> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564295fe67c0 con 0x564295c88f60 2024-09-17T01:48:57.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.086+0000 7f4347400640 1 --2- 172.21.15.42:0/3837140833 >> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] conn(0x564295c88f60 0x5642960c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.086+0000 7f4347400640 1 --2- 172.21.15.42:0/3837140833 >> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] conn(0x564295c88f60 0x5642960c8dd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38dfd9c67d264484 server_cookie=24c4de4a5ea8c867 in_seq=0 out_seq=0 2024-09-17T01:48:57.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.086+0000 7f432be00640 10 client.11352 ms_handle_connect on v2:172.21.15.43:6835/777529944 2024-09-17T01:48:57.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.088+0000 7f432be00640 1 -- 172.21.15.42:0/3837140833 <== mds.0 v2:172.21.15.43:6835/777529944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564295fe67c0 con 0x564295c88f60 2024-09-17T01:48:57.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.088+0000 7f432be00640 10 client.11352 handle_command_reply: tid=0 2024-09-17T01:48:57.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.088+0000 7f4355206740 1 client.11352 shutdown 2024-09-17T01:48:57.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.088+0000 7f4355206740 1 -- 172.21.15.42:0/3837140833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295ca96b0 msgr2=0x564296096ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:57.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.088+0000 7f4355206740 1 --2- 172.21.15.42:0/3837140833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295ca96b0 0x564296096ad0 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 crypto rx=0x7f43300044c0 tx=0x7f4330004730 comp rx=0 tx=0).stop 2024-09-17T01:48:57.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.088+0000 7f4355206740 1 -- 172.21.15.42:0/3837140833 shutdown_connections 2024-09-17T01:48:57.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.088+0000 7f4355206740 1 --2- 172.21.15.42:0/3837140833 >> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] conn(0x564295c88f60 0x5642960c8dd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.088+0000 7f4355206740 1 --2- 172.21.15.42:0/3837140833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564295cca390 0x564296097010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.088+0000 7f4355206740 1 --2- 172.21.15.42:0/3837140833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295ca96b0 0x564296096ad0 unknown :-1 s=CLOSED pgs=2453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.088+0000 7f4355206740 1 --2- 172.21.15.42:0/3837140833 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564295ca14d0 0x564296098160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.088+0000 7f432be00640 0 client.11352 ms_handle_reset on v2:172.21.15.43:6835/777529944 2024-09-17T01:48:57.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.088+0000 7f4355206740 1 -- 172.21.15.42:0/3837140833 >> 172.21.15.42:0/3837140833 conn(0x564295cbe4e0 msgr2=0x5642960b9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:57.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.088+0000 7f4355206740 1 -- 172.21.15.42:0/3837140833 shutdown_connections 2024-09-17T01:48:57.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.088+0000 7f4355206740 1 -- 172.21.15.42:0/3837140833 wait complete. 2024-09-17T01:48:57.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.088+0000 7f4355206740 20 client.11352 trim_cache size 0 max 16384 2024-09-17T01:48:57.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.107+0000 7f4355206740 1 Processor -- start 2024-09-17T01:48:57.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.107+0000 7f4355206740 1 -- start start 2024-09-17T01:48:57.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.108+0000 7f4355206740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295ca14d0 0x5642960b9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.108+0000 7f4355206740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564295ca96b0 0x5642960b99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.108+0000 7f4355206740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564295cca390 0x564296094dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.109+0000 7f4355206740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4348202650 con 0x564295ca14d0 2024-09-17T01:48:57.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.109+0000 7f4355206740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4348201660 con 0x564295cca390 2024-09-17T01:48:57.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.109+0000 7f4355206740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4348148810 con 0x564295ca96b0 2024-09-17T01:48:57.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.109+0000 7f4347400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295ca14d0 0x5642960b9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.109+0000 7f4347400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295ca14d0 0x5642960b9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51850/0 (socket says 172.21.15.42:51850) 2024-09-17T01:48:57.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.109+0000 7f4347400640 1 -- 172.21.15.42:0/4017147272 learned_addr learned my addr 172.21.15.42:0/4017147272 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:57.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.109+0000 7f4347400640 1 -- 172.21.15.42:0/4017147272 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564295ca96b0 msgr2=0x5642960b99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:57.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.109+0000 7f4347e00640 1 --2- 172.21.15.42:0/4017147272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564295cca390 0x564296094dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.109+0000 7f433ea00640 1 --2- 172.21.15.42:0/4017147272 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564295ca96b0 0x5642960b99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.109+0000 7f4347400640 1 --2- 172.21.15.42:0/4017147272 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564295ca96b0 0x5642960b99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.109+0000 7f4347400640 1 -- 172.21.15.42:0/4017147272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564295cca390 msgr2=0x564296094dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:57.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.109+0000 7f4347400640 1 --2- 172.21.15.42:0/4017147272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564295cca390 0x564296094dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.109+0000 7f4347400640 1 -- 172.21.15.42:0/4017147272 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642960aeec0 con 0x564295ca14d0 2024-09-17T01:48:57.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.109+0000 7f4347e00640 1 --2- 172.21.15.42:0/4017147272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564295cca390 0x564296094dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:48:57.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.109+0000 7f433ea00640 1 --2- 172.21.15.42:0/4017147272 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564295ca96b0 0x5642960b99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:48:57.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.109+0000 7f4347400640 1 --2- 172.21.15.42:0/4017147272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295ca14d0 0x5642960b9480 secure :-1 s=READY pgs=2454 cs=0 l=1 rev1=1 crypto rx=0x7f4338063400 tx=0x7f4338066040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7770a2d92a196be server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:57.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.110+0000 7f4336a00640 1 -- 172.21.15.42:0/4017147272 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338085bc0 con 0x564295ca14d0 2024-09-17T01:48:57.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.110+0000 7f4336a00640 1 -- 172.21.15.42:0/4017147272 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4338081070 con 0x564295ca14d0 2024-09-17T01:48:57.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.110+0000 7f4336a00640 1 -- 172.21.15.42:0/4017147272 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43380626d0 con 0x564295ca14d0 2024-09-17T01:48:57.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.110+0000 7f4355206740 1 -- 172.21.15.42:0/4017147272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295ca14d0 msgr2=0x5642960b9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:57.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.110+0000 7f4355206740 1 --2- 172.21.15.42:0/4017147272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295ca14d0 0x5642960b9480 secure :-1 s=READY pgs=2454 cs=0 l=1 rev1=1 crypto rx=0x7f4338063400 tx=0x7f4338066040 comp rx=0 tx=0).stop 2024-09-17T01:48:57.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.111+0000 7f4355206740 1 -- 172.21.15.42:0/4017147272 shutdown_connections 2024-09-17T01:48:57.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.111+0000 7f4355206740 1 --2- 172.21.15.42:0/4017147272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564295cca390 0x564296094dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.111+0000 7f4355206740 1 --2- 172.21.15.42:0/4017147272 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564295ca96b0 0x5642960b99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.111+0000 7f4355206740 1 --2- 172.21.15.42:0/4017147272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295ca14d0 0x5642960b9480 unknown :-1 s=CLOSED pgs=2454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.111+0000 7f4355206740 1 -- 172.21.15.42:0/4017147272 >> 172.21.15.42:0/4017147272 conn(0x564295cbe4e0 msgr2=0x5642960c2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:57.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.111+0000 7f4355206740 1 -- 172.21.15.42:0/4017147272 shutdown_connections 2024-09-17T01:48:57.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.111+0000 7f4355206740 1 -- 172.21.15.42:0/4017147272 wait complete. 2024-09-17T01:48:57.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.112+0000 7f4355206740 1 -- start start 2024-09-17T01:48:57.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.112+0000 7f4355206740 1 Processor -- start 2024-09-17T01:48:57.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.113+0000 7f4355206740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564295ca14d0 0x5642961329e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.113+0000 7f4355206740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295ca96b0 0x564296089880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.113+0000 7f4355206740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564295cca390 0x5642960d8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.113+0000 7f4355206740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4348148e60 con 0x564295ca96b0 2024-09-17T01:48:57.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.113+0000 7f4355206740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5642960b0460 con 0x564295cca390 2024-09-17T01:48:57.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.113+0000 7f4355206740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5642960d9ae0 con 0x564295ca14d0 2024-09-17T01:48:57.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.113+0000 7f4355206740 10 client.0 _ll_register_callbacks cb 0x7f4330011b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:48:57.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.113+0000 7f433ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295ca96b0 0x564296089880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.113+0000 7f433ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295ca96b0 0x564296089880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51864/0 (socket says 172.21.15.42:51864) 2024-09-17T01:48:57.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.113+0000 7f433ea00640 1 -- 172.21.15.42:0/3071715414 learned_addr learned my addr 172.21.15.42:0/3071715414 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:57.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.114+0000 7f4347400640 1 --2- 172.21.15.42:0/3071715414 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564295ca14d0 0x5642961329e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.114+0000 7f4347e00640 1 --2- 172.21.15.42:0/3071715414 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564295cca390 0x5642960d8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.114+0000 7f433ea00640 1 -- 172.21.15.42:0/3071715414 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564295ca14d0 msgr2=0x5642961329e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:57.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.114+0000 7f433ea00640 1 --2- 172.21.15.42:0/3071715414 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564295ca14d0 0x5642961329e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.114+0000 7f433ea00640 1 -- 172.21.15.42:0/3071715414 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564295cca390 msgr2=0x5642960d8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:57.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.114+0000 7f433ea00640 1 --2- 172.21.15.42:0/3071715414 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564295cca390 0x5642960d8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.114+0000 7f433ea00640 1 -- 172.21.15.42:0/3071715414 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56429608b6d0 con 0x564295ca96b0 2024-09-17T01:48:57.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.114+0000 7f433ea00640 1 --2- 172.21.15.42:0/3071715414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295ca96b0 0x564296089880 secure :-1 s=READY pgs=2455 cs=0 l=1 rev1=1 crypto rx=0x7f4330004850 tx=0x7f4330005b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aec50f195bd545a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:57.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.114+0000 7f432be00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:48:57.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.114+0000 7f432be00640 1 -- 172.21.15.42:0/3071715414 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4330037020 con 0x564295ca96b0 2024-09-17T01:48:57.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.115+0000 7f432be00640 1 -- 172.21.15.42:0/3071715414 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(215..215 src has 1..215) ==== 5912+0+0 (secure 0 0 0) 0x7f433001e840 con 0x564295ca96b0 2024-09-17T01:48:57.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.115+0000 7f4355206740 1 -- 172.21.15.42:0/3071715414 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4338081070 con 0x564295ca96b0 2024-09-17T01:48:57.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.115+0000 7f432be00640 1 -- 172.21.15.42:0/3071715414 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=168) ==== 24+0+0 (secure 0 0 0) 0x7f433001ea40 con 0x564295ca96b0 2024-09-17T01:48:57.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.115+0000 7f4355206740 10 client.11358 fetch_fsmap learned FSMap version 168 2024-09-17T01:48:57.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.115+0000 7f4355206740 1 -- 172.21.15.42:0/3071715414 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=168,monmap=2+}) -- 0x564296070c70 con 0x564295ca96b0 2024-09-17T01:48:57.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.115+0000 7f432be00640 1 -- 172.21.15.42:0/3071715414 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4338081070 con 0x564295ca96b0 2024-09-17T01:48:57.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.115+0000 7f432be00640 1 -- 172.21.15.42:0/3071715414 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 168) ==== 3502+0+0 (secure 0 0 0) 0x7f4330026030 con 0x564295ca96b0 2024-09-17T01:48:57.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.115+0000 7f4355206740 10 client.11358 fetch_fsmap finished waiting for FSMap version 168 2024-09-17T01:48:57.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.115+0000 7f4355206740 10 client.11358 resolve_mds: resolved 15:0 to role '15:0' aka daemon mds.b 2024-09-17T01:48:57.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.115+0000 7f4355206740 20 client.11358 populate_metadata read hostname 'smithi042' 2024-09-17T01:48:57.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.115+0000 7f4355206740 1 --2- 172.21.15.42:0/3071715414 >> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] conn(0x5642960d9290 0x564296096990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.115+0000 7f4355206740 4 client.11358 mds_command: new command op to 11193 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:48:57.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.115+0000 7f4355206740 1 -- 172.21.15.42:0/3071715414 --> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564295fe2270 con 0x5642960d9290 2024-09-17T01:48:57.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.116+0000 7f4347400640 1 --2- 172.21.15.42:0/3071715414 >> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] conn(0x5642960d9290 0x564296096990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.116+0000 7f4347400640 1 --2- 172.21.15.42:0/3071715414 >> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] conn(0x5642960d9290 0x564296096990 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e28ab12b74c3f1f0 server_cookie=549afc69c3f89206 in_seq=0 out_seq=0 2024-09-17T01:48:57.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.116+0000 7f432be00640 10 client.11358 ms_handle_connect on v2:172.21.15.43:6835/777529944 2024-09-17T01:48:57.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.116+0000 7f432be00640 1 -- 172.21.15.42:0/3071715414 <== mds.0 v2:172.21.15.43:6835/777529944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+86 (crc 0 0 0) 0x564295fe2270 con 0x5642960d9290 2024-09-17T01:48:57.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.116+0000 7f432be00640 10 client.11358 handle_command_reply: tid=0 2024-09-17T01:48:57.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.116+0000 7f4355206740 1 client.11358 shutdown 2024-09-17T01:48:57.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.116+0000 7f4355206740 1 -- 172.21.15.42:0/3071715414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295ca96b0 msgr2=0x564296089880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:57.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.116+0000 7f4355206740 1 --2- 172.21.15.42:0/3071715414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295ca96b0 0x564296089880 secure :-1 s=READY pgs=2455 cs=0 l=1 rev1=1 crypto rx=0x7f4330004850 tx=0x7f4330005b20 comp rx=0 tx=0).stop 2024-09-17T01:48:57.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.117+0000 7f4355206740 1 -- 172.21.15.42:0/3071715414 shutdown_connections 2024-09-17T01:48:57.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.117+0000 7f4355206740 1 --2- 172.21.15.42:0/3071715414 >> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] conn(0x5642960d9290 0x564296096990 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.117+0000 7f4355206740 1 --2- 172.21.15.42:0/3071715414 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564295cca390 0x5642960d8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.117+0000 7f4355206740 1 --2- 172.21.15.42:0/3071715414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564295ca96b0 0x564296089880 unknown :-1 s=CLOSED pgs=2455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.117+0000 7f432be00640 0 client.11358 ms_handle_reset on v2:172.21.15.43:6835/777529944 2024-09-17T01:48:57.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.117+0000 7f4355206740 1 --2- 172.21.15.42:0/3071715414 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x564295ca14d0 0x5642961329e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.117+0000 7f4355206740 1 -- 172.21.15.42:0/3071715414 >> 172.21.15.42:0/3071715414 conn(0x564295cbe4e0 msgr2=0x5642960af610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:57.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.117+0000 7f4355206740 1 -- 172.21.15.42:0/3071715414 shutdown_connections 2024-09-17T01:48:57.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.117+0000 7f4355206740 1 -- 172.21.15.42:0/3071715414 wait complete. 2024-09-17T01:48:57.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.117+0000 7f4355206740 20 client.11358 trim_cache size 0 max 16384 2024-09-17T01:48:57.119 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:48:57.119 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-09-17T01:48:57.119 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {}, 2024-09-17T01:48:57.119 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_stats": {} 2024-09-17T01:48:57.119 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:48:57.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.117+0000 7f434cc00640 1 -- 172.21.15.42:0/2768995324 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4324078b90 msgr2=0x7f432407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:57.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.117+0000 7f434cc00640 1 --2- 172.21.15.42:0/2768995324 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4324078b90 0x7f432407b0a0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f434815be50 tx=0x7f4330005f90 comp rx=0 tx=0).stop 2024-09-17T01:48:57.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.117+0000 7f434cc00640 1 -- 172.21.15.42:0/2768995324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43480cf480 msgr2=0x7f43481456a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:57.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.117+0000 7f434cc00640 1 --2- 172.21.15.42:0/2768995324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43480cf480 0x7f43481456a0 secure :-1 s=READY pgs=2451 cs=0 l=1 rev1=1 crypto rx=0x7f433800e790 tx=0x7f433800ec50 comp rx=0 tx=0).stop 2024-09-17T01:48:57.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.118+0000 7f434cc00640 1 -- 172.21.15.42:0/2768995324 shutdown_connections 2024-09-17T01:48:57.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.118+0000 7f434cc00640 1 --2- 172.21.15.42:0/2768995324 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4324078b90 0x7f432407b0a0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.118+0000 7f434cc00640 1 --2- 172.21.15.42:0/2768995324 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f434815fe40 0x7f43481463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.118+0000 7f434cc00640 1 --2- 172.21.15.42:0/2768995324 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f434815c9f0 0x7f4348145e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.118+0000 7f434cc00640 1 --2- 172.21.15.42:0/2768995324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43480cf480 0x7f43481456a0 unknown :-1 s=CLOSED pgs=2451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.118+0000 7f434cc00640 1 -- 172.21.15.42:0/2768995324 >> 172.21.15.42:0/2768995324 conn(0x7f434806d3f0 msgr2=0x7f43480b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:57.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.118+0000 7f434cc00640 1 -- 172.21.15.42:0/2768995324 shutdown_connections 2024-09-17T01:48:57.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.118+0000 7f434cc00640 1 -- 172.21.15.42:0/2768995324 wait complete. 2024-09-17T01:48:57.141 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T01:48:57.142 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.15:0 damage ls 2024-09-17T01:48:57.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.373+0000 7ff87a400640 1 -- 172.21.15.42:0/354042178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff858003f90 msgr2=0x7ff858004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:57.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.373+0000 7ff87a400640 1 --2- 172.21.15.42:0/354042178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff858003f90 0x7ff858004800 secure :-1 s=READY pgs=2457 cs=0 l=1 rev1=1 crypto rx=0x7ff860006f60 tx=0x7ff858005830 comp rx=0 tx=0).stop 2024-09-17T01:48:57.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.373+0000 7ff873e00640 1 -- 172.21.15.42:0/354042178 reap_dead start 2024-09-17T01:48:57.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.373+0000 7ff87a400640 1 -- 172.21.15.42:0/354042178 shutdown_connections 2024-09-17T01:48:57.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.373+0000 7ff87a400640 1 -- 172.21.15.42:0/354042178 >> 172.21.15.42:0/354042178 conn(0x7ff87406d1b0 msgr2=0x7ff87406d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:57.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.373+0000 7ff87a400640 1 -- 172.21.15.42:0/354042178 shutdown_connections 2024-09-17T01:48:57.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.373+0000 7ff87a400640 1 -- 172.21.15.42:0/354042178 wait complete. 2024-09-17T01:48:57.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.376+0000 7ff87a400640 1 Processor -- start 2024-09-17T01:48:57.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.376+0000 7ff87a400640 1 -- start start 2024-09-17T01:48:57.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.377+0000 7ff87a400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff858003f90 0x7ff874135900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.377+0000 7ff87a400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff874158ab0 0x7ff8740af370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.377+0000 7ff87a400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8740af8b0 0x7ff8741f2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.377+0000 7ff87a400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff874160d20 con 0x7ff8740af8b0 2024-09-17T01:48:57.376 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.377+0000 7ff87a400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff874160ba0 con 0x7ff858003f90 2024-09-17T01:48:57.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.377+0000 7ff87a400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff874160ea0 con 0x7ff874158ab0 2024-09-17T01:48:57.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.378+0000 7ff872a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff874158ab0 0x7ff8740af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.378+0000 7ff873400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff858003f90 0x7ff874135900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.378+0000 7ff873e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8740af8b0 0x7ff8741f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.378+0000 7ff872a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff874158ab0 0x7ff8740af370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:47662/0 (socket says 172.21.15.42:47662) 2024-09-17T01:48:57.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.378+0000 7ff872a00640 1 -- 172.21.15.42:0/3627280377 learned_addr learned my addr 172.21.15.42:0/3627280377 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:57.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.378+0000 7ff873e00640 1 -- 172.21.15.42:0/3627280377 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff874158ab0 msgr2=0x7ff8740af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:57.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.378+0000 7ff873e00640 1 --2- 172.21.15.42:0/3627280377 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff874158ab0 0x7ff8740af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.378+0000 7ff873e00640 1 -- 172.21.15.42:0/3627280377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff858003f90 msgr2=0x7ff874135900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:57.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.378+0000 7ff873e00640 1 --2- 172.21.15.42:0/3627280377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff858003f90 0x7ff874135900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.378+0000 7ff873e00640 1 -- 172.21.15.42:0/3627280377 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8740aa6d0 con 0x7ff8740af8b0 2024-09-17T01:48:57.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.378+0000 7ff873e00640 1 --2- 172.21.15.42:0/3627280377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8740af8b0 0x7ff8741f2690 secure :-1 s=READY pgs=2458 cs=0 l=1 rev1=1 crypto rx=0x7ff874154290 tx=0x7ff86c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:57.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.379+0000 7ff86b400640 1 -- 172.21.15.42:0/3627280377 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86c015020 con 0x7ff8740af8b0 2024-09-17T01:48:57.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.379+0000 7ff86b400640 1 -- 172.21.15.42:0/3627280377 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff86c011960 con 0x7ff8740af8b0 2024-09-17T01:48:57.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.379+0000 7ff86b400640 1 -- 172.21.15.42:0/3627280377 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86c011db0 con 0x7ff8740af8b0 2024-09-17T01:48:57.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.379+0000 7ff87a400640 1 -- 172.21.15.42:0/3627280377 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8741582b0 con 0x7ff8740af8b0 2024-09-17T01:48:57.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.379+0000 7ff87a400640 1 -- 172.21.15.42:0/3627280377 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8741360f0 con 0x7ff8740af8b0 2024-09-17T01:48:57.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.381+0000 7ff86b400640 1 -- 172.21.15.42:0/3627280377 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff86c018020 con 0x7ff8740af8b0 2024-09-17T01:48:57.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.382+0000 7ff86b400640 1 --2- 172.21.15.42:0/3627280377 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff854078b90 0x7ff85407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.382+0000 7ff86b400640 1 -- 172.21.15.42:0/3627280377 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(215..215 src has 1..215) ==== 5912+0+0 (secure 0 0 0) 0x7ff86c09b400 con 0x7ff8740af8b0 2024-09-17T01:48:57.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.383+0000 7ff881605740 1 Processor -- start 2024-09-17T01:48:57.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.383+0000 7ff873400640 1 --2- 172.21.15.42:0/3627280377 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff854078b90 0x7ff85407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.383+0000 7ff881605740 1 -- start start 2024-09-17T01:48:57.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.383+0000 7ff873400640 1 --2- 172.21.15.42:0/3627280377 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff854078b90 0x7ff85407b0a0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7ff8740afd20 tx=0x7ff864005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:57.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.384+0000 7ff881605740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f283901390 0x55f283cee340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.384+0000 7ff881605740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2838d84d0 0x55f283ca3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.384+0000 7ff881605740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838e06b0 0x55f283ccf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.384+0000 7ff881605740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f283c1b6f0 con 0x55f2838e06b0 2024-09-17T01:48:57.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.384+0000 7ff881605740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f283c0ab20 con 0x55f2838d84d0 2024-09-17T01:48:57.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.384+0000 7ff881605740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55f283c0e930 con 0x55f283901390 2024-09-17T01:48:57.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.384+0000 7ff873e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838e06b0 0x55f283ccf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.384+0000 7ff873e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838e06b0 0x55f283ccf100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51890/0 (socket says 172.21.15.42:51890) 2024-09-17T01:48:57.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.385+0000 7ff873e00640 1 -- 172.21.15.42:0/941180577 learned_addr learned my addr 172.21.15.42:0/941180577 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:57.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.385+0000 7ff872a00640 1 --2- 172.21.15.42:0/941180577 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2838d84d0 0x55f283ca3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.385+0000 7ff873400640 1 --2- 172.21.15.42:0/941180577 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f283901390 0x55f283cee340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.385+0000 7ff873e00640 1 -- 172.21.15.42:0/941180577 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f283901390 msgr2=0x55f283cee340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:57.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.385+0000 7ff873e00640 1 --2- 172.21.15.42:0/941180577 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f283901390 0x55f283cee340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.385+0000 7ff873e00640 1 -- 172.21.15.42:0/941180577 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2838d84d0 msgr2=0x55f283ca3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:57.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.385+0000 7ff873e00640 1 --2- 172.21.15.42:0/941180577 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2838d84d0 0x55f283ca3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.385+0000 7ff873e00640 1 -- 172.21.15.42:0/941180577 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f28396c970 con 0x55f2838e06b0 2024-09-17T01:48:57.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.385+0000 7ff872a00640 1 --2- 172.21.15.42:0/941180577 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2838d84d0 0x55f283ca3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:48:57.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.385+0000 7ff873e00640 1 --2- 172.21.15.42:0/941180577 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838e06b0 0x55f283ccf100 secure :-1 s=READY pgs=2459 cs=0 l=1 rev1=1 crypto rx=0x7ff86c062df0 tx=0x7ff86c062860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e377e9921e8097 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:57.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.385+0000 7ff85fe00640 1 -- 172.21.15.42:0/941180577 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86c0630f0 con 0x55f2838e06b0 2024-09-17T01:48:57.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.386+0000 7ff85fe00640 1 -- 172.21.15.42:0/941180577 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff86c067bd0 con 0x55f2838e06b0 2024-09-17T01:48:57.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.386+0000 7ff85fe00640 1 -- 172.21.15.42:0/941180577 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86c06ca80 con 0x55f2838e06b0 2024-09-17T01:48:57.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.386+0000 7ff881605740 1 -- 172.21.15.42:0/941180577 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838e06b0 msgr2=0x55f283ccf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:57.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.386+0000 7ff881605740 1 --2- 172.21.15.42:0/941180577 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838e06b0 0x55f283ccf100 secure :-1 s=READY pgs=2459 cs=0 l=1 rev1=1 crypto rx=0x7ff86c062df0 tx=0x7ff86c062860 comp rx=0 tx=0).stop 2024-09-17T01:48:57.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.386+0000 7ff881605740 1 -- 172.21.15.42:0/941180577 shutdown_connections 2024-09-17T01:48:57.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.386+0000 7ff881605740 1 --2- 172.21.15.42:0/941180577 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2838d84d0 0x55f283ca3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.386+0000 7ff881605740 1 --2- 172.21.15.42:0/941180577 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838e06b0 0x55f283ccf100 unknown :-1 s=CLOSED pgs=2459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.386+0000 7ff881605740 1 --2- 172.21.15.42:0/941180577 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f283901390 0x55f283cee340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.386+0000 7ff881605740 1 -- 172.21.15.42:0/941180577 >> 172.21.15.42:0/941180577 conn(0x55f2838f54e0 msgr2=0x55f283ca85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:57.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.387+0000 7ff881605740 1 -- 172.21.15.42:0/941180577 shutdown_connections 2024-09-17T01:48:57.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.387+0000 7ff881605740 1 -- 172.21.15.42:0/941180577 wait complete. 2024-09-17T01:48:57.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.388+0000 7ff881605740 1 -- start start 2024-09-17T01:48:57.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.388+0000 7ff881605740 1 Processor -- start 2024-09-17T01:48:57.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.390+0000 7ff881605740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2838d84d0 0x55f283ccf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.390+0000 7ff881605740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838e06b0 0x55f283d037c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.397 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.390+0000 7ff881605740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f283901390 0x55f283cd0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.390+0000 7ff881605740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f28397b740 con 0x55f2838e06b0 2024-09-17T01:48:57.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.390+0000 7ff881605740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f283bb1290 con 0x55f2838d84d0 2024-09-17T01:48:57.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.390+0000 7ff881605740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55f283d00f40 con 0x55f283901390 2024-09-17T01:48:57.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.390+0000 7ff881605740 10 client.0 _ll_register_callbacks cb 0x55f283b8e1e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:48:57.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.390+0000 7ff872a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838e06b0 0x55f283d037c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.390+0000 7ff872a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838e06b0 0x55f283d037c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51904/0 (socket says 172.21.15.42:51904) 2024-09-17T01:48:57.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.390+0000 7ff873e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f283901390 0x55f283cd0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.390+0000 7ff872a00640 1 -- 172.21.15.42:0/3900117509 learned_addr learned my addr 172.21.15.42:0/3900117509 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:57.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.390+0000 7ff873400640 1 --2- 172.21.15.42:0/3900117509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2838d84d0 0x55f283ccf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.390+0000 7ff872a00640 1 -- 172.21.15.42:0/3900117509 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f283901390 msgr2=0x55f283cd0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:57.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.390+0000 7ff872a00640 1 --2- 172.21.15.42:0/3900117509 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f283901390 0x55f283cd0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.390+0000 7ff872a00640 1 -- 172.21.15.42:0/3900117509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2838d84d0 msgr2=0x55f283ccf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:57.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.390+0000 7ff872a00640 1 --2- 172.21.15.42:0/3900117509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2838d84d0 0x55f283ccf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.390+0000 7ff872a00640 1 -- 172.21.15.42:0/3900117509 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2839e37d0 con 0x55f2838e06b0 2024-09-17T01:48:57.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.391+0000 7ff873e00640 1 --2- 172.21.15.42:0/3900117509 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f283901390 0x55f283cd0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:48:57.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.391+0000 7ff872a00640 1 --2- 172.21.15.42:0/3900117509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838e06b0 0x55f283d037c0 secure :-1 s=READY pgs=2460 cs=0 l=1 rev1=1 crypto rx=0x7ff8600069b0 tx=0x7ff860001c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec998740f4a1069 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:57.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.391+0000 7ff85cc00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:48:57.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.391+0000 7ff85cc00640 1 -- 172.21.15.42:0/3900117509 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff860032070 con 0x55f2838e06b0 2024-09-17T01:48:57.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.391+0000 7ff85cc00640 1 -- 172.21.15.42:0/3900117509 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(215..215 src has 1..215) ==== 5912+0+0 (secure 0 0 0) 0x7ff8600064f0 con 0x55f2838e06b0 2024-09-17T01:48:57.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.391+0000 7ff881605740 1 -- 172.21.15.42:0/3900117509 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff86c067bd0 con 0x55f2838e06b0 2024-09-17T01:48:57.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.391+0000 7ff85cc00640 1 -- 172.21.15.42:0/3900117509 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=168) ==== 24+0+0 (secure 0 0 0) 0x7ff86004e050 con 0x55f2838e06b0 2024-09-17T01:48:57.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.391+0000 7ff881605740 10 client.11370 fetch_fsmap learned FSMap version 168 2024-09-17T01:48:57.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.391+0000 7ff881605740 1 -- 172.21.15.42:0/3900117509 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=168,monmap=2+}) -- 0x55f283d03d00 con 0x55f2838e06b0 2024-09-17T01:48:57.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.392+0000 7ff85cc00640 1 -- 172.21.15.42:0/3900117509 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff86c067bd0 con 0x55f2838e06b0 2024-09-17T01:48:57.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.392+0000 7ff85cc00640 1 -- 172.21.15.42:0/3900117509 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 168) ==== 3502+0+0 (secure 0 0 0) 0x7ff860051020 con 0x55f2838e06b0 2024-09-17T01:48:57.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.392+0000 7ff881605740 10 client.11370 fetch_fsmap finished waiting for FSMap version 168 2024-09-17T01:48:57.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.392+0000 7ff881605740 10 client.11370 resolve_mds: resolved 15:0 to role '15:0' aka daemon mds.b 2024-09-17T01:48:57.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.392+0000 7ff881605740 20 client.11370 populate_metadata read hostname 'smithi042' 2024-09-17T01:48:57.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.392+0000 7ff881605740 1 --2- 172.21.15.42:0/3900117509 >> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] conn(0x55f2838bff60 0x55f283ce6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.392+0000 7ff881605740 4 client.11370 mds_command: new command op to 11193 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:48:57.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.392+0000 7ff881605740 1 -- 172.21.15.42:0/3900117509 --> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f283c1d640 con 0x55f2838bff60 2024-09-17T01:48:57.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.392+0000 7ff873400640 1 --2- 172.21.15.42:0/3900117509 >> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] conn(0x55f2838bff60 0x55f283ce6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.393+0000 7ff873400640 1 --2- 172.21.15.42:0/3900117509 >> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] conn(0x55f2838bff60 0x55f283ce6670 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a85137b436fdefdf server_cookie=4a1a2cafd0700bd6 in_seq=0 out_seq=0 2024-09-17T01:48:57.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.393+0000 7ff85cc00640 10 client.11370 ms_handle_connect on v2:172.21.15.43:6835/777529944 2024-09-17T01:48:57.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.394+0000 7ff85cc00640 1 -- 172.21.15.42:0/3900117509 <== mds.0 v2:172.21.15.43:6835/777529944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f283c1d640 con 0x55f2838bff60 2024-09-17T01:48:57.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.394+0000 7ff85cc00640 10 client.11370 handle_command_reply: tid=0 2024-09-17T01:48:57.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.394+0000 7ff881605740 1 client.11370 shutdown 2024-09-17T01:48:57.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.394+0000 7ff881605740 1 -- 172.21.15.42:0/3900117509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838e06b0 msgr2=0x55f283d037c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:57.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.394+0000 7ff881605740 1 --2- 172.21.15.42:0/3900117509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838e06b0 0x55f283d037c0 secure :-1 s=READY pgs=2460 cs=0 l=1 rev1=1 crypto rx=0x7ff8600069b0 tx=0x7ff860001c30 comp rx=0 tx=0).stop 2024-09-17T01:48:57.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.394+0000 7ff881605740 1 -- 172.21.15.42:0/3900117509 shutdown_connections 2024-09-17T01:48:57.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.394+0000 7ff881605740 1 --2- 172.21.15.42:0/3900117509 >> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] conn(0x55f2838bff60 0x55f283ce6670 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.394+0000 7ff881605740 1 --2- 172.21.15.42:0/3900117509 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f283901390 0x55f283cd0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.394+0000 7ff881605740 1 --2- 172.21.15.42:0/3900117509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838e06b0 0x55f283d037c0 unknown :-1 s=CLOSED pgs=2460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.394+0000 7ff85cc00640 0 client.11370 ms_handle_reset on v2:172.21.15.43:6835/777529944 2024-09-17T01:48:57.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.394+0000 7ff881605740 1 --2- 172.21.15.42:0/3900117509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2838d84d0 0x55f283ccf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.394+0000 7ff881605740 1 -- 172.21.15.42:0/3900117509 >> 172.21.15.42:0/3900117509 conn(0x55f2838f54e0 msgr2=0x55f283ca2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:57.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.394+0000 7ff881605740 1 -- 172.21.15.42:0/3900117509 shutdown_connections 2024-09-17T01:48:57.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.394+0000 7ff881605740 1 -- 172.21.15.42:0/3900117509 wait complete. 2024-09-17T01:48:57.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.394+0000 7ff881605740 20 client.11370 trim_cache size 0 max 16384 2024-09-17T01:48:57.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.409+0000 7ff881605740 1 Processor -- start 2024-09-17T01:48:57.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.409+0000 7ff881605740 1 -- start start 2024-09-17T01:48:57.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.410+0000 7ff881605740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838d84d0 0x55f283cc1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.410+0000 7ff881605740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f2838e06b0 0x55f283cc2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.410+0000 7ff881605740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f283901390 0x55f283cef330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.410+0000 7ff881605740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff874138370 con 0x55f2838d84d0 2024-09-17T01:48:57.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.410+0000 7ff881605740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff8740b5400 con 0x55f283901390 2024-09-17T01:48:57.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.410+0000 7ff881605740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff8741f7820 con 0x55f2838e06b0 2024-09-17T01:48:57.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.411+0000 7ff873400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838d84d0 0x55f283cc1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.411+0000 7ff873400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838d84d0 0x55f283cc1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51918/0 (socket says 172.21.15.42:51918) 2024-09-17T01:48:57.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.411+0000 7ff873400640 1 -- 172.21.15.42:0/1973905844 learned_addr learned my addr 172.21.15.42:0/1973905844 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:57.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.411+0000 7ff873e00640 1 --2- 172.21.15.42:0/1973905844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f283901390 0x55f283cef330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.411+0000 7ff872a00640 1 --2- 172.21.15.42:0/1973905844 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f2838e06b0 0x55f283cc2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.411+0000 7ff873400640 1 -- 172.21.15.42:0/1973905844 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f2838e06b0 msgr2=0x55f283cc2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:57.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.411+0000 7ff873400640 1 --2- 172.21.15.42:0/1973905844 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f2838e06b0 0x55f283cc2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.411+0000 7ff873400640 1 -- 172.21.15.42:0/1973905844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f283901390 msgr2=0x55f283cef330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:57.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.411+0000 7ff873400640 1 --2- 172.21.15.42:0/1973905844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f283901390 0x55f283cef330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.411+0000 7ff873400640 1 -- 172.21.15.42:0/1973905844 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f283ce3740 con 0x55f2838d84d0 2024-09-17T01:48:57.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.411+0000 7ff873400640 1 --2- 172.21.15.42:0/1973905844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838d84d0 0x55f283cc1b00 secure :-1 s=READY pgs=2461 cs=0 l=1 rev1=1 crypto rx=0x7ff864012cb0 tx=0x7ff86401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc10ff690fa0640b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:57.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.412+0000 7ff85f400640 1 -- 172.21.15.42:0/1973905844 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff864038070 con 0x55f2838d84d0 2024-09-17T01:48:57.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.412+0000 7ff85f400640 1 -- 172.21.15.42:0/1973905844 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff864003c70 con 0x55f2838d84d0 2024-09-17T01:48:57.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.412+0000 7ff85f400640 1 -- 172.21.15.42:0/1973905844 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff864033430 con 0x55f2838d84d0 2024-09-17T01:48:57.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.412+0000 7ff881605740 1 -- 172.21.15.42:0/1973905844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838d84d0 msgr2=0x55f283cc1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:57.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.412+0000 7ff881605740 1 --2- 172.21.15.42:0/1973905844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838d84d0 0x55f283cc1b00 secure :-1 s=READY pgs=2461 cs=0 l=1 rev1=1 crypto rx=0x7ff864012cb0 tx=0x7ff86401b000 comp rx=0 tx=0).stop 2024-09-17T01:48:57.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.413+0000 7ff881605740 1 -- 172.21.15.42:0/1973905844 shutdown_connections 2024-09-17T01:48:57.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.413+0000 7ff881605740 1 --2- 172.21.15.42:0/1973905844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f283901390 0x55f283cef330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.413+0000 7ff881605740 1 --2- 172.21.15.42:0/1973905844 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f2838e06b0 0x55f283cc2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.413+0000 7ff881605740 1 --2- 172.21.15.42:0/1973905844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838d84d0 0x55f283cc1b00 unknown :-1 s=CLOSED pgs=2461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.413+0000 7ff881605740 1 -- 172.21.15.42:0/1973905844 >> 172.21.15.42:0/1973905844 conn(0x55f2838f54e0 msgr2=0x55f283cceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:57.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.413+0000 7ff881605740 1 -- 172.21.15.42:0/1973905844 shutdown_connections 2024-09-17T01:48:57.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.413+0000 7ff881605740 1 -- 172.21.15.42:0/1973905844 wait complete. 2024-09-17T01:48:57.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.414+0000 7ff881605740 1 -- start start 2024-09-17T01:48:57.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.414+0000 7ff881605740 1 Processor -- start 2024-09-17T01:48:57.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.415+0000 7ff881605740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2838d84d0 0x55f283d738a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.415+0000 7ff881605740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838e06b0 0x55f283d6fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.415+0000 7ff881605740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f283901390 0x55f283cd28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.415+0000 7ff881605740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff8740b4d50 con 0x55f2838e06b0 2024-09-17T01:48:57.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.415+0000 7ff881605740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f283ca4bd0 con 0x55f2838d84d0 2024-09-17T01:48:57.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.415+0000 7ff881605740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55f283d74210 con 0x55f283901390 2024-09-17T01:48:57.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.415+0000 7ff881605740 10 client.0 _ll_register_callbacks cb 0x7ff864005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:48:57.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.416+0000 7ff872a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838e06b0 0x55f283d6fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.416+0000 7ff872a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838e06b0 0x55f283d6fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51920/0 (socket says 172.21.15.42:51920) 2024-09-17T01:48:57.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.416+0000 7ff872a00640 1 -- 172.21.15.42:0/760384857 learned_addr learned my addr 172.21.15.42:0/760384857 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:57.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.416+0000 7ff873400640 1 --2- 172.21.15.42:0/760384857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2838d84d0 0x55f283d738a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.416+0000 7ff873e00640 1 --2- 172.21.15.42:0/760384857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f283901390 0x55f283cd28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.416+0000 7ff872a00640 1 -- 172.21.15.42:0/760384857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f283901390 msgr2=0x55f283cd28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:57.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.416+0000 7ff872a00640 1 --2- 172.21.15.42:0/760384857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f283901390 0x55f283cd28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.416+0000 7ff872a00640 1 -- 172.21.15.42:0/760384857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2838d84d0 msgr2=0x55f283d738a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:48:57.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.416+0000 7ff872a00640 1 --2- 172.21.15.42:0/760384857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2838d84d0 0x55f283d738a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.416+0000 7ff872a00640 1 -- 172.21.15.42:0/760384857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f283d13830 con 0x55f2838e06b0 2024-09-17T01:48:57.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.416+0000 7ff872a00640 1 --2- 172.21.15.42:0/760384857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838e06b0 0x55f283d6fb30 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 crypto rx=0x7ff8600069b0 tx=0x7ff860006520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb9521df899d402 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:57.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.416+0000 7ff85cc00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:48:57.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.417+0000 7ff85cc00640 1 -- 172.21.15.42:0/760384857 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff860032040 con 0x55f2838e06b0 2024-09-17T01:48:57.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.417+0000 7ff85cc00640 1 -- 172.21.15.42:0/760384857 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(215..215 src has 1..215) ==== 5912+0+0 (secure 0 0 0) 0x7ff860053b70 con 0x55f2838e06b0 2024-09-17T01:48:57.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.417+0000 7ff881605740 1 -- 172.21.15.42:0/760384857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff864003c70 con 0x55f2838e06b0 2024-09-17T01:48:57.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.417+0000 7ff85cc00640 1 -- 172.21.15.42:0/760384857 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=168) ==== 24+0+0 (secure 0 0 0) 0x7ff860053d70 con 0x55f2838e06b0 2024-09-17T01:48:57.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.417+0000 7ff881605740 10 client.11376 fetch_fsmap learned FSMap version 168 2024-09-17T01:48:57.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.417+0000 7ff881605740 1 -- 172.21.15.42:0/760384857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=168,monmap=2+}) -- 0x55f283d73f50 con 0x55f2838e06b0 2024-09-17T01:48:57.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.417+0000 7ff85cc00640 1 -- 172.21.15.42:0/760384857 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff864003c70 con 0x55f2838e06b0 2024-09-17T01:48:57.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.417+0000 7ff85cc00640 1 -- 172.21.15.42:0/760384857 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 168) ==== 3502+0+0 (secure 0 0 0) 0x7ff860051070 con 0x55f2838e06b0 2024-09-17T01:48:57.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.417+0000 7ff881605740 10 client.11376 fetch_fsmap finished waiting for FSMap version 168 2024-09-17T01:48:57.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.417+0000 7ff881605740 10 client.11376 resolve_mds: resolved 15:0 to role '15:0' aka daemon mds.b 2024-09-17T01:48:57.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.417+0000 7ff881605740 20 client.11376 populate_metadata read hostname 'smithi042' 2024-09-17T01:48:57.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.417+0000 7ff881605740 1 --2- 172.21.15.42:0/760384857 >> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] conn(0x55f283ca35d0 0x55f283cc1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:57.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.417+0000 7ff881605740 4 client.11376 mds_command: new command op to 11193 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-17T01:48:57.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.417+0000 7ff881605740 1 -- 172.21.15.42:0/760384857 --> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f283c190f0 con 0x55f283ca35d0 2024-09-17T01:48:57.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.418+0000 7ff873400640 1 --2- 172.21.15.42:0/760384857 >> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] conn(0x55f283ca35d0 0x55f283cc1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:57.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.418+0000 7ff873400640 1 --2- 172.21.15.42:0/760384857 >> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] conn(0x55f283ca35d0 0x55f283cc1a60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40ff59f474d925cc server_cookie=e1179b70a561390b in_seq=0 out_seq=0 2024-09-17T01:48:57.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.418+0000 7ff85cc00640 10 client.11376 ms_handle_connect on v2:172.21.15.43:6835/777529944 2024-09-17T01:48:57.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.418+0000 7ff85cc00640 1 -- 172.21.15.42:0/760384857 <== mds.0 v2:172.21.15.43:6835/777529944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f283c190f0 con 0x55f283ca35d0 2024-09-17T01:48:57.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.418+0000 7ff85cc00640 10 client.11376 handle_command_reply: tid=0 2024-09-17T01:48:57.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.418+0000 7ff881605740 1 client.11376 shutdown 2024-09-17T01:48:57.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.419+0000 7ff881605740 1 -- 172.21.15.42:0/760384857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838e06b0 msgr2=0x55f283d6fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:57.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.419+0000 7ff881605740 1 --2- 172.21.15.42:0/760384857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838e06b0 0x55f283d6fb30 secure :-1 s=READY pgs=2462 cs=0 l=1 rev1=1 crypto rx=0x7ff8600069b0 tx=0x7ff860006520 comp rx=0 tx=0).stop 2024-09-17T01:48:57.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.419+0000 7ff881605740 1 -- 172.21.15.42:0/760384857 shutdown_connections 2024-09-17T01:48:57.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.419+0000 7ff881605740 1 --2- 172.21.15.42:0/760384857 >> [v2:172.21.15.43:6835/777529944,v1:172.21.15.43:6836/777529944] conn(0x55f283ca35d0 0x55f283cc1a60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.419+0000 7ff881605740 1 --2- 172.21.15.42:0/760384857 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55f283901390 0x55f283cd28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.419+0000 7ff881605740 1 --2- 172.21.15.42:0/760384857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f2838e06b0 0x55f283d6fb30 unknown :-1 s=CLOSED pgs=2462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.419+0000 7ff881605740 1 --2- 172.21.15.42:0/760384857 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f2838d84d0 0x55f283d738a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.419+0000 7ff85cc00640 0 client.11376 ms_handle_reset on v2:172.21.15.43:6835/777529944 2024-09-17T01:48:57.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.419+0000 7ff881605740 1 -- 172.21.15.42:0/760384857 >> 172.21.15.42:0/760384857 conn(0x55f2838f54e0 msgr2=0x55f283d033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:57.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.419+0000 7ff881605740 1 -- 172.21.15.42:0/760384857 shutdown_connections 2024-09-17T01:48:57.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.419+0000 7ff881605740 1 -- 172.21.15.42:0/760384857 wait complete. 2024-09-17T01:48:57.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.419+0000 7ff881605740 20 client.11376 trim_cache size 0 max 16384 2024-09-17T01:48:57.424 INFO:teuthology.orchestra.run.smithi042.stdout:[] 2024-09-17T01:48:57.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.420+0000 7ff87a400640 1 -- 172.21.15.42:0/3627280377 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff854078b90 msgr2=0x7ff85407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:57.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.420+0000 7ff87a400640 1 --2- 172.21.15.42:0/3627280377 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff854078b90 0x7ff85407b0a0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7ff8740afd20 tx=0x7ff864005f90 comp rx=0 tx=0).stop 2024-09-17T01:48:57.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.420+0000 7ff87a400640 1 -- 172.21.15.42:0/3627280377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8740af8b0 msgr2=0x7ff8741f2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:57.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.420+0000 7ff87a400640 1 --2- 172.21.15.42:0/3627280377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8740af8b0 0x7ff8741f2690 secure :-1 s=READY pgs=2458 cs=0 l=1 rev1=1 crypto rx=0x7ff874154290 tx=0x7ff86c001ab0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.420+0000 7ff87a400640 1 -- 172.21.15.42:0/3627280377 shutdown_connections 2024-09-17T01:48:57.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.420+0000 7ff87a400640 1 --2- 172.21.15.42:0/3627280377 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff854078b90 0x7ff85407b0a0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.420+0000 7ff87a400640 1 --2- 172.21.15.42:0/3627280377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8740af8b0 0x7ff8741f2690 unknown :-1 s=CLOSED pgs=2458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.420+0000 7ff87a400640 1 --2- 172.21.15.42:0/3627280377 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff874158ab0 0x7ff8740af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.420+0000 7ff87a400640 1 --2- 172.21.15.42:0/3627280377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff858003f90 0x7ff874135900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.420+0000 7ff87a400640 1 -- 172.21.15.42:0/3627280377 >> 172.21.15.42:0/3627280377 conn(0x7ff87406d1b0 msgr2=0x7ff8741543c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:57.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.420+0000 7ff87a400640 1 -- 172.21.15.42:0/3627280377 shutdown_connections 2024-09-17T01:48:57.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:57.420+0000 7ff87a400640 1 -- 172.21.15.42:0/3627280377 wait complete. 2024-09-17T01:48:57.440 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:48:57.440 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:48:57.535 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:48:57.614 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:48:57.614 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:48:57.614 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:48:57.615 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:48:57.650 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:48:57.650 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:48:57.727 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T01:48:57.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.000+0000 7f810ec00640 1 -- 172.21.15.42:0/1226210223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8108160c30 msgr2=0x7f81081676a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:57.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.000+0000 7f810ec00640 1 --2- 172.21.15.42:0/1226210223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8108160c30 0x7f81081676a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f8100005fd0 tx=0x7f810002a940 comp rx=0 tx=0).stop 2024-09-17T01:48:57.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.000+0000 7f810ec00640 1 -- 172.21.15.42:0/1226210223 shutdown_connections 2024-09-17T01:48:57.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.000+0000 7f810ec00640 1 --2- 172.21.15.42:0/1226210223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8108160c30 0x7f81081676a0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:57.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.000+0000 7f810ec00640 1 -- 172.21.15.42:0/1226210223 >> 172.21.15.42:0/1226210223 conn(0x7f810806d3f0 msgr2=0x7f81080b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:57.998 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.000+0000 7f810ec00640 1 -- 172.21.15.42:0/1226210223 shutdown_connections 2024-09-17T01:48:57.999 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.000+0000 7f810ec00640 1 -- 172.21.15.42:0/1226210223 wait complete. 2024-09-17T01:48:58.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.002+0000 7f810ec00640 1 Processor -- start 2024-09-17T01:48:58.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.002+0000 7f810ec00640 1 -- start start 2024-09-17T01:48:58.002 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.004+0000 7f810ec00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81080afa90 0x7f810813e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:58.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.004+0000 7f810ec00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8108161210 0x7f81080ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:58.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.004+0000 7f810ec00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f810813f4e0 0x7f81081441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:58.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.004+0000 7f810ec00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8108167df0 con 0x7f810813f4e0 2024-09-17T01:48:58.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.004+0000 7f810ec00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f81080b0010 con 0x7f8108161210 2024-09-17T01:48:58.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.004+0000 7f810ec00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8108167f70 con 0x7f81080afa90 2024-09-17T01:48:58.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.004+0000 7f810e200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f810813f4e0 0x7f81081441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:58.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.004+0000 7f810e200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f810813f4e0 0x7f81081441c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51932/0 (socket says 172.21.15.42:51932) 2024-09-17T01:48:58.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.004+0000 7f810e200640 1 -- 172.21.15.42:0/2351766500 learned_addr learned my addr 172.21.15.42:0/2351766500 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:58.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.004+0000 7f810d800640 1 --2- 172.21.15.42:0/2351766500 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81080afa90 0x7f810813e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:58.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.004+0000 7f810ce00640 1 --2- 172.21.15.42:0/2351766500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8108161210 0x7f81080ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:58.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.005+0000 7f810e200640 1 -- 172.21.15.42:0/2351766500 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81080afa90 msgr2=0x7f810813e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:58.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.005+0000 7f810e200640 1 --2- 172.21.15.42:0/2351766500 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81080afa90 0x7f810813e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:58.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.005+0000 7f810e200640 1 -- 172.21.15.42:0/2351766500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8108161210 msgr2=0x7f81080ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:58.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.005+0000 7f810e200640 1 --2- 172.21.15.42:0/2351766500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8108161210 0x7f81080ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:58.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.005+0000 7f810e200640 1 -- 172.21.15.42:0/2351766500 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81080aedd0 con 0x7f810813f4e0 2024-09-17T01:48:58.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.005+0000 7f810e200640 1 --2- 172.21.15.42:0/2351766500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f810813f4e0 0x7f81081441c0 secure :-1 s=READY pgs=2464 cs=0 l=1 rev1=1 crypto rx=0x7f810002af30 tx=0x7f8100031e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:58.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.005+0000 7f8105600640 1 -- 172.21.15.42:0/2351766500 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810003e070 con 0x7f810813f4e0 2024-09-17T01:48:58.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.005+0000 7f8105600640 1 -- 172.21.15.42:0/2351766500 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8100004540 con 0x7f810813f4e0 2024-09-17T01:48:58.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.005+0000 7f810ec00640 1 -- 172.21.15.42:0/2351766500 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81080aa480 con 0x7f810813f4e0 2024-09-17T01:48:58.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.005+0000 7f8105600640 1 -- 172.21.15.42:0/2351766500 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8100030430 con 0x7f810813f4e0 2024-09-17T01:48:58.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.006+0000 7f810ec00640 1 -- 172.21.15.42:0/2351766500 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81080aaa40 con 0x7f810813f4e0 2024-09-17T01:48:58.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.007+0000 7f810ec00640 1 -- 172.21.15.42:0/2351766500 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f810813fa30 con 0x7f810813f4e0 2024-09-17T01:48:58.006 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.008+0000 7f8105600640 1 -- 172.21.15.42:0/2351766500 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8100043460 con 0x7f810813f4e0 2024-09-17T01:48:58.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.009+0000 7f8105600640 1 --2- 172.21.15.42:0/2351766500 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f80e8078b90 0x7f80e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:58.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.009+0000 7f8105600640 1 -- 172.21.15.42:0/2351766500 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(215..215 src has 1..215) ==== 5912+0+0 (secure 0 0 0) 0x7f81000bc8b0 con 0x7f810813f4e0 2024-09-17T01:48:58.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.009+0000 7f810d800640 1 --2- 172.21.15.42:0/2351766500 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f80e8078b90 0x7f80e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:58.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.010+0000 7f810d800640 1 --2- 172.21.15.42:0/2351766500 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f80e8078b90 0x7f80e807b0a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f80fc000f60 tx=0x7f80fc009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:58.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.014+0000 7f8105600640 1 -- 172.21.15.42:0/2351766500 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f810004a020 con 0x7f810813f4e0 2024-09-17T01:48:58.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.218+0000 7f810ec00640 1 -- 172.21.15.42:0/2351766500 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f81080b2bb0 con 0x7f810813f4e0 2024-09-17T01:48:58.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.218+0000 7f8105600640 1 -- 172.21.15.42:0/2351766500 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v215) ==== 80+0+0 (secure 0 0 0) 0x7f81000844b0 con 0x7f810813f4e0 2024-09-17T01:48:58.216 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-17T01:48:58.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.220+0000 7f810ec00640 1 -- 172.21.15.42:0/2351766500 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f80e8078b90 msgr2=0x7f80e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:58.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.220+0000 7f810ec00640 1 --2- 172.21.15.42:0/2351766500 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f80e8078b90 0x7f80e807b0a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f80fc000f60 tx=0x7f80fc009040 comp rx=0 tx=0).stop 2024-09-17T01:48:58.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.220+0000 7f810ec00640 1 -- 172.21.15.42:0/2351766500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f810813f4e0 msgr2=0x7f81081441c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:58.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.220+0000 7f810ec00640 1 --2- 172.21.15.42:0/2351766500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f810813f4e0 0x7f81081441c0 secure :-1 s=READY pgs=2464 cs=0 l=1 rev1=1 crypto rx=0x7f810002af30 tx=0x7f8100031e20 comp rx=0 tx=0).stop 2024-09-17T01:48:58.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.221+0000 7f810ec00640 1 -- 172.21.15.42:0/2351766500 shutdown_connections 2024-09-17T01:48:58.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.221+0000 7f810ec00640 1 --2- 172.21.15.42:0/2351766500 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f80e8078b90 0x7f80e807b0a0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:58.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.221+0000 7f810ec00640 1 --2- 172.21.15.42:0/2351766500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8108161210 0x7f81080ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:58.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.221+0000 7f810ec00640 1 --2- 172.21.15.42:0/2351766500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f810813f4e0 0x7f81081441c0 unknown :-1 s=CLOSED pgs=2464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:58.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.221+0000 7f810ec00640 1 --2- 172.21.15.42:0/2351766500 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f81080afa90 0x7f810813e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:58.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.221+0000 7f810ec00640 1 -- 172.21.15.42:0/2351766500 >> 172.21.15.42:0/2351766500 conn(0x7f810806d3f0 msgr2=0x7f81080b21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:58.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.221+0000 7f810ec00640 1 -- 172.21.15.42:0/2351766500 shutdown_connections 2024-09-17T01:48:58.220 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:58.221+0000 7f810ec00640 1 -- 172.21.15.42:0/2351766500 wait complete. 2024-09-17T01:48:58.240 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T01:48:58.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:48:58.241 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T01:48:59.015 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:48:59.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:48:59.016 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T01:48:59.053 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:48:59.053 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:48:59.053 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:48:59.090 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:48:59.090 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:48:59.090 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:48:59.090 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:48:59.130 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:48:59.130 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:48:59.131 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:48:59.131 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:48:59.166 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:48:59.167 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:48:59.398 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.400+0000 7f9e0e200640 1 -- 172.21.15.42:0/573437178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e08160790 msgr2=0x7f9e08160ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:59.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.400+0000 7f9e0e200640 1 --2- 172.21.15.42:0/573437178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e08160790 0x7f9e08160ba0 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 crypto rx=0x7f9e08072170 tx=0x7f9df002a560 comp rx=0 tx=0).stop 2024-09-17T01:48:59.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.400+0000 7f9e0e200640 1 -- 172.21.15.42:0/573437178 shutdown_connections 2024-09-17T01:48:59.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.400+0000 7f9e0e200640 1 --2- 172.21.15.42:0/573437178 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e080cd620 0x7f9e080cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:59.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.400+0000 7f9e0e200640 1 --2- 172.21.15.42:0/573437178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e08160790 0x7f9e08160ba0 unknown :-1 s=CLOSED pgs=2465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:59.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.400+0000 7f9e0e200640 1 --2- 172.21.15.42:0/573437178 >> v2:172.21.15.43:3300/0 conn(0x7f9e0815dcf0 0x7f9e08072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:59.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.400+0000 7f9e0e200640 1 -- 172.21.15.42:0/573437178 >> 172.21.15.42:0/573437178 conn(0x7f9e0806d1b0 msgr2=0x7f9e0806d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:59.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.401+0000 7f9e0e200640 1 -- 172.21.15.42:0/573437178 shutdown_connections 2024-09-17T01:48:59.399 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.401+0000 7f9e0e200640 1 -- 172.21.15.42:0/573437178 wait complete. 2024-09-17T01:48:59.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.403+0000 7f9e0e200640 1 Processor -- start 2024-09-17T01:48:59.400 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.403+0000 7f9e0e200640 1 -- start start 2024-09-17T01:48:59.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.404+0000 7f9e0e200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e080cd620 0x7f9e0813bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:59.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.404+0000 7f9e0e200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e0815dcf0 0x7f9e08155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:59.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.404+0000 7f9e0e200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e08160790 0x7f9e08156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:59.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.404+0000 7f9e0e200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0806ed50 con 0x7f9e080cd620 2024-09-17T01:48:59.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.404+0000 7f9e0e200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0806ebd0 con 0x7f9e08160790 2024-09-17T01:48:59.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.404+0000 7f9e0e200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9e0806eed0 con 0x7f9e0815dcf0 2024-09-17T01:48:59.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.404+0000 7f9e07400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e080cd620 0x7f9e0813bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:59.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.405+0000 7f9e07400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e080cd620 0x7f9e0813bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51946/0 (socket says 172.21.15.42:51946) 2024-09-17T01:48:59.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.405+0000 7f9e07400640 1 -- 172.21.15.42:0/2282401703 learned_addr learned my addr 172.21.15.42:0/2282401703 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:59.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.405+0000 7f9e07e00640 1 --2- 172.21.15.42:0/2282401703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e08160790 0x7f9e08156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:59.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.405+0000 7f9dffe00640 1 --2- 172.21.15.42:0/2282401703 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e0815dcf0 0x7f9e08155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:59.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.405+0000 7f9e07400640 1 -- 172.21.15.42:0/2282401703 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e0815dcf0 msgr2=0x7f9e08155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:59.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.405+0000 7f9e07400640 1 --2- 172.21.15.42:0/2282401703 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e0815dcf0 0x7f9e08155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:59.404 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.405+0000 7f9e07400640 1 -- 172.21.15.42:0/2282401703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e08160790 msgr2=0x7f9e08156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:59.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.405+0000 7f9e07400640 1 --2- 172.21.15.42:0/2282401703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e08160790 0x7f9e08156320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:59.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.405+0000 7f9e07400640 1 -- 172.21.15.42:0/2282401703 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e080ac080 con 0x7f9e080cd620 2024-09-17T01:48:59.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.405+0000 7f9e07e00640 1 --2- 172.21.15.42:0/2282401703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e08160790 0x7f9e08156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:59.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.405+0000 7f9dffe00640 1 --2- 172.21.15.42:0/2282401703 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e0815dcf0 0x7f9e08155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:59.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.405+0000 7f9e07400640 1 --2- 172.21.15.42:0/2282401703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e080cd620 0x7f9e0813bf00 secure :-1 s=READY pgs=2466 cs=0 l=1 rev1=1 crypto rx=0x7f9df800e790 tx=0x7f9df800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:59.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.405+0000 7f9dff400640 1 -- 172.21.15.42:0/2282401703 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df800eea0 con 0x7f9e080cd620 2024-09-17T01:48:59.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.406+0000 7f9dff400640 1 -- 172.21.15.42:0/2282401703 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9df800ccc0 con 0x7f9e080cd620 2024-09-17T01:48:59.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.406+0000 7f9dff400640 1 -- 172.21.15.42:0/2282401703 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df8004280 con 0x7f9e080cd620 2024-09-17T01:48:59.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.406+0000 7f9e0e200640 1 -- 172.21.15.42:0/2282401703 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e080b1930 con 0x7f9e080cd620 2024-09-17T01:48:59.405 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.406+0000 7f9e0e200640 1 -- 172.21.15.42:0/2282401703 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e080aa890 con 0x7f9e080cd620 2024-09-17T01:48:59.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.407+0000 7f9e0e200640 1 -- 172.21.15.42:0/2282401703 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e0806f3f0 con 0x7f9e080cd620 2024-09-17T01:48:59.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.408+0000 7f9dff400640 1 -- 172.21.15.42:0/2282401703 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9df80035f0 con 0x7f9e080cd620 2024-09-17T01:48:59.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.409+0000 7f9dff400640 1 --2- 172.21.15.42:0/2282401703 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9de4078b90 0x7f9de407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:59.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.410+0000 7f9dff400640 1 -- 172.21.15.42:0/2282401703 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(215..215 src has 1..215) ==== 5912+0+0 (secure 0 0 0) 0x7f9df809b7d0 con 0x7f9e080cd620 2024-09-17T01:48:59.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.410+0000 7f9dffe00640 1 --2- 172.21.15.42:0/2282401703 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9de4078b90 0x7f9de407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:59.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.411+0000 7f9dffe00640 1 --2- 172.21.15.42:0/2282401703 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9de4078b90 0x7f9de407b0a0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f9df0033000 tx=0x7f9df0004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:59.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.414+0000 7f9dff400640 1 -- 172.21.15.42:0/2282401703 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9df8063b30 con 0x7f9e080cd620 2024-09-17T01:48:59.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.647+0000 7f9e0e200640 1 -- 172.21.15.42:0/2282401703 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e080aaad0 con 0x7f9e080cd620 2024-09-17T01:48:59.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.647+0000 7f9dff400640 1 -- 172.21.15.42:0/2282401703 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 168 v168) ==== 95+0+5238 (secure 0 0 0) 0x7f9df8063430 con 0x7f9e080cd620 2024-09-17T01:48:59.645 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:48:59.645 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":168,"btime":"2024-09-17T01:48:44:968283+0000","default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/2828763381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2828763381},{"type":"v1","addr":"172.21.15.42:6834","nonce":2828763381}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":162},{"gid":10357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2652584517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2652584517},{"type":"v1","addr":"172.21.15.43:6837","nonce":2652584517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":163},{"gid":11190,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3512646002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3512646002},{"type":"v1","addr":"172.21.15.42:6835","nonce":3512646002}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":163}],"filesystems":[{"mdsmap":{"epoch":168,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:48:41.459234+0000","modified":"2024-09-17T01:48:44.478983+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11193":{"gid":11193,"name":"b","rank":0,"incarnation":164,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6836/777529944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":777529944},{"type":"v1","addr":"172.21.15.43:6836","nonce":777529944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11193,"qdb_cluster":[11193]},"id":15}]} 2024-09-17T01:48:59.646 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 168 2024-09-17T01:48:59.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.649+0000 7f9e0e200640 1 -- 172.21.15.42:0/2282401703 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9de4078b90 msgr2=0x7f9de407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:59.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.649+0000 7f9e0e200640 1 --2- 172.21.15.42:0/2282401703 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9de4078b90 0x7f9de407b0a0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f9df0033000 tx=0x7f9df0004730 comp rx=0 tx=0).stop 2024-09-17T01:48:59.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.649+0000 7f9e0e200640 1 -- 172.21.15.42:0/2282401703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e080cd620 msgr2=0x7f9e0813bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:59.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.649+0000 7f9e0e200640 1 --2- 172.21.15.42:0/2282401703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e080cd620 0x7f9e0813bf00 secure :-1 s=READY pgs=2466 cs=0 l=1 rev1=1 crypto rx=0x7f9df800e790 tx=0x7f9df800ec50 comp rx=0 tx=0).stop 2024-09-17T01:48:59.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.650+0000 7f9e0e200640 1 -- 172.21.15.42:0/2282401703 shutdown_connections 2024-09-17T01:48:59.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.650+0000 7f9e0e200640 1 --2- 172.21.15.42:0/2282401703 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9de4078b90 0x7f9de407b0a0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:59.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.650+0000 7f9e0e200640 1 --2- 172.21.15.42:0/2282401703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e08160790 0x7f9e08156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:59.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.650+0000 7f9e0e200640 1 --2- 172.21.15.42:0/2282401703 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9e0815dcf0 0x7f9e08155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:59.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.650+0000 7f9e0e200640 1 --2- 172.21.15.42:0/2282401703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e080cd620 0x7f9e0813bf00 unknown :-1 s=CLOSED pgs=2466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:59.648 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.650+0000 7f9e0e200640 1 -- 172.21.15.42:0/2282401703 >> 172.21.15.42:0/2282401703 conn(0x7f9e0806d1b0 msgr2=0x7f9e0815bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:59.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.650+0000 7f9e0e200640 1 -- 172.21.15.42:0/2282401703 shutdown_connections 2024-09-17T01:48:59.649 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.650+0000 7f9e0e200640 1 -- 172.21.15.42:0/2282401703 wait complete. 2024-09-17T01:48:59.672 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:48:59.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.903+0000 7fa893200640 1 -- 172.21.15.42:0/3396557693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8940d2830 msgr2=0x7fa8940d2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:59.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.903+0000 7fa893200640 1 --2- 172.21.15.42:0/3396557693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8940d2830 0x7fa8940d2c40 secure :-1 s=READY pgs=2467 cs=0 l=1 rev1=1 crypto rx=0x7fa88c005fd0 tx=0x7fa88c02aa10 comp rx=0 tx=0).stop 2024-09-17T01:48:59.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.903+0000 7fa893200640 1 -- 172.21.15.42:0/3396557693 shutdown_connections 2024-09-17T01:48:59.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.903+0000 7fa893200640 1 --2- 172.21.15.42:0/3396557693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8940d2830 0x7fa8940d2c40 unknown :-1 s=CLOSED pgs=2467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:59.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.903+0000 7fa893200640 1 --2- 172.21.15.42:0/3396557693 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa89415c7b0 0x7fa89415efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:59.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.903+0000 7fa893200640 1 -- 172.21.15.42:0/3396557693 >> 172.21.15.42:0/3396557693 conn(0x7fa894073de0 msgr2=0x7fa89406cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:59.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.903+0000 7fa893200640 1 -- 172.21.15.42:0/3396557693 shutdown_connections 2024-09-17T01:48:59.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.903+0000 7fa893200640 1 -- 172.21.15.42:0/3396557693 wait complete. 2024-09-17T01:48:59.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.905+0000 7fa893200640 1 Processor -- start 2024-09-17T01:48:59.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.905+0000 7fa893200640 1 -- start start 2024-09-17T01:48:59.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.907+0000 7fa893200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8940d2830 0x7fa8941f99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:59.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.907+0000 7fa893200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa89415c7b0 0x7fa8941504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:59.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.907+0000 7fa893200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa89415f510 0x7fa8940c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:59.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.907+0000 7fa893200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa8940d1300 con 0x7fa8940d2830 2024-09-17T01:48:59.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.907+0000 7fa893200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa8940d1180 con 0x7fa89415f510 2024-09-17T01:48:59.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.907+0000 7fa893200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa8940d1480 con 0x7fa89415c7b0 2024-09-17T01:48:59.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.907+0000 7fa891e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8940d2830 0x7fa8941f99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:59.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.907+0000 7fa891e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8940d2830 0x7fa8941f99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51968/0 (socket says 172.21.15.42:51968) 2024-09-17T01:48:59.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.907+0000 7fa891e00640 1 -- 172.21.15.42:0/2040584427 learned_addr learned my addr 172.21.15.42:0/2040584427 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:48:59.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.907+0000 7fa88be00640 1 --2- 172.21.15.42:0/2040584427 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa89415c7b0 0x7fa8941504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:59.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.907+0000 7fa892800640 1 --2- 172.21.15.42:0/2040584427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa89415f510 0x7fa8940c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:59.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.908+0000 7fa891e00640 1 -- 172.21.15.42:0/2040584427 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa89415c7b0 msgr2=0x7fa8941504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:59.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.908+0000 7fa891e00640 1 --2- 172.21.15.42:0/2040584427 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa89415c7b0 0x7fa8941504c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:59.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.908+0000 7fa891e00640 1 -- 172.21.15.42:0/2040584427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa89415f510 msgr2=0x7fa8940c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:59.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.908+0000 7fa891e00640 1 --2- 172.21.15.42:0/2040584427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa89415f510 0x7fa8940c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:59.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.908+0000 7fa891e00640 1 -- 172.21.15.42:0/2040584427 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8941f5af0 con 0x7fa8940d2830 2024-09-17T01:48:59.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.908+0000 7fa892800640 1 --2- 172.21.15.42:0/2040584427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa89415f510 0x7fa8940c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:59.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.908+0000 7fa891e00640 1 --2- 172.21.15.42:0/2040584427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8940d2830 0x7fa8941f99b0 secure :-1 s=READY pgs=2468 cs=0 l=1 rev1=1 crypto rx=0x7fa88400d780 tx=0x7fa88400dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:59.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.908+0000 7fa88a000640 1 -- 172.21.15.42:0/2040584427 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa884017070 con 0x7fa8940d2830 2024-09-17T01:48:59.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.908+0000 7fa88a000640 1 -- 172.21.15.42:0/2040584427 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa88400de90 con 0x7fa8940d2830 2024-09-17T01:48:59.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.908+0000 7fa88a000640 1 -- 172.21.15.42:0/2040584427 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8840099d0 con 0x7fa8940d2830 2024-09-17T01:48:59.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.908+0000 7fa893200640 1 -- 172.21.15.42:0/2040584427 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa894150a00 con 0x7fa8940d2830 2024-09-17T01:48:59.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.908+0000 7fa893200640 1 -- 172.21.15.42:0/2040584427 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8941f6070 con 0x7fa8940d2830 2024-09-17T01:48:59.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.909+0000 7fa893200640 1 -- 172.21.15.42:0/2040584427 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8940d1930 con 0x7fa8940d2830 2024-09-17T01:48:59.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.911+0000 7fa88a000640 1 -- 172.21.15.42:0/2040584427 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa884009b70 con 0x7fa8940d2830 2024-09-17T01:48:59.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.912+0000 7fa88a000640 1 --2- 172.21.15.42:0/2040584427 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa870078b90 0x7fa87007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:59.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.912+0000 7fa88a000640 1 -- 172.21.15.42:0/2040584427 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(215..215 src has 1..215) ==== 5912+0+0 (secure 0 0 0) 0x7fa88409b2b0 con 0x7fa8940d2830 2024-09-17T01:48:59.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.912+0000 7fa88be00640 1 --2- 172.21.15.42:0/2040584427 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa870078b90 0x7fa87007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:59.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.913+0000 7fa88be00640 1 --2- 172.21.15.42:0/2040584427 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa870078b90 0x7fa87007b0a0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fa8940d2f10 tx=0x7fa87c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:59.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:48:59.916+0000 7fa88a000640 1 -- 172.21.15.42:0/2040584427 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa884020020 con 0x7fa8940d2830 2024-09-17T01:49:00.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.149+0000 7fa893200640 1 -- 172.21.15.42:0/2040584427 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8940b9bc0 con 0x7fa8940d2830 2024-09-17T01:49:00.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.149+0000 7fa88a000640 1 -- 172.21.15.42:0/2040584427 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 168 v168) ==== 95+0+5238 (secure 0 0 0) 0x7fa884063580 con 0x7fa8940d2830 2024-09-17T01:49:00.147 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:00.148 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":168,"btime":"2024-09-17T01:48:44:968283+0000","default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/2828763381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2828763381},{"type":"v1","addr":"172.21.15.42:6834","nonce":2828763381}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":162},{"gid":10357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2652584517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2652584517},{"type":"v1","addr":"172.21.15.43:6837","nonce":2652584517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":163},{"gid":11190,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3512646002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3512646002},{"type":"v1","addr":"172.21.15.42:6835","nonce":3512646002}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":163}],"filesystems":[{"mdsmap":{"epoch":168,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:48:41.459234+0000","modified":"2024-09-17T01:48:44.478983+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11193":{"gid":11193,"name":"b","rank":0,"incarnation":164,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6836/777529944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":777529944},{"type":"v1","addr":"172.21.15.43:6836","nonce":777529944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11193,"qdb_cluster":[11193]},"id":15}]} 2024-09-17T01:49:00.148 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 168 2024-09-17T01:49:00.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.152+0000 7fa893200640 1 -- 172.21.15.42:0/2040584427 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa870078b90 msgr2=0x7fa87007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:00.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.152+0000 7fa893200640 1 --2- 172.21.15.42:0/2040584427 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa870078b90 0x7fa87007b0a0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fa8940d2f10 tx=0x7fa87c009040 comp rx=0 tx=0).stop 2024-09-17T01:49:00.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.152+0000 7fa893200640 1 -- 172.21.15.42:0/2040584427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8940d2830 msgr2=0x7fa8941f99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:00.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.152+0000 7fa893200640 1 --2- 172.21.15.42:0/2040584427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8940d2830 0x7fa8941f99b0 secure :-1 s=READY pgs=2468 cs=0 l=1 rev1=1 crypto rx=0x7fa88400d780 tx=0x7fa88400dc40 comp rx=0 tx=0).stop 2024-09-17T01:49:00.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.152+0000 7fa893200640 1 -- 172.21.15.42:0/2040584427 shutdown_connections 2024-09-17T01:49:00.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.152+0000 7fa893200640 1 --2- 172.21.15.42:0/2040584427 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa870078b90 0x7fa87007b0a0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:00.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.152+0000 7fa893200640 1 --2- 172.21.15.42:0/2040584427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa89415f510 0x7fa8940c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:00.150 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.152+0000 7fa893200640 1 --2- 172.21.15.42:0/2040584427 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa89415c7b0 0x7fa8941504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:00.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.152+0000 7fa893200640 1 --2- 172.21.15.42:0/2040584427 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8940d2830 0x7fa8941f99b0 unknown :-1 s=CLOSED pgs=2468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:00.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.152+0000 7fa893200640 1 -- 172.21.15.42:0/2040584427 >> 172.21.15.42:0/2040584427 conn(0x7fa894073de0 msgr2=0x7fa894162a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:00.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.152+0000 7fa893200640 1 -- 172.21.15.42:0/2040584427 shutdown_connections 2024-09-17T01:49:00.151 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.152+0000 7fa893200640 1 -- 172.21.15.42:0/2040584427 wait complete. 2024-09-17T01:49:00.172 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:49:00.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.403+0000 7f13ba000640 1 -- 172.21.15.42:0/2117916926 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13b40d2830 msgr2=0x7f13b40d2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:00.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.403+0000 7f13ba000640 1 --2- 172.21.15.42:0/2117916926 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13b40d2830 0x7f13b40d2c40 secure :-1 s=READY pgs=2470 cs=0 l=1 rev1=1 crypto rx=0x7f13b408d890 tx=0x7f13ac02aa30 comp rx=0 tx=0).stop 2024-09-17T01:49:00.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.403+0000 7f13ba000640 1 -- 172.21.15.42:0/2117916926 shutdown_connections 2024-09-17T01:49:00.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.403+0000 7f13ba000640 1 --2- 172.21.15.42:0/2117916926 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13b40d2830 0x7f13b40d2c40 unknown :-1 s=CLOSED pgs=2470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:00.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.403+0000 7f13ba000640 1 --2- 172.21.15.42:0/2117916926 >> v2:172.21.15.43:3300/0 conn(0x7f13b415c7b0 0x7f13b415efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:00.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.403+0000 7f13ba000640 1 -- 172.21.15.42:0/2117916926 >> 172.21.15.42:0/2117916926 conn(0x7f13b4073de0 msgr2=0x7f13b406cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:00.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.403+0000 7f13ba000640 1 -- 172.21.15.42:0/2117916926 shutdown_connections 2024-09-17T01:49:00.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.403+0000 7f13ba000640 1 -- 172.21.15.42:0/2117916926 wait complete. 2024-09-17T01:49:00.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.405+0000 7f13ba000640 1 Processor -- start 2024-09-17T01:49:00.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.405+0000 7f13ba000640 1 -- start start 2024-09-17T01:49:00.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.407+0000 7f13ba000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13b40d2830 0x7f13b415a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:00.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.407+0000 7f13ba000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13b415c7b0 0x7f13b41f8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:00.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.407+0000 7f13ba000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f13b415f510 0x7f13b41f9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:00.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.407+0000 7f13ba000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f13b40d1300 con 0x7f13b415c7b0 2024-09-17T01:49:00.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.407+0000 7f13ba000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f13b40d1180 con 0x7f13b40d2830 2024-09-17T01:49:00.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.407+0000 7f13ba000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f13b40d1480 con 0x7f13b415f510 2024-09-17T01:49:00.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.407+0000 7f13b3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13b415c7b0 0x7f13b41f8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:00.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.407+0000 7f13b3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13b415c7b0 0x7f13b41f8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:51988/0 (socket says 172.21.15.42:51988) 2024-09-17T01:49:00.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.407+0000 7f13b3e00640 1 -- 172.21.15.42:0/4168020534 learned_addr learned my addr 172.21.15.42:0/4168020534 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:00.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.407+0000 7f13b8c00640 1 --2- 172.21.15.42:0/4168020534 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13b40d2830 0x7f13b415a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:00.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.407+0000 7f13b9600640 1 --2- 172.21.15.42:0/4168020534 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f13b415f510 0x7f13b41f9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:00.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.407+0000 7f13b3e00640 1 -- 172.21.15.42:0/4168020534 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f13b415f510 msgr2=0x7f13b41f9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:00.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.407+0000 7f13b3e00640 1 --2- 172.21.15.42:0/4168020534 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f13b415f510 0x7f13b41f9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:00.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.407+0000 7f13b3e00640 1 -- 172.21.15.42:0/4168020534 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13b40d2830 msgr2=0x7f13b415a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:00.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.407+0000 7f13b3e00640 1 --2- 172.21.15.42:0/4168020534 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13b40d2830 0x7f13b415a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:00.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.407+0000 7f13b3e00640 1 -- 172.21.15.42:0/4168020534 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13b40ceb70 con 0x7f13b415c7b0 2024-09-17T01:49:00.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.407+0000 7f13b8c00640 1 --2- 172.21.15.42:0/4168020534 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13b40d2830 0x7f13b415a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:49:00.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.408+0000 7f13b9600640 1 --2- 172.21.15.42:0/4168020534 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f13b415f510 0x7f13b41f9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:49:00.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.408+0000 7f13b3e00640 1 --2- 172.21.15.42:0/4168020534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13b415c7b0 0x7f13b41f8ff0 secure :-1 s=READY pgs=2471 cs=0 l=1 rev1=1 crypto rx=0x7f13a000c3c0 tx=0x7f13a000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:00.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.408+0000 7f13b0c00640 1 -- 172.21.15.42:0/4168020534 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a0017070 con 0x7f13b415c7b0 2024-09-17T01:49:00.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.408+0000 7f13b0c00640 1 -- 172.21.15.42:0/4168020534 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13a00035f0 con 0x7f13b415c7b0 2024-09-17T01:49:00.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.408+0000 7f13b0c00640 1 -- 172.21.15.42:0/4168020534 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a0003a80 con 0x7f13b415c7b0 2024-09-17T01:49:00.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.408+0000 7f13ba000640 1 -- 172.21.15.42:0/4168020534 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13b40cbe80 con 0x7f13b415c7b0 2024-09-17T01:49:00.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.408+0000 7f13ba000640 1 -- 172.21.15.42:0/4168020534 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13b40cbba0 con 0x7f13b415c7b0 2024-09-17T01:49:00.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.409+0000 7f13ba000640 1 -- 172.21.15.42:0/4168020534 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13b40d1970 con 0x7f13b415c7b0 2024-09-17T01:49:00.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.410+0000 7f13b0c00640 1 -- 172.21.15.42:0/4168020534 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f13a001a070 con 0x7f13b415c7b0 2024-09-17T01:49:00.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.411+0000 7f13b0c00640 1 --2- 172.21.15.42:0/4168020534 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1394078b90 0x7f139407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:00.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.412+0000 7f13b0c00640 1 -- 172.21.15.42:0/4168020534 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(215..215 src has 1..215) ==== 5912+0+0 (secure 0 0 0) 0x7f13a009a190 con 0x7f13b415c7b0 2024-09-17T01:49:00.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.412+0000 7f13b8c00640 1 --2- 172.21.15.42:0/4168020534 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1394078b90 0x7f139407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:00.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.413+0000 7f13b8c00640 1 --2- 172.21.15.42:0/4168020534 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1394078b90 0x7f139407b0a0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f13a8005fd0 tx=0x7f13a800f360 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:00.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.416+0000 7f13b0c00640 1 -- 172.21.15.42:0/4168020534 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f13a00625b0 con 0x7f13b415c7b0 2024-09-17T01:49:00.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.613+0000 7f13ba000640 1 -- 172.21.15.42:0/4168020534 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13b40d25d0 con 0x7f13b415c7b0 2024-09-17T01:49:00.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.614+0000 7f13b0c00640 1 -- 172.21.15.42:0/4168020534 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v215) ==== 74+0+16964 (secure 0 0 0) 0x7f13a0061eb0 con 0x7f13b415c7b0 2024-09-17T01:49:00.613 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:00.613 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":215,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:48:53.007153+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:48:39.408110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"cephfs_data","create_time":"2024-09-17T01:48:40.420221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"213","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"31.b","mappings":[{"from":4,"to":3}]},{"pgid":"31.24","mappings":[{"from":4,"to":0}]},{"pgid":"31.28","mappings":[{"from":4,"to":0}]},{"pgid":"31.2a","mappings":[{"from":4,"to":5}]},{"pgid":"31.35","mappings":[{"from":4,"to":3}]},{"pgid":"31.36","mappings":[{"from":4,"to":0}]},{"pgid":"31.38","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:49:00.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.617+0000 7f13ba000640 1 -- 172.21.15.42:0/4168020534 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1394078b90 msgr2=0x7f139407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:00.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.617+0000 7f13ba000640 1 --2- 172.21.15.42:0/4168020534 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1394078b90 0x7f139407b0a0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f13a8005fd0 tx=0x7f13a800f360 comp rx=0 tx=0).stop 2024-09-17T01:49:00.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.617+0000 7f13ba000640 1 -- 172.21.15.42:0/4168020534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13b415c7b0 msgr2=0x7f13b41f8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:00.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.617+0000 7f13ba000640 1 --2- 172.21.15.42:0/4168020534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13b415c7b0 0x7f13b41f8ff0 secure :-1 s=READY pgs=2471 cs=0 l=1 rev1=1 crypto rx=0x7f13a000c3c0 tx=0x7f13a000c880 comp rx=0 tx=0).stop 2024-09-17T01:49:00.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.617+0000 7f13ba000640 1 -- 172.21.15.42:0/4168020534 shutdown_connections 2024-09-17T01:49:00.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.617+0000 7f13ba000640 1 --2- 172.21.15.42:0/4168020534 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1394078b90 0x7f139407b0a0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:00.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.617+0000 7f13ba000640 1 --2- 172.21.15.42:0/4168020534 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f13b415f510 0x7f13b41f9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:00.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.617+0000 7f13ba000640 1 --2- 172.21.15.42:0/4168020534 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f13b415c7b0 0x7f13b41f8ff0 unknown :-1 s=CLOSED pgs=2471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:00.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.617+0000 7f13ba000640 1 --2- 172.21.15.42:0/4168020534 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13b40d2830 0x7f13b415a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:00.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.617+0000 7f13ba000640 1 -- 172.21.15.42:0/4168020534 >> 172.21.15.42:0/4168020534 conn(0x7f13b4073de0 msgr2=0x7f13b41619f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:00.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.617+0000 7f13ba000640 1 -- 172.21.15.42:0/4168020534 shutdown_connections 2024-09-17T01:49:00.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.617+0000 7f13ba000640 1 -- 172.21.15.42:0/4168020534 wait complete. 2024-09-17T01:49:00.640 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T01:49:00.640 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:49:00.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.870+0000 7fc878e00640 1 -- 172.21.15.42:0/3509271989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8740cdd30 msgr2=0x7fc87406e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:00.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.870+0000 7fc878e00640 1 --2- 172.21.15.42:0/3509271989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8740cdd30 0x7fc87406e9c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc86c005fd0 tx=0x7fc86c02a8b0 comp rx=0 tx=0).stop 2024-09-17T01:49:00.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.870+0000 7fc878e00640 1 -- 172.21.15.42:0/3509271989 shutdown_connections 2024-09-17T01:49:00.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.870+0000 7fc878e00640 1 --2- 172.21.15.42:0/3509271989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8740cdd30 0x7fc87406e9c0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:00.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.870+0000 7fc878e00640 1 -- 172.21.15.42:0/3509271989 >> 172.21.15.42:0/3509271989 conn(0x7fc87406d1b0 msgr2=0x7fc87406d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:00.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.870+0000 7fc878e00640 1 -- 172.21.15.42:0/3509271989 shutdown_connections 2024-09-17T01:49:00.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.870+0000 7fc878e00640 1 -- 172.21.15.42:0/3509271989 wait complete. 2024-09-17T01:49:00.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.873+0000 7fc878e00640 1 Processor -- start 2024-09-17T01:49:00.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.873+0000 7fc878e00640 1 -- start start 2024-09-17T01:49:00.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.874+0000 7fc878e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc874072b60 0x7fc874148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:00.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.874+0000 7fc878e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc87415dcf0 0x7fc8740cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:00.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.874+0000 7fc878e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8740cba70 0x7fc8740cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:00.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.874+0000 7fc878e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc87406f080 con 0x7fc8740cba70 2024-09-17T01:49:00.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.874+0000 7fc878e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc87406ef00 con 0x7fc874072b60 2024-09-17T01:49:00.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.874+0000 7fc878e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc87406f200 con 0x7fc87415dcf0 2024-09-17T01:49:00.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.874+0000 7fc872800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8740cba70 0x7fc8740cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:00.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.874+0000 7fc872800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8740cba70 0x7fc8740cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52002/0 (socket says 172.21.15.42:52002) 2024-09-17T01:49:00.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.874+0000 7fc872800640 1 -- 172.21.15.42:0/1966944124 learned_addr learned my addr 172.21.15.42:0/1966944124 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:00.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.875+0000 7fc871e00640 1 --2- 172.21.15.42:0/1966944124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc874072b60 0x7fc874148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:00.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.875+0000 7fc871400640 1 --2- 172.21.15.42:0/1966944124 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc87415dcf0 0x7fc8740cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:00.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.875+0000 7fc872800640 1 -- 172.21.15.42:0/1966944124 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc87415dcf0 msgr2=0x7fc8740cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:00.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.875+0000 7fc872800640 1 --2- 172.21.15.42:0/1966944124 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc87415dcf0 0x7fc8740cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:00.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.875+0000 7fc872800640 1 -- 172.21.15.42:0/1966944124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc874072b60 msgr2=0x7fc874148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:00.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.875+0000 7fc872800640 1 --2- 172.21.15.42:0/1966944124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc874072b60 0x7fc874148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:00.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.875+0000 7fc872800640 1 -- 172.21.15.42:0/1966944124 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8740cc3c0 con 0x7fc8740cba70 2024-09-17T01:49:00.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.875+0000 7fc872800640 1 --2- 172.21.15.42:0/1966944124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8740cba70 0x7fc8740cbe80 secure :-1 s=READY pgs=2473 cs=0 l=1 rev1=1 crypto rx=0x7fc86c006010 tx=0x7fc86c031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:00.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.875+0000 7fc86a000640 1 -- 172.21.15.42:0/1966944124 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c031990 con 0x7fc8740cba70 2024-09-17T01:49:00.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.876+0000 7fc86a000640 1 -- 172.21.15.42:0/1966944124 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc86c031c20 con 0x7fc8740cba70 2024-09-17T01:49:00.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.876+0000 7fc878e00640 1 -- 172.21.15.42:0/1966944124 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8740b2bf0 con 0x7fc8740cba70 2024-09-17T01:49:00.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.876+0000 7fc86a000640 1 -- 172.21.15.42:0/1966944124 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c0330d0 con 0x7fc8740cba70 2024-09-17T01:49:00.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.876+0000 7fc878e00640 1 -- 172.21.15.42:0/1966944124 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8740cad30 con 0x7fc8740cba70 2024-09-17T01:49:00.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.877+0000 7fc878e00640 1 -- 172.21.15.42:0/1966944124 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8740ca860 con 0x7fc8740cba70 2024-09-17T01:49:00.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.878+0000 7fc86a000640 1 -- 172.21.15.42:0/1966944124 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc86c033270 con 0x7fc8740cba70 2024-09-17T01:49:00.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.879+0000 7fc86a000640 1 --2- 172.21.15.42:0/1966944124 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc854078b90 0x7fc85407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:00.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.879+0000 7fc86a000640 1 -- 172.21.15.42:0/1966944124 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(215..215 src has 1..215) ==== 5912+0+0 (secure 0 0 0) 0x7fc86c0bc2e0 con 0x7fc8740cba70 2024-09-17T01:49:00.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.879+0000 7fc871e00640 1 --2- 172.21.15.42:0/1966944124 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc854078b90 0x7fc85407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:00.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.880+0000 7fc871e00640 1 --2- 172.21.15.42:0/1966944124 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc854078b90 0x7fc85407b0a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fc864000f60 tx=0x7fc864009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:00.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:00.883+0000 7fc86a000640 1 -- 172.21.15.42:0/1966944124 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc86c03f030 con 0x7fc8740cba70 2024-09-17T01:49:01.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.116+0000 7fc878e00640 1 -- 172.21.15.42:0/1966944124 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8740b2980 con 0x7fc8740cba70 2024-09-17T01:49:01.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.117+0000 7fc86a000640 1 -- 172.21.15.42:0/1966944124 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 168 v168) ==== 95+0+5238 (secure 0 0 0) 0x7fc86c0845b0 con 0x7fc8740cba70 2024-09-17T01:49:01.115 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:01.115 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":168,"btime":"2024-09-17T01:48:44:968283+0000","default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/2828763381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2828763381},{"type":"v1","addr":"172.21.15.42:6834","nonce":2828763381}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":162},{"gid":10357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2652584517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2652584517},{"type":"v1","addr":"172.21.15.43:6837","nonce":2652584517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":163},{"gid":11190,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3512646002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3512646002},{"type":"v1","addr":"172.21.15.42:6835","nonce":3512646002}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":163}],"filesystems":[{"mdsmap":{"epoch":168,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:48:41.459234+0000","modified":"2024-09-17T01:48:44.478983+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11193":{"gid":11193,"name":"b","rank":0,"incarnation":164,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6836/777529944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":777529944},{"type":"v1","addr":"172.21.15.43:6836","nonce":777529944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11193,"qdb_cluster":[11193]},"id":15}]} 2024-09-17T01:49:01.115 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 168 2024-09-17T01:49:01.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.119+0000 7fc878e00640 1 -- 172.21.15.42:0/1966944124 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc854078b90 msgr2=0x7fc85407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:01.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.119+0000 7fc878e00640 1 --2- 172.21.15.42:0/1966944124 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc854078b90 0x7fc85407b0a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fc864000f60 tx=0x7fc864009040 comp rx=0 tx=0).stop 2024-09-17T01:49:01.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.119+0000 7fc878e00640 1 -- 172.21.15.42:0/1966944124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8740cba70 msgr2=0x7fc8740cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:01.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.119+0000 7fc878e00640 1 --2- 172.21.15.42:0/1966944124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8740cba70 0x7fc8740cbe80 secure :-1 s=READY pgs=2473 cs=0 l=1 rev1=1 crypto rx=0x7fc86c006010 tx=0x7fc86c031700 comp rx=0 tx=0).stop 2024-09-17T01:49:01.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.119+0000 7fc878e00640 1 -- 172.21.15.42:0/1966944124 shutdown_connections 2024-09-17T01:49:01.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.119+0000 7fc878e00640 1 --2- 172.21.15.42:0/1966944124 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc854078b90 0x7fc85407b0a0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:01.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.119+0000 7fc878e00640 1 --2- 172.21.15.42:0/1966944124 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8740cba70 0x7fc8740cbe80 unknown :-1 s=CLOSED pgs=2473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:01.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.119+0000 7fc878e00640 1 --2- 172.21.15.42:0/1966944124 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc87415dcf0 0x7fc8740cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:01.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.119+0000 7fc878e00640 1 --2- 172.21.15.42:0/1966944124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc874072b60 0x7fc874148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:01.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.119+0000 7fc878e00640 1 -- 172.21.15.42:0/1966944124 >> 172.21.15.42:0/1966944124 conn(0x7fc87406d1b0 msgr2=0x7fc87415e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:01.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.120+0000 7fc878e00640 1 -- 172.21.15.42:0/1966944124 shutdown_connections 2024-09-17T01:49:01.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.120+0000 7fc878e00640 1 -- 172.21.15.42:0/1966944124 wait complete. 2024-09-17T01:49:01.143 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:49:01.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.375+0000 7f8c9ec00640 1 -- 172.21.15.42:0/3007201034 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8c980cdd30 msgr2=0x7f8c98160ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:01.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.375+0000 7f8c9ec00640 1 --2- 172.21.15.42:0/3007201034 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8c980cdd30 0x7f8c98160ba0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8c90005fd0 tx=0x7f8c9002aa90 comp rx=0 tx=0).stop 2024-09-17T01:49:01.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.375+0000 7f8c9ec00640 1 -- 172.21.15.42:0/3007201034 shutdown_connections 2024-09-17T01:49:01.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.375+0000 7f8c9ec00640 1 --2- 172.21.15.42:0/3007201034 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8c980cdd30 0x7f8c98160ba0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:01.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.375+0000 7f8c9ec00640 1 --2- 172.21.15.42:0/3007201034 >> v2:172.21.15.43:3300/0 conn(0x7f8c9815dcf0 0x7f8c98072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:01.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.375+0000 7f8c9ec00640 1 -- 172.21.15.42:0/3007201034 >> 172.21.15.42:0/3007201034 conn(0x7f8c9806d1b0 msgr2=0x7f8c9806d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:01.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.375+0000 7f8c9ec00640 1 -- 172.21.15.42:0/3007201034 shutdown_connections 2024-09-17T01:49:01.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.375+0000 7f8c9ec00640 1 -- 172.21.15.42:0/3007201034 wait complete. 2024-09-17T01:49:01.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.377+0000 7f8c9ec00640 1 Processor -- start 2024-09-17T01:49:01.375 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.377+0000 7f8c9ec00640 1 -- start start 2024-09-17T01:49:01.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.379+0000 7f8c9ec00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c9815dcf0 0x7f8c980aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:01.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.379+0000 7f8c9ec00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8c98160790 0x7f8c981537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:01.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.379+0000 7f8c9ec00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c98134c70 0x7f8c981e7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:01.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.379+0000 7f8c9ec00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9806ee90 con 0x7f8c98134c70 2024-09-17T01:49:01.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.379+0000 7f8c9ec00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9806ed10 con 0x7f8c9815dcf0 2024-09-17T01:49:01.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.379+0000 7f8c9ec00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8c9806f010 con 0x7f8c98160790 2024-09-17T01:49:01.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.379+0000 7f8c9cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c98134c70 0x7f8c981e7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:01.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.379+0000 7f8c9cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c98134c70 0x7f8c981e7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52004/0 (socket says 172.21.15.42:52004) 2024-09-17T01:49:01.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.379+0000 7f8c9cc00640 1 -- 172.21.15.42:0/1957581282 learned_addr learned my addr 172.21.15.42:0/1957581282 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:01.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.380+0000 7f8c97e00640 1 --2- 172.21.15.42:0/1957581282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c9815dcf0 0x7f8c980aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:01.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.380+0000 7f8c8f400640 1 --2- 172.21.15.42:0/1957581282 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8c98160790 0x7f8c981537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:01.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.380+0000 7f8c9cc00640 1 -- 172.21.15.42:0/1957581282 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8c98160790 msgr2=0x7f8c981537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:01.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.380+0000 7f8c9cc00640 1 --2- 172.21.15.42:0/1957581282 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8c98160790 0x7f8c981537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:01.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.380+0000 7f8c9cc00640 1 -- 172.21.15.42:0/1957581282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c9815dcf0 msgr2=0x7f8c980aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:01.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.380+0000 7f8c9cc00640 1 --2- 172.21.15.42:0/1957581282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c9815dcf0 0x7f8c980aa480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:01.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.380+0000 7f8c9cc00640 1 -- 172.21.15.42:0/1957581282 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c980aad80 con 0x7f8c98134c70 2024-09-17T01:49:01.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.380+0000 7f8c8f400640 1 --2- 172.21.15.42:0/1957581282 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8c98160790 0x7f8c981537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:49:01.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.380+0000 7f8c9cc00640 1 --2- 172.21.15.42:0/1957581282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c98134c70 0x7f8c981e7a70 secure :-1 s=READY pgs=2474 cs=0 l=1 rev1=1 crypto rx=0x7f8c90006010 tx=0x7f8c90003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:01.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.380+0000 7f8c94c00640 1 -- 172.21.15.42:0/1957581282 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c90044070 con 0x7f8c98134c70 2024-09-17T01:49:01.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.380+0000 7f8c94c00640 1 -- 172.21.15.42:0/1957581282 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c90004040 con 0x7f8c98134c70 2024-09-17T01:49:01.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.380+0000 7f8c94c00640 1 -- 172.21.15.42:0/1957581282 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c90004430 con 0x7f8c98134c70 2024-09-17T01:49:01.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.380+0000 7f8c9ec00640 1 -- 172.21.15.42:0/1957581282 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c980ab060 con 0x7f8c98134c70 2024-09-17T01:49:01.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.380+0000 7f8c9ec00640 1 -- 172.21.15.42:0/1957581282 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c98153d30 con 0x7f8c98134c70 2024-09-17T01:49:01.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.381+0000 7f8c9ec00640 1 -- 172.21.15.42:0/1957581282 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c980aaaf0 con 0x7f8c98134c70 2024-09-17T01:49:01.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.383+0000 7f8c94c00640 1 -- 172.21.15.42:0/1957581282 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8c90047070 con 0x7f8c98134c70 2024-09-17T01:49:01.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.384+0000 7f8c94c00640 1 --2- 172.21.15.42:0/1957581282 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8c74078b90 0x7f8c7407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:01.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.385+0000 7f8c94c00640 1 -- 172.21.15.42:0/1957581282 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(215..215 src has 1..215) ==== 5912+0+0 (secure 0 0 0) 0x7f8c900bbc70 con 0x7f8c98134c70 2024-09-17T01:49:01.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.385+0000 7f8c97e00640 1 --2- 172.21.15.42:0/1957581282 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8c74078b90 0x7f8c7407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:01.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.386+0000 7f8c97e00640 1 --2- 172.21.15.42:0/1957581282 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8c74078b90 0x7f8c7407b0a0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f8c980afd20 tx=0x7f8c88005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:01.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.389+0000 7f8c94c00640 1 -- 172.21.15.42:0/1957581282 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8c90032030 con 0x7f8c98134c70 2024-09-17T01:49:01.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.621+0000 7f8c9ec00640 1 -- 172.21.15.42:0/1957581282 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c980ab580 con 0x7f8c98134c70 2024-09-17T01:49:01.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.622+0000 7f8c94c00640 1 -- 172.21.15.42:0/1957581282 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 168 v168) ==== 95+0+5238 (secure 0 0 0) 0x7f8c980ab580 con 0x7f8c98134c70 2024-09-17T01:49:01.620 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:01.620 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":168,"btime":"2024-09-17T01:48:44:968283+0000","default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/2828763381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2828763381},{"type":"v1","addr":"172.21.15.42:6834","nonce":2828763381}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":162},{"gid":10357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2652584517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2652584517},{"type":"v1","addr":"172.21.15.43:6837","nonce":2652584517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":163},{"gid":11190,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3512646002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3512646002},{"type":"v1","addr":"172.21.15.42:6835","nonce":3512646002}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":163}],"filesystems":[{"mdsmap":{"epoch":168,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:48:41.459234+0000","modified":"2024-09-17T01:48:44.478983+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11193":{"gid":11193,"name":"b","rank":0,"incarnation":164,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6836/777529944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":777529944},{"type":"v1","addr":"172.21.15.43:6836","nonce":777529944}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[31],"metadata_pool":30,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11193,"qdb_cluster":[11193]},"id":15}]} 2024-09-17T01:49:01.620 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 168 2024-09-17T01:49:01.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.624+0000 7f8c9ec00640 1 -- 172.21.15.42:0/1957581282 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8c74078b90 msgr2=0x7f8c7407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:01.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.624+0000 7f8c9ec00640 1 --2- 172.21.15.42:0/1957581282 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8c74078b90 0x7f8c7407b0a0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f8c980afd20 tx=0x7f8c88005f90 comp rx=0 tx=0).stop 2024-09-17T01:49:01.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.624+0000 7f8c9ec00640 1 -- 172.21.15.42:0/1957581282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c98134c70 msgr2=0x7f8c981e7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:01.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.624+0000 7f8c9ec00640 1 --2- 172.21.15.42:0/1957581282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c98134c70 0x7f8c981e7a70 secure :-1 s=READY pgs=2474 cs=0 l=1 rev1=1 crypto rx=0x7f8c90006010 tx=0x7f8c90003ce0 comp rx=0 tx=0).stop 2024-09-17T01:49:01.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.624+0000 7f8c9ec00640 1 -- 172.21.15.42:0/1957581282 shutdown_connections 2024-09-17T01:49:01.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.624+0000 7f8c9ec00640 1 --2- 172.21.15.42:0/1957581282 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8c74078b90 0x7f8c7407b0a0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:01.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.624+0000 7f8c9ec00640 1 --2- 172.21.15.42:0/1957581282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c98134c70 0x7f8c981e7a70 unknown :-1 s=CLOSED pgs=2474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:01.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.624+0000 7f8c9ec00640 1 --2- 172.21.15.42:0/1957581282 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8c98160790 0x7f8c981537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:01.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.624+0000 7f8c9ec00640 1 --2- 172.21.15.42:0/1957581282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c9815dcf0 0x7f8c980aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:01.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.624+0000 7f8c9ec00640 1 -- 172.21.15.42:0/1957581282 >> 172.21.15.42:0/1957581282 conn(0x7f8c9806d1b0 msgr2=0x7f8c9815eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:01.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.624+0000 7f8c9ec00640 1 -- 172.21.15.42:0/1957581282 shutdown_connections 2024-09-17T01:49:01.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.625+0000 7f8c9ec00640 1 -- 172.21.15.42:0/1957581282 wait complete. 2024-09-17T01:49:01.644 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:49:01.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.872+0000 7f4a2dc00640 1 -- 172.21.15.42:0/605913815 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a28160cd0 msgr2=0x7f4a280b55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:01.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.872+0000 7f4a2dc00640 1 --2- 172.21.15.42:0/605913815 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a28160cd0 0x7f4a280b55e0 secure :-1 s=READY pgs=2475 cs=0 l=1 rev1=1 crypto rx=0x7f4a28071f30 tx=0x7f4a2002aa30 comp rx=0 tx=0).stop 2024-09-17T01:49:01.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.872+0000 7f4a2dc00640 1 -- 172.21.15.42:0/605913815 shutdown_connections 2024-09-17T01:49:01.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.872+0000 7f4a2dc00640 1 --2- 172.21.15.42:0/605913815 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a28160cd0 0x7f4a280b55e0 unknown :-1 s=CLOSED pgs=2475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:01.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.872+0000 7f4a2dc00640 1 --2- 172.21.15.42:0/605913815 >> v2:172.21.15.43:3300/0 conn(0x7f4a280afb00 0x7f4a28073d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:01.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.872+0000 7f4a2dc00640 1 -- 172.21.15.42:0/605913815 >> 172.21.15.42:0/605913815 conn(0x7f4a2806d3f0 msgr2=0x7f4a280b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:01.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.872+0000 7f4a2dc00640 1 -- 172.21.15.42:0/605913815 shutdown_connections 2024-09-17T01:49:01.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.872+0000 7f4a2dc00640 1 -- 172.21.15.42:0/605913815 wait complete. 2024-09-17T01:49:01.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.875+0000 7f4a2dc00640 1 Processor -- start 2024-09-17T01:49:01.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.875+0000 7f4a2dc00640 1 -- start start 2024-09-17T01:49:01.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.876+0000 7f4a2dc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a280afb00 0x7f4a280c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:01.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.876+0000 7f4a2dc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4a280b51d0 0x7f4a28156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:01.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.876+0000 7f4a2dc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a281f52e0 0x7f4a280ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:01.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.876+0000 7f4a2dc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4a280ce4f0 con 0x7f4a281f52e0 2024-09-17T01:49:01.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.876+0000 7f4a2dc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4a280ce370 con 0x7f4a280afb00 2024-09-17T01:49:01.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.876+0000 7f4a2dc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4a280ce670 con 0x7f4a280b51d0 2024-09-17T01:49:01.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.877+0000 7f4a2d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a281f52e0 0x7f4a280ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:01.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.877+0000 7f4a2d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a281f52e0 0x7f4a280ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52022/0 (socket says 172.21.15.42:52022) 2024-09-17T01:49:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.877+0000 7f4a2d200640 1 -- 172.21.15.42:0/862094640 learned_addr learned my addr 172.21.15.42:0/862094640 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.877+0000 7f4a27e00640 1 --2- 172.21.15.42:0/862094640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a280afb00 0x7f4a280c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.877+0000 7f4a1fe00640 1 --2- 172.21.15.42:0/862094640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4a280b51d0 0x7f4a28156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.877+0000 7f4a2d200640 1 -- 172.21.15.42:0/862094640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4a280b51d0 msgr2=0x7f4a28156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.877+0000 7f4a2d200640 1 --2- 172.21.15.42:0/862094640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4a280b51d0 0x7f4a28156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.877+0000 7f4a2d200640 1 -- 172.21.15.42:0/862094640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a280afb00 msgr2=0x7f4a280c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.877+0000 7f4a2d200640 1 --2- 172.21.15.42:0/862094640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a280afb00 0x7f4a280c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.877+0000 7f4a2d200640 1 -- 172.21.15.42:0/862094640 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a2815a100 con 0x7f4a281f52e0 2024-09-17T01:49:01.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.877+0000 7f4a2d200640 1 --2- 172.21.15.42:0/862094640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a281f52e0 0x7f4a280ae890 secure :-1 s=READY pgs=2476 cs=0 l=1 rev1=1 crypto rx=0x7f4a20009d60 tx=0x7f4a20003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:01.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.878+0000 7f4a24c00640 1 -- 172.21.15.42:0/862094640 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a20033050 con 0x7f4a281f52e0 2024-09-17T01:49:01.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.878+0000 7f4a24c00640 1 -- 172.21.15.42:0/862094640 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a20004450 con 0x7f4a281f52e0 2024-09-17T01:49:01.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.878+0000 7f4a24c00640 1 -- 172.21.15.42:0/862094640 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a20038450 con 0x7f4a281f52e0 2024-09-17T01:49:01.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.878+0000 7f4a2dc00640 1 -- 172.21.15.42:0/862094640 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a2815a3e0 con 0x7f4a281f52e0 2024-09-17T01:49:01.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.878+0000 7f4a2dc00640 1 -- 172.21.15.42:0/862094640 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a2815a9a0 con 0x7f4a281f52e0 2024-09-17T01:49:01.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.879+0000 7f4a2dc00640 1 -- 172.21.15.42:0/862094640 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a28073d00 con 0x7f4a281f52e0 2024-09-17T01:49:01.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.880+0000 7f4a24c00640 1 -- 172.21.15.42:0/862094640 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4a20036070 con 0x7f4a281f52e0 2024-09-17T01:49:01.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.881+0000 7f4a24c00640 1 --2- 172.21.15.42:0/862094640 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4a04078b90 0x7f4a0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:01.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.881+0000 7f4a24c00640 1 -- 172.21.15.42:0/862094640 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(215..215 src has 1..215) ==== 5912+0+0 (secure 0 0 0) 0x7f4a200bc2b0 con 0x7f4a281f52e0 2024-09-17T01:49:01.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.881+0000 7f4a27e00640 1 --2- 172.21.15.42:0/862094640 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4a04078b90 0x7f4a0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:01.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.882+0000 7f4a27e00640 1 --2- 172.21.15.42:0/862094640 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4a04078b90 0x7f4a0407b0a0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800bb50 tx=0x7f4a1800b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:01.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:01.885+0000 7f4a24c00640 1 -- 172.21.15.42:0/862094640 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4a20083f30 con 0x7f4a281f52e0 2024-09-17T01:49:02.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.079+0000 7f4a2dc00640 1 -- 172.21.15.42:0/862094640 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a281f9820 con 0x7f4a281f52e0 2024-09-17T01:49:02.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.080+0000 7f4a24c00640 1 -- 172.21.15.42:0/862094640 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v215) ==== 74+0+16964 (secure 0 0 0) 0x7f4a20088960 con 0x7f4a281f52e0 2024-09-17T01:49:02.079 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:02.079 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":215,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:48:53.007153+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":30,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:48:39.408110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":31,"pool_name":"cephfs_data","create_time":"2024-09-17T01:48:40.420221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"213","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"31.b","mappings":[{"from":4,"to":3}]},{"pgid":"31.24","mappings":[{"from":4,"to":0}]},{"pgid":"31.28","mappings":[{"from":4,"to":0}]},{"pgid":"31.2a","mappings":[{"from":4,"to":5}]},{"pgid":"31.35","mappings":[{"from":4,"to":3}]},{"pgid":"31.36","mappings":[{"from":4,"to":0}]},{"pgid":"31.38","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:49:02.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.083+0000 7f4a2dc00640 1 -- 172.21.15.42:0/862094640 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4a04078b90 msgr2=0x7f4a0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:02.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.083+0000 7f4a2dc00640 1 --2- 172.21.15.42:0/862094640 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4a04078b90 0x7f4a0407b0a0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800bb50 tx=0x7f4a1800b2e0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.083+0000 7f4a2dc00640 1 -- 172.21.15.42:0/862094640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a281f52e0 msgr2=0x7f4a280ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:02.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.083+0000 7f4a2dc00640 1 --2- 172.21.15.42:0/862094640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a281f52e0 0x7f4a280ae890 secure :-1 s=READY pgs=2476 cs=0 l=1 rev1=1 crypto rx=0x7f4a20009d60 tx=0x7f4a20003f10 comp rx=0 tx=0).stop 2024-09-17T01:49:02.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.083+0000 7f4a2dc00640 1 -- 172.21.15.42:0/862094640 shutdown_connections 2024-09-17T01:49:02.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.083+0000 7f4a2dc00640 1 --2- 172.21.15.42:0/862094640 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4a04078b90 0x7f4a0407b0a0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.083+0000 7f4a2dc00640 1 --2- 172.21.15.42:0/862094640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4a281f52e0 0x7f4a280ae890 unknown :-1 s=CLOSED pgs=2476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.083+0000 7f4a2dc00640 1 --2- 172.21.15.42:0/862094640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4a280b51d0 0x7f4a28156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.083+0000 7f4a2dc00640 1 --2- 172.21.15.42:0/862094640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a280afb00 0x7f4a280c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.083+0000 7f4a2dc00640 1 -- 172.21.15.42:0/862094640 >> 172.21.15.42:0/862094640 conn(0x7f4a2806d3f0 msgr2=0x7f4a2815ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:02.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.083+0000 7f4a2dc00640 1 -- 172.21.15.42:0/862094640 shutdown_connections 2024-09-17T01:49:02.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.083+0000 7f4a2dc00640 1 -- 172.21.15.42:0/862094640 wait complete. 2024-09-17T01:49:02.103 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T01:49:02.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.336+0000 7f4081e00640 1 -- 172.21.15.42:0/1312751463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f407c06e4e0 msgr2=0x7f407c06e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:02.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.336+0000 7f4081e00640 1 --2- 172.21.15.42:0/1312751463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f407c06e4e0 0x7f407c06e8f0 secure :-1 s=READY pgs=2478 cs=0 l=1 rev1=1 crypto rx=0x7f4074005fd0 tx=0x7f407402aa10 comp rx=0 tx=0).stop 2024-09-17T01:49:02.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.336+0000 7f4081e00640 1 -- 172.21.15.42:0/1312751463 shutdown_connections 2024-09-17T01:49:02.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.336+0000 7f4081e00640 1 --2- 172.21.15.42:0/1312751463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f407c06e4e0 0x7f407c06e8f0 unknown :-1 s=CLOSED pgs=2478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.336+0000 7f4081e00640 1 --2- 172.21.15.42:0/1312751463 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f407c151bb0 0x7f407c15bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.336+0000 7f4081e00640 1 -- 172.21.15.42:0/1312751463 >> 172.21.15.42:0/1312751463 conn(0x7f407c06d3f0 msgr2=0x7f407c0b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:02.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.336+0000 7f4081e00640 1 -- 172.21.15.42:0/1312751463 shutdown_connections 2024-09-17T01:49:02.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.336+0000 7f4081e00640 1 -- 172.21.15.42:0/1312751463 wait complete. 2024-09-17T01:49:02.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.339+0000 7f4081e00640 1 Processor -- start 2024-09-17T01:49:02.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.339+0000 7f4081e00640 1 -- start start 2024-09-17T01:49:02.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.340+0000 7f4081e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f407c06e4e0 0x7f407c152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:02.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.340+0000 7f4081e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f407c072480 0x7f407c1526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:02.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.340+0000 7f4081e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f407c151bb0 0x7f407c14ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:02.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.340+0000 7f4081e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f407c070570 con 0x7f407c072480 2024-09-17T01:49:02.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.340+0000 7f4081e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f407c0cc920 con 0x7f407c06e4e0 2024-09-17T01:49:02.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.340+0000 7f4081e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f407c0706f0 con 0x7f407c151bb0 2024-09-17T01:49:02.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.341+0000 7f407be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f407c072480 0x7f407c1526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:02.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.341+0000 7f407be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f407c072480 0x7f407c1526b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52044/0 (socket says 172.21.15.42:52044) 2024-09-17T01:49:02.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.341+0000 7f407be00640 1 -- 172.21.15.42:0/1253361077 learned_addr learned my addr 172.21.15.42:0/1253361077 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:02.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.341+0000 7f4080a00640 1 --2- 172.21.15.42:0/1253361077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f407c06e4e0 0x7f407c152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:02.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.341+0000 7f4081400640 1 --2- 172.21.15.42:0/1253361077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f407c151bb0 0x7f407c14ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:02.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.341+0000 7f407be00640 1 -- 172.21.15.42:0/1253361077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f407c151bb0 msgr2=0x7f407c14ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:02.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.341+0000 7f407be00640 1 --2- 172.21.15.42:0/1253361077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f407c151bb0 0x7f407c14ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.341+0000 7f407be00640 1 -- 172.21.15.42:0/1253361077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f407c06e4e0 msgr2=0x7f407c152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:02.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.341+0000 7f407be00640 1 --2- 172.21.15.42:0/1253361077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f407c06e4e0 0x7f407c152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.341+0000 7f407be00640 1 -- 172.21.15.42:0/1253361077 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f407c132a00 con 0x7f407c072480 2024-09-17T01:49:02.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.341+0000 7f407be00640 1 --2- 172.21.15.42:0/1253361077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f407c072480 0x7f407c1526b0 secure :-1 s=READY pgs=2479 cs=0 l=1 rev1=1 crypto rx=0x7f406800c3f0 tx=0x7f406800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:02.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.342+0000 7f4078c00640 1 -- 172.21.15.42:0/1253361077 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4068017070 con 0x7f407c072480 2024-09-17T01:49:02.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.342+0000 7f4078c00640 1 -- 172.21.15.42:0/1253361077 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40680035f0 con 0x7f407c072480 2024-09-17T01:49:02.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.342+0000 7f4078c00640 1 -- 172.21.15.42:0/1253361077 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4068003a40 con 0x7f407c072480 2024-09-17T01:49:02.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.342+0000 7f4081e00640 1 -- 172.21.15.42:0/1253361077 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f407c155160 con 0x7f407c072480 2024-09-17T01:49:02.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.342+0000 7f4081e00640 1 -- 172.21.15.42:0/1253361077 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f407c14a1b0 con 0x7f407c072480 2024-09-17T01:49:02.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.343+0000 7f4081e00640 1 -- 172.21.15.42:0/1253361077 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f407c154ed0 con 0x7f407c072480 2024-09-17T01:49:02.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.344+0000 7f4078c00640 1 -- 172.21.15.42:0/1253361077 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f406801a070 con 0x7f407c072480 2024-09-17T01:49:02.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.346+0000 7f4078c00640 1 --2- 172.21.15.42:0/1253361077 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f405c078bc0 0x7f405c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:02.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.346+0000 7f4078c00640 1 -- 172.21.15.42:0/1253361077 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(215..215 src has 1..215) ==== 5912+0+0 (secure 0 0 0) 0x7f406809a1f0 con 0x7f407c072480 2024-09-17T01:49:02.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.346+0000 7f4080a00640 1 --2- 172.21.15.42:0/1253361077 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f405c078bc0 0x7f405c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:02.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.347+0000 7f4080a00640 1 --2- 172.21.15.42:0/1253361077 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f405c078bc0 0x7f405c07b0d0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f4070009b30 tx=0x7f4070005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:02.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.350+0000 7f4078c00640 1 -- 172.21.15.42:0/1253361077 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4068061e70 con 0x7f407c072480 2024-09-17T01:49:02.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.587+0000 7f4081e00640 1 -- 172.21.15.42:0/1253361077 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f407c06e8f0 con 0x7f407c072480 2024-09-17T01:49:02.586 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-17T01:49:02.588+0000 7f9961e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:49:02.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.590+0000 7f4078c00640 1 -- 172.21.15.42:0/1253361077 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v169) ==== 161+0+0 (secure 0 0 0) 0x7f40680668a0 con 0x7f407c072480 2024-09-17T01:49:02.588 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T01:49:02.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.593+0000 7f4081e00640 1 -- 172.21.15.42:0/1253361077 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f405c078bc0 msgr2=0x7f405c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:02.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.593+0000 7f4081e00640 1 --2- 172.21.15.42:0/1253361077 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f405c078bc0 0x7f405c07b0d0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f4070009b30 tx=0x7f4070005f90 comp rx=0 tx=0).stop 2024-09-17T01:49:02.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.593+0000 7f4081e00640 1 -- 172.21.15.42:0/1253361077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f407c072480 msgr2=0x7f407c1526b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:02.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.593+0000 7f4081e00640 1 --2- 172.21.15.42:0/1253361077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f407c072480 0x7f407c1526b0 secure :-1 s=READY pgs=2479 cs=0 l=1 rev1=1 crypto rx=0x7f406800c3f0 tx=0x7f406800c8b0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.593+0000 7f4081e00640 1 -- 172.21.15.42:0/1253361077 shutdown_connections 2024-09-17T01:49:02.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.593+0000 7f4081e00640 1 --2- 172.21.15.42:0/1253361077 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f405c078bc0 0x7f405c07b0d0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.593+0000 7f4081e00640 1 --2- 172.21.15.42:0/1253361077 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f407c151bb0 0x7f407c14ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.593+0000 7f4081e00640 1 --2- 172.21.15.42:0/1253361077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f407c072480 0x7f407c1526b0 unknown :-1 s=CLOSED pgs=2479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.593+0000 7f4081e00640 1 --2- 172.21.15.42:0/1253361077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f407c06e4e0 0x7f407c152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.594+0000 7f4081e00640 1 -- 172.21.15.42:0/1253361077 >> 172.21.15.42:0/1253361077 conn(0x7f407c06d3f0 msgr2=0x7f407c072890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:02.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.594+0000 7f4081e00640 1 -- 172.21.15.42:0/1253361077 shutdown_connections 2024-09-17T01:49:02.592 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.594+0000 7f4081e00640 1 -- 172.21.15.42:0/1253361077 wait complete. 2024-09-17T01:49:02.614 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T01:49:02.737 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-09-17T01:49:02.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.847+0000 7f4d23e00640 1 -- 172.21.15.42:0/597084188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d24155b60 msgr2=0x7f4d240af4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:02.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.847+0000 7f4d23e00640 1 --2- 172.21.15.42:0/597084188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d24155b60 0x7f4d240af4e0 secure :-1 s=READY pgs=2480 cs=0 l=1 rev1=1 crypto rx=0x7f4d240b5be0 tx=0x7f4d1402a4d0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.847+0000 7f4d23e00640 1 -- 172.21.15.42:0/597084188 shutdown_connections 2024-09-17T01:49:02.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.847+0000 7f4d23e00640 1 --2- 172.21.15.42:0/597084188 >> v2:172.21.15.43:3300/0 conn(0x7f4d240aedd0 0x7f4d241626b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.845 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.847+0000 7f4d23e00640 1 --2- 172.21.15.42:0/597084188 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d240afa20 0x7f4d240ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.847+0000 7f4d23e00640 1 --2- 172.21.15.42:0/597084188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d24155b60 0x7f4d240af4e0 unknown :-1 s=CLOSED pgs=2480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.847+0000 7f4d23e00640 1 -- 172.21.15.42:0/597084188 >> 172.21.15.42:0/597084188 conn(0x7f4d2406d3f0 msgr2=0x7f4d240b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:02.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.847+0000 7f4d23e00640 1 -- 172.21.15.42:0/597084188 shutdown_connections 2024-09-17T01:49:02.846 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.847+0000 7f4d23e00640 1 -- 172.21.15.42:0/597084188 wait complete. 2024-09-17T01:49:02.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.849+0000 7f4d23e00640 1 Processor -- start 2024-09-17T01:49:02.847 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.849+0000 7f4d23e00640 1 -- start start 2024-09-17T01:49:02.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.851+0000 7f4d23e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d240aedd0 0x7f4d2414e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:02.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.851+0000 7f4d23e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d240afa20 0x7f4d24150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:02.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.851+0000 7f4d23e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d24155b60 0x7f4d24150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:02.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.851+0000 7f4d23e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4d24162d70 con 0x7f4d240aedd0 2024-09-17T01:49:02.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.851+0000 7f4d23e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4d24162bf0 con 0x7f4d240afa20 2024-09-17T01:49:02.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.851+0000 7f4d23e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4d24162ef0 con 0x7f4d24155b60 2024-09-17T01:49:02.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.851+0000 7f4d22a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d240aedd0 0x7f4d2414e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:02.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.851+0000 7f4d22a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d240aedd0 0x7f4d2414e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52064/0 (socket says 172.21.15.42:52064) 2024-09-17T01:49:02.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.851+0000 7f4d22a00640 1 -- 172.21.15.42:0/1064495774 learned_addr learned my addr 172.21.15.42:0/1064495774 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:02.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.851+0000 7f4d1a000640 1 --2- 172.21.15.42:0/1064495774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d240afa20 0x7f4d24150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:02.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.851+0000 7f4d23400640 1 --2- 172.21.15.42:0/1064495774 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d24155b60 0x7f4d24150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:02.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.852+0000 7f4d22a00640 1 -- 172.21.15.42:0/1064495774 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d24155b60 msgr2=0x7f4d24150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:02.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.852+0000 7f4d22a00640 1 --2- 172.21.15.42:0/1064495774 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d24155b60 0x7f4d24150790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.852+0000 7f4d22a00640 1 -- 172.21.15.42:0/1064495774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d240afa20 msgr2=0x7f4d24150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:02.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.852+0000 7f4d22a00640 1 --2- 172.21.15.42:0/1064495774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d240afa20 0x7f4d24150250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.852+0000 7f4d22a00640 1 -- 172.21.15.42:0/1064495774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d24151060 con 0x7f4d240aedd0 2024-09-17T01:49:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.852+0000 7f4d22a00640 1 --2- 172.21.15.42:0/1064495774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d240aedd0 0x7f4d2414e340 secure :-1 s=READY pgs=2481 cs=0 l=1 rev1=1 crypto rx=0x7f4d14034040 tx=0x7f4d140039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.852+0000 7f4d1b400640 1 -- 172.21.15.42:0/1064495774 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1403e030 con 0x7f4d240aedd0 2024-09-17T01:49:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.852+0000 7f4d1b400640 1 -- 172.21.15.42:0/1064495774 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d140047a0 con 0x7f4d240aedd0 2024-09-17T01:49:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.852+0000 7f4d1b400640 1 -- 172.21.15.42:0/1064495774 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d14035040 con 0x7f4d240aedd0 2024-09-17T01:49:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.852+0000 7f4d23e00640 1 -- 172.21.15.42:0/1064495774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d24151340 con 0x7f4d240aedd0 2024-09-17T01:49:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.852+0000 7f4d23e00640 1 -- 172.21.15.42:0/1064495774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d24151900 con 0x7f4d240aedd0 2024-09-17T01:49:02.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.854+0000 7f4d23e00640 1 -- 172.21.15.42:0/1064495774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d2406f900 con 0x7f4d240aedd0 2024-09-17T01:49:02.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.855+0000 7f4d1b400640 1 -- 172.21.15.42:0/1064495774 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4d14041030 con 0x7f4d240aedd0 2024-09-17T01:49:02.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.856+0000 7f4d1b400640 1 --2- 172.21.15.42:0/1064495774 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4d00078bc0 0x7f4d0007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:02.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.856+0000 7f4d1b400640 1 -- 172.21.15.42:0/1064495774 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(216..216 src has 1..216) ==== 5998+0+0 (secure 0 0 0) 0x7f4d140bb5f0 con 0x7f4d240aedd0 2024-09-17T01:49:02.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.856+0000 7f4d1a000640 1 --2- 172.21.15.42:0/1064495774 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4d00078bc0 0x7f4d0007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:02.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.857+0000 7f4d1a000640 1 --2- 172.21.15.42:0/1064495774 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4d00078bc0 0x7f4d0007b0d0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f4d2414b050 tx=0x7f4d0c00b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:02.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:02.860+0000 7f4d1b400640 1 -- 172.21.15.42:0/1064495774 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4d2406f900 con 0x7f4d240aedd0 2024-09-17T01:49:03.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.091+0000 7f4d23e00640 1 -- 172.21.15.42:0/1064495774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4d241634b0 con 0x7f4d240aedd0 2024-09-17T01:49:03.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.596+0000 7f4d1b400640 1 -- 172.21.15.42:0/1064495774 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v170) ==== 104+0+0 (secure 0 0 0) 0x7f4d14083220 con 0x7f4d240aedd0 2024-09-17T01:49:03.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.599+0000 7f4d23e00640 1 -- 172.21.15.42:0/1064495774 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4d00078bc0 msgr2=0x7f4d0007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:03.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.599+0000 7f4d23e00640 1 --2- 172.21.15.42:0/1064495774 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4d00078bc0 0x7f4d0007b0d0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f4d2414b050 tx=0x7f4d0c00b2e0 comp rx=0 tx=0).stop 2024-09-17T01:49:03.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.599+0000 7f4d23e00640 1 -- 172.21.15.42:0/1064495774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d240aedd0 msgr2=0x7f4d2414e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:03.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.599+0000 7f4d23e00640 1 --2- 172.21.15.42:0/1064495774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d240aedd0 0x7f4d2414e340 secure :-1 s=READY pgs=2481 cs=0 l=1 rev1=1 crypto rx=0x7f4d14034040 tx=0x7f4d140039e0 comp rx=0 tx=0).stop 2024-09-17T01:49:03.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.599+0000 7f4d23e00640 1 -- 172.21.15.42:0/1064495774 shutdown_connections 2024-09-17T01:49:03.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.599+0000 7f4d23e00640 1 --2- 172.21.15.42:0/1064495774 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4d00078bc0 0x7f4d0007b0d0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:03.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.599+0000 7f4d23e00640 1 --2- 172.21.15.42:0/1064495774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d240afa20 0x7f4d24150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:03.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.599+0000 7f4d23e00640 1 --2- 172.21.15.42:0/1064495774 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4d24155b60 0x7f4d24150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:03.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.599+0000 7f4d23e00640 1 --2- 172.21.15.42:0/1064495774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d240aedd0 0x7f4d2414e340 unknown :-1 s=CLOSED pgs=2481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:03.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.599+0000 7f4d23e00640 1 -- 172.21.15.42:0/1064495774 >> 172.21.15.42:0/1064495774 conn(0x7f4d2406d3f0 msgr2=0x7f4d241624a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:03.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.599+0000 7f4d23e00640 1 -- 172.21.15.42:0/1064495774 shutdown_connections 2024-09-17T01:49:03.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.599+0000 7f4d23e00640 1 -- 172.21.15.42:0/1064495774 wait complete. 2024-09-17T01:49:03.624 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T01:49:03.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.861+0000 7f6895800640 1 -- 172.21.15.42:0/1937353856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6890072700 msgr2=0x7f689006f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:03.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.861+0000 7f6895800640 1 --2- 172.21.15.42:0/1937353856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6890072700 0x7f689006f870 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f6878009830 tx=0x7f687802a520 comp rx=0 tx=0).stop 2024-09-17T01:49:03.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.861+0000 7f6895800640 1 -- 172.21.15.42:0/1937353856 shutdown_connections 2024-09-17T01:49:03.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.861+0000 7f6895800640 1 --2- 172.21.15.42:0/1937353856 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6890072700 0x7f689006f870 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:03.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.861+0000 7f6895800640 1 -- 172.21.15.42:0/1937353856 >> 172.21.15.42:0/1937353856 conn(0x7f689006d420 msgr2=0x7f68900b2430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:03.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.862+0000 7f6895800640 1 -- 172.21.15.42:0/1937353856 shutdown_connections 2024-09-17T01:49:03.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.862+0000 7f6895800640 1 -- 172.21.15.42:0/1937353856 wait complete. 2024-09-17T01:49:03.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.864+0000 7f6895800640 1 Processor -- start 2024-09-17T01:49:03.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.864+0000 7f6895800640 1 -- start start 2024-09-17T01:49:03.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.865+0000 7f6895800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f689006fdb0 0x7f6890155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:03.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.865+0000 7f6895800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6890072700 0x7f689014cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:03.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.865+0000 7f6895800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f689015c190 0x7f689014d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:03.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.865+0000 7f6895800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f68900b4a30 con 0x7f689015c190 2024-09-17T01:49:03.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.865+0000 7f6895800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f68900b48b0 con 0x7f6890072700 2024-09-17T01:49:03.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.865+0000 7f6895800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f68900b4bb0 con 0x7f689006fdb0 2024-09-17T01:49:03.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.866+0000 7f688f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f689015c190 0x7f689014d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:03.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.866+0000 7f688f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f689015c190 0x7f689014d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52072/0 (socket says 172.21.15.42:52072) 2024-09-17T01:49:03.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.866+0000 7f688f400640 1 -- 172.21.15.42:0/2126428645 learned_addr learned my addr 172.21.15.42:0/2126428645 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:03.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.866+0000 7f6886000640 1 --2- 172.21.15.42:0/2126428645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6890072700 0x7f689014cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:03.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.866+0000 7f688f400640 1 -- 172.21.15.42:0/2126428645 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f689006fdb0 msgr2=0x7f6890155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:03.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.866+0000 7f688f400640 1 --2- 172.21.15.42:0/2126428645 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f689006fdb0 0x7f6890155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:03.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.866+0000 7f688f400640 1 -- 172.21.15.42:0/2126428645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6890072700 msgr2=0x7f689014cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:03.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.866+0000 7f688f400640 1 --2- 172.21.15.42:0/2126428645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6890072700 0x7f689014cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:03.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.866+0000 7f688f400640 1 -- 172.21.15.42:0/2126428645 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689014e970 con 0x7f689015c190 2024-09-17T01:49:03.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.866+0000 7f688f400640 1 --2- 172.21.15.42:0/2126428645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f689015c190 0x7f689014d420 secure :-1 s=READY pgs=2483 cs=0 l=1 rev1=1 crypto rx=0x7f688800cb40 tx=0x7f688800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:03.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.867+0000 7f6887400640 1 -- 172.21.15.42:0/2126428645 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6888016020 con 0x7f689015c190 2024-09-17T01:49:03.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.867+0000 7f6887400640 1 -- 172.21.15.42:0/2126428645 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f688800ad90 con 0x7f689015c190 2024-09-17T01:49:03.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.867+0000 7f6887400640 1 -- 172.21.15.42:0/2126428645 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6888012680 con 0x7f689015c190 2024-09-17T01:49:03.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.867+0000 7f6895800640 1 -- 172.21.15.42:0/2126428645 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f689014ec50 con 0x7f689015c190 2024-09-17T01:49:03.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.867+0000 7f6895800640 1 -- 172.21.15.42:0/2126428645 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f689014f580 con 0x7f689015c190 2024-09-17T01:49:03.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.868+0000 7f6895800640 1 -- 172.21.15.42:0/2126428645 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f689015e540 con 0x7f689015c190 2024-09-17T01:49:03.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.870+0000 7f6887400640 1 -- 172.21.15.42:0/2126428645 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6888019020 con 0x7f689015c190 2024-09-17T01:49:03.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.871+0000 7f6887400640 1 --2- 172.21.15.42:0/2126428645 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f686c078b90 0x7f686c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:03.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.871+0000 7f6887400640 1 -- 172.21.15.42:0/2126428645 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(216..216 src has 1..216) ==== 5998+0+0 (secure 0 0 0) 0x7f688809b3a0 con 0x7f689015c190 2024-09-17T01:49:03.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.872+0000 7f688ea00640 1 --2- 172.21.15.42:0/2126428645 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f686c078b90 0x7f686c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:03.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.872+0000 7f688ea00640 1 --2- 172.21.15.42:0/2126428645 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f686c078b90 0x7f686c07b0a0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f6880000f60 tx=0x7f68800079b0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:03.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:03.876+0000 7f6887400640 1 -- 172.21.15.42:0/2126428645 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f689015e540 con 0x7f689015c190 2024-09-17T01:49:04.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.068+0000 7f6895800640 1 -- 172.21.15.42:0/2126428645 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6890076490 con 0x7f689015c190 2024-09-17T01:49:04.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.598+0000 7f6887400640 1 -- 172.21.15.42:0/2126428645 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v217) ==== 181+0+0 (secure 0 0 0) 0x7f6890076490 con 0x7f689015c190 2024-09-17T01:49:04.596 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-09-17T01:49:04.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.601+0000 7f6895800640 1 -- 172.21.15.42:0/2126428645 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f686c078b90 msgr2=0x7f686c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:04.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.601+0000 7f6895800640 1 --2- 172.21.15.42:0/2126428645 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f686c078b90 0x7f686c07b0a0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f6880000f60 tx=0x7f68800079b0 comp rx=0 tx=0).stop 2024-09-17T01:49:04.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.601+0000 7f6895800640 1 -- 172.21.15.42:0/2126428645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f689015c190 msgr2=0x7f689014d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:04.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.601+0000 7f6895800640 1 --2- 172.21.15.42:0/2126428645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f689015c190 0x7f689014d420 secure :-1 s=READY pgs=2483 cs=0 l=1 rev1=1 crypto rx=0x7f688800cb40 tx=0x7f688800a060 comp rx=0 tx=0).stop 2024-09-17T01:49:04.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.602+0000 7f6895800640 1 -- 172.21.15.42:0/2126428645 shutdown_connections 2024-09-17T01:49:04.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.602+0000 7f6895800640 1 --2- 172.21.15.42:0/2126428645 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f686c078b90 0x7f686c07b0a0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:04.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.602+0000 7f6895800640 1 --2- 172.21.15.42:0/2126428645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6890072700 0x7f689014cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:04.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.602+0000 7f6895800640 1 --2- 172.21.15.42:0/2126428645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f689015c190 0x7f689014d420 unknown :-1 s=CLOSED pgs=2483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:04.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.602+0000 7f6895800640 1 --2- 172.21.15.42:0/2126428645 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f689006fdb0 0x7f6890155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:04.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.602+0000 7f6895800640 1 -- 172.21.15.42:0/2126428645 >> 172.21.15.42:0/2126428645 conn(0x7f689006d420 msgr2=0x7f68900b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:04.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.602+0000 7f6895800640 1 -- 172.21.15.42:0/2126428645 shutdown_connections 2024-09-17T01:49:04.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.602+0000 7f6895800640 1 -- 172.21.15.42:0/2126428645 wait complete. 2024-09-17T01:49:04.630 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T01:49:04.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.868+0000 7f43e1000640 1 -- 172.21.15.42:0/4100169541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43c0003a00 msgr2=0x7f43c0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:04.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.868+0000 7f43e1000640 1 --2- 172.21.15.42:0/4100169541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43c0003a00 0x7f43c0003e70 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009b50 tx=0x7f43c0005830 comp rx=0 tx=0).stop 2024-09-17T01:49:04.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.868+0000 7f43da800640 1 -- 172.21.15.42:0/4100169541 reap_dead start 2024-09-17T01:49:04.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.868+0000 7f43e1000640 1 -- 172.21.15.42:0/4100169541 shutdown_connections 2024-09-17T01:49:04.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.868+0000 7f43e1000640 1 -- 172.21.15.42:0/4100169541 >> 172.21.15.42:0/4100169541 conn(0x7f43dc06d420 msgr2=0x7f43dc0b2430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:04.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.868+0000 7f43e1000640 1 -- 172.21.15.42:0/4100169541 shutdown_connections 2024-09-17T01:49:04.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.868+0000 7f43e1000640 1 -- 172.21.15.42:0/4100169541 wait complete. 2024-09-17T01:49:04.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.871+0000 7f43e1000640 1 Processor -- start 2024-09-17T01:49:04.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.871+0000 7f43e1000640 1 -- start start 2024-09-17T01:49:04.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.872+0000 7f43e1000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43c0003a00 0x7f43dc14b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:04.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.872+0000 7f43e1000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f43dc0c56a0 0x7f43dc1f8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:04.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.872+0000 7f43e1000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43dc0c5ab0 0x7f43dc1f9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:04.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.872+0000 7f43e1000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc0cfd60 con 0x7f43c0003a00 2024-09-17T01:49:04.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.872+0000 7f43e1000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc0cfbe0 con 0x7f43dc0c5ab0 2024-09-17T01:49:04.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.872+0000 7f43e1000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f43dc0cfee0 con 0x7f43dc0c56a0 2024-09-17T01:49:04.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.872+0000 7f43d9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43c0003a00 0x7f43dc14b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:04.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.872+0000 7f43d9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43c0003a00 0x7f43dc14b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:52088/0 (socket says 172.21.15.42:52088) 2024-09-17T01:49:04.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.872+0000 7f43d9e00640 1 -- 172.21.15.42:0/1605215408 learned_addr learned my addr 172.21.15.42:0/1605215408 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:04.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.873+0000 7f43d3e00640 1 --2- 172.21.15.42:0/1605215408 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f43dc0c56a0 0x7f43dc1f8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:04.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.873+0000 7f43da800640 1 --2- 172.21.15.42:0/1605215408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43dc0c5ab0 0x7f43dc1f9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:04.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.873+0000 7f43d9e00640 1 -- 172.21.15.42:0/1605215408 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f43dc0c56a0 msgr2=0x7f43dc1f8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:04.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.873+0000 7f43d9e00640 1 --2- 172.21.15.42:0/1605215408 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f43dc0c56a0 0x7f43dc1f8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:04.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.873+0000 7f43d9e00640 1 -- 172.21.15.42:0/1605215408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43dc0c5ab0 msgr2=0x7f43dc1f9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:04.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.873+0000 7f43d9e00640 1 --2- 172.21.15.42:0/1605215408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43dc0c5ab0 0x7f43dc1f9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:04.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.873+0000 7f43d9e00640 1 -- 172.21.15.42:0/1605215408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43dc1e9220 con 0x7f43c0003a00 2024-09-17T01:49:04.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.873+0000 7f43d9e00640 1 --2- 172.21.15.42:0/1605215408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43c0003a00 0x7f43dc14b4c0 secure :-1 s=READY pgs=2486 cs=0 l=1 rev1=1 crypto rx=0x7f43cc02b4f0 tx=0x7f43cc033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:04.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.873+0000 7f43d2000640 1 -- 172.21.15.42:0/1605215408 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43cc038040 con 0x7f43c0003a00 2024-09-17T01:49:04.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.874+0000 7f43d2000640 1 -- 172.21.15.42:0/1605215408 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43cc004020 con 0x7f43c0003a00 2024-09-17T01:49:04.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.874+0000 7f43e1000640 1 -- 172.21.15.42:0/1605215408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43dc1e9500 con 0x7f43c0003a00 2024-09-17T01:49:04.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.874+0000 7f43d2000640 1 -- 172.21.15.42:0/1605215408 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43cc004450 con 0x7f43c0003a00 2024-09-17T01:49:04.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.874+0000 7f43e1000640 1 -- 172.21.15.42:0/1605215408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43dc1e9ac0 con 0x7f43c0003a00 2024-09-17T01:49:04.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.875+0000 7f43e1000640 1 -- 172.21.15.42:0/1605215408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43dc0b5630 con 0x7f43c0003a00 2024-09-17T01:49:04.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.876+0000 7f43d2000640 1 -- 172.21.15.42:0/1605215408 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f43cc045020 con 0x7f43c0003a00 2024-09-17T01:49:04.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.877+0000 7f43d2000640 1 --2- 172.21.15.42:0/1605215408 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f43b8078b90 0x7f43b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:04.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.877+0000 7f43d2000640 1 -- 172.21.15.42:0/1605215408 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(217..217 src has 1..217) ==== 5560+0+0 (secure 0 0 0) 0x7f43cc0bb640 con 0x7f43c0003a00 2024-09-17T01:49:04.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.877+0000 7f43d3e00640 1 --2- 172.21.15.42:0/1605215408 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f43b8078b90 0x7f43b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:04.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.878+0000 7f43d3e00640 1 --2- 172.21.15.42:0/1605215408 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f43b8078b90 0x7f43b807b0a0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f43dc1e8710 tx=0x7f43c4005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:04.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:04.882+0000 7f43d2000640 1 -- 172.21.15.42:0/1605215408 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f43cc0834c0 con 0x7f43c0003a00 2024-09-17T01:49:05.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.078+0000 7f43e1000640 1 -- 172.21.15.42:0/1605215408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f43dc15eea0 con 0x7f43c0003a00 2024-09-17T01:49:05.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.604+0000 7f43d2000640 1 -- 172.21.15.42:0/1605215408 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v218) ==== 169+0+0 (secure 0 0 0) 0x7f43cc087ef0 con 0x7f43c0003a00 2024-09-17T01:49:05.602 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-09-17T01:49:05.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.607+0000 7f43e1000640 1 -- 172.21.15.42:0/1605215408 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f43b8078b90 msgr2=0x7f43b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:05.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.607+0000 7f43e1000640 1 --2- 172.21.15.42:0/1605215408 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f43b8078b90 0x7f43b807b0a0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f43dc1e8710 tx=0x7f43c4005f90 comp rx=0 tx=0).stop 2024-09-17T01:49:05.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.607+0000 7f43e1000640 1 -- 172.21.15.42:0/1605215408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43c0003a00 msgr2=0x7f43dc14b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:05.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.607+0000 7f43e1000640 1 --2- 172.21.15.42:0/1605215408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43c0003a00 0x7f43dc14b4c0 secure :-1 s=READY pgs=2486 cs=0 l=1 rev1=1 crypto rx=0x7f43cc02b4f0 tx=0x7f43cc033670 comp rx=0 tx=0).stop 2024-09-17T01:49:05.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.608+0000 7f43e1000640 1 -- 172.21.15.42:0/1605215408 shutdown_connections 2024-09-17T01:49:05.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.608+0000 7f43e1000640 1 --2- 172.21.15.42:0/1605215408 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f43b8078b90 0x7f43b807b0a0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:05.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.608+0000 7f43e1000640 1 --2- 172.21.15.42:0/1605215408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43dc0c5ab0 0x7f43dc1f9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:05.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.608+0000 7f43e1000640 1 --2- 172.21.15.42:0/1605215408 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f43dc0c56a0 0x7f43dc1f8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:05.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.608+0000 7f43e1000640 1 --2- 172.21.15.42:0/1605215408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f43c0003a00 0x7f43dc14b4c0 unknown :-1 s=CLOSED pgs=2486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:05.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.608+0000 7f43e1000640 1 -- 172.21.15.42:0/1605215408 >> 172.21.15.42:0/1605215408 conn(0x7f43dc06d420 msgr2=0x7f43dc15f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:05.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.609+0000 7f43e1000640 1 -- 172.21.15.42:0/1605215408 shutdown_connections 2024-09-17T01:49:05.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.609+0000 7f43e1000640 1 -- 172.21.15.42:0/1605215408 wait complete. 2024-09-17T01:49:05.640 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T01:49:05.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.886+0000 7f6418400640 1 -- 172.21.15.42:0/1613871413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6410069240 msgr2=0x7f641015d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:05.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.886+0000 7f6418400640 1 --2- 172.21.15.42:0/1613871413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6410069240 0x7f641015d000 secure :-1 s=READY pgs=2487 cs=0 l=1 rev1=1 crypto rx=0x7f63fc005fd0 tx=0x7f63fc02a540 comp rx=0 tx=0).stop 2024-09-17T01:49:05.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.887+0000 7f6418400640 1 -- 172.21.15.42:0/1613871413 shutdown_connections 2024-09-17T01:49:05.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.887+0000 7f6418400640 1 --2- 172.21.15.42:0/1613871413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6410069240 0x7f641015d000 unknown :-1 s=CLOSED pgs=2487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:05.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.887+0000 7f6418400640 1 --2- 172.21.15.42:0/1613871413 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f64100b0dd0 0x7f6410068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:05.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.887+0000 7f6418400640 1 -- 172.21.15.42:0/1613871413 >> 172.21.15.42:0/1613871413 conn(0x7f6410074700 msgr2=0x7f641006cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:05.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.887+0000 7f6418400640 1 -- 172.21.15.42:0/1613871413 shutdown_connections 2024-09-17T01:49:05.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.887+0000 7f6418400640 1 -- 172.21.15.42:0/1613871413 wait complete. 2024-09-17T01:49:05.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.891+0000 7f6418400640 1 Processor -- start 2024-09-17T01:49:05.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.891+0000 7f6418400640 1 -- start start 2024-09-17T01:49:05.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.894+0000 7f6418400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6410069240 0x7f64101f97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:05.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.894+0000 7f6418400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64100b0dd0 0x7f641015a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:05.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.894+0000 7f6418400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f641015d540 0x7f641015a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:05.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.894+0000 7f6418400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6410160d50 con 0x7f6410069240 2024-09-17T01:49:05.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.894+0000 7f6418400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6410160090 con 0x7f64100b0dd0 2024-09-17T01:49:05.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.894+0000 7f6418400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6410160ed0 con 0x7f641015d540 2024-09-17T01:49:05.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.894+0000 7f6415a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6410069240 0x7f64101f97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.894+0000 7f6415a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6410069240 0x7f64101f97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46400/0 (socket says 172.21.15.42:46400) 2024-09-17T01:49:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.894+0000 7f6415a00640 1 -- 172.21.15.42:0/1577117511 learned_addr learned my addr 172.21.15.42:0/1577117511 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.894+0000 7f6415000640 1 --2- 172.21.15.42:0/1577117511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64100b0dd0 0x7f641015a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.894+0000 7f6416400640 1 --2- 172.21.15.42:0/1577117511 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f641015d540 0x7f641015a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.894+0000 7f6415a00640 1 -- 172.21.15.42:0/1577117511 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f641015d540 msgr2=0x7f641015a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.894+0000 7f6415a00640 1 --2- 172.21.15.42:0/1577117511 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f641015d540 0x7f641015a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.894+0000 7f6415a00640 1 -- 172.21.15.42:0/1577117511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64100b0dd0 msgr2=0x7f641015a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.894+0000 7f6415a00640 1 --2- 172.21.15.42:0/1577117511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64100b0dd0 0x7f641015a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.894+0000 7f6415a00640 1 -- 172.21.15.42:0/1577117511 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64101fe220 con 0x7f6410069240 2024-09-17T01:49:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.895+0000 7f6415a00640 1 --2- 172.21.15.42:0/1577117511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6410069240 0x7f64101f97e0 secure :-1 s=READY pgs=2488 cs=0 l=1 rev1=1 crypto rx=0x7f640400e7f0 tx=0x7f640400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.895+0000 7f640d600640 1 -- 172.21.15.42:0/1577117511 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640400eea0 con 0x7f6410069240 2024-09-17T01:49:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.895+0000 7f640d600640 1 -- 172.21.15.42:0/1577117511 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f640400ccc0 con 0x7f6410069240 2024-09-17T01:49:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.895+0000 7f6418400640 1 -- 172.21.15.42:0/1577117511 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6410151d00 con 0x7f6410069240 2024-09-17T01:49:05.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.895+0000 7f640d600640 1 -- 172.21.15.42:0/1577117511 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6404004280 con 0x7f6410069240 2024-09-17T01:49:05.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.895+0000 7f6418400640 1 -- 172.21.15.42:0/1577117511 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64100b4e70 con 0x7f6410069240 2024-09-17T01:49:05.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.897+0000 7f6418400640 1 -- 172.21.15.42:0/1577117511 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6410161380 con 0x7f6410069240 2024-09-17T01:49:05.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.898+0000 7f640d600640 1 -- 172.21.15.42:0/1577117511 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f64040035f0 con 0x7f6410069240 2024-09-17T01:49:05.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.899+0000 7f640d600640 1 --2- 172.21.15.42:0/1577117511 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f63f0078bc0 0x7f63f007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:05.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.899+0000 7f640d600640 1 -- 172.21.15.42:0/1577117511 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 4943+0+0 (secure 0 0 0) 0x7f640409b200 con 0x7f6410069240 2024-09-17T01:49:05.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.899+0000 7f6415000640 1 --2- 172.21.15.42:0/1577117511 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f63f0078bc0 0x7f63f007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:05.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.900+0000 7f6415000640 1 --2- 172.21.15.42:0/1577117511 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f63f0078bc0 0x7f63f007b0d0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f63fc033000 tx=0x7f63fc004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:05.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:05.903+0000 7f640d600640 1 -- 172.21.15.42:0/1577117511 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f64040632f0 con 0x7f6410069240 2024-09-17T01:49:06.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.099+0000 7f6418400640 1 -- 172.21.15.42:0/1577117511 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f64100ceeb0 con 0x7f6410069240 2024-09-17T01:49:06.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.104+0000 7f640d600640 1 -- 172.21.15.42:0/1577117511 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v67) ==== 71+0+0 (secure 0 0 0) 0x7f6404067d20 con 0x7f6410069240 2024-09-17T01:49:06.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.106+0000 7f6418400640 1 -- 172.21.15.42:0/1577117511 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f63f0078bc0 msgr2=0x7f63f007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:06.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.106+0000 7f6418400640 1 --2- 172.21.15.42:0/1577117511 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f63f0078bc0 0x7f63f007b0d0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f63fc033000 tx=0x7f63fc004730 comp rx=0 tx=0).stop 2024-09-17T01:49:06.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.106+0000 7f6418400640 1 -- 172.21.15.42:0/1577117511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6410069240 msgr2=0x7f64101f97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:06.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.106+0000 7f6418400640 1 --2- 172.21.15.42:0/1577117511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6410069240 0x7f64101f97e0 secure :-1 s=READY pgs=2488 cs=0 l=1 rev1=1 crypto rx=0x7f640400e7f0 tx=0x7f640400ecb0 comp rx=0 tx=0).stop 2024-09-17T01:49:06.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.106+0000 7f6418400640 1 -- 172.21.15.42:0/1577117511 shutdown_connections 2024-09-17T01:49:06.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.106+0000 7f6418400640 1 --2- 172.21.15.42:0/1577117511 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f63f0078bc0 0x7f63f007b0d0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:06.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.106+0000 7f6418400640 1 --2- 172.21.15.42:0/1577117511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64100b0dd0 0x7f641015a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:06.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.107+0000 7f6418400640 1 --2- 172.21.15.42:0/1577117511 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f641015d540 0x7f641015a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:06.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.107+0000 7f6418400640 1 --2- 172.21.15.42:0/1577117511 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6410069240 0x7f64101f97e0 unknown :-1 s=CLOSED pgs=2488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:06.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.107+0000 7f6418400640 1 -- 172.21.15.42:0/1577117511 >> 172.21.15.42:0/1577117511 conn(0x7f6410074700 msgr2=0x7f6410071990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:06.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.107+0000 7f6418400640 1 -- 172.21.15.42:0/1577117511 shutdown_connections 2024-09-17T01:49:06.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.107+0000 7f6418400640 1 -- 172.21.15.42:0/1577117511 wait complete. 2024-09-17T01:49:06.131 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files' 2024-09-17T01:49:06.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.361+0000 7f450f200640 1 -- 172.21.15.42:0/2374821637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f40051c0 msgr2=0x7f44f400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:06.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.361+0000 7f450f200640 1 --2- 172.21.15.42:0/2374821637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f40051c0 0x7f44f400b9c0 secure :-1 s=READY pgs=2490 cs=0 l=1 rev1=1 crypto rx=0x7f4508009ed0 tx=0x7f44f4005830 comp rx=0 tx=0).stop 2024-09-17T01:49:06.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.361+0000 7f450e800640 1 -- 172.21.15.42:0/2374821637 reap_dead start 2024-09-17T01:49:06.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.361+0000 7f450f200640 1 -- 172.21.15.42:0/2374821637 shutdown_connections 2024-09-17T01:49:06.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.361+0000 7f450f200640 1 -- 172.21.15.42:0/2374821637 >> 172.21.15.42:0/2374821637 conn(0x7f451006d3f0 msgr2=0x7f45100b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:06.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.361+0000 7f450f200640 1 -- 172.21.15.42:0/2374821637 shutdown_connections 2024-09-17T01:49:06.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.361+0000 7f450f200640 1 -- 172.21.15.42:0/2374821637 wait complete. 2024-09-17T01:49:06.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.364+0000 7f450f200640 1 Processor -- start 2024-09-17T01:49:06.361 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.364+0000 7f450f200640 1 -- start start 2024-09-17T01:49:06.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.365+0000 7f450f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f40051c0 0x7f451006f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:06.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.365+0000 7f450f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f451015f6d0 0x7f45100ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:06.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.365+0000 7f450f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f451015fae0 0x7f45100aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:06.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.365+0000 7f450f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f45100b55e0 con 0x7f44f40051c0 2024-09-17T01:49:06.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.365+0000 7f450f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4510160f30 con 0x7f451015fae0 2024-09-17T01:49:06.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.365+0000 7f450f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f45100b5760 con 0x7f451015f6d0 2024-09-17T01:49:06.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.366+0000 7f450de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f40051c0 0x7f451006f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:06.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.366+0000 7f450de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f40051c0 0x7f451006f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46418/0 (socket says 172.21.15.42:46418) 2024-09-17T01:49:06.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.366+0000 7f450de00640 1 -- 172.21.15.42:0/1867156934 learned_addr learned my addr 172.21.15.42:0/1867156934 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:06.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.366+0000 7f450e800640 1 --2- 172.21.15.42:0/1867156934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f451015fae0 0x7f45100aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:06.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.366+0000 7f4507e00640 1 --2- 172.21.15.42:0/1867156934 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f451015f6d0 0x7f45100ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:06.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.366+0000 7f450de00640 1 -- 172.21.15.42:0/1867156934 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f451015f6d0 msgr2=0x7f45100ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:06.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.366+0000 7f450de00640 1 --2- 172.21.15.42:0/1867156934 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f451015f6d0 0x7f45100ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:06.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.366+0000 7f450de00640 1 -- 172.21.15.42:0/1867156934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f451015fae0 msgr2=0x7f45100aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:06.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.366+0000 7f450de00640 1 --2- 172.21.15.42:0/1867156934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f451015fae0 0x7f45100aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:06.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.366+0000 7f450de00640 1 -- 172.21.15.42:0/1867156934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f451015e560 con 0x7f44f40051c0 2024-09-17T01:49:06.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.366+0000 7f450e800640 1 --2- 172.21.15.42:0/1867156934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f451015fae0 0x7f45100aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:49:06.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.366+0000 7f450de00640 1 --2- 172.21.15.42:0/1867156934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f40051c0 0x7f451006f840 secure :-1 s=READY pgs=2491 cs=0 l=1 rev1=1 crypto rx=0x7f4500001bb0 tx=0x7f45000039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:06.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.367+0000 7f4506000640 1 -- 172.21.15.42:0/1867156934 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4500015070 con 0x7f44f40051c0 2024-09-17T01:49:06.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.367+0000 7f4506000640 1 -- 172.21.15.42:0/1867156934 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4500011840 con 0x7f44f40051c0 2024-09-17T01:49:06.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.367+0000 7f4506000640 1 -- 172.21.15.42:0/1867156934 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4500011c90 con 0x7f44f40051c0 2024-09-17T01:49:06.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.367+0000 7f450f200640 1 -- 172.21.15.42:0/1867156934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f451015e840 con 0x7f44f40051c0 2024-09-17T01:49:06.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.367+0000 7f450f200640 1 -- 172.21.15.42:0/1867156934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f451015ee00 con 0x7f44f40051c0 2024-09-17T01:49:06.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.368+0000 7f450f200640 1 -- 172.21.15.42:0/1867156934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4510073d00 con 0x7f44f40051c0 2024-09-17T01:49:06.367 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.369+0000 7f4506000640 1 -- 172.21.15.42:0/1867156934 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4500018070 con 0x7f44f40051c0 2024-09-17T01:49:06.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.370+0000 7f4506000640 1 --2- 172.21.15.42:0/1867156934 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f44ec078b90 0x7f44ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:06.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.370+0000 7f4506000640 1 -- 172.21.15.42:0/1867156934 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 4943+0+0 (secure 0 0 0) 0x7f450009b890 con 0x7f44f40051c0 2024-09-17T01:49:06.368 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.370+0000 7f4507e00640 1 --2- 172.21.15.42:0/1867156934 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f44ec078b90 0x7f44ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:06.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.371+0000 7f4507e00640 1 --2- 172.21.15.42:0/1867156934 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f44ec078b90 0x7f44ec07b0a0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f451015dbb0 tx=0x7f44f8006b10 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:06.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.374+0000 7f4506000640 1 -- 172.21.15.42:0/1867156934 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4500063f40 con 0x7f44f40051c0 2024-09-17T01:49:06.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:06.645+0000 7f450f200640 1 -- 172.21.15.42:0/1867156934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]} v 0) -- 0x7f45101593c0 con 0x7f44f40051c0 2024-09-17T01:49:07.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.612+0000 7f4506000640 1 -- 172.21.15.42:0/1867156934 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]}]=0 v805) ==== 147+0+0 (secure 0 0 0) 0x7f4500063840 con 0x7f44f40051c0 2024-09-17T01:49:07.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.616+0000 7f450f200640 1 -- 172.21.15.42:0/1867156934 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f44ec078b90 msgr2=0x7f44ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:07.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.616+0000 7f450f200640 1 --2- 172.21.15.42:0/1867156934 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f44ec078b90 0x7f44ec07b0a0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f451015dbb0 tx=0x7f44f8006b10 comp rx=0 tx=0).stop 2024-09-17T01:49:07.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.616+0000 7f450f200640 1 -- 172.21.15.42:0/1867156934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f40051c0 msgr2=0x7f451006f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:07.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.616+0000 7f450f200640 1 --2- 172.21.15.42:0/1867156934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f40051c0 0x7f451006f840 secure :-1 s=READY pgs=2491 cs=0 l=1 rev1=1 crypto rx=0x7f4500001bb0 tx=0x7f45000039c0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.616+0000 7f450f200640 1 -- 172.21.15.42:0/1867156934 shutdown_connections 2024-09-17T01:49:07.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.616+0000 7f450f200640 1 --2- 172.21.15.42:0/1867156934 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f44ec078b90 0x7f44ec07b0a0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.616+0000 7f450f200640 1 --2- 172.21.15.42:0/1867156934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f451015fae0 0x7f45100aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.616+0000 7f450f200640 1 --2- 172.21.15.42:0/1867156934 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f451015f6d0 0x7f45100ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.616+0000 7f450f200640 1 --2- 172.21.15.42:0/1867156934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44f40051c0 0x7f451006f840 unknown :-1 s=CLOSED pgs=2491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.616+0000 7f450f200640 1 -- 172.21.15.42:0/1867156934 >> 172.21.15.42:0/1867156934 conn(0x7f451006d3f0 msgr2=0x7f4510145b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:07.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.616+0000 7f450f200640 1 -- 172.21.15.42:0/1867156934 shutdown_connections 2024-09-17T01:49:07.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.616+0000 7f450f200640 1 -- 172.21.15.42:0/1867156934 wait complete. 2024-09-17T01:49:07.639 INFO:tasks.cephfs_test_runner:test_scrub_backtrace_for_new_files (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-09-17T01:49:07.639 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_dup_inode (tasks.cephfs.test_scrub.TestScrub) 2024-09-17T01:49:07.640 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:49:07.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.875+0000 7f76dbe00640 1 -- 172.21.15.42:0/1792745887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76c00041c0 msgr2=0x7f76c0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:07.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.875+0000 7f76dbe00640 1 --2- 172.21.15.42:0/1792745887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76c00041c0 0x7f76c0004800 secure :-1 s=READY pgs=2493 cs=0 l=1 rev1=1 crypto rx=0x7f76c4009b50 tx=0x7f76c0005830 comp rx=0 tx=0).stop 2024-09-17T01:49:07.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.875+0000 7f76db400640 1 -- 172.21.15.42:0/1792745887 reap_dead start 2024-09-17T01:49:07.873 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.875+0000 7f76dbe00640 1 -- 172.21.15.42:0/1792745887 shutdown_connections 2024-09-17T01:49:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.875+0000 7f76dbe00640 1 -- 172.21.15.42:0/1792745887 >> 172.21.15.42:0/1792745887 conn(0x7f76dc06d3f0 msgr2=0x7f76dc0b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.875+0000 7f76dbe00640 1 -- 172.21.15.42:0/1792745887 shutdown_connections 2024-09-17T01:49:07.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.875+0000 7f76dbe00640 1 -- 172.21.15.42:0/1792745887 wait complete. 2024-09-17T01:49:07.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.877+0000 7f76dbe00640 1 Processor -- start 2024-09-17T01:49:07.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.877+0000 7f76dbe00640 1 -- start start 2024-09-17T01:49:07.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.879+0000 7f76dbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76c00041c0 0x7f76dc1559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:07.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.879+0000 7f76dbe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76dc0c5490 0x7f76dc0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:07.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.879+0000 7f76dbe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76dc1f5880 0x7f76dc159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:07.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.879+0000 7f76dbe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f76dc0b59c0 con 0x7f76c00041c0 2024-09-17T01:49:07.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.879+0000 7f76dbe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f76dc0b5840 con 0x7f76dc1f5880 2024-09-17T01:49:07.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.879+0000 7f76dbe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f76dc0cf380 con 0x7f76dc0c5490 2024-09-17T01:49:07.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.879+0000 7f76daa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76c00041c0 0x7f76dc1559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:07.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.879+0000 7f76daa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76c00041c0 0x7f76dc1559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46444/0 (socket says 172.21.15.42:46444) 2024-09-17T01:49:07.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.879+0000 7f76daa00640 1 -- 172.21.15.42:0/1728402889 learned_addr learned my addr 172.21.15.42:0/1728402889 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:07.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.879+0000 7f76db400640 1 --2- 172.21.15.42:0/1728402889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76dc1f5880 0x7f76dc159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:07.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.879+0000 7f76d3e00640 1 --2- 172.21.15.42:0/1728402889 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76dc0c5490 0x7f76dc0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:07.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.880+0000 7f76daa00640 1 -- 172.21.15.42:0/1728402889 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76dc0c5490 msgr2=0x7f76dc0b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:07.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.880+0000 7f76daa00640 1 --2- 172.21.15.42:0/1728402889 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76dc0c5490 0x7f76dc0b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.880+0000 7f76daa00640 1 -- 172.21.15.42:0/1728402889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76dc1f5880 msgr2=0x7f76dc159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:07.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.880+0000 7f76daa00640 1 --2- 172.21.15.42:0/1728402889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76dc1f5880 0x7f76dc159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.880+0000 7f76daa00640 1 -- 172.21.15.42:0/1728402889 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76dc0b2100 con 0x7f76c00041c0 2024-09-17T01:49:07.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.880+0000 7f76db400640 1 --2- 172.21.15.42:0/1728402889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76dc1f5880 0x7f76dc159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:49:07.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.880+0000 7f76d3e00640 1 --2- 172.21.15.42:0/1728402889 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76dc0c5490 0x7f76dc0b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:49:07.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.880+0000 7f76daa00640 1 --2- 172.21.15.42:0/1728402889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76c00041c0 0x7f76dc1559d0 secure :-1 s=READY pgs=2494 cs=0 l=1 rev1=1 crypto rx=0x7f76cc003e40 tx=0x7f76cc001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:07.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.880+0000 7f76d2a00640 1 -- 172.21.15.42:0/1728402889 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc011700 con 0x7f76c00041c0 2024-09-17T01:49:07.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.880+0000 7f76d2a00640 1 -- 172.21.15.42:0/1728402889 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76cc016020 con 0x7f76c00041c0 2024-09-17T01:49:07.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.880+0000 7f76d2a00640 1 -- 172.21.15.42:0/1728402889 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc011b40 con 0x7f76c00041c0 2024-09-17T01:49:07.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.880+0000 7f76dbe00640 1 -- 172.21.15.42:0/1728402889 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76dc1f5e70 con 0x7f76c00041c0 2024-09-17T01:49:07.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.880+0000 7f76dbe00640 1 -- 172.21.15.42:0/1728402889 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76dc1f6430 con 0x7f76c00041c0 2024-09-17T01:49:07.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.881+0000 7f76dbe00640 1 -- 172.21.15.42:0/1728402889 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76dc0cf8e0 con 0x7f76c00041c0 2024-09-17T01:49:07.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.883+0000 7f76d2a00640 1 -- 172.21.15.42:0/1728402889 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f76cc011ce0 con 0x7f76c00041c0 2024-09-17T01:49:07.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.884+0000 7f76d2a00640 1 --2- 172.21.15.42:0/1728402889 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f76b8078b90 0x7f76b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:07.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.884+0000 7f76d2a00640 1 -- 172.21.15.42:0/1728402889 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 4943+0+0 (secure 0 0 0) 0x7f76cc09b820 con 0x7f76c00041c0 2024-09-17T01:49:07.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.884+0000 7f76d3e00640 1 --2- 172.21.15.42:0/1728402889 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f76b8078b90 0x7f76b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:07.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.885+0000 7f76d3e00640 1 --2- 172.21.15.42:0/1728402889 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f76b8078b90 0x7f76b807b0a0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f76c4035000 tx=0x7f76c40046c0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:07.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:07.888+0000 7f76d2a00640 1 -- 172.21.15.42:0/1728402889 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f76cc020020 con 0x7f76c00041c0 2024-09-17T01:49:08.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.083+0000 7f76dbe00640 1 -- 172.21.15.42:0/1728402889 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76dc0b2330 con 0x7f76c00041c0 2024-09-17T01:49:08.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.084+0000 7f76d2a00640 1 -- 172.21.15.42:0/1728402889 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v218) ==== 74+0+12992 (secure 0 0 0) 0x7f76cc063ec0 con 0x7f76c00041c0 2024-09-17T01:49:08.082 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:08.082 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":218,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:49:05.599418+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":31,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":214,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6836/777529944":"2024-09-18T01:49:02.589098+0000","172.21.15.43:6835/777529944":"2024-09-18T01:49:02.589098+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:49:08.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.087+0000 7f76dbe00640 1 -- 172.21.15.42:0/1728402889 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f76b8078b90 msgr2=0x7f76b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:08.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.087+0000 7f76dbe00640 1 --2- 172.21.15.42:0/1728402889 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f76b8078b90 0x7f76b807b0a0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f76c4035000 tx=0x7f76c40046c0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.087+0000 7f76dbe00640 1 -- 172.21.15.42:0/1728402889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76c00041c0 msgr2=0x7f76dc1559d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:08.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.087+0000 7f76dbe00640 1 --2- 172.21.15.42:0/1728402889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76c00041c0 0x7f76dc1559d0 secure :-1 s=READY pgs=2494 cs=0 l=1 rev1=1 crypto rx=0x7f76cc003e40 tx=0x7f76cc001800 comp rx=0 tx=0).stop 2024-09-17T01:49:08.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.087+0000 7f76dbe00640 1 -- 172.21.15.42:0/1728402889 shutdown_connections 2024-09-17T01:49:08.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.087+0000 7f76dbe00640 1 --2- 172.21.15.42:0/1728402889 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f76b8078b90 0x7f76b807b0a0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.087+0000 7f76dbe00640 1 --2- 172.21.15.42:0/1728402889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76dc1f5880 0x7f76dc159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.087+0000 7f76dbe00640 1 --2- 172.21.15.42:0/1728402889 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f76dc0c5490 0x7f76dc0b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.087+0000 7f76dbe00640 1 --2- 172.21.15.42:0/1728402889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76c00041c0 0x7f76dc1559d0 unknown :-1 s=CLOSED pgs=2494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.087+0000 7f76dbe00640 1 -- 172.21.15.42:0/1728402889 >> 172.21.15.42:0/1728402889 conn(0x7f76dc06d3f0 msgr2=0x7f76dc075cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:08.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.087+0000 7f76dbe00640 1 -- 172.21.15.42:0/1728402889 shutdown_connections 2024-09-17T01:49:08.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.087+0000 7f76dbe00640 1 -- 172.21.15.42:0/1728402889 wait complete. 2024-09-17T01:49:08.107 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T01:31:55.004951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T01:49:08.108 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T01:49:08.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.341+0000 7f9b0b200640 1 -- 172.21.15.42:0/543575119 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b0c0728e0 msgr2=0x7f9b0c0afb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:08.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.341+0000 7f9b0b200640 1 --2- 172.21.15.42:0/543575119 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b0c0728e0 0x7f9b0c0afb10 secure :-1 s=READY pgs=2495 cs=0 l=1 rev1=1 crypto rx=0x7f9afc005fd0 tx=0x7f9afc02a530 comp rx=0 tx=0).stop 2024-09-17T01:49:08.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.341+0000 7f9b0b200640 1 -- 172.21.15.42:0/543575119 shutdown_connections 2024-09-17T01:49:08.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.341+0000 7f9b0b200640 1 --2- 172.21.15.42:0/543575119 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9b0c0cd9f0 0x7f9b0c15d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.341+0000 7f9b0b200640 1 --2- 172.21.15.42:0/543575119 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b0c0728e0 0x7f9b0c0afb10 unknown :-1 s=CLOSED pgs=2495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.341+0000 7f9b0b200640 1 -- 172.21.15.42:0/543575119 >> 172.21.15.42:0/543575119 conn(0x7f9b0c06cfa0 msgr2=0x7f9b0c06d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:08.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.341+0000 7f9b0b200640 1 -- 172.21.15.42:0/543575119 shutdown_connections 2024-09-17T01:49:08.342 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.341+0000 7f9b0b200640 1 -- 172.21.15.42:0/543575119 wait complete. 2024-09-17T01:49:08.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.343+0000 7f9b0b200640 1 Processor -- start 2024-09-17T01:49:08.343 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.344+0000 7f9b0b200640 1 -- start start 2024-09-17T01:49:08.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.345+0000 7f9b0b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b0c0728e0 0x7f9b0c1f4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:08.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.345+0000 7f9b0b200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9b0c0b34b0 0x7f9b0c15b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:08.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.345+0000 7f9b0b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b0c145de0 0x7f9b0c1e7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:08.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.345+0000 7f9b0b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c15d660 con 0x7f9b0c0728e0 2024-09-17T01:49:08.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.345+0000 7f9b0b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c0b3b10 con 0x7f9b0c145de0 2024-09-17T01:49:08.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.345+0000 7f9b0b200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f9b0c15d7e0 con 0x7f9b0c0b34b0 2024-09-17T01:49:08.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.345+0000 7f9b09e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b0c0728e0 0x7f9b0c1f4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:08.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.345+0000 7f9b09e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b0c0728e0 0x7f9b0c1f4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46458/0 (socket says 172.21.15.42:46458) 2024-09-17T01:49:08.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.345+0000 7f9b09e00640 1 -- 172.21.15.42:0/2465201197 learned_addr learned my addr 172.21.15.42:0/2465201197 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:08.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.345+0000 7f9b0a800640 1 --2- 172.21.15.42:0/2465201197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b0c145de0 0x7f9b0c1e7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:08.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.345+0000 7f9b01400640 1 --2- 172.21.15.42:0/2465201197 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9b0c0b34b0 0x7f9b0c15b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:08.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.346+0000 7f9b09e00640 1 -- 172.21.15.42:0/2465201197 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9b0c0b34b0 msgr2=0x7f9b0c15b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:08.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.346+0000 7f9b09e00640 1 --2- 172.21.15.42:0/2465201197 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9b0c0b34b0 0x7f9b0c15b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.346+0000 7f9b09e00640 1 -- 172.21.15.42:0/2465201197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b0c145de0 msgr2=0x7f9b0c1e7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:08.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.346+0000 7f9b09e00640 1 --2- 172.21.15.42:0/2465201197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b0c145de0 0x7f9b0c1e7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.346+0000 7f9b09e00640 1 -- 172.21.15.42:0/2465201197 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0c1f4b20 con 0x7f9b0c0728e0 2024-09-17T01:49:08.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.346+0000 7f9b0a800640 1 --2- 172.21.15.42:0/2465201197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b0c145de0 0x7f9b0c1e7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:49:08.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.346+0000 7f9b01400640 1 --2- 172.21.15.42:0/2465201197 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9b0c0b34b0 0x7f9b0c15b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:49:08.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.346+0000 7f9b09e00640 1 --2- 172.21.15.42:0/2465201197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b0c0728e0 0x7f9b0c1f4260 secure :-1 s=READY pgs=2496 cs=0 l=1 rev1=1 crypto rx=0x7f9afc006010 tx=0x7f9afc0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:08.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.346+0000 7f9b02a00640 1 -- 172.21.15.42:0/2465201197 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc03e030 con 0x7f9b0c0728e0 2024-09-17T01:49:08.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.346+0000 7f9b02a00640 1 -- 172.21.15.42:0/2465201197 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9afc003d90 con 0x7f9b0c0728e0 2024-09-17T01:49:08.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.346+0000 7f9b02a00640 1 -- 172.21.15.42:0/2465201197 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc035040 con 0x7f9b0c0728e0 2024-09-17T01:49:08.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.346+0000 7f9b0b200640 1 -- 172.21.15.42:0/2465201197 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b0c1f4e00 con 0x7f9b0c0728e0 2024-09-17T01:49:08.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.347+0000 7f9b0b200640 1 -- 172.21.15.42:0/2465201197 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b0c1f53c0 con 0x7f9b0c0728e0 2024-09-17T01:49:08.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.348+0000 7f9b0b200640 1 -- 172.21.15.42:0/2465201197 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b0c15dc80 con 0x7f9b0c0728e0 2024-09-17T01:49:08.347 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.349+0000 7f9b02a00640 1 -- 172.21.15.42:0/2465201197 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9afc041030 con 0x7f9b0c0728e0 2024-09-17T01:49:08.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.350+0000 7f9b02a00640 1 --2- 172.21.15.42:0/2465201197 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9ae8078bc0 0x7f9ae807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:08.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.350+0000 7f9b02a00640 1 -- 172.21.15.42:0/2465201197 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 4943+0+0 (secure 0 0 0) 0x7f9afc0bb210 con 0x7f9b0c0728e0 2024-09-17T01:49:08.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.351+0000 7f9b01400640 1 --2- 172.21.15.42:0/2465201197 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9ae8078bc0 0x7f9ae807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:08.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.352+0000 7f9b01400640 1 --2- 172.21.15.42:0/2465201197 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9ae8078bc0 0x7f9ae807b0d0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f9af4006fd0 tx=0x7f9af4008040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:08.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.355+0000 7f9b02a00640 1 -- 172.21.15.42:0/2465201197 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9b0c072cf0 con 0x7f9b0c0728e0 2024-09-17T01:49:08.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.548+0000 7f9b0b200640 1 -- 172.21.15.42:0/2465201197 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9b0c15d440 con 0x7f9b0c0728e0 2024-09-17T01:49:08.550 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.549+0000 7f9b02a00640 1 -- 172.21.15.42:0/2465201197 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v218) ==== 93+0+10 (secure 0 0 0) 0x7f9afc083940 con 0x7f9b0c0728e0 2024-09-17T01:49:08.550 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-09-17T01:49:08.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.551+0000 7f9b0b200640 1 -- 172.21.15.42:0/2465201197 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9ae8078bc0 msgr2=0x7f9ae807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:08.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.551+0000 7f9b0b200640 1 --2- 172.21.15.42:0/2465201197 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9ae8078bc0 0x7f9ae807b0d0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f9af4006fd0 tx=0x7f9af4008040 comp rx=0 tx=0).stop 2024-09-17T01:49:08.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.551+0000 7f9b0b200640 1 -- 172.21.15.42:0/2465201197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b0c0728e0 msgr2=0x7f9b0c1f4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:08.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.551+0000 7f9b0b200640 1 --2- 172.21.15.42:0/2465201197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b0c0728e0 0x7f9b0c1f4260 secure :-1 s=READY pgs=2496 cs=0 l=1 rev1=1 crypto rx=0x7f9afc006010 tx=0x7f9afc0038a0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.551+0000 7f9b0b200640 1 -- 172.21.15.42:0/2465201197 shutdown_connections 2024-09-17T01:49:08.551 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.551+0000 7f9b0b200640 1 --2- 172.21.15.42:0/2465201197 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f9ae8078bc0 0x7f9ae807b0d0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.551+0000 7f9b0b200640 1 --2- 172.21.15.42:0/2465201197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b0c145de0 0x7f9b0c1e7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.551+0000 7f9b0b200640 1 --2- 172.21.15.42:0/2465201197 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f9b0c0b34b0 0x7f9b0c15b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.551+0000 7f9b0b200640 1 --2- 172.21.15.42:0/2465201197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b0c0728e0 0x7f9b0c1f4260 unknown :-1 s=CLOSED pgs=2496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.551+0000 7f9b0b200640 1 -- 172.21.15.42:0/2465201197 >> 172.21.15.42:0/2465201197 conn(0x7f9b0c06cfa0 msgr2=0x7f9b0c0ce300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:08.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.551+0000 7f9b0b200640 1 -- 172.21.15.42:0/2465201197 shutdown_connections 2024-09-17T01:49:08.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.551+0000 7f9b0b200640 1 -- 172.21.15.42:0/2465201197 wait complete. 2024-09-17T01:49:08.571 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode' 2024-09-17T01:49:08.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.800+0000 7fdb2ba00640 1 -- 172.21.15.42:0/3073179651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb2415dcf0 msgr2=0x7fdb24072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:08.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.800+0000 7fdb2ba00640 1 --2- 172.21.15.42:0/3073179651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb2415dcf0 0x7fdb24072b60 secure :-1 s=READY pgs=2497 cs=0 l=1 rev1=1 crypto rx=0x7fdb2415e2e0 tx=0x7fdb1802a4b0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.800+0000 7fdb2ba00640 1 -- 172.21.15.42:0/3073179651 shutdown_connections 2024-09-17T01:49:08.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.800+0000 7fdb2ba00640 1 --2- 172.21.15.42:0/3073179651 >> v2:172.21.15.43:3300/0 conn(0x7fdb240cdd30 0x7fdb24160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.800+0000 7fdb2ba00640 1 --2- 172.21.15.42:0/3073179651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb2415dcf0 0x7fdb24072b60 unknown :-1 s=CLOSED pgs=2497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.800+0000 7fdb2ba00640 1 -- 172.21.15.42:0/3073179651 >> 172.21.15.42:0/3073179651 conn(0x7fdb2406d1b0 msgr2=0x7fdb2406d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:08.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.800+0000 7fdb2ba00640 1 -- 172.21.15.42:0/3073179651 shutdown_connections 2024-09-17T01:49:08.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.800+0000 7fdb2ba00640 1 -- 172.21.15.42:0/3073179651 wait complete. 2024-09-17T01:49:08.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.802+0000 7fdb2ba00640 1 Processor -- start 2024-09-17T01:49:08.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.803+0000 7fdb2ba00640 1 -- start start 2024-09-17T01:49:08.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.804+0000 7fdb2ba00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdb2415dcf0 0x7fdb240ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:08.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.804+0000 7fdb2ba00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb24160790 0x7fdb2413f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:08.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.804+0000 7fdb2ba00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb24143fd0 0x7fdb2413fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:08.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.804+0000 7fdb2ba00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2406ee00 con 0x7fdb24160790 2024-09-17T01:49:08.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.804+0000 7fdb2ba00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2406ec80 con 0x7fdb24143fd0 2024-09-17T01:49:08.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.804+0000 7fdb2ba00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fdb2406ef80 con 0x7fdb2415dcf0 2024-09-17T01:49:08.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.804+0000 7fdb23e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb24160790 0x7fdb2413f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:08.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.804+0000 7fdb23e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb24160790 0x7fdb2413f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46474/0 (socket says 172.21.15.42:46474) 2024-09-17T01:49:08.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.804+0000 7fdb23e00640 1 -- 172.21.15.42:0/1672031332 learned_addr learned my addr 172.21.15.42:0/1672031332 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:08.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.805+0000 7fdb29000640 1 --2- 172.21.15.42:0/1672031332 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdb2415dcf0 0x7fdb240ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:08.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.805+0000 7fdb29a00640 1 --2- 172.21.15.42:0/1672031332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb24143fd0 0x7fdb2413fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:08.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.805+0000 7fdb23e00640 1 -- 172.21.15.42:0/1672031332 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdb2415dcf0 msgr2=0x7fdb240ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:08.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.805+0000 7fdb23e00640 1 --2- 172.21.15.42:0/1672031332 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdb2415dcf0 0x7fdb240ae230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.805+0000 7fdb23e00640 1 -- 172.21.15.42:0/1672031332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb24143fd0 msgr2=0x7fdb2413fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:08.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.805+0000 7fdb23e00640 1 --2- 172.21.15.42:0/1672031332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb24143fd0 0x7fdb2413fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.805+0000 7fdb23e00640 1 -- 172.21.15.42:0/1672031332 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb240ab790 con 0x7fdb24160790 2024-09-17T01:49:08.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.805+0000 7fdb23e00640 1 --2- 172.21.15.42:0/1672031332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb24160790 0x7fdb2413f670 secure :-1 s=READY pgs=2498 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000b3f0 tx=0x7fdb1000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:08.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.805+0000 7fdb20c00640 1 -- 172.21.15.42:0/1672031332 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb10015020 con 0x7fdb24160790 2024-09-17T01:49:08.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.805+0000 7fdb20c00640 1 -- 172.21.15.42:0/1672031332 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb10011920 con 0x7fdb24160790 2024-09-17T01:49:08.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.805+0000 7fdb2ba00640 1 -- 172.21.15.42:0/1672031332 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb240aba70 con 0x7fdb24160790 2024-09-17T01:49:08.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.805+0000 7fdb20c00640 1 -- 172.21.15.42:0/1672031332 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb10011d70 con 0x7fdb24160790 2024-09-17T01:49:08.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.806+0000 7fdb2ba00640 1 -- 172.21.15.42:0/1672031332 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb240ac030 con 0x7fdb24160790 2024-09-17T01:49:08.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.806+0000 7fdb2ba00640 1 -- 172.21.15.42:0/1672031332 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb2406f460 con 0x7fdb24160790 2024-09-17T01:49:08.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.808+0000 7fdb20c00640 1 -- 172.21.15.42:0/1672031332 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdb10018020 con 0x7fdb24160790 2024-09-17T01:49:08.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.809+0000 7fdb20c00640 1 --2- 172.21.15.42:0/1672031332 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdb04078bc0 0x7fdb0407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:08.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.809+0000 7fdb20c00640 1 -- 172.21.15.42:0/1672031332 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 4943+0+0 (secure 0 0 0) 0x7fdb1009a730 con 0x7fdb24160790 2024-09-17T01:49:08.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.809+0000 7fdb29000640 1 --2- 172.21.15.42:0/1672031332 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdb04078bc0 0x7fdb0407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:08.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.810+0000 7fdb29000640 1 --2- 172.21.15.42:0/1672031332 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdb04078bc0 0x7fdb0407b0d0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fdb18033000 tx=0x7fdb18004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:08.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:08.814+0000 7fdb20c00640 1 -- 172.21.15.42:0/1672031332 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdb1001f030 con 0x7fdb24160790 2024-09-17T01:49:09.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.079+0000 7fdb2ba00640 1 -- 172.21.15.42:0/1672031332 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]} v 0) -- 0x7fdb240af880 con 0x7fdb24160790 2024-09-17T01:49:09.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.620+0000 7fdb20c00640 1 -- 172.21.15.42:0/1672031332 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]}]=0 v807) ==== 136+0+0 (secure 0 0 0) 0x7fdb10062e60 con 0x7fdb24160790 2024-09-17T01:49:09.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.623+0000 7fdb2ba00640 1 -- 172.21.15.42:0/1672031332 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdb04078bc0 msgr2=0x7fdb0407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:09.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.623+0000 7fdb2ba00640 1 --2- 172.21.15.42:0/1672031332 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdb04078bc0 0x7fdb0407b0d0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fdb18033000 tx=0x7fdb18004730 comp rx=0 tx=0).stop 2024-09-17T01:49:09.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.623+0000 7fdb2ba00640 1 -- 172.21.15.42:0/1672031332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb24160790 msgr2=0x7fdb2413f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:09.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.623+0000 7fdb2ba00640 1 --2- 172.21.15.42:0/1672031332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb24160790 0x7fdb2413f670 secure :-1 s=READY pgs=2498 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000b3f0 tx=0x7fdb1000b8b0 comp rx=0 tx=0).stop 2024-09-17T01:49:09.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.623+0000 7fdb2ba00640 1 -- 172.21.15.42:0/1672031332 shutdown_connections 2024-09-17T01:49:09.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.623+0000 7fdb2ba00640 1 --2- 172.21.15.42:0/1672031332 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fdb04078bc0 0x7fdb0407b0d0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:09.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.623+0000 7fdb2ba00640 1 --2- 172.21.15.42:0/1672031332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb24143fd0 0x7fdb2413fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:09.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.623+0000 7fdb2ba00640 1 --2- 172.21.15.42:0/1672031332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdb24160790 0x7fdb2413f670 unknown :-1 s=CLOSED pgs=2498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:09.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.623+0000 7fdb2ba00640 1 --2- 172.21.15.42:0/1672031332 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fdb2415dcf0 0x7fdb240ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:09.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.623+0000 7fdb2ba00640 1 -- 172.21.15.42:0/1672031332 >> 172.21.15.42:0/1672031332 conn(0x7fdb2406d1b0 msgr2=0x7fdb24146070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:09.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.623+0000 7fdb2ba00640 1 -- 172.21.15.42:0/1672031332 shutdown_connections 2024-09-17T01:49:09.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.623+0000 7fdb2ba00640 1 -- 172.21.15.42:0/1672031332 wait complete. 2024-09-17T01:49:09.648 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T01:49:09.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.880+0000 7fbb6cc00640 1 -- 172.21.15.42:0/2303940540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb4c003a50 msgr2=0x7fbb4c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:09.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.880+0000 7fbb6cc00640 1 --2- 172.21.15.42:0/2303940540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb4c003a50 0x7fbb4c003ec0 secure :-1 s=READY pgs=2500 cs=0 l=1 rev1=1 crypto rx=0x7fbb580016c0 tx=0x7fbb4c005830 comp rx=0 tx=0).stop 2024-09-17T01:49:09.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.880+0000 7fbb6cc00640 1 -- 172.21.15.42:0/2303940540 shutdown_connections 2024-09-17T01:49:09.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.880+0000 7fbb6cc00640 1 --2- 172.21.15.42:0/2303940540 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb4c003a50 0x7fbb4c003ec0 unknown :-1 s=CLOSED pgs=2500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:09.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.880+0000 7fbb6cc00640 1 -- 172.21.15.42:0/2303940540 >> 172.21.15.42:0/2303940540 conn(0x7fbb68073de0 msgr2=0x7fbb6806cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:09.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.880+0000 7fbb6cc00640 1 -- 172.21.15.42:0/2303940540 shutdown_connections 2024-09-17T01:49:09.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.880+0000 7fbb6cc00640 1 -- 172.21.15.42:0/2303940540 wait complete. 2024-09-17T01:49:09.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.882+0000 7fbb6cc00640 1 Processor -- start 2024-09-17T01:49:09.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.883+0000 7fbb6cc00640 1 -- start start 2024-09-17T01:49:09.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.884+0000 7fbb6cc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbb4c003a50 0x7fbb681f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:09.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.884+0000 7fbb6cc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb680b68e0 0x7fbb6815dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:09.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.884+0000 7fbb6cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb6815e530 0x7fbb681f8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:09.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.884+0000 7fbb6cc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbb680d2c40 con 0x7fbb6815e530 2024-09-17T01:49:09.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.884+0000 7fbb6cc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbb680d0050 con 0x7fbb680b68e0 2024-09-17T01:49:09.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.884+0000 7fbb6cc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbb680d2dc0 con 0x7fbb4c003a50 2024-09-17T01:49:09.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.884+0000 7fbb67e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb6815e530 0x7fbb681f8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:09.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.884+0000 7fbb67e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb6815e530 0x7fbb681f8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46486/0 (socket says 172.21.15.42:46486) 2024-09-17T01:49:09.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.884+0000 7fbb67e00640 1 -- 172.21.15.42:0/1526472197 learned_addr learned my addr 172.21.15.42:0/1526472197 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:09.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.884+0000 7fbb67400640 1 --2- 172.21.15.42:0/1526472197 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbb4c003a50 0x7fbb681f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:09.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.884+0000 7fbb5fe00640 1 --2- 172.21.15.42:0/1526472197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb680b68e0 0x7fbb6815dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:09.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.885+0000 7fbb67e00640 1 -- 172.21.15.42:0/1526472197 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbb4c003a50 msgr2=0x7fbb681f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:09.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.885+0000 7fbb67e00640 1 --2- 172.21.15.42:0/1526472197 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbb4c003a50 0x7fbb681f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:09.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.885+0000 7fbb67e00640 1 -- 172.21.15.42:0/1526472197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb680b68e0 msgr2=0x7fbb6815dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:09.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.885+0000 7fbb67e00640 1 --2- 172.21.15.42:0/1526472197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb680b68e0 0x7fbb6815dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:09.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.885+0000 7fbb67e00640 1 -- 172.21.15.42:0/1526472197 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb681f6810 con 0x7fbb6815e530 2024-09-17T01:49:09.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.885+0000 7fbb5fe00640 1 --2- 172.21.15.42:0/1526472197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb680b68e0 0x7fbb6815dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:49:09.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.885+0000 7fbb67e00640 1 --2- 172.21.15.42:0/1526472197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb6815e530 0x7fbb681f8e40 secure :-1 s=READY pgs=2501 cs=0 l=1 rev1=1 crypto rx=0x7fbb60000f80 tx=0x7fbb6000eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:09.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.885+0000 7fbb5f400640 1 -- 172.21.15.42:0/1526472197 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb60010890 con 0x7fbb6815e530 2024-09-17T01:49:09.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.885+0000 7fbb5f400640 1 -- 172.21.15.42:0/1526472197 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb60017070 con 0x7fbb6815e530 2024-09-17T01:49:09.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.885+0000 7fbb6cc00640 1 -- 172.21.15.42:0/1526472197 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb6815e940 con 0x7fbb6815e530 2024-09-17T01:49:09.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.885+0000 7fbb5f400640 1 -- 172.21.15.42:0/1526472197 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb60010da0 con 0x7fbb6815e530 2024-09-17T01:49:09.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.886+0000 7fbb6cc00640 1 -- 172.21.15.42:0/1526472197 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb680c9bb0 con 0x7fbb6815e530 2024-09-17T01:49:09.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.887+0000 7fbb6cc00640 1 -- 172.21.15.42:0/1526472197 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb680c9640 con 0x7fbb6815e530 2024-09-17T01:49:09.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.888+0000 7fbb5f400640 1 -- 172.21.15.42:0/1526472197 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbb6001c460 con 0x7fbb6815e530 2024-09-17T01:49:09.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.889+0000 7fbb5f400640 1 --2- 172.21.15.42:0/1526472197 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbb44078b90 0x7fbb4407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:09.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.889+0000 7fbb5f400640 1 -- 172.21.15.42:0/1526472197 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 4943+0+0 (secure 0 0 0) 0x7fbb6009ae40 con 0x7fbb6815e530 2024-09-17T01:49:09.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.890+0000 7fbb67400640 1 --2- 172.21.15.42:0/1526472197 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbb44078b90 0x7fbb4407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:09.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.890+0000 7fbb67400640 1 --2- 172.21.15.42:0/1526472197 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbb44078b90 0x7fbb4407b0a0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fbb58032000 tx=0x7fbb5802c040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:09.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:09.894+0000 7fbb5f400640 1 -- 172.21.15.42:0/1526472197 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbb6815e940 con 0x7fbb6815e530 2024-09-17T01:49:10.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.087+0000 7fbb6cc00640 1 -- 172.21.15.42:0/1526472197 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fbb6815f020 con 0x7fbb6815e530 2024-09-17T01:49:10.085 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.087+0000 7fbb5f400640 1 -- 172.21.15.42:0/1526472197 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v67) ==== 59+0+2294 (secure 0 0 0) 0x7fbb681f6810 con 0x7fbb6815e530 2024-09-17T01:49:10.085 INFO:teuthology.orchestra.run.smithi042.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T01:49:10.086 INFO:teuthology.orchestra.run.smithi042.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T01:49:10.086 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced client_mount_timeout 30 2024-09-17T01:49:10.086 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_client 20/20 2024-09-17T01:49:10.086 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_mgr 20/20 2024-09-17T01:49:10.086 INFO:teuthology.orchestra.run.smithi042.stdout:mgr advanced debug_ms 1/1 2024-09-17T01:49:10.086 INFO:teuthology.orchestra.run.smithi042.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T01:49:10.086 INFO:teuthology.orchestra.run.smithi042.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T01:49:10.086 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3683.959260 2024-09-17T01:49:10.086 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4350.010833 2024-09-17T01:49:10.086 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4316.776055 2024-09-17T01:49:10.086 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3885.595082 2024-09-17T01:49:10.086 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3602.000737 2024-09-17T01:49:10.087 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4883.364748 2024-09-17T01:49:10.087 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3752.484811 2024-09-17T01:49:10.087 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3775.035963 2024-09-17T01:49:10.087 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds 20/20 2024-09-17T01:49:10.087 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T01:49:10.087 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced debug_ms 2/2 2024-09-17T01:49:10.087 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_frag true 2024-09-17T01:49:10.087 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_debug_scatterstat true 2024-09-17T01:49:10.087 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T01:49:10.087 INFO:teuthology.orchestra.run.smithi042.stdout:mds dev mds_verify_scatter true 2024-09-17T01:49:10.087 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T01:49:10.087 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T01:49:10.087 INFO:teuthology.orchestra.run.smithi042.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T01:49:10.087 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced client_mount_timeout 600 2024-09-17T01:49:10.088 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_client 20/20 2024-09-17T01:49:10.088 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced debug_ms 1/1 2024-09-17T01:49:10.088 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T01:49:10.088 INFO:teuthology.orchestra.run.smithi042.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T01:49:10.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.090+0000 7fbb6cc00640 1 -- 172.21.15.42:0/1526472197 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbb44078b90 msgr2=0x7fbb4407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:10.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.090+0000 7fbb6cc00640 1 --2- 172.21.15.42:0/1526472197 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbb44078b90 0x7fbb4407b0a0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fbb58032000 tx=0x7fbb5802c040 comp rx=0 tx=0).stop 2024-09-17T01:49:10.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.090+0000 7fbb6cc00640 1 -- 172.21.15.42:0/1526472197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb6815e530 msgr2=0x7fbb681f8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:10.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.090+0000 7fbb6cc00640 1 --2- 172.21.15.42:0/1526472197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb6815e530 0x7fbb681f8e40 secure :-1 s=READY pgs=2501 cs=0 l=1 rev1=1 crypto rx=0x7fbb60000f80 tx=0x7fbb6000eb00 comp rx=0 tx=0).stop 2024-09-17T01:49:10.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.090+0000 7fbb6cc00640 1 -- 172.21.15.42:0/1526472197 shutdown_connections 2024-09-17T01:49:10.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.090+0000 7fbb6cc00640 1 --2- 172.21.15.42:0/1526472197 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbb44078b90 0x7fbb4407b0a0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:10.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.090+0000 7fbb6cc00640 1 --2- 172.21.15.42:0/1526472197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb680b68e0 0x7fbb6815dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:10.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.090+0000 7fbb6cc00640 1 --2- 172.21.15.42:0/1526472197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb6815e530 0x7fbb681f8e40 unknown :-1 s=CLOSED pgs=2501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:10.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.090+0000 7fbb6cc00640 1 --2- 172.21.15.42:0/1526472197 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbb4c003a50 0x7fbb681f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:10.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.090+0000 7fbb6cc00640 1 -- 172.21.15.42:0/1526472197 >> 172.21.15.42:0/1526472197 conn(0x7fbb68073de0 msgr2=0x7fbb6806cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:10.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.090+0000 7fbb6cc00640 1 -- 172.21.15.42:0/1526472197 shutdown_connections 2024-09-17T01:49:10.090 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.090+0000 7fbb6cc00640 1 -- 172.21.15.42:0/1526472197 wait complete. 2024-09-17T01:49:10.114 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T01:49:10.344 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.346+0000 7fbedb200640 1 -- 172.21.15.42:0/3713391223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbed4155a90 msgr2=0x7fbed40af4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:10.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.346+0000 7fbedb200640 1 --2- 172.21.15.42:0/3713391223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbed4155a90 0x7fbed40af4e0 secure :-1 s=READY pgs=2503 cs=0 l=1 rev1=1 crypto rx=0x7fbec8005fd0 tx=0x7fbec802a5a0 comp rx=0 tx=0).stop 2024-09-17T01:49:10.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.346+0000 7fbedb200640 1 -- 172.21.15.42:0/3713391223 shutdown_connections 2024-09-17T01:49:10.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.346+0000 7fbedb200640 1 --2- 172.21.15.42:0/3713391223 >> v2:172.21.15.43:3300/0 conn(0x7fbed40aefa0 0x7fbed4072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:10.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.346+0000 7fbedb200640 1 --2- 172.21.15.42:0/3713391223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbed4155a90 0x7fbed40af4e0 unknown :-1 s=CLOSED pgs=2503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:10.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.346+0000 7fbedb200640 1 -- 172.21.15.42:0/3713391223 >> 172.21.15.42:0/3713391223 conn(0x7fbed406d3f0 msgr2=0x7fbed40b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:10.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.346+0000 7fbedb200640 1 -- 172.21.15.42:0/3713391223 shutdown_connections 2024-09-17T01:49:10.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.346+0000 7fbedb200640 1 -- 172.21.15.42:0/3713391223 wait complete. 2024-09-17T01:49:10.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.348+0000 7fbedb200640 1 Processor -- start 2024-09-17T01:49:10.346 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.349+0000 7fbedb200640 1 -- start start 2024-09-17T01:49:10.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.350+0000 7fbedb200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbed40afa20 0x7fbed4147730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:10.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.350+0000 7fbedb200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbed4155a90 0x7fbed415a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:10.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.350+0000 7fbedb200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbed41601f0 0x7fbed4162de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:10.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.350+0000 7fbedb200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbed40733c0 con 0x7fbed4155a90 2024-09-17T01:49:10.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.350+0000 7fbedb200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbed4073240 con 0x7fbed40afa20 2024-09-17T01:49:10.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.350+0000 7fbedb200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbed4073540 con 0x7fbed41601f0 2024-09-17T01:49:10.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.350+0000 7fbed9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbed4155a90 0x7fbed415a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:10.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.350+0000 7fbed9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbed4155a90 0x7fbed415a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46502/0 (socket says 172.21.15.42:46502) 2024-09-17T01:49:10.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.350+0000 7fbed9400640 1 -- 172.21.15.42:0/2532881673 learned_addr learned my addr 172.21.15.42:0/2532881673 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:10.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.351+0000 7fbed9e00640 1 --2- 172.21.15.42:0/2532881673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbed40afa20 0x7fbed4147730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:10.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.351+0000 7fbeda800640 1 --2- 172.21.15.42:0/2532881673 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbed41601f0 0x7fbed4162de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:10.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.351+0000 7fbed9400640 1 -- 172.21.15.42:0/2532881673 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbed41601f0 msgr2=0x7fbed4162de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:10.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.351+0000 7fbed9400640 1 --2- 172.21.15.42:0/2532881673 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbed41601f0 0x7fbed4162de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:10.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.351+0000 7fbed9400640 1 -- 172.21.15.42:0/2532881673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbed40afa20 msgr2=0x7fbed4147730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:10.350 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.351+0000 7fbed9400640 1 --2- 172.21.15.42:0/2532881673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbed40afa20 0x7fbed4147730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:10.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.351+0000 7fbed9400640 1 -- 172.21.15.42:0/2532881673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed4162020 con 0x7fbed4155a90 2024-09-17T01:49:10.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.351+0000 7fbed9400640 1 --2- 172.21.15.42:0/2532881673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbed4155a90 0x7fbed415a740 secure :-1 s=READY pgs=2504 cs=0 l=1 rev1=1 crypto rx=0x7fbec400c3a0 tx=0x7fbec400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:10.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.351+0000 7fbece000640 1 -- 172.21.15.42:0/2532881673 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4017070 con 0x7fbed4155a90 2024-09-17T01:49:10.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.351+0000 7fbece000640 1 -- 172.21.15.42:0/2532881673 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbec40053c0 con 0x7fbed4155a90 2024-09-17T01:49:10.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.351+0000 7fbece000640 1 -- 172.21.15.42:0/2532881673 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4003850 con 0x7fbed4155a90 2024-09-17T01:49:10.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.351+0000 7fbedb200640 1 -- 172.21.15.42:0/2532881673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed4162300 con 0x7fbed4155a90 2024-09-17T01:49:10.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.352+0000 7fbedb200640 1 -- 172.21.15.42:0/2532881673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed4161d30 con 0x7fbed4155a90 2024-09-17T01:49:10.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.353+0000 7fbedb200640 1 -- 172.21.15.42:0/2532881673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbed4073a90 con 0x7fbed4155a90 2024-09-17T01:49:10.352 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.354+0000 7fbece000640 1 -- 172.21.15.42:0/2532881673 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbec401a070 con 0x7fbed4155a90 2024-09-17T01:49:10.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.355+0000 7fbece000640 1 --2- 172.21.15.42:0/2532881673 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbeb8078b90 0x7fbeb807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:10.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.355+0000 7fbece000640 1 -- 172.21.15.42:0/2532881673 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 4943+0+0 (secure 0 0 0) 0x7fbec4099e60 con 0x7fbed4155a90 2024-09-17T01:49:10.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.355+0000 7fbed9e00640 1 --2- 172.21.15.42:0/2532881673 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbeb8078b90 0x7fbeb807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:10.353 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.356+0000 7fbed9e00640 1 --2- 172.21.15.42:0/2532881673 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbeb8078b90 0x7fbeb807b0a0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fbec8033000 tx=0x7fbec8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:10.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.359+0000 7fbece000640 1 -- 172.21.15.42:0/2532881673 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbec4062500 con 0x7fbed4155a90 2024-09-17T01:49:10.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.554+0000 7fbedb200640 1 -- 172.21.15.42:0/2532881673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fbed41606f0 con 0x7fbed4155a90 2024-09-17T01:49:10.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.558+0000 7fbece000640 1 -- 172.21.15.42:0/2532881673 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v68)=0 v68) ==== 122+0+0 (secure 0 0 0) 0x7fbec4061e00 con 0x7fbed4155a90 2024-09-17T01:49:10.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.561+0000 7fbedb200640 1 -- 172.21.15.42:0/2532881673 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbeb8078b90 msgr2=0x7fbeb807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:10.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.561+0000 7fbedb200640 1 --2- 172.21.15.42:0/2532881673 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbeb8078b90 0x7fbeb807b0a0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fbec8033000 tx=0x7fbec8004730 comp rx=0 tx=0).stop 2024-09-17T01:49:10.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.561+0000 7fbedb200640 1 -- 172.21.15.42:0/2532881673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbed4155a90 msgr2=0x7fbed415a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:10.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.561+0000 7fbedb200640 1 --2- 172.21.15.42:0/2532881673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbed4155a90 0x7fbed415a740 secure :-1 s=READY pgs=2504 cs=0 l=1 rev1=1 crypto rx=0x7fbec400c3a0 tx=0x7fbec400c860 comp rx=0 tx=0).stop 2024-09-17T01:49:10.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.561+0000 7fbedb200640 1 -- 172.21.15.42:0/2532881673 shutdown_connections 2024-09-17T01:49:10.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.561+0000 7fbedb200640 1 --2- 172.21.15.42:0/2532881673 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbeb8078b90 0x7fbeb807b0a0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:10.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.561+0000 7fbedb200640 1 --2- 172.21.15.42:0/2532881673 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbed41601f0 0x7fbed4162de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:10.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.561+0000 7fbedb200640 1 --2- 172.21.15.42:0/2532881673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbed4155a90 0x7fbed415a740 unknown :-1 s=CLOSED pgs=2504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:10.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.561+0000 7fbedb200640 1 --2- 172.21.15.42:0/2532881673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbed40afa20 0x7fbed4147730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:10.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.561+0000 7fbedb200640 1 -- 172.21.15.42:0/2532881673 >> 172.21.15.42:0/2532881673 conn(0x7fbed406d3f0 msgr2=0x7fbed40ce500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:10.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.561+0000 7fbedb200640 1 -- 172.21.15.42:0/2532881673 shutdown_connections 2024-09-17T01:49:10.559 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:10.561+0000 7fbedb200640 1 -- 172.21.15.42:0/2532881673 wait complete. 2024-09-17T01:49:10.585 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:49:10.585 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:49:10.672 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:49:10.766 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:49:10.766 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:49:10.766 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:49:10.802 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:49:10.802 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:49:10.803 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:49:10.840 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:49:10.841 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:49:10.841 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:49:10.877 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:49:10.878 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:49:10.878 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:49:10.917 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:49:10.917 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T01:49:10.917 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:49:11.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.148+0000 7fef01c00640 1 -- 172.21.15.42:0/1531025520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feefc0aedd0 msgr2=0x7feefc072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:11.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.148+0000 7fef01c00640 1 --2- 172.21.15.42:0/1531025520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feefc0aedd0 0x7feefc072af0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7feef4009830 tx=0x7feef402a510 comp rx=0 tx=0).stop 2024-09-17T01:49:11.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.148+0000 7fef01c00640 1 -- 172.21.15.42:0/1531025520 shutdown_connections 2024-09-17T01:49:11.146 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.148+0000 7fef01c00640 1 --2- 172.21.15.42:0/1531025520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feefc0aedd0 0x7feefc072af0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:11.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.148+0000 7fef01c00640 1 --2- 172.21.15.42:0/1531025520 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feefc155c60 0x7feefc0ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:11.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.148+0000 7fef01c00640 1 -- 172.21.15.42:0/1531025520 >> 172.21.15.42:0/1531025520 conn(0x7feefc06d3f0 msgr2=0x7feefc0b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:11.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.148+0000 7fef01c00640 1 -- 172.21.15.42:0/1531025520 shutdown_connections 2024-09-17T01:49:11.147 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.148+0000 7fef01c00640 1 -- 172.21.15.42:0/1531025520 wait complete. 2024-09-17T01:49:11.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.150+0000 7fef01c00640 1 Processor -- start 2024-09-17T01:49:11.148 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.150+0000 7fef01c00640 1 -- start start 2024-09-17T01:49:11.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.152+0000 7fef01c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feefc06f4b0 0x7feefc1f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:11.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.152+0000 7fef01c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feefc0aedd0 0x7feefc157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:11.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.152+0000 7fef01c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feefc155c60 0x7feefc1568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:11.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.152+0000 7fef01c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7feefc0733c0 con 0x7feefc0aedd0 2024-09-17T01:49:11.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.152+0000 7fef01c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7feefc073240 con 0x7feefc06f4b0 2024-09-17T01:49:11.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.152+0000 7fef01c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7feefc073540 con 0x7feefc155c60 2024-09-17T01:49:11.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.152+0000 7feef3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feefc0aedd0 0x7feefc157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:11.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.152+0000 7feef3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feefc0aedd0 0x7feefc157780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46516/0 (socket says 172.21.15.42:46516) 2024-09-17T01:49:11.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.152+0000 7feef3400640 1 -- 172.21.15.42:0/2183474925 learned_addr learned my addr 172.21.15.42:0/2183474925 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:11.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.152+0000 7feefbe00640 1 --2- 172.21.15.42:0/2183474925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feefc06f4b0 0x7feefc1f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:11.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.152+0000 7fef01200640 1 --2- 172.21.15.42:0/2183474925 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feefc155c60 0x7feefc1568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:11.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.153+0000 7feef3400640 1 -- 172.21.15.42:0/2183474925 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feefc155c60 msgr2=0x7feefc1568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:11.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.153+0000 7feef3400640 1 --2- 172.21.15.42:0/2183474925 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feefc155c60 0x7feefc1568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:11.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.153+0000 7feef3400640 1 -- 172.21.15.42:0/2183474925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feefc06f4b0 msgr2=0x7feefc1f8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:11.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.153+0000 7feef3400640 1 --2- 172.21.15.42:0/2183474925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feefc06f4b0 0x7feefc1f8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:11.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.153+0000 7feef3400640 1 -- 172.21.15.42:0/2183474925 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feefc156110 con 0x7feefc0aedd0 2024-09-17T01:49:11.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.153+0000 7fef01200640 1 --2- 172.21.15.42:0/2183474925 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feefc155c60 0x7feefc1568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:49:11.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.153+0000 7feef3400640 1 --2- 172.21.15.42:0/2183474925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feefc0aedd0 0x7feefc157780 secure :-1 s=READY pgs=2506 cs=0 l=1 rev1=1 crypto rx=0x7feee400eb30 tx=0x7feee400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:11.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.153+0000 7feef8c00640 1 -- 172.21.15.42:0/2183474925 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee4010430 con 0x7feefc0aedd0 2024-09-17T01:49:11.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.153+0000 7feef8c00640 1 -- 172.21.15.42:0/2183474925 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feee40106c0 con 0x7feefc0aedd0 2024-09-17T01:49:11.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.153+0000 7feef8c00640 1 -- 172.21.15.42:0/2183474925 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee4010b10 con 0x7feefc0aedd0 2024-09-17T01:49:11.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.153+0000 7fef01c00640 1 -- 172.21.15.42:0/2183474925 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feefc1f96d0 con 0x7feefc0aedd0 2024-09-17T01:49:11.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.153+0000 7fef01c00640 1 -- 172.21.15.42:0/2183474925 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feefc1f9c90 con 0x7feefc0aedd0 2024-09-17T01:49:11.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.154+0000 7fef01c00640 1 -- 172.21.15.42:0/2183474925 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feefc073a20 con 0x7feefc0aedd0 2024-09-17T01:49:11.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.156+0000 7feef8c00640 1 -- 172.21.15.42:0/2183474925 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feee4010cb0 con 0x7feefc0aedd0 2024-09-17T01:49:11.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.157+0000 7feef8c00640 1 --2- 172.21.15.42:0/2183474925 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feed8078b90 0x7feed807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:11.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.157+0000 7feef8c00640 1 -- 172.21.15.42:0/2183474925 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 4943+0+0 (secure 0 0 0) 0x7feee409b760 con 0x7feefc0aedd0 2024-09-17T01:49:11.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.157+0000 7feefbe00640 1 --2- 172.21.15.42:0/2183474925 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feed8078b90 0x7feed807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:11.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.158+0000 7feefbe00640 1 --2- 172.21.15.42:0/2183474925 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feed8078b90 0x7feed807b0a0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7feeec007d60 tx=0x7feeec007cf0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:11.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.161+0000 7feef8c00640 1 -- 172.21.15.42:0/2183474925 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feee4063850 con 0x7feefc0aedd0 2024-09-17T01:49:11.389 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.392+0000 7fef01c00640 1 -- 172.21.15.42:0/2183474925 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feefc15ecc0 con 0x7feefc0aedd0 2024-09-17T01:49:11.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.392+0000 7feef8c00640 1 -- 172.21.15.42:0/2183474925 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 170 v170) ==== 95+0+3916 (secure 0 0 0) 0x7feee4068280 con 0x7feefc0aedd0 2024-09-17T01:49:11.390 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:11.391 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":170,"btime":"2024-09-17T01:49:03:591899+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/584909928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":584909928},{"type":"v1","addr":"172.21.15.43:6836","nonce":584909928}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":170},{"gid":10348,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/2828763381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2828763381},{"type":"v1","addr":"172.21.15.42:6834","nonce":2828763381}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":162},{"gid":10357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2652584517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2652584517},{"type":"v1","addr":"172.21.15.43:6837","nonce":2652584517}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":163},{"gid":11190,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/3512646002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":3512646002},{"type":"v1","addr":"172.21.15.42:6835","nonce":3512646002}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":163}],"filesystems":[]} 2024-09-17T01:49:11.391 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 170 2024-09-17T01:49:11.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.395+0000 7fef01c00640 1 -- 172.21.15.42:0/2183474925 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feed8078b90 msgr2=0x7feed807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:11.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.395+0000 7fef01c00640 1 --2- 172.21.15.42:0/2183474925 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feed8078b90 0x7feed807b0a0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7feeec007d60 tx=0x7feeec007cf0 comp rx=0 tx=0).stop 2024-09-17T01:49:11.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.395+0000 7fef01c00640 1 -- 172.21.15.42:0/2183474925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feefc0aedd0 msgr2=0x7feefc157780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:11.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.395+0000 7fef01c00640 1 --2- 172.21.15.42:0/2183474925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feefc0aedd0 0x7feefc157780 secure :-1 s=READY pgs=2506 cs=0 l=1 rev1=1 crypto rx=0x7feee400eb30 tx=0x7feee400c2d0 comp rx=0 tx=0).stop 2024-09-17T01:49:11.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.395+0000 7fef01c00640 1 -- 172.21.15.42:0/2183474925 shutdown_connections 2024-09-17T01:49:11.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.395+0000 7fef01c00640 1 --2- 172.21.15.42:0/2183474925 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feed8078b90 0x7feed807b0a0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:11.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.395+0000 7fef01c00640 1 --2- 172.21.15.42:0/2183474925 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feefc155c60 0x7feefc1568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:11.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.395+0000 7fef01c00640 1 --2- 172.21.15.42:0/2183474925 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feefc0aedd0 0x7feefc157780 unknown :-1 s=CLOSED pgs=2506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:11.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.395+0000 7fef01c00640 1 --2- 172.21.15.42:0/2183474925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feefc06f4b0 0x7feefc1f8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:11.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.395+0000 7fef01c00640 1 -- 172.21.15.42:0/2183474925 >> 172.21.15.42:0/2183474925 conn(0x7feefc06d3f0 msgr2=0x7feefc0b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:11.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.395+0000 7fef01c00640 1 -- 172.21.15.42:0/2183474925 shutdown_connections 2024-09-17T01:49:11.394 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.395+0000 7fef01c00640 1 -- 172.21.15.42:0/2183474925 wait complete. 2024-09-17T01:49:11.415 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T01:49:11.415 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T01:49:11.415 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T01:49:11.416 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:49:11.416 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T01:49:11.416 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T01:49:11.416 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T01:49:11.416 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:49:11.416 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T01:49:11.417 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T01:49:11.417 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T01:49:11.417 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:49:11.417 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T01:49:11.417 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T01:49:11.417 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T01:49:11.418 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:49:11.439 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T01:49:11.439 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T01:49:11.443 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T01:49:11.443 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T01:49:11.445 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T01:49:11.445 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T01:49:11.445 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T01:49:11.446 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T01:49:11.488 INFO:tasks.ceph.mds.a:Started 2024-09-17T01:49:11.488 DEBUG:teuthology.parallel:result is None 2024-09-17T01:49:11.489 INFO:tasks.ceph.mds.b:Started 2024-09-17T01:49:11.489 DEBUG:teuthology.parallel:result is None 2024-09-17T01:49:11.490 INFO:tasks.ceph.mds.d:Started 2024-09-17T01:49:11.491 DEBUG:teuthology.parallel:result is None 2024-09-17T01:49:11.491 INFO:tasks.ceph.mds.c:Started 2024-09-17T01:49:11.491 DEBUG:teuthology.parallel:result is None 2024-09-17T01:49:11.491 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T01:49:11.688 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2024-09-17T01:49:11.690 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2024-09-17T01:49:11.693 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-09-17T01:49:11.694 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-09-17T01:49:11.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.727+0000 7f44ada00640 1 -- 172.21.15.42:0/952361230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44a80cf1b0 msgr2=0x7f44a80704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:11.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.727+0000 7f44ada00640 1 --2- 172.21.15.42:0/952361230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44a80cf1b0 0x7f44a80704b0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f4490009830 tx=0x7f449002a400 comp rx=0 tx=0).stop 2024-09-17T01:49:11.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.727+0000 7f44ada00640 1 -- 172.21.15.42:0/952361230 shutdown_connections 2024-09-17T01:49:11.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.727+0000 7f44ada00640 1 --2- 172.21.15.42:0/952361230 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44a80cd6a0 0x7f44a80cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:11.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.727+0000 7f44ada00640 1 --2- 172.21.15.42:0/952361230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44a80cf1b0 0x7f44a80704b0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:11.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.727+0000 7f44ada00640 1 -- 172.21.15.42:0/952361230 >> 172.21.15.42:0/952361230 conn(0x7f44a806d1b0 msgr2=0x7f44a806d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:11.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.728+0000 7f44ada00640 1 -- 172.21.15.42:0/952361230 shutdown_connections 2024-09-17T01:49:11.726 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.728+0000 7f44ada00640 1 -- 172.21.15.42:0/952361230 wait complete. 2024-09-17T01:49:11.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.730+0000 7f44ada00640 1 Processor -- start 2024-09-17T01:49:11.728 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.730+0000 7f44ada00640 1 -- start start 2024-09-17T01:49:11.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.731+0000 7f44ada00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44a80cd6a0 0x7f44a815c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:11.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.731+0000 7f44ada00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44a80cf1b0 0x7f44a8153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:11.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.731+0000 7f44ada00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44a815f450 0x7f44a80b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:11.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.731+0000 7f44ada00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f44a8155b60 con 0x7f44a80cd6a0 2024-09-17T01:49:11.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.731+0000 7f44ada00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f44a81559e0 con 0x7f44a815f450 2024-09-17T01:49:11.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.731+0000 7f44ada00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f44a8155ce0 con 0x7f44a80cf1b0 2024-09-17T01:49:11.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.732+0000 7f44a6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44a80cd6a0 0x7f44a815c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:11.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.732+0000 7f44a6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44a80cd6a0 0x7f44a815c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46540/0 (socket says 172.21.15.42:46540) 2024-09-17T01:49:11.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.732+0000 7f44a6a00640 1 -- 172.21.15.42:0/3187198436 learned_addr learned my addr 172.21.15.42:0/3187198436 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:11.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.732+0000 7f449e000640 1 --2- 172.21.15.42:0/3187198436 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44a80cf1b0 0x7f44a8153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:11.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.732+0000 7f44a7400640 1 --2- 172.21.15.42:0/3187198436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44a815f450 0x7f44a80b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:11.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.732+0000 7f44a6a00640 1 -- 172.21.15.42:0/3187198436 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44a80cf1b0 msgr2=0x7f44a8153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:11.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.732+0000 7f44a6a00640 1 --2- 172.21.15.42:0/3187198436 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44a80cf1b0 0x7f44a8153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:11.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.732+0000 7f44a6a00640 1 -- 172.21.15.42:0/3187198436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44a815f450 msgr2=0x7f44a80b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:11.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.732+0000 7f44a6a00640 1 --2- 172.21.15.42:0/3187198436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44a815f450 0x7f44a80b3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:11.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.732+0000 7f44a6a00640 1 -- 172.21.15.42:0/3187198436 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a81f5cd0 con 0x7f44a80cd6a0 2024-09-17T01:49:11.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.732+0000 7f44a6a00640 1 --2- 172.21.15.42:0/3187198436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44a80cd6a0 0x7f44a815c8a0 secure :-1 s=READY pgs=2513 cs=0 l=1 rev1=1 crypto rx=0x7f449800c730 tx=0x7f449800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:11.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.733+0000 7f449f400640 1 -- 172.21.15.42:0/3187198436 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4498017070 con 0x7f44a80cd6a0 2024-09-17T01:49:11.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.733+0000 7f449f400640 1 -- 172.21.15.42:0/3187198436 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f449800ce40 con 0x7f44a80cd6a0 2024-09-17T01:49:11.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.733+0000 7f449f400640 1 -- 172.21.15.42:0/3187198436 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449800a8a0 con 0x7f44a80cd6a0 2024-09-17T01:49:11.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.733+0000 7f44ada00640 1 -- 172.21.15.42:0/3187198436 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a81f6130 con 0x7f44a80cd6a0 2024-09-17T01:49:11.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.733+0000 7f44ada00640 1 -- 172.21.15.42:0/3187198436 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a81f66f0 con 0x7f44a80cd6a0 2024-09-17T01:49:11.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.734+0000 7f44ada00640 1 -- 172.21.15.42:0/3187198436 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a8156190 con 0x7f44a80cd6a0 2024-09-17T01:49:11.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.735+0000 7f449f400640 1 -- 172.21.15.42:0/3187198436 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f449801a070 con 0x7f44a80cd6a0 2024-09-17T01:49:11.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.736+0000 7f449f400640 1 --2- 172.21.15.42:0/3187198436 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4484078b90 0x7f448407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:11.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.736+0000 7f449f400640 1 -- 172.21.15.42:0/3187198436 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(218..218 src has 1..218) ==== 4943+0+0 (secure 0 0 0) 0x7f449809a0c0 con 0x7f44a80cd6a0 2024-09-17T01:49:11.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.737+0000 7f449e000640 1 --2- 172.21.15.42:0/3187198436 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4484078b90 0x7f448407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:11.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.737+0000 7f449e000640 1 --2- 172.21.15.42:0/3187198436 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4484078b90 0x7f448407b0a0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f4490034000 tx=0x7f4490004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:11.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.741+0000 7f449f400640 1 -- 172.21.15.42:0/3187198436 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f44a80ced90 con 0x7f44a80cd6a0 2024-09-17T01:49:11.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:11.950+0000 7f44ada00640 1 -- 172.21.15.42:0/3187198436 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f44a8070650 con 0x7f44a80cd6a0 2024-09-17T01:49:12.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.641+0000 7f449f400640 1 -- 172.21.15.42:0/3187198436 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v220) ==== 97+0+0 (secure 0 0 0) 0x7f44980013e0 con 0x7f44a80cd6a0 2024-09-17T01:49:12.640 INFO:teuthology.orchestra.run.smithi042.stderr: removed all blocklist entries 2024-09-17T01:49:12.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.645+0000 7f44ada00640 1 -- 172.21.15.42:0/3187198436 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4484078b90 msgr2=0x7f448407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:12.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.645+0000 7f44ada00640 1 --2- 172.21.15.42:0/3187198436 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4484078b90 0x7f448407b0a0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f4490034000 tx=0x7f4490004730 comp rx=0 tx=0).stop 2024-09-17T01:49:12.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.645+0000 7f44ada00640 1 -- 172.21.15.42:0/3187198436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44a80cd6a0 msgr2=0x7f44a815c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:12.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.645+0000 7f44ada00640 1 --2- 172.21.15.42:0/3187198436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44a80cd6a0 0x7f44a815c8a0 secure :-1 s=READY pgs=2513 cs=0 l=1 rev1=1 crypto rx=0x7f449800c730 tx=0x7f449800cbf0 comp rx=0 tx=0).stop 2024-09-17T01:49:12.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.646+0000 7f44ada00640 1 -- 172.21.15.42:0/3187198436 shutdown_connections 2024-09-17T01:49:12.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.646+0000 7f44ada00640 1 --2- 172.21.15.42:0/3187198436 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4484078b90 0x7f448407b0a0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:12.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.646+0000 7f44ada00640 1 --2- 172.21.15.42:0/3187198436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44a815f450 0x7f44a80b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:12.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.646+0000 7f44ada00640 1 --2- 172.21.15.42:0/3187198436 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44a80cf1b0 0x7f44a8153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:12.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.646+0000 7f44ada00640 1 --2- 172.21.15.42:0/3187198436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44a80cd6a0 0x7f44a815c8a0 unknown :-1 s=CLOSED pgs=2513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:12.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.646+0000 7f44ada00640 1 -- 172.21.15.42:0/3187198436 >> 172.21.15.42:0/3187198436 conn(0x7f44a806d1b0 msgr2=0x7f44a8154fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:12.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.646+0000 7f44ada00640 1 -- 172.21.15.42:0/3187198436 shutdown_connections 2024-09-17T01:49:12.645 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.646+0000 7f44ada00640 1 -- 172.21.15.42:0/3187198436 wait complete. 2024-09-17T01:49:12.674 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T01:49:12.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.906+0000 7f52e5600640 1 -- 172.21.15.42:0/1905816893 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52e0072b60 msgr2=0x7f52e00cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:12.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.906+0000 7f52e5600640 1 --2- 172.21.15.42:0/1905816893 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52e0072b60 0x7f52e00cd620 secure :-1 s=READY pgs=2515 cs=0 l=1 rev1=1 crypto rx=0x7f52e00749c0 tx=0x7f52c802a510 comp rx=0 tx=0).stop 2024-09-17T01:49:12.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.906+0000 7f52e5600640 1 -- 172.21.15.42:0/1905816893 shutdown_connections 2024-09-17T01:49:12.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.906+0000 7f52e5600640 1 --2- 172.21.15.42:0/1905816893 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52e0072b60 0x7f52e00cd620 unknown :-1 s=CLOSED pgs=2515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:12.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.906+0000 7f52e5600640 1 -- 172.21.15.42:0/1905816893 >> 172.21.15.42:0/1905816893 conn(0x7f52e006d1b0 msgr2=0x7f52e006d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:12.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.906+0000 7f52e5600640 1 -- 172.21.15.42:0/1905816893 shutdown_connections 2024-09-17T01:49:12.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.906+0000 7f52e5600640 1 -- 172.21.15.42:0/1905816893 wait complete. 2024-09-17T01:49:12.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.909+0000 7f52e5600640 1 Processor -- start 2024-09-17T01:49:12.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.909+0000 7f52e5600640 1 -- start start 2024-09-17T01:49:12.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.910+0000 7f52e5600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52e0072b60 0x7f52e013de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:12.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.910+0000 7f52e5600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52e00cdb60 0x7f52e00b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:12.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.910+0000 7f52e5600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52e015dcf0 0x7f52e00ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:12.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.910+0000 7f52e5600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f52e006f0d0 con 0x7f52e0072b60 2024-09-17T01:49:12.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.910+0000 7f52e5600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f52e01610b0 con 0x7f52e00cdb60 2024-09-17T01:49:12.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.910+0000 7f52e5600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f52e006f250 con 0x7f52e015dcf0 2024-09-17T01:49:12.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.910+0000 7f52dea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52e0072b60 0x7f52e013de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:12.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.910+0000 7f52dea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52e0072b60 0x7f52e013de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46552/0 (socket says 172.21.15.42:46552) 2024-09-17T01:49:12.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.910+0000 7f52dea00640 1 -- 172.21.15.42:0/2080463951 learned_addr learned my addr 172.21.15.42:0/2080463951 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:12.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.911+0000 7f52d6000640 1 --2- 172.21.15.42:0/2080463951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52e00cdb60 0x7f52e00b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:12.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.911+0000 7f52df400640 1 --2- 172.21.15.42:0/2080463951 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52e015dcf0 0x7f52e00ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:12.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.911+0000 7f52dea00640 1 -- 172.21.15.42:0/2080463951 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52e015dcf0 msgr2=0x7f52e00ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:12.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.911+0000 7f52dea00640 1 --2- 172.21.15.42:0/2080463951 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52e015dcf0 0x7f52e00ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:12.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.911+0000 7f52dea00640 1 -- 172.21.15.42:0/2080463951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52e00cdb60 msgr2=0x7f52e00b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:12.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.911+0000 7f52dea00640 1 --2- 172.21.15.42:0/2080463951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52e00cdb60 0x7f52e00b5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:12.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.911+0000 7f52dea00640 1 -- 172.21.15.42:0/2080463951 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e00b3830 con 0x7f52e0072b60 2024-09-17T01:49:12.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.911+0000 7f52df400640 1 --2- 172.21.15.42:0/2080463951 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52e015dcf0 0x7f52e00ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:49:12.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.911+0000 7f52dea00640 1 --2- 172.21.15.42:0/2080463951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52e0072b60 0x7f52e013de40 secure :-1 s=READY pgs=2516 cs=0 l=1 rev1=1 crypto rx=0x7f52d0001eb0 tx=0x7f52d000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:12.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.911+0000 7f52d7400640 1 -- 172.21.15.42:0/2080463951 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d0017070 con 0x7f52e0072b60 2024-09-17T01:49:12.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.912+0000 7f52d7400640 1 -- 172.21.15.42:0/2080463951 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52d00053c0 con 0x7f52e0072b60 2024-09-17T01:49:12.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.912+0000 7f52e5600640 1 -- 172.21.15.42:0/2080463951 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52e0141ec0 con 0x7f52e0072b60 2024-09-17T01:49:12.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.912+0000 7f52d7400640 1 -- 172.21.15.42:0/2080463951 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d0003830 con 0x7f52e0072b60 2024-09-17T01:49:12.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.912+0000 7f52e5600640 1 -- 172.21.15.42:0/2080463951 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52e0142480 con 0x7f52e0072b60 2024-09-17T01:49:12.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.913+0000 7f52e5600640 1 -- 172.21.15.42:0/2080463951 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52e00b3a00 con 0x7f52e0072b60 2024-09-17T01:49:12.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.914+0000 7f52d7400640 1 -- 172.21.15.42:0/2080463951 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f52d001a070 con 0x7f52e0072b60 2024-09-17T01:49:12.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.915+0000 7f52d7400640 1 --2- 172.21.15.42:0/2080463951 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f52bc078b90 0x7f52bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:12.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.915+0000 7f52d7400640 1 -- 172.21.15.42:0/2080463951 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(222..222 src has 1..222) ==== 4857+0+0 (secure 0 0 0) 0x7f52d0099e30 con 0x7f52e0072b60 2024-09-17T01:49:12.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.916+0000 7f52d6000640 1 --2- 172.21.15.42:0/2080463951 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f52bc078b90 0x7f52bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:12.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.917+0000 7f52d6000640 1 --2- 172.21.15.42:0/2080463951 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f52bc078b90 0x7f52bc07b0a0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f52c8034000 tx=0x7f52c8004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:12.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:12.920+0000 7f52d7400640 1 -- 172.21.15.42:0/2080463951 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f52d0062520 con 0x7f52e0072b60 2024-09-17T01:49:13.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.189+0000 7f52e5600640 1 -- 172.21.15.42:0/2080463951 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f52e00cd620 con 0x7f52e0072b60 2024-09-17T01:49:13.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.189+0000 7f52d7400640 1 -- 172.21.15.42:0/2080463951 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v45) ==== 80+0+5304 (secure 0 0 0) 0x7f52d0061e20 con 0x7f52e0072b60 2024-09-17T01:49:13.187 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:13.187 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:49:13.187 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_dump": [ 2024-09-17T01:49:13.187 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:49:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.a", 2024-09-17T01:49:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmyJK4HRAAIC4E4V7p1fqIEfPIICMxZg==", 2024-09-17T01:49:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:49:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:49:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:49:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:49:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:49:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:49:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:49:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:49:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.b", 2024-09-17T01:49:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmXv3vORAALPrYIM6Vtz0g1pOxVhrUig==", 2024-09-17T01:49:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:49:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:49:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:49:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:49:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:49:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:49:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:49:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:49:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.c", 2024-09-17T01:49:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmPE7MKxAA9mGG+EO9C3VGVMerOm92+Q==", 2024-09-17T01:49:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:49:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:49:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:49:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:49:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:49:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:49:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:49:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:49:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mds.d", 2024-09-17T01:49:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmaOBSDBAATU4tpjM5IMcuvzZFE7N5bQ==", 2024-09-17T01:49:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:49:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:49:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:49:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:49:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:49:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:49:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:49:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:49:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.0", 2024-09-17T01:49:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDP2+hmEJebExAAAdGEoSzM96ybGT9h7t7OkA==", 2024-09-17T01:49:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:49:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:49:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:49:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:49:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:49:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:49:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:49:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.1", 2024-09-17T01:49:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDS2+hm7dWoMBAAagktrUl0O2/mgKCEfpAstA==", 2024-09-17T01:49:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:49:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:49:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:49:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:49:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:49:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:49:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:49:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.2", 2024-09-17T01:49:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDW2+hmEfSPBBAAPAa6EZt27yUcJSfZyCKheg==", 2024-09-17T01:49:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:49:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:49:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:49:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:49:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:49:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:49:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:49:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.3", 2024-09-17T01:49:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDZ2+hmHQhXFRAAj84g+IKqH6KMP7LjRtFvLw==", 2024-09-17T01:49:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:49:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:49:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:49:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:49:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:49:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:49:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:49:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.4", 2024-09-17T01:49:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDd2+hmaNcMNBAAx1GV/oFdfssMjFWFN5M0VQ==", 2024-09-17T01:49:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:49:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:49:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:49:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:49:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:49:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:49:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:49:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.5", 2024-09-17T01:49:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDh2+hm301NJhAAnSUH5AAvqhPwM7loH6frww==", 2024-09-17T01:49:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:49:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:49:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:49:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:49:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:49:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:49:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:49:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.6", 2024-09-17T01:49:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDk2+hm61WNNRAAbCvVvsUpB4fgt4ja60DRZA==", 2024-09-17T01:49:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:49:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:49:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:49:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:49:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:49:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:49:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:49:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "osd.7", 2024-09-17T01:49:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDo2+hmesiLFhAA29n1eageNvP+lkRyh6gGMw==", 2024-09-17T01:49:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:49:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow profile osd", 2024-09-17T01:49:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile osd", 2024-09-17T01:49:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:49:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:49:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:49:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:49:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.0", 2024-09-17T01:49:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA==", 2024-09-17T01:49:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:49:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:49:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow r", 2024-09-17T01:49:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T01:49:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:49:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:49:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:49:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.1", 2024-09-17T01:49:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmZLygLhAABlauZgnidFWvfCCPuBLObg==", 2024-09-17T01:49:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:49:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:49:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:49:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:49:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:49:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:49:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:49:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:49:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.2", 2024-09-17T01:49:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hm8lnZIxAAN0a2CVMMtu/Nz50OG4a02A==", 2024-09-17T01:49:13.199 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:49:13.199 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:49:13.199 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:49:13.199 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:49:13.199 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:49:13.199 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:49:13.199 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:49:13.199 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:49:13.199 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.3", 2024-09-17T01:49:13.199 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDN2+hmgXdAORAAM5Uy66I4nnTJ9Vhkn9JoBw==", 2024-09-17T01:49:13.199 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:49:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow", 2024-09-17T01:49:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow r", 2024-09-17T01:49:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow rw", 2024-09-17T01:49:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow rwx" 2024-09-17T01:49:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:49:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:49:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:49:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "client.admin", 2024-09-17T01:49:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDL2+hmvCreHBAA4CSAhosssViGqD93U+I7Iw==", 2024-09-17T01:49:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:49:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:49:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": "allow *", 2024-09-17T01:49:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow *", 2024-09-17T01:49:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:49:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:49:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:49:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:49:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.x", 2024-09-17T01:49:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmYPnlEhAAIcQ11ktWZyMXYdbAONiLog==", 2024-09-17T01:49:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:49:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:49:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:49:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:49:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:49:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:49:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:49:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: "entity": "mgr.y", 2024-09-17T01:49:13.202 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "AQDM2+hmpCZtBxAAp5tXMc6aEq1aOny2LJZAiA==", 2024-09-17T01:49:13.202 INFO:teuthology.orchestra.run.smithi042.stdout: "caps": { 2024-09-17T01:49:13.202 INFO:teuthology.orchestra.run.smithi042.stdout: "mds": "allow *", 2024-09-17T01:49:13.202 INFO:teuthology.orchestra.run.smithi042.stdout: "mon": "allow profile mgr", 2024-09-17T01:49:13.202 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": "allow *" 2024-09-17T01:49:13.202 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:49:13.202 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:49:13.202 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-17T01:49:13.202 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:49:13.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.191+0000 7f52e5600640 1 -- 172.21.15.42:0/2080463951 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f52bc078b90 msgr2=0x7f52bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:13.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.191+0000 7f52e5600640 1 --2- 172.21.15.42:0/2080463951 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f52bc078b90 0x7f52bc07b0a0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f52c8034000 tx=0x7f52c8004730 comp rx=0 tx=0).stop 2024-09-17T01:49:13.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.191+0000 7f52e5600640 1 -- 172.21.15.42:0/2080463951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52e0072b60 msgr2=0x7f52e013de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:13.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.191+0000 7f52e5600640 1 --2- 172.21.15.42:0/2080463951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52e0072b60 0x7f52e013de40 secure :-1 s=READY pgs=2516 cs=0 l=1 rev1=1 crypto rx=0x7f52d0001eb0 tx=0x7f52d000c890 comp rx=0 tx=0).stop 2024-09-17T01:49:13.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.192+0000 7f52e5600640 1 -- 172.21.15.42:0/2080463951 shutdown_connections 2024-09-17T01:49:13.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.192+0000 7f52e5600640 1 --2- 172.21.15.42:0/2080463951 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f52bc078b90 0x7f52bc07b0a0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:13.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.192+0000 7f52e5600640 1 --2- 172.21.15.42:0/2080463951 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52e00cdb60 0x7f52e00b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:13.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.192+0000 7f52e5600640 1 --2- 172.21.15.42:0/2080463951 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f52e015dcf0 0x7f52e00ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:13.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.192+0000 7f52e5600640 1 --2- 172.21.15.42:0/2080463951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52e0072b60 0x7f52e013de40 unknown :-1 s=CLOSED pgs=2516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:13.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.192+0000 7f52e5600640 1 -- 172.21.15.42:0/2080463951 >> 172.21.15.42:0/2080463951 conn(0x7f52e006d1b0 msgr2=0x7f52e015e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:13.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.192+0000 7f52e5600640 1 -- 172.21.15.42:0/2080463951 shutdown_connections 2024-09-17T01:49:13.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.192+0000 7f52e5600640 1 -- 172.21.15.42:0/2080463951 wait complete. 2024-09-17T01:49:13.213 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T01:49:13.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.442+0000 7ff78b200640 1 -- 172.21.15.42:0/2458832325 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff78c0b3520 msgr2=0x7ff78c0b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:13.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.442+0000 7ff78b200640 1 --2- 172.21.15.42:0/2458832325 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff78c0b3520 0x7ff78c0b3930 secure :-1 s=READY pgs=2518 cs=0 l=1 rev1=1 crypto rx=0x7ff774009830 tx=0x7ff77402a510 comp rx=0 tx=0).stop 2024-09-17T01:49:13.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.442+0000 7ff78b200640 1 -- 172.21.15.42:0/2458832325 shutdown_connections 2024-09-17T01:49:13.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.442+0000 7ff78b200640 1 --2- 172.21.15.42:0/2458832325 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff78c160500 0x7ff78c160910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:13.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.442+0000 7ff78b200640 1 --2- 172.21.15.42:0/2458832325 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff78c0b3520 0x7ff78c0b3930 unknown :-1 s=CLOSED pgs=2518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:13.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.442+0000 7ff78b200640 1 -- 172.21.15.42:0/2458832325 >> 172.21.15.42:0/2458832325 conn(0x7ff78c06d3f0 msgr2=0x7ff78c0b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:13.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.442+0000 7ff78b200640 1 -- 172.21.15.42:0/2458832325 shutdown_connections 2024-09-17T01:49:13.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.442+0000 7ff78b200640 1 -- 172.21.15.42:0/2458832325 wait complete. 2024-09-17T01:49:13.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.444+0000 7ff78b200640 1 Processor -- start 2024-09-17T01:49:13.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.444+0000 7ff78b200640 1 -- start start 2024-09-17T01:49:13.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.446+0000 7ff78b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff78c0af970 0x7ff78c15c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:13.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.446+0000 7ff78b200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff78c0b3520 0x7ff78c1429e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:13.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.446+0000 7ff78b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff78c160500 0x7ff78c152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:13.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.446+0000 7ff78b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c0ce700 con 0x7ff78c0af970 2024-09-17T01:49:13.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.446+0000 7ff78b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c0ce580 con 0x7ff78c160500 2024-09-17T01:49:13.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.446+0000 7ff78b200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff78c0ce880 con 0x7ff78c0b3520 2024-09-17T01:49:13.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.446+0000 7ff789e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff78c0af970 0x7ff78c15c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:13.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.446+0000 7ff789e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff78c0af970 0x7ff78c15c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46556/0 (socket says 172.21.15.42:46556) 2024-09-17T01:49:13.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.446+0000 7ff789e00640 1 -- 172.21.15.42:0/3839385361 learned_addr learned my addr 172.21.15.42:0/3839385361 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:13.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.446+0000 7ff78a800640 1 --2- 172.21.15.42:0/3839385361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff78c160500 0x7ff78c152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:13.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.446+0000 7ff783e00640 1 --2- 172.21.15.42:0/3839385361 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff78c0b3520 0x7ff78c1429e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:13.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.447+0000 7ff789e00640 1 -- 172.21.15.42:0/3839385361 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff78c0b3520 msgr2=0x7ff78c1429e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:13.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.447+0000 7ff789e00640 1 --2- 172.21.15.42:0/3839385361 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff78c0b3520 0x7ff78c1429e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:13.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.447+0000 7ff789e00640 1 -- 172.21.15.42:0/3839385361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff78c160500 msgr2=0x7ff78c152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:13.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.447+0000 7ff789e00640 1 --2- 172.21.15.42:0/3839385361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff78c160500 0x7ff78c152630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:13.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.447+0000 7ff789e00640 1 -- 172.21.15.42:0/3839385361 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff78c143710 con 0x7ff78c0af970 2024-09-17T01:49:13.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.447+0000 7ff783e00640 1 --2- 172.21.15.42:0/3839385361 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff78c0b3520 0x7ff78c1429e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:49:13.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.447+0000 7ff789e00640 1 --2- 172.21.15.42:0/3839385361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff78c0af970 0x7ff78c15c2d0 secure :-1 s=READY pgs=2519 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00c3c0 tx=0x7ff77c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:13.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.447+0000 7ff782000640 1 -- 172.21.15.42:0/3839385361 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c017070 con 0x7ff78c0af970 2024-09-17T01:49:13.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.447+0000 7ff782000640 1 -- 172.21.15.42:0/3839385361 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff77c0035f0 con 0x7ff78c0af970 2024-09-17T01:49:13.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.447+0000 7ff78b200640 1 -- 172.21.15.42:0/3839385361 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff78c1f6d30 con 0x7ff78c0af970 2024-09-17T01:49:13.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.447+0000 7ff782000640 1 -- 172.21.15.42:0/3839385361 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c003a40 con 0x7ff78c0af970 2024-09-17T01:49:13.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.447+0000 7ff78b200640 1 -- 172.21.15.42:0/3839385361 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff78c1f72f0 con 0x7ff78c0af970 2024-09-17T01:49:13.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.449+0000 7ff78b200640 1 -- 172.21.15.42:0/3839385361 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff78c0b3930 con 0x7ff78c0af970 2024-09-17T01:49:13.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.450+0000 7ff782000640 1 -- 172.21.15.42:0/3839385361 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff77c01a070 con 0x7ff78c0af970 2024-09-17T01:49:13.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.451+0000 7ff782000640 1 --2- 172.21.15.42:0/3839385361 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff768078b90 0x7ff76807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:13.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.451+0000 7ff782000640 1 -- 172.21.15.42:0/3839385361 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(222..222 src has 1..222) ==== 4857+0+0 (secure 0 0 0) 0x7ff77c099cb0 con 0x7ff78c0af970 2024-09-17T01:49:13.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.452+0000 7ff783e00640 1 --2- 172.21.15.42:0/3839385361 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff768078b90 0x7ff76807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:13.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.453+0000 7ff783e00640 1 --2- 172.21.15.42:0/3839385361 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff768078b90 0x7ff76807b0a0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7ff774034000 tx=0x7ff774004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:13.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.456+0000 7ff782000640 1 -- 172.21.15.42:0/3839385361 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff78c160e50 con 0x7ff78c0af970 2024-09-17T01:49:13.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.652+0000 7ff78b200640 1 -- 172.21.15.42:0/3839385361 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff78c0698e0 con 0x7ff78c0af970 2024-09-17T01:49:13.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.653+0000 7ff782000640 1 -- 172.21.15.42:0/3839385361 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v222) ==== 84+0+65 (secure 0 0 0) 0x7ff77c061d50 con 0x7ff78c0af970 2024-09-17T01:49:13.651 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:13.651 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2024-09-17T01:49:13.651 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T01:49:13.651 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2024-09-17T01:49:13.651 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2024-09-17T01:49:13.651 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:49:13.651 INFO:teuthology.orchestra.run.smithi042.stdout:] 2024-09-17T01:49:13.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.655+0000 7ff78b200640 1 -- 172.21.15.42:0/3839385361 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff768078b90 msgr2=0x7ff76807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:13.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.655+0000 7ff78b200640 1 --2- 172.21.15.42:0/3839385361 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff768078b90 0x7ff76807b0a0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7ff774034000 tx=0x7ff774004730 comp rx=0 tx=0).stop 2024-09-17T01:49:13.653 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.655+0000 7ff78b200640 1 -- 172.21.15.42:0/3839385361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff78c0af970 msgr2=0x7ff78c15c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:13.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.655+0000 7ff78b200640 1 --2- 172.21.15.42:0/3839385361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff78c0af970 0x7ff78c15c2d0 secure :-1 s=READY pgs=2519 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00c3c0 tx=0x7ff77c00c880 comp rx=0 tx=0).stop 2024-09-17T01:49:13.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.655+0000 7ff78b200640 1 -- 172.21.15.42:0/3839385361 shutdown_connections 2024-09-17T01:49:13.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.655+0000 7ff78b200640 1 --2- 172.21.15.42:0/3839385361 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff768078b90 0x7ff76807b0a0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:13.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.655+0000 7ff78b200640 1 --2- 172.21.15.42:0/3839385361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff78c160500 0x7ff78c152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:13.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.655+0000 7ff78b200640 1 --2- 172.21.15.42:0/3839385361 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff78c0b3520 0x7ff78c1429e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:13.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.655+0000 7ff78b200640 1 --2- 172.21.15.42:0/3839385361 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff78c0af970 0x7ff78c15c2d0 unknown :-1 s=CLOSED pgs=2519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:13.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.655+0000 7ff78b200640 1 -- 172.21.15.42:0/3839385361 >> 172.21.15.42:0/3839385361 conn(0x7ff78c06d3f0 msgr2=0x7ff78c15e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:13.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.655+0000 7ff78b200640 1 -- 172.21.15.42:0/3839385361 shutdown_connections 2024-09-17T01:49:13.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.655+0000 7ff78b200640 1 -- 172.21.15.42:0/3839385361 wait complete. 2024-09-17T01:49:13.675 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T01:49:13.675 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T01:49:13.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.909+0000 7f326f200640 1 -- 172.21.15.42:0/2137267507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32700b5210 msgr2=0x7f32700b59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:13.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.909+0000 7f326f200640 1 --2- 172.21.15.42:0/2137267507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32700b5210 0x7f32700b59c0 secure :-1 s=READY pgs=2520 cs=0 l=1 rev1=1 crypto rx=0x7f3258005fd0 tx=0x7f325802a5d0 comp rx=0 tx=0).stop 2024-09-17T01:49:13.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.909+0000 7f326f200640 1 -- 172.21.15.42:0/2137267507 shutdown_connections 2024-09-17T01:49:13.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.909+0000 7f326f200640 1 --2- 172.21.15.42:0/2137267507 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32700b5210 0x7f32700b59c0 unknown :-1 s=CLOSED pgs=2520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:13.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.909+0000 7f326f200640 1 --2- 172.21.15.42:0/2137267507 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f32700b3620 0x7f3270163000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:13.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.909+0000 7f326f200640 1 -- 172.21.15.42:0/2137267507 >> 172.21.15.42:0/2137267507 conn(0x7f327006cfa0 msgr2=0x7f327006d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:13.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.909+0000 7f326f200640 1 -- 172.21.15.42:0/2137267507 shutdown_connections 2024-09-17T01:49:13.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.909+0000 7f326f200640 1 -- 172.21.15.42:0/2137267507 wait complete. 2024-09-17T01:49:13.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.911+0000 7f326f200640 1 Processor -- start 2024-09-17T01:49:13.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.911+0000 7f326f200640 1 -- start start 2024-09-17T01:49:13.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.913+0000 7f326f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f32700b3620 0x7f3270137910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:13.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.913+0000 7f326f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32700b5210 0x7f3270161600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:13.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.913+0000 7f326f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32700b5f00 0x7f3270161b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:13.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.913+0000 7f326f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f32700af0b0 con 0x7f32700b5f00 2024-09-17T01:49:13.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.913+0000 7f326f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f327015f140 con 0x7f32700b5210 2024-09-17T01:49:13.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.913+0000 7f326f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f32700af230 con 0x7f32700b3620 2024-09-17T01:49:13.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.913+0000 7f326e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32700b5f00 0x7f3270161b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:13.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.913+0000 7f326de00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f32700b3620 0x7f3270137910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:13.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.913+0000 7f326e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32700b5f00 0x7f3270161b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46582/0 (socket says 172.21.15.42:46582) 2024-09-17T01:49:13.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.913+0000 7f326e800640 1 -- 172.21.15.42:0/4245348547 learned_addr learned my addr 172.21.15.42:0/4245348547 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:13.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.913+0000 7f3267e00640 1 --2- 172.21.15.42:0/4245348547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32700b5210 0x7f3270161600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:13.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.914+0000 7f326e800640 1 -- 172.21.15.42:0/4245348547 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f32700b3620 msgr2=0x7f3270137910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:13.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.914+0000 7f326e800640 1 --2- 172.21.15.42:0/4245348547 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f32700b3620 0x7f3270137910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:13.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.914+0000 7f326e800640 1 -- 172.21.15.42:0/4245348547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32700b5210 msgr2=0x7f3270161600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:13.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.914+0000 7f326e800640 1 --2- 172.21.15.42:0/4245348547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32700b5210 0x7f3270161600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:13.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.914+0000 7f326e800640 1 -- 172.21.15.42:0/4245348547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f327015e2c0 con 0x7f32700b5f00 2024-09-17T01:49:13.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.914+0000 7f326e800640 1 --2- 172.21.15.42:0/4245348547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32700b5f00 0x7f3270161b40 secure :-1 s=READY pgs=2521 cs=0 l=1 rev1=1 crypto rx=0x7f326800c730 tx=0x7f326800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:13.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.914+0000 7f3266000640 1 -- 172.21.15.42:0/4245348547 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3268003b70 con 0x7f32700b5f00 2024-09-17T01:49:13.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.914+0000 7f3266000640 1 -- 172.21.15.42:0/4245348547 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3268003d10 con 0x7f32700b5f00 2024-09-17T01:49:13.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.914+0000 7f326f200640 1 -- 172.21.15.42:0/4245348547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3270139df0 con 0x7f32700b5f00 2024-09-17T01:49:13.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.914+0000 7f3266000640 1 -- 172.21.15.42:0/4245348547 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3268005330 con 0x7f32700b5f00 2024-09-17T01:49:13.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.914+0000 7f326f200640 1 -- 172.21.15.42:0/4245348547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f327013a3b0 con 0x7f32700b5f00 2024-09-17T01:49:13.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.915+0000 7f326f200640 1 -- 172.21.15.42:0/4245348547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3270137ea0 con 0x7f32700b5f00 2024-09-17T01:49:13.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.916+0000 7f3266000640 1 -- 172.21.15.42:0/4245348547 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f32680054d0 con 0x7f32700b5f00 2024-09-17T01:49:13.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.917+0000 7f3266000640 1 --2- 172.21.15.42:0/4245348547 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f324c078b90 0x7f324c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:13.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.918+0000 7f3266000640 1 -- 172.21.15.42:0/4245348547 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(222..222 src has 1..222) ==== 4857+0+0 (secure 0 0 0) 0x7f326809a6e0 con 0x7f32700b5f00 2024-09-17T01:49:13.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.918+0000 7f326de00640 1 --2- 172.21.15.42:0/4245348547 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f324c078b90 0x7f324c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:13.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.919+0000 7f326de00640 1 --2- 172.21.15.42:0/4245348547 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f324c078b90 0x7f324c07b0a0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f3260004630 tx=0x7f326000b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:13.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:13.922+0000 7f3266000640 1 -- 172.21.15.42:0/4245348547 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3270163540 con 0x7f32700b5f00 2024-09-17T01:49:14.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.117+0000 7f326f200640 1 -- 172.21.15.42:0/4245348547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f3270139b80 con 0x7f32700b5f00 2024-09-17T01:49:14.654 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.656+0000 7f3266000640 1 -- 172.21.15.42:0/4245348547 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v223) ==== 138+0+0 (secure 0 0 0) 0x7f3268062790 con 0x7f32700b5f00 2024-09-17T01:49:14.655 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2024-09-17T01:49:14.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.660+0000 7f326f200640 1 -- 172.21.15.42:0/4245348547 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f324c078b90 msgr2=0x7f324c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:14.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.660+0000 7f326f200640 1 --2- 172.21.15.42:0/4245348547 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f324c078b90 0x7f324c07b0a0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f3260004630 tx=0x7f326000b2e0 comp rx=0 tx=0).stop 2024-09-17T01:49:14.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.660+0000 7f326f200640 1 -- 172.21.15.42:0/4245348547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32700b5f00 msgr2=0x7f3270161b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:14.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.660+0000 7f326f200640 1 --2- 172.21.15.42:0/4245348547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32700b5f00 0x7f3270161b40 secure :-1 s=READY pgs=2521 cs=0 l=1 rev1=1 crypto rx=0x7f326800c730 tx=0x7f326800cb30 comp rx=0 tx=0).stop 2024-09-17T01:49:14.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.661+0000 7f326f200640 1 -- 172.21.15.42:0/4245348547 shutdown_connections 2024-09-17T01:49:14.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.661+0000 7f326f200640 1 --2- 172.21.15.42:0/4245348547 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f324c078b90 0x7f324c07b0a0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:14.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.661+0000 7f326f200640 1 --2- 172.21.15.42:0/4245348547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32700b5210 0x7f3270161600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:14.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.661+0000 7f326f200640 1 --2- 172.21.15.42:0/4245348547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32700b5f00 0x7f3270161b40 unknown :-1 s=CLOSED pgs=2521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:14.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.661+0000 7f326f200640 1 --2- 172.21.15.42:0/4245348547 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f32700b3620 0x7f3270137910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:14.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.661+0000 7f326f200640 1 -- 172.21.15.42:0/4245348547 >> 172.21.15.42:0/4245348547 conn(0x7f327006cfa0 msgr2=0x7f32700b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:14.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.661+0000 7f326f200640 1 -- 172.21.15.42:0/4245348547 shutdown_connections 2024-09-17T01:49:14.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.661+0000 7f326f200640 1 -- 172.21.15.42:0/4245348547 wait complete. 2024-09-17T01:49:14.692 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T01:49:14.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.931+0000 7fe481000640 1 -- 172.21.15.42:0/857043923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe47c15c820 msgr2=0x7fe47c160290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:14.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.931+0000 7fe481000640 1 --2- 172.21.15.42:0/857043923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe47c15c820 0x7fe47c160290 secure :-1 s=READY pgs=2523 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009830 tx=0x7fe46c02a530 comp rx=0 tx=0).stop 2024-09-17T01:49:14.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.931+0000 7fe481000640 1 -- 172.21.15.42:0/857043923 shutdown_connections 2024-09-17T01:49:14.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.931+0000 7fe481000640 1 --2- 172.21.15.42:0/857043923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe47c15c820 0x7fe47c160290 unknown :-1 s=CLOSED pgs=2523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:14.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.931+0000 7fe481000640 1 -- 172.21.15.42:0/857043923 >> 172.21.15.42:0/857043923 conn(0x7fe47c073f60 msgr2=0x7fe47c06cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:14.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.931+0000 7fe481000640 1 -- 172.21.15.42:0/857043923 shutdown_connections 2024-09-17T01:49:14.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.931+0000 7fe481000640 1 -- 172.21.15.42:0/857043923 wait complete. 2024-09-17T01:49:14.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.933+0000 7fe481000640 1 Processor -- start 2024-09-17T01:49:14.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.933+0000 7fe481000640 1 -- start start 2024-09-17T01:49:14.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.935+0000 7fe481000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe47c0d1670 0x7fe47c1f9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:14.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.935+0000 7fe481000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe47c15c820 0x7fe47c150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:14.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.935+0000 7fe481000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe47c15f0d0 0x7fe47c0cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:14.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.935+0000 7fe481000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe47c0b38e0 con 0x7fe47c15f0d0 2024-09-17T01:49:14.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.935+0000 7fe481000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe47c0cf6e0 con 0x7fe47c15c820 2024-09-17T01:49:14.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.935+0000 7fe481000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe47c0b3a60 con 0x7fe47c0d1670 2024-09-17T01:49:14.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.935+0000 7fe47be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe47c15f0d0 0x7fe47c0cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:14.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.935+0000 7fe47be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe47c15f0d0 0x7fe47c0cda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46598/0 (socket says 172.21.15.42:46598) 2024-09-17T01:49:14.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.935+0000 7fe47be00640 1 -- 172.21.15.42:0/4284736134 learned_addr learned my addr 172.21.15.42:0/4284736134 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:14.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.935+0000 7fe47b400640 1 --2- 172.21.15.42:0/4284736134 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe47c0d1670 0x7fe47c1f9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:14.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.935+0000 7fe472a00640 1 --2- 172.21.15.42:0/4284736134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe47c15c820 0x7fe47c150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:14.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.935+0000 7fe47be00640 1 -- 172.21.15.42:0/4284736134 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe47c0d1670 msgr2=0x7fe47c1f9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:14.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.935+0000 7fe47be00640 1 --2- 172.21.15.42:0/4284736134 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe47c0d1670 0x7fe47c1f9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:14.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.936+0000 7fe47be00640 1 -- 172.21.15.42:0/4284736134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe47c15c820 msgr2=0x7fe47c150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:14.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.936+0000 7fe47be00640 1 --2- 172.21.15.42:0/4284736134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe47c15c820 0x7fe47c150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:14.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.936+0000 7fe47be00640 1 -- 172.21.15.42:0/4284736134 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe47c0c8310 con 0x7fe47c15f0d0 2024-09-17T01:49:14.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.936+0000 7fe472a00640 1 --2- 172.21.15.42:0/4284736134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe47c15c820 0x7fe47c150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:49:14.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.936+0000 7fe47be00640 1 --2- 172.21.15.42:0/4284736134 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe47c15f0d0 0x7fe47c0cda60 secure :-1 s=READY pgs=2524 cs=0 l=1 rev1=1 crypto rx=0x7fe47400c730 tx=0x7fe47400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:14.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.936+0000 7fe473e00640 1 -- 172.21.15.42:0/4284736134 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe474003b70 con 0x7fe47c15f0d0 2024-09-17T01:49:14.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.936+0000 7fe473e00640 1 -- 172.21.15.42:0/4284736134 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe474003d10 con 0x7fe47c15f0d0 2024-09-17T01:49:14.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.936+0000 7fe473e00640 1 -- 172.21.15.42:0/4284736134 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47400aab0 con 0x7fe47c15f0d0 2024-09-17T01:49:14.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.936+0000 7fe481000640 1 -- 172.21.15.42:0/4284736134 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe47c1fa280 con 0x7fe47c15f0d0 2024-09-17T01:49:14.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.936+0000 7fe481000640 1 -- 172.21.15.42:0/4284736134 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe47c1fa840 con 0x7fe47c15f0d0 2024-09-17T01:49:14.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.937+0000 7fe481000640 1 -- 172.21.15.42:0/4284736134 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe47c0cefe0 con 0x7fe47c15f0d0 2024-09-17T01:49:14.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.939+0000 7fe473e00640 1 -- 172.21.15.42:0/4284736134 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe47400ac50 con 0x7fe47c15f0d0 2024-09-17T01:49:14.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.940+0000 7fe473e00640 1 --2- 172.21.15.42:0/4284736134 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe458078b90 0x7fe45807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:14.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.940+0000 7fe473e00640 1 -- 172.21.15.42:0/4284736134 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(223..223 src has 1..223) ==== 5227+0+0 (secure 0 0 0) 0x7fe47409b330 con 0x7fe47c15f0d0 2024-09-17T01:49:14.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.940+0000 7fe47b400640 1 --2- 172.21.15.42:0/4284736134 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe458078b90 0x7fe45807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:14.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.941+0000 7fe47b400640 1 --2- 172.21.15.42:0/4284736134 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe458078b90 0x7fe45807b0a0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fe46c034000 tx=0x7fe46c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:14.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:14.944+0000 7fe473e00640 1 -- 172.21.15.42:0/4284736134 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe47c0cefe0 con 0x7fe47c15f0d0 2024-09-17T01:49:15.137 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.139+0000 7fe481000640 1 -- 172.21.15.42:0/4284736134 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe47c1fa010 con 0x7fe47c15f0d0 2024-09-17T01:49:15.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.664+0000 7fe473e00640 1 -- 172.21.15.42:0/4284736134 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v224) ==== 170+0+0 (secure 0 0 0) 0x7fe4740639c0 con 0x7fe47c15f0d0 2024-09-17T01:49:15.662 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2024-09-17T01:49:15.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.671+0000 7fe481000640 1 -- 172.21.15.42:0/4284736134 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe458078b90 msgr2=0x7fe45807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:15.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.671+0000 7fe481000640 1 --2- 172.21.15.42:0/4284736134 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe458078b90 0x7fe45807b0a0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fe46c034000 tx=0x7fe46c004730 comp rx=0 tx=0).stop 2024-09-17T01:49:15.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.671+0000 7fe481000640 1 -- 172.21.15.42:0/4284736134 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe47c15f0d0 msgr2=0x7fe47c0cda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:15.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.671+0000 7fe481000640 1 --2- 172.21.15.42:0/4284736134 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe47c15f0d0 0x7fe47c0cda60 secure :-1 s=READY pgs=2524 cs=0 l=1 rev1=1 crypto rx=0x7fe47400c730 tx=0x7fe47400cbf0 comp rx=0 tx=0).stop 2024-09-17T01:49:15.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.671+0000 7fe481000640 1 -- 172.21.15.42:0/4284736134 shutdown_connections 2024-09-17T01:49:15.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.671+0000 7fe481000640 1 --2- 172.21.15.42:0/4284736134 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe458078b90 0x7fe45807b0a0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:15.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.671+0000 7fe481000640 1 --2- 172.21.15.42:0/4284736134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe47c15c820 0x7fe47c150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:15.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.671+0000 7fe481000640 1 --2- 172.21.15.42:0/4284736134 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe47c15f0d0 0x7fe47c0cda60 unknown :-1 s=CLOSED pgs=2524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:15.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.671+0000 7fe481000640 1 --2- 172.21.15.42:0/4284736134 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe47c0d1670 0x7fe47c1f9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:15.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.671+0000 7fe481000640 1 -- 172.21.15.42:0/4284736134 >> 172.21.15.42:0/4284736134 conn(0x7fe47c073f60 msgr2=0x7fe47c06cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:15.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.672+0000 7fe481000640 1 -- 172.21.15.42:0/4284736134 shutdown_connections 2024-09-17T01:49:15.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.673+0000 7fe481000640 1 -- 172.21.15.42:0/4284736134 wait complete. 2024-09-17T01:49:15.709 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T01:49:15.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.942+0000 7fbd85200640 1 -- 172.21.15.42:0/566138951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd8015dcf0 msgr2=0x7fbd80072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:15.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.942+0000 7fbd85200640 1 --2- 172.21.15.42:0/566138951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd8015dcf0 0x7fbd80072b60 secure :-1 s=READY pgs=2526 cs=0 l=1 rev1=1 crypto rx=0x7fbd8015e2e0 tx=0x7fbd7002a560 comp rx=0 tx=0).stop 2024-09-17T01:49:15.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.943+0000 7fbd85200640 1 -- 172.21.15.42:0/566138951 shutdown_connections 2024-09-17T01:49:15.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.943+0000 7fbd85200640 1 --2- 172.21.15.42:0/566138951 >> v2:172.21.15.43:3300/0 conn(0x7fbd80160790 0x7fbd80160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:15.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.943+0000 7fbd85200640 1 --2- 172.21.15.42:0/566138951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd8015dcf0 0x7fbd80072b60 unknown :-1 s=CLOSED pgs=2526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:15.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.943+0000 7fbd85200640 1 -- 172.21.15.42:0/566138951 >> 172.21.15.42:0/566138951 conn(0x7fbd8006d1b0 msgr2=0x7fbd8006d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:15.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.943+0000 7fbd85200640 1 -- 172.21.15.42:0/566138951 shutdown_connections 2024-09-17T01:49:15.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.943+0000 7fbd85200640 1 -- 172.21.15.42:0/566138951 wait complete. 2024-09-17T01:49:15.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.945+0000 7fbd85200640 1 Processor -- start 2024-09-17T01:49:15.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.945+0000 7fbd85200640 1 -- start start 2024-09-17T01:49:15.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.946+0000 7fbd85200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd800cd620 0x7fbd800b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:15.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.946+0000 7fbd85200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd8015dcf0 0x7fbd801386e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:15.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.947+0000 7fbd85200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd80160790 0x7fbd801f8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:15.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.947+0000 7fbd85200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8006ee00 con 0x7fbd80160790 2024-09-17T01:49:15.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.947+0000 7fbd85200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8006ec80 con 0x7fbd800cd620 2024-09-17T01:49:15.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.947+0000 7fbd85200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbd8006ef80 con 0x7fbd8015dcf0 2024-09-17T01:49:15.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.947+0000 7fbd7e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd80160790 0x7fbd801f8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:15.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.947+0000 7fbd7e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd80160790 0x7fbd801f8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41464/0 (socket says 172.21.15.42:41464) 2024-09-17T01:49:15.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.947+0000 7fbd7e800640 1 -- 172.21.15.42:0/3697768866 learned_addr learned my addr 172.21.15.42:0/3697768866 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:15.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.947+0000 7fbd7de00640 1 --2- 172.21.15.42:0/3697768866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd800cd620 0x7fbd800b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:15.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.947+0000 7fbd7d400640 1 --2- 172.21.15.42:0/3697768866 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd8015dcf0 0x7fbd801386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:15.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.947+0000 7fbd7e800640 1 -- 172.21.15.42:0/3697768866 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd8015dcf0 msgr2=0x7fbd801386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:15.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.947+0000 7fbd7e800640 1 --2- 172.21.15.42:0/3697768866 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd8015dcf0 0x7fbd801386e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:15.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.947+0000 7fbd7e800640 1 -- 172.21.15.42:0/3697768866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd800cd620 msgr2=0x7fbd800b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:15.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.947+0000 7fbd7e800640 1 --2- 172.21.15.42:0/3697768866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd800cd620 0x7fbd800b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:15.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.947+0000 7fbd7e800640 1 -- 172.21.15.42:0/3697768866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd801f8d60 con 0x7fbd80160790 2024-09-17T01:49:15.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.948+0000 7fbd7e800640 1 --2- 172.21.15.42:0/3697768866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd80160790 0x7fbd801f8820 secure :-1 s=READY pgs=2527 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800c6e0 tx=0x7fbd7800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:15.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.948+0000 7fbd76000640 1 -- 172.21.15.42:0/3697768866 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd78003b70 con 0x7fbd80160790 2024-09-17T01:49:15.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.948+0000 7fbd76000640 1 -- 172.21.15.42:0/3697768866 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd78003d30 con 0x7fbd80160790 2024-09-17T01:49:15.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.948+0000 7fbd85200640 1 -- 172.21.15.42:0/3697768866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd800b1400 con 0x7fbd80160790 2024-09-17T01:49:15.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.948+0000 7fbd76000640 1 -- 172.21.15.42:0/3697768866 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd78005330 con 0x7fbd80160790 2024-09-17T01:49:15.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.948+0000 7fbd85200640 1 -- 172.21.15.42:0/3697768866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd800b19c0 con 0x7fbd80160790 2024-09-17T01:49:15.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.949+0000 7fbd85200640 1 -- 172.21.15.42:0/3697768866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd800b1170 con 0x7fbd80160790 2024-09-17T01:49:15.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.950+0000 7fbd76000640 1 -- 172.21.15.42:0/3697768866 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbd780054d0 con 0x7fbd80160790 2024-09-17T01:49:15.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.951+0000 7fbd76000640 1 --2- 172.21.15.42:0/3697768866 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd60078b90 0x7fbd6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:15.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.951+0000 7fbd76000640 1 -- 172.21.15.42:0/3697768866 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(224..224 src has 1..224) ==== 5609+0+0 (secure 0 0 0) 0x7fbd7809aa90 con 0x7fbd80160790 2024-09-17T01:49:15.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.952+0000 7fbd7de00640 1 --2- 172.21.15.42:0/3697768866 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd60078b90 0x7fbd6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:15.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.953+0000 7fbd7de00640 1 --2- 172.21.15.42:0/3697768866 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd60078b90 0x7fbd6007b0a0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fbd70033000 tx=0x7fbd70004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:15.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:15.956+0000 7fbd76000640 1 -- 172.21.15.42:0/3697768866 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbd801f8d60 con 0x7fbd80160790 2024-09-17T01:49:16.185 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.187+0000 7fbd85200640 1 -- 172.21.15.42:0/3697768866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fbd8006f440 con 0x7fbd80160790 2024-09-17T01:49:16.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.666+0000 7fbd76000640 1 -- 172.21.15.42:0/3697768866 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 32 and data pool 33 v173) ==== 174+0+0 (secure 0 0 0) 0x7fbd78062fb0 con 0x7fbd80160790 2024-09-17T01:49:16.665 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 32 and data pool 33 2024-09-17T01:49:16.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.670+0000 7fbd85200640 1 -- 172.21.15.42:0/3697768866 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd60078b90 msgr2=0x7fbd6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:16.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.670+0000 7fbd85200640 1 --2- 172.21.15.42:0/3697768866 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd60078b90 0x7fbd6007b0a0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fbd70033000 tx=0x7fbd70004730 comp rx=0 tx=0).stop 2024-09-17T01:49:16.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.670+0000 7fbd85200640 1 -- 172.21.15.42:0/3697768866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd80160790 msgr2=0x7fbd801f8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.670+0000 7fbd85200640 1 --2- 172.21.15.42:0/3697768866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd80160790 0x7fbd801f8820 secure :-1 s=READY pgs=2527 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800c6e0 tx=0x7fbd7800cba0 comp rx=0 tx=0).stop 2024-09-17T01:49:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.670+0000 7fbd85200640 1 -- 172.21.15.42:0/3697768866 shutdown_connections 2024-09-17T01:49:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.670+0000 7fbd85200640 1 --2- 172.21.15.42:0/3697768866 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbd60078b90 0x7fbd6007b0a0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.670+0000 7fbd85200640 1 --2- 172.21.15.42:0/3697768866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd80160790 0x7fbd801f8820 unknown :-1 s=CLOSED pgs=2527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.670+0000 7fbd85200640 1 --2- 172.21.15.42:0/3697768866 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbd8015dcf0 0x7fbd801386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.670+0000 7fbd85200640 1 --2- 172.21.15.42:0/3697768866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbd800cd620 0x7fbd800b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.670+0000 7fbd85200640 1 -- 172.21.15.42:0/3697768866 >> 172.21.15.42:0/3697768866 conn(0x7fbd8006d1b0 msgr2=0x7fbd8015e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.670+0000 7fbd85200640 1 -- 172.21.15.42:0/3697768866 shutdown_connections 2024-09-17T01:49:16.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.671+0000 7fbd85200640 1 -- 172.21.15.42:0/3697768866 wait complete. 2024-09-17T01:49:16.718 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:49:16.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.949+0000 7f8cc8c00640 1 -- 172.21.15.42:0/2264728208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ca8005300 msgr2=0x7f8ca800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:16.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.949+0000 7f8cc8c00640 1 --2- 172.21.15.42:0/2264728208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ca8005300 0x7f8ca800b9c0 secure :-1 s=READY pgs=2529 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc00c610 tx=0x7f8ca8005830 comp rx=0 tx=0).stop 2024-09-17T01:49:16.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.949+0000 7f8cc8c00640 1 -- 172.21.15.42:0/2264728208 shutdown_connections 2024-09-17T01:49:16.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.949+0000 7f8cc8c00640 1 --2- 172.21.15.42:0/2264728208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8ca8005300 0x7f8ca800b9c0 unknown :-1 s=CLOSED pgs=2529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:16.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.949+0000 7f8cc8c00640 1 -- 172.21.15.42:0/2264728208 >> 172.21.15.42:0/2264728208 conn(0x7f8cc406d3f0 msgr2=0x7f8cc40b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:16.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.949+0000 7f8cc8c00640 1 -- 172.21.15.42:0/2264728208 shutdown_connections 2024-09-17T01:49:16.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.949+0000 7f8cc8c00640 1 -- 172.21.15.42:0/2264728208 wait complete. 2024-09-17T01:49:16.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.952+0000 7f8cc8c00640 1 Processor -- start 2024-09-17T01:49:16.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.952+0000 7f8cc8c00640 1 -- start start 2024-09-17T01:49:16.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.953+0000 7f8cc8c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ca8005300 0x7f8cc40b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:16.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.953+0000 7f8cc8c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cc40af2e0 0x7f8cc4155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:16.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.953+0000 7f8cc8c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cc41f8c40 0x7f8cc4158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:16.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.953+0000 7f8cc8c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc40cf480 con 0x7f8cc40af2e0 2024-09-17T01:49:16.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.953+0000 7f8cc8c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc406fca0 con 0x7f8ca8005300 2024-09-17T01:49:16.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.953+0000 7f8cc8c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8cc40cf600 con 0x7f8cc41f8c40 2024-09-17T01:49:16.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.954+0000 7f8cc2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cc40af2e0 0x7f8cc4155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:16.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.954+0000 7f8cc2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cc40af2e0 0x7f8cc4155c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41492/0 (socket says 172.21.15.42:41492) 2024-09-17T01:49:16.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.954+0000 7f8cc2a00640 1 -- 172.21.15.42:0/4248499365 learned_addr learned my addr 172.21.15.42:0/4248499365 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:16.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.954+0000 7f8cc3e00640 1 --2- 172.21.15.42:0/4248499365 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cc41f8c40 0x7f8cc4158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:16.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.954+0000 7f8cc3400640 1 --2- 172.21.15.42:0/4248499365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ca8005300 0x7f8cc40b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:16.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.954+0000 7f8cc2a00640 1 -- 172.21.15.42:0/4248499365 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cc41f8c40 msgr2=0x7f8cc4158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:16.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.954+0000 7f8cc2a00640 1 --2- 172.21.15.42:0/4248499365 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cc41f8c40 0x7f8cc4158640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:16.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.954+0000 7f8cc2a00640 1 -- 172.21.15.42:0/4248499365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ca8005300 msgr2=0x7f8cc40b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:16.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.954+0000 7f8cc2a00640 1 --2- 172.21.15.42:0/4248499365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ca8005300 0x7f8cc40b0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:16.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.954+0000 7f8cc2a00640 1 -- 172.21.15.42:0/4248499365 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc40b06a0 con 0x7f8cc40af2e0 2024-09-17T01:49:16.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.954+0000 7f8cc3400640 1 --2- 172.21.15.42:0/4248499365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ca8005300 0x7f8cc40b0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:49:16.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.954+0000 7f8cc3e00640 1 --2- 172.21.15.42:0/4248499365 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cc41f8c40 0x7f8cc4158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:49:16.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.954+0000 7f8cc2a00640 1 --2- 172.21.15.42:0/4248499365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cc40af2e0 0x7f8cc4155c20 secure :-1 s=READY pgs=2530 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0003f00 tx=0x7f8cb0001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:16.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.955+0000 7f8cbb400640 1 -- 172.21.15.42:0/4248499365 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0011640 con 0x7f8cc40af2e0 2024-09-17T01:49:16.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.955+0000 7f8cbb400640 1 -- 172.21.15.42:0/4248499365 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8cb0016020 con 0x7f8cc40af2e0 2024-09-17T01:49:16.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.955+0000 7f8cc8c00640 1 -- 172.21.15.42:0/4248499365 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cc4073340 con 0x7f8cc40af2e0 2024-09-17T01:49:16.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.955+0000 7f8cbb400640 1 -- 172.21.15.42:0/4248499365 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0011a60 con 0x7f8cc40af2e0 2024-09-17T01:49:16.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.955+0000 7f8cc8c00640 1 -- 172.21.15.42:0/4248499365 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cc4156160 con 0x7f8cc40af2e0 2024-09-17T01:49:16.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.956+0000 7f8cc8c00640 1 -- 172.21.15.42:0/4248499365 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cc4076590 con 0x7f8cc40af2e0 2024-09-17T01:49:16.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.957+0000 7f8cbb400640 1 -- 172.21.15.42:0/4248499365 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8cb0011c00 con 0x7f8cc40af2e0 2024-09-17T01:49:16.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.958+0000 7f8cbb400640 1 --2- 172.21.15.42:0/4248499365 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ca4078bc0 0x7f8ca407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:16.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.958+0000 7f8cbb400640 1 -- 172.21.15.42:0/4248499365 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(225..225 src has 1..225) ==== 5709+0+0 (secure 0 0 0) 0x7f8cb009b980 con 0x7f8cc40af2e0 2024-09-17T01:49:16.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.959+0000 7f8cc3400640 1 --2- 172.21.15.42:0/4248499365 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ca4078bc0 0x7f8ca407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:16.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.960+0000 7f8cc3400640 1 --2- 172.21.15.42:0/4248499365 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ca4078bc0 0x7f8ca407b0d0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4005fd0 tx=0x7f8cb400d550 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:16.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:16.963+0000 7f8cbb400640 1 -- 172.21.15.42:0/4248499365 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8cc4076590 con 0x7f8cc40af2e0 2024-09-17T01:49:17.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.157+0000 7f8cc8c00640 1 -- 172.21.15.42:0/4248499365 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8cc40cfb10 con 0x7f8cc40af2e0 2024-09-17T01:49:17.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.158+0000 7f8cbb400640 1 -- 172.21.15.42:0/4248499365 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v225) ==== 74+0+16648 (secure 0 0 0) 0x7f8cb0020020 con 0x7f8cc40af2e0 2024-09-17T01:49:17.157 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:17.157 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":225,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:49:16.188431+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":33,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":32,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:49:14.130558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"225","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":33,"pool_name":"cephfs_data","create_time":"2024-09-17T01:49:15.152992+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"225","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:49:17.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.160+0000 7f8cc8c00640 1 -- 172.21.15.42:0/4248499365 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ca4078bc0 msgr2=0x7f8ca407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:17.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.160+0000 7f8cc8c00640 1 --2- 172.21.15.42:0/4248499365 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ca4078bc0 0x7f8ca407b0d0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4005fd0 tx=0x7f8cb400d550 comp rx=0 tx=0).stop 2024-09-17T01:49:17.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.160+0000 7f8cc8c00640 1 -- 172.21.15.42:0/4248499365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cc40af2e0 msgr2=0x7f8cc4155c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:17.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.160+0000 7f8cc8c00640 1 --2- 172.21.15.42:0/4248499365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cc40af2e0 0x7f8cc4155c20 secure :-1 s=READY pgs=2530 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0003f00 tx=0x7f8cb0001630 comp rx=0 tx=0).stop 2024-09-17T01:49:17.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.161+0000 7f8cc8c00640 1 -- 172.21.15.42:0/4248499365 shutdown_connections 2024-09-17T01:49:17.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.161+0000 7f8cc8c00640 1 --2- 172.21.15.42:0/4248499365 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8ca4078bc0 0x7f8ca407b0d0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:17.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.161+0000 7f8cc8c00640 1 --2- 172.21.15.42:0/4248499365 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8cc41f8c40 0x7f8cc4158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:17.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.161+0000 7f8cc8c00640 1 --2- 172.21.15.42:0/4248499365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8cc40af2e0 0x7f8cc4155c20 unknown :-1 s=CLOSED pgs=2530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:17.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.161+0000 7f8cc8c00640 1 --2- 172.21.15.42:0/4248499365 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ca8005300 0x7f8cc40b0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:17.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.161+0000 7f8cc8c00640 1 -- 172.21.15.42:0/4248499365 >> 172.21.15.42:0/4248499365 conn(0x7f8cc406d3f0 msgr2=0x7f8cc415a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:17.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.161+0000 7f8cc8c00640 1 -- 172.21.15.42:0/4248499365 shutdown_connections 2024-09-17T01:49:17.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.161+0000 7f8cc8c00640 1 -- 172.21.15.42:0/4248499365 wait complete. 2024-09-17T01:49:17.182 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:49:17.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.412+0000 7f0625c00640 1 -- 172.21.15.42:0/2968796388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0620069410 msgr2=0x7f06200ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:17.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.412+0000 7f0625c00640 1 --2- 172.21.15.42:0/2968796388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0620069410 0x7f06200ce020 secure :-1 s=READY pgs=2532 cs=0 l=1 rev1=1 crypto rx=0x7f06200cf090 tx=0x7f060802a540 comp rx=0 tx=0).stop 2024-09-17T01:49:17.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.412+0000 7f0625c00640 1 -- 172.21.15.42:0/2968796388 shutdown_connections 2024-09-17T01:49:17.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.412+0000 7f0625c00640 1 --2- 172.21.15.42:0/2968796388 >> v2:172.21.15.43:3300/0 conn(0x7f062015ca30 0x7f062006f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:17.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.412+0000 7f0625c00640 1 --2- 172.21.15.42:0/2968796388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0620069410 0x7f06200ce020 unknown :-1 s=CLOSED pgs=2532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:17.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.412+0000 7f0625c00640 1 -- 172.21.15.42:0/2968796388 >> 172.21.15.42:0/2968796388 conn(0x7f06200d1580 msgr2=0x7f06200d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:17.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.412+0000 7f0625c00640 1 -- 172.21.15.42:0/2968796388 shutdown_connections 2024-09-17T01:49:17.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.412+0000 7f0625c00640 1 -- 172.21.15.42:0/2968796388 wait complete. 2024-09-17T01:49:17.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.414+0000 7f0625c00640 1 Processor -- start 2024-09-17T01:49:17.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.415+0000 7f0625c00640 1 -- start start 2024-09-17T01:49:17.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.416+0000 7f0625c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0620071040 0x7f0620150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:17.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.416+0000 7f0625c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f062015ca30 0x7f062014db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:17.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.416+0000 7f0625c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06201f6290 0x7f06201f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:17.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.416+0000 7f0625c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f062006fb30 con 0x7f06201f6290 2024-09-17T01:49:17.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.416+0000 7f0625c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f062006f9b0 con 0x7f0620071040 2024-09-17T01:49:17.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.416+0000 7f0625c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f062006fcb0 con 0x7f062015ca30 2024-09-17T01:49:17.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.416+0000 7f0625200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06201f6290 0x7f06201f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:17.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.416+0000 7f0625200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06201f6290 0x7f06201f5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41496/0 (socket says 172.21.15.42:41496) 2024-09-17T01:49:17.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.416+0000 7f0625200640 1 -- 172.21.15.42:0/41607316 learned_addr learned my addr 172.21.15.42:0/41607316 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:17.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.417+0000 7f061fe00640 1 --2- 172.21.15.42:0/41607316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0620071040 0x7f0620150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:17.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.417+0000 7f0617e00640 1 --2- 172.21.15.42:0/41607316 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f062015ca30 0x7f062014db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.417+0000 7f0625200640 1 -- 172.21.15.42:0/41607316 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f062015ca30 msgr2=0x7f062014db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.417+0000 7f0625200640 1 --2- 172.21.15.42:0/41607316 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f062015ca30 0x7f062014db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.417+0000 7f0625200640 1 -- 172.21.15.42:0/41607316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0620071040 msgr2=0x7f0620150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.417+0000 7f0625200640 1 --2- 172.21.15.42:0/41607316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0620071040 0x7f0620150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.417+0000 7f0625200640 1 -- 172.21.15.42:0/41607316 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0620150da0 con 0x7f06201f6290 2024-09-17T01:49:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.417+0000 7f0625200640 1 --2- 172.21.15.42:0/41607316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06201f6290 0x7f06201f5680 secure :-1 s=READY pgs=2533 cs=0 l=1 rev1=1 crypto rx=0x7f061800e960 tx=0x7f061800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:17.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.418+0000 7f061cc00640 1 -- 172.21.15.42:0/41607316 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0618004d20 con 0x7f06201f6290 2024-09-17T01:49:17.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.418+0000 7f061cc00640 1 -- 172.21.15.42:0/41607316 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f061800cac0 con 0x7f06201f6290 2024-09-17T01:49:17.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.418+0000 7f0625c00640 1 -- 172.21.15.42:0/41607316 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0620151080 con 0x7f06201f6290 2024-09-17T01:49:17.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.418+0000 7f061cc00640 1 -- 172.21.15.42:0/41607316 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0618005020 con 0x7f06201f6290 2024-09-17T01:49:17.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.418+0000 7f0625c00640 1 -- 172.21.15.42:0/41607316 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06200ccac0 con 0x7f06201f6290 2024-09-17T01:49:17.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.419+0000 7f0625c00640 1 -- 172.21.15.42:0/41607316 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f062015cee0 con 0x7f06201f6290 2024-09-17T01:49:17.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.421+0000 7f061cc00640 1 -- 172.21.15.42:0/41607316 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f06180051c0 con 0x7f06201f6290 2024-09-17T01:49:17.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.422+0000 7f061cc00640 1 --2- 172.21.15.42:0/41607316 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f05fc078bc0 0x7f05fc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:17.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.422+0000 7f061cc00640 1 -- 172.21.15.42:0/41607316 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(225..225 src has 1..225) ==== 5709+0+0 (secure 0 0 0) 0x7f061809b970 con 0x7f06201f6290 2024-09-17T01:49:17.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.423+0000 7f061fe00640 1 --2- 172.21.15.42:0/41607316 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f05fc078bc0 0x7f05fc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:17.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.424+0000 7f061fe00640 1 --2- 172.21.15.42:0/41607316 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f05fc078bc0 0x7f05fc07b0d0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f0610001720 tx=0x7f0610007e90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:17.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.426+0000 7f061cc00640 1 -- 172.21.15.42:0/41607316 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f062015cee0 con 0x7f06201f6290 2024-09-17T01:49:17.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.623+0000 7f0625c00640 1 -- 172.21.15.42:0/41607316 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0620150b30 con 0x7f06201f6290 2024-09-17T01:49:17.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.624+0000 7f061cc00640 1 -- 172.21.15.42:0/41607316 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v225) ==== 74+0+16648 (secure 0 0 0) 0x7f0618016030 con 0x7f06201f6290 2024-09-17T01:49:17.622 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:17.622 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":225,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:49:16.188431+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":33,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":32,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:49:14.130558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"225","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":33,"pool_name":"cephfs_data","create_time":"2024-09-17T01:49:15.152992+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"225","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:49:17.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.627+0000 7f0625c00640 1 -- 172.21.15.42:0/41607316 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f05fc078bc0 msgr2=0x7f05fc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:17.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.627+0000 7f0625c00640 1 --2- 172.21.15.42:0/41607316 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f05fc078bc0 0x7f05fc07b0d0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f0610001720 tx=0x7f0610007e90 comp rx=0 tx=0).stop 2024-09-17T01:49:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.627+0000 7f0625c00640 1 -- 172.21.15.42:0/41607316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06201f6290 msgr2=0x7f06201f5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.627+0000 7f0625c00640 1 --2- 172.21.15.42:0/41607316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06201f6290 0x7f06201f5680 secure :-1 s=READY pgs=2533 cs=0 l=1 rev1=1 crypto rx=0x7f061800e960 tx=0x7f061800ee20 comp rx=0 tx=0).stop 2024-09-17T01:49:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.627+0000 7f0625c00640 1 -- 172.21.15.42:0/41607316 shutdown_connections 2024-09-17T01:49:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.627+0000 7f0625c00640 1 --2- 172.21.15.42:0/41607316 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f05fc078bc0 0x7f05fc07b0d0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.627+0000 7f0625c00640 1 --2- 172.21.15.42:0/41607316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f06201f6290 0x7f06201f5680 unknown :-1 s=CLOSED pgs=2533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.627+0000 7f0625c00640 1 --2- 172.21.15.42:0/41607316 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f062015ca30 0x7f062014db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.627+0000 7f0625c00640 1 --2- 172.21.15.42:0/41607316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0620071040 0x7f0620150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:17.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.627+0000 7f0625c00640 1 -- 172.21.15.42:0/41607316 >> 172.21.15.42:0/41607316 conn(0x7f06200d1580 msgr2=0x7f06200b2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:17.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.627+0000 7f0625c00640 1 -- 172.21.15.42:0/41607316 shutdown_connections 2024-09-17T01:49:17.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.627+0000 7f0625c00640 1 -- 172.21.15.42:0/41607316 wait complete. 2024-09-17T01:49:17.650 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T01:49:17.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.889+0000 7f4b0d200640 1 -- 172.21.15.42:0/3868798978 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4b080b4d40 msgr2=0x7f4b080d0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:17.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.889+0000 7f4b0d200640 1 --2- 172.21.15.42:0/3868798978 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4b080b4d40 0x7f4b080d0d90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4af0005fd0 tx=0x7f4af002a5d0 comp rx=0 tx=0).stop 2024-09-17T01:49:17.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.890+0000 7f4b0d200640 1 -- 172.21.15.42:0/3868798978 shutdown_connections 2024-09-17T01:49:17.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.890+0000 7f4b0d200640 1 --2- 172.21.15.42:0/3868798978 >> v2:172.21.15.43:3300/0 conn(0x7f4b080d12d0 0x7f4b080cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:17.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.890+0000 7f4b0d200640 1 --2- 172.21.15.42:0/3868798978 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4b080b4d40 0x7f4b080d0d90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:17.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.890+0000 7f4b0d200640 1 -- 172.21.15.42:0/3868798978 >> 172.21.15.42:0/3868798978 conn(0x7f4b080b4220 msgr2=0x7f4b080b4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:17.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.890+0000 7f4b0d200640 1 -- 172.21.15.42:0/3868798978 shutdown_connections 2024-09-17T01:49:17.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.890+0000 7f4b0d200640 1 -- 172.21.15.42:0/3868798978 wait complete. 2024-09-17T01:49:17.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.892+0000 7f4b0d200640 1 Processor -- start 2024-09-17T01:49:17.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.892+0000 7f4b0d200640 1 -- start start 2024-09-17T01:49:17.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.893+0000 7f4b0d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b080b4d40 0x7f4b08157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:17.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.893+0000 7f4b0d200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4b080d12d0 0x7f4b081f9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:17.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.894+0000 7f4b07400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b080b4d40 0x7f4b08157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:17.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.894+0000 7f4b07400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b080b4d40 0x7f4b08157a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41512/0 (socket says 172.21.15.42:41512) 2024-09-17T01:49:17.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.894+0000 7f4affe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4b080d12d0 0x7f4b081f9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:17.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.894+0000 7f4affe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4b080d12d0 0x7f4b081f9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:39438/0 (socket says 172.21.15.42:39438) 2024-09-17T01:49:17.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.894+0000 7f4b0d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b0815ccd0 0x7f4b081f96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:17.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.894+0000 7f4b0d200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4b080cdf00 con 0x7f4b080b4d40 2024-09-17T01:49:17.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.894+0000 7f4b0d200640 1 -- 172.21.15.42:0/2126584374 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f4b080cdd80 con 0x7f4b0815ccd0 2024-09-17T01:49:17.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.894+0000 7f4b07400640 1 -- 172.21.15.42:0/2126584374 learned_addr learned my addr 172.21.15.42:0/2126584374 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:17.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.894+0000 7f4b0d200640 1 -- 172.21.15.42:0/2126584374 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f4b080ce080 con 0x7f4b080d12d0 2024-09-17T01:49:17.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.894+0000 7f4b07e00640 1 --2- 172.21.15.42:0/2126584374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b0815ccd0 0x7f4b081f96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:17.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.894+0000 7f4affe00640 1 -- 172.21.15.42:0/2126584374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b0815ccd0 msgr2=0x7f4b081f96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:17.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.895+0000 7f4affe00640 1 --2- 172.21.15.42:0/2126584374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b0815ccd0 0x7f4b081f96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:17.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.895+0000 7f4affe00640 1 -- 172.21.15.42:0/2126584374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b080b4d40 msgr2=0x7f4b08157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:17.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.895+0000 7f4affe00640 1 --2- 172.21.15.42:0/2126584374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b080b4d40 0x7f4b08157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:17.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.895+0000 7f4affe00640 1 -- 172.21.15.42:0/2126584374 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b080cc320 con 0x7f4b080d12d0 2024-09-17T01:49:17.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.895+0000 7f4b07400640 1 --2- 172.21.15.42:0/2126584374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b080b4d40 0x7f4b08157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:49:17.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.895+0000 7f4affe00640 1 --2- 172.21.15.42:0/2126584374 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4b080d12d0 0x7f4b081f9160 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4af0031000 tx=0x7f4af0005750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:17.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.895+0000 7f4aff400640 1 -- 172.21.15.42:0/2126584374 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af003e030 con 0x7f4b080d12d0 2024-09-17T01:49:17.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.895+0000 7f4aff400640 1 -- 172.21.15.42:0/2126584374 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4af0003a70 con 0x7f4b080d12d0 2024-09-17T01:49:17.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.895+0000 7f4b0d200640 1 -- 172.21.15.42:0/2126584374 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b080b70b0 con 0x7f4b080d12d0 2024-09-17T01:49:17.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.895+0000 7f4aff400640 1 -- 172.21.15.42:0/2126584374 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af0035040 con 0x7f4b080d12d0 2024-09-17T01:49:17.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.895+0000 7f4b0d200640 1 -- 172.21.15.42:0/2126584374 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b080b7320 con 0x7f4b080d12d0 2024-09-17T01:49:17.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.896+0000 7f4b0d200640 1 -- 172.21.15.42:0/2126584374 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b080ce530 con 0x7f4b080d12d0 2024-09-17T01:49:17.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.898+0000 7f4aff400640 1 -- 172.21.15.42:0/2126584374 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4af0041030 con 0x7f4b080d12d0 2024-09-17T01:49:17.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.899+0000 7f4aff400640 1 --2- 172.21.15.42:0/2126584374 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4ae4078b90 0x7f4ae407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:17.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.899+0000 7f4aff400640 1 -- 172.21.15.42:0/2126584374 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(226..226 src has 1..226) ==== 5709+0+0 (secure 0 0 0) 0x7f4af00bb870 con 0x7f4b080d12d0 2024-09-17T01:49:17.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.899+0000 7f4b07400640 1 --2- 172.21.15.42:0/2126584374 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4ae4078b90 0x7f4ae407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:17.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.900+0000 7f4b07400640 1 --2- 172.21.15.42:0/2126584374 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4ae4078b90 0x7f4ae407b0a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f4af8001bd0 tx=0x7f4af8009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:17.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:17.902+0000 7f4aff400640 1 -- 172.21.15.42:0/2126584374 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4af0083700 con 0x7f4b080d12d0 2024-09-17T01:49:18.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.137+0000 7f4b0d200640 1 -- 172.21.15.42:0/2126584374 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4b080cd650 con 0x7f4b080d12d0 2024-09-17T01:49:18.647 INFO:tasks.ceph.mds.b.smithi043.stderr:2024-09-17T01:49:18.649+0000 7f52a1800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:49:18.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.696+0000 7f4aff400640 1 -- 172.21.15.42:0/2126584374 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v176) ==== 118+0+0 (secure 0 0 0) 0x7f4af0088130 con 0x7f4b080d12d0 2024-09-17T01:49:18.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.699+0000 7f4b0d200640 1 -- 172.21.15.42:0/2126584374 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4ae4078b90 msgr2=0x7f4ae407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:18.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.699+0000 7f4b0d200640 1 --2- 172.21.15.42:0/2126584374 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4ae4078b90 0x7f4ae407b0a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f4af8001bd0 tx=0x7f4af8009040 comp rx=0 tx=0).stop 2024-09-17T01:49:18.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.699+0000 7f4b0d200640 1 -- 172.21.15.42:0/2126584374 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4b080d12d0 msgr2=0x7f4b081f9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:18.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.699+0000 7f4b0d200640 1 --2- 172.21.15.42:0/2126584374 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4b080d12d0 0x7f4b081f9160 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4af0031000 tx=0x7f4af0005750 comp rx=0 tx=0).stop 2024-09-17T01:49:18.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.699+0000 7f4b0d200640 1 -- 172.21.15.42:0/2126584374 shutdown_connections 2024-09-17T01:49:18.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.699+0000 7f4b0d200640 1 --2- 172.21.15.42:0/2126584374 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f4ae4078b90 0x7f4ae407b0a0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:18.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.699+0000 7f4b0d200640 1 --2- 172.21.15.42:0/2126584374 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b0815ccd0 0x7f4b081f96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:18.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.699+0000 7f4b0d200640 1 --2- 172.21.15.42:0/2126584374 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f4b080d12d0 0x7f4b081f9160 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:18.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.699+0000 7f4b0d200640 1 --2- 172.21.15.42:0/2126584374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4b080b4d40 0x7f4b08157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:18.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.699+0000 7f4b0d200640 1 -- 172.21.15.42:0/2126584374 >> 172.21.15.42:0/2126584374 conn(0x7f4b080b4220 msgr2=0x7f4b0815c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:18.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.699+0000 7f4b0d200640 1 -- 172.21.15.42:0/2126584374 shutdown_connections 2024-09-17T01:49:18.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.700+0000 7f4b0d200640 1 -- 172.21.15.42:0/2126584374 wait complete. 2024-09-17T01:49:18.723 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T01:49:18.723 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T01:49:18.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.957+0000 7fbbcb400640 1 -- 172.21.15.42:0/2819778109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbc4072b60 msgr2=0x7fbbc40cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:18.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.957+0000 7fbbcb400640 1 --2- 172.21.15.42:0/2819778109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbc4072b60 0x7fbbc40cd620 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009860 tx=0x7fbbb002a540 comp rx=0 tx=0).stop 2024-09-17T01:49:18.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.957+0000 7fbbcb400640 1 -- 172.21.15.42:0/2819778109 shutdown_connections 2024-09-17T01:49:18.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.957+0000 7fbbcb400640 1 --2- 172.21.15.42:0/2819778109 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbbc40cdb60 0x7fbbc406e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:18.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.957+0000 7fbbcb400640 1 --2- 172.21.15.42:0/2819778109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbc4072b60 0x7fbbc40cd620 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:18.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.957+0000 7fbbcb400640 1 -- 172.21.15.42:0/2819778109 >> 172.21.15.42:0/2819778109 conn(0x7fbbc406d1b0 msgr2=0x7fbbc406d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:18.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.957+0000 7fbbcb400640 1 -- 172.21.15.42:0/2819778109 shutdown_connections 2024-09-17T01:49:18.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.957+0000 7fbbcb400640 1 -- 172.21.15.42:0/2819778109 wait complete. 2024-09-17T01:49:18.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.959+0000 7fbbcb400640 1 Processor -- start 2024-09-17T01:49:18.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.959+0000 7fbbcb400640 1 -- start start 2024-09-17T01:49:18.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.961+0000 7fbbcb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbc4072b60 0x7fbbc4150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:18.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.961+0000 7fbbcb400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbc40cdb60 0x7fbbc40b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:18.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.961+0000 7fbbcb400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbbc415dcf0 0x7fbbc40ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:18.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.961+0000 7fbbcb400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc406ef00 con 0x7fbbc4072b60 2024-09-17T01:49:18.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.961+0000 7fbbcb400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc41610b0 con 0x7fbbc40cdb60 2024-09-17T01:49:18.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.961+0000 7fbbcb400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc406f080 con 0x7fbbc415dcf0 2024-09-17T01:49:18.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.961+0000 7fbbc8a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbc4072b60 0x7fbbc4150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:18.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.961+0000 7fbbc8a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbc4072b60 0x7fbbc4150920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41528/0 (socket says 172.21.15.42:41528) 2024-09-17T01:49:18.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.961+0000 7fbbc8a00640 1 -- 172.21.15.42:0/4122241331 learned_addr learned my addr 172.21.15.42:0/4122241331 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:18.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.961+0000 7fbbc3e00640 1 --2- 172.21.15.42:0/4122241331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbc40cdb60 0x7fbbc40b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:18.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.961+0000 7fbbc9400640 1 --2- 172.21.15.42:0/4122241331 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbbc415dcf0 0x7fbbc40ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:18.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.962+0000 7fbbc8a00640 1 -- 172.21.15.42:0/4122241331 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbbc415dcf0 msgr2=0x7fbbc40ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:18.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.962+0000 7fbbc8a00640 1 --2- 172.21.15.42:0/4122241331 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbbc415dcf0 0x7fbbc40ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:18.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.962+0000 7fbbc8a00640 1 -- 172.21.15.42:0/4122241331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbc40cdb60 msgr2=0x7fbbc40b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:18.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.962+0000 7fbbc8a00640 1 --2- 172.21.15.42:0/4122241331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbc40cdb60 0x7fbbc40b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:18.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.962+0000 7fbbc8a00640 1 -- 172.21.15.42:0/4122241331 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc41f9710 con 0x7fbbc4072b60 2024-09-17T01:49:18.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.962+0000 7fbbc8a00640 1 --2- 172.21.15.42:0/4122241331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbc4072b60 0x7fbbc4150920 secure :-1 s=READY pgs=2534 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800c390 tx=0x7fbbb800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:18.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.962+0000 7fbbc0c00640 1 -- 172.21.15.42:0/4122241331 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8017070 con 0x7fbbc4072b60 2024-09-17T01:49:18.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.962+0000 7fbbc0c00640 1 -- 172.21.15.42:0/4122241331 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbbb80035f0 con 0x7fbbc4072b60 2024-09-17T01:49:18.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.963+0000 7fbbcb400640 1 -- 172.21.15.42:0/4122241331 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc41f99f0 con 0x7fbbc4072b60 2024-09-17T01:49:18.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.963+0000 7fbbc0c00640 1 -- 172.21.15.42:0/4122241331 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8003a20 con 0x7fbbc4072b60 2024-09-17T01:49:18.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.963+0000 7fbbcb400640 1 -- 172.21.15.42:0/4122241331 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbc41f9fb0 con 0x7fbbc4072b60 2024-09-17T01:49:18.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.964+0000 7fbbcb400640 1 -- 172.21.15.42:0/4122241331 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbc41fa590 con 0x7fbbc4072b60 2024-09-17T01:49:18.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.965+0000 7fbbc0c00640 1 -- 172.21.15.42:0/4122241331 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbbb801a070 con 0x7fbbc4072b60 2024-09-17T01:49:18.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.966+0000 7fbbc0c00640 1 --2- 172.21.15.42:0/4122241331 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbba4078b90 0x7fbba407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:18.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.966+0000 7fbbc0c00640 1 -- 172.21.15.42:0/4122241331 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 5709+0+0 (secure 0 0 0) 0x7fbbb8099fb0 con 0x7fbbc4072b60 2024-09-17T01:49:18.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.967+0000 7fbbc3e00640 1 --2- 172.21.15.42:0/4122241331 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbba4078b90 0x7fbba407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:18.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.967+0000 7fbbc3e00640 1 --2- 172.21.15.42:0/4122241331 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbba4078b90 0x7fbba407b0a0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0034000 tx=0x7fbbb0004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:18.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:18.971+0000 7fbbc0c00640 1 -- 172.21.15.42:0/4122241331 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbbc41fa590 con 0x7fbbc4072b60 2024-09-17T01:49:19.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.206+0000 7fbbcb400640 1 -- 172.21.15.42:0/4122241331 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fbbc4154140 con 0x7fbbc4072b60 2024-09-17T01:49:19.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.700+0000 7fbbc0c00640 1 -- 172.21.15.42:0/4122241331 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v177) ==== 122+0+0 (secure 0 0 0) 0x7fbbc4154140 con 0x7fbbc4072b60 2024-09-17T01:49:19.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.702+0000 7fbbcb400640 1 -- 172.21.15.42:0/4122241331 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbba4078b90 msgr2=0x7fbba407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:19.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.702+0000 7fbbcb400640 1 --2- 172.21.15.42:0/4122241331 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbba4078b90 0x7fbba407b0a0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0034000 tx=0x7fbbb0004730 comp rx=0 tx=0).stop 2024-09-17T01:49:19.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.702+0000 7fbbcb400640 1 -- 172.21.15.42:0/4122241331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbc4072b60 msgr2=0x7fbbc4150920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:19.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.702+0000 7fbbcb400640 1 --2- 172.21.15.42:0/4122241331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbc4072b60 0x7fbbc4150920 secure :-1 s=READY pgs=2534 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800c390 tx=0x7fbbb800c850 comp rx=0 tx=0).stop 2024-09-17T01:49:19.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.703+0000 7fbbcb400640 1 -- 172.21.15.42:0/4122241331 shutdown_connections 2024-09-17T01:49:19.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.703+0000 7fbbcb400640 1 --2- 172.21.15.42:0/4122241331 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbba4078b90 0x7fbba407b0a0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:19.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.703+0000 7fbbcb400640 1 --2- 172.21.15.42:0/4122241331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbc40cdb60 0x7fbbc40b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:19.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.703+0000 7fbbcb400640 1 --2- 172.21.15.42:0/4122241331 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbbc415dcf0 0x7fbbc40ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:19.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.703+0000 7fbbcb400640 1 --2- 172.21.15.42:0/4122241331 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbc4072b60 0x7fbbc4150920 unknown :-1 s=CLOSED pgs=2534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:19.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.703+0000 7fbbcb400640 1 -- 172.21.15.42:0/4122241331 >> 172.21.15.42:0/4122241331 conn(0x7fbbc406d1b0 msgr2=0x7fbbc4156da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:19.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.703+0000 7fbbcb400640 1 -- 172.21.15.42:0/4122241331 shutdown_connections 2024-09-17T01:49:19.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.703+0000 7fbbcb400640 1 -- 172.21.15.42:0/4122241331 wait complete. 2024-09-17T01:49:19.724 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T01:49:19.724 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:49:19.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.956+0000 7f75f5400640 1 -- 172.21.15.42:0/2315103042 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75f00b3520 msgr2=0x7f75f00b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:19.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.956+0000 7f75f5400640 1 --2- 172.21.15.42:0/2315103042 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75f00b3520 0x7f75f00b3930 secure :-1 s=READY pgs=2536 cs=0 l=1 rev1=1 crypto rx=0x7f75d8009830 tx=0x7f75d802a530 comp rx=0 tx=0).stop 2024-09-17T01:49:19.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.956+0000 7f75f5400640 1 -- 172.21.15.42:0/2315103042 shutdown_connections 2024-09-17T01:49:19.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.956+0000 7f75f5400640 1 --2- 172.21.15.42:0/2315103042 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75f00b3520 0x7f75f00b3930 unknown :-1 s=CLOSED pgs=2536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:19.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.956+0000 7f75f5400640 1 -- 172.21.15.42:0/2315103042 >> 172.21.15.42:0/2315103042 conn(0x7f75f006d3f0 msgr2=0x7f75f00b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:19.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.956+0000 7f75f5400640 1 -- 172.21.15.42:0/2315103042 shutdown_connections 2024-09-17T01:49:19.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.956+0000 7f75f5400640 1 -- 172.21.15.42:0/2315103042 wait complete. 2024-09-17T01:49:19.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.959+0000 7f75f5400640 1 Processor -- start 2024-09-17T01:49:19.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.959+0000 7f75f5400640 1 -- start start 2024-09-17T01:49:19.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.960+0000 7f75f5400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f75f00af970 0x7f75f01445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:19.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.960+0000 7f75f5400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75f00b3520 0x7f75f0143c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:19.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.960+0000 7f75f5400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f0160500 0x7f75f0149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:19.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.960+0000 7f75f5400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f75f00cf8b0 con 0x7f75f00b3520 2024-09-17T01:49:19.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.960+0000 7f75f5400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f75f00cf730 con 0x7f75f0160500 2024-09-17T01:49:19.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.960+0000 7f75f5400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f75f00cfa30 con 0x7f75f00af970 2024-09-17T01:49:19.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.960+0000 7f75e7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75f00b3520 0x7f75f0143c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:19.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.961+0000 7f75e7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75f00b3520 0x7f75f0143c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41540/0 (socket says 172.21.15.42:41540) 2024-09-17T01:49:19.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.961+0000 7f75e7400640 1 -- 172.21.15.42:0/1403279640 learned_addr learned my addr 172.21.15.42:0/1403279640 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:19.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.961+0000 7f75efe00640 1 --2- 172.21.15.42:0/1403279640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f75f00af970 0x7f75f01445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:19.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.961+0000 7f75f4a00640 1 --2- 172.21.15.42:0/1403279640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f0160500 0x7f75f0149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:19.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.961+0000 7f75e7400640 1 -- 172.21.15.42:0/1403279640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f75f00af970 msgr2=0x7f75f01445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:19.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.961+0000 7f75e7400640 1 --2- 172.21.15.42:0/1403279640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f75f00af970 0x7f75f01445b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:19.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.961+0000 7f75e7400640 1 -- 172.21.15.42:0/1403279640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f0160500 msgr2=0x7f75f0149b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:19.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.961+0000 7f75e7400640 1 --2- 172.21.15.42:0/1403279640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f0160500 0x7f75f0149b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:19.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.961+0000 7f75e7400640 1 -- 172.21.15.42:0/1403279640 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f0148ae0 con 0x7f75f00b3520 2024-09-17T01:49:19.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.961+0000 7f75e7400640 1 --2- 172.21.15.42:0/1403279640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75f00b3520 0x7f75f0143c70 secure :-1 s=READY pgs=2537 cs=0 l=1 rev1=1 crypto rx=0x7f75d802ab20 tx=0x7f75d8033c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:19.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.962+0000 7f75ecc00640 1 -- 172.21.15.42:0/1403279640 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d8031b60 con 0x7f75f00b3520 2024-09-17T01:49:19.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.962+0000 7f75ecc00640 1 -- 172.21.15.42:0/1403279640 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75d8031df0 con 0x7f75f00b3520 2024-09-17T01:49:19.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.962+0000 7f75ecc00640 1 -- 172.21.15.42:0/1403279640 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d8005280 con 0x7f75f00b3520 2024-09-17T01:49:19.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.962+0000 7f75f5400640 1 -- 172.21.15.42:0/1403279640 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75f0148dc0 con 0x7f75f00b3520 2024-09-17T01:49:19.961 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.962+0000 7f75f5400640 1 -- 172.21.15.42:0/1403279640 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75f0149380 con 0x7f75f00b3520 2024-09-17T01:49:19.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.963+0000 7f75f5400640 1 -- 172.21.15.42:0/1403279640 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75f00b3930 con 0x7f75f00b3520 2024-09-17T01:49:19.962 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.964+0000 7f75ecc00640 1 -- 172.21.15.42:0/1403279640 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f75d8005420 con 0x7f75f00b3520 2024-09-17T01:49:19.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.965+0000 7f75ecc00640 1 --2- 172.21.15.42:0/1403279640 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f75cc078b90 0x7f75cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:19.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.965+0000 7f75ecc00640 1 -- 172.21.15.42:0/1403279640 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 5709+0+0 (secure 0 0 0) 0x7f75d80bbf40 con 0x7f75f00b3520 2024-09-17T01:49:19.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.965+0000 7f75efe00640 1 --2- 172.21.15.42:0/1403279640 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f75cc078b90 0x7f75cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:19.964 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.966+0000 7f75efe00640 1 --2- 172.21.15.42:0/1403279640 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f75cc078b90 0x7f75cc07b0a0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f75e0000f60 tx=0x7f75e0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:19.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:19.970+0000 7f75ecc00640 1 -- 172.21.15.42:0/1403279640 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f75d803f030 con 0x7f75f00b3520 2024-09-17T01:49:20.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.199+0000 7f75f5400640 1 -- 172.21.15.42:0/1403279640 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75f00b2680 con 0x7f75f00b3520 2024-09-17T01:49:20.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.199+0000 7f75ecc00640 1 -- 172.21.15.42:0/1403279640 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 177 v177) ==== 95+0+5241 (secure 0 0 0) 0x7f75d8031770 con 0x7f75f00b3520 2024-09-17T01:49:20.198 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:20.198 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":177,"btime":"2024-09-17T01:49:19:694779+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":11511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1418140325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1418140325},{"type":"v1","addr":"172.21.15.42:6833","nonce":1418140325}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":171},{"gid":11514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2781042225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":2781042225},{"type":"v1","addr":"172.21.15.42:6835","nonce":2781042225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":172},{"gid":11517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4082001755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4082001755},{"type":"v1","addr":"172.21.15.43:6836","nonce":4082001755}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":172}],"filesystems":[{"mdsmap":{"epoch":177,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:49:16.188388+0000","modified":"2024-09-17T01:49:19.207517+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11520":{"gid":11520,"name":"b","rank":0,"incarnation":173,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/4233677817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":4233677817},{"type":"v1","addr":"172.21.15.43:6837","nonce":4233677817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11520,"qdb_cluster":[11520]},"id":16}]} 2024-09-17T01:49:20.198 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 177 2024-09-17T01:49:20.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.202+0000 7f75f5400640 1 -- 172.21.15.42:0/1403279640 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f75cc078b90 msgr2=0x7f75cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:20.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.202+0000 7f75f5400640 1 --2- 172.21.15.42:0/1403279640 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f75cc078b90 0x7f75cc07b0a0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f75e0000f60 tx=0x7f75e0009040 comp rx=0 tx=0).stop 2024-09-17T01:49:20.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.202+0000 7f75f5400640 1 -- 172.21.15.42:0/1403279640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75f00b3520 msgr2=0x7f75f0143c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:20.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.202+0000 7f75f5400640 1 --2- 172.21.15.42:0/1403279640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75f00b3520 0x7f75f0143c70 secure :-1 s=READY pgs=2537 cs=0 l=1 rev1=1 crypto rx=0x7f75d802ab20 tx=0x7f75d8033c10 comp rx=0 tx=0).stop 2024-09-17T01:49:20.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.202+0000 7f75f5400640 1 -- 172.21.15.42:0/1403279640 shutdown_connections 2024-09-17T01:49:20.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.202+0000 7f75f5400640 1 --2- 172.21.15.42:0/1403279640 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f75cc078b90 0x7f75cc07b0a0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:20.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.202+0000 7f75f5400640 1 --2- 172.21.15.42:0/1403279640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f0160500 0x7f75f0149b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:20.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.202+0000 7f75f5400640 1 --2- 172.21.15.42:0/1403279640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75f00b3520 0x7f75f0143c70 unknown :-1 s=CLOSED pgs=2537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:20.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.202+0000 7f75f5400640 1 --2- 172.21.15.42:0/1403279640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f75f00af970 0x7f75f01445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:20.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.202+0000 7f75f5400640 1 -- 172.21.15.42:0/1403279640 >> 172.21.15.42:0/1403279640 conn(0x7f75f006d3f0 msgr2=0x7f75f015e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:20.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.202+0000 7f75f5400640 1 -- 172.21.15.42:0/1403279640 shutdown_connections 2024-09-17T01:49:20.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.202+0000 7f75f5400640 1 -- 172.21.15.42:0/1403279640 wait complete. 2024-09-17T01:49:20.222 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:49:20.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.452+0000 7fa0d3e00640 1 -- 172.21.15.42:0/3736589966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0d4072b90 msgr2=0x7fa0d415bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:20.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.452+0000 7fa0d3e00640 1 --2- 172.21.15.42:0/3736589966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0d4072b90 0x7fa0d415bb60 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000a940 tx=0x7fa0c002b860 comp rx=0 tx=0).stop 2024-09-17T01:49:20.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.452+0000 7fa0d3e00640 1 -- 172.21.15.42:0/3736589966 shutdown_connections 2024-09-17T01:49:20.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.452+0000 7fa0d3e00640 1 --2- 172.21.15.42:0/3736589966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0d4072b90 0x7fa0d415bb60 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:20.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.452+0000 7fa0d3e00640 1 -- 172.21.15.42:0/3736589966 >> 172.21.15.42:0/3736589966 conn(0x7fa0d406d3f0 msgr2=0x7fa0d40b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:20.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.452+0000 7fa0d3e00640 1 -- 172.21.15.42:0/3736589966 shutdown_connections 2024-09-17T01:49:20.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.452+0000 7fa0d3e00640 1 -- 172.21.15.42:0/3736589966 wait complete. 2024-09-17T01:49:20.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.454+0000 7fa0d3e00640 1 Processor -- start 2024-09-17T01:49:20.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.454+0000 7fa0d3e00640 1 -- start start 2024-09-17T01:49:20.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.456+0000 7fa0d3e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0d406e4e0 0x7fa0d40b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:20.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.456+0000 7fa0d3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0d4151bb0 0x7fa0d41f8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:20.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.456+0000 7fa0d3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0d41f8ea0 0x7fa0d4152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:20.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.456+0000 7fa0d3e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d4070570 con 0x7fa0d4151bb0 2024-09-17T01:49:20.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.456+0000 7fa0d3e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d40cc920 con 0x7fa0d41f8ea0 2024-09-17T01:49:20.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.456+0000 7fa0d3e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa0d40706f0 con 0x7fa0d406e4e0 2024-09-17T01:49:20.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.456+0000 7fa0d2000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0d4151bb0 0x7fa0d41f8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:20.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.456+0000 7fa0d2000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0d4151bb0 0x7fa0d41f8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41554/0 (socket says 172.21.15.42:41554) 2024-09-17T01:49:20.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.456+0000 7fa0d2000640 1 -- 172.21.15.42:0/4087396447 learned_addr learned my addr 172.21.15.42:0/4087396447 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:20.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.456+0000 7fa0d2a00640 1 --2- 172.21.15.42:0/4087396447 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0d406e4e0 0x7fa0d40b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:20.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.456+0000 7fa0d3400640 1 --2- 172.21.15.42:0/4087396447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0d41f8ea0 0x7fa0d4152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:20.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.457+0000 7fa0d2000640 1 -- 172.21.15.42:0/4087396447 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0d406e4e0 msgr2=0x7fa0d40b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:20.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.457+0000 7fa0d2000640 1 --2- 172.21.15.42:0/4087396447 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0d406e4e0 0x7fa0d40b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:20.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.457+0000 7fa0d2000640 1 -- 172.21.15.42:0/4087396447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0d41f8ea0 msgr2=0x7fa0d4152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:20.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.457+0000 7fa0d2000640 1 --2- 172.21.15.42:0/4087396447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0d41f8ea0 0x7fa0d4152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:20.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.457+0000 7fa0d2000640 1 -- 172.21.15.42:0/4087396447 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0d40b0600 con 0x7fa0d4151bb0 2024-09-17T01:49:20.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.457+0000 7fa0d2000640 1 --2- 172.21.15.42:0/4087396447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0d4151bb0 0x7fa0d41f8960 secure :-1 s=READY pgs=2539 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000a890 tx=0x7fa0c0031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:20.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.457+0000 7fa0caa00640 1 -- 172.21.15.42:0/4087396447 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0005c90 con 0x7fa0d4151bb0 2024-09-17T01:49:20.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.457+0000 7fa0caa00640 1 -- 172.21.15.42:0/4087396447 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0c0005310 con 0x7fa0d4151bb0 2024-09-17T01:49:20.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.457+0000 7fa0caa00640 1 -- 172.21.15.42:0/4087396447 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0031e90 con 0x7fa0d4151bb0 2024-09-17T01:49:20.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.457+0000 7fa0d3e00640 1 -- 172.21.15.42:0/4087396447 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0d40b08e0 con 0x7fa0d4151bb0 2024-09-17T01:49:20.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.457+0000 7fa0d3e00640 1 -- 172.21.15.42:0/4087396447 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0d40b0ea0 con 0x7fa0d4151bb0 2024-09-17T01:49:20.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.458+0000 7fa0d3e00640 1 -- 172.21.15.42:0/4087396447 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0d40b0370 con 0x7fa0d4151bb0 2024-09-17T01:49:20.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.460+0000 7fa0caa00640 1 -- 172.21.15.42:0/4087396447 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa0c00047a0 con 0x7fa0d4151bb0 2024-09-17T01:49:20.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.461+0000 7fa0caa00640 1 --2- 172.21.15.42:0/4087396447 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa0b4078bf0 0x7fa0b407b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:20.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.461+0000 7fa0caa00640 1 -- 172.21.15.42:0/4087396447 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 5709+0+0 (secure 0 0 0) 0x7fa0c00bc090 con 0x7fa0d4151bb0 2024-09-17T01:49:20.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.461+0000 7fa0d2a00640 1 --2- 172.21.15.42:0/4087396447 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa0b4078bf0 0x7fa0b407b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:20.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.462+0000 7fa0d2a00640 1 --2- 172.21.15.42:0/4087396447 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa0b4078bf0 0x7fa0b407b100 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4001120 tx=0x7fa0c4009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:20.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.465+0000 7fa0caa00640 1 -- 172.21.15.42:0/4087396447 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa0c0083e70 con 0x7fa0d4151bb0 2024-09-17T01:49:20.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.662+0000 7fa0d3e00640 1 -- 172.21.15.42:0/4087396447 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa0d406f1c0 con 0x7fa0d4151bb0 2024-09-17T01:49:20.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.663+0000 7fa0caa00640 1 -- 172.21.15.42:0/4087396447 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v226) ==== 74+0+16635 (secure 0 0 0) 0x7fa0c00888a0 con 0x7fa0d4151bb0 2024-09-17T01:49:20.661 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:20.661 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":226,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:49:17.679249+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":33,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":32,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:49:14.130558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"225","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":33,"pool_name":"cephfs_data","create_time":"2024-09-17T01:49:15.152992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"226","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:49:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.665+0000 7fa0d3e00640 1 -- 172.21.15.42:0/4087396447 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa0b4078bf0 msgr2=0x7fa0b407b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.665+0000 7fa0d3e00640 1 --2- 172.21.15.42:0/4087396447 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa0b4078bf0 0x7fa0b407b100 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4001120 tx=0x7fa0c4009040 comp rx=0 tx=0).stop 2024-09-17T01:49:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.665+0000 7fa0d3e00640 1 -- 172.21.15.42:0/4087396447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0d4151bb0 msgr2=0x7fa0d41f8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.665+0000 7fa0d3e00640 1 --2- 172.21.15.42:0/4087396447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0d4151bb0 0x7fa0d41f8960 secure :-1 s=READY pgs=2539 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000a890 tx=0x7fa0c0031ca0 comp rx=0 tx=0).stop 2024-09-17T01:49:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.666+0000 7fa0d3e00640 1 -- 172.21.15.42:0/4087396447 shutdown_connections 2024-09-17T01:49:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.666+0000 7fa0d3e00640 1 --2- 172.21.15.42:0/4087396447 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa0b4078bf0 0x7fa0b407b100 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.666+0000 7fa0d3e00640 1 --2- 172.21.15.42:0/4087396447 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0d41f8ea0 0x7fa0d4152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.666+0000 7fa0d3e00640 1 --2- 172.21.15.42:0/4087396447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0d4151bb0 0x7fa0d41f8960 unknown :-1 s=CLOSED pgs=2539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.666+0000 7fa0d3e00640 1 --2- 172.21.15.42:0/4087396447 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa0d406e4e0 0x7fa0d40b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.666+0000 7fa0d3e00640 1 -- 172.21.15.42:0/4087396447 >> 172.21.15.42:0/4087396447 conn(0x7fa0d406d3f0 msgr2=0x7fa0d4150de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.666+0000 7fa0d3e00640 1 -- 172.21.15.42:0/4087396447 shutdown_connections 2024-09-17T01:49:20.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.666+0000 7fa0d3e00640 1 -- 172.21.15.42:0/4087396447 wait complete. 2024-09-17T01:49:20.686 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T01:49:20.686 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:49:20.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.916+0000 7f621b600640 1 -- 172.21.15.42:0/366199257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6214160790 msgr2=0x7f6214160ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:20.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.916+0000 7f621b600640 1 --2- 172.21.15.42:0/366199257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6214160790 0x7f6214160ba0 secure :-1 s=READY pgs=2540 cs=0 l=1 rev1=1 crypto rx=0x7f6214070bb0 tx=0x7f61fc02a560 comp rx=0 tx=0).stop 2024-09-17T01:49:20.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.917+0000 7f621b600640 1 -- 172.21.15.42:0/366199257 shutdown_connections 2024-09-17T01:49:20.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.917+0000 7f621b600640 1 --2- 172.21.15.42:0/366199257 >> v2:172.21.15.43:3300/0 conn(0x7f62140cd620 0x7f62140cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:20.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.917+0000 7f621b600640 1 --2- 172.21.15.42:0/366199257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6214160790 0x7f6214160ba0 unknown :-1 s=CLOSED pgs=2540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:20.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.917+0000 7f621b600640 1 --2- 172.21.15.42:0/366199257 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f621415dcf0 0x7f6214072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:20.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.917+0000 7f621b600640 1 -- 172.21.15.42:0/366199257 >> 172.21.15.42:0/366199257 conn(0x7f621406d1b0 msgr2=0x7f621406d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:20.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.917+0000 7f621b600640 1 -- 172.21.15.42:0/366199257 shutdown_connections 2024-09-17T01:49:20.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.917+0000 7f621b600640 1 -- 172.21.15.42:0/366199257 wait complete. 2024-09-17T01:49:20.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.919+0000 7f621b600640 1 Processor -- start 2024-09-17T01:49:20.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.919+0000 7f621b600640 1 -- start start 2024-09-17T01:49:20.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.920+0000 7f621b600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62140cd620 0x7f62141348a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:20.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.920+0000 7f621b600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f621415dcf0 0x7f62141f7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:20.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.920+0000 7f621b600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6214160790 0x7f62141f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:20.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.920+0000 7f621b600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f621406ed50 con 0x7f62140cd620 2024-09-17T01:49:20.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.920+0000 7f621b600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f621406ebd0 con 0x7f621415dcf0 2024-09-17T01:49:20.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.920+0000 7f621b600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f621406eed0 con 0x7f6214160790 2024-09-17T01:49:20.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.921+0000 7f6218c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62140cd620 0x7f62141348a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:20.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.921+0000 7f6218c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62140cd620 0x7f62141348a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41580/0 (socket says 172.21.15.42:41580) 2024-09-17T01:49:20.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.921+0000 7f6218c00640 1 -- 172.21.15.42:0/3902968761 learned_addr learned my addr 172.21.15.42:0/3902968761 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:20.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.921+0000 7f620be00640 1 --2- 172.21.15.42:0/3902968761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f621415dcf0 0x7f62141f7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:20.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.921+0000 7f6219600640 1 --2- 172.21.15.42:0/3902968761 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6214160790 0x7f62141f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:20.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.921+0000 7f6218c00640 1 -- 172.21.15.42:0/3902968761 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6214160790 msgr2=0x7f62141f76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:20.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.921+0000 7f6218c00640 1 --2- 172.21.15.42:0/3902968761 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6214160790 0x7f62141f76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:20.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.921+0000 7f6218c00640 1 -- 172.21.15.42:0/3902968761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f621415dcf0 msgr2=0x7f62141f7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:20.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.921+0000 7f6218c00640 1 --2- 172.21.15.42:0/3902968761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f621415dcf0 0x7f62141f7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:20.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.921+0000 7f6218c00640 1 -- 172.21.15.42:0/3902968761 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62141f7be0 con 0x7f62140cd620 2024-09-17T01:49:20.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.921+0000 7f620be00640 1 --2- 172.21.15.42:0/3902968761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f621415dcf0 0x7f62141f7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:49:20.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.921+0000 7f6218c00640 1 --2- 172.21.15.42:0/3902968761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62140cd620 0x7f62141348a0 secure :-1 s=READY pgs=2541 cs=0 l=1 rev1=1 crypto rx=0x7f620400e740 tx=0x7f620400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:20.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.922+0000 7f6211600640 1 -- 172.21.15.42:0/3902968761 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620400ccc0 con 0x7f62140cd620 2024-09-17T01:49:20.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.922+0000 7f6211600640 1 -- 172.21.15.42:0/3902968761 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f620400ee50 con 0x7f62140cd620 2024-09-17T01:49:20.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.922+0000 7f6211600640 1 -- 172.21.15.42:0/3902968761 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6204004290 con 0x7f62140cd620 2024-09-17T01:49:20.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.922+0000 7f621b600640 1 -- 172.21.15.42:0/3902968761 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6214134de0 con 0x7f62140cd620 2024-09-17T01:49:20.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.922+0000 7f621b600640 1 -- 172.21.15.42:0/3902968761 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62141f4690 con 0x7f62140cd620 2024-09-17T01:49:20.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.923+0000 7f621b600640 1 -- 172.21.15.42:0/3902968761 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f621406f3f0 con 0x7f62140cd620 2024-09-17T01:49:20.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.924+0000 7f6211600640 1 -- 172.21.15.42:0/3902968761 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f62040035f0 con 0x7f62140cd620 2024-09-17T01:49:20.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.925+0000 7f6211600640 1 --2- 172.21.15.42:0/3902968761 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f61f0078b90 0x7f61f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:20.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.925+0000 7f6211600640 1 -- 172.21.15.42:0/3902968761 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 5709+0+0 (secure 0 0 0) 0x7f620409b780 con 0x7f62140cd620 2024-09-17T01:49:20.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.925+0000 7f620be00640 1 --2- 172.21.15.42:0/3902968761 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f61f0078b90 0x7f61f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:20.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.926+0000 7f620be00640 1 --2- 172.21.15.42:0/3902968761 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f61f0078b90 0x7f61f007b0a0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f61fc033000 tx=0x7f61fc004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:20.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:20.929+0000 7f6211600640 1 -- 172.21.15.42:0/3902968761 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6204063bb0 con 0x7f62140cd620 2024-09-17T01:49:21.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.121+0000 7f621b600640 1 -- 172.21.15.42:0/3902968761 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f62140cdc40 con 0x7f61f0078b90 2024-09-17T01:49:21.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.126+0000 7f6211600640 1 -- 172.21.15.42:0/3902968761 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242134 (secure 0 0 0) 0x7f62140cdc40 con 0x7f61f0078b90 2024-09-17T01:49:21.127 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:21.128 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:49:21.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.130+0000 7f621b600640 1 -- 172.21.15.42:0/3902968761 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f61f0078b90 msgr2=0x7f61f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:21.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.130+0000 7f621b600640 1 --2- 172.21.15.42:0/3902968761 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f61f0078b90 0x7f61f007b0a0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f61fc033000 tx=0x7f61fc004730 comp rx=0 tx=0).stop 2024-09-17T01:49:21.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.130+0000 7f621b600640 1 -- 172.21.15.42:0/3902968761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62140cd620 msgr2=0x7f62141348a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:21.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.130+0000 7f621b600640 1 --2- 172.21.15.42:0/3902968761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62140cd620 0x7f62141348a0 secure :-1 s=READY pgs=2541 cs=0 l=1 rev1=1 crypto rx=0x7f620400e740 tx=0x7f620400ec00 comp rx=0 tx=0).stop 2024-09-17T01:49:21.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.130+0000 7f621b600640 1 -- 172.21.15.42:0/3902968761 shutdown_connections 2024-09-17T01:49:21.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.130+0000 7f621b600640 1 --2- 172.21.15.42:0/3902968761 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f61f0078b90 0x7f61f007b0a0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:21.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.130+0000 7f621b600640 1 --2- 172.21.15.42:0/3902968761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f621415dcf0 0x7f62141f7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:21.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.130+0000 7f621b600640 1 --2- 172.21.15.42:0/3902968761 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6214160790 0x7f62141f76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:21.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.130+0000 7f621b600640 1 --2- 172.21.15.42:0/3902968761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62140cd620 0x7f62141348a0 unknown :-1 s=CLOSED pgs=2541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:21.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.130+0000 7f621b600640 1 -- 172.21.15.42:0/3902968761 >> 172.21.15.42:0/3902968761 conn(0x7f621406d1b0 msgr2=0x7f62140cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:21.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.130+0000 7f621b600640 1 -- 172.21.15.42:0/3902968761 shutdown_connections 2024-09-17T01:49:21.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.130+0000 7f621b600640 1 -- 172.21.15.42:0/3902968761 wait complete. 2024-09-17T01:49:21.151 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":742,"stamp":"2024-09-17T01:49:19.277334+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":110,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":94,"acting":94,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":447492,"kb_used_data":23096,"kb_used_omap":12,"kb_used_meta":424179,"kb_avail":754527228,"statfs":{"total":773094113280,"available":772635881472,"internally_reserved":0,"allocated":23650304,"data_stored":11126239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":434359860},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.618543"},"pg_stats":[{"pgid":"33.3f","version":"0'0","reported_seq":1,"reported_epoch":224,"state":"creating+peering","last_fresh":"2024-09-17T01:49:15.678830+0000","last_change":"2024-09-17T01:49:15.678830+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.678830+0000","last_undegraded":"2024-09-17T01:49:15.678830+0000","last_fullsized":"2024-09-17T01:49:15.678830+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.3c","version":"0'0","reported_seq":1,"reported_epoch":224,"state":"creating+peering","last_fresh":"2024-09-17T01:49:15.679908+0000","last_change":"2024-09-17T01:49:15.679908+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.679908+0000","last_undegraded":"2024-09-17T01:49:15.679908+0000","last_fullsized":"2024-09-17T01:49:15.679908+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.3b","version":"0'0","reported_seq":1,"reported_epoch":224,"state":"creating+peering","last_fresh":"2024-09-17T01:49:15.681516+0000","last_change":"2024-09-17T01:49:15.681516+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.681516+0000","last_undegraded":"2024-09-17T01:49:15.681516+0000","last_fullsized":"2024-09-17T01:49:15.681516+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.3a","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.690998+0000","last_change":"2024-09-17T01:49:16.698318+0000","last_active":"2024-09-17T01:49:17.690998+0000","last_peered":"2024-09-17T01:49:17.690998+0000","last_clean":"2024-09-17T01:49:17.690998+0000","last_became_active":"2024-09-17T01:49:16.696434+0000","last_became_peered":"2024-09-17T01:49:16.696434+0000","last_unstale":"2024-09-17T01:49:17.690998+0000","last_undegraded":"2024-09-17T01:49:17.690998+0000","last_fullsized":"2024-09-17T01:49:17.690998+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:15:53.339115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.39","version":"0'0","reported_seq":1,"reported_epoch":224,"state":"creating+peering","last_fresh":"2024-09-17T01:49:15.685988+0000","last_change":"2024-09-17T01:49:15.685988+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.685988+0000","last_undegraded":"2024-09-17T01:49:15.685988+0000","last_fullsized":"2024-09-17T01:49:15.685988+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.35","version":"0'0","reported_seq":1,"reported_epoch":224,"state":"creating+peering","last_fresh":"2024-09-17T01:49:15.681584+0000","last_change":"2024-09-17T01:49:15.681584+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.681584+0000","last_undegraded":"2024-09-17T01:49:15.681584+0000","last_fullsized":"2024-09-17T01:49:15.681584+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.2f","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.691164+0000","last_change":"2024-09-17T01:49:16.695596+0000","last_active":"2024-09-17T01:49:17.691164+0000","last_peered":"2024-09-17T01:49:17.691164+0000","last_clean":"2024-09-17T01:49:17.691164+0000","last_became_active":"2024-09-17T01:49:16.695138+0000","last_became_peered":"2024-09-17T01:49:16.695138+0000","last_unstale":"2024-09-17T01:49:17.691164+0000","last_undegraded":"2024-09-17T01:49:17.691164+0000","last_fullsized":"2024-09-17T01:49:17.691164+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:40.492037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.23","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.690646+0000","last_change":"2024-09-17T01:49:16.691519+0000","last_active":"2024-09-17T01:49:17.690646+0000","last_peered":"2024-09-17T01:49:17.690646+0000","last_clean":"2024-09-17T01:49:17.690646+0000","last_became_active":"2024-09-17T01:49:16.691160+0000","last_became_peered":"2024-09-17T01:49:16.691160+0000","last_unstale":"2024-09-17T01:49:17.690646+0000","last_undegraded":"2024-09-17T01:49:17.690646+0000","last_fullsized":"2024-09-17T01:49:17.690646+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:44.213730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.21","version":"0'0","reported_seq":1,"reported_epoch":224,"state":"creating+peering","last_fresh":"2024-09-17T01:49:15.685346+0000","last_change":"2024-09-17T01:49:15.685346+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.685346+0000","last_undegraded":"2024-09-17T01:49:15.685346+0000","last_fullsized":"2024-09-17T01:49:15.685346+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.1f","version":"0'0","reported_seq":1,"reported_epoch":223,"state":"creating+peering","last_fresh":"2024-09-17T01:49:14.669270+0000","last_change":"2024-09-17T01:49:14.669270+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.669270+0000","last_undegraded":"2024-09-17T01:49:14.669270+0000","last_fullsized":"2024-09-17T01:49:14.669270+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.1f","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.691437+0000","last_change":"2024-09-17T01:49:16.690760+0000","last_active":"2024-09-17T01:49:17.691437+0000","last_peered":"2024-09-17T01:49:17.691437+0000","last_clean":"2024-09-17T01:49:17.691437+0000","last_became_active":"2024-09-17T01:49:16.690436+0000","last_became_peered":"2024-09-17T01:49:16.690436+0000","last_unstale":"2024-09-17T01:49:17.691437+0000","last_undegraded":"2024-09-17T01:49:17.691437+0000","last_fullsized":"2024-09-17T01:49:17.691437+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:52.044984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.1e","version":"0'0","reported_seq":1,"reported_epoch":223,"state":"creating+peering","last_fresh":"2024-09-17T01:49:14.668273+0000","last_change":"2024-09-17T01:49:14.668273+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.668273+0000","last_undegraded":"2024-09-17T01:49:14.668273+0000","last_fullsized":"2024-09-17T01:49:14.668273+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.1d","version":"225'2","reported_seq":17,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.690276+0000","last_change":"2024-09-17T01:49:15.690681+0000","last_active":"2024-09-17T01:49:17.690276+0000","last_peered":"2024-09-17T01:49:17.690276+0000","last_clean":"2024-09-17T01:49:17.690276+0000","last_became_active":"2024-09-17T01:49:15.690294+0000","last_became_peered":"2024-09-17T01:49:15.690294+0000","last_unstale":"2024-09-17T01:49:17.690276+0000","last_undegraded":"2024-09-17T01:49:17.690276+0000","last_fullsized":"2024-09-17T01:49:17.690276+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:53.807459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.1c","version":"225'2","reported_seq":17,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.690479+0000","last_change":"2024-09-17T01:49:15.687825+0000","last_active":"2024-09-17T01:49:17.690479+0000","last_peered":"2024-09-17T01:49:17.690479+0000","last_clean":"2024-09-17T01:49:17.690479+0000","last_became_active":"2024-09-17T01:49:15.685453+0000","last_became_peered":"2024-09-17T01:49:15.685453+0000","last_unstale":"2024-09-17T01:49:17.690479+0000","last_undegraded":"2024-09-17T01:49:17.690479+0000","last_fullsized":"2024-09-17T01:49:17.690479+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:58.866704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.1b","version":"0'0","reported_seq":1,"reported_epoch":223,"state":"creating+peering","last_fresh":"2024-09-17T01:49:14.665372+0000","last_change":"2024-09-17T01:49:14.665372+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.665372+0000","last_undegraded":"2024-09-17T01:49:14.665372+0000","last_fullsized":"2024-09-17T01:49:14.665372+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.1a","version":"0'0","reported_seq":1,"reported_epoch":223,"state":"creating+peering","last_fresh":"2024-09-17T01:49:14.668568+0000","last_change":"2024-09-17T01:49:14.668568+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.668568+0000","last_undegraded":"2024-09-17T01:49:14.668568+0000","last_fullsized":"2024-09-17T01:49:14.668568+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.18","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.689185+0000","last_change":"2024-09-17T01:49:16.700731+0000","last_active":"2024-09-17T01:49:17.689185+0000","last_peered":"2024-09-17T01:49:17.689185+0000","last_clean":"2024-09-17T01:49:17.689185+0000","last_became_active":"2024-09-17T01:49:16.700368+0000","last_became_peered":"2024-09-17T01:49:16.700368+0000","last_unstale":"2024-09-17T01:49:17.689185+0000","last_undegraded":"2024-09-17T01:49:17.689185+0000","last_fullsized":"2024-09-17T01:49:17.689185+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:47:18.045173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:14.655203+0000","last_change":"2024-09-17T01:49:14.655203+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.655203+0000","last_undegraded":"2024-09-17T01:49:14.655203+0000","last_fullsized":"2024-09-17T01:49:14.655203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.19","version":"0'0","reported_seq":1,"reported_epoch":224,"state":"creating+peering","last_fresh":"2024-09-17T01:49:15.681821+0000","last_change":"2024-09-17T01:49:15.681821+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.681821+0000","last_undegraded":"2024-09-17T01:49:15.681821+0000","last_fullsized":"2024-09-17T01:49:15.681821+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":10,"reported_epoch":224,"state":"active+clean","last_fresh":"2024-09-17T01:49:15.696006+0000","last_change":"2024-09-17T01:49:15.695392+0000","last_active":"2024-09-17T01:49:15.696006+0000","last_peered":"2024-09-17T01:49:15.696006+0000","last_clean":"2024-09-17T01:49:15.696006+0000","last_became_active":"2024-09-17T01:49:15.695057+0000","last_became_peered":"2024-09-17T01:49:15.695057+0000","last_unstale":"2024-09-17T01:49:15.696006+0000","last_undegraded":"2024-09-17T01:49:15.696006+0000","last_fullsized":"2024-09-17T01:49:15.696006+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:31.476700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.16","version":"0'0","reported_seq":1,"reported_epoch":224,"state":"creating+peering","last_fresh":"2024-09-17T01:49:15.683152+0000","last_change":"2024-09-17T01:49:15.683152+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.683152+0000","last_undegraded":"2024-09-17T01:49:15.683152+0000","last_fullsized":"2024-09-17T01:49:15.683152+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":1,"reported_epoch":223,"state":"creating+peering","last_fresh":"2024-09-17T01:49:14.668073+0000","last_change":"2024-09-17T01:49:14.668073+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.668073+0000","last_undegraded":"2024-09-17T01:49:14.668073+0000","last_fullsized":"2024-09-17T01:49:14.668073+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":1,"reported_epoch":223,"state":"creating+peering","last_fresh":"2024-09-17T01:49:14.667080+0000","last_change":"2024-09-17T01:49:14.667080+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.667080+0000","last_undegraded":"2024-09-17T01:49:14.667080+0000","last_fullsized":"2024-09-17T01:49:14.667080+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.14","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.690302+0000","last_change":"2024-09-17T01:49:16.700534+0000","last_active":"2024-09-17T01:49:17.690302+0000","last_peered":"2024-09-17T01:49:17.690302+0000","last_clean":"2024-09-17T01:49:17.690302+0000","last_became_active":"2024-09-17T01:49:16.700149+0000","last_became_peered":"2024-09-17T01:49:16.700149+0000","last_unstale":"2024-09-17T01:49:17.690302+0000","last_undegraded":"2024-09-17T01:49:17.690302+0000","last_fullsized":"2024-09-17T01:49:17.690302+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:53.269282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.15","version":"0'0","reported_seq":1,"reported_epoch":223,"state":"creating+peering","last_fresh":"2024-09-17T01:49:14.668155+0000","last_change":"2024-09-17T01:49:14.668155+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.668155+0000","last_undegraded":"2024-09-17T01:49:14.668155+0000","last_fullsized":"2024-09-17T01:49:14.668155+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:14.655203+0000","last_change":"2024-09-17T01:49:14.655203+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.655203+0000","last_undegraded":"2024-09-17T01:49:14.655203+0000","last_fullsized":"2024-09-17T01:49:14.655203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.13","version":"0'0","reported_seq":1,"reported_epoch":223,"state":"creating+peering","last_fresh":"2024-09-17T01:49:14.668000+0000","last_change":"2024-09-17T01:49:14.668000+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.668000+0000","last_undegraded":"2024-09-17T01:49:14.668000+0000","last_fullsized":"2024-09-17T01:49:14.668000+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.13","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.690124+0000","last_change":"2024-09-17T01:49:16.688969+0000","last_active":"2024-09-17T01:49:17.690124+0000","last_peered":"2024-09-17T01:49:17.690124+0000","last_clean":"2024-09-17T01:49:17.690124+0000","last_became_active":"2024-09-17T01:49:16.687866+0000","last_became_peered":"2024-09-17T01:49:16.687866+0000","last_unstale":"2024-09-17T01:49:17.690124+0000","last_undegraded":"2024-09-17T01:49:17.690124+0000","last_fullsized":"2024-09-17T01:49:17.690124+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:45.779540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":1,"reported_epoch":223,"state":"creating+peering","last_fresh":"2024-09-17T01:49:14.667172+0000","last_change":"2024-09-17T01:49:14.667172+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.667172+0000","last_undegraded":"2024-09-17T01:49:14.667172+0000","last_fullsized":"2024-09-17T01:49:14.667172+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.10","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.689590+0000","last_change":"2024-09-17T01:49:16.691078+0000","last_active":"2024-09-17T01:49:17.689590+0000","last_peered":"2024-09-17T01:49:17.689590+0000","last_clean":"2024-09-17T01:49:17.689590+0000","last_became_active":"2024-09-17T01:49:16.690338+0000","last_became_peered":"2024-09-17T01:49:16.690338+0000","last_unstale":"2024-09-17T01:49:17.689590+0000","last_undegraded":"2024-09-17T01:49:17.689590+0000","last_fullsized":"2024-09-17T01:49:17.689590+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:42.692835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":10,"reported_epoch":224,"state":"active+clean","last_fresh":"2024-09-17T01:49:15.691740+0000","last_change":"2024-09-17T01:49:15.691139+0000","last_active":"2024-09-17T01:49:15.691740+0000","last_peered":"2024-09-17T01:49:15.691740+0000","last_clean":"2024-09-17T01:49:15.691740+0000","last_became_active":"2024-09-17T01:49:15.690420+0000","last_became_peered":"2024-09-17T01:49:15.690420+0000","last_unstale":"2024-09-17T01:49:15.691740+0000","last_undegraded":"2024-09-17T01:49:15.691740+0000","last_fullsized":"2024-09-17T01:49:15.691740+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:11.545962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.10","version":"0'0","reported_seq":1,"reported_epoch":223,"state":"creating+peering","last_fresh":"2024-09-17T01:49:14.669067+0000","last_change":"2024-09-17T01:49:14.669067+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.669067+0000","last_undegraded":"2024-09-17T01:49:14.669067+0000","last_fullsized":"2024-09-17T01:49:14.669067+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.f","version":"0'0","reported_seq":10,"reported_epoch":224,"state":"active+clean","last_fresh":"2024-09-17T01:49:15.687248+0000","last_change":"2024-09-17T01:49:15.684903+0000","last_active":"2024-09-17T01:49:15.687248+0000","last_peered":"2024-09-17T01:49:15.687248+0000","last_clean":"2024-09-17T01:49:15.687248+0000","last_became_active":"2024-09-17T01:49:15.684552+0000","last_became_peered":"2024-09-17T01:49:15.684552+0000","last_unstale":"2024-09-17T01:49:15.687248+0000","last_undegraded":"2024-09-17T01:49:15.687248+0000","last_fullsized":"2024-09-17T01:49:15.687248+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:08:43.966262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.e","version":"225'2","reported_seq":17,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.690622+0000","last_change":"2024-09-17T01:49:15.685289+0000","last_active":"2024-09-17T01:49:17.690622+0000","last_peered":"2024-09-17T01:49:17.690622+0000","last_clean":"2024-09-17T01:49:17.690622+0000","last_became_active":"2024-09-17T01:49:15.684960+0000","last_became_peered":"2024-09-17T01:49:15.684960+0000","last_unstale":"2024-09-17T01:49:17.690622+0000","last_undegraded":"2024-09-17T01:49:17.690622+0000","last_fullsized":"2024-09-17T01:49:17.690622+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:09.732082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.d","version":"0'0","reported_seq":1,"reported_epoch":223,"state":"creating+peering","last_fresh":"2024-09-17T01:49:14.665210+0000","last_change":"2024-09-17T01:49:14.665210+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.665210+0000","last_undegraded":"2024-09-17T01:49:14.665210+0000","last_fullsized":"2024-09-17T01:49:14.665210+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.d","version":"0'0","reported_seq":1,"reported_epoch":224,"state":"creating+peering","last_fresh":"2024-09-17T01:49:15.678911+0000","last_change":"2024-09-17T01:49:15.678911+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.678911+0000","last_undegraded":"2024-09-17T01:49:15.678911+0000","last_fullsized":"2024-09-17T01:49:15.678911+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":1,"reported_epoch":223,"state":"creating+peering","last_fresh":"2024-09-17T01:49:14.667049+0000","last_change":"2024-09-17T01:49:14.667049+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.667049+0000","last_undegraded":"2024-09-17T01:49:14.667049+0000","last_fullsized":"2024-09-17T01:49:14.667049+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.a","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.690402+0000","last_change":"2024-09-17T01:49:16.703011+0000","last_active":"2024-09-17T01:49:17.690402+0000","last_peered":"2024-09-17T01:49:17.690402+0000","last_clean":"2024-09-17T01:49:17.690402+0000","last_became_active":"2024-09-17T01:49:16.699564+0000","last_became_peered":"2024-09-17T01:49:16.699564+0000","last_unstale":"2024-09-17T01:49:17.690402+0000","last_undegraded":"2024-09-17T01:49:17.690402+0000","last_fullsized":"2024-09-17T01:49:17.690402+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:55:19.808839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.b","version":"0'0","reported_seq":1,"reported_epoch":223,"state":"creating+peering","last_fresh":"2024-09-17T01:49:14.667109+0000","last_change":"2024-09-17T01:49:14.667109+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.667109+0000","last_undegraded":"2024-09-17T01:49:14.667109+0000","last_fullsized":"2024-09-17T01:49:14.667109+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":1,"reported_epoch":223,"state":"creating+peering","last_fresh":"2024-09-17T01:49:14.663525+0000","last_change":"2024-09-17T01:49:14.663525+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.663525+0000","last_undegraded":"2024-09-17T01:49:14.663525+0000","last_fullsized":"2024-09-17T01:49:14.663525+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":1,"reported_epoch":223,"state":"creating+peering","last_fresh":"2024-09-17T01:49:14.663795+0000","last_change":"2024-09-17T01:49:14.663795+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.663795+0000","last_undegraded":"2024-09-17T01:49:14.663795+0000","last_fullsized":"2024-09-17T01:49:14.663795+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:14.655203+0000","last_change":"2024-09-17T01:49:14.655203+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.655203+0000","last_undegraded":"2024-09-17T01:49:14.655203+0000","last_fullsized":"2024-09-17T01:49:14.655203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.7","version":"0'0","reported_seq":1,"reported_epoch":223,"state":"creating+peering","last_fresh":"2024-09-17T01:49:14.667897+0000","last_change":"2024-09-17T01:49:14.667897+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.667897+0000","last_undegraded":"2024-09-17T01:49:14.667897+0000","last_fullsized":"2024-09-17T01:49:14.667897+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":1,"reported_epoch":223,"state":"creating+peering","last_fresh":"2024-09-17T01:49:14.663546+0000","last_change":"2024-09-17T01:49:14.663546+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.663546+0000","last_undegraded":"2024-09-17T01:49:14.663546+0000","last_fullsized":"2024-09-17T01:49:14.663546+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":1,"reported_epoch":223,"state":"creating+peering","last_fresh":"2024-09-17T01:49:14.663319+0000","last_change":"2024-09-17T01:49:14.663319+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.663319+0000","last_undegraded":"2024-09-17T01:49:14.663319+0000","last_fullsized":"2024-09-17T01:49:14.663319+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:14.655203+0000","last_change":"2024-09-17T01:49:14.655203+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.655203+0000","last_undegraded":"2024-09-17T01:49:14.655203+0000","last_fullsized":"2024-09-17T01:49:14.655203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":1,"reported_epoch":223,"state":"creating+peering","last_fresh":"2024-09-17T01:49:14.669404+0000","last_change":"2024-09-17T01:49:14.669404+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.669404+0000","last_undegraded":"2024-09-17T01:49:14.669404+0000","last_fullsized":"2024-09-17T01:49:14.669404+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:14.655203+0000","last_change":"2024-09-17T01:49:14.655203+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.655203+0000","last_undegraded":"2024-09-17T01:49:14.655203+0000","last_fullsized":"2024-09-17T01:49:14.655203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.0","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.689483+0000","last_change":"2024-09-17T01:49:16.692102+0000","last_active":"2024-09-17T01:49:17.689483+0000","last_peered":"2024-09-17T01:49:17.689483+0000","last_clean":"2024-09-17T01:49:17.689483+0000","last_became_active":"2024-09-17T01:49:16.691766+0000","last_became_peered":"2024-09-17T01:49:16.691766+0000","last_unstale":"2024-09-17T01:49:17.689483+0000","last_undegraded":"2024-09-17T01:49:17.689483+0000","last_fullsized":"2024-09-17T01:49:17.689483+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:07.127188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":1,"reported_epoch":223,"state":"creating+peering","last_fresh":"2024-09-17T01:49:14.668075+0000","last_change":"2024-09-17T01:49:14.668075+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.668075+0000","last_undegraded":"2024-09-17T01:49:14.668075+0000","last_fullsized":"2024-09-17T01:49:14.668075+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:15.657939+0000","last_change":"2024-09-17T01:49:15.657939+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.657939+0000","last_undegraded":"2024-09-17T01:49:15.657939+0000","last_fullsized":"2024-09-17T01:49:15.657939+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T01:49:14.655203+0000","last_change":"2024-09-17T01:49:14.655203+0000","last_active":"2024-09-17T01:49:14.655203+0000","last_peered":"2024-09-17T01:49:14.655203+0000","last_clean":"2024-09-17T01:49:14.655203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:14.655203+0000","last_undegraded":"2024-09-17T01:49:14.655203+0000","last_fullsized":"2024-09-17T01:49:14.655203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"33.20","version":"0'0","reported_seq":1,"reported_epoch":224,"state":"creating+peering","last_fresh":"2024-09-17T01:49:15.676458+0000","last_change":"2024-09-17T01:49:15.676458+0000","last_active":"2024-09-17T01:49:15.657939+0000","last_peered":"2024-09-17T01:49:15.657939+0000","last_clean":"2024-09-17T01:49:15.657939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T01:49:15.676458+0000","last_undegraded":"2024-09-17T01:49:15.676458+0000","last_fullsized":"2024-09-17T01:49:15.676458+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":497,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-17T01:49:14.659711+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:49:14.659711+0000","last_peered":"2024-09-17T01:49:14.659711+0000","last_clean":"2024-09-17T01:49:14.659711+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:49:14.659711+0000","last_undegraded":"2024-09-17T01:49:14.659711+0000","last_fullsized":"2024-09-17T01:49:14.659711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":33,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":2},{"poolid":32,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":52,"acting":52,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476948,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51984,"kb_used_data":2748,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319856,"statfs":{"total":96636764160,"available":96583532544,"internally_reserved":0,"allocated":2813952,"data_stored":1245764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509651,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60296,"kb_used_data":2736,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311544,"statfs":{"total":96636764160,"available":96575021056,"internally_reserved":0,"allocated":2801664,"data_stored":1239947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509650,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47816,"kb_used_data":2736,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324024,"statfs":{"total":96636764160,"available":96587800576,"internally_reserved":0,"allocated":2801664,"data_stored":1239947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509651,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51984,"kb_used_data":2736,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319856,"statfs":{"total":96636764160,"available":96583532544,"internally_reserved":0,"allocated":2801664,"data_stored":1239947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509651,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69960,"kb_used_data":2736,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94301880,"statfs":{"total":96636764160,"available":96565125120,"internally_reserved":0,"allocated":2801664,"data_stored":1239947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509650,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52560,"kb_used_data":3316,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319280,"statfs":{"total":96636764160,"available":96582942720,"internally_reserved":0,"allocated":3395584,"data_stored":1830315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60284,"kb_used_data":2724,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311556,"statfs":{"total":96636764160,"available":96575033344,"internally_reserved":0,"allocated":2789376,"data_stored":1234890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":58915273},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542357,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52608,"kb_used_data":3364,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319232,"statfs":{"total":96636764160,"available":96582893568,"internally_reserved":0,"allocated":3444736,"data_stored":1855482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:49:21.155 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:49:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.420+0000 7f773ce00640 1 -- 172.21.15.42:0/1820964729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f773806cdc0 msgr2=0x7f773806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.420+0000 7f773ce00640 1 --2- 172.21.15.42:0/1820964729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f773806cdc0 0x7f773806d1d0 secure :-1 s=READY pgs=2542 cs=0 l=1 rev1=1 crypto rx=0x7f773806ad70 tx=0x7f773002aa30 comp rx=0 tx=0).stop 2024-09-17T01:49:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.421+0000 7f773ce00640 1 -- 172.21.15.42:0/1820964729 shutdown_connections 2024-09-17T01:49:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.421+0000 7f773ce00640 1 --2- 172.21.15.42:0/1820964729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f773806cdc0 0x7f773806d1d0 unknown :-1 s=CLOSED pgs=2542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.421+0000 7f773ce00640 1 --2- 172.21.15.42:0/1820964729 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77380b21d0 0x7f77380b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.421+0000 7f773ce00640 1 --2- 172.21.15.42:0/1820964729 >> v2:172.21.15.43:3300/0 conn(0x7f77380b79d0 0x7f77380d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.421+0000 7f773ce00640 1 -- 172.21.15.42:0/1820964729 >> 172.21.15.42:0/1820964729 conn(0x7f77380b4180 msgr2=0x7f77380b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.421+0000 7f773ce00640 1 -- 172.21.15.42:0/1820964729 shutdown_connections 2024-09-17T01:49:21.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.421+0000 7f773ce00640 1 -- 172.21.15.42:0/1820964729 wait complete. 2024-09-17T01:49:21.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.423+0000 7f773ce00640 1 Processor -- start 2024-09-17T01:49:21.421 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.423+0000 7f773ce00640 1 -- start start 2024-09-17T01:49:21.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.424+0000 7f773ce00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f773806cdc0 0x7f77381e1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:21.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.425+0000 7f773ce00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77380b21d0 0x7f77381e5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:21.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.425+0000 7f773ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77380b79d0 0x7f77381e63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:21.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.425+0000 7f773ce00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f77380b7f40 con 0x7f77380b79d0 2024-09-17T01:49:21.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.425+0000 7f773ce00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f77380b80c0 con 0x7f773806cdc0 2024-09-17T01:49:21.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.425+0000 7f773ce00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f77380cee70 con 0x7f77380b21d0 2024-09-17T01:49:21.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.425+0000 7f7737e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77380b79d0 0x7f77381e63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:21.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.425+0000 7f7737e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77380b79d0 0x7f77381e63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41590/0 (socket says 172.21.15.42:41590) 2024-09-17T01:49:21.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.425+0000 7f7737e00640 1 -- 172.21.15.42:0/2541250234 learned_addr learned my addr 172.21.15.42:0/2541250234 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:21.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.425+0000 7f7736a00640 1 --2- 172.21.15.42:0/2541250234 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77380b21d0 0x7f77381e5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:21.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.425+0000 7f7737400640 1 --2- 172.21.15.42:0/2541250234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f773806cdc0 0x7f77381e1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:21.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.425+0000 7f7737e00640 1 -- 172.21.15.42:0/2541250234 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77380b21d0 msgr2=0x7f77381e5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:21.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.425+0000 7f7737e00640 1 --2- 172.21.15.42:0/2541250234 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77380b21d0 0x7f77381e5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:21.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.425+0000 7f7737e00640 1 -- 172.21.15.42:0/2541250234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f773806cdc0 msgr2=0x7f77381e1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:21.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.425+0000 7f7737e00640 1 --2- 172.21.15.42:0/2541250234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f773806cdc0 0x7f77381e1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:21.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.425+0000 7f7737e00640 1 -- 172.21.15.42:0/2541250234 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77381e1bc0 con 0x7f77380b79d0 2024-09-17T01:49:21.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.426+0000 7f7737e00640 1 --2- 172.21.15.42:0/2541250234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77380b79d0 0x7f77381e63d0 secure :-1 s=READY pgs=2543 cs=0 l=1 rev1=1 crypto rx=0x7f7730009d60 tx=0x7f7730003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:21.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.426+0000 7f772f400640 1 -- 172.21.15.42:0/2541250234 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7730033050 con 0x7f77380b79d0 2024-09-17T01:49:21.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.426+0000 7f772f400640 1 -- 172.21.15.42:0/2541250234 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7730004450 con 0x7f77380b79d0 2024-09-17T01:49:21.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.426+0000 7f772f400640 1 -- 172.21.15.42:0/2541250234 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7730038450 con 0x7f77380b79d0 2024-09-17T01:49:21.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.426+0000 7f773ce00640 1 -- 172.21.15.42:0/2541250234 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77381e4de0 con 0x7f77380b79d0 2024-09-17T01:49:21.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.426+0000 7f773ce00640 1 -- 172.21.15.42:0/2541250234 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77381e5360 con 0x7f77380b79d0 2024-09-17T01:49:21.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.427+0000 7f773ce00640 1 -- 172.21.15.42:0/2541250234 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77380b25e0 con 0x7f77380b79d0 2024-09-17T01:49:21.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.428+0000 7f772f400640 1 -- 172.21.15.42:0/2541250234 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7730036070 con 0x7f77380b79d0 2024-09-17T01:49:21.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.429+0000 7f772f400640 1 --2- 172.21.15.42:0/2541250234 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7718078bc0 0x7f771807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:21.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.429+0000 7f772f400640 1 -- 172.21.15.42:0/2541250234 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 5709+0+0 (secure 0 0 0) 0x7f77300bc130 con 0x7f77380b79d0 2024-09-17T01:49:21.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.430+0000 7f7737400640 1 --2- 172.21.15.42:0/2541250234 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7718078bc0 0x7f771807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:21.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.431+0000 7f7737400640 1 --2- 172.21.15.42:0/2541250234 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7718078bc0 0x7f771807b0d0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f77380750d0 tx=0x7f772800b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:21.431 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.434+0000 7f772f400640 1 -- 172.21.15.42:0/2541250234 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7730083f10 con 0x7f77380b79d0 2024-09-17T01:49:21.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.625+0000 7f773ce00640 1 -- 172.21.15.42:0/2541250234 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f77380751f0 con 0x7f7718078bc0 2024-09-17T01:49:21.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.631+0000 7f772f400640 1 -- 172.21.15.42:0/2541250234 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252482 (secure 0 0 0) 0x7f77380751f0 con 0x7f7718078bc0 2024-09-17T01:49:21.631 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:21.632 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:49:21.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.634+0000 7f773ce00640 1 -- 172.21.15.42:0/2541250234 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7718078bc0 msgr2=0x7f771807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:21.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.634+0000 7f773ce00640 1 --2- 172.21.15.42:0/2541250234 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7718078bc0 0x7f771807b0d0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f77380750d0 tx=0x7f772800b2e0 comp rx=0 tx=0).stop 2024-09-17T01:49:21.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.634+0000 7f773ce00640 1 -- 172.21.15.42:0/2541250234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77380b79d0 msgr2=0x7f77381e63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:21.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.634+0000 7f773ce00640 1 --2- 172.21.15.42:0/2541250234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77380b79d0 0x7f77381e63d0 secure :-1 s=READY pgs=2543 cs=0 l=1 rev1=1 crypto rx=0x7f7730009d60 tx=0x7f7730003f10 comp rx=0 tx=0).stop 2024-09-17T01:49:21.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.634+0000 7f773ce00640 1 -- 172.21.15.42:0/2541250234 shutdown_connections 2024-09-17T01:49:21.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.634+0000 7f773ce00640 1 --2- 172.21.15.42:0/2541250234 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7718078bc0 0x7f771807b0d0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:21.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.634+0000 7f773ce00640 1 --2- 172.21.15.42:0/2541250234 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f77380b79d0 0x7f77381e63d0 unknown :-1 s=CLOSED pgs=2543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:21.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.634+0000 7f773ce00640 1 --2- 172.21.15.42:0/2541250234 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f77380b21d0 0x7f77381e5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.634+0000 7f773ce00640 1 --2- 172.21.15.42:0/2541250234 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f773806cdc0 0x7f77381e1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.634+0000 7f773ce00640 1 -- 172.21.15.42:0/2541250234 >> 172.21.15.42:0/2541250234 conn(0x7f77380b4180 msgr2=0x7f7738071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.635+0000 7f773ce00640 1 -- 172.21.15.42:0/2541250234 shutdown_connections 2024-09-17T01:49:21.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.635+0000 7f773ce00640 1 -- 172.21.15.42:0/2541250234 wait complete. 2024-09-17T01:49:21.654 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":743,"stamp":"2024-09-17T01:49:21.277898+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":447896,"kb_used_data":23496,"kb_used_omap":12,"kb_used_meta":424179,"kb_avail":754526824,"statfs":{"total":773094113280,"available":772635467776,"internally_reserved":0,"allocated":24059904,"data_stored":11306468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":434359860},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001693"},"pg_stats":[{"pgid":"33.3f","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728969+0000","last_change":"2024-09-17T01:49:16.692180+0000","last_active":"2024-09-17T01:49:17.728969+0000","last_peered":"2024-09-17T01:49:17.728969+0000","last_clean":"2024-09-17T01:49:17.728969+0000","last_became_active":"2024-09-17T01:49:16.690655+0000","last_became_peered":"2024-09-17T01:49:16.690655+0000","last_unstale":"2024-09-17T01:49:17.728969+0000","last_undegraded":"2024-09-17T01:49:17.728969+0000","last_fullsized":"2024-09-17T01:49:17.728969+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:13.708646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.3e","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.699038+0000","last_change":"2024-09-17T01:49:16.694630+0000","last_active":"2024-09-17T01:49:17.699038+0000","last_peered":"2024-09-17T01:49:17.699038+0000","last_clean":"2024-09-17T01:49:17.699038+0000","last_became_active":"2024-09-17T01:49:16.692838+0000","last_became_peered":"2024-09-17T01:49:16.692838+0000","last_unstale":"2024-09-17T01:49:17.699038+0000","last_undegraded":"2024-09-17T01:49:17.699038+0000","last_fullsized":"2024-09-17T01:49:17.699038+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:17:34.369913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.3d","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.687307+0000","last_change":"2024-09-17T01:49:16.697993+0000","last_active":"2024-09-17T01:49:17.687307+0000","last_peered":"2024-09-17T01:49:17.687307+0000","last_clean":"2024-09-17T01:49:17.687307+0000","last_became_active":"2024-09-17T01:49:16.697669+0000","last_became_peered":"2024-09-17T01:49:16.697669+0000","last_unstale":"2024-09-17T01:49:17.687307+0000","last_undegraded":"2024-09-17T01:49:17.687307+0000","last_fullsized":"2024-09-17T01:49:17.687307+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:02.774087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.3c","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728266+0000","last_change":"2024-09-17T01:49:16.691198+0000","last_active":"2024-09-17T01:49:17.728266+0000","last_peered":"2024-09-17T01:49:17.728266+0000","last_clean":"2024-09-17T01:49:17.728266+0000","last_became_active":"2024-09-17T01:49:16.689466+0000","last_became_peered":"2024-09-17T01:49:16.689466+0000","last_unstale":"2024-09-17T01:49:17.728266+0000","last_undegraded":"2024-09-17T01:49:17.728266+0000","last_fullsized":"2024-09-17T01:49:17.728266+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:17.097239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.3b","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728094+0000","last_change":"2024-09-17T01:49:16.696034+0000","last_active":"2024-09-17T01:49:17.728094+0000","last_peered":"2024-09-17T01:49:17.728094+0000","last_clean":"2024-09-17T01:49:17.728094+0000","last_became_active":"2024-09-17T01:49:16.695677+0000","last_became_peered":"2024-09-17T01:49:16.695677+0000","last_unstale":"2024-09-17T01:49:17.728094+0000","last_undegraded":"2024-09-17T01:49:17.728094+0000","last_fullsized":"2024-09-17T01:49:17.728094+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:17:39.537235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.3a","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.690998+0000","last_change":"2024-09-17T01:49:16.698318+0000","last_active":"2024-09-17T01:49:17.690998+0000","last_peered":"2024-09-17T01:49:17.690998+0000","last_clean":"2024-09-17T01:49:17.690998+0000","last_became_active":"2024-09-17T01:49:16.696434+0000","last_became_peered":"2024-09-17T01:49:16.696434+0000","last_unstale":"2024-09-17T01:49:17.690998+0000","last_undegraded":"2024-09-17T01:49:17.690998+0000","last_fullsized":"2024-09-17T01:49:17.690998+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:15:53.339115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.39","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728113+0000","last_change":"2024-09-17T01:49:16.688033+0000","last_active":"2024-09-17T01:49:17.728113+0000","last_peered":"2024-09-17T01:49:17.728113+0000","last_clean":"2024-09-17T01:49:17.728113+0000","last_became_active":"2024-09-17T01:49:16.686310+0000","last_became_peered":"2024-09-17T01:49:16.686310+0000","last_unstale":"2024-09-17T01:49:17.728113+0000","last_undegraded":"2024-09-17T01:49:17.728113+0000","last_fullsized":"2024-09-17T01:49:17.728113+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:40.140291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.38","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728006+0000","last_change":"2024-09-17T01:49:16.697012+0000","last_active":"2024-09-17T01:49:17.728006+0000","last_peered":"2024-09-17T01:49:17.728006+0000","last_clean":"2024-09-17T01:49:17.728006+0000","last_became_active":"2024-09-17T01:49:16.696688+0000","last_became_peered":"2024-09-17T01:49:16.696688+0000","last_unstale":"2024-09-17T01:49:17.728006+0000","last_undegraded":"2024-09-17T01:49:17.728006+0000","last_fullsized":"2024-09-17T01:49:17.728006+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:00.135851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.37","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.729594+0000","last_change":"2024-09-17T01:49:16.708886+0000","last_active":"2024-09-17T01:49:17.729594+0000","last_peered":"2024-09-17T01:49:17.729594+0000","last_clean":"2024-09-17T01:49:17.729594+0000","last_became_active":"2024-09-17T01:49:16.705727+0000","last_became_peered":"2024-09-17T01:49:16.705727+0000","last_unstale":"2024-09-17T01:49:17.729594+0000","last_undegraded":"2024-09-17T01:49:17.729594+0000","last_fullsized":"2024-09-17T01:49:17.729594+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:29.826234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.36","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.699048+0000","last_change":"2024-09-17T01:49:16.700002+0000","last_active":"2024-09-17T01:49:17.699048+0000","last_peered":"2024-09-17T01:49:17.699048+0000","last_clean":"2024-09-17T01:49:17.699048+0000","last_became_active":"2024-09-17T01:49:16.699650+0000","last_became_peered":"2024-09-17T01:49:16.699650+0000","last_unstale":"2024-09-17T01:49:17.699048+0000","last_undegraded":"2024-09-17T01:49:17.699048+0000","last_fullsized":"2024-09-17T01:49:17.699048+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:48.561921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.35","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728767+0000","last_change":"2024-09-17T01:49:16.700112+0000","last_active":"2024-09-17T01:49:17.728767+0000","last_peered":"2024-09-17T01:49:17.728767+0000","last_clean":"2024-09-17T01:49:17.728767+0000","last_became_active":"2024-09-17T01:49:16.699817+0000","last_became_peered":"2024-09-17T01:49:16.699817+0000","last_unstale":"2024-09-17T01:49:17.728767+0000","last_undegraded":"2024-09-17T01:49:17.728767+0000","last_fullsized":"2024-09-17T01:49:17.728767+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:26.367766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.34","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.687289+0000","last_change":"2024-09-17T01:49:16.700006+0000","last_active":"2024-09-17T01:49:17.687289+0000","last_peered":"2024-09-17T01:49:17.687289+0000","last_clean":"2024-09-17T01:49:17.687289+0000","last_became_active":"2024-09-17T01:49:16.699660+0000","last_became_peered":"2024-09-17T01:49:16.699660+0000","last_unstale":"2024-09-17T01:49:17.687289+0000","last_undegraded":"2024-09-17T01:49:17.687289+0000","last_fullsized":"2024-09-17T01:49:17.687289+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:40.345894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.33","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.691029+0000","last_change":"2024-09-17T01:49:16.702385+0000","last_active":"2024-09-17T01:49:17.691029+0000","last_peered":"2024-09-17T01:49:17.691029+0000","last_clean":"2024-09-17T01:49:17.691029+0000","last_became_active":"2024-09-17T01:49:16.700375+0000","last_became_peered":"2024-09-17T01:49:16.700375+0000","last_unstale":"2024-09-17T01:49:17.691029+0000","last_undegraded":"2024-09-17T01:49:17.691029+0000","last_fullsized":"2024-09-17T01:49:17.691029+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:40.690689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.32","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.690846+0000","last_change":"2024-09-17T01:49:16.688869+0000","last_active":"2024-09-17T01:49:17.690846+0000","last_peered":"2024-09-17T01:49:17.690846+0000","last_clean":"2024-09-17T01:49:17.690846+0000","last_became_active":"2024-09-17T01:49:16.687132+0000","last_became_peered":"2024-09-17T01:49:16.687132+0000","last_unstale":"2024-09-17T01:49:17.690846+0000","last_undegraded":"2024-09-17T01:49:17.690846+0000","last_fullsized":"2024-09-17T01:49:17.690846+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:56.341372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.31","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.689344+0000","last_change":"2024-09-17T01:49:16.692293+0000","last_active":"2024-09-17T01:49:17.689344+0000","last_peered":"2024-09-17T01:49:17.689344+0000","last_clean":"2024-09-17T01:49:17.689344+0000","last_became_active":"2024-09-17T01:49:16.691989+0000","last_became_peered":"2024-09-17T01:49:16.691989+0000","last_unstale":"2024-09-17T01:49:17.689344+0000","last_undegraded":"2024-09-17T01:49:17.689344+0000","last_fullsized":"2024-09-17T01:49:17.689344+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:20.373064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.30","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728273+0000","last_change":"2024-09-17T01:49:16.703636+0000","last_active":"2024-09-17T01:49:17.728273+0000","last_peered":"2024-09-17T01:49:17.728273+0000","last_clean":"2024-09-17T01:49:17.728273+0000","last_became_active":"2024-09-17T01:49:16.702392+0000","last_became_peered":"2024-09-17T01:49:16.702392+0000","last_unstale":"2024-09-17T01:49:17.728273+0000","last_undegraded":"2024-09-17T01:49:17.728273+0000","last_fullsized":"2024-09-17T01:49:17.728273+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:34:07.083552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.2f","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.691164+0000","last_change":"2024-09-17T01:49:16.695596+0000","last_active":"2024-09-17T01:49:17.691164+0000","last_peered":"2024-09-17T01:49:17.691164+0000","last_clean":"2024-09-17T01:49:17.691164+0000","last_became_active":"2024-09-17T01:49:16.695138+0000","last_became_peered":"2024-09-17T01:49:16.695138+0000","last_unstale":"2024-09-17T01:49:17.691164+0000","last_undegraded":"2024-09-17T01:49:17.691164+0000","last_fullsized":"2024-09-17T01:49:17.691164+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:40.492037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.2e","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.699198+0000","last_change":"2024-09-17T01:49:16.696899+0000","last_active":"2024-09-17T01:49:17.699198+0000","last_peered":"2024-09-17T01:49:17.699198+0000","last_clean":"2024-09-17T01:49:17.699198+0000","last_became_active":"2024-09-17T01:49:16.696068+0000","last_became_peered":"2024-09-17T01:49:16.696068+0000","last_unstale":"2024-09-17T01:49:17.699198+0000","last_undegraded":"2024-09-17T01:49:17.699198+0000","last_fullsized":"2024-09-17T01:49:17.699198+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:23:41.745768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.2d","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.687564+0000","last_change":"2024-09-17T01:49:16.694467+0000","last_active":"2024-09-17T01:49:17.687564+0000","last_peered":"2024-09-17T01:49:17.687564+0000","last_clean":"2024-09-17T01:49:17.687564+0000","last_became_active":"2024-09-17T01:49:16.692507+0000","last_became_peered":"2024-09-17T01:49:16.692507+0000","last_unstale":"2024-09-17T01:49:17.687564+0000","last_undegraded":"2024-09-17T01:49:17.687564+0000","last_fullsized":"2024-09-17T01:49:17.687564+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:17.097239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.2c","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.729516+0000","last_change":"2024-09-17T01:49:16.687914+0000","last_active":"2024-09-17T01:49:17.729516+0000","last_peered":"2024-09-17T01:49:17.729516+0000","last_clean":"2024-09-17T01:49:17.729516+0000","last_became_active":"2024-09-17T01:49:16.687547+0000","last_became_peered":"2024-09-17T01:49:16.687547+0000","last_unstale":"2024-09-17T01:49:17.729516+0000","last_undegraded":"2024-09-17T01:49:17.729516+0000","last_fullsized":"2024-09-17T01:49:17.729516+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:31.794929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.2b","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728795+0000","last_change":"2024-09-17T01:49:16.708254+0000","last_active":"2024-09-17T01:49:17.728795+0000","last_peered":"2024-09-17T01:49:17.728795+0000","last_clean":"2024-09-17T01:49:17.728795+0000","last_became_active":"2024-09-17T01:49:16.705345+0000","last_became_peered":"2024-09-17T01:49:16.705345+0000","last_unstale":"2024-09-17T01:49:17.728795+0000","last_undegraded":"2024-09-17T01:49:17.728795+0000","last_fullsized":"2024-09-17T01:49:17.728795+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:28.058553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.2a","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728815+0000","last_change":"2024-09-17T01:49:16.706980+0000","last_active":"2024-09-17T01:49:17.728815+0000","last_peered":"2024-09-17T01:49:17.728815+0000","last_clean":"2024-09-17T01:49:17.728815+0000","last_became_active":"2024-09-17T01:49:16.704927+0000","last_became_peered":"2024-09-17T01:49:16.704927+0000","last_unstale":"2024-09-17T01:49:17.728815+0000","last_undegraded":"2024-09-17T01:49:17.728815+0000","last_fullsized":"2024-09-17T01:49:17.728815+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:40.844513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.29","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.686998+0000","last_change":"2024-09-17T01:49:16.691681+0000","last_active":"2024-09-17T01:49:17.686998+0000","last_peered":"2024-09-17T01:49:17.686998+0000","last_clean":"2024-09-17T01:49:17.686998+0000","last_became_active":"2024-09-17T01:49:16.690892+0000","last_became_peered":"2024-09-17T01:49:16.690892+0000","last_unstale":"2024-09-17T01:49:17.686998+0000","last_undegraded":"2024-09-17T01:49:17.686998+0000","last_fullsized":"2024-09-17T01:49:17.686998+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:22.715738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.28","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728258+0000","last_change":"2024-09-17T01:49:16.699493+0000","last_active":"2024-09-17T01:49:17.728258+0000","last_peered":"2024-09-17T01:49:17.728258+0000","last_clean":"2024-09-17T01:49:17.728258+0000","last_became_active":"2024-09-17T01:49:16.699169+0000","last_became_peered":"2024-09-17T01:49:16.699169+0000","last_unstale":"2024-09-17T01:49:17.728258+0000","last_undegraded":"2024-09-17T01:49:17.728258+0000","last_fullsized":"2024-09-17T01:49:17.728258+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:17.651913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.27","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.729859+0000","last_change":"2024-09-17T01:49:16.716807+0000","last_active":"2024-09-17T01:49:17.729859+0000","last_peered":"2024-09-17T01:49:17.729859+0000","last_clean":"2024-09-17T01:49:17.729859+0000","last_became_active":"2024-09-17T01:49:16.716021+0000","last_became_peered":"2024-09-17T01:49:16.716021+0000","last_unstale":"2024-09-17T01:49:17.729859+0000","last_undegraded":"2024-09-17T01:49:17.729859+0000","last_fullsized":"2024-09-17T01:49:17.729859+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:35.653197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.26","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.729566+0000","last_change":"2024-09-17T01:49:16.689992+0000","last_active":"2024-09-17T01:49:17.729566+0000","last_peered":"2024-09-17T01:49:17.729566+0000","last_clean":"2024-09-17T01:49:17.729566+0000","last_became_active":"2024-09-17T01:49:16.689689+0000","last_became_peered":"2024-09-17T01:49:16.689689+0000","last_unstale":"2024-09-17T01:49:17.729566+0000","last_undegraded":"2024-09-17T01:49:17.729566+0000","last_fullsized":"2024-09-17T01:49:17.729566+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:53.842347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.25","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728199+0000","last_change":"2024-09-17T01:49:16.688085+0000","last_active":"2024-09-17T01:49:17.728199+0000","last_peered":"2024-09-17T01:49:17.728199+0000","last_clean":"2024-09-17T01:49:17.728199+0000","last_became_active":"2024-09-17T01:49:16.685625+0000","last_became_peered":"2024-09-17T01:49:16.685625+0000","last_unstale":"2024-09-17T01:49:17.728199+0000","last_undegraded":"2024-09-17T01:49:17.728199+0000","last_fullsized":"2024-09-17T01:49:17.728199+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:01.056977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.24","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.690210+0000","last_change":"2024-09-17T01:49:16.707275+0000","last_active":"2024-09-17T01:49:17.690210+0000","last_peered":"2024-09-17T01:49:17.690210+0000","last_clean":"2024-09-17T01:49:17.690210+0000","last_became_active":"2024-09-17T01:49:16.706940+0000","last_became_peered":"2024-09-17T01:49:16.706940+0000","last_unstale":"2024-09-17T01:49:17.690210+0000","last_undegraded":"2024-09-17T01:49:17.690210+0000","last_fullsized":"2024-09-17T01:49:17.690210+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:28.058553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.23","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.690646+0000","last_change":"2024-09-17T01:49:16.691519+0000","last_active":"2024-09-17T01:49:17.690646+0000","last_peered":"2024-09-17T01:49:17.690646+0000","last_clean":"2024-09-17T01:49:17.690646+0000","last_became_active":"2024-09-17T01:49:16.691160+0000","last_became_peered":"2024-09-17T01:49:16.691160+0000","last_unstale":"2024-09-17T01:49:17.690646+0000","last_undegraded":"2024-09-17T01:49:17.690646+0000","last_fullsized":"2024-09-17T01:49:17.690646+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:44.213730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.22","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.689898+0000","last_change":"2024-09-17T01:49:16.692960+0000","last_active":"2024-09-17T01:49:17.689898+0000","last_peered":"2024-09-17T01:49:17.689898+0000","last_clean":"2024-09-17T01:49:17.689898+0000","last_became_active":"2024-09-17T01:49:16.690490+0000","last_became_peered":"2024-09-17T01:49:16.690490+0000","last_unstale":"2024-09-17T01:49:17.689898+0000","last_undegraded":"2024-09-17T01:49:17.689898+0000","last_fullsized":"2024-09-17T01:49:17.689898+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:24.964578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.21","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728385+0000","last_change":"2024-09-17T01:49:16.698993+0000","last_active":"2024-09-17T01:49:17.728385+0000","last_peered":"2024-09-17T01:49:17.728385+0000","last_clean":"2024-09-17T01:49:17.728385+0000","last_became_active":"2024-09-17T01:49:16.698686+0000","last_became_peered":"2024-09-17T01:49:16.698686+0000","last_unstale":"2024-09-17T01:49:17.728385+0000","last_undegraded":"2024-09-17T01:49:17.728385+0000","last_fullsized":"2024-09-17T01:49:17.728385+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:50:08.406738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1e","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.729185+0000","last_change":"2024-09-17T01:49:16.685967+0000","last_active":"2024-09-17T01:49:17.729185+0000","last_peered":"2024-09-17T01:49:17.729185+0000","last_clean":"2024-09-17T01:49:17.729185+0000","last_became_active":"2024-09-17T01:49:16.685579+0000","last_became_peered":"2024-09-17T01:49:16.685579+0000","last_unstale":"2024-09-17T01:49:17.729185+0000","last_undegraded":"2024-09-17T01:49:17.729185+0000","last_fullsized":"2024-09-17T01:49:17.729185+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:50.427874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.1f","version":"225'4","reported_seq":19,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.729950+0000","last_change":"2024-09-17T01:49:15.694835+0000","last_active":"2024-09-17T01:49:17.729950+0000","last_peered":"2024-09-17T01:49:17.729950+0000","last_clean":"2024-09-17T01:49:17.729950+0000","last_became_active":"2024-09-17T01:49:15.693572+0000","last_became_peered":"2024-09-17T01:49:15.693572+0000","last_unstale":"2024-09-17T01:49:17.729950+0000","last_undegraded":"2024-09-17T01:49:17.729950+0000","last_fullsized":"2024-09-17T01:49:17.729950+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:45:54.697218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.1f","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.691437+0000","last_change":"2024-09-17T01:49:16.690760+0000","last_active":"2024-09-17T01:49:17.691437+0000","last_peered":"2024-09-17T01:49:17.691437+0000","last_clean":"2024-09-17T01:49:17.691437+0000","last_became_active":"2024-09-17T01:49:16.690436+0000","last_became_peered":"2024-09-17T01:49:16.690436+0000","last_unstale":"2024-09-17T01:49:17.691437+0000","last_undegraded":"2024-09-17T01:49:17.691437+0000","last_fullsized":"2024-09-17T01:49:17.691437+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:52.044984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.1e","version":"225'1","reported_seq":16,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.729308+0000","last_change":"2024-09-17T01:49:15.698452+0000","last_active":"2024-09-17T01:49:17.729308+0000","last_peered":"2024-09-17T01:49:17.729308+0000","last_clean":"2024-09-17T01:49:17.729308+0000","last_became_active":"2024-09-17T01:49:15.697645+0000","last_became_peered":"2024-09-17T01:49:15.697645+0000","last_unstale":"2024-09-17T01:49:17.729308+0000","last_undegraded":"2024-09-17T01:49:17.729308+0000","last_fullsized":"2024-09-17T01:49:17.729308+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:36.649779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.1c","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.687569+0000","last_change":"2024-09-17T01:49:16.703644+0000","last_active":"2024-09-17T01:49:17.687569+0000","last_peered":"2024-09-17T01:49:17.687569+0000","last_clean":"2024-09-17T01:49:17.687569+0000","last_became_active":"2024-09-17T01:49:16.703105+0000","last_became_peered":"2024-09-17T01:49:16.703105+0000","last_unstale":"2024-09-17T01:49:17.687569+0000","last_undegraded":"2024-09-17T01:49:17.687569+0000","last_fullsized":"2024-09-17T01:49:17.687569+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:06.109893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1d","version":"225'2","reported_seq":17,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.690276+0000","last_change":"2024-09-17T01:49:15.690681+0000","last_active":"2024-09-17T01:49:17.690276+0000","last_peered":"2024-09-17T01:49:17.690276+0000","last_clean":"2024-09-17T01:49:17.690276+0000","last_became_active":"2024-09-17T01:49:15.690294+0000","last_became_peered":"2024-09-17T01:49:15.690294+0000","last_unstale":"2024-09-17T01:49:17.690276+0000","last_undegraded":"2024-09-17T01:49:17.690276+0000","last_fullsized":"2024-09-17T01:49:17.690276+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:53.807459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.1d","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.698911+0000","last_change":"2024-09-17T01:49:16.703978+0000","last_active":"2024-09-17T01:49:17.698911+0000","last_peered":"2024-09-17T01:49:17.698911+0000","last_clean":"2024-09-17T01:49:17.698911+0000","last_became_active":"2024-09-17T01:49:16.703579+0000","last_became_peered":"2024-09-17T01:49:16.703579+0000","last_unstale":"2024-09-17T01:49:17.698911+0000","last_undegraded":"2024-09-17T01:49:17.698911+0000","last_fullsized":"2024-09-17T01:49:17.698911+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:26:17.439670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1c","version":"225'2","reported_seq":17,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.690479+0000","last_change":"2024-09-17T01:49:15.687825+0000","last_active":"2024-09-17T01:49:17.690479+0000","last_peered":"2024-09-17T01:49:17.690479+0000","last_clean":"2024-09-17T01:49:17.690479+0000","last_became_active":"2024-09-17T01:49:15.685453+0000","last_became_peered":"2024-09-17T01:49:15.685453+0000","last_unstale":"2024-09-17T01:49:17.690479+0000","last_undegraded":"2024-09-17T01:49:17.690479+0000","last_fullsized":"2024-09-17T01:49:17.690479+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:58.866704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.1a","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728588+0000","last_change":"2024-09-17T01:49:16.710061+0000","last_active":"2024-09-17T01:49:17.728588+0000","last_peered":"2024-09-17T01:49:17.728588+0000","last_clean":"2024-09-17T01:49:17.728588+0000","last_became_active":"2024-09-17T01:49:16.709713+0000","last_became_peered":"2024-09-17T01:49:16.709713+0000","last_unstale":"2024-09-17T01:49:17.728588+0000","last_undegraded":"2024-09-17T01:49:17.728588+0000","last_fullsized":"2024-09-17T01:49:17.728588+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:36:41.899473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.1b","version":"225'1","reported_seq":16,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.687064+0000","last_change":"2024-09-17T01:49:15.674338+0000","last_active":"2024-09-17T01:49:17.687064+0000","last_peered":"2024-09-17T01:49:17.687064+0000","last_clean":"2024-09-17T01:49:17.687064+0000","last_became_active":"2024-09-17T01:49:15.673719+0000","last_became_peered":"2024-09-17T01:49:15.673719+0000","last_unstale":"2024-09-17T01:49:17.687064+0000","last_undegraded":"2024-09-17T01:49:17.687064+0000","last_fullsized":"2024-09-17T01:49:17.687064+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:16.952068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.1b","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.729520+0000","last_change":"2024-09-17T01:49:16.683689+0000","last_active":"2024-09-17T01:49:17.729520+0000","last_peered":"2024-09-17T01:49:17.729520+0000","last_clean":"2024-09-17T01:49:17.729520+0000","last_became_active":"2024-09-17T01:49:16.683323+0000","last_became_peered":"2024-09-17T01:49:16.683323+0000","last_unstale":"2024-09-17T01:49:17.729520+0000","last_undegraded":"2024-09-17T01:49:17.729520+0000","last_fullsized":"2024-09-17T01:49:17.729520+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:17:59.986596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.1a","version":"225'1","reported_seq":16,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.690355+0000","last_change":"2024-09-17T01:49:15.692716+0000","last_active":"2024-09-17T01:49:17.690355+0000","last_peered":"2024-09-17T01:49:17.690355+0000","last_clean":"2024-09-17T01:49:17.690355+0000","last_became_active":"2024-09-17T01:49:15.692379+0000","last_became_peered":"2024-09-17T01:49:15.692379+0000","last_unstale":"2024-09-17T01:49:17.690355+0000","last_undegraded":"2024-09-17T01:49:17.690355+0000","last_fullsized":"2024-09-17T01:49:17.690355+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:45:22.191958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.18","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.689185+0000","last_change":"2024-09-17T01:49:16.700731+0000","last_active":"2024-09-17T01:49:17.689185+0000","last_peered":"2024-09-17T01:49:17.689185+0000","last_clean":"2024-09-17T01:49:17.689185+0000","last_became_active":"2024-09-17T01:49:16.700368+0000","last_became_peered":"2024-09-17T01:49:16.700368+0000","last_unstale":"2024-09-17T01:49:17.689185+0000","last_undegraded":"2024-09-17T01:49:17.689185+0000","last_fullsized":"2024-09-17T01:49:17.689185+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:47:18.045173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":15,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.698452+0000","last_change":"2024-09-17T01:49:15.677885+0000","last_active":"2024-09-17T01:49:17.698452+0000","last_peered":"2024-09-17T01:49:17.698452+0000","last_clean":"2024-09-17T01:49:17.698452+0000","last_became_active":"2024-09-17T01:49:15.677528+0000","last_became_peered":"2024-09-17T01:49:15.677528+0000","last_unstale":"2024-09-17T01:49:17.698452+0000","last_undegraded":"2024-09-17T01:49:17.698452+0000","last_fullsized":"2024-09-17T01:49:17.698452+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:27.696675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.19","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728549+0000","last_change":"2024-09-17T01:49:16.680854+0000","last_active":"2024-09-17T01:49:17.728549+0000","last_peered":"2024-09-17T01:49:17.728549+0000","last_clean":"2024-09-17T01:49:17.728549+0000","last_became_active":"2024-09-17T01:49:16.679856+0000","last_became_peered":"2024-09-17T01:49:16.679856+0000","last_unstale":"2024-09-17T01:49:17.728549+0000","last_undegraded":"2024-09-17T01:49:17.728549+0000","last_fullsized":"2024-09-17T01:49:17.728549+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:31.876318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":15,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.727711+0000","last_change":"2024-09-17T01:49:15.695392+0000","last_active":"2024-09-17T01:49:17.727711+0000","last_peered":"2024-09-17T01:49:17.727711+0000","last_clean":"2024-09-17T01:49:17.727711+0000","last_became_active":"2024-09-17T01:49:15.695057+0000","last_became_peered":"2024-09-17T01:49:15.695057+0000","last_unstale":"2024-09-17T01:49:17.727711+0000","last_undegraded":"2024-09-17T01:49:17.727711+0000","last_fullsized":"2024-09-17T01:49:17.727711+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:16.811219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.16","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728955+0000","last_change":"2024-09-17T01:49:16.688608+0000","last_active":"2024-09-17T01:49:17.728955+0000","last_peered":"2024-09-17T01:49:17.728955+0000","last_clean":"2024-09-17T01:49:17.728955+0000","last_became_active":"2024-09-17T01:49:16.688204+0000","last_became_peered":"2024-09-17T01:49:16.688204+0000","last_unstale":"2024-09-17T01:49:17.728955+0000","last_undegraded":"2024-09-17T01:49:17.728955+0000","last_fullsized":"2024-09-17T01:49:17.728955+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:42.783645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":15,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.729975+0000","last_change":"2024-09-17T01:49:15.695510+0000","last_active":"2024-09-17T01:49:17.729975+0000","last_peered":"2024-09-17T01:49:17.729975+0000","last_clean":"2024-09-17T01:49:17.729975+0000","last_became_active":"2024-09-17T01:49:15.695103+0000","last_became_peered":"2024-09-17T01:49:15.695103+0000","last_unstale":"2024-09-17T01:49:17.729975+0000","last_undegraded":"2024-09-17T01:49:17.729975+0000","last_fullsized":"2024-09-17T01:49:17.729975+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:19.323524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.17","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.729657+0000","last_change":"2024-09-17T01:49:16.708814+0000","last_active":"2024-09-17T01:49:17.729657+0000","last_peered":"2024-09-17T01:49:17.729657+0000","last_clean":"2024-09-17T01:49:17.729657+0000","last_became_active":"2024-09-17T01:49:16.708477+0000","last_became_peered":"2024-09-17T01:49:16.708477+0000","last_unstale":"2024-09-17T01:49:17.729657+0000","last_undegraded":"2024-09-17T01:49:17.729657+0000","last_fullsized":"2024-09-17T01:49:17.729657+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:45.221222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":15,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.691953+0000","last_change":"2024-09-17T01:49:15.691427+0000","last_active":"2024-09-17T01:49:17.691953+0000","last_peered":"2024-09-17T01:49:17.691953+0000","last_clean":"2024-09-17T01:49:17.691953+0000","last_became_active":"2024-09-17T01:49:15.691018+0000","last_became_peered":"2024-09-17T01:49:15.691018+0000","last_unstale":"2024-09-17T01:49:17.691953+0000","last_undegraded":"2024-09-17T01:49:17.691953+0000","last_fullsized":"2024-09-17T01:49:17.691953+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:59.730670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.14","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.690302+0000","last_change":"2024-09-17T01:49:16.700534+0000","last_active":"2024-09-17T01:49:17.690302+0000","last_peered":"2024-09-17T01:49:17.690302+0000","last_clean":"2024-09-17T01:49:17.690302+0000","last_became_active":"2024-09-17T01:49:16.700149+0000","last_became_peered":"2024-09-17T01:49:16.700149+0000","last_unstale":"2024-09-17T01:49:17.690302+0000","last_undegraded":"2024-09-17T01:49:17.690302+0000","last_fullsized":"2024-09-17T01:49:17.690302+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:53.269282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.15","version":"225'3","reported_seq":18,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.691795+0000","last_change":"2024-09-17T01:49:15.686987+0000","last_active":"2024-09-17T01:49:17.691795+0000","last_peered":"2024-09-17T01:49:17.691795+0000","last_clean":"2024-09-17T01:49:17.691795+0000","last_became_active":"2024-09-17T01:49:15.686654+0000","last_became_peered":"2024-09-17T01:49:15.686654+0000","last_unstale":"2024-09-17T01:49:17.691795+0000","last_undegraded":"2024-09-17T01:49:17.691795+0000","last_fullsized":"2024-09-17T01:49:17.691795+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:43.897581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.15","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.691843+0000","last_change":"2024-09-17T01:49:16.704833+0000","last_active":"2024-09-17T01:49:17.691843+0000","last_peered":"2024-09-17T01:49:17.691843+0000","last_clean":"2024-09-17T01:49:17.691843+0000","last_became_active":"2024-09-17T01:49:16.704176+0000","last_became_peered":"2024-09-17T01:49:16.704176+0000","last_unstale":"2024-09-17T01:49:17.691843+0000","last_undegraded":"2024-09-17T01:49:17.691843+0000","last_fullsized":"2024-09-17T01:49:17.691843+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:37.142304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.14","version":"225'6","reported_seq":21,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.729438+0000","last_change":"2024-09-17T01:49:15.687326+0000","last_active":"2024-09-17T01:49:17.729438+0000","last_peered":"2024-09-17T01:49:17.729438+0000","last_clean":"2024-09-17T01:49:17.729438+0000","last_became_active":"2024-09-17T01:49:15.686984+0000","last_became_peered":"2024-09-17T01:49:15.686984+0000","last_unstale":"2024-09-17T01:49:17.729438+0000","last_undegraded":"2024-09-17T01:49:17.729438+0000","last_fullsized":"2024-09-17T01:49:17.729438+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:23:34.426511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.12","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.690259+0000","last_change":"2024-09-17T01:49:16.691222+0000","last_active":"2024-09-17T01:49:17.690259+0000","last_peered":"2024-09-17T01:49:17.690259+0000","last_clean":"2024-09-17T01:49:17.690259+0000","last_became_active":"2024-09-17T01:49:16.690113+0000","last_became_peered":"2024-09-17T01:49:16.690113+0000","last_unstale":"2024-09-17T01:49:17.690259+0000","last_undegraded":"2024-09-17T01:49:17.690259+0000","last_fullsized":"2024-09-17T01:49:17.690259+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:07.831658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.13","version":"225'2","reported_seq":17,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728213+0000","last_change":"2024-09-17T01:49:15.681222+0000","last_active":"2024-09-17T01:49:17.728213+0000","last_peered":"2024-09-17T01:49:17.728213+0000","last_clean":"2024-09-17T01:49:17.728213+0000","last_became_active":"2024-09-17T01:49:15.680926+0000","last_became_peered":"2024-09-17T01:49:15.680926+0000","last_unstale":"2024-09-17T01:49:17.728213+0000","last_undegraded":"2024-09-17T01:49:17.728213+0000","last_fullsized":"2024-09-17T01:49:17.728213+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:28.823497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.13","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.690124+0000","last_change":"2024-09-17T01:49:16.688969+0000","last_active":"2024-09-17T01:49:17.690124+0000","last_peered":"2024-09-17T01:49:17.690124+0000","last_clean":"2024-09-17T01:49:17.690124+0000","last_became_active":"2024-09-17T01:49:16.687866+0000","last_became_peered":"2024-09-17T01:49:16.687866+0000","last_unstale":"2024-09-17T01:49:17.690124+0000","last_undegraded":"2024-09-17T01:49:17.690124+0000","last_fullsized":"2024-09-17T01:49:17.690124+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:45.779540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":15,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.690600+0000","last_change":"2024-09-17T01:49:15.687327+0000","last_active":"2024-09-17T01:49:17.690600+0000","last_peered":"2024-09-17T01:49:17.690600+0000","last_clean":"2024-09-17T01:49:17.690600+0000","last_became_active":"2024-09-17T01:49:15.686596+0000","last_became_peered":"2024-09-17T01:49:15.686596+0000","last_unstale":"2024-09-17T01:49:17.690600+0000","last_undegraded":"2024-09-17T01:49:17.690600+0000","last_fullsized":"2024-09-17T01:49:17.690600+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:41.265827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.10","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.689590+0000","last_change":"2024-09-17T01:49:16.691078+0000","last_active":"2024-09-17T01:49:17.689590+0000","last_peered":"2024-09-17T01:49:17.689590+0000","last_clean":"2024-09-17T01:49:17.689590+0000","last_became_active":"2024-09-17T01:49:16.690338+0000","last_became_peered":"2024-09-17T01:49:16.690338+0000","last_unstale":"2024-09-17T01:49:17.689590+0000","last_undegraded":"2024-09-17T01:49:17.689590+0000","last_fullsized":"2024-09-17T01:49:17.689590+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:42.692835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":15,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728721+0000","last_change":"2024-09-17T01:49:15.691139+0000","last_active":"2024-09-17T01:49:17.728721+0000","last_peered":"2024-09-17T01:49:17.728721+0000","last_clean":"2024-09-17T01:49:17.728721+0000","last_became_active":"2024-09-17T01:49:15.690420+0000","last_became_peered":"2024-09-17T01:49:15.690420+0000","last_unstale":"2024-09-17T01:49:17.728721+0000","last_undegraded":"2024-09-17T01:49:17.728721+0000","last_fullsized":"2024-09-17T01:49:17.728721+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:41.227881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.11","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.689155+0000","last_change":"2024-09-17T01:49:16.690180+0000","last_active":"2024-09-17T01:49:17.689155+0000","last_peered":"2024-09-17T01:49:17.689155+0000","last_clean":"2024-09-17T01:49:17.689155+0000","last_became_active":"2024-09-17T01:49:16.687096+0000","last_became_peered":"2024-09-17T01:49:16.687096+0000","last_unstale":"2024-09-17T01:49:17.689155+0000","last_undegraded":"2024-09-17T01:49:17.689155+0000","last_fullsized":"2024-09-17T01:49:17.689155+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:11.760530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.10","version":"225'8","reported_seq":23,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728058+0000","last_change":"2024-09-17T01:49:15.694803+0000","last_active":"2024-09-17T01:49:17.728058+0000","last_peered":"2024-09-17T01:49:17.728058+0000","last_clean":"2024-09-17T01:49:17.728058+0000","last_became_active":"2024-09-17T01:49:15.694275+0000","last_became_peered":"2024-09-17T01:49:15.694275+0000","last_unstale":"2024-09-17T01:49:17.728058+0000","last_undegraded":"2024-09-17T01:49:17.728058+0000","last_fullsized":"2024-09-17T01:49:17.728058+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:03.865807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.e","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.692202+0000","last_change":"2024-09-17T01:49:16.691830+0000","last_active":"2024-09-17T01:49:17.692202+0000","last_peered":"2024-09-17T01:49:17.692202+0000","last_clean":"2024-09-17T01:49:17.692202+0000","last_became_active":"2024-09-17T01:49:16.691331+0000","last_became_peered":"2024-09-17T01:49:16.691331+0000","last_unstale":"2024-09-17T01:49:17.692202+0000","last_undegraded":"2024-09-17T01:49:17.692202+0000","last_fullsized":"2024-09-17T01:49:17.692202+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:47:40.061995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.f","version":"225'1","reported_seq":16,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728973+0000","last_change":"2024-09-17T01:49:15.684903+0000","last_active":"2024-09-17T01:49:17.728973+0000","last_peered":"2024-09-17T01:49:17.728973+0000","last_clean":"2024-09-17T01:49:17.728973+0000","last_became_active":"2024-09-17T01:49:15.684552+0000","last_became_peered":"2024-09-17T01:49:15.684552+0000","last_unstale":"2024-09-17T01:49:17.728973+0000","last_undegraded":"2024-09-17T01:49:17.728973+0000","last_fullsized":"2024-09-17T01:49:17.728973+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:03.807961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.f","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.698928+0000","last_change":"2024-09-17T01:49:16.703292+0000","last_active":"2024-09-17T01:49:17.698928+0000","last_peered":"2024-09-17T01:49:17.698928+0000","last_clean":"2024-09-17T01:49:17.698928+0000","last_became_active":"2024-09-17T01:49:16.702981+0000","last_became_peered":"2024-09-17T01:49:16.702981+0000","last_unstale":"2024-09-17T01:49:17.698928+0000","last_undegraded":"2024-09-17T01:49:17.698928+0000","last_fullsized":"2024-09-17T01:49:17.698928+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:41:48.664464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.e","version":"225'2","reported_seq":17,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.690622+0000","last_change":"2024-09-17T01:49:15.685289+0000","last_active":"2024-09-17T01:49:17.690622+0000","last_peered":"2024-09-17T01:49:17.690622+0000","last_clean":"2024-09-17T01:49:17.690622+0000","last_became_active":"2024-09-17T01:49:15.684960+0000","last_became_peered":"2024-09-17T01:49:15.684960+0000","last_unstale":"2024-09-17T01:49:17.690622+0000","last_undegraded":"2024-09-17T01:49:17.690622+0000","last_fullsized":"2024-09-17T01:49:17.690622+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:09.732082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.c","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.729301+0000","last_change":"2024-09-17T01:49:16.689930+0000","last_active":"2024-09-17T01:49:17.729301+0000","last_peered":"2024-09-17T01:49:17.729301+0000","last_clean":"2024-09-17T01:49:17.729301+0000","last_became_active":"2024-09-17T01:49:16.689582+0000","last_became_peered":"2024-09-17T01:49:16.689582+0000","last_unstale":"2024-09-17T01:49:17.729301+0000","last_undegraded":"2024-09-17T01:49:17.729301+0000","last_fullsized":"2024-09-17T01:49:17.729301+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:40.215308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.d","version":"225'1","reported_seq":16,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.687390+0000","last_change":"2024-09-17T01:49:15.694042+0000","last_active":"2024-09-17T01:49:17.687390+0000","last_peered":"2024-09-17T01:49:17.687390+0000","last_clean":"2024-09-17T01:49:17.687390+0000","last_became_active":"2024-09-17T01:49:15.693636+0000","last_became_peered":"2024-09-17T01:49:15.693636+0000","last_unstale":"2024-09-17T01:49:17.687390+0000","last_undegraded":"2024-09-17T01:49:17.687390+0000","last_fullsized":"2024-09-17T01:49:17.687390+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:03.360686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.d","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728635+0000","last_change":"2024-09-17T01:49:16.685886+0000","last_active":"2024-09-17T01:49:17.728635+0000","last_peered":"2024-09-17T01:49:17.728635+0000","last_clean":"2024-09-17T01:49:17.728635+0000","last_became_active":"2024-09-17T01:49:16.682670+0000","last_became_peered":"2024-09-17T01:49:16.682670+0000","last_unstale":"2024-09-17T01:49:17.728635+0000","last_undegraded":"2024-09-17T01:49:17.728635+0000","last_fullsized":"2024-09-17T01:49:17.728635+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:37.209828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":15,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.691158+0000","last_change":"2024-09-17T01:49:15.692026+0000","last_active":"2024-09-17T01:49:17.691158+0000","last_peered":"2024-09-17T01:49:17.691158+0000","last_clean":"2024-09-17T01:49:17.691158+0000","last_became_active":"2024-09-17T01:49:15.690827+0000","last_became_peered":"2024-09-17T01:49:15.690827+0000","last_unstale":"2024-09-17T01:49:17.691158+0000","last_undegraded":"2024-09-17T01:49:17.691158+0000","last_fullsized":"2024-09-17T01:49:17.691158+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:38.619136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.a","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.690402+0000","last_change":"2024-09-17T01:49:16.703011+0000","last_active":"2024-09-17T01:49:17.690402+0000","last_peered":"2024-09-17T01:49:17.690402+0000","last_clean":"2024-09-17T01:49:17.690402+0000","last_became_active":"2024-09-17T01:49:16.699564+0000","last_became_peered":"2024-09-17T01:49:16.699564+0000","last_unstale":"2024-09-17T01:49:17.690402+0000","last_undegraded":"2024-09-17T01:49:17.690402+0000","last_fullsized":"2024-09-17T01:49:17.690402+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:55:19.808839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.b","version":"225'2","reported_seq":17,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728333+0000","last_change":"2024-09-17T01:49:15.684772+0000","last_active":"2024-09-17T01:49:17.728333+0000","last_peered":"2024-09-17T01:49:17.728333+0000","last_clean":"2024-09-17T01:49:17.728333+0000","last_became_active":"2024-09-17T01:49:15.683720+0000","last_became_peered":"2024-09-17T01:49:15.683720+0000","last_unstale":"2024-09-17T01:49:17.728333+0000","last_undegraded":"2024-09-17T01:49:17.728333+0000","last_fullsized":"2024-09-17T01:49:17.728333+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:42:34.650460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.b","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.691473+0000","last_change":"2024-09-17T01:49:16.703716+0000","last_active":"2024-09-17T01:49:17.691473+0000","last_peered":"2024-09-17T01:49:17.691473+0000","last_clean":"2024-09-17T01:49:17.691473+0000","last_became_active":"2024-09-17T01:49:16.703383+0000","last_became_peered":"2024-09-17T01:49:16.703383+0000","last_unstale":"2024-09-17T01:49:17.691473+0000","last_undegraded":"2024-09-17T01:49:17.691473+0000","last_fullsized":"2024-09-17T01:49:17.691473+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:26:25.924436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":15,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.686783+0000","last_change":"2024-09-17T01:49:15.682604+0000","last_active":"2024-09-17T01:49:17.686783+0000","last_peered":"2024-09-17T01:49:17.686783+0000","last_clean":"2024-09-17T01:49:17.686783+0000","last_became_active":"2024-09-17T01:49:15.681623+0000","last_became_peered":"2024-09-17T01:49:15.681623+0000","last_unstale":"2024-09-17T01:49:17.686783+0000","last_undegraded":"2024-09-17T01:49:17.686783+0000","last_fullsized":"2024-09-17T01:49:17.686783+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:17.238491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.8","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.689091+0000","last_change":"2024-09-17T01:49:16.687053+0000","last_active":"2024-09-17T01:49:17.689091+0000","last_peered":"2024-09-17T01:49:17.689091+0000","last_clean":"2024-09-17T01:49:17.689091+0000","last_became_active":"2024-09-17T01:49:16.686670+0000","last_became_peered":"2024-09-17T01:49:16.686670+0000","last_unstale":"2024-09-17T01:49:17.689091+0000","last_undegraded":"2024-09-17T01:49:17.689091+0000","last_fullsized":"2024-09-17T01:49:17.689091+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:29.634390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":15,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.687071+0000","last_change":"2024-09-17T01:49:15.683528+0000","last_active":"2024-09-17T01:49:17.687071+0000","last_peered":"2024-09-17T01:49:17.687071+0000","last_clean":"2024-09-17T01:49:17.687071+0000","last_became_active":"2024-09-17T01:49:15.683236+0000","last_became_peered":"2024-09-17T01:49:15.683236+0000","last_unstale":"2024-09-17T01:49:17.687071+0000","last_undegraded":"2024-09-17T01:49:17.687071+0000","last_fullsized":"2024-09-17T01:49:17.687071+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:28.978354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.9","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728401+0000","last_change":"2024-09-17T01:49:16.708587+0000","last_active":"2024-09-17T01:49:17.728401+0000","last_peered":"2024-09-17T01:49:17.728401+0000","last_clean":"2024-09-17T01:49:17.728401+0000","last_became_active":"2024-09-17T01:49:16.708241+0000","last_became_peered":"2024-09-17T01:49:16.708241+0000","last_unstale":"2024-09-17T01:49:17.728401+0000","last_undegraded":"2024-09-17T01:49:17.728401+0000","last_fullsized":"2024-09-17T01:49:17.728401+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:02.893331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":15,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.698425+0000","last_change":"2024-09-17T01:49:15.683532+0000","last_active":"2024-09-17T01:49:17.698425+0000","last_peered":"2024-09-17T01:49:17.698425+0000","last_clean":"2024-09-17T01:49:17.698425+0000","last_became_active":"2024-09-17T01:49:15.683187+0000","last_became_peered":"2024-09-17T01:49:15.683187+0000","last_unstale":"2024-09-17T01:49:17.698425+0000","last_undegraded":"2024-09-17T01:49:17.698425+0000","last_fullsized":"2024-09-17T01:49:17.698425+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:57:21.170899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.6","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.729303+0000","last_change":"2024-09-17T01:49:16.699946+0000","last_active":"2024-09-17T01:49:17.729303+0000","last_peered":"2024-09-17T01:49:17.729303+0000","last_clean":"2024-09-17T01:49:17.729303+0000","last_became_active":"2024-09-17T01:49:16.698850+0000","last_became_peered":"2024-09-17T01:49:16.698850+0000","last_unstale":"2024-09-17T01:49:17.729303+0000","last_undegraded":"2024-09-17T01:49:17.729303+0000","last_fullsized":"2024-09-17T01:49:17.729303+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:17.269158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.7","version":"225'2","reported_seq":17,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.692101+0000","last_change":"2024-09-17T01:49:15.694080+0000","last_active":"2024-09-17T01:49:17.692101+0000","last_peered":"2024-09-17T01:49:17.692101+0000","last_clean":"2024-09-17T01:49:17.692101+0000","last_became_active":"2024-09-17T01:49:15.693718+0000","last_became_peered":"2024-09-17T01:49:15.693718+0000","last_unstale":"2024-09-17T01:49:17.692101+0000","last_undegraded":"2024-09-17T01:49:17.692101+0000","last_fullsized":"2024-09-17T01:49:17.692101+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:07:04.297489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.7","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.729892+0000","last_change":"2024-09-17T01:49:16.710946+0000","last_active":"2024-09-17T01:49:17.729892+0000","last_peered":"2024-09-17T01:49:17.729892+0000","last_clean":"2024-09-17T01:49:17.729892+0000","last_became_active":"2024-09-17T01:49:16.710612+0000","last_became_peered":"2024-09-17T01:49:16.710612+0000","last_unstale":"2024-09-17T01:49:17.729892+0000","last_undegraded":"2024-09-17T01:49:17.729892+0000","last_fullsized":"2024-09-17T01:49:17.729892+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:03:20.732685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.6","version":"226'1","reported_seq":16,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.687408+0000","last_change":"2024-09-17T01:49:15.686534+0000","last_active":"2024-09-17T01:49:17.687408+0000","last_peered":"2024-09-17T01:49:17.687408+0000","last_clean":"2024-09-17T01:49:17.687408+0000","last_became_active":"2024-09-17T01:49:15.685192+0000","last_became_peered":"2024-09-17T01:49:15.685192+0000","last_unstale":"2024-09-17T01:49:17.687408+0000","last_undegraded":"2024-09-17T01:49:17.687408+0000","last_fullsized":"2024-09-17T01:49:17.687408+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:32.611775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.4","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.687615+0000","last_change":"2024-09-17T01:49:16.684498+0000","last_active":"2024-09-17T01:49:17.687615+0000","last_peered":"2024-09-17T01:49:17.687615+0000","last_clean":"2024-09-17T01:49:17.687615+0000","last_became_active":"2024-09-17T01:49:16.684174+0000","last_became_peered":"2024-09-17T01:49:16.684174+0000","last_unstale":"2024-09-17T01:49:17.687615+0000","last_undegraded":"2024-09-17T01:49:17.687615+0000","last_fullsized":"2024-09-17T01:49:17.687615+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:19.253256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":15,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.687530+0000","last_change":"2024-09-17T01:49:15.680479+0000","last_active":"2024-09-17T01:49:17.687530+0000","last_peered":"2024-09-17T01:49:17.687530+0000","last_clean":"2024-09-17T01:49:17.687530+0000","last_became_active":"2024-09-17T01:49:15.679834+0000","last_became_peered":"2024-09-17T01:49:15.679834+0000","last_unstale":"2024-09-17T01:49:17.687530+0000","last_undegraded":"2024-09-17T01:49:17.687530+0000","last_fullsized":"2024-09-17T01:49:17.687530+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:31.610323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.5","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728567+0000","last_change":"2024-09-17T01:49:16.681224+0000","last_active":"2024-09-17T01:49:17.728567+0000","last_peered":"2024-09-17T01:49:17.728567+0000","last_clean":"2024-09-17T01:49:17.728567+0000","last_became_active":"2024-09-17T01:49:16.680919+0000","last_became_peered":"2024-09-17T01:49:16.680919+0000","last_unstale":"2024-09-17T01:49:17.728567+0000","last_undegraded":"2024-09-17T01:49:17.728567+0000","last_fullsized":"2024-09-17T01:49:17.728567+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:39.447761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":15,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.729536+0000","last_change":"2024-09-17T01:49:15.679485+0000","last_active":"2024-09-17T01:49:17.729536+0000","last_peered":"2024-09-17T01:49:17.729536+0000","last_clean":"2024-09-17T01:49:17.729536+0000","last_became_active":"2024-09-17T01:49:15.677626+0000","last_became_peered":"2024-09-17T01:49:15.677626+0000","last_unstale":"2024-09-17T01:49:17.729536+0000","last_undegraded":"2024-09-17T01:49:17.729536+0000","last_fullsized":"2024-09-17T01:49:17.729536+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:36.198124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.2","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728557+0000","last_change":"2024-09-17T01:49:16.689494+0000","last_active":"2024-09-17T01:49:17.728557+0000","last_peered":"2024-09-17T01:49:17.728557+0000","last_clean":"2024-09-17T01:49:17.728557+0000","last_became_active":"2024-09-17T01:49:16.689193+0000","last_became_peered":"2024-09-17T01:49:16.689193+0000","last_unstale":"2024-09-17T01:49:17.728557+0000","last_undegraded":"2024-09-17T01:49:17.728557+0000","last_fullsized":"2024-09-17T01:49:17.728557+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:03.975979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":15,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728898+0000","last_change":"2024-09-17T01:49:15.693617+0000","last_active":"2024-09-17T01:49:17.728898+0000","last_peered":"2024-09-17T01:49:17.728898+0000","last_clean":"2024-09-17T01:49:17.728898+0000","last_became_active":"2024-09-17T01:49:15.693270+0000","last_became_peered":"2024-09-17T01:49:15.693270+0000","last_unstale":"2024-09-17T01:49:17.728898+0000","last_undegraded":"2024-09-17T01:49:17.728898+0000","last_fullsized":"2024-09-17T01:49:17.728898+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:53.967028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.3","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.691400+0000","last_change":"2024-09-17T01:49:16.697484+0000","last_active":"2024-09-17T01:49:17.691400+0000","last_peered":"2024-09-17T01:49:17.691400+0000","last_clean":"2024-09-17T01:49:17.691400+0000","last_became_active":"2024-09-17T01:49:16.697135+0000","last_became_peered":"2024-09-17T01:49:16.697135+0000","last_unstale":"2024-09-17T01:49:17.691400+0000","last_undegraded":"2024-09-17T01:49:17.691400+0000","last_fullsized":"2024-09-17T01:49:17.691400+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:02:44.754497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":15,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728707+0000","last_change":"2024-09-17T01:49:15.677987+0000","last_active":"2024-09-17T01:49:17.728707+0000","last_peered":"2024-09-17T01:49:17.728707+0000","last_clean":"2024-09-17T01:49:17.728707+0000","last_became_active":"2024-09-17T01:49:15.677646+0000","last_became_peered":"2024-09-17T01:49:15.677646+0000","last_unstale":"2024-09-17T01:49:17.728707+0000","last_undegraded":"2024-09-17T01:49:17.728707+0000","last_fullsized":"2024-09-17T01:49:17.728707+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:49.625679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.0","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.689483+0000","last_change":"2024-09-17T01:49:16.692102+0000","last_active":"2024-09-17T01:49:17.689483+0000","last_peered":"2024-09-17T01:49:17.689483+0000","last_clean":"2024-09-17T01:49:17.689483+0000","last_became_active":"2024-09-17T01:49:16.691766+0000","last_became_peered":"2024-09-17T01:49:16.691766+0000","last_unstale":"2024-09-17T01:49:17.689483+0000","last_undegraded":"2024-09-17T01:49:17.689483+0000","last_fullsized":"2024-09-17T01:49:17.689483+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:07.127188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":15,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.689240+0000","last_change":"2024-09-17T01:49:15.687769+0000","last_active":"2024-09-17T01:49:17.689240+0000","last_peered":"2024-09-17T01:49:17.689240+0000","last_clean":"2024-09-17T01:49:17.689240+0000","last_became_active":"2024-09-17T01:49:15.687402+0000","last_became_peered":"2024-09-17T01:49:15.687402+0000","last_unstale":"2024-09-17T01:49:17.689240+0000","last_undegraded":"2024-09-17T01:49:17.689240+0000","last_fullsized":"2024-09-17T01:49:17.689240+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:49.697150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.1","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728831+0000","last_change":"2024-09-17T01:49:16.697832+0000","last_active":"2024-09-17T01:49:17.728831+0000","last_peered":"2024-09-17T01:49:17.728831+0000","last_clean":"2024-09-17T01:49:17.728831+0000","last_became_active":"2024-09-17T01:49:16.697489+0000","last_became_peered":"2024-09-17T01:49:16.697489+0000","last_unstale":"2024-09-17T01:49:17.728831+0000","last_undegraded":"2024-09-17T01:49:17.728831+0000","last_fullsized":"2024-09-17T01:49:17.728831+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:16.063681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":15,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.728219+0000","last_change":"2024-09-17T01:49:15.676538+0000","last_active":"2024-09-17T01:49:17.728219+0000","last_peered":"2024-09-17T01:49:17.728219+0000","last_clean":"2024-09-17T01:49:17.728219+0000","last_became_active":"2024-09-17T01:49:15.676080+0000","last_became_peered":"2024-09-17T01:49:15.676080+0000","last_unstale":"2024-09-17T01:49:17.728219+0000","last_undegraded":"2024-09-17T01:49:17.728219+0000","last_fullsized":"2024-09-17T01:49:17.728219+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":223,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:14.655203+0000","last_clean_scrub_stamp":"2024-09-17T01:49:14.655203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:44.721052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.20","version":"0'0","reported_seq":13,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.727808+0000","last_change":"2024-09-17T01:49:16.683008+0000","last_active":"2024-09-17T01:49:17.727808+0000","last_peered":"2024-09-17T01:49:17.727808+0000","last_clean":"2024-09-17T01:49:17.727808+0000","last_became_active":"2024-09-17T01:49:16.682646+0000","last_became_peered":"2024-09-17T01:49:16.682646+0000","last_unstale":"2024-09-17T01:49:17.727808+0000","last_undegraded":"2024-09-17T01:49:17.727808+0000","last_fullsized":"2024-09-17T01:49:17.727808+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":224,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:49:15.657939+0000","last_clean_scrub_stamp":"2024-09-17T01:49:15.657939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:43.848241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":503,"reported_epoch":226,"state":"active+clean","last_fresh":"2024-09-17T01:49:17.686867+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:49:17.686867+0000","last_peered":"2024-09-17T01:49:17.686867+0000","last_clean":"2024-09-17T01:49:17.686867+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:49:17.686867+0000","last_undegraded":"2024-09-17T01:49:17.686867+0000","last_fullsized":"2024-09-17T01:49:17.686867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":33,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":32,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476949,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52040,"kb_used_data":2800,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319800,"statfs":{"total":96636764160,"available":96583475200,"internally_reserved":0,"allocated":2867200,"data_stored":1266748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509652,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60356,"kb_used_data":2796,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311484,"statfs":{"total":96636764160,"available":96574959616,"internally_reserved":0,"allocated":2863104,"data_stored":1265800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509651,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47872,"kb_used_data":2788,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323968,"statfs":{"total":96636764160,"available":96587743232,"internally_reserved":0,"allocated":2854912,"data_stored":1265204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509652,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52040,"kb_used_data":2800,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319800,"statfs":{"total":96636764160,"available":96583475200,"internally_reserved":0,"allocated":2867200,"data_stored":1267308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509652,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70012,"kb_used_data":2788,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94301828,"statfs":{"total":96636764160,"available":96565071872,"internally_reserved":0,"allocated":2854912,"data_stored":1265148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509651,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52616,"kb_used_data":3372,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319224,"statfs":{"total":96636764160,"available":96582885376,"internally_reserved":0,"allocated":3452928,"data_stored":1855574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509653,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60352,"kb_used_data":2788,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311488,"statfs":{"total":96636764160,"available":96574963712,"internally_reserved":0,"allocated":2854912,"data_stored":1265204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":58915273},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542357,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52608,"kb_used_data":3364,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319232,"statfs":{"total":96636764160,"available":96582893568,"internally_reserved":0,"allocated":3444736,"data_stored":1855482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:49:21.658 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T01:49:21.658 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T01:49:21.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.933+0000 7efeff200640 1 -- 172.21.15.42:0/937187077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efee4003fd0 msgr2=0x7efee4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:21.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.933+0000 7efeff200640 1 --2- 172.21.15.42:0/937187077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efee4003fd0 0x7efee4004800 secure :-1 s=READY pgs=2545 cs=0 l=1 rev1=1 crypto rx=0x7eff000cb890 tx=0x7efee4005830 comp rx=0 tx=0).stop 2024-09-17T01:49:21.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.933+0000 7efefe800640 1 -- 172.21.15.42:0/937187077 reap_dead start 2024-09-17T01:49:21.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.933+0000 7efeff200640 1 -- 172.21.15.42:0/937187077 shutdown_connections 2024-09-17T01:49:21.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.933+0000 7efeff200640 1 -- 172.21.15.42:0/937187077 >> 172.21.15.42:0/937187077 conn(0x7eff00073c60 msgr2=0x7eff0006cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:21.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.933+0000 7efeff200640 1 -- 172.21.15.42:0/937187077 shutdown_connections 2024-09-17T01:49:21.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.933+0000 7efeff200640 1 -- 172.21.15.42:0/937187077 wait complete. 2024-09-17T01:49:21.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.935+0000 7efeff200640 1 Processor -- start 2024-09-17T01:49:21.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.935+0000 7efeff200640 1 -- start start 2024-09-17T01:49:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.937+0000 7efeff200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efee4003fd0 0x7eff000b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.937+0000 7efeff200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7eff00146350 0x7eff000ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.937+0000 7efeff200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff000ab700 0x7eff001f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.937+0000 7efeff200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7eff000d1850 con 0x7eff000ab700 2024-09-17T01:49:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.937+0000 7efeff200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7eff000d16d0 con 0x7efee4003fd0 2024-09-17T01:49:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.937+0000 7efeff200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7eff000d19d0 con 0x7eff00146350 2024-09-17T01:49:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.937+0000 7efefe800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff000ab700 0x7eff001f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.937+0000 7efefe800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff000ab700 0x7eff001f7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41614/0 (socket says 172.21.15.42:41614) 2024-09-17T01:49:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.937+0000 7efefe800640 1 -- 172.21.15.42:0/3688417403 learned_addr learned my addr 172.21.15.42:0/3688417403 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.937+0000 7efef5400640 1 --2- 172.21.15.42:0/3688417403 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7eff00146350 0x7eff000ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.937+0000 7efefde00640 1 --2- 172.21.15.42:0/3688417403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efee4003fd0 0x7eff000b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.937+0000 7efefe800640 1 -- 172.21.15.42:0/3688417403 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7eff00146350 msgr2=0x7eff000ab1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.937+0000 7efefe800640 1 --2- 172.21.15.42:0/3688417403 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7eff00146350 0x7eff000ab1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.937+0000 7efefe800640 1 -- 172.21.15.42:0/3688417403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efee4003fd0 msgr2=0x7eff000b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.937+0000 7efefe800640 1 --2- 172.21.15.42:0/3688417403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efee4003fd0 0x7eff000b5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.937+0000 7efefe800640 1 -- 172.21.15.42:0/3688417403 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff000abb10 con 0x7eff000ab700 2024-09-17T01:49:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.938+0000 7efefe800640 1 --2- 172.21.15.42:0/3688417403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff000ab700 0x7eff001f7dd0 secure :-1 s=READY pgs=2546 cs=0 l=1 rev1=1 crypto rx=0x7efef8005fd0 tx=0x7efef8010e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.938+0000 7efef6a00640 1 -- 172.21.15.42:0/3688417403 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef800ee20 con 0x7eff000ab700 2024-09-17T01:49:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.938+0000 7efef6a00640 1 -- 172.21.15.42:0/3688417403 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efef8015070 con 0x7eff000ab700 2024-09-17T01:49:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.938+0000 7efef6a00640 1 -- 172.21.15.42:0/3688417403 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef8003d00 con 0x7eff000ab700 2024-09-17T01:49:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.938+0000 7efeff200640 1 -- 172.21.15.42:0/3688417403 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff000b5fc0 con 0x7eff000ab700 2024-09-17T01:49:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.938+0000 7efeff200640 1 -- 172.21.15.42:0/3688417403 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff00147130 con 0x7eff000ab700 2024-09-17T01:49:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.939+0000 7efeff200640 1 -- 172.21.15.42:0/3688417403 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff0015fbb0 con 0x7eff000ab700 2024-09-17T01:49:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.941+0000 7efef6a00640 1 -- 172.21.15.42:0/3688417403 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efef8004030 con 0x7eff000ab700 2024-09-17T01:49:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.941+0000 7efef6a00640 1 --2- 172.21.15.42:0/3688417403 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efedc078b90 0x7efedc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.942+0000 7efef6a00640 1 -- 172.21.15.42:0/3688417403 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 5709+0+0 (secure 0 0 0) 0x7efef809b420 con 0x7eff000ab700 2024-09-17T01:49:21.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.942+0000 7efefde00640 1 --2- 172.21.15.42:0/3688417403 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efedc078b90 0x7efedc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:21.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.943+0000 7efefde00640 1 --2- 172.21.15.42:0/3688417403 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efedc078b90 0x7efedc07b0a0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7efef0006b90 tx=0x7efef00067a0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:21.946+0000 7efef6a00640 1 -- 172.21.15.42:0/3688417403 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7eff000abb10 con 0x7eff000ab700 2024-09-17T01:49:22.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.214+0000 7efeff200640 1 -- 172.21.15.42:0/3688417403 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7eff00146bc0 con 0x7eff000ab700 2024-09-17T01:49:22.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.217+0000 7efef6a00640 1 -- 172.21.15.42:0/3688417403 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v46) ==== 190+0+147 (secure 0 0 0) 0x7efef8063170 con 0x7eff000ab700 2024-09-17T01:49:22.215 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-09-17T01:49:22.215 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDN2+hmiCYRGRAA+gYtgrtJ2yzbGeUVn2Q9DA== 2024-09-17T01:49:22.215 INFO:teuthology.orchestra.run.smithi042.stdout: caps mds = "allow" 2024-09-17T01:49:22.215 INFO:teuthology.orchestra.run.smithi042.stdout: caps mon = "allow r" 2024-09-17T01:49:22.215 INFO:teuthology.orchestra.run.smithi042.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T01:49:22.216 INFO:teuthology.orchestra.run.smithi042.stderr:updated caps for client.0 2024-09-17T01:49:22.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.220+0000 7efeff200640 1 -- 172.21.15.42:0/3688417403 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efedc078b90 msgr2=0x7efedc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:22.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.220+0000 7efeff200640 1 --2- 172.21.15.42:0/3688417403 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efedc078b90 0x7efedc07b0a0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7efef0006b90 tx=0x7efef00067a0 comp rx=0 tx=0).stop 2024-09-17T01:49:22.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.220+0000 7efeff200640 1 -- 172.21.15.42:0/3688417403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff000ab700 msgr2=0x7eff001f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:22.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.220+0000 7efeff200640 1 --2- 172.21.15.42:0/3688417403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff000ab700 0x7eff001f7dd0 secure :-1 s=READY pgs=2546 cs=0 l=1 rev1=1 crypto rx=0x7efef8005fd0 tx=0x7efef8010e50 comp rx=0 tx=0).stop 2024-09-17T01:49:22.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.220+0000 7efeff200640 1 -- 172.21.15.42:0/3688417403 shutdown_connections 2024-09-17T01:49:22.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.220+0000 7efeff200640 1 --2- 172.21.15.42:0/3688417403 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7efedc078b90 0x7efedc07b0a0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:22.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.220+0000 7efeff200640 1 --2- 172.21.15.42:0/3688417403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7eff000ab700 0x7eff001f7dd0 unknown :-1 s=CLOSED pgs=2546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:22.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.220+0000 7efeff200640 1 --2- 172.21.15.42:0/3688417403 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7eff00146350 0x7eff000ab1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:22.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.220+0000 7efeff200640 1 --2- 172.21.15.42:0/3688417403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efee4003fd0 0x7eff000b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:22.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.220+0000 7efeff200640 1 -- 172.21.15.42:0/3688417403 >> 172.21.15.42:0/3688417403 conn(0x7eff00073c60 msgr2=0x7eff001589c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:22.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.220+0000 7efeff200640 1 -- 172.21.15.42:0/3688417403 shutdown_connections 2024-09-17T01:49:22.219 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.220+0000 7efeff200640 1 -- 172.21.15.42:0/3688417403 wait complete. 2024-09-17T01:49:22.244 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:49:22.456 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:49:22.460 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:49:22.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.475+0000 7f359c400640 1 -- 172.21.15.42:0/963199791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f357c003c10 msgr2=0x7f357c004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:22.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.475+0000 7f359c400640 1 --2- 172.21.15.42:0/963199791 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f357c003c10 0x7f357c004060 secure :-1 s=READY pgs=2548 cs=0 l=1 rev1=1 crypto rx=0x7f3594074260 tx=0x7f357c005830 comp rx=0 tx=0).stop 2024-09-17T01:49:22.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.475+0000 7f359a400640 1 -- 172.21.15.42:0/963199791 reap_dead start 2024-09-17T01:49:22.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.475+0000 7f359c400640 1 -- 172.21.15.42:0/963199791 shutdown_connections 2024-09-17T01:49:22.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.475+0000 7f359c400640 1 -- 172.21.15.42:0/963199791 >> 172.21.15.42:0/963199791 conn(0x7f35940d2700 msgr2=0x7f35940d2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:22.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.475+0000 7f359c400640 1 -- 172.21.15.42:0/963199791 shutdown_connections 2024-09-17T01:49:22.473 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.475+0000 7f359c400640 1 -- 172.21.15.42:0/963199791 wait complete. 2024-09-17T01:49:22.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.477+0000 7f359c400640 1 Processor -- start 2024-09-17T01:49:22.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.477+0000 7f359c400640 1 -- start start 2024-09-17T01:49:22.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.479+0000 7f359c400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f357c003c10 0x7f35940b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:22.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.479+0000 7f359c400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f359409ed90 0x7f35940715d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:22.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.479+0000 7f359c400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3594071b10 0x7f359409f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:22.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.479+0000 7f359c400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f35940d0e50 con 0x7f359409ed90 2024-09-17T01:49:22.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.479+0000 7f359c400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f35940ce610 con 0x7f3594071b10 2024-09-17T01:49:22.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.479+0000 7f359c400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f35940d0fd0 con 0x7f357c003c10 2024-09-17T01:49:22.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.479+0000 7f3599000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f359409ed90 0x7f35940715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:22.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.479+0000 7f3599000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f359409ed90 0x7f35940715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41626/0 (socket says 172.21.15.42:41626) 2024-09-17T01:49:22.478 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.479+0000 7f3599000640 1 -- 172.21.15.42:0/1275335743 learned_addr learned my addr 172.21.15.42:0/1275335743 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:22.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.479+0000 7f3599a00640 1 --2- 172.21.15.42:0/1275335743 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f357c003c10 0x7f35940b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:22.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.479+0000 7f359a400640 1 --2- 172.21.15.42:0/1275335743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3594071b10 0x7f359409f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:22.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.479+0000 7f3599000640 1 -- 172.21.15.42:0/1275335743 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f357c003c10 msgr2=0x7f35940b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:22.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.479+0000 7f3599000640 1 --2- 172.21.15.42:0/1275335743 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f357c003c10 0x7f35940b2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:22.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.479+0000 7f3599000640 1 -- 172.21.15.42:0/1275335743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3594071b10 msgr2=0x7f359409f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:22.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.479+0000 7f3599000640 1 --2- 172.21.15.42:0/1275335743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3594071b10 0x7f359409f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:22.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.479+0000 7f3599000640 1 -- 172.21.15.42:0/1275335743 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35941f9700 con 0x7f359409ed90 2024-09-17T01:49:22.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.480+0000 7f3599000640 1 --2- 172.21.15.42:0/1275335743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f359409ed90 0x7f35940715d0 secure :-1 s=READY pgs=2549 cs=0 l=1 rev1=1 crypto rx=0x7f3580006650 tx=0x7f3580001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:22.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.480+0000 7f3591600640 1 -- 172.21.15.42:0/1275335743 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3580011700 con 0x7f359409ed90 2024-09-17T01:49:22.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.480+0000 7f3591600640 1 -- 172.21.15.42:0/1275335743 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3580016020 con 0x7f359409ed90 2024-09-17T01:49:22.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.480+0000 7f3591600640 1 -- 172.21.15.42:0/1275335743 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3580011b00 con 0x7f359409ed90 2024-09-17T01:49:22.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.480+0000 7f359c400640 1 -- 172.21.15.42:0/1275335743 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35941f99e0 con 0x7f359409ed90 2024-09-17T01:49:22.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.480+0000 7f359c400640 1 -- 172.21.15.42:0/1275335743 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f359409d770 con 0x7f359409ed90 2024-09-17T01:49:22.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.481+0000 7f359c400640 1 -- 172.21.15.42:0/1275335743 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35941f9470 con 0x7f359409ed90 2024-09-17T01:49:22.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.483+0000 7f3591600640 1 -- 172.21.15.42:0/1275335743 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3580011ca0 con 0x7f359409ed90 2024-09-17T01:49:22.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.484+0000 7f3591600640 1 --2- 172.21.15.42:0/1275335743 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3574078bc0 0x7f357407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:22.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.484+0000 7f3591600640 1 -- 172.21.15.42:0/1275335743 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 5709+0+0 (secure 0 0 0) 0x7f358009b950 con 0x7f359409ed90 2024-09-17T01:49:22.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.484+0000 7f3599a00640 1 --2- 172.21.15.42:0/1275335743 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3574078bc0 0x7f357407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:22.483 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.485+0000 7f3599a00640 1 --2- 172.21.15.42:0/1275335743 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3574078bc0 0x7f357407b0d0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f3588035000 tx=0x7f358802d040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:22.486 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.489+0000 7f3591600640 1 -- 172.21.15.42:0/1275335743 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3580020020 con 0x7f359409ed90 2024-09-17T01:49:22.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.723+0000 7f359c400640 1 -- 172.21.15.42:0/1275335743 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35940b0f90 con 0x7f359409ed90 2024-09-17T01:49:22.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.723+0000 7f3591600640 1 -- 172.21.15.42:0/1275335743 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 177 v177) ==== 95+0+5241 (secure 0 0 0) 0x7f35800636a0 con 0x7f359409ed90 2024-09-17T01:49:22.721 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:22.722 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":177,"btime":"2024-09-17T01:49:19:694779+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":11511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1418140325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1418140325},{"type":"v1","addr":"172.21.15.42:6833","nonce":1418140325}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":171},{"gid":11514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2781042225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":2781042225},{"type":"v1","addr":"172.21.15.42:6835","nonce":2781042225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":172},{"gid":11517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4082001755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4082001755},{"type":"v1","addr":"172.21.15.43:6836","nonce":4082001755}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":172}],"filesystems":[{"mdsmap":{"epoch":177,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:49:16.188388+0000","modified":"2024-09-17T01:49:19.207517+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11520":{"gid":11520,"name":"b","rank":0,"incarnation":173,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/4233677817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":4233677817},{"type":"v1","addr":"172.21.15.43:6837","nonce":4233677817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11520,"qdb_cluster":[11520]},"id":16}]} 2024-09-17T01:49:22.722 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 177 2024-09-17T01:49:22.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.726+0000 7f359c400640 1 -- 172.21.15.42:0/1275335743 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3574078bc0 msgr2=0x7f357407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:22.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.726+0000 7f359c400640 1 --2- 172.21.15.42:0/1275335743 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3574078bc0 0x7f357407b0d0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f3588035000 tx=0x7f358802d040 comp rx=0 tx=0).stop 2024-09-17T01:49:22.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.726+0000 7f359c400640 1 -- 172.21.15.42:0/1275335743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f359409ed90 msgr2=0x7f35940715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:22.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.726+0000 7f359c400640 1 --2- 172.21.15.42:0/1275335743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f359409ed90 0x7f35940715d0 secure :-1 s=READY pgs=2549 cs=0 l=1 rev1=1 crypto rx=0x7f3580006650 tx=0x7f3580001800 comp rx=0 tx=0).stop 2024-09-17T01:49:22.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.726+0000 7f359c400640 1 -- 172.21.15.42:0/1275335743 shutdown_connections 2024-09-17T01:49:22.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.726+0000 7f359c400640 1 --2- 172.21.15.42:0/1275335743 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3574078bc0 0x7f357407b0d0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:22.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.726+0000 7f359c400640 1 --2- 172.21.15.42:0/1275335743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3594071b10 0x7f359409f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:22.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.726+0000 7f359c400640 1 --2- 172.21.15.42:0/1275335743 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f359409ed90 0x7f35940715d0 unknown :-1 s=CLOSED pgs=2549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:22.724 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.726+0000 7f359c400640 1 --2- 172.21.15.42:0/1275335743 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f357c003c10 0x7f35940b2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:22.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.726+0000 7f359c400640 1 -- 172.21.15.42:0/1275335743 >> 172.21.15.42:0/1275335743 conn(0x7f35940d2700 msgr2=0x7f35940cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:22.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.726+0000 7f359c400640 1 -- 172.21.15.42:0/1275335743 shutdown_connections 2024-09-17T01:49:22.725 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:22.726+0000 7f359c400640 1 -- 172.21.15.42:0/1275335743 wait complete. 2024-09-17T01:49:23.148 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 177, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:49:16.188388+0000', 'modified': '2024-09-17T01:49:19.207517+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11520}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11520': {'gid': 11520, 'name': 'b', 'rank': 0, 'incarnation': 173, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.43:6837/4233677817', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 4233677817}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 4233677817}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [33], 'metadata_pool': 32, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 11520, 'qdb_cluster': [11520]} 2024-09-17T01:49:23.148 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T01:49:23.148 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-17T01:49:23.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.380+0000 7f3b54a00640 1 -- 172.21.15.42:0/2288534243 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b500b51d0 msgr2=0x7f3b500b55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:23.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.380+0000 7f3b54a00640 1 --2- 172.21.15.42:0/2288534243 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b500b51d0 0x7f3b500b55e0 secure :-1 s=READY pgs=2550 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c005fd0 tx=0x7f3b3c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.380+0000 7f3b54a00640 1 -- 172.21.15.42:0/2288534243 shutdown_connections 2024-09-17T01:49:23.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.380+0000 7f3b54a00640 1 --2- 172.21.15.42:0/2288534243 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3b501605c0 0x7f3b501609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.380+0000 7f3b54a00640 1 --2- 172.21.15.42:0/2288534243 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b500b51d0 0x7f3b500b55e0 unknown :-1 s=CLOSED pgs=2550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.380+0000 7f3b54a00640 1 -- 172.21.15.42:0/2288534243 >> 172.21.15.42:0/2288534243 conn(0x7f3b5006d3f0 msgr2=0x7f3b500b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:23.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.381+0000 7f3b54a00640 1 -- 172.21.15.42:0/2288534243 shutdown_connections 2024-09-17T01:49:23.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.381+0000 7f3b54a00640 1 -- 172.21.15.42:0/2288534243 wait complete. 2024-09-17T01:49:23.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.383+0000 7f3b54a00640 1 Processor -- start 2024-09-17T01:49:23.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.383+0000 7f3b54a00640 1 -- start start 2024-09-17T01:49:23.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.384+0000 7f3b54a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b500afb00 0x7f3b501f6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:23.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.384+0000 7f3b54a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b500b51d0 0x7f3b501f5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:23.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.384+0000 7f3b54a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3b501605c0 0x7f3b500b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:23.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.384+0000 7f3b54a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3b500ce4f0 con 0x7f3b500b51d0 2024-09-17T01:49:23.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.384+0000 7f3b54a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3b500ce370 con 0x7f3b500afb00 2024-09-17T01:49:23.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.384+0000 7f3b54a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3b500ce670 con 0x7f3b501605c0 2024-09-17T01:49:23.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.385+0000 7f3b4ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b500b51d0 0x7f3b501f5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:23.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.385+0000 7f3b4ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b500b51d0 0x7f3b501f5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41634/0 (socket says 172.21.15.42:41634) 2024-09-17T01:49:23.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.385+0000 7f3b4ea00640 1 -- 172.21.15.42:0/2952256164 learned_addr learned my addr 172.21.15.42:0/2952256164 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:23.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.385+0000 7f3b4fe00640 1 --2- 172.21.15.42:0/2952256164 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3b501605c0 0x7f3b500b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:23.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.385+0000 7f3b4f400640 1 --2- 172.21.15.42:0/2952256164 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b500afb00 0x7f3b501f6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:23.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.385+0000 7f3b4ea00640 1 -- 172.21.15.42:0/2952256164 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3b501605c0 msgr2=0x7f3b500b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:23.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.385+0000 7f3b4ea00640 1 --2- 172.21.15.42:0/2952256164 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3b501605c0 0x7f3b500b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.385+0000 7f3b4ea00640 1 -- 172.21.15.42:0/2952256164 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b500afb00 msgr2=0x7f3b501f6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:23.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.385+0000 7f3b4ea00640 1 --2- 172.21.15.42:0/2952256164 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b500afb00 0x7f3b501f6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.385+0000 7f3b4ea00640 1 -- 172.21.15.42:0/2952256164 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b501f3a50 con 0x7f3b500b51d0 2024-09-17T01:49:23.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.385+0000 7f3b4ea00640 1 --2- 172.21.15.42:0/2952256164 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b500b51d0 0x7f3b501f5730 secure :-1 s=READY pgs=2551 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c034040 tx=0x7f3b3c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:23.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.386+0000 7f3b47400640 1 -- 172.21.15.42:0/2952256164 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c03e030 con 0x7f3b500b51d0 2024-09-17T01:49:23.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.386+0000 7f3b47400640 1 -- 172.21.15.42:0/2952256164 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b3c003d90 con 0x7f3b500b51d0 2024-09-17T01:49:23.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.386+0000 7f3b54a00640 1 -- 172.21.15.42:0/2952256164 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b501f7520 con 0x7f3b500b51d0 2024-09-17T01:49:23.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.386+0000 7f3b47400640 1 -- 172.21.15.42:0/2952256164 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c035040 con 0x7f3b500b51d0 2024-09-17T01:49:23.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.386+0000 7f3b54a00640 1 -- 172.21.15.42:0/2952256164 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b501f7ae0 con 0x7f3b500b51d0 2024-09-17T01:49:23.386 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.388+0000 7f3b47400640 1 -- 172.21.15.42:0/2952256164 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3b3c041030 con 0x7f3b500b51d0 2024-09-17T01:49:23.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.389+0000 7f3b47400640 1 --2- 172.21.15.42:0/2952256164 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3b30078b90 0x7f3b3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:23.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.389+0000 7f3b47400640 1 -- 172.21.15.42:0/2952256164 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 5709+0+0 (secure 0 0 0) 0x7f3b3c0bb5a0 con 0x7f3b500b51d0 2024-09-17T01:49:23.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.390+0000 7f3b5d09d740 1 Processor -- start 2024-09-17T01:49:23.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.390+0000 7f3b5d09d740 1 -- start start 2024-09-17T01:49:23.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.390+0000 7f3b4f400640 1 --2- 172.21.15.42:0/2952256164 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3b30078b90 0x7f3b3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:23.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.391+0000 7f3b4f400640 1 --2- 172.21.15.42:0/2952256164 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3b30078b90 0x7f3b3007b0a0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f3b40006fd0 tx=0x7f3b40008040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:23.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.391+0000 7f3b5d09d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027d0ec270 0x56027d4bcb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:23.390 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.391+0000 7f3b5d09d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0c33b0 0x56027d4bd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:23.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.392+0000 7f3b5d09d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56027d0cb590 0x56027d48d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:23.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.392+0000 7f3b5d09d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56027d416430 con 0x56027d0c33b0 2024-09-17T01:49:23.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.392+0000 7f3b5d09d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56027d4065d0 con 0x56027d0ec270 2024-09-17T01:49:23.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.392+0000 7f3b5d09d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56027d3f5a00 con 0x56027d0cb590 2024-09-17T01:49:23.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.392+0000 7f3b4ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0c33b0 0x56027d4bd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:23.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.392+0000 7f3b4ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0c33b0 0x56027d4bd0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41642/0 (socket says 172.21.15.42:41642) 2024-09-17T01:49:23.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.392+0000 7f3b4ea00640 1 -- 172.21.15.42:0/1395928019 learned_addr learned my addr 172.21.15.42:0/1395928019 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:23.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.392+0000 7f3b4f400640 1 --2- 172.21.15.42:0/1395928019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027d0ec270 0x56027d4bcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:23.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.392+0000 7f3b4fe00640 1 --2- 172.21.15.42:0/1395928019 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56027d0cb590 0x56027d48d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:23.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.392+0000 7f3b4ea00640 1 -- 172.21.15.42:0/1395928019 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56027d0cb590 msgr2=0x56027d48d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:23.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.392+0000 7f3b4ea00640 1 --2- 172.21.15.42:0/1395928019 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56027d0cb590 0x56027d48d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.392+0000 7f3b4ea00640 1 -- 172.21.15.42:0/1395928019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027d0ec270 msgr2=0x56027d4bcb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:23.391 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.392+0000 7f3b4ea00640 1 --2- 172.21.15.42:0/1395928019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027d0ec270 0x56027d4bcb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.392+0000 7f3b4ea00640 1 -- 172.21.15.42:0/1395928019 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56027d3be520 con 0x56027d0c33b0 2024-09-17T01:49:23.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.392+0000 7f3b4fe00640 1 --2- 172.21.15.42:0/1395928019 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56027d0cb590 0x56027d48d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:49:23.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.392+0000 7f3b4ea00640 1 --2- 172.21.15.42:0/1395928019 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0c33b0 0x56027d4bd0a0 secure :-1 s=READY pgs=2552 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c0b9970 tx=0x7f3b3c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212b0c611dc7dc5c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:23.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.393+0000 7f3b3b400640 1 -- 172.21.15.42:0/1395928019 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c048040 con 0x56027d0c33b0 2024-09-17T01:49:23.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.393+0000 7f3b3b400640 1 -- 172.21.15.42:0/1395928019 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b3c082e60 con 0x56027d0c33b0 2024-09-17T01:49:23.392 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.393+0000 7f3b3b400640 1 -- 172.21.15.42:0/1395928019 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c08a2f0 con 0x56027d0c33b0 2024-09-17T01:49:23.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.393+0000 7f3b5d09d740 1 -- 172.21.15.42:0/1395928019 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0c33b0 msgr2=0x56027d4bd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:23.393 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.393+0000 7f3b5d09d740 1 --2- 172.21.15.42:0/1395928019 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0c33b0 0x56027d4bd0a0 secure :-1 s=READY pgs=2552 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c0b9970 tx=0x7f3b3c009260 comp rx=0 tx=0).stop 2024-09-17T01:49:23.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.394+0000 7f3b5d09d740 1 -- 172.21.15.42:0/1395928019 shutdown_connections 2024-09-17T01:49:23.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.394+0000 7f3b5d09d740 1 --2- 172.21.15.42:0/1395928019 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56027d0cb590 0x56027d48d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.394+0000 7f3b5d09d740 1 --2- 172.21.15.42:0/1395928019 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0c33b0 0x56027d4bd0a0 unknown :-1 s=CLOSED pgs=2552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.394+0000 7f3b5d09d740 1 --2- 172.21.15.42:0/1395928019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027d0ec270 0x56027d4bcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.394+0000 7f3b5d09d740 1 -- 172.21.15.42:0/1395928019 >> 172.21.15.42:0/1395928019 conn(0x56027d0e03c0 msgr2=0x56027d492b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:23.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.394+0000 7f3b5d09d740 1 -- 172.21.15.42:0/1395928019 shutdown_connections 2024-09-17T01:49:23.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.394+0000 7f3b5d09d740 1 -- 172.21.15.42:0/1395928019 wait complete. 2024-09-17T01:49:23.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.395+0000 7f3b5d09d740 1 -- start start 2024-09-17T01:49:23.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.395+0000 7f3b5d09d740 1 Processor -- start 2024-09-17T01:49:23.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.397+0000 7f3b5d09d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0c33b0 0x56027d4b3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.397+0000 7f3b5d09d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56027d0cb590 0x56027d4b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.397+0000 7f3b5d09d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027d0ec270 0x56027d4b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.397+0000 7f3b5d09d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56027d39c330 con 0x56027d0c33b0 2024-09-17T01:49:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.397+0000 7f3b5d09d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56027d3f9810 con 0x56027d0ec270 2024-09-17T01:49:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.397+0000 7f3b5d09d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56027d166620 con 0x56027d0cb590 2024-09-17T01:49:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.397+0000 7f3b5d09d740 10 client.0 _ll_register_callbacks cb 0x56027d3a1420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:49:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.397+0000 7f3b4f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0c33b0 0x56027d4b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.397+0000 7f3b4f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0c33b0 0x56027d4b3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41656/0 (socket says 172.21.15.42:41656) 2024-09-17T01:49:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.397+0000 7f3b4f400640 1 -- 172.21.15.42:0/3673421874 learned_addr learned my addr 172.21.15.42:0/3673421874 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.398+0000 7f3b4fe00640 1 --2- 172.21.15.42:0/3673421874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027d0ec270 0x56027d4b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.398+0000 7f3b4ea00640 1 --2- 172.21.15.42:0/3673421874 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56027d0cb590 0x56027d4b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:23.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.398+0000 7f3b4f400640 1 -- 172.21.15.42:0/3673421874 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56027d0cb590 msgr2=0x56027d4b55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.398+0000 7f3b4f400640 1 --2- 172.21.15.42:0/3673421874 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56027d0cb590 0x56027d4b55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.398+0000 7f3b4f400640 1 -- 172.21.15.42:0/3673421874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027d0ec270 msgr2=0x56027d4b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.398+0000 7f3b4f400640 1 --2- 172.21.15.42:0/3673421874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027d0ec270 0x56027d4b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.398+0000 7f3b4f400640 1 -- 172.21.15.42:0/3673421874 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56027d157850 con 0x56027d0c33b0 2024-09-17T01:49:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.398+0000 7f3b4f400640 1 --2- 172.21.15.42:0/3673421874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0c33b0 0x56027d4b3020 secure :-1 s=READY pgs=2553 cs=0 l=1 rev1=1 crypto rx=0x7f3b4000dea0 tx=0x7f3b40004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df73b215cb96320e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.398+0000 7f3b2fe00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:49:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.398+0000 7f3b2fe00640 1 -- 172.21.15.42:0/3673421874 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b400125f0 con 0x56027d0c33b0 2024-09-17T01:49:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.398+0000 7f3b5d09d740 1 -- 172.21.15.42:0/3673421874 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b3c082e60 con 0x56027d0c33b0 2024-09-17T01:49:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.399+0000 7f3b2fe00640 1 -- 172.21.15.42:0/3673421874 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(226..226 src has 1..226) ==== 5709+0+0 (secure 0 0 0) 0x7f3b4000f040 con 0x56027d0c33b0 2024-09-17T01:49:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.399+0000 7f3b2fe00640 1 -- 172.21.15.42:0/3673421874 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=177) ==== 24+0+0 (secure 0 0 0) 0x7f3b400058d0 con 0x56027d0c33b0 2024-09-17T01:49:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.399+0000 7f3b5d09d740 10 client.11637 fetch_fsmap learned FSMap version 177 2024-09-17T01:49:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.399+0000 7f3b5d09d740 1 -- 172.21.15.42:0/3673421874 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=177,monmap=2+}) -- 0x56027d1ce6b0 con 0x56027d0c33b0 2024-09-17T01:49:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.399+0000 7f3b2fe00640 1 -- 172.21.15.42:0/3673421874 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b3c082e60 con 0x56027d0c33b0 2024-09-17T01:49:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.399+0000 7f3b2fe00640 1 -- 172.21.15.42:0/3673421874 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 177) ==== 3502+0+0 (secure 0 0 0) 0x7f3b40030080 con 0x56027d0c33b0 2024-09-17T01:49:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.399+0000 7f3b5d09d740 10 client.11637 fetch_fsmap finished waiting for FSMap version 177 2024-09-17T01:49:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.399+0000 7f3b5d09d740 10 client.11637 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T01:49:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.399+0000 7f3b5d09d740 20 client.11637 populate_metadata read hostname 'smithi042' 2024-09-17T01:49:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.399+0000 7f3b5d09d740 1 --2- 172.21.15.42:0/3673421874 >> [v2:172.21.15.43:6835/4233677817,v1:172.21.15.43:6837/4233677817] conn(0x56027d0aae40 0x56027d4e6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.399+0000 7f3b5d09d740 4 client.11637 mds_command: new command op to 11520 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:49:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.399+0000 7f3b5d09d740 1 -- 172.21.15.42:0/3673421874 --> [v2:172.21.15.43:6835/4233677817,v1:172.21.15.43:6837/4233677817] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56027d408520 con 0x56027d0aae40 2024-09-17T01:49:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.400+0000 7f3b4ea00640 1 --2- 172.21.15.42:0/3673421874 >> [v2:172.21.15.43:6835/4233677817,v1:172.21.15.43:6837/4233677817] conn(0x56027d0aae40 0x56027d4e6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.401+0000 7f3b4ea00640 1 --2- 172.21.15.42:0/3673421874 >> [v2:172.21.15.43:6835/4233677817,v1:172.21.15.43:6837/4233677817] conn(0x56027d0aae40 0x56027d4e6aa0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41ecc7403868a2b8 server_cookie=109befd398cce053 in_seq=0 out_seq=0 2024-09-17T01:49:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.401+0000 7f3b2fe00640 10 client.11637 ms_handle_connect on v2:172.21.15.43:6835/4233677817 2024-09-17T01:49:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.402+0000 7f3b2fe00640 1 -- 172.21.15.42:0/3673421874 <== mds.0 v2:172.21.15.43:6835/4233677817 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56027d408520 con 0x56027d0aae40 2024-09-17T01:49:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.402+0000 7f3b2fe00640 10 client.11637 handle_command_reply: tid=0 2024-09-17T01:49:23.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.402+0000 7f3b5d09d740 1 client.11637 shutdown 2024-09-17T01:49:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.402+0000 7f3b5d09d740 1 -- 172.21.15.42:0/3673421874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0c33b0 msgr2=0x56027d4b3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.402+0000 7f3b5d09d740 1 --2- 172.21.15.42:0/3673421874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0c33b0 0x56027d4b3020 secure :-1 s=READY pgs=2553 cs=0 l=1 rev1=1 crypto rx=0x7f3b4000dea0 tx=0x7f3b40004640 comp rx=0 tx=0).stop 2024-09-17T01:49:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.402+0000 7f3b5d09d740 1 -- 172.21.15.42:0/3673421874 shutdown_connections 2024-09-17T01:49:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.402+0000 7f3b5d09d740 1 --2- 172.21.15.42:0/3673421874 >> [v2:172.21.15.43:6835/4233677817,v1:172.21.15.43:6837/4233677817] conn(0x56027d0aae40 0x56027d4e6aa0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.402+0000 7f3b5d09d740 1 --2- 172.21.15.42:0/3673421874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027d0ec270 0x56027d4b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.402+0000 7f3b5d09d740 1 --2- 172.21.15.42:0/3673421874 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56027d0cb590 0x56027d4b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.402+0000 7f3b5d09d740 1 --2- 172.21.15.42:0/3673421874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0c33b0 0x56027d4b3020 unknown :-1 s=CLOSED pgs=2553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.402+0000 7f3b2fe00640 0 client.11637 ms_handle_reset on v2:172.21.15.43:6835/4233677817 2024-09-17T01:49:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.402+0000 7f3b5d09d740 1 -- 172.21.15.42:0/3673421874 >> 172.21.15.42:0/3673421874 conn(0x56027d0e03c0 msgr2=0x56027d4ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.402+0000 7f3b5d09d740 1 -- 172.21.15.42:0/3673421874 shutdown_connections 2024-09-17T01:49:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.402+0000 7f3b5d09d740 1 -- 172.21.15.42:0/3673421874 wait complete. 2024-09-17T01:49:23.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.402+0000 7f3b5d09d740 20 client.11637 trim_cache size 0 max 16384 2024-09-17T01:49:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.422+0000 7f3b5d09d740 1 Processor -- start 2024-09-17T01:49:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.422+0000 7f3b5d09d740 1 -- start start 2024-09-17T01:49:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.424+0000 7f3b5d09d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027d0e03c0 0x56027d4d0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.424+0000 7f3b5d09d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0c33b0 0x56027d4daeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.424+0000 7f3b5d09d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56027d0cb590 0x56027d4db3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.424+0000 7f3b5d09d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3b501fa130 con 0x56027d0c33b0 2024-09-17T01:49:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.424+0000 7f3b5d09d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3b501f9490 con 0x56027d0e03c0 2024-09-17T01:49:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.424+0000 7f3b5d09d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3b501f9ae0 con 0x56027d0cb590 2024-09-17T01:49:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.424+0000 7f3b4ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0c33b0 0x56027d4daeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.424+0000 7f3b4ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0c33b0 0x56027d4daeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41662/0 (socket says 172.21.15.42:41662) 2024-09-17T01:49:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.424+0000 7f3b4ea00640 1 -- 172.21.15.42:0/752465835 learned_addr learned my addr 172.21.15.42:0/752465835 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.424+0000 7f3b4fe00640 1 --2- 172.21.15.42:0/752465835 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56027d0cb590 0x56027d4db3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:23.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.424+0000 7f3b4f400640 1 --2- 172.21.15.42:0/752465835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027d0e03c0 0x56027d4d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.424+0000 7f3b4ea00640 1 -- 172.21.15.42:0/752465835 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56027d0cb590 msgr2=0x56027d4db3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.424+0000 7f3b4ea00640 1 --2- 172.21.15.42:0/752465835 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56027d0cb590 0x56027d4db3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.424+0000 7f3b4ea00640 1 -- 172.21.15.42:0/752465835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027d0e03c0 msgr2=0x56027d4d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.425+0000 7f3b4ea00640 1 --2- 172.21.15.42:0/752465835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027d0e03c0 0x56027d4d0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.425+0000 7f3b4ea00640 1 -- 172.21.15.42:0/752465835 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56027d493840 con 0x56027d0c33b0 2024-09-17T01:49:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.425+0000 7f3b4ea00640 1 --2- 172.21.15.42:0/752465835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0c33b0 0x56027d4daeb0 secure :-1 s=READY pgs=2554 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c006010 tx=0x7f3b3c02a4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a532ed80d097fb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.425+0000 7f3b3aa00640 1 -- 172.21.15.42:0/752465835 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c048040 con 0x56027d0c33b0 2024-09-17T01:49:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.425+0000 7f3b3aa00640 1 -- 172.21.15.42:0/752465835 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b3c08cc60 con 0x56027d0c33b0 2024-09-17T01:49:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.425+0000 7f3b3aa00640 1 -- 172.21.15.42:0/752465835 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c08a310 con 0x56027d0c33b0 2024-09-17T01:49:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.426+0000 7f3b5d09d740 1 -- 172.21.15.42:0/752465835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0c33b0 msgr2=0x56027d4daeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.426+0000 7f3b5d09d740 1 --2- 172.21.15.42:0/752465835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0c33b0 0x56027d4daeb0 secure :-1 s=READY pgs=2554 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c006010 tx=0x7f3b3c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.426+0000 7f3b5d09d740 1 -- 172.21.15.42:0/752465835 shutdown_connections 2024-09-17T01:49:23.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.426+0000 7f3b5d09d740 1 --2- 172.21.15.42:0/752465835 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56027d0cb590 0x56027d4db3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.426+0000 7f3b5d09d740 1 --2- 172.21.15.42:0/752465835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0c33b0 0x56027d4daeb0 unknown :-1 s=CLOSED pgs=2554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.426+0000 7f3b5d09d740 1 --2- 172.21.15.42:0/752465835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027d0e03c0 0x56027d4d0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.426+0000 7f3b5d09d740 1 -- 172.21.15.42:0/752465835 >> 172.21.15.42:0/752465835 conn(0x56027d48e8f0 msgr2=0x56027d4b68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.426+0000 7f3b5d09d740 1 -- 172.21.15.42:0/752465835 shutdown_connections 2024-09-17T01:49:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.426+0000 7f3b5d09d740 1 -- 172.21.15.42:0/752465835 wait complete. 2024-09-17T01:49:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.427+0000 7f3b5d09d740 1 -- start start 2024-09-17T01:49:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.427+0000 7f3b5d09d740 1 Processor -- start 2024-09-17T01:49:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.429+0000 7f3b5d09d740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56027d0c33b0 0x56027d54db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.429+0000 7f3b5d09d740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0cb590 0x56027d4b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.429+0000 7f3b5d09d740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027d0e03c0 0x56027d4b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.429+0000 7f3b5d09d740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56027d4b3950 con 0x56027d0cb590 2024-09-17T01:49:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.429+0000 7f3b5d09d740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56027d4cecb0 con 0x56027d0e03c0 2024-09-17T01:49:23.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.429+0000 7f3b5d09d740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x56027d4ea3f0 con 0x56027d0c33b0 2024-09-17T01:49:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.429+0000 7f3b5d09d740 10 client.0 _ll_register_callbacks cb 0x7f3b4000d840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:49:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.429+0000 7f3b4ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0cb590 0x56027d4b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.429+0000 7f3b4ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0cb590 0x56027d4b54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41664/0 (socket says 172.21.15.42:41664) 2024-09-17T01:49:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.429+0000 7f3b4f400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56027d0c33b0 0x56027d54db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.429+0000 7f3b4ea00640 1 -- 172.21.15.42:0/348531828 learned_addr learned my addr 172.21.15.42:0/348531828 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.429+0000 7f3b4fe00640 1 --2- 172.21.15.42:0/348531828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027d0e03c0 0x56027d4b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.429+0000 7f3b4ea00640 1 -- 172.21.15.42:0/348531828 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56027d0c33b0 msgr2=0x56027d54db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.429+0000 7f3b4ea00640 1 --2- 172.21.15.42:0/348531828 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56027d0c33b0 0x56027d54db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.429+0000 7f3b4ea00640 1 -- 172.21.15.42:0/348531828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027d0e03c0 msgr2=0x56027d4b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.429+0000 7f3b4ea00640 1 --2- 172.21.15.42:0/348531828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027d0e03c0 0x56027d4b59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.429+0000 7f3b4ea00640 1 -- 172.21.15.42:0/348531828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56027d4e93b0 con 0x56027d0cb590 2024-09-17T01:49:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.430+0000 7f3b4ea00640 1 --2- 172.21.15.42:0/348531828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0cb590 0x56027d4b54a0 secure :-1 s=READY pgs=2555 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c0bb040 tx=0x7f3b3c005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c87b419906470f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:23.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.430+0000 7f3b2fe00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:49:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.430+0000 7f3b2fe00640 1 -- 172.21.15.42:0/348531828 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c048040 con 0x56027d0cb590 2024-09-17T01:49:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.430+0000 7f3b2fe00640 1 -- 172.21.15.42:0/348531828 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(226..226 src has 1..226) ==== 5709+0+0 (secure 0 0 0) 0x7f3b3c08c7d0 con 0x56027d0cb590 2024-09-17T01:49:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.430+0000 7f3b5d09d740 1 -- 172.21.15.42:0/348531828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b3c08cc60 con 0x56027d0cb590 2024-09-17T01:49:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.430+0000 7f3b2fe00640 1 -- 172.21.15.42:0/348531828 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=177) ==== 24+0+0 (secure 0 0 0) 0x7f3b3c082e60 con 0x56027d0cb590 2024-09-17T01:49:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.430+0000 7f3b5d09d740 10 client.11643 fetch_fsmap learned FSMap version 177 2024-09-17T01:49:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.430+0000 7f3b5d09d740 1 -- 172.21.15.42:0/348531828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=177,monmap=2+}) -- 0x56027d4d01c0 con 0x56027d0cb590 2024-09-17T01:49:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.430+0000 7f3b2fe00640 1 -- 172.21.15.42:0/348531828 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b3c08cc60 con 0x56027d0cb590 2024-09-17T01:49:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.430+0000 7f3b2fe00640 1 -- 172.21.15.42:0/348531828 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 177) ==== 3502+0+0 (secure 0 0 0) 0x7f3b3c0825b0 con 0x56027d0cb590 2024-09-17T01:49:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.431+0000 7f3b5d09d740 10 client.11643 fetch_fsmap finished waiting for FSMap version 177 2024-09-17T01:49:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.431+0000 7f3b5d09d740 10 client.11643 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T01:49:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.431+0000 7f3b5d09d740 20 client.11643 populate_metadata read hostname 'smithi042' 2024-09-17T01:49:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.431+0000 7f3b5d09d740 1 --2- 172.21.15.42:0/348531828 >> [v2:172.21.15.43:6835/4233677817,v1:172.21.15.43:6837/4233677817] conn(0x56027d080280 0x56027d55aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.431+0000 7f3b5d09d740 4 client.11643 mds_command: new command op to 11520 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T01:49:23.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.431+0000 7f3b5d09d740 1 -- 172.21.15.42:0/348531828 --> [v2:172.21.15.43:6835/4233677817,v1:172.21.15.43:6837/4233677817] -- command(tid 0: {"prefix": "status"}) -- 0x56027d403fd0 con 0x56027d080280 2024-09-17T01:49:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.431+0000 7f3b4f400640 1 --2- 172.21.15.42:0/348531828 >> [v2:172.21.15.43:6835/4233677817,v1:172.21.15.43:6837/4233677817] conn(0x56027d080280 0x56027d55aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.432+0000 7f3b4f400640 1 --2- 172.21.15.42:0/348531828 >> [v2:172.21.15.43:6835/4233677817,v1:172.21.15.43:6837/4233677817] conn(0x56027d080280 0x56027d55aaf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3265d5e0ade26b63 server_cookie=e80da08b0d1b4958 in_seq=0 out_seq=0 2024-09-17T01:49:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.432+0000 7f3b2fe00640 10 client.11643 ms_handle_connect on v2:172.21.15.43:6835/4233677817 2024-09-17T01:49:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.432+0000 7f3b2fe00640 1 -- 172.21.15.42:0/348531828 <== mds.0 v2:172.21.15.43:6835/4233677817 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x56027d403fd0 con 0x56027d080280 2024-09-17T01:49:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.432+0000 7f3b2fe00640 10 client.11643 handle_command_reply: tid=0 2024-09-17T01:49:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.432+0000 7f3b5d09d740 1 client.11643 shutdown 2024-09-17T01:49:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.433+0000 7f3b5d09d740 1 -- 172.21.15.42:0/348531828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0cb590 msgr2=0x56027d4b54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.433+0000 7f3b5d09d740 1 --2- 172.21.15.42:0/348531828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0cb590 0x56027d4b54a0 secure :-1 s=READY pgs=2555 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c0bb040 tx=0x7f3b3c005a40 comp rx=0 tx=0).stop 2024-09-17T01:49:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.433+0000 7f3b5d09d740 1 -- 172.21.15.42:0/348531828 shutdown_connections 2024-09-17T01:49:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.433+0000 7f3b5d09d740 1 --2- 172.21.15.42:0/348531828 >> [v2:172.21.15.43:6835/4233677817,v1:172.21.15.43:6837/4233677817] conn(0x56027d080280 0x56027d55aaf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.433+0000 7f3b5d09d740 1 --2- 172.21.15.42:0/348531828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56027d0e03c0 0x56027d4b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.433+0000 7f3b5d09d740 1 --2- 172.21.15.42:0/348531828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56027d0cb590 0x56027d4b54a0 unknown :-1 s=CLOSED pgs=2555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.433+0000 7f3b5d09d740 1 --2- 172.21.15.42:0/348531828 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x56027d0c33b0 0x56027d54db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.433+0000 7f3b2fe00640 0 client.11643 ms_handle_reset on v2:172.21.15.43:6835/4233677817 2024-09-17T01:49:23.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.433+0000 7f3b5d09d740 1 -- 172.21.15.42:0/348531828 >> 172.21.15.42:0/348531828 conn(0x56027d48e8f0 msgr2=0x56027d4b28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:23.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.433+0000 7f3b5d09d740 1 -- 172.21.15.42:0/348531828 shutdown_connections 2024-09-17T01:49:23.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.433+0000 7f3b5d09d740 1 -- 172.21.15.42:0/348531828 wait complete. 2024-09-17T01:49:23.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.433+0000 7f3b5d09d740 20 client.11643 trim_cache size 0 max 16384 2024-09-17T01:49:23.464 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:49:23.464 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "fea1c88c-cb05-432f-a745-f9dcbb5f2503", 2024-09-17T01:49:23.464 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-17T01:49:23.464 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 11520, 2024-09-17T01:49:23.465 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-17T01:49:23.465 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-17T01:49:23.465 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-17T01:49:23.465 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 6.764616652, 2024-09-17T01:49:23.465 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 177, 2024-09-17T01:49:23.465 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 226, 2024-09-17T01:49:23.465 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 226, 2024-09-17T01:49:23.465 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 11.732193730000001 2024-09-17T01:49:23.465 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:49:23.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.434+0000 7f3b54a00640 1 -- 172.21.15.42:0/2952256164 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3b30078b90 msgr2=0x7f3b3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.434+0000 7f3b54a00640 1 --2- 172.21.15.42:0/2952256164 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3b30078b90 0x7f3b3007b0a0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f3b40006fd0 tx=0x7f3b40008040 comp rx=0 tx=0).stop 2024-09-17T01:49:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.434+0000 7f3b54a00640 1 -- 172.21.15.42:0/2952256164 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b500b51d0 msgr2=0x7f3b501f5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.434+0000 7f3b54a00640 1 --2- 172.21.15.42:0/2952256164 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b500b51d0 0x7f3b501f5730 secure :-1 s=READY pgs=2551 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c034040 tx=0x7f3b3c0038a0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.434+0000 7f3b54a00640 1 -- 172.21.15.42:0/2952256164 shutdown_connections 2024-09-17T01:49:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.434+0000 7f3b54a00640 1 --2- 172.21.15.42:0/2952256164 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3b30078b90 0x7f3b3007b0a0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.434+0000 7f3b54a00640 1 --2- 172.21.15.42:0/2952256164 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3b501605c0 0x7f3b500b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.434+0000 7f3b54a00640 1 --2- 172.21.15.42:0/2952256164 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b500b51d0 0x7f3b501f5730 unknown :-1 s=CLOSED pgs=2551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.434+0000 7f3b54a00640 1 --2- 172.21.15.42:0/2952256164 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b500afb00 0x7f3b501f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.434+0000 7f3b54a00640 1 -- 172.21.15.42:0/2952256164 >> 172.21.15.42:0/2952256164 conn(0x7f3b5006d3f0 msgr2=0x7f3b5015c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.434+0000 7f3b54a00640 1 -- 172.21.15.42:0/2952256164 shutdown_connections 2024-09-17T01:49:23.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.434+0000 7f3b54a00640 1 -- 172.21.15.42:0/2952256164 wait complete. 2024-09-17T01:49:23.468 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T01:49:23.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.698+0000 7f078fe00640 1 -- 172.21.15.42:0/1794428915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0790160500 msgr2=0x7f0790160910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:23.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.698+0000 7f078fe00640 1 --2- 172.21.15.42:0/1794428915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0790160500 0x7f0790160910 secure :-1 s=READY pgs=2556 cs=0 l=1 rev1=1 crypto rx=0x7f0788005fd0 tx=0x7f078802aa00 comp rx=0 tx=0).stop 2024-09-17T01:49:23.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.699+0000 7f078fe00640 1 -- 172.21.15.42:0/1794428915 shutdown_connections 2024-09-17T01:49:23.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.699+0000 7f078fe00640 1 --2- 172.21.15.42:0/1794428915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0790160500 0x7f0790160910 unknown :-1 s=CLOSED pgs=2556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.699+0000 7f078fe00640 1 --2- 172.21.15.42:0/1794428915 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f07900b3520 0x7f07900b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.699+0000 7f078fe00640 1 -- 172.21.15.42:0/1794428915 >> 172.21.15.42:0/1794428915 conn(0x7f079006d3f0 msgr2=0x7f07900b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:23.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.699+0000 7f078fe00640 1 -- 172.21.15.42:0/1794428915 shutdown_connections 2024-09-17T01:49:23.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.699+0000 7f078fe00640 1 -- 172.21.15.42:0/1794428915 wait complete. 2024-09-17T01:49:23.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.701+0000 7f078fe00640 1 Processor -- start 2024-09-17T01:49:23.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.701+0000 7f078fe00640 1 -- start start 2024-09-17T01:49:23.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.703+0000 7f078fe00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07900af970 0x7f079014a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:23.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.703+0000 7f078fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07900b3520 0x7f079014ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:23.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.703+0000 7f078fe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0790160500 0x7f07901f9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:23.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.703+0000 7f078fe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f07900ce700 con 0x7f07900b3520 2024-09-17T01:49:23.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.703+0000 7f078fe00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f07900ce580 con 0x7f07900af970 2024-09-17T01:49:23.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.703+0000 7f078fe00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f07900ce880 con 0x7f0790160500 2024-09-17T01:49:23.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.703+0000 7f0787e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07900b3520 0x7f079014ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:23.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.703+0000 7f0787e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07900b3520 0x7f079014ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:41682/0 (socket says 172.21.15.42:41682) 2024-09-17T01:49:23.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.703+0000 7f0787e00640 1 -- 172.21.15.42:0/4168323657 learned_addr learned my addr 172.21.15.42:0/4168323657 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:23.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.703+0000 7f078f400640 1 --2- 172.21.15.42:0/4168323657 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0790160500 0x7f07901f9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:23.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.703+0000 7f078ea00640 1 --2- 172.21.15.42:0/4168323657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07900af970 0x7f079014a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:23.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.703+0000 7f0787e00640 1 -- 172.21.15.42:0/4168323657 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0790160500 msgr2=0x7f07901f9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:23.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.703+0000 7f0787e00640 1 --2- 172.21.15.42:0/4168323657 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0790160500 0x7f07901f9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.704+0000 7f0787e00640 1 -- 172.21.15.42:0/4168323657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07900af970 msgr2=0x7f079014a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:23.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.704+0000 7f0787e00640 1 --2- 172.21.15.42:0/4168323657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07900af970 0x7f079014a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.704+0000 7f0787e00640 1 -- 172.21.15.42:0/4168323657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0790156400 con 0x7f07900b3520 2024-09-17T01:49:23.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.704+0000 7f0787e00640 1 --2- 172.21.15.42:0/4168323657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07900b3520 0x7f079014ac60 secure :-1 s=READY pgs=2557 cs=0 l=1 rev1=1 crypto rx=0x7f077800d780 tx=0x7f077800dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:23.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.704+0000 7f0786a00640 1 -- 172.21.15.42:0/4168323657 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0778017070 con 0x7f07900b3520 2024-09-17T01:49:23.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.704+0000 7f0786a00640 1 -- 172.21.15.42:0/4168323657 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0778009b10 con 0x7f07900b3520 2024-09-17T01:49:23.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.704+0000 7f0786a00640 1 -- 172.21.15.42:0/4168323657 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0778010460 con 0x7f07900b3520 2024-09-17T01:49:23.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.704+0000 7f078fe00640 1 -- 172.21.15.42:0/4168323657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0790159e00 con 0x7f07900b3520 2024-09-17T01:49:23.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.704+0000 7f078fe00640 1 -- 172.21.15.42:0/4168323657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f079015a3c0 con 0x7f07900b3520 2024-09-17T01:49:23.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.706+0000 7f078fe00640 1 -- 172.21.15.42:0/4168323657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07900b3930 con 0x7f07900b3520 2024-09-17T01:49:23.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.707+0000 7f0786a00640 1 -- 172.21.15.42:0/4168323657 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f077801a070 con 0x7f07900b3520 2024-09-17T01:49:23.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.708+0000 7f0786a00640 1 --2- 172.21.15.42:0/4168323657 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f076c078b90 0x7f076c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:23.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.708+0000 7f0786a00640 1 -- 172.21.15.42:0/4168323657 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 5709+0+0 (secure 0 0 0) 0x7f077809af60 con 0x7f07900b3520 2024-09-17T01:49:23.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.708+0000 7f078ea00640 1 --2- 172.21.15.42:0/4168323657 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f076c078b90 0x7f076c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:23.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.709+0000 7f078ea00640 1 --2- 172.21.15.42:0/4168323657 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f076c078b90 0x7f076c07b0a0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f0780006fd0 tx=0x7f0780009060 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:23.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.713+0000 7f0786a00640 1 -- 172.21.15.42:0/4168323657 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0790156400 con 0x7f07900b3520 2024-09-17T01:49:23.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.949+0000 7f078fe00640 1 -- 172.21.15.42:0/4168323657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f07900b4a60 con 0x7f07900b3520 2024-09-17T01:49:23.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.949+0000 7f0786a00640 1 -- 172.21.15.42:0/4168323657 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v177) ==== 53+0+73 (secure 0 0 0) 0x7f0778062cb0 con 0x7f07900b3520 2024-09-17T01:49:23.949 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T01:49:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.952+0000 7f078fe00640 1 -- 172.21.15.42:0/4168323657 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f076c078b90 msgr2=0x7f076c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.952+0000 7f078fe00640 1 --2- 172.21.15.42:0/4168323657 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f076c078b90 0x7f076c07b0a0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f0780006fd0 tx=0x7f0780009060 comp rx=0 tx=0).stop 2024-09-17T01:49:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.952+0000 7f078fe00640 1 -- 172.21.15.42:0/4168323657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07900b3520 msgr2=0x7f079014ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.952+0000 7f078fe00640 1 --2- 172.21.15.42:0/4168323657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07900b3520 0x7f079014ac60 secure :-1 s=READY pgs=2557 cs=0 l=1 rev1=1 crypto rx=0x7f077800d780 tx=0x7f077800dc40 comp rx=0 tx=0).stop 2024-09-17T01:49:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.952+0000 7f078fe00640 1 -- 172.21.15.42:0/4168323657 shutdown_connections 2024-09-17T01:49:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.952+0000 7f078fe00640 1 --2- 172.21.15.42:0/4168323657 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f076c078b90 0x7f076c07b0a0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.952+0000 7f078fe00640 1 --2- 172.21.15.42:0/4168323657 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0790160500 0x7f07901f9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.952+0000 7f078fe00640 1 --2- 172.21.15.42:0/4168323657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07900b3520 0x7f079014ac60 unknown :-1 s=CLOSED pgs=2557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.952+0000 7f078fe00640 1 --2- 172.21.15.42:0/4168323657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07900af970 0x7f079014a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.952+0000 7f078fe00640 1 -- 172.21.15.42:0/4168323657 >> 172.21.15.42:0/4168323657 conn(0x7f079006d3f0 msgr2=0x7f07900cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.952+0000 7f078fe00640 1 -- 172.21.15.42:0/4168323657 shutdown_connections 2024-09-17T01:49:23.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:23.952+0000 7f078fe00640 1 -- 172.21.15.42:0/4168323657 wait complete. 2024-09-17T01:49:23.976 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T01:49:23.977 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:49:23.977 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-09-17T01:49:23.977 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T01:49:23.977 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:49:23.977 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T01:49:23.977 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T01:49:23.977 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:49:23.977 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:49:23.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:23.977 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-09-17T01:49:24.013 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:49:24.014 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:49:24.014 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:49:24.014 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:49:24.014 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-09-17T01:49:24.014 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:49:24.014 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:49:24.014 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-09-17T01:49:24.014 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-09-17T01:49:24.014 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:49:24.014 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-09-17T01:49:24.014 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-09-17T01:49:24.015 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:49:24.015 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:49:24.015 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-09-17T01:49:24.015 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-17T01:49:24.015 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 41644sec preferred_lft 41644sec 2024-09-17T01:49:24.015 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-17T01:49:24.015 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:49:24.015 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:49:24.015 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:49:24.015 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-09-17T01:49:24.015 INFO:teuthology.orchestra.run.smithi042.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T01:49:24.016 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T01:49:24.016 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T01:49:24.016 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:49:24.016 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::68d2:2bff:fe2f:191a/64 scope link 2024-09-17T01:49:24.016 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:49:24.016 INFO:teuthology.orchestra.run.smithi042.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:49:24.016 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether e2:73:3e:9b:8a:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:49:24.016 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::e073:3eff:fe9b:8a00/64 scope link 2024-09-17T01:49:24.016 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:49:24.016 INFO:teuthology.orchestra.run.smithi042.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T01:49:24.016 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 26:0b:bf:b7:6e:5b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T01:49:24.016 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::240b:bfff:feb7:6e5b/64 scope link 2024-09-17T01:49:24.016 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:49:24.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:24.017 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:49:24.107 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-17T01:49:24.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:24.110 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-09-17T01:49:24.146 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-09-17T01:49:24.147 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:49:24.147 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-17T01:49:24.147 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-17T01:49:24.147 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:49:24.147 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:49:24.147 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-09-17T01:49:24.147 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T01:49:24.147 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T01:49:24.147 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T01:49:24.148 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-09-17T01:49:24.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:49:24.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:49:24.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:24.344 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-17T01:49:24.381 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T01:49:24.382 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T01:49:24.382 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:49:24.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:24.382 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-09-17T01:49:24.478 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:49:24.478 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T01:49:24.514 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:49:24.514 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:49:24.514 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:49:24.588 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T01:49:24.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:24.588 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:49:24.791 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:49:24.791 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:49:24.791 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:49:24.812 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:49:24.812 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:49:24.812 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:49:24.812 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:49:24.812 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:49:24.842 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T01:49:24.842 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T01:49:24.842 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2024-09-17T01:49:24.842 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.43:3300,172.21.15.43:3301" 2024-09-17T01:49:24.842 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T01:49:24.842 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790" 2024-09-17T01:49:24.842 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.43:6789,172.21.15.43:6790:/ 2024-09-17T01:49:24.842 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fea1c88c-cb05-432f-a745-f9dcbb5f2503" will pass to kernel 2024-09-17T01:49:24.843 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T01:49:24.844 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-09-17T01:49:24.844 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T01:49:24.844 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T01:49:24.844 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T01:49:24.847 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T01:49:24.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:24.847 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:49:24.903 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T01:49:24.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T01:49:24.994 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:49:25.002 INFO:teuthology.orchestra.run.smithi042.stdout:client9458 2024-09-17T01:49:25.002 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:49:25.002 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:49:25.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:25.038 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent) 2024-09-17T01:49:25.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:25.122 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/child) 2024-09-17T01:49:25.200 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:49:25.200 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:49:25.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:25.275 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=parent/parentfile bs=1M conv=fdatasync count=6 seek=0) 2024-09-17T01:49:25.414 INFO:teuthology.orchestra.run.smithi042.stderr:6+0 records in 2024-09-17T01:49:25.414 INFO:teuthology.orchestra.run.smithi042.stderr:6+0 records out 2024-09-17T01:49:25.415 INFO:teuthology.orchestra.run.smithi042.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0619188 s, 102 MB/s 2024-09-17T01:49:25.416 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:49:25.416 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:49:25.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:25.451 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=parent/child/childfile bs=1M conv=fdatasync count=6 seek=0) 2024-09-17T01:49:25.606 INFO:teuthology.orchestra.run.smithi042.stderr:6+0 records in 2024-09-17T01:49:25.606 INFO:teuthology.orchestra.run.smithi042.stderr:6+0 records out 2024-09-17T01:49:25.606 INFO:teuthology.orchestra.run.smithi042.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0783697 s, 80.3 MB/s 2024-09-17T01:49:25.608 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T01:49:25.612 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T01:49:25.708 INFO:teuthology.orchestra.run.smithi042.stdout:[global] 2024-09-17T01:49:25.708 INFO:teuthology.orchestra.run.smithi042.stdout: chdir = "" 2024-09-17T01:49:25.708 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T01:49:25.709 INFO:teuthology.orchestra.run.smithi042.stdout: auth supported = cephx 2024-09-17T01:49:25.709 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.709 INFO:teuthology.orchestra.run.smithi042.stdout: filestore xattr use omap = true 2024-09-17T01:49:25.709 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.709 INFO:teuthology.orchestra.run.smithi042.stdout: mon clock drift allowed = 1.000 2024-09-17T01:49:25.709 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.709 INFO:teuthology.orchestra.run.smithi042.stdout: osd crush chooseleaf type = 0 2024-09-17T01:49:25.709 INFO:teuthology.orchestra.run.smithi042.stdout: auth debug = true 2024-09-17T01:49:25.709 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.709 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on old message = true 2024-09-17T01:49:25.709 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on bug = true 2024-09-17T01:49:25.709 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.709 INFO:teuthology.orchestra.run.smithi042.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T01:49:25.709 INFO:teuthology.orchestra.run.smithi042.stdout: mon pg warn max object skew = 0 2024-09-17T01:49:25.710 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.710 INFO:teuthology.orchestra.run.smithi042.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T01:49:25.710 INFO:teuthology.orchestra.run.smithi042.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T01:49:25.710 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.710 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default size = 2 2024-09-17T01:49:25.710 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.710 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow primary affinity = true 2024-09-17T01:49:25.710 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow pg remap = true 2024-09-17T01:49:25.710 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on legacy crush tunables = false 2024-09-17T01:49:25.710 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on crush straw calc version zero = false 2024-09-17T01:49:25.710 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on no sortbitwise = false 2024-09-17T01:49:25.710 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on osd down out interval zero = false 2024-09-17T01:49:25.710 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on too few osds = false 2024-09-17T01:49:25.711 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T01:49:25.711 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T01:49:25.711 INFO:teuthology.orchestra.run.smithi042.stdout: mon_allow_pool_size_one = true 2024-09-17T01:49:25.711 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.711 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T01:49:25.711 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.711 INFO:teuthology.orchestra.run.smithi042.stdout: osd default data pool replay window = 5 2024-09-17T01:49:25.711 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.711 INFO:teuthology.orchestra.run.smithi042.stdout: mon allow pool delete = true 2024-09-17T01:49:25.711 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.711 INFO:teuthology.orchestra.run.smithi042.stdout: mon cluster log file level = debug 2024-09-17T01:49:25.711 INFO:teuthology.orchestra.run.smithi042.stdout: debug asserts on shutdown = true 2024-09-17T01:49:25.711 INFO:teuthology.orchestra.run.smithi042.stdout: mon health detail to clog = false 2024-09-17T01:49:25.711 INFO:teuthology.orchestra.run.smithi042.stdout: mon host = "172.21.15.42,172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790]" 2024-09-17T01:49:25.712 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on skipped message = False 2024-09-17T01:49:25.712 INFO:teuthology.orchestra.run.smithi042.stdout: fsid = fea1c88c-cb05-432f-a745-f9dcbb5f2503 2024-09-17T01:49:25.712 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.712 INFO:teuthology.orchestra.run.smithi042.stdout:[osd] 2024-09-17T01:49:25.712 INFO:teuthology.orchestra.run.smithi042.stdout: osd journal size = 100 2024-09-17T01:49:25.712 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.712 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub load threshold = 5.0 2024-09-17T01:49:25.712 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub max interval = 600 2024-09-17T01:49:25.712 INFO:teuthology.orchestra.run.smithi042.stdout: osd mclock profile = high_recovery_ops 2024-09-17T01:49:25.712 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.712 INFO:teuthology.orchestra.run.smithi042.stdout: osd recover clone overlap = true 2024-09-17T01:49:25.712 INFO:teuthology.orchestra.run.smithi042.stdout: osd recovery max chunk = 1048576 2024-09-17T01:49:25.712 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.713 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug shutdown = true 2024-09-17T01:49:25.713 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug op order = true 2024-09-17T01:49:25.713 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug verify stray on activate = true 2024-09-17T01:49:25.713 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug trim objects = true 2024-09-17T01:49:25.713 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.713 INFO:teuthology.orchestra.run.smithi042.stdout: osd open classes on start = true 2024-09-17T01:49:25.713 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug pg log writeout = true 2024-09-17T01:49:25.713 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.713 INFO:teuthology.orchestra.run.smithi042.stdout: osd deep scrub update digest min age = 30 2024-09-17T01:49:25.713 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.713 INFO:teuthology.orchestra.run.smithi042.stdout: osd map max advance = 10 2024-09-17T01:49:25.713 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.713 INFO:teuthology.orchestra.run.smithi042.stdout: journal zero on create = true 2024-09-17T01:49:25.713 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.714 INFO:teuthology.orchestra.run.smithi042.stdout: filestore ondisk finisher threads = 3 2024-09-17T01:49:25.714 INFO:teuthology.orchestra.run.smithi042.stdout: filestore apply finisher threads = 3 2024-09-17T01:49:25.714 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.714 INFO:teuthology.orchestra.run.smithi042.stdout: bdev debug aio = true 2024-09-17T01:49:25.714 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug misdirected ops = true 2024-09-17T01:49:25.714 INFO:teuthology.orchestra.run.smithi042.stdout: bdev async discard = True 2024-09-17T01:49:25.714 INFO:teuthology.orchestra.run.smithi042.stdout: bdev enable discard = True 2024-09-17T01:49:25.714 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore allocator = bitmap 2024-09-17T01:49:25.714 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore block size = 96636764160 2024-09-17T01:49:25.714 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore fsck on mount = True 2024-09-17T01:49:25.714 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluefs = 1/20 2024-09-17T01:49:25.714 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluestore = 1/20 2024-09-17T01:49:25.714 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-17T01:49:25.714 INFO:teuthology.orchestra.run.smithi042.stdout: debug osd = 20 2024-09-17T01:49:25.715 INFO:teuthology.orchestra.run.smithi042.stdout: debug rocksdb = 4/10 2024-09-17T01:49:25.715 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T01:49:25.715 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd full ratio = 0.9 2024-09-17T01:49:25.715 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd nearfull ratio = 0.8 2024-09-17T01:49:25.715 INFO:teuthology.orchestra.run.smithi042.stdout: osd failsafe full ratio = 0.95 2024-09-17T01:49:25.715 INFO:teuthology.orchestra.run.smithi042.stdout: osd objectstore = bluestore 2024-09-17T01:49:25.715 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.715 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr] 2024-09-17T01:49:25.715 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-17T01:49:25.715 INFO:teuthology.orchestra.run.smithi042.stdout: debug mgr = 20 2024-09-17T01:49:25.715 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-09-17T01:49:25.715 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-09-17T01:49:25.715 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:49:25.716 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:49:25.716 INFO:teuthology.orchestra.run.smithi042.stdout: mgr/telemetry/nag = false 2024-09-17T01:49:25.716 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.716 INFO:teuthology.orchestra.run.smithi042.stdout:[mon] 2024-09-17T01:49:25.716 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-17T01:49:25.716 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-09-17T01:49:25.716 INFO:teuthology.orchestra.run.smithi042.stdout: debug paxos = 20 2024-09-17T01:49:25.716 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-09-17T01:49:25.716 INFO:teuthology.orchestra.run.smithi042.stdout: mon data avail warn = 5 2024-09-17T01:49:25.716 INFO:teuthology.orchestra.run.smithi042.stdout: mon mgr mkfs grace = 240 2024-09-17T01:49:25.716 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:49:25.716 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd reporter subtree level = osd 2024-09-17T01:49:25.716 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd prime pg temp = true 2024-09-17T01:49:25.716 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:49:25.717 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.717 INFO:teuthology.orchestra.run.smithi042.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T01:49:25.717 INFO:teuthology.orchestra.run.smithi042.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T01:49:25.717 INFO:teuthology.orchestra.run.smithi042.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T01:49:25.717 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.717 INFO:teuthology.orchestra.run.smithi042.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T01:49:25.717 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T01:49:25.717 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T01:49:25.717 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.717 INFO:teuthology.orchestra.run.smithi042.stdout: # 1m isn't quite enough 2024-09-17T01:49:25.717 INFO:teuthology.orchestra.run.smithi042.stdout: mon_down_mkfs_grace = 2m 2024-09-17T01:49:25.717 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.718 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_filestore_osds = false 2024-09-17T01:49:25.718 INFO:teuthology.orchestra.run.smithi042.stdout: mon down mkfs grace = 300 2024-09-17T01:49:25.718 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.718 INFO:teuthology.orchestra.run.smithi042.stdout:[client] 2024-09-17T01:49:25.718 INFO:teuthology.orchestra.run.smithi042.stdout: rgw cache enabled = true 2024-09-17T01:49:25.718 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable ops log = true 2024-09-17T01:49:25.718 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable usage log = true 2024-09-17T01:49:25.718 INFO:teuthology.orchestra.run.smithi042.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T01:49:25.718 INFO:teuthology.orchestra.run.smithi042.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T01:49:25.718 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = "" 2024-09-17T01:49:25.718 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.a] 2024-09-17T01:49:25.718 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.b] 2024-09-17T01:49:25.718 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.c] 2024-09-17T01:49:25.718 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.a] 2024-09-17T01:49:25.719 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.c] 2024-09-17T01:49:25.719 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.b] 2024-09-17T01:49:25.719 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.d] 2024-09-17T01:49:25.719 INFO:teuthology.orchestra.run.smithi042.stdout:[mds] 2024-09-17T01:49:25.719 INFO:teuthology.orchestra.run.smithi042.stdout: mds cache max size = 1000 2024-09-17T01:49:25.719 INFO:teuthology.orchestra.run.smithi042.stdout: mds log max segments = 1 2024-09-17T01:49:25.719 INFO:teuthology.orchestra.run.smithi042.stdout: mds verify scatter = False 2024-09-17T01:49:25.719 INFO:teuthology.orchestra.run.smithi042.stdout: mds debug scatterstat = False 2024-09-17T01:49:25.720 INFO:teuthology.orchestra.run.smithi043.stdout:[global] 2024-09-17T01:49:25.720 INFO:teuthology.orchestra.run.smithi043.stdout: chdir = "" 2024-09-17T01:49:25.720 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T01:49:25.720 INFO:teuthology.orchestra.run.smithi043.stdout: auth supported = cephx 2024-09-17T01:49:25.720 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.720 INFO:teuthology.orchestra.run.smithi043.stdout: filestore xattr use omap = true 2024-09-17T01:49:25.721 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.721 INFO:teuthology.orchestra.run.smithi043.stdout: mon clock drift allowed = 1.000 2024-09-17T01:49:25.721 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.721 INFO:teuthology.orchestra.run.smithi043.stdout: osd crush chooseleaf type = 0 2024-09-17T01:49:25.721 INFO:teuthology.orchestra.run.smithi043.stdout: auth debug = true 2024-09-17T01:49:25.721 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.721 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on old message = true 2024-09-17T01:49:25.721 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on bug = true 2024-09-17T01:49:25.721 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.721 INFO:teuthology.orchestra.run.smithi043.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T01:49:25.721 INFO:teuthology.orchestra.run.smithi043.stdout: mon pg warn max object skew = 0 2024-09-17T01:49:25.721 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.721 INFO:teuthology.orchestra.run.smithi043.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T01:49:25.722 INFO:teuthology.orchestra.run.smithi043.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T01:49:25.722 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.722 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default size = 2 2024-09-17T01:49:25.722 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.722 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow primary affinity = true 2024-09-17T01:49:25.722 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow pg remap = true 2024-09-17T01:49:25.722 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on legacy crush tunables = false 2024-09-17T01:49:25.722 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on crush straw calc version zero = false 2024-09-17T01:49:25.722 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on no sortbitwise = false 2024-09-17T01:49:25.722 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on osd down out interval zero = false 2024-09-17T01:49:25.722 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on too few osds = false 2024-09-17T01:49:25.722 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T01:49:25.722 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T01:49:25.722 INFO:teuthology.orchestra.run.smithi043.stdout: mon_allow_pool_size_one = true 2024-09-17T01:49:25.723 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.723 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T01:49:25.723 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.723 INFO:teuthology.orchestra.run.smithi043.stdout: osd default data pool replay window = 5 2024-09-17T01:49:25.723 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.723 INFO:teuthology.orchestra.run.smithi043.stdout: mon allow pool delete = true 2024-09-17T01:49:25.723 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.723 INFO:teuthology.orchestra.run.smithi043.stdout: mon cluster log file level = debug 2024-09-17T01:49:25.723 INFO:teuthology.orchestra.run.smithi043.stdout: debug asserts on shutdown = true 2024-09-17T01:49:25.723 INFO:teuthology.orchestra.run.smithi043.stdout: mon health detail to clog = false 2024-09-17T01:49:25.723 INFO:teuthology.orchestra.run.smithi043.stdout: mon host = "172.21.15.42,172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790]" 2024-09-17T01:49:25.723 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on skipped message = False 2024-09-17T01:49:25.723 INFO:teuthology.orchestra.run.smithi043.stdout: fsid = fea1c88c-cb05-432f-a745-f9dcbb5f2503 2024-09-17T01:49:25.723 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.724 INFO:teuthology.orchestra.run.smithi043.stdout:[osd] 2024-09-17T01:49:25.724 INFO:teuthology.orchestra.run.smithi043.stdout: osd journal size = 100 2024-09-17T01:49:25.724 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.724 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub load threshold = 5.0 2024-09-17T01:49:25.724 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub max interval = 600 2024-09-17T01:49:25.724 INFO:teuthology.orchestra.run.smithi043.stdout: osd mclock profile = high_recovery_ops 2024-09-17T01:49:25.724 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.724 INFO:teuthology.orchestra.run.smithi043.stdout: osd recover clone overlap = true 2024-09-17T01:49:25.724 INFO:teuthology.orchestra.run.smithi043.stdout: osd recovery max chunk = 1048576 2024-09-17T01:49:25.724 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.724 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug shutdown = true 2024-09-17T01:49:25.724 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug op order = true 2024-09-17T01:49:25.724 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug verify stray on activate = true 2024-09-17T01:49:25.725 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug trim objects = true 2024-09-17T01:49:25.725 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.725 INFO:teuthology.orchestra.run.smithi043.stdout: osd open classes on start = true 2024-09-17T01:49:25.725 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug pg log writeout = true 2024-09-17T01:49:25.725 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.725 INFO:teuthology.orchestra.run.smithi043.stdout: osd deep scrub update digest min age = 30 2024-09-17T01:49:25.725 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.725 INFO:teuthology.orchestra.run.smithi043.stdout: osd map max advance = 10 2024-09-17T01:49:25.725 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.725 INFO:teuthology.orchestra.run.smithi043.stdout: journal zero on create = true 2024-09-17T01:49:25.725 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.725 INFO:teuthology.orchestra.run.smithi043.stdout: filestore ondisk finisher threads = 3 2024-09-17T01:49:25.725 INFO:teuthology.orchestra.run.smithi043.stdout: filestore apply finisher threads = 3 2024-09-17T01:49:25.725 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.726 INFO:teuthology.orchestra.run.smithi043.stdout: bdev debug aio = true 2024-09-17T01:49:25.726 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug misdirected ops = true 2024-09-17T01:49:25.726 INFO:teuthology.orchestra.run.smithi043.stdout: bdev async discard = True 2024-09-17T01:49:25.726 INFO:teuthology.orchestra.run.smithi043.stdout: bdev enable discard = True 2024-09-17T01:49:25.726 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore allocator = bitmap 2024-09-17T01:49:25.726 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore block size = 96636764160 2024-09-17T01:49:25.726 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore fsck on mount = True 2024-09-17T01:49:25.726 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluefs = 1/20 2024-09-17T01:49:25.726 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluestore = 1/20 2024-09-17T01:49:25.726 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-17T01:49:25.726 INFO:teuthology.orchestra.run.smithi043.stdout: debug osd = 20 2024-09-17T01:49:25.726 INFO:teuthology.orchestra.run.smithi043.stdout: debug rocksdb = 4/10 2024-09-17T01:49:25.726 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T01:49:25.726 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd full ratio = 0.9 2024-09-17T01:49:25.727 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd nearfull ratio = 0.8 2024-09-17T01:49:25.727 INFO:teuthology.orchestra.run.smithi043.stdout: osd failsafe full ratio = 0.95 2024-09-17T01:49:25.727 INFO:teuthology.orchestra.run.smithi043.stdout: osd objectstore = bluestore 2024-09-17T01:49:25.727 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.727 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr] 2024-09-17T01:49:25.727 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-17T01:49:25.727 INFO:teuthology.orchestra.run.smithi043.stdout: debug mgr = 20 2024-09-17T01:49:25.727 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-09-17T01:49:25.727 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-09-17T01:49:25.727 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:49:25.727 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:49:25.727 INFO:teuthology.orchestra.run.smithi043.stdout: mgr/telemetry/nag = false 2024-09-17T01:49:25.727 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.727 INFO:teuthology.orchestra.run.smithi043.stdout:[mon] 2024-09-17T01:49:25.728 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-17T01:49:25.728 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-09-17T01:49:25.728 INFO:teuthology.orchestra.run.smithi043.stdout: debug paxos = 20 2024-09-17T01:49:25.728 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-09-17T01:49:25.728 INFO:teuthology.orchestra.run.smithi043.stdout: mon data avail warn = 5 2024-09-17T01:49:25.728 INFO:teuthology.orchestra.run.smithi043.stdout: mon mgr mkfs grace = 240 2024-09-17T01:49:25.728 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:49:25.728 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd reporter subtree level = osd 2024-09-17T01:49:25.728 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd prime pg temp = true 2024-09-17T01:49:25.728 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:49:25.728 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.728 INFO:teuthology.orchestra.run.smithi043.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T01:49:25.728 INFO:teuthology.orchestra.run.smithi043.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T01:49:25.728 INFO:teuthology.orchestra.run.smithi043.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T01:49:25.729 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.729 INFO:teuthology.orchestra.run.smithi043.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T01:49:25.729 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T01:49:25.729 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T01:49:25.729 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.729 INFO:teuthology.orchestra.run.smithi043.stdout: # 1m isn't quite enough 2024-09-17T01:49:25.729 INFO:teuthology.orchestra.run.smithi043.stdout: mon_down_mkfs_grace = 2m 2024-09-17T01:49:25.729 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.729 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_filestore_osds = false 2024-09-17T01:49:25.729 INFO:teuthology.orchestra.run.smithi043.stdout: mon down mkfs grace = 300 2024-09-17T01:49:25.729 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.729 INFO:teuthology.orchestra.run.smithi043.stdout:[client] 2024-09-17T01:49:25.729 INFO:teuthology.orchestra.run.smithi043.stdout: rgw cache enabled = true 2024-09-17T01:49:25.729 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable ops log = true 2024-09-17T01:49:25.730 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable usage log = true 2024-09-17T01:49:25.730 INFO:teuthology.orchestra.run.smithi043.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T01:49:25.730 INFO:teuthology.orchestra.run.smithi043.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T01:49:25.730 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = "" 2024-09-17T01:49:25.730 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.a] 2024-09-17T01:49:25.730 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.b] 2024-09-17T01:49:25.730 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.c] 2024-09-17T01:49:25.730 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a] 2024-09-17T01:49:25.730 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.c] 2024-09-17T01:49:25.730 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.b] 2024-09-17T01:49:25.730 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.d] 2024-09-17T01:49:25.730 INFO:teuthology.orchestra.run.smithi043.stdout:[mds] 2024-09-17T01:49:25.730 INFO:teuthology.orchestra.run.smithi043.stdout: mds cache max size = 1000 2024-09-17T01:49:25.730 INFO:teuthology.orchestra.run.smithi043.stdout: mds log max segments = 1 2024-09-17T01:49:25.731 INFO:teuthology.orchestra.run.smithi043.stdout: mds verify scatter = False 2024-09-17T01:49:25.731 INFO:teuthology.orchestra.run.smithi043.stdout: mds debug scatterstat = False 2024-09-17T01:49:25.748 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T01:49:25.752 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T01:49:25.846 INFO:teuthology.orchestra.run.smithi042.stdout:[global] 2024-09-17T01:49:25.847 INFO:teuthology.orchestra.run.smithi042.stdout: chdir = "" 2024-09-17T01:49:25.847 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T01:49:25.847 INFO:teuthology.orchestra.run.smithi042.stdout: auth supported = cephx 2024-09-17T01:49:25.847 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.847 INFO:teuthology.orchestra.run.smithi042.stdout: filestore xattr use omap = true 2024-09-17T01:49:25.847 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.847 INFO:teuthology.orchestra.run.smithi042.stdout: mon clock drift allowed = 1.000 2024-09-17T01:49:25.847 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.847 INFO:teuthology.orchestra.run.smithi042.stdout: osd crush chooseleaf type = 0 2024-09-17T01:49:25.847 INFO:teuthology.orchestra.run.smithi042.stdout: auth debug = true 2024-09-17T01:49:25.847 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.847 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on old message = true 2024-09-17T01:49:25.847 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on bug = true 2024-09-17T01:49:25.847 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.848 INFO:teuthology.orchestra.run.smithi042.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T01:49:25.848 INFO:teuthology.orchestra.run.smithi042.stdout: mon pg warn max object skew = 0 2024-09-17T01:49:25.848 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.848 INFO:teuthology.orchestra.run.smithi042.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T01:49:25.848 INFO:teuthology.orchestra.run.smithi042.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T01:49:25.848 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.848 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default size = 2 2024-09-17T01:49:25.848 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.848 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow primary affinity = true 2024-09-17T01:49:25.848 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow pg remap = true 2024-09-17T01:49:25.848 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on legacy crush tunables = false 2024-09-17T01:49:25.848 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on crush straw calc version zero = false 2024-09-17T01:49:25.848 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on no sortbitwise = false 2024-09-17T01:49:25.849 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on osd down out interval zero = false 2024-09-17T01:49:25.849 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on too few osds = false 2024-09-17T01:49:25.849 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T01:49:25.849 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T01:49:25.849 INFO:teuthology.orchestra.run.smithi042.stdout: mon_allow_pool_size_one = true 2024-09-17T01:49:25.849 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.849 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T01:49:25.849 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.849 INFO:teuthology.orchestra.run.smithi042.stdout: osd default data pool replay window = 5 2024-09-17T01:49:25.849 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.849 INFO:teuthology.orchestra.run.smithi042.stdout: mon allow pool delete = true 2024-09-17T01:49:25.849 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.849 INFO:teuthology.orchestra.run.smithi042.stdout: mon cluster log file level = debug 2024-09-17T01:49:25.850 INFO:teuthology.orchestra.run.smithi042.stdout: debug asserts on shutdown = true 2024-09-17T01:49:25.850 INFO:teuthology.orchestra.run.smithi042.stdout: mon health detail to clog = false 2024-09-17T01:49:25.850 INFO:teuthology.orchestra.run.smithi042.stdout: mon host = "172.21.15.42,172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790]" 2024-09-17T01:49:25.850 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on skipped message = False 2024-09-17T01:49:25.850 INFO:teuthology.orchestra.run.smithi042.stdout: fsid = fea1c88c-cb05-432f-a745-f9dcbb5f2503 2024-09-17T01:49:25.850 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.850 INFO:teuthology.orchestra.run.smithi042.stdout:[osd] 2024-09-17T01:49:25.850 INFO:teuthology.orchestra.run.smithi042.stdout: osd journal size = 100 2024-09-17T01:49:25.850 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.850 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub load threshold = 5.0 2024-09-17T01:49:25.850 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub max interval = 600 2024-09-17T01:49:25.850 INFO:teuthology.orchestra.run.smithi042.stdout: osd mclock profile = high_recovery_ops 2024-09-17T01:49:25.850 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.851 INFO:teuthology.orchestra.run.smithi042.stdout: osd recover clone overlap = true 2024-09-17T01:49:25.851 INFO:teuthology.orchestra.run.smithi042.stdout: osd recovery max chunk = 1048576 2024-09-17T01:49:25.851 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.851 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug shutdown = true 2024-09-17T01:49:25.851 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug op order = true 2024-09-17T01:49:25.851 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug verify stray on activate = true 2024-09-17T01:49:25.851 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug trim objects = true 2024-09-17T01:49:25.851 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.851 INFO:teuthology.orchestra.run.smithi042.stdout: osd open classes on start = true 2024-09-17T01:49:25.851 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug pg log writeout = true 2024-09-17T01:49:25.851 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.851 INFO:teuthology.orchestra.run.smithi042.stdout: osd deep scrub update digest min age = 30 2024-09-17T01:49:25.851 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.851 INFO:teuthology.orchestra.run.smithi042.stdout: osd map max advance = 10 2024-09-17T01:49:25.852 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.852 INFO:teuthology.orchestra.run.smithi042.stdout: journal zero on create = true 2024-09-17T01:49:25.852 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.852 INFO:teuthology.orchestra.run.smithi042.stdout: filestore ondisk finisher threads = 3 2024-09-17T01:49:25.852 INFO:teuthology.orchestra.run.smithi042.stdout: filestore apply finisher threads = 3 2024-09-17T01:49:25.852 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.852 INFO:teuthology.orchestra.run.smithi042.stdout: bdev debug aio = true 2024-09-17T01:49:25.852 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug misdirected ops = true 2024-09-17T01:49:25.852 INFO:teuthology.orchestra.run.smithi042.stdout: bdev async discard = True 2024-09-17T01:49:25.852 INFO:teuthology.orchestra.run.smithi042.stdout: bdev enable discard = True 2024-09-17T01:49:25.852 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore allocator = bitmap 2024-09-17T01:49:25.852 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore block size = 96636764160 2024-09-17T01:49:25.852 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore fsck on mount = True 2024-09-17T01:49:25.852 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluefs = 1/20 2024-09-17T01:49:25.853 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluestore = 1/20 2024-09-17T01:49:25.853 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-17T01:49:25.853 INFO:teuthology.orchestra.run.smithi042.stdout: debug osd = 20 2024-09-17T01:49:25.853 INFO:teuthology.orchestra.run.smithi042.stdout: debug rocksdb = 4/10 2024-09-17T01:49:25.853 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T01:49:25.853 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd full ratio = 0.9 2024-09-17T01:49:25.853 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd nearfull ratio = 0.8 2024-09-17T01:49:25.853 INFO:teuthology.orchestra.run.smithi042.stdout: osd failsafe full ratio = 0.95 2024-09-17T01:49:25.853 INFO:teuthology.orchestra.run.smithi042.stdout: osd objectstore = bluestore 2024-09-17T01:49:25.853 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.853 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr] 2024-09-17T01:49:25.853 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-17T01:49:25.854 INFO:teuthology.orchestra.run.smithi042.stdout: debug mgr = 20 2024-09-17T01:49:25.854 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-09-17T01:49:25.854 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-09-17T01:49:25.854 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:49:25.854 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:49:25.854 INFO:teuthology.orchestra.run.smithi042.stdout: mgr/telemetry/nag = false 2024-09-17T01:49:25.854 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.854 INFO:teuthology.orchestra.run.smithi042.stdout:[mon] 2024-09-17T01:49:25.854 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-09-17T01:49:25.854 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-09-17T01:49:25.854 INFO:teuthology.orchestra.run.smithi042.stdout: debug paxos = 20 2024-09-17T01:49:25.854 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-09-17T01:49:25.854 INFO:teuthology.orchestra.run.smithi042.stdout: mon data avail warn = 5 2024-09-17T01:49:25.855 INFO:teuthology.orchestra.run.smithi042.stdout: mon mgr mkfs grace = 240 2024-09-17T01:49:25.855 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:49:25.855 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd reporter subtree level = osd 2024-09-17T01:49:25.855 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd prime pg temp = true 2024-09-17T01:49:25.855 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:49:25.855 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.855 INFO:teuthology.orchestra.run.smithi042.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T01:49:25.855 INFO:teuthology.orchestra.run.smithi042.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T01:49:25.855 INFO:teuthology.orchestra.run.smithi042.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T01:49:25.855 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.855 INFO:teuthology.orchestra.run.smithi042.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T01:49:25.855 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T01:49:25.856 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T01:49:25.856 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.856 INFO:teuthology.orchestra.run.smithi042.stdout: # 1m isn't quite enough 2024-09-17T01:49:25.856 INFO:teuthology.orchestra.run.smithi042.stdout: mon_down_mkfs_grace = 2m 2024-09-17T01:49:25.856 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.856 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_filestore_osds = false 2024-09-17T01:49:25.856 INFO:teuthology.orchestra.run.smithi042.stdout: mon down mkfs grace = 300 2024-09-17T01:49:25.856 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:25.856 INFO:teuthology.orchestra.run.smithi042.stdout:[client] 2024-09-17T01:49:25.856 INFO:teuthology.orchestra.run.smithi042.stdout: rgw cache enabled = true 2024-09-17T01:49:25.856 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable ops log = true 2024-09-17T01:49:25.856 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable usage log = true 2024-09-17T01:49:25.856 INFO:teuthology.orchestra.run.smithi042.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T01:49:25.857 INFO:teuthology.orchestra.run.smithi042.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T01:49:25.857 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = "" 2024-09-17T01:49:25.857 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.a] 2024-09-17T01:49:25.857 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.b] 2024-09-17T01:49:25.857 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.c] 2024-09-17T01:49:25.857 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.a] 2024-09-17T01:49:25.857 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.c] 2024-09-17T01:49:25.857 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.b] 2024-09-17T01:49:25.857 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.d] 2024-09-17T01:49:25.857 INFO:teuthology.orchestra.run.smithi042.stdout:[mds] 2024-09-17T01:49:25.857 INFO:teuthology.orchestra.run.smithi042.stdout: mds cache max size = 1000 2024-09-17T01:49:25.857 INFO:teuthology.orchestra.run.smithi042.stdout: mds log max segments = 1 2024-09-17T01:49:25.858 INFO:teuthology.orchestra.run.smithi042.stdout: mds verify scatter = False 2024-09-17T01:49:25.858 INFO:teuthology.orchestra.run.smithi042.stdout: mds debug scatterstat = False 2024-09-17T01:49:25.858 INFO:teuthology.orchestra.run.smithi043.stdout:[global] 2024-09-17T01:49:25.858 INFO:teuthology.orchestra.run.smithi043.stdout: chdir = "" 2024-09-17T01:49:25.858 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T01:49:25.858 INFO:teuthology.orchestra.run.smithi043.stdout: auth supported = cephx 2024-09-17T01:49:25.858 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.858 INFO:teuthology.orchestra.run.smithi043.stdout: filestore xattr use omap = true 2024-09-17T01:49:25.858 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.859 INFO:teuthology.orchestra.run.smithi043.stdout: mon clock drift allowed = 1.000 2024-09-17T01:49:25.859 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.859 INFO:teuthology.orchestra.run.smithi043.stdout: osd crush chooseleaf type = 0 2024-09-17T01:49:25.859 INFO:teuthology.orchestra.run.smithi043.stdout: auth debug = true 2024-09-17T01:49:25.859 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.859 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on old message = true 2024-09-17T01:49:25.859 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on bug = true 2024-09-17T01:49:25.859 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.859 INFO:teuthology.orchestra.run.smithi043.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T01:49:25.859 INFO:teuthology.orchestra.run.smithi043.stdout: mon pg warn max object skew = 0 2024-09-17T01:49:25.859 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.859 INFO:teuthology.orchestra.run.smithi043.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T01:49:25.859 INFO:teuthology.orchestra.run.smithi043.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T01:49:25.860 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.860 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default size = 2 2024-09-17T01:49:25.860 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.860 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow primary affinity = true 2024-09-17T01:49:25.860 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow pg remap = true 2024-09-17T01:49:25.860 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on legacy crush tunables = false 2024-09-17T01:49:25.860 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on crush straw calc version zero = false 2024-09-17T01:49:25.860 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on no sortbitwise = false 2024-09-17T01:49:25.860 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on osd down out interval zero = false 2024-09-17T01:49:25.860 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on too few osds = false 2024-09-17T01:49:25.860 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T01:49:25.860 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T01:49:25.860 INFO:teuthology.orchestra.run.smithi043.stdout: mon_allow_pool_size_one = true 2024-09-17T01:49:25.861 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.861 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T01:49:25.861 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.861 INFO:teuthology.orchestra.run.smithi043.stdout: osd default data pool replay window = 5 2024-09-17T01:49:25.861 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.861 INFO:teuthology.orchestra.run.smithi043.stdout: mon allow pool delete = true 2024-09-17T01:49:25.861 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.861 INFO:teuthology.orchestra.run.smithi043.stdout: mon cluster log file level = debug 2024-09-17T01:49:25.861 INFO:teuthology.orchestra.run.smithi043.stdout: debug asserts on shutdown = true 2024-09-17T01:49:25.861 INFO:teuthology.orchestra.run.smithi043.stdout: mon health detail to clog = false 2024-09-17T01:49:25.861 INFO:teuthology.orchestra.run.smithi043.stdout: mon host = "172.21.15.42,172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790]" 2024-09-17T01:49:25.861 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on skipped message = False 2024-09-17T01:49:25.861 INFO:teuthology.orchestra.run.smithi043.stdout: fsid = fea1c88c-cb05-432f-a745-f9dcbb5f2503 2024-09-17T01:49:25.862 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.862 INFO:teuthology.orchestra.run.smithi043.stdout:[osd] 2024-09-17T01:49:25.862 INFO:teuthology.orchestra.run.smithi043.stdout: osd journal size = 100 2024-09-17T01:49:25.862 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.862 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub load threshold = 5.0 2024-09-17T01:49:25.862 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub max interval = 600 2024-09-17T01:49:25.862 INFO:teuthology.orchestra.run.smithi043.stdout: osd mclock profile = high_recovery_ops 2024-09-17T01:49:25.862 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.862 INFO:teuthology.orchestra.run.smithi043.stdout: osd recover clone overlap = true 2024-09-17T01:49:25.862 INFO:teuthology.orchestra.run.smithi043.stdout: osd recovery max chunk = 1048576 2024-09-17T01:49:25.862 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.862 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug shutdown = true 2024-09-17T01:49:25.862 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug op order = true 2024-09-17T01:49:25.862 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug verify stray on activate = true 2024-09-17T01:49:25.863 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug trim objects = true 2024-09-17T01:49:25.863 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.863 INFO:teuthology.orchestra.run.smithi043.stdout: osd open classes on start = true 2024-09-17T01:49:25.863 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug pg log writeout = true 2024-09-17T01:49:25.863 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.863 INFO:teuthology.orchestra.run.smithi043.stdout: osd deep scrub update digest min age = 30 2024-09-17T01:49:25.863 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.863 INFO:teuthology.orchestra.run.smithi043.stdout: osd map max advance = 10 2024-09-17T01:49:25.863 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.863 INFO:teuthology.orchestra.run.smithi043.stdout: journal zero on create = true 2024-09-17T01:49:25.863 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.863 INFO:teuthology.orchestra.run.smithi043.stdout: filestore ondisk finisher threads = 3 2024-09-17T01:49:25.863 INFO:teuthology.orchestra.run.smithi043.stdout: filestore apply finisher threads = 3 2024-09-17T01:49:25.864 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.864 INFO:teuthology.orchestra.run.smithi043.stdout: bdev debug aio = true 2024-09-17T01:49:25.864 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug misdirected ops = true 2024-09-17T01:49:25.864 INFO:teuthology.orchestra.run.smithi043.stdout: bdev async discard = True 2024-09-17T01:49:25.864 INFO:teuthology.orchestra.run.smithi043.stdout: bdev enable discard = True 2024-09-17T01:49:25.864 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore allocator = bitmap 2024-09-17T01:49:25.864 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore block size = 96636764160 2024-09-17T01:49:25.864 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore fsck on mount = True 2024-09-17T01:49:25.864 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluefs = 1/20 2024-09-17T01:49:25.864 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluestore = 1/20 2024-09-17T01:49:25.864 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-17T01:49:25.864 INFO:teuthology.orchestra.run.smithi043.stdout: debug osd = 20 2024-09-17T01:49:25.864 INFO:teuthology.orchestra.run.smithi043.stdout: debug rocksdb = 4/10 2024-09-17T01:49:25.865 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T01:49:25.865 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd full ratio = 0.9 2024-09-17T01:49:25.865 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd nearfull ratio = 0.8 2024-09-17T01:49:25.865 INFO:teuthology.orchestra.run.smithi043.stdout: osd failsafe full ratio = 0.95 2024-09-17T01:49:25.865 INFO:teuthology.orchestra.run.smithi043.stdout: osd objectstore = bluestore 2024-09-17T01:49:25.865 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.865 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr] 2024-09-17T01:49:25.865 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-17T01:49:25.865 INFO:teuthology.orchestra.run.smithi043.stdout: debug mgr = 20 2024-09-17T01:49:25.865 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-09-17T01:49:25.865 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-09-17T01:49:25.865 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:49:25.866 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:49:25.866 INFO:teuthology.orchestra.run.smithi043.stdout: mgr/telemetry/nag = false 2024-09-17T01:49:25.866 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.866 INFO:teuthology.orchestra.run.smithi043.stdout:[mon] 2024-09-17T01:49:25.866 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-17T01:49:25.866 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-09-17T01:49:25.866 INFO:teuthology.orchestra.run.smithi043.stdout: debug paxos = 20 2024-09-17T01:49:25.866 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-09-17T01:49:25.866 INFO:teuthology.orchestra.run.smithi043.stdout: mon data avail warn = 5 2024-09-17T01:49:25.866 INFO:teuthology.orchestra.run.smithi043.stdout: mon mgr mkfs grace = 240 2024-09-17T01:49:25.866 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-09-17T01:49:25.866 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd reporter subtree level = osd 2024-09-17T01:49:25.866 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd prime pg temp = true 2024-09-17T01:49:25.867 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-09-17T01:49:25.867 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.867 INFO:teuthology.orchestra.run.smithi043.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T01:49:25.867 INFO:teuthology.orchestra.run.smithi043.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T01:49:25.867 INFO:teuthology.orchestra.run.smithi043.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T01:49:25.867 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.867 INFO:teuthology.orchestra.run.smithi043.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T01:49:25.867 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T01:49:25.867 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T01:49:25.867 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.867 INFO:teuthology.orchestra.run.smithi043.stdout: # 1m isn't quite enough 2024-09-17T01:49:25.867 INFO:teuthology.orchestra.run.smithi043.stdout: mon_down_mkfs_grace = 2m 2024-09-17T01:49:25.867 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.867 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_filestore_osds = false 2024-09-17T01:49:25.867 INFO:teuthology.orchestra.run.smithi043.stdout: mon down mkfs grace = 300 2024-09-17T01:49:25.868 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-17T01:49:25.868 INFO:teuthology.orchestra.run.smithi043.stdout:[client] 2024-09-17T01:49:25.868 INFO:teuthology.orchestra.run.smithi043.stdout: rgw cache enabled = true 2024-09-17T01:49:25.868 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable ops log = true 2024-09-17T01:49:25.868 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable usage log = true 2024-09-17T01:49:25.868 INFO:teuthology.orchestra.run.smithi043.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T01:49:25.868 INFO:teuthology.orchestra.run.smithi043.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T01:49:25.868 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = "" 2024-09-17T01:49:25.868 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.a] 2024-09-17T01:49:25.868 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.b] 2024-09-17T01:49:25.868 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.c] 2024-09-17T01:49:25.868 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a] 2024-09-17T01:49:25.868 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.c] 2024-09-17T01:49:25.868 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.b] 2024-09-17T01:49:25.869 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.d] 2024-09-17T01:49:25.869 INFO:teuthology.orchestra.run.smithi043.stdout:[mds] 2024-09-17T01:49:25.869 INFO:teuthology.orchestra.run.smithi043.stdout: mds cache max size = 1000 2024-09-17T01:49:25.869 INFO:teuthology.orchestra.run.smithi043.stdout: mds log max segments = 1 2024-09-17T01:49:25.869 INFO:teuthology.orchestra.run.smithi043.stdout: mds verify scatter = False 2024-09-17T01:49:25.869 INFO:teuthology.orchestra.run.smithi043.stdout: mds debug scatterstat = False 2024-09-17T01:49:25.875 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:49:25.876 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:49:25.911 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:49:25.911 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:49:25.987 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T01:49:26.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.258+0000 7f53b1a00640 1 -- 172.21.15.42:0/260166367 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53ac15c9c0 msgr2=0x7f53ac06f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:26.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.258+0000 7f53b1a00640 1 --2- 172.21.15.42:0/260166367 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53ac15c9c0 0x7f53ac06f930 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f539c009830 tx=0x7f539c02a490 comp rx=0 tx=0).stop 2024-09-17T01:49:26.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.258+0000 7f53b1a00640 1 -- 172.21.15.42:0/260166367 shutdown_connections 2024-09-17T01:49:26.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.258+0000 7f53b1a00640 1 --2- 172.21.15.42:0/260166367 >> v2:172.21.15.43:3300/0 conn(0x7f53ac152770 0x7f53ac0cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:26.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.258+0000 7f53b1a00640 1 --2- 172.21.15.42:0/260166367 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53ac15c9c0 0x7f53ac06f930 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:26.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.258+0000 7f53b1a00640 1 -- 172.21.15.42:0/260166367 >> 172.21.15.42:0/260166367 conn(0x7f53ac06d3f0 msgr2=0x7f53ac0b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:26.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.258+0000 7f53b1a00640 1 -- 172.21.15.42:0/260166367 shutdown_connections 2024-09-17T01:49:26.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.258+0000 7f53b1a00640 1 -- 172.21.15.42:0/260166367 wait complete. 2024-09-17T01:49:26.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.260+0000 7f53b1a00640 1 Processor -- start 2024-09-17T01:49:26.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.261+0000 7f53b1a00640 1 -- start start 2024-09-17T01:49:26.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.262+0000 7f53b1a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53ac0cf9c0 0x7f53ac157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:26.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.262+0000 7f53b1a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53ac152770 0x7f53ac14c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:26.260 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.262+0000 7f53b1a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53ac15c9c0 0x7f53ac152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:26.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.262+0000 7f53b1a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac06eca0 con 0x7f53ac0cf9c0 2024-09-17T01:49:26.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.262+0000 7f53b1a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac06eb20 con 0x7f53ac15c9c0 2024-09-17T01:49:26.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.262+0000 7f53b1a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f53ac06ee20 con 0x7f53ac152770 2024-09-17T01:49:26.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.262+0000 7f53abe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53ac0cf9c0 0x7f53ac157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:26.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.262+0000 7f53abe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53ac0cf9c0 0x7f53ac157360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40388/0 (socket says 172.21.15.42:40388) 2024-09-17T01:49:26.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.262+0000 7f53abe00640 1 -- 172.21.15.42:0/2255149069 learned_addr learned my addr 172.21.15.42:0/2255149069 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:26.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.263+0000 7f53a3400640 1 --2- 172.21.15.42:0/2255149069 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53ac152770 0x7f53ac14c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:26.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.263+0000 7f53b1000640 1 --2- 172.21.15.42:0/2255149069 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53ac15c9c0 0x7f53ac152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:26.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.263+0000 7f53abe00640 1 -- 172.21.15.42:0/2255149069 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53ac152770 msgr2=0x7f53ac14c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:26.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.263+0000 7f53abe00640 1 --2- 172.21.15.42:0/2255149069 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53ac152770 0x7f53ac14c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:26.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.263+0000 7f53abe00640 1 -- 172.21.15.42:0/2255149069 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53ac15c9c0 msgr2=0x7f53ac152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:26.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.263+0000 7f53abe00640 1 --2- 172.21.15.42:0/2255149069 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53ac15c9c0 0x7f53ac152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:26.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.263+0000 7f53abe00640 1 -- 172.21.15.42:0/2255149069 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ac1565a0 con 0x7f53ac0cf9c0 2024-09-17T01:49:26.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.263+0000 7f53abe00640 1 --2- 172.21.15.42:0/2255149069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53ac0cf9c0 0x7f53ac157360 secure :-1 s=READY pgs=2559 cs=0 l=1 rev1=1 crypto rx=0x7f539c02aa80 tx=0x7f539c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:26.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.264+0000 7f53a8c00640 1 -- 172.21.15.42:0/2255149069 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539c005c90 con 0x7f53ac0cf9c0 2024-09-17T01:49:26.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.264+0000 7f53a8c00640 1 -- 172.21.15.42:0/2255149069 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f539c005020 con 0x7f53ac0cf9c0 2024-09-17T01:49:26.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.264+0000 7f53b1a00640 1 -- 172.21.15.42:0/2255149069 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53ac156880 con 0x7f53ac0cf9c0 2024-09-17T01:49:26.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.264+0000 7f53a8c00640 1 -- 172.21.15.42:0/2255149069 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539c005450 con 0x7f53ac0cf9c0 2024-09-17T01:49:26.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.264+0000 7f53b1a00640 1 -- 172.21.15.42:0/2255149069 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53ac153930 con 0x7f53ac0cf9c0 2024-09-17T01:49:26.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.265+0000 7f53b1a00640 1 -- 172.21.15.42:0/2255149069 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53ac153b90 con 0x7f53ac0cf9c0 2024-09-17T01:49:26.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.266+0000 7f53a8c00640 1 -- 172.21.15.42:0/2255149069 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f539c0317c0 con 0x7f53ac0cf9c0 2024-09-17T01:49:26.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.267+0000 7f53a8c00640 1 --2- 172.21.15.42:0/2255149069 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5388078b90 0x7f538807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:26.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.267+0000 7f53a8c00640 1 -- 172.21.15.42:0/2255149069 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 5709+0+0 (secure 0 0 0) 0x7f539c0bbd10 con 0x7f53ac0cf9c0 2024-09-17T01:49:26.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.268+0000 7f53a3400640 1 --2- 172.21.15.42:0/2255149069 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5388078b90 0x7f538807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:26.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.268+0000 7f53a3400640 1 --2- 172.21.15.42:0/2255149069 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5388078b90 0x7f538807b0a0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f53ac0b2620 tx=0x7f5394005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:26.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.271+0000 7f53a8c00640 1 -- 172.21.15.42:0/2255149069 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f539c0c1020 con 0x7f53ac0cf9c0 2024-09-17T01:49:26.476 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.478+0000 7f53b1a00640 1 -- 172.21.15.42:0/2255149069 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f53ac0cf480 con 0x7f53ac0cf9c0 2024-09-17T01:49:26.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.479+0000 7f53a8c00640 1 -- 172.21.15.42:0/2255149069 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v226) ==== 80+0+0 (secure 0 0 0) 0x7f539c03f030 con 0x7f53ac0cf9c0 2024-09-17T01:49:26.477 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2024-09-17T01:49:26.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.481+0000 7f53b1a00640 1 -- 172.21.15.42:0/2255149069 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5388078b90 msgr2=0x7f538807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:26.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.481+0000 7f53b1a00640 1 --2- 172.21.15.42:0/2255149069 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5388078b90 0x7f538807b0a0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f53ac0b2620 tx=0x7f5394005f90 comp rx=0 tx=0).stop 2024-09-17T01:49:26.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.481+0000 7f53b1a00640 1 -- 172.21.15.42:0/2255149069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53ac0cf9c0 msgr2=0x7f53ac157360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:26.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.481+0000 7f53b1a00640 1 --2- 172.21.15.42:0/2255149069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53ac0cf9c0 0x7f53ac157360 secure :-1 s=READY pgs=2559 cs=0 l=1 rev1=1 crypto rx=0x7f539c02aa80 tx=0x7f539c003c10 comp rx=0 tx=0).stop 2024-09-17T01:49:26.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.481+0000 7f53b1a00640 1 -- 172.21.15.42:0/2255149069 shutdown_connections 2024-09-17T01:49:26.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.481+0000 7f53b1a00640 1 --2- 172.21.15.42:0/2255149069 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5388078b90 0x7f538807b0a0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:26.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.481+0000 7f53b1a00640 1 --2- 172.21.15.42:0/2255149069 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53ac15c9c0 0x7f53ac152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:26.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.481+0000 7f53b1a00640 1 --2- 172.21.15.42:0/2255149069 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f53ac152770 0x7f53ac14c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:26.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.481+0000 7f53b1a00640 1 --2- 172.21.15.42:0/2255149069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53ac0cf9c0 0x7f53ac157360 unknown :-1 s=CLOSED pgs=2559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:26.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.481+0000 7f53b1a00640 1 -- 172.21.15.42:0/2255149069 >> 172.21.15.42:0/2255149069 conn(0x7f53ac06d3f0 msgr2=0x7f53ac0b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:26.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.481+0000 7f53b1a00640 1 -- 172.21.15.42:0/2255149069 shutdown_connections 2024-09-17T01:49:26.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.481+0000 7f53b1a00640 1 -- 172.21.15.42:0/2255149069 wait complete. 2024-09-17T01:49:26.505 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T01:49:26.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:26.505 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T01:49:26.608 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:49:26.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:26.608 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T01:49:26.651 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:49:26.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.922+0000 7fd329200640 1 -- 172.21.15.42:0/2874762518 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3240b51d0 msgr2=0x7fd3240b55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:26.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.922+0000 7fd329200640 1 --2- 172.21.15.42:0/2874762518 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3240b51d0 0x7fd3240b55e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd30c005fd0 tx=0x7fd30c02a540 comp rx=0 tx=0).stop 2024-09-17T01:49:26.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.922+0000 7fd329200640 1 -- 172.21.15.42:0/2874762518 shutdown_connections 2024-09-17T01:49:26.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.922+0000 7fd329200640 1 --2- 172.21.15.42:0/2874762518 >> v2:172.21.15.43:3300/0 conn(0x7fd3241605c0 0x7fd3241609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:26.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.922+0000 7fd329200640 1 --2- 172.21.15.42:0/2874762518 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3240b51d0 0x7fd3240b55e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:26.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.922+0000 7fd329200640 1 -- 172.21.15.42:0/2874762518 >> 172.21.15.42:0/2874762518 conn(0x7fd32406d3f0 msgr2=0x7fd3240b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:26.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.922+0000 7fd329200640 1 -- 172.21.15.42:0/2874762518 shutdown_connections 2024-09-17T01:49:26.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.922+0000 7fd329200640 1 -- 172.21.15.42:0/2874762518 wait complete. 2024-09-17T01:49:26.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.924+0000 7fd329200640 1 Processor -- start 2024-09-17T01:49:26.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.924+0000 7fd329200640 1 -- start start 2024-09-17T01:49:26.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.926+0000 7fd329200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3240afb00 0x7fd3241f0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:26.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.926+0000 7fd329200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3240b51d0 0x7fd3240aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:26.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.926+0000 7fd329200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3241605c0 0x7fd3240af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:26.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.926+0000 7fd329200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd3240ce4f0 con 0x7fd3241605c0 2024-09-17T01:49:26.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.926+0000 7fd329200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd3240ce370 con 0x7fd3240afb00 2024-09-17T01:49:26.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.926+0000 7fd329200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd3240ce670 con 0x7fd3240b51d0 2024-09-17T01:49:26.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.926+0000 7fd31aa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3240b51d0 0x7fd3240aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:26.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.926+0000 7fd323400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3240afb00 0x7fd3241f0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:26.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.926+0000 7fd31aa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3240b51d0 0x7fd3240aeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:57658/0 (socket says 172.21.15.42:57658) 2024-09-17T01:49:26.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.926+0000 7fd31aa00640 1 -- 172.21.15.42:0/2344068137 learned_addr learned my addr 172.21.15.42:0/2344068137 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:26.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.926+0000 7fd323e00640 1 --2- 172.21.15.42:0/2344068137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3241605c0 0x7fd3240af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:26.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.926+0000 7fd31aa00640 1 -- 172.21.15.42:0/2344068137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3240afb00 msgr2=0x7fd3241f0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:26.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.926+0000 7fd31aa00640 1 --2- 172.21.15.42:0/2344068137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3240afb00 0x7fd3241f0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:26.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.926+0000 7fd31aa00640 1 -- 172.21.15.42:0/2344068137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3241605c0 msgr2=0x7fd3240af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:26.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.926+0000 7fd31aa00640 1 --2- 172.21.15.42:0/2344068137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3241605c0 0x7fd3240af060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:26.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.926+0000 7fd31aa00640 1 -- 172.21.15.42:0/2344068137 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd324137b40 con 0x7fd3240b51d0 2024-09-17T01:49:26.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.927+0000 7fd31aa00640 1 --2- 172.21.15.42:0/2344068137 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3240b51d0 0x7fd3240aeb20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd30c034040 tx=0x7fd30c003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:26.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.927+0000 7fd31be00640 1 -- 172.21.15.42:0/2344068137 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c03e030 con 0x7fd3240b51d0 2024-09-17T01:49:26.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.927+0000 7fd31be00640 1 -- 172.21.15.42:0/2344068137 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd30c003d10 con 0x7fd3240b51d0 2024-09-17T01:49:26.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.927+0000 7fd329200640 1 -- 172.21.15.42:0/2344068137 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd324137e20 con 0x7fd3240b51d0 2024-09-17T01:49:26.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.927+0000 7fd31be00640 1 -- 172.21.15.42:0/2344068137 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c035040 con 0x7fd3240b51d0 2024-09-17T01:49:26.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.927+0000 7fd329200640 1 -- 172.21.15.42:0/2344068137 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3241383e0 con 0x7fd3240b51d0 2024-09-17T01:49:26.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.928+0000 7fd329200640 1 -- 172.21.15.42:0/2344068137 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3240b55e0 con 0x7fd3240b51d0 2024-09-17T01:49:26.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.930+0000 7fd31be00640 1 -- 172.21.15.42:0/2344068137 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd30c041030 con 0x7fd3240b51d0 2024-09-17T01:49:26.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.930+0000 7fd31be00640 1 --2- 172.21.15.42:0/2344068137 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd300078bc0 0x7fd30007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:26.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.931+0000 7fd31be00640 1 -- 172.21.15.42:0/2344068137 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(226..226 src has 1..226) ==== 5709+0+0 (secure 0 0 0) 0x7fd30c0bb760 con 0x7fd3240b51d0 2024-09-17T01:49:26.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.931+0000 7fd323400640 1 --2- 172.21.15.42:0/2344068137 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd300078bc0 0x7fd30007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:26.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.932+0000 7fd323400640 1 --2- 172.21.15.42:0/2344068137 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd300078bc0 0x7fd30007b0d0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fd314001720 tx=0x7fd314009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:26.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:26.935+0000 7fd31be00640 1 -- 172.21.15.42:0/2344068137 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd30c0834b0 con 0x7fd3240b51d0 2024-09-17T01:49:27.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.167+0000 7fd329200640 1 -- 172.21.15.42:0/2344068137 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd324160c00 con 0x7fd3240b51d0 2024-09-17T01:49:27.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.168+0000 7fd31be00640 1 -- 172.21.15.42:0/2344068137 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 177 v177) ==== 95+0+5241 (secure 0 0 0) 0x7fd30c087ee0 con 0x7fd3240b51d0 2024-09-17T01:49:27.165 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:27.166 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":177,"btime":"2024-09-17T01:49:19:694779+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":11511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1418140325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1418140325},{"type":"v1","addr":"172.21.15.42:6833","nonce":1418140325}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":171},{"gid":11514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2781042225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":2781042225},{"type":"v1","addr":"172.21.15.42:6835","nonce":2781042225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":172},{"gid":11517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4082001755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4082001755},{"type":"v1","addr":"172.21.15.43:6836","nonce":4082001755}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":172}],"filesystems":[{"mdsmap":{"epoch":177,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:49:16.188388+0000","modified":"2024-09-17T01:49:19.207517+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11520":{"gid":11520,"name":"b","rank":0,"incarnation":173,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/4233677817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":4233677817},{"type":"v1","addr":"172.21.15.43:6837","nonce":4233677817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11520,"qdb_cluster":[11520]},"id":16}]} 2024-09-17T01:49:27.166 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 177 2024-09-17T01:49:27.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.170+0000 7fd329200640 1 -- 172.21.15.42:0/2344068137 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd300078bc0 msgr2=0x7fd30007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:27.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.170+0000 7fd329200640 1 --2- 172.21.15.42:0/2344068137 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd300078bc0 0x7fd30007b0d0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fd314001720 tx=0x7fd314009040 comp rx=0 tx=0).stop 2024-09-17T01:49:27.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.170+0000 7fd329200640 1 -- 172.21.15.42:0/2344068137 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3240b51d0 msgr2=0x7fd3240aeb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:27.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.170+0000 7fd329200640 1 --2- 172.21.15.42:0/2344068137 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3240b51d0 0x7fd3240aeb20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd30c034040 tx=0x7fd30c003820 comp rx=0 tx=0).stop 2024-09-17T01:49:27.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.170+0000 7fd329200640 1 -- 172.21.15.42:0/2344068137 shutdown_connections 2024-09-17T01:49:27.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.170+0000 7fd329200640 1 --2- 172.21.15.42:0/2344068137 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd300078bc0 0x7fd30007b0d0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:27.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.170+0000 7fd329200640 1 --2- 172.21.15.42:0/2344068137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd3241605c0 0x7fd3240af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:27.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.170+0000 7fd329200640 1 --2- 172.21.15.42:0/2344068137 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd3240b51d0 0x7fd3240aeb20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:27.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.170+0000 7fd329200640 1 --2- 172.21.15.42:0/2344068137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd3240afb00 0x7fd3241f0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:27.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.170+0000 7fd329200640 1 -- 172.21.15.42:0/2344068137 >> 172.21.15.42:0/2344068137 conn(0x7fd32406d3f0 msgr2=0x7fd3240b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:27.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.170+0000 7fd329200640 1 -- 172.21.15.42:0/2344068137 shutdown_connections 2024-09-17T01:49:27.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.170+0000 7fd329200640 1 -- 172.21.15.42:0/2344068137 wait complete. 2024-09-17T01:49:27.191 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-09-17T01:49:27.455 INFO:teuthology.orchestra.run.smithi043.stdout:{"message":"","return_code":0} 2024-09-17T01:49:27.456 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-17T01:49:27.456 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T01:49:27.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.688+0000 7f5c00c00640 1 -- 172.21.15.42:0/2444578516 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5bfc0cdd30 msgr2=0x7f5bfc06e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:27.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.688+0000 7f5c00c00640 1 --2- 172.21.15.42:0/2444578516 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5bfc0cdd30 0x7f5bfc06e9c0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4005fd0 tx=0x7f5bf402a840 comp rx=0 tx=0).stop 2024-09-17T01:49:27.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.688+0000 7f5c00c00640 1 -- 172.21.15.42:0/2444578516 shutdown_connections 2024-09-17T01:49:27.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.688+0000 7f5c00c00640 1 --2- 172.21.15.42:0/2444578516 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5bfc0cdd30 0x7f5bfc06e9c0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:27.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.688+0000 7f5c00c00640 1 -- 172.21.15.42:0/2444578516 >> 172.21.15.42:0/2444578516 conn(0x7f5bfc06d1b0 msgr2=0x7f5bfc06d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:27.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.688+0000 7f5c00c00640 1 -- 172.21.15.42:0/2444578516 shutdown_connections 2024-09-17T01:49:27.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.688+0000 7f5c00c00640 1 -- 172.21.15.42:0/2444578516 wait complete. 2024-09-17T01:49:27.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.690+0000 7f5c00c00640 1 Processor -- start 2024-09-17T01:49:27.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.690+0000 7f5c00c00640 1 -- start start 2024-09-17T01:49:27.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.692+0000 7f5c00c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5bfc072b60 0x7f5bfc0b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:27.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.692+0000 7f5c00c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5bfc15dcf0 0x7f5bfc0b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:27.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.692+0000 7f5c00c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bfc0b0e30 0x7f5bfc0ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:27.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.692+0000 7f5c00c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5bfc06f080 con 0x7f5bfc0b0e30 2024-09-17T01:49:27.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.692+0000 7f5c00c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5bfc06ef00 con 0x7f5bfc15dcf0 2024-09-17T01:49:27.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.692+0000 7f5c00c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5bfc06f200 con 0x7f5bfc072b60 2024-09-17T01:49:27.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.692+0000 7f5bfa800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bfc0b0e30 0x7f5bfc0ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:27.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.692+0000 7f5bfa800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bfc0b0e30 0x7f5bfc0ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40410/0 (socket says 172.21.15.42:40410) 2024-09-17T01:49:27.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.692+0000 7f5bfa800640 1 -- 172.21.15.42:0/1936123264 learned_addr learned my addr 172.21.15.42:0/1936123264 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:27.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.692+0000 7f5bf9e00640 1 --2- 172.21.15.42:0/1936123264 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5bfc072b60 0x7f5bfc0b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:27.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.692+0000 7f5bf3e00640 1 --2- 172.21.15.42:0/1936123264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5bfc15dcf0 0x7f5bfc0b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:27.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.693+0000 7f5bfa800640 1 -- 172.21.15.42:0/1936123264 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5bfc072b60 msgr2=0x7f5bfc0b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:27.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.693+0000 7f5bfa800640 1 --2- 172.21.15.42:0/1936123264 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5bfc072b60 0x7f5bfc0b5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:27.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.693+0000 7f5bfa800640 1 -- 172.21.15.42:0/1936123264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5bfc15dcf0 msgr2=0x7f5bfc0b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:27.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.693+0000 7f5bfa800640 1 --2- 172.21.15.42:0/1936123264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5bfc15dcf0 0x7f5bfc0b2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:27.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.693+0000 7f5bfa800640 1 -- 172.21.15.42:0/1936123264 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bfc1f5ca0 con 0x7f5bfc0b0e30 2024-09-17T01:49:27.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.693+0000 7f5bfa800640 1 --2- 172.21.15.42:0/1936123264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bfc0b0e30 0x7f5bfc0ae890 secure :-1 s=READY pgs=2561 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4005fd0 tx=0x7f5bf4032cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:27.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.693+0000 7f5bf2000640 1 -- 172.21.15.42:0/1936123264 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4040070 con 0x7f5bfc0b0e30 2024-09-17T01:49:27.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.693+0000 7f5bf2000640 1 -- 172.21.15.42:0/1936123264 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5bf4004540 con 0x7f5bfc0b0e30 2024-09-17T01:49:27.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.693+0000 7f5bf2000640 1 -- 172.21.15.42:0/1936123264 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4003e60 con 0x7f5bfc0b0e30 2024-09-17T01:49:27.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.693+0000 7f5c00c00640 1 -- 172.21.15.42:0/1936123264 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bfc0b57a0 con 0x7f5bfc0b0e30 2024-09-17T01:49:27.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.694+0000 7f5c00c00640 1 -- 172.21.15.42:0/1936123264 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bfc1f9a40 con 0x7f5bfc0b0e30 2024-09-17T01:49:27.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.695+0000 7f5c00c00640 1 -- 172.21.15.42:0/1936123264 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bfc1f94d0 con 0x7f5bfc0b0e30 2024-09-17T01:49:27.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.696+0000 7f5bf2000640 1 -- 172.21.15.42:0/1936123264 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5bf4043070 con 0x7f5bfc0b0e30 2024-09-17T01:49:27.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.697+0000 7f5bf2000640 1 --2- 172.21.15.42:0/1936123264 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5bd8078b90 0x7f5bd807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:27.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.697+0000 7f5bf2000640 1 -- 172.21.15.42:0/1936123264 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(226..226 src has 1..226) ==== 5709+0+0 (secure 0 0 0) 0x7f5bf40bbec0 con 0x7f5bfc0b0e30 2024-09-17T01:49:27.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.698+0000 7f5bf9e00640 1 --2- 172.21.15.42:0/1936123264 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5bd8078b90 0x7f5bd807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:27.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.698+0000 7f5bf9e00640 1 --2- 172.21.15.42:0/1936123264 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5bd8078b90 0x7f5bd807b0a0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0046b0 tx=0x7f5bec001720 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:27.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.702+0000 7f5bf2000640 1 -- 172.21.15.42:0/1936123264 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5bf4083c10 con 0x7f5bfc0b0e30 2024-09-17T01:49:27.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.938+0000 7f5c00c00640 1 -- 172.21.15.42:0/1936123264 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5bfc06e9c0 con 0x7f5bfc0b0e30 2024-09-17T01:49:27.937 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-17T01:49:27.939+0000 7f9961e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:49:27.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.941+0000 7f5bf2000640 1 -- 172.21.15.42:0/1936123264 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v178) ==== 161+0+0 (secure 0 0 0) 0x7f5bf4088640 con 0x7f5bfc0b0e30 2024-09-17T01:49:27.939 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T01:49:27.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.943+0000 7f5c00c00640 1 -- 172.21.15.42:0/1936123264 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5bd8078b90 msgr2=0x7f5bd807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:27.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.943+0000 7f5c00c00640 1 --2- 172.21.15.42:0/1936123264 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5bd8078b90 0x7f5bd807b0a0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0046b0 tx=0x7f5bec001720 comp rx=0 tx=0).stop 2024-09-17T01:49:27.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.943+0000 7f5c00c00640 1 -- 172.21.15.42:0/1936123264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bfc0b0e30 msgr2=0x7f5bfc0ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:27.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.943+0000 7f5c00c00640 1 --2- 172.21.15.42:0/1936123264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bfc0b0e30 0x7f5bfc0ae890 secure :-1 s=READY pgs=2561 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4005fd0 tx=0x7f5bf4032cf0 comp rx=0 tx=0).stop 2024-09-17T01:49:27.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.944+0000 7f5c00c00640 1 -- 172.21.15.42:0/1936123264 shutdown_connections 2024-09-17T01:49:27.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.944+0000 7f5c00c00640 1 --2- 172.21.15.42:0/1936123264 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5bd8078b90 0x7f5bd807b0a0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:27.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.944+0000 7f5c00c00640 1 --2- 172.21.15.42:0/1936123264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5bfc15dcf0 0x7f5bfc0b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:27.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.944+0000 7f5c00c00640 1 --2- 172.21.15.42:0/1936123264 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5bfc0b0e30 0x7f5bfc0ae890 unknown :-1 s=CLOSED pgs=2561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:27.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.944+0000 7f5c00c00640 1 --2- 172.21.15.42:0/1936123264 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5bfc072b60 0x7f5bfc0b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:27.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.944+0000 7f5c00c00640 1 -- 172.21.15.42:0/1936123264 >> 172.21.15.42:0/1936123264 conn(0x7f5bfc06d1b0 msgr2=0x7f5bfc150080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:27.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.944+0000 7f5c00c00640 1 -- 172.21.15.42:0/1936123264 shutdown_connections 2024-09-17T01:49:27.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:27.944+0000 7f5c00c00640 1 -- 172.21.15.42:0/1936123264 wait complete. 2024-09-17T01:49:27.953 INFO:tasks.ceph.mds.b.smithi043.stderr: -6355> 2024-09-17T01:49:18.649+0000 7f52a1800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:49:27.965 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapval 10000000000.00000000 parentfile_head - 2024-09-17T01:49:28.080 INFO:tasks.ceph.mds.b.smithi043.stdout:starting mds.b at 2024-09-17T01:49:28.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.113+0000 7fb158864f40 1 Processor -- start 2024-09-17T01:49:28.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.114+0000 7fb158864f40 1 -- start start 2024-09-17T01:49:28.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.115+0000 7fb158864f40 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b804370640 0x55b804446160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:28.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.115+0000 7fb158864f40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b80439f9b0 0x55b80442e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:28.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.115+0000 7fb158864f40 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b804447380 0x55b8043b6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:28.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.115+0000 7fb158864f40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b8042bec60 con 0x55b80439f9b0 2024-09-17T01:49:28.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.115+0000 7fb158864f40 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b80431d1d0 con 0x55b804447380 2024-09-17T01:49:28.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.115+0000 7fb158864f40 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55b80436f6f0 con 0x55b804370640 2024-09-17T01:49:28.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.115+0000 7fb151000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b80439f9b0 0x55b80442e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:28.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.115+0000 7fb151000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b80439f9b0 0x55b80442e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40426/0 (socket says 172.21.15.42:40426) 2024-09-17T01:49:28.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.115+0000 7fb151000640 1 -- 172.21.15.42:0/821277935 learned_addr learned my addr 172.21.15.42:0/821277935 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:28.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.115+0000 7fb151a00640 1 --2- 172.21.15.42:0/821277935 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b804370640 0x55b804446160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:28.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.115+0000 7fb152400640 1 --2- 172.21.15.42:0/821277935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b804447380 0x55b8043b6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:28.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.116+0000 7fb151000640 1 -- 172.21.15.42:0/821277935 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b804370640 msgr2=0x55b804446160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:28.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.116+0000 7fb151000640 1 --2- 172.21.15.42:0/821277935 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b804370640 0x55b804446160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.116+0000 7fb151000640 1 -- 172.21.15.42:0/821277935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b804447380 msgr2=0x55b8043b6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:28.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.116+0000 7fb151000640 1 --2- 172.21.15.42:0/821277935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b804447380 0x55b8043b6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.116+0000 7fb151000640 1 -- 172.21.15.42:0/821277935 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b804372770 con 0x55b80439f9b0 2024-09-17T01:49:28.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.116+0000 7fb152400640 1 --2- 172.21.15.42:0/821277935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b804447380 0x55b8043b6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:49:28.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.116+0000 7fb151000640 1 --2- 172.21.15.42:0/821277935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b80439f9b0 0x55b80442e150 secure :-1 s=READY pgs=2564 cs=0 l=1 rev1=1 crypto rx=0x7fb140025f40 tx=0x7fb140002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=befe24f3c2625ba2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:28.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.116+0000 7fb14b400640 1 -- 172.21.15.42:0/821277935 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14004d9a0 con 0x55b80439f9b0 2024-09-17T01:49:28.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.116+0000 7fb14b400640 1 -- 172.21.15.42:0/821277935 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb140056670 con 0x55b80439f9b0 2024-09-17T01:49:28.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.116+0000 7fb14b400640 1 -- 172.21.15.42:0/821277935 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb140056ac0 con 0x55b80439f9b0 2024-09-17T01:49:28.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.117+0000 7fb158864f40 1 -- 172.21.15.42:0/821277935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b80439f9b0 msgr2=0x55b80442e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:28.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.117+0000 7fb158864f40 1 --2- 172.21.15.42:0/821277935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b80439f9b0 0x55b80442e150 secure :-1 s=READY pgs=2564 cs=0 l=1 rev1=1 crypto rx=0x7fb140025f40 tx=0x7fb140002fb0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.117+0000 7fb158864f40 1 -- 172.21.15.42:0/821277935 shutdown_connections 2024-09-17T01:49:28.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.117+0000 7fb158864f40 1 --2- 172.21.15.42:0/821277935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b804447380 0x55b8043b6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.117+0000 7fb158864f40 1 --2- 172.21.15.42:0/821277935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b80439f9b0 0x55b80442e150 unknown :-1 s=CLOSED pgs=2564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.117+0000 7fb158864f40 1 --2- 172.21.15.42:0/821277935 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b804370640 0x55b804446160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.117+0000 7fb158864f40 1 -- 172.21.15.42:0/821277935 >> 172.21.15.42:0/821277935 conn(0x55b80428fac0 msgr2=0x55b80442ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:28.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.117+0000 7fb158864f40 1 -- 172.21.15.42:0/821277935 shutdown_connections 2024-09-17T01:49:28.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.117+0000 7fb158864f40 1 -- 172.21.15.42:0/821277935 wait complete. 2024-09-17T01:49:28.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.118+0000 7fb158864f40 1 Processor -- start 2024-09-17T01:49:28.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.118+0000 7fb158864f40 1 -- start start 2024-09-17T01:49:28.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.120+0000 7fb158864f40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b804370640 0x55b8044452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:28.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.120+0000 7fb158864f40 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b80439f9b0 0x55b8043b9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:28.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.120+0000 7fb158864f40 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b804447380 0x55b8043ba400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:28.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.120+0000 7fb158864f40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b804447d60 con 0x55b804370640 2024-09-17T01:49:28.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.120+0000 7fb158864f40 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b8044d0970 con 0x55b804447380 2024-09-17T01:49:28.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.120+0000 7fb158864f40 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55b8043b8280 con 0x55b80439f9b0 2024-09-17T01:49:28.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.120+0000 7fb151a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b804370640 0x55b8044452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:28.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.120+0000 7fb151a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b804370640 0x55b8044452a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40430/0 (socket says 172.21.15.42:40430) 2024-09-17T01:49:28.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.120+0000 7fb151a00640 1 -- 172.21.15.42:0/233800939 learned_addr learned my addr 172.21.15.42:0/233800939 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:28.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.120+0000 7fb151000640 1 --2- 172.21.15.42:0/233800939 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b80439f9b0 0x55b8043b9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:28.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.120+0000 7fb152400640 1 --2- 172.21.15.42:0/233800939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b804447380 0x55b8043ba400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:28.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.120+0000 7fb151a00640 1 -- 172.21.15.42:0/233800939 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b80439f9b0 msgr2=0x55b8043b9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:28.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.120+0000 7fb151a00640 1 --2- 172.21.15.42:0/233800939 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b80439f9b0 0x55b8043b9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.120+0000 7fb151a00640 1 -- 172.21.15.42:0/233800939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b804447380 msgr2=0x55b8043ba400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:28.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.120+0000 7fb151a00640 1 --2- 172.21.15.42:0/233800939 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b804447380 0x55b8043ba400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.120+0000 7fb151a00640 1 -- 172.21.15.42:0/233800939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8043b9790 con 0x55b804370640 2024-09-17T01:49:28.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.121+0000 7fb151a00640 1 --2- 172.21.15.42:0/233800939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b804370640 0x55b8044452a0 secure :-1 s=READY pgs=2565 cs=0 l=1 rev1=1 crypto rx=0x7fb1440086f0 tx=0x7fb1440087e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:28.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.121+0000 7fb14a000640 1 -- 172.21.15.42:0/233800939 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14400a850 con 0x55b804370640 2024-09-17T01:49:28.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.121+0000 7fb14a000640 1 -- 172.21.15.42:0/233800939 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb14400a9f0 con 0x55b804370640 2024-09-17T01:49:28.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.121+0000 7fb14a000640 1 -- 172.21.15.42:0/233800939 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14400ae00 con 0x55b804370640 2024-09-17T01:49:28.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.121+0000 7fb158864f40 1 -- 172.21.15.42:0/233800939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b8043b6f00 con 0x55b804370640 2024-09-17T01:49:28.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.121+0000 7fb158864f40 1 -- 172.21.15.42:0/233800939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8043b7f10 con 0x55b804370640 2024-09-17T01:49:28.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.123+0000 7fb14a000640 1 -- 172.21.15.42:0/233800939 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb144016430 con 0x55b804370640 2024-09-17T01:49:28.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.124+0000 7fb14a000640 1 --2- 172.21.15.42:0/233800939 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb1340775a0 0x7fb134079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:28.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.124+0000 7fb14a000640 1 -- 172.21.15.42:0/233800939 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7fb14409a240 con 0x55b804370640 2024-09-17T01:49:28.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.124+0000 7fb158864f40 1 --2- 172.21.15.42:0/233800939 >> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] conn(0x55b8044e1740 0x55b8044e1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:28.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.125+0000 7fb158864f40 1 -- 172.21.15.42:0/233800939 --> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] -- osd_op(unknown.0.0:1 32.10 32:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e227) -- 0x55b80442df10 con 0x55b8044e1740 2024-09-17T01:49:28.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.125+0000 7fb151000640 1 --2- 172.21.15.42:0/233800939 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb1340775a0 0x7fb134079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:28.123 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.125+0000 7fb152400640 1 --2- 172.21.15.42:0/233800939 >> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] conn(0x55b8044e1740 0x55b8044e1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:28.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.126+0000 7fb152400640 1 --2- 172.21.15.42:0/233800939 >> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] conn(0x55b8044e1740 0x55b8044e1b50 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:28.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.126+0000 7fb151000640 1 --2- 172.21.15.42:0/233800939 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb1340775a0 0x7fb134079ab0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fb140062000 tx=0x7fb140004940 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:28.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.126+0000 7fb152400640 1 -- 172.21.15.42:0/233800939 <== osd.7 v2:172.21.15.43:6810/859332009 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-vals-by-keys out=596b] v0'0 uv10 ondisk = 0) ==== 164+0+596 (crc 0 0 0) 0x7fb14c0105d0 con 0x55b8044e1740 2024-09-17T01:49:28.124 INFO:teuthology.orchestra.run.smithi042.stderr:Writing to - 2024-09-17T01:49:28.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.126+0000 7fb158864f40 1 -- 172.21.15.42:0/233800939 >> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] conn(0x55b8044e1740 msgr2=0x55b8044e1b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:28.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.126+0000 7fb158864f40 1 --2- 172.21.15.42:0/233800939 >> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] conn(0x55b8044e1740 0x55b8044e1b50 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.126+0000 7fb158864f40 1 -- 172.21.15.42:0/233800939 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb1340775a0 msgr2=0x7fb134079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:28.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.126+0000 7fb158864f40 1 --2- 172.21.15.42:0/233800939 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb1340775a0 0x7fb134079ab0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fb140062000 tx=0x7fb140004940 comp rx=0 tx=0).stop 2024-09-17T01:49:28.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.126+0000 7fb158864f40 1 -- 172.21.15.42:0/233800939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b804370640 msgr2=0x55b8044452a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:28.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.126+0000 7fb158864f40 1 --2- 172.21.15.42:0/233800939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b804370640 0x55b8044452a0 secure :-1 s=READY pgs=2565 cs=0 l=1 rev1=1 crypto rx=0x7fb1440086f0 tx=0x7fb1440087e0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.126+0000 7fb152400640 1 -- 172.21.15.42:0/233800939 reap_dead start 2024-09-17T01:49:28.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.126+0000 7fb158864f40 1 -- 172.21.15.42:0/233800939 shutdown_connections 2024-09-17T01:49:28.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.126+0000 7fb158864f40 1 -- 172.21.15.42:0/233800939 >> 172.21.15.42:0/233800939 conn(0x55b80428fac0 msgr2=0x55b804449130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:28.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.126+0000 7fb158864f40 1 -- 172.21.15.42:0/233800939 shutdown_connections 2024-09-17T01:49:28.126 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.126+0000 7fb158864f40 1 -- 172.21.15.42:0/233800939 wait complete. 2024-09-17T01:49:28.135 INFO:teuthology.orchestra.run.smithi042.stdout:i* �%��f�!2���5@@!`��������%��f�!2%��f�� (8`%��f�!28`%��f�!2��������%��f�� ����`security.selinux%unconfined_u:object_r:unlabeled_t:s0�������� 2024-09-17T01:49:28.135 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 shadow_head 2024-09-17T01:49:28.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.281+0000 7fef48946f40 1 Processor -- start 2024-09-17T01:49:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.281+0000 7fef48946f40 1 -- start start 2024-09-17T01:49:28.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.282+0000 7fef48946f40 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e6f852d830 0x55e6f8502f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:28.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.282+0000 7fef48946f40 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6f85d78b0 0x55e6f85d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:28.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.282+0000 7fef48946f40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e6f85d9ce0 0x55e6f8669130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:28.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.282+0000 7fef48946f40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e6f8450c60 con 0x55e6f85d9ce0 2024-09-17T01:49:28.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.282+0000 7fef48946f40 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e6f84af1d0 con 0x55e6f85d78b0 2024-09-17T01:49:28.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.282+0000 7fef48946f40 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55e6f85d8c10 con 0x55e6f852d830 2024-09-17T01:49:28.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.282+0000 7fef42400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e6f85d9ce0 0x55e6f8669130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:28.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.282+0000 7fef42400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e6f85d9ce0 0x55e6f8669130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40446/0 (socket says 172.21.15.42:40446) 2024-09-17T01:49:28.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.282+0000 7fef42400640 1 -- 172.21.15.42:0/2382305083 learned_addr learned my addr 172.21.15.42:0/2382305083 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:28.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.283+0000 7fef42400640 1 -- 172.21.15.42:0/2382305083 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e6f852d830 msgr2=0x55e6f8502f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:28.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.283+0000 7fef42400640 1 --2- 172.21.15.42:0/2382305083 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e6f852d830 0x55e6f8502f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.283+0000 7fef42400640 1 -- 172.21.15.42:0/2382305083 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6f85d78b0 msgr2=0x55e6f85d00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:28.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.283+0000 7fef41000640 1 --2- 172.21.15.42:0/2382305083 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6f85d78b0 0x55e6f85d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:28.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.283+0000 7fef42400640 1 --2- 172.21.15.42:0/2382305083 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6f85d78b0 0x55e6f85d00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.283+0000 7fef42400640 1 -- 172.21.15.42:0/2382305083 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6f85d2fd0 con 0x55e6f85d9ce0 2024-09-17T01:49:28.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.283+0000 7fef41000640 1 --2- 172.21.15.42:0/2382305083 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6f85d78b0 0x55e6f85d00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:49:28.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.283+0000 7fef42400640 1 --2- 172.21.15.42:0/2382305083 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e6f85d9ce0 0x55e6f8669130 secure :-1 s=READY pgs=2568 cs=0 l=1 rev1=1 crypto rx=0x7fef3c00c710 tx=0x7fef3c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b05855e02ff306 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:28.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.283+0000 7fef3b400640 1 -- 172.21.15.42:0/2382305083 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3c013070 con 0x55e6f85d9ce0 2024-09-17T01:49:28.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.283+0000 7fef3b400640 1 -- 172.21.15.42:0/2382305083 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef3c00a930 con 0x55e6f85d9ce0 2024-09-17T01:49:28.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.283+0000 7fef3b400640 1 -- 172.21.15.42:0/2382305083 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3c00ad80 con 0x55e6f85d9ce0 2024-09-17T01:49:28.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.284+0000 7fef48946f40 1 -- 172.21.15.42:0/2382305083 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e6f85d9ce0 msgr2=0x55e6f8669130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:28.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.284+0000 7fef48946f40 1 --2- 172.21.15.42:0/2382305083 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e6f85d9ce0 0x55e6f8669130 secure :-1 s=READY pgs=2568 cs=0 l=1 rev1=1 crypto rx=0x7fef3c00c710 tx=0x7fef3c00cbd0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.284+0000 7fef48946f40 1 -- 172.21.15.42:0/2382305083 shutdown_connections 2024-09-17T01:49:28.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.284+0000 7fef48946f40 1 --2- 172.21.15.42:0/2382305083 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6f85d78b0 0x55e6f85d00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.284+0000 7fef48946f40 1 --2- 172.21.15.42:0/2382305083 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e6f85d9ce0 0x55e6f8669130 unknown :-1 s=CLOSED pgs=2568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.284+0000 7fef48946f40 1 --2- 172.21.15.42:0/2382305083 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e6f852d830 0x55e6f8502f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.284+0000 7fef48946f40 1 -- 172.21.15.42:0/2382305083 >> 172.21.15.42:0/2382305083 conn(0x55e6f8421ac0 msgr2=0x55e6f854ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:28.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.284+0000 7fef48946f40 1 -- 172.21.15.42:0/2382305083 shutdown_connections 2024-09-17T01:49:28.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.284+0000 7fef48946f40 1 -- 172.21.15.42:0/2382305083 wait complete. 2024-09-17T01:49:28.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.285+0000 7fef48946f40 1 Processor -- start 2024-09-17T01:49:28.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.285+0000 7fef48946f40 1 -- start start 2024-09-17T01:49:28.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.287+0000 7fef48946f40 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6f852d830 0x55e6f85cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:28.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.287+0000 7fef48946f40 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e6f85d78b0 0x55e6f85cd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:28.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.287+0000 7fef48946f40 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e6f85d9ce0 0x55e6f85d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:28.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.287+0000 7fef48946f40 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e6f85034c0 con 0x55e6f85d9ce0 2024-09-17T01:49:28.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.287+0000 7fef48946f40 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e6f85d3a10 con 0x55e6f852d830 2024-09-17T01:49:28.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.287+0000 7fef48946f40 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55e6f85cc3b0 con 0x55e6f85d78b0 2024-09-17T01:49:28.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.287+0000 7fef42400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e6f85d9ce0 0x55e6f85d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:28.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.287+0000 7fef42400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e6f85d9ce0 0x55e6f85d19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40448/0 (socket says 172.21.15.42:40448) 2024-09-17T01:49:28.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.287+0000 7fef42400640 1 -- 172.21.15.42:0/3259543285 learned_addr learned my addr 172.21.15.42:0/3259543285 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:28.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.287+0000 7fef41000640 1 --2- 172.21.15.42:0/3259543285 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e6f85d78b0 0x55e6f85cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:28.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.287+0000 7fef41a00640 1 --2- 172.21.15.42:0/3259543285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6f852d830 0x55e6f85cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:28.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.287+0000 7fef42400640 1 -- 172.21.15.42:0/3259543285 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e6f85d78b0 msgr2=0x55e6f85cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:28.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.287+0000 7fef42400640 1 --2- 172.21.15.42:0/3259543285 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55e6f85d78b0 0x55e6f85cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.287+0000 7fef42400640 1 -- 172.21.15.42:0/3259543285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6f852d830 msgr2=0x55e6f85cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:28.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.287+0000 7fef42400640 1 --2- 172.21.15.42:0/3259543285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6f852d830 0x55e6f85cd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.287+0000 7fef42400640 1 -- 172.21.15.42:0/3259543285 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6f8549460 con 0x55e6f85d9ce0 2024-09-17T01:49:28.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.287+0000 7fef41a00640 1 --2- 172.21.15.42:0/3259543285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e6f852d830 0x55e6f85cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:49:28.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.288+0000 7fef42400640 1 --2- 172.21.15.42:0/3259543285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e6f85d9ce0 0x55e6f85d19f0 secure :-1 s=READY pgs=2569 cs=0 l=1 rev1=1 crypto rx=0x7fef3c00a630 tx=0x7fef3c0116b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:28.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.288+0000 7fef3a000640 1 -- 172.21.15.42:0/3259543285 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3c026070 con 0x55e6f85d9ce0 2024-09-17T01:49:28.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.288+0000 7fef3a000640 1 -- 172.21.15.42:0/3259543285 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef3c0118d0 con 0x55e6f85d9ce0 2024-09-17T01:49:28.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.288+0000 7fef3a000640 1 -- 172.21.15.42:0/3259543285 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3c013040 con 0x55e6f85d9ce0 2024-09-17T01:49:28.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.288+0000 7fef48946f40 1 -- 172.21.15.42:0/3259543285 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e6f8530f30 con 0x55e6f85d9ce0 2024-09-17T01:49:28.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.288+0000 7fef48946f40 1 -- 172.21.15.42:0/3259543285 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6f8531710 con 0x55e6f85d9ce0 2024-09-17T01:49:28.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.290+0000 7fef3a000640 1 -- 172.21.15.42:0/3259543285 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fef3c029070 con 0x55e6f85d9ce0 2024-09-17T01:49:28.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.291+0000 7fef3a000640 1 --2- 172.21.15.42:0/3259543285 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fef240775a0 0x7fef24079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:28.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.291+0000 7fef3a000640 1 -- 172.21.15.42:0/3259543285 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7fef3c09b770 con 0x55e6f85d9ce0 2024-09-17T01:49:28.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.292+0000 7fef48946f40 1 --2- 172.21.15.42:0/3259543285 >> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] conn(0x55e6f85caf80 0x55e6f85cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:28.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.292+0000 7fef48946f40 1 -- 172.21.15.42:0/3259543285 --> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] -- osd_op(unknown.0.0:1 32.10 32:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=592b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e227) -- 0x55e6f85c7440 con 0x55e6f85caf80 2024-09-17T01:49:28.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.292+0000 7fef41a00640 1 --2- 172.21.15.42:0/3259543285 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fef240775a0 0x7fef24079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:28.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.292+0000 7fef41000640 1 --2- 172.21.15.42:0/3259543285 >> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] conn(0x55e6f85caf80 0x55e6f85cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:28.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.293+0000 7fef41a00640 1 --2- 172.21.15.42:0/3259543285 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fef240775a0 0x7fef24079ab0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fef34000f60 tx=0x7fef340013e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:28.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.293+0000 7fef41000640 1 --2- 172.21.15.42:0/3259543285 >> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] conn(0x55e6f85caf80 0x55e6f85cb390 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:28.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.294+0000 7fef41000640 1 -- 172.21.15.42:0/3259543285 <== osd.7 v2:172.21.15.43:6810/859332009 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v227'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fef3004db70 con 0x55e6f85caf80 2024-09-17T01:49:28.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.294+0000 7fef48946f40 1 -- 172.21.15.42:0/3259543285 >> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] conn(0x55e6f85caf80 msgr2=0x55e6f85cb390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:28.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.294+0000 7fef48946f40 1 --2- 172.21.15.42:0/3259543285 >> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] conn(0x55e6f85caf80 0x55e6f85cb390 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.294+0000 7fef48946f40 1 -- 172.21.15.42:0/3259543285 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fef240775a0 msgr2=0x7fef24079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:28.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.295+0000 7fef48946f40 1 --2- 172.21.15.42:0/3259543285 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fef240775a0 0x7fef24079ab0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fef34000f60 tx=0x7fef340013e0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.295+0000 7fef48946f40 1 -- 172.21.15.42:0/3259543285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e6f85d9ce0 msgr2=0x55e6f85d19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:28.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.295+0000 7fef48946f40 1 --2- 172.21.15.42:0/3259543285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e6f85d9ce0 0x55e6f85d19f0 secure :-1 s=READY pgs=2569 cs=0 l=1 rev1=1 crypto rx=0x7fef3c00a630 tx=0x7fef3c0116b0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.295+0000 7fef42400640 1 -- 172.21.15.42:0/3259543285 reap_dead start 2024-09-17T01:49:28.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.295+0000 7fef48946f40 1 -- 172.21.15.42:0/3259543285 shutdown_connections 2024-09-17T01:49:28.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.295+0000 7fef48946f40 1 -- 172.21.15.42:0/3259543285 >> 172.21.15.42:0/3259543285 conn(0x55e6f8421ac0 msgr2=0x55e6f854ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:28.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.295+0000 7fef48946f40 1 -- 172.21.15.42:0/3259543285 shutdown_connections 2024-09-17T01:49:28.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.295+0000 7fef48946f40 1 -- 172.21.15.42:0/3259543285 wait complete. 2024-09-17T01:49:28.308 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_hack_allow_loading_invalid_metadata True 2024-09-17T01:49:28.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.540+0000 7f0c00c00640 1 -- 172.21.15.42:0/2503484407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0be0004800 msgr2=0x7f0be0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:28.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.540+0000 7f0c00c00640 1 --2- 172.21.15.42:0/2503484407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0be0004800 0x7f0be0004c10 secure :-1 s=READY pgs=2571 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc154290 tx=0x7f0be0005830 comp rx=0 tx=0).stop 2024-09-17T01:49:28.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.540+0000 7f0bfa800640 1 -- 172.21.15.42:0/2503484407 reap_dead start 2024-09-17T01:49:28.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.541+0000 7f0c00c00640 1 -- 172.21.15.42:0/2503484407 shutdown_connections 2024-09-17T01:49:28.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.541+0000 7f0c00c00640 1 -- 172.21.15.42:0/2503484407 >> 172.21.15.42:0/2503484407 conn(0x7f0bfc06d1b0 msgr2=0x7f0bfc06d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:28.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.541+0000 7f0c00c00640 1 -- 172.21.15.42:0/2503484407 shutdown_connections 2024-09-17T01:49:28.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.541+0000 7f0c00c00640 1 -- 172.21.15.42:0/2503484407 wait complete. 2024-09-17T01:49:28.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.543+0000 7f0c00c00640 1 Processor -- start 2024-09-17T01:49:28.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.543+0000 7f0c00c00640 1 -- start start 2024-09-17T01:49:28.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.544+0000 7f0c00c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be0004800 0x7f0bfc1f5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:28.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.544+0000 7f0c00c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0bfc153e10 0x7f0bfc15bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:28.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.545+0000 7f0c00c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bfc15c150 0x7f0bfc0b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:28.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.545+0000 7f0c00c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0bfc160f30 con 0x7f0bfc15c150 2024-09-17T01:49:28.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.545+0000 7f0c00c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0bfc160db0 con 0x7f0be0004800 2024-09-17T01:49:28.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.545+0000 7f0c00c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0bfc06e9c0 con 0x7f0bfc153e10 2024-09-17T01:49:28.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.545+0000 7f0bfa800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bfc15c150 0x7f0bfc0b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:28.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.545+0000 7f0bf9400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0bfc153e10 0x7f0bfc15bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:28.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.545+0000 7f0bf9e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be0004800 0x7f0bfc1f5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:28.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.545+0000 7f0bf9400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0bfc153e10 0x7f0bfc15bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:57744/0 (socket says 172.21.15.42:57744) 2024-09-17T01:49:28.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.545+0000 7f0bf9400640 1 -- 172.21.15.42:0/1395473866 learned_addr learned my addr 172.21.15.42:0/1395473866 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:28.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.545+0000 7f0bfa800640 1 -- 172.21.15.42:0/1395473866 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0bfc153e10 msgr2=0x7f0bfc15bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:28.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.545+0000 7f0bfa800640 1 --2- 172.21.15.42:0/1395473866 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0bfc153e10 0x7f0bfc15bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.545+0000 7f0bfa800640 1 -- 172.21.15.42:0/1395473866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be0004800 msgr2=0x7f0bfc1f5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:28.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.545+0000 7f0bfa800640 1 --2- 172.21.15.42:0/1395473866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be0004800 0x7f0bfc1f5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.545+0000 7f0bfa800640 1 -- 172.21.15.42:0/1395473866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bfc15c560 con 0x7f0bfc15c150 2024-09-17T01:49:28.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.546+0000 7f0bfa800640 1 --2- 172.21.15.42:0/1395473866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bfc15c150 0x7f0bfc0b19b0 secure :-1 s=READY pgs=2572 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc0747c0 tx=0x7f0bf4006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:28.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.546+0000 7f0bf2000640 1 -- 172.21.15.42:0/1395473866 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf400fa20 con 0x7f0bfc15c150 2024-09-17T01:49:28.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.546+0000 7f0bf2000640 1 -- 172.21.15.42:0/1395473866 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bf4018070 con 0x7f0bfc15c150 2024-09-17T01:49:28.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.546+0000 7f0c00c00640 1 -- 172.21.15.42:0/1395473866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bfc134c30 con 0x7f0bfc15c150 2024-09-17T01:49:28.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.546+0000 7f0bf2000640 1 -- 172.21.15.42:0/1395473866 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf400fe60 con 0x7f0bfc15c150 2024-09-17T01:49:28.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.546+0000 7f0c00c00640 1 -- 172.21.15.42:0/1395473866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bfc1f6120 con 0x7f0bfc15c150 2024-09-17T01:49:28.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.547+0000 7f0c00c00640 1 -- 172.21.15.42:0/1395473866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bfc072b60 con 0x7f0bfc15c150 2024-09-17T01:49:28.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.548+0000 7f0bf2000640 1 -- 172.21.15.42:0/1395473866 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0bf401d460 con 0x7f0bfc15c150 2024-09-17T01:49:28.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.549+0000 7f0bf2000640 1 --2- 172.21.15.42:0/1395473866 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0bdc078bc0 0x7f0bdc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:28.547 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.549+0000 7f0bf2000640 1 -- 172.21.15.42:0/1395473866 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f0bf409b480 con 0x7f0bfc15c150 2024-09-17T01:49:28.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.550+0000 7f0bf9e00640 1 --2- 172.21.15.42:0/1395473866 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0bdc078bc0 0x7f0bdc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:28.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.551+0000 7f0bf9e00640 1 --2- 172.21.15.42:0/1395473866 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0bdc078bc0 0x7f0bdc07b0d0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f0bec009460 tx=0x7f0bec005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:28.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.554+0000 7f0bf2000640 1 -- 172.21.15.42:0/1395473866 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0bfc15c560 con 0x7f0bfc15c150 2024-09-17T01:49:28.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.747+0000 7f0c00c00640 1 -- 172.21.15.42:0/1395473866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mds_hack_allow_loading_invalid_metadata}] v 0) -- 0x7f0bfc146510 con 0x7f0bfc15c150 2024-09-17T01:49:28.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.750+0000 7f0bf2000640 1 -- 172.21.15.42:0/1395473866 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_hack_allow_loading_invalid_metadata}]=0 v69)=0 v69) ==== 140+0+0 (secure 0 0 0) 0x7f0bf4063170 con 0x7f0bfc15c150 2024-09-17T01:49:28.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.753+0000 7f0c00c00640 1 -- 172.21.15.42:0/1395473866 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0bdc078bc0 msgr2=0x7f0bdc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:28.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.753+0000 7f0c00c00640 1 --2- 172.21.15.42:0/1395473866 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0bdc078bc0 0x7f0bdc07b0d0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f0bec009460 tx=0x7f0bec005f90 comp rx=0 tx=0).stop 2024-09-17T01:49:28.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.753+0000 7f0c00c00640 1 -- 172.21.15.42:0/1395473866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bfc15c150 msgr2=0x7f0bfc0b19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:28.751 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.753+0000 7f0c00c00640 1 --2- 172.21.15.42:0/1395473866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bfc15c150 0x7f0bfc0b19b0 secure :-1 s=READY pgs=2572 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc0747c0 tx=0x7f0bf4006720 comp rx=0 tx=0).stop 2024-09-17T01:49:28.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.753+0000 7f0c00c00640 1 -- 172.21.15.42:0/1395473866 shutdown_connections 2024-09-17T01:49:28.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.753+0000 7f0c00c00640 1 --2- 172.21.15.42:0/1395473866 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0bdc078bc0 0x7f0bdc07b0d0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.753+0000 7f0c00c00640 1 --2- 172.21.15.42:0/1395473866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0bfc15c150 0x7f0bfc0b19b0 unknown :-1 s=CLOSED pgs=2572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.753+0000 7f0c00c00640 1 --2- 172.21.15.42:0/1395473866 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0bfc153e10 0x7f0bfc15bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.753+0000 7f0c00c00640 1 --2- 172.21.15.42:0/1395473866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0be0004800 0x7f0bfc1f5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:28.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.753+0000 7f0c00c00640 1 -- 172.21.15.42:0/1395473866 >> 172.21.15.42:0/1395473866 conn(0x7f0bfc06d1b0 msgr2=0x7f0bfc155fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:28.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.753+0000 7f0c00c00640 1 -- 172.21.15.42:0/1395473866 shutdown_connections 2024-09-17T01:49:28.752 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:28.753+0000 7f0c00c00640 1 -- 172.21.15.42:0/1395473866 wait complete. 2024-09-17T01:49:28.773 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-17T01:49:29.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.006+0000 7fc40e600640 1 -- 172.21.15.42:0/1232274067 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc408072b60 msgr2=0x7fc4080cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:29.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.006+0000 7fc40e600640 1 --2- 172.21.15.42:0/1232274067 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc408072b60 0x7fc4080cd620 secure :-1 s=READY pgs=2574 cs=0 l=1 rev1=1 crypto rx=0x7fc4080749c0 tx=0x7fc3f402a510 comp rx=0 tx=0).stop 2024-09-17T01:49:29.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.007+0000 7fc40e600640 1 -- 172.21.15.42:0/1232274067 shutdown_connections 2024-09-17T01:49:29.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.007+0000 7fc40e600640 1 --2- 172.21.15.42:0/1232274067 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc408072b60 0x7fc4080cd620 unknown :-1 s=CLOSED pgs=2574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:29.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.007+0000 7fc40e600640 1 -- 172.21.15.42:0/1232274067 >> 172.21.15.42:0/1232274067 conn(0x7fc40806d1b0 msgr2=0x7fc40806d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:29.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.007+0000 7fc40e600640 1 -- 172.21.15.42:0/1232274067 shutdown_connections 2024-09-17T01:49:29.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.007+0000 7fc40e600640 1 -- 172.21.15.42:0/1232274067 wait complete. 2024-09-17T01:49:29.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.009+0000 7fc40e600640 1 Processor -- start 2024-09-17T01:49:29.007 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.009+0000 7fc40e600640 1 -- start start 2024-09-17T01:49:29.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.010+0000 7fc40e600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc408072b60 0x7fc4081f9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:29.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.010+0000 7fc40e600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4080cdb60 0x7fc4081f63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:29.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.011+0000 7fc40e600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc40815dcf0 0x7fc4081446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:29.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.011+0000 7fc40e600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc40806f0d0 con 0x7fc408072b60 2024-09-17T01:49:29.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.011+0000 7fc40e600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc4081610b0 con 0x7fc4080cdb60 2024-09-17T01:49:29.009 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.011+0000 7fc40e600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc40806f250 con 0x7fc40815dcf0 2024-09-17T01:49:29.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.011+0000 7fc407400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc408072b60 0x7fc4081f9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:29.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.011+0000 7fc407400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc408072b60 0x7fc4081f9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40500/0 (socket says 172.21.15.42:40500) 2024-09-17T01:49:29.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.011+0000 7fc407400640 1 -- 172.21.15.42:0/2324814149 learned_addr learned my addr 172.21.15.42:0/2324814149 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:29.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.011+0000 7fc406a00640 1 --2- 172.21.15.42:0/2324814149 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4080cdb60 0x7fc4081f63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:29.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.011+0000 7fc407e00640 1 --2- 172.21.15.42:0/2324814149 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc40815dcf0 0x7fc4081446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:29.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.011+0000 7fc407400640 1 -- 172.21.15.42:0/2324814149 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc40815dcf0 msgr2=0x7fc4081446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:29.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.011+0000 7fc407400640 1 --2- 172.21.15.42:0/2324814149 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc40815dcf0 0x7fc4081446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:29.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.011+0000 7fc407400640 1 -- 172.21.15.42:0/2324814149 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4080cdb60 msgr2=0x7fc4081f63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:29.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.011+0000 7fc407400640 1 --2- 172.21.15.42:0/2324814149 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4080cdb60 0x7fc4081f63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:29.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.011+0000 7fc407400640 1 -- 172.21.15.42:0/2324814149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4081fa650 con 0x7fc408072b60 2024-09-17T01:49:29.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.011+0000 7fc407e00640 1 --2- 172.21.15.42:0/2324814149 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc40815dcf0 0x7fc4081446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:49:29.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.012+0000 7fc407400640 1 --2- 172.21.15.42:0/2324814149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc408072b60 0x7fc4081f9740 secure :-1 s=READY pgs=2575 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800c370 tx=0x7fc3f800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:29.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.012+0000 7fc3ff400640 1 -- 172.21.15.42:0/2324814149 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8017070 con 0x7fc408072b60 2024-09-17T01:49:29.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.012+0000 7fc3ff400640 1 -- 172.21.15.42:0/2324814149 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3f80035f0 con 0x7fc408072b60 2024-09-17T01:49:29.011 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.012+0000 7fc40e600640 1 -- 172.21.15.42:0/2324814149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4081fa090 con 0x7fc408072b60 2024-09-17T01:49:29.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.012+0000 7fc3ff400640 1 -- 172.21.15.42:0/2324814149 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8003a40 con 0x7fc408072b60 2024-09-17T01:49:29.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.012+0000 7fc40e600640 1 -- 172.21.15.42:0/2324814149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4081550c0 con 0x7fc408072b60 2024-09-17T01:49:29.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.013+0000 7fc40e600640 1 -- 172.21.15.42:0/2324814149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc408160510 con 0x7fc408072b60 2024-09-17T01:49:29.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.015+0000 7fc3ff400640 1 -- 172.21.15.42:0/2324814149 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc3f801a070 con 0x7fc408072b60 2024-09-17T01:49:29.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.015+0000 7fc3ff400640 1 --2- 172.21.15.42:0/2324814149 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc3e8078bc0 0x7fc3e807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:29.013 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.016+0000 7fc3ff400640 1 -- 172.21.15.42:0/2324814149 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7fc3f8099f90 con 0x7fc408072b60 2024-09-17T01:49:29.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.016+0000 7fc406a00640 1 --2- 172.21.15.42:0/2324814149 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc3e8078bc0 0x7fc3e807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:29.014 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.017+0000 7fc406a00640 1 --2- 172.21.15.42:0/2324814149 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc3e8078bc0 0x7fc3e807b0d0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4034000 tx=0x7fc3f4004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:29.018 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.020+0000 7fc3ff400640 1 -- 172.21.15.42:0/2324814149 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc408160510 con 0x7fc408072b60 2024-09-17T01:49:29.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.255+0000 7fc40e600640 1 -- 172.21.15.42:0/2324814149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fc4080cd620 con 0x7fc408072b60 2024-09-17T01:49:29.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.613+0000 7fc3ff400640 1 -- 172.21.15.42:0/2324814149 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v180) ==== 162+0+0 (secure 0 0 0) 0x7fc4080cdf70 con 0x7fc408072b60 2024-09-17T01:49:29.611 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-17T01:49:29.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.616+0000 7fc40e600640 1 -- 172.21.15.42:0/2324814149 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc3e8078bc0 msgr2=0x7fc3e807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:29.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.616+0000 7fc40e600640 1 --2- 172.21.15.42:0/2324814149 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc3e8078bc0 0x7fc3e807b0d0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4034000 tx=0x7fc3f4004730 comp rx=0 tx=0).stop 2024-09-17T01:49:29.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.616+0000 7fc40e600640 1 -- 172.21.15.42:0/2324814149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc408072b60 msgr2=0x7fc4081f9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:29.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.616+0000 7fc40e600640 1 --2- 172.21.15.42:0/2324814149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc408072b60 0x7fc4081f9740 secure :-1 s=READY pgs=2575 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800c370 tx=0x7fc3f800c830 comp rx=0 tx=0).stop 2024-09-17T01:49:29.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.616+0000 7fc40e600640 1 -- 172.21.15.42:0/2324814149 shutdown_connections 2024-09-17T01:49:29.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.616+0000 7fc40e600640 1 --2- 172.21.15.42:0/2324814149 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc3e8078bc0 0x7fc3e807b0d0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:29.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.616+0000 7fc40e600640 1 --2- 172.21.15.42:0/2324814149 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4080cdb60 0x7fc4081f63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:29.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.616+0000 7fc40e600640 1 --2- 172.21.15.42:0/2324814149 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc40815dcf0 0x7fc4081446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:29.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.616+0000 7fc40e600640 1 --2- 172.21.15.42:0/2324814149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc408072b60 0x7fc4081f9740 unknown :-1 s=CLOSED pgs=2575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:29.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.616+0000 7fc40e600640 1 -- 172.21.15.42:0/2324814149 >> 172.21.15.42:0/2324814149 conn(0x7fc40806d1b0 msgr2=0x7fc40806e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:29.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.616+0000 7fc40e600640 1 -- 172.21.15.42:0/2324814149 shutdown_connections 2024-09-17T01:49:29.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.616+0000 7fc40e600640 1 -- 172.21.15.42:0/2324814149 wait complete. 2024-09-17T01:49:29.643 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:49:29.874 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.876+0000 7f5549200640 1 -- 172.21.15.42:0/291365683 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55440b7c70 msgr2=0x7f55440b8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:29.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.876+0000 7f5549200640 1 --2- 172.21.15.42:0/291365683 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55440b7c70 0x7f55440b8080 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f552c009830 tx=0x7f552c02a510 comp rx=0 tx=0).stop 2024-09-17T01:49:29.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.876+0000 7f5549200640 1 -- 172.21.15.42:0/291365683 shutdown_connections 2024-09-17T01:49:29.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.876+0000 7f5549200640 1 --2- 172.21.15.42:0/291365683 >> v2:172.21.15.43:3300/0 conn(0x7f55440b6250 0x7f55440b6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:29.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.876+0000 7f5549200640 1 --2- 172.21.15.42:0/291365683 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55440b7c70 0x7f55440b8080 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:29.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.876+0000 7f5549200640 1 -- 172.21.15.42:0/291365683 >> 172.21.15.42:0/291365683 conn(0x7f554406d3f0 msgr2=0x7f55440d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:29.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.877+0000 7f5549200640 1 -- 172.21.15.42:0/291365683 shutdown_connections 2024-09-17T01:49:29.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.877+0000 7f5549200640 1 -- 172.21.15.42:0/291365683 wait complete. 2024-09-17T01:49:29.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.879+0000 7f5549200640 1 Processor -- start 2024-09-17T01:49:29.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.879+0000 7f5549200640 1 -- start start 2024-09-17T01:49:29.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.880+0000 7f5549200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55440b6250 0x7f554414a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:29.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.880+0000 7f5549200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55440b7c70 0x7f554414be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:29.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.880+0000 7f5549200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f554415eae0 0x7f554414c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:29.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.880+0000 7f5549200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f55440d3930 con 0x7f55440b6250 2024-09-17T01:49:29.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.880+0000 7f5549200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f55440d37b0 con 0x7f554415eae0 2024-09-17T01:49:29.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.880+0000 7f5549200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f55440d3ab0 con 0x7f55440b7c70 2024-09-17T01:49:29.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.881+0000 7f5543400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55440b6250 0x7f554414a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:29.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.881+0000 7f5543400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55440b6250 0x7f554414a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40508/0 (socket says 172.21.15.42:40508) 2024-09-17T01:49:29.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.881+0000 7f5543400640 1 -- 172.21.15.42:0/2579807348 learned_addr learned my addr 172.21.15.42:0/2579807348 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:29.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.881+0000 7f5543e00640 1 --2- 172.21.15.42:0/2579807348 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f554415eae0 0x7f554414c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:29.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.881+0000 7f553aa00640 1 --2- 172.21.15.42:0/2579807348 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55440b7c70 0x7f554414be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:29.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.881+0000 7f5543400640 1 -- 172.21.15.42:0/2579807348 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55440b7c70 msgr2=0x7f554414be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:29.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.881+0000 7f5543400640 1 --2- 172.21.15.42:0/2579807348 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55440b7c70 0x7f554414be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:29.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.881+0000 7f5543400640 1 -- 172.21.15.42:0/2579807348 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f554415eae0 msgr2=0x7f554414c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:29.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.881+0000 7f5543400640 1 --2- 172.21.15.42:0/2579807348 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f554415eae0 0x7f554414c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:29.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.881+0000 7f5543400640 1 -- 172.21.15.42:0/2579807348 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f554414ada0 con 0x7f55440b6250 2024-09-17T01:49:29.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.881+0000 7f5543400640 1 --2- 172.21.15.42:0/2579807348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55440b6250 0x7f554414a2a0 secure :-1 s=READY pgs=2576 cs=0 l=1 rev1=1 crypto rx=0x7f553400c3a0 tx=0x7f553400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:29.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.882+0000 7f553be00640 1 -- 172.21.15.42:0/2579807348 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5534011790 con 0x7f55440b6250 2024-09-17T01:49:29.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.882+0000 7f553be00640 1 -- 172.21.15.42:0/2579807348 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5534017070 con 0x7f55440b6250 2024-09-17T01:49:29.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.882+0000 7f553be00640 1 -- 172.21.15.42:0/2579807348 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5534011cc0 con 0x7f55440b6250 2024-09-17T01:49:29.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.882+0000 7f5549200640 1 -- 172.21.15.42:0/2579807348 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f554414b080 con 0x7f55440b6250 2024-09-17T01:49:29.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.882+0000 7f5549200640 1 -- 172.21.15.42:0/2579807348 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f554414b640 con 0x7f55440b6250 2024-09-17T01:49:29.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.883+0000 7f5549200640 1 -- 172.21.15.42:0/2579807348 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55440d3fd0 con 0x7f55440b6250 2024-09-17T01:49:29.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.884+0000 7f553be00640 1 -- 172.21.15.42:0/2579807348 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f553401c460 con 0x7f55440b6250 2024-09-17T01:49:29.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.885+0000 7f553be00640 1 --2- 172.21.15.42:0/2579807348 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5520078b90 0x7f552007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:29.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.885+0000 7f553be00640 1 -- 172.21.15.42:0/2579807348 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f553409a9c0 con 0x7f55440b6250 2024-09-17T01:49:29.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.886+0000 7f553aa00640 1 --2- 172.21.15.42:0/2579807348 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5520078b90 0x7f552007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:29.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.886+0000 7f553aa00640 1 --2- 172.21.15.42:0/2579807348 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5520078b90 0x7f552007b0a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f552c034000 tx=0x7f552c004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:29.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:29.890+0000 7f553be00640 1 -- 172.21.15.42:0/2579807348 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f55440b6ba0 con 0x7f55440b6250 2024-09-17T01:49:30.121 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:30.123+0000 7f5549200640 1 -- 172.21.15.42:0/2579807348 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55440b9a60 con 0x7f55440b6250 2024-09-17T01:49:30.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:30.124+0000 7f553be00640 1 -- 172.21.15.42:0/2579807348 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 180 v180) ==== 95+0+5233 (secure 0 0 0) 0x7f5534062da0 con 0x7f55440b6250 2024-09-17T01:49:30.122 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:30.122 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":180,"btime":"2024-09-17T01:49:29:612382+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9479,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1690107508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1690107508},{"type":"v1","addr":"172.21.15.43:6837","nonce":1690107508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":179},{"gid":11511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1418140325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1418140325},{"type":"v1","addr":"172.21.15.42:6833","nonce":1418140325}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":171},{"gid":11514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2781042225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":2781042225},{"type":"v1","addr":"172.21.15.42:6835","nonce":2781042225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":172}],"filesystems":[{"mdsmap":{"epoch":180,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:49:16.188388+0000","modified":"2024-09-17T01:49:29.612364+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":227,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11517":{"gid":11517,"name":"d","rank":0,"incarnation":180,"state":"up:replay","state_seq":1,"addr":"172.21.15.43:6836/4082001755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4082001755},{"type":"v1","addr":"172.21.15.43:6836","nonce":4082001755}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":16}]} 2024-09-17T01:49:30.122 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 180 2024-09-17T01:49:30.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:30.126+0000 7f5549200640 1 -- 172.21.15.42:0/2579807348 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5520078b90 msgr2=0x7f552007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:30.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:30.126+0000 7f5549200640 1 --2- 172.21.15.42:0/2579807348 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5520078b90 0x7f552007b0a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f552c034000 tx=0x7f552c004730 comp rx=0 tx=0).stop 2024-09-17T01:49:30.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:30.126+0000 7f5549200640 1 -- 172.21.15.42:0/2579807348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55440b6250 msgr2=0x7f554414a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:30.124 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:30.126+0000 7f5549200640 1 --2- 172.21.15.42:0/2579807348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55440b6250 0x7f554414a2a0 secure :-1 s=READY pgs=2576 cs=0 l=1 rev1=1 crypto rx=0x7f553400c3a0 tx=0x7f553400c7a0 comp rx=0 tx=0).stop 2024-09-17T01:49:30.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:30.126+0000 7f5549200640 1 -- 172.21.15.42:0/2579807348 shutdown_connections 2024-09-17T01:49:30.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:30.126+0000 7f5549200640 1 --2- 172.21.15.42:0/2579807348 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5520078b90 0x7f552007b0a0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:30.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:30.126+0000 7f5549200640 1 --2- 172.21.15.42:0/2579807348 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f554415eae0 0x7f554414c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:30.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:30.126+0000 7f5549200640 1 --2- 172.21.15.42:0/2579807348 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f55440b7c70 0x7f554414be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:30.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:30.126+0000 7f5549200640 1 --2- 172.21.15.42:0/2579807348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f55440b6250 0x7f554414a2a0 unknown :-1 s=CLOSED pgs=2576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:30.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:30.126+0000 7f5549200640 1 -- 172.21.15.42:0/2579807348 >> 172.21.15.42:0/2579807348 conn(0x7f554406d3f0 msgr2=0x7f55440b9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:30.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:30.126+0000 7f5549200640 1 -- 172.21.15.42:0/2579807348 shutdown_connections 2024-09-17T01:49:30.125 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:30.126+0000 7f5549200640 1 -- 172.21.15.42:0/2579807348 wait complete. 2024-09-17T01:49:30.548 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 180, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:49:16.188388+0000', 'modified': '2024-09-17T01:49:29.612364+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 227, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11517}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11517': {'gid': 11517, 'name': 'd', 'rank': 0, 'incarnation': 180, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.43:6836/4082001755', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 4082001755}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 4082001755}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [33], 'metadata_pool': 32, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T01:49:30.548 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_11517:up:replay 2024-09-17T01:49:31.549 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:49:31.789 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.791+0000 7f281de00640 1 -- 172.21.15.42:0/4153979953 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28181605c0 msgr2=0x7f28181609d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:31.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.791+0000 7f281de00640 1 --2- 172.21.15.42:0/4153979953 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28181605c0 0x7f28181609d0 secure :-1 s=READY pgs=2577 cs=0 l=1 rev1=1 crypto rx=0x7f2810005fd0 tx=0x7f281002aa10 comp rx=0 tx=0).stop 2024-09-17T01:49:31.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.791+0000 7f281de00640 1 -- 172.21.15.42:0/4153979953 shutdown_connections 2024-09-17T01:49:31.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.791+0000 7f281de00640 1 --2- 172.21.15.42:0/4153979953 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28181605c0 0x7f28181609d0 unknown :-1 s=CLOSED pgs=2577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:31.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.791+0000 7f281de00640 1 --2- 172.21.15.42:0/4153979953 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28180b51d0 0x7f28180b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:31.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.791+0000 7f281de00640 1 -- 172.21.15.42:0/4153979953 >> 172.21.15.42:0/4153979953 conn(0x7f281806d3f0 msgr2=0x7f28180b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:31.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.791+0000 7f281de00640 1 -- 172.21.15.42:0/4153979953 shutdown_connections 2024-09-17T01:49:31.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.791+0000 7f281de00640 1 -- 172.21.15.42:0/4153979953 wait complete. 2024-09-17T01:49:31.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.794+0000 7f281de00640 1 Processor -- start 2024-09-17T01:49:31.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.794+0000 7f281de00640 1 -- start start 2024-09-17T01:49:31.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.795+0000 7f281de00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28180afb00 0x7f28181f7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:31.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.795+0000 7f281de00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28180b51d0 0x7f28181456a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:31.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.795+0000 7f281de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28181605c0 0x7f28181f3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:31.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.795+0000 7f281de00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f28180ce4f0 con 0x7f28181605c0 2024-09-17T01:49:31.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.795+0000 7f281de00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f28180ce370 con 0x7f28180b51d0 2024-09-17T01:49:31.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.795+0000 7f281de00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f28180ce670 con 0x7f28180afb00 2024-09-17T01:49:31.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.796+0000 7f281d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28181605c0 0x7f28181f3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:31.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.796+0000 7f281d400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28181605c0 0x7f28181f3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40522/0 (socket says 172.21.15.42:40522) 2024-09-17T01:49:31.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.796+0000 7f281d400640 1 -- 172.21.15.42:0/3674366247 learned_addr learned my addr 172.21.15.42:0/3674366247 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:31.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.796+0000 7f2817e00640 1 --2- 172.21.15.42:0/3674366247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28180b51d0 0x7f28181456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:31.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.796+0000 7f281ca00640 1 --2- 172.21.15.42:0/3674366247 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28180afb00 0x7f28181f7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:31.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.796+0000 7f281d400640 1 -- 172.21.15.42:0/3674366247 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28180afb00 msgr2=0x7f28181f7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:31.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.796+0000 7f281d400640 1 --2- 172.21.15.42:0/3674366247 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28180afb00 0x7f28181f7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:31.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.796+0000 7f281d400640 1 -- 172.21.15.42:0/3674366247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28180b51d0 msgr2=0x7f28181456a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:31.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.796+0000 7f281d400640 1 --2- 172.21.15.42:0/3674366247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28180b51d0 0x7f28181456a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:31.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.796+0000 7f281d400640 1 -- 172.21.15.42:0/3674366247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2818145be0 con 0x7f28181605c0 2024-09-17T01:49:31.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.796+0000 7f281d400640 1 --2- 172.21.15.42:0/3674366247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28181605c0 0x7f28181f3ab0 secure :-1 s=READY pgs=2578 cs=0 l=1 rev1=1 crypto rx=0x7f2810006010 tx=0x7f2810003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:31.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.797+0000 7f2814c00640 1 -- 172.21.15.42:0/3674366247 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2810046070 con 0x7f28181605c0 2024-09-17T01:49:31.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.797+0000 7f2814c00640 1 -- 172.21.15.42:0/3674366247 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2810004540 con 0x7f28181605c0 2024-09-17T01:49:31.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.797+0000 7f2814c00640 1 -- 172.21.15.42:0/3674366247 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2810033070 con 0x7f28181605c0 2024-09-17T01:49:31.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.797+0000 7f281de00640 1 -- 172.21.15.42:0/3674366247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28180aee80 con 0x7f28181605c0 2024-09-17T01:49:31.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.797+0000 7f281de00640 1 -- 172.21.15.42:0/3674366247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2818158880 con 0x7f28181605c0 2024-09-17T01:49:31.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.798+0000 7f281de00640 1 -- 172.21.15.42:0/3674366247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2818074710 con 0x7f28181605c0 2024-09-17T01:49:31.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.799+0000 7f2814c00640 1 -- 172.21.15.42:0/3674366247 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2810049070 con 0x7f28181605c0 2024-09-17T01:49:31.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.800+0000 7f2814c00640 1 --2- 172.21.15.42:0/3674366247 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f27f8078b90 0x7f27f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:31.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.800+0000 7f2814c00640 1 -- 172.21.15.42:0/3674366247 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f28100bbec0 con 0x7f28181605c0 2024-09-17T01:49:31.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.801+0000 7f281ca00640 1 --2- 172.21.15.42:0/3674366247 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f27f8078b90 0x7f27f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:31.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.802+0000 7f281ca00640 1 --2- 172.21.15.42:0/3674366247 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f27f8078b90 0x7f27f807b0a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f280c001720 tx=0x7f280c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:31.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:31.805+0000 7f2814c00640 1 -- 172.21.15.42:0/3674366247 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2818074710 con 0x7f28181605c0 2024-09-17T01:49:32.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:32.036+0000 7f281de00640 1 -- 172.21.15.42:0/3674366247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28180b55e0 con 0x7f28181605c0 2024-09-17T01:49:32.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:32.036+0000 7f2814c00640 1 -- 172.21.15.42:0/3674366247 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 182 v182) ==== 95+0+5233 (secure 0 0 0) 0x7f281003e070 con 0x7f28181605c0 2024-09-17T01:49:32.034 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:32.035 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":182,"btime":"2024-09-17T01:49:31:616113+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9479,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1690107508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1690107508},{"type":"v1","addr":"172.21.15.43:6837","nonce":1690107508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":179},{"gid":11511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1418140325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1418140325},{"type":"v1","addr":"172.21.15.42:6833","nonce":1418140325}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":171},{"gid":11514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2781042225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":2781042225},{"type":"v1","addr":"172.21.15.42:6835","nonce":2781042225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":172}],"filesystems":[{"mdsmap":{"epoch":182,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:49:16.188388+0000","modified":"2024-09-17T01:49:30.619155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":227,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11517":{"gid":11517,"name":"d","rank":0,"incarnation":180,"state":"up:rejoin","state_seq":7,"addr":"172.21.15.43:6836/4082001755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4082001755},{"type":"v1","addr":"172.21.15.43:6836","nonce":4082001755}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":16}]} 2024-09-17T01:49:32.035 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 182 2024-09-17T01:49:32.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:32.039+0000 7f281de00640 1 -- 172.21.15.42:0/3674366247 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f27f8078b90 msgr2=0x7f27f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:32.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:32.039+0000 7f281de00640 1 --2- 172.21.15.42:0/3674366247 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f27f8078b90 0x7f27f807b0a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f280c001720 tx=0x7f280c009040 comp rx=0 tx=0).stop 2024-09-17T01:49:32.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:32.039+0000 7f281de00640 1 -- 172.21.15.42:0/3674366247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28181605c0 msgr2=0x7f28181f3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:32.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:32.039+0000 7f281de00640 1 --2- 172.21.15.42:0/3674366247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28181605c0 0x7f28181f3ab0 secure :-1 s=READY pgs=2578 cs=0 l=1 rev1=1 crypto rx=0x7f2810006010 tx=0x7f2810003f10 comp rx=0 tx=0).stop 2024-09-17T01:49:32.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:32.039+0000 7f281de00640 1 -- 172.21.15.42:0/3674366247 shutdown_connections 2024-09-17T01:49:32.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:32.039+0000 7f281de00640 1 --2- 172.21.15.42:0/3674366247 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f27f8078b90 0x7f27f807b0a0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:32.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:32.039+0000 7f281de00640 1 --2- 172.21.15.42:0/3674366247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28180b51d0 0x7f28181456a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:32.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:32.039+0000 7f281de00640 1 --2- 172.21.15.42:0/3674366247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28181605c0 0x7f28181f3ab0 unknown :-1 s=CLOSED pgs=2578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:32.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:32.039+0000 7f281de00640 1 --2- 172.21.15.42:0/3674366247 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28180afb00 0x7f28181f7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:32.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:32.039+0000 7f281de00640 1 -- 172.21.15.42:0/3674366247 >> 172.21.15.42:0/3674366247 conn(0x7f281806d3f0 msgr2=0x7f281815ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:32.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:32.039+0000 7f281de00640 1 -- 172.21.15.42:0/3674366247 shutdown_connections 2024-09-17T01:49:32.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:32.039+0000 7f281de00640 1 -- 172.21.15.42:0/3674366247 wait complete. 2024-09-17T01:49:32.467 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 182, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:49:16.188388+0000', 'modified': '2024-09-17T01:49:30.619155+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 227, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11517}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11517': {'gid': 11517, 'name': 'd', 'rank': 0, 'incarnation': 180, 'state': 'up:rejoin', 'state_seq': 7, 'addr': '172.21.15.43:6836/4082001755', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 4082001755}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 4082001755}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [33], 'metadata_pool': 32, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T01:49:32.467 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_11517:up:rejoin 2024-09-17T01:49:33.468 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:49:33.647 INFO:tasks.ceph.mds.d.smithi043.stderr:2024-09-17T01:49:33.649+0000 7f5496c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:49:33.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.709+0000 7f613c200640 1 -- 172.21.15.42:0/4282750323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6134073760 msgr2=0x7f61340cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:33.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.709+0000 7f613c200640 1 --2- 172.21.15.42:0/4282750323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6134073760 0x7f61340cd620 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f612c005fd0 tx=0x7f612c02a8b0 comp rx=0 tx=0).stop 2024-09-17T01:49:33.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.709+0000 7f613c200640 1 -- 172.21.15.42:0/4282750323 shutdown_connections 2024-09-17T01:49:33.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.709+0000 7f613c200640 1 --2- 172.21.15.42:0/4282750323 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6134073760 0x7f61340cd620 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:33.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.709+0000 7f613c200640 1 --2- 172.21.15.42:0/4282750323 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f613406fd50 0x7f6134073220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:33.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.709+0000 7f613c200640 1 -- 172.21.15.42:0/4282750323 >> 172.21.15.42:0/4282750323 conn(0x7f613406d1b0 msgr2=0x7f613406d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:33.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.709+0000 7f613c200640 1 -- 172.21.15.42:0/4282750323 shutdown_connections 2024-09-17T01:49:33.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.709+0000 7f613c200640 1 -- 172.21.15.42:0/4282750323 wait complete. 2024-09-17T01:49:33.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.711+0000 7f613c200640 1 Processor -- start 2024-09-17T01:49:33.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.711+0000 7f613c200640 1 -- start start 2024-09-17T01:49:33.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.713+0000 7f613c200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f613406fd50 0x7f61341f9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:33.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.713+0000 7f613c200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6134073760 0x7f61341f98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:33.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.713+0000 7f613c200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f613415c040 0x7f6134142b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:33.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.713+0000 7f613c200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f61340cdf20 con 0x7f613415c040 2024-09-17T01:49:33.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.713+0000 7f613c200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f61340cdda0 con 0x7f6134073760 2024-09-17T01:49:33.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.713+0000 7f613c200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f613406ede0 con 0x7f613406fd50 2024-09-17T01:49:33.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.713+0000 7f613a200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f613415c040 0x7f6134142b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:33.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.713+0000 7f6139800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f613406fd50 0x7f61341f9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:33.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.713+0000 7f6139800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f613406fd50 0x7f61341f9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:57804/0 (socket says 172.21.15.42:57804) 2024-09-17T01:49:33.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.713+0000 7f6139800640 1 -- 172.21.15.42:0/3583884652 learned_addr learned my addr 172.21.15.42:0/3583884652 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:33.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.713+0000 7f613a200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f613415c040 0x7f6134142b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40538/0 (socket says 172.21.15.42:40538) 2024-09-17T01:49:33.712 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.713+0000 7f6138e00640 1 --2- 172.21.15.42:0/3583884652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6134073760 0x7f61341f98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:33.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.714+0000 7f6139800640 1 -- 172.21.15.42:0/3583884652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6134073760 msgr2=0x7f61341f98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:33.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.714+0000 7f6139800640 1 --2- 172.21.15.42:0/3583884652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6134073760 0x7f61341f98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:33.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.714+0000 7f6139800640 1 -- 172.21.15.42:0/3583884652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f613415c040 msgr2=0x7f6134142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:33.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.714+0000 7f6139800640 1 --2- 172.21.15.42:0/3583884652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f613415c040 0x7f6134142b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:33.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.714+0000 7f6139800640 1 -- 172.21.15.42:0/3583884652 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6134153b80 con 0x7f613406fd50 2024-09-17T01:49:33.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.714+0000 7f613a200640 1 --2- 172.21.15.42:0/3583884652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f613415c040 0x7f6134142b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:49:33.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.714+0000 7f6139800640 1 --2- 172.21.15.42:0/3583884652 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f613406fd50 0x7f61341f9380 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f612800c3a0 tx=0x7f612800c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:33.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.714+0000 7f6131600640 1 -- 172.21.15.42:0/3583884652 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6128017070 con 0x7f613406fd50 2024-09-17T01:49:33.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.715+0000 7f6131600640 1 -- 172.21.15.42:0/3583884652 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61280053c0 con 0x7f613406fd50 2024-09-17T01:49:33.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.715+0000 7f613c200640 1 -- 172.21.15.42:0/3583884652 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6134153e60 con 0x7f613406fd50 2024-09-17T01:49:33.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.715+0000 7f6131600640 1 -- 172.21.15.42:0/3583884652 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6128003850 con 0x7f613406fd50 2024-09-17T01:49:33.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.715+0000 7f613c200640 1 -- 172.21.15.42:0/3583884652 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6134154420 con 0x7f613406fd50 2024-09-17T01:49:33.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.716+0000 7f613c200640 1 -- 172.21.15.42:0/3583884652 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6134073220 con 0x7f613406fd50 2024-09-17T01:49:33.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.718+0000 7f6131600640 1 -- 172.21.15.42:0/3583884652 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f612801a070 con 0x7f613406fd50 2024-09-17T01:49:33.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.718+0000 7f6131600640 1 --2- 172.21.15.42:0/3583884652 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6114078b90 0x7f611407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:33.716 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.719+0000 7f6131600640 1 -- 172.21.15.42:0/3583884652 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f612809a310 con 0x7f613406fd50 2024-09-17T01:49:33.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.719+0000 7f6138e00640 1 --2- 172.21.15.42:0/3583884652 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6114078b90 0x7f611407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:33.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.720+0000 7f6138e00640 1 --2- 172.21.15.42:0/3583884652 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6114078b90 0x7f611407b0a0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f6120009530 tx=0x7f6120009260 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:33.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.722+0000 7f6131600640 1 -- 172.21.15.42:0/3583884652 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6128062080 con 0x7f613406fd50 2024-09-17T01:49:33.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.954+0000 7f613c200640 1 -- 172.21.15.42:0/3583884652 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6134155ee0 con 0x7f613406fd50 2024-09-17T01:49:33.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.955+0000 7f6131600640 1 -- 172.21.15.42:0/3583884652 <== mon.2 v2:172.21.15.43:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 183 v183) ==== 95+0+5242 (secure 0 0 0) 0x7f6128066ab0 con 0x7f613406fd50 2024-09-17T01:49:33.953 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:49:33.953 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":183,"btime":"2024-09-17T01:49:32:618086+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9479,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1690107508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1690107508},{"type":"v1","addr":"172.21.15.43:6837","nonce":1690107508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":179},{"gid":11511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1418140325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1418140325},{"type":"v1","addr":"172.21.15.42:6833","nonce":1418140325}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":171},{"gid":11514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2781042225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":2781042225},{"type":"v1","addr":"172.21.15.42:6835","nonce":2781042225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":172}],"filesystems":[{"mdsmap":{"epoch":183,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:49:16.188388+0000","modified":"2024-09-17T01:49:32.618079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":227,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11517":{"gid":11517,"name":"d","rank":0,"incarnation":180,"state":"up:active","state_seq":8,"addr":"172.21.15.43:6836/4082001755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4082001755},{"type":"v1","addr":"172.21.15.43:6836","nonce":4082001755}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11517,"qdb_cluster":[11517]},"id":16}]} 2024-09-17T01:49:33.953 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 183 2024-09-17T01:49:33.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.957+0000 7f613c200640 1 -- 172.21.15.42:0/3583884652 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6114078b90 msgr2=0x7f611407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:33.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.957+0000 7f613c200640 1 --2- 172.21.15.42:0/3583884652 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6114078b90 0x7f611407b0a0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f6120009530 tx=0x7f6120009260 comp rx=0 tx=0).stop 2024-09-17T01:49:33.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.957+0000 7f613c200640 1 -- 172.21.15.42:0/3583884652 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f613406fd50 msgr2=0x7f61341f9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:33.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.957+0000 7f613c200640 1 --2- 172.21.15.42:0/3583884652 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f613406fd50 0x7f61341f9380 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f612800c3a0 tx=0x7f612800c860 comp rx=0 tx=0).stop 2024-09-17T01:49:33.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.957+0000 7f613c200640 1 -- 172.21.15.42:0/3583884652 shutdown_connections 2024-09-17T01:49:33.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.957+0000 7f613c200640 1 --2- 172.21.15.42:0/3583884652 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6114078b90 0x7f611407b0a0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:33.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.957+0000 7f613c200640 1 --2- 172.21.15.42:0/3583884652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6134073760 0x7f61341f98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:33.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.957+0000 7f613c200640 1 --2- 172.21.15.42:0/3583884652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f613415c040 0x7f6134142b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:33.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.957+0000 7f613c200640 1 --2- 172.21.15.42:0/3583884652 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f613406fd50 0x7f61341f9380 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:33.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.957+0000 7f613c200640 1 -- 172.21.15.42:0/3583884652 >> 172.21.15.42:0/3583884652 conn(0x7f613406d1b0 msgr2=0x7f6134154b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:33.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.957+0000 7f613c200640 1 -- 172.21.15.42:0/3583884652 shutdown_connections 2024-09-17T01:49:33.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:33.957+0000 7f613c200640 1 -- 172.21.15.42:0/3583884652 wait complete. 2024-09-17T01:49:34.382 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 183, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:49:16.188388+0000', 'modified': '2024-09-17T01:49:32.618079+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 227, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11517}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11517': {'gid': 11517, 'name': 'd', 'rank': 0, 'incarnation': 180, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.43:6836/4082001755', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 4082001755}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 4082001755}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [33], 'metadata_pool': 32, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 11517, 'qdb_cluster': [11517]} 2024-09-17T01:49:34.382 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T01:49:34.382 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T01:49:34.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.615+0000 7fea6be00640 1 -- 172.21.15.42:0/2444117467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea6c160cd0 msgr2=0x7fea6c0b55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:34.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.615+0000 7fea6be00640 1 --2- 172.21.15.42:0/2444117467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea6c160cd0 0x7fea6c0b55e0 secure :-1 s=READY pgs=2580 cs=0 l=1 rev1=1 crypto rx=0x7fea64005fd0 tx=0x7fea6402a8b0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.615+0000 7fea6be00640 1 -- 172.21.15.42:0/2444117467 shutdown_connections 2024-09-17T01:49:34.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.615+0000 7fea6be00640 1 --2- 172.21.15.42:0/2444117467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea6c160cd0 0x7fea6c0b55e0 unknown :-1 s=CLOSED pgs=2580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.615+0000 7fea6be00640 1 -- 172.21.15.42:0/2444117467 >> 172.21.15.42:0/2444117467 conn(0x7fea6c06d3f0 msgr2=0x7fea6c0b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:34.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.615+0000 7fea6be00640 1 -- 172.21.15.42:0/2444117467 shutdown_connections 2024-09-17T01:49:34.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.615+0000 7fea6be00640 1 -- 172.21.15.42:0/2444117467 wait complete. 2024-09-17T01:49:34.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.617+0000 7fea6be00640 1 Processor -- start 2024-09-17T01:49:34.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.617+0000 7fea6be00640 1 -- start start 2024-09-17T01:49:34.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.619+0000 7fea6be00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea6c0afb00 0x7fea6c1f95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.619+0000 7fea6be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea6c0b51d0 0x7fea6c1f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.619+0000 7fea6be00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fea6c1e9940 0x7fea6c158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.619+0000 7fea6be00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fea6c0cf710 con 0x7fea6c0b51d0 2024-09-17T01:49:34.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.619+0000 7fea6be00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fea6c0cf590 con 0x7fea6c0afb00 2024-09-17T01:49:34.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.619+0000 7fea6be00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fea6c0cf890 con 0x7fea6c1e9940 2024-09-17T01:49:34.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.619+0000 7fea63e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea6c0b51d0 0x7fea6c1f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.619+0000 7fea63e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea6c0b51d0 0x7fea6c1f28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40560/0 (socket says 172.21.15.42:40560) 2024-09-17T01:49:34.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.619+0000 7fea63e00640 1 -- 172.21.15.42:0/3867540017 learned_addr learned my addr 172.21.15.42:0/3867540017 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:34.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.619+0000 7fea6aa00640 1 --2- 172.21.15.42:0/3867540017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea6c0afb00 0x7fea6c1f95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.619+0000 7fea6b400640 1 --2- 172.21.15.42:0/3867540017 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fea6c1e9940 0x7fea6c158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.620+0000 7fea63e00640 1 -- 172.21.15.42:0/3867540017 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fea6c1e9940 msgr2=0x7fea6c158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:34.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.620+0000 7fea63e00640 1 --2- 172.21.15.42:0/3867540017 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fea6c1e9940 0x7fea6c158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.620+0000 7fea63e00640 1 -- 172.21.15.42:0/3867540017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea6c0afb00 msgr2=0x7fea6c1f95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:34.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.620+0000 7fea63e00640 1 --2- 172.21.15.42:0/3867540017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea6c0afb00 0x7fea6c1f95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.620+0000 7fea63e00640 1 -- 172.21.15.42:0/3867540017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea6c1f56d0 con 0x7fea6c0b51d0 2024-09-17T01:49:34.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.620+0000 7fea63e00640 1 --2- 172.21.15.42:0/3867540017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea6c0b51d0 0x7fea6c1f28c0 secure :-1 s=READY pgs=2581 cs=0 l=1 rev1=1 crypto rx=0x7fea5400c3d0 tx=0x7fea5400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:34.619 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.620+0000 7fea62a00640 1 -- 172.21.15.42:0/3867540017 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea54017070 con 0x7fea6c0b51d0 2024-09-17T01:49:34.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.620+0000 7fea62a00640 1 -- 172.21.15.42:0/3867540017 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea540053c0 con 0x7fea6c0b51d0 2024-09-17T01:49:34.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.620+0000 7fea6be00640 1 -- 172.21.15.42:0/3867540017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea6c1f59b0 con 0x7fea6c0b51d0 2024-09-17T01:49:34.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.621+0000 7fea62a00640 1 -- 172.21.15.42:0/3867540017 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea54003850 con 0x7fea6c0b51d0 2024-09-17T01:49:34.620 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.621+0000 7fea6be00640 1 -- 172.21.15.42:0/3867540017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea6c1f5f70 con 0x7fea6c0b51d0 2024-09-17T01:49:34.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.623+0000 7fea62a00640 1 -- 172.21.15.42:0/3867540017 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fea5401a070 con 0x7fea6c0b51d0 2024-09-17T01:49:34.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.624+0000 7fea62a00640 1 --2- 172.21.15.42:0/3867540017 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fea48078bc0 0x7fea4807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.624+0000 7fea62a00640 1 -- 172.21.15.42:0/3867540017 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7fea5409a100 con 0x7fea6c0b51d0 2024-09-17T01:49:34.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.624+0000 7fea78be7740 1 Processor -- start 2024-09-17T01:49:34.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.625+0000 7fea6aa00640 1 --2- 172.21.15.42:0/3867540017 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fea48078bc0 0x7fea4807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.625+0000 7fea78be7740 1 -- start start 2024-09-17T01:49:34.623 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.625+0000 7fea6aa00640 1 --2- 172.21.15.42:0/3867540017 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fea48078bc0 0x7fea4807b0d0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fea5c0046b0 tx=0x7fea5c007eb0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:34.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.626+0000 7fea78be7740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607a86cc270 0x5607a8a9cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.626+0000 7fea78be7740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5607a86a33b0 0x5607a8a9d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.624 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.626+0000 7fea78be7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86ab590 0x5607a8a6d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.626+0000 7fea78be7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5607a89f6430 con 0x5607a86ab590 2024-09-17T01:49:34.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.626+0000 7fea78be7740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5607a89e65d0 con 0x5607a86cc270 2024-09-17T01:49:34.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.626+0000 7fea78be7740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5607a89d5a00 con 0x5607a86a33b0 2024-09-17T01:49:34.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.627+0000 7fea6b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86ab590 0x5607a8a6d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.627+0000 7fea63e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5607a86a33b0 0x5607a8a9d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.627+0000 7fea6b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86ab590 0x5607a8a6d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40566/0 (socket says 172.21.15.42:40566) 2024-09-17T01:49:34.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.627+0000 7fea6b400640 1 -- 172.21.15.42:0/3352299362 learned_addr learned my addr 172.21.15.42:0/3352299362 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:34.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.627+0000 7fea6aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607a86cc270 0x5607a8a9cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.626 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.627+0000 7fea6b400640 1 -- 172.21.15.42:0/3352299362 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5607a86a33b0 msgr2=0x5607a8a9d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:34.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.627+0000 7fea6b400640 1 --2- 172.21.15.42:0/3352299362 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5607a86a33b0 0x5607a8a9d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.627+0000 7fea6b400640 1 -- 172.21.15.42:0/3352299362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607a86cc270 msgr2=0x5607a8a9cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:34.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.627+0000 7fea6b400640 1 --2- 172.21.15.42:0/3352299362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607a86cc270 0x5607a8a9cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.627+0000 7fea6b400640 1 -- 172.21.15.42:0/3352299362 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607a899e520 con 0x5607a86ab590 2024-09-17T01:49:34.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.627+0000 7fea6b400640 1 --2- 172.21.15.42:0/3352299362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86ab590 0x5607a8a6d150 secure :-1 s=READY pgs=2582 cs=0 l=1 rev1=1 crypto rx=0x7fea6402aea0 tx=0x7fea64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3ce319b1d106ab server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:34.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.628+0000 7fea5b400640 1 -- 172.21.15.42:0/3352299362 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea64004040 con 0x5607a86ab590 2024-09-17T01:49:34.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.628+0000 7fea5b400640 1 -- 172.21.15.42:0/3352299362 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea640042d0 con 0x5607a86ab590 2024-09-17T01:49:34.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.628+0000 7fea5b400640 1 -- 172.21.15.42:0/3352299362 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea640046e0 con 0x5607a86ab590 2024-09-17T01:49:34.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.628+0000 7fea78be7740 1 -- 172.21.15.42:0/3352299362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86ab590 msgr2=0x5607a8a6d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:34.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.628+0000 7fea78be7740 1 --2- 172.21.15.42:0/3352299362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86ab590 0x5607a8a6d150 secure :-1 s=READY pgs=2582 cs=0 l=1 rev1=1 crypto rx=0x7fea6402aea0 tx=0x7fea64004a40 comp rx=0 tx=0).stop 2024-09-17T01:49:34.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.629+0000 7fea78be7740 1 -- 172.21.15.42:0/3352299362 shutdown_connections 2024-09-17T01:49:34.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.629+0000 7fea78be7740 1 --2- 172.21.15.42:0/3352299362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86ab590 0x5607a8a6d150 unknown :-1 s=CLOSED pgs=2582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.627 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.629+0000 7fea78be7740 1 --2- 172.21.15.42:0/3352299362 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5607a86a33b0 0x5607a8a9d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.629+0000 7fea78be7740 1 --2- 172.21.15.42:0/3352299362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607a86cc270 0x5607a8a9cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.629+0000 7fea78be7740 1 -- 172.21.15.42:0/3352299362 >> 172.21.15.42:0/3352299362 conn(0x5607a86c03c0 msgr2=0x5607a8a72b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:34.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.629+0000 7fea78be7740 1 -- 172.21.15.42:0/3352299362 shutdown_connections 2024-09-17T01:49:34.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.629+0000 7fea78be7740 1 -- 172.21.15.42:0/3352299362 wait complete. 2024-09-17T01:49:34.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.630+0000 7fea78be7740 1 -- start start 2024-09-17T01:49:34.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.630+0000 7fea78be7740 1 Processor -- start 2024-09-17T01:49:34.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.631+0000 7fea78be7740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5607a86a33b0 0x5607a8a80ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.631+0000 7fea78be7740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607a86ab590 0x5607a8aca600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.631+0000 7fea78be7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86cc270 0x5607a8ab9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.631+0000 7fea78be7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5607a897c330 con 0x5607a86cc270 2024-09-17T01:49:34.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.632+0000 7fea78be7740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5607a89d9810 con 0x5607a86ab590 2024-09-17T01:49:34.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.632+0000 7fea78be7740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5607a8746620 con 0x5607a86a33b0 2024-09-17T01:49:34.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.632+0000 7fea78be7740 10 client.0 _ll_register_callbacks cb 0x5607a8981420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:49:34.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.632+0000 7fea6b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86cc270 0x5607a8ab9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.632+0000 7fea6aa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5607a86a33b0 0x5607a8a80ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.632+0000 7fea6aa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5607a86a33b0 0x5607a8a80ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:57826/0 (socket says 172.21.15.42:57826) 2024-09-17T01:49:34.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.632+0000 7fea6b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86cc270 0x5607a8ab9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40576/0 (socket says 172.21.15.42:40576) 2024-09-17T01:49:34.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.632+0000 7fea6aa00640 1 -- 172.21.15.42:0/3164041753 learned_addr learned my addr 172.21.15.42:0/3164041753 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:34.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.632+0000 7fea63e00640 1 --2- 172.21.15.42:0/3164041753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607a86ab590 0x5607a8aca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.632+0000 7fea6b400640 1 -- 172.21.15.42:0/3164041753 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5607a86a33b0 msgr2=0x5607a8a80ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:34.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.632+0000 7fea6b400640 1 --2- 172.21.15.42:0/3164041753 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5607a86a33b0 0x5607a8a80ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.632+0000 7fea6b400640 1 -- 172.21.15.42:0/3164041753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607a86ab590 msgr2=0x5607a8aca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:34.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.632+0000 7fea6b400640 1 --2- 172.21.15.42:0/3164041753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607a86ab590 0x5607a8aca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.632+0000 7fea6b400640 1 -- 172.21.15.42:0/3164041753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607a8737850 con 0x5607a86cc270 2024-09-17T01:49:34.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.633+0000 7fea6b400640 1 --2- 172.21.15.42:0/3164041753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86cc270 0x5607a8ab9f60 secure :-1 s=READY pgs=2583 cs=0 l=1 rev1=1 crypto rx=0x7fea64009cd0 tx=0x7fea64003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4d3f4d29bc175c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:34.632 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.633+0000 7fea4fe00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:49:34.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.635+0000 7fea4fe00640 1 -- 172.21.15.42:0/3164041753 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6404d020 con 0x5607a86cc270 2024-09-17T01:49:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.635+0000 7fea78be7740 1 -- 172.21.15.42:0/3164041753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea640042d0 con 0x5607a86cc270 2024-09-17T01:49:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.635+0000 7fea4fe00640 1 -- 172.21.15.42:0/3164041753 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7fea64045440 con 0x5607a86cc270 2024-09-17T01:49:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.635+0000 7fea4fe00640 1 -- 172.21.15.42:0/3164041753 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=183) ==== 24+0+0 (secure 0 0 0) 0x7fea64045640 con 0x5607a86cc270 2024-09-17T01:49:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.635+0000 7fea78be7740 10 client.11730 fetch_fsmap learned FSMap version 183 2024-09-17T01:49:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.635+0000 7fea78be7740 1 -- 172.21.15.42:0/3164041753 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=183,monmap=2+}) -- 0x5607a87ae6b0 con 0x5607a86cc270 2024-09-17T01:49:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.635+0000 7fea4fe00640 1 -- 172.21.15.42:0/3164041753 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea640042d0 con 0x5607a86cc270 2024-09-17T01:49:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.635+0000 7fea4fe00640 1 -- 172.21.15.42:0/3164041753 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 183) ==== 3502+0+0 (secure 0 0 0) 0x7fea64043020 con 0x5607a86cc270 2024-09-17T01:49:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.635+0000 7fea78be7740 10 client.11730 fetch_fsmap finished waiting for FSMap version 183 2024-09-17T01:49:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.635+0000 7fea78be7740 10 client.11730 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T01:49:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.635+0000 7fea78be7740 20 client.11730 populate_metadata read hostname 'smithi042' 2024-09-17T01:49:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.635+0000 7fea78be7740 1 --2- 172.21.15.42:0/3164041753 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x5607a868ae40 0x5607a8a99290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.635+0000 7fea78be7740 4 client.11730 mds_command: new command op to 11517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:49:34.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.635+0000 7fea78be7740 1 -- 172.21.15.42:0/3164041753 --> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607a89e8520 con 0x5607a868ae40 2024-09-17T01:49:34.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.636+0000 7fea6aa00640 1 --2- 172.21.15.42:0/3164041753 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x5607a868ae40 0x5607a8a99290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.637+0000 7fea6aa00640 1 --2- 172.21.15.42:0/3164041753 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x5607a868ae40 0x5607a8a99290 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aaa12201c73c2a server_cookie=82f233604a4f4b9c in_seq=0 out_seq=0 2024-09-17T01:49:34.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.637+0000 7fea4fe00640 10 client.11730 ms_handle_connect on v2:172.21.15.43:6834/4082001755 2024-09-17T01:49:34.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.638+0000 7fea4fe00640 1 -- 172.21.15.42:0/3164041753 <== mds.0 v2:172.21.15.43:6834/4082001755 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5607a89e8520 con 0x5607a868ae40 2024-09-17T01:49:34.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.638+0000 7fea4fe00640 10 client.11730 handle_command_reply: tid=0 2024-09-17T01:49:34.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.638+0000 7fea78be7740 1 client.11730 shutdown 2024-09-17T01:49:34.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.638+0000 7fea78be7740 1 -- 172.21.15.42:0/3164041753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86cc270 msgr2=0x5607a8ab9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:34.636 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.638+0000 7fea78be7740 1 --2- 172.21.15.42:0/3164041753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86cc270 0x5607a8ab9f60 secure :-1 s=READY pgs=2583 cs=0 l=1 rev1=1 crypto rx=0x7fea64009cd0 tx=0x7fea64003970 comp rx=0 tx=0).stop 2024-09-17T01:49:34.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.638+0000 7fea78be7740 1 -- 172.21.15.42:0/3164041753 shutdown_connections 2024-09-17T01:49:34.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.638+0000 7fea78be7740 1 --2- 172.21.15.42:0/3164041753 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x5607a868ae40 0x5607a8a99290 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.638+0000 7fea78be7740 1 --2- 172.21.15.42:0/3164041753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607a86ab590 0x5607a8aca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.638+0000 7fea78be7740 1 --2- 172.21.15.42:0/3164041753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86cc270 0x5607a8ab9f60 unknown :-1 s=CLOSED pgs=2583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.638+0000 7fea78be7740 1 --2- 172.21.15.42:0/3164041753 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5607a86a33b0 0x5607a8a80ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.638+0000 7fea4fe00640 0 client.11730 ms_handle_reset on v2:172.21.15.43:6834/4082001755 2024-09-17T01:49:34.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.638+0000 7fea78be7740 1 -- 172.21.15.42:0/3164041753 >> 172.21.15.42:0/3164041753 conn(0x5607a86c03c0 msgr2=0x5607a8ab81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:34.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.638+0000 7fea78be7740 1 -- 172.21.15.42:0/3164041753 shutdown_connections 2024-09-17T01:49:34.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.638+0000 7fea78be7740 1 -- 172.21.15.42:0/3164041753 wait complete. 2024-09-17T01:49:34.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.639+0000 7fea78be7740 20 client.11730 trim_cache size 0 max 16384 2024-09-17T01:49:34.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.658+0000 7fea78be7740 1 Processor -- start 2024-09-17T01:49:34.656 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.658+0000 7fea78be7740 1 -- start start 2024-09-17T01:49:34.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.659+0000 7fea78be7740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607a86a33b0 0x5607a8a80a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.659+0000 7fea78be7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86ab590 0x5607a8a9b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.659+0000 7fea78be7740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5607a86cc270 0x5607a8a9b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.659+0000 7fea78be7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fea6c157ce0 con 0x5607a86ab590 2024-09-17T01:49:34.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.659+0000 7fea78be7740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fea6c144a00 con 0x5607a86a33b0 2024-09-17T01:49:34.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.659+0000 7fea78be7740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fea6c157690 con 0x5607a86cc270 2024-09-17T01:49:34.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.660+0000 7fea63e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86ab590 0x5607a8a9b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.660+0000 7fea63e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86ab590 0x5607a8a9b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40590/0 (socket says 172.21.15.42:40590) 2024-09-17T01:49:34.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.660+0000 7fea63e00640 1 -- 172.21.15.42:0/3889218566 learned_addr learned my addr 172.21.15.42:0/3889218566 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:34.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.660+0000 7fea6b400640 1 --2- 172.21.15.42:0/3889218566 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5607a86cc270 0x5607a8a9b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.660+0000 7fea6aa00640 1 --2- 172.21.15.42:0/3889218566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607a86a33b0 0x5607a8a80a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.660+0000 7fea63e00640 1 -- 172.21.15.42:0/3889218566 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5607a86cc270 msgr2=0x5607a8a9b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:34.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.660+0000 7fea63e00640 1 --2- 172.21.15.42:0/3889218566 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5607a86cc270 0x5607a8a9b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.660+0000 7fea63e00640 1 -- 172.21.15.42:0/3889218566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607a86a33b0 msgr2=0x5607a8a80a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:34.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.660+0000 7fea63e00640 1 --2- 172.21.15.42:0/3889218566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607a86a33b0 0x5607a8a80a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.660+0000 7fea63e00640 1 -- 172.21.15.42:0/3889218566 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607a8a83af0 con 0x5607a86ab590 2024-09-17T01:49:34.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.660+0000 7fea6aa00640 1 --2- 172.21.15.42:0/3889218566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607a86a33b0 0x5607a8a80a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:49:34.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.660+0000 7fea63e00640 1 --2- 172.21.15.42:0/3889218566 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86ab590 0x5607a8a9b030 secure :-1 s=READY pgs=2584 cs=0 l=1 rev1=1 crypto rx=0x7fea540984d0 tx=0x7fea54014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7866920d4a64e426 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:34.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.660+0000 7fea5aa00640 1 -- 172.21.15.42:0/3889218566 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5407c070 con 0x5607a86ab590 2024-09-17T01:49:34.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.660+0000 7fea5aa00640 1 -- 172.21.15.42:0/3889218566 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea54066820 con 0x5607a86ab590 2024-09-17T01:49:34.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.660+0000 7fea5aa00640 1 -- 172.21.15.42:0/3889218566 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea540612b0 con 0x5607a86ab590 2024-09-17T01:49:34.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.661+0000 7fea78be7740 1 -- 172.21.15.42:0/3889218566 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86ab590 msgr2=0x5607a8a9b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:34.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.661+0000 7fea78be7740 1 --2- 172.21.15.42:0/3889218566 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86ab590 0x5607a8a9b030 secure :-1 s=READY pgs=2584 cs=0 l=1 rev1=1 crypto rx=0x7fea540984d0 tx=0x7fea54014040 comp rx=0 tx=0).stop 2024-09-17T01:49:34.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.661+0000 7fea78be7740 1 -- 172.21.15.42:0/3889218566 shutdown_connections 2024-09-17T01:49:34.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.661+0000 7fea78be7740 1 --2- 172.21.15.42:0/3889218566 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5607a86cc270 0x5607a8a9b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.661+0000 7fea78be7740 1 --2- 172.21.15.42:0/3889218566 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86ab590 0x5607a8a9b030 unknown :-1 s=CLOSED pgs=2584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.661+0000 7fea78be7740 1 --2- 172.21.15.42:0/3889218566 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607a86a33b0 0x5607a8a80a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.661+0000 7fea78be7740 1 -- 172.21.15.42:0/3889218566 >> 172.21.15.42:0/3889218566 conn(0x5607a86c03c0 msgr2=0x5607a8ab2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:34.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.661+0000 7fea78be7740 1 -- 172.21.15.42:0/3889218566 shutdown_connections 2024-09-17T01:49:34.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.661+0000 7fea78be7740 1 -- 172.21.15.42:0/3889218566 wait complete. 2024-09-17T01:49:34.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.662+0000 7fea78be7740 1 -- start start 2024-09-17T01:49:34.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.663+0000 7fea78be7740 1 Processor -- start 2024-09-17T01:49:34.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.664+0000 7fea78be7740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5607a86a33b0 0x5607a8b1cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.664+0000 7fea78be7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86ab590 0x5607a8ac98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.664+0000 7fea78be7740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607a86cc270 0x5607a8ac9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.664+0000 7fea78be7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5607a8a81a70 con 0x5607a86ab590 2024-09-17T01:49:34.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.664+0000 7fea78be7740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5607a897c330 con 0x5607a86cc270 2024-09-17T01:49:34.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.664+0000 7fea78be7740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5607a8acac30 con 0x5607a86a33b0 2024-09-17T01:49:34.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.664+0000 7fea78be7740 10 client.0 _ll_register_callbacks cb 0x7fea5c001d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:49:34.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.664+0000 7fea63e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86ab590 0x5607a8ac98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.664+0000 7fea63e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86ab590 0x5607a8ac98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40602/0 (socket says 172.21.15.42:40602) 2024-09-17T01:49:34.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.664+0000 7fea63e00640 1 -- 172.21.15.42:0/1346287165 learned_addr learned my addr 172.21.15.42:0/1346287165 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:34.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.665+0000 7fea6aa00640 1 --2- 172.21.15.42:0/1346287165 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5607a86a33b0 0x5607a8b1cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.665+0000 7fea6b400640 1 --2- 172.21.15.42:0/1346287165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607a86cc270 0x5607a8ac9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.665+0000 7fea63e00640 1 -- 172.21.15.42:0/1346287165 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5607a86a33b0 msgr2=0x5607a8b1cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:34.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.665+0000 7fea63e00640 1 --2- 172.21.15.42:0/1346287165 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5607a86a33b0 0x5607a8b1cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.665+0000 7fea63e00640 1 -- 172.21.15.42:0/1346287165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607a86cc270 msgr2=0x5607a8ac9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:34.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.665+0000 7fea63e00640 1 --2- 172.21.15.42:0/1346287165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607a86cc270 0x5607a8ac9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.665+0000 7fea63e00640 1 -- 172.21.15.42:0/1346287165 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607a8b1feb0 con 0x5607a86ab590 2024-09-17T01:49:34.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.665+0000 7fea63e00640 1 --2- 172.21.15.42:0/1346287165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86ab590 0x5607a8ac98e0 secure :-1 s=READY pgs=2585 cs=0 l=1 rev1=1 crypto rx=0x7fea54061af0 tx=0x7fea54061280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ebd20c4eaa34ec server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:34.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.665+0000 7fea4fe00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:49:34.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.665+0000 7fea4fe00640 1 -- 172.21.15.42:0/1346287165 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5407c040 con 0x5607a86ab590 2024-09-17T01:49:34.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.665+0000 7fea4fe00640 1 -- 172.21.15.42:0/1346287165 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7fea54069ba0 con 0x5607a86ab590 2024-09-17T01:49:34.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.665+0000 7fea78be7740 1 -- 172.21.15.42:0/1346287165 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea54066820 con 0x5607a86ab590 2024-09-17T01:49:34.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.666+0000 7fea4fe00640 1 -- 172.21.15.42:0/1346287165 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=183) ==== 24+0+0 (secure 0 0 0) 0x7fea5406b760 con 0x5607a86ab590 2024-09-17T01:49:34.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.666+0000 7fea78be7740 10 client.11736 fetch_fsmap learned FSMap version 183 2024-09-17T01:49:34.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.666+0000 7fea78be7740 1 -- 172.21.15.42:0/1346287165 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=183,monmap=2+}) -- 0x5607a8a93160 con 0x5607a86ab590 2024-09-17T01:49:34.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.666+0000 7fea4fe00640 1 -- 172.21.15.42:0/1346287165 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea54066820 con 0x5607a86ab590 2024-09-17T01:49:34.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.666+0000 7fea4fe00640 1 -- 172.21.15.42:0/1346287165 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 183) ==== 3502+0+0 (secure 0 0 0) 0x7fea5405d740 con 0x5607a86ab590 2024-09-17T01:49:34.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.666+0000 7fea78be7740 10 client.11736 fetch_fsmap finished waiting for FSMap version 183 2024-09-17T01:49:34.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.666+0000 7fea78be7740 10 client.11736 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T01:49:34.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.666+0000 7fea78be7740 20 client.11736 populate_metadata read hostname 'smithi042' 2024-09-17T01:49:34.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.666+0000 7fea78be7740 1 --2- 172.21.15.42:0/1346287165 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x5607a8ad0890 0x5607a8ad0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.666+0000 7fea78be7740 4 client.11736 mds_command: new command op to 11517 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T01:49:34.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.666+0000 7fea78be7740 1 -- 172.21.15.42:0/1346287165 --> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] -- command(tid 0: {"prefix": "status"}) -- 0x5607a89e3fd0 con 0x5607a8ad0890 2024-09-17T01:49:34.667 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.666+0000 7fea6aa00640 1 --2- 172.21.15.42:0/1346287165 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x5607a8ad0890 0x5607a8ad0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.667+0000 7fea6aa00640 1 --2- 172.21.15.42:0/1346287165 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x5607a8ad0890 0x5607a8ad0ca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=951031ec603cd84f server_cookie=a8e676f6c1814131 in_seq=0 out_seq=0 2024-09-17T01:49:34.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.667+0000 7fea4fe00640 10 client.11736 ms_handle_connect on v2:172.21.15.43:6834/4082001755 2024-09-17T01:49:34.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.667+0000 7fea4fe00640 1 -- 172.21.15.42:0/1346287165 <== mds.0 v2:172.21.15.43:6834/4082001755 1 ==== command_reply(tid 0: 0 ) ==== 8+0+329 (crc 0 0 0) 0x5607a89e3fd0 con 0x5607a8ad0890 2024-09-17T01:49:34.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.667+0000 7fea4fe00640 10 client.11736 handle_command_reply: tid=0 2024-09-17T01:49:34.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.667+0000 7fea78be7740 1 client.11736 shutdown 2024-09-17T01:49:34.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.668+0000 7fea78be7740 1 -- 172.21.15.42:0/1346287165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86ab590 msgr2=0x5607a8ac98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:34.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.668+0000 7fea78be7740 1 --2- 172.21.15.42:0/1346287165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86ab590 0x5607a8ac98e0 secure :-1 s=READY pgs=2585 cs=0 l=1 rev1=1 crypto rx=0x7fea54061af0 tx=0x7fea54061280 comp rx=0 tx=0).stop 2024-09-17T01:49:34.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.668+0000 7fea78be7740 1 -- 172.21.15.42:0/1346287165 shutdown_connections 2024-09-17T01:49:34.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.668+0000 7fea78be7740 1 --2- 172.21.15.42:0/1346287165 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x5607a8ad0890 0x5607a8ad0ca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.668+0000 7fea78be7740 1 --2- 172.21.15.42:0/1346287165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607a86cc270 0x5607a8ac9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.668+0000 7fea78be7740 1 --2- 172.21.15.42:0/1346287165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5607a86ab590 0x5607a8ac98e0 unknown :-1 s=CLOSED pgs=2585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.668+0000 7fea4fe00640 0 client.11736 ms_handle_reset on v2:172.21.15.43:6834/4082001755 2024-09-17T01:49:34.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.668+0000 7fea78be7740 1 --2- 172.21.15.42:0/1346287165 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5607a86a33b0 0x5607a8b1cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.668+0000 7fea78be7740 1 -- 172.21.15.42:0/1346287165 >> 172.21.15.42:0/1346287165 conn(0x5607a86c03c0 msgr2=0x5607a8adb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:34.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.668+0000 7fea78be7740 1 -- 172.21.15.42:0/1346287165 shutdown_connections 2024-09-17T01:49:34.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.668+0000 7fea78be7740 1 -- 172.21.15.42:0/1346287165 wait complete. 2024-09-17T01:49:34.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.668+0000 7fea78be7740 20 client.11736 trim_cache size 0 max 16384 2024-09-17T01:49:34.670 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:49:34.670 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "fea1c88c-cb05-432f-a745-f9dcbb5f2503", 2024-09-17T01:49:34.670 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-17T01:49:34.670 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 11517, 2024-09-17T01:49:34.670 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-17T01:49:34.670 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-17T01:49:34.670 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-17T01:49:34.670 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 5.0532887750000004, 2024-09-17T01:49:34.670 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 183, 2024-09-17T01:49:34.670 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 227, 2024-09-17T01:49:34.671 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 227, 2024-09-17T01:49:34.671 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 22.967481608 2024-09-17T01:49:34.671 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:49:34.671 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.669+0000 7fea6be00640 1 -- 172.21.15.42:0/3867540017 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fea48078bc0 msgr2=0x7fea4807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:34.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.669+0000 7fea6be00640 1 --2- 172.21.15.42:0/3867540017 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fea48078bc0 0x7fea4807b0d0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fea5c0046b0 tx=0x7fea5c007eb0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.669+0000 7fea6be00640 1 -- 172.21.15.42:0/3867540017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea6c0b51d0 msgr2=0x7fea6c1f28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:34.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.669+0000 7fea6be00640 1 --2- 172.21.15.42:0/3867540017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea6c0b51d0 0x7fea6c1f28c0 secure :-1 s=READY pgs=2581 cs=0 l=1 rev1=1 crypto rx=0x7fea5400c3d0 tx=0x7fea5400c890 comp rx=0 tx=0).stop 2024-09-17T01:49:34.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.669+0000 7fea6be00640 1 -- 172.21.15.42:0/3867540017 shutdown_connections 2024-09-17T01:49:34.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.669+0000 7fea6be00640 1 --2- 172.21.15.42:0/3867540017 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fea48078bc0 0x7fea4807b0d0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.669+0000 7fea6be00640 1 --2- 172.21.15.42:0/3867540017 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fea6c1e9940 0x7fea6c158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.669+0000 7fea6be00640 1 --2- 172.21.15.42:0/3867540017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fea6c0b51d0 0x7fea6c1f28c0 unknown :-1 s=CLOSED pgs=2581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.669+0000 7fea6be00640 1 --2- 172.21.15.42:0/3867540017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea6c0afb00 0x7fea6c1f95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.669+0000 7fea6be00640 1 -- 172.21.15.42:0/3867540017 >> 172.21.15.42:0/3867540017 conn(0x7fea6c06d3f0 msgr2=0x7fea6c0cd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:34.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.669+0000 7fea6be00640 1 -- 172.21.15.42:0/3867540017 shutdown_connections 2024-09-17T01:49:34.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.669+0000 7fea6be00640 1 -- 172.21.15.42:0/3867540017 wait complete. 2024-09-17T01:49:34.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:34.692 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.16:0 scrub start / recursive,repair 2024-09-17T01:49:34.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.926+0000 7feb2f600640 1 -- 172.21.15.42:0/866911711 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb28160fb0 msgr2=0x7feb280cfbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:34.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.926+0000 7feb2f600640 1 --2- 172.21.15.42:0/866911711 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb28160fb0 0x7feb280cfbe0 secure :-1 s=READY pgs=2586 cs=0 l=1 rev1=1 crypto rx=0x7feb20005fd0 tx=0x7feb2002a970 comp rx=0 tx=0).stop 2024-09-17T01:49:34.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.927+0000 7feb2f600640 1 -- 172.21.15.42:0/866911711 shutdown_connections 2024-09-17T01:49:34.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.927+0000 7feb2f600640 1 --2- 172.21.15.42:0/866911711 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb28160fb0 0x7feb280cfbe0 unknown :-1 s=CLOSED pgs=2586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.927+0000 7feb2f600640 1 --2- 172.21.15.42:0/866911711 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feb280b3a40 0x7feb280b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.927+0000 7feb2f600640 1 -- 172.21.15.42:0/866911711 >> 172.21.15.42:0/866911711 conn(0x7feb2806d420 msgr2=0x7feb280b2430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:34.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.927+0000 7feb2f600640 1 -- 172.21.15.42:0/866911711 shutdown_connections 2024-09-17T01:49:34.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.927+0000 7feb2f600640 1 -- 172.21.15.42:0/866911711 wait complete. 2024-09-17T01:49:34.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.929+0000 7feb2f600640 1 Processor -- start 2024-09-17T01:49:34.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.929+0000 7feb2f600640 1 -- start start 2024-09-17T01:49:34.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.930+0000 7feb2f600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb280b3a40 0x7feb28144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.930+0000 7feb2f600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb280cf7d0 0x7feb281432d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.931+0000 7feb2f600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feb28143810 0x7feb28131db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.931+0000 7feb2f600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7feb2806fb00 con 0x7feb280cf7d0 2024-09-17T01:49:34.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.931+0000 7feb2f600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7feb2806f980 con 0x7feb280b3a40 2024-09-17T01:49:34.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.931+0000 7feb2f600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7feb2806fc80 con 0x7feb28143810 2024-09-17T01:49:34.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.931+0000 7feb1fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb280cf7d0 0x7feb281432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.931+0000 7feb1fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb280cf7d0 0x7feb281432d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40618/0 (socket says 172.21.15.42:40618) 2024-09-17T01:49:34.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.931+0000 7feb1fe00640 1 -- 172.21.15.42:0/4137719790 learned_addr learned my addr 172.21.15.42:0/4137719790 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:34.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.931+0000 7feb2cc00640 1 --2- 172.21.15.42:0/4137719790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb280b3a40 0x7feb28144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.931+0000 7feb2d600640 1 --2- 172.21.15.42:0/4137719790 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feb28143810 0x7feb28131db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.931+0000 7feb1fe00640 1 -- 172.21.15.42:0/4137719790 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feb28143810 msgr2=0x7feb28131db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:34.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.931+0000 7feb1fe00640 1 --2- 172.21.15.42:0/4137719790 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feb28143810 0x7feb28131db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.931+0000 7feb1fe00640 1 -- 172.21.15.42:0/4137719790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb280b3a40 msgr2=0x7feb28144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:34.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.931+0000 7feb1fe00640 1 --2- 172.21.15.42:0/4137719790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb280b3a40 0x7feb28144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.931+0000 7feb1fe00640 1 -- 172.21.15.42:0/4137719790 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb28143d00 con 0x7feb280cf7d0 2024-09-17T01:49:34.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.931+0000 7feb2d600640 1 --2- 172.21.15.42:0/4137719790 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feb28143810 0x7feb28131db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:49:34.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.932+0000 7feb1fe00640 1 --2- 172.21.15.42:0/4137719790 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb280cf7d0 0x7feb281432d0 secure :-1 s=READY pgs=2587 cs=0 l=1 rev1=1 crypto rx=0x7feb1000b3f0 tx=0x7feb1000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:34.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.932+0000 7feb25600640 1 -- 172.21.15.42:0/4137719790 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb10015020 con 0x7feb280cf7d0 2024-09-17T01:49:34.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.932+0000 7feb25600640 1 -- 172.21.15.42:0/4137719790 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb10011920 con 0x7feb280cf7d0 2024-09-17T01:49:34.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.932+0000 7feb25600640 1 -- 172.21.15.42:0/4137719790 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb10011d70 con 0x7feb280cf7d0 2024-09-17T01:49:34.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.932+0000 7feb2f600640 1 -- 172.21.15.42:0/4137719790 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb28143fe0 con 0x7feb280cf7d0 2024-09-17T01:49:34.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.932+0000 7feb2f600640 1 -- 172.21.15.42:0/4137719790 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb281445a0 con 0x7feb280cf7d0 2024-09-17T01:49:34.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.936+0000 7feb25600640 1 -- 172.21.15.42:0/4137719790 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feb10018020 con 0x7feb280cf7d0 2024-09-17T01:49:34.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.937+0000 7feb25600640 1 --2- 172.21.15.42:0/4137719790 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feb04078b90 0x7feb0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.937+0000 7feb36639740 1 Processor -- start 2024-09-17T01:49:34.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.937+0000 7feb25600640 1 -- 172.21.15.42:0/4137719790 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7feb1009a9c0 con 0x7feb280cf7d0 2024-09-17T01:49:34.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.937+0000 7feb36639740 1 -- start start 2024-09-17T01:49:34.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.937+0000 7feb2cc00640 1 --2- 172.21.15.42:0/4137719790 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feb04078b90 0x7feb0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.938+0000 7feb2cc00640 1 --2- 172.21.15.42:0/4137719790 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feb04078b90 0x7feb0407b0a0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7feb1800bb50 tx=0x7feb1800b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:34.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.938+0000 7feb36639740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557db18e410 0x5557db57d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.939+0000 7feb36639740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db165550 0x5557db55fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.939+0000 7feb36639740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5557db16d730 0x5557db5603a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.939+0000 7feb36639740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5557db4a8f40 con 0x5557db165550 2024-09-17T01:49:34.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.939+0000 7feb36639740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5557db498370 con 0x5557db18e410 2024-09-17T01:49:34.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.939+0000 7feb36639740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5557db49c180 con 0x5557db16d730 2024-09-17T01:49:34.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.939+0000 7feb1fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db165550 0x5557db55fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.939+0000 7feb1fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db165550 0x5557db55fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40628/0 (socket says 172.21.15.42:40628) 2024-09-17T01:49:34.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.939+0000 7feb1fe00640 1 -- 172.21.15.42:0/90345455 learned_addr learned my addr 172.21.15.42:0/90345455 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:34.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.939+0000 7feb2cc00640 1 --2- 172.21.15.42:0/90345455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557db18e410 0x5557db57d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.939+0000 7feb2d600640 1 --2- 172.21.15.42:0/90345455 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5557db16d730 0x5557db5603a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.939+0000 7feb1fe00640 1 -- 172.21.15.42:0/90345455 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5557db16d730 msgr2=0x5557db5603a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:34.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.939+0000 7feb1fe00640 1 --2- 172.21.15.42:0/90345455 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5557db16d730 0x5557db5603a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.939+0000 7feb1fe00640 1 -- 172.21.15.42:0/90345455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557db18e410 msgr2=0x5557db57d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:34.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.939+0000 7feb1fe00640 1 --2- 172.21.15.42:0/90345455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557db18e410 0x5557db57d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.939+0000 7feb1fe00640 1 -- 172.21.15.42:0/90345455 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557db18a470 con 0x5557db165550 2024-09-17T01:49:34.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.939+0000 7feb2cc00640 1 --2- 172.21.15.42:0/90345455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557db18e410 0x5557db57d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:49:34.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.939+0000 7feb1fe00640 1 --2- 172.21.15.42:0/90345455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db165550 0x5557db55fe60 secure :-1 s=READY pgs=2588 cs=0 l=1 rev1=1 crypto rx=0x7feb10062390 tx=0x7feb10062590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4ebf580eb10d9b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:34.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.940+0000 7feb1d200640 1 -- 172.21.15.42:0/90345455 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb10067170 con 0x5557db165550 2024-09-17T01:49:34.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.940+0000 7feb1d200640 1 -- 172.21.15.42:0/90345455 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb1006c020 con 0x5557db165550 2024-09-17T01:49:34.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.940+0000 7feb1d200640 1 -- 172.21.15.42:0/90345455 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1006b030 con 0x5557db165550 2024-09-17T01:49:34.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.940+0000 7feb36639740 1 -- 172.21.15.42:0/90345455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db165550 msgr2=0x5557db55fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:34.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.940+0000 7feb36639740 1 --2- 172.21.15.42:0/90345455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db165550 0x5557db55fe60 secure :-1 s=READY pgs=2588 cs=0 l=1 rev1=1 crypto rx=0x7feb10062390 tx=0x7feb10062590 comp rx=0 tx=0).stop 2024-09-17T01:49:34.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.941+0000 7feb36639740 1 -- 172.21.15.42:0/90345455 shutdown_connections 2024-09-17T01:49:34.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.941+0000 7feb36639740 1 --2- 172.21.15.42:0/90345455 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5557db16d730 0x5557db5603a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.941+0000 7feb36639740 1 --2- 172.21.15.42:0/90345455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db165550 0x5557db55fe60 unknown :-1 s=CLOSED pgs=2588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.941+0000 7feb36639740 1 --2- 172.21.15.42:0/90345455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557db18e410 0x5557db57d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.941+0000 7feb36639740 1 -- 172.21.15.42:0/90345455 >> 172.21.15.42:0/90345455 conn(0x5557db182560 msgr2=0x5557db536080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:34.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.941+0000 7feb36639740 1 -- 172.21.15.42:0/90345455 shutdown_connections 2024-09-17T01:49:34.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.941+0000 7feb36639740 1 -- 172.21.15.42:0/90345455 wait complete. 2024-09-17T01:49:34.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.942+0000 7feb36639740 1 -- start start 2024-09-17T01:49:34.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.942+0000 7feb36639740 1 Processor -- start 2024-09-17T01:49:34.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.943+0000 7feb36639740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5557db165550 0x5557db57b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.943+0000 7feb36639740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db16d730 0x5557db54e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.943+0000 7feb36639740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557db18e410 0x5557db535400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.943+0000 7feb36639740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5557db2087c0 con 0x5557db16d730 2024-09-17T01:49:34.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.943+0000 7feb36639740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5557db43dae0 con 0x5557db18e410 2024-09-17T01:49:34.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.943+0000 7feb36639740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5557db578b30 con 0x5557db165550 2024-09-17T01:49:34.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.944+0000 7feb36639740 10 client.0 _ll_register_callbacks cb 0x5557db44d5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:49:34.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.944+0000 7feb1fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db16d730 0x5557db54e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.944+0000 7feb1fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db16d730 0x5557db54e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40632/0 (socket says 172.21.15.42:40632) 2024-09-17T01:49:34.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.944+0000 7feb1fe00640 1 -- 172.21.15.42:0/263971343 learned_addr learned my addr 172.21.15.42:0/263971343 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:34.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.944+0000 7feb2cc00640 1 --2- 172.21.15.42:0/263971343 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5557db165550 0x5557db57b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.944+0000 7feb2d600640 1 --2- 172.21.15.42:0/263971343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557db18e410 0x5557db535400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.944+0000 7feb1fe00640 1 -- 172.21.15.42:0/263971343 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5557db165550 msgr2=0x5557db57b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:34.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.944+0000 7feb1fe00640 1 --2- 172.21.15.42:0/263971343 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5557db165550 0x5557db57b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.944+0000 7feb1fe00640 1 -- 172.21.15.42:0/263971343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557db18e410 msgr2=0x5557db535400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:34.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.944+0000 7feb1fe00640 1 --2- 172.21.15.42:0/263971343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557db18e410 0x5557db535400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.944+0000 7feb1fe00640 1 -- 172.21.15.42:0/263971343 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557db26e7e0 con 0x5557db16d730 2024-09-17T01:49:34.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.944+0000 7feb2cc00640 1 --2- 172.21.15.42:0/263971343 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5557db165550 0x5557db57b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:49:34.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.944+0000 7feb1fe00640 1 --2- 172.21.15.42:0/263971343 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db16d730 0x5557db54e610 secure :-1 s=READY pgs=2589 cs=0 l=1 rev1=1 crypto rx=0x7feb10062390 tx=0x7feb1005ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a359418e645b51ca server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:34.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.944+0000 7feb15600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:49:34.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.945+0000 7feb15600640 1 -- 172.21.15.42:0/263971343 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1006b240 con 0x5557db16d730 2024-09-17T01:49:34.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.945+0000 7feb15600640 1 -- 172.21.15.42:0/263971343 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7feb100618f0 con 0x5557db16d730 2024-09-17T01:49:34.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.945+0000 7feb36639740 1 -- 172.21.15.42:0/263971343 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb1006c020 con 0x5557db16d730 2024-09-17T01:49:34.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.945+0000 7feb15600640 1 -- 172.21.15.42:0/263971343 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=183) ==== 24+0+0 (secure 0 0 0) 0x7feb10061af0 con 0x5557db16d730 2024-09-17T01:49:34.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.945+0000 7feb36639740 10 client.11748 fetch_fsmap learned FSMap version 183 2024-09-17T01:49:34.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.945+0000 7feb36639740 1 -- 172.21.15.42:0/263971343 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=183,monmap=2+}) -- 0x5557db2cef70 con 0x5557db16d730 2024-09-17T01:49:34.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.945+0000 7feb15600640 1 -- 172.21.15.42:0/263971343 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb1006c020 con 0x5557db16d730 2024-09-17T01:49:34.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.945+0000 7feb15600640 1 -- 172.21.15.42:0/263971343 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 183) ==== 3502+0+0 (secure 0 0 0) 0x7feb1007cb50 con 0x5557db16d730 2024-09-17T01:49:34.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.945+0000 7feb36639740 10 client.11748 fetch_fsmap finished waiting for FSMap version 183 2024-09-17T01:49:34.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.945+0000 7feb36639740 10 client.11748 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.d 2024-09-17T01:49:34.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.945+0000 7feb36639740 20 client.11748 populate_metadata read hostname 'smithi042' 2024-09-17T01:49:34.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.945+0000 7feb36639740 1 --2- 172.21.15.42:0/263971343 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x5557db14d1f0 0x5557db58d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.945+0000 7feb36639740 4 client.11748 mds_command: new command op to 11517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:49:34.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.945+0000 7feb36639740 1 -- 172.21.15.42:0/263971343 --> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557db4aae90 con 0x5557db14d1f0 2024-09-17T01:49:34.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.946+0000 7feb2cc00640 1 --2- 172.21.15.42:0/263971343 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x5557db14d1f0 0x5557db58d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.946+0000 7feb2cc00640 1 --2- 172.21.15.42:0/263971343 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x5557db14d1f0 0x5557db58d330 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdb96ac73940ca90 server_cookie=fffbdf1de1feb162 in_seq=0 out_seq=0 2024-09-17T01:49:34.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.946+0000 7feb15600640 10 client.11748 ms_handle_connect on v2:172.21.15.43:6834/4082001755 2024-09-17T01:49:34.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.947+0000 7feb15600640 1 -- 172.21.15.42:0/263971343 <== mds.0 v2:172.21.15.43:6834/4082001755 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5557db4aae90 con 0x5557db14d1f0 2024-09-17T01:49:34.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.947+0000 7feb15600640 10 client.11748 handle_command_reply: tid=0 2024-09-17T01:49:34.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.948+0000 7feb36639740 1 client.11748 shutdown 2024-09-17T01:49:34.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.948+0000 7feb36639740 1 -- 172.21.15.42:0/263971343 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db16d730 msgr2=0x5557db54e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:34.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.948+0000 7feb36639740 1 --2- 172.21.15.42:0/263971343 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db16d730 0x5557db54e610 secure :-1 s=READY pgs=2589 cs=0 l=1 rev1=1 crypto rx=0x7feb10062390 tx=0x7feb1005ebb0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.948+0000 7feb36639740 1 -- 172.21.15.42:0/263971343 shutdown_connections 2024-09-17T01:49:34.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.948+0000 7feb36639740 1 --2- 172.21.15.42:0/263971343 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x5557db14d1f0 0x5557db58d330 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.948+0000 7feb36639740 1 --2- 172.21.15.42:0/263971343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557db18e410 0x5557db535400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.948+0000 7feb36639740 1 --2- 172.21.15.42:0/263971343 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db16d730 0x5557db54e610 unknown :-1 s=CLOSED pgs=2589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.948+0000 7feb36639740 1 --2- 172.21.15.42:0/263971343 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5557db165550 0x5557db57b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.948+0000 7feb15600640 0 client.11748 ms_handle_reset on v2:172.21.15.43:6834/4082001755 2024-09-17T01:49:34.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.948+0000 7feb36639740 1 -- 172.21.15.42:0/263971343 >> 172.21.15.42:0/263971343 conn(0x5557db182560 msgr2=0x5557db57e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:34.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.948+0000 7feb36639740 1 -- 172.21.15.42:0/263971343 shutdown_connections 2024-09-17T01:49:34.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.948+0000 7feb36639740 1 -- 172.21.15.42:0/263971343 wait complete. 2024-09-17T01:49:34.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.948+0000 7feb36639740 20 client.11748 trim_cache size 0 max 16384 2024-09-17T01:49:34.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.967+0000 7feb36639740 1 Processor -- start 2024-09-17T01:49:34.965 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.967+0000 7feb36639740 1 -- start start 2024-09-17T01:49:34.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.968+0000 7feb36639740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557db165550 0x5557db536f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.969+0000 7feb36639740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5557db16d730 0x5557db5374c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.969+0000 7feb36639740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db18e410 0x5557db59d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.969+0000 7feb36639740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7feb28202460 con 0x5557db18e410 2024-09-17T01:49:34.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.969+0000 7feb36639740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7feb282014c0 con 0x5557db165550 2024-09-17T01:49:34.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.969+0000 7feb36639740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7feb281f9da0 con 0x5557db16d730 2024-09-17T01:49:34.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.969+0000 7feb2d600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db18e410 0x5557db59d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.969+0000 7feb2d600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db18e410 0x5557db59d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40636/0 (socket says 172.21.15.42:40636) 2024-09-17T01:49:34.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.969+0000 7feb2d600640 1 -- 172.21.15.42:0/1884036224 learned_addr learned my addr 172.21.15.42:0/1884036224 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:34.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.969+0000 7feb1fe00640 1 --2- 172.21.15.42:0/1884036224 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5557db16d730 0x5557db5374c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.969+0000 7feb2cc00640 1 --2- 172.21.15.42:0/1884036224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557db165550 0x5557db536f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.969+0000 7feb2d600640 1 -- 172.21.15.42:0/1884036224 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5557db16d730 msgr2=0x5557db5374c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:34.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.969+0000 7feb2d600640 1 --2- 172.21.15.42:0/1884036224 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5557db16d730 0x5557db5374c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.969+0000 7feb2d600640 1 -- 172.21.15.42:0/1884036224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557db165550 msgr2=0x5557db536f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:34.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.969+0000 7feb2d600640 1 --2- 172.21.15.42:0/1884036224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557db165550 0x5557db536f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.969+0000 7feb2d600640 1 -- 172.21.15.42:0/1884036224 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557db1d7720 con 0x5557db18e410 2024-09-17T01:49:34.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.970+0000 7feb2d600640 1 --2- 172.21.15.42:0/1884036224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db18e410 0x5557db59d6f0 secure :-1 s=READY pgs=2590 cs=0 l=1 rev1=1 crypto rx=0x7feb2002af60 tx=0x7feb20004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a125d2b8efeab2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:34.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.970+0000 7feb17e00640 1 -- 172.21.15.42:0/1884036224 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2004a070 con 0x5557db18e410 2024-09-17T01:49:34.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.970+0000 7feb17e00640 1 -- 172.21.15.42:0/1884036224 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb20003b70 con 0x5557db18e410 2024-09-17T01:49:34.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.970+0000 7feb17e00640 1 -- 172.21.15.42:0/1884036224 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb20034040 con 0x5557db18e410 2024-09-17T01:49:34.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.971+0000 7feb36639740 1 -- 172.21.15.42:0/1884036224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db18e410 msgr2=0x5557db59d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:34.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.971+0000 7feb36639740 1 --2- 172.21.15.42:0/1884036224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db18e410 0x5557db59d6f0 secure :-1 s=READY pgs=2590 cs=0 l=1 rev1=1 crypto rx=0x7feb2002af60 tx=0x7feb20004ab0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.971+0000 7feb36639740 1 -- 172.21.15.42:0/1884036224 shutdown_connections 2024-09-17T01:49:34.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.971+0000 7feb36639740 1 --2- 172.21.15.42:0/1884036224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db18e410 0x5557db59d6f0 unknown :-1 s=CLOSED pgs=2590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.971+0000 7feb36639740 1 --2- 172.21.15.42:0/1884036224 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5557db16d730 0x5557db5374c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.971+0000 7feb36639740 1 --2- 172.21.15.42:0/1884036224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557db165550 0x5557db536f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.971+0000 7feb36639740 1 -- 172.21.15.42:0/1884036224 >> 172.21.15.42:0/1884036224 conn(0x5557db182560 msgr2=0x5557db57e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:34.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.971+0000 7feb36639740 1 -- 172.21.15.42:0/1884036224 shutdown_connections 2024-09-17T01:49:34.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.971+0000 7feb36639740 1 -- 172.21.15.42:0/1884036224 wait complete. 2024-09-17T01:49:34.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.972+0000 7feb36639740 1 -- start start 2024-09-17T01:49:34.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.972+0000 7feb36639740 1 Processor -- start 2024-09-17T01:49:34.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.973+0000 7feb36639740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5557db165550 0x5557db5fa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.973+0000 7feb36639740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557db16d730 0x5557db59db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.973+0000 7feb36639740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db18e410 0x5557db59e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.973+0000 7feb36639740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7feb28134990 con 0x5557db18e410 2024-09-17T01:49:34.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.973+0000 7feb36639740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5557db5794a0 con 0x5557db16d730 2024-09-17T01:49:34.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.973+0000 7feb36639740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x5557db573c00 con 0x5557db165550 2024-09-17T01:49:34.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.974+0000 7feb36639740 10 client.0 _ll_register_callbacks cb 0x7feb10088070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:49:34.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.974+0000 7feb2d600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db18e410 0x5557db59e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.974+0000 7feb2d600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db18e410 0x5557db59e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40648/0 (socket says 172.21.15.42:40648) 2024-09-17T01:49:34.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.974+0000 7feb2d600640 1 -- 172.21.15.42:0/1969806126 learned_addr learned my addr 172.21.15.42:0/1969806126 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:34.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.974+0000 7feb1fe00640 1 --2- 172.21.15.42:0/1969806126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557db16d730 0x5557db59db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.974+0000 7feb2cc00640 1 --2- 172.21.15.42:0/1969806126 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5557db165550 0x5557db5fa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.974+0000 7feb2d600640 1 -- 172.21.15.42:0/1969806126 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5557db165550 msgr2=0x5557db5fa2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:34.974 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.974+0000 7feb2d600640 1 --2- 172.21.15.42:0/1969806126 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5557db165550 0x5557db5fa2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.974+0000 7feb2d600640 1 -- 172.21.15.42:0/1969806126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557db16d730 msgr2=0x5557db59db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:34.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.974+0000 7feb2d600640 1 --2- 172.21.15.42:0/1969806126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557db16d730 0x5557db59db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.974+0000 7feb2d600640 1 -- 172.21.15.42:0/1969806126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557db533e10 con 0x5557db18e410 2024-09-17T01:49:34.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.975+0000 7feb2d600640 1 --2- 172.21.15.42:0/1969806126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db18e410 0x5557db59e070 secure :-1 s=READY pgs=2591 cs=0 l=1 rev1=1 crypto rx=0x7feb20006010 tx=0x7feb20030b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa09f2695e0c16f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:34.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.975+0000 7feb15600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:49:34.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.975+0000 7feb15600640 1 -- 172.21.15.42:0/1969806126 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2004a070 con 0x5557db18e410 2024-09-17T01:49:34.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.975+0000 7feb15600640 1 -- 172.21.15.42:0/1969806126 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7feb20045680 con 0x5557db18e410 2024-09-17T01:49:34.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.975+0000 7feb36639740 1 -- 172.21.15.42:0/1969806126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb20003b70 con 0x5557db18e410 2024-09-17T01:49:34.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.975+0000 7feb15600640 1 -- 172.21.15.42:0/1969806126 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=183) ==== 24+0+0 (secure 0 0 0) 0x7feb20034050 con 0x5557db18e410 2024-09-17T01:49:34.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.975+0000 7feb36639740 10 client.11754 fetch_fsmap learned FSMap version 183 2024-09-17T01:49:34.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.975+0000 7feb36639740 1 -- 172.21.15.42:0/1969806126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=183,monmap=2+}) -- 0x5557db5363a0 con 0x5557db18e410 2024-09-17T01:49:34.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.975+0000 7feb15600640 1 -- 172.21.15.42:0/1969806126 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb20003b70 con 0x5557db18e410 2024-09-17T01:49:34.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.975+0000 7feb15600640 1 -- 172.21.15.42:0/1969806126 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 183) ==== 3502+0+0 (secure 0 0 0) 0x7feb20004b40 con 0x5557db18e410 2024-09-17T01:49:34.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.975+0000 7feb36639740 10 client.11754 fetch_fsmap finished waiting for FSMap version 183 2024-09-17T01:49:34.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.975+0000 7feb36639740 10 client.11754 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.d 2024-09-17T01:49:34.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.976+0000 7feb36639740 20 client.11754 populate_metadata read hostname 'smithi042' 2024-09-17T01:49:34.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.976+0000 7feb36639740 1 --2- 172.21.15.42:0/1969806126 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x5557db578cc0 0x5557db572d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:34.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.976+0000 7feb36639740 4 client.11754 mds_command: new command op to 11517 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2024-09-17T01:49:34.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.976+0000 7feb36639740 1 -- 172.21.15.42:0/1969806126 --> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) -- 0x5557db531fe0 con 0x5557db578cc0 2024-09-17T01:49:34.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.976+0000 7feb2cc00640 1 --2- 172.21.15.42:0/1969806126 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x5557db578cc0 0x5557db572d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:34.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.976+0000 7feb2cc00640 1 --2- 172.21.15.42:0/1969806126 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x5557db578cc0 0x5557db572d80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=422a27e032987137 server_cookie=ca38ba327bb10a04 in_seq=0 out_seq=0 2024-09-17T01:49:34.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.976+0000 7feb15600640 10 client.11754 ms_handle_connect on v2:172.21.15.43:6834/4082001755 2024-09-17T01:49:34.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.977+0000 7feb15600640 1 -- 172.21.15.42:0/1969806126 <== mds.0 v2:172.21.15.43:6834/4082001755 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5557db531fe0 con 0x5557db578cc0 2024-09-17T01:49:34.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.977+0000 7feb15600640 10 client.11754 handle_command_reply: tid=0 2024-09-17T01:49:34.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.977+0000 7feb36639740 1 client.11754 shutdown 2024-09-17T01:49:34.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.978+0000 7feb36639740 1 -- 172.21.15.42:0/1969806126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db18e410 msgr2=0x5557db59e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:34.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.978+0000 7feb36639740 1 --2- 172.21.15.42:0/1969806126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db18e410 0x5557db59e070 secure :-1 s=READY pgs=2591 cs=0 l=1 rev1=1 crypto rx=0x7feb20006010 tx=0x7feb20030b90 comp rx=0 tx=0).stop 2024-09-17T01:49:34.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.978+0000 7feb36639740 1 -- 172.21.15.42:0/1969806126 shutdown_connections 2024-09-17T01:49:34.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.978+0000 7feb36639740 1 --2- 172.21.15.42:0/1969806126 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x5557db578cc0 0x5557db572d80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.978+0000 7feb36639740 1 --2- 172.21.15.42:0/1969806126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5557db16d730 0x5557db59db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.978+0000 7feb36639740 1 --2- 172.21.15.42:0/1969806126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5557db18e410 0x5557db59e070 unknown :-1 s=CLOSED pgs=2591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.978+0000 7feb36639740 1 --2- 172.21.15.42:0/1969806126 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x5557db165550 0x5557db5fa2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.978+0000 7feb15600640 0 client.11754 ms_handle_reset on v2:172.21.15.43:6834/4082001755 2024-09-17T01:49:34.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.978+0000 7feb36639740 1 -- 172.21.15.42:0/1969806126 >> 172.21.15.42:0/1969806126 conn(0x5557db182560 msgr2=0x5557db57e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:34.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.978+0000 7feb36639740 1 -- 172.21.15.42:0/1969806126 shutdown_connections 2024-09-17T01:49:34.978 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.978+0000 7feb36639740 1 -- 172.21.15.42:0/1969806126 wait complete. 2024-09-17T01:49:34.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.978+0000 7feb36639740 20 client.11754 trim_cache size 0 max 16384 2024-09-17T01:49:34.979 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:49:34.979 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-17T01:49:34.979 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "e7620a81-dc19-43a9-a344-f1ffb93dfff2", 2024-09-17T01:49:34.979 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-17T01:49:34.979 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:49:34.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.979+0000 7feb2f600640 1 -- 172.21.15.42:0/4137719790 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feb04078b90 msgr2=0x7feb0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:34.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.979+0000 7feb2f600640 1 --2- 172.21.15.42:0/4137719790 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feb04078b90 0x7feb0407b0a0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7feb1800bb50 tx=0x7feb1800b2e0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.979+0000 7feb2f600640 1 -- 172.21.15.42:0/4137719790 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb280cf7d0 msgr2=0x7feb281432d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:34.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.979+0000 7feb2f600640 1 --2- 172.21.15.42:0/4137719790 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb280cf7d0 0x7feb281432d0 secure :-1 s=READY pgs=2587 cs=0 l=1 rev1=1 crypto rx=0x7feb1000b3f0 tx=0x7feb1000b8b0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.979+0000 7feb2f600640 1 -- 172.21.15.42:0/4137719790 shutdown_connections 2024-09-17T01:49:34.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.979+0000 7feb2f600640 1 --2- 172.21.15.42:0/4137719790 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7feb04078b90 0x7feb0407b0a0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.980 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.979+0000 7feb2f600640 1 --2- 172.21.15.42:0/4137719790 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7feb28143810 0x7feb28131db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.979+0000 7feb2f600640 1 --2- 172.21.15.42:0/4137719790 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feb280cf7d0 0x7feb281432d0 unknown :-1 s=CLOSED pgs=2587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.979+0000 7feb2f600640 1 --2- 172.21.15.42:0/4137719790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb280b3a40 0x7feb28144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:34.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.979+0000 7feb2f600640 1 -- 172.21.15.42:0/4137719790 >> 172.21.15.42:0/4137719790 conn(0x7feb2806d420 msgr2=0x7feb280b0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:34.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.979+0000 7feb2f600640 1 -- 172.21.15.42:0/4137719790 shutdown_connections 2024-09-17T01:49:34.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:34.979+0000 7feb2f600640 1 -- 172.21.15.42:0/4137719790 wait complete. 2024-09-17T01:49:35.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:49:35.002 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.16:0 scrub status 2024-09-17T01:49:35.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.232+0000 7fe686600640 1 -- 172.21.15.42:0/428844081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6800cdd30 msgr2=0x7fe680160ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:35.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.232+0000 7fe686600640 1 --2- 172.21.15.42:0/428844081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6800cdd30 0x7fe680160ba0 secure :-1 s=READY pgs=2592 cs=0 l=1 rev1=1 crypto rx=0x7fe68015e2e0 tx=0x7fe67802a980 comp rx=0 tx=0).stop 2024-09-17T01:49:35.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.232+0000 7fe686600640 1 -- 172.21.15.42:0/428844081 shutdown_connections 2024-09-17T01:49:35.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.232+0000 7fe686600640 1 --2- 172.21.15.42:0/428844081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe6800cdd30 0x7fe680160ba0 unknown :-1 s=CLOSED pgs=2592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.232+0000 7fe686600640 1 --2- 172.21.15.42:0/428844081 >> v2:172.21.15.43:3300/0 conn(0x7fe68015dcf0 0x7fe680072b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.232+0000 7fe686600640 1 -- 172.21.15.42:0/428844081 >> 172.21.15.42:0/428844081 conn(0x7fe68006d1b0 msgr2=0x7fe68006d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:35.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.232+0000 7fe686600640 1 -- 172.21.15.42:0/428844081 shutdown_connections 2024-09-17T01:49:35.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.233+0000 7fe686600640 1 -- 172.21.15.42:0/428844081 wait complete. 2024-09-17T01:49:35.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.235+0000 7fe686600640 1 Processor -- start 2024-09-17T01:49:35.232 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.235+0000 7fe686600640 1 -- start start 2024-09-17T01:49:35.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.236+0000 7fe686600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe68015dcf0 0x7fe68015bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.236+0000 7fe686600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe680160790 0x7fe6800b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.236+0000 7fe686600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6800b4400 0x7fe6800b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.236+0000 7fe686600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe68006edb0 con 0x7fe68015dcf0 2024-09-17T01:49:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.236+0000 7fe686600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe68006ec30 con 0x7fe6800b4400 2024-09-17T01:49:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.236+0000 7fe686600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe68006ef30 con 0x7fe680160790 2024-09-17T01:49:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.236+0000 7fe67f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe68015dcf0 0x7fe68015bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.237+0000 7fe67f400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe68015dcf0 0x7fe68015bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40658/0 (socket says 172.21.15.42:40658) 2024-09-17T01:49:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.237+0000 7fe67f400640 1 -- 172.21.15.42:0/895422129 learned_addr learned my addr 172.21.15.42:0/895422129 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.237+0000 7fe67fe00640 1 --2- 172.21.15.42:0/895422129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6800b4400 0x7fe6800b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:35.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.237+0000 7fe67ea00640 1 --2- 172.21.15.42:0/895422129 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe680160790 0x7fe6800b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.237+0000 7fe67f400640 1 -- 172.21.15.42:0/895422129 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe680160790 msgr2=0x7fe6800b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.237+0000 7fe67f400640 1 --2- 172.21.15.42:0/895422129 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe680160790 0x7fe6800b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.237+0000 7fe67f400640 1 -- 172.21.15.42:0/895422129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6800b4400 msgr2=0x7fe6800b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:35.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.237+0000 7fe67f400640 1 --2- 172.21.15.42:0/895422129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6800b4400 0x7fe6800b4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.237+0000 7fe67f400640 1 -- 172.21.15.42:0/895422129 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6800b4d50 con 0x7fe68015dcf0 2024-09-17T01:49:35.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.238+0000 7fe67f400640 1 --2- 172.21.15.42:0/895422129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe68015dcf0 0x7fe68015bc90 secure :-1 s=READY pgs=2593 cs=0 l=1 rev1=1 crypto rx=0x7fe67000d6d0 tx=0x7fe67000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:35.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.238+0000 7fe677400640 1 -- 172.21.15.42:0/895422129 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe670017070 con 0x7fe68015dcf0 2024-09-17T01:49:35.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.238+0000 7fe677400640 1 -- 172.21.15.42:0/895422129 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe670004310 con 0x7fe68015dcf0 2024-09-17T01:49:35.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.238+0000 7fe677400640 1 -- 172.21.15.42:0/895422129 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe670009a80 con 0x7fe68015dcf0 2024-09-17T01:49:35.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.238+0000 7fe686600640 1 -- 172.21.15.42:0/895422129 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe680145270 con 0x7fe68015dcf0 2024-09-17T01:49:35.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.238+0000 7fe686600640 1 -- 172.21.15.42:0/895422129 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6801f9850 con 0x7fe68015dcf0 2024-09-17T01:49:35.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.240+0000 7fe677400640 1 -- 172.21.15.42:0/895422129 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe6700035f0 con 0x7fe68015dcf0 2024-09-17T01:49:35.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.241+0000 7fe677400640 1 --2- 172.21.15.42:0/895422129 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe660078b90 0x7fe66007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:35.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.241+0000 7fe677400640 1 -- 172.21.15.42:0/895422129 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7fe67009b110 con 0x7fe68015dcf0 2024-09-17T01:49:35.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.242+0000 7fe68d7ef740 1 Processor -- start 2024-09-17T01:49:35.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.242+0000 7fe67ea00640 1 --2- 172.21.15.42:0/895422129 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe660078b90 0x7fe66007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:35.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.242+0000 7fe68d7ef740 1 -- start start 2024-09-17T01:49:35.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.243+0000 7fe67ea00640 1 --2- 172.21.15.42:0/895422129 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe660078b90 0x7fe66007b0a0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fe6800cca10 tx=0x7fe66c009060 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:35.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.243+0000 7fe68d7ef740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a0ffa48390 0x55a0ffe36550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:35.242 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.243+0000 7fe68d7ef740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa1f4d0 0x55a0ffe19220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:35.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.243+0000 7fe68d7ef740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0ffa276b0 0x55a0ffe19760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:35.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.243+0000 7fe68d7ef740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a0ffd4f1c0 con 0x55a0ffa1f4d0 2024-09-17T01:49:35.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.243+0000 7fe68d7ef740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a0ffd62870 con 0x55a0ffa276b0 2024-09-17T01:49:35.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.243+0000 7fe68d7ef740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55a0ffd51ca0 con 0x55a0ffa48390 2024-09-17T01:49:35.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.244+0000 7fe67ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa1f4d0 0x55a0ffe19220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:35.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.244+0000 7fe67ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa1f4d0 0x55a0ffe19220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40662/0 (socket says 172.21.15.42:40662) 2024-09-17T01:49:35.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.244+0000 7fe67ea00640 1 -- 172.21.15.42:0/2151028640 learned_addr learned my addr 172.21.15.42:0/2151028640 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:35.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.244+0000 7fe67fe00640 1 --2- 172.21.15.42:0/2151028640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0ffa276b0 0x55a0ffe19760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:35.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.244+0000 7fe67f400640 1 --2- 172.21.15.42:0/2151028640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a0ffa48390 0x55a0ffe36550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:35.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.244+0000 7fe67ea00640 1 -- 172.21.15.42:0/2151028640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a0ffa48390 msgr2=0x55a0ffe36550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:35.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.244+0000 7fe67ea00640 1 --2- 172.21.15.42:0/2151028640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a0ffa48390 0x55a0ffe36550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.244+0000 7fe67ea00640 1 -- 172.21.15.42:0/2151028640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0ffa276b0 msgr2=0x55a0ffe19760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:35.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.244+0000 7fe67ea00640 1 --2- 172.21.15.42:0/2151028640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0ffa276b0 0x55a0ffe19760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.244+0000 7fe67ea00640 1 -- 172.21.15.42:0/2151028640 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0ffb2a7d0 con 0x55a0ffa1f4d0 2024-09-17T01:49:35.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.244+0000 7fe67ea00640 1 --2- 172.21.15.42:0/2151028640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa1f4d0 0x55a0ffe19220 secure :-1 s=READY pgs=2594 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00eb70 tx=0x7fe66c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc32a453f0bdde3a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:35.244 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.245+0000 7fe66be00640 1 -- 172.21.15.42:0/2151028640 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c01b040 con 0x55a0ffa1f4d0 2024-09-17T01:49:35.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.245+0000 7fe66be00640 1 -- 172.21.15.42:0/2151028640 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe66c024070 con 0x55a0ffa1f4d0 2024-09-17T01:49:35.245 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.245+0000 7fe66be00640 1 -- 172.21.15.42:0/2151028640 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c015e50 con 0x55a0ffa1f4d0 2024-09-17T01:49:35.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.245+0000 7fe68d7ef740 1 -- 172.21.15.42:0/2151028640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa1f4d0 msgr2=0x55a0ffe19220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:35.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.245+0000 7fe68d7ef740 1 --2- 172.21.15.42:0/2151028640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa1f4d0 0x55a0ffe19220 secure :-1 s=READY pgs=2594 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00eb70 tx=0x7fe66c011000 comp rx=0 tx=0).stop 2024-09-17T01:49:35.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.246+0000 7fe68d7ef740 1 -- 172.21.15.42:0/2151028640 shutdown_connections 2024-09-17T01:49:35.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.246+0000 7fe68d7ef740 1 --2- 172.21.15.42:0/2151028640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0ffa276b0 0x55a0ffe19760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.246+0000 7fe68d7ef740 1 --2- 172.21.15.42:0/2151028640 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa1f4d0 0x55a0ffe19220 unknown :-1 s=CLOSED pgs=2594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.246+0000 7fe68d7ef740 1 --2- 172.21.15.42:0/2151028640 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a0ffa48390 0x55a0ffe36550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.246+0000 7fe68d7ef740 1 -- 172.21.15.42:0/2151028640 >> 172.21.15.42:0/2151028640 conn(0x55a0ffa3c4e0 msgr2=0x55a0ffdef440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:35.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.246+0000 7fe68d7ef740 1 -- 172.21.15.42:0/2151028640 shutdown_connections 2024-09-17T01:49:35.246 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.246+0000 7fe68d7ef740 1 -- 172.21.15.42:0/2151028640 wait complete. 2024-09-17T01:49:35.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.247+0000 7fe68d7ef740 1 -- start start 2024-09-17T01:49:35.247 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.247+0000 7fe68d7ef740 1 Processor -- start 2024-09-17T01:49:35.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.248+0000 7fe68d7ef740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a0ffa1f4d0 0x55a0ffe162a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:35.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.248+0000 7fe68d7ef740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa276b0 0x55a0ffe078b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:35.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.248+0000 7fe68d7ef740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0ffa48390 0x55a0ffe466e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:35.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.248+0000 7fe68d7ef740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a0ffcf8410 con 0x55a0ffa276b0 2024-09-17T01:49:35.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.248+0000 7fe68d7ef740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a0ffd55ab0 con 0x55a0ffa48390 2024-09-17T01:49:35.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.248+0000 7fe68d7ef740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55a0ffac2740 con 0x55a0ffa1f4d0 2024-09-17T01:49:35.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.248+0000 7fe68d7ef740 10 client.0 _ll_register_callbacks cb 0x55a0ffcd5360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:49:35.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.249+0000 7fe67ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa276b0 0x55a0ffe078b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:35.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.249+0000 7fe67ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa276b0 0x55a0ffe078b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40672/0 (socket says 172.21.15.42:40672) 2024-09-17T01:49:35.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.249+0000 7fe67ea00640 1 -- 172.21.15.42:0/3233800557 learned_addr learned my addr 172.21.15.42:0/3233800557 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:35.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.249+0000 7fe67f400640 1 --2- 172.21.15.42:0/3233800557 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a0ffa1f4d0 0x55a0ffe162a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:35.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.249+0000 7fe67fe00640 1 --2- 172.21.15.42:0/3233800557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0ffa48390 0x55a0ffe466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:35.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.249+0000 7fe67ea00640 1 -- 172.21.15.42:0/3233800557 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a0ffa1f4d0 msgr2=0x55a0ffe162a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:35.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.249+0000 7fe67ea00640 1 --2- 172.21.15.42:0/3233800557 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a0ffa1f4d0 0x55a0ffe162a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.249+0000 7fe67ea00640 1 -- 172.21.15.42:0/3233800557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0ffa48390 msgr2=0x55a0ffe466e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:35.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.249+0000 7fe67ea00640 1 --2- 172.21.15.42:0/3233800557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0ffa48390 0x55a0ffe466e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.249+0000 7fe67ea00640 1 -- 172.21.15.42:0/3233800557 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0ffab3970 con 0x55a0ffa276b0 2024-09-17T01:49:35.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.250+0000 7fe67ea00640 1 --2- 172.21.15.42:0/3233800557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa276b0 0x55a0ffe078b0 secure :-1 s=READY pgs=2595 cs=0 l=1 rev1=1 crypto rx=0x7fe66c020000 tx=0x7fe66c006d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5032d9c537c1da server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:35.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.250+0000 7fe668c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:49:35.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.250+0000 7fe668c00640 1 -- 172.21.15.42:0/3233800557 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c0298d0 con 0x55a0ffa276b0 2024-09-17T01:49:35.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.250+0000 7fe668c00640 1 -- 172.21.15.42:0/3233800557 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7fe66c029a70 con 0x55a0ffa276b0 2024-09-17T01:49:35.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.250+0000 7fe68d7ef740 1 -- 172.21.15.42:0/3233800557 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe66c024070 con 0x55a0ffa276b0 2024-09-17T01:49:35.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.250+0000 7fe668c00640 1 -- 172.21.15.42:0/3233800557 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=183) ==== 24+0+0 (secure 0 0 0) 0x7fe66c03b050 con 0x55a0ffa276b0 2024-09-17T01:49:35.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.250+0000 7fe68d7ef740 10 client.11766 fetch_fsmap learned FSMap version 183 2024-09-17T01:49:35.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.250+0000 7fe68d7ef740 1 -- 172.21.15.42:0/3233800557 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=183,monmap=2+}) -- 0x55a0ffa916a0 con 0x55a0ffa276b0 2024-09-17T01:49:35.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.250+0000 7fe668c00640 1 -- 172.21.15.42:0/3233800557 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe66c024070 con 0x55a0ffa276b0 2024-09-17T01:49:35.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.251+0000 7fe668c00640 1 -- 172.21.15.42:0/3233800557 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 183) ==== 3502+0+0 (secure 0 0 0) 0x7fe66c03e020 con 0x55a0ffa276b0 2024-09-17T01:49:35.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.251+0000 7fe68d7ef740 10 client.11766 fetch_fsmap finished waiting for FSMap version 183 2024-09-17T01:49:35.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.251+0000 7fe68d7ef740 10 client.11766 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.d 2024-09-17T01:49:35.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.251+0000 7fe68d7ef740 20 client.11766 populate_metadata read hostname 'smithi042' 2024-09-17T01:49:35.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.251+0000 7fe68d7ef740 1 --2- 172.21.15.42:0/3233800557 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55a0ffa06f60 0x55a0ffe2ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:35.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.251+0000 7fe68d7ef740 4 client.11766 mds_command: new command op to 11517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:49:35.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.251+0000 7fe68d7ef740 1 -- 172.21.15.42:0/3233800557 --> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0ffd647c0 con 0x55a0ffa06f60 2024-09-17T01:49:35.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.251+0000 7fe67f400640 1 --2- 172.21.15.42:0/3233800557 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55a0ffa06f60 0x55a0ffe2ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:35.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.252+0000 7fe67f400640 1 --2- 172.21.15.42:0/3233800557 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55a0ffa06f60 0x55a0ffe2ead0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd5836f27fa15cb8 server_cookie=b40c2ae5c57ade5c in_seq=0 out_seq=0 2024-09-17T01:49:35.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.252+0000 7fe668c00640 10 client.11766 ms_handle_connect on v2:172.21.15.43:6834/4082001755 2024-09-17T01:49:35.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.252+0000 7fe668c00640 1 -- 172.21.15.42:0/3233800557 <== mds.0 v2:172.21.15.43:6834/4082001755 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a0ffd647c0 con 0x55a0ffa06f60 2024-09-17T01:49:35.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.253+0000 7fe668c00640 10 client.11766 handle_command_reply: tid=0 2024-09-17T01:49:35.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.253+0000 7fe68d7ef740 1 client.11766 shutdown 2024-09-17T01:49:35.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.253+0000 7fe68d7ef740 1 -- 172.21.15.42:0/3233800557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa276b0 msgr2=0x55a0ffe078b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:35.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.253+0000 7fe68d7ef740 1 --2- 172.21.15.42:0/3233800557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa276b0 0x55a0ffe078b0 secure :-1 s=READY pgs=2595 cs=0 l=1 rev1=1 crypto rx=0x7fe66c020000 tx=0x7fe66c006d10 comp rx=0 tx=0).stop 2024-09-17T01:49:35.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.253+0000 7fe68d7ef740 1 -- 172.21.15.42:0/3233800557 shutdown_connections 2024-09-17T01:49:35.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.253+0000 7fe68d7ef740 1 --2- 172.21.15.42:0/3233800557 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55a0ffa06f60 0x55a0ffe2ead0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.253+0000 7fe68d7ef740 1 --2- 172.21.15.42:0/3233800557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0ffa48390 0x55a0ffe466e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.253+0000 7fe68d7ef740 1 --2- 172.21.15.42:0/3233800557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa276b0 0x55a0ffe078b0 unknown :-1 s=CLOSED pgs=2595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.253+0000 7fe68d7ef740 1 --2- 172.21.15.42:0/3233800557 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a0ffa1f4d0 0x55a0ffe162a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.253+0000 7fe68d7ef740 1 -- 172.21.15.42:0/3233800557 >> 172.21.15.42:0/3233800557 conn(0x55a0ffa3c4e0 msgr2=0x55a0ffe089e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:35.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.253+0000 7fe668c00640 0 client.11766 ms_handle_reset on v2:172.21.15.43:6834/4082001755 2024-09-17T01:49:35.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.253+0000 7fe68d7ef740 1 -- 172.21.15.42:0/3233800557 shutdown_connections 2024-09-17T01:49:35.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.253+0000 7fe68d7ef740 1 -- 172.21.15.42:0/3233800557 wait complete. 2024-09-17T01:49:35.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.253+0000 7fe68d7ef740 20 client.11766 trim_cache size 0 max 16384 2024-09-17T01:49:35.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.272+0000 7fe68d7ef740 1 Processor -- start 2024-09-17T01:49:35.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.273+0000 7fe68d7ef740 1 -- start start 2024-09-17T01:49:35.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.274+0000 7fe68d7ef740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a0ffa1f4d0 0x55a0ffe2e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:35.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.274+0000 7fe68d7ef740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa276b0 0x55a0ffe36d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:35.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.274+0000 7fe68d7ef740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0ffa48390 0x55a0ffe30de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:35.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.274+0000 7fe68d7ef740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe6802026c0 con 0x55a0ffa276b0 2024-09-17T01:49:35.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.274+0000 7fe68d7ef740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe6802016c0 con 0x55a0ffa48390 2024-09-17T01:49:35.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.274+0000 7fe68d7ef740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe6800b13e0 con 0x55a0ffa1f4d0 2024-09-17T01:49:35.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.274+0000 7fe67ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa276b0 0x55a0ffe36d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:35.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.274+0000 7fe67ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa276b0 0x55a0ffe36d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40678/0 (socket says 172.21.15.42:40678) 2024-09-17T01:49:35.273 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.274+0000 7fe67ea00640 1 -- 172.21.15.42:0/2642284705 learned_addr learned my addr 172.21.15.42:0/2642284705 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:35.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.274+0000 7fe67f400640 1 --2- 172.21.15.42:0/2642284705 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a0ffa1f4d0 0x55a0ffe2e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:35.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.274+0000 7fe67fe00640 1 --2- 172.21.15.42:0/2642284705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0ffa48390 0x55a0ffe30de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:35.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.275+0000 7fe67ea00640 1 -- 172.21.15.42:0/2642284705 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a0ffa1f4d0 msgr2=0x55a0ffe2e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:35.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.275+0000 7fe67ea00640 1 --2- 172.21.15.42:0/2642284705 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a0ffa1f4d0 0x55a0ffe2e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.275+0000 7fe67ea00640 1 -- 172.21.15.42:0/2642284705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0ffa48390 msgr2=0x55a0ffe30de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:35.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.275+0000 7fe67ea00640 1 --2- 172.21.15.42:0/2642284705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0ffa48390 0x55a0ffe30de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.275+0000 7fe67ea00640 1 -- 172.21.15.42:0/2642284705 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0ffdea720 con 0x55a0ffa276b0 2024-09-17T01:49:35.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.275+0000 7fe67fe00640 1 --2- 172.21.15.42:0/2642284705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0ffa48390 0x55a0ffe30de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:49:35.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.275+0000 7fe67ea00640 1 --2- 172.21.15.42:0/2642284705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa276b0 0x55a0ffe36d10 secure :-1 s=READY pgs=2596 cs=0 l=1 rev1=1 crypto rx=0x7fe66c033800 tx=0x7fe66c00ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2281bb995c802beb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:35.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.275+0000 7fe66b400640 1 -- 172.21.15.42:0/2642284705 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c015850 con 0x55a0ffa276b0 2024-09-17T01:49:35.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.275+0000 7fe66b400640 1 -- 172.21.15.42:0/2642284705 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe66c024070 con 0x55a0ffa276b0 2024-09-17T01:49:35.274 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.275+0000 7fe66b400640 1 -- 172.21.15.42:0/2642284705 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c029930 con 0x55a0ffa276b0 2024-09-17T01:49:35.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.276+0000 7fe68d7ef740 1 -- 172.21.15.42:0/2642284705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa276b0 msgr2=0x55a0ffe36d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:35.275 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.276+0000 7fe68d7ef740 1 --2- 172.21.15.42:0/2642284705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa276b0 0x55a0ffe36d10 secure :-1 s=READY pgs=2596 cs=0 l=1 rev1=1 crypto rx=0x7fe66c033800 tx=0x7fe66c00ea40 comp rx=0 tx=0).stop 2024-09-17T01:49:35.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.276+0000 7fe68d7ef740 1 -- 172.21.15.42:0/2642284705 shutdown_connections 2024-09-17T01:49:35.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.276+0000 7fe68d7ef740 1 --2- 172.21.15.42:0/2642284705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0ffa48390 0x55a0ffe30de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.276+0000 7fe68d7ef740 1 --2- 172.21.15.42:0/2642284705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa276b0 0x55a0ffe36d10 unknown :-1 s=CLOSED pgs=2596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.276+0000 7fe68d7ef740 1 --2- 172.21.15.42:0/2642284705 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a0ffa1f4d0 0x55a0ffe2e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.276+0000 7fe68d7ef740 1 -- 172.21.15.42:0/2642284705 >> 172.21.15.42:0/2642284705 conn(0x55a0ffa3c4e0 msgr2=0x55a0ffde4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:35.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.276+0000 7fe68d7ef740 1 -- 172.21.15.42:0/2642284705 shutdown_connections 2024-09-17T01:49:35.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.276+0000 7fe68d7ef740 1 -- 172.21.15.42:0/2642284705 wait complete. 2024-09-17T01:49:35.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.277+0000 7fe68d7ef740 1 -- start start 2024-09-17T01:49:35.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.277+0000 7fe68d7ef740 1 Processor -- start 2024-09-17T01:49:35.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.279+0000 7fe68d7ef740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0ffa1f4d0 0x55a0ffdeddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:35.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.279+0000 7fe68d7ef740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa276b0 0x55a0ffea92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:35.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.279+0000 7fe68d7ef740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a0ffa48390 0x55a0ffeb2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:35.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.279+0000 7fe68d7ef740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe6800b1a30 con 0x55a0ffa276b0 2024-09-17T01:49:35.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.279+0000 7fe68d7ef740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a0ffd57f50 con 0x55a0ffa1f4d0 2024-09-17T01:49:35.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.279+0000 7fe68d7ef740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55a0ffeb3340 con 0x55a0ffa48390 2024-09-17T01:49:35.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.279+0000 7fe68d7ef740 10 client.0 _ll_register_callbacks cb 0x7fe678009440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:49:35.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.279+0000 7fe67ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa276b0 0x55a0ffea92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:35.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.279+0000 7fe67ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa276b0 0x55a0ffea92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40686/0 (socket says 172.21.15.42:40686) 2024-09-17T01:49:35.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.279+0000 7fe67ea00640 1 -- 172.21.15.42:0/3260854054 learned_addr learned my addr 172.21.15.42:0/3260854054 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:49:35.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.279+0000 7fe67f400640 1 --2- 172.21.15.42:0/3260854054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0ffa1f4d0 0x55a0ffdeddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:35.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.279+0000 7fe67fe00640 1 --2- 172.21.15.42:0/3260854054 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a0ffa48390 0x55a0ffeb2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:35.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.279+0000 7fe67ea00640 1 -- 172.21.15.42:0/3260854054 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a0ffa48390 msgr2=0x55a0ffeb2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:35.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.279+0000 7fe67ea00640 1 --2- 172.21.15.42:0/3260854054 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a0ffa48390 0x55a0ffeb2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.279+0000 7fe67ea00640 1 -- 172.21.15.42:0/3260854054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0ffa1f4d0 msgr2=0x55a0ffdeddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:49:35.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.279+0000 7fe67ea00640 1 --2- 172.21.15.42:0/3260854054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0ffa1f4d0 0x55a0ffdeddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.279+0000 7fe67ea00640 1 -- 172.21.15.42:0/3260854054 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0ffe30f10 con 0x55a0ffa276b0 2024-09-17T01:49:35.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.279+0000 7fe67fe00640 1 --2- 172.21.15.42:0/3260854054 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a0ffa48390 0x55a0ffeb2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:49:35.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.280+0000 7fe67ea00640 1 --2- 172.21.15.42:0/3260854054 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa276b0 0x55a0ffea92b0 secure :-1 s=READY pgs=2597 cs=0 l=1 rev1=1 crypto rx=0x7fe66c006a60 tx=0x7fe66c015850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b445ee63e536db03 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:35.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.280+0000 7fe668c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:49:35.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.280+0000 7fe668c00640 1 -- 172.21.15.42:0/3260854054 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c033a30 con 0x55a0ffa276b0 2024-09-17T01:49:35.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.280+0000 7fe668c00640 1 -- 172.21.15.42:0/3260854054 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7fe66c033bd0 con 0x55a0ffa276b0 2024-09-17T01:49:35.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.280+0000 7fe68d7ef740 1 -- 172.21.15.42:0/3260854054 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe66c024070 con 0x55a0ffa276b0 2024-09-17T01:49:35.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.280+0000 7fe668c00640 1 -- 172.21.15.42:0/3260854054 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=183) ==== 24+0+0 (secure 0 0 0) 0x7fe66c00e740 con 0x55a0ffa276b0 2024-09-17T01:49:35.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.280+0000 7fe68d7ef740 10 client.11772 fetch_fsmap learned FSMap version 183 2024-09-17T01:49:35.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.280+0000 7fe68d7ef740 1 -- 172.21.15.42:0/3260854054 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=183,monmap=2+}) -- 0x55a0ffeb3140 con 0x55a0ffa276b0 2024-09-17T01:49:35.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.280+0000 7fe668c00640 1 -- 172.21.15.42:0/3260854054 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe66c024070 con 0x55a0ffa276b0 2024-09-17T01:49:35.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.280+0000 7fe668c00640 1 -- 172.21.15.42:0/3260854054 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 183) ==== 3502+0+0 (secure 0 0 0) 0x7fe66c052080 con 0x55a0ffa276b0 2024-09-17T01:49:35.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.281+0000 7fe68d7ef740 10 client.11772 fetch_fsmap finished waiting for FSMap version 183 2024-09-17T01:49:35.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.281+0000 7fe68d7ef740 10 client.11772 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.d 2024-09-17T01:49:35.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.281+0000 7fe68d7ef740 20 client.11772 populate_metadata read hostname 'smithi042' 2024-09-17T01:49:35.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.281+0000 7fe68d7ef740 1 --2- 172.21.15.42:0/3260854054 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55a0ffeb66b0 0x55a0ffe37430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:35.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.281+0000 7fe68d7ef740 4 client.11772 mds_command: new command op to 11517 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:49:35.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.281+0000 7fe68d7ef740 1 -- 172.21.15.42:0/3260854054 --> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a0ffd60270 con 0x55a0ffeb66b0 2024-09-17T01:49:35.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.281+0000 7fe67f400640 1 --2- 172.21.15.42:0/3260854054 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55a0ffeb66b0 0x55a0ffe37430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:35.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.282+0000 7fe67f400640 1 --2- 172.21.15.42:0/3260854054 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55a0ffeb66b0 0x55a0ffe37430 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=147cff7f62e07006 server_cookie=4077150f12340c0f in_seq=0 out_seq=0 2024-09-17T01:49:35.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.282+0000 7fe668c00640 10 client.11772 ms_handle_connect on v2:172.21.15.43:6834/4082001755 2024-09-17T01:49:35.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.282+0000 7fe668c00640 1 -- 172.21.15.42:0/3260854054 <== mds.0 v2:172.21.15.43:6834/4082001755 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x55a0ffd60270 con 0x55a0ffeb66b0 2024-09-17T01:49:35.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.282+0000 7fe668c00640 10 client.11772 handle_command_reply: tid=0 2024-09-17T01:49:35.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.282+0000 7fe68d7ef740 1 client.11772 shutdown 2024-09-17T01:49:35.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.282+0000 7fe68d7ef740 1 -- 172.21.15.42:0/3260854054 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa276b0 msgr2=0x55a0ffea92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:35.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.282+0000 7fe68d7ef740 1 --2- 172.21.15.42:0/3260854054 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa276b0 0x55a0ffea92b0 secure :-1 s=READY pgs=2597 cs=0 l=1 rev1=1 crypto rx=0x7fe66c006a60 tx=0x7fe66c015850 comp rx=0 tx=0).stop 2024-09-17T01:49:35.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.282+0000 7fe68d7ef740 1 -- 172.21.15.42:0/3260854054 shutdown_connections 2024-09-17T01:49:35.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.282+0000 7fe68d7ef740 1 --2- 172.21.15.42:0/3260854054 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55a0ffeb66b0 0x55a0ffe37430 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.282+0000 7fe68d7ef740 1 --2- 172.21.15.42:0/3260854054 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55a0ffa48390 0x55a0ffeb2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.282+0000 7fe68d7ef740 1 --2- 172.21.15.42:0/3260854054 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a0ffa276b0 0x55a0ffea92b0 unknown :-1 s=CLOSED pgs=2597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.282+0000 7fe68d7ef740 1 --2- 172.21.15.42:0/3260854054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0ffa1f4d0 0x55a0ffdeddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.282+0000 7fe668c00640 0 client.11772 ms_handle_reset on v2:172.21.15.43:6834/4082001755 2024-09-17T01:49:35.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.282+0000 7fe68d7ef740 1 -- 172.21.15.42:0/3260854054 >> 172.21.15.42:0/3260854054 conn(0x55a0ffa3c4e0 msgr2=0x55a0ffe424a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:35.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.282+0000 7fe68d7ef740 1 -- 172.21.15.42:0/3260854054 shutdown_connections 2024-09-17T01:49:35.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.283+0000 7fe68d7ef740 1 -- 172.21.15.42:0/3260854054 wait complete. 2024-09-17T01:49:35.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.283+0000 7fe68d7ef740 20 client.11772 trim_cache size 0 max 16384 2024-09-17T01:49:35.285 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:49:35.285 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T01:49:35.285 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-09-17T01:49:35.285 INFO:teuthology.orchestra.run.smithi042.stdout: "e7620a81-dc19-43a9-a344-f1ffb93dfff2": { 2024-09-17T01:49:35.285 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-17T01:49:35.285 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "e7620a81-dc19-43a9-a344-f1ffb93dfff2", 2024-09-17T01:49:35.285 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive,repair" 2024-09-17T01:49:35.285 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:49:35.285 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:49:35.285 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:49:35.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.283+0000 7fe686600640 1 -- 172.21.15.42:0/895422129 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe660078b90 msgr2=0x7fe66007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:35.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.283+0000 7fe686600640 1 --2- 172.21.15.42:0/895422129 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe660078b90 0x7fe66007b0a0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fe6800cca10 tx=0x7fe66c009060 comp rx=0 tx=0).stop 2024-09-17T01:49:35.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.283+0000 7fe686600640 1 -- 172.21.15.42:0/895422129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe68015dcf0 msgr2=0x7fe68015bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:35.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.283+0000 7fe686600640 1 --2- 172.21.15.42:0/895422129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe68015dcf0 0x7fe68015bc90 secure :-1 s=READY pgs=2593 cs=0 l=1 rev1=1 crypto rx=0x7fe67000d6d0 tx=0x7fe67000db90 comp rx=0 tx=0).stop 2024-09-17T01:49:35.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.283+0000 7fe686600640 1 -- 172.21.15.42:0/895422129 shutdown_connections 2024-09-17T01:49:35.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.283+0000 7fe686600640 1 --2- 172.21.15.42:0/895422129 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe660078b90 0x7fe66007b0a0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.283+0000 7fe686600640 1 --2- 172.21.15.42:0/895422129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6800b4400 0x7fe6800b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.283+0000 7fe686600640 1 --2- 172.21.15.42:0/895422129 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe680160790 0x7fe6800b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.283+0000 7fe686600640 1 --2- 172.21.15.42:0/895422129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe68015dcf0 0x7fe68015bc90 unknown :-1 s=CLOSED pgs=2593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:35.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.283+0000 7fe686600640 1 -- 172.21.15.42:0/895422129 >> 172.21.15.42:0/895422129 conn(0x7fe68006d1b0 msgr2=0x7fe680145f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:35.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.283+0000 7fe686600640 1 -- 172.21.15.42:0/895422129 shutdown_connections 2024-09-17T01:49:35.287 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:49:35.283+0000 7fe686600640 1 -- 172.21.15.42:0/895422129 wait complete. 2024-09-17T01:49:35.307 INFO:tasks.cephfs.filesystem:scrub status for tag:e7620a81-dc19-43a9-a344-f1ffb93dfff2 - {'path': '/', 'tag': 'e7620a81-dc19-43a9-a344-f1ffb93dfff2', 'options': 'recursive,repair'} 2024-09-17T01:49:52.561 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:49:52.567 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:50:05.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:50:05.309 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.16:0 scrub status 2024-09-17T01:50:05.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.553+0000 7f02d9600640 1 -- 172.21.15.42:0/111406910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02d40b3520 msgr2=0x7f02d40b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:05.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.553+0000 7f02d9600640 1 --2- 172.21.15.42:0/111406910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02d40b3520 0x7f02d40b3930 secure :-1 s=READY pgs=2598 cs=0 l=1 rev1=1 crypto rx=0x7f02bc005fd0 tx=0x7f02bc02a5d0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.553+0000 7f02d9600640 1 -- 172.21.15.42:0/111406910 shutdown_connections 2024-09-17T01:50:05.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.553+0000 7f02d9600640 1 --2- 172.21.15.42:0/111406910 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02d4160500 0x7f02d4160910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.553+0000 7f02d9600640 1 --2- 172.21.15.42:0/111406910 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02d40b3520 0x7f02d40b3930 unknown :-1 s=CLOSED pgs=2598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.553+0000 7f02d9600640 1 -- 172.21.15.42:0/111406910 >> 172.21.15.42:0/111406910 conn(0x7f02d406d3f0 msgr2=0x7f02d40b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:05.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.553+0000 7f02d9600640 1 -- 172.21.15.42:0/111406910 shutdown_connections 2024-09-17T01:50:05.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.553+0000 7f02d9600640 1 -- 172.21.15.42:0/111406910 wait complete. 2024-09-17T01:50:05.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.556+0000 7f02d9600640 1 Processor -- start 2024-09-17T01:50:05.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.556+0000 7f02d9600640 1 -- start start 2024-09-17T01:50:05.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.557+0000 7f02d9600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02d40af970 0x7f02d41f5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.557+0000 7f02d9600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02d40b3520 0x7f02d415e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.560 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.557+0000 7f02d9600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02d4160500 0x7f02d415e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.557+0000 7f02d9600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f02d40ce700 con 0x7f02d40af970 2024-09-17T01:50:05.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.557+0000 7f02d9600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f02d40ce580 con 0x7f02d40b3520 2024-09-17T01:50:05.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.557+0000 7f02d9600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f02d40ce880 con 0x7f02d4160500 2024-09-17T01:50:05.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.557+0000 7f02d3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02d40af970 0x7f02d41f5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.557+0000 7f02d3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02d40af970 0x7f02d41f5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59302/0 (socket says 172.21.15.42:59302) 2024-09-17T01:50:05.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.557+0000 7f02d3e00640 1 -- 172.21.15.42:0/793919880 learned_addr learned my addr 172.21.15.42:0/793919880 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:05.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.558+0000 7f02d8c00640 1 --2- 172.21.15.42:0/793919880 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02d4160500 0x7f02d415e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.558+0000 7f02cb400640 1 --2- 172.21.15.42:0/793919880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02d40b3520 0x7f02d415e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.558+0000 7f02d3e00640 1 -- 172.21.15.42:0/793919880 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02d4160500 msgr2=0x7f02d415e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:05.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.558+0000 7f02d3e00640 1 --2- 172.21.15.42:0/793919880 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02d4160500 0x7f02d415e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.558+0000 7f02d3e00640 1 -- 172.21.15.42:0/793919880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02d40b3520 msgr2=0x7f02d415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:05.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.558+0000 7f02d3e00640 1 --2- 172.21.15.42:0/793919880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02d40b3520 0x7f02d415e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.558+0000 7f02d3e00640 1 -- 172.21.15.42:0/793919880 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d41e61d0 con 0x7f02d40af970 2024-09-17T01:50:05.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.558+0000 7f02d3e00640 1 --2- 172.21.15.42:0/793919880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02d40af970 0x7f02d41f5340 secure :-1 s=READY pgs=2599 cs=0 l=1 rev1=1 crypto rx=0x7f02c400c3f0 tx=0x7f02c400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:05.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.558+0000 7f02d0c00640 1 -- 172.21.15.42:0/793919880 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c4017070 con 0x7f02d40af970 2024-09-17T01:50:05.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.559+0000 7f02d0c00640 1 -- 172.21.15.42:0/793919880 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02c40035f0 con 0x7f02d40af970 2024-09-17T01:50:05.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.559+0000 7f02d0c00640 1 -- 172.21.15.42:0/793919880 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c4003a40 con 0x7f02d40af970 2024-09-17T01:50:05.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.559+0000 7f02d9600640 1 -- 172.21.15.42:0/793919880 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d41f92c0 con 0x7f02d40af970 2024-09-17T01:50:05.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.559+0000 7f02d9600640 1 -- 172.21.15.42:0/793919880 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d41f9880 con 0x7f02d40af970 2024-09-17T01:50:05.562 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.561+0000 7f02d0c00640 1 -- 172.21.15.42:0/793919880 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f02c401a070 con 0x7f02d40af970 2024-09-17T01:50:05.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.562+0000 7f02d0c00640 1 --2- 172.21.15.42:0/793919880 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f02b0078bc0 0x7f02b007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.562+0000 7f02d0c00640 1 -- 172.21.15.42:0/793919880 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f02c4099fe0 con 0x7f02d40af970 2024-09-17T01:50:05.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.562+0000 7f02e1bba740 1 Processor -- start 2024-09-17T01:50:05.565 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.563+0000 7f02cb400640 1 --2- 172.21.15.42:0/793919880 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f02b0078bc0 0x7f02b007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.563+0000 7f02e1bba740 1 -- start start 2024-09-17T01:50:05.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.563+0000 7f02cb400640 1 --2- 172.21.15.42:0/793919880 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f02b0078bc0 0x7f02b007b0d0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f02bc033000 tx=0x7f02bc004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:05.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.564+0000 7f02e1bba740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a473390 0x555e9a861730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.564+0000 7f02e1bba740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555e9a44a4d0 0x555e9a844400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.564+0000 7f02e1bba740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555e9a4526b0 0x555e9a844940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.566 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.564+0000 7f02e1bba740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555e9a77a1c0 con 0x555e9a473390 2024-09-17T01:50:05.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.564+0000 7f02e1bba740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555e9a78d870 con 0x555e9a44a4d0 2024-09-17T01:50:05.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.564+0000 7f02e1bba740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x555e9a77cca0 con 0x555e9a4526b0 2024-09-17T01:50:05.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.564+0000 7f02d3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a473390 0x555e9a861730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.564+0000 7f02d3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a473390 0x555e9a861730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59304/0 (socket says 172.21.15.42:59304) 2024-09-17T01:50:05.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.564+0000 7f02d3e00640 1 -- 172.21.15.42:0/3925253952 learned_addr learned my addr 172.21.15.42:0/3925253952 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:05.567 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.564+0000 7f02cb400640 1 --2- 172.21.15.42:0/3925253952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555e9a44a4d0 0x555e9a844400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.564+0000 7f02d8c00640 1 --2- 172.21.15.42:0/3925253952 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555e9a4526b0 0x555e9a844940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.565+0000 7f02d3e00640 1 -- 172.21.15.42:0/3925253952 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555e9a4526b0 msgr2=0x555e9a844940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:05.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.565+0000 7f02d3e00640 1 --2- 172.21.15.42:0/3925253952 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555e9a4526b0 0x555e9a844940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.565+0000 7f02d3e00640 1 -- 172.21.15.42:0/3925253952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555e9a44a4d0 msgr2=0x555e9a844400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:05.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.565+0000 7f02d3e00640 1 --2- 172.21.15.42:0/3925253952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555e9a44a4d0 0x555e9a844400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.565+0000 7f02d3e00640 1 -- 172.21.15.42:0/3925253952 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e9a5557d0 con 0x555e9a473390 2024-09-17T01:50:05.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.565+0000 7f02d3e00640 1 --2- 172.21.15.42:0/3925253952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a473390 0x555e9a861730 secure :-1 s=READY pgs=2600 cs=0 l=1 rev1=1 crypto rx=0x7f02c4098420 tx=0x7f02c40617c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530f822072139ab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:05.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.565+0000 7f02c3e00640 1 -- 172.21.15.42:0/3925253952 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c4066030 con 0x555e9a473390 2024-09-17T01:50:05.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.565+0000 7f02c3e00640 1 -- 172.21.15.42:0/3925253952 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02c40667e0 con 0x555e9a473390 2024-09-17T01:50:05.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.565+0000 7f02c3e00640 1 -- 172.21.15.42:0/3925253952 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c406b690 con 0x555e9a473390 2024-09-17T01:50:05.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.566+0000 7f02e1bba740 1 -- 172.21.15.42:0/3925253952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a473390 msgr2=0x555e9a861730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:05.569 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.566+0000 7f02e1bba740 1 --2- 172.21.15.42:0/3925253952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a473390 0x555e9a861730 secure :-1 s=READY pgs=2600 cs=0 l=1 rev1=1 crypto rx=0x7f02c4098420 tx=0x7f02c40617c0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.566+0000 7f02e1bba740 1 -- 172.21.15.42:0/3925253952 shutdown_connections 2024-09-17T01:50:05.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.566+0000 7f02e1bba740 1 --2- 172.21.15.42:0/3925253952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555e9a44a4d0 0x555e9a844400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.566+0000 7f02e1bba740 1 --2- 172.21.15.42:0/3925253952 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555e9a4526b0 0x555e9a844940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.566+0000 7f02e1bba740 1 --2- 172.21.15.42:0/3925253952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a473390 0x555e9a861730 unknown :-1 s=CLOSED pgs=2600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.566+0000 7f02e1bba740 1 -- 172.21.15.42:0/3925253952 >> 172.21.15.42:0/3925253952 conn(0x555e9a4674e0 msgr2=0x555e9a81a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:05.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.566+0000 7f02e1bba740 1 -- 172.21.15.42:0/3925253952 shutdown_connections 2024-09-17T01:50:05.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.566+0000 7f02e1bba740 1 -- 172.21.15.42:0/3925253952 wait complete. 2024-09-17T01:50:05.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.567+0000 7f02e1bba740 1 -- start start 2024-09-17T01:50:05.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.567+0000 7f02e1bba740 1 Processor -- start 2024-09-17T01:50:05.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.569+0000 7f02e1bba740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a44a4d0 0x555e9a871d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.569+0000 7f02e1bba740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555e9a4526b0 0x555e9a86f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.569+0000 7f02e1bba740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555e9a473390 0x555e9a841360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.569+0000 7f02e1bba740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555e9a723410 con 0x555e9a44a4d0 2024-09-17T01:50:05.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.569+0000 7f02e1bba740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555e9a780ab0 con 0x555e9a473390 2024-09-17T01:50:05.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.569+0000 7f02e1bba740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x555e9a4ed740 con 0x555e9a4526b0 2024-09-17T01:50:05.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.569+0000 7f02e1bba740 10 client.0 _ll_register_callbacks cb 0x555e9a700360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:50:05.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.569+0000 7f02d3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a44a4d0 0x555e9a871d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.579 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.569+0000 7f02d3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a44a4d0 0x555e9a871d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59312/0 (socket says 172.21.15.42:59312) 2024-09-17T01:50:05.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.569+0000 7f02d3e00640 1 -- 172.21.15.42:0/1785571509 learned_addr learned my addr 172.21.15.42:0/1785571509 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:05.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.570+0000 7f02d8c00640 1 --2- 172.21.15.42:0/1785571509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555e9a473390 0x555e9a841360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.570+0000 7f02d3e00640 1 -- 172.21.15.42:0/1785571509 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555e9a4526b0 msgr2=0x555e9a86f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:05.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.570+0000 7f02cb400640 1 --2- 172.21.15.42:0/1785571509 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555e9a4526b0 0x555e9a86f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.570+0000 7f02d3e00640 1 --2- 172.21.15.42:0/1785571509 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555e9a4526b0 0x555e9a86f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.570+0000 7f02d3e00640 1 -- 172.21.15.42:0/1785571509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555e9a473390 msgr2=0x555e9a841360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.570+0000 7f02d3e00640 1 --2- 172.21.15.42:0/1785571509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555e9a473390 0x555e9a841360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.570+0000 7f02d3e00640 1 -- 172.21.15.42:0/1785571509 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e9a4de970 con 0x555e9a44a4d0 2024-09-17T01:50:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.570+0000 7f02d8c00640 1 --2- 172.21.15.42:0/1785571509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555e9a473390 0x555e9a841360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:50:05.581 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.570+0000 7f02cb400640 1 --2- 172.21.15.42:0/1785571509 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555e9a4526b0 0x555e9a86f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:50:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.570+0000 7f02d3e00640 1 --2- 172.21.15.42:0/1785571509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a44a4d0 0x555e9a871d50 secure :-1 s=READY pgs=2601 cs=0 l=1 rev1=1 crypto rx=0x7f02c4001270 tx=0x7f02c40842e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dede31c21fbfe90 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.570+0000 7f02c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:50:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.570+0000 7f02c0c00640 1 -- 172.21.15.42:0/1785571509 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c407b070 con 0x555e9a44a4d0 2024-09-17T01:50:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.570+0000 7f02c0c00640 1 -- 172.21.15.42:0/1785571509 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f02c4082b80 con 0x555e9a44a4d0 2024-09-17T01:50:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.570+0000 7f02e1bba740 1 -- 172.21.15.42:0/1785571509 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02c40667e0 con 0x555e9a44a4d0 2024-09-17T01:50:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.570+0000 7f02c0c00640 1 -- 172.21.15.42:0/1785571509 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=183) ==== 24+0+0 (secure 0 0 0) 0x7f02c406b690 con 0x555e9a44a4d0 2024-09-17T01:50:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.570+0000 7f02e1bba740 10 client.11784 fetch_fsmap learned FSMap version 183 2024-09-17T01:50:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.570+0000 7f02e1bba740 1 -- 172.21.15.42:0/1785571509 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=183,monmap=2+}) -- 0x555e9a4bc6a0 con 0x555e9a44a4d0 2024-09-17T01:50:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.571+0000 7f02c0c00640 1 -- 172.21.15.42:0/1785571509 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02c40667e0 con 0x555e9a44a4d0 2024-09-17T01:50:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.571+0000 7f02c0c00640 1 -- 172.21.15.42:0/1785571509 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 183) ==== 3502+0+0 (secure 0 0 0) 0x7f02c4061010 con 0x555e9a44a4d0 2024-09-17T01:50:05.582 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.571+0000 7f02e1bba740 10 client.11784 fetch_fsmap finished waiting for FSMap version 183 2024-09-17T01:50:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.571+0000 7f02e1bba740 10 client.11784 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.d 2024-09-17T01:50:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.571+0000 7f02e1bba740 20 client.11784 populate_metadata read hostname 'smithi042' 2024-09-17T01:50:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.571+0000 7f02e1bba740 1 --2- 172.21.15.42:0/1785571509 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x555e9a431f60 0x555e9a840460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.571+0000 7f02e1bba740 4 client.11784 mds_command: new command op to 11517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:50:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.571+0000 7f02e1bba740 1 -- 172.21.15.42:0/1785571509 --> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e9a78f7c0 con 0x555e9a431f60 2024-09-17T01:50:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.571+0000 7f02cb400640 1 --2- 172.21.15.42:0/1785571509 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x555e9a431f60 0x555e9a840460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.572+0000 7f02cb400640 1 --2- 172.21.15.42:0/1785571509 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x555e9a431f60 0x555e9a840460 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=449ea09182062b8b server_cookie=86f5187eee6467b0 in_seq=0 out_seq=0 2024-09-17T01:50:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.572+0000 7f02c0c00640 10 client.11784 ms_handle_connect on v2:172.21.15.43:6834/4082001755 2024-09-17T01:50:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.573+0000 7f02c0c00640 1 -- 172.21.15.42:0/1785571509 <== mds.0 v2:172.21.15.43:6834/4082001755 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555e9a78f7c0 con 0x555e9a431f60 2024-09-17T01:50:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.573+0000 7f02c0c00640 10 client.11784 handle_command_reply: tid=0 2024-09-17T01:50:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.573+0000 7f02e1bba740 1 client.11784 shutdown 2024-09-17T01:50:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.573+0000 7f02e1bba740 1 -- 172.21.15.42:0/1785571509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a44a4d0 msgr2=0x555e9a871d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:05.583 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.573+0000 7f02e1bba740 1 --2- 172.21.15.42:0/1785571509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a44a4d0 0x555e9a871d50 secure :-1 s=READY pgs=2601 cs=0 l=1 rev1=1 crypto rx=0x7f02c4001270 tx=0x7f02c40842e0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.573+0000 7f02e1bba740 1 -- 172.21.15.42:0/1785571509 shutdown_connections 2024-09-17T01:50:05.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.573+0000 7f02e1bba740 1 --2- 172.21.15.42:0/1785571509 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x555e9a431f60 0x555e9a840460 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.573+0000 7f02e1bba740 1 --2- 172.21.15.42:0/1785571509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555e9a473390 0x555e9a841360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.573+0000 7f02e1bba740 1 --2- 172.21.15.42:0/1785571509 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555e9a4526b0 0x555e9a86f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.573+0000 7f02e1bba740 1 --2- 172.21.15.42:0/1785571509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a44a4d0 0x555e9a871d50 unknown :-1 s=CLOSED pgs=2601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.573+0000 7f02c0c00640 0 client.11784 ms_handle_reset on v2:172.21.15.43:6834/4082001755 2024-09-17T01:50:05.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.573+0000 7f02e1bba740 1 -- 172.21.15.42:0/1785571509 >> 172.21.15.42:0/1785571509 conn(0x555e9a4674e0 msgr2=0x555e9a844400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:05.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.573+0000 7f02e1bba740 1 -- 172.21.15.42:0/1785571509 shutdown_connections 2024-09-17T01:50:05.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.573+0000 7f02e1bba740 1 -- 172.21.15.42:0/1785571509 wait complete. 2024-09-17T01:50:05.584 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.574+0000 7f02e1bba740 20 client.11784 trim_cache size 0 max 16384 2024-09-17T01:50:05.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.592+0000 7f02e1bba740 1 Processor -- start 2024-09-17T01:50:05.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.592+0000 7f02e1bba740 1 -- start start 2024-09-17T01:50:05.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.593+0000 7f02e1bba740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555e9a44a4d0 0x555e9a814f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.593+0000 7f02e1bba740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555e9a4526b0 0x555e9a81a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.594+0000 7f02e1bba740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a473390 0x555e9a81aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.594+0000 7f02e1bba740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f02d4202370 con 0x555e9a473390 2024-09-17T01:50:05.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.594+0000 7f02e1bba740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f02d4201400 con 0x555e9a4526b0 2024-09-17T01:50:05.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.594+0000 7f02e1bba740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f02d415a5d0 con 0x555e9a44a4d0 2024-09-17T01:50:05.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.594+0000 7f02d8c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a473390 0x555e9a81aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.594+0000 7f02d8c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a473390 0x555e9a81aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59324/0 (socket says 172.21.15.42:59324) 2024-09-17T01:50:05.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.594+0000 7f02d8c00640 1 -- 172.21.15.42:0/3874411509 learned_addr learned my addr 172.21.15.42:0/3874411509 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:05.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.594+0000 7f02d3e00640 1 --2- 172.21.15.42:0/3874411509 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555e9a44a4d0 0x555e9a814f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.594+0000 7f02cb400640 1 --2- 172.21.15.42:0/3874411509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555e9a4526b0 0x555e9a81a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.594+0000 7f02d8c00640 1 -- 172.21.15.42:0/3874411509 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555e9a44a4d0 msgr2=0x555e9a814f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:05.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.594+0000 7f02d8c00640 1 --2- 172.21.15.42:0/3874411509 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555e9a44a4d0 0x555e9a814f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.594+0000 7f02d8c00640 1 -- 172.21.15.42:0/3874411509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555e9a4526b0 msgr2=0x555e9a81a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:05.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.594+0000 7f02d8c00640 1 --2- 172.21.15.42:0/3874411509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555e9a4526b0 0x555e9a81a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.594+0000 7f02d8c00640 1 -- 172.21.15.42:0/3874411509 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e9a817ac0 con 0x555e9a473390 2024-09-17T01:50:05.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.595+0000 7f02d8c00640 1 --2- 172.21.15.42:0/3874411509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a473390 0x555e9a81aab0 secure :-1 s=READY pgs=2602 cs=0 l=1 rev1=1 crypto rx=0x7f02cc005fd0 tx=0x7f02cc003e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ba45176d35c8f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:05.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.595+0000 7f02c3400640 1 -- 172.21.15.42:0/3874411509 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc004530 con 0x555e9a473390 2024-09-17T01:50:05.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.595+0000 7f02c3400640 1 -- 172.21.15.42:0/3874411509 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02cc0046d0 con 0x555e9a473390 2024-09-17T01:50:05.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.595+0000 7f02c3400640 1 -- 172.21.15.42:0/3874411509 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc010670 con 0x555e9a473390 2024-09-17T01:50:05.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.595+0000 7f02e1bba740 1 -- 172.21.15.42:0/3874411509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a473390 msgr2=0x555e9a81aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:05.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.595+0000 7f02e1bba740 1 --2- 172.21.15.42:0/3874411509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a473390 0x555e9a81aab0 secure :-1 s=READY pgs=2602 cs=0 l=1 rev1=1 crypto rx=0x7f02cc005fd0 tx=0x7f02cc003e00 comp rx=0 tx=0).stop 2024-09-17T01:50:05.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.596+0000 7f02e1bba740 1 -- 172.21.15.42:0/3874411509 shutdown_connections 2024-09-17T01:50:05.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.596+0000 7f02e1bba740 1 --2- 172.21.15.42:0/3874411509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555e9a4526b0 0x555e9a81a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.596+0000 7f02e1bba740 1 --2- 172.21.15.42:0/3874411509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a473390 0x555e9a81aab0 unknown :-1 s=CLOSED pgs=2602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.596+0000 7f02e1bba740 1 --2- 172.21.15.42:0/3874411509 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555e9a44a4d0 0x555e9a814f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.596+0000 7f02e1bba740 1 -- 172.21.15.42:0/3874411509 >> 172.21.15.42:0/3874411509 conn(0x555e9a4674e0 msgr2=0x555e9a844400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:05.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.596+0000 7f02e1bba740 1 -- 172.21.15.42:0/3874411509 shutdown_connections 2024-09-17T01:50:05.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.596+0000 7f02e1bba740 1 -- 172.21.15.42:0/3874411509 wait complete. 2024-09-17T01:50:05.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.597+0000 7f02e1bba740 1 -- start start 2024-09-17T01:50:05.597 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.597+0000 7f02e1bba740 1 Processor -- start 2024-09-17T01:50:05.599 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.598+0000 7f02e1bba740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555e9a44a4d0 0x555e9a85fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.598+0000 7f02e1bba740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a4526b0 0x555e9a8d4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.598+0000 7f02e1bba740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555e9a473390 0x555e9a834180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.598+0000 7f02e1bba740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f02d415c160 con 0x555e9a4526b0 2024-09-17T01:50:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.598+0000 7f02e1bba740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555e9a8147c0 con 0x555e9a44a4d0 2024-09-17T01:50:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.598+0000 7f02e1bba740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x555e9a8de4b0 con 0x555e9a473390 2024-09-17T01:50:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.598+0000 7f02e1bba740 10 client.0 _ll_register_callbacks cb 0x7f02c4087070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:50:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.599+0000 7f02cb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a4526b0 0x555e9a8d4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.599+0000 7f02cb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a4526b0 0x555e9a8d4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59326/0 (socket says 172.21.15.42:59326) 2024-09-17T01:50:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.599+0000 7f02cb400640 1 -- 172.21.15.42:0/3332182935 learned_addr learned my addr 172.21.15.42:0/3332182935 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.599+0000 7f02d8c00640 1 --2- 172.21.15.42:0/3332182935 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555e9a473390 0x555e9a834180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.599+0000 7f02d3e00640 1 --2- 172.21.15.42:0/3332182935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555e9a44a4d0 0x555e9a85fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.600 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.599+0000 7f02cb400640 1 -- 172.21.15.42:0/3332182935 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555e9a473390 msgr2=0x555e9a834180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:05.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.599+0000 7f02cb400640 1 --2- 172.21.15.42:0/3332182935 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555e9a473390 0x555e9a834180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.599+0000 7f02cb400640 1 -- 172.21.15.42:0/3332182935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555e9a44a4d0 msgr2=0x555e9a85fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:05.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.599+0000 7f02cb400640 1 --2- 172.21.15.42:0/3332182935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555e9a44a4d0 0x555e9a85fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.599+0000 7f02cb400640 1 -- 172.21.15.42:0/3332182935 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e9a878b00 con 0x555e9a4526b0 2024-09-17T01:50:05.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.599+0000 7f02d3e00640 1 --2- 172.21.15.42:0/3332182935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555e9a44a4d0 0x555e9a85fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:05.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.599+0000 7f02cb400640 1 --2- 172.21.15.42:0/3332182935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a4526b0 0x555e9a8d4e00 secure :-1 s=READY pgs=2603 cs=0 l=1 rev1=1 crypto rx=0x7f02bc000c00 tx=0x7f02bc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9e8d772839cc86 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:05.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.599+0000 7f02c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:50:05.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.600+0000 7f02c0c00640 1 -- 172.21.15.42:0/3332182935 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc035040 con 0x555e9a4526b0 2024-09-17T01:50:05.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.600+0000 7f02c0c00640 1 -- 172.21.15.42:0/3332182935 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f02bc05ab90 con 0x555e9a4526b0 2024-09-17T01:50:05.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.600+0000 7f02e1bba740 1 -- 172.21.15.42:0/3332182935 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02cc0046d0 con 0x555e9a4526b0 2024-09-17T01:50:05.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.600+0000 7f02c0c00640 1 -- 172.21.15.42:0/3332182935 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=183) ==== 24+0+0 (secure 0 0 0) 0x7f02bc05ad90 con 0x555e9a4526b0 2024-09-17T01:50:05.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.600+0000 7f02e1bba740 10 client.11790 fetch_fsmap learned FSMap version 183 2024-09-17T01:50:05.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.600+0000 7f02e1bba740 1 -- 172.21.15.42:0/3332182935 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=183,monmap=2+}) -- 0x555e9a8df250 con 0x555e9a4526b0 2024-09-17T01:50:05.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.600+0000 7f02c0c00640 1 -- 172.21.15.42:0/3332182935 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02cc0046d0 con 0x555e9a4526b0 2024-09-17T01:50:05.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.600+0000 7f02c0c00640 1 -- 172.21.15.42:0/3332182935 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 183) ==== 3502+0+0 (secure 0 0 0) 0x7f02bc003ac0 con 0x555e9a4526b0 2024-09-17T01:50:05.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.600+0000 7f02e1bba740 10 client.11790 fetch_fsmap finished waiting for FSMap version 183 2024-09-17T01:50:05.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.600+0000 7f02e1bba740 10 client.11790 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.d 2024-09-17T01:50:05.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.600+0000 7f02e1bba740 20 client.11790 populate_metadata read hostname 'smithi042' 2024-09-17T01:50:05.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.600+0000 7f02e1bba740 1 --2- 172.21.15.42:0/3332182935 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x555e9a8346c0 0x555e9a813830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.600+0000 7f02e1bba740 4 client.11790 mds_command: new command op to 11517 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:50:05.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.600+0000 7f02e1bba740 1 -- 172.21.15.42:0/3332182935 --> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555e9a78b270 con 0x555e9a8346c0 2024-09-17T01:50:05.602 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.601+0000 7f02d3e00640 1 --2- 172.21.15.42:0/3332182935 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x555e9a8346c0 0x555e9a813830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.601+0000 7f02d3e00640 1 --2- 172.21.15.42:0/3332182935 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x555e9a8346c0 0x555e9a813830 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf80e8b4725b0703 server_cookie=2d7c6fa6d31b6d3b in_seq=0 out_seq=0 2024-09-17T01:50:05.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.601+0000 7f02c0c00640 10 client.11790 ms_handle_connect on v2:172.21.15.43:6834/4082001755 2024-09-17T01:50:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.602+0000 7f02c0c00640 1 -- 172.21.15.42:0/3332182935 <== mds.0 v2:172.21.15.43:6834/4082001755 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x555e9a78b270 con 0x555e9a8346c0 2024-09-17T01:50:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.602+0000 7f02c0c00640 10 client.11790 handle_command_reply: tid=0 2024-09-17T01:50:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.602+0000 7f02e1bba740 1 client.11790 shutdown 2024-09-17T01:50:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.602+0000 7f02e1bba740 1 -- 172.21.15.42:0/3332182935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a4526b0 msgr2=0x555e9a8d4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.602+0000 7f02e1bba740 1 --2- 172.21.15.42:0/3332182935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a4526b0 0x555e9a8d4e00 secure :-1 s=READY pgs=2603 cs=0 l=1 rev1=1 crypto rx=0x7f02bc000c00 tx=0x7f02bc009260 comp rx=0 tx=0).stop 2024-09-17T01:50:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.602+0000 7f02e1bba740 1 -- 172.21.15.42:0/3332182935 shutdown_connections 2024-09-17T01:50:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.602+0000 7f02e1bba740 1 --2- 172.21.15.42:0/3332182935 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x555e9a8346c0 0x555e9a813830 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.602+0000 7f02e1bba740 1 --2- 172.21.15.42:0/3332182935 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x555e9a473390 0x555e9a834180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.602+0000 7f02e1bba740 1 --2- 172.21.15.42:0/3332182935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555e9a4526b0 0x555e9a8d4e00 unknown :-1 s=CLOSED pgs=2603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.602+0000 7f02e1bba740 1 --2- 172.21.15.42:0/3332182935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555e9a44a4d0 0x555e9a85fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.602+0000 7f02c0c00640 0 client.11790 ms_handle_reset on v2:172.21.15.43:6834/4082001755 2024-09-17T01:50:05.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.602+0000 7f02e1bba740 1 -- 172.21.15.42:0/3332182935 >> 172.21.15.42:0/3332182935 conn(0x555e9a4674e0 msgr2=0x555e9a8719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:05.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.602+0000 7f02e1bba740 1 -- 172.21.15.42:0/3332182935 shutdown_connections 2024-09-17T01:50:05.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.602+0000 7f02e1bba740 1 -- 172.21.15.42:0/3332182935 wait complete. 2024-09-17T01:50:05.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.602+0000 7f02e1bba740 20 client.11790 trim_cache size 0 max 16384 2024-09-17T01:50:05.605 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:50:05.605 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-09-17T01:50:05.605 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {}, 2024-09-17T01:50:05.605 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_stats": { 2024-09-17T01:50:05.605 INFO:teuthology.orchestra.run.smithi042.stdout: "e7620a81-dc19-43a9-a344-f1ffb93dfff2": { 2024-09-17T01:50:05.605 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:49:41.704309+0000", 2024-09-17T01:50:05.606 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-17T01:50:05.606 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:50:05.606 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:50:05.606 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:50:05.606 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:50:05.606 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:50:05.606 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:50:05.606 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:50:05.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.603+0000 7f02d9600640 1 -- 172.21.15.42:0/793919880 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f02b0078bc0 msgr2=0x7f02b007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:05.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.603+0000 7f02d9600640 1 --2- 172.21.15.42:0/793919880 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f02b0078bc0 0x7f02b007b0d0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f02bc033000 tx=0x7f02bc004730 comp rx=0 tx=0).stop 2024-09-17T01:50:05.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.603+0000 7f02d9600640 1 -- 172.21.15.42:0/793919880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02d40af970 msgr2=0x7f02d41f5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:05.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.603+0000 7f02d9600640 1 --2- 172.21.15.42:0/793919880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02d40af970 0x7f02d41f5340 secure :-1 s=READY pgs=2599 cs=0 l=1 rev1=1 crypto rx=0x7f02c400c3f0 tx=0x7f02c400c8b0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.603+0000 7f02d9600640 1 -- 172.21.15.42:0/793919880 shutdown_connections 2024-09-17T01:50:05.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.603+0000 7f02d9600640 1 --2- 172.21.15.42:0/793919880 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f02b0078bc0 0x7f02b007b0d0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.603+0000 7f02d9600640 1 --2- 172.21.15.42:0/793919880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02d40b3520 0x7f02d415e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.603+0000 7f02d9600640 1 --2- 172.21.15.42:0/793919880 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f02d4160500 0x7f02d415e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.603+0000 7f02d9600640 1 --2- 172.21.15.42:0/793919880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f02d40af970 0x7f02d41f5340 unknown :-1 s=CLOSED pgs=2599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.603+0000 7f02d9600640 1 -- 172.21.15.42:0/793919880 >> 172.21.15.42:0/793919880 conn(0x7f02d406d3f0 msgr2=0x7f02d40b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:05.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.603+0000 7f02d9600640 1 -- 172.21.15.42:0/793919880 shutdown_connections 2024-09-17T01:50:05.608 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.603+0000 7f02d9600640 1 -- 172.21.15.42:0/793919880 wait complete. 2024-09-17T01:50:05.624 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T01:50:05.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:50:05.624 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.16:0 scrub start / recursive,repair 2024-09-17T01:50:05.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.858+0000 7f1791a00640 1 -- 172.21.15.42:0/2484511667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f178c160b40 msgr2=0x7f178c0ceaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:05.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.858+0000 7f1791a00640 1 --2- 172.21.15.42:0/2484511667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f178c160b40 0x7f178c0ceaf0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f1774009830 tx=0x7f177402a4b0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.857 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.858+0000 7f1791a00640 1 -- 172.21.15.42:0/2484511667 shutdown_connections 2024-09-17T01:50:05.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.858+0000 7f1791a00640 1 --2- 172.21.15.42:0/2484511667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f178c160b40 0x7f178c0ceaf0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.858+0000 7f1791a00640 1 -- 172.21.15.42:0/2484511667 >> 172.21.15.42:0/2484511667 conn(0x7f178c0b2530 msgr2=0x7f178c0b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:05.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.858+0000 7f1791a00640 1 -- 172.21.15.42:0/2484511667 shutdown_connections 2024-09-17T01:50:05.858 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.858+0000 7f1791a00640 1 -- 172.21.15.42:0/2484511667 wait complete. 2024-09-17T01:50:05.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.860+0000 7f1791a00640 1 Processor -- start 2024-09-17T01:50:05.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.860+0000 7f1791a00640 1 -- start start 2024-09-17T01:50:05.861 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.862+0000 7f1791a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f178c15c770 0x7f178c14e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.862+0000 7f1791a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f178c160b40 0x7f178c073bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.862+0000 7f1791a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f178c160f50 0x7f178c0ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.862+0000 7f1791a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f178c0cf8c0 con 0x7f178c160b40 2024-09-17T01:50:05.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.862+0000 7f1791a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f178c0cf740 con 0x7f178c160f50 2024-09-17T01:50:05.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.862+0000 7f1791a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f178c0cfa40 con 0x7f178c15c770 2024-09-17T01:50:05.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.862+0000 7f1783e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f178c160b40 0x7f178c073bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.862+0000 7f1783e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f178c160b40 0x7f178c073bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47638/0 (socket says 172.21.15.42:47638) 2024-09-17T01:50:05.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.862+0000 7f1783e00640 1 -- 172.21.15.42:0/2902575087 learned_addr learned my addr 172.21.15.42:0/2902575087 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:05.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.862+0000 7f178be00640 1 --2- 172.21.15.42:0/2902575087 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f178c15c770 0x7f178c14e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.862+0000 7f1791000640 1 --2- 172.21.15.42:0/2902575087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f178c160f50 0x7f178c0ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.863+0000 7f1783e00640 1 -- 172.21.15.42:0/2902575087 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f178c15c770 msgr2=0x7f178c14e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:05.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.863+0000 7f1783e00640 1 --2- 172.21.15.42:0/2902575087 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f178c15c770 0x7f178c14e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.863+0000 7f1783e00640 1 -- 172.21.15.42:0/2902575087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f178c160f50 msgr2=0x7f178c0ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:05.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.863+0000 7f1783e00640 1 --2- 172.21.15.42:0/2902575087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f178c160f50 0x7f178c0ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.863+0000 7f1783e00640 1 -- 172.21.15.42:0/2902575087 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f178c1fa010 con 0x7f178c160b40 2024-09-17T01:50:05.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.863+0000 7f1783e00640 1 --2- 172.21.15.42:0/2902575087 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f178c160b40 0x7f178c073bd0 secure :-1 s=READY pgs=2605 cs=0 l=1 rev1=1 crypto rx=0x7f1774009950 tx=0x7f1774003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:05.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.863+0000 7f1788c00640 1 -- 172.21.15.42:0/2902575087 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1774005c90 con 0x7f178c160b40 2024-09-17T01:50:05.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.863+0000 7f1788c00640 1 -- 172.21.15.42:0/2902575087 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1774005020 con 0x7f178c160b40 2024-09-17T01:50:05.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.863+0000 7f1791a00640 1 -- 172.21.15.42:0/2902575087 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f178c1f9250 con 0x7f178c160b40 2024-09-17T01:50:05.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.863+0000 7f1788c00640 1 -- 172.21.15.42:0/2902575087 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1774005450 con 0x7f178c160b40 2024-09-17T01:50:05.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.863+0000 7f1791a00640 1 -- 172.21.15.42:0/2902575087 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f178c1f9810 con 0x7f178c160b40 2024-09-17T01:50:05.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.866+0000 7f1788c00640 1 -- 172.21.15.42:0/2902575087 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f17740317c0 con 0x7f178c160b40 2024-09-17T01:50:05.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.867+0000 7f1788c00640 1 --2- 172.21.15.42:0/2902575087 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1768078b90 0x7f176807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.867+0000 7f1788c00640 1 -- 172.21.15.42:0/2902575087 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f17740bbef0 con 0x7f178c160b40 2024-09-17T01:50:05.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.867+0000 7f178be00640 1 --2- 172.21.15.42:0/2902575087 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1768078b90 0x7f176807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.867+0000 7f179a1df740 1 Processor -- start 2024-09-17T01:50:05.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.867+0000 7f179a1df740 1 -- start start 2024-09-17T01:50:05.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.868+0000 7f178be00640 1 --2- 172.21.15.42:0/2902575087 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1768078b90 0x7f176807b0a0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f177c001220 tx=0x7f177c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:05.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.869+0000 7f179a1df740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ab6d6df410 0x55ab6dace360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.869+0000 7f179a1df740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6b6550 0x55ab6dab1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.869+0000 7f179a1df740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ab6d6be730 0x55ab6dab1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.869+0000 7f179a1df740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ab6d9f9f40 con 0x55ab6d6b6550 2024-09-17T01:50:05.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.869+0000 7f179a1df740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ab6d9e9370 con 0x55ab6d6be730 2024-09-17T01:50:05.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.869+0000 7f179a1df740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55ab6d9ed180 con 0x55ab6d6df410 2024-09-17T01:50:05.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.869+0000 7f1783e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6b6550 0x55ab6dab1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.869+0000 7f1783e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6b6550 0x55ab6dab1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47650/0 (socket says 172.21.15.42:47650) 2024-09-17T01:50:05.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.869+0000 7f1783e00640 1 -- 172.21.15.42:0/906813027 learned_addr learned my addr 172.21.15.42:0/906813027 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:05.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.869+0000 7f178be00640 1 --2- 172.21.15.42:0/906813027 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ab6d6df410 0x55ab6dace360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.869+0000 7f1791000640 1 --2- 172.21.15.42:0/906813027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ab6d6be730 0x55ab6dab1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.870+0000 7f1783e00640 1 -- 172.21.15.42:0/906813027 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ab6d6df410 msgr2=0x55ab6dace360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:05.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.870+0000 7f1783e00640 1 --2- 172.21.15.42:0/906813027 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ab6d6df410 0x55ab6dace360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.870+0000 7f1783e00640 1 -- 172.21.15.42:0/906813027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ab6d6be730 msgr2=0x55ab6dab1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:05.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.870+0000 7f1783e00640 1 --2- 172.21.15.42:0/906813027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ab6d6be730 0x55ab6dab1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.870+0000 7f1783e00640 1 -- 172.21.15.42:0/906813027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab6d6db470 con 0x55ab6d6b6550 2024-09-17T01:50:05.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.870+0000 7f1783e00640 1 --2- 172.21.15.42:0/906813027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6b6550 0x55ab6dab1030 secure :-1 s=READY pgs=2606 cs=0 l=1 rev1=1 crypto rx=0x7f1774083830 tx=0x7f1774031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2528e164a986df server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:05.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.870+0000 7f1780c00640 1 -- 172.21.15.42:0/906813027 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1774048030 con 0x55ab6d6b6550 2024-09-17T01:50:05.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.870+0000 7f1780c00640 1 -- 172.21.15.42:0/906813027 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1774084230 con 0x55ab6d6b6550 2024-09-17T01:50:05.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.870+0000 7f1780c00640 1 -- 172.21.15.42:0/906813027 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1774084e60 con 0x55ab6d6b6550 2024-09-17T01:50:05.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.871+0000 7f179a1df740 1 -- 172.21.15.42:0/906813027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6b6550 msgr2=0x55ab6dab1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:05.871 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.871+0000 7f179a1df740 1 --2- 172.21.15.42:0/906813027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6b6550 0x55ab6dab1030 secure :-1 s=READY pgs=2606 cs=0 l=1 rev1=1 crypto rx=0x7f1774083830 tx=0x7f1774031400 comp rx=0 tx=0).stop 2024-09-17T01:50:05.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.871+0000 7f179a1df740 1 -- 172.21.15.42:0/906813027 shutdown_connections 2024-09-17T01:50:05.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.871+0000 7f179a1df740 1 --2- 172.21.15.42:0/906813027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ab6d6be730 0x55ab6dab1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.871+0000 7f179a1df740 1 --2- 172.21.15.42:0/906813027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6b6550 0x55ab6dab1030 unknown :-1 s=CLOSED pgs=2606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.871+0000 7f179a1df740 1 --2- 172.21.15.42:0/906813027 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ab6d6df410 0x55ab6dace360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.871+0000 7f179a1df740 1 -- 172.21.15.42:0/906813027 >> 172.21.15.42:0/906813027 conn(0x55ab6d6d3560 msgr2=0x55ab6da87250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:05.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.871+0000 7f179a1df740 1 -- 172.21.15.42:0/906813027 shutdown_connections 2024-09-17T01:50:05.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.871+0000 7f179a1df740 1 -- 172.21.15.42:0/906813027 wait complete. 2024-09-17T01:50:05.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.872+0000 7f179a1df740 1 -- start start 2024-09-17T01:50:05.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.872+0000 7f179a1df740 1 Processor -- start 2024-09-17T01:50:05.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.874+0000 7f179a1df740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ab6d6b6550 0x55ab6dac7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.874+0000 7f179a1df740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ab6d6be730 0x55ab6da86b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.874+0000 7f179a1df740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6df410 0x55ab6dacb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.874+0000 7f179a1df740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ab6d7597c0 con 0x55ab6d6df410 2024-09-17T01:50:05.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.874+0000 7f179a1df740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ab6d98eae0 con 0x55ab6d6b6550 2024-09-17T01:50:05.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.874+0000 7f179a1df740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55ab6d9f9f40 con 0x55ab6d6be730 2024-09-17T01:50:05.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.874+0000 7f179a1df740 10 client.0 _ll_register_callbacks cb 0x55ab6d99e5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:50:05.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.874+0000 7f1791000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6df410 0x55ab6dacb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.874+0000 7f1791000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6df410 0x55ab6dacb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47656/0 (socket says 172.21.15.42:47656) 2024-09-17T01:50:05.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.874+0000 7f1791000640 1 -- 172.21.15.42:0/4087426827 learned_addr learned my addr 172.21.15.42:0/4087426827 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:05.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.874+0000 7f1783e00640 1 --2- 172.21.15.42:0/4087426827 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ab6d6be730 0x55ab6da86b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.875 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.874+0000 7f178be00640 1 --2- 172.21.15.42:0/4087426827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ab6d6b6550 0x55ab6dac7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.875+0000 7f1791000640 1 -- 172.21.15.42:0/4087426827 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ab6d6be730 msgr2=0x55ab6da86b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:05.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.875+0000 7f1791000640 1 --2- 172.21.15.42:0/4087426827 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ab6d6be730 0x55ab6da86b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.875+0000 7f1791000640 1 -- 172.21.15.42:0/4087426827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ab6d6b6550 msgr2=0x55ab6dac7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:05.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.875+0000 7f1791000640 1 --2- 172.21.15.42:0/4087426827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ab6d6b6550 0x55ab6dac7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.875+0000 7f1791000640 1 -- 172.21.15.42:0/4087426827 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab6d7bf7e0 con 0x55ab6d6df410 2024-09-17T01:50:05.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.875+0000 7f178be00640 1 --2- 172.21.15.42:0/4087426827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ab6d6b6550 0x55ab6dac7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:05.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.875+0000 7f1791000640 1 --2- 172.21.15.42:0/4087426827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6df410 0x55ab6dacb4d0 secure :-1 s=READY pgs=2607 cs=0 l=1 rev1=1 crypto rx=0x7f178c0ce6a0 tx=0x7f17840018d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd28c2152953a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:05.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.875+0000 7f1779600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:50:05.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.875+0000 7f1779600640 1 -- 172.21.15.42:0/4087426827 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178401b060 con 0x55ab6d6df410 2024-09-17T01:50:05.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.875+0000 7f1779600640 1 -- 172.21.15.42:0/4087426827 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f1784016b70 con 0x55ab6d6df410 2024-09-17T01:50:05.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.875+0000 7f179a1df740 1 -- 172.21.15.42:0/4087426827 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1774084230 con 0x55ab6d6df410 2024-09-17T01:50:05.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.875+0000 7f1779600640 1 -- 172.21.15.42:0/4087426827 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=183) ==== 24+0+0 (secure 0 0 0) 0x7f1784016d90 con 0x55ab6d6df410 2024-09-17T01:50:05.876 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.875+0000 7f179a1df740 10 client.11802 fetch_fsmap learned FSMap version 183 2024-09-17T01:50:05.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.876+0000 7f179a1df740 1 -- 172.21.15.42:0/4087426827 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=183,monmap=2+}) -- 0x55ab6d81ff70 con 0x55ab6d6df410 2024-09-17T01:50:05.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.876+0000 7f1779600640 1 -- 172.21.15.42:0/4087426827 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1774084230 con 0x55ab6d6df410 2024-09-17T01:50:05.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.876+0000 7f1779600640 1 -- 172.21.15.42:0/4087426827 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 183) ==== 3502+0+0 (secure 0 0 0) 0x7f17840143c0 con 0x55ab6d6df410 2024-09-17T01:50:05.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.876+0000 7f179a1df740 10 client.11802 fetch_fsmap finished waiting for FSMap version 183 2024-09-17T01:50:05.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.876+0000 7f179a1df740 10 client.11802 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.d 2024-09-17T01:50:05.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.876+0000 7f179a1df740 20 client.11802 populate_metadata read hostname 'smithi042' 2024-09-17T01:50:05.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.876+0000 7f179a1df740 1 --2- 172.21.15.42:0/4087426827 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55ab6d69e1f0 0x55ab6dacba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.876+0000 7f179a1df740 4 client.11802 mds_command: new command op to 11517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:50:05.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.876+0000 7f179a1df740 1 -- 172.21.15.42:0/4087426827 --> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab6d9fbe90 con 0x55ab6d69e1f0 2024-09-17T01:50:05.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.876+0000 7f178be00640 1 --2- 172.21.15.42:0/4087426827 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55ab6d69e1f0 0x55ab6dacba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.877+0000 7f178be00640 1 --2- 172.21.15.42:0/4087426827 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55ab6d69e1f0 0x55ab6dacba10 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c96902c374c83619 server_cookie=9cf61e7550bd5b03 in_seq=0 out_seq=0 2024-09-17T01:50:05.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.877+0000 7f1779600640 10 client.11802 ms_handle_connect on v2:172.21.15.43:6834/4082001755 2024-09-17T01:50:05.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.878+0000 7f1779600640 1 -- 172.21.15.42:0/4087426827 <== mds.0 v2:172.21.15.43:6834/4082001755 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ab6d9fbe90 con 0x55ab6d69e1f0 2024-09-17T01:50:05.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.878+0000 7f1779600640 10 client.11802 handle_command_reply: tid=0 2024-09-17T01:50:05.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.878+0000 7f179a1df740 1 client.11802 shutdown 2024-09-17T01:50:05.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.878+0000 7f179a1df740 1 -- 172.21.15.42:0/4087426827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6df410 msgr2=0x55ab6dacb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:05.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.878+0000 7f179a1df740 1 --2- 172.21.15.42:0/4087426827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6df410 0x55ab6dacb4d0 secure :-1 s=READY pgs=2607 cs=0 l=1 rev1=1 crypto rx=0x7f178c0ce6a0 tx=0x7f17840018d0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.878+0000 7f179a1df740 1 -- 172.21.15.42:0/4087426827 shutdown_connections 2024-09-17T01:50:05.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.878+0000 7f179a1df740 1 --2- 172.21.15.42:0/4087426827 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55ab6d69e1f0 0x55ab6dacba10 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.878+0000 7f179a1df740 1 --2- 172.21.15.42:0/4087426827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6df410 0x55ab6dacb4d0 unknown :-1 s=CLOSED pgs=2607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.878+0000 7f179a1df740 1 --2- 172.21.15.42:0/4087426827 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ab6d6be730 0x55ab6da86b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.878+0000 7f179a1df740 1 --2- 172.21.15.42:0/4087426827 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ab6d6b6550 0x55ab6dac7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.878+0000 7f1779600640 0 client.11802 ms_handle_reset on v2:172.21.15.43:6834/4082001755 2024-09-17T01:50:05.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.878+0000 7f179a1df740 1 -- 172.21.15.42:0/4087426827 >> 172.21.15.42:0/4087426827 conn(0x55ab6d6d3560 msgr2=0x55ab6daa1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:05.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.879+0000 7f179a1df740 1 -- 172.21.15.42:0/4087426827 shutdown_connections 2024-09-17T01:50:05.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.879+0000 7f179a1df740 1 -- 172.21.15.42:0/4087426827 wait complete. 2024-09-17T01:50:05.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.879+0000 7f179a1df740 20 client.11802 trim_cache size 0 max 16384 2024-09-17T01:50:05.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.897+0000 7f179a1df740 1 Processor -- start 2024-09-17T01:50:05.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.898+0000 7f179a1df740 1 -- start start 2024-09-17T01:50:05.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.899+0000 7f179a1df740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6b6550 0x55ab6daad7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.899+0000 7f179a1df740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ab6d6be730 0x55ab6dacf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.899+0000 7f179a1df740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ab6d6df410 0x55ab6dacf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.899+0000 7f179a1df740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f178c2022f0 con 0x55ab6d6b6550 2024-09-17T01:50:05.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.899+0000 7f179a1df740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f178c201460 con 0x55ab6d6df410 2024-09-17T01:50:05.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.899+0000 7f179a1df740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f178c072b20 con 0x55ab6d6be730 2024-09-17T01:50:05.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.899+0000 7f178be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6b6550 0x55ab6daad7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.899+0000 7f178be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6b6550 0x55ab6daad7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47662/0 (socket says 172.21.15.42:47662) 2024-09-17T01:50:05.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.899+0000 7f178be00640 1 -- 172.21.15.42:0/2641141847 learned_addr learned my addr 172.21.15.42:0/2641141847 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:05.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.899+0000 7f1783e00640 1 --2- 172.21.15.42:0/2641141847 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ab6d6be730 0x55ab6dacf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.899+0000 7f1791000640 1 --2- 172.21.15.42:0/2641141847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ab6d6df410 0x55ab6dacf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.900+0000 7f178be00640 1 -- 172.21.15.42:0/2641141847 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ab6d6be730 msgr2=0x55ab6dacf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:05.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.900+0000 7f178be00640 1 --2- 172.21.15.42:0/2641141847 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ab6d6be730 0x55ab6dacf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.900+0000 7f178be00640 1 -- 172.21.15.42:0/2641141847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ab6d6df410 msgr2=0x55ab6dacf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:05.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.900+0000 7f178be00640 1 --2- 172.21.15.42:0/2641141847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ab6d6df410 0x55ab6dacf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.900+0000 7f178be00640 1 -- 172.21.15.42:0/2641141847 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab6d728720 con 0x55ab6d6b6550 2024-09-17T01:50:05.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.900+0000 7f1791000640 1 --2- 172.21.15.42:0/2641141847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ab6d6df410 0x55ab6dacf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:50:05.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.900+0000 7f178be00640 1 --2- 172.21.15.42:0/2641141847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6b6550 0x55ab6daad7f0 secure :-1 s=READY pgs=2608 cs=0 l=1 rev1=1 crypto rx=0x7f177c0013c0 tx=0x7f177c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7135ab6ab03cc8a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:05.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.900+0000 7f177be00640 1 -- 172.21.15.42:0/2641141847 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c02f070 con 0x55ab6d6b6550 2024-09-17T01:50:05.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.900+0000 7f177be00640 1 -- 172.21.15.42:0/2641141847 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f177c0158b0 con 0x55ab6d6b6550 2024-09-17T01:50:05.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.900+0000 7f177be00640 1 -- 172.21.15.42:0/2641141847 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c00eea0 con 0x55ab6d6b6550 2024-09-17T01:50:05.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.901+0000 7f179a1df740 1 -- 172.21.15.42:0/2641141847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6b6550 msgr2=0x55ab6daad7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:05.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.901+0000 7f179a1df740 1 --2- 172.21.15.42:0/2641141847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6b6550 0x55ab6daad7f0 secure :-1 s=READY pgs=2608 cs=0 l=1 rev1=1 crypto rx=0x7f177c0013c0 tx=0x7f177c014000 comp rx=0 tx=0).stop 2024-09-17T01:50:05.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.901+0000 7f179a1df740 1 -- 172.21.15.42:0/2641141847 shutdown_connections 2024-09-17T01:50:05.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.901+0000 7f179a1df740 1 --2- 172.21.15.42:0/2641141847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ab6d6df410 0x55ab6dacf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.901+0000 7f179a1df740 1 --2- 172.21.15.42:0/2641141847 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ab6d6be730 0x55ab6dacf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.901+0000 7f179a1df740 1 --2- 172.21.15.42:0/2641141847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6b6550 0x55ab6daad7f0 unknown :-1 s=CLOSED pgs=2608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.901+0000 7f179a1df740 1 -- 172.21.15.42:0/2641141847 >> 172.21.15.42:0/2641141847 conn(0x55ab6d6d3560 msgr2=0x55ab6da7cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:05.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.901+0000 7f179a1df740 1 -- 172.21.15.42:0/2641141847 shutdown_connections 2024-09-17T01:50:05.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.901+0000 7f179a1df740 1 -- 172.21.15.42:0/2641141847 wait complete. 2024-09-17T01:50:05.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.902+0000 7f179a1df740 1 -- start start 2024-09-17T01:50:05.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.902+0000 7f179a1df740 1 Processor -- start 2024-09-17T01:50:05.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.904+0000 7f179a1df740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ab6d6b6550 0x55ab6db48220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.904+0000 7f179a1df740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6be730 0x55ab6dacf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.904+0000 7f179a1df740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ab6d6df410 0x55ab6dacf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.904+0000 7f179a1df740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f178c073170 con 0x55ab6d6be730 2024-09-17T01:50:05.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.904+0000 7f179a1df740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ab6daca8d0 con 0x55ab6d6b6550 2024-09-17T01:50:05.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.904+0000 7f179a1df740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55ab6dac4420 con 0x55ab6d6df410 2024-09-17T01:50:05.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.904+0000 7f179a1df740 10 client.0 _ll_register_callbacks cb 0x7f1784003af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:50:05.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.904+0000 7f1783e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6be730 0x55ab6dacf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.904+0000 7f1783e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6be730 0x55ab6dacf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47668/0 (socket says 172.21.15.42:47668) 2024-09-17T01:50:05.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.904+0000 7f1783e00640 1 -- 172.21.15.42:0/4147092259 learned_addr learned my addr 172.21.15.42:0/4147092259 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:05.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.904+0000 7f178be00640 1 --2- 172.21.15.42:0/4147092259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ab6d6b6550 0x55ab6db48220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.904+0000 7f1791000640 1 --2- 172.21.15.42:0/4147092259 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ab6d6df410 0x55ab6dacf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.904+0000 7f1783e00640 1 -- 172.21.15.42:0/4147092259 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ab6d6df410 msgr2=0x55ab6dacf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:05.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.904+0000 7f1783e00640 1 --2- 172.21.15.42:0/4147092259 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ab6d6df410 0x55ab6dacf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.904+0000 7f1783e00640 1 -- 172.21.15.42:0/4147092259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ab6d6b6550 msgr2=0x55ab6db48220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:05.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.904+0000 7f1783e00640 1 --2- 172.21.15.42:0/4147092259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ab6d6b6550 0x55ab6db48220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.904+0000 7f1783e00640 1 -- 172.21.15.42:0/4147092259 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab6dac3f50 con 0x55ab6d6be730 2024-09-17T01:50:05.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.904+0000 7f1783e00640 1 --2- 172.21.15.42:0/4147092259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6be730 0x55ab6dacf3c0 secure :-1 s=READY pgs=2609 cs=0 l=1 rev1=1 crypto rx=0x7f1774080da0 tx=0x7f17740832c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe208a1e1c2cdc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:05.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.904+0000 7f1779600640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:50:05.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.905+0000 7f1779600640 1 -- 172.21.15.42:0/4147092259 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17740a1030 con 0x55ab6d6be730 2024-09-17T01:50:05.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.905+0000 7f1779600640 1 -- 172.21.15.42:0/4147092259 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f1774083d90 con 0x55ab6d6be730 2024-09-17T01:50:05.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.905+0000 7f179a1df740 1 -- 172.21.15.42:0/4147092259 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f177c0158b0 con 0x55ab6d6be730 2024-09-17T01:50:05.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.905+0000 7f1779600640 1 -- 172.21.15.42:0/4147092259 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=183) ==== 24+0+0 (secure 0 0 0) 0x7f1774092050 con 0x55ab6d6be730 2024-09-17T01:50:05.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.905+0000 7f179a1df740 10 client.11808 fetch_fsmap learned FSMap version 183 2024-09-17T01:50:05.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.905+0000 7f179a1df740 1 -- 172.21.15.42:0/4147092259 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=183,monmap=2+}) -- 0x55ab6daa0280 con 0x55ab6d6be730 2024-09-17T01:50:05.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.905+0000 7f1779600640 1 -- 172.21.15.42:0/4147092259 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f177c0158b0 con 0x55ab6d6be730 2024-09-17T01:50:05.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.905+0000 7f1779600640 1 -- 172.21.15.42:0/4147092259 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 183) ==== 3502+0+0 (secure 0 0 0) 0x7f1774095020 con 0x55ab6d6be730 2024-09-17T01:50:05.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.905+0000 7f179a1df740 10 client.11808 fetch_fsmap finished waiting for FSMap version 183 2024-09-17T01:50:05.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.905+0000 7f179a1df740 10 client.11808 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.d 2024-09-17T01:50:05.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.905+0000 7f179a1df740 20 client.11808 populate_metadata read hostname 'smithi042' 2024-09-17T01:50:05.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.905+0000 7f179a1df740 1 --2- 172.21.15.42:0/4147092259 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55ab6db4b150 0x55ab6db4b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:05.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.905+0000 7f179a1df740 4 client.11808 mds_command: new command op to 11517 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2024-09-17T01:50:05.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.905+0000 7f179a1df740 1 -- 172.21.15.42:0/4147092259 --> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) -- 0x55ab6dac8860 con 0x55ab6db4b150 2024-09-17T01:50:05.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.906+0000 7f178be00640 1 --2- 172.21.15.42:0/4147092259 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55ab6db4b150 0x55ab6db4b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:05.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.907+0000 7f178be00640 1 --2- 172.21.15.42:0/4147092259 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55ab6db4b150 0x55ab6db4b560 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af408ca730a4de3a server_cookie=8831f33c6dea9c3c in_seq=0 out_seq=0 2024-09-17T01:50:05.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.907+0000 7f1779600640 10 client.11808 ms_handle_connect on v2:172.21.15.43:6834/4082001755 2024-09-17T01:50:05.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.907+0000 7f1779600640 1 -- 172.21.15.42:0/4147092259 <== mds.0 v2:172.21.15.43:6834/4082001755 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ab6dac8860 con 0x55ab6db4b150 2024-09-17T01:50:05.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.907+0000 7f1779600640 10 client.11808 handle_command_reply: tid=0 2024-09-17T01:50:05.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.907+0000 7f179a1df740 1 client.11808 shutdown 2024-09-17T01:50:05.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.908+0000 7f179a1df740 1 -- 172.21.15.42:0/4147092259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6be730 msgr2=0x55ab6dacf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:05.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.908+0000 7f179a1df740 1 --2- 172.21.15.42:0/4147092259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6be730 0x55ab6dacf3c0 secure :-1 s=READY pgs=2609 cs=0 l=1 rev1=1 crypto rx=0x7f1774080da0 tx=0x7f17740832c0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.908+0000 7f179a1df740 1 -- 172.21.15.42:0/4147092259 shutdown_connections 2024-09-17T01:50:05.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.908+0000 7f179a1df740 1 --2- 172.21.15.42:0/4147092259 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55ab6db4b150 0x55ab6db4b560 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.908+0000 7f179a1df740 1 --2- 172.21.15.42:0/4147092259 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55ab6d6df410 0x55ab6dacf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.908+0000 7f179a1df740 1 --2- 172.21.15.42:0/4147092259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ab6d6be730 0x55ab6dacf3c0 unknown :-1 s=CLOSED pgs=2609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.908+0000 7f179a1df740 1 --2- 172.21.15.42:0/4147092259 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ab6d6b6550 0x55ab6db48220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.908+0000 7f1779600640 0 client.11808 ms_handle_reset on v2:172.21.15.43:6834/4082001755 2024-09-17T01:50:05.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.908+0000 7f179a1df740 1 -- 172.21.15.42:0/4147092259 >> 172.21.15.42:0/4147092259 conn(0x55ab6d6d3560 msgr2=0x55ab6dac7670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:05.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.908+0000 7f179a1df740 1 -- 172.21.15.42:0/4147092259 shutdown_connections 2024-09-17T01:50:05.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.908+0000 7f179a1df740 1 -- 172.21.15.42:0/4147092259 wait complete. 2024-09-17T01:50:05.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.908+0000 7f179a1df740 20 client.11808 trim_cache size 0 max 16384 2024-09-17T01:50:05.910 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:50:05.910 INFO:teuthology.orchestra.run.smithi042.stdout: "return_code": 0, 2024-09-17T01:50:05.910 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_tag": "01c320cd-fa68-4bd5-8f83-7093367c7109", 2024-09-17T01:50:05.910 INFO:teuthology.orchestra.run.smithi042.stdout: "mode": "asynchronous" 2024-09-17T01:50:05.910 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:50:05.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.908+0000 7f1791a00640 1 -- 172.21.15.42:0/2902575087 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1768078b90 msgr2=0x7f176807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:05.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.908+0000 7f1791a00640 1 --2- 172.21.15.42:0/2902575087 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1768078b90 0x7f176807b0a0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f177c001220 tx=0x7f177c009040 comp rx=0 tx=0).stop 2024-09-17T01:50:05.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.908+0000 7f1791a00640 1 -- 172.21.15.42:0/2902575087 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f178c160b40 msgr2=0x7f178c073bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:05.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.908+0000 7f1791a00640 1 --2- 172.21.15.42:0/2902575087 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f178c160b40 0x7f178c073bd0 secure :-1 s=READY pgs=2605 cs=0 l=1 rev1=1 crypto rx=0x7f1774009950 tx=0x7f1774003c10 comp rx=0 tx=0).stop 2024-09-17T01:50:05.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.909+0000 7f1791a00640 1 -- 172.21.15.42:0/2902575087 shutdown_connections 2024-09-17T01:50:05.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.909+0000 7f1791a00640 1 --2- 172.21.15.42:0/2902575087 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1768078b90 0x7f176807b0a0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.909+0000 7f1791a00640 1 --2- 172.21.15.42:0/2902575087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f178c160f50 0x7f178c0ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.909+0000 7f1791a00640 1 --2- 172.21.15.42:0/2902575087 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f178c160b40 0x7f178c073bd0 unknown :-1 s=CLOSED pgs=2605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.909+0000 7f1791a00640 1 --2- 172.21.15.42:0/2902575087 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f178c15c770 0x7f178c14e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:05.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.909+0000 7f1791a00640 1 -- 172.21.15.42:0/2902575087 >> 172.21.15.42:0/2902575087 conn(0x7f178c0b2530 msgr2=0x7f178c159df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:05.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.909+0000 7f1791a00640 1 -- 172.21.15.42:0/2902575087 shutdown_connections 2024-09-17T01:50:05.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:05.909+0000 7f1791a00640 1 -- 172.21.15.42:0/2902575087 wait complete. 2024-09-17T01:50:05.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:50:05.929 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.16:0 scrub status 2024-09-17T01:50:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.160+0000 7f28aaa00640 1 -- 172.21.15.42:0/3542520287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28a40b6250 msgr2=0x7f28a40b6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:06.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.160+0000 7f28aaa00640 1 --2- 172.21.15.42:0/3542520287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28a40b6250 0x7f28a40b6660 secure :-1 s=READY pgs=2610 cs=0 l=1 rev1=1 crypto rx=0x7f28a408dc40 tx=0x7f289c02aac0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.160+0000 7f28aaa00640 1 -- 172.21.15.42:0/3542520287 shutdown_connections 2024-09-17T01:50:06.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.160+0000 7f28aaa00640 1 --2- 172.21.15.42:0/3542520287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28a40b6250 0x7f28a40b6660 unknown :-1 s=CLOSED pgs=2610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.160+0000 7f28aaa00640 1 --2- 172.21.15.42:0/3542520287 >> v2:172.21.15.43:3300/0 conn(0x7f28a40b7c70 0x7f28a40b8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.160+0000 7f28aaa00640 1 -- 172.21.15.42:0/3542520287 >> 172.21.15.42:0/3542520287 conn(0x7f28a406d3f0 msgr2=0x7f28a40d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:06.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.160+0000 7f28aaa00640 1 -- 172.21.15.42:0/3542520287 shutdown_connections 2024-09-17T01:50:06.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.160+0000 7f28aaa00640 1 -- 172.21.15.42:0/3542520287 wait complete. 2024-09-17T01:50:06.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.162+0000 7f28aaa00640 1 Processor -- start 2024-09-17T01:50:06.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.162+0000 7f28aaa00640 1 -- start start 2024-09-17T01:50:06.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.164+0000 7f28aaa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28a40b6250 0x7f28a414cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:06.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.164+0000 7f28aaa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28a40b7c70 0x7f28a41612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:06.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.164+0000 7f28aaa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28a415eae0 0x7f28a41617e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:06.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.164+0000 7f28aaa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f28a40d37b0 con 0x7f28a40b6250 2024-09-17T01:50:06.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.164+0000 7f28aaa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f28a40d3930 con 0x7f28a40b7c70 2024-09-17T01:50:06.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.164+0000 7f28aaa00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f28a40d3ab0 con 0x7f28a415eae0 2024-09-17T01:50:06.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.164+0000 7f28a9600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28a40b6250 0x7f28a414cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:06.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.164+0000 7f28a9600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28a40b6250 0x7f28a414cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47688/0 (socket says 172.21.15.42:47688) 2024-09-17T01:50:06.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.164+0000 7f28a9600640 1 -- 172.21.15.42:0/3844095129 learned_addr learned my addr 172.21.15.42:0/3844095129 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:06.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.164+0000 7f28aa000640 1 --2- 172.21.15.42:0/3844095129 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28a415eae0 0x7f28a41617e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:06.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.164+0000 7f28a8c00640 1 --2- 172.21.15.42:0/3844095129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28a40b7c70 0x7f28a41612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:06.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.164+0000 7f28a9600640 1 -- 172.21.15.42:0/3844095129 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28a415eae0 msgr2=0x7f28a41617e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:06.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.164+0000 7f28a9600640 1 --2- 172.21.15.42:0/3844095129 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28a415eae0 0x7f28a41617e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.164+0000 7f28a9600640 1 -- 172.21.15.42:0/3844095129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28a40b7c70 msgr2=0x7f28a41612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:06.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.164+0000 7f28a9600640 1 --2- 172.21.15.42:0/3844095129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28a40b7c70 0x7f28a41612a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.164+0000 7f28a9600640 1 -- 172.21.15.42:0/3844095129 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a40cc7b0 con 0x7f28a40b6250 2024-09-17T01:50:06.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.164+0000 7f28a8c00640 1 --2- 172.21.15.42:0/3844095129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28a40b7c70 0x7f28a41612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:06.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.164+0000 7f28aa000640 1 --2- 172.21.15.42:0/3844095129 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28a415eae0 0x7f28a41617e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:06.165 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.165+0000 7f28a9600640 1 --2- 172.21.15.42:0/3844095129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28a40b6250 0x7f28a414cb60 secure :-1 s=READY pgs=2611 cs=0 l=1 rev1=1 crypto rx=0x7f289800c3a0 tx=0x7f289800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:06.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.165+0000 7f28a1600640 1 -- 172.21.15.42:0/3844095129 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2898017070 con 0x7f28a40b6250 2024-09-17T01:50:06.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.165+0000 7f28a1600640 1 -- 172.21.15.42:0/3844095129 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28980053c0 con 0x7f28a40b6250 2024-09-17T01:50:06.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.165+0000 7f28aaa00640 1 -- 172.21.15.42:0/3844095129 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a40cca90 con 0x7f28a40b6250 2024-09-17T01:50:06.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.165+0000 7f28a1600640 1 -- 172.21.15.42:0/3844095129 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2898003850 con 0x7f28a40b6250 2024-09-17T01:50:06.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.165+0000 7f28aaa00640 1 -- 172.21.15.42:0/3844095129 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a40cd050 con 0x7f28a40b6250 2024-09-17T01:50:06.166 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.168+0000 7f28a1600640 1 -- 172.21.15.42:0/3844095129 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f289801a070 con 0x7f28a40b6250 2024-09-17T01:50:06.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.168+0000 7f28a1600640 1 --2- 172.21.15.42:0/3844095129 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2884078bc0 0x7f288407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:06.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.169+0000 7f28a1600640 1 -- 172.21.15.42:0/3844095129 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f289809a1e0 con 0x7f28a40b6250 2024-09-17T01:50:06.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.169+0000 7f28b31ce740 1 Processor -- start 2024-09-17T01:50:06.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.169+0000 7f28a8c00640 1 --2- 172.21.15.42:0/3844095129 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2884078bc0 0x7f288407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:06.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.169+0000 7f28b31ce740 1 -- start start 2024-09-17T01:50:06.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.170+0000 7f28a8c00640 1 --2- 172.21.15.42:0/3844095129 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2884078bc0 0x7f288407b0d0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f28a40b83d0 tx=0x7f2890005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:06.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.170+0000 7f28b31ce740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9f26a5390 0x55b9f2a93730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:06.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.170+0000 7f28b31ce740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b9f267c4d0 0x55b9f2a76400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:06.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.170+0000 7f28b31ce740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f26846b0 0x55b9f2a76940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:06.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.170+0000 7f28b31ce740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b9f29ac1c0 con 0x55b9f26846b0 2024-09-17T01:50:06.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.170+0000 7f28b31ce740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b9f29bf870 con 0x55b9f26a5390 2024-09-17T01:50:06.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.170+0000 7f28b31ce740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55b9f29aeca0 con 0x55b9f267c4d0 2024-09-17T01:50:06.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.171+0000 7f28aa000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f26846b0 0x55b9f2a76940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:06.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.171+0000 7f28aa000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f26846b0 0x55b9f2a76940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47702/0 (socket says 172.21.15.42:47702) 2024-09-17T01:50:06.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.171+0000 7f28aa000640 1 -- 172.21.15.42:0/2015958831 learned_addr learned my addr 172.21.15.42:0/2015958831 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:06.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.171+0000 7f28a9600640 1 --2- 172.21.15.42:0/2015958831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9f26a5390 0x55b9f2a93730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:06.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.171+0000 7f28a8c00640 1 --2- 172.21.15.42:0/2015958831 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b9f267c4d0 0x55b9f2a76400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:06.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.171+0000 7f28aa000640 1 -- 172.21.15.42:0/2015958831 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b9f267c4d0 msgr2=0x55b9f2a76400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:06.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.171+0000 7f28aa000640 1 --2- 172.21.15.42:0/2015958831 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b9f267c4d0 0x55b9f2a76400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.171+0000 7f28aa000640 1 -- 172.21.15.42:0/2015958831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9f26a5390 msgr2=0x55b9f2a93730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:06.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.171+0000 7f28aa000640 1 --2- 172.21.15.42:0/2015958831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9f26a5390 0x55b9f2a93730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.171+0000 7f28aa000640 1 -- 172.21.15.42:0/2015958831 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9f27877d0 con 0x55b9f26846b0 2024-09-17T01:50:06.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.171+0000 7f28a8c00640 1 --2- 172.21.15.42:0/2015958831 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b9f267c4d0 0x55b9f2a76400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:06.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.171+0000 7f28aa000640 1 --2- 172.21.15.42:0/2015958831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f26846b0 0x55b9f2a76940 secure :-1 s=READY pgs=2612 cs=0 l=1 rev1=1 crypto rx=0x7f289c005fd0 tx=0x7f289c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3beddc0a0ab32e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:06.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.172+0000 7f2895c00640 1 -- 172.21.15.42:0/2015958831 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c045070 con 0x55b9f26846b0 2024-09-17T01:50:06.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.172+0000 7f2895c00640 1 -- 172.21.15.42:0/2015958831 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f289c02cab0 con 0x55b9f26846b0 2024-09-17T01:50:06.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.172+0000 7f2895c00640 1 -- 172.21.15.42:0/2015958831 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c02c820 con 0x55b9f26846b0 2024-09-17T01:50:06.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.172+0000 7f28b31ce740 1 -- 172.21.15.42:0/2015958831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f26846b0 msgr2=0x55b9f2a76940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:06.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.172+0000 7f28b31ce740 1 --2- 172.21.15.42:0/2015958831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f26846b0 0x55b9f2a76940 secure :-1 s=READY pgs=2612 cs=0 l=1 rev1=1 crypto rx=0x7f289c005fd0 tx=0x7f289c004a40 comp rx=0 tx=0).stop 2024-09-17T01:50:06.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.173+0000 7f28b31ce740 1 -- 172.21.15.42:0/2015958831 shutdown_connections 2024-09-17T01:50:06.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.173+0000 7f28b31ce740 1 --2- 172.21.15.42:0/2015958831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f26846b0 0x55b9f2a76940 unknown :-1 s=CLOSED pgs=2612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.173+0000 7f28b31ce740 1 --2- 172.21.15.42:0/2015958831 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b9f267c4d0 0x55b9f2a76400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.173+0000 7f28b31ce740 1 --2- 172.21.15.42:0/2015958831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9f26a5390 0x55b9f2a93730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.173+0000 7f28b31ce740 1 -- 172.21.15.42:0/2015958831 >> 172.21.15.42:0/2015958831 conn(0x55b9f26994e0 msgr2=0x55b9f2a4c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:06.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.173+0000 7f28b31ce740 1 -- 172.21.15.42:0/2015958831 shutdown_connections 2024-09-17T01:50:06.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.173+0000 7f28b31ce740 1 -- 172.21.15.42:0/2015958831 wait complete. 2024-09-17T01:50:06.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.174+0000 7f28b31ce740 1 -- start start 2024-09-17T01:50:06.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.174+0000 7f28b31ce740 1 Processor -- start 2024-09-17T01:50:06.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.175+0000 7f28b31ce740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f267c4d0 0x55b9f2aa4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:06.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.175+0000 7f28b31ce740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b9f26846b0 0x55b9f2a64960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:06.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.175+0000 7f28b31ce740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9f26a5390 0x55b9f2aa0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:06.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.175+0000 7f28b31ce740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b9f2955410 con 0x55b9f267c4d0 2024-09-17T01:50:06.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.175+0000 7f28b31ce740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b9f29b2ab0 con 0x55b9f26a5390 2024-09-17T01:50:06.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.175+0000 7f28b31ce740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55b9f271f740 con 0x55b9f26846b0 2024-09-17T01:50:06.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.175+0000 7f28b31ce740 10 client.0 _ll_register_callbacks cb 0x55b9f2932360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:50:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.176+0000 7f28a9600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f267c4d0 0x55b9f2aa4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.176+0000 7f28a9600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f267c4d0 0x55b9f2aa4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47712/0 (socket says 172.21.15.42:47712) 2024-09-17T01:50:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.176+0000 7f28a9600640 1 -- 172.21.15.42:0/1113399179 learned_addr learned my addr 172.21.15.42:0/1113399179 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.176+0000 7f28aa000640 1 --2- 172.21.15.42:0/1113399179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9f26a5390 0x55b9f2aa0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.176+0000 7f28a8c00640 1 --2- 172.21.15.42:0/1113399179 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b9f26846b0 0x55b9f2a64960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.176+0000 7f28a9600640 1 -- 172.21.15.42:0/1113399179 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b9f26846b0 msgr2=0x55b9f2a64960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.176+0000 7f28a9600640 1 --2- 172.21.15.42:0/1113399179 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b9f26846b0 0x55b9f2a64960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.176+0000 7f28a9600640 1 -- 172.21.15.42:0/1113399179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9f26a5390 msgr2=0x55b9f2aa0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.176+0000 7f28a9600640 1 --2- 172.21.15.42:0/1113399179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9f26a5390 0x55b9f2aa0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.176+0000 7f28a9600640 1 -- 172.21.15.42:0/1113399179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9f2710970 con 0x55b9f267c4d0 2024-09-17T01:50:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.176+0000 7f28a8c00640 1 --2- 172.21.15.42:0/1113399179 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b9f26846b0 0x55b9f2a64960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.176+0000 7f28a9600640 1 --2- 172.21.15.42:0/1113399179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f267c4d0 0x55b9f2aa4500 secure :-1 s=READY pgs=2613 cs=0 l=1 rev1=1 crypto rx=0x7f289800c370 tx=0x7f2898061650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a417ad538c8c8a25 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:06.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.176+0000 7f288a000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:50:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.176+0000 7f288a000640 1 -- 172.21.15.42:0/1113399179 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289807c060 con 0x55b9f267c4d0 2024-09-17T01:50:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.177+0000 7f288a000640 1 -- 172.21.15.42:0/1113399179 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f2898061080 con 0x55b9f267c4d0 2024-09-17T01:50:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.177+0000 7f28b31ce740 1 -- 172.21.15.42:0/1113399179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f289c02cab0 con 0x55b9f267c4d0 2024-09-17T01:50:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.177+0000 7f288a000640 1 -- 172.21.15.42:0/1113399179 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=183) ==== 24+0+0 (secure 0 0 0) 0x7f2898082050 con 0x55b9f267c4d0 2024-09-17T01:50:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.177+0000 7f28b31ce740 10 client.11820 fetch_fsmap learned FSMap version 183 2024-09-17T01:50:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.177+0000 7f28b31ce740 1 -- 172.21.15.42:0/1113399179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=183,monmap=2+}) -- 0x55b9f26ee6a0 con 0x55b9f267c4d0 2024-09-17T01:50:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.177+0000 7f288a000640 1 -- 172.21.15.42:0/1113399179 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f289c02cab0 con 0x55b9f267c4d0 2024-09-17T01:50:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.177+0000 7f288a000640 1 -- 172.21.15.42:0/1113399179 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 183) ==== 3502+0+0 (secure 0 0 0) 0x7f289805d770 con 0x55b9f267c4d0 2024-09-17T01:50:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.177+0000 7f28b31ce740 10 client.11820 fetch_fsmap finished waiting for FSMap version 183 2024-09-17T01:50:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.177+0000 7f28b31ce740 10 client.11820 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.d 2024-09-17T01:50:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.177+0000 7f28b31ce740 20 client.11820 populate_metadata read hostname 'smithi042' 2024-09-17T01:50:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.177+0000 7f28b31ce740 1 --2- 172.21.15.42:0/1113399179 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55b9f2663f60 0x55b9f2aa10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.177+0000 7f28b31ce740 4 client.11820 mds_command: new command op to 11517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:50:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.177+0000 7f28b31ce740 1 -- 172.21.15.42:0/1113399179 --> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9f29c17c0 con 0x55b9f2663f60 2024-09-17T01:50:06.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.178+0000 7f28a8c00640 1 --2- 172.21.15.42:0/1113399179 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55b9f2663f60 0x55b9f2aa10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.179+0000 7f28a8c00640 1 --2- 172.21.15.42:0/1113399179 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55b9f2663f60 0x55b9f2aa10a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bca1fb7d6a8a0ef server_cookie=cb6f16fe26e40095 in_seq=0 out_seq=0 2024-09-17T01:50:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.179+0000 7f288a000640 10 client.11820 ms_handle_connect on v2:172.21.15.43:6834/4082001755 2024-09-17T01:50:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.180+0000 7f288a000640 1 -- 172.21.15.42:0/1113399179 <== mds.0 v2:172.21.15.43:6834/4082001755 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b9f29c17c0 con 0x55b9f2663f60 2024-09-17T01:50:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.180+0000 7f288a000640 10 client.11820 handle_command_reply: tid=0 2024-09-17T01:50:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.180+0000 7f28b31ce740 1 client.11820 shutdown 2024-09-17T01:50:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.180+0000 7f28b31ce740 1 -- 172.21.15.42:0/1113399179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f267c4d0 msgr2=0x55b9f2aa4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.180+0000 7f28b31ce740 1 --2- 172.21.15.42:0/1113399179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f267c4d0 0x55b9f2aa4500 secure :-1 s=READY pgs=2613 cs=0 l=1 rev1=1 crypto rx=0x7f289800c370 tx=0x7f2898061650 comp rx=0 tx=0).stop 2024-09-17T01:50:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.180+0000 7f28b31ce740 1 -- 172.21.15.42:0/1113399179 shutdown_connections 2024-09-17T01:50:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.180+0000 7f28b31ce740 1 --2- 172.21.15.42:0/1113399179 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55b9f2663f60 0x55b9f2aa10a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.180+0000 7f28b31ce740 1 --2- 172.21.15.42:0/1113399179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9f26a5390 0x55b9f2aa0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.180+0000 7f28b31ce740 1 --2- 172.21.15.42:0/1113399179 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b9f26846b0 0x55b9f2a64960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.180+0000 7f28b31ce740 1 --2- 172.21.15.42:0/1113399179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f267c4d0 0x55b9f2aa4500 unknown :-1 s=CLOSED pgs=2613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.180+0000 7f288a000640 0 client.11820 ms_handle_reset on v2:172.21.15.43:6834/4082001755 2024-09-17T01:50:06.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.180+0000 7f28b31ce740 1 -- 172.21.15.42:0/1113399179 >> 172.21.15.42:0/1113399179 conn(0x55b9f26994e0 msgr2=0x55b9f2a65bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:06.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.180+0000 7f28b31ce740 1 -- 172.21.15.42:0/1113399179 shutdown_connections 2024-09-17T01:50:06.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.180+0000 7f28b31ce740 1 -- 172.21.15.42:0/1113399179 wait complete. 2024-09-17T01:50:06.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.180+0000 7f28b31ce740 20 client.11820 trim_cache size 0 max 16384 2024-09-17T01:50:06.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.199+0000 7f28b31ce740 1 Processor -- start 2024-09-17T01:50:06.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.199+0000 7f28b31ce740 1 -- start start 2024-09-17T01:50:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.200+0000 7f28b31ce740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b9f267c4d0 0x55b9f2aa0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.200+0000 7f28b31ce740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f26846b0 0x55b9f2a64170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.201+0000 7f28b31ce740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9f26a5390 0x55b9f2a646b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.201+0000 7f28b31ce740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f28a4202150 con 0x55b9f26846b0 2024-09-17T01:50:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.201+0000 7f28b31ce740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f28a4157170 con 0x55b9f26a5390 2024-09-17T01:50:06.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.201+0000 7f28b31ce740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f28a41f9d20 con 0x55b9f267c4d0 2024-09-17T01:50:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.201+0000 7f28a8c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f26846b0 0x55b9f2a64170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.201+0000 7f28a8c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f26846b0 0x55b9f2a64170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47726/0 (socket says 172.21.15.42:47726) 2024-09-17T01:50:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.201+0000 7f28a8c00640 1 -- 172.21.15.42:0/4013152655 learned_addr learned my addr 172.21.15.42:0/4013152655 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.201+0000 7f28a9600640 1 --2- 172.21.15.42:0/4013152655 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b9f267c4d0 0x55b9f2aa0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.201+0000 7f28aa000640 1 --2- 172.21.15.42:0/4013152655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9f26a5390 0x55b9f2a646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.201+0000 7f28a8c00640 1 -- 172.21.15.42:0/4013152655 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b9f267c4d0 msgr2=0x55b9f2aa0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.201+0000 7f28a8c00640 1 --2- 172.21.15.42:0/4013152655 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b9f267c4d0 0x55b9f2aa0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.201+0000 7f28a8c00640 1 -- 172.21.15.42:0/4013152655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9f26a5390 msgr2=0x55b9f2a646b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.201+0000 7f28a8c00640 1 --2- 172.21.15.42:0/4013152655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9f26a5390 0x55b9f2a646b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.201+0000 7f28a8c00640 1 -- 172.21.15.42:0/4013152655 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9f2aaaab0 con 0x55b9f26846b0 2024-09-17T01:50:06.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.202+0000 7f28a8c00640 1 --2- 172.21.15.42:0/4013152655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f26846b0 0x55b9f2a64170 secure :-1 s=READY pgs=2614 cs=0 l=1 rev1=1 crypto rx=0x7f2890012580 tx=0x7f2890014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d3bdb1f54837a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:06.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.202+0000 7f2895200640 1 -- 172.21.15.42:0/4013152655 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289002e070 con 0x55b9f26846b0 2024-09-17T01:50:06.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.202+0000 7f2895200640 1 -- 172.21.15.42:0/4013152655 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28900206f0 con 0x55b9f26846b0 2024-09-17T01:50:06.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.202+0000 7f2895200640 1 -- 172.21.15.42:0/4013152655 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2890020b00 con 0x55b9f26846b0 2024-09-17T01:50:06.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.202+0000 7f28b31ce740 1 -- 172.21.15.42:0/4013152655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f26846b0 msgr2=0x55b9f2a64170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:06.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.202+0000 7f28b31ce740 1 --2- 172.21.15.42:0/4013152655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f26846b0 0x55b9f2a64170 secure :-1 s=READY pgs=2614 cs=0 l=1 rev1=1 crypto rx=0x7f2890012580 tx=0x7f2890014000 comp rx=0 tx=0).stop 2024-09-17T01:50:06.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.203+0000 7f28b31ce740 1 -- 172.21.15.42:0/4013152655 shutdown_connections 2024-09-17T01:50:06.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.203+0000 7f28b31ce740 1 --2- 172.21.15.42:0/4013152655 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9f26a5390 0x55b9f2a646b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.203+0000 7f28b31ce740 1 --2- 172.21.15.42:0/4013152655 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f26846b0 0x55b9f2a64170 unknown :-1 s=CLOSED pgs=2614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.203+0000 7f28b31ce740 1 --2- 172.21.15.42:0/4013152655 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b9f267c4d0 0x55b9f2aa0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.203+0000 7f28b31ce740 1 -- 172.21.15.42:0/4013152655 >> 172.21.15.42:0/4013152655 conn(0x55b9f26994e0 msgr2=0x55b9f2a76400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:06.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.203+0000 7f28b31ce740 1 -- 172.21.15.42:0/4013152655 shutdown_connections 2024-09-17T01:50:06.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.203+0000 7f28b31ce740 1 -- 172.21.15.42:0/4013152655 wait complete. 2024-09-17T01:50:06.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.204+0000 7f28b31ce740 1 -- start start 2024-09-17T01:50:06.204 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.204+0000 7f28b31ce740 1 Processor -- start 2024-09-17T01:50:06.205 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.205+0000 7f28b31ce740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b9f267c4d0 0x55b9f2b10a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:06.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.205+0000 7f28b31ce740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f26846b0 0x55b9f2b0a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:06.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.205+0000 7f28b31ce740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9f26a5390 0x55b9f2aa9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:06.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.205+0000 7f28b31ce740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f28a4156b00 con 0x55b9f26846b0 2024-09-17T01:50:06.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.205+0000 7f28b31ce740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b9f2b10f70 con 0x55b9f26a5390 2024-09-17T01:50:06.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.205+0000 7f28b31ce740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55b9f2a8c3a0 con 0x55b9f267c4d0 2024-09-17T01:50:06.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.205+0000 7f28b31ce740 10 client.0 _ll_register_callbacks cb 0x7f289805dd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:50:06.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.206+0000 7f28a8c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f26846b0 0x55b9f2b0a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:06.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.206+0000 7f28a8c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f26846b0 0x55b9f2b0a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:47742/0 (socket says 172.21.15.42:47742) 2024-09-17T01:50:06.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.206+0000 7f28a8c00640 1 -- 172.21.15.42:0/2337029408 learned_addr learned my addr 172.21.15.42:0/2337029408 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:06.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.206+0000 7f28aa000640 1 --2- 172.21.15.42:0/2337029408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9f26a5390 0x55b9f2aa9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:06.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.206+0000 7f28a9600640 1 --2- 172.21.15.42:0/2337029408 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b9f267c4d0 0x55b9f2b10a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:06.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.206+0000 7f28a8c00640 1 -- 172.21.15.42:0/2337029408 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b9f267c4d0 msgr2=0x55b9f2b10a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:06.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.206+0000 7f28a8c00640 1 --2- 172.21.15.42:0/2337029408 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b9f267c4d0 0x55b9f2b10a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.206+0000 7f28a8c00640 1 -- 172.21.15.42:0/2337029408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9f26a5390 msgr2=0x55b9f2aa9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:06.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.206+0000 7f28a8c00640 1 --2- 172.21.15.42:0/2337029408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9f26a5390 0x55b9f2aa9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.206+0000 7f28a8c00640 1 -- 172.21.15.42:0/2337029408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9f2a8c680 con 0x55b9f26846b0 2024-09-17T01:50:06.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.206+0000 7f28a8c00640 1 --2- 172.21.15.42:0/2337029408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f26846b0 0x55b9f2b0a8f0 secure :-1 s=READY pgs=2615 cs=0 l=1 rev1=1 crypto rx=0x7f28900096a0 tx=0x7f2890011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e096ff74307cd92 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:06.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.206+0000 7f288a000640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:50:06.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.207+0000 7f288a000640 1 -- 172.21.15.42:0/2337029408 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289002e050 con 0x55b9f26846b0 2024-09-17T01:50:06.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.207+0000 7f288a000640 1 -- 172.21.15.42:0/2337029408 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f2890020d70 con 0x55b9f26846b0 2024-09-17T01:50:06.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.207+0000 7f28b31ce740 1 -- 172.21.15.42:0/2337029408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28900206f0 con 0x55b9f26846b0 2024-09-17T01:50:06.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.207+0000 7f288a000640 1 -- 172.21.15.42:0/2337029408 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=183) ==== 24+0+0 (secure 0 0 0) 0x7f2890033440 con 0x55b9f26846b0 2024-09-17T01:50:06.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.207+0000 7f28b31ce740 10 client.11826 fetch_fsmap learned FSMap version 183 2024-09-17T01:50:06.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.207+0000 7f28b31ce740 1 -- 172.21.15.42:0/2337029408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=183,monmap=2+}) -- 0x55b9f2a9ddd0 con 0x55b9f26846b0 2024-09-17T01:50:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.207+0000 7f288a000640 1 -- 172.21.15.42:0/2337029408 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2890040070 con 0x55b9f26846b0 2024-09-17T01:50:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.207+0000 7f288a000640 1 -- 172.21.15.42:0/2337029408 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 183) ==== 3502+0+0 (secure 0 0 0) 0x7f28900336d0 con 0x55b9f26846b0 2024-09-17T01:50:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.207+0000 7f28b31ce740 10 client.11826 fetch_fsmap finished waiting for FSMap version 183 2024-09-17T01:50:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.207+0000 7f28b31ce740 10 client.11826 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.d 2024-09-17T01:50:06.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.207+0000 7f28b31ce740 20 client.11826 populate_metadata read hostname 'smithi042' 2024-09-17T01:50:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.207+0000 7f28b31ce740 1 --2- 172.21.15.42:0/2337029408 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55b9f2aa9bb0 0x55b9f2b14350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.207+0000 7f28b31ce740 4 client.11826 mds_command: new command op to 11517 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:50:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.207+0000 7f28b31ce740 1 -- 172.21.15.42:0/2337029408 --> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b9f29bd270 con 0x55b9f2aa9bb0 2024-09-17T01:50:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.208+0000 7f28a9600640 1 --2- 172.21.15.42:0/2337029408 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55b9f2aa9bb0 0x55b9f2b14350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.208+0000 7f28a9600640 1 --2- 172.21.15.42:0/2337029408 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55b9f2aa9bb0 0x55b9f2b14350 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3612729c91fbf180 server_cookie=97d1dce9c6b800ea in_seq=0 out_seq=0 2024-09-17T01:50:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.208+0000 7f288a000640 10 client.11826 ms_handle_connect on v2:172.21.15.43:6834/4082001755 2024-09-17T01:50:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.209+0000 7f288a000640 1 -- 172.21.15.42:0/2337029408 <== mds.0 v2:172.21.15.43:6834/4082001755 1 ==== command_reply(tid 0: 0 ) ==== 8+0+855 (crc 0 0 0) 0x55b9f29bd270 con 0x55b9f2aa9bb0 2024-09-17T01:50:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.209+0000 7f288a000640 10 client.11826 handle_command_reply: tid=0 2024-09-17T01:50:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.209+0000 7f28b31ce740 1 client.11826 shutdown 2024-09-17T01:50:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.209+0000 7f28b31ce740 1 -- 172.21.15.42:0/2337029408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f26846b0 msgr2=0x55b9f2b0a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.209+0000 7f28b31ce740 1 --2- 172.21.15.42:0/2337029408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f26846b0 0x55b9f2b0a8f0 secure :-1 s=READY pgs=2615 cs=0 l=1 rev1=1 crypto rx=0x7f28900096a0 tx=0x7f2890011dc0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.209+0000 7f28b31ce740 1 -- 172.21.15.42:0/2337029408 shutdown_connections 2024-09-17T01:50:06.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.209+0000 7f28b31ce740 1 --2- 172.21.15.42:0/2337029408 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55b9f2aa9bb0 0x55b9f2b14350 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.209+0000 7f28b31ce740 1 --2- 172.21.15.42:0/2337029408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b9f26a5390 0x55b9f2aa9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.209+0000 7f28b31ce740 1 --2- 172.21.15.42:0/2337029408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b9f26846b0 0x55b9f2b0a8f0 unknown :-1 s=CLOSED pgs=2615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.209+0000 7f28b31ce740 1 --2- 172.21.15.42:0/2337029408 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55b9f267c4d0 0x55b9f2b10a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.209+0000 7f288a000640 0 client.11826 ms_handle_reset on v2:172.21.15.43:6834/4082001755 2024-09-17T01:50:06.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.209+0000 7f28b31ce740 1 -- 172.21.15.42:0/2337029408 >> 172.21.15.42:0/2337029408 conn(0x55b9f26994e0 msgr2=0x55b9f2a76620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:06.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.209+0000 7f28b31ce740 1 -- 172.21.15.42:0/2337029408 shutdown_connections 2024-09-17T01:50:06.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.209+0000 7f28b31ce740 1 -- 172.21.15.42:0/2337029408 wait complete. 2024-09-17T01:50:06.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.209+0000 7f28b31ce740 20 client.11826 trim_cache size 0 max 16384 2024-09-17T01:50:06.211 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:50:06.211 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T01:50:06.212 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": { 2024-09-17T01:50:06.212 INFO:teuthology.orchestra.run.smithi042.stdout: "01c320cd-fa68-4bd5-8f83-7093367c7109": { 2024-09-17T01:50:06.212 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-17T01:50:06.212 INFO:teuthology.orchestra.run.smithi042.stdout: "tag": "01c320cd-fa68-4bd5-8f83-7093367c7109", 2024-09-17T01:50:06.212 INFO:teuthology.orchestra.run.smithi042.stdout: "options": "recursive,repair" 2024-09-17T01:50:06.212 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:50:06.212 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:50:06.212 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_stats": { 2024-09-17T01:50:06.212 INFO:teuthology.orchestra.run.smithi042.stdout: "01c320cd-fa68-4bd5-8f83-7093367c7109": { 2024-09-17T01:50:06.213 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:50:05.908013+0000", 2024-09-17T01:50:06.213 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-17T01:50:06.213 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:50:06.213 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:50:06.213 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:50:06.214 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:50:06.214 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:50:06.214 INFO:teuthology.orchestra.run.smithi042.stdout: "e7620a81-dc19-43a9-a344-f1ffb93dfff2": { 2024-09-17T01:50:06.214 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:49:41.704309+0000", 2024-09-17T01:50:06.214 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-17T01:50:06.214 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:50:06.214 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:50:06.215 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:50:06.215 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:50:06.215 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:50:06.215 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:50:06.215 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:50:06.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.210+0000 7f28aaa00640 1 -- 172.21.15.42:0/3844095129 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2884078bc0 msgr2=0x7f288407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:06.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.210+0000 7f28aaa00640 1 --2- 172.21.15.42:0/3844095129 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2884078bc0 0x7f288407b0d0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f28a40b83d0 tx=0x7f2890005f90 comp rx=0 tx=0).stop 2024-09-17T01:50:06.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.210+0000 7f28aaa00640 1 -- 172.21.15.42:0/3844095129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28a40b6250 msgr2=0x7f28a414cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:06.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.210+0000 7f28aaa00640 1 --2- 172.21.15.42:0/3844095129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28a40b6250 0x7f28a414cb60 secure :-1 s=READY pgs=2611 cs=0 l=1 rev1=1 crypto rx=0x7f289800c3a0 tx=0x7f289800c860 comp rx=0 tx=0).stop 2024-09-17T01:50:06.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.210+0000 7f28aaa00640 1 -- 172.21.15.42:0/3844095129 shutdown_connections 2024-09-17T01:50:06.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.210+0000 7f28aaa00640 1 --2- 172.21.15.42:0/3844095129 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2884078bc0 0x7f288407b0d0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.210+0000 7f28aaa00640 1 --2- 172.21.15.42:0/3844095129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28a40b7c70 0x7f28a41612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.210+0000 7f28aaa00640 1 --2- 172.21.15.42:0/3844095129 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f28a415eae0 0x7f28a41617e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.217 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.210+0000 7f28aaa00640 1 --2- 172.21.15.42:0/3844095129 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f28a40b6250 0x7f28a414cb60 unknown :-1 s=CLOSED pgs=2611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:06.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.210+0000 7f28aaa00640 1 -- 172.21.15.42:0/3844095129 >> 172.21.15.42:0/3844095129 conn(0x7f28a406d3f0 msgr2=0x7f28a40d4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:06.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.210+0000 7f28aaa00640 1 -- 172.21.15.42:0/3844095129 shutdown_connections 2024-09-17T01:50:06.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:06.210+0000 7f28aaa00640 1 -- 172.21.15.42:0/3844095129 wait complete. 2024-09-17T01:50:06.233 INFO:tasks.cephfs.filesystem:scrub status for tag:01c320cd-fa68-4bd5-8f83-7093367c7109 - {'path': '/', 'tag': '01c320cd-fa68-4bd5-8f83-7093367c7109', 'options': 'recursive,repair'} 2024-09-17T01:50:22.661 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:50:22.666 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:50:36.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:50:36.235 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.16:0 scrub status 2024-09-17T01:50:36.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.476+0000 7f580ea00640 1 -- 172.21.15.42:0/3391740728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5808161350 msgr2=0x7f580806eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:36.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.476+0000 7f580ea00640 1 --2- 172.21.15.42:0/3391740728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5808161350 0x7f580806eae0 secure :-1 s=READY pgs=2617 cs=0 l=1 rev1=1 crypto rx=0x7f5800005fd0 tx=0x7f580002aaa0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.476+0000 7f580ea00640 1 -- 172.21.15.42:0/3391740728 shutdown_connections 2024-09-17T01:50:36.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.476+0000 7f580ea00640 1 --2- 172.21.15.42:0/3391740728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5808161350 0x7f580806eae0 unknown :-1 s=CLOSED pgs=2617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.476+0000 7f580ea00640 1 --2- 172.21.15.42:0/3391740728 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f580815dd50 0x7f58080cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.476+0000 7f580ea00640 1 -- 172.21.15.42:0/3391740728 >> 172.21.15.42:0/3391740728 conn(0x7f580806d1b0 msgr2=0x7f580806d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:36.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.477+0000 7f580ea00640 1 -- 172.21.15.42:0/3391740728 shutdown_connections 2024-09-17T01:50:36.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.477+0000 7f580ea00640 1 -- 172.21.15.42:0/3391740728 wait complete. 2024-09-17T01:50:36.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.479+0000 7f580ea00640 1 Processor -- start 2024-09-17T01:50:36.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.479+0000 7f580ea00640 1 -- start start 2024-09-17T01:50:36.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.480+0000 7f580ea00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58080cdc00 0x7f58080aace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:36.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.480+0000 7f580ea00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f580815dd50 0x7f58080b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:36.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.480+0000 7f580ea00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5808161350 0x7f58081f6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:36.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.481+0000 7f580ea00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5808072840 con 0x7f5808161350 2024-09-17T01:50:36.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.481+0000 7f580ea00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f58080726c0 con 0x7f58080cdc00 2024-09-17T01:50:36.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.481+0000 7f580ea00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f580806f020 con 0x7f580815dd50 2024-09-17T01:50:36.479 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.481+0000 7f580ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5808161350 0x7f58081f6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:36.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.481+0000 7f580ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5808161350 0x7f58081f6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54964/0 (socket says 172.21.15.42:54964) 2024-09-17T01:50:36.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.481+0000 7f580ca00640 1 -- 172.21.15.42:0/1106367879 learned_addr learned my addr 172.21.15.42:0/1106367879 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:36.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.481+0000 7f57ffe00640 1 --2- 172.21.15.42:0/1106367879 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f580815dd50 0x7f58080b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:36.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.481+0000 7f5807e00640 1 --2- 172.21.15.42:0/1106367879 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58080cdc00 0x7f58080aace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:36.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.481+0000 7f580ca00640 1 -- 172.21.15.42:0/1106367879 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f580815dd50 msgr2=0x7f58080b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:36.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.481+0000 7f580ca00640 1 --2- 172.21.15.42:0/1106367879 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f580815dd50 0x7f58080b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.481+0000 7f580ca00640 1 -- 172.21.15.42:0/1106367879 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58080cdc00 msgr2=0x7f58080aace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:36.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.481+0000 7f580ca00640 1 --2- 172.21.15.42:0/1106367879 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58080cdc00 0x7f58080aace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.481+0000 7f580ca00640 1 -- 172.21.15.42:0/1106367879 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58081561d0 con 0x7f5808161350 2024-09-17T01:50:36.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.482+0000 7f580ca00640 1 --2- 172.21.15.42:0/1106367879 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5808161350 0x7f58081f6c80 secure :-1 s=READY pgs=2618 cs=0 l=1 rev1=1 crypto rx=0x7f5800009d90 tx=0x7f5800003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:36.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.482+0000 7f5804c00640 1 -- 172.21.15.42:0/1106367879 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5800044070 con 0x7f5808161350 2024-09-17T01:50:36.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.482+0000 7f5804c00640 1 -- 172.21.15.42:0/1106367879 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5800004250 con 0x7f5808161350 2024-09-17T01:50:36.481 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.482+0000 7f5804c00640 1 -- 172.21.15.42:0/1106367879 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5800004660 con 0x7f5808161350 2024-09-17T01:50:36.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.482+0000 7f580ea00640 1 -- 172.21.15.42:0/1106367879 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58081564b0 con 0x7f5808161350 2024-09-17T01:50:36.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.482+0000 7f580ea00640 1 -- 172.21.15.42:0/1106367879 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5808156a70 con 0x7f5808161350 2024-09-17T01:50:36.482 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.484+0000 7f5804c00640 1 -- 172.21.15.42:0/1106367879 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5800047070 con 0x7f5808161350 2024-09-17T01:50:36.484 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.486+0000 7f5804c00640 1 --2- 172.21.15.42:0/1106367879 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f57e4078b90 0x7f57e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:36.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.486+0000 7f5804c00640 1 -- 172.21.15.42:0/1106367879 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f58000bbed0 con 0x7f5808161350 2024-09-17T01:50:36.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.486+0000 7f5807e00640 1 --2- 172.21.15.42:0/1106367879 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f57e4078b90 0x7f57e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:36.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.487+0000 7f58159ea740 1 Processor -- start 2024-09-17T01:50:36.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.487+0000 7f58159ea740 1 -- start start 2024-09-17T01:50:36.485 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.487+0000 7f5807e00640 1 --2- 172.21.15.42:0/1106367879 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f57e4078b90 0x7f57e407b0a0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f57f80058c0 tx=0x7f57f8005850 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:36.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.488+0000 7f58159ea740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558335c7d390 0x55833603e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:36.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.488+0000 7f58159ea740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558335c544d0 0x55833606a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:36.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.488+0000 7f58159ea740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c5c6b0 0x55833604b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:36.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.488+0000 7f58159ea740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558335f841c0 con 0x558335c5c6b0 2024-09-17T01:50:36.487 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.488+0000 7f58159ea740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558335f97870 con 0x558335c7d390 2024-09-17T01:50:36.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.488+0000 7f58159ea740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558335f86ca0 con 0x558335c544d0 2024-09-17T01:50:36.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.489+0000 7f580ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c5c6b0 0x55833604b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:36.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.489+0000 7f580ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c5c6b0 0x55833604b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54974/0 (socket says 172.21.15.42:54974) 2024-09-17T01:50:36.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.489+0000 7f580ca00640 1 -- 172.21.15.42:0/4055657807 learned_addr learned my addr 172.21.15.42:0/4055657807 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:36.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.489+0000 7f57ffe00640 1 --2- 172.21.15.42:0/4055657807 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558335c544d0 0x55833606a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:36.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.489+0000 7f5807e00640 1 --2- 172.21.15.42:0/4055657807 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558335c7d390 0x55833603e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:36.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.489+0000 7f580ca00640 1 -- 172.21.15.42:0/4055657807 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558335c544d0 msgr2=0x55833606a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:36.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.489+0000 7f580ca00640 1 --2- 172.21.15.42:0/4055657807 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558335c544d0 0x55833606a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.489+0000 7f580ca00640 1 -- 172.21.15.42:0/4055657807 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558335c7d390 msgr2=0x55833603e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:36.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.489+0000 7f580ca00640 1 --2- 172.21.15.42:0/4055657807 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558335c7d390 0x55833603e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.489+0000 7f580ca00640 1 -- 172.21.15.42:0/4055657807 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558335d5f7d0 con 0x558335c5c6b0 2024-09-17T01:50:36.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.489+0000 7f5807e00640 1 --2- 172.21.15.42:0/4055657807 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558335c7d390 0x55833603e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:36.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.489+0000 7f580ca00640 1 --2- 172.21.15.42:0/4055657807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c5c6b0 0x55833604b150 secure :-1 s=READY pgs=2619 cs=0 l=1 rev1=1 crypto rx=0x7f58000ba240 tx=0x7f58000834a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac186a6d3d874839 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:36.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.489+0000 7f57f7e00640 1 -- 172.21.15.42:0/4055657807 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5800083a90 con 0x558335c5c6b0 2024-09-17T01:50:36.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.489+0000 7f57f7e00640 1 -- 172.21.15.42:0/4055657807 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5800088570 con 0x558335c5c6b0 2024-09-17T01:50:36.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.489+0000 7f57f7e00640 1 -- 172.21.15.42:0/4055657807 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580008d4b0 con 0x558335c5c6b0 2024-09-17T01:50:36.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.490+0000 7f58159ea740 1 -- 172.21.15.42:0/4055657807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c5c6b0 msgr2=0x55833604b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:36.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.490+0000 7f58159ea740 1 --2- 172.21.15.42:0/4055657807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c5c6b0 0x55833604b150 secure :-1 s=READY pgs=2619 cs=0 l=1 rev1=1 crypto rx=0x7f58000ba240 tx=0x7f58000834a0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.490+0000 7f58159ea740 1 -- 172.21.15.42:0/4055657807 shutdown_connections 2024-09-17T01:50:36.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.490+0000 7f58159ea740 1 --2- 172.21.15.42:0/4055657807 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c5c6b0 0x55833604b150 unknown :-1 s=CLOSED pgs=2619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.490+0000 7f58159ea740 1 --2- 172.21.15.42:0/4055657807 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558335c544d0 0x55833606a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.490+0000 7f58159ea740 1 --2- 172.21.15.42:0/4055657807 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558335c7d390 0x55833603e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.490+0000 7f58159ea740 1 -- 172.21.15.42:0/4055657807 >> 172.21.15.42:0/4055657807 conn(0x558335c714e0 msgr2=0x558336024440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:36.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.490+0000 7f58159ea740 1 -- 172.21.15.42:0/4055657807 shutdown_connections 2024-09-17T01:50:36.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.490+0000 7f58159ea740 1 -- 172.21.15.42:0/4055657807 wait complete. 2024-09-17T01:50:36.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.491+0000 7f58159ea740 1 -- start start 2024-09-17T01:50:36.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.492+0000 7f58159ea740 1 Processor -- start 2024-09-17T01:50:36.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.493+0000 7f58159ea740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c544d0 0x55833603b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:36.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.493+0000 7f58159ea740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558335c5c6b0 0x55833604df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:36.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.493+0000 7f58159ea740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558335c7d390 0x55833603b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:36.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.493+0000 7f58159ea740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558335f2d410 con 0x558335c544d0 2024-09-17T01:50:36.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.493+0000 7f58159ea740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558335f8aab0 con 0x558335c7d390 2024-09-17T01:50:36.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.493+0000 7f58159ea740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558335cf7740 con 0x558335c5c6b0 2024-09-17T01:50:36.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.493+0000 7f58159ea740 10 client.0 _ll_register_callbacks cb 0x558335f0a360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:50:36.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.493+0000 7f5807e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c544d0 0x55833603b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:36.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.493+0000 7f5807e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c544d0 0x55833603b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54990/0 (socket says 172.21.15.42:54990) 2024-09-17T01:50:36.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.493+0000 7f5807e00640 1 -- 172.21.15.42:0/4184620141 learned_addr learned my addr 172.21.15.42:0/4184620141 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:36.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.494+0000 7f580ca00640 1 --2- 172.21.15.42:0/4184620141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558335c7d390 0x55833603b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:36.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.494+0000 7f57ffe00640 1 --2- 172.21.15.42:0/4184620141 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558335c5c6b0 0x55833604df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:36.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.494+0000 7f5807e00640 1 -- 172.21.15.42:0/4184620141 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558335c5c6b0 msgr2=0x55833604df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:36.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.494+0000 7f5807e00640 1 --2- 172.21.15.42:0/4184620141 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558335c5c6b0 0x55833604df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.494+0000 7f5807e00640 1 -- 172.21.15.42:0/4184620141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558335c7d390 msgr2=0x55833603b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:36.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.494+0000 7f5807e00640 1 --2- 172.21.15.42:0/4184620141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558335c7d390 0x55833603b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.494+0000 7f5807e00640 1 -- 172.21.15.42:0/4184620141 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558335ce8970 con 0x558335c544d0 2024-09-17T01:50:36.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.494+0000 7f5807e00640 1 --2- 172.21.15.42:0/4184620141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c544d0 0x55833603b270 secure :-1 s=READY pgs=2620 cs=0 l=1 rev1=1 crypto rx=0x7f57f8010a60 tx=0x7f57f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d2f7f5bbe2073d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:36.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.494+0000 7f57f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:50:36.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.495+0000 7f57f4c00640 1 -- 172.21.15.42:0/4184620141 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f800fd50 con 0x558335c544d0 2024-09-17T01:50:36.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.495+0000 7f57f4c00640 1 -- 172.21.15.42:0/4184620141 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f57f801e430 con 0x558335c544d0 2024-09-17T01:50:36.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.495+0000 7f58159ea740 1 -- 172.21.15.42:0/4184620141 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5800088570 con 0x558335c544d0 2024-09-17T01:50:36.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.495+0000 7f57f4c00640 1 -- 172.21.15.42:0/4184620141 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=183) ==== 24+0+0 (secure 0 0 0) 0x7f57f801e630 con 0x558335c544d0 2024-09-17T01:50:36.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.495+0000 7f58159ea740 10 client.11841 fetch_fsmap learned FSMap version 183 2024-09-17T01:50:36.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.495+0000 7f58159ea740 1 -- 172.21.15.42:0/4184620141 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=183,monmap=2+}) -- 0x558335cc66a0 con 0x558335c544d0 2024-09-17T01:50:36.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.495+0000 7f57f4c00640 1 -- 172.21.15.42:0/4184620141 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5800088570 con 0x558335c544d0 2024-09-17T01:50:36.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.495+0000 7f57f4c00640 1 -- 172.21.15.42:0/4184620141 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 183) ==== 3502+0+0 (secure 0 0 0) 0x7f57f801e7d0 con 0x558335c544d0 2024-09-17T01:50:36.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.495+0000 7f58159ea740 10 client.11841 fetch_fsmap finished waiting for FSMap version 183 2024-09-17T01:50:36.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.495+0000 7f58159ea740 10 client.11841 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.d 2024-09-17T01:50:36.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.495+0000 7f58159ea740 20 client.11841 populate_metadata read hostname 'smithi042' 2024-09-17T01:50:36.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.495+0000 7f58159ea740 1 --2- 172.21.15.42:0/4184620141 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x558335c3bf60 0x55833604c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:36.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.495+0000 7f58159ea740 4 client.11841 mds_command: new command op to 11517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:50:36.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.495+0000 7f58159ea740 1 -- 172.21.15.42:0/4184620141 --> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558335f997c0 con 0x558335c3bf60 2024-09-17T01:50:36.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.496+0000 7f57ffe00640 1 --2- 172.21.15.42:0/4184620141 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x558335c3bf60 0x55833604c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:36.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.496+0000 7f57ffe00640 1 --2- 172.21.15.42:0/4184620141 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x558335c3bf60 0x55833604c110 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e55b3779f9ca975 server_cookie=61d1980e87670c46 in_seq=0 out_seq=0 2024-09-17T01:50:36.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.496+0000 7f57f4c00640 10 client.11841 ms_handle_connect on v2:172.21.15.43:6834/4082001755 2024-09-17T01:50:36.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.497+0000 7f57f4c00640 1 -- 172.21.15.42:0/4184620141 <== mds.0 v2:172.21.15.43:6834/4082001755 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558335f997c0 con 0x558335c3bf60 2024-09-17T01:50:36.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.497+0000 7f57f4c00640 10 client.11841 handle_command_reply: tid=0 2024-09-17T01:50:36.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.497+0000 7f58159ea740 1 client.11841 shutdown 2024-09-17T01:50:36.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.498+0000 7f58159ea740 1 -- 172.21.15.42:0/4184620141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c544d0 msgr2=0x55833603b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:36.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.498+0000 7f58159ea740 1 --2- 172.21.15.42:0/4184620141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c544d0 0x55833603b270 secure :-1 s=READY pgs=2620 cs=0 l=1 rev1=1 crypto rx=0x7f57f8010a60 tx=0x7f57f80046c0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.498+0000 7f58159ea740 1 -- 172.21.15.42:0/4184620141 shutdown_connections 2024-09-17T01:50:36.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.498+0000 7f58159ea740 1 --2- 172.21.15.42:0/4184620141 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x558335c3bf60 0x55833604c110 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.498+0000 7f58159ea740 1 --2- 172.21.15.42:0/4184620141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558335c7d390 0x55833603b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.498+0000 7f58159ea740 1 --2- 172.21.15.42:0/4184620141 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558335c5c6b0 0x55833604df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.498+0000 7f58159ea740 1 --2- 172.21.15.42:0/4184620141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c544d0 0x55833603b270 unknown :-1 s=CLOSED pgs=2620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.498+0000 7f57f4c00640 0 client.11841 ms_handle_reset on v2:172.21.15.43:6834/4082001755 2024-09-17T01:50:36.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.498+0000 7f58159ea740 1 -- 172.21.15.42:0/4184620141 >> 172.21.15.42:0/4184620141 conn(0x558335c714e0 msgr2=0x55833604b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:36.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.498+0000 7f58159ea740 1 -- 172.21.15.42:0/4184620141 shutdown_connections 2024-09-17T01:50:36.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.498+0000 7f58159ea740 1 -- 172.21.15.42:0/4184620141 wait complete. 2024-09-17T01:50:36.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.498+0000 7f58159ea740 20 client.11841 trim_cache size 0 max 16384 2024-09-17T01:50:36.515 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.517+0000 7f58159ea740 1 Processor -- start 2024-09-17T01:50:36.516 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.517+0000 7f58159ea740 1 -- start start 2024-09-17T01:50:36.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.518+0000 7f58159ea740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558335c544d0 0x5583360626c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:36.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.518+0000 7f58159ea740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c5c6b0 0x55833604c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:36.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.518+0000 7f58159ea740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558335c7d390 0x55833604c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:36.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.518+0000 7f58159ea740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55833604d900 con 0x558335c5c6b0 2024-09-17T01:50:36.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.518+0000 7f58159ea740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f58081fe300 con 0x558335c544d0 2024-09-17T01:50:36.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.518+0000 7f58159ea740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f58080b5090 con 0x558335c7d390 2024-09-17T01:50:36.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.519+0000 7f57ffe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c5c6b0 0x55833604c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:36.517 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.519+0000 7f57ffe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c5c6b0 0x55833604c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54994/0 (socket says 172.21.15.42:54994) 2024-09-17T01:50:36.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.519+0000 7f57ffe00640 1 -- 172.21.15.42:0/3932224197 learned_addr learned my addr 172.21.15.42:0/3932224197 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:36.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.519+0000 7f5807e00640 1 --2- 172.21.15.42:0/3932224197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558335c544d0 0x5583360626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:36.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.519+0000 7f580ca00640 1 --2- 172.21.15.42:0/3932224197 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558335c7d390 0x55833604c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:36.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.519+0000 7f57ffe00640 1 -- 172.21.15.42:0/3932224197 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558335c7d390 msgr2=0x55833604c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:36.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.519+0000 7f57ffe00640 1 --2- 172.21.15.42:0/3932224197 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558335c7d390 0x55833604c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.519+0000 7f57ffe00640 1 -- 172.21.15.42:0/3932224197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558335c544d0 msgr2=0x5583360626c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:36.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.519+0000 7f57ffe00640 1 --2- 172.21.15.42:0/3932224197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558335c544d0 0x5583360626c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.519+0000 7f57ffe00640 1 -- 172.21.15.42:0/3932224197 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55833601d830 con 0x558335c5c6b0 2024-09-17T01:50:36.518 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.519+0000 7f57ffe00640 1 --2- 172.21.15.42:0/3932224197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c5c6b0 0x55833604c0f0 secure :-1 s=READY pgs=2621 cs=0 l=1 rev1=1 crypto rx=0x7f57f0000fb0 tx=0x7f57f0004be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5740324192476b87 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:36.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.520+0000 7f57f7400640 1 -- 172.21.15.42:0/3932224197 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f0021070 con 0x558335c5c6b0 2024-09-17T01:50:36.519 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.520+0000 7f57f7400640 1 -- 172.21.15.42:0/3932224197 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f57f00188b0 con 0x558335c5c6b0 2024-09-17T01:50:36.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.520+0000 7f57f7400640 1 -- 172.21.15.42:0/3932224197 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f0018ce0 con 0x558335c5c6b0 2024-09-17T01:50:36.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.520+0000 7f58159ea740 1 -- 172.21.15.42:0/3932224197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c5c6b0 msgr2=0x55833604c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:36.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.520+0000 7f58159ea740 1 --2- 172.21.15.42:0/3932224197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c5c6b0 0x55833604c0f0 secure :-1 s=READY pgs=2621 cs=0 l=1 rev1=1 crypto rx=0x7f57f0000fb0 tx=0x7f57f0004be0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.520+0000 7f58159ea740 1 -- 172.21.15.42:0/3932224197 shutdown_connections 2024-09-17T01:50:36.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.520+0000 7f58159ea740 1 --2- 172.21.15.42:0/3932224197 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558335c7d390 0x55833604c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.520+0000 7f58159ea740 1 --2- 172.21.15.42:0/3932224197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c5c6b0 0x55833604c0f0 unknown :-1 s=CLOSED pgs=2621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.520+0000 7f58159ea740 1 --2- 172.21.15.42:0/3932224197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558335c544d0 0x5583360626c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.521+0000 7f58159ea740 1 -- 172.21.15.42:0/3932224197 >> 172.21.15.42:0/3932224197 conn(0x558335c714e0 msgr2=0x558336019f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:36.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.521+0000 7f58159ea740 1 -- 172.21.15.42:0/3932224197 shutdown_connections 2024-09-17T01:50:36.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.521+0000 7f58159ea740 1 -- 172.21.15.42:0/3932224197 wait complete. 2024-09-17T01:50:36.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.522+0000 7f58159ea740 1 -- start start 2024-09-17T01:50:36.520 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.522+0000 7f58159ea740 1 Processor -- start 2024-09-17T01:50:36.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.523+0000 7f58159ea740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c544d0 0x5583360e3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:36.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.523+0000 7f58159ea740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558335c5c6b0 0x55833608f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:36.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.523+0000 7f58159ea740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558335c7d390 0x558336073e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:36.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.523+0000 7f58159ea740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f58080b4a40 con 0x558335c544d0 2024-09-17T01:50:36.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.523+0000 7f58159ea740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5808159b00 con 0x558335c5c6b0 2024-09-17T01:50:36.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.523+0000 7f58159ea740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x558336021b50 con 0x558335c7d390 2024-09-17T01:50:36.522 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.523+0000 7f58159ea740 10 client.0 _ll_register_callbacks cb 0x7f57f8014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:50:36.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.524+0000 7f5807e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c544d0 0x5583360e3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:36.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.524+0000 7f5807e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c544d0 0x5583360e3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:54996/0 (socket says 172.21.15.42:54996) 2024-09-17T01:50:36.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.524+0000 7f5807e00640 1 -- 172.21.15.42:0/2111429496 learned_addr learned my addr 172.21.15.42:0/2111429496 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:36.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.524+0000 7f57ffe00640 1 --2- 172.21.15.42:0/2111429496 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558335c5c6b0 0x55833608f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:36.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.524+0000 7f580ca00640 1 --2- 172.21.15.42:0/2111429496 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558335c7d390 0x558336073e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:36.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.524+0000 7f5807e00640 1 -- 172.21.15.42:0/2111429496 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558335c7d390 msgr2=0x558336073e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:36.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.524+0000 7f5807e00640 1 --2- 172.21.15.42:0/2111429496 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558335c7d390 0x558336073e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.524+0000 7f5807e00640 1 -- 172.21.15.42:0/2111429496 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558335c5c6b0 msgr2=0x55833608f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:36.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.524+0000 7f5807e00640 1 --2- 172.21.15.42:0/2111429496 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558335c5c6b0 0x55833608f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.524+0000 7f5807e00640 1 -- 172.21.15.42:0/2111429496 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583360e2c00 con 0x558335c544d0 2024-09-17T01:50:36.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.524+0000 7f5807e00640 1 --2- 172.21.15.42:0/2111429496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c544d0 0x5583360e3950 secure :-1 s=READY pgs=2622 cs=0 l=1 rev1=1 crypto rx=0x7f57f8020fa0 tx=0x7f57f8020fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ace56dc562ac52 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:36.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.524+0000 7f57f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:50:36.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.525+0000 7f57f4c00640 1 -- 172.21.15.42:0/2111429496 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f802e030 con 0x558335c544d0 2024-09-17T01:50:36.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.525+0000 7f57f4c00640 1 -- 172.21.15.42:0/2111429496 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f57f801e430 con 0x558335c544d0 2024-09-17T01:50:36.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.525+0000 7f58159ea740 1 -- 172.21.15.42:0/2111429496 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57f00188b0 con 0x558335c544d0 2024-09-17T01:50:36.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.525+0000 7f57f4c00640 1 -- 172.21.15.42:0/2111429496 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=183) ==== 24+0+0 (secure 0 0 0) 0x7f57f8044050 con 0x558335c544d0 2024-09-17T01:50:36.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.525+0000 7f58159ea740 10 client.11847 fetch_fsmap learned FSMap version 183 2024-09-17T01:50:36.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.525+0000 7f58159ea740 1 -- 172.21.15.42:0/2111429496 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=183,monmap=2+}) -- 0x55833601f930 con 0x558335c544d0 2024-09-17T01:50:36.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.525+0000 7f57f4c00640 1 -- 172.21.15.42:0/2111429496 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f57f00188b0 con 0x558335c544d0 2024-09-17T01:50:36.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.525+0000 7f57f4c00640 1 -- 172.21.15.42:0/2111429496 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 183) ==== 3502+0+0 (secure 0 0 0) 0x7f57f8047020 con 0x558335c544d0 2024-09-17T01:50:36.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.525+0000 7f58159ea740 10 client.11847 fetch_fsmap finished waiting for FSMap version 183 2024-09-17T01:50:36.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.525+0000 7f58159ea740 10 client.11847 resolve_mds: resolved 16:0 to role '16:0' aka daemon mds.d 2024-09-17T01:50:36.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.525+0000 7f58159ea740 20 client.11847 populate_metadata read hostname 'smithi042' 2024-09-17T01:50:36.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.525+0000 7f58159ea740 1 --2- 172.21.15.42:0/2111429496 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x5583360e2fb0 0x55833608e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:36.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.525+0000 7f58159ea740 4 client.11847 mds_command: new command op to 11517 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T01:50:36.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.525+0000 7f58159ea740 1 -- 172.21.15.42:0/2111429496 --> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558336063f50 con 0x5583360e2fb0 2024-09-17T01:50:36.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.526+0000 7f57ffe00640 1 --2- 172.21.15.42:0/2111429496 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x5583360e2fb0 0x55833608e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:36.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.526+0000 7f57ffe00640 1 --2- 172.21.15.42:0/2111429496 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x5583360e2fb0 0x55833608e440 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7212ffe53271e473 server_cookie=5ae5e23269349def in_seq=0 out_seq=0 2024-09-17T01:50:36.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.526+0000 7f57f4c00640 10 client.11847 ms_handle_connect on v2:172.21.15.43:6834/4082001755 2024-09-17T01:50:36.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.527+0000 7f57f4c00640 1 -- 172.21.15.42:0/2111429496 <== mds.0 v2:172.21.15.43:6834/4082001755 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x558336063f50 con 0x5583360e2fb0 2024-09-17T01:50:36.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.527+0000 7f57f4c00640 10 client.11847 handle_command_reply: tid=0 2024-09-17T01:50:36.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.527+0000 7f58159ea740 1 client.11847 shutdown 2024-09-17T01:50:36.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.527+0000 7f58159ea740 1 -- 172.21.15.42:0/2111429496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c544d0 msgr2=0x5583360e3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:36.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.527+0000 7f58159ea740 1 --2- 172.21.15.42:0/2111429496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c544d0 0x5583360e3950 secure :-1 s=READY pgs=2622 cs=0 l=1 rev1=1 crypto rx=0x7f57f8020fa0 tx=0x7f57f8020fd0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.527 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.527+0000 7f58159ea740 1 -- 172.21.15.42:0/2111429496 shutdown_connections 2024-09-17T01:50:36.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.527+0000 7f58159ea740 1 --2- 172.21.15.42:0/2111429496 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x5583360e2fb0 0x55833608e440 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.527+0000 7f58159ea740 1 --2- 172.21.15.42:0/2111429496 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558335c5c6b0 0x55833608f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.527+0000 7f58159ea740 1 --2- 172.21.15.42:0/2111429496 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x558335c7d390 0x558336073e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.527+0000 7f57f4c00640 0 client.11847 ms_handle_reset on v2:172.21.15.43:6834/4082001755 2024-09-17T01:50:36.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.527+0000 7f58159ea740 1 --2- 172.21.15.42:0/2111429496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558335c544d0 0x5583360e3950 unknown :-1 s=CLOSED pgs=2622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.527+0000 7f58159ea740 1 -- 172.21.15.42:0/2111429496 >> 172.21.15.42:0/2111429496 conn(0x558335c714e0 msgr2=0x558336024410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:36.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.527+0000 7f58159ea740 1 -- 172.21.15.42:0/2111429496 shutdown_connections 2024-09-17T01:50:36.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.527+0000 7f58159ea740 1 -- 172.21.15.42:0/2111429496 wait complete. 2024-09-17T01:50:36.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.527+0000 7f58159ea740 20 client.11847 trim_cache size 0 max 16384 2024-09-17T01:50:36.528 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:50:36.529 INFO:teuthology.orchestra.run.smithi042.stdout: "status": "no active scrubs running", 2024-09-17T01:50:36.529 INFO:teuthology.orchestra.run.smithi042.stdout: "scrubs": {}, 2024-09-17T01:50:36.529 INFO:teuthology.orchestra.run.smithi042.stdout: "scrub_stats": { 2024-09-17T01:50:36.529 INFO:teuthology.orchestra.run.smithi042.stdout: "01c320cd-fa68-4bd5-8f83-7093367c7109": { 2024-09-17T01:50:36.529 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:50:05.908013+0000", 2024-09-17T01:50:36.529 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-17T01:50:36.529 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:50:36.529 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:50:36.529 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:50:36.529 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:50:36.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T01:50:36.530 INFO:teuthology.orchestra.run.smithi042.stdout: "e7620a81-dc19-43a9-a344-f1ffb93dfff2": { 2024-09-17T01:50:36.530 INFO:teuthology.orchestra.run.smithi042.stdout: "start_time": "2024-09-17T01:49:41.704309+0000", 2024-09-17T01:50:36.530 INFO:teuthology.orchestra.run.smithi042.stdout: "path": "/", 2024-09-17T01:50:36.530 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_started": 0, 2024-09-17T01:50:36.530 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_passed": 0, 2024-09-17T01:50:36.530 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_failed": 0, 2024-09-17T01:50:36.530 INFO:teuthology.orchestra.run.smithi042.stdout: "uninline_skipped": 0 2024-09-17T01:50:36.530 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:50:36.530 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T01:50:36.530 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:50:36.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.528+0000 7f580ea00640 1 -- 172.21.15.42:0/1106367879 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f57e4078b90 msgr2=0x7f57e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:36.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.528+0000 7f580ea00640 1 --2- 172.21.15.42:0/1106367879 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f57e4078b90 0x7f57e407b0a0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f57f80058c0 tx=0x7f57f8005850 comp rx=0 tx=0).stop 2024-09-17T01:50:36.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.528+0000 7f580ea00640 1 -- 172.21.15.42:0/1106367879 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5808161350 msgr2=0x7f58081f6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:36.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.528+0000 7f580ea00640 1 --2- 172.21.15.42:0/1106367879 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5808161350 0x7f58081f6c80 secure :-1 s=READY pgs=2618 cs=0 l=1 rev1=1 crypto rx=0x7f5800009d90 tx=0x7f5800003d00 comp rx=0 tx=0).stop 2024-09-17T01:50:36.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.528+0000 7f580ea00640 1 -- 172.21.15.42:0/1106367879 shutdown_connections 2024-09-17T01:50:36.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.528+0000 7f580ea00640 1 --2- 172.21.15.42:0/1106367879 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f57e4078b90 0x7f57e407b0a0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.528+0000 7f580ea00640 1 --2- 172.21.15.42:0/1106367879 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5808161350 0x7f58081f6c80 unknown :-1 s=CLOSED pgs=2618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.528+0000 7f580ea00640 1 --2- 172.21.15.42:0/1106367879 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f580815dd50 0x7f58080b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.528+0000 7f580ea00640 1 --2- 172.21.15.42:0/1106367879 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58080cdc00 0x7f58080aace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:36.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.528+0000 7f580ea00640 1 -- 172.21.15.42:0/1106367879 >> 172.21.15.42:0/1106367879 conn(0x7f580806d1b0 msgr2=0x7f580815e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:36.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.528+0000 7f580ea00640 1 -- 172.21.15.42:0/1106367879 shutdown_connections 2024-09-17T01:50:36.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:36.528+0000 7f580ea00640 1 -- 172.21.15.42:0/1106367879 wait complete. 2024-09-17T01:50:36.548 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T01:50:36.951 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:50:37.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.184+0000 7f6542e00640 1 -- 172.21.15.42:0/2903211919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f653c15f4c0 msgr2=0x7f653c15f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:37.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.184+0000 7f6542e00640 1 --2- 172.21.15.42:0/2903211919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f653c15f4c0 0x7f653c15f8d0 secure :-1 s=READY pgs=2623 cs=0 l=1 rev1=1 crypto rx=0x7f653c071e40 tx=0x7f653402aa30 comp rx=0 tx=0).stop 2024-09-17T01:50:37.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.184+0000 7f6542e00640 1 -- 172.21.15.42:0/2903211919 shutdown_connections 2024-09-17T01:50:37.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.184+0000 7f6542e00640 1 --2- 172.21.15.42:0/2903211919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f653c15f4c0 0x7f653c15f8d0 unknown :-1 s=CLOSED pgs=2623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.184+0000 7f6542e00640 1 --2- 172.21.15.42:0/2903211919 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f653c0ae240 0x7f653c0702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.184+0000 7f6542e00640 1 --2- 172.21.15.42:0/2903211919 >> v2:172.21.15.43:3300/0 conn(0x7f653c0ade30 0x7f653c06fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.184+0000 7f6542e00640 1 -- 172.21.15.42:0/2903211919 >> 172.21.15.42:0/2903211919 conn(0x7f653c06cdc0 msgr2=0x7f653c06d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:37.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.184+0000 7f6542e00640 1 -- 172.21.15.42:0/2903211919 shutdown_connections 2024-09-17T01:50:37.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.184+0000 7f6542e00640 1 -- 172.21.15.42:0/2903211919 wait complete. 2024-09-17T01:50:37.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.186+0000 7f6542e00640 1 Processor -- start 2024-09-17T01:50:37.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.186+0000 7f6542e00640 1 -- start start 2024-09-17T01:50:37.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.188+0000 7f6542e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f653c0ade30 0x7f653c152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:37.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.188+0000 7f6542e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f653c0ae240 0x7f653c09d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:37.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.188+0000 7f6542e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f653c15f4c0 0x7f653c0738b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:37.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.188+0000 7f6542e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f653c15ff90 con 0x7f653c0ae240 2024-09-17T01:50:37.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.188+0000 7f6542e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f653c15fe10 con 0x7f653c0ade30 2024-09-17T01:50:37.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.188+0000 7f6542e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f653c160110 con 0x7f653c15f4c0 2024-09-17T01:50:37.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.188+0000 7f6533400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f653c0ae240 0x7f653c09d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:37.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.188+0000 7f6533400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f653c0ae240 0x7f653c09d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55014/0 (socket says 172.21.15.42:55014) 2024-09-17T01:50:37.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.188+0000 7f6533400640 1 -- 172.21.15.42:0/359098902 learned_addr learned my addr 172.21.15.42:0/359098902 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:37.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.188+0000 7f653be00640 1 --2- 172.21.15.42:0/359098902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f653c0ade30 0x7f653c152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:37.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.188+0000 7f6540e00640 1 --2- 172.21.15.42:0/359098902 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f653c15f4c0 0x7f653c0738b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:37.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.188+0000 7f6533400640 1 -- 172.21.15.42:0/359098902 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f653c15f4c0 msgr2=0x7f653c0738b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:37.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.188+0000 7f6533400640 1 --2- 172.21.15.42:0/359098902 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f653c15f4c0 0x7f653c0738b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.188+0000 7f6533400640 1 -- 172.21.15.42:0/359098902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f653c0ade30 msgr2=0x7f653c152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:37.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.188+0000 7f6533400640 1 --2- 172.21.15.42:0/359098902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f653c0ade30 0x7f653c152450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.188+0000 7f6533400640 1 -- 172.21.15.42:0/359098902 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653c1f9810 con 0x7f653c0ae240 2024-09-17T01:50:37.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.189+0000 7f6533400640 1 --2- 172.21.15.42:0/359098902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f653c0ae240 0x7f653c09d2b0 secure :-1 s=READY pgs=2624 cs=0 l=1 rev1=1 crypto rx=0x7f652400d6d0 tx=0x7f652400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:37.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.189+0000 7f6538c00640 1 -- 172.21.15.42:0/359098902 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6524017070 con 0x7f653c0ae240 2024-09-17T01:50:37.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.189+0000 7f6538c00640 1 -- 172.21.15.42:0/359098902 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6524005330 con 0x7f653c0ae240 2024-09-17T01:50:37.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.189+0000 7f6542e00640 1 -- 172.21.15.42:0/359098902 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f653c1f9af0 con 0x7f653c0ae240 2024-09-17T01:50:37.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.189+0000 7f6538c00640 1 -- 172.21.15.42:0/359098902 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6524009820 con 0x7f653c0ae240 2024-09-17T01:50:37.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.189+0000 7f6542e00640 1 -- 172.21.15.42:0/359098902 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f653c1fa0b0 con 0x7f653c0ae240 2024-09-17T01:50:37.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.190+0000 7f6542e00640 1 -- 172.21.15.42:0/359098902 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f653c15f8d0 con 0x7f653c0ae240 2024-09-17T01:50:37.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.192+0000 7f6538c00640 1 -- 172.21.15.42:0/359098902 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6524009bd0 con 0x7f653c0ae240 2024-09-17T01:50:37.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.193+0000 7f6538c00640 1 --2- 172.21.15.42:0/359098902 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6518078b90 0x7f651807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:37.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.193+0000 7f6538c00640 1 -- 172.21.15.42:0/359098902 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f652409b090 con 0x7f653c0ae240 2024-09-17T01:50:37.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.194+0000 7f653be00640 1 --2- 172.21.15.42:0/359098902 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6518078b90 0x7f651807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:37.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.194+0000 7f653be00640 1 --2- 172.21.15.42:0/359098902 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6518078b90 0x7f651807b0a0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f652c005fd0 tx=0x7f652c00b260 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:37.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.198+0000 7f6538c00640 1 -- 172.21.15.42:0/359098902 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6524062d80 con 0x7f653c0ae240 2024-09-17T01:50:37.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.431+0000 7f6542e00640 1 -- 172.21.15.42:0/359098902 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f653c15e550 con 0x7f653c0ae240 2024-09-17T01:50:37.429 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.431+0000 7f6538c00640 1 -- 172.21.15.42:0/359098902 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 183 v183) ==== 95+0+5242 (secure 0 0 0) 0x7f65240677b0 con 0x7f653c0ae240 2024-09-17T01:50:37.430 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:50:37.430 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":183,"btime":"2024-09-17T01:49:32:618086+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9479,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1690107508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1690107508},{"type":"v1","addr":"172.21.15.43:6837","nonce":1690107508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":179},{"gid":11511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1418140325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1418140325},{"type":"v1","addr":"172.21.15.42:6833","nonce":1418140325}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":171},{"gid":11514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2781042225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":2781042225},{"type":"v1","addr":"172.21.15.42:6835","nonce":2781042225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":172}],"filesystems":[{"mdsmap":{"epoch":183,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:49:16.188388+0000","modified":"2024-09-17T01:49:32.618079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":227,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11517":{"gid":11517,"name":"d","rank":0,"incarnation":180,"state":"up:active","state_seq":8,"addr":"172.21.15.43:6836/4082001755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4082001755},{"type":"v1","addr":"172.21.15.43:6836","nonce":4082001755}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11517,"qdb_cluster":[11517]},"id":16}]} 2024-09-17T01:50:37.430 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 183 2024-09-17T01:50:37.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.434+0000 7f6542e00640 1 -- 172.21.15.42:0/359098902 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6518078b90 msgr2=0x7f651807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:37.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.434+0000 7f6542e00640 1 --2- 172.21.15.42:0/359098902 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6518078b90 0x7f651807b0a0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f652c005fd0 tx=0x7f652c00b260 comp rx=0 tx=0).stop 2024-09-17T01:50:37.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.434+0000 7f6542e00640 1 -- 172.21.15.42:0/359098902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f653c0ae240 msgr2=0x7f653c09d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:37.432 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.434+0000 7f6542e00640 1 --2- 172.21.15.42:0/359098902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f653c0ae240 0x7f653c09d2b0 secure :-1 s=READY pgs=2624 cs=0 l=1 rev1=1 crypto rx=0x7f652400d6d0 tx=0x7f652400db90 comp rx=0 tx=0).stop 2024-09-17T01:50:37.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.434+0000 7f6542e00640 1 -- 172.21.15.42:0/359098902 shutdown_connections 2024-09-17T01:50:37.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.434+0000 7f6542e00640 1 --2- 172.21.15.42:0/359098902 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6518078b90 0x7f651807b0a0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.434+0000 7f6542e00640 1 --2- 172.21.15.42:0/359098902 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f653c15f4c0 0x7f653c0738b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.434+0000 7f6542e00640 1 --2- 172.21.15.42:0/359098902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f653c0ae240 0x7f653c09d2b0 unknown :-1 s=CLOSED pgs=2624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.434+0000 7f6542e00640 1 --2- 172.21.15.42:0/359098902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f653c0ade30 0x7f653c152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.434+0000 7f6542e00640 1 -- 172.21.15.42:0/359098902 >> 172.21.15.42:0/359098902 conn(0x7f653c06cdc0 msgr2=0x7f653c15ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:37.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.434+0000 7f6542e00640 1 -- 172.21.15.42:0/359098902 shutdown_connections 2024-09-17T01:50:37.433 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.434+0000 7f6542e00640 1 -- 172.21.15.42:0/359098902 wait complete. 2024-09-17T01:50:37.457 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 183, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T01:49:16.188388+0000', 'modified': '2024-09-17T01:49:32.618079+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 227, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11517}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11517': {'gid': 11517, 'name': 'd', 'rank': 0, 'incarnation': 180, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.43:6836/4082001755', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 4082001755}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 4082001755}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [33], 'metadata_pool': 32, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 11517, 'qdb_cluster': [11517]} 2024-09-17T01:50:37.457 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T01:50:37.457 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T01:50:37.686 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.688+0000 7f7ffb200640 1 -- 172.21.15.42:0/4245667916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fe0003c10 msgr2=0x7f7fe0004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:37.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.688+0000 7f7ffb200640 1 --2- 172.21.15.42:0/4245667916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fe0003c10 0x7f7fe0004060 secure :-1 s=READY pgs=2626 cs=0 l=1 rev1=1 crypto rx=0x7f7fec009b50 tx=0x7f7fe0005830 comp rx=0 tx=0).stop 2024-09-17T01:50:37.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.688+0000 7f7ffa800640 1 -- 172.21.15.42:0/4245667916 reap_dead start 2024-09-17T01:50:37.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.688+0000 7f7ffb200640 1 -- 172.21.15.42:0/4245667916 shutdown_connections 2024-09-17T01:50:37.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.688+0000 7f7ffb200640 1 -- 172.21.15.42:0/4245667916 >> 172.21.15.42:0/4245667916 conn(0x7f7ffc06d3f0 msgr2=0x7f7ffc0b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:37.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.688+0000 7f7ffb200640 1 -- 172.21.15.42:0/4245667916 shutdown_connections 2024-09-17T01:50:37.687 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.688+0000 7f7ffb200640 1 -- 172.21.15.42:0/4245667916 wait complete. 2024-09-17T01:50:37.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.691+0000 7f7ffb200640 1 Processor -- start 2024-09-17T01:50:37.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.691+0000 7f7ffb200640 1 -- start start 2024-09-17T01:50:37.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.692+0000 7f7ffb200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7fe0003c10 0x7f7ffc158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:37.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.692+0000 7f7ffb200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ffc0c65f0 0x7f7ffc1f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:37.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.692+0000 7f7ffb200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ffc0c6a00 0x7f7ffc158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:37.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.692+0000 7f7ffb200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc0b55e0 con 0x7f7ffc0c65f0 2024-09-17T01:50:37.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.692+0000 7f7ffb200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc0cfd50 con 0x7f7ffc0c6a00 2024-09-17T01:50:37.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.692+0000 7f7ffb200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7ffc0b5760 con 0x7f7fe0003c10 2024-09-17T01:50:37.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.692+0000 7f7ff3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ffc0c65f0 0x7f7ffc1f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:37.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.692+0000 7f7ff3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ffc0c65f0 0x7f7ffc1f5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55032/0 (socket says 172.21.15.42:55032) 2024-09-17T01:50:37.691 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.692+0000 7f7ff3e00640 1 -- 172.21.15.42:0/3248305487 learned_addr learned my addr 172.21.15.42:0/3248305487 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:37.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.693+0000 7f7ffa800640 1 --2- 172.21.15.42:0/3248305487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ffc0c6a00 0x7f7ffc158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:37.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.693+0000 7f7ff9e00640 1 --2- 172.21.15.42:0/3248305487 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7fe0003c10 0x7f7ffc158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:37.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.693+0000 7f7ff3e00640 1 -- 172.21.15.42:0/3248305487 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7fe0003c10 msgr2=0x7f7ffc158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:37.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.693+0000 7f7ff3e00640 1 --2- 172.21.15.42:0/3248305487 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7fe0003c10 0x7f7ffc158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.693+0000 7f7ff3e00640 1 -- 172.21.15.42:0/3248305487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ffc0c6a00 msgr2=0x7f7ffc158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:37.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.693+0000 7f7ff3e00640 1 --2- 172.21.15.42:0/3248305487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ffc0c6a00 0x7f7ffc158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.693+0000 7f7ff3e00640 1 -- 172.21.15.42:0/3248305487 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ffc1f6140 con 0x7f7ffc0c65f0 2024-09-17T01:50:37.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.693+0000 7f7ff9e00640 1 --2- 172.21.15.42:0/3248305487 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7fe0003c10 0x7f7ffc158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:37.692 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.693+0000 7f7ff3e00640 1 --2- 172.21.15.42:0/3248305487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ffc0c65f0 0x7f7ffc1f5410 secure :-1 s=READY pgs=2627 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4006630 tx=0x7f7fe40039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:37.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.693+0000 7f7ff2000640 1 -- 172.21.15.42:0/3248305487 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4015070 con 0x7f7ffc0c65f0 2024-09-17T01:50:37.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.693+0000 7f7ff2000640 1 -- 172.21.15.42:0/3248305487 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fe4011920 con 0x7f7ffc0c65f0 2024-09-17T01:50:37.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.693+0000 7f7ff2000640 1 -- 172.21.15.42:0/3248305487 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4011d70 con 0x7f7ffc0c65f0 2024-09-17T01:50:37.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.694+0000 7f7ffb200640 1 -- 172.21.15.42:0/3248305487 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ffc157830 con 0x7f7ffc0c65f0 2024-09-17T01:50:37.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.694+0000 7f7ffb200640 1 -- 172.21.15.42:0/3248305487 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ffc157df0 con 0x7f7ffc0c65f0 2024-09-17T01:50:37.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.696+0000 7f7ff2000640 1 -- 172.21.15.42:0/3248305487 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7fe4018070 con 0x7f7ffc0c65f0 2024-09-17T01:50:37.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.697+0000 7f7ff2000640 1 --2- 172.21.15.42:0/3248305487 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7fd8078b90 0x7f7fd807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:37.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.697+0000 7f7ff2000640 1 -- 172.21.15.42:0/3248305487 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f7fe409ba90 con 0x7f7ffc0c65f0 2024-09-17T01:50:37.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.697+0000 7f8007c33740 1 Processor -- start 2024-09-17T01:50:37.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.697+0000 7f7ff9e00640 1 --2- 172.21.15.42:0/3248305487 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7fd8078b90 0x7f7fd807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:37.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.698+0000 7f8007c33740 1 -- start start 2024-09-17T01:50:37.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.698+0000 7f7ff9e00640 1 --2- 172.21.15.42:0/3248305487 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7fd8078b90 0x7f7fd807b0a0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f7fec035000 tx=0x7f7fec02d040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:37.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.699+0000 7f8007c33740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c953270 0x55870cd23b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:37.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.699+0000 7f8007c33740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55870c92a3b0 0x55870cd240a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:37.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.699+0000 7f8007c33740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55870c932590 0x55870ccf4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:37.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.699+0000 7f8007c33740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55870cc7d430 con 0x55870c953270 2024-09-17T01:50:37.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.699+0000 7f8007c33740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55870cc6d5d0 con 0x55870c92a3b0 2024-09-17T01:50:37.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.699+0000 7f8007c33740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55870cc5ca00 con 0x55870c932590 2024-09-17T01:50:37.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.699+0000 7f7ff9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c953270 0x55870cd23b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:37.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.699+0000 7f7ff9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c953270 0x55870cd23b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55040/0 (socket says 172.21.15.42:55040) 2024-09-17T01:50:37.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.699+0000 7f7ff9e00640 1 -- 172.21.15.42:0/247298387 learned_addr learned my addr 172.21.15.42:0/247298387 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:37.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.699+0000 7f7ff3e00640 1 --2- 172.21.15.42:0/247298387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55870c92a3b0 0x55870cd240a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:37.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.699+0000 7f7ffa800640 1 --2- 172.21.15.42:0/247298387 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55870c932590 0x55870ccf4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:37.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.700+0000 7f7ff9e00640 1 -- 172.21.15.42:0/247298387 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55870c932590 msgr2=0x55870ccf4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:37.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.700+0000 7f7ff9e00640 1 --2- 172.21.15.42:0/247298387 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55870c932590 0x55870ccf4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.700+0000 7f7ff9e00640 1 -- 172.21.15.42:0/247298387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55870c92a3b0 msgr2=0x55870cd240a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:37.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.700+0000 7f7ff9e00640 1 --2- 172.21.15.42:0/247298387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55870c92a3b0 0x55870cd240a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.700+0000 7f7ff9e00640 1 -- 172.21.15.42:0/247298387 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55870cc25520 con 0x55870c953270 2024-09-17T01:50:37.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.700+0000 7f7ff9e00640 1 --2- 172.21.15.42:0/247298387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c953270 0x55870cd23b60 secure :-1 s=READY pgs=2628 cs=0 l=1 rev1=1 crypto rx=0x7f7fec009c40 tx=0x7f7fe0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11389469ee4d77f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:37.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.701+0000 7f7fea600640 1 -- 172.21.15.42:0/247298387 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec038040 con 0x55870c953270 2024-09-17T01:50:37.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.701+0000 7f7fea600640 1 -- 172.21.15.42:0/247298387 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fec043070 con 0x55870c953270 2024-09-17T01:50:37.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.701+0000 7f7fea600640 1 -- 172.21.15.42:0/247298387 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec03ee20 con 0x55870c953270 2024-09-17T01:50:37.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.701+0000 7f8007c33740 1 -- 172.21.15.42:0/247298387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c953270 msgr2=0x55870cd23b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:37.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.701+0000 7f8007c33740 1 --2- 172.21.15.42:0/247298387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c953270 0x55870cd23b60 secure :-1 s=READY pgs=2628 cs=0 l=1 rev1=1 crypto rx=0x7f7fec009c40 tx=0x7f7fe0005830 comp rx=0 tx=0).stop 2024-09-17T01:50:37.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.701+0000 7f8007c33740 1 -- 172.21.15.42:0/247298387 shutdown_connections 2024-09-17T01:50:37.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.701+0000 7f8007c33740 1 --2- 172.21.15.42:0/247298387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55870c92a3b0 0x55870cd240a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.701+0000 7f8007c33740 1 --2- 172.21.15.42:0/247298387 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55870c932590 0x55870ccf4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.701+0000 7f8007c33740 1 --2- 172.21.15.42:0/247298387 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c953270 0x55870cd23b60 unknown :-1 s=CLOSED pgs=2628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.701+0000 7f8007c33740 1 -- 172.21.15.42:0/247298387 >> 172.21.15.42:0/247298387 conn(0x55870c9473c0 msgr2=0x55870ccf9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:37.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.702+0000 7f8007c33740 1 -- 172.21.15.42:0/247298387 shutdown_connections 2024-09-17T01:50:37.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.702+0000 7f8007c33740 1 -- 172.21.15.42:0/247298387 wait complete. 2024-09-17T01:50:37.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.703+0000 7f8007c33740 1 -- start start 2024-09-17T01:50:37.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.703+0000 7f8007c33740 1 Processor -- start 2024-09-17T01:50:37.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.704+0000 7f8007c33740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55870c92a3b0 0x55870cd4e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:37.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.704+0000 7f8007c33740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55870c932590 0x55870cd387e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:37.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.704+0000 7f8007c33740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c953270 0x55870cd38f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:37.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.704+0000 7f8007c33740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55870cc03330 con 0x55870c953270 2024-09-17T01:50:37.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.704+0000 7f8007c33740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55870cc60810 con 0x55870c932590 2024-09-17T01:50:37.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.704+0000 7f8007c33740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55870c9cd620 con 0x55870c92a3b0 2024-09-17T01:50:37.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.705+0000 7f8007c33740 10 client.0 _ll_register_callbacks cb 0x55870cc08420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:50:37.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.705+0000 7f7ffa800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c953270 0x55870cd38f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:37.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.705+0000 7f7ffa800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c953270 0x55870cd38f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55056/0 (socket says 172.21.15.42:55056) 2024-09-17T01:50:37.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.705+0000 7f7ffa800640 1 -- 172.21.15.42:0/1260571017 learned_addr learned my addr 172.21.15.42:0/1260571017 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:37.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.705+0000 7f7ff3e00640 1 --2- 172.21.15.42:0/1260571017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55870c932590 0x55870cd387e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:37.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.705+0000 7f7ff9e00640 1 --2- 172.21.15.42:0/1260571017 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55870c92a3b0 0x55870cd4e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:37.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.705+0000 7f7ffa800640 1 -- 172.21.15.42:0/1260571017 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55870c92a3b0 msgr2=0x55870cd4e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:37.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.705+0000 7f7ffa800640 1 --2- 172.21.15.42:0/1260571017 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55870c92a3b0 0x55870cd4e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.705+0000 7f7ffa800640 1 -- 172.21.15.42:0/1260571017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55870c932590 msgr2=0x55870cd387e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:37.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.705+0000 7f7ffa800640 1 --2- 172.21.15.42:0/1260571017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55870c932590 0x55870cd387e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.705+0000 7f7ffa800640 1 -- 172.21.15.42:0/1260571017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55870c9be850 con 0x55870c953270 2024-09-17T01:50:37.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.706+0000 7f7ffa800640 1 --2- 172.21.15.42:0/1260571017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c953270 0x55870cd38f30 secure :-1 s=READY pgs=2629 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc074680 tx=0x7f7ff4001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61f3f1ea258a8e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:37.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.706+0000 7f7fdea00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:50:37.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.706+0000 7f7fdea00640 1 -- 172.21.15.42:0/1260571017 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4012650 con 0x55870c953270 2024-09-17T01:50:37.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.706+0000 7f7fdea00640 1 -- 172.21.15.42:0/1260571017 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f7ff40127f0 con 0x55870c953270 2024-09-17T01:50:37.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.706+0000 7f8007c33740 1 -- 172.21.15.42:0/1260571017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fec043070 con 0x55870c953270 2024-09-17T01:50:37.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.706+0000 7f7fdea00640 1 -- 172.21.15.42:0/1260571017 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=183) ==== 24+0+0 (secure 0 0 0) 0x7f7ff4023050 con 0x55870c953270 2024-09-17T01:50:37.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.706+0000 7f8007c33740 10 client.11865 fetch_fsmap learned FSMap version 183 2024-09-17T01:50:37.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.706+0000 7f8007c33740 1 -- 172.21.15.42:0/1260571017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=183,monmap=2+}) -- 0x55870ca356b0 con 0x55870c953270 2024-09-17T01:50:37.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.706+0000 7f7fdea00640 1 -- 172.21.15.42:0/1260571017 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fec043070 con 0x55870c953270 2024-09-17T01:50:37.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.707+0000 7f7fdea00640 1 -- 172.21.15.42:0/1260571017 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 183) ==== 3502+0+0 (secure 0 0 0) 0x7f7ff4026020 con 0x55870c953270 2024-09-17T01:50:37.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.707+0000 7f8007c33740 10 client.11865 fetch_fsmap finished waiting for FSMap version 183 2024-09-17T01:50:37.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.707+0000 7f8007c33740 10 client.11865 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T01:50:37.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.707+0000 7f8007c33740 20 client.11865 populate_metadata read hostname 'smithi042' 2024-09-17T01:50:37.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.707+0000 7f8007c33740 1 --2- 172.21.15.42:0/1260571017 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55870c911e40 0x55870cd51130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:37.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.707+0000 7f8007c33740 4 client.11865 mds_command: new command op to 11517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T01:50:37.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.707+0000 7f8007c33740 1 -- 172.21.15.42:0/1260571017 --> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55870cc6f520 con 0x55870c911e40 2024-09-17T01:50:37.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.707+0000 7f7ff9e00640 1 --2- 172.21.15.42:0/1260571017 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55870c911e40 0x55870cd51130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:37.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.708+0000 7f7ff9e00640 1 --2- 172.21.15.42:0/1260571017 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55870c911e40 0x55870cd51130 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6daf0bb047ca385 server_cookie=690e5d8db8082768 in_seq=0 out_seq=0 2024-09-17T01:50:37.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.708+0000 7f7fdea00640 10 client.11865 ms_handle_connect on v2:172.21.15.43:6834/4082001755 2024-09-17T01:50:37.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.709+0000 7f7fdea00640 1 -- 172.21.15.42:0/1260571017 <== mds.0 v2:172.21.15.43:6834/4082001755 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55870cc6f520 con 0x55870c911e40 2024-09-17T01:50:37.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.709+0000 7f7fdea00640 10 client.11865 handle_command_reply: tid=0 2024-09-17T01:50:37.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.709+0000 7f8007c33740 1 client.11865 shutdown 2024-09-17T01:50:37.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.709+0000 7f8007c33740 1 -- 172.21.15.42:0/1260571017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c953270 msgr2=0x55870cd38f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:37.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.709+0000 7f8007c33740 1 --2- 172.21.15.42:0/1260571017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c953270 0x55870cd38f30 secure :-1 s=READY pgs=2629 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc074680 tx=0x7f7ff4001b80 comp rx=0 tx=0).stop 2024-09-17T01:50:37.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.709+0000 7f8007c33740 1 -- 172.21.15.42:0/1260571017 shutdown_connections 2024-09-17T01:50:37.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.709+0000 7f8007c33740 1 --2- 172.21.15.42:0/1260571017 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55870c911e40 0x55870cd51130 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.709+0000 7f8007c33740 1 --2- 172.21.15.42:0/1260571017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55870c932590 0x55870cd387e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.709+0000 7f8007c33740 1 --2- 172.21.15.42:0/1260571017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c953270 0x55870cd38f30 unknown :-1 s=CLOSED pgs=2629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.709+0000 7f8007c33740 1 --2- 172.21.15.42:0/1260571017 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55870c92a3b0 0x55870cd4e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.709+0000 7f7fdea00640 0 client.11865 ms_handle_reset on v2:172.21.15.43:6834/4082001755 2024-09-17T01:50:37.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.709+0000 7f8007c33740 1 -- 172.21.15.42:0/1260571017 >> 172.21.15.42:0/1260571017 conn(0x55870c9473c0 msgr2=0x55870cd41630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:37.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.709+0000 7f8007c33740 1 -- 172.21.15.42:0/1260571017 shutdown_connections 2024-09-17T01:50:37.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.709+0000 7f8007c33740 1 -- 172.21.15.42:0/1260571017 wait complete. 2024-09-17T01:50:37.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.710+0000 7f8007c33740 20 client.11865 trim_cache size 0 max 16384 2024-09-17T01:50:37.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.729+0000 7f8007c33740 1 Processor -- start 2024-09-17T01:50:37.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.729+0000 7f8007c33740 1 -- start start 2024-09-17T01:50:37.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.730+0000 7f8007c33740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c92a3b0 0x55870cd4cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:37.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.730+0000 7f8007c33740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55870c932590 0x55870cd37c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:37.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.730+0000 7f8007c33740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55870c953270 0x55870cd40680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:37.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.730+0000 7f8007c33740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc201480 con 0x55870c92a3b0 2024-09-17T01:50:37.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.730+0000 7f8007c33740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7ffc1f9460 con 0x55870c953270 2024-09-17T01:50:37.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.730+0000 7f8007c33740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7ffc200e30 con 0x55870c932590 2024-09-17T01:50:37.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.731+0000 7f7ff9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c92a3b0 0x55870cd4cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:37.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.731+0000 7f7ff9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c92a3b0 0x55870cd4cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55062/0 (socket says 172.21.15.42:55062) 2024-09-17T01:50:37.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.731+0000 7f7ff9e00640 1 -- 172.21.15.42:0/3494249082 learned_addr learned my addr 172.21.15.42:0/3494249082 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:37.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.731+0000 7f7ff3e00640 1 --2- 172.21.15.42:0/3494249082 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55870c932590 0x55870cd37c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:37.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.731+0000 7f7ffa800640 1 --2- 172.21.15.42:0/3494249082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55870c953270 0x55870cd40680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:37.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.731+0000 7f7ff9e00640 1 -- 172.21.15.42:0/3494249082 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55870c932590 msgr2=0x55870cd37c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:37.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.731+0000 7f7ff9e00640 1 --2- 172.21.15.42:0/3494249082 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55870c932590 0x55870cd37c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.731+0000 7f7ff9e00640 1 -- 172.21.15.42:0/3494249082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55870c953270 msgr2=0x55870cd40680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:37.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.731+0000 7f7ff9e00640 1 --2- 172.21.15.42:0/3494249082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55870c953270 0x55870cd40680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.731+0000 7f7ff9e00640 1 -- 172.21.15.42:0/3494249082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55870cd392a0 con 0x55870c92a3b0 2024-09-17T01:50:37.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.731+0000 7f7ff9e00640 1 --2- 172.21.15.42:0/3494249082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c92a3b0 0x55870cd4cf80 secure :-1 s=READY pgs=2630 cs=0 l=1 rev1=1 crypto rx=0x7f7fec036040 tx=0x7f7fec03c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307bc4c55978a69f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:37.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.732+0000 7f7fe9c00640 1 -- 172.21.15.42:0/3494249082 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec03e8f0 con 0x55870c92a3b0 2024-09-17T01:50:37.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.732+0000 7f7fe9c00640 1 -- 172.21.15.42:0/3494249082 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fec05e030 con 0x55870c92a3b0 2024-09-17T01:50:37.731 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.732+0000 7f7fe9c00640 1 -- 172.21.15.42:0/3494249082 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec03ede0 con 0x55870c92a3b0 2024-09-17T01:50:37.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.732+0000 7f8007c33740 1 -- 172.21.15.42:0/3494249082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c92a3b0 msgr2=0x55870cd4cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:37.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.732+0000 7f8007c33740 1 --2- 172.21.15.42:0/3494249082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c92a3b0 0x55870cd4cf80 secure :-1 s=READY pgs=2630 cs=0 l=1 rev1=1 crypto rx=0x7f7fec036040 tx=0x7f7fec03c000 comp rx=0 tx=0).stop 2024-09-17T01:50:37.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.732+0000 7f8007c33740 1 -- 172.21.15.42:0/3494249082 shutdown_connections 2024-09-17T01:50:37.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.732+0000 7f8007c33740 1 --2- 172.21.15.42:0/3494249082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55870c953270 0x55870cd40680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.732+0000 7f8007c33740 1 --2- 172.21.15.42:0/3494249082 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55870c932590 0x55870cd37c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.732+0000 7f8007c33740 1 --2- 172.21.15.42:0/3494249082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c92a3b0 0x55870cd4cf80 unknown :-1 s=CLOSED pgs=2630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.732+0000 7f8007c33740 1 -- 172.21.15.42:0/3494249082 >> 172.21.15.42:0/3494249082 conn(0x55870c9473c0 msgr2=0x55870cd383c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:37.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.732+0000 7f8007c33740 1 -- 172.21.15.42:0/3494249082 shutdown_connections 2024-09-17T01:50:37.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.732+0000 7f8007c33740 1 -- 172.21.15.42:0/3494249082 wait complete. 2024-09-17T01:50:37.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.733+0000 7f8007c33740 1 -- start start 2024-09-17T01:50:37.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.733+0000 7f8007c33740 1 Processor -- start 2024-09-17T01:50:37.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.735+0000 7f8007c33740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c92a3b0 0x55870cd1eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:37.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.735+0000 7f8007c33740 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55870c932590 0x55870cd4c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:37.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.735+0000 7f8007c33740 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55870c953270 0x55870cdb50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:37.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.735+0000 7f8007c33740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55870cd1fb30 con 0x55870c92a3b0 2024-09-17T01:50:37.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.735+0000 7f8007c33740 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55870cd1da20 con 0x55870c953270 2024-09-17T01:50:37.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.735+0000 7f8007c33740 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x55870cd1cee0 con 0x55870c932590 2024-09-17T01:50:37.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.735+0000 7f8007c33740 10 client.0 _ll_register_callbacks cb 0x7f7ff4006370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T01:50:37.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.735+0000 7f7ff9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c92a3b0 0x55870cd1eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:37.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.735+0000 7f7ff9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c92a3b0 0x55870cd1eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55072/0 (socket says 172.21.15.42:55072) 2024-09-17T01:50:37.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.735+0000 7f7ff9e00640 1 -- 172.21.15.42:0/2887557891 learned_addr learned my addr 172.21.15.42:0/2887557891 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:37.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.736+0000 7f7ff9e00640 1 -- 172.21.15.42:0/2887557891 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55870c932590 msgr2=0x55870cd4c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:37.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.736+0000 7f7ff9e00640 1 --2- 172.21.15.42:0/2887557891 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55870c932590 0x55870cd4c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.736+0000 7f7ff9e00640 1 -- 172.21.15.42:0/2887557891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55870c953270 msgr2=0x55870cdb50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T01:50:37.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.736+0000 7f7ffa800640 1 --2- 172.21.15.42:0/2887557891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55870c953270 0x55870cdb50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:37.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.736+0000 7f7ff9e00640 1 --2- 172.21.15.42:0/2887557891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55870c953270 0x55870cdb50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.736+0000 7f7ff9e00640 1 -- 172.21.15.42:0/2887557891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55870cd1bd10 con 0x55870c92a3b0 2024-09-17T01:50:37.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.736+0000 7f7ffa800640 1 --2- 172.21.15.42:0/2887557891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55870c953270 0x55870cdb50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:50:37.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.736+0000 7f7ff9e00640 1 --2- 172.21.15.42:0/2887557891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c92a3b0 0x55870cd1eb80 secure :-1 s=READY pgs=2631 cs=0 l=1 rev1=1 crypto rx=0x7f7fec009a70 tx=0x7f7fec03e870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63876fc8135b5626 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:37.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.736+0000 7f7fdea00640 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2024-09-17T01:50:37.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.736+0000 7f7fdea00640 1 -- 172.21.15.42:0/2887557891 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec03eea0 con 0x55870c92a3b0 2024-09-17T01:50:37.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.736+0000 7f7fdea00640 1 -- 172.21.15.42:0/2887557891 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f7fec033440 con 0x55870c92a3b0 2024-09-17T01:50:37.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.736+0000 7f8007c33740 1 -- 172.21.15.42:0/2887557891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fec05e030 con 0x55870c92a3b0 2024-09-17T01:50:37.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.737+0000 7f7fdea00640 1 -- 172.21.15.42:0/2887557891 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=183) ==== 24+0+0 (secure 0 0 0) 0x7f7fec033640 con 0x55870c92a3b0 2024-09-17T01:50:37.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.737+0000 7f8007c33740 10 client.11871 fetch_fsmap learned FSMap version 183 2024-09-17T01:50:37.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.737+0000 7f8007c33740 1 -- 172.21.15.42:0/2887557891 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=183,monmap=2+}) -- 0x55870cdb56d0 con 0x55870c92a3b0 2024-09-17T01:50:37.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.737+0000 7f7fdea00640 1 -- 172.21.15.42:0/2887557891 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fec05e030 con 0x55870c92a3b0 2024-09-17T01:50:37.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.737+0000 7f7fdea00640 1 -- 172.21.15.42:0/2887557891 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 183) ==== 3502+0+0 (secure 0 0 0) 0x7f7fec048070 con 0x55870c92a3b0 2024-09-17T01:50:37.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.737+0000 7f8007c33740 10 client.11871 fetch_fsmap finished waiting for FSMap version 183 2024-09-17T01:50:37.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.737+0000 7f8007c33740 10 client.11871 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T01:50:37.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.737+0000 7f8007c33740 20 client.11871 populate_metadata read hostname 'smithi042' 2024-09-17T01:50:37.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.737+0000 7f8007c33740 1 --2- 172.21.15.42:0/2887557891 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55870cd38320 0x55870cd38730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:37.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.737+0000 7f8007c33740 4 client.11871 mds_command: new command op to 11517 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T01:50:37.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.737+0000 7f8007c33740 1 -- 172.21.15.42:0/2887557891 --> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] -- command(tid 0: {"prefix": "status"}) -- 0x55870cc6afd0 con 0x55870cd38320 2024-09-17T01:50:37.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.738+0000 7f7ff3e00640 1 --2- 172.21.15.42:0/2887557891 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55870cd38320 0x55870cd38730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:37.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.738+0000 7f7ff3e00640 1 --2- 172.21.15.42:0/2887557891 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55870cd38320 0x55870cd38730 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b150b6558ec0256 server_cookie=e55b959caa0c1223 in_seq=0 out_seq=0 2024-09-17T01:50:37.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.738+0000 7f7fdea00640 10 client.11871 ms_handle_connect on v2:172.21.15.43:6834/4082001755 2024-09-17T01:50:37.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.739+0000 7f7fdea00640 1 -- 172.21.15.42:0/2887557891 <== mds.0 v2:172.21.15.43:6834/4082001755 1 ==== command_reply(tid 0: 0 ) ==== 8+0+335 (crc 0 0 0) 0x55870cc6afd0 con 0x55870cd38320 2024-09-17T01:50:37.739 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.739+0000 7f7fdea00640 10 client.11871 handle_command_reply: tid=0 2024-09-17T01:50:37.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.739+0000 7f8007c33740 1 client.11871 shutdown 2024-09-17T01:50:37.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.739+0000 7f8007c33740 1 -- 172.21.15.42:0/2887557891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c92a3b0 msgr2=0x55870cd1eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:37.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.739+0000 7f8007c33740 1 --2- 172.21.15.42:0/2887557891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c92a3b0 0x55870cd1eb80 secure :-1 s=READY pgs=2631 cs=0 l=1 rev1=1 crypto rx=0x7f7fec009a70 tx=0x7f7fec03e870 comp rx=0 tx=0).stop 2024-09-17T01:50:37.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.739+0000 7f8007c33740 1 -- 172.21.15.42:0/2887557891 shutdown_connections 2024-09-17T01:50:37.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.739+0000 7f8007c33740 1 --2- 172.21.15.42:0/2887557891 >> [v2:172.21.15.43:6834/4082001755,v1:172.21.15.43:6836/4082001755] conn(0x55870cd38320 0x55870cd38730 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.739+0000 7f8007c33740 1 --2- 172.21.15.42:0/2887557891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55870c953270 0x55870cdb50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.739+0000 7f7fdea00640 0 client.11871 ms_handle_reset on v2:172.21.15.43:6834/4082001755 2024-09-17T01:50:37.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.739+0000 7f8007c33740 1 --2- 172.21.15.42:0/2887557891 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x55870c932590 0x55870cd4c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.739+0000 7f8007c33740 1 --2- 172.21.15.42:0/2887557891 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55870c92a3b0 0x55870cd1eb80 unknown :-1 s=CLOSED pgs=2631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.739+0000 7f8007c33740 1 -- 172.21.15.42:0/2887557891 >> 172.21.15.42:0/2887557891 conn(0x55870c9473c0 msgr2=0x55870cd23e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:37.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.739+0000 7f8007c33740 1 -- 172.21.15.42:0/2887557891 shutdown_connections 2024-09-17T01:50:37.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.739+0000 7f8007c33740 1 -- 172.21.15.42:0/2887557891 wait complete. 2024-09-17T01:50:37.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.739+0000 7f8007c33740 20 client.11871 trim_cache size 0 max 16384 2024-09-17T01:50:37.741 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:50:37.741 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "fea1c88c-cb05-432f-a745-f9dcbb5f2503", 2024-09-17T01:50:37.741 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2024-09-17T01:50:37.741 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 11517, 2024-09-17T01:50:37.741 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2024-09-17T01:50:37.741 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2024-09-17T01:50:37.742 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2024-09-17T01:50:37.742 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 68.124560060999997, 2024-09-17T01:50:37.742 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 183, 2024-09-17T01:50:37.742 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 227, 2024-09-17T01:50:37.742 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 227, 2024-09-17T01:50:37.742 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 86.038750644000004 2024-09-17T01:50:37.742 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:50:37.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.740+0000 7f7ffb200640 1 -- 172.21.15.42:0/3248305487 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7fd8078b90 msgr2=0x7f7fd807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:37.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.740+0000 7f7ffb200640 1 --2- 172.21.15.42:0/3248305487 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7fd8078b90 0x7f7fd807b0a0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f7fec035000 tx=0x7f7fec02d040 comp rx=0 tx=0).stop 2024-09-17T01:50:37.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.740+0000 7f7ffb200640 1 -- 172.21.15.42:0/3248305487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ffc0c65f0 msgr2=0x7f7ffc1f5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:37.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.740+0000 7f7ffb200640 1 --2- 172.21.15.42:0/3248305487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ffc0c65f0 0x7f7ffc1f5410 secure :-1 s=READY pgs=2627 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4006630 tx=0x7f7fe40039c0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.740+0000 7f7ffb200640 1 -- 172.21.15.42:0/3248305487 shutdown_connections 2024-09-17T01:50:37.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.740+0000 7f7ffb200640 1 --2- 172.21.15.42:0/3248305487 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7fd8078b90 0x7f7fd807b0a0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.740+0000 7f7ffb200640 1 --2- 172.21.15.42:0/3248305487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ffc0c6a00 0x7f7ffc158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.740+0000 7f7ffb200640 1 --2- 172.21.15.42:0/3248305487 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ffc0c65f0 0x7f7ffc1f5410 unknown :-1 s=CLOSED pgs=2627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.740+0000 7f7ffb200640 1 --2- 172.21.15.42:0/3248305487 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7fe0003c10 0x7f7ffc158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:37.743 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.740+0000 7f7ffb200640 1 -- 172.21.15.42:0/3248305487 >> 172.21.15.42:0/3248305487 conn(0x7f7ffc06d3f0 msgr2=0x7f7ffc072990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:37.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.740+0000 7f7ffb200640 1 -- 172.21.15.42:0/3248305487 shutdown_connections 2024-09-17T01:50:37.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:37.740+0000 7f7ffb200640 1 -- 172.21.15.42:0/3248305487 wait complete. 2024-09-17T01:50:37.760 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T01:50:37.760 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:50:37.859 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T01:50:37.951 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T01:50:37.951 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:50:37.951 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:50:37.952 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:50:37.987 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:50:37.987 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:50:37.987 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:50:37.987 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:50:38.025 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:50:38.026 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:50:38.026 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:50:38.026 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:50:38.063 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:50:38.063 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T01:50:38.063 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:50:38.063 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:50:38.102 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:50:38.103 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:50:38.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.333+0000 7f7accc00640 1 -- 172.21.15.42:0/194088377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ac80d2830 msgr2=0x7f7ac80d2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:38.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.333+0000 7f7accc00640 1 --2- 172.21.15.42:0/194088377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ac80d2830 0x7f7ac80d2c40 secure :-1 s=READY pgs=2632 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80d2560 tx=0x7f7ac002a9a0 comp rx=0 tx=0).stop 2024-09-17T01:50:38.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.333+0000 7f7accc00640 1 -- 172.21.15.42:0/194088377 shutdown_connections 2024-09-17T01:50:38.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.333+0000 7f7accc00640 1 --2- 172.21.15.42:0/194088377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ac80d2830 0x7f7ac80d2c40 unknown :-1 s=CLOSED pgs=2632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:38.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.333+0000 7f7accc00640 1 --2- 172.21.15.42:0/194088377 >> v2:172.21.15.43:3300/0 conn(0x7f7ac80cf760 0x7f7ac80cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:38.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.333+0000 7f7accc00640 1 -- 172.21.15.42:0/194088377 >> 172.21.15.42:0/194088377 conn(0x7f7ac8073de0 msgr2=0x7f7ac806cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:38.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.333+0000 7f7accc00640 1 -- 172.21.15.42:0/194088377 shutdown_connections 2024-09-17T01:50:38.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.333+0000 7f7accc00640 1 -- 172.21.15.42:0/194088377 wait complete. 2024-09-17T01:50:38.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.335+0000 7f7accc00640 1 Processor -- start 2024-09-17T01:50:38.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.335+0000 7f7accc00640 1 -- start start 2024-09-17T01:50:38.335 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.337+0000 7f7accc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ac80cf760 0x7f7ac80c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:38.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.337+0000 7f7accc00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ac80d2830 0x7f7ac80c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:38.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.337+0000 7f7accc00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ac815c7b0 0x7f7ac8157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:38.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.337+0000 7f7accc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac80d1300 con 0x7f7ac80cf760 2024-09-17T01:50:38.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.337+0000 7f7accc00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac80d1180 con 0x7f7ac80d2830 2024-09-17T01:50:38.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.337+0000 7f7accc00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f7ac80d1480 con 0x7f7ac815c7b0 2024-09-17T01:50:38.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.337+0000 7f7ac7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ac80cf760 0x7f7ac80c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:38.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.337+0000 7f7ac7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ac80cf760 0x7f7ac80c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55090/0 (socket says 172.21.15.42:55090) 2024-09-17T01:50:38.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.337+0000 7f7ac7400640 1 -- 172.21.15.42:0/2370315450 learned_addr learned my addr 172.21.15.42:0/2370315450 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:38.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.337+0000 7f7abea00640 1 --2- 172.21.15.42:0/2370315450 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ac80d2830 0x7f7ac80c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:38.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.338+0000 7f7ac7e00640 1 --2- 172.21.15.42:0/2370315450 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ac815c7b0 0x7f7ac8157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:38.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.338+0000 7f7ac7400640 1 -- 172.21.15.42:0/2370315450 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ac815c7b0 msgr2=0x7f7ac8157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:38.336 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.338+0000 7f7ac7400640 1 --2- 172.21.15.42:0/2370315450 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ac815c7b0 0x7f7ac8157cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:38.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.338+0000 7f7ac7400640 1 -- 172.21.15.42:0/2370315450 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ac80d2830 msgr2=0x7f7ac80c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:38.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.338+0000 7f7ac7400640 1 --2- 172.21.15.42:0/2370315450 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ac80d2830 0x7f7ac80c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:38.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.338+0000 7f7ac7400640 1 -- 172.21.15.42:0/2370315450 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac8158da0 con 0x7f7ac80cf760 2024-09-17T01:50:38.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.338+0000 7f7ac7400640 1 --2- 172.21.15.42:0/2370315450 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ac80cf760 0x7f7ac80c9750 secure :-1 s=READY pgs=2633 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800c3d0 tx=0x7f7ab800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:38.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.338+0000 7f7abfe00640 1 -- 172.21.15.42:0/2370315450 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8017070 con 0x7f7ac80cf760 2024-09-17T01:50:38.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.338+0000 7f7abfe00640 1 -- 172.21.15.42:0/2370315450 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ab80053c0 con 0x7f7ac80cf760 2024-09-17T01:50:38.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.338+0000 7f7abfe00640 1 -- 172.21.15.42:0/2370315450 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8003850 con 0x7f7ac80cf760 2024-09-17T01:50:38.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.338+0000 7f7accc00640 1 -- 172.21.15.42:0/2370315450 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac8159040 con 0x7f7ac80cf760 2024-09-17T01:50:38.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.339+0000 7f7accc00640 1 -- 172.21.15.42:0/2370315450 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac81f72d0 con 0x7f7ac80cf760 2024-09-17T01:50:38.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.340+0000 7f7accc00640 1 -- 172.21.15.42:0/2370315450 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ac80c90a0 con 0x7f7ac80cf760 2024-09-17T01:50:38.338 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.341+0000 7f7abfe00640 1 -- 172.21.15.42:0/2370315450 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7ab801a070 con 0x7f7ac80cf760 2024-09-17T01:50:38.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.342+0000 7f7abfe00640 1 --2- 172.21.15.42:0/2370315450 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7aa4078b90 0x7f7aa407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:38.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.343+0000 7f7abfe00640 1 -- 172.21.15.42:0/2370315450 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f7ab809a0c0 con 0x7f7ac80cf760 2024-09-17T01:50:38.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.343+0000 7f7abea00640 1 --2- 172.21.15.42:0/2370315450 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7aa4078b90 0x7f7aa407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:38.341 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.344+0000 7f7abea00640 1 --2- 172.21.15.42:0/2370315450 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7aa4078b90 0x7f7aa407b0a0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80b3c20 tx=0x7f7ab0005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:38.345 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.347+0000 7f7abfe00640 1 -- 172.21.15.42:0/2370315450 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7ab8061e40 con 0x7f7ac80cf760 2024-09-17T01:50:38.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.574+0000 7f7accc00640 1 -- 172.21.15.42:0/2370315450 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ac80d18d0 con 0x7f7ac80cf760 2024-09-17T01:50:38.572 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.575+0000 7f7abfe00640 1 -- 172.21.15.42:0/2370315450 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 183 v183) ==== 95+0+5242 (secure 0 0 0) 0x7f7ab8066870 con 0x7f7ac80cf760 2024-09-17T01:50:38.573 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:50:38.573 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":183,"btime":"2024-09-17T01:49:32:618086+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9479,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1690107508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1690107508},{"type":"v1","addr":"172.21.15.43:6837","nonce":1690107508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":179},{"gid":11511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1418140325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1418140325},{"type":"v1","addr":"172.21.15.42:6833","nonce":1418140325}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":171},{"gid":11514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2781042225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":2781042225},{"type":"v1","addr":"172.21.15.42:6835","nonce":2781042225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":172}],"filesystems":[{"mdsmap":{"epoch":183,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:49:16.188388+0000","modified":"2024-09-17T01:49:32.618079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":227,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11517":{"gid":11517,"name":"d","rank":0,"incarnation":180,"state":"up:active","state_seq":8,"addr":"172.21.15.43:6836/4082001755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4082001755},{"type":"v1","addr":"172.21.15.43:6836","nonce":4082001755}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11517,"qdb_cluster":[11517]},"id":16}]} 2024-09-17T01:50:38.573 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 183 2024-09-17T01:50:38.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.577+0000 7f7accc00640 1 -- 172.21.15.42:0/2370315450 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7aa4078b90 msgr2=0x7f7aa407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:38.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.577+0000 7f7accc00640 1 --2- 172.21.15.42:0/2370315450 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7aa4078b90 0x7f7aa407b0a0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80b3c20 tx=0x7f7ab0005f90 comp rx=0 tx=0).stop 2024-09-17T01:50:38.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.577+0000 7f7accc00640 1 -- 172.21.15.42:0/2370315450 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ac80cf760 msgr2=0x7f7ac80c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:38.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.577+0000 7f7accc00640 1 --2- 172.21.15.42:0/2370315450 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ac80cf760 0x7f7ac80c9750 secure :-1 s=READY pgs=2633 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800c3d0 tx=0x7f7ab800c890 comp rx=0 tx=0).stop 2024-09-17T01:50:38.575 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.577+0000 7f7accc00640 1 -- 172.21.15.42:0/2370315450 shutdown_connections 2024-09-17T01:50:38.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.577+0000 7f7accc00640 1 --2- 172.21.15.42:0/2370315450 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f7aa4078b90 0x7f7aa407b0a0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:38.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.577+0000 7f7accc00640 1 --2- 172.21.15.42:0/2370315450 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ac80d2830 0x7f7ac80c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:38.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.577+0000 7f7accc00640 1 --2- 172.21.15.42:0/2370315450 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f7ac815c7b0 0x7f7ac8157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:38.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.577+0000 7f7accc00640 1 --2- 172.21.15.42:0/2370315450 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ac80cf760 0x7f7ac80c9750 unknown :-1 s=CLOSED pgs=2633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:38.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.577+0000 7f7accc00640 1 -- 172.21.15.42:0/2370315450 >> 172.21.15.42:0/2370315450 conn(0x7f7ac8073de0 msgr2=0x7f7ac80b7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:38.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.577+0000 7f7accc00640 1 -- 172.21.15.42:0/2370315450 shutdown_connections 2024-09-17T01:50:38.576 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.577+0000 7f7accc00640 1 -- 172.21.15.42:0/2370315450 wait complete. 2024-09-17T01:50:38.598 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:50:38.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.827+0000 7f73b4e00640 1 -- 172.21.15.42:0/2675460078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73b0160cd0 msgr2=0x7f73b00b55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:38.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.827+0000 7f73b4e00640 1 --2- 172.21.15.42:0/2675460078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73b0160cd0 0x7f73b00b55e0 secure :-1 s=READY pgs=2635 cs=0 l=1 rev1=1 crypto rx=0x7f73a8005fd0 tx=0x7f73a802a820 comp rx=0 tx=0).stop 2024-09-17T01:50:38.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.827+0000 7f73b4e00640 1 -- 172.21.15.42:0/2675460078 shutdown_connections 2024-09-17T01:50:38.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.827+0000 7f73b4e00640 1 --2- 172.21.15.42:0/2675460078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73b0160cd0 0x7f73b00b55e0 unknown :-1 s=CLOSED pgs=2635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:38.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.827+0000 7f73b4e00640 1 -- 172.21.15.42:0/2675460078 >> 172.21.15.42:0/2675460078 conn(0x7f73b006d3f0 msgr2=0x7f73b00b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:38.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.827+0000 7f73b4e00640 1 -- 172.21.15.42:0/2675460078 shutdown_connections 2024-09-17T01:50:38.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.827+0000 7f73b4e00640 1 -- 172.21.15.42:0/2675460078 wait complete. 2024-09-17T01:50:38.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.829+0000 7f73b4e00640 1 Processor -- start 2024-09-17T01:50:38.827 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.830+0000 7f73b4e00640 1 -- start start 2024-09-17T01:50:38.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.831+0000 7f73b4e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f73b00afb00 0x7f73b0143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:38.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.831+0000 7f73b4e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73b00b51d0 0x7f73b01f9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:38.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.831+0000 7f73b4e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73b006e8a0 0x7f73b00ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:38.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.831+0000 7f73b4e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f73b00cf710 con 0x7f73b00b51d0 2024-09-17T01:50:38.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.831+0000 7f73b4e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f73b00cf590 con 0x7f73b006e8a0 2024-09-17T01:50:38.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.831+0000 7f73b4e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f73b00cf890 con 0x7f73b00afb00 2024-09-17T01:50:38.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.831+0000 7f73a6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73b00b51d0 0x7f73b01f9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:38.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.831+0000 7f73a6a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73b00b51d0 0x7f73b01f9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55094/0 (socket says 172.21.15.42:55094) 2024-09-17T01:50:38.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.831+0000 7f73a6a00640 1 -- 172.21.15.42:0/3604903965 learned_addr learned my addr 172.21.15.42:0/3604903965 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:38.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.832+0000 7f73afe00640 1 --2- 172.21.15.42:0/3604903965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73b006e8a0 0x7f73b00ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:38.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.832+0000 7f73af400640 1 --2- 172.21.15.42:0/3604903965 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f73b00afb00 0x7f73b0143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:38.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.832+0000 7f73a6a00640 1 -- 172.21.15.42:0/3604903965 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f73b00afb00 msgr2=0x7f73b0143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:38.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.832+0000 7f73a6a00640 1 --2- 172.21.15.42:0/3604903965 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f73b00afb00 0x7f73b0143110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:38.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.832+0000 7f73a6a00640 1 -- 172.21.15.42:0/3604903965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73b006e8a0 msgr2=0x7f73b00ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:38.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.832+0000 7f73a6a00640 1 --2- 172.21.15.42:0/3604903965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73b006e8a0 0x7f73b00ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:38.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.832+0000 7f73a6a00640 1 -- 172.21.15.42:0/3604903965 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b0159ad0 con 0x7f73b00b51d0 2024-09-17T01:50:38.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.832+0000 7f73afe00640 1 --2- 172.21.15.42:0/3604903965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73b006e8a0 0x7f73b00ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:50:38.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.832+0000 7f73af400640 1 --2- 172.21.15.42:0/3604903965 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f73b00afb00 0x7f73b0143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:50:38.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.832+0000 7f73a6a00640 1 --2- 172.21.15.42:0/3604903965 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73b00b51d0 0x7f73b01f9750 secure :-1 s=READY pgs=2636 cs=0 l=1 rev1=1 crypto rx=0x7f739800c3a0 tx=0x7f739800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:38.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.832+0000 7f73a7e00640 1 -- 172.21.15.42:0/3604903965 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7398006890 con 0x7f73b00b51d0 2024-09-17T01:50:38.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.832+0000 7f73a7e00640 1 -- 172.21.15.42:0/3604903965 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7398006b20 con 0x7f73b00b51d0 2024-09-17T01:50:38.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.832+0000 7f73a7e00640 1 -- 172.21.15.42:0/3604903965 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7398007020 con 0x7f73b00b51d0 2024-09-17T01:50:38.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.832+0000 7f73b4e00640 1 -- 172.21.15.42:0/3604903965 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73b01f9c90 con 0x7f73b00b51d0 2024-09-17T01:50:38.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.833+0000 7f73b4e00640 1 -- 172.21.15.42:0/3604903965 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73b015a020 con 0x7f73b00b51d0 2024-09-17T01:50:38.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.834+0000 7f73b4e00640 1 -- 172.21.15.42:0/3604903965 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73b00b55e0 con 0x7f73b00b51d0 2024-09-17T01:50:38.833 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.835+0000 7f73a7e00640 1 -- 172.21.15.42:0/3604903965 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7398019020 con 0x7f73b00b51d0 2024-09-17T01:50:38.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.836+0000 7f73a7e00640 1 --2- 172.21.15.42:0/3604903965 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f738c078b90 0x7f738c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:38.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.836+0000 7f73a7e00640 1 -- 172.21.15.42:0/3604903965 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f739809a5b0 con 0x7f73b00b51d0 2024-09-17T01:50:38.834 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.836+0000 7f73af400640 1 --2- 172.21.15.42:0/3604903965 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f738c078b90 0x7f738c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:38.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.837+0000 7f73af400640 1 --2- 172.21.15.42:0/3604903965 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f738c078b90 0x7f738c07b0a0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f73a000a830 tx=0x7f73a0008040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:38.838 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:38.840+0000 7f73a7e00640 1 -- 172.21.15.42:0/3604903965 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f73980628f0 con 0x7f73b00b51d0 2024-09-17T01:50:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.072+0000 7f73b4e00640 1 -- 172.21.15.42:0/3604903965 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f73b015fb80 con 0x7f73b00b51d0 2024-09-17T01:50:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.073+0000 7f73a7e00640 1 -- 172.21.15.42:0/3604903965 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 183 v183) ==== 95+0+5242 (secure 0 0 0) 0x7f73980621f0 con 0x7f73b00b51d0 2024-09-17T01:50:39.071 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:50:39.071 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":183,"btime":"2024-09-17T01:49:32:618086+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9479,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1690107508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1690107508},{"type":"v1","addr":"172.21.15.43:6837","nonce":1690107508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":179},{"gid":11511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1418140325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1418140325},{"type":"v1","addr":"172.21.15.42:6833","nonce":1418140325}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":171},{"gid":11514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2781042225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":2781042225},{"type":"v1","addr":"172.21.15.42:6835","nonce":2781042225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":172}],"filesystems":[{"mdsmap":{"epoch":183,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:49:16.188388+0000","modified":"2024-09-17T01:49:32.618079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":227,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11517":{"gid":11517,"name":"d","rank":0,"incarnation":180,"state":"up:active","state_seq":8,"addr":"172.21.15.43:6836/4082001755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4082001755},{"type":"v1","addr":"172.21.15.43:6836","nonce":4082001755}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11517,"qdb_cluster":[11517]},"id":16}]} 2024-09-17T01:50:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 183 2024-09-17T01:50:39.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.075+0000 7f73b4e00640 1 -- 172.21.15.42:0/3604903965 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f738c078b90 msgr2=0x7f738c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:39.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.075+0000 7f73b4e00640 1 --2- 172.21.15.42:0/3604903965 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f738c078b90 0x7f738c07b0a0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f73a000a830 tx=0x7f73a0008040 comp rx=0 tx=0).stop 2024-09-17T01:50:39.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.075+0000 7f73b4e00640 1 -- 172.21.15.42:0/3604903965 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73b00b51d0 msgr2=0x7f73b01f9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:39.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.075+0000 7f73b4e00640 1 --2- 172.21.15.42:0/3604903965 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73b00b51d0 0x7f73b01f9750 secure :-1 s=READY pgs=2636 cs=0 l=1 rev1=1 crypto rx=0x7f739800c3a0 tx=0x7f739800c860 comp rx=0 tx=0).stop 2024-09-17T01:50:39.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.075+0000 7f73b4e00640 1 -- 172.21.15.42:0/3604903965 shutdown_connections 2024-09-17T01:50:39.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.075+0000 7f73b4e00640 1 --2- 172.21.15.42:0/3604903965 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f738c078b90 0x7f738c07b0a0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:39.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.075+0000 7f73b4e00640 1 --2- 172.21.15.42:0/3604903965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73b006e8a0 0x7f73b00ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:39.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.075+0000 7f73b4e00640 1 --2- 172.21.15.42:0/3604903965 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73b00b51d0 0x7f73b01f9750 unknown :-1 s=CLOSED pgs=2636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:39.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.075+0000 7f73b4e00640 1 --2- 172.21.15.42:0/3604903965 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f73b00afb00 0x7f73b0143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:39.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.075+0000 7f73b4e00640 1 -- 172.21.15.42:0/3604903965 >> 172.21.15.42:0/3604903965 conn(0x7f73b006d3f0 msgr2=0x7f73b0144e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:39.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.075+0000 7f73b4e00640 1 -- 172.21.15.42:0/3604903965 shutdown_connections 2024-09-17T01:50:39.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.075+0000 7f73b4e00640 1 -- 172.21.15.42:0/3604903965 wait complete. 2024-09-17T01:50:39.096 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:50:39.324 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.326+0000 7fe0baa00640 1 -- 172.21.15.42:0/837332761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0b40cf4c0 msgr2=0x7fe0b40d01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.326+0000 7fe0baa00640 1 --2- 172.21.15.42:0/837332761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0b40cf4c0 0x7fe0b40d01c0 secure :-1 s=READY pgs=2637 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0005fd0 tx=0x7fe0a002a4f0 comp rx=0 tx=0).stop 2024-09-17T01:50:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.326+0000 7fe0baa00640 1 -- 172.21.15.42:0/837332761 shutdown_connections 2024-09-17T01:50:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.326+0000 7fe0baa00640 1 --2- 172.21.15.42:0/837332761 >> v2:172.21.15.43:3300/0 conn(0x7fe0b40ce100 0x7fe0b40d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.326+0000 7fe0baa00640 1 --2- 172.21.15.42:0/837332761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0b40cf4c0 0x7fe0b40d01c0 unknown :-1 s=CLOSED pgs=2637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.326+0000 7fe0baa00640 1 --2- 172.21.15.42:0/837332761 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0b40cdcf0 0x7fe0b40cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.326+0000 7fe0baa00640 1 -- 172.21.15.42:0/837332761 >> 172.21.15.42:0/837332761 conn(0x7fe0b40b4180 msgr2=0x7fe0b40b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.326+0000 7fe0baa00640 1 -- 172.21.15.42:0/837332761 shutdown_connections 2024-09-17T01:50:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.326+0000 7fe0baa00640 1 -- 172.21.15.42:0/837332761 wait complete. 2024-09-17T01:50:39.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.328+0000 7fe0baa00640 1 Processor -- start 2024-09-17T01:50:39.326 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.328+0000 7fe0baa00640 1 -- start start 2024-09-17T01:50:39.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.330+0000 7fe0baa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0b40cdcf0 0x7fe0b40cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:39.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.330+0000 7fe0baa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0b40ce100 0x7fe0b40c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:39.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.330+0000 7fe0baa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0b40cf4c0 0x7fe0b40c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:39.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.330+0000 7fe0baa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b40b8030 con 0x7fe0b40ce100 2024-09-17T01:50:39.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.330+0000 7fe0baa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b40b7eb0 con 0x7fe0b40cdcf0 2024-09-17T01:50:39.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.330+0000 7fe0baa00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fe0b40b1e20 con 0x7fe0b40cf4c0 2024-09-17T01:50:39.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.330+0000 7fe0b8c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0b40ce100 0x7fe0b40c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:39.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.330+0000 7fe0b8c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0b40ce100 0x7fe0b40c8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55108/0 (socket says 172.21.15.42:55108) 2024-09-17T01:50:39.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.330+0000 7fe0b8c00640 1 -- 172.21.15.42:0/2370410776 learned_addr learned my addr 172.21.15.42:0/2370410776 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:39.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.330+0000 7fe0b9600640 1 --2- 172.21.15.42:0/2370410776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0b40cdcf0 0x7fe0b40cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:39.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.330+0000 7fe0ba000640 1 --2- 172.21.15.42:0/2370410776 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0b40cf4c0 0x7fe0b40c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:39.329 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.331+0000 7fe0b8c00640 1 -- 172.21.15.42:0/2370410776 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0b40cf4c0 msgr2=0x7fe0b40c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:39.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.331+0000 7fe0b8c00640 1 --2- 172.21.15.42:0/2370410776 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0b40cf4c0 0x7fe0b40c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:39.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.331+0000 7fe0b8c00640 1 -- 172.21.15.42:0/2370410776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0b40cdcf0 msgr2=0x7fe0b40cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:39.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.331+0000 7fe0b8c00640 1 --2- 172.21.15.42:0/2370410776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0b40cdcf0 0x7fe0b40cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:39.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.331+0000 7fe0b8c00640 1 -- 172.21.15.42:0/2370410776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b40a04b0 con 0x7fe0b40ce100 2024-09-17T01:50:39.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.331+0000 7fe0b8c00640 1 --2- 172.21.15.42:0/2370410776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0b40ce100 0x7fe0b40c8b00 secure :-1 s=READY pgs=2638 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0034040 tx=0x7fe0a0003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:39.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.331+0000 7fe0b1600640 1 -- 172.21.15.42:0/2370410776 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a003e030 con 0x7fe0b40ce100 2024-09-17T01:50:39.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.331+0000 7fe0b1600640 1 -- 172.21.15.42:0/2370410776 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0a0003e00 con 0x7fe0b40ce100 2024-09-17T01:50:39.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.331+0000 7fe0baa00640 1 -- 172.21.15.42:0/2370410776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b409cf20 con 0x7fe0b40ce100 2024-09-17T01:50:39.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.331+0000 7fe0b1600640 1 -- 172.21.15.42:0/2370410776 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0035040 con 0x7fe0b40ce100 2024-09-17T01:50:39.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.332+0000 7fe0baa00640 1 -- 172.21.15.42:0/2370410776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0b409d4e0 con 0x7fe0b40ce100 2024-09-17T01:50:39.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.333+0000 7fe0baa00640 1 -- 172.21.15.42:0/2370410776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0b40cef80 con 0x7fe0b40ce100 2024-09-17T01:50:39.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.334+0000 7fe0b1600640 1 -- 172.21.15.42:0/2370410776 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe0a0041030 con 0x7fe0b40ce100 2024-09-17T01:50:39.332 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.335+0000 7fe0b1600640 1 --2- 172.21.15.42:0/2370410776 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe094078bc0 0x7fe09407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:39.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.335+0000 7fe0b1600640 1 -- 172.21.15.42:0/2370410776 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7fe0a00bb4e0 con 0x7fe0b40ce100 2024-09-17T01:50:39.333 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.335+0000 7fe0b9600640 1 --2- 172.21.15.42:0/2370410776 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe094078bc0 0x7fe09407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:39.334 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.336+0000 7fe0b9600640 1 --2- 172.21.15.42:0/2370410776 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe094078bc0 0x7fe09407b0d0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fe0a800a4d0 tx=0x7fe0a800a460 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:39.337 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.340+0000 7fe0b1600640 1 -- 172.21.15.42:0/2370410776 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe0a0083300 con 0x7fe0b40ce100 2024-09-17T01:50:39.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.534+0000 7fe0baa00640 1 -- 172.21.15.42:0/2370410776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0b40751f0 con 0x7fe0b40ce100 2024-09-17T01:50:39.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.535+0000 7fe0b1600640 1 -- 172.21.15.42:0/2370410776 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v227) ==== 74+0+16764 (secure 0 0 0) 0x7fe0a0087d30 con 0x7fe0b40ce100 2024-09-17T01:50:39.533 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:50:39.534 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":227,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:49:27.940003+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":33,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":32,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:49:14.130558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"225","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":33,"pool_name":"cephfs_data","create_time":"2024-09-17T01:49:15.152992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"226","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6837/4233677817":"2024-09-18T01:49:27.939972+0000","172.21.15.43:6835/4233677817":"2024-09-18T01:49:27.939972+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:50:39.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.537+0000 7fe0baa00640 1 -- 172.21.15.42:0/2370410776 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe094078bc0 msgr2=0x7fe09407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:39.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.537+0000 7fe0baa00640 1 --2- 172.21.15.42:0/2370410776 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe094078bc0 0x7fe09407b0d0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fe0a800a4d0 tx=0x7fe0a800a460 comp rx=0 tx=0).stop 2024-09-17T01:50:39.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.537+0000 7fe0baa00640 1 -- 172.21.15.42:0/2370410776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0b40ce100 msgr2=0x7fe0b40c8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:39.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.537+0000 7fe0baa00640 1 --2- 172.21.15.42:0/2370410776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0b40ce100 0x7fe0b40c8b00 secure :-1 s=READY pgs=2638 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0034040 tx=0x7fe0a0003910 comp rx=0 tx=0).stop 2024-09-17T01:50:39.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.538+0000 7fe0baa00640 1 -- 172.21.15.42:0/2370410776 shutdown_connections 2024-09-17T01:50:39.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.538+0000 7fe0baa00640 1 --2- 172.21.15.42:0/2370410776 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fe094078bc0 0x7fe09407b0d0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:39.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.538+0000 7fe0baa00640 1 --2- 172.21.15.42:0/2370410776 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fe0b40cf4c0 0x7fe0b40c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:39.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.538+0000 7fe0baa00640 1 --2- 172.21.15.42:0/2370410776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0b40ce100 0x7fe0b40c8b00 unknown :-1 s=CLOSED pgs=2638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:39.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.538+0000 7fe0baa00640 1 --2- 172.21.15.42:0/2370410776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe0b40cdcf0 0x7fe0b40cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:39.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.538+0000 7fe0baa00640 1 -- 172.21.15.42:0/2370410776 >> 172.21.15.42:0/2370410776 conn(0x7fe0b40b4180 msgr2=0x7fe0b4071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:39.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.538+0000 7fe0baa00640 1 -- 172.21.15.42:0/2370410776 shutdown_connections 2024-09-17T01:50:39.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.538+0000 7fe0baa00640 1 -- 172.21.15.42:0/2370410776 wait complete. 2024-09-17T01:50:39.560 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T01:50:39.560 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:50:39.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.792+0000 7f79caa00640 1 -- 172.21.15.42:0/2676313483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79c415dcf0 msgr2=0x7f79c4072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:39.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.792+0000 7f79caa00640 1 --2- 172.21.15.42:0/2676313483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79c415dcf0 0x7f79c4072b60 secure :-1 s=READY pgs=2639 cs=0 l=1 rev1=1 crypto rx=0x7f79c41606c0 tx=0x7f79b402a560 comp rx=0 tx=0).stop 2024-09-17T01:50:39.790 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.792+0000 7f79caa00640 1 -- 172.21.15.42:0/2676313483 shutdown_connections 2024-09-17T01:50:39.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.792+0000 7f79caa00640 1 --2- 172.21.15.42:0/2676313483 >> v2:172.21.15.43:3300/0 conn(0x7f79c4160790 0x7f79c4160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:39.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.792+0000 7f79caa00640 1 --2- 172.21.15.42:0/2676313483 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f79c40cd620 0x7f79c40cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:39.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.792+0000 7f79caa00640 1 --2- 172.21.15.42:0/2676313483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79c415dcf0 0x7f79c4072b60 unknown :-1 s=CLOSED pgs=2639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:39.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.792+0000 7f79caa00640 1 -- 172.21.15.42:0/2676313483 >> 172.21.15.42:0/2676313483 conn(0x7f79c406d1b0 msgr2=0x7f79c406d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:39.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.792+0000 7f79caa00640 1 -- 172.21.15.42:0/2676313483 shutdown_connections 2024-09-17T01:50:39.791 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.792+0000 7f79caa00640 1 -- 172.21.15.42:0/2676313483 wait complete. 2024-09-17T01:50:39.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.794+0000 7f79caa00640 1 Processor -- start 2024-09-17T01:50:39.792 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.794+0000 7f79caa00640 1 -- start start 2024-09-17T01:50:39.794 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.796+0000 7f79caa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79c40cd620 0x7f79c40b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.796+0000 7f79caa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f79c415dcf0 0x7f79c41f9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.796+0000 7f79caa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79c4160790 0x7f79c415be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.796+0000 7f79caa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f79c406ed50 con 0x7f79c40cd620 2024-09-17T01:50:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.796+0000 7f79caa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f79c406ebd0 con 0x7f79c4160790 2024-09-17T01:50:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.796+0000 7f79caa00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f79c406eed0 con 0x7f79c415dcf0 2024-09-17T01:50:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.796+0000 7f79c3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79c40cd620 0x7f79c40b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.796+0000 7f79c3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79c40cd620 0x7f79c40b4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55114/0 (socket says 172.21.15.42:55114) 2024-09-17T01:50:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.796+0000 7f79c3e00640 1 -- 172.21.15.42:0/1267545985 learned_addr learned my addr 172.21.15.42:0/1267545985 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.796+0000 7f79bbe00640 1 --2- 172.21.15.42:0/1267545985 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f79c415dcf0 0x7f79c41f9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.796+0000 7f79c8a00640 1 --2- 172.21.15.42:0/1267545985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79c4160790 0x7f79c415be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.797+0000 7f79c3e00640 1 -- 172.21.15.42:0/1267545985 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f79c415dcf0 msgr2=0x7f79c41f9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:39.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.797+0000 7f79c3e00640 1 --2- 172.21.15.42:0/1267545985 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f79c415dcf0 0x7f79c41f9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:39.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.797+0000 7f79c3e00640 1 -- 172.21.15.42:0/1267545985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79c4160790 msgr2=0x7f79c415be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:39.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.797+0000 7f79c3e00640 1 --2- 172.21.15.42:0/1267545985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79c4160790 0x7f79c415be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:39.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.797+0000 7f79c3e00640 1 -- 172.21.15.42:0/1267545985 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c40b5310 con 0x7f79c40cd620 2024-09-17T01:50:39.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.797+0000 7f79c3e00640 1 --2- 172.21.15.42:0/1267545985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79c40cd620 0x7f79c40b4a10 secure :-1 s=READY pgs=2640 cs=0 l=1 rev1=1 crypto rx=0x7f79b4034040 tx=0x7f79b40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:39.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.797+0000 7f79c0c00640 1 -- 172.21.15.42:0/1267545985 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b403e030 con 0x7f79c40cd620 2024-09-17T01:50:39.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.797+0000 7f79c0c00640 1 -- 172.21.15.42:0/1267545985 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79b4003ca0 con 0x7f79c40cd620 2024-09-17T01:50:39.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.797+0000 7f79caa00640 1 -- 172.21.15.42:0/1267545985 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79c40b55f0 con 0x7f79c40cd620 2024-09-17T01:50:39.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.797+0000 7f79c0c00640 1 -- 172.21.15.42:0/1267545985 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b4035040 con 0x7f79c40cd620 2024-09-17T01:50:39.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.797+0000 7f79caa00640 1 -- 172.21.15.42:0/1267545985 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c40b41b0 con 0x7f79c40cd620 2024-09-17T01:50:39.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.798+0000 7f79caa00640 1 -- 172.21.15.42:0/1267545985 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79c40b5830 con 0x7f79c40cd620 2024-09-17T01:50:39.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.800+0000 7f79c0c00640 1 -- 172.21.15.42:0/1267545985 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f79b4041030 con 0x7f79c40cd620 2024-09-17T01:50:39.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.801+0000 7f79c0c00640 1 --2- 172.21.15.42:0/1267545985 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f79a0078b90 0x7f79a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:39.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.801+0000 7f79c0c00640 1 -- 172.21.15.42:0/1267545985 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f79b40bb640 con 0x7f79c40cd620 2024-09-17T01:50:39.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.801+0000 7f79bbe00640 1 --2- 172.21.15.42:0/1267545985 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f79a0078b90 0x7f79a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:39.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.802+0000 7f79bbe00640 1 --2- 172.21.15.42:0/1267545985 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f79a0078b90 0x7f79a007b0a0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f79c4072e10 tx=0x7f79ac005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:39.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:39.805+0000 7f79c0c00640 1 -- 172.21.15.42:0/1267545985 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f79c40b5830 con 0x7f79c40cd620 2024-09-17T01:50:40.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.039+0000 7f79caa00640 1 -- 172.21.15.42:0/1267545985 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79c406f3f0 con 0x7f79c40cd620 2024-09-17T01:50:40.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.039+0000 7f79c0c00640 1 -- 172.21.15.42:0/1267545985 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 183 v183) ==== 95+0+5242 (secure 0 0 0) 0x7f79b4083330 con 0x7f79c40cd620 2024-09-17T01:50:40.037 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:50:40.038 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":183,"btime":"2024-09-17T01:49:32:618086+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9479,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1690107508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1690107508},{"type":"v1","addr":"172.21.15.43:6837","nonce":1690107508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":179},{"gid":11511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1418140325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1418140325},{"type":"v1","addr":"172.21.15.42:6833","nonce":1418140325}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":171},{"gid":11514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2781042225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":2781042225},{"type":"v1","addr":"172.21.15.42:6835","nonce":2781042225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":172}],"filesystems":[{"mdsmap":{"epoch":183,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:49:16.188388+0000","modified":"2024-09-17T01:49:32.618079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":227,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11517":{"gid":11517,"name":"d","rank":0,"incarnation":180,"state":"up:active","state_seq":8,"addr":"172.21.15.43:6836/4082001755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4082001755},{"type":"v1","addr":"172.21.15.43:6836","nonce":4082001755}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11517,"qdb_cluster":[11517]},"id":16}]} 2024-09-17T01:50:40.038 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 183 2024-09-17T01:50:40.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.042+0000 7f79caa00640 1 -- 172.21.15.42:0/1267545985 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f79a0078b90 msgr2=0x7f79a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:40.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.042+0000 7f79caa00640 1 --2- 172.21.15.42:0/1267545985 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f79a0078b90 0x7f79a007b0a0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f79c4072e10 tx=0x7f79ac005f90 comp rx=0 tx=0).stop 2024-09-17T01:50:40.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.042+0000 7f79caa00640 1 -- 172.21.15.42:0/1267545985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79c40cd620 msgr2=0x7f79c40b4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:40.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.042+0000 7f79caa00640 1 --2- 172.21.15.42:0/1267545985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79c40cd620 0x7f79c40b4a10 secure :-1 s=READY pgs=2640 cs=0 l=1 rev1=1 crypto rx=0x7f79b4034040 tx=0x7f79b40038a0 comp rx=0 tx=0).stop 2024-09-17T01:50:40.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.042+0000 7f79caa00640 1 -- 172.21.15.42:0/1267545985 shutdown_connections 2024-09-17T01:50:40.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.042+0000 7f79caa00640 1 --2- 172.21.15.42:0/1267545985 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f79a0078b90 0x7f79a007b0a0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:40.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.042+0000 7f79caa00640 1 --2- 172.21.15.42:0/1267545985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79c4160790 0x7f79c415be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:40.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.042+0000 7f79caa00640 1 --2- 172.21.15.42:0/1267545985 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f79c415dcf0 0x7f79c41f9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:40.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.042+0000 7f79caa00640 1 --2- 172.21.15.42:0/1267545985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f79c40cd620 0x7f79c40b4a10 unknown :-1 s=CLOSED pgs=2640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:40.040 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.042+0000 7f79caa00640 1 -- 172.21.15.42:0/1267545985 >> 172.21.15.42:0/1267545985 conn(0x7f79c406d1b0 msgr2=0x7f79c40b2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:40.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.042+0000 7f79caa00640 1 -- 172.21.15.42:0/1267545985 shutdown_connections 2024-09-17T01:50:40.041 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.042+0000 7f79caa00640 1 -- 172.21.15.42:0/1267545985 wait complete. 2024-09-17T01:50:40.063 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:50:40.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.292+0000 7fb83ca00640 1 -- 172.21.15.42:0/4039674761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8380702d0 msgr2=0x7fb8381537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:40.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.292+0000 7fb83ca00640 1 --2- 172.21.15.42:0/4039674761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8380702d0 0x7fb8381537b0 secure :-1 s=READY pgs=2642 cs=0 l=1 rev1=1 crypto rx=0x7fb838071eb0 tx=0x7fb82802a580 comp rx=0 tx=0).stop 2024-09-17T01:50:40.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.292+0000 7fb83ca00640 1 -- 172.21.15.42:0/4039674761 shutdown_connections 2024-09-17T01:50:40.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.292+0000 7fb83ca00640 1 --2- 172.21.15.42:0/4039674761 >> v2:172.21.15.43:3300/0 conn(0x7fb838073e70 0x7fb838074280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:40.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.292+0000 7fb83ca00640 1 --2- 172.21.15.42:0/4039674761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8380702d0 0x7fb8381537b0 unknown :-1 s=CLOSED pgs=2642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:40.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.292+0000 7fb83ca00640 1 -- 172.21.15.42:0/4039674761 >> 172.21.15.42:0/4039674761 conn(0x7fb8380b2a50 msgr2=0x7fb8380b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:40.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.292+0000 7fb83ca00640 1 -- 172.21.15.42:0/4039674761 shutdown_connections 2024-09-17T01:50:40.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.292+0000 7fb83ca00640 1 -- 172.21.15.42:0/4039674761 wait complete. 2024-09-17T01:50:40.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.294+0000 7fb83ca00640 1 Processor -- start 2024-09-17T01:50:40.293 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.295+0000 7fb83ca00640 1 -- start start 2024-09-17T01:50:40.296 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.296+0000 7fb83ca00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8380702d0 0x7fb83814e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:40.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.296+0000 7fb83ca00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb838073e70 0x7fb8381f0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:40.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.296+0000 7fb83ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8380cff60 0x7fb8381f6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:40.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.296+0000 7fb83ca00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb83806f430 con 0x7fb8380cff60 2024-09-17T01:50:40.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.296+0000 7fb83ca00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb83806f2b0 con 0x7fb838073e70 2024-09-17T01:50:40.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.296+0000 7fb83ca00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb83806f5b0 con 0x7fb8380702d0 2024-09-17T01:50:40.297 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.296+0000 7fb837200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8380cff60 0x7fb8381f6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:40.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.296+0000 7fb837200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8380cff60 0x7fb8381f6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55128/0 (socket says 172.21.15.42:55128) 2024-09-17T01:50:40.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.296+0000 7fb837200640 1 -- 172.21.15.42:0/2703389195 learned_addr learned my addr 172.21.15.42:0/2703389195 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:40.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.297+0000 7fb82fe00640 1 --2- 172.21.15.42:0/2703389195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb838073e70 0x7fb8381f0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:40.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.297+0000 7fb836800640 1 --2- 172.21.15.42:0/2703389195 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8380702d0 0x7fb83814e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:40.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.297+0000 7fb837200640 1 -- 172.21.15.42:0/2703389195 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8380702d0 msgr2=0x7fb83814e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:40.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.297+0000 7fb837200640 1 --2- 172.21.15.42:0/2703389195 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8380702d0 0x7fb83814e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:40.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.297+0000 7fb837200640 1 -- 172.21.15.42:0/2703389195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb838073e70 msgr2=0x7fb8381f0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:40.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.297+0000 7fb837200640 1 --2- 172.21.15.42:0/2703389195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb838073e70 0x7fb8381f0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:40.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.297+0000 7fb837200640 1 -- 172.21.15.42:0/2703389195 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb838156260 con 0x7fb8380cff60 2024-09-17T01:50:40.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.297+0000 7fb837200640 1 --2- 172.21.15.42:0/2703389195 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8380cff60 0x7fb8381f6950 secure :-1 s=READY pgs=2643 cs=0 l=1 rev1=1 crypto rx=0x7fb830002230 tx=0x7fb83000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:40.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.297+0000 7fb82ea00640 1 -- 172.21.15.42:0/2703389195 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb830003b70 con 0x7fb8380cff60 2024-09-17T01:50:40.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.297+0000 7fb82ea00640 1 -- 172.21.15.42:0/2703389195 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb830003d10 con 0x7fb8380cff60 2024-09-17T01:50:40.299 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.297+0000 7fb82ea00640 1 -- 172.21.15.42:0/2703389195 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb830005330 con 0x7fb8380cff60 2024-09-17T01:50:40.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.297+0000 7fb83ca00640 1 -- 172.21.15.42:0/2703389195 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb838156540 con 0x7fb8380cff60 2024-09-17T01:50:40.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.298+0000 7fb83ca00640 1 -- 172.21.15.42:0/2703389195 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb838156b00 con 0x7fb8380cff60 2024-09-17T01:50:40.300 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.299+0000 7fb83ca00640 1 -- 172.21.15.42:0/2703389195 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8381537b0 con 0x7fb8380cff60 2024-09-17T01:50:40.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.300+0000 7fb82ea00640 1 -- 172.21.15.42:0/2703389195 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb8300056e0 con 0x7fb8380cff60 2024-09-17T01:50:40.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.301+0000 7fb82ea00640 1 --2- 172.21.15.42:0/2703389195 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb814078b90 0x7fb81407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:40.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.301+0000 7fb82ea00640 1 -- 172.21.15.42:0/2703389195 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7fb83009ae90 con 0x7fb8380cff60 2024-09-17T01:50:40.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.302+0000 7fb836800640 1 --2- 172.21.15.42:0/2703389195 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb814078b90 0x7fb81407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:40.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.302+0000 7fb836800640 1 --2- 172.21.15.42:0/2703389195 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb814078b90 0x7fb81407b0a0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fb828033000 tx=0x7fb828004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:40.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.305+0000 7fb82ea00640 1 -- 172.21.15.42:0/2703389195 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb8300631d0 con 0x7fb8380cff60 2024-09-17T01:50:40.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.541+0000 7fb83ca00640 1 -- 172.21.15.42:0/2703389195 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb838150fd0 con 0x7fb8380cff60 2024-09-17T01:50:40.540 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.542+0000 7fb82ea00640 1 -- 172.21.15.42:0/2703389195 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 183 v183) ==== 95+0+5242 (secure 0 0 0) 0x7fb830062ad0 con 0x7fb8380cff60 2024-09-17T01:50:40.540 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:50:40.540 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":183,"btime":"2024-09-17T01:49:32:618086+0000","default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9479,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1690107508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1690107508},{"type":"v1","addr":"172.21.15.43:6837","nonce":1690107508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":179},{"gid":11511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1418140325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1418140325},{"type":"v1","addr":"172.21.15.42:6833","nonce":1418140325}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":171},{"gid":11514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2781042225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":2781042225},{"type":"v1","addr":"172.21.15.42:6835","nonce":2781042225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":172}],"filesystems":[{"mdsmap":{"epoch":183,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T01:49:16.188388+0000","modified":"2024-09-17T01:49:32.618079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":227,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":11517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11517":{"gid":11517,"name":"d","rank":0,"incarnation":180,"state":"up:active","state_seq":8,"addr":"172.21.15.43:6836/4082001755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4082001755},{"type":"v1","addr":"172.21.15.43:6836","nonce":4082001755}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[33],"metadata_pool":32,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":11517,"qdb_cluster":[11517]},"id":16}]} 2024-09-17T01:50:40.540 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 183 2024-09-17T01:50:40.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.544+0000 7fb83ca00640 1 -- 172.21.15.42:0/2703389195 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb814078b90 msgr2=0x7fb81407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:40.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.544+0000 7fb83ca00640 1 --2- 172.21.15.42:0/2703389195 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb814078b90 0x7fb81407b0a0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fb828033000 tx=0x7fb828004730 comp rx=0 tx=0).stop 2024-09-17T01:50:40.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.544+0000 7fb83ca00640 1 -- 172.21.15.42:0/2703389195 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8380cff60 msgr2=0x7fb8381f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:40.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.544+0000 7fb83ca00640 1 --2- 172.21.15.42:0/2703389195 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8380cff60 0x7fb8381f6950 secure :-1 s=READY pgs=2643 cs=0 l=1 rev1=1 crypto rx=0x7fb830002230 tx=0x7fb83000cb90 comp rx=0 tx=0).stop 2024-09-17T01:50:40.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.544+0000 7fb83ca00640 1 -- 172.21.15.42:0/2703389195 shutdown_connections 2024-09-17T01:50:40.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.544+0000 7fb83ca00640 1 --2- 172.21.15.42:0/2703389195 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb814078b90 0x7fb81407b0a0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:40.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.544+0000 7fb83ca00640 1 --2- 172.21.15.42:0/2703389195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb838073e70 0x7fb8381f0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:40.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.544+0000 7fb83ca00640 1 --2- 172.21.15.42:0/2703389195 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb8380cff60 0x7fb8381f6950 unknown :-1 s=CLOSED pgs=2643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:40.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.544+0000 7fb83ca00640 1 --2- 172.21.15.42:0/2703389195 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb8380702d0 0x7fb83814e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:40.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.544+0000 7fb83ca00640 1 -- 172.21.15.42:0/2703389195 >> 172.21.15.42:0/2703389195 conn(0x7fb8380b2a50 msgr2=0x7fb838072ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:40.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.544+0000 7fb83ca00640 1 -- 172.21.15.42:0/2703389195 shutdown_connections 2024-09-17T01:50:40.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.544+0000 7fb83ca00640 1 -- 172.21.15.42:0/2703389195 wait complete. 2024-09-17T01:50:40.569 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:50:40.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.797+0000 7f1079400640 1 -- 172.21.15.42:0/1245789753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10740b6960 msgr2=0x7f10740b8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:40.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.797+0000 7f1079400640 1 --2- 172.21.15.42:0/1245789753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10740b6960 0x7f10740b8080 secure :-1 s=READY pgs=2645 cs=0 l=1 rev1=1 crypto rx=0x7f10740cedd0 tx=0x7f106c02aac0 comp rx=0 tx=0).stop 2024-09-17T01:50:40.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.797+0000 7f1079400640 1 -- 172.21.15.42:0/1245789753 shutdown_connections 2024-09-17T01:50:40.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.797+0000 7f1079400640 1 --2- 172.21.15.42:0/1245789753 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f10740b6960 0x7f10740b8080 unknown :-1 s=CLOSED pgs=2645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:40.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.797+0000 7f1079400640 1 --2- 172.21.15.42:0/1245789753 >> v2:172.21.15.43:3300/0 conn(0x7f107415eae0 0x7f10740d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:40.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.797+0000 7f1079400640 1 -- 172.21.15.42:0/1245789753 >> 172.21.15.42:0/1245789753 conn(0x7f107406d3f0 msgr2=0x7f10740d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:40.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.797+0000 7f1079400640 1 -- 172.21.15.42:0/1245789753 shutdown_connections 2024-09-17T01:50:40.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.797+0000 7f1079400640 1 -- 172.21.15.42:0/1245789753 wait complete. 2024-09-17T01:50:40.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.799+0000 7f1079400640 1 Processor -- start 2024-09-17T01:50:40.797 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.799+0000 7f1079400640 1 -- start start 2024-09-17T01:50:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.800+0000 7f1079400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10740b7c70 0x7f10740b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.801+0000 7f1079400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f107415eae0 0x7f107414c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.801+0000 7f1079400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10741eab20 0x7f107414deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.801+0000 7f1079400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f10740d37b0 con 0x7f107415eae0 2024-09-17T01:50:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.801+0000 7f1079400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f10740d3930 con 0x7f10740b7c70 2024-09-17T01:50:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.801+0000 7f1079400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f10740d3ab0 con 0x7f10741eab20 2024-09-17T01:50:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.801+0000 7f106be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f107415eae0 0x7f107414c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.801+0000 7f106be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f107415eae0 0x7f107414c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55154/0 (socket says 172.21.15.42:55154) 2024-09-17T01:50:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.801+0000 7f106be00640 1 -- 172.21.15.42:0/411512035 learned_addr learned my addr 172.21.15.42:0/411512035 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:40.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.801+0000 7f1073e00640 1 --2- 172.21.15.42:0/411512035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10740b7c70 0x7f10740b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:40.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.801+0000 7f1078a00640 1 --2- 172.21.15.42:0/411512035 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10741eab20 0x7f107414deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:40.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.801+0000 7f106be00640 1 -- 172.21.15.42:0/411512035 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10741eab20 msgr2=0x7f107414deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:40.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.801+0000 7f106be00640 1 --2- 172.21.15.42:0/411512035 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10741eab20 0x7f107414deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:40.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.801+0000 7f106be00640 1 -- 172.21.15.42:0/411512035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10740b7c70 msgr2=0x7f10740b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:40.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.801+0000 7f106be00640 1 --2- 172.21.15.42:0/411512035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10740b7c70 0x7f10740b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:40.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.801+0000 7f106be00640 1 -- 172.21.15.42:0/411512035 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10741eb270 con 0x7f107415eae0 2024-09-17T01:50:40.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.801+0000 7f1078a00640 1 --2- 172.21.15.42:0/411512035 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10741eab20 0x7f107414deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:40.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.802+0000 7f106be00640 1 --2- 172.21.15.42:0/411512035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f107415eae0 0x7f107414c230 secure :-1 s=READY pgs=2646 cs=0 l=1 rev1=1 crypto rx=0x7f105c00c3f0 tx=0x7f105c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:40.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.802+0000 7f1070c00640 1 -- 172.21.15.42:0/411512035 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c017070 con 0x7f107415eae0 2024-09-17T01:50:40.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.802+0000 7f1070c00640 1 -- 172.21.15.42:0/411512035 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f105c0035f0 con 0x7f107415eae0 2024-09-17T01:50:40.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.802+0000 7f1079400640 1 -- 172.21.15.42:0/411512035 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f107414b470 con 0x7f107415eae0 2024-09-17T01:50:40.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.802+0000 7f1070c00640 1 -- 172.21.15.42:0/411512035 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c003a40 con 0x7f107415eae0 2024-09-17T01:50:40.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.802+0000 7f1079400640 1 -- 172.21.15.42:0/411512035 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f107414ba30 con 0x7f107415eae0 2024-09-17T01:50:40.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.803+0000 7f1079400640 1 -- 172.21.15.42:0/411512035 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10740d3fd0 con 0x7f107415eae0 2024-09-17T01:50:40.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.804+0000 7f1070c00640 1 -- 172.21.15.42:0/411512035 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f105c01a070 con 0x7f107415eae0 2024-09-17T01:50:40.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.805+0000 7f1070c00640 1 --2- 172.21.15.42:0/411512035 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1050078b90 0x7f105007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:40.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.805+0000 7f1070c00640 1 -- 172.21.15.42:0/411512035 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f105c09a100 con 0x7f107415eae0 2024-09-17T01:50:40.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.806+0000 7f1073e00640 1 --2- 172.21.15.42:0/411512035 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1050078b90 0x7f105007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:40.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.806+0000 7f1073e00640 1 --2- 172.21.15.42:0/411512035 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1050078b90 0x7f105007b0a0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f1064009b30 tx=0x7f1064005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:40.807 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:40.810+0000 7f1070c00640 1 -- 172.21.15.42:0/411512035 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f105c061df0 con 0x7f107415eae0 2024-09-17T01:50:41.000 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.002+0000 7f1079400640 1 -- 172.21.15.42:0/411512035 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10741eb000 con 0x7f107415eae0 2024-09-17T01:50:41.001 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.003+0000 7f1070c00640 1 -- 172.21.15.42:0/411512035 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v227) ==== 74+0+16764 (secure 0 0 0) 0x7f105c066820 con 0x7f107415eae0 2024-09-17T01:50:41.001 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:50:41.002 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":227,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:49:27.940003+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":33,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":32,"pool_name":"cephfs_metadata","create_time":"2024-09-17T01:49:14.130558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"225","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":33,"pool_name":"cephfs_data","create_time":"2024-09-17T01:49:15.152992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"226","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6837/4233677817":"2024-09-18T01:49:27.939972+0000","172.21.15.43:6835/4233677817":"2024-09-18T01:49:27.939972+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:50:41.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.005+0000 7f1079400640 1 -- 172.21.15.42:0/411512035 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1050078b90 msgr2=0x7f105007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:41.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.005+0000 7f1079400640 1 --2- 172.21.15.42:0/411512035 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1050078b90 0x7f105007b0a0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f1064009b30 tx=0x7f1064005f90 comp rx=0 tx=0).stop 2024-09-17T01:50:41.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.005+0000 7f1079400640 1 -- 172.21.15.42:0/411512035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f107415eae0 msgr2=0x7f107414c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:41.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.005+0000 7f1079400640 1 --2- 172.21.15.42:0/411512035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f107415eae0 0x7f107414c230 secure :-1 s=READY pgs=2646 cs=0 l=1 rev1=1 crypto rx=0x7f105c00c3f0 tx=0x7f105c00c8b0 comp rx=0 tx=0).stop 2024-09-17T01:50:41.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.006+0000 7f1079400640 1 -- 172.21.15.42:0/411512035 shutdown_connections 2024-09-17T01:50:41.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.006+0000 7f1079400640 1 --2- 172.21.15.42:0/411512035 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1050078b90 0x7f105007b0a0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:41.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.006+0000 7f1079400640 1 --2- 172.21.15.42:0/411512035 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f10741eab20 0x7f107414deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:41.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.006+0000 7f1079400640 1 --2- 172.21.15.42:0/411512035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f107415eae0 0x7f107414c230 unknown :-1 s=CLOSED pgs=2646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:41.004 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.006+0000 7f1079400640 1 --2- 172.21.15.42:0/411512035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10740b7c70 0x7f10740b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:41.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.006+0000 7f1079400640 1 -- 172.21.15.42:0/411512035 >> 172.21.15.42:0/411512035 conn(0x7f107406d3f0 msgr2=0x7f107415d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:41.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.006+0000 7f1079400640 1 -- 172.21.15.42:0/411512035 shutdown_connections 2024-09-17T01:50:41.005 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.006+0000 7f1079400640 1 -- 172.21.15.42:0/411512035 wait complete. 2024-09-17T01:50:41.027 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T01:50:41.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.259+0000 7f8fbca00640 1 -- 172.21.15.42:0/17104937 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f9c005380 msgr2=0x7f8f9c00ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:41.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.259+0000 7f8fbca00640 1 --2- 172.21.15.42:0/17104937 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f9c005380 0x7f8f9c00ba40 secure :-1 s=READY pgs=2648 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000c610 tx=0x7f8f9c005830 comp rx=0 tx=0).stop 2024-09-17T01:50:41.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.259+0000 7f8fbca00640 1 -- 172.21.15.42:0/17104937 shutdown_connections 2024-09-17T01:50:41.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.259+0000 7f8fbca00640 1 --2- 172.21.15.42:0/17104937 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f9c005380 0x7f8f9c00ba40 unknown :-1 s=CLOSED pgs=2648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:41.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.259+0000 7f8fbca00640 1 -- 172.21.15.42:0/17104937 >> 172.21.15.42:0/17104937 conn(0x7f8fb806d3f0 msgr2=0x7f8fb80b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:41.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.259+0000 7f8fbca00640 1 -- 172.21.15.42:0/17104937 shutdown_connections 2024-09-17T01:50:41.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.259+0000 7f8fbca00640 1 -- 172.21.15.42:0/17104937 wait complete. 2024-09-17T01:50:41.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.261+0000 7f8fbca00640 1 Processor -- start 2024-09-17T01:50:41.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.262+0000 7f8fbca00640 1 -- start start 2024-09-17T01:50:41.262 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.263+0000 7f8fbca00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8f9c005380 0x7f8fb8156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:41.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.263+0000 7f8fbca00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fb8156da0 0x7f8fb814ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:41.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.263+0000 7f8fbca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8fb80b0190 0x7f8fb814cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:41.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.263+0000 7f8fbca00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb80b59c0 con 0x7f8fb80b0190 2024-09-17T01:50:41.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.263+0000 7f8fbca00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb80b5840 con 0x7f8fb8156da0 2024-09-17T01:50:41.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.263+0000 7f8fbca00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f8fb8073d00 con 0x7f8f9c005380 2024-09-17T01:50:41.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.263+0000 7f8fb7200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8fb80b0190 0x7f8fb814cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:41.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.263+0000 7f8fb7200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8fb80b0190 0x7f8fb814cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55174/0 (socket says 172.21.15.42:55174) 2024-09-17T01:50:41.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.263+0000 7f8fb6800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8f9c005380 0x7f8fb8156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:41.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.263+0000 7f8fb7200640 1 -- 172.21.15.42:0/1406567718 learned_addr learned my addr 172.21.15.42:0/1406567718 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:41.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.263+0000 7f8fafe00640 1 --2- 172.21.15.42:0/1406567718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fb8156da0 0x7f8fb814ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:41.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.264+0000 7f8fb7200640 1 -- 172.21.15.42:0/1406567718 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8f9c005380 msgr2=0x7f8fb8156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:41.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.264+0000 7f8fb7200640 1 --2- 172.21.15.42:0/1406567718 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8f9c005380 0x7f8fb8156860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:41.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.264+0000 7f8fb7200640 1 -- 172.21.15.42:0/1406567718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fb8156da0 msgr2=0x7f8fb814ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:41.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.264+0000 7f8fb7200640 1 --2- 172.21.15.42:0/1406567718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fb8156da0 0x7f8fb814ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:41.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.264+0000 7f8fb7200640 1 -- 172.21.15.42:0/1406567718 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb80aed40 con 0x7f8fb80b0190 2024-09-17T01:50:41.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.264+0000 7f8fafe00640 1 --2- 172.21.15.42:0/1406567718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fb8156da0 0x7f8fb814ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:41.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.264+0000 7f8fb7200640 1 --2- 172.21.15.42:0/1406567718 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8fb80b0190 0x7f8fb814cfc0 secure :-1 s=READY pgs=2649 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000c730 tx=0x7f8fb0001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:41.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.264+0000 7f8faea00640 1 -- 172.21.15.42:0/1406567718 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb002bac0 con 0x7f8fb80b0190 2024-09-17T01:50:41.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.264+0000 7f8faea00640 1 -- 172.21.15.42:0/1406567718 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8fb002bd50 con 0x7f8fb80b0190 2024-09-17T01:50:41.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.264+0000 7f8fbca00640 1 -- 172.21.15.42:0/1406567718 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb80af020 con 0x7f8fb80b0190 2024-09-17T01:50:41.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.264+0000 7f8faea00640 1 -- 172.21.15.42:0/1406567718 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0006300 con 0x7f8fb80b0190 2024-09-17T01:50:41.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.265+0000 7f8fbca00640 1 -- 172.21.15.42:0/1406567718 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb806e680 con 0x7f8fb80b0190 2024-09-17T01:50:41.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.266+0000 7f8fbca00640 1 -- 172.21.15.42:0/1406567718 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb8074200 con 0x7f8fb80b0190 2024-09-17T01:50:41.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.267+0000 7f8faea00640 1 -- 172.21.15.42:0/1406567718 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8fb00064a0 con 0x7f8fb80b0190 2024-09-17T01:50:41.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.268+0000 7f8faea00640 1 --2- 172.21.15.42:0/1406567718 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8f94078bc0 0x7f8f9407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:41.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.268+0000 7f8faea00640 1 -- 172.21.15.42:0/1406567718 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 5795+0+0 (secure 0 0 0) 0x7f8fb00baed0 con 0x7f8fb80b0190 2024-09-17T01:50:41.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.268+0000 7f8fb6800640 1 --2- 172.21.15.42:0/1406567718 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8f94078bc0 0x7f8f9407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:41.268 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.269+0000 7f8fb6800640 1 --2- 172.21.15.42:0/1406567718 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8f94078bc0 0x7f8f9407b0d0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8006580 tx=0x7f8fa8006b10 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:41.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.273+0000 7f8faea00640 1 -- 172.21.15.42:0/1406567718 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8fb0083210 con 0x7f8fb80b0190 2024-09-17T01:50:41.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.506+0000 7f8fbca00640 1 -- 172.21.15.42:0/1406567718 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8fb80af220 con 0x7f8fb80b0190 2024-09-17T01:50:41.504 INFO:tasks.ceph.mon.a.smithi042.stderr:2024-09-17T01:50:41.507+0000 7f9961e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:50:41.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.509+0000 7f8faea00640 1 -- 172.21.15.42:0/1406567718 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v184) ==== 161+0+0 (secure 0 0 0) 0x7f8fb0082b10 con 0x7f8fb80b0190 2024-09-17T01:50:41.506 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T01:50:41.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.512+0000 7f8fbca00640 1 -- 172.21.15.42:0/1406567718 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8f94078bc0 msgr2=0x7f8f9407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:41.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.512+0000 7f8fbca00640 1 --2- 172.21.15.42:0/1406567718 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8f94078bc0 0x7f8f9407b0d0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8006580 tx=0x7f8fa8006b10 comp rx=0 tx=0).stop 2024-09-17T01:50:41.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.512+0000 7f8fbca00640 1 -- 172.21.15.42:0/1406567718 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8fb80b0190 msgr2=0x7f8fb814cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:41.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.512+0000 7f8fbca00640 1 --2- 172.21.15.42:0/1406567718 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8fb80b0190 0x7f8fb814cfc0 secure :-1 s=READY pgs=2649 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000c730 tx=0x7f8fb0001ac0 comp rx=0 tx=0).stop 2024-09-17T01:50:41.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.512+0000 7f8fbca00640 1 -- 172.21.15.42:0/1406567718 shutdown_connections 2024-09-17T01:50:41.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.512+0000 7f8fbca00640 1 --2- 172.21.15.42:0/1406567718 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8f94078bc0 0x7f8f9407b0d0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:41.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.512+0000 7f8fbca00640 1 --2- 172.21.15.42:0/1406567718 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8fb8156da0 0x7f8fb814ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:41.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.512+0000 7f8fbca00640 1 --2- 172.21.15.42:0/1406567718 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8fb80b0190 0x7f8fb814cfc0 unknown :-1 s=CLOSED pgs=2649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:41.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.512+0000 7f8fbca00640 1 --2- 172.21.15.42:0/1406567718 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f8f9c005380 0x7f8fb8156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:41.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.512+0000 7f8fbca00640 1 -- 172.21.15.42:0/1406567718 >> 172.21.15.42:0/1406567718 conn(0x7f8fb806d3f0 msgr2=0x7f8fb8152fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:41.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.512+0000 7f8fbca00640 1 -- 172.21.15.42:0/1406567718 shutdown_connections 2024-09-17T01:50:41.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.513+0000 7f8fbca00640 1 -- 172.21.15.42:0/1406567718 wait complete. 2024-09-17T01:50:41.520 INFO:tasks.ceph.mds.d.smithi043.stderr: -3441> 2024-09-17T01:49:33.649+0000 7f5496c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T01:50:41.532 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T01:50:41.646 INFO:tasks.ceph.mds.d.smithi043.stdout:starting mds.d at 2024-09-17T01:50:41.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.764+0000 7f5cfe000640 1 -- 172.21.15.42:0/1916567448 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5cf80af970 msgr2=0x7f5cf8073ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:41.762 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.764+0000 7f5cfe000640 1 --2- 172.21.15.42:0/1916567448 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5cf80af970 0x7f5cf8073ba0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5cec005fd0 tx=0x7f5cec02a5d0 comp rx=0 tx=0).stop 2024-09-17T01:50:41.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.764+0000 7f5cfe000640 1 -- 172.21.15.42:0/1916567448 shutdown_connections 2024-09-17T01:50:41.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.764+0000 7f5cfe000640 1 --2- 172.21.15.42:0/1916567448 >> v2:172.21.15.43:3300/0 conn(0x7f5cf80b3520 0x7f5cf80b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:41.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.764+0000 7f5cfe000640 1 --2- 172.21.15.42:0/1916567448 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5cf80af970 0x7f5cf8073ba0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:41.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.764+0000 7f5cfe000640 1 -- 172.21.15.42:0/1916567448 >> 172.21.15.42:0/1916567448 conn(0x7f5cf806d3f0 msgr2=0x7f5cf80b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:41.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.764+0000 7f5cfe000640 1 -- 172.21.15.42:0/1916567448 shutdown_connections 2024-09-17T01:50:41.763 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.764+0000 7f5cfe000640 1 -- 172.21.15.42:0/1916567448 wait complete. 2024-09-17T01:50:41.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.766+0000 7f5cfe000640 1 Processor -- start 2024-09-17T01:50:41.764 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.766+0000 7f5cfe000640 1 -- start start 2024-09-17T01:50:41.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.768+0000 7f5cfe000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5cf80af970 0x7f5cf8147db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:41.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.768+0000 7f5cfe000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5cf80b3520 0x7f5cf80ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:41.769 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.768+0000 7f5cfe000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5cf8160500 0x7f5cf80cd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:41.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.768+0000 7f5cfe000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf80ce700 con 0x7f5cf80af970 2024-09-17T01:50:41.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.768+0000 7f5cfe000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf80ce580 con 0x7f5cf80b3520 2024-09-17T01:50:41.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.768+0000 7f5cfe000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf80ce880 con 0x7f5cf8160500 2024-09-17T01:50:41.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.768+0000 7f5cfcc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5cf80af970 0x7f5cf8147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:41.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.768+0000 7f5cfcc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5cf80af970 0x7f5cf8147db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55180/0 (socket says 172.21.15.42:55180) 2024-09-17T01:50:41.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.768+0000 7f5cfcc00640 1 -- 172.21.15.42:0/1166817955 learned_addr learned my addr 172.21.15.42:0/1166817955 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:41.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.768+0000 7f5cf7e00640 1 --2- 172.21.15.42:0/1166817955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5cf80b3520 0x7f5cf80ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:41.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.768+0000 7f5cfd600640 1 --2- 172.21.15.42:0/1166817955 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5cf8160500 0x7f5cf80cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:41.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.769+0000 7f5cfcc00640 1 -- 172.21.15.42:0/1166817955 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5cf8160500 msgr2=0x7f5cf80cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:41.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.769+0000 7f5cfcc00640 1 --2- 172.21.15.42:0/1166817955 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5cf8160500 0x7f5cf80cd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:41.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.769+0000 7f5cfcc00640 1 -- 172.21.15.42:0/1166817955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5cf80b3520 msgr2=0x7f5cf80ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:41.770 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.769+0000 7f5cfcc00640 1 --2- 172.21.15.42:0/1166817955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5cf80b3520 0x7f5cf80ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:41.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.769+0000 7f5cfcc00640 1 -- 172.21.15.42:0/1166817955 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf8149480 con 0x7f5cf80af970 2024-09-17T01:50:41.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.769+0000 7f5cf7e00640 1 --2- 172.21.15.42:0/1166817955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5cf80b3520 0x7f5cf80ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:50:41.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.769+0000 7f5cfcc00640 1 --2- 172.21.15.42:0/1166817955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5cf80af970 0x7f5cf8147db0 secure :-1 s=READY pgs=2650 cs=0 l=1 rev1=1 crypto rx=0x7f5cec034040 tx=0x7f5cec0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:41.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.769+0000 7f5cf4c00640 1 -- 172.21.15.42:0/1166817955 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cec03e030 con 0x7f5cf80af970 2024-09-17T01:50:41.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.770+0000 7f5cf4c00640 1 -- 172.21.15.42:0/1166817955 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5cec003ae0 con 0x7f5cf80af970 2024-09-17T01:50:41.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.770+0000 7f5cfe000640 1 -- 172.21.15.42:0/1166817955 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf8149760 con 0x7f5cf80af970 2024-09-17T01:50:41.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.770+0000 7f5cf4c00640 1 -- 172.21.15.42:0/1166817955 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cec035040 con 0x7f5cf80af970 2024-09-17T01:50:41.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.770+0000 7f5cfe000640 1 -- 172.21.15.42:0/1166817955 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf81e6e70 con 0x7f5cf80af970 2024-09-17T01:50:41.771 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.771+0000 7f5cfe000640 1 -- 172.21.15.42:0/1166817955 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cf8073ba0 con 0x7f5cf80af970 2024-09-17T01:50:41.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.772+0000 7f5cf4c00640 1 -- 172.21.15.42:0/1166817955 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5cec041030 con 0x7f5cf80af970 2024-09-17T01:50:41.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.773+0000 7f5cf4c00640 1 --2- 172.21.15.42:0/1166817955 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5cd8078b90 0x7f5cd807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:41.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.773+0000 7f5cf4c00640 1 -- 172.21.15.42:0/1166817955 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(228..228 src has 1..228) ==== 5881+0+0 (secure 0 0 0) 0x7f5cec0bb7a0 con 0x7f5cf80af970 2024-09-17T01:50:41.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.774+0000 7f5cf7e00640 1 --2- 172.21.15.42:0/1166817955 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5cd8078b90 0x7f5cd807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:41.772 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.774+0000 7f5cf7e00640 1 --2- 172.21.15.42:0/1166817955 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5cd8078b90 0x7f5cd807b0a0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f5cf80cda80 tx=0x7f5ce4005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:41.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:41.776+0000 7f5cf4c00640 1 -- 172.21.15.42:0/1166817955 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5cec0834c0 con 0x7f5cf80af970 2024-09-17T01:50:42.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.012+0000 7f5cfe000640 1 -- 172.21.15.42:0/1166817955 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5cf80af250 con 0x7f5cf80af970 2024-09-17T01:50:42.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.510+0000 7f5cf4c00640 1 -- 172.21.15.42:0/1166817955 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v185) ==== 104+0+0 (secure 0 0 0) 0x7f5cec087ef0 con 0x7f5cf80af970 2024-09-17T01:50:42.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.513+0000 7f5cfe000640 1 -- 172.21.15.42:0/1166817955 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5cd8078b90 msgr2=0x7f5cd807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:42.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.513+0000 7f5cfe000640 1 --2- 172.21.15.42:0/1166817955 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5cd8078b90 0x7f5cd807b0a0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f5cf80cda80 tx=0x7f5ce4005f90 comp rx=0 tx=0).stop 2024-09-17T01:50:42.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.513+0000 7f5cfe000640 1 -- 172.21.15.42:0/1166817955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5cf80af970 msgr2=0x7f5cf8147db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:42.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.513+0000 7f5cfe000640 1 --2- 172.21.15.42:0/1166817955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5cf80af970 0x7f5cf8147db0 secure :-1 s=READY pgs=2650 cs=0 l=1 rev1=1 crypto rx=0x7f5cec034040 tx=0x7f5cec0035f0 comp rx=0 tx=0).stop 2024-09-17T01:50:42.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.514+0000 7f5cfe000640 1 -- 172.21.15.42:0/1166817955 shutdown_connections 2024-09-17T01:50:42.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.514+0000 7f5cfe000640 1 --2- 172.21.15.42:0/1166817955 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f5cd8078b90 0x7f5cd807b0a0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:42.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.514+0000 7f5cfe000640 1 --2- 172.21.15.42:0/1166817955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5cf80b3520 0x7f5cf80ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:42.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.514+0000 7f5cfe000640 1 --2- 172.21.15.42:0/1166817955 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f5cf8160500 0x7f5cf80cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:42.512 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.514+0000 7f5cfe000640 1 --2- 172.21.15.42:0/1166817955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5cf80af970 0x7f5cf8147db0 unknown :-1 s=CLOSED pgs=2650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.514+0000 7f5cfe000640 1 -- 172.21.15.42:0/1166817955 >> 172.21.15.42:0/1166817955 conn(0x7f5cf806d3f0 msgr2=0x7f5cf80cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.514+0000 7f5cfe000640 1 -- 172.21.15.42:0/1166817955 shutdown_connections 2024-09-17T01:50:42.513 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.514+0000 7f5cfe000640 1 -- 172.21.15.42:0/1166817955 wait complete. 2024-09-17T01:50:42.536 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T01:50:42.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.775+0000 7ff4ede00640 1 -- 172.21.15.42:0/3890147454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e80b6ae0 msgr2=0x7ff4e815c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:42.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.775+0000 7ff4ede00640 1 --2- 172.21.15.42:0/3890147454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e80b6ae0 0x7ff4e815c700 secure :-1 s=READY pgs=2651 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8161450 tx=0x7ff4d802aa30 comp rx=0 tx=0).stop 2024-09-17T01:50:42.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.775+0000 7ff4ede00640 1 -- 172.21.15.42:0/3890147454 shutdown_connections 2024-09-17T01:50:42.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.775+0000 7ff4ede00640 1 --2- 172.21.15.42:0/3890147454 >> v2:172.21.15.43:3300/0 conn(0x7ff4e80d04a0 0x7ff4e80703c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:42.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.775+0000 7ff4ede00640 1 --2- 172.21.15.42:0/3890147454 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff4e80d0090 0x7ff4e806fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:42.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.775+0000 7ff4ede00640 1 --2- 172.21.15.42:0/3890147454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e80b6ae0 0x7ff4e815c700 unknown :-1 s=CLOSED pgs=2651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:42.773 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.775+0000 7ff4ede00640 1 -- 172.21.15.42:0/3890147454 >> 172.21.15.42:0/3890147454 conn(0x7ff4e80b2ca0 msgr2=0x7ff4e80b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:42.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.775+0000 7ff4ede00640 1 -- 172.21.15.42:0/3890147454 shutdown_connections 2024-09-17T01:50:42.774 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.775+0000 7ff4ede00640 1 -- 172.21.15.42:0/3890147454 wait complete. 2024-09-17T01:50:42.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.777+0000 7ff4ede00640 1 Processor -- start 2024-09-17T01:50:42.775 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.777+0000 7ff4ede00640 1 -- start start 2024-09-17T01:50:42.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.779+0000 7ff4ede00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4e80b6ae0 0x7ff4e814ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:42.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.779+0000 7ff4ede00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff4e80d0090 0x7ff4e814a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:42.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.779+0000 7ff4ede00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e80d04a0 0x7ff4e814a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:42.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.779+0000 7ff4ede00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e8160b70 con 0x7ff4e80d04a0 2024-09-17T01:50:42.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.779+0000 7ff4ede00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e81609f0 con 0x7ff4e80b6ae0 2024-09-17T01:50:42.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.779+0000 7ff4ede00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff4e8160cf0 con 0x7ff4e80d0090 2024-09-17T01:50:42.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.779+0000 7ff4ed400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e80d04a0 0x7ff4e814a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:42.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.779+0000 7ff4dfe00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff4e80d0090 0x7ff4e814a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:42.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.779+0000 7ff4eca00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4e80b6ae0 0x7ff4e814ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:42.777 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.779+0000 7ff4ed400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e80d04a0 0x7ff4e814a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55210/0 (socket says 172.21.15.42:55210) 2024-09-17T01:50:42.778 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.779+0000 7ff4ed400640 1 -- 172.21.15.42:0/593077108 learned_addr learned my addr 172.21.15.42:0/593077108 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:42.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.780+0000 7ff4ed400640 1 -- 172.21.15.42:0/593077108 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff4e80d0090 msgr2=0x7ff4e814a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:42.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.780+0000 7ff4ed400640 1 --2- 172.21.15.42:0/593077108 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff4e80d0090 0x7ff4e814a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:42.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.780+0000 7ff4ed400640 1 -- 172.21.15.42:0/593077108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4e80b6ae0 msgr2=0x7ff4e814ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:42.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.780+0000 7ff4ed400640 1 --2- 172.21.15.42:0/593077108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4e80b6ae0 0x7ff4e814ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:42.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.780+0000 7ff4ed400640 1 -- 172.21.15.42:0/593077108 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e814d200 con 0x7ff4e80d04a0 2024-09-17T01:50:42.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.780+0000 7ff4ed400640 1 --2- 172.21.15.42:0/593077108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e80d04a0 0x7ff4e814a1b0 secure :-1 s=READY pgs=2652 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000d630 tx=0x7ff4e000daf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:42.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.780+0000 7ff4e5600640 1 -- 172.21.15.42:0/593077108 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0017070 con 0x7ff4e80d04a0 2024-09-17T01:50:42.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.780+0000 7ff4e5600640 1 -- 172.21.15.42:0/593077108 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4e0004310 con 0x7ff4e80d04a0 2024-09-17T01:50:42.779 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.780+0000 7ff4e5600640 1 -- 172.21.15.42:0/593077108 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0005280 con 0x7ff4e80d04a0 2024-09-17T01:50:42.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.780+0000 7ff4ede00640 1 -- 172.21.15.42:0/593077108 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4e814d4e0 con 0x7ff4e80d04a0 2024-09-17T01:50:42.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.780+0000 7ff4ede00640 1 -- 172.21.15.42:0/593077108 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4e814b060 con 0x7ff4e80d04a0 2024-09-17T01:50:42.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.781+0000 7ff4ede00640 1 -- 172.21.15.42:0/593077108 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4e814b2c0 con 0x7ff4e80d04a0 2024-09-17T01:50:42.780 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.782+0000 7ff4e5600640 1 -- 172.21.15.42:0/593077108 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff4e0005420 con 0x7ff4e80d04a0 2024-09-17T01:50:42.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.784+0000 7ff4e5600640 1 --2- 172.21.15.42:0/593077108 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff4c4078b90 0x7ff4c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:42.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.784+0000 7ff4e5600640 1 -- 172.21.15.42:0/593077108 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(228..228 src has 1..228) ==== 5881+0+0 (secure 0 0 0) 0x7ff4e009b0d0 con 0x7ff4e80d04a0 2024-09-17T01:50:42.782 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.785+0000 7ff4eca00640 1 --2- 172.21.15.42:0/593077108 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff4c4078b90 0x7ff4c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:42.783 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.785+0000 7ff4eca00640 1 --2- 172.21.15.42:0/593077108 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff4c4078b90 0x7ff4c407b0a0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8035000 tx=0x7ff4d803b040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:42.786 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.789+0000 7ff4e5600640 1 -- 172.21.15.42:0/593077108 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff4e0020020 con 0x7ff4e80d04a0 2024-09-17T01:50:42.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:42.984+0000 7ff4ede00640 1 -- 172.21.15.42:0/593077108 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff4e814cf90 con 0x7ff4e80d04a0 2024-09-17T01:50:43.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:43.797+0000 7ff4e5600640 1 -- 172.21.15.42:0/593077108 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v229) ==== 181+0+0 (secure 0 0 0) 0x7ff4e0062d70 con 0x7ff4e80d04a0 2024-09-17T01:50:43.796 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2024-09-17T01:50:43.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:43.803+0000 7ff4ede00640 1 -- 172.21.15.42:0/593077108 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff4c4078b90 msgr2=0x7ff4c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:43.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:43.803+0000 7ff4ede00640 1 --2- 172.21.15.42:0/593077108 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff4c4078b90 0x7ff4c407b0a0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8035000 tx=0x7ff4d803b040 comp rx=0 tx=0).stop 2024-09-17T01:50:43.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:43.803+0000 7ff4ede00640 1 -- 172.21.15.42:0/593077108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e80d04a0 msgr2=0x7ff4e814a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:43.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:43.803+0000 7ff4ede00640 1 --2- 172.21.15.42:0/593077108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e80d04a0 0x7ff4e814a1b0 secure :-1 s=READY pgs=2652 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000d630 tx=0x7ff4e000daf0 comp rx=0 tx=0).stop 2024-09-17T01:50:43.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:43.803+0000 7ff4ede00640 1 -- 172.21.15.42:0/593077108 shutdown_connections 2024-09-17T01:50:43.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:43.803+0000 7ff4ede00640 1 --2- 172.21.15.42:0/593077108 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff4c4078b90 0x7ff4c407b0a0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:43.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:43.803+0000 7ff4ede00640 1 --2- 172.21.15.42:0/593077108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e80d04a0 0x7ff4e814a1b0 unknown :-1 s=CLOSED pgs=2652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:43.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:43.803+0000 7ff4ede00640 1 --2- 172.21.15.42:0/593077108 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff4e80d0090 0x7ff4e814a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:43.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:43.803+0000 7ff4ede00640 1 --2- 172.21.15.42:0/593077108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff4e80b6ae0 0x7ff4e814ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:43.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:43.803+0000 7ff4ede00640 1 -- 172.21.15.42:0/593077108 >> 172.21.15.42:0/593077108 conn(0x7ff4e80b2ca0 msgr2=0x7ff4e815e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:43.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:43.803+0000 7ff4ede00640 1 -- 172.21.15.42:0/593077108 shutdown_connections 2024-09-17T01:50:43.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:43.804+0000 7ff4ede00640 1 -- 172.21.15.42:0/593077108 wait complete. 2024-09-17T01:50:43.829 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T01:50:44.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.067+0000 7f6774600640 1 -- 172.21.15.42:0/2764069849 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f676c0b3a40 msgr2=0x7f676c0b5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:44.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.067+0000 7f6774600640 1 --2- 172.21.15.42:0/2764069849 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f676c0b3a40 0x7f676c0b5630 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6760005fd0 tx=0x7f676002a540 comp rx=0 tx=0).stop 2024-09-17T01:50:44.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.067+0000 7f6774600640 1 -- 172.21.15.42:0/2764069849 shutdown_connections 2024-09-17T01:50:44.065 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.067+0000 7f6774600640 1 --2- 172.21.15.42:0/2764069849 >> v2:172.21.15.43:3300/0 conn(0x7f676c160fb0 0x7f676c0cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.067+0000 7f6774600640 1 --2- 172.21.15.42:0/2764069849 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f676c0b3a40 0x7f676c0b5630 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.067+0000 7f6774600640 1 -- 172.21.15.42:0/2764069849 >> 172.21.15.42:0/2764069849 conn(0x7f676c06d420 msgr2=0x7f676c0b2430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:44.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.067+0000 7f6774600640 1 -- 172.21.15.42:0/2764069849 shutdown_connections 2024-09-17T01:50:44.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.067+0000 7f6774600640 1 -- 172.21.15.42:0/2764069849 wait complete. 2024-09-17T01:50:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.069+0000 7f6774600640 1 Processor -- start 2024-09-17T01:50:44.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.069+0000 7f6774600640 1 -- start start 2024-09-17T01:50:44.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.071+0000 7f6774600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f676c0b3a40 0x7f676c13d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.071+0000 7f6774600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f676c0cf7d0 0x7f676c1454e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.071+0000 7f6774600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f676c140f10 0x7f676c141940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.071+0000 7f6774600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f676c06fb00 con 0x7f676c0cf7d0 2024-09-17T01:50:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.071+0000 7f6774600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f676c06f980 con 0x7f676c0b3a40 2024-09-17T01:50:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.071+0000 7f6774600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f676c06fc80 con 0x7f676c140f10 2024-09-17T01:50:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.071+0000 7f6771200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f676c0cf7d0 0x7f676c1454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.071+0000 7f6771200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f676c0cf7d0 0x7f676c1454e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55226/0 (socket says 172.21.15.42:55226) 2024-09-17T01:50:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.071+0000 7f6771200640 1 -- 172.21.15.42:0/2769373253 learned_addr learned my addr 172.21.15.42:0/2769373253 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.071+0000 7f6771c00640 1 --2- 172.21.15.42:0/2769373253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f676c0b3a40 0x7f676c13d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.071+0000 7f6772600640 1 --2- 172.21.15.42:0/2769373253 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f676c140f10 0x7f676c141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.072+0000 7f6771200640 1 -- 172.21.15.42:0/2769373253 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f676c140f10 msgr2=0x7f676c141940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.072+0000 7f6771200640 1 --2- 172.21.15.42:0/2769373253 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f676c140f10 0x7f676c141940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.072+0000 7f6771200640 1 -- 172.21.15.42:0/2769373253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f676c0b3a40 msgr2=0x7f676c13d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.072+0000 7f6771200640 1 --2- 172.21.15.42:0/2769373253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f676c0b3a40 0x7f676c13d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.072+0000 7f6771200640 1 -- 172.21.15.42:0/2769373253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f676c13d790 con 0x7f676c0cf7d0 2024-09-17T01:50:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.072+0000 7f6771200640 1 --2- 172.21.15.42:0/2769373253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f676c0cf7d0 0x7f676c1454e0 secure :-1 s=READY pgs=2653 cs=0 l=1 rev1=1 crypto rx=0x7f675800c460 tx=0x7f675800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.072+0000 7f6769600640 1 -- 172.21.15.42:0/2769373253 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6758017070 con 0x7f676c0cf7d0 2024-09-17T01:50:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.072+0000 7f6769600640 1 -- 172.21.15.42:0/2769373253 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67580053e0 con 0x7f676c0cf7d0 2024-09-17T01:50:44.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.072+0000 7f6769600640 1 -- 172.21.15.42:0/2769373253 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6758003850 con 0x7f676c0cf7d0 2024-09-17T01:50:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.072+0000 7f6774600640 1 -- 172.21.15.42:0/2769373253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f676c145a20 con 0x7f676c0cf7d0 2024-09-17T01:50:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.072+0000 7f6774600640 1 -- 172.21.15.42:0/2769373253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f676c145cf0 con 0x7f676c0cf7d0 2024-09-17T01:50:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.073+0000 7f6774600640 1 -- 172.21.15.42:0/2769373253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f676c070130 con 0x7f676c0cf7d0 2024-09-17T01:50:44.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.075+0000 7f6769600640 1 -- 172.21.15.42:0/2769373253 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f675801a070 con 0x7f676c0cf7d0 2024-09-17T01:50:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.075+0000 7f6769600640 1 --2- 172.21.15.42:0/2769373253 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f674c078b90 0x7f674c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:44.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.076+0000 7f6769600640 1 -- 172.21.15.42:0/2769373253 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(229..229 src has 1..229) ==== 5443+0+0 (secure 0 0 0) 0x7f6758099f40 con 0x7f676c0cf7d0 2024-09-17T01:50:44.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.076+0000 7f6771c00640 1 --2- 172.21.15.42:0/2769373253 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f674c078b90 0x7f674c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:44.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.077+0000 7f6771c00640 1 --2- 172.21.15.42:0/2769373253 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f674c078b90 0x7f674c07b0a0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f6760033000 tx=0x7f6760004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:44.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.080+0000 7f6769600640 1 -- 172.21.15.42:0/2769373253 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f676c13d790 con 0x7f676c0cf7d0 2024-09-17T01:50:44.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.273+0000 7f6774600640 1 -- 172.21.15.42:0/2769373253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f676c0afec0 con 0x7f676c0cf7d0 2024-09-17T01:50:44.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.805+0000 7f6769600640 1 -- 172.21.15.42:0/2769373253 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v230) ==== 169+0+0 (secure 0 0 0) 0x7f6758061e20 con 0x7f676c0cf7d0 2024-09-17T01:50:44.803 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2024-09-17T01:50:44.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.809+0000 7f6774600640 1 -- 172.21.15.42:0/2769373253 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f674c078b90 msgr2=0x7f674c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:44.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.809+0000 7f6774600640 1 --2- 172.21.15.42:0/2769373253 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f674c078b90 0x7f674c07b0a0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f6760033000 tx=0x7f6760004730 comp rx=0 tx=0).stop 2024-09-17T01:50:44.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.809+0000 7f6774600640 1 -- 172.21.15.42:0/2769373253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f676c0cf7d0 msgr2=0x7f676c1454e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:44.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.809+0000 7f6774600640 1 --2- 172.21.15.42:0/2769373253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f676c0cf7d0 0x7f676c1454e0 secure :-1 s=READY pgs=2653 cs=0 l=1 rev1=1 crypto rx=0x7f675800c460 tx=0x7f675800c860 comp rx=0 tx=0).stop 2024-09-17T01:50:44.808 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.809+0000 7f6774600640 1 -- 172.21.15.42:0/2769373253 shutdown_connections 2024-09-17T01:50:44.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.809+0000 7f6774600640 1 --2- 172.21.15.42:0/2769373253 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f674c078b90 0x7f674c07b0a0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.809+0000 7f6774600640 1 --2- 172.21.15.42:0/2769373253 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f676c140f10 0x7f676c141940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.809+0000 7f6774600640 1 --2- 172.21.15.42:0/2769373253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f676c0cf7d0 0x7f676c1454e0 unknown :-1 s=CLOSED pgs=2653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.809+0000 7f6774600640 1 --2- 172.21.15.42:0/2769373253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f676c0b3a40 0x7f676c13d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.809+0000 7f6774600640 1 -- 172.21.15.42:0/2769373253 >> 172.21.15.42:0/2769373253 conn(0x7f676c06d420 msgr2=0x7f676c160ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:44.809 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.810+0000 7f6774600640 1 -- 172.21.15.42:0/2769373253 shutdown_connections 2024-09-17T01:50:44.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:44.810+0000 7f6774600640 1 -- 172.21.15.42:0/2769373253 wait complete. 2024-09-17T01:50:44.837 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T01:50:45.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.071+0000 7fac34e00640 1 -- 172.21.15.42:0/4160886224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac3015dcf0 msgr2=0x7fac30072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:45.069 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.071+0000 7fac34e00640 1 --2- 172.21.15.42:0/4160886224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac3015dcf0 0x7fac30072b60 secure :-1 s=READY pgs=2654 cs=0 l=1 rev1=1 crypto rx=0x7fac20005fd0 tx=0x7fac2002a5d0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.071+0000 7fac34e00640 1 -- 172.21.15.42:0/4160886224 shutdown_connections 2024-09-17T01:50:45.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.071+0000 7fac34e00640 1 --2- 172.21.15.42:0/4160886224 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fac30160790 0x7fac30160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.071+0000 7fac34e00640 1 --2- 172.21.15.42:0/4160886224 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac3015dcf0 0x7fac30072b60 unknown :-1 s=CLOSED pgs=2654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.071+0000 7fac34e00640 1 -- 172.21.15.42:0/4160886224 >> 172.21.15.42:0/4160886224 conn(0x7fac3006d1b0 msgr2=0x7fac3006d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:45.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.071+0000 7fac34e00640 1 -- 172.21.15.42:0/4160886224 shutdown_connections 2024-09-17T01:50:45.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.071+0000 7fac34e00640 1 -- 172.21.15.42:0/4160886224 wait complete. 2024-09-17T01:50:45.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.073+0000 7fac34e00640 1 Processor -- start 2024-09-17T01:50:45.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.074+0000 7fac34e00640 1 -- start start 2024-09-17T01:50:45.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.075+0000 7fac34e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac300cd620 0x7fac301f9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:45.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.075+0000 7fac34e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac3015dcf0 0x7fac3015ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:45.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.075+0000 7fac34e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fac30160790 0x7fac301f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:45.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.075+0000 7fac34e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fac3006ee00 con 0x7fac300cd620 2024-09-17T01:50:45.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.075+0000 7fac34e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fac3006ec80 con 0x7fac3015dcf0 2024-09-17T01:50:45.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.075+0000 7fac34e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fac3006ef80 con 0x7fac30160790 2024-09-17T01:50:45.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.075+0000 7fac2de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac300cd620 0x7fac301f9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:45.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.075+0000 7fac2de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac300cd620 0x7fac301f9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55236/0 (socket says 172.21.15.42:55236) 2024-09-17T01:50:45.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.075+0000 7fac2de00640 1 -- 172.21.15.42:0/1889729591 learned_addr learned my addr 172.21.15.42:0/1889729591 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:45.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.075+0000 7fac27e00640 1 --2- 172.21.15.42:0/1889729591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac3015dcf0 0x7fac3015ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:45.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.075+0000 7fac2e800640 1 --2- 172.21.15.42:0/1889729591 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fac30160790 0x7fac301f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:45.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.076+0000 7fac2de00640 1 -- 172.21.15.42:0/1889729591 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fac30160790 msgr2=0x7fac301f5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:45.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.076+0000 7fac2de00640 1 --2- 172.21.15.42:0/1889729591 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fac30160790 0x7fac301f5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.076+0000 7fac2de00640 1 -- 172.21.15.42:0/1889729591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac3015dcf0 msgr2=0x7fac3015ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:45.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.076+0000 7fac2de00640 1 --2- 172.21.15.42:0/1889729591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac3015dcf0 0x7fac3015ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.076+0000 7fac2de00640 1 -- 172.21.15.42:0/1889729591 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac30146360 con 0x7fac300cd620 2024-09-17T01:50:45.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.076+0000 7fac2e800640 1 --2- 172.21.15.42:0/1889729591 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fac30160790 0x7fac301f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:45.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.076+0000 7fac2de00640 1 --2- 172.21.15.42:0/1889729591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac300cd620 0x7fac301f9e30 secure :-1 s=READY pgs=2655 cs=0 l=1 rev1=1 crypto rx=0x7fac20034040 tx=0x7fac200038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:45.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.076+0000 7fac26000640 1 -- 172.21.15.42:0/1889729591 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2003e030 con 0x7fac300cd620 2024-09-17T01:50:45.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.076+0000 7fac26000640 1 -- 172.21.15.42:0/1889729591 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac20003ca0 con 0x7fac300cd620 2024-09-17T01:50:45.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.076+0000 7fac34e00640 1 -- 172.21.15.42:0/1889729591 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac301f6c30 con 0x7fac300cd620 2024-09-17T01:50:45.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.076+0000 7fac26000640 1 -- 172.21.15.42:0/1889729591 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac20035040 con 0x7fac300cd620 2024-09-17T01:50:45.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.077+0000 7fac34e00640 1 -- 172.21.15.42:0/1889729591 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac301f9350 con 0x7fac300cd620 2024-09-17T01:50:45.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.078+0000 7fac34e00640 1 -- 172.21.15.42:0/1889729591 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac3006f4a0 con 0x7fac300cd620 2024-09-17T01:50:45.077 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.079+0000 7fac26000640 1 -- 172.21.15.42:0/1889729591 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fac20041030 con 0x7fac300cd620 2024-09-17T01:50:45.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.080+0000 7fac26000640 1 --2- 172.21.15.42:0/1889729591 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fac0c078b90 0x7fac0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:45.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.080+0000 7fac26000640 1 -- 172.21.15.42:0/1889729591 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7fac200baf50 con 0x7fac300cd620 2024-09-17T01:50:45.078 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.080+0000 7fac27e00640 1 --2- 172.21.15.42:0/1889729591 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fac0c078b90 0x7fac0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:45.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.081+0000 7fac27e00640 1 --2- 172.21.15.42:0/1889729591 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fac0c078b90 0x7fac0c07b0a0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fac301f9280 tx=0x7fac1800b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:45.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.085+0000 7fac26000640 1 -- 172.21.15.42:0/1889729591 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fac30146360 con 0x7fac300cd620 2024-09-17T01:50:45.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.279+0000 7fac34e00640 1 -- 172.21.15.42:0/1889729591 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fac30154050 con 0x7fac300cd620 2024-09-17T01:50:45.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.283+0000 7fac26000640 1 -- 172.21.15.42:0/1889729591 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v70) ==== 71+0+0 (secure 0 0 0) 0x7fac20082f40 con 0x7fac300cd620 2024-09-17T01:50:45.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.286+0000 7fac34e00640 1 -- 172.21.15.42:0/1889729591 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fac0c078b90 msgr2=0x7fac0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:45.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.286+0000 7fac34e00640 1 --2- 172.21.15.42:0/1889729591 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fac0c078b90 0x7fac0c07b0a0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fac301f9280 tx=0x7fac1800b2e0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.286+0000 7fac34e00640 1 -- 172.21.15.42:0/1889729591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac300cd620 msgr2=0x7fac301f9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:45.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.286+0000 7fac34e00640 1 --2- 172.21.15.42:0/1889729591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac300cd620 0x7fac301f9e30 secure :-1 s=READY pgs=2655 cs=0 l=1 rev1=1 crypto rx=0x7fac20034040 tx=0x7fac200038a0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.286+0000 7fac34e00640 1 -- 172.21.15.42:0/1889729591 shutdown_connections 2024-09-17T01:50:45.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.286+0000 7fac34e00640 1 --2- 172.21.15.42:0/1889729591 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fac0c078b90 0x7fac0c07b0a0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.286+0000 7fac34e00640 1 --2- 172.21.15.42:0/1889729591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac3015dcf0 0x7fac3015ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.286+0000 7fac34e00640 1 --2- 172.21.15.42:0/1889729591 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fac30160790 0x7fac301f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.286+0000 7fac34e00640 1 --2- 172.21.15.42:0/1889729591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fac300cd620 0x7fac301f9e30 unknown :-1 s=CLOSED pgs=2655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.286+0000 7fac34e00640 1 -- 172.21.15.42:0/1889729591 >> 172.21.15.42:0/1889729591 conn(0x7fac3006d1b0 msgr2=0x7fac3015f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:45.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.286+0000 7fac34e00640 1 -- 172.21.15.42:0/1889729591 shutdown_connections 2024-09-17T01:50:45.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.286+0000 7fac34e00640 1 -- 172.21.15.42:0/1889729591 wait complete. 2024-09-17T01:50:45.307 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode' 2024-09-17T01:50:45.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.540+0000 7f44e3e00640 1 -- 172.21.15.42:0/565323841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44e40d08d0 msgr2=0x7f44e41672c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:45.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.540+0000 7f44e3e00640 1 --2- 172.21.15.42:0/565323841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44e40d08d0 0x7f44e41672c0 secure :-1 s=READY pgs=2656 cs=0 l=1 rev1=1 crypto rx=0x7f44dc009ca0 tx=0x7f44dc02aa30 comp rx=0 tx=0).stop 2024-09-17T01:50:45.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.540+0000 7f44e3e00640 1 -- 172.21.15.42:0/565323841 shutdown_connections 2024-09-17T01:50:45.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.540+0000 7f44e3e00640 1 --2- 172.21.15.42:0/565323841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44e40d08d0 0x7f44e41672c0 unknown :-1 s=CLOSED pgs=2656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.540+0000 7f44e3e00640 1 --2- 172.21.15.42:0/565323841 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44e40cdcf0 0x7f44e40cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.540+0000 7f44e3e00640 1 -- 172.21.15.42:0/565323841 >> 172.21.15.42:0/565323841 conn(0x7f44e40b4180 msgr2=0x7f44e40b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:45.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.541+0000 7f44e3e00640 1 -- 172.21.15.42:0/565323841 shutdown_connections 2024-09-17T01:50:45.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.541+0000 7f44e3e00640 1 -- 172.21.15.42:0/565323841 wait complete. 2024-09-17T01:50:45.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.543+0000 7f44e3e00640 1 Processor -- start 2024-09-17T01:50:45.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.543+0000 7f44e3e00640 1 -- start start 2024-09-17T01:50:45.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.544+0000 7f44e3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44e40cdcf0 0x7f44e41f3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:45.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.544+0000 7f44e3e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44e40cf4c0 0x7f44e409efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:45.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.544+0000 7f44e3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44e40d08d0 0x7f44e41e8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:45.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.544+0000 7f44e3e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f44e40b2e30 con 0x7f44e40d08d0 2024-09-17T01:50:45.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.544+0000 7f44e3e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f44e40b80c0 con 0x7f44e40cdcf0 2024-09-17T01:50:45.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.544+0000 7f44e3e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f44e40b2fb0 con 0x7f44e40cf4c0 2024-09-17T01:50:45.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.545+0000 7f44e3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44e40d08d0 0x7f44e41e8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:45.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.545+0000 7f44e3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44e40d08d0 0x7f44e41e8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55252/0 (socket says 172.21.15.42:55252) 2024-09-17T01:50:45.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.545+0000 7f44e3400640 1 -- 172.21.15.42:0/3102822305 learned_addr learned my addr 172.21.15.42:0/3102822305 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:45.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.545+0000 7f44e2a00640 1 --2- 172.21.15.42:0/3102822305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44e40cdcf0 0x7f44e41f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:45.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.545+0000 7f44e2000640 1 --2- 172.21.15.42:0/3102822305 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44e40cf4c0 0x7f44e409efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:45.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.545+0000 7f44e3400640 1 -- 172.21.15.42:0/3102822305 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44e40cf4c0 msgr2=0x7f44e409efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:45.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.545+0000 7f44e3400640 1 --2- 172.21.15.42:0/3102822305 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44e40cf4c0 0x7f44e409efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.545+0000 7f44e3400640 1 -- 172.21.15.42:0/3102822305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44e40cdcf0 msgr2=0x7f44e41f3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:45.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.545+0000 7f44e3400640 1 --2- 172.21.15.42:0/3102822305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44e40cdcf0 0x7f44e41f3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.545+0000 7f44e3400640 1 -- 172.21.15.42:0/3102822305 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e409f890 con 0x7f44e40d08d0 2024-09-17T01:50:45.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.545+0000 7f44e2000640 1 --2- 172.21.15.42:0/3102822305 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44e40cf4c0 0x7f44e409efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:45.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.546+0000 7f44e3400640 1 --2- 172.21.15.42:0/3102822305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44e40d08d0 0x7f44e41e8fa0 secure :-1 s=READY pgs=2657 cs=0 l=1 rev1=1 crypto rx=0x7f44dc006010 tx=0x7f44dc003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:45.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.546+0000 7f44daa00640 1 -- 172.21.15.42:0/3102822305 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44dc046070 con 0x7f44e40d08d0 2024-09-17T01:50:45.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.546+0000 7f44daa00640 1 -- 172.21.15.42:0/3102822305 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44dc004540 con 0x7f44e40d08d0 2024-09-17T01:50:45.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.546+0000 7f44daa00640 1 -- 172.21.15.42:0/3102822305 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44dc033070 con 0x7f44e40d08d0 2024-09-17T01:50:45.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.546+0000 7f44e3e00640 1 -- 172.21.15.42:0/3102822305 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e409fb70 con 0x7f44e40d08d0 2024-09-17T01:50:45.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.546+0000 7f44e3e00640 1 -- 172.21.15.42:0/3102822305 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e40a0130 con 0x7f44e40d08d0 2024-09-17T01:50:45.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.547+0000 7f44e3e00640 1 -- 172.21.15.42:0/3102822305 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44e40a0510 con 0x7f44e40d08d0 2024-09-17T01:50:45.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.548+0000 7f44daa00640 1 -- 172.21.15.42:0/3102822305 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f44dc036070 con 0x7f44e40d08d0 2024-09-17T01:50:45.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.550+0000 7f44daa00640 1 --2- 172.21.15.42:0/3102822305 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f44c4078b90 0x7f44c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:45.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.550+0000 7f44daa00640 1 -- 172.21.15.42:0/3102822305 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7f44dc0bb750 con 0x7f44e40d08d0 2024-09-17T01:50:45.548 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.550+0000 7f44e2a00640 1 --2- 172.21.15.42:0/3102822305 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f44c4078b90 0x7f44c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:45.549 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.551+0000 7f44e2a00640 1 --2- 172.21.15.42:0/3102822305 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f44c4078b90 0x7f44c407b0a0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f44d400bb50 tx=0x7f44d400b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:45.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.555+0000 7f44daa00640 1 -- 172.21.15.42:0/3102822305 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f44e40a0510 con 0x7f44e40d08d0 2024-09-17T01:50:45.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:45.821+0000 7f44e3e00640 1 -- 172.21.15.42:0/3102822305 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]} v 0) -- 0x7f44e40ce350 con 0x7f44e40d08d0 2024-09-17T01:50:46.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:46.808+0000 7f44daa00640 1 -- 172.21.15.42:0/3102822305 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]}]=0 v872) ==== 133+0+0 (secure 0 0 0) 0x7f44dc03e070 con 0x7f44e40d08d0 2024-09-17T01:50:46.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:46.811+0000 7f44e3e00640 1 -- 172.21.15.42:0/3102822305 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f44c4078b90 msgr2=0x7f44c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:46.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:46.811+0000 7f44e3e00640 1 --2- 172.21.15.42:0/3102822305 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f44c4078b90 0x7f44c407b0a0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f44d400bb50 tx=0x7f44d400b2e0 comp rx=0 tx=0).stop 2024-09-17T01:50:46.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:46.811+0000 7f44e3e00640 1 -- 172.21.15.42:0/3102822305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44e40d08d0 msgr2=0x7f44e41e8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:46.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:46.811+0000 7f44e3e00640 1 --2- 172.21.15.42:0/3102822305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44e40d08d0 0x7f44e41e8fa0 secure :-1 s=READY pgs=2657 cs=0 l=1 rev1=1 crypto rx=0x7f44dc006010 tx=0x7f44dc003f10 comp rx=0 tx=0).stop 2024-09-17T01:50:46.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:46.811+0000 7f44e3e00640 1 -- 172.21.15.42:0/3102822305 shutdown_connections 2024-09-17T01:50:46.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:46.811+0000 7f44e3e00640 1 --2- 172.21.15.42:0/3102822305 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f44c4078b90 0x7f44c407b0a0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:46.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:46.811+0000 7f44e3e00640 1 --2- 172.21.15.42:0/3102822305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f44e40d08d0 0x7f44e41e8fa0 unknown :-1 s=CLOSED pgs=2657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:46.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:46.811+0000 7f44e3e00640 1 --2- 172.21.15.42:0/3102822305 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f44e40cf4c0 0x7f44e409efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:46.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:46.811+0000 7f44e3e00640 1 --2- 172.21.15.42:0/3102822305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44e40cdcf0 0x7f44e41f3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:46.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:46.811+0000 7f44e3e00640 1 -- 172.21.15.42:0/3102822305 >> 172.21.15.42:0/3102822305 conn(0x7f44e40b4180 msgr2=0x7f44e41e4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:46.810 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:46.812+0000 7f44e3e00640 1 -- 172.21.15.42:0/3102822305 shutdown_connections 2024-09-17T01:50:46.811 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:46.812+0000 7f44e3e00640 1 -- 172.21.15.42:0/3102822305 wait complete. 2024-09-17T01:50:46.842 INFO:tasks.cephfs_test_runner:test_scrub_dup_inode (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-09-17T01:50:46.842 INFO:tasks.cephfs_test_runner: 2024-09-17T01:50:46.842 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-17T01:50:46.842 INFO:tasks.cephfs_test_runner:Ran 15 tests in 1093.603s 2024-09-17T01:50:46.842 INFO:tasks.cephfs_test_runner: 2024-09-17T01:50:46.842 INFO:tasks.cephfs_test_runner:OK 2024-09-17T01:50:46.843 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-17T01:50:46.851 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-17T01:50:46.863 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-17T01:50:46.864 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:50:46.864 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:50:46.901 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:50:46.901 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T01:50:46.901 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:50:46.978 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T01:50:46.978 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:50:46.978 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:50:47.018 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:50:47.018 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-17T01:50:47.018 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:50:47.096 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T01:50:47.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:50:47.097 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-17T01:50:47.136 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T01:50:47.136 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T01:50:47.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:50:47.136 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:50:47.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:50:47.235 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T01:50:47.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:50:47.491 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-09-17T01:50:47.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:50:47.791 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-09-17T01:50:47.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:50:47.828 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-09-17T01:50:47.929 INFO:teuthology.orchestra.run.smithi042.stderr:Cannot find device "ceph-brx" 2024-09-17T01:50:47.931 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:50:47.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:50:47.932 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-09-17T01:50:47.972 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T01:50:47.972 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T01:50:47.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:50:47.973 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T01:50:48.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:50:48.075 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T01:50:48.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:50:48.331 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2024-09-17T01:50:48.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:50:48.642 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2024-09-17T01:50:48.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:50:48.679 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2024-09-17T01:50:48.778 INFO:teuthology.orchestra.run.smithi043.stderr:Cannot find device "ceph-brx" 2024-09-17T01:50:48.781 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:50:48.782 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-17T01:50:48.791 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T01:50:48.791 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:50:49.029 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.031+0000 7f0b0d200640 1 -- 172.21.15.42:0/1761109301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b080ae890 msgr2=0x7f0b080aeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:49.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.031+0000 7f0b0d200640 1 --2- 172.21.15.42:0/1761109301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b080ae890 0x7f0b080aeca0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009830 tx=0x7f0af402a470 comp rx=0 tx=0).stop 2024-09-17T01:50:49.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.031+0000 7f0b0d200640 1 -- 172.21.15.42:0/1761109301 shutdown_connections 2024-09-17T01:50:49.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.031+0000 7f0b0d200640 1 --2- 172.21.15.42:0/1761109301 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b08072af0 0x7f0b08072f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.031+0000 7f0b0d200640 1 --2- 172.21.15.42:0/1761109301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b080ae890 0x7f0b080aeca0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.031+0000 7f0b0d200640 1 -- 172.21.15.42:0/1761109301 >> 172.21.15.42:0/1761109301 conn(0x7f0b0806d3f0 msgr2=0x7f0b080b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:49.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.031+0000 7f0b0d200640 1 -- 172.21.15.42:0/1761109301 shutdown_connections 2024-09-17T01:50:49.030 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.031+0000 7f0b0d200640 1 -- 172.21.15.42:0/1761109301 wait complete. 2024-09-17T01:50:49.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.033+0000 7f0b0d200640 1 Processor -- start 2024-09-17T01:50:49.031 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.034+0000 7f0b0d200640 1 -- start start 2024-09-17T01:50:49.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.035+0000 7f0b0d200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b08072af0 0x7f0b08151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:49.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.035+0000 7f0b0d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b080ae890 0x7f0b0814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:49.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.035+0000 7f0b0d200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b08155b60 0x7f0b08162a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:49.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.035+0000 7f0b0d200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0b080735c0 con 0x7f0b08155b60 2024-09-17T01:50:49.034 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.035+0000 7f0b0d200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0b08073440 con 0x7f0b080ae890 2024-09-17T01:50:49.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.035+0000 7f0b0d200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0b08073740 con 0x7f0b08072af0 2024-09-17T01:50:49.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.035+0000 7f0b06a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b080ae890 0x7f0b0814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:49.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.035+0000 7f0b07400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b08072af0 0x7f0b08151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:49.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.035+0000 7f0b06a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b080ae890 0x7f0b0814ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.42:49834/0 (socket says 172.21.15.42:49834) 2024-09-17T01:50:49.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.036+0000 7f0b06a00640 1 -- 172.21.15.42:0/529830465 learned_addr learned my addr 172.21.15.42:0/529830465 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:49.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.036+0000 7f0b07e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b08155b60 0x7f0b08162a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:49.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.036+0000 7f0b07400640 1 -- 172.21.15.42:0/529830465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b080ae890 msgr2=0x7f0b0814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:49.035 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.036+0000 7f0b07400640 1 --2- 172.21.15.42:0/529830465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b080ae890 0x7f0b0814ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.036+0000 7f0b07400640 1 -- 172.21.15.42:0/529830465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b08155b60 msgr2=0x7f0b08162a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:49.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.036+0000 7f0b07400640 1 --2- 172.21.15.42:0/529830465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b08155b60 0x7f0b08162a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.036+0000 7f0b07400640 1 -- 172.21.15.42:0/529830465 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b081f56e0 con 0x7f0b08072af0 2024-09-17T01:50:49.036 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.036+0000 7f0b07400640 1 --2- 172.21.15.42:0/529830465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b08072af0 0x7f0b08151f90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0af800c3c0 tx=0x7f0af800c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:49.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.036+0000 7f0aff400640 1 -- 172.21.15.42:0/529830465 <== mon.2 v2:172.21.15.43:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af8011790 con 0x7f0b08072af0 2024-09-17T01:50:49.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.037+0000 7f0aff400640 1 -- 172.21.15.42:0/529830465 <== mon.2 v2:172.21.15.43:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0af8017070 con 0x7f0b08072af0 2024-09-17T01:50:49.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.037+0000 7f0aff400640 1 -- 172.21.15.42:0/529830465 <== mon.2 v2:172.21.15.43:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af8011ce0 con 0x7f0b08072af0 2024-09-17T01:50:49.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.037+0000 7f0b0d200640 1 -- 172.21.15.42:0/529830465 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b081f9160 con 0x7f0b08072af0 2024-09-17T01:50:49.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.037+0000 7f0b0d200640 1 -- 172.21.15.42:0/529830465 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b081f9720 con 0x7f0b08072af0 2024-09-17T01:50:49.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.038+0000 7f0b0d200640 1 -- 172.21.15.42:0/529830465 --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b08072f00 con 0x7f0b08072af0 2024-09-17T01:50:49.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.039+0000 7f0aff400640 1 -- 172.21.15.42:0/529830465 <== mon.2 v2:172.21.15.43:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0af801c460 con 0x7f0b08072af0 2024-09-17T01:50:49.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.040+0000 7f0aff400640 1 --2- 172.21.15.42:0/529830465 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0ae8078bc0 0x7f0ae807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:49.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.040+0000 7f0aff400640 1 -- 172.21.15.42:0/529830465 <== mon.2 v2:172.21.15.43:3301/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7f0af809a610 con 0x7f0b08072af0 2024-09-17T01:50:49.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.040+0000 7f0b06a00640 1 --2- 172.21.15.42:0/529830465 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0ae8078bc0 0x7f0ae807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:49.038 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.041+0000 7f0b06a00640 1 --2- 172.21.15.42:0/529830465 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0ae8078bc0 0x7f0ae807b0d0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f0b080b3740 tx=0x7f0af4004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:49.042 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.045+0000 7f0aff400640 1 -- 172.21.15.42:0/529830465 <== mon.2 v2:172.21.15.43:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0af8062cf0 con 0x7f0b08072af0 2024-09-17T01:50:49.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.235+0000 7f0b0d200640 1 -- 172.21.15.42:0/529830465 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0b080af650 con 0x7f0ae8078bc0 2024-09-17T01:50:49.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.236+0000 7f0aff400640 1 -- 172.21.15.42:0/529830465 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13485 (secure 0 0 0) 0x7f0b080af650 con 0x7f0ae8078bc0 2024-09-17T01:50:49.234 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:50:49.235 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:50:49.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.239+0000 7f0b0d200640 1 -- 172.21.15.42:0/529830465 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0ae8078bc0 msgr2=0x7f0ae807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:49.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.239+0000 7f0b0d200640 1 --2- 172.21.15.42:0/529830465 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0ae8078bc0 0x7f0ae807b0d0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f0b080b3740 tx=0x7f0af4004730 comp rx=0 tx=0).stop 2024-09-17T01:50:49.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.239+0000 7f0b0d200640 1 -- 172.21.15.42:0/529830465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b08072af0 msgr2=0x7f0b08151f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:49.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.239+0000 7f0b0d200640 1 --2- 172.21.15.42:0/529830465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b08072af0 0x7f0b08151f90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0af800c3c0 tx=0x7f0af800c7c0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.239+0000 7f0b0d200640 1 -- 172.21.15.42:0/529830465 shutdown_connections 2024-09-17T01:50:49.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.239+0000 7f0b0d200640 1 --2- 172.21.15.42:0/529830465 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0ae8078bc0 0x7f0ae807b0d0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.239+0000 7f0b0d200640 1 --2- 172.21.15.42:0/529830465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b080ae890 0x7f0b0814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.239+0000 7f0b0d200640 1 --2- 172.21.15.42:0/529830465 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b08155b60 0x7f0b08162a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.237 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.239+0000 7f0b0d200640 1 --2- 172.21.15.42:0/529830465 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b08072af0 0x7f0b08151f90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.239+0000 7f0b0d200640 1 -- 172.21.15.42:0/529830465 >> 172.21.15.42:0/529830465 conn(0x7f0b0806d3f0 msgr2=0x7f0b0815e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:49.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.239+0000 7f0b0d200640 1 -- 172.21.15.42:0/529830465 shutdown_connections 2024-09-17T01:50:49.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.239+0000 7f0b0d200640 1 -- 172.21.15.42:0/529830465 wait complete. 2024-09-17T01:50:49.259 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":790,"stamp":"2024-09-17T01:50:47.306902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":470620,"kb_used_data":46264,"kb_used_omap":12,"kb_used_meta":424179,"kb_avail":754504100,"statfs":{"total":773094113280,"available":772612198400,"internally_reserved":0,"allocated":47374336,"data_stored":34505152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":434359860},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12624445,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-99,"num_read_kb":-105,"num_write":-95,"num_write_kb":-12360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002027"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":510,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-17T01:50:43.801031+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:50:43.801031+0000","last_peered":"2024-09-17T01:50:43.801031+0000","last_clean":"2024-09-17T01:50:43.801031+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:50:43.801031+0000","last_undegraded":"2024-09-17T01:50:43.801031+0000","last_fullsized":"2024-09-17T01:50:43.801031+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476966,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52080,"kb_used_data":2840,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319760,"statfs":{"total":96636764160,"available":96583434240,"internally_reserved":0,"allocated":2908160,"data_stored":1289102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509669,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66520,"kb_used_data":8964,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94305320,"statfs":{"total":96636764160,"available":96568647680,"internally_reserved":0,"allocated":9179136,"data_stored":7569520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509668,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51996,"kb_used_data":6920,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319844,"statfs":{"total":96636764160,"available":96583520256,"internally_reserved":0,"allocated":7086080,"data_stored":5477755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509669,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52060,"kb_used_data":2824,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319780,"statfs":{"total":96636764160,"available":96583454720,"internally_reserved":0,"allocated":2891776,"data_stored":1283451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509669,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74128,"kb_used_data":6908,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94297712,"statfs":{"total":96636764160,"available":96560857088,"internally_reserved":0,"allocated":7073792,"data_stored":5471716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509668,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52640,"kb_used_data":3404,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319200,"statfs":{"total":96636764160,"available":96582860800,"internally_reserved":0,"allocated":3485696,"data_stored":1873819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509670,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66524,"kb_used_data":8968,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94305316,"statfs":{"total":96636764160,"available":96568643584,"internally_reserved":0,"allocated":9183232,"data_stored":7574907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":58915273},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542374,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54672,"kb_used_data":5436,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94317168,"statfs":{"total":96636764160,"available":96580780032,"internally_reserved":0,"allocated":5566464,"data_stored":3964882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:50:49.260 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:50:49.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.490+0000 7f32be800640 1 -- 172.21.15.42:0/2193894921 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f32b815dcf0 msgr2=0x7f32b8072b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:49.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.490+0000 7f32be800640 1 --2- 172.21.15.42:0/2193894921 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f32b815dcf0 0x7f32b8072b60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f32a8009860 tx=0x7f32a802a5a0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.490+0000 7f32be800640 1 -- 172.21.15.42:0/2193894921 shutdown_connections 2024-09-17T01:50:49.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.490+0000 7f32be800640 1 --2- 172.21.15.42:0/2193894921 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f32b815dcf0 0x7f32b8072b60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.490+0000 7f32be800640 1 -- 172.21.15.42:0/2193894921 >> 172.21.15.42:0/2193894921 conn(0x7f32b806d1b0 msgr2=0x7f32b806d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:49.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.490+0000 7f32be800640 1 -- 172.21.15.42:0/2193894921 shutdown_connections 2024-09-17T01:50:49.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.490+0000 7f32be800640 1 -- 172.21.15.42:0/2193894921 wait complete. 2024-09-17T01:50:49.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.492+0000 7f32be800640 1 Processor -- start 2024-09-17T01:50:49.490 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.492+0000 7f32be800640 1 -- start start 2024-09-17T01:50:49.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.494+0000 7f32be800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32b815dcf0 0x7f32b81367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:49.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.494+0000 7f32be800640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f32b8160790 0x7f32b8138f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:49.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.494+0000 7f32be800640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32b8144fa0 0x7f32b8139480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:49.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.494+0000 7f32be800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f32b806f0d0 con 0x7f32b815dcf0 2024-09-17T01:50:49.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.494+0000 7f32be800640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f32b81610b0 con 0x7f32b8144fa0 2024-09-17T01:50:49.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.494+0000 7f32be800640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f32b806f250 con 0x7f32b8160790 2024-09-17T01:50:49.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.494+0000 7f32b7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32b815dcf0 0x7f32b81367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:49.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.494+0000 7f32b7400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32b815dcf0 0x7f32b81367c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59134/0 (socket says 172.21.15.42:59134) 2024-09-17T01:50:49.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.494+0000 7f32b7400640 1 -- 172.21.15.42:0/714238943 learned_addr learned my addr 172.21.15.42:0/714238943 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:49.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.495+0000 7f32b7e00640 1 --2- 172.21.15.42:0/714238943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32b8144fa0 0x7f32b8139480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:49.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.495+0000 7f32afe00640 1 --2- 172.21.15.42:0/714238943 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f32b8160790 0x7f32b8138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:49.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.495+0000 7f32b7400640 1 -- 172.21.15.42:0/714238943 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f32b8160790 msgr2=0x7f32b8138f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:49.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.495+0000 7f32b7400640 1 --2- 172.21.15.42:0/714238943 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f32b8160790 0x7f32b8138f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.495+0000 7f32b7400640 1 -- 172.21.15.42:0/714238943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32b8144fa0 msgr2=0x7f32b8139480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:49.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.495+0000 7f32b7400640 1 --2- 172.21.15.42:0/714238943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32b8144fa0 0x7f32b8139480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.495+0000 7f32b7400640 1 -- 172.21.15.42:0/714238943 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b80af090 con 0x7f32b815dcf0 2024-09-17T01:50:49.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.495+0000 7f32afe00640 1 --2- 172.21.15.42:0/714238943 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f32b8160790 0x7f32b8138f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:50:49.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.495+0000 7f32b7400640 1 --2- 172.21.15.42:0/714238943 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32b815dcf0 0x7f32b81367c0 secure :-1 s=READY pgs=2659 cs=0 l=1 rev1=1 crypto rx=0x7f32a8009980 tx=0x7f32a8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:49.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.495+0000 7f32af400640 1 -- 172.21.15.42:0/714238943 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a8005c90 con 0x7f32b815dcf0 2024-09-17T01:50:49.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.495+0000 7f32af400640 1 -- 172.21.15.42:0/714238943 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32a8031e50 con 0x7f32b815dcf0 2024-09-17T01:50:49.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.495+0000 7f32af400640 1 -- 172.21.15.42:0/714238943 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a8005260 con 0x7f32b815dcf0 2024-09-17T01:50:49.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.495+0000 7f32be800640 1 -- 172.21.15.42:0/714238943 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b8139b50 con 0x7f32b815dcf0 2024-09-17T01:50:49.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.496+0000 7f32be800640 1 -- 172.21.15.42:0/714238943 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b8139e30 con 0x7f32b815dcf0 2024-09-17T01:50:49.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.497+0000 7f32be800640 1 -- 172.21.15.42:0/714238943 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32b8072b60 con 0x7f32b815dcf0 2024-09-17T01:50:49.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.498+0000 7f32af400640 1 -- 172.21.15.42:0/714238943 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f32a8005400 con 0x7f32b815dcf0 2024-09-17T01:50:49.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.499+0000 7f32af400640 1 --2- 172.21.15.42:0/714238943 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3294078bc0 0x7f329407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:49.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.499+0000 7f32af400640 1 -- 172.21.15.42:0/714238943 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7f32a80bb960 con 0x7f32b815dcf0 2024-09-17T01:50:49.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.499+0000 7f32afe00640 1 --2- 172.21.15.42:0/714238943 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3294078bc0 0x7f329407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:49.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.500+0000 7f32afe00640 1 --2- 172.21.15.42:0/714238943 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3294078bc0 0x7f329407b0d0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f32b81e7430 tx=0x7f32a0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:49.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.504+0000 7f32af400640 1 -- 172.21.15.42:0/714238943 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f32a803f030 con 0x7f32b815dcf0 2024-09-17T01:50:49.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.697+0000 7f32be800640 1 -- 172.21.15.42:0/714238943 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f32b81e7180 con 0x7f3294078bc0 2024-09-17T01:50:49.696 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.698+0000 7f32af400640 1 -- 172.21.15.42:0/714238943 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13484 (secure 0 0 0) 0x7f32b81e7180 con 0x7f3294078bc0 2024-09-17T01:50:49.696 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:50:49.696 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:50:49.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.700+0000 7f32be800640 1 -- 172.21.15.42:0/714238943 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3294078bc0 msgr2=0x7f329407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:49.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.700+0000 7f32be800640 1 --2- 172.21.15.42:0/714238943 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3294078bc0 0x7f329407b0d0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f32b81e7430 tx=0x7f32a0009040 comp rx=0 tx=0).stop 2024-09-17T01:50:49.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.700+0000 7f32be800640 1 -- 172.21.15.42:0/714238943 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32b815dcf0 msgr2=0x7f32b81367c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:49.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.700+0000 7f32be800640 1 --2- 172.21.15.42:0/714238943 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32b815dcf0 0x7f32b81367c0 secure :-1 s=READY pgs=2659 cs=0 l=1 rev1=1 crypto rx=0x7f32a8009980 tx=0x7f32a8033c20 comp rx=0 tx=0).stop 2024-09-17T01:50:49.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.700+0000 7f32be800640 1 -- 172.21.15.42:0/714238943 shutdown_connections 2024-09-17T01:50:49.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.700+0000 7f32be800640 1 --2- 172.21.15.42:0/714238943 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3294078bc0 0x7f329407b0d0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.700+0000 7f32be800640 1 --2- 172.21.15.42:0/714238943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32b8144fa0 0x7f32b8139480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.700+0000 7f32be800640 1 --2- 172.21.15.42:0/714238943 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f32b8160790 0x7f32b8138f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.700+0000 7f32be800640 1 --2- 172.21.15.42:0/714238943 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32b815dcf0 0x7f32b81367c0 unknown :-1 s=CLOSED pgs=2659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.700+0000 7f32be800640 1 -- 172.21.15.42:0/714238943 >> 172.21.15.42:0/714238943 conn(0x7f32b806d1b0 msgr2=0x7f32b8145f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:49.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.700+0000 7f32be800640 1 -- 172.21.15.42:0/714238943 shutdown_connections 2024-09-17T01:50:49.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.700+0000 7f32be800640 1 -- 172.21.15.42:0/714238943 wait complete. 2024-09-17T01:50:49.721 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":791,"stamp":"2024-09-17T01:50:49.307400+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":468612,"kb_used_data":44248,"kb_used_omap":12,"kb_used_meta":424179,"kb_avail":754506108,"statfs":{"total":773094113280,"available":772614254592,"internally_reserved":0,"allocated":45309952,"data_stored":32419740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":434359860},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12624445,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-99,"num_read_kb":-105,"num_write":-95,"num_write_kb":-12360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.795581"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":510,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-17T01:50:43.801031+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:50:43.801031+0000","last_peered":"2024-09-17T01:50:43.801031+0000","last_clean":"2024-09-17T01:50:43.801031+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:50:43.801031+0000","last_undegraded":"2024-09-17T01:50:43.801031+0000","last_fullsized":"2024-09-17T01:50:43.801031+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476966,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52080,"kb_used_data":2840,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319760,"statfs":{"total":96636764160,"available":96583434240,"internally_reserved":0,"allocated":2908160,"data_stored":1289102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509669,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66520,"kb_used_data":8964,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94305320,"statfs":{"total":96636764160,"available":96568647680,"internally_reserved":0,"allocated":9179136,"data_stored":7569520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509668,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51996,"kb_used_data":6920,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319844,"statfs":{"total":96636764160,"available":96583520256,"internally_reserved":0,"allocated":7086080,"data_stored":5477755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509669,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52060,"kb_used_data":2824,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319780,"statfs":{"total":96636764160,"available":96583454720,"internally_reserved":0,"allocated":2891776,"data_stored":1283451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509669,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74128,"kb_used_data":6908,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94297712,"statfs":{"total":96636764160,"available":96560857088,"internally_reserved":0,"allocated":7073792,"data_stored":5471716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509668,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52640,"kb_used_data":3404,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319200,"statfs":{"total":96636764160,"available":96582860800,"internally_reserved":0,"allocated":3485696,"data_stored":1873819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509670,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66524,"kb_used_data":8968,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94305316,"statfs":{"total":96636764160,"available":96568643584,"internally_reserved":0,"allocated":9183232,"data_stored":7574907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":58915273},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542375,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52664,"kb_used_data":3420,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319176,"statfs":{"total":96636764160,"available":96582836224,"internally_reserved":0,"allocated":3502080,"data_stored":1879470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:50:49.721 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T01:50:49.721 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:50:49.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.952+0000 7f6f94a00640 1 -- 172.21.15.42:0/2400911953 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f74004d40 msgr2=0x7f6f74005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:49.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.952+0000 7f6f94a00640 1 --2- 172.21.15.42:0/2400911953 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f74004d40 0x7f6f74005210 secure :-1 s=READY pgs=2661 cs=0 l=1 rev1=1 crypto rx=0x7f6f88005fd0 tx=0x7f6f74005830 comp rx=0 tx=0).stop 2024-09-17T01:50:49.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.952+0000 7f6f8e800640 1 -- 172.21.15.42:0/2400911953 reap_dead start 2024-09-17T01:50:49.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.952+0000 7f6f94a00640 1 -- 172.21.15.42:0/2400911953 shutdown_connections 2024-09-17T01:50:49.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.952+0000 7f6f94a00640 1 -- 172.21.15.42:0/2400911953 >> 172.21.15.42:0/2400911953 conn(0x7f6f9006d1b0 msgr2=0x7f6f9006d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:49.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.953+0000 7f6f94a00640 1 -- 172.21.15.42:0/2400911953 shutdown_connections 2024-09-17T01:50:49.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.953+0000 7f6f94a00640 1 -- 172.21.15.42:0/2400911953 wait complete. 2024-09-17T01:50:49.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.955+0000 7f6f94a00640 1 Processor -- start 2024-09-17T01:50:49.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.955+0000 7f6f94a00640 1 -- start start 2024-09-17T01:50:49.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.956+0000 7f6f94a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f74004d40 0x7f6f9015f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:49.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.956+0000 7f6f94a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f9015f9c0 0x7f6f901f69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:49.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.956+0000 7f6f94a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f901f6f10 0x7f6f901f7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:49.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.956+0000 7f6f94a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9006eae0 con 0x7f6f901f6f10 2024-09-17T01:50:49.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.956+0000 7f6f94a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6f900d02e0 con 0x7f6f74004d40 2024-09-17T01:50:49.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.956+0000 7f6f94a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6f9006ec60 con 0x7f6f9015f9c0 2024-09-17T01:50:49.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.957+0000 7f6f8e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f901f6f10 0x7f6f901f7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:49.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.957+0000 7f6f8e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f901f6f10 0x7f6f901f7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59152/0 (socket says 172.21.15.42:59152) 2024-09-17T01:50:49.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.957+0000 7f6f8e800640 1 -- 172.21.15.42:0/1066897654 learned_addr learned my addr 172.21.15.42:0/1066897654 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:49.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.957+0000 7f6f8de00640 1 --2- 172.21.15.42:0/1066897654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f74004d40 0x7f6f9015f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:49.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.957+0000 7f6f85400640 1 --2- 172.21.15.42:0/1066897654 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f9015f9c0 0x7f6f901f69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:49.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.957+0000 7f6f8e800640 1 -- 172.21.15.42:0/1066897654 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f9015f9c0 msgr2=0x7f6f901f69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:49.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.957+0000 7f6f8e800640 1 --2- 172.21.15.42:0/1066897654 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f9015f9c0 0x7f6f901f69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.957+0000 7f6f8e800640 1 -- 172.21.15.42:0/1066897654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f74004d40 msgr2=0x7f6f9015f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:49.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.957+0000 7f6f8e800640 1 --2- 172.21.15.42:0/1066897654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f74004d40 0x7f6f9015f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:49.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.957+0000 7f6f8e800640 1 -- 172.21.15.42:0/1066897654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9015fdd0 con 0x7f6f901f6f10 2024-09-17T01:50:49.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.957+0000 7f6f8e800640 1 --2- 172.21.15.42:0/1066897654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f901f6f10 0x7f6f901f7320 secure :-1 s=READY pgs=2662 cs=0 l=1 rev1=1 crypto rx=0x7f6f88005fd0 tx=0x7f6f88033bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:49.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.958+0000 7f6f86a00640 1 -- 172.21.15.42:0/1066897654 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f88042070 con 0x7f6f901f6f10 2024-09-17T01:50:49.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.958+0000 7f6f86a00640 1 -- 172.21.15.42:0/1066897654 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f88003970 con 0x7f6f901f6f10 2024-09-17T01:50:49.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.958+0000 7f6f86a00640 1 -- 172.21.15.42:0/1066897654 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f88038040 con 0x7f6f901f6f10 2024-09-17T01:50:49.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.958+0000 7f6f94a00640 1 -- 172.21.15.42:0/1066897654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f900af610 con 0x7f6f901f6f10 2024-09-17T01:50:49.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.958+0000 7f6f94a00640 1 -- 172.21.15.42:0/1066897654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f900ab070 con 0x7f6f901f6f10 2024-09-17T01:50:49.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.959+0000 7f6f94a00640 1 -- 172.21.15.42:0/1066897654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f90160c40 con 0x7f6f901f6f10 2024-09-17T01:50:49.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.960+0000 7f6f86a00640 1 -- 172.21.15.42:0/1066897654 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6f88004030 con 0x7f6f901f6f10 2024-09-17T01:50:49.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.961+0000 7f6f86a00640 1 --2- 172.21.15.42:0/1066897654 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6f6c078bc0 0x7f6f6c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:49.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.961+0000 7f6f86a00640 1 -- 172.21.15.42:0/1066897654 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7f6f880bad40 con 0x7f6f901f6f10 2024-09-17T01:50:49.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.962+0000 7f6f8de00640 1 --2- 172.21.15.42:0/1066897654 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6f6c078bc0 0x7f6f6c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:49.960 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.962+0000 7f6f8de00640 1 --2- 172.21.15.42:0/1066897654 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6f6c078bc0 0x7f6f6c07b0d0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f6f80006fd0 tx=0x7f6f80006d70 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:49.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:49.966+0000 7f6f86a00640 1 -- 172.21.15.42:0/1066897654 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6f9015fdd0 con 0x7f6f901f6f10 2024-09-17T01:50:50.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.156+0000 7f6f94a00640 1 -- 172.21.15.42:0/1066897654 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6f900af3a0 con 0x7f6f6c078bc0 2024-09-17T01:50:50.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.158+0000 7f6f86a00640 1 -- 172.21.15.42:0/1066897654 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13484 (secure 0 0 0) 0x7f6f900af3a0 con 0x7f6f6c078bc0 2024-09-17T01:50:50.156 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:50:50.156 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:50:50.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.160+0000 7f6f94a00640 1 -- 172.21.15.42:0/1066897654 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6f6c078bc0 msgr2=0x7f6f6c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:50.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.160+0000 7f6f94a00640 1 --2- 172.21.15.42:0/1066897654 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6f6c078bc0 0x7f6f6c07b0d0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f6f80006fd0 tx=0x7f6f80006d70 comp rx=0 tx=0).stop 2024-09-17T01:50:50.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.160+0000 7f6f94a00640 1 -- 172.21.15.42:0/1066897654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f901f6f10 msgr2=0x7f6f901f7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:50.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.160+0000 7f6f94a00640 1 --2- 172.21.15.42:0/1066897654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f901f6f10 0x7f6f901f7320 secure :-1 s=READY pgs=2662 cs=0 l=1 rev1=1 crypto rx=0x7f6f88005fd0 tx=0x7f6f88033bf0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.160+0000 7f6f94a00640 1 -- 172.21.15.42:0/1066897654 shutdown_connections 2024-09-17T01:50:50.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.160+0000 7f6f94a00640 1 --2- 172.21.15.42:0/1066897654 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6f6c078bc0 0x7f6f6c07b0d0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.160+0000 7f6f94a00640 1 --2- 172.21.15.42:0/1066897654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f901f6f10 0x7f6f901f7320 unknown :-1 s=CLOSED pgs=2662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.160+0000 7f6f94a00640 1 --2- 172.21.15.42:0/1066897654 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6f9015f9c0 0x7f6f901f69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.160+0000 7f6f94a00640 1 --2- 172.21.15.42:0/1066897654 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f74004d40 0x7f6f9015f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.160+0000 7f6f94a00640 1 -- 172.21.15.42:0/1066897654 >> 172.21.15.42:0/1066897654 conn(0x7f6f9006d1b0 msgr2=0x7f6f90070260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:50.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.160+0000 7f6f94a00640 1 -- 172.21.15.42:0/1066897654 shutdown_connections 2024-09-17T01:50:50.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.160+0000 7f6f94a00640 1 -- 172.21.15.42:0/1066897654 wait complete. 2024-09-17T01:50:50.180 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":791,"stamp":"2024-09-17T01:50:49.307400+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":468612,"kb_used_data":44248,"kb_used_omap":12,"kb_used_meta":424179,"kb_avail":754506108,"statfs":{"total":773094113280,"available":772614254592,"internally_reserved":0,"allocated":45309952,"data_stored":32419740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":434359860},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12624445,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-99,"num_read_kb":-105,"num_write":-95,"num_write_kb":-12360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.795581"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":510,"reported_epoch":229,"state":"active+clean","last_fresh":"2024-09-17T01:50:43.801031+0000","last_change":"2024-09-17T01:31:56.603907+0000","last_active":"2024-09-17T01:50:43.801031+0000","last_peered":"2024-09-17T01:50:43.801031+0000","last_clean":"2024-09-17T01:50:43.801031+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:50:43.801031+0000","last_undegraded":"2024-09-17T01:50:43.801031+0000","last_fullsized":"2024-09-17T01:50:43.801031+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:31:55.066838+0000","last_clean_scrub_stamp":"2024-09-17T01:31:55.066838+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:10.497169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476966,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52080,"kb_used_data":2840,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319760,"statfs":{"total":96636764160,"available":96583434240,"internally_reserved":0,"allocated":2908160,"data_stored":1289102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509669,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66520,"kb_used_data":8964,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94305320,"statfs":{"total":96636764160,"available":96568647680,"internally_reserved":0,"allocated":9179136,"data_stored":7569520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509668,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51996,"kb_used_data":6920,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319844,"statfs":{"total":96636764160,"available":96583520256,"internally_reserved":0,"allocated":7086080,"data_stored":5477755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509669,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52060,"kb_used_data":2824,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319780,"statfs":{"total":96636764160,"available":96583454720,"internally_reserved":0,"allocated":2891776,"data_stored":1283451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509669,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74128,"kb_used_data":6908,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94297712,"statfs":{"total":96636764160,"available":96560857088,"internally_reserved":0,"allocated":7073792,"data_stored":5471716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509668,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52640,"kb_used_data":3404,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319200,"statfs":{"total":96636764160,"available":96582860800,"internally_reserved":0,"allocated":3485696,"data_stored":1873819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509670,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66524,"kb_used_data":8968,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94305316,"statfs":{"total":96636764160,"available":96568643584,"internally_reserved":0,"allocated":9183232,"data_stored":7574907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":58915273},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542375,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52664,"kb_used_data":3420,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319176,"statfs":{"total":96636764160,"available":96582836224,"internally_reserved":0,"allocated":3502080,"data_stored":1879470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:50:50.180 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T01:50:50.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.409+0000 7fd751000640 1 -- 172.21.15.42:0/3904133623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd74c0afb00 msgr2=0x7fd74c073d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:50.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.409+0000 7fd751000640 1 --2- 172.21.15.42:0/3904133623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd74c0afb00 0x7fd74c073d00 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009830 tx=0x7fd73c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.409+0000 7fd751000640 1 -- 172.21.15.42:0/3904133623 shutdown_connections 2024-09-17T01:50:50.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.409+0000 7fd751000640 1 --2- 172.21.15.42:0/3904133623 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd74c160cd0 0x7fd74c0b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.409+0000 7fd751000640 1 --2- 172.21.15.42:0/3904133623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd74c0afb00 0x7fd74c073d00 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.409+0000 7fd751000640 1 -- 172.21.15.42:0/3904133623 >> 172.21.15.42:0/3904133623 conn(0x7fd74c06d3f0 msgr2=0x7fd74c0b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:50.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.409+0000 7fd751000640 1 -- 172.21.15.42:0/3904133623 shutdown_connections 2024-09-17T01:50:50.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.409+0000 7fd751000640 1 -- 172.21.15.42:0/3904133623 wait complete. 2024-09-17T01:50:50.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.412+0000 7fd751000640 1 Processor -- start 2024-09-17T01:50:50.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.412+0000 7fd751000640 1 -- start start 2024-09-17T01:50:50.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.413+0000 7fd751000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd74c0afb00 0x7fd74c15ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:50.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.413+0000 7fd751000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd74c0b51d0 0x7fd74c1f5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:50.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.413+0000 7fd751000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd74c1f2960 0x7fd74c159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:50.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.413+0000 7fd751000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c0ce4f0 con 0x7fd74c0afb00 2024-09-17T01:50:50.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.413+0000 7fd751000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c0ce370 con 0x7fd74c0b51d0 2024-09-17T01:50:50.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.413+0000 7fd751000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fd74c0ce670 con 0x7fd74c1f2960 2024-09-17T01:50:50.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.413+0000 7fd74b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd74c0afb00 0x7fd74c15ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:50.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.414+0000 7fd74b400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd74c0afb00 0x7fd74c15ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59166/0 (socket says 172.21.15.42:59166) 2024-09-17T01:50:50.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.414+0000 7fd74b400640 1 -- 172.21.15.42:0/2312745610 learned_addr learned my addr 172.21.15.42:0/2312745610 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:50.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.414+0000 7fd74be00640 1 --2- 172.21.15.42:0/2312745610 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd74c1f2960 0x7fd74c159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:50.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.414+0000 7fd74aa00640 1 --2- 172.21.15.42:0/2312745610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd74c0b51d0 0x7fd74c1f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:50.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.414+0000 7fd74b400640 1 -- 172.21.15.42:0/2312745610 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd74c1f2960 msgr2=0x7fd74c159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:50.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.414+0000 7fd74b400640 1 --2- 172.21.15.42:0/2312745610 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd74c1f2960 0x7fd74c159350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.414+0000 7fd74b400640 1 -- 172.21.15.42:0/2312745610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd74c0b51d0 msgr2=0x7fd74c1f5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:50.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.414+0000 7fd74b400640 1 --2- 172.21.15.42:0/2312745610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd74c0b51d0 0x7fd74c1f5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.414+0000 7fd74b400640 1 -- 172.21.15.42:0/2312745610 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74c157ae0 con 0x7fd74c0afb00 2024-09-17T01:50:50.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.414+0000 7fd74b400640 1 --2- 172.21.15.42:0/2312745610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd74c0afb00 0x7fd74c15ebd0 secure :-1 s=READY pgs=2664 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009950 tx=0x7fd73c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:50.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.415+0000 7fd743400640 1 -- 172.21.15.42:0/2312745610 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c005c90 con 0x7fd74c0afb00 2024-09-17T01:50:50.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.415+0000 7fd743400640 1 -- 172.21.15.42:0/2312745610 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd73c005020 con 0x7fd74c0afb00 2024-09-17T01:50:50.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.415+0000 7fd743400640 1 -- 172.21.15.42:0/2312745610 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c005450 con 0x7fd74c0afb00 2024-09-17T01:50:50.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.415+0000 7fd751000640 1 -- 172.21.15.42:0/2312745610 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74c157dc0 con 0x7fd74c0afb00 2024-09-17T01:50:50.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.415+0000 7fd751000640 1 -- 172.21.15.42:0/2312745610 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd74c15e3d0 con 0x7fd74c0afb00 2024-09-17T01:50:50.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.416+0000 7fd751000640 1 -- 172.21.15.42:0/2312745610 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd74c073d00 con 0x7fd74c0afb00 2024-09-17T01:50:50.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.417+0000 7fd743400640 1 -- 172.21.15.42:0/2312745610 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd73c0317c0 con 0x7fd74c0afb00 2024-09-17T01:50:50.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.418+0000 7fd743400640 1 --2- 172.21.15.42:0/2312745610 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd72c078bc0 0x7fd72c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:50.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.418+0000 7fd743400640 1 -- 172.21.15.42:0/2312745610 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7fd73c0bbac0 con 0x7fd74c0afb00 2024-09-17T01:50:50.416 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.419+0000 7fd74aa00640 1 --2- 172.21.15.42:0/2312745610 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd72c078bc0 0x7fd72c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:50.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.419+0000 7fd74aa00640 1 --2- 172.21.15.42:0/2312745610 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd72c078bc0 0x7fd72c07b0d0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fd74c15bf60 tx=0x7fd738001d50 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:50.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.422+0000 7fd743400640 1 -- 172.21.15.42:0/2312745610 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd73c03f030 con 0x7fd74c0afb00 2024-09-17T01:50:50.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.616+0000 7fd751000640 1 -- 172.21.15.42:0/2312745610 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd74c15bf90 con 0x7fd74c0afb00 2024-09-17T01:50:50.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.617+0000 7fd743400640 1 -- 172.21.15.42:0/2312745610 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v230) ==== 74+0+13124 (secure 0 0 0) 0x7fd73c083ab0 con 0x7fd74c0afb00 2024-09-17T01:50:50.615 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:50:50.615 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":230,"fsid":"fea1c88c-cb05-432f-a745-f9dcbb5f2503","created":"2024-09-17T01:31:39.426820+0000","modified":"2024-09-17T01:50:44.798678+0000","last_up_change":"2024-09-17T01:31:55.066838+0000","last_in_change":"2024-09-17T01:31:44.223667+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":33,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:31:55.004951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbbed357-73f1-4c49-a687-10f8d1bbc605","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6801","nonce":1232300261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6803","nonce":1232300261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6807","nonce":1232300261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1232300261},{"type":"v1","addr":"172.21.15.42:6805","nonce":1232300261}]},"public_addr":"172.21.15.42:6801/1232300261","cluster_addr":"172.21.15.42:6803/1232300261","heartbeat_back_addr":"172.21.15.42:6807/1232300261","heartbeat_front_addr":"172.21.15.42:6805/1232300261","state":["exists","up"]},{"osd":1,"uuid":"adfdb56d-ca7d-475c-9c67-92b67d1ec8d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6825","nonce":4073532812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6827","nonce":4073532812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6831","nonce":4073532812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":4073532812},{"type":"v1","addr":"172.21.15.42:6829","nonce":4073532812}]},"public_addr":"172.21.15.42:6825/4073532812","cluster_addr":"172.21.15.42:6827/4073532812","heartbeat_back_addr":"172.21.15.42:6831/4073532812","heartbeat_front_addr":"172.21.15.42:6829/4073532812","state":["exists","up"]},{"osd":2,"uuid":"91f1a863-ad20-41a1-922c-87c20ee12f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6817","nonce":2631717588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6819","nonce":2631717588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6823","nonce":2631717588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":2631717588},{"type":"v1","addr":"172.21.15.42:6821","nonce":2631717588}]},"public_addr":"172.21.15.42:6817/2631717588","cluster_addr":"172.21.15.42:6819/2631717588","heartbeat_back_addr":"172.21.15.42:6823/2631717588","heartbeat_front_addr":"172.21.15.42:6821/2631717588","state":["exists","up"]},{"osd":3,"uuid":"bf989245-f530-4e54-9bac-348e51303f29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6809","nonce":940657160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6811","nonce":940657160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6815","nonce":940657160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":940657160},{"type":"v1","addr":"172.21.15.42:6813","nonce":940657160}]},"public_addr":"172.21.15.42:6809/940657160","cluster_addr":"172.21.15.42:6811/940657160","heartbeat_back_addr":"172.21.15.42:6815/940657160","heartbeat_front_addr":"172.21.15.42:6813/940657160","state":["exists","up"]},{"osd":4,"uuid":"a989b7cb-a52d-4ee9-8557-469825e4ca19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6819","nonce":3453529013}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6820","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6821","nonce":3453529013}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6824","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6825","nonce":3453529013}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":3453529013},{"type":"v1","addr":"172.21.15.43:6823","nonce":3453529013}]},"public_addr":"172.21.15.43:6819/3453529013","cluster_addr":"172.21.15.43:6821/3453529013","heartbeat_back_addr":"172.21.15.43:6825/3453529013","heartbeat_front_addr":"172.21.15.43:6823/3453529013","state":["exists","up"]},{"osd":5,"uuid":"47a091d7-5988-4bf8-a126-e0d61efbcdba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6803","nonce":3469876255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6805","nonce":3469876255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6809","nonce":3469876255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3469876255},{"type":"v1","addr":"172.21.15.43:6807","nonce":3469876255}]},"public_addr":"172.21.15.43:6803/3469876255","cluster_addr":"172.21.15.43:6805/3469876255","heartbeat_back_addr":"172.21.15.43:6809/3469876255","heartbeat_front_addr":"172.21.15.43:6807/3469876255","state":["exists","up"]},{"osd":6,"uuid":"dbdd536c-6ecc-4533-82d8-ef46e1e1cb97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6826","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6827","nonce":3742263700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6829","nonce":3742263700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6833","nonce":3742263700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6830","nonce":3742263700},{"type":"v1","addr":"172.21.15.43:6831","nonce":3742263700}]},"public_addr":"172.21.15.43:6827/3742263700","cluster_addr":"172.21.15.43:6829/3742263700","heartbeat_back_addr":"172.21.15.43:6833/3742263700","heartbeat_front_addr":"172.21.15.43:6831/3742263700","state":["exists","up"]},{"osd":7,"uuid":"603d3787-a3cb-4384-a201-f928d2f083e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":224,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6811","nonce":859332009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6813","nonce":859332009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6817","nonce":859332009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":859332009},{"type":"v1","addr":"172.21.15.43:6815","nonce":859332009}]},"public_addr":"172.21.15.43:6811/859332009","cluster_addr":"172.21.15.43:6813/859332009","heartbeat_back_addr":"172.21.15.43:6817/859332009","heartbeat_front_addr":"172.21.15.43:6815/859332009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.615956+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.634370+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.921446+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.941611+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.119820+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:50.536965+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.252576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:31:51.352148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6836/4082001755":"2024-09-18T01:50:41.507542+0000","172.21.15.43:6834/4082001755":"2024-09-18T01:50:41.507542+0000","172.21.15.43:6837/4233677817":"2024-09-18T01:49:27.939972+0000","172.21.15.43:6835/4233677817":"2024-09-18T01:49:27.939972+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:50:50.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.619+0000 7fd751000640 1 -- 172.21.15.42:0/2312745610 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd72c078bc0 msgr2=0x7fd72c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:50.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.619+0000 7fd751000640 1 --2- 172.21.15.42:0/2312745610 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd72c078bc0 0x7fd72c07b0d0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fd74c15bf60 tx=0x7fd738001d50 comp rx=0 tx=0).stop 2024-09-17T01:50:50.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.619+0000 7fd751000640 1 -- 172.21.15.42:0/2312745610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd74c0afb00 msgr2=0x7fd74c15ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:50.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.619+0000 7fd751000640 1 --2- 172.21.15.42:0/2312745610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd74c0afb00 0x7fd74c15ebd0 secure :-1 s=READY pgs=2664 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009950 tx=0x7fd73c003c10 comp rx=0 tx=0).stop 2024-09-17T01:50:50.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.619+0000 7fd751000640 1 -- 172.21.15.42:0/2312745610 shutdown_connections 2024-09-17T01:50:50.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.619+0000 7fd751000640 1 --2- 172.21.15.42:0/2312745610 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fd72c078bc0 0x7fd72c07b0d0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.619+0000 7fd751000640 1 --2- 172.21.15.42:0/2312745610 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd74c0b51d0 0x7fd74c1f5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.619+0000 7fd751000640 1 --2- 172.21.15.42:0/2312745610 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fd74c1f2960 0x7fd74c159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.619+0000 7fd751000640 1 --2- 172.21.15.42:0/2312745610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd74c0afb00 0x7fd74c15ebd0 unknown :-1 s=CLOSED pgs=2664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:50.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.619+0000 7fd751000640 1 -- 172.21.15.42:0/2312745610 >> 172.21.15.42:0/2312745610 conn(0x7fd74c06d3f0 msgr2=0x7fd74c15c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:50.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.619+0000 7fd751000640 1 -- 172.21.15.42:0/2312745610 shutdown_connections 2024-09-17T01:50:50.618 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:50.619+0000 7fd751000640 1 -- 172.21.15.42:0/2312745610 wait complete. 2024-09-17T01:50:51.641 INFO:tasks.ceph:Scrubbing osd.0 2024-09-17T01:50:51.641 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-17T01:50:51.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.885+0000 7f3dc5000640 1 -- 172.21.15.42:0/1995089197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dc015bd10 msgr2=0x7f3dc006fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:51.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.885+0000 7f3dc5000640 1 --2- 172.21.15.42:0/1995089197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dc015bd10 0x7f3dc006fc40 secure :-1 s=READY pgs=2666 cs=0 l=1 rev1=1 crypto rx=0x7f3db0005fd0 tx=0x7f3db002a5d0 comp rx=0 tx=0).stop 2024-09-17T01:50:51.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.885+0000 7f3dc5000640 1 -- 172.21.15.42:0/1995089197 shutdown_connections 2024-09-17T01:50:51.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.885+0000 7f3dc5000640 1 --2- 172.21.15.42:0/1995089197 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3dc015fe70 0x7f3dc00cecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:51.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.885+0000 7f3dc5000640 1 --2- 172.21.15.42:0/1995089197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dc015bd10 0x7f3dc006fc40 unknown :-1 s=CLOSED pgs=2666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:51.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.885+0000 7f3dc5000640 1 -- 172.21.15.42:0/1995089197 >> 172.21.15.42:0/1995089197 conn(0x7f3dc006cfa0 msgr2=0x7f3dc006d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:51.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.886+0000 7f3dc5000640 1 -- 172.21.15.42:0/1995089197 shutdown_connections 2024-09-17T01:50:51.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.886+0000 7f3dc5000640 1 -- 172.21.15.42:0/1995089197 wait complete. 2024-09-17T01:50:51.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.888+0000 7f3dc5000640 1 Processor -- start 2024-09-17T01:50:51.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.888+0000 7f3dc5000640 1 -- start start 2024-09-17T01:50:51.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.889+0000 7f3dc5000640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3dc0070180 0x7f3dc00b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:51.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.889+0000 7f3dc5000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dc015bd10 0x7f3dc0148460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:51.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.889+0000 7f3dc5000640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dc015fe70 0x7f3dc0147a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:51.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.889+0000 7f3dc5000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc00cf650 con 0x7f3dc015bd10 2024-09-17T01:50:51.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.889+0000 7f3dc5000640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc00cf4d0 con 0x7f3dc015fe70 2024-09-17T01:50:51.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.889+0000 7f3dc5000640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f3dc00cf7d0 con 0x7f3dc0070180 2024-09-17T01:50:51.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.890+0000 7f3db7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dc015bd10 0x7f3dc0148460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:51.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.890+0000 7f3dbf400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3dc0070180 0x7f3dc00b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:51.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.890+0000 7f3dbf400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3dc0070180 0x7f3dc00b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3301/0 says I am v2:172.21.15.42:48014/0 (socket says 172.21.15.42:48014) 2024-09-17T01:50:51.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.890+0000 7f3dbf400640 1 -- 172.21.15.42:0/4189658781 learned_addr learned my addr 172.21.15.42:0/4189658781 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:51.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.890+0000 7f3db7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dc015bd10 0x7f3dc0148460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59188/0 (socket says 172.21.15.42:59188) 2024-09-17T01:50:51.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.890+0000 7f3dbfe00640 1 --2- 172.21.15.42:0/4189658781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dc015fe70 0x7f3dc0147a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:51.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.890+0000 7f3db7e00640 1 -- 172.21.15.42:0/4189658781 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3dc0070180 msgr2=0x7f3dc00b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:51.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.890+0000 7f3db7e00640 1 --2- 172.21.15.42:0/4189658781 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3dc0070180 0x7f3dc00b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:51.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.890+0000 7f3db7e00640 1 -- 172.21.15.42:0/4189658781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dc015fe70 msgr2=0x7f3dc0147a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:51.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.890+0000 7f3db7e00640 1 --2- 172.21.15.42:0/4189658781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3dc015fe70 0x7f3dc0147a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:51.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.890+0000 7f3db7e00640 1 -- 172.21.15.42:0/4189658781 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc00b41d0 con 0x7f3dc015bd10 2024-09-17T01:50:51.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.890+0000 7f3dbf400640 1 --2- 172.21.15.42:0/4189658781 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f3dc0070180 0x7f3dc00b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:50:51.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.890+0000 7f3db7e00640 1 --2- 172.21.15.42:0/4189658781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dc015bd10 0x7f3dc0148460 secure :-1 s=READY pgs=2667 cs=0 l=1 rev1=1 crypto rx=0x7f3da800c3c0 tx=0x7f3da800c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:51.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.891+0000 7f3db7400640 1 -- 172.21.15.42:0/4189658781 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da8017070 con 0x7f3dc015bd10 2024-09-17T01:50:51.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.891+0000 7f3db7400640 1 -- 172.21.15.42:0/4189658781 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3da80035f0 con 0x7f3dc015bd10 2024-09-17T01:50:51.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.891+0000 7f3db7400640 1 -- 172.21.15.42:0/4189658781 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da8003a80 con 0x7f3dc015bd10 2024-09-17T01:50:51.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.891+0000 7f3dc5000640 1 -- 172.21.15.42:0/4189658781 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dc00c57a0 con 0x7f3dc015bd10 2024-09-17T01:50:51.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.891+0000 7f3dc5000640 1 -- 172.21.15.42:0/4189658781 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dc00c5a80 con 0x7f3dc015bd10 2024-09-17T01:50:51.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.892+0000 7f3dc5000640 1 -- 172.21.15.42:0/4189658781 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3dc00cfcf0 con 0x7f3dc015bd10 2024-09-17T01:50:51.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.893+0000 7f3db7400640 1 -- 172.21.15.42:0/4189658781 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3da801a070 con 0x7f3dc015bd10 2024-09-17T01:50:51.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.894+0000 7f3db7400640 1 --2- 172.21.15.42:0/4189658781 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3d9c078bc0 0x7f3d9c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:51.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.894+0000 7f3db7400640 1 -- 172.21.15.42:0/4189658781 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7f3da8099c80 con 0x7f3dc015bd10 2024-09-17T01:50:51.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.894+0000 7f3db7400640 1 --2- 172.21.15.42:0/4189658781 >> [v2:172.21.15.42:6800/1232300261,v1:172.21.15.42:6801/1232300261] conn(0x7f3d9c07eb70 0x7f3d9c080fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:51.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.894+0000 7f3db7400640 1 -- 172.21.15.42:0/4189658781 --> [v2:172.21.15.42:6800/1232300261,v1:172.21.15.42:6801/1232300261] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d9c081690 con 0x7f3d9c07eb70 2024-09-17T01:50:51.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.894+0000 7f3db7400640 1 -- 172.21.15.42:0/4189658781 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=230) ==== 24+0+0 (secure 0 0 0) 0x7f3da809e2a0 con 0x7f3dc015bd10 2024-09-17T01:50:51.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.895+0000 7f3dbf400640 1 --2- 172.21.15.42:0/4189658781 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3d9c078bc0 0x7f3d9c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:51.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.895+0000 7f3dbfe00640 1 --2- 172.21.15.42:0/4189658781 >> [v2:172.21.15.42:6800/1232300261,v1:172.21.15.42:6801/1232300261] conn(0x7f3d9c07eb70 0x7f3d9c080fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:51.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.895+0000 7f3dbfe00640 1 --2- 172.21.15.42:0/4189658781 >> [v2:172.21.15.42:6800/1232300261,v1:172.21.15.42:6801/1232300261] conn(0x7f3d9c07eb70 0x7f3d9c080fc0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:51.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.895+0000 7f3dbf400640 1 --2- 172.21.15.42:0/4189658781 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3d9c078bc0 0x7f3d9c07b0d0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f3db0009230 tx=0x7f3db0004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:51.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.896+0000 7f3db7400640 1 -- 172.21.15.42:0/4189658781 <== osd.0 v2:172.21.15.42:6800/1232300261 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d9c081690 con 0x7f3d9c07eb70 2024-09-17T01:50:51.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.909+0000 7f3dc5000640 1 -- 172.21.15.42:0/4189658781 --> [v2:172.21.15.42:6800/1232300261,v1:172.21.15.42:6801/1232300261] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3dc014b320 con 0x7f3d9c07eb70 2024-09-17T01:50:51.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.910+0000 7f3db7400640 1 -- 172.21.15.42:0/4189658781 <== osd.0 v2:172.21.15.42:6800/1232300261 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3dc014b320 con 0x7f3d9c07eb70 2024-09-17T01:50:51.908 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:50:51.908 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T01:50:51.908 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:50:51.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.910+0000 7f3dc5000640 1 -- 172.21.15.42:0/4189658781 >> [v2:172.21.15.42:6800/1232300261,v1:172.21.15.42:6801/1232300261] conn(0x7f3d9c07eb70 msgr2=0x7f3d9c080fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:51.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.910+0000 7f3dc5000640 1 --2- 172.21.15.42:0/4189658781 >> [v2:172.21.15.42:6800/1232300261,v1:172.21.15.42:6801/1232300261] conn(0x7f3d9c07eb70 0x7f3d9c080fc0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:51.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.910+0000 7f3dc5000640 1 -- 172.21.15.42:0/4189658781 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3d9c078bc0 msgr2=0x7f3d9c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:51.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.910+0000 7f3dc5000640 1 --2- 172.21.15.42:0/4189658781 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f3d9c078bc0 0x7f3d9c07b0d0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f3db0009230 tx=0x7f3db0004730 comp rx=0 tx=0).stop 2024-09-17T01:50:51.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.910+0000 7f3dc5000640 1 -- 172.21.15.42:0/4189658781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dc015bd10 msgr2=0x7f3dc0148460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:51.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.910+0000 7f3dc5000640 1 --2- 172.21.15.42:0/4189658781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3dc015bd10 0x7f3dc0148460 secure :-1 s=READY pgs=2667 cs=0 l=1 rev1=1 crypto rx=0x7f3da800c3c0 tx=0x7f3da800c7c0 comp rx=0 tx=0).stop 2024-09-17T01:50:51.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.910+0000 7f3dbfe00640 1 -- 172.21.15.42:0/4189658781 reap_dead start 2024-09-17T01:50:51.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.910+0000 7f3dc5000640 1 -- 172.21.15.42:0/4189658781 shutdown_connections 2024-09-17T01:50:51.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.910+0000 7f3dc5000640 1 -- 172.21.15.42:0/4189658781 >> 172.21.15.42:0/4189658781 conn(0x7f3dc006cfa0 msgr2=0x7f3dc015f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:51.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.910+0000 7f3dc5000640 1 -- 172.21.15.42:0/4189658781 shutdown_connections 2024-09-17T01:50:51.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:51.910+0000 7f3dc5000640 1 -- 172.21.15.42:0/4189658781 wait complete. 2024-09-17T01:50:51.933 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-17T01:50:52.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.164+0000 7f6b4ec00640 1 -- 172.21.15.42:0/3070974856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b480afa90 msgr2=0x7f6b48160520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:52.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.164+0000 7f6b4ec00640 1 --2- 172.21.15.42:0/3070974856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b480afa90 0x7f6b48160520 secure :-1 s=READY pgs=2668 cs=0 l=1 rev1=1 crypto rx=0x7f6b480d02c0 tx=0x7f6b3402a5f0 comp rx=0 tx=0).stop 2024-09-17T01:50:52.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.164+0000 7f6b4ec00640 1 -- 172.21.15.42:0/3070974856 shutdown_connections 2024-09-17T01:50:52.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.164+0000 7f6b4ec00640 1 --2- 172.21.15.42:0/3070974856 >> v2:172.21.15.43:3300/0 conn(0x7f6b48160a60 0x7f6b480ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:52.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.164+0000 7f6b4ec00640 1 --2- 172.21.15.42:0/3070974856 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b480afa90 0x7f6b48160520 unknown :-1 s=CLOSED pgs=2668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:52.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.164+0000 7f6b4ec00640 1 -- 172.21.15.42:0/3070974856 >> 172.21.15.42:0/3070974856 conn(0x7f6b4806d3f0 msgr2=0x7f6b480b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:52.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.164+0000 7f6b4ec00640 1 -- 172.21.15.42:0/3070974856 shutdown_connections 2024-09-17T01:50:52.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.164+0000 7f6b4ec00640 1 -- 172.21.15.42:0/3070974856 wait complete. 2024-09-17T01:50:52.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.167+0000 7f6b4ec00640 1 Processor -- start 2024-09-17T01:50:52.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.167+0000 7f6b4ec00640 1 -- start start 2024-09-17T01:50:52.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.168+0000 7f6b4ec00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b480afa90 0x7f6b4813dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:52.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.168+0000 7f6b4ec00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b48160a60 0x7f6b480b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:52.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.168+0000 7f6b4ec00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b48161210 0x7f6b480b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:52.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.168+0000 7f6b4ec00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6b480cf440 con 0x7f6b48160a60 2024-09-17T01:50:52.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.168+0000 7f6b4ec00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6b480cf2c0 con 0x7f6b48161210 2024-09-17T01:50:52.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.168+0000 7f6b4ec00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f6b480cf5c0 con 0x7f6b480afa90 2024-09-17T01:50:52.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.168+0000 7f6b4ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b48160a60 0x7f6b480b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:52.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.169+0000 7f6b4ce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b48160a60 0x7f6b480b1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59200/0 (socket says 172.21.15.42:59200) 2024-09-17T01:50:52.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.169+0000 7f6b4ce00640 1 -- 172.21.15.42:0/497117810 learned_addr learned my addr 172.21.15.42:0/497117810 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:52.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.169+0000 7f6b4e200640 1 --2- 172.21.15.42:0/497117810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b48161210 0x7f6b480b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:52.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.169+0000 7f6b4d800640 1 --2- 172.21.15.42:0/497117810 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b480afa90 0x7f6b4813dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:52.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.169+0000 7f6b4ce00640 1 -- 172.21.15.42:0/497117810 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b480afa90 msgr2=0x7f6b4813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:52.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.169+0000 7f6b4ce00640 1 --2- 172.21.15.42:0/497117810 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b480afa90 0x7f6b4813dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:52.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.169+0000 7f6b4ce00640 1 -- 172.21.15.42:0/497117810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b48161210 msgr2=0x7f6b480b2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:52.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.169+0000 7f6b4ce00640 1 --2- 172.21.15.42:0/497117810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b48161210 0x7f6b480b2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:52.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.169+0000 7f6b4ce00640 1 -- 172.21.15.42:0/497117810 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b481f8e50 con 0x7f6b48160a60 2024-09-17T01:50:52.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.169+0000 7f6b4d800640 1 --2- 172.21.15.42:0/497117810 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b480afa90 0x7f6b4813dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:52.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.169+0000 7f6b4e200640 1 --2- 172.21.15.42:0/497117810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b48161210 0x7f6b480b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:52.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.169+0000 7f6b4ce00640 1 --2- 172.21.15.42:0/497117810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b48160a60 0x7f6b480b1d50 secure :-1 s=READY pgs=2669 cs=0 l=1 rev1=1 crypto rx=0x7f6b34034040 tx=0x7f6b34003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:52.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.170+0000 7f6b45600640 1 -- 172.21.15.42:0/497117810 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3403e030 con 0x7f6b48160a60 2024-09-17T01:50:52.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.170+0000 7f6b45600640 1 -- 172.21.15.42:0/497117810 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b34003e00 con 0x7f6b48160a60 2024-09-17T01:50:52.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.170+0000 7f6b4ec00640 1 -- 172.21.15.42:0/497117810 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b481f9130 con 0x7f6b48160a60 2024-09-17T01:50:52.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.170+0000 7f6b45600640 1 -- 172.21.15.42:0/497117810 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b34035040 con 0x7f6b48160a60 2024-09-17T01:50:52.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.170+0000 7f6b4ec00640 1 -- 172.21.15.42:0/497117810 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b481f96f0 con 0x7f6b48160a60 2024-09-17T01:50:52.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.171+0000 7f6b4ec00640 1 -- 172.21.15.42:0/497117810 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b480cfb20 con 0x7f6b48160a60 2024-09-17T01:50:52.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.172+0000 7f6b45600640 1 -- 172.21.15.42:0/497117810 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6b34041030 con 0x7f6b48160a60 2024-09-17T01:50:52.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.173+0000 7f6b45600640 1 --2- 172.21.15.42:0/497117810 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6b28078bc0 0x7f6b2807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:52.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.173+0000 7f6b45600640 1 -- 172.21.15.42:0/497117810 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7f6b340bb350 con 0x7f6b48160a60 2024-09-17T01:50:52.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.173+0000 7f6b4d800640 1 --2- 172.21.15.42:0/497117810 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6b28078bc0 0x7f6b2807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:52.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.174+0000 7f6b4d800640 1 --2- 172.21.15.42:0/497117810 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6b28078bc0 0x7f6b2807b0d0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c007fd0 tx=0x7f6b3c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:52.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.177+0000 7f6b45600640 1 -- 172.21.15.42:0/497117810 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6b34083990 con 0x7f6b48160a60 2024-09-17T01:50:52.369 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.372+0000 7f6b4ec00640 1 -- 172.21.15.42:0/497117810 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f6b4815c300 con 0x7f6b28078bc0 2024-09-17T01:50:52.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.372+0000 7f6b45600640 1 -- 172.21.15.42:0/497117810 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6b3c001c50 con 0x7f6b28078bc0 2024-09-17T01:50:52.370 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 0 to deep-scrub 2024-09-17T01:50:52.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.375+0000 7f6b4ec00640 1 -- 172.21.15.42:0/497117810 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6b28078bc0 msgr2=0x7f6b2807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:52.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.375+0000 7f6b4ec00640 1 --2- 172.21.15.42:0/497117810 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6b28078bc0 0x7f6b2807b0d0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c007fd0 tx=0x7f6b3c009040 comp rx=0 tx=0).stop 2024-09-17T01:50:52.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.375+0000 7f6b4ec00640 1 -- 172.21.15.42:0/497117810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b48160a60 msgr2=0x7f6b480b1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:52.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.375+0000 7f6b4ec00640 1 --2- 172.21.15.42:0/497117810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b48160a60 0x7f6b480b1d50 secure :-1 s=READY pgs=2669 cs=0 l=1 rev1=1 crypto rx=0x7f6b34034040 tx=0x7f6b34003910 comp rx=0 tx=0).stop 2024-09-17T01:50:52.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.375+0000 7f6b4ec00640 1 -- 172.21.15.42:0/497117810 shutdown_connections 2024-09-17T01:50:52.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.375+0000 7f6b4ec00640 1 --2- 172.21.15.42:0/497117810 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6b28078bc0 0x7f6b2807b0d0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:52.373 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.375+0000 7f6b4ec00640 1 --2- 172.21.15.42:0/497117810 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b48161210 0x7f6b480b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:52.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.375+0000 7f6b4ec00640 1 --2- 172.21.15.42:0/497117810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6b48160a60 0x7f6b480b1d50 unknown :-1 s=CLOSED pgs=2669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:52.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.375+0000 7f6b4ec00640 1 --2- 172.21.15.42:0/497117810 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6b480afa90 0x7f6b4813dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:52.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.375+0000 7f6b4ec00640 1 -- 172.21.15.42:0/497117810 >> 172.21.15.42:0/497117810 conn(0x7f6b4806d3f0 msgr2=0x7f6b4815df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:52.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.375+0000 7f6b4ec00640 1 -- 172.21.15.42:0/497117810 shutdown_connections 2024-09-17T01:50:52.374 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.375+0000 7f6b4ec00640 1 -- 172.21.15.42:0/497117810 wait complete. 2024-09-17T01:50:52.397 INFO:tasks.ceph:Scrubbing osd.1 2024-09-17T01:50:52.397 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-17T01:50:52.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.634+0000 7faa09c00640 1 -- 172.21.15.42:0/1445593267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa040ce860 msgr2=0x7faa04166890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:52.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.634+0000 7faa09c00640 1 --2- 172.21.15.42:0/1445593267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa040ce860 0x7faa04166890 secure :-1 s=READY pgs=2670 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc005fd0 tx=0x7fa9fc02aa10 comp rx=0 tx=0).stop 2024-09-17T01:50:52.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.635+0000 7faa09c00640 1 -- 172.21.15.42:0/1445593267 shutdown_connections 2024-09-17T01:50:52.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.635+0000 7faa09c00640 1 --2- 172.21.15.42:0/1445593267 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa040ce860 0x7faa04166890 unknown :-1 s=CLOSED pgs=2670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:52.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.635+0000 7faa09c00640 1 --2- 172.21.15.42:0/1445593267 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faa040cfe10 0x7faa040b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:52.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.635+0000 7faa09c00640 1 -- 172.21.15.42:0/1445593267 >> 172.21.15.42:0/1445593267 conn(0x7faa040d0f90 msgr2=0x7faa040d13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:52.633 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.635+0000 7faa09c00640 1 -- 172.21.15.42:0/1445593267 shutdown_connections 2024-09-17T01:50:52.634 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.635+0000 7faa09c00640 1 -- 172.21.15.42:0/1445593267 wait complete. 2024-09-17T01:50:52.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.637+0000 7faa09c00640 1 Processor -- start 2024-09-17T01:50:52.635 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.637+0000 7faa09c00640 1 -- start start 2024-09-17T01:50:52.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.639+0000 7faa09c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa040ce860 0x7faa04154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:52.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.639+0000 7faa09c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa0415ce60 0x7faa040ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:52.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.639+0000 7faa09c00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faa04155270 0x7faa040cae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:52.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.639+0000 7faa09c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7faa04166f50 con 0x7faa040ce860 2024-09-17T01:50:52.637 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.639+0000 7faa09c00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faa04166dd0 con 0x7faa0415ce60 2024-09-17T01:50:52.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.639+0000 7faa09c00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7faa041670d0 con 0x7faa04155270 2024-09-17T01:50:52.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.639+0000 7faa02a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa040ce860 0x7faa04154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:52.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.639+0000 7faa02a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa040ce860 0x7faa04154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59214/0 (socket says 172.21.15.42:59214) 2024-09-17T01:50:52.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.639+0000 7faa02a00640 1 -- 172.21.15.42:0/2115847866 learned_addr learned my addr 172.21.15.42:0/2115847866 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:52.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.639+0000 7faa02000640 1 --2- 172.21.15.42:0/2115847866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa0415ce60 0x7faa040ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:52.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.639+0000 7faa03400640 1 --2- 172.21.15.42:0/2115847866 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faa04155270 0x7faa040cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:52.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.639+0000 7faa02a00640 1 -- 172.21.15.42:0/2115847866 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faa04155270 msgr2=0x7faa040cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:52.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.639+0000 7faa02a00640 1 --2- 172.21.15.42:0/2115847866 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7faa04155270 0x7faa040cae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:52.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.639+0000 7faa02a00640 1 -- 172.21.15.42:0/2115847866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa0415ce60 msgr2=0x7faa040ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:52.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.639+0000 7faa02a00640 1 --2- 172.21.15.42:0/2115847866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa0415ce60 0x7faa040ca930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:52.638 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.639+0000 7faa02a00640 1 -- 172.21.15.42:0/2115847866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa040b4b70 con 0x7faa040ce860 2024-09-17T01:50:52.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.640+0000 7faa02a00640 1 --2- 172.21.15.42:0/2115847866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa040ce860 0x7faa04154b50 secure :-1 s=READY pgs=2671 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400c440 tx=0x7fa9f400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:52.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.640+0000 7fa9faa00640 1 -- 172.21.15.42:0/2115847866 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4017070 con 0x7faa040ce860 2024-09-17T01:50:52.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.640+0000 7fa9faa00640 1 -- 172.21.15.42:0/2115847866 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9f40035f0 con 0x7faa040ce860 2024-09-17T01:50:52.639 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.640+0000 7fa9faa00640 1 -- 172.21.15.42:0/2115847866 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4003a40 con 0x7faa040ce860 2024-09-17T01:50:52.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.640+0000 7faa09c00640 1 -- 172.21.15.42:0/2115847866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa040b4e50 con 0x7faa040ce860 2024-09-17T01:50:52.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.640+0000 7faa09c00640 1 -- 172.21.15.42:0/2115847866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa040b5410 con 0x7faa040ce860 2024-09-17T01:50:52.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.641+0000 7faa09c00640 1 -- 172.21.15.42:0/2115847866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faa040cb7a0 con 0x7faa040ce860 2024-09-17T01:50:52.640 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.643+0000 7fa9faa00640 1 -- 172.21.15.42:0/2115847866 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa9f401a070 con 0x7faa040ce860 2024-09-17T01:50:52.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.644+0000 7fa9faa00640 1 --2- 172.21.15.42:0/2115847866 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa9e4078b90 0x7fa9e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:52.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.644+0000 7fa9faa00640 1 -- 172.21.15.42:0/2115847866 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7fa9f4099d50 con 0x7faa040ce860 2024-09-17T01:50:52.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.644+0000 7fa9faa00640 1 --2- 172.21.15.42:0/2115847866 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x7fa9e407eb40 0x7fa9e4080f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:52.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.644+0000 7fa9faa00640 1 -- 172.21.15.42:0/2115847866 --> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa9f4016ec0 con 0x7fa9e407eb40 2024-09-17T01:50:52.642 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.644+0000 7fa9faa00640 1 -- 172.21.15.42:0/2115847866 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=230) ==== 24+0+0 (secure 0 0 0) 0x7fa9f409c370 con 0x7faa040ce860 2024-09-17T01:50:52.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.644+0000 7faa03400640 1 --2- 172.21.15.42:0/2115847866 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x7fa9e407eb40 0x7fa9e4080f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:52.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.644+0000 7faa02000640 1 --2- 172.21.15.42:0/2115847866 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa9e4078b90 0x7fa9e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:52.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.645+0000 7faa03400640 1 --2- 172.21.15.42:0/2115847866 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x7fa9e407eb40 0x7fa9e4080f90 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:52.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.645+0000 7faa02000640 1 --2- 172.21.15.42:0/2115847866 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa9e4078b90 0x7fa9e407b0a0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7faa04051010 tx=0x7fa9f0005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:52.644 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.646+0000 7fa9faa00640 1 -- 172.21.15.42:0/2115847866 <== osd.1 v2:172.21.15.42:6824/4073532812 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa9f4016ec0 con 0x7fa9e407eb40 2024-09-17T01:50:52.657 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.660+0000 7faa09c00640 1 -- 172.21.15.42:0/2115847866 --> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7faa04155090 con 0x7fa9e407eb40 2024-09-17T01:50:52.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.660+0000 7fa9faa00640 1 -- 172.21.15.42:0/2115847866 <== osd.1 v2:172.21.15.42:6824/4073532812 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa9fc009360 con 0x7fa9e407eb40 2024-09-17T01:50:52.658 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:50:52.659 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T01:50:52.659 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:50:52.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.660+0000 7faa09c00640 1 -- 172.21.15.42:0/2115847866 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x7fa9e407eb40 msgr2=0x7fa9e4080f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:52.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.660+0000 7faa09c00640 1 --2- 172.21.15.42:0/2115847866 >> [v2:172.21.15.42:6824/4073532812,v1:172.21.15.42:6825/4073532812] conn(0x7fa9e407eb40 0x7fa9e4080f90 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:52.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.661+0000 7faa09c00640 1 -- 172.21.15.42:0/2115847866 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa9e4078b90 msgr2=0x7fa9e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:52.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.661+0000 7faa09c00640 1 --2- 172.21.15.42:0/2115847866 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa9e4078b90 0x7fa9e407b0a0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7faa04051010 tx=0x7fa9f0005f90 comp rx=0 tx=0).stop 2024-09-17T01:50:52.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.661+0000 7faa09c00640 1 -- 172.21.15.42:0/2115847866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa040ce860 msgr2=0x7faa04154b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:52.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.661+0000 7faa09c00640 1 --2- 172.21.15.42:0/2115847866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faa040ce860 0x7faa04154b50 secure :-1 s=READY pgs=2671 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400c440 tx=0x7fa9f400c900 comp rx=0 tx=0).stop 2024-09-17T01:50:52.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.661+0000 7faa03400640 1 -- 172.21.15.42:0/2115847866 reap_dead start 2024-09-17T01:50:52.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.661+0000 7faa09c00640 1 -- 172.21.15.42:0/2115847866 shutdown_connections 2024-09-17T01:50:52.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.661+0000 7faa09c00640 1 -- 172.21.15.42:0/2115847866 >> 172.21.15.42:0/2115847866 conn(0x7faa040d0f90 msgr2=0x7faa040af050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:52.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.661+0000 7faa09c00640 1 -- 172.21.15.42:0/2115847866 shutdown_connections 2024-09-17T01:50:52.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.661+0000 7faa09c00640 1 -- 172.21.15.42:0/2115847866 wait complete. 2024-09-17T01:50:52.685 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-17T01:50:52.792 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:50:52.797 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:50:52.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.921+0000 7fafb5e00640 1 -- 172.21.15.42:0/2495590477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafb01612f0 msgr2=0x7fafb006e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:52.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.921+0000 7fafb5e00640 1 --2- 172.21.15.42:0/2495590477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafb01612f0 0x7fafb006e310 secure :-1 s=READY pgs=2673 cs=0 l=1 rev1=1 crypto rx=0x7faf98009830 tx=0x7faf9802a510 comp rx=0 tx=0).stop 2024-09-17T01:50:52.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.921+0000 7fafb5e00640 1 -- 172.21.15.42:0/2495590477 shutdown_connections 2024-09-17T01:50:52.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.921+0000 7fafb5e00640 1 --2- 172.21.15.42:0/2495590477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafb01612f0 0x7fafb006e310 unknown :-1 s=CLOSED pgs=2673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:52.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.921+0000 7fafb5e00640 1 --2- 172.21.15.42:0/2495590477 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fafb013fbd0 0x7fafb006ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:52.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.921+0000 7fafb5e00640 1 -- 172.21.15.42:0/2495590477 >> 172.21.15.42:0/2495590477 conn(0x7fafb0073740 msgr2=0x7fafb0073b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:52.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.921+0000 7fafb5e00640 1 -- 172.21.15.42:0/2495590477 shutdown_connections 2024-09-17T01:50:52.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.921+0000 7fafb5e00640 1 -- 172.21.15.42:0/2495590477 wait complete. 2024-09-17T01:50:52.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.923+0000 7fafb5e00640 1 Processor -- start 2024-09-17T01:50:52.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.924+0000 7fafb5e00640 1 -- start start 2024-09-17T01:50:52.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.925+0000 7fafb5e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fafb0142180 0x7fafb01f59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:52.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.925+0000 7fafb5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafb01612f0 0x7fafb00cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:52.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.925+0000 7fafb5e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafb0156fa0 0x7fafb013ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:52.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.925+0000 7fafb5e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fafb015d810 con 0x7fafb01612f0 2024-09-17T01:50:52.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.925+0000 7fafb5e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fafb015d690 con 0x7fafb0156fa0 2024-09-17T01:50:52.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.925+0000 7fafb5e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fafb015d990 con 0x7fafb0142180 2024-09-17T01:50:52.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.925+0000 7fafa7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafb01612f0 0x7fafb00cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:52.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.925+0000 7fafa7e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafb01612f0 0x7fafb00cc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59232/0 (socket says 172.21.15.42:59232) 2024-09-17T01:50:52.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.925+0000 7fafa7e00640 1 -- 172.21.15.42:0/2472192641 learned_addr learned my addr 172.21.15.42:0/2472192641 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:52.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.926+0000 7fafaea00640 1 --2- 172.21.15.42:0/2472192641 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fafb0142180 0x7fafb01f59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:52.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.926+0000 7fafaf400640 1 --2- 172.21.15.42:0/2472192641 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafb0156fa0 0x7fafb013ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:52.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.926+0000 7fafa7e00640 1 -- 172.21.15.42:0/2472192641 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fafb0142180 msgr2=0x7fafb01f59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:52.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.926+0000 7fafa7e00640 1 --2- 172.21.15.42:0/2472192641 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fafb0142180 0x7fafb01f59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:52.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.926+0000 7fafa7e00640 1 -- 172.21.15.42:0/2472192641 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafb0156fa0 msgr2=0x7fafb013ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:52.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.926+0000 7fafa7e00640 1 --2- 172.21.15.42:0/2472192641 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafb0156fa0 0x7fafb013ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:52.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.926+0000 7fafa7e00640 1 -- 172.21.15.42:0/2472192641 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb013f3b0 con 0x7fafb01612f0 2024-09-17T01:50:52.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.926+0000 7fafa7e00640 1 --2- 172.21.15.42:0/2472192641 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafb01612f0 0x7fafb00cc210 secure :-1 s=READY pgs=2674 cs=0 l=1 rev1=1 crypto rx=0x7faf98009950 tx=0x7faf98033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:52.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.927+0000 7fafa7400640 1 -- 172.21.15.42:0/2472192641 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf98031d60 con 0x7fafb01612f0 2024-09-17T01:50:52.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.927+0000 7fafa7400640 1 -- 172.21.15.42:0/2472192641 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf98033e10 con 0x7fafb01612f0 2024-09-17T01:50:52.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.927+0000 7fafb5e00640 1 -- 172.21.15.42:0/2472192641 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb01f61b0 con 0x7fafb01612f0 2024-09-17T01:50:52.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.927+0000 7fafa7400640 1 -- 172.21.15.42:0/2472192641 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf98033310 con 0x7fafb01612f0 2024-09-17T01:50:52.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.927+0000 7fafb5e00640 1 -- 172.21.15.42:0/2472192641 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb01f6770 con 0x7fafb01612f0 2024-09-17T01:50:52.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.928+0000 7fafb5e00640 1 -- 172.21.15.42:0/2472192641 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb015de40 con 0x7fafb01612f0 2024-09-17T01:50:52.927 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.929+0000 7fafa7400640 1 -- 172.21.15.42:0/2472192641 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faf980334b0 con 0x7fafb01612f0 2024-09-17T01:50:52.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.931+0000 7fafa7400640 1 --2- 172.21.15.42:0/2472192641 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faf8c078bc0 0x7faf8c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:52.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.931+0000 7fafa7400640 1 -- 172.21.15.42:0/2472192641 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7faf980bbe20 con 0x7fafb01612f0 2024-09-17T01:50:52.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.931+0000 7fafaea00640 1 --2- 172.21.15.42:0/2472192641 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faf8c078bc0 0x7faf8c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:52.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.932+0000 7fafaea00640 1 --2- 172.21.15.42:0/2472192641 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faf8c078bc0 0x7faf8c07b0d0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009b30 tx=0x7fafa0005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:52.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:52.936+0000 7fafa7400640 1 -- 172.21.15.42:0/2472192641 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faf9803f030 con 0x7fafb01612f0 2024-09-17T01:50:53.130 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.133+0000 7fafb5e00640 1 -- 172.21.15.42:0/2472192641 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fafb01f5f40 con 0x7faf8c078bc0 2024-09-17T01:50:53.131 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.133+0000 7fafa7400640 1 -- 172.21.15.42:0/2472192641 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fafb01f5f40 con 0x7faf8c078bc0 2024-09-17T01:50:53.131 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 1 to deep-scrub 2024-09-17T01:50:53.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.136+0000 7fafb5e00640 1 -- 172.21.15.42:0/2472192641 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faf8c078bc0 msgr2=0x7faf8c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:53.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.136+0000 7fafb5e00640 1 --2- 172.21.15.42:0/2472192641 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faf8c078bc0 0x7faf8c07b0d0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009b30 tx=0x7fafa0005f90 comp rx=0 tx=0).stop 2024-09-17T01:50:53.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.136+0000 7fafb5e00640 1 -- 172.21.15.42:0/2472192641 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafb01612f0 msgr2=0x7fafb00cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:53.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.136+0000 7fafb5e00640 1 --2- 172.21.15.42:0/2472192641 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafb01612f0 0x7fafb00cc210 secure :-1 s=READY pgs=2674 cs=0 l=1 rev1=1 crypto rx=0x7faf98009950 tx=0x7faf98033c20 comp rx=0 tx=0).stop 2024-09-17T01:50:53.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.136+0000 7fafb5e00640 1 -- 172.21.15.42:0/2472192641 shutdown_connections 2024-09-17T01:50:53.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.136+0000 7fafb5e00640 1 --2- 172.21.15.42:0/2472192641 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7faf8c078bc0 0x7faf8c07b0d0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:53.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.136+0000 7fafb5e00640 1 --2- 172.21.15.42:0/2472192641 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafb0156fa0 0x7fafb013ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:53.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.136+0000 7fafb5e00640 1 --2- 172.21.15.42:0/2472192641 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fafb01612f0 0x7fafb00cc210 unknown :-1 s=CLOSED pgs=2674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:53.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.136+0000 7fafb5e00640 1 --2- 172.21.15.42:0/2472192641 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fafb0142180 0x7fafb01f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:53.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.136+0000 7fafb5e00640 1 -- 172.21.15.42:0/2472192641 >> 172.21.15.42:0/2472192641 conn(0x7fafb0073740 msgr2=0x7fafb0153890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:53.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.136+0000 7fafb5e00640 1 -- 172.21.15.42:0/2472192641 shutdown_connections 2024-09-17T01:50:53.135 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.136+0000 7fafb5e00640 1 -- 172.21.15.42:0/2472192641 wait complete. 2024-09-17T01:50:53.158 INFO:tasks.ceph:Scrubbing osd.2 2024-09-17T01:50:53.158 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-17T01:50:53.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.436+0000 7f01cae00640 1 -- 172.21.15.42:0/294648366 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01a8003a00 msgr2=0x7f01a8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:53.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.436+0000 7f01cae00640 1 --2- 172.21.15.42:0/294648366 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01a8003a00 0x7f01a8003e70 secure :-1 s=READY pgs=2676 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009b50 tx=0x7f01a8005830 comp rx=0 tx=0).stop 2024-09-17T01:50:53.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.436+0000 7f01c8e00640 1 -- 172.21.15.42:0/294648366 reap_dead start 2024-09-17T01:50:53.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.436+0000 7f01cae00640 1 -- 172.21.15.42:0/294648366 shutdown_connections 2024-09-17T01:50:53.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.436+0000 7f01cae00640 1 -- 172.21.15.42:0/294648366 >> 172.21.15.42:0/294648366 conn(0x7f01c406d420 msgr2=0x7f01c40b2430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:53.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.436+0000 7f01cae00640 1 -- 172.21.15.42:0/294648366 shutdown_connections 2024-09-17T01:50:53.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.436+0000 7f01cae00640 1 -- 172.21.15.42:0/294648366 wait complete. 2024-09-17T01:50:53.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.439+0000 7f01cae00640 1 Processor -- start 2024-09-17T01:50:53.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.439+0000 7f01cae00640 1 -- start start 2024-09-17T01:50:53.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.440+0000 7f01cae00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01a8003a00 0x7f01c414bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:53.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.440+0000 7f01cae00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01c415b220 0x7f01c415b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:53.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.440+0000 7f01cae00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01c414e3a0 0x7f01c414e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:53.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.440+0000 7f01cae00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f01c40b59c0 con 0x7f01c414e3a0 2024-09-17T01:50:53.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.440+0000 7f01cae00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f01c40b5840 con 0x7f01a8003a00 2024-09-17T01:50:53.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.440+0000 7f01cae00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f01c40b5b40 con 0x7f01c415b220 2024-09-17T01:50:53.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.441+0000 7f01c8e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01c414e3a0 0x7f01c414e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:53.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.441+0000 7f01c8e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01c414e3a0 0x7f01c414e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59248/0 (socket says 172.21.15.42:59248) 2024-09-17T01:50:53.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.441+0000 7f01c8e00640 1 -- 172.21.15.42:0/1653701471 learned_addr learned my addr 172.21.15.42:0/1653701471 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:53.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.441+0000 7f01c3e00640 1 --2- 172.21.15.42:0/1653701471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01a8003a00 0x7f01c414bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:53.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.441+0000 7f01c3400640 1 --2- 172.21.15.42:0/1653701471 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01c415b220 0x7f01c415b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:53.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.441+0000 7f01c8e00640 1 -- 172.21.15.42:0/1653701471 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01c415b220 msgr2=0x7f01c415b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:53.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.441+0000 7f01c8e00640 1 --2- 172.21.15.42:0/1653701471 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01c415b220 0x7f01c415b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:53.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.441+0000 7f01c8e00640 1 -- 172.21.15.42:0/1653701471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01a8003a00 msgr2=0x7f01c414bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:53.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.441+0000 7f01c8e00640 1 --2- 172.21.15.42:0/1653701471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01a8003a00 0x7f01c414bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:53.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.441+0000 7f01c8e00640 1 -- 172.21.15.42:0/1653701471 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c415bb70 con 0x7f01c414e3a0 2024-09-17T01:50:53.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.441+0000 7f01c3e00640 1 --2- 172.21.15.42:0/1653701471 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01a8003a00 0x7f01c414bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:50:53.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.441+0000 7f01c3400640 1 --2- 172.21.15.42:0/1653701471 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f01c415b220 0x7f01c415b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:50:53.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.441+0000 7f01c8e00640 1 --2- 172.21.15.42:0/1653701471 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01c414e3a0 0x7f01c414e7b0 secure :-1 s=READY pgs=2677 cs=0 l=1 rev1=1 crypto rx=0x7f01bc001330 tx=0x7f01bc00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:53.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.442+0000 7f01bbe00640 1 -- 172.21.15.42:0/1653701471 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01bc00cba0 con 0x7f01c414e3a0 2024-09-17T01:50:53.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.442+0000 7f01bbe00640 1 -- 172.21.15.42:0/1653701471 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01bc018070 con 0x7f01c414e3a0 2024-09-17T01:50:53.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.442+0000 7f01bbe00640 1 -- 172.21.15.42:0/1653701471 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01bc0116c0 con 0x7f01c414e3a0 2024-09-17T01:50:53.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.442+0000 7f01cae00640 1 -- 172.21.15.42:0/1653701471 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01c40c8da0 con 0x7f01c414e3a0 2024-09-17T01:50:53.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.442+0000 7f01cae00640 1 -- 172.21.15.42:0/1653701471 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c41f9550 con 0x7f01c414e3a0 2024-09-17T01:50:53.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.443+0000 7f01cae00640 1 -- 172.21.15.42:0/1653701471 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f01c414df60 con 0x7f01c414e3a0 2024-09-17T01:50:53.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.444+0000 7f01bbe00640 1 -- 172.21.15.42:0/1653701471 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f01bc011860 con 0x7f01c414e3a0 2024-09-17T01:50:53.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.445+0000 7f01bbe00640 1 --2- 172.21.15.42:0/1653701471 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f01a4078b90 0x7f01a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:53.443 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.445+0000 7f01bbe00640 1 -- 172.21.15.42:0/1653701471 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7f01bc09af90 con 0x7f01c414e3a0 2024-09-17T01:50:53.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.445+0000 7f01bbe00640 1 --2- 172.21.15.42:0/1653701471 >> [v2:172.21.15.42:6816/2631717588,v1:172.21.15.42:6817/2631717588] conn(0x7f01a407eb40 0x7f01a4080f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:53.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.445+0000 7f01bbe00640 1 -- 172.21.15.42:0/1653701471 --> [v2:172.21.15.42:6816/2631717588,v1:172.21.15.42:6817/2631717588] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f01a4081660 con 0x7f01a407eb40 2024-09-17T01:50:53.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.445+0000 7f01bbe00640 1 -- 172.21.15.42:0/1653701471 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=230) ==== 24+0+0 (secure 0 0 0) 0x7f01bc0a2050 con 0x7f01c414e3a0 2024-09-17T01:50:53.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.445+0000 7f01c3e00640 1 --2- 172.21.15.42:0/1653701471 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f01a4078b90 0x7f01a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:53.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.446+0000 7f01c3400640 1 --2- 172.21.15.42:0/1653701471 >> [v2:172.21.15.42:6816/2631717588,v1:172.21.15.42:6817/2631717588] conn(0x7f01a407eb40 0x7f01a4080f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:53.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.446+0000 7f01c3400640 1 --2- 172.21.15.42:0/1653701471 >> [v2:172.21.15.42:6816/2631717588,v1:172.21.15.42:6817/2631717588] conn(0x7f01a407eb40 0x7f01a4080f90 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:53.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.446+0000 7f01c3e00640 1 --2- 172.21.15.42:0/1653701471 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f01a4078b90 0x7f01a407b0a0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f01b4035000 tx=0x7f01b402d040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:53.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.447+0000 7f01bbe00640 1 -- 172.21.15.42:0/1653701471 <== osd.2 v2:172.21.15.42:6816/2631717588 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f01a4081660 con 0x7f01a407eb40 2024-09-17T01:50:53.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.460+0000 7f01cae00640 1 -- 172.21.15.42:0/1653701471 --> [v2:172.21.15.42:6816/2631717588,v1:172.21.15.42:6817/2631717588] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f01c41f9020 con 0x7f01a407eb40 2024-09-17T01:50:53.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.461+0000 7f01bbe00640 1 -- 172.21.15.42:0/1653701471 <== osd.2 v2:172.21.15.42:6816/2631717588 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f01c41f9020 con 0x7f01a407eb40 2024-09-17T01:50:53.459 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:50:53.459 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T01:50:53.459 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:50:53.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.461+0000 7f01cae00640 1 -- 172.21.15.42:0/1653701471 >> [v2:172.21.15.42:6816/2631717588,v1:172.21.15.42:6817/2631717588] conn(0x7f01a407eb40 msgr2=0x7f01a4080f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:53.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.461+0000 7f01cae00640 1 --2- 172.21.15.42:0/1653701471 >> [v2:172.21.15.42:6816/2631717588,v1:172.21.15.42:6817/2631717588] conn(0x7f01a407eb40 0x7f01a4080f90 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:53.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.461+0000 7f01cae00640 1 -- 172.21.15.42:0/1653701471 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f01a4078b90 msgr2=0x7f01a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:53.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.461+0000 7f01cae00640 1 --2- 172.21.15.42:0/1653701471 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f01a4078b90 0x7f01a407b0a0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f01b4035000 tx=0x7f01b402d040 comp rx=0 tx=0).stop 2024-09-17T01:50:53.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.461+0000 7f01cae00640 1 -- 172.21.15.42:0/1653701471 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01c414e3a0 msgr2=0x7f01c414e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:53.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.461+0000 7f01cae00640 1 --2- 172.21.15.42:0/1653701471 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f01c414e3a0 0x7f01c414e7b0 secure :-1 s=READY pgs=2677 cs=0 l=1 rev1=1 crypto rx=0x7f01bc001330 tx=0x7f01bc00ed10 comp rx=0 tx=0).stop 2024-09-17T01:50:53.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.461+0000 7f01c8e00640 1 -- 172.21.15.42:0/1653701471 reap_dead start 2024-09-17T01:50:53.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.461+0000 7f01cae00640 1 -- 172.21.15.42:0/1653701471 shutdown_connections 2024-09-17T01:50:53.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.461+0000 7f01cae00640 1 -- 172.21.15.42:0/1653701471 >> 172.21.15.42:0/1653701471 conn(0x7f01c406d420 msgr2=0x7f01c40aea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:53.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.461+0000 7f01cae00640 1 -- 172.21.15.42:0/1653701471 shutdown_connections 2024-09-17T01:50:53.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.461+0000 7f01cae00640 1 -- 172.21.15.42:0/1653701471 wait complete. 2024-09-17T01:50:53.483 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-17T01:50:53.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.715+0000 7f6653e00640 1 -- 172.21.15.42:0/1789194758 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f665415c7b0 msgr2=0x7f665415efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:53.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.715+0000 7f6653e00640 1 --2- 172.21.15.42:0/1789194758 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f665415c7b0 0x7f665415efd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6644005fd0 tx=0x7f664402a540 comp rx=0 tx=0).stop 2024-09-17T01:50:53.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.715+0000 7f6653e00640 1 -- 172.21.15.42:0/1789194758 shutdown_connections 2024-09-17T01:50:53.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.715+0000 7f6653e00640 1 --2- 172.21.15.42:0/1789194758 >> v2:172.21.15.43:3300/0 conn(0x7f66540d2830 0x7f66540d2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:53.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.715+0000 7f6653e00640 1 --2- 172.21.15.42:0/1789194758 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f665415c7b0 0x7f665415efd0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:53.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.715+0000 7f6653e00640 1 -- 172.21.15.42:0/1789194758 >> 172.21.15.42:0/1789194758 conn(0x7f6654073de0 msgr2=0x7f665406cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:53.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.715+0000 7f6653e00640 1 -- 172.21.15.42:0/1789194758 shutdown_connections 2024-09-17T01:50:53.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.715+0000 7f6653e00640 1 -- 172.21.15.42:0/1789194758 wait complete. 2024-09-17T01:50:53.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.717+0000 7f6653e00640 1 Processor -- start 2024-09-17T01:50:53.715 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.718+0000 7f6653e00640 1 -- start start 2024-09-17T01:50:53.717 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.719+0000 7f6653e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66540d2830 0x7f66541f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:53.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.719+0000 7f6653e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f665415c7b0 0x7f66541f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:53.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.719+0000 7f6653e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f665415f510 0x7f66541f7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:53.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.719+0000 7f6653e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f66540d1300 con 0x7f66540d2830 2024-09-17T01:50:53.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.719+0000 7f6653e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f66540d1180 con 0x7f665415f510 2024-09-17T01:50:53.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.719+0000 7f6653e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f66540d1480 con 0x7f665415c7b0 2024-09-17T01:50:53.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.719+0000 7f6652a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66540d2830 0x7f66541f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:53.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.719+0000 7f6652a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66540d2830 0x7f66541f66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59260/0 (socket says 172.21.15.42:59260) 2024-09-17T01:50:53.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.719+0000 7f6652a00640 1 -- 172.21.15.42:0/1691801813 learned_addr learned my addr 172.21.15.42:0/1691801813 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:53.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.720+0000 7f664a000640 1 --2- 172.21.15.42:0/1691801813 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f665415c7b0 0x7f66541f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:53.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.720+0000 7f6653400640 1 --2- 172.21.15.42:0/1691801813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f665415f510 0x7f66541f7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:53.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.720+0000 7f6652a00640 1 -- 172.21.15.42:0/1691801813 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f665415c7b0 msgr2=0x7f66541f6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:53.718 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.720+0000 7f6652a00640 1 --2- 172.21.15.42:0/1691801813 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f665415c7b0 0x7f66541f6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:53.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.720+0000 7f6652a00640 1 -- 172.21.15.42:0/1691801813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f665415f510 msgr2=0x7f66541f7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:53.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.720+0000 7f6652a00640 1 --2- 172.21.15.42:0/1691801813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f665415f510 0x7f66541f7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:53.719 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.720+0000 7f6652a00640 1 -- 172.21.15.42:0/1691801813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66540cc680 con 0x7f66540d2830 2024-09-17T01:50:53.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.720+0000 7f6652a00640 1 --2- 172.21.15.42:0/1691801813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66540d2830 0x7f66541f66c0 secure :-1 s=READY pgs=2678 cs=0 l=1 rev1=1 crypto rx=0x7f6644000c00 tx=0x7f66440038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:53.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.720+0000 7f664be00640 1 -- 172.21.15.42:0/1691801813 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664403e030 con 0x7f66540d2830 2024-09-17T01:50:53.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.721+0000 7f664be00640 1 -- 172.21.15.42:0/1691801813 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6644003db0 con 0x7f66540d2830 2024-09-17T01:50:53.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.721+0000 7f6653e00640 1 -- 172.21.15.42:0/1691801813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66540cc960 con 0x7f66540d2830 2024-09-17T01:50:53.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.721+0000 7f664be00640 1 -- 172.21.15.42:0/1691801813 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6644035040 con 0x7f66540d2830 2024-09-17T01:50:53.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.721+0000 7f6653e00640 1 -- 172.21.15.42:0/1691801813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66540ccf20 con 0x7f66540d2830 2024-09-17T01:50:53.720 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.722+0000 7f6653e00640 1 -- 172.21.15.42:0/1691801813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66540d1930 con 0x7f66540d2830 2024-09-17T01:50:53.721 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.723+0000 7f664be00640 1 -- 172.21.15.42:0/1691801813 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6644041030 con 0x7f66540d2830 2024-09-17T01:50:53.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.725+0000 7f664be00640 1 --2- 172.21.15.42:0/1691801813 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6630078b90 0x7f663007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:53.722 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.725+0000 7f664be00640 1 -- 172.21.15.42:0/1691801813 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7f66440bb2a0 con 0x7f66540d2830 2024-09-17T01:50:53.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.725+0000 7f664a000640 1 --2- 172.21.15.42:0/1691801813 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6630078b90 0x7f663007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:53.723 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.726+0000 7f664a000640 1 --2- 172.21.15.42:0/1691801813 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6630078b90 0x7f663007b0a0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f66540b9ee0 tx=0x7f663c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:53.727 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.729+0000 7f664be00640 1 -- 172.21.15.42:0/1691801813 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6644083860 con 0x7f66540d2830 2024-09-17T01:50:53.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.925+0000 7f6653e00640 1 -- 172.21.15.42:0/1691801813 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f66540b6f00 con 0x7f6630078b90 2024-09-17T01:50:53.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.926+0000 7f664be00640 1 -- 172.21.15.42:0/1691801813 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f66540b6f00 con 0x7f6630078b90 2024-09-17T01:50:53.923 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 2 to deep-scrub 2024-09-17T01:50:53.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.929+0000 7f6653e00640 1 -- 172.21.15.42:0/1691801813 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6630078b90 msgr2=0x7f663007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:53.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.930+0000 7f6653e00640 1 --2- 172.21.15.42:0/1691801813 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6630078b90 0x7f663007b0a0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f66540b9ee0 tx=0x7f663c009040 comp rx=0 tx=0).stop 2024-09-17T01:50:53.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.930+0000 7f6653e00640 1 -- 172.21.15.42:0/1691801813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66540d2830 msgr2=0x7f66541f66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:53.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.930+0000 7f6653e00640 1 --2- 172.21.15.42:0/1691801813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66540d2830 0x7f66541f66c0 secure :-1 s=READY pgs=2678 cs=0 l=1 rev1=1 crypto rx=0x7f6644000c00 tx=0x7f66440038a0 comp rx=0 tx=0).stop 2024-09-17T01:50:53.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.930+0000 7f6653e00640 1 -- 172.21.15.42:0/1691801813 shutdown_connections 2024-09-17T01:50:53.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.930+0000 7f6653e00640 1 --2- 172.21.15.42:0/1691801813 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f6630078b90 0x7f663007b0a0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:53.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.930+0000 7f6653e00640 1 --2- 172.21.15.42:0/1691801813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f665415f510 0x7f66541f7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:53.928 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.930+0000 7f6653e00640 1 --2- 172.21.15.42:0/1691801813 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f665415c7b0 0x7f66541f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:53.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.930+0000 7f6653e00640 1 --2- 172.21.15.42:0/1691801813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f66540d2830 0x7f66541f66c0 unknown :-1 s=CLOSED pgs=2678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:53.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.930+0000 7f6653e00640 1 -- 172.21.15.42:0/1691801813 >> 172.21.15.42:0/1691801813 conn(0x7f6654073de0 msgr2=0x7f66540b8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:53.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.930+0000 7f6653e00640 1 -- 172.21.15.42:0/1691801813 shutdown_connections 2024-09-17T01:50:53.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:53.930+0000 7f6653e00640 1 -- 172.21.15.42:0/1691801813 wait complete. 2024-09-17T01:50:53.957 INFO:tasks.ceph:Scrubbing osd.3 2024-09-17T01:50:53.957 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-17T01:50:54.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.192+0000 7fc191a00640 1 -- 172.21.15.42:0/783745355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc170004800 msgr2=0x7fc170004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:54.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.192+0000 7fc191a00640 1 --2- 172.21.15.42:0/783745355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc170004800 0x7fc170004c10 secure :-1 s=READY pgs=2680 cs=0 l=1 rev1=1 crypto rx=0x7fc17400c290 tx=0x7fc170005830 comp rx=0 tx=0).stop 2024-09-17T01:50:54.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.192+0000 7fc191000640 1 -- 172.21.15.42:0/783745355 reap_dead start 2024-09-17T01:50:54.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.192+0000 7fc191a00640 1 -- 172.21.15.42:0/783745355 shutdown_connections 2024-09-17T01:50:54.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.192+0000 7fc191a00640 1 -- 172.21.15.42:0/783745355 >> 172.21.15.42:0/783745355 conn(0x7fc18c0b4220 msgr2=0x7fc18c0b4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:54.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.192+0000 7fc191a00640 1 -- 172.21.15.42:0/783745355 shutdown_connections 2024-09-17T01:50:54.191 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.192+0000 7fc191a00640 1 -- 172.21.15.42:0/783745355 wait complete. 2024-09-17T01:50:54.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.194+0000 7fc191a00640 1 Processor -- start 2024-09-17T01:50:54.192 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.194+0000 7fc191a00640 1 -- start start 2024-09-17T01:50:54.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.196+0000 7fc191a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc170004800 0x7fc18c1f9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:54.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.196+0000 7fc191a00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc18c1f5810 0x7fc18c0c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:54.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.196+0000 7fc191a00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc18c0cf670 0x7fc18c06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:54.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.196+0000 7fc191a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c160260 con 0x7fc170004800 2024-09-17T01:50:54.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.196+0000 7fc191a00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c0b8050 con 0x7fc18c0cf670 2024-09-17T01:50:54.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.196+0000 7fc191a00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc18c1603e0 con 0x7fc18c1f5810 2024-09-17T01:50:54.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.196+0000 7fc18be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc170004800 0x7fc18c1f9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:54.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.196+0000 7fc18be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc170004800 0x7fc18c1f9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59284/0 (socket says 172.21.15.42:59284) 2024-09-17T01:50:54.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.196+0000 7fc18be00640 1 -- 172.21.15.42:0/1991968209 learned_addr learned my addr 172.21.15.42:0/1991968209 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:54.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.196+0000 7fc191000640 1 --2- 172.21.15.42:0/1991968209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc18c0cf670 0x7fc18c06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:54.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.196+0000 7fc183400640 1 --2- 172.21.15.42:0/1991968209 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc18c1f5810 0x7fc18c0c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:54.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.197+0000 7fc18be00640 1 -- 172.21.15.42:0/1991968209 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc18c1f5810 msgr2=0x7fc18c0c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:54.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.197+0000 7fc18be00640 1 --2- 172.21.15.42:0/1991968209 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc18c1f5810 0x7fc18c0c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:54.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.197+0000 7fc18be00640 1 -- 172.21.15.42:0/1991968209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc18c0cf670 msgr2=0x7fc18c06d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:54.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.197+0000 7fc18be00640 1 --2- 172.21.15.42:0/1991968209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc18c0cf670 0x7fc18c06d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:54.195 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.197+0000 7fc18be00640 1 -- 172.21.15.42:0/1991968209 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc18c1f60b0 con 0x7fc170004800 2024-09-17T01:50:54.196 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.197+0000 7fc183400640 1 --2- 172.21.15.42:0/1991968209 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc18c1f5810 0x7fc18c0c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:54.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.197+0000 7fc18be00640 1 --2- 172.21.15.42:0/1991968209 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc170004800 0x7fc18c1f9a20 secure :-1 s=READY pgs=2681 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0118d0 tx=0x7fc17c011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:54.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.197+0000 7fc188c00640 1 -- 172.21.15.42:0/1991968209 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc17c01e070 con 0x7fc170004800 2024-09-17T01:50:54.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.197+0000 7fc188c00640 1 -- 172.21.15.42:0/1991968209 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc17c00fbb0 con 0x7fc170004800 2024-09-17T01:50:54.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.197+0000 7fc191a00640 1 -- 172.21.15.42:0/1991968209 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc18c1f6390 con 0x7fc170004800 2024-09-17T01:50:54.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.197+0000 7fc188c00640 1 -- 172.21.15.42:0/1991968209 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc17c019410 con 0x7fc170004800 2024-09-17T01:50:54.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.197+0000 7fc191a00640 1 -- 172.21.15.42:0/1991968209 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc18c06cfd0 con 0x7fc170004800 2024-09-17T01:50:54.197 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.199+0000 7fc191a00640 1 -- 172.21.15.42:0/1991968209 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc18c06cdc0 con 0x7fc170004800 2024-09-17T01:50:54.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.200+0000 7fc188c00640 1 -- 172.21.15.42:0/1991968209 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc17c021070 con 0x7fc170004800 2024-09-17T01:50:54.198 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.201+0000 7fc188c00640 1 --2- 172.21.15.42:0/1991968209 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc168078bc0 0x7fc16807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:54.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.201+0000 7fc188c00640 1 -- 172.21.15.42:0/1991968209 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7fc17c09b1b0 con 0x7fc170004800 2024-09-17T01:50:54.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.201+0000 7fc188c00640 1 --2- 172.21.15.42:0/1991968209 >> [v2:172.21.15.42:6808/940657160,v1:172.21.15.42:6809/940657160] conn(0x7fc16807eb70 0x7fc168080fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:54.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.201+0000 7fc188c00640 1 -- 172.21.15.42:0/1991968209 --> [v2:172.21.15.42:6808/940657160,v1:172.21.15.42:6809/940657160] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc17c022e50 con 0x7fc16807eb70 2024-09-17T01:50:54.199 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.201+0000 7fc188c00640 1 -- 172.21.15.42:0/1991968209 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=230) ==== 24+0+0 (secure 0 0 0) 0x7fc17c0a2050 con 0x7fc170004800 2024-09-17T01:50:54.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.201+0000 7fc191000640 1 --2- 172.21.15.42:0/1991968209 >> [v2:172.21.15.42:6808/940657160,v1:172.21.15.42:6809/940657160] conn(0x7fc16807eb70 0x7fc168080fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:54.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.201+0000 7fc183400640 1 --2- 172.21.15.42:0/1991968209 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc168078bc0 0x7fc16807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:54.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.202+0000 7fc191000640 1 --2- 172.21.15.42:0/1991968209 >> [v2:172.21.15.42:6808/940657160,v1:172.21.15.42:6809/940657160] conn(0x7fc16807eb70 0x7fc168080fc0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:54.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.202+0000 7fc183400640 1 --2- 172.21.15.42:0/1991968209 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc168078bc0 0x7fc16807b0d0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fc17400c290 tx=0x7fc17402d000 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:54.200 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.203+0000 7fc188c00640 1 -- 172.21.15.42:0/1991968209 <== osd.3 v2:172.21.15.42:6808/940657160 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc17c022e50 con 0x7fc16807eb70 2024-09-17T01:50:54.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.216+0000 7fc191a00640 1 -- 172.21.15.42:0/1991968209 --> [v2:172.21.15.42:6808/940657160,v1:172.21.15.42:6809/940657160] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc18c0b62d0 con 0x7fc16807eb70 2024-09-17T01:50:54.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.216+0000 7fc188c00640 1 -- 172.21.15.42:0/1991968209 <== osd.3 v2:172.21.15.42:6808/940657160 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc18c0b62d0 con 0x7fc16807eb70 2024-09-17T01:50:54.214 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:50:54.214 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T01:50:54.215 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:50:54.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.217+0000 7fc191a00640 1 -- 172.21.15.42:0/1991968209 >> [v2:172.21.15.42:6808/940657160,v1:172.21.15.42:6809/940657160] conn(0x7fc16807eb70 msgr2=0x7fc168080fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:54.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.217+0000 7fc191a00640 1 --2- 172.21.15.42:0/1991968209 >> [v2:172.21.15.42:6808/940657160,v1:172.21.15.42:6809/940657160] conn(0x7fc16807eb70 0x7fc168080fc0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:54.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.217+0000 7fc191a00640 1 -- 172.21.15.42:0/1991968209 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc168078bc0 msgr2=0x7fc16807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:54.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.217+0000 7fc191a00640 1 --2- 172.21.15.42:0/1991968209 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc168078bc0 0x7fc16807b0d0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fc17400c290 tx=0x7fc17402d000 comp rx=0 tx=0).stop 2024-09-17T01:50:54.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.217+0000 7fc191a00640 1 -- 172.21.15.42:0/1991968209 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc170004800 msgr2=0x7fc18c1f9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:54.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.217+0000 7fc191a00640 1 --2- 172.21.15.42:0/1991968209 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc170004800 0x7fc18c1f9a20 secure :-1 s=READY pgs=2681 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0118d0 tx=0x7fc17c011d90 comp rx=0 tx=0).stop 2024-09-17T01:50:54.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.217+0000 7fc191000640 1 -- 172.21.15.42:0/1991968209 reap_dead start 2024-09-17T01:50:54.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.217+0000 7fc191a00640 1 -- 172.21.15.42:0/1991968209 shutdown_connections 2024-09-17T01:50:54.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.217+0000 7fc191a00640 1 -- 172.21.15.42:0/1991968209 >> 172.21.15.42:0/1991968209 conn(0x7fc18c0b4220 msgr2=0x7fc18c15c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:54.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.217+0000 7fc191a00640 1 -- 172.21.15.42:0/1991968209 shutdown_connections 2024-09-17T01:50:54.216 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.217+0000 7fc191a00640 1 -- 172.21.15.42:0/1991968209 wait complete. 2024-09-17T01:50:54.236 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-17T01:50:54.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.466+0000 7f7103e00640 1 -- 172.21.15.42:0/2213599801 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71040709b0 msgr2=0x7f71040b4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:54.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.466+0000 7f7103e00640 1 --2- 172.21.15.42:0/2213599801 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71040709b0 0x7f71040b4630 secure :-1 s=READY pgs=2683 cs=0 l=1 rev1=1 crypto rx=0x7f70fc005fd0 tx=0x7f70fc02aa10 comp rx=0 tx=0).stop 2024-09-17T01:50:54.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.466+0000 7f7103e00640 1 -- 172.21.15.42:0/2213599801 shutdown_connections 2024-09-17T01:50:54.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.466+0000 7f7103e00640 1 --2- 172.21.15.42:0/2213599801 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71040709b0 0x7f71040b4630 unknown :-1 s=CLOSED pgs=2683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:54.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.466+0000 7f7103e00640 1 --2- 172.21.15.42:0/2213599801 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f71040b58c0 0x7f710415b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:54.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.466+0000 7f7103e00640 1 -- 172.21.15.42:0/2213599801 >> 172.21.15.42:0/2213599801 conn(0x7f71040d1580 msgr2=0x7f71040d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:54.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.466+0000 7f7103e00640 1 -- 172.21.15.42:0/2213599801 shutdown_connections 2024-09-17T01:50:54.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.466+0000 7f7103e00640 1 -- 172.21.15.42:0/2213599801 wait complete. 2024-09-17T01:50:54.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.469+0000 7f7103e00640 1 Processor -- start 2024-09-17T01:50:54.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.469+0000 7f7103e00640 1 -- start start 2024-09-17T01:50:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.470+0000 7f7103e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f71040709b0 0x7f7104156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.470+0000 7f7103e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71040ce6f0 0x7f7104155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.470+0000 7f7103e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71040ae890 0x7f71040ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.470+0000 7f7103e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f710406dd90 con 0x7f71040ae890 2024-09-17T01:50:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.470+0000 7f7103e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f710406dc10 con 0x7f71040ce6f0 2024-09-17T01:50:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.470+0000 7f7103e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f710406df10 con 0x7f71040709b0 2024-09-17T01:50:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.470+0000 7f7103400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71040ae890 0x7f71040ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.471+0000 7f7103400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71040ae890 0x7f71040ceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59306/0 (socket says 172.21.15.42:59306) 2024-09-17T01:50:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.471+0000 7f7103400640 1 -- 172.21.15.42:0/1098194371 learned_addr learned my addr 172.21.15.42:0/1098194371 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.471+0000 7f7102000640 1 --2- 172.21.15.42:0/1098194371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71040ce6f0 0x7f7104155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:54.469 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.471+0000 7f7102a00640 1 --2- 172.21.15.42:0/1098194371 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f71040709b0 0x7f7104156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:54.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.471+0000 7f7103400640 1 -- 172.21.15.42:0/1098194371 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f71040709b0 msgr2=0x7f7104156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:54.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.471+0000 7f7103400640 1 --2- 172.21.15.42:0/1098194371 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f71040709b0 0x7f7104156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:54.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.471+0000 7f7103400640 1 -- 172.21.15.42:0/1098194371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71040ce6f0 msgr2=0x7f7104155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:54.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.471+0000 7f7103400640 1 --2- 172.21.15.42:0/1098194371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71040ce6f0 0x7f7104155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:54.470 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.471+0000 7f7103400640 1 -- 172.21.15.42:0/1098194371 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71040af480 con 0x7f71040ae890 2024-09-17T01:50:54.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.471+0000 7f7103400640 1 --2- 172.21.15.42:0/1098194371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71040ae890 0x7f71040ceb00 secure :-1 s=READY pgs=2684 cs=0 l=1 rev1=1 crypto rx=0x7f70fc009d90 tx=0x7f70fc003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:54.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.472+0000 7f70faa00640 1 -- 172.21.15.42:0/1098194371 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc033050 con 0x7f71040ae890 2024-09-17T01:50:54.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.472+0000 7f70faa00640 1 -- 172.21.15.42:0/1098194371 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70fc004450 con 0x7f71040ae890 2024-09-17T01:50:54.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.472+0000 7f7103e00640 1 -- 172.21.15.42:0/1098194371 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71040af760 con 0x7f71040ae890 2024-09-17T01:50:54.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.472+0000 7f70faa00640 1 -- 172.21.15.42:0/1098194371 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc038450 con 0x7f71040ae890 2024-09-17T01:50:54.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.472+0000 7f7103e00640 1 -- 172.21.15.42:0/1098194371 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7104156680 con 0x7f71040ae890 2024-09-17T01:50:54.471 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.473+0000 7f7103e00640 1 -- 172.21.15.42:0/1098194371 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71040af1f0 con 0x7f71040ae890 2024-09-17T01:50:54.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.474+0000 7f70faa00640 1 -- 172.21.15.42:0/1098194371 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f70fc036070 con 0x7f71040ae890 2024-09-17T01:50:54.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.475+0000 7f70faa00640 1 --2- 172.21.15.42:0/1098194371 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f70e4078b90 0x7f70e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:54.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.475+0000 7f70faa00640 1 -- 172.21.15.42:0/1098194371 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7f70fc0bbed0 con 0x7f71040ae890 2024-09-17T01:50:54.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.476+0000 7f7102a00640 1 --2- 172.21.15.42:0/1098194371 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f70e4078b90 0x7f70e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:54.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.476+0000 7f7102a00640 1 --2- 172.21.15.42:0/1098194371 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f70e4078b90 0x7f70e407b0a0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f70f4001720 tx=0x7f70f4009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:54.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.479+0000 7f70faa00640 1 -- 172.21.15.42:0/1098194371 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f70fc083e40 con 0x7f71040ae890 2024-09-17T01:50:54.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.674+0000 7f7103e00640 1 -- 172.21.15.42:0/1098194371 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f710406e3c0 con 0x7f70e4078b90 2024-09-17T01:50:54.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.675+0000 7f70faa00640 1 -- 172.21.15.42:0/1098194371 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f710406e3c0 con 0x7f70e4078b90 2024-09-17T01:50:54.672 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 3 to deep-scrub 2024-09-17T01:50:54.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.677+0000 7f7103e00640 1 -- 172.21.15.42:0/1098194371 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f70e4078b90 msgr2=0x7f70e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:54.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.677+0000 7f7103e00640 1 --2- 172.21.15.42:0/1098194371 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f70e4078b90 0x7f70e407b0a0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f70f4001720 tx=0x7f70f4009040 comp rx=0 tx=0).stop 2024-09-17T01:50:54.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.677+0000 7f7103e00640 1 -- 172.21.15.42:0/1098194371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71040ae890 msgr2=0x7f71040ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:54.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.677+0000 7f7103e00640 1 --2- 172.21.15.42:0/1098194371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71040ae890 0x7f71040ceb00 secure :-1 s=READY pgs=2684 cs=0 l=1 rev1=1 crypto rx=0x7f70fc009d90 tx=0x7f70fc003f10 comp rx=0 tx=0).stop 2024-09-17T01:50:54.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.677+0000 7f7103e00640 1 -- 172.21.15.42:0/1098194371 shutdown_connections 2024-09-17T01:50:54.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.677+0000 7f7103e00640 1 --2- 172.21.15.42:0/1098194371 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f70e4078b90 0x7f70e407b0a0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:54.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.677+0000 7f7103e00640 1 --2- 172.21.15.42:0/1098194371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71040ce6f0 0x7f7104155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:54.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.677+0000 7f7103e00640 1 --2- 172.21.15.42:0/1098194371 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71040ae890 0x7f71040ceb00 unknown :-1 s=CLOSED pgs=2684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:54.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.677+0000 7f7103e00640 1 --2- 172.21.15.42:0/1098194371 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f71040709b0 0x7f7104156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:54.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.677+0000 7f7103e00640 1 -- 172.21.15.42:0/1098194371 >> 172.21.15.42:0/1098194371 conn(0x7f71040d1580 msgr2=0x7f7104068fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:54.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.677+0000 7f7103e00640 1 -- 172.21.15.42:0/1098194371 shutdown_connections 2024-09-17T01:50:54.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.677+0000 7f7103e00640 1 -- 172.21.15.42:0/1098194371 wait complete. 2024-09-17T01:50:54.698 INFO:tasks.ceph:Scrubbing osd.4 2024-09-17T01:50:54.698 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-17T01:50:54.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.932+0000 7f899f200640 1 -- 172.21.15.42:0/2162649843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89a00cd860 msgr2=0x7f89a00afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:54.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.932+0000 7f899f200640 1 --2- 172.21.15.42:0/2162649843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89a00cd860 0x7f89a00afb90 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f8990009860 tx=0x7f899002a4f0 comp rx=0 tx=0).stop 2024-09-17T01:50:54.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.932+0000 7f899f200640 1 -- 172.21.15.42:0/2162649843 shutdown_connections 2024-09-17T01:50:54.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.932+0000 7f899f200640 1 --2- 172.21.15.42:0/2162649843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89a00cd860 0x7f89a00afb90 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:54.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.932+0000 7f899f200640 1 -- 172.21.15.42:0/2162649843 >> 172.21.15.42:0/2162649843 conn(0x7f89a006cfa0 msgr2=0x7f89a006d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:54.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.932+0000 7f899f200640 1 -- 172.21.15.42:0/2162649843 shutdown_connections 2024-09-17T01:50:54.931 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.932+0000 7f899f200640 1 -- 172.21.15.42:0/2162649843 wait complete. 2024-09-17T01:50:54.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.934+0000 7f899f200640 1 Processor -- start 2024-09-17T01:50:54.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.934+0000 7f899f200640 1 -- start start 2024-09-17T01:50:54.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.936+0000 7f899f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89a00cd860 0x7f89a014ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:54.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.936+0000 7f899f200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f89a0145a70 0x7f89a013c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:54.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.936+0000 7f899f200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89a013cdb0 0x7f89a01e8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:54.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.936+0000 7f899f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f89a0073b00 con 0x7f89a00cd860 2024-09-17T01:50:54.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.936+0000 7f899f200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f89a0073980 con 0x7f89a013cdb0 2024-09-17T01:50:54.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.936+0000 7f899f200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f89a0073c80 con 0x7f89a0145a70 2024-09-17T01:50:54.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.936+0000 7f899de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89a00cd860 0x7f89a014ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:54.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.936+0000 7f899de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89a00cd860 0x7f89a014ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59316/0 (socket says 172.21.15.42:59316) 2024-09-17T01:50:54.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.936+0000 7f899de00640 1 -- 172.21.15.42:0/3188007942 learned_addr learned my addr 172.21.15.42:0/3188007942 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:54.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.936+0000 7f899d400640 1 --2- 172.21.15.42:0/3188007942 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f89a0145a70 0x7f89a013c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:54.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.936+0000 7f899e800640 1 --2- 172.21.15.42:0/3188007942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89a013cdb0 0x7f89a01e8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:54.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.937+0000 7f899de00640 1 -- 172.21.15.42:0/3188007942 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f89a0145a70 msgr2=0x7f89a013c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:54.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.937+0000 7f899de00640 1 --2- 172.21.15.42:0/3188007942 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f89a0145a70 0x7f89a013c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:54.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.937+0000 7f899de00640 1 -- 172.21.15.42:0/3188007942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89a013cdb0 msgr2=0x7f89a01e8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:54.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.937+0000 7f899de00640 1 --2- 172.21.15.42:0/3188007942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89a013cdb0 0x7f89a01e8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:54.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.937+0000 7f899de00640 1 -- 172.21.15.42:0/3188007942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a015cdb0 con 0x7f89a00cd860 2024-09-17T01:50:54.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.937+0000 7f899de00640 1 --2- 172.21.15.42:0/3188007942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89a00cd860 0x7f89a014ed70 secure :-1 s=READY pgs=2686 cs=0 l=1 rev1=1 crypto rx=0x7f899002aae0 tx=0x7f89900038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:54.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.937+0000 7f8996000640 1 -- 172.21.15.42:0/3188007942 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8990005c90 con 0x7f89a00cd860 2024-09-17T01:50:54.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.937+0000 7f8996000640 1 -- 172.21.15.42:0/3188007942 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8990005020 con 0x7f89a00cd860 2024-09-17T01:50:54.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.937+0000 7f8996000640 1 -- 172.21.15.42:0/3188007942 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8990003ea0 con 0x7f89a00cd860 2024-09-17T01:50:54.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.937+0000 7f899f200640 1 -- 172.21.15.42:0/3188007942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a01e9830 con 0x7f89a00cd860 2024-09-17T01:50:54.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.937+0000 7f899f200640 1 -- 172.21.15.42:0/3188007942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a01e9df0 con 0x7f89a00cd860 2024-09-17T01:50:54.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.938+0000 7f899f200640 1 -- 172.21.15.42:0/3188007942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f89a00afb90 con 0x7f89a00cd860 2024-09-17T01:50:54.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.940+0000 7f8996000640 1 -- 172.21.15.42:0/3188007942 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8990005470 con 0x7f89a00cd860 2024-09-17T01:50:54.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.941+0000 7f8996000640 1 --2- 172.21.15.42:0/3188007942 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8980078bc0 0x7f898007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:54.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.941+0000 7f8996000640 1 -- 172.21.15.42:0/3188007942 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7f89900bbc50 con 0x7f89a00cd860 2024-09-17T01:50:54.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.941+0000 7f8996000640 1 --2- 172.21.15.42:0/3188007942 >> [v2:172.21.15.43:6818/3453529013,v1:172.21.15.43:6819/3453529013] conn(0x7f898007eb70 0x7f8980080fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:54.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.941+0000 7f8996000640 1 -- 172.21.15.42:0/3188007942 --> [v2:172.21.15.43:6818/3453529013,v1:172.21.15.43:6819/3453529013] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8980081690 con 0x7f898007eb70 2024-09-17T01:50:54.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.941+0000 7f8996000640 1 -- 172.21.15.42:0/3188007942 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=230) ==== 24+0+0 (secure 0 0 0) 0x7f89900bc0b0 con 0x7f89a00cd860 2024-09-17T01:50:54.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.942+0000 7f899d400640 1 --2- 172.21.15.42:0/3188007942 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8980078bc0 0x7f898007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:54.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.942+0000 7f899e800640 1 --2- 172.21.15.42:0/3188007942 >> [v2:172.21.15.43:6818/3453529013,v1:172.21.15.43:6819/3453529013] conn(0x7f898007eb70 0x7f8980080fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:54.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.942+0000 7f899d400640 1 --2- 172.21.15.42:0/3188007942 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8980078bc0 0x7f898007b0d0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f89a01eb520 tx=0x7f898c009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:54.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.943+0000 7f899e800640 1 --2- 172.21.15.42:0/3188007942 >> [v2:172.21.15.43:6818/3453529013,v1:172.21.15.43:6819/3453529013] conn(0x7f898007eb70 0x7f8980080fc0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:54.942 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.943+0000 7f8996000640 1 -- 172.21.15.42:0/3188007942 <== osd.4 v2:172.21.15.43:6818/3453529013 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8980081690 con 0x7f898007eb70 2024-09-17T01:50:54.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.957+0000 7f899f200640 1 -- 172.21.15.42:0/3188007942 --> [v2:172.21.15.43:6818/3453529013,v1:172.21.15.43:6819/3453529013] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f89a00761e0 con 0x7f898007eb70 2024-09-17T01:50:54.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.957+0000 7f8996000640 1 -- 172.21.15.42:0/3188007942 <== osd.4 v2:172.21.15.43:6818/3453529013 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f89a00761e0 con 0x7f898007eb70 2024-09-17T01:50:54.955 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:50:54.955 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T01:50:54.955 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:50:54.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.958+0000 7f899f200640 1 -- 172.21.15.42:0/3188007942 >> [v2:172.21.15.43:6818/3453529013,v1:172.21.15.43:6819/3453529013] conn(0x7f898007eb70 msgr2=0x7f8980080fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:54.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.958+0000 7f899f200640 1 --2- 172.21.15.42:0/3188007942 >> [v2:172.21.15.43:6818/3453529013,v1:172.21.15.43:6819/3453529013] conn(0x7f898007eb70 0x7f8980080fc0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:54.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.958+0000 7f899f200640 1 -- 172.21.15.42:0/3188007942 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8980078bc0 msgr2=0x7f898007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:54.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.958+0000 7f899f200640 1 --2- 172.21.15.42:0/3188007942 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f8980078bc0 0x7f898007b0d0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f89a01eb520 tx=0x7f898c009040 comp rx=0 tx=0).stop 2024-09-17T01:50:54.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.958+0000 7f899f200640 1 -- 172.21.15.42:0/3188007942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89a00cd860 msgr2=0x7f89a014ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:54.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.958+0000 7f899f200640 1 --2- 172.21.15.42:0/3188007942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89a00cd860 0x7f89a014ed70 secure :-1 s=READY pgs=2686 cs=0 l=1 rev1=1 crypto rx=0x7f899002aae0 tx=0x7f89900038a0 comp rx=0 tx=0).stop 2024-09-17T01:50:54.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.958+0000 7f899e800640 1 -- 172.21.15.42:0/3188007942 reap_dead start 2024-09-17T01:50:54.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.958+0000 7f899f200640 1 -- 172.21.15.42:0/3188007942 shutdown_connections 2024-09-17T01:50:54.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.958+0000 7f899f200640 1 -- 172.21.15.42:0/3188007942 >> 172.21.15.42:0/3188007942 conn(0x7f89a006cfa0 msgr2=0x7f89a00b13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:54.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.958+0000 7f899f200640 1 -- 172.21.15.42:0/3188007942 shutdown_connections 2024-09-17T01:50:54.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:54.958+0000 7f899f200640 1 -- 172.21.15.42:0/3188007942 wait complete. 2024-09-17T01:50:54.978 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-17T01:50:55.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.207+0000 7ff94d600640 1 -- 172.21.15.42:0/3620487268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9481605c0 msgr2=0x7ff9481609d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:55.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.207+0000 7ff94d600640 1 --2- 172.21.15.42:0/3620487268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9481605c0 0x7ff9481609d0 secure :-1 s=READY pgs=2687 cs=0 l=1 rev1=1 crypto rx=0x7ff948072250 tx=0x7ff94002aa30 comp rx=0 tx=0).stop 2024-09-17T01:50:55.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.208+0000 7ff94d600640 1 -- 172.21.15.42:0/3620487268 shutdown_connections 2024-09-17T01:50:55.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.208+0000 7ff94d600640 1 --2- 172.21.15.42:0/3620487268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9481605c0 0x7ff9481609d0 unknown :-1 s=CLOSED pgs=2687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:55.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.208+0000 7ff94d600640 1 --2- 172.21.15.42:0/3620487268 >> v2:172.21.15.43:3300/0 conn(0x7ff9480b51d0 0x7ff9480b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:55.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.208+0000 7ff94d600640 1 -- 172.21.15.42:0/3620487268 >> 172.21.15.42:0/3620487268 conn(0x7ff94806d3f0 msgr2=0x7ff9480b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:55.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.208+0000 7ff94d600640 1 -- 172.21.15.42:0/3620487268 shutdown_connections 2024-09-17T01:50:55.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.208+0000 7ff94d600640 1 -- 172.21.15.42:0/3620487268 wait complete. 2024-09-17T01:50:55.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.210+0000 7ff94d600640 1 Processor -- start 2024-09-17T01:50:55.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.210+0000 7ff94d600640 1 -- start start 2024-09-17T01:50:55.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.211+0000 7ff94d600640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9480afb00 0x7ff94815c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:55.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.211+0000 7ff94d600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9480b51d0 0x7ff948157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:55.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.211+0000 7ff94d600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9481605c0 0x7ff948144d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:55.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.211+0000 7ff94d600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff9480ce4f0 con 0x7ff9480b51d0 2024-09-17T01:50:55.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.211+0000 7ff94d600640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff9480ce370 con 0x7ff9481605c0 2024-09-17T01:50:55.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.211+0000 7ff94d600640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7ff9480ce670 con 0x7ff9480afb00 2024-09-17T01:50:55.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.212+0000 7ff93fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9480b51d0 0x7ff948157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:55.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.212+0000 7ff93fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9480b51d0 0x7ff948157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59328/0 (socket says 172.21.15.42:59328) 2024-09-17T01:50:55.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.212+0000 7ff93fe00640 1 -- 172.21.15.42:0/4290355201 learned_addr learned my addr 172.21.15.42:0/4290355201 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:55.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.212+0000 7ff947e00640 1 --2- 172.21.15.42:0/4290355201 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9480afb00 0x7ff94815c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:55.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.212+0000 7ff94cc00640 1 --2- 172.21.15.42:0/4290355201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9481605c0 0x7ff948144d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:55.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.212+0000 7ff93fe00640 1 -- 172.21.15.42:0/4290355201 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9480afb00 msgr2=0x7ff94815c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:55.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.212+0000 7ff93fe00640 1 --2- 172.21.15.42:0/4290355201 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9480afb00 0x7ff94815c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:55.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.212+0000 7ff93fe00640 1 -- 172.21.15.42:0/4290355201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9481605c0 msgr2=0x7ff948144d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:55.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.212+0000 7ff93fe00640 1 --2- 172.21.15.42:0/4290355201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9481605c0 0x7ff948144d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:55.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.212+0000 7ff93fe00640 1 -- 172.21.15.42:0/4290355201 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9481f7100 con 0x7ff9480b51d0 2024-09-17T01:50:55.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.212+0000 7ff947e00640 1 --2- 172.21.15.42:0/4290355201 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9480afb00 0x7ff94815c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:55.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.213+0000 7ff93fe00640 1 --2- 172.21.15.42:0/4290355201 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9480b51d0 0x7ff948157690 secure :-1 s=READY pgs=2688 cs=0 l=1 rev1=1 crypto rx=0x7ff93000e790 tx=0x7ff93000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:55.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.213+0000 7ff944c00640 1 -- 172.21.15.42:0/4290355201 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93000eea0 con 0x7ff9480b51d0 2024-09-17T01:50:55.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.213+0000 7ff944c00640 1 -- 172.21.15.42:0/4290355201 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff93000cdb0 con 0x7ff9480b51d0 2024-09-17T01:50:55.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.213+0000 7ff944c00640 1 -- 172.21.15.42:0/4290355201 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff930010690 con 0x7ff9480b51d0 2024-09-17T01:50:55.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.213+0000 7ff94d600640 1 -- 172.21.15.42:0/4290355201 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9481f73e0 con 0x7ff9480b51d0 2024-09-17T01:50:55.212 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.213+0000 7ff94d600640 1 -- 172.21.15.42:0/4290355201 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff948157bd0 con 0x7ff9480b51d0 2024-09-17T01:50:55.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.214+0000 7ff94d600640 1 -- 172.21.15.42:0/4290355201 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9480b55e0 con 0x7ff9480b51d0 2024-09-17T01:50:55.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.215+0000 7ff944c00640 1 -- 172.21.15.42:0/4290355201 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff930010830 con 0x7ff9480b51d0 2024-09-17T01:50:55.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.216+0000 7ff944c00640 1 --2- 172.21.15.42:0/4290355201 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff924078b90 0x7ff92407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:55.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.216+0000 7ff944c00640 1 -- 172.21.15.42:0/4290355201 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7ff93009b480 con 0x7ff9480b51d0 2024-09-17T01:50:55.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.217+0000 7ff947e00640 1 --2- 172.21.15.42:0/4290355201 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff924078b90 0x7ff92407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:55.215 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.217+0000 7ff947e00640 1 --2- 172.21.15.42:0/4290355201 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff924078b90 0x7ff92407b0a0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7ff938007fd0 tx=0x7ff938009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:55.218 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.221+0000 7ff944c00640 1 -- 172.21.15.42:0/4290355201 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff930063480 con 0x7ff9480b51d0 2024-09-17T01:50:55.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.413+0000 7ff94d600640 1 -- 172.21.15.42:0/4290355201 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7ff9481f6e90 con 0x7ff924078b90 2024-09-17T01:50:55.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.414+0000 7ff944c00640 1 -- 172.21.15.42:0/4290355201 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff9481f6e90 con 0x7ff924078b90 2024-09-17T01:50:55.412 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 4 to deep-scrub 2024-09-17T01:50:55.414 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.416+0000 7ff94d600640 1 -- 172.21.15.42:0/4290355201 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff924078b90 msgr2=0x7ff92407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:55.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.416+0000 7ff94d600640 1 --2- 172.21.15.42:0/4290355201 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff924078b90 0x7ff92407b0a0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7ff938007fd0 tx=0x7ff938009040 comp rx=0 tx=0).stop 2024-09-17T01:50:55.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.416+0000 7ff94d600640 1 -- 172.21.15.42:0/4290355201 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9480b51d0 msgr2=0x7ff948157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:55.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.416+0000 7ff94d600640 1 --2- 172.21.15.42:0/4290355201 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9480b51d0 0x7ff948157690 secure :-1 s=READY pgs=2688 cs=0 l=1 rev1=1 crypto rx=0x7ff93000e790 tx=0x7ff93000ec50 comp rx=0 tx=0).stop 2024-09-17T01:50:55.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.416+0000 7ff94d600640 1 -- 172.21.15.42:0/4290355201 shutdown_connections 2024-09-17T01:50:55.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.416+0000 7ff94d600640 1 --2- 172.21.15.42:0/4290355201 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7ff924078b90 0x7ff92407b0a0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:55.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.416+0000 7ff94d600640 1 --2- 172.21.15.42:0/4290355201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9481605c0 0x7ff948144d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:55.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.416+0000 7ff94d600640 1 --2- 172.21.15.42:0/4290355201 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9480b51d0 0x7ff948157690 unknown :-1 s=CLOSED pgs=2688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:55.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.416+0000 7ff94d600640 1 --2- 172.21.15.42:0/4290355201 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7ff9480afb00 0x7ff94815c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:55.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.416+0000 7ff94d600640 1 -- 172.21.15.42:0/4290355201 >> 172.21.15.42:0/4290355201 conn(0x7ff94806d3f0 msgr2=0x7ff94815ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:55.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.416+0000 7ff94d600640 1 -- 172.21.15.42:0/4290355201 shutdown_connections 2024-09-17T01:50:55.415 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.417+0000 7ff94d600640 1 -- 172.21.15.42:0/4290355201 wait complete. 2024-09-17T01:50:55.440 INFO:tasks.ceph:Scrubbing osd.5 2024-09-17T01:50:55.441 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-17T01:50:55.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.674+0000 7fb1c3200640 1 -- 172.21.15.42:0/3908821814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1c4070370 msgr2=0x7fb1c40aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:55.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.674+0000 7fb1c3200640 1 --2- 172.21.15.42:0/3908821814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1c4070370 0x7fb1c40aebc0 secure :-1 s=READY pgs=2690 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc005fd0 tx=0x7fb1bc02a980 comp rx=0 tx=0).stop 2024-09-17T01:50:55.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.675+0000 7fb1c3200640 1 -- 172.21.15.42:0/3908821814 shutdown_connections 2024-09-17T01:50:55.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.675+0000 7fb1c3200640 1 --2- 172.21.15.42:0/3908821814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1c4070370 0x7fb1c40aebc0 unknown :-1 s=CLOSED pgs=2690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:55.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.675+0000 7fb1c3200640 1 --2- 172.21.15.42:0/3908821814 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1c415fa40 0x7fb1c40b5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:55.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.675+0000 7fb1c3200640 1 -- 172.21.15.42:0/3908821814 >> 172.21.15.42:0/3908821814 conn(0x7fb1c406cfa0 msgr2=0x7fb1c406d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:55.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.675+0000 7fb1c3200640 1 -- 172.21.15.42:0/3908821814 shutdown_connections 2024-09-17T01:50:55.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.675+0000 7fb1c3200640 1 -- 172.21.15.42:0/3908821814 wait complete. 2024-09-17T01:50:55.674 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.677+0000 7fb1c3200640 1 Processor -- start 2024-09-17T01:50:55.675 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.677+0000 7fb1c3200640 1 -- start start 2024-09-17T01:50:55.676 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.678+0000 7fb1c3200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1c4141760 0x7fb1c41f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:55.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.678+0000 7fb1c3200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1c415fa40 0x7fb1c415da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:55.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.678+0000 7fb1c3200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1c4146220 0x7fb1c40cf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:55.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.678+0000 7fb1c3200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c4141cf0 con 0x7fb1c415fa40 2024-09-17T01:50:55.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.678+0000 7fb1c3200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c4141b70 con 0x7fb1c4141760 2024-09-17T01:50:55.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.678+0000 7fb1c3200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c40af100 con 0x7fb1c4146220 2024-09-17T01:50:55.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.679+0000 7fb1b9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1c415fa40 0x7fb1c415da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:55.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.679+0000 7fb1b9400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1c415fa40 0x7fb1c415da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:59344/0 (socket says 172.21.15.42:59344) 2024-09-17T01:50:55.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.679+0000 7fb1b9400640 1 -- 172.21.15.42:0/269727523 learned_addr learned my addr 172.21.15.42:0/269727523 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:55.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.679+0000 7fb1c2800640 1 --2- 172.21.15.42:0/269727523 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1c4146220 0x7fb1c40cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:55.677 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.679+0000 7fb1c1e00640 1 --2- 172.21.15.42:0/269727523 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1c4141760 0x7fb1c41f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:55.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.679+0000 7fb1b9400640 1 -- 172.21.15.42:0/269727523 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1c4146220 msgr2=0x7fb1c40cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:55.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.679+0000 7fb1b9400640 1 --2- 172.21.15.42:0/269727523 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fb1c4146220 0x7fb1c40cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:55.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.679+0000 7fb1b9400640 1 -- 172.21.15.42:0/269727523 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1c4141760 msgr2=0x7fb1c41f5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:55.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.679+0000 7fb1b9400640 1 --2- 172.21.15.42:0/269727523 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb1c4141760 0x7fb1c41f5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:55.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.679+0000 7fb1b9400640 1 -- 172.21.15.42:0/269727523 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c4146900 con 0x7fb1c415fa40 2024-09-17T01:50:55.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.680+0000 7fb1b9400640 1 --2- 172.21.15.42:0/269727523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1c415fa40 0x7fb1c415da00 secure :-1 s=READY pgs=2691 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00c370 tx=0x7fb1ac00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:55.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.680+0000 7fb1baa00640 1 -- 172.21.15.42:0/269727523 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac017070 con 0x7fb1c415fa40 2024-09-17T01:50:55.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.680+0000 7fb1baa00640 1 -- 172.21.15.42:0/269727523 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1ac0053c0 con 0x7fb1c415fa40 2024-09-17T01:50:55.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.680+0000 7fb1c3200640 1 -- 172.21.15.42:0/269727523 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c4146be0 con 0x7fb1c415fa40 2024-09-17T01:50:55.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.680+0000 7fb1baa00640 1 -- 172.21.15.42:0/269727523 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac003850 con 0x7fb1c415fa40 2024-09-17T01:50:55.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.680+0000 7fb1c3200640 1 -- 172.21.15.42:0/269727523 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c41471a0 con 0x7fb1c415fa40 2024-09-17T01:50:55.679 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.681+0000 7fb1c3200640 1 -- 172.21.15.42:0/269727523 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb1c40af5b0 con 0x7fb1c415fa40 2024-09-17T01:50:55.680 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.682+0000 7fb1baa00640 1 -- 172.21.15.42:0/269727523 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb1ac01a070 con 0x7fb1c415fa40 2024-09-17T01:50:55.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.683+0000 7fb1baa00640 1 --2- 172.21.15.42:0/269727523 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb1a0078b90 0x7fb1a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:55.681 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.684+0000 7fb1baa00640 1 -- 172.21.15.42:0/269727523 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7fb1ac09a4f0 con 0x7fb1c415fa40 2024-09-17T01:50:55.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.684+0000 7fb1baa00640 1 --2- 172.21.15.42:0/269727523 >> [v2:172.21.15.43:6802/3469876255,v1:172.21.15.43:6803/3469876255] conn(0x7fb1a007eb40 0x7fb1a0080f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:55.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.684+0000 7fb1baa00640 1 -- 172.21.15.42:0/269727523 --> [v2:172.21.15.43:6802/3469876255,v1:172.21.15.43:6803/3469876255] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb1ac009e50 con 0x7fb1a007eb40 2024-09-17T01:50:55.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.684+0000 7fb1baa00640 1 -- 172.21.15.42:0/269727523 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=230) ==== 24+0+0 (secure 0 0 0) 0x7fb1ac09a8a0 con 0x7fb1c415fa40 2024-09-17T01:50:55.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.684+0000 7fb1c1e00640 1 --2- 172.21.15.42:0/269727523 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb1a0078b90 0x7fb1a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:55.682 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.684+0000 7fb1c2800640 1 --2- 172.21.15.42:0/269727523 >> [v2:172.21.15.43:6802/3469876255,v1:172.21.15.43:6803/3469876255] conn(0x7fb1a007eb40 0x7fb1a0080f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:55.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.685+0000 7fb1c1e00640 1 --2- 172.21.15.42:0/269727523 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb1a0078b90 0x7fb1a007b0a0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fb1b400bb50 tx=0x7fb1b400b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:55.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.685+0000 7fb1c2800640 1 --2- 172.21.15.42:0/269727523 >> [v2:172.21.15.43:6802/3469876255,v1:172.21.15.43:6803/3469876255] conn(0x7fb1a007eb40 0x7fb1a0080f90 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:55.683 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.686+0000 7fb1baa00640 1 -- 172.21.15.42:0/269727523 <== osd.5 v2:172.21.15.43:6802/3469876255 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb1ac009e50 con 0x7fb1a007eb40 2024-09-17T01:50:55.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.699+0000 7fb1c3200640 1 -- 172.21.15.42:0/269727523 --> [v2:172.21.15.43:6802/3469876255,v1:172.21.15.43:6803/3469876255] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb1c41466b0 con 0x7fb1a007eb40 2024-09-17T01:50:55.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.700+0000 7fb1baa00640 1 -- 172.21.15.42:0/269727523 <== osd.5 v2:172.21.15.43:6802/3469876255 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb1c41466b0 con 0x7fb1a007eb40 2024-09-17T01:50:55.700 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:50:55.701 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T01:50:55.701 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:50:55.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.700+0000 7fb1c3200640 1 -- 172.21.15.42:0/269727523 >> [v2:172.21.15.43:6802/3469876255,v1:172.21.15.43:6803/3469876255] conn(0x7fb1a007eb40 msgr2=0x7fb1a0080f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:55.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.700+0000 7fb1c3200640 1 --2- 172.21.15.42:0/269727523 >> [v2:172.21.15.43:6802/3469876255,v1:172.21.15.43:6803/3469876255] conn(0x7fb1a007eb40 0x7fb1a0080f90 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:55.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.701+0000 7fb1c3200640 1 -- 172.21.15.42:0/269727523 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb1a0078b90 msgr2=0x7fb1a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:55.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.701+0000 7fb1c3200640 1 --2- 172.21.15.42:0/269727523 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fb1a0078b90 0x7fb1a007b0a0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fb1b400bb50 tx=0x7fb1b400b2e0 comp rx=0 tx=0).stop 2024-09-17T01:50:55.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.701+0000 7fb1c3200640 1 -- 172.21.15.42:0/269727523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1c415fa40 msgr2=0x7fb1c415da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:55.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.701+0000 7fb1c3200640 1 --2- 172.21.15.42:0/269727523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1c415fa40 0x7fb1c415da00 secure :-1 s=READY pgs=2691 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00c370 tx=0x7fb1ac00c830 comp rx=0 tx=0).stop 2024-09-17T01:50:55.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.701+0000 7fb1c2800640 1 -- 172.21.15.42:0/269727523 reap_dead start 2024-09-17T01:50:55.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.701+0000 7fb1c3200640 1 -- 172.21.15.42:0/269727523 shutdown_connections 2024-09-17T01:50:55.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.701+0000 7fb1c3200640 1 -- 172.21.15.42:0/269727523 >> 172.21.15.42:0/269727523 conn(0x7fb1c406cfa0 msgr2=0x7fb1c40b0650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:55.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.701+0000 7fb1c3200640 1 -- 172.21.15.42:0/269727523 shutdown_connections 2024-09-17T01:50:55.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.701+0000 7fb1c3200640 1 -- 172.21.15.42:0/269727523 wait complete. 2024-09-17T01:50:55.720 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-17T01:50:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.951+0000 7f0b7aa00640 1 -- 172.21.15.42:0/611289296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b74160c10 msgr2=0x7f0b740b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.951+0000 7f0b7aa00640 1 --2- 172.21.15.42:0/611289296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b74160c10 0x7f0b740b3930 secure :-1 s=READY pgs=2692 cs=0 l=1 rev1=1 crypto rx=0x7f0b74071f30 tx=0x7f0b6c02aac0 comp rx=0 tx=0).stop 2024-09-17T01:50:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.951+0000 7f0b7aa00640 1 -- 172.21.15.42:0/611289296 shutdown_connections 2024-09-17T01:50:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.951+0000 7f0b7aa00640 1 --2- 172.21.15.42:0/611289296 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b74160c10 0x7f0b740b3930 unknown :-1 s=CLOSED pgs=2692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:55.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.951+0000 7f0b7aa00640 1 --2- 172.21.15.42:0/611289296 >> v2:172.21.15.43:3300/0 conn(0x7f0b740afc00 0x7f0b74073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:55.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.951+0000 7f0b7aa00640 1 -- 172.21.15.42:0/611289296 >> 172.21.15.42:0/611289296 conn(0x7f0b7406d3f0 msgr2=0x7f0b740b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:55.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.951+0000 7f0b7aa00640 1 -- 172.21.15.42:0/611289296 shutdown_connections 2024-09-17T01:50:55.950 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.951+0000 7f0b7aa00640 1 -- 172.21.15.42:0/611289296 wait complete. 2024-09-17T01:50:55.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.953+0000 7f0b7aa00640 1 Processor -- start 2024-09-17T01:50:55.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.953+0000 7f0b7aa00640 1 -- start start 2024-09-17T01:50:55.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.955+0000 7f0b7aa00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b740afc00 0x7f0b741f98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:55.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.955+0000 7f0b7aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b740b3520 0x7f0b74144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:55.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.955+0000 7f0b7aa00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b74158b30 0x7f0b741575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:55.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.955+0000 7f0b7aa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0b740ce700 con 0x7f0b740b3520 2024-09-17T01:50:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.955+0000 7f0b7aa00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0b740ce580 con 0x7f0b740afc00 2024-09-17T01:50:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.955+0000 7f0b7aa00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0b740ce880 con 0x7f0b74158b30 2024-09-17T01:50:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.955+0000 7f0b78c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b740b3520 0x7f0b74144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.955+0000 7f0b78c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b740b3520 0x7f0b74144e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48786/0 (socket says 172.21.15.42:48786) 2024-09-17T01:50:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.955+0000 7f0b78c00640 1 -- 172.21.15.42:0/363392430 learned_addr learned my addr 172.21.15.42:0/363392430 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.955+0000 7f0b79600640 1 --2- 172.21.15.42:0/363392430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b740afc00 0x7f0b741f98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.955+0000 7f0b7a000640 1 --2- 172.21.15.42:0/363392430 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b74158b30 0x7f0b741575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.956+0000 7f0b78c00640 1 -- 172.21.15.42:0/363392430 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b74158b30 msgr2=0x7f0b741575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.956+0000 7f0b78c00640 1 --2- 172.21.15.42:0/363392430 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b74158b30 0x7f0b741575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.956+0000 7f0b78c00640 1 -- 172.21.15.42:0/363392430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b740afc00 msgr2=0x7f0b741f98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.956+0000 7f0b78c00640 1 --2- 172.21.15.42:0/363392430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b740afc00 0x7f0b741f98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:55.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.956+0000 7f0b78c00640 1 -- 172.21.15.42:0/363392430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b74158420 con 0x7f0b740b3520 2024-09-17T01:50:55.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.956+0000 7f0b78c00640 1 --2- 172.21.15.42:0/363392430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b740b3520 0x7f0b74144e10 secure :-1 s=READY pgs=2693 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000c3f0 tx=0x7f0b6000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:55.955 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.956+0000 7f0b71600640 1 -- 172.21.15.42:0/363392430 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b60017070 con 0x7f0b740b3520 2024-09-17T01:50:55.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.956+0000 7f0b71600640 1 -- 172.21.15.42:0/363392430 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b600053e0 con 0x7f0b740b3520 2024-09-17T01:50:55.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.956+0000 7f0b71600640 1 -- 172.21.15.42:0/363392430 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b60003870 con 0x7f0b740b3520 2024-09-17T01:50:55.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.956+0000 7f0b7aa00640 1 -- 172.21.15.42:0/363392430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b741fa860 con 0x7f0b740b3520 2024-09-17T01:50:55.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.956+0000 7f0b7aa00640 1 -- 172.21.15.42:0/363392430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b741fa2a0 con 0x7f0b740b3520 2024-09-17T01:50:55.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.958+0000 7f0b7aa00640 1 -- 172.21.15.42:0/363392430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b74073ba0 con 0x7f0b740b3520 2024-09-17T01:50:55.956 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.959+0000 7f0b71600640 1 -- 172.21.15.42:0/363392430 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0b6001a070 con 0x7f0b740b3520 2024-09-17T01:50:55.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.960+0000 7f0b71600640 1 --2- 172.21.15.42:0/363392430 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0b54078b90 0x7f0b5407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:55.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.961+0000 7f0b71600640 1 -- 172.21.15.42:0/363392430 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7f0b60099da0 con 0x7f0b740b3520 2024-09-17T01:50:55.958 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.961+0000 7f0b79600640 1 --2- 172.21.15.42:0/363392430 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0b54078b90 0x7f0b5407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:55.959 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.962+0000 7f0b79600640 1 --2- 172.21.15.42:0/363392430 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0b54078b90 0x7f0b5407b0a0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f0b68004630 tx=0x7f0b6800b2e0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:55.963 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:55.965+0000 7f0b71600640 1 -- 172.21.15.42:0/363392430 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0b74158420 con 0x7f0b740b3520 2024-09-17T01:50:56.157 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.159+0000 7f0b7aa00640 1 -- 172.21.15.42:0/363392430 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f0b74145350 con 0x7f0b54078b90 2024-09-17T01:50:56.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.160+0000 7f0b71600640 1 -- 172.21.15.42:0/363392430 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0b68005020 con 0x7f0b54078b90 2024-09-17T01:50:56.158 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 5 to deep-scrub 2024-09-17T01:50:56.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.163+0000 7f0b7aa00640 1 -- 172.21.15.42:0/363392430 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0b54078b90 msgr2=0x7f0b5407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:56.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.163+0000 7f0b7aa00640 1 --2- 172.21.15.42:0/363392430 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0b54078b90 0x7f0b5407b0a0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f0b68004630 tx=0x7f0b6800b2e0 comp rx=0 tx=0).stop 2024-09-17T01:50:56.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.163+0000 7f0b7aa00640 1 -- 172.21.15.42:0/363392430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b740b3520 msgr2=0x7f0b74144e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:56.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.163+0000 7f0b7aa00640 1 --2- 172.21.15.42:0/363392430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b740b3520 0x7f0b74144e10 secure :-1 s=READY pgs=2693 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000c3f0 tx=0x7f0b6000c8b0 comp rx=0 tx=0).stop 2024-09-17T01:50:56.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.163+0000 7f0b7aa00640 1 -- 172.21.15.42:0/363392430 shutdown_connections 2024-09-17T01:50:56.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.163+0000 7f0b7aa00640 1 --2- 172.21.15.42:0/363392430 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0b54078b90 0x7f0b5407b0a0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:56.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.163+0000 7f0b7aa00640 1 --2- 172.21.15.42:0/363392430 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0b74158b30 0x7f0b741575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:56.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.163+0000 7f0b7aa00640 1 --2- 172.21.15.42:0/363392430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b740b3520 0x7f0b74144e10 unknown :-1 s=CLOSED pgs=2693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:56.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.163+0000 7f0b7aa00640 1 --2- 172.21.15.42:0/363392430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b740afc00 0x7f0b741f98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:56.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.163+0000 7f0b7aa00640 1 -- 172.21.15.42:0/363392430 >> 172.21.15.42:0/363392430 conn(0x7f0b7406d3f0 msgr2=0x7f0b74145df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:56.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.163+0000 7f0b7aa00640 1 -- 172.21.15.42:0/363392430 shutdown_connections 2024-09-17T01:50:56.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.163+0000 7f0b7aa00640 1 -- 172.21.15.42:0/363392430 wait complete. 2024-09-17T01:50:56.184 INFO:tasks.ceph:Scrubbing osd.6 2024-09-17T01:50:56.184 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-17T01:50:56.417 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.419+0000 7f0aba200640 1 -- 172.21.15.42:0/1216349119 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a98005150 msgr2=0x7f0a9800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:56.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.419+0000 7f0aba200640 1 --2- 172.21.15.42:0/1216349119 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a98005150 0x7f0a9800b9c0 secure :-1 s=READY pgs=2695 cs=0 l=1 rev1=1 crypto rx=0x7f0aac009ed0 tx=0x7f0a98005830 comp rx=0 tx=0).stop 2024-09-17T01:50:56.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.419+0000 7f0ab3e00640 1 -- 172.21.15.42:0/1216349119 reap_dead start 2024-09-17T01:50:56.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.419+0000 7f0aba200640 1 -- 172.21.15.42:0/1216349119 shutdown_connections 2024-09-17T01:50:56.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.419+0000 7f0aba200640 1 -- 172.21.15.42:0/1216349119 >> 172.21.15.42:0/1216349119 conn(0x7f0ab406d420 msgr2=0x7f0ab40b2430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:56.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.419+0000 7f0aba200640 1 -- 172.21.15.42:0/1216349119 shutdown_connections 2024-09-17T01:50:56.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.420+0000 7f0aba200640 1 -- 172.21.15.42:0/1216349119 wait complete. 2024-09-17T01:50:56.419 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.422+0000 7f0aba200640 1 Processor -- start 2024-09-17T01:50:56.420 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.422+0000 7f0aba200640 1 -- start start 2024-09-17T01:50:56.422 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.423+0000 7f0aba200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a98005150 0x7f0ab40ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:56.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.423+0000 7f0aba200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ab40ae3a0 0x7f0ab41453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:56.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.423+0000 7f0aba200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0ab40af3b0 0x7f0ab40af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:56.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.423+0000 7f0aba200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab40cfbe0 con 0x7f0ab40ae3a0 2024-09-17T01:50:56.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.423+0000 7f0aba200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab41611c0 con 0x7f0a98005150 2024-09-17T01:50:56.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.424+0000 7f0aba200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f0ab40cfd60 con 0x7f0ab40af3b0 2024-09-17T01:50:56.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.424+0000 7f0aaaa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ab40ae3a0 0x7f0ab41453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:56.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.424+0000 7f0aaaa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ab40ae3a0 0x7f0ab41453f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48794/0 (socket says 172.21.15.42:48794) 2024-09-17T01:50:56.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.424+0000 7f0aaaa00640 1 -- 172.21.15.42:0/276993633 learned_addr learned my addr 172.21.15.42:0/276993633 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:56.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.424+0000 7f0ab3400640 1 --2- 172.21.15.42:0/276993633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a98005150 0x7f0ab40ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:56.423 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.424+0000 7f0ab3e00640 1 --2- 172.21.15.42:0/276993633 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0ab40af3b0 0x7f0ab40af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:56.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.424+0000 7f0aaaa00640 1 -- 172.21.15.42:0/276993633 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0ab40af3b0 msgr2=0x7f0ab40af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:56.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.424+0000 7f0aaaa00640 1 --2- 172.21.15.42:0/276993633 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0ab40af3b0 0x7f0ab40af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:56.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.424+0000 7f0aaaa00640 1 -- 172.21.15.42:0/276993633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a98005150 msgr2=0x7f0ab40ab4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:56.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.424+0000 7f0aaaa00640 1 --2- 172.21.15.42:0/276993633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a98005150 0x7f0ab40ab4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:56.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.424+0000 7f0aaaa00640 1 -- 172.21.15.42:0/276993633 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab40ae910 con 0x7f0ab40ae3a0 2024-09-17T01:50:56.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.424+0000 7f0ab3e00640 1 --2- 172.21.15.42:0/276993633 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f0ab40af3b0 0x7f0ab40af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:56.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.424+0000 7f0aaaa00640 1 --2- 172.21.15.42:0/276993633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ab40ae3a0 0x7f0ab41453f0 secure :-1 s=READY pgs=2696 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c003f50 tx=0x7f0a9c0016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:56.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.425+0000 7f0aabe00640 1 -- 172.21.15.42:0/276993633 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c011640 con 0x7f0ab40ae3a0 2024-09-17T01:50:56.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.425+0000 7f0aabe00640 1 -- 172.21.15.42:0/276993633 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a9c016020 con 0x7f0ab40ae3a0 2024-09-17T01:50:56.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.425+0000 7f0aabe00640 1 -- 172.21.15.42:0/276993633 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c011a60 con 0x7f0ab40ae3a0 2024-09-17T01:50:56.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.425+0000 7f0aba200640 1 -- 172.21.15.42:0/276993633 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab4145930 con 0x7f0ab40ae3a0 2024-09-17T01:50:56.424 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.425+0000 7f0aba200640 1 -- 172.21.15.42:0/276993633 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab40aebb0 con 0x7f0ab40ae3a0 2024-09-17T01:50:56.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.426+0000 7f0aba200640 1 -- 172.21.15.42:0/276993633 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0ab40b5630 con 0x7f0ab40ae3a0 2024-09-17T01:50:56.425 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.427+0000 7f0aabe00640 1 -- 172.21.15.42:0/276993633 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0a9c011c00 con 0x7f0ab40ae3a0 2024-09-17T01:50:56.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.428+0000 7f0aabe00640 1 --2- 172.21.15.42:0/276993633 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0a90078bc0 0x7f0a9007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:56.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.428+0000 7f0aabe00640 1 -- 172.21.15.42:0/276993633 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7f0a9c09bd70 con 0x7f0ab40ae3a0 2024-09-17T01:50:56.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.428+0000 7f0aabe00640 1 --2- 172.21.15.42:0/276993633 >> [v2:172.21.15.43:6826/3742263700,v1:172.21.15.43:6827/3742263700] conn(0x7f0a9007eb70 0x7f0a90080fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:56.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.428+0000 7f0aabe00640 1 -- 172.21.15.42:0/276993633 --> [v2:172.21.15.43:6826/3742263700,v1:172.21.15.43:6827/3742263700] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a90081690 con 0x7f0a9007eb70 2024-09-17T01:50:56.426 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.428+0000 7f0aabe00640 1 -- 172.21.15.42:0/276993633 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=230) ==== 24+0+0 (secure 0 0 0) 0x7f0a9c09c120 con 0x7f0ab40ae3a0 2024-09-17T01:50:56.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.429+0000 7f0ab3400640 1 --2- 172.21.15.42:0/276993633 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0a90078bc0 0x7f0a9007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:56.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.429+0000 7f0ab3e00640 1 --2- 172.21.15.42:0/276993633 >> [v2:172.21.15.43:6826/3742263700,v1:172.21.15.43:6827/3742263700] conn(0x7f0a9007eb70 0x7f0a90080fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:56.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.430+0000 7f0ab3e00640 1 --2- 172.21.15.42:0/276993633 >> [v2:172.21.15.43:6826/3742263700,v1:172.21.15.43:6827/3742263700] conn(0x7f0a9007eb70 0x7f0a90080fc0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:56.427 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.430+0000 7f0ab3400640 1 --2- 172.21.15.42:0/276993633 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0a90078bc0 0x7f0a9007b0d0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4001d70 tx=0x7f0aa4001cc0 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:56.428 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.430+0000 7f0aabe00640 1 -- 172.21.15.42:0/276993633 <== osd.6 v2:172.21.15.43:6826/3742263700 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0a90081690 con 0x7f0a9007eb70 2024-09-17T01:50:56.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.444+0000 7f0aba200640 1 -- 172.21.15.42:0/276993633 --> [v2:172.21.15.43:6826/3742263700,v1:172.21.15.43:6827/3742263700] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0ab40d1000 con 0x7f0a9007eb70 2024-09-17T01:50:56.442 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.445+0000 7f0aabe00640 1 -- 172.21.15.42:0/276993633 <== osd.6 v2:172.21.15.43:6826/3742263700 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0ab40d1000 con 0x7f0a9007eb70 2024-09-17T01:50:56.443 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:50:56.443 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T01:50:56.443 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:50:56.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.445+0000 7f0aba200640 1 -- 172.21.15.42:0/276993633 >> [v2:172.21.15.43:6826/3742263700,v1:172.21.15.43:6827/3742263700] conn(0x7f0a9007eb70 msgr2=0x7f0a90080fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:56.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.445+0000 7f0aba200640 1 --2- 172.21.15.42:0/276993633 >> [v2:172.21.15.43:6826/3742263700,v1:172.21.15.43:6827/3742263700] conn(0x7f0a9007eb70 0x7f0a90080fc0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:56.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.445+0000 7f0aba200640 1 -- 172.21.15.42:0/276993633 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0a90078bc0 msgr2=0x7f0a9007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:56.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.445+0000 7f0aba200640 1 --2- 172.21.15.42:0/276993633 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f0a90078bc0 0x7f0a9007b0d0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4001d70 tx=0x7f0aa4001cc0 comp rx=0 tx=0).stop 2024-09-17T01:50:56.444 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.445+0000 7f0aba200640 1 -- 172.21.15.42:0/276993633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ab40ae3a0 msgr2=0x7f0ab41453f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:56.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.445+0000 7f0aba200640 1 --2- 172.21.15.42:0/276993633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ab40ae3a0 0x7f0ab41453f0 secure :-1 s=READY pgs=2696 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c003f50 tx=0x7f0a9c0016f0 comp rx=0 tx=0).stop 2024-09-17T01:50:56.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.445+0000 7f0ab3e00640 1 -- 172.21.15.42:0/276993633 reap_dead start 2024-09-17T01:50:56.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.445+0000 7f0aba200640 1 -- 172.21.15.42:0/276993633 shutdown_connections 2024-09-17T01:50:56.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.445+0000 7f0aba200640 1 -- 172.21.15.42:0/276993633 >> 172.21.15.42:0/276993633 conn(0x7f0ab406d420 msgr2=0x7f0ab40d04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:56.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.446+0000 7f0aba200640 1 -- 172.21.15.42:0/276993633 shutdown_connections 2024-09-17T01:50:56.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.446+0000 7f0aba200640 1 -- 172.21.15.42:0/276993633 wait complete. 2024-09-17T01:50:56.464 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-17T01:50:56.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.695+0000 7f1ae0e00640 1 -- 172.21.15.42:0/3517019562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1adc160cd0 msgr2=0x7f1adc0b55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:56.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.695+0000 7f1ae0e00640 1 --2- 172.21.15.42:0/3517019562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1adc160cd0 0x7f1adc0b55e0 secure :-1 s=READY pgs=2697 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0b36a0 tx=0x7f1ad402aa90 comp rx=0 tx=0).stop 2024-09-17T01:50:56.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.695+0000 7f1ae0e00640 1 -- 172.21.15.42:0/3517019562 shutdown_connections 2024-09-17T01:50:56.693 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.695+0000 7f1ae0e00640 1 --2- 172.21.15.42:0/3517019562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1adc160cd0 0x7f1adc0b55e0 unknown :-1 s=CLOSED pgs=2697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:56.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.695+0000 7f1ae0e00640 1 --2- 172.21.15.42:0/3517019562 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1adc0afb00 0x7f1adc073d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:56.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.695+0000 7f1ae0e00640 1 -- 172.21.15.42:0/3517019562 >> 172.21.15.42:0/3517019562 conn(0x7f1adc06d3f0 msgr2=0x7f1adc0b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:56.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.695+0000 7f1ae0e00640 1 -- 172.21.15.42:0/3517019562 shutdown_connections 2024-09-17T01:50:56.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.695+0000 7f1ae0e00640 1 -- 172.21.15.42:0/3517019562 wait complete. 2024-09-17T01:50:56.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.697+0000 7f1ae0e00640 1 Processor -- start 2024-09-17T01:50:56.695 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.697+0000 7f1ae0e00640 1 -- start start 2024-09-17T01:50:56.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.698+0000 7f1ae0e00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1adc0afb00 0x7f1adc145bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:56.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.698+0000 7f1ae0e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1adc0b51d0 0x7f1adc1e6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:56.697 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.699+0000 7f1ae0e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1adc1e9470 0x7f1adc1f6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:56.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.699+0000 7f1ae0e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc0ce4f0 con 0x7f1adc1e9470 2024-09-17T01:50:56.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.699+0000 7f1ae0e00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc0ce370 con 0x7f1adc0b51d0 2024-09-17T01:50:56.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.699+0000 7f1ae0e00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f1adc0ce670 con 0x7f1adc0afb00 2024-09-17T01:50:56.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.699+0000 7f1adbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1adc1e9470 0x7f1adc1f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:56.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.699+0000 7f1adbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1adc1e9470 0x7f1adc1f6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48820/0 (socket says 172.21.15.42:48820) 2024-09-17T01:50:56.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.699+0000 7f1adbe00640 1 -- 172.21.15.42:0/2719577725 learned_addr learned my addr 172.21.15.42:0/2719577725 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:56.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.699+0000 7f1adb400640 1 --2- 172.21.15.42:0/2719577725 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1adc0afb00 0x7f1adc145bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:56.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.699+0000 7f1adaa00640 1 --2- 172.21.15.42:0/2719577725 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1adc0b51d0 0x7f1adc1e6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:56.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.699+0000 7f1adbe00640 1 -- 172.21.15.42:0/2719577725 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1adc0afb00 msgr2=0x7f1adc145bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:56.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.699+0000 7f1adbe00640 1 --2- 172.21.15.42:0/2719577725 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1adc0afb00 0x7f1adc145bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:56.698 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.699+0000 7f1adbe00640 1 -- 172.21.15.42:0/2719577725 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1adc0b51d0 msgr2=0x7f1adc1e6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:56.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.699+0000 7f1adbe00640 1 --2- 172.21.15.42:0/2719577725 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1adc0b51d0 0x7f1adc1e6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:56.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.699+0000 7f1adbe00640 1 -- 172.21.15.42:0/2719577725 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1adc1e8710 con 0x7f1adc1e9470 2024-09-17T01:50:56.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.699+0000 7f1adb400640 1 --2- 172.21.15.42:0/2719577725 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1adc0afb00 0x7f1adc145bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:56.699 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.700+0000 7f1adbe00640 1 --2- 172.21.15.42:0/2719577725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1adc1e9470 0x7f1adc1f6500 secure :-1 s=READY pgs=2698 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4009d60 tx=0x7f1ad4003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:56.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.700+0000 7f1ad3400640 1 -- 172.21.15.42:0/2719577725 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4044070 con 0x7f1adc1e9470 2024-09-17T01:50:56.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.700+0000 7f1ad3400640 1 -- 172.21.15.42:0/2719577725 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ad4004250 con 0x7f1adc1e9470 2024-09-17T01:50:56.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.700+0000 7f1ae0e00640 1 -- 172.21.15.42:0/2719577725 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1adc1e6b50 con 0x7f1adc1e9470 2024-09-17T01:50:56.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.700+0000 7f1ad3400640 1 -- 172.21.15.42:0/2719577725 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad40046a0 con 0x7f1adc1e9470 2024-09-17T01:50:56.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.700+0000 7f1ae0e00640 1 -- 172.21.15.42:0/2719577725 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1adc1e8990 con 0x7f1adc1e9470 2024-09-17T01:50:56.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.701+0000 7f1ae0e00640 1 -- 172.21.15.42:0/2719577725 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1adc1e6d20 con 0x7f1adc1e9470 2024-09-17T01:50:56.700 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.702+0000 7f1ad3400640 1 -- 172.21.15.42:0/2719577725 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1ad4047070 con 0x7f1adc1e9470 2024-09-17T01:50:56.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.703+0000 7f1ad3400640 1 --2- 172.21.15.42:0/2719577725 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1abc078bc0 0x7f1abc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:56.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.703+0000 7f1ad3400640 1 -- 172.21.15.42:0/2719577725 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7f1ad40bb9a0 con 0x7f1adc1e9470 2024-09-17T01:50:56.701 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.704+0000 7f1adb400640 1 --2- 172.21.15.42:0/2719577725 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1abc078bc0 0x7f1abc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:56.702 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.705+0000 7f1adb400640 1 --2- 172.21.15.42:0/2719577725 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1abc078bc0 0x7f1abc07b0d0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f1acc005fd0 tx=0x7f1acc00f360 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:56.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.708+0000 7f1ad3400640 1 -- 172.21.15.42:0/2719577725 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1adc1e8710 con 0x7f1adc1e9470 2024-09-17T01:50:56.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.902+0000 7f1ae0e00640 1 -- 172.21.15.42:0/2719577725 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f1adc146110 con 0x7f1abc078bc0 2024-09-17T01:50:56.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.903+0000 7f1ad3400640 1 -- 172.21.15.42:0/2719577725 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1adc146110 con 0x7f1abc078bc0 2024-09-17T01:50:56.901 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 6 to deep-scrub 2024-09-17T01:50:56.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.906+0000 7f1ae0e00640 1 -- 172.21.15.42:0/2719577725 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1abc078bc0 msgr2=0x7f1abc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:56.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.906+0000 7f1ae0e00640 1 --2- 172.21.15.42:0/2719577725 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1abc078bc0 0x7f1abc07b0d0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f1acc005fd0 tx=0x7f1acc00f360 comp rx=0 tx=0).stop 2024-09-17T01:50:56.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.906+0000 7f1ae0e00640 1 -- 172.21.15.42:0/2719577725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1adc1e9470 msgr2=0x7f1adc1f6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:56.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.906+0000 7f1ae0e00640 1 --2- 172.21.15.42:0/2719577725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1adc1e9470 0x7f1adc1f6500 secure :-1 s=READY pgs=2698 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4009d60 tx=0x7f1ad4003ce0 comp rx=0 tx=0).stop 2024-09-17T01:50:56.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.906+0000 7f1ae0e00640 1 -- 172.21.15.42:0/2719577725 shutdown_connections 2024-09-17T01:50:56.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.906+0000 7f1ae0e00640 1 --2- 172.21.15.42:0/2719577725 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f1abc078bc0 0x7f1abc07b0d0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:56.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.906+0000 7f1ae0e00640 1 --2- 172.21.15.42:0/2719577725 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1adc0b51d0 0x7f1adc1e6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:56.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.906+0000 7f1ae0e00640 1 --2- 172.21.15.42:0/2719577725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1adc1e9470 0x7f1adc1f6500 unknown :-1 s=CLOSED pgs=2698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:56.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.906+0000 7f1ae0e00640 1 --2- 172.21.15.42:0/2719577725 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f1adc0afb00 0x7f1adc145bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:56.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.906+0000 7f1ae0e00640 1 -- 172.21.15.42:0/2719577725 >> 172.21.15.42:0/2719577725 conn(0x7f1adc06d3f0 msgr2=0x7f1adc06faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:56.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.906+0000 7f1ae0e00640 1 -- 172.21.15.42:0/2719577725 shutdown_connections 2024-09-17T01:50:56.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:56.906+0000 7f1ae0e00640 1 -- 172.21.15.42:0/2719577725 wait complete. 2024-09-17T01:50:56.930 INFO:tasks.ceph:Scrubbing osd.7 2024-09-17T01:50:56.930 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-17T01:50:57.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.164+0000 7fbce4200640 1 -- 172.21.15.42:0/3522460796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcdc0aedd0 msgr2=0x7fbcdc0b3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:57.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.164+0000 7fbce4200640 1 --2- 172.21.15.42:0/3522460796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcdc0aedd0 0x7fbcdc0b3fb0 secure :-1 s=READY pgs=2699 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4005fd0 tx=0x7fbcd402aa90 comp rx=0 tx=0).stop 2024-09-17T01:50:57.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.164+0000 7fbce4200640 1 -- 172.21.15.42:0/3522460796 shutdown_connections 2024-09-17T01:50:57.162 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.164+0000 7fbce4200640 1 --2- 172.21.15.42:0/3522460796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcdc0aedd0 0x7fbcdc0b3fb0 unknown :-1 s=CLOSED pgs=2699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:57.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.164+0000 7fbce4200640 1 --2- 172.21.15.42:0/3522460796 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcdc15f430 0x7fbcdc0ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:57.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.164+0000 7fbce4200640 1 -- 172.21.15.42:0/3522460796 >> 172.21.15.42:0/3522460796 conn(0x7fbcdc06d420 msgr2=0x7fbcdc0b2430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:57.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.164+0000 7fbce4200640 1 -- 172.21.15.42:0/3522460796 shutdown_connections 2024-09-17T01:50:57.163 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.164+0000 7fbce4200640 1 -- 172.21.15.42:0/3522460796 wait complete. 2024-09-17T01:50:57.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.166+0000 7fbce4200640 1 Processor -- start 2024-09-17T01:50:57.164 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.166+0000 7fbce4200640 1 -- start start 2024-09-17T01:50:57.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.168+0000 7fbce4200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcdc0729a0 0x7fbcdc1591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:57.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.168+0000 7fbce4200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcdc0aedd0 0x7fbcdc13f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:57.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.168+0000 7fbce4200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcdc15f430 0x7fbcdc14eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:57.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.168+0000 7fbce4200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc0b4930 con 0x7fbcdc0aedd0 2024-09-17T01:50:57.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.168+0000 7fbce4200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc0b47b0 con 0x7fbcdc15f430 2024-09-17T01:50:57.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.168+0000 7fbce4200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fbcdc0b4ab0 con 0x7fbcdc0729a0 2024-09-17T01:50:57.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.168+0000 7fbce0e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcdc0aedd0 0x7fbcdc13f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:57.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.168+0000 7fbce0e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcdc0aedd0 0x7fbcdc13f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48842/0 (socket says 172.21.15.42:48842) 2024-09-17T01:50:57.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.168+0000 7fbce0e00640 1 -- 172.21.15.42:0/399608087 learned_addr learned my addr 172.21.15.42:0/399608087 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:57.167 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.168+0000 7fbce2200640 1 --2- 172.21.15.42:0/399608087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcdc15f430 0x7fbcdc14eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:57.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.168+0000 7fbce1800640 1 --2- 172.21.15.42:0/399608087 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcdc0729a0 0x7fbcdc1591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:57.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.169+0000 7fbce0e00640 1 -- 172.21.15.42:0/399608087 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcdc0729a0 msgr2=0x7fbcdc1591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:57.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.169+0000 7fbce0e00640 1 --2- 172.21.15.42:0/399608087 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcdc0729a0 0x7fbcdc1591b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:57.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.169+0000 7fbce0e00640 1 -- 172.21.15.42:0/399608087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcdc15f430 msgr2=0x7fbcdc14eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:57.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.169+0000 7fbce0e00640 1 --2- 172.21.15.42:0/399608087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcdc15f430 0x7fbcdc14eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:57.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.169+0000 7fbce0e00640 1 -- 172.21.15.42:0/399608087 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcdc13f690 con 0x7fbcdc0aedd0 2024-09-17T01:50:57.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.169+0000 7fbce2200640 1 --2- 172.21.15.42:0/399608087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbcdc15f430 0x7fbcdc14eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:50:57.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.169+0000 7fbce1800640 1 --2- 172.21.15.42:0/399608087 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fbcdc0729a0 0x7fbcdc1591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:50:57.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.169+0000 7fbce0e00640 1 --2- 172.21.15.42:0/399608087 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcdc0aedd0 0x7fbcdc13f150 secure :-1 s=READY pgs=2700 cs=0 l=1 rev1=1 crypto rx=0x7fbcc800d6a0 tx=0x7fbcc800db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:57.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.169+0000 7fbcd9600640 1 -- 172.21.15.42:0/399608087 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8017070 con 0x7fbcdc0aedd0 2024-09-17T01:50:57.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.169+0000 7fbcd9600640 1 -- 172.21.15.42:0/399608087 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcc8005310 con 0x7fbcdc0aedd0 2024-09-17T01:50:57.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.169+0000 7fbce4200640 1 -- 172.21.15.42:0/399608087 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcdc1ea440 con 0x7fbcdc0aedd0 2024-09-17T01:50:57.168 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.169+0000 7fbcd9600640 1 -- 172.21.15.42:0/399608087 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8009820 con 0x7fbcdc0aedd0 2024-09-17T01:50:57.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.169+0000 7fbce4200640 1 -- 172.21.15.42:0/399608087 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcdc158c90 con 0x7fbcdc0aedd0 2024-09-17T01:50:57.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.170+0000 7fbce4200640 1 -- 172.21.15.42:0/399608087 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbcdc1ea1f0 con 0x7fbcdc0aedd0 2024-09-17T01:50:57.169 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.172+0000 7fbcd9600640 1 -- 172.21.15.42:0/399608087 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbcc80099c0 con 0x7fbcdc0aedd0 2024-09-17T01:50:57.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.172+0000 7fbcd9600640 1 --2- 172.21.15.42:0/399608087 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbcbc078b90 0x7fbcbc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:57.170 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.173+0000 7fbcd9600640 1 -- 172.21.15.42:0/399608087 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7fbcc809ab80 con 0x7fbcdc0aedd0 2024-09-17T01:50:57.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.173+0000 7fbcd9600640 1 --2- 172.21.15.42:0/399608087 >> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] conn(0x7fbcbc07eb40 0x7fbcbc080f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:57.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.173+0000 7fbcd9600640 1 -- 172.21.15.42:0/399608087 --> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbcc8009e50 con 0x7fbcbc07eb40 2024-09-17T01:50:57.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.173+0000 7fbcd9600640 1 -- 172.21.15.42:0/399608087 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=230) ==== 24+0+0 (secure 0 0 0) 0x7fbcc809f2a0 con 0x7fbcdc0aedd0 2024-09-17T01:50:57.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.173+0000 7fbce1800640 1 --2- 172.21.15.42:0/399608087 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbcbc078b90 0x7fbcbc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:57.171 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.173+0000 7fbce2200640 1 --2- 172.21.15.42:0/399608087 >> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] conn(0x7fbcbc07eb40 0x7fbcbc080f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:57.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.174+0000 7fbce1800640 1 --2- 172.21.15.42:0/399608087 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbcbc078b90 0x7fbcbc07b0a0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0001640 tx=0x7fbcd0009040 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:57.172 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.174+0000 7fbce2200640 1 --2- 172.21.15.42:0/399608087 >> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] conn(0x7fbcbc07eb40 0x7fbcbc080f90 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:57.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.175+0000 7fbcd9600640 1 -- 172.21.15.42:0/399608087 <== osd.7 v2:172.21.15.43:6810/859332009 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbcc8009e50 con 0x7fbcbc07eb40 2024-09-17T01:50:57.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.188+0000 7fbce4200640 1 -- 172.21.15.42:0/399608087 --> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbcdc14b980 con 0x7fbcbc07eb40 2024-09-17T01:50:57.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.189+0000 7fbcd9600640 1 -- 172.21.15.42:0/399608087 <== osd.7 v2:172.21.15.43:6810/859332009 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbcd402e750 con 0x7fbcbc07eb40 2024-09-17T01:50:57.187 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T01:50:57.187 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T01:50:57.187 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T01:50:57.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.189+0000 7fbce4200640 1 -- 172.21.15.42:0/399608087 >> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] conn(0x7fbcbc07eb40 msgr2=0x7fbcbc080f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:57.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.189+0000 7fbce4200640 1 --2- 172.21.15.42:0/399608087 >> [v2:172.21.15.43:6810/859332009,v1:172.21.15.43:6811/859332009] conn(0x7fbcbc07eb40 0x7fbcbc080f90 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:57.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.190+0000 7fbce4200640 1 -- 172.21.15.42:0/399608087 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbcbc078b90 msgr2=0x7fbcbc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:57.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.190+0000 7fbce4200640 1 --2- 172.21.15.42:0/399608087 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fbcbc078b90 0x7fbcbc07b0a0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0001640 tx=0x7fbcd0009040 comp rx=0 tx=0).stop 2024-09-17T01:50:57.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.190+0000 7fbce4200640 1 -- 172.21.15.42:0/399608087 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcdc0aedd0 msgr2=0x7fbcdc13f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:57.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.190+0000 7fbce4200640 1 --2- 172.21.15.42:0/399608087 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbcdc0aedd0 0x7fbcdc13f150 secure :-1 s=READY pgs=2700 cs=0 l=1 rev1=1 crypto rx=0x7fbcc800d6a0 tx=0x7fbcc800db60 comp rx=0 tx=0).stop 2024-09-17T01:50:57.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.190+0000 7fbce2200640 1 -- 172.21.15.42:0/399608087 reap_dead start 2024-09-17T01:50:57.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.190+0000 7fbce4200640 1 -- 172.21.15.42:0/399608087 shutdown_connections 2024-09-17T01:50:57.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.190+0000 7fbce4200640 1 -- 172.21.15.42:0/399608087 >> 172.21.15.42:0/399608087 conn(0x7fbcdc06d420 msgr2=0x7fbcdc155cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:57.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.190+0000 7fbce4200640 1 -- 172.21.15.42:0/399608087 shutdown_connections 2024-09-17T01:50:57.189 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.190+0000 7fbce4200640 1 -- 172.21.15.42:0/399608087 wait complete. 2024-09-17T01:50:57.209 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-17T01:50:57.439 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.441+0000 7f651da00640 1 -- 172.21.15.42:0/3698995924 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65180cdc00 msgr2=0x7f6518160c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:57.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.441+0000 7f651da00640 1 --2- 172.21.15.42:0/3698995924 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65180cdc00 0x7f6518160c40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6500005fd0 tx=0x7f650002a5d0 comp rx=0 tx=0).stop 2024-09-17T01:50:57.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.441+0000 7f651da00640 1 -- 172.21.15.42:0/3698995924 shutdown_connections 2024-09-17T01:50:57.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.441+0000 7f651da00640 1 --2- 172.21.15.42:0/3698995924 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f65180cdc00 0x7f6518160c40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:57.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.441+0000 7f651da00640 1 --2- 172.21.15.42:0/3698995924 >> v2:172.21.15.43:3300/0 conn(0x7f651815dd50 0x7f65180cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:57.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.441+0000 7f651da00640 1 -- 172.21.15.42:0/3698995924 >> 172.21.15.42:0/3698995924 conn(0x7f651806d1b0 msgr2=0x7f651806d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:57.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.441+0000 7f651da00640 1 -- 172.21.15.42:0/3698995924 shutdown_connections 2024-09-17T01:50:57.440 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.441+0000 7f651da00640 1 -- 172.21.15.42:0/3698995924 wait complete. 2024-09-17T01:50:57.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.444+0000 7f651da00640 1 Processor -- start 2024-09-17T01:50:57.441 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.444+0000 7f651da00640 1 -- start start 2024-09-17T01:50:57.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.445+0000 7f651da00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65180cdc00 0x7f65180ac180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:57.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.445+0000 7f651da00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f651815dd50 0x7f65180ada70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:57.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.445+0000 7f651da00640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6518161180 0x7f6518156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:57.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.445+0000 7f651da00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6518161710 con 0x7f65180cdc00 2024-09-17T01:50:57.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.445+0000 7f651da00640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6518161590 con 0x7f651815dd50 2024-09-17T01:50:57.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.445+0000 7f651da00640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f651806f1f0 con 0x7f6518161180 2024-09-17T01:50:57.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.445+0000 7f6516a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65180cdc00 0x7f65180ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:57.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.445+0000 7f6516a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65180cdc00 0x7f65180ac180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48846/0 (socket says 172.21.15.42:48846) 2024-09-17T01:50:57.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.446+0000 7f6516a00640 1 -- 172.21.15.42:0/64537358 learned_addr learned my addr 172.21.15.42:0/64537358 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:57.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.446+0000 7f6517400640 1 --2- 172.21.15.42:0/64537358 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6518161180 0x7f6518156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:57.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.446+0000 7f650e000640 1 --2- 172.21.15.42:0/64537358 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f651815dd50 0x7f65180ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:57.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.446+0000 7f6516a00640 1 -- 172.21.15.42:0/64537358 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6518161180 msgr2=0x7f6518156c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:57.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.446+0000 7f6516a00640 1 --2- 172.21.15.42:0/64537358 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6518161180 0x7f6518156c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:57.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.446+0000 7f6516a00640 1 -- 172.21.15.42:0/64537358 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f651815dd50 msgr2=0x7f65180ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:57.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.446+0000 7f6516a00640 1 --2- 172.21.15.42:0/64537358 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f651815dd50 0x7f65180ada70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:57.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.446+0000 7f6516a00640 1 -- 172.21.15.42:0/64537358 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65180ac6c0 con 0x7f65180cdc00 2024-09-17T01:50:57.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.446+0000 7f6516a00640 1 --2- 172.21.15.42:0/64537358 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65180cdc00 0x7f65180ac180 secure :-1 s=READY pgs=2701 cs=0 l=1 rev1=1 crypto rx=0x7f6508009fd0 tx=0x7f650800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:57.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.446+0000 7f650f400640 1 -- 172.21.15.42:0/64537358 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650800cc60 con 0x7f65180cdc00 2024-09-17T01:50:57.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.446+0000 7f650f400640 1 -- 172.21.15.42:0/64537358 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f650800ce00 con 0x7f65180cdc00 2024-09-17T01:50:57.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.447+0000 7f651da00640 1 -- 172.21.15.42:0/64537358 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65180ab0e0 con 0x7f65180cdc00 2024-09-17T01:50:57.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.447+0000 7f650f400640 1 -- 172.21.15.42:0/64537358 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508004280 con 0x7f65180cdc00 2024-09-17T01:50:57.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.447+0000 7f651da00640 1 -- 172.21.15.42:0/64537358 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65180ab6a0 con 0x7f65180cdc00 2024-09-17T01:50:57.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.448+0000 7f651da00640 1 -- 172.21.15.42:0/64537358 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f651806f6a0 con 0x7f65180cdc00 2024-09-17T01:50:57.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.449+0000 7f650f400640 1 -- 172.21.15.42:0/64537358 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f65080035f0 con 0x7f65180cdc00 2024-09-17T01:50:57.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.450+0000 7f650f400640 1 --2- 172.21.15.42:0/64537358 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f64f4078bc0 0x7f64f407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:57.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.450+0000 7f650f400640 1 -- 172.21.15.42:0/64537358 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7f650809b430 con 0x7f65180cdc00 2024-09-17T01:50:57.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.451+0000 7f650e000640 1 --2- 172.21.15.42:0/64537358 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f64f4078bc0 0x7f64f407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:57.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.451+0000 7f650e000640 1 --2- 172.21.15.42:0/64537358 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f64f4078bc0 0x7f64f407b0d0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f6500033000 tx=0x7f6500004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:57.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.455+0000 7f650f400640 1 -- 172.21.15.42:0/64537358 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6508063b00 con 0x7f65180cdc00 2024-09-17T01:50:57.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.649+0000 7f651da00640 1 -- 172.21.15.42:0/64537358 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f65180adfb0 con 0x7f64f4078bc0 2024-09-17T01:50:57.647 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.649+0000 7f650f400640 1 -- 172.21.15.42:0/64537358 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f65180adfb0 con 0x7f64f4078bc0 2024-09-17T01:50:57.647 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 7 to deep-scrub 2024-09-17T01:50:57.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.652+0000 7f651da00640 1 -- 172.21.15.42:0/64537358 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f64f4078bc0 msgr2=0x7f64f407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:57.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.652+0000 7f651da00640 1 --2- 172.21.15.42:0/64537358 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f64f4078bc0 0x7f64f407b0d0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f6500033000 tx=0x7f6500004730 comp rx=0 tx=0).stop 2024-09-17T01:50:57.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.652+0000 7f651da00640 1 -- 172.21.15.42:0/64537358 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65180cdc00 msgr2=0x7f65180ac180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:57.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.652+0000 7f651da00640 1 --2- 172.21.15.42:0/64537358 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65180cdc00 0x7f65180ac180 secure :-1 s=READY pgs=2701 cs=0 l=1 rev1=1 crypto rx=0x7f6508009fd0 tx=0x7f650800ec20 comp rx=0 tx=0).stop 2024-09-17T01:50:57.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.652+0000 7f651da00640 1 -- 172.21.15.42:0/64537358 shutdown_connections 2024-09-17T01:50:57.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.652+0000 7f651da00640 1 --2- 172.21.15.42:0/64537358 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f64f4078bc0 0x7f64f407b0d0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:57.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.652+0000 7f651da00640 1 --2- 172.21.15.42:0/64537358 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f651815dd50 0x7f65180ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:57.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.652+0000 7f651da00640 1 --2- 172.21.15.42:0/64537358 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f6518161180 0x7f6518156c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:57.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.652+0000 7f651da00640 1 --2- 172.21.15.42:0/64537358 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f65180cdc00 0x7f65180ac180 unknown :-1 s=CLOSED pgs=2701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:57.650 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.652+0000 7f651da00640 1 -- 172.21.15.42:0/64537358 >> 172.21.15.42:0/64537358 conn(0x7f651806d1b0 msgr2=0x7f65180b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:57.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.652+0000 7f651da00640 1 -- 172.21.15.42:0/64537358 shutdown_connections 2024-09-17T01:50:57.651 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.652+0000 7f651da00640 1 -- 172.21.15.42:0/64537358 wait complete. 2024-09-17T01:50:57.671 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T01:50:57.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.902+0000 7f2eed400640 1 -- 172.21.15.42:0/3843996799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ee80b51d0 msgr2=0x7f2ee80b55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:57.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.902+0000 7f2eed400640 1 --2- 172.21.15.42:0/3843996799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ee80b51d0 0x7f2ee80b55e0 secure :-1 s=READY pgs=2703 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8071f30 tx=0x7f2ed002a4b0 comp rx=0 tx=0).stop 2024-09-17T01:50:57.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.902+0000 7f2eed400640 1 -- 172.21.15.42:0/3843996799 shutdown_connections 2024-09-17T01:50:57.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.902+0000 7f2eed400640 1 --2- 172.21.15.42:0/3843996799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ee80b51d0 0x7f2ee80b55e0 unknown :-1 s=CLOSED pgs=2703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:57.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.902+0000 7f2eed400640 1 --2- 172.21.15.42:0/3843996799 >> v2:172.21.15.43:3300/0 conn(0x7f2ee80afb00 0x7f2ee8073d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:57.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.902+0000 7f2eed400640 1 -- 172.21.15.42:0/3843996799 >> 172.21.15.42:0/3843996799 conn(0x7f2ee806d3f0 msgr2=0x7f2ee80b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:57.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.902+0000 7f2eed400640 1 -- 172.21.15.42:0/3843996799 shutdown_connections 2024-09-17T01:50:57.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.902+0000 7f2eed400640 1 -- 172.21.15.42:0/3843996799 wait complete. 2024-09-17T01:50:57.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.904+0000 7f2eed400640 1 Processor -- start 2024-09-17T01:50:57.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.904+0000 7f2eed400640 1 -- start start 2024-09-17T01:50:57.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.906+0000 7f2eed400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ee80afb00 0x7f2ee81590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:57.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.906+0000 7f2eed400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ee80b51d0 0x7f2ee80acd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:57.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.906+0000 7f2eed400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2ee81605c0 0x7f2ee81f2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:57.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.906+0000 7f2eed400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee80ce4f0 con 0x7f2ee80b51d0 2024-09-17T01:50:57.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.906+0000 7f2eed400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee80ce370 con 0x7f2ee80afb00 2024-09-17T01:50:57.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.906+0000 7f2eed400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee80ce670 con 0x7f2ee81605c0 2024-09-17T01:50:57.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.906+0000 7f2edfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ee80b51d0 0x7f2ee80acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:57.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.906+0000 7f2edfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ee80b51d0 0x7f2ee80acd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48856/0 (socket says 172.21.15.42:48856) 2024-09-17T01:50:57.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.906+0000 7f2edfe00640 1 -- 172.21.15.42:0/3201879974 learned_addr learned my addr 172.21.15.42:0/3201879974 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:57.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.906+0000 7f2ee7e00640 1 --2- 172.21.15.42:0/3201879974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ee80afb00 0x7f2ee81590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:57.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.906+0000 7f2eeca00640 1 --2- 172.21.15.42:0/3201879974 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2ee81605c0 0x7f2ee81f2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:57.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.907+0000 7f2edfe00640 1 -- 172.21.15.42:0/3201879974 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2ee81605c0 msgr2=0x7f2ee81f2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:57.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.907+0000 7f2edfe00640 1 --2- 172.21.15.42:0/3201879974 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2ee81605c0 0x7f2ee81f2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:57.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.907+0000 7f2edfe00640 1 -- 172.21.15.42:0/3201879974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ee80afb00 msgr2=0x7f2ee81590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:57.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.907+0000 7f2edfe00640 1 --2- 172.21.15.42:0/3201879974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ee80afb00 0x7f2ee81590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:57.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.907+0000 7f2edfe00640 1 -- 172.21.15.42:0/3201879974 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee80ad240 con 0x7f2ee80b51d0 2024-09-17T01:50:57.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.907+0000 7f2eeca00640 1 --2- 172.21.15.42:0/3201879974 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2ee81605c0 0x7f2ee81f2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:57.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.907+0000 7f2ee7e00640 1 --2- 172.21.15.42:0/3201879974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ee80afb00 0x7f2ee81590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:57.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.907+0000 7f2edfe00640 1 --2- 172.21.15.42:0/3201879974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ee80b51d0 0x7f2ee80acd00 secure :-1 s=READY pgs=2704 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0009920 tx=0x7f2ed0033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:57.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.907+0000 7f2ee4c00640 1 -- 172.21.15.42:0/3201879974 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0031d60 con 0x7f2ee80b51d0 2024-09-17T01:50:57.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.907+0000 7f2ee4c00640 1 -- 172.21.15.42:0/3201879974 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ed0005020 con 0x7f2ee80b51d0 2024-09-17T01:50:57.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.907+0000 7f2ee4c00640 1 -- 172.21.15.42:0/3201879974 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0005470 con 0x7f2ee80b51d0 2024-09-17T01:50:57.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.908+0000 7f2eed400640 1 -- 172.21.15.42:0/3201879974 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee8159740 con 0x7f2ee80b51d0 2024-09-17T01:50:57.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.908+0000 7f2eed400640 1 -- 172.21.15.42:0/3201879974 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee8159d00 con 0x7f2ee80b51d0 2024-09-17T01:50:57.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.909+0000 7f2eed400640 1 -- 172.21.15.42:0/3201879974 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee8073d00 con 0x7f2ee80b51d0 2024-09-17T01:50:57.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.910+0000 7f2ee4c00640 1 -- 172.21.15.42:0/3201879974 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2ed00047a0 con 0x7f2ee80b51d0 2024-09-17T01:50:57.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.911+0000 7f2ee4c00640 1 --2- 172.21.15.42:0/3201879974 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2ec4078bc0 0x7f2ec407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:57.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.911+0000 7f2ee4c00640 1 -- 172.21.15.42:0/3201879974 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7f2ed00bbc70 con 0x7f2ee80b51d0 2024-09-17T01:50:57.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.912+0000 7f2ee7e00640 1 --2- 172.21.15.42:0/3201879974 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2ec4078bc0 0x7f2ec407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:57.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.912+0000 7f2ee7e00640 1 --2- 172.21.15.42:0/3201879974 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2ec4078bc0 0x7f2ec407b0d0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8005fd0 tx=0x7f2ed800f360 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:57.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:57.915+0000 7f2ee4c00640 1 -- 172.21.15.42:0/3201879974 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2ed003f030 con 0x7f2ee80b51d0 2024-09-17T01:50:58.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.107+0000 7f2eed400640 1 -- 172.21.15.42:0/3201879974 --> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2ee80008d0 con 0x7f2ec4078bc0 2024-09-17T01:50:58.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.109+0000 7f2ee4c00640 1 -- 172.21.15.42:0/3201879974 <== mgr.4160 v2:172.21.15.43:6800/1082699944 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13371 (secure 0 0 0) 0x7f2ee80008d0 con 0x7f2ec4078bc0 2024-09-17T01:50:58.107 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:50:58.107 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T01:50:58.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.111+0000 7f2eed400640 1 -- 172.21.15.42:0/3201879974 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2ec4078bc0 msgr2=0x7f2ec407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:58.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.111+0000 7f2eed400640 1 --2- 172.21.15.42:0/3201879974 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2ec4078bc0 0x7f2ec407b0d0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8005fd0 tx=0x7f2ed800f360 comp rx=0 tx=0).stop 2024-09-17T01:50:58.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.111+0000 7f2eed400640 1 -- 172.21.15.42:0/3201879974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ee80b51d0 msgr2=0x7f2ee80acd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:58.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.111+0000 7f2eed400640 1 --2- 172.21.15.42:0/3201879974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ee80b51d0 0x7f2ee80acd00 secure :-1 s=READY pgs=2704 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0009920 tx=0x7f2ed0033c90 comp rx=0 tx=0).stop 2024-09-17T01:50:58.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.111+0000 7f2eed400640 1 -- 172.21.15.42:0/3201879974 shutdown_connections 2024-09-17T01:50:58.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.111+0000 7f2eed400640 1 --2- 172.21.15.42:0/3201879974 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7f2ec4078bc0 0x7f2ec407b0d0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:58.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.111+0000 7f2eed400640 1 --2- 172.21.15.42:0/3201879974 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7f2ee81605c0 0x7f2ee81f2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:58.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.111+0000 7f2eed400640 1 --2- 172.21.15.42:0/3201879974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ee80b51d0 0x7f2ee80acd00 unknown :-1 s=CLOSED pgs=2704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:58.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.111+0000 7f2eed400640 1 --2- 172.21.15.42:0/3201879974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ee80afb00 0x7f2ee81590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:58.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.111+0000 7f2eed400640 1 -- 172.21.15.42:0/3201879974 >> 172.21.15.42:0/3201879974 conn(0x7f2ee806d3f0 msgr2=0x7f2ee8075cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:58.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.112+0000 7f2eed400640 1 -- 172.21.15.42:0/3201879974 shutdown_connections 2024-09-17T01:50:58.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.112+0000 7f2eed400640 1 -- 172.21.15.42:0/3201879974 wait complete. 2024-09-17T01:50:58.131 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":795,"stamp":"2024-09-17T01:50:57.309395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":448248,"kb_used_data":23880,"kb_used_omap":12,"kb_used_meta":424179,"kb_avail":754526472,"statfs":{"total":773094113280,"available":772635107328,"internally_reserved":0,"allocated":24453120,"data_stored":11493552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":434359860},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003038"},"pg_stats":[{"pgid":"1.0","version":"230'74","reported_seq":522,"reported_epoch":230,"state":"active+clean","last_fresh":"2024-09-17T01:50:53.163691+0000","last_change":"2024-09-17T01:50:53.163691+0000","last_active":"2024-09-17T01:50:53.163691+0000","last_peered":"2024-09-17T01:50:53.163691+0000","last_clean":"2024-09-17T01:50:53.163691+0000","last_became_active":"2024-09-17T01:31:56.602255+0000","last_became_peered":"2024-09-17T01:31:56.602255+0000","last_unstale":"2024-09-17T01:50:53.163691+0000","last_undegraded":"2024-09-17T01:50:53.163691+0000","last_fullsized":"2024-09-17T01:50:53.163691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"230'74","last_scrub_stamp":"2024-09-17T01:50:53.163561+0000","last_deep_scrub":"230'74","last_deep_scrub_stamp":"2024-09-17T01:50:53.163561+0000","last_clean_scrub_stamp":"2024-09-17T01:50:53.163561+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:45.208924+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52080,"kb_used_data":2840,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319760,"statfs":{"total":96636764160,"available":96583434240,"internally_reserved":0,"allocated":2908160,"data_stored":1289102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60400,"kb_used_data":2840,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311440,"statfs":{"total":96636764160,"available":96574914560,"internally_reserved":0,"allocated":2908160,"data_stored":1289102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47920,"kb_used_data":2840,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323920,"statfs":{"total":96636764160,"available":96587694080,"internally_reserved":0,"allocated":2908160,"data_stored":1289102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52080,"kb_used_data":2840,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319760,"statfs":{"total":96636764160,"available":96583434240,"internally_reserved":0,"allocated":2908160,"data_stored":1289102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70064,"kb_used_data":2840,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94301776,"statfs":{"total":96636764160,"available":96565018624,"internally_reserved":0,"allocated":2908160,"data_stored":1289102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509670,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52652,"kb_used_data":3420,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319188,"statfs":{"total":96636764160,"available":96582848512,"internally_reserved":0,"allocated":3502080,"data_stored":1879470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60400,"kb_used_data":2840,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311440,"statfs":{"total":96636764160,"available":96574914560,"internally_reserved":0,"allocated":2908160,"data_stored":1289102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":58915273},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542376,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52652,"kb_used_data":3420,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319188,"statfs":{"total":96636764160,"available":96582848512,"internally_reserved":0,"allocated":3502080,"data_stored":1879470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:50:58.135 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-17T01:50:58.357 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.359+0000 7fc25c400640 1 -- 172.21.15.42:0/724345450 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc254072b60 msgr2=0x7fc2540cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:58.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.359+0000 7fc25c400640 1 --2- 172.21.15.42:0/724345450 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc254072b60 0x7fc2540cd620 secure :-1 s=READY pgs=2706 cs=0 l=1 rev1=1 crypto rx=0x7fc240009900 tx=0x7fc24002a600 comp rx=0 tx=0).stop 2024-09-17T01:50:58.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.359+0000 7fc25c400640 1 -- 172.21.15.42:0/724345450 shutdown_connections 2024-09-17T01:50:58.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.359+0000 7fc25c400640 1 --2- 172.21.15.42:0/724345450 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc2540cdb60 0x7fc25406e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:58.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.359+0000 7fc25c400640 1 --2- 172.21.15.42:0/724345450 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc254072b60 0x7fc2540cd620 unknown :-1 s=CLOSED pgs=2706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:58.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.359+0000 7fc25c400640 1 -- 172.21.15.42:0/724345450 >> 172.21.15.42:0/724345450 conn(0x7fc25406d1b0 msgr2=0x7fc25406d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:58.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.359+0000 7fc25c400640 1 -- 172.21.15.42:0/724345450 shutdown_connections 2024-09-17T01:50:58.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.359+0000 7fc25c400640 1 -- 172.21.15.42:0/724345450 wait complete. 2024-09-17T01:50:58.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.361+0000 7fc25c400640 1 Processor -- start 2024-09-17T01:50:58.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.362+0000 7fc25c400640 1 -- start start 2024-09-17T01:50:58.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.363+0000 7fc25c400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc254072b60 0x7fc2541f3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:58.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.363+0000 7fc25c400640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc2540cdb60 0x7fc25415bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:58.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.363+0000 7fc25c400640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc25415dcf0 0x7fc2541426a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:58.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.363+0000 7fc25c400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc25406ef00 con 0x7fc254072b60 2024-09-17T01:50:58.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.363+0000 7fc25c400640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc2541610b0 con 0x7fc25415dcf0 2024-09-17T01:50:58.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.363+0000 7fc25c400640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fc25406f080 con 0x7fc2540cdb60 2024-09-17T01:50:58.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.363+0000 7fc259a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc254072b60 0x7fc2541f3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:58.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.363+0000 7fc259a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc254072b60 0x7fc2541f3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48870/0 (socket says 172.21.15.42:48870) 2024-09-17T01:50:58.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.363+0000 7fc259a00640 1 -- 172.21.15.42:0/3423764657 learned_addr learned my addr 172.21.15.42:0/3423764657 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:58.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.364+0000 7fc25a400640 1 --2- 172.21.15.42:0/3423764657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc25415dcf0 0x7fc2541426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:58.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.364+0000 7fc259000640 1 --2- 172.21.15.42:0/3423764657 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc2540cdb60 0x7fc25415bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:58.362 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.364+0000 7fc259a00640 1 -- 172.21.15.42:0/3423764657 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc2540cdb60 msgr2=0x7fc25415bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:58.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.364+0000 7fc259a00640 1 --2- 172.21.15.42:0/3423764657 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc2540cdb60 0x7fc25415bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:58.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.364+0000 7fc259a00640 1 -- 172.21.15.42:0/3423764657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc25415dcf0 msgr2=0x7fc2541426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:58.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.364+0000 7fc259a00640 1 --2- 172.21.15.42:0/3423764657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc25415dcf0 0x7fc2541426a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:58.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.364+0000 7fc259a00640 1 -- 172.21.15.42:0/3423764657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2540ae660 con 0x7fc254072b60 2024-09-17T01:50:58.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.364+0000 7fc25a400640 1 --2- 172.21.15.42:0/3423764657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc25415dcf0 0x7fc2541426a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:58.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.364+0000 7fc259000640 1 --2- 172.21.15.42:0/3423764657 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc2540cdb60 0x7fc25415bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:58.363 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.364+0000 7fc259a00640 1 --2- 172.21.15.42:0/3423764657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc254072b60 0x7fc2541f3d00 secure :-1 s=READY pgs=2707 cs=0 l=1 rev1=1 crypto rx=0x7fc24800c370 tx=0x7fc24800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:58.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.364+0000 7fc251600640 1 -- 172.21.15.42:0/3423764657 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc248017070 con 0x7fc254072b60 2024-09-17T01:50:58.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.364+0000 7fc251600640 1 -- 172.21.15.42:0/3423764657 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2480053c0 con 0x7fc254072b60 2024-09-17T01:50:58.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.364+0000 7fc251600640 1 -- 172.21.15.42:0/3423764657 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc248003850 con 0x7fc254072b60 2024-09-17T01:50:58.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.364+0000 7fc25c400640 1 -- 172.21.15.42:0/3423764657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2540ae940 con 0x7fc254072b60 2024-09-17T01:50:58.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.365+0000 7fc25c400640 1 -- 172.21.15.42:0/3423764657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2540aef00 con 0x7fc254072b60 2024-09-17T01:50:58.364 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.366+0000 7fc25c400640 1 -- 172.21.15.42:0/3423764657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc25406f570 con 0x7fc254072b60 2024-09-17T01:50:58.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.367+0000 7fc251600640 1 -- 172.21.15.42:0/3423764657 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc24801a070 con 0x7fc254072b60 2024-09-17T01:50:58.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.368+0000 7fc251600640 1 --2- 172.21.15.42:0/3423764657 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc234078b90 0x7fc23407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:58.365 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.368+0000 7fc251600640 1 -- 172.21.15.42:0/3423764657 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7fc248099f00 con 0x7fc254072b60 2024-09-17T01:50:58.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.368+0000 7fc259000640 1 --2- 172.21.15.42:0/3423764657 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc234078b90 0x7fc23407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:58.366 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.369+0000 7fc259000640 1 --2- 172.21.15.42:0/3423764657 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc234078b90 0x7fc23407b0a0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fc240033000 tx=0x7fc240004730 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:58.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.372+0000 7fc251600640 1 -- 172.21.15.42:0/3423764657 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc2540cdf70 con 0x7fc254072b60 2024-09-17T01:50:58.564 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.566+0000 7fc25c400640 1 -- 172.21.15.42:0/3423764657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fc254143500 con 0x7fc254072b60 2024-09-17T01:50:58.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.571+0000 7fc251600640 1 -- 172.21.15.42:0/3423764657 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v71)=0 v71) ==== 123+0+0 (secure 0 0 0) 0x7fc248062540 con 0x7fc254072b60 2024-09-17T01:50:58.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.572+0000 7fc251600640 1 -- 172.21.15.42:0/3423764657 <== mon.0 v2:172.21.15.42:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fc248061950 con 0x7fc254072b60 2024-09-17T01:50:58.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.574+0000 7fc25c400640 1 -- 172.21.15.42:0/3423764657 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc234078b90 msgr2=0x7fc23407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:58.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.574+0000 7fc25c400640 1 --2- 172.21.15.42:0/3423764657 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc234078b90 0x7fc23407b0a0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fc240033000 tx=0x7fc240004730 comp rx=0 tx=0).stop 2024-09-17T01:50:58.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.574+0000 7fc25c400640 1 -- 172.21.15.42:0/3423764657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc254072b60 msgr2=0x7fc2541f3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:58.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.574+0000 7fc25c400640 1 --2- 172.21.15.42:0/3423764657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc254072b60 0x7fc2541f3d00 secure :-1 s=READY pgs=2707 cs=0 l=1 rev1=1 crypto rx=0x7fc24800c370 tx=0x7fc24800c830 comp rx=0 tx=0).stop 2024-09-17T01:50:58.573 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.574+0000 7fc25c400640 1 -- 172.21.15.42:0/3423764657 shutdown_connections 2024-09-17T01:50:58.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.574+0000 7fc25c400640 1 --2- 172.21.15.42:0/3423764657 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fc234078b90 0x7fc23407b0a0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:58.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.574+0000 7fc25c400640 1 --2- 172.21.15.42:0/3423764657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc25415dcf0 0x7fc2541426a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:58.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.574+0000 7fc25c400640 1 --2- 172.21.15.42:0/3423764657 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fc2540cdb60 0x7fc25415bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:58.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.574+0000 7fc25c400640 1 --2- 172.21.15.42:0/3423764657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc254072b60 0x7fc2541f3d00 unknown :-1 s=CLOSED pgs=2707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:58.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.574+0000 7fc25c400640 1 -- 172.21.15.42:0/3423764657 >> 172.21.15.42:0/3423764657 conn(0x7fc25406d1b0 msgr2=0x7fc2540b2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:58.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.574+0000 7fc25c400640 1 -- 172.21.15.42:0/3423764657 shutdown_connections 2024-09-17T01:50:58.574 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.574+0000 7fc25c400640 1 -- 172.21.15.42:0/3423764657 wait complete. 2024-09-17T01:50:58.594 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T01:50:58.594 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T01:50:58.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.824+0000 7fa81b200640 1 -- 172.21.15.42:0/753293261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa81c1605c0 msgr2=0x7fa81c1609d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:58.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.824+0000 7fa81b200640 1 --2- 172.21.15.42:0/753293261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa81c1605c0 0x7fa81c1609d0 secure :-1 s=READY pgs=2709 cs=0 l=1 rev1=1 crypto rx=0x7fa814005fd0 tx=0x7fa81402a820 comp rx=0 tx=0).stop 2024-09-17T01:50:58.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.824+0000 7fa81b200640 1 -- 172.21.15.42:0/753293261 shutdown_connections 2024-09-17T01:50:58.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.824+0000 7fa81b200640 1 --2- 172.21.15.42:0/753293261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa81c1605c0 0x7fa81c1609d0 unknown :-1 s=CLOSED pgs=2709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:58.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.824+0000 7fa81b200640 1 --2- 172.21.15.42:0/753293261 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa81c0b51d0 0x7fa81c0b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:58.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.824+0000 7fa81b200640 1 -- 172.21.15.42:0/753293261 >> 172.21.15.42:0/753293261 conn(0x7fa81c06d3f0 msgr2=0x7fa81c0b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:58.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.824+0000 7fa81b200640 1 -- 172.21.15.42:0/753293261 shutdown_connections 2024-09-17T01:50:58.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.825+0000 7fa81b200640 1 -- 172.21.15.42:0/753293261 wait complete. 2024-09-17T01:50:58.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.827+0000 7fa81b200640 1 Processor -- start 2024-09-17T01:50:58.825 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.827+0000 7fa81b200640 1 -- start start 2024-09-17T01:50:58.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.828+0000 7fa81b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa81c0afb00 0x7fa81c149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:58.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.828+0000 7fa81b200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa81c0b51d0 0x7fa81c06f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:58.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.828+0000 7fa81b200640 1 --2- >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa81c1605c0 0x7fa81c0ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:58.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.828+0000 7fa81b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c0ce700 con 0x7fa81c0afb00 2024-09-17T01:50:58.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.828+0000 7fa81b200640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c0ce580 con 0x7fa81c0b51d0 2024-09-17T01:50:58.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.828+0000 7fa81b200640 1 -- --> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] -- mon_getmap magic: 0 -- 0x7fa81c0ce880 con 0x7fa81c1605c0 2024-09-17T01:50:58.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.829+0000 7fa819e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa81c0afb00 0x7fa81c149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:58.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.829+0000 7fa819e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa81c0afb00 0x7fa81c149dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:48892/0 (socket says 172.21.15.42:48892) 2024-09-17T01:50:58.828 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.829+0000 7fa819e00640 1 -- 172.21.15.42:0/2062310088 learned_addr learned my addr 172.21.15.42:0/2062310088 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-09-17T01:50:58.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.829+0000 7fa813e00640 1 --2- 172.21.15.42:0/2062310088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa81c0b51d0 0x7fa81c06f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:58.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.829+0000 7fa81a800640 1 --2- 172.21.15.42:0/2062310088 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa81c1605c0 0x7fa81c0ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:58.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.829+0000 7fa819e00640 1 -- 172.21.15.42:0/2062310088 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa81c1605c0 msgr2=0x7fa81c0ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:58.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.829+0000 7fa819e00640 1 --2- 172.21.15.42:0/2062310088 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa81c1605c0 0x7fa81c0ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:58.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.829+0000 7fa819e00640 1 -- 172.21.15.42:0/2062310088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa81c0b51d0 msgr2=0x7fa81c06f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:58.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.829+0000 7fa819e00640 1 --2- 172.21.15.42:0/2062310088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa81c0b51d0 0x7fa81c06f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:58.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.829+0000 7fa819e00640 1 -- 172.21.15.42:0/2062310088 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa81c14a310 con 0x7fa81c0afb00 2024-09-17T01:50:58.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.830+0000 7fa819e00640 1 --2- 172.21.15.42:0/2062310088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa81c0afb00 0x7fa81c149dd0 secure :-1 s=READY pgs=2710 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00c3a0 tx=0x7fa80c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:58.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.830+0000 7fa812000640 1 -- 172.21.15.42:0/2062310088 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c011790 con 0x7fa81c0afb00 2024-09-17T01:50:58.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.830+0000 7fa812000640 1 -- 172.21.15.42:0/2062310088 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fa80c017070 con 0x7fa81c0afb00 2024-09-17T01:50:58.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.830+0000 7fa812000640 1 -- 172.21.15.42:0/2062310088 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c011bf0 con 0x7fa81c0afb00 2024-09-17T01:50:58.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.830+0000 7fa81b200640 1 -- 172.21.15.42:0/2062310088 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa81c1f9450 con 0x7fa81c0afb00 2024-09-17T01:50:58.829 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.830+0000 7fa81b200640 1 -- 172.21.15.42:0/2062310088 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa81c1f9a10 con 0x7fa81c0afb00 2024-09-17T01:50:58.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.831+0000 7fa81b200640 1 -- 172.21.15.42:0/2062310088 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa81c0b58a0 con 0x7fa81c0afb00 2024-09-17T01:50:58.830 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.832+0000 7fa812000640 1 -- 172.21.15.42:0/2062310088 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa80c01c460 con 0x7fa81c0afb00 2024-09-17T01:50:58.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.833+0000 7fa812000640 1 --2- 172.21.15.42:0/2062310088 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa7f8078b90 0x7fa7f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:58.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.833+0000 7fa812000640 1 -- 172.21.15.42:0/2062310088 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 5029+0+0 (secure 0 0 0) 0x7fa80c09a760 con 0x7fa81c0afb00 2024-09-17T01:50:58.831 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.834+0000 7fa813e00640 1 --2- 172.21.15.42:0/2062310088 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa7f8078b90 0x7fa7f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:58.832 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.835+0000 7fa813e00640 1 --2- 172.21.15.42:0/2062310088 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa7f8078b90 0x7fa7f807b0a0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fa81c1f3800 tx=0x7fa804005f90 comp rx=0 tx=0).ready entity=mgr.4160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:58.835 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:58.838+0000 7fa812000640 1 -- 172.21.15.42:0/2062310088 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa81c0b58a0 con 0x7fa81c0afb00 2024-09-17T01:50:59.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:59.069+0000 7fa81b200640 1 -- 172.21.15.42:0/2062310088 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa81c0b55e0 con 0x7fa81c0afb00 2024-09-17T01:50:59.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:59.070+0000 7fa812000640 1 -- 172.21.15.42:0/2062310088 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 185 v185) ==== 95+0+3918 (secure 0 0 0) 0x7fa81c160f10 con 0x7fa81c0afb00 2024-09-17T01:50:59.068 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T01:50:59.068 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":185,"btime":"2024-09-17T01:50:42:509840+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9479,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1690107508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1690107508},{"type":"v1","addr":"172.21.15.43:6837","nonce":1690107508}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":179},{"gid":9668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3582046192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3582046192},{"type":"v1","addr":"172.21.15.43:6836","nonce":3582046192}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":185},{"gid":11511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/1418140325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":1418140325},{"type":"v1","addr":"172.21.15.42:6833","nonce":1418140325}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":171},{"gid":11514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/2781042225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":2781042225},{"type":"v1","addr":"172.21.15.42:6835","nonce":2781042225}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":172}],"filesystems":[]} 2024-09-17T01:50:59.068 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 185 2024-09-17T01:50:59.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:59.072+0000 7fa81b200640 1 -- 172.21.15.42:0/2062310088 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa7f8078b90 msgr2=0x7fa7f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:59.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:59.072+0000 7fa81b200640 1 --2- 172.21.15.42:0/2062310088 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa7f8078b90 0x7fa7f807b0a0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fa81c1f3800 tx=0x7fa804005f90 comp rx=0 tx=0).stop 2024-09-17T01:50:59.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:59.072+0000 7fa81b200640 1 -- 172.21.15.42:0/2062310088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa81c0afb00 msgr2=0x7fa81c149dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:59.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:59.072+0000 7fa81b200640 1 --2- 172.21.15.42:0/2062310088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa81c0afb00 0x7fa81c149dd0 secure :-1 s=READY pgs=2710 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00c3a0 tx=0x7fa80c00c860 comp rx=0 tx=0).stop 2024-09-17T01:50:59.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:59.072+0000 7fa81b200640 1 -- 172.21.15.42:0/2062310088 shutdown_connections 2024-09-17T01:50:59.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:59.072+0000 7fa81b200640 1 --2- 172.21.15.42:0/2062310088 >> [v2:172.21.15.43:6800/1082699944,v1:172.21.15.43:6801/1082699944] conn(0x7fa7f8078b90 0x7fa7f807b0a0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:59.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:59.072+0000 7fa81b200640 1 --2- 172.21.15.42:0/2062310088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa81c0b51d0 0x7fa81c06f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:59.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:59.072+0000 7fa81b200640 1 --2- 172.21.15.42:0/2062310088 >> [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] conn(0x7fa81c1605c0 0x7fa81c0ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:59.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:59.072+0000 7fa81b200640 1 --2- 172.21.15.42:0/2062310088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa81c0afb00 0x7fa81c149dd0 unknown :-1 s=CLOSED pgs=2710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:59.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:59.072+0000 7fa81b200640 1 -- 172.21.15.42:0/2062310088 >> 172.21.15.42:0/2062310088 conn(0x7fa81c06d3f0 msgr2=0x7fa81c0cee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:59.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:59.072+0000 7fa81b200640 1 -- 172.21.15.42:0/2062310088 shutdown_connections 2024-09-17T01:50:59.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-09-17T01:50:59.072+0000 7fa81b200640 1 -- 172.21.15.42:0/2062310088 wait complete. 2024-09-17T01:50:59.092 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-17T01:50:59.093 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-17T01:50:59.093 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T01:50:59.093 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:50:59.113 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T01:50:59.114 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T01:50:59.114 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:50:59.177 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T01:50:59.177 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T01:50:59.177 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:50:59.202 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T01:50:59.202 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T01:50:59.202 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:50:59.267 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T01:50:59.267 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-17T01:50:59.268 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-17T01:50:59.268 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:50:59.326 INFO:tasks.ceph.osd.0:Stopped 2024-09-17T01:50:59.326 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-17T01:50:59.327 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:50:59.391 INFO:tasks.ceph.osd.1:Stopped 2024-09-17T01:50:59.391 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-17T01:50:59.391 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:50:59.450 INFO:tasks.ceph.osd.2:Stopped 2024-09-17T01:50:59.450 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-17T01:50:59.450 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:50:59.515 INFO:tasks.ceph.osd.3:Stopped 2024-09-17T01:50:59.516 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-17T01:50:59.516 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:50:59.577 INFO:tasks.ceph.osd.4:Stopped 2024-09-17T01:50:59.578 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-17T01:50:59.578 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:50:59.646 INFO:tasks.ceph.osd.5:Stopped 2024-09-17T01:50:59.646 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-17T01:50:59.646 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:50:59.718 INFO:tasks.ceph.osd.6:Stopped 2024-09-17T01:50:59.719 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-17T01:50:59.719 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:50:59.778 INFO:tasks.ceph.osd.7:Stopped 2024-09-17T01:50:59.778 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-17T01:50:59.779 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-17T01:50:59.779 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:50:59.856 INFO:tasks.ceph.mgr.y:Stopped 2024-09-17T01:50:59.856 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-17T01:50:59.856 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:50:59.935 INFO:tasks.ceph.mgr.x:Stopped 2024-09-17T01:50:59.935 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-17T01:50:59.935 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-17T01:50:59.935 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:50:59.966 INFO:tasks.ceph.mon.a:Stopped 2024-09-17T01:50:59.966 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-17T01:50:59.966 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:50:59.993 INFO:tasks.ceph.mon.b:Stopped 2024-09-17T01:50:59.993 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-17T01:50:59.993 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:51:00.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-17T01:51:00.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-17T01:51:00.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-17T01:51:00.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-17T01:51:00.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-17T01:51:00.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-17T01:51:00.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-17T01:51:00.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-17T01:51:00.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-17T01:51:00.062 INFO:tasks.ceph.mon.c:Stopped 2024-09-17T01:51:00.062 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-17T01:51:00.062 DEBUG:teuthology.orchestra.run.smithi042:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2024-09-17T01:51:00.149 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:51:00.149 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-17T01:51:00.493 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:51:00.493 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-17T01:51:00.614 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:51:00.614 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-17T01:51:00.728 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:51:00.728 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-17T01:51:00.853 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T01:51:00.854 DEBUG:teuthology.orchestra.run.smithi043:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-17T01:51:01.032 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T01:51:01.032 DEBUG:teuthology.orchestra.run.smithi043:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-17T01:51:01.143 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T01:51:01.144 DEBUG:teuthology.orchestra.run.smithi043:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-17T01:51:01.251 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T01:51:01.251 DEBUG:teuthology.orchestra.run.smithi043:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-17T01:51:01.367 INFO:tasks.ceph:Archiving mon data... 2024-09-17T01:51:01.368 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908333/data/mon.a.tgz 2024-09-17T01:51:01.368 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-09-17T01:51:01.405 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.kKrKTIOXKV 2024-09-17T01:51:01.406 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.kKrKTIOXKV 2024-09-17T01:51:01.614 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.kKrKTIOXKV 2024-09-17T01:51:01.708 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.kKrKTIOXKV is 503KB 2024-09-17T01:51:01.799 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.kKrKTIOXKV 2024-09-17T01:51:01.834 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908333/data/mon.b.tgz 2024-09-17T01:51:01.834 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-09-17T01:51:01.870 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.caWq7Xd2P8 2024-09-17T01:51:01.871 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.caWq7Xd2P8 2024-09-17T01:51:02.078 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.caWq7Xd2P8 2024-09-17T01:51:02.173 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.caWq7Xd2P8 is 508KB 2024-09-17T01:51:02.274 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.caWq7Xd2P8 2024-09-17T01:51:02.308 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908333/data/mon.c.tgz 2024-09-17T01:51:02.309 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-09-17T01:51:02.382 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.35NPDtuDI1 2024-09-17T01:51:02.383 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.35NPDtuDI1 2024-09-17T01:51:02.582 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.35NPDtuDI1 2024-09-17T01:51:02.679 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.35NPDtuDI1 is 508KB 2024-09-17T01:51:02.769 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.35NPDtuDI1 2024-09-17T01:51:02.804 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-17T01:51:02.804 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T01:51:02.809 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T01:51:02.937 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T01:51:02.971 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T01:51:02.972 INFO:tasks.ceph:Archiving crash dumps... 2024-09-17T01:51:02.973 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908333/remote/smithi042/crash 2024-09-17T01:51:02.974 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T01:51:03.032 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908333/remote/smithi043/crash 2024-09-17T01:51:03.033 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T01:51:03.087 INFO:tasks.ceph:Shutting down logrotate 2024-09-17T01:51:03.088 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:51:03.092 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T01:51:03.182 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T01:51:03.238 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T01:51:03.293 INFO:tasks.ceph:Compressing logs... 2024-09-17T01:51:03.293 DEBUG:teuthology.orchestra.run.smithi042:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T01:51:03.298 DEBUG:teuthology.orchestra.run.smithi043:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T01:51:03.350 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108265.log 2024-09-17T01:51:03.350 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-17T01:51:03.351 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36087.log 2024-09-17T01:51:03.352 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.108265.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108265.log.gz 2024-09-17T01:51:03.352 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110758.log 2024-09-17T01:51:03.354 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-17T01:51:03.354 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36087.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-17T01:51:03.354 INFO:teuthology.orchestra.run.smithi043.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36087.log.gz 2024-09-17T01:51:03.354 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110429.log 2024-09-17T01:51:03.354 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.110758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44175.log 2024-09-17T01:51:03.354 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110758.log.gz 2024-09-17T01:51:03.356 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.40961.log 2024-09-17T01:51:03.356 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-17T01:51:03.356 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.3.40961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.40961.log.gz 2024-09-17T01:51:03.356 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T01:51:03.357 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.110429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112156.log 2024-09-17T01:51:03.357 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.110429.log.gz 2024-09-17T01:51:03.357 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68759.log 2024-09-17T01:51:03.357 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44175.log.gz 2024-09-17T01:51:03.358 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36007.log 2024-09-17T01:51:03.358 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-17T01:51:03.359 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.112156.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.112156.log.gz 2024-09-17T01:51:03.359 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44901.log 2024-09-17T01:51:03.359 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.68759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107379.log 2024-09-17T01:51:03.359 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68759.log.gz 2024-09-17T01:51:03.359 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44901.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44901.log.gz 2024-09-17T01:51:03.359 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84496.log 2024-09-17T01:51:03.360 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40562.log 2024-09-17T01:51:03.360 INFO:teuthology.orchestra.run.smithi043.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36007.log.gz 2024-09-17T01:51:03.361 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.107379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67542.log 2024-09-17T01:51:03.361 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107379.log.gz 2024-09-17T01:51:03.361 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.84496.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.84496.log.gz 2024-09-17T01:51:03.361 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99799.log 2024-09-17T01:51:03.362 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36247.log 2024-09-17T01:51:03.362 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.1.40562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.40562.log.gz 2024-09-17T01:51:03.363 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35967.log 2024-09-17T01:51:03.364 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36247.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36247.log.gz 2024-09-17T01:51:03.364 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-17T01:51:03.365 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.67542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101897.log 2024-09-17T01:51:03.365 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67542.log.gz 2024-09-17T01:51:03.365 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.99799.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.99799.log.gz 2024-09-17T01:51:03.365 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85803.log 2024-09-17T01:51:03.365 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.101897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108648.log 2024-09-17T01:51:03.365 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.101897.log.gz 2024-09-17T01:51:03.366 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.85803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96221.log 2024-09-17T01:51:03.366 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.85803.log.gz 2024-09-17T01:51:03.367 INFO:teuthology.orchestra.run.smithi043.stderr: 94.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T01:51:03.367 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.35967.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-17T01:51:03.367 INFO:teuthology.orchestra.run.smithi043.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.35967.log.gz 2024-09-17T01:51:03.367 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T01:51:03.367 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40543.log 2024-09-17T01:51:03.369 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.108648.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.108648.log.gz 2024-09-17T01:51:03.369 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94338.log 2024-09-17T01:51:03.369 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.96221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41835.log 2024-09-17T01:51:03.369 INFO:teuthology.orchestra.run.smithi042.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.96221.log.gz 2024-09-17T01:51:03.369 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.94338.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.94338.log.gz 2024-09-17T01:51:03.369 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94590.log 2024-09-17T01:51:03.371 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.1.40543.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-17T01:51:03.371 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94506.log 2024-09-17T01:51:03.371 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41835.log.gz 2024-09-17T01:51:03.371 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.94590.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94590.log.gz 2024-09-17T01:51:03.371 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61329.log 2024-09-17T01:51:03.372 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.94506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81621.log 2024-09-17T01:51:03.372 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94506.log.gz 2024-09-17T01:51:03.373 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mds.d.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.40543.log.gz 2024-09-17T01:51:03.373 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-17T01:51:03.375 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-17T01:51:03.375 INFO:teuthology.orchestra.run.smithi043.stderr: 92.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T01:51:03.376 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.61329.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61329.log.gz 2024-09-17T01:51:03.376 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77250.log 2024-09-17T01:51:03.376 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87277.log 2024-09-17T01:51:03.376 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.81621.log: /var/log/ceph/ceph-client.admin.77250.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.81621.log.gz 2024-09-17T01:51:03.376 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59701.log 2024-09-17T01:51:03.376 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.77250.log.gz 2024-09-17T01:51:03.376 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.87277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.87277.log.gz 2024-09-17T01:51:03.376 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104961.log 2024-09-17T01:51:03.377 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.59701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111010.log 2024-09-17T01:51:03.377 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.59701.log.gz 2024-09-17T01:51:03.378 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.104961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45842.log 2024-09-17T01:51:03.378 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.104961.log.gz 2024-09-17T01:51:03.378 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.111010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53122.log 2024-09-17T01:51:03.378 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111010.log.gz 2024-09-17T01:51:03.379 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63409.log 2024-09-17T01:51:03.379 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.53122.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.45842.log.gz 2024-09-17T01:51:03.380 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53122.log.gz 2024-09-17T01:51:03.380 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86637.log 2024-09-17T01:51:03.381 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.63409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61683.log 2024-09-17T01:51:03.381 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63409.log.gz 2024-09-17T01:51:03.382 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.86637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64015.log 2024-09-17T01:51:03.382 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.86637.log.gz 2024-09-17T01:51:03.383 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.61683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110926.log 2024-09-17T01:51:03.383 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61683.log.gz 2024-09-17T01:51:03.383 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.64015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64015.log.gz 2024-09-17T01:51:03.384 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84881.log 2024-09-17T01:51:03.384 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.110926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100027.log 2024-09-17T01:51:03.385 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.110926.log.gz 2024-09-17T01:51:03.385 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.84881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60191.log 2024-09-17T01:51:03.385 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.84881.log.gz 2024-09-17T01:51:03.386 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.100027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54525.log 2024-09-17T01:51:03.387 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36047.log 2024-09-17T01:51:03.387 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.40957.log 2024-09-17T01:51:03.387 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36127.log 2024-09-17T01:51:03.387 INFO:teuthology.orchestra.run.smithi043.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36047.log.gz 2024-09-17T01:51:03.387 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.100027.log.gz 2024-09-17T01:51:03.388 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.60191.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.60191.log.gz 2024-09-17T01:51:03.388 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36188.log 2024-09-17T01:51:03.389 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.54525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80320.log 2024-09-17T01:51:03.389 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54525.log.gz 2024-09-17T01:51:03.389 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36188.log.gz 2024-09-17T01:51:03.389 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55246.log 2024-09-17T01:51:03.389 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.80320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108522.log 2024-09-17T01:51:03.390 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.80320.log.gz 2024-09-17T01:51:03.390 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.55246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77725.log 2024-09-17T01:51:03.391 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.3.40957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.40957.log.gz 2024-09-17T01:51:03.392 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.55246.log.gz 2024-09-17T01:51:03.392 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.108522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103032.log 2024-09-17T01:51:03.392 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108522.log.gz 2024-09-17T01:51:03.393 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36127.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36127.log.gz 2024-09-17T01:51:03.393 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.77725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54465.log 2024-09-17T01:51:03.393 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.103032.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.77725.log.gz 2024-09-17T01:51:03.394 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103032.log.gz 2024-09-17T01:51:03.394 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64110.log 2024-09-17T01:51:03.394 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.54465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57752.log 2024-09-17T01:51:03.394 INFO:teuthology.orchestra.run.smithi042.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.54465.log.gz 2024-09-17T01:51:03.395 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.64110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59239.log 2024-09-17T01:51:03.396 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36167.log 2024-09-17T01:51:03.396 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.64110.log.gz 2024-09-17T01:51:03.396 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.57752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104825.log 2024-09-17T01:51:03.397 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57752.log.gz 2024-09-17T01:51:03.398 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36207.log 2024-09-17T01:51:03.399 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.59239.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.59239.log.gz 2024-09-17T01:51:03.399 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90266.log 2024-09-17T01:51:03.399 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.104825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65033.log 2024-09-17T01:51:03.399 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.104825.log.gz 2024-09-17T01:51:03.399 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.90266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95796.log 2024-09-17T01:51:03.399 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90266.log.gz 2024-09-17T01:51:03.400 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.65033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56795.log 2024-09-17T01:51:03.400 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.65033.log.gz 2024-09-17T01:51:03.401 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.95796.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.95796.log.gz 2024-09-17T01:51:03.401 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103161.log 2024-09-17T01:51:03.401 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36167.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36167.log.gz 2024-09-17T01:51:03.402 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.56795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41564.log 2024-09-17T01:51:03.402 INFO:teuthology.orchestra.run.smithi042.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.56795.log.gz 2024-09-17T01:51:03.402 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.103161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44301.log 2024-09-17T01:51:03.402 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.103161.log.gz 2024-09-17T01:51:03.403 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.36207.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36207.log.gz 2024-09-17T01:51:03.404 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35712.log 2024-09-17T01:51:03.404 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41564.log.gz 2024-09-17T01:51:03.404 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44301.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44301.log.gz 2024-09-17T01:51:03.404 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82017.log 2024-09-17T01:51:03.405 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.35712.log: 74.5% -- replaced with /var/log/ceph/ceph-client.admin.35712.log.gzgzip 2024-09-17T01:51:03.405 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.75700.log 2024-09-17T01:51:03.405 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.82017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53756.log 2024-09-17T01:51:03.406 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.75700.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.82017.log.gz 2024-09-17T01:51:03.406 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81312.log 2024-09-17T01:51:03.406 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.75700.log.gz 2024-09-17T01:51:03.407 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.53756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67367.log 2024-09-17T01:51:03.407 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53756.log.gz 2024-09-17T01:51:03.408 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.81312.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.81312.log.gz 2024-09-17T01:51:03.408 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54171.log 2024-09-17T01:51:03.409 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.67367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112073.log 2024-09-17T01:51:03.409 INFO:teuthology.orchestra.run.smithi042.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67367.log.gz 2024-09-17T01:51:03.410 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.54171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58370.log 2024-09-17T01:51:03.410 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54171.log.gz 2024-09-17T01:51:03.411 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.112073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81225.log 2024-09-17T01:51:03.411 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.112073.log.gz 2024-09-17T01:51:03.411 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.58370.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58370.log.gz 2024-09-17T01:51:03.412 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41264.log 2024-09-17T01:51:03.412 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.81225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89071.log 2024-09-17T01:51:03.413 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.81225.log.gz 2024-09-17T01:51:03.413 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110842.log 2024-09-17T01:51:03.413 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41264.log.gz 2024-09-17T01:51:03.414 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.89071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45250.log 2024-09-17T01:51:03.415 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.110842.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.89071.log.gz 2024-09-17T01:51:03.415 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.110842.log.gz 2024-09-17T01:51:03.415 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64823.log 2024-09-17T01:51:03.416 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58885.log 2024-09-17T01:51:03.416 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45250.log.gz 2024-09-17T01:51:03.417 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.64823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95568.log 2024-09-17T01:51:03.417 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.64823.log.gz 2024-09-17T01:51:03.418 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.58885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106645.log 2024-09-17T01:51:03.418 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58885.log.gz 2024-09-17T01:51:03.418 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.95568.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.95568.log.gz 2024-09-17T01:51:03.419 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58275.log 2024-09-17T01:51:03.420 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.106645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110800.log 2024-09-17T01:51:03.420 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.106645.log.gz 2024-09-17T01:51:03.420 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.58275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86683.log 2024-09-17T01:51:03.421 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.58275.log.gz 2024-09-17T01:51:03.421 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.110800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109561.log 2024-09-17T01:51:03.422 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.110800.log.gz 2024-09-17T01:51:03.422 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.86683.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.86683.log.gz 2024-09-17T01:51:03.422 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90098.log 2024-09-17T01:51:03.423 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.109561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82275.log 2024-09-17T01:51:03.423 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.109561.log.gz 2024-09-17T01:51:03.424 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.90098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100286.log 2024-09-17T01:51:03.424 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.90098.log.gz 2024-09-17T01:51:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.82275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.82275.log.gz 2024-09-17T01:51:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54717.log 2024-09-17T01:51:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.100286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62588.log 2024-09-17T01:51:03.426 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100286.log.gz 2024-09-17T01:51:03.427 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.54717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63651.log 2024-09-17T01:51:03.427 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54717.log.gz 2024-09-17T01:51:03.427 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.62588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107057.log 2024-09-17T01:51:03.428 INFO:teuthology.orchestra.run.smithi042.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.62588.log.gz 2024-09-17T01:51:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.63651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77162.log 2024-09-17T01:51:03.429 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63651.log.gz 2024-09-17T01:51:03.429 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.107057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66022.log 2024-09-17T01:51:03.430 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.107057.log.gz 2024-09-17T01:51:03.430 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.77162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68023.log 2024-09-17T01:51:03.430 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77162.log.gz 2024-09-17T01:51:03.431 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.66022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62714.log 2024-09-17T01:51:03.431 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.66022.log.gz 2024-09-17T01:51:03.432 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.68023.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68023.log.gz 2024-09-17T01:51:03.432 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54129.log 2024-09-17T01:51:03.433 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.62714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45590.log 2024-09-17T01:51:03.433 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62714.log.gz 2024-09-17T01:51:03.434 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.54129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52758.log 2024-09-17T01:51:03.434 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54129.log.gz 2024-09-17T01:51:03.435 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111498.log 2024-09-17T01:51:03.435 INFO:teuthology.orchestra.run.smithi042.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.45590.log.gz 2024-09-17T01:51:03.436 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.52758.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52758.log.gz 2024-09-17T01:51:03.436 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67093.log 2024-09-17T01:51:03.436 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.111498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68149.log 2024-09-17T01:51:03.437 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.111498.log.gz 2024-09-17T01:51:03.437 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.67093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56184.log 2024-09-17T01:51:03.437 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67093.log.gz 2024-09-17T01:51:03.438 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.68149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60192.log 2024-09-17T01:51:03.439 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68149.log.gz 2024-09-17T01:51:03.439 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.56184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76298.log 2024-09-17T01:51:03.440 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.56184.log.gz 2024-09-17T01:51:03.440 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.60192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104700.log 2024-09-17T01:51:03.440 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.60192.log.gz 2024-09-17T01:51:03.441 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.76298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61058.log 2024-09-17T01:51:03.441 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.76298.log.gz 2024-09-17T01:51:03.442 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.104700.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.104700.log.gz 2024-09-17T01:51:03.442 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41905.log 2024-09-17T01:51:03.443 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.61058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57710.log 2024-09-17T01:51:03.443 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61058.log.gz 2024-09-17T01:51:03.444 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85091.log 2024-09-17T01:51:03.444 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41905.log.gz 2024-09-17T01:51:03.445 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.57710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76485.log 2024-09-17T01:51:03.445 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57710.log.gz 2024-09-17T01:51:03.446 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.85091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76916.log 2024-09-17T01:51:03.446 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.85091.log.gz 2024-09-17T01:51:03.446 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.76485.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.76485.log.gz 2024-09-17T01:51:03.446 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57836.log 2024-09-17T01:51:03.447 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.76916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45506.log 2024-09-17T01:51:03.447 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.76916.log.gz 2024-09-17T01:51:03.448 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.57836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95423.log 2024-09-17T01:51:03.448 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.57836.log.gz 2024-09-17T01:51:03.449 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56142.log 2024-09-17T01:51:03.449 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45506.log.gz 2024-09-17T01:51:03.450 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.95423.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.95423.log.gz 2024-09-17T01:51:03.450 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55378.log 2024-09-17T01:51:03.451 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.56142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91985.log 2024-09-17T01:51:03.451 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.56142.log.gz 2024-09-17T01:51:03.451 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.55378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67051.log 2024-09-17T01:51:03.452 INFO:teuthology.orchestra.run.smithi042.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.55378.log.gz 2024-09-17T01:51:03.453 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.91985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66804.log 2024-09-17T01:51:03.453 INFO:teuthology.orchestra.run.smithi042.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.91985.log.gz 2024-09-17T01:51:03.453 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.67051.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.67051.log.gz 2024-09-17T01:51:03.454 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41561.log 2024-09-17T01:51:03.454 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.66804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80801.log 2024-09-17T01:51:03.454 INFO:teuthology.orchestra.run.smithi042.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.66804.log.gz 2024-09-17T01:51:03.456 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109887.log 2024-09-17T01:51:03.457 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.41561.log.gz 2024-09-17T01:51:03.457 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.80801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41096.log 2024-09-17T01:51:03.457 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.80801.log.gz 2024-09-17T01:51:03.457 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.109887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53020.log 2024-09-17T01:51:03.457 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.109887.log.gz 2024-09-17T01:51:03.458 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109442.log 2024-09-17T01:51:03.458 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41096.log.gz 2024-09-17T01:51:03.460 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.53020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101171.log 2024-09-17T01:51:03.460 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53020.log.gz 2024-09-17T01:51:03.460 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.109442.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.109442.log.gz 2024-09-17T01:51:03.460 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54651.log 2024-09-17T01:51:03.461 INFO:teuthology.orchestra.run.smithi043.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-17T01:51:03.461 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.101171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89972.log 2024-09-17T01:51:03.461 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0%/var/log/ceph/ceph-client.admin.54651.log: -- replaced with /var/log/ceph/ceph-client.admin.101171.log.gz 2024-09-17T01:51:03.461 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65872.log 2024-09-17T01:51:03.462 INFO:teuthology.orchestra.run.smithi042.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.54651.log.gz 2024-09-17T01:51:03.462 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.89972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87085.log 2024-09-17T01:51:03.462 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.89972.log.gz 2024-09-17T01:51:03.463 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.65872.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.65872.log.gz 2024-09-17T01:51:03.463 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106123.log 2024-09-17T01:51:03.464 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.87085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56613.log 2024-09-17T01:51:03.464 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.87085.log.gz 2024-09-17T01:51:03.465 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.106123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110237.log 2024-09-17T01:51:03.465 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.106123.log.gz 2024-09-17T01:51:03.465 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.56613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111947.log 2024-09-17T01:51:03.466 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56613.log.gz 2024-09-17T01:51:03.466 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.110237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61641.log 2024-09-17T01:51:03.467 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.111947.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.110237.log.gz 2024-09-17T01:51:03.467 INFO:teuthology.orchestra.run.smithi042.stderr:gzip 87.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.111947.log.gz --verbose 2024-09-17T01:51:03.467 INFO:teuthology.orchestra.run.smithi042.stderr: -- /var/log/ceph/ceph-client.admin.103554.log 2024-09-17T01:51:03.468 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.61641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84268.log 2024-09-17T01:51:03.468 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61641.log.gz 2024-09-17T01:51:03.469 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.103554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81022.log 2024-09-17T01:51:03.469 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.103554.log.gz 2024-09-17T01:51:03.470 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.84268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64011.log 2024-09-17T01:51:03.470 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84268.log.gz 2024-09-17T01:51:03.471 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.81022.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.81022.log.gz 2024-09-17T01:51:03.471 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53946.log 2024-09-17T01:51:03.472 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.64011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64011.log.gz 2024-09-17T01:51:03.472 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84796.log 2024-09-17T01:51:03.472 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.53946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57939.log 2024-09-17T01:51:03.473 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53946.log.gz 2024-09-17T01:51:03.473 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.84796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95975.log 2024-09-17T01:51:03.473 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.84796.log.gz 2024-09-17T01:51:03.474 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.57939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95652.log 2024-09-17T01:51:03.474 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57939.log.gz 2024-09-17T01:51:03.475 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.95975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68576.log 2024-09-17T01:51:03.475 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.95975.log.gz 2024-09-17T01:51:03.476 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.95652.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95652.log.gz 2024-09-17T01:51:03.476 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-17T01:51:03.477 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.68576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53860.log 2024-09-17T01:51:03.477 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68576.log.gz 2024-09-17T01:51:03.478 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36158.log 2024-09-17T01:51:03.479 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.53860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105866.log 2024-09-17T01:51:03.479 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53860.log.gz 2024-09-17T01:51:03.479 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62504.log 2024-09-17T01:51:03.480 INFO:teuthology.orchestra.run.smithi042.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.36158.log.gz 2024-09-17T01:51:03.481 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.105866.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105866.log.gz 2024-09-17T01:51:03.481 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60627.log 2024-09-17T01:51:03.482 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.62504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52894.log 2024-09-17T01:51:03.482 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.62504.log.gz 2024-09-17T01:51:03.483 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.60627.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60627.log.gz 2024-09-17T01:51:03.483 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99677.log 2024-09-17T01:51:03.484 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.52894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78005.log 2024-09-17T01:51:03.484 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52894.log.gz 2024-09-17T01:51:03.485 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.99677.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.99677.log.gz 2024-09-17T01:51:03.485 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43346.log 2024-09-17T01:51:03.486 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.78005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.78005.log.gz 2024-09-17T01:51:03.486 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59623.log 2024-09-17T01:51:03.487 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.2.43346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.43346.log.gz 2024-09-17T01:51:03.487 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77515.log 2024-09-17T01:51:03.488 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.59623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59623.log.gz 2024-09-17T01:51:03.488 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68843.log 2024-09-17T01:51:03.489 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.77515.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77515.log.gz 2024-09-17T01:51:03.489 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108816.log 2024-09-17T01:51:03.489 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.68843.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68843.log.gz 2024-09-17T01:51:03.489 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94838.log 2024-09-17T01:51:03.490 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.108816.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.108816.log.gz 2024-09-17T01:51:03.490 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104307.log 2024-09-17T01:51:03.491 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.94838.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.94838.log.gzgzip 2024-09-17T01:51:03.492 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.104106.log 2024-09-17T01:51:03.492 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.104307.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.104307.log.gz 2024-09-17T01:51:03.492 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66985.log 2024-09-17T01:51:03.499 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.104106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.104106.log.gz 2024-09-17T01:51:03.500 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100835.log 2024-09-17T01:51:03.500 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.66985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92447.log 2024-09-17T01:51:03.500 INFO:teuthology.orchestra.run.smithi042.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.66985.log.gz 2024-09-17T01:51:03.500 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.100835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61981.log 2024-09-17T01:51:03.500 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.100835.log.gz 2024-09-17T01:51:03.500 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.92447.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.92447.log.gz 2024-09-17T01:51:03.500 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103764.log 2024-09-17T01:51:03.500 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.61981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100409.log 2024-09-17T01:51:03.500 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61981.log.gz 2024-09-17T01:51:03.500 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.103764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44755.log 2024-09-17T01:51:03.500 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.103764.log.gz 2024-09-17T01:51:03.500 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.100409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107421.log 2024-09-17T01:51:03.501 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.100409.log.gz 2024-09-17T01:51:03.502 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44755.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44755.log.gz 2024-09-17T01:51:03.502 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98812.log 2024-09-17T01:51:03.502 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.107421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41570.log 2024-09-17T01:51:03.502 INFO:teuthology.orchestra.run.smithi042.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.107421.log.gz 2024-09-17T01:51:03.502 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.98812.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.98812.log.gz 2024-09-17T01:51:03.502 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44008.log 2024-09-17T01:51:03.503 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67177.log 2024-09-17T01:51:03.503 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.41570.log.gz 2024-09-17T01:51:03.504 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44008.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44008.log.gz 2024-09-17T01:51:03.504 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86977.log 2024-09-17T01:51:03.505 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.67177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43693.log 2024-09-17T01:51:03.505 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67177.log.gz 2024-09-17T01:51:03.505 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.86977.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.86977.log.gz 2024-09-17T01:51:03.506 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85574.log 2024-09-17T01:51:03.506 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68885.log 2024-09-17T01:51:03.507 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43693.log.gz 2024-09-17T01:51:03.507 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.85574.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.85574.log.gz 2024-09-17T01:51:03.508 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86809.log 2024-09-17T01:51:03.509 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.68885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60431.log 2024-09-17T01:51:03.509 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68885.log.gz 2024-09-17T01:51:03.509 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.86809.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.86809.log.gz 2024-09-17T01:51:03.509 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109761.log 2024-09-17T01:51:03.510 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.60431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67939.log 2024-09-17T01:51:03.510 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60431.log.gz 2024-09-17T01:51:03.511 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.109761.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.109761.log.gz 2024-09-17T01:51:03.511 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108564.log 2024-09-17T01:51:03.512 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.67939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81747.log 2024-09-17T01:51:03.512 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67939.log.gz 2024-09-17T01:51:03.513 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.108564.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108564.log.gz 2024-09-17T01:51:03.513 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85845.log 2024-09-17T01:51:03.514 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.81747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80675.log 2024-09-17T01:51:03.514 INFO:teuthology.orchestra.run.smithi042.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.81747.log.gz 2024-09-17T01:51:03.515 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.85845.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.85845.log.gz 2024-09-17T01:51:03.515 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86725.log 2024-09-17T01:51:03.516 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.80675.log: gzip -5 --verbose 87.6% -- -- replaced with /var/log/ceph/ceph-client.admin.80675.log.gz /var/log/ceph/ceph-client.0.109172.log 2024-09-17T01:51:03.516 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-09-17T01:51:03.517 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.86725.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.86725.log.gz 2024-09-17T01:51:03.517 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80633.log 2024-09-17T01:51:03.518 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.109172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.109172.log.gz 2024-09-17T01:51:03.518 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91775.log 2024-09-17T01:51:03.519 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.80633.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.80633.log.gz 2024-09-17T01:51:03.519 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109719.log 2024-09-17T01:51:03.520 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.91775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57626.log 2024-09-17T01:51:03.520 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.91775.log.gz 2024-09-17T01:51:03.521 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.109719.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.109719.log.gz 2024-09-17T01:51:03.521 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52852.log 2024-09-17T01:51:03.522 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.57626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105129.log 2024-09-17T01:51:03.522 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57626.log.gz 2024-09-17T01:51:03.523 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.52852.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52852.log.gz 2024-09-17T01:51:03.523 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100583.log 2024-09-17T01:51:03.524 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.105129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35847.log 2024-09-17T01:51:03.524 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.105129.log.gz 2024-09-17T01:51:03.524 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.100583.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.100583.log.gz 2024-09-17T01:51:03.525 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60519.log 2024-09-17T01:51:03.525 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.35847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35847.log.gz 2024-09-17T01:51:03.526 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91123.log 2024-09-17T01:51:03.526 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.60519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85217.log 2024-09-17T01:51:03.527 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.60519.log.gz 2024-09-17T01:51:03.527 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.91123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89672.log 2024-09-17T01:51:03.528 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.91123.log.gz 2024-09-17T01:51:03.528 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.85217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53164.log 2024-09-17T01:51:03.528 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.85217.log.gz 2024-09-17T01:51:03.529 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.89672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85448.log 2024-09-17T01:51:03.529 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.89672.log.gz 2024-09-17T01:51:03.530 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.53164.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53164.log.gz 2024-09-17T01:51:03.530 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63296.log 2024-09-17T01:51:03.531 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.85448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89540.log 2024-09-17T01:51:03.531 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.85448.log.gz 2024-09-17T01:51:03.532 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.63296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45758.log 2024-09-17T01:51:03.532 INFO:teuthology.orchestra.run.smithi042.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63296.log.gz 2024-09-17T01:51:03.533 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.89540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36100.log 2024-09-17T01:51:03.533 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.89540.log.gz 2024-09-17T01:51:03.534 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102338.log 2024-09-17T01:51:03.534 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45758.log.gz 2024-09-17T01:51:03.535 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52423.log 2024-09-17T01:51:03.535 INFO:teuthology.orchestra.run.smithi042.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.36100.log.gz 2024-09-17T01:51:03.536 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.102338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86544.log 2024-09-17T01:51:03.536 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.102338.log.gz 2024-09-17T01:51:03.537 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.52423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103205.log 2024-09-17T01:51:03.537 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52423.log.gz 2024-09-17T01:51:03.538 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.86544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.104102.log 2024-09-17T01:51:03.538 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.86544.log.gz 2024-09-17T01:51:03.539 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.103205.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.103205.log.gz 2024-09-17T01:51:03.539 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94796.log 2024-09-17T01:51:03.540 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.104102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.104102.log.gz 2024-09-17T01:51:03.540 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68620.log 2024-09-17T01:51:03.541 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.94796.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94796.log.gz 2024-09-17T01:51:03.541 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80591.log 2024-09-17T01:51:03.542 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.68620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90014.log 2024-09-17T01:51:03.542 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68620.log.gz 2024-09-17T01:51:03.543 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.80591.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.80591.log.gz 2024-09-17T01:51:03.543 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80278.log 2024-09-17T01:51:03.544 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.90014.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90014.log.gz 2024-09-17T01:51:03.544 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62113.log 2024-09-17T01:51:03.545 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.80278.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.80278.log.gz 2024-09-17T01:51:03.545 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100625.log 2024-09-17T01:51:03.546 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.62113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103117.log 2024-09-17T01:51:03.546 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62113.log.gz 2024-09-17T01:51:03.547 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.100625.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100625.log.gz 2024-09-17T01:51:03.547 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66939.log 2024-09-17T01:51:03.548 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.103117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95736.log 2024-09-17T01:51:03.548 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103117.log.gz 2024-09-17T01:51:03.548 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.66939.log: gzip -5 --verbose 87.2% -- -- replaced with /var/log/ceph/ceph-client.admin.66939.log.gz 2024-09-17T01:51:03.549 INFO:teuthology.orchestra.run.smithi042.stderr: /var/log/ceph/ceph-client.admin.76996.log 2024-09-17T01:51:03.550 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.95736.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.95736.log.gz 2024-09-17T01:51:03.550 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81537.log 2024-09-17T01:51:03.550 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.76996.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.76996.log.gz 2024-09-17T01:51:03.551 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106039.log 2024-09-17T01:51:03.551 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.81537.log: gzip -5 87.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.81537.log.gz /var/log/ceph/ceph-client.admin.65331.log 2024-09-17T01:51:03.551 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-09-17T01:51:03.552 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.106039.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.106039.log.gz 2024-09-17T01:51:03.553 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80530.log 2024-09-17T01:51:03.553 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.65331.log: gzip -5 87.5% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.65331.log.gz /var/log/ceph/ceph-client.admin.80236.log 2024-09-17T01:51:03.553 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-09-17T01:51:03.554 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.80530.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.80530.log.gz 2024-09-17T01:51:03.554 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59988.log 2024-09-17T01:51:03.555 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.80236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89372.log 2024-09-17T01:51:03.555 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.80236.log.gz 2024-09-17T01:51:03.556 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.59988.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59988.log.gz 2024-09-17T01:51:03.556 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96490.log 2024-09-17T01:51:03.557 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.89372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44859.log 2024-09-17T01:51:03.557 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.89372.log.gz 2024-09-17T01:51:03.558 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.96490.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.96490.log.gz 2024-09-17T01:51:03.558 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76382.log 2024-09-17T01:51:03.559 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107463.log 2024-09-17T01:51:03.559 INFO:teuthology.orchestra.run.smithi042.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44859.log.gz 2024-09-17T01:51:03.560 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.76382.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.76382.log.gz 2024-09-17T01:51:03.560 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40714.log 2024-09-17T01:51:03.561 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.107463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109953.log 2024-09-17T01:51:03.561 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.107463.log.gz 2024-09-17T01:51:03.562 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40714.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40714.log.gz 2024-09-17T01:51:03.562 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98865.log 2024-09-17T01:51:03.563 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.109953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56878.log 2024-09-17T01:51:03.564 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.109953.log.gz 2024-09-17T01:51:03.564 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.98865.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.98865.log.gz 2024-09-17T01:51:03.565 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59431.log 2024-09-17T01:51:03.565 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.56878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76821.log 2024-09-17T01:51:03.566 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.56878.log.gz 2024-09-17T01:51:03.566 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.59431.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59431.log.gz 2024-09-17T01:51:03.567 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61778.log 2024-09-17T01:51:03.567 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.76821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57305.log 2024-09-17T01:51:03.567 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.76821.log.gz 2024-09-17T01:51:03.568 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.61778.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61778.log.gz 2024-09-17T01:51:03.568 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99424.log 2024-09-17T01:51:03.569 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.57305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89606.log 2024-09-17T01:51:03.570 INFO:teuthology.orchestra.run.smithi042.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57305.log.gz 2024-09-17T01:51:03.570 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.99424.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99424.log.gz 2024-09-17T01:51:03.570 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112114.log 2024-09-17T01:51:03.571 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.89606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43350.log 2024-09-17T01:51:03.572 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.89606.log.gz 2024-09-17T01:51:03.572 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.112114.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112114.log.gz 2024-09-17T01:51:03.572 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103914.log 2024-09-17T01:51:03.573 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.2.43350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.43350.log.gz 2024-09-17T01:51:03.573 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101573.log 2024-09-17T01:51:03.574 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.103914.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103914.log.gz 2024-09-17T01:51:03.574 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41853.log 2024-09-17T01:51:03.575 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.101573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57371.log 2024-09-17T01:51:03.575 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.101573.log.gz 2024-09-17T01:51:03.576 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41853.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41853.log.gz 2024-09-17T01:51:03.576 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57981.log 2024-09-17T01:51:03.577 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.57371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91687.log 2024-09-17T01:51:03.577 INFO:teuthology.orchestra.run.smithi042.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.57371.log.gz 2024-09-17T01:51:03.578 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.57981.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57981.log.gz 2024-09-17T01:51:03.578 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62294.log 2024-09-17T01:51:03.579 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.91687.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.91687.log.gz 2024-09-17T01:51:03.579 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43042.log 2024-09-17T01:51:03.580 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.62294.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62294.log.gz 2024-09-17T01:51:03.580 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91463.log 2024-09-17T01:51:03.581 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43042.log: gzip 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43042.log.gz -5 2024-09-17T01:51:03.581 INFO:teuthology.orchestra.run.smithi042.stderr: --verbose -- /var/log/ceph/ceph-client.admin.62462.log 2024-09-17T01:51:03.582 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.91463.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.91463.log.gz 2024-09-17T01:51:03.582 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56010.log 2024-09-17T01:51:03.583 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.62462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44469.log 2024-09-17T01:51:03.583 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.62462.log.gz 2024-09-17T01:51:03.584 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.56010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69096.log 2024-09-17T01:51:03.584 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.56010.log.gz 2024-09-17T01:51:03.585 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62822.log 2024-09-17T01:51:03.585 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44469.log.gz 2024-09-17T01:51:03.586 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.69096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90498.log 2024-09-17T01:51:03.586 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.69096.log.gz 2024-09-17T01:51:03.587 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.62822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62756.log 2024-09-17T01:51:03.587 INFO:teuthology.orchestra.run.smithi042.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62822.log.gz 2024-09-17T01:51:03.588 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.90498.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90498.log.gz 2024-09-17T01:51:03.588 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105785.log 2024-09-17T01:51:03.589 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.62756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103074.log 2024-09-17T01:51:03.589 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.62756.log.gz 2024-09-17T01:51:03.590 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.105785.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105785.log.gz 2024-09-17T01:51:03.590 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45111.log 2024-09-17T01:51:03.591 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.103074.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.103074.log.gz -5 2024-09-17T01:51:03.591 INFO:teuthology.orchestra.run.smithi042.stderr: --verbose -- /var/log/ceph/ceph-client.admin.90182.log 2024-09-17T01:51:03.592 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45111.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45111.log.gz 2024-09-17T01:51:03.592 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105213.log 2024-09-17T01:51:03.593 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.90182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62420.log 2024-09-17T01:51:03.593 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.90182.log.gz 2024-09-17T01:51:03.594 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.105213.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.105213.log.gz 2024-09-17T01:51:03.594 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.109176.log 2024-09-17T01:51:03.595 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.62420.log: gzip -5 --verbose -- 86.9% /var/log/ceph/ceph-client.admin.108858.log 2024-09-17T01:51:03.595 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62420.log.gz 2024-09-17T01:51:03.596 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.109176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106249.log 2024-09-17T01:51:03.596 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.109176.log.gz 2024-09-17T01:51:03.597 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.108858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110171.log 2024-09-17T01:51:03.597 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.108858.log.gz 2024-09-17T01:51:03.598 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.106249.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.106249.log.gz 2024-09-17T01:51:03.598 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102951.log 2024-09-17T01:51:03.599 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.110171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77343.log 2024-09-17T01:51:03.599 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.110171.log.gz 2024-09-17T01:51:03.600 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.102951.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.102951.log.gz 2024-09-17T01:51:03.600 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79855.log 2024-09-17T01:51:03.601 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.77343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60186.log 2024-09-17T01:51:03.601 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77343.log.gz 2024-09-17T01:51:03.602 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.79855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95880.log 2024-09-17T01:51:03.602 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.79855.log.gz 2024-09-17T01:51:03.603 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.60186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60797.log 2024-09-17T01:51:03.603 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60186.log.gz 2024-09-17T01:51:03.604 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.95880.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95880.log.gz 2024-09-17T01:51:03.604 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89756.log 2024-09-17T01:51:03.605 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.60797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66658.log 2024-09-17T01:51:03.605 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60797.log.gz 2024-09-17T01:51:03.606 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.89756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103806.log 2024-09-17T01:51:03.606 INFO:teuthology.orchestra.run.smithi042.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.89756.log.gz 2024-09-17T01:51:03.607 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.66658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55593.log 2024-09-17T01:51:03.607 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66658.log.gz 2024-09-17T01:51:03.608 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.103806.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103806.log.gz 2024-09-17T01:51:03.608 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76695.log 2024-09-17T01:51:03.609 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.55593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110104.log 2024-09-17T01:51:03.609 INFO:teuthology.orchestra.run.smithi042.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.55593.log.gz 2024-09-17T01:51:03.610 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.76695.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.76695.log.gz 2024-09-17T01:51:03.610 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111653.log 2024-09-17T01:51:03.611 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.110104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111371.log 2024-09-17T01:51:03.611 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.110104.log.gz 2024-09-17T01:51:03.612 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.111653.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.111653.log.gz 2024-09-17T01:51:03.612 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41390.log 2024-09-17T01:51:03.613 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.111371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98907.log 2024-09-17T01:51:03.613 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.111371.log.gz 2024-09-17T01:51:03.614 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41390.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41390.log.gz 2024-09-17T01:51:03.614 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57878.log 2024-09-17T01:51:03.615 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.98907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59785.log 2024-09-17T01:51:03.615 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.98907.log.gz 2024-09-17T01:51:03.616 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.57878.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57878.log.gz 2024-09-17T01:51:03.616 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60731.log 2024-09-17T01:51:03.617 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.59785.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59785.log.gz 2024-09-17T01:51:03.617 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107547.log 2024-09-17T01:51:03.618 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.60731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44943.log 2024-09-17T01:51:03.618 INFO:teuthology.orchestra.run.smithi042.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.60731.log.gz 2024-09-17T01:51:03.619 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.107547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94980.log 2024-09-17T01:51:03.619 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.107547.log.gz 2024-09-17T01:51:03.620 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44943.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44943.log.gz 2024-09-17T01:51:03.620 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67794.log 2024-09-17T01:51:03.621 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.94980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68065.log 2024-09-17T01:51:03.621 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94980.log.gz 2024-09-17T01:51:03.622 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.67794.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67794.log.gz 2024-09-17T01:51:03.622 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81183.log 2024-09-17T01:51:03.623 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.68065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52357.log 2024-09-17T01:51:03.623 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68065.log.gz 2024-09-17T01:51:03.624 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.81183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75917.log 2024-09-17T01:51:03.624 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.81183.log.gz 2024-09-17T01:51:03.625 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.52357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60974.log 2024-09-17T01:51:03.625 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52357.log.gz 2024-09-17T01:51:03.626 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.75917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102086.log 2024-09-17T01:51:03.626 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.75917.log.gz 2024-09-17T01:51:03.627 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.60974.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60974.log.gz 2024-09-17T01:51:03.627 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64949.log 2024-09-17T01:51:03.628 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.102086.log: gzip -5 87.3% --verbose -- replaced with /var/log/ceph/ceph-client.admin.102086.log.gz 2024-09-17T01:51:03.628 INFO:teuthology.orchestra.run.smithi042.stderr: -- /var/log/ceph/ceph-client.admin.106375.log 2024-09-17T01:51:03.629 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.64949.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64949.log.gz 2024-09-17T01:51:03.629 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104472.log 2024-09-17T01:51:03.630 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.106375.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.106375.log.gz 2024-09-17T01:51:03.630 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107757.log 2024-09-17T01:51:03.630 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.104472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84670.log 2024-09-17T01:51:03.631 INFO:teuthology.orchestra.run.smithi042.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.104472.log.gz 2024-09-17T01:51:03.631 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.107757.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107757.log.gz 2024-09-17T01:51:03.632 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58755.log 2024-09-17T01:51:03.634 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.84670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94380.log 2024-09-17T01:51:03.634 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.84670.log.gz 2024-09-17T01:51:03.634 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.58755.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58755.log.gz 2024-09-17T01:51:03.634 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102650.log 2024-09-17T01:51:03.635 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.94380.log: gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.0.97038.log -- replaced with /var/log/ceph/ceph-client.admin.94380.log.gz 2024-09-17T01:51:03.635 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-09-17T01:51:03.635 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.102650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65662.log 2024-09-17T01:51:03.636 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102650.log.gz 2024-09-17T01:51:03.636 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.97038.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.97038.log.gz 2024-09-17T01:51:03.636 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89888.log 2024-09-17T01:51:03.637 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.65662.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.65662.log.gz 2024-09-17T01:51:03.637 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86013.log 2024-09-17T01:51:03.638 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.89888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95380.log 2024-09-17T01:51:03.638 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.89888.log.gz 2024-09-17T01:51:03.639 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.86013.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.86013.log.gz 2024-09-17T01:51:03.639 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92405.log 2024-09-17T01:51:03.640 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.95380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95838.log 87.1% 2024-09-17T01:51:03.640 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95380.log.gz 2024-09-17T01:51:03.641 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.92405.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.92405.log.gz 2024-09-17T01:51:03.641 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63559.log 2024-09-17T01:51:03.642 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.95838.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95838.log.gz 2024-09-17T01:51:03.642 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68366.log 2024-09-17T01:51:03.643 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.63559.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63559.log.gz 2024-09-17T01:51:03.643 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69012.log 2024-09-17T01:51:03.644 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.68366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61100.log 2024-09-17T01:51:03.644 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68366.log.gz 2024-09-17T01:51:03.645 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.69012.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.69012.log.gz 2024-09-17T01:51:03.645 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76340.log 2024-09-17T01:51:03.645 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.61100.log: gzip -5 --verbose -- 87.5% /var/log/ceph/ceph-client.admin.66618.log 2024-09-17T01:51:03.645 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61100.log.gz 2024-09-17T01:51:03.646 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.76340.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.76340.log.gz 2024-09-17T01:51:03.646 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61858.log 2024-09-17T01:51:03.647 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.66618.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.66618.log.gz 2024-09-17T01:51:03.647 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.101615.log 2024-09-17T01:51:03.648 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.61858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69350.log 2024-09-17T01:51:03.649 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61858.log.gz 2024-09-17T01:51:03.649 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.101615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41180.log 2024-09-17T01:51:03.650 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.101615.log.gz 2024-09-17T01:51:03.650 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.69350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.69350.log.gz 2024-09-17T01:51:03.650 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102380.log 2024-09-17T01:51:03.651 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41180.log: gzip -5 --verbose -- 87.2% /var/log/ceph/ceph-client.admin.90456.log -- replaced with /var/log/ceph/ceph-client.admin.41180.log.gz 2024-09-17T01:51:03.651 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-09-17T01:51:03.652 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.102380.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102380.log.gz 2024-09-17T01:51:03.652 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.101425.log 2024-09-17T01:51:03.653 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.90456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41843.log 2024-09-17T01:51:03.653 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90456.log.gz 2024-09-17T01:51:03.653 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.101425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.101425.log.gz 2024-09-17T01:51:03.654 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41222.log 2024-09-17T01:51:03.656 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41843.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41843.log.gz 2024-09-17T01:51:03.656 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66657.log 2024-09-17T01:51:03.656 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41222.log: gzip 86.9% -- replaced with /var/log/ceph/ceph-client.admin.41222.log.gz 2024-09-17T01:51:03.656 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.107589.log 2024-09-17T01:51:03.657 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.66657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111244.log 2024-09-17T01:51:03.657 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.66657.log.gz 2024-09-17T01:51:03.658 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.107589.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.107589.log.gz 2024-09-17T01:51:03.658 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81663.log 2024-09-17T01:51:03.658 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.111244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87273.log 87.0% 2024-09-17T01:51:03.658 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.111244.log.gz 2024-09-17T01:51:03.659 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.81663.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.81663.log.gz 2024-09-17T01:51:03.660 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59281.log 2024-09-17T01:51:03.660 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.87273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.87273.log.gz 2024-09-17T01:51:03.660 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100709.log 2024-09-17T01:51:03.661 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.59281.log: gzip 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59281.log.gz 2024-09-17T01:51:03.661 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44259.log 2024-09-17T01:51:03.662 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.100709.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.100709.log.gz 2024-09-17T01:51:03.662 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43777.log 2024-09-17T01:51:03.663 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105087.log 2024-09-17T01:51:03.663 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44259.log.gz 2024-09-17T01:51:03.664 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45380.log 2024-09-17T01:51:03.664 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43777.log.gz 2024-09-17T01:51:03.665 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.105087.log: gzip 87.3% -- replaced with /var/log/ceph/ceph-client.admin.105087.log.gz 2024-09-17T01:51:03.665 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.80142.log 2024-09-17T01:51:03.666 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45380.log: gzip -5 87.4% --verbose -- replaced with /var/log/ceph/ceph-client.admin.45380.log.gz -- 2024-09-17T01:51:03.666 INFO:teuthology.orchestra.run.smithi042.stderr: /var/log/ceph/ceph-client.admin.85761.log 2024-09-17T01:51:03.667 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.80142.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80142.log.gz 2024-09-17T01:51:03.667 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81915.log 2024-09-17T01:51:03.668 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.85761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85049.log 2024-09-17T01:51:03.668 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.85761.log.gz 2024-09-17T01:51:03.669 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.81915.log: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.81915.log.gz 2024-09-17T01:51:03.669 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T01:51:03.670 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.85049.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.85049.log.gz 2024-09-17T01:51:03.670 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40414.log 2024-09-17T01:51:03.670 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55180.log 2024-09-17T01:51:03.672 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40414.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40414.log.gz 2024-09-17T01:51:03.672 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94140.log 2024-09-17T01:51:03.673 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.55180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81449.log 2024-09-17T01:51:03.674 INFO:teuthology.orchestra.run.smithi042.stderr: 90.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T01:51:03.674 INFO:teuthology.orchestra.run.smithi042.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.55180.log.gz 2024-09-17T01:51:03.674 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.94140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76130.log 2024-09-17T01:51:03.675 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.81449.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.94140.log.gz 2024-09-17T01:51:03.675 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.81449.log.gz 2024-09-17T01:51:03.676 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41138.log 2024-09-17T01:51:03.676 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.76130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85007.log 2024-09-17T01:51:03.677 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.76130.log.gz 2024-09-17T01:51:03.677 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41138.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41138.log.gz 2024-09-17T01:51:03.677 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96742.log 2024-09-17T01:51:03.678 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.85007.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.85007.log.gz 2024-09-17T01:51:03.678 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35785.log 2024-09-17T01:51:03.679 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.96742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85971.log 2024-09-17T01:51:03.679 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.96742.log.gz 2024-09-17T01:51:03.680 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.35785.log: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.35785.log.gz 2024-09-17T01:51:03.680 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91943.log 2024-09-17T01:51:03.681 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.85971.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.85971.log.gz 2024-09-17T01:51:03.681 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.105045.log 2024-09-17T01:51:03.682 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.91943.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.91943.log.gz 2024-09-17T01:51:03.682 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42230.log 2024-09-17T01:51:03.683 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.105045.log: gzip 87.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.105045.log.gz --verbose 2024-09-17T01:51:03.683 INFO:teuthology.orchestra.run.smithi042.stderr: -- /var/log/ceph/ceph-client.admin.41558.log 2024-09-17T01:51:03.684 INFO:teuthology.orchestra.run.smithi043.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-17T01:51:03.684 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42230.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42230.log.gz 2024-09-17T01:51:03.684 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53267.log 2024-09-17T01:51:03.685 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54297.log 2024-09-17T01:51:03.685 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41558.log.gz 2024-09-17T01:51:03.686 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.53267.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53267.log.gzgzip 2024-09-17T01:51:03.686 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35873.log 2024-09-17T01:51:03.687 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.54297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108606.log 2024-09-17T01:51:03.687 INFO:teuthology.orchestra.run.smithi042.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.54297.log.gz 2024-09-17T01:51:03.688 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.35873.log: 74.2% -- replaced with /var/log/ceph/ceph-client.admin.35873.log.gz 2024-09-17T01:51:03.688 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65289.log 2024-09-17T01:51:03.688 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.108606.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108606.log.gz 2024-09-17T01:51:03.689 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.100877.log 2024-09-17T01:51:03.689 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.65289.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65289.log.gz 2024-09-17T01:51:03.689 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98974.log 2024-09-17T01:51:03.690 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.100877.log: gzip -5 --verbose 87.1% -- -- replaced with /var/log/ceph/ceph-client.admin.100877.log.gz /var/log/ceph/ceph-client.admin.60338.log 2024-09-17T01:51:03.690 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-09-17T01:51:03.691 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.98974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85532.log 2024-09-17T01:51:03.692 INFO:teuthology.orchestra.run.smithi042.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.98974.log.gz 2024-09-17T01:51:03.692 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.60338.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60338.log.gz 2024-09-17T01:51:03.693 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99551.log 2024-09-17T01:51:03.693 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.85532.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.85532.log.gzgzip 2024-09-17T01:51:03.693 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.77641.log 2024-09-17T01:51:03.694 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.99551.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.99551.log.gz 2024-09-17T01:51:03.694 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36654.log 2024-09-17T01:51:03.695 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.77641.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.77641.log.gz 2024-09-17T01:51:03.695 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91340.log 2024-09-17T01:51:03.696 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36654.log: gzip 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36654.log.gz 2024-09-17T01:51:03.696 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.78000.log 2024-09-17T01:51:03.697 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.91340.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.91340.log.gz 2024-09-17T01:51:03.697 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.111202.log 2024-09-17T01:51:03.698 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.78000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.78000.log.gz 2024-09-17T01:51:03.698 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58704.log 2024-09-17T01:51:03.699 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.111202.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.111202.log.gz 2024-09-17T01:51:03.699 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36214.log 2024-09-17T01:51:03.700 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.58704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64552.log 2024-09-17T01:51:03.700 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58704.log.gz 2024-09-17T01:51:03.701 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36214.log: 76.3% -- replaced with /var/log/ceph/ceph-client.admin.36214.log.gz 2024-09-17T01:51:03.701 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62252.log 2024-09-17T01:51:03.706 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.64552.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64552.log.gzgzip 2024-09-17T01:51:03.706 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.64468.log 2024-09-17T01:51:03.706 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.62252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109519.log 2024-09-17T01:51:03.706 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62252.log.gz 2024-09-17T01:51:03.707 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.64468.log: 87.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.64468.log.gz 2024-09-17T01:51:03.707 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53818.log 2024-09-17T01:51:03.707 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.109519.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.109519.log.gzgzip 2024-09-17T01:51:03.707 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.108184.log 2024-09-17T01:51:03.707 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.53818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110884.log 2024-09-17T01:51:03.707 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53818.log.gz 2024-09-17T01:51:03.707 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.108184.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108184.log.gz 2024-09-17T01:51:03.707 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52936.log 2024-09-17T01:51:03.708 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.110884.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110884.log.gz 2024-09-17T01:51:03.708 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96658.log 2024-09-17T01:51:03.708 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.52936.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52936.log.gz 2024-09-17T01:51:03.708 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.96309.log 2024-09-17T01:51:03.709 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.96658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89822.log 2024-09-17T01:51:03.709 INFO:teuthology.orchestra.run.smithi042.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.96658.log.gz 2024-09-17T01:51:03.710 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.96309.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.96309.log.gz 2024-09-17T01:51:03.710 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65704.log 2024-09-17T01:51:03.711 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.89822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79987.log 2024-09-17T01:51:03.711 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.89822.log.gz 2024-09-17T01:51:03.712 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.65704.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65704.log.gz 2024-09-17T01:51:03.712 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69354.log 2024-09-17T01:51:03.713 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.79987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94206.log 87.4% 2024-09-17T01:51:03.713 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.79987.log.gz 2024-09-17T01:51:03.714 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.69354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.69354.log.gz 2024-09-17T01:51:03.714 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43609.log 2024-09-17T01:51:03.715 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.94206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52573.log 2024-09-17T01:51:03.715 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.94206.log.gz 2024-09-17T01:51:03.716 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66326.log 2024-09-17T01:51:03.716 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43609.log.gz 2024-09-17T01:51:03.717 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.52573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107841.log 2024-09-17T01:51:03.717 INFO:teuthology.orchestra.run.smithi042.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.52573.log.gz 2024-09-17T01:51:03.718 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.66326.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.66326.log.gz 2024-09-17T01:51:03.718 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90997.log 2024-09-17T01:51:03.718 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.107841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105568.log 2024-09-17T01:51:03.719 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107841.log.gz 2024-09-17T01:51:03.720 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.90997.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90997.log.gz -5 2024-09-17T01:51:03.720 INFO:teuthology.orchestra.run.smithi042.stderr: --verbose -- /var/log/ceph/ceph-client.admin.89288.log 2024-09-17T01:51:03.720 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.105568.log: gzip -5 --verbose -- 87.8% /var/log/ceph/ceph-client.admin.64991.log -- replaced with /var/log/ceph/ceph-client.admin.105568.log.gz 2024-09-17T01:51:03.721 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-09-17T01:51:03.721 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.89288.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89288.log.gz 2024-09-17T01:51:03.721 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81957.log 2024-09-17T01:51:03.722 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.64991.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64991.log.gz 2024-09-17T01:51:03.722 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68671.log 2024-09-17T01:51:03.723 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.81957.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.81957.log.gz 2024-09-17T01:51:03.723 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42272.log 2024-09-17T01:51:03.724 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.68671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79723.log 2024-09-17T01:51:03.724 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68671.log.gz 2024-09-17T01:51:03.725 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42272.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.42272.log.gz 2024-09-17T01:51:03.725 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.94694.log 2024-09-17T01:51:03.726 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.79723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44595.log 2024-09-17T01:51:03.726 INFO:teuthology.orchestra.run.smithi042.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.79723.log.gz 2024-09-17T01:51:03.727 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.94694.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.94694.log.gz 2024-09-17T01:51:03.727 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64248.log 2024-09-17T01:51:03.728 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66897.log 2024-09-17T01:51:03.728 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44595.log.gz 2024-09-17T01:51:03.729 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.64248.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64248.log.gz 2024-09-17T01:51:03.729 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62378.log 2024-09-17T01:51:03.730 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.66897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100961.log 2024-09-17T01:51:03.730 INFO:teuthology.orchestra.run.smithi042.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66897.log.gz 2024-09-17T01:51:03.731 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.62378.log: gzip -5 87.6% --verbose -- replaced with /var/log/ceph/ceph-client.admin.62378.log.gz -- 2024-09-17T01:51:03.731 INFO:teuthology.orchestra.run.smithi042.stderr: /var/log/ceph/ceph-client.admin.86210.log 2024-09-17T01:51:03.732 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.100961.log: gzip -5 --verbose -- 87.9% /var/log/ceph/ceph-client.admin.53309.log -- replaced with /var/log/ceph/ceph-client.admin.100961.log.gz 2024-09-17T01:51:03.732 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-09-17T01:51:03.733 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.86210.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.86210.log.gz 2024-09-17T01:51:03.733 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56250.log 2024-09-17T01:51:03.733 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.53309.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53309.log.gz 2024-09-17T01:51:03.734 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94548.log 2024-09-17T01:51:03.734 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.56250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92027.log 2024-09-17T01:51:03.735 INFO:teuthology.orchestra.run.smithi042.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.56250.log.gz 2024-09-17T01:51:03.735 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.94548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64781.log 2024-09-17T01:51:03.736 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94548.log.gz 2024-09-17T01:51:03.736 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.92027.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.92027.log.gz 2024-09-17T01:51:03.736 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.80488.log 2024-09-17T01:51:03.737 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.64781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36944.log 2024-09-17T01:51:03.737 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64781.log.gz 2024-09-17T01:51:03.738 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.80488.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.80488.log.gz 2024-09-17T01:51:03.738 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86893.log 2024-09-17T01:51:03.739 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36944.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36944.log.gz 2024-09-17T01:51:03.739 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95212.log 2024-09-17T01:51:03.740 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.86893.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86893.log.gz 2024-09-17T01:51:03.740 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.90913.log 2024-09-17T01:51:03.741 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.95212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84923.log 2024-09-17T01:51:03.741 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95212.log.gz 2024-09-17T01:51:03.742 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.90913.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.90913.log.gz 2024-09-17T01:51:03.742 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.90955.log 2024-09-17T01:51:03.743 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.84923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106081.log 2024-09-17T01:51:03.743 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84923.log.gz 2024-09-17T01:51:03.744 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.90955.log: gzip -5 --verbose -- 87.2% /var/log/ceph/ceph-client.admin.101045.log 2024-09-17T01:51:03.744 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90955.log.gz 2024-09-17T01:51:03.745 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.106081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96700.log 2024-09-17T01:51:03.745 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106081.log.gz 2024-09-17T01:51:03.746 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.101045.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.101045.log.gz 2024-09-17T01:51:03.746 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61938.log 2024-09-17T01:51:03.747 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.96700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85887.log 2024-09-17T01:51:03.747 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.96700.log.gz 2024-09-17T01:51:03.747 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.61938.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61938.log.gz 2024-09-17T01:51:03.748 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65532.log 2024-09-17T01:51:03.748 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.85887.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.85887.log.gz 2024-09-17T01:51:03.749 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53519.log 2024-09-17T01:51:03.749 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.65532.log: gzip 87.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.65532.log.gz 2024-09-17T01:51:03.750 INFO:teuthology.orchestra.run.smithi042.stderr: --verbose -- /var/log/ceph/ceph-client.admin.106753.log 2024-09-17T01:51:03.750 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.53519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100069.log 87.5% 2024-09-17T01:51:03.750 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53519.log.gz 2024-09-17T01:51:03.751 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.106753.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106753.log.gz -5 2024-09-17T01:51:03.751 INFO:teuthology.orchestra.run.smithi042.stderr: --verbose -- /var/log/ceph/ceph-client.admin.63711.log 2024-09-17T01:51:03.752 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.100069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36017.log 2024-09-17T01:51:03.752 INFO:teuthology.orchestra.run.smithi042.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100069.log.gz 2024-09-17T01:51:03.753 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.63711.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63711.log.gz 2024-09-17T01:51:03.753 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92135.log 2024-09-17T01:51:03.754 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36017.log: 74.3% -- replaced with /var/log/ceph/ceph-client.admin.36017.log.gz 2024-09-17T01:51:03.754 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101087.log 2024-09-17T01:51:03.755 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.92135.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.92135.log.gz 2024-09-17T01:51:03.755 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102776.log 2024-09-17T01:51:03.756 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.101087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63410.log 2024-09-17T01:51:03.756 INFO:teuthology.orchestra.run.smithi042.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.101087.log.gz 2024-09-17T01:51:03.757 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.102776.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102776.log.gz -5 2024-09-17T01:51:03.757 INFO:teuthology.orchestra.run.smithi042.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41908.log 2024-09-17T01:51:03.757 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.63410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56547.log 2024-09-17T01:51:03.758 INFO:teuthology.orchestra.run.smithi042.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.63410.log.gz 2024-09-17T01:51:03.759 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41908.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.41908.log.gz 2024-09-17T01:51:03.759 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62025.log 2024-09-17T01:51:03.759 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.56547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66454.log 2024-09-17T01:51:03.760 INFO:teuthology.orchestra.run.smithi042.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.56547.log.gz 2024-09-17T01:51:03.761 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.62025.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.62025.log.gz 2024-09-17T01:51:03.761 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43567.log 2024-09-17T01:51:03.761 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.66454.log: gzip -5 87.5% --verbose -- replaced with /var/log/ceph/ceph-client.admin.66454.log.gz 2024-09-17T01:51:03.761 INFO:teuthology.orchestra.run.smithi042.stderr: -- /var/log/ceph/ceph-client.admin.58107.log 2024-09-17T01:51:03.762 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43567.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43567.log.gzgzip 2024-09-17T01:51:03.762 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53435.log 2024-09-17T01:51:03.763 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.58107.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58107.log.gz 2024-09-17T01:51:03.763 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55114.log 2024-09-17T01:51:03.764 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.53435.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53435.log.gz 2024-09-17T01:51:03.764 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60066.log 2024-09-17T01:51:03.765 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.55114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61599.log 2024-09-17T01:51:03.766 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.55114.log.gz 2024-09-17T01:51:03.766 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.60066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80404.log 2024-09-17T01:51:03.767 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.60066.log.gz 2024-09-17T01:51:03.767 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.61599.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61599.log.gz 2024-09-17T01:51:03.767 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65914.log 2024-09-17T01:51:03.768 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.80404.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80404.log.gz 2024-09-17T01:51:03.769 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101831.log 2024-09-17T01:51:03.769 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.65914.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65914.log.gz 2024-09-17T01:51:03.770 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36248.log 2024-09-17T01:51:03.770 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.101831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63757.log 2024-09-17T01:51:03.771 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.101831.log.gz 2024-09-17T01:51:03.771 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36248.log: 74.0% -- replaced with /var/log/ceph/ceph-client.admin.36248.log.gz 2024-09-17T01:51:03.771 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94422.log 2024-09-17T01:51:03.772 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.63757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100751.log 2024-09-17T01:51:03.773 INFO:teuthology.orchestra.run.smithi042.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.63757.log.gz 2024-09-17T01:51:03.773 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.94422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80717.log 2024-09-17T01:51:03.774 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.94422.log.gz 2024-09-17T01:51:03.774 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.100751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94754.log 2024-09-17T01:51:03.774 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.100751.log.gz 2024-09-17T01:51:03.775 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.80717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35798.log 87.0% 2024-09-17T01:51:03.775 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.80717.log.gz 2024-09-17T01:51:03.776 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.94754.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94754.log.gz 2024-09-17T01:51:03.776 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69054.log 2024-09-17T01:51:03.777 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.35798.log: 76.4% -- replaced with /var/log/ceph/ceph-client.admin.35798.log.gz 2024-09-17T01:51:03.777 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84454.log 2024-09-17T01:51:03.778 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.69054.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.69054.log.gz 2024-09-17T01:51:03.778 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67855.log 2024-09-17T01:51:03.779 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.84454.log: gzip -5 --verbose 87.6% -- -- replaced with /var/log/ceph/ceph-client.admin.84454.log.gz /var/log/ceph/ceph-client.admin.79789.log 2024-09-17T01:51:03.779 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-09-17T01:51:03.780 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.67855.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.67855.log.gzgzip 2024-09-17T01:51:03.780 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.102128.log 2024-09-17T01:51:03.781 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.79789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101507.log 2024-09-17T01:51:03.781 INFO:teuthology.orchestra.run.smithi042.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.79789.log.gz 2024-09-17T01:51:03.782 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.102128.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.102128.log.gz 2024-09-17T01:51:03.782 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59861.log 2024-09-17T01:51:03.783 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.101507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105003.log 2024-09-17T01:51:03.783 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.101507.log.gz 2024-09-17T01:51:03.784 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.59861.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59861.log.gz 2024-09-17T01:51:03.784 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67981.log 2024-09-17T01:51:03.785 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.105003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104406.log 2024-09-17T01:51:03.785 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.105003.log.gz 2024-09-17T01:51:03.786 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.67981.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.67981.log.gz 2024-09-17T01:51:03.786 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90140.log 2024-09-17T01:51:03.787 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.104406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102212.log 2024-09-17T01:51:03.787 INFO:teuthology.orchestra.run.smithi042.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.104406.log.gz 2024-09-17T01:51:03.788 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.90140.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.90140.log.gz 2024-09-17T01:51:03.788 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67752.log 2024-09-17T01:51:03.789 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.102212.log: gzip 87.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.102212.log.gz --verbose 2024-09-17T01:51:03.789 INFO:teuthology.orchestra.run.smithi042.stderr: -- /var/log/ceph/ceph-client.admin.91421.log 2024-09-17T01:51:03.789 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.67752.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.67752.log.gzgzip 2024-09-17T01:51:03.790 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43525.log 2024-09-17T01:51:03.790 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.91421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77389.log 2024-09-17T01:51:03.791 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91421.log.gz 2024-09-17T01:51:03.792 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43525.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43525.log.gz 2024-09-17T01:51:03.792 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-17T01:51:03.792 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.77389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64510.log 2024-09-17T01:51:03.792 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.77389.log.gz 2024-09-17T01:51:03.793 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76779.log 2024-09-17T01:51:03.794 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.64510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45908.log 2024-09-17T01:51:03.795 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.64510.log.gz 2024-09-17T01:51:03.796 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.76779.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.76779.log.gz 2024-09-17T01:51:03.796 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90224.log 2024-09-17T01:51:03.797 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103386.log 2024-09-17T01:51:03.797 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45908.log.gz 2024-09-17T01:51:03.798 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.90224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85929.log 87.4% 2024-09-17T01:51:03.798 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90224.log.gz 2024-09-17T01:51:03.799 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.103386.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.103386.log.gz 2024-09-17T01:51:03.799 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81831.log 2024-09-17T01:51:03.800 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.85929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41904.log 2024-09-17T01:51:03.801 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.85929.log.gz 2024-09-17T01:51:03.801 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.81831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84604.log 2024-09-17T01:51:03.801 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.81831.log.gz 2024-09-17T01:51:03.802 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55049.log 2024-09-17T01:51:03.803 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41904.log.gz 2024-09-17T01:51:03.804 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.84604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110387.log 2024-09-17T01:51:03.804 INFO:teuthology.orchestra.run.smithi042.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.84604.log.gz 2024-09-17T01:51:03.805 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.55049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81789.log 2024-09-17T01:51:03.805 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.110387.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.55049.log.gz 2024-09-17T01:51:03.806 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110387.log.gz 2024-09-17T01:51:03.806 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57115.log 2024-09-17T01:51:03.807 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.81789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96095.log 2024-09-17T01:51:03.807 INFO:teuthology.orchestra.run.smithi042.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.81789.log.gz 2024-09-17T01:51:03.808 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.57115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77206.log 2024-09-17T01:51:03.809 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57115.log.gz 2024-09-17T01:51:03.809 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.96095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107925.log 2024-09-17T01:51:03.810 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96095.log.gz 2024-09-17T01:51:03.810 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.77206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107242.log 2024-09-17T01:51:03.811 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.77206.log.gz 2024-09-17T01:51:03.812 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.107925.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.107925.log.gz 2024-09-17T01:51:03.812 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56481.log 2024-09-17T01:51:03.813 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.107242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43651.log 2024-09-17T01:51:03.813 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.107242.log.gz 2024-09-17T01:51:03.814 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.56481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45027.log 2024-09-17T01:51:03.814 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56481.log.gz 2024-09-17T01:51:03.815 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64697.log 2024-09-17T01:51:03.816 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43651.log.gz 2024-09-17T01:51:03.817 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81407.log 2024-09-17T01:51:03.817 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45027.log.gz 2024-09-17T01:51:03.818 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.64697.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64697.log.gz 2024-09-17T01:51:03.818 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59743.log 2024-09-17T01:51:03.818 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.81407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46096.log 2024-09-17T01:51:03.819 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.81407.log.gz 2024-09-17T01:51:03.820 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.59743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65208.log 2024-09-17T01:51:03.820 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59743.log.gz 2024-09-17T01:51:03.821 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.46096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46096.log.gz 2024-09-17T01:51:03.821 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61371.log 2024-09-17T01:51:03.822 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.65208.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65208.log.gz 2024-09-17T01:51:03.822 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44217.log 2024-09-17T01:51:03.824 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.61371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63010.log 2024-09-17T01:51:03.824 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.61371.log.gz 2024-09-17T01:51:03.825 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44217.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44217.log.gz 2024-09-17T01:51:03.825 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76424.log 2024-09-17T01:51:03.826 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.63010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107337.log 2024-09-17T01:51:03.826 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.63010.log.gz 2024-09-17T01:51:03.827 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.76424.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.76424.log.gz 2024-09-17T01:51:03.827 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75766.log 2024-09-17T01:51:03.828 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.107337.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107337.log.gz 2024-09-17T01:51:03.828 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76527.log 2024-09-17T01:51:03.829 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.75766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76569.log 2024-09-17T01:51:03.830 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.76527.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.75766.log.gz 2024-09-17T01:51:03.831 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61226.log 2024-09-17T01:51:03.831 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.76527.log.gz 2024-09-17T01:51:03.831 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.76569.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.76569.log.gz 2024-09-17T01:51:03.832 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57794.log 2024-09-17T01:51:03.832 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.61226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76611.log 2024-09-17T01:51:03.833 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61226.log.gz 2024-09-17T01:51:03.834 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.57794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42890.log 2024-09-17T01:51:03.834 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57794.log.gz 2024-09-17T01:51:03.835 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.76611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85175.log 2024-09-17T01:51:03.835 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.76611.log.gz 2024-09-17T01:51:03.836 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.42890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42890.log.gz 2024-09-17T01:51:03.836 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55944.log 2024-09-17T01:51:03.837 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.85175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61420.log 2024-09-17T01:51:03.838 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.85175.log.gz 2024-09-17T01:51:03.838 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.55944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102734.log 2024-09-17T01:51:03.839 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.55944.log.gz 2024-09-17T01:51:03.840 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.61420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61557.log 2024-09-17T01:51:03.840 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61420.log.gz 2024-09-17T01:51:03.840 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.102734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101992.log 2024-09-17T01:51:03.841 INFO:teuthology.orchestra.run.smithi042.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102734.log.gz 2024-09-17T01:51:03.842 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.61557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96360.log 2024-09-17T01:51:03.842 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61557.log.gz 2024-09-17T01:51:03.843 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.101992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110716.log 2024-09-17T01:51:03.843 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101992.log.gz 2024-09-17T01:51:03.844 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.96360.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96360.log.gz 2024-09-17T01:51:03.844 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44797.log 2024-09-17T01:51:03.845 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.110716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110321.log 2024-09-17T01:51:03.846 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110716.log.gz 2024-09-17T01:51:03.846 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42554.log 2024-09-17T01:51:03.847 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44797.log.gz 2024-09-17T01:51:03.848 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.110321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59137.log 2024-09-17T01:51:03.848 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.110321.log.gz 2024-09-17T01:51:03.848 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42104.log 2024-09-17T01:51:03.849 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42554.log.gz 2024-09-17T01:51:03.850 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.59137.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59137.log.gz 2024-09-17T01:51:03.850 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40756.log 2024-09-17T01:51:03.851 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42104.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.42104.log.gz 2024-09-17T01:51:03.851 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91165.log 2024-09-17T01:51:03.852 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44427.log 2024-09-17T01:51:03.852 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40756.log.gz 2024-09-17T01:51:03.853 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.91165.log: gzip -5 87.6% --verbose -- replaced with /var/log/ceph/ceph-client.admin.91165.log.gz -- 2024-09-17T01:51:03.853 INFO:teuthology.orchestra.run.smithi042.stderr: /var/log/ceph/ceph-client.0.92323.log 2024-09-17T01:51:03.854 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44427.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44427.log.gz 2024-09-17T01:51:03.854 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81579.log 2024-09-17T01:51:03.855 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.92323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105484.log 2024-09-17T01:51:03.855 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.92323.log.gz 2024-09-17T01:51:03.857 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.81579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69162.log 87.1% 2024-09-17T01:51:03.857 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.81579.log.gz 2024-09-17T01:51:03.858 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.105484.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105484.log.gz 2024-09-17T01:51:03.858 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100496.log 2024-09-17T01:51:03.859 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.69162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91506.log 2024-09-17T01:51:03.859 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.69162.log.gz 2024-09-17T01:51:03.860 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.100496.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.100496.log.gz 2024-09-17T01:51:03.860 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53393.log 2024-09-17T01:51:03.861 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.91506.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.91506.log.gz 2024-09-17T01:51:03.861 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99467.log 2024-09-17T01:51:03.862 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.53393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77431.log 2024-09-17T01:51:03.863 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53393.log.gz 2024-09-17T01:51:03.863 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.99467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86595.log 2024-09-17T01:51:03.864 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.99467.log.gz 2024-09-17T01:51:03.865 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.77431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110968.log 2024-09-17T01:51:03.865 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.77431.log.gz 2024-09-17T01:51:03.866 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.86595.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.86595.log.gz 2024-09-17T01:51:03.866 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105995.log 2024-09-17T01:51:03.867 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.110968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43483.log 2024-09-17T01:51:03.867 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110968.log.gz 2024-09-17T01:51:03.868 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.105995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54423.log 2024-09-17T01:51:03.868 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.105995.log.gz 2024-09-17T01:51:03.869 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43483.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43483.log.gz 2024-09-17T01:51:03.869 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108774.log 2024-09-17T01:51:03.870 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.54423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67626.log 2024-09-17T01:51:03.871 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54423.log.gz 2024-09-17T01:51:03.871 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.108774.log: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.108774.log.gz 2024-09-17T01:51:03.871 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.106543.log 2024-09-17T01:51:03.873 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.67626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99757.log 2024-09-17T01:51:03.873 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67626.log.gz 2024-09-17T01:51:03.874 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.106543.log: gzip -5 87.1% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.106543.log.gz 2024-09-17T01:51:03.874 INFO:teuthology.orchestra.run.smithi042.stderr: /var/log/ceph/ceph-client.0.63014.log 2024-09-17T01:51:03.875 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.99757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58797.log 2024-09-17T01:51:03.875 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.99757.log.gz 2024-09-17T01:51:03.876 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.63014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.63014.log.gz 2024-09-17T01:51:03.876 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62546.log 2024-09-17T01:51:03.877 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.58797.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.58797.log.gzgzip 2024-09-17T01:51:03.877 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.92069.log 2024-09-17T01:51:03.879 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.62546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95526.log 2024-09-17T01:51:03.879 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62546.log.gz 2024-09-17T01:51:03.880 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.92069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108307.log 2024-09-17T01:51:03.880 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.92069.log.gz 2024-09-17T01:51:03.881 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.95526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56350.log 2024-09-17T01:51:03.881 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.95526.log.gz 2024-09-17T01:51:03.882 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.108307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62672.log 2024-09-17T01:51:03.882 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108307.log.gz 2024-09-17T01:51:03.883 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.56350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57490.log 2024-09-17T01:51:03.883 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.56350.log.gz 2024-09-17T01:51:03.884 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.62672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103298.log 2024-09-17T01:51:03.885 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.62672.log.gz 2024-09-17T01:51:03.885 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.57490.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-17T01:51:03.885 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57490.log.gz 2024-09-17T01:51:03.886 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.103298.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103298.log.gz 2024-09-17T01:51:03.887 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111328.log 2024-09-17T01:51:03.887 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92327.log 2024-09-17T01:51:03.889 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.111328.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111328.log.gz 2024-09-17T01:51:03.889 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95254.log 2024-09-17T01:51:03.890 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.92327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.92327.log.gz 2024-09-17T01:51:03.890 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42314.log 2024-09-17T01:51:03.891 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.95254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77076.log 2024-09-17T01:51:03.891 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95254.log.gz 2024-09-17T01:51:03.892 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42314.log: gzip 87.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.42314.log.gz 2024-09-17T01:51:03.892 INFO:teuthology.orchestra.run.smithi042.stderr: --verbose -- /var/log/ceph/ceph-client.admin.105358.log 2024-09-17T01:51:03.893 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.77076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68801.log 2024-09-17T01:51:03.894 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77076.log.gz 2024-09-17T01:51:03.894 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.105358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105610.log 2024-09-17T01:51:03.895 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.105358.log.gz 2024-09-17T01:51:03.895 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.68801.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68801.log.gz 2024-09-17T01:51:03.896 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111863.log 2024-09-17T01:51:03.897 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.105610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55444.log 2024-09-17T01:51:03.897 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.105610.log.gz 2024-09-17T01:51:03.898 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.111863.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.111863.log.gz 2024-09-17T01:51:03.898 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35693.log 2024-09-17T01:51:03.899 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52978.log 2024-09-17T01:51:03.900 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.55444.log: /var/log/ceph/ceph-client.admin.35693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35693.log.gz 2024-09-17T01:51:03.900 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55312.log 2024-09-17T01:51:03.900 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.55444.log.gz 2024-09-17T01:51:03.901 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.52978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66214.log 2024-09-17T01:51:03.902 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52978.log.gz 2024-09-17T01:51:03.902 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.55312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107967.log 2024-09-17T01:51:03.902 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.55312.log.gz 2024-09-17T01:51:03.903 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.66214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.66214.log.gz 2024-09-17T01:51:03.903 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96448.log 2024-09-17T01:51:03.904 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.107967.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107967.log.gz 2024-09-17T01:51:03.905 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103344.log 2024-09-17T01:51:03.910 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.96448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63411.log 2024-09-17T01:51:03.910 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96448.log.gz 2024-09-17T01:51:03.910 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.103344.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103344.log.gz 2024-09-17T01:51:03.910 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53225.log 2024-09-17T01:51:03.910 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55775.log 2024-09-17T01:51:03.910 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.63411.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63411.log.gz 2024-09-17T01:51:03.910 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.53225.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53225.log.gz 2024-09-17T01:51:03.910 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65480.log 2024-09-17T01:51:03.910 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.55775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45800.log 2024-09-17T01:51:03.911 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.65480.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.55775.log.gz 2024-09-17T01:51:03.911 INFO:teuthology.orchestra.run.smithi042.stderr:gzip 87.2% -- replaced with /var/log/ceph/ceph-client.admin.65480.log.gz -5 2024-09-17T01:51:03.911 INFO:teuthology.orchestra.run.smithi042.stderr: --verbose -- /var/log/ceph/ceph-client.admin.67897.log 2024-09-17T01:51:03.912 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99039.log 2024-09-17T01:51:03.912 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45800.log.gz 2024-09-17T01:51:03.913 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.67897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107883.log 2024-09-17T01:51:03.913 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67897.log.gz 2024-09-17T01:51:03.914 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.99039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76653.log 2024-09-17T01:51:03.915 INFO:teuthology.orchestra.run.smithi042.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.99039.log.gz 2024-09-17T01:51:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.107883.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.107883.log.gz 2024-09-17T01:51:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77118.log 2024-09-17T01:51:03.917 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.76653.log: gzip -5 --verbose -- 87.5% /var/log/ceph/ceph-client.admin.58065.log 2024-09-17T01:51:03.917 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.76653.log.gz 2024-09-17T01:51:03.918 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.77118.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77118.log.gz 2024-09-17T01:51:03.918 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84118.log 2024-09-17T01:51:03.919 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.58065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35987.log 2024-09-17T01:51:03.920 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.58065.log.gz 2024-09-17T01:51:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.84118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95296.log 2024-09-17T01:51:03.921 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.84118.log.gz 2024-09-17T01:51:03.922 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.35987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45716.log 2024-09-17T01:51:03.922 INFO:teuthology.orchestra.run.smithi042.stderr: 74.4% -- replaced with /var/log/ceph/ceph-client.admin.35987.log.gz 2024-09-17T01:51:03.923 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.95296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77599.log 2024-09-17T01:51:03.923 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95296.log.gz 2024-09-17T01:51:03.924 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42909.log 2024-09-17T01:51:03.924 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45716.log.gz 2024-09-17T01:51:03.925 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.77599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104350.log 2024-09-17T01:51:03.925 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.77599.log.gz 2024-09-17T01:51:03.926 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.42909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65436.log 2024-09-17T01:51:03.926 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42909.log.gz 2024-09-17T01:51:03.928 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.104350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64426.log 2024-09-17T01:51:03.928 INFO:teuthology.orchestra.run.smithi042.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.104350.log.gz 2024-09-17T01:51:03.929 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.65436.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.65436.log.gz 2024-09-17T01:51:03.929 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101003.log 2024-09-17T01:51:03.930 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.64426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62630.log 2024-09-17T01:51:03.930 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64426.log.gz 2024-09-17T01:51:03.931 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.101003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111566.log 2024-09-17T01:51:03.931 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.101003.log.gz 2024-09-17T01:51:03.932 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.62630.log: 87.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84754.log 2024-09-17T01:51:03.932 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62630.log.gz 2024-09-17T01:51:03.933 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.111566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101129.log 2024-09-17T01:51:03.934 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.111566.log.gz 2024-09-17T01:51:03.934 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.84754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54083.log 2024-09-17T01:51:03.934 INFO:teuthology.orchestra.run.smithi042.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.84754.log.gz 2024-09-17T01:51:03.936 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.101129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111905.log 2024-09-17T01:51:03.936 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.101129.log.gz 2024-09-17T01:51:03.938 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.54083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85490.log 2024-09-17T01:51:03.938 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54083.log.gz 2024-09-17T01:51:03.939 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.111905.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.111905.log.gz 2024-09-17T01:51:03.939 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76036.log 2024-09-17T01:51:03.940 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.85490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96574.log 2024-09-17T01:51:03.940 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.85490.log.gz 2024-09-17T01:51:03.942 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.76036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84965.log 2024-09-17T01:51:03.942 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.76036.log.gz 2024-09-17T01:51:03.943 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.96574.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.96574.log.gz 2024-09-17T01:51:03.944 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.84965.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.84965.log.gz 2024-09-17T01:51:03.944 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59323.log 2024-09-17T01:51:03.946 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111456.log 2024-09-17T01:51:03.947 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.59323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100452.log 2024-09-17T01:51:03.947 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.59323.log.gz 2024-09-17T01:51:03.949 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.111456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106501.log 2024-09-17T01:51:03.949 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.111456.log.gz 2024-09-17T01:51:03.949 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.100452.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.100452.log.gz 2024-09-17T01:51:03.950 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85133.log 2024-09-17T01:51:03.951 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.106501.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.106501.log.gz 2024-09-17T01:51:03.951 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56415.log 2024-09-17T01:51:03.953 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.85133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82083.log 2024-09-17T01:51:03.953 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.85133.log.gz 2024-09-17T01:51:03.955 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.56415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108350.log 2024-09-17T01:51:03.955 INFO:teuthology.orchestra.run.smithi042.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.56415.log.gz 2024-09-17T01:51:03.955 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.82083.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.82083.log.gz 2024-09-17T01:51:03.956 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109584.log 2024-09-17T01:51:03.957 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.108350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43819.log 2024-09-17T01:51:03.957 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.108350.log.gz 2024-09-17T01:51:03.959 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.109584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76214.log 2024-09-17T01:51:03.959 INFO:teuthology.orchestra.run.smithi042.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109584.log.gz 2024-09-17T01:51:03.959 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43819.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43819.log.gz 2024-09-17T01:51:03.960 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53561.log 2024-09-17T01:51:03.961 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.76214.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.76214.log.gz 2024-09-17T01:51:03.961 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89203.log 2024-09-17T01:51:03.963 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.53561.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53561.log.gz -5 2024-09-17T01:51:03.963 INFO:teuthology.orchestra.run.smithi042.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53902.log 2024-09-17T01:51:03.964 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.89203.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-17T01:51:03.964 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89203.log.gz 2024-09-17T01:51:03.965 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.53902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100206.log 2024-09-17T01:51:03.965 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53902.log.gz 2024-09-17T01:51:03.968 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.100206.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.100206.log.gz 2024-09-17T01:51:03.968 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109803.log 2024-09-17T01:51:03.970 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81873.log 2024-09-17T01:51:03.971 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.109803.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109803.log.gz 2024-09-17T01:51:03.972 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110548.log/var/log/ceph/ceph-client.admin.81873.log: 2024-09-17T01:51:03.972 INFO:teuthology.orchestra.run.smithi042.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.81873.log.gz 2024-09-17T01:51:03.973 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53477.log 2024-09-17T01:51:03.975 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.110548.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110548.log.gz 2024-09-17T01:51:03.975 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106417.log 2024-09-17T01:51:03.976 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.53477.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53477.log.gz 2024-09-17T01:51:03.978 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89245.log/var/log/ceph/ceph-client.admin.106417.log: 2024-09-17T01:51:03.978 INFO:teuthology.orchestra.run.smithi042.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.106417.log.gz 2024-09-17T01:51:03.979 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41572.log 2024-09-17T01:51:03.980 INFO:teuthology.orchestra.run.smithi043.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-17T01:51:03.980 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.89245.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.89245.log.gz 2024-09-17T01:51:03.981 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90726.log 2024-09-17T01:51:03.982 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41572.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41572.log.gz 2024-09-17T01:51:03.982 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83986.log 2024-09-17T01:51:03.984 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.90726.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.90726.log.gz 2024-09-17T01:51:03.985 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5/var/log/ceph/ceph-client.admin.83986.log: --verbose -- /var/log/ceph/ceph-client.admin.44511.log 2024-09-17T01:51:03.985 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.83986.log.gz 2024-09-17T01:51:03.986 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96532.log 2024-09-17T01:51:03.988 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44511.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44511.log.gz 2024-09-17T01:51:03.989 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.96532.log: /var/log/ceph/ceph-client.admin.89930.log 2024-09-17T01:51:03.989 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.96532.log.gz 2024-09-17T01:51:03.990 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81268.log 2024-09-17T01:51:03.992 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.89930.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.89930.log.gz 2024-09-17T01:51:03.993 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84360.log 2024-09-17T01:51:03.993 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.81268.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.81268.log.gz 2024-09-17T01:51:03.994 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64636.log 2024-09-17T01:51:03.995 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.84360.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.84360.log.gz 2024-09-17T01:51:03.996 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68447.log 2024-09-17T01:51:03.997 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.64636.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64636.log.gz 2024-09-17T01:51:03.998 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65746.log 2024-09-17T01:51:03.999 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.68447.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.68447.log.gz 2024-09-17T01:51:04.000 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68107.log 2024-09-17T01:51:04.000 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.65746.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65746.log.gz 2024-09-17T01:51:04.001 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41907.log 2024-09-17T01:51:04.003 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.68107.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.68107.log.gz 2024-09-17T01:51:04.004 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100367.log 2024-09-17T01:51:04.004 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41907.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41907.log.gz 2024-09-17T01:51:04.005 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90642.log 2024-09-17T01:51:04.006 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.100367.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.100367.log.gz 2024-09-17T01:51:04.007 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86935.log 2024-09-17T01:51:04.008 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.90642.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.90642.log.gz 2024-09-17T01:51:04.009 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99509.log 2024-09-17T01:51:04.010 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.86935.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86935.log.gz 2024-09-17T01:51:04.011 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108984.log 2024-09-17T01:51:04.011 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.99509.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.99509.log.gz 2024-09-17T01:51:04.012 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84712.log 2024-09-17T01:51:04.014 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.108984.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.108984.log.gz 2024-09-17T01:51:04.015 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.84712.log: /var/log/ceph/ceph-client.0.97042.log 2024-09-17T01:51:04.015 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.84712.log.gz 2024-09-17T01:51:04.016 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36046.log 2024-09-17T01:51:04.017 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.97042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.97042.log.gz 2024-09-17T01:51:04.018 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86500.log 2024-09-17T01:51:04.019 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36046.log: 74.4% -- replaced with /var/log/ceph/ceph-client.admin.36046.log.gz 2024-09-17T01:51:04.020 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56981.log 2024-09-17T01:51:04.021 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.86500.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.86500.log.gz 2024-09-17T01:51:04.022 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.56981.log: /var/log/ceph/ceph-client.admin.52639.log 2024-09-17T01:51:04.023 INFO:teuthology.orchestra.run.smithi042.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.56981.log.gz 2024-09-17T01:51:04.024 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104919.log 2024-09-17T01:51:04.026 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.52639.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52639.log.gz 2024-09-17T01:51:04.026 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.104919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76172.log 2024-09-17T01:51:04.026 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.104919.log.gz 2024-09-17T01:51:04.028 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95076.log 2024-09-17T01:51:04.029 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.76172.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.76172.log.gz 2024-09-17T01:51:04.030 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42356.log 2024-09-17T01:51:04.030 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.95076.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95076.log.gz 2024-09-17T01:51:04.031 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103848.log 2024-09-17T01:51:04.033 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42356.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42356.log.gz 2024-09-17T01:51:04.034 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44343.log 2024-09-17T01:51:04.035 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.103848.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.103848.log.gz 2024-09-17T01:51:04.035 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76737.log 2024-09-17T01:51:04.037 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44343.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44343.log.gz 2024-09-17T01:51:04.037 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61515.log 2024-09-17T01:51:04.038 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.76737.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.76737.log.gz 2024-09-17T01:51:04.039 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110019.log 2024-09-17T01:51:04.040 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.61515.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61515.log.gz 2024-09-17T01:51:04.040 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96179.log 2024-09-17T01:51:04.042 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.110019.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.110019.log.gz 2024-09-17T01:51:04.043 INFO:teuthology.orchestra.run.smithi042.stderr:gzip/var/log/ceph/ceph-client.admin.96179.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36855.log 2024-09-17T01:51:04.043 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.96179.log.gz 2024-09-17T01:51:04.044 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91645.log 2024-09-17T01:51:04.046 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36855.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36855.log.gz 2024-09-17T01:51:04.047 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94272.log 2024-09-17T01:51:04.047 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.91645.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.91645.log.gz 2024-09-17T01:51:04.048 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106585.log 2024-09-17T01:51:04.050 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.94272.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.94272.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58233.log 2024-09-17T01:51:04.050 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-09-17T01:51:04.050 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.106585.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.106585.log.gz 2024-09-17T01:51:04.051 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-17T01:51:04.053 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.58233.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58233.log.gz 2024-09-17T01:51:04.053 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59053.log 2024-09-17T01:51:04.054 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91081.log 2024-09-17T01:51:04.056 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.59053.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.59053.log.gz 2024-09-17T01:51:04.057 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.91081.log: gzip -5 --verbose -- 87.5% -- replaced with /var/log/ceph/ceph-client.admin.91081.log.gz 2024-09-17T01:51:04.057 INFO:teuthology.orchestra.run.smithi042.stderr: /var/log/ceph/ceph-client.admin.81705.log 2024-09-17T01:51:04.058 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64384.log 2024-09-17T01:51:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.81705.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.81705.log.gz 2024-09-17T01:51:04.061 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.64384.log: -- 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64384.log.gz 2024-09-17T01:51:04.061 INFO:teuthology.orchestra.run.smithi042.stderr: /var/log/ceph/ceph-client.admin.58191.log 2024-09-17T01:51:04.063 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76256.log 2024-09-17T01:51:04.064 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.58191.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58191.log.gz 2024-09-17T01:51:04.065 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86370.log 2024-09-17T01:51:04.066 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.76256.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.76256.log.gz 2024-09-17T01:51:04.066 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105442.log 2024-09-17T01:51:04.067 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.86370.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.86370.log.gz 2024-09-17T01:51:04.068 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94896.log 2024-09-17T01:51:04.069 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.105442.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.105442.log.gz 2024-09-17T01:51:04.070 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58969.log 2024-09-17T01:51:04.070 INFO:teuthology.orchestra.run.smithi042.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-17T01:51:04.071 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.94896.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94896.log.gz 2024-09-17T01:51:04.071 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94464.log 2024-09-17T01:51:04.073 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.58969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89137.log 2024-09-17T01:51:04.073 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58969.log.gz 2024-09-17T01:51:04.074 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.94464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36074.log 2024-09-17T01:51:04.074 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94464.log.gz 2024-09-17T01:51:04.076 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.89137.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.89137.log.gz 2024-09-17T01:51:04.076 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58573.log 2024-09-17T01:51:04.076 INFO:teuthology.orchestra.run.smithi042.stderr: 74.2% -- replaced with /var/log/ceph/ceph-client.admin.36074.log.gz 2024-09-17T01:51:04.077 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52489.log 2024-09-17T01:51:04.078 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.58573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108732.log 2024-09-17T01:51:04.079 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58573.log.gz 2024-09-17T01:51:04.080 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.52489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95465.log 2024-09-17T01:51:04.082 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52489.log.gz 2024-09-17T01:51:04.082 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.108732.log: gzip -5 87.1% --verbose -- /var/log/ceph/ceph-client.admin.89330.log 2024-09-17T01:51:04.082 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.108732.log.gz 2024-09-17T01:51:04.082 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.95465.log: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54339.log 2024-09-17T01:51:04.082 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95465.log.gz 2024-09-17T01:51:04.084 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.89330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53656.log 2024-09-17T01:51:04.084 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.89330.log.gz 2024-09-17T01:51:04.086 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.54339.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54339.log.gz 2024-09-17T01:51:04.086 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5/var/log/ceph/ceph-client.admin.53656.log: --verbose -- /var/log/ceph/ceph-client.admin.105274.log 2024-09-17T01:51:04.086 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53656.log.gz 2024-09-17T01:51:04.087 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105951.log 2024-09-17T01:51:04.088 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.105274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82271.log 2024-09-17T01:51:04.089 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.105274.log.gz 2024-09-17T01:51:04.090 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.105951.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.105951.log.gz 2024-09-17T01:51:04.090 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99883.log 2024-09-17T01:51:04.090 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.82271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.82271.log.gz 2024-09-17T01:51:04.092 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41568.log 2024-09-17T01:51:04.093 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.99883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59365.log 2024-09-17T01:51:04.093 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.99883.log.gz 2024-09-17T01:51:04.094 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41568.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.41568.log.gz 2024-09-17T01:51:04.095 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91733.log 2024-09-17T01:51:04.095 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.59365.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.59365.log.gz 2024-09-17T01:51:04.096 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62336.log 2024-09-17T01:51:04.097 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.91733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84538.log 2024-09-17T01:51:04.097 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.91733.log.gz 2024-09-17T01:51:04.099 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.62336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44553.log 2024-09-17T01:51:04.099 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62336.log.gz 2024-09-17T01:51:04.100 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.84538.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T01:51:04.100 INFO:teuthology.orchestra.run.smithi042.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.84538.log.gz 2024-09-17T01:51:04.101 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44553.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44553.log.gz 2024-09-17T01:51:04.101 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91039.log 2024-09-17T01:51:04.103 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81102.log 2024-09-17T01:51:04.105 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.91039.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.91039.log.gz 2024-09-17T01:51:04.105 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5/var/log/ceph/ceph-client.admin.81102.log: --verbose -- /var/log/ceph/ceph-client.admin.105316.log 2024-09-17T01:51:04.105 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.81102.log.gz 2024-09-17T01:51:04.106 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59011.log 2024-09-17T01:51:04.107 INFO:teuthology.orchestra.run.smithi042.stderr: 86.8%/var/log/ceph/ceph-client.admin.105316.log: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T01:51:04.107 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.105316.log.gz 2024-09-17T01:51:04.108 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75851.log 2024-09-17T01:51:04.109 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.59011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80362.log 2024-09-17T01:51:04.112 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59011.log.gz 2024-09-17T01:51:04.115 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.75851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62206.log 2024-09-17T01:51:04.115 INFO:teuthology.orchestra.run.smithi042.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.75851.log.gz/var/log/ceph/ceph-client.admin.80362.log: 2024-09-17T01:51:04.116 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- 87.1% -- replaced with /var/log/ceph/ceph-client.admin.80362.log.gz 2024-09-17T01:51:04.116 INFO:teuthology.orchestra.run.smithi042.stderr: /var/log/ceph/ceph-client.admin.100540.log 2024-09-17T01:51:04.116 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.62206.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62206.log.gz 2024-09-17T01:51:04.116 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86851.log 2024-09-17T01:51:04.116 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.100540.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.100540.log.gz 2024-09-17T01:51:04.116 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5/var/log/ceph/ceph-client.admin.86851.log: --verbose -- /var/log/ceph/ceph-client.admin.58843.log 2024-09-17T01:51:04.116 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.86851.log.gz 2024-09-17T01:51:04.117 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65620.log 2024-09-17T01:51:04.118 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.58843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86456.log 2024-09-17T01:51:04.118 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.58843.log.gz 2024-09-17T01:51:04.119 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.65620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91817.log 2024-09-17T01:51:04.119 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65620.log.gz 2024-09-17T01:51:04.121 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.86456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77791.log 2024-09-17T01:51:04.121 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.86456.log.gz 2024-09-17T01:51:04.121 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.91817.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.91817.log.gz 2024-09-17T01:51:04.122 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62164.log 2024-09-17T01:51:04.123 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.77791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90056.log 2024-09-17T01:51:04.123 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.77791.log.gz 2024-09-17T01:51:04.125 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.62164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36231.log 2024-09-17T01:51:04.125 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.62164.log.gz 2024-09-17T01:51:04.126 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.90056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102608.log 2024-09-17T01:51:04.126 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90056.log.gz 2024-09-17T01:51:04.127 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107505.log 2024-09-17T01:51:04.127 INFO:teuthology.orchestra.run.smithi042.stderr: 76.5% -- replaced with /var/log/ceph/ceph-client.admin.36231.log.gz 2024-09-17T01:51:04.128 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.102608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40970.log 2024-09-17T01:51:04.128 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102608.log.gz 2024-09-17T01:51:04.129 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.107505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53080.log 2024-09-17T01:51:04.129 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107505.log.gz 2024-09-17T01:51:04.131 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86055.log 2024-09-17T01:51:04.131 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40970.log.gz 2024-09-17T01:51:04.132 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.53080.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53080.log.gz 2024-09-17T01:51:04.132 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.103722.log 2024-09-17T01:51:04.133 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.86055.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86055.log.gz 2024-09-17T01:51:04.134 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100667.log 2024-09-17T01:51:04.135 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.103722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58149.log 2024-09-17T01:51:04.135 INFO:teuthology.orchestra.run.smithi042.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.103722.log.gz 2024-09-17T01:51:04.136 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.100667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66622.log 2024-09-17T01:51:04.136 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.100667.log.gz 2024-09-17T01:51:04.137 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.58149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68969.log 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58149.log.gz 2024-09-17T01:51:04.138 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-09-17T01:51:04.138 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.66622.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66622.log.gz 2024-09-17T01:51:04.139 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45548.log 2024-09-17T01:51:04.141 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.68969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45069.log 2024-09-17T01:51:04.141 INFO:teuthology.orchestra.run.smithi042.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.68969.log.gz 2024-09-17T01:51:04.142 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94938.log 2024-09-17T01:51:04.142 INFO:teuthology.orchestra.run.smithi042.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.45548.log.gz 2024-09-17T01:51:04.143 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58927.log 2024-09-17T01:51:04.143 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45069.log.gz 2024-09-17T01:51:04.144 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.94938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111286.log 2024-09-17T01:51:04.145 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.94938.log.gz 2024-09-17T01:51:04.145 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.58927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60189.log 2024-09-17T01:51:04.145 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58927.log.gz 2024-09-17T01:51:04.146 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.111286.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.111286.log.gz 2024-09-17T01:51:04.147 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84052.log 2024-09-17T01:51:04.148 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.60189.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60189.log.gz 2024-09-17T01:51:04.148 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65788.log 2024-09-17T01:51:04.149 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.84052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108104.log 2024-09-17T01:51:04.150 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.84052.log.gz 2024-09-17T01:51:04.150 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.65788.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.65788.log.gz 2024-09-17T01:51:04.151 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90361.log 2024-09-17T01:51:04.152 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.108104.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98770.log 2024-09-17T01:51:04.152 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.108104.log.gz 2024-09-17T01:51:04.153 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.90361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108394.log 2024-09-17T01:51:04.154 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.90361.log.gz 2024-09-17T01:51:04.155 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.98770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80759.log 2024-09-17T01:51:04.155 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98770.log.gz 2024-09-17T01:51:04.156 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.108394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111989.log 2024-09-17T01:51:04.156 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.108394.log.gz 2024-09-17T01:51:04.157 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.80759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102254.log 2024-09-17T01:51:04.157 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.80759.log.gz 2024-09-17T01:51:04.159 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.111989.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29639.log 2024-09-17T01:51:04.159 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111989.log.gz 2024-09-17T01:51:04.160 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.102254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104639.log 2024-09-17T01:51:04.160 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.102254.log.gz 2024-09-17T01:51:04.161 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph.tmp-client.admin.29639.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29639.log.gz 2024-09-17T01:51:04.161 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67668.log 2024-09-17T01:51:04.163 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.104639.log: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91550.log 2024-09-17T01:51:04.163 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.104639.log.gz 2024-09-17T01:51:04.164 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.67668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90768.log 2024-09-17T01:51:04.164 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67668.log.gz 2024-09-17T01:51:04.166 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.91550.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.91550.log.gz 2024-09-17T01:51:04.166 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80927.log 2024-09-17T01:51:04.167 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.90768.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65392.log 2024-09-17T01:51:04.167 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90768.log.gz 2024-09-17T01:51:04.168 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.80927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105400.log 2024-09-17T01:51:04.168 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.80927.log.gz 2024-09-17T01:51:04.169 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.65392.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.65392.log.gz 2024-09-17T01:51:04.169 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54213.log 2024-09-17T01:51:04.171 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.105400.log: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107715.log 2024-09-17T01:51:04.171 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.105400.log.gz 2024-09-17T01:51:04.172 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.54213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105908.log 2024-09-17T01:51:04.172 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54213.log.gz 2024-09-17T01:51:04.173 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.107715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54041.log 2024-09-17T01:51:04.173 INFO:teuthology.orchestra.run.smithi042.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.107715.log.gz 2024-09-17T01:51:04.174 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.105908.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105908.log.gz 2024-09-17T01:51:04.175 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56696.log 2024-09-17T01:51:04.175 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.54041.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54041.log.gz 2024-09-17T01:51:04.176 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43735.log 2024-09-17T01:51:04.177 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.56696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108690.log 2024-09-17T01:51:04.179 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.56696.log.gz/var/log/ceph/ceph-client.admin.43735.log: 2024-09-17T01:51:04.179 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43735.log.gz 2024-09-17T01:51:04.179 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79921.log 2024-09-17T01:51:04.180 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.108690.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.108690.log.gz 2024-09-17T01:51:04.180 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100919.log 2024-09-17T01:51:04.182 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.79921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107799.log 2024-09-17T01:51:04.182 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.79921.log.gz 2024-09-17T01:51:04.182 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.100919.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.100919.log.gz 2024-09-17T01:51:04.183 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64594.log 2024-09-17T01:51:04.184 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.107799.log: 86.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54567.log 2024-09-17T01:51:04.184 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.107799.log.gz 2024-09-17T01:51:04.185 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.64594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58531.log 2024-09-17T01:51:04.186 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64594.log.gz 2024-09-17T01:51:04.187 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.54567.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54567.log.gz 2024-09-17T01:51:04.187 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85700.log 2024-09-17T01:51:04.188 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.58531.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.101429.log 2024-09-17T01:51:04.188 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58531.log.gz 2024-09-17T01:51:04.189 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.85700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54909.log 2024-09-17T01:51:04.190 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.85700.log.gz 2024-09-17T01:51:04.191 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.101429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.101429.log.gz 2024-09-17T01:51:04.191 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62069.log 2024-09-17T01:51:04.192 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.54909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89456.log 2024-09-17T01:51:04.192 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54909.log.gz 2024-09-17T01:51:04.193 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.62069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90684.log 2024-09-17T01:51:04.193 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62069.log.gz 2024-09-17T01:51:04.194 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.89456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35902.log 2024-09-17T01:51:04.194 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89456.log.gz 2024-09-17T01:51:04.196 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.90684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77557.log 2024-09-17T01:51:04.196 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.90684.log.gz 2024-09-17T01:51:04.197 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.35902.log: gzip 74.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.35902.log.gz --verbose 2024-09-17T01:51:04.197 INFO:teuthology.orchestra.run.smithi042.stderr: -- /var/log/ceph/ceph-client.admin.64865.log 2024-09-17T01:51:04.198 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.77557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44675.log 2024-09-17T01:51:04.198 INFO:teuthology.orchestra.run.smithi042.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.77557.log.gz 2024-09-17T01:51:04.199 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.64865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96850.log 2024-09-17T01:51:04.200 INFO:teuthology.orchestra.run.smithi042.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64865.log.gz 2024-09-17T01:51:04.201 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77683.log 2024-09-17T01:51:04.201 INFO:teuthology.orchestra.run.smithi042.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44675.log.gz 2024-09-17T01:51:04.201 INFO:teuthology.orchestra.run.smithi043.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-17T01:51:04.202 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.96850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77301.log 2024-09-17T01:51:04.202 INFO:teuthology.orchestra.run.smithi042.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96850.log.gz 2024-09-17T01:51:04.203 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.77683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85658.log 2024-09-17T01:51:04.203 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77683.log.gz 2024-09-17T01:51:04.204 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.77301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86290.log 2024-09-17T01:51:04.206 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77301.log.gz 2024-09-17T01:51:04.206 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.85658.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.85658.log.gz 2024-09-17T01:51:04.206 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41012.log 2024-09-17T01:51:04.207 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.86290.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86290.log.gz 2024-09-17T01:51:04.207 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67482.log 2024-09-17T01:51:04.209 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45199.log 2024-09-17T01:51:04.209 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41012.log.gz 2024-09-17T01:51:04.210 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.67482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41348.log 2024-09-17T01:51:04.210 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67482.log.gz 2024-09-17T01:51:04.211 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102871.log 2024-09-17T01:51:04.211 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45199.log.gz 2024-09-17T01:51:04.212 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41348.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41348.log.gz 2024-09-17T01:51:04.213 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.102871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89714.log 2024-09-17T01:51:04.214 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.102871.log.gz 2024-09-17T01:51:04.215 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45422.log 2024-09-17T01:51:04.216 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.89714.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.89714.log.gz 2024-09-17T01:51:04.216 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80885.log 2024-09-17T01:51:04.217 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99593.log 2024-09-17T01:51:04.218 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45422.log.gz 2024-09-17T01:51:04.219 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.80885.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.80885.log.gz 2024-09-17T01:51:04.220 INFO:teuthology.orchestra.run.smithi042.stderr:gzip/var/log/ceph/ceph-client.admin.99593.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.63176.log 2024-09-17T01:51:04.221 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.99593.log.gz 2024-09-17T01:51:04.221 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110632.log 2024-09-17T01:51:04.223 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.63176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45155.log 2024-09-17T01:51:04.223 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63176.log.gz 2024-09-17T01:51:04.223 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.110632.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110632.log.gz 2024-09-17T01:51:04.224 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43930.log 2024-09-17T01:51:04.225 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68286.log 2024-09-17T01:51:04.225 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45155.log.gz 2024-09-17T01:51:04.226 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.43930.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43930.log.gz 2024-09-17T01:51:04.226 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89498.log 2024-09-17T01:51:04.228 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.68286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96784.log 87.1% -- replaced with /var/log/ceph/ceph-client.admin.68286.log.gz 2024-09-17T01:51:04.228 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-09-17T01:51:04.229 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.89498.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89498.log.gz 2024-09-17T01:51:04.229 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.106945.log 2024-09-17T01:51:04.231 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.96784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96265.log 2024-09-17T01:51:04.231 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.96784.log.gz 2024-09-17T01:51:04.232 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.106945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.106945.log.gz 2024-09-17T01:51:04.232 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111610.log 2024-09-17T01:51:04.233 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.96265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68713.log 2024-09-17T01:51:04.233 INFO:teuthology.orchestra.run.smithi042.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.96265.log.gz 2024-09-17T01:51:04.234 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.111610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58450.log 2024-09-17T01:51:04.234 INFO:teuthology.orchestra.run.smithi042.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.111610.log.gz 2024-09-17T01:51:04.236 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.68713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35672.log 2024-09-17T01:51:04.236 INFO:teuthology.orchestra.run.smithi042.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68713.log.gz 2024-09-17T01:51:04.237 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.58450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85406.log 2024-09-17T01:51:04.237 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58450.log.gz 2024-09-17T01:51:04.238 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.35672.log: gzip 77.8% -- replaced with /var/log/ceph/ceph-client.admin.35672.log.gz -5 2024-09-17T01:51:04.238 INFO:teuthology.orchestra.run.smithi042.stderr: --verbose -- /var/log/ceph/ceph-client.admin.107631.log 2024-09-17T01:51:04.239 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.85406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81495.log 2024-09-17T01:51:04.239 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.85406.log.gz 2024-09-17T01:51:04.241 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.107631.log: gzip -5 --verbose -- 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107631.log.gz 2024-09-17T01:51:04.241 INFO:teuthology.orchestra.run.smithi042.stderr: /var/log/ceph/ceph-client.admin.35972.log 2024-09-17T01:51:04.242 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.81495.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.81495.log.gz 2024-09-17T01:51:04.242 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99841.log 2024-09-17T01:51:04.243 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.35972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61142.log 2024-09-17T01:51:04.244 INFO:teuthology.orchestra.run.smithi042.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.35972.log.gz 2024-09-17T01:51:04.244 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.99841.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99841.log.gz 2024-09-17T01:51:04.246 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.61142.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61142.log.gz 2024-09-17T01:51:04.246 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64342.log 2024-09-17T01:51:04.247 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91859.log 2024-09-17T01:51:04.249 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.64342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99382.log 2024-09-17T01:51:04.249 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.64342.log.gz 2024-09-17T01:51:04.250 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.91859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106459.log 2024-09-17T01:51:04.250 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.91859.log.gz 2024-09-17T01:51:04.251 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.99382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61473.log 2024-09-17T01:51:04.252 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.99382.log.gz 2024-09-17T01:51:04.252 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.106459.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106459.log.gz 2024-09-17T01:51:04.254 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.61473.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61473.log.gz 2024-09-17T01:51:04.254 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103256.log 2024-09-17T01:51:04.255 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68532.log 2024-09-17T01:51:04.257 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.103256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112031.log 2024-09-17T01:51:04.257 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103256.log.gz 2024-09-17T01:51:04.258 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.68532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108918.log 2024-09-17T01:51:04.258 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68532.log.gz 2024-09-17T01:51:04.259 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.112031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90871.log 2024-09-17T01:51:04.259 INFO:teuthology.orchestra.run.smithi042.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.112031.log.gz 2024-09-17T01:51:04.260 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.108918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60585.log 2024-09-17T01:51:04.261 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.108918.log.gz 2024-09-17T01:51:04.262 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.90871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42188.log 2024-09-17T01:51:04.262 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.90871.log.gz 2024-09-17T01:51:04.263 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.60585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65128.log 2024-09-17T01:51:04.263 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60585.log.gz 2024-09-17T01:51:04.264 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103680.log 2024-09-17T01:51:04.264 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42188.log.gz 2024-09-17T01:51:04.266 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.65128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87019.log 2024-09-17T01:51:04.266 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65128.log.gz 2024-09-17T01:51:04.266 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.103680.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.103680.log.gz 2024-09-17T01:51:04.267 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41054.log 2024-09-17T01:51:04.269 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.87019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84226.log 2024-09-17T01:51:04.269 INFO:teuthology.orchestra.run.smithi042.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.87019.log.gz 2024-09-17T01:51:04.270 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95694.log 2024-09-17T01:51:04.270 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41054.log.gz 2024-09-17T01:51:04.270 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.84226.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84226.log.gz 2024-09-17T01:51:04.271 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101237.log 2024-09-17T01:51:04.272 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.95694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41306.log 2024-09-17T01:51:04.272 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95694.log.gz 2024-09-17T01:51:04.273 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.101237.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101237.log.gz 2024-09-17T01:51:04.275 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.41306.log: -- /var/log/ceph/ceph-client.admin.40886.log 2024-09-17T01:51:04.275 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41306.log.gz 2024-09-17T01:51:04.275 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68927.log 2024-09-17T01:51:04.277 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94632.log 2024-09-17T01:51:04.277 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40886.log.gz 2024-09-17T01:51:04.278 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.68927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108438.log 2024-09-17T01:51:04.278 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68927.log.gz 2024-09-17T01:51:04.279 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.94632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106207.log 2024-09-17T01:51:04.280 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94632.log.gz 2024-09-17T01:51:04.281 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.108438.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.108438.log.gz 2024-09-17T01:51:04.281 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102692.log 2024-09-17T01:51:04.282 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.106207.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.106207.log.gz 2024-09-17T01:51:04.282 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75634.log 2024-09-17T01:51:04.284 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.102692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45338.log 2024-09-17T01:51:04.284 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.102692.log.gz 2024-09-17T01:51:04.286 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.75634.log: gzip 90.9% -- replaced with /var/log/ceph/ceph-client.admin.75634.log.gz 2024-09-17T01:51:04.286 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose/var/log/ceph/ceph-client.admin.45338.log: -- /var/log/ceph/ceph-client.admin.90829.log 2024-09-17T01:51:04.286 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45338.log.gz 2024-09-17T01:51:04.287 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41555.log 2024-09-17T01:51:04.288 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.90829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102566.log 2024-09-17T01:51:04.288 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.90829.log.gz 2024-09-17T01:51:04.290 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95170.log 2024-09-17T01:51:04.290 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41555.log.gz 2024-09-17T01:51:04.291 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.102566.log: gzip -5 --verbose 87.2% -- replaced with /var/log/ceph/ceph-client.admin.102566.log.gz 2024-09-17T01:51:04.291 INFO:teuthology.orchestra.run.smithi042.stderr: -- /var/log/ceph/ceph-client.admin.106165.log 2024-09-17T01:51:04.292 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.95170.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95170.log.gz 2024-09-17T01:51:04.292 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67305.log 2024-09-17T01:51:04.294 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.106165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80446.log 2024-09-17T01:51:04.294 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.106165.log.gz 2024-09-17T01:51:04.295 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.67305.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67305.log.gz 2024-09-17T01:51:04.295 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103596.log 2024-09-17T01:51:04.296 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.80446.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80446.log.gz 2024-09-17T01:51:04.297 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63253.log 2024-09-17T01:51:04.298 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.103596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40842.log 2024-09-17T01:51:04.298 INFO:teuthology.orchestra.run.smithi042.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.103596.log.gz 2024-09-17T01:51:04.299 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.63253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99943.log 2024-09-17T01:51:04.299 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63253.log.gz 2024-09-17T01:51:04.301 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40842.log: gzip -5 --verbose 87.1% -- replaced with /var/log/ceph/ceph-client.admin.40842.log.gz 2024-09-17T01:51:04.301 INFO:teuthology.orchestra.run.smithi042.stderr: -- /var/log/ceph/ceph-client.admin.90582.log 2024-09-17T01:51:04.301 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.99943.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99943.log.gz 2024-09-17T01:51:04.302 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91901.log 2024-09-17T01:51:04.303 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.90582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68191.log 2024-09-17T01:51:04.303 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90582.log.gz 2024-09-17T01:51:04.304 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.91901.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.91901.log.gz 2024-09-17T01:51:04.305 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59179.log 2024-09-17T01:51:04.305 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.68191.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68191.log.gz 2024-09-17T01:51:04.306 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77473.log 2024-09-17T01:51:04.307 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.59179.log: gzip -5 --verbose -- 87.2% /var/log/ceph/ceph-client.admin.35938.log 2024-09-17T01:51:04.308 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59179.log.gz 2024-09-17T01:51:04.308 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.77473.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.77473.log.gz 2024-09-17T01:51:04.309 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45292.log 2024-09-17T01:51:04.310 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.35938.log: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.35938.log.gz 2024-09-17T01:51:04.310 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102296.log 2024-09-17T01:51:04.311 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80029.log 2024-09-17T01:51:04.311 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45292.log.gz 2024-09-17T01:51:04.313 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.102296.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102296.log.gz 2024-09-17T01:51:04.317 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.80029.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80029.log.gz 2024-09-17T01:51:04.317 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81356.log 2024-09-17T01:51:04.318 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40798.log 2024-09-17T01:51:04.318 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.81356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80843.log 2024-09-17T01:51:04.318 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.81356.log.gz 2024-09-17T01:51:04.318 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40798.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40798.log.gz 2024-09-17T01:51:04.319 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101681.log 2024-09-17T01:51:04.319 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.80843.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.80843.log.gz 2024-09-17T01:51:04.320 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84838.log 2024-09-17T01:51:04.321 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.101681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60859.log 2024-09-17T01:51:04.322 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.101681.log.gz 2024-09-17T01:51:04.322 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.84838.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84838.log.gz 2024-09-17T01:51:04.323 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86412.log 2024-09-17T01:51:04.323 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.60859.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60859.log.gz 2024-09-17T01:51:04.324 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91260.log 2024-09-17T01:51:04.325 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.86412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89414.log 2024-09-17T01:51:04.325 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86412.log.gz 2024-09-17T01:51:04.327 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.91260.log: gzip 87.1% -- replaced with /var/log/ceph/ceph-client.admin.91260.log.gz 2024-09-17T01:51:04.327 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.104556.log 2024-09-17T01:51:04.327 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.89414.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.89414.log.gz 2024-09-17T01:51:04.328 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105526.log 2024-09-17T01:51:04.329 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.104556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106291.log 2024-09-17T01:51:04.330 INFO:teuthology.orchestra.run.smithi042.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.104556.log.gz 2024-09-17T01:51:04.330 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.105526.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.105526.log.gz 2024-09-17T01:51:04.332 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.106291.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106291.log.gz 2024-09-17T01:51:04.332 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55692.log 2024-09-17T01:51:04.333 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66210.log 2024-09-17T01:51:04.335 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.55692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40632.log 2024-09-17T01:51:04.335 INFO:teuthology.orchestra.run.smithi042.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.55692.log.gz 2024-09-17T01:51:04.336 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.66210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.66210.log.gz 2024-09-17T01:51:04.336 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102524.log 2024-09-17T01:51:04.337 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90540.log 2024-09-17T01:51:04.337 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40632.log.gz 2024-09-17T01:51:04.339 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.102524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100111.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.102524.log.gz 2024-09-17T01:51:04.339 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-09-17T01:51:04.340 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.90540.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.90540.log.gz 2024-09-17T01:51:04.340 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103428.log 2024-09-17T01:51:04.341 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.100111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84310.log 2024-09-17T01:51:04.342 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.100111.log.gz 2024-09-17T01:51:04.343 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.103428.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103428.log.gz 2024-09-17T01:51:04.343 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57584.log 2024-09-17T01:51:04.345 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.84310.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.84310.log.gz 2024-09-17T01:51:04.345 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110674.log 2024-09-17T01:51:04.346 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5/var/log/ceph/ceph-client.admin.57584.log: --verbose -- /var/log/ceph/ceph-client.admin.109677.log 2024-09-17T01:51:04.346 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57584.log.gz 2024-09-17T01:51:04.347 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.110674.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.110674.log.gz 2024-09-17T01:51:04.348 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84184.log 2024-09-17T01:51:04.349 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.109677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101765.log 2024-09-17T01:51:04.349 INFO:teuthology.orchestra.run.smithi042.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.109677.log.gz 2024-09-17T01:51:04.350 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.84184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100793.log 2024-09-17T01:51:04.350 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84184.log.gz 2024-09-17T01:51:04.351 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.101765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54905.log 2024-09-17T01:51:04.352 INFO:teuthology.orchestra.run.smithi042.stderr: 91.1%/var/log/ceph/ceph-client.admin.100793.log: -- replaced with /var/log/ceph/ceph-client.admin.101765.log.gz 2024-09-17T01:51:04.352 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100793.log.gz 2024-09-17T01:51:04.353 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61184.log 2024-09-17T01:51:04.353 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.54905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54905.log.gz 2024-09-17T01:51:04.354 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103470.log 2024-09-17T01:51:04.355 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.61184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99287.log 2024-09-17T01:51:04.355 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61184.log.gz 2024-09-17T01:51:04.357 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.103470.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.103470.log.gz 2024-09-17T01:51:04.357 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111695.log 2024-09-17T01:51:04.358 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.99287.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.99287.log.gz 2024-09-17T01:51:04.358 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59619.log 2024-09-17T01:51:04.360 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.111695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55510.log 2024-09-17T01:51:04.360 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.111695.log.gz 2024-09-17T01:51:04.360 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.59619.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59619.log.gz 2024-09-17T01:51:04.361 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42146.log 2024-09-17T01:51:04.362 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.55510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99169.log 2024-09-17T01:51:04.363 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.55510.log.gz 2024-09-17T01:51:04.363 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42146.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42146.log.gz 2024-09-17T01:51:04.364 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57197.log 2024-09-17T01:51:04.365 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.99169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105171.log 2024-09-17T01:51:04.366 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.99169.log.gz 2024-09-17T01:51:04.366 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.57197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102482.log 2024-09-17T01:51:04.367 INFO:teuthology.orchestra.run.smithi042.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57197.log.gz 2024-09-17T01:51:04.367 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.105171.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.105171.log.gz 2024-09-17T01:51:04.368 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56076.log 2024-09-17T01:51:04.369 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.102482.log: gzip -5 --verbose 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102482.log.gz 2024-09-17T01:51:04.369 INFO:teuthology.orchestra.run.smithi042.stderr: -- /var/log/ceph/ceph-client.admin.107673.log 2024-09-17T01:51:04.371 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.56076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85616.log 2024-09-17T01:51:04.371 INFO:teuthology.orchestra.run.smithi042.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.56076.log.gz 2024-09-17T01:51:04.372 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.107673.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.107673.log.gz 2024-09-17T01:51:04.373 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.85616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40928.log 2024-09-17T01:51:04.374 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.85616.log.gz 2024-09-17T01:51:04.374 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85312.log 2024-09-17T01:51:04.376 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86767.log 2024-09-17T01:51:04.376 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40928.log.gz 2024-09-17T01:51:04.377 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.85312.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.85312.log.gz 2024-09-17T01:51:04.377 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46100.log 2024-09-17T01:51:04.378 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.86767.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86767.log.gz 2024-09-17T01:51:04.379 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110590.log 2024-09-17T01:51:04.380 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.46100.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46100.log.gz 2024-09-17T01:51:04.380 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44985.log 2024-09-17T01:51:04.381 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.110590.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110590.log.gz 2024-09-17T01:51:04.381 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59095.log 2024-09-17T01:51:04.383 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111737.log 2024-09-17T01:51:04.383 INFO:teuthology.orchestra.run.smithi042.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44985.log.gz 2024-09-17T01:51:04.384 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.59095.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.59095.log.gz 2024-09-17T01:51:04.384 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54255.log 2024-09-17T01:51:04.385 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.111737.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.111737.log.gz 2024-09-17T01:51:04.386 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45464.log 2024-09-17T01:51:04.387 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.54255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67710.log 2024-09-17T01:51:04.387 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54255.log.gz 2024-09-17T01:51:04.388 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96137.log 2024-09-17T01:51:04.389 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45464.log.gz 2024-09-17T01:51:04.390 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.67710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61268.log 2024-09-17T01:51:04.390 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67710.log.gz 2024-09-17T01:51:04.391 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.96137.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96137.log.gz 2024-09-17T01:51:04.392 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.61268.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61268.log.gz 2024-09-17T01:51:04.392 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95610.log 2024-09-17T01:51:04.394 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57668.log 2024-09-17T01:51:04.395 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.95610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61016.log 2024-09-17T01:51:04.395 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95610.log.gz 2024-09-17T01:51:04.396 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.57668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106687.log 2024-09-17T01:51:04.396 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57668.log.gz 2024-09-17T01:51:04.397 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.61016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54609.log 2024-09-17T01:51:04.398 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61016.log.gz 2024-09-17T01:51:04.399 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.106687.log: /var/log/ceph/ceph-client.admin.54609.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.106687.log.gz 2024-09-17T01:51:04.400 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.106941.log 2024-09-17T01:51:04.400 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54609.log.gz 2024-09-17T01:51:04.401 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108480.log 2024-09-17T01:51:04.402 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.0.106941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.106941.log.gz 2024-09-17T01:51:04.403 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102440.log 2024-09-17T01:51:04.404 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.108480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68489.log 2024-09-17T01:51:04.404 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108480.log.gz 2024-09-17T01:51:04.405 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.102440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91594.log 2024-09-17T01:51:04.405 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.102440.log.gz 2024-09-17T01:51:04.407 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.68489.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68489.log.gz 2024-09-17T01:51:04.409 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.91594.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.91594.log.gz 2024-09-17T01:51:04.409 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99985.log 2024-09-17T01:51:04.409 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60669.log 2024-09-17T01:51:04.411 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.99985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60477.log 2024-09-17T01:51:04.411 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.99985.log.gz 2024-09-17T01:51:04.413 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.60669.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60669.log.gz 2024-09-17T01:51:04.413 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54381.log 2024-09-17T01:51:04.413 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.60477.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60477.log.gz 2024-09-17T01:51:04.413 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40536.log 2024-09-17T01:51:04.415 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.54381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86115.log 2024-09-17T01:51:04.415 INFO:teuthology.orchestra.run.smithi042.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.54381.log.gz 2024-09-17T01:51:04.416 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103512.log 2024-09-17T01:51:04.416 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40536.log.gz 2024-09-17T01:51:04.417 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.86115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64907.log 2024-09-17T01:51:04.417 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.86115.log.gz 2024-09-17T01:51:04.418 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.103512.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.103512.log.gz 2024-09-17T01:51:04.421 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111779.log 2024-09-17T01:51:04.421 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.64907.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.64907.log.gz 2024-09-17T01:51:04.421 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.99104.log 2024-09-17T01:51:04.422 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.111779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63823.log 2024-09-17T01:51:04.422 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.111779.log.gz 2024-09-17T01:51:04.423 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.99104.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.99104.log.gz/var/log/ceph/ceph-client.admin.63823.log: 2024-09-17T01:51:04.424 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63823.log.gz 2024-09-17T01:51:04.424 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108009.log 2024-09-17T01:51:04.425 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65956.log 2024-09-17T01:51:04.427 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.108009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96616.log 2024-09-17T01:51:04.427 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.108009.log.gz 2024-09-17T01:51:04.429 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.65956.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.65956.log.gz 2024-09-17T01:51:04.429 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.96616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41571.log 2024-09-17T01:51:04.430 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.96616.log.gz 2024-09-17T01:51:04.430 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109845.log 2024-09-17T01:51:04.431 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84412.log 2024-09-17T01:51:04.432 INFO:teuthology.orchestra.run.smithi042.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41571.log.gz 2024-09-17T01:51:04.433 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.109845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35812.log 2024-09-17T01:51:04.433 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109845.log.gz 2024-09-17T01:51:04.434 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.84412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36127.log 2024-09-17T01:51:04.434 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.84412.log.gz 2024-09-17T01:51:04.435 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.35812.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35812.log.gz 2024-09-17T01:51:04.435 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55822.log 2024-09-17T01:51:04.437 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36127.log.gz 2024-09-17T01:51:04.437 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-17T01:51:04.438 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.55822.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55822.log.gz 2024-09-17T01:51:04.438 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65830.log 2024-09-17T01:51:04.439 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45674.log 2024-09-17T01:51:04.441 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.65830.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.65830.log.gz 2024-09-17T01:51:04.442 INFO:teuthology.orchestra.run.smithi042.stderr:gzip/var/log/ceph/ceph-client.admin.45674.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.65574.log 2024-09-17T01:51:04.442 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.45674.log.gz 2024-09-17T01:51:04.443 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99635.log 2024-09-17T01:51:04.444 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.65574.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.65574.log.gz 2024-09-17T01:51:04.445 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57263.log 2024-09-17T01:51:04.446 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.99635.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.99635.log.gz 2024-09-17T01:51:04.446 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58660.log 2024-09-17T01:51:04.449 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.57263.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57263.log.gz 2024-09-17T01:51:04.449 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89005.log 2024-09-17T01:51:04.449 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.58660.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58660.log.gz 2024-09-17T01:51:04.450 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45632.log 2024-09-17T01:51:04.452 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.89005.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.89005.log.gz 2024-09-17T01:51:04.452 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.45632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96402.log 2024-09-17T01:51:04.453 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45632.log.gz 2024-09-17T01:51:04.454 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-17T01:51:04.455 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.96402.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96402.log.gz 2024-09-17T01:51:04.456 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111821.log 2024-09-17T01:51:04.458 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.111821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36614.log 2024-09-17T01:51:04.459 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.111821.log.gz 2024-09-17T01:51:04.461 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53351.log 2024-09-17T01:51:04.463 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36614.log: 86.9%/var/log/ceph/ceph-client.admin.53351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106333.log 2024-09-17T01:51:04.463 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53351.log.gz 2024-09-17T01:51:04.464 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36614.log.gz 2024-09-17T01:51:04.465 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46178.log 2024-09-17T01:51:04.468 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.106333.log: /var/log/ceph/ceph-client.admin.46178.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.106333.log.gz 2024-09-17T01:51:04.469 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53990.log 2024-09-17T01:51:04.470 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46178.log.gz 2024-09-17T01:51:04.471 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102170.log 2024-09-17T01:51:04.475 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.53990.log: /var/log/ceph/ceph-client.admin.102170.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53990.log.gz 2024-09-17T01:51:04.476 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58023.log 2024-09-17T01:51:04.477 INFO:teuthology.orchestra.run.smithi042.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.102170.log.gz 2024-09-17T01:51:04.478 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57047.log 2024-09-17T01:51:04.482 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.57047.log: /var/log/ceph/ceph-client.admin.58023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111413.log 2024-09-17T01:51:04.484 INFO:teuthology.orchestra.run.smithi042.stderr: 87.1% 91.0% -- replaced with /var/log/ceph/ceph-client.admin.58023.log.gz 2024-09-17T01:51:04.484 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57047.log.gz 2024-09-17T01:51:04.485 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69432.log 2024-09-17T01:51:04.488 INFO:teuthology.orchestra.run.smithi042.stderr:gzip/var/log/ceph/ceph-client.admin.111413.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.67135.log 2024-09-17T01:51:04.489 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103638.log 2024-09-17T01:51:04.493 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2%/var/log/ceph/ceph-client.admin.69432.log: 87.1%/var/log/ceph/ceph-client.admin.103638.log: -- replaced with /var/log/ceph/ceph-client.admin.111413.log.gz 2024-09-17T01:51:04.493 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69432.log.gz 2024-09-17T01:51:04.495 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103638.log.gz 2024-09-17T01:51:04.495 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.67135.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56925.log 2024-09-17T01:51:04.498 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.56925.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56925.log.gz 2024-09-17T01:51:04.498 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67135.log.gz 2024-09-17T01:51:04.499 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64739.log 2024-09-17T01:51:04.500 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67239.log 2024-09-17T01:51:04.502 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107123.log 2024-09-17T01:51:04.504 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.64739.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64739.log.gz 2024-09-17T01:51:04.504 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44098.log 2024-09-17T01:51:04.506 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.67239.log: /var/log/ceph/ceph-client.admin.107123.log: 90.9% 90.8% -- replaced with /var/log/ceph/ceph-client.admin.107123.log.gz 2024-09-17T01:51:04.508 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44385.log 2024-09-17T01:51:04.510 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44098.log.gz 2024-09-17T01:51:04.510 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67239.log.gz 2024-09-17T01:51:04.511 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42416.log 2024-09-17T01:51:04.513 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.44385.log: 87.3%/var/log/ceph/ceph-client.admin.42416.log: -- replaced with /var/log/ceph/ceph-client.admin.44385.log.gz 2024-09-17T01:51:04.514 INFO:teuthology.orchestra.run.smithi042.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.42416.log.gz 2024-09-17T01:51:04.515 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67584.log 2024-09-17T01:51:04.522 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.67584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105705.log 2024-09-17T01:51:04.522 INFO:teuthology.orchestra.run.smithi042.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67584.log.gz 2024-09-17T01:51:04.522 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95338.log 2024-09-17T01:51:04.524 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.105705.log: /var/log/ceph/ceph-client.admin.95338.log: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58616.log 2024-09-17T01:51:04.526 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.105705.log.gz 2024-09-17T01:51:04.526 INFO:teuthology.orchestra.run.smithi042.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.95338.log.gz 2024-09-17T01:51:04.528 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109621.log 2024-09-17T01:51:04.532 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.58616.log: /var/log/ceph/ceph-client.admin.109621.log: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66532.log 2024-09-17T01:51:04.532 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58616.log.gz 2024-09-17T01:51:04.534 INFO:teuthology.orchestra.run.smithi042.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109621.log.gz 2024-09-17T01:51:04.535 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41823.log 2024-09-17T01:51:04.540 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.66532.log: /var/log/ceph/ceph-client.admin.41823.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.41823.log.gz 2024-09-17T01:51:04.540 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55878.log 2024-09-17T01:51:04.544 INFO:teuthology.orchestra.run.smithi042.stderr: 90.8%/var/log/ceph/ceph-client.admin.55878.log: -- replaced with /var/log/ceph/ceph-client.admin.66532.log.gz 2024-09-17T01:51:04.544 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63412.log 2024-09-17T01:51:04.547 INFO:teuthology.orchestra.run.smithi042.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.55878.log.gz/var/log/ceph/ceph-client.admin.63412.log: 2024-09-17T01:51:04.548 INFO:teuthology.orchestra.run.smithi042.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63412.log.gz 2024-09-17T01:51:05.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-17T01:51:05.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-17T01:51:05.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-17T01:51:05.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-17T01:51:05.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-17T01:51:05.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-17T01:51:05.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-17T01:51:05.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-17T01:51:05.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-09-17T01:51:05.227 INFO:teuthology.orchestra.run.smithi042.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-17T01:51:05.237 INFO:teuthology.orchestra.run.smithi043.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-17T01:51:05.504 INFO:teuthology.orchestra.run.smithi043.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-17T01:51:05.921 INFO:teuthology.orchestra.run.smithi043.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-17T01:51:05.992 INFO:teuthology.orchestra.run.smithi042.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-17T01:51:06.015 INFO:teuthology.orchestra.run.smithi043.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-17T01:51:06.250 INFO:teuthology.orchestra.run.smithi043.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-17T01:51:06.253 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-09-17T01:51:06.253 INFO:teuthology.orchestra.run.smithi043.stderr:real 0m2.923s 2024-09-17T01:51:06.253 INFO:teuthology.orchestra.run.smithi043.stderr:user 0m12.799s 2024-09-17T01:51:06.253 INFO:teuthology.orchestra.run.smithi043.stderr:sys 0m1.176s 2024-09-17T01:51:06.461 INFO:teuthology.orchestra.run.smithi042.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-17T01:51:07.007 INFO:teuthology.orchestra.run.smithi042.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-17T01:51:07.171 INFO:teuthology.orchestra.run.smithi042.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-17T01:51:31.262 INFO:teuthology.orchestra.run.smithi042.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-17T01:51:35.637 INFO:teuthology.orchestra.run.smithi042.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-17T01:51:35.640 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-09-17T01:51:35.640 INFO:teuthology.orchestra.run.smithi042.stderr:real 0m32.314s 2024-09-17T01:51:35.640 INFO:teuthology.orchestra.run.smithi042.stderr:user 1m6.261s 2024-09-17T01:51:35.641 INFO:teuthology.orchestra.run.smithi042.stderr:sys 0m7.686s 2024-09-17T01:51:35.642 INFO:tasks.ceph:Archiving logs... 2024-09-17T01:51:35.642 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908333/remote/smithi042/log 2024-09-17T01:51:35.643 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T01:51:45.051 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908333/remote/smithi043/log 2024-09-17T01:51:45.052 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T01:51:46.704 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T01:51:46.714 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T01:51:46.714 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T01:51:46.719 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T01:51:46.828 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T01:51:46.838 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T01:51:46.838 DEBUG:teuthology.orchestra.run.smithi042:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T01:51:46.843 DEBUG:teuthology.orchestra.run.smithi043:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T01:51:46.875 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-09-17T01:51:46.878 INFO:teuthology.orchestra.run.smithi043.stderr:bash: line 1: ntpq: command not found 2024-09-17T01:51:46.882 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T01:51:46.882 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-09-17T01:51:46.882 INFO:teuthology.orchestra.run.smithi042.stdout:^* hv01.front.sepia.ceph.com 3 7 377 12 +2980us[+2982us] +/- 54ms 2024-09-17T01:51:46.882 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 13 -3098us[-3096us] +/- 69ms 2024-09-17T01:51:46.882 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 76 -2158us[-2156us] +/- 88ms 2024-09-17T01:51:46.882 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:51:46.885 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T01:51:46.885 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2024-09-17T01:51:46.885 INFO:teuthology.orchestra.run.smithi043.stdout:^* hv01.front.sepia.ceph.com 3 6 377 12 +3359us[+3344us] +/- 54ms 2024-09-17T01:51:46.885 INFO:teuthology.orchestra.run.smithi043.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 10 -2735us[-2735us] +/- 69ms 2024-09-17T01:51:46.885 INFO:teuthology.orchestra.run.smithi043.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 -1767us[-1767us] +/- 89ms 2024-09-17T01:51:46.885 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:51:46.886 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T01:51:46.895 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T01:51:46.896 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T01:51:46.903 DEBUG:teuthology.orchestra.run.smithi042:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T01:51:47.079 DEBUG:teuthology.orchestra.run.smithi043:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T01:51:47.200 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T01:51:47.263 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:51:47.263 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T01:51:47.323 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:51:47.324 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T01:51:47.333 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T01:51:47.341 INFO:teuthology.task.internal:Duration was 1667.396735 seconds 2024-09-17T01:51:47.342 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T01:51:47.350 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T01:51:47.351 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T01:51:47.355 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T01:51:47.438 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T01:51:47.442 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T01:51:47.947 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T01:51:47.947 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T01:51:47.948 DEBUG:teuthology.orchestra.run.smithi042:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T01:51:47.998 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi043.front.sepia.ceph.com 2024-09-17T01:51:47.999 DEBUG:teuthology.orchestra.run.smithi043:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T01:51:48.048 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T01:51:48.048 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T01:51:48.053 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T01:51:48.111 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T01:51:48.111 DEBUG:teuthology.orchestra.run.smithi042:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T01:51:48.115 DEBUG:teuthology.orchestra.run.smithi043:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T01:51:48.304 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T01:51:48.315 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T01:51:48.315 DEBUG:teuthology.orchestra.run.smithi042:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T01:51:48.371 DEBUG:teuthology.orchestra.run.smithi043:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T01:51:48.429 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T01:51:48.439 DEBUG:teuthology.orchestra.run.smithi042:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T01:51:48.444 DEBUG:teuthology.orchestra.run.smithi043:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T01:51:48.511 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = core 2024-09-17T01:51:48.514 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = core 2024-09-17T01:51:48.544 DEBUG:teuthology.orchestra.run.smithi042:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T01:51:48.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:51:48.578 DEBUG:teuthology.orchestra.run.smithi043:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T01:51:48.611 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:51:48.611 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T01:51:48.622 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T01:51:48.623 DEBUG:teuthology.misc:Transferring archived files from smithi042:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908333/remote/smithi042 2024-09-17T01:51:48.623 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T01:51:48.692 DEBUG:teuthology.misc:Transferring archived files from smithi043:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908333/remote/smithi043 2024-09-17T01:51:48.692 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T01:51:48.758 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T01:51:48.758 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T01:51:48.763 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T01:51:48.798 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T01:51:48.810 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T01:51:48.810 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T01:51:48.820 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T01:51:48.821 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T01:51:48.840 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T01:51:48.871 INFO:teuthology.orchestra.run.smithi042.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 01:51 /home/ubuntu/cephtest 2024-09-17T01:51:48.874 INFO:teuthology.orchestra.run.smithi043.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 01:51 /home/ubuntu/cephtest 2024-09-17T01:51:48.877 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T01:51:48.889 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T01:51:48.913 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a client.1-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/scrub} duration: 1667.3967349529266 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-17T01:51:48.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T01:51:48.994 INFO:teuthology.run:pass